2023-08-01T19:36:45.296 INFO:root:teuthology version: 0.0.1.dev174+g10753fd 2023-08-01T19:36:45.297 DEBUG:teuthology.run:Teuthology command: teuthology --name yuriw-2023-08-01_19:18:05-powercycle-quincy-distro-default-smithi --verbose --owner scheduled_yuriw@teuthology --archive /home/teuthworker/archive/yuriw-2023-08-01_19:18:05-powercycle-quincy-distro-default-smithi/7358036 --description powercycle/osd/{clusters/3osd-1per-target ignorelist_health objectstore/bluestore-comp-lz4 powercycle/default supported-all-distro/centos_8 tasks/admin_socket_objecter_requests thrashosds-health} -- /home/teuthworker/archive/yuriw-2023-08-01_19:18:05-powercycle-quincy-distro-default-smithi/7358036/orig.config.yaml 2023-08-01T19:36:45.332 DEBUG:teuthology.report:Pushing job info to https://paddles.front.sepia.ceph.com/ 2023-08-01T19:36:45.405 INFO:teuthology.run:Config: archive_path: /home/teuthworker/archive/yuriw-2023-08-01_19:18:05-powercycle-quincy-distro-default-smithi/7358036 branch: quincy description: powercycle/osd/{clusters/3osd-1per-target ignorelist_health objectstore/bluestore-comp-lz4 powercycle/default supported-all-distro/centos_8 tasks/admin_socket_objecter_requests thrashosds-health} email: yweinste@redhat.com first_in_suite: false job_id: '7358036' kernel: kdb: true sha1: distro last_in_suite: false machine_type: smithi name: yuriw-2023-08-01_19:18:05-powercycle-quincy-distro-default-smithi no_nested_subset: false nuke-on-error: true os_type: centos os_version: 8.stream overrides: admin_socket: branch: quincy ceph: conf: client.0: admin socket: /var/run/ceph/ceph-$name.asok mgr: debug mgr: 20 debug ms: 1 mon: debug mon: 20 debug ms: 1 debug paxos: 20 osd: bluestore block size: 96636764160 bluestore compression algorithm: lz4 bluestore compression mode: aggressive bluestore fsck on mount: true debug bluefs: 1/20 debug bluestore: 1/20 debug ms: 1 debug osd: 20 debug rocksdb: 4/10 mon osd backfillfull_ratio: 0.85 mon osd full ratio: 0.9 mon osd nearfull ratio: 0.8 osd failsafe full ratio: 0.95 osd max markdown count: 1000 osd objectstore: bluestore flavor: default fs: xfs log-ignorelist: - \(MDS_ALL_DOWN\) - \(MDS_UP_LESS_THAN_MAX\) - \(MDS_TRIM\) - \(MDS_SLOW_REQUEST\) - MDS_SLOW_METADATA_IO - Behind on trimming - overall HEALTH_ - \(OSDMAP_FLAGS\) - \(OSD_ - \(PG_ - \(POOL_ - \(CACHE_POOL_ - \(SMALLER_PGP_NUM\) - \(OBJECT_ - \(SLOW_OPS\) - \(REQUEST_SLOW\) - \(TOO_FEW_PGS\) - slow request sha1: 893fa35fffd26b5b50498e64ff6f7c94584d30b6 ceph-deploy: conf: client: log file: /var/log/ceph/ceph-$name.$pid.log mon: osd default pool size: 2 install: ceph: flavor: default sha1: 893fa35fffd26b5b50498e64ff6f7c94584d30b6 selinux: whitelist: - scontext=system_u:system_r:logrotate_t:s0 thrashosds: bdev_inject_crash: 2 bdev_inject_crash_probability: 0.5 workunit: branch: quincy sha1: a185a2e2933b21246ce41dd13f03fd6f8f84f03d owner: scheduled_yuriw@teuthology priority: 75 repo: https://github.com/ceph/ceph.git roles: - - mon.a - mon.b - mon.c - mgr.x - mgr.y - mds.a - client.0 - - osd.0 - - osd.1 - - osd.2 seed: 4358 sha1: 893fa35fffd26b5b50498e64ff6f7c94584d30b6 sleep_before_teardown: 0 subset: 111/120000 suite: powercycle suite_branch: quincy suite_path: /home/teuthworker/src/github.com_ceph_ceph_a185a2e2933b21246ce41dd13f03fd6f8f84f03d/qa suite_relpath: qa suite_repo: https://github.com/ceph/ceph.git suite_sha1: a185a2e2933b21246ce41dd13f03fd6f8f84f03d targets: smithi006.front.sepia.ceph.com: ssh-rsa AAAAB3NzaC1yc2EAAAADAQABAAABgQDHXsUNSlFLCzrtJm9UBoT8HA73bfB6pGWdupX8X3arUQObxAXBe9ZAFl4qAyQfUtKOl4Y4ewbQf0lQuzkxdmcFo9ssrFlpCneVtJRyO7Y7CFXUltf6V0mo4jUs9uQFtNQrKwHHd2d7v0IKV1tEXH5dbro66f3oVQzrZn7ogixBzTETd4+O70KhSO+iYRV8U31SCcWz69eao/JFNPo6V+16a4NfX4As0H7pf17QwrJ5+sBYp3DnJogBafJDx/MQiDW88Nvf42zPoFUzzZPgHFMonPvGIdP1z1VNn/rfjLj7H7qpKswngimYx4IVMLgE7xX16D7bhSxGzQ6vQrQJrIZNDiWXevziPZ+iRPAQUVp2IQS1LDrvwLqVQFugVUpCgRM8oURL9+Zg/3yNVgy8skDE3qxjqgSE6Sgi6N6/5AoZYdhukFuXLYq1M1EBMxr8CQtWzFkqZzD2NeYS1Hcjom7Gtt3foDenTaRskDWCXpNJtUVsv3VL/SrXjPfRM3xHVkc= smithi008.front.sepia.ceph.com: ssh-rsa AAAAB3NzaC1yc2EAAAADAQABAAABgQCpo1p1nkE5ovTqi960kuPvHnSVRMnkWXjOEFJRzWlwXqBbxdMjXpPpEkoH4KlErsqOIi0+3n5DG6I4JHOCeTpoKYJGv2ZlQava6mOn41ASUGhuB4NRIHJ5Qcc7hHfsSJH9Z0wuk1ZKRwoOkGKEriKFAZROjbq3khcaUObbDnz7qHFmG0BvFmQtjald6/ZFuown6frkSQ6BBgsGeMuUUYJbGBAmfXInmzClVeQrtuNd7WweNRmmM35NTjFzx1FVbZhcSq9acSjVyCeUgN2lmKE6H3isfsYA0eewNV3vs6IikHKghwEuCZ5o1G2vHEw/K3Jyd3GBqQ7oaSWdL7TN9oK3QSx2LdZCO8KHzlU72XkGLLkEfouNuEmeYTqcx602NGzyx4DBCCGYqkeCaW9P61GhtzoCgCiqcC0F7zpfn0t4n07nMU9Wb7EYufTBEUAi+d7y8LBzozsdnjBocq5jlI2VWRvF8kCKNseV0wJyTqPHnZmr8IdI1n8FhpDk9dMyLMc= smithi101.front.sepia.ceph.com: ssh-rsa AAAAB3NzaC1yc2EAAAADAQABAAABgQCqW1iyMvH01tgtwD2szts39NPYi3uTQWbKn9EWrYpK56zPLD/rE/SqQ125QXt/7HaO6hYaMio0skMpiD71gOEZ90SGmzTzwKnhW0maieFRDKECZswRY/HvXPB7SZZAU/DCv++WDnUbzoweiiVktY5taGp5iQwbyxcYzGQmjprf4X6JMsE/wnAPdqC/DmEzlULLPmjfs28QVGGBeBD8gq/NNHczjTG6ct9m1Qz4Bde8fZezYxzCZ1dxO+No8djYcnjr98uxNjvmlq5oKYAU1a3Unki5jy3dGEcaOWgDJA+d/wu7FzcNyXsarpmpSz36PLOzFQbNVzOENcGRSJi6QTCk5Psa7NUbC1L01wsGgrCKqp0z76JExnBCckHKx9MkCGwKz1IEsXJftHe/jqkJeFZelXzaWG3BTEyp+VhbgjodUpn/9A1GK02WTDj3plAZ35+vOkvEsd40/YGSG72jpLjX1sk/aZmth6z8ohXunB0jMLz9spVMcUet/JSR/ZEvu5c= smithi155.front.sepia.ceph.com: ssh-rsa AAAAB3NzaC1yc2EAAAADAQABAAABgQCuAqZ8xTboGrlX0Kh6ppzDfuvpjc5Ks+U6GpzzgfCJR55lEeqhy0U867PiGPRAEK868GP+fqDfgPuesLrQdjRDG2GWCAeHMTE3fCbsguHJHdproyBmS5SmCuN8M9FN014OgIdHv7zbouqawTS1n2LHLN/A6cVp7TKB9bmgNPjzYrEMKes+p2x0oH/xAKUbkEmH2tfaj1kABVQvxVnBkW6383s2VpQybCLR5pBZmFXIRbw2TDxclB/Ds/ZEL7nFhzSLkiuW6Uv8MrswEZUy7T+GIYI2hKQQNkpRKj8JQ+apMtXu4AKOyGO1pAOfnrgzCHyHww6bVdk4kBs//xmWFtftLBCmalMdYkil/pu475tB3J5m8Br+1WusGxm1m/ClFqTB0pDKWTBXUyP/QhH4FTqc5aDxB7Qdh9P39i0Ig/fgO7AfUk9dPyMk6FqGz5ijea3waXnwmUpnTVcwbIi5HLcPUSITtYcEWgAgd9Ero7Gs1S5OYtQpENC9fVIgu+gesO0= tasks: - install: extra_system_packages: deb: - bison - flex - libelf-dev - libssl-dev - libaio-dev - libtool-bin - uuid-dev - xfslibs-dev rpm: - bison - flex - elfutils-libelf-devel - openssl-devel - libaio-devel - libtool - libuuid-devel - xfsprogs-devel - ceph: null - thrashosds: chance_down: 1.0 powercycle: true timeout: 600 - radosbench: clients: - client.0 time: 60 - admin_socket: client.0: objecter_requests: test: http://git.ceph.com/?p={repo};a=blob_plain;f=src/test/admin_socket/objecter_requests;hb={branch} teuthology: fragments_dropped: [] meta: {} postmerge: [] teuthology_branch: main teuthology_sha1: 10753fdddd8d487ef9ffba05c09f1a055cd67877 timestamp: 2023-08-01_19:18:05 tube: smithi user: yuriw verbose: true worker_log: /home/teuthworker/archive/worker_logs/dispatcher.smithi.2021 2023-08-01T19:36:45.405 INFO:teuthology.run:suite_path is set to /home/teuthworker/src/github.com_ceph_ceph_a185a2e2933b21246ce41dd13f03fd6f8f84f03d/qa; will attempt to use it 2023-08-01T19:36:45.406 INFO:teuthology.run:Found tasks at /home/teuthworker/src/github.com_ceph_ceph_a185a2e2933b21246ce41dd13f03fd6f8f84f03d/qa/tasks 2023-08-01T19:36:45.406 INFO:teuthology.run_tasks:Running task internal.check_packages... 2023-08-01T19:36:45.408 INFO:teuthology.task.internal:Checking packages... 2023-08-01T19:36:45.437 INFO:teuthology.task.internal:Checking packages for os_type 'centos', flavor 'default' and ceph hash '893fa35fffd26b5b50498e64ff6f7c94584d30b6' 2023-08-01T19:36:45.437 WARNING:teuthology.packaging:More than one of ref, tag, branch, or sha1 supplied; using branch 2023-08-01T19:36:45.438 INFO:teuthology.packaging:ref: None 2023-08-01T19:36:45.438 INFO:teuthology.packaging:tag: None 2023-08-01T19:36:45.438 INFO:teuthology.packaging:branch: quincy 2023-08-01T19:36:45.438 INFO:teuthology.packaging:sha1: 893fa35fffd26b5b50498e64ff6f7c94584d30b6 2023-08-01T19:36:45.439 DEBUG:teuthology.packaging:Querying https://shaman.ceph.com/api/search?status=ready&project=ceph&flavor=default&distros=centos%2F8%2Fx86_64&ref=quincy 2023-08-01T19:36:45.639 INFO:teuthology.task.internal:Found packages for ceph version 17.2.6-825.ga185a2e2 2023-08-01T19:36:45.639 INFO:teuthology.run_tasks:Running task internal.buildpackages_prep... 2023-08-01T19:36:45.649 INFO:teuthology.task.internal:no buildpackages task found 2023-08-01T19:36:45.650 INFO:teuthology.run_tasks:Running task internal.save_config... 2023-08-01T19:36:45.656 INFO:teuthology.task.internal:Saving configuration 2023-08-01T19:36:45.670 INFO:teuthology.run_tasks:Running task internal.check_lock... 2023-08-01T19:36:45.680 INFO:teuthology.task.internal.check_lock:Checking locks... 2023-08-01T19:36:45.703 DEBUG:teuthology.task.internal.check_lock:machine status is {'name': 'smithi006.front.sepia.ceph.com', 'description': '/home/teuthworker/archive/yuriw-2023-08-01_19:18:05-powercycle-quincy-distro-default-smithi/7358036', 'up': True, 'machine_type': 'smithi', 'is_vm': False, 'vm_host': None, 'os_type': 'centos', 'os_version': '8', 'arch': 'x86_64', 'locked': True, 'locked_since': '2023-08-01 19:19:26.997992', 'locked_by': 'scheduled_yuriw@teuthology', 'mac_address': None, 'ssh_pub_key': 'ecdsa-sha2-nistp256 AAAAE2VjZHNhLXNoYTItbmlzdHAyNTYAAAAIbmlzdHAyNTYAAABBBFBeFCQtPQ0gmYZqag/Q7uWrwykdOAqKhqKchZ4OfpBSo8bfhvfTfyONhbpSt0WEI1/uAo5zrYHtXch2Io3bqK0='} 2023-08-01T19:36:45.727 DEBUG:teuthology.task.internal.check_lock:machine status is {'name': 'smithi008.front.sepia.ceph.com', 'description': '/home/teuthworker/archive/yuriw-2023-08-01_19:18:05-powercycle-quincy-distro-default-smithi/7358036', 'up': True, 'machine_type': 'smithi', 'is_vm': False, 'vm_host': None, 'os_type': 'centos', 'os_version': '8', 'arch': 'x86_64', 'locked': True, 'locked_since': '2023-08-01 19:19:27.000036', 'locked_by': 'scheduled_yuriw@teuthology', 'mac_address': None, 'ssh_pub_key': 'ecdsa-sha2-nistp256 AAAAE2VjZHNhLXNoYTItbmlzdHAyNTYAAAAIbmlzdHAyNTYAAABBBHjaMoCQAuEwIwFRx0DC4+7rvM/+VcgBdxxuYH1iP5uyracXW0jULQeFXwRIbjjIHhOwmNi2z2YHDjxGoLlmawI='} 2023-08-01T19:36:45.750 DEBUG:teuthology.task.internal.check_lock:machine status is {'name': 'smithi101.front.sepia.ceph.com', 'description': '/home/teuthworker/archive/yuriw-2023-08-01_19:18:05-powercycle-quincy-distro-default-smithi/7358036', 'up': True, 'machine_type': 'smithi', 'is_vm': False, 'vm_host': None, 'os_type': 'centos', 'os_version': '8', 'arch': 'x86_64', 'locked': True, 'locked_since': '2023-08-01 19:19:26.996745', 'locked_by': 'scheduled_yuriw@teuthology', 'mac_address': None, 'ssh_pub_key': 'ecdsa-sha2-nistp256 AAAAE2VjZHNhLXNoYTItbmlzdHAyNTYAAAAIbmlzdHAyNTYAAABBBEhdlVpUFRZf6t7FV0KdzU271HlfN0dXoOuNywhQHgQqqyx0ddeDOzXzUT0c7sj+NejUfe4rrKmlupoe/HaMug8='} 2023-08-01T19:36:45.777 DEBUG:teuthology.task.internal.check_lock:machine status is {'name': 'smithi155.front.sepia.ceph.com', 'description': '/home/teuthworker/archive/yuriw-2023-08-01_19:18:05-powercycle-quincy-distro-default-smithi/7358036', 'up': True, 'machine_type': 'smithi', 'is_vm': False, 'vm_host': None, 'os_type': 'centos', 'os_version': '8', 'arch': 'x86_64', 'locked': True, 'locked_since': '2023-08-01 19:19:26.999012', 'locked_by': 'scheduled_yuriw@teuthology', 'mac_address': None, 'ssh_pub_key': 'ecdsa-sha2-nistp256 AAAAE2VjZHNhLXNoYTItbmlzdHAyNTYAAAAIbmlzdHAyNTYAAABBBIObfCq81zxTI3ssdEc/1BB0VAD7Kcdla2IoDBT5YhnOG4x0TahdZ4odvRTeE8wwlg3tju2O0NIIqVfCG4GQnOk='} 2023-08-01T19:36:45.777 INFO:teuthology.run_tasks:Running task internal.add_remotes... 2023-08-01T19:36:45.783 INFO:teuthology.task.internal:roles: ubuntu@smithi006.front.sepia.ceph.com - ['mon.a', 'mon.b', 'mon.c', 'mgr.x', 'mgr.y', 'mds.a', 'client.0'] 2023-08-01T19:36:45.783 INFO:teuthology.task.internal:roles: ubuntu@smithi008.front.sepia.ceph.com - ['osd.0'] 2023-08-01T19:36:45.783 INFO:teuthology.task.internal:roles: ubuntu@smithi101.front.sepia.ceph.com - ['osd.1'] 2023-08-01T19:36:45.783 INFO:teuthology.task.internal:roles: ubuntu@smithi155.front.sepia.ceph.com - ['osd.2'] 2023-08-01T19:36:45.784 INFO:teuthology.run_tasks:Running task console_log... 2023-08-01T19:36:45.932 DEBUG:teuthology.exit:Installing handler: Handler(exiter=, func=.kill_console_loggers at 0x7f4e6bd10e50>, signals=[15]) 2023-08-01T19:36:45.934 INFO:teuthology.run_tasks:Running task internal.connect... 2023-08-01T19:36:45.940 INFO:teuthology.task.internal:Opening connections... 2023-08-01T19:36:45.941 DEBUG:teuthology.task.internal:connecting to ubuntu@smithi006.front.sepia.ceph.com 2023-08-01T19:36:45.942 DEBUG:teuthology.orchestra.connection:{'hostname': 'smithi006.front.sepia.ceph.com', 'username': 'ubuntu', 'timeout': 60} 2023-08-01T19:36:46.030 DEBUG:teuthology.task.internal:connecting to ubuntu@smithi008.front.sepia.ceph.com 2023-08-01T19:36:46.031 DEBUG:teuthology.orchestra.connection:{'hostname': 'smithi008.front.sepia.ceph.com', 'username': 'ubuntu', 'timeout': 60} 2023-08-01T19:36:46.102 DEBUG:teuthology.task.internal:connecting to ubuntu@smithi101.front.sepia.ceph.com 2023-08-01T19:36:46.103 DEBUG:teuthology.orchestra.connection:{'hostname': 'smithi101.front.sepia.ceph.com', 'username': 'ubuntu', 'timeout': 60} 2023-08-01T19:36:46.172 DEBUG:teuthology.task.internal:connecting to ubuntu@smithi155.front.sepia.ceph.com 2023-08-01T19:36:46.173 DEBUG:teuthology.orchestra.connection:{'hostname': 'smithi155.front.sepia.ceph.com', 'username': 'ubuntu', 'timeout': 60} 2023-08-01T19:36:46.245 INFO:teuthology.run_tasks:Running task internal.push_inventory... 2023-08-01T19:36:46.253 DEBUG:teuthology.orchestra.run.smithi006:> uname -m 2023-08-01T19:36:46.278 INFO:teuthology.orchestra.run.smithi006.stdout:x86_64 2023-08-01T19:36:46.278 DEBUG:teuthology.orchestra.run.smithi006:> cat /etc/os-release 2023-08-01T19:36:46.340 INFO:teuthology.orchestra.run.smithi006.stdout:NAME="CentOS Stream" 2023-08-01T19:36:46.341 INFO:teuthology.orchestra.run.smithi006.stdout:VERSION="8" 2023-08-01T19:36:46.341 INFO:teuthology.orchestra.run.smithi006.stdout:ID="centos" 2023-08-01T19:36:46.341 INFO:teuthology.orchestra.run.smithi006.stdout:ID_LIKE="rhel fedora" 2023-08-01T19:36:46.341 INFO:teuthology.orchestra.run.smithi006.stdout:VERSION_ID="8" 2023-08-01T19:36:46.341 INFO:teuthology.orchestra.run.smithi006.stdout:PLATFORM_ID="platform:el8" 2023-08-01T19:36:46.341 INFO:teuthology.orchestra.run.smithi006.stdout:PRETTY_NAME="CentOS Stream 8" 2023-08-01T19:36:46.342 INFO:teuthology.orchestra.run.smithi006.stdout:ANSI_COLOR="0;31" 2023-08-01T19:36:46.342 INFO:teuthology.orchestra.run.smithi006.stdout:CPE_NAME="cpe:/o:centos:centos:8" 2023-08-01T19:36:46.342 INFO:teuthology.orchestra.run.smithi006.stdout:HOME_URL="https://centos.org/" 2023-08-01T19:36:46.342 INFO:teuthology.orchestra.run.smithi006.stdout:BUG_REPORT_URL="https://bugzilla.redhat.com/" 2023-08-01T19:36:46.342 INFO:teuthology.orchestra.run.smithi006.stdout:REDHAT_SUPPORT_PRODUCT="Red Hat Enterprise Linux 8" 2023-08-01T19:36:46.342 INFO:teuthology.orchestra.run.smithi006.stdout:REDHAT_SUPPORT_PRODUCT_VERSION="CentOS Stream" 2023-08-01T19:36:46.343 INFO:teuthology.lock.ops:Updating smithi006.front.sepia.ceph.com on lock server 2023-08-01T19:36:46.365 DEBUG:teuthology.orchestra.run.smithi008:> uname -m 2023-08-01T19:36:46.388 INFO:teuthology.orchestra.run.smithi008.stdout:x86_64 2023-08-01T19:36:46.389 DEBUG:teuthology.orchestra.run.smithi008:> cat /etc/os-release 2023-08-01T19:36:46.451 INFO:teuthology.orchestra.run.smithi008.stdout:NAME="CentOS Stream" 2023-08-01T19:36:46.451 INFO:teuthology.orchestra.run.smithi008.stdout:VERSION="8" 2023-08-01T19:36:46.452 INFO:teuthology.orchestra.run.smithi008.stdout:ID="centos" 2023-08-01T19:36:46.452 INFO:teuthology.orchestra.run.smithi008.stdout:ID_LIKE="rhel fedora" 2023-08-01T19:36:46.452 INFO:teuthology.orchestra.run.smithi008.stdout:VERSION_ID="8" 2023-08-01T19:36:46.452 INFO:teuthology.orchestra.run.smithi008.stdout:PLATFORM_ID="platform:el8" 2023-08-01T19:36:46.452 INFO:teuthology.orchestra.run.smithi008.stdout:PRETTY_NAME="CentOS Stream 8" 2023-08-01T19:36:46.452 INFO:teuthology.orchestra.run.smithi008.stdout:ANSI_COLOR="0;31" 2023-08-01T19:36:46.452 INFO:teuthology.orchestra.run.smithi008.stdout:CPE_NAME="cpe:/o:centos:centos:8" 2023-08-01T19:36:46.453 INFO:teuthology.orchestra.run.smithi008.stdout:HOME_URL="https://centos.org/" 2023-08-01T19:36:46.453 INFO:teuthology.orchestra.run.smithi008.stdout:BUG_REPORT_URL="https://bugzilla.redhat.com/" 2023-08-01T19:36:46.453 INFO:teuthology.orchestra.run.smithi008.stdout:REDHAT_SUPPORT_PRODUCT="Red Hat Enterprise Linux 8" 2023-08-01T19:36:46.453 INFO:teuthology.orchestra.run.smithi008.stdout:REDHAT_SUPPORT_PRODUCT_VERSION="CentOS Stream" 2023-08-01T19:36:46.453 INFO:teuthology.lock.ops:Updating smithi008.front.sepia.ceph.com on lock server 2023-08-01T19:36:46.473 DEBUG:teuthology.orchestra.run.smithi101:> uname -m 2023-08-01T19:36:46.495 INFO:teuthology.orchestra.run.smithi101.stdout:x86_64 2023-08-01T19:36:46.496 DEBUG:teuthology.orchestra.run.smithi101:> cat /etc/os-release 2023-08-01T19:36:46.556 INFO:teuthology.orchestra.run.smithi101.stdout:NAME="CentOS Stream" 2023-08-01T19:36:46.556 INFO:teuthology.orchestra.run.smithi101.stdout:VERSION="8" 2023-08-01T19:36:46.556 INFO:teuthology.orchestra.run.smithi101.stdout:ID="centos" 2023-08-01T19:36:46.556 INFO:teuthology.orchestra.run.smithi101.stdout:ID_LIKE="rhel fedora" 2023-08-01T19:36:46.557 INFO:teuthology.orchestra.run.smithi101.stdout:VERSION_ID="8" 2023-08-01T19:36:46.557 INFO:teuthology.orchestra.run.smithi101.stdout:PLATFORM_ID="platform:el8" 2023-08-01T19:36:46.557 INFO:teuthology.orchestra.run.smithi101.stdout:PRETTY_NAME="CentOS Stream 8" 2023-08-01T19:36:46.557 INFO:teuthology.orchestra.run.smithi101.stdout:ANSI_COLOR="0;31" 2023-08-01T19:36:46.557 INFO:teuthology.orchestra.run.smithi101.stdout:CPE_NAME="cpe:/o:centos:centos:8" 2023-08-01T19:36:46.557 INFO:teuthology.orchestra.run.smithi101.stdout:HOME_URL="https://centos.org/" 2023-08-01T19:36:46.557 INFO:teuthology.orchestra.run.smithi101.stdout:BUG_REPORT_URL="https://bugzilla.redhat.com/" 2023-08-01T19:36:46.557 INFO:teuthology.orchestra.run.smithi101.stdout:REDHAT_SUPPORT_PRODUCT="Red Hat Enterprise Linux 8" 2023-08-01T19:36:46.558 INFO:teuthology.orchestra.run.smithi101.stdout:REDHAT_SUPPORT_PRODUCT_VERSION="CentOS Stream" 2023-08-01T19:36:46.558 INFO:teuthology.lock.ops:Updating smithi101.front.sepia.ceph.com on lock server 2023-08-01T19:36:46.581 DEBUG:teuthology.orchestra.run.smithi155:> uname -m 2023-08-01T19:36:46.603 INFO:teuthology.orchestra.run.smithi155.stdout:x86_64 2023-08-01T19:36:46.603 DEBUG:teuthology.orchestra.run.smithi155:> cat /etc/os-release 2023-08-01T19:36:46.665 INFO:teuthology.orchestra.run.smithi155.stdout:NAME="CentOS Stream" 2023-08-01T19:36:46.666 INFO:teuthology.orchestra.run.smithi155.stdout:VERSION="8" 2023-08-01T19:36:46.666 INFO:teuthology.orchestra.run.smithi155.stdout:ID="centos" 2023-08-01T19:36:46.666 INFO:teuthology.orchestra.run.smithi155.stdout:ID_LIKE="rhel fedora" 2023-08-01T19:36:46.666 INFO:teuthology.orchestra.run.smithi155.stdout:VERSION_ID="8" 2023-08-01T19:36:46.666 INFO:teuthology.orchestra.run.smithi155.stdout:PLATFORM_ID="platform:el8" 2023-08-01T19:36:46.667 INFO:teuthology.orchestra.run.smithi155.stdout:PRETTY_NAME="CentOS Stream 8" 2023-08-01T19:36:46.667 INFO:teuthology.orchestra.run.smithi155.stdout:ANSI_COLOR="0;31" 2023-08-01T19:36:46.668 INFO:teuthology.orchestra.run.smithi155.stdout:CPE_NAME="cpe:/o:centos:centos:8" 2023-08-01T19:36:46.668 INFO:teuthology.orchestra.run.smithi155.stdout:HOME_URL="https://centos.org/" 2023-08-01T19:36:46.669 INFO:teuthology.orchestra.run.smithi155.stdout:BUG_REPORT_URL="https://bugzilla.redhat.com/" 2023-08-01T19:36:46.669 INFO:teuthology.orchestra.run.smithi155.stdout:REDHAT_SUPPORT_PRODUCT="Red Hat Enterprise Linux 8" 2023-08-01T19:36:46.669 INFO:teuthology.orchestra.run.smithi155.stdout:REDHAT_SUPPORT_PRODUCT_VERSION="CentOS Stream" 2023-08-01T19:36:46.669 INFO:teuthology.lock.ops:Updating smithi155.front.sepia.ceph.com on lock server 2023-08-01T19:36:46.690 INFO:teuthology.run_tasks:Running task internal.serialize_remote_roles... 2023-08-01T19:36:46.701 INFO:teuthology.run_tasks:Running task internal.check_conflict... 2023-08-01T19:36:46.758 INFO:teuthology.task.internal:Checking for old test directory... 2023-08-01T19:36:46.758 DEBUG:teuthology.orchestra.run.smithi006:> test '!' -e /home/ubuntu/cephtest 2023-08-01T19:36:46.761 DEBUG:teuthology.orchestra.run.smithi008:> test '!' -e /home/ubuntu/cephtest 2023-08-01T19:36:46.764 DEBUG:teuthology.orchestra.run.smithi101:> test '!' -e /home/ubuntu/cephtest 2023-08-01T19:36:46.766 DEBUG:teuthology.orchestra.run.smithi155:> test '!' -e /home/ubuntu/cephtest 2023-08-01T19:36:46.793 INFO:teuthology.run_tasks:Running task internal.check_ceph_data... 2023-08-01T19:36:46.801 INFO:teuthology.task.internal:Checking for non-empty /var/lib/ceph... 2023-08-01T19:36:46.802 DEBUG:teuthology.orchestra.run.smithi006:> test -z $(ls -A /var/lib/ceph) 2023-08-01T19:36:46.824 DEBUG:teuthology.orchestra.run.smithi008:> test -z $(ls -A /var/lib/ceph) 2023-08-01T19:36:46.826 DEBUG:teuthology.orchestra.run.smithi101:> test -z $(ls -A /var/lib/ceph) 2023-08-01T19:36:46.829 DEBUG:teuthology.orchestra.run.smithi155:> test -z $(ls -A /var/lib/ceph) 2023-08-01T19:36:46.861 INFO:teuthology.run_tasks:Running task internal.vm_setup... 2023-08-01T19:36:46.963 INFO:teuthology.run_tasks:Running task kernel... 2023-08-01T19:36:46.984 INFO:teuthology.task.kernel:normalize config orig: {'kdb': True, 'sha1': 'distro'} 2023-08-01T19:36:46.985 INFO:teuthology.task.kernel:config {'mon.a': {'kdb': True, 'sha1': 'distro'}, 'osd.0': {'kdb': True, 'sha1': 'distro'}, 'osd.1': {'kdb': True, 'sha1': 'distro'}, 'osd.2': {'kdb': True, 'sha1': 'distro'}}, timeout 300 2023-08-01T19:36:46.985 DEBUG:teuthology.orchestra.run.smithi006:> test -f /run/.containerenv -o -f /.dockerenv 2023-08-01T19:36:46.986 DEBUG:teuthology.orchestra.run.smithi008:> test -f /run/.containerenv -o -f /.dockerenv 2023-08-01T19:36:46.986 DEBUG:teuthology.orchestra.run.smithi101:> test -f /run/.containerenv -o -f /.dockerenv 2023-08-01T19:36:46.987 DEBUG:teuthology.orchestra.run.smithi155:> test -f /run/.containerenv -o -f /.dockerenv 2023-08-01T19:36:47.007 DEBUG:teuthology.orchestra.run:got remote process result: 1 2023-08-01T19:36:47.008 DEBUG:teuthology.orchestra.run.smithi155:> uname -r 2023-08-01T19:36:47.009 DEBUG:teuthology.orchestra.run:got remote process result: 1 2023-08-01T19:36:47.010 DEBUG:teuthology.orchestra.run:got remote process result: 1 2023-08-01T19:36:47.010 DEBUG:teuthology.orchestra.run:got remote process result: 1 2023-08-01T19:36:47.011 DEBUG:teuthology.orchestra.run.smithi008:> uname -r 2023-08-01T19:36:47.011 DEBUG:teuthology.orchestra.run.smithi101:> uname -r 2023-08-01T19:36:47.012 DEBUG:teuthology.orchestra.run.smithi006:> uname -r 2023-08-01T19:36:47.069 INFO:teuthology.orchestra.run.smithi155.stdout:4.18.0-489.el8.x86_64 2023-08-01T19:36:47.070 INFO:teuthology.task.kernel:Running kernel on smithi155: 4.18.0-489.el8.x86_64 2023-08-01T19:36:47.070 DEBUG:teuthology.orchestra.run.smithi155:> sudo yum install -y kernel 2023-08-01T19:36:47.071 INFO:teuthology.orchestra.run.smithi006.stdout:4.18.0-489.el8.x86_64 2023-08-01T19:36:47.071 INFO:teuthology.task.kernel:Running kernel on smithi006: 4.18.0-489.el8.x86_64 2023-08-01T19:36:47.072 DEBUG:teuthology.orchestra.run.smithi006:> sudo yum install -y kernel 2023-08-01T19:36:47.074 INFO:teuthology.orchestra.run.smithi008.stdout:4.18.0-489.el8.x86_64 2023-08-01T19:36:47.074 INFO:teuthology.orchestra.run.smithi101.stdout:4.18.0-489.el8.x86_64 2023-08-01T19:36:47.074 INFO:teuthology.task.kernel:Running kernel on smithi008: 4.18.0-489.el8.x86_64 2023-08-01T19:36:47.075 DEBUG:teuthology.orchestra.run.smithi008:> sudo yum install -y kernel 2023-08-01T19:36:47.075 INFO:teuthology.task.kernel:Running kernel on smithi101: 4.18.0-489.el8.x86_64 2023-08-01T19:36:47.075 DEBUG:teuthology.orchestra.run.smithi101:> sudo yum install -y kernel 2023-08-01T19:36:54.377 INFO:teuthology.orchestra.run.smithi155.stdout:CentOS Stream 8 - AppStream 6.6 MB/s | 31 MB 00:04 2023-08-01T19:36:54.464 INFO:teuthology.orchestra.run.smithi008.stdout:CentOS Stream 8 - AppStream 6.5 MB/s | 31 MB 00:04 2023-08-01T19:36:54.904 INFO:teuthology.orchestra.run.smithi006.stdout:CentOS Stream 8 - AppStream 6.1 MB/s | 31 MB 00:05 2023-08-01T19:36:54.960 INFO:teuthology.orchestra.run.smithi101.stdout:CentOS Stream 8 - AppStream 5.9 MB/s | 31 MB 00:05 2023-08-01T19:37:02.532 INFO:teuthology.orchestra.run.smithi155.stdout:CentOS Stream 8 - BaseOS 16 MB/s | 41 MB 00:02 2023-08-01T19:37:02.748 INFO:teuthology.orchestra.run.smithi008.stdout:CentOS Stream 8 - BaseOS 17 MB/s | 41 MB 00:02 2023-08-01T19:37:03.818 INFO:teuthology.orchestra.run.smithi101.stdout:CentOS Stream 8 - BaseOS 13 MB/s | 41 MB 00:03 2023-08-01T19:37:03.870 INFO:teuthology.orchestra.run.smithi006.stdout:CentOS Stream 8 - BaseOS 13 MB/s | 41 MB 00:03 2023-08-01T19:37:09.448 INFO:teuthology.orchestra.run.smithi008.stdout:CentOS Stream 8 - Extras 50 kB/s | 18 kB 00:00 2023-08-01T19:37:10.015 INFO:teuthology.orchestra.run.smithi008.stdout:CentOS Stream 8 - Extras common packages 17 kB/s | 6.6 kB 00:00 2023-08-01T19:37:10.317 INFO:teuthology.orchestra.run.smithi008.stdout:Copr repo for python3-asyncssh owned by ceph 24 kB/s | 3.5 kB 00:00 2023-08-01T19:37:10.344 INFO:teuthology.orchestra.run.smithi101.stdout:CentOS Stream 8 - Extras 48 kB/s | 18 kB 00:00 2023-08-01T19:37:10.654 INFO:teuthology.orchestra.run.smithi006.stdout:CentOS Stream 8 - Extras 47 kB/s | 18 kB 00:00 2023-08-01T19:37:11.251 INFO:teuthology.orchestra.run.smithi008.stdout:Extra Packages for Enterprise Linux 20 MB/s | 16 MB 00:00 2023-08-01T19:37:11.952 INFO:teuthology.orchestra.run.smithi101.stdout:CentOS Stream 8 - Extras common packages 4.6 kB/s | 6.6 kB 00:01 2023-08-01T19:37:12.235 INFO:teuthology.orchestra.run.smithi155.stdout:CentOS Stream 8 - Extras 4.7 kB/s | 18 kB 00:03 2023-08-01T19:37:12.254 INFO:teuthology.orchestra.run.smithi101.stdout:Copr repo for python3-asyncssh owned by ceph 23 kB/s | 3.5 kB 00:00 2023-08-01T19:37:12.744 INFO:teuthology.orchestra.run.smithi155.stdout:CentOS Stream 8 - Extras common packages 20 kB/s | 6.6 kB 00:00 2023-08-01T19:37:13.037 INFO:teuthology.orchestra.run.smithi155.stdout:Copr repo for python3-asyncssh owned by ceph 23 kB/s | 3.5 kB 00:00 2023-08-01T19:37:13.204 INFO:teuthology.orchestra.run.smithi006.stdout:CentOS Stream 8 - Extras common packages 2.8 kB/s | 6.6 kB 00:02 2023-08-01T19:37:13.514 INFO:teuthology.orchestra.run.smithi006.stdout:Copr repo for python3-asyncssh owned by ceph 24 kB/s | 3.5 kB 00:00 2023-08-01T19:37:14.225 INFO:teuthology.orchestra.run.smithi155.stdout:Extra Packages for Enterprise Linux 15 MB/s | 16 MB 00:01 2023-08-01T19:37:14.941 INFO:teuthology.orchestra.run.smithi101.stdout:Extra Packages for Enterprise Linux 6.1 MB/s | 16 MB 00:02 2023-08-01T19:37:15.193 INFO:teuthology.orchestra.run.smithi008.stdout:lab-extras 534 kB/s | 24 kB 00:00 2023-08-01T19:37:17.946 INFO:teuthology.orchestra.run.smithi155.stdout:lab-extras 482 kB/s | 24 kB 00:00 2023-08-01T19:37:18.508 INFO:teuthology.orchestra.run.smithi008.stdout:Package kernel-4.18.0-348.el8.x86_64 is already installed. 2023-08-01T19:37:18.509 INFO:teuthology.orchestra.run.smithi008.stdout:Package kernel-4.18.0-489.el8.x86_64 is already installed. 2023-08-01T19:37:18.752 INFO:teuthology.orchestra.run.smithi008.stdout:Dependencies resolved. 2023-08-01T19:37:18.753 INFO:teuthology.orchestra.run.smithi008.stdout:================================================================================ 2023-08-01T19:37:18.754 INFO:teuthology.orchestra.run.smithi008.stdout: Package Architecture Version Repository Size 2023-08-01T19:37:18.754 INFO:teuthology.orchestra.run.smithi008.stdout:================================================================================ 2023-08-01T19:37:18.754 INFO:teuthology.orchestra.run.smithi008.stdout:Installing: 2023-08-01T19:37:18.755 INFO:teuthology.orchestra.run.smithi008.stdout: kernel x86_64 4.18.0-500.el8 baseos 9.8 M 2023-08-01T19:37:18.755 INFO:teuthology.orchestra.run.smithi008.stdout:Installing dependencies: 2023-08-01T19:37:18.755 INFO:teuthology.orchestra.run.smithi008.stdout: kernel-core x86_64 4.18.0-500.el8 baseos 43 M 2023-08-01T19:37:18.755 INFO:teuthology.orchestra.run.smithi008.stdout: kernel-modules x86_64 4.18.0-500.el8 baseos 35 M 2023-08-01T19:37:18.756 INFO:teuthology.orchestra.run.smithi008.stdout: 2023-08-01T19:37:18.756 INFO:teuthology.orchestra.run.smithi008.stdout:Transaction Summary 2023-08-01T19:37:18.756 INFO:teuthology.orchestra.run.smithi008.stdout:================================================================================ 2023-08-01T19:37:18.757 INFO:teuthology.orchestra.run.smithi008.stdout:Install 3 Packages 2023-08-01T19:37:18.757 INFO:teuthology.orchestra.run.smithi008.stdout: 2023-08-01T19:37:18.757 INFO:teuthology.orchestra.run.smithi008.stdout:Total download size: 88 M 2023-08-01T19:37:18.757 INFO:teuthology.orchestra.run.smithi008.stdout:Installed size: 95 M 2023-08-01T19:37:18.758 INFO:teuthology.orchestra.run.smithi008.stdout:Downloading Packages: 2023-08-01T19:37:18.805 INFO:teuthology.orchestra.run.smithi101.stdout:lab-extras 395 kB/s | 24 kB 00:00 2023-08-01T19:37:20.219 INFO:teuthology.orchestra.run.smithi008.stdout:(1/3): kernel-4.18.0-500.el8.x86_64.rpm 6.9 MB/s | 9.8 MB 00:01 2023-08-01T19:37:21.179 INFO:teuthology.orchestra.run.smithi155.stdout:Package kernel-4.18.0-348.el8.x86_64 is already installed. 2023-08-01T19:37:21.179 INFO:teuthology.orchestra.run.smithi155.stdout:Package kernel-4.18.0-489.el8.x86_64 is already installed. 2023-08-01T19:37:21.278 INFO:teuthology.orchestra.run.smithi008.stdout:(2/3): kernel-modules-4.18.0-500.el8.x86_64.rpm 14 MB/s | 35 MB 00:02 2023-08-01T19:37:21.306 INFO:teuthology.orchestra.run.smithi006.stdout:Extra Packages for Enterprise Linux 2.0 MB/s | 16 MB 00:07 2023-08-01T19:37:21.409 INFO:teuthology.orchestra.run.smithi155.stdout:Dependencies resolved. 2023-08-01T19:37:21.410 INFO:teuthology.orchestra.run.smithi155.stdout:================================================================================ 2023-08-01T19:37:21.410 INFO:teuthology.orchestra.run.smithi155.stdout: Package Architecture Version Repository Size 2023-08-01T19:37:21.411 INFO:teuthology.orchestra.run.smithi155.stdout:================================================================================ 2023-08-01T19:37:21.411 INFO:teuthology.orchestra.run.smithi155.stdout:Installing: 2023-08-01T19:37:21.411 INFO:teuthology.orchestra.run.smithi155.stdout: kernel x86_64 4.18.0-500.el8 baseos 9.8 M 2023-08-01T19:37:21.412 INFO:teuthology.orchestra.run.smithi155.stdout:Installing dependencies: 2023-08-01T19:37:21.412 INFO:teuthology.orchestra.run.smithi155.stdout: kernel-core x86_64 4.18.0-500.el8 baseos 43 M 2023-08-01T19:37:21.412 INFO:teuthology.orchestra.run.smithi155.stdout: kernel-modules x86_64 4.18.0-500.el8 baseos 35 M 2023-08-01T19:37:21.412 INFO:teuthology.orchestra.run.smithi155.stdout: 2023-08-01T19:37:21.412 INFO:teuthology.orchestra.run.smithi155.stdout:Transaction Summary 2023-08-01T19:37:21.413 INFO:teuthology.orchestra.run.smithi155.stdout:================================================================================ 2023-08-01T19:37:21.413 INFO:teuthology.orchestra.run.smithi155.stdout:Install 3 Packages 2023-08-01T19:37:21.413 INFO:teuthology.orchestra.run.smithi155.stdout: 2023-08-01T19:37:21.414 INFO:teuthology.orchestra.run.smithi155.stdout:Total download size: 88 M 2023-08-01T19:37:21.414 INFO:teuthology.orchestra.run.smithi155.stdout:Installed size: 95 M 2023-08-01T19:37:21.414 INFO:teuthology.orchestra.run.smithi155.stdout:Downloading Packages: 2023-08-01T19:37:22.011 INFO:teuthology.orchestra.run.smithi008.stdout:(3/3): kernel-core-4.18.0-500.el8.x86_64.rpm 13 MB/s | 43 MB 00:03 2023-08-01T19:37:22.012 INFO:teuthology.orchestra.run.smithi008.stdout:-------------------------------------------------------------------------------- 2023-08-01T19:37:22.012 INFO:teuthology.orchestra.run.smithi008.stdout:Total 27 MB/s | 88 MB 00:03 2023-08-01T19:37:22.029 INFO:teuthology.orchestra.run.smithi101.stdout:Package kernel-4.18.0-348.el8.x86_64 is already installed. 2023-08-01T19:37:22.029 INFO:teuthology.orchestra.run.smithi101.stdout:Package kernel-4.18.0-489.el8.x86_64 is already installed. 2023-08-01T19:37:22.260 INFO:teuthology.orchestra.run.smithi101.stdout:Dependencies resolved. 2023-08-01T19:37:22.262 INFO:teuthology.orchestra.run.smithi101.stdout:================================================================================ 2023-08-01T19:37:22.262 INFO:teuthology.orchestra.run.smithi101.stdout: Package Architecture Version Repository Size 2023-08-01T19:37:22.263 INFO:teuthology.orchestra.run.smithi101.stdout:================================================================================ 2023-08-01T19:37:22.263 INFO:teuthology.orchestra.run.smithi101.stdout:Installing: 2023-08-01T19:37:22.263 INFO:teuthology.orchestra.run.smithi101.stdout: kernel x86_64 4.18.0-500.el8 baseos 9.8 M 2023-08-01T19:37:22.263 INFO:teuthology.orchestra.run.smithi101.stdout:Installing dependencies: 2023-08-01T19:37:22.264 INFO:teuthology.orchestra.run.smithi101.stdout: kernel-core x86_64 4.18.0-500.el8 baseos 43 M 2023-08-01T19:37:22.264 INFO:teuthology.orchestra.run.smithi101.stdout: kernel-modules x86_64 4.18.0-500.el8 baseos 35 M 2023-08-01T19:37:22.264 INFO:teuthology.orchestra.run.smithi101.stdout: 2023-08-01T19:37:22.265 INFO:teuthology.orchestra.run.smithi101.stdout:Transaction Summary 2023-08-01T19:37:22.265 INFO:teuthology.orchestra.run.smithi101.stdout:================================================================================ 2023-08-01T19:37:22.265 INFO:teuthology.orchestra.run.smithi101.stdout:Install 3 Packages 2023-08-01T19:37:22.265 INFO:teuthology.orchestra.run.smithi101.stdout: 2023-08-01T19:37:22.265 INFO:teuthology.orchestra.run.smithi101.stdout:Total download size: 88 M 2023-08-01T19:37:22.265 INFO:teuthology.orchestra.run.smithi101.stdout:Installed size: 95 M 2023-08-01T19:37:22.266 INFO:teuthology.orchestra.run.smithi101.stdout:Downloading Packages: 2023-08-01T19:37:22.707 INFO:teuthology.orchestra.run.smithi008.stdout:Running transaction check 2023-08-01T19:37:22.806 INFO:teuthology.orchestra.run.smithi155.stdout:(1/3): kernel-4.18.0-500.el8.x86_64.rpm 7.3 MB/s | 9.8 MB 00:01 2023-08-01T19:37:23.127 INFO:teuthology.orchestra.run.smithi008.stdout:Transaction check succeeded. 2023-08-01T19:37:23.128 INFO:teuthology.orchestra.run.smithi008.stdout:Running transaction test 2023-08-01T19:37:23.748 INFO:teuthology.orchestra.run.smithi101.stdout:(1/3): kernel-4.18.0-500.el8.x86_64.rpm 6.8 MB/s | 9.8 MB 00:01 2023-08-01T19:37:24.006 INFO:teuthology.orchestra.run.smithi155.stdout:(2/3): kernel-modules-4.18.0-500.el8.x86_64.rpm 14 MB/s | 35 MB 00:02 2023-08-01T19:37:24.416 INFO:teuthology.orchestra.run.smithi008.stdout:Transaction test succeeded. 2023-08-01T19:37:24.433 INFO:teuthology.orchestra.run.smithi008.stdout:Running transaction 2023-08-01T19:37:24.589 INFO:teuthology.orchestra.run.smithi155.stdout:(3/3): kernel-core-4.18.0-500.el8.x86_64.rpm 14 MB/s | 43 MB 00:03 2023-08-01T19:37:24.590 INFO:teuthology.orchestra.run.smithi155.stdout:-------------------------------------------------------------------------------- 2023-08-01T19:37:24.590 INFO:teuthology.orchestra.run.smithi155.stdout:Total 28 MB/s | 88 MB 00:03 2023-08-01T19:37:24.773 INFO:teuthology.orchestra.run.smithi101.stdout:(2/3): kernel-modules-4.18.0-500.el8.x86_64.rpm 14 MB/s | 35 MB 00:02 2023-08-01T19:37:25.253 INFO:teuthology.orchestra.run.smithi155.stdout:Running transaction check 2023-08-01T19:37:25.332 INFO:teuthology.orchestra.run.smithi101.stdout:(3/3): kernel-core-4.18.0-500.el8.x86_64.rpm 14 MB/s | 43 MB 00:03 2023-08-01T19:37:25.333 INFO:teuthology.orchestra.run.smithi101.stdout:-------------------------------------------------------------------------------- 2023-08-01T19:37:25.333 INFO:teuthology.orchestra.run.smithi101.stdout:Total 29 MB/s | 88 MB 00:03 2023-08-01T19:37:25.348 INFO:teuthology.orchestra.run.smithi006.stdout:lab-extras 286 kB/s | 24 kB 00:00 2023-08-01T19:37:25.719 INFO:teuthology.orchestra.run.smithi155.stdout:Transaction check succeeded. 2023-08-01T19:37:25.720 INFO:teuthology.orchestra.run.smithi155.stdout:Running transaction test 2023-08-01T19:37:25.995 INFO:teuthology.orchestra.run.smithi101.stdout:Running transaction check 2023-08-01T19:37:26.413 INFO:teuthology.orchestra.run.smithi101.stdout:Transaction check succeeded. 2023-08-01T19:37:26.413 INFO:teuthology.orchestra.run.smithi101.stdout:Running transaction test 2023-08-01T19:37:26.934 INFO:teuthology.orchestra.run.smithi155.stdout:Transaction test succeeded. 2023-08-01T19:37:26.959 INFO:teuthology.orchestra.run.smithi155.stdout:Running transaction 2023-08-01T19:37:27.311 INFO:teuthology.orchestra.run.smithi008.stdout: Preparing : 1/1 2023-08-01T19:37:27.614 INFO:teuthology.orchestra.run.smithi101.stdout:Transaction test succeeded. 2023-08-01T19:37:27.636 INFO:teuthology.orchestra.run.smithi101.stdout:Running transaction 2023-08-01T19:37:27.836 INFO:teuthology.orchestra.run.smithi008.stdout: Installing : kernel-core-4.18.0-500.el8.x86_64 1/3 2023-08-01T19:37:28.931 INFO:teuthology.orchestra.run.smithi006.stdout:Package kernel-4.18.0-348.el8.x86_64 is already installed. 2023-08-01T19:37:28.931 INFO:teuthology.orchestra.run.smithi006.stdout:Package kernel-4.18.0-489.el8.x86_64 is already installed. 2023-08-01T19:37:29.153 INFO:teuthology.orchestra.run.smithi006.stdout:Dependencies resolved. 2023-08-01T19:37:29.161 INFO:teuthology.orchestra.run.smithi006.stdout:================================================================================ 2023-08-01T19:37:29.161 INFO:teuthology.orchestra.run.smithi006.stdout: Package Architecture Version Repository Size 2023-08-01T19:37:29.161 INFO:teuthology.orchestra.run.smithi006.stdout:================================================================================ 2023-08-01T19:37:29.161 INFO:teuthology.orchestra.run.smithi006.stdout:Installing: 2023-08-01T19:37:29.161 INFO:teuthology.orchestra.run.smithi006.stdout: kernel x86_64 4.18.0-500.el8 baseos 9.8 M 2023-08-01T19:37:29.162 INFO:teuthology.orchestra.run.smithi006.stdout:Installing dependencies: 2023-08-01T19:37:29.162 INFO:teuthology.orchestra.run.smithi006.stdout: kernel-core x86_64 4.18.0-500.el8 baseos 43 M 2023-08-01T19:37:29.162 INFO:teuthology.orchestra.run.smithi006.stdout: kernel-modules x86_64 4.18.0-500.el8 baseos 35 M 2023-08-01T19:37:29.162 INFO:teuthology.orchestra.run.smithi006.stdout: 2023-08-01T19:37:29.162 INFO:teuthology.orchestra.run.smithi006.stdout:Transaction Summary 2023-08-01T19:37:29.163 INFO:teuthology.orchestra.run.smithi006.stdout:================================================================================ 2023-08-01T19:37:29.163 INFO:teuthology.orchestra.run.smithi006.stdout:Install 3 Packages 2023-08-01T19:37:29.163 INFO:teuthology.orchestra.run.smithi006.stdout: 2023-08-01T19:37:29.163 INFO:teuthology.orchestra.run.smithi006.stdout:Total download size: 88 M 2023-08-01T19:37:29.163 INFO:teuthology.orchestra.run.smithi006.stdout:Installed size: 95 M 2023-08-01T19:37:29.163 INFO:teuthology.orchestra.run.smithi006.stdout:Downloading Packages: 2023-08-01T19:37:29.729 INFO:teuthology.orchestra.run.smithi155.stdout: Preparing : 1/1 2023-08-01T19:37:30.255 INFO:teuthology.orchestra.run.smithi155.stdout: Installing : kernel-core-4.18.0-500.el8.x86_64 1/3 2023-08-01T19:37:30.376 INFO:teuthology.orchestra.run.smithi101.stdout: Preparing : 1/1 2023-08-01T19:37:30.778 INFO:teuthology.orchestra.run.smithi006.stdout:(1/3): kernel-4.18.0-500.el8.x86_64.rpm 6.9 MB/s | 9.8 MB 00:01 2023-08-01T19:37:30.865 INFO:teuthology.orchestra.run.smithi101.stdout: Installing : kernel-core-4.18.0-500.el8.x86_64 1/3 2023-08-01T19:37:31.592 INFO:teuthology.orchestra.run.smithi008.stdout: Running scriptlet: kernel-core-4.18.0-500.el8.x86_64 1/3 2023-08-01T19:37:31.933 INFO:teuthology.orchestra.run.smithi006.stdout:(2/3): kernel-modules-4.18.0-500.el8.x86_64.rpm 14 MB/s | 35 MB 00:02 2023-08-01T19:37:31.985 INFO:teuthology.orchestra.run.smithi008.stdout: Installing : kernel-modules-4.18.0-500.el8.x86_64 2/3 2023-08-01T19:37:32.550 INFO:teuthology.orchestra.run.smithi006.stdout:(3/3): kernel-core-4.18.0-500.el8.x86_64.rpm 13 MB/s | 43 MB 00:03 2023-08-01T19:37:32.550 INFO:teuthology.orchestra.run.smithi006.stdout:-------------------------------------------------------------------------------- 2023-08-01T19:37:32.551 INFO:teuthology.orchestra.run.smithi006.stdout:Total 26 MB/s | 88 MB 00:03 2023-08-01T19:37:33.243 INFO:teuthology.orchestra.run.smithi006.stdout:Running transaction check 2023-08-01T19:37:33.695 INFO:teuthology.orchestra.run.smithi006.stdout:Transaction check succeeded. 2023-08-01T19:37:33.695 INFO:teuthology.orchestra.run.smithi006.stdout:Running transaction test 2023-08-01T19:37:33.907 INFO:teuthology.orchestra.run.smithi155.stdout: Running scriptlet: kernel-core-4.18.0-500.el8.x86_64 1/3 2023-08-01T19:37:34.288 INFO:teuthology.orchestra.run.smithi155.stdout: Installing : kernel-modules-4.18.0-500.el8.x86_64 2/3 2023-08-01T19:37:34.470 INFO:teuthology.orchestra.run.smithi101.stdout: Running scriptlet: kernel-core-4.18.0-500.el8.x86_64 1/3 2023-08-01T19:37:34.882 INFO:teuthology.orchestra.run.smithi101.stdout: Installing : kernel-modules-4.18.0-500.el8.x86_64 2/3 2023-08-01T19:37:34.982 INFO:teuthology.orchestra.run.smithi006.stdout:Transaction test succeeded. 2023-08-01T19:37:35.007 INFO:teuthology.orchestra.run.smithi006.stdout:Running transaction 2023-08-01T19:37:35.581 INFO:teuthology.orchestra.run.smithi008.stdout: Running scriptlet: kernel-modules-4.18.0-500.el8.x86_64 2/3 2023-08-01T19:37:35.903 INFO:teuthology.orchestra.run.smithi008.stdout: Installing : kernel-4.18.0-500.el8.x86_64 3/3 2023-08-01T19:37:37.646 INFO:teuthology.orchestra.run.smithi155.stdout: Running scriptlet: kernel-modules-4.18.0-500.el8.x86_64 2/3 2023-08-01T19:37:37.939 INFO:teuthology.orchestra.run.smithi006.stdout: Preparing : 1/1 2023-08-01T19:37:37.992 INFO:teuthology.orchestra.run.smithi155.stdout: Installing : kernel-4.18.0-500.el8.x86_64 3/3 2023-08-01T19:37:38.232 INFO:teuthology.orchestra.run.smithi101.stdout: Running scriptlet: kernel-modules-4.18.0-500.el8.x86_64 2/3 2023-08-01T19:37:38.540 INFO:teuthology.orchestra.run.smithi006.stdout: Installing : kernel-core-4.18.0-500.el8.x86_64 1/3 2023-08-01T19:37:38.552 INFO:teuthology.orchestra.run.smithi101.stdout: Installing : kernel-4.18.0-500.el8.x86_64 3/3 2023-08-01T19:37:42.270 INFO:teuthology.orchestra.run.smithi006.stdout: Running scriptlet: kernel-core-4.18.0-500.el8.x86_64 1/3 2023-08-01T19:37:42.689 INFO:teuthology.orchestra.run.smithi006.stdout: Installing : kernel-modules-4.18.0-500.el8.x86_64 2/3 2023-08-01T19:37:46.295 INFO:teuthology.orchestra.run.smithi006.stdout: Running scriptlet: kernel-modules-4.18.0-500.el8.x86_64 2/3 2023-08-01T19:37:46.606 INFO:teuthology.orchestra.run.smithi006.stdout: Installing : kernel-4.18.0-500.el8.x86_64 3/3 2023-08-01T19:37:59.017 INFO:teuthology.orchestra.run.smithi008.stdout: Running scriptlet: kernel-core-4.18.0-500.el8.x86_64 3/3 2023-08-01T19:37:59.042 INFO:teuthology.orchestra.run.smithi008.stdout: Running scriptlet: kernel-modules-4.18.0-500.el8.x86_64 3/3 2023-08-01T19:37:59.403 INFO:teuthology.orchestra.run.smithi008.stdout: Running scriptlet: kernel-4.18.0-500.el8.x86_64 3/3 2023-08-01T19:37:59.404 INFO:teuthology.orchestra.run.smithi008.stdout: Verifying : kernel-4.18.0-500.el8.x86_64 1/3 2023-08-01T19:37:59.404 INFO:teuthology.orchestra.run.smithi008.stdout: Verifying : kernel-core-4.18.0-500.el8.x86_64 2/3 2023-08-01T19:37:59.767 INFO:teuthology.orchestra.run.smithi155.stdout: Running scriptlet: kernel-core-4.18.0-500.el8.x86_64 3/3 2023-08-01T19:37:59.791 INFO:teuthology.orchestra.run.smithi155.stdout: Running scriptlet: kernel-modules-4.18.0-500.el8.x86_64 3/3 2023-08-01T19:38:00.110 INFO:teuthology.orchestra.run.smithi008.stdout: Verifying : kernel-modules-4.18.0-500.el8.x86_64 3/3 2023-08-01T19:38:00.110 INFO:teuthology.orchestra.run.smithi008.stdout: 2023-08-01T19:38:00.110 INFO:teuthology.orchestra.run.smithi008.stdout:Installed: 2023-08-01T19:38:00.110 INFO:teuthology.orchestra.run.smithi008.stdout: kernel-4.18.0-500.el8.x86_64 kernel-core-4.18.0-500.el8.x86_64 2023-08-01T19:38:00.110 INFO:teuthology.orchestra.run.smithi008.stdout: kernel-modules-4.18.0-500.el8.x86_64 2023-08-01T19:38:00.111 INFO:teuthology.orchestra.run.smithi008.stdout: 2023-08-01T19:38:00.111 INFO:teuthology.orchestra.run.smithi008.stdout:Complete! 2023-08-01T19:38:00.164 INFO:teuthology.orchestra.run.smithi155.stdout: Running scriptlet: kernel-4.18.0-500.el8.x86_64 3/3 2023-08-01T19:38:00.164 INFO:teuthology.orchestra.run.smithi155.stdout: Verifying : kernel-4.18.0-500.el8.x86_64 1/3 2023-08-01T19:38:00.164 INFO:teuthology.orchestra.run.smithi155.stdout: Verifying : kernel-core-4.18.0-500.el8.x86_64 2/3 2023-08-01T19:38:00.244 DEBUG:teuthology.orchestra.run.smithi008:> rpm -q kernel | sort -rV | head -n 1 2023-08-01T19:38:00.249 INFO:teuthology.orchestra.run.smithi101.stdout: Running scriptlet: kernel-core-4.18.0-500.el8.x86_64 3/3 2023-08-01T19:38:00.269 INFO:teuthology.orchestra.run.smithi101.stdout: Running scriptlet: kernel-modules-4.18.0-500.el8.x86_64 3/3 2023-08-01T19:38:00.474 INFO:teuthology.orchestra.run.smithi008.stdout:kernel-4.18.0-500.el8.x86_64 2023-08-01T19:38:00.474 DEBUG:teuthology.task.kernel:get_latest_image_version_rpm: 4.18.0-500.el8.x86_64 2023-08-01T19:38:00.474 INFO:teuthology.task.kernel:Not newest distro kernel. Current: 4.18.0-489.el8.x86_64 Expected: 4.18.0-500.el8.x86_64 2023-08-01T19:38:00.475 INFO:teuthology.task.kernel:Skipping firmware on distro kernel 2023-08-01T19:38:00.475 DEBUG:teuthology.task.kernel:src is distro, skipping download 2023-08-01T19:38:00.475 INFO:teuthology.task.kernel:Installing distro kernel on osd.0... 2023-08-01T19:38:00.475 DEBUG:teuthology.task.kernel:install_kernel(remote=ubuntu@smithi008.front.sepia.ceph.com, path=None, version=distro) 2023-08-01T19:38:00.475 DEBUG:teuthology.orchestra.run.smithi008:> rpm -q kernel | sort -rV | head -n 1 2023-08-01T19:38:00.617 INFO:teuthology.orchestra.run.smithi101.stdout: Running scriptlet: kernel-4.18.0-500.el8.x86_64 3/3 2023-08-01T19:38:00.617 INFO:teuthology.orchestra.run.smithi101.stdout: Verifying : kernel-4.18.0-500.el8.x86_64 1/3 2023-08-01T19:38:00.617 INFO:teuthology.orchestra.run.smithi101.stdout: Verifying : kernel-core-4.18.0-500.el8.x86_64 2/3 2023-08-01T19:38:00.691 INFO:teuthology.orchestra.run.smithi008.stdout:kernel-4.18.0-500.el8.x86_64 2023-08-01T19:38:00.691 DEBUG:teuthology.task.kernel:get_latest_image_version_rpm: 4.18.0-500.el8.x86_64 2023-08-01T19:38:00.691 DEBUG:teuthology.orchestra.run.smithi008:> sudo rpm -qi grub2-tools 2023-08-01T19:38:00.726 INFO:teuthology.orchestra.run.smithi008.stdout:Name : grub2-tools 2023-08-01T19:38:00.726 INFO:teuthology.orchestra.run.smithi008.stdout:Epoch : 1 2023-08-01T19:38:00.727 INFO:teuthology.orchestra.run.smithi008.stdout:Version : 2.02 2023-08-01T19:38:00.727 INFO:teuthology.orchestra.run.smithi008.stdout:Release : 129.el8 2023-08-01T19:38:00.727 INFO:teuthology.orchestra.run.smithi008.stdout:Architecture: x86_64 2023-08-01T19:38:00.727 INFO:teuthology.orchestra.run.smithi008.stdout:Install Date: Thu 04 May 2023 10:17:48 PM UTC 2023-08-01T19:38:00.728 INFO:teuthology.orchestra.run.smithi008.stdout:Group : System Environment/Base 2023-08-01T19:38:00.728 INFO:teuthology.orchestra.run.smithi008.stdout:Size : 9265586 2023-08-01T19:38:00.728 INFO:teuthology.orchestra.run.smithi008.stdout:License : GPLv3+ 2023-08-01T19:38:00.729 INFO:teuthology.orchestra.run.smithi008.stdout:Signature : RSA/SHA256, Tue 19 Jul 2022 02:52:06 PM UTC, Key ID 05b555b38483c65d 2023-08-01T19:38:00.729 INFO:teuthology.orchestra.run.smithi008.stdout:Source RPM : grub2-2.02-129.el8.src.rpm 2023-08-01T19:38:00.729 INFO:teuthology.orchestra.run.smithi008.stdout:Build Date : Tue 19 Jul 2022 02:30:39 PM UTC 2023-08-01T19:38:00.729 INFO:teuthology.orchestra.run.smithi008.stdout:Build Host : kbuilder.bsys.centos.org 2023-08-01T19:38:00.730 INFO:teuthology.orchestra.run.smithi008.stdout:Relocations : (not relocatable) 2023-08-01T19:38:00.730 INFO:teuthology.orchestra.run.smithi008.stdout:Packager : CentOS BuildSystem 2023-08-01T19:38:00.730 INFO:teuthology.orchestra.run.smithi008.stdout:Vendor : CentOS 2023-08-01T19:38:00.730 INFO:teuthology.orchestra.run.smithi008.stdout:URL : http://www.gnu.org/software/grub/ 2023-08-01T19:38:00.730 INFO:teuthology.orchestra.run.smithi008.stdout:Summary : Support tools for GRUB. 2023-08-01T19:38:00.731 INFO:teuthology.orchestra.run.smithi008.stdout:Description : 2023-08-01T19:38:00.731 INFO:teuthology.orchestra.run.smithi008.stdout: 2023-08-01T19:38:00.731 INFO:teuthology.orchestra.run.smithi008.stdout:The GRand Unified Bootloader (GRUB) is a highly configurable and 2023-08-01T19:38:00.731 INFO:teuthology.orchestra.run.smithi008.stdout:customizable bootloader with modular architecture. It supports a rich 2023-08-01T19:38:00.731 INFO:teuthology.orchestra.run.smithi008.stdout:variety of kernel formats, file systems, computer architectures and 2023-08-01T19:38:00.731 INFO:teuthology.orchestra.run.smithi008.stdout:hardware devices. 2023-08-01T19:38:00.731 INFO:teuthology.orchestra.run.smithi008.stdout: 2023-08-01T19:38:00.731 INFO:teuthology.orchestra.run.smithi008.stdout:This subpackage provides tools for support of all platforms. 2023-08-01T19:38:00.732 INFO:teuthology.task.kernel:Updating Grub Version: grub2 2023-08-01T19:38:00.733 INFO:teuthology.task.kernel:Updating grub on smithi008 to boot 4.18.0-500.el8.x86_64 2023-08-01T19:38:00.733 DEBUG:teuthology.orchestra.run.smithi008:> sudo grub2-mkconfig -o /boot/grub2/grub.cfg 2023-08-01T19:38:00.828 INFO:teuthology.orchestra.run.smithi155.stdout: Verifying : kernel-modules-4.18.0-500.el8.x86_64 3/3 2023-08-01T19:38:00.829 INFO:teuthology.orchestra.run.smithi155.stdout: 2023-08-01T19:38:00.829 INFO:teuthology.orchestra.run.smithi155.stdout:Installed: 2023-08-01T19:38:00.829 INFO:teuthology.orchestra.run.smithi155.stdout: kernel-4.18.0-500.el8.x86_64 kernel-core-4.18.0-500.el8.x86_64 2023-08-01T19:38:00.829 INFO:teuthology.orchestra.run.smithi155.stdout: kernel-modules-4.18.0-500.el8.x86_64 2023-08-01T19:38:00.829 INFO:teuthology.orchestra.run.smithi155.stdout: 2023-08-01T19:38:00.829 INFO:teuthology.orchestra.run.smithi155.stdout:Complete! 2023-08-01T19:38:01.013 DEBUG:teuthology.orchestra.run.smithi155:> rpm -q kernel | sort -rV | head -n 1 2023-08-01T19:38:01.230 INFO:teuthology.orchestra.run.smithi155.stdout:kernel-4.18.0-500.el8.x86_64 2023-08-01T19:38:01.230 DEBUG:teuthology.task.kernel:get_latest_image_version_rpm: 4.18.0-500.el8.x86_64 2023-08-01T19:38:01.231 INFO:teuthology.task.kernel:Not newest distro kernel. Current: 4.18.0-489.el8.x86_64 Expected: 4.18.0-500.el8.x86_64 2023-08-01T19:38:01.231 INFO:teuthology.task.kernel:Skipping firmware on distro kernel 2023-08-01T19:38:01.231 DEBUG:teuthology.task.kernel:src is distro, skipping download 2023-08-01T19:38:01.231 INFO:teuthology.task.kernel:Installing distro kernel on osd.2... 2023-08-01T19:38:01.231 DEBUG:teuthology.task.kernel:install_kernel(remote=ubuntu@smithi155.front.sepia.ceph.com, path=None, version=distro) 2023-08-01T19:38:01.231 DEBUG:teuthology.orchestra.run.smithi155:> rpm -q kernel | sort -rV | head -n 1 2023-08-01T19:38:01.332 INFO:teuthology.orchestra.run.smithi101.stdout: Verifying : kernel-modules-4.18.0-500.el8.x86_64 3/3 2023-08-01T19:38:01.332 INFO:teuthology.orchestra.run.smithi101.stdout: 2023-08-01T19:38:01.332 INFO:teuthology.orchestra.run.smithi101.stdout:Installed: 2023-08-01T19:38:01.333 INFO:teuthology.orchestra.run.smithi101.stdout: kernel-4.18.0-500.el8.x86_64 kernel-core-4.18.0-500.el8.x86_64 2023-08-01T19:38:01.333 INFO:teuthology.orchestra.run.smithi101.stdout: kernel-modules-4.18.0-500.el8.x86_64 2023-08-01T19:38:01.333 INFO:teuthology.orchestra.run.smithi101.stdout: 2023-08-01T19:38:01.333 INFO:teuthology.orchestra.run.smithi101.stdout:Complete! 2023-08-01T19:38:01.439 INFO:teuthology.orchestra.run.smithi155.stdout:kernel-4.18.0-500.el8.x86_64 2023-08-01T19:38:01.439 DEBUG:teuthology.task.kernel:get_latest_image_version_rpm: 4.18.0-500.el8.x86_64 2023-08-01T19:38:01.439 DEBUG:teuthology.orchestra.run.smithi155:> sudo rpm -qi grub2-tools 2023-08-01T19:38:01.473 DEBUG:teuthology.orchestra.run.smithi101:> rpm -q kernel | sort -rV | head -n 1 2023-08-01T19:38:01.474 INFO:teuthology.orchestra.run.smithi155.stdout:Name : grub2-tools 2023-08-01T19:38:01.474 INFO:teuthology.orchestra.run.smithi155.stdout:Epoch : 1 2023-08-01T19:38:01.475 INFO:teuthology.orchestra.run.smithi155.stdout:Version : 2.02 2023-08-01T19:38:01.475 INFO:teuthology.orchestra.run.smithi155.stdout:Release : 129.el8 2023-08-01T19:38:01.475 INFO:teuthology.orchestra.run.smithi155.stdout:Architecture: x86_64 2023-08-01T19:38:01.476 INFO:teuthology.orchestra.run.smithi155.stdout:Install Date: Thu 04 May 2023 10:17:48 PM UTC 2023-08-01T19:38:01.476 INFO:teuthology.orchestra.run.smithi155.stdout:Group : System Environment/Base 2023-08-01T19:38:01.476 INFO:teuthology.orchestra.run.smithi155.stdout:Size : 9265586 2023-08-01T19:38:01.477 INFO:teuthology.orchestra.run.smithi155.stdout:License : GPLv3+ 2023-08-01T19:38:01.477 INFO:teuthology.orchestra.run.smithi155.stdout:Signature : RSA/SHA256, Tue 19 Jul 2022 02:52:06 PM UTC, Key ID 05b555b38483c65d 2023-08-01T19:38:01.477 INFO:teuthology.orchestra.run.smithi155.stdout:Source RPM : grub2-2.02-129.el8.src.rpm 2023-08-01T19:38:01.477 INFO:teuthology.orchestra.run.smithi155.stdout:Build Date : Tue 19 Jul 2022 02:30:39 PM UTC 2023-08-01T19:38:01.478 INFO:teuthology.orchestra.run.smithi155.stdout:Build Host : kbuilder.bsys.centos.org 2023-08-01T19:38:01.478 INFO:teuthology.orchestra.run.smithi155.stdout:Relocations : (not relocatable) 2023-08-01T19:38:01.479 INFO:teuthology.orchestra.run.smithi155.stdout:Packager : CentOS BuildSystem 2023-08-01T19:38:01.479 INFO:teuthology.orchestra.run.smithi155.stdout:Vendor : CentOS 2023-08-01T19:38:01.479 INFO:teuthology.orchestra.run.smithi155.stdout:URL : http://www.gnu.org/software/grub/ 2023-08-01T19:38:01.480 INFO:teuthology.orchestra.run.smithi155.stdout:Summary : Support tools for GRUB. 2023-08-01T19:38:01.480 INFO:teuthology.orchestra.run.smithi155.stdout:Description : 2023-08-01T19:38:01.480 INFO:teuthology.orchestra.run.smithi155.stdout: 2023-08-01T19:38:01.480 INFO:teuthology.orchestra.run.smithi155.stdout:The GRand Unified Bootloader (GRUB) is a highly configurable and 2023-08-01T19:38:01.481 INFO:teuthology.orchestra.run.smithi155.stdout:customizable bootloader with modular architecture. It supports a rich 2023-08-01T19:38:01.481 INFO:teuthology.orchestra.run.smithi155.stdout:variety of kernel formats, file systems, computer architectures and 2023-08-01T19:38:01.482 INFO:teuthology.orchestra.run.smithi155.stdout:hardware devices. 2023-08-01T19:38:01.482 INFO:teuthology.orchestra.run.smithi155.stdout: 2023-08-01T19:38:01.482 INFO:teuthology.orchestra.run.smithi155.stdout:This subpackage provides tools for support of all platforms. 2023-08-01T19:38:01.484 INFO:teuthology.task.kernel:Updating Grub Version: grub2 2023-08-01T19:38:01.485 INFO:teuthology.task.kernel:Updating grub on smithi155 to boot 4.18.0-500.el8.x86_64 2023-08-01T19:38:01.485 DEBUG:teuthology.orchestra.run.smithi155:> sudo grub2-mkconfig -o /boot/grub2/grub.cfg 2023-08-01T19:38:01.698 INFO:teuthology.orchestra.run.smithi101.stdout:kernel-4.18.0-500.el8.x86_64 2023-08-01T19:38:01.698 DEBUG:teuthology.task.kernel:get_latest_image_version_rpm: 4.18.0-500.el8.x86_64 2023-08-01T19:38:01.699 INFO:teuthology.task.kernel:Not newest distro kernel. Current: 4.18.0-489.el8.x86_64 Expected: 4.18.0-500.el8.x86_64 2023-08-01T19:38:01.699 INFO:teuthology.task.kernel:Skipping firmware on distro kernel 2023-08-01T19:38:01.700 DEBUG:teuthology.task.kernel:src is distro, skipping download 2023-08-01T19:38:01.700 INFO:teuthology.task.kernel:Installing distro kernel on osd.1... 2023-08-01T19:38:01.701 DEBUG:teuthology.task.kernel:install_kernel(remote=ubuntu@smithi101.front.sepia.ceph.com, path=None, version=distro) 2023-08-01T19:38:01.701 DEBUG:teuthology.orchestra.run.smithi101:> rpm -q kernel | sort -rV | head -n 1 2023-08-01T19:38:01.906 INFO:teuthology.orchestra.run.smithi101.stdout:kernel-4.18.0-500.el8.x86_64 2023-08-01T19:38:01.907 DEBUG:teuthology.task.kernel:get_latest_image_version_rpm: 4.18.0-500.el8.x86_64 2023-08-01T19:38:01.907 DEBUG:teuthology.orchestra.run.smithi101:> sudo rpm -qi grub2-tools 2023-08-01T19:38:01.941 INFO:teuthology.orchestra.run.smithi101.stdout:Name : grub2-tools 2023-08-01T19:38:01.942 INFO:teuthology.orchestra.run.smithi101.stdout:Epoch : 1 2023-08-01T19:38:01.942 INFO:teuthology.orchestra.run.smithi101.stdout:Version : 2.02 2023-08-01T19:38:01.942 INFO:teuthology.orchestra.run.smithi101.stdout:Release : 129.el8 2023-08-01T19:38:01.942 INFO:teuthology.orchestra.run.smithi101.stdout:Architecture: x86_64 2023-08-01T19:38:01.942 INFO:teuthology.orchestra.run.smithi101.stdout:Install Date: Thu 04 May 2023 10:17:48 PM UTC 2023-08-01T19:38:01.942 INFO:teuthology.orchestra.run.smithi101.stdout:Group : System Environment/Base 2023-08-01T19:38:01.943 INFO:teuthology.orchestra.run.smithi101.stdout:Size : 9265586 2023-08-01T19:38:01.943 INFO:teuthology.orchestra.run.smithi101.stdout:License : GPLv3+ 2023-08-01T19:38:01.943 INFO:teuthology.orchestra.run.smithi101.stdout:Signature : RSA/SHA256, Tue 19 Jul 2022 02:52:06 PM UTC, Key ID 05b555b38483c65d 2023-08-01T19:38:01.943 INFO:teuthology.orchestra.run.smithi101.stdout:Source RPM : grub2-2.02-129.el8.src.rpm 2023-08-01T19:38:01.943 INFO:teuthology.orchestra.run.smithi101.stdout:Build Date : Tue 19 Jul 2022 02:30:39 PM UTC 2023-08-01T19:38:01.943 INFO:teuthology.orchestra.run.smithi101.stdout:Build Host : kbuilder.bsys.centos.org 2023-08-01T19:38:01.943 INFO:teuthology.orchestra.run.smithi101.stdout:Relocations : (not relocatable) 2023-08-01T19:38:01.944 INFO:teuthology.orchestra.run.smithi101.stdout:Packager : CentOS BuildSystem 2023-08-01T19:38:01.944 INFO:teuthology.orchestra.run.smithi101.stdout:Vendor : CentOS 2023-08-01T19:38:01.944 INFO:teuthology.orchestra.run.smithi101.stdout:URL : http://www.gnu.org/software/grub/ 2023-08-01T19:38:01.944 INFO:teuthology.orchestra.run.smithi101.stdout:Summary : Support tools for GRUB. 2023-08-01T19:38:01.944 INFO:teuthology.orchestra.run.smithi101.stdout:Description : 2023-08-01T19:38:01.944 INFO:teuthology.orchestra.run.smithi101.stdout: 2023-08-01T19:38:01.944 INFO:teuthology.orchestra.run.smithi101.stdout:The GRand Unified Bootloader (GRUB) is a highly configurable and 2023-08-01T19:38:01.945 INFO:teuthology.orchestra.run.smithi101.stdout:customizable bootloader with modular architecture. It supports a rich 2023-08-01T19:38:01.945 INFO:teuthology.orchestra.run.smithi101.stdout:variety of kernel formats, file systems, computer architectures and 2023-08-01T19:38:01.946 INFO:teuthology.orchestra.run.smithi101.stdout:hardware devices. 2023-08-01T19:38:01.947 INFO:teuthology.orchestra.run.smithi101.stdout: 2023-08-01T19:38:01.947 INFO:teuthology.orchestra.run.smithi101.stdout:This subpackage provides tools for support of all platforms. 2023-08-01T19:38:01.948 INFO:teuthology.task.kernel:Updating Grub Version: grub2 2023-08-01T19:38:01.949 INFO:teuthology.task.kernel:Updating grub on smithi101 to boot 4.18.0-500.el8.x86_64 2023-08-01T19:38:01.949 DEBUG:teuthology.orchestra.run.smithi101:> sudo grub2-mkconfig -o /boot/grub2/grub.cfg 2023-08-01T19:38:02.347 INFO:teuthology.orchestra.run.smithi008.stderr:Generating grub configuration file ... 2023-08-01T19:38:03.383 INFO:teuthology.orchestra.run.smithi155.stderr:Generating grub configuration file ... 2023-08-01T19:38:03.805 INFO:teuthology.orchestra.run.smithi101.stderr:Generating grub configuration file ... 2023-08-01T19:38:04.394 INFO:teuthology.orchestra.run.smithi008.stderr:done 2023-08-01T19:38:04.396 DEBUG:teuthology.orchestra.run.smithi008:> mktemp 2023-08-01T19:38:04.421 INFO:teuthology.orchestra.run.smithi008.stdout:/tmp/tmp.jvN7bNUSqA 2023-08-01T19:38:04.422 DEBUG:teuthology.orchestra.run.smithi008:> sudo cp /boot/grub2/grub.cfg /tmp/tmp.jvN7bNUSqA 2023-08-01T19:38:04.495 DEBUG:teuthology.orchestra.run.smithi008:> sudo chmod 0666 /tmp/tmp.jvN7bNUSqA 2023-08-01T19:38:04.655 DEBUG:teuthology.orchestra.remote:smithi008:/tmp/tmp.jvN7bNUSqA is 6KB 2023-08-01T19:38:04.705 DEBUG:teuthology.orchestra.run.smithi008:> rm -fr /tmp/tmp.jvN7bNUSqA 2023-08-01T19:38:04.724 DEBUG:teuthology.orchestra.run.smithi008:> sudo /bin/ls /boot/loader/entries || true 2023-08-01T19:38:04.797 INFO:teuthology.orchestra.run.smithi008.stdout:a1b29d6c289747bdb22930598d39874a-0-rescue.conf 2023-08-01T19:38:04.798 INFO:teuthology.orchestra.run.smithi008.stdout:a1b29d6c289747bdb22930598d39874a-4.18.0-348.el8.x86_64.conf 2023-08-01T19:38:04.798 INFO:teuthology.orchestra.run.smithi008.stdout:a1b29d6c289747bdb22930598d39874a-4.18.0-489.el8.x86_64.conf 2023-08-01T19:38:04.798 INFO:teuthology.orchestra.run.smithi008.stdout:a1b29d6c289747bdb22930598d39874a-4.18.0-500.el8.x86_64.conf 2023-08-01T19:38:04.799 DEBUG:teuthology.orchestra.run.smithi008:> sudo grub2-set-default a1b29d6c289747bdb22930598d39874a-4.18.0-500.el8.x86_64 2023-08-01T19:38:04.980 DEBUG:teuthology.orchestra.run.smithi008:> sudo shutdown -r now 2023-08-01T19:38:05.779 INFO:teuthology.orchestra.run.smithi155.stderr:done 2023-08-01T19:38:05.783 DEBUG:teuthology.orchestra.run.smithi155:> mktemp 2023-08-01T19:38:05.823 INFO:teuthology.orchestra.run.smithi155.stdout:/tmp/tmp.OCbZLqVWgK 2023-08-01T19:38:05.824 DEBUG:teuthology.orchestra.run.smithi155:> sudo cp /boot/grub2/grub.cfg /tmp/tmp.OCbZLqVWgK 2023-08-01T19:38:05.904 DEBUG:teuthology.orchestra.run.smithi155:> sudo chmod 0666 /tmp/tmp.OCbZLqVWgK 2023-08-01T19:38:05.919 INFO:teuthology.orchestra.run.smithi101.stderr:done 2023-08-01T19:38:05.920 DEBUG:teuthology.orchestra.run.smithi101:> mktemp 2023-08-01T19:38:05.943 INFO:teuthology.orchestra.run.smithi101.stdout:/tmp/tmp.EjYVDf7ZuA 2023-08-01T19:38:05.944 DEBUG:teuthology.orchestra.run.smithi101:> sudo cp /boot/grub2/grub.cfg /tmp/tmp.EjYVDf7ZuA 2023-08-01T19:38:06.020 DEBUG:teuthology.orchestra.run.smithi101:> sudo chmod 0666 /tmp/tmp.EjYVDf7ZuA 2023-08-01T19:38:06.048 DEBUG:teuthology.orchestra.remote:smithi155:/tmp/tmp.OCbZLqVWgK is 6KB 2023-08-01T19:38:06.097 DEBUG:teuthology.orchestra.run.smithi155:> rm -fr /tmp/tmp.OCbZLqVWgK 2023-08-01T19:38:06.115 DEBUG:teuthology.orchestra.run.smithi155:> sudo /bin/ls /boot/loader/entries || true 2023-08-01T19:38:06.185 DEBUG:teuthology.orchestra.remote:smithi101:/tmp/tmp.EjYVDf7ZuA is 6KB 2023-08-01T19:38:06.192 INFO:teuthology.orchestra.run.smithi155.stdout:a1b29d6c289747bdb22930598d39874a-0-rescue.conf 2023-08-01T19:38:06.193 INFO:teuthology.orchestra.run.smithi155.stdout:a1b29d6c289747bdb22930598d39874a-4.18.0-348.el8.x86_64.conf 2023-08-01T19:38:06.193 INFO:teuthology.orchestra.run.smithi155.stdout:a1b29d6c289747bdb22930598d39874a-4.18.0-489.el8.x86_64.conf 2023-08-01T19:38:06.193 INFO:teuthology.orchestra.run.smithi155.stdout:a1b29d6c289747bdb22930598d39874a-4.18.0-500.el8.x86_64.conf 2023-08-01T19:38:06.194 DEBUG:teuthology.orchestra.run.smithi155:> sudo grub2-set-default a1b29d6c289747bdb22930598d39874a-4.18.0-500.el8.x86_64 2023-08-01T19:38:06.243 DEBUG:teuthology.orchestra.run.smithi101:> rm -fr /tmp/tmp.EjYVDf7ZuA 2023-08-01T19:38:06.261 DEBUG:teuthology.orchestra.run.smithi101:> sudo /bin/ls /boot/loader/entries || true 2023-08-01T19:38:06.337 INFO:teuthology.orchestra.run.smithi101.stdout:a1b29d6c289747bdb22930598d39874a-0-rescue.conf 2023-08-01T19:38:06.338 INFO:teuthology.orchestra.run.smithi101.stdout:a1b29d6c289747bdb22930598d39874a-4.18.0-348.el8.x86_64.conf 2023-08-01T19:38:06.338 INFO:teuthology.orchestra.run.smithi101.stdout:a1b29d6c289747bdb22930598d39874a-4.18.0-489.el8.x86_64.conf 2023-08-01T19:38:06.338 INFO:teuthology.orchestra.run.smithi101.stdout:a1b29d6c289747bdb22930598d39874a-4.18.0-500.el8.x86_64.conf 2023-08-01T19:38:06.339 DEBUG:teuthology.orchestra.run.smithi101:> sudo grub2-set-default a1b29d6c289747bdb22930598d39874a-4.18.0-500.el8.x86_64 2023-08-01T19:38:06.395 DEBUG:teuthology.orchestra.run.smithi155:> sudo shutdown -r now 2023-08-01T19:38:06.494 DEBUG:teuthology.orchestra.run.smithi101:> sudo shutdown -r now 2023-08-01T19:38:10.009 INFO:teuthology.orchestra.run.smithi006.stdout: Running scriptlet: kernel-core-4.18.0-500.el8.x86_64 3/3 2023-08-01T19:38:10.033 INFO:teuthology.orchestra.run.smithi006.stdout: Running scriptlet: kernel-modules-4.18.0-500.el8.x86_64 3/3 2023-08-01T19:38:10.381 INFO:teuthology.orchestra.run.smithi006.stdout: Running scriptlet: kernel-4.18.0-500.el8.x86_64 3/3 2023-08-01T19:38:10.381 INFO:teuthology.orchestra.run.smithi006.stdout: Verifying : kernel-4.18.0-500.el8.x86_64 1/3 2023-08-01T19:38:10.381 INFO:teuthology.orchestra.run.smithi006.stdout: Verifying : kernel-core-4.18.0-500.el8.x86_64 2/3 2023-08-01T19:38:11.106 INFO:teuthology.orchestra.run.smithi006.stdout: Verifying : kernel-modules-4.18.0-500.el8.x86_64 3/3 2023-08-01T19:38:11.107 INFO:teuthology.orchestra.run.smithi006.stdout: 2023-08-01T19:38:11.107 INFO:teuthology.orchestra.run.smithi006.stdout:Installed: 2023-08-01T19:38:11.107 INFO:teuthology.orchestra.run.smithi006.stdout: kernel-4.18.0-500.el8.x86_64 kernel-core-4.18.0-500.el8.x86_64 2023-08-01T19:38:11.107 INFO:teuthology.orchestra.run.smithi006.stdout: kernel-modules-4.18.0-500.el8.x86_64 2023-08-01T19:38:11.107 INFO:teuthology.orchestra.run.smithi006.stdout: 2023-08-01T19:38:11.107 INFO:teuthology.orchestra.run.smithi006.stdout:Complete! 2023-08-01T19:38:11.232 DEBUG:teuthology.orchestra.run.smithi006:> rpm -q kernel | sort -rV | head -n 1 2023-08-01T19:38:11.452 INFO:teuthology.orchestra.run.smithi006.stdout:kernel-4.18.0-500.el8.x86_64 2023-08-01T19:38:11.453 DEBUG:teuthology.task.kernel:get_latest_image_version_rpm: 4.18.0-500.el8.x86_64 2023-08-01T19:38:11.453 INFO:teuthology.task.kernel:Not newest distro kernel. Current: 4.18.0-489.el8.x86_64 Expected: 4.18.0-500.el8.x86_64 2023-08-01T19:38:11.453 INFO:teuthology.task.kernel:Skipping firmware on distro kernel 2023-08-01T19:38:11.454 DEBUG:teuthology.task.kernel:src is distro, skipping download 2023-08-01T19:38:11.454 INFO:teuthology.task.kernel:Installing distro kernel on mon.a... 2023-08-01T19:38:11.454 DEBUG:teuthology.task.kernel:install_kernel(remote=ubuntu@smithi006.front.sepia.ceph.com, path=None, version=distro) 2023-08-01T19:38:11.454 DEBUG:teuthology.orchestra.run.smithi006:> rpm -q kernel | sort -rV | head -n 1 2023-08-01T19:38:11.670 INFO:teuthology.orchestra.run.smithi006.stdout:kernel-4.18.0-500.el8.x86_64 2023-08-01T19:38:11.671 DEBUG:teuthology.task.kernel:get_latest_image_version_rpm: 4.18.0-500.el8.x86_64 2023-08-01T19:38:11.671 DEBUG:teuthology.orchestra.run.smithi006:> sudo rpm -qi grub2-tools 2023-08-01T19:38:11.706 INFO:teuthology.orchestra.run.smithi006.stdout:Name : grub2-tools 2023-08-01T19:38:11.707 INFO:teuthology.orchestra.run.smithi006.stdout:Epoch : 1 2023-08-01T19:38:11.707 INFO:teuthology.orchestra.run.smithi006.stdout:Version : 2.02 2023-08-01T19:38:11.707 INFO:teuthology.orchestra.run.smithi006.stdout:Release : 129.el8 2023-08-01T19:38:11.707 INFO:teuthology.orchestra.run.smithi006.stdout:Architecture: x86_64 2023-08-01T19:38:11.707 INFO:teuthology.orchestra.run.smithi006.stdout:Install Date: Thu 04 May 2023 10:17:48 PM UTC 2023-08-01T19:38:11.707 INFO:teuthology.orchestra.run.smithi006.stdout:Group : System Environment/Base 2023-08-01T19:38:11.707 INFO:teuthology.orchestra.run.smithi006.stdout:Size : 9265586 2023-08-01T19:38:11.708 INFO:teuthology.orchestra.run.smithi006.stdout:License : GPLv3+ 2023-08-01T19:38:11.708 INFO:teuthology.orchestra.run.smithi006.stdout:Signature : RSA/SHA256, Tue 19 Jul 2022 02:52:06 PM UTC, Key ID 05b555b38483c65d 2023-08-01T19:38:11.708 INFO:teuthology.orchestra.run.smithi006.stdout:Source RPM : grub2-2.02-129.el8.src.rpm 2023-08-01T19:38:11.708 INFO:teuthology.orchestra.run.smithi006.stdout:Build Date : Tue 19 Jul 2022 02:30:39 PM UTC 2023-08-01T19:38:11.708 INFO:teuthology.orchestra.run.smithi006.stdout:Build Host : kbuilder.bsys.centos.org 2023-08-01T19:38:11.708 INFO:teuthology.orchestra.run.smithi006.stdout:Relocations : (not relocatable) 2023-08-01T19:38:11.708 INFO:teuthology.orchestra.run.smithi006.stdout:Packager : CentOS BuildSystem 2023-08-01T19:38:11.709 INFO:teuthology.orchestra.run.smithi006.stdout:Vendor : CentOS 2023-08-01T19:38:11.709 INFO:teuthology.orchestra.run.smithi006.stdout:URL : http://www.gnu.org/software/grub/ 2023-08-01T19:38:11.709 INFO:teuthology.orchestra.run.smithi006.stdout:Summary : Support tools for GRUB. 2023-08-01T19:38:11.709 INFO:teuthology.orchestra.run.smithi006.stdout:Description : 2023-08-01T19:38:11.709 INFO:teuthology.orchestra.run.smithi006.stdout: 2023-08-01T19:38:11.709 INFO:teuthology.orchestra.run.smithi006.stdout:The GRand Unified Bootloader (GRUB) is a highly configurable and 2023-08-01T19:38:11.709 INFO:teuthology.orchestra.run.smithi006.stdout:customizable bootloader with modular architecture. It supports a rich 2023-08-01T19:38:11.709 INFO:teuthology.orchestra.run.smithi006.stdout:variety of kernel formats, file systems, computer architectures and 2023-08-01T19:38:11.710 INFO:teuthology.orchestra.run.smithi006.stdout:hardware devices. 2023-08-01T19:38:11.710 INFO:teuthology.orchestra.run.smithi006.stdout: 2023-08-01T19:38:11.710 INFO:teuthology.orchestra.run.smithi006.stdout:This subpackage provides tools for support of all platforms. 2023-08-01T19:38:11.711 INFO:teuthology.task.kernel:Updating Grub Version: grub2 2023-08-01T19:38:11.711 INFO:teuthology.task.kernel:Updating grub on smithi006 to boot 4.18.0-500.el8.x86_64 2023-08-01T19:38:11.711 DEBUG:teuthology.orchestra.run.smithi006:> sudo grub2-mkconfig -o /boot/grub2/grub.cfg 2023-08-01T19:38:13.236 INFO:teuthology.orchestra.run.smithi006.stderr:Generating grub configuration file ... 2023-08-01T19:38:15.500 INFO:teuthology.orchestra.run.smithi006.stderr:done 2023-08-01T19:38:15.501 DEBUG:teuthology.orchestra.run.smithi006:> mktemp 2023-08-01T19:38:15.528 INFO:teuthology.orchestra.run.smithi006.stdout:/tmp/tmp.1WtTiAydpU 2023-08-01T19:38:15.529 DEBUG:teuthology.orchestra.run.smithi006:> sudo cp /boot/grub2/grub.cfg /tmp/tmp.1WtTiAydpU 2023-08-01T19:38:15.601 DEBUG:teuthology.orchestra.run.smithi006:> sudo chmod 0666 /tmp/tmp.1WtTiAydpU 2023-08-01T19:38:15.748 DEBUG:teuthology.orchestra.remote:smithi006:/tmp/tmp.1WtTiAydpU is 6KB 2023-08-01T19:38:15.799 DEBUG:teuthology.orchestra.run.smithi006:> rm -fr /tmp/tmp.1WtTiAydpU 2023-08-01T19:38:15.817 DEBUG:teuthology.orchestra.run.smithi006:> sudo /bin/ls /boot/loader/entries || true 2023-08-01T19:38:15.884 INFO:teuthology.orchestra.run.smithi006.stdout:a1b29d6c289747bdb22930598d39874a-0-rescue.conf 2023-08-01T19:38:15.885 INFO:teuthology.orchestra.run.smithi006.stdout:a1b29d6c289747bdb22930598d39874a-4.18.0-348.el8.x86_64.conf 2023-08-01T19:38:15.885 INFO:teuthology.orchestra.run.smithi006.stdout:a1b29d6c289747bdb22930598d39874a-4.18.0-489.el8.x86_64.conf 2023-08-01T19:38:15.885 INFO:teuthology.orchestra.run.smithi006.stdout:a1b29d6c289747bdb22930598d39874a-4.18.0-500.el8.x86_64.conf 2023-08-01T19:38:15.886 DEBUG:teuthology.orchestra.run.smithi006:> sudo grub2-set-default a1b29d6c289747bdb22930598d39874a-4.18.0-500.el8.x86_64 2023-08-01T19:38:16.047 DEBUG:teuthology.orchestra.run.smithi006:> sudo shutdown -r now 2023-08-01T19:38:35.002 INFO:teuthology.task.kernel:Checking client osd.0 for new kernel version... 2023-08-01T19:38:35.002 INFO:teuthology.orchestra.remote:Trying to reconnect to host 'ubuntu@smithi008.front.sepia.ceph.com' 2023-08-01T19:38:35.003 DEBUG:teuthology.orchestra.connection:{'hostname': 'smithi008.front.sepia.ceph.com', 'username': 'ubuntu', 'timeout': 60} 2023-08-01T19:38:36.398 INFO:teuthology.task.kernel:Checking client osd.2 for new kernel version... 2023-08-01T19:38:36.399 INFO:teuthology.orchestra.remote:Trying to reconnect to host 'ubuntu@smithi155.front.sepia.ceph.com' 2023-08-01T19:38:36.399 DEBUG:teuthology.orchestra.connection:{'hostname': 'smithi155.front.sepia.ceph.com', 'username': 'ubuntu', 'timeout': 60} 2023-08-01T19:38:36.498 INFO:teuthology.task.kernel:Checking client osd.1 for new kernel version... 2023-08-01T19:38:36.498 INFO:teuthology.orchestra.remote:Trying to reconnect to host 'ubuntu@smithi101.front.sepia.ceph.com' 2023-08-01T19:38:36.499 DEBUG:teuthology.orchestra.connection:{'hostname': 'smithi101.front.sepia.ceph.com', 'username': 'ubuntu', 'timeout': 60} 2023-08-01T19:38:46.060 INFO:teuthology.task.kernel:Checking client mon.a for new kernel version... 2023-08-01T19:38:46.061 INFO:teuthology.orchestra.remote:Trying to reconnect to host 'ubuntu@smithi006.front.sepia.ceph.com' 2023-08-01T19:38:46.061 DEBUG:teuthology.orchestra.connection:{'hostname': 'smithi006.front.sepia.ceph.com', 'username': 'ubuntu', 'timeout': 60} 2023-08-01T19:38:53.428 DEBUG:teuthology.orchestra.remote:[Errno None] Unable to connect to port 22 on 172.21.15.8 2023-08-01T19:38:54.960 DEBUG:teuthology.orchestra.remote:[Errno None] Unable to connect to port 22 on 172.21.15.155 2023-08-01T19:38:54.961 DEBUG:teuthology.orchestra.remote:[Errno None] Unable to connect to port 22 on 172.21.15.101 2023-08-01T19:39:02.437 INFO:teuthology.orchestra.remote:Trying to reconnect to host 'ubuntu@smithi008.front.sepia.ceph.com' 2023-08-01T19:39:02.437 DEBUG:teuthology.orchestra.connection:{'hostname': 'smithi008.front.sepia.ceph.com', 'username': 'ubuntu', 'timeout': 60} 2023-08-01T19:39:03.963 INFO:teuthology.orchestra.remote:Trying to reconnect to host 'ubuntu@smithi155.front.sepia.ceph.com' 2023-08-01T19:39:03.964 DEBUG:teuthology.orchestra.connection:{'hostname': 'smithi155.front.sepia.ceph.com', 'username': 'ubuntu', 'timeout': 60} 2023-08-01T19:39:03.965 INFO:teuthology.orchestra.remote:Trying to reconnect to host 'ubuntu@smithi101.front.sepia.ceph.com' 2023-08-01T19:39:03.965 DEBUG:teuthology.orchestra.connection:{'hostname': 'smithi101.front.sepia.ceph.com', 'username': 'ubuntu', 'timeout': 60} 2023-08-01T19:39:04.440 DEBUG:teuthology.orchestra.remote:[Errno None] Unable to connect to port 22 on 172.21.15.6 2023-08-01T19:39:05.488 DEBUG:teuthology.orchestra.remote:[Errno None] Unable to connect to port 22 on 172.21.15.8 2023-08-01T19:39:07.028 DEBUG:teuthology.orchestra.remote:[Errno None] Unable to connect to port 22 on 172.21.15.155 2023-08-01T19:39:07.029 DEBUG:teuthology.orchestra.remote:[Errno None] Unable to connect to port 22 on 172.21.15.101 2023-08-01T19:39:13.444 INFO:teuthology.orchestra.remote:Trying to reconnect to host 'ubuntu@smithi006.front.sepia.ceph.com' 2023-08-01T19:39:13.445 DEBUG:teuthology.orchestra.connection:{'hostname': 'smithi006.front.sepia.ceph.com', 'username': 'ubuntu', 'timeout': 60} 2023-08-01T19:39:17.496 INFO:teuthology.orchestra.remote:Trying to reconnect to host 'ubuntu@smithi008.front.sepia.ceph.com' 2023-08-01T19:39:17.497 DEBUG:teuthology.orchestra.connection:{'hostname': 'smithi008.front.sepia.ceph.com', 'username': 'ubuntu', 'timeout': 60} 2023-08-01T19:39:19.031 INFO:teuthology.orchestra.remote:Trying to reconnect to host 'ubuntu@smithi155.front.sepia.ceph.com' 2023-08-01T19:39:19.031 DEBUG:teuthology.orchestra.connection:{'hostname': 'smithi155.front.sepia.ceph.com', 'username': 'ubuntu', 'timeout': 60} 2023-08-01T19:39:19.033 INFO:teuthology.orchestra.remote:Trying to reconnect to host 'ubuntu@smithi101.front.sepia.ceph.com' 2023-08-01T19:39:19.033 DEBUG:teuthology.orchestra.connection:{'hostname': 'smithi101.front.sepia.ceph.com', 'username': 'ubuntu', 'timeout': 60} 2023-08-01T19:39:37.456 DEBUG:teuthology.orchestra.remote:[Errno None] Unable to connect to port 22 on 172.21.15.155 2023-08-01T19:39:37.457 DEBUG:teuthology.orchestra.remote:[Errno None] Unable to connect to port 22 on 172.21.15.101 2023-08-01T19:39:49.632 DEBUG:teuthology.orchestra.run.smithi008:> true 2023-08-01T19:39:49.949 INFO:teuthology.orchestra.remote:Successfully reconnected to host 'ubuntu@smithi008.front.sepia.ceph.com' 2023-08-01T19:39:49.949 INFO:teuthology.task.kernel:Checking kernel version of osd.0, want "4.18.0-500.el8.x86_64"... 2023-08-01T19:39:49.950 DEBUG:teuthology.orchestra.run.smithi008:> uname -r 2023-08-01T19:39:49.969 INFO:teuthology.orchestra.run.smithi008.stdout:4.18.0-500.el8.x86_64 2023-08-01T19:39:49.969 DEBUG:teuthology.task.kernel:current kernel version is 4.18.0-500.el8.x86_64 vs 4.18.0-500.el8.x86_64 2023-08-01T19:39:49.969 DEBUG:teuthology.task.kernel:utsrelease strings match, do not need to install 2023-08-01T19:39:49.970 DEBUG:teuthology.task.kernel:Distro of this test job: centos 2023-08-01T19:39:50.970 INFO:teuthology.task.kernel:Enabling kdb on osd.0... 2023-08-01T19:39:50.971 DEBUG:teuthology.orchestra.run.smithi008:> echo ttyS1 | sudo tee /sys/module/kgdboc/parameters/kgdboc 2023-08-01T19:39:51.049 INFO:teuthology.orchestra.run.smithi008.stdout:ttyS1 2023-08-01T19:39:51.063 DEBUG:teuthology.parallel:result is None 2023-08-01T19:39:52.457 INFO:teuthology.orchestra.remote:Trying to reconnect to host 'ubuntu@smithi155.front.sepia.ceph.com' 2023-08-01T19:39:52.458 DEBUG:teuthology.orchestra.connection:{'hostname': 'smithi155.front.sepia.ceph.com', 'username': 'ubuntu', 'timeout': 60} 2023-08-01T19:39:52.466 INFO:teuthology.orchestra.remote:Trying to reconnect to host 'ubuntu@smithi101.front.sepia.ceph.com' 2023-08-01T19:39:52.467 DEBUG:teuthology.orchestra.connection:{'hostname': 'smithi101.front.sepia.ceph.com', 'username': 'ubuntu', 'timeout': 60} 2023-08-01T19:39:52.787 DEBUG:teuthology.orchestra.run.smithi155:> true 2023-08-01T19:39:53.146 INFO:teuthology.orchestra.remote:Successfully reconnected to host 'ubuntu@smithi155.front.sepia.ceph.com' 2023-08-01T19:39:53.146 INFO:teuthology.task.kernel:Checking kernel version of osd.2, want "4.18.0-500.el8.x86_64"... 2023-08-01T19:39:53.147 DEBUG:teuthology.orchestra.run.smithi155:> uname -r 2023-08-01T19:39:53.164 INFO:teuthology.orchestra.run.smithi155.stdout:4.18.0-500.el8.x86_64 2023-08-01T19:39:53.165 DEBUG:teuthology.task.kernel:current kernel version is 4.18.0-500.el8.x86_64 vs 4.18.0-500.el8.x86_64 2023-08-01T19:39:53.165 DEBUG:teuthology.task.kernel:utsrelease strings match, do not need to install 2023-08-01T19:39:53.165 DEBUG:teuthology.task.kernel:Distro of this test job: centos 2023-08-01T19:39:53.776 DEBUG:teuthology.orchestra.run.smithi101:> true 2023-08-01T19:39:54.166 INFO:teuthology.task.kernel:Enabling kdb on osd.2... 2023-08-01T19:39:54.167 DEBUG:teuthology.orchestra.run.smithi155:> echo ttyS1 | sudo tee /sys/module/kgdboc/parameters/kgdboc 2023-08-01T19:39:54.242 INFO:teuthology.orchestra.run.smithi155.stdout:ttyS1 2023-08-01T19:39:54.256 DEBUG:teuthology.parallel:result is None 2023-08-01T19:39:54.278 INFO:teuthology.orchestra.remote:Successfully reconnected to host 'ubuntu@smithi101.front.sepia.ceph.com' 2023-08-01T19:39:54.278 INFO:teuthology.task.kernel:Checking kernel version of osd.1, want "4.18.0-500.el8.x86_64"... 2023-08-01T19:39:54.278 DEBUG:teuthology.orchestra.run.smithi101:> uname -r 2023-08-01T19:39:54.297 INFO:teuthology.orchestra.run.smithi101.stdout:4.18.0-500.el8.x86_64 2023-08-01T19:39:54.298 DEBUG:teuthology.task.kernel:current kernel version is 4.18.0-500.el8.x86_64 vs 4.18.0-500.el8.x86_64 2023-08-01T19:39:54.298 DEBUG:teuthology.task.kernel:utsrelease strings match, do not need to install 2023-08-01T19:39:54.298 DEBUG:teuthology.task.kernel:Distro of this test job: centos 2023-08-01T19:39:55.299 INFO:teuthology.task.kernel:Enabling kdb on osd.1... 2023-08-01T19:39:55.300 DEBUG:teuthology.orchestra.run.smithi101:> echo ttyS1 | sudo tee /sys/module/kgdboc/parameters/kgdboc 2023-08-01T19:39:55.382 INFO:teuthology.orchestra.run.smithi101.stdout:ttyS1 2023-08-01T19:39:55.393 DEBUG:teuthology.parallel:result is None 2023-08-01T19:40:13.446 DEBUG:teuthology.orchestra.remote:timed out 2023-08-01T19:40:25.449 INFO:teuthology.orchestra.remote:Trying to reconnect to host 'ubuntu@smithi006.front.sepia.ceph.com' 2023-08-01T19:40:25.449 DEBUG:teuthology.orchestra.connection:{'hostname': 'smithi006.front.sepia.ceph.com', 'username': 'ubuntu', 'timeout': 60} 2023-08-01T19:40:25.793 DEBUG:teuthology.orchestra.run.smithi006:> true 2023-08-01T19:40:26.059 INFO:teuthology.orchestra.remote:Successfully reconnected to host 'ubuntu@smithi006.front.sepia.ceph.com' 2023-08-01T19:40:26.060 INFO:teuthology.task.kernel:Checking kernel version of mon.a, want "4.18.0-500.el8.x86_64"... 2023-08-01T19:40:26.060 DEBUG:teuthology.orchestra.run.smithi006:> uname -r 2023-08-01T19:40:26.080 INFO:teuthology.orchestra.run.smithi006.stdout:4.18.0-500.el8.x86_64 2023-08-01T19:40:26.081 DEBUG:teuthology.task.kernel:current kernel version is 4.18.0-500.el8.x86_64 vs 4.18.0-500.el8.x86_64 2023-08-01T19:40:26.081 DEBUG:teuthology.task.kernel:utsrelease strings match, do not need to install 2023-08-01T19:40:26.081 DEBUG:teuthology.task.kernel:Distro of this test job: centos 2023-08-01T19:40:27.082 INFO:teuthology.task.kernel:Enabling kdb on mon.a... 2023-08-01T19:40:27.082 DEBUG:teuthology.orchestra.run.smithi006:> echo ttyS1 | sudo tee /sys/module/kgdboc/parameters/kgdboc 2023-08-01T19:40:27.164 INFO:teuthology.orchestra.run.smithi006.stdout:ttyS1 2023-08-01T19:40:27.179 DEBUG:teuthology.parallel:result is None 2023-08-01T19:40:27.179 INFO:teuthology.run_tasks:Running task internal.base... 2023-08-01T19:40:27.187 INFO:teuthology.task.internal:Creating test directory... 2023-08-01T19:40:27.187 DEBUG:teuthology.orchestra.run.smithi006:> mkdir -p -m0755 -- /home/ubuntu/cephtest 2023-08-01T19:40:27.190 DEBUG:teuthology.orchestra.run.smithi008:> mkdir -p -m0755 -- /home/ubuntu/cephtest 2023-08-01T19:40:27.193 DEBUG:teuthology.orchestra.run.smithi101:> mkdir -p -m0755 -- /home/ubuntu/cephtest 2023-08-01T19:40:27.209 DEBUG:teuthology.orchestra.run.smithi155:> mkdir -p -m0755 -- /home/ubuntu/cephtest 2023-08-01T19:40:27.235 INFO:teuthology.run_tasks:Running task internal.archive_upload... 2023-08-01T19:40:27.243 INFO:teuthology.run_tasks:Running task internal.archive... 2023-08-01T19:40:27.259 INFO:teuthology.task.internal:Creating archive directory... 2023-08-01T19:40:27.260 DEBUG:teuthology.orchestra.run.smithi006:> install -d -m0755 -- /home/ubuntu/cephtest/archive 2023-08-01T19:40:27.272 DEBUG:teuthology.orchestra.run.smithi008:> install -d -m0755 -- /home/ubuntu/cephtest/archive 2023-08-01T19:40:27.276 DEBUG:teuthology.orchestra.run.smithi101:> install -d -m0755 -- /home/ubuntu/cephtest/archive 2023-08-01T19:40:27.280 DEBUG:teuthology.orchestra.run.smithi155:> install -d -m0755 -- /home/ubuntu/cephtest/archive 2023-08-01T19:40:27.316 INFO:teuthology.run_tasks:Running task internal.coredump... 2023-08-01T19:40:27.327 INFO:teuthology.task.internal:Enabling coredump saving... 2023-08-01T19:40:27.328 DEBUG:teuthology.orchestra.run.smithi006:> install -d -m0755 -- /home/ubuntu/cephtest/archive/coredump && sudo sysctl -w kernel.core_pattern=/home/ubuntu/cephtest/archive/coredump/%t.%p.core && echo kernel.core_pattern=/home/ubuntu/cephtest/archive/coredump/%t.%p.core | sudo tee -a /etc/sysctl.conf 2023-08-01T19:40:27.347 DEBUG:teuthology.orchestra.run.smithi008:> install -d -m0755 -- /home/ubuntu/cephtest/archive/coredump && sudo sysctl -w kernel.core_pattern=/home/ubuntu/cephtest/archive/coredump/%t.%p.core && echo kernel.core_pattern=/home/ubuntu/cephtest/archive/coredump/%t.%p.core | sudo tee -a /etc/sysctl.conf 2023-08-01T19:40:27.354 DEBUG:teuthology.orchestra.run.smithi101:> install -d -m0755 -- /home/ubuntu/cephtest/archive/coredump && sudo sysctl -w kernel.core_pattern=/home/ubuntu/cephtest/archive/coredump/%t.%p.core && echo kernel.core_pattern=/home/ubuntu/cephtest/archive/coredump/%t.%p.core | sudo tee -a /etc/sysctl.conf 2023-08-01T19:40:27.356 DEBUG:teuthology.orchestra.run.smithi155:> install -d -m0755 -- /home/ubuntu/cephtest/archive/coredump && sudo sysctl -w kernel.core_pattern=/home/ubuntu/cephtest/archive/coredump/%t.%p.core && echo kernel.core_pattern=/home/ubuntu/cephtest/archive/coredump/%t.%p.core | sudo tee -a /etc/sysctl.conf 2023-08-01T19:40:27.384 INFO:teuthology.orchestra.run.smithi006.stdout:kernel.core_pattern = /home/ubuntu/cephtest/archive/coredump/%t.%p.core 2023-08-01T19:40:27.390 INFO:teuthology.orchestra.run.smithi008.stdout:kernel.core_pattern = /home/ubuntu/cephtest/archive/coredump/%t.%p.core 2023-08-01T19:40:27.396 INFO:teuthology.orchestra.run.smithi006.stdout:kernel.core_pattern=/home/ubuntu/cephtest/archive/coredump/%t.%p.core 2023-08-01T19:40:27.406 INFO:teuthology.orchestra.run.smithi155.stdout:kernel.core_pattern = /home/ubuntu/cephtest/archive/coredump/%t.%p.core 2023-08-01T19:40:27.406 INFO:teuthology.orchestra.run.smithi101.stdout:kernel.core_pattern = /home/ubuntu/cephtest/archive/coredump/%t.%p.core 2023-08-01T19:40:27.407 INFO:teuthology.orchestra.run.smithi008.stdout:kernel.core_pattern=/home/ubuntu/cephtest/archive/coredump/%t.%p.core 2023-08-01T19:40:27.412 INFO:teuthology.orchestra.run.smithi101.stdout:kernel.core_pattern=/home/ubuntu/cephtest/archive/coredump/%t.%p.core 2023-08-01T19:40:27.416 INFO:teuthology.orchestra.run.smithi155.stdout:kernel.core_pattern=/home/ubuntu/cephtest/archive/coredump/%t.%p.core 2023-08-01T19:40:27.418 INFO:teuthology.run_tasks:Running task internal.sudo... 2023-08-01T19:40:27.431 INFO:teuthology.task.internal:Configuring sudo... 2023-08-01T19:40:27.432 DEBUG:teuthology.orchestra.run.smithi006:> sudo sed -i.orig.teuthology -e 's/^\([^#]*\) \(requiretty\)/\1 !\2/g' -e 's/^\([^#]*\) !\(visiblepw\)/\1 \2/g' /etc/sudoers 2023-08-01T19:40:27.441 DEBUG:teuthology.orchestra.run.smithi008:> sudo sed -i.orig.teuthology -e 's/^\([^#]*\) \(requiretty\)/\1 !\2/g' -e 's/^\([^#]*\) !\(visiblepw\)/\1 \2/g' /etc/sudoers 2023-08-01T19:40:27.450 DEBUG:teuthology.orchestra.run.smithi101:> sudo sed -i.orig.teuthology -e 's/^\([^#]*\) \(requiretty\)/\1 !\2/g' -e 's/^\([^#]*\) !\(visiblepw\)/\1 \2/g' /etc/sudoers 2023-08-01T19:40:27.454 DEBUG:teuthology.orchestra.run.smithi155:> sudo sed -i.orig.teuthology -e 's/^\([^#]*\) \(requiretty\)/\1 !\2/g' -e 's/^\([^#]*\) !\(visiblepw\)/\1 \2/g' /etc/sudoers 2023-08-01T19:40:27.489 INFO:teuthology.run_tasks:Running task internal.syslog... 2023-08-01T19:40:27.503 INFO:teuthology.task.internal.syslog:Starting syslog monitoring... 2023-08-01T19:40:27.503 DEBUG:teuthology.orchestra.run.smithi006:> mkdir -p -m0755 -- /home/ubuntu/cephtest/archive/syslog 2023-08-01T19:40:27.515 DEBUG:teuthology.orchestra.run.smithi008:> mkdir -p -m0755 -- /home/ubuntu/cephtest/archive/syslog 2023-08-01T19:40:27.527 DEBUG:teuthology.orchestra.run.smithi101:> mkdir -p -m0755 -- /home/ubuntu/cephtest/archive/syslog 2023-08-01T19:40:27.540 DEBUG:teuthology.orchestra.run.smithi155:> mkdir -p -m0755 -- /home/ubuntu/cephtest/archive/syslog 2023-08-01T19:40:27.561 DEBUG:teuthology.orchestra.run.smithi006:> install -m 666 /dev/null /home/ubuntu/cephtest/archive/syslog/kern.log 2023-08-01T19:40:27.621 DEBUG:teuthology.orchestra.run.smithi006:> sudo chcon system_u:object_r:var_log_t:s0 /home/ubuntu/cephtest/archive/syslog/kern.log 2023-08-01T19:40:27.685 DEBUG:teuthology.orchestra.run.smithi006:> install -m 666 /dev/null /home/ubuntu/cephtest/archive/syslog/misc.log 2023-08-01T19:40:27.732 DEBUG:teuthology.orchestra.run.smithi006:> sudo chcon system_u:object_r:var_log_t:s0 /home/ubuntu/cephtest/archive/syslog/misc.log 2023-08-01T19:40:27.779 DEBUG:teuthology.orchestra.run.smithi006:> set -ex 2023-08-01T19:40:27.779 DEBUG:teuthology.orchestra.run.smithi006:> sudo dd of=/etc/rsyslog.d/80-cephtest.conf 2023-08-01T19:40:27.853 DEBUG:teuthology.orchestra.run.smithi008:> install -m 666 /dev/null /home/ubuntu/cephtest/archive/syslog/kern.log 2023-08-01T19:40:27.901 DEBUG:teuthology.orchestra.run.smithi008:> sudo chcon system_u:object_r:var_log_t:s0 /home/ubuntu/cephtest/archive/syslog/kern.log 2023-08-01T19:40:27.961 DEBUG:teuthology.orchestra.run.smithi008:> install -m 666 /dev/null /home/ubuntu/cephtest/archive/syslog/misc.log 2023-08-01T19:40:28.070 DEBUG:teuthology.orchestra.run.smithi008:> sudo chcon system_u:object_r:var_log_t:s0 /home/ubuntu/cephtest/archive/syslog/misc.log 2023-08-01T19:40:28.102 DEBUG:teuthology.orchestra.run.smithi008:> set -ex 2023-08-01T19:40:28.102 DEBUG:teuthology.orchestra.run.smithi008:> sudo dd of=/etc/rsyslog.d/80-cephtest.conf 2023-08-01T19:40:28.178 DEBUG:teuthology.orchestra.run.smithi101:> install -m 666 /dev/null /home/ubuntu/cephtest/archive/syslog/kern.log 2023-08-01T19:40:28.235 DEBUG:teuthology.orchestra.run.smithi101:> sudo chcon system_u:object_r:var_log_t:s0 /home/ubuntu/cephtest/archive/syslog/kern.log 2023-08-01T19:40:28.296 DEBUG:teuthology.orchestra.run.smithi101:> install -m 666 /dev/null /home/ubuntu/cephtest/archive/syslog/misc.log 2023-08-01T19:40:28.386 DEBUG:teuthology.orchestra.run.smithi101:> sudo chcon system_u:object_r:var_log_t:s0 /home/ubuntu/cephtest/archive/syslog/misc.log 2023-08-01T19:40:28.432 DEBUG:teuthology.orchestra.run.smithi101:> set -ex 2023-08-01T19:40:28.433 DEBUG:teuthology.orchestra.run.smithi101:> sudo dd of=/etc/rsyslog.d/80-cephtest.conf 2023-08-01T19:40:28.509 DEBUG:teuthology.orchestra.run.smithi155:> install -m 666 /dev/null /home/ubuntu/cephtest/archive/syslog/kern.log 2023-08-01T19:40:28.560 DEBUG:teuthology.orchestra.run.smithi155:> sudo chcon system_u:object_r:var_log_t:s0 /home/ubuntu/cephtest/archive/syslog/kern.log 2023-08-01T19:40:28.621 DEBUG:teuthology.orchestra.run.smithi155:> install -m 666 /dev/null /home/ubuntu/cephtest/archive/syslog/misc.log 2023-08-01T19:40:28.719 DEBUG:teuthology.orchestra.run.smithi155:> sudo chcon system_u:object_r:var_log_t:s0 /home/ubuntu/cephtest/archive/syslog/misc.log 2023-08-01T19:40:28.754 DEBUG:teuthology.orchestra.run.smithi155:> set -ex 2023-08-01T19:40:28.754 DEBUG:teuthology.orchestra.run.smithi155:> sudo dd of=/etc/rsyslog.d/80-cephtest.conf 2023-08-01T19:40:28.823 DEBUG:teuthology.orchestra.run.smithi006:> sudo service rsyslog restart 2023-08-01T19:40:28.827 DEBUG:teuthology.orchestra.run.smithi008:> sudo service rsyslog restart 2023-08-01T19:40:28.831 DEBUG:teuthology.orchestra.run.smithi101:> sudo service rsyslog restart 2023-08-01T19:40:28.837 DEBUG:teuthology.orchestra.run.smithi155:> sudo service rsyslog restart 2023-08-01T19:40:28.896 INFO:teuthology.orchestra.run.smithi006.stderr:Redirecting to /bin/systemctl restart rsyslog.service 2023-08-01T19:40:28.904 INFO:teuthology.orchestra.run.smithi101.stderr:Redirecting to /bin/systemctl restart rsyslog.service 2023-08-01T19:40:28.905 INFO:teuthology.orchestra.run.smithi008.stderr:Redirecting to /bin/systemctl restart rsyslog.service 2023-08-01T19:40:28.948 INFO:teuthology.orchestra.run.smithi155.stderr:Redirecting to /bin/systemctl restart rsyslog.service 2023-08-01T19:40:29.359 INFO:teuthology.run_tasks:Running task internal.timer... 2023-08-01T19:40:29.368 INFO:teuthology.task.internal:Starting timer... 2023-08-01T19:40:29.368 INFO:teuthology.run_tasks:Running task pcp... 2023-08-01T19:40:29.467 INFO:teuthology.run_tasks:Running task selinux... 2023-08-01T19:40:29.480 DEBUG:teuthology.task:Applying overrides for task selinux: {'whitelist': ['scontext=system_u:system_r:logrotate_t:s0']} 2023-08-01T19:40:29.487 DEBUG:teuthology.orchestra.run.smithi006:> sudo service auditd rotate 2023-08-01T19:40:29.558 INFO:teuthology.orchestra.run.smithi006.stdout:Rotating logs: 2023-08-01T19:40:29.559 DEBUG:teuthology.orchestra.run.smithi008:> sudo service auditd rotate 2023-08-01T19:40:29.630 INFO:teuthology.orchestra.run.smithi008.stdout:Rotating logs: 2023-08-01T19:40:29.632 DEBUG:teuthology.orchestra.run.smithi101:> sudo service auditd rotate 2023-08-01T19:40:29.704 INFO:teuthology.orchestra.run.smithi101.stdout:Rotating logs: 2023-08-01T19:40:29.705 DEBUG:teuthology.orchestra.run.smithi155:> sudo service auditd rotate 2023-08-01T19:40:29.777 INFO:teuthology.orchestra.run.smithi155.stdout:Rotating logs: 2023-08-01T19:40:29.779 DEBUG:teuthology.task.selinux:Getting current SELinux state 2023-08-01T19:40:29.779 DEBUG:teuthology.orchestra.run.smithi006:> /usr/sbin/getenforce 2023-08-01T19:40:29.810 INFO:teuthology.orchestra.run.smithi006.stdout:Permissive 2023-08-01T19:40:29.811 DEBUG:teuthology.orchestra.run.smithi008:> /usr/sbin/getenforce 2023-08-01T19:40:29.836 INFO:teuthology.orchestra.run.smithi008.stdout:Permissive 2023-08-01T19:40:29.837 DEBUG:teuthology.orchestra.run.smithi101:> /usr/sbin/getenforce 2023-08-01T19:40:29.873 INFO:teuthology.orchestra.run.smithi101.stdout:Permissive 2023-08-01T19:40:29.874 DEBUG:teuthology.orchestra.run.smithi155:> /usr/sbin/getenforce 2023-08-01T19:40:29.901 INFO:teuthology.orchestra.run.smithi155.stdout:Permissive 2023-08-01T19:40:29.902 DEBUG:teuthology.task.selinux:Existing SELinux modes: {'ubuntu@smithi006.front.sepia.ceph.com': 'permissive', 'ubuntu@smithi008.front.sepia.ceph.com': 'permissive', 'ubuntu@smithi101.front.sepia.ceph.com': 'permissive', 'ubuntu@smithi155.front.sepia.ceph.com': 'permissive'} 2023-08-01T19:40:29.902 DEBUG:teuthology.orchestra.run.smithi006:> sudo grep -a 'avc: .*denied' /var/log/audit/audit.log | grep -av -e 'comm="dmidecode"' -e chronyd.service -e 'name="cephtest"' -e scontext=system_u:system_r:nrpe_t:s0 -e scontext=system_u:system_r:pcp_pmlogger_t -e scontext=system_u:system_r:pcp_pmcd_t:s0 -e 'comm="rhsmd"' -e scontext=system_u:system_r:syslogd_t:s0 -e tcontext=system_u:system_r:nrpe_t:s0 -e 'comm="updatedb"' -e 'comm="smartd"' -e 'comm="rhsmcertd-worke"' -e 'comm="setroubleshootd"' -e 'comm="rpm"' -e tcontext=system_u:object_r:container_runtime_exec_t:s0 -e 'comm="ksmtuned"' -e 'comm="sssd"' -e 'comm="sss_cache"' -e context=system_u:system_r:NetworkManager_dispatcher_t:s0 2023-08-01T19:40:29.937 DEBUG:teuthology.orchestra.run:got remote process result: 1 2023-08-01T19:40:29.938 DEBUG:teuthology.orchestra.run.smithi008:> sudo grep -a 'avc: .*denied' /var/log/audit/audit.log | grep -av -e 'comm="dmidecode"' -e chronyd.service -e 'name="cephtest"' -e scontext=system_u:system_r:nrpe_t:s0 -e scontext=system_u:system_r:pcp_pmlogger_t -e scontext=system_u:system_r:pcp_pmcd_t:s0 -e 'comm="rhsmd"' -e scontext=system_u:system_r:syslogd_t:s0 -e tcontext=system_u:system_r:nrpe_t:s0 -e 'comm="updatedb"' -e 'comm="smartd"' -e 'comm="rhsmcertd-worke"' -e 'comm="setroubleshootd"' -e 'comm="rpm"' -e tcontext=system_u:object_r:container_runtime_exec_t:s0 -e 'comm="ksmtuned"' -e 'comm="sssd"' -e 'comm="sss_cache"' -e context=system_u:system_r:NetworkManager_dispatcher_t:s0 2023-08-01T19:40:29.972 DEBUG:teuthology.orchestra.run:got remote process result: 1 2023-08-01T19:40:29.973 DEBUG:teuthology.orchestra.run.smithi101:> sudo grep -a 'avc: .*denied' /var/log/audit/audit.log | grep -av -e 'comm="dmidecode"' -e chronyd.service -e 'name="cephtest"' -e scontext=system_u:system_r:nrpe_t:s0 -e scontext=system_u:system_r:pcp_pmlogger_t -e scontext=system_u:system_r:pcp_pmcd_t:s0 -e 'comm="rhsmd"' -e scontext=system_u:system_r:syslogd_t:s0 -e tcontext=system_u:system_r:nrpe_t:s0 -e 'comm="updatedb"' -e 'comm="smartd"' -e 'comm="rhsmcertd-worke"' -e 'comm="setroubleshootd"' -e 'comm="rpm"' -e tcontext=system_u:object_r:container_runtime_exec_t:s0 -e 'comm="ksmtuned"' -e 'comm="sssd"' -e 'comm="sss_cache"' -e context=system_u:system_r:NetworkManager_dispatcher_t:s0 2023-08-01T19:40:30.005 DEBUG:teuthology.orchestra.run:got remote process result: 1 2023-08-01T19:40:30.006 DEBUG:teuthology.orchestra.run.smithi155:> sudo grep -a 'avc: .*denied' /var/log/audit/audit.log | grep -av -e 'comm="dmidecode"' -e chronyd.service -e 'name="cephtest"' -e scontext=system_u:system_r:nrpe_t:s0 -e scontext=system_u:system_r:pcp_pmlogger_t -e scontext=system_u:system_r:pcp_pmcd_t:s0 -e 'comm="rhsmd"' -e scontext=system_u:system_r:syslogd_t:s0 -e tcontext=system_u:system_r:nrpe_t:s0 -e 'comm="updatedb"' -e 'comm="smartd"' -e 'comm="rhsmcertd-worke"' -e 'comm="setroubleshootd"' -e 'comm="rpm"' -e tcontext=system_u:object_r:container_runtime_exec_t:s0 -e 'comm="ksmtuned"' -e 'comm="sssd"' -e 'comm="sss_cache"' -e context=system_u:system_r:NetworkManager_dispatcher_t:s0 2023-08-01T19:40:30.037 DEBUG:teuthology.orchestra.run:got remote process result: 1 2023-08-01T19:40:30.039 INFO:teuthology.task.selinux:Putting SELinux into permissive mode 2023-08-01T19:40:30.039 DEBUG:teuthology.orchestra.run.smithi006:> sudo /usr/sbin/setenforce permissive 2023-08-01T19:40:30.069 DEBUG:teuthology.orchestra.run.smithi008:> sudo /usr/sbin/setenforce permissive 2023-08-01T19:40:30.105 DEBUG:teuthology.orchestra.run.smithi101:> sudo /usr/sbin/setenforce permissive 2023-08-01T19:40:30.134 DEBUG:teuthology.orchestra.run.smithi155:> sudo /usr/sbin/setenforce permissive 2023-08-01T19:40:30.184 INFO:teuthology.run_tasks:Running task ansible.cephlab... 2023-08-01T19:40:30.200 DEBUG:teuthology.repo_utils:Setting repo remote to https://git.ceph.com/ceph-cm-ansible.git 2023-08-01T19:40:30.209 INFO:teuthology.repo_utils:Fetching main from origin 2023-08-01T19:40:30.484 INFO:teuthology.repo_utils:Resetting repo at /home/teuthworker/src/git.ceph.com_ceph-cm-ansible_main to origin/main 2023-08-01T19:40:30.526 INFO:teuthology.task.ansible:Playbook: [{'import_playbook': 'ansible_managed.yml'}, {'import_playbook': 'teuthology.yml'}, {'hosts': 'testnodes', 'tasks': [{'set_fact': {'ran_from_cephlab_playbook': True}}]}, {'import_playbook': 'testnodes.yml'}, {'import_playbook': 'container-host.yml'}, {'import_playbook': 'cobbler.yml'}, {'import_playbook': 'paddles.yml'}, {'import_playbook': 'pulpito.yml'}, {'hosts': 'testnodes', 'become': True, 'tasks': [{'name': 'Touch /ceph-qa-ready', 'file': {'path': '/ceph-qa-ready', 'state': 'touch'}, 'when': 'ran_from_cephlab_playbook|bool'}]}] 2023-08-01T19:40:30.527 DEBUG:teuthology.task.ansible:Running ansible-playbook -v --extra-vars '{"ansible_ssh_user": "ubuntu"}' -i /etc/ansible/hosts --limit smithi006.front.sepia.ceph.com,smithi008.front.sepia.ceph.com,smithi101.front.sepia.ceph.com,smithi155.front.sepia.ceph.com /home/teuthworker/src/git.ceph.com_ceph-cm-ansible_main/cephlab.yml 2023-08-01T19:50:23.193 DEBUG:teuthology.task.ansible:Reconnecting to [Remote(name='ubuntu@smithi006.front.sepia.ceph.com'), Remote(name='ubuntu@smithi008.front.sepia.ceph.com'), Remote(name='ubuntu@smithi101.front.sepia.ceph.com'), Remote(name='ubuntu@smithi155.front.sepia.ceph.com')] 2023-08-01T19:50:23.194 INFO:teuthology.orchestra.remote:Trying to reconnect to host 'ubuntu@smithi006.front.sepia.ceph.com' 2023-08-01T19:50:23.195 DEBUG:teuthology.orchestra.connection:{'hostname': 'smithi006.front.sepia.ceph.com', 'username': 'ubuntu', 'timeout': 60} 2023-08-01T19:50:23.262 DEBUG:teuthology.orchestra.run.smithi006:> true 2023-08-01T19:50:23.335 INFO:teuthology.orchestra.remote:Successfully reconnected to host 'ubuntu@smithi006.front.sepia.ceph.com' 2023-08-01T19:50:23.335 INFO:teuthology.orchestra.remote:Trying to reconnect to host 'ubuntu@smithi008.front.sepia.ceph.com' 2023-08-01T19:50:23.336 DEBUG:teuthology.orchestra.connection:{'hostname': 'smithi008.front.sepia.ceph.com', 'username': 'ubuntu', 'timeout': 60} 2023-08-01T19:50:23.403 DEBUG:teuthology.orchestra.run.smithi008:> true 2023-08-01T19:50:23.472 INFO:teuthology.orchestra.remote:Successfully reconnected to host 'ubuntu@smithi008.front.sepia.ceph.com' 2023-08-01T19:50:23.473 INFO:teuthology.orchestra.remote:Trying to reconnect to host 'ubuntu@smithi101.front.sepia.ceph.com' 2023-08-01T19:50:23.473 DEBUG:teuthology.orchestra.connection:{'hostname': 'smithi101.front.sepia.ceph.com', 'username': 'ubuntu', 'timeout': 60} 2023-08-01T19:50:23.542 DEBUG:teuthology.orchestra.run.smithi101:> true 2023-08-01T19:50:23.571 INFO:teuthology.orchestra.remote:Successfully reconnected to host 'ubuntu@smithi101.front.sepia.ceph.com' 2023-08-01T19:50:23.572 INFO:teuthology.orchestra.remote:Trying to reconnect to host 'ubuntu@smithi155.front.sepia.ceph.com' 2023-08-01T19:50:23.572 DEBUG:teuthology.orchestra.connection:{'hostname': 'smithi155.front.sepia.ceph.com', 'username': 'ubuntu', 'timeout': 60} 2023-08-01T19:50:23.643 DEBUG:teuthology.orchestra.run.smithi155:> true 2023-08-01T19:50:23.673 INFO:teuthology.orchestra.remote:Successfully reconnected to host 'ubuntu@smithi155.front.sepia.ceph.com' 2023-08-01T19:50:23.676 INFO:teuthology.run_tasks:Running task clock... 2023-08-01T19:50:23.686 INFO:teuthology.task.clock:Syncing clocks and checking initial clock skew... 2023-08-01T19:50:23.687 INFO:teuthology.orchestra.run:Running command with timeout 360 2023-08-01T19:50:23.687 DEBUG:teuthology.orchestra.run.smithi006:> sudo systemctl stop ntp.service || sudo systemctl stop ntpd.service || sudo systemctl stop chronyd.service ; sudo ntpd -gq || sudo chronyc makestep ; sudo systemctl start ntp.service || sudo systemctl start ntpd.service || sudo systemctl start chronyd.service ; PATH=/usr/bin:/usr/sbin ntpq -p || PATH=/usr/bin:/usr/sbin chronyc sources || true 2023-08-01T19:50:23.689 INFO:teuthology.orchestra.run:Running command with timeout 360 2023-08-01T19:50:23.690 DEBUG:teuthology.orchestra.run.smithi008:> sudo systemctl stop ntp.service || sudo systemctl stop ntpd.service || sudo systemctl stop chronyd.service ; sudo ntpd -gq || sudo chronyc makestep ; sudo systemctl start ntp.service || sudo systemctl start ntpd.service || sudo systemctl start chronyd.service ; PATH=/usr/bin:/usr/sbin ntpq -p || PATH=/usr/bin:/usr/sbin chronyc sources || true 2023-08-01T19:50:23.692 INFO:teuthology.orchestra.run:Running command with timeout 360 2023-08-01T19:50:23.692 DEBUG:teuthology.orchestra.run.smithi101:> sudo systemctl stop ntp.service || sudo systemctl stop ntpd.service || sudo systemctl stop chronyd.service ; sudo ntpd -gq || sudo chronyc makestep ; sudo systemctl start ntp.service || sudo systemctl start ntpd.service || sudo systemctl start chronyd.service ; PATH=/usr/bin:/usr/sbin ntpq -p || PATH=/usr/bin:/usr/sbin chronyc sources || true 2023-08-01T19:50:23.694 INFO:teuthology.orchestra.run:Running command with timeout 360 2023-08-01T19:50:23.694 DEBUG:teuthology.orchestra.run.smithi155:> sudo systemctl stop ntp.service || sudo systemctl stop ntpd.service || sudo systemctl stop chronyd.service ; sudo ntpd -gq || sudo chronyc makestep ; sudo systemctl start ntp.service || sudo systemctl start ntpd.service || sudo systemctl start chronyd.service ; PATH=/usr/bin:/usr/sbin ntpq -p || PATH=/usr/bin:/usr/sbin chronyc sources || true 2023-08-01T19:50:23.721 INFO:teuthology.orchestra.run.smithi006.stderr:Failed to stop ntp.service: Unit ntp.service not loaded. 2023-08-01T19:50:23.726 INFO:teuthology.orchestra.run.smithi101.stderr:Failed to stop ntp.service: Unit ntp.service not loaded. 2023-08-01T19:50:23.727 INFO:teuthology.orchestra.run.smithi008.stderr:Failed to stop ntp.service: Unit ntp.service not loaded. 2023-08-01T19:50:23.736 INFO:teuthology.orchestra.run.smithi006.stderr:Failed to stop ntpd.service: Unit ntpd.service not loaded. 2023-08-01T19:50:23.741 INFO:teuthology.orchestra.run.smithi101.stderr:Failed to stop ntpd.service: Unit ntpd.service not loaded. 2023-08-01T19:50:23.742 INFO:teuthology.orchestra.run.smithi008.stderr:Failed to stop ntpd.service: Unit ntpd.service not loaded. 2023-08-01T19:50:23.749 INFO:teuthology.orchestra.run.smithi155.stderr:Failed to stop ntp.service: Unit ntp.service not loaded. 2023-08-01T19:50:23.764 INFO:teuthology.orchestra.run.smithi155.stderr:Failed to stop ntpd.service: Unit ntpd.service not loaded. 2023-08-01T19:50:23.804 INFO:teuthology.orchestra.run.smithi006.stderr:sudo: ntpd: command not found 2023-08-01T19:50:23.809 INFO:teuthology.orchestra.run.smithi101.stderr:sudo: ntpd: command not found 2023-08-01T19:50:23.816 INFO:teuthology.orchestra.run.smithi006.stdout:506 Cannot talk to daemon 2023-08-01T19:50:23.821 INFO:teuthology.orchestra.run.smithi101.stdout:506 Cannot talk to daemon 2023-08-01T19:50:23.825 INFO:teuthology.orchestra.run.smithi008.stderr:sudo: ntpd: command not found 2023-08-01T19:50:23.831 INFO:teuthology.orchestra.run.smithi006.stderr:Failed to start ntp.service: Unit ntp.service not found. 2023-08-01T19:50:23.835 INFO:teuthology.orchestra.run.smithi101.stderr:Failed to start ntp.service: Unit ntp.service not found. 2023-08-01T19:50:23.837 INFO:teuthology.orchestra.run.smithi008.stdout:506 Cannot talk to daemon 2023-08-01T19:50:23.838 INFO:teuthology.orchestra.run.smithi155.stderr:sudo: ntpd: command not found 2023-08-01T19:50:23.845 INFO:teuthology.orchestra.run.smithi006.stderr:Failed to start ntpd.service: Unit ntpd.service not found. 2023-08-01T19:50:23.848 INFO:teuthology.orchestra.run.smithi101.stderr:Failed to start ntpd.service: Unit ntpd.service not found. 2023-08-01T19:50:23.850 INFO:teuthology.orchestra.run.smithi155.stdout:506 Cannot talk to daemon 2023-08-01T19:50:23.852 INFO:teuthology.orchestra.run.smithi008.stderr:Failed to start ntp.service: Unit ntp.service not found. 2023-08-01T19:50:23.864 INFO:teuthology.orchestra.run.smithi155.stderr:Failed to start ntp.service: Unit ntp.service not found. 2023-08-01T19:50:23.867 INFO:teuthology.orchestra.run.smithi008.stderr:Failed to start ntpd.service: Unit ntpd.service not found. 2023-08-01T19:50:23.878 INFO:teuthology.orchestra.run.smithi155.stderr:Failed to start ntpd.service: Unit ntpd.service not found. 2023-08-01T19:50:23.916 INFO:teuthology.orchestra.run.smithi101.stderr:bash: ntpq: command not found 2023-08-01T19:50:23.920 INFO:teuthology.orchestra.run.smithi101.stdout:MS Name/IP address Stratum Poll Reach LastRx Last sample 2023-08-01T19:50:23.920 INFO:teuthology.orchestra.run.smithi101.stdout:=============================================================================== 2023-08-01T19:50:23.920 INFO:teuthology.orchestra.run.smithi101.stdout:^? hv01.front.sepia.ceph.com 0 6 0 - +0ns[ +0ns] +/- 0ns 2023-08-01T19:50:23.921 INFO:teuthology.orchestra.run.smithi101.stdout:^? hv02.front.sepia.ceph.com 0 6 0 - +0ns[ +0ns] +/- 0ns 2023-08-01T19:50:23.921 INFO:teuthology.orchestra.run.smithi101.stdout:^? hv03.front.sepia.ceph.com 0 6 0 - +0ns[ +0ns] +/- 0ns 2023-08-01T19:50:23.921 INFO:teuthology.orchestra.run.smithi101.stdout:^? hv04.front.sepia.ceph.com 0 6 0 - +0ns[ +0ns] +/- 0ns 2023-08-01T19:50:23.921 INFO:teuthology.orchestra.run.smithi006.stderr:bash: ntpq: command not found 2023-08-01T19:50:23.925 INFO:teuthology.orchestra.run.smithi006.stdout:MS Name/IP address Stratum Poll Reach LastRx Last sample 2023-08-01T19:50:23.925 INFO:teuthology.orchestra.run.smithi006.stdout:=============================================================================== 2023-08-01T19:50:23.925 INFO:teuthology.orchestra.run.smithi006.stdout:^? hv01.front.sepia.ceph.com 0 6 0 - +0ns[ +0ns] +/- 0ns 2023-08-01T19:50:23.925 INFO:teuthology.orchestra.run.smithi006.stdout:^? hv02.front.sepia.ceph.com 0 6 0 - +0ns[ +0ns] +/- 0ns 2023-08-01T19:50:23.926 INFO:teuthology.orchestra.run.smithi006.stdout:^? hv03.front.sepia.ceph.com 0 6 0 - +0ns[ +0ns] +/- 0ns 2023-08-01T19:50:23.926 INFO:teuthology.orchestra.run.smithi006.stdout:^? hv04.front.sepia.ceph.com 0 6 0 - +0ns[ +0ns] +/- 0ns 2023-08-01T19:50:23.941 INFO:teuthology.orchestra.run.smithi008.stderr:bash: ntpq: command not found 2023-08-01T19:50:23.943 INFO:teuthology.orchestra.run.smithi155.stderr:bash: ntpq: command not found 2023-08-01T19:50:23.944 INFO:teuthology.orchestra.run.smithi008.stdout:MS Name/IP address Stratum Poll Reach LastRx Last sample 2023-08-01T19:50:23.944 INFO:teuthology.orchestra.run.smithi008.stdout:=============================================================================== 2023-08-01T19:50:23.944 INFO:teuthology.orchestra.run.smithi008.stdout:^? hv01.front.sepia.ceph.com 0 6 0 - +0ns[ +0ns] +/- 0ns 2023-08-01T19:50:23.944 INFO:teuthology.orchestra.run.smithi008.stdout:^? hv02.front.sepia.ceph.com 0 6 0 - +0ns[ +0ns] +/- 0ns 2023-08-01T19:50:23.944 INFO:teuthology.orchestra.run.smithi008.stdout:^? hv03.front.sepia.ceph.com 0 6 0 - +0ns[ +0ns] +/- 0ns 2023-08-01T19:50:23.945 INFO:teuthology.orchestra.run.smithi008.stdout:^? hv04.front.sepia.ceph.com 0 6 0 - +0ns[ +0ns] +/- 0ns 2023-08-01T19:50:23.946 INFO:teuthology.orchestra.run.smithi155.stdout:MS Name/IP address Stratum Poll Reach LastRx Last sample 2023-08-01T19:50:23.946 INFO:teuthology.orchestra.run.smithi155.stdout:=============================================================================== 2023-08-01T19:50:23.946 INFO:teuthology.orchestra.run.smithi155.stdout:^? hv01.front.sepia.ceph.com 0 6 0 - +0ns[ +0ns] +/- 0ns 2023-08-01T19:50:23.947 INFO:teuthology.orchestra.run.smithi155.stdout:^? hv02.front.sepia.ceph.com 0 6 0 - +0ns[ +0ns] +/- 0ns 2023-08-01T19:50:23.947 INFO:teuthology.orchestra.run.smithi155.stdout:^? hv03.front.sepia.ceph.com 0 6 0 - +0ns[ +0ns] +/- 0ns 2023-08-01T19:50:23.947 INFO:teuthology.orchestra.run.smithi155.stdout:^? hv04.front.sepia.ceph.com 0 6 0 - +0ns[ +0ns] +/- 0ns 2023-08-01T19:50:23.948 INFO:teuthology.run_tasks:Running task install... 2023-08-01T19:50:23.958 DEBUG:teuthology.task.install:project ceph 2023-08-01T19:50:23.959 DEBUG:teuthology.task.install:INSTALL overrides: {'ceph': {'flavor': 'default', 'sha1': '893fa35fffd26b5b50498e64ff6f7c94584d30b6'}} 2023-08-01T19:50:23.959 DEBUG:teuthology.task.install:config {'extra_system_packages': {'deb': ['bison', 'flex', 'libelf-dev', 'libssl-dev', 'libaio-dev', 'libtool-bin', 'uuid-dev', 'xfslibs-dev'], 'rpm': ['bison', 'flex', 'elfutils-libelf-devel', 'openssl-devel', 'libaio-devel', 'libtool', 'libuuid-devel', 'xfsprogs-devel']}, 'flavor': 'default', 'sha1': '893fa35fffd26b5b50498e64ff6f7c94584d30b6'} 2023-08-01T19:50:23.959 INFO:teuthology.task.install:Using flavor: default 2023-08-01T19:50:23.965 DEBUG:teuthology.task.install:Package list is: {'deb': ['ceph', 'cephadm', 'ceph-mds', 'ceph-mgr', 'ceph-common', 'ceph-fuse', 'ceph-test', 'ceph-volume', 'radosgw', 'python3-rados', 'python3-rgw', 'python3-cephfs', 'python3-rbd', 'libcephfs2', 'libcephfs-dev', 'librados2', 'librbd1', 'rbd-fuse'], 'rpm': ['ceph-radosgw', 'ceph-test', 'ceph', 'ceph-base', 'cephadm', 'ceph-immutable-object-cache', 'ceph-mgr', 'ceph-mgr-dashboard', 'ceph-mgr-diskprediction-local', 'ceph-mgr-rook', 'ceph-mgr-cephadm', 'ceph-fuse', 'ceph-volume', 'librados-devel', 'libcephfs2', 'libcephfs-devel', 'librados2', 'librbd1', 'python3-rados', 'python3-rgw', 'python3-cephfs', 'python3-rbd', 'rbd-fuse', 'rbd-mirror', 'rbd-nbd']} 2023-08-01T19:50:23.965 INFO:teuthology.task.install:extra packages: [] 2023-08-01T19:50:23.966 DEBUG:teuthology.task.install.rpm:_update_package_list_and_install: config is {'branch': None, 'cleanup': None, 'debuginfo': None, 'downgrade_packages': [], 'exclude_packages': [], 'extra_packages': [], 'extra_system_packages': {'deb': ['bison', 'flex', 'libelf-dev', 'libssl-dev', 'libaio-dev', 'libtool-bin', 'uuid-dev', 'xfslibs-dev'], 'rpm': ['bison', 'flex', 'elfutils-libelf-devel', 'openssl-devel', 'libaio-devel', 'libtool', 'libuuid-devel', 'xfsprogs-devel']}, 'extras': None, 'enable_coprs': [], 'flavor': 'default', 'install_ceph_packages': True, 'packages': {}, 'project': 'ceph', 'repos_only': False, 'sha1': '893fa35fffd26b5b50498e64ff6f7c94584d30b6', 'tag': None, 'wait_for_package': False} 2023-08-01T19:50:23.966 DEBUG:teuthology.packaging:Querying https://shaman.ceph.com/api/search?status=ready&project=ceph&flavor=default&distros=centos%2F8%2Fx86_64&sha1=893fa35fffd26b5b50498e64ff6f7c94584d30b6 2023-08-01T19:50:23.968 DEBUG:teuthology.task.install.rpm:_update_package_list_and_install: config is {'branch': None, 'cleanup': None, 'debuginfo': None, 'downgrade_packages': [], 'exclude_packages': [], 'extra_packages': [], 'extra_system_packages': {'deb': ['bison', 'flex', 'libelf-dev', 'libssl-dev', 'libaio-dev', 'libtool-bin', 'uuid-dev', 'xfslibs-dev'], 'rpm': ['bison', 'flex', 'elfutils-libelf-devel', 'openssl-devel', 'libaio-devel', 'libtool', 'libuuid-devel', 'xfsprogs-devel']}, 'extras': None, 'enable_coprs': [], 'flavor': 'default', 'install_ceph_packages': True, 'packages': {}, 'project': 'ceph', 'repos_only': False, 'sha1': '893fa35fffd26b5b50498e64ff6f7c94584d30b6', 'tag': None, 'wait_for_package': False} 2023-08-01T19:50:23.969 DEBUG:teuthology.packaging:Querying https://shaman.ceph.com/api/search?status=ready&project=ceph&flavor=default&distros=centos%2F8%2Fx86_64&sha1=893fa35fffd26b5b50498e64ff6f7c94584d30b6 2023-08-01T19:50:23.970 DEBUG:teuthology.task.install.rpm:_update_package_list_and_install: config is {'branch': None, 'cleanup': None, 'debuginfo': None, 'downgrade_packages': [], 'exclude_packages': [], 'extra_packages': [], 'extra_system_packages': {'deb': ['bison', 'flex', 'libelf-dev', 'libssl-dev', 'libaio-dev', 'libtool-bin', 'uuid-dev', 'xfslibs-dev'], 'rpm': ['bison', 'flex', 'elfutils-libelf-devel', 'openssl-devel', 'libaio-devel', 'libtool', 'libuuid-devel', 'xfsprogs-devel']}, 'extras': None, 'enable_coprs': [], 'flavor': 'default', 'install_ceph_packages': True, 'packages': {}, 'project': 'ceph', 'repos_only': False, 'sha1': '893fa35fffd26b5b50498e64ff6f7c94584d30b6', 'tag': None, 'wait_for_package': False} 2023-08-01T19:50:23.970 DEBUG:teuthology.packaging:Querying https://shaman.ceph.com/api/search?status=ready&project=ceph&flavor=default&distros=centos%2F8%2Fx86_64&sha1=893fa35fffd26b5b50498e64ff6f7c94584d30b6 2023-08-01T19:50:23.971 DEBUG:teuthology.task.install.rpm:_update_package_list_and_install: config is {'branch': None, 'cleanup': None, 'debuginfo': None, 'downgrade_packages': [], 'exclude_packages': [], 'extra_packages': [], 'extra_system_packages': {'deb': ['bison', 'flex', 'libelf-dev', 'libssl-dev', 'libaio-dev', 'libtool-bin', 'uuid-dev', 'xfslibs-dev'], 'rpm': ['bison', 'flex', 'elfutils-libelf-devel', 'openssl-devel', 'libaio-devel', 'libtool', 'libuuid-devel', 'xfsprogs-devel']}, 'extras': None, 'enable_coprs': [], 'flavor': 'default', 'install_ceph_packages': True, 'packages': {}, 'project': 'ceph', 'repos_only': False, 'sha1': '893fa35fffd26b5b50498e64ff6f7c94584d30b6', 'tag': None, 'wait_for_package': False} 2023-08-01T19:50:23.971 DEBUG:teuthology.packaging:Querying https://shaman.ceph.com/api/search?status=ready&project=ceph&flavor=default&distros=centos%2F8%2Fx86_64&sha1=893fa35fffd26b5b50498e64ff6f7c94584d30b6 2023-08-01T19:50:24.113 INFO:teuthology.task.install.rpm:Pulling from https://4.chacra.ceph.com/r/ceph/quincy/893fa35fffd26b5b50498e64ff6f7c94584d30b6/centos/8/flavors/default/ 2023-08-01T19:50:24.113 INFO:teuthology.task.install.rpm:Package version is 17.2.6-823.g893fa35f 2023-08-01T19:50:24.269 INFO:teuthology.task.install.rpm:Pulling from https://4.chacra.ceph.com/r/ceph/quincy/893fa35fffd26b5b50498e64ff6f7c94584d30b6/centos/8/flavors/default/ 2023-08-01T19:50:24.269 INFO:teuthology.task.install.rpm:Package version is 17.2.6-823.g893fa35f 2023-08-01T19:50:24.284 INFO:teuthology.task.install.rpm:Pulling from https://4.chacra.ceph.com/r/ceph/quincy/893fa35fffd26b5b50498e64ff6f7c94584d30b6/centos/8/flavors/default/ 2023-08-01T19:50:24.284 INFO:teuthology.task.install.rpm:Package version is 17.2.6-823.g893fa35f 2023-08-01T19:50:24.294 INFO:teuthology.task.install.rpm:Pulling from https://4.chacra.ceph.com/r/ceph/quincy/893fa35fffd26b5b50498e64ff6f7c94584d30b6/centos/8/flavors/default/ 2023-08-01T19:50:24.294 INFO:teuthology.task.install.rpm:Package version is 17.2.6-823.g893fa35f 2023-08-01T19:50:24.505 INFO:teuthology.packaging:Writing yum repo: [ceph] name=ceph packages for $basearch baseurl=https://4.chacra.ceph.com/r/ceph/quincy/893fa35fffd26b5b50498e64ff6f7c94584d30b6/centos/8/flavors/default/$basearch enabled=1 gpgcheck=0 type=rpm-md [ceph-noarch] name=ceph noarch packages baseurl=https://4.chacra.ceph.com/r/ceph/quincy/893fa35fffd26b5b50498e64ff6f7c94584d30b6/centos/8/flavors/default/noarch enabled=1 gpgcheck=0 type=rpm-md [ceph-source] name=ceph source packages baseurl=https://4.chacra.ceph.com/r/ceph/quincy/893fa35fffd26b5b50498e64ff6f7c94584d30b6/centos/8/flavors/default/SRPMS enabled=1 gpgcheck=0 type=rpm-md 2023-08-01T19:50:24.505 DEBUG:teuthology.orchestra.run.smithi155:> set -ex 2023-08-01T19:50:24.505 DEBUG:teuthology.orchestra.run.smithi155:> sudo dd of=/etc/yum.repos.d/ceph.repo 2023-08-01T19:50:24.535 INFO:teuthology.task.install.rpm:Installing packages: ceph-radosgw, ceph-test, ceph, ceph-base, cephadm, ceph-immutable-object-cache, ceph-mgr, ceph-mgr-dashboard, ceph-mgr-diskprediction-local, ceph-mgr-rook, ceph-mgr-cephadm, ceph-fuse, ceph-volume, librados-devel, libcephfs2, libcephfs-devel, librados2, librbd1, python3-rados, python3-rgw, python3-cephfs, python3-rbd, rbd-fuse, rbd-mirror, rbd-nbd, bison, flex, elfutils-libelf-devel, openssl-devel, libaio-devel, libtool, libuuid-devel, xfsprogs-devel, bison, flex, elfutils-libelf-devel, openssl-devel, libaio-devel, libtool, libuuid-devel, xfsprogs-devel, bison, flex, elfutils-libelf-devel, openssl-devel, libaio-devel, libtool, libuuid-devel, xfsprogs-devel, bison, flex, elfutils-libelf-devel, openssl-devel, libaio-devel, libtool, libuuid-devel, xfsprogs-devel, bison, flex, elfutils-libelf-devel, openssl-devel, libaio-devel, libtool, libuuid-devel, xfsprogs-devel on remote rpm x86_64 2023-08-01T19:50:24.536 DEBUG:teuthology.orchestra.run.smithi155:> if test -f /etc/yum.repos.d/ceph.repo ; then sudo sed -i -e ':a;N;$!ba;s/enabled=1\ngpg/enabled=1\npriority=1\ngpg/g' -e 's;ref/[a-zA-Z0-9_-]*/;sha1/893fa35fffd26b5b50498e64ff6f7c94584d30b6/;g' /etc/yum.repos.d/ceph.repo ; fi 2023-08-01T19:50:24.606 DEBUG:teuthology.orchestra.run.smithi155:> sudo touch -a /etc/yum/pluginconf.d/priorities.conf ; test -e /etc/yum/pluginconf.d/priorities.conf.orig || sudo cp -af /etc/yum/pluginconf.d/priorities.conf /etc/yum/pluginconf.d/priorities.conf.orig 2023-08-01T19:50:24.636 INFO:teuthology.packaging:Writing yum repo: [ceph] name=ceph packages for $basearch baseurl=https://4.chacra.ceph.com/r/ceph/quincy/893fa35fffd26b5b50498e64ff6f7c94584d30b6/centos/8/flavors/default/$basearch enabled=1 gpgcheck=0 type=rpm-md [ceph-noarch] name=ceph noarch packages baseurl=https://4.chacra.ceph.com/r/ceph/quincy/893fa35fffd26b5b50498e64ff6f7c94584d30b6/centos/8/flavors/default/noarch enabled=1 gpgcheck=0 type=rpm-md [ceph-source] name=ceph source packages baseurl=https://4.chacra.ceph.com/r/ceph/quincy/893fa35fffd26b5b50498e64ff6f7c94584d30b6/centos/8/flavors/default/SRPMS enabled=1 gpgcheck=0 type=rpm-md 2023-08-01T19:50:24.636 DEBUG:teuthology.orchestra.run.smithi006:> set -ex 2023-08-01T19:50:24.637 DEBUG:teuthology.orchestra.run.smithi006:> sudo dd of=/etc/yum.repos.d/ceph.repo 2023-08-01T19:50:24.673 INFO:teuthology.packaging:Writing yum repo: [ceph] name=ceph packages for $basearch baseurl=https://4.chacra.ceph.com/r/ceph/quincy/893fa35fffd26b5b50498e64ff6f7c94584d30b6/centos/8/flavors/default/$basearch enabled=1 gpgcheck=0 type=rpm-md [ceph-noarch] name=ceph noarch packages baseurl=https://4.chacra.ceph.com/r/ceph/quincy/893fa35fffd26b5b50498e64ff6f7c94584d30b6/centos/8/flavors/default/noarch enabled=1 gpgcheck=0 type=rpm-md [ceph-source] name=ceph source packages baseurl=https://4.chacra.ceph.com/r/ceph/quincy/893fa35fffd26b5b50498e64ff6f7c94584d30b6/centos/8/flavors/default/SRPMS enabled=1 gpgcheck=0 type=rpm-md 2023-08-01T19:50:24.673 DEBUG:teuthology.orchestra.run.smithi101:> set -ex 2023-08-01T19:50:24.674 DEBUG:teuthology.orchestra.run.smithi101:> sudo dd of=/etc/yum.repos.d/ceph.repo 2023-08-01T19:50:24.676 INFO:teuthology.task.install.rpm:Installing packages: ceph-radosgw, ceph-test, ceph, ceph-base, cephadm, ceph-immutable-object-cache, ceph-mgr, ceph-mgr-dashboard, ceph-mgr-diskprediction-local, ceph-mgr-rook, ceph-mgr-cephadm, ceph-fuse, ceph-volume, librados-devel, libcephfs2, libcephfs-devel, librados2, librbd1, python3-rados, python3-rgw, python3-cephfs, python3-rbd, rbd-fuse, rbd-mirror, rbd-nbd, bison, flex, elfutils-libelf-devel, openssl-devel, libaio-devel, libtool, libuuid-devel, xfsprogs-devel, bison, flex, elfutils-libelf-devel, openssl-devel, libaio-devel, libtool, libuuid-devel, xfsprogs-devel, bison, flex, elfutils-libelf-devel, openssl-devel, libaio-devel, libtool, libuuid-devel, xfsprogs-devel, bison, flex, elfutils-libelf-devel, openssl-devel, libaio-devel, libtool, libuuid-devel, xfsprogs-devel, bison, flex, elfutils-libelf-devel, openssl-devel, libaio-devel, libtool, libuuid-devel, xfsprogs-devel, bison, flex, elfutils-libelf-devel, openssl-devel, libaio-devel, libtool, libuuid-devel, xfsprogs-devel on remote rpm x86_64 2023-08-01T19:50:24.677 DEBUG:teuthology.orchestra.run.smithi006:> if test -f /etc/yum.repos.d/ceph.repo ; then sudo sed -i -e ':a;N;$!ba;s/enabled=1\ngpg/enabled=1\npriority=1\ngpg/g' -e 's;ref/[a-zA-Z0-9_-]*/;sha1/893fa35fffd26b5b50498e64ff6f7c94584d30b6/;g' /etc/yum.repos.d/ceph.repo ; fi 2023-08-01T19:50:24.684 DEBUG:teuthology.orchestra.run.smithi155:> grep check_obsoletes /etc/yum/pluginconf.d/priorities.conf && sudo sed -i 's/check_obsoletes.*0/check_obsoletes = 1/g' /etc/yum/pluginconf.d/priorities.conf || echo 'check_obsoletes = 1' | sudo tee -a /etc/yum/pluginconf.d/priorities.conf 2023-08-01T19:50:24.696 INFO:teuthology.packaging:Writing yum repo: [ceph] name=ceph packages for $basearch baseurl=https://4.chacra.ceph.com/r/ceph/quincy/893fa35fffd26b5b50498e64ff6f7c94584d30b6/centos/8/flavors/default/$basearch enabled=1 gpgcheck=0 type=rpm-md [ceph-noarch] name=ceph noarch packages baseurl=https://4.chacra.ceph.com/r/ceph/quincy/893fa35fffd26b5b50498e64ff6f7c94584d30b6/centos/8/flavors/default/noarch enabled=1 gpgcheck=0 type=rpm-md [ceph-source] name=ceph source packages baseurl=https://4.chacra.ceph.com/r/ceph/quincy/893fa35fffd26b5b50498e64ff6f7c94584d30b6/centos/8/flavors/default/SRPMS enabled=1 gpgcheck=0 type=rpm-md 2023-08-01T19:50:24.696 DEBUG:teuthology.orchestra.run.smithi008:> set -ex 2023-08-01T19:50:24.697 DEBUG:teuthology.orchestra.run.smithi008:> sudo dd of=/etc/yum.repos.d/ceph.repo 2023-08-01T19:50:24.708 INFO:teuthology.task.install.rpm:Installing packages: ceph-radosgw, ceph-test, ceph, ceph-base, cephadm, ceph-immutable-object-cache, ceph-mgr, ceph-mgr-dashboard, ceph-mgr-diskprediction-local, ceph-mgr-rook, ceph-mgr-cephadm, ceph-fuse, ceph-volume, librados-devel, libcephfs2, libcephfs-devel, librados2, librbd1, python3-rados, python3-rgw, python3-cephfs, python3-rbd, rbd-fuse, rbd-mirror, rbd-nbd, bison, flex, elfutils-libelf-devel, openssl-devel, libaio-devel, libtool, libuuid-devel, xfsprogs-devel, bison, flex, elfutils-libelf-devel, openssl-devel, libaio-devel, libtool, libuuid-devel, xfsprogs-devel, bison, flex, elfutils-libelf-devel, openssl-devel, libaio-devel, libtool, libuuid-devel, xfsprogs-devel, bison, flex, elfutils-libelf-devel, openssl-devel, libaio-devel, libtool, libuuid-devel, xfsprogs-devel, bison, flex, elfutils-libelf-devel, openssl-devel, libaio-devel, libtool, libuuid-devel, xfsprogs-devel, bison, flex, elfutils-libelf-devel, openssl-devel, libaio-devel, libtool, libuuid-devel, xfsprogs-devel, bison, flex, elfutils-libelf-devel, openssl-devel, libaio-devel, libtool, libuuid-devel, xfsprogs-devel on remote rpm x86_64 2023-08-01T19:50:24.708 DEBUG:teuthology.orchestra.run.smithi101:> if test -f /etc/yum.repos.d/ceph.repo ; then sudo sed -i -e ':a;N;$!ba;s/enabled=1\ngpg/enabled=1\npriority=1\ngpg/g' -e 's;ref/[a-zA-Z0-9_-]*/;sha1/893fa35fffd26b5b50498e64ff6f7c94584d30b6/;g' /etc/yum.repos.d/ceph.repo ; fi 2023-08-01T19:50:24.731 INFO:teuthology.task.install.rpm:Installing packages: ceph-radosgw, ceph-test, ceph, ceph-base, cephadm, ceph-immutable-object-cache, ceph-mgr, ceph-mgr-dashboard, ceph-mgr-diskprediction-local, ceph-mgr-rook, ceph-mgr-cephadm, ceph-fuse, ceph-volume, librados-devel, libcephfs2, libcephfs-devel, librados2, librbd1, python3-rados, python3-rgw, python3-cephfs, python3-rbd, rbd-fuse, rbd-mirror, rbd-nbd, bison, flex, elfutils-libelf-devel, openssl-devel, libaio-devel, libtool, libuuid-devel, xfsprogs-devel, bison, flex, elfutils-libelf-devel, openssl-devel, libaio-devel, libtool, libuuid-devel, xfsprogs-devel, bison, flex, elfutils-libelf-devel, openssl-devel, libaio-devel, libtool, libuuid-devel, xfsprogs-devel, bison, flex, elfutils-libelf-devel, openssl-devel, libaio-devel, libtool, libuuid-devel, xfsprogs-devel, bison, flex, elfutils-libelf-devel, openssl-devel, libaio-devel, libtool, libuuid-devel, xfsprogs-devel, bison, flex, elfutils-libelf-devel, openssl-devel, libaio-devel, libtool, libuuid-devel, xfsprogs-devel, bison, flex, elfutils-libelf-devel, openssl-devel, libaio-devel, libtool, libuuid-devel, xfsprogs-devel, bison, flex, elfutils-libelf-devel, openssl-devel, libaio-devel, libtool, libuuid-devel, xfsprogs-devel on remote rpm x86_64 2023-08-01T19:50:24.731 DEBUG:teuthology.orchestra.run.smithi008:> if test -f /etc/yum.repos.d/ceph.repo ; then sudo sed -i -e ':a;N;$!ba;s/enabled=1\ngpg/enabled=1\npriority=1\ngpg/g' -e 's;ref/[a-zA-Z0-9_-]*/;sha1/893fa35fffd26b5b50498e64ff6f7c94584d30b6/;g' /etc/yum.repos.d/ceph.repo ; fi 2023-08-01T19:50:24.748 DEBUG:teuthology.orchestra.run.smithi006:> sudo touch -a /etc/yum/pluginconf.d/priorities.conf ; test -e /etc/yum/pluginconf.d/priorities.conf.orig || sudo cp -af /etc/yum/pluginconf.d/priorities.conf /etc/yum/pluginconf.d/priorities.conf.orig 2023-08-01T19:50:24.752 INFO:teuthology.orchestra.run.smithi155.stdout:check_obsoletes = 1 2023-08-01T19:50:24.753 DEBUG:teuthology.orchestra.run.smithi155:> sudo yum clean all 2023-08-01T19:50:24.779 DEBUG:teuthology.orchestra.run.smithi101:> sudo touch -a /etc/yum/pluginconf.d/priorities.conf ; test -e /etc/yum/pluginconf.d/priorities.conf.orig || sudo cp -af /etc/yum/pluginconf.d/priorities.conf /etc/yum/pluginconf.d/priorities.conf.orig 2023-08-01T19:50:24.804 DEBUG:teuthology.orchestra.run.smithi008:> sudo touch -a /etc/yum/pluginconf.d/priorities.conf ; test -e /etc/yum/pluginconf.d/priorities.conf.orig || sudo cp -af /etc/yum/pluginconf.d/priorities.conf /etc/yum/pluginconf.d/priorities.conf.orig 2023-08-01T19:50:24.833 DEBUG:teuthology.orchestra.run.smithi006:> grep check_obsoletes /etc/yum/pluginconf.d/priorities.conf && sudo sed -i 's/check_obsoletes.*0/check_obsoletes = 1/g' /etc/yum/pluginconf.d/priorities.conf || echo 'check_obsoletes = 1' | sudo tee -a /etc/yum/pluginconf.d/priorities.conf 2023-08-01T19:50:24.859 DEBUG:teuthology.orchestra.run.smithi101:> grep check_obsoletes /etc/yum/pluginconf.d/priorities.conf && sudo sed -i 's/check_obsoletes.*0/check_obsoletes = 1/g' /etc/yum/pluginconf.d/priorities.conf || echo 'check_obsoletes = 1' | sudo tee -a /etc/yum/pluginconf.d/priorities.conf 2023-08-01T19:50:24.862 INFO:teuthology.orchestra.run.smithi006.stdout:check_obsoletes = 1 2023-08-01T19:50:24.864 DEBUG:teuthology.orchestra.run.smithi006:> sudo yum clean all 2023-08-01T19:50:24.888 DEBUG:teuthology.orchestra.run.smithi008:> grep check_obsoletes /etc/yum/pluginconf.d/priorities.conf && sudo sed -i 's/check_obsoletes.*0/check_obsoletes = 1/g' /etc/yum/pluginconf.d/priorities.conf || echo 'check_obsoletes = 1' | sudo tee -a /etc/yum/pluginconf.d/priorities.conf 2023-08-01T19:50:24.928 INFO:teuthology.orchestra.run.smithi101.stdout:check_obsoletes = 1 2023-08-01T19:50:24.929 DEBUG:teuthology.orchestra.run.smithi101:> sudo yum clean all 2023-08-01T19:50:24.958 INFO:teuthology.orchestra.run.smithi008.stdout:check_obsoletes = 1 2023-08-01T19:50:24.959 DEBUG:teuthology.orchestra.run.smithi008:> sudo yum clean all 2023-08-01T19:50:25.022 INFO:teuthology.orchestra.run.smithi155.stdout:73 files removed 2023-08-01T19:50:25.050 DEBUG:teuthology.orchestra.run.smithi155:> sudo yum -y install ceph-radosgw ceph-test ceph ceph-base cephadm ceph-immutable-object-cache ceph-mgr ceph-mgr-dashboard ceph-mgr-diskprediction-local ceph-mgr-rook ceph-mgr-cephadm ceph-fuse ceph-volume librados-devel libcephfs2 libcephfs-devel librados2 librbd1 python3-rados python3-rgw python3-cephfs python3-rbd rbd-fuse rbd-mirror rbd-nbd bison flex elfutils-libelf-devel openssl-devel libaio-devel libtool libuuid-devel xfsprogs-devel bison flex elfutils-libelf-devel openssl-devel libaio-devel libtool libuuid-devel xfsprogs-devel bison flex elfutils-libelf-devel openssl-devel libaio-devel libtool libuuid-devel xfsprogs-devel bison flex elfutils-libelf-devel openssl-devel libaio-devel libtool libuuid-devel xfsprogs-devel bison flex elfutils-libelf-devel openssl-devel libaio-devel libtool libuuid-devel xfsprogs-devel bison flex elfutils-libelf-devel openssl-devel libaio-devel libtool libuuid-devel xfsprogs-devel bison flex elfutils-libelf-devel openssl-devel libaio-devel libtool libuuid-devel xfsprogs-devel bison flex elfutils-libelf-devel openssl-devel libaio-devel libtool libuuid-devel xfsprogs-devel 2023-08-01T19:50:25.153 INFO:teuthology.orchestra.run.smithi006.stdout:73 files removed 2023-08-01T19:50:25.184 DEBUG:teuthology.orchestra.run.smithi006:> sudo yum -y install ceph-radosgw ceph-test ceph ceph-base cephadm ceph-immutable-object-cache ceph-mgr ceph-mgr-dashboard ceph-mgr-diskprediction-local ceph-mgr-rook ceph-mgr-cephadm ceph-fuse ceph-volume librados-devel libcephfs2 libcephfs-devel librados2 librbd1 python3-rados python3-rgw python3-cephfs python3-rbd rbd-fuse rbd-mirror rbd-nbd bison flex elfutils-libelf-devel openssl-devel libaio-devel libtool libuuid-devel xfsprogs-devel bison flex elfutils-libelf-devel openssl-devel libaio-devel libtool libuuid-devel xfsprogs-devel bison flex elfutils-libelf-devel openssl-devel libaio-devel libtool libuuid-devel xfsprogs-devel bison flex elfutils-libelf-devel openssl-devel libaio-devel libtool libuuid-devel xfsprogs-devel bison flex elfutils-libelf-devel openssl-devel libaio-devel libtool libuuid-devel xfsprogs-devel bison flex elfutils-libelf-devel openssl-devel libaio-devel libtool libuuid-devel xfsprogs-devel bison flex elfutils-libelf-devel openssl-devel libaio-devel libtool libuuid-devel xfsprogs-devel bison flex elfutils-libelf-devel openssl-devel libaio-devel libtool libuuid-devel xfsprogs-devel 2023-08-01T19:50:25.198 INFO:teuthology.orchestra.run.smithi101.stdout:73 files removed 2023-08-01T19:50:25.227 DEBUG:teuthology.orchestra.run.smithi101:> sudo yum -y install ceph-radosgw ceph-test ceph ceph-base cephadm ceph-immutable-object-cache ceph-mgr ceph-mgr-dashboard ceph-mgr-diskprediction-local ceph-mgr-rook ceph-mgr-cephadm ceph-fuse ceph-volume librados-devel libcephfs2 libcephfs-devel librados2 librbd1 python3-rados python3-rgw python3-cephfs python3-rbd rbd-fuse rbd-mirror rbd-nbd bison flex elfutils-libelf-devel openssl-devel libaio-devel libtool libuuid-devel xfsprogs-devel bison flex elfutils-libelf-devel openssl-devel libaio-devel libtool libuuid-devel xfsprogs-devel bison flex elfutils-libelf-devel openssl-devel libaio-devel libtool libuuid-devel xfsprogs-devel bison flex elfutils-libelf-devel openssl-devel libaio-devel libtool libuuid-devel xfsprogs-devel bison flex elfutils-libelf-devel openssl-devel libaio-devel libtool libuuid-devel xfsprogs-devel bison flex elfutils-libelf-devel openssl-devel libaio-devel libtool libuuid-devel xfsprogs-devel bison flex elfutils-libelf-devel openssl-devel libaio-devel libtool libuuid-devel xfsprogs-devel bison flex elfutils-libelf-devel openssl-devel libaio-devel libtool libuuid-devel xfsprogs-devel 2023-08-01T19:50:25.240 INFO:teuthology.orchestra.run.smithi008.stdout:73 files removed 2023-08-01T19:50:25.269 DEBUG:teuthology.orchestra.run.smithi008:> sudo yum -y install ceph-radosgw ceph-test ceph ceph-base cephadm ceph-immutable-object-cache ceph-mgr ceph-mgr-dashboard ceph-mgr-diskprediction-local ceph-mgr-rook ceph-mgr-cephadm ceph-fuse ceph-volume librados-devel libcephfs2 libcephfs-devel librados2 librbd1 python3-rados python3-rgw python3-cephfs python3-rbd rbd-fuse rbd-mirror rbd-nbd bison flex elfutils-libelf-devel openssl-devel libaio-devel libtool libuuid-devel xfsprogs-devel bison flex elfutils-libelf-devel openssl-devel libaio-devel libtool libuuid-devel xfsprogs-devel bison flex elfutils-libelf-devel openssl-devel libaio-devel libtool libuuid-devel xfsprogs-devel bison flex elfutils-libelf-devel openssl-devel libaio-devel libtool libuuid-devel xfsprogs-devel bison flex elfutils-libelf-devel openssl-devel libaio-devel libtool libuuid-devel xfsprogs-devel bison flex elfutils-libelf-devel openssl-devel libaio-devel libtool libuuid-devel xfsprogs-devel bison flex elfutils-libelf-devel openssl-devel libaio-devel libtool libuuid-devel xfsprogs-devel bison flex elfutils-libelf-devel openssl-devel libaio-devel libtool libuuid-devel xfsprogs-devel 2023-08-01T19:50:26.330 INFO:teuthology.orchestra.run.smithi155.stdout:ceph packages for x86_64 90 kB/s | 78 kB 00:00 2023-08-01T19:50:26.388 INFO:teuthology.orchestra.run.smithi101.stdout:ceph packages for x86_64 103 kB/s | 78 kB 00:00 2023-08-01T19:50:26.474 INFO:teuthology.orchestra.run.smithi008.stdout:ceph packages for x86_64 101 kB/s | 78 kB 00:00 2023-08-01T19:50:26.490 INFO:teuthology.orchestra.run.smithi006.stdout:ceph packages for x86_64 89 kB/s | 78 kB 00:00 2023-08-01T19:50:27.048 INFO:teuthology.orchestra.run.smithi155.stdout:ceph noarch packages 13 kB/s | 9.2 kB 00:00 2023-08-01T19:50:27.216 INFO:teuthology.orchestra.run.smithi006.stdout:ceph noarch packages 13 kB/s | 9.2 kB 00:00 2023-08-01T19:50:27.224 INFO:teuthology.orchestra.run.smithi008.stdout:ceph noarch packages 13 kB/s | 9.2 kB 00:00 2023-08-01T19:50:27.421 INFO:teuthology.orchestra.run.smithi101.stdout:ceph noarch packages 9.2 kB/s | 9.2 kB 00:00 2023-08-01T19:50:27.908 INFO:teuthology.orchestra.run.smithi006.stdout:ceph source packages 2.2 kB/s | 1.5 kB 00:00 2023-08-01T19:50:27.932 INFO:teuthology.orchestra.run.smithi155.stdout:ceph source packages 1.7 kB/s | 1.5 kB 00:00 2023-08-01T19:50:27.933 INFO:teuthology.orchestra.run.smithi008.stdout:ceph source packages 2.1 kB/s | 1.5 kB 00:00 2023-08-01T19:50:28.130 INFO:teuthology.orchestra.run.smithi101.stdout:ceph source packages 2.1 kB/s | 1.5 kB 00:00 2023-08-01T19:50:32.272 INFO:teuthology.orchestra.run.smithi101.stdout:CentOS Stream 8 - AppStream 7.5 MB/s | 31 MB 00:04 2023-08-01T19:50:32.448 INFO:teuthology.orchestra.run.smithi155.stdout:CentOS Stream 8 - AppStream 6.8 MB/s | 31 MB 00:04 2023-08-01T19:50:35.683 INFO:teuthology.orchestra.run.smithi008.stdout:CentOS Stream 8 - AppStream 4.0 MB/s | 31 MB 00:07 2023-08-01T19:50:36.483 INFO:teuthology.orchestra.run.smithi006.stdout:CentOS Stream 8 - AppStream 3.6 MB/s | 31 MB 00:08 2023-08-01T19:50:39.972 INFO:teuthology.orchestra.run.smithi101.stdout:CentOS Stream 8 - BaseOS 19 MB/s | 41 MB 00:02 2023-08-01T19:50:40.540 INFO:teuthology.orchestra.run.smithi155.stdout:CentOS Stream 8 - BaseOS 16 MB/s | 41 MB 00:02 2023-08-01T19:50:44.150 INFO:teuthology.orchestra.run.smithi008.stdout:CentOS Stream 8 - BaseOS 16 MB/s | 41 MB 00:02 2023-08-01T19:50:44.709 INFO:teuthology.orchestra.run.smithi006.stdout:CentOS Stream 8 - BaseOS 18 MB/s | 41 MB 00:02 2023-08-01T19:50:46.140 INFO:teuthology.orchestra.run.smithi101.stdout:CentOS Stream 8 - Extras 82 kB/s | 18 kB 00:00 2023-08-01T19:50:46.641 INFO:teuthology.orchestra.run.smithi101.stdout:CentOS Stream 8 - Extras common packages 20 kB/s | 6.6 kB 00:00 2023-08-01T19:50:46.740 INFO:teuthology.orchestra.run.smithi155.stdout:CentOS Stream 8 - Extras 86 kB/s | 18 kB 00:00 2023-08-01T19:50:47.099 INFO:teuthology.orchestra.run.smithi155.stdout:CentOS Stream 8 - Extras common packages 34 kB/s | 6.6 kB 00:00 2023-08-01T19:50:48.133 INFO:teuthology.orchestra.run.smithi101.stdout:CentOS Stream 8 - PowerTools 4.7 MB/s | 6.3 MB 00:01 2023-08-01T19:50:48.678 INFO:teuthology.orchestra.run.smithi155.stdout:CentOS Stream 8 - PowerTools 4.4 MB/s | 6.3 MB 00:01 2023-08-01T19:50:49.518 INFO:teuthology.orchestra.run.smithi101.stdout:Copr repo for python3-asyncssh owned by ceph 24 kB/s | 3.5 kB 00:00 2023-08-01T19:50:50.113 INFO:teuthology.orchestra.run.smithi155.stdout:Copr repo for python3-asyncssh owned by ceph 18 kB/s | 3.5 kB 00:00 2023-08-01T19:50:50.884 INFO:teuthology.orchestra.run.smithi008.stdout:CentOS Stream 8 - Extras 44 kB/s | 18 kB 00:00 2023-08-01T19:50:51.019 INFO:teuthology.orchestra.run.smithi101.stdout:Extra Packages for Enterprise Linux 12 MB/s | 16 MB 00:01 2023-08-01T19:50:51.310 INFO:teuthology.orchestra.run.smithi008.stdout:CentOS Stream 8 - Extras common packages 27 kB/s | 6.6 kB 00:00 2023-08-01T19:50:51.526 INFO:teuthology.orchestra.run.smithi006.stdout:CentOS Stream 8 - Extras 43 kB/s | 18 kB 00:00 2023-08-01T19:50:52.077 INFO:teuthology.orchestra.run.smithi006.stdout:CentOS Stream 8 - Extras common packages 18 kB/s | 6.6 kB 00:00 2023-08-01T19:50:52.969 INFO:teuthology.orchestra.run.smithi008.stdout:CentOS Stream 8 - PowerTools 4.2 MB/s | 6.3 MB 00:01 2023-08-01T19:50:53.611 INFO:teuthology.orchestra.run.smithi006.stdout:CentOS Stream 8 - PowerTools 4.6 MB/s | 6.3 MB 00:01 2023-08-01T19:50:54.396 INFO:teuthology.orchestra.run.smithi008.stdout:Copr repo for python3-asyncssh owned by ceph 28 kB/s | 3.5 kB 00:00 2023-08-01T19:50:54.827 INFO:teuthology.orchestra.run.smithi101.stdout:lab-extras 438 kB/s | 24 kB 00:00 2023-08-01T19:50:55.080 INFO:teuthology.orchestra.run.smithi006.stdout:Copr repo for python3-asyncssh owned by ceph 28 kB/s | 3.5 kB 00:00 2023-08-01T19:50:55.663 INFO:teuthology.orchestra.run.smithi008.stdout:Extra Packages for Enterprise Linux 14 MB/s | 16 MB 00:01 2023-08-01T19:50:58.496 INFO:teuthology.orchestra.run.smithi155.stdout:Extra Packages for Enterprise Linux 1.9 MB/s | 16 MB 00:08 2023-08-01T19:50:58.675 INFO:teuthology.orchestra.run.smithi101.stdout:Package librados2-1:12.2.7-9.el8.x86_64 is already installed. 2023-08-01T19:50:58.676 INFO:teuthology.orchestra.run.smithi101.stdout:Package librbd1-1:12.2.7-9.el8.x86_64 is already installed. 2023-08-01T19:50:58.865 INFO:teuthology.orchestra.run.smithi101.stdout:Dependencies resolved. 2023-08-01T19:50:58.877 INFO:teuthology.orchestra.run.smithi101.stdout:================================================================================================ 2023-08-01T19:50:58.877 INFO:teuthology.orchestra.run.smithi101.stdout: Package Arch Version Repository Size 2023-08-01T19:50:58.878 INFO:teuthology.orchestra.run.smithi101.stdout:================================================================================================ 2023-08-01T19:50:58.878 INFO:teuthology.orchestra.run.smithi101.stdout:Installing: 2023-08-01T19:50:58.878 INFO:teuthology.orchestra.run.smithi101.stdout: bison x86_64 3.0.4-10.el8 appstream 688 k 2023-08-01T19:50:58.878 INFO:teuthology.orchestra.run.smithi101.stdout: ceph x86_64 2:17.2.6-823.g893fa35f.el8 ceph 6.4 k 2023-08-01T19:50:58.878 INFO:teuthology.orchestra.run.smithi101.stdout: ceph-base x86_64 2:17.2.6-823.g893fa35f.el8 ceph 5.2 M 2023-08-01T19:50:58.878 INFO:teuthology.orchestra.run.smithi101.stdout: ceph-fuse x86_64 2:17.2.6-823.g893fa35f.el8 ceph 874 k 2023-08-01T19:50:58.878 INFO:teuthology.orchestra.run.smithi101.stdout: ceph-immutable-object-cache x86_64 2:17.2.6-823.g893fa35f.el8 ceph 162 k 2023-08-01T19:50:58.879 INFO:teuthology.orchestra.run.smithi101.stdout: ceph-mgr x86_64 2:17.2.6-823.g893fa35f.el8 ceph 1.6 M 2023-08-01T19:50:58.879 INFO:teuthology.orchestra.run.smithi101.stdout: ceph-mgr-cephadm noarch 2:17.2.6-823.g893fa35f.el8 ceph-noarch 121 k 2023-08-01T19:50:58.879 INFO:teuthology.orchestra.run.smithi101.stdout: ceph-mgr-dashboard noarch 2:17.2.6-823.g893fa35f.el8 ceph-noarch 1.7 M 2023-08-01T19:50:58.879 INFO:teuthology.orchestra.run.smithi101.stdout: ceph-mgr-diskprediction-local noarch 2:17.2.6-823.g893fa35f.el8 ceph-noarch 7.4 M 2023-08-01T19:50:58.879 INFO:teuthology.orchestra.run.smithi101.stdout: ceph-mgr-rook noarch 2:17.2.6-823.g893fa35f.el8 ceph-noarch 47 k 2023-08-01T19:50:58.879 INFO:teuthology.orchestra.run.smithi101.stdout: ceph-radosgw x86_64 2:17.2.6-823.g893fa35f.el8 ceph 17 M 2023-08-01T19:50:58.879 INFO:teuthology.orchestra.run.smithi101.stdout: ceph-test x86_64 2:17.2.6-823.g893fa35f.el8 ceph 52 M 2023-08-01T19:50:58.879 INFO:teuthology.orchestra.run.smithi101.stdout: ceph-volume noarch 2:17.2.6-823.g893fa35f.el8 ceph-noarch 264 k 2023-08-01T19:50:58.880 INFO:teuthology.orchestra.run.smithi101.stdout: cephadm noarch 2:17.2.6-823.g893fa35f.el8 ceph-noarch 80 k 2023-08-01T19:50:58.880 INFO:teuthology.orchestra.run.smithi101.stdout: elfutils-libelf-devel x86_64 0.189-2.el8 baseos 61 k 2023-08-01T19:50:58.880 INFO:teuthology.orchestra.run.smithi101.stdout: flex x86_64 2.6.1-9.el8 appstream 320 k 2023-08-01T19:50:58.880 INFO:teuthology.orchestra.run.smithi101.stdout: libaio-devel x86_64 0.3.112-1.el8 baseos 19 k 2023-08-01T19:50:58.880 INFO:teuthology.orchestra.run.smithi101.stdout: libcephfs-devel x86_64 2:17.2.6-823.g893fa35f.el8 ceph 25 k 2023-08-01T19:50:58.880 INFO:teuthology.orchestra.run.smithi101.stdout: libcephfs2 x86_64 2:17.2.6-823.g893fa35f.el8 ceph 795 k 2023-08-01T19:50:58.880 INFO:teuthology.orchestra.run.smithi101.stdout: librados-devel x86_64 2:17.2.6-823.g893fa35f.el8 ceph 130 k 2023-08-01T19:50:58.881 INFO:teuthology.orchestra.run.smithi101.stdout: libtool x86_64 2.4.6-25.el8 appstream 709 k 2023-08-01T19:50:58.881 INFO:teuthology.orchestra.run.smithi101.stdout: libuuid-devel x86_64 2.32.1-42.el8 baseos 99 k 2023-08-01T19:50:58.881 INFO:teuthology.orchestra.run.smithi101.stdout: openssl-devel x86_64 1:1.1.1k-9.el8 baseos 3.2 M 2023-08-01T19:50:58.881 INFO:teuthology.orchestra.run.smithi101.stdout: python3-cephfs x86_64 2:17.2.6-823.g893fa35f.el8 ceph 190 k 2023-08-01T19:50:58.881 INFO:teuthology.orchestra.run.smithi101.stdout: python3-rados x86_64 2:17.2.6-823.g893fa35f.el8 ceph 371 k 2023-08-01T19:50:58.881 INFO:teuthology.orchestra.run.smithi101.stdout: python3-rbd x86_64 2:17.2.6-823.g893fa35f.el8 ceph 358 k 2023-08-01T19:50:58.881 INFO:teuthology.orchestra.run.smithi101.stdout: python3-rgw x86_64 2:17.2.6-823.g893fa35f.el8 ceph 107 k 2023-08-01T19:50:58.881 INFO:teuthology.orchestra.run.smithi101.stdout: rbd-fuse x86_64 2:17.2.6-823.g893fa35f.el8 ceph 90 k 2023-08-01T19:50:58.882 INFO:teuthology.orchestra.run.smithi101.stdout: rbd-mirror x86_64 2:17.2.6-823.g893fa35f.el8 ceph 3.5 M 2023-08-01T19:50:58.882 INFO:teuthology.orchestra.run.smithi101.stdout: rbd-nbd x86_64 2:17.2.6-823.g893fa35f.el8 ceph 173 k 2023-08-01T19:50:58.882 INFO:teuthology.orchestra.run.smithi101.stdout: xfsprogs-devel x86_64 5.0.0-12.el8 baseos 74 k 2023-08-01T19:50:58.882 INFO:teuthology.orchestra.run.smithi101.stdout:Upgrading: 2023-08-01T19:50:58.882 INFO:teuthology.orchestra.run.smithi101.stdout: elfutils-debuginfod-client x86_64 0.189-2.el8 baseos 76 k 2023-08-01T19:50:58.882 INFO:teuthology.orchestra.run.smithi101.stdout: elfutils-libelf x86_64 0.189-2.el8 baseos 232 k 2023-08-01T19:50:58.882 INFO:teuthology.orchestra.run.smithi101.stdout: elfutils-libs x86_64 0.189-2.el8 baseos 302 k 2023-08-01T19:50:58.883 INFO:teuthology.orchestra.run.smithi101.stdout: libblkid x86_64 2.32.1-42.el8 baseos 220 k 2023-08-01T19:50:58.883 INFO:teuthology.orchestra.run.smithi101.stdout: libfdisk x86_64 2.32.1-42.el8 baseos 253 k 2023-08-01T19:50:58.883 INFO:teuthology.orchestra.run.smithi101.stdout: libmount x86_64 2.32.1-42.el8 baseos 236 k 2023-08-01T19:50:58.883 INFO:teuthology.orchestra.run.smithi101.stdout: librados2 x86_64 2:17.2.6-823.g893fa35f.el8 ceph 3.5 M 2023-08-01T19:50:58.883 INFO:teuthology.orchestra.run.smithi101.stdout: librbd1 x86_64 2:17.2.6-823.g893fa35f.el8 ceph 3.6 M 2023-08-01T19:50:58.883 INFO:teuthology.orchestra.run.smithi101.stdout: libsmartcols x86_64 2.32.1-42.el8 baseos 179 k 2023-08-01T19:50:58.883 INFO:teuthology.orchestra.run.smithi101.stdout: libuuid x86_64 2.32.1-42.el8 baseos 98 k 2023-08-01T19:50:58.883 INFO:teuthology.orchestra.run.smithi101.stdout: util-linux x86_64 2.32.1-42.el8 baseos 2.6 M 2023-08-01T19:50:58.884 INFO:teuthology.orchestra.run.smithi101.stdout: util-linux-user x86_64 2.32.1-42.el8 baseos 102 k 2023-08-01T19:50:58.884 INFO:teuthology.orchestra.run.smithi101.stdout: xfsprogs x86_64 5.0.0-12.el8 baseos 1.1 M 2023-08-01T19:50:58.884 INFO:teuthology.orchestra.run.smithi101.stdout:Installing dependencies: 2023-08-01T19:50:58.884 INFO:teuthology.orchestra.run.smithi101.stdout: automake noarch 1.16.1-7.el8 appstream 713 k 2023-08-01T19:50:58.884 INFO:teuthology.orchestra.run.smithi101.stdout: ceph-common x86_64 2:17.2.6-823.g893fa35f.el8 ceph 23 M 2023-08-01T19:50:58.884 INFO:teuthology.orchestra.run.smithi101.stdout: ceph-grafana-dashboards noarch 2:17.2.6-823.g893fa35f.el8 ceph-noarch 23 k 2023-08-01T19:50:58.884 INFO:teuthology.orchestra.run.smithi101.stdout: ceph-mds x86_64 2:17.2.6-823.g893fa35f.el8 ceph 2.3 M 2023-08-01T19:50:58.885 INFO:teuthology.orchestra.run.smithi101.stdout: ceph-mgr-modules-core noarch 2:17.2.6-823.g893fa35f.el8 ceph-noarch 238 k 2023-08-01T19:50:58.885 INFO:teuthology.orchestra.run.smithi101.stdout: ceph-mon x86_64 2:17.2.6-823.g893fa35f.el8 ceph 3.9 M 2023-08-01T19:50:58.885 INFO:teuthology.orchestra.run.smithi101.stdout: ceph-osd x86_64 2:17.2.6-823.g893fa35f.el8 ceph 17 M 2023-08-01T19:50:58.885 INFO:teuthology.orchestra.run.smithi101.stdout: ceph-prometheus-alerts noarch 2:17.2.6-823.g893fa35f.el8 ceph-noarch 14 k 2023-08-01T19:50:58.885 INFO:teuthology.orchestra.run.smithi101.stdout: ceph-selinux x86_64 2:17.2.6-823.g893fa35f.el8 ceph 24 k 2023-08-01T19:50:58.885 INFO:teuthology.orchestra.run.smithi101.stdout: fuse x86_64 2.9.7-17.el8 baseos 83 k 2023-08-01T19:50:58.885 INFO:teuthology.orchestra.run.smithi101.stdout: gperftools-libs x86_64 1:2.7-9.el8 epel 306 k 2023-08-01T19:50:58.886 INFO:teuthology.orchestra.run.smithi101.stdout: jq x86_64 1.6-7.el8 appstream 202 k 2023-08-01T19:50:58.886 INFO:teuthology.orchestra.run.smithi101.stdout: keyutils-libs-devel x86_64 1.5.10-9.el8 baseos 48 k 2023-08-01T19:50:58.886 INFO:teuthology.orchestra.run.smithi101.stdout: krb5-devel x86_64 1.18.2-22.el8 baseos 561 k 2023-08-01T19:50:58.886 INFO:teuthology.orchestra.run.smithi101.stdout: libcephsqlite x86_64 2:17.2.6-823.g893fa35f.el8 ceph 174 k 2023-08-01T19:50:58.886 INFO:teuthology.orchestra.run.smithi101.stdout: libcom_err-devel x86_64 1.45.6-5.el8 baseos 39 k 2023-08-01T19:50:58.886 INFO:teuthology.orchestra.run.smithi101.stdout: libgfortran x86_64 8.5.0-20.el8 baseos 645 k 2023-08-01T19:50:58.886 INFO:teuthology.orchestra.run.smithi101.stdout: liboath x86_64 2.6.2-3.el8 epel 59 k 2023-08-01T19:50:58.886 INFO:teuthology.orchestra.run.smithi101.stdout: libquadmath x86_64 8.5.0-20.el8 baseos 172 k 2023-08-01T19:50:58.887 INFO:teuthology.orchestra.run.smithi101.stdout: librabbitmq x86_64 0.9.0-4.el8 baseos 47 k 2023-08-01T19:50:58.887 INFO:teuthology.orchestra.run.smithi101.stdout: libradosstriper1 x86_64 2:17.2.6-823.g893fa35f.el8 ceph 508 k 2023-08-01T19:50:58.887 INFO:teuthology.orchestra.run.smithi101.stdout: librdkafka x86_64 0.11.4-3.el8 appstream 354 k 2023-08-01T19:50:58.887 INFO:teuthology.orchestra.run.smithi101.stdout: librgw2 x86_64 2:17.2.6-823.g893fa35f.el8 ceph 5.5 M 2023-08-01T19:50:58.887 INFO:teuthology.orchestra.run.smithi101.stdout: libselinux-devel x86_64 2.9-8.el8 baseos 200 k 2023-08-01T19:50:58.887 INFO:teuthology.orchestra.run.smithi101.stdout: libsepol-devel x86_64 2.9-3.el8 baseos 87 k 2023-08-01T19:50:58.887 INFO:teuthology.orchestra.run.smithi101.stdout: libunwind x86_64 1.3.1-3.el8 epel 75 k 2023-08-01T19:50:58.888 INFO:teuthology.orchestra.run.smithi101.stdout: libverto-devel x86_64 0.3.2-2.el8 baseos 18 k 2023-08-01T19:50:58.888 INFO:teuthology.orchestra.run.smithi101.stdout: libzstd-devel x86_64 1.4.4-1.el8 baseos 44 k 2023-08-01T19:50:58.888 INFO:teuthology.orchestra.run.smithi101.stdout: lttng-ust x86_64 2.8.1-11.el8 appstream 259 k 2023-08-01T19:50:58.888 INFO:teuthology.orchestra.run.smithi101.stdout: oniguruma x86_64 6.8.2-2.el8 appstream 187 k 2023-08-01T19:50:58.888 INFO:teuthology.orchestra.run.smithi101.stdout: openblas x86_64 0.3.15-4.el8 appstream 4.7 M 2023-08-01T19:50:58.888 INFO:teuthology.orchestra.run.smithi101.stdout: openblas-threads x86_64 0.3.15-4.el8 appstream 4.9 M 2023-08-01T19:50:58.888 INFO:teuthology.orchestra.run.smithi101.stdout: pcre2-devel x86_64 10.32-3.el8 baseos 605 k 2023-08-01T19:50:58.888 INFO:teuthology.orchestra.run.smithi101.stdout: pcre2-utf16 x86_64 10.32-3.el8 baseos 229 k 2023-08-01T19:50:58.889 INFO:teuthology.orchestra.run.smithi101.stdout: pcre2-utf32 x86_64 10.32-3.el8 baseos 220 k 2023-08-01T19:50:58.889 INFO:teuthology.orchestra.run.smithi101.stdout: python3-asyncssh noarch 2.7.0-2.el8 epel 476 k 2023-08-01T19:50:58.889 INFO:teuthology.orchestra.run.smithi101.stdout: python3-babel noarch 2.5.1-7.el8 appstream 4.8 M 2023-08-01T19:50:58.889 INFO:teuthology.orchestra.run.smithi101.stdout: python3-bcrypt x86_64 3.1.6-2.el8.1 epel 44 k 2023-08-01T19:50:58.889 INFO:teuthology.orchestra.run.smithi101.stdout: python3-beautifulsoup4 noarch 4.6.3-2.el8.1 epel 185 k 2023-08-01T19:50:58.889 INFO:teuthology.orchestra.run.smithi101.stdout: python3-cachetools noarch 3.1.1-4.el8 epel 33 k 2023-08-01T19:50:58.889 INFO:teuthology.orchestra.run.smithi101.stdout: python3-ceph-argparse x86_64 2:17.2.6-823.g893fa35f.el8 ceph 45 k 2023-08-01T19:50:58.889 INFO:teuthology.orchestra.run.smithi101.stdout: python3-ceph-common x86_64 2:17.2.6-823.g893fa35f.el8 ceph 115 k 2023-08-01T19:50:58.890 INFO:teuthology.orchestra.run.smithi101.stdout: python3-certifi noarch 2018.10.15-7.el8 epel 16 k 2023-08-01T19:50:58.890 INFO:teuthology.orchestra.run.smithi101.stdout: python3-cffi x86_64 1.11.5-6.el8 baseos 249 k 2023-08-01T19:50:58.890 INFO:teuthology.orchestra.run.smithi101.stdout: python3-cheroot noarch 8.5.2-1.el8 epel 173 k 2023-08-01T19:50:58.890 INFO:teuthology.orchestra.run.smithi101.stdout: python3-cherrypy noarch 18.4.0-1.el8 epel 384 k 2023-08-01T19:50:58.890 INFO:teuthology.orchestra.run.smithi101.stdout: python3-cryptography x86_64 3.2.1-6.el8 baseos 641 k 2023-08-01T19:50:58.890 INFO:teuthology.orchestra.run.smithi101.stdout: python3-google-auth noarch 1:1.1.1-10.el8 epel 81 k 2023-08-01T19:50:58.890 INFO:teuthology.orchestra.run.smithi101.stdout: python3-jaraco noarch 6.2-6.el8 epel 11 k 2023-08-01T19:50:58.891 INFO:teuthology.orchestra.run.smithi101.stdout: python3-jaraco-functools noarch 2.0-4.el8 epel 18 k 2023-08-01T19:50:58.891 INFO:teuthology.orchestra.run.smithi101.stdout: python3-jinja2 noarch 2.10.1-3.el8 appstream 538 k 2023-08-01T19:50:58.891 INFO:teuthology.orchestra.run.smithi101.stdout: python3-jsonpatch noarch 1.21-2.el8 appstream 27 k 2023-08-01T19:50:58.891 INFO:teuthology.orchestra.run.smithi101.stdout: python3-jsonpointer noarch 1.10-11.el8 appstream 20 k 2023-08-01T19:50:58.891 INFO:teuthology.orchestra.run.smithi101.stdout: python3-jwt noarch 1.6.1-2.el8 baseos 43 k 2023-08-01T19:50:58.891 INFO:teuthology.orchestra.run.smithi101.stdout: python3-kubernetes noarch 1:11.0.0-6.el8 epel 1.2 M 2023-08-01T19:50:58.891 INFO:teuthology.orchestra.run.smithi101.stdout: python3-logutils noarch 0.3.5-11.el8 epel 49 k 2023-08-01T19:50:58.891 INFO:teuthology.orchestra.run.smithi101.stdout: python3-mako noarch 1.0.6-14.el8 appstream 157 k 2023-08-01T19:50:58.892 INFO:teuthology.orchestra.run.smithi101.stdout: python3-markupsafe x86_64 0.23-19.el8 appstream 39 k 2023-08-01T19:50:58.892 INFO:teuthology.orchestra.run.smithi101.stdout: python3-more-itertools noarch 7.2.0-3.el8 epel 59 k 2023-08-01T19:50:58.892 INFO:teuthology.orchestra.run.smithi101.stdout: python3-natsort noarch 7.1.1-2.el8 epel 60 k 2023-08-01T19:50:58.892 INFO:teuthology.orchestra.run.smithi101.stdout: python3-numpy x86_64 1:1.14.3-10.el8 appstream 3.7 M 2023-08-01T19:50:58.892 INFO:teuthology.orchestra.run.smithi101.stdout: python3-numpy-f2py x86_64 1:1.14.3-10.el8 appstream 225 k 2023-08-01T19:50:58.892 INFO:teuthology.orchestra.run.smithi101.stdout: python3-oauthlib noarch 2.1.0-1.el8 baseos 155 k 2023-08-01T19:50:58.892 INFO:teuthology.orchestra.run.smithi101.stdout: python3-pecan noarch 1.3.2-9.el8 epel 283 k 2023-08-01T19:50:58.893 INFO:teuthology.orchestra.run.smithi101.stdout: python3-portend noarch 2.6-1.el8 epel 16 k 2023-08-01T19:50:58.893 INFO:teuthology.orchestra.run.smithi101.stdout: python3-prettytable noarch 0.7.2-14.el8 appstream 44 k 2023-08-01T19:50:58.893 INFO:teuthology.orchestra.run.smithi101.stdout: python3-pyOpenSSL noarch 19.0.0-1.el8 appstream 103 k 2023-08-01T19:50:58.893 INFO:teuthology.orchestra.run.smithi101.stdout: python3-pyasn1 noarch 0.3.7-6.el8 appstream 126 k 2023-08-01T19:50:58.893 INFO:teuthology.orchestra.run.smithi101.stdout: python3-pyasn1-modules noarch 0.3.7-6.el8 appstream 110 k 2023-08-01T19:50:58.893 INFO:teuthology.orchestra.run.smithi101.stdout: python3-pycparser noarch 2.14-14.el8 baseos 109 k 2023-08-01T19:50:58.893 INFO:teuthology.orchestra.run.smithi101.stdout: python3-pytz noarch 2017.2-9.el8 appstream 54 k 2023-08-01T19:50:58.893 INFO:teuthology.orchestra.run.smithi101.stdout: python3-repoze-lru noarch 0.7-6.el8 epel 34 k 2023-08-01T19:50:58.894 INFO:teuthology.orchestra.run.smithi101.stdout: python3-requests-oauthlib noarch 1.0.0-1.el8 baseos 43 k 2023-08-01T19:50:58.894 INFO:teuthology.orchestra.run.smithi101.stdout: python3-routes noarch 2.4.1-12.el8 epel 196 k 2023-08-01T19:50:58.894 INFO:teuthology.orchestra.run.smithi101.stdout: python3-rsa noarch 4.9-2.el8 epel 64 k 2023-08-01T19:50:58.894 INFO:teuthology.orchestra.run.smithi101.stdout: python3-scipy x86_64 1.0.0-21.module_el8.5.0+771+e5d9a225 appstream 14 M 2023-08-01T19:50:58.894 INFO:teuthology.orchestra.run.smithi101.stdout: python3-simplegeneric noarch 0.8.1-17.el8 epel 19 k 2023-08-01T19:50:58.894 INFO:teuthology.orchestra.run.smithi101.stdout: python3-singledispatch noarch 3.4.0.3-18.el8 epel 24 k 2023-08-01T19:50:58.894 INFO:teuthology.orchestra.run.smithi101.stdout: python3-tempora noarch 1.14.1-5.el8 epel 29 k 2023-08-01T19:50:58.894 INFO:teuthology.orchestra.run.smithi101.stdout: python3-trustme noarch 0.6.0-4.el8 epel 27 k 2023-08-01T19:50:58.895 INFO:teuthology.orchestra.run.smithi101.stdout: python3-waitress noarch 1.4.3-1.el8 epel 255 k 2023-08-01T19:50:58.895 INFO:teuthology.orchestra.run.smithi101.stdout: python3-webob noarch 1.8.5-1.el8.1 epel 251 k 2023-08-01T19:50:58.895 INFO:teuthology.orchestra.run.smithi101.stdout: python3-websocket-client noarch 0.56.0-5.el8 epel 61 k 2023-08-01T19:50:58.895 INFO:teuthology.orchestra.run.smithi101.stdout: python3-webtest noarch 2.0.33-1.el8 epel 85 k 2023-08-01T19:50:58.895 INFO:teuthology.orchestra.run.smithi101.stdout: python3-werkzeug noarch 0.12.2-4.el8 appstream 457 k 2023-08-01T19:50:58.895 INFO:teuthology.orchestra.run.smithi101.stdout: python3-zc-lockfile noarch 2.0-2.el8 epel 23 k 2023-08-01T19:50:58.895 INFO:teuthology.orchestra.run.smithi101.stdout: socat x86_64 1.7.4.1-1.el8 appstream 323 k 2023-08-01T19:50:58.895 INFO:teuthology.orchestra.run.smithi101.stdout: thrift x86_64 0.13.0-2.el8 epel 1.7 M 2023-08-01T19:50:58.896 INFO:teuthology.orchestra.run.smithi101.stdout: xmlstarlet x86_64 1.6.1-20.el8 appstream 71 k 2023-08-01T19:50:58.896 INFO:teuthology.orchestra.run.smithi101.stdout: zlib-devel x86_64 1.2.11-21.el8 baseos 58 k 2023-08-01T19:50:58.896 INFO:teuthology.orchestra.run.smithi101.stdout: 2023-08-01T19:50:58.896 INFO:teuthology.orchestra.run.smithi101.stdout:Transaction Summary 2023-08-01T19:50:58.896 INFO:teuthology.orchestra.run.smithi101.stdout:================================================================================================ 2023-08-01T19:50:58.896 INFO:teuthology.orchestra.run.smithi101.stdout:Install 121 Packages 2023-08-01T19:50:58.896 INFO:teuthology.orchestra.run.smithi101.stdout:Upgrade 13 Packages 2023-08-01T19:50:58.896 INFO:teuthology.orchestra.run.smithi101.stdout: 2023-08-01T19:50:58.897 INFO:teuthology.orchestra.run.smithi101.stdout:Total download size: 208 M 2023-08-01T19:50:58.897 INFO:teuthology.orchestra.run.smithi101.stdout:Downloading Packages: 2023-08-01T19:50:59.453 INFO:teuthology.orchestra.run.smithi101.stdout:(1/134): ceph-17.2.6-823.g893fa35f.el8.x86_64.r 22 kB/s | 6.4 kB 00:00 2023-08-01T19:50:59.630 INFO:teuthology.orchestra.run.smithi008.stdout:lab-extras 428 kB/s | 24 kB 00:00 2023-08-01T19:50:59.929 INFO:teuthology.orchestra.run.smithi101.stdout:(2/134): ceph-fuse-17.2.6-823.g893fa35f.el8.x86 1.8 MB/s | 874 kB 00:00 2023-08-01T19:51:00.029 INFO:teuthology.orchestra.run.smithi101.stdout:(3/134): ceph-immutable-object-cache-17.2.6-823 1.6 MB/s | 162 kB 00:00 2023-08-01T19:51:00.588 INFO:teuthology.orchestra.run.smithi101.stdout:(4/134): ceph-mds-17.2.6-823.g893fa35f.el8.x86_ 4.1 MB/s | 2.3 MB 00:00 2023-08-01T19:51:00.788 INFO:teuthology.orchestra.run.smithi101.stdout:(5/134): ceph-base-17.2.6-823.g893fa35f.el8.x86 3.2 MB/s | 5.2 MB 00:01 2023-08-01T19:51:00.997 INFO:teuthology.orchestra.run.smithi101.stdout:(6/134): ceph-mgr-17.2.6-823.g893fa35f.el8.x86_ 3.8 MB/s | 1.6 MB 00:00 2023-08-01T19:51:01.380 INFO:teuthology.orchestra.run.smithi101.stdout:(7/134): ceph-mon-17.2.6-823.g893fa35f.el8.x86_ 6.6 MB/s | 3.9 MB 00:00 2023-08-01T19:51:02.254 INFO:teuthology.orchestra.run.smithi155.stdout:lab-extras 392 kB/s | 24 kB 00:00 2023-08-01T19:51:02.891 INFO:teuthology.orchestra.run.smithi101.stdout:(8/134): ceph-osd-17.2.6-823.g893fa35f.el8.x86_ 8.8 MB/s | 17 MB 00:01 2023-08-01T19:51:03.106 INFO:teuthology.orchestra.run.smithi101.stdout:(9/134): ceph-common-17.2.6-823.g893fa35f.el8.x 5.9 MB/s | 23 MB 00:03 2023-08-01T19:51:03.123 INFO:teuthology.orchestra.run.smithi101.stdout:(10/134): ceph-selinux-17.2.6-823.g893fa35f.el8 105 kB/s | 24 kB 00:00 2023-08-01T19:51:03.206 INFO:teuthology.orchestra.run.smithi101.stdout:(11/134): libcephfs-devel-17.2.6-823.g893fa35f. 298 kB/s | 25 kB 00:00 2023-08-01T19:51:03.390 INFO:teuthology.orchestra.run.smithi101.stdout:(12/134): libcephfs2-17.2.6-823.g893fa35f.el8.x 4.2 MB/s | 795 kB 00:00 2023-08-01T19:51:03.498 INFO:teuthology.orchestra.run.smithi101.stdout:(13/134): libcephsqlite-17.2.6-823.g893fa35f.el 1.6 MB/s | 174 kB 00:00 2023-08-01T19:51:03.599 INFO:teuthology.orchestra.run.smithi101.stdout:(14/134): librados-devel-17.2.6-823.g893fa35f.e 1.3 MB/s | 130 kB 00:00 2023-08-01T19:51:03.737 INFO:teuthology.orchestra.run.smithi008.stdout:Package librados2-1:12.2.7-9.el8.x86_64 is already installed. 2023-08-01T19:51:03.738 INFO:teuthology.orchestra.run.smithi008.stdout:Package librbd1-1:12.2.7-9.el8.x86_64 is already installed. 2023-08-01T19:51:03.740 INFO:teuthology.orchestra.run.smithi101.stdout:(15/134): libradosstriper1-17.2.6-823.g893fa35f 3.5 MB/s | 508 kB 00:00 2023-08-01T19:51:03.940 INFO:teuthology.orchestra.run.smithi008.stdout:Dependencies resolved. 2023-08-01T19:51:03.954 INFO:teuthology.orchestra.run.smithi008.stdout:================================================================================================ 2023-08-01T19:51:03.954 INFO:teuthology.orchestra.run.smithi008.stdout: Package Arch Version Repository Size 2023-08-01T19:51:03.954 INFO:teuthology.orchestra.run.smithi008.stdout:================================================================================================ 2023-08-01T19:51:03.954 INFO:teuthology.orchestra.run.smithi008.stdout:Installing: 2023-08-01T19:51:03.955 INFO:teuthology.orchestra.run.smithi008.stdout: bison x86_64 3.0.4-10.el8 appstream 688 k 2023-08-01T19:51:03.955 INFO:teuthology.orchestra.run.smithi008.stdout: ceph x86_64 2:17.2.6-823.g893fa35f.el8 ceph 6.4 k 2023-08-01T19:51:03.955 INFO:teuthology.orchestra.run.smithi008.stdout: ceph-base x86_64 2:17.2.6-823.g893fa35f.el8 ceph 5.2 M 2023-08-01T19:51:03.955 INFO:teuthology.orchestra.run.smithi008.stdout: ceph-fuse x86_64 2:17.2.6-823.g893fa35f.el8 ceph 874 k 2023-08-01T19:51:03.955 INFO:teuthology.orchestra.run.smithi008.stdout: ceph-immutable-object-cache x86_64 2:17.2.6-823.g893fa35f.el8 ceph 162 k 2023-08-01T19:51:03.955 INFO:teuthology.orchestra.run.smithi008.stdout: ceph-mgr x86_64 2:17.2.6-823.g893fa35f.el8 ceph 1.6 M 2023-08-01T19:51:03.955 INFO:teuthology.orchestra.run.smithi008.stdout: ceph-mgr-cephadm noarch 2:17.2.6-823.g893fa35f.el8 ceph-noarch 121 k 2023-08-01T19:51:03.955 INFO:teuthology.orchestra.run.smithi008.stdout: ceph-mgr-dashboard noarch 2:17.2.6-823.g893fa35f.el8 ceph-noarch 1.7 M 2023-08-01T19:51:03.956 INFO:teuthology.orchestra.run.smithi008.stdout: ceph-mgr-diskprediction-local noarch 2:17.2.6-823.g893fa35f.el8 ceph-noarch 7.4 M 2023-08-01T19:51:03.956 INFO:teuthology.orchestra.run.smithi008.stdout: ceph-mgr-rook noarch 2:17.2.6-823.g893fa35f.el8 ceph-noarch 47 k 2023-08-01T19:51:03.956 INFO:teuthology.orchestra.run.smithi008.stdout: ceph-radosgw x86_64 2:17.2.6-823.g893fa35f.el8 ceph 17 M 2023-08-01T19:51:03.956 INFO:teuthology.orchestra.run.smithi008.stdout: ceph-test x86_64 2:17.2.6-823.g893fa35f.el8 ceph 52 M 2023-08-01T19:51:03.956 INFO:teuthology.orchestra.run.smithi008.stdout: ceph-volume noarch 2:17.2.6-823.g893fa35f.el8 ceph-noarch 264 k 2023-08-01T19:51:03.956 INFO:teuthology.orchestra.run.smithi008.stdout: cephadm noarch 2:17.2.6-823.g893fa35f.el8 ceph-noarch 80 k 2023-08-01T19:51:03.956 INFO:teuthology.orchestra.run.smithi008.stdout: elfutils-libelf-devel x86_64 0.189-2.el8 baseos 61 k 2023-08-01T19:51:03.957 INFO:teuthology.orchestra.run.smithi008.stdout: flex x86_64 2.6.1-9.el8 appstream 320 k 2023-08-01T19:51:03.957 INFO:teuthology.orchestra.run.smithi008.stdout: libaio-devel x86_64 0.3.112-1.el8 baseos 19 k 2023-08-01T19:51:03.957 INFO:teuthology.orchestra.run.smithi008.stdout: libcephfs-devel x86_64 2:17.2.6-823.g893fa35f.el8 ceph 25 k 2023-08-01T19:51:03.957 INFO:teuthology.orchestra.run.smithi008.stdout: libcephfs2 x86_64 2:17.2.6-823.g893fa35f.el8 ceph 795 k 2023-08-01T19:51:03.957 INFO:teuthology.orchestra.run.smithi008.stdout: librados-devel x86_64 2:17.2.6-823.g893fa35f.el8 ceph 130 k 2023-08-01T19:51:03.957 INFO:teuthology.orchestra.run.smithi008.stdout: libtool x86_64 2.4.6-25.el8 appstream 709 k 2023-08-01T19:51:03.957 INFO:teuthology.orchestra.run.smithi008.stdout: libuuid-devel x86_64 2.32.1-42.el8 baseos 99 k 2023-08-01T19:51:03.957 INFO:teuthology.orchestra.run.smithi008.stdout: openssl-devel x86_64 1:1.1.1k-9.el8 baseos 3.2 M 2023-08-01T19:51:03.958 INFO:teuthology.orchestra.run.smithi008.stdout: python3-cephfs x86_64 2:17.2.6-823.g893fa35f.el8 ceph 190 k 2023-08-01T19:51:03.958 INFO:teuthology.orchestra.run.smithi008.stdout: python3-rados x86_64 2:17.2.6-823.g893fa35f.el8 ceph 371 k 2023-08-01T19:51:03.958 INFO:teuthology.orchestra.run.smithi008.stdout: python3-rbd x86_64 2:17.2.6-823.g893fa35f.el8 ceph 358 k 2023-08-01T19:51:03.958 INFO:teuthology.orchestra.run.smithi008.stdout: python3-rgw x86_64 2:17.2.6-823.g893fa35f.el8 ceph 107 k 2023-08-01T19:51:03.958 INFO:teuthology.orchestra.run.smithi008.stdout: rbd-fuse x86_64 2:17.2.6-823.g893fa35f.el8 ceph 90 k 2023-08-01T19:51:03.958 INFO:teuthology.orchestra.run.smithi008.stdout: rbd-mirror x86_64 2:17.2.6-823.g893fa35f.el8 ceph 3.5 M 2023-08-01T19:51:03.958 INFO:teuthology.orchestra.run.smithi008.stdout: rbd-nbd x86_64 2:17.2.6-823.g893fa35f.el8 ceph 173 k 2023-08-01T19:51:03.958 INFO:teuthology.orchestra.run.smithi008.stdout: xfsprogs-devel x86_64 5.0.0-12.el8 baseos 74 k 2023-08-01T19:51:03.959 INFO:teuthology.orchestra.run.smithi008.stdout:Upgrading: 2023-08-01T19:51:03.959 INFO:teuthology.orchestra.run.smithi008.stdout: elfutils-debuginfod-client x86_64 0.189-2.el8 baseos 76 k 2023-08-01T19:51:03.959 INFO:teuthology.orchestra.run.smithi008.stdout: elfutils-libelf x86_64 0.189-2.el8 baseos 232 k 2023-08-01T19:51:03.959 INFO:teuthology.orchestra.run.smithi008.stdout: elfutils-libs x86_64 0.189-2.el8 baseos 302 k 2023-08-01T19:51:03.959 INFO:teuthology.orchestra.run.smithi008.stdout: libblkid x86_64 2.32.1-42.el8 baseos 220 k 2023-08-01T19:51:03.959 INFO:teuthology.orchestra.run.smithi008.stdout: libfdisk x86_64 2.32.1-42.el8 baseos 253 k 2023-08-01T19:51:03.959 INFO:teuthology.orchestra.run.smithi008.stdout: libmount x86_64 2.32.1-42.el8 baseos 236 k 2023-08-01T19:51:03.960 INFO:teuthology.orchestra.run.smithi008.stdout: librados2 x86_64 2:17.2.6-823.g893fa35f.el8 ceph 3.5 M 2023-08-01T19:51:03.960 INFO:teuthology.orchestra.run.smithi008.stdout: librbd1 x86_64 2:17.2.6-823.g893fa35f.el8 ceph 3.6 M 2023-08-01T19:51:03.960 INFO:teuthology.orchestra.run.smithi008.stdout: libsmartcols x86_64 2.32.1-42.el8 baseos 179 k 2023-08-01T19:51:03.960 INFO:teuthology.orchestra.run.smithi008.stdout: libuuid x86_64 2.32.1-42.el8 baseos 98 k 2023-08-01T19:51:03.960 INFO:teuthology.orchestra.run.smithi008.stdout: util-linux x86_64 2.32.1-42.el8 baseos 2.6 M 2023-08-01T19:51:03.960 INFO:teuthology.orchestra.run.smithi008.stdout: util-linux-user x86_64 2.32.1-42.el8 baseos 102 k 2023-08-01T19:51:03.960 INFO:teuthology.orchestra.run.smithi008.stdout: xfsprogs x86_64 5.0.0-12.el8 baseos 1.1 M 2023-08-01T19:51:03.960 INFO:teuthology.orchestra.run.smithi008.stdout:Installing dependencies: 2023-08-01T19:51:03.961 INFO:teuthology.orchestra.run.smithi008.stdout: automake noarch 1.16.1-7.el8 appstream 713 k 2023-08-01T19:51:03.961 INFO:teuthology.orchestra.run.smithi008.stdout: ceph-common x86_64 2:17.2.6-823.g893fa35f.el8 ceph 23 M 2023-08-01T19:51:03.961 INFO:teuthology.orchestra.run.smithi008.stdout: ceph-grafana-dashboards noarch 2:17.2.6-823.g893fa35f.el8 ceph-noarch 23 k 2023-08-01T19:51:03.961 INFO:teuthology.orchestra.run.smithi008.stdout: ceph-mds x86_64 2:17.2.6-823.g893fa35f.el8 ceph 2.3 M 2023-08-01T19:51:03.961 INFO:teuthology.orchestra.run.smithi008.stdout: ceph-mgr-modules-core noarch 2:17.2.6-823.g893fa35f.el8 ceph-noarch 238 k 2023-08-01T19:51:03.961 INFO:teuthology.orchestra.run.smithi008.stdout: ceph-mon x86_64 2:17.2.6-823.g893fa35f.el8 ceph 3.9 M 2023-08-01T19:51:03.961 INFO:teuthology.orchestra.run.smithi008.stdout: ceph-osd x86_64 2:17.2.6-823.g893fa35f.el8 ceph 17 M 2023-08-01T19:51:03.961 INFO:teuthology.orchestra.run.smithi008.stdout: ceph-prometheus-alerts noarch 2:17.2.6-823.g893fa35f.el8 ceph-noarch 14 k 2023-08-01T19:51:03.962 INFO:teuthology.orchestra.run.smithi008.stdout: ceph-selinux x86_64 2:17.2.6-823.g893fa35f.el8 ceph 24 k 2023-08-01T19:51:03.962 INFO:teuthology.orchestra.run.smithi008.stdout: fuse x86_64 2.9.7-17.el8 baseos 83 k 2023-08-01T19:51:03.962 INFO:teuthology.orchestra.run.smithi008.stdout: gperftools-libs x86_64 1:2.7-9.el8 epel 306 k 2023-08-01T19:51:03.962 INFO:teuthology.orchestra.run.smithi008.stdout: jq x86_64 1.6-7.el8 appstream 202 k 2023-08-01T19:51:03.962 INFO:teuthology.orchestra.run.smithi008.stdout: keyutils-libs-devel x86_64 1.5.10-9.el8 baseos 48 k 2023-08-01T19:51:03.962 INFO:teuthology.orchestra.run.smithi008.stdout: krb5-devel x86_64 1.18.2-22.el8 baseos 561 k 2023-08-01T19:51:03.962 INFO:teuthology.orchestra.run.smithi008.stdout: libcephsqlite x86_64 2:17.2.6-823.g893fa35f.el8 ceph 174 k 2023-08-01T19:51:03.963 INFO:teuthology.orchestra.run.smithi008.stdout: libcom_err-devel x86_64 1.45.6-5.el8 baseos 39 k 2023-08-01T19:51:03.963 INFO:teuthology.orchestra.run.smithi008.stdout: libgfortran x86_64 8.5.0-20.el8 baseos 645 k 2023-08-01T19:51:03.963 INFO:teuthology.orchestra.run.smithi008.stdout: liboath x86_64 2.6.2-3.el8 epel 59 k 2023-08-01T19:51:03.963 INFO:teuthology.orchestra.run.smithi008.stdout: libquadmath x86_64 8.5.0-20.el8 baseos 172 k 2023-08-01T19:51:03.963 INFO:teuthology.orchestra.run.smithi008.stdout: librabbitmq x86_64 0.9.0-4.el8 baseos 47 k 2023-08-01T19:51:03.963 INFO:teuthology.orchestra.run.smithi008.stdout: libradosstriper1 x86_64 2:17.2.6-823.g893fa35f.el8 ceph 508 k 2023-08-01T19:51:03.963 INFO:teuthology.orchestra.run.smithi008.stdout: librdkafka x86_64 0.11.4-3.el8 appstream 354 k 2023-08-01T19:51:03.963 INFO:teuthology.orchestra.run.smithi008.stdout: librgw2 x86_64 2:17.2.6-823.g893fa35f.el8 ceph 5.5 M 2023-08-01T19:51:03.964 INFO:teuthology.orchestra.run.smithi008.stdout: libselinux-devel x86_64 2.9-8.el8 baseos 200 k 2023-08-01T19:51:03.964 INFO:teuthology.orchestra.run.smithi008.stdout: libsepol-devel x86_64 2.9-3.el8 baseos 87 k 2023-08-01T19:51:03.964 INFO:teuthology.orchestra.run.smithi008.stdout: libunwind x86_64 1.3.1-3.el8 epel 75 k 2023-08-01T19:51:03.964 INFO:teuthology.orchestra.run.smithi008.stdout: libverto-devel x86_64 0.3.2-2.el8 baseos 18 k 2023-08-01T19:51:03.964 INFO:teuthology.orchestra.run.smithi008.stdout: libzstd-devel x86_64 1.4.4-1.el8 baseos 44 k 2023-08-01T19:51:03.964 INFO:teuthology.orchestra.run.smithi008.stdout: lttng-ust x86_64 2.8.1-11.el8 appstream 259 k 2023-08-01T19:51:03.964 INFO:teuthology.orchestra.run.smithi008.stdout: oniguruma x86_64 6.8.2-2.el8 appstream 187 k 2023-08-01T19:51:03.964 INFO:teuthology.orchestra.run.smithi008.stdout: openblas x86_64 0.3.15-4.el8 appstream 4.7 M 2023-08-01T19:51:03.965 INFO:teuthology.orchestra.run.smithi008.stdout: openblas-threads x86_64 0.3.15-4.el8 appstream 4.9 M 2023-08-01T19:51:03.965 INFO:teuthology.orchestra.run.smithi008.stdout: pcre2-devel x86_64 10.32-3.el8 baseos 605 k 2023-08-01T19:51:03.965 INFO:teuthology.orchestra.run.smithi008.stdout: pcre2-utf16 x86_64 10.32-3.el8 baseos 229 k 2023-08-01T19:51:03.965 INFO:teuthology.orchestra.run.smithi008.stdout: pcre2-utf32 x86_64 10.32-3.el8 baseos 220 k 2023-08-01T19:51:03.965 INFO:teuthology.orchestra.run.smithi008.stdout: python3-asyncssh noarch 2.7.0-2.el8 epel 476 k 2023-08-01T19:51:03.965 INFO:teuthology.orchestra.run.smithi008.stdout: python3-babel noarch 2.5.1-7.el8 appstream 4.8 M 2023-08-01T19:51:03.965 INFO:teuthology.orchestra.run.smithi008.stdout: python3-bcrypt x86_64 3.1.6-2.el8.1 epel 44 k 2023-08-01T19:51:03.966 INFO:teuthology.orchestra.run.smithi008.stdout: python3-beautifulsoup4 noarch 4.6.3-2.el8.1 epel 185 k 2023-08-01T19:51:03.966 INFO:teuthology.orchestra.run.smithi008.stdout: python3-cachetools noarch 3.1.1-4.el8 epel 33 k 2023-08-01T19:51:03.966 INFO:teuthology.orchestra.run.smithi008.stdout: python3-ceph-argparse x86_64 2:17.2.6-823.g893fa35f.el8 ceph 45 k 2023-08-01T19:51:03.966 INFO:teuthology.orchestra.run.smithi008.stdout: python3-ceph-common x86_64 2:17.2.6-823.g893fa35f.el8 ceph 115 k 2023-08-01T19:51:03.966 INFO:teuthology.orchestra.run.smithi008.stdout: python3-certifi noarch 2018.10.15-7.el8 epel 16 k 2023-08-01T19:51:03.966 INFO:teuthology.orchestra.run.smithi008.stdout: python3-cffi x86_64 1.11.5-6.el8 baseos 249 k 2023-08-01T19:51:03.966 INFO:teuthology.orchestra.run.smithi008.stdout: python3-cheroot noarch 8.5.2-1.el8 epel 173 k 2023-08-01T19:51:03.966 INFO:teuthology.orchestra.run.smithi008.stdout: python3-cherrypy noarch 18.4.0-1.el8 epel 384 k 2023-08-01T19:51:03.967 INFO:teuthology.orchestra.run.smithi008.stdout: python3-cryptography x86_64 3.2.1-6.el8 baseos 641 k 2023-08-01T19:51:03.967 INFO:teuthology.orchestra.run.smithi008.stdout: python3-google-auth noarch 1:1.1.1-10.el8 epel 81 k 2023-08-01T19:51:03.967 INFO:teuthology.orchestra.run.smithi008.stdout: python3-jaraco noarch 6.2-6.el8 epel 11 k 2023-08-01T19:51:03.967 INFO:teuthology.orchestra.run.smithi008.stdout: python3-jaraco-functools noarch 2.0-4.el8 epel 18 k 2023-08-01T19:51:03.967 INFO:teuthology.orchestra.run.smithi008.stdout: python3-jinja2 noarch 2.10.1-3.el8 appstream 538 k 2023-08-01T19:51:03.967 INFO:teuthology.orchestra.run.smithi008.stdout: python3-jsonpatch noarch 1.21-2.el8 appstream 27 k 2023-08-01T19:51:03.967 INFO:teuthology.orchestra.run.smithi008.stdout: python3-jsonpointer noarch 1.10-11.el8 appstream 20 k 2023-08-01T19:51:03.967 INFO:teuthology.orchestra.run.smithi008.stdout: python3-jwt noarch 1.6.1-2.el8 baseos 43 k 2023-08-01T19:51:03.968 INFO:teuthology.orchestra.run.smithi008.stdout: python3-kubernetes noarch 1:11.0.0-6.el8 epel 1.2 M 2023-08-01T19:51:03.968 INFO:teuthology.orchestra.run.smithi008.stdout: python3-logutils noarch 0.3.5-11.el8 epel 49 k 2023-08-01T19:51:03.968 INFO:teuthology.orchestra.run.smithi008.stdout: python3-mako noarch 1.0.6-14.el8 appstream 157 k 2023-08-01T19:51:03.968 INFO:teuthology.orchestra.run.smithi008.stdout: python3-markupsafe x86_64 0.23-19.el8 appstream 39 k 2023-08-01T19:51:03.968 INFO:teuthology.orchestra.run.smithi008.stdout: python3-more-itertools noarch 7.2.0-3.el8 epel 59 k 2023-08-01T19:51:03.968 INFO:teuthology.orchestra.run.smithi008.stdout: python3-natsort noarch 7.1.1-2.el8 epel 60 k 2023-08-01T19:51:03.968 INFO:teuthology.orchestra.run.smithi008.stdout: python3-numpy x86_64 1:1.14.3-10.el8 appstream 3.7 M 2023-08-01T19:51:03.969 INFO:teuthology.orchestra.run.smithi008.stdout: python3-numpy-f2py x86_64 1:1.14.3-10.el8 appstream 225 k 2023-08-01T19:51:03.969 INFO:teuthology.orchestra.run.smithi008.stdout: python3-oauthlib noarch 2.1.0-1.el8 baseos 155 k 2023-08-01T19:51:03.969 INFO:teuthology.orchestra.run.smithi008.stdout: python3-pecan noarch 1.3.2-9.el8 epel 283 k 2023-08-01T19:51:03.969 INFO:teuthology.orchestra.run.smithi008.stdout: python3-portend noarch 2.6-1.el8 epel 16 k 2023-08-01T19:51:03.969 INFO:teuthology.orchestra.run.smithi008.stdout: python3-prettytable noarch 0.7.2-14.el8 appstream 44 k 2023-08-01T19:51:03.969 INFO:teuthology.orchestra.run.smithi008.stdout: python3-pyOpenSSL noarch 19.0.0-1.el8 appstream 103 k 2023-08-01T19:51:03.969 INFO:teuthology.orchestra.run.smithi008.stdout: python3-pyasn1 noarch 0.3.7-6.el8 appstream 126 k 2023-08-01T19:51:03.969 INFO:teuthology.orchestra.run.smithi008.stdout: python3-pyasn1-modules noarch 0.3.7-6.el8 appstream 110 k 2023-08-01T19:51:03.970 INFO:teuthology.orchestra.run.smithi008.stdout: python3-pycparser noarch 2.14-14.el8 baseos 109 k 2023-08-01T19:51:03.970 INFO:teuthology.orchestra.run.smithi008.stdout: python3-pytz noarch 2017.2-9.el8 appstream 54 k 2023-08-01T19:51:03.970 INFO:teuthology.orchestra.run.smithi008.stdout: python3-repoze-lru noarch 0.7-6.el8 epel 34 k 2023-08-01T19:51:03.970 INFO:teuthology.orchestra.run.smithi008.stdout: python3-requests-oauthlib noarch 1.0.0-1.el8 baseos 43 k 2023-08-01T19:51:03.970 INFO:teuthology.orchestra.run.smithi008.stdout: python3-routes noarch 2.4.1-12.el8 epel 196 k 2023-08-01T19:51:03.970 INFO:teuthology.orchestra.run.smithi008.stdout: python3-rsa noarch 4.9-2.el8 epel 64 k 2023-08-01T19:51:03.970 INFO:teuthology.orchestra.run.smithi008.stdout: python3-scipy x86_64 1.0.0-21.module_el8.5.0+771+e5d9a225 appstream 14 M 2023-08-01T19:51:03.970 INFO:teuthology.orchestra.run.smithi008.stdout: python3-simplegeneric noarch 0.8.1-17.el8 epel 19 k 2023-08-01T19:51:03.971 INFO:teuthology.orchestra.run.smithi008.stdout: python3-singledispatch noarch 3.4.0.3-18.el8 epel 24 k 2023-08-01T19:51:03.971 INFO:teuthology.orchestra.run.smithi008.stdout: python3-tempora noarch 1.14.1-5.el8 epel 29 k 2023-08-01T19:51:03.971 INFO:teuthology.orchestra.run.smithi008.stdout: python3-trustme noarch 0.6.0-4.el8 epel 27 k 2023-08-01T19:51:03.971 INFO:teuthology.orchestra.run.smithi008.stdout: python3-waitress noarch 1.4.3-1.el8 epel 255 k 2023-08-01T19:51:03.971 INFO:teuthology.orchestra.run.smithi008.stdout: python3-webob noarch 1.8.5-1.el8.1 epel 251 k 2023-08-01T19:51:03.971 INFO:teuthology.orchestra.run.smithi008.stdout: python3-websocket-client noarch 0.56.0-5.el8 epel 61 k 2023-08-01T19:51:03.971 INFO:teuthology.orchestra.run.smithi008.stdout: python3-webtest noarch 2.0.33-1.el8 epel 85 k 2023-08-01T19:51:03.971 INFO:teuthology.orchestra.run.smithi008.stdout: python3-werkzeug noarch 0.12.2-4.el8 appstream 457 k 2023-08-01T19:51:03.972 INFO:teuthology.orchestra.run.smithi008.stdout: python3-zc-lockfile noarch 2.0-2.el8 epel 23 k 2023-08-01T19:51:03.972 INFO:teuthology.orchestra.run.smithi008.stdout: socat x86_64 1.7.4.1-1.el8 appstream 323 k 2023-08-01T19:51:03.972 INFO:teuthology.orchestra.run.smithi008.stdout: thrift x86_64 0.13.0-2.el8 epel 1.7 M 2023-08-01T19:51:03.972 INFO:teuthology.orchestra.run.smithi008.stdout: xmlstarlet x86_64 1.6.1-20.el8 appstream 71 k 2023-08-01T19:51:03.972 INFO:teuthology.orchestra.run.smithi008.stdout: zlib-devel x86_64 1.2.11-21.el8 baseos 58 k 2023-08-01T19:51:03.972 INFO:teuthology.orchestra.run.smithi008.stdout: 2023-08-01T19:51:03.972 INFO:teuthology.orchestra.run.smithi008.stdout:Transaction Summary 2023-08-01T19:51:03.972 INFO:teuthology.orchestra.run.smithi008.stdout:================================================================================================ 2023-08-01T19:51:03.973 INFO:teuthology.orchestra.run.smithi008.stdout:Install 121 Packages 2023-08-01T19:51:03.973 INFO:teuthology.orchestra.run.smithi008.stdout:Upgrade 13 Packages 2023-08-01T19:51:03.973 INFO:teuthology.orchestra.run.smithi008.stdout: 2023-08-01T19:51:03.974 INFO:teuthology.orchestra.run.smithi101.stdout:(16/134): ceph-radosgw-17.2.6-823.g893fa35f.el8 6.5 MB/s | 17 MB 00:02 2023-08-01T19:51:03.974 INFO:teuthology.orchestra.run.smithi008.stdout:Total download size: 208 M 2023-08-01T19:51:03.974 INFO:teuthology.orchestra.run.smithi008.stdout:Downloading Packages: 2023-08-01T19:51:04.083 INFO:teuthology.orchestra.run.smithi101.stdout:(17/134): python3-ceph-argparse-17.2.6-823.g893 358 kB/s | 45 kB 00:00 2023-08-01T19:51:04.175 INFO:teuthology.orchestra.run.smithi101.stdout:(18/134): python3-ceph-common-17.2.6-823.g893fa 1.2 MB/s | 115 kB 00:00 2023-08-01T19:51:04.292 INFO:teuthology.orchestra.run.smithi101.stdout:(19/134): python3-cephfs-17.2.6-823.g893fa35f.e 1.6 MB/s | 190 kB 00:00 2023-08-01T19:51:04.392 INFO:teuthology.orchestra.run.smithi101.stdout:(20/134): librgw2-17.2.6-823.g893fa35f.el8.x86_ 8.5 MB/s | 5.5 MB 00:00 2023-08-01T19:51:04.417 INFO:teuthology.orchestra.run.smithi101.stdout:(21/134): python3-rados-17.2.6-823.g893fa35f.el 2.9 MB/s | 371 kB 00:00 2023-08-01T19:51:04.509 INFO:teuthology.orchestra.run.smithi101.stdout:(22/134): python3-rbd-17.2.6-823.g893fa35f.el8. 3.0 MB/s | 358 kB 00:00 2023-08-01T19:51:04.557 INFO:teuthology.orchestra.run.smithi101.stdout:(23/134): python3-rgw-17.2.6-823.g893fa35f.el8. 768 kB/s | 107 kB 00:00 2023-08-01T19:51:04.602 INFO:teuthology.orchestra.run.smithi101.stdout:(24/134): rbd-fuse-17.2.6-823.g893fa35f.el8.x86 980 kB/s | 90 kB 00:00 2023-08-01T19:51:04.702 INFO:teuthology.orchestra.run.smithi101.stdout:(25/134): rbd-nbd-17.2.6-823.g893fa35f.el8.x86_ 1.7 MB/s | 173 kB 00:00 2023-08-01T19:51:04.740 INFO:teuthology.orchestra.run.smithi008.stdout:(1/134): ceph-17.2.6-823.g893fa35f.el8.x86_64.r 14 kB/s | 6.4 kB 00:00 2023-08-01T19:51:04.794 INFO:teuthology.orchestra.run.smithi101.stdout:(26/134): ceph-grafana-dashboards-17.2.6-823.g8 251 kB/s | 23 kB 00:00 2023-08-01T19:51:04.894 INFO:teuthology.orchestra.run.smithi101.stdout:(27/134): ceph-mgr-cephadm-17.2.6-823.g893fa35f 1.2 MB/s | 121 kB 00:00 2023-08-01T19:51:05.194 INFO:teuthology.orchestra.run.smithi101.stdout:(28/134): rbd-mirror-17.2.6-823.g893fa35f.el8.x 5.4 MB/s | 3.5 MB 00:00 2023-08-01T19:51:05.765 INFO:teuthology.orchestra.run.smithi008.stdout:(2/134): ceph-fuse-17.2.6-823.g893fa35f.el8.x86 853 kB/s | 874 kB 00:01 2023-08-01T19:51:05.936 INFO:teuthology.orchestra.run.smithi101.stdout:(29/134): ceph-mgr-dashboard-17.2.6-823.g893fa3 1.6 MB/s | 1.7 MB 00:01 2023-08-01T19:51:05.982 INFO:teuthology.orchestra.run.smithi008.stdout:(3/134): ceph-immutable-object-cache-17.2.6-823 747 kB/s | 162 kB 00:00 2023-08-01T19:51:06.053 INFO:teuthology.orchestra.run.smithi101.stdout:(30/134): ceph-mgr-modules-core-17.2.6-823.g893 2.0 MB/s | 238 kB 00:00 2023-08-01T19:51:06.162 INFO:teuthology.orchestra.run.smithi101.stdout:(31/134): ceph-mgr-rook-17.2.6-823.g893fa35f.el 437 kB/s | 47 kB 00:00 2023-08-01T19:51:06.177 INFO:teuthology.orchestra.run.smithi155.stdout:Package librados2-1:12.2.7-9.el8.x86_64 is already installed. 2023-08-01T19:51:06.178 INFO:teuthology.orchestra.run.smithi155.stdout:Package librbd1-1:12.2.7-9.el8.x86_64 is already installed. 2023-08-01T19:51:06.254 INFO:teuthology.orchestra.run.smithi101.stdout:(32/134): ceph-prometheus-alerts-17.2.6-823.g89 158 kB/s | 14 kB 00:00 2023-08-01T19:51:06.346 INFO:teuthology.orchestra.run.smithi101.stdout:(33/134): ceph-mgr-diskprediction-local-17.2.6- 6.4 MB/s | 7.4 MB 00:01 2023-08-01T19:51:06.366 INFO:teuthology.orchestra.run.smithi155.stdout:Dependencies resolved. 2023-08-01T19:51:06.371 INFO:teuthology.orchestra.run.smithi101.stdout:(34/134): ceph-volume-17.2.6-823.g893fa35f.el8. 2.2 MB/s | 264 kB 00:00 2023-08-01T19:51:06.379 INFO:teuthology.orchestra.run.smithi155.stdout:================================================================================================ 2023-08-01T19:51:06.379 INFO:teuthology.orchestra.run.smithi155.stdout: Package Arch Version Repository Size 2023-08-01T19:51:06.379 INFO:teuthology.orchestra.run.smithi155.stdout:================================================================================================ 2023-08-01T19:51:06.379 INFO:teuthology.orchestra.run.smithi155.stdout:Installing: 2023-08-01T19:51:06.379 INFO:teuthology.orchestra.run.smithi155.stdout: bison x86_64 3.0.4-10.el8 appstream 688 k 2023-08-01T19:51:06.379 INFO:teuthology.orchestra.run.smithi155.stdout: ceph x86_64 2:17.2.6-823.g893fa35f.el8 ceph 6.4 k 2023-08-01T19:51:06.380 INFO:teuthology.orchestra.run.smithi155.stdout: ceph-base x86_64 2:17.2.6-823.g893fa35f.el8 ceph 5.2 M 2023-08-01T19:51:06.380 INFO:teuthology.orchestra.run.smithi155.stdout: ceph-fuse x86_64 2:17.2.6-823.g893fa35f.el8 ceph 874 k 2023-08-01T19:51:06.380 INFO:teuthology.orchestra.run.smithi155.stdout: ceph-immutable-object-cache x86_64 2:17.2.6-823.g893fa35f.el8 ceph 162 k 2023-08-01T19:51:06.380 INFO:teuthology.orchestra.run.smithi155.stdout: ceph-mgr x86_64 2:17.2.6-823.g893fa35f.el8 ceph 1.6 M 2023-08-01T19:51:06.380 INFO:teuthology.orchestra.run.smithi155.stdout: ceph-mgr-cephadm noarch 2:17.2.6-823.g893fa35f.el8 ceph-noarch 121 k 2023-08-01T19:51:06.380 INFO:teuthology.orchestra.run.smithi155.stdout: ceph-mgr-dashboard noarch 2:17.2.6-823.g893fa35f.el8 ceph-noarch 1.7 M 2023-08-01T19:51:06.380 INFO:teuthology.orchestra.run.smithi155.stdout: ceph-mgr-diskprediction-local noarch 2:17.2.6-823.g893fa35f.el8 ceph-noarch 7.4 M 2023-08-01T19:51:06.381 INFO:teuthology.orchestra.run.smithi155.stdout: ceph-mgr-rook noarch 2:17.2.6-823.g893fa35f.el8 ceph-noarch 47 k 2023-08-01T19:51:06.381 INFO:teuthology.orchestra.run.smithi155.stdout: ceph-radosgw x86_64 2:17.2.6-823.g893fa35f.el8 ceph 17 M 2023-08-01T19:51:06.381 INFO:teuthology.orchestra.run.smithi155.stdout: ceph-test x86_64 2:17.2.6-823.g893fa35f.el8 ceph 52 M 2023-08-01T19:51:06.381 INFO:teuthology.orchestra.run.smithi155.stdout: ceph-volume noarch 2:17.2.6-823.g893fa35f.el8 ceph-noarch 264 k 2023-08-01T19:51:06.381 INFO:teuthology.orchestra.run.smithi155.stdout: cephadm noarch 2:17.2.6-823.g893fa35f.el8 ceph-noarch 80 k 2023-08-01T19:51:06.381 INFO:teuthology.orchestra.run.smithi155.stdout: elfutils-libelf-devel x86_64 0.189-2.el8 baseos 61 k 2023-08-01T19:51:06.381 INFO:teuthology.orchestra.run.smithi155.stdout: flex x86_64 2.6.1-9.el8 appstream 320 k 2023-08-01T19:51:06.382 INFO:teuthology.orchestra.run.smithi155.stdout: libaio-devel x86_64 0.3.112-1.el8 baseos 19 k 2023-08-01T19:51:06.382 INFO:teuthology.orchestra.run.smithi155.stdout: libcephfs-devel x86_64 2:17.2.6-823.g893fa35f.el8 ceph 25 k 2023-08-01T19:51:06.382 INFO:teuthology.orchestra.run.smithi155.stdout: libcephfs2 x86_64 2:17.2.6-823.g893fa35f.el8 ceph 795 k 2023-08-01T19:51:06.382 INFO:teuthology.orchestra.run.smithi155.stdout: librados-devel x86_64 2:17.2.6-823.g893fa35f.el8 ceph 130 k 2023-08-01T19:51:06.382 INFO:teuthology.orchestra.run.smithi155.stdout: libtool x86_64 2.4.6-25.el8 appstream 709 k 2023-08-01T19:51:06.382 INFO:teuthology.orchestra.run.smithi155.stdout: libuuid-devel x86_64 2.32.1-42.el8 baseos 99 k 2023-08-01T19:51:06.382 INFO:teuthology.orchestra.run.smithi155.stdout: openssl-devel x86_64 1:1.1.1k-9.el8 baseos 3.2 M 2023-08-01T19:51:06.382 INFO:teuthology.orchestra.run.smithi155.stdout: python3-cephfs x86_64 2:17.2.6-823.g893fa35f.el8 ceph 190 k 2023-08-01T19:51:06.383 INFO:teuthology.orchestra.run.smithi155.stdout: python3-rados x86_64 2:17.2.6-823.g893fa35f.el8 ceph 371 k 2023-08-01T19:51:06.383 INFO:teuthology.orchestra.run.smithi155.stdout: python3-rbd x86_64 2:17.2.6-823.g893fa35f.el8 ceph 358 k 2023-08-01T19:51:06.383 INFO:teuthology.orchestra.run.smithi155.stdout: python3-rgw x86_64 2:17.2.6-823.g893fa35f.el8 ceph 107 k 2023-08-01T19:51:06.383 INFO:teuthology.orchestra.run.smithi155.stdout: rbd-fuse x86_64 2:17.2.6-823.g893fa35f.el8 ceph 90 k 2023-08-01T19:51:06.383 INFO:teuthology.orchestra.run.smithi155.stdout: rbd-mirror x86_64 2:17.2.6-823.g893fa35f.el8 ceph 3.5 M 2023-08-01T19:51:06.383 INFO:teuthology.orchestra.run.smithi155.stdout: rbd-nbd x86_64 2:17.2.6-823.g893fa35f.el8 ceph 173 k 2023-08-01T19:51:06.383 INFO:teuthology.orchestra.run.smithi155.stdout: xfsprogs-devel x86_64 5.0.0-12.el8 baseos 74 k 2023-08-01T19:51:06.383 INFO:teuthology.orchestra.run.smithi155.stdout:Upgrading: 2023-08-01T19:51:06.384 INFO:teuthology.orchestra.run.smithi155.stdout: elfutils-debuginfod-client x86_64 0.189-2.el8 baseos 76 k 2023-08-01T19:51:06.384 INFO:teuthology.orchestra.run.smithi155.stdout: elfutils-libelf x86_64 0.189-2.el8 baseos 232 k 2023-08-01T19:51:06.384 INFO:teuthology.orchestra.run.smithi155.stdout: elfutils-libs x86_64 0.189-2.el8 baseos 302 k 2023-08-01T19:51:06.384 INFO:teuthology.orchestra.run.smithi155.stdout: libblkid x86_64 2.32.1-42.el8 baseos 220 k 2023-08-01T19:51:06.384 INFO:teuthology.orchestra.run.smithi155.stdout: libfdisk x86_64 2.32.1-42.el8 baseos 253 k 2023-08-01T19:51:06.384 INFO:teuthology.orchestra.run.smithi155.stdout: libmount x86_64 2.32.1-42.el8 baseos 236 k 2023-08-01T19:51:06.384 INFO:teuthology.orchestra.run.smithi155.stdout: librados2 x86_64 2:17.2.6-823.g893fa35f.el8 ceph 3.5 M 2023-08-01T19:51:06.385 INFO:teuthology.orchestra.run.smithi155.stdout: librbd1 x86_64 2:17.2.6-823.g893fa35f.el8 ceph 3.6 M 2023-08-01T19:51:06.385 INFO:teuthology.orchestra.run.smithi155.stdout: libsmartcols x86_64 2.32.1-42.el8 baseos 179 k 2023-08-01T19:51:06.385 INFO:teuthology.orchestra.run.smithi155.stdout: libuuid x86_64 2.32.1-42.el8 baseos 98 k 2023-08-01T19:51:06.385 INFO:teuthology.orchestra.run.smithi155.stdout: util-linux x86_64 2.32.1-42.el8 baseos 2.6 M 2023-08-01T19:51:06.385 INFO:teuthology.orchestra.run.smithi155.stdout: util-linux-user x86_64 2.32.1-42.el8 baseos 102 k 2023-08-01T19:51:06.385 INFO:teuthology.orchestra.run.smithi155.stdout: xfsprogs x86_64 5.0.0-12.el8 baseos 1.1 M 2023-08-01T19:51:06.385 INFO:teuthology.orchestra.run.smithi155.stdout:Installing dependencies: 2023-08-01T19:51:06.385 INFO:teuthology.orchestra.run.smithi155.stdout: automake noarch 1.16.1-7.el8 appstream 713 k 2023-08-01T19:51:06.386 INFO:teuthology.orchestra.run.smithi155.stdout: ceph-common x86_64 2:17.2.6-823.g893fa35f.el8 ceph 23 M 2023-08-01T19:51:06.386 INFO:teuthology.orchestra.run.smithi155.stdout: ceph-grafana-dashboards noarch 2:17.2.6-823.g893fa35f.el8 ceph-noarch 23 k 2023-08-01T19:51:06.386 INFO:teuthology.orchestra.run.smithi155.stdout: ceph-mds x86_64 2:17.2.6-823.g893fa35f.el8 ceph 2.3 M 2023-08-01T19:51:06.386 INFO:teuthology.orchestra.run.smithi155.stdout: ceph-mgr-modules-core noarch 2:17.2.6-823.g893fa35f.el8 ceph-noarch 238 k 2023-08-01T19:51:06.386 INFO:teuthology.orchestra.run.smithi155.stdout: ceph-mon x86_64 2:17.2.6-823.g893fa35f.el8 ceph 3.9 M 2023-08-01T19:51:06.386 INFO:teuthology.orchestra.run.smithi155.stdout: ceph-osd x86_64 2:17.2.6-823.g893fa35f.el8 ceph 17 M 2023-08-01T19:51:06.386 INFO:teuthology.orchestra.run.smithi155.stdout: ceph-prometheus-alerts noarch 2:17.2.6-823.g893fa35f.el8 ceph-noarch 14 k 2023-08-01T19:51:06.386 INFO:teuthology.orchestra.run.smithi155.stdout: ceph-selinux x86_64 2:17.2.6-823.g893fa35f.el8 ceph 24 k 2023-08-01T19:51:06.387 INFO:teuthology.orchestra.run.smithi155.stdout: fuse x86_64 2.9.7-17.el8 baseos 83 k 2023-08-01T19:51:06.387 INFO:teuthology.orchestra.run.smithi155.stdout: gperftools-libs x86_64 1:2.7-9.el8 epel 306 k 2023-08-01T19:51:06.387 INFO:teuthology.orchestra.run.smithi155.stdout: jq x86_64 1.6-7.el8 appstream 202 k 2023-08-01T19:51:06.387 INFO:teuthology.orchestra.run.smithi155.stdout: keyutils-libs-devel x86_64 1.5.10-9.el8 baseos 48 k 2023-08-01T19:51:06.387 INFO:teuthology.orchestra.run.smithi155.stdout: krb5-devel x86_64 1.18.2-22.el8 baseos 561 k 2023-08-01T19:51:06.387 INFO:teuthology.orchestra.run.smithi155.stdout: libcephsqlite x86_64 2:17.2.6-823.g893fa35f.el8 ceph 174 k 2023-08-01T19:51:06.387 INFO:teuthology.orchestra.run.smithi155.stdout: libcom_err-devel x86_64 1.45.6-5.el8 baseos 39 k 2023-08-01T19:51:06.388 INFO:teuthology.orchestra.run.smithi155.stdout: libgfortran x86_64 8.5.0-20.el8 baseos 645 k 2023-08-01T19:51:06.388 INFO:teuthology.orchestra.run.smithi155.stdout: liboath x86_64 2.6.2-3.el8 epel 59 k 2023-08-01T19:51:06.388 INFO:teuthology.orchestra.run.smithi155.stdout: libquadmath x86_64 8.5.0-20.el8 baseos 172 k 2023-08-01T19:51:06.388 INFO:teuthology.orchestra.run.smithi155.stdout: librabbitmq x86_64 0.9.0-4.el8 baseos 47 k 2023-08-01T19:51:06.388 INFO:teuthology.orchestra.run.smithi155.stdout: libradosstriper1 x86_64 2:17.2.6-823.g893fa35f.el8 ceph 508 k 2023-08-01T19:51:06.388 INFO:teuthology.orchestra.run.smithi155.stdout: librdkafka x86_64 0.11.4-3.el8 appstream 354 k 2023-08-01T19:51:06.388 INFO:teuthology.orchestra.run.smithi155.stdout: librgw2 x86_64 2:17.2.6-823.g893fa35f.el8 ceph 5.5 M 2023-08-01T19:51:06.388 INFO:teuthology.orchestra.run.smithi155.stdout: libselinux-devel x86_64 2.9-8.el8 baseos 200 k 2023-08-01T19:51:06.389 INFO:teuthology.orchestra.run.smithi155.stdout: libsepol-devel x86_64 2.9-3.el8 baseos 87 k 2023-08-01T19:51:06.389 INFO:teuthology.orchestra.run.smithi155.stdout: libunwind x86_64 1.3.1-3.el8 epel 75 k 2023-08-01T19:51:06.389 INFO:teuthology.orchestra.run.smithi155.stdout: libverto-devel x86_64 0.3.2-2.el8 baseos 18 k 2023-08-01T19:51:06.389 INFO:teuthology.orchestra.run.smithi155.stdout: libzstd-devel x86_64 1.4.4-1.el8 baseos 44 k 2023-08-01T19:51:06.389 INFO:teuthology.orchestra.run.smithi155.stdout: lttng-ust x86_64 2.8.1-11.el8 appstream 259 k 2023-08-01T19:51:06.389 INFO:teuthology.orchestra.run.smithi155.stdout: oniguruma x86_64 6.8.2-2.el8 appstream 187 k 2023-08-01T19:51:06.389 INFO:teuthology.orchestra.run.smithi155.stdout: openblas x86_64 0.3.15-4.el8 appstream 4.7 M 2023-08-01T19:51:06.390 INFO:teuthology.orchestra.run.smithi155.stdout: openblas-threads x86_64 0.3.15-4.el8 appstream 4.9 M 2023-08-01T19:51:06.390 INFO:teuthology.orchestra.run.smithi155.stdout: pcre2-devel x86_64 10.32-3.el8 baseos 605 k 2023-08-01T19:51:06.390 INFO:teuthology.orchestra.run.smithi155.stdout: pcre2-utf16 x86_64 10.32-3.el8 baseos 229 k 2023-08-01T19:51:06.390 INFO:teuthology.orchestra.run.smithi155.stdout: pcre2-utf32 x86_64 10.32-3.el8 baseos 220 k 2023-08-01T19:51:06.390 INFO:teuthology.orchestra.run.smithi155.stdout: python3-asyncssh noarch 2.7.0-2.el8 epel 476 k 2023-08-01T19:51:06.391 INFO:teuthology.orchestra.run.smithi155.stdout: python3-babel noarch 2.5.1-7.el8 appstream 4.8 M 2023-08-01T19:51:06.391 INFO:teuthology.orchestra.run.smithi155.stdout: python3-bcrypt x86_64 3.1.6-2.el8.1 epel 44 k 2023-08-01T19:51:06.391 INFO:teuthology.orchestra.run.smithi155.stdout: python3-beautifulsoup4 noarch 4.6.3-2.el8.1 epel 185 k 2023-08-01T19:51:06.391 INFO:teuthology.orchestra.run.smithi155.stdout: python3-cachetools noarch 3.1.1-4.el8 epel 33 k 2023-08-01T19:51:06.391 INFO:teuthology.orchestra.run.smithi155.stdout: python3-ceph-argparse x86_64 2:17.2.6-823.g893fa35f.el8 ceph 45 k 2023-08-01T19:51:06.391 INFO:teuthology.orchestra.run.smithi155.stdout: python3-ceph-common x86_64 2:17.2.6-823.g893fa35f.el8 ceph 115 k 2023-08-01T19:51:06.391 INFO:teuthology.orchestra.run.smithi155.stdout: python3-certifi noarch 2018.10.15-7.el8 epel 16 k 2023-08-01T19:51:06.392 INFO:teuthology.orchestra.run.smithi155.stdout: python3-cffi x86_64 1.11.5-6.el8 baseos 249 k 2023-08-01T19:51:06.392 INFO:teuthology.orchestra.run.smithi155.stdout: python3-cheroot noarch 8.5.2-1.el8 epel 173 k 2023-08-01T19:51:06.392 INFO:teuthology.orchestra.run.smithi155.stdout: python3-cherrypy noarch 18.4.0-1.el8 epel 384 k 2023-08-01T19:51:06.392 INFO:teuthology.orchestra.run.smithi155.stdout: python3-cryptography x86_64 3.2.1-6.el8 baseos 641 k 2023-08-01T19:51:06.392 INFO:teuthology.orchestra.run.smithi155.stdout: python3-google-auth noarch 1:1.1.1-10.el8 epel 81 k 2023-08-01T19:51:06.392 INFO:teuthology.orchestra.run.smithi155.stdout: python3-jaraco noarch 6.2-6.el8 epel 11 k 2023-08-01T19:51:06.392 INFO:teuthology.orchestra.run.smithi155.stdout: python3-jaraco-functools noarch 2.0-4.el8 epel 18 k 2023-08-01T19:51:06.393 INFO:teuthology.orchestra.run.smithi155.stdout: python3-jinja2 noarch 2.10.1-3.el8 appstream 538 k 2023-08-01T19:51:06.393 INFO:teuthology.orchestra.run.smithi155.stdout: python3-jsonpatch noarch 1.21-2.el8 appstream 27 k 2023-08-01T19:51:06.393 INFO:teuthology.orchestra.run.smithi155.stdout: python3-jsonpointer noarch 1.10-11.el8 appstream 20 k 2023-08-01T19:51:06.393 INFO:teuthology.orchestra.run.smithi155.stdout: python3-jwt noarch 1.6.1-2.el8 baseos 43 k 2023-08-01T19:51:06.393 INFO:teuthology.orchestra.run.smithi155.stdout: python3-kubernetes noarch 1:11.0.0-6.el8 epel 1.2 M 2023-08-01T19:51:06.393 INFO:teuthology.orchestra.run.smithi155.stdout: python3-logutils noarch 0.3.5-11.el8 epel 49 k 2023-08-01T19:51:06.393 INFO:teuthology.orchestra.run.smithi155.stdout: python3-mako noarch 1.0.6-14.el8 appstream 157 k 2023-08-01T19:51:06.393 INFO:teuthology.orchestra.run.smithi155.stdout: python3-markupsafe x86_64 0.23-19.el8 appstream 39 k 2023-08-01T19:51:06.394 INFO:teuthology.orchestra.run.smithi155.stdout: python3-more-itertools noarch 7.2.0-3.el8 epel 59 k 2023-08-01T19:51:06.394 INFO:teuthology.orchestra.run.smithi155.stdout: python3-natsort noarch 7.1.1-2.el8 epel 60 k 2023-08-01T19:51:06.394 INFO:teuthology.orchestra.run.smithi155.stdout: python3-numpy x86_64 1:1.14.3-10.el8 appstream 3.7 M 2023-08-01T19:51:06.394 INFO:teuthology.orchestra.run.smithi155.stdout: python3-numpy-f2py x86_64 1:1.14.3-10.el8 appstream 225 k 2023-08-01T19:51:06.394 INFO:teuthology.orchestra.run.smithi155.stdout: python3-oauthlib noarch 2.1.0-1.el8 baseos 155 k 2023-08-01T19:51:06.394 INFO:teuthology.orchestra.run.smithi155.stdout: python3-pecan noarch 1.3.2-9.el8 epel 283 k 2023-08-01T19:51:06.394 INFO:teuthology.orchestra.run.smithi155.stdout: python3-portend noarch 2.6-1.el8 epel 16 k 2023-08-01T19:51:06.394 INFO:teuthology.orchestra.run.smithi155.stdout: python3-prettytable noarch 0.7.2-14.el8 appstream 44 k 2023-08-01T19:51:06.395 INFO:teuthology.orchestra.run.smithi155.stdout: python3-pyOpenSSL noarch 19.0.0-1.el8 appstream 103 k 2023-08-01T19:51:06.395 INFO:teuthology.orchestra.run.smithi155.stdout: python3-pyasn1 noarch 0.3.7-6.el8 appstream 126 k 2023-08-01T19:51:06.395 INFO:teuthology.orchestra.run.smithi155.stdout: python3-pyasn1-modules noarch 0.3.7-6.el8 appstream 110 k 2023-08-01T19:51:06.395 INFO:teuthology.orchestra.run.smithi155.stdout: python3-pycparser noarch 2.14-14.el8 baseos 109 k 2023-08-01T19:51:06.395 INFO:teuthology.orchestra.run.smithi155.stdout: python3-pytz noarch 2017.2-9.el8 appstream 54 k 2023-08-01T19:51:06.395 INFO:teuthology.orchestra.run.smithi155.stdout: python3-repoze-lru noarch 0.7-6.el8 epel 34 k 2023-08-01T19:51:06.395 INFO:teuthology.orchestra.run.smithi155.stdout: python3-requests-oauthlib noarch 1.0.0-1.el8 baseos 43 k 2023-08-01T19:51:06.396 INFO:teuthology.orchestra.run.smithi155.stdout: python3-routes noarch 2.4.1-12.el8 epel 196 k 2023-08-01T19:51:06.396 INFO:teuthology.orchestra.run.smithi155.stdout: python3-rsa noarch 4.9-2.el8 epel 64 k 2023-08-01T19:51:06.396 INFO:teuthology.orchestra.run.smithi155.stdout: python3-scipy x86_64 1.0.0-21.module_el8.5.0+771+e5d9a225 appstream 14 M 2023-08-01T19:51:06.396 INFO:teuthology.orchestra.run.smithi155.stdout: python3-simplegeneric noarch 0.8.1-17.el8 epel 19 k 2023-08-01T19:51:06.396 INFO:teuthology.orchestra.run.smithi155.stdout: python3-singledispatch noarch 3.4.0.3-18.el8 epel 24 k 2023-08-01T19:51:06.396 INFO:teuthology.orchestra.run.smithi155.stdout: python3-tempora noarch 1.14.1-5.el8 epel 29 k 2023-08-01T19:51:06.396 INFO:teuthology.orchestra.run.smithi155.stdout: python3-trustme noarch 0.6.0-4.el8 epel 27 k 2023-08-01T19:51:06.396 INFO:teuthology.orchestra.run.smithi155.stdout: python3-waitress noarch 1.4.3-1.el8 epel 255 k 2023-08-01T19:51:06.397 INFO:teuthology.orchestra.run.smithi155.stdout: python3-webob noarch 1.8.5-1.el8.1 epel 251 k 2023-08-01T19:51:06.397 INFO:teuthology.orchestra.run.smithi155.stdout: python3-websocket-client noarch 0.56.0-5.el8 epel 61 k 2023-08-01T19:51:06.397 INFO:teuthology.orchestra.run.smithi155.stdout: python3-webtest noarch 2.0.33-1.el8 epel 85 k 2023-08-01T19:51:06.397 INFO:teuthology.orchestra.run.smithi155.stdout: python3-werkzeug noarch 0.12.2-4.el8 appstream 457 k 2023-08-01T19:51:06.397 INFO:teuthology.orchestra.run.smithi155.stdout: python3-zc-lockfile noarch 2.0-2.el8 epel 23 k 2023-08-01T19:51:06.397 INFO:teuthology.orchestra.run.smithi155.stdout: socat x86_64 1.7.4.1-1.el8 appstream 323 k 2023-08-01T19:51:06.397 INFO:teuthology.orchestra.run.smithi155.stdout: thrift x86_64 0.13.0-2.el8 epel 1.7 M 2023-08-01T19:51:06.397 INFO:teuthology.orchestra.run.smithi155.stdout: xmlstarlet x86_64 1.6.1-20.el8 appstream 71 k 2023-08-01T19:51:06.398 INFO:teuthology.orchestra.run.smithi155.stdout: zlib-devel x86_64 1.2.11-21.el8 baseos 58 k 2023-08-01T19:51:06.398 INFO:teuthology.orchestra.run.smithi155.stdout: 2023-08-01T19:51:06.398 INFO:teuthology.orchestra.run.smithi155.stdout:Transaction Summary 2023-08-01T19:51:06.398 INFO:teuthology.orchestra.run.smithi155.stdout:================================================================================================ 2023-08-01T19:51:06.398 INFO:teuthology.orchestra.run.smithi155.stdout:Install 121 Packages 2023-08-01T19:51:06.398 INFO:teuthology.orchestra.run.smithi155.stdout:Upgrade 13 Packages 2023-08-01T19:51:06.398 INFO:teuthology.orchestra.run.smithi155.stdout: 2023-08-01T19:51:06.399 INFO:teuthology.orchestra.run.smithi155.stdout:Total download size: 208 M 2023-08-01T19:51:06.399 INFO:teuthology.orchestra.run.smithi155.stdout:Downloading Packages: 2023-08-01T19:51:06.438 INFO:teuthology.orchestra.run.smithi101.stdout:(35/134): cephadm-17.2.6-823.g893fa35f.el8.noar 872 kB/s | 80 kB 00:00 2023-08-01T19:51:06.691 INFO:teuthology.orchestra.run.smithi008.stdout:(4/134): ceph-base-17.2.6-823.g893fa35f.el8.x86 2.1 MB/s | 5.2 MB 00:02 2023-08-01T19:51:07.039 INFO:teuthology.orchestra.run.smithi155.stdout:(1/134): ceph-17.2.6-823.g893fa35f.el8.x86_64.r 17 kB/s | 6.4 kB 00:00 2023-08-01T19:51:07.183 INFO:teuthology.orchestra.run.smithi008.stdout:(5/134): ceph-mds-17.2.6-823.g893fa35f.el8.x86_ 1.9 MB/s | 2.3 MB 00:01 2023-08-01T19:51:07.283 INFO:teuthology.orchestra.run.smithi008.stdout:(6/134): ceph-mgr-17.2.6-823.g893fa35f.el8.x86_ 2.6 MB/s | 1.6 MB 00:00 2023-08-01T19:51:07.463 INFO:teuthology.orchestra.run.smithi101.stdout:(36/134): automake-1.16.1-7.el8.noarch.rpm 653 kB/s | 713 kB 00:01 2023-08-01T19:51:07.730 INFO:teuthology.orchestra.run.smithi101.stdout:(37/134): bison-3.0.4-10.el8.x86_64.rpm 533 kB/s | 688 kB 00:01 2023-08-01T19:51:07.764 INFO:teuthology.orchestra.run.smithi155.stdout:(2/134): ceph-fuse-17.2.6-823.g893fa35f.el8.x86 1.2 MB/s | 874 kB 00:00 2023-08-01T19:51:07.881 INFO:teuthology.orchestra.run.smithi155.stdout:(3/134): ceph-immutable-object-cache-17.2.6-823 1.4 MB/s | 162 kB 00:00 2023-08-01T19:51:08.617 INFO:teuthology.orchestra.run.smithi101.stdout:(38/134): flex-2.6.1-9.el8.x86_64.rpm 277 kB/s | 320 kB 00:01 2023-08-01T19:51:08.639 INFO:teuthology.orchestra.run.smithi101.stdout:(39/134): jq-1.6-7.el8.x86_64.rpm 223 kB/s | 202 kB 00:00 2023-08-01T19:51:08.815 INFO:teuthology.orchestra.run.smithi155.stdout:(4/134): ceph-mds-17.2.6-823.g893fa35f.el8.x86_ 2.5 MB/s | 2.3 MB 00:00 2023-08-01T19:51:08.882 INFO:teuthology.orchestra.run.smithi155.stdout:(5/134): ceph-base-17.2.6-823.g893fa35f.el8.x86 2.3 MB/s | 5.2 MB 00:02 2023-08-01T19:51:08.983 INFO:teuthology.orchestra.run.smithi008.stdout:(7/134): ceph-mon-17.2.6-823.g893fa35f.el8.x86_ 2.2 MB/s | 3.9 MB 00:01 2023-08-01T19:51:09.608 INFO:teuthology.orchestra.run.smithi155.stdout:(6/134): ceph-mgr-17.2.6-823.g893fa35f.el8.x86_ 2.0 MB/s | 1.6 MB 00:00 2023-08-01T19:51:09.675 INFO:teuthology.orchestra.run.smithi155.stdout:(7/134): ceph-mon-17.2.6-823.g893fa35f.el8.x86_ 5.0 MB/s | 3.9 MB 00:00 2023-08-01T19:51:10.015 INFO:teuthology.orchestra.run.smithi101.stdout:(40/134): ceph-test-17.2.6-823.g893fa35f.el8.x8 7.5 MB/s | 52 MB 00:06 2023-08-01T19:51:10.040 INFO:teuthology.orchestra.run.smithi101.stdout:(41/134): librdkafka-0.11.4-3.el8.x86_64.rpm 249 kB/s | 354 kB 00:01 2023-08-01T19:51:10.065 INFO:teuthology.orchestra.run.smithi101.stdout:(42/134): libtool-2.4.6-25.el8.x86_64.rpm 497 kB/s | 709 kB 00:01 2023-08-01T19:51:10.882 INFO:teuthology.orchestra.run.smithi101.stdout:(43/134): lttng-ust-2.8.1-11.el8.x86_64.rpm 299 kB/s | 259 kB 00:00 2023-08-01T19:51:10.907 INFO:teuthology.orchestra.run.smithi101.stdout:(44/134): oniguruma-6.8.2-2.el8.x86_64.rpm 216 kB/s | 187 kB 00:00 2023-08-01T19:51:11.516 INFO:teuthology.orchestra.run.smithi155.stdout:(8/134): ceph-radosgw-17.2.6-823.g893fa35f.el8. 9.1 MB/s | 17 MB 00:01 2023-08-01T19:51:11.675 INFO:teuthology.orchestra.run.smithi155.stdout:(9/134): ceph-selinux-17.2.6-823.g893fa35f.el8. 153 kB/s | 24 kB 00:00 2023-08-01T19:51:11.899 INFO:teuthology.orchestra.run.smithi101.stdout:(45/134): openblas-0.3.15-4.el8.x86_64.rpm 2.6 MB/s | 4.7 MB 00:01 2023-08-01T19:51:12.491 INFO:teuthology.orchestra.run.smithi008.stdout:(8/134): ceph-common-17.2.6-823.g893fa35f.el8.x 2.9 MB/s | 23 MB 00:08 2023-08-01T19:51:12.700 INFO:teuthology.orchestra.run.smithi008.stdout:(9/134): ceph-osd-17.2.6-823.g893fa35f.el8.x86_ 3.1 MB/s | 17 MB 00:05 2023-08-01T19:51:12.725 INFO:teuthology.orchestra.run.smithi008.stdout:(10/134): ceph-selinux-17.2.6-823.g893fa35f.el8 104 kB/s | 24 kB 00:00 2023-08-01T19:51:12.733 INFO:teuthology.orchestra.run.smithi101.stdout:(46/134): python3-babel-2.5.1-7.el8.noarch.rpm 2.6 MB/s | 4.8 MB 00:01 2023-08-01T19:51:12.750 INFO:teuthology.orchestra.run.smithi155.stdout:(10/134): ceph-common-17.2.6-823.g893fa35f.el8. 3.8 MB/s | 23 MB 00:06 2023-08-01T19:51:12.825 INFO:teuthology.orchestra.run.smithi008.stdout:(11/134): libcephfs-devel-17.2.6-823.g893fa35f. 248 kB/s | 25 kB 00:00 2023-08-01T19:51:12.875 INFO:teuthology.orchestra.run.smithi155.stdout:(11/134): libcephfs-devel-17.2.6-823.g893fa35f. 199 kB/s | 25 kB 00:00 2023-08-01T19:51:13.041 INFO:teuthology.orchestra.run.smithi101.stdout:(47/134): openblas-threads-0.3.15-4.el8.x86_64. 2.2 MB/s | 4.9 MB 00:02 2023-08-01T19:51:13.066 INFO:teuthology.orchestra.run.smithi101.stdout:(48/134): python3-jsonpatch-1.21-2.el8.noarch.r 80 kB/s | 27 kB 00:00 2023-08-01T19:51:13.092 INFO:teuthology.orchestra.run.smithi101.stdout:(49/134): python3-jinja2-2.10.1-3.el8.noarch.rp 451 kB/s | 538 kB 00:01 2023-08-01T19:51:13.192 INFO:teuthology.orchestra.run.smithi155.stdout:(12/134): libcephfs2-17.2.6-823.g893fa35f.el8.x 2.5 MB/s | 795 kB 00:00 2023-08-01T19:51:13.234 INFO:teuthology.orchestra.run.smithi008.stdout:(12/134): libcephfs2-17.2.6-823.g893fa35f.el8.x 1.9 MB/s | 795 kB 00:00 2023-08-01T19:51:13.334 INFO:teuthology.orchestra.run.smithi155.stdout:(13/134): libcephsqlite-17.2.6-823.g893fa35f.el 1.2 MB/s | 174 kB 00:00 2023-08-01T19:51:13.367 INFO:teuthology.orchestra.run.smithi101.stdout:(50/134): python3-jsonpointer-1.10-11.el8.noarc 61 kB/s | 20 kB 00:00 2023-08-01T19:51:13.368 INFO:teuthology.orchestra.run.smithi008.stdout:(13/134): libcephsqlite-17.2.6-823.g893fa35f.el 1.3 MB/s | 174 kB 00:00 2023-08-01T19:51:13.409 INFO:teuthology.orchestra.run.smithi101.stdout:(51/134): python3-markupsafe-0.23-19.el8.x86_64 122 kB/s | 39 kB 00:00 2023-08-01T19:51:13.468 INFO:teuthology.orchestra.run.smithi008.stdout:(14/134): librados-devel-17.2.6-823.g893fa35f.e 1.3 MB/s | 130 kB 00:00 2023-08-01T19:51:13.476 INFO:teuthology.orchestra.run.smithi155.stdout:(14/134): librados-devel-17.2.6-823.g893fa35f.e 917 kB/s | 130 kB 00:00 2023-08-01T19:51:13.727 INFO:teuthology.orchestra.run.smithi155.stdout:(15/134): libradosstriper1-17.2.6-823.g893fa35f 2.0 MB/s | 508 kB 00:00 2023-08-01T19:51:13.743 INFO:teuthology.orchestra.run.smithi008.stdout:(15/134): libradosstriper1-17.2.6-823.g893fa35f 1.8 MB/s | 508 kB 00:00 2023-08-01T19:51:13.859 INFO:teuthology.orchestra.run.smithi101.stdout:(52/134): python3-mako-1.0.6-14.el8.noarch.rpm 198 kB/s | 157 kB 00:00 2023-08-01T19:51:14.006 INFO:teuthology.orchestra.run.smithi006.stdout:Extra Packages for Enterprise Linux 853 kB/s | 16 MB 00:18 2023-08-01T19:51:14.185 INFO:teuthology.orchestra.run.smithi101.stdout:(53/134): python3-prettytable-0.7.2-14.el8.noar 135 kB/s | 44 kB 00:00 2023-08-01T19:51:14.302 INFO:teuthology.orchestra.run.smithi155.stdout:(16/134): ceph-osd-17.2.6-823.g893fa35f.el8.x86 3.6 MB/s | 17 MB 00:04 2023-08-01T19:51:14.351 INFO:teuthology.orchestra.run.smithi101.stdout:(54/134): python3-numpy-f2py-1.14.3-10.el8.x86_ 239 kB/s | 225 kB 00:00 2023-08-01T19:51:14.410 INFO:teuthology.orchestra.run.smithi155.stdout:(17/134): python3-ceph-argparse-17.2.6-823.g893 413 kB/s | 45 kB 00:00 2023-08-01T19:51:14.552 INFO:teuthology.orchestra.run.smithi155.stdout:(18/134): python3-ceph-common-17.2.6-823.g893fa 814 kB/s | 115 kB 00:00 2023-08-01T19:51:14.669 INFO:teuthology.orchestra.run.smithi155.stdout:(19/134): python3-cephfs-17.2.6-823.g893fa35f.e 1.6 MB/s | 190 kB 00:00 2023-08-01T19:51:14.820 INFO:teuthology.orchestra.run.smithi155.stdout:(20/134): python3-rados-17.2.6-823.g893fa35f.el 2.4 MB/s | 371 kB 00:00 2023-08-01T19:51:14.852 INFO:teuthology.orchestra.run.smithi101.stdout:(55/134): python3-pyOpenSSL-19.0.0-1.el8.noarch 155 kB/s | 103 kB 00:00 2023-08-01T19:51:15.003 INFO:teuthology.orchestra.run.smithi155.stdout:(21/134): python3-rbd-17.2.6-823.g893fa35f.el8. 1.9 MB/s | 358 kB 00:00 2023-08-01T19:51:15.079 INFO:teuthology.orchestra.run.smithi155.stdout:(22/134): librgw2-17.2.6-823.g893fa35f.el8.x86_ 4.1 MB/s | 5.5 MB 00:01 2023-08-01T19:51:15.085 INFO:teuthology.orchestra.run.smithi101.stdout:(56/134): python3-numpy-1.14.3-10.el8.x86_64.rp 2.2 MB/s | 3.7 MB 00:01 2023-08-01T19:51:15.112 INFO:teuthology.orchestra.run.smithi155.stdout:(23/134): python3-rgw-17.2.6-823.g893fa35f.el8. 984 kB/s | 107 kB 00:00 2023-08-01T19:51:15.187 INFO:teuthology.orchestra.run.smithi155.stdout:(24/134): rbd-fuse-17.2.6-823.g893fa35f.el8.x86 830 kB/s | 90 kB 00:00 2023-08-01T19:51:15.244 INFO:teuthology.orchestra.run.smithi101.stdout:(57/134): python3-pyasn1-0.3.7-6.el8.noarch.rpm 142 kB/s | 126 kB 00:00 2023-08-01T19:51:15.296 INFO:teuthology.orchestra.run.smithi155.stdout:(25/134): rbd-nbd-17.2.6-823.g893fa35f.el8.x86_ 1.6 MB/s | 173 kB 00:00 2023-08-01T19:51:15.430 INFO:teuthology.orchestra.run.smithi155.stdout:(26/134): ceph-grafana-dashboards-17.2.6-823.g8 173 kB/s | 23 kB 00:00 2023-08-01T19:51:15.493 INFO:teuthology.orchestra.run.smithi008.stdout:(16/134): librgw2-17.2.6-823.g893fa35f.el8.x86_ 3.2 MB/s | 5.5 MB 00:01 2023-08-01T19:51:15.539 INFO:teuthology.orchestra.run.smithi155.stdout:(27/134): ceph-mgr-cephadm-17.2.6-823.g893fa35f 1.1 MB/s | 121 kB 00:00 2023-08-01T19:51:15.578 INFO:teuthology.orchestra.run.smithi101.stdout:(58/134): python3-pyasn1-modules-0.3.7-6.el8.no 152 kB/s | 110 kB 00:00 2023-08-01T19:51:15.585 INFO:teuthology.orchestra.run.smithi008.stdout:(17/134): python3-ceph-argparse-17.2.6-823.g893 487 kB/s | 45 kB 00:00 2023-08-01T19:51:15.645 INFO:teuthology.orchestra.run.smithi101.stdout:(59/134): python3-pytz-2017.2-9.el8.noarch.rpm 97 kB/s | 54 kB 00:00 2023-08-01T19:51:15.694 INFO:teuthology.orchestra.run.smithi008.stdout:(18/134): python3-ceph-common-17.2.6-823.g893fa 1.0 MB/s | 115 kB 00:00 2023-08-01T19:51:15.786 INFO:teuthology.orchestra.run.smithi008.stdout:(19/134): python3-cephfs-17.2.6-823.g893fa35f.e 2.0 MB/s | 190 kB 00:00 2023-08-01T19:51:15.922 INFO:teuthology.orchestra.run.smithi155.stdout:(28/134): rbd-mirror-17.2.6-823.g893fa35f.el8.x 4.3 MB/s | 3.5 MB 00:00 2023-08-01T19:51:15.944 INFO:teuthology.orchestra.run.smithi008.stdout:(20/134): python3-rados-17.2.6-823.g893fa35f.el 2.3 MB/s | 371 kB 00:00 2023-08-01T19:51:15.987 INFO:teuthology.orchestra.run.smithi155.stdout:(29/134): ceph-mgr-dashboard-17.2.6-823.g893fa3 3.8 MB/s | 1.7 MB 00:00 2023-08-01T19:51:16.115 INFO:teuthology.orchestra.run.smithi155.stdout:(30/134): ceph-mgr-modules-core-17.2.6-823.g893 1.8 MB/s | 238 kB 00:00 2023-08-01T19:51:16.136 INFO:teuthology.orchestra.run.smithi008.stdout:(21/134): python3-rbd-17.2.6-823.g893fa35f.el8. 1.8 MB/s | 358 kB 00:00 2023-08-01T19:51:16.228 INFO:teuthology.orchestra.run.smithi008.stdout:(22/134): python3-rgw-17.2.6-823.g893fa35f.el8. 1.1 MB/s | 107 kB 00:00 2023-08-01T19:51:16.320 INFO:teuthology.orchestra.run.smithi008.stdout:(23/134): rbd-fuse-17.2.6-823.g893fa35f.el8.x86 985 kB/s | 90 kB 00:00 2023-08-01T19:51:16.615 INFO:teuthology.orchestra.run.smithi155.stdout:(31/134): ceph-test-17.2.6-823.g893fa35f.el8.x8 10 MB/s | 52 MB 00:04 2023-08-01T19:51:16.632 INFO:teuthology.orchestra.run.smithi155.stdout:(32/134): ceph-mgr-rook-17.2.6-823.g893fa35f.el 92 kB/s | 47 kB 00:00 2023-08-01T19:51:16.662 INFO:teuthology.orchestra.run.smithi101.stdout:(60/134): socat-1.7.4.1-1.el8.x86_64.rpm 318 kB/s | 323 kB 00:01 2023-08-01T19:51:16.716 INFO:teuthology.orchestra.run.smithi155.stdout:(33/134): ceph-prometheus-alerts-17.2.6-823.g89 145 kB/s | 14 kB 00:00 2023-08-01T19:51:16.762 INFO:teuthology.orchestra.run.smithi101.stdout:(61/134): python3-werkzeug-0.12.2-4.el8.noarch. 386 kB/s | 457 kB 00:01 2023-08-01T19:51:16.841 INFO:teuthology.orchestra.run.smithi155.stdout:(34/134): ceph-volume-17.2.6-823.g893fa35f.el8. 1.2 MB/s | 264 kB 00:00 2023-08-01T19:51:16.866 INFO:teuthology.orchestra.run.smithi155.stdout:(35/134): cephadm-17.2.6-823.g893fa35f.el8.noar 533 kB/s | 80 kB 00:00 2023-08-01T19:51:17.221 INFO:teuthology.orchestra.run.smithi101.stdout:(62/134): elfutils-libelf-devel-0.189-2.el8.x86 134 kB/s | 61 kB 00:00 2023-08-01T19:51:17.246 INFO:teuthology.orchestra.run.smithi101.stdout:(63/134): xmlstarlet-1.6.1-20.el8.x86_64.rpm 121 kB/s | 71 kB 00:00 2023-08-01T19:51:17.412 INFO:teuthology.orchestra.run.smithi008.stdout:(24/134): rbd-mirror-17.2.6-823.g893fa35f.el8.x 3.2 MB/s | 3.5 MB 00:01 2023-08-01T19:51:17.446 INFO:teuthology.orchestra.run.smithi101.stdout:(64/134): fuse-2.9.7-17.el8.x86_64.rpm 369 kB/s | 83 kB 00:00 2023-08-01T19:51:17.504 INFO:teuthology.orchestra.run.smithi008.stdout:(25/134): rbd-nbd-17.2.6-823.g893fa35f.el8.x86_ 1.9 MB/s | 173 kB 00:00 2023-08-01T19:51:17.596 INFO:teuthology.orchestra.run.smithi008.stdout:(26/134): ceph-grafana-dashboards-17.2.6-823.g8 252 kB/s | 23 kB 00:00 2023-08-01T19:51:17.654 INFO:teuthology.orchestra.run.smithi101.stdout:(65/134): keyutils-libs-devel-1.5.10-9.el8.x86_ 118 kB/s | 48 kB 00:00 2023-08-01T19:51:17.729 INFO:teuthology.orchestra.run.smithi008.stdout:(27/134): ceph-mgr-cephadm-17.2.6-823.g893fa35f 909 kB/s | 121 kB 00:00 2023-08-01T19:51:17.817 INFO:teuthology.orchestra.run.smithi155.stdout:(36/134): ceph-mgr-diskprediction-local-17.2.6- 3.9 MB/s | 7.4 MB 00:01 2023-08-01T19:51:17.913 INFO:teuthology.orchestra.run.smithi101.stdout:(66/134): python3-scipy-1.0.0-21.module_el8.5.0 5.1 MB/s | 14 MB 00:02 2023-08-01T19:51:17.917 INFO:teuthology.orchestra.run.smithi155.stdout:(37/134): automake-1.16.1-7.el8.noarch.rpm 664 kB/s | 713 kB 00:01 2023-08-01T19:51:17.938 INFO:teuthology.orchestra.run.smithi101.stdout:(67/134): libaio-devel-0.3.112-1.el8.x86_64.rpm 66 kB/s | 19 kB 00:00 2023-08-01T19:51:17.964 INFO:teuthology.orchestra.run.smithi101.stdout:(68/134): krb5-devel-1.18.2-22.el8.x86_64.rpm 1.1 MB/s | 561 kB 00:00 2023-08-01T19:51:18.029 INFO:teuthology.orchestra.run.smithi006.stdout:lab-extras 244 kB/s | 24 kB 00:00 2023-08-01T19:51:18.105 INFO:teuthology.orchestra.run.smithi101.stdout:(69/134): libquadmath-8.5.0-20.el8.x86_64.rpm 1.2 MB/s | 172 kB 00:00 2023-08-01T19:51:18.163 INFO:teuthology.orchestra.run.smithi008.stdout:(28/134): ceph-radosgw-17.2.6-823.g893fa35f.el8 1.8 MB/s | 17 MB 00:09 2023-08-01T19:51:18.176 INFO:teuthology.orchestra.run.smithi155.stdout:(38/134): bison-3.0.4-10.el8.x86_64.rpm 526 kB/s | 688 kB 00:01 2023-08-01T19:51:18.205 INFO:teuthology.orchestra.run.smithi008.stdout:(29/134): ceph-mgr-dashboard-17.2.6-823.g893fa3 3.6 MB/s | 1.7 MB 00:00 2023-08-01T19:51:18.231 INFO:teuthology.orchestra.run.smithi101.stdout:(70/134): librabbitmq-0.9.0-4.el8.x86_64.rpm 376 kB/s | 47 kB 00:00 2023-08-01T19:51:18.272 INFO:teuthology.orchestra.run.smithi008.stdout:(30/134): ceph-mgr-modules-core-17.2.6-823.g893 3.5 MB/s | 238 kB 00:00 2023-08-01T19:51:18.281 INFO:teuthology.orchestra.run.smithi101.stdout:(71/134): libcom_err-devel-1.45.6-5.el8.x86_64. 105 kB/s | 39 kB 00:00 2023-08-01T19:51:18.373 INFO:teuthology.orchestra.run.smithi101.stdout:(72/134): libselinux-devel-2.9-8.el8.x86_64.rpm 1.4 MB/s | 200 kB 00:00 2023-08-01T19:51:18.407 INFO:teuthology.orchestra.run.smithi101.stdout:(73/134): libgfortran-8.5.0-20.el8.x86_64.rpm 1.3 MB/s | 645 kB 00:00 2023-08-01T19:51:18.489 INFO:teuthology.orchestra.run.smithi008.stdout:(31/134): ceph-mgr-rook-17.2.6-823.g893fa35f.el 218 kB/s | 47 kB 00:00 2023-08-01T19:51:18.507 INFO:teuthology.orchestra.run.smithi101.stdout:(74/134): libuuid-devel-2.32.1-42.el8.x86_64.rp 745 kB/s | 99 kB 00:00 2023-08-01T19:51:18.532 INFO:teuthology.orchestra.run.smithi101.stdout:(75/134): libverto-devel-0.3.2-2.el8.x86_64.rpm 144 kB/s | 18 kB 00:00 2023-08-01T19:51:18.566 INFO:teuthology.orchestra.run.smithi101.stdout:(76/134): libsepol-devel-2.9-3.el8.x86_64.rpm 306 kB/s | 87 kB 00:00 2023-08-01T19:51:18.573 INFO:teuthology.orchestra.run.smithi008.stdout:(32/134): ceph-prometheus-alerts-17.2.6-823.g89 174 kB/s | 14 kB 00:00 2023-08-01T19:51:18.632 INFO:teuthology.orchestra.run.smithi101.stdout:(77/134): libzstd-devel-1.4.4-1.el8.x86_64.rpm 349 kB/s | 44 kB 00:00 2023-08-01T19:51:18.634 INFO:teuthology.orchestra.run.smithi155.stdout:(39/134): flex-2.6.1-9.el8.x86_64.rpm 391 kB/s | 320 kB 00:00 2023-08-01T19:51:18.732 INFO:teuthology.orchestra.run.smithi008.stdout:(33/134): ceph-volume-17.2.6-823.g893fa35f.el8. 1.6 MB/s | 264 kB 00:00 2023-08-01T19:51:18.791 INFO:teuthology.orchestra.run.smithi101.stdout:(78/134): pcre2-utf16-10.32-3.el8.x86_64.rpm 1.4 MB/s | 229 kB 00:00 2023-08-01T19:51:18.809 INFO:teuthology.orchestra.run.smithi155.stdout:(40/134): jq-1.6-7.el8.x86_64.rpm 227 kB/s | 202 kB 00:00 2023-08-01T19:51:18.823 INFO:teuthology.orchestra.run.smithi008.stdout:(34/134): cephadm-17.2.6-823.g893fa35f.el8.noar 876 kB/s | 80 kB 00:00 2023-08-01T19:51:18.958 INFO:teuthology.orchestra.run.smithi101.stdout:(79/134): openssl-devel-1.1.1k-9.el8.x86_64.rpm 7.5 MB/s | 3.2 MB 00:00 2023-08-01T19:51:18.983 INFO:teuthology.orchestra.run.smithi101.stdout:(80/134): pcre2-devel-10.32-3.el8.x86_64.rpm 1.4 MB/s | 605 kB 00:00 2023-08-01T19:51:19.008 INFO:teuthology.orchestra.run.smithi101.stdout:(81/134): pcre2-utf32-10.32-3.el8.x86_64.rpm 1.0 MB/s | 220 kB 00:00 2023-08-01T19:51:19.084 INFO:teuthology.orchestra.run.smithi101.stdout:(82/134): python3-cffi-1.11.5-6.el8.x86_64.rpm 1.9 MB/s | 249 kB 00:00 2023-08-01T19:51:19.134 INFO:teuthology.orchestra.run.smithi101.stdout:(83/134): python3-jwt-1.6.1-2.el8.noarch.rpm 341 kB/s | 43 kB 00:00 2023-08-01T19:51:19.135 INFO:teuthology.orchestra.run.smithi155.stdout:(41/134): librdkafka-0.11.4-3.el8.x86_64.rpm 369 kB/s | 354 kB 00:00 2023-08-01T19:51:19.418 INFO:teuthology.orchestra.run.smithi101.stdout:(84/134): python3-cryptography-3.2.1-6.el8.x86_ 1.5 MB/s | 641 kB 00:00 2023-08-01T19:51:19.443 INFO:teuthology.orchestra.run.smithi101.stdout:(85/134): python3-oauthlib-2.1.0-1.el8.noarch.r 431 kB/s | 155 kB 00:00 2023-08-01T19:51:19.460 INFO:teuthology.orchestra.run.smithi101.stdout:(86/134): python3-pycparser-2.14-14.el8.noarch. 335 kB/s | 109 kB 00:00 2023-08-01T19:51:19.543 INFO:teuthology.orchestra.run.smithi101.stdout:(87/134): python3-requests-oauthlib-1.0.0-1.el8 340 kB/s | 43 kB 00:00 2023-08-01T19:51:19.599 INFO:teuthology.orchestra.run.smithi101.stdout:(88/134): xfsprogs-devel-5.0.0-12.el8.x86_64.rp 480 kB/s | 74 kB 00:00 2023-08-01T19:51:19.628 INFO:teuthology.orchestra.run.smithi101.stdout:(89/134): zlib-devel-1.2.11-21.el8.x86_64.rpm 347 kB/s | 58 kB 00:00 2023-08-01T19:51:19.801 INFO:teuthology.orchestra.run.smithi155.stdout:(42/134): lttng-ust-2.8.1-11.el8.x86_64.rpm 262 kB/s | 259 kB 00:00 2023-08-01T19:51:19.910 INFO:teuthology.orchestra.run.smithi155.stdout:(43/134): libtool-2.4.6-25.el8.x86_64.rpm 556 kB/s | 709 kB 00:01 2023-08-01T19:51:19.911 INFO:teuthology.orchestra.run.smithi101.stdout:(90/134): liboath-2.6.2-3.el8.x86_64.rpm 188 kB/s | 59 kB 00:00 2023-08-01T19:51:19.945 INFO:teuthology.orchestra.run.smithi101.stdout:(91/134): libunwind-1.3.1-3.el8.x86_64.rpm 237 kB/s | 75 kB 00:00 2023-08-01T19:51:20.011 INFO:teuthology.orchestra.run.smithi155.stdout:(44/134): oniguruma-6.8.2-2.el8.x86_64.rpm 214 kB/s | 187 kB 00:00 2023-08-01T19:51:20.045 INFO:teuthology.orchestra.run.smithi101.stdout:(92/134): python3-bcrypt-3.1.6-2.el8.1.x86_64.r 436 kB/s | 44 kB 00:00 2023-08-01T19:51:20.070 INFO:teuthology.orchestra.run.smithi101.stdout:(93/134): gperftools-libs-2.7-9.el8.x86_64.rpm 582 kB/s | 306 kB 00:00 2023-08-01T19:51:20.162 INFO:teuthology.orchestra.run.smithi101.stdout:(94/134): python3-cachetools-3.1.1-4.el8.noarch 360 kB/s | 33 kB 00:00 2023-08-01T19:51:20.165 INFO:teuthology.orchestra.run.smithi008.stdout:(35/134): automake-1.16.1-7.el8.noarch.rpm 532 kB/s | 713 kB 00:01 2023-08-01T19:51:20.213 INFO:teuthology.orchestra.run.smithi101.stdout:(95/134): python3-beautifulsoup4-4.6.3-2.el8.1. 1.1 MB/s | 185 kB 00:00 2023-08-01T19:51:20.246 INFO:teuthology.orchestra.run.smithi101.stdout:(96/134): python3-asyncssh-2.7.0-2.el8.noarch.r 1.4 MB/s | 476 kB 00:00 2023-08-01T19:51:20.271 INFO:teuthology.orchestra.run.smithi101.stdout:(97/134): python3-certifi-2018.10.15-7.el8.noar 150 kB/s | 16 kB 00:00 2023-08-01T19:51:20.313 INFO:teuthology.orchestra.run.smithi101.stdout:(98/134): python3-cheroot-8.5.2-1.el8.noarch.rp 1.7 MB/s | 173 kB 00:00 2023-08-01T19:51:20.347 INFO:teuthology.orchestra.run.smithi101.stdout:(99/134): python3-cherrypy-18.4.0-1.el8.noarch. 3.7 MB/s | 384 kB 00:00 2023-08-01T19:51:20.372 INFO:teuthology.orchestra.run.smithi101.stdout:(100/134): python3-google-auth-1.1.1-10.el8.noa 809 kB/s | 81 kB 00:00 2023-08-01T19:51:20.438 INFO:teuthology.orchestra.run.smithi101.stdout:(101/134): python3-jaraco-6.2-6.el8.noarch.rpm 89 kB/s | 11 kB 00:00 2023-08-01T19:51:20.464 INFO:teuthology.orchestra.run.smithi101.stdout:(102/134): python3-jaraco-functools-2.0-4.el8.n 150 kB/s | 18 kB 00:00 2023-08-01T19:51:20.539 INFO:teuthology.orchestra.run.smithi101.stdout:(103/134): python3-logutils-0.3.5-11.el8.noarch 480 kB/s | 49 kB 00:00 2023-08-01T19:51:20.565 INFO:teuthology.orchestra.run.smithi101.stdout:(104/134): python3-more-itertools-7.2.0-3.el8.n 586 kB/s | 59 kB 00:00 2023-08-01T19:51:20.623 INFO:teuthology.orchestra.run.smithi101.stdout:(105/134): python3-kubernetes-11.0.0-6.el8.noar 4.6 MB/s | 1.2 MB 00:00 2023-08-01T19:51:20.648 INFO:teuthology.orchestra.run.smithi101.stdout:(106/134): python3-natsort-7.1.1-2.el8.noarch.r 554 kB/s | 60 kB 00:00 2023-08-01T19:51:20.674 INFO:teuthology.orchestra.run.smithi101.stdout:(107/134): python3-pecan-1.3.2-9.el8.noarch.rpm 2.5 MB/s | 283 kB 00:00 2023-08-01T19:51:20.716 INFO:teuthology.orchestra.run.smithi101.stdout:(108/134): python3-portend-2.6-1.el8.noarch.rpm 169 kB/s | 16 kB 00:00 2023-08-01T19:51:20.749 INFO:teuthology.orchestra.run.smithi101.stdout:(109/134): python3-repoze-lru-0.7-6.el8.noarch. 334 kB/s | 34 kB 00:00 2023-08-01T19:51:20.775 INFO:teuthology.orchestra.run.smithi101.stdout:(110/134): python3-routes-2.4.1-12.el8.noarch.r 1.9 MB/s | 196 kB 00:00 2023-08-01T19:51:20.808 INFO:teuthology.orchestra.run.smithi101.stdout:(111/134): python3-rsa-4.9-2.el8.noarch.rpm 698 kB/s | 64 kB 00:00 2023-08-01T19:51:20.842 INFO:teuthology.orchestra.run.smithi101.stdout:(112/134): python3-simplegeneric-0.8.1-17.el8.n 203 kB/s | 19 kB 00:00 2023-08-01T19:51:20.868 INFO:teuthology.orchestra.run.smithi101.stdout:(113/134): python3-singledispatch-3.4.0.3-18.el 259 kB/s | 24 kB 00:00 2023-08-01T19:51:20.892 INFO:teuthology.orchestra.run.smithi101.stdout:(114/134): python3-tempora-1.14.1-5.el8.noarch. 348 kB/s | 29 kB 00:00 2023-08-01T19:51:20.934 INFO:teuthology.orchestra.run.smithi101.stdout:(115/134): python3-trustme-0.6.0-4.el8.noarch.r 299 kB/s | 27 kB 00:00 2023-08-01T19:51:20.968 INFO:teuthology.orchestra.run.smithi101.stdout:(116/134): python3-waitress-1.4.3-1.el8.noarch. 2.5 MB/s | 255 kB 00:00 2023-08-01T19:51:20.993 INFO:teuthology.orchestra.run.smithi101.stdout:(117/134): python3-webob-1.8.5-1.el8.1.noarch.r 2.4 MB/s | 251 kB 00:00 2023-08-01T19:51:21.027 INFO:teuthology.orchestra.run.smithi101.stdout:(118/134): python3-websocket-client-0.56.0-5.el 664 kB/s | 61 kB 00:00 2023-08-01T19:51:21.060 INFO:teuthology.orchestra.run.smithi101.stdout:(119/134): python3-webtest-2.0.33-1.el8.noarch. 925 kB/s | 85 kB 00:00 2023-08-01T19:51:21.086 INFO:teuthology.orchestra.run.smithi101.stdout:(120/134): python3-zc-lockfile-2.0-2.el8.noarch 248 kB/s | 23 kB 00:00 2023-08-01T19:51:21.257 INFO:teuthology.orchestra.run.smithi008.stdout:(36/134): bison-3.0.4-10.el8.x86_64.rpm 631 kB/s | 688 kB 00:01 2023-08-01T19:51:21.303 INFO:teuthology.orchestra.run.smithi101.stdout:(121/134): thrift-0.13.0-2.el8.x86_64.rpm 6.3 MB/s | 1.7 MB 00:00 2023-08-01T19:51:21.428 INFO:teuthology.orchestra.run.smithi101.stdout:(122/134): elfutils-debuginfod-client-0.189-2.e 607 kB/s | 76 kB 00:00 2023-08-01T19:51:21.478 INFO:teuthology.orchestra.run.smithi155.stdout:(45/134): openblas-0.3.15-4.el8.x86_64.rpm 2.8 MB/s | 4.7 MB 00:01 2023-08-01T19:51:21.578 INFO:teuthology.orchestra.run.smithi101.stdout:(123/134): elfutils-libelf-0.189-2.el8.x86_64.r 1.5 MB/s | 232 kB 00:00 2023-08-01T19:51:21.661 INFO:teuthology.orchestra.run.smithi155.stdout:(46/134): openblas-threads-0.3.15-4.el8.x86_64. 2.8 MB/s | 4.9 MB 00:01 2023-08-01T19:51:21.729 INFO:teuthology.orchestra.run.smithi101.stdout:(124/134): elfutils-libs-0.189-2.el8.x86_64.rpm 2.0 MB/s | 302 kB 00:00 2023-08-01T19:51:21.816 INFO:teuthology.orchestra.run.smithi008.stdout:(37/134): ceph-mgr-diskprediction-local-17.2.6- 2.0 MB/s | 7.4 MB 00:03 2023-08-01T19:51:21.871 INFO:teuthology.orchestra.run.smithi101.stdout:(125/134): libblkid-2.32.1-42.el8.x86_64.rpm 1.5 MB/s | 220 kB 00:00 2023-08-01T19:51:22.019 INFO:teuthology.orchestra.run.smithi155.stdout:(47/134): python3-jsonpatch-1.21-2.el8.noarch.r 74 kB/s | 27 kB 00:00 2023-08-01T19:51:22.021 INFO:teuthology.orchestra.run.smithi101.stdout:(126/134): libfdisk-2.32.1-42.el8.x86_64.rpm 1.7 MB/s | 253 kB 00:00 2023-08-01T19:51:22.171 INFO:teuthology.orchestra.run.smithi101.stdout:(127/134): libmount-2.32.1-42.el8.x86_64.rpm 1.5 MB/s | 236 kB 00:00 2023-08-01T19:51:22.186 INFO:teuthology.orchestra.run.smithi006.stdout:Package librados2-1:12.2.7-9.el8.x86_64 is already installed. 2023-08-01T19:51:22.187 INFO:teuthology.orchestra.run.smithi006.stdout:Package librbd1-1:12.2.7-9.el8.x86_64 is already installed. 2023-08-01T19:51:22.224 INFO:teuthology.orchestra.run.smithi008.stdout:(38/134): flex-2.6.1-9.el8.x86_64.rpm 331 kB/s | 320 kB 00:00 2023-08-01T19:51:22.245 INFO:teuthology.orchestra.run.smithi155.stdout:(48/134): python3-babel-2.5.1-7.el8.noarch.rpm 2.1 MB/s | 4.8 MB 00:02 2023-08-01T19:51:22.313 INFO:teuthology.orchestra.run.smithi101.stdout:(128/134): libsmartcols-2.32.1-42.el8.x86_64.rp 1.2 MB/s | 179 kB 00:00 2023-08-01T19:51:22.382 INFO:teuthology.orchestra.run.smithi155.stdout:(49/134): python3-jsonpointer-1.10-11.el8.noarc 55 kB/s | 20 kB 00:00 2023-08-01T19:51:22.389 INFO:teuthology.orchestra.run.smithi006.stdout:Dependencies resolved. 2023-08-01T19:51:22.403 INFO:teuthology.orchestra.run.smithi006.stdout:================================================================================================ 2023-08-01T19:51:22.403 INFO:teuthology.orchestra.run.smithi006.stdout: Package Arch Version Repository Size 2023-08-01T19:51:22.404 INFO:teuthology.orchestra.run.smithi006.stdout:================================================================================================ 2023-08-01T19:51:22.404 INFO:teuthology.orchestra.run.smithi006.stdout:Installing: 2023-08-01T19:51:22.404 INFO:teuthology.orchestra.run.smithi006.stdout: bison x86_64 3.0.4-10.el8 appstream 688 k 2023-08-01T19:51:22.404 INFO:teuthology.orchestra.run.smithi006.stdout: ceph x86_64 2:17.2.6-823.g893fa35f.el8 ceph 6.4 k 2023-08-01T19:51:22.404 INFO:teuthology.orchestra.run.smithi006.stdout: ceph-base x86_64 2:17.2.6-823.g893fa35f.el8 ceph 5.2 M 2023-08-01T19:51:22.404 INFO:teuthology.orchestra.run.smithi006.stdout: ceph-fuse x86_64 2:17.2.6-823.g893fa35f.el8 ceph 874 k 2023-08-01T19:51:22.404 INFO:teuthology.orchestra.run.smithi006.stdout: ceph-immutable-object-cache x86_64 2:17.2.6-823.g893fa35f.el8 ceph 162 k 2023-08-01T19:51:22.405 INFO:teuthology.orchestra.run.smithi006.stdout: ceph-mgr x86_64 2:17.2.6-823.g893fa35f.el8 ceph 1.6 M 2023-08-01T19:51:22.405 INFO:teuthology.orchestra.run.smithi006.stdout: ceph-mgr-cephadm noarch 2:17.2.6-823.g893fa35f.el8 ceph-noarch 121 k 2023-08-01T19:51:22.405 INFO:teuthology.orchestra.run.smithi006.stdout: ceph-mgr-dashboard noarch 2:17.2.6-823.g893fa35f.el8 ceph-noarch 1.7 M 2023-08-01T19:51:22.405 INFO:teuthology.orchestra.run.smithi006.stdout: ceph-mgr-diskprediction-local noarch 2:17.2.6-823.g893fa35f.el8 ceph-noarch 7.4 M 2023-08-01T19:51:22.405 INFO:teuthology.orchestra.run.smithi006.stdout: ceph-mgr-rook noarch 2:17.2.6-823.g893fa35f.el8 ceph-noarch 47 k 2023-08-01T19:51:22.405 INFO:teuthology.orchestra.run.smithi006.stdout: ceph-radosgw x86_64 2:17.2.6-823.g893fa35f.el8 ceph 17 M 2023-08-01T19:51:22.405 INFO:teuthology.orchestra.run.smithi006.stdout: ceph-test x86_64 2:17.2.6-823.g893fa35f.el8 ceph 52 M 2023-08-01T19:51:22.406 INFO:teuthology.orchestra.run.smithi006.stdout: ceph-volume noarch 2:17.2.6-823.g893fa35f.el8 ceph-noarch 264 k 2023-08-01T19:51:22.406 INFO:teuthology.orchestra.run.smithi006.stdout: cephadm noarch 2:17.2.6-823.g893fa35f.el8 ceph-noarch 80 k 2023-08-01T19:51:22.406 INFO:teuthology.orchestra.run.smithi006.stdout: elfutils-libelf-devel x86_64 0.189-2.el8 baseos 61 k 2023-08-01T19:51:22.406 INFO:teuthology.orchestra.run.smithi006.stdout: flex x86_64 2.6.1-9.el8 appstream 320 k 2023-08-01T19:51:22.406 INFO:teuthology.orchestra.run.smithi006.stdout: libaio-devel x86_64 0.3.112-1.el8 baseos 19 k 2023-08-01T19:51:22.406 INFO:teuthology.orchestra.run.smithi006.stdout: libcephfs-devel x86_64 2:17.2.6-823.g893fa35f.el8 ceph 25 k 2023-08-01T19:51:22.407 INFO:teuthology.orchestra.run.smithi006.stdout: libcephfs2 x86_64 2:17.2.6-823.g893fa35f.el8 ceph 795 k 2023-08-01T19:51:22.407 INFO:teuthology.orchestra.run.smithi006.stdout: librados-devel x86_64 2:17.2.6-823.g893fa35f.el8 ceph 130 k 2023-08-01T19:51:22.407 INFO:teuthology.orchestra.run.smithi006.stdout: libtool x86_64 2.4.6-25.el8 appstream 709 k 2023-08-01T19:51:22.407 INFO:teuthology.orchestra.run.smithi006.stdout: libuuid-devel x86_64 2.32.1-42.el8 baseos 99 k 2023-08-01T19:51:22.407 INFO:teuthology.orchestra.run.smithi006.stdout: openssl-devel x86_64 1:1.1.1k-9.el8 baseos 3.2 M 2023-08-01T19:51:22.407 INFO:teuthology.orchestra.run.smithi006.stdout: python3-cephfs x86_64 2:17.2.6-823.g893fa35f.el8 ceph 190 k 2023-08-01T19:51:22.407 INFO:teuthology.orchestra.run.smithi006.stdout: python3-rados x86_64 2:17.2.6-823.g893fa35f.el8 ceph 371 k 2023-08-01T19:51:22.408 INFO:teuthology.orchestra.run.smithi006.stdout: python3-rbd x86_64 2:17.2.6-823.g893fa35f.el8 ceph 358 k 2023-08-01T19:51:22.408 INFO:teuthology.orchestra.run.smithi006.stdout: python3-rgw x86_64 2:17.2.6-823.g893fa35f.el8 ceph 107 k 2023-08-01T19:51:22.408 INFO:teuthology.orchestra.run.smithi006.stdout: rbd-fuse x86_64 2:17.2.6-823.g893fa35f.el8 ceph 90 k 2023-08-01T19:51:22.408 INFO:teuthology.orchestra.run.smithi006.stdout: rbd-mirror x86_64 2:17.2.6-823.g893fa35f.el8 ceph 3.5 M 2023-08-01T19:51:22.408 INFO:teuthology.orchestra.run.smithi006.stdout: rbd-nbd x86_64 2:17.2.6-823.g893fa35f.el8 ceph 173 k 2023-08-01T19:51:22.408 INFO:teuthology.orchestra.run.smithi006.stdout: xfsprogs-devel x86_64 5.0.0-12.el8 baseos 74 k 2023-08-01T19:51:22.408 INFO:teuthology.orchestra.run.smithi006.stdout:Upgrading: 2023-08-01T19:51:22.408 INFO:teuthology.orchestra.run.smithi006.stdout: elfutils-debuginfod-client x86_64 0.189-2.el8 baseos 76 k 2023-08-01T19:51:22.409 INFO:teuthology.orchestra.run.smithi006.stdout: elfutils-libelf x86_64 0.189-2.el8 baseos 232 k 2023-08-01T19:51:22.409 INFO:teuthology.orchestra.run.smithi006.stdout: elfutils-libs x86_64 0.189-2.el8 baseos 302 k 2023-08-01T19:51:22.409 INFO:teuthology.orchestra.run.smithi006.stdout: libblkid x86_64 2.32.1-42.el8 baseos 220 k 2023-08-01T19:51:22.409 INFO:teuthology.orchestra.run.smithi006.stdout: libfdisk x86_64 2.32.1-42.el8 baseos 253 k 2023-08-01T19:51:22.409 INFO:teuthology.orchestra.run.smithi006.stdout: libmount x86_64 2.32.1-42.el8 baseos 236 k 2023-08-01T19:51:22.409 INFO:teuthology.orchestra.run.smithi006.stdout: librados2 x86_64 2:17.2.6-823.g893fa35f.el8 ceph 3.5 M 2023-08-01T19:51:22.409 INFO:teuthology.orchestra.run.smithi006.stdout: librbd1 x86_64 2:17.2.6-823.g893fa35f.el8 ceph 3.6 M 2023-08-01T19:51:22.410 INFO:teuthology.orchestra.run.smithi006.stdout: libsmartcols x86_64 2.32.1-42.el8 baseos 179 k 2023-08-01T19:51:22.410 INFO:teuthology.orchestra.run.smithi006.stdout: libuuid x86_64 2.32.1-42.el8 baseos 98 k 2023-08-01T19:51:22.410 INFO:teuthology.orchestra.run.smithi006.stdout: util-linux x86_64 2.32.1-42.el8 baseos 2.6 M 2023-08-01T19:51:22.410 INFO:teuthology.orchestra.run.smithi006.stdout: util-linux-user x86_64 2.32.1-42.el8 baseos 102 k 2023-08-01T19:51:22.410 INFO:teuthology.orchestra.run.smithi006.stdout: xfsprogs x86_64 5.0.0-12.el8 baseos 1.1 M 2023-08-01T19:51:22.410 INFO:teuthology.orchestra.run.smithi006.stdout:Installing dependencies: 2023-08-01T19:51:22.410 INFO:teuthology.orchestra.run.smithi006.stdout: automake noarch 1.16.1-7.el8 appstream 713 k 2023-08-01T19:51:22.410 INFO:teuthology.orchestra.run.smithi006.stdout: ceph-common x86_64 2:17.2.6-823.g893fa35f.el8 ceph 23 M 2023-08-01T19:51:22.411 INFO:teuthology.orchestra.run.smithi006.stdout: ceph-grafana-dashboards noarch 2:17.2.6-823.g893fa35f.el8 ceph-noarch 23 k 2023-08-01T19:51:22.411 INFO:teuthology.orchestra.run.smithi006.stdout: ceph-mds x86_64 2:17.2.6-823.g893fa35f.el8 ceph 2.3 M 2023-08-01T19:51:22.411 INFO:teuthology.orchestra.run.smithi006.stdout: ceph-mgr-modules-core noarch 2:17.2.6-823.g893fa35f.el8 ceph-noarch 238 k 2023-08-01T19:51:22.411 INFO:teuthology.orchestra.run.smithi006.stdout: ceph-mon x86_64 2:17.2.6-823.g893fa35f.el8 ceph 3.9 M 2023-08-01T19:51:22.411 INFO:teuthology.orchestra.run.smithi006.stdout: ceph-osd x86_64 2:17.2.6-823.g893fa35f.el8 ceph 17 M 2023-08-01T19:51:22.411 INFO:teuthology.orchestra.run.smithi006.stdout: ceph-prometheus-alerts noarch 2:17.2.6-823.g893fa35f.el8 ceph-noarch 14 k 2023-08-01T19:51:22.411 INFO:teuthology.orchestra.run.smithi006.stdout: ceph-selinux x86_64 2:17.2.6-823.g893fa35f.el8 ceph 24 k 2023-08-01T19:51:22.412 INFO:teuthology.orchestra.run.smithi006.stdout: fuse x86_64 2.9.7-17.el8 baseos 83 k 2023-08-01T19:51:22.412 INFO:teuthology.orchestra.run.smithi006.stdout: gperftools-libs x86_64 1:2.7-9.el8 epel 306 k 2023-08-01T19:51:22.412 INFO:teuthology.orchestra.run.smithi006.stdout: jq x86_64 1.6-7.el8 appstream 202 k 2023-08-01T19:51:22.412 INFO:teuthology.orchestra.run.smithi006.stdout: keyutils-libs-devel x86_64 1.5.10-9.el8 baseos 48 k 2023-08-01T19:51:22.412 INFO:teuthology.orchestra.run.smithi006.stdout: krb5-devel x86_64 1.18.2-22.el8 baseos 561 k 2023-08-01T19:51:22.412 INFO:teuthology.orchestra.run.smithi006.stdout: libcephsqlite x86_64 2:17.2.6-823.g893fa35f.el8 ceph 174 k 2023-08-01T19:51:22.412 INFO:teuthology.orchestra.run.smithi006.stdout: libcom_err-devel x86_64 1.45.6-5.el8 baseos 39 k 2023-08-01T19:51:22.412 INFO:teuthology.orchestra.run.smithi006.stdout: libgfortran x86_64 8.5.0-20.el8 baseos 645 k 2023-08-01T19:51:22.413 INFO:teuthology.orchestra.run.smithi006.stdout: liboath x86_64 2.6.2-3.el8 epel 59 k 2023-08-01T19:51:22.413 INFO:teuthology.orchestra.run.smithi006.stdout: libquadmath x86_64 8.5.0-20.el8 baseos 172 k 2023-08-01T19:51:22.413 INFO:teuthology.orchestra.run.smithi006.stdout: librabbitmq x86_64 0.9.0-4.el8 baseos 47 k 2023-08-01T19:51:22.413 INFO:teuthology.orchestra.run.smithi006.stdout: libradosstriper1 x86_64 2:17.2.6-823.g893fa35f.el8 ceph 508 k 2023-08-01T19:51:22.413 INFO:teuthology.orchestra.run.smithi006.stdout: librdkafka x86_64 0.11.4-3.el8 appstream 354 k 2023-08-01T19:51:22.413 INFO:teuthology.orchestra.run.smithi006.stdout: librgw2 x86_64 2:17.2.6-823.g893fa35f.el8 ceph 5.5 M 2023-08-01T19:51:22.413 INFO:teuthology.orchestra.run.smithi006.stdout: libselinux-devel x86_64 2.9-8.el8 baseos 200 k 2023-08-01T19:51:22.413 INFO:teuthology.orchestra.run.smithi006.stdout: libsepol-devel x86_64 2.9-3.el8 baseos 87 k 2023-08-01T19:51:22.414 INFO:teuthology.orchestra.run.smithi006.stdout: libunwind x86_64 1.3.1-3.el8 epel 75 k 2023-08-01T19:51:22.414 INFO:teuthology.orchestra.run.smithi006.stdout: libverto-devel x86_64 0.3.2-2.el8 baseos 18 k 2023-08-01T19:51:22.414 INFO:teuthology.orchestra.run.smithi006.stdout: libzstd-devel x86_64 1.4.4-1.el8 baseos 44 k 2023-08-01T19:51:22.414 INFO:teuthology.orchestra.run.smithi006.stdout: lttng-ust x86_64 2.8.1-11.el8 appstream 259 k 2023-08-01T19:51:22.414 INFO:teuthology.orchestra.run.smithi006.stdout: oniguruma x86_64 6.8.2-2.el8 appstream 187 k 2023-08-01T19:51:22.414 INFO:teuthology.orchestra.run.smithi006.stdout: openblas x86_64 0.3.15-4.el8 appstream 4.7 M 2023-08-01T19:51:22.414 INFO:teuthology.orchestra.run.smithi006.stdout: openblas-threads x86_64 0.3.15-4.el8 appstream 4.9 M 2023-08-01T19:51:22.414 INFO:teuthology.orchestra.run.smithi006.stdout: pcre2-devel x86_64 10.32-3.el8 baseos 605 k 2023-08-01T19:51:22.415 INFO:teuthology.orchestra.run.smithi006.stdout: pcre2-utf16 x86_64 10.32-3.el8 baseos 229 k 2023-08-01T19:51:22.415 INFO:teuthology.orchestra.run.smithi006.stdout: pcre2-utf32 x86_64 10.32-3.el8 baseos 220 k 2023-08-01T19:51:22.415 INFO:teuthology.orchestra.run.smithi006.stdout: python3-asyncssh noarch 2.7.0-2.el8 epel 476 k 2023-08-01T19:51:22.415 INFO:teuthology.orchestra.run.smithi006.stdout: python3-babel noarch 2.5.1-7.el8 appstream 4.8 M 2023-08-01T19:51:22.415 INFO:teuthology.orchestra.run.smithi006.stdout: python3-bcrypt x86_64 3.1.6-2.el8.1 epel 44 k 2023-08-01T19:51:22.415 INFO:teuthology.orchestra.run.smithi006.stdout: python3-beautifulsoup4 noarch 4.6.3-2.el8.1 epel 185 k 2023-08-01T19:51:22.416 INFO:teuthology.orchestra.run.smithi006.stdout: python3-cachetools noarch 3.1.1-4.el8 epel 33 k 2023-08-01T19:51:22.416 INFO:teuthology.orchestra.run.smithi006.stdout: python3-ceph-argparse x86_64 2:17.2.6-823.g893fa35f.el8 ceph 45 k 2023-08-01T19:51:22.416 INFO:teuthology.orchestra.run.smithi006.stdout: python3-ceph-common x86_64 2:17.2.6-823.g893fa35f.el8 ceph 115 k 2023-08-01T19:51:22.416 INFO:teuthology.orchestra.run.smithi006.stdout: python3-certifi noarch 2018.10.15-7.el8 epel 16 k 2023-08-01T19:51:22.417 INFO:teuthology.orchestra.run.smithi006.stdout: python3-cffi x86_64 1.11.5-6.el8 baseos 249 k 2023-08-01T19:51:22.417 INFO:teuthology.orchestra.run.smithi006.stdout: python3-cheroot noarch 8.5.2-1.el8 epel 173 k 2023-08-01T19:51:22.417 INFO:teuthology.orchestra.run.smithi006.stdout: python3-cherrypy noarch 18.4.0-1.el8 epel 384 k 2023-08-01T19:51:22.417 INFO:teuthology.orchestra.run.smithi006.stdout: python3-cryptography x86_64 3.2.1-6.el8 baseos 641 k 2023-08-01T19:51:22.417 INFO:teuthology.orchestra.run.smithi006.stdout: python3-google-auth noarch 1:1.1.1-10.el8 epel 81 k 2023-08-01T19:51:22.417 INFO:teuthology.orchestra.run.smithi006.stdout: python3-jaraco noarch 6.2-6.el8 epel 11 k 2023-08-01T19:51:22.417 INFO:teuthology.orchestra.run.smithi006.stdout: python3-jaraco-functools noarch 2.0-4.el8 epel 18 k 2023-08-01T19:51:22.418 INFO:teuthology.orchestra.run.smithi006.stdout: python3-jinja2 noarch 2.10.1-3.el8 appstream 538 k 2023-08-01T19:51:22.418 INFO:teuthology.orchestra.run.smithi006.stdout: python3-jsonpatch noarch 1.21-2.el8 appstream 27 k 2023-08-01T19:51:22.418 INFO:teuthology.orchestra.run.smithi006.stdout: python3-jsonpointer noarch 1.10-11.el8 appstream 20 k 2023-08-01T19:51:22.418 INFO:teuthology.orchestra.run.smithi006.stdout: python3-jwt noarch 1.6.1-2.el8 baseos 43 k 2023-08-01T19:51:22.418 INFO:teuthology.orchestra.run.smithi006.stdout: python3-kubernetes noarch 1:11.0.0-6.el8 epel 1.2 M 2023-08-01T19:51:22.418 INFO:teuthology.orchestra.run.smithi006.stdout: python3-logutils noarch 0.3.5-11.el8 epel 49 k 2023-08-01T19:51:22.418 INFO:teuthology.orchestra.run.smithi006.stdout: python3-mako noarch 1.0.6-14.el8 appstream 157 k 2023-08-01T19:51:22.419 INFO:teuthology.orchestra.run.smithi006.stdout: python3-markupsafe x86_64 0.23-19.el8 appstream 39 k 2023-08-01T19:51:22.419 INFO:teuthology.orchestra.run.smithi006.stdout: python3-more-itertools noarch 7.2.0-3.el8 epel 59 k 2023-08-01T19:51:22.419 INFO:teuthology.orchestra.run.smithi006.stdout: python3-natsort noarch 7.1.1-2.el8 epel 60 k 2023-08-01T19:51:22.419 INFO:teuthology.orchestra.run.smithi006.stdout: python3-numpy x86_64 1:1.14.3-10.el8 appstream 3.7 M 2023-08-01T19:51:22.419 INFO:teuthology.orchestra.run.smithi006.stdout: python3-numpy-f2py x86_64 1:1.14.3-10.el8 appstream 225 k 2023-08-01T19:51:22.419 INFO:teuthology.orchestra.run.smithi006.stdout: python3-oauthlib noarch 2.1.0-1.el8 baseos 155 k 2023-08-01T19:51:22.419 INFO:teuthology.orchestra.run.smithi006.stdout: python3-pecan noarch 1.3.2-9.el8 epel 283 k 2023-08-01T19:51:22.419 INFO:teuthology.orchestra.run.smithi006.stdout: python3-portend noarch 2.6-1.el8 epel 16 k 2023-08-01T19:51:22.420 INFO:teuthology.orchestra.run.smithi006.stdout: python3-prettytable noarch 0.7.2-14.el8 appstream 44 k 2023-08-01T19:51:22.420 INFO:teuthology.orchestra.run.smithi006.stdout: python3-pyOpenSSL noarch 19.0.0-1.el8 appstream 103 k 2023-08-01T19:51:22.420 INFO:teuthology.orchestra.run.smithi006.stdout: python3-pyasn1 noarch 0.3.7-6.el8 appstream 126 k 2023-08-01T19:51:22.420 INFO:teuthology.orchestra.run.smithi006.stdout: python3-pyasn1-modules noarch 0.3.7-6.el8 appstream 110 k 2023-08-01T19:51:22.420 INFO:teuthology.orchestra.run.smithi006.stdout: python3-pycparser noarch 2.14-14.el8 baseos 109 k 2023-08-01T19:51:22.420 INFO:teuthology.orchestra.run.smithi006.stdout: python3-pytz noarch 2017.2-9.el8 appstream 54 k 2023-08-01T19:51:22.420 INFO:teuthology.orchestra.run.smithi006.stdout: python3-repoze-lru noarch 0.7-6.el8 epel 34 k 2023-08-01T19:51:22.420 INFO:teuthology.orchestra.run.smithi006.stdout: python3-requests-oauthlib noarch 1.0.0-1.el8 baseos 43 k 2023-08-01T19:51:22.421 INFO:teuthology.orchestra.run.smithi006.stdout: python3-routes noarch 2.4.1-12.el8 epel 196 k 2023-08-01T19:51:22.421 INFO:teuthology.orchestra.run.smithi006.stdout: python3-rsa noarch 4.9-2.el8 epel 64 k 2023-08-01T19:51:22.421 INFO:teuthology.orchestra.run.smithi006.stdout: python3-scipy x86_64 1.0.0-21.module_el8.5.0+771+e5d9a225 appstream 14 M 2023-08-01T19:51:22.421 INFO:teuthology.orchestra.run.smithi006.stdout: python3-simplegeneric noarch 0.8.1-17.el8 epel 19 k 2023-08-01T19:51:22.421 INFO:teuthology.orchestra.run.smithi006.stdout: python3-singledispatch noarch 3.4.0.3-18.el8 epel 24 k 2023-08-01T19:51:22.421 INFO:teuthology.orchestra.run.smithi006.stdout: python3-tempora noarch 1.14.1-5.el8 epel 29 k 2023-08-01T19:51:22.421 INFO:teuthology.orchestra.run.smithi006.stdout: python3-trustme noarch 0.6.0-4.el8 epel 27 k 2023-08-01T19:51:22.421 INFO:teuthology.orchestra.run.smithi006.stdout: python3-waitress noarch 1.4.3-1.el8 epel 255 k 2023-08-01T19:51:22.422 INFO:teuthology.orchestra.run.smithi006.stdout: python3-webob noarch 1.8.5-1.el8.1 epel 251 k 2023-08-01T19:51:22.422 INFO:teuthology.orchestra.run.smithi006.stdout: python3-websocket-client noarch 0.56.0-5.el8 epel 61 k 2023-08-01T19:51:22.422 INFO:teuthology.orchestra.run.smithi006.stdout: python3-webtest noarch 2.0.33-1.el8 epel 85 k 2023-08-01T19:51:22.422 INFO:teuthology.orchestra.run.smithi006.stdout: python3-werkzeug noarch 0.12.2-4.el8 appstream 457 k 2023-08-01T19:51:22.422 INFO:teuthology.orchestra.run.smithi006.stdout: python3-zc-lockfile noarch 2.0-2.el8 epel 23 k 2023-08-01T19:51:22.422 INFO:teuthology.orchestra.run.smithi006.stdout: socat x86_64 1.7.4.1-1.el8 appstream 323 k 2023-08-01T19:51:22.423 INFO:teuthology.orchestra.run.smithi006.stdout: thrift x86_64 0.13.0-2.el8 epel 1.7 M 2023-08-01T19:51:22.423 INFO:teuthology.orchestra.run.smithi006.stdout: xmlstarlet x86_64 1.6.1-20.el8 appstream 71 k 2023-08-01T19:51:22.423 INFO:teuthology.orchestra.run.smithi006.stdout: zlib-devel x86_64 1.2.11-21.el8 baseos 58 k 2023-08-01T19:51:22.423 INFO:teuthology.orchestra.run.smithi006.stdout: 2023-08-01T19:51:22.423 INFO:teuthology.orchestra.run.smithi006.stdout:Transaction Summary 2023-08-01T19:51:22.423 INFO:teuthology.orchestra.run.smithi006.stdout:================================================================================================ 2023-08-01T19:51:22.423 INFO:teuthology.orchestra.run.smithi006.stdout:Install 121 Packages 2023-08-01T19:51:22.423 INFO:teuthology.orchestra.run.smithi006.stdout:Upgrade 13 Packages 2023-08-01T19:51:22.424 INFO:teuthology.orchestra.run.smithi006.stdout: 2023-08-01T19:51:22.424 INFO:teuthology.orchestra.run.smithi006.stdout:Total download size: 208 M 2023-08-01T19:51:22.424 INFO:teuthology.orchestra.run.smithi006.stdout:Downloading Packages: 2023-08-01T19:51:22.438 INFO:teuthology.orchestra.run.smithi101.stdout:(129/134): libuuid-2.32.1-42.el8.x86_64.rpm 787 kB/s | 98 kB 00:00 2023-08-01T19:51:22.587 INFO:teuthology.orchestra.run.smithi155.stdout:(50/134): python3-jinja2-2.10.1-3.el8.noarch.rp 485 kB/s | 538 kB 00:01 2023-08-01T19:51:22.630 INFO:teuthology.orchestra.run.smithi101.stdout:(130/134): librados2-17.2.6-823.g893fa35f.el8.x 2.2 MB/s | 3.5 MB 00:01 2023-08-01T19:51:22.683 INFO:teuthology.orchestra.run.smithi008.stdout:(39/134): jq-1.6-7.el8.x86_64.rpm 234 kB/s | 202 kB 00:00 2023-08-01T19:51:22.745 INFO:teuthology.orchestra.run.smithi155.stdout:(51/134): python3-markupsafe-0.23-19.el8.x86_64 107 kB/s | 39 kB 00:00 2023-08-01T19:51:22.797 INFO:teuthology.orchestra.run.smithi101.stdout:(131/134): util-linux-2.32.1-42.el8.x86_64.rpm 7.2 MB/s | 2.6 MB 00:00 2023-08-01T19:51:22.956 INFO:teuthology.orchestra.run.smithi101.stdout:(132/134): xfsprogs-5.0.0-12.el8.x86_64.rpm 6.8 MB/s | 1.1 MB 00:00 2023-08-01T19:51:23.138 INFO:teuthology.orchestra.run.smithi155.stdout:(52/134): python3-mako-1.0.6-14.el8.noarch.rpm 176 kB/s | 157 kB 00:00 2023-08-01T19:51:23.139 INFO:teuthology.orchestra.run.smithi101.stdout:(133/134): util-linux-user-2.32.1-42.el8.x86_64 201 kB/s | 102 kB 00:00 2023-08-01T19:51:23.184 INFO:teuthology.orchestra.run.smithi008.stdout:(40/134): librdkafka-0.11.4-3.el8.x86_64.rpm 369 kB/s | 354 kB 00:00 2023-08-01T19:51:23.189 INFO:teuthology.orchestra.run.smithi006.stdout:(1/134): ceph-17.2.6-823.g893fa35f.el8.x86_64.r 25 kB/s | 6.4 kB 00:00 2023-08-01T19:51:23.489 INFO:teuthology.orchestra.run.smithi155.stdout:(53/134): python3-prettytable-0.7.2-14.el8.noar 125 kB/s | 44 kB 00:00 2023-08-01T19:51:23.723 INFO:teuthology.orchestra.run.smithi006.stdout:(2/134): ceph-fuse-17.2.6-823.g893fa35f.el8.x86 1.6 MB/s | 874 kB 00:00 2023-08-01T19:51:23.789 INFO:teuthology.orchestra.run.smithi155.stdout:(54/134): python3-numpy-f2py-1.14.3-10.el8.x86_ 216 kB/s | 225 kB 00:01 2023-08-01T19:51:23.823 INFO:teuthology.orchestra.run.smithi006.stdout:(3/134): ceph-immutable-object-cache-17.2.6-823 1.6 MB/s | 162 kB 00:00 2023-08-01T19:51:23.943 INFO:teuthology.orchestra.run.smithi008.stdout:(41/134): libtool-2.4.6-25.el8.x86_64.rpm 563 kB/s | 709 kB 00:01 2023-08-01T19:51:23.998 INFO:teuthology.orchestra.run.smithi101.stdout:(134/134): librbd1-17.2.6-823.g893fa35f.el8.x86 1.2 MB/s | 3.6 MB 00:02 2023-08-01T19:51:24.000 INFO:teuthology.orchestra.run.smithi101.stdout:-------------------------------------------------------------------------------- 2023-08-01T19:51:24.001 INFO:teuthology.orchestra.run.smithi101.stdout:Total 8.3 MB/s | 208 MB 00:25 2023-08-01T19:51:24.134 INFO:teuthology.orchestra.run.smithi008.stdout:(42/134): lttng-ust-2.8.1-11.el8.x86_64.rpm 273 kB/s | 259 kB 00:00 2023-08-01T19:51:24.203 INFO:teuthology.orchestra.run.smithi155.stdout:(55/134): python3-numpy-1.14.3-10.el8.x86_64.rp 2.3 MB/s | 3.7 MB 00:01 2023-08-01T19:51:24.231 INFO:teuthology.orchestra.run.smithi155.stdout:(56/134): python3-pyOpenSSL-19.0.0-1.el8.noarch 139 kB/s | 103 kB 00:00 2023-08-01T19:51:24.506 INFO:teuthology.orchestra.run.smithi006.stdout:(4/134): ceph-mds-17.2.6-823.g893fa35f.el8.x86_ 3.4 MB/s | 2.3 MB 00:00 2023-08-01T19:51:24.590 INFO:teuthology.orchestra.run.smithi155.stdout:(57/134): python3-pyasn1-0.3.7-6.el8.noarch.rpm 158 kB/s | 126 kB 00:00 2023-08-01T19:51:24.765 INFO:teuthology.orchestra.run.smithi006.stdout:(5/134): ceph-mgr-17.2.6-823.g893fa35f.el8.x86_ 6.1 MB/s | 1.6 MB 00:00 2023-08-01T19:51:24.773 INFO:teuthology.orchestra.run.smithi101.stdout:Running transaction check 2023-08-01T19:51:24.790 INFO:teuthology.orchestra.run.smithi155.stdout:(58/134): python3-pytz-2017.2-9.el8.noarch.rpm 97 kB/s | 54 kB 00:00 2023-08-01T19:51:24.864 INFO:teuthology.orchestra.run.smithi008.stdout:(43/134): oniguruma-6.8.2-2.el8.x86_64.rpm 203 kB/s | 187 kB 00:00 2023-08-01T19:51:24.865 INFO:teuthology.orchestra.run.smithi006.stdout:(6/134): ceph-base-17.2.6-823.g893fa35f.el8.x86 2.7 MB/s | 5.2 MB 00:01 2023-08-01T19:51:24.957 INFO:teuthology.orchestra.run.smithi155.stdout:(59/134): python3-pyasn1-modules-0.3.7-6.el8.no 146 kB/s | 110 kB 00:00 2023-08-01T19:51:25.192 INFO:teuthology.orchestra.run.smithi101.stdout:Transaction check succeeded. 2023-08-01T19:51:25.192 INFO:teuthology.orchestra.run.smithi101.stdout:Running transaction test 2023-08-01T19:51:25.274 INFO:teuthology.orchestra.run.smithi006.stdout:(7/134): ceph-mon-17.2.6-823.g893fa35f.el8.x86_ 7.7 MB/s | 3.9 MB 00:00 2023-08-01T19:51:25.785 INFO:teuthology.orchestra.run.smithi008.stdout:(44/134): openblas-0.3.15-4.el8.x86_64.rpm 2.9 MB/s | 4.7 MB 00:01 2023-08-01T19:51:26.049 INFO:teuthology.orchestra.run.smithi155.stdout:(60/134): socat-1.7.4.1-1.el8.x86_64.rpm 296 kB/s | 323 kB 00:01 2023-08-01T19:51:26.074 INFO:teuthology.orchestra.run.smithi155.stdout:(61/134): python3-werkzeug-0.12.2-4.el8.noarch. 356 kB/s | 457 kB 00:01 2023-08-01T19:51:26.402 INFO:teuthology.orchestra.run.smithi008.stdout:(45/134): openblas-threads-0.3.15-4.el8.x86_64. 3.2 MB/s | 4.9 MB 00:01 2023-08-01T19:51:26.524 INFO:teuthology.orchestra.run.smithi155.stdout:(62/134): elfutils-libelf-devel-0.189-2.el8.x86 137 kB/s | 61 kB 00:00 2023-08-01T19:51:26.551 INFO:teuthology.orchestra.run.smithi101.stdout:Transaction test succeeded. 2023-08-01T19:51:26.554 INFO:teuthology.orchestra.run.smithi101.stdout:Running transaction 2023-08-01T19:51:26.700 INFO:teuthology.orchestra.run.smithi155.stdout:(63/134): xmlstarlet-1.6.1-20.el8.x86_64.rpm 109 kB/s | 71 kB 00:00 2023-08-01T19:51:26.759 INFO:teuthology.orchestra.run.smithi155.stdout:(64/134): fuse-2.9.7-17.el8.x86_64.rpm 355 kB/s | 83 kB 00:00 2023-08-01T19:51:26.877 INFO:teuthology.orchestra.run.smithi008.stdout:(46/134): ceph-test-17.2.6-823.g893fa35f.el8.x8 3.6 MB/s | 52 MB 00:14 2023-08-01T19:51:27.117 INFO:teuthology.orchestra.run.smithi155.stdout:(65/134): keyutils-libs-devel-1.5.10-9.el8.x86_ 115 kB/s | 48 kB 00:00 2023-08-01T19:51:27.151 INFO:teuthology.orchestra.run.smithi155.stdout:(66/134): krb5-devel-1.18.2-22.el8.x86_64.rpm 1.4 MB/s | 561 kB 00:00 2023-08-01T19:51:27.158 INFO:teuthology.orchestra.run.smithi006.stdout:(8/134): ceph-common-17.2.6-823.g893fa35f.el8.x 5.5 MB/s | 23 MB 00:04 2023-08-01T19:51:27.211 INFO:teuthology.orchestra.run.smithi008.stdout:(47/134): python3-jsonpatch-1.21-2.el8.noarch.r 80 kB/s | 27 kB 00:00 2023-08-01T19:51:27.233 INFO:teuthology.orchestra.run.smithi006.stdout:(9/134): ceph-selinux-17.2.6-823.g893fa35f.el8. 325 kB/s | 24 kB 00:00 2023-08-01T19:51:27.259 INFO:teuthology.orchestra.run.smithi155.stdout:(67/134): libaio-devel-0.3.112-1.el8.x86_64.rpm 132 kB/s | 19 kB 00:00 2023-08-01T19:51:27.285 INFO:teuthology.orchestra.run.smithi155.stdout:(68/134): libcom_err-devel-1.45.6-5.el8.x86_64. 290 kB/s | 39 kB 00:00 2023-08-01T19:51:27.427 INFO:teuthology.orchestra.run.smithi155.stdout:(69/134): libquadmath-8.5.0-20.el8.x86_64.rpm 1.2 MB/s | 172 kB 00:00 2023-08-01T19:51:27.544 INFO:teuthology.orchestra.run.smithi008.stdout:(48/134): python3-jsonpointer-1.10-11.el8.noarc 60 kB/s | 20 kB 00:00 2023-08-01T19:51:27.569 INFO:teuthology.orchestra.run.smithi155.stdout:(70/134): librabbitmq-0.9.0-4.el8.x86_64.rpm 331 kB/s | 47 kB 00:00 2023-08-01T19:51:27.736 INFO:teuthology.orchestra.run.smithi155.stdout:(71/134): python3-scipy-1.0.0-21.module_el8.5.0 4.4 MB/s | 14 MB 00:03 2023-08-01T19:51:27.761 INFO:teuthology.orchestra.run.smithi155.stdout:(72/134): libselinux-devel-2.9-8.el8.x86_64.rpm 1.0 MB/s | 200 kB 00:00 2023-08-01T19:51:27.786 INFO:teuthology.orchestra.run.smithi155.stdout:(73/134): libgfortran-8.5.0-20.el8.x86_64.rpm 1.2 MB/s | 645 kB 00:00 2023-08-01T19:51:27.853 INFO:teuthology.orchestra.run.smithi008.stdout:(49/134): python3-babel-2.5.1-7.el8.noarch.rpm 2.3 MB/s | 4.8 MB 00:02 2023-08-01T19:51:27.887 INFO:teuthology.orchestra.run.smithi008.stdout:(50/134): python3-jinja2-2.10.1-3.el8.noarch.rp 362 kB/s | 538 kB 00:01 2023-08-01T19:51:27.903 INFO:teuthology.orchestra.run.smithi155.stdout:(74/134): libuuid-devel-2.32.1-42.el8.x86_64.rp 701 kB/s | 99 kB 00:00 2023-08-01T19:51:27.928 INFO:teuthology.orchestra.run.smithi155.stdout:(75/134): libverto-devel-0.3.2-2.el8.x86_64.rpm 127 kB/s | 18 kB 00:00 2023-08-01T19:51:28.029 INFO:teuthology.orchestra.run.smithi155.stdout:(76/134): libzstd-devel-1.4.4-1.el8.x86_64.rpm 350 kB/s | 44 kB 00:00 2023-08-01T19:51:28.187 INFO:teuthology.orchestra.run.smithi008.stdout:(51/134): python3-markupsafe-0.23-19.el8.x86_64 116 kB/s | 39 kB 00:00 2023-08-01T19:51:28.221 INFO:teuthology.orchestra.run.smithi155.stdout:(77/134): pcre2-devel-10.32-3.el8.x86_64.rpm 3.1 MB/s | 605 kB 00:00 2023-08-01T19:51:28.246 INFO:teuthology.orchestra.run.smithi155.stdout:(78/134): libsepol-devel-2.9-3.el8.x86_64.rpm 171 kB/s | 87 kB 00:00 2023-08-01T19:51:28.329 INFO:teuthology.orchestra.run.smithi008.stdout:(52/134): python3-mako-1.0.6-14.el8.noarch.rpm 200 kB/s | 157 kB 00:00 2023-08-01T19:51:28.371 INFO:teuthology.orchestra.run.smithi155.stdout:(79/134): openssl-devel-1.1.1k-9.el8.x86_64.rpm 7.2 MB/s | 3.2 MB 00:00 2023-08-01T19:51:28.397 INFO:teuthology.orchestra.run.smithi155.stdout:(80/134): pcre2-utf16-10.32-3.el8.x86_64.rpm 1.3 MB/s | 229 kB 00:00 2023-08-01T19:51:28.466 INFO:teuthology.orchestra.run.smithi006.stdout:(10/134): ceph-radosgw-17.2.6-823.g893fa35f.el8 5.3 MB/s | 17 MB 00:03 2023-08-01T19:51:28.497 INFO:teuthology.orchestra.run.smithi155.stdout:(81/134): python3-cffi-1.11.5-6.el8.x86_64.rpm 1.9 MB/s | 249 kB 00:00 2023-08-01T19:51:28.572 INFO:teuthology.orchestra.run.smithi155.stdout:(82/134): pcre2-utf32-10.32-3.el8.x86_64.rpm 676 kB/s | 220 kB 00:00 2023-08-01T19:51:28.606 INFO:teuthology.orchestra.run.smithi155.stdout:(83/134): python3-cryptography-3.2.1-6.el8.x86_ 3.0 MB/s | 641 kB 00:00 2023-08-01T19:51:28.625 INFO:teuthology.orchestra.run.smithi006.stdout:(11/134): ceph-osd-17.2.6-823.g893fa35f.el8.x86 4.4 MB/s | 17 MB 00:03 2023-08-01T19:51:28.631 INFO:teuthology.orchestra.run.smithi155.stdout:(84/134): python3-jwt-1.6.1-2.el8.noarch.rpm 318 kB/s | 43 kB 00:00 2023-08-01T19:51:28.650 INFO:teuthology.orchestra.run.smithi006.stdout:(12/134): libcephfs-devel-17.2.6-823.g893fa35f. 135 kB/s | 25 kB 00:00 2023-08-01T19:51:28.731 INFO:teuthology.orchestra.run.smithi155.stdout:(85/134): python3-pycparser-2.14-14.el8.noarch. 870 kB/s | 109 kB 00:00 2023-08-01T19:51:28.757 INFO:teuthology.orchestra.run.smithi155.stdout:(86/134): python3-oauthlib-2.1.0-1.el8.noarch.r 841 kB/s | 155 kB 00:00 2023-08-01T19:51:28.782 INFO:teuthology.orchestra.run.smithi155.stdout:(87/134): python3-requests-oauthlib-1.0.0-1.el8 283 kB/s | 43 kB 00:00 2023-08-01T19:51:28.817 INFO:teuthology.orchestra.run.smithi006.stdout:(13/134): libcephsqlite-17.2.6-823.g893fa35f.el 1.0 MB/s | 174 kB 00:00 2023-08-01T19:51:28.849 INFO:teuthology.orchestra.run.smithi155.stdout:(88/134): xfsprogs-devel-5.0.0-12.el8.x86_64.rp 636 kB/s | 74 kB 00:00 2023-08-01T19:51:28.874 INFO:teuthology.orchestra.run.smithi155.stdout:(89/134): zlib-devel-1.2.11-21.el8.x86_64.rpm 495 kB/s | 58 kB 00:00 2023-08-01T19:51:28.887 INFO:teuthology.orchestra.run.smithi008.stdout:(53/134): python3-prettytable-0.7.2-14.el8.noar 79 kB/s | 44 kB 00:00 2023-08-01T19:51:29.001 INFO:teuthology.orchestra.run.smithi006.stdout:(14/134): libcephfs2-17.2.6-823.g893fa35f.el8.x 2.1 MB/s | 795 kB 00:00 2023-08-01T19:51:29.025 INFO:teuthology.orchestra.run.smithi155.stdout:(90/134): liboath-2.6.2-3.el8.x86_64.rpm 335 kB/s | 59 kB 00:00 2023-08-01T19:51:29.050 INFO:teuthology.orchestra.run.smithi155.stdout:(91/134): libunwind-1.3.1-3.el8.x86_64.rpm 429 kB/s | 75 kB 00:00 2023-08-01T19:51:29.059 INFO:teuthology.orchestra.run.smithi006.stdout:(15/134): librados-devel-17.2.6-823.g893fa35f.e 537 kB/s | 130 kB 00:00 2023-08-01T19:51:29.075 INFO:teuthology.orchestra.run.smithi155.stdout:(92/134): gperftools-libs-2.7-9.el8.x86_64.rpm 1.0 MB/s | 306 kB 00:00 2023-08-01T19:51:29.109 INFO:teuthology.orchestra.run.smithi155.stdout:(93/134): python3-bcrypt-3.1.6-2.el8.1.x86_64.r 743 kB/s | 44 kB 00:00 2023-08-01T19:51:29.142 INFO:teuthology.orchestra.run.smithi155.stdout:(94/134): python3-beautifulsoup4-4.6.3-2.el8.1. 2.7 MB/s | 185 kB 00:00 2023-08-01T19:51:29.146 INFO:teuthology.orchestra.run.smithi008.stdout:(54/134): python3-numpy-f2py-1.14.3-10.el8.x86_ 235 kB/s | 225 kB 00:00 2023-08-01T19:51:29.159 INFO:teuthology.orchestra.run.smithi155.stdout:(95/134): python3-cachetools-3.1.1-4.el8.noarch 656 kB/s | 33 kB 00:00 2023-08-01T19:51:29.193 INFO:teuthology.orchestra.run.smithi006.stdout:(16/134): libradosstriper1-17.2.6-823.g893fa35f 2.6 MB/s | 508 kB 00:00 2023-08-01T19:51:29.194 INFO:teuthology.orchestra.run.smithi155.stdout:(96/134): python3-certifi-2018.10.15-7.el8.noar 324 kB/s | 16 kB 00:00 2023-08-01T19:51:29.227 INFO:teuthology.orchestra.run.smithi155.stdout:(97/134): python3-asyncssh-2.7.0-2.el8.noarch.r 2.3 MB/s | 476 kB 00:00 2023-08-01T19:51:29.293 INFO:teuthology.orchestra.run.smithi006.stdout:(17/134): python3-ceph-argparse-17.2.6-823.g893 446 kB/s | 45 kB 00:00 2023-08-01T19:51:29.294 INFO:teuthology.orchestra.run.smithi155.stdout:(98/134): python3-cheroot-8.5.2-1.el8.noarch.rp 1.3 MB/s | 173 kB 00:00 2023-08-01T19:51:29.319 INFO:teuthology.orchestra.run.smithi155.stdout:(99/134): python3-cherrypy-18.4.0-1.el8.noarch. 3.0 MB/s | 384 kB 00:00 2023-08-01T19:51:29.336 INFO:teuthology.orchestra.run.smithi155.stdout:(100/134): python3-google-auth-1.1.1-10.el8.noa 746 kB/s | 81 kB 00:00 2023-08-01T19:51:29.361 INFO:teuthology.orchestra.run.smithi155.stdout:(101/134): python3-jaraco-6.2-6.el8.noarch.rpm 165 kB/s | 11 kB 00:00 2023-08-01T19:51:29.369 INFO:teuthology.orchestra.run.smithi006.stdout:(18/134): python3-ceph-common-17.2.6-823.g893fa 1.5 MB/s | 115 kB 00:00 2023-08-01T19:51:29.387 INFO:teuthology.orchestra.run.smithi155.stdout:(102/134): python3-jaraco-functools-2.0-4.el8.n 261 kB/s | 18 kB 00:00 2023-08-01T19:51:29.420 INFO:teuthology.orchestra.run.smithi155.stdout:(103/134): python3-logutils-0.3.5-11.el8.noarch 832 kB/s | 49 kB 00:00 2023-08-01T19:51:29.445 INFO:teuthology.orchestra.run.smithi155.stdout:(104/134): python3-more-itertools-7.2.0-3.el8.n 1.0 MB/s | 59 kB 00:00 2023-08-01T19:51:29.477 INFO:teuthology.orchestra.run.smithi006.stdout:(19/134): python3-cephfs-17.2.6-823.g893fa35f.e 1.7 MB/s | 190 kB 00:00 2023-08-01T19:51:29.496 INFO:teuthology.orchestra.run.smithi155.stdout:(105/134): python3-kubernetes-11.0.0-6.el8.noar 7.3 MB/s | 1.2 MB 00:00 2023-08-01T19:51:29.521 INFO:teuthology.orchestra.run.smithi155.stdout:(106/134): python3-natsort-7.1.1-2.el8.noarch.r 599 kB/s | 60 kB 00:00 2023-08-01T19:51:29.547 INFO:teuthology.orchestra.run.smithi155.stdout:(107/134): python3-pecan-1.3.2-9.el8.noarch.rpm 2.7 MB/s | 283 kB 00:00 2023-08-01T19:51:29.572 INFO:teuthology.orchestra.run.smithi155.stdout:(108/134): python3-portend-2.6-1.el8.noarch.rpm 205 kB/s | 16 kB 00:00 2023-08-01T19:51:29.597 INFO:teuthology.orchestra.run.smithi155.stdout:(109/134): python3-repoze-lru-0.7-6.el8.noarch. 443 kB/s | 34 kB 00:00 2023-08-01T19:51:29.613 INFO:teuthology.orchestra.run.smithi008.stdout:(55/134): python3-pyOpenSSL-19.0.0-1.el8.noarch 143 kB/s | 103 kB 00:00 2023-08-01T19:51:29.648 INFO:teuthology.orchestra.run.smithi155.stdout:(110/134): python3-routes-2.4.1-12.el8.noarch.r 1.9 MB/s | 196 kB 00:00 2023-08-01T19:51:29.673 INFO:teuthology.orchestra.run.smithi155.stdout:(111/134): python3-simplegeneric-0.8.1-17.el8.n 249 kB/s | 19 kB 00:00 2023-08-01T19:51:29.686 INFO:teuthology.orchestra.run.smithi006.stdout:(20/134): python3-rados-17.2.6-823.g893fa35f.el 1.7 MB/s | 371 kB 00:00 2023-08-01T19:51:29.698 INFO:teuthology.orchestra.run.smithi155.stdout:(112/134): python3-rsa-4.9-2.el8.noarch.rpm 510 kB/s | 64 kB 00:00 2023-08-01T19:51:29.723 INFO:teuthology.orchestra.run.smithi155.stdout:(113/134): python3-singledispatch-3.4.0.3-18.el 317 kB/s | 24 kB 00:00 2023-08-01T19:51:29.749 INFO:teuthology.orchestra.run.smithi155.stdout:(114/134): python3-tempora-1.14.1-5.el8.noarch. 387 kB/s | 29 kB 00:00 2023-08-01T19:51:29.774 INFO:teuthology.orchestra.run.smithi155.stdout:(115/134): python3-trustme-0.6.0-4.el8.noarch.r 363 kB/s | 27 kB 00:00 2023-08-01T19:51:29.799 INFO:teuthology.orchestra.run.smithi155.stdout:(116/134): python3-waitress-1.4.3-1.el8.noarch. 3.3 MB/s | 255 kB 00:00 2023-08-01T19:51:29.825 INFO:teuthology.orchestra.run.smithi155.stdout:(117/134): python3-webob-1.8.5-1.el8.1.noarch.r 3.2 MB/s | 251 kB 00:00 2023-08-01T19:51:29.850 INFO:teuthology.orchestra.run.smithi155.stdout:(118/134): python3-websocket-client-0.56.0-5.el 810 kB/s | 61 kB 00:00 2023-08-01T19:51:29.875 INFO:teuthology.orchestra.run.smithi155.stdout:(119/134): python3-webtest-2.0.33-1.el8.noarch. 1.1 MB/s | 85 kB 00:00 2023-08-01T19:51:29.880 INFO:teuthology.orchestra.run.smithi008.stdout:(56/134): python3-pyasn1-0.3.7-6.el8.noarch.rpm 172 kB/s | 126 kB 00:00 2023-08-01T19:51:29.886 INFO:teuthology.orchestra.run.smithi006.stdout:(21/134): python3-rbd-17.2.6-823.g893fa35f.el8. 1.8 MB/s | 358 kB 00:00 2023-08-01T19:51:29.901 INFO:teuthology.orchestra.run.smithi155.stdout:(120/134): python3-zc-lockfile-2.0-2.el8.noarch 303 kB/s | 23 kB 00:00 2023-08-01T19:51:29.939 INFO:teuthology.orchestra.run.smithi008.stdout:(57/134): python3-numpy-1.14.3-10.el8.x86_64.rp 1.8 MB/s | 3.7 MB 00:02 2023-08-01T19:51:29.995 INFO:teuthology.orchestra.run.smithi006.stdout:(22/134): python3-rgw-17.2.6-823.g893fa35f.el8. 985 kB/s | 107 kB 00:00 2023-08-01T19:51:30.043 INFO:teuthology.orchestra.run.smithi155.stdout:(121/134): thrift-0.13.0-2.el8.x86_64.rpm 9.0 MB/s | 1.7 MB 00:00 2023-08-01T19:51:30.120 INFO:teuthology.orchestra.run.smithi006.stdout:(23/134): rbd-fuse-17.2.6-823.g893fa35f.el8.x86 721 kB/s | 90 kB 00:00 2023-08-01T19:51:30.184 INFO:teuthology.orchestra.run.smithi155.stdout:(122/134): elfutils-debuginfod-client-0.189-2.e 536 kB/s | 76 kB 00:00 2023-08-01T19:51:30.327 INFO:teuthology.orchestra.run.smithi155.stdout:(123/134): elfutils-libelf-0.189-2.el8.x86_64.r 1.6 MB/s | 232 kB 00:00 2023-08-01T19:51:30.406 INFO:teuthology.orchestra.run.smithi008.stdout:(58/134): python3-pyasn1-modules-0.3.7-6.el8.no 139 kB/s | 110 kB 00:00 2023-08-01T19:51:30.439 INFO:teuthology.orchestra.run.smithi008.stdout:(59/134): python3-pytz-2017.2-9.el8.noarch.rpm 97 kB/s | 54 kB 00:00 2023-08-01T19:51:30.477 INFO:teuthology.orchestra.run.smithi155.stdout:(124/134): elfutils-libs-0.189-2.el8.x86_64.rpm 2.0 MB/s | 302 kB 00:00 2023-08-01T19:51:30.619 INFO:teuthology.orchestra.run.smithi155.stdout:(125/134): libblkid-2.32.1-42.el8.x86_64.rpm 1.5 MB/s | 220 kB 00:00 2023-08-01T19:51:30.761 INFO:teuthology.orchestra.run.smithi155.stdout:(126/134): libfdisk-2.32.1-42.el8.x86_64.rpm 1.8 MB/s | 253 kB 00:00 2023-08-01T19:51:30.944 INFO:teuthology.orchestra.run.smithi155.stdout:(127/134): librbd1-17.2.6-823.g893fa35f.el8.x86 3.4 MB/s | 3.6 MB 00:01 2023-08-01T19:51:30.970 INFO:teuthology.orchestra.run.smithi155.stdout:(128/134): libmount-2.32.1-42.el8.x86_64.rpm 1.1 MB/s | 236 kB 00:00 2023-08-01T19:51:31.112 INFO:teuthology.orchestra.run.smithi155.stdout:(129/134): libuuid-2.32.1-42.el8.x86_64.rpm 696 kB/s | 98 kB 00:00 2023-08-01T19:51:31.162 INFO:teuthology.orchestra.run.smithi006.stdout:(24/134): librgw2-17.2.6-823.g893fa35f.el8.x86_ 2.6 MB/s | 5.5 MB 00:02 2023-08-01T19:51:31.237 INFO:teuthology.orchestra.run.smithi006.stdout:(25/134): rbd-nbd-17.2.6-823.g893fa35f.el8.x86_ 2.3 MB/s | 173 kB 00:00 2023-08-01T19:51:31.296 INFO:teuthology.orchestra.run.smithi006.stdout:(26/134): ceph-grafana-dashboards-17.2.6-823.g8 397 kB/s | 23 kB 00:00 2023-08-01T19:51:31.388 INFO:teuthology.orchestra.run.smithi006.stdout:(27/134): ceph-mgr-cephadm-17.2.6-823.g893fa35f 1.3 MB/s | 121 kB 00:00 2023-08-01T19:51:31.448 INFO:teuthology.orchestra.run.smithi008.stdout:(60/134): python3-werkzeug-0.12.2-4.el8.noarch. 439 kB/s | 457 kB 00:01 2023-08-01T19:51:31.473 INFO:teuthology.orchestra.run.smithi008.stdout:(61/134): socat-1.7.4.1-1.el8.x86_64.rpm 313 kB/s | 323 kB 00:01 2023-08-01T19:51:31.487 INFO:teuthology.orchestra.run.smithi155.stdout:(130/134): util-linux-2.32.1-42.el8.x86_64.rpm 6.9 MB/s | 2.6 MB 00:00 2023-08-01T19:51:31.546 INFO:teuthology.orchestra.run.smithi155.stdout:(131/134): libsmartcols-2.32.1-42.el8.x86_64.rp 298 kB/s | 179 kB 00:00 2023-08-01T19:51:31.604 INFO:teuthology.orchestra.run.smithi155.stdout:(132/134): util-linux-user-2.32.1-42.el8.x86_64 876 kB/s | 102 kB 00:00 2023-08-01T19:51:31.774 INFO:teuthology.orchestra.run.smithi101.stdout: Preparing : 1/1 2023-08-01T19:51:31.814 INFO:teuthology.orchestra.run.smithi101.stdout: Running scriptlet: libuuid-2.32.1-42.el8.x86_64 1/1 2023-08-01T19:51:31.872 INFO:teuthology.orchestra.run.smithi006.stdout:(28/134): rbd-mirror-17.2.6-823.g893fa35f.el8.x 2.0 MB/s | 3.5 MB 00:01 2023-08-01T19:51:31.915 INFO:teuthology.orchestra.run.smithi008.stdout:(62/134): elfutils-libelf-devel-0.189-2.el8.x86 139 kB/s | 61 kB 00:00 2023-08-01T19:51:31.955 INFO:teuthology.orchestra.run.smithi006.stdout:(29/134): ceph-mgr-dashboard-17.2.6-823.g893fa3 3.0 MB/s | 1.7 MB 00:00 2023-08-01T19:51:31.960 INFO:teuthology.orchestra.run.smithi101.stdout: Upgrading : libuuid-2.32.1-42.el8.x86_64 1/147 2023-08-01T19:51:31.965 INFO:teuthology.orchestra.run.smithi008.stdout:(63/134): xmlstarlet-1.6.1-20.el8.x86_64.rpm 136 kB/s | 71 kB 00:00 2023-08-01T19:51:31.980 INFO:teuthology.orchestra.run.smithi155.stdout:(133/134): xfsprogs-5.0.0-12.el8.x86_64.rpm 2.5 MB/s | 1.1 MB 00:00 2023-08-01T19:51:32.041 INFO:teuthology.orchestra.run.smithi101.stdout: Running scriptlet: libuuid-2.32.1-42.el8.x86_64 1/147 2023-08-01T19:51:32.055 INFO:teuthology.orchestra.run.smithi006.stdout:(30/134): ceph-mgr-modules-core-17.2.6-823.g893 2.3 MB/s | 238 kB 00:00 2023-08-01T19:51:32.123 INFO:teuthology.orchestra.run.smithi006.stdout:(31/134): ceph-mgr-rook-17.2.6-823.g893fa35f.el 710 kB/s | 47 kB 00:00 2023-08-01T19:51:32.173 INFO:teuthology.orchestra.run.smithi006.stdout:(32/134): ceph-prometheus-alerts-17.2.6-823.g89 291 kB/s | 14 kB 00:00 2023-08-01T19:51:32.191 INFO:teuthology.orchestra.run.smithi008.stdout:(64/134): fuse-2.9.7-17.el8.x86_64.rpm 302 kB/s | 83 kB 00:00 2023-08-01T19:51:32.201 INFO:teuthology.orchestra.run.smithi101.stdout: Upgrading : libblkid-2.32.1-42.el8.x86_64 2/147 2023-08-01T19:51:32.265 INFO:teuthology.orchestra.run.smithi006.stdout:(33/134): ceph-volume-17.2.6-823.g893fa35f.el8. 2.8 MB/s | 264 kB 00:00 2023-08-01T19:51:32.275 INFO:teuthology.orchestra.run.smithi101.stdout: Running scriptlet: libblkid-2.32.1-42.el8.x86_64 2/147 2023-08-01T19:51:32.315 INFO:teuthology.orchestra.run.smithi006.stdout:(34/134): cephadm-17.2.6-823.g893fa35f.el8.noar 1.6 MB/s | 80 kB 00:00 2023-08-01T19:51:32.416 INFO:teuthology.orchestra.run.smithi008.stdout:(65/134): keyutils-libs-devel-1.5.10-9.el8.x86_ 107 kB/s | 48 kB 00:00 2023-08-01T19:51:32.558 INFO:teuthology.orchestra.run.smithi008.stdout:(66/134): libaio-devel-0.3.112-1.el8.x86_64.rpm 132 kB/s | 19 kB 00:00 2023-08-01T19:51:32.572 INFO:teuthology.orchestra.run.smithi155.stdout:(134/134): librados2-17.2.6-823.g893fa35f.el8.x 1.3 MB/s | 3.5 MB 00:02 2023-08-01T19:51:32.575 INFO:teuthology.orchestra.run.smithi155.stdout:-------------------------------------------------------------------------------- 2023-08-01T19:51:32.575 INFO:teuthology.orchestra.run.smithi155.stdout:Total 7.9 MB/s | 208 MB 00:26 2023-08-01T19:51:32.597 INFO:teuthology.orchestra.run.smithi101.stdout: Installing : liboath-2.6.2-3.el8.x86_64 3/147 2023-08-01T19:51:32.617 INFO:teuthology.orchestra.run.smithi008.stdout:(67/134): krb5-devel-1.18.2-22.el8.x86_64.rpm 1.3 MB/s | 561 kB 00:00 2023-08-01T19:51:32.717 INFO:teuthology.orchestra.run.smithi008.stdout:(68/134): libcom_err-devel-1.45.6-5.el8.x86_64. 244 kB/s | 39 kB 00:00 2023-08-01T19:51:32.789 INFO:teuthology.orchestra.run.smithi101.stdout: Installing : thrift-0.13.0-2.el8.x86_64 4/147 2023-08-01T19:51:32.834 INFO:teuthology.orchestra.run.smithi008.stdout:(69/134): libgfortran-8.5.0-20.el8.x86_64.rpm 2.9 MB/s | 645 kB 00:00 2023-08-01T19:51:32.993 INFO:teuthology.orchestra.run.smithi101.stdout: Installing : librabbitmq-0.9.0-4.el8.x86_64 5/147 2023-08-01T19:51:33.067 INFO:teuthology.orchestra.run.smithi008.stdout:(70/134): python3-scipy-1.0.0-21.module_el8.5.0 4.4 MB/s | 14 MB 00:03 2023-08-01T19:51:33.101 INFO:teuthology.orchestra.run.smithi008.stdout:(71/134): librabbitmq-0.9.0-4.el8.x86_64.rpm 176 kB/s | 47 kB 00:00 2023-08-01T19:51:33.126 INFO:teuthology.orchestra.run.smithi008.stdout:(72/134): libquadmath-8.5.0-20.el8.x86_64.rpm 421 kB/s | 172 kB 00:00 2023-08-01T19:51:33.160 INFO:teuthology.orchestra.run.smithi101.stdout: Installing : lttng-ust-2.8.1-11.el8.x86_64 6/147 2023-08-01T19:51:33.243 INFO:teuthology.orchestra.run.smithi008.stdout:(73/134): libsepol-devel-2.9-3.el8.x86_64.rpm 613 kB/s | 87 kB 00:00 2023-08-01T19:51:33.285 INFO:teuthology.orchestra.run.smithi008.stdout:(74/134): libuuid-devel-2.32.1-42.el8.x86_64.rp 627 kB/s | 99 kB 00:00 2023-08-01T19:51:33.368 INFO:teuthology.orchestra.run.smithi008.stdout:(75/134): libverto-devel-0.3.2-2.el8.x86_64.rpm 144 kB/s | 18 kB 00:00 2023-08-01T19:51:33.399 INFO:teuthology.orchestra.run.smithi155.stdout:Running transaction check 2023-08-01T19:51:33.410 INFO:teuthology.orchestra.run.smithi008.stdout:(76/134): libzstd-devel-1.4.4-1.el8.x86_64.rpm 350 kB/s | 44 kB 00:00 2023-08-01T19:51:33.540 INFO:teuthology.orchestra.run.smithi006.stdout:(35/134): automake-1.16.1-7.el8.noarch.rpm 583 kB/s | 713 kB 00:01 2023-08-01T19:51:33.542 INFO:teuthology.orchestra.run.smithi101.stdout: Running scriptlet: lttng-ust-2.8.1-11.el8.x86_64 6/147 2023-08-01T19:51:33.711 INFO:teuthology.orchestra.run.smithi008.stdout:(77/134): openssl-devel-1.1.1k-9.el8.x86_64.rpm 9.3 MB/s | 3.2 MB 00:00 2023-08-01T19:51:33.718 INFO:teuthology.orchestra.run.smithi101.stdout: Upgrading : librados2-2:17.2.6-823.g893fa35f.el8.x86_64 7/147 2023-08-01T19:51:33.736 INFO:teuthology.orchestra.run.smithi008.stdout:(78/134): libselinux-devel-2.9-8.el8.x86_64.rpm 300 kB/s | 200 kB 00:00 2023-08-01T19:51:33.770 INFO:teuthology.orchestra.run.smithi008.stdout:(79/134): pcre2-devel-10.32-3.el8.x86_64.rpm 1.6 MB/s | 605 kB 00:00 2023-08-01T19:51:33.820 INFO:teuthology.orchestra.run.smithi155.stdout:Transaction check succeeded. 2023-08-01T19:51:33.820 INFO:teuthology.orchestra.run.smithi155.stdout:Running transaction test 2023-08-01T19:51:33.836 INFO:teuthology.orchestra.run.smithi008.stdout:(80/134): pcre2-utf16-10.32-3.el8.x86_64.rpm 1.8 MB/s | 229 kB 00:00 2023-08-01T19:51:33.920 INFO:teuthology.orchestra.run.smithi008.stdout:(81/134): python3-cffi-1.11.5-6.el8.x86_64.rpm 1.6 MB/s | 249 kB 00:00 2023-08-01T19:51:33.954 INFO:teuthology.orchestra.run.smithi008.stdout:(82/134): pcre2-utf32-10.32-3.el8.x86_64.rpm 1.0 MB/s | 220 kB 00:00 2023-08-01T19:51:34.004 INFO:teuthology.orchestra.run.smithi008.stdout:(83/134): python3-cryptography-3.2.1-6.el8.x86_ 3.7 MB/s | 641 kB 00:00 2023-08-01T19:51:34.030 INFO:teuthology.orchestra.run.smithi008.stdout:(84/134): python3-jwt-1.6.1-2.el8.noarch.rpm 390 kB/s | 43 kB 00:00 2023-08-01T19:51:34.096 INFO:teuthology.orchestra.run.smithi008.stdout:(85/134): python3-oauthlib-2.1.0-1.el8.noarch.r 1.1 MB/s | 155 kB 00:00 2023-08-01T19:51:34.122 INFO:teuthology.orchestra.run.smithi008.stdout:(86/134): python3-pycparser-2.14-14.el8.noarch. 932 kB/s | 109 kB 00:00 2023-08-01T19:51:34.142 INFO:teuthology.orchestra.run.smithi101.stdout: Running scriptlet: librados2-2:17.2.6-823.g893fa35f.el8.x86_64 7/147 2023-08-01T19:51:34.147 INFO:teuthology.orchestra.run.smithi008.stdout:(87/134): python3-requests-oauthlib-1.0.0-1.el8 364 kB/s | 43 kB 00:00 2023-08-01T19:51:34.222 INFO:teuthology.orchestra.run.smithi008.stdout:(88/134): xfsprogs-devel-5.0.0-12.el8.x86_64.rp 594 kB/s | 74 kB 00:00 2023-08-01T19:51:34.239 INFO:teuthology.orchestra.run.smithi008.stdout:(89/134): zlib-devel-1.2.11-21.el8.x86_64.rpm 495 kB/s | 58 kB 00:00 2023-08-01T19:51:34.310 INFO:teuthology.orchestra.run.smithi101.stdout: Upgrading : librbd1-2:17.2.6-823.g893fa35f.el8.x86_64 8/147 2023-08-01T19:51:34.364 INFO:teuthology.orchestra.run.smithi008.stdout:(90/134): liboath-2.6.2-3.el8.x86_64.rpm 415 kB/s | 59 kB 00:00 2023-08-01T19:51:34.390 INFO:teuthology.orchestra.run.smithi008.stdout:(91/134): libunwind-1.3.1-3.el8.x86_64.rpm 500 kB/s | 75 kB 00:00 2023-08-01T19:51:34.415 INFO:teuthology.orchestra.run.smithi008.stdout:(92/134): gperftools-libs-2.7-9.el8.x86_64.rpm 1.1 MB/s | 306 kB 00:00 2023-08-01T19:51:34.441 INFO:teuthology.orchestra.run.smithi101.stdout: Running scriptlet: librbd1-2:17.2.6-823.g893fa35f.el8.x86_64 8/147 2023-08-01T19:51:34.448 INFO:teuthology.orchestra.run.smithi008.stdout:(93/134): python3-bcrypt-3.1.6-2.el8.1.x86_64.r 747 kB/s | 44 kB 00:00 2023-08-01T19:51:34.510 INFO:teuthology.orchestra.run.smithi008.stdout:(94/134): python3-beautifulsoup4-4.6.3-2.el8.1. 1.9 MB/s | 185 kB 00:00 2023-08-01T19:51:34.541 INFO:teuthology.orchestra.run.smithi008.stdout:(95/134): python3-cachetools-3.1.1-4.el8.noarch 359 kB/s | 33 kB 00:00 2023-08-01T19:51:34.566 INFO:teuthology.orchestra.run.smithi008.stdout:(96/134): python3-certifi-2018.10.15-7.el8.noar 290 kB/s | 16 kB 00:00 2023-08-01T19:51:34.592 INFO:teuthology.orchestra.run.smithi008.stdout:(97/134): python3-asyncssh-2.7.0-2.el8.noarch.r 2.1 MB/s | 476 kB 00:00 2023-08-01T19:51:34.650 INFO:teuthology.orchestra.run.smithi008.stdout:(98/134): python3-google-auth-1.1.1-10.el8.noar 1.4 MB/s | 81 kB 00:00 2023-08-01T19:51:34.668 INFO:teuthology.orchestra.run.smithi101.stdout: Installing : libcephfs2-2:17.2.6-823.g893fa35f.el8.x86_64 9/147 2023-08-01T19:51:34.675 INFO:teuthology.orchestra.run.smithi008.stdout:(99/134): python3-cheroot-8.5.2-1.el8.noarch.rp 1.3 MB/s | 173 kB 00:00 2023-08-01T19:51:34.700 INFO:teuthology.orchestra.run.smithi008.stdout:(100/134): python3-cherrypy-18.4.0-1.el8.noarch 2.8 MB/s | 384 kB 00:00 2023-08-01T19:51:34.726 INFO:teuthology.orchestra.run.smithi008.stdout:(101/134): python3-jaraco-6.2-6.el8.noarch.rpm 147 kB/s | 11 kB 00:00 2023-08-01T19:51:34.751 INFO:teuthology.orchestra.run.smithi008.stdout:(102/134): python3-jaraco-functools-2.0-4.el8.n 351 kB/s | 18 kB 00:00 2023-08-01T19:51:34.761 INFO:teuthology.orchestra.run.smithi101.stdout: Running scriptlet: libcephfs2-2:17.2.6-823.g893fa35f.el8.x86_64 9/147 2023-08-01T19:51:34.784 INFO:teuthology.orchestra.run.smithi008.stdout:(103/134): python3-logutils-0.3.5-11.el8.noarch 832 kB/s | 49 kB 00:00 2023-08-01T19:51:34.810 INFO:teuthology.orchestra.run.smithi008.stdout:(104/134): python3-more-itertools-7.2.0-3.el8.n 1.0 MB/s | 59 kB 00:00 2023-08-01T19:51:34.843 INFO:teuthology.orchestra.run.smithi008.stdout:(105/134): python3-kubernetes-11.0.0-6.el8.noar 8.2 MB/s | 1.2 MB 00:00 2023-08-01T19:51:34.869 INFO:teuthology.orchestra.run.smithi008.stdout:(106/134): python3-natsort-7.1.1-2.el8.noarch.r 719 kB/s | 60 kB 00:00 2023-08-01T19:51:34.894 INFO:teuthology.orchestra.run.smithi008.stdout:(107/134): python3-pecan-1.3.2-9.el8.noarch.rpm 3.3 MB/s | 283 kB 00:00 2023-08-01T19:51:34.919 INFO:teuthology.orchestra.run.smithi008.stdout:(108/134): python3-portend-2.6-1.el8.noarch.rpm 206 kB/s | 16 kB 00:00 2023-08-01T19:51:34.944 INFO:teuthology.orchestra.run.smithi008.stdout:(109/134): python3-repoze-lru-0.7-6.el8.noarch. 445 kB/s | 34 kB 00:00 2023-08-01T19:51:34.970 INFO:teuthology.orchestra.run.smithi008.stdout:(110/134): python3-routes-2.4.1-12.el8.noarch.r 2.5 MB/s | 196 kB 00:00 2023-08-01T19:51:34.974 INFO:teuthology.orchestra.run.smithi101.stdout: Installing : python3-rados-2:17.2.6-823.g893fa35f.el8.x86_64 10/147 2023-08-01T19:51:34.995 INFO:teuthology.orchestra.run.smithi008.stdout:(111/134): python3-rsa-4.9-2.el8.noarch.rpm 850 kB/s | 64 kB 00:00 2023-08-01T19:51:35.012 INFO:teuthology.orchestra.run.smithi008.stdout:(112/134): python3-simplegeneric-0.8.1-17.el8.n 279 kB/s | 19 kB 00:00 2023-08-01T19:51:35.029 INFO:teuthology.orchestra.run.smithi008.stdout:(113/134): python3-singledispatch-3.4.0.3-18.el 406 kB/s | 24 kB 00:00 2023-08-01T19:51:35.046 INFO:teuthology.orchestra.run.smithi008.stdout:(114/134): python3-tempora-1.14.1-5.el8.noarch. 575 kB/s | 29 kB 00:00 2023-08-01T19:51:35.063 INFO:teuthology.orchestra.run.smithi008.stdout:(115/134): python3-trustme-0.6.0-4.el8.noarch.r 541 kB/s | 27 kB 00:00 2023-08-01T19:51:35.088 INFO:teuthology.orchestra.run.smithi008.stdout:(116/134): python3-waitress-1.4.3-1.el8.noarch. 4.2 MB/s | 255 kB 00:00 2023-08-01T19:51:35.114 INFO:teuthology.orchestra.run.smithi008.stdout:(117/134): python3-webob-1.8.5-1.el8.1.noarch.r 3.7 MB/s | 251 kB 00:00 2023-08-01T19:51:35.159 INFO:teuthology.orchestra.run.smithi101.stdout: Installing : librdkafka-0.11.4-3.el8.x86_64 11/147 2023-08-01T19:51:35.180 INFO:teuthology.orchestra.run.smithi008.stdout:(118/134): python3-websocket-client-0.56.0-5.el 523 kB/s | 61 kB 00:00 2023-08-01T19:51:35.198 INFO:teuthology.orchestra.run.smithi008.stdout:(119/134): python3-zc-lockfile-2.0-2.el8.noarch 274 kB/s | 23 kB 00:00 2023-08-01T19:51:35.207 INFO:teuthology.orchestra.run.smithi155.stdout:Transaction test succeeded. 2023-08-01T19:51:35.211 INFO:teuthology.orchestra.run.smithi155.stdout:Running transaction 2023-08-01T19:51:35.222 INFO:teuthology.orchestra.run.smithi008.stdout:(120/134): python3-webtest-2.0.33-1.el8.noarch. 637 kB/s | 85 kB 00:00 2023-08-01T19:51:35.240 INFO:teuthology.orchestra.run.smithi006.stdout:(36/134): ceph-test-17.2.6-823.g893fa35f.el8.x8 6.4 MB/s | 52 MB 00:08 2023-08-01T19:51:35.266 INFO:teuthology.orchestra.run.smithi006.stdout:(37/134): bison-3.0.4-10.el8.x86_64.rpm 399 kB/s | 688 kB 00:01 2023-08-01T19:51:35.448 INFO:teuthology.orchestra.run.smithi008.stdout:(121/134): thrift-0.13.0-2.el8.x86_64.rpm 6.5 MB/s | 1.7 MB 00:00 2023-08-01T19:51:35.565 INFO:teuthology.orchestra.run.smithi008.stdout:(122/134): elfutils-debuginfod-client-0.189-2.e 651 kB/s | 76 kB 00:00 2023-08-01T19:51:35.616 INFO:teuthology.orchestra.run.smithi006.stdout:(38/134): ceph-mgr-diskprediction-local-17.2.6- 2.0 MB/s | 7.4 MB 00:03 2023-08-01T19:51:35.690 INFO:teuthology.orchestra.run.smithi008.stdout:(123/134): elfutils-libelf-0.189-2.el8.x86_64.r 1.8 MB/s | 232 kB 00:00 2023-08-01T19:51:35.693 INFO:teuthology.orchestra.run.smithi101.stdout: Running scriptlet: librdkafka-0.11.4-3.el8.x86_64 11/147 2023-08-01T19:51:35.824 INFO:teuthology.orchestra.run.smithi008.stdout:(124/134): elfutils-libs-0.189-2.el8.x86_64.rpm 2.2 MB/s | 302 kB 00:00 2023-08-01T19:51:35.842 INFO:teuthology.orchestra.run.smithi101.stdout: Installing : librgw2-2:17.2.6-823.g893fa35f.el8.x86_64 12/147 2023-08-01T19:51:35.937 INFO:teuthology.orchestra.run.smithi101.stdout: Running scriptlet: librgw2-2:17.2.6-823.g893fa35f.el8.x86_64 12/147 2023-08-01T19:51:35.949 INFO:teuthology.orchestra.run.smithi008.stdout:(125/134): libblkid-2.32.1-42.el8.x86_64.rpm 1.7 MB/s | 220 kB 00:00 2023-08-01T19:51:36.075 INFO:teuthology.orchestra.run.smithi008.stdout:(126/134): libfdisk-2.32.1-42.el8.x86_64.rpm 2.0 MB/s | 253 kB 00:00 2023-08-01T19:51:36.129 INFO:teuthology.orchestra.run.smithi101.stdout: Upgrading : elfutils-libelf-0.189-2.el8.x86_64 13/147 2023-08-01T19:51:36.200 INFO:teuthology.orchestra.run.smithi006.stdout:(39/134): jq-1.6-7.el8.x86_64.rpm 217 kB/s | 202 kB 00:00 2023-08-01T19:51:36.200 INFO:teuthology.orchestra.run.smithi008.stdout:(127/134): libmount-2.32.1-42.el8.x86_64.rpm 1.9 MB/s | 236 kB 00:00 2023-08-01T19:51:36.325 INFO:teuthology.orchestra.run.smithi008.stdout:(128/134): libsmartcols-2.32.1-42.el8.x86_64.rp 1.4 MB/s | 179 kB 00:00 2023-08-01T19:51:36.350 INFO:teuthology.orchestra.run.smithi006.stdout:(40/134): flex-2.6.1-9.el8.x86_64.rpm 288 kB/s | 320 kB 00:01 2023-08-01T19:51:36.364 INFO:teuthology.orchestra.run.smithi101.stdout: Installing : python3-more-itertools-7.2.0-3.el8.noarch 14/147 2023-08-01T19:51:36.459 INFO:teuthology.orchestra.run.smithi008.stdout:(129/134): libuuid-2.32.1-42.el8.x86_64.rpm 738 kB/s | 98 kB 00:00 2023-08-01T19:51:36.575 INFO:teuthology.orchestra.run.smithi101.stdout: Installing : python3-pyasn1-0.3.7-6.el8.noarch 15/147 2023-08-01T19:51:36.584 INFO:teuthology.orchestra.run.smithi008.stdout:(130/134): librbd1-17.2.6-823.g893fa35f.el8.x86 2.6 MB/s | 3.6 MB 00:01 2023-08-01T19:51:36.642 INFO:teuthology.orchestra.run.smithi006.stdout:(41/134): librdkafka-0.11.4-3.el8.x86_64.rpm 345 kB/s | 354 kB 00:01 2023-08-01T19:51:36.651 INFO:teuthology.orchestra.run.smithi008.stdout:(131/134): util-linux-2.32.1-42.el8.x86_64.rpm 14 MB/s | 2.6 MB 00:00 2023-08-01T19:51:36.734 INFO:teuthology.orchestra.run.smithi101.stdout: Installing : libcephsqlite-2:17.2.6-823.g893fa35f.el8.x86_64 16/147 2023-08-01T19:51:36.801 INFO:teuthology.orchestra.run.smithi008.stdout:(132/134): xfsprogs-5.0.0-12.el8.x86_64.rpm 7.2 MB/s | 1.1 MB 00:00 2023-08-01T19:51:36.844 INFO:teuthology.orchestra.run.smithi101.stdout: Running scriptlet: libcephsqlite-2:17.2.6-823.g893fa35f.el8.x86_64 16/147 2023-08-01T19:51:36.992 INFO:teuthology.orchestra.run.smithi101.stdout: Installing : libradosstriper1-2:17.2.6-823.g893fa35f.el8.x86_ 17/147 2023-08-01T19:51:37.110 INFO:teuthology.orchestra.run.smithi008.stdout:(133/134): util-linux-user-2.32.1-42.el8.x86_64 195 kB/s | 102 kB 00:00 2023-08-01T19:51:37.193 INFO:teuthology.orchestra.run.smithi101.stdout: Running scriptlet: libradosstriper1-2:17.2.6-823.g893fa35f.el8.x86_ 17/147 2023-08-01T19:51:37.217 INFO:teuthology.orchestra.run.smithi006.stdout:(42/134): lttng-ust-2.8.1-11.el8.x86_64.rpm 299 kB/s | 259 kB 00:00 2023-08-01T19:51:37.342 INFO:teuthology.orchestra.run.smithi006.stdout:(43/134): libtool-2.4.6-25.el8.x86_64.rpm 620 kB/s | 709 kB 00:01 2023-08-01T19:51:37.467 INFO:teuthology.orchestra.run.smithi101.stdout: Upgrading : xfsprogs-5.0.0-12.el8.x86_64 18/147 2023-08-01T19:51:37.501 INFO:teuthology.orchestra.run.smithi006.stdout:(44/134): oniguruma-6.8.2-2.el8.x86_64.rpm 218 kB/s | 187 kB 00:00 2023-08-01T19:51:37.583 INFO:teuthology.orchestra.run.smithi101.stdout: Running scriptlet: xfsprogs-5.0.0-12.el8.x86_64 18/147 2023-08-01T19:51:37.773 INFO:teuthology.orchestra.run.smithi101.stdout: Installing : python3-webob-1.8.5-1.el8.1.noarch 19/147 2023-08-01T19:51:37.924 INFO:teuthology.orchestra.run.smithi101.stdout: Installing : zlib-devel-1.2.11-21.el8.x86_64 20/147 2023-08-01T19:51:38.117 INFO:teuthology.orchestra.run.smithi101.stdout: Installing : libquadmath-8.5.0-20.el8.x86_64 21/147 2023-08-01T19:51:38.227 INFO:teuthology.orchestra.run.smithi008.stdout:(134/134): librados2-17.2.6-823.g893fa35f.el8.x 1.1 MB/s | 3.5 MB 00:03 2023-08-01T19:51:38.229 INFO:teuthology.orchestra.run.smithi008.stdout:-------------------------------------------------------------------------------- 2023-08-01T19:51:38.230 INFO:teuthology.orchestra.run.smithi008.stdout:Total 6.1 MB/s | 208 MB 00:34 2023-08-01T19:51:38.252 INFO:teuthology.orchestra.run.smithi101.stdout: Running scriptlet: libquadmath-8.5.0-20.el8.x86_64 21/147 2023-08-01T19:51:38.392 INFO:teuthology.orchestra.run.smithi101.stdout: Installing : libgfortran-8.5.0-20.el8.x86_64 22/147 2023-08-01T19:51:38.992 INFO:teuthology.orchestra.run.smithi101.stdout: Running scriptlet: libgfortran-8.5.0-20.el8.x86_64 22/147 2023-08-01T19:51:39.039 INFO:teuthology.orchestra.run.smithi008.stdout:Running transaction check 2023-08-01T19:51:39.176 INFO:teuthology.orchestra.run.smithi101.stdout: Installing : openblas-0.3.15-4.el8.x86_64 23/147 2023-08-01T19:51:39.176 INFO:teuthology.orchestra.run.smithi006.stdout:(45/134): openblas-threads-0.3.15-4.el8.x86_64. 2.6 MB/s | 4.9 MB 00:01 2023-08-01T19:51:39.335 INFO:teuthology.orchestra.run.smithi006.stdout:(46/134): openblas-0.3.15-4.el8.x86_64.rpm 2.2 MB/s | 4.7 MB 00:02 2023-08-01T19:51:39.402 INFO:teuthology.orchestra.run.smithi006.stdout:(47/134): python3-babel-2.5.1-7.el8.noarch.rpm 2.5 MB/s | 4.8 MB 00:01 2023-08-01T19:51:39.490 INFO:teuthology.orchestra.run.smithi008.stdout:Transaction check succeeded. 2023-08-01T19:51:39.490 INFO:teuthology.orchestra.run.smithi008.stdout:Running transaction test 2023-08-01T19:51:39.661 INFO:teuthology.orchestra.run.smithi006.stdout:(48/134): python3-jsonpatch-1.21-2.el8.noarch.r 82 kB/s | 27 kB 00:00 2023-08-01T19:51:39.727 INFO:teuthology.orchestra.run.smithi006.stdout:(49/134): python3-jsonpointer-1.10-11.el8.noarc 61 kB/s | 20 kB 00:00 2023-08-01T19:51:39.793 INFO:teuthology.orchestra.run.smithi101.stdout: Running scriptlet: openblas-0.3.15-4.el8.x86_64 23/147 2023-08-01T19:51:39.942 INFO:teuthology.orchestra.run.smithi101.stdout: Installing : openblas-threads-0.3.15-4.el8.x86_64 24/147 2023-08-01T19:51:40.069 INFO:teuthology.orchestra.run.smithi006.stdout:(50/134): python3-markupsafe-0.23-19.el8.x86_64 113 kB/s | 39 kB 00:00 2023-08-01T19:51:40.412 INFO:teuthology.orchestra.run.smithi006.stdout:(51/134): python3-jinja2-2.10.1-3.el8.noarch.rp 436 kB/s | 538 kB 00:01 2023-08-01T19:51:40.445 INFO:teuthology.orchestra.run.smithi006.stdout:(52/134): python3-mako-1.0.6-14.el8.noarch.rpm 200 kB/s | 157 kB 00:00 2023-08-01T19:51:40.511 INFO:teuthology.orchestra.run.smithi155.stdout: Preparing : 1/1 2023-08-01T19:51:40.547 INFO:teuthology.orchestra.run.smithi155.stdout: Running scriptlet: libuuid-2.32.1-42.el8.x86_64 1/1 2023-08-01T19:51:40.648 INFO:teuthology.orchestra.run.smithi101.stdout: Running scriptlet: openblas-threads-0.3.15-4.el8.x86_64 24/147 2023-08-01T19:51:40.701 INFO:teuthology.orchestra.run.smithi155.stdout: Upgrading : libuuid-2.32.1-42.el8.x86_64 1/147 2023-08-01T19:51:40.779 INFO:teuthology.orchestra.run.smithi006.stdout:(53/134): python3-prettytable-0.7.2-14.el8.noar 132 kB/s | 44 kB 00:00 2023-08-01T19:51:40.784 INFO:teuthology.orchestra.run.smithi155.stdout: Running scriptlet: libuuid-2.32.1-42.el8.x86_64 1/147 2023-08-01T19:51:40.921 INFO:teuthology.orchestra.run.smithi008.stdout:Transaction test succeeded. 2023-08-01T19:51:40.924 INFO:teuthology.orchestra.run.smithi008.stdout:Running transaction 2023-08-01T19:51:40.959 INFO:teuthology.orchestra.run.smithi155.stdout: Upgrading : libblkid-2.32.1-42.el8.x86_64 2/147 2023-08-01T19:51:40.968 INFO:teuthology.orchestra.run.smithi101.stdout: Installing : python3-numpy-1:1.14.3-10.el8.x86_64 25/147 2023-08-01T19:51:41.039 INFO:teuthology.orchestra.run.smithi155.stdout: Running scriptlet: libblkid-2.32.1-42.el8.x86_64 2/147 2023-08-01T19:51:41.181 INFO:teuthology.orchestra.run.smithi101.stdout: Installing : python3-werkzeug-0.12.2-4.el8.noarch 26/147 2023-08-01T19:51:41.346 INFO:teuthology.orchestra.run.smithi006.stdout:(54/134): python3-numpy-f2py-1.14.3-10.el8.x86_ 241 kB/s | 225 kB 00:00 2023-08-01T19:51:41.370 INFO:teuthology.orchestra.run.smithi101.stdout: Installing : python3-pytz-2017.2-9.el8.noarch 27/147 2023-08-01T19:51:41.496 INFO:teuthology.orchestra.run.smithi006.stdout:(55/134): python3-pyOpenSSL-19.0.0-1.el8.noarch 144 kB/s | 103 kB 00:00 2023-08-01T19:51:41.534 INFO:teuthology.orchestra.run.smithi155.stdout: Installing : liboath-2.6.2-3.el8.x86_64 3/147 2023-08-01T19:51:41.577 INFO:teuthology.orchestra.run.smithi101.stdout: Installing : python3-markupsafe-0.23-19.el8.x86_64 28/147 2023-08-01T19:51:41.596 INFO:teuthology.orchestra.run.smithi006.stdout:(56/134): python3-numpy-1.14.3-10.el8.x86_64.rp 2.4 MB/s | 3.7 MB 00:01 2023-08-01T19:51:41.772 INFO:teuthology.orchestra.run.smithi155.stdout: Installing : thrift-0.13.0-2.el8.x86_64 4/147 2023-08-01T19:51:41.811 INFO:teuthology.orchestra.run.smithi101.stdout: Installing : python3-ceph-common-2:17.2.6-823.g893fa35f.el8.x 29/147 2023-08-01T19:51:41.962 INFO:teuthology.orchestra.run.smithi155.stdout: Installing : librabbitmq-0.9.0-4.el8.x86_64 5/147 2023-08-01T19:51:41.985 INFO:teuthology.orchestra.run.smithi101.stdout: Installing : python3-ceph-argparse-2:17.2.6-823.g893fa35f.el8 30/147 2023-08-01T19:51:42.142 INFO:teuthology.orchestra.run.smithi155.stdout: Installing : lttng-ust-2.8.1-11.el8.x86_64 6/147 2023-08-01T19:51:42.146 INFO:teuthology.orchestra.run.smithi006.stdout:(57/134): python3-pytz-2017.2-9.el8.noarch.rpm 98 kB/s | 54 kB 00:00 2023-08-01T19:51:42.171 INFO:teuthology.orchestra.run.smithi006.stdout:(58/134): python3-pyasn1-0.3.7-6.el8.noarch.rpm 153 kB/s | 126 kB 00:00 2023-08-01T19:51:42.212 INFO:teuthology.orchestra.run.smithi101.stdout: Installing : python3-cephfs-2:17.2.6-823.g893fa35f.el8.x86_64 31/147 2023-08-01T19:51:42.230 INFO:teuthology.orchestra.run.smithi006.stdout:(59/134): python3-pyasn1-modules-0.3.7-6.el8.no 150 kB/s | 110 kB 00:00 2023-08-01T19:51:42.524 INFO:teuthology.orchestra.run.smithi155.stdout: Running scriptlet: lttng-ust-2.8.1-11.el8.x86_64 6/147 2023-08-01T19:51:42.751 INFO:teuthology.orchestra.run.smithi155.stdout: Upgrading : librados2-2:17.2.6-823.g893fa35f.el8.x86_64 7/147 2023-08-01T19:51:43.151 INFO:teuthology.orchestra.run.smithi155.stdout: Running scriptlet: librados2-2:17.2.6-823.g893fa35f.el8.x86_64 7/147 2023-08-01T19:51:43.189 INFO:teuthology.orchestra.run.smithi006.stdout:(60/134): python3-werkzeug-0.12.2-4.el8.noarch. 450 kB/s | 457 kB 00:01 2023-08-01T19:51:43.198 INFO:teuthology.orchestra.run.smithi101.stdout: Installing : python3-mako-1.0.6-14.el8.noarch 32/147 2023-08-01T19:51:43.334 INFO:teuthology.orchestra.run.smithi155.stdout: Upgrading : librbd1-2:17.2.6-823.g893fa35f.el8.x86_64 8/147 2023-08-01T19:51:43.406 INFO:teuthology.orchestra.run.smithi006.stdout:(61/134): socat-1.7.4.1-1.el8.x86_64.rpm 275 kB/s | 323 kB 00:01 2023-08-01T19:51:43.461 INFO:teuthology.orchestra.run.smithi155.stdout: Running scriptlet: librbd1-2:17.2.6-823.g893fa35f.el8.x86_64 8/147 2023-08-01T19:51:43.523 INFO:teuthology.orchestra.run.smithi101.stdout: Installing : python3-babel-2.5.1-7.el8.noarch 33/147 2023-08-01T19:51:43.650 INFO:teuthology.orchestra.run.smithi155.stdout: Installing : libcephfs2-2:17.2.6-823.g893fa35f.el8.x86_64 9/147 2023-08-01T19:51:43.689 INFO:teuthology.orchestra.run.smithi006.stdout:(62/134): xmlstarlet-1.6.1-20.el8.x86_64.rpm 141 kB/s | 71 kB 00:00 2023-08-01T19:51:43.745 INFO:teuthology.orchestra.run.smithi155.stdout: Running scriptlet: libcephfs2-2:17.2.6-823.g893fa35f.el8.x86_64 9/147 2023-08-01T19:51:43.788 INFO:teuthology.orchestra.run.smithi101.stdout: Installing : python3-jinja2-2.10.1-3.el8.noarch 34/147 2023-08-01T19:51:43.848 INFO:teuthology.orchestra.run.smithi006.stdout:(63/134): elfutils-libelf-devel-0.189-2.el8.x86 139 kB/s | 61 kB 00:00 2023-08-01T19:51:43.967 INFO:teuthology.orchestra.run.smithi101.stdout: Installing : python3-numpy-f2py-1:1.14.3-10.el8.x86_64 35/147 2023-08-01T19:51:43.999 INFO:teuthology.orchestra.run.smithi155.stdout: Installing : python3-rados-2:17.2.6-823.g893fa35f.el8.x86_64 10/147 2023-08-01T19:51:44.031 INFO:teuthology.orchestra.run.smithi006.stdout:(64/134): keyutils-libs-devel-1.5.10-9.el8.x86_ 262 kB/s | 48 kB 00:00 2023-08-01T19:51:44.190 INFO:teuthology.orchestra.run.smithi006.stdout:(65/134): fuse-2.9.7-17.el8.x86_64.rpm 166 kB/s | 83 kB 00:00 2023-08-01T19:51:44.200 INFO:teuthology.orchestra.run.smithi155.stdout: Installing : librdkafka-0.11.4-3.el8.x86_64 11/147 2023-08-01T19:51:44.357 INFO:teuthology.orchestra.run.smithi006.stdout:(66/134): libaio-devel-0.3.112-1.el8.x86_64.rpm 112 kB/s | 19 kB 00:00 2023-08-01T19:51:44.524 INFO:teuthology.orchestra.run.smithi006.stdout:(67/134): krb5-devel-1.18.2-22.el8.x86_64.rpm 1.1 MB/s | 561 kB 00:00 2023-08-01T19:51:44.549 INFO:teuthology.orchestra.run.smithi006.stdout:(68/134): libcom_err-devel-1.45.6-5.el8.x86_64. 202 kB/s | 39 kB 00:00 2023-08-01T19:51:44.753 INFO:teuthology.orchestra.run.smithi155.stdout: Running scriptlet: librdkafka-0.11.4-3.el8.x86_64 11/147 2023-08-01T19:51:44.758 INFO:teuthology.orchestra.run.smithi006.stdout:(69/134): libgfortran-8.5.0-20.el8.x86_64.rpm 2.7 MB/s | 645 kB 00:00 2023-08-01T19:51:44.908 INFO:teuthology.orchestra.run.smithi006.stdout:(70/134): python3-scipy-1.0.0-21.module_el8.5.0 5.0 MB/s | 14 MB 00:02 2023-08-01T19:51:44.934 INFO:teuthology.orchestra.run.smithi155.stdout: Installing : librgw2-2:17.2.6-823.g893fa35f.el8.x86_64 12/147 2023-08-01T19:51:44.967 INFO:teuthology.orchestra.run.smithi006.stdout:(71/134): libquadmath-8.5.0-20.el8.x86_64.rpm 413 kB/s | 172 kB 00:00 2023-08-01T19:51:44.992 INFO:teuthology.orchestra.run.smithi006.stdout:(72/134): librabbitmq-0.9.0-4.el8.x86_64.rpm 201 kB/s | 47 kB 00:00 2023-08-01T19:51:45.025 INFO:teuthology.orchestra.run.smithi155.stdout: Running scriptlet: librgw2-2:17.2.6-823.g893fa35f.el8.x86_64 12/147 2023-08-01T19:51:45.126 INFO:teuthology.orchestra.run.smithi006.stdout:(73/134): libsepol-devel-2.9-3.el8.x86_64.rpm 654 kB/s | 87 kB 00:00 2023-08-01T19:51:45.160 INFO:teuthology.orchestra.run.smithi006.stdout:(74/134): libuuid-devel-2.32.1-42.el8.x86_64.rp 596 kB/s | 99 kB 00:00 2023-08-01T19:51:45.229 INFO:teuthology.orchestra.run.smithi155.stdout: Upgrading : elfutils-libelf-0.189-2.el8.x86_64 13/147 2023-08-01T19:51:45.243 INFO:teuthology.orchestra.run.smithi006.stdout:(75/134): libverto-devel-0.3.2-2.el8.x86_64.rpm 154 kB/s | 18 kB 00:00 2023-08-01T19:51:45.293 INFO:teuthology.orchestra.run.smithi006.stdout:(76/134): libzstd-devel-1.4.4-1.el8.x86_64.rpm 328 kB/s | 44 kB 00:00 2023-08-01T19:51:45.464 INFO:teuthology.orchestra.run.smithi155.stdout: Installing : python3-more-itertools-7.2.0-3.el8.noarch 14/147 2023-08-01T19:51:45.518 INFO:teuthology.orchestra.run.smithi006.stdout:(77/134): libselinux-devel-2.9-8.el8.x86_64.rpm 328 kB/s | 200 kB 00:00 2023-08-01T19:51:45.627 INFO:teuthology.orchestra.run.smithi006.stdout:(78/134): openssl-devel-1.1.1k-9.el8.x86_64.rpm 8.3 MB/s | 3.2 MB 00:00 2023-08-01T19:51:45.652 INFO:teuthology.orchestra.run.smithi006.stdout:(79/134): pcre2-devel-10.32-3.el8.x86_64.rpm 1.6 MB/s | 605 kB 00:00 2023-08-01T19:51:45.715 INFO:teuthology.orchestra.run.smithi155.stdout: Installing : python3-pyasn1-0.3.7-6.el8.noarch 15/147 2023-08-01T19:51:45.736 INFO:teuthology.orchestra.run.smithi006.stdout:(80/134): pcre2-utf16-10.32-3.el8.x86_64.rpm 1.0 MB/s | 229 kB 00:00 2023-08-01T19:51:45.762 INFO:teuthology.orchestra.run.smithi006.stdout:(81/134): pcre2-utf32-10.32-3.el8.x86_64.rpm 1.6 MB/s | 220 kB 00:00 2023-08-01T19:51:45.772 INFO:teuthology.orchestra.run.smithi101.stdout: Running scriptlet: python3-numpy-f2py-1:1.14.3-10.el8.x86_64 35/147 2023-08-01T19:51:45.795 INFO:teuthology.orchestra.run.smithi006.stdout:(82/134): python3-cffi-1.11.5-6.el8.x86_64.rpm 1.7 MB/s | 249 kB 00:00 2023-08-01T19:51:45.858 INFO:teuthology.orchestra.run.smithi155.stdout: Installing : libcephsqlite-2:17.2.6-823.g893fa35f.el8.x86_64 16/147 2023-08-01T19:51:45.879 INFO:teuthology.orchestra.run.smithi006.stdout:(83/134): python3-jwt-1.6.1-2.el8.noarch.rpm 365 kB/s | 43 kB 00:00 2023-08-01T19:51:45.929 INFO:teuthology.orchestra.run.smithi006.stdout:(84/134): python3-oauthlib-2.1.0-1.el8.noarch.r 1.1 MB/s | 155 kB 00:00 2023-08-01T19:51:45.953 INFO:teuthology.orchestra.run.smithi155.stdout: Running scriptlet: libcephsqlite-2:17.2.6-823.g893fa35f.el8.x86_64 16/147 2023-08-01T19:51:45.988 INFO:teuthology.orchestra.run.smithi006.stdout:(85/134): python3-cryptography-3.2.1-6.el8.x86_ 2.5 MB/s | 641 kB 00:00 2023-08-01T19:51:46.013 INFO:teuthology.orchestra.run.smithi006.stdout:(86/134): python3-pycparser-2.14-14.el8.noarch. 815 kB/s | 109 kB 00:00 2023-08-01T19:51:46.023 INFO:teuthology.orchestra.run.smithi008.stdout: Preparing : 1/1 2023-08-01T19:51:46.055 INFO:teuthology.orchestra.run.smithi006.stdout:(87/134): python3-requests-oauthlib-1.0.0-1.el8 340 kB/s | 43 kB 00:00 2023-08-01T19:51:46.058 INFO:teuthology.orchestra.run.smithi008.stdout: Running scriptlet: libuuid-2.32.1-42.el8.x86_64 1/1 2023-08-01T19:51:46.070 INFO:teuthology.orchestra.run.smithi101.stdout: Installing : python3-scipy-1.0.0-21.module_el8.5.0+771+e5d9a2 36/147 2023-08-01T19:51:46.113 INFO:teuthology.orchestra.run.smithi006.stdout:(88/134): xfsprogs-devel-5.0.0-12.el8.x86_64.rp 594 kB/s | 74 kB 00:00 2023-08-01T19:51:46.125 INFO:teuthology.orchestra.run.smithi155.stdout: Installing : libradosstriper1-2:17.2.6-823.g893fa35f.el8.x86_ 17/147 2023-08-01T19:51:46.139 INFO:teuthology.orchestra.run.smithi006.stdout:(89/134): zlib-devel-1.2.11-21.el8.x86_64.rpm 463 kB/s | 58 kB 00:00 2023-08-01T19:51:46.198 INFO:teuthology.orchestra.run.smithi008.stdout: Upgrading : libuuid-2.32.1-42.el8.x86_64 1/147 2023-08-01T19:51:46.267 INFO:teuthology.orchestra.run.smithi101.stdout: Installing : python3-pyasn1-modules-0.3.7-6.el8.noarch 37/147 2023-08-01T19:51:46.289 INFO:teuthology.orchestra.run.smithi008.stdout: Running scriptlet: libuuid-2.32.1-42.el8.x86_64 1/147 2023-08-01T19:51:46.302 INFO:teuthology.orchestra.run.smithi155.stdout: Running scriptlet: libradosstriper1-2:17.2.6-823.g893fa35f.el8.x86_ 17/147 2023-08-01T19:51:46.314 INFO:teuthology.orchestra.run.smithi006.stdout:(90/134): liboath-2.6.2-3.el8.x86_64.rpm 294 kB/s | 59 kB 00:00 2023-08-01T19:51:46.339 INFO:teuthology.orchestra.run.smithi006.stdout:(91/134): libunwind-1.3.1-3.el8.x86_64.rpm 375 kB/s | 75 kB 00:00 2023-08-01T19:51:46.364 INFO:teuthology.orchestra.run.smithi006.stdout:(92/134): gperftools-libs-2.7-9.el8.x86_64.rpm 990 kB/s | 306 kB 00:00 2023-08-01T19:51:46.406 INFO:teuthology.orchestra.run.smithi006.stdout:(93/134): python3-bcrypt-3.1.6-2.el8.1.x86_64.r 653 kB/s | 44 kB 00:00 2023-08-01T19:51:46.432 INFO:teuthology.orchestra.run.smithi006.stdout:(94/134): python3-beautifulsoup4-4.6.3-2.el8.1. 2.7 MB/s | 185 kB 00:00 2023-08-01T19:51:46.439 INFO:teuthology.orchestra.run.smithi008.stdout: Upgrading : libblkid-2.32.1-42.el8.x86_64 2/147 2023-08-01T19:51:46.474 INFO:teuthology.orchestra.run.smithi006.stdout:(95/134): python3-cachetools-3.1.1-4.el8.noarch 492 kB/s | 33 kB 00:00 2023-08-01T19:51:46.496 INFO:teuthology.orchestra.run.smithi008.stdout: Running scriptlet: libblkid-2.32.1-42.el8.x86_64 2/147 2023-08-01T19:51:46.499 INFO:teuthology.orchestra.run.smithi006.stdout:(96/134): python3-certifi-2018.10.15-7.el8.noar 243 kB/s | 16 kB 00:00 2023-08-01T19:51:46.500 INFO:teuthology.orchestra.run.smithi101.stdout: Installing : python3-rsa-4.9-2.el8.noarch 38/147 2023-08-01T19:51:46.524 INFO:teuthology.orchestra.run.smithi006.stdout:(97/134): python3-asyncssh-2.7.0-2.el8.noarch.r 2.2 MB/s | 476 kB 00:00 2023-08-01T19:51:46.566 INFO:teuthology.orchestra.run.smithi006.stdout:(98/134): python3-cherrypy-18.4.0-1.el8.noarch. 5.6 MB/s | 384 kB 00:00 2023-08-01T19:51:46.567 INFO:teuthology.orchestra.run.smithi155.stdout: Upgrading : xfsprogs-5.0.0-12.el8.x86_64 18/147 2023-08-01T19:51:46.591 INFO:teuthology.orchestra.run.smithi006.stdout:(99/134): python3-cheroot-8.5.2-1.el8.noarch.rp 1.4 MB/s | 173 kB 00:00 2023-08-01T19:51:46.617 INFO:teuthology.orchestra.run.smithi006.stdout:(100/134): python3-google-auth-1.1.1-10.el8.noa 883 kB/s | 81 kB 00:00 2023-08-01T19:51:46.642 INFO:teuthology.orchestra.run.smithi006.stdout:(101/134): python3-jaraco-6.2-6.el8.noarch.rpm 147 kB/s | 11 kB 00:00 2023-08-01T19:51:46.660 INFO:teuthology.orchestra.run.smithi101.stdout: Upgrading : elfutils-libs-0.189-2.el8.x86_64 39/147 2023-08-01T19:51:46.684 INFO:teuthology.orchestra.run.smithi006.stdout:(102/134): python3-jaraco-functools-2.0-4.el8.n 263 kB/s | 18 kB 00:00 2023-08-01T19:51:46.686 INFO:teuthology.orchestra.run.smithi155.stdout: Running scriptlet: xfsprogs-5.0.0-12.el8.x86_64 18/147 2023-08-01T19:51:46.710 INFO:teuthology.orchestra.run.smithi006.stdout:(103/134): python3-logutils-0.3.5-11.el8.noarch 724 kB/s | 49 kB 00:00 2023-08-01T19:51:46.760 INFO:teuthology.orchestra.run.smithi006.stdout:(104/134): python3-more-itertools-7.2.0-3.el8.n 779 kB/s | 59 kB 00:00 2023-08-01T19:51:46.808 INFO:teuthology.orchestra.run.smithi008.stdout: Installing : liboath-2.6.2-3.el8.x86_64 3/147 2023-08-01T19:51:46.868 INFO:teuthology.orchestra.run.smithi006.stdout:(105/134): python3-natsort-7.1.1-2.el8.noarch.r 380 kB/s | 60 kB 00:00 2023-08-01T19:51:46.869 INFO:teuthology.orchestra.run.smithi101.stdout: Upgrading : elfutils-debuginfod-client-0.189-2.el8.x86_64 40/147 2023-08-01T19:51:46.906 INFO:teuthology.orchestra.run.smithi155.stdout: Installing : python3-webob-1.8.5-1.el8.1.noarch 19/147 2023-08-01T19:51:46.960 INFO:teuthology.orchestra.run.smithi006.stdout:(106/134): python3-pecan-1.3.2-9.el8.noarch.rpm 1.4 MB/s | 283 kB 00:00 2023-08-01T19:51:46.986 INFO:teuthology.orchestra.run.smithi006.stdout:(107/134): python3-portend-2.6-1.el8.noarch.rpm 133 kB/s | 16 kB 00:00 2023-08-01T19:51:47.003 INFO:teuthology.orchestra.run.smithi008.stdout: Installing : thrift-0.13.0-2.el8.x86_64 4/147 2023-08-01T19:51:47.028 INFO:teuthology.orchestra.run.smithi006.stdout:(108/134): python3-kubernetes-11.0.0-6.el8.noar 2.8 MB/s | 1.2 MB 00:00 2023-08-01T19:51:47.053 INFO:teuthology.orchestra.run.smithi006.stdout:(109/134): python3-repoze-lru-0.7-6.el8.noarch. 365 kB/s | 34 kB 00:00 2023-08-01T19:51:47.079 INFO:teuthology.orchestra.run.smithi155.stdout: Installing : zlib-devel-1.2.11-21.el8.x86_64 20/147 2023-08-01T19:51:47.087 INFO:teuthology.orchestra.run.smithi006.stdout:(110/134): python3-routes-2.4.1-12.el8.noarch.r 1.9 MB/s | 196 kB 00:00 2023-08-01T19:51:47.092 INFO:teuthology.orchestra.run.smithi101.stdout: Installing : python3-rgw-2:17.2.6-823.g893fa35f.el8.x86_64 41/147 2023-08-01T19:51:47.112 INFO:teuthology.orchestra.run.smithi006.stdout:(111/134): python3-rsa-4.9-2.el8.noarch.rpm 767 kB/s | 64 kB 00:00 2023-08-01T19:51:47.137 INFO:teuthology.orchestra.run.smithi006.stdout:(112/134): python3-simplegeneric-0.8.1-17.el8.n 223 kB/s | 19 kB 00:00 2023-08-01T19:51:47.162 INFO:teuthology.orchestra.run.smithi006.stdout:(113/134): python3-singledispatch-3.4.0.3-18.el 317 kB/s | 24 kB 00:00 2023-08-01T19:51:47.187 INFO:teuthology.orchestra.run.smithi008.stdout: Installing : librabbitmq-0.9.0-4.el8.x86_64 5/147 2023-08-01T19:51:47.188 INFO:teuthology.orchestra.run.smithi006.stdout:(114/134): python3-tempora-1.14.1-5.el8.noarch. 386 kB/s | 29 kB 00:00 2023-08-01T19:51:47.213 INFO:teuthology.orchestra.run.smithi006.stdout:(115/134): python3-trustme-0.6.0-4.el8.noarch.r 364 kB/s | 27 kB 00:00 2023-08-01T19:51:47.238 INFO:teuthology.orchestra.run.smithi006.stdout:(116/134): python3-waitress-1.4.3-1.el8.noarch. 3.3 MB/s | 255 kB 00:00 2023-08-01T19:51:47.258 INFO:teuthology.orchestra.run.smithi155.stdout: Installing : libquadmath-8.5.0-20.el8.x86_64 21/147 2023-08-01T19:51:47.264 INFO:teuthology.orchestra.run.smithi006.stdout:(117/134): python3-webob-1.8.5-1.el8.1.noarch.r 3.3 MB/s | 251 kB 00:00 2023-08-01T19:51:47.296 INFO:teuthology.orchestra.run.smithi101.stdout: Installing : python3-rbd-2:17.2.6-823.g893fa35f.el8.x86_64 42/147 2023-08-01T19:51:47.305 INFO:teuthology.orchestra.run.smithi006.stdout:(118/134): python3-webtest-2.0.33-1.el8.noarch. 1.2 MB/s | 85 kB 00:00 2023-08-01T19:51:47.381 INFO:teuthology.orchestra.run.smithi008.stdout: Installing : lttng-ust-2.8.1-11.el8.x86_64 6/147 2023-08-01T19:51:47.392 INFO:teuthology.orchestra.run.smithi155.stdout: Running scriptlet: libquadmath-8.5.0-20.el8.x86_64 21/147 2023-08-01T19:51:47.506 INFO:teuthology.orchestra.run.smithi006.stdout:(119/134): thrift-0.13.0-2.el8.x86_64.rpm 8.7 MB/s | 1.7 MB 00:00 2023-08-01T19:51:47.508 INFO:teuthology.orchestra.run.smithi101.stdout: Installing : librados-devel-2:17.2.6-823.g893fa35f.el8.x86_64 43/147 2023-08-01T19:51:47.523 INFO:teuthology.orchestra.run.smithi006.stdout:(120/134): python3-zc-lockfile-2.0-2.el8.noarch 89 kB/s | 23 kB 00:00 2023-08-01T19:51:47.558 INFO:teuthology.orchestra.run.smithi155.stdout: Installing : libgfortran-8.5.0-20.el8.x86_64 22/147 2023-08-01T19:51:47.572 INFO:teuthology.orchestra.run.smithi006.stdout:(121/134): python3-websocket-client-0.56.0-5.el 171 kB/s | 61 kB 00:00 2023-08-01T19:51:47.698 INFO:teuthology.orchestra.run.smithi006.stdout:(122/134): elfutils-debuginfod-client-0.189-2.e 601 kB/s | 76 kB 00:00 2023-08-01T19:51:47.733 INFO:teuthology.orchestra.run.smithi101.stdout: Upgrading : libfdisk-2.32.1-42.el8.x86_64 44/147 2023-08-01T19:51:47.782 INFO:teuthology.orchestra.run.smithi008.stdout: Running scriptlet: lttng-ust-2.8.1-11.el8.x86_64 6/147 2023-08-01T19:51:47.794 INFO:teuthology.orchestra.run.smithi101.stdout: Running scriptlet: libfdisk-2.32.1-42.el8.x86_64 44/147 2023-08-01T19:51:47.824 INFO:teuthology.orchestra.run.smithi006.stdout:(123/134): elfutils-libelf-0.189-2.el8.x86_64.r 1.8 MB/s | 232 kB 00:00 2023-08-01T19:51:47.949 INFO:teuthology.orchestra.run.smithi006.stdout:(124/134): elfutils-libs-0.189-2.el8.x86_64.rpm 2.4 MB/s | 302 kB 00:00 2023-08-01T19:51:47.973 INFO:teuthology.orchestra.run.smithi008.stdout: Upgrading : librados2-2:17.2.6-823.g893fa35f.el8.x86_64 7/147 2023-08-01T19:51:48.007 INFO:teuthology.orchestra.run.smithi101.stdout: Upgrading : libmount-2.32.1-42.el8.x86_64 45/147 2023-08-01T19:51:48.069 INFO:teuthology.orchestra.run.smithi101.stdout: Running scriptlet: libmount-2.32.1-42.el8.x86_64 45/147 2023-08-01T19:51:48.074 INFO:teuthology.orchestra.run.smithi006.stdout:(125/134): libblkid-2.32.1-42.el8.x86_64.rpm 1.7 MB/s | 220 kB 00:00 2023-08-01T19:51:48.162 INFO:teuthology.orchestra.run.smithi155.stdout: Running scriptlet: libgfortran-8.5.0-20.el8.x86_64 22/147 2023-08-01T19:51:48.200 INFO:teuthology.orchestra.run.smithi006.stdout:(126/134): libfdisk-2.32.1-42.el8.x86_64.rpm 2.0 MB/s | 253 kB 00:00 2023-08-01T19:51:48.227 INFO:teuthology.orchestra.run.smithi101.stdout: Installing : libuuid-devel-2.32.1-42.el8.x86_64 46/147 2023-08-01T19:51:48.292 INFO:teuthology.orchestra.run.smithi006.stdout:(127/134): librados2-17.2.6-823.g893fa35f.el8.x 4.4 MB/s | 3.5 MB 00:00 2023-08-01T19:51:48.325 INFO:teuthology.orchestra.run.smithi006.stdout:(128/134): libmount-2.32.1-42.el8.x86_64.rpm 1.8 MB/s | 236 kB 00:00 2023-08-01T19:51:48.399 INFO:teuthology.orchestra.run.smithi101.stdout: Upgrading : libsmartcols-2.32.1-42.el8.x86_64 47/147 2023-08-01T19:51:48.401 INFO:teuthology.orchestra.run.smithi008.stdout: Running scriptlet: librados2-2:17.2.6-823.g893fa35f.el8.x86_64 7/147 2023-08-01T19:51:48.408 INFO:teuthology.orchestra.run.smithi155.stdout: Installing : openblas-0.3.15-4.el8.x86_64 23/147 2023-08-01T19:51:48.450 INFO:teuthology.orchestra.run.smithi006.stdout:(129/134): libuuid-2.32.1-42.el8.x86_64.rpm 788 kB/s | 98 kB 00:00 2023-08-01T19:51:48.631 INFO:teuthology.orchestra.run.smithi008.stdout: Upgrading : librbd1-2:17.2.6-823.g893fa35f.el8.x86_64 8/147 2023-08-01T19:51:48.634 INFO:teuthology.orchestra.run.smithi006.stdout:(130/134): util-linux-2.32.1-42.el8.x86_64.rpm 14 MB/s | 2.6 MB 00:00 2023-08-01T19:51:48.758 INFO:teuthology.orchestra.run.smithi008.stdout: Running scriptlet: librbd1-2:17.2.6-823.g893fa35f.el8.x86_64 8/147 2023-08-01T19:51:48.760 INFO:teuthology.orchestra.run.smithi006.stdout:(131/134): util-linux-user-2.32.1-42.el8.x86_64 817 kB/s | 102 kB 00:00 2023-08-01T19:51:48.851 INFO:teuthology.orchestra.run.smithi006.stdout:(132/134): librbd1-17.2.6-823.g893fa35f.el8.x86 2.7 MB/s | 3.6 MB 00:01 2023-08-01T19:51:48.892 INFO:teuthology.orchestra.run.smithi101.stdout: Running scriptlet: libsmartcols-2.32.1-42.el8.x86_64 47/147 2023-08-01T19:51:48.914 INFO:teuthology.orchestra.run.smithi008.stdout: Installing : libcephfs2-2:17.2.6-823.g893fa35f.el8.x86_64 9/147 2023-08-01T19:51:48.944 INFO:teuthology.orchestra.run.smithi006.stdout:(133/134): xfsprogs-5.0.0-12.el8.x86_64.rpm 5.9 MB/s | 1.1 MB 00:00 2023-08-01T19:51:48.969 INFO:teuthology.orchestra.run.smithi006.stdout:(134/134): libsmartcols-2.32.1-42.el8.x86_64.rp 265 kB/s | 179 kB 00:00 2023-08-01T19:51:48.971 INFO:teuthology.orchestra.run.smithi006.stdout:-------------------------------------------------------------------------------- 2023-08-01T19:51:48.972 INFO:teuthology.orchestra.run.smithi006.stdout:Total 7.8 MB/s | 208 MB 00:26 2023-08-01T19:51:49.018 INFO:teuthology.orchestra.run.smithi008.stdout: Running scriptlet: libcephfs2-2:17.2.6-823.g893fa35f.el8.x86_64 9/147 2023-08-01T19:51:49.023 INFO:teuthology.orchestra.run.smithi155.stdout: Running scriptlet: openblas-0.3.15-4.el8.x86_64 23/147 2023-08-01T19:51:49.167 INFO:teuthology.orchestra.run.smithi101.stdout: Upgrading : util-linux-2.32.1-42.el8.x86_64 48/147 2023-08-01T19:51:49.181 INFO:teuthology.orchestra.run.smithi101.stdout: Running scriptlet: util-linux-2.32.1-42.el8.x86_64 48/147 2023-08-01T19:51:49.183 INFO:teuthology.orchestra.run.smithi155.stdout: Installing : openblas-threads-0.3.15-4.el8.x86_64 24/147 2023-08-01T19:51:49.274 INFO:teuthology.orchestra.run.smithi008.stdout: Installing : python3-rados-2:17.2.6-823.g893fa35f.el8.x86_64 10/147 2023-08-01T19:51:49.360 INFO:teuthology.orchestra.run.smithi101.stdout: Installing : python3-zc-lockfile-2.0-2.el8.noarch 49/147 2023-08-01T19:51:49.431 INFO:teuthology.orchestra.run.smithi008.stdout: Installing : librdkafka-0.11.4-3.el8.x86_64 11/147 2023-08-01T19:51:49.600 INFO:teuthology.orchestra.run.smithi101.stdout: Installing : python3-websocket-client-0.56.0-5.el8.noarch 50/147 2023-08-01T19:51:49.797 INFO:teuthology.orchestra.run.smithi006.stdout:Running transaction check 2023-08-01T19:51:49.814 INFO:teuthology.orchestra.run.smithi101.stdout: Installing : python3-waitress-1.4.3-1.el8.noarch 51/147 2023-08-01T19:51:49.881 INFO:teuthology.orchestra.run.smithi155.stdout: Running scriptlet: openblas-threads-0.3.15-4.el8.x86_64 24/147 2023-08-01T19:51:49.978 INFO:teuthology.orchestra.run.smithi101.stdout: Installing : python3-singledispatch-3.4.0.3-18.el8.noarch 52/147 2023-08-01T19:51:50.013 INFO:teuthology.orchestra.run.smithi008.stdout: Running scriptlet: librdkafka-0.11.4-3.el8.x86_64 11/147 2023-08-01T19:51:50.143 INFO:teuthology.orchestra.run.smithi101.stdout: Installing : python3-simplegeneric-0.8.1-17.el8.noarch 53/147 2023-08-01T19:51:50.156 INFO:teuthology.orchestra.run.smithi008.stdout: Installing : librgw2-2:17.2.6-823.g893fa35f.el8.x86_64 12/147 2023-08-01T19:51:50.227 INFO:teuthology.orchestra.run.smithi155.stdout: Installing : python3-numpy-1:1.14.3-10.el8.x86_64 25/147 2023-08-01T19:51:50.243 INFO:teuthology.orchestra.run.smithi008.stdout: Running scriptlet: librgw2-2:17.2.6-823.g893fa35f.el8.x86_64 12/147 2023-08-01T19:51:50.247 INFO:teuthology.orchestra.run.smithi006.stdout:Transaction check succeeded. 2023-08-01T19:51:50.247 INFO:teuthology.orchestra.run.smithi006.stdout:Running transaction test 2023-08-01T19:51:50.332 INFO:teuthology.orchestra.run.smithi101.stdout: Installing : python3-repoze-lru-0.7-6.el8.noarch 54/147 2023-08-01T19:51:50.435 INFO:teuthology.orchestra.run.smithi008.stdout: Upgrading : elfutils-libelf-0.189-2.el8.x86_64 13/147 2023-08-01T19:51:50.447 INFO:teuthology.orchestra.run.smithi155.stdout: Installing : python3-werkzeug-0.12.2-4.el8.noarch 26/147 2023-08-01T19:51:50.594 INFO:teuthology.orchestra.run.smithi101.stdout: Installing : python3-routes-2.4.1-12.el8.noarch 55/147 2023-08-01T19:51:50.611 INFO:teuthology.orchestra.run.smithi155.stdout: Installing : python3-pytz-2017.2-9.el8.noarch 27/147 2023-08-01T19:51:50.657 INFO:teuthology.orchestra.run.smithi008.stdout: Installing : python3-more-itertools-7.2.0-3.el8.noarch 14/147 2023-08-01T19:51:50.801 INFO:teuthology.orchestra.run.smithi101.stdout: Installing : python3-natsort-7.1.1-2.el8.noarch 56/147 2023-08-01T19:51:50.839 INFO:teuthology.orchestra.run.smithi008.stdout: Installing : python3-pyasn1-0.3.7-6.el8.noarch 15/147 2023-08-01T19:51:50.843 INFO:teuthology.orchestra.run.smithi155.stdout: Installing : python3-markupsafe-0.23-19.el8.x86_64 28/147 2023-08-01T19:51:50.944 INFO:teuthology.orchestra.run.smithi101.stdout: Installing : python3-logutils-0.3.5-11.el8.noarch 57/147 2023-08-01T19:51:50.980 INFO:teuthology.orchestra.run.smithi008.stdout: Installing : libcephsqlite-2:17.2.6-823.g893fa35f.el8.x86_64 16/147 2023-08-01T19:51:51.085 INFO:teuthology.orchestra.run.smithi008.stdout: Running scriptlet: libcephsqlite-2:17.2.6-823.g893fa35f.el8.x86_64 16/147 2023-08-01T19:51:51.097 INFO:teuthology.orchestra.run.smithi155.stdout: Installing : python3-ceph-common-2:17.2.6-823.g893fa35f.el8.x 29/147 2023-08-01T19:51:51.113 INFO:teuthology.orchestra.run.smithi101.stdout: Installing : python3-jaraco-6.2-6.el8.noarch 58/147 2023-08-01T19:51:51.272 INFO:teuthology.orchestra.run.smithi008.stdout: Installing : libradosstriper1-2:17.2.6-823.g893fa35f.el8.x86_ 17/147 2023-08-01T19:51:51.276 INFO:teuthology.orchestra.run.smithi155.stdout: Installing : python3-ceph-argparse-2:17.2.6-823.g893fa35f.el8 30/147 2023-08-01T19:51:51.295 INFO:teuthology.orchestra.run.smithi101.stdout: Installing : python3-jaraco-functools-2.0-4.el8.noarch 59/147 2023-08-01T19:51:51.473 INFO:teuthology.orchestra.run.smithi008.stdout: Running scriptlet: libradosstriper1-2:17.2.6-823.g893fa35f.el8.x86_ 17/147 2023-08-01T19:51:51.498 INFO:teuthology.orchestra.run.smithi155.stdout: Installing : python3-cephfs-2:17.2.6-823.g893fa35f.el8.x86_64 31/147 2023-08-01T19:51:51.524 INFO:teuthology.orchestra.run.smithi101.stdout: Installing : python3-tempora-1.14.1-5.el8.noarch 60/147 2023-08-01T19:51:51.647 INFO:teuthology.orchestra.run.smithi006.stdout:Transaction test succeeded. 2023-08-01T19:51:51.650 INFO:teuthology.orchestra.run.smithi006.stdout:Running transaction 2023-08-01T19:51:51.691 INFO:teuthology.orchestra.run.smithi101.stdout: Installing : python3-portend-2.6-1.el8.noarch 61/147 2023-08-01T19:51:51.739 INFO:teuthology.orchestra.run.smithi008.stdout: Upgrading : xfsprogs-5.0.0-12.el8.x86_64 18/147 2023-08-01T19:51:51.866 INFO:teuthology.orchestra.run.smithi101.stdout: Installing : python3-certifi-2018.10.15-7.el8.noarch 62/147 2023-08-01T19:51:52.020 INFO:teuthology.orchestra.run.smithi008.stdout: Running scriptlet: xfsprogs-5.0.0-12.el8.x86_64 18/147 2023-08-01T19:51:52.076 INFO:teuthology.orchestra.run.smithi101.stdout: Installing : python3-cachetools-3.1.1-4.el8.noarch 63/147 2023-08-01T19:51:52.195 INFO:teuthology.orchestra.run.smithi008.stdout: Installing : python3-webob-1.8.5-1.el8.1.noarch 19/147 2023-08-01T19:51:52.332 INFO:teuthology.orchestra.run.smithi101.stdout: Installing : python3-google-auth-1:1.1.1-10.el8.noarch 64/147 2023-08-01T19:51:52.355 INFO:teuthology.orchestra.run.smithi008.stdout: Installing : zlib-devel-1.2.11-21.el8.x86_64 20/147 2023-08-01T19:51:52.478 INFO:teuthology.orchestra.run.smithi155.stdout: Installing : python3-mako-1.0.6-14.el8.noarch 32/147 2023-08-01T19:51:52.514 INFO:teuthology.orchestra.run.smithi008.stdout: Installing : libquadmath-8.5.0-20.el8.x86_64 21/147 2023-08-01T19:51:52.528 INFO:teuthology.orchestra.run.smithi101.stdout: Installing : python3-beautifulsoup4-4.6.3-2.el8.1.noarch 65/147 2023-08-01T19:51:52.652 INFO:teuthology.orchestra.run.smithi008.stdout: Running scriptlet: libquadmath-8.5.0-20.el8.x86_64 21/147 2023-08-01T19:51:52.789 INFO:teuthology.orchestra.run.smithi008.stdout: Installing : libgfortran-8.5.0-20.el8.x86_64 22/147 2023-08-01T19:51:52.851 INFO:teuthology.orchestra.run.smithi155.stdout: Installing : python3-babel-2.5.1-7.el8.noarch 33/147 2023-08-01T19:51:52.854 INFO:teuthology.orchestra.run.smithi101.stdout: Installing : python3-webtest-2.0.33-1.el8.noarch 66/147 2023-08-01T19:51:53.116 INFO:teuthology.orchestra.run.smithi101.stdout: Installing : python3-pecan-1.3.2-9.el8.noarch 67/147 2023-08-01T19:51:53.179 INFO:teuthology.orchestra.run.smithi155.stdout: Installing : python3-jinja2-2.10.1-3.el8.noarch 34/147 2023-08-01T19:51:53.283 INFO:teuthology.orchestra.run.smithi101.stdout: Installing : libunwind-1.3.1-3.el8.x86_64 68/147 2023-08-01T19:51:53.391 INFO:teuthology.orchestra.run.smithi155.stdout: Installing : python3-numpy-f2py-1:1.14.3-10.el8.x86_64 35/147 2023-08-01T19:51:53.409 INFO:teuthology.orchestra.run.smithi008.stdout: Running scriptlet: libgfortran-8.5.0-20.el8.x86_64 22/147 2023-08-01T19:51:53.462 INFO:teuthology.orchestra.run.smithi101.stdout: Installing : gperftools-libs-1:2.7-9.el8.x86_64 69/147 2023-08-01T19:51:53.606 INFO:teuthology.orchestra.run.smithi008.stdout: Installing : openblas-0.3.15-4.el8.x86_64 23/147 2023-08-01T19:51:53.685 INFO:teuthology.orchestra.run.smithi101.stdout: Installing : python3-pycparser-2.14-14.el8.noarch 70/147 2023-08-01T19:51:54.042 INFO:teuthology.orchestra.run.smithi101.stdout: Installing : python3-cffi-1.11.5-6.el8.x86_64 71/147 2023-08-01T19:51:54.244 INFO:teuthology.orchestra.run.smithi008.stdout: Running scriptlet: openblas-0.3.15-4.el8.x86_64 23/147 2023-08-01T19:51:54.293 INFO:teuthology.orchestra.run.smithi101.stdout: Installing : python3-cryptography-3.2.1-6.el8.x86_64 72/147 2023-08-01T19:51:54.447 INFO:teuthology.orchestra.run.smithi008.stdout: Installing : openblas-threads-0.3.15-4.el8.x86_64 24/147 2023-08-01T19:51:54.539 INFO:teuthology.orchestra.run.smithi101.stdout: Installing : python3-pyOpenSSL-19.0.0-1.el8.noarch 73/147 2023-08-01T19:51:54.762 INFO:teuthology.orchestra.run.smithi101.stdout: Installing : python3-jwt-1.6.1-2.el8.noarch 74/147 2023-08-01T19:51:54.978 INFO:teuthology.orchestra.run.smithi101.stdout: Installing : python3-oauthlib-2.1.0-1.el8.noarch 75/147 2023-08-01T19:51:55.200 INFO:teuthology.orchestra.run.smithi008.stdout: Running scriptlet: openblas-threads-0.3.15-4.el8.x86_64 24/147 2023-08-01T19:51:55.206 INFO:teuthology.orchestra.run.smithi155.stdout: Running scriptlet: python3-numpy-f2py-1:1.14.3-10.el8.x86_64 35/147 2023-08-01T19:51:55.506 INFO:teuthology.orchestra.run.smithi008.stdout: Installing : python3-numpy-1:1.14.3-10.el8.x86_64 25/147 2023-08-01T19:51:55.554 INFO:teuthology.orchestra.run.smithi155.stdout: Installing : python3-scipy-1.0.0-21.module_el8.5.0+771+e5d9a2 36/147 2023-08-01T19:51:55.729 INFO:teuthology.orchestra.run.smithi008.stdout: Installing : python3-werkzeug-0.12.2-4.el8.noarch 26/147 2023-08-01T19:51:55.734 INFO:teuthology.orchestra.run.smithi155.stdout: Installing : python3-pyasn1-modules-0.3.7-6.el8.noarch 37/147 2023-08-01T19:51:55.893 INFO:teuthology.orchestra.run.smithi008.stdout: Installing : python3-pytz-2017.2-9.el8.noarch 27/147 2023-08-01T19:51:55.965 INFO:teuthology.orchestra.run.smithi155.stdout: Installing : python3-rsa-4.9-2.el8.noarch 38/147 2023-08-01T19:51:56.080 INFO:teuthology.orchestra.run.smithi101.stdout: Installing : python3-requests-oauthlib-1.0.0-1.el8.noarch 76/147 2023-08-01T19:51:56.102 INFO:teuthology.orchestra.run.smithi008.stdout: Installing : python3-markupsafe-0.23-19.el8.x86_64 28/147 2023-08-01T19:51:56.129 INFO:teuthology.orchestra.run.smithi155.stdout: Upgrading : elfutils-libs-0.189-2.el8.x86_64 39/147 2023-08-01T19:51:56.332 INFO:teuthology.orchestra.run.smithi008.stdout: Installing : python3-ceph-common-2:17.2.6-823.g893fa35f.el8.x 29/147 2023-08-01T19:51:56.360 INFO:teuthology.orchestra.run.smithi155.stdout: Upgrading : elfutils-debuginfod-client-0.189-2.el8.x86_64 40/147 2023-08-01T19:51:56.432 INFO:teuthology.orchestra.run.smithi101.stdout: Installing : python3-kubernetes-1:11.0.0-6.el8.noarch 77/147 2023-08-01T19:51:56.491 INFO:teuthology.orchestra.run.smithi008.stdout: Installing : python3-ceph-argparse-2:17.2.6-823.g893fa35f.el8 30/147 2023-08-01T19:51:56.575 INFO:teuthology.orchestra.run.smithi155.stdout: Installing : python3-rgw-2:17.2.6-823.g893fa35f.el8.x86_64 41/147 2023-08-01T19:51:56.665 INFO:teuthology.orchestra.run.smithi101.stdout: Installing : python3-asyncssh-2.7.0-2.el8.noarch 78/147 2023-08-01T19:51:56.723 INFO:teuthology.orchestra.run.smithi008.stdout: Installing : python3-cephfs-2:17.2.6-823.g893fa35f.el8.x86_64 31/147 2023-08-01T19:51:56.781 INFO:teuthology.orchestra.run.smithi155.stdout: Installing : python3-rbd-2:17.2.6-823.g893fa35f.el8.x86_64 42/147 2023-08-01T19:51:56.890 INFO:teuthology.orchestra.run.smithi101.stdout: Installing : python3-trustme-0.6.0-4.el8.noarch 79/147 2023-08-01T19:51:56.980 INFO:teuthology.orchestra.run.smithi006.stdout: Preparing : 1/1 2023-08-01T19:51:57.013 INFO:teuthology.orchestra.run.smithi006.stdout: Running scriptlet: libuuid-2.32.1-42.el8.x86_64 1/1 2023-08-01T19:51:57.024 INFO:teuthology.orchestra.run.smithi155.stdout: Installing : librados-devel-2:17.2.6-823.g893fa35f.el8.x86_64 43/147 2023-08-01T19:51:57.189 INFO:teuthology.orchestra.run.smithi101.stdout: Installing : python3-cheroot-8.5.2-1.el8.noarch 80/147 2023-08-01T19:51:57.194 INFO:teuthology.orchestra.run.smithi006.stdout: Upgrading : libuuid-2.32.1-42.el8.x86_64 1/147 2023-08-01T19:51:57.257 INFO:teuthology.orchestra.run.smithi155.stdout: Upgrading : libfdisk-2.32.1-42.el8.x86_64 44/147 2023-08-01T19:51:57.279 INFO:teuthology.orchestra.run.smithi006.stdout: Running scriptlet: libuuid-2.32.1-42.el8.x86_64 1/147 2023-08-01T19:51:57.358 INFO:teuthology.orchestra.run.smithi155.stdout: Running scriptlet: libfdisk-2.32.1-42.el8.x86_64 44/147 2023-08-01T19:51:57.427 INFO:teuthology.orchestra.run.smithi006.stdout: Upgrading : libblkid-2.32.1-42.el8.x86_64 2/147 2023-08-01T19:51:57.490 INFO:teuthology.orchestra.run.smithi101.stdout: Installing : python3-cherrypy-18.4.0-1.el8.noarch 81/147 2023-08-01T19:51:57.496 INFO:teuthology.orchestra.run.smithi006.stdout: Running scriptlet: libblkid-2.32.1-42.el8.x86_64 2/147 2023-08-01T19:51:57.573 INFO:teuthology.orchestra.run.smithi155.stdout: Upgrading : libmount-2.32.1-42.el8.x86_64 45/147 2023-08-01T19:51:57.626 INFO:teuthology.orchestra.run.smithi155.stdout: Running scriptlet: libmount-2.32.1-42.el8.x86_64 45/147 2023-08-01T19:51:57.734 INFO:teuthology.orchestra.run.smithi101.stdout: Installing : python3-bcrypt-3.1.6-2.el8.1.x86_64 82/147 2023-08-01T19:51:57.774 INFO:teuthology.orchestra.run.smithi008.stdout: Installing : python3-mako-1.0.6-14.el8.noarch 32/147 2023-08-01T19:51:57.793 INFO:teuthology.orchestra.run.smithi155.stdout: Installing : libuuid-devel-2.32.1-42.el8.x86_64 46/147 2023-08-01T19:51:57.827 INFO:teuthology.orchestra.run.smithi006.stdout: Installing : liboath-2.6.2-3.el8.x86_64 3/147 2023-08-01T19:51:57.918 INFO:teuthology.orchestra.run.smithi101.stdout: Installing : pcre2-utf32-10.32-3.el8.x86_64 83/147 2023-08-01T19:51:57.957 INFO:teuthology.orchestra.run.smithi155.stdout: Upgrading : libsmartcols-2.32.1-42.el8.x86_64 47/147 2023-08-01T19:51:57.998 INFO:teuthology.orchestra.run.smithi006.stdout: Installing : thrift-0.13.0-2.el8.x86_64 4/147 2023-08-01T19:51:58.089 INFO:teuthology.orchestra.run.smithi008.stdout: Installing : python3-babel-2.5.1-7.el8.noarch 33/147 2023-08-01T19:51:58.187 INFO:teuthology.orchestra.run.smithi006.stdout: Installing : librabbitmq-0.9.0-4.el8.x86_64 5/147 2023-08-01T19:51:58.237 INFO:teuthology.orchestra.run.smithi101.stdout: Installing : pcre2-utf16-10.32-3.el8.x86_64 84/147 2023-08-01T19:51:58.352 INFO:teuthology.orchestra.run.smithi006.stdout: Installing : lttng-ust-2.8.1-11.el8.x86_64 6/147 2023-08-01T19:51:58.364 INFO:teuthology.orchestra.run.smithi008.stdout: Installing : python3-jinja2-2.10.1-3.el8.noarch 34/147 2023-08-01T19:51:58.453 INFO:teuthology.orchestra.run.smithi101.stdout: Installing : pcre2-devel-10.32-3.el8.x86_64 85/147 2023-08-01T19:51:58.454 INFO:teuthology.orchestra.run.smithi155.stdout: Running scriptlet: libsmartcols-2.32.1-42.el8.x86_64 47/147 2023-08-01T19:51:58.546 INFO:teuthology.orchestra.run.smithi008.stdout: Installing : python3-numpy-f2py-1:1.14.3-10.el8.x86_64 35/147 2023-08-01T19:51:58.608 INFO:teuthology.orchestra.run.smithi101.stdout: Installing : libzstd-devel-1.4.4-1.el8.x86_64 86/147 2023-08-01T19:51:58.740 INFO:teuthology.orchestra.run.smithi155.stdout: Upgrading : util-linux-2.32.1-42.el8.x86_64 48/147 2023-08-01T19:51:58.755 INFO:teuthology.orchestra.run.smithi155.stdout: Running scriptlet: util-linux-2.32.1-42.el8.x86_64 48/147 2023-08-01T19:51:58.778 INFO:teuthology.orchestra.run.smithi101.stdout: Installing : libverto-devel-0.3.2-2.el8.x86_64 87/147 2023-08-01T19:51:58.806 INFO:teuthology.orchestra.run.smithi006.stdout: Running scriptlet: lttng-ust-2.8.1-11.el8.x86_64 6/147 2023-08-01T19:51:58.934 INFO:teuthology.orchestra.run.smithi155.stdout: Installing : python3-zc-lockfile-2.0-2.el8.noarch 49/147 2023-08-01T19:51:58.993 INFO:teuthology.orchestra.run.smithi006.stdout: Upgrading : librados2-2:17.2.6-823.g893fa35f.el8.x86_64 7/147 2023-08-01T19:51:59.155 INFO:teuthology.orchestra.run.smithi101.stdout: Installing : libsepol-devel-2.9-3.el8.x86_64 88/147 2023-08-01T19:51:59.158 INFO:teuthology.orchestra.run.smithi155.stdout: Installing : python3-websocket-client-0.56.0-5.el8.noarch 50/147 2023-08-01T19:51:59.388 INFO:teuthology.orchestra.run.smithi155.stdout: Installing : python3-waitress-1.4.3-1.el8.noarch 51/147 2023-08-01T19:51:59.393 INFO:teuthology.orchestra.run.smithi101.stdout: Installing : libselinux-devel-2.9-8.el8.x86_64 89/147 2023-08-01T19:51:59.416 INFO:teuthology.orchestra.run.smithi006.stdout: Running scriptlet: librados2-2:17.2.6-823.g893fa35f.el8.x86_64 7/147 2023-08-01T19:51:59.534 INFO:teuthology.orchestra.run.smithi101.stdout: Installing : libcom_err-devel-1.45.6-5.el8.x86_64 90/147 2023-08-01T19:51:59.585 INFO:teuthology.orchestra.run.smithi006.stdout: Upgrading : librbd1-2:17.2.6-823.g893fa35f.el8.x86_64 8/147 2023-08-01T19:51:59.602 INFO:teuthology.orchestra.run.smithi155.stdout: Installing : python3-singledispatch-3.4.0.3-18.el8.noarch 52/147 2023-08-01T19:51:59.717 INFO:teuthology.orchestra.run.smithi006.stdout: Running scriptlet: librbd1-2:17.2.6-823.g893fa35f.el8.x86_64 8/147 2023-08-01T19:51:59.737 INFO:teuthology.orchestra.run.smithi101.stdout: Installing : keyutils-libs-devel-1.5.10-9.el8.x86_64 91/147 2023-08-01T19:51:59.758 INFO:teuthology.orchestra.run.smithi155.stdout: Installing : python3-simplegeneric-0.8.1-17.el8.noarch 53/147 2023-08-01T19:51:59.910 INFO:teuthology.orchestra.run.smithi006.stdout: Installing : libcephfs2-2:17.2.6-823.g893fa35f.el8.x86_64 9/147 2023-08-01T19:51:59.974 INFO:teuthology.orchestra.run.smithi101.stdout: Installing : krb5-devel-1.18.2-22.el8.x86_64 92/147 2023-08-01T19:51:59.982 INFO:teuthology.orchestra.run.smithi155.stdout: Installing : python3-repoze-lru-0.7-6.el8.noarch 54/147 2023-08-01T19:52:00.010 INFO:teuthology.orchestra.run.smithi006.stdout: Running scriptlet: libcephfs2-2:17.2.6-823.g893fa35f.el8.x86_64 9/147 2023-08-01T19:52:00.193 INFO:teuthology.orchestra.run.smithi155.stdout: Installing : python3-routes-2.4.1-12.el8.noarch 55/147 2023-08-01T19:52:00.210 INFO:teuthology.orchestra.run.smithi006.stdout: Installing : python3-rados-2:17.2.6-823.g893fa35f.el8.x86_64 10/147 2023-08-01T19:52:00.304 INFO:teuthology.orchestra.run.smithi101.stdout: Installing : fuse-2.9.7-17.el8.x86_64 93/147 2023-08-01T19:52:00.410 INFO:teuthology.orchestra.run.smithi006.stdout: Installing : librdkafka-0.11.4-3.el8.x86_64 11/147 2023-08-01T19:52:00.435 INFO:teuthology.orchestra.run.smithi155.stdout: Installing : python3-natsort-7.1.1-2.el8.noarch 56/147 2023-08-01T19:52:00.472 INFO:teuthology.orchestra.run.smithi008.stdout: Running scriptlet: python3-numpy-f2py-1:1.14.3-10.el8.x86_64 35/147 2023-08-01T19:52:00.635 INFO:teuthology.orchestra.run.smithi155.stdout: Installing : python3-logutils-0.3.5-11.el8.noarch 57/147 2023-08-01T19:52:00.796 INFO:teuthology.orchestra.run.smithi155.stdout: Installing : python3-jaraco-6.2-6.el8.noarch 58/147 2023-08-01T19:52:00.803 INFO:teuthology.orchestra.run.smithi008.stdout: Installing : python3-scipy-1.0.0-21.module_el8.5.0+771+e5d9a2 36/147 2023-08-01T19:52:00.855 INFO:teuthology.orchestra.run.smithi101.stdout: Installing : xmlstarlet-1.6.1-20.el8.x86_64 94/147 2023-08-01T19:52:00.980 INFO:teuthology.orchestra.run.smithi006.stdout: Running scriptlet: librdkafka-0.11.4-3.el8.x86_64 11/147 2023-08-01T19:52:00.982 INFO:teuthology.orchestra.run.smithi008.stdout: Installing : python3-pyasn1-modules-0.3.7-6.el8.noarch 37/147 2023-08-01T19:52:00.994 INFO:teuthology.orchestra.run.smithi155.stdout: Installing : python3-jaraco-functools-2.0-4.el8.noarch 59/147 2023-08-01T19:52:01.049 INFO:teuthology.orchestra.run.smithi101.stdout: Installing : socat-1.7.4.1-1.el8.x86_64 95/147 2023-08-01T19:52:01.160 INFO:teuthology.orchestra.run.smithi006.stdout: Installing : librgw2-2:17.2.6-823.g893fa35f.el8.x86_64 12/147 2023-08-01T19:52:01.182 INFO:teuthology.orchestra.run.smithi155.stdout: Installing : python3-tempora-1.14.1-5.el8.noarch 60/147 2023-08-01T19:52:01.189 INFO:teuthology.orchestra.run.smithi008.stdout: Installing : python3-rsa-4.9-2.el8.noarch 38/147 2023-08-01T19:52:01.198 INFO:teuthology.orchestra.run.smithi101.stdout: Installing : python3-prettytable-0.7.2-14.el8.noarch 96/147 2023-08-01T19:52:01.247 INFO:teuthology.orchestra.run.smithi006.stdout: Running scriptlet: librgw2-2:17.2.6-823.g893fa35f.el8.x86_64 12/147 2023-08-01T19:52:01.341 INFO:teuthology.orchestra.run.smithi008.stdout: Upgrading : elfutils-libs-0.189-2.el8.x86_64 39/147 2023-08-01T19:52:01.386 INFO:teuthology.orchestra.run.smithi155.stdout: Installing : python3-portend-2.6-1.el8.noarch 61/147 2023-08-01T19:52:01.456 INFO:teuthology.orchestra.run.smithi006.stdout: Upgrading : elfutils-libelf-0.189-2.el8.x86_64 13/147 2023-08-01T19:52:01.549 INFO:teuthology.orchestra.run.smithi155.stdout: Installing : python3-certifi-2018.10.15-7.el8.noarch 62/147 2023-08-01T19:52:01.549 INFO:teuthology.orchestra.run.smithi008.stdout: Upgrading : elfutils-debuginfod-client-0.189-2.el8.x86_64 40/147 2023-08-01T19:52:01.695 INFO:teuthology.orchestra.run.smithi006.stdout: Installing : python3-more-itertools-7.2.0-3.el8.noarch 14/147 2023-08-01T19:52:01.752 INFO:teuthology.orchestra.run.smithi008.stdout: Installing : python3-rgw-2:17.2.6-823.g893fa35f.el8.x86_64 41/147 2023-08-01T19:52:01.776 INFO:teuthology.orchestra.run.smithi155.stdout: Installing : python3-cachetools-3.1.1-4.el8.noarch 63/147 2023-08-01T19:52:01.910 INFO:teuthology.orchestra.run.smithi008.stdout: Installing : python3-rbd-2:17.2.6-823.g893fa35f.el8.x86_64 42/147 2023-08-01T19:52:01.935 INFO:teuthology.orchestra.run.smithi006.stdout: Installing : python3-pyasn1-0.3.7-6.el8.noarch 15/147 2023-08-01T19:52:02.015 INFO:teuthology.orchestra.run.smithi155.stdout: Installing : python3-google-auth-1:1.1.1-10.el8.noarch 64/147 2023-08-01T19:52:02.068 INFO:teuthology.orchestra.run.smithi006.stdout: Installing : libcephsqlite-2:17.2.6-823.g893fa35f.el8.x86_64 16/147 2023-08-01T19:52:02.155 INFO:teuthology.orchestra.run.smithi008.stdout: Installing : librados-devel-2:17.2.6-823.g893fa35f.el8.x86_64 43/147 2023-08-01T19:52:02.177 INFO:teuthology.orchestra.run.smithi006.stdout: Running scriptlet: libcephsqlite-2:17.2.6-823.g893fa35f.el8.x86_64 16/147 2023-08-01T19:52:02.213 INFO:teuthology.orchestra.run.smithi155.stdout: Installing : python3-beautifulsoup4-4.6.3-2.el8.1.noarch 65/147 2023-08-01T19:52:02.318 INFO:teuthology.orchestra.run.smithi006.stdout: Installing : libradosstriper1-2:17.2.6-823.g893fa35f.el8.x86_ 17/147 2023-08-01T19:52:02.362 INFO:teuthology.orchestra.run.smithi008.stdout: Upgrading : libfdisk-2.32.1-42.el8.x86_64 44/147 2023-08-01T19:52:02.442 INFO:teuthology.orchestra.run.smithi008.stdout: Running scriptlet: libfdisk-2.32.1-42.el8.x86_64 44/147 2023-08-01T19:52:02.543 INFO:teuthology.orchestra.run.smithi006.stdout: Running scriptlet: libradosstriper1-2:17.2.6-823.g893fa35f.el8.x86_ 17/147 2023-08-01T19:52:02.605 INFO:teuthology.orchestra.run.smithi155.stdout: Installing : python3-webtest-2.0.33-1.el8.noarch 66/147 2023-08-01T19:52:02.621 INFO:teuthology.orchestra.run.smithi008.stdout: Upgrading : libmount-2.32.1-42.el8.x86_64 45/147 2023-08-01T19:52:02.727 INFO:teuthology.orchestra.run.smithi008.stdout: Running scriptlet: libmount-2.32.1-42.el8.x86_64 45/147 2023-08-01T19:52:02.793 INFO:teuthology.orchestra.run.smithi006.stdout: Upgrading : xfsprogs-5.0.0-12.el8.x86_64 18/147 2023-08-01T19:52:02.850 INFO:teuthology.orchestra.run.smithi008.stdout: Installing : libuuid-devel-2.32.1-42.el8.x86_64 46/147 2023-08-01T19:52:02.882 INFO:teuthology.orchestra.run.smithi155.stdout: Installing : python3-pecan-1.3.2-9.el8.noarch 67/147 2023-08-01T19:52:02.920 INFO:teuthology.orchestra.run.smithi006.stdout: Running scriptlet: xfsprogs-5.0.0-12.el8.x86_64 18/147 2023-08-01T19:52:03.021 INFO:teuthology.orchestra.run.smithi008.stdout: Upgrading : libsmartcols-2.32.1-42.el8.x86_64 47/147 2023-08-01T19:52:03.074 INFO:teuthology.orchestra.run.smithi006.stdout: Installing : python3-webob-1.8.5-1.el8.1.noarch 19/147 2023-08-01T19:52:03.082 INFO:teuthology.orchestra.run.smithi155.stdout: Installing : libunwind-1.3.1-3.el8.x86_64 68/147 2023-08-01T19:52:03.265 INFO:teuthology.orchestra.run.smithi006.stdout: Installing : zlib-devel-1.2.11-21.el8.x86_64 20/147 2023-08-01T19:52:03.303 INFO:teuthology.orchestra.run.smithi155.stdout: Installing : gperftools-libs-1:2.7-9.el8.x86_64 69/147 2023-08-01T19:52:03.401 INFO:teuthology.orchestra.run.smithi006.stdout: Installing : libquadmath-8.5.0-20.el8.x86_64 21/147 2023-08-01T19:52:03.530 INFO:teuthology.orchestra.run.smithi006.stdout: Running scriptlet: libquadmath-8.5.0-20.el8.x86_64 21/147 2023-08-01T19:52:03.547 INFO:teuthology.orchestra.run.smithi155.stdout: Installing : python3-pycparser-2.14-14.el8.noarch 70/147 2023-08-01T19:52:03.556 INFO:teuthology.orchestra.run.smithi008.stdout: Running scriptlet: libsmartcols-2.32.1-42.el8.x86_64 47/147 2023-08-01T19:52:03.684 INFO:teuthology.orchestra.run.smithi006.stdout: Installing : libgfortran-8.5.0-20.el8.x86_64 22/147 2023-08-01T19:52:03.805 INFO:teuthology.orchestra.run.smithi008.stdout: Upgrading : util-linux-2.32.1-42.el8.x86_64 48/147 2023-08-01T19:52:03.820 INFO:teuthology.orchestra.run.smithi008.stdout: Running scriptlet: util-linux-2.32.1-42.el8.x86_64 48/147 2023-08-01T19:52:03.884 INFO:teuthology.orchestra.run.smithi101.stdout: Running scriptlet: ceph-common-2:17.2.6-823.g893fa35f.el8.x86_64 97/147 2023-08-01T19:52:03.891 INFO:teuthology.orchestra.run.smithi155.stdout: Installing : python3-cffi-1.11.5-6.el8.x86_64 71/147 2023-08-01T19:52:04.025 INFO:teuthology.orchestra.run.smithi008.stdout: Installing : python3-zc-lockfile-2.0-2.el8.noarch 49/147 2023-08-01T19:52:04.148 INFO:teuthology.orchestra.run.smithi101.stdout: Installing : ceph-common-2:17.2.6-823.g893fa35f.el8.x86_64 97/147 2023-08-01T19:52:04.151 INFO:teuthology.orchestra.run.smithi155.stdout: Installing : python3-cryptography-3.2.1-6.el8.x86_64 72/147 2023-08-01T19:52:04.262 INFO:teuthology.orchestra.run.smithi008.stdout: Installing : python3-websocket-client-0.56.0-5.el8.noarch 50/147 2023-08-01T19:52:04.342 INFO:teuthology.orchestra.run.smithi006.stdout: Running scriptlet: libgfortran-8.5.0-20.el8.x86_64 22/147 2023-08-01T19:52:04.373 INFO:teuthology.orchestra.run.smithi155.stdout: Installing : python3-pyOpenSSL-19.0.0-1.el8.noarch 73/147 2023-08-01T19:52:04.461 INFO:teuthology.orchestra.run.smithi008.stdout: Installing : python3-waitress-1.4.3-1.el8.noarch 51/147 2023-08-01T19:52:04.576 INFO:teuthology.orchestra.run.smithi006.stdout: Installing : openblas-0.3.15-4.el8.x86_64 23/147 2023-08-01T19:52:04.593 INFO:teuthology.orchestra.run.smithi155.stdout: Installing : python3-jwt-1.6.1-2.el8.noarch 74/147 2023-08-01T19:52:04.651 INFO:teuthology.orchestra.run.smithi008.stdout: Installing : python3-singledispatch-3.4.0.3-18.el8.noarch 52/147 2023-08-01T19:52:04.707 INFO:teuthology.orchestra.run.smithi101.stdout: Running scriptlet: ceph-common-2:17.2.6-823.g893fa35f.el8.x86_64 97/147 2023-08-01T19:52:04.800 INFO:teuthology.orchestra.run.smithi008.stdout: Installing : python3-simplegeneric-0.8.1-17.el8.noarch 53/147 2023-08-01T19:52:04.810 INFO:teuthology.orchestra.run.smithi155.stdout: Installing : python3-oauthlib-2.1.0-1.el8.noarch 75/147 2023-08-01T19:52:04.990 INFO:teuthology.orchestra.run.smithi008.stdout: Installing : python3-repoze-lru-0.7-6.el8.noarch 54/147 2023-08-01T19:52:05.027 INFO:teuthology.orchestra.run.smithi101.stdout: Installing : ceph-base-2:17.2.6-823.g893fa35f.el8.x86_64 98/147 2023-08-01T19:52:05.134 INFO:teuthology.orchestra.run.smithi101.stdout: Running scriptlet: ceph-base-2:17.2.6-823.g893fa35f.el8.x86_64 98/147 2023-08-01T19:52:05.193 INFO:teuthology.orchestra.run.smithi008.stdout: Installing : python3-routes-2.4.1-12.el8.noarch 55/147 2023-08-01T19:52:05.213 INFO:teuthology.orchestra.run.smithi006.stdout: Running scriptlet: openblas-0.3.15-4.el8.x86_64 23/147 2023-08-01T19:52:05.280 INFO:teuthology.orchestra.run.smithi101.stdout: Installing : ceph-selinux-2:17.2.6-823.g893fa35f.el8.x86_64 99/147 2023-08-01T19:52:05.368 INFO:teuthology.orchestra.run.smithi006.stdout: Installing : openblas-threads-0.3.15-4.el8.x86_64 24/147 2023-08-01T19:52:05.433 INFO:teuthology.orchestra.run.smithi008.stdout: Installing : python3-natsort-7.1.1-2.el8.noarch 56/147 2023-08-01T19:52:05.583 INFO:teuthology.orchestra.run.smithi008.stdout: Installing : python3-logutils-0.3.5-11.el8.noarch 57/147 2023-08-01T19:52:05.744 INFO:teuthology.orchestra.run.smithi008.stdout: Installing : python3-jaraco-6.2-6.el8.noarch 58/147 2023-08-01T19:52:05.918 INFO:teuthology.orchestra.run.smithi008.stdout: Installing : python3-jaraco-functools-2.0-4.el8.noarch 59/147 2023-08-01T19:52:05.927 INFO:teuthology.orchestra.run.smithi155.stdout: Installing : python3-requests-oauthlib-1.0.0-1.el8.noarch 76/147 2023-08-01T19:52:06.098 INFO:teuthology.orchestra.run.smithi008.stdout: Installing : python3-tempora-1.14.1-5.el8.noarch 60/147 2023-08-01T19:52:06.118 INFO:teuthology.orchestra.run.smithi006.stdout: Running scriptlet: openblas-threads-0.3.15-4.el8.x86_64 24/147 2023-08-01T19:52:06.247 INFO:teuthology.orchestra.run.smithi008.stdout: Installing : python3-portend-2.6-1.el8.noarch 61/147 2023-08-01T19:52:06.266 INFO:teuthology.orchestra.run.smithi155.stdout: Installing : python3-kubernetes-1:11.0.0-6.el8.noarch 77/147 2023-08-01T19:52:06.414 INFO:teuthology.orchestra.run.smithi008.stdout: Installing : python3-certifi-2018.10.15-7.el8.noarch 62/147 2023-08-01T19:52:06.417 INFO:teuthology.orchestra.run.smithi006.stdout: Installing : python3-numpy-1:1.14.3-10.el8.x86_64 25/147 2023-08-01T19:52:06.513 INFO:teuthology.orchestra.run.smithi155.stdout: Installing : python3-asyncssh-2.7.0-2.el8.noarch 78/147 2023-08-01T19:52:06.650 INFO:teuthology.orchestra.run.smithi006.stdout: Installing : python3-werkzeug-0.12.2-4.el8.noarch 26/147 2023-08-01T19:52:06.659 INFO:teuthology.orchestra.run.smithi008.stdout: Installing : python3-cachetools-3.1.1-4.el8.noarch 63/147 2023-08-01T19:52:06.773 INFO:teuthology.orchestra.run.smithi155.stdout: Installing : python3-trustme-0.6.0-4.el8.noarch 79/147 2023-08-01T19:52:06.814 INFO:teuthology.orchestra.run.smithi006.stdout: Installing : python3-pytz-2017.2-9.el8.noarch 27/147 2023-08-01T19:52:06.891 INFO:teuthology.orchestra.run.smithi008.stdout: Installing : python3-google-auth-1:1.1.1-10.el8.noarch 64/147 2023-08-01T19:52:07.022 INFO:teuthology.orchestra.run.smithi006.stdout: Installing : python3-markupsafe-0.23-19.el8.x86_64 28/147 2023-08-01T19:52:07.085 INFO:teuthology.orchestra.run.smithi008.stdout: Installing : python3-beautifulsoup4-4.6.3-2.el8.1.noarch 65/147 2023-08-01T19:52:07.096 INFO:teuthology.orchestra.run.smithi155.stdout: Installing : python3-cheroot-8.5.2-1.el8.noarch 80/147 2023-08-01T19:52:07.294 INFO:teuthology.orchestra.run.smithi006.stdout: Installing : python3-ceph-common-2:17.2.6-823.g893fa35f.el8.x 29/147 2023-08-01T19:52:07.350 INFO:teuthology.orchestra.run.smithi155.stdout: Installing : python3-cherrypy-18.4.0-1.el8.noarch 81/147 2023-08-01T19:52:07.429 INFO:teuthology.orchestra.run.smithi008.stdout: Installing : python3-webtest-2.0.33-1.el8.noarch 66/147 2023-08-01T19:52:07.446 INFO:teuthology.orchestra.run.smithi006.stdout: Installing : python3-ceph-argparse-2:17.2.6-823.g893fa35f.el8 30/147 2023-08-01T19:52:07.574 INFO:teuthology.orchestra.run.smithi155.stdout: Installing : python3-bcrypt-3.1.6-2.el8.1.x86_64 82/147 2023-08-01T19:52:07.673 INFO:teuthology.orchestra.run.smithi006.stdout: Installing : python3-cephfs-2:17.2.6-823.g893fa35f.el8.x86_64 31/147 2023-08-01T19:52:07.738 INFO:teuthology.orchestra.run.smithi155.stdout: Installing : pcre2-utf32-10.32-3.el8.x86_64 83/147 2023-08-01T19:52:07.763 INFO:teuthology.orchestra.run.smithi008.stdout: Installing : python3-pecan-1.3.2-9.el8.noarch 67/147 2023-08-01T19:52:07.957 INFO:teuthology.orchestra.run.smithi008.stdout: Installing : libunwind-1.3.1-3.el8.x86_64 68/147 2023-08-01T19:52:08.056 INFO:teuthology.orchestra.run.smithi155.stdout: Installing : pcre2-utf16-10.32-3.el8.x86_64 84/147 2023-08-01T19:52:08.164 INFO:teuthology.orchestra.run.smithi008.stdout: Installing : gperftools-libs-1:2.7-9.el8.x86_64 69/147 2023-08-01T19:52:08.301 INFO:teuthology.orchestra.run.smithi155.stdout: Installing : pcre2-devel-10.32-3.el8.x86_64 85/147 2023-08-01T19:52:08.398 INFO:teuthology.orchestra.run.smithi008.stdout: Installing : python3-pycparser-2.14-14.el8.noarch 70/147 2023-08-01T19:52:08.449 INFO:teuthology.orchestra.run.smithi155.stdout: Installing : libzstd-devel-1.4.4-1.el8.x86_64 86/147 2023-08-01T19:52:08.648 INFO:teuthology.orchestra.run.smithi155.stdout: Installing : libverto-devel-0.3.2-2.el8.x86_64 87/147 2023-08-01T19:52:08.723 INFO:teuthology.orchestra.run.smithi006.stdout: Installing : python3-mako-1.0.6-14.el8.noarch 32/147 2023-08-01T19:52:08.792 INFO:teuthology.orchestra.run.smithi008.stdout: Installing : python3-cffi-1.11.5-6.el8.x86_64 71/147 2023-08-01T19:52:08.954 INFO:teuthology.orchestra.run.smithi155.stdout: Installing : libsepol-devel-2.9-3.el8.x86_64 88/147 2023-08-01T19:52:09.033 INFO:teuthology.orchestra.run.smithi008.stdout: Installing : python3-cryptography-3.2.1-6.el8.x86_64 72/147 2023-08-01T19:52:09.049 INFO:teuthology.orchestra.run.smithi006.stdout: Installing : python3-babel-2.5.1-7.el8.noarch 33/147 2023-08-01T19:52:09.200 INFO:teuthology.orchestra.run.smithi155.stdout: Installing : libselinux-devel-2.9-8.el8.x86_64 89/147 2023-08-01T19:52:09.289 INFO:teuthology.orchestra.run.smithi008.stdout: Installing : python3-pyOpenSSL-19.0.0-1.el8.noarch 73/147 2023-08-01T19:52:09.350 INFO:teuthology.orchestra.run.smithi155.stdout: Installing : libcom_err-devel-1.45.6-5.el8.x86_64 90/147 2023-08-01T19:52:09.369 INFO:teuthology.orchestra.run.smithi006.stdout: Installing : python3-jinja2-2.10.1-3.el8.noarch 34/147 2023-08-01T19:52:09.512 INFO:teuthology.orchestra.run.smithi008.stdout: Installing : python3-jwt-1.6.1-2.el8.noarch 74/147 2023-08-01T19:52:09.542 INFO:teuthology.orchestra.run.smithi006.stdout: Installing : python3-numpy-f2py-1:1.14.3-10.el8.x86_64 35/147 2023-08-01T19:52:09.553 INFO:teuthology.orchestra.run.smithi155.stdout: Installing : keyutils-libs-devel-1.5.10-9.el8.x86_64 91/147 2023-08-01T19:52:09.731 INFO:teuthology.orchestra.run.smithi008.stdout: Installing : python3-oauthlib-2.1.0-1.el8.noarch 75/147 2023-08-01T19:52:09.839 INFO:teuthology.orchestra.run.smithi155.stdout: Installing : krb5-devel-1.18.2-22.el8.x86_64 92/147 2023-08-01T19:52:10.052 INFO:teuthology.orchestra.run.smithi155.stdout: Installing : fuse-2.9.7-17.el8.x86_64 93/147 2023-08-01T19:52:10.310 INFO:teuthology.orchestra.run.smithi155.stdout: Installing : xmlstarlet-1.6.1-20.el8.x86_64 94/147 2023-08-01T19:52:10.530 INFO:teuthology.orchestra.run.smithi155.stdout: Installing : socat-1.7.4.1-1.el8.x86_64 95/147 2023-08-01T19:52:10.705 INFO:teuthology.orchestra.run.smithi155.stdout: Installing : python3-prettytable-0.7.2-14.el8.noarch 96/147 2023-08-01T19:52:10.850 INFO:teuthology.orchestra.run.smithi008.stdout: Installing : python3-requests-oauthlib-1.0.0-1.el8.noarch 76/147 2023-08-01T19:52:11.197 INFO:teuthology.orchestra.run.smithi008.stdout: Installing : python3-kubernetes-1:11.0.0-6.el8.noarch 77/147 2023-08-01T19:52:11.395 INFO:teuthology.orchestra.run.smithi008.stdout: Installing : python3-asyncssh-2.7.0-2.el8.noarch 78/147 2023-08-01T19:52:11.449 INFO:teuthology.orchestra.run.smithi006.stdout: Running scriptlet: python3-numpy-f2py-1:1.14.3-10.el8.x86_64 35/147 2023-08-01T19:52:11.606 INFO:teuthology.orchestra.run.smithi008.stdout: Installing : python3-trustme-0.6.0-4.el8.noarch 79/147 2023-08-01T19:52:11.707 INFO:teuthology.orchestra.run.smithi006.stdout: Installing : python3-scipy-1.0.0-21.module_el8.5.0+771+e5d9a2 36/147 2023-08-01T19:52:11.907 INFO:teuthology.orchestra.run.smithi008.stdout: Installing : python3-cheroot-8.5.2-1.el8.noarch 80/147 2023-08-01T19:52:11.929 INFO:teuthology.orchestra.run.smithi006.stdout: Installing : python3-pyasn1-modules-0.3.7-6.el8.noarch 37/147 2023-08-01T19:52:12.123 INFO:teuthology.orchestra.run.smithi008.stdout: Installing : python3-cherrypy-18.4.0-1.el8.noarch 81/147 2023-08-01T19:52:12.127 INFO:teuthology.orchestra.run.smithi006.stdout: Installing : python3-rsa-4.9-2.el8.noarch 38/147 2023-08-01T19:52:12.281 INFO:teuthology.orchestra.run.smithi006.stdout: Upgrading : elfutils-libs-0.189-2.el8.x86_64 39/147 2023-08-01T19:52:12.365 INFO:teuthology.orchestra.run.smithi008.stdout: Installing : python3-bcrypt-3.1.6-2.el8.1.x86_64 82/147 2023-08-01T19:52:12.471 INFO:teuthology.orchestra.run.smithi006.stdout: Upgrading : elfutils-debuginfod-client-0.189-2.el8.x86_64 40/147 2023-08-01T19:52:12.550 INFO:teuthology.orchestra.run.smithi008.stdout: Installing : pcre2-utf32-10.32-3.el8.x86_64 83/147 2023-08-01T19:52:12.747 INFO:teuthology.orchestra.run.smithi006.stdout: Installing : python3-rgw-2:17.2.6-823.g893fa35f.el8.x86_64 41/147 2023-08-01T19:52:12.943 INFO:teuthology.orchestra.run.smithi006.stdout: Installing : python3-rbd-2:17.2.6-823.g893fa35f.el8.x86_64 42/147 2023-08-01T19:52:12.965 INFO:teuthology.orchestra.run.smithi008.stdout: Installing : pcre2-utf16-10.32-3.el8.x86_64 84/147 2023-08-01T19:52:13.169 INFO:teuthology.orchestra.run.smithi006.stdout: Installing : librados-devel-2:17.2.6-823.g893fa35f.el8.x86_64 43/147 2023-08-01T19:52:13.183 INFO:teuthology.orchestra.run.smithi008.stdout: Installing : pcre2-devel-10.32-3.el8.x86_64 85/147 2023-08-01T19:52:13.330 INFO:teuthology.orchestra.run.smithi008.stdout: Installing : libzstd-devel-1.4.4-1.el8.x86_64 86/147 2023-08-01T19:52:13.400 INFO:teuthology.orchestra.run.smithi006.stdout: Upgrading : libfdisk-2.32.1-42.el8.x86_64 44/147 2023-08-01T19:52:13.434 INFO:teuthology.orchestra.run.smithi155.stdout: Running scriptlet: ceph-common-2:17.2.6-823.g893fa35f.el8.x86_64 97/147 2023-08-01T19:52:13.463 INFO:teuthology.orchestra.run.smithi006.stdout: Running scriptlet: libfdisk-2.32.1-42.el8.x86_64 44/147 2023-08-01T19:52:13.511 INFO:teuthology.orchestra.run.smithi008.stdout: Installing : libverto-devel-0.3.2-2.el8.x86_64 87/147 2023-08-01T19:52:13.663 INFO:teuthology.orchestra.run.smithi155.stdout: Installing : ceph-common-2:17.2.6-823.g893fa35f.el8.x86_64 97/147 2023-08-01T19:52:13.667 INFO:teuthology.orchestra.run.smithi006.stdout: Upgrading : libmount-2.32.1-42.el8.x86_64 45/147 2023-08-01T19:52:13.739 INFO:teuthology.orchestra.run.smithi006.stdout: Running scriptlet: libmount-2.32.1-42.el8.x86_64 45/147 2023-08-01T19:52:13.875 INFO:teuthology.orchestra.run.smithi008.stdout: Installing : libsepol-devel-2.9-3.el8.x86_64 88/147 2023-08-01T19:52:13.879 INFO:teuthology.orchestra.run.smithi006.stdout: Installing : libuuid-devel-2.32.1-42.el8.x86_64 46/147 2023-08-01T19:52:14.074 INFO:teuthology.orchestra.run.smithi008.stdout: Installing : libselinux-devel-2.9-8.el8.x86_64 89/147 2023-08-01T19:52:14.083 INFO:teuthology.orchestra.run.smithi006.stdout: Upgrading : libsmartcols-2.32.1-42.el8.x86_64 47/147 2023-08-01T19:52:14.241 INFO:teuthology.orchestra.run.smithi155.stdout: Running scriptlet: ceph-common-2:17.2.6-823.g893fa35f.el8.x86_64 97/147 2023-08-01T19:52:14.249 INFO:teuthology.orchestra.run.smithi008.stdout: Installing : libcom_err-devel-1.45.6-5.el8.x86_64 90/147 2023-08-01T19:52:14.434 INFO:teuthology.orchestra.run.smithi008.stdout: Installing : keyutils-libs-devel-1.5.10-9.el8.x86_64 91/147 2023-08-01T19:52:14.537 INFO:teuthology.orchestra.run.smithi155.stdout: Installing : ceph-base-2:17.2.6-823.g893fa35f.el8.x86_64 98/147 2023-08-01T19:52:14.624 INFO:teuthology.orchestra.run.smithi006.stdout: Running scriptlet: libsmartcols-2.32.1-42.el8.x86_64 47/147 2023-08-01T19:52:14.630 INFO:teuthology.orchestra.run.smithi008.stdout: Installing : krb5-devel-1.18.2-22.el8.x86_64 92/147 2023-08-01T19:52:14.643 INFO:teuthology.orchestra.run.smithi155.stdout: Running scriptlet: ceph-base-2:17.2.6-823.g893fa35f.el8.x86_64 98/147 2023-08-01T19:52:14.805 INFO:teuthology.orchestra.run.smithi008.stdout: Installing : fuse-2.9.7-17.el8.x86_64 93/147 2023-08-01T19:52:14.851 INFO:teuthology.orchestra.run.smithi006.stdout: Upgrading : util-linux-2.32.1-42.el8.x86_64 48/147 2023-08-01T19:52:14.862 INFO:teuthology.orchestra.run.smithi155.stdout: Installing : ceph-selinux-2:17.2.6-823.g893fa35f.el8.x86_64 99/147 2023-08-01T19:52:14.866 INFO:teuthology.orchestra.run.smithi006.stdout: Running scriptlet: util-linux-2.32.1-42.el8.x86_64 48/147 2023-08-01T19:52:15.038 INFO:teuthology.orchestra.run.smithi006.stdout: Installing : python3-zc-lockfile-2.0-2.el8.noarch 49/147 2023-08-01T19:52:15.051 INFO:teuthology.orchestra.run.smithi008.stdout: Installing : xmlstarlet-1.6.1-20.el8.x86_64 94/147 2023-08-01T19:52:15.229 INFO:teuthology.orchestra.run.smithi008.stdout: Installing : socat-1.7.4.1-1.el8.x86_64 95/147 2023-08-01T19:52:15.317 INFO:teuthology.orchestra.run.smithi006.stdout: Installing : python3-websocket-client-0.56.0-5.el8.noarch 50/147 2023-08-01T19:52:15.411 INFO:teuthology.orchestra.run.smithi008.stdout: Installing : python3-prettytable-0.7.2-14.el8.noarch 96/147 2023-08-01T19:52:15.540 INFO:teuthology.orchestra.run.smithi006.stdout: Installing : python3-waitress-1.4.3-1.el8.noarch 51/147 2023-08-01T19:52:15.722 INFO:teuthology.orchestra.run.smithi006.stdout: Installing : python3-singledispatch-3.4.0.3-18.el8.noarch 52/147 2023-08-01T19:52:15.871 INFO:teuthology.orchestra.run.smithi006.stdout: Installing : python3-simplegeneric-0.8.1-17.el8.noarch 53/147 2023-08-01T19:52:16.098 INFO:teuthology.orchestra.run.smithi006.stdout: Installing : python3-repoze-lru-0.7-6.el8.noarch 54/147 2023-08-01T19:52:16.316 INFO:teuthology.orchestra.run.smithi006.stdout: Installing : python3-routes-2.4.1-12.el8.noarch 55/147 2023-08-01T19:52:16.548 INFO:teuthology.orchestra.run.smithi006.stdout: Installing : python3-natsort-7.1.1-2.el8.noarch 56/147 2023-08-01T19:52:16.729 INFO:teuthology.orchestra.run.smithi006.stdout: Installing : python3-logutils-0.3.5-11.el8.noarch 57/147 2023-08-01T19:52:16.907 INFO:teuthology.orchestra.run.smithi006.stdout: Installing : python3-jaraco-6.2-6.el8.noarch 58/147 2023-08-01T19:52:17.081 INFO:teuthology.orchestra.run.smithi006.stdout: Installing : python3-jaraco-functools-2.0-4.el8.noarch 59/147 2023-08-01T19:52:17.308 INFO:teuthology.orchestra.run.smithi006.stdout: Installing : python3-tempora-1.14.1-5.el8.noarch 60/147 2023-08-01T19:52:17.466 INFO:teuthology.orchestra.run.smithi006.stdout: Installing : python3-portend-2.6-1.el8.noarch 61/147 2023-08-01T19:52:17.643 INFO:teuthology.orchestra.run.smithi006.stdout: Installing : python3-certifi-2018.10.15-7.el8.noarch 62/147 2023-08-01T19:52:17.864 INFO:teuthology.orchestra.run.smithi006.stdout: Installing : python3-cachetools-3.1.1-4.el8.noarch 63/147 2023-08-01T19:52:18.129 INFO:teuthology.orchestra.run.smithi006.stdout: Installing : python3-google-auth-1:1.1.1-10.el8.noarch 64/147 2023-08-01T19:52:18.172 INFO:teuthology.orchestra.run.smithi008.stdout: Running scriptlet: ceph-common-2:17.2.6-823.g893fa35f.el8.x86_64 97/147 2023-08-01T19:52:18.346 INFO:teuthology.orchestra.run.smithi006.stdout: Installing : python3-beautifulsoup4-4.6.3-2.el8.1.noarch 65/147 2023-08-01T19:52:18.386 INFO:teuthology.orchestra.run.smithi008.stdout: Installing : ceph-common-2:17.2.6-823.g893fa35f.el8.x86_64 97/147 2023-08-01T19:52:18.698 INFO:teuthology.orchestra.run.smithi006.stdout: Installing : python3-webtest-2.0.33-1.el8.noarch 66/147 2023-08-01T19:52:18.934 INFO:teuthology.orchestra.run.smithi006.stdout: Installing : python3-pecan-1.3.2-9.el8.noarch 67/147 2023-08-01T19:52:18.992 INFO:teuthology.orchestra.run.smithi008.stdout: Running scriptlet: ceph-common-2:17.2.6-823.g893fa35f.el8.x86_64 97/147 2023-08-01T19:52:19.120 INFO:teuthology.orchestra.run.smithi006.stdout: Installing : libunwind-1.3.1-3.el8.x86_64 68/147 2023-08-01T19:52:19.225 INFO:teuthology.orchestra.run.smithi008.stdout: Installing : ceph-base-2:17.2.6-823.g893fa35f.el8.x86_64 98/147 2023-08-01T19:52:19.320 INFO:teuthology.orchestra.run.smithi008.stdout: Running scriptlet: ceph-base-2:17.2.6-823.g893fa35f.el8.x86_64 98/147 2023-08-01T19:52:19.358 INFO:teuthology.orchestra.run.smithi006.stdout: Installing : gperftools-libs-1:2.7-9.el8.x86_64 69/147 2023-08-01T19:52:19.452 INFO:teuthology.orchestra.run.smithi008.stdout: Installing : ceph-selinux-2:17.2.6-823.g893fa35f.el8.x86_64 99/147 2023-08-01T19:52:19.590 INFO:teuthology.orchestra.run.smithi006.stdout: Installing : python3-pycparser-2.14-14.el8.noarch 70/147 2023-08-01T19:52:20.116 INFO:teuthology.orchestra.run.smithi006.stdout: Installing : python3-cffi-1.11.5-6.el8.x86_64 71/147 2023-08-01T19:52:20.371 INFO:teuthology.orchestra.run.smithi006.stdout: Installing : python3-cryptography-3.2.1-6.el8.x86_64 72/147 2023-08-01T19:52:20.651 INFO:teuthology.orchestra.run.smithi006.stdout: Installing : python3-pyOpenSSL-19.0.0-1.el8.noarch 73/147 2023-08-01T19:52:20.896 INFO:teuthology.orchestra.run.smithi006.stdout: Installing : python3-jwt-1.6.1-2.el8.noarch 74/147 2023-08-01T19:52:21.274 INFO:teuthology.orchestra.run.smithi006.stdout: Installing : python3-oauthlib-2.1.0-1.el8.noarch 75/147 2023-08-01T19:52:22.398 INFO:teuthology.orchestra.run.smithi006.stdout: Installing : python3-requests-oauthlib-1.0.0-1.el8.noarch 76/147 2023-08-01T19:52:22.776 INFO:teuthology.orchestra.run.smithi006.stdout: Installing : python3-kubernetes-1:11.0.0-6.el8.noarch 77/147 2023-08-01T19:52:22.999 INFO:teuthology.orchestra.run.smithi006.stdout: Installing : python3-asyncssh-2.7.0-2.el8.noarch 78/147 2023-08-01T19:52:23.480 INFO:teuthology.orchestra.run.smithi006.stdout: Installing : python3-trustme-0.6.0-4.el8.noarch 79/147 2023-08-01T19:52:23.912 INFO:teuthology.orchestra.run.smithi006.stdout: Installing : python3-cheroot-8.5.2-1.el8.noarch 80/147 2023-08-01T19:52:24.164 INFO:teuthology.orchestra.run.smithi101.stdout: Running scriptlet: ceph-selinux-2:17.2.6-823.g893fa35f.el8.x86_64 99/147 2023-08-01T19:52:24.164 INFO:teuthology.orchestra.run.smithi101.stdout:skipping the directory /sys 2023-08-01T19:52:24.164 INFO:teuthology.orchestra.run.smithi101.stdout:skipping the directory /proc 2023-08-01T19:52:24.164 INFO:teuthology.orchestra.run.smithi101.stdout:skipping the directory /dev 2023-08-01T19:52:24.165 INFO:teuthology.orchestra.run.smithi101.stdout:skipping the directory /run 2023-08-01T19:52:24.165 INFO:teuthology.orchestra.run.smithi101.stdout:skipping the directory /mnt 2023-08-01T19:52:24.165 INFO:teuthology.orchestra.run.smithi101.stdout:skipping the directory /var/tmp 2023-08-01T19:52:24.165 INFO:teuthology.orchestra.run.smithi101.stdout:skipping the directory /home 2023-08-01T19:52:24.165 INFO:teuthology.orchestra.run.smithi101.stdout:skipping the directory /tmp 2023-08-01T19:52:24.165 INFO:teuthology.orchestra.run.smithi101.stdout:skipping the directory /dev 2023-08-01T19:52:24.165 INFO:teuthology.orchestra.run.smithi101.stdout: 2023-08-01T19:52:24.201 INFO:teuthology.orchestra.run.smithi006.stdout: Installing : python3-cherrypy-18.4.0-1.el8.noarch 81/147 2023-08-01T19:52:24.462 INFO:teuthology.orchestra.run.smithi006.stdout: Installing : python3-bcrypt-3.1.6-2.el8.1.x86_64 82/147 2023-08-01T19:52:24.528 INFO:teuthology.orchestra.run.smithi101.stdout: Installing : ceph-volume-2:17.2.6-823.g893fa35f.el8.noarch 100/147 2023-08-01T19:52:24.686 INFO:teuthology.orchestra.run.smithi006.stdout: Installing : pcre2-utf32-10.32-3.el8.x86_64 83/147 2023-08-01T19:52:25.009 INFO:teuthology.orchestra.run.smithi006.stdout: Installing : pcre2-utf16-10.32-3.el8.x86_64 84/147 2023-08-01T19:52:25.221 INFO:teuthology.orchestra.run.smithi006.stdout: Installing : pcre2-devel-10.32-3.el8.x86_64 85/147 2023-08-01T19:52:25.393 INFO:teuthology.orchestra.run.smithi006.stdout: Installing : libzstd-devel-1.4.4-1.el8.x86_64 86/147 2023-08-01T19:52:25.557 INFO:teuthology.orchestra.run.smithi006.stdout: Installing : libverto-devel-0.3.2-2.el8.x86_64 87/147 2023-08-01T19:52:25.864 INFO:teuthology.orchestra.run.smithi006.stdout: Installing : libsepol-devel-2.9-3.el8.x86_64 88/147 2023-08-01T19:52:25.993 INFO:teuthology.orchestra.run.smithi101.stdout: Running scriptlet: ceph-volume-2:17.2.6-823.g893fa35f.el8.noarch 100/147 2023-08-01T19:52:26.128 INFO:teuthology.orchestra.run.smithi006.stdout: Installing : libselinux-devel-2.9-8.el8.x86_64 89/147 2023-08-01T19:52:26.233 INFO:teuthology.orchestra.run.smithi101.stdout: Installing : ceph-osd-2:17.2.6-823.g893fa35f.el8.x86_64 101/147 2023-08-01T19:52:26.281 INFO:teuthology.orchestra.run.smithi006.stdout: Installing : libcom_err-devel-1.45.6-5.el8.x86_64 90/147 2023-08-01T19:52:26.453 INFO:teuthology.orchestra.run.smithi101.stdout: Running scriptlet: ceph-osd-2:17.2.6-823.g893fa35f.el8.x86_64 101/147 2023-08-01T19:52:26.516 INFO:teuthology.orchestra.run.smithi006.stdout: Installing : keyutils-libs-devel-1.5.10-9.el8.x86_64 91/147 2023-08-01T19:52:26.670 INFO:teuthology.orchestra.run.smithi101.stdout: Installing : ceph-mds-2:17.2.6-823.g893fa35f.el8.x86_64 102/147 2023-08-01T19:52:26.769 INFO:teuthology.orchestra.run.smithi006.stdout: Installing : krb5-devel-1.18.2-22.el8.x86_64 92/147 2023-08-01T19:52:26.952 INFO:teuthology.orchestra.run.smithi006.stdout: Installing : fuse-2.9.7-17.el8.x86_64 93/147 2023-08-01T19:52:27.057 INFO:teuthology.orchestra.run.smithi101.stdout: Running scriptlet: ceph-mds-2:17.2.6-823.g893fa35f.el8.x86_64 102/147 2023-08-01T19:52:27.158 INFO:teuthology.orchestra.run.smithi006.stdout: Installing : xmlstarlet-1.6.1-20.el8.x86_64 94/147 2023-08-01T19:52:27.245 INFO:teuthology.orchestra.run.smithi101.stdout: Installing : ceph-mon-2:17.2.6-823.g893fa35f.el8.x86_64 103/147 2023-08-01T19:52:27.269 INFO:teuthology.orchestra.run.smithi101.stdout: Running scriptlet: ceph-mon-2:17.2.6-823.g893fa35f.el8.x86_64 103/147 2023-08-01T19:52:27.333 INFO:teuthology.orchestra.run.smithi006.stdout: Installing : socat-1.7.4.1-1.el8.x86_64 95/147 2023-08-01T19:52:27.468 INFO:teuthology.orchestra.run.smithi101.stdout: Installing : python3-jsonpointer-1.10-11.el8.noarch 104/147 2023-08-01T19:52:27.524 INFO:teuthology.orchestra.run.smithi006.stdout: Installing : python3-prettytable-0.7.2-14.el8.noarch 96/147 2023-08-01T19:52:27.699 INFO:teuthology.orchestra.run.smithi101.stdout: Installing : python3-jsonpatch-1.21-2.el8.noarch 105/147 2023-08-01T19:52:27.861 INFO:teuthology.orchestra.run.smithi101.stdout: Installing : oniguruma-6.8.2-2.el8.x86_64 106/147 2023-08-01T19:52:27.921 INFO:teuthology.orchestra.run.smithi101.stdout: Running scriptlet: oniguruma-6.8.2-2.el8.x86_64 106/147 2023-08-01T19:52:28.186 INFO:teuthology.orchestra.run.smithi101.stdout: Installing : jq-1.6-7.el8.x86_64 107/147 2023-08-01T19:52:28.445 INFO:teuthology.orchestra.run.smithi101.stdout: Installing : automake-1.16.1-7.el8.noarch 108/147 2023-08-01T19:52:28.916 INFO:teuthology.orchestra.run.smithi101.stdout: Running scriptlet: cephadm-2:17.2.6-823.g893fa35f.el8.noarch 109/147 2023-08-01T19:52:29.101 INFO:teuthology.orchestra.run.smithi101.stdout: Installing : cephadm-2:17.2.6-823.g893fa35f.el8.noarch 109/147 2023-08-01T19:52:29.267 INFO:teuthology.orchestra.run.smithi101.stdout: Installing : ceph-prometheus-alerts-2:17.2.6-823.g893fa35f.el 110/147 2023-08-01T19:52:29.472 INFO:teuthology.orchestra.run.smithi101.stdout: Installing : ceph-grafana-dashboards-2:17.2.6-823.g893fa35f.e 111/147 2023-08-01T19:52:29.669 INFO:teuthology.orchestra.run.smithi101.stdout: Installing : ceph-mgr-cephadm-2:17.2.6-823.g893fa35f.el8.noar 112/147 2023-08-01T19:52:29.878 INFO:teuthology.orchestra.run.smithi101.stdout: Running scriptlet: ceph-mgr-cephadm-2:17.2.6-823.g893fa35f.el8.noar 112/147 2023-08-01T19:52:30.107 INFO:teuthology.orchestra.run.smithi101.stdout: Installing : ceph-mgr-dashboard-2:17.2.6-823.g893fa35f.el8.no 113/147 2023-08-01T19:52:30.315 INFO:teuthology.orchestra.run.smithi006.stdout: Running scriptlet: ceph-common-2:17.2.6-823.g893fa35f.el8.x86_64 97/147 2023-08-01T19:52:30.590 INFO:teuthology.orchestra.run.smithi006.stdout: Installing : ceph-common-2:17.2.6-823.g893fa35f.el8.x86_64 97/147 2023-08-01T19:52:31.068 INFO:teuthology.orchestra.run.smithi101.stdout: Running scriptlet: ceph-mgr-dashboard-2:17.2.6-823.g893fa35f.el8.no 113/147 2023-08-01T19:52:31.189 INFO:teuthology.orchestra.run.smithi006.stdout: Running scriptlet: ceph-common-2:17.2.6-823.g893fa35f.el8.x86_64 97/147 2023-08-01T19:52:31.260 INFO:teuthology.orchestra.run.smithi101.stdout: Installing : ceph-mgr-diskprediction-local-2:17.2.6-823.g893f 114/147 2023-08-01T19:52:31.352 INFO:teuthology.orchestra.run.smithi101.stdout: Running scriptlet: ceph-mgr-diskprediction-local-2:17.2.6-823.g893f 114/147 2023-08-01T19:52:31.506 INFO:teuthology.orchestra.run.smithi006.stdout: Installing : ceph-base-2:17.2.6-823.g893fa35f.el8.x86_64 98/147 2023-08-01T19:52:31.606 INFO:teuthology.orchestra.run.smithi006.stdout: Running scriptlet: ceph-base-2:17.2.6-823.g893fa35f.el8.x86_64 98/147 2023-08-01T19:52:31.702 INFO:teuthology.orchestra.run.smithi101.stdout: Installing : ceph-mgr-modules-core-2:17.2.6-823.g893fa35f.el8 115/147 2023-08-01T19:52:31.765 INFO:teuthology.orchestra.run.smithi006.stdout: Installing : ceph-selinux-2:17.2.6-823.g893fa35f.el8.x86_64 99/147 2023-08-01T19:52:31.924 INFO:teuthology.orchestra.run.smithi101.stdout: Installing : ceph-mgr-2:17.2.6-823.g893fa35f.el8.x86_64 116/147 2023-08-01T19:52:31.959 INFO:teuthology.orchestra.run.smithi101.stdout: Running scriptlet: ceph-mgr-2:17.2.6-823.g893fa35f.el8.x86_64 116/147 2023-08-01T19:52:32.152 INFO:teuthology.orchestra.run.smithi101.stdout: Installing : ceph-mgr-rook-2:17.2.6-823.g893fa35f.el8.noarch 117/147 2023-08-01T19:52:32.163 INFO:teuthology.orchestra.run.smithi101.stdout: Running scriptlet: ceph-mgr-rook-2:17.2.6-823.g893fa35f.el8.noarch 117/147 2023-08-01T19:52:32.361 INFO:teuthology.orchestra.run.smithi101.stdout: Installing : ceph-2:17.2.6-823.g893fa35f.el8.x86_64 118/147 2023-08-01T19:52:32.502 INFO:teuthology.orchestra.run.smithi101.stdout: Installing : libtool-2.4.6-25.el8.x86_64 119/147 2023-08-01T19:52:33.803 INFO:teuthology.orchestra.run.smithi155.stdout: Running scriptlet: ceph-selinux-2:17.2.6-823.g893fa35f.el8.x86_64 99/147 2023-08-01T19:52:33.803 INFO:teuthology.orchestra.run.smithi155.stdout:skipping the directory /sys 2023-08-01T19:52:33.803 INFO:teuthology.orchestra.run.smithi155.stdout:skipping the directory /proc 2023-08-01T19:52:33.803 INFO:teuthology.orchestra.run.smithi155.stdout:skipping the directory /dev 2023-08-01T19:52:33.803 INFO:teuthology.orchestra.run.smithi155.stdout:skipping the directory /run 2023-08-01T19:52:33.804 INFO:teuthology.orchestra.run.smithi155.stdout:skipping the directory /mnt 2023-08-01T19:52:33.804 INFO:teuthology.orchestra.run.smithi155.stdout:skipping the directory /var/tmp 2023-08-01T19:52:33.804 INFO:teuthology.orchestra.run.smithi155.stdout:skipping the directory /home 2023-08-01T19:52:33.804 INFO:teuthology.orchestra.run.smithi155.stdout:skipping the directory /tmp 2023-08-01T19:52:33.804 INFO:teuthology.orchestra.run.smithi155.stdout:skipping the directory /dev 2023-08-01T19:52:33.804 INFO:teuthology.orchestra.run.smithi155.stdout: 2023-08-01T19:52:34.176 INFO:teuthology.orchestra.run.smithi155.stdout: Installing : ceph-volume-2:17.2.6-823.g893fa35f.el8.noarch 100/147 2023-08-01T19:52:35.653 INFO:teuthology.orchestra.run.smithi155.stdout: Running scriptlet: ceph-volume-2:17.2.6-823.g893fa35f.el8.noarch 100/147 2023-08-01T19:52:35.884 INFO:teuthology.orchestra.run.smithi155.stdout: Installing : ceph-osd-2:17.2.6-823.g893fa35f.el8.x86_64 101/147 2023-08-01T19:52:36.105 INFO:teuthology.orchestra.run.smithi155.stdout: Running scriptlet: ceph-osd-2:17.2.6-823.g893fa35f.el8.x86_64 101/147 2023-08-01T19:52:36.284 INFO:teuthology.orchestra.run.smithi155.stdout: Installing : ceph-mds-2:17.2.6-823.g893fa35f.el8.x86_64 102/147 2023-08-01T19:52:36.676 INFO:teuthology.orchestra.run.smithi155.stdout: Running scriptlet: ceph-mds-2:17.2.6-823.g893fa35f.el8.x86_64 102/147 2023-08-01T19:52:36.880 INFO:teuthology.orchestra.run.smithi155.stdout: Installing : ceph-mon-2:17.2.6-823.g893fa35f.el8.x86_64 103/147 2023-08-01T19:52:36.904 INFO:teuthology.orchestra.run.smithi155.stdout: Running scriptlet: ceph-mon-2:17.2.6-823.g893fa35f.el8.x86_64 103/147 2023-08-01T19:52:37.146 INFO:teuthology.orchestra.run.smithi155.stdout: Installing : python3-jsonpointer-1.10-11.el8.noarch 104/147 2023-08-01T19:52:37.363 INFO:teuthology.orchestra.run.smithi155.stdout: Installing : python3-jsonpatch-1.21-2.el8.noarch 105/147 2023-08-01T19:52:37.417 INFO:teuthology.orchestra.run.smithi101.stdout: Running scriptlet: libtool-2.4.6-25.el8.x86_64 119/147 2023-08-01T19:52:37.559 INFO:teuthology.orchestra.run.smithi155.stdout: Installing : oniguruma-6.8.2-2.el8.x86_64 106/147 2023-08-01T19:52:37.622 INFO:teuthology.orchestra.run.smithi155.stdout: Running scriptlet: oniguruma-6.8.2-2.el8.x86_64 106/147 2023-08-01T19:52:37.913 INFO:teuthology.orchestra.run.smithi155.stdout: Installing : jq-1.6-7.el8.x86_64 107/147 2023-08-01T19:52:38.167 INFO:teuthology.orchestra.run.smithi155.stdout: Installing : automake-1.16.1-7.el8.noarch 108/147 2023-08-01T19:52:38.732 INFO:teuthology.orchestra.run.smithi155.stdout: Running scriptlet: cephadm-2:17.2.6-823.g893fa35f.el8.noarch 109/147 2023-08-01T19:52:38.935 INFO:teuthology.orchestra.run.smithi155.stdout: Installing : cephadm-2:17.2.6-823.g893fa35f.el8.noarch 109/147 2023-08-01T19:52:39.065 INFO:teuthology.orchestra.run.smithi155.stdout: Installing : ceph-prometheus-alerts-2:17.2.6-823.g893fa35f.el 110/147 2023-08-01T19:52:39.170 INFO:teuthology.orchestra.run.smithi101.stdout: Installing : ceph-test-2:17.2.6-823.g893fa35f.el8.x86_64 120/147 2023-08-01T19:52:39.222 INFO:teuthology.orchestra.run.smithi008.stdout: Running scriptlet: ceph-selinux-2:17.2.6-823.g893fa35f.el8.x86_64 99/147 2023-08-01T19:52:39.223 INFO:teuthology.orchestra.run.smithi008.stdout:skipping the directory /sys 2023-08-01T19:52:39.223 INFO:teuthology.orchestra.run.smithi008.stdout:skipping the directory /proc 2023-08-01T19:52:39.223 INFO:teuthology.orchestra.run.smithi008.stdout:skipping the directory /dev 2023-08-01T19:52:39.223 INFO:teuthology.orchestra.run.smithi008.stdout:skipping the directory /run 2023-08-01T19:52:39.223 INFO:teuthology.orchestra.run.smithi008.stdout:skipping the directory /mnt 2023-08-01T19:52:39.223 INFO:teuthology.orchestra.run.smithi008.stdout:skipping the directory /var/tmp 2023-08-01T19:52:39.224 INFO:teuthology.orchestra.run.smithi008.stdout:skipping the directory /home 2023-08-01T19:52:39.224 INFO:teuthology.orchestra.run.smithi008.stdout:skipping the directory /tmp 2023-08-01T19:52:39.224 INFO:teuthology.orchestra.run.smithi008.stdout:skipping the directory /dev 2023-08-01T19:52:39.224 INFO:teuthology.orchestra.run.smithi008.stdout: 2023-08-01T19:52:39.287 INFO:teuthology.orchestra.run.smithi155.stdout: Installing : ceph-grafana-dashboards-2:17.2.6-823.g893fa35f.e 111/147 2023-08-01T19:52:39.406 INFO:teuthology.orchestra.run.smithi101.stdout: Installing : ceph-radosgw-2:17.2.6-823.g893fa35f.el8.x86_64 121/147 2023-08-01T19:52:39.493 INFO:teuthology.orchestra.run.smithi101.stdout: Running scriptlet: ceph-radosgw-2:17.2.6-823.g893fa35f.el8.x86_64 121/147 2023-08-01T19:52:39.517 INFO:teuthology.orchestra.run.smithi155.stdout: Installing : ceph-mgr-cephadm-2:17.2.6-823.g893fa35f.el8.noar 112/147 2023-08-01T19:52:39.685 INFO:teuthology.orchestra.run.smithi101.stdout: Installing : ceph-immutable-object-cache-2:17.2.6-823.g893fa3 122/147 2023-08-01T19:52:39.725 INFO:teuthology.orchestra.run.smithi008.stdout: Installing : ceph-volume-2:17.2.6-823.g893fa35f.el8.noarch 100/147 2023-08-01T19:52:39.727 INFO:teuthology.orchestra.run.smithi155.stdout: Running scriptlet: ceph-mgr-cephadm-2:17.2.6-823.g893fa35f.el8.noar 112/147 2023-08-01T19:52:39.949 INFO:teuthology.orchestra.run.smithi155.stdout: Installing : ceph-mgr-dashboard-2:17.2.6-823.g893fa35f.el8.no 113/147 2023-08-01T19:52:40.031 INFO:teuthology.orchestra.run.smithi101.stdout: Running scriptlet: ceph-immutable-object-cache-2:17.2.6-823.g893fa3 122/147 2023-08-01T19:52:40.276 INFO:teuthology.orchestra.run.smithi101.stdout: Installing : rbd-mirror-2:17.2.6-823.g893fa35f.el8.x86_64 123/147 2023-08-01T19:52:40.378 INFO:teuthology.orchestra.run.smithi101.stdout: Running scriptlet: rbd-mirror-2:17.2.6-823.g893fa35f.el8.x86_64 123/147 2023-08-01T19:52:40.917 INFO:teuthology.orchestra.run.smithi155.stdout: Running scriptlet: ceph-mgr-dashboard-2:17.2.6-823.g893fa35f.el8.no 113/147 2023-08-01T19:52:41.125 INFO:teuthology.orchestra.run.smithi155.stdout: Installing : ceph-mgr-diskprediction-local-2:17.2.6-823.g893f 114/147 2023-08-01T19:52:41.217 INFO:teuthology.orchestra.run.smithi155.stdout: Running scriptlet: ceph-mgr-diskprediction-local-2:17.2.6-823.g893f 114/147 2023-08-01T19:52:41.253 INFO:teuthology.orchestra.run.smithi101.stdout: Installing : ceph-fuse-2:17.2.6-823.g893fa35f.el8.x86_64 124/147 2023-08-01T19:52:41.287 INFO:teuthology.orchestra.run.smithi008.stdout: Running scriptlet: ceph-volume-2:17.2.6-823.g893fa35f.el8.noarch 100/147 2023-08-01T19:52:41.505 INFO:teuthology.orchestra.run.smithi101.stdout: Installing : openssl-devel-1:1.1.1k-9.el8.x86_64 125/147 2023-08-01T19:52:41.539 INFO:teuthology.orchestra.run.smithi008.stdout: Installing : ceph-osd-2:17.2.6-823.g893fa35f.el8.x86_64 101/147 2023-08-01T19:52:41.612 INFO:teuthology.orchestra.run.smithi155.stdout: Installing : ceph-mgr-modules-core-2:17.2.6-823.g893fa35f.el8 115/147 2023-08-01T19:52:41.771 INFO:teuthology.orchestra.run.smithi008.stdout: Running scriptlet: ceph-osd-2:17.2.6-823.g893fa35f.el8.x86_64 101/147 2023-08-01T19:52:41.781 INFO:teuthology.orchestra.run.smithi101.stdout: Installing : elfutils-libelf-devel-0.189-2.el8.x86_64 126/147 2023-08-01T19:52:41.874 INFO:teuthology.orchestra.run.smithi155.stdout: Installing : ceph-mgr-2:17.2.6-823.g893fa35f.el8.x86_64 116/147 2023-08-01T19:52:41.910 INFO:teuthology.orchestra.run.smithi155.stdout: Running scriptlet: ceph-mgr-2:17.2.6-823.g893fa35f.el8.x86_64 116/147 2023-08-01T19:52:41.916 INFO:teuthology.orchestra.run.smithi008.stdout: Installing : ceph-mds-2:17.2.6-823.g893fa35f.el8.x86_64 102/147 2023-08-01T19:52:42.003 INFO:teuthology.orchestra.run.smithi101.stdout: Upgrading : util-linux-user-2.32.1-42.el8.x86_64 127/147 2023-08-01T19:52:42.083 INFO:teuthology.orchestra.run.smithi155.stdout: Installing : ceph-mgr-rook-2:17.2.6-823.g893fa35f.el8.noarch 117/147 2023-08-01T19:52:42.094 INFO:teuthology.orchestra.run.smithi155.stdout: Running scriptlet: ceph-mgr-rook-2:17.2.6-823.g893fa35f.el8.noarch 117/147 2023-08-01T19:52:42.162 INFO:teuthology.orchestra.run.smithi101.stdout: Installing : xfsprogs-devel-5.0.0-12.el8.x86_64 128/147 2023-08-01T19:52:42.327 INFO:teuthology.orchestra.run.smithi008.stdout: Running scriptlet: ceph-mds-2:17.2.6-823.g893fa35f.el8.x86_64 102/147 2023-08-01T19:52:42.333 INFO:teuthology.orchestra.run.smithi155.stdout: Installing : ceph-2:17.2.6-823.g893fa35f.el8.x86_64 118/147 2023-08-01T19:52:42.367 INFO:teuthology.orchestra.run.smithi101.stdout: Installing : libcephfs-devel-2:17.2.6-823.g893fa35f.el8.x86_6 129/147 2023-08-01T19:52:42.491 INFO:teuthology.orchestra.run.smithi008.stdout: Installing : ceph-mon-2:17.2.6-823.g893fa35f.el8.x86_64 103/147 2023-08-01T19:52:42.516 INFO:teuthology.orchestra.run.smithi008.stdout: Running scriptlet: ceph-mon-2:17.2.6-823.g893fa35f.el8.x86_64 103/147 2023-08-01T19:52:42.541 INFO:teuthology.orchestra.run.smithi155.stdout: Installing : libtool-2.4.6-25.el8.x86_64 119/147 2023-08-01T19:52:42.575 INFO:teuthology.orchestra.run.smithi101.stdout: Installing : rbd-fuse-2:17.2.6-823.g893fa35f.el8.x86_64 130/147 2023-08-01T19:52:42.740 INFO:teuthology.orchestra.run.smithi008.stdout: Installing : python3-jsonpointer-1.10-11.el8.noarch 104/147 2023-08-01T19:52:42.835 INFO:teuthology.orchestra.run.smithi101.stdout: Installing : rbd-nbd-2:17.2.6-823.g893fa35f.el8.x86_64 131/147 2023-08-01T19:52:42.935 INFO:teuthology.orchestra.run.smithi008.stdout: Installing : python3-jsonpatch-1.21-2.el8.noarch 105/147 2023-08-01T19:52:43.025 INFO:teuthology.orchestra.run.smithi101.stdout: Installing : libaio-devel-0.3.112-1.el8.x86_64 132/147 2023-08-01T19:52:43.082 INFO:teuthology.orchestra.run.smithi008.stdout: Installing : oniguruma-6.8.2-2.el8.x86_64 106/147 2023-08-01T19:52:43.150 INFO:teuthology.orchestra.run.smithi008.stdout: Running scriptlet: oniguruma-6.8.2-2.el8.x86_64 106/147 2023-08-01T19:52:43.259 INFO:teuthology.orchestra.run.smithi101.stdout: Installing : flex-2.6.1-9.el8.x86_64 133/147 2023-08-01T19:52:43.341 INFO:teuthology.orchestra.run.smithi101.stdout: Running scriptlet: flex-2.6.1-9.el8.x86_64 133/147 2023-08-01T19:52:43.435 INFO:teuthology.orchestra.run.smithi008.stdout: Installing : jq-1.6-7.el8.x86_64 107/147 2023-08-01T19:52:43.584 INFO:teuthology.orchestra.run.smithi101.stdout: Installing : bison-3.0.4-10.el8.x86_64 134/147 2023-08-01T19:52:43.595 INFO:teuthology.orchestra.run.smithi101.stdout: Running scriptlet: bison-3.0.4-10.el8.x86_64 134/147 2023-08-01T19:52:43.633 INFO:teuthology.orchestra.run.smithi008.stdout: Installing : automake-1.16.1-7.el8.noarch 108/147 2023-08-01T19:52:43.769 INFO:teuthology.orchestra.run.smithi101.stdout: Cleanup : elfutils-debuginfod-client-0.189-1.el8.x86_64 135/147 2023-08-01T19:52:43.918 INFO:teuthology.orchestra.run.smithi101.stdout: Cleanup : elfutils-libs-0.189-1.el8.x86_64 136/147 2023-08-01T19:52:43.918 INFO:teuthology.orchestra.run.smithi101.stdout: Cleanup : xfsprogs-5.0.0-10.el8.x86_64 137/147 2023-08-01T19:52:44.153 INFO:teuthology.orchestra.run.smithi101.stdout: Running scriptlet: xfsprogs-5.0.0-10.el8.x86_64 137/147 2023-08-01T19:52:44.153 INFO:teuthology.orchestra.run.smithi101.stdout: Cleanup : librbd1-1:12.2.7-9.el8.x86_64 138/147 2023-08-01T19:52:44.207 INFO:teuthology.orchestra.run.smithi008.stdout: Running scriptlet: cephadm-2:17.2.6-823.g893fa35f.el8.noarch 109/147 2023-08-01T19:52:44.358 INFO:teuthology.orchestra.run.smithi008.stdout: Installing : cephadm-2:17.2.6-823.g893fa35f.el8.noarch 109/147 2023-08-01T19:52:44.412 INFO:teuthology.orchestra.run.smithi101.stdout: Running scriptlet: librbd1-1:12.2.7-9.el8.x86_64 138/147 2023-08-01T19:52:44.412 INFO:teuthology.orchestra.run.smithi101.stdout: Cleanup : librados2-1:12.2.7-9.el8.x86_64 139/147 2023-08-01T19:52:44.481 INFO:teuthology.orchestra.run.smithi008.stdout: Installing : ceph-prometheus-alerts-2:17.2.6-823.g893fa35f.el 110/147 2023-08-01T19:52:44.669 INFO:teuthology.orchestra.run.smithi101.stdout: Running scriptlet: librados2-1:12.2.7-9.el8.x86_64 139/147 2023-08-01T19:52:44.690 INFO:teuthology.orchestra.run.smithi008.stdout: Installing : ceph-grafana-dashboards-2:17.2.6-823.g893fa35f.e 111/147 2023-08-01T19:52:44.854 INFO:teuthology.orchestra.run.smithi101.stdout: Cleanup : util-linux-user-2.32.1-41.el8.x86_64 140/147 2023-08-01T19:52:44.890 INFO:teuthology.orchestra.run.smithi008.stdout: Installing : ceph-mgr-cephadm-2:17.2.6-823.g893fa35f.el8.noar 112/147 2023-08-01T19:52:45.085 INFO:teuthology.orchestra.run.smithi101.stdout: Cleanup : util-linux-2.32.1-41.el8.x86_64 141/147 2023-08-01T19:52:45.086 INFO:teuthology.orchestra.run.smithi101.stdout: Cleanup : libfdisk-2.32.1-41.el8.x86_64 142/147 2023-08-01T19:52:45.118 INFO:teuthology.orchestra.run.smithi008.stdout: Running scriptlet: ceph-mgr-cephadm-2:17.2.6-823.g893fa35f.el8.noar 112/147 2023-08-01T19:52:45.327 INFO:teuthology.orchestra.run.smithi101.stdout: Running scriptlet: libfdisk-2.32.1-41.el8.x86_64 142/147 2023-08-01T19:52:45.328 INFO:teuthology.orchestra.run.smithi101.stdout: Cleanup : libmount-2.32.1-41.el8.x86_64 143/147 2023-08-01T19:52:45.346 INFO:teuthology.orchestra.run.smithi008.stdout: Installing : ceph-mgr-dashboard-2:17.2.6-823.g893fa35f.el8.no 113/147 2023-08-01T19:52:45.511 INFO:teuthology.orchestra.run.smithi101.stdout: Running scriptlet: libmount-2.32.1-41.el8.x86_64 143/147 2023-08-01T19:52:45.511 INFO:teuthology.orchestra.run.smithi101.stdout: Cleanup : libblkid-2.32.1-41.el8.x86_64 144/147 2023-08-01T19:52:45.694 INFO:teuthology.orchestra.run.smithi101.stdout: Running scriptlet: libblkid-2.32.1-41.el8.x86_64 144/147 2023-08-01T19:52:45.694 INFO:teuthology.orchestra.run.smithi101.stdout: Cleanup : libuuid-2.32.1-41.el8.x86_64 145/147 2023-08-01T19:52:45.894 INFO:teuthology.orchestra.run.smithi101.stdout: Running scriptlet: libuuid-2.32.1-41.el8.x86_64 145/147 2023-08-01T19:52:45.894 INFO:teuthology.orchestra.run.smithi101.stdout: Cleanup : libsmartcols-2.32.1-41.el8.x86_64 146/147 2023-08-01T19:52:46.153 INFO:teuthology.orchestra.run.smithi101.stdout: Running scriptlet: libsmartcols-2.32.1-41.el8.x86_64 146/147 2023-08-01T19:52:46.372 INFO:teuthology.orchestra.run.smithi008.stdout: Running scriptlet: ceph-mgr-dashboard-2:17.2.6-823.g893fa35f.el8.no 113/147 2023-08-01T19:52:46.376 INFO:teuthology.orchestra.run.smithi101.stdout: Cleanup : elfutils-libelf-0.189-1.el8.x86_64 147/147 2023-08-01T19:52:46.565 INFO:teuthology.orchestra.run.smithi008.stdout: Installing : ceph-mgr-diskprediction-local-2:17.2.6-823.g893f 114/147 2023-08-01T19:52:46.664 INFO:teuthology.orchestra.run.smithi008.stdout: Running scriptlet: ceph-mgr-diskprediction-local-2:17.2.6-823.g893f 114/147 2023-08-01T19:52:46.945 INFO:teuthology.orchestra.run.smithi101.stdout: Running scriptlet: elfutils-libelf-0.189-1.el8.x86_64 147/147 2023-08-01T19:52:46.945 INFO:teuthology.orchestra.run.smithi101.stdout: Verifying : ceph-2:17.2.6-823.g893fa35f.el8.x86_64 1/147 2023-08-01T19:52:46.946 INFO:teuthology.orchestra.run.smithi101.stdout: Verifying : ceph-base-2:17.2.6-823.g893fa35f.el8.x86_64 2/147 2023-08-01T19:52:46.946 INFO:teuthology.orchestra.run.smithi101.stdout: Verifying : ceph-common-2:17.2.6-823.g893fa35f.el8.x86_64 3/147 2023-08-01T19:52:46.946 INFO:teuthology.orchestra.run.smithi101.stdout: Verifying : ceph-fuse-2:17.2.6-823.g893fa35f.el8.x86_64 4/147 2023-08-01T19:52:46.946 INFO:teuthology.orchestra.run.smithi101.stdout: Verifying : ceph-immutable-object-cache-2:17.2.6-823.g893fa3 5/147 2023-08-01T19:52:46.946 INFO:teuthology.orchestra.run.smithi101.stdout: Verifying : ceph-mds-2:17.2.6-823.g893fa35f.el8.x86_64 6/147 2023-08-01T19:52:46.947 INFO:teuthology.orchestra.run.smithi101.stdout: Verifying : ceph-mgr-2:17.2.6-823.g893fa35f.el8.x86_64 7/147 2023-08-01T19:52:46.947 INFO:teuthology.orchestra.run.smithi101.stdout: Verifying : ceph-mon-2:17.2.6-823.g893fa35f.el8.x86_64 8/147 2023-08-01T19:52:46.947 INFO:teuthology.orchestra.run.smithi101.stdout: Verifying : ceph-osd-2:17.2.6-823.g893fa35f.el8.x86_64 9/147 2023-08-01T19:52:46.947 INFO:teuthology.orchestra.run.smithi101.stdout: Verifying : ceph-radosgw-2:17.2.6-823.g893fa35f.el8.x86_64 10/147 2023-08-01T19:52:46.947 INFO:teuthology.orchestra.run.smithi101.stdout: Verifying : ceph-selinux-2:17.2.6-823.g893fa35f.el8.x86_64 11/147 2023-08-01T19:52:46.947 INFO:teuthology.orchestra.run.smithi101.stdout: Verifying : ceph-test-2:17.2.6-823.g893fa35f.el8.x86_64 12/147 2023-08-01T19:52:46.947 INFO:teuthology.orchestra.run.smithi101.stdout: Verifying : libcephfs-devel-2:17.2.6-823.g893fa35f.el8.x86_6 13/147 2023-08-01T19:52:46.948 INFO:teuthology.orchestra.run.smithi101.stdout: Verifying : libcephfs2-2:17.2.6-823.g893fa35f.el8.x86_64 14/147 2023-08-01T19:52:46.948 INFO:teuthology.orchestra.run.smithi101.stdout: Verifying : libcephsqlite-2:17.2.6-823.g893fa35f.el8.x86_64 15/147 2023-08-01T19:52:46.948 INFO:teuthology.orchestra.run.smithi101.stdout: Verifying : librados-devel-2:17.2.6-823.g893fa35f.el8.x86_64 16/147 2023-08-01T19:52:46.948 INFO:teuthology.orchestra.run.smithi101.stdout: Verifying : libradosstriper1-2:17.2.6-823.g893fa35f.el8.x86_ 17/147 2023-08-01T19:52:46.948 INFO:teuthology.orchestra.run.smithi101.stdout: Verifying : librgw2-2:17.2.6-823.g893fa35f.el8.x86_64 18/147 2023-08-01T19:52:46.948 INFO:teuthology.orchestra.run.smithi101.stdout: Verifying : python3-ceph-argparse-2:17.2.6-823.g893fa35f.el8 19/147 2023-08-01T19:52:46.949 INFO:teuthology.orchestra.run.smithi101.stdout: Verifying : python3-ceph-common-2:17.2.6-823.g893fa35f.el8.x 20/147 2023-08-01T19:52:46.949 INFO:teuthology.orchestra.run.smithi101.stdout: Verifying : python3-cephfs-2:17.2.6-823.g893fa35f.el8.x86_64 21/147 2023-08-01T19:52:46.949 INFO:teuthology.orchestra.run.smithi101.stdout: Verifying : python3-rados-2:17.2.6-823.g893fa35f.el8.x86_64 22/147 2023-08-01T19:52:46.949 INFO:teuthology.orchestra.run.smithi101.stdout: Verifying : python3-rbd-2:17.2.6-823.g893fa35f.el8.x86_64 23/147 2023-08-01T19:52:46.949 INFO:teuthology.orchestra.run.smithi101.stdout: Verifying : python3-rgw-2:17.2.6-823.g893fa35f.el8.x86_64 24/147 2023-08-01T19:52:46.949 INFO:teuthology.orchestra.run.smithi101.stdout: Verifying : rbd-fuse-2:17.2.6-823.g893fa35f.el8.x86_64 25/147 2023-08-01T19:52:46.949 INFO:teuthology.orchestra.run.smithi101.stdout: Verifying : rbd-mirror-2:17.2.6-823.g893fa35f.el8.x86_64 26/147 2023-08-01T19:52:46.949 INFO:teuthology.orchestra.run.smithi101.stdout: Verifying : rbd-nbd-2:17.2.6-823.g893fa35f.el8.x86_64 27/147 2023-08-01T19:52:46.959 INFO:teuthology.orchestra.run.smithi101.stdout: Verifying : ceph-grafana-dashboards-2:17.2.6-823.g893fa35f.e 28/147 2023-08-01T19:52:46.959 INFO:teuthology.orchestra.run.smithi101.stdout: Verifying : ceph-mgr-cephadm-2:17.2.6-823.g893fa35f.el8.noar 29/147 2023-08-01T19:52:46.959 INFO:teuthology.orchestra.run.smithi101.stdout: Verifying : ceph-mgr-dashboard-2:17.2.6-823.g893fa35f.el8.no 30/147 2023-08-01T19:52:46.959 INFO:teuthology.orchestra.run.smithi101.stdout: Verifying : ceph-mgr-diskprediction-local-2:17.2.6-823.g893f 31/147 2023-08-01T19:52:46.959 INFO:teuthology.orchestra.run.smithi101.stdout: Verifying : ceph-mgr-modules-core-2:17.2.6-823.g893fa35f.el8 32/147 2023-08-01T19:52:46.960 INFO:teuthology.orchestra.run.smithi101.stdout: Verifying : ceph-mgr-rook-2:17.2.6-823.g893fa35f.el8.noarch 33/147 2023-08-01T19:52:46.960 INFO:teuthology.orchestra.run.smithi101.stdout: Verifying : ceph-prometheus-alerts-2:17.2.6-823.g893fa35f.el 34/147 2023-08-01T19:52:46.960 INFO:teuthology.orchestra.run.smithi101.stdout: Verifying : ceph-volume-2:17.2.6-823.g893fa35f.el8.noarch 35/147 2023-08-01T19:52:46.960 INFO:teuthology.orchestra.run.smithi101.stdout: Verifying : cephadm-2:17.2.6-823.g893fa35f.el8.noarch 36/147 2023-08-01T19:52:46.960 INFO:teuthology.orchestra.run.smithi101.stdout: Verifying : automake-1.16.1-7.el8.noarch 37/147 2023-08-01T19:52:46.960 INFO:teuthology.orchestra.run.smithi101.stdout: Verifying : bison-3.0.4-10.el8.x86_64 38/147 2023-08-01T19:52:46.960 INFO:teuthology.orchestra.run.smithi101.stdout: Verifying : flex-2.6.1-9.el8.x86_64 39/147 2023-08-01T19:52:46.961 INFO:teuthology.orchestra.run.smithi101.stdout: Verifying : jq-1.6-7.el8.x86_64 40/147 2023-08-01T19:52:46.961 INFO:teuthology.orchestra.run.smithi101.stdout: Verifying : librdkafka-0.11.4-3.el8.x86_64 41/147 2023-08-01T19:52:46.961 INFO:teuthology.orchestra.run.smithi101.stdout: Verifying : libtool-2.4.6-25.el8.x86_64 42/147 2023-08-01T19:52:46.961 INFO:teuthology.orchestra.run.smithi101.stdout: Verifying : lttng-ust-2.8.1-11.el8.x86_64 43/147 2023-08-01T19:52:46.961 INFO:teuthology.orchestra.run.smithi101.stdout: Verifying : oniguruma-6.8.2-2.el8.x86_64 44/147 2023-08-01T19:52:46.961 INFO:teuthology.orchestra.run.smithi101.stdout: Verifying : openblas-0.3.15-4.el8.x86_64 45/147 2023-08-01T19:52:46.961 INFO:teuthology.orchestra.run.smithi101.stdout: Verifying : openblas-threads-0.3.15-4.el8.x86_64 46/147 2023-08-01T19:52:46.962 INFO:teuthology.orchestra.run.smithi101.stdout: Verifying : python3-babel-2.5.1-7.el8.noarch 47/147 2023-08-01T19:52:46.962 INFO:teuthology.orchestra.run.smithi101.stdout: Verifying : python3-jinja2-2.10.1-3.el8.noarch 48/147 2023-08-01T19:52:46.962 INFO:teuthology.orchestra.run.smithi101.stdout: Verifying : python3-jsonpatch-1.21-2.el8.noarch 49/147 2023-08-01T19:52:46.962 INFO:teuthology.orchestra.run.smithi101.stdout: Verifying : python3-jsonpointer-1.10-11.el8.noarch 50/147 2023-08-01T19:52:46.962 INFO:teuthology.orchestra.run.smithi101.stdout: Verifying : python3-mako-1.0.6-14.el8.noarch 51/147 2023-08-01T19:52:46.962 INFO:teuthology.orchestra.run.smithi101.stdout: Verifying : python3-markupsafe-0.23-19.el8.x86_64 52/147 2023-08-01T19:52:46.962 INFO:teuthology.orchestra.run.smithi101.stdout: Verifying : python3-numpy-1:1.14.3-10.el8.x86_64 53/147 2023-08-01T19:52:46.962 INFO:teuthology.orchestra.run.smithi101.stdout: Verifying : python3-numpy-f2py-1:1.14.3-10.el8.x86_64 54/147 2023-08-01T19:52:46.963 INFO:teuthology.orchestra.run.smithi101.stdout: Verifying : python3-prettytable-0.7.2-14.el8.noarch 55/147 2023-08-01T19:52:46.963 INFO:teuthology.orchestra.run.smithi101.stdout: Verifying : python3-pyOpenSSL-19.0.0-1.el8.noarch 56/147 2023-08-01T19:52:46.963 INFO:teuthology.orchestra.run.smithi101.stdout: Verifying : python3-pyasn1-0.3.7-6.el8.noarch 57/147 2023-08-01T19:52:46.963 INFO:teuthology.orchestra.run.smithi101.stdout: Verifying : python3-pyasn1-modules-0.3.7-6.el8.noarch 58/147 2023-08-01T19:52:46.963 INFO:teuthology.orchestra.run.smithi101.stdout: Verifying : python3-pytz-2017.2-9.el8.noarch 59/147 2023-08-01T19:52:46.963 INFO:teuthology.orchestra.run.smithi101.stdout: Verifying : python3-scipy-1.0.0-21.module_el8.5.0+771+e5d9a2 60/147 2023-08-01T19:52:46.963 INFO:teuthology.orchestra.run.smithi101.stdout: Verifying : python3-werkzeug-0.12.2-4.el8.noarch 61/147 2023-08-01T19:52:46.963 INFO:teuthology.orchestra.run.smithi101.stdout: Verifying : socat-1.7.4.1-1.el8.x86_64 62/147 2023-08-01T19:52:46.964 INFO:teuthology.orchestra.run.smithi101.stdout: Verifying : xmlstarlet-1.6.1-20.el8.x86_64 63/147 2023-08-01T19:52:46.964 INFO:teuthology.orchestra.run.smithi101.stdout: Verifying : elfutils-libelf-devel-0.189-2.el8.x86_64 64/147 2023-08-01T19:52:46.964 INFO:teuthology.orchestra.run.smithi101.stdout: Verifying : fuse-2.9.7-17.el8.x86_64 65/147 2023-08-01T19:52:46.964 INFO:teuthology.orchestra.run.smithi101.stdout: Verifying : keyutils-libs-devel-1.5.10-9.el8.x86_64 66/147 2023-08-01T19:52:46.964 INFO:teuthology.orchestra.run.smithi101.stdout: Verifying : krb5-devel-1.18.2-22.el8.x86_64 67/147 2023-08-01T19:52:46.964 INFO:teuthology.orchestra.run.smithi101.stdout: Verifying : libaio-devel-0.3.112-1.el8.x86_64 68/147 2023-08-01T19:52:46.964 INFO:teuthology.orchestra.run.smithi101.stdout: Verifying : libcom_err-devel-1.45.6-5.el8.x86_64 69/147 2023-08-01T19:52:46.965 INFO:teuthology.orchestra.run.smithi101.stdout: Verifying : libgfortran-8.5.0-20.el8.x86_64 70/147 2023-08-01T19:52:46.965 INFO:teuthology.orchestra.run.smithi101.stdout: Verifying : libquadmath-8.5.0-20.el8.x86_64 71/147 2023-08-01T19:52:46.965 INFO:teuthology.orchestra.run.smithi101.stdout: Verifying : librabbitmq-0.9.0-4.el8.x86_64 72/147 2023-08-01T19:52:46.965 INFO:teuthology.orchestra.run.smithi101.stdout: Verifying : libselinux-devel-2.9-8.el8.x86_64 73/147 2023-08-01T19:52:46.965 INFO:teuthology.orchestra.run.smithi101.stdout: Verifying : libsepol-devel-2.9-3.el8.x86_64 74/147 2023-08-01T19:52:46.965 INFO:teuthology.orchestra.run.smithi101.stdout: Verifying : libuuid-devel-2.32.1-42.el8.x86_64 75/147 2023-08-01T19:52:46.965 INFO:teuthology.orchestra.run.smithi101.stdout: Verifying : libverto-devel-0.3.2-2.el8.x86_64 76/147 2023-08-01T19:52:46.966 INFO:teuthology.orchestra.run.smithi101.stdout: Verifying : libzstd-devel-1.4.4-1.el8.x86_64 77/147 2023-08-01T19:52:46.966 INFO:teuthology.orchestra.run.smithi101.stdout: Verifying : openssl-devel-1:1.1.1k-9.el8.x86_64 78/147 2023-08-01T19:52:46.966 INFO:teuthology.orchestra.run.smithi101.stdout: Verifying : pcre2-devel-10.32-3.el8.x86_64 79/147 2023-08-01T19:52:46.966 INFO:teuthology.orchestra.run.smithi101.stdout: Verifying : pcre2-utf16-10.32-3.el8.x86_64 80/147 2023-08-01T19:52:46.966 INFO:teuthology.orchestra.run.smithi101.stdout: Verifying : pcre2-utf32-10.32-3.el8.x86_64 81/147 2023-08-01T19:52:46.966 INFO:teuthology.orchestra.run.smithi101.stdout: Verifying : python3-cffi-1.11.5-6.el8.x86_64 82/147 2023-08-01T19:52:46.966 INFO:teuthology.orchestra.run.smithi101.stdout: Verifying : python3-cryptography-3.2.1-6.el8.x86_64 83/147 2023-08-01T19:52:46.966 INFO:teuthology.orchestra.run.smithi101.stdout: Verifying : python3-jwt-1.6.1-2.el8.noarch 84/147 2023-08-01T19:52:46.967 INFO:teuthology.orchestra.run.smithi101.stdout: Verifying : python3-oauthlib-2.1.0-1.el8.noarch 85/147 2023-08-01T19:52:46.967 INFO:teuthology.orchestra.run.smithi101.stdout: Verifying : python3-pycparser-2.14-14.el8.noarch 86/147 2023-08-01T19:52:46.967 INFO:teuthology.orchestra.run.smithi101.stdout: Verifying : python3-requests-oauthlib-1.0.0-1.el8.noarch 87/147 2023-08-01T19:52:46.967 INFO:teuthology.orchestra.run.smithi101.stdout: Verifying : xfsprogs-devel-5.0.0-12.el8.x86_64 88/147 2023-08-01T19:52:46.967 INFO:teuthology.orchestra.run.smithi101.stdout: Verifying : zlib-devel-1.2.11-21.el8.x86_64 89/147 2023-08-01T19:52:46.967 INFO:teuthology.orchestra.run.smithi101.stdout: Verifying : gperftools-libs-1:2.7-9.el8.x86_64 90/147 2023-08-01T19:52:46.967 INFO:teuthology.orchestra.run.smithi101.stdout: Verifying : liboath-2.6.2-3.el8.x86_64 91/147 2023-08-01T19:52:46.967 INFO:teuthology.orchestra.run.smithi101.stdout: Verifying : libunwind-1.3.1-3.el8.x86_64 92/147 2023-08-01T19:52:46.968 INFO:teuthology.orchestra.run.smithi101.stdout: Verifying : python3-asyncssh-2.7.0-2.el8.noarch 93/147 2023-08-01T19:52:46.968 INFO:teuthology.orchestra.run.smithi101.stdout: Verifying : python3-bcrypt-3.1.6-2.el8.1.x86_64 94/147 2023-08-01T19:52:46.968 INFO:teuthology.orchestra.run.smithi101.stdout: Verifying : python3-beautifulsoup4-4.6.3-2.el8.1.noarch 95/147 2023-08-01T19:52:46.968 INFO:teuthology.orchestra.run.smithi101.stdout: Verifying : python3-cachetools-3.1.1-4.el8.noarch 96/147 2023-08-01T19:52:46.968 INFO:teuthology.orchestra.run.smithi101.stdout: Verifying : python3-certifi-2018.10.15-7.el8.noarch 97/147 2023-08-01T19:52:46.968 INFO:teuthology.orchestra.run.smithi101.stdout: Verifying : python3-cheroot-8.5.2-1.el8.noarch 98/147 2023-08-01T19:52:46.968 INFO:teuthology.orchestra.run.smithi101.stdout: Verifying : python3-cherrypy-18.4.0-1.el8.noarch 99/147 2023-08-01T19:52:46.969 INFO:teuthology.orchestra.run.smithi101.stdout: Verifying : python3-google-auth-1:1.1.1-10.el8.noarch 100/147 2023-08-01T19:52:46.969 INFO:teuthology.orchestra.run.smithi101.stdout: Verifying : python3-jaraco-6.2-6.el8.noarch 101/147 2023-08-01T19:52:46.969 INFO:teuthology.orchestra.run.smithi101.stdout: Verifying : python3-jaraco-functools-2.0-4.el8.noarch 102/147 2023-08-01T19:52:46.969 INFO:teuthology.orchestra.run.smithi101.stdout: Verifying : python3-kubernetes-1:11.0.0-6.el8.noarch 103/147 2023-08-01T19:52:46.969 INFO:teuthology.orchestra.run.smithi101.stdout: Verifying : python3-logutils-0.3.5-11.el8.noarch 104/147 2023-08-01T19:52:46.969 INFO:teuthology.orchestra.run.smithi101.stdout: Verifying : python3-more-itertools-7.2.0-3.el8.noarch 105/147 2023-08-01T19:52:46.969 INFO:teuthology.orchestra.run.smithi101.stdout: Verifying : python3-natsort-7.1.1-2.el8.noarch 106/147 2023-08-01T19:52:46.969 INFO:teuthology.orchestra.run.smithi101.stdout: Verifying : python3-pecan-1.3.2-9.el8.noarch 107/147 2023-08-01T19:52:46.970 INFO:teuthology.orchestra.run.smithi101.stdout: Verifying : python3-portend-2.6-1.el8.noarch 108/147 2023-08-01T19:52:46.970 INFO:teuthology.orchestra.run.smithi101.stdout: Verifying : python3-repoze-lru-0.7-6.el8.noarch 109/147 2023-08-01T19:52:46.970 INFO:teuthology.orchestra.run.smithi101.stdout: Verifying : python3-routes-2.4.1-12.el8.noarch 110/147 2023-08-01T19:52:46.970 INFO:teuthology.orchestra.run.smithi101.stdout: Verifying : python3-rsa-4.9-2.el8.noarch 111/147 2023-08-01T19:52:46.970 INFO:teuthology.orchestra.run.smithi101.stdout: Verifying : python3-simplegeneric-0.8.1-17.el8.noarch 112/147 2023-08-01T19:52:46.970 INFO:teuthology.orchestra.run.smithi101.stdout: Verifying : python3-singledispatch-3.4.0.3-18.el8.noarch 113/147 2023-08-01T19:52:46.970 INFO:teuthology.orchestra.run.smithi101.stdout: Verifying : python3-tempora-1.14.1-5.el8.noarch 114/147 2023-08-01T19:52:46.970 INFO:teuthology.orchestra.run.smithi101.stdout: Verifying : python3-trustme-0.6.0-4.el8.noarch 115/147 2023-08-01T19:52:46.971 INFO:teuthology.orchestra.run.smithi101.stdout: Verifying : python3-waitress-1.4.3-1.el8.noarch 116/147 2023-08-01T19:52:46.971 INFO:teuthology.orchestra.run.smithi101.stdout: Verifying : python3-webob-1.8.5-1.el8.1.noarch 117/147 2023-08-01T19:52:46.971 INFO:teuthology.orchestra.run.smithi101.stdout: Verifying : python3-websocket-client-0.56.0-5.el8.noarch 118/147 2023-08-01T19:52:46.971 INFO:teuthology.orchestra.run.smithi101.stdout: Verifying : python3-webtest-2.0.33-1.el8.noarch 119/147 2023-08-01T19:52:46.971 INFO:teuthology.orchestra.run.smithi101.stdout: Verifying : python3-zc-lockfile-2.0-2.el8.noarch 120/147 2023-08-01T19:52:46.971 INFO:teuthology.orchestra.run.smithi101.stdout: Verifying : thrift-0.13.0-2.el8.x86_64 121/147 2023-08-01T19:52:46.972 INFO:teuthology.orchestra.run.smithi101.stdout: Verifying : librados2-2:17.2.6-823.g893fa35f.el8.x86_64 122/147 2023-08-01T19:52:46.972 INFO:teuthology.orchestra.run.smithi101.stdout: Verifying : librados2-1:12.2.7-9.el8.x86_64 123/147 2023-08-01T19:52:46.972 INFO:teuthology.orchestra.run.smithi101.stdout: Verifying : librbd1-2:17.2.6-823.g893fa35f.el8.x86_64 124/147 2023-08-01T19:52:46.972 INFO:teuthology.orchestra.run.smithi101.stdout: Verifying : librbd1-1:12.2.7-9.el8.x86_64 125/147 2023-08-01T19:52:46.972 INFO:teuthology.orchestra.run.smithi101.stdout: Verifying : elfutils-debuginfod-client-0.189-2.el8.x86_64 126/147 2023-08-01T19:52:46.972 INFO:teuthology.orchestra.run.smithi101.stdout: Verifying : elfutils-debuginfod-client-0.189-1.el8.x86_64 127/147 2023-08-01T19:52:46.972 INFO:teuthology.orchestra.run.smithi101.stdout: Verifying : elfutils-libelf-0.189-2.el8.x86_64 128/147 2023-08-01T19:52:46.973 INFO:teuthology.orchestra.run.smithi101.stdout: Verifying : elfutils-libelf-0.189-1.el8.x86_64 129/147 2023-08-01T19:52:46.973 INFO:teuthology.orchestra.run.smithi101.stdout: Verifying : elfutils-libs-0.189-2.el8.x86_64 130/147 2023-08-01T19:52:46.973 INFO:teuthology.orchestra.run.smithi101.stdout: Verifying : elfutils-libs-0.189-1.el8.x86_64 131/147 2023-08-01T19:52:46.973 INFO:teuthology.orchestra.run.smithi101.stdout: Verifying : libblkid-2.32.1-42.el8.x86_64 132/147 2023-08-01T19:52:46.973 INFO:teuthology.orchestra.run.smithi101.stdout: Verifying : libblkid-2.32.1-41.el8.x86_64 133/147 2023-08-01T19:52:46.973 INFO:teuthology.orchestra.run.smithi101.stdout: Verifying : libfdisk-2.32.1-42.el8.x86_64 134/147 2023-08-01T19:52:46.973 INFO:teuthology.orchestra.run.smithi101.stdout: Verifying : libfdisk-2.32.1-41.el8.x86_64 135/147 2023-08-01T19:52:46.974 INFO:teuthology.orchestra.run.smithi101.stdout: Verifying : libmount-2.32.1-42.el8.x86_64 136/147 2023-08-01T19:52:46.974 INFO:teuthology.orchestra.run.smithi101.stdout: Verifying : libmount-2.32.1-41.el8.x86_64 137/147 2023-08-01T19:52:46.974 INFO:teuthology.orchestra.run.smithi101.stdout: Verifying : libsmartcols-2.32.1-42.el8.x86_64 138/147 2023-08-01T19:52:46.974 INFO:teuthology.orchestra.run.smithi101.stdout: Verifying : libsmartcols-2.32.1-41.el8.x86_64 139/147 2023-08-01T19:52:46.974 INFO:teuthology.orchestra.run.smithi101.stdout: Verifying : libuuid-2.32.1-42.el8.x86_64 140/147 2023-08-01T19:52:46.974 INFO:teuthology.orchestra.run.smithi101.stdout: Verifying : libuuid-2.32.1-41.el8.x86_64 141/147 2023-08-01T19:52:46.974 INFO:teuthology.orchestra.run.smithi101.stdout: Verifying : util-linux-2.32.1-42.el8.x86_64 142/147 2023-08-01T19:52:46.975 INFO:teuthology.orchestra.run.smithi101.stdout: Verifying : util-linux-2.32.1-41.el8.x86_64 143/147 2023-08-01T19:52:46.975 INFO:teuthology.orchestra.run.smithi101.stdout: Verifying : util-linux-user-2.32.1-42.el8.x86_64 144/147 2023-08-01T19:52:46.975 INFO:teuthology.orchestra.run.smithi101.stdout: Verifying : util-linux-user-2.32.1-41.el8.x86_64 145/147 2023-08-01T19:52:46.975 INFO:teuthology.orchestra.run.smithi101.stdout: Verifying : xfsprogs-5.0.0-12.el8.x86_64 146/147 2023-08-01T19:52:47.018 INFO:teuthology.orchestra.run.smithi008.stdout: Installing : ceph-mgr-modules-core-2:17.2.6-823.g893fa35f.el8 115/147 2023-08-01T19:52:47.363 INFO:teuthology.orchestra.run.smithi008.stdout: Installing : ceph-mgr-2:17.2.6-823.g893fa35f.el8.x86_64 116/147 2023-08-01T19:52:47.401 INFO:teuthology.orchestra.run.smithi008.stdout: Running scriptlet: ceph-mgr-2:17.2.6-823.g893fa35f.el8.x86_64 116/147 2023-08-01T19:52:47.456 INFO:teuthology.orchestra.run.smithi155.stdout: Running scriptlet: libtool-2.4.6-25.el8.x86_64 119/147 2023-08-01T19:52:47.540 INFO:teuthology.orchestra.run.smithi008.stdout: Installing : ceph-mgr-rook-2:17.2.6-823.g893fa35f.el8.noarch 117/147 2023-08-01T19:52:47.552 INFO:teuthology.orchestra.run.smithi008.stdout: Running scriptlet: ceph-mgr-rook-2:17.2.6-823.g893fa35f.el8.noarch 117/147 2023-08-01T19:52:47.731 INFO:teuthology.orchestra.run.smithi008.stdout: Installing : ceph-2:17.2.6-823.g893fa35f.el8.x86_64 118/147 2023-08-01T19:52:47.881 INFO:teuthology.orchestra.run.smithi008.stdout: Installing : libtool-2.4.6-25.el8.x86_64 119/147 2023-08-01T19:52:48.964 INFO:teuthology.orchestra.run.smithi101.stdout: Verifying : xfsprogs-5.0.0-10.el8.x86_64 147/147 2023-08-01T19:52:48.964 INFO:teuthology.orchestra.run.smithi101.stdout: 2023-08-01T19:52:48.965 INFO:teuthology.orchestra.run.smithi101.stdout:Upgraded: 2023-08-01T19:52:48.965 INFO:teuthology.orchestra.run.smithi101.stdout: elfutils-debuginfod-client-0.189-2.el8.x86_64 2023-08-01T19:52:48.965 INFO:teuthology.orchestra.run.smithi101.stdout: elfutils-libelf-0.189-2.el8.x86_64 2023-08-01T19:52:48.965 INFO:teuthology.orchestra.run.smithi101.stdout: elfutils-libs-0.189-2.el8.x86_64 2023-08-01T19:52:48.965 INFO:teuthology.orchestra.run.smithi101.stdout: libblkid-2.32.1-42.el8.x86_64 2023-08-01T19:52:48.965 INFO:teuthology.orchestra.run.smithi101.stdout: libfdisk-2.32.1-42.el8.x86_64 2023-08-01T19:52:48.965 INFO:teuthology.orchestra.run.smithi101.stdout: libmount-2.32.1-42.el8.x86_64 2023-08-01T19:52:48.966 INFO:teuthology.orchestra.run.smithi101.stdout: librados2-2:17.2.6-823.g893fa35f.el8.x86_64 2023-08-01T19:52:48.966 INFO:teuthology.orchestra.run.smithi101.stdout: librbd1-2:17.2.6-823.g893fa35f.el8.x86_64 2023-08-01T19:52:48.966 INFO:teuthology.orchestra.run.smithi101.stdout: libsmartcols-2.32.1-42.el8.x86_64 2023-08-01T19:52:48.966 INFO:teuthology.orchestra.run.smithi101.stdout: libuuid-2.32.1-42.el8.x86_64 2023-08-01T19:52:48.966 INFO:teuthology.orchestra.run.smithi101.stdout: util-linux-2.32.1-42.el8.x86_64 2023-08-01T19:52:48.966 INFO:teuthology.orchestra.run.smithi101.stdout: util-linux-user-2.32.1-42.el8.x86_64 2023-08-01T19:52:48.966 INFO:teuthology.orchestra.run.smithi101.stdout: xfsprogs-5.0.0-12.el8.x86_64 2023-08-01T19:52:48.967 INFO:teuthology.orchestra.run.smithi101.stdout:Installed: 2023-08-01T19:52:48.967 INFO:teuthology.orchestra.run.smithi101.stdout: automake-1.16.1-7.el8.noarch 2023-08-01T19:52:48.967 INFO:teuthology.orchestra.run.smithi101.stdout: bison-3.0.4-10.el8.x86_64 2023-08-01T19:52:48.967 INFO:teuthology.orchestra.run.smithi101.stdout: ceph-2:17.2.6-823.g893fa35f.el8.x86_64 2023-08-01T19:52:48.967 INFO:teuthology.orchestra.run.smithi101.stdout: ceph-base-2:17.2.6-823.g893fa35f.el8.x86_64 2023-08-01T19:52:48.967 INFO:teuthology.orchestra.run.smithi101.stdout: ceph-common-2:17.2.6-823.g893fa35f.el8.x86_64 2023-08-01T19:52:48.967 INFO:teuthology.orchestra.run.smithi101.stdout: ceph-fuse-2:17.2.6-823.g893fa35f.el8.x86_64 2023-08-01T19:52:48.967 INFO:teuthology.orchestra.run.smithi101.stdout: ceph-grafana-dashboards-2:17.2.6-823.g893fa35f.el8.noarch 2023-08-01T19:52:48.968 INFO:teuthology.orchestra.run.smithi101.stdout: ceph-immutable-object-cache-2:17.2.6-823.g893fa35f.el8.x86_64 2023-08-01T19:52:48.968 INFO:teuthology.orchestra.run.smithi101.stdout: ceph-mds-2:17.2.6-823.g893fa35f.el8.x86_64 2023-08-01T19:52:48.968 INFO:teuthology.orchestra.run.smithi101.stdout: ceph-mgr-2:17.2.6-823.g893fa35f.el8.x86_64 2023-08-01T19:52:48.968 INFO:teuthology.orchestra.run.smithi101.stdout: ceph-mgr-cephadm-2:17.2.6-823.g893fa35f.el8.noarch 2023-08-01T19:52:48.968 INFO:teuthology.orchestra.run.smithi101.stdout: ceph-mgr-dashboard-2:17.2.6-823.g893fa35f.el8.noarch 2023-08-01T19:52:48.968 INFO:teuthology.orchestra.run.smithi101.stdout: ceph-mgr-diskprediction-local-2:17.2.6-823.g893fa35f.el8.noarch 2023-08-01T19:52:48.968 INFO:teuthology.orchestra.run.smithi101.stdout: ceph-mgr-modules-core-2:17.2.6-823.g893fa35f.el8.noarch 2023-08-01T19:52:48.969 INFO:teuthology.orchestra.run.smithi101.stdout: ceph-mgr-rook-2:17.2.6-823.g893fa35f.el8.noarch 2023-08-01T19:52:48.969 INFO:teuthology.orchestra.run.smithi101.stdout: ceph-mon-2:17.2.6-823.g893fa35f.el8.x86_64 2023-08-01T19:52:48.969 INFO:teuthology.orchestra.run.smithi101.stdout: ceph-osd-2:17.2.6-823.g893fa35f.el8.x86_64 2023-08-01T19:52:48.969 INFO:teuthology.orchestra.run.smithi101.stdout: ceph-prometheus-alerts-2:17.2.6-823.g893fa35f.el8.noarch 2023-08-01T19:52:48.969 INFO:teuthology.orchestra.run.smithi101.stdout: ceph-radosgw-2:17.2.6-823.g893fa35f.el8.x86_64 2023-08-01T19:52:48.969 INFO:teuthology.orchestra.run.smithi101.stdout: ceph-selinux-2:17.2.6-823.g893fa35f.el8.x86_64 2023-08-01T19:52:48.969 INFO:teuthology.orchestra.run.smithi101.stdout: ceph-test-2:17.2.6-823.g893fa35f.el8.x86_64 2023-08-01T19:52:48.970 INFO:teuthology.orchestra.run.smithi101.stdout: ceph-volume-2:17.2.6-823.g893fa35f.el8.noarch 2023-08-01T19:52:48.970 INFO:teuthology.orchestra.run.smithi101.stdout: cephadm-2:17.2.6-823.g893fa35f.el8.noarch 2023-08-01T19:52:48.970 INFO:teuthology.orchestra.run.smithi101.stdout: elfutils-libelf-devel-0.189-2.el8.x86_64 2023-08-01T19:52:48.970 INFO:teuthology.orchestra.run.smithi101.stdout: flex-2.6.1-9.el8.x86_64 2023-08-01T19:52:48.970 INFO:teuthology.orchestra.run.smithi101.stdout: fuse-2.9.7-17.el8.x86_64 2023-08-01T19:52:48.970 INFO:teuthology.orchestra.run.smithi101.stdout: gperftools-libs-1:2.7-9.el8.x86_64 2023-08-01T19:52:48.970 INFO:teuthology.orchestra.run.smithi101.stdout: jq-1.6-7.el8.x86_64 2023-08-01T19:52:48.970 INFO:teuthology.orchestra.run.smithi101.stdout: keyutils-libs-devel-1.5.10-9.el8.x86_64 2023-08-01T19:52:48.971 INFO:teuthology.orchestra.run.smithi101.stdout: krb5-devel-1.18.2-22.el8.x86_64 2023-08-01T19:52:48.971 INFO:teuthology.orchestra.run.smithi101.stdout: libaio-devel-0.3.112-1.el8.x86_64 2023-08-01T19:52:48.971 INFO:teuthology.orchestra.run.smithi101.stdout: libcephfs-devel-2:17.2.6-823.g893fa35f.el8.x86_64 2023-08-01T19:52:48.971 INFO:teuthology.orchestra.run.smithi101.stdout: libcephfs2-2:17.2.6-823.g893fa35f.el8.x86_64 2023-08-01T19:52:48.971 INFO:teuthology.orchestra.run.smithi101.stdout: libcephsqlite-2:17.2.6-823.g893fa35f.el8.x86_64 2023-08-01T19:52:48.971 INFO:teuthology.orchestra.run.smithi101.stdout: libcom_err-devel-1.45.6-5.el8.x86_64 2023-08-01T19:52:48.971 INFO:teuthology.orchestra.run.smithi101.stdout: libgfortran-8.5.0-20.el8.x86_64 2023-08-01T19:52:48.971 INFO:teuthology.orchestra.run.smithi101.stdout: liboath-2.6.2-3.el8.x86_64 2023-08-01T19:52:48.972 INFO:teuthology.orchestra.run.smithi101.stdout: libquadmath-8.5.0-20.el8.x86_64 2023-08-01T19:52:48.972 INFO:teuthology.orchestra.run.smithi101.stdout: librabbitmq-0.9.0-4.el8.x86_64 2023-08-01T19:52:48.972 INFO:teuthology.orchestra.run.smithi101.stdout: librados-devel-2:17.2.6-823.g893fa35f.el8.x86_64 2023-08-01T19:52:48.972 INFO:teuthology.orchestra.run.smithi101.stdout: libradosstriper1-2:17.2.6-823.g893fa35f.el8.x86_64 2023-08-01T19:52:48.972 INFO:teuthology.orchestra.run.smithi101.stdout: librdkafka-0.11.4-3.el8.x86_64 2023-08-01T19:52:48.972 INFO:teuthology.orchestra.run.smithi101.stdout: librgw2-2:17.2.6-823.g893fa35f.el8.x86_64 2023-08-01T19:52:48.972 INFO:teuthology.orchestra.run.smithi101.stdout: libselinux-devel-2.9-8.el8.x86_64 2023-08-01T19:52:48.973 INFO:teuthology.orchestra.run.smithi101.stdout: libsepol-devel-2.9-3.el8.x86_64 2023-08-01T19:52:48.973 INFO:teuthology.orchestra.run.smithi101.stdout: libtool-2.4.6-25.el8.x86_64 2023-08-01T19:52:48.973 INFO:teuthology.orchestra.run.smithi101.stdout: libunwind-1.3.1-3.el8.x86_64 2023-08-01T19:52:48.973 INFO:teuthology.orchestra.run.smithi101.stdout: libuuid-devel-2.32.1-42.el8.x86_64 2023-08-01T19:52:48.973 INFO:teuthology.orchestra.run.smithi101.stdout: libverto-devel-0.3.2-2.el8.x86_64 2023-08-01T19:52:48.973 INFO:teuthology.orchestra.run.smithi101.stdout: libzstd-devel-1.4.4-1.el8.x86_64 2023-08-01T19:52:48.973 INFO:teuthology.orchestra.run.smithi101.stdout: lttng-ust-2.8.1-11.el8.x86_64 2023-08-01T19:52:48.973 INFO:teuthology.orchestra.run.smithi101.stdout: oniguruma-6.8.2-2.el8.x86_64 2023-08-01T19:52:48.974 INFO:teuthology.orchestra.run.smithi101.stdout: openblas-0.3.15-4.el8.x86_64 2023-08-01T19:52:48.974 INFO:teuthology.orchestra.run.smithi101.stdout: openblas-threads-0.3.15-4.el8.x86_64 2023-08-01T19:52:48.974 INFO:teuthology.orchestra.run.smithi101.stdout: openssl-devel-1:1.1.1k-9.el8.x86_64 2023-08-01T19:52:48.974 INFO:teuthology.orchestra.run.smithi101.stdout: pcre2-devel-10.32-3.el8.x86_64 2023-08-01T19:52:48.974 INFO:teuthology.orchestra.run.smithi101.stdout: pcre2-utf16-10.32-3.el8.x86_64 2023-08-01T19:52:48.974 INFO:teuthology.orchestra.run.smithi101.stdout: pcre2-utf32-10.32-3.el8.x86_64 2023-08-01T19:52:48.974 INFO:teuthology.orchestra.run.smithi101.stdout: python3-asyncssh-2.7.0-2.el8.noarch 2023-08-01T19:52:48.974 INFO:teuthology.orchestra.run.smithi101.stdout: python3-babel-2.5.1-7.el8.noarch 2023-08-01T19:52:48.975 INFO:teuthology.orchestra.run.smithi101.stdout: python3-bcrypt-3.1.6-2.el8.1.x86_64 2023-08-01T19:52:48.975 INFO:teuthology.orchestra.run.smithi101.stdout: python3-beautifulsoup4-4.6.3-2.el8.1.noarch 2023-08-01T19:52:48.975 INFO:teuthology.orchestra.run.smithi101.stdout: python3-cachetools-3.1.1-4.el8.noarch 2023-08-01T19:52:48.975 INFO:teuthology.orchestra.run.smithi101.stdout: python3-ceph-argparse-2:17.2.6-823.g893fa35f.el8.x86_64 2023-08-01T19:52:48.975 INFO:teuthology.orchestra.run.smithi101.stdout: python3-ceph-common-2:17.2.6-823.g893fa35f.el8.x86_64 2023-08-01T19:52:48.975 INFO:teuthology.orchestra.run.smithi101.stdout: python3-cephfs-2:17.2.6-823.g893fa35f.el8.x86_64 2023-08-01T19:52:48.975 INFO:teuthology.orchestra.run.smithi101.stdout: python3-certifi-2018.10.15-7.el8.noarch 2023-08-01T19:52:48.975 INFO:teuthology.orchestra.run.smithi101.stdout: python3-cffi-1.11.5-6.el8.x86_64 2023-08-01T19:52:48.976 INFO:teuthology.orchestra.run.smithi101.stdout: python3-cheroot-8.5.2-1.el8.noarch 2023-08-01T19:52:48.976 INFO:teuthology.orchestra.run.smithi101.stdout: python3-cherrypy-18.4.0-1.el8.noarch 2023-08-01T19:52:48.976 INFO:teuthology.orchestra.run.smithi101.stdout: python3-cryptography-3.2.1-6.el8.x86_64 2023-08-01T19:52:48.976 INFO:teuthology.orchestra.run.smithi101.stdout: python3-google-auth-1:1.1.1-10.el8.noarch 2023-08-01T19:52:48.976 INFO:teuthology.orchestra.run.smithi101.stdout: python3-jaraco-6.2-6.el8.noarch 2023-08-01T19:52:48.976 INFO:teuthology.orchestra.run.smithi101.stdout: python3-jaraco-functools-2.0-4.el8.noarch 2023-08-01T19:52:48.976 INFO:teuthology.orchestra.run.smithi101.stdout: python3-jinja2-2.10.1-3.el8.noarch 2023-08-01T19:52:48.977 INFO:teuthology.orchestra.run.smithi101.stdout: python3-jsonpatch-1.21-2.el8.noarch 2023-08-01T19:52:48.977 INFO:teuthology.orchestra.run.smithi101.stdout: python3-jsonpointer-1.10-11.el8.noarch 2023-08-01T19:52:48.977 INFO:teuthology.orchestra.run.smithi101.stdout: python3-jwt-1.6.1-2.el8.noarch 2023-08-01T19:52:48.977 INFO:teuthology.orchestra.run.smithi101.stdout: python3-kubernetes-1:11.0.0-6.el8.noarch 2023-08-01T19:52:48.977 INFO:teuthology.orchestra.run.smithi101.stdout: python3-logutils-0.3.5-11.el8.noarch 2023-08-01T19:52:48.977 INFO:teuthology.orchestra.run.smithi101.stdout: python3-mako-1.0.6-14.el8.noarch 2023-08-01T19:52:48.977 INFO:teuthology.orchestra.run.smithi101.stdout: python3-markupsafe-0.23-19.el8.x86_64 2023-08-01T19:52:48.977 INFO:teuthology.orchestra.run.smithi101.stdout: python3-more-itertools-7.2.0-3.el8.noarch 2023-08-01T19:52:48.978 INFO:teuthology.orchestra.run.smithi101.stdout: python3-natsort-7.1.1-2.el8.noarch 2023-08-01T19:52:48.978 INFO:teuthology.orchestra.run.smithi101.stdout: python3-numpy-1:1.14.3-10.el8.x86_64 2023-08-01T19:52:48.978 INFO:teuthology.orchestra.run.smithi101.stdout: python3-numpy-f2py-1:1.14.3-10.el8.x86_64 2023-08-01T19:52:48.978 INFO:teuthology.orchestra.run.smithi101.stdout: python3-oauthlib-2.1.0-1.el8.noarch 2023-08-01T19:52:48.978 INFO:teuthology.orchestra.run.smithi101.stdout: python3-pecan-1.3.2-9.el8.noarch 2023-08-01T19:52:48.978 INFO:teuthology.orchestra.run.smithi101.stdout: python3-portend-2.6-1.el8.noarch 2023-08-01T19:52:48.978 INFO:teuthology.orchestra.run.smithi101.stdout: python3-prettytable-0.7.2-14.el8.noarch 2023-08-01T19:52:48.978 INFO:teuthology.orchestra.run.smithi101.stdout: python3-pyOpenSSL-19.0.0-1.el8.noarch 2023-08-01T19:52:48.979 INFO:teuthology.orchestra.run.smithi101.stdout: python3-pyasn1-0.3.7-6.el8.noarch 2023-08-01T19:52:48.979 INFO:teuthology.orchestra.run.smithi101.stdout: python3-pyasn1-modules-0.3.7-6.el8.noarch 2023-08-01T19:52:48.979 INFO:teuthology.orchestra.run.smithi101.stdout: python3-pycparser-2.14-14.el8.noarch 2023-08-01T19:52:48.979 INFO:teuthology.orchestra.run.smithi101.stdout: python3-pytz-2017.2-9.el8.noarch 2023-08-01T19:52:48.979 INFO:teuthology.orchestra.run.smithi101.stdout: python3-rados-2:17.2.6-823.g893fa35f.el8.x86_64 2023-08-01T19:52:48.979 INFO:teuthology.orchestra.run.smithi101.stdout: python3-rbd-2:17.2.6-823.g893fa35f.el8.x86_64 2023-08-01T19:52:48.979 INFO:teuthology.orchestra.run.smithi101.stdout: python3-repoze-lru-0.7-6.el8.noarch 2023-08-01T19:52:48.980 INFO:teuthology.orchestra.run.smithi101.stdout: python3-requests-oauthlib-1.0.0-1.el8.noarch 2023-08-01T19:52:48.980 INFO:teuthology.orchestra.run.smithi101.stdout: python3-rgw-2:17.2.6-823.g893fa35f.el8.x86_64 2023-08-01T19:52:48.980 INFO:teuthology.orchestra.run.smithi101.stdout: python3-routes-2.4.1-12.el8.noarch 2023-08-01T19:52:48.980 INFO:teuthology.orchestra.run.smithi101.stdout: python3-rsa-4.9-2.el8.noarch 2023-08-01T19:52:48.980 INFO:teuthology.orchestra.run.smithi101.stdout: python3-scipy-1.0.0-21.module_el8.5.0+771+e5d9a225.x86_64 2023-08-01T19:52:48.980 INFO:teuthology.orchestra.run.smithi101.stdout: python3-simplegeneric-0.8.1-17.el8.noarch 2023-08-01T19:52:48.980 INFO:teuthology.orchestra.run.smithi101.stdout: python3-singledispatch-3.4.0.3-18.el8.noarch 2023-08-01T19:52:48.980 INFO:teuthology.orchestra.run.smithi101.stdout: python3-tempora-1.14.1-5.el8.noarch 2023-08-01T19:52:48.981 INFO:teuthology.orchestra.run.smithi101.stdout: python3-trustme-0.6.0-4.el8.noarch 2023-08-01T19:52:48.981 INFO:teuthology.orchestra.run.smithi101.stdout: python3-waitress-1.4.3-1.el8.noarch 2023-08-01T19:52:48.981 INFO:teuthology.orchestra.run.smithi101.stdout: python3-webob-1.8.5-1.el8.1.noarch 2023-08-01T19:52:48.981 INFO:teuthology.orchestra.run.smithi101.stdout: python3-websocket-client-0.56.0-5.el8.noarch 2023-08-01T19:52:48.981 INFO:teuthology.orchestra.run.smithi101.stdout: python3-webtest-2.0.33-1.el8.noarch 2023-08-01T19:52:48.981 INFO:teuthology.orchestra.run.smithi101.stdout: python3-werkzeug-0.12.2-4.el8.noarch 2023-08-01T19:52:48.981 INFO:teuthology.orchestra.run.smithi101.stdout: python3-zc-lockfile-2.0-2.el8.noarch 2023-08-01T19:52:48.982 INFO:teuthology.orchestra.run.smithi101.stdout: rbd-fuse-2:17.2.6-823.g893fa35f.el8.x86_64 2023-08-01T19:52:48.982 INFO:teuthology.orchestra.run.smithi101.stdout: rbd-mirror-2:17.2.6-823.g893fa35f.el8.x86_64 2023-08-01T19:52:48.982 INFO:teuthology.orchestra.run.smithi101.stdout: rbd-nbd-2:17.2.6-823.g893fa35f.el8.x86_64 2023-08-01T19:52:48.982 INFO:teuthology.orchestra.run.smithi101.stdout: socat-1.7.4.1-1.el8.x86_64 2023-08-01T19:52:48.982 INFO:teuthology.orchestra.run.smithi101.stdout: thrift-0.13.0-2.el8.x86_64 2023-08-01T19:52:48.982 INFO:teuthology.orchestra.run.smithi101.stdout: xfsprogs-devel-5.0.0-12.el8.x86_64 2023-08-01T19:52:48.982 INFO:teuthology.orchestra.run.smithi101.stdout: xmlstarlet-1.6.1-20.el8.x86_64 2023-08-01T19:52:48.983 INFO:teuthology.orchestra.run.smithi101.stdout: zlib-devel-1.2.11-21.el8.x86_64 2023-08-01T19:52:48.983 INFO:teuthology.orchestra.run.smithi101.stdout: 2023-08-01T19:52:48.983 INFO:teuthology.orchestra.run.smithi101.stdout:Complete! 2023-08-01T19:52:49.149 DEBUG:teuthology.parallel:result is None 2023-08-01T19:52:49.226 INFO:teuthology.orchestra.run.smithi155.stdout: Installing : ceph-test-2:17.2.6-823.g893fa35f.el8.x86_64 120/147 2023-08-01T19:52:49.465 INFO:teuthology.orchestra.run.smithi155.stdout: Installing : ceph-radosgw-2:17.2.6-823.g893fa35f.el8.x86_64 121/147 2023-08-01T19:52:49.553 INFO:teuthology.orchestra.run.smithi155.stdout: Running scriptlet: ceph-radosgw-2:17.2.6-823.g893fa35f.el8.x86_64 121/147 2023-08-01T19:52:49.774 INFO:teuthology.orchestra.run.smithi155.stdout: Installing : ceph-immutable-object-cache-2:17.2.6-823.g893fa3 122/147 2023-08-01T19:52:50.121 INFO:teuthology.orchestra.run.smithi155.stdout: Running scriptlet: ceph-immutable-object-cache-2:17.2.6-823.g893fa3 122/147 2023-08-01T19:52:50.332 INFO:teuthology.orchestra.run.smithi155.stdout: Installing : rbd-mirror-2:17.2.6-823.g893fa35f.el8.x86_64 123/147 2023-08-01T19:52:50.434 INFO:teuthology.orchestra.run.smithi155.stdout: Running scriptlet: rbd-mirror-2:17.2.6-823.g893fa35f.el8.x86_64 123/147 2023-08-01T19:52:51.316 INFO:teuthology.orchestra.run.smithi155.stdout: Installing : ceph-fuse-2:17.2.6-823.g893fa35f.el8.x86_64 124/147 2023-08-01T19:52:51.611 INFO:teuthology.orchestra.run.smithi155.stdout: Installing : openssl-devel-1:1.1.1k-9.el8.x86_64 125/147 2023-08-01T19:52:51.663 INFO:teuthology.orchestra.run.smithi006.stdout: Running scriptlet: ceph-selinux-2:17.2.6-823.g893fa35f.el8.x86_64 99/147 2023-08-01T19:52:51.664 INFO:teuthology.orchestra.run.smithi006.stdout:skipping the directory /sys 2023-08-01T19:52:51.664 INFO:teuthology.orchestra.run.smithi006.stdout:skipping the directory /proc 2023-08-01T19:52:51.665 INFO:teuthology.orchestra.run.smithi006.stdout:skipping the directory /dev 2023-08-01T19:52:51.665 INFO:teuthology.orchestra.run.smithi006.stdout:skipping the directory /run 2023-08-01T19:52:51.665 INFO:teuthology.orchestra.run.smithi006.stdout:skipping the directory /mnt 2023-08-01T19:52:51.665 INFO:teuthology.orchestra.run.smithi006.stdout:skipping the directory /var/tmp 2023-08-01T19:52:51.665 INFO:teuthology.orchestra.run.smithi006.stdout:skipping the directory /home 2023-08-01T19:52:51.666 INFO:teuthology.orchestra.run.smithi006.stdout:skipping the directory /tmp 2023-08-01T19:52:51.666 INFO:teuthology.orchestra.run.smithi006.stdout:skipping the directory /dev 2023-08-01T19:52:51.666 INFO:teuthology.orchestra.run.smithi006.stdout: 2023-08-01T19:52:51.886 INFO:teuthology.orchestra.run.smithi155.stdout: Installing : elfutils-libelf-devel-0.189-2.el8.x86_64 126/147 2023-08-01T19:52:52.021 INFO:teuthology.orchestra.run.smithi006.stdout: Installing : ceph-volume-2:17.2.6-823.g893fa35f.el8.noarch 100/147 2023-08-01T19:52:52.118 INFO:teuthology.orchestra.run.smithi155.stdout: Upgrading : util-linux-user-2.32.1-42.el8.x86_64 127/147 2023-08-01T19:52:52.310 INFO:teuthology.orchestra.run.smithi155.stdout: Installing : xfsprogs-devel-5.0.0-12.el8.x86_64 128/147 2023-08-01T19:52:52.473 INFO:teuthology.orchestra.run.smithi155.stdout: Installing : libcephfs-devel-2:17.2.6-823.g893fa35f.el8.x86_6 129/147 2023-08-01T19:52:52.694 INFO:teuthology.orchestra.run.smithi155.stdout: Installing : rbd-fuse-2:17.2.6-823.g893fa35f.el8.x86_64 130/147 2023-08-01T19:52:52.858 INFO:teuthology.orchestra.run.smithi155.stdout: Installing : rbd-nbd-2:17.2.6-823.g893fa35f.el8.x86_64 131/147 2023-08-01T19:52:53.075 INFO:teuthology.orchestra.run.smithi155.stdout: Installing : libaio-devel-0.3.112-1.el8.x86_64 132/147 2023-08-01T19:52:53.113 INFO:teuthology.orchestra.run.smithi008.stdout: Running scriptlet: libtool-2.4.6-25.el8.x86_64 119/147 2023-08-01T19:52:53.273 INFO:teuthology.orchestra.run.smithi155.stdout: Installing : flex-2.6.1-9.el8.x86_64 133/147 2023-08-01T19:52:53.367 INFO:teuthology.orchestra.run.smithi155.stdout: Running scriptlet: flex-2.6.1-9.el8.x86_64 133/147 2023-08-01T19:52:53.584 INFO:teuthology.orchestra.run.smithi006.stdout: Running scriptlet: ceph-volume-2:17.2.6-823.g893fa35f.el8.noarch 100/147 2023-08-01T19:52:53.636 INFO:teuthology.orchestra.run.smithi155.stdout: Installing : bison-3.0.4-10.el8.x86_64 134/147 2023-08-01T19:52:53.649 INFO:teuthology.orchestra.run.smithi155.stdout: Running scriptlet: bison-3.0.4-10.el8.x86_64 134/147 2023-08-01T19:52:53.820 INFO:teuthology.orchestra.run.smithi006.stdout: Installing : ceph-osd-2:17.2.6-823.g893fa35f.el8.x86_64 101/147 2023-08-01T19:52:53.833 INFO:teuthology.orchestra.run.smithi155.stdout: Cleanup : elfutils-debuginfod-client-0.189-1.el8.x86_64 135/147 2023-08-01T19:52:53.993 INFO:teuthology.orchestra.run.smithi155.stdout: Cleanup : elfutils-libs-0.189-1.el8.x86_64 136/147 2023-08-01T19:52:53.993 INFO:teuthology.orchestra.run.smithi155.stdout: Cleanup : xfsprogs-5.0.0-10.el8.x86_64 137/147 2023-08-01T19:52:54.053 INFO:teuthology.orchestra.run.smithi006.stdout: Running scriptlet: ceph-osd-2:17.2.6-823.g893fa35f.el8.x86_64 101/147 2023-08-01T19:52:54.204 INFO:teuthology.orchestra.run.smithi006.stdout: Installing : ceph-mds-2:17.2.6-823.g893fa35f.el8.x86_64 102/147 2023-08-01T19:52:54.260 INFO:teuthology.orchestra.run.smithi155.stdout: Running scriptlet: xfsprogs-5.0.0-10.el8.x86_64 137/147 2023-08-01T19:52:54.260 INFO:teuthology.orchestra.run.smithi155.stdout: Cleanup : librbd1-1:12.2.7-9.el8.x86_64 138/147 2023-08-01T19:52:54.518 INFO:teuthology.orchestra.run.smithi155.stdout: Running scriptlet: librbd1-1:12.2.7-9.el8.x86_64 138/147 2023-08-01T19:52:54.519 INFO:teuthology.orchestra.run.smithi155.stdout: Cleanup : librados2-1:12.2.7-9.el8.x86_64 139/147 2023-08-01T19:52:54.616 INFO:teuthology.orchestra.run.smithi006.stdout: Running scriptlet: ceph-mds-2:17.2.6-823.g893fa35f.el8.x86_64 102/147 2023-08-01T19:52:54.734 INFO:teuthology.orchestra.run.smithi155.stdout: Running scriptlet: librados2-1:12.2.7-9.el8.x86_64 139/147 2023-08-01T19:52:54.794 INFO:teuthology.orchestra.run.smithi006.stdout: Installing : ceph-mon-2:17.2.6-823.g893fa35f.el8.x86_64 103/147 2023-08-01T19:52:54.818 INFO:teuthology.orchestra.run.smithi006.stdout: Running scriptlet: ceph-mon-2:17.2.6-823.g893fa35f.el8.x86_64 103/147 2023-08-01T19:52:54.916 INFO:teuthology.orchestra.run.smithi008.stdout: Installing : ceph-test-2:17.2.6-823.g893fa35f.el8.x86_64 120/147 2023-08-01T19:52:54.923 INFO:teuthology.orchestra.run.smithi155.stdout: Cleanup : util-linux-user-2.32.1-41.el8.x86_64 140/147 2023-08-01T19:52:55.092 INFO:teuthology.orchestra.run.smithi006.stdout: Installing : python3-jsonpointer-1.10-11.el8.noarch 104/147 2023-08-01T19:52:55.095 INFO:teuthology.orchestra.run.smithi008.stdout: Installing : ceph-radosgw-2:17.2.6-823.g893fa35f.el8.x86_64 121/147 2023-08-01T19:52:55.116 INFO:teuthology.orchestra.run.smithi155.stdout: Cleanup : util-linux-2.32.1-41.el8.x86_64 141/147 2023-08-01T19:52:55.116 INFO:teuthology.orchestra.run.smithi155.stdout: Cleanup : libfdisk-2.32.1-41.el8.x86_64 142/147 2023-08-01T19:52:55.171 INFO:teuthology.orchestra.run.smithi008.stdout: Running scriptlet: ceph-radosgw-2:17.2.6-823.g893fa35f.el8.x86_64 121/147 2023-08-01T19:52:55.308 INFO:teuthology.orchestra.run.smithi006.stdout: Installing : python3-jsonpatch-1.21-2.el8.noarch 105/147 2023-08-01T19:52:55.359 INFO:teuthology.orchestra.run.smithi155.stdout: Running scriptlet: libfdisk-2.32.1-41.el8.x86_64 142/147 2023-08-01T19:52:55.359 INFO:teuthology.orchestra.run.smithi155.stdout: Cleanup : libmount-2.32.1-41.el8.x86_64 143/147 2023-08-01T19:52:55.453 INFO:teuthology.orchestra.run.smithi006.stdout: Installing : oniguruma-6.8.2-2.el8.x86_64 106/147 2023-08-01T19:52:55.489 INFO:teuthology.orchestra.run.smithi008.stdout: Installing : ceph-immutable-object-cache-2:17.2.6-823.g893fa3 122/147 2023-08-01T19:52:55.532 INFO:teuthology.orchestra.run.smithi006.stdout: Running scriptlet: oniguruma-6.8.2-2.el8.x86_64 106/147 2023-08-01T19:52:55.584 INFO:teuthology.orchestra.run.smithi155.stdout: Running scriptlet: libmount-2.32.1-41.el8.x86_64 143/147 2023-08-01T19:52:55.584 INFO:teuthology.orchestra.run.smithi155.stdout: Cleanup : libblkid-2.32.1-41.el8.x86_64 144/147 2023-08-01T19:52:55.789 INFO:teuthology.orchestra.run.smithi006.stdout: Installing : jq-1.6-7.el8.x86_64 107/147 2023-08-01T19:52:55.792 INFO:teuthology.orchestra.run.smithi155.stdout: Running scriptlet: libblkid-2.32.1-41.el8.x86_64 144/147 2023-08-01T19:52:55.792 INFO:teuthology.orchestra.run.smithi155.stdout: Cleanup : libuuid-2.32.1-41.el8.x86_64 145/147 2023-08-01T19:52:55.859 INFO:teuthology.orchestra.run.smithi008.stdout: Running scriptlet: ceph-immutable-object-cache-2:17.2.6-823.g893fa3 122/147 2023-08-01T19:52:56.031 INFO:teuthology.orchestra.run.smithi008.stdout: Installing : rbd-mirror-2:17.2.6-823.g893fa35f.el8.x86_64 123/147 2023-08-01T19:52:56.033 INFO:teuthology.orchestra.run.smithi155.stdout: Running scriptlet: libuuid-2.32.1-41.el8.x86_64 145/147 2023-08-01T19:52:56.034 INFO:teuthology.orchestra.run.smithi155.stdout: Cleanup : libsmartcols-2.32.1-41.el8.x86_64 146/147 2023-08-01T19:52:56.130 INFO:teuthology.orchestra.run.smithi008.stdout: Running scriptlet: rbd-mirror-2:17.2.6-823.g893fa35f.el8.x86_64 123/147 2023-08-01T19:52:56.154 INFO:teuthology.orchestra.run.smithi006.stdout: Installing : automake-1.16.1-7.el8.noarch 108/147 2023-08-01T19:52:56.225 INFO:teuthology.orchestra.run.smithi155.stdout: Running scriptlet: libsmartcols-2.32.1-41.el8.x86_64 146/147 2023-08-01T19:52:56.432 INFO:teuthology.orchestra.run.smithi155.stdout: Cleanup : elfutils-libelf-0.189-1.el8.x86_64 147/147 2023-08-01T19:52:56.683 INFO:teuthology.orchestra.run.smithi006.stdout: Running scriptlet: cephadm-2:17.2.6-823.g893fa35f.el8.noarch 109/147 2023-08-01T19:52:56.848 INFO:teuthology.orchestra.run.smithi006.stdout: Installing : cephadm-2:17.2.6-823.g893fa35f.el8.noarch 109/147 2023-08-01T19:52:56.969 INFO:teuthology.orchestra.run.smithi006.stdout: Installing : ceph-prometheus-alerts-2:17.2.6-823.g893fa35f.el 110/147 2023-08-01T19:52:57.027 INFO:teuthology.orchestra.run.smithi155.stdout: Running scriptlet: elfutils-libelf-0.189-1.el8.x86_64 147/147 2023-08-01T19:52:57.028 INFO:teuthology.orchestra.run.smithi155.stdout: Verifying : ceph-2:17.2.6-823.g893fa35f.el8.x86_64 1/147 2023-08-01T19:52:57.028 INFO:teuthology.orchestra.run.smithi155.stdout: Verifying : ceph-base-2:17.2.6-823.g893fa35f.el8.x86_64 2/147 2023-08-01T19:52:57.028 INFO:teuthology.orchestra.run.smithi155.stdout: Verifying : ceph-common-2:17.2.6-823.g893fa35f.el8.x86_64 3/147 2023-08-01T19:52:57.028 INFO:teuthology.orchestra.run.smithi155.stdout: Verifying : ceph-fuse-2:17.2.6-823.g893fa35f.el8.x86_64 4/147 2023-08-01T19:52:57.028 INFO:teuthology.orchestra.run.smithi155.stdout: Verifying : ceph-immutable-object-cache-2:17.2.6-823.g893fa3 5/147 2023-08-01T19:52:57.028 INFO:teuthology.orchestra.run.smithi155.stdout: Verifying : ceph-mds-2:17.2.6-823.g893fa35f.el8.x86_64 6/147 2023-08-01T19:52:57.028 INFO:teuthology.orchestra.run.smithi155.stdout: Verifying : ceph-mgr-2:17.2.6-823.g893fa35f.el8.x86_64 7/147 2023-08-01T19:52:57.029 INFO:teuthology.orchestra.run.smithi155.stdout: Verifying : ceph-mon-2:17.2.6-823.g893fa35f.el8.x86_64 8/147 2023-08-01T19:52:57.029 INFO:teuthology.orchestra.run.smithi155.stdout: Verifying : ceph-osd-2:17.2.6-823.g893fa35f.el8.x86_64 9/147 2023-08-01T19:52:57.029 INFO:teuthology.orchestra.run.smithi155.stdout: Verifying : ceph-radosgw-2:17.2.6-823.g893fa35f.el8.x86_64 10/147 2023-08-01T19:52:57.029 INFO:teuthology.orchestra.run.smithi155.stdout: Verifying : ceph-selinux-2:17.2.6-823.g893fa35f.el8.x86_64 11/147 2023-08-01T19:52:57.029 INFO:teuthology.orchestra.run.smithi155.stdout: Verifying : ceph-test-2:17.2.6-823.g893fa35f.el8.x86_64 12/147 2023-08-01T19:52:57.029 INFO:teuthology.orchestra.run.smithi155.stdout: Verifying : libcephfs-devel-2:17.2.6-823.g893fa35f.el8.x86_6 13/147 2023-08-01T19:52:57.030 INFO:teuthology.orchestra.run.smithi155.stdout: Verifying : libcephfs2-2:17.2.6-823.g893fa35f.el8.x86_64 14/147 2023-08-01T19:52:57.030 INFO:teuthology.orchestra.run.smithi155.stdout: Verifying : libcephsqlite-2:17.2.6-823.g893fa35f.el8.x86_64 15/147 2023-08-01T19:52:57.030 INFO:teuthology.orchestra.run.smithi155.stdout: Verifying : librados-devel-2:17.2.6-823.g893fa35f.el8.x86_64 16/147 2023-08-01T19:52:57.030 INFO:teuthology.orchestra.run.smithi155.stdout: Verifying : libradosstriper1-2:17.2.6-823.g893fa35f.el8.x86_ 17/147 2023-08-01T19:52:57.030 INFO:teuthology.orchestra.run.smithi155.stdout: Verifying : librgw2-2:17.2.6-823.g893fa35f.el8.x86_64 18/147 2023-08-01T19:52:57.030 INFO:teuthology.orchestra.run.smithi155.stdout: Verifying : python3-ceph-argparse-2:17.2.6-823.g893fa35f.el8 19/147 2023-08-01T19:52:57.030 INFO:teuthology.orchestra.run.smithi155.stdout: Verifying : python3-ceph-common-2:17.2.6-823.g893fa35f.el8.x 20/147 2023-08-01T19:52:57.030 INFO:teuthology.orchestra.run.smithi155.stdout: Verifying : python3-cephfs-2:17.2.6-823.g893fa35f.el8.x86_64 21/147 2023-08-01T19:52:57.031 INFO:teuthology.orchestra.run.smithi155.stdout: Verifying : python3-rados-2:17.2.6-823.g893fa35f.el8.x86_64 22/147 2023-08-01T19:52:57.031 INFO:teuthology.orchestra.run.smithi155.stdout: Verifying : python3-rbd-2:17.2.6-823.g893fa35f.el8.x86_64 23/147 2023-08-01T19:52:57.031 INFO:teuthology.orchestra.run.smithi155.stdout: Verifying : python3-rgw-2:17.2.6-823.g893fa35f.el8.x86_64 24/147 2023-08-01T19:52:57.031 INFO:teuthology.orchestra.run.smithi155.stdout: Verifying : rbd-fuse-2:17.2.6-823.g893fa35f.el8.x86_64 25/147 2023-08-01T19:52:57.031 INFO:teuthology.orchestra.run.smithi155.stdout: Verifying : rbd-mirror-2:17.2.6-823.g893fa35f.el8.x86_64 26/147 2023-08-01T19:52:57.031 INFO:teuthology.orchestra.run.smithi155.stdout: Verifying : rbd-nbd-2:17.2.6-823.g893fa35f.el8.x86_64 27/147 2023-08-01T19:52:57.031 INFO:teuthology.orchestra.run.smithi155.stdout: Verifying : ceph-grafana-dashboards-2:17.2.6-823.g893fa35f.e 28/147 2023-08-01T19:52:57.031 INFO:teuthology.orchestra.run.smithi155.stdout: Verifying : ceph-mgr-cephadm-2:17.2.6-823.g893fa35f.el8.noar 29/147 2023-08-01T19:52:57.039 INFO:teuthology.orchestra.run.smithi155.stdout: Verifying : ceph-mgr-dashboard-2:17.2.6-823.g893fa35f.el8.no 30/147 2023-08-01T19:52:57.039 INFO:teuthology.orchestra.run.smithi155.stdout: Verifying : ceph-mgr-diskprediction-local-2:17.2.6-823.g893f 31/147 2023-08-01T19:52:57.039 INFO:teuthology.orchestra.run.smithi155.stdout: Verifying : ceph-mgr-modules-core-2:17.2.6-823.g893fa35f.el8 32/147 2023-08-01T19:52:57.039 INFO:teuthology.orchestra.run.smithi155.stdout: Verifying : ceph-mgr-rook-2:17.2.6-823.g893fa35f.el8.noarch 33/147 2023-08-01T19:52:57.040 INFO:teuthology.orchestra.run.smithi155.stdout: Verifying : ceph-prometheus-alerts-2:17.2.6-823.g893fa35f.el 34/147 2023-08-01T19:52:57.040 INFO:teuthology.orchestra.run.smithi155.stdout: Verifying : ceph-volume-2:17.2.6-823.g893fa35f.el8.noarch 35/147 2023-08-01T19:52:57.040 INFO:teuthology.orchestra.run.smithi155.stdout: Verifying : cephadm-2:17.2.6-823.g893fa35f.el8.noarch 36/147 2023-08-01T19:52:57.040 INFO:teuthology.orchestra.run.smithi155.stdout: Verifying : automake-1.16.1-7.el8.noarch 37/147 2023-08-01T19:52:57.040 INFO:teuthology.orchestra.run.smithi155.stdout: Verifying : bison-3.0.4-10.el8.x86_64 38/147 2023-08-01T19:52:57.040 INFO:teuthology.orchestra.run.smithi155.stdout: Verifying : flex-2.6.1-9.el8.x86_64 39/147 2023-08-01T19:52:57.040 INFO:teuthology.orchestra.run.smithi155.stdout: Verifying : jq-1.6-7.el8.x86_64 40/147 2023-08-01T19:52:57.041 INFO:teuthology.orchestra.run.smithi155.stdout: Verifying : librdkafka-0.11.4-3.el8.x86_64 41/147 2023-08-01T19:52:57.041 INFO:teuthology.orchestra.run.smithi155.stdout: Verifying : libtool-2.4.6-25.el8.x86_64 42/147 2023-08-01T19:52:57.041 INFO:teuthology.orchestra.run.smithi155.stdout: Verifying : lttng-ust-2.8.1-11.el8.x86_64 43/147 2023-08-01T19:52:57.041 INFO:teuthology.orchestra.run.smithi155.stdout: Verifying : oniguruma-6.8.2-2.el8.x86_64 44/147 2023-08-01T19:52:57.041 INFO:teuthology.orchestra.run.smithi155.stdout: Verifying : openblas-0.3.15-4.el8.x86_64 45/147 2023-08-01T19:52:57.041 INFO:teuthology.orchestra.run.smithi155.stdout: Verifying : openblas-threads-0.3.15-4.el8.x86_64 46/147 2023-08-01T19:52:57.041 INFO:teuthology.orchestra.run.smithi155.stdout: Verifying : python3-babel-2.5.1-7.el8.noarch 47/147 2023-08-01T19:52:57.042 INFO:teuthology.orchestra.run.smithi155.stdout: Verifying : python3-jinja2-2.10.1-3.el8.noarch 48/147 2023-08-01T19:52:57.042 INFO:teuthology.orchestra.run.smithi155.stdout: Verifying : python3-jsonpatch-1.21-2.el8.noarch 49/147 2023-08-01T19:52:57.042 INFO:teuthology.orchestra.run.smithi155.stdout: Verifying : python3-jsonpointer-1.10-11.el8.noarch 50/147 2023-08-01T19:52:57.042 INFO:teuthology.orchestra.run.smithi155.stdout: Verifying : python3-mako-1.0.6-14.el8.noarch 51/147 2023-08-01T19:52:57.042 INFO:teuthology.orchestra.run.smithi155.stdout: Verifying : python3-markupsafe-0.23-19.el8.x86_64 52/147 2023-08-01T19:52:57.042 INFO:teuthology.orchestra.run.smithi155.stdout: Verifying : python3-numpy-1:1.14.3-10.el8.x86_64 53/147 2023-08-01T19:52:57.042 INFO:teuthology.orchestra.run.smithi155.stdout: Verifying : python3-numpy-f2py-1:1.14.3-10.el8.x86_64 54/147 2023-08-01T19:52:57.042 INFO:teuthology.orchestra.run.smithi155.stdout: Verifying : python3-prettytable-0.7.2-14.el8.noarch 55/147 2023-08-01T19:52:57.043 INFO:teuthology.orchestra.run.smithi155.stdout: Verifying : python3-pyOpenSSL-19.0.0-1.el8.noarch 56/147 2023-08-01T19:52:57.043 INFO:teuthology.orchestra.run.smithi155.stdout: Verifying : python3-pyasn1-0.3.7-6.el8.noarch 57/147 2023-08-01T19:52:57.043 INFO:teuthology.orchestra.run.smithi155.stdout: Verifying : python3-pyasn1-modules-0.3.7-6.el8.noarch 58/147 2023-08-01T19:52:57.043 INFO:teuthology.orchestra.run.smithi155.stdout: Verifying : python3-pytz-2017.2-9.el8.noarch 59/147 2023-08-01T19:52:57.043 INFO:teuthology.orchestra.run.smithi155.stdout: Verifying : python3-scipy-1.0.0-21.module_el8.5.0+771+e5d9a2 60/147 2023-08-01T19:52:57.043 INFO:teuthology.orchestra.run.smithi155.stdout: Verifying : python3-werkzeug-0.12.2-4.el8.noarch 61/147 2023-08-01T19:52:57.043 INFO:teuthology.orchestra.run.smithi155.stdout: Verifying : socat-1.7.4.1-1.el8.x86_64 62/147 2023-08-01T19:52:57.043 INFO:teuthology.orchestra.run.smithi155.stdout: Verifying : xmlstarlet-1.6.1-20.el8.x86_64 63/147 2023-08-01T19:52:57.044 INFO:teuthology.orchestra.run.smithi155.stdout: Verifying : elfutils-libelf-devel-0.189-2.el8.x86_64 64/147 2023-08-01T19:52:57.044 INFO:teuthology.orchestra.run.smithi155.stdout: Verifying : fuse-2.9.7-17.el8.x86_64 65/147 2023-08-01T19:52:57.044 INFO:teuthology.orchestra.run.smithi155.stdout: Verifying : keyutils-libs-devel-1.5.10-9.el8.x86_64 66/147 2023-08-01T19:52:57.044 INFO:teuthology.orchestra.run.smithi155.stdout: Verifying : krb5-devel-1.18.2-22.el8.x86_64 67/147 2023-08-01T19:52:57.044 INFO:teuthology.orchestra.run.smithi155.stdout: Verifying : libaio-devel-0.3.112-1.el8.x86_64 68/147 2023-08-01T19:52:57.044 INFO:teuthology.orchestra.run.smithi155.stdout: Verifying : libcom_err-devel-1.45.6-5.el8.x86_64 69/147 2023-08-01T19:52:57.044 INFO:teuthology.orchestra.run.smithi155.stdout: Verifying : libgfortran-8.5.0-20.el8.x86_64 70/147 2023-08-01T19:52:57.045 INFO:teuthology.orchestra.run.smithi155.stdout: Verifying : libquadmath-8.5.0-20.el8.x86_64 71/147 2023-08-01T19:52:57.045 INFO:teuthology.orchestra.run.smithi155.stdout: Verifying : librabbitmq-0.9.0-4.el8.x86_64 72/147 2023-08-01T19:52:57.045 INFO:teuthology.orchestra.run.smithi155.stdout: Verifying : libselinux-devel-2.9-8.el8.x86_64 73/147 2023-08-01T19:52:57.045 INFO:teuthology.orchestra.run.smithi155.stdout: Verifying : libsepol-devel-2.9-3.el8.x86_64 74/147 2023-08-01T19:52:57.045 INFO:teuthology.orchestra.run.smithi155.stdout: Verifying : libuuid-devel-2.32.1-42.el8.x86_64 75/147 2023-08-01T19:52:57.045 INFO:teuthology.orchestra.run.smithi155.stdout: Verifying : libverto-devel-0.3.2-2.el8.x86_64 76/147 2023-08-01T19:52:57.045 INFO:teuthology.orchestra.run.smithi155.stdout: Verifying : libzstd-devel-1.4.4-1.el8.x86_64 77/147 2023-08-01T19:52:57.045 INFO:teuthology.orchestra.run.smithi155.stdout: Verifying : openssl-devel-1:1.1.1k-9.el8.x86_64 78/147 2023-08-01T19:52:57.046 INFO:teuthology.orchestra.run.smithi155.stdout: Verifying : pcre2-devel-10.32-3.el8.x86_64 79/147 2023-08-01T19:52:57.046 INFO:teuthology.orchestra.run.smithi155.stdout: Verifying : pcre2-utf16-10.32-3.el8.x86_64 80/147 2023-08-01T19:52:57.046 INFO:teuthology.orchestra.run.smithi155.stdout: Verifying : pcre2-utf32-10.32-3.el8.x86_64 81/147 2023-08-01T19:52:57.046 INFO:teuthology.orchestra.run.smithi155.stdout: Verifying : python3-cffi-1.11.5-6.el8.x86_64 82/147 2023-08-01T19:52:57.046 INFO:teuthology.orchestra.run.smithi155.stdout: Verifying : python3-cryptography-3.2.1-6.el8.x86_64 83/147 2023-08-01T19:52:57.046 INFO:teuthology.orchestra.run.smithi155.stdout: Verifying : python3-jwt-1.6.1-2.el8.noarch 84/147 2023-08-01T19:52:57.046 INFO:teuthology.orchestra.run.smithi155.stdout: Verifying : python3-oauthlib-2.1.0-1.el8.noarch 85/147 2023-08-01T19:52:57.047 INFO:teuthology.orchestra.run.smithi155.stdout: Verifying : python3-pycparser-2.14-14.el8.noarch 86/147 2023-08-01T19:52:57.047 INFO:teuthology.orchestra.run.smithi155.stdout: Verifying : python3-requests-oauthlib-1.0.0-1.el8.noarch 87/147 2023-08-01T19:52:57.047 INFO:teuthology.orchestra.run.smithi155.stdout: Verifying : xfsprogs-devel-5.0.0-12.el8.x86_64 88/147 2023-08-01T19:52:57.047 INFO:teuthology.orchestra.run.smithi155.stdout: Verifying : zlib-devel-1.2.11-21.el8.x86_64 89/147 2023-08-01T19:52:57.047 INFO:teuthology.orchestra.run.smithi155.stdout: Verifying : gperftools-libs-1:2.7-9.el8.x86_64 90/147 2023-08-01T19:52:57.047 INFO:teuthology.orchestra.run.smithi155.stdout: Verifying : liboath-2.6.2-3.el8.x86_64 91/147 2023-08-01T19:52:57.047 INFO:teuthology.orchestra.run.smithi155.stdout: Verifying : libunwind-1.3.1-3.el8.x86_64 92/147 2023-08-01T19:52:57.047 INFO:teuthology.orchestra.run.smithi155.stdout: Verifying : python3-asyncssh-2.7.0-2.el8.noarch 93/147 2023-08-01T19:52:57.048 INFO:teuthology.orchestra.run.smithi155.stdout: Verifying : python3-bcrypt-3.1.6-2.el8.1.x86_64 94/147 2023-08-01T19:52:57.048 INFO:teuthology.orchestra.run.smithi155.stdout: Verifying : python3-beautifulsoup4-4.6.3-2.el8.1.noarch 95/147 2023-08-01T19:52:57.048 INFO:teuthology.orchestra.run.smithi155.stdout: Verifying : python3-cachetools-3.1.1-4.el8.noarch 96/147 2023-08-01T19:52:57.048 INFO:teuthology.orchestra.run.smithi155.stdout: Verifying : python3-certifi-2018.10.15-7.el8.noarch 97/147 2023-08-01T19:52:57.048 INFO:teuthology.orchestra.run.smithi155.stdout: Verifying : python3-cheroot-8.5.2-1.el8.noarch 98/147 2023-08-01T19:52:57.048 INFO:teuthology.orchestra.run.smithi155.stdout: Verifying : python3-cherrypy-18.4.0-1.el8.noarch 99/147 2023-08-01T19:52:57.048 INFO:teuthology.orchestra.run.smithi155.stdout: Verifying : python3-google-auth-1:1.1.1-10.el8.noarch 100/147 2023-08-01T19:52:57.049 INFO:teuthology.orchestra.run.smithi155.stdout: Verifying : python3-jaraco-6.2-6.el8.noarch 101/147 2023-08-01T19:52:57.049 INFO:teuthology.orchestra.run.smithi155.stdout: Verifying : python3-jaraco-functools-2.0-4.el8.noarch 102/147 2023-08-01T19:52:57.049 INFO:teuthology.orchestra.run.smithi155.stdout: Verifying : python3-kubernetes-1:11.0.0-6.el8.noarch 103/147 2023-08-01T19:52:57.049 INFO:teuthology.orchestra.run.smithi155.stdout: Verifying : python3-logutils-0.3.5-11.el8.noarch 104/147 2023-08-01T19:52:57.049 INFO:teuthology.orchestra.run.smithi155.stdout: Verifying : python3-more-itertools-7.2.0-3.el8.noarch 105/147 2023-08-01T19:52:57.049 INFO:teuthology.orchestra.run.smithi155.stdout: Verifying : python3-natsort-7.1.1-2.el8.noarch 106/147 2023-08-01T19:52:57.050 INFO:teuthology.orchestra.run.smithi155.stdout: Verifying : python3-pecan-1.3.2-9.el8.noarch 107/147 2023-08-01T19:52:57.050 INFO:teuthology.orchestra.run.smithi155.stdout: Verifying : python3-portend-2.6-1.el8.noarch 108/147 2023-08-01T19:52:57.050 INFO:teuthology.orchestra.run.smithi155.stdout: Verifying : python3-repoze-lru-0.7-6.el8.noarch 109/147 2023-08-01T19:52:57.050 INFO:teuthology.orchestra.run.smithi155.stdout: Verifying : python3-routes-2.4.1-12.el8.noarch 110/147 2023-08-01T19:52:57.050 INFO:teuthology.orchestra.run.smithi155.stdout: Verifying : python3-rsa-4.9-2.el8.noarch 111/147 2023-08-01T19:52:57.050 INFO:teuthology.orchestra.run.smithi155.stdout: Verifying : python3-simplegeneric-0.8.1-17.el8.noarch 112/147 2023-08-01T19:52:57.050 INFO:teuthology.orchestra.run.smithi155.stdout: Verifying : python3-singledispatch-3.4.0.3-18.el8.noarch 113/147 2023-08-01T19:52:57.050 INFO:teuthology.orchestra.run.smithi155.stdout: Verifying : python3-tempora-1.14.1-5.el8.noarch 114/147 2023-08-01T19:52:57.051 INFO:teuthology.orchestra.run.smithi155.stdout: Verifying : python3-trustme-0.6.0-4.el8.noarch 115/147 2023-08-01T19:52:57.051 INFO:teuthology.orchestra.run.smithi155.stdout: Verifying : python3-waitress-1.4.3-1.el8.noarch 116/147 2023-08-01T19:52:57.051 INFO:teuthology.orchestra.run.smithi155.stdout: Verifying : python3-webob-1.8.5-1.el8.1.noarch 117/147 2023-08-01T19:52:57.051 INFO:teuthology.orchestra.run.smithi155.stdout: Verifying : python3-websocket-client-0.56.0-5.el8.noarch 118/147 2023-08-01T19:52:57.051 INFO:teuthology.orchestra.run.smithi155.stdout: Verifying : python3-webtest-2.0.33-1.el8.noarch 119/147 2023-08-01T19:52:57.051 INFO:teuthology.orchestra.run.smithi155.stdout: Verifying : python3-zc-lockfile-2.0-2.el8.noarch 120/147 2023-08-01T19:52:57.051 INFO:teuthology.orchestra.run.smithi155.stdout: Verifying : thrift-0.13.0-2.el8.x86_64 121/147 2023-08-01T19:52:57.051 INFO:teuthology.orchestra.run.smithi155.stdout: Verifying : librados2-2:17.2.6-823.g893fa35f.el8.x86_64 122/147 2023-08-01T19:52:57.052 INFO:teuthology.orchestra.run.smithi155.stdout: Verifying : librados2-1:12.2.7-9.el8.x86_64 123/147 2023-08-01T19:52:57.052 INFO:teuthology.orchestra.run.smithi155.stdout: Verifying : librbd1-2:17.2.6-823.g893fa35f.el8.x86_64 124/147 2023-08-01T19:52:57.052 INFO:teuthology.orchestra.run.smithi155.stdout: Verifying : librbd1-1:12.2.7-9.el8.x86_64 125/147 2023-08-01T19:52:57.052 INFO:teuthology.orchestra.run.smithi155.stdout: Verifying : elfutils-debuginfod-client-0.189-2.el8.x86_64 126/147 2023-08-01T19:52:57.052 INFO:teuthology.orchestra.run.smithi155.stdout: Verifying : elfutils-debuginfod-client-0.189-1.el8.x86_64 127/147 2023-08-01T19:52:57.052 INFO:teuthology.orchestra.run.smithi155.stdout: Verifying : elfutils-libelf-0.189-2.el8.x86_64 128/147 2023-08-01T19:52:57.052 INFO:teuthology.orchestra.run.smithi155.stdout: Verifying : elfutils-libelf-0.189-1.el8.x86_64 129/147 2023-08-01T19:52:57.053 INFO:teuthology.orchestra.run.smithi155.stdout: Verifying : elfutils-libs-0.189-2.el8.x86_64 130/147 2023-08-01T19:52:57.053 INFO:teuthology.orchestra.run.smithi155.stdout: Verifying : elfutils-libs-0.189-1.el8.x86_64 131/147 2023-08-01T19:52:57.053 INFO:teuthology.orchestra.run.smithi155.stdout: Verifying : libblkid-2.32.1-42.el8.x86_64 132/147 2023-08-01T19:52:57.053 INFO:teuthology.orchestra.run.smithi155.stdout: Verifying : libblkid-2.32.1-41.el8.x86_64 133/147 2023-08-01T19:52:57.053 INFO:teuthology.orchestra.run.smithi155.stdout: Verifying : libfdisk-2.32.1-42.el8.x86_64 134/147 2023-08-01T19:52:57.053 INFO:teuthology.orchestra.run.smithi155.stdout: Verifying : libfdisk-2.32.1-41.el8.x86_64 135/147 2023-08-01T19:52:57.053 INFO:teuthology.orchestra.run.smithi155.stdout: Verifying : libmount-2.32.1-42.el8.x86_64 136/147 2023-08-01T19:52:57.053 INFO:teuthology.orchestra.run.smithi155.stdout: Verifying : libmount-2.32.1-41.el8.x86_64 137/147 2023-08-01T19:52:57.054 INFO:teuthology.orchestra.run.smithi155.stdout: Verifying : libsmartcols-2.32.1-42.el8.x86_64 138/147 2023-08-01T19:52:57.054 INFO:teuthology.orchestra.run.smithi155.stdout: Verifying : libsmartcols-2.32.1-41.el8.x86_64 139/147 2023-08-01T19:52:57.054 INFO:teuthology.orchestra.run.smithi155.stdout: Verifying : libuuid-2.32.1-42.el8.x86_64 140/147 2023-08-01T19:52:57.054 INFO:teuthology.orchestra.run.smithi155.stdout: Verifying : libuuid-2.32.1-41.el8.x86_64 141/147 2023-08-01T19:52:57.054 INFO:teuthology.orchestra.run.smithi155.stdout: Verifying : util-linux-2.32.1-42.el8.x86_64 142/147 2023-08-01T19:52:57.054 INFO:teuthology.orchestra.run.smithi155.stdout: Verifying : util-linux-2.32.1-41.el8.x86_64 143/147 2023-08-01T19:52:57.054 INFO:teuthology.orchestra.run.smithi155.stdout: Verifying : util-linux-user-2.32.1-42.el8.x86_64 144/147 2023-08-01T19:52:57.055 INFO:teuthology.orchestra.run.smithi155.stdout: Verifying : util-linux-user-2.32.1-41.el8.x86_64 145/147 2023-08-01T19:52:57.055 INFO:teuthology.orchestra.run.smithi155.stdout: Verifying : xfsprogs-5.0.0-12.el8.x86_64 146/147 2023-08-01T19:52:57.058 INFO:teuthology.orchestra.run.smithi008.stdout: Installing : ceph-fuse-2:17.2.6-823.g893fa35f.el8.x86_64 124/147 2023-08-01T19:52:57.203 INFO:teuthology.orchestra.run.smithi006.stdout: Installing : ceph-grafana-dashboards-2:17.2.6-823.g893fa35f.e 111/147 2023-08-01T19:52:57.318 INFO:teuthology.orchestra.run.smithi008.stdout: Installing : openssl-devel-1:1.1.1k-9.el8.x86_64 125/147 2023-08-01T19:52:57.428 INFO:teuthology.orchestra.run.smithi006.stdout: Installing : ceph-mgr-cephadm-2:17.2.6-823.g893fa35f.el8.noar 112/147 2023-08-01T19:52:57.609 INFO:teuthology.orchestra.run.smithi008.stdout: Installing : elfutils-libelf-devel-0.189-2.el8.x86_64 126/147 2023-08-01T19:52:57.656 INFO:teuthology.orchestra.run.smithi006.stdout: Running scriptlet: ceph-mgr-cephadm-2:17.2.6-823.g893fa35f.el8.noar 112/147 2023-08-01T19:52:57.793 INFO:teuthology.orchestra.run.smithi008.stdout: Upgrading : util-linux-user-2.32.1-42.el8.x86_64 127/147 2023-08-01T19:52:57.919 INFO:teuthology.orchestra.run.smithi006.stdout: Installing : ceph-mgr-dashboard-2:17.2.6-823.g893fa35f.el8.no 113/147 2023-08-01T19:52:57.993 INFO:teuthology.orchestra.run.smithi008.stdout: Installing : xfsprogs-devel-5.0.0-12.el8.x86_64 128/147 2023-08-01T19:52:58.190 INFO:teuthology.orchestra.run.smithi008.stdout: Installing : libcephfs-devel-2:17.2.6-823.g893fa35f.el8.x86_6 129/147 2023-08-01T19:52:58.357 INFO:teuthology.orchestra.run.smithi008.stdout: Installing : rbd-fuse-2:17.2.6-823.g893fa35f.el8.x86_64 130/147 2023-08-01T19:52:58.515 INFO:teuthology.orchestra.run.smithi008.stdout: Installing : rbd-nbd-2:17.2.6-823.g893fa35f.el8.x86_64 131/147 2023-08-01T19:52:58.689 INFO:teuthology.orchestra.run.smithi008.stdout: Installing : libaio-devel-0.3.112-1.el8.x86_64 132/147 2023-08-01T19:52:58.872 INFO:teuthology.orchestra.run.smithi008.stdout: Installing : flex-2.6.1-9.el8.x86_64 133/147 2023-08-01T19:52:58.944 INFO:teuthology.orchestra.run.smithi006.stdout: Running scriptlet: ceph-mgr-dashboard-2:17.2.6-823.g893fa35f.el8.no 113/147 2023-08-01T19:52:58.963 INFO:teuthology.orchestra.run.smithi008.stdout: Running scriptlet: flex-2.6.1-9.el8.x86_64 133/147 2023-08-01T19:52:59.161 INFO:teuthology.orchestra.run.smithi006.stdout: Installing : ceph-mgr-diskprediction-local-2:17.2.6-823.g893f 114/147 2023-08-01T19:52:59.172 INFO:teuthology.orchestra.run.smithi008.stdout: Installing : bison-3.0.4-10.el8.x86_64 134/147 2023-08-01T19:52:59.186 INFO:teuthology.orchestra.run.smithi008.stdout: Running scriptlet: bison-3.0.4-10.el8.x86_64 134/147 2023-08-01T19:52:59.223 INFO:teuthology.orchestra.run.smithi155.stdout: Verifying : xfsprogs-5.0.0-10.el8.x86_64 147/147 2023-08-01T19:52:59.223 INFO:teuthology.orchestra.run.smithi155.stdout: 2023-08-01T19:52:59.223 INFO:teuthology.orchestra.run.smithi155.stdout:Upgraded: 2023-08-01T19:52:59.223 INFO:teuthology.orchestra.run.smithi155.stdout: elfutils-debuginfod-client-0.189-2.el8.x86_64 2023-08-01T19:52:59.223 INFO:teuthology.orchestra.run.smithi155.stdout: elfutils-libelf-0.189-2.el8.x86_64 2023-08-01T19:52:59.223 INFO:teuthology.orchestra.run.smithi155.stdout: elfutils-libs-0.189-2.el8.x86_64 2023-08-01T19:52:59.224 INFO:teuthology.orchestra.run.smithi155.stdout: libblkid-2.32.1-42.el8.x86_64 2023-08-01T19:52:59.224 INFO:teuthology.orchestra.run.smithi155.stdout: libfdisk-2.32.1-42.el8.x86_64 2023-08-01T19:52:59.224 INFO:teuthology.orchestra.run.smithi155.stdout: libmount-2.32.1-42.el8.x86_64 2023-08-01T19:52:59.224 INFO:teuthology.orchestra.run.smithi155.stdout: librados2-2:17.2.6-823.g893fa35f.el8.x86_64 2023-08-01T19:52:59.224 INFO:teuthology.orchestra.run.smithi155.stdout: librbd1-2:17.2.6-823.g893fa35f.el8.x86_64 2023-08-01T19:52:59.224 INFO:teuthology.orchestra.run.smithi155.stdout: libsmartcols-2.32.1-42.el8.x86_64 2023-08-01T19:52:59.224 INFO:teuthology.orchestra.run.smithi155.stdout: libuuid-2.32.1-42.el8.x86_64 2023-08-01T19:52:59.225 INFO:teuthology.orchestra.run.smithi155.stdout: util-linux-2.32.1-42.el8.x86_64 2023-08-01T19:52:59.225 INFO:teuthology.orchestra.run.smithi155.stdout: util-linux-user-2.32.1-42.el8.x86_64 2023-08-01T19:52:59.225 INFO:teuthology.orchestra.run.smithi155.stdout: xfsprogs-5.0.0-12.el8.x86_64 2023-08-01T19:52:59.225 INFO:teuthology.orchestra.run.smithi155.stdout:Installed: 2023-08-01T19:52:59.225 INFO:teuthology.orchestra.run.smithi155.stdout: automake-1.16.1-7.el8.noarch 2023-08-01T19:52:59.225 INFO:teuthology.orchestra.run.smithi155.stdout: bison-3.0.4-10.el8.x86_64 2023-08-01T19:52:59.225 INFO:teuthology.orchestra.run.smithi155.stdout: ceph-2:17.2.6-823.g893fa35f.el8.x86_64 2023-08-01T19:52:59.226 INFO:teuthology.orchestra.run.smithi155.stdout: ceph-base-2:17.2.6-823.g893fa35f.el8.x86_64 2023-08-01T19:52:59.226 INFO:teuthology.orchestra.run.smithi155.stdout: ceph-common-2:17.2.6-823.g893fa35f.el8.x86_64 2023-08-01T19:52:59.226 INFO:teuthology.orchestra.run.smithi155.stdout: ceph-fuse-2:17.2.6-823.g893fa35f.el8.x86_64 2023-08-01T19:52:59.226 INFO:teuthology.orchestra.run.smithi155.stdout: ceph-grafana-dashboards-2:17.2.6-823.g893fa35f.el8.noarch 2023-08-01T19:52:59.226 INFO:teuthology.orchestra.run.smithi155.stdout: ceph-immutable-object-cache-2:17.2.6-823.g893fa35f.el8.x86_64 2023-08-01T19:52:59.226 INFO:teuthology.orchestra.run.smithi155.stdout: ceph-mds-2:17.2.6-823.g893fa35f.el8.x86_64 2023-08-01T19:52:59.226 INFO:teuthology.orchestra.run.smithi155.stdout: ceph-mgr-2:17.2.6-823.g893fa35f.el8.x86_64 2023-08-01T19:52:59.227 INFO:teuthology.orchestra.run.smithi155.stdout: ceph-mgr-cephadm-2:17.2.6-823.g893fa35f.el8.noarch 2023-08-01T19:52:59.227 INFO:teuthology.orchestra.run.smithi155.stdout: ceph-mgr-dashboard-2:17.2.6-823.g893fa35f.el8.noarch 2023-08-01T19:52:59.227 INFO:teuthology.orchestra.run.smithi155.stdout: ceph-mgr-diskprediction-local-2:17.2.6-823.g893fa35f.el8.noarch 2023-08-01T19:52:59.227 INFO:teuthology.orchestra.run.smithi155.stdout: ceph-mgr-modules-core-2:17.2.6-823.g893fa35f.el8.noarch 2023-08-01T19:52:59.227 INFO:teuthology.orchestra.run.smithi155.stdout: ceph-mgr-rook-2:17.2.6-823.g893fa35f.el8.noarch 2023-08-01T19:52:59.227 INFO:teuthology.orchestra.run.smithi155.stdout: ceph-mon-2:17.2.6-823.g893fa35f.el8.x86_64 2023-08-01T19:52:59.227 INFO:teuthology.orchestra.run.smithi155.stdout: ceph-osd-2:17.2.6-823.g893fa35f.el8.x86_64 2023-08-01T19:52:59.227 INFO:teuthology.orchestra.run.smithi155.stdout: ceph-prometheus-alerts-2:17.2.6-823.g893fa35f.el8.noarch 2023-08-01T19:52:59.228 INFO:teuthology.orchestra.run.smithi155.stdout: ceph-radosgw-2:17.2.6-823.g893fa35f.el8.x86_64 2023-08-01T19:52:59.228 INFO:teuthology.orchestra.run.smithi155.stdout: ceph-selinux-2:17.2.6-823.g893fa35f.el8.x86_64 2023-08-01T19:52:59.228 INFO:teuthology.orchestra.run.smithi155.stdout: ceph-test-2:17.2.6-823.g893fa35f.el8.x86_64 2023-08-01T19:52:59.228 INFO:teuthology.orchestra.run.smithi155.stdout: ceph-volume-2:17.2.6-823.g893fa35f.el8.noarch 2023-08-01T19:52:59.228 INFO:teuthology.orchestra.run.smithi155.stdout: cephadm-2:17.2.6-823.g893fa35f.el8.noarch 2023-08-01T19:52:59.228 INFO:teuthology.orchestra.run.smithi155.stdout: elfutils-libelf-devel-0.189-2.el8.x86_64 2023-08-01T19:52:59.228 INFO:teuthology.orchestra.run.smithi155.stdout: flex-2.6.1-9.el8.x86_64 2023-08-01T19:52:59.229 INFO:teuthology.orchestra.run.smithi155.stdout: fuse-2.9.7-17.el8.x86_64 2023-08-01T19:52:59.229 INFO:teuthology.orchestra.run.smithi155.stdout: gperftools-libs-1:2.7-9.el8.x86_64 2023-08-01T19:52:59.229 INFO:teuthology.orchestra.run.smithi155.stdout: jq-1.6-7.el8.x86_64 2023-08-01T19:52:59.229 INFO:teuthology.orchestra.run.smithi155.stdout: keyutils-libs-devel-1.5.10-9.el8.x86_64 2023-08-01T19:52:59.229 INFO:teuthology.orchestra.run.smithi155.stdout: krb5-devel-1.18.2-22.el8.x86_64 2023-08-01T19:52:59.229 INFO:teuthology.orchestra.run.smithi155.stdout: libaio-devel-0.3.112-1.el8.x86_64 2023-08-01T19:52:59.229 INFO:teuthology.orchestra.run.smithi155.stdout: libcephfs-devel-2:17.2.6-823.g893fa35f.el8.x86_64 2023-08-01T19:52:59.229 INFO:teuthology.orchestra.run.smithi155.stdout: libcephfs2-2:17.2.6-823.g893fa35f.el8.x86_64 2023-08-01T19:52:59.230 INFO:teuthology.orchestra.run.smithi155.stdout: libcephsqlite-2:17.2.6-823.g893fa35f.el8.x86_64 2023-08-01T19:52:59.230 INFO:teuthology.orchestra.run.smithi155.stdout: libcom_err-devel-1.45.6-5.el8.x86_64 2023-08-01T19:52:59.230 INFO:teuthology.orchestra.run.smithi155.stdout: libgfortran-8.5.0-20.el8.x86_64 2023-08-01T19:52:59.230 INFO:teuthology.orchestra.run.smithi155.stdout: liboath-2.6.2-3.el8.x86_64 2023-08-01T19:52:59.230 INFO:teuthology.orchestra.run.smithi155.stdout: libquadmath-8.5.0-20.el8.x86_64 2023-08-01T19:52:59.230 INFO:teuthology.orchestra.run.smithi155.stdout: librabbitmq-0.9.0-4.el8.x86_64 2023-08-01T19:52:59.230 INFO:teuthology.orchestra.run.smithi155.stdout: librados-devel-2:17.2.6-823.g893fa35f.el8.x86_64 2023-08-01T19:52:59.231 INFO:teuthology.orchestra.run.smithi155.stdout: libradosstriper1-2:17.2.6-823.g893fa35f.el8.x86_64 2023-08-01T19:52:59.231 INFO:teuthology.orchestra.run.smithi155.stdout: librdkafka-0.11.4-3.el8.x86_64 2023-08-01T19:52:59.231 INFO:teuthology.orchestra.run.smithi155.stdout: librgw2-2:17.2.6-823.g893fa35f.el8.x86_64 2023-08-01T19:52:59.231 INFO:teuthology.orchestra.run.smithi155.stdout: libselinux-devel-2.9-8.el8.x86_64 2023-08-01T19:52:59.231 INFO:teuthology.orchestra.run.smithi155.stdout: libsepol-devel-2.9-3.el8.x86_64 2023-08-01T19:52:59.231 INFO:teuthology.orchestra.run.smithi155.stdout: libtool-2.4.6-25.el8.x86_64 2023-08-01T19:52:59.231 INFO:teuthology.orchestra.run.smithi155.stdout: libunwind-1.3.1-3.el8.x86_64 2023-08-01T19:52:59.231 INFO:teuthology.orchestra.run.smithi155.stdout: libuuid-devel-2.32.1-42.el8.x86_64 2023-08-01T19:52:59.232 INFO:teuthology.orchestra.run.smithi155.stdout: libverto-devel-0.3.2-2.el8.x86_64 2023-08-01T19:52:59.232 INFO:teuthology.orchestra.run.smithi155.stdout: libzstd-devel-1.4.4-1.el8.x86_64 2023-08-01T19:52:59.232 INFO:teuthology.orchestra.run.smithi155.stdout: lttng-ust-2.8.1-11.el8.x86_64 2023-08-01T19:52:59.232 INFO:teuthology.orchestra.run.smithi155.stdout: oniguruma-6.8.2-2.el8.x86_64 2023-08-01T19:52:59.232 INFO:teuthology.orchestra.run.smithi155.stdout: openblas-0.3.15-4.el8.x86_64 2023-08-01T19:52:59.232 INFO:teuthology.orchestra.run.smithi155.stdout: openblas-threads-0.3.15-4.el8.x86_64 2023-08-01T19:52:59.232 INFO:teuthology.orchestra.run.smithi155.stdout: openssl-devel-1:1.1.1k-9.el8.x86_64 2023-08-01T19:52:59.233 INFO:teuthology.orchestra.run.smithi155.stdout: pcre2-devel-10.32-3.el8.x86_64 2023-08-01T19:52:59.233 INFO:teuthology.orchestra.run.smithi155.stdout: pcre2-utf16-10.32-3.el8.x86_64 2023-08-01T19:52:59.233 INFO:teuthology.orchestra.run.smithi155.stdout: pcre2-utf32-10.32-3.el8.x86_64 2023-08-01T19:52:59.233 INFO:teuthology.orchestra.run.smithi155.stdout: python3-asyncssh-2.7.0-2.el8.noarch 2023-08-01T19:52:59.233 INFO:teuthology.orchestra.run.smithi155.stdout: python3-babel-2.5.1-7.el8.noarch 2023-08-01T19:52:59.233 INFO:teuthology.orchestra.run.smithi155.stdout: python3-bcrypt-3.1.6-2.el8.1.x86_64 2023-08-01T19:52:59.233 INFO:teuthology.orchestra.run.smithi155.stdout: python3-beautifulsoup4-4.6.3-2.el8.1.noarch 2023-08-01T19:52:59.233 INFO:teuthology.orchestra.run.smithi155.stdout: python3-cachetools-3.1.1-4.el8.noarch 2023-08-01T19:52:59.234 INFO:teuthology.orchestra.run.smithi155.stdout: python3-ceph-argparse-2:17.2.6-823.g893fa35f.el8.x86_64 2023-08-01T19:52:59.234 INFO:teuthology.orchestra.run.smithi155.stdout: python3-ceph-common-2:17.2.6-823.g893fa35f.el8.x86_64 2023-08-01T19:52:59.234 INFO:teuthology.orchestra.run.smithi155.stdout: python3-cephfs-2:17.2.6-823.g893fa35f.el8.x86_64 2023-08-01T19:52:59.234 INFO:teuthology.orchestra.run.smithi155.stdout: python3-certifi-2018.10.15-7.el8.noarch 2023-08-01T19:52:59.234 INFO:teuthology.orchestra.run.smithi155.stdout: python3-cffi-1.11.5-6.el8.x86_64 2023-08-01T19:52:59.234 INFO:teuthology.orchestra.run.smithi155.stdout: python3-cheroot-8.5.2-1.el8.noarch 2023-08-01T19:52:59.234 INFO:teuthology.orchestra.run.smithi155.stdout: python3-cherrypy-18.4.0-1.el8.noarch 2023-08-01T19:52:59.234 INFO:teuthology.orchestra.run.smithi155.stdout: python3-cryptography-3.2.1-6.el8.x86_64 2023-08-01T19:52:59.235 INFO:teuthology.orchestra.run.smithi155.stdout: python3-google-auth-1:1.1.1-10.el8.noarch 2023-08-01T19:52:59.235 INFO:teuthology.orchestra.run.smithi155.stdout: python3-jaraco-6.2-6.el8.noarch 2023-08-01T19:52:59.235 INFO:teuthology.orchestra.run.smithi155.stdout: python3-jaraco-functools-2.0-4.el8.noarch 2023-08-01T19:52:59.235 INFO:teuthology.orchestra.run.smithi155.stdout: python3-jinja2-2.10.1-3.el8.noarch 2023-08-01T19:52:59.235 INFO:teuthology.orchestra.run.smithi155.stdout: python3-jsonpatch-1.21-2.el8.noarch 2023-08-01T19:52:59.235 INFO:teuthology.orchestra.run.smithi155.stdout: python3-jsonpointer-1.10-11.el8.noarch 2023-08-01T19:52:59.235 INFO:teuthology.orchestra.run.smithi155.stdout: python3-jwt-1.6.1-2.el8.noarch 2023-08-01T19:52:59.235 INFO:teuthology.orchestra.run.smithi155.stdout: python3-kubernetes-1:11.0.0-6.el8.noarch 2023-08-01T19:52:59.236 INFO:teuthology.orchestra.run.smithi155.stdout: python3-logutils-0.3.5-11.el8.noarch 2023-08-01T19:52:59.236 INFO:teuthology.orchestra.run.smithi155.stdout: python3-mako-1.0.6-14.el8.noarch 2023-08-01T19:52:59.236 INFO:teuthology.orchestra.run.smithi155.stdout: python3-markupsafe-0.23-19.el8.x86_64 2023-08-01T19:52:59.236 INFO:teuthology.orchestra.run.smithi155.stdout: python3-more-itertools-7.2.0-3.el8.noarch 2023-08-01T19:52:59.236 INFO:teuthology.orchestra.run.smithi155.stdout: python3-natsort-7.1.1-2.el8.noarch 2023-08-01T19:52:59.236 INFO:teuthology.orchestra.run.smithi155.stdout: python3-numpy-1:1.14.3-10.el8.x86_64 2023-08-01T19:52:59.236 INFO:teuthology.orchestra.run.smithi155.stdout: python3-numpy-f2py-1:1.14.3-10.el8.x86_64 2023-08-01T19:52:59.237 INFO:teuthology.orchestra.run.smithi155.stdout: python3-oauthlib-2.1.0-1.el8.noarch 2023-08-01T19:52:59.237 INFO:teuthology.orchestra.run.smithi155.stdout: python3-pecan-1.3.2-9.el8.noarch 2023-08-01T19:52:59.237 INFO:teuthology.orchestra.run.smithi155.stdout: python3-portend-2.6-1.el8.noarch 2023-08-01T19:52:59.237 INFO:teuthology.orchestra.run.smithi155.stdout: python3-prettytable-0.7.2-14.el8.noarch 2023-08-01T19:52:59.237 INFO:teuthology.orchestra.run.smithi155.stdout: python3-pyOpenSSL-19.0.0-1.el8.noarch 2023-08-01T19:52:59.237 INFO:teuthology.orchestra.run.smithi155.stdout: python3-pyasn1-0.3.7-6.el8.noarch 2023-08-01T19:52:59.237 INFO:teuthology.orchestra.run.smithi155.stdout: python3-pyasn1-modules-0.3.7-6.el8.noarch 2023-08-01T19:52:59.238 INFO:teuthology.orchestra.run.smithi155.stdout: python3-pycparser-2.14-14.el8.noarch 2023-08-01T19:52:59.238 INFO:teuthology.orchestra.run.smithi155.stdout: python3-pytz-2017.2-9.el8.noarch 2023-08-01T19:52:59.238 INFO:teuthology.orchestra.run.smithi155.stdout: python3-rados-2:17.2.6-823.g893fa35f.el8.x86_64 2023-08-01T19:52:59.238 INFO:teuthology.orchestra.run.smithi155.stdout: python3-rbd-2:17.2.6-823.g893fa35f.el8.x86_64 2023-08-01T19:52:59.238 INFO:teuthology.orchestra.run.smithi155.stdout: python3-repoze-lru-0.7-6.el8.noarch 2023-08-01T19:52:59.238 INFO:teuthology.orchestra.run.smithi155.stdout: python3-requests-oauthlib-1.0.0-1.el8.noarch 2023-08-01T19:52:59.238 INFO:teuthology.orchestra.run.smithi155.stdout: python3-rgw-2:17.2.6-823.g893fa35f.el8.x86_64 2023-08-01T19:52:59.238 INFO:teuthology.orchestra.run.smithi155.stdout: python3-routes-2.4.1-12.el8.noarch 2023-08-01T19:52:59.239 INFO:teuthology.orchestra.run.smithi155.stdout: python3-rsa-4.9-2.el8.noarch 2023-08-01T19:52:59.239 INFO:teuthology.orchestra.run.smithi155.stdout: python3-scipy-1.0.0-21.module_el8.5.0+771+e5d9a225.x86_64 2023-08-01T19:52:59.239 INFO:teuthology.orchestra.run.smithi155.stdout: python3-simplegeneric-0.8.1-17.el8.noarch 2023-08-01T19:52:59.239 INFO:teuthology.orchestra.run.smithi155.stdout: python3-singledispatch-3.4.0.3-18.el8.noarch 2023-08-01T19:52:59.239 INFO:teuthology.orchestra.run.smithi155.stdout: python3-tempora-1.14.1-5.el8.noarch 2023-08-01T19:52:59.239 INFO:teuthology.orchestra.run.smithi155.stdout: python3-trustme-0.6.0-4.el8.noarch 2023-08-01T19:52:59.239 INFO:teuthology.orchestra.run.smithi155.stdout: python3-waitress-1.4.3-1.el8.noarch 2023-08-01T19:52:59.239 INFO:teuthology.orchestra.run.smithi155.stdout: python3-webob-1.8.5-1.el8.1.noarch 2023-08-01T19:52:59.240 INFO:teuthology.orchestra.run.smithi155.stdout: python3-websocket-client-0.56.0-5.el8.noarch 2023-08-01T19:52:59.240 INFO:teuthology.orchestra.run.smithi155.stdout: python3-webtest-2.0.33-1.el8.noarch 2023-08-01T19:52:59.240 INFO:teuthology.orchestra.run.smithi155.stdout: python3-werkzeug-0.12.2-4.el8.noarch 2023-08-01T19:52:59.240 INFO:teuthology.orchestra.run.smithi155.stdout: python3-zc-lockfile-2.0-2.el8.noarch 2023-08-01T19:52:59.240 INFO:teuthology.orchestra.run.smithi155.stdout: rbd-fuse-2:17.2.6-823.g893fa35f.el8.x86_64 2023-08-01T19:52:59.240 INFO:teuthology.orchestra.run.smithi155.stdout: rbd-mirror-2:17.2.6-823.g893fa35f.el8.x86_64 2023-08-01T19:52:59.240 INFO:teuthology.orchestra.run.smithi155.stdout: rbd-nbd-2:17.2.6-823.g893fa35f.el8.x86_64 2023-08-01T19:52:59.241 INFO:teuthology.orchestra.run.smithi155.stdout: socat-1.7.4.1-1.el8.x86_64 2023-08-01T19:52:59.241 INFO:teuthology.orchestra.run.smithi155.stdout: thrift-0.13.0-2.el8.x86_64 2023-08-01T19:52:59.241 INFO:teuthology.orchestra.run.smithi155.stdout: xfsprogs-devel-5.0.0-12.el8.x86_64 2023-08-01T19:52:59.241 INFO:teuthology.orchestra.run.smithi155.stdout: xmlstarlet-1.6.1-20.el8.x86_64 2023-08-01T19:52:59.241 INFO:teuthology.orchestra.run.smithi155.stdout: zlib-devel-1.2.11-21.el8.x86_64 2023-08-01T19:52:59.242 INFO:teuthology.orchestra.run.smithi155.stdout: 2023-08-01T19:52:59.242 INFO:teuthology.orchestra.run.smithi155.stdout:Complete! 2023-08-01T19:52:59.257 INFO:teuthology.orchestra.run.smithi006.stdout: Running scriptlet: ceph-mgr-diskprediction-local-2:17.2.6-823.g893f 114/147 2023-08-01T19:52:59.382 INFO:teuthology.orchestra.run.smithi008.stdout: Cleanup : elfutils-debuginfod-client-0.189-1.el8.x86_64 135/147 2023-08-01T19:52:59.477 DEBUG:teuthology.parallel:result is None 2023-08-01T19:52:59.624 INFO:teuthology.orchestra.run.smithi006.stdout: Installing : ceph-mgr-modules-core-2:17.2.6-823.g893fa35f.el8 115/147 2023-08-01T19:52:59.667 INFO:teuthology.orchestra.run.smithi008.stdout: Cleanup : elfutils-libs-0.189-1.el8.x86_64 136/147 2023-08-01T19:52:59.668 INFO:teuthology.orchestra.run.smithi008.stdout: Cleanup : xfsprogs-5.0.0-10.el8.x86_64 137/147 2023-08-01T19:52:59.845 INFO:teuthology.orchestra.run.smithi006.stdout: Installing : ceph-mgr-2:17.2.6-823.g893fa35f.el8.x86_64 116/147 2023-08-01T19:52:59.882 INFO:teuthology.orchestra.run.smithi006.stdout: Running scriptlet: ceph-mgr-2:17.2.6-823.g893fa35f.el8.x86_64 116/147 2023-08-01T19:52:59.892 INFO:teuthology.orchestra.run.smithi008.stdout: Running scriptlet: xfsprogs-5.0.0-10.el8.x86_64 137/147 2023-08-01T19:52:59.892 INFO:teuthology.orchestra.run.smithi008.stdout: Cleanup : librbd1-1:12.2.7-9.el8.x86_64 138/147 2023-08-01T19:53:00.045 INFO:teuthology.orchestra.run.smithi006.stdout: Installing : ceph-mgr-rook-2:17.2.6-823.g893fa35f.el8.noarch 117/147 2023-08-01T19:53:00.056 INFO:teuthology.orchestra.run.smithi006.stdout: Running scriptlet: ceph-mgr-rook-2:17.2.6-823.g893fa35f.el8.noarch 117/147 2023-08-01T19:53:00.143 INFO:teuthology.orchestra.run.smithi008.stdout: Running scriptlet: librbd1-1:12.2.7-9.el8.x86_64 138/147 2023-08-01T19:53:00.143 INFO:teuthology.orchestra.run.smithi008.stdout: Cleanup : librados2-1:12.2.7-9.el8.x86_64 139/147 2023-08-01T19:53:00.232 INFO:teuthology.orchestra.run.smithi006.stdout: Installing : ceph-2:17.2.6-823.g893fa35f.el8.x86_64 118/147 2023-08-01T19:53:00.342 INFO:teuthology.orchestra.run.smithi008.stdout: Running scriptlet: librados2-1:12.2.7-9.el8.x86_64 139/147 2023-08-01T19:53:00.386 INFO:teuthology.orchestra.run.smithi006.stdout: Installing : libtool-2.4.6-25.el8.x86_64 119/147 2023-08-01T19:53:00.497 INFO:teuthology.orchestra.run.smithi008.stdout: Cleanup : util-linux-user-2.32.1-41.el8.x86_64 140/147 2023-08-01T19:53:00.732 INFO:teuthology.orchestra.run.smithi008.stdout: Cleanup : util-linux-2.32.1-41.el8.x86_64 141/147 2023-08-01T19:53:00.732 INFO:teuthology.orchestra.run.smithi008.stdout: Cleanup : libfdisk-2.32.1-41.el8.x86_64 142/147 2023-08-01T19:53:00.950 INFO:teuthology.orchestra.run.smithi008.stdout: Running scriptlet: libfdisk-2.32.1-41.el8.x86_64 142/147 2023-08-01T19:53:00.950 INFO:teuthology.orchestra.run.smithi008.stdout: Cleanup : libmount-2.32.1-41.el8.x86_64 143/147 2023-08-01T19:53:01.150 INFO:teuthology.orchestra.run.smithi008.stdout: Running scriptlet: libmount-2.32.1-41.el8.x86_64 143/147 2023-08-01T19:53:01.150 INFO:teuthology.orchestra.run.smithi008.stdout: Cleanup : libblkid-2.32.1-41.el8.x86_64 144/147 2023-08-01T19:53:01.366 INFO:teuthology.orchestra.run.smithi008.stdout: Running scriptlet: libblkid-2.32.1-41.el8.x86_64 144/147 2023-08-01T19:53:01.366 INFO:teuthology.orchestra.run.smithi008.stdout: Cleanup : libuuid-2.32.1-41.el8.x86_64 145/147 2023-08-01T19:53:01.558 INFO:teuthology.orchestra.run.smithi008.stdout: Running scriptlet: libuuid-2.32.1-41.el8.x86_64 145/147 2023-08-01T19:53:01.558 INFO:teuthology.orchestra.run.smithi008.stdout: Cleanup : libsmartcols-2.32.1-41.el8.x86_64 146/147 2023-08-01T19:53:01.725 INFO:teuthology.orchestra.run.smithi008.stdout: Running scriptlet: libsmartcols-2.32.1-41.el8.x86_64 146/147 2023-08-01T19:53:01.924 INFO:teuthology.orchestra.run.smithi008.stdout: Cleanup : elfutils-libelf-0.189-1.el8.x86_64 147/147 2023-08-01T19:53:02.522 INFO:teuthology.orchestra.run.smithi008.stdout: Running scriptlet: elfutils-libelf-0.189-1.el8.x86_64 147/147 2023-08-01T19:53:02.522 INFO:teuthology.orchestra.run.smithi008.stdout: Verifying : ceph-2:17.2.6-823.g893fa35f.el8.x86_64 1/147 2023-08-01T19:53:02.523 INFO:teuthology.orchestra.run.smithi008.stdout: Verifying : ceph-base-2:17.2.6-823.g893fa35f.el8.x86_64 2/147 2023-08-01T19:53:02.523 INFO:teuthology.orchestra.run.smithi008.stdout: Verifying : ceph-common-2:17.2.6-823.g893fa35f.el8.x86_64 3/147 2023-08-01T19:53:02.523 INFO:teuthology.orchestra.run.smithi008.stdout: Verifying : ceph-fuse-2:17.2.6-823.g893fa35f.el8.x86_64 4/147 2023-08-01T19:53:02.523 INFO:teuthology.orchestra.run.smithi008.stdout: Verifying : ceph-immutable-object-cache-2:17.2.6-823.g893fa3 5/147 2023-08-01T19:53:02.524 INFO:teuthology.orchestra.run.smithi008.stdout: Verifying : ceph-mds-2:17.2.6-823.g893fa35f.el8.x86_64 6/147 2023-08-01T19:53:02.524 INFO:teuthology.orchestra.run.smithi008.stdout: Verifying : ceph-mgr-2:17.2.6-823.g893fa35f.el8.x86_64 7/147 2023-08-01T19:53:02.524 INFO:teuthology.orchestra.run.smithi008.stdout: Verifying : ceph-mon-2:17.2.6-823.g893fa35f.el8.x86_64 8/147 2023-08-01T19:53:02.524 INFO:teuthology.orchestra.run.smithi008.stdout: Verifying : ceph-osd-2:17.2.6-823.g893fa35f.el8.x86_64 9/147 2023-08-01T19:53:02.524 INFO:teuthology.orchestra.run.smithi008.stdout: Verifying : ceph-radosgw-2:17.2.6-823.g893fa35f.el8.x86_64 10/147 2023-08-01T19:53:02.525 INFO:teuthology.orchestra.run.smithi008.stdout: Verifying : ceph-selinux-2:17.2.6-823.g893fa35f.el8.x86_64 11/147 2023-08-01T19:53:02.525 INFO:teuthology.orchestra.run.smithi008.stdout: Verifying : ceph-test-2:17.2.6-823.g893fa35f.el8.x86_64 12/147 2023-08-01T19:53:02.525 INFO:teuthology.orchestra.run.smithi008.stdout: Verifying : libcephfs-devel-2:17.2.6-823.g893fa35f.el8.x86_6 13/147 2023-08-01T19:53:02.525 INFO:teuthology.orchestra.run.smithi008.stdout: Verifying : libcephfs2-2:17.2.6-823.g893fa35f.el8.x86_64 14/147 2023-08-01T19:53:02.525 INFO:teuthology.orchestra.run.smithi008.stdout: Verifying : libcephsqlite-2:17.2.6-823.g893fa35f.el8.x86_64 15/147 2023-08-01T19:53:02.525 INFO:teuthology.orchestra.run.smithi008.stdout: Verifying : librados-devel-2:17.2.6-823.g893fa35f.el8.x86_64 16/147 2023-08-01T19:53:02.525 INFO:teuthology.orchestra.run.smithi008.stdout: Verifying : libradosstriper1-2:17.2.6-823.g893fa35f.el8.x86_ 17/147 2023-08-01T19:53:02.526 INFO:teuthology.orchestra.run.smithi008.stdout: Verifying : librgw2-2:17.2.6-823.g893fa35f.el8.x86_64 18/147 2023-08-01T19:53:02.526 INFO:teuthology.orchestra.run.smithi008.stdout: Verifying : python3-ceph-argparse-2:17.2.6-823.g893fa35f.el8 19/147 2023-08-01T19:53:02.526 INFO:teuthology.orchestra.run.smithi008.stdout: Verifying : python3-ceph-common-2:17.2.6-823.g893fa35f.el8.x 20/147 2023-08-01T19:53:02.526 INFO:teuthology.orchestra.run.smithi008.stdout: Verifying : python3-cephfs-2:17.2.6-823.g893fa35f.el8.x86_64 21/147 2023-08-01T19:53:02.526 INFO:teuthology.orchestra.run.smithi008.stdout: Verifying : python3-rados-2:17.2.6-823.g893fa35f.el8.x86_64 22/147 2023-08-01T19:53:02.526 INFO:teuthology.orchestra.run.smithi008.stdout: Verifying : python3-rbd-2:17.2.6-823.g893fa35f.el8.x86_64 23/147 2023-08-01T19:53:02.526 INFO:teuthology.orchestra.run.smithi008.stdout: Verifying : python3-rgw-2:17.2.6-823.g893fa35f.el8.x86_64 24/147 2023-08-01T19:53:02.526 INFO:teuthology.orchestra.run.smithi008.stdout: Verifying : rbd-fuse-2:17.2.6-823.g893fa35f.el8.x86_64 25/147 2023-08-01T19:53:02.527 INFO:teuthology.orchestra.run.smithi008.stdout: Verifying : rbd-mirror-2:17.2.6-823.g893fa35f.el8.x86_64 26/147 2023-08-01T19:53:02.527 INFO:teuthology.orchestra.run.smithi008.stdout: Verifying : rbd-nbd-2:17.2.6-823.g893fa35f.el8.x86_64 27/147 2023-08-01T19:53:02.527 INFO:teuthology.orchestra.run.smithi008.stdout: Verifying : ceph-grafana-dashboards-2:17.2.6-823.g893fa35f.e 28/147 2023-08-01T19:53:02.527 INFO:teuthology.orchestra.run.smithi008.stdout: Verifying : ceph-mgr-cephadm-2:17.2.6-823.g893fa35f.el8.noar 29/147 2023-08-01T19:53:02.527 INFO:teuthology.orchestra.run.smithi008.stdout: Verifying : ceph-mgr-dashboard-2:17.2.6-823.g893fa35f.el8.no 30/147 2023-08-01T19:53:02.527 INFO:teuthology.orchestra.run.smithi008.stdout: Verifying : ceph-mgr-diskprediction-local-2:17.2.6-823.g893f 31/147 2023-08-01T19:53:02.527 INFO:teuthology.orchestra.run.smithi008.stdout: Verifying : ceph-mgr-modules-core-2:17.2.6-823.g893fa35f.el8 32/147 2023-08-01T19:53:02.527 INFO:teuthology.orchestra.run.smithi008.stdout: Verifying : ceph-mgr-rook-2:17.2.6-823.g893fa35f.el8.noarch 33/147 2023-08-01T19:53:02.528 INFO:teuthology.orchestra.run.smithi008.stdout: Verifying : ceph-prometheus-alerts-2:17.2.6-823.g893fa35f.el 34/147 2023-08-01T19:53:02.528 INFO:teuthology.orchestra.run.smithi008.stdout: Verifying : ceph-volume-2:17.2.6-823.g893fa35f.el8.noarch 35/147 2023-08-01T19:53:02.528 INFO:teuthology.orchestra.run.smithi008.stdout: Verifying : cephadm-2:17.2.6-823.g893fa35f.el8.noarch 36/147 2023-08-01T19:53:02.528 INFO:teuthology.orchestra.run.smithi008.stdout: Verifying : automake-1.16.1-7.el8.noarch 37/147 2023-08-01T19:53:02.528 INFO:teuthology.orchestra.run.smithi008.stdout: Verifying : bison-3.0.4-10.el8.x86_64 38/147 2023-08-01T19:53:02.528 INFO:teuthology.orchestra.run.smithi008.stdout: Verifying : flex-2.6.1-9.el8.x86_64 39/147 2023-08-01T19:53:02.528 INFO:teuthology.orchestra.run.smithi008.stdout: Verifying : jq-1.6-7.el8.x86_64 40/147 2023-08-01T19:53:02.529 INFO:teuthology.orchestra.run.smithi008.stdout: Verifying : librdkafka-0.11.4-3.el8.x86_64 41/147 2023-08-01T19:53:02.529 INFO:teuthology.orchestra.run.smithi008.stdout: Verifying : libtool-2.4.6-25.el8.x86_64 42/147 2023-08-01T19:53:02.529 INFO:teuthology.orchestra.run.smithi008.stdout: Verifying : lttng-ust-2.8.1-11.el8.x86_64 43/147 2023-08-01T19:53:02.529 INFO:teuthology.orchestra.run.smithi008.stdout: Verifying : oniguruma-6.8.2-2.el8.x86_64 44/147 2023-08-01T19:53:02.529 INFO:teuthology.orchestra.run.smithi008.stdout: Verifying : openblas-0.3.15-4.el8.x86_64 45/147 2023-08-01T19:53:02.529 INFO:teuthology.orchestra.run.smithi008.stdout: Verifying : openblas-threads-0.3.15-4.el8.x86_64 46/147 2023-08-01T19:53:02.529 INFO:teuthology.orchestra.run.smithi008.stdout: Verifying : python3-babel-2.5.1-7.el8.noarch 47/147 2023-08-01T19:53:02.529 INFO:teuthology.orchestra.run.smithi008.stdout: Verifying : python3-jinja2-2.10.1-3.el8.noarch 48/147 2023-08-01T19:53:02.530 INFO:teuthology.orchestra.run.smithi008.stdout: Verifying : python3-jsonpatch-1.21-2.el8.noarch 49/147 2023-08-01T19:53:02.530 INFO:teuthology.orchestra.run.smithi008.stdout: Verifying : python3-jsonpointer-1.10-11.el8.noarch 50/147 2023-08-01T19:53:02.530 INFO:teuthology.orchestra.run.smithi008.stdout: Verifying : python3-mako-1.0.6-14.el8.noarch 51/147 2023-08-01T19:53:02.530 INFO:teuthology.orchestra.run.smithi008.stdout: Verifying : python3-markupsafe-0.23-19.el8.x86_64 52/147 2023-08-01T19:53:02.530 INFO:teuthology.orchestra.run.smithi008.stdout: Verifying : python3-numpy-1:1.14.3-10.el8.x86_64 53/147 2023-08-01T19:53:02.530 INFO:teuthology.orchestra.run.smithi008.stdout: Verifying : python3-numpy-f2py-1:1.14.3-10.el8.x86_64 54/147 2023-08-01T19:53:02.530 INFO:teuthology.orchestra.run.smithi008.stdout: Verifying : python3-prettytable-0.7.2-14.el8.noarch 55/147 2023-08-01T19:53:02.530 INFO:teuthology.orchestra.run.smithi008.stdout: Verifying : python3-pyOpenSSL-19.0.0-1.el8.noarch 56/147 2023-08-01T19:53:02.531 INFO:teuthology.orchestra.run.smithi008.stdout: Verifying : python3-pyasn1-0.3.7-6.el8.noarch 57/147 2023-08-01T19:53:02.531 INFO:teuthology.orchestra.run.smithi008.stdout: Verifying : python3-pyasn1-modules-0.3.7-6.el8.noarch 58/147 2023-08-01T19:53:02.531 INFO:teuthology.orchestra.run.smithi008.stdout: Verifying : python3-pytz-2017.2-9.el8.noarch 59/147 2023-08-01T19:53:02.531 INFO:teuthology.orchestra.run.smithi008.stdout: Verifying : python3-scipy-1.0.0-21.module_el8.5.0+771+e5d9a2 60/147 2023-08-01T19:53:02.531 INFO:teuthology.orchestra.run.smithi008.stdout: Verifying : python3-werkzeug-0.12.2-4.el8.noarch 61/147 2023-08-01T19:53:02.531 INFO:teuthology.orchestra.run.smithi008.stdout: Verifying : socat-1.7.4.1-1.el8.x86_64 62/147 2023-08-01T19:53:02.531 INFO:teuthology.orchestra.run.smithi008.stdout: Verifying : xmlstarlet-1.6.1-20.el8.x86_64 63/147 2023-08-01T19:53:02.531 INFO:teuthology.orchestra.run.smithi008.stdout: Verifying : elfutils-libelf-devel-0.189-2.el8.x86_64 64/147 2023-08-01T19:53:02.532 INFO:teuthology.orchestra.run.smithi008.stdout: Verifying : fuse-2.9.7-17.el8.x86_64 65/147 2023-08-01T19:53:02.532 INFO:teuthology.orchestra.run.smithi008.stdout: Verifying : keyutils-libs-devel-1.5.10-9.el8.x86_64 66/147 2023-08-01T19:53:02.532 INFO:teuthology.orchestra.run.smithi008.stdout: Verifying : krb5-devel-1.18.2-22.el8.x86_64 67/147 2023-08-01T19:53:02.532 INFO:teuthology.orchestra.run.smithi008.stdout: Verifying : libaio-devel-0.3.112-1.el8.x86_64 68/147 2023-08-01T19:53:02.532 INFO:teuthology.orchestra.run.smithi008.stdout: Verifying : libcom_err-devel-1.45.6-5.el8.x86_64 69/147 2023-08-01T19:53:02.532 INFO:teuthology.orchestra.run.smithi008.stdout: Verifying : libgfortran-8.5.0-20.el8.x86_64 70/147 2023-08-01T19:53:02.532 INFO:teuthology.orchestra.run.smithi008.stdout: Verifying : libquadmath-8.5.0-20.el8.x86_64 71/147 2023-08-01T19:53:02.533 INFO:teuthology.orchestra.run.smithi008.stdout: Verifying : librabbitmq-0.9.0-4.el8.x86_64 72/147 2023-08-01T19:53:02.533 INFO:teuthology.orchestra.run.smithi008.stdout: Verifying : libselinux-devel-2.9-8.el8.x86_64 73/147 2023-08-01T19:53:02.533 INFO:teuthology.orchestra.run.smithi008.stdout: Verifying : libsepol-devel-2.9-3.el8.x86_64 74/147 2023-08-01T19:53:02.533 INFO:teuthology.orchestra.run.smithi008.stdout: Verifying : libuuid-devel-2.32.1-42.el8.x86_64 75/147 2023-08-01T19:53:02.533 INFO:teuthology.orchestra.run.smithi008.stdout: Verifying : libverto-devel-0.3.2-2.el8.x86_64 76/147 2023-08-01T19:53:02.533 INFO:teuthology.orchestra.run.smithi008.stdout: Verifying : libzstd-devel-1.4.4-1.el8.x86_64 77/147 2023-08-01T19:53:02.533 INFO:teuthology.orchestra.run.smithi008.stdout: Verifying : openssl-devel-1:1.1.1k-9.el8.x86_64 78/147 2023-08-01T19:53:02.533 INFO:teuthology.orchestra.run.smithi008.stdout: Verifying : pcre2-devel-10.32-3.el8.x86_64 79/147 2023-08-01T19:53:02.534 INFO:teuthology.orchestra.run.smithi008.stdout: Verifying : pcre2-utf16-10.32-3.el8.x86_64 80/147 2023-08-01T19:53:02.534 INFO:teuthology.orchestra.run.smithi008.stdout: Verifying : pcre2-utf32-10.32-3.el8.x86_64 81/147 2023-08-01T19:53:02.534 INFO:teuthology.orchestra.run.smithi008.stdout: Verifying : python3-cffi-1.11.5-6.el8.x86_64 82/147 2023-08-01T19:53:02.534 INFO:teuthology.orchestra.run.smithi008.stdout: Verifying : python3-cryptography-3.2.1-6.el8.x86_64 83/147 2023-08-01T19:53:02.534 INFO:teuthology.orchestra.run.smithi008.stdout: Verifying : python3-jwt-1.6.1-2.el8.noarch 84/147 2023-08-01T19:53:02.534 INFO:teuthology.orchestra.run.smithi008.stdout: Verifying : python3-oauthlib-2.1.0-1.el8.noarch 85/147 2023-08-01T19:53:02.534 INFO:teuthology.orchestra.run.smithi008.stdout: Verifying : python3-pycparser-2.14-14.el8.noarch 86/147 2023-08-01T19:53:02.534 INFO:teuthology.orchestra.run.smithi008.stdout: Verifying : python3-requests-oauthlib-1.0.0-1.el8.noarch 87/147 2023-08-01T19:53:02.535 INFO:teuthology.orchestra.run.smithi008.stdout: Verifying : xfsprogs-devel-5.0.0-12.el8.x86_64 88/147 2023-08-01T19:53:02.535 INFO:teuthology.orchestra.run.smithi008.stdout: Verifying : zlib-devel-1.2.11-21.el8.x86_64 89/147 2023-08-01T19:53:02.535 INFO:teuthology.orchestra.run.smithi008.stdout: Verifying : gperftools-libs-1:2.7-9.el8.x86_64 90/147 2023-08-01T19:53:02.535 INFO:teuthology.orchestra.run.smithi008.stdout: Verifying : liboath-2.6.2-3.el8.x86_64 91/147 2023-08-01T19:53:02.535 INFO:teuthology.orchestra.run.smithi008.stdout: Verifying : libunwind-1.3.1-3.el8.x86_64 92/147 2023-08-01T19:53:02.535 INFO:teuthology.orchestra.run.smithi008.stdout: Verifying : python3-asyncssh-2.7.0-2.el8.noarch 93/147 2023-08-01T19:53:02.535 INFO:teuthology.orchestra.run.smithi008.stdout: Verifying : python3-bcrypt-3.1.6-2.el8.1.x86_64 94/147 2023-08-01T19:53:02.535 INFO:teuthology.orchestra.run.smithi008.stdout: Verifying : python3-beautifulsoup4-4.6.3-2.el8.1.noarch 95/147 2023-08-01T19:53:02.536 INFO:teuthology.orchestra.run.smithi008.stdout: Verifying : python3-cachetools-3.1.1-4.el8.noarch 96/147 2023-08-01T19:53:02.536 INFO:teuthology.orchestra.run.smithi008.stdout: Verifying : python3-certifi-2018.10.15-7.el8.noarch 97/147 2023-08-01T19:53:02.536 INFO:teuthology.orchestra.run.smithi008.stdout: Verifying : python3-cheroot-8.5.2-1.el8.noarch 98/147 2023-08-01T19:53:02.536 INFO:teuthology.orchestra.run.smithi008.stdout: Verifying : python3-cherrypy-18.4.0-1.el8.noarch 99/147 2023-08-01T19:53:02.536 INFO:teuthology.orchestra.run.smithi008.stdout: Verifying : python3-google-auth-1:1.1.1-10.el8.noarch 100/147 2023-08-01T19:53:02.536 INFO:teuthology.orchestra.run.smithi008.stdout: Verifying : python3-jaraco-6.2-6.el8.noarch 101/147 2023-08-01T19:53:02.536 INFO:teuthology.orchestra.run.smithi008.stdout: Verifying : python3-jaraco-functools-2.0-4.el8.noarch 102/147 2023-08-01T19:53:02.536 INFO:teuthology.orchestra.run.smithi008.stdout: Verifying : python3-kubernetes-1:11.0.0-6.el8.noarch 103/147 2023-08-01T19:53:02.537 INFO:teuthology.orchestra.run.smithi008.stdout: Verifying : python3-logutils-0.3.5-11.el8.noarch 104/147 2023-08-01T19:53:02.537 INFO:teuthology.orchestra.run.smithi008.stdout: Verifying : python3-more-itertools-7.2.0-3.el8.noarch 105/147 2023-08-01T19:53:02.537 INFO:teuthology.orchestra.run.smithi008.stdout: Verifying : python3-natsort-7.1.1-2.el8.noarch 106/147 2023-08-01T19:53:02.537 INFO:teuthology.orchestra.run.smithi008.stdout: Verifying : python3-pecan-1.3.2-9.el8.noarch 107/147 2023-08-01T19:53:02.537 INFO:teuthology.orchestra.run.smithi008.stdout: Verifying : python3-portend-2.6-1.el8.noarch 108/147 2023-08-01T19:53:02.537 INFO:teuthology.orchestra.run.smithi008.stdout: Verifying : python3-repoze-lru-0.7-6.el8.noarch 109/147 2023-08-01T19:53:02.537 INFO:teuthology.orchestra.run.smithi008.stdout: Verifying : python3-routes-2.4.1-12.el8.noarch 110/147 2023-08-01T19:53:02.538 INFO:teuthology.orchestra.run.smithi008.stdout: Verifying : python3-rsa-4.9-2.el8.noarch 111/147 2023-08-01T19:53:02.538 INFO:teuthology.orchestra.run.smithi008.stdout: Verifying : python3-simplegeneric-0.8.1-17.el8.noarch 112/147 2023-08-01T19:53:02.538 INFO:teuthology.orchestra.run.smithi008.stdout: Verifying : python3-singledispatch-3.4.0.3-18.el8.noarch 113/147 2023-08-01T19:53:02.538 INFO:teuthology.orchestra.run.smithi008.stdout: Verifying : python3-tempora-1.14.1-5.el8.noarch 114/147 2023-08-01T19:53:02.538 INFO:teuthology.orchestra.run.smithi008.stdout: Verifying : python3-trustme-0.6.0-4.el8.noarch 115/147 2023-08-01T19:53:02.538 INFO:teuthology.orchestra.run.smithi008.stdout: Verifying : python3-waitress-1.4.3-1.el8.noarch 116/147 2023-08-01T19:53:02.538 INFO:teuthology.orchestra.run.smithi008.stdout: Verifying : python3-webob-1.8.5-1.el8.1.noarch 117/147 2023-08-01T19:53:02.539 INFO:teuthology.orchestra.run.smithi008.stdout: Verifying : python3-websocket-client-0.56.0-5.el8.noarch 118/147 2023-08-01T19:53:02.539 INFO:teuthology.orchestra.run.smithi008.stdout: Verifying : python3-webtest-2.0.33-1.el8.noarch 119/147 2023-08-01T19:53:02.539 INFO:teuthology.orchestra.run.smithi008.stdout: Verifying : python3-zc-lockfile-2.0-2.el8.noarch 120/147 2023-08-01T19:53:02.539 INFO:teuthology.orchestra.run.smithi008.stdout: Verifying : thrift-0.13.0-2.el8.x86_64 121/147 2023-08-01T19:53:02.539 INFO:teuthology.orchestra.run.smithi008.stdout: Verifying : librados2-2:17.2.6-823.g893fa35f.el8.x86_64 122/147 2023-08-01T19:53:02.539 INFO:teuthology.orchestra.run.smithi008.stdout: Verifying : librados2-1:12.2.7-9.el8.x86_64 123/147 2023-08-01T19:53:02.539 INFO:teuthology.orchestra.run.smithi008.stdout: Verifying : librbd1-2:17.2.6-823.g893fa35f.el8.x86_64 124/147 2023-08-01T19:53:02.539 INFO:teuthology.orchestra.run.smithi008.stdout: Verifying : librbd1-1:12.2.7-9.el8.x86_64 125/147 2023-08-01T19:53:02.540 INFO:teuthology.orchestra.run.smithi008.stdout: Verifying : elfutils-debuginfod-client-0.189-2.el8.x86_64 126/147 2023-08-01T19:53:02.540 INFO:teuthology.orchestra.run.smithi008.stdout: Verifying : elfutils-debuginfod-client-0.189-1.el8.x86_64 127/147 2023-08-01T19:53:02.540 INFO:teuthology.orchestra.run.smithi008.stdout: Verifying : elfutils-libelf-0.189-2.el8.x86_64 128/147 2023-08-01T19:53:02.540 INFO:teuthology.orchestra.run.smithi008.stdout: Verifying : elfutils-libelf-0.189-1.el8.x86_64 129/147 2023-08-01T19:53:02.540 INFO:teuthology.orchestra.run.smithi008.stdout: Verifying : elfutils-libs-0.189-2.el8.x86_64 130/147 2023-08-01T19:53:02.540 INFO:teuthology.orchestra.run.smithi008.stdout: Verifying : elfutils-libs-0.189-1.el8.x86_64 131/147 2023-08-01T19:53:02.540 INFO:teuthology.orchestra.run.smithi008.stdout: Verifying : libblkid-2.32.1-42.el8.x86_64 132/147 2023-08-01T19:53:02.541 INFO:teuthology.orchestra.run.smithi008.stdout: Verifying : libblkid-2.32.1-41.el8.x86_64 133/147 2023-08-01T19:53:02.541 INFO:teuthology.orchestra.run.smithi008.stdout: Verifying : libfdisk-2.32.1-42.el8.x86_64 134/147 2023-08-01T19:53:02.541 INFO:teuthology.orchestra.run.smithi008.stdout: Verifying : libfdisk-2.32.1-41.el8.x86_64 135/147 2023-08-01T19:53:02.541 INFO:teuthology.orchestra.run.smithi008.stdout: Verifying : libmount-2.32.1-42.el8.x86_64 136/147 2023-08-01T19:53:02.541 INFO:teuthology.orchestra.run.smithi008.stdout: Verifying : libmount-2.32.1-41.el8.x86_64 137/147 2023-08-01T19:53:02.541 INFO:teuthology.orchestra.run.smithi008.stdout: Verifying : libsmartcols-2.32.1-42.el8.x86_64 138/147 2023-08-01T19:53:02.541 INFO:teuthology.orchestra.run.smithi008.stdout: Verifying : libsmartcols-2.32.1-41.el8.x86_64 139/147 2023-08-01T19:53:02.541 INFO:teuthology.orchestra.run.smithi008.stdout: Verifying : libuuid-2.32.1-42.el8.x86_64 140/147 2023-08-01T19:53:02.542 INFO:teuthology.orchestra.run.smithi008.stdout: Verifying : libuuid-2.32.1-41.el8.x86_64 141/147 2023-08-01T19:53:02.542 INFO:teuthology.orchestra.run.smithi008.stdout: Verifying : util-linux-2.32.1-42.el8.x86_64 142/147 2023-08-01T19:53:02.542 INFO:teuthology.orchestra.run.smithi008.stdout: Verifying : util-linux-2.32.1-41.el8.x86_64 143/147 2023-08-01T19:53:02.542 INFO:teuthology.orchestra.run.smithi008.stdout: Verifying : util-linux-user-2.32.1-42.el8.x86_64 144/147 2023-08-01T19:53:02.542 INFO:teuthology.orchestra.run.smithi008.stdout: Verifying : util-linux-user-2.32.1-41.el8.x86_64 145/147 2023-08-01T19:53:02.542 INFO:teuthology.orchestra.run.smithi008.stdout: Verifying : xfsprogs-5.0.0-12.el8.x86_64 146/147 2023-08-01T19:53:04.619 INFO:teuthology.orchestra.run.smithi008.stdout: Verifying : xfsprogs-5.0.0-10.el8.x86_64 147/147 2023-08-01T19:53:04.620 INFO:teuthology.orchestra.run.smithi008.stdout: 2023-08-01T19:53:04.620 INFO:teuthology.orchestra.run.smithi008.stdout:Upgraded: 2023-08-01T19:53:04.620 INFO:teuthology.orchestra.run.smithi008.stdout: elfutils-debuginfod-client-0.189-2.el8.x86_64 2023-08-01T19:53:04.620 INFO:teuthology.orchestra.run.smithi008.stdout: elfutils-libelf-0.189-2.el8.x86_64 2023-08-01T19:53:04.620 INFO:teuthology.orchestra.run.smithi008.stdout: elfutils-libs-0.189-2.el8.x86_64 2023-08-01T19:53:04.620 INFO:teuthology.orchestra.run.smithi008.stdout: libblkid-2.32.1-42.el8.x86_64 2023-08-01T19:53:04.620 INFO:teuthology.orchestra.run.smithi008.stdout: libfdisk-2.32.1-42.el8.x86_64 2023-08-01T19:53:04.621 INFO:teuthology.orchestra.run.smithi008.stdout: libmount-2.32.1-42.el8.x86_64 2023-08-01T19:53:04.621 INFO:teuthology.orchestra.run.smithi008.stdout: librados2-2:17.2.6-823.g893fa35f.el8.x86_64 2023-08-01T19:53:04.621 INFO:teuthology.orchestra.run.smithi008.stdout: librbd1-2:17.2.6-823.g893fa35f.el8.x86_64 2023-08-01T19:53:04.621 INFO:teuthology.orchestra.run.smithi008.stdout: libsmartcols-2.32.1-42.el8.x86_64 2023-08-01T19:53:04.621 INFO:teuthology.orchestra.run.smithi008.stdout: libuuid-2.32.1-42.el8.x86_64 2023-08-01T19:53:04.621 INFO:teuthology.orchestra.run.smithi008.stdout: util-linux-2.32.1-42.el8.x86_64 2023-08-01T19:53:04.621 INFO:teuthology.orchestra.run.smithi008.stdout: util-linux-user-2.32.1-42.el8.x86_64 2023-08-01T19:53:04.622 INFO:teuthology.orchestra.run.smithi008.stdout: xfsprogs-5.0.0-12.el8.x86_64 2023-08-01T19:53:04.622 INFO:teuthology.orchestra.run.smithi008.stdout:Installed: 2023-08-01T19:53:04.622 INFO:teuthology.orchestra.run.smithi008.stdout: automake-1.16.1-7.el8.noarch 2023-08-01T19:53:04.622 INFO:teuthology.orchestra.run.smithi008.stdout: bison-3.0.4-10.el8.x86_64 2023-08-01T19:53:04.622 INFO:teuthology.orchestra.run.smithi008.stdout: ceph-2:17.2.6-823.g893fa35f.el8.x86_64 2023-08-01T19:53:04.622 INFO:teuthology.orchestra.run.smithi008.stdout: ceph-base-2:17.2.6-823.g893fa35f.el8.x86_64 2023-08-01T19:53:04.622 INFO:teuthology.orchestra.run.smithi008.stdout: ceph-common-2:17.2.6-823.g893fa35f.el8.x86_64 2023-08-01T19:53:04.622 INFO:teuthology.orchestra.run.smithi008.stdout: ceph-fuse-2:17.2.6-823.g893fa35f.el8.x86_64 2023-08-01T19:53:04.623 INFO:teuthology.orchestra.run.smithi008.stdout: ceph-grafana-dashboards-2:17.2.6-823.g893fa35f.el8.noarch 2023-08-01T19:53:04.623 INFO:teuthology.orchestra.run.smithi008.stdout: ceph-immutable-object-cache-2:17.2.6-823.g893fa35f.el8.x86_64 2023-08-01T19:53:04.623 INFO:teuthology.orchestra.run.smithi008.stdout: ceph-mds-2:17.2.6-823.g893fa35f.el8.x86_64 2023-08-01T19:53:04.623 INFO:teuthology.orchestra.run.smithi008.stdout: ceph-mgr-2:17.2.6-823.g893fa35f.el8.x86_64 2023-08-01T19:53:04.623 INFO:teuthology.orchestra.run.smithi008.stdout: ceph-mgr-cephadm-2:17.2.6-823.g893fa35f.el8.noarch 2023-08-01T19:53:04.623 INFO:teuthology.orchestra.run.smithi008.stdout: ceph-mgr-dashboard-2:17.2.6-823.g893fa35f.el8.noarch 2023-08-01T19:53:04.623 INFO:teuthology.orchestra.run.smithi008.stdout: ceph-mgr-diskprediction-local-2:17.2.6-823.g893fa35f.el8.noarch 2023-08-01T19:53:04.623 INFO:teuthology.orchestra.run.smithi008.stdout: ceph-mgr-modules-core-2:17.2.6-823.g893fa35f.el8.noarch 2023-08-01T19:53:04.624 INFO:teuthology.orchestra.run.smithi008.stdout: ceph-mgr-rook-2:17.2.6-823.g893fa35f.el8.noarch 2023-08-01T19:53:04.624 INFO:teuthology.orchestra.run.smithi008.stdout: ceph-mon-2:17.2.6-823.g893fa35f.el8.x86_64 2023-08-01T19:53:04.624 INFO:teuthology.orchestra.run.smithi008.stdout: ceph-osd-2:17.2.6-823.g893fa35f.el8.x86_64 2023-08-01T19:53:04.624 INFO:teuthology.orchestra.run.smithi008.stdout: ceph-prometheus-alerts-2:17.2.6-823.g893fa35f.el8.noarch 2023-08-01T19:53:04.624 INFO:teuthology.orchestra.run.smithi008.stdout: ceph-radosgw-2:17.2.6-823.g893fa35f.el8.x86_64 2023-08-01T19:53:04.624 INFO:teuthology.orchestra.run.smithi008.stdout: ceph-selinux-2:17.2.6-823.g893fa35f.el8.x86_64 2023-08-01T19:53:04.624 INFO:teuthology.orchestra.run.smithi008.stdout: ceph-test-2:17.2.6-823.g893fa35f.el8.x86_64 2023-08-01T19:53:04.625 INFO:teuthology.orchestra.run.smithi008.stdout: ceph-volume-2:17.2.6-823.g893fa35f.el8.noarch 2023-08-01T19:53:04.625 INFO:teuthology.orchestra.run.smithi008.stdout: cephadm-2:17.2.6-823.g893fa35f.el8.noarch 2023-08-01T19:53:04.625 INFO:teuthology.orchestra.run.smithi008.stdout: elfutils-libelf-devel-0.189-2.el8.x86_64 2023-08-01T19:53:04.625 INFO:teuthology.orchestra.run.smithi008.stdout: flex-2.6.1-9.el8.x86_64 2023-08-01T19:53:04.625 INFO:teuthology.orchestra.run.smithi008.stdout: fuse-2.9.7-17.el8.x86_64 2023-08-01T19:53:04.625 INFO:teuthology.orchestra.run.smithi008.stdout: gperftools-libs-1:2.7-9.el8.x86_64 2023-08-01T19:53:04.625 INFO:teuthology.orchestra.run.smithi008.stdout: jq-1.6-7.el8.x86_64 2023-08-01T19:53:04.625 INFO:teuthology.orchestra.run.smithi008.stdout: keyutils-libs-devel-1.5.10-9.el8.x86_64 2023-08-01T19:53:04.626 INFO:teuthology.orchestra.run.smithi008.stdout: krb5-devel-1.18.2-22.el8.x86_64 2023-08-01T19:53:04.626 INFO:teuthology.orchestra.run.smithi008.stdout: libaio-devel-0.3.112-1.el8.x86_64 2023-08-01T19:53:04.626 INFO:teuthology.orchestra.run.smithi008.stdout: libcephfs-devel-2:17.2.6-823.g893fa35f.el8.x86_64 2023-08-01T19:53:04.626 INFO:teuthology.orchestra.run.smithi008.stdout: libcephfs2-2:17.2.6-823.g893fa35f.el8.x86_64 2023-08-01T19:53:04.626 INFO:teuthology.orchestra.run.smithi008.stdout: libcephsqlite-2:17.2.6-823.g893fa35f.el8.x86_64 2023-08-01T19:53:04.626 INFO:teuthology.orchestra.run.smithi008.stdout: libcom_err-devel-1.45.6-5.el8.x86_64 2023-08-01T19:53:04.626 INFO:teuthology.orchestra.run.smithi008.stdout: libgfortran-8.5.0-20.el8.x86_64 2023-08-01T19:53:04.627 INFO:teuthology.orchestra.run.smithi008.stdout: liboath-2.6.2-3.el8.x86_64 2023-08-01T19:53:04.627 INFO:teuthology.orchestra.run.smithi008.stdout: libquadmath-8.5.0-20.el8.x86_64 2023-08-01T19:53:04.627 INFO:teuthology.orchestra.run.smithi008.stdout: librabbitmq-0.9.0-4.el8.x86_64 2023-08-01T19:53:04.627 INFO:teuthology.orchestra.run.smithi008.stdout: librados-devel-2:17.2.6-823.g893fa35f.el8.x86_64 2023-08-01T19:53:04.627 INFO:teuthology.orchestra.run.smithi008.stdout: libradosstriper1-2:17.2.6-823.g893fa35f.el8.x86_64 2023-08-01T19:53:04.627 INFO:teuthology.orchestra.run.smithi008.stdout: librdkafka-0.11.4-3.el8.x86_64 2023-08-01T19:53:04.627 INFO:teuthology.orchestra.run.smithi008.stdout: librgw2-2:17.2.6-823.g893fa35f.el8.x86_64 2023-08-01T19:53:04.627 INFO:teuthology.orchestra.run.smithi008.stdout: libselinux-devel-2.9-8.el8.x86_64 2023-08-01T19:53:04.628 INFO:teuthology.orchestra.run.smithi008.stdout: libsepol-devel-2.9-3.el8.x86_64 2023-08-01T19:53:04.628 INFO:teuthology.orchestra.run.smithi008.stdout: libtool-2.4.6-25.el8.x86_64 2023-08-01T19:53:04.628 INFO:teuthology.orchestra.run.smithi008.stdout: libunwind-1.3.1-3.el8.x86_64 2023-08-01T19:53:04.628 INFO:teuthology.orchestra.run.smithi008.stdout: libuuid-devel-2.32.1-42.el8.x86_64 2023-08-01T19:53:04.628 INFO:teuthology.orchestra.run.smithi008.stdout: libverto-devel-0.3.2-2.el8.x86_64 2023-08-01T19:53:04.628 INFO:teuthology.orchestra.run.smithi008.stdout: libzstd-devel-1.4.4-1.el8.x86_64 2023-08-01T19:53:04.628 INFO:teuthology.orchestra.run.smithi008.stdout: lttng-ust-2.8.1-11.el8.x86_64 2023-08-01T19:53:04.628 INFO:teuthology.orchestra.run.smithi008.stdout: oniguruma-6.8.2-2.el8.x86_64 2023-08-01T19:53:04.629 INFO:teuthology.orchestra.run.smithi008.stdout: openblas-0.3.15-4.el8.x86_64 2023-08-01T19:53:04.629 INFO:teuthology.orchestra.run.smithi008.stdout: openblas-threads-0.3.15-4.el8.x86_64 2023-08-01T19:53:04.629 INFO:teuthology.orchestra.run.smithi008.stdout: openssl-devel-1:1.1.1k-9.el8.x86_64 2023-08-01T19:53:04.629 INFO:teuthology.orchestra.run.smithi008.stdout: pcre2-devel-10.32-3.el8.x86_64 2023-08-01T19:53:04.629 INFO:teuthology.orchestra.run.smithi008.stdout: pcre2-utf16-10.32-3.el8.x86_64 2023-08-01T19:53:04.629 INFO:teuthology.orchestra.run.smithi008.stdout: pcre2-utf32-10.32-3.el8.x86_64 2023-08-01T19:53:04.629 INFO:teuthology.orchestra.run.smithi008.stdout: python3-asyncssh-2.7.0-2.el8.noarch 2023-08-01T19:53:04.629 INFO:teuthology.orchestra.run.smithi008.stdout: python3-babel-2.5.1-7.el8.noarch 2023-08-01T19:53:04.630 INFO:teuthology.orchestra.run.smithi008.stdout: python3-bcrypt-3.1.6-2.el8.1.x86_64 2023-08-01T19:53:04.630 INFO:teuthology.orchestra.run.smithi008.stdout: python3-beautifulsoup4-4.6.3-2.el8.1.noarch 2023-08-01T19:53:04.630 INFO:teuthology.orchestra.run.smithi008.stdout: python3-cachetools-3.1.1-4.el8.noarch 2023-08-01T19:53:04.630 INFO:teuthology.orchestra.run.smithi008.stdout: python3-ceph-argparse-2:17.2.6-823.g893fa35f.el8.x86_64 2023-08-01T19:53:04.630 INFO:teuthology.orchestra.run.smithi008.stdout: python3-ceph-common-2:17.2.6-823.g893fa35f.el8.x86_64 2023-08-01T19:53:04.630 INFO:teuthology.orchestra.run.smithi008.stdout: python3-cephfs-2:17.2.6-823.g893fa35f.el8.x86_64 2023-08-01T19:53:04.630 INFO:teuthology.orchestra.run.smithi008.stdout: python3-certifi-2018.10.15-7.el8.noarch 2023-08-01T19:53:04.630 INFO:teuthology.orchestra.run.smithi008.stdout: python3-cffi-1.11.5-6.el8.x86_64 2023-08-01T19:53:04.631 INFO:teuthology.orchestra.run.smithi008.stdout: python3-cheroot-8.5.2-1.el8.noarch 2023-08-01T19:53:04.631 INFO:teuthology.orchestra.run.smithi008.stdout: python3-cherrypy-18.4.0-1.el8.noarch 2023-08-01T19:53:04.631 INFO:teuthology.orchestra.run.smithi008.stdout: python3-cryptography-3.2.1-6.el8.x86_64 2023-08-01T19:53:04.631 INFO:teuthology.orchestra.run.smithi008.stdout: python3-google-auth-1:1.1.1-10.el8.noarch 2023-08-01T19:53:04.631 INFO:teuthology.orchestra.run.smithi008.stdout: python3-jaraco-6.2-6.el8.noarch 2023-08-01T19:53:04.631 INFO:teuthology.orchestra.run.smithi008.stdout: python3-jaraco-functools-2.0-4.el8.noarch 2023-08-01T19:53:04.631 INFO:teuthology.orchestra.run.smithi008.stdout: python3-jinja2-2.10.1-3.el8.noarch 2023-08-01T19:53:04.632 INFO:teuthology.orchestra.run.smithi008.stdout: python3-jsonpatch-1.21-2.el8.noarch 2023-08-01T19:53:04.632 INFO:teuthology.orchestra.run.smithi008.stdout: python3-jsonpointer-1.10-11.el8.noarch 2023-08-01T19:53:04.632 INFO:teuthology.orchestra.run.smithi008.stdout: python3-jwt-1.6.1-2.el8.noarch 2023-08-01T19:53:04.632 INFO:teuthology.orchestra.run.smithi008.stdout: python3-kubernetes-1:11.0.0-6.el8.noarch 2023-08-01T19:53:04.632 INFO:teuthology.orchestra.run.smithi008.stdout: python3-logutils-0.3.5-11.el8.noarch 2023-08-01T19:53:04.632 INFO:teuthology.orchestra.run.smithi008.stdout: python3-mako-1.0.6-14.el8.noarch 2023-08-01T19:53:04.632 INFO:teuthology.orchestra.run.smithi008.stdout: python3-markupsafe-0.23-19.el8.x86_64 2023-08-01T19:53:04.632 INFO:teuthology.orchestra.run.smithi008.stdout: python3-more-itertools-7.2.0-3.el8.noarch 2023-08-01T19:53:04.633 INFO:teuthology.orchestra.run.smithi008.stdout: python3-natsort-7.1.1-2.el8.noarch 2023-08-01T19:53:04.633 INFO:teuthology.orchestra.run.smithi008.stdout: python3-numpy-1:1.14.3-10.el8.x86_64 2023-08-01T19:53:04.633 INFO:teuthology.orchestra.run.smithi008.stdout: python3-numpy-f2py-1:1.14.3-10.el8.x86_64 2023-08-01T19:53:04.633 INFO:teuthology.orchestra.run.smithi008.stdout: python3-oauthlib-2.1.0-1.el8.noarch 2023-08-01T19:53:04.633 INFO:teuthology.orchestra.run.smithi008.stdout: python3-pecan-1.3.2-9.el8.noarch 2023-08-01T19:53:04.633 INFO:teuthology.orchestra.run.smithi008.stdout: python3-portend-2.6-1.el8.noarch 2023-08-01T19:53:04.633 INFO:teuthology.orchestra.run.smithi008.stdout: python3-prettytable-0.7.2-14.el8.noarch 2023-08-01T19:53:04.634 INFO:teuthology.orchestra.run.smithi008.stdout: python3-pyOpenSSL-19.0.0-1.el8.noarch 2023-08-01T19:53:04.634 INFO:teuthology.orchestra.run.smithi008.stdout: python3-pyasn1-0.3.7-6.el8.noarch 2023-08-01T19:53:04.634 INFO:teuthology.orchestra.run.smithi008.stdout: python3-pyasn1-modules-0.3.7-6.el8.noarch 2023-08-01T19:53:04.634 INFO:teuthology.orchestra.run.smithi008.stdout: python3-pycparser-2.14-14.el8.noarch 2023-08-01T19:53:04.634 INFO:teuthology.orchestra.run.smithi008.stdout: python3-pytz-2017.2-9.el8.noarch 2023-08-01T19:53:04.634 INFO:teuthology.orchestra.run.smithi008.stdout: python3-rados-2:17.2.6-823.g893fa35f.el8.x86_64 2023-08-01T19:53:04.634 INFO:teuthology.orchestra.run.smithi008.stdout: python3-rbd-2:17.2.6-823.g893fa35f.el8.x86_64 2023-08-01T19:53:04.635 INFO:teuthology.orchestra.run.smithi008.stdout: python3-repoze-lru-0.7-6.el8.noarch 2023-08-01T19:53:04.635 INFO:teuthology.orchestra.run.smithi008.stdout: python3-requests-oauthlib-1.0.0-1.el8.noarch 2023-08-01T19:53:04.635 INFO:teuthology.orchestra.run.smithi008.stdout: python3-rgw-2:17.2.6-823.g893fa35f.el8.x86_64 2023-08-01T19:53:04.635 INFO:teuthology.orchestra.run.smithi008.stdout: python3-routes-2.4.1-12.el8.noarch 2023-08-01T19:53:04.635 INFO:teuthology.orchestra.run.smithi008.stdout: python3-rsa-4.9-2.el8.noarch 2023-08-01T19:53:04.635 INFO:teuthology.orchestra.run.smithi008.stdout: python3-scipy-1.0.0-21.module_el8.5.0+771+e5d9a225.x86_64 2023-08-01T19:53:04.635 INFO:teuthology.orchestra.run.smithi008.stdout: python3-simplegeneric-0.8.1-17.el8.noarch 2023-08-01T19:53:04.635 INFO:teuthology.orchestra.run.smithi008.stdout: python3-singledispatch-3.4.0.3-18.el8.noarch 2023-08-01T19:53:04.636 INFO:teuthology.orchestra.run.smithi008.stdout: python3-tempora-1.14.1-5.el8.noarch 2023-08-01T19:53:04.636 INFO:teuthology.orchestra.run.smithi008.stdout: python3-trustme-0.6.0-4.el8.noarch 2023-08-01T19:53:04.636 INFO:teuthology.orchestra.run.smithi008.stdout: python3-waitress-1.4.3-1.el8.noarch 2023-08-01T19:53:04.636 INFO:teuthology.orchestra.run.smithi008.stdout: python3-webob-1.8.5-1.el8.1.noarch 2023-08-01T19:53:04.636 INFO:teuthology.orchestra.run.smithi008.stdout: python3-websocket-client-0.56.0-5.el8.noarch 2023-08-01T19:53:04.636 INFO:teuthology.orchestra.run.smithi008.stdout: python3-webtest-2.0.33-1.el8.noarch 2023-08-01T19:53:04.636 INFO:teuthology.orchestra.run.smithi008.stdout: python3-werkzeug-0.12.2-4.el8.noarch 2023-08-01T19:53:04.637 INFO:teuthology.orchestra.run.smithi008.stdout: python3-zc-lockfile-2.0-2.el8.noarch 2023-08-01T19:53:04.637 INFO:teuthology.orchestra.run.smithi008.stdout: rbd-fuse-2:17.2.6-823.g893fa35f.el8.x86_64 2023-08-01T19:53:04.637 INFO:teuthology.orchestra.run.smithi008.stdout: rbd-mirror-2:17.2.6-823.g893fa35f.el8.x86_64 2023-08-01T19:53:04.637 INFO:teuthology.orchestra.run.smithi008.stdout: rbd-nbd-2:17.2.6-823.g893fa35f.el8.x86_64 2023-08-01T19:53:04.637 INFO:teuthology.orchestra.run.smithi008.stdout: socat-1.7.4.1-1.el8.x86_64 2023-08-01T19:53:04.637 INFO:teuthology.orchestra.run.smithi008.stdout: thrift-0.13.0-2.el8.x86_64 2023-08-01T19:53:04.637 INFO:teuthology.orchestra.run.smithi008.stdout: xfsprogs-devel-5.0.0-12.el8.x86_64 2023-08-01T19:53:04.637 INFO:teuthology.orchestra.run.smithi008.stdout: xmlstarlet-1.6.1-20.el8.x86_64 2023-08-01T19:53:04.638 INFO:teuthology.orchestra.run.smithi008.stdout: zlib-devel-1.2.11-21.el8.x86_64 2023-08-01T19:53:04.638 INFO:teuthology.orchestra.run.smithi008.stdout: 2023-08-01T19:53:04.638 INFO:teuthology.orchestra.run.smithi008.stdout:Complete! 2023-08-01T19:53:04.817 DEBUG:teuthology.parallel:result is None 2023-08-01T19:53:05.586 INFO:teuthology.orchestra.run.smithi006.stdout: Running scriptlet: libtool-2.4.6-25.el8.x86_64 119/147 2023-08-01T19:53:07.436 INFO:teuthology.orchestra.run.smithi006.stdout: Installing : ceph-test-2:17.2.6-823.g893fa35f.el8.x86_64 120/147 2023-08-01T19:53:07.644 INFO:teuthology.orchestra.run.smithi006.stdout: Installing : ceph-radosgw-2:17.2.6-823.g893fa35f.el8.x86_64 121/147 2023-08-01T19:53:07.745 INFO:teuthology.orchestra.run.smithi006.stdout: Running scriptlet: ceph-radosgw-2:17.2.6-823.g893fa35f.el8.x86_64 121/147 2023-08-01T19:53:07.927 INFO:teuthology.orchestra.run.smithi006.stdout: Installing : ceph-immutable-object-cache-2:17.2.6-823.g893fa3 122/147 2023-08-01T19:53:08.295 INFO:teuthology.orchestra.run.smithi006.stdout: Running scriptlet: ceph-immutable-object-cache-2:17.2.6-823.g893fa3 122/147 2023-08-01T19:53:08.535 INFO:teuthology.orchestra.run.smithi006.stdout: Installing : rbd-mirror-2:17.2.6-823.g893fa35f.el8.x86_64 123/147 2023-08-01T19:53:08.644 INFO:teuthology.orchestra.run.smithi006.stdout: Running scriptlet: rbd-mirror-2:17.2.6-823.g893fa35f.el8.x86_64 123/147 2023-08-01T19:53:09.579 INFO:teuthology.orchestra.run.smithi006.stdout: Installing : ceph-fuse-2:17.2.6-823.g893fa35f.el8.x86_64 124/147 2023-08-01T19:53:09.881 INFO:teuthology.orchestra.run.smithi006.stdout: Installing : openssl-devel-1:1.1.1k-9.el8.x86_64 125/147 2023-08-01T19:53:10.183 INFO:teuthology.orchestra.run.smithi006.stdout: Installing : elfutils-libelf-devel-0.189-2.el8.x86_64 126/147 2023-08-01T19:53:10.414 INFO:teuthology.orchestra.run.smithi006.stdout: Upgrading : util-linux-user-2.32.1-42.el8.x86_64 127/147 2023-08-01T19:53:10.597 INFO:teuthology.orchestra.run.smithi006.stdout: Installing : xfsprogs-devel-5.0.0-12.el8.x86_64 128/147 2023-08-01T19:53:10.769 INFO:teuthology.orchestra.run.smithi006.stdout: Installing : libcephfs-devel-2:17.2.6-823.g893fa35f.el8.x86_6 129/147 2023-08-01T19:53:10.993 INFO:teuthology.orchestra.run.smithi006.stdout: Installing : rbd-fuse-2:17.2.6-823.g893fa35f.el8.x86_64 130/147 2023-08-01T19:53:11.153 INFO:teuthology.orchestra.run.smithi006.stdout: Installing : rbd-nbd-2:17.2.6-823.g893fa35f.el8.x86_64 131/147 2023-08-01T19:53:11.344 INFO:teuthology.orchestra.run.smithi006.stdout: Installing : libaio-devel-0.3.112-1.el8.x86_64 132/147 2023-08-01T19:53:11.551 INFO:teuthology.orchestra.run.smithi006.stdout: Installing : flex-2.6.1-9.el8.x86_64 133/147 2023-08-01T19:53:11.652 INFO:teuthology.orchestra.run.smithi006.stdout: Running scriptlet: flex-2.6.1-9.el8.x86_64 133/147 2023-08-01T19:53:11.858 INFO:teuthology.orchestra.run.smithi006.stdout: Installing : bison-3.0.4-10.el8.x86_64 134/147 2023-08-01T19:53:11.871 INFO:teuthology.orchestra.run.smithi006.stdout: Running scriptlet: bison-3.0.4-10.el8.x86_64 134/147 2023-08-01T19:53:12.019 INFO:teuthology.orchestra.run.smithi006.stdout: Cleanup : elfutils-debuginfod-client-0.189-1.el8.x86_64 135/147 2023-08-01T19:53:12.186 INFO:teuthology.orchestra.run.smithi006.stdout: Cleanup : elfutils-libs-0.189-1.el8.x86_64 136/147 2023-08-01T19:53:12.186 INFO:teuthology.orchestra.run.smithi006.stdout: Cleanup : xfsprogs-5.0.0-10.el8.x86_64 137/147 2023-08-01T19:53:12.454 INFO:teuthology.orchestra.run.smithi006.stdout: Running scriptlet: xfsprogs-5.0.0-10.el8.x86_64 137/147 2023-08-01T19:53:12.455 INFO:teuthology.orchestra.run.smithi006.stdout: Cleanup : librbd1-1:12.2.7-9.el8.x86_64 138/147 2023-08-01T19:53:12.664 INFO:teuthology.orchestra.run.smithi006.stdout: Running scriptlet: librbd1-1:12.2.7-9.el8.x86_64 138/147 2023-08-01T19:53:12.664 INFO:teuthology.orchestra.run.smithi006.stdout: Cleanup : librados2-1:12.2.7-9.el8.x86_64 139/147 2023-08-01T19:53:12.888 INFO:teuthology.orchestra.run.smithi006.stdout: Running scriptlet: librados2-1:12.2.7-9.el8.x86_64 139/147 2023-08-01T19:53:13.091 INFO:teuthology.orchestra.run.smithi006.stdout: Cleanup : util-linux-user-2.32.1-41.el8.x86_64 140/147 2023-08-01T19:53:13.295 INFO:teuthology.orchestra.run.smithi006.stdout: Cleanup : util-linux-2.32.1-41.el8.x86_64 141/147 2023-08-01T19:53:13.295 INFO:teuthology.orchestra.run.smithi006.stdout: Cleanup : libfdisk-2.32.1-41.el8.x86_64 142/147 2023-08-01T19:53:13.479 INFO:teuthology.orchestra.run.smithi006.stdout: Running scriptlet: libfdisk-2.32.1-41.el8.x86_64 142/147 2023-08-01T19:53:13.479 INFO:teuthology.orchestra.run.smithi006.stdout: Cleanup : libmount-2.32.1-41.el8.x86_64 143/147 2023-08-01T19:53:13.721 INFO:teuthology.orchestra.run.smithi006.stdout: Running scriptlet: libmount-2.32.1-41.el8.x86_64 143/147 2023-08-01T19:53:13.721 INFO:teuthology.orchestra.run.smithi006.stdout: Cleanup : libblkid-2.32.1-41.el8.x86_64 144/147 2023-08-01T19:53:13.904 INFO:teuthology.orchestra.run.smithi006.stdout: Running scriptlet: libblkid-2.32.1-41.el8.x86_64 144/147 2023-08-01T19:53:13.904 INFO:teuthology.orchestra.run.smithi006.stdout: Cleanup : libuuid-2.32.1-41.el8.x86_64 145/147 2023-08-01T19:53:14.112 INFO:teuthology.orchestra.run.smithi006.stdout: Running scriptlet: libuuid-2.32.1-41.el8.x86_64 145/147 2023-08-01T19:53:14.113 INFO:teuthology.orchestra.run.smithi006.stdout: Cleanup : libsmartcols-2.32.1-41.el8.x86_64 146/147 2023-08-01T19:53:14.337 INFO:teuthology.orchestra.run.smithi006.stdout: Running scriptlet: libsmartcols-2.32.1-41.el8.x86_64 146/147 2023-08-01T19:53:14.520 INFO:teuthology.orchestra.run.smithi006.stdout: Cleanup : elfutils-libelf-0.189-1.el8.x86_64 147/147 2023-08-01T19:53:15.099 INFO:teuthology.orchestra.run.smithi006.stdout: Running scriptlet: elfutils-libelf-0.189-1.el8.x86_64 147/147 2023-08-01T19:53:15.099 INFO:teuthology.orchestra.run.smithi006.stdout: Verifying : ceph-2:17.2.6-823.g893fa35f.el8.x86_64 1/147 2023-08-01T19:53:15.099 INFO:teuthology.orchestra.run.smithi006.stdout: Verifying : ceph-base-2:17.2.6-823.g893fa35f.el8.x86_64 2/147 2023-08-01T19:53:15.100 INFO:teuthology.orchestra.run.smithi006.stdout: Verifying : ceph-common-2:17.2.6-823.g893fa35f.el8.x86_64 3/147 2023-08-01T19:53:15.100 INFO:teuthology.orchestra.run.smithi006.stdout: Verifying : ceph-fuse-2:17.2.6-823.g893fa35f.el8.x86_64 4/147 2023-08-01T19:53:15.100 INFO:teuthology.orchestra.run.smithi006.stdout: Verifying : ceph-immutable-object-cache-2:17.2.6-823.g893fa3 5/147 2023-08-01T19:53:15.100 INFO:teuthology.orchestra.run.smithi006.stdout: Verifying : ceph-mds-2:17.2.6-823.g893fa35f.el8.x86_64 6/147 2023-08-01T19:53:15.100 INFO:teuthology.orchestra.run.smithi006.stdout: Verifying : ceph-mgr-2:17.2.6-823.g893fa35f.el8.x86_64 7/147 2023-08-01T19:53:15.100 INFO:teuthology.orchestra.run.smithi006.stdout: Verifying : ceph-mon-2:17.2.6-823.g893fa35f.el8.x86_64 8/147 2023-08-01T19:53:15.100 INFO:teuthology.orchestra.run.smithi006.stdout: Verifying : ceph-osd-2:17.2.6-823.g893fa35f.el8.x86_64 9/147 2023-08-01T19:53:15.101 INFO:teuthology.orchestra.run.smithi006.stdout: Verifying : ceph-radosgw-2:17.2.6-823.g893fa35f.el8.x86_64 10/147 2023-08-01T19:53:15.101 INFO:teuthology.orchestra.run.smithi006.stdout: Verifying : ceph-selinux-2:17.2.6-823.g893fa35f.el8.x86_64 11/147 2023-08-01T19:53:15.101 INFO:teuthology.orchestra.run.smithi006.stdout: Verifying : ceph-test-2:17.2.6-823.g893fa35f.el8.x86_64 12/147 2023-08-01T19:53:15.101 INFO:teuthology.orchestra.run.smithi006.stdout: Verifying : libcephfs-devel-2:17.2.6-823.g893fa35f.el8.x86_6 13/147 2023-08-01T19:53:15.101 INFO:teuthology.orchestra.run.smithi006.stdout: Verifying : libcephfs2-2:17.2.6-823.g893fa35f.el8.x86_64 14/147 2023-08-01T19:53:15.101 INFO:teuthology.orchestra.run.smithi006.stdout: Verifying : libcephsqlite-2:17.2.6-823.g893fa35f.el8.x86_64 15/147 2023-08-01T19:53:15.101 INFO:teuthology.orchestra.run.smithi006.stdout: Verifying : librados-devel-2:17.2.6-823.g893fa35f.el8.x86_64 16/147 2023-08-01T19:53:15.101 INFO:teuthology.orchestra.run.smithi006.stdout: Verifying : libradosstriper1-2:17.2.6-823.g893fa35f.el8.x86_ 17/147 2023-08-01T19:53:15.102 INFO:teuthology.orchestra.run.smithi006.stdout: Verifying : librgw2-2:17.2.6-823.g893fa35f.el8.x86_64 18/147 2023-08-01T19:53:15.102 INFO:teuthology.orchestra.run.smithi006.stdout: Verifying : python3-ceph-argparse-2:17.2.6-823.g893fa35f.el8 19/147 2023-08-01T19:53:15.102 INFO:teuthology.orchestra.run.smithi006.stdout: Verifying : python3-ceph-common-2:17.2.6-823.g893fa35f.el8.x 20/147 2023-08-01T19:53:15.102 INFO:teuthology.orchestra.run.smithi006.stdout: Verifying : python3-cephfs-2:17.2.6-823.g893fa35f.el8.x86_64 21/147 2023-08-01T19:53:15.102 INFO:teuthology.orchestra.run.smithi006.stdout: Verifying : python3-rados-2:17.2.6-823.g893fa35f.el8.x86_64 22/147 2023-08-01T19:53:15.102 INFO:teuthology.orchestra.run.smithi006.stdout: Verifying : python3-rbd-2:17.2.6-823.g893fa35f.el8.x86_64 23/147 2023-08-01T19:53:15.102 INFO:teuthology.orchestra.run.smithi006.stdout: Verifying : python3-rgw-2:17.2.6-823.g893fa35f.el8.x86_64 24/147 2023-08-01T19:53:15.102 INFO:teuthology.orchestra.run.smithi006.stdout: Verifying : rbd-fuse-2:17.2.6-823.g893fa35f.el8.x86_64 25/147 2023-08-01T19:53:15.103 INFO:teuthology.orchestra.run.smithi006.stdout: Verifying : rbd-mirror-2:17.2.6-823.g893fa35f.el8.x86_64 26/147 2023-08-01T19:53:15.103 INFO:teuthology.orchestra.run.smithi006.stdout: Verifying : rbd-nbd-2:17.2.6-823.g893fa35f.el8.x86_64 27/147 2023-08-01T19:53:15.103 INFO:teuthology.orchestra.run.smithi006.stdout: Verifying : ceph-grafana-dashboards-2:17.2.6-823.g893fa35f.e 28/147 2023-08-01T19:53:15.103 INFO:teuthology.orchestra.run.smithi006.stdout: Verifying : ceph-mgr-cephadm-2:17.2.6-823.g893fa35f.el8.noar 29/147 2023-08-01T19:53:15.103 INFO:teuthology.orchestra.run.smithi006.stdout: Verifying : ceph-mgr-dashboard-2:17.2.6-823.g893fa35f.el8.no 30/147 2023-08-01T19:53:15.103 INFO:teuthology.orchestra.run.smithi006.stdout: Verifying : ceph-mgr-diskprediction-local-2:17.2.6-823.g893f 31/147 2023-08-01T19:53:15.110 INFO:teuthology.orchestra.run.smithi006.stdout: Verifying : ceph-mgr-modules-core-2:17.2.6-823.g893fa35f.el8 32/147 2023-08-01T19:53:15.111 INFO:teuthology.orchestra.run.smithi006.stdout: Verifying : ceph-mgr-rook-2:17.2.6-823.g893fa35f.el8.noarch 33/147 2023-08-01T19:53:15.111 INFO:teuthology.orchestra.run.smithi006.stdout: Verifying : ceph-prometheus-alerts-2:17.2.6-823.g893fa35f.el 34/147 2023-08-01T19:53:15.111 INFO:teuthology.orchestra.run.smithi006.stdout: Verifying : ceph-volume-2:17.2.6-823.g893fa35f.el8.noarch 35/147 2023-08-01T19:53:15.111 INFO:teuthology.orchestra.run.smithi006.stdout: Verifying : cephadm-2:17.2.6-823.g893fa35f.el8.noarch 36/147 2023-08-01T19:53:15.111 INFO:teuthology.orchestra.run.smithi006.stdout: Verifying : automake-1.16.1-7.el8.noarch 37/147 2023-08-01T19:53:15.111 INFO:teuthology.orchestra.run.smithi006.stdout: Verifying : bison-3.0.4-10.el8.x86_64 38/147 2023-08-01T19:53:15.112 INFO:teuthology.orchestra.run.smithi006.stdout: Verifying : flex-2.6.1-9.el8.x86_64 39/147 2023-08-01T19:53:15.112 INFO:teuthology.orchestra.run.smithi006.stdout: Verifying : jq-1.6-7.el8.x86_64 40/147 2023-08-01T19:53:15.112 INFO:teuthology.orchestra.run.smithi006.stdout: Verifying : librdkafka-0.11.4-3.el8.x86_64 41/147 2023-08-01T19:53:15.112 INFO:teuthology.orchestra.run.smithi006.stdout: Verifying : libtool-2.4.6-25.el8.x86_64 42/147 2023-08-01T19:53:15.112 INFO:teuthology.orchestra.run.smithi006.stdout: Verifying : lttng-ust-2.8.1-11.el8.x86_64 43/147 2023-08-01T19:53:15.112 INFO:teuthology.orchestra.run.smithi006.stdout: Verifying : oniguruma-6.8.2-2.el8.x86_64 44/147 2023-08-01T19:53:15.112 INFO:teuthology.orchestra.run.smithi006.stdout: Verifying : openblas-0.3.15-4.el8.x86_64 45/147 2023-08-01T19:53:15.112 INFO:teuthology.orchestra.run.smithi006.stdout: Verifying : openblas-threads-0.3.15-4.el8.x86_64 46/147 2023-08-01T19:53:15.113 INFO:teuthology.orchestra.run.smithi006.stdout: Verifying : python3-babel-2.5.1-7.el8.noarch 47/147 2023-08-01T19:53:15.113 INFO:teuthology.orchestra.run.smithi006.stdout: Verifying : python3-jinja2-2.10.1-3.el8.noarch 48/147 2023-08-01T19:53:15.113 INFO:teuthology.orchestra.run.smithi006.stdout: Verifying : python3-jsonpatch-1.21-2.el8.noarch 49/147 2023-08-01T19:53:15.113 INFO:teuthology.orchestra.run.smithi006.stdout: Verifying : python3-jsonpointer-1.10-11.el8.noarch 50/147 2023-08-01T19:53:15.113 INFO:teuthology.orchestra.run.smithi006.stdout: Verifying : python3-mako-1.0.6-14.el8.noarch 51/147 2023-08-01T19:53:15.113 INFO:teuthology.orchestra.run.smithi006.stdout: Verifying : python3-markupsafe-0.23-19.el8.x86_64 52/147 2023-08-01T19:53:15.113 INFO:teuthology.orchestra.run.smithi006.stdout: Verifying : python3-numpy-1:1.14.3-10.el8.x86_64 53/147 2023-08-01T19:53:15.114 INFO:teuthology.orchestra.run.smithi006.stdout: Verifying : python3-numpy-f2py-1:1.14.3-10.el8.x86_64 54/147 2023-08-01T19:53:15.114 INFO:teuthology.orchestra.run.smithi006.stdout: Verifying : python3-prettytable-0.7.2-14.el8.noarch 55/147 2023-08-01T19:53:15.114 INFO:teuthology.orchestra.run.smithi006.stdout: Verifying : python3-pyOpenSSL-19.0.0-1.el8.noarch 56/147 2023-08-01T19:53:15.114 INFO:teuthology.orchestra.run.smithi006.stdout: Verifying : python3-pyasn1-0.3.7-6.el8.noarch 57/147 2023-08-01T19:53:15.114 INFO:teuthology.orchestra.run.smithi006.stdout: Verifying : python3-pyasn1-modules-0.3.7-6.el8.noarch 58/147 2023-08-01T19:53:15.114 INFO:teuthology.orchestra.run.smithi006.stdout: Verifying : python3-pytz-2017.2-9.el8.noarch 59/147 2023-08-01T19:53:15.114 INFO:teuthology.orchestra.run.smithi006.stdout: Verifying : python3-scipy-1.0.0-21.module_el8.5.0+771+e5d9a2 60/147 2023-08-01T19:53:15.114 INFO:teuthology.orchestra.run.smithi006.stdout: Verifying : python3-werkzeug-0.12.2-4.el8.noarch 61/147 2023-08-01T19:53:15.115 INFO:teuthology.orchestra.run.smithi006.stdout: Verifying : socat-1.7.4.1-1.el8.x86_64 62/147 2023-08-01T19:53:15.115 INFO:teuthology.orchestra.run.smithi006.stdout: Verifying : xmlstarlet-1.6.1-20.el8.x86_64 63/147 2023-08-01T19:53:15.115 INFO:teuthology.orchestra.run.smithi006.stdout: Verifying : elfutils-libelf-devel-0.189-2.el8.x86_64 64/147 2023-08-01T19:53:15.115 INFO:teuthology.orchestra.run.smithi006.stdout: Verifying : fuse-2.9.7-17.el8.x86_64 65/147 2023-08-01T19:53:15.115 INFO:teuthology.orchestra.run.smithi006.stdout: Verifying : keyutils-libs-devel-1.5.10-9.el8.x86_64 66/147 2023-08-01T19:53:15.115 INFO:teuthology.orchestra.run.smithi006.stdout: Verifying : krb5-devel-1.18.2-22.el8.x86_64 67/147 2023-08-01T19:53:15.115 INFO:teuthology.orchestra.run.smithi006.stdout: Verifying : libaio-devel-0.3.112-1.el8.x86_64 68/147 2023-08-01T19:53:15.115 INFO:teuthology.orchestra.run.smithi006.stdout: Verifying : libcom_err-devel-1.45.6-5.el8.x86_64 69/147 2023-08-01T19:53:15.116 INFO:teuthology.orchestra.run.smithi006.stdout: Verifying : libgfortran-8.5.0-20.el8.x86_64 70/147 2023-08-01T19:53:15.116 INFO:teuthology.orchestra.run.smithi006.stdout: Verifying : libquadmath-8.5.0-20.el8.x86_64 71/147 2023-08-01T19:53:15.116 INFO:teuthology.orchestra.run.smithi006.stdout: Verifying : librabbitmq-0.9.0-4.el8.x86_64 72/147 2023-08-01T19:53:15.116 INFO:teuthology.orchestra.run.smithi006.stdout: Verifying : libselinux-devel-2.9-8.el8.x86_64 73/147 2023-08-01T19:53:15.116 INFO:teuthology.orchestra.run.smithi006.stdout: Verifying : libsepol-devel-2.9-3.el8.x86_64 74/147 2023-08-01T19:53:15.116 INFO:teuthology.orchestra.run.smithi006.stdout: Verifying : libuuid-devel-2.32.1-42.el8.x86_64 75/147 2023-08-01T19:53:15.116 INFO:teuthology.orchestra.run.smithi006.stdout: Verifying : libverto-devel-0.3.2-2.el8.x86_64 76/147 2023-08-01T19:53:15.117 INFO:teuthology.orchestra.run.smithi006.stdout: Verifying : libzstd-devel-1.4.4-1.el8.x86_64 77/147 2023-08-01T19:53:15.117 INFO:teuthology.orchestra.run.smithi006.stdout: Verifying : openssl-devel-1:1.1.1k-9.el8.x86_64 78/147 2023-08-01T19:53:15.117 INFO:teuthology.orchestra.run.smithi006.stdout: Verifying : pcre2-devel-10.32-3.el8.x86_64 79/147 2023-08-01T19:53:15.117 INFO:teuthology.orchestra.run.smithi006.stdout: Verifying : pcre2-utf16-10.32-3.el8.x86_64 80/147 2023-08-01T19:53:15.117 INFO:teuthology.orchestra.run.smithi006.stdout: Verifying : pcre2-utf32-10.32-3.el8.x86_64 81/147 2023-08-01T19:53:15.117 INFO:teuthology.orchestra.run.smithi006.stdout: Verifying : python3-cffi-1.11.5-6.el8.x86_64 82/147 2023-08-01T19:53:15.117 INFO:teuthology.orchestra.run.smithi006.stdout: Verifying : python3-cryptography-3.2.1-6.el8.x86_64 83/147 2023-08-01T19:53:15.117 INFO:teuthology.orchestra.run.smithi006.stdout: Verifying : python3-jwt-1.6.1-2.el8.noarch 84/147 2023-08-01T19:53:15.118 INFO:teuthology.orchestra.run.smithi006.stdout: Verifying : python3-oauthlib-2.1.0-1.el8.noarch 85/147 2023-08-01T19:53:15.118 INFO:teuthology.orchestra.run.smithi006.stdout: Verifying : python3-pycparser-2.14-14.el8.noarch 86/147 2023-08-01T19:53:15.118 INFO:teuthology.orchestra.run.smithi006.stdout: Verifying : python3-requests-oauthlib-1.0.0-1.el8.noarch 87/147 2023-08-01T19:53:15.118 INFO:teuthology.orchestra.run.smithi006.stdout: Verifying : xfsprogs-devel-5.0.0-12.el8.x86_64 88/147 2023-08-01T19:53:15.118 INFO:teuthology.orchestra.run.smithi006.stdout: Verifying : zlib-devel-1.2.11-21.el8.x86_64 89/147 2023-08-01T19:53:15.118 INFO:teuthology.orchestra.run.smithi006.stdout: Verifying : gperftools-libs-1:2.7-9.el8.x86_64 90/147 2023-08-01T19:53:15.118 INFO:teuthology.orchestra.run.smithi006.stdout: Verifying : liboath-2.6.2-3.el8.x86_64 91/147 2023-08-01T19:53:15.119 INFO:teuthology.orchestra.run.smithi006.stdout: Verifying : libunwind-1.3.1-3.el8.x86_64 92/147 2023-08-01T19:53:15.119 INFO:teuthology.orchestra.run.smithi006.stdout: Verifying : python3-asyncssh-2.7.0-2.el8.noarch 93/147 2023-08-01T19:53:15.119 INFO:teuthology.orchestra.run.smithi006.stdout: Verifying : python3-bcrypt-3.1.6-2.el8.1.x86_64 94/147 2023-08-01T19:53:15.119 INFO:teuthology.orchestra.run.smithi006.stdout: Verifying : python3-beautifulsoup4-4.6.3-2.el8.1.noarch 95/147 2023-08-01T19:53:15.119 INFO:teuthology.orchestra.run.smithi006.stdout: Verifying : python3-cachetools-3.1.1-4.el8.noarch 96/147 2023-08-01T19:53:15.119 INFO:teuthology.orchestra.run.smithi006.stdout: Verifying : python3-certifi-2018.10.15-7.el8.noarch 97/147 2023-08-01T19:53:15.119 INFO:teuthology.orchestra.run.smithi006.stdout: Verifying : python3-cheroot-8.5.2-1.el8.noarch 98/147 2023-08-01T19:53:15.119 INFO:teuthology.orchestra.run.smithi006.stdout: Verifying : python3-cherrypy-18.4.0-1.el8.noarch 99/147 2023-08-01T19:53:15.120 INFO:teuthology.orchestra.run.smithi006.stdout: Verifying : python3-google-auth-1:1.1.1-10.el8.noarch 100/147 2023-08-01T19:53:15.120 INFO:teuthology.orchestra.run.smithi006.stdout: Verifying : python3-jaraco-6.2-6.el8.noarch 101/147 2023-08-01T19:53:15.120 INFO:teuthology.orchestra.run.smithi006.stdout: Verifying : python3-jaraco-functools-2.0-4.el8.noarch 102/147 2023-08-01T19:53:15.120 INFO:teuthology.orchestra.run.smithi006.stdout: Verifying : python3-kubernetes-1:11.0.0-6.el8.noarch 103/147 2023-08-01T19:53:15.120 INFO:teuthology.orchestra.run.smithi006.stdout: Verifying : python3-logutils-0.3.5-11.el8.noarch 104/147 2023-08-01T19:53:15.120 INFO:teuthology.orchestra.run.smithi006.stdout: Verifying : python3-more-itertools-7.2.0-3.el8.noarch 105/147 2023-08-01T19:53:15.120 INFO:teuthology.orchestra.run.smithi006.stdout: Verifying : python3-natsort-7.1.1-2.el8.noarch 106/147 2023-08-01T19:53:15.120 INFO:teuthology.orchestra.run.smithi006.stdout: Verifying : python3-pecan-1.3.2-9.el8.noarch 107/147 2023-08-01T19:53:15.121 INFO:teuthology.orchestra.run.smithi006.stdout: Verifying : python3-portend-2.6-1.el8.noarch 108/147 2023-08-01T19:53:15.121 INFO:teuthology.orchestra.run.smithi006.stdout: Verifying : python3-repoze-lru-0.7-6.el8.noarch 109/147 2023-08-01T19:53:15.121 INFO:teuthology.orchestra.run.smithi006.stdout: Verifying : python3-routes-2.4.1-12.el8.noarch 110/147 2023-08-01T19:53:15.121 INFO:teuthology.orchestra.run.smithi006.stdout: Verifying : python3-rsa-4.9-2.el8.noarch 111/147 2023-08-01T19:53:15.121 INFO:teuthology.orchestra.run.smithi006.stdout: Verifying : python3-simplegeneric-0.8.1-17.el8.noarch 112/147 2023-08-01T19:53:15.121 INFO:teuthology.orchestra.run.smithi006.stdout: Verifying : python3-singledispatch-3.4.0.3-18.el8.noarch 113/147 2023-08-01T19:53:15.121 INFO:teuthology.orchestra.run.smithi006.stdout: Verifying : python3-tempora-1.14.1-5.el8.noarch 114/147 2023-08-01T19:53:15.122 INFO:teuthology.orchestra.run.smithi006.stdout: Verifying : python3-trustme-0.6.0-4.el8.noarch 115/147 2023-08-01T19:53:15.122 INFO:teuthology.orchestra.run.smithi006.stdout: Verifying : python3-waitress-1.4.3-1.el8.noarch 116/147 2023-08-01T19:53:15.122 INFO:teuthology.orchestra.run.smithi006.stdout: Verifying : python3-webob-1.8.5-1.el8.1.noarch 117/147 2023-08-01T19:53:15.122 INFO:teuthology.orchestra.run.smithi006.stdout: Verifying : python3-websocket-client-0.56.0-5.el8.noarch 118/147 2023-08-01T19:53:15.122 INFO:teuthology.orchestra.run.smithi006.stdout: Verifying : python3-webtest-2.0.33-1.el8.noarch 119/147 2023-08-01T19:53:15.122 INFO:teuthology.orchestra.run.smithi006.stdout: Verifying : python3-zc-lockfile-2.0-2.el8.noarch 120/147 2023-08-01T19:53:15.122 INFO:teuthology.orchestra.run.smithi006.stdout: Verifying : thrift-0.13.0-2.el8.x86_64 121/147 2023-08-01T19:53:15.122 INFO:teuthology.orchestra.run.smithi006.stdout: Verifying : librados2-2:17.2.6-823.g893fa35f.el8.x86_64 122/147 2023-08-01T19:53:15.123 INFO:teuthology.orchestra.run.smithi006.stdout: Verifying : librados2-1:12.2.7-9.el8.x86_64 123/147 2023-08-01T19:53:15.123 INFO:teuthology.orchestra.run.smithi006.stdout: Verifying : librbd1-2:17.2.6-823.g893fa35f.el8.x86_64 124/147 2023-08-01T19:53:15.123 INFO:teuthology.orchestra.run.smithi006.stdout: Verifying : librbd1-1:12.2.7-9.el8.x86_64 125/147 2023-08-01T19:53:15.123 INFO:teuthology.orchestra.run.smithi006.stdout: Verifying : elfutils-debuginfod-client-0.189-2.el8.x86_64 126/147 2023-08-01T19:53:15.123 INFO:teuthology.orchestra.run.smithi006.stdout: Verifying : elfutils-debuginfod-client-0.189-1.el8.x86_64 127/147 2023-08-01T19:53:15.123 INFO:teuthology.orchestra.run.smithi006.stdout: Verifying : elfutils-libelf-0.189-2.el8.x86_64 128/147 2023-08-01T19:53:15.123 INFO:teuthology.orchestra.run.smithi006.stdout: Verifying : elfutils-libelf-0.189-1.el8.x86_64 129/147 2023-08-01T19:53:15.123 INFO:teuthology.orchestra.run.smithi006.stdout: Verifying : elfutils-libs-0.189-2.el8.x86_64 130/147 2023-08-01T19:53:15.124 INFO:teuthology.orchestra.run.smithi006.stdout: Verifying : elfutils-libs-0.189-1.el8.x86_64 131/147 2023-08-01T19:53:15.124 INFO:teuthology.orchestra.run.smithi006.stdout: Verifying : libblkid-2.32.1-42.el8.x86_64 132/147 2023-08-01T19:53:15.124 INFO:teuthology.orchestra.run.smithi006.stdout: Verifying : libblkid-2.32.1-41.el8.x86_64 133/147 2023-08-01T19:53:15.124 INFO:teuthology.orchestra.run.smithi006.stdout: Verifying : libfdisk-2.32.1-42.el8.x86_64 134/147 2023-08-01T19:53:15.124 INFO:teuthology.orchestra.run.smithi006.stdout: Verifying : libfdisk-2.32.1-41.el8.x86_64 135/147 2023-08-01T19:53:15.124 INFO:teuthology.orchestra.run.smithi006.stdout: Verifying : libmount-2.32.1-42.el8.x86_64 136/147 2023-08-01T19:53:15.124 INFO:teuthology.orchestra.run.smithi006.stdout: Verifying : libmount-2.32.1-41.el8.x86_64 137/147 2023-08-01T19:53:15.124 INFO:teuthology.orchestra.run.smithi006.stdout: Verifying : libsmartcols-2.32.1-42.el8.x86_64 138/147 2023-08-01T19:53:15.125 INFO:teuthology.orchestra.run.smithi006.stdout: Verifying : libsmartcols-2.32.1-41.el8.x86_64 139/147 2023-08-01T19:53:15.125 INFO:teuthology.orchestra.run.smithi006.stdout: Verifying : libuuid-2.32.1-42.el8.x86_64 140/147 2023-08-01T19:53:15.125 INFO:teuthology.orchestra.run.smithi006.stdout: Verifying : libuuid-2.32.1-41.el8.x86_64 141/147 2023-08-01T19:53:15.125 INFO:teuthology.orchestra.run.smithi006.stdout: Verifying : util-linux-2.32.1-42.el8.x86_64 142/147 2023-08-01T19:53:15.125 INFO:teuthology.orchestra.run.smithi006.stdout: Verifying : util-linux-2.32.1-41.el8.x86_64 143/147 2023-08-01T19:53:15.125 INFO:teuthology.orchestra.run.smithi006.stdout: Verifying : util-linux-user-2.32.1-42.el8.x86_64 144/147 2023-08-01T19:53:15.125 INFO:teuthology.orchestra.run.smithi006.stdout: Verifying : util-linux-user-2.32.1-41.el8.x86_64 145/147 2023-08-01T19:53:15.126 INFO:teuthology.orchestra.run.smithi006.stdout: Verifying : xfsprogs-5.0.0-12.el8.x86_64 146/147 2023-08-01T19:53:17.101 INFO:teuthology.orchestra.run.smithi006.stdout: Verifying : xfsprogs-5.0.0-10.el8.x86_64 147/147 2023-08-01T19:53:17.102 INFO:teuthology.orchestra.run.smithi006.stdout: 2023-08-01T19:53:17.102 INFO:teuthology.orchestra.run.smithi006.stdout:Upgraded: 2023-08-01T19:53:17.102 INFO:teuthology.orchestra.run.smithi006.stdout: elfutils-debuginfod-client-0.189-2.el8.x86_64 2023-08-01T19:53:17.102 INFO:teuthology.orchestra.run.smithi006.stdout: elfutils-libelf-0.189-2.el8.x86_64 2023-08-01T19:53:17.102 INFO:teuthology.orchestra.run.smithi006.stdout: elfutils-libs-0.189-2.el8.x86_64 2023-08-01T19:53:17.103 INFO:teuthology.orchestra.run.smithi006.stdout: libblkid-2.32.1-42.el8.x86_64 2023-08-01T19:53:17.103 INFO:teuthology.orchestra.run.smithi006.stdout: libfdisk-2.32.1-42.el8.x86_64 2023-08-01T19:53:17.103 INFO:teuthology.orchestra.run.smithi006.stdout: libmount-2.32.1-42.el8.x86_64 2023-08-01T19:53:17.103 INFO:teuthology.orchestra.run.smithi006.stdout: librados2-2:17.2.6-823.g893fa35f.el8.x86_64 2023-08-01T19:53:17.103 INFO:teuthology.orchestra.run.smithi006.stdout: librbd1-2:17.2.6-823.g893fa35f.el8.x86_64 2023-08-01T19:53:17.103 INFO:teuthology.orchestra.run.smithi006.stdout: libsmartcols-2.32.1-42.el8.x86_64 2023-08-01T19:53:17.103 INFO:teuthology.orchestra.run.smithi006.stdout: libuuid-2.32.1-42.el8.x86_64 2023-08-01T19:53:17.103 INFO:teuthology.orchestra.run.smithi006.stdout: util-linux-2.32.1-42.el8.x86_64 2023-08-01T19:53:17.104 INFO:teuthology.orchestra.run.smithi006.stdout: util-linux-user-2.32.1-42.el8.x86_64 2023-08-01T19:53:17.104 INFO:teuthology.orchestra.run.smithi006.stdout: xfsprogs-5.0.0-12.el8.x86_64 2023-08-01T19:53:17.104 INFO:teuthology.orchestra.run.smithi006.stdout:Installed: 2023-08-01T19:53:17.104 INFO:teuthology.orchestra.run.smithi006.stdout: automake-1.16.1-7.el8.noarch 2023-08-01T19:53:17.104 INFO:teuthology.orchestra.run.smithi006.stdout: bison-3.0.4-10.el8.x86_64 2023-08-01T19:53:17.104 INFO:teuthology.orchestra.run.smithi006.stdout: ceph-2:17.2.6-823.g893fa35f.el8.x86_64 2023-08-01T19:53:17.104 INFO:teuthology.orchestra.run.smithi006.stdout: ceph-base-2:17.2.6-823.g893fa35f.el8.x86_64 2023-08-01T19:53:17.105 INFO:teuthology.orchestra.run.smithi006.stdout: ceph-common-2:17.2.6-823.g893fa35f.el8.x86_64 2023-08-01T19:53:17.105 INFO:teuthology.orchestra.run.smithi006.stdout: ceph-fuse-2:17.2.6-823.g893fa35f.el8.x86_64 2023-08-01T19:53:17.105 INFO:teuthology.orchestra.run.smithi006.stdout: ceph-grafana-dashboards-2:17.2.6-823.g893fa35f.el8.noarch 2023-08-01T19:53:17.105 INFO:teuthology.orchestra.run.smithi006.stdout: ceph-immutable-object-cache-2:17.2.6-823.g893fa35f.el8.x86_64 2023-08-01T19:53:17.105 INFO:teuthology.orchestra.run.smithi006.stdout: ceph-mds-2:17.2.6-823.g893fa35f.el8.x86_64 2023-08-01T19:53:17.105 INFO:teuthology.orchestra.run.smithi006.stdout: ceph-mgr-2:17.2.6-823.g893fa35f.el8.x86_64 2023-08-01T19:53:17.105 INFO:teuthology.orchestra.run.smithi006.stdout: ceph-mgr-cephadm-2:17.2.6-823.g893fa35f.el8.noarch 2023-08-01T19:53:17.105 INFO:teuthology.orchestra.run.smithi006.stdout: ceph-mgr-dashboard-2:17.2.6-823.g893fa35f.el8.noarch 2023-08-01T19:53:17.106 INFO:teuthology.orchestra.run.smithi006.stdout: ceph-mgr-diskprediction-local-2:17.2.6-823.g893fa35f.el8.noarch 2023-08-01T19:53:17.106 INFO:teuthology.orchestra.run.smithi006.stdout: ceph-mgr-modules-core-2:17.2.6-823.g893fa35f.el8.noarch 2023-08-01T19:53:17.106 INFO:teuthology.orchestra.run.smithi006.stdout: ceph-mgr-rook-2:17.2.6-823.g893fa35f.el8.noarch 2023-08-01T19:53:17.106 INFO:teuthology.orchestra.run.smithi006.stdout: ceph-mon-2:17.2.6-823.g893fa35f.el8.x86_64 2023-08-01T19:53:17.106 INFO:teuthology.orchestra.run.smithi006.stdout: ceph-osd-2:17.2.6-823.g893fa35f.el8.x86_64 2023-08-01T19:53:17.106 INFO:teuthology.orchestra.run.smithi006.stdout: ceph-prometheus-alerts-2:17.2.6-823.g893fa35f.el8.noarch 2023-08-01T19:53:17.106 INFO:teuthology.orchestra.run.smithi006.stdout: ceph-radosgw-2:17.2.6-823.g893fa35f.el8.x86_64 2023-08-01T19:53:17.106 INFO:teuthology.orchestra.run.smithi006.stdout: ceph-selinux-2:17.2.6-823.g893fa35f.el8.x86_64 2023-08-01T19:53:17.107 INFO:teuthology.orchestra.run.smithi006.stdout: ceph-test-2:17.2.6-823.g893fa35f.el8.x86_64 2023-08-01T19:53:17.107 INFO:teuthology.orchestra.run.smithi006.stdout: ceph-volume-2:17.2.6-823.g893fa35f.el8.noarch 2023-08-01T19:53:17.107 INFO:teuthology.orchestra.run.smithi006.stdout: cephadm-2:17.2.6-823.g893fa35f.el8.noarch 2023-08-01T19:53:17.107 INFO:teuthology.orchestra.run.smithi006.stdout: elfutils-libelf-devel-0.189-2.el8.x86_64 2023-08-01T19:53:17.107 INFO:teuthology.orchestra.run.smithi006.stdout: flex-2.6.1-9.el8.x86_64 2023-08-01T19:53:17.107 INFO:teuthology.orchestra.run.smithi006.stdout: fuse-2.9.7-17.el8.x86_64 2023-08-01T19:53:17.107 INFO:teuthology.orchestra.run.smithi006.stdout: gperftools-libs-1:2.7-9.el8.x86_64 2023-08-01T19:53:17.108 INFO:teuthology.orchestra.run.smithi006.stdout: jq-1.6-7.el8.x86_64 2023-08-01T19:53:17.108 INFO:teuthology.orchestra.run.smithi006.stdout: keyutils-libs-devel-1.5.10-9.el8.x86_64 2023-08-01T19:53:17.108 INFO:teuthology.orchestra.run.smithi006.stdout: krb5-devel-1.18.2-22.el8.x86_64 2023-08-01T19:53:17.108 INFO:teuthology.orchestra.run.smithi006.stdout: libaio-devel-0.3.112-1.el8.x86_64 2023-08-01T19:53:17.108 INFO:teuthology.orchestra.run.smithi006.stdout: libcephfs-devel-2:17.2.6-823.g893fa35f.el8.x86_64 2023-08-01T19:53:17.108 INFO:teuthology.orchestra.run.smithi006.stdout: libcephfs2-2:17.2.6-823.g893fa35f.el8.x86_64 2023-08-01T19:53:17.108 INFO:teuthology.orchestra.run.smithi006.stdout: libcephsqlite-2:17.2.6-823.g893fa35f.el8.x86_64 2023-08-01T19:53:17.108 INFO:teuthology.orchestra.run.smithi006.stdout: libcom_err-devel-1.45.6-5.el8.x86_64 2023-08-01T19:53:17.109 INFO:teuthology.orchestra.run.smithi006.stdout: libgfortran-8.5.0-20.el8.x86_64 2023-08-01T19:53:17.109 INFO:teuthology.orchestra.run.smithi006.stdout: liboath-2.6.2-3.el8.x86_64 2023-08-01T19:53:17.109 INFO:teuthology.orchestra.run.smithi006.stdout: libquadmath-8.5.0-20.el8.x86_64 2023-08-01T19:53:17.109 INFO:teuthology.orchestra.run.smithi006.stdout: librabbitmq-0.9.0-4.el8.x86_64 2023-08-01T19:53:17.109 INFO:teuthology.orchestra.run.smithi006.stdout: librados-devel-2:17.2.6-823.g893fa35f.el8.x86_64 2023-08-01T19:53:17.109 INFO:teuthology.orchestra.run.smithi006.stdout: libradosstriper1-2:17.2.6-823.g893fa35f.el8.x86_64 2023-08-01T19:53:17.109 INFO:teuthology.orchestra.run.smithi006.stdout: librdkafka-0.11.4-3.el8.x86_64 2023-08-01T19:53:17.109 INFO:teuthology.orchestra.run.smithi006.stdout: librgw2-2:17.2.6-823.g893fa35f.el8.x86_64 2023-08-01T19:53:17.110 INFO:teuthology.orchestra.run.smithi006.stdout: libselinux-devel-2.9-8.el8.x86_64 2023-08-01T19:53:17.110 INFO:teuthology.orchestra.run.smithi006.stdout: libsepol-devel-2.9-3.el8.x86_64 2023-08-01T19:53:17.110 INFO:teuthology.orchestra.run.smithi006.stdout: libtool-2.4.6-25.el8.x86_64 2023-08-01T19:53:17.110 INFO:teuthology.orchestra.run.smithi006.stdout: libunwind-1.3.1-3.el8.x86_64 2023-08-01T19:53:17.110 INFO:teuthology.orchestra.run.smithi006.stdout: libuuid-devel-2.32.1-42.el8.x86_64 2023-08-01T19:53:17.110 INFO:teuthology.orchestra.run.smithi006.stdout: libverto-devel-0.3.2-2.el8.x86_64 2023-08-01T19:53:17.110 INFO:teuthology.orchestra.run.smithi006.stdout: libzstd-devel-1.4.4-1.el8.x86_64 2023-08-01T19:53:17.111 INFO:teuthology.orchestra.run.smithi006.stdout: lttng-ust-2.8.1-11.el8.x86_64 2023-08-01T19:53:17.111 INFO:teuthology.orchestra.run.smithi006.stdout: oniguruma-6.8.2-2.el8.x86_64 2023-08-01T19:53:17.111 INFO:teuthology.orchestra.run.smithi006.stdout: openblas-0.3.15-4.el8.x86_64 2023-08-01T19:53:17.111 INFO:teuthology.orchestra.run.smithi006.stdout: openblas-threads-0.3.15-4.el8.x86_64 2023-08-01T19:53:17.111 INFO:teuthology.orchestra.run.smithi006.stdout: openssl-devel-1:1.1.1k-9.el8.x86_64 2023-08-01T19:53:17.111 INFO:teuthology.orchestra.run.smithi006.stdout: pcre2-devel-10.32-3.el8.x86_64 2023-08-01T19:53:17.111 INFO:teuthology.orchestra.run.smithi006.stdout: pcre2-utf16-10.32-3.el8.x86_64 2023-08-01T19:53:17.111 INFO:teuthology.orchestra.run.smithi006.stdout: pcre2-utf32-10.32-3.el8.x86_64 2023-08-01T19:53:17.112 INFO:teuthology.orchestra.run.smithi006.stdout: python3-asyncssh-2.7.0-2.el8.noarch 2023-08-01T19:53:17.112 INFO:teuthology.orchestra.run.smithi006.stdout: python3-babel-2.5.1-7.el8.noarch 2023-08-01T19:53:17.112 INFO:teuthology.orchestra.run.smithi006.stdout: python3-bcrypt-3.1.6-2.el8.1.x86_64 2023-08-01T19:53:17.112 INFO:teuthology.orchestra.run.smithi006.stdout: python3-beautifulsoup4-4.6.3-2.el8.1.noarch 2023-08-01T19:53:17.112 INFO:teuthology.orchestra.run.smithi006.stdout: python3-cachetools-3.1.1-4.el8.noarch 2023-08-01T19:53:17.112 INFO:teuthology.orchestra.run.smithi006.stdout: python3-ceph-argparse-2:17.2.6-823.g893fa35f.el8.x86_64 2023-08-01T19:53:17.112 INFO:teuthology.orchestra.run.smithi006.stdout: python3-ceph-common-2:17.2.6-823.g893fa35f.el8.x86_64 2023-08-01T19:53:17.112 INFO:teuthology.orchestra.run.smithi006.stdout: python3-cephfs-2:17.2.6-823.g893fa35f.el8.x86_64 2023-08-01T19:53:17.113 INFO:teuthology.orchestra.run.smithi006.stdout: python3-certifi-2018.10.15-7.el8.noarch 2023-08-01T19:53:17.113 INFO:teuthology.orchestra.run.smithi006.stdout: python3-cffi-1.11.5-6.el8.x86_64 2023-08-01T19:53:17.113 INFO:teuthology.orchestra.run.smithi006.stdout: python3-cheroot-8.5.2-1.el8.noarch 2023-08-01T19:53:17.113 INFO:teuthology.orchestra.run.smithi006.stdout: python3-cherrypy-18.4.0-1.el8.noarch 2023-08-01T19:53:17.113 INFO:teuthology.orchestra.run.smithi006.stdout: python3-cryptography-3.2.1-6.el8.x86_64 2023-08-01T19:53:17.113 INFO:teuthology.orchestra.run.smithi006.stdout: python3-google-auth-1:1.1.1-10.el8.noarch 2023-08-01T19:53:17.113 INFO:teuthology.orchestra.run.smithi006.stdout: python3-jaraco-6.2-6.el8.noarch 2023-08-01T19:53:17.113 INFO:teuthology.orchestra.run.smithi006.stdout: python3-jaraco-functools-2.0-4.el8.noarch 2023-08-01T19:53:17.114 INFO:teuthology.orchestra.run.smithi006.stdout: python3-jinja2-2.10.1-3.el8.noarch 2023-08-01T19:53:17.114 INFO:teuthology.orchestra.run.smithi006.stdout: python3-jsonpatch-1.21-2.el8.noarch 2023-08-01T19:53:17.114 INFO:teuthology.orchestra.run.smithi006.stdout: python3-jsonpointer-1.10-11.el8.noarch 2023-08-01T19:53:17.114 INFO:teuthology.orchestra.run.smithi006.stdout: python3-jwt-1.6.1-2.el8.noarch 2023-08-01T19:53:17.114 INFO:teuthology.orchestra.run.smithi006.stdout: python3-kubernetes-1:11.0.0-6.el8.noarch 2023-08-01T19:53:17.114 INFO:teuthology.orchestra.run.smithi006.stdout: python3-logutils-0.3.5-11.el8.noarch 2023-08-01T19:53:17.114 INFO:teuthology.orchestra.run.smithi006.stdout: python3-mako-1.0.6-14.el8.noarch 2023-08-01T19:53:17.115 INFO:teuthology.orchestra.run.smithi006.stdout: python3-markupsafe-0.23-19.el8.x86_64 2023-08-01T19:53:17.115 INFO:teuthology.orchestra.run.smithi006.stdout: python3-more-itertools-7.2.0-3.el8.noarch 2023-08-01T19:53:17.115 INFO:teuthology.orchestra.run.smithi006.stdout: python3-natsort-7.1.1-2.el8.noarch 2023-08-01T19:53:17.115 INFO:teuthology.orchestra.run.smithi006.stdout: python3-numpy-1:1.14.3-10.el8.x86_64 2023-08-01T19:53:17.115 INFO:teuthology.orchestra.run.smithi006.stdout: python3-numpy-f2py-1:1.14.3-10.el8.x86_64 2023-08-01T19:53:17.115 INFO:teuthology.orchestra.run.smithi006.stdout: python3-oauthlib-2.1.0-1.el8.noarch 2023-08-01T19:53:17.115 INFO:teuthology.orchestra.run.smithi006.stdout: python3-pecan-1.3.2-9.el8.noarch 2023-08-01T19:53:17.115 INFO:teuthology.orchestra.run.smithi006.stdout: python3-portend-2.6-1.el8.noarch 2023-08-01T19:53:17.116 INFO:teuthology.orchestra.run.smithi006.stdout: python3-prettytable-0.7.2-14.el8.noarch 2023-08-01T19:53:17.116 INFO:teuthology.orchestra.run.smithi006.stdout: python3-pyOpenSSL-19.0.0-1.el8.noarch 2023-08-01T19:53:17.116 INFO:teuthology.orchestra.run.smithi006.stdout: python3-pyasn1-0.3.7-6.el8.noarch 2023-08-01T19:53:17.116 INFO:teuthology.orchestra.run.smithi006.stdout: python3-pyasn1-modules-0.3.7-6.el8.noarch 2023-08-01T19:53:17.116 INFO:teuthology.orchestra.run.smithi006.stdout: python3-pycparser-2.14-14.el8.noarch 2023-08-01T19:53:17.116 INFO:teuthology.orchestra.run.smithi006.stdout: python3-pytz-2017.2-9.el8.noarch 2023-08-01T19:53:17.116 INFO:teuthology.orchestra.run.smithi006.stdout: python3-rados-2:17.2.6-823.g893fa35f.el8.x86_64 2023-08-01T19:53:17.116 INFO:teuthology.orchestra.run.smithi006.stdout: python3-rbd-2:17.2.6-823.g893fa35f.el8.x86_64 2023-08-01T19:53:17.117 INFO:teuthology.orchestra.run.smithi006.stdout: python3-repoze-lru-0.7-6.el8.noarch 2023-08-01T19:53:17.117 INFO:teuthology.orchestra.run.smithi006.stdout: python3-requests-oauthlib-1.0.0-1.el8.noarch 2023-08-01T19:53:17.117 INFO:teuthology.orchestra.run.smithi006.stdout: python3-rgw-2:17.2.6-823.g893fa35f.el8.x86_64 2023-08-01T19:53:17.117 INFO:teuthology.orchestra.run.smithi006.stdout: python3-routes-2.4.1-12.el8.noarch 2023-08-01T19:53:17.117 INFO:teuthology.orchestra.run.smithi006.stdout: python3-rsa-4.9-2.el8.noarch 2023-08-01T19:53:17.117 INFO:teuthology.orchestra.run.smithi006.stdout: python3-scipy-1.0.0-21.module_el8.5.0+771+e5d9a225.x86_64 2023-08-01T19:53:17.117 INFO:teuthology.orchestra.run.smithi006.stdout: python3-simplegeneric-0.8.1-17.el8.noarch 2023-08-01T19:53:17.118 INFO:teuthology.orchestra.run.smithi006.stdout: python3-singledispatch-3.4.0.3-18.el8.noarch 2023-08-01T19:53:17.118 INFO:teuthology.orchestra.run.smithi006.stdout: python3-tempora-1.14.1-5.el8.noarch 2023-08-01T19:53:17.118 INFO:teuthology.orchestra.run.smithi006.stdout: python3-trustme-0.6.0-4.el8.noarch 2023-08-01T19:53:17.118 INFO:teuthology.orchestra.run.smithi006.stdout: python3-waitress-1.4.3-1.el8.noarch 2023-08-01T19:53:17.118 INFO:teuthology.orchestra.run.smithi006.stdout: python3-webob-1.8.5-1.el8.1.noarch 2023-08-01T19:53:17.118 INFO:teuthology.orchestra.run.smithi006.stdout: python3-websocket-client-0.56.0-5.el8.noarch 2023-08-01T19:53:17.118 INFO:teuthology.orchestra.run.smithi006.stdout: python3-webtest-2.0.33-1.el8.noarch 2023-08-01T19:53:17.118 INFO:teuthology.orchestra.run.smithi006.stdout: python3-werkzeug-0.12.2-4.el8.noarch 2023-08-01T19:53:17.119 INFO:teuthology.orchestra.run.smithi006.stdout: python3-zc-lockfile-2.0-2.el8.noarch 2023-08-01T19:53:17.119 INFO:teuthology.orchestra.run.smithi006.stdout: rbd-fuse-2:17.2.6-823.g893fa35f.el8.x86_64 2023-08-01T19:53:17.119 INFO:teuthology.orchestra.run.smithi006.stdout: rbd-mirror-2:17.2.6-823.g893fa35f.el8.x86_64 2023-08-01T19:53:17.119 INFO:teuthology.orchestra.run.smithi006.stdout: rbd-nbd-2:17.2.6-823.g893fa35f.el8.x86_64 2023-08-01T19:53:17.119 INFO:teuthology.orchestra.run.smithi006.stdout: socat-1.7.4.1-1.el8.x86_64 2023-08-01T19:53:17.119 INFO:teuthology.orchestra.run.smithi006.stdout: thrift-0.13.0-2.el8.x86_64 2023-08-01T19:53:17.119 INFO:teuthology.orchestra.run.smithi006.stdout: xfsprogs-devel-5.0.0-12.el8.x86_64 2023-08-01T19:53:17.119 INFO:teuthology.orchestra.run.smithi006.stdout: xmlstarlet-1.6.1-20.el8.x86_64 2023-08-01T19:53:17.120 INFO:teuthology.orchestra.run.smithi006.stdout: zlib-devel-1.2.11-21.el8.x86_64 2023-08-01T19:53:17.120 INFO:teuthology.orchestra.run.smithi006.stdout: 2023-08-01T19:53:17.120 INFO:teuthology.orchestra.run.smithi006.stdout:Complete! 2023-08-01T19:53:17.291 DEBUG:teuthology.parallel:result is None 2023-08-01T19:53:17.291 DEBUG:teuthology.packaging:Querying https://shaman.ceph.com/api/search?status=ready&project=ceph&flavor=default&distros=centos%2F8%2Fx86_64&sha1=893fa35fffd26b5b50498e64ff6f7c94584d30b6 2023-08-01T19:53:17.423 DEBUG:teuthology.orchestra.run.smithi006:> rpm -q ceph --qf '%{VERSION}-%{RELEASE}' 2023-08-01T19:53:17.447 INFO:teuthology.orchestra.run.smithi006.stdout:17.2.6-823.g893fa35f.el8 2023-08-01T19:53:17.448 INFO:teuthology.packaging:The installed version of ceph is 17.2.6-823.g893fa35f.el8 2023-08-01T19:53:17.448 INFO:teuthology.task.install:The correct ceph version 17.2.6-823.g893fa35f is installed. 2023-08-01T19:53:17.449 DEBUG:teuthology.packaging:Querying https://shaman.ceph.com/api/search?status=ready&project=ceph&flavor=default&distros=centos%2F8%2Fx86_64&sha1=893fa35fffd26b5b50498e64ff6f7c94584d30b6 2023-08-01T19:53:17.652 DEBUG:teuthology.orchestra.run.smithi008:> rpm -q ceph --qf '%{VERSION}-%{RELEASE}' 2023-08-01T19:53:17.682 INFO:teuthology.orchestra.run.smithi008.stdout:17.2.6-823.g893fa35f.el8 2023-08-01T19:53:17.682 INFO:teuthology.packaging:The installed version of ceph is 17.2.6-823.g893fa35f.el8 2023-08-01T19:53:17.682 INFO:teuthology.task.install:The correct ceph version 17.2.6-823.g893fa35f is installed. 2023-08-01T19:53:17.683 DEBUG:teuthology.packaging:Querying https://shaman.ceph.com/api/search?status=ready&project=ceph&flavor=default&distros=centos%2F8%2Fx86_64&sha1=893fa35fffd26b5b50498e64ff6f7c94584d30b6 2023-08-01T19:53:17.900 DEBUG:teuthology.orchestra.run.smithi101:> rpm -q ceph --qf '%{VERSION}-%{RELEASE}' 2023-08-01T19:53:17.929 INFO:teuthology.orchestra.run.smithi101.stdout:17.2.6-823.g893fa35f.el8 2023-08-01T19:53:17.930 INFO:teuthology.packaging:The installed version of ceph is 17.2.6-823.g893fa35f.el8 2023-08-01T19:53:17.930 INFO:teuthology.task.install:The correct ceph version 17.2.6-823.g893fa35f is installed. 2023-08-01T19:53:17.930 DEBUG:teuthology.packaging:Querying https://shaman.ceph.com/api/search?status=ready&project=ceph&flavor=default&distros=centos%2F8%2Fx86_64&sha1=893fa35fffd26b5b50498e64ff6f7c94584d30b6 2023-08-01T19:53:18.171 DEBUG:teuthology.orchestra.run.smithi155:> rpm -q ceph --qf '%{VERSION}-%{RELEASE}' 2023-08-01T19:53:18.200 INFO:teuthology.orchestra.run.smithi155.stdout:17.2.6-823.g893fa35f.el8 2023-08-01T19:53:18.201 INFO:teuthology.packaging:The installed version of ceph is 17.2.6-823.g893fa35f.el8 2023-08-01T19:53:18.201 INFO:teuthology.task.install:The correct ceph version 17.2.6-823.g893fa35f is installed. 2023-08-01T19:53:18.201 INFO:teuthology.task.install.util:Shipping valgrind.supp... 2023-08-01T19:53:18.202 DEBUG:teuthology.orchestra.run.smithi006:> set -ex 2023-08-01T19:53:18.202 DEBUG:teuthology.orchestra.run.smithi006:> sudo dd of=/home/ubuntu/cephtest/valgrind.supp 2023-08-01T19:53:18.234 DEBUG:teuthology.orchestra.run.smithi008:> set -ex 2023-08-01T19:53:18.235 DEBUG:teuthology.orchestra.run.smithi008:> sudo dd of=/home/ubuntu/cephtest/valgrind.supp 2023-08-01T19:53:18.272 DEBUG:teuthology.orchestra.run.smithi101:> set -ex 2023-08-01T19:53:18.272 DEBUG:teuthology.orchestra.run.smithi101:> sudo dd of=/home/ubuntu/cephtest/valgrind.supp 2023-08-01T19:53:18.308 DEBUG:teuthology.orchestra.run.smithi155:> set -ex 2023-08-01T19:53:18.309 DEBUG:teuthology.orchestra.run.smithi155:> sudo dd of=/home/ubuntu/cephtest/valgrind.supp 2023-08-01T19:53:18.345 INFO:teuthology.task.install.util:Shipping 'daemon-helper'... 2023-08-01T19:53:18.345 DEBUG:teuthology.orchestra.run.smithi006:> set -ex 2023-08-01T19:53:18.345 DEBUG:teuthology.orchestra.run.smithi006:> sudo dd of=/usr/bin/daemon-helper 2023-08-01T19:53:18.373 DEBUG:teuthology.orchestra.run.smithi006:> sudo chmod a=rx -- /usr/bin/daemon-helper 2023-08-01T19:53:18.442 DEBUG:teuthology.orchestra.run.smithi008:> set -ex 2023-08-01T19:53:18.442 DEBUG:teuthology.orchestra.run.smithi008:> sudo dd of=/usr/bin/daemon-helper 2023-08-01T19:53:18.476 DEBUG:teuthology.orchestra.run.smithi008:> sudo chmod a=rx -- /usr/bin/daemon-helper 2023-08-01T19:53:18.549 DEBUG:teuthology.orchestra.run.smithi101:> set -ex 2023-08-01T19:53:18.549 DEBUG:teuthology.orchestra.run.smithi101:> sudo dd of=/usr/bin/daemon-helper 2023-08-01T19:53:18.582 DEBUG:teuthology.orchestra.run.smithi101:> sudo chmod a=rx -- /usr/bin/daemon-helper 2023-08-01T19:53:18.653 DEBUG:teuthology.orchestra.run.smithi155:> set -ex 2023-08-01T19:53:18.653 DEBUG:teuthology.orchestra.run.smithi155:> sudo dd of=/usr/bin/daemon-helper 2023-08-01T19:53:18.686 DEBUG:teuthology.orchestra.run.smithi155:> sudo chmod a=rx -- /usr/bin/daemon-helper 2023-08-01T19:53:18.757 INFO:teuthology.task.install.util:Shipping 'adjust-ulimits'... 2023-08-01T19:53:18.758 DEBUG:teuthology.orchestra.run.smithi006:> set -ex 2023-08-01T19:53:18.758 DEBUG:teuthology.orchestra.run.smithi006:> sudo dd of=/usr/bin/adjust-ulimits 2023-08-01T19:53:18.786 DEBUG:teuthology.orchestra.run.smithi006:> sudo chmod a=rx -- /usr/bin/adjust-ulimits 2023-08-01T19:53:18.855 DEBUG:teuthology.orchestra.run.smithi008:> set -ex 2023-08-01T19:53:18.855 DEBUG:teuthology.orchestra.run.smithi008:> sudo dd of=/usr/bin/adjust-ulimits 2023-08-01T19:53:18.889 DEBUG:teuthology.orchestra.run.smithi008:> sudo chmod a=rx -- /usr/bin/adjust-ulimits 2023-08-01T19:53:18.961 DEBUG:teuthology.orchestra.run.smithi101:> set -ex 2023-08-01T19:53:18.962 DEBUG:teuthology.orchestra.run.smithi101:> sudo dd of=/usr/bin/adjust-ulimits 2023-08-01T19:53:18.993 DEBUG:teuthology.orchestra.run.smithi101:> sudo chmod a=rx -- /usr/bin/adjust-ulimits 2023-08-01T19:53:19.064 DEBUG:teuthology.orchestra.run.smithi155:> set -ex 2023-08-01T19:53:19.064 DEBUG:teuthology.orchestra.run.smithi155:> sudo dd of=/usr/bin/adjust-ulimits 2023-08-01T19:53:19.096 DEBUG:teuthology.orchestra.run.smithi155:> sudo chmod a=rx -- /usr/bin/adjust-ulimits 2023-08-01T19:53:19.167 INFO:teuthology.task.install.util:Shipping 'stdin-killer'... 2023-08-01T19:53:19.167 DEBUG:teuthology.orchestra.run.smithi006:> set -ex 2023-08-01T19:53:19.167 DEBUG:teuthology.orchestra.run.smithi006:> sudo dd of=/usr/bin/stdin-killer 2023-08-01T19:53:19.196 DEBUG:teuthology.orchestra.run.smithi006:> sudo chmod a=rx -- /usr/bin/stdin-killer 2023-08-01T19:53:19.266 DEBUG:teuthology.orchestra.run.smithi008:> set -ex 2023-08-01T19:53:19.266 DEBUG:teuthology.orchestra.run.smithi008:> sudo dd of=/usr/bin/stdin-killer 2023-08-01T19:53:19.299 DEBUG:teuthology.orchestra.run.smithi008:> sudo chmod a=rx -- /usr/bin/stdin-killer 2023-08-01T19:53:19.372 DEBUG:teuthology.orchestra.run.smithi101:> set -ex 2023-08-01T19:53:19.372 DEBUG:teuthology.orchestra.run.smithi101:> sudo dd of=/usr/bin/stdin-killer 2023-08-01T19:53:19.404 DEBUG:teuthology.orchestra.run.smithi101:> sudo chmod a=rx -- /usr/bin/stdin-killer 2023-08-01T19:53:19.474 DEBUG:teuthology.orchestra.run.smithi155:> set -ex 2023-08-01T19:53:19.474 DEBUG:teuthology.orchestra.run.smithi155:> sudo dd of=/usr/bin/stdin-killer 2023-08-01T19:53:19.507 DEBUG:teuthology.orchestra.run.smithi155:> sudo chmod a=rx -- /usr/bin/stdin-killer 2023-08-01T19:53:19.580 INFO:teuthology.run_tasks:Running task ceph... 2023-08-01T19:53:19.646 INFO:tasks.ceph:Making ceph log dir writeable by non-root... 2023-08-01T19:53:19.646 DEBUG:teuthology.orchestra.run.smithi006:> sudo chmod 777 /var/log/ceph 2023-08-01T19:53:19.649 DEBUG:teuthology.orchestra.run.smithi008:> sudo chmod 777 /var/log/ceph 2023-08-01T19:53:19.652 DEBUG:teuthology.orchestra.run.smithi101:> sudo chmod 777 /var/log/ceph 2023-08-01T19:53:19.654 DEBUG:teuthology.orchestra.run.smithi155:> sudo chmod 777 /var/log/ceph 2023-08-01T19:53:19.685 INFO:tasks.ceph:Disabling ceph logrotate... 2023-08-01T19:53:19.686 DEBUG:teuthology.orchestra.run.smithi006:> sudo rm -f -- /etc/logrotate.d/ceph 2023-08-01T19:53:19.720 DEBUG:teuthology.orchestra.run.smithi008:> sudo rm -f -- /etc/logrotate.d/ceph 2023-08-01T19:53:19.725 DEBUG:teuthology.orchestra.run.smithi101:> sudo rm -f -- /etc/logrotate.d/ceph 2023-08-01T19:53:19.726 DEBUG:teuthology.orchestra.run.smithi155:> sudo rm -f -- /etc/logrotate.d/ceph 2023-08-01T19:53:19.757 INFO:tasks.ceph:Creating extra log directories... 2023-08-01T19:53:19.758 DEBUG:teuthology.orchestra.run.smithi006:> sudo install -d -m0777 -- /var/log/ceph/valgrind /var/log/ceph/profiling-logger 2023-08-01T19:53:19.790 DEBUG:teuthology.orchestra.run.smithi008:> sudo install -d -m0777 -- /var/log/ceph/valgrind /var/log/ceph/profiling-logger 2023-08-01T19:53:19.797 DEBUG:teuthology.orchestra.run.smithi101:> sudo install -d -m0777 -- /var/log/ceph/valgrind /var/log/ceph/profiling-logger 2023-08-01T19:53:19.799 DEBUG:teuthology.orchestra.run.smithi155:> sudo install -d -m0777 -- /var/log/ceph/valgrind /var/log/ceph/profiling-logger 2023-08-01T19:53:19.839 INFO:tasks.ceph:Creating ceph cluster ceph... 2023-08-01T19:53:19.840 INFO:tasks.ceph:config {'conf': {'client.0': {'admin socket': '/var/run/ceph/ceph-$name.asok'}, 'mgr': {'debug mgr': 20, 'debug ms': 1}, 'mon': {'debug mon': 20, 'debug ms': 1, 'debug paxos': 20}, 'osd': {'bluestore block size': 96636764160, 'bluestore compression algorithm': 'lz4', 'bluestore compression mode': 'aggressive', 'bluestore fsck on mount': True, 'debug bluefs': '1/20', 'debug bluestore': '1/20', 'debug ms': 1, 'debug osd': 20, 'debug rocksdb': '4/10', 'mon osd backfillfull_ratio': 0.85, 'mon osd full ratio': 0.9, 'mon osd nearfull ratio': 0.8, 'osd failsafe full ratio': 0.95, 'osd max markdown count': 1000, 'osd objectstore': 'bluestore'}}, 'fs': 'xfs', 'mkfs_options': None, 'mount_options': None, 'skip_mgr_daemons': False, 'log_ignorelist': ['\\(MDS_ALL_DOWN\\)', '\\(MDS_UP_LESS_THAN_MAX\\)', '\\(MDS_TRIM\\)', '\\(MDS_SLOW_REQUEST\\)', 'MDS_SLOW_METADATA_IO', 'Behind on trimming', 'overall HEALTH_', '\\(OSDMAP_FLAGS\\)', '\\(OSD_', '\\(PG_', '\\(POOL_', '\\(CACHE_POOL_', '\\(SMALLER_PGP_NUM\\)', '\\(OBJECT_', '\\(SLOW_OPS\\)', '\\(REQUEST_SLOW\\)', '\\(TOO_FEW_PGS\\)', 'slow request'], 'cpu_profile': set(), 'cluster': 'ceph', 'mon_bind_msgr2': True, 'mon_bind_addrvec': True} 2023-08-01T19:53:19.840 INFO:tasks.ceph:ctx.config {'archive_path': '/home/teuthworker/archive/yuriw-2023-08-01_19:18:05-powercycle-quincy-distro-default-smithi/7358036', 'branch': 'quincy', 'description': 'powercycle/osd/{clusters/3osd-1per-target ignorelist_health objectstore/bluestore-comp-lz4 powercycle/default supported-all-distro/centos_8 tasks/admin_socket_objecter_requests thrashosds-health}', 'email': 'yweinste@redhat.com', 'first_in_suite': False, 'job_id': '7358036', 'kernel': {'kdb': True, 'sha1': 'distro'}, 'last_in_suite': False, 'machine_type': 'smithi', 'name': 'yuriw-2023-08-01_19:18:05-powercycle-quincy-distro-default-smithi', 'no_nested_subset': False, 'nuke-on-error': True, 'os_type': 'centos', 'os_version': '8.stream', 'overrides': {'admin_socket': {'branch': 'quincy'}, 'ceph': {'conf': {'client.0': {'admin socket': '/var/run/ceph/ceph-$name.asok'}, 'mgr': {'debug mgr': 20, 'debug ms': 1}, 'mon': {'debug mon': 20, 'debug ms': 1, 'debug paxos': 20}, 'osd': {'bluestore block size': 96636764160, 'bluestore compression algorithm': 'lz4', 'bluestore compression mode': 'aggressive', 'bluestore fsck on mount': True, 'debug bluefs': '1/20', 'debug bluestore': '1/20', 'debug ms': 1, 'debug osd': 20, 'debug rocksdb': '4/10', 'mon osd backfillfull_ratio': 0.85, 'mon osd full ratio': 0.9, 'mon osd nearfull ratio': 0.8, 'osd failsafe full ratio': 0.95, 'osd max markdown count': 1000, 'osd objectstore': 'bluestore'}}, 'flavor': 'default', 'fs': 'xfs', 'log-ignorelist': ['\\(MDS_ALL_DOWN\\)', '\\(MDS_UP_LESS_THAN_MAX\\)', '\\(MDS_TRIM\\)', '\\(MDS_SLOW_REQUEST\\)', 'MDS_SLOW_METADATA_IO', 'Behind on trimming', 'overall HEALTH_', '\\(OSDMAP_FLAGS\\)', '\\(OSD_', '\\(PG_', '\\(POOL_', '\\(CACHE_POOL_', '\\(SMALLER_PGP_NUM\\)', '\\(OBJECT_', '\\(SLOW_OPS\\)', '\\(REQUEST_SLOW\\)', '\\(TOO_FEW_PGS\\)', 'slow request'], 'sha1': '893fa35fffd26b5b50498e64ff6f7c94584d30b6'}, 'ceph-deploy': {'conf': {'client': {'log file': '/var/log/ceph/ceph-$name.$pid.log'}, 'mon': {'osd default pool size': 2}}}, 'install': {'ceph': {'flavor': 'default', 'sha1': '893fa35fffd26b5b50498e64ff6f7c94584d30b6'}}, 'selinux': {'whitelist': ['scontext=system_u:system_r:logrotate_t:s0']}, 'thrashosds': {'bdev_inject_crash': 2, 'bdev_inject_crash_probability': 0.5}, 'workunit': {'branch': 'quincy', 'sha1': 'a185a2e2933b21246ce41dd13f03fd6f8f84f03d'}}, 'owner': 'scheduled_yuriw@teuthology', 'priority': 75, 'repo': 'https://github.com/ceph/ceph.git', 'roles': [['mon.a', 'mon.b', 'mon.c', 'mgr.x', 'mgr.y', 'mds.a', 'client.0'], ['osd.0'], ['osd.1'], ['osd.2']], 'seed': 4358, 'sha1': '893fa35fffd26b5b50498e64ff6f7c94584d30b6', 'sleep_before_teardown': 0, 'subset': '111/120000', 'suite': 'powercycle', 'suite_branch': 'quincy', 'suite_path': '/home/teuthworker/src/github.com_ceph_ceph_a185a2e2933b21246ce41dd13f03fd6f8f84f03d/qa', 'suite_relpath': 'qa', 'suite_repo': 'https://github.com/ceph/ceph.git', 'suite_sha1': 'a185a2e2933b21246ce41dd13f03fd6f8f84f03d', 'targets': {'smithi006.front.sepia.ceph.com': 'ssh-rsa AAAAB3NzaC1yc2EAAAADAQABAAABgQDHXsUNSlFLCzrtJm9UBoT8HA73bfB6pGWdupX8X3arUQObxAXBe9ZAFl4qAyQfUtKOl4Y4ewbQf0lQuzkxdmcFo9ssrFlpCneVtJRyO7Y7CFXUltf6V0mo4jUs9uQFtNQrKwHHd2d7v0IKV1tEXH5dbro66f3oVQzrZn7ogixBzTETd4+O70KhSO+iYRV8U31SCcWz69eao/JFNPo6V+16a4NfX4As0H7pf17QwrJ5+sBYp3DnJogBafJDx/MQiDW88Nvf42zPoFUzzZPgHFMonPvGIdP1z1VNn/rfjLj7H7qpKswngimYx4IVMLgE7xX16D7bhSxGzQ6vQrQJrIZNDiWXevziPZ+iRPAQUVp2IQS1LDrvwLqVQFugVUpCgRM8oURL9+Zg/3yNVgy8skDE3qxjqgSE6Sgi6N6/5AoZYdhukFuXLYq1M1EBMxr8CQtWzFkqZzD2NeYS1Hcjom7Gtt3foDenTaRskDWCXpNJtUVsv3VL/SrXjPfRM3xHVkc=', 'smithi008.front.sepia.ceph.com': 'ssh-rsa AAAAB3NzaC1yc2EAAAADAQABAAABgQCpo1p1nkE5ovTqi960kuPvHnSVRMnkWXjOEFJRzWlwXqBbxdMjXpPpEkoH4KlErsqOIi0+3n5DG6I4JHOCeTpoKYJGv2ZlQava6mOn41ASUGhuB4NRIHJ5Qcc7hHfsSJH9Z0wuk1ZKRwoOkGKEriKFAZROjbq3khcaUObbDnz7qHFmG0BvFmQtjald6/ZFuown6frkSQ6BBgsGeMuUUYJbGBAmfXInmzClVeQrtuNd7WweNRmmM35NTjFzx1FVbZhcSq9acSjVyCeUgN2lmKE6H3isfsYA0eewNV3vs6IikHKghwEuCZ5o1G2vHEw/K3Jyd3GBqQ7oaSWdL7TN9oK3QSx2LdZCO8KHzlU72XkGLLkEfouNuEmeYTqcx602NGzyx4DBCCGYqkeCaW9P61GhtzoCgCiqcC0F7zpfn0t4n07nMU9Wb7EYufTBEUAi+d7y8LBzozsdnjBocq5jlI2VWRvF8kCKNseV0wJyTqPHnZmr8IdI1n8FhpDk9dMyLMc=', 'smithi101.front.sepia.ceph.com': 'ssh-rsa AAAAB3NzaC1yc2EAAAADAQABAAABgQCqW1iyMvH01tgtwD2szts39NPYi3uTQWbKn9EWrYpK56zPLD/rE/SqQ125QXt/7HaO6hYaMio0skMpiD71gOEZ90SGmzTzwKnhW0maieFRDKECZswRY/HvXPB7SZZAU/DCv++WDnUbzoweiiVktY5taGp5iQwbyxcYzGQmjprf4X6JMsE/wnAPdqC/DmEzlULLPmjfs28QVGGBeBD8gq/NNHczjTG6ct9m1Qz4Bde8fZezYxzCZ1dxO+No8djYcnjr98uxNjvmlq5oKYAU1a3Unki5jy3dGEcaOWgDJA+d/wu7FzcNyXsarpmpSz36PLOzFQbNVzOENcGRSJi6QTCk5Psa7NUbC1L01wsGgrCKqp0z76JExnBCckHKx9MkCGwKz1IEsXJftHe/jqkJeFZelXzaWG3BTEyp+VhbgjodUpn/9A1GK02WTDj3plAZ35+vOkvEsd40/YGSG72jpLjX1sk/aZmth6z8ohXunB0jMLz9spVMcUet/JSR/ZEvu5c=', 'smithi155.front.sepia.ceph.com': 'ssh-rsa AAAAB3NzaC1yc2EAAAADAQABAAABgQCuAqZ8xTboGrlX0Kh6ppzDfuvpjc5Ks+U6GpzzgfCJR55lEeqhy0U867PiGPRAEK868GP+fqDfgPuesLrQdjRDG2GWCAeHMTE3fCbsguHJHdproyBmS5SmCuN8M9FN014OgIdHv7zbouqawTS1n2LHLN/A6cVp7TKB9bmgNPjzYrEMKes+p2x0oH/xAKUbkEmH2tfaj1kABVQvxVnBkW6383s2VpQybCLR5pBZmFXIRbw2TDxclB/Ds/ZEL7nFhzSLkiuW6Uv8MrswEZUy7T+GIYI2hKQQNkpRKj8JQ+apMtXu4AKOyGO1pAOfnrgzCHyHww6bVdk4kBs//xmWFtftLBCmalMdYkil/pu475tB3J5m8Br+1WusGxm1m/ClFqTB0pDKWTBXUyP/QhH4FTqc5aDxB7Qdh9P39i0Ig/fgO7AfUk9dPyMk6FqGz5ijea3waXnwmUpnTVcwbIi5HLcPUSITtYcEWgAgd9Ero7Gs1S5OYtQpENC9fVIgu+gesO0='}, 'tasks': [{'internal.check_packages': None}, {'internal.buildpackages_prep': None}, {'internal.save_config': None}, {'internal.check_lock': None}, {'internal.add_remotes': None}, {'console_log': None}, {'internal.connect': None}, {'internal.push_inventory': None}, {'internal.serialize_remote_roles': None}, {'internal.check_conflict': None}, {'internal.check_ceph_data': None}, {'internal.vm_setup': None}, {'kernel': {'kdb': True, 'sha1': 'distro'}}, {'internal.base': None}, {'internal.archive_upload': None}, {'internal.archive': None}, {'internal.coredump': None}, {'internal.sudo': None}, {'internal.syslog': None}, {'internal.timer': None}, {'pcp': None}, {'selinux': None}, {'ansible.cephlab': None}, {'clock': None}, {'install': {'extra_system_packages': {'deb': ['bison', 'flex', 'libelf-dev', 'libssl-dev', 'libaio-dev', 'libtool-bin', 'uuid-dev', 'xfslibs-dev'], 'rpm': ['bison', 'flex', 'elfutils-libelf-devel', 'openssl-devel', 'libaio-devel', 'libtool', 'libuuid-devel', 'xfsprogs-devel']}, 'flavor': 'default', 'sha1': '893fa35fffd26b5b50498e64ff6f7c94584d30b6'}}, {'ceph': None}, {'thrashosds': {'chance_down': 1.0, 'powercycle': True, 'timeout': 600}}, {'radosbench': {'clients': ['client.0'], 'time': 60}}, {'admin_socket': {'client.0': {'objecter_requests': {'test': 'http://git.ceph.com/?p={repo};a=blob_plain;f=src/test/admin_socket/objecter_requests;hb={branch}'}}}}], 'teuthology': {'fragments_dropped': [], 'meta': {}, 'postmerge': []}, 'teuthology_branch': 'main', 'teuthology_sha1': '10753fdddd8d487ef9ffba05c09f1a055cd67877', 'timestamp': '2023-08-01_19:18:05', 'tube': 'smithi', 'user': 'yuriw', 'verbose': True, 'worker_log': '/home/teuthworker/archive/worker_logs/dispatcher.smithi.2021'} 2023-08-01T19:53:19.841 DEBUG:teuthology.orchestra.run.smithi006:> install -d -m0755 -- /home/ubuntu/cephtest/ceph.data 2023-08-01T19:53:19.861 DEBUG:teuthology.orchestra.run.smithi008:> install -d -m0755 -- /home/ubuntu/cephtest/ceph.data 2023-08-01T19:53:19.867 DEBUG:teuthology.orchestra.run.smithi101:> install -d -m0755 -- /home/ubuntu/cephtest/ceph.data 2023-08-01T19:53:19.870 DEBUG:teuthology.orchestra.run.smithi155:> install -d -m0755 -- /home/ubuntu/cephtest/ceph.data 2023-08-01T19:53:19.889 DEBUG:teuthology.orchestra.run.smithi006:> sudo install -d -m0777 -- /var/run/ceph 2023-08-01T19:53:19.921 DEBUG:teuthology.orchestra.run.smithi008:> sudo install -d -m0777 -- /var/run/ceph 2023-08-01T19:53:19.927 DEBUG:teuthology.orchestra.run.smithi101:> sudo install -d -m0777 -- /var/run/ceph 2023-08-01T19:53:19.929 DEBUG:teuthology.orchestra.run.smithi155:> sudo install -d -m0777 -- /var/run/ceph 2023-08-01T19:53:19.959 DEBUG:teuthology.orchestra.run.smithi008:> set -ex 2023-08-01T19:53:19.959 DEBUG:teuthology.orchestra.run.smithi008:> dd if=/scratch_devs of=/dev/stdout 2023-08-01T19:53:20.014 DEBUG:teuthology.misc:devs=['/dev/vg_nvme/lv_1', '/dev/vg_nvme/lv_2', '/dev/vg_nvme/lv_3', '/dev/vg_nvme/lv_4'] 2023-08-01T19:53:20.014 DEBUG:teuthology.orchestra.run.smithi008:> stat /dev/vg_nvme/lv_1 2023-08-01T19:53:20.072 INFO:teuthology.orchestra.run.smithi008.stdout: File: /dev/vg_nvme/lv_1 -> ../dm-0 2023-08-01T19:53:20.073 INFO:teuthology.orchestra.run.smithi008.stdout: Size: 7 Blocks: 0 IO Block: 4096 symbolic link 2023-08-01T19:53:20.073 INFO:teuthology.orchestra.run.smithi008.stdout:Device: 6h/6d Inode: 387529 Links: 1 2023-08-01T19:53:20.073 INFO:teuthology.orchestra.run.smithi008.stdout:Access: (0777/lrwxrwxrwx) Uid: ( 0/ root) Gid: ( 0/ root) 2023-08-01T19:53:20.073 INFO:teuthology.orchestra.run.smithi008.stdout:Context: system_u:object_r:device_t:s0 2023-08-01T19:53:20.073 INFO:teuthology.orchestra.run.smithi008.stdout:Access: 2023-08-01 19:53:02.150217849 +0000 2023-08-01T19:53:20.073 INFO:teuthology.orchestra.run.smithi008.stdout:Modify: 2023-08-01 19:49:43.842482284 +0000 2023-08-01T19:53:20.073 INFO:teuthology.orchestra.run.smithi008.stdout:Change: 2023-08-01 19:49:43.842482284 +0000 2023-08-01T19:53:20.074 INFO:teuthology.orchestra.run.smithi008.stdout: Birth: - 2023-08-01T19:53:20.074 DEBUG:teuthology.orchestra.run.smithi008:> sudo dd if=/dev/vg_nvme/lv_1 of=/dev/null count=1 2023-08-01T19:53:20.139 INFO:teuthology.orchestra.run.smithi008.stderr:1+0 records in 2023-08-01T19:53:20.140 INFO:teuthology.orchestra.run.smithi008.stderr:1+0 records out 2023-08-01T19:53:20.140 INFO:teuthology.orchestra.run.smithi008.stderr:512 bytes copied, 9.439e-05 s, 5.4 MB/s 2023-08-01T19:53:20.141 DEBUG:teuthology.orchestra.run.smithi008:> ! mount | grep -v devtmpfs | grep -q /dev/vg_nvme/lv_1 2023-08-01T19:53:20.201 DEBUG:teuthology.orchestra.run.smithi008:> stat /dev/vg_nvme/lv_2 2023-08-01T19:53:20.259 INFO:teuthology.orchestra.run.smithi008.stdout: File: /dev/vg_nvme/lv_2 -> ../dm-1 2023-08-01T19:53:20.260 INFO:teuthology.orchestra.run.smithi008.stdout: Size: 7 Blocks: 0 IO Block: 4096 symbolic link 2023-08-01T19:53:20.260 INFO:teuthology.orchestra.run.smithi008.stdout:Device: 6h/6d Inode: 381637 Links: 1 2023-08-01T19:53:20.260 INFO:teuthology.orchestra.run.smithi008.stdout:Access: (0777/lrwxrwxrwx) Uid: ( 0/ root) Gid: ( 0/ root) 2023-08-01T19:53:20.260 INFO:teuthology.orchestra.run.smithi008.stdout:Context: system_u:object_r:device_t:s0 2023-08-01T19:53:20.260 INFO:teuthology.orchestra.run.smithi008.stdout:Access: 2023-08-01 19:53:02.150217849 +0000 2023-08-01T19:53:20.260 INFO:teuthology.orchestra.run.smithi008.stdout:Modify: 2023-08-01 19:49:44.368477326 +0000 2023-08-01T19:53:20.261 INFO:teuthology.orchestra.run.smithi008.stdout:Change: 2023-08-01 19:49:44.368477326 +0000 2023-08-01T19:53:20.261 INFO:teuthology.orchestra.run.smithi008.stdout: Birth: - 2023-08-01T19:53:20.261 DEBUG:teuthology.orchestra.run.smithi008:> sudo dd if=/dev/vg_nvme/lv_2 of=/dev/null count=1 2023-08-01T19:53:20.327 INFO:teuthology.orchestra.run.smithi008.stderr:1+0 records in 2023-08-01T19:53:20.327 INFO:teuthology.orchestra.run.smithi008.stderr:1+0 records out 2023-08-01T19:53:20.328 INFO:teuthology.orchestra.run.smithi008.stderr:512 bytes copied, 8.5291e-05 s, 6.0 MB/s 2023-08-01T19:53:20.328 DEBUG:teuthology.orchestra.run.smithi008:> ! mount | grep -v devtmpfs | grep -q /dev/vg_nvme/lv_2 2023-08-01T19:53:20.389 DEBUG:teuthology.orchestra.run.smithi008:> stat /dev/vg_nvme/lv_3 2023-08-01T19:53:20.448 INFO:teuthology.orchestra.run.smithi008.stdout: File: /dev/vg_nvme/lv_3 -> ../dm-2 2023-08-01T19:53:20.448 INFO:teuthology.orchestra.run.smithi008.stdout: Size: 7 Blocks: 0 IO Block: 4096 symbolic link 2023-08-01T19:53:20.448 INFO:teuthology.orchestra.run.smithi008.stdout:Device: 6h/6d Inode: 382651 Links: 1 2023-08-01T19:53:20.449 INFO:teuthology.orchestra.run.smithi008.stdout:Access: (0777/lrwxrwxrwx) Uid: ( 0/ root) Gid: ( 0/ root) 2023-08-01T19:53:20.449 INFO:teuthology.orchestra.run.smithi008.stdout:Context: system_u:object_r:device_t:s0 2023-08-01T19:53:20.449 INFO:teuthology.orchestra.run.smithi008.stdout:Access: 2023-08-01 19:53:02.150217849 +0000 2023-08-01T19:53:20.449 INFO:teuthology.orchestra.run.smithi008.stdout:Modify: 2023-08-01 19:49:44.919472134 +0000 2023-08-01T19:53:20.449 INFO:teuthology.orchestra.run.smithi008.stdout:Change: 2023-08-01 19:49:44.919472134 +0000 2023-08-01T19:53:20.449 INFO:teuthology.orchestra.run.smithi008.stdout: Birth: - 2023-08-01T19:53:20.450 DEBUG:teuthology.orchestra.run.smithi008:> sudo dd if=/dev/vg_nvme/lv_3 of=/dev/null count=1 2023-08-01T19:53:20.515 INFO:teuthology.orchestra.run.smithi008.stderr:1+0 records in 2023-08-01T19:53:20.515 INFO:teuthology.orchestra.run.smithi008.stderr:1+0 records out 2023-08-01T19:53:20.515 INFO:teuthology.orchestra.run.smithi008.stderr:512 bytes copied, 8.7765e-05 s, 5.8 MB/s 2023-08-01T19:53:20.516 DEBUG:teuthology.orchestra.run.smithi008:> ! mount | grep -v devtmpfs | grep -q /dev/vg_nvme/lv_3 2023-08-01T19:53:20.574 DEBUG:teuthology.orchestra.run.smithi008:> stat /dev/vg_nvme/lv_4 2023-08-01T19:53:20.632 INFO:teuthology.orchestra.run.smithi008.stdout: File: /dev/vg_nvme/lv_4 -> ../dm-3 2023-08-01T19:53:20.633 INFO:teuthology.orchestra.run.smithi008.stdout: Size: 7 Blocks: 0 IO Block: 4096 symbolic link 2023-08-01T19:53:20.633 INFO:teuthology.orchestra.run.smithi008.stdout:Device: 6h/6d Inode: 388044 Links: 1 2023-08-01T19:53:20.633 INFO:teuthology.orchestra.run.smithi008.stdout:Access: (0777/lrwxrwxrwx) Uid: ( 0/ root) Gid: ( 0/ root) 2023-08-01T19:53:20.633 INFO:teuthology.orchestra.run.smithi008.stdout:Context: system_u:object_r:device_t:s0 2023-08-01T19:53:20.633 INFO:teuthology.orchestra.run.smithi008.stdout:Access: 2023-08-01 19:53:02.150217849 +0000 2023-08-01T19:53:20.634 INFO:teuthology.orchestra.run.smithi008.stdout:Modify: 2023-08-01 19:49:45.464466997 +0000 2023-08-01T19:53:20.634 INFO:teuthology.orchestra.run.smithi008.stdout:Change: 2023-08-01 19:49:45.464466997 +0000 2023-08-01T19:53:20.634 INFO:teuthology.orchestra.run.smithi008.stdout: Birth: - 2023-08-01T19:53:20.634 DEBUG:teuthology.orchestra.run.smithi008:> sudo dd if=/dev/vg_nvme/lv_4 of=/dev/null count=1 2023-08-01T19:53:20.699 INFO:teuthology.orchestra.run.smithi008.stderr:1+0 records in 2023-08-01T19:53:20.700 INFO:teuthology.orchestra.run.smithi008.stderr:1+0 records out 2023-08-01T19:53:20.700 INFO:teuthology.orchestra.run.smithi008.stderr:512 bytes copied, 9.7331e-05 s, 5.3 MB/s 2023-08-01T19:53:20.700 DEBUG:teuthology.orchestra.run.smithi008:> ! mount | grep -v devtmpfs | grep -q /dev/vg_nvme/lv_4 2023-08-01T19:53:20.759 INFO:tasks.ceph:osd dev map: {'osd.0': '/dev/vg_nvme/lv_1'} 2023-08-01T19:53:20.760 DEBUG:teuthology.orchestra.run.smithi101:> set -ex 2023-08-01T19:53:20.760 DEBUG:teuthology.orchestra.run.smithi101:> dd if=/scratch_devs of=/dev/stdout 2023-08-01T19:53:20.781 DEBUG:teuthology.misc:devs=['/dev/vg_nvme/lv_1', '/dev/vg_nvme/lv_2', '/dev/vg_nvme/lv_3', '/dev/vg_nvme/lv_4'] 2023-08-01T19:53:20.782 DEBUG:teuthology.orchestra.run.smithi101:> stat /dev/vg_nvme/lv_1 2023-08-01T19:53:20.842 INFO:teuthology.orchestra.run.smithi101.stdout: File: /dev/vg_nvme/lv_1 -> ../dm-0 2023-08-01T19:53:20.843 INFO:teuthology.orchestra.run.smithi101.stdout: Size: 7 Blocks: 0 IO Block: 4096 symbolic link 2023-08-01T19:53:20.843 INFO:teuthology.orchestra.run.smithi101.stdout:Device: 6h/6d Inode: 387439 Links: 1 2023-08-01T19:53:20.843 INFO:teuthology.orchestra.run.smithi101.stdout:Access: (0777/lrwxrwxrwx) Uid: ( 0/ root) Gid: ( 0/ root) 2023-08-01T19:53:20.843 INFO:teuthology.orchestra.run.smithi101.stdout:Context: system_u:object_r:device_t:s0 2023-08-01T19:53:20.843 INFO:teuthology.orchestra.run.smithi101.stdout:Access: 2023-08-01 19:52:46.577695178 +0000 2023-08-01T19:53:20.843 INFO:teuthology.orchestra.run.smithi101.stdout:Modify: 2023-08-01 19:49:33.527670214 +0000 2023-08-01T19:53:20.844 INFO:teuthology.orchestra.run.smithi101.stdout:Change: 2023-08-01 19:49:33.527670214 +0000 2023-08-01T19:53:20.844 INFO:teuthology.orchestra.run.smithi101.stdout: Birth: - 2023-08-01T19:53:20.844 DEBUG:teuthology.orchestra.run.smithi101:> sudo dd if=/dev/vg_nvme/lv_1 of=/dev/null count=1 2023-08-01T19:53:20.913 INFO:teuthology.orchestra.run.smithi101.stderr:1+0 records in 2023-08-01T19:53:20.914 INFO:teuthology.orchestra.run.smithi101.stderr:1+0 records out 2023-08-01T19:53:20.914 INFO:teuthology.orchestra.run.smithi101.stderr:512 bytes copied, 0.000250054 s, 2.0 MB/s 2023-08-01T19:53:20.915 DEBUG:teuthology.orchestra.run.smithi101:> ! mount | grep -v devtmpfs | grep -q /dev/vg_nvme/lv_1 2023-08-01T19:53:20.976 DEBUG:teuthology.orchestra.run.smithi101:> stat /dev/vg_nvme/lv_2 2023-08-01T19:53:21.037 INFO:teuthology.orchestra.run.smithi101.stdout: File: /dev/vg_nvme/lv_2 -> ../dm-1 2023-08-01T19:53:21.038 INFO:teuthology.orchestra.run.smithi101.stdout: Size: 7 Blocks: 0 IO Block: 4096 symbolic link 2023-08-01T19:53:21.038 INFO:teuthology.orchestra.run.smithi101.stdout:Device: 6h/6d Inode: 389145 Links: 1 2023-08-01T19:53:21.038 INFO:teuthology.orchestra.run.smithi101.stdout:Access: (0777/lrwxrwxrwx) Uid: ( 0/ root) Gid: ( 0/ root) 2023-08-01T19:53:21.038 INFO:teuthology.orchestra.run.smithi101.stdout:Context: system_u:object_r:device_t:s0 2023-08-01T19:53:21.038 INFO:teuthology.orchestra.run.smithi101.stdout:Access: 2023-08-01 19:52:46.577695178 +0000 2023-08-01T19:53:21.038 INFO:teuthology.orchestra.run.smithi101.stdout:Modify: 2023-08-01 19:49:34.213655621 +0000 2023-08-01T19:53:21.038 INFO:teuthology.orchestra.run.smithi101.stdout:Change: 2023-08-01 19:49:34.213655621 +0000 2023-08-01T19:53:21.039 INFO:teuthology.orchestra.run.smithi101.stdout: Birth: - 2023-08-01T19:53:21.039 DEBUG:teuthology.orchestra.run.smithi101:> sudo dd if=/dev/vg_nvme/lv_2 of=/dev/null count=1 2023-08-01T19:53:21.106 INFO:teuthology.orchestra.run.smithi101.stderr:1+0 records in 2023-08-01T19:53:21.107 INFO:teuthology.orchestra.run.smithi101.stderr:1+0 records out 2023-08-01T19:53:21.107 INFO:teuthology.orchestra.run.smithi101.stderr:512 bytes copied, 0.000231609 s, 2.2 MB/s 2023-08-01T19:53:21.108 DEBUG:teuthology.orchestra.run.smithi101:> ! mount | grep -v devtmpfs | grep -q /dev/vg_nvme/lv_2 2023-08-01T19:53:21.167 DEBUG:teuthology.orchestra.run.smithi101:> stat /dev/vg_nvme/lv_3 2023-08-01T19:53:21.227 INFO:teuthology.orchestra.run.smithi101.stdout: File: /dev/vg_nvme/lv_3 -> ../dm-2 2023-08-01T19:53:21.227 INFO:teuthology.orchestra.run.smithi101.stdout: Size: 7 Blocks: 0 IO Block: 4096 symbolic link 2023-08-01T19:53:21.227 INFO:teuthology.orchestra.run.smithi101.stdout:Device: 6h/6d Inode: 379493 Links: 1 2023-08-01T19:53:21.227 INFO:teuthology.orchestra.run.smithi101.stdout:Access: (0777/lrwxrwxrwx) Uid: ( 0/ root) Gid: ( 0/ root) 2023-08-01T19:53:21.228 INFO:teuthology.orchestra.run.smithi101.stdout:Context: system_u:object_r:device_t:s0 2023-08-01T19:53:21.228 INFO:teuthology.orchestra.run.smithi101.stdout:Access: 2023-08-01 19:52:46.577695178 +0000 2023-08-01T19:53:21.228 INFO:teuthology.orchestra.run.smithi101.stdout:Modify: 2023-08-01 19:49:34.729644643 +0000 2023-08-01T19:53:21.229 INFO:teuthology.orchestra.run.smithi101.stdout:Change: 2023-08-01 19:49:34.729644643 +0000 2023-08-01T19:53:21.229 INFO:teuthology.orchestra.run.smithi101.stdout: Birth: - 2023-08-01T19:53:21.229 DEBUG:teuthology.orchestra.run.smithi101:> sudo dd if=/dev/vg_nvme/lv_3 of=/dev/null count=1 2023-08-01T19:53:21.295 INFO:teuthology.orchestra.run.smithi101.stderr:1+0 records in 2023-08-01T19:53:21.296 INFO:teuthology.orchestra.run.smithi101.stderr:1+0 records out 2023-08-01T19:53:21.296 INFO:teuthology.orchestra.run.smithi101.stderr:512 bytes copied, 0.000227927 s, 2.2 MB/s 2023-08-01T19:53:21.297 DEBUG:teuthology.orchestra.run.smithi101:> ! mount | grep -v devtmpfs | grep -q /dev/vg_nvme/lv_3 2023-08-01T19:53:21.356 DEBUG:teuthology.orchestra.run.smithi101:> stat /dev/vg_nvme/lv_4 2023-08-01T19:53:21.414 INFO:teuthology.orchestra.run.smithi101.stdout: File: /dev/vg_nvme/lv_4 -> ../dm-3 2023-08-01T19:53:21.415 INFO:teuthology.orchestra.run.smithi101.stdout: Size: 7 Blocks: 0 IO Block: 4096 symbolic link 2023-08-01T19:53:21.415 INFO:teuthology.orchestra.run.smithi101.stdout:Device: 6h/6d Inode: 390312 Links: 1 2023-08-01T19:53:21.415 INFO:teuthology.orchestra.run.smithi101.stdout:Access: (0777/lrwxrwxrwx) Uid: ( 0/ root) Gid: ( 0/ root) 2023-08-01T19:53:21.415 INFO:teuthology.orchestra.run.smithi101.stdout:Context: system_u:object_r:device_t:s0 2023-08-01T19:53:21.415 INFO:teuthology.orchestra.run.smithi101.stdout:Access: 2023-08-01 19:52:46.577695178 +0000 2023-08-01T19:53:21.415 INFO:teuthology.orchestra.run.smithi101.stdout:Modify: 2023-08-01 19:49:35.258633389 +0000 2023-08-01T19:53:21.416 INFO:teuthology.orchestra.run.smithi101.stdout:Change: 2023-08-01 19:49:35.258633389 +0000 2023-08-01T19:53:21.416 INFO:teuthology.orchestra.run.smithi101.stdout: Birth: - 2023-08-01T19:53:21.416 DEBUG:teuthology.orchestra.run.smithi101:> sudo dd if=/dev/vg_nvme/lv_4 of=/dev/null count=1 2023-08-01T19:53:21.481 INFO:teuthology.orchestra.run.smithi101.stderr:1+0 records in 2023-08-01T19:53:21.481 INFO:teuthology.orchestra.run.smithi101.stderr:1+0 records out 2023-08-01T19:53:21.481 INFO:teuthology.orchestra.run.smithi101.stderr:512 bytes copied, 0.000229471 s, 2.2 MB/s 2023-08-01T19:53:21.482 DEBUG:teuthology.orchestra.run.smithi101:> ! mount | grep -v devtmpfs | grep -q /dev/vg_nvme/lv_4 2023-08-01T19:53:21.541 INFO:tasks.ceph:osd dev map: {'osd.1': '/dev/vg_nvme/lv_1'} 2023-08-01T19:53:21.541 DEBUG:teuthology.orchestra.run.smithi155:> set -ex 2023-08-01T19:53:21.542 DEBUG:teuthology.orchestra.run.smithi155:> dd if=/scratch_devs of=/dev/stdout 2023-08-01T19:53:21.563 DEBUG:teuthology.misc:devs=['/dev/vg_nvme/lv_1', '/dev/vg_nvme/lv_2', '/dev/vg_nvme/lv_3', '/dev/vg_nvme/lv_4'] 2023-08-01T19:53:21.563 DEBUG:teuthology.orchestra.run.smithi155:> stat /dev/vg_nvme/lv_1 2023-08-01T19:53:21.623 INFO:teuthology.orchestra.run.smithi155.stdout: File: /dev/vg_nvme/lv_1 -> ../dm-0 2023-08-01T19:53:21.623 INFO:teuthology.orchestra.run.smithi155.stdout: Size: 7 Blocks: 0 IO Block: 4096 symbolic link 2023-08-01T19:53:21.624 INFO:teuthology.orchestra.run.smithi155.stdout:Device: 6h/6d Inode: 389212 Links: 1 2023-08-01T19:53:21.624 INFO:teuthology.orchestra.run.smithi155.stdout:Access: (0777/lrwxrwxrwx) Uid: ( 0/ root) Gid: ( 0/ root) 2023-08-01T19:53:21.624 INFO:teuthology.orchestra.run.smithi155.stdout:Context: system_u:object_r:device_t:s0 2023-08-01T19:53:21.624 INFO:teuthology.orchestra.run.smithi155.stdout:Access: 2023-08-01 19:52:56.651950408 +0000 2023-08-01T19:53:21.624 INFO:teuthology.orchestra.run.smithi155.stdout:Modify: 2023-08-01 19:49:38.184430917 +0000 2023-08-01T19:53:21.624 INFO:teuthology.orchestra.run.smithi155.stdout:Change: 2023-08-01 19:49:38.184430917 +0000 2023-08-01T19:53:21.624 INFO:teuthology.orchestra.run.smithi155.stdout: Birth: - 2023-08-01T19:53:21.625 DEBUG:teuthology.orchestra.run.smithi155:> sudo dd if=/dev/vg_nvme/lv_1 of=/dev/null count=1 2023-08-01T19:53:21.692 INFO:teuthology.orchestra.run.smithi155.stderr:1+0 records in 2023-08-01T19:53:21.693 INFO:teuthology.orchestra.run.smithi155.stderr:1+0 records out 2023-08-01T19:53:21.693 INFO:teuthology.orchestra.run.smithi155.stderr:512 bytes copied, 0.000221355 s, 2.3 MB/s 2023-08-01T19:53:21.693 DEBUG:teuthology.orchestra.run.smithi155:> ! mount | grep -v devtmpfs | grep -q /dev/vg_nvme/lv_1 2023-08-01T19:53:21.754 DEBUG:teuthology.orchestra.run.smithi155:> stat /dev/vg_nvme/lv_2 2023-08-01T19:53:21.813 INFO:teuthology.orchestra.run.smithi155.stdout: File: /dev/vg_nvme/lv_2 -> ../dm-1 2023-08-01T19:53:21.813 INFO:teuthology.orchestra.run.smithi155.stdout: Size: 7 Blocks: 0 IO Block: 4096 symbolic link 2023-08-01T19:53:21.813 INFO:teuthology.orchestra.run.smithi155.stdout:Device: 6h/6d Inode: 387064 Links: 1 2023-08-01T19:53:21.813 INFO:teuthology.orchestra.run.smithi155.stdout:Access: (0777/lrwxrwxrwx) Uid: ( 0/ root) Gid: ( 0/ root) 2023-08-01T19:53:21.813 INFO:teuthology.orchestra.run.smithi155.stdout:Context: system_u:object_r:device_t:s0 2023-08-01T19:53:21.813 INFO:teuthology.orchestra.run.smithi155.stdout:Access: 2023-08-01 19:52:56.652950389 +0000 2023-08-01T19:53:21.814 INFO:teuthology.orchestra.run.smithi155.stdout:Modify: 2023-08-01 19:49:38.728420383 +0000 2023-08-01T19:53:21.814 INFO:teuthology.orchestra.run.smithi155.stdout:Change: 2023-08-01 19:49:38.728420383 +0000 2023-08-01T19:53:21.814 INFO:teuthology.orchestra.run.smithi155.stdout: Birth: - 2023-08-01T19:53:21.814 DEBUG:teuthology.orchestra.run.smithi155:> sudo dd if=/dev/vg_nvme/lv_2 of=/dev/null count=1 2023-08-01T19:53:21.881 INFO:teuthology.orchestra.run.smithi155.stderr:1+0 records in 2023-08-01T19:53:21.881 INFO:teuthology.orchestra.run.smithi155.stderr:1+0 records out 2023-08-01T19:53:21.881 INFO:teuthology.orchestra.run.smithi155.stderr:512 bytes copied, 0.000220884 s, 2.3 MB/s 2023-08-01T19:53:21.882 DEBUG:teuthology.orchestra.run.smithi155:> ! mount | grep -v devtmpfs | grep -q /dev/vg_nvme/lv_2 2023-08-01T19:53:21.942 DEBUG:teuthology.orchestra.run.smithi155:> stat /dev/vg_nvme/lv_3 2023-08-01T19:53:22.001 INFO:teuthology.orchestra.run.smithi155.stdout: File: /dev/vg_nvme/lv_3 -> ../dm-2 2023-08-01T19:53:22.001 INFO:teuthology.orchestra.run.smithi155.stdout: Size: 7 Blocks: 0 IO Block: 4096 symbolic link 2023-08-01T19:53:22.002 INFO:teuthology.orchestra.run.smithi155.stdout:Device: 6h/6d Inode: 380801 Links: 1 2023-08-01T19:53:22.002 INFO:teuthology.orchestra.run.smithi155.stdout:Access: (0777/lrwxrwxrwx) Uid: ( 0/ root) Gid: ( 0/ root) 2023-08-01T19:53:22.002 INFO:teuthology.orchestra.run.smithi155.stdout:Context: system_u:object_r:device_t:s0 2023-08-01T19:53:22.002 INFO:teuthology.orchestra.run.smithi155.stdout:Access: 2023-08-01 19:52:56.652950389 +0000 2023-08-01T19:53:22.002 INFO:teuthology.orchestra.run.smithi155.stdout:Modify: 2023-08-01 19:49:39.241410368 +0000 2023-08-01T19:53:22.002 INFO:teuthology.orchestra.run.smithi155.stdout:Change: 2023-08-01 19:49:39.241410368 +0000 2023-08-01T19:53:22.002 INFO:teuthology.orchestra.run.smithi155.stdout: Birth: - 2023-08-01T19:53:22.003 DEBUG:teuthology.orchestra.run.smithi155:> sudo dd if=/dev/vg_nvme/lv_3 of=/dev/null count=1 2023-08-01T19:53:22.068 INFO:teuthology.orchestra.run.smithi155.stderr:1+0 records in 2023-08-01T19:53:22.068 INFO:teuthology.orchestra.run.smithi155.stderr:1+0 records out 2023-08-01T19:53:22.068 INFO:teuthology.orchestra.run.smithi155.stderr:512 bytes copied, 0.000216131 s, 2.4 MB/s 2023-08-01T19:53:22.069 DEBUG:teuthology.orchestra.run.smithi155:> ! mount | grep -v devtmpfs | grep -q /dev/vg_nvme/lv_3 2023-08-01T19:53:22.128 DEBUG:teuthology.orchestra.run.smithi155:> stat /dev/vg_nvme/lv_4 2023-08-01T19:53:22.186 INFO:teuthology.orchestra.run.smithi155.stdout: File: /dev/vg_nvme/lv_4 -> ../dm-3 2023-08-01T19:53:22.186 INFO:teuthology.orchestra.run.smithi155.stdout: Size: 7 Blocks: 0 IO Block: 4096 symbolic link 2023-08-01T19:53:22.186 INFO:teuthology.orchestra.run.smithi155.stdout:Device: 6h/6d Inode: 389544 Links: 1 2023-08-01T19:53:22.186 INFO:teuthology.orchestra.run.smithi155.stdout:Access: (0777/lrwxrwxrwx) Uid: ( 0/ root) Gid: ( 0/ root) 2023-08-01T19:53:22.187 INFO:teuthology.orchestra.run.smithi155.stdout:Context: system_u:object_r:device_t:s0 2023-08-01T19:53:22.187 INFO:teuthology.orchestra.run.smithi155.stdout:Access: 2023-08-01 19:52:56.652950389 +0000 2023-08-01T19:53:22.187 INFO:teuthology.orchestra.run.smithi155.stdout:Modify: 2023-08-01 19:49:39.799399475 +0000 2023-08-01T19:53:22.187 INFO:teuthology.orchestra.run.smithi155.stdout:Change: 2023-08-01 19:49:39.799399475 +0000 2023-08-01T19:53:22.187 INFO:teuthology.orchestra.run.smithi155.stdout: Birth: - 2023-08-01T19:53:22.187 DEBUG:teuthology.orchestra.run.smithi155:> sudo dd if=/dev/vg_nvme/lv_4 of=/dev/null count=1 2023-08-01T19:53:22.252 INFO:teuthology.orchestra.run.smithi155.stderr:1+0 records in 2023-08-01T19:53:22.252 INFO:teuthology.orchestra.run.smithi155.stderr:1+0 records out 2023-08-01T19:53:22.252 INFO:teuthology.orchestra.run.smithi155.stderr:512 bytes copied, 0.000228119 s, 2.2 MB/s 2023-08-01T19:53:22.253 DEBUG:teuthology.orchestra.run.smithi155:> ! mount | grep -v devtmpfs | grep -q /dev/vg_nvme/lv_4 2023-08-01T19:53:22.312 INFO:tasks.ceph:osd dev map: {'osd.2': '/dev/vg_nvme/lv_1'} 2023-08-01T19:53:22.312 INFO:tasks.ceph:remote_to_roles_to_devs: {Remote(name='ubuntu@smithi008.front.sepia.ceph.com'): {'osd.0': '/dev/vg_nvme/lv_1'}, Remote(name='ubuntu@smithi101.front.sepia.ceph.com'): {'osd.1': '/dev/vg_nvme/lv_1'}, Remote(name='ubuntu@smithi155.front.sepia.ceph.com'): {'osd.2': '/dev/vg_nvme/lv_1'}} 2023-08-01T19:53:22.312 INFO:tasks.ceph:Generating config... 2023-08-01T19:53:22.314 INFO:tasks.ceph:[client.0] admin socket = /var/run/ceph/ceph-$name.asok 2023-08-01T19:53:22.314 INFO:tasks.ceph:[mgr] debug mgr = 20 2023-08-01T19:53:22.315 INFO:tasks.ceph:[mgr] debug ms = 1 2023-08-01T19:53:22.315 INFO:tasks.ceph:[mon] debug mon = 20 2023-08-01T19:53:22.315 INFO:tasks.ceph:[mon] debug ms = 1 2023-08-01T19:53:22.316 INFO:tasks.ceph:[mon] debug paxos = 20 2023-08-01T19:53:22.316 INFO:tasks.ceph:[osd] bluestore block size = 96636764160 2023-08-01T19:53:22.316 INFO:tasks.ceph:[osd] bluestore compression algorithm = lz4 2023-08-01T19:53:22.317 INFO:tasks.ceph:[osd] bluestore compression mode = aggressive 2023-08-01T19:53:22.317 INFO:tasks.ceph:[osd] bluestore fsck on mount = True 2023-08-01T19:53:22.317 INFO:tasks.ceph:[osd] debug bluefs = 1/20 2023-08-01T19:53:22.317 INFO:tasks.ceph:[osd] debug bluestore = 1/20 2023-08-01T19:53:22.318 INFO:tasks.ceph:[osd] debug ms = 1 2023-08-01T19:53:22.318 INFO:tasks.ceph:[osd] debug osd = 20 2023-08-01T19:53:22.318 INFO:tasks.ceph:[osd] debug rocksdb = 4/10 2023-08-01T19:53:22.318 INFO:tasks.ceph:[osd] mon osd backfillfull_ratio = 0.85 2023-08-01T19:53:22.318 INFO:tasks.ceph:[osd] mon osd full ratio = 0.9 2023-08-01T19:53:22.319 INFO:tasks.ceph:[osd] mon osd nearfull ratio = 0.8 2023-08-01T19:53:22.319 INFO:tasks.ceph:[osd] osd failsafe full ratio = 0.95 2023-08-01T19:53:22.319 INFO:tasks.ceph:[osd] osd max markdown count = 1000 2023-08-01T19:53:22.319 INFO:tasks.ceph:[osd] osd objectstore = bluestore 2023-08-01T19:53:22.319 INFO:tasks.ceph:Setting up mon.a... 2023-08-01T19:53:22.320 DEBUG:teuthology.orchestra.run.smithi006:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage ceph-authtool --create-keyring /etc/ceph/ceph.keyring 2023-08-01T19:53:22.372 INFO:teuthology.orchestra.run.smithi006.stdout:creating /etc/ceph/ceph.keyring 2023-08-01T19:53:22.375 DEBUG:teuthology.orchestra.run.smithi006:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage ceph-authtool --gen-key --name=mon. /etc/ceph/ceph.keyring 2023-08-01T19:53:22.421 DEBUG:teuthology.orchestra.run.smithi006:> sudo chmod 0644 /etc/ceph/ceph.keyring 2023-08-01T19:53:22.450 DEBUG:tasks.ceph:Ceph mon addresses: [('mon.a', '172.21.15.6'), ('mon.b', '[v2:172.21.15.6:3301,v1:172.21.15.6:6790]'), ('mon.c', '[v2:172.21.15.6:3302,v1:172.21.15.6:6791]')] 2023-08-01T19:53:22.450 DEBUG:tasks.ceph:writing out conf {'global': {'chdir': '', 'pid file': '/var/run/ceph/$cluster-$name.pid', 'auth supported': 'cephx', 'filestore xattr use omap': 'true', 'mon clock drift allowed': '1.000', 'osd crush chooseleaf type': '0', 'auth debug': 'true', 'ms die on old message': 'true', 'ms die on bug': 'true', 'mon max pg per osd': '10000', 'mon pg warn max object skew': '0', 'osd_pool_default_pg_autoscale_mode': 'off', 'osd pool default size': '2', 'mon osd allow primary affinity': 'true', 'mon osd allow pg remap': 'true', 'mon warn on legacy crush tunables': 'false', 'mon warn on crush straw calc version zero': 'false', 'mon warn on no sortbitwise': 'false', 'mon warn on osd down out interval zero': 'false', 'mon warn on too few osds': 'false', 'mon_warn_on_pool_pg_num_not_power_of_two': 'false', 'mon_warn_on_pool_no_redundancy': 'false', 'mon_allow_pool_size_one': 'true', 'osd pool default erasure code profile': 'plugin=jerasure technique=reed_sol_van k=2 m=1 crush-failure-domain=osd', 'osd default data pool replay window': '5', 'mon allow pool delete': 'true', 'mon cluster log file level': 'debug', 'debug asserts on shutdown': 'true', 'mon health detail to clog': 'false', 'mon host': '172.21.15.6,[v2:172.21.15.6:3301,v1:172.21.15.6:6790],[v2:172.21.15.6:3302,v1:172.21.15.6:6791]'}, 'osd': {'osd journal size': '100', 'osd scrub load threshold': '5.0', 'osd scrub max interval': '600', 'osd mclock profile': 'high_recovery_ops', 'osd recover clone overlap': 'true', 'osd recovery max chunk': '1048576', 'osd debug shutdown': 'true', 'osd debug op order': 'true', 'osd debug verify stray on activate': 'true', 'osd open classes on start': 'true', 'osd debug pg log writeout': 'true', 'osd deep scrub update digest min age': '30', 'osd map max advance': '10', 'journal zero on create': 'true', 'filestore ondisk finisher threads': '3', 'filestore apply finisher threads': '3', 'bdev debug aio': 'true', 'osd debug misdirected ops': 'true', 'bluestore block size': 96636764160, 'bluestore compression algorithm': 'lz4', 'bluestore compression mode': 'aggressive', 'bluestore fsck on mount': True, 'debug bluefs': '1/20', 'debug bluestore': '1/20', 'debug ms': 1, 'debug osd': 20, 'debug rocksdb': '4/10', 'mon osd backfillfull_ratio': 0.85, 'mon osd full ratio': 0.9, 'mon osd nearfull ratio': 0.8, 'osd failsafe full ratio': 0.95, 'osd max markdown count': 1000, 'osd objectstore': 'bluestore'}, 'mgr': {'debug ms': 1, 'debug mgr': 20, 'debug mon': '20', 'debug auth': '20', 'mon reweight min pgs per osd': '4', 'mon reweight min bytes per osd': '10', 'mgr/telemetry/nag': 'false'}, 'mon': {'debug ms': 1, 'debug mon': 20, 'debug paxos': 20, 'debug auth': '20', 'mon data avail warn': '5', 'mon mgr mkfs grace': '240', 'mon reweight min pgs per osd': '4', 'mon osd reporter subtree level': 'osd', 'mon osd prime pg temp': 'true', 'mon reweight min bytes per osd': '10', 'auth mon ticket ttl': '660', 'auth service ticket ttl': '240', 'mon_warn_on_insecure_global_id_reclaim': 'false', 'mon_warn_on_insecure_global_id_reclaim_allowed': 'false', 'mon_down_mkfs_grace': '2m', 'mon_warn_on_filestore_osds': 'false'}, 'client': {'rgw cache enabled': 'true', 'rgw enable ops log': 'true', 'rgw enable usage log': 'true', 'log file': '/var/log/ceph/$cluster-$name.$pid.log', 'admin socket': '/var/run/ceph/$cluster-$name.$pid.asok'}, 'mon.a': {}, 'mon.b': {}, 'mon.c': {}, 'mds.a': {}, 'client.0': {'admin socket': '/var/run/ceph/ceph-$name.asok'}} 2023-08-01T19:53:22.451 DEBUG:teuthology.orchestra.run.smithi006:> set -ex 2023-08-01T19:53:22.451 DEBUG:teuthology.orchestra.run.smithi006:> dd of=/home/ubuntu/cephtest/ceph.tmp.conf 2023-08-01T19:53:22.509 DEBUG:teuthology.orchestra.run.smithi006:> adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage monmaptool -c /home/ubuntu/cephtest/ceph.tmp.conf --create --clobber --enable-all-features --add a 172.21.15.6 --addv b '[v2:172.21.15.6:3301,v1:172.21.15.6:6790]' --addv c '[v2:172.21.15.6:3302,v1:172.21.15.6:6791]' --print /home/ubuntu/cephtest/ceph.monmap 2023-08-01T19:53:22.596 INFO:teuthology.orchestra.run.smithi006.stdout:monmaptool: monmap file /home/ubuntu/cephtest/ceph.monmap 2023-08-01T19:53:22.596 INFO:teuthology.orchestra.run.smithi006.stdout:monmaptool: generated fsid a0e420cc-4df1-42a5-8bd4-a98c309a9349 2023-08-01T19:53:22.597 INFO:teuthology.orchestra.run.smithi006.stdout:setting min_mon_release = octopus 2023-08-01T19:53:22.597 INFO:teuthology.orchestra.run.smithi006.stdout:epoch 0 2023-08-01T19:53:22.597 INFO:teuthology.orchestra.run.smithi006.stdout:fsid a0e420cc-4df1-42a5-8bd4-a98c309a9349 2023-08-01T19:53:22.597 INFO:teuthology.orchestra.run.smithi006.stdout:last_changed 2023-08-01T19:53:22.595762+0000 2023-08-01T19:53:22.597 INFO:teuthology.orchestra.run.smithi006.stdout:created 2023-08-01T19:53:22.595762+0000 2023-08-01T19:53:22.597 INFO:teuthology.orchestra.run.smithi006.stdout:min_mon_release 15 (octopus) 2023-08-01T19:53:22.597 INFO:teuthology.orchestra.run.smithi006.stdout:election_strategy: 1 2023-08-01T19:53:22.598 INFO:teuthology.orchestra.run.smithi006.stdout:0: [v2:172.21.15.6:3300/0,v1:172.21.15.6:6789/0] mon.a 2023-08-01T19:53:22.598 INFO:teuthology.orchestra.run.smithi006.stdout:1: [v2:172.21.15.6:3301/0,v1:172.21.15.6:6790/0] mon.b 2023-08-01T19:53:22.598 INFO:teuthology.orchestra.run.smithi006.stdout:2: [v2:172.21.15.6:3302/0,v1:172.21.15.6:6791/0] mon.c 2023-08-01T19:53:22.598 INFO:teuthology.orchestra.run.smithi006.stdout:monmaptool: writing epoch 0 to /home/ubuntu/cephtest/ceph.monmap (3 monitors) 2023-08-01T19:53:22.599 DEBUG:teuthology.orchestra.run.smithi006:> rm -- /home/ubuntu/cephtest/ceph.tmp.conf 2023-08-01T19:53:22.617 INFO:tasks.ceph:Writing /etc/ceph/ceph.conf for FSID a0e420cc-4df1-42a5-8bd4-a98c309a9349... 2023-08-01T19:53:22.618 DEBUG:teuthology.orchestra.run.smithi006:> sudo mkdir -p /etc/ceph && sudo chmod 0755 /etc/ceph && sudo tee /etc/ceph/ceph.conf && sudo chmod 0644 /etc/ceph/ceph.conf > /dev/null 2023-08-01T19:53:22.659 DEBUG:teuthology.orchestra.run.smithi008:> sudo mkdir -p /etc/ceph && sudo chmod 0755 /etc/ceph && sudo tee /etc/ceph/ceph.conf && sudo chmod 0644 /etc/ceph/ceph.conf > /dev/null 2023-08-01T19:53:22.661 DEBUG:teuthology.orchestra.run.smithi101:> sudo mkdir -p /etc/ceph && sudo chmod 0755 /etc/ceph && sudo tee /etc/ceph/ceph.conf && sudo chmod 0644 /etc/ceph/ceph.conf > /dev/null 2023-08-01T19:53:22.664 DEBUG:teuthology.orchestra.run.smithi155:> sudo mkdir -p /etc/ceph && sudo chmod 0755 /etc/ceph && sudo tee /etc/ceph/ceph.conf && sudo chmod 0644 /etc/ceph/ceph.conf > /dev/null 2023-08-01T19:53:22.703 INFO:teuthology.orchestra.run.smithi006.stdout:[global] 2023-08-01T19:53:22.703 INFO:teuthology.orchestra.run.smithi006.stdout: chdir = "" 2023-08-01T19:53:22.703 INFO:teuthology.orchestra.run.smithi006.stdout: pid file = /var/run/ceph/$cluster-$name.pid 2023-08-01T19:53:22.703 INFO:teuthology.orchestra.run.smithi006.stdout: auth supported = cephx 2023-08-01T19:53:22.704 INFO:teuthology.orchestra.run.smithi006.stdout: 2023-08-01T19:53:22.704 INFO:teuthology.orchestra.run.smithi006.stdout: filestore xattr use omap = true 2023-08-01T19:53:22.704 INFO:teuthology.orchestra.run.smithi006.stdout: 2023-08-01T19:53:22.704 INFO:teuthology.orchestra.run.smithi006.stdout: mon clock drift allowed = 1.000 2023-08-01T19:53:22.704 INFO:teuthology.orchestra.run.smithi006.stdout: 2023-08-01T19:53:22.705 INFO:teuthology.orchestra.run.smithi006.stdout: osd crush chooseleaf type = 0 2023-08-01T19:53:22.705 INFO:teuthology.orchestra.run.smithi006.stdout: auth debug = true 2023-08-01T19:53:22.705 INFO:teuthology.orchestra.run.smithi006.stdout: 2023-08-01T19:53:22.705 INFO:teuthology.orchestra.run.smithi006.stdout: ms die on old message = true 2023-08-01T19:53:22.705 INFO:teuthology.orchestra.run.smithi006.stdout: ms die on bug = true 2023-08-01T19:53:22.705 INFO:teuthology.orchestra.run.smithi006.stdout: 2023-08-01T19:53:22.705 INFO:teuthology.orchestra.run.smithi006.stdout: mon max pg per osd = 10000 # >= luminous 2023-08-01T19:53:22.706 INFO:teuthology.orchestra.run.smithi006.stdout: mon pg warn max object skew = 0 2023-08-01T19:53:22.706 INFO:teuthology.orchestra.run.smithi006.stdout: 2023-08-01T19:53:22.706 INFO:teuthology.orchestra.run.smithi006.stdout: # disable pg_autoscaler by default for new pools 2023-08-01T19:53:22.706 INFO:teuthology.orchestra.run.smithi006.stdout: osd_pool_default_pg_autoscale_mode = off 2023-08-01T19:53:22.706 INFO:teuthology.orchestra.run.smithi006.stdout: 2023-08-01T19:53:22.706 INFO:teuthology.orchestra.run.smithi006.stdout: osd pool default size = 2 2023-08-01T19:53:22.706 INFO:teuthology.orchestra.run.smithi006.stdout: 2023-08-01T19:53:22.707 INFO:teuthology.orchestra.run.smithi006.stdout: mon osd allow primary affinity = true 2023-08-01T19:53:22.707 INFO:teuthology.orchestra.run.smithi006.stdout: mon osd allow pg remap = true 2023-08-01T19:53:22.707 INFO:teuthology.orchestra.run.smithi006.stdout: mon warn on legacy crush tunables = false 2023-08-01T19:53:22.707 INFO:teuthology.orchestra.run.smithi006.stdout: mon warn on crush straw calc version zero = false 2023-08-01T19:53:22.707 INFO:teuthology.orchestra.run.smithi006.stdout: mon warn on no sortbitwise = false 2023-08-01T19:53:22.707 INFO:teuthology.orchestra.run.smithi006.stdout: mon warn on osd down out interval zero = false 2023-08-01T19:53:22.707 INFO:teuthology.orchestra.run.smithi006.stdout: mon warn on too few osds = false 2023-08-01T19:53:22.708 INFO:teuthology.orchestra.run.smithi006.stdout: mon_warn_on_pool_pg_num_not_power_of_two = false 2023-08-01T19:53:22.708 INFO:teuthology.orchestra.run.smithi006.stdout: mon_warn_on_pool_no_redundancy = false 2023-08-01T19:53:22.708 INFO:teuthology.orchestra.run.smithi006.stdout: mon_allow_pool_size_one = true 2023-08-01T19:53:22.708 INFO:teuthology.orchestra.run.smithi006.stdout: 2023-08-01T19:53:22.708 INFO:teuthology.orchestra.run.smithi006.stdout: osd pool default erasure code profile = plugin=jerasure technique=reed_sol_van k=2 m=1 crush-failure-domain=osd 2023-08-01T19:53:22.708 INFO:teuthology.orchestra.run.smithi006.stdout: 2023-08-01T19:53:22.708 INFO:teuthology.orchestra.run.smithi006.stdout: osd default data pool replay window = 5 2023-08-01T19:53:22.709 INFO:teuthology.orchestra.run.smithi006.stdout: 2023-08-01T19:53:22.709 INFO:teuthology.orchestra.run.smithi006.stdout: mon allow pool delete = true 2023-08-01T19:53:22.709 INFO:teuthology.orchestra.run.smithi006.stdout: 2023-08-01T19:53:22.709 INFO:teuthology.orchestra.run.smithi006.stdout: mon cluster log file level = debug 2023-08-01T19:53:22.709 INFO:teuthology.orchestra.run.smithi006.stdout: debug asserts on shutdown = true 2023-08-01T19:53:22.709 INFO:teuthology.orchestra.run.smithi006.stdout: mon health detail to clog = false 2023-08-01T19:53:22.709 INFO:teuthology.orchestra.run.smithi006.stdout: mon host = "172.21.15.6,[v2:172.21.15.6:3301,v1:172.21.15.6:6790],[v2:172.21.15.6:3302,v1:172.21.15.6:6791]" 2023-08-01T19:53:22.710 INFO:teuthology.orchestra.run.smithi006.stdout: fsid = a0e420cc-4df1-42a5-8bd4-a98c309a9349 2023-08-01T19:53:22.710 INFO:teuthology.orchestra.run.smithi006.stdout: 2023-08-01T19:53:22.710 INFO:teuthology.orchestra.run.smithi006.stdout:[osd] 2023-08-01T19:53:22.710 INFO:teuthology.orchestra.run.smithi006.stdout: osd journal size = 100 2023-08-01T19:53:22.710 INFO:teuthology.orchestra.run.smithi006.stdout: 2023-08-01T19:53:22.710 INFO:teuthology.orchestra.run.smithi006.stdout: osd scrub load threshold = 5.0 2023-08-01T19:53:22.710 INFO:teuthology.orchestra.run.smithi006.stdout: osd scrub max interval = 600 2023-08-01T19:53:22.711 INFO:teuthology.orchestra.run.smithi006.stdout: osd mclock profile = high_recovery_ops 2023-08-01T19:53:22.711 INFO:teuthology.orchestra.run.smithi006.stdout: 2023-08-01T19:53:22.711 INFO:teuthology.orchestra.run.smithi006.stdout: osd recover clone overlap = true 2023-08-01T19:53:22.711 INFO:teuthology.orchestra.run.smithi006.stdout: osd recovery max chunk = 1048576 2023-08-01T19:53:22.711 INFO:teuthology.orchestra.run.smithi006.stdout: 2023-08-01T19:53:22.711 INFO:teuthology.orchestra.run.smithi006.stdout: osd debug shutdown = true 2023-08-01T19:53:22.711 INFO:teuthology.orchestra.run.smithi006.stdout: osd debug op order = true 2023-08-01T19:53:22.712 INFO:teuthology.orchestra.run.smithi006.stdout: osd debug verify stray on activate = true 2023-08-01T19:53:22.712 INFO:teuthology.orchestra.run.smithi006.stdout: 2023-08-01T19:53:22.712 INFO:teuthology.orchestra.run.smithi006.stdout: osd open classes on start = true 2023-08-01T19:53:22.712 INFO:teuthology.orchestra.run.smithi006.stdout: osd debug pg log writeout = true 2023-08-01T19:53:22.712 INFO:teuthology.orchestra.run.smithi006.stdout: 2023-08-01T19:53:22.712 INFO:teuthology.orchestra.run.smithi006.stdout: osd deep scrub update digest min age = 30 2023-08-01T19:53:22.712 INFO:teuthology.orchestra.run.smithi006.stdout: 2023-08-01T19:53:22.713 INFO:teuthology.orchestra.run.smithi006.stdout: osd map max advance = 10 2023-08-01T19:53:22.713 INFO:teuthology.orchestra.run.smithi006.stdout: 2023-08-01T19:53:22.713 INFO:teuthology.orchestra.run.smithi006.stdout: journal zero on create = true 2023-08-01T19:53:22.713 INFO:teuthology.orchestra.run.smithi006.stdout: 2023-08-01T19:53:22.713 INFO:teuthology.orchestra.run.smithi006.stdout: filestore ondisk finisher threads = 3 2023-08-01T19:53:22.713 INFO:teuthology.orchestra.run.smithi006.stdout: filestore apply finisher threads = 3 2023-08-01T19:53:22.713 INFO:teuthology.orchestra.run.smithi006.stdout: 2023-08-01T19:53:22.713 INFO:teuthology.orchestra.run.smithi006.stdout: bdev debug aio = true 2023-08-01T19:53:22.714 INFO:teuthology.orchestra.run.smithi006.stdout: osd debug misdirected ops = true 2023-08-01T19:53:22.714 INFO:teuthology.orchestra.run.smithi006.stdout: bluestore block size = 96636764160 2023-08-01T19:53:22.714 INFO:teuthology.orchestra.run.smithi006.stdout: bluestore compression algorithm = lz4 2023-08-01T19:53:22.714 INFO:teuthology.orchestra.run.smithi006.stdout: bluestore compression mode = aggressive 2023-08-01T19:53:22.714 INFO:teuthology.orchestra.run.smithi006.stdout: bluestore fsck on mount = True 2023-08-01T19:53:22.714 INFO:teuthology.orchestra.run.smithi006.stdout: debug bluefs = 1/20 2023-08-01T19:53:22.714 INFO:teuthology.orchestra.run.smithi006.stdout: debug bluestore = 1/20 2023-08-01T19:53:22.715 INFO:teuthology.orchestra.run.smithi006.stdout: debug ms = 1 2023-08-01T19:53:22.715 INFO:teuthology.orchestra.run.smithi006.stdout: debug osd = 20 2023-08-01T19:53:22.715 INFO:teuthology.orchestra.run.smithi006.stdout: debug rocksdb = 4/10 2023-08-01T19:53:22.715 INFO:teuthology.orchestra.run.smithi006.stdout: mon osd backfillfull_ratio = 0.85 2023-08-01T19:53:22.715 INFO:teuthology.orchestra.run.smithi006.stdout: mon osd full ratio = 0.9 2023-08-01T19:53:22.715 INFO:teuthology.orchestra.run.smithi006.stdout: mon osd nearfull ratio = 0.8 2023-08-01T19:53:22.716 INFO:teuthology.orchestra.run.smithi006.stdout: osd failsafe full ratio = 0.95 2023-08-01T19:53:22.716 INFO:teuthology.orchestra.run.smithi006.stdout: osd max markdown count = 1000 2023-08-01T19:53:22.716 INFO:teuthology.orchestra.run.smithi006.stdout: osd objectstore = bluestore 2023-08-01T19:53:22.716 INFO:teuthology.orchestra.run.smithi006.stdout: 2023-08-01T19:53:22.716 INFO:teuthology.orchestra.run.smithi006.stdout:[mgr] 2023-08-01T19:53:22.716 INFO:teuthology.orchestra.run.smithi006.stdout: debug ms = 1 2023-08-01T19:53:22.716 INFO:teuthology.orchestra.run.smithi006.stdout: debug mgr = 20 2023-08-01T19:53:22.717 INFO:teuthology.orchestra.run.smithi006.stdout: debug mon = 20 2023-08-01T19:53:22.717 INFO:teuthology.orchestra.run.smithi006.stdout: debug auth = 20 2023-08-01T19:53:22.717 INFO:teuthology.orchestra.run.smithi006.stdout: mon reweight min pgs per osd = 4 2023-08-01T19:53:22.717 INFO:teuthology.orchestra.run.smithi006.stdout: mon reweight min bytes per osd = 10 2023-08-01T19:53:22.718 INFO:teuthology.orchestra.run.smithi006.stdout: mgr/telemetry/nag = false 2023-08-01T19:53:22.718 INFO:teuthology.orchestra.run.smithi006.stdout: 2023-08-01T19:53:22.718 INFO:teuthology.orchestra.run.smithi006.stdout:[mon] 2023-08-01T19:53:22.718 INFO:teuthology.orchestra.run.smithi006.stdout: debug ms = 1 2023-08-01T19:53:22.718 INFO:teuthology.orchestra.run.smithi006.stdout: debug mon = 20 2023-08-01T19:53:22.718 INFO:teuthology.orchestra.run.smithi006.stdout: debug paxos = 20 2023-08-01T19:53:22.718 INFO:teuthology.orchestra.run.smithi006.stdout: debug auth = 20 2023-08-01T19:53:22.719 INFO:teuthology.orchestra.run.smithi006.stdout: mon data avail warn = 5 2023-08-01T19:53:22.719 INFO:teuthology.orchestra.run.smithi006.stdout: mon mgr mkfs grace = 240 2023-08-01T19:53:22.719 INFO:teuthology.orchestra.run.smithi006.stdout: mon reweight min pgs per osd = 4 2023-08-01T19:53:22.719 INFO:teuthology.orchestra.run.smithi006.stdout: mon osd reporter subtree level = osd 2023-08-01T19:53:22.719 INFO:teuthology.orchestra.run.smithi006.stdout: mon osd prime pg temp = true 2023-08-01T19:53:22.719 INFO:teuthology.orchestra.run.smithi006.stdout: mon reweight min bytes per osd = 10 2023-08-01T19:53:22.719 INFO:teuthology.orchestra.run.smithi006.stdout: 2023-08-01T19:53:22.720 INFO:teuthology.orchestra.run.smithi006.stdout: # rotate auth tickets quickly to exercise renewal paths 2023-08-01T19:53:22.720 INFO:teuthology.orchestra.run.smithi006.stdout: auth mon ticket ttl = 660 # 11m 2023-08-01T19:53:22.720 INFO:teuthology.orchestra.run.smithi006.stdout: auth service ticket ttl = 240 # 4m 2023-08-01T19:53:22.720 INFO:teuthology.orchestra.run.smithi006.stdout: 2023-08-01T19:53:22.720 INFO:teuthology.orchestra.run.smithi006.stdout: # don't complain about insecure global_id in the test suite 2023-08-01T19:53:22.720 INFO:teuthology.orchestra.run.smithi006.stdout: mon_warn_on_insecure_global_id_reclaim = false 2023-08-01T19:53:22.720 INFO:teuthology.orchestra.run.smithi006.stdout: mon_warn_on_insecure_global_id_reclaim_allowed = false 2023-08-01T19:53:22.721 INFO:teuthology.orchestra.run.smithi006.stdout: 2023-08-01T19:53:22.721 INFO:teuthology.orchestra.run.smithi006.stdout: # 1m isn't quite enough 2023-08-01T19:53:22.721 INFO:teuthology.orchestra.run.smithi006.stdout: mon_down_mkfs_grace = 2m 2023-08-01T19:53:22.721 INFO:teuthology.orchestra.run.smithi006.stdout: 2023-08-01T19:53:22.721 INFO:teuthology.orchestra.run.smithi006.stdout: mon_warn_on_filestore_osds = false 2023-08-01T19:53:22.721 INFO:teuthology.orchestra.run.smithi006.stdout: 2023-08-01T19:53:22.721 INFO:teuthology.orchestra.run.smithi006.stdout:[client] 2023-08-01T19:53:22.721 INFO:teuthology.orchestra.run.smithi006.stdout: rgw cache enabled = true 2023-08-01T19:53:22.722 INFO:teuthology.orchestra.run.smithi006.stdout: rgw enable ops log = true 2023-08-01T19:53:22.722 INFO:teuthology.orchestra.run.smithi006.stdout: rgw enable usage log = true 2023-08-01T19:53:22.722 INFO:teuthology.orchestra.run.smithi006.stdout: log file = /var/log/ceph/$cluster-$name.$pid.log 2023-08-01T19:53:22.722 INFO:teuthology.orchestra.run.smithi006.stdout: admin socket = /var/run/ceph/$cluster-$name.$pid.asok 2023-08-01T19:53:22.722 INFO:teuthology.orchestra.run.smithi006.stdout:[mon.a] 2023-08-01T19:53:22.722 INFO:teuthology.orchestra.run.smithi006.stdout:[mon.b] 2023-08-01T19:53:22.722 INFO:teuthology.orchestra.run.smithi006.stdout:[mon.c] 2023-08-01T19:53:22.723 INFO:teuthology.orchestra.run.smithi006.stdout:[mds.a] 2023-08-01T19:53:22.723 INFO:teuthology.orchestra.run.smithi006.stdout:[client.0] 2023-08-01T19:53:22.723 INFO:teuthology.orchestra.run.smithi006.stdout: admin socket = /var/run/ceph/ceph-$name.asok 2023-08-01T19:53:22.724 INFO:teuthology.orchestra.run.smithi101.stdout:[global] 2023-08-01T19:53:22.724 INFO:teuthology.orchestra.run.smithi101.stdout: chdir = "" 2023-08-01T19:53:22.724 INFO:teuthology.orchestra.run.smithi101.stdout: pid file = /var/run/ceph/$cluster-$name.pid 2023-08-01T19:53:22.724 INFO:teuthology.orchestra.run.smithi101.stdout: auth supported = cephx 2023-08-01T19:53:22.724 INFO:teuthology.orchestra.run.smithi101.stdout: 2023-08-01T19:53:22.724 INFO:teuthology.orchestra.run.smithi101.stdout: filestore xattr use omap = true 2023-08-01T19:53:22.725 INFO:teuthology.orchestra.run.smithi101.stdout: 2023-08-01T19:53:22.725 INFO:teuthology.orchestra.run.smithi101.stdout: mon clock drift allowed = 1.000 2023-08-01T19:53:22.725 INFO:teuthology.orchestra.run.smithi101.stdout: 2023-08-01T19:53:22.725 INFO:teuthology.orchestra.run.smithi101.stdout: osd crush chooseleaf type = 0 2023-08-01T19:53:22.725 INFO:teuthology.orchestra.run.smithi101.stdout: auth debug = true 2023-08-01T19:53:22.725 INFO:teuthology.orchestra.run.smithi101.stdout: 2023-08-01T19:53:22.725 INFO:teuthology.orchestra.run.smithi101.stdout: ms die on old message = true 2023-08-01T19:53:22.726 INFO:teuthology.orchestra.run.smithi101.stdout: ms die on bug = true 2023-08-01T19:53:22.726 INFO:teuthology.orchestra.run.smithi101.stdout: 2023-08-01T19:53:22.726 INFO:teuthology.orchestra.run.smithi101.stdout: mon max pg per osd = 10000 # >= luminous 2023-08-01T19:53:22.726 INFO:teuthology.orchestra.run.smithi101.stdout: mon pg warn max object skew = 0 2023-08-01T19:53:22.726 INFO:teuthology.orchestra.run.smithi101.stdout: 2023-08-01T19:53:22.726 INFO:teuthology.orchestra.run.smithi101.stdout: # disable pg_autoscaler by default for new pools 2023-08-01T19:53:22.726 INFO:teuthology.orchestra.run.smithi101.stdout: osd_pool_default_pg_autoscale_mode = off 2023-08-01T19:53:22.727 INFO:teuthology.orchestra.run.smithi101.stdout: 2023-08-01T19:53:22.727 INFO:teuthology.orchestra.run.smithi101.stdout: osd pool default size = 2 2023-08-01T19:53:22.727 INFO:teuthology.orchestra.run.smithi101.stdout: 2023-08-01T19:53:22.727 INFO:teuthology.orchestra.run.smithi101.stdout: mon osd allow primary affinity = true 2023-08-01T19:53:22.727 INFO:teuthology.orchestra.run.smithi101.stdout: mon osd allow pg remap = true 2023-08-01T19:53:22.727 INFO:teuthology.orchestra.run.smithi101.stdout: mon warn on legacy crush tunables = false 2023-08-01T19:53:22.727 INFO:teuthology.orchestra.run.smithi101.stdout: mon warn on crush straw calc version zero = false 2023-08-01T19:53:22.728 INFO:teuthology.orchestra.run.smithi101.stdout: mon warn on no sortbitwise = false 2023-08-01T19:53:22.728 INFO:teuthology.orchestra.run.smithi101.stdout: mon warn on osd down out interval zero = false 2023-08-01T19:53:22.728 INFO:teuthology.orchestra.run.smithi101.stdout: mon warn on too few osds = false 2023-08-01T19:53:22.728 INFO:teuthology.orchestra.run.smithi101.stdout: mon_warn_on_pool_pg_num_not_power_of_two = false 2023-08-01T19:53:22.728 INFO:teuthology.orchestra.run.smithi101.stdout: mon_warn_on_pool_no_redundancy = false 2023-08-01T19:53:22.728 INFO:teuthology.orchestra.run.smithi101.stdout: mon_allow_pool_size_one = true 2023-08-01T19:53:22.729 INFO:teuthology.orchestra.run.smithi101.stdout: 2023-08-01T19:53:22.729 INFO:teuthology.orchestra.run.smithi101.stdout: osd pool default erasure code profile = plugin=jerasure technique=reed_sol_van k=2 m=1 crush-failure-domain=osd 2023-08-01T19:53:22.729 INFO:teuthology.orchestra.run.smithi101.stdout: 2023-08-01T19:53:22.729 INFO:teuthology.orchestra.run.smithi101.stdout: osd default data pool replay window = 5 2023-08-01T19:53:22.729 INFO:teuthology.orchestra.run.smithi101.stdout: 2023-08-01T19:53:22.729 INFO:teuthology.orchestra.run.smithi101.stdout: mon allow pool delete = true 2023-08-01T19:53:22.729 INFO:teuthology.orchestra.run.smithi101.stdout: 2023-08-01T19:53:22.730 INFO:teuthology.orchestra.run.smithi101.stdout: mon cluster log file level = debug 2023-08-01T19:53:22.730 INFO:teuthology.orchestra.run.smithi101.stdout: debug asserts on shutdown = true 2023-08-01T19:53:22.730 INFO:teuthology.orchestra.run.smithi101.stdout: mon health detail to clog = false 2023-08-01T19:53:22.730 INFO:teuthology.orchestra.run.smithi101.stdout: mon host = "172.21.15.6,[v2:172.21.15.6:3301,v1:172.21.15.6:6790],[v2:172.21.15.6:3302,v1:172.21.15.6:6791]" 2023-08-01T19:53:22.730 INFO:teuthology.orchestra.run.smithi101.stdout: fsid = a0e420cc-4df1-42a5-8bd4-a98c309a9349 2023-08-01T19:53:22.730 INFO:teuthology.orchestra.run.smithi101.stdout: 2023-08-01T19:53:22.730 INFO:teuthology.orchestra.run.smithi101.stdout:[osd] 2023-08-01T19:53:22.730 INFO:teuthology.orchestra.run.smithi101.stdout: osd journal size = 100 2023-08-01T19:53:22.731 INFO:teuthology.orchestra.run.smithi101.stdout: 2023-08-01T19:53:22.731 INFO:teuthology.orchestra.run.smithi101.stdout: osd scrub load threshold = 5.0 2023-08-01T19:53:22.731 INFO:teuthology.orchestra.run.smithi101.stdout: osd scrub max interval = 600 2023-08-01T19:53:22.731 INFO:teuthology.orchestra.run.smithi101.stdout: osd mclock profile = high_recovery_ops 2023-08-01T19:53:22.731 INFO:teuthology.orchestra.run.smithi101.stdout: 2023-08-01T19:53:22.731 INFO:teuthology.orchestra.run.smithi101.stdout: osd recover clone overlap = true 2023-08-01T19:53:22.731 INFO:teuthology.orchestra.run.smithi101.stdout: osd recovery max chunk = 1048576 2023-08-01T19:53:22.732 INFO:teuthology.orchestra.run.smithi101.stdout: 2023-08-01T19:53:22.732 INFO:teuthology.orchestra.run.smithi101.stdout: osd debug shutdown = true 2023-08-01T19:53:22.732 INFO:teuthology.orchestra.run.smithi101.stdout: osd debug op order = true 2023-08-01T19:53:22.732 INFO:teuthology.orchestra.run.smithi101.stdout: osd debug verify stray on activate = true 2023-08-01T19:53:22.732 INFO:teuthology.orchestra.run.smithi101.stdout: 2023-08-01T19:53:22.732 INFO:teuthology.orchestra.run.smithi101.stdout: osd open classes on start = true 2023-08-01T19:53:22.733 INFO:teuthology.orchestra.run.smithi101.stdout: osd debug pg log writeout = true 2023-08-01T19:53:22.733 INFO:teuthology.orchestra.run.smithi101.stdout: 2023-08-01T19:53:22.733 INFO:teuthology.orchestra.run.smithi101.stdout: osd deep scrub update digest min age = 30 2023-08-01T19:53:22.733 INFO:teuthology.orchestra.run.smithi101.stdout: 2023-08-01T19:53:22.733 INFO:teuthology.orchestra.run.smithi101.stdout: osd map max advance = 10 2023-08-01T19:53:22.733 INFO:teuthology.orchestra.run.smithi101.stdout: 2023-08-01T19:53:22.733 INFO:teuthology.orchestra.run.smithi101.stdout: journal zero on create = true 2023-08-01T19:53:22.734 INFO:teuthology.orchestra.run.smithi101.stdout: 2023-08-01T19:53:22.734 INFO:teuthology.orchestra.run.smithi101.stdout: filestore ondisk finisher threads = 3 2023-08-01T19:53:22.734 INFO:teuthology.orchestra.run.smithi101.stdout: filestore apply finisher threads = 3 2023-08-01T19:53:22.734 INFO:teuthology.orchestra.run.smithi101.stdout: 2023-08-01T19:53:22.734 INFO:teuthology.orchestra.run.smithi101.stdout: bdev debug aio = true 2023-08-01T19:53:22.734 INFO:teuthology.orchestra.run.smithi101.stdout: osd debug misdirected ops = true 2023-08-01T19:53:22.734 INFO:teuthology.orchestra.run.smithi101.stdout: bluestore block size = 96636764160 2023-08-01T19:53:22.735 INFO:teuthology.orchestra.run.smithi101.stdout: bluestore compression algorithm = lz4 2023-08-01T19:53:22.735 INFO:teuthology.orchestra.run.smithi101.stdout: bluestore compression mode = aggressive 2023-08-01T19:53:22.735 INFO:teuthology.orchestra.run.smithi101.stdout: bluestore fsck on mount = True 2023-08-01T19:53:22.735 INFO:teuthology.orchestra.run.smithi101.stdout: debug bluefs = 1/20 2023-08-01T19:53:22.735 INFO:teuthology.orchestra.run.smithi101.stdout: debug bluestore = 1/20 2023-08-01T19:53:22.735 INFO:teuthology.orchestra.run.smithi101.stdout: debug ms = 1 2023-08-01T19:53:22.735 INFO:teuthology.orchestra.run.smithi101.stdout: debug osd = 20 2023-08-01T19:53:22.736 INFO:teuthology.orchestra.run.smithi101.stdout: debug rocksdb = 4/10 2023-08-01T19:53:22.736 INFO:teuthology.orchestra.run.smithi101.stdout: mon osd backfillfull_ratio = 0.85 2023-08-01T19:53:22.736 INFO:teuthology.orchestra.run.smithi101.stdout: mon osd full ratio = 0.9 2023-08-01T19:53:22.736 INFO:teuthology.orchestra.run.smithi101.stdout: mon osd nearfull ratio = 0.8 2023-08-01T19:53:22.736 INFO:teuthology.orchestra.run.smithi101.stdout: osd failsafe full ratio = 0.95 2023-08-01T19:53:22.736 INFO:teuthology.orchestra.run.smithi101.stdout: osd max markdown count = 1000 2023-08-01T19:53:22.736 INFO:teuthology.orchestra.run.smithi101.stdout: osd objectstore = bluestore 2023-08-01T19:53:22.737 INFO:teuthology.orchestra.run.smithi101.stdout: 2023-08-01T19:53:22.737 INFO:teuthology.orchestra.run.smithi101.stdout:[mgr] 2023-08-01T19:53:22.737 INFO:teuthology.orchestra.run.smithi101.stdout: debug ms = 1 2023-08-01T19:53:22.737 INFO:teuthology.orchestra.run.smithi101.stdout: debug mgr = 20 2023-08-01T19:53:22.737 INFO:teuthology.orchestra.run.smithi101.stdout: debug mon = 20 2023-08-01T19:53:22.737 INFO:teuthology.orchestra.run.smithi101.stdout: debug auth = 20 2023-08-01T19:53:22.737 INFO:teuthology.orchestra.run.smithi101.stdout: mon reweight min pgs per osd = 4 2023-08-01T19:53:22.737 INFO:teuthology.orchestra.run.smithi101.stdout: mon reweight min bytes per osd = 10 2023-08-01T19:53:22.738 INFO:teuthology.orchestra.run.smithi101.stdout: mgr/telemetry/nag = false 2023-08-01T19:53:22.738 INFO:teuthology.orchestra.run.smithi101.stdout: 2023-08-01T19:53:22.738 INFO:teuthology.orchestra.run.smithi101.stdout:[mon] 2023-08-01T19:53:22.738 INFO:teuthology.orchestra.run.smithi101.stdout: debug ms = 1 2023-08-01T19:53:22.738 INFO:teuthology.orchestra.run.smithi101.stdout: debug mon = 20 2023-08-01T19:53:22.738 INFO:teuthology.orchestra.run.smithi101.stdout: debug paxos = 20 2023-08-01T19:53:22.738 INFO:teuthology.orchestra.run.smithi101.stdout: debug auth = 20 2023-08-01T19:53:22.739 INFO:teuthology.orchestra.run.smithi101.stdout: mon data avail warn = 5 2023-08-01T19:53:22.739 INFO:teuthology.orchestra.run.smithi101.stdout: mon mgr mkfs grace = 240 2023-08-01T19:53:22.739 INFO:teuthology.orchestra.run.smithi101.stdout: mon reweight min pgs per osd = 4 2023-08-01T19:53:22.739 INFO:teuthology.orchestra.run.smithi101.stdout: mon osd reporter subtree level = osd 2023-08-01T19:53:22.739 INFO:teuthology.orchestra.run.smithi101.stdout: mon osd prime pg temp = true 2023-08-01T19:53:22.739 INFO:teuthology.orchestra.run.smithi101.stdout: mon reweight min bytes per osd = 10 2023-08-01T19:53:22.739 INFO:teuthology.orchestra.run.smithi101.stdout: 2023-08-01T19:53:22.740 INFO:teuthology.orchestra.run.smithi101.stdout: # rotate auth tickets quickly to exercise renewal paths 2023-08-01T19:53:22.740 INFO:teuthology.orchestra.run.smithi101.stdout: auth mon ticket ttl = 660 # 11m 2023-08-01T19:53:22.740 INFO:teuthology.orchestra.run.smithi101.stdout: auth service ticket ttl = 240 # 4m 2023-08-01T19:53:22.740 INFO:teuthology.orchestra.run.smithi101.stdout: 2023-08-01T19:53:22.740 INFO:teuthology.orchestra.run.smithi101.stdout: # don't complain about insecure global_id in the test suite 2023-08-01T19:53:22.740 INFO:teuthology.orchestra.run.smithi101.stdout: mon_warn_on_insecure_global_id_reclaim = false 2023-08-01T19:53:22.740 INFO:teuthology.orchestra.run.smithi101.stdout: mon_warn_on_insecure_global_id_reclaim_allowed = false 2023-08-01T19:53:22.740 INFO:teuthology.orchestra.run.smithi101.stdout: 2023-08-01T19:53:22.741 INFO:teuthology.orchestra.run.smithi101.stdout: # 1m isn't quite enough 2023-08-01T19:53:22.741 INFO:teuthology.orchestra.run.smithi101.stdout: mon_down_mkfs_grace = 2m 2023-08-01T19:53:22.741 INFO:teuthology.orchestra.run.smithi101.stdout: 2023-08-01T19:53:22.741 INFO:teuthology.orchestra.run.smithi101.stdout: mon_warn_on_filestore_osds = false 2023-08-01T19:53:22.741 INFO:teuthology.orchestra.run.smithi101.stdout: 2023-08-01T19:53:22.741 INFO:teuthology.orchestra.run.smithi101.stdout:[client] 2023-08-01T19:53:22.741 INFO:teuthology.orchestra.run.smithi101.stdout: rgw cache enabled = true 2023-08-01T19:53:22.742 INFO:teuthology.orchestra.run.smithi101.stdout: rgw enable ops log = true 2023-08-01T19:53:22.742 INFO:teuthology.orchestra.run.smithi101.stdout: rgw enable usage log = true 2023-08-01T19:53:22.742 INFO:teuthology.orchestra.run.smithi101.stdout: log file = /var/log/ceph/$cluster-$name.$pid.log 2023-08-01T19:53:22.742 INFO:teuthology.orchestra.run.smithi101.stdout: admin socket = /var/run/ceph/$cluster-$name.$pid.asok 2023-08-01T19:53:22.742 INFO:teuthology.orchestra.run.smithi101.stdout:[mon.a] 2023-08-01T19:53:22.742 INFO:teuthology.orchestra.run.smithi101.stdout:[mon.b] 2023-08-01T19:53:22.742 INFO:teuthology.orchestra.run.smithi101.stdout:[mon.c] 2023-08-01T19:53:22.743 INFO:teuthology.orchestra.run.smithi101.stdout:[mds.a] 2023-08-01T19:53:22.743 INFO:teuthology.orchestra.run.smithi101.stdout:[client.0] 2023-08-01T19:53:22.743 INFO:teuthology.orchestra.run.smithi101.stdout: admin socket = /var/run/ceph/ceph-$name.asok 2023-08-01T19:53:22.743 INFO:teuthology.orchestra.run.smithi008.stdout:[global] 2023-08-01T19:53:22.743 INFO:teuthology.orchestra.run.smithi008.stdout: chdir = "" 2023-08-01T19:53:22.743 INFO:teuthology.orchestra.run.smithi008.stdout: pid file = /var/run/ceph/$cluster-$name.pid 2023-08-01T19:53:22.743 INFO:teuthology.orchestra.run.smithi008.stdout: auth supported = cephx 2023-08-01T19:53:22.744 INFO:teuthology.orchestra.run.smithi008.stdout: 2023-08-01T19:53:22.744 INFO:teuthology.orchestra.run.smithi008.stdout: filestore xattr use omap = true 2023-08-01T19:53:22.744 INFO:teuthology.orchestra.run.smithi008.stdout: 2023-08-01T19:53:22.744 INFO:teuthology.orchestra.run.smithi008.stdout: mon clock drift allowed = 1.000 2023-08-01T19:53:22.744 INFO:teuthology.orchestra.run.smithi008.stdout: 2023-08-01T19:53:22.744 INFO:teuthology.orchestra.run.smithi008.stdout: osd crush chooseleaf type = 0 2023-08-01T19:53:22.744 INFO:teuthology.orchestra.run.smithi008.stdout: auth debug = true 2023-08-01T19:53:22.745 INFO:teuthology.orchestra.run.smithi008.stdout: 2023-08-01T19:53:22.745 INFO:teuthology.orchestra.run.smithi008.stdout: ms die on old message = true 2023-08-01T19:53:22.745 INFO:teuthology.orchestra.run.smithi008.stdout: ms die on bug = true 2023-08-01T19:53:22.745 INFO:teuthology.orchestra.run.smithi008.stdout: 2023-08-01T19:53:22.745 INFO:teuthology.orchestra.run.smithi008.stdout: mon max pg per osd = 10000 # >= luminous 2023-08-01T19:53:22.745 INFO:teuthology.orchestra.run.smithi008.stdout: mon pg warn max object skew = 0 2023-08-01T19:53:22.746 INFO:teuthology.orchestra.run.smithi008.stdout: 2023-08-01T19:53:22.746 INFO:teuthology.orchestra.run.smithi008.stdout: # disable pg_autoscaler by default for new pools 2023-08-01T19:53:22.746 INFO:teuthology.orchestra.run.smithi008.stdout: osd_pool_default_pg_autoscale_mode = off 2023-08-01T19:53:22.746 INFO:teuthology.orchestra.run.smithi008.stdout: 2023-08-01T19:53:22.746 INFO:teuthology.orchestra.run.smithi008.stdout: osd pool default size = 2 2023-08-01T19:53:22.746 INFO:teuthology.orchestra.run.smithi008.stdout: 2023-08-01T19:53:22.746 INFO:teuthology.orchestra.run.smithi008.stdout: mon osd allow primary affinity = true 2023-08-01T19:53:22.747 INFO:teuthology.orchestra.run.smithi008.stdout: mon osd allow pg remap = true 2023-08-01T19:53:22.747 INFO:teuthology.orchestra.run.smithi008.stdout: mon warn on legacy crush tunables = false 2023-08-01T19:53:22.747 INFO:teuthology.orchestra.run.smithi008.stdout: mon warn on crush straw calc version zero = false 2023-08-01T19:53:22.747 INFO:teuthology.orchestra.run.smithi008.stdout: mon warn on no sortbitwise = false 2023-08-01T19:53:22.747 INFO:teuthology.orchestra.run.smithi008.stdout: mon warn on osd down out interval zero = false 2023-08-01T19:53:22.747 INFO:teuthology.orchestra.run.smithi008.stdout: mon warn on too few osds = false 2023-08-01T19:53:22.747 INFO:teuthology.orchestra.run.smithi008.stdout: mon_warn_on_pool_pg_num_not_power_of_two = false 2023-08-01T19:53:22.747 INFO:teuthology.orchestra.run.smithi008.stdout: mon_warn_on_pool_no_redundancy = false 2023-08-01T19:53:22.748 INFO:teuthology.orchestra.run.smithi008.stdout: mon_allow_pool_size_one = true 2023-08-01T19:53:22.748 INFO:teuthology.orchestra.run.smithi008.stdout: 2023-08-01T19:53:22.748 INFO:teuthology.orchestra.run.smithi008.stdout: osd pool default erasure code profile = plugin=jerasure technique=reed_sol_van k=2 m=1 crush-failure-domain=osd 2023-08-01T19:53:22.748 INFO:teuthology.orchestra.run.smithi008.stdout: 2023-08-01T19:53:22.748 INFO:teuthology.orchestra.run.smithi008.stdout: osd default data pool replay window = 5 2023-08-01T19:53:22.748 INFO:teuthology.orchestra.run.smithi008.stdout: 2023-08-01T19:53:22.749 INFO:teuthology.orchestra.run.smithi008.stdout: mon allow pool delete = true 2023-08-01T19:53:22.749 INFO:teuthology.orchestra.run.smithi008.stdout: 2023-08-01T19:53:22.749 INFO:teuthology.orchestra.run.smithi008.stdout: mon cluster log file level = debug 2023-08-01T19:53:22.749 INFO:teuthology.orchestra.run.smithi008.stdout: debug asserts on shutdown = true 2023-08-01T19:53:22.749 INFO:teuthology.orchestra.run.smithi008.stdout: mon health detail to clog = false 2023-08-01T19:53:22.749 INFO:teuthology.orchestra.run.smithi008.stdout: mon host = "172.21.15.6,[v2:172.21.15.6:3301,v1:172.21.15.6:6790],[v2:172.21.15.6:3302,v1:172.21.15.6:6791]" 2023-08-01T19:53:22.749 INFO:teuthology.orchestra.run.smithi008.stdout: fsid = a0e420cc-4df1-42a5-8bd4-a98c309a9349 2023-08-01T19:53:22.750 INFO:teuthology.orchestra.run.smithi008.stdout: 2023-08-01T19:53:22.750 INFO:teuthology.orchestra.run.smithi008.stdout:[osd] 2023-08-01T19:53:22.750 INFO:teuthology.orchestra.run.smithi008.stdout: osd journal size = 100 2023-08-01T19:53:22.750 INFO:teuthology.orchestra.run.smithi008.stdout: 2023-08-01T19:53:22.750 INFO:teuthology.orchestra.run.smithi008.stdout: osd scrub load threshold = 5.0 2023-08-01T19:53:22.750 INFO:teuthology.orchestra.run.smithi008.stdout: osd scrub max interval = 600 2023-08-01T19:53:22.750 INFO:teuthology.orchestra.run.smithi008.stdout: osd mclock profile = high_recovery_ops 2023-08-01T19:53:22.751 INFO:teuthology.orchestra.run.smithi008.stdout: 2023-08-01T19:53:22.751 INFO:teuthology.orchestra.run.smithi008.stdout: osd recover clone overlap = true 2023-08-01T19:53:22.751 INFO:teuthology.orchestra.run.smithi008.stdout: osd recovery max chunk = 1048576 2023-08-01T19:53:22.751 INFO:teuthology.orchestra.run.smithi008.stdout: 2023-08-01T19:53:22.751 INFO:teuthology.orchestra.run.smithi008.stdout: osd debug shutdown = true 2023-08-01T19:53:22.751 INFO:teuthology.orchestra.run.smithi008.stdout: osd debug op order = true 2023-08-01T19:53:22.751 INFO:teuthology.orchestra.run.smithi008.stdout: osd debug verify stray on activate = true 2023-08-01T19:53:22.752 INFO:teuthology.orchestra.run.smithi008.stdout: 2023-08-01T19:53:22.752 INFO:teuthology.orchestra.run.smithi008.stdout: osd open classes on start = true 2023-08-01T19:53:22.752 INFO:teuthology.orchestra.run.smithi008.stdout: osd debug pg log writeout = true 2023-08-01T19:53:22.752 INFO:teuthology.orchestra.run.smithi008.stdout: 2023-08-01T19:53:22.752 INFO:teuthology.orchestra.run.smithi008.stdout: osd deep scrub update digest min age = 30 2023-08-01T19:53:22.752 INFO:teuthology.orchestra.run.smithi008.stdout: 2023-08-01T19:53:22.752 INFO:teuthology.orchestra.run.smithi008.stdout: osd map max advance = 10 2023-08-01T19:53:22.753 INFO:teuthology.orchestra.run.smithi008.stdout: 2023-08-01T19:53:22.753 INFO:teuthology.orchestra.run.smithi008.stdout: journal zero on create = true 2023-08-01T19:53:22.753 INFO:teuthology.orchestra.run.smithi008.stdout: 2023-08-01T19:53:22.753 INFO:teuthology.orchestra.run.smithi008.stdout: filestore ondisk finisher threads = 3 2023-08-01T19:53:22.753 INFO:teuthology.orchestra.run.smithi008.stdout: filestore apply finisher threads = 3 2023-08-01T19:53:22.753 INFO:teuthology.orchestra.run.smithi008.stdout: 2023-08-01T19:53:22.753 INFO:teuthology.orchestra.run.smithi008.stdout: bdev debug aio = true 2023-08-01T19:53:22.754 INFO:teuthology.orchestra.run.smithi008.stdout: osd debug misdirected ops = true 2023-08-01T19:53:22.754 INFO:teuthology.orchestra.run.smithi008.stdout: bluestore block size = 96636764160 2023-08-01T19:53:22.754 INFO:teuthology.orchestra.run.smithi008.stdout: bluestore compression algorithm = lz4 2023-08-01T19:53:22.754 INFO:teuthology.orchestra.run.smithi008.stdout: bluestore compression mode = aggressive 2023-08-01T19:53:22.754 INFO:teuthology.orchestra.run.smithi008.stdout: bluestore fsck on mount = True 2023-08-01T19:53:22.754 INFO:teuthology.orchestra.run.smithi008.stdout: debug bluefs = 1/20 2023-08-01T19:53:22.754 INFO:teuthology.orchestra.run.smithi008.stdout: debug bluestore = 1/20 2023-08-01T19:53:22.754 INFO:teuthology.orchestra.run.smithi008.stdout: debug ms = 1 2023-08-01T19:53:22.755 INFO:teuthology.orchestra.run.smithi008.stdout: debug osd = 20 2023-08-01T19:53:22.755 INFO:teuthology.orchestra.run.smithi008.stdout: debug rocksdb = 4/10 2023-08-01T19:53:22.755 INFO:teuthology.orchestra.run.smithi008.stdout: mon osd backfillfull_ratio = 0.85 2023-08-01T19:53:22.755 INFO:teuthology.orchestra.run.smithi008.stdout: mon osd full ratio = 0.9 2023-08-01T19:53:22.755 INFO:teuthology.orchestra.run.smithi008.stdout: mon osd nearfull ratio = 0.8 2023-08-01T19:53:22.755 INFO:teuthology.orchestra.run.smithi008.stdout: osd failsafe full ratio = 0.95 2023-08-01T19:53:22.755 INFO:teuthology.orchestra.run.smithi008.stdout: osd max markdown count = 1000 2023-08-01T19:53:22.756 INFO:teuthology.orchestra.run.smithi008.stdout: osd objectstore = bluestore 2023-08-01T19:53:22.756 INFO:teuthology.orchestra.run.smithi008.stdout: 2023-08-01T19:53:22.756 INFO:teuthology.orchestra.run.smithi008.stdout:[mgr] 2023-08-01T19:53:22.756 INFO:teuthology.orchestra.run.smithi008.stdout: debug ms = 1 2023-08-01T19:53:22.756 INFO:teuthology.orchestra.run.smithi008.stdout: debug mgr = 20 2023-08-01T19:53:22.756 INFO:teuthology.orchestra.run.smithi008.stdout: debug mon = 20 2023-08-01T19:53:22.757 INFO:teuthology.orchestra.run.smithi008.stdout: debug auth = 20 2023-08-01T19:53:22.757 INFO:teuthology.orchestra.run.smithi008.stdout: mon reweight min pgs per osd = 4 2023-08-01T19:53:22.757 INFO:teuthology.orchestra.run.smithi008.stdout: mon reweight min bytes per osd = 10 2023-08-01T19:53:22.757 INFO:teuthology.orchestra.run.smithi008.stdout: mgr/telemetry/nag = false 2023-08-01T19:53:22.757 INFO:teuthology.orchestra.run.smithi008.stdout: 2023-08-01T19:53:22.757 INFO:teuthology.orchestra.run.smithi008.stdout:[mon] 2023-08-01T19:53:22.757 INFO:teuthology.orchestra.run.smithi008.stdout: debug ms = 1 2023-08-01T19:53:22.758 INFO:teuthology.orchestra.run.smithi008.stdout: debug mon = 20 2023-08-01T19:53:22.758 INFO:teuthology.orchestra.run.smithi008.stdout: debug paxos = 20 2023-08-01T19:53:22.758 INFO:teuthology.orchestra.run.smithi008.stdout: debug auth = 20 2023-08-01T19:53:22.758 INFO:teuthology.orchestra.run.smithi008.stdout: mon data avail warn = 5 2023-08-01T19:53:22.758 INFO:teuthology.orchestra.run.smithi008.stdout: mon mgr mkfs grace = 240 2023-08-01T19:53:22.758 INFO:teuthology.orchestra.run.smithi008.stdout: mon reweight min pgs per osd = 4 2023-08-01T19:53:22.758 INFO:teuthology.orchestra.run.smithi008.stdout: mon osd reporter subtree level = osd 2023-08-01T19:53:22.758 INFO:teuthology.orchestra.run.smithi008.stdout: mon osd prime pg temp = true 2023-08-01T19:53:22.759 INFO:teuthology.orchestra.run.smithi008.stdout: mon reweight min bytes per osd = 10 2023-08-01T19:53:22.759 INFO:teuthology.orchestra.run.smithi008.stdout: 2023-08-01T19:53:22.759 INFO:teuthology.orchestra.run.smithi008.stdout: # rotate auth tickets quickly to exercise renewal paths 2023-08-01T19:53:22.759 INFO:teuthology.orchestra.run.smithi008.stdout: auth mon ticket ttl = 660 # 11m 2023-08-01T19:53:22.759 INFO:teuthology.orchestra.run.smithi008.stdout: auth service ticket ttl = 240 # 4m 2023-08-01T19:53:22.759 INFO:teuthology.orchestra.run.smithi008.stdout: 2023-08-01T19:53:22.759 INFO:teuthology.orchestra.run.smithi008.stdout: # don't complain about insecure global_id in the test suite 2023-08-01T19:53:22.760 INFO:teuthology.orchestra.run.smithi008.stdout: mon_warn_on_insecure_global_id_reclaim = false 2023-08-01T19:53:22.760 INFO:teuthology.orchestra.run.smithi008.stdout: mon_warn_on_insecure_global_id_reclaim_allowed = false 2023-08-01T19:53:22.760 INFO:teuthology.orchestra.run.smithi008.stdout: 2023-08-01T19:53:22.760 INFO:teuthology.orchestra.run.smithi008.stdout: # 1m isn't quite enough 2023-08-01T19:53:22.760 INFO:teuthology.orchestra.run.smithi008.stdout: mon_down_mkfs_grace = 2m 2023-08-01T19:53:22.760 INFO:teuthology.orchestra.run.smithi008.stdout: 2023-08-01T19:53:22.760 INFO:teuthology.orchestra.run.smithi008.stdout: mon_warn_on_filestore_osds = false 2023-08-01T19:53:22.761 INFO:teuthology.orchestra.run.smithi008.stdout: 2023-08-01T19:53:22.761 INFO:teuthology.orchestra.run.smithi008.stdout:[client] 2023-08-01T19:53:22.761 INFO:teuthology.orchestra.run.smithi008.stdout: rgw cache enabled = true 2023-08-01T19:53:22.761 INFO:teuthology.orchestra.run.smithi008.stdout: rgw enable ops log = true 2023-08-01T19:53:22.761 INFO:teuthology.orchestra.run.smithi008.stdout: rgw enable usage log = true 2023-08-01T19:53:22.761 INFO:teuthology.orchestra.run.smithi008.stdout: log file = /var/log/ceph/$cluster-$name.$pid.log 2023-08-01T19:53:22.761 INFO:teuthology.orchestra.run.smithi008.stdout: admin socket = /var/run/ceph/$cluster-$name.$pid.asok 2023-08-01T19:53:22.762 INFO:teuthology.orchestra.run.smithi008.stdout:[mon.a] 2023-08-01T19:53:22.762 INFO:teuthology.orchestra.run.smithi008.stdout:[mon.b] 2023-08-01T19:53:22.762 INFO:teuthology.orchestra.run.smithi008.stdout:[mon.c] 2023-08-01T19:53:22.762 INFO:teuthology.orchestra.run.smithi008.stdout:[mds.a] 2023-08-01T19:53:22.762 INFO:teuthology.orchestra.run.smithi008.stdout:[client.0] 2023-08-01T19:53:22.762 INFO:teuthology.orchestra.run.smithi008.stdout: admin socket = /var/run/ceph/ceph-$name.asok 2023-08-01T19:53:22.763 INFO:teuthology.orchestra.run.smithi155.stdout:[global] 2023-08-01T19:53:22.764 INFO:teuthology.orchestra.run.smithi155.stdout: chdir = "" 2023-08-01T19:53:22.764 INFO:teuthology.orchestra.run.smithi155.stdout: pid file = /var/run/ceph/$cluster-$name.pid 2023-08-01T19:53:22.764 INFO:teuthology.orchestra.run.smithi155.stdout: auth supported = cephx 2023-08-01T19:53:22.764 INFO:teuthology.orchestra.run.smithi155.stdout: 2023-08-01T19:53:22.764 INFO:teuthology.orchestra.run.smithi155.stdout: filestore xattr use omap = true 2023-08-01T19:53:22.764 INFO:teuthology.orchestra.run.smithi155.stdout: 2023-08-01T19:53:22.765 INFO:teuthology.orchestra.run.smithi155.stdout: mon clock drift allowed = 1.000 2023-08-01T19:53:22.765 INFO:teuthology.orchestra.run.smithi155.stdout: 2023-08-01T19:53:22.765 INFO:teuthology.orchestra.run.smithi155.stdout: osd crush chooseleaf type = 0 2023-08-01T19:53:22.765 INFO:teuthology.orchestra.run.smithi155.stdout: auth debug = true 2023-08-01T19:53:22.765 INFO:teuthology.orchestra.run.smithi155.stdout: 2023-08-01T19:53:22.765 INFO:teuthology.orchestra.run.smithi155.stdout: ms die on old message = true 2023-08-01T19:53:22.765 INFO:teuthology.orchestra.run.smithi155.stdout: ms die on bug = true 2023-08-01T19:53:22.766 INFO:teuthology.orchestra.run.smithi155.stdout: 2023-08-01T19:53:22.766 INFO:teuthology.orchestra.run.smithi155.stdout: mon max pg per osd = 10000 # >= luminous 2023-08-01T19:53:22.766 INFO:teuthology.orchestra.run.smithi155.stdout: mon pg warn max object skew = 0 2023-08-01T19:53:22.766 INFO:teuthology.orchestra.run.smithi155.stdout: 2023-08-01T19:53:22.766 INFO:teuthology.orchestra.run.smithi155.stdout: # disable pg_autoscaler by default for new pools 2023-08-01T19:53:22.766 INFO:teuthology.orchestra.run.smithi155.stdout: osd_pool_default_pg_autoscale_mode = off 2023-08-01T19:53:22.766 INFO:teuthology.orchestra.run.smithi155.stdout: 2023-08-01T19:53:22.766 INFO:teuthology.orchestra.run.smithi155.stdout: osd pool default size = 2 2023-08-01T19:53:22.767 INFO:teuthology.orchestra.run.smithi155.stdout: 2023-08-01T19:53:22.767 INFO:teuthology.orchestra.run.smithi155.stdout: mon osd allow primary affinity = true 2023-08-01T19:53:22.767 INFO:teuthology.orchestra.run.smithi155.stdout: mon osd allow pg remap = true 2023-08-01T19:53:22.767 INFO:teuthology.orchestra.run.smithi155.stdout: mon warn on legacy crush tunables = false 2023-08-01T19:53:22.767 INFO:teuthology.orchestra.run.smithi155.stdout: mon warn on crush straw calc version zero = false 2023-08-01T19:53:22.767 INFO:teuthology.orchestra.run.smithi155.stdout: mon warn on no sortbitwise = false 2023-08-01T19:53:22.767 INFO:teuthology.orchestra.run.smithi155.stdout: mon warn on osd down out interval zero = false 2023-08-01T19:53:22.768 INFO:teuthology.orchestra.run.smithi155.stdout: mon warn on too few osds = false 2023-08-01T19:53:22.768 INFO:teuthology.orchestra.run.smithi155.stdout: mon_warn_on_pool_pg_num_not_power_of_two = false 2023-08-01T19:53:22.768 INFO:teuthology.orchestra.run.smithi155.stdout: mon_warn_on_pool_no_redundancy = false 2023-08-01T19:53:22.768 INFO:teuthology.orchestra.run.smithi155.stdout: mon_allow_pool_size_one = true 2023-08-01T19:53:22.768 INFO:teuthology.orchestra.run.smithi155.stdout: 2023-08-01T19:53:22.768 INFO:teuthology.orchestra.run.smithi155.stdout: osd pool default erasure code profile = plugin=jerasure technique=reed_sol_van k=2 m=1 crush-failure-domain=osd 2023-08-01T19:53:22.768 INFO:teuthology.orchestra.run.smithi155.stdout: 2023-08-01T19:53:22.769 INFO:teuthology.orchestra.run.smithi155.stdout: osd default data pool replay window = 5 2023-08-01T19:53:22.769 INFO:teuthology.orchestra.run.smithi155.stdout: 2023-08-01T19:53:22.769 INFO:teuthology.orchestra.run.smithi155.stdout: mon allow pool delete = true 2023-08-01T19:53:22.769 INFO:teuthology.orchestra.run.smithi155.stdout: 2023-08-01T19:53:22.769 INFO:teuthology.orchestra.run.smithi155.stdout: mon cluster log file level = debug 2023-08-01T19:53:22.769 INFO:teuthology.orchestra.run.smithi155.stdout: debug asserts on shutdown = true 2023-08-01T19:53:22.769 INFO:teuthology.orchestra.run.smithi155.stdout: mon health detail to clog = false 2023-08-01T19:53:22.770 INFO:teuthology.orchestra.run.smithi155.stdout: mon host = "172.21.15.6,[v2:172.21.15.6:3301,v1:172.21.15.6:6790],[v2:172.21.15.6:3302,v1:172.21.15.6:6791]" 2023-08-01T19:53:22.770 INFO:teuthology.orchestra.run.smithi155.stdout: fsid = a0e420cc-4df1-42a5-8bd4-a98c309a9349 2023-08-01T19:53:22.770 INFO:teuthology.orchestra.run.smithi155.stdout: 2023-08-01T19:53:22.770 INFO:teuthology.orchestra.run.smithi155.stdout:[osd] 2023-08-01T19:53:22.770 INFO:teuthology.orchestra.run.smithi155.stdout: osd journal size = 100 2023-08-01T19:53:22.770 INFO:teuthology.orchestra.run.smithi155.stdout: 2023-08-01T19:53:22.770 INFO:teuthology.orchestra.run.smithi155.stdout: osd scrub load threshold = 5.0 2023-08-01T19:53:22.771 INFO:teuthology.orchestra.run.smithi155.stdout: osd scrub max interval = 600 2023-08-01T19:53:22.771 INFO:teuthology.orchestra.run.smithi155.stdout: osd mclock profile = high_recovery_ops 2023-08-01T19:53:22.771 INFO:teuthology.orchestra.run.smithi155.stdout: 2023-08-01T19:53:22.771 INFO:teuthology.orchestra.run.smithi155.stdout: osd recover clone overlap = true 2023-08-01T19:53:22.771 INFO:teuthology.orchestra.run.smithi155.stdout: osd recovery max chunk = 1048576 2023-08-01T19:53:22.771 INFO:teuthology.orchestra.run.smithi155.stdout: 2023-08-01T19:53:22.771 INFO:teuthology.orchestra.run.smithi155.stdout: osd debug shutdown = true 2023-08-01T19:53:22.772 INFO:teuthology.orchestra.run.smithi155.stdout: osd debug op order = true 2023-08-01T19:53:22.772 INFO:teuthology.orchestra.run.smithi155.stdout: osd debug verify stray on activate = true 2023-08-01T19:53:22.772 INFO:teuthology.orchestra.run.smithi155.stdout: 2023-08-01T19:53:22.772 INFO:teuthology.orchestra.run.smithi155.stdout: osd open classes on start = true 2023-08-01T19:53:22.772 INFO:teuthology.orchestra.run.smithi155.stdout: osd debug pg log writeout = true 2023-08-01T19:53:22.772 INFO:teuthology.orchestra.run.smithi155.stdout: 2023-08-01T19:53:22.772 INFO:teuthology.orchestra.run.smithi155.stdout: osd deep scrub update digest min age = 30 2023-08-01T19:53:22.773 INFO:teuthology.orchestra.run.smithi155.stdout: 2023-08-01T19:53:22.773 INFO:teuthology.orchestra.run.smithi155.stdout: osd map max advance = 10 2023-08-01T19:53:22.773 INFO:teuthology.orchestra.run.smithi155.stdout: 2023-08-01T19:53:22.773 INFO:teuthology.orchestra.run.smithi155.stdout: journal zero on create = true 2023-08-01T19:53:22.773 INFO:teuthology.orchestra.run.smithi155.stdout: 2023-08-01T19:53:22.773 INFO:teuthology.orchestra.run.smithi155.stdout: filestore ondisk finisher threads = 3 2023-08-01T19:53:22.773 INFO:teuthology.orchestra.run.smithi155.stdout: filestore apply finisher threads = 3 2023-08-01T19:53:22.773 INFO:teuthology.orchestra.run.smithi155.stdout: 2023-08-01T19:53:22.774 INFO:teuthology.orchestra.run.smithi155.stdout: bdev debug aio = true 2023-08-01T19:53:22.774 INFO:teuthology.orchestra.run.smithi155.stdout: osd debug misdirected ops = true 2023-08-01T19:53:22.774 INFO:teuthology.orchestra.run.smithi155.stdout: bluestore block size = 96636764160 2023-08-01T19:53:22.774 INFO:teuthology.orchestra.run.smithi155.stdout: bluestore compression algorithm = lz4 2023-08-01T19:53:22.774 INFO:teuthology.orchestra.run.smithi155.stdout: bluestore compression mode = aggressive 2023-08-01T19:53:22.774 INFO:teuthology.orchestra.run.smithi155.stdout: bluestore fsck on mount = True 2023-08-01T19:53:22.774 INFO:teuthology.orchestra.run.smithi155.stdout: debug bluefs = 1/20 2023-08-01T19:53:22.775 INFO:teuthology.orchestra.run.smithi155.stdout: debug bluestore = 1/20 2023-08-01T19:53:22.775 INFO:teuthology.orchestra.run.smithi155.stdout: debug ms = 1 2023-08-01T19:53:22.775 INFO:teuthology.orchestra.run.smithi155.stdout: debug osd = 20 2023-08-01T19:53:22.775 INFO:teuthology.orchestra.run.smithi155.stdout: debug rocksdb = 4/10 2023-08-01T19:53:22.775 INFO:teuthology.orchestra.run.smithi155.stdout: mon osd backfillfull_ratio = 0.85 2023-08-01T19:53:22.775 INFO:teuthology.orchestra.run.smithi155.stdout: mon osd full ratio = 0.9 2023-08-01T19:53:22.775 INFO:teuthology.orchestra.run.smithi155.stdout: mon osd nearfull ratio = 0.8 2023-08-01T19:53:22.776 INFO:teuthology.orchestra.run.smithi155.stdout: osd failsafe full ratio = 0.95 2023-08-01T19:53:22.776 INFO:teuthology.orchestra.run.smithi155.stdout: osd max markdown count = 1000 2023-08-01T19:53:22.776 INFO:teuthology.orchestra.run.smithi155.stdout: osd objectstore = bluestore 2023-08-01T19:53:22.776 INFO:teuthology.orchestra.run.smithi155.stdout: 2023-08-01T19:53:22.776 INFO:teuthology.orchestra.run.smithi155.stdout:[mgr] 2023-08-01T19:53:22.776 INFO:teuthology.orchestra.run.smithi155.stdout: debug ms = 1 2023-08-01T19:53:22.776 INFO:teuthology.orchestra.run.smithi155.stdout: debug mgr = 20 2023-08-01T19:53:22.777 INFO:teuthology.orchestra.run.smithi155.stdout: debug mon = 20 2023-08-01T19:53:22.777 INFO:teuthology.orchestra.run.smithi155.stdout: debug auth = 20 2023-08-01T19:53:22.777 INFO:teuthology.orchestra.run.smithi155.stdout: mon reweight min pgs per osd = 4 2023-08-01T19:53:22.777 INFO:teuthology.orchestra.run.smithi155.stdout: mon reweight min bytes per osd = 10 2023-08-01T19:53:22.777 INFO:teuthology.orchestra.run.smithi155.stdout: mgr/telemetry/nag = false 2023-08-01T19:53:22.777 INFO:teuthology.orchestra.run.smithi155.stdout: 2023-08-01T19:53:22.777 INFO:teuthology.orchestra.run.smithi155.stdout:[mon] 2023-08-01T19:53:22.778 INFO:teuthology.orchestra.run.smithi155.stdout: debug ms = 1 2023-08-01T19:53:22.778 INFO:teuthology.orchestra.run.smithi155.stdout: debug mon = 20 2023-08-01T19:53:22.778 INFO:teuthology.orchestra.run.smithi155.stdout: debug paxos = 20 2023-08-01T19:53:22.778 INFO:teuthology.orchestra.run.smithi155.stdout: debug auth = 20 2023-08-01T19:53:22.778 INFO:teuthology.orchestra.run.smithi155.stdout: mon data avail warn = 5 2023-08-01T19:53:22.778 INFO:teuthology.orchestra.run.smithi155.stdout: mon mgr mkfs grace = 240 2023-08-01T19:53:22.778 INFO:teuthology.orchestra.run.smithi155.stdout: mon reweight min pgs per osd = 4 2023-08-01T19:53:22.778 INFO:teuthology.orchestra.run.smithi155.stdout: mon osd reporter subtree level = osd 2023-08-01T19:53:22.779 INFO:teuthology.orchestra.run.smithi155.stdout: mon osd prime pg temp = true 2023-08-01T19:53:22.779 INFO:teuthology.orchestra.run.smithi155.stdout: mon reweight min bytes per osd = 10 2023-08-01T19:53:22.779 INFO:teuthology.orchestra.run.smithi155.stdout: 2023-08-01T19:53:22.779 INFO:teuthology.orchestra.run.smithi155.stdout: # rotate auth tickets quickly to exercise renewal paths 2023-08-01T19:53:22.779 INFO:teuthology.orchestra.run.smithi155.stdout: auth mon ticket ttl = 660 # 11m 2023-08-01T19:53:22.779 INFO:teuthology.orchestra.run.smithi155.stdout: auth service ticket ttl = 240 # 4m 2023-08-01T19:53:22.779 INFO:teuthology.orchestra.run.smithi155.stdout: 2023-08-01T19:53:22.780 INFO:teuthology.orchestra.run.smithi155.stdout: # don't complain about insecure global_id in the test suite 2023-08-01T19:53:22.780 INFO:teuthology.orchestra.run.smithi155.stdout: mon_warn_on_insecure_global_id_reclaim = false 2023-08-01T19:53:22.780 INFO:teuthology.orchestra.run.smithi155.stdout: mon_warn_on_insecure_global_id_reclaim_allowed = false 2023-08-01T19:53:22.780 INFO:teuthology.orchestra.run.smithi155.stdout: 2023-08-01T19:53:22.780 INFO:teuthology.orchestra.run.smithi155.stdout: # 1m isn't quite enough 2023-08-01T19:53:22.780 INFO:teuthology.orchestra.run.smithi155.stdout: mon_down_mkfs_grace = 2m 2023-08-01T19:53:22.780 INFO:teuthology.orchestra.run.smithi155.stdout: 2023-08-01T19:53:22.781 INFO:teuthology.orchestra.run.smithi155.stdout: mon_warn_on_filestore_osds = false 2023-08-01T19:53:22.781 INFO:teuthology.orchestra.run.smithi155.stdout: 2023-08-01T19:53:22.781 INFO:teuthology.orchestra.run.smithi155.stdout:[client] 2023-08-01T19:53:22.781 INFO:teuthology.orchestra.run.smithi155.stdout: rgw cache enabled = true 2023-08-01T19:53:22.781 INFO:teuthology.orchestra.run.smithi155.stdout: rgw enable ops log = true 2023-08-01T19:53:22.781 INFO:teuthology.orchestra.run.smithi155.stdout: rgw enable usage log = true 2023-08-01T19:53:22.781 INFO:teuthology.orchestra.run.smithi155.stdout: log file = /var/log/ceph/$cluster-$name.$pid.log 2023-08-01T19:53:22.782 INFO:teuthology.orchestra.run.smithi155.stdout: admin socket = /var/run/ceph/$cluster-$name.$pid.asok 2023-08-01T19:53:22.782 INFO:teuthology.orchestra.run.smithi155.stdout:[mon.a] 2023-08-01T19:53:22.782 INFO:teuthology.orchestra.run.smithi155.stdout:[mon.b] 2023-08-01T19:53:22.782 INFO:teuthology.orchestra.run.smithi155.stdout:[mon.c] 2023-08-01T19:53:22.782 INFO:teuthology.orchestra.run.smithi155.stdout:[mds.a] 2023-08-01T19:53:22.782 INFO:teuthology.orchestra.run.smithi155.stdout:[client.0] 2023-08-01T19:53:22.782 INFO:teuthology.orchestra.run.smithi155.stdout: admin socket = /var/run/ceph/ceph-$name.asok 2023-08-01T19:53:22.783 INFO:tasks.ceph:Creating admin key on mon.a... 2023-08-01T19:53:22.784 DEBUG:teuthology.orchestra.run.smithi006:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage ceph-authtool --gen-key --name=client.admin --cap mon 'allow *' --cap osd 'allow *' --cap mds 'allow *' --cap mgr 'allow *' /etc/ceph/ceph.keyring 2023-08-01T19:53:22.859 INFO:tasks.ceph:Copying monmap to all nodes... 2023-08-01T19:53:22.860 DEBUG:teuthology.orchestra.run.smithi006:> set -ex 2023-08-01T19:53:22.860 DEBUG:teuthology.orchestra.run.smithi006:> dd if=/etc/ceph/ceph.keyring of=/dev/stdout 2023-08-01T19:53:22.878 DEBUG:teuthology.orchestra.run.smithi006:> set -ex 2023-08-01T19:53:22.878 DEBUG:teuthology.orchestra.run.smithi006:> dd if=/home/ubuntu/cephtest/ceph.monmap of=/dev/stdout 2023-08-01T19:53:22.935 INFO:tasks.ceph:Sending monmap to node ubuntu@smithi006.front.sepia.ceph.com 2023-08-01T19:53:22.936 DEBUG:teuthology.orchestra.run.smithi006:> set -ex 2023-08-01T19:53:22.936 DEBUG:teuthology.orchestra.run.smithi006:> sudo dd of=/etc/ceph/ceph.keyring 2023-08-01T19:53:22.936 DEBUG:teuthology.orchestra.run.smithi006:> sudo chmod 0644 /etc/ceph/ceph.keyring 2023-08-01T19:53:23.013 DEBUG:teuthology.orchestra.run.smithi006:> set -ex 2023-08-01T19:53:23.013 DEBUG:teuthology.orchestra.run.smithi006:> dd of=/home/ubuntu/cephtest/ceph.monmap 2023-08-01T19:53:23.071 INFO:tasks.ceph:Sending monmap to node ubuntu@smithi008.front.sepia.ceph.com 2023-08-01T19:53:23.071 DEBUG:teuthology.orchestra.run.smithi008:> set -ex 2023-08-01T19:53:23.071 DEBUG:teuthology.orchestra.run.smithi008:> sudo dd of=/etc/ceph/ceph.keyring 2023-08-01T19:53:23.072 DEBUG:teuthology.orchestra.run.smithi008:> sudo chmod 0644 /etc/ceph/ceph.keyring 2023-08-01T19:53:23.116 DEBUG:teuthology.orchestra.run.smithi008:> set -ex 2023-08-01T19:53:23.117 DEBUG:teuthology.orchestra.run.smithi008:> dd of=/home/ubuntu/cephtest/ceph.monmap 2023-08-01T19:53:23.177 INFO:tasks.ceph:Sending monmap to node ubuntu@smithi101.front.sepia.ceph.com 2023-08-01T19:53:23.177 DEBUG:teuthology.orchestra.run.smithi101:> set -ex 2023-08-01T19:53:23.177 DEBUG:teuthology.orchestra.run.smithi101:> sudo dd of=/etc/ceph/ceph.keyring 2023-08-01T19:53:23.178 DEBUG:teuthology.orchestra.run.smithi101:> sudo chmod 0644 /etc/ceph/ceph.keyring 2023-08-01T19:53:23.221 DEBUG:teuthology.orchestra.run.smithi101:> set -ex 2023-08-01T19:53:23.221 DEBUG:teuthology.orchestra.run.smithi101:> dd of=/home/ubuntu/cephtest/ceph.monmap 2023-08-01T19:53:23.281 INFO:tasks.ceph:Sending monmap to node ubuntu@smithi155.front.sepia.ceph.com 2023-08-01T19:53:23.281 DEBUG:teuthology.orchestra.run.smithi155:> set -ex 2023-08-01T19:53:23.282 DEBUG:teuthology.orchestra.run.smithi155:> sudo dd of=/etc/ceph/ceph.keyring 2023-08-01T19:53:23.282 DEBUG:teuthology.orchestra.run.smithi155:> sudo chmod 0644 /etc/ceph/ceph.keyring 2023-08-01T19:53:23.323 DEBUG:teuthology.orchestra.run.smithi155:> set -ex 2023-08-01T19:53:23.323 DEBUG:teuthology.orchestra.run.smithi155:> dd of=/home/ubuntu/cephtest/ceph.monmap 2023-08-01T19:53:23.381 INFO:tasks.ceph:Setting up mon nodes... 2023-08-01T19:53:23.382 INFO:tasks.ceph:Setting up mgr nodes... 2023-08-01T19:53:23.382 DEBUG:teuthology.orchestra.run.smithi006:> sudo mkdir -p /var/lib/ceph/mgr/ceph-x && sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage ceph-authtool --create-keyring --gen-key --name=mgr.x /var/lib/ceph/mgr/ceph-x/keyring 2023-08-01T19:53:23.435 INFO:teuthology.orchestra.run.smithi006.stdout:creating /var/lib/ceph/mgr/ceph-x/keyring 2023-08-01T19:53:23.437 DEBUG:teuthology.orchestra.run.smithi006:> sudo mkdir -p /var/lib/ceph/mgr/ceph-y && sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage ceph-authtool --create-keyring --gen-key --name=mgr.y /var/lib/ceph/mgr/ceph-y/keyring 2023-08-01T19:53:23.488 INFO:teuthology.orchestra.run.smithi006.stdout:creating /var/lib/ceph/mgr/ceph-y/keyring 2023-08-01T19:53:23.490 INFO:tasks.ceph:Setting up mds nodes... 2023-08-01T19:53:23.491 DEBUG:teuthology.orchestra.run.smithi006:> sudo mkdir -p /var/lib/ceph/mds/ceph-a && sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage ceph-authtool --create-keyring --gen-key --name=mds.a /var/lib/ceph/mds/ceph-a/keyring 2023-08-01T19:53:23.542 INFO:teuthology.orchestra.run.smithi006.stdout:creating /var/lib/ceph/mds/ceph-a/keyring 2023-08-01T19:53:23.544 DEBUG:teuthology.orchestra.run.smithi006:> sudo chown -R ceph:ceph /var/lib/ceph/mds/ceph-a 2023-08-01T19:53:23.572 INFO:tasks.ceph_client:Setting up client nodes... 2023-08-01T19:53:23.572 DEBUG:teuthology.orchestra.run.smithi006:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage ceph-authtool --create-keyring --gen-key --name=client.0 /etc/ceph/ceph.client.0.keyring && sudo chmod 0644 /etc/ceph/ceph.client.0.keyring 2023-08-01T19:53:23.653 INFO:teuthology.orchestra.run.smithi006.stdout:creating /etc/ceph/ceph.client.0.keyring 2023-08-01T19:53:23.666 INFO:tasks.ceph:Running mkfs on osd nodes... 2023-08-01T19:53:23.667 INFO:tasks.ceph:ctx.disk_config.remote_to_roles_to_dev: {Remote(name='ubuntu@smithi008.front.sepia.ceph.com'): {'osd.0': '/dev/vg_nvme/lv_1'}, Remote(name='ubuntu@smithi101.front.sepia.ceph.com'): {'osd.1': '/dev/vg_nvme/lv_1'}, Remote(name='ubuntu@smithi155.front.sepia.ceph.com'): {'osd.2': '/dev/vg_nvme/lv_1'}} 2023-08-01T19:53:23.667 DEBUG:teuthology.orchestra.run.smithi008:> sudo mkdir -p /var/lib/ceph/osd/ceph-0 2023-08-01T19:53:23.702 INFO:tasks.ceph:roles_to_devs: {'osd.0': '/dev/vg_nvme/lv_1'} 2023-08-01T19:53:23.702 INFO:tasks.ceph:role: osd.0 2023-08-01T19:53:23.702 INFO:tasks.ceph:['mkfs.xfs', '-f', '-i', 'size=2048'] on /dev/vg_nvme/lv_1 on ubuntu@smithi008.front.sepia.ceph.com 2023-08-01T19:53:23.703 DEBUG:teuthology.orchestra.run.smithi008:> yes | sudo mkfs.xfs -f -i size=2048 /dev/vg_nvme/lv_1 2023-08-01T19:53:23.773 INFO:teuthology.orchestra.run.smithi008.stdout:meta-data=/dev/vg_nvme/lv_1 isize=2048 agcount=4, agsize=5859072 blks 2023-08-01T19:53:23.773 INFO:teuthology.orchestra.run.smithi008.stdout: = sectsz=512 attr=2, projid32bit=1 2023-08-01T19:53:23.773 INFO:teuthology.orchestra.run.smithi008.stdout: = crc=1 finobt=1, sparse=1, rmapbt=0 2023-08-01T19:53:23.773 INFO:teuthology.orchestra.run.smithi008.stdout: = reflink=1 bigtime=0 inobtcount=0 2023-08-01T19:53:23.774 INFO:teuthology.orchestra.run.smithi008.stdout:data = bsize=4096 blocks=23436288, imaxpct=25 2023-08-01T19:53:23.774 INFO:teuthology.orchestra.run.smithi008.stdout: = sunit=0 swidth=0 blks 2023-08-01T19:53:23.774 INFO:teuthology.orchestra.run.smithi008.stdout:naming =version 2 bsize=4096 ascii-ci=0, ftype=1 2023-08-01T19:53:23.774 INFO:teuthology.orchestra.run.smithi008.stdout:log =internal log bsize=4096 blocks=11443, version=2 2023-08-01T19:53:23.774 INFO:teuthology.orchestra.run.smithi008.stdout: = sectsz=512 sunit=0 blks, lazy-count=1 2023-08-01T19:53:23.774 INFO:teuthology.orchestra.run.smithi008.stdout:realtime =none extsz=4096 blocks=0, rtextents=0 2023-08-01T19:53:23.797 INFO:teuthology.orchestra.run.smithi008.stdout:Discarding blocks...Done. 2023-08-01T19:53:23.799 INFO:tasks.ceph:mount /dev/vg_nvme/lv_1 on ubuntu@smithi008.front.sepia.ceph.com -o noatime 2023-08-01T19:53:23.800 DEBUG:teuthology.orchestra.run.smithi008:> sudo mount -t xfs -o noatime /dev/vg_nvme/lv_1 /var/lib/ceph/osd/ceph-0 2023-08-01T19:53:23.882 DEBUG:teuthology.orchestra.run.smithi008:> sudo /sbin/restorecon /var/lib/ceph/osd/ceph-0 2023-08-01T19:53:23.955 DEBUG:teuthology.orchestra.run.smithi008:> sudo MALLOC_CHECK_=3 adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage ceph-osd --no-mon-config --cluster ceph --mkfs --mkkey -i 0 --monmap /home/ubuntu/cephtest/ceph.monmap 2023-08-01T19:53:24.061 INFO:teuthology.orchestra.run.smithi008.stderr:2023-08-01T19:53:24.059+0000 7f4cce5a7540 -1 auth: error reading file: /var/lib/ceph/osd/ceph-0/keyring: can't open /var/lib/ceph/osd/ceph-0/keyring: (2) No such file or directory 2023-08-01T19:53:24.061 INFO:teuthology.orchestra.run.smithi008.stderr:2023-08-01T19:53:24.059+0000 7f4cce5a7540 -1 created new key in keyring /var/lib/ceph/osd/ceph-0/keyring 2023-08-01T19:53:24.061 INFO:teuthology.orchestra.run.smithi008.stderr:2023-08-01T19:53:24.059+0000 7f4cce5a7540 -1 bluestore(/var/lib/ceph/osd/ceph-0/block) _read_bdev_label failed to open /var/lib/ceph/osd/ceph-0/block: (2) No such file or directory 2023-08-01T19:53:24.062 INFO:teuthology.orchestra.run.smithi008.stderr:2023-08-01T19:53:24.059+0000 7f4cce5a7540 -1 bluestore(/var/lib/ceph/osd/ceph-0/block) _read_bdev_label failed to open /var/lib/ceph/osd/ceph-0/block: (2) No such file or directory 2023-08-01T19:53:24.062 INFO:teuthology.orchestra.run.smithi008.stderr:2023-08-01T19:53:24.059+0000 7f4cce5a7540 -1 bluestore(/var/lib/ceph/osd/ceph-0/block) _read_bdev_label failed to open /var/lib/ceph/osd/ceph-0/block: (2) No such file or directory 2023-08-01T19:53:24.062 INFO:teuthology.orchestra.run.smithi008.stderr:2023-08-01T19:53:24.060+0000 7f4cce5a7540 -1 bluestore(/var/lib/ceph/osd/ceph-0) _read_fsid unparsable uuid 2023-08-01T19:53:24.581 INFO:teuthology.orchestra.run.smithi008.stderr:2023-08-01T19:53:24.580+0000 7f4cce5a7540 -1 bluestore::NCB::__restore_allocator::Failed open_for_read with error-code -2 2023-08-01T19:53:25.344 INFO:teuthology.orchestra.run.smithi008.stderr:2023-08-01T19:53:25.343+0000 7f4cce5a7540 -1 bluestore::NCB::__restore_allocator::Failed open_for_read with error-code -2 2023-08-01T19:53:26.107 INFO:teuthology.orchestra.run.smithi008.stderr:2023-08-01T19:53:26.105+0000 7f4cce5a7540 -1 bluestore::NCB::__restore_allocator::Failed open_for_read with error-code -2 2023-08-01T19:53:26.903 DEBUG:teuthology.orchestra.run.smithi008:> sudo chown -R ceph:ceph /var/lib/ceph/osd/ceph-0 2023-08-01T19:53:26.936 DEBUG:teuthology.orchestra.run.smithi101:> sudo mkdir -p /var/lib/ceph/osd/ceph-1 2023-08-01T19:53:26.968 INFO:tasks.ceph:roles_to_devs: {'osd.1': '/dev/vg_nvme/lv_1'} 2023-08-01T19:53:26.968 INFO:tasks.ceph:role: osd.1 2023-08-01T19:53:26.969 INFO:tasks.ceph:['mkfs.xfs', '-f', '-i', 'size=2048'] on /dev/vg_nvme/lv_1 on ubuntu@smithi101.front.sepia.ceph.com 2023-08-01T19:53:26.969 DEBUG:teuthology.orchestra.run.smithi101:> yes | sudo mkfs.xfs -f -i size=2048 /dev/vg_nvme/lv_1 2023-08-01T19:53:27.046 INFO:teuthology.orchestra.run.smithi101.stdout:meta-data=/dev/vg_nvme/lv_1 isize=2048 agcount=4, agsize=5859072 blks 2023-08-01T19:53:27.047 INFO:teuthology.orchestra.run.smithi101.stdout: = sectsz=512 attr=2, projid32bit=1 2023-08-01T19:53:27.047 INFO:teuthology.orchestra.run.smithi101.stdout: = crc=1 finobt=1, sparse=1, rmapbt=0 2023-08-01T19:53:27.047 INFO:teuthology.orchestra.run.smithi101.stdout: = reflink=1 bigtime=0 inobtcount=0 2023-08-01T19:53:27.047 INFO:teuthology.orchestra.run.smithi101.stdout:data = bsize=4096 blocks=23436288, imaxpct=25 2023-08-01T19:53:27.047 INFO:teuthology.orchestra.run.smithi101.stdout: = sunit=0 swidth=0 blks 2023-08-01T19:53:27.047 INFO:teuthology.orchestra.run.smithi101.stdout:naming =version 2 bsize=4096 ascii-ci=0, ftype=1 2023-08-01T19:53:27.048 INFO:teuthology.orchestra.run.smithi101.stdout:log =internal log bsize=4096 blocks=11443, version=2 2023-08-01T19:53:27.048 INFO:teuthology.orchestra.run.smithi101.stdout: = sectsz=512 sunit=0 blks, lazy-count=1 2023-08-01T19:53:27.048 INFO:teuthology.orchestra.run.smithi101.stdout:realtime =none extsz=4096 blocks=0, rtextents=0 2023-08-01T19:53:27.477 INFO:teuthology.orchestra.run.smithi101.stdout:Discarding blocks...Done. 2023-08-01T19:53:27.478 INFO:tasks.ceph:mount /dev/vg_nvme/lv_1 on ubuntu@smithi101.front.sepia.ceph.com -o noatime 2023-08-01T19:53:27.479 DEBUG:teuthology.orchestra.run.smithi101:> sudo mount -t xfs -o noatime /dev/vg_nvme/lv_1 /var/lib/ceph/osd/ceph-1 2023-08-01T19:53:27.639 DEBUG:teuthology.orchestra.run.smithi101:> sudo /sbin/restorecon /var/lib/ceph/osd/ceph-1 2023-08-01T19:53:27.675 DEBUG:teuthology.orchestra.run.smithi101:> sudo MALLOC_CHECK_=3 adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage ceph-osd --no-mon-config --cluster ceph --mkfs --mkkey -i 1 --monmap /home/ubuntu/cephtest/ceph.monmap 2023-08-01T19:53:27.774 INFO:teuthology.orchestra.run.smithi101.stderr:2023-08-01T19:53:27.772+0000 7fa7b6997540 -1 auth: error reading file: /var/lib/ceph/osd/ceph-1/keyring: can't open /var/lib/ceph/osd/ceph-1/keyring: (2) No such file or directory 2023-08-01T19:53:27.775 INFO:teuthology.orchestra.run.smithi101.stderr:2023-08-01T19:53:27.773+0000 7fa7b6997540 -1 created new key in keyring /var/lib/ceph/osd/ceph-1/keyring 2023-08-01T19:53:27.775 INFO:teuthology.orchestra.run.smithi101.stderr:2023-08-01T19:53:27.773+0000 7fa7b6997540 -1 bluestore(/var/lib/ceph/osd/ceph-1/block) _read_bdev_label failed to open /var/lib/ceph/osd/ceph-1/block: (2) No such file or directory 2023-08-01T19:53:27.775 INFO:teuthology.orchestra.run.smithi101.stderr:2023-08-01T19:53:27.773+0000 7fa7b6997540 -1 bluestore(/var/lib/ceph/osd/ceph-1/block) _read_bdev_label failed to open /var/lib/ceph/osd/ceph-1/block: (2) No such file or directory 2023-08-01T19:53:27.776 INFO:teuthology.orchestra.run.smithi101.stderr:2023-08-01T19:53:27.773+0000 7fa7b6997540 -1 bluestore(/var/lib/ceph/osd/ceph-1/block) _read_bdev_label failed to open /var/lib/ceph/osd/ceph-1/block: (2) No such file or directory 2023-08-01T19:53:27.781 INFO:teuthology.orchestra.run.smithi101.stderr:2023-08-01T19:53:27.780+0000 7fa7b6997540 -1 bluestore(/var/lib/ceph/osd/ceph-1) _read_fsid unparsable uuid 2023-08-01T19:53:28.312 INFO:teuthology.orchestra.run.smithi101.stderr:2023-08-01T19:53:28.311+0000 7fa7b6997540 -1 bluestore::NCB::__restore_allocator::Failed open_for_read with error-code -2 2023-08-01T19:53:29.076 INFO:teuthology.orchestra.run.smithi101.stderr:2023-08-01T19:53:29.075+0000 7fa7b6997540 -1 bluestore::NCB::__restore_allocator::Failed open_for_read with error-code -2 2023-08-01T19:53:29.837 INFO:teuthology.orchestra.run.smithi101.stderr:2023-08-01T19:53:29.835+0000 7fa7b6997540 -1 bluestore::NCB::__restore_allocator::Failed open_for_read with error-code -2 2023-08-01T19:53:30.630 DEBUG:teuthology.orchestra.run.smithi101:> sudo chown -R ceph:ceph /var/lib/ceph/osd/ceph-1 2023-08-01T19:53:30.661 DEBUG:teuthology.orchestra.run.smithi155:> sudo mkdir -p /var/lib/ceph/osd/ceph-2 2023-08-01T19:53:30.693 INFO:tasks.ceph:roles_to_devs: {'osd.2': '/dev/vg_nvme/lv_1'} 2023-08-01T19:53:30.693 INFO:tasks.ceph:role: osd.2 2023-08-01T19:53:30.694 INFO:tasks.ceph:['mkfs.xfs', '-f', '-i', 'size=2048'] on /dev/vg_nvme/lv_1 on ubuntu@smithi155.front.sepia.ceph.com 2023-08-01T19:53:30.694 DEBUG:teuthology.orchestra.run.smithi155:> yes | sudo mkfs.xfs -f -i size=2048 /dev/vg_nvme/lv_1 2023-08-01T19:53:30.772 INFO:teuthology.orchestra.run.smithi155.stdout:meta-data=/dev/vg_nvme/lv_1 isize=2048 agcount=4, agsize=5859072 blks 2023-08-01T19:53:30.772 INFO:teuthology.orchestra.run.smithi155.stdout: = sectsz=512 attr=2, projid32bit=1 2023-08-01T19:53:30.772 INFO:teuthology.orchestra.run.smithi155.stdout: = crc=1 finobt=1, sparse=1, rmapbt=0 2023-08-01T19:53:30.772 INFO:teuthology.orchestra.run.smithi155.stdout: = reflink=1 bigtime=0 inobtcount=0 2023-08-01T19:53:30.772 INFO:teuthology.orchestra.run.smithi155.stdout:data = bsize=4096 blocks=23436288, imaxpct=25 2023-08-01T19:53:30.773 INFO:teuthology.orchestra.run.smithi155.stdout: = sunit=0 swidth=0 blks 2023-08-01T19:53:30.773 INFO:teuthology.orchestra.run.smithi155.stdout:naming =version 2 bsize=4096 ascii-ci=0, ftype=1 2023-08-01T19:53:30.773 INFO:teuthology.orchestra.run.smithi155.stdout:log =internal log bsize=4096 blocks=11443, version=2 2023-08-01T19:53:30.773 INFO:teuthology.orchestra.run.smithi155.stdout: = sectsz=512 sunit=0 blks, lazy-count=1 2023-08-01T19:53:30.773 INFO:teuthology.orchestra.run.smithi155.stdout:realtime =none extsz=4096 blocks=0, rtextents=0 2023-08-01T19:53:31.213 INFO:teuthology.orchestra.run.smithi155.stdout:Discarding blocks...Done. 2023-08-01T19:53:31.215 INFO:tasks.ceph:mount /dev/vg_nvme/lv_1 on ubuntu@smithi155.front.sepia.ceph.com -o noatime 2023-08-01T19:53:31.216 DEBUG:teuthology.orchestra.run.smithi155:> sudo mount -t xfs -o noatime /dev/vg_nvme/lv_1 /var/lib/ceph/osd/ceph-2 2023-08-01T19:53:31.403 DEBUG:teuthology.orchestra.run.smithi155:> sudo /sbin/restorecon /var/lib/ceph/osd/ceph-2 2023-08-01T19:53:31.443 DEBUG:teuthology.orchestra.run.smithi155:> sudo MALLOC_CHECK_=3 adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage ceph-osd --no-mon-config --cluster ceph --mkfs --mkkey -i 2 --monmap /home/ubuntu/cephtest/ceph.monmap 2023-08-01T19:53:31.561 INFO:teuthology.orchestra.run.smithi155.stderr:2023-08-01T19:53:31.560+0000 7f8d5de4e540 -1 auth: error reading file: /var/lib/ceph/osd/ceph-2/keyring: can't open /var/lib/ceph/osd/ceph-2/keyring: (2) No such file or directory 2023-08-01T19:53:31.563 INFO:teuthology.orchestra.run.smithi155.stderr:2023-08-01T19:53:31.562+0000 7f8d5de4e540 -1 created new key in keyring /var/lib/ceph/osd/ceph-2/keyring 2023-08-01T19:53:31.564 INFO:teuthology.orchestra.run.smithi155.stderr:2023-08-01T19:53:31.562+0000 7f8d5de4e540 -1 bluestore(/var/lib/ceph/osd/ceph-2/block) _read_bdev_label failed to open /var/lib/ceph/osd/ceph-2/block: (2) No such file or directory 2023-08-01T19:53:31.564 INFO:teuthology.orchestra.run.smithi155.stderr:2023-08-01T19:53:31.562+0000 7f8d5de4e540 -1 bluestore(/var/lib/ceph/osd/ceph-2/block) _read_bdev_label failed to open /var/lib/ceph/osd/ceph-2/block: (2) No such file or directory 2023-08-01T19:53:31.564 INFO:teuthology.orchestra.run.smithi155.stderr:2023-08-01T19:53:31.562+0000 7f8d5de4e540 -1 bluestore(/var/lib/ceph/osd/ceph-2/block) _read_bdev_label failed to open /var/lib/ceph/osd/ceph-2/block: (2) No such file or directory 2023-08-01T19:53:31.571 INFO:teuthology.orchestra.run.smithi155.stderr:2023-08-01T19:53:31.569+0000 7f8d5de4e540 -1 bluestore(/var/lib/ceph/osd/ceph-2) _read_fsid unparsable uuid 2023-08-01T19:53:32.093 INFO:teuthology.orchestra.run.smithi155.stderr:2023-08-01T19:53:32.091+0000 7f8d5de4e540 -1 bluestore::NCB::__restore_allocator::Failed open_for_read with error-code -2 2023-08-01T19:53:32.855 INFO:teuthology.orchestra.run.smithi155.stderr:2023-08-01T19:53:32.853+0000 7f8d5de4e540 -1 bluestore::NCB::__restore_allocator::Failed open_for_read with error-code -2 2023-08-01T19:53:33.621 INFO:teuthology.orchestra.run.smithi155.stderr:2023-08-01T19:53:33.620+0000 7f8d5de4e540 -1 bluestore::NCB::__restore_allocator::Failed open_for_read with error-code -2 2023-08-01T19:53:34.422 DEBUG:teuthology.orchestra.run.smithi155:> sudo chown -R ceph:ceph /var/lib/ceph/osd/ceph-2 2023-08-01T19:53:34.454 INFO:tasks.ceph:Reading keys from all nodes... 2023-08-01T19:53:34.454 DEBUG:teuthology.orchestra.run.smithi006:> set -ex 2023-08-01T19:53:34.455 DEBUG:teuthology.orchestra.run.smithi006:> sudo dd if=/var/lib/ceph/mgr/ceph-x/keyring of=/dev/stdout 2023-08-01T19:53:34.488 DEBUG:teuthology.orchestra.run.smithi006:> set -ex 2023-08-01T19:53:34.488 DEBUG:teuthology.orchestra.run.smithi006:> sudo dd if=/var/lib/ceph/mgr/ceph-y/keyring of=/dev/stdout 2023-08-01T19:53:34.559 DEBUG:teuthology.orchestra.run.smithi006:> set -ex 2023-08-01T19:53:34.559 DEBUG:teuthology.orchestra.run.smithi006:> sudo dd if=/var/lib/ceph/mds/ceph-a/keyring of=/dev/stdout 2023-08-01T19:53:34.629 DEBUG:teuthology.orchestra.run.smithi008:> set -ex 2023-08-01T19:53:34.630 DEBUG:teuthology.orchestra.run.smithi008:> sudo dd if=/var/lib/ceph/osd/ceph-0/keyring of=/dev/stdout 2023-08-01T19:53:34.664 DEBUG:teuthology.orchestra.run.smithi101:> set -ex 2023-08-01T19:53:34.665 DEBUG:teuthology.orchestra.run.smithi101:> sudo dd if=/var/lib/ceph/osd/ceph-1/keyring of=/dev/stdout 2023-08-01T19:53:34.698 DEBUG:teuthology.orchestra.run.smithi155:> set -ex 2023-08-01T19:53:34.699 DEBUG:teuthology.orchestra.run.smithi155:> sudo dd if=/var/lib/ceph/osd/ceph-2/keyring of=/dev/stdout 2023-08-01T19:53:34.733 DEBUG:teuthology.orchestra.run.smithi006:> set -ex 2023-08-01T19:53:34.733 DEBUG:teuthology.orchestra.run.smithi006:> dd if=/etc/ceph/ceph.client.0.keyring of=/dev/stdout 2023-08-01T19:53:34.754 INFO:tasks.ceph:Adding keys to all mons... 2023-08-01T19:53:34.754 DEBUG:teuthology.orchestra.run.smithi006:> sudo tee -a /etc/ceph/ceph.keyring 2023-08-01T19:53:34.822 INFO:teuthology.orchestra.run.smithi006.stdout:[mgr.x] 2023-08-01T19:53:34.822 INFO:teuthology.orchestra.run.smithi006.stdout: key = AQCzYslk0cTrGRAAEQDtsAKkhAY8Kt0kG1BDSA== 2023-08-01T19:53:34.823 INFO:teuthology.orchestra.run.smithi006.stdout:[mgr.y] 2023-08-01T19:53:34.823 INFO:teuthology.orchestra.run.smithi006.stdout: key = AQCzYslkxqEYHRAAtO/H59VTWPNdwZnzICSd2g== 2023-08-01T19:53:34.823 INFO:teuthology.orchestra.run.smithi006.stdout:[mds.a] 2023-08-01T19:53:34.823 INFO:teuthology.orchestra.run.smithi006.stdout: key = AQCzYslkCzVJIBAAZ9GkFJoY87l0IefE9FLseA== 2023-08-01T19:53:34.823 INFO:teuthology.orchestra.run.smithi006.stdout:[osd.0] 2023-08-01T19:53:34.823 INFO:teuthology.orchestra.run.smithi006.stdout: key = AQC0Yslk1YGVAxAAPJTWc//MPMg7UENgbi+O0Q== 2023-08-01T19:53:34.823 INFO:teuthology.orchestra.run.smithi006.stdout:[osd.1] 2023-08-01T19:53:34.824 INFO:teuthology.orchestra.run.smithi006.stdout: key = AQC3Yslka4cdLhAA+ZPw3KJ3jUbP9rd8G6tyVQ== 2023-08-01T19:53:34.824 INFO:teuthology.orchestra.run.smithi006.stdout:[osd.2] 2023-08-01T19:53:34.824 INFO:teuthology.orchestra.run.smithi006.stdout: key = AQC7YslkaWB1IRAAVOan3FZl/hzaoVTkpGRoDQ== 2023-08-01T19:53:34.824 INFO:teuthology.orchestra.run.smithi006.stdout:[client.0] 2023-08-01T19:53:34.824 INFO:teuthology.orchestra.run.smithi006.stdout: key = AQCzYslkp8frJhAAhTassUBY9a510FHCNFINVA== 2023-08-01T19:53:34.825 DEBUG:teuthology.orchestra.run.smithi006:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage ceph-authtool /etc/ceph/ceph.keyring --name=mgr.x --cap mon 'allow profile mgr' --cap osd 'allow *' --cap mds 'allow *' 2023-08-01T19:53:34.924 DEBUG:teuthology.orchestra.run.smithi006:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage ceph-authtool /etc/ceph/ceph.keyring --name=mgr.y --cap mon 'allow profile mgr' --cap osd 'allow *' --cap mds 'allow *' 2023-08-01T19:53:34.996 DEBUG:teuthology.orchestra.run.smithi006:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage ceph-authtool /etc/ceph/ceph.keyring --name=mds.a --cap mon 'allow *' --cap mgr 'allow *' --cap osd 'allow *' --cap mds allow 2023-08-01T19:53:35.050 DEBUG:teuthology.orchestra.run.smithi006:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage ceph-authtool /etc/ceph/ceph.keyring --name=osd.0 --cap mon 'allow profile osd' --cap mgr 'allow profile osd' --cap osd 'allow *' 2023-08-01T19:53:35.101 DEBUG:teuthology.orchestra.run.smithi006:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage ceph-authtool /etc/ceph/ceph.keyring --name=osd.1 --cap mon 'allow profile osd' --cap mgr 'allow profile osd' --cap osd 'allow *' 2023-08-01T19:53:35.152 DEBUG:teuthology.orchestra.run.smithi006:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage ceph-authtool /etc/ceph/ceph.keyring --name=osd.2 --cap mon 'allow profile osd' --cap mgr 'allow profile osd' --cap osd 'allow *' 2023-08-01T19:53:35.202 DEBUG:teuthology.orchestra.run.smithi006:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage ceph-authtool /etc/ceph/ceph.keyring --name=client.0 --cap mon 'allow rw' --cap mgr 'allow r' --cap osd 'allow rwx' --cap mds allow 2023-08-01T19:53:35.255 INFO:tasks.ceph:Running mkfs on mon nodes... 2023-08-01T19:53:35.256 DEBUG:teuthology.orchestra.run.smithi006:> sudo mkdir -p /var/lib/ceph/mon/ceph-a 2023-08-01T19:53:35.283 DEBUG:teuthology.orchestra.run.smithi006:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage ceph-mon --cluster ceph --mkfs -i a --monmap /home/ubuntu/cephtest/ceph.monmap --keyring /etc/ceph/ceph.keyring 2023-08-01T19:53:35.393 DEBUG:teuthology.orchestra.run.smithi006:> sudo chown -R ceph:ceph /var/lib/ceph/mon/ceph-a 2023-08-01T19:53:35.421 DEBUG:teuthology.orchestra.run.smithi006:> sudo mkdir -p /var/lib/ceph/mon/ceph-b 2023-08-01T19:53:35.488 DEBUG:teuthology.orchestra.run.smithi006:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage ceph-mon --cluster ceph --mkfs -i b --monmap /home/ubuntu/cephtest/ceph.monmap --keyring /etc/ceph/ceph.keyring 2023-08-01T19:53:35.584 DEBUG:teuthology.orchestra.run.smithi006:> sudo chown -R ceph:ceph /var/lib/ceph/mon/ceph-b 2023-08-01T19:53:35.611 DEBUG:teuthology.orchestra.run.smithi006:> sudo mkdir -p /var/lib/ceph/mon/ceph-c 2023-08-01T19:53:35.679 DEBUG:teuthology.orchestra.run.smithi006:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage ceph-mon --cluster ceph --mkfs -i c --monmap /home/ubuntu/cephtest/ceph.monmap --keyring /etc/ceph/ceph.keyring 2023-08-01T19:53:35.775 DEBUG:teuthology.orchestra.run.smithi006:> sudo chown -R ceph:ceph /var/lib/ceph/mon/ceph-c 2023-08-01T19:53:35.803 DEBUG:teuthology.orchestra.run.smithi006:> rm -- /home/ubuntu/cephtest/ceph.monmap 2023-08-01T19:53:35.861 INFO:tasks.ceph:Starting mon daemons in cluster ceph... 2023-08-01T19:53:35.862 INFO:tasks.ceph.mon.a:Restarting daemon 2023-08-01T19:53:35.863 DEBUG:teuthology.orchestra.run.smithi006:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage daemon-helper kill ceph-mon -f --cluster ceph -i a 2023-08-01T19:53:35.904 INFO:tasks.ceph.mon.a:Started 2023-08-01T19:53:35.905 INFO:tasks.ceph.mon.b:Restarting daemon 2023-08-01T19:53:35.905 DEBUG:teuthology.orchestra.run.smithi006:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage daemon-helper kill ceph-mon -f --cluster ceph -i b 2023-08-01T19:53:35.907 INFO:tasks.ceph.mon.b:Started 2023-08-01T19:53:35.908 INFO:tasks.ceph.mon.c:Restarting daemon 2023-08-01T19:53:35.908 DEBUG:teuthology.orchestra.run.smithi006:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage daemon-helper kill ceph-mon -f --cluster ceph -i c 2023-08-01T19:53:35.910 INFO:tasks.ceph.mon.c:Started 2023-08-01T19:53:35.911 INFO:tasks.ceph:Starting mgr daemons in cluster ceph... 2023-08-01T19:53:35.911 INFO:tasks.ceph.mgr.x:Restarting daemon 2023-08-01T19:53:35.911 DEBUG:teuthology.orchestra.run.smithi006:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage daemon-helper kill ceph-mgr -f --cluster ceph -i x 2023-08-01T19:53:35.913 INFO:tasks.ceph.mgr.x:Started 2023-08-01T19:53:35.914 INFO:tasks.ceph.mgr.y:Restarting daemon 2023-08-01T19:53:35.915 DEBUG:teuthology.orchestra.run.smithi006:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage daemon-helper kill ceph-mgr -f --cluster ceph -i y 2023-08-01T19:53:35.917 INFO:tasks.ceph.mgr.y:Started 2023-08-01T19:53:35.917 INFO:tasks.ceph:Setting crush tunables to default 2023-08-01T19:53:35.918 DEBUG:teuthology.orchestra.run.smithi006:> sudo ceph --cluster ceph osd crush tunables default 2023-08-01T19:53:42.147 INFO:tasks.ceph.mgr.x.smithi006.stderr:2023-08-01T19:53:42.146+0000 7f980ff601c0 -1 mgr[py] Module balancer has missing NOTIFY_TYPES member 2023-08-01T19:53:42.149 INFO:tasks.ceph.mgr.y.smithi006.stderr:2023-08-01T19:53:42.148+0000 7f9b3a5e41c0 -1 mgr[py] Module balancer has missing NOTIFY_TYPES member 2023-08-01T19:53:42.175 INFO:teuthology.orchestra.run.smithi006.stderr:adjusted tunables profile to default 2023-08-01T19:53:42.187 INFO:tasks.ceph:Starting osd daemons in cluster ceph... 2023-08-01T19:53:42.187 DEBUG:teuthology.orchestra.run.smithi008:> set -ex 2023-08-01T19:53:42.188 DEBUG:teuthology.orchestra.run.smithi008:> sudo dd if=/var/lib/ceph/osd/ceph-0/fsid of=/dev/stdout 2023-08-01T19:53:42.221 DEBUG:teuthology.orchestra.run.smithi101:> set -ex 2023-08-01T19:53:42.221 DEBUG:teuthology.orchestra.run.smithi101:> sudo dd if=/var/lib/ceph/osd/ceph-1/fsid of=/dev/stdout 2023-08-01T19:53:42.253 DEBUG:teuthology.orchestra.run.smithi155:> set -ex 2023-08-01T19:53:42.254 DEBUG:teuthology.orchestra.run.smithi155:> sudo dd if=/var/lib/ceph/osd/ceph-2/fsid of=/dev/stdout 2023-08-01T19:53:42.288 DEBUG:teuthology.orchestra.run.smithi155:> sudo ceph --cluster ceph osd new 5dd675c7-2777-48f2-8009-ff0e0d4c7086 0 2023-08-01T19:53:42.333 INFO:tasks.ceph.mgr.y.smithi006.stderr:2023-08-01T19:53:42.332+0000 7f9b3a5e41c0 -1 mgr[py] Module diskprediction_local has missing NOTIFY_TYPES member 2023-08-01T19:53:42.333 INFO:tasks.ceph.mgr.x.smithi006.stderr:2023-08-01T19:53:42.332+0000 7f980ff601c0 -1 mgr[py] Module diskprediction_local has missing NOTIFY_TYPES member 2023-08-01T19:53:42.541 INFO:teuthology.orchestra.run.smithi155.stdout:0 2023-08-01T19:53:42.554 DEBUG:teuthology.orchestra.run.smithi155:> sudo ceph --cluster ceph osd new 7fc612c4-33ba-4a33-bca8-1f42ee8ed548 1 2023-08-01T19:53:42.745 INFO:tasks.ceph.mgr.x.smithi006.stderr:2023-08-01T19:53:42.744+0000 7f980ff601c0 -1 mgr[py] Module crash has missing NOTIFY_TYPES member 2023-08-01T19:53:42.745 INFO:tasks.ceph.mgr.y.smithi006.stderr:2023-08-01T19:53:42.744+0000 7f9b3a5e41c0 -1 mgr[py] Module crash has missing NOTIFY_TYPES member 2023-08-01T19:53:42.761 INFO:teuthology.orchestra.run.smithi155.stdout:1 2023-08-01T19:53:42.773 DEBUG:teuthology.orchestra.run.smithi155:> sudo ceph --cluster ceph osd new f85cadbc-4230-4772-8f39-62ed52e220b1 2 2023-08-01T19:53:42.983 INFO:teuthology.orchestra.run.smithi155.stdout:2 2023-08-01T19:53:42.995 INFO:tasks.ceph.osd.0:Restarting daemon 2023-08-01T19:53:42.995 DEBUG:teuthology.orchestra.run.smithi008:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage daemon-helper kill ceph-osd -f --cluster ceph -i 0 2023-08-01T19:53:42.997 INFO:tasks.ceph.osd.0:Started 2023-08-01T19:53:42.998 INFO:tasks.ceph.osd.1:Restarting daemon 2023-08-01T19:53:42.998 DEBUG:teuthology.orchestra.run.smithi101:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage daemon-helper kill ceph-osd -f --cluster ceph -i 1 2023-08-01T19:53:43.000 INFO:tasks.ceph.osd.1:Started 2023-08-01T19:53:43.001 INFO:tasks.ceph.osd.2:Restarting daemon 2023-08-01T19:53:43.001 DEBUG:teuthology.orchestra.run.smithi155:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage daemon-helper kill ceph-osd -f --cluster ceph -i 2 2023-08-01T19:53:43.003 INFO:tasks.ceph.osd.2:Started 2023-08-01T19:53:43.003 DEBUG:teuthology.orchestra.run.smithi006:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 120 ceph --cluster ceph osd dump --format=json 2023-08-01T19:53:43.224 INFO:teuthology.orchestra.run.smithi006.stdout: 2023-08-01T19:53:43.224 INFO:teuthology.orchestra.run.smithi006.stdout:{"epoch":5,"fsid":"a0e420cc-4df1-42a5-8bd4-a98c309a9349","created":"2023-08-01T19:53:41.279588+0000","modified":"2023-08-01T19:53:42.974751+0000","last_up_change":"0.000000","last_in_change":"2023-08-01T19:53:42.974751+0000","flags":"sortbitwise,recovery_deletes,purged_snapdirs,pglog_hardlimit","flags_num":5799936,"flags_set":["pglog_hardlimit","purged_snapdirs","recovery_deletes","sortbitwise"],"crush_version":2,"full_ratio":0.94999998807907104,"backfillfull_ratio":0.89999997615814209,"nearfull_ratio":0.85000002384185791,"cluster_snapshot":"","pool_max":0,"max_osd":3,"require_min_compat_client":"luminous","min_compat_client":"jewel","require_osd_release":"quincy","pools":[],"osds":[{"osd":0,"uuid":"5dd675c7-2777-48f2-8009-ff0e0d4c7086","up":0,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":0,"up_thru":0,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[]},"cluster_addrs":{"addrvec":[]},"heartbeat_back_addrs":{"addrvec":[]},"heartbeat_front_addrs":{"addrvec":[]},"public_addr":"(unrecognized address family 0)/0","cluster_addr":"(unrecognized address family 0)/0","heartbeat_back_addr":"(unrecognized address family 0)/0","heartbeat_front_addr":"(unrecognized address family 0)/0","state":["exists","new"]},{"osd":1,"uuid":"7fc612c4-33ba-4a33-bca8-1f42ee8ed548","up":0,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":0,"up_thru":0,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[]},"cluster_addrs":{"addrvec":[]},"heartbeat_back_addrs":{"addrvec":[]},"heartbeat_front_addrs":{"addrvec":[]},"public_addr":"(unrecognized address family 0)/0","cluster_addr":"(unrecognized address family 0)/0","heartbeat_back_addr":"(unrecognized address family 0)/0","heartbeat_front_addr":"(unrecognized address family 0)/0","state":["exists","new"]},{"osd":2,"uuid":"f85cadbc-4230-4772-8f39-62ed52e220b1","up":0,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":0,"up_thru":0,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[]},"cluster_addrs":{"addrvec":[]},"heartbeat_back_addrs":{"addrvec":[]},"heartbeat_front_addrs":{"addrvec":[]},"public_addr":"(unrecognized address family 0)/0","cluster_addr":"(unrecognized address family 0)/0","heartbeat_back_addr":"(unrecognized address family 0)/0","heartbeat_front_addr":"(unrecognized address family 0)/0","state":["exists","new"]}],"osd_xinfo":[{"osd":0,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":0,"old_weight":0,"last_purged_snaps_scrub":"0.000000","dead_epoch":0},{"osd":1,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":0,"old_weight":0,"last_purged_snaps_scrub":"0.000000","dead_epoch":0},{"osd":2,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":0,"old_weight":0,"last_purged_snaps_scrub":"0.000000","dead_epoch":0}],"pg_upmap":[],"pg_upmap_items":[],"pg_temp":[],"primary_temp":[],"blocklist":{},"range_blocklist":{},"erasure_code_profiles":{"default":{"crush-failure-domain":"osd","k":"2","m":"1","plugin":"jerasure","technique":"reed_sol_van"}},"removed_snaps_queue":[],"new_removed_snaps":[],"new_purged_snaps":[],"crush_node_flags":{},"device_class_flags":{},"stretch_mode":{"stretch_mode_enabled":false,"stretch_bucket_count":0,"degraded_stretch_mode":0,"recovering_stretch_mode":0,"stretch_mode_bucket":0}} 2023-08-01T19:53:43.236 INFO:tasks.ceph.ceph_manager.ceph:[] 2023-08-01T19:53:43.237 INFO:tasks.ceph:Waiting for OSDs to come up 2023-08-01T19:53:43.300 INFO:tasks.ceph.mgr.x.smithi006.stderr:2023-08-01T19:53:43.299+0000 7f980ff601c0 -1 mgr[py] Module rook has missing NOTIFY_TYPES member 2023-08-01T19:53:43.301 INFO:tasks.ceph.mgr.y.smithi006.stderr:2023-08-01T19:53:43.300+0000 7f9b3a5e41c0 -1 mgr[py] Module rook has missing NOTIFY_TYPES member 2023-08-01T19:53:43.449 INFO:tasks.ceph.mgr.x.smithi006.stderr:2023-08-01T19:53:43.448+0000 7f980ff601c0 -1 mgr[py] Module rgw has missing NOTIFY_TYPES member 2023-08-01T19:53:43.449 INFO:tasks.ceph.mgr.y.smithi006.stderr:2023-08-01T19:53:43.448+0000 7f9b3a5e41c0 -1 mgr[py] Module rgw has missing NOTIFY_TYPES member 2023-08-01T19:53:43.539 DEBUG:teuthology.orchestra.run.smithi006:> adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage ceph --cluster ceph osd dump --format=json 2023-08-01T19:53:43.588 INFO:tasks.ceph.osd.2.smithi155.stderr:2023-08-01T19:53:43.587+0000 7faa64aa5540 -1 Falling back to public interface 2023-08-01T19:53:43.596 INFO:tasks.ceph.osd.0.smithi008.stderr:2023-08-01T19:53:43.595+0000 7f16adced540 -1 Falling back to public interface 2023-08-01T19:53:43.600 INFO:tasks.ceph.osd.1.smithi101.stderr:2023-08-01T19:53:43.598+0000 7fb0d3bef540 -1 Falling back to public interface 2023-08-01T19:53:43.750 INFO:teuthology.misc.health.smithi006.stdout: 2023-08-01T19:53:43.750 INFO:teuthology.misc.health.smithi006.stdout:{"epoch":5,"fsid":"a0e420cc-4df1-42a5-8bd4-a98c309a9349","created":"2023-08-01T19:53:41.279588+0000","modified":"2023-08-01T19:53:42.974751+0000","last_up_change":"0.000000","last_in_change":"2023-08-01T19:53:42.974751+0000","flags":"sortbitwise,recovery_deletes,purged_snapdirs,pglog_hardlimit","flags_num":5799936,"flags_set":["pglog_hardlimit","purged_snapdirs","recovery_deletes","sortbitwise"],"crush_version":2,"full_ratio":0.94999998807907104,"backfillfull_ratio":0.89999997615814209,"nearfull_ratio":0.85000002384185791,"cluster_snapshot":"","pool_max":0,"max_osd":3,"require_min_compat_client":"luminous","min_compat_client":"jewel","require_osd_release":"quincy","pools":[],"osds":[{"osd":0,"uuid":"5dd675c7-2777-48f2-8009-ff0e0d4c7086","up":0,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":0,"up_thru":0,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[]},"cluster_addrs":{"addrvec":[]},"heartbeat_back_addrs":{"addrvec":[]},"heartbeat_front_addrs":{"addrvec":[]},"public_addr":"(unrecognized address family 0)/0","cluster_addr":"(unrecognized address family 0)/0","heartbeat_back_addr":"(unrecognized address family 0)/0","heartbeat_front_addr":"(unrecognized address family 0)/0","state":["exists","new"]},{"osd":1,"uuid":"7fc612c4-33ba-4a33-bca8-1f42ee8ed548","up":0,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":0,"up_thru":0,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[]},"cluster_addrs":{"addrvec":[]},"heartbeat_back_addrs":{"addrvec":[]},"heartbeat_front_addrs":{"addrvec":[]},"public_addr":"(unrecognized address family 0)/0","cluster_addr":"(unrecognized address family 0)/0","heartbeat_back_addr":"(unrecognized address family 0)/0","heartbeat_front_addr":"(unrecognized address family 0)/0","state":["exists","new"]},{"osd":2,"uuid":"f85cadbc-4230-4772-8f39-62ed52e220b1","up":0,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":0,"up_thru":0,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[]},"cluster_addrs":{"addrvec":[]},"heartbeat_back_addrs":{"addrvec":[]},"heartbeat_front_addrs":{"addrvec":[]},"public_addr":"(unrecognized address family 0)/0","cluster_addr":"(unrecognized address family 0)/0","heartbeat_back_addr":"(unrecognized address family 0)/0","heartbeat_front_addr":"(unrecognized address family 0)/0","state":["exists","new"]}],"osd_xinfo":[{"osd":0,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":0,"old_weight":0,"last_purged_snaps_scrub":"0.000000","dead_epoch":0},{"osd":1,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":0,"old_weight":0,"last_purged_snaps_scrub":"0.000000","dead_epoch":0},{"osd":2,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":0,"old_weight":0,"last_purged_snaps_scrub":"0.000000","dead_epoch":0}],"pg_upmap":[],"pg_upmap_items":[],"pg_temp":[],"primary_temp":[],"blocklist":{},"range_blocklist":{},"erasure_code_profiles":{"default":{"crush-failure-domain":"osd","k":"2","m":"1","plugin":"jerasure","technique":"reed_sol_van"}},"removed_snaps_queue":[],"new_removed_snaps":[],"new_purged_snaps":[],"crush_node_flags":{},"device_class_flags":{},"stretch_mode":{"stretch_mode_enabled":false,"stretch_bucket_count":0,"degraded_stretch_mode":0,"recovering_stretch_mode":0,"stretch_mode_bucket":0}} 2023-08-01T19:53:43.762 DEBUG:teuthology.misc:0 of 3 OSDs are up 2023-08-01T19:53:43.830 INFO:tasks.ceph.mgr.x.smithi006.stderr:2023-08-01T19:53:43.829+0000 7f980ff601c0 -1 mgr[py] Module alerts has missing NOTIFY_TYPES member 2023-08-01T19:53:43.831 INFO:tasks.ceph.mgr.y.smithi006.stderr:2023-08-01T19:53:43.829+0000 7f9b3a5e41c0 -1 mgr[py] Module alerts has missing NOTIFY_TYPES member 2023-08-01T19:53:44.601 INFO:tasks.ceph.mgr.y.smithi006.stderr:2023-08-01T19:53:44.600+0000 7f9b3a5e41c0 -1 mgr[py] Module progress has missing NOTIFY_TYPES member 2023-08-01T19:53:44.602 INFO:tasks.ceph.mgr.x.smithi006.stderr:2023-08-01T19:53:44.600+0000 7f980ff601c0 -1 mgr[py] Module progress has missing NOTIFY_TYPES member 2023-08-01T19:53:44.677 INFO:tasks.ceph.mgr.y.smithi006.stderr:2023-08-01T19:53:44.676+0000 7f9b3a5e41c0 -1 mgr[py] Module telegraf has missing NOTIFY_TYPES member 2023-08-01T19:53:44.678 INFO:tasks.ceph.mgr.x.smithi006.stderr:2023-08-01T19:53:44.676+0000 7f980ff601c0 -1 mgr[py] Module telegraf has missing NOTIFY_TYPES member 2023-08-01T19:53:44.820 INFO:tasks.ceph.mgr.x.smithi006.stderr:2023-08-01T19:53:44.819+0000 7f980ff601c0 -1 mgr[py] Module telemetry has missing NOTIFY_TYPES member 2023-08-01T19:53:44.820 INFO:tasks.ceph.mgr.y.smithi006.stderr:2023-08-01T19:53:44.819+0000 7f9b3a5e41c0 -1 mgr[py] Module telemetry has missing NOTIFY_TYPES member 2023-08-01T19:53:44.894 INFO:tasks.ceph.mgr.y.smithi006.stderr:2023-08-01T19:53:44.893+0000 7f9b3a5e41c0 -1 mgr[py] Module iostat has missing NOTIFY_TYPES member 2023-08-01T19:53:44.894 INFO:tasks.ceph.mgr.x.smithi006.stderr:2023-08-01T19:53:44.893+0000 7f980ff601c0 -1 mgr[py] Module iostat has missing NOTIFY_TYPES member 2023-08-01T19:53:45.087 INFO:tasks.ceph.mgr.y.smithi006.stderr:2023-08-01T19:53:45.086+0000 7f9b3a5e41c0 -1 mgr[py] Module zabbix has missing NOTIFY_TYPES member 2023-08-01T19:53:45.088 INFO:tasks.ceph.mgr.x.smithi006.stderr:2023-08-01T19:53:45.086+0000 7f980ff601c0 -1 mgr[py] Module zabbix has missing NOTIFY_TYPES member 2023-08-01T19:53:45.170 INFO:tasks.ceph.mgr.x.smithi006.stderr:2023-08-01T19:53:45.169+0000 7f980ff601c0 -1 mgr[py] Module status has missing NOTIFY_TYPES member 2023-08-01T19:53:45.170 INFO:tasks.ceph.mgr.y.smithi006.stderr:2023-08-01T19:53:45.169+0000 7f9b3a5e41c0 -1 mgr[py] Module status has missing NOTIFY_TYPES member 2023-08-01T19:53:45.251 INFO:tasks.ceph.mgr.x.smithi006.stderr:2023-08-01T19:53:45.250+0000 7f980ff601c0 -1 mgr[py] Module osd_perf_query has missing NOTIFY_TYPES member 2023-08-01T19:53:45.252 INFO:tasks.ceph.mgr.y.smithi006.stderr:2023-08-01T19:53:45.250+0000 7f9b3a5e41c0 -1 mgr[py] Module osd_perf_query has missing NOTIFY_TYPES member 2023-08-01T19:53:45.364 INFO:tasks.ceph.mgr.y.smithi006.stderr:2023-08-01T19:53:45.363+0000 7f9b3a5e41c0 -1 mgr[py] Module selftest has missing NOTIFY_TYPES member 2023-08-01T19:53:45.365 INFO:tasks.ceph.mgr.x.smithi006.stderr:2023-08-01T19:53:45.363+0000 7f980ff601c0 -1 mgr[py] Module selftest has missing NOTIFY_TYPES member 2023-08-01T19:53:45.568 INFO:tasks.ceph.mgr.y.smithi006.stderr:2023-08-01T19:53:45.567+0000 7f9b3a5e41c0 -1 mgr[py] Module volumes has missing NOTIFY_TYPES member 2023-08-01T19:53:45.569 INFO:tasks.ceph.mgr.x.smithi006.stderr:2023-08-01T19:53:45.567+0000 7f980ff601c0 -1 mgr[py] Module volumes has missing NOTIFY_TYPES member 2023-08-01T19:53:45.654 INFO:tasks.ceph.mgr.x.smithi006.stderr:2023-08-01T19:53:45.653+0000 7f980ff601c0 -1 mgr[py] Module pg_autoscaler has missing NOTIFY_TYPES member 2023-08-01T19:53:45.655 INFO:tasks.ceph.mgr.y.smithi006.stderr:2023-08-01T19:53:45.653+0000 7f9b3a5e41c0 -1 mgr[py] Module pg_autoscaler has missing NOTIFY_TYPES member 2023-08-01T19:53:45.972 INFO:tasks.ceph.mgr.x.smithi006.stderr:2023-08-01T19:53:45.971+0000 7f980ff601c0 -1 mgr[py] Module snap_schedule has missing NOTIFY_TYPES member 2023-08-01T19:53:45.973 INFO:tasks.ceph.mgr.y.smithi006.stderr:2023-08-01T19:53:45.971+0000 7f9b3a5e41c0 -1 mgr[py] Module snap_schedule has missing NOTIFY_TYPES member 2023-08-01T19:53:46.048 INFO:tasks.ceph.mgr.y.smithi006.stderr:2023-08-01T19:53:46.046+0000 7f9b3a5e41c0 -1 mgr[py] Module osd_support has missing NOTIFY_TYPES member 2023-08-01T19:53:46.048 INFO:tasks.ceph.mgr.x.smithi006.stderr:2023-08-01T19:53:46.047+0000 7f980ff601c0 -1 mgr[py] Module osd_support has missing NOTIFY_TYPES member 2023-08-01T19:53:46.591 INFO:tasks.ceph.mgr.x.smithi006.stderr:2023-08-01T19:53:46.590+0000 7f980ff601c0 -1 mgr[py] Module influx has missing NOTIFY_TYPES member 2023-08-01T19:53:46.591 INFO:tasks.ceph.mgr.y.smithi006.stderr:2023-08-01T19:53:46.590+0000 7f9b3a5e41c0 -1 mgr[py] Module influx has missing NOTIFY_TYPES member 2023-08-01T19:53:46.939 INFO:tasks.ceph.mgr.y.smithi006.stderr:2023-08-01T19:53:46.938+0000 7f9b3a5e41c0 -1 mgr[py] Module nfs has missing NOTIFY_TYPES member 2023-08-01T19:53:46.939 INFO:tasks.ceph.mgr.x.smithi006.stderr:2023-08-01T19:53:46.938+0000 7f980ff601c0 -1 mgr[py] Module nfs has missing NOTIFY_TYPES member 2023-08-01T19:53:47.018 INFO:tasks.ceph.osd.1.smithi101.stderr:2023-08-01T19:53:47.016+0000 7fb0d3bef540 -1 osd.1 0 log_to_monitors true 2023-08-01T19:53:47.018 INFO:tasks.ceph.osd.0.smithi008.stderr:2023-08-01T19:53:47.016+0000 7f16adced540 -1 osd.0 0 log_to_monitors true 2023-08-01T19:53:47.025 INFO:tasks.ceph.osd.2.smithi155.stderr:2023-08-01T19:53:47.023+0000 7faa64aa5540 -1 osd.2 0 log_to_monitors true 2023-08-01T19:53:47.092 INFO:tasks.ceph.mgr.x.smithi006.stderr:2023-08-01T19:53:47.091+0000 7f980ff601c0 -1 mgr[py] Module orchestrator has missing NOTIFY_TYPES member 2023-08-01T19:53:47.093 INFO:tasks.ceph.mgr.y.smithi006.stderr:2023-08-01T19:53:47.092+0000 7f9b3a5e41c0 -1 mgr[py] Module orchestrator has missing NOTIFY_TYPES member 2023-08-01T19:53:47.477 INFO:tasks.ceph.mgr.x.smithi006.stderr:2023-08-01T19:53:47.476+0000 7f980ff601c0 -1 mgr[py] Module prometheus has missing NOTIFY_TYPES member 2023-08-01T19:53:47.477 INFO:tasks.ceph.mgr.y.smithi006.stderr:2023-08-01T19:53:47.476+0000 7f9b3a5e41c0 -1 mgr[py] Module prometheus has missing NOTIFY_TYPES member 2023-08-01T19:53:47.631 INFO:tasks.ceph.mgr.y.smithi006.stderr:2023-08-01T19:53:47.630+0000 7f9b3a5e41c0 -1 mgr[py] Module test_orchestrator has missing NOTIFY_TYPES member 2023-08-01T19:53:47.632 INFO:tasks.ceph.mgr.x.smithi006.stderr:2023-08-01T19:53:47.630+0000 7f980ff601c0 -1 mgr[py] Module test_orchestrator has missing NOTIFY_TYPES member 2023-08-01T19:53:47.792 INFO:tasks.ceph.mgr.y.smithi006.stderr:2023-08-01T19:53:47.791+0000 7f9b3a5e41c0 -1 mgr[py] Module devicehealth has missing NOTIFY_TYPES member 2023-08-01T19:53:47.793 INFO:tasks.ceph.mgr.x.smithi006.stderr:2023-08-01T19:53:47.791+0000 7f980ff601c0 -1 mgr[py] Module devicehealth has missing NOTIFY_TYPES member 2023-08-01T19:53:47.899 INFO:tasks.ceph.mgr.y.smithi006.stderr:2023-08-01T19:53:47.898+0000 7f9b3a5e41c0 -1 mgr[py] Module rbd_support has missing NOTIFY_TYPES member 2023-08-01T19:53:47.900 INFO:tasks.ceph.mgr.x.smithi006.stderr:2023-08-01T19:53:47.898+0000 7f980ff601c0 -1 mgr[py] Module rbd_support has missing NOTIFY_TYPES member 2023-08-01T19:53:48.720 INFO:tasks.ceph.osd.1.smithi101.stderr:2023-08-01T19:53:48.718+0000 7fb0ca7f4700 -1 osd.1 0 waiting for initial osdmap 2023-08-01T19:53:48.722 INFO:tasks.ceph.osd.1.smithi101.stderr:2023-08-01T19:53:48.721+0000 7fb0c35eb700 -1 osd.1 7 set_numa_affinity unable to identify public interface '' numa node: (2) No such file or directory 2023-08-01T19:53:48.805 INFO:tasks.ceph.osd.0.smithi008.stderr:2023-08-01T19:53:48.803+0000 7f16a60f5700 -1 osd.0 0 waiting for initial osdmap 2023-08-01T19:53:48.807 INFO:tasks.ceph.osd.0.smithi008.stderr:2023-08-01T19:53:48.806+0000 7f169d6e9700 -1 osd.0 7 set_numa_affinity unable to identify public interface '' numa node: (2) No such file or directory 2023-08-01T19:53:48.916 INFO:tasks.ceph.mgr.x.smithi006.stderr:2023-08-01T19:53:48.915+0000 7f97d4643700 -1 mgr.server handle_report got status from non-daemon mon.b 2023-08-01T19:53:48.917 INFO:tasks.ceph.mgr.x.smithi006.stderr:2023-08-01T19:53:48.916+0000 7f97d4643700 -1 mgr.server handle_report got status from non-daemon mon.c 2023-08-01T19:53:49.734 INFO:tasks.ceph.osd.2.smithi155.stderr:2023-08-01T19:53:49.732+0000 7faa5cead700 -1 osd.2 0 waiting for initial osdmap 2023-08-01T19:53:49.737 INFO:tasks.ceph.osd.2.smithi155.stderr:2023-08-01T19:53:49.735+0000 7faa544a1700 -1 osd.2 8 set_numa_affinity unable to identify public interface '' numa node: (2) No such file or directory 2023-08-01T19:53:50.066 DEBUG:teuthology.orchestra.run.smithi006:> adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage ceph --cluster ceph osd dump --format=json 2023-08-01T19:53:50.390 INFO:teuthology.misc.health.smithi006.stdout: 2023-08-01T19:53:50.390 INFO:teuthology.misc.health.smithi006.stdout:{"epoch":8,"fsid":"a0e420cc-4df1-42a5-8bd4-a98c309a9349","created":"2023-08-01T19:53:41.279588+0000","modified":"2023-08-01T19:53:49.035013+0000","last_up_change":"2023-08-01T19:53:49.035013+0000","last_in_change":"2023-08-01T19:53:42.974751+0000","flags":"sortbitwise,recovery_deletes,purged_snapdirs,pglog_hardlimit","flags_num":5799936,"flags_set":["pglog_hardlimit","purged_snapdirs","recovery_deletes","sortbitwise"],"crush_version":5,"full_ratio":0.94999998807907104,"backfillfull_ratio":0.89999997615814209,"nearfull_ratio":0.85000002384185791,"cluster_snapshot":"","pool_max":0,"max_osd":3,"require_min_compat_client":"luminous","min_compat_client":"jewel","require_osd_release":"quincy","pools":[],"osds":[{"osd":0,"uuid":"5dd675c7-2777-48f2-8009-ff0e0d4c7086","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":8,"up_thru":0,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.8:6800","nonce":111181},{"type":"v1","addr":"172.21.15.8:6801","nonce":111181}]},"cluster_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.8:6802","nonce":111181},{"type":"v1","addr":"172.21.15.8:6803","nonce":111181}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.8:6806","nonce":111181},{"type":"v1","addr":"172.21.15.8:6807","nonce":111181}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.8:6804","nonce":111181},{"type":"v1","addr":"172.21.15.8:6805","nonce":111181}]},"public_addr":"172.21.15.8:6801/111181","cluster_addr":"172.21.15.8:6803/111181","heartbeat_back_addr":"172.21.15.8:6807/111181","heartbeat_front_addr":"172.21.15.8:6805/111181","state":["exists","up"]},{"osd":1,"uuid":"7fc612c4-33ba-4a33-bca8-1f42ee8ed548","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":8,"up_thru":0,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.101:6800","nonce":111143},{"type":"v1","addr":"172.21.15.101:6801","nonce":111143}]},"cluster_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.101:6802","nonce":111143},{"type":"v1","addr":"172.21.15.101:6803","nonce":111143}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.101:6806","nonce":111143},{"type":"v1","addr":"172.21.15.101:6807","nonce":111143}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.101:6804","nonce":111143},{"type":"v1","addr":"172.21.15.101:6805","nonce":111143}]},"public_addr":"172.21.15.101:6801/111143","cluster_addr":"172.21.15.101:6803/111143","heartbeat_back_addr":"172.21.15.101:6807/111143","heartbeat_front_addr":"172.21.15.101:6805/111143","state":["exists","up"]},{"osd":2,"uuid":"f85cadbc-4230-4772-8f39-62ed52e220b1","up":0,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":0,"up_thru":0,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[]},"cluster_addrs":{"addrvec":[]},"heartbeat_back_addrs":{"addrvec":[]},"heartbeat_front_addrs":{"addrvec":[]},"public_addr":"(unrecognized address family 0)/0","cluster_addr":"(unrecognized address family 0)/0","heartbeat_back_addr":"(unrecognized address family 0)/0","heartbeat_front_addr":"(unrecognized address family 0)/0","state":["exists","new"]}],"osd_xinfo":[{"osd":0,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4540138320759226367,"old_weight":0,"last_purged_snaps_scrub":"0.000000","dead_epoch":0},{"osd":1,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4540138320759226367,"old_weight":0,"last_purged_snaps_scrub":"0.000000","dead_epoch":0},{"osd":2,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":0,"old_weight":0,"last_purged_snaps_scrub":"0.000000","dead_epoch":0}],"pg_upmap":[],"pg_upmap_items":[],"pg_temp":[],"primary_temp":[],"blocklist":{},"range_blocklist":{},"erasure_code_profiles":{"default":{"crush-failure-domain":"osd","k":"2","m":"1","plugin":"jerasure","technique":"reed_sol_van"}},"removed_snaps_queue":[],"new_removed_snaps":[],"new_purged_snaps":[],"crush_node_flags":{},"device_class_flags":{},"stretch_mode":{"stretch_mode_enabled":false,"stretch_bucket_count":0,"degraded_stretch_mode":0,"recovering_stretch_mode":0,"stretch_mode_bucket":0}} 2023-08-01T19:53:50.403 DEBUG:teuthology.misc:2 of 3 OSDs are up 2023-08-01T19:53:56.706 DEBUG:teuthology.orchestra.run.smithi006:> adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage ceph --cluster ceph osd dump --format=json 2023-08-01T19:53:57.037 INFO:teuthology.misc.health.smithi006.stdout: 2023-08-01T19:53:57.037 INFO:teuthology.misc.health.smithi006.stdout:{"epoch":11,"fsid":"a0e420cc-4df1-42a5-8bd4-a98c309a9349","created":"2023-08-01T19:53:41.279588+0000","modified":"2023-08-01T19:53:52.742841+0000","last_up_change":"2023-08-01T19:53:50.735626+0000","last_in_change":"2023-08-01T19:53:42.974751+0000","flags":"sortbitwise,recovery_deletes,purged_snapdirs,pglog_hardlimit","flags_num":5799936,"flags_set":["pglog_hardlimit","purged_snapdirs","recovery_deletes","sortbitwise"],"crush_version":5,"full_ratio":0.94999998807907104,"backfillfull_ratio":0.89999997615814209,"nearfull_ratio":0.85000002384185791,"cluster_snapshot":"","pool_max":1,"max_osd":3,"require_min_compat_client":"luminous","min_compat_client":"jewel","require_osd_release":"quincy","pools":[{"pool":1,"pool_name":".mgr","create_time":"2023-08-01T19:53:49.961944+0000","flags":1,"flags_names":"hashpspool","type":1,"size":2,"min_size":1,"crush_rule":0,"peering_crush_bucket_count":0,"peering_crush_bucket_target":0,"peering_crush_bucket_barrier":0,"peering_crush_bucket_mandatory_member":2147483647,"object_hash":2,"pg_autoscale_mode":"off","pg_num":1,"pg_placement_num":1,"pg_placement_num_target":1,"pg_num_target":1,"pg_num_pending":1,"last_pg_merge_meta":{"source_pgid":"0.0","ready_epoch":0,"last_epoch_started":0,"last_epoch_clean":0,"source_version":"0'0","target_version":"0'0"},"last_change":"11","last_force_op_resend":"0","last_force_op_resend_prenautilus":"0","last_force_op_resend_preluminous":"0","auid":0,"snap_mode":"selfmanaged","snap_seq":0,"snap_epoch":0,"pool_snaps":[],"removed_snaps":"[]","quota_max_bytes":0,"quota_max_objects":0,"tiers":[],"tier_of":-1,"read_tier":-1,"write_tier":-1,"cache_mode":"none","target_max_bytes":0,"target_max_objects":0,"cache_target_dirty_ratio_micro":400000,"cache_target_dirty_high_ratio_micro":600000,"cache_target_full_ratio_micro":800000,"cache_min_flush_age":0,"cache_min_evict_age":0,"erasure_code_profile":"","hit_set_params":{"type":"none"},"hit_set_period":0,"hit_set_count":0,"use_gmt_hitset":true,"min_read_recency_for_promote":0,"min_write_recency_for_promote":0,"hit_set_grade_decay_rate":0,"hit_set_search_last_n":0,"grade_table":[],"stripe_width":0,"expected_num_objects":0,"fast_read":false,"options":{"pg_num_max":32,"pg_num_min":1},"application_metadata":{"mgr":{}}}],"osds":[{"osd":0,"uuid":"5dd675c7-2777-48f2-8009-ff0e0d4c7086","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":8,"up_thru":0,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.8:6800","nonce":111181},{"type":"v1","addr":"172.21.15.8:6801","nonce":111181}]},"cluster_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.8:6802","nonce":111181},{"type":"v1","addr":"172.21.15.8:6803","nonce":111181}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.8:6806","nonce":111181},{"type":"v1","addr":"172.21.15.8:6807","nonce":111181}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.8:6804","nonce":111181},{"type":"v1","addr":"172.21.15.8:6805","nonce":111181}]},"public_addr":"172.21.15.8:6801/111181","cluster_addr":"172.21.15.8:6803/111181","heartbeat_back_addr":"172.21.15.8:6807/111181","heartbeat_front_addr":"172.21.15.8:6805/111181","state":["exists","up"]},{"osd":1,"uuid":"7fc612c4-33ba-4a33-bca8-1f42ee8ed548","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":8,"up_thru":9,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.101:6800","nonce":111143},{"type":"v1","addr":"172.21.15.101:6801","nonce":111143}]},"cluster_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.101:6802","nonce":111143},{"type":"v1","addr":"172.21.15.101:6803","nonce":111143}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.101:6806","nonce":111143},{"type":"v1","addr":"172.21.15.101:6807","nonce":111143}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.101:6804","nonce":111143},{"type":"v1","addr":"172.21.15.101:6805","nonce":111143}]},"public_addr":"172.21.15.101:6801/111143","cluster_addr":"172.21.15.101:6803/111143","heartbeat_back_addr":"172.21.15.101:6807/111143","heartbeat_front_addr":"172.21.15.101:6805/111143","state":["exists","up"]},{"osd":2,"uuid":"f85cadbc-4230-4772-8f39-62ed52e220b1","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":9,"up_thru":0,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.155:6800","nonce":111339},{"type":"v1","addr":"172.21.15.155:6801","nonce":111339}]},"cluster_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.155:6802","nonce":111339},{"type":"v1","addr":"172.21.15.155:6803","nonce":111339}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.155:6806","nonce":111339},{"type":"v1","addr":"172.21.15.155:6807","nonce":111339}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.155:6804","nonce":111339},{"type":"v1","addr":"172.21.15.155:6805","nonce":111339}]},"public_addr":"172.21.15.155:6801/111339","cluster_addr":"172.21.15.155:6803/111339","heartbeat_back_addr":"172.21.15.155:6807/111339","heartbeat_front_addr":"172.21.15.155:6805/111339","state":["exists","up"]}],"osd_xinfo":[{"osd":0,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4540138320759226367,"old_weight":0,"last_purged_snaps_scrub":"2023-08-01T19:53:48.018154+0000","dead_epoch":0},{"osd":1,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4540138320759226367,"old_weight":0,"last_purged_snaps_scrub":"2023-08-01T19:53:48.000488+0000","dead_epoch":0},{"osd":2,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4540138320759226367,"old_weight":0,"last_purged_snaps_scrub":"2023-08-01T19:53:48.072529+0000","dead_epoch":0}],"pg_upmap":[],"pg_upmap_items":[],"pg_temp":[],"primary_temp":[],"blocklist":{},"range_blocklist":{},"erasure_code_profiles":{"default":{"crush-failure-domain":"osd","k":"2","m":"1","plugin":"jerasure","technique":"reed_sol_van"}},"removed_snaps_queue":[],"new_removed_snaps":[],"new_purged_snaps":[],"crush_node_flags":{},"device_class_flags":{},"stretch_mode":{"stretch_mode_enabled":false,"stretch_bucket_count":0,"degraded_stretch_mode":0,"recovering_stretch_mode":0,"stretch_mode_bucket":0}} 2023-08-01T19:53:57.049 DEBUG:teuthology.misc:3 of 3 OSDs are up 2023-08-01T19:53:57.050 INFO:tasks.ceph:Creating RBD pool 2023-08-01T19:53:57.050 DEBUG:teuthology.orchestra.run.smithi006:> sudo ceph --cluster ceph osd pool create rbd 8 2023-08-01T19:53:57.972 INFO:teuthology.orchestra.run.smithi006.stderr:pool 'rbd' created 2023-08-01T19:53:57.985 DEBUG:teuthology.orchestra.run.smithi006:> sudo ceph --cluster ceph osd pool application enable rbd rbd --yes-i-really-mean-it 2023-08-01T19:53:58.976 INFO:teuthology.orchestra.run.smithi006.stderr:enabled application 'rbd' on pool 'rbd' 2023-08-01T19:53:58.989 INFO:tasks.ceph:Starting mds daemons in cluster ceph... 2023-08-01T19:53:58.990 INFO:tasks.ceph.mds.a:Restarting daemon 2023-08-01T19:53:58.990 DEBUG:teuthology.orchestra.run.smithi006:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage daemon-helper kill ceph-mds -f --cluster ceph -i a 2023-08-01T19:53:58.992 INFO:tasks.ceph.mds.a:Started 2023-08-01T19:53:58.992 INFO:tasks.ceph:Setting up CephFS filesystem(s)... 2023-08-01T19:53:58.992 DEBUG:teuthology.orchestra.run.smithi006:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 120 ceph --cluster ceph osd dump --format=json 2023-08-01T19:53:59.075 INFO:tasks.ceph.mds.a.smithi006.stdout:starting mds.a at 2023-08-01T19:53:59.325 INFO:teuthology.orchestra.run.smithi006.stdout: 2023-08-01T19:53:59.325 INFO:teuthology.orchestra.run.smithi006.stdout:{"epoch":13,"fsid":"a0e420cc-4df1-42a5-8bd4-a98c309a9349","created":"2023-08-01T19:53:41.279588+0000","modified":"2023-08-01T19:53:58.963876+0000","last_up_change":"2023-08-01T19:53:50.735626+0000","last_in_change":"2023-08-01T19:53:42.974751+0000","flags":"sortbitwise,recovery_deletes,purged_snapdirs,pglog_hardlimit","flags_num":5799936,"flags_set":["pglog_hardlimit","purged_snapdirs","recovery_deletes","sortbitwise"],"crush_version":5,"full_ratio":0.94999998807907104,"backfillfull_ratio":0.89999997615814209,"nearfull_ratio":0.85000002384185791,"cluster_snapshot":"","pool_max":2,"max_osd":3,"require_min_compat_client":"luminous","min_compat_client":"jewel","require_osd_release":"quincy","pools":[{"pool":1,"pool_name":".mgr","create_time":"2023-08-01T19:53:49.961944+0000","flags":1,"flags_names":"hashpspool","type":1,"size":2,"min_size":1,"crush_rule":0,"peering_crush_bucket_count":0,"peering_crush_bucket_target":0,"peering_crush_bucket_barrier":0,"peering_crush_bucket_mandatory_member":2147483647,"object_hash":2,"pg_autoscale_mode":"off","pg_num":1,"pg_placement_num":1,"pg_placement_num_target":1,"pg_num_target":1,"pg_num_pending":1,"last_pg_merge_meta":{"source_pgid":"0.0","ready_epoch":0,"last_epoch_started":0,"last_epoch_clean":0,"source_version":"0'0","target_version":"0'0"},"last_change":"11","last_force_op_resend":"0","last_force_op_resend_prenautilus":"0","last_force_op_resend_preluminous":"0","auid":0,"snap_mode":"selfmanaged","snap_seq":0,"snap_epoch":0,"pool_snaps":[],"removed_snaps":"[]","quota_max_bytes":0,"quota_max_objects":0,"tiers":[],"tier_of":-1,"read_tier":-1,"write_tier":-1,"cache_mode":"none","target_max_bytes":0,"target_max_objects":0,"cache_target_dirty_ratio_micro":400000,"cache_target_dirty_high_ratio_micro":600000,"cache_target_full_ratio_micro":800000,"cache_min_flush_age":0,"cache_min_evict_age":0,"erasure_code_profile":"","hit_set_params":{"type":"none"},"hit_set_period":0,"hit_set_count":0,"use_gmt_hitset":true,"min_read_recency_for_promote":0,"min_write_recency_for_promote":0,"hit_set_grade_decay_rate":0,"hit_set_search_last_n":0,"grade_table":[],"stripe_width":0,"expected_num_objects":0,"fast_read":false,"options":{"pg_num_max":32,"pg_num_min":1},"application_metadata":{"mgr":{}}},{"pool":2,"pool_name":"rbd","create_time":"2023-08-01T19:53:57.404091+0000","flags":32769,"flags_names":"hashpspool,creating","type":1,"size":2,"min_size":1,"crush_rule":0,"peering_crush_bucket_count":0,"peering_crush_bucket_target":0,"peering_crush_bucket_barrier":0,"peering_crush_bucket_mandatory_member":2147483647,"object_hash":2,"pg_autoscale_mode":"off","pg_num":8,"pg_placement_num":8,"pg_placement_num_target":8,"pg_num_target":8,"pg_num_pending":8,"last_pg_merge_meta":{"source_pgid":"0.0","ready_epoch":0,"last_epoch_started":0,"last_epoch_clean":0,"source_version":"0'0","target_version":"0'0"},"last_change":"13","last_force_op_resend":"0","last_force_op_resend_prenautilus":"0","last_force_op_resend_preluminous":"0","auid":0,"snap_mode":"selfmanaged","snap_seq":0,"snap_epoch":0,"pool_snaps":[],"removed_snaps":"[]","quota_max_bytes":0,"quota_max_objects":0,"tiers":[],"tier_of":-1,"read_tier":-1,"write_tier":-1,"cache_mode":"none","target_max_bytes":0,"target_max_objects":0,"cache_target_dirty_ratio_micro":400000,"cache_target_dirty_high_ratio_micro":600000,"cache_target_full_ratio_micro":800000,"cache_min_flush_age":0,"cache_min_evict_age":0,"erasure_code_profile":"","hit_set_params":{"type":"none"},"hit_set_period":0,"hit_set_count":0,"use_gmt_hitset":true,"min_read_recency_for_promote":0,"min_write_recency_for_promote":0,"hit_set_grade_decay_rate":0,"hit_set_search_last_n":0,"grade_table":[],"stripe_width":0,"expected_num_objects":0,"fast_read":false,"options":{},"application_metadata":{"rbd":{}}}],"osds":[{"osd":0,"uuid":"5dd675c7-2777-48f2-8009-ff0e0d4c7086","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":8,"up_thru":12,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.8:6800","nonce":111181},{"type":"v1","addr":"172.21.15.8:6801","nonce":111181}]},"cluster_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.8:6802","nonce":111181},{"type":"v1","addr":"172.21.15.8:6803","nonce":111181}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.8:6806","nonce":111181},{"type":"v1","addr":"172.21.15.8:6807","nonce":111181}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.8:6804","nonce":111181},{"type":"v1","addr":"172.21.15.8:6805","nonce":111181}]},"public_addr":"172.21.15.8:6801/111181","cluster_addr":"172.21.15.8:6803/111181","heartbeat_back_addr":"172.21.15.8:6807/111181","heartbeat_front_addr":"172.21.15.8:6805/111181","state":["exists","up"]},{"osd":1,"uuid":"7fc612c4-33ba-4a33-bca8-1f42ee8ed548","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":8,"up_thru":12,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.101:6800","nonce":111143},{"type":"v1","addr":"172.21.15.101:6801","nonce":111143}]},"cluster_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.101:6802","nonce":111143},{"type":"v1","addr":"172.21.15.101:6803","nonce":111143}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.101:6806","nonce":111143},{"type":"v1","addr":"172.21.15.101:6807","nonce":111143}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.101:6804","nonce":111143},{"type":"v1","addr":"172.21.15.101:6805","nonce":111143}]},"public_addr":"172.21.15.101:6801/111143","cluster_addr":"172.21.15.101:6803/111143","heartbeat_back_addr":"172.21.15.101:6807/111143","heartbeat_front_addr":"172.21.15.101:6805/111143","state":["exists","up"]},{"osd":2,"uuid":"f85cadbc-4230-4772-8f39-62ed52e220b1","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":9,"up_thru":12,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.155:6800","nonce":111339},{"type":"v1","addr":"172.21.15.155:6801","nonce":111339}]},"cluster_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.155:6802","nonce":111339},{"type":"v1","addr":"172.21.15.155:6803","nonce":111339}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.155:6806","nonce":111339},{"type":"v1","addr":"172.21.15.155:6807","nonce":111339}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.155:6804","nonce":111339},{"type":"v1","addr":"172.21.15.155:6805","nonce":111339}]},"public_addr":"172.21.15.155:6801/111339","cluster_addr":"172.21.15.155:6803/111339","heartbeat_back_addr":"172.21.15.155:6807/111339","heartbeat_front_addr":"172.21.15.155:6805/111339","state":["exists","up"]}],"osd_xinfo":[{"osd":0,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4540138320759226367,"old_weight":0,"last_purged_snaps_scrub":"2023-08-01T19:53:48.018154+0000","dead_epoch":0},{"osd":1,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4540138320759226367,"old_weight":0,"last_purged_snaps_scrub":"2023-08-01T19:53:48.000488+0000","dead_epoch":0},{"osd":2,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4540138320759226367,"old_weight":0,"last_purged_snaps_scrub":"2023-08-01T19:53:48.072529+0000","dead_epoch":0}],"pg_upmap":[],"pg_upmap_items":[],"pg_temp":[],"primary_temp":[],"blocklist":{},"range_blocklist":{},"erasure_code_profiles":{"default":{"crush-failure-domain":"osd","k":"2","m":"1","plugin":"jerasure","technique":"reed_sol_van"}},"removed_snaps_queue":[],"new_removed_snaps":[],"new_purged_snaps":[],"crush_node_flags":{},"device_class_flags":{},"stretch_mode":{"stretch_mode_enabled":false,"stretch_bucket_count":0,"degraded_stretch_mode":0,"recovering_stretch_mode":0,"stretch_mode_bucket":0}} 2023-08-01T19:53:59.339 INFO:tasks.cephfs.filesystem.ceph_manager:[{'pool': 1, 'pool_name': '.mgr', 'create_time': '2023-08-01T19:53:49.961944+0000', 'flags': 1, 'flags_names': 'hashpspool', 'type': 1, 'size': 2, 'min_size': 1, 'crush_rule': 0, 'peering_crush_bucket_count': 0, 'peering_crush_bucket_target': 0, 'peering_crush_bucket_barrier': 0, 'peering_crush_bucket_mandatory_member': 2147483647, 'object_hash': 2, 'pg_autoscale_mode': 'off', 'pg_num': 1, 'pg_placement_num': 1, 'pg_placement_num_target': 1, 'pg_num_target': 1, 'pg_num_pending': 1, 'last_pg_merge_meta': {'source_pgid': '0.0', 'ready_epoch': 0, 'last_epoch_started': 0, 'last_epoch_clean': 0, 'source_version': "0'0", 'target_version': "0'0"}, 'last_change': '11', 'last_force_op_resend': '0', 'last_force_op_resend_prenautilus': '0', 'last_force_op_resend_preluminous': '0', 'auid': 0, 'snap_mode': 'selfmanaged', 'snap_seq': 0, 'snap_epoch': 0, 'pool_snaps': [], 'removed_snaps': '[]', 'quota_max_bytes': 0, 'quota_max_objects': 0, 'tiers': [], 'tier_of': -1, 'read_tier': -1, 'write_tier': -1, 'cache_mode': 'none', 'target_max_bytes': 0, 'target_max_objects': 0, 'cache_target_dirty_ratio_micro': 400000, 'cache_target_dirty_high_ratio_micro': 600000, 'cache_target_full_ratio_micro': 800000, 'cache_min_flush_age': 0, 'cache_min_evict_age': 0, 'erasure_code_profile': '', 'hit_set_params': {'type': 'none'}, 'hit_set_period': 0, 'hit_set_count': 0, 'use_gmt_hitset': True, 'min_read_recency_for_promote': 0, 'min_write_recency_for_promote': 0, 'hit_set_grade_decay_rate': 0, 'hit_set_search_last_n': 0, 'grade_table': [], 'stripe_width': 0, 'expected_num_objects': 0, 'fast_read': False, 'options': {'pg_num_max': 32, 'pg_num_min': 1}, 'application_metadata': {'mgr': {}}}, {'pool': 2, 'pool_name': 'rbd', 'create_time': '2023-08-01T19:53:57.404091+0000', 'flags': 32769, 'flags_names': 'hashpspool,creating', 'type': 1, 'size': 2, 'min_size': 1, 'crush_rule': 0, 'peering_crush_bucket_count': 0, 'peering_crush_bucket_target': 0, 'peering_crush_bucket_barrier': 0, 'peering_crush_bucket_mandatory_member': 2147483647, 'object_hash': 2, 'pg_autoscale_mode': 'off', 'pg_num': 8, 'pg_placement_num': 8, 'pg_placement_num_target': 8, 'pg_num_target': 8, 'pg_num_pending': 8, 'last_pg_merge_meta': {'source_pgid': '0.0', 'ready_epoch': 0, 'last_epoch_started': 0, 'last_epoch_clean': 0, 'source_version': "0'0", 'target_version': "0'0"}, 'last_change': '13', 'last_force_op_resend': '0', 'last_force_op_resend_prenautilus': '0', 'last_force_op_resend_preluminous': '0', 'auid': 0, 'snap_mode': 'selfmanaged', 'snap_seq': 0, 'snap_epoch': 0, 'pool_snaps': [], 'removed_snaps': '[]', 'quota_max_bytes': 0, 'quota_max_objects': 0, 'tiers': [], 'tier_of': -1, 'read_tier': -1, 'write_tier': -1, 'cache_mode': 'none', 'target_max_bytes': 0, 'target_max_objects': 0, 'cache_target_dirty_ratio_micro': 400000, 'cache_target_dirty_high_ratio_micro': 600000, 'cache_target_full_ratio_micro': 800000, 'cache_min_flush_age': 0, 'cache_min_evict_age': 0, 'erasure_code_profile': '', 'hit_set_params': {'type': 'none'}, 'hit_set_period': 0, 'hit_set_count': 0, 'use_gmt_hitset': True, 'min_read_recency_for_promote': 0, 'min_write_recency_for_promote': 0, 'hit_set_grade_decay_rate': 0, 'hit_set_search_last_n': 0, 'grade_table': [], 'stripe_width': 0, 'expected_num_objects': 0, 'fast_read': False, 'options': {}, 'application_metadata': {'rbd': {}}}] 2023-08-01T19:53:59.339 DEBUG:teuthology.orchestra.run.smithi006:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 120 ceph --cluster ceph osd pool get .mgr pg_num 2023-08-01T19:53:59.663 INFO:teuthology.orchestra.run.smithi006.stdout:pg_num: 1 2023-08-01T19:53:59.677 DEBUG:teuthology.orchestra.run.smithi006:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 120 ceph --cluster ceph osd pool get rbd pg_num 2023-08-01T19:54:00.003 INFO:teuthology.orchestra.run.smithi006.stdout:pg_num: 8 2023-08-01T19:54:00.017 DEBUG:teuthology.orchestra.run.smithi006:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 120 ceph --cluster ceph fs dump --format=json 2023-08-01T19:54:00.383 INFO:teuthology.orchestra.run.smithi006.stdout: 2023-08-01T19:54:00.384 INFO:teuthology.orchestra.run.smithi006.stdout:{"epoch":2,"default_fscid":-1,"compat":{"compat":{},"ro_compat":{},"incompat":{"feature_1":"base v0.20","feature_2":"client writeable ranges","feature_3":"default file layouts on dirs","feature_4":"dir inode in separate object","feature_5":"mds uses versioned encoding","feature_6":"dirfrag is stored in omap","feature_8":"no anchor table","feature_9":"file layout v2","feature_10":"snaprealm v2"}},"feature_flags":{"enable_multiple":true,"ever_enabled_multiple":true},"standbys":[{"gid":4202,"name":"a","rank":-1,"incarnation":0,"state":"up:standby","state_seq":1,"addr":"172.21.15.6:6803/2433431095","addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.6:6802","nonce":2433431095},{"type":"v1","addr":"172.21.15.6:6803","nonce":2433431095}]},"join_fscid":-1,"export_targets":[],"features":4540138320759226367,"flags":0,"compat":{"compat":{},"ro_compat":{},"incompat":{"feature_1":"base v0.20","feature_2":"client writeable ranges","feature_3":"default file layouts on dirs","feature_4":"dir inode in separate object","feature_5":"mds uses versioned encoding","feature_6":"dirfrag is stored in omap","feature_7":"mds uses inline data","feature_8":"no anchor table","feature_9":"file layout v2","feature_10":"snaprealm v2"}},"epoch":2}],"filesystems":[]} 2023-08-01T19:54:00.386 INFO:teuthology.orchestra.run.smithi006.stderr:dumped fsmap epoch 2 2023-08-01T19:54:00.397 DEBUG:teuthology.orchestra.run.smithi006:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 120 ceph --cluster ceph osd dump --format=json 2023-08-01T19:54:00.722 INFO:teuthology.orchestra.run.smithi006.stdout: 2023-08-01T19:54:00.722 INFO:teuthology.orchestra.run.smithi006.stdout:{"epoch":14,"fsid":"a0e420cc-4df1-42a5-8bd4-a98c309a9349","created":"2023-08-01T19:53:41.279588+0000","modified":"2023-08-01T19:53:59.971502+0000","last_up_change":"2023-08-01T19:53:50.735626+0000","last_in_change":"2023-08-01T19:53:42.974751+0000","flags":"sortbitwise,recovery_deletes,purged_snapdirs,pglog_hardlimit","flags_num":5799936,"flags_set":["pglog_hardlimit","purged_snapdirs","recovery_deletes","sortbitwise"],"crush_version":5,"full_ratio":0.94999998807907104,"backfillfull_ratio":0.89999997615814209,"nearfull_ratio":0.85000002384185791,"cluster_snapshot":"","pool_max":2,"max_osd":3,"require_min_compat_client":"luminous","min_compat_client":"jewel","require_osd_release":"quincy","pools":[{"pool":1,"pool_name":".mgr","create_time":"2023-08-01T19:53:49.961944+0000","flags":1,"flags_names":"hashpspool","type":1,"size":2,"min_size":1,"crush_rule":0,"peering_crush_bucket_count":0,"peering_crush_bucket_target":0,"peering_crush_bucket_barrier":0,"peering_crush_bucket_mandatory_member":2147483647,"object_hash":2,"pg_autoscale_mode":"off","pg_num":1,"pg_placement_num":1,"pg_placement_num_target":1,"pg_num_target":1,"pg_num_pending":1,"last_pg_merge_meta":{"source_pgid":"0.0","ready_epoch":0,"last_epoch_started":0,"last_epoch_clean":0,"source_version":"0'0","target_version":"0'0"},"last_change":"11","last_force_op_resend":"0","last_force_op_resend_prenautilus":"0","last_force_op_resend_preluminous":"0","auid":0,"snap_mode":"selfmanaged","snap_seq":0,"snap_epoch":0,"pool_snaps":[],"removed_snaps":"[]","quota_max_bytes":0,"quota_max_objects":0,"tiers":[],"tier_of":-1,"read_tier":-1,"write_tier":-1,"cache_mode":"none","target_max_bytes":0,"target_max_objects":0,"cache_target_dirty_ratio_micro":400000,"cache_target_dirty_high_ratio_micro":600000,"cache_target_full_ratio_micro":800000,"cache_min_flush_age":0,"cache_min_evict_age":0,"erasure_code_profile":"","hit_set_params":{"type":"none"},"hit_set_period":0,"hit_set_count":0,"use_gmt_hitset":true,"min_read_recency_for_promote":0,"min_write_recency_for_promote":0,"hit_set_grade_decay_rate":0,"hit_set_search_last_n":0,"grade_table":[],"stripe_width":0,"expected_num_objects":0,"fast_read":false,"options":{"pg_num_max":32,"pg_num_min":1},"application_metadata":{"mgr":{}}},{"pool":2,"pool_name":"rbd","create_time":"2023-08-01T19:53:57.404091+0000","flags":1,"flags_names":"hashpspool","type":1,"size":2,"min_size":1,"crush_rule":0,"peering_crush_bucket_count":0,"peering_crush_bucket_target":0,"peering_crush_bucket_barrier":0,"peering_crush_bucket_mandatory_member":2147483647,"object_hash":2,"pg_autoscale_mode":"off","pg_num":8,"pg_placement_num":8,"pg_placement_num_target":8,"pg_num_target":8,"pg_num_pending":8,"last_pg_merge_meta":{"source_pgid":"0.0","ready_epoch":0,"last_epoch_started":0,"last_epoch_clean":0,"source_version":"0'0","target_version":"0'0"},"last_change":"14","last_force_op_resend":"0","last_force_op_resend_prenautilus":"0","last_force_op_resend_preluminous":"0","auid":0,"snap_mode":"selfmanaged","snap_seq":0,"snap_epoch":0,"pool_snaps":[],"removed_snaps":"[]","quota_max_bytes":0,"quota_max_objects":0,"tiers":[],"tier_of":-1,"read_tier":-1,"write_tier":-1,"cache_mode":"none","target_max_bytes":0,"target_max_objects":0,"cache_target_dirty_ratio_micro":400000,"cache_target_dirty_high_ratio_micro":600000,"cache_target_full_ratio_micro":800000,"cache_min_flush_age":0,"cache_min_evict_age":0,"erasure_code_profile":"","hit_set_params":{"type":"none"},"hit_set_period":0,"hit_set_count":0,"use_gmt_hitset":true,"min_read_recency_for_promote":0,"min_write_recency_for_promote":0,"hit_set_grade_decay_rate":0,"hit_set_search_last_n":0,"grade_table":[],"stripe_width":0,"expected_num_objects":0,"fast_read":false,"options":{},"application_metadata":{"rbd":{}}}],"osds":[{"osd":0,"uuid":"5dd675c7-2777-48f2-8009-ff0e0d4c7086","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":8,"up_thru":12,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.8:6800","nonce":111181},{"type":"v1","addr":"172.21.15.8:6801","nonce":111181}]},"cluster_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.8:6802","nonce":111181},{"type":"v1","addr":"172.21.15.8:6803","nonce":111181}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.8:6806","nonce":111181},{"type":"v1","addr":"172.21.15.8:6807","nonce":111181}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.8:6804","nonce":111181},{"type":"v1","addr":"172.21.15.8:6805","nonce":111181}]},"public_addr":"172.21.15.8:6801/111181","cluster_addr":"172.21.15.8:6803/111181","heartbeat_back_addr":"172.21.15.8:6807/111181","heartbeat_front_addr":"172.21.15.8:6805/111181","state":["exists","up"]},{"osd":1,"uuid":"7fc612c4-33ba-4a33-bca8-1f42ee8ed548","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":8,"up_thru":12,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.101:6800","nonce":111143},{"type":"v1","addr":"172.21.15.101:6801","nonce":111143}]},"cluster_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.101:6802","nonce":111143},{"type":"v1","addr":"172.21.15.101:6803","nonce":111143}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.101:6806","nonce":111143},{"type":"v1","addr":"172.21.15.101:6807","nonce":111143}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.101:6804","nonce":111143},{"type":"v1","addr":"172.21.15.101:6805","nonce":111143}]},"public_addr":"172.21.15.101:6801/111143","cluster_addr":"172.21.15.101:6803/111143","heartbeat_back_addr":"172.21.15.101:6807/111143","heartbeat_front_addr":"172.21.15.101:6805/111143","state":["exists","up"]},{"osd":2,"uuid":"f85cadbc-4230-4772-8f39-62ed52e220b1","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":9,"up_thru":12,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.155:6800","nonce":111339},{"type":"v1","addr":"172.21.15.155:6801","nonce":111339}]},"cluster_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.155:6802","nonce":111339},{"type":"v1","addr":"172.21.15.155:6803","nonce":111339}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.155:6806","nonce":111339},{"type":"v1","addr":"172.21.15.155:6807","nonce":111339}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.155:6804","nonce":111339},{"type":"v1","addr":"172.21.15.155:6805","nonce":111339}]},"public_addr":"172.21.15.155:6801/111339","cluster_addr":"172.21.15.155:6803/111339","heartbeat_back_addr":"172.21.15.155:6807/111339","heartbeat_front_addr":"172.21.15.155:6805/111339","state":["exists","up"]}],"osd_xinfo":[{"osd":0,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4540138320759226367,"old_weight":0,"last_purged_snaps_scrub":"2023-08-01T19:53:48.018154+0000","dead_epoch":0},{"osd":1,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4540138320759226367,"old_weight":0,"last_purged_snaps_scrub":"2023-08-01T19:53:48.000488+0000","dead_epoch":0},{"osd":2,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4540138320759226367,"old_weight":0,"last_purged_snaps_scrub":"2023-08-01T19:53:48.072529+0000","dead_epoch":0}],"pg_upmap":[],"pg_upmap_items":[],"pg_temp":[],"primary_temp":[],"blocklist":{},"range_blocklist":{},"erasure_code_profiles":{"default":{"crush-failure-domain":"osd","k":"2","m":"1","plugin":"jerasure","technique":"reed_sol_van"}},"removed_snaps_queue":[],"new_removed_snaps":[],"new_purged_snaps":[],"crush_node_flags":{},"device_class_flags":{},"stretch_mode":{"stretch_mode_enabled":false,"stretch_bucket_count":0,"degraded_stretch_mode":0,"recovering_stretch_mode":0,"stretch_mode_bucket":0}} 2023-08-01T19:54:00.736 INFO:tasks.cephfs.filesystem.ceph_manager:[{'pool': 1, 'pool_name': '.mgr', 'create_time': '2023-08-01T19:53:49.961944+0000', 'flags': 1, 'flags_names': 'hashpspool', 'type': 1, 'size': 2, 'min_size': 1, 'crush_rule': 0, 'peering_crush_bucket_count': 0, 'peering_crush_bucket_target': 0, 'peering_crush_bucket_barrier': 0, 'peering_crush_bucket_mandatory_member': 2147483647, 'object_hash': 2, 'pg_autoscale_mode': 'off', 'pg_num': 1, 'pg_placement_num': 1, 'pg_placement_num_target': 1, 'pg_num_target': 1, 'pg_num_pending': 1, 'last_pg_merge_meta': {'source_pgid': '0.0', 'ready_epoch': 0, 'last_epoch_started': 0, 'last_epoch_clean': 0, 'source_version': "0'0", 'target_version': "0'0"}, 'last_change': '11', 'last_force_op_resend': '0', 'last_force_op_resend_prenautilus': '0', 'last_force_op_resend_preluminous': '0', 'auid': 0, 'snap_mode': 'selfmanaged', 'snap_seq': 0, 'snap_epoch': 0, 'pool_snaps': [], 'removed_snaps': '[]', 'quota_max_bytes': 0, 'quota_max_objects': 0, 'tiers': [], 'tier_of': -1, 'read_tier': -1, 'write_tier': -1, 'cache_mode': 'none', 'target_max_bytes': 0, 'target_max_objects': 0, 'cache_target_dirty_ratio_micro': 400000, 'cache_target_dirty_high_ratio_micro': 600000, 'cache_target_full_ratio_micro': 800000, 'cache_min_flush_age': 0, 'cache_min_evict_age': 0, 'erasure_code_profile': '', 'hit_set_params': {'type': 'none'}, 'hit_set_period': 0, 'hit_set_count': 0, 'use_gmt_hitset': True, 'min_read_recency_for_promote': 0, 'min_write_recency_for_promote': 0, 'hit_set_grade_decay_rate': 0, 'hit_set_search_last_n': 0, 'grade_table': [], 'stripe_width': 0, 'expected_num_objects': 0, 'fast_read': False, 'options': {'pg_num_max': 32, 'pg_num_min': 1}, 'application_metadata': {'mgr': {}}}, {'pool': 2, 'pool_name': 'rbd', 'create_time': '2023-08-01T19:53:57.404091+0000', 'flags': 1, 'flags_names': 'hashpspool', 'type': 1, 'size': 2, 'min_size': 1, 'crush_rule': 0, 'peering_crush_bucket_count': 0, 'peering_crush_bucket_target': 0, 'peering_crush_bucket_barrier': 0, 'peering_crush_bucket_mandatory_member': 2147483647, 'object_hash': 2, 'pg_autoscale_mode': 'off', 'pg_num': 8, 'pg_placement_num': 8, 'pg_placement_num_target': 8, 'pg_num_target': 8, 'pg_num_pending': 8, 'last_pg_merge_meta': {'source_pgid': '0.0', 'ready_epoch': 0, 'last_epoch_started': 0, 'last_epoch_clean': 0, 'source_version': "0'0", 'target_version': "0'0"}, 'last_change': '14', 'last_force_op_resend': '0', 'last_force_op_resend_prenautilus': '0', 'last_force_op_resend_preluminous': '0', 'auid': 0, 'snap_mode': 'selfmanaged', 'snap_seq': 0, 'snap_epoch': 0, 'pool_snaps': [], 'removed_snaps': '[]', 'quota_max_bytes': 0, 'quota_max_objects': 0, 'tiers': [], 'tier_of': -1, 'read_tier': -1, 'write_tier': -1, 'cache_mode': 'none', 'target_max_bytes': 0, 'target_max_objects': 0, 'cache_target_dirty_ratio_micro': 400000, 'cache_target_dirty_high_ratio_micro': 600000, 'cache_target_full_ratio_micro': 800000, 'cache_min_flush_age': 0, 'cache_min_evict_age': 0, 'erasure_code_profile': '', 'hit_set_params': {'type': 'none'}, 'hit_set_period': 0, 'hit_set_count': 0, 'use_gmt_hitset': True, 'min_read_recency_for_promote': 0, 'min_write_recency_for_promote': 0, 'hit_set_grade_decay_rate': 0, 'hit_set_search_last_n': 0, 'grade_table': [], 'stripe_width': 0, 'expected_num_objects': 0, 'fast_read': False, 'options': {}, 'application_metadata': {'rbd': {}}}] 2023-08-01T19:54:00.736 DEBUG:teuthology.orchestra.run.smithi006:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 120 ceph --cluster ceph osd pool get .mgr pg_num 2023-08-01T19:54:01.063 INFO:teuthology.orchestra.run.smithi006.stdout:pg_num: 1 2023-08-01T19:54:01.077 DEBUG:teuthology.orchestra.run.smithi006:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 120 ceph --cluster ceph osd pool get rbd pg_num 2023-08-01T19:54:01.398 INFO:teuthology.orchestra.run.smithi006.stdout:pg_num: 8 2023-08-01T19:54:01.411 DEBUG:teuthology.orchestra.run.smithi006:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 120 ceph --cluster ceph --format=json-pretty osd lspools 2023-08-01T19:54:01.738 INFO:teuthology.orchestra.run.smithi006.stdout: 2023-08-01T19:54:01.738 INFO:teuthology.orchestra.run.smithi006.stdout:[ 2023-08-01T19:54:01.738 INFO:teuthology.orchestra.run.smithi006.stdout: { 2023-08-01T19:54:01.738 INFO:teuthology.orchestra.run.smithi006.stdout: "poolnum": 1, 2023-08-01T19:54:01.738 INFO:teuthology.orchestra.run.smithi006.stdout: "poolname": ".mgr" 2023-08-01T19:54:01.738 INFO:teuthology.orchestra.run.smithi006.stdout: }, 2023-08-01T19:54:01.739 INFO:teuthology.orchestra.run.smithi006.stdout: { 2023-08-01T19:54:01.739 INFO:teuthology.orchestra.run.smithi006.stdout: "poolnum": 2, 2023-08-01T19:54:01.739 INFO:teuthology.orchestra.run.smithi006.stdout: "poolname": "rbd" 2023-08-01T19:54:01.739 INFO:teuthology.orchestra.run.smithi006.stdout: } 2023-08-01T19:54:01.739 INFO:teuthology.orchestra.run.smithi006.stdout:] 2023-08-01T19:54:01.751 DEBUG:tasks.cephfs.filesystem:Creating filesystem 'cephfs' 2023-08-01T19:54:01.751 DEBUG:teuthology.orchestra.run.smithi006:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 120 ceph --cluster ceph osd pool create cephfs_metadata --pg_num_min 64 2023-08-01T19:54:03.047 INFO:teuthology.orchestra.run.smithi006.stderr:pool 'cephfs_metadata' created 2023-08-01T19:54:03.060 DEBUG:teuthology.orchestra.run.smithi006:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 120 ceph --cluster ceph osd pool create cephfs_data 64 --pg_num_min 64 --target_size_ratio 0.9 2023-08-01T19:54:04.058 INFO:teuthology.orchestra.run.smithi006.stderr:pool 'cephfs_data' created 2023-08-01T19:54:04.073 DEBUG:teuthology.orchestra.run.smithi006:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 120 ceph --cluster ceph fs new cephfs cephfs_metadata cephfs_data 2023-08-01T19:54:04.462 INFO:teuthology.orchestra.run.smithi006.stderr:new fs with metadata pool 3 and data pool 4 2023-08-01T19:54:04.474 DEBUG:teuthology.orchestra.run.smithi006:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 120 ceph --cluster ceph osd dump --format=json 2023-08-01T19:54:04.797 INFO:teuthology.orchestra.run.smithi006.stdout: 2023-08-01T19:54:04.797 INFO:teuthology.orchestra.run.smithi006.stdout:{"epoch":17,"fsid":"a0e420cc-4df1-42a5-8bd4-a98c309a9349","created":"2023-08-01T19:53:41.279588+0000","modified":"2023-08-01T19:54:04.448007+0000","last_up_change":"2023-08-01T19:53:50.735626+0000","last_in_change":"2023-08-01T19:53:42.974751+0000","flags":"sortbitwise,recovery_deletes,purged_snapdirs,pglog_hardlimit","flags_num":5799936,"flags_set":["pglog_hardlimit","purged_snapdirs","recovery_deletes","sortbitwise"],"crush_version":5,"full_ratio":0.94999998807907104,"backfillfull_ratio":0.89999997615814209,"nearfull_ratio":0.85000002384185791,"cluster_snapshot":"","pool_max":4,"max_osd":3,"require_min_compat_client":"luminous","min_compat_client":"jewel","require_osd_release":"quincy","pools":[{"pool":1,"pool_name":".mgr","create_time":"2023-08-01T19:53:49.961944+0000","flags":1,"flags_names":"hashpspool","type":1,"size":2,"min_size":1,"crush_rule":0,"peering_crush_bucket_count":0,"peering_crush_bucket_target":0,"peering_crush_bucket_barrier":0,"peering_crush_bucket_mandatory_member":2147483647,"object_hash":2,"pg_autoscale_mode":"off","pg_num":1,"pg_placement_num":1,"pg_placement_num_target":1,"pg_num_target":1,"pg_num_pending":1,"last_pg_merge_meta":{"source_pgid":"0.0","ready_epoch":0,"last_epoch_started":0,"last_epoch_clean":0,"source_version":"0'0","target_version":"0'0"},"last_change":"11","last_force_op_resend":"0","last_force_op_resend_prenautilus":"0","last_force_op_resend_preluminous":"0","auid":0,"snap_mode":"selfmanaged","snap_seq":0,"snap_epoch":0,"pool_snaps":[],"removed_snaps":"[]","quota_max_bytes":0,"quota_max_objects":0,"tiers":[],"tier_of":-1,"read_tier":-1,"write_tier":-1,"cache_mode":"none","target_max_bytes":0,"target_max_objects":0,"cache_target_dirty_ratio_micro":400000,"cache_target_dirty_high_ratio_micro":600000,"cache_target_full_ratio_micro":800000,"cache_min_flush_age":0,"cache_min_evict_age":0,"erasure_code_profile":"","hit_set_params":{"type":"none"},"hit_set_period":0,"hit_set_count":0,"use_gmt_hitset":true,"min_read_recency_for_promote":0,"min_write_recency_for_promote":0,"hit_set_grade_decay_rate":0,"hit_set_search_last_n":0,"grade_table":[],"stripe_width":0,"expected_num_objects":0,"fast_read":false,"options":{"pg_num_max":32,"pg_num_min":1},"application_metadata":{"mgr":{}}},{"pool":2,"pool_name":"rbd","create_time":"2023-08-01T19:53:57.404091+0000","flags":1,"flags_names":"hashpspool","type":1,"size":2,"min_size":1,"crush_rule":0,"peering_crush_bucket_count":0,"peering_crush_bucket_target":0,"peering_crush_bucket_barrier":0,"peering_crush_bucket_mandatory_member":2147483647,"object_hash":2,"pg_autoscale_mode":"off","pg_num":8,"pg_placement_num":8,"pg_placement_num_target":8,"pg_num_target":8,"pg_num_pending":8,"last_pg_merge_meta":{"source_pgid":"0.0","ready_epoch":0,"last_epoch_started":0,"last_epoch_clean":0,"source_version":"0'0","target_version":"0'0"},"last_change":"14","last_force_op_resend":"0","last_force_op_resend_prenautilus":"0","last_force_op_resend_preluminous":"0","auid":0,"snap_mode":"selfmanaged","snap_seq":0,"snap_epoch":0,"pool_snaps":[],"removed_snaps":"[]","quota_max_bytes":0,"quota_max_objects":0,"tiers":[],"tier_of":-1,"read_tier":-1,"write_tier":-1,"cache_mode":"none","target_max_bytes":0,"target_max_objects":0,"cache_target_dirty_ratio_micro":400000,"cache_target_dirty_high_ratio_micro":600000,"cache_target_full_ratio_micro":800000,"cache_min_flush_age":0,"cache_min_evict_age":0,"erasure_code_profile":"","hit_set_params":{"type":"none"},"hit_set_period":0,"hit_set_count":0,"use_gmt_hitset":true,"min_read_recency_for_promote":0,"min_write_recency_for_promote":0,"hit_set_grade_decay_rate":0,"hit_set_search_last_n":0,"grade_table":[],"stripe_width":0,"expected_num_objects":0,"fast_read":false,"options":{},"application_metadata":{"rbd":{}}},{"pool":3,"pool_name":"cephfs_metadata","create_time":"2023-08-01T19:54:02.111247+0000","flags":1,"flags_names":"hashpspool","type":1,"size":2,"min_size":1,"crush_rule":0,"peering_crush_bucket_count":0,"peering_crush_bucket_target":0,"peering_crush_bucket_barrier":0,"peering_crush_bucket_mandatory_member":2147483647,"object_hash":2,"pg_autoscale_mode":"off","pg_num":32,"pg_placement_num":32,"pg_placement_num_target":32,"pg_num_target":32,"pg_num_pending":32,"last_pg_merge_meta":{"source_pgid":"0.0","ready_epoch":0,"last_epoch_started":0,"last_epoch_clean":0,"source_version":"0'0","target_version":"0'0"},"last_change":"17","last_force_op_resend":"0","last_force_op_resend_prenautilus":"0","last_force_op_resend_preluminous":"0","auid":0,"snap_mode":"selfmanaged","snap_seq":0,"snap_epoch":0,"pool_snaps":[],"removed_snaps":"[]","quota_max_bytes":0,"quota_max_objects":0,"tiers":[],"tier_of":-1,"read_tier":-1,"write_tier":-1,"cache_mode":"none","target_max_bytes":0,"target_max_objects":0,"cache_target_dirty_ratio_micro":400000,"cache_target_dirty_high_ratio_micro":600000,"cache_target_full_ratio_micro":800000,"cache_min_flush_age":0,"cache_min_evict_age":0,"erasure_code_profile":"","hit_set_params":{"type":"none"},"hit_set_period":0,"hit_set_count":0,"use_gmt_hitset":true,"min_read_recency_for_promote":0,"min_write_recency_for_promote":0,"hit_set_grade_decay_rate":0,"hit_set_search_last_n":0,"grade_table":[],"stripe_width":0,"expected_num_objects":0,"fast_read":false,"options":{"pg_autoscale_bias":4,"pg_num_min":16,"recovery_priority":5},"application_metadata":{"cephfs":{"metadata":"cephfs"}}},{"pool":4,"pool_name":"cephfs_data","create_time":"2023-08-01T19:54:03.430277+0000","flags":32769,"flags_names":"hashpspool,creating","type":1,"size":2,"min_size":1,"crush_rule":0,"peering_crush_bucket_count":0,"peering_crush_bucket_target":0,"peering_crush_bucket_barrier":0,"peering_crush_bucket_mandatory_member":2147483647,"object_hash":2,"pg_autoscale_mode":"off","pg_num":64,"pg_placement_num":64,"pg_placement_num_target":64,"pg_num_target":64,"pg_num_pending":64,"last_pg_merge_meta":{"source_pgid":"0.0","ready_epoch":0,"last_epoch_started":0,"last_epoch_clean":0,"source_version":"0'0","target_version":"0'0"},"last_change":"17","last_force_op_resend":"0","last_force_op_resend_prenautilus":"0","last_force_op_resend_preluminous":"0","auid":0,"snap_mode":"selfmanaged","snap_seq":0,"snap_epoch":0,"pool_snaps":[],"removed_snaps":"[]","quota_max_bytes":0,"quota_max_objects":0,"tiers":[],"tier_of":-1,"read_tier":-1,"write_tier":-1,"cache_mode":"none","target_max_bytes":0,"target_max_objects":0,"cache_target_dirty_ratio_micro":400000,"cache_target_dirty_high_ratio_micro":600000,"cache_target_full_ratio_micro":800000,"cache_min_flush_age":0,"cache_min_evict_age":0,"erasure_code_profile":"","hit_set_params":{"type":"none"},"hit_set_period":0,"hit_set_count":0,"use_gmt_hitset":true,"min_read_recency_for_promote":0,"min_write_recency_for_promote":0,"hit_set_grade_decay_rate":0,"hit_set_search_last_n":0,"grade_table":[],"stripe_width":0,"expected_num_objects":0,"fast_read":false,"options":{"pg_num_min":64,"target_size_ratio":0.89999997615814209},"application_metadata":{"cephfs":{"data":"cephfs"}}}],"osds":[{"osd":0,"uuid":"5dd675c7-2777-48f2-8009-ff0e0d4c7086","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":8,"up_thru":16,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.8:6800","nonce":111181},{"type":"v1","addr":"172.21.15.8:6801","nonce":111181}]},"cluster_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.8:6802","nonce":111181},{"type":"v1","addr":"172.21.15.8:6803","nonce":111181}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.8:6806","nonce":111181},{"type":"v1","addr":"172.21.15.8:6807","nonce":111181}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.8:6804","nonce":111181},{"type":"v1","addr":"172.21.15.8:6805","nonce":111181}]},"public_addr":"172.21.15.8:6801/111181","cluster_addr":"172.21.15.8:6803/111181","heartbeat_back_addr":"172.21.15.8:6807/111181","heartbeat_front_addr":"172.21.15.8:6805/111181","state":["exists","up"]},{"osd":1,"uuid":"7fc612c4-33ba-4a33-bca8-1f42ee8ed548","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":8,"up_thru":16,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.101:6800","nonce":111143},{"type":"v1","addr":"172.21.15.101:6801","nonce":111143}]},"cluster_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.101:6802","nonce":111143},{"type":"v1","addr":"172.21.15.101:6803","nonce":111143}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.101:6806","nonce":111143},{"type":"v1","addr":"172.21.15.101:6807","nonce":111143}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.101:6804","nonce":111143},{"type":"v1","addr":"172.21.15.101:6805","nonce":111143}]},"public_addr":"172.21.15.101:6801/111143","cluster_addr":"172.21.15.101:6803/111143","heartbeat_back_addr":"172.21.15.101:6807/111143","heartbeat_front_addr":"172.21.15.101:6805/111143","state":["exists","up"]},{"osd":2,"uuid":"f85cadbc-4230-4772-8f39-62ed52e220b1","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":9,"up_thru":16,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.155:6800","nonce":111339},{"type":"v1","addr":"172.21.15.155:6801","nonce":111339}]},"cluster_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.155:6802","nonce":111339},{"type":"v1","addr":"172.21.15.155:6803","nonce":111339}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.155:6806","nonce":111339},{"type":"v1","addr":"172.21.15.155:6807","nonce":111339}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.155:6804","nonce":111339},{"type":"v1","addr":"172.21.15.155:6805","nonce":111339}]},"public_addr":"172.21.15.155:6801/111339","cluster_addr":"172.21.15.155:6803/111339","heartbeat_back_addr":"172.21.15.155:6807/111339","heartbeat_front_addr":"172.21.15.155:6805/111339","state":["exists","up"]}],"osd_xinfo":[{"osd":0,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4540138320759226367,"old_weight":0,"last_purged_snaps_scrub":"2023-08-01T19:53:48.018154+0000","dead_epoch":0},{"osd":1,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4540138320759226367,"old_weight":0,"last_purged_snaps_scrub":"2023-08-01T19:53:48.000488+0000","dead_epoch":0},{"osd":2,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4540138320759226367,"old_weight":0,"last_purged_snaps_scrub":"2023-08-01T19:53:48.072529+0000","dead_epoch":0}],"pg_upmap":[],"pg_upmap_items":[],"pg_temp":[],"primary_temp":[],"blocklist":{},"range_blocklist":{},"erasure_code_profiles":{"default":{"crush-failure-domain":"osd","k":"2","m":"1","plugin":"jerasure","technique":"reed_sol_van"}},"removed_snaps_queue":[],"new_removed_snaps":[],"new_purged_snaps":[],"crush_node_flags":{},"device_class_flags":{},"stretch_mode":{"stretch_mode_enabled":false,"stretch_bucket_count":0,"degraded_stretch_mode":0,"recovering_stretch_mode":0,"stretch_mode_bucket":0}} 2023-08-01T19:54:04.810 DEBUG:teuthology.orchestra.run.smithi006:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 120 ceph --cluster ceph osd dump --format=json 2023-08-01T19:54:05.136 INFO:teuthology.orchestra.run.smithi006.stdout: 2023-08-01T19:54:05.136 INFO:teuthology.orchestra.run.smithi006.stdout:{"epoch":17,"fsid":"a0e420cc-4df1-42a5-8bd4-a98c309a9349","created":"2023-08-01T19:53:41.279588+0000","modified":"2023-08-01T19:54:04.448007+0000","last_up_change":"2023-08-01T19:53:50.735626+0000","last_in_change":"2023-08-01T19:53:42.974751+0000","flags":"sortbitwise,recovery_deletes,purged_snapdirs,pglog_hardlimit","flags_num":5799936,"flags_set":["pglog_hardlimit","purged_snapdirs","recovery_deletes","sortbitwise"],"crush_version":5,"full_ratio":0.94999998807907104,"backfillfull_ratio":0.89999997615814209,"nearfull_ratio":0.85000002384185791,"cluster_snapshot":"","pool_max":4,"max_osd":3,"require_min_compat_client":"luminous","min_compat_client":"jewel","require_osd_release":"quincy","pools":[{"pool":1,"pool_name":".mgr","create_time":"2023-08-01T19:53:49.961944+0000","flags":1,"flags_names":"hashpspool","type":1,"size":2,"min_size":1,"crush_rule":0,"peering_crush_bucket_count":0,"peering_crush_bucket_target":0,"peering_crush_bucket_barrier":0,"peering_crush_bucket_mandatory_member":2147483647,"object_hash":2,"pg_autoscale_mode":"off","pg_num":1,"pg_placement_num":1,"pg_placement_num_target":1,"pg_num_target":1,"pg_num_pending":1,"last_pg_merge_meta":{"source_pgid":"0.0","ready_epoch":0,"last_epoch_started":0,"last_epoch_clean":0,"source_version":"0'0","target_version":"0'0"},"last_change":"11","last_force_op_resend":"0","last_force_op_resend_prenautilus":"0","last_force_op_resend_preluminous":"0","auid":0,"snap_mode":"selfmanaged","snap_seq":0,"snap_epoch":0,"pool_snaps":[],"removed_snaps":"[]","quota_max_bytes":0,"quota_max_objects":0,"tiers":[],"tier_of":-1,"read_tier":-1,"write_tier":-1,"cache_mode":"none","target_max_bytes":0,"target_max_objects":0,"cache_target_dirty_ratio_micro":400000,"cache_target_dirty_high_ratio_micro":600000,"cache_target_full_ratio_micro":800000,"cache_min_flush_age":0,"cache_min_evict_age":0,"erasure_code_profile":"","hit_set_params":{"type":"none"},"hit_set_period":0,"hit_set_count":0,"use_gmt_hitset":true,"min_read_recency_for_promote":0,"min_write_recency_for_promote":0,"hit_set_grade_decay_rate":0,"hit_set_search_last_n":0,"grade_table":[],"stripe_width":0,"expected_num_objects":0,"fast_read":false,"options":{"pg_num_max":32,"pg_num_min":1},"application_metadata":{"mgr":{}}},{"pool":2,"pool_name":"rbd","create_time":"2023-08-01T19:53:57.404091+0000","flags":1,"flags_names":"hashpspool","type":1,"size":2,"min_size":1,"crush_rule":0,"peering_crush_bucket_count":0,"peering_crush_bucket_target":0,"peering_crush_bucket_barrier":0,"peering_crush_bucket_mandatory_member":2147483647,"object_hash":2,"pg_autoscale_mode":"off","pg_num":8,"pg_placement_num":8,"pg_placement_num_target":8,"pg_num_target":8,"pg_num_pending":8,"last_pg_merge_meta":{"source_pgid":"0.0","ready_epoch":0,"last_epoch_started":0,"last_epoch_clean":0,"source_version":"0'0","target_version":"0'0"},"last_change":"14","last_force_op_resend":"0","last_force_op_resend_prenautilus":"0","last_force_op_resend_preluminous":"0","auid":0,"snap_mode":"selfmanaged","snap_seq":0,"snap_epoch":0,"pool_snaps":[],"removed_snaps":"[]","quota_max_bytes":0,"quota_max_objects":0,"tiers":[],"tier_of":-1,"read_tier":-1,"write_tier":-1,"cache_mode":"none","target_max_bytes":0,"target_max_objects":0,"cache_target_dirty_ratio_micro":400000,"cache_target_dirty_high_ratio_micro":600000,"cache_target_full_ratio_micro":800000,"cache_min_flush_age":0,"cache_min_evict_age":0,"erasure_code_profile":"","hit_set_params":{"type":"none"},"hit_set_period":0,"hit_set_count":0,"use_gmt_hitset":true,"min_read_recency_for_promote":0,"min_write_recency_for_promote":0,"hit_set_grade_decay_rate":0,"hit_set_search_last_n":0,"grade_table":[],"stripe_width":0,"expected_num_objects":0,"fast_read":false,"options":{},"application_metadata":{"rbd":{}}},{"pool":3,"pool_name":"cephfs_metadata","create_time":"2023-08-01T19:54:02.111247+0000","flags":1,"flags_names":"hashpspool","type":1,"size":2,"min_size":1,"crush_rule":0,"peering_crush_bucket_count":0,"peering_crush_bucket_target":0,"peering_crush_bucket_barrier":0,"peering_crush_bucket_mandatory_member":2147483647,"object_hash":2,"pg_autoscale_mode":"off","pg_num":32,"pg_placement_num":32,"pg_placement_num_target":32,"pg_num_target":32,"pg_num_pending":32,"last_pg_merge_meta":{"source_pgid":"0.0","ready_epoch":0,"last_epoch_started":0,"last_epoch_clean":0,"source_version":"0'0","target_version":"0'0"},"last_change":"17","last_force_op_resend":"0","last_force_op_resend_prenautilus":"0","last_force_op_resend_preluminous":"0","auid":0,"snap_mode":"selfmanaged","snap_seq":0,"snap_epoch":0,"pool_snaps":[],"removed_snaps":"[]","quota_max_bytes":0,"quota_max_objects":0,"tiers":[],"tier_of":-1,"read_tier":-1,"write_tier":-1,"cache_mode":"none","target_max_bytes":0,"target_max_objects":0,"cache_target_dirty_ratio_micro":400000,"cache_target_dirty_high_ratio_micro":600000,"cache_target_full_ratio_micro":800000,"cache_min_flush_age":0,"cache_min_evict_age":0,"erasure_code_profile":"","hit_set_params":{"type":"none"},"hit_set_period":0,"hit_set_count":0,"use_gmt_hitset":true,"min_read_recency_for_promote":0,"min_write_recency_for_promote":0,"hit_set_grade_decay_rate":0,"hit_set_search_last_n":0,"grade_table":[],"stripe_width":0,"expected_num_objects":0,"fast_read":false,"options":{"pg_autoscale_bias":4,"pg_num_min":16,"recovery_priority":5},"application_metadata":{"cephfs":{"metadata":"cephfs"}}},{"pool":4,"pool_name":"cephfs_data","create_time":"2023-08-01T19:54:03.430277+0000","flags":32769,"flags_names":"hashpspool,creating","type":1,"size":2,"min_size":1,"crush_rule":0,"peering_crush_bucket_count":0,"peering_crush_bucket_target":0,"peering_crush_bucket_barrier":0,"peering_crush_bucket_mandatory_member":2147483647,"object_hash":2,"pg_autoscale_mode":"off","pg_num":64,"pg_placement_num":64,"pg_placement_num_target":64,"pg_num_target":64,"pg_num_pending":64,"last_pg_merge_meta":{"source_pgid":"0.0","ready_epoch":0,"last_epoch_started":0,"last_epoch_clean":0,"source_version":"0'0","target_version":"0'0"},"last_change":"17","last_force_op_resend":"0","last_force_op_resend_prenautilus":"0","last_force_op_resend_preluminous":"0","auid":0,"snap_mode":"selfmanaged","snap_seq":0,"snap_epoch":0,"pool_snaps":[],"removed_snaps":"[]","quota_max_bytes":0,"quota_max_objects":0,"tiers":[],"tier_of":-1,"read_tier":-1,"write_tier":-1,"cache_mode":"none","target_max_bytes":0,"target_max_objects":0,"cache_target_dirty_ratio_micro":400000,"cache_target_dirty_high_ratio_micro":600000,"cache_target_full_ratio_micro":800000,"cache_min_flush_age":0,"cache_min_evict_age":0,"erasure_code_profile":"","hit_set_params":{"type":"none"},"hit_set_period":0,"hit_set_count":0,"use_gmt_hitset":true,"min_read_recency_for_promote":0,"min_write_recency_for_promote":0,"hit_set_grade_decay_rate":0,"hit_set_search_last_n":0,"grade_table":[],"stripe_width":0,"expected_num_objects":0,"fast_read":false,"options":{"pg_num_min":64,"target_size_ratio":0.89999997615814209},"application_metadata":{"cephfs":{"data":"cephfs"}}}],"osds":[{"osd":0,"uuid":"5dd675c7-2777-48f2-8009-ff0e0d4c7086","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":8,"up_thru":16,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.8:6800","nonce":111181},{"type":"v1","addr":"172.21.15.8:6801","nonce":111181}]},"cluster_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.8:6802","nonce":111181},{"type":"v1","addr":"172.21.15.8:6803","nonce":111181}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.8:6806","nonce":111181},{"type":"v1","addr":"172.21.15.8:6807","nonce":111181}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.8:6804","nonce":111181},{"type":"v1","addr":"172.21.15.8:6805","nonce":111181}]},"public_addr":"172.21.15.8:6801/111181","cluster_addr":"172.21.15.8:6803/111181","heartbeat_back_addr":"172.21.15.8:6807/111181","heartbeat_front_addr":"172.21.15.8:6805/111181","state":["exists","up"]},{"osd":1,"uuid":"7fc612c4-33ba-4a33-bca8-1f42ee8ed548","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":8,"up_thru":16,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.101:6800","nonce":111143},{"type":"v1","addr":"172.21.15.101:6801","nonce":111143}]},"cluster_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.101:6802","nonce":111143},{"type":"v1","addr":"172.21.15.101:6803","nonce":111143}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.101:6806","nonce":111143},{"type":"v1","addr":"172.21.15.101:6807","nonce":111143}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.101:6804","nonce":111143},{"type":"v1","addr":"172.21.15.101:6805","nonce":111143}]},"public_addr":"172.21.15.101:6801/111143","cluster_addr":"172.21.15.101:6803/111143","heartbeat_back_addr":"172.21.15.101:6807/111143","heartbeat_front_addr":"172.21.15.101:6805/111143","state":["exists","up"]},{"osd":2,"uuid":"f85cadbc-4230-4772-8f39-62ed52e220b1","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":9,"up_thru":16,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.155:6800","nonce":111339},{"type":"v1","addr":"172.21.15.155:6801","nonce":111339}]},"cluster_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.155:6802","nonce":111339},{"type":"v1","addr":"172.21.15.155:6803","nonce":111339}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.155:6806","nonce":111339},{"type":"v1","addr":"172.21.15.155:6807","nonce":111339}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.155:6804","nonce":111339},{"type":"v1","addr":"172.21.15.155:6805","nonce":111339}]},"public_addr":"172.21.15.155:6801/111339","cluster_addr":"172.21.15.155:6803/111339","heartbeat_back_addr":"172.21.15.155:6807/111339","heartbeat_front_addr":"172.21.15.155:6805/111339","state":["exists","up"]}],"osd_xinfo":[{"osd":0,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4540138320759226367,"old_weight":0,"last_purged_snaps_scrub":"2023-08-01T19:53:48.018154+0000","dead_epoch":0},{"osd":1,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4540138320759226367,"old_weight":0,"last_purged_snaps_scrub":"2023-08-01T19:53:48.000488+0000","dead_epoch":0},{"osd":2,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4540138320759226367,"old_weight":0,"last_purged_snaps_scrub":"2023-08-01T19:53:48.072529+0000","dead_epoch":0}],"pg_upmap":[],"pg_upmap_items":[],"pg_temp":[],"primary_temp":[],"blocklist":{},"range_blocklist":{},"erasure_code_profiles":{"default":{"crush-failure-domain":"osd","k":"2","m":"1","plugin":"jerasure","technique":"reed_sol_van"}},"removed_snaps_queue":[],"new_removed_snaps":[],"new_purged_snaps":[],"crush_node_flags":{},"device_class_flags":{},"stretch_mode":{"stretch_mode_enabled":false,"stretch_bucket_count":0,"degraded_stretch_mode":0,"recovering_stretch_mode":0,"stretch_mode_bucket":0}} 2023-08-01T19:54:05.150 DEBUG:teuthology.orchestra.run.smithi006:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 120 ceph --cluster ceph fs set cephfs standby_count_wanted 0 2023-08-01T19:54:06.486 DEBUG:teuthology.orchestra.run.smithi006:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 120 ceph --cluster ceph fs set cephfs allow_standby_replay false 2023-08-01T19:54:07.496 DEBUG:teuthology.orchestra.run.smithi006:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 120 ceph --cluster ceph fs dump --format=json 2023-08-01T19:54:07.869 INFO:teuthology.orchestra.run.smithi006.stdout: 2023-08-01T19:54:07.869 INFO:teuthology.orchestra.run.smithi006.stdout:{"epoch":6,"default_fscid":1,"compat":{"compat":{},"ro_compat":{},"incompat":{"feature_1":"base v0.20","feature_2":"client writeable ranges","feature_3":"default file layouts on dirs","feature_4":"dir inode in separate object","feature_5":"mds uses versioned encoding","feature_6":"dirfrag is stored in omap","feature_8":"no anchor table","feature_9":"file layout v2","feature_10":"snaprealm v2"}},"feature_flags":{"enable_multiple":true,"ever_enabled_multiple":true},"standbys":[],"filesystems":[{"mdsmap":{"epoch":6,"flags":18,"flags_state":{"joinable":true,"allow_snaps":true,"allow_multimds_snaps":true,"allow_standby_replay":false},"ever_allowed_features":0,"explicitly_allowed_features":0,"created":"2023-08-01T19:54:04.448302+0000","modified":"2023-08-01T19:54:07.465889+0000","tableserver":0,"root":0,"session_timeout":60,"session_autoclose":300,"required_client_features":{},"max_file_size":1099511627776,"last_failure":0,"last_failure_osd_epoch":0,"compat":{"compat":{},"ro_compat":{},"incompat":{"feature_1":"base v0.20","feature_2":"client writeable ranges","feature_3":"default file layouts on dirs","feature_4":"dir inode in separate object","feature_5":"mds uses versioned encoding","feature_6":"dirfrag is stored in omap","feature_7":"mds uses inline data","feature_8":"no anchor table","feature_9":"file layout v2","feature_10":"snaprealm v2"}},"max_mds":1,"in":[0],"up":{"mds_0":4202},"failed":[],"damaged":[],"stopped":[],"info":{"gid_4202":{"gid":4202,"name":"a","rank":0,"incarnation":3,"state":"up:active","state_seq":3,"addr":"172.21.15.6:6803/2433431095","addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.6:6802","nonce":2433431095},{"type":"v1","addr":"172.21.15.6:6803","nonce":2433431095}]},"join_fscid":-1,"export_targets":[],"features":4540138320759226367,"flags":0,"compat":{"compat":{},"ro_compat":{},"incompat":{"feature_1":"base v0.20","feature_2":"client writeable ranges","feature_3":"default file layouts on dirs","feature_4":"dir inode in separate object","feature_5":"mds uses versioned encoding","feature_6":"dirfrag is stored in omap","feature_7":"mds uses inline data","feature_8":"no anchor table","feature_9":"file layout v2","feature_10":"snaprealm v2"}}}},"data_pools":[4],"metadata_pool":3,"enabled":true,"fs_name":"cephfs","balancer":"","standby_count_wanted":0},"id":1}]} 2023-08-01T19:54:07.871 INFO:teuthology.orchestra.run.smithi006.stderr:dumped fsmap epoch 6 2023-08-01T19:54:07.882 DEBUG:teuthology.orchestra.run.smithi006:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 120 ceph --cluster ceph osd dump --format=json 2023-08-01T19:54:08.205 INFO:teuthology.orchestra.run.smithi006.stdout: 2023-08-01T19:54:08.205 INFO:teuthology.orchestra.run.smithi006.stdout:{"epoch":18,"fsid":"a0e420cc-4df1-42a5-8bd4-a98c309a9349","created":"2023-08-01T19:53:41.279588+0000","modified":"2023-08-01T19:54:05.452537+0000","last_up_change":"2023-08-01T19:53:50.735626+0000","last_in_change":"2023-08-01T19:53:42.974751+0000","flags":"sortbitwise,recovery_deletes,purged_snapdirs,pglog_hardlimit","flags_num":5799936,"flags_set":["pglog_hardlimit","purged_snapdirs","recovery_deletes","sortbitwise"],"crush_version":5,"full_ratio":0.94999998807907104,"backfillfull_ratio":0.89999997615814209,"nearfull_ratio":0.85000002384185791,"cluster_snapshot":"","pool_max":4,"max_osd":3,"require_min_compat_client":"luminous","min_compat_client":"jewel","require_osd_release":"quincy","pools":[{"pool":1,"pool_name":".mgr","create_time":"2023-08-01T19:53:49.961944+0000","flags":1,"flags_names":"hashpspool","type":1,"size":2,"min_size":1,"crush_rule":0,"peering_crush_bucket_count":0,"peering_crush_bucket_target":0,"peering_crush_bucket_barrier":0,"peering_crush_bucket_mandatory_member":2147483647,"object_hash":2,"pg_autoscale_mode":"off","pg_num":1,"pg_placement_num":1,"pg_placement_num_target":1,"pg_num_target":1,"pg_num_pending":1,"last_pg_merge_meta":{"source_pgid":"0.0","ready_epoch":0,"last_epoch_started":0,"last_epoch_clean":0,"source_version":"0'0","target_version":"0'0"},"last_change":"11","last_force_op_resend":"0","last_force_op_resend_prenautilus":"0","last_force_op_resend_preluminous":"0","auid":0,"snap_mode":"selfmanaged","snap_seq":0,"snap_epoch":0,"pool_snaps":[],"removed_snaps":"[]","quota_max_bytes":0,"quota_max_objects":0,"tiers":[],"tier_of":-1,"read_tier":-1,"write_tier":-1,"cache_mode":"none","target_max_bytes":0,"target_max_objects":0,"cache_target_dirty_ratio_micro":400000,"cache_target_dirty_high_ratio_micro":600000,"cache_target_full_ratio_micro":800000,"cache_min_flush_age":0,"cache_min_evict_age":0,"erasure_code_profile":"","hit_set_params":{"type":"none"},"hit_set_period":0,"hit_set_count":0,"use_gmt_hitset":true,"min_read_recency_for_promote":0,"min_write_recency_for_promote":0,"hit_set_grade_decay_rate":0,"hit_set_search_last_n":0,"grade_table":[],"stripe_width":0,"expected_num_objects":0,"fast_read":false,"options":{"pg_num_max":32,"pg_num_min":1},"application_metadata":{"mgr":{}}},{"pool":2,"pool_name":"rbd","create_time":"2023-08-01T19:53:57.404091+0000","flags":1,"flags_names":"hashpspool","type":1,"size":2,"min_size":1,"crush_rule":0,"peering_crush_bucket_count":0,"peering_crush_bucket_target":0,"peering_crush_bucket_barrier":0,"peering_crush_bucket_mandatory_member":2147483647,"object_hash":2,"pg_autoscale_mode":"off","pg_num":8,"pg_placement_num":8,"pg_placement_num_target":8,"pg_num_target":8,"pg_num_pending":8,"last_pg_merge_meta":{"source_pgid":"0.0","ready_epoch":0,"last_epoch_started":0,"last_epoch_clean":0,"source_version":"0'0","target_version":"0'0"},"last_change":"14","last_force_op_resend":"0","last_force_op_resend_prenautilus":"0","last_force_op_resend_preluminous":"0","auid":0,"snap_mode":"selfmanaged","snap_seq":0,"snap_epoch":0,"pool_snaps":[],"removed_snaps":"[]","quota_max_bytes":0,"quota_max_objects":0,"tiers":[],"tier_of":-1,"read_tier":-1,"write_tier":-1,"cache_mode":"none","target_max_bytes":0,"target_max_objects":0,"cache_target_dirty_ratio_micro":400000,"cache_target_dirty_high_ratio_micro":600000,"cache_target_full_ratio_micro":800000,"cache_min_flush_age":0,"cache_min_evict_age":0,"erasure_code_profile":"","hit_set_params":{"type":"none"},"hit_set_period":0,"hit_set_count":0,"use_gmt_hitset":true,"min_read_recency_for_promote":0,"min_write_recency_for_promote":0,"hit_set_grade_decay_rate":0,"hit_set_search_last_n":0,"grade_table":[],"stripe_width":0,"expected_num_objects":0,"fast_read":false,"options":{},"application_metadata":{"rbd":{}}},{"pool":3,"pool_name":"cephfs_metadata","create_time":"2023-08-01T19:54:02.111247+0000","flags":1,"flags_names":"hashpspool","type":1,"size":2,"min_size":1,"crush_rule":0,"peering_crush_bucket_count":0,"peering_crush_bucket_target":0,"peering_crush_bucket_barrier":0,"peering_crush_bucket_mandatory_member":2147483647,"object_hash":2,"pg_autoscale_mode":"off","pg_num":32,"pg_placement_num":32,"pg_placement_num_target":32,"pg_num_target":32,"pg_num_pending":32,"last_pg_merge_meta":{"source_pgid":"0.0","ready_epoch":0,"last_epoch_started":0,"last_epoch_clean":0,"source_version":"0'0","target_version":"0'0"},"last_change":"17","last_force_op_resend":"0","last_force_op_resend_prenautilus":"0","last_force_op_resend_preluminous":"0","auid":0,"snap_mode":"selfmanaged","snap_seq":0,"snap_epoch":0,"pool_snaps":[],"removed_snaps":"[]","quota_max_bytes":0,"quota_max_objects":0,"tiers":[],"tier_of":-1,"read_tier":-1,"write_tier":-1,"cache_mode":"none","target_max_bytes":0,"target_max_objects":0,"cache_target_dirty_ratio_micro":400000,"cache_target_dirty_high_ratio_micro":600000,"cache_target_full_ratio_micro":800000,"cache_min_flush_age":0,"cache_min_evict_age":0,"erasure_code_profile":"","hit_set_params":{"type":"none"},"hit_set_period":0,"hit_set_count":0,"use_gmt_hitset":true,"min_read_recency_for_promote":0,"min_write_recency_for_promote":0,"hit_set_grade_decay_rate":0,"hit_set_search_last_n":0,"grade_table":[],"stripe_width":0,"expected_num_objects":0,"fast_read":false,"options":{"pg_autoscale_bias":4,"pg_num_min":16,"recovery_priority":5},"application_metadata":{"cephfs":{"metadata":"cephfs"}}},{"pool":4,"pool_name":"cephfs_data","create_time":"2023-08-01T19:54:03.430277+0000","flags":1,"flags_names":"hashpspool","type":1,"size":2,"min_size":1,"crush_rule":0,"peering_crush_bucket_count":0,"peering_crush_bucket_target":0,"peering_crush_bucket_barrier":0,"peering_crush_bucket_mandatory_member":2147483647,"object_hash":2,"pg_autoscale_mode":"off","pg_num":64,"pg_placement_num":64,"pg_placement_num_target":64,"pg_num_target":64,"pg_num_pending":64,"last_pg_merge_meta":{"source_pgid":"0.0","ready_epoch":0,"last_epoch_started":0,"last_epoch_clean":0,"source_version":"0'0","target_version":"0'0"},"last_change":"18","last_force_op_resend":"0","last_force_op_resend_prenautilus":"0","last_force_op_resend_preluminous":"0","auid":0,"snap_mode":"selfmanaged","snap_seq":0,"snap_epoch":0,"pool_snaps":[],"removed_snaps":"[]","quota_max_bytes":0,"quota_max_objects":0,"tiers":[],"tier_of":-1,"read_tier":-1,"write_tier":-1,"cache_mode":"none","target_max_bytes":0,"target_max_objects":0,"cache_target_dirty_ratio_micro":400000,"cache_target_dirty_high_ratio_micro":600000,"cache_target_full_ratio_micro":800000,"cache_min_flush_age":0,"cache_min_evict_age":0,"erasure_code_profile":"","hit_set_params":{"type":"none"},"hit_set_period":0,"hit_set_count":0,"use_gmt_hitset":true,"min_read_recency_for_promote":0,"min_write_recency_for_promote":0,"hit_set_grade_decay_rate":0,"hit_set_search_last_n":0,"grade_table":[],"stripe_width":0,"expected_num_objects":0,"fast_read":false,"options":{"pg_num_min":64,"target_size_ratio":0.89999997615814209},"application_metadata":{"cephfs":{"data":"cephfs"}}}],"osds":[{"osd":0,"uuid":"5dd675c7-2777-48f2-8009-ff0e0d4c7086","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":8,"up_thru":16,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.8:6800","nonce":111181},{"type":"v1","addr":"172.21.15.8:6801","nonce":111181}]},"cluster_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.8:6802","nonce":111181},{"type":"v1","addr":"172.21.15.8:6803","nonce":111181}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.8:6806","nonce":111181},{"type":"v1","addr":"172.21.15.8:6807","nonce":111181}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.8:6804","nonce":111181},{"type":"v1","addr":"172.21.15.8:6805","nonce":111181}]},"public_addr":"172.21.15.8:6801/111181","cluster_addr":"172.21.15.8:6803/111181","heartbeat_back_addr":"172.21.15.8:6807/111181","heartbeat_front_addr":"172.21.15.8:6805/111181","state":["exists","up"]},{"osd":1,"uuid":"7fc612c4-33ba-4a33-bca8-1f42ee8ed548","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":8,"up_thru":16,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.101:6800","nonce":111143},{"type":"v1","addr":"172.21.15.101:6801","nonce":111143}]},"cluster_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.101:6802","nonce":111143},{"type":"v1","addr":"172.21.15.101:6803","nonce":111143}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.101:6806","nonce":111143},{"type":"v1","addr":"172.21.15.101:6807","nonce":111143}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.101:6804","nonce":111143},{"type":"v1","addr":"172.21.15.101:6805","nonce":111143}]},"public_addr":"172.21.15.101:6801/111143","cluster_addr":"172.21.15.101:6803/111143","heartbeat_back_addr":"172.21.15.101:6807/111143","heartbeat_front_addr":"172.21.15.101:6805/111143","state":["exists","up"]},{"osd":2,"uuid":"f85cadbc-4230-4772-8f39-62ed52e220b1","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":9,"up_thru":16,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.155:6800","nonce":111339},{"type":"v1","addr":"172.21.15.155:6801","nonce":111339}]},"cluster_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.155:6802","nonce":111339},{"type":"v1","addr":"172.21.15.155:6803","nonce":111339}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.155:6806","nonce":111339},{"type":"v1","addr":"172.21.15.155:6807","nonce":111339}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.155:6804","nonce":111339},{"type":"v1","addr":"172.21.15.155:6805","nonce":111339}]},"public_addr":"172.21.15.155:6801/111339","cluster_addr":"172.21.15.155:6803/111339","heartbeat_back_addr":"172.21.15.155:6807/111339","heartbeat_front_addr":"172.21.15.155:6805/111339","state":["exists","up"]}],"osd_xinfo":[{"osd":0,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4540138320759226367,"old_weight":0,"last_purged_snaps_scrub":"2023-08-01T19:53:48.018154+0000","dead_epoch":0},{"osd":1,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4540138320759226367,"old_weight":0,"last_purged_snaps_scrub":"2023-08-01T19:53:48.000488+0000","dead_epoch":0},{"osd":2,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4540138320759226367,"old_weight":0,"last_purged_snaps_scrub":"2023-08-01T19:53:48.072529+0000","dead_epoch":0}],"pg_upmap":[],"pg_upmap_items":[],"pg_temp":[],"primary_temp":[],"blocklist":{},"range_blocklist":{},"erasure_code_profiles":{"default":{"crush-failure-domain":"osd","k":"2","m":"1","plugin":"jerasure","technique":"reed_sol_van"}},"removed_snaps_queue":[],"new_removed_snaps":[],"new_purged_snaps":[],"crush_node_flags":{},"device_class_flags":{},"stretch_mode":{"stretch_mode_enabled":false,"stretch_bucket_count":0,"degraded_stretch_mode":0,"recovering_stretch_mode":0,"stretch_mode_bucket":0}} 2023-08-01T19:54:08.219 INFO:tasks.cephfs.filesystem.ceph_manager:waiting for clean 2023-08-01T19:54:08.219 DEBUG:teuthology.orchestra.run.smithi006:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 120 ceph --cluster ceph pg dump --format=json 2023-08-01T19:54:08.552 INFO:teuthology.orchestra.run.smithi006.stdout: 2023-08-01T19:54:08.554 INFO:teuthology.orchestra.run.smithi006.stderr:dumped all 2023-08-01T19:54:08.565 INFO:teuthology.orchestra.run.smithi006.stdout:{"pg_ready":true,"pg_map":{"version":24,"stamp":"2023-08-01T19:54:07.908558+0000","last_osdmap_epoch":0,"last_pg_scan":0,"pg_stats_sum":{"stat_sum":{"num_bytes":592674,"num_objects":23,"num_object_clones":0,"num_object_copies":46,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":23,"num_whiteouts":0,"num_read":136,"num_read_kb":118,"num_write":247,"num_write_kb":3473,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":13,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"store_stats":{"total":0,"available":0,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},"log_size":195,"ondisk_log_size":195,"up":210,"acting":210,"num_store_stats":0},"osd_stats_sum":{"up_from":0,"seq":0,"num_pgs":137,"num_osds":3,"num_per_pool_osds":3,"num_per_pool_omap_osds":3,"kb":283115520,"kb_used":30880,"kb_used_data":584,"kb_used_omap":0,"kb_used_meta":30272,"kb_avail":283084640,"statfs":{"total":289910292480,"available":289878671360,"internally_reserved":0,"allocated":598016,"data_stored":1326870,"data_compressed":20662,"data_compressed_allocated":73728,"data_compressed_original":1146880,"omap_allocated":0,"internal_metadata":30998528},"hb_peers":[],"snap_trim_queue_len":0,"num_snap_trimming":0,"num_shards_repaired":0,"op_queue_age_hist":{"histogram":[],"upper_bound":1},"perf_stat":{"commit_latency_ms":7,"apply_latency_ms":7,"commit_latency_ns":7000000,"apply_latency_ns":7000000},"alerts":[],"network_ping_times":[]},"pg_stats_delta":{"stat_sum":{"num_bytes":2306,"num_objects":21,"num_object_clones":0,"num_object_copies":42,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":21,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":44,"num_write_kb":13,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":13,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"store_stats":{"total":0,"available":0,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},"log_size":0,"ondisk_log_size":0,"up":0,"acting":0,"num_store_stats":0,"stamp_delta":"4.867751"},"pg_stats":[{"pgid":"4.3f","version":"0'0","reported_seq":9,"reported_epoch":17,"state":"active+clean","last_fresh":"2023-08-01T19:54:04.477207+0000","last_change":"2023-08-01T19:54:04.473430+0000","last_active":"2023-08-01T19:54:04.477207+0000","last_peered":"2023-08-01T19:54:04.477207+0000","last_clean":"2023-08-01T19:54:04.477207+0000","last_became_active":"2023-08-01T19:54:04.472887+0000","last_became_peered":"2023-08-01T19:54:04.472887+0000","last_unstale":"2023-08-01T19:54:04.477207+0000","last_undegraded":"2023-08-01T19:54:04.477207+0000","last_fullsized":"2023-08-01T19:54:04.477207+0000","mapping_epoch":16,"log_start":"0'0","ondisk_log_start":"0'0","created":16,"last_epoch_clean":17,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-08-01T19:54:04.040663+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-08-01T19:54:04.040663+0000","last_clean_scrub_stamp":"2023-08-01T19:54:04.040663+0000","objects_scrubbed":0,"log_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-08-03T06:38:54.196605+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[2,0],"acting":[2,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":2,"acting_primary":2,"purged_snaps":[]},{"pgid":"4.3e","version":"0'0","reported_seq":9,"reported_epoch":17,"state":"active+clean","last_fresh":"2023-08-01T19:54:04.472547+0000","last_change":"2023-08-01T19:54:04.470501+0000","last_active":"2023-08-01T19:54:04.472547+0000","last_peered":"2023-08-01T19:54:04.472547+0000","last_clean":"2023-08-01T19:54:04.472547+0000","last_became_active":"2023-08-01T19:54:04.469692+0000","last_became_peered":"2023-08-01T19:54:04.469692+0000","last_unstale":"2023-08-01T19:54:04.472547+0000","last_undegraded":"2023-08-01T19:54:04.472547+0000","last_fullsized":"2023-08-01T19:54:04.472547+0000","mapping_epoch":16,"log_start":"0'0","ondisk_log_start":"0'0","created":16,"last_epoch_clean":17,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-08-01T19:54:04.040663+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-08-01T19:54:04.040663+0000","last_clean_scrub_stamp":"2023-08-01T19:54:04.040663+0000","objects_scrubbed":0,"log_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-08-03T02:19:35.201107+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[2,0],"acting":[2,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":2,"acting_primary":2,"purged_snaps":[]},{"pgid":"4.3d","version":"0'0","reported_seq":8,"reported_epoch":17,"state":"active+clean","last_fresh":"2023-08-01T19:54:04.472579+0000","last_change":"2023-08-01T19:54:04.472579+0000","last_active":"2023-08-01T19:54:04.472579+0000","last_peered":"2023-08-01T19:54:04.472579+0000","last_clean":"2023-08-01T19:54:04.472579+0000","last_became_active":"2023-08-01T19:54:04.471128+0000","last_became_peered":"2023-08-01T19:54:04.471128+0000","last_unstale":"2023-08-01T19:54:04.472579+0000","last_undegraded":"2023-08-01T19:54:04.472579+0000","last_fullsized":"2023-08-01T19:54:04.472579+0000","mapping_epoch":16,"log_start":"0'0","ondisk_log_start":"0'0","created":16,"last_epoch_clean":17,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-08-01T19:54:04.040663+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-08-01T19:54:04.040663+0000","last_clean_scrub_stamp":"2023-08-01T19:54:04.040663+0000","objects_scrubbed":0,"log_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-08-03T03:04:06.137335+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[1,2],"acting":[1,2],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":1,"acting_primary":1,"purged_snaps":[]},{"pgid":"4.3c","version":"0'0","reported_seq":8,"reported_epoch":17,"state":"active+clean","last_fresh":"2023-08-01T19:54:04.477908+0000","last_change":"2023-08-01T19:54:04.477908+0000","last_active":"2023-08-01T19:54:04.477908+0000","last_peered":"2023-08-01T19:54:04.477908+0000","last_clean":"2023-08-01T19:54:04.477908+0000","last_became_active":"2023-08-01T19:54:04.476684+0000","last_became_peered":"2023-08-01T19:54:04.476684+0000","last_unstale":"2023-08-01T19:54:04.477908+0000","last_undegraded":"2023-08-01T19:54:04.477908+0000","last_fullsized":"2023-08-01T19:54:04.477908+0000","mapping_epoch":16,"log_start":"0'0","ondisk_log_start":"0'0","created":16,"last_epoch_clean":17,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-08-01T19:54:04.040663+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-08-01T19:54:04.040663+0000","last_clean_scrub_stamp":"2023-08-01T19:54:04.040663+0000","objects_scrubbed":0,"log_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-08-03T03:56:55.336461+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[1,0],"acting":[1,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":1,"acting_primary":1,"purged_snaps":[]},{"pgid":"4.3b","version":"0'0","reported_seq":9,"reported_epoch":17,"state":"active+clean","last_fresh":"2023-08-01T19:54:04.469848+0000","last_change":"2023-08-01T19:54:04.467197+0000","last_active":"2023-08-01T19:54:04.469848+0000","last_peered":"2023-08-01T19:54:04.469848+0000","last_clean":"2023-08-01T19:54:04.469848+0000","last_became_active":"2023-08-01T19:54:04.466526+0000","last_became_peered":"2023-08-01T19:54:04.466526+0000","last_unstale":"2023-08-01T19:54:04.469848+0000","last_undegraded":"2023-08-01T19:54:04.469848+0000","last_fullsized":"2023-08-01T19:54:04.469848+0000","mapping_epoch":16,"log_start":"0'0","ondisk_log_start":"0'0","created":16,"last_epoch_clean":17,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-08-01T19:54:04.040663+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-08-01T19:54:04.040663+0000","last_clean_scrub_stamp":"2023-08-01T19:54:04.040663+0000","objects_scrubbed":0,"log_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-08-03T06:54:18.982174+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[2,0],"acting":[2,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":2,"acting_primary":2,"purged_snaps":[]},{"pgid":"4.3a","version":"0'0","reported_seq":8,"reported_epoch":17,"state":"active+clean","last_fresh":"2023-08-01T19:54:04.473296+0000","last_change":"2023-08-01T19:54:04.473296+0000","last_active":"2023-08-01T19:54:04.473296+0000","last_peered":"2023-08-01T19:54:04.473296+0000","last_clean":"2023-08-01T19:54:04.473296+0000","last_became_active":"2023-08-01T19:54:04.472324+0000","last_became_peered":"2023-08-01T19:54:04.472324+0000","last_unstale":"2023-08-01T19:54:04.473296+0000","last_undegraded":"2023-08-01T19:54:04.473296+0000","last_fullsized":"2023-08-01T19:54:04.473296+0000","mapping_epoch":16,"log_start":"0'0","ondisk_log_start":"0'0","created":16,"last_epoch_clean":17,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-08-01T19:54:04.040663+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-08-01T19:54:04.040663+0000","last_clean_scrub_stamp":"2023-08-01T19:54:04.040663+0000","objects_scrubbed":0,"log_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-08-02T23:15:11.148662+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[1,0],"acting":[1,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":1,"acting_primary":1,"purged_snaps":[]},{"pgid":"4.39","version":"0'0","reported_seq":8,"reported_epoch":17,"state":"active+clean","last_fresh":"2023-08-01T19:54:04.475322+0000","last_change":"2023-08-01T19:54:04.475322+0000","last_active":"2023-08-01T19:54:04.475322+0000","last_peered":"2023-08-01T19:54:04.475322+0000","last_clean":"2023-08-01T19:54:04.475322+0000","last_became_active":"2023-08-01T19:54:04.474591+0000","last_became_peered":"2023-08-01T19:54:04.474591+0000","last_unstale":"2023-08-01T19:54:04.475322+0000","last_undegraded":"2023-08-01T19:54:04.475322+0000","last_fullsized":"2023-08-01T19:54:04.475322+0000","mapping_epoch":16,"log_start":"0'0","ondisk_log_start":"0'0","created":16,"last_epoch_clean":17,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-08-01T19:54:04.040663+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-08-01T19:54:04.040663+0000","last_clean_scrub_stamp":"2023-08-01T19:54:04.040663+0000","objects_scrubbed":0,"log_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-08-03T00:29:53.554989+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[1,0],"acting":[1,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":1,"acting_primary":1,"purged_snaps":[]},{"pgid":"4.38","version":"0'0","reported_seq":8,"reported_epoch":17,"state":"active+clean","last_fresh":"2023-08-01T19:54:04.478505+0000","last_change":"2023-08-01T19:54:04.478505+0000","last_active":"2023-08-01T19:54:04.478505+0000","last_peered":"2023-08-01T19:54:04.478505+0000","last_clean":"2023-08-01T19:54:04.478505+0000","last_became_active":"2023-08-01T19:54:04.477325+0000","last_became_peered":"2023-08-01T19:54:04.477325+0000","last_unstale":"2023-08-01T19:54:04.478505+0000","last_undegraded":"2023-08-01T19:54:04.478505+0000","last_fullsized":"2023-08-01T19:54:04.478505+0000","mapping_epoch":16,"log_start":"0'0","ondisk_log_start":"0'0","created":16,"last_epoch_clean":17,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-08-01T19:54:04.040663+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-08-01T19:54:04.040663+0000","last_clean_scrub_stamp":"2023-08-01T19:54:04.040663+0000","objects_scrubbed":0,"log_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-08-03T01:38:12.939736+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[1,0],"acting":[1,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":1,"acting_primary":1,"purged_snaps":[]},{"pgid":"4.37","version":"0'0","reported_seq":8,"reported_epoch":17,"state":"active+clean","last_fresh":"2023-08-01T19:54:04.470971+0000","last_change":"2023-08-01T19:54:04.470971+0000","last_active":"2023-08-01T19:54:04.470971+0000","last_peered":"2023-08-01T19:54:04.470971+0000","last_clean":"2023-08-01T19:54:04.470971+0000","last_became_active":"2023-08-01T19:54:04.469011+0000","last_became_peered":"2023-08-01T19:54:04.469011+0000","last_unstale":"2023-08-01T19:54:04.470971+0000","last_undegraded":"2023-08-01T19:54:04.470971+0000","last_fullsized":"2023-08-01T19:54:04.470971+0000","mapping_epoch":16,"log_start":"0'0","ondisk_log_start":"0'0","created":16,"last_epoch_clean":17,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-08-01T19:54:04.040663+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-08-01T19:54:04.040663+0000","last_clean_scrub_stamp":"2023-08-01T19:54:04.040663+0000","objects_scrubbed":0,"log_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-08-03T06:50:03.420334+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[0,2],"acting":[0,2],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":0,"acting_primary":0,"purged_snaps":[]},{"pgid":"4.36","version":"0'0","reported_seq":9,"reported_epoch":17,"state":"active+clean","last_fresh":"2023-08-01T19:54:04.477220+0000","last_change":"2023-08-01T19:54:04.473523+0000","last_active":"2023-08-01T19:54:04.477220+0000","last_peered":"2023-08-01T19:54:04.477220+0000","last_clean":"2023-08-01T19:54:04.477220+0000","last_became_active":"2023-08-01T19:54:04.473084+0000","last_became_peered":"2023-08-01T19:54:04.473084+0000","last_unstale":"2023-08-01T19:54:04.477220+0000","last_undegraded":"2023-08-01T19:54:04.477220+0000","last_fullsized":"2023-08-01T19:54:04.477220+0000","mapping_epoch":16,"log_start":"0'0","ondisk_log_start":"0'0","created":16,"last_epoch_clean":17,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-08-01T19:54:04.040663+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-08-01T19:54:04.040663+0000","last_clean_scrub_stamp":"2023-08-01T19:54:04.040663+0000","objects_scrubbed":0,"log_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-08-03T04:28:59.042443+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[2,0],"acting":[2,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":2,"acting_primary":2,"purged_snaps":[]},{"pgid":"4.35","version":"0'0","reported_seq":8,"reported_epoch":17,"state":"active+clean","last_fresh":"2023-08-01T19:54:04.475816+0000","last_change":"2023-08-01T19:54:04.475816+0000","last_active":"2023-08-01T19:54:04.475816+0000","last_peered":"2023-08-01T19:54:04.475816+0000","last_clean":"2023-08-01T19:54:04.475816+0000","last_became_active":"2023-08-01T19:54:04.475061+0000","last_became_peered":"2023-08-01T19:54:04.475061+0000","last_unstale":"2023-08-01T19:54:04.475816+0000","last_undegraded":"2023-08-01T19:54:04.475816+0000","last_fullsized":"2023-08-01T19:54:04.475816+0000","mapping_epoch":16,"log_start":"0'0","ondisk_log_start":"0'0","created":16,"last_epoch_clean":17,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-08-01T19:54:04.040663+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-08-01T19:54:04.040663+0000","last_clean_scrub_stamp":"2023-08-01T19:54:04.040663+0000","objects_scrubbed":0,"log_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-08-02T22:07:41.305488+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[1,0],"acting":[1,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":1,"acting_primary":1,"purged_snaps":[]},{"pgid":"4.34","version":"0'0","reported_seq":9,"reported_epoch":17,"state":"active+clean","last_fresh":"2023-08-01T19:54:04.470323+0000","last_change":"2023-08-01T19:54:04.468009+0000","last_active":"2023-08-01T19:54:04.470323+0000","last_peered":"2023-08-01T19:54:04.470323+0000","last_clean":"2023-08-01T19:54:04.470323+0000","last_became_active":"2023-08-01T19:54:04.467568+0000","last_became_peered":"2023-08-01T19:54:04.467568+0000","last_unstale":"2023-08-01T19:54:04.470323+0000","last_undegraded":"2023-08-01T19:54:04.470323+0000","last_fullsized":"2023-08-01T19:54:04.470323+0000","mapping_epoch":16,"log_start":"0'0","ondisk_log_start":"0'0","created":16,"last_epoch_clean":17,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-08-01T19:54:04.040663+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-08-01T19:54:04.040663+0000","last_clean_scrub_stamp":"2023-08-01T19:54:04.040663+0000","objects_scrubbed":0,"log_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-08-03T04:53:44.017572+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[2,1],"acting":[2,1],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":2,"acting_primary":2,"purged_snaps":[]},{"pgid":"4.33","version":"0'0","reported_seq":9,"reported_epoch":17,"state":"active+clean","last_fresh":"2023-08-01T19:54:04.468611+0000","last_change":"2023-08-01T19:54:04.466770+0000","last_active":"2023-08-01T19:54:04.468611+0000","last_peered":"2023-08-01T19:54:04.468611+0000","last_clean":"2023-08-01T19:54:04.468611+0000","last_became_active":"2023-08-01T19:54:04.466460+0000","last_became_peered":"2023-08-01T19:54:04.466460+0000","last_unstale":"2023-08-01T19:54:04.468611+0000","last_undegraded":"2023-08-01T19:54:04.468611+0000","last_fullsized":"2023-08-01T19:54:04.468611+0000","mapping_epoch":16,"log_start":"0'0","ondisk_log_start":"0'0","created":16,"last_epoch_clean":17,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-08-01T19:54:04.040663+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-08-01T19:54:04.040663+0000","last_clean_scrub_stamp":"2023-08-01T19:54:04.040663+0000","objects_scrubbed":0,"log_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-08-03T06:04:11.595951+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[2,0],"acting":[2,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":2,"acting_primary":2,"purged_snaps":[]},{"pgid":"4.32","version":"0'0","reported_seq":8,"reported_epoch":17,"state":"active+clean","last_fresh":"2023-08-01T19:54:04.466634+0000","last_change":"2023-08-01T19:54:04.466634+0000","last_active":"2023-08-01T19:54:04.466634+0000","last_peered":"2023-08-01T19:54:04.466634+0000","last_clean":"2023-08-01T19:54:04.466634+0000","last_became_active":"2023-08-01T19:54:04.466302+0000","last_became_peered":"2023-08-01T19:54:04.466302+0000","last_unstale":"2023-08-01T19:54:04.466634+0000","last_undegraded":"2023-08-01T19:54:04.466634+0000","last_fullsized":"2023-08-01T19:54:04.466634+0000","mapping_epoch":16,"log_start":"0'0","ondisk_log_start":"0'0","created":16,"last_epoch_clean":17,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-08-01T19:54:04.040663+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-08-01T19:54:04.040663+0000","last_clean_scrub_stamp":"2023-08-01T19:54:04.040663+0000","objects_scrubbed":0,"log_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-08-03T05:46:11.085577+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[1,2],"acting":[1,2],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":1,"acting_primary":1,"purged_snaps":[]},{"pgid":"4.31","version":"0'0","reported_seq":8,"reported_epoch":17,"state":"active+clean","last_fresh":"2023-08-01T19:54:04.472407+0000","last_change":"2023-08-01T19:54:04.472407+0000","last_active":"2023-08-01T19:54:04.472407+0000","last_peered":"2023-08-01T19:54:04.472407+0000","last_clean":"2023-08-01T19:54:04.472407+0000","last_became_active":"2023-08-01T19:54:04.472008+0000","last_became_peered":"2023-08-01T19:54:04.472008+0000","last_unstale":"2023-08-01T19:54:04.472407+0000","last_undegraded":"2023-08-01T19:54:04.472407+0000","last_fullsized":"2023-08-01T19:54:04.472407+0000","mapping_epoch":16,"log_start":"0'0","ondisk_log_start":"0'0","created":16,"last_epoch_clean":17,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-08-01T19:54:04.040663+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-08-01T19:54:04.040663+0000","last_clean_scrub_stamp":"2023-08-01T19:54:04.040663+0000","objects_scrubbed":0,"log_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-08-02T22:42:25.293502+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[1,2],"acting":[1,2],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":1,"acting_primary":1,"purged_snaps":[]},{"pgid":"4.30","version":"0'0","reported_seq":8,"reported_epoch":17,"state":"active+clean","last_fresh":"2023-08-01T19:54:04.478283+0000","last_change":"2023-08-01T19:54:04.478283+0000","last_active":"2023-08-01T19:54:04.478283+0000","last_peered":"2023-08-01T19:54:04.478283+0000","last_clean":"2023-08-01T19:54:04.478283+0000","last_became_active":"2023-08-01T19:54:04.476620+0000","last_became_peered":"2023-08-01T19:54:04.476620+0000","last_unstale":"2023-08-01T19:54:04.478283+0000","last_undegraded":"2023-08-01T19:54:04.478283+0000","last_fullsized":"2023-08-01T19:54:04.478283+0000","mapping_epoch":16,"log_start":"0'0","ondisk_log_start":"0'0","created":16,"last_epoch_clean":17,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-08-01T19:54:04.040663+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-08-01T19:54:04.040663+0000","last_clean_scrub_stamp":"2023-08-01T19:54:04.040663+0000","objects_scrubbed":0,"log_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-08-03T02:27:17.063518+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[1,0],"acting":[1,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":1,"acting_primary":1,"purged_snaps":[]},{"pgid":"4.2f","version":"0'0","reported_seq":8,"reported_epoch":17,"state":"active+clean","last_fresh":"2023-08-01T19:54:04.470302+0000","last_change":"2023-08-01T19:54:04.470302+0000","last_active":"2023-08-01T19:54:04.470302+0000","last_peered":"2023-08-01T19:54:04.470302+0000","last_clean":"2023-08-01T19:54:04.470302+0000","last_became_active":"2023-08-01T19:54:04.468919+0000","last_became_peered":"2023-08-01T19:54:04.468919+0000","last_unstale":"2023-08-01T19:54:04.470302+0000","last_undegraded":"2023-08-01T19:54:04.470302+0000","last_fullsized":"2023-08-01T19:54:04.470302+0000","mapping_epoch":16,"log_start":"0'0","ondisk_log_start":"0'0","created":16,"last_epoch_clean":17,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-08-01T19:54:04.040663+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-08-01T19:54:04.040663+0000","last_clean_scrub_stamp":"2023-08-01T19:54:04.040663+0000","objects_scrubbed":0,"log_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-08-02T22:42:25.293502+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[0,2],"acting":[0,2],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":0,"acting_primary":0,"purged_snaps":[]},{"pgid":"4.2e","version":"0'0","reported_seq":9,"reported_epoch":17,"state":"active+clean","last_fresh":"2023-08-01T19:54:04.477303+0000","last_change":"2023-08-01T19:54:04.474058+0000","last_active":"2023-08-01T19:54:04.477303+0000","last_peered":"2023-08-01T19:54:04.477303+0000","last_clean":"2023-08-01T19:54:04.477303+0000","last_became_active":"2023-08-01T19:54:04.473355+0000","last_became_peered":"2023-08-01T19:54:04.473355+0000","last_unstale":"2023-08-01T19:54:04.477303+0000","last_undegraded":"2023-08-01T19:54:04.477303+0000","last_fullsized":"2023-08-01T19:54:04.477303+0000","mapping_epoch":16,"log_start":"0'0","ondisk_log_start":"0'0","created":16,"last_epoch_clean":17,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-08-01T19:54:04.040663+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-08-01T19:54:04.040663+0000","last_clean_scrub_stamp":"2023-08-01T19:54:04.040663+0000","objects_scrubbed":0,"log_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-08-03T04:55:54.197252+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[2,0],"acting":[2,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":2,"acting_primary":2,"purged_snaps":[]},{"pgid":"4.2d","version":"0'0","reported_seq":8,"reported_epoch":17,"state":"active+clean","last_fresh":"2023-08-01T19:54:04.468775+0000","last_change":"2023-08-01T19:54:04.468775+0000","last_active":"2023-08-01T19:54:04.468775+0000","last_peered":"2023-08-01T19:54:04.468775+0000","last_clean":"2023-08-01T19:54:04.468775+0000","last_became_active":"2023-08-01T19:54:04.467274+0000","last_became_peered":"2023-08-01T19:54:04.467274+0000","last_unstale":"2023-08-01T19:54:04.468775+0000","last_undegraded":"2023-08-01T19:54:04.468775+0000","last_fullsized":"2023-08-01T19:54:04.468775+0000","mapping_epoch":16,"log_start":"0'0","ondisk_log_start":"0'0","created":16,"last_epoch_clean":17,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-08-01T19:54:04.040663+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-08-01T19:54:04.040663+0000","last_clean_scrub_stamp":"2023-08-01T19:54:04.040663+0000","objects_scrubbed":0,"log_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-08-02T23:00:37.537286+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[0,2],"acting":[0,2],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":0,"acting_primary":0,"purged_snaps":[]},{"pgid":"4.2c","version":"0'0","reported_seq":8,"reported_epoch":17,"state":"active+clean","last_fresh":"2023-08-01T19:54:04.478409+0000","last_change":"2023-08-01T19:54:04.478409+0000","last_active":"2023-08-01T19:54:04.478409+0000","last_peered":"2023-08-01T19:54:04.478409+0000","last_clean":"2023-08-01T19:54:04.478409+0000","last_became_active":"2023-08-01T19:54:04.477133+0000","last_became_peered":"2023-08-01T19:54:04.477133+0000","last_unstale":"2023-08-01T19:54:04.478409+0000","last_undegraded":"2023-08-01T19:54:04.478409+0000","last_fullsized":"2023-08-01T19:54:04.478409+0000","mapping_epoch":16,"log_start":"0'0","ondisk_log_start":"0'0","created":16,"last_epoch_clean":17,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-08-01T19:54:04.040663+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-08-01T19:54:04.040663+0000","last_clean_scrub_stamp":"2023-08-01T19:54:04.040663+0000","objects_scrubbed":0,"log_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-08-02T22:15:19.744281+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[1,0],"acting":[1,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":1,"acting_primary":1,"purged_snaps":[]},{"pgid":"4.2b","version":"0'0","reported_seq":8,"reported_epoch":17,"state":"active+clean","last_fresh":"2023-08-01T19:54:04.474047+0000","last_change":"2023-08-01T19:54:04.474047+0000","last_active":"2023-08-01T19:54:04.474047+0000","last_peered":"2023-08-01T19:54:04.474047+0000","last_clean":"2023-08-01T19:54:04.474047+0000","last_became_active":"2023-08-01T19:54:04.473578+0000","last_became_peered":"2023-08-01T19:54:04.473578+0000","last_unstale":"2023-08-01T19:54:04.474047+0000","last_undegraded":"2023-08-01T19:54:04.474047+0000","last_fullsized":"2023-08-01T19:54:04.474047+0000","mapping_epoch":16,"log_start":"0'0","ondisk_log_start":"0'0","created":16,"last_epoch_clean":17,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-08-01T19:54:04.040663+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-08-01T19:54:04.040663+0000","last_clean_scrub_stamp":"2023-08-01T19:54:04.040663+0000","objects_scrubbed":0,"log_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-08-03T05:39:29.199142+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[1,0],"acting":[1,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":1,"acting_primary":1,"purged_snaps":[]},{"pgid":"4.2a","version":"0'0","reported_seq":9,"reported_epoch":17,"state":"active+clean","last_fresh":"2023-08-01T19:54:04.470833+0000","last_change":"2023-08-01T19:54:04.469281+0000","last_active":"2023-08-01T19:54:04.470833+0000","last_peered":"2023-08-01T19:54:04.470833+0000","last_clean":"2023-08-01T19:54:04.470833+0000","last_became_active":"2023-08-01T19:54:04.468771+0000","last_became_peered":"2023-08-01T19:54:04.468771+0000","last_unstale":"2023-08-01T19:54:04.470833+0000","last_undegraded":"2023-08-01T19:54:04.470833+0000","last_fullsized":"2023-08-01T19:54:04.470833+0000","mapping_epoch":16,"log_start":"0'0","ondisk_log_start":"0'0","created":16,"last_epoch_clean":17,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-08-01T19:54:04.040663+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-08-01T19:54:04.040663+0000","last_clean_scrub_stamp":"2023-08-01T19:54:04.040663+0000","objects_scrubbed":0,"log_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-08-03T01:15:27.748810+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[2,1],"acting":[2,1],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":2,"acting_primary":2,"purged_snaps":[]},{"pgid":"4.29","version":"0'0","reported_seq":8,"reported_epoch":17,"state":"active+clean","last_fresh":"2023-08-01T19:54:04.466694+0000","last_change":"2023-08-01T19:54:04.466694+0000","last_active":"2023-08-01T19:54:04.466694+0000","last_peered":"2023-08-01T19:54:04.466694+0000","last_clean":"2023-08-01T19:54:04.466694+0000","last_became_active":"2023-08-01T19:54:04.466250+0000","last_became_peered":"2023-08-01T19:54:04.466250+0000","last_unstale":"2023-08-01T19:54:04.466694+0000","last_undegraded":"2023-08-01T19:54:04.466694+0000","last_fullsized":"2023-08-01T19:54:04.466694+0000","mapping_epoch":16,"log_start":"0'0","ondisk_log_start":"0'0","created":16,"last_epoch_clean":17,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-08-01T19:54:04.040663+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-08-01T19:54:04.040663+0000","last_clean_scrub_stamp":"2023-08-01T19:54:04.040663+0000","objects_scrubbed":0,"log_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-08-03T01:00:18.725898+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[0,1],"acting":[0,1],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":0,"acting_primary":0,"purged_snaps":[]},{"pgid":"4.28","version":"0'0","reported_seq":9,"reported_epoch":17,"state":"active+clean","last_fresh":"2023-08-01T19:54:04.470337+0000","last_change":"2023-08-01T19:54:04.468160+0000","last_active":"2023-08-01T19:54:04.470337+0000","last_peered":"2023-08-01T19:54:04.470337+0000","last_clean":"2023-08-01T19:54:04.470337+0000","last_became_active":"2023-08-01T19:54:04.467625+0000","last_became_peered":"2023-08-01T19:54:04.467625+0000","last_unstale":"2023-08-01T19:54:04.470337+0000","last_undegraded":"2023-08-01T19:54:04.470337+0000","last_fullsized":"2023-08-01T19:54:04.470337+0000","mapping_epoch":16,"log_start":"0'0","ondisk_log_start":"0'0","created":16,"last_epoch_clean":17,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-08-01T19:54:04.040663+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-08-01T19:54:04.040663+0000","last_clean_scrub_stamp":"2023-08-01T19:54:04.040663+0000","objects_scrubbed":0,"log_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-08-02T21:27:52.506153+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[2,0],"acting":[2,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":2,"acting_primary":2,"purged_snaps":[]},{"pgid":"4.27","version":"0'0","reported_seq":9,"reported_epoch":17,"state":"active+clean","last_fresh":"2023-08-01T19:54:04.470777+0000","last_change":"2023-08-01T19:54:04.469187+0000","last_active":"2023-08-01T19:54:04.470777+0000","last_peered":"2023-08-01T19:54:04.470777+0000","last_clean":"2023-08-01T19:54:04.470777+0000","last_became_active":"2023-08-01T19:54:04.468628+0000","last_became_peered":"2023-08-01T19:54:04.468628+0000","last_unstale":"2023-08-01T19:54:04.470777+0000","last_undegraded":"2023-08-01T19:54:04.470777+0000","last_fullsized":"2023-08-01T19:54:04.470777+0000","mapping_epoch":16,"log_start":"0'0","ondisk_log_start":"0'0","created":16,"last_epoch_clean":17,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-08-01T19:54:04.040663+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-08-01T19:54:04.040663+0000","last_clean_scrub_stamp":"2023-08-01T19:54:04.040663+0000","objects_scrubbed":0,"log_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-08-03T00:07:29.565677+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[2,1],"acting":[2,1],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":2,"acting_primary":2,"purged_snaps":[]},{"pgid":"4.26","version":"0'0","reported_seq":8,"reported_epoch":17,"state":"active+clean","last_fresh":"2023-08-01T19:54:04.470942+0000","last_change":"2023-08-01T19:54:04.470942+0000","last_active":"2023-08-01T19:54:04.470942+0000","last_peered":"2023-08-01T19:54:04.470942+0000","last_clean":"2023-08-01T19:54:04.470942+0000","last_became_active":"2023-08-01T19:54:04.470564+0000","last_became_peered":"2023-08-01T19:54:04.470564+0000","last_unstale":"2023-08-01T19:54:04.470942+0000","last_undegraded":"2023-08-01T19:54:04.470942+0000","last_fullsized":"2023-08-01T19:54:04.470942+0000","mapping_epoch":16,"log_start":"0'0","ondisk_log_start":"0'0","created":16,"last_epoch_clean":17,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-08-01T19:54:04.040663+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-08-01T19:54:04.040663+0000","last_clean_scrub_stamp":"2023-08-01T19:54:04.040663+0000","objects_scrubbed":0,"log_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-08-03T04:43:21.408174+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[0,1],"acting":[0,1],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":0,"acting_primary":0,"purged_snaps":[]},{"pgid":"4.25","version":"0'0","reported_seq":8,"reported_epoch":17,"state":"active+clean","last_fresh":"2023-08-01T19:54:04.474813+0000","last_change":"2023-08-01T19:54:04.474813+0000","last_active":"2023-08-01T19:54:04.474813+0000","last_peered":"2023-08-01T19:54:04.474813+0000","last_clean":"2023-08-01T19:54:04.474813+0000","last_became_active":"2023-08-01T19:54:04.472530+0000","last_became_peered":"2023-08-01T19:54:04.472530+0000","last_unstale":"2023-08-01T19:54:04.474813+0000","last_undegraded":"2023-08-01T19:54:04.474813+0000","last_fullsized":"2023-08-01T19:54:04.474813+0000","mapping_epoch":16,"log_start":"0'0","ondisk_log_start":"0'0","created":16,"last_epoch_clean":17,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-08-01T19:54:04.040663+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-08-01T19:54:04.040663+0000","last_clean_scrub_stamp":"2023-08-01T19:54:04.040663+0000","objects_scrubbed":0,"log_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-08-03T01:00:18.725898+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[1,2],"acting":[1,2],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":1,"acting_primary":1,"purged_snaps":[]},{"pgid":"3.1a","version":"17'1","reported_seq":11,"reported_epoch":17,"state":"active+clean","last_fresh":"2023-08-01T19:54:04.473081+0000","last_change":"2023-08-01T19:54:04.063936+0000","last_active":"2023-08-01T19:54:04.473081+0000","last_peered":"2023-08-01T19:54:04.473081+0000","last_clean":"2023-08-01T19:54:04.473081+0000","last_became_active":"2023-08-01T19:54:04.063674+0000","last_became_peered":"2023-08-01T19:54:04.063674+0000","last_unstale":"2023-08-01T19:54:04.473081+0000","last_undegraded":"2023-08-01T19:54:04.473081+0000","last_fullsized":"2023-08-01T19:54:04.473081+0000","mapping_epoch":15,"log_start":"0'0","ondisk_log_start":"0'0","created":15,"last_epoch_clean":16,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-08-01T19:54:03.032665+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-08-01T19:54:03.032665+0000","last_clean_scrub_stamp":"2023-08-01T19:54:03.032665+0000","objects_scrubbed":0,"log_size":1,"ondisk_log_size":1,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-08-03T00:06:00.058200+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[2,0],"acting":[2,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":2,"acting_primary":2,"purged_snaps":[]},{"pgid":"4.1d","version":"0'0","reported_seq":9,"reported_epoch":17,"state":"active+clean","last_fresh":"2023-08-01T19:54:04.474051+0000","last_change":"2023-08-01T19:54:04.471916+0000","last_active":"2023-08-01T19:54:04.474051+0000","last_peered":"2023-08-01T19:54:04.474051+0000","last_clean":"2023-08-01T19:54:04.474051+0000","last_became_active":"2023-08-01T19:54:04.471480+0000","last_became_peered":"2023-08-01T19:54:04.471480+0000","last_unstale":"2023-08-01T19:54:04.474051+0000","last_undegraded":"2023-08-01T19:54:04.474051+0000","last_fullsized":"2023-08-01T19:54:04.474051+0000","mapping_epoch":16,"log_start":"0'0","ondisk_log_start":"0'0","created":16,"last_epoch_clean":17,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-08-01T19:54:04.040663+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-08-01T19:54:04.040663+0000","last_clean_scrub_stamp":"2023-08-01T19:54:04.040663+0000","objects_scrubbed":0,"log_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-08-02T21:19:17.547590+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[2,1],"acting":[2,1],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":2,"acting_primary":2,"purged_snaps":[]},{"pgid":"3.19","version":"0'0","reported_seq":9,"reported_epoch":16,"state":"active+clean","last_fresh":"2023-08-01T19:54:04.068905+0000","last_change":"2023-08-01T19:54:04.067837+0000","last_active":"2023-08-01T19:54:04.068905+0000","last_peered":"2023-08-01T19:54:04.068905+0000","last_clean":"2023-08-01T19:54:04.068905+0000","last_became_active":"2023-08-01T19:54:04.067535+0000","last_became_peered":"2023-08-01T19:54:04.067535+0000","last_unstale":"2023-08-01T19:54:04.068905+0000","last_undegraded":"2023-08-01T19:54:04.068905+0000","last_fullsized":"2023-08-01T19:54:04.068905+0000","mapping_epoch":15,"log_start":"0'0","ondisk_log_start":"0'0","created":15,"last_epoch_clean":16,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-08-01T19:54:03.032665+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-08-01T19:54:03.032665+0000","last_clean_scrub_stamp":"2023-08-01T19:54:03.032665+0000","objects_scrubbed":0,"log_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-08-02T20:56:47.324761+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[0,1],"acting":[0,1],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":0,"acting_primary":0,"purged_snaps":[]},{"pgid":"4.1e","version":"0'0","reported_seq":8,"reported_epoch":17,"state":"active+clean","last_fresh":"2023-08-01T19:54:04.470544+0000","last_change":"2023-08-01T19:54:04.470544+0000","last_active":"2023-08-01T19:54:04.470544+0000","last_peered":"2023-08-01T19:54:04.470544+0000","last_clean":"2023-08-01T19:54:04.470544+0000","last_became_active":"2023-08-01T19:54:04.469657+0000","last_became_peered":"2023-08-01T19:54:04.469657+0000","last_unstale":"2023-08-01T19:54:04.470544+0000","last_undegraded":"2023-08-01T19:54:04.470544+0000","last_fullsized":"2023-08-01T19:54:04.470544+0000","mapping_epoch":16,"log_start":"0'0","ondisk_log_start":"0'0","created":16,"last_epoch_clean":17,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-08-01T19:54:04.040663+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-08-01T19:54:04.040663+0000","last_clean_scrub_stamp":"2023-08-01T19:54:04.040663+0000","objects_scrubbed":0,"log_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-08-02T23:12:30.830199+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[0,1],"acting":[0,1],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":0,"acting_primary":0,"purged_snaps":[]},{"pgid":"3.18","version":"0'0","reported_seq":9,"reported_epoch":16,"state":"active+clean","last_fresh":"2023-08-01T19:54:04.065295+0000","last_change":"2023-08-01T19:54:04.064289+0000","last_active":"2023-08-01T19:54:04.065295+0000","last_peered":"2023-08-01T19:54:04.065295+0000","last_clean":"2023-08-01T19:54:04.065295+0000","last_became_active":"2023-08-01T19:54:04.063971+0000","last_became_peered":"2023-08-01T19:54:04.063971+0000","last_unstale":"2023-08-01T19:54:04.065295+0000","last_undegraded":"2023-08-01T19:54:04.065295+0000","last_fullsized":"2023-08-01T19:54:04.065295+0000","mapping_epoch":15,"log_start":"0'0","ondisk_log_start":"0'0","created":15,"last_epoch_clean":16,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-08-01T19:54:03.032665+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-08-01T19:54:03.032665+0000","last_clean_scrub_stamp":"2023-08-01T19:54:03.032665+0000","objects_scrubbed":0,"log_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-08-03T04:09:30.496098+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[0,2],"acting":[0,2],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":0,"acting_primary":0,"purged_snaps":[]},{"pgid":"4.1f","version":"0'0","reported_seq":9,"reported_epoch":17,"state":"active+clean","last_fresh":"2023-08-01T19:54:04.474406+0000","last_change":"2023-08-01T19:54:04.472227+0000","last_active":"2023-08-01T19:54:04.474406+0000","last_peered":"2023-08-01T19:54:04.474406+0000","last_clean":"2023-08-01T19:54:04.474406+0000","last_became_active":"2023-08-01T19:54:04.471767+0000","last_became_peered":"2023-08-01T19:54:04.471767+0000","last_unstale":"2023-08-01T19:54:04.474406+0000","last_undegraded":"2023-08-01T19:54:04.474406+0000","last_fullsized":"2023-08-01T19:54:04.474406+0000","mapping_epoch":16,"log_start":"0'0","ondisk_log_start":"0'0","created":16,"last_epoch_clean":17,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-08-01T19:54:04.040663+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-08-01T19:54:04.040663+0000","last_clean_scrub_stamp":"2023-08-01T19:54:04.040663+0000","objects_scrubbed":0,"log_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-08-02T20:25:25.280329+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[2,1],"acting":[2,1],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":2,"acting_primary":2,"purged_snaps":[]},{"pgid":"3.17","version":"0'0","reported_seq":9,"reported_epoch":16,"state":"active+clean","last_fresh":"2023-08-01T19:54:04.068922+0000","last_change":"2023-08-01T19:54:04.067975+0000","last_active":"2023-08-01T19:54:04.068922+0000","last_peered":"2023-08-01T19:54:04.068922+0000","last_clean":"2023-08-01T19:54:04.068922+0000","last_became_active":"2023-08-01T19:54:04.067577+0000","last_became_peered":"2023-08-01T19:54:04.067577+0000","last_unstale":"2023-08-01T19:54:04.068922+0000","last_undegraded":"2023-08-01T19:54:04.068922+0000","last_fullsized":"2023-08-01T19:54:04.068922+0000","mapping_epoch":15,"log_start":"0'0","ondisk_log_start":"0'0","created":15,"last_epoch_clean":16,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-08-01T19:54:03.032665+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-08-01T19:54:03.032665+0000","last_clean_scrub_stamp":"2023-08-01T19:54:03.032665+0000","objects_scrubbed":0,"log_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-08-03T07:13:34.025722+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[0,1],"acting":[0,1],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":0,"acting_primary":0,"purged_snaps":[]},{"pgid":"4.10","version":"0'0","reported_seq":8,"reported_epoch":17,"state":"active+clean","last_fresh":"2023-08-01T19:54:04.467146+0000","last_change":"2023-08-01T19:54:04.467146+0000","last_active":"2023-08-01T19:54:04.467146+0000","last_peered":"2023-08-01T19:54:04.467146+0000","last_clean":"2023-08-01T19:54:04.467146+0000","last_became_active":"2023-08-01T19:54:04.466627+0000","last_became_peered":"2023-08-01T19:54:04.466627+0000","last_unstale":"2023-08-01T19:54:04.467146+0000","last_undegraded":"2023-08-01T19:54:04.467146+0000","last_fullsized":"2023-08-01T19:54:04.467146+0000","mapping_epoch":16,"log_start":"0'0","ondisk_log_start":"0'0","created":16,"last_epoch_clean":17,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-08-01T19:54:04.040663+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-08-01T19:54:04.040663+0000","last_clean_scrub_stamp":"2023-08-01T19:54:04.040663+0000","objects_scrubbed":0,"log_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-08-03T04:43:26.793480+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[0,2],"acting":[0,2],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":0,"acting_primary":0,"purged_snaps":[]},{"pgid":"3.16","version":"0'0","reported_seq":9,"reported_epoch":16,"state":"active+clean","last_fresh":"2023-08-01T19:54:04.066517+0000","last_change":"2023-08-01T19:54:04.065042+0000","last_active":"2023-08-01T19:54:04.066517+0000","last_peered":"2023-08-01T19:54:04.066517+0000","last_clean":"2023-08-01T19:54:04.066517+0000","last_became_active":"2023-08-01T19:54:04.064040+0000","last_became_peered":"2023-08-01T19:54:04.064040+0000","last_unstale":"2023-08-01T19:54:04.066517+0000","last_undegraded":"2023-08-01T19:54:04.066517+0000","last_fullsized":"2023-08-01T19:54:04.066517+0000","mapping_epoch":15,"log_start":"0'0","ondisk_log_start":"0'0","created":15,"last_epoch_clean":16,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-08-01T19:54:03.032665+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-08-01T19:54:03.032665+0000","last_clean_scrub_stamp":"2023-08-01T19:54:03.032665+0000","objects_scrubbed":0,"log_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-08-03T03:40:43.460182+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[1,0],"acting":[1,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":1,"acting_primary":1,"purged_snaps":[]},{"pgid":"4.11","version":"0'0","reported_seq":8,"reported_epoch":17,"state":"active+clean","last_fresh":"2023-08-01T19:54:04.470401+0000","last_change":"2023-08-01T19:54:04.470401+0000","last_active":"2023-08-01T19:54:04.470401+0000","last_peered":"2023-08-01T19:54:04.470401+0000","last_clean":"2023-08-01T19:54:04.470401+0000","last_became_active":"2023-08-01T19:54:04.469680+0000","last_became_peered":"2023-08-01T19:54:04.469680+0000","last_unstale":"2023-08-01T19:54:04.470401+0000","last_undegraded":"2023-08-01T19:54:04.470401+0000","last_fullsized":"2023-08-01T19:54:04.470401+0000","mapping_epoch":16,"log_start":"0'0","ondisk_log_start":"0'0","created":16,"last_epoch_clean":17,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-08-01T19:54:04.040663+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-08-01T19:54:04.040663+0000","last_clean_scrub_stamp":"2023-08-01T19:54:04.040663+0000","objects_scrubbed":0,"log_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-08-03T03:58:06.360840+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[0,1],"acting":[0,1],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":0,"acting_primary":0,"purged_snaps":[]},{"pgid":"3.15","version":"17'3","reported_seq":13,"reported_epoch":17,"state":"active+clean","last_fresh":"2023-08-01T19:54:04.471749+0000","last_change":"2023-08-01T19:54:04.065443+0000","last_active":"2023-08-01T19:54:04.471749+0000","last_peered":"2023-08-01T19:54:04.471749+0000","last_clean":"2023-08-01T19:54:04.471749+0000","last_became_active":"2023-08-01T19:54:04.065112+0000","last_became_peered":"2023-08-01T19:54:04.065112+0000","last_unstale":"2023-08-01T19:54:04.471749+0000","last_undegraded":"2023-08-01T19:54:04.471749+0000","last_fullsized":"2023-08-01T19:54:04.471749+0000","mapping_epoch":15,"log_start":"0'0","ondisk_log_start":"0'0","created":15,"last_epoch_clean":16,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-08-01T19:54:03.032665+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-08-01T19:54:03.032665+0000","last_clean_scrub_stamp":"2023-08-01T19:54:03.032665+0000","objects_scrubbed":0,"log_size":3,"ondisk_log_size":3,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-08-03T03:27:50.887004+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":90,"num_objects":2,"num_object_clones":0,"num_object_copies":4,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":2,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":4,"num_write_kb":1,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":1,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[2,1],"acting":[2,1],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":2,"acting_primary":2,"purged_snaps":[]},{"pgid":"4.12","version":"0'0","reported_seq":8,"reported_epoch":17,"state":"active+clean","last_fresh":"2023-08-01T19:54:04.467822+0000","last_change":"2023-08-01T19:54:04.467822+0000","last_active":"2023-08-01T19:54:04.467822+0000","last_peered":"2023-08-01T19:54:04.467822+0000","last_clean":"2023-08-01T19:54:04.467822+0000","last_became_active":"2023-08-01T19:54:04.466667+0000","last_became_peered":"2023-08-01T19:54:04.466667+0000","last_unstale":"2023-08-01T19:54:04.467822+0000","last_undegraded":"2023-08-01T19:54:04.467822+0000","last_fullsized":"2023-08-01T19:54:04.467822+0000","mapping_epoch":16,"log_start":"0'0","ondisk_log_start":"0'0","created":16,"last_epoch_clean":17,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-08-01T19:54:04.040663+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-08-01T19:54:04.040663+0000","last_clean_scrub_stamp":"2023-08-01T19:54:04.040663+0000","objects_scrubbed":0,"log_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-08-03T02:57:18.148077+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[0,2],"acting":[0,2],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":0,"acting_primary":0,"purged_snaps":[]},{"pgid":"3.14","version":"17'6","reported_seq":15,"reported_epoch":17,"state":"active+clean","last_fresh":"2023-08-01T19:54:04.480371+0000","last_change":"2023-08-01T19:54:04.061419+0000","last_active":"2023-08-01T19:54:04.480371+0000","last_peered":"2023-08-01T19:54:04.480371+0000","last_clean":"2023-08-01T19:54:04.480371+0000","last_became_active":"2023-08-01T19:54:04.061078+0000","last_became_peered":"2023-08-01T19:54:04.061078+0000","last_unstale":"2023-08-01T19:54:04.480371+0000","last_undegraded":"2023-08-01T19:54:04.480371+0000","last_fullsized":"2023-08-01T19:54:04.480371+0000","mapping_epoch":15,"log_start":"0'0","ondisk_log_start":"0'0","created":15,"last_epoch_clean":16,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-08-01T19:54:03.032665+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-08-01T19:54:03.032665+0000","last_clean_scrub_stamp":"2023-08-01T19:54:03.032665+0000","objects_scrubbed":0,"log_size":6,"ondisk_log_size":6,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-08-02T21:35:44.874727+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":1536,"num_objects":4,"num_object_clones":0,"num_object_copies":8,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":4,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":6,"num_write_kb":3,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":1,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[1,2],"acting":[1,2],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":1,"acting_primary":1,"purged_snaps":[]},{"pgid":"4.13","version":"0'0","reported_seq":8,"reported_epoch":17,"state":"active+clean","last_fresh":"2023-08-01T19:54:04.466400+0000","last_change":"2023-08-01T19:54:04.466400+0000","last_active":"2023-08-01T19:54:04.466400+0000","last_peered":"2023-08-01T19:54:04.466400+0000","last_clean":"2023-08-01T19:54:04.466400+0000","last_became_active":"2023-08-01T19:54:04.465979+0000","last_became_peered":"2023-08-01T19:54:04.465979+0000","last_unstale":"2023-08-01T19:54:04.466400+0000","last_undegraded":"2023-08-01T19:54:04.466400+0000","last_fullsized":"2023-08-01T19:54:04.466400+0000","mapping_epoch":16,"log_start":"0'0","ondisk_log_start":"0'0","created":16,"last_epoch_clean":17,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-08-01T19:54:04.040663+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-08-01T19:54:04.040663+0000","last_clean_scrub_stamp":"2023-08-01T19:54:04.040663+0000","objects_scrubbed":0,"log_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-08-02T20:20:59.989030+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[1,2],"acting":[1,2],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":1,"acting_primary":1,"purged_snaps":[]},{"pgid":"3.13","version":"17'2","reported_seq":11,"reported_epoch":17,"state":"active+clean","last_fresh":"2023-08-01T19:54:04.474777+0000","last_change":"2023-08-01T19:54:04.065212+0000","last_active":"2023-08-01T19:54:04.474777+0000","last_peered":"2023-08-01T19:54:04.474777+0000","last_clean":"2023-08-01T19:54:04.474777+0000","last_became_active":"2023-08-01T19:54:04.064375+0000","last_became_peered":"2023-08-01T19:54:04.064375+0000","last_unstale":"2023-08-01T19:54:04.474777+0000","last_undegraded":"2023-08-01T19:54:04.474777+0000","last_fullsized":"2023-08-01T19:54:04.474777+0000","mapping_epoch":15,"log_start":"0'0","ondisk_log_start":"0'0","created":15,"last_epoch_clean":16,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-08-01T19:54:03.032665+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-08-01T19:54:03.032665+0000","last_clean_scrub_stamp":"2023-08-01T19:54:03.032665+0000","objects_scrubbed":0,"log_size":2,"ondisk_log_size":2,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-08-03T06:17:37.910752+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":34,"num_objects":2,"num_object_clones":0,"num_object_copies":4,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":2,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":3,"num_write_kb":6,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":1,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[1,0],"acting":[1,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":1,"acting_primary":1,"purged_snaps":[]},{"pgid":"4.14","version":"0'0","reported_seq":9,"reported_epoch":17,"state":"active+clean","last_fresh":"2023-08-01T19:54:04.465917+0000","last_change":"2023-08-01T19:54:04.464446+0000","last_active":"2023-08-01T19:54:04.465917+0000","last_peered":"2023-08-01T19:54:04.465917+0000","last_clean":"2023-08-01T19:54:04.465917+0000","last_became_active":"2023-08-01T19:54:04.464021+0000","last_became_peered":"2023-08-01T19:54:04.464021+0000","last_unstale":"2023-08-01T19:54:04.465917+0000","last_undegraded":"2023-08-01T19:54:04.465917+0000","last_fullsized":"2023-08-01T19:54:04.465917+0000","mapping_epoch":16,"log_start":"0'0","ondisk_log_start":"0'0","created":16,"last_epoch_clean":17,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-08-01T19:54:04.040663+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-08-01T19:54:04.040663+0000","last_clean_scrub_stamp":"2023-08-01T19:54:04.040663+0000","objects_scrubbed":0,"log_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-08-02T20:26:51.080849+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[2,0],"acting":[2,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":2,"acting_primary":2,"purged_snaps":[]},{"pgid":"3.12","version":"0'0","reported_seq":9,"reported_epoch":16,"state":"active+clean","last_fresh":"2023-08-01T19:54:04.068588+0000","last_change":"2023-08-01T19:54:04.066566+0000","last_active":"2023-08-01T19:54:04.068588+0000","last_peered":"2023-08-01T19:54:04.068588+0000","last_clean":"2023-08-01T19:54:04.068588+0000","last_became_active":"2023-08-01T19:54:04.066190+0000","last_became_peered":"2023-08-01T19:54:04.066190+0000","last_unstale":"2023-08-01T19:54:04.068588+0000","last_undegraded":"2023-08-01T19:54:04.068588+0000","last_fullsized":"2023-08-01T19:54:04.068588+0000","mapping_epoch":15,"log_start":"0'0","ondisk_log_start":"0'0","created":15,"last_epoch_clean":16,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-08-01T19:54:03.032665+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-08-01T19:54:03.032665+0000","last_clean_scrub_stamp":"2023-08-01T19:54:03.032665+0000","objects_scrubbed":0,"log_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-08-03T02:01:47.073630+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[0,1],"acting":[0,1],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":0,"acting_primary":0,"purged_snaps":[]},{"pgid":"4.15","version":"0'0","reported_seq":9,"reported_epoch":17,"state":"active+clean","last_fresh":"2023-08-01T19:54:04.470734+0000","last_change":"2023-08-01T19:54:04.468791+0000","last_active":"2023-08-01T19:54:04.470734+0000","last_peered":"2023-08-01T19:54:04.470734+0000","last_clean":"2023-08-01T19:54:04.470734+0000","last_became_active":"2023-08-01T19:54:04.468214+0000","last_became_peered":"2023-08-01T19:54:04.468214+0000","last_unstale":"2023-08-01T19:54:04.470734+0000","last_undegraded":"2023-08-01T19:54:04.470734+0000","last_fullsized":"2023-08-01T19:54:04.470734+0000","mapping_epoch":16,"log_start":"0'0","ondisk_log_start":"0'0","created":16,"last_epoch_clean":17,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-08-01T19:54:04.040663+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-08-01T19:54:04.040663+0000","last_clean_scrub_stamp":"2023-08-01T19:54:04.040663+0000","objects_scrubbed":0,"log_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-08-03T04:10:44.729287+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[2,0],"acting":[2,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":2,"acting_primary":2,"purged_snaps":[]},{"pgid":"3.11","version":"0'0","reported_seq":10,"reported_epoch":17,"state":"active+clean","last_fresh":"2023-08-01T19:54:04.457924+0000","last_change":"2023-08-01T19:54:04.064280+0000","last_active":"2023-08-01T19:54:04.457924+0000","last_peered":"2023-08-01T19:54:04.457924+0000","last_clean":"2023-08-01T19:54:04.457924+0000","last_became_active":"2023-08-01T19:54:04.064064+0000","last_became_peered":"2023-08-01T19:54:04.064064+0000","last_unstale":"2023-08-01T19:54:04.457924+0000","last_undegraded":"2023-08-01T19:54:04.457924+0000","last_fullsized":"2023-08-01T19:54:04.457924+0000","mapping_epoch":15,"log_start":"0'0","ondisk_log_start":"0'0","created":15,"last_epoch_clean":16,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-08-01T19:54:03.032665+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-08-01T19:54:03.032665+0000","last_clean_scrub_stamp":"2023-08-01T19:54:03.032665+0000","objects_scrubbed":0,"log_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-08-03T06:13:51.475710+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[2,1],"acting":[2,1],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":2,"acting_primary":2,"purged_snaps":[]},{"pgid":"4.16","version":"0'0","reported_seq":8,"reported_epoch":17,"state":"active+clean","last_fresh":"2023-08-01T19:54:04.469724+0000","last_change":"2023-08-01T19:54:04.469724+0000","last_active":"2023-08-01T19:54:04.469724+0000","last_peered":"2023-08-01T19:54:04.469724+0000","last_clean":"2023-08-01T19:54:04.469724+0000","last_became_active":"2023-08-01T19:54:04.469275+0000","last_became_peered":"2023-08-01T19:54:04.469275+0000","last_unstale":"2023-08-01T19:54:04.469724+0000","last_undegraded":"2023-08-01T19:54:04.469724+0000","last_fullsized":"2023-08-01T19:54:04.469724+0000","mapping_epoch":16,"log_start":"0'0","ondisk_log_start":"0'0","created":16,"last_epoch_clean":17,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-08-01T19:54:04.040663+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-08-01T19:54:04.040663+0000","last_clean_scrub_stamp":"2023-08-01T19:54:04.040663+0000","objects_scrubbed":0,"log_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-08-03T03:04:06.137335+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[0,1],"acting":[0,1],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":0,"acting_primary":0,"purged_snaps":[]},{"pgid":"3.10","version":"17'8","reported_seq":17,"reported_epoch":17,"state":"active+clean","last_fresh":"2023-08-01T19:54:04.480213+0000","last_change":"2023-08-01T19:54:04.060962+0000","last_active":"2023-08-01T19:54:04.480213+0000","last_peered":"2023-08-01T19:54:04.480213+0000","last_clean":"2023-08-01T19:54:04.480213+0000","last_became_active":"2023-08-01T19:54:04.060576+0000","last_became_peered":"2023-08-01T19:54:04.060576+0000","last_unstale":"2023-08-01T19:54:04.480213+0000","last_undegraded":"2023-08-01T19:54:04.480213+0000","last_fullsized":"2023-08-01T19:54:04.480213+0000","mapping_epoch":15,"log_start":"0'0","ondisk_log_start":"0'0","created":15,"last_epoch_clean":16,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-08-01T19:54:03.032665+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-08-01T19:54:03.032665+0000","last_clean_scrub_stamp":"2023-08-01T19:54:03.032665+0000","objects_scrubbed":0,"log_size":8,"ondisk_log_size":8,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-08-03T05:00:51.171444+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":4,"num_object_clones":0,"num_object_copies":8,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":4,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":12,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":4,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[1,2],"acting":[1,2],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":1,"acting_primary":1,"purged_snaps":[]},{"pgid":"4.17","version":"0'0","reported_seq":8,"reported_epoch":17,"state":"active+clean","last_fresh":"2023-08-01T19:54:04.472721+0000","last_change":"2023-08-01T19:54:04.472721+0000","last_active":"2023-08-01T19:54:04.472721+0000","last_peered":"2023-08-01T19:54:04.472721+0000","last_clean":"2023-08-01T19:54:04.472721+0000","last_became_active":"2023-08-01T19:54:04.472126+0000","last_became_peered":"2023-08-01T19:54:04.472126+0000","last_unstale":"2023-08-01T19:54:04.472721+0000","last_undegraded":"2023-08-01T19:54:04.472721+0000","last_fullsized":"2023-08-01T19:54:04.472721+0000","mapping_epoch":16,"log_start":"0'0","ondisk_log_start":"0'0","created":16,"last_epoch_clean":17,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-08-01T19:54:04.040663+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-08-01T19:54:04.040663+0000","last_clean_scrub_stamp":"2023-08-01T19:54:04.040663+0000","objects_scrubbed":0,"log_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-08-03T00:29:05.857138+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[0,1],"acting":[0,1],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":0,"acting_primary":0,"purged_snaps":[]},{"pgid":"3.f","version":"17'1","reported_seq":10,"reported_epoch":17,"state":"active+clean","last_fresh":"2023-08-01T19:54:04.469403+0000","last_change":"2023-08-01T19:54:04.060797+0000","last_active":"2023-08-01T19:54:04.469403+0000","last_peered":"2023-08-01T19:54:04.469403+0000","last_clean":"2023-08-01T19:54:04.469403+0000","last_became_active":"2023-08-01T19:54:04.060444+0000","last_became_peered":"2023-08-01T19:54:04.060444+0000","last_unstale":"2023-08-01T19:54:04.469403+0000","last_undegraded":"2023-08-01T19:54:04.469403+0000","last_fullsized":"2023-08-01T19:54:04.469403+0000","mapping_epoch":15,"log_start":"0'0","ondisk_log_start":"0'0","created":15,"last_epoch_clean":16,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-08-01T19:54:03.032665+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-08-01T19:54:03.032665+0000","last_clean_scrub_stamp":"2023-08-01T19:54:03.032665+0000","objects_scrubbed":0,"log_size":1,"ondisk_log_size":1,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-08-03T07:13:34.025722+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":22,"num_objects":1,"num_object_clones":0,"num_object_copies":2,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":1,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":1,"num_write_kb":1,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[1,2],"acting":[1,2],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":1,"acting_primary":1,"purged_snaps":[]},{"pgid":"4.8","version":"0'0","reported_seq":9,"reported_epoch":17,"state":"active+clean","last_fresh":"2023-08-01T19:54:04.470264+0000","last_change":"2023-08-01T19:54:04.467671+0000","last_active":"2023-08-01T19:54:04.470264+0000","last_peered":"2023-08-01T19:54:04.470264+0000","last_clean":"2023-08-01T19:54:04.470264+0000","last_became_active":"2023-08-01T19:54:04.467300+0000","last_became_peered":"2023-08-01T19:54:04.467300+0000","last_unstale":"2023-08-01T19:54:04.470264+0000","last_undegraded":"2023-08-01T19:54:04.470264+0000","last_fullsized":"2023-08-01T19:54:04.470264+0000","mapping_epoch":16,"log_start":"0'0","ondisk_log_start":"0'0","created":16,"last_epoch_clean":17,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-08-01T19:54:04.040663+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-08-01T19:54:04.040663+0000","last_clean_scrub_stamp":"2023-08-01T19:54:04.040663+0000","objects_scrubbed":0,"log_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-08-03T05:27:24.774345+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[2,1],"acting":[2,1],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":2,"acting_primary":2,"purged_snaps":[]},{"pgid":"3.e","version":"17'2","reported_seq":12,"reported_epoch":17,"state":"active+clean","last_fresh":"2023-08-01T19:54:04.471249+0000","last_change":"2023-08-01T19:54:04.065595+0000","last_active":"2023-08-01T19:54:04.471249+0000","last_peered":"2023-08-01T19:54:04.471249+0000","last_clean":"2023-08-01T19:54:04.471249+0000","last_became_active":"2023-08-01T19:54:04.065303+0000","last_became_peered":"2023-08-01T19:54:04.065303+0000","last_unstale":"2023-08-01T19:54:04.471249+0000","last_undegraded":"2023-08-01T19:54:04.471249+0000","last_fullsized":"2023-08-01T19:54:04.471249+0000","mapping_epoch":15,"log_start":"0'0","ondisk_log_start":"0'0","created":15,"last_epoch_clean":16,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-08-01T19:54:03.032665+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-08-01T19:54:03.032665+0000","last_clean_scrub_stamp":"2023-08-01T19:54:03.032665+0000","objects_scrubbed":0,"log_size":2,"ondisk_log_size":2,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-08-02T22:40:38.782053+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":1,"num_object_clones":0,"num_object_copies":2,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":1,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":3,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":1,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[2,1],"acting":[2,1],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":2,"acting_primary":2,"purged_snaps":[]},{"pgid":"4.9","version":"0'0","reported_seq":9,"reported_epoch":17,"state":"active+clean","last_fresh":"2023-08-01T19:54:04.470284+0000","last_change":"2023-08-01T19:54:04.468007+0000","last_active":"2023-08-01T19:54:04.470284+0000","last_peered":"2023-08-01T19:54:04.470284+0000","last_clean":"2023-08-01T19:54:04.470284+0000","last_became_active":"2023-08-01T19:54:04.467509+0000","last_became_peered":"2023-08-01T19:54:04.467509+0000","last_unstale":"2023-08-01T19:54:04.470284+0000","last_undegraded":"2023-08-01T19:54:04.470284+0000","last_fullsized":"2023-08-01T19:54:04.470284+0000","mapping_epoch":16,"log_start":"0'0","ondisk_log_start":"0'0","created":16,"last_epoch_clean":17,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-08-01T19:54:04.040663+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-08-01T19:54:04.040663+0000","last_clean_scrub_stamp":"2023-08-01T19:54:04.040663+0000","objects_scrubbed":0,"log_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-08-03T06:04:50.963711+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[2,0],"acting":[2,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":2,"acting_primary":2,"purged_snaps":[]},{"pgid":"3.d","version":"17'1","reported_seq":10,"reported_epoch":17,"state":"active+clean","last_fresh":"2023-08-01T19:54:04.468649+0000","last_change":"2023-08-01T19:54:04.062853+0000","last_active":"2023-08-01T19:54:04.468649+0000","last_peered":"2023-08-01T19:54:04.468649+0000","last_clean":"2023-08-01T19:54:04.468649+0000","last_became_active":"2023-08-01T19:54:04.062598+0000","last_became_peered":"2023-08-01T19:54:04.062598+0000","last_unstale":"2023-08-01T19:54:04.468649+0000","last_undegraded":"2023-08-01T19:54:04.468649+0000","last_fullsized":"2023-08-01T19:54:04.468649+0000","mapping_epoch":15,"log_start":"0'0","ondisk_log_start":"0'0","created":15,"last_epoch_clean":16,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-08-01T19:54:03.032665+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-08-01T19:54:03.032665+0000","last_clean_scrub_stamp":"2023-08-01T19:54:03.032665+0000","objects_scrubbed":0,"log_size":1,"ondisk_log_size":1,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-08-02T20:56:47.324761+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":70,"num_objects":1,"num_object_clones":0,"num_object_copies":2,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":1,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":1,"num_write_kb":1,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[1,2],"acting":[1,2],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":1,"acting_primary":1,"purged_snaps":[]},{"pgid":"4.a","version":"0'0","reported_seq":8,"reported_epoch":17,"state":"active+clean","last_fresh":"2023-08-01T19:54:04.471997+0000","last_change":"2023-08-01T19:54:04.471997+0000","last_active":"2023-08-01T19:54:04.471997+0000","last_peered":"2023-08-01T19:54:04.471997+0000","last_clean":"2023-08-01T19:54:04.471997+0000","last_became_active":"2023-08-01T19:54:04.471204+0000","last_became_peered":"2023-08-01T19:54:04.471204+0000","last_unstale":"2023-08-01T19:54:04.471997+0000","last_undegraded":"2023-08-01T19:54:04.471997+0000","last_fullsized":"2023-08-01T19:54:04.471997+0000","mapping_epoch":16,"log_start":"0'0","ondisk_log_start":"0'0","created":16,"last_epoch_clean":17,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-08-01T19:54:04.040663+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-08-01T19:54:04.040663+0000","last_clean_scrub_stamp":"2023-08-01T19:54:04.040663+0000","objects_scrubbed":0,"log_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-08-02T23:12:30.830199+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[1,0],"acting":[1,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":1,"acting_primary":1,"purged_snaps":[]},{"pgid":"3.c","version":"0'0","reported_seq":9,"reported_epoch":16,"state":"active+clean","last_fresh":"2023-08-01T19:54:04.066181+0000","last_change":"2023-08-01T19:54:04.063532+0000","last_active":"2023-08-01T19:54:04.066181+0000","last_peered":"2023-08-01T19:54:04.066181+0000","last_clean":"2023-08-01T19:54:04.066181+0000","last_became_active":"2023-08-01T19:54:04.063116+0000","last_became_peered":"2023-08-01T19:54:04.063116+0000","last_unstale":"2023-08-01T19:54:04.066181+0000","last_undegraded":"2023-08-01T19:54:04.066181+0000","last_fullsized":"2023-08-01T19:54:04.066181+0000","mapping_epoch":15,"log_start":"0'0","ondisk_log_start":"0'0","created":15,"last_epoch_clean":16,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-08-01T19:54:03.032665+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-08-01T19:54:03.032665+0000","last_clean_scrub_stamp":"2023-08-01T19:54:03.032665+0000","objects_scrubbed":0,"log_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-08-02T22:28:51.936138+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[1,0],"acting":[1,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":1,"acting_primary":1,"purged_snaps":[]},{"pgid":"4.b","version":"0'0","reported_seq":8,"reported_epoch":17,"state":"active+clean","last_fresh":"2023-08-01T19:54:04.470787+0000","last_change":"2023-08-01T19:54:04.470787+0000","last_active":"2023-08-01T19:54:04.470787+0000","last_peered":"2023-08-01T19:54:04.470787+0000","last_clean":"2023-08-01T19:54:04.470787+0000","last_became_active":"2023-08-01T19:54:04.470332+0000","last_became_peered":"2023-08-01T19:54:04.470332+0000","last_unstale":"2023-08-01T19:54:04.470787+0000","last_undegraded":"2023-08-01T19:54:04.470787+0000","last_fullsized":"2023-08-01T19:54:04.470787+0000","mapping_epoch":16,"log_start":"0'0","ondisk_log_start":"0'0","created":16,"last_epoch_clean":17,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-08-01T19:54:04.040663+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-08-01T19:54:04.040663+0000","last_clean_scrub_stamp":"2023-08-01T19:54:04.040663+0000","objects_scrubbed":0,"log_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-08-03T05:13:38.298401+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[0,1],"acting":[0,1],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":0,"acting_primary":0,"purged_snaps":[]},{"pgid":"3.b","version":"17'2","reported_seq":11,"reported_epoch":17,"state":"active+clean","last_fresh":"2023-08-01T19:54:04.472823+0000","last_change":"2023-08-01T19:54:04.066839+0000","last_active":"2023-08-01T19:54:04.472823+0000","last_peered":"2023-08-01T19:54:04.472823+0000","last_clean":"2023-08-01T19:54:04.472823+0000","last_became_active":"2023-08-01T19:54:04.065535+0000","last_became_peered":"2023-08-01T19:54:04.065535+0000","last_unstale":"2023-08-01T19:54:04.472823+0000","last_undegraded":"2023-08-01T19:54:04.472823+0000","last_fullsized":"2023-08-01T19:54:04.472823+0000","mapping_epoch":15,"log_start":"0'0","ondisk_log_start":"0'0","created":15,"last_epoch_clean":16,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-08-01T19:54:03.032665+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-08-01T19:54:03.032665+0000","last_clean_scrub_stamp":"2023-08-01T19:54:03.032665+0000","objects_scrubbed":0,"log_size":2,"ondisk_log_size":2,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-08-03T05:00:51.171444+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":1,"num_object_clones":0,"num_object_copies":2,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":1,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":1,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":1,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[0,1],"acting":[0,1],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":0,"acting_primary":0,"purged_snaps":[]},{"pgid":"4.c","version":"0'0","reported_seq":8,"reported_epoch":17,"state":"active+clean","last_fresh":"2023-08-01T19:54:04.478715+0000","last_change":"2023-08-01T19:54:04.478715+0000","last_active":"2023-08-01T19:54:04.478715+0000","last_peered":"2023-08-01T19:54:04.478715+0000","last_clean":"2023-08-01T19:54:04.478715+0000","last_became_active":"2023-08-01T19:54:04.477435+0000","last_became_peered":"2023-08-01T19:54:04.477435+0000","last_unstale":"2023-08-01T19:54:04.478715+0000","last_undegraded":"2023-08-01T19:54:04.478715+0000","last_fullsized":"2023-08-01T19:54:04.478715+0000","mapping_epoch":16,"log_start":"0'0","ondisk_log_start":"0'0","created":16,"last_epoch_clean":17,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-08-01T19:54:04.040663+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-08-01T19:54:04.040663+0000","last_clean_scrub_stamp":"2023-08-01T19:54:04.040663+0000","objects_scrubbed":0,"log_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-08-03T04:43:21.408174+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[1,0],"acting":[1,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":1,"acting_primary":1,"purged_snaps":[]},{"pgid":"3.a","version":"0'0","reported_seq":9,"reported_epoch":16,"state":"active+clean","last_fresh":"2023-08-01T19:54:04.066947+0000","last_change":"2023-08-01T19:54:04.065267+0000","last_active":"2023-08-01T19:54:04.066947+0000","last_peered":"2023-08-01T19:54:04.066947+0000","last_clean":"2023-08-01T19:54:04.066947+0000","last_became_active":"2023-08-01T19:54:04.064912+0000","last_became_peered":"2023-08-01T19:54:04.064912+0000","last_unstale":"2023-08-01T19:54:04.066947+0000","last_undegraded":"2023-08-01T19:54:04.066947+0000","last_fullsized":"2023-08-01T19:54:04.066947+0000","mapping_epoch":15,"log_start":"0'0","ondisk_log_start":"0'0","created":15,"last_epoch_clean":16,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-08-01T19:54:03.032665+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-08-01T19:54:03.032665+0000","last_clean_scrub_stamp":"2023-08-01T19:54:03.032665+0000","objects_scrubbed":0,"log_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-08-03T02:37:09.180970+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[1,0],"acting":[1,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":1,"acting_primary":1,"purged_snaps":[]},{"pgid":"4.d","version":"0'0","reported_seq":8,"reported_epoch":17,"state":"active+clean","last_fresh":"2023-08-01T19:54:04.474755+0000","last_change":"2023-08-01T19:54:04.474755+0000","last_active":"2023-08-01T19:54:04.474755+0000","last_peered":"2023-08-01T19:54:04.474755+0000","last_clean":"2023-08-01T19:54:04.474755+0000","last_became_active":"2023-08-01T19:54:04.471526+0000","last_became_peered":"2023-08-01T19:54:04.471526+0000","last_unstale":"2023-08-01T19:54:04.474755+0000","last_undegraded":"2023-08-01T19:54:04.474755+0000","last_fullsized":"2023-08-01T19:54:04.474755+0000","mapping_epoch":16,"log_start":"0'0","ondisk_log_start":"0'0","created":16,"last_epoch_clean":17,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-08-01T19:54:04.040663+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-08-01T19:54:04.040663+0000","last_clean_scrub_stamp":"2023-08-01T19:54:04.040663+0000","objects_scrubbed":0,"log_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-08-03T06:50:03.420334+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[1,2],"acting":[1,2],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":1,"acting_primary":1,"purged_snaps":[]},{"pgid":"3.9","version":"0'0","reported_seq":10,"reported_epoch":17,"state":"active+clean","last_fresh":"2023-08-01T19:54:04.457820+0000","last_change":"2023-08-01T19:54:04.065519+0000","last_active":"2023-08-01T19:54:04.457820+0000","last_peered":"2023-08-01T19:54:04.457820+0000","last_clean":"2023-08-01T19:54:04.457820+0000","last_became_active":"2023-08-01T19:54:04.065211+0000","last_became_peered":"2023-08-01T19:54:04.065211+0000","last_unstale":"2023-08-01T19:54:04.457820+0000","last_undegraded":"2023-08-01T19:54:04.457820+0000","last_fullsized":"2023-08-01T19:54:04.457820+0000","mapping_epoch":15,"log_start":"0'0","ondisk_log_start":"0'0","created":15,"last_epoch_clean":16,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-08-01T19:54:03.032665+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-08-01T19:54:03.032665+0000","last_clean_scrub_stamp":"2023-08-01T19:54:03.032665+0000","objects_scrubbed":0,"log_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-08-03T05:46:27.672957+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[2,1],"acting":[2,1],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":2,"acting_primary":2,"purged_snaps":[]},{"pgid":"4.e","version":"0'0","reported_seq":8,"reported_epoch":17,"state":"active+clean","last_fresh":"2023-08-01T19:54:04.473750+0000","last_change":"2023-08-01T19:54:04.473750+0000","last_active":"2023-08-01T19:54:04.473750+0000","last_peered":"2023-08-01T19:54:04.473750+0000","last_clean":"2023-08-01T19:54:04.473750+0000","last_became_active":"2023-08-01T19:54:04.471512+0000","last_became_peered":"2023-08-01T19:54:04.471512+0000","last_unstale":"2023-08-01T19:54:04.473750+0000","last_undegraded":"2023-08-01T19:54:04.473750+0000","last_fullsized":"2023-08-01T19:54:04.473750+0000","mapping_epoch":16,"log_start":"0'0","ondisk_log_start":"0'0","created":16,"last_epoch_clean":17,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-08-01T19:54:04.040663+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-08-01T19:54:04.040663+0000","last_clean_scrub_stamp":"2023-08-01T19:54:04.040663+0000","objects_scrubbed":0,"log_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-08-03T05:13:38.298401+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[1,2],"acting":[1,2],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":1,"acting_primary":1,"purged_snaps":[]},{"pgid":"3.8","version":"0'0","reported_seq":10,"reported_epoch":17,"state":"active+clean","last_fresh":"2023-08-01T19:54:04.458299+0000","last_change":"2023-08-01T19:54:04.063990+0000","last_active":"2023-08-01T19:54:04.458299+0000","last_peered":"2023-08-01T19:54:04.458299+0000","last_clean":"2023-08-01T19:54:04.458299+0000","last_became_active":"2023-08-01T19:54:04.063652+0000","last_became_peered":"2023-08-01T19:54:04.063652+0000","last_unstale":"2023-08-01T19:54:04.458299+0000","last_undegraded":"2023-08-01T19:54:04.458299+0000","last_fullsized":"2023-08-01T19:54:04.458299+0000","mapping_epoch":15,"log_start":"0'0","ondisk_log_start":"0'0","created":15,"last_epoch_clean":16,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-08-01T19:54:03.032665+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-08-01T19:54:03.032665+0000","last_clean_scrub_stamp":"2023-08-01T19:54:03.032665+0000","objects_scrubbed":0,"log_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-08-03T05:30:28.028091+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[2,0],"acting":[2,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":2,"acting_primary":2,"purged_snaps":[]},{"pgid":"4.f","version":"0'0","reported_seq":8,"reported_epoch":17,"state":"active+clean","last_fresh":"2023-08-01T19:54:04.469648+0000","last_change":"2023-08-01T19:54:04.469648+0000","last_active":"2023-08-01T19:54:04.469648+0000","last_peered":"2023-08-01T19:54:04.469648+0000","last_clean":"2023-08-01T19:54:04.469648+0000","last_became_active":"2023-08-01T19:54:04.468445+0000","last_became_peered":"2023-08-01T19:54:04.468445+0000","last_unstale":"2023-08-01T19:54:04.469648+0000","last_undegraded":"2023-08-01T19:54:04.469648+0000","last_fullsized":"2023-08-01T19:54:04.469648+0000","mapping_epoch":16,"log_start":"0'0","ondisk_log_start":"0'0","created":16,"last_epoch_clean":17,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-08-01T19:54:04.040663+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-08-01T19:54:04.040663+0000","last_clean_scrub_stamp":"2023-08-01T19:54:04.040663+0000","objects_scrubbed":0,"log_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-08-03T05:46:11.085577+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[0,2],"acting":[0,2],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":0,"acting_primary":0,"purged_snaps":[]},{"pgid":"2.4","version":"0'0","reported_seq":12,"reported_epoch":16,"state":"active+clean","last_fresh":"2023-08-01T19:54:04.062005+0000","last_change":"2023-08-01T19:53:58.973838+0000","last_active":"2023-08-01T19:54:04.062005+0000","last_peered":"2023-08-01T19:54:04.062005+0000","last_clean":"2023-08-01T19:54:04.062005+0000","last_became_active":"2023-08-01T19:53:58.973242+0000","last_became_peered":"2023-08-01T19:53:58.973242+0000","last_unstale":"2023-08-01T19:54:04.062005+0000","last_undegraded":"2023-08-01T19:54:04.062005+0000","last_fullsized":"2023-08-01T19:54:04.062005+0000","mapping_epoch":12,"log_start":"0'0","ondisk_log_start":"0'0","created":12,"last_epoch_clean":13,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-08-01T19:53:57.959448+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-08-01T19:53:57.959448+0000","last_clean_scrub_stamp":"2023-08-01T19:53:57.959448+0000","objects_scrubbed":0,"log_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-08-03T00:09:48.796549+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[0,2],"acting":[0,2],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":0,"acting_primary":0,"purged_snaps":[]},{"pgid":"3.5","version":"0'0","reported_seq":9,"reported_epoch":16,"state":"active+clean","last_fresh":"2023-08-01T19:54:04.066960+0000","last_change":"2023-08-01T19:54:04.065255+0000","last_active":"2023-08-01T19:54:04.066960+0000","last_peered":"2023-08-01T19:54:04.066960+0000","last_clean":"2023-08-01T19:54:04.066960+0000","last_became_active":"2023-08-01T19:54:04.064814+0000","last_became_peered":"2023-08-01T19:54:04.064814+0000","last_unstale":"2023-08-01T19:54:04.066960+0000","last_undegraded":"2023-08-01T19:54:04.066960+0000","last_fullsized":"2023-08-01T19:54:04.066960+0000","mapping_epoch":15,"log_start":"0'0","ondisk_log_start":"0'0","created":15,"last_epoch_clean":16,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-08-01T19:54:03.032665+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-08-01T19:54:03.032665+0000","last_clean_scrub_stamp":"2023-08-01T19:54:03.032665+0000","objects_scrubbed":0,"log_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-08-03T02:01:47.073630+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[1,0],"acting":[1,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":1,"acting_primary":1,"purged_snaps":[]},{"pgid":"4.2","version":"0'0","reported_seq":9,"reported_epoch":17,"state":"active+clean","last_fresh":"2023-08-01T19:54:04.473868+0000","last_change":"2023-08-01T19:54:04.471715+0000","last_active":"2023-08-01T19:54:04.473868+0000","last_peered":"2023-08-01T19:54:04.473868+0000","last_clean":"2023-08-01T19:54:04.473868+0000","last_became_active":"2023-08-01T19:54:04.471300+0000","last_became_peered":"2023-08-01T19:54:04.471300+0000","last_unstale":"2023-08-01T19:54:04.473868+0000","last_undegraded":"2023-08-01T19:54:04.473868+0000","last_fullsized":"2023-08-01T19:54:04.473868+0000","mapping_epoch":16,"log_start":"0'0","ondisk_log_start":"0'0","created":16,"last_epoch_clean":17,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-08-01T19:54:04.040663+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-08-01T19:54:04.040663+0000","last_clean_scrub_stamp":"2023-08-01T19:54:04.040663+0000","objects_scrubbed":0,"log_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-08-02T23:00:24.980203+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[2,1],"acting":[2,1],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":2,"acting_primary":2,"purged_snaps":[]},{"pgid":"2.2","version":"0'0","reported_seq":12,"reported_epoch":16,"state":"active+clean","last_fresh":"2023-08-01T19:54:04.058293+0000","last_change":"2023-08-01T19:53:58.973665+0000","last_active":"2023-08-01T19:54:04.058293+0000","last_peered":"2023-08-01T19:54:04.058293+0000","last_clean":"2023-08-01T19:54:04.058293+0000","last_became_active":"2023-08-01T19:53:58.973463+0000","last_became_peered":"2023-08-01T19:53:58.973463+0000","last_unstale":"2023-08-01T19:54:04.058293+0000","last_undegraded":"2023-08-01T19:54:04.058293+0000","last_fullsized":"2023-08-01T19:54:04.058293+0000","mapping_epoch":12,"log_start":"0'0","ondisk_log_start":"0'0","created":12,"last_epoch_clean":13,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-08-01T19:53:57.959448+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-08-01T19:53:57.959448+0000","last_clean_scrub_stamp":"2023-08-01T19:53:57.959448+0000","objects_scrubbed":0,"log_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-08-03T04:50:42.368892+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[1,0],"acting":[1,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":1,"acting_primary":1,"purged_snaps":[]},{"pgid":"3.3","version":"0'0","reported_seq":9,"reported_epoch":16,"state":"active+clean","last_fresh":"2023-08-01T19:54:04.067001+0000","last_change":"2023-08-01T19:54:04.065415+0000","last_active":"2023-08-01T19:54:04.067001+0000","last_peered":"2023-08-01T19:54:04.067001+0000","last_clean":"2023-08-01T19:54:04.067001+0000","last_became_active":"2023-08-01T19:54:04.065030+0000","last_became_peered":"2023-08-01T19:54:04.065030+0000","last_unstale":"2023-08-01T19:54:04.067001+0000","last_undegraded":"2023-08-01T19:54:04.067001+0000","last_fullsized":"2023-08-01T19:54:04.067001+0000","mapping_epoch":15,"log_start":"0'0","ondisk_log_start":"0'0","created":15,"last_epoch_clean":16,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-08-01T19:54:03.032665+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-08-01T19:54:03.032665+0000","last_clean_scrub_stamp":"2023-08-01T19:54:03.032665+0000","objects_scrubbed":0,"log_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-08-02T21:33:27.007118+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[1,0],"acting":[1,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":1,"acting_primary":1,"purged_snaps":[]},{"pgid":"4.4","version":"0'0","reported_seq":8,"reported_epoch":17,"state":"active+clean","last_fresh":"2023-08-01T19:54:04.468101+0000","last_change":"2023-08-01T19:54:04.468101+0000","last_active":"2023-08-01T19:54:04.468101+0000","last_peered":"2023-08-01T19:54:04.468101+0000","last_clean":"2023-08-01T19:54:04.468101+0000","last_became_active":"2023-08-01T19:54:04.467409+0000","last_became_peered":"2023-08-01T19:54:04.467409+0000","last_unstale":"2023-08-01T19:54:04.468101+0000","last_undegraded":"2023-08-01T19:54:04.468101+0000","last_fullsized":"2023-08-01T19:54:04.468101+0000","mapping_epoch":16,"log_start":"0'0","ondisk_log_start":"0'0","created":16,"last_epoch_clean":17,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-08-01T19:54:04.040663+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-08-01T19:54:04.040663+0000","last_clean_scrub_stamp":"2023-08-01T19:54:04.040663+0000","objects_scrubbed":0,"log_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-08-02T21:43:30.325991+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[0,2],"acting":[0,2],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":0,"acting_primary":0,"purged_snaps":[]},{"pgid":"2.1","version":"0'0","reported_seq":12,"reported_epoch":16,"state":"active+clean","last_fresh":"2023-08-01T19:54:04.061378+0000","last_change":"2023-08-01T19:53:58.973700+0000","last_active":"2023-08-01T19:54:04.061378+0000","last_peered":"2023-08-01T19:54:04.061378+0000","last_clean":"2023-08-01T19:54:04.061378+0000","last_became_active":"2023-08-01T19:53:58.973285+0000","last_became_peered":"2023-08-01T19:53:58.973285+0000","last_unstale":"2023-08-01T19:54:04.061378+0000","last_undegraded":"2023-08-01T19:54:04.061378+0000","last_fullsized":"2023-08-01T19:54:04.061378+0000","mapping_epoch":12,"log_start":"0'0","ondisk_log_start":"0'0","created":12,"last_epoch_clean":13,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-08-01T19:53:57.959448+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-08-01T19:53:57.959448+0000","last_clean_scrub_stamp":"2023-08-01T19:53:57.959448+0000","objects_scrubbed":0,"log_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-08-02T21:26:02.570824+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[0,2],"acting":[0,2],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":0,"acting_primary":0,"purged_snaps":[]},{"pgid":"3.0","version":"0'0","reported_seq":10,"reported_epoch":17,"state":"active+clean","last_fresh":"2023-08-01T19:54:04.457828+0000","last_change":"2023-08-01T19:54:04.064407+0000","last_active":"2023-08-01T19:54:04.457828+0000","last_peered":"2023-08-01T19:54:04.457828+0000","last_clean":"2023-08-01T19:54:04.457828+0000","last_became_active":"2023-08-01T19:54:04.064122+0000","last_became_peered":"2023-08-01T19:54:04.064122+0000","last_unstale":"2023-08-01T19:54:04.457828+0000","last_undegraded":"2023-08-01T19:54:04.457828+0000","last_fullsized":"2023-08-01T19:54:04.457828+0000","mapping_epoch":15,"log_start":"0'0","ondisk_log_start":"0'0","created":15,"last_epoch_clean":16,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-08-01T19:54:03.032665+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-08-01T19:54:03.032665+0000","last_clean_scrub_stamp":"2023-08-01T19:54:03.032665+0000","objects_scrubbed":0,"log_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-08-03T07:08:17.318689+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[2,1],"acting":[2,1],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":2,"acting_primary":2,"purged_snaps":[]},{"pgid":"4.7","version":"0'0","reported_seq":8,"reported_epoch":17,"state":"active+clean","last_fresh":"2023-08-01T19:54:04.469739+0000","last_change":"2023-08-01T19:54:04.469739+0000","last_active":"2023-08-01T19:54:04.469739+0000","last_peered":"2023-08-01T19:54:04.469739+0000","last_clean":"2023-08-01T19:54:04.469739+0000","last_became_active":"2023-08-01T19:54:04.468021+0000","last_became_peered":"2023-08-01T19:54:04.468021+0000","last_unstale":"2023-08-01T19:54:04.469739+0000","last_undegraded":"2023-08-01T19:54:04.469739+0000","last_fullsized":"2023-08-01T19:54:04.469739+0000","mapping_epoch":16,"log_start":"0'0","ondisk_log_start":"0'0","created":16,"last_epoch_clean":17,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-08-01T19:54:04.040663+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-08-01T19:54:04.040663+0000","last_clean_scrub_stamp":"2023-08-01T19:54:04.040663+0000","objects_scrubbed":0,"log_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-08-02T21:03:01.319028+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[0,2],"acting":[0,2],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":0,"acting_primary":0,"purged_snaps":[]},{"pgid":"2.3","version":"0'0","reported_seq":12,"reported_epoch":16,"state":"active+clean","last_fresh":"2023-08-01T19:54:04.058424+0000","last_change":"2023-08-01T19:53:58.973768+0000","last_active":"2023-08-01T19:54:04.058424+0000","last_peered":"2023-08-01T19:54:04.058424+0000","last_clean":"2023-08-01T19:54:04.058424+0000","last_became_active":"2023-08-01T19:53:58.973492+0000","last_became_peered":"2023-08-01T19:53:58.973492+0000","last_unstale":"2023-08-01T19:54:04.058424+0000","last_undegraded":"2023-08-01T19:54:04.058424+0000","last_fullsized":"2023-08-01T19:54:04.058424+0000","mapping_epoch":12,"log_start":"0'0","ondisk_log_start":"0'0","created":12,"last_epoch_clean":13,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-08-01T19:53:57.959448+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-08-01T19:53:57.959448+0000","last_clean_scrub_stamp":"2023-08-01T19:53:57.959448+0000","objects_scrubbed":0,"log_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-08-03T02:04:52.034667+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[1,0],"acting":[1,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":1,"acting_primary":1,"purged_snaps":[]},{"pgid":"1.0","version":"10'157","reported_seq":211,"reported_epoch":16,"state":"active+clean","last_fresh":"2023-08-01T19:54:04.058061+0000","last_change":"2023-08-01T19:53:51.746910+0000","last_active":"2023-08-01T19:54:04.058061+0000","last_peered":"2023-08-01T19:54:04.058061+0000","last_clean":"2023-08-01T19:54:04.058061+0000","last_became_active":"2023-08-01T19:53:51.746590+0000","last_became_peered":"2023-08-01T19:53:51.746590+0000","last_unstale":"2023-08-01T19:54:04.058061+0000","last_undegraded":"2023-08-01T19:54:04.058061+0000","last_fullsized":"2023-08-01T19:54:04.058061+0000","mapping_epoch":9,"log_start":"0'0","ondisk_log_start":"0'0","created":9,"last_epoch_clean":10,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-08-01T19:53:50.735626+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-08-01T19:53:50.735626+0000","last_clean_scrub_stamp":"2023-08-01T19:53:50.735626+0000","objects_scrubbed":0,"log_size":157,"ondisk_log_size":157,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-08-03T02:56:50.228294+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":590368,"num_objects":2,"num_object_clones":0,"num_object_copies":4,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":2,"num_whiteouts":0,"num_read":136,"num_read_kb":118,"num_write":203,"num_write_kb":3460,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[1,2],"acting":[1,2],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":1,"acting_primary":1,"purged_snaps":[]},{"pgid":"3.2","version":"0'0","reported_seq":9,"reported_epoch":16,"state":"active+clean","last_fresh":"2023-08-01T19:54:04.065343+0000","last_change":"2023-08-01T19:54:04.064009+0000","last_active":"2023-08-01T19:54:04.065343+0000","last_peered":"2023-08-01T19:54:04.065343+0000","last_clean":"2023-08-01T19:54:04.065343+0000","last_became_active":"2023-08-01T19:54:04.063665+0000","last_became_peered":"2023-08-01T19:54:04.063665+0000","last_unstale":"2023-08-01T19:54:04.065343+0000","last_undegraded":"2023-08-01T19:54:04.065343+0000","last_fullsized":"2023-08-01T19:54:04.065343+0000","mapping_epoch":15,"log_start":"0'0","ondisk_log_start":"0'0","created":15,"last_epoch_clean":16,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-08-01T19:54:03.032665+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-08-01T19:54:03.032665+0000","last_clean_scrub_stamp":"2023-08-01T19:54:03.032665+0000","objects_scrubbed":0,"log_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-08-03T04:04:46.983253+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[0,2],"acting":[0,2],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":0,"acting_primary":0,"purged_snaps":[]},{"pgid":"4.5","version":"0'0","reported_seq":8,"reported_epoch":17,"state":"active+clean","last_fresh":"2023-08-01T19:54:04.474061+0000","last_change":"2023-08-01T19:54:04.474061+0000","last_active":"2023-08-01T19:54:04.474061+0000","last_peered":"2023-08-01T19:54:04.474061+0000","last_clean":"2023-08-01T19:54:04.474061+0000","last_became_active":"2023-08-01T19:54:04.472128+0000","last_became_peered":"2023-08-01T19:54:04.472128+0000","last_unstale":"2023-08-01T19:54:04.474061+0000","last_undegraded":"2023-08-01T19:54:04.474061+0000","last_fullsized":"2023-08-01T19:54:04.474061+0000","mapping_epoch":16,"log_start":"0'0","ondisk_log_start":"0'0","created":16,"last_epoch_clean":17,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-08-01T19:54:04.040663+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-08-01T19:54:04.040663+0000","last_clean_scrub_stamp":"2023-08-01T19:54:04.040663+0000","objects_scrubbed":0,"log_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-08-03T00:29:05.857138+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[1,2],"acting":[1,2],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":1,"acting_primary":1,"purged_snaps":[]},{"pgid":"2.0","version":"0'0","reported_seq":12,"reported_epoch":16,"state":"active+clean","last_fresh":"2023-08-01T19:54:04.058064+0000","last_change":"2023-08-01T19:53:58.975968+0000","last_active":"2023-08-01T19:54:04.058064+0000","last_peered":"2023-08-01T19:54:04.058064+0000","last_clean":"2023-08-01T19:54:04.058064+0000","last_became_active":"2023-08-01T19:53:58.975706+0000","last_became_peered":"2023-08-01T19:53:58.975706+0000","last_unstale":"2023-08-01T19:54:04.058064+0000","last_undegraded":"2023-08-01T19:54:04.058064+0000","last_fullsized":"2023-08-01T19:54:04.058064+0000","mapping_epoch":12,"log_start":"0'0","ondisk_log_start":"0'0","created":12,"last_epoch_clean":13,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-08-01T19:53:57.959448+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-08-01T19:53:57.959448+0000","last_clean_scrub_stamp":"2023-08-01T19:53:57.959448+0000","objects_scrubbed":0,"log_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-08-03T00:02:15.204280+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[1,2],"acting":[1,2],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":1,"acting_primary":1,"purged_snaps":[]},{"pgid":"3.1","version":"0'0","reported_seq":9,"reported_epoch":16,"state":"active+clean","last_fresh":"2023-08-01T19:54:04.068652+0000","last_change":"2023-08-01T19:54:04.066707+0000","last_active":"2023-08-01T19:54:04.068652+0000","last_peered":"2023-08-01T19:54:04.068652+0000","last_clean":"2023-08-01T19:54:04.068652+0000","last_became_active":"2023-08-01T19:54:04.066334+0000","last_became_peered":"2023-08-01T19:54:04.066334+0000","last_unstale":"2023-08-01T19:54:04.068652+0000","last_undegraded":"2023-08-01T19:54:04.068652+0000","last_fullsized":"2023-08-01T19:54:04.068652+0000","mapping_epoch":15,"log_start":"0'0","ondisk_log_start":"0'0","created":15,"last_epoch_clean":16,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-08-01T19:54:03.032665+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-08-01T19:54:03.032665+0000","last_clean_scrub_stamp":"2023-08-01T19:54:03.032665+0000","objects_scrubbed":0,"log_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-08-03T02:40:15.210599+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[0,1],"acting":[0,1],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":0,"acting_primary":0,"purged_snaps":[]},{"pgid":"4.6","version":"0'0","reported_seq":9,"reported_epoch":17,"state":"active+clean","last_fresh":"2023-08-01T19:54:04.471325+0000","last_change":"2023-08-01T19:54:04.469877+0000","last_active":"2023-08-01T19:54:04.471325+0000","last_peered":"2023-08-01T19:54:04.471325+0000","last_clean":"2023-08-01T19:54:04.471325+0000","last_became_active":"2023-08-01T19:54:04.469528+0000","last_became_peered":"2023-08-01T19:54:04.469528+0000","last_unstale":"2023-08-01T19:54:04.471325+0000","last_undegraded":"2023-08-01T19:54:04.471325+0000","last_fullsized":"2023-08-01T19:54:04.471325+0000","mapping_epoch":16,"log_start":"0'0","ondisk_log_start":"0'0","created":16,"last_epoch_clean":17,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-08-01T19:54:04.040663+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-08-01T19:54:04.040663+0000","last_clean_scrub_stamp":"2023-08-01T19:54:04.040663+0000","objects_scrubbed":0,"log_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-08-03T02:24:19.067602+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[2,0],"acting":[2,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":2,"acting_primary":2,"purged_snaps":[]},{"pgid":"2.5","version":"0'0","reported_seq":13,"reported_epoch":17,"state":"active+clean","last_fresh":"2023-08-01T19:54:04.459098+0000","last_change":"2023-08-01T19:53:58.970683+0000","last_active":"2023-08-01T19:54:04.459098+0000","last_peered":"2023-08-01T19:54:04.459098+0000","last_clean":"2023-08-01T19:54:04.459098+0000","last_became_active":"2023-08-01T19:53:58.970437+0000","last_became_peered":"2023-08-01T19:53:58.970437+0000","last_unstale":"2023-08-01T19:54:04.459098+0000","last_undegraded":"2023-08-01T19:54:04.459098+0000","last_fullsized":"2023-08-01T19:54:04.459098+0000","mapping_epoch":12,"log_start":"0'0","ondisk_log_start":"0'0","created":12,"last_epoch_clean":13,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-08-01T19:53:57.959448+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-08-01T19:53:57.959448+0000","last_clean_scrub_stamp":"2023-08-01T19:53:57.959448+0000","objects_scrubbed":0,"log_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-08-02T23:54:08.273426+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[2,0],"acting":[2,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":2,"acting_primary":2,"purged_snaps":[]},{"pgid":"3.4","version":"0'0","reported_seq":9,"reported_epoch":16,"state":"active+clean","last_fresh":"2023-08-01T19:54:04.062998+0000","last_change":"2023-08-01T19:54:04.062283+0000","last_active":"2023-08-01T19:54:04.062998+0000","last_peered":"2023-08-01T19:54:04.062998+0000","last_clean":"2023-08-01T19:54:04.062998+0000","last_became_active":"2023-08-01T19:54:04.061796+0000","last_became_peered":"2023-08-01T19:54:04.061796+0000","last_unstale":"2023-08-01T19:54:04.062998+0000","last_undegraded":"2023-08-01T19:54:04.062998+0000","last_fullsized":"2023-08-01T19:54:04.062998+0000","mapping_epoch":15,"log_start":"0'0","ondisk_log_start":"0'0","created":15,"last_epoch_clean":16,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-08-01T19:54:03.032665+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-08-01T19:54:03.032665+0000","last_clean_scrub_stamp":"2023-08-01T19:54:03.032665+0000","objects_scrubbed":0,"log_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-08-02T19:54:08.401797+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[0,2],"acting":[0,2],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":0,"acting_primary":0,"purged_snaps":[]},{"pgid":"4.3","version":"0'0","reported_seq":9,"reported_epoch":17,"state":"active+clean","last_fresh":"2023-08-01T19:54:04.474487+0000","last_change":"2023-08-01T19:54:04.473088+0000","last_active":"2023-08-01T19:54:04.474487+0000","last_peered":"2023-08-01T19:54:04.474487+0000","last_clean":"2023-08-01T19:54:04.474487+0000","last_became_active":"2023-08-01T19:54:04.472611+0000","last_became_peered":"2023-08-01T19:54:04.472611+0000","last_unstale":"2023-08-01T19:54:04.474487+0000","last_undegraded":"2023-08-01T19:54:04.474487+0000","last_fullsized":"2023-08-01T19:54:04.474487+0000","mapping_epoch":16,"log_start":"0'0","ondisk_log_start":"0'0","created":16,"last_epoch_clean":17,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-08-01T19:54:04.040663+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-08-01T19:54:04.040663+0000","last_clean_scrub_stamp":"2023-08-01T19:54:04.040663+0000","objects_scrubbed":0,"log_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-08-03T07:27:26.537518+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[2,1],"acting":[2,1],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":2,"acting_primary":2,"purged_snaps":[]},{"pgid":"3.7","version":"17'2","reported_seq":11,"reported_epoch":17,"state":"active+clean","last_fresh":"2023-08-01T19:54:04.469241+0000","last_change":"2023-08-01T19:54:04.065147+0000","last_active":"2023-08-01T19:54:04.469241+0000","last_peered":"2023-08-01T19:54:04.469241+0000","last_clean":"2023-08-01T19:54:04.469241+0000","last_became_active":"2023-08-01T19:54:04.064779+0000","last_became_peered":"2023-08-01T19:54:04.064779+0000","last_unstale":"2023-08-01T19:54:04.469241+0000","last_undegraded":"2023-08-01T19:54:04.469241+0000","last_fullsized":"2023-08-01T19:54:04.469241+0000","mapping_epoch":15,"log_start":"0'0","ondisk_log_start":"0'0","created":15,"last_epoch_clean":16,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-08-01T19:54:03.032665+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-08-01T19:54:03.032665+0000","last_clean_scrub_stamp":"2023-08-01T19:54:03.032665+0000","objects_scrubbed":0,"log_size":2,"ondisk_log_size":2,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-08-03T03:43:45.667663+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":1,"num_object_clones":0,"num_object_copies":2,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":1,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":3,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":1,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[0,2],"acting":[0,2],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":0,"acting_primary":0,"purged_snaps":[]},{"pgid":"2.6","version":"0'0","reported_seq":12,"reported_epoch":16,"state":"active+clean","last_fresh":"2023-08-01T19:54:04.061844+0000","last_change":"2023-08-01T19:53:58.974077+0000","last_active":"2023-08-01T19:54:04.061844+0000","last_peered":"2023-08-01T19:54:04.061844+0000","last_clean":"2023-08-01T19:54:04.061844+0000","last_became_active":"2023-08-01T19:53:58.973396+0000","last_became_peered":"2023-08-01T19:53:58.973396+0000","last_unstale":"2023-08-01T19:54:04.061844+0000","last_undegraded":"2023-08-01T19:54:04.061844+0000","last_fullsized":"2023-08-01T19:54:04.061844+0000","mapping_epoch":12,"log_start":"0'0","ondisk_log_start":"0'0","created":12,"last_epoch_clean":13,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-08-01T19:53:57.959448+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-08-01T19:53:57.959448+0000","last_clean_scrub_stamp":"2023-08-01T19:53:57.959448+0000","objects_scrubbed":0,"log_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-08-02T22:13:50.940864+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[0,2],"acting":[0,2],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":0,"acting_primary":0,"purged_snaps":[]},{"pgid":"4.0","version":"0'0","reported_seq":8,"reported_epoch":17,"state":"active+clean","last_fresh":"2023-08-01T19:54:04.476807+0000","last_change":"2023-08-01T19:54:04.476807+0000","last_active":"2023-08-01T19:54:04.476807+0000","last_peered":"2023-08-01T19:54:04.476807+0000","last_clean":"2023-08-01T19:54:04.476807+0000","last_became_active":"2023-08-01T19:54:04.476453+0000","last_became_peered":"2023-08-01T19:54:04.476453+0000","last_unstale":"2023-08-01T19:54:04.476807+0000","last_undegraded":"2023-08-01T19:54:04.476807+0000","last_fullsized":"2023-08-01T19:54:04.476807+0000","mapping_epoch":16,"log_start":"0'0","ondisk_log_start":"0'0","created":16,"last_epoch_clean":17,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-08-01T19:54:04.040663+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-08-01T19:54:04.040663+0000","last_clean_scrub_stamp":"2023-08-01T19:54:04.040663+0000","objects_scrubbed":0,"log_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-08-02T20:20:59.989030+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[0,1],"acting":[0,1],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":0,"acting_primary":0,"purged_snaps":[]},{"pgid":"2.7","version":"0'0","reported_seq":12,"reported_epoch":16,"state":"active+clean","last_fresh":"2023-08-01T19:54:04.058795+0000","last_change":"2023-08-01T19:53:58.975936+0000","last_active":"2023-08-01T19:54:04.058795+0000","last_peered":"2023-08-01T19:54:04.058795+0000","last_clean":"2023-08-01T19:54:04.058795+0000","last_became_active":"2023-08-01T19:53:58.975680+0000","last_became_peered":"2023-08-01T19:53:58.975680+0000","last_unstale":"2023-08-01T19:54:04.058795+0000","last_undegraded":"2023-08-01T19:54:04.058795+0000","last_fullsized":"2023-08-01T19:54:04.058795+0000","mapping_epoch":12,"log_start":"0'0","ondisk_log_start":"0'0","created":12,"last_epoch_clean":13,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-08-01T19:53:57.959448+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-08-01T19:53:57.959448+0000","last_clean_scrub_stamp":"2023-08-01T19:53:57.959448+0000","objects_scrubbed":0,"log_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-08-03T05:17:03.508898+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[1,2],"acting":[1,2],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":1,"acting_primary":1,"purged_snaps":[]},{"pgid":"3.6","version":"0'0","reported_seq":9,"reported_epoch":16,"state":"active+clean","last_fresh":"2023-08-01T19:54:04.068935+0000","last_change":"2023-08-01T19:54:04.068041+0000","last_active":"2023-08-01T19:54:04.068935+0000","last_peered":"2023-08-01T19:54:04.068935+0000","last_clean":"2023-08-01T19:54:04.068935+0000","last_became_active":"2023-08-01T19:54:04.067613+0000","last_became_peered":"2023-08-01T19:54:04.067613+0000","last_unstale":"2023-08-01T19:54:04.068935+0000","last_undegraded":"2023-08-01T19:54:04.068935+0000","last_fullsized":"2023-08-01T19:54:04.068935+0000","mapping_epoch":15,"log_start":"0'0","ondisk_log_start":"0'0","created":15,"last_epoch_clean":16,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-08-01T19:54:03.032665+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-08-01T19:54:03.032665+0000","last_clean_scrub_stamp":"2023-08-01T19:54:03.032665+0000","objects_scrubbed":0,"log_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-08-02T21:35:44.874727+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[0,1],"acting":[0,1],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":0,"acting_primary":0,"purged_snaps":[]},{"pgid":"4.1","version":"0'0","reported_seq":9,"reported_epoch":17,"state":"active+clean","last_fresh":"2023-08-01T19:54:04.470826+0000","last_change":"2023-08-01T19:54:04.469243+0000","last_active":"2023-08-01T19:54:04.470826+0000","last_peered":"2023-08-01T19:54:04.470826+0000","last_clean":"2023-08-01T19:54:04.470826+0000","last_became_active":"2023-08-01T19:54:04.468835+0000","last_became_peered":"2023-08-01T19:54:04.468835+0000","last_unstale":"2023-08-01T19:54:04.470826+0000","last_undegraded":"2023-08-01T19:54:04.470826+0000","last_fullsized":"2023-08-01T19:54:04.470826+0000","mapping_epoch":16,"log_start":"0'0","ondisk_log_start":"0'0","created":16,"last_epoch_clean":17,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-08-01T19:54:04.040663+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-08-01T19:54:04.040663+0000","last_clean_scrub_stamp":"2023-08-01T19:54:04.040663+0000","objects_scrubbed":0,"log_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-08-03T04:43:58.358628+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[2,1],"acting":[2,1],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":2,"acting_primary":2,"purged_snaps":[]},{"pgid":"3.1b","version":"17'1","reported_seq":11,"reported_epoch":17,"state":"active+clean","last_fresh":"2023-08-01T19:54:04.471524+0000","last_change":"2023-08-01T19:54:04.066748+0000","last_active":"2023-08-01T19:54:04.471524+0000","last_peered":"2023-08-01T19:54:04.471524+0000","last_clean":"2023-08-01T19:54:04.471524+0000","last_became_active":"2023-08-01T19:54:04.066483+0000","last_became_peered":"2023-08-01T19:54:04.066483+0000","last_unstale":"2023-08-01T19:54:04.471524+0000","last_undegraded":"2023-08-01T19:54:04.471524+0000","last_fullsized":"2023-08-01T19:54:04.471524+0000","mapping_epoch":15,"log_start":"0'0","ondisk_log_start":"0'0","created":15,"last_epoch_clean":16,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-08-01T19:54:03.032665+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-08-01T19:54:03.032665+0000","last_clean_scrub_stamp":"2023-08-01T19:54:03.032665+0000","objects_scrubbed":0,"log_size":1,"ondisk_log_size":1,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-08-03T03:08:26.880362+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[2,1],"acting":[2,1],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":2,"acting_primary":2,"purged_snaps":[]},{"pgid":"4.1c","version":"0'0","reported_seq":9,"reported_epoch":17,"state":"active+clean","last_fresh":"2023-08-01T19:54:04.468766+0000","last_change":"2023-08-01T19:54:04.466766+0000","last_active":"2023-08-01T19:54:04.468766+0000","last_peered":"2023-08-01T19:54:04.468766+0000","last_clean":"2023-08-01T19:54:04.468766+0000","last_became_active":"2023-08-01T19:54:04.466417+0000","last_became_peered":"2023-08-01T19:54:04.466417+0000","last_unstale":"2023-08-01T19:54:04.468766+0000","last_undegraded":"2023-08-01T19:54:04.468766+0000","last_fullsized":"2023-08-01T19:54:04.468766+0000","mapping_epoch":16,"log_start":"0'0","ondisk_log_start":"0'0","created":16,"last_epoch_clean":17,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-08-01T19:54:04.040663+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-08-01T19:54:04.040663+0000","last_clean_scrub_stamp":"2023-08-01T19:54:04.040663+0000","objects_scrubbed":0,"log_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-08-02T22:01:53.643825+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[2,0],"acting":[2,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":2,"acting_primary":2,"purged_snaps":[]},{"pgid":"3.1c","version":"17'2","reported_seq":11,"reported_epoch":17,"state":"active+clean","last_fresh":"2023-08-01T19:54:04.477636+0000","last_change":"2023-08-01T19:54:04.065706+0000","last_active":"2023-08-01T19:54:04.477636+0000","last_peered":"2023-08-01T19:54:04.477636+0000","last_clean":"2023-08-01T19:54:04.477636+0000","last_became_active":"2023-08-01T19:54:04.064796+0000","last_became_peered":"2023-08-01T19:54:04.064796+0000","last_unstale":"2023-08-01T19:54:04.477636+0000","last_undegraded":"2023-08-01T19:54:04.477636+0000","last_fullsized":"2023-08-01T19:54:04.477636+0000","mapping_epoch":15,"log_start":"0'0","ondisk_log_start":"0'0","created":15,"last_epoch_clean":16,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-08-01T19:54:03.032665+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-08-01T19:54:03.032665+0000","last_clean_scrub_stamp":"2023-08-01T19:54:03.032665+0000","objects_scrubbed":0,"log_size":2,"ondisk_log_size":2,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-08-02T21:40:43.596301+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":1,"num_object_clones":0,"num_object_copies":2,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":1,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":3,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":1,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[1,0],"acting":[1,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":1,"acting_primary":1,"purged_snaps":[]},{"pgid":"4.1b","version":"0'0","reported_seq":8,"reported_epoch":17,"state":"active+clean","last_fresh":"2023-08-01T19:54:04.474971+0000","last_change":"2023-08-01T19:54:04.474971+0000","last_active":"2023-08-01T19:54:04.474971+0000","last_peered":"2023-08-01T19:54:04.474971+0000","last_clean":"2023-08-01T19:54:04.474971+0000","last_became_active":"2023-08-01T19:54:04.473957+0000","last_became_peered":"2023-08-01T19:54:04.473957+0000","last_unstale":"2023-08-01T19:54:04.474971+0000","last_undegraded":"2023-08-01T19:54:04.474971+0000","last_fullsized":"2023-08-01T19:54:04.474971+0000","mapping_epoch":16,"log_start":"0'0","ondisk_log_start":"0'0","created":16,"last_epoch_clean":17,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-08-01T19:54:04.040663+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-08-01T19:54:04.040663+0000","last_clean_scrub_stamp":"2023-08-01T19:54:04.040663+0000","objects_scrubbed":0,"log_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-08-02T21:59:19.682560+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[1,0],"acting":[1,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":1,"acting_primary":1,"purged_snaps":[]},{"pgid":"3.1d","version":"17'2","reported_seq":12,"reported_epoch":17,"state":"active+clean","last_fresh":"2023-08-01T19:54:04.471623+0000","last_change":"2023-08-01T19:54:04.065591+0000","last_active":"2023-08-01T19:54:04.471623+0000","last_peered":"2023-08-01T19:54:04.471623+0000","last_clean":"2023-08-01T19:54:04.471623+0000","last_became_active":"2023-08-01T19:54:04.065306+0000","last_became_peered":"2023-08-01T19:54:04.065306+0000","last_unstale":"2023-08-01T19:54:04.471623+0000","last_undegraded":"2023-08-01T19:54:04.471623+0000","last_fullsized":"2023-08-01T19:54:04.471623+0000","mapping_epoch":15,"log_start":"0'0","ondisk_log_start":"0'0","created":15,"last_epoch_clean":16,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-08-01T19:54:03.032665+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-08-01T19:54:03.032665+0000","last_clean_scrub_stamp":"2023-08-01T19:54:03.032665+0000","objects_scrubbed":0,"log_size":2,"ondisk_log_size":2,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-08-02T21:32:10.389227+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":1,"num_object_clones":0,"num_object_copies":2,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":1,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":3,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":1,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[2,1],"acting":[2,1],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":2,"acting_primary":2,"purged_snaps":[]},{"pgid":"4.1a","version":"0'0","reported_seq":8,"reported_epoch":17,"state":"active+clean","last_fresh":"2023-08-01T19:54:04.473302+0000","last_change":"2023-08-01T19:54:04.473302+0000","last_active":"2023-08-01T19:54:04.473302+0000","last_peered":"2023-08-01T19:54:04.473302+0000","last_clean":"2023-08-01T19:54:04.473302+0000","last_became_active":"2023-08-01T19:54:04.472452+0000","last_became_peered":"2023-08-01T19:54:04.472452+0000","last_unstale":"2023-08-01T19:54:04.473302+0000","last_undegraded":"2023-08-01T19:54:04.473302+0000","last_fullsized":"2023-08-01T19:54:04.473302+0000","mapping_epoch":16,"log_start":"0'0","ondisk_log_start":"0'0","created":16,"last_epoch_clean":17,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-08-01T19:54:04.040663+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-08-01T19:54:04.040663+0000","last_clean_scrub_stamp":"2023-08-01T19:54:04.040663+0000","objects_scrubbed":0,"log_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-08-02T21:02:39.542019+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[1,0],"acting":[1,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":1,"acting_primary":1,"purged_snaps":[]},{"pgid":"3.1e","version":"17'1","reported_seq":10,"reported_epoch":17,"state":"active+clean","last_fresh":"2023-08-01T19:54:04.460743+0000","last_change":"2023-08-01T19:54:04.064378+0000","last_active":"2023-08-01T19:54:04.460743+0000","last_peered":"2023-08-01T19:54:04.460743+0000","last_clean":"2023-08-01T19:54:04.460743+0000","last_became_active":"2023-08-01T19:54:04.063988+0000","last_became_peered":"2023-08-01T19:54:04.063988+0000","last_unstale":"2023-08-01T19:54:04.460743+0000","last_undegraded":"2023-08-01T19:54:04.460743+0000","last_fullsized":"2023-08-01T19:54:04.460743+0000","mapping_epoch":15,"log_start":"0'0","ondisk_log_start":"0'0","created":15,"last_epoch_clean":16,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-08-01T19:54:03.032665+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-08-01T19:54:03.032665+0000","last_clean_scrub_stamp":"2023-08-01T19:54:03.032665+0000","objects_scrubbed":0,"log_size":1,"ondisk_log_size":1,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-08-02T22:28:51.936138+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[0,2],"acting":[0,2],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":0,"acting_primary":0,"purged_snaps":[]},{"pgid":"4.19","version":"0'0","reported_seq":9,"reported_epoch":17,"state":"active+clean","last_fresh":"2023-08-01T19:54:04.469620+0000","last_change":"2023-08-01T19:54:04.467017+0000","last_active":"2023-08-01T19:54:04.469620+0000","last_peered":"2023-08-01T19:54:04.469620+0000","last_clean":"2023-08-01T19:54:04.469620+0000","last_became_active":"2023-08-01T19:54:04.466339+0000","last_became_peered":"2023-08-01T19:54:04.466339+0000","last_unstale":"2023-08-01T19:54:04.469620+0000","last_undegraded":"2023-08-01T19:54:04.469620+0000","last_fullsized":"2023-08-01T19:54:04.469620+0000","mapping_epoch":16,"log_start":"0'0","ondisk_log_start":"0'0","created":16,"last_epoch_clean":17,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-08-01T19:54:04.040663+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-08-01T19:54:04.040663+0000","last_clean_scrub_stamp":"2023-08-01T19:54:04.040663+0000","objects_scrubbed":0,"log_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-08-03T04:07:57.222873+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[2,0],"acting":[2,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":2,"acting_primary":2,"purged_snaps":[]},{"pgid":"3.1f","version":"17'4","reported_seq":13,"reported_epoch":17,"state":"active+clean","last_fresh":"2023-08-01T19:54:04.472208+0000","last_change":"2023-08-01T19:54:04.067767+0000","last_active":"2023-08-01T19:54:04.472208+0000","last_peered":"2023-08-01T19:54:04.472208+0000","last_clean":"2023-08-01T19:54:04.472208+0000","last_became_active":"2023-08-01T19:54:04.067414+0000","last_became_peered":"2023-08-01T19:54:04.067414+0000","last_unstale":"2023-08-01T19:54:04.472208+0000","last_undegraded":"2023-08-01T19:54:04.472208+0000","last_fullsized":"2023-08-01T19:54:04.472208+0000","mapping_epoch":15,"log_start":"0'0","ondisk_log_start":"0'0","created":15,"last_epoch_clean":16,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-08-01T19:54:03.032665+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-08-01T19:54:03.032665+0000","last_clean_scrub_stamp":"2023-08-01T19:54:03.032665+0000","objects_scrubbed":0,"log_size":4,"ondisk_log_size":4,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-08-02T21:33:27.007118+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":554,"num_objects":2,"num_object_clones":0,"num_object_copies":4,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":2,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":4,"num_write_kb":1,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":1,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[0,1],"acting":[0,1],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":0,"acting_primary":0,"purged_snaps":[]},{"pgid":"4.18","version":"0'0","reported_seq":8,"reported_epoch":17,"state":"active+clean","last_fresh":"2023-08-01T19:54:04.477588+0000","last_change":"2023-08-01T19:54:04.477588+0000","last_active":"2023-08-01T19:54:04.477588+0000","last_peered":"2023-08-01T19:54:04.477588+0000","last_clean":"2023-08-01T19:54:04.477588+0000","last_became_active":"2023-08-01T19:54:04.476194+0000","last_became_peered":"2023-08-01T19:54:04.476194+0000","last_unstale":"2023-08-01T19:54:04.477588+0000","last_undegraded":"2023-08-01T19:54:04.477588+0000","last_fullsized":"2023-08-01T19:54:04.477588+0000","mapping_epoch":16,"log_start":"0'0","ondisk_log_start":"0'0","created":16,"last_epoch_clean":17,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-08-01T19:54:04.040663+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-08-01T19:54:04.040663+0000","last_clean_scrub_stamp":"2023-08-01T19:54:04.040663+0000","objects_scrubbed":0,"log_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-08-03T03:58:06.360840+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[1,0],"acting":[1,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":1,"acting_primary":1,"purged_snaps":[]},{"pgid":"4.20","version":"0'0","reported_seq":8,"reported_epoch":17,"state":"active+clean","last_fresh":"2023-08-01T19:54:04.477904+0000","last_change":"2023-08-01T19:54:04.477904+0000","last_active":"2023-08-01T19:54:04.477904+0000","last_peered":"2023-08-01T19:54:04.477904+0000","last_clean":"2023-08-01T19:54:04.477904+0000","last_became_active":"2023-08-01T19:54:04.476564+0000","last_became_peered":"2023-08-01T19:54:04.476564+0000","last_unstale":"2023-08-01T19:54:04.477904+0000","last_undegraded":"2023-08-01T19:54:04.477904+0000","last_fullsized":"2023-08-01T19:54:04.477904+0000","mapping_epoch":16,"log_start":"0'0","ondisk_log_start":"0'0","created":16,"last_epoch_clean":17,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-08-01T19:54:04.040663+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-08-01T19:54:04.040663+0000","last_clean_scrub_stamp":"2023-08-01T19:54:04.040663+0000","objects_scrubbed":0,"log_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-08-03T02:21:47.656072+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[1,0],"acting":[1,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":1,"acting_primary":1,"purged_snaps":[]},{"pgid":"4.21","version":"0'0","reported_seq":8,"reported_epoch":17,"state":"active+clean","last_fresh":"2023-08-01T19:54:04.466899+0000","last_change":"2023-08-01T19:54:04.466899+0000","last_active":"2023-08-01T19:54:04.466899+0000","last_peered":"2023-08-01T19:54:04.466899+0000","last_clean":"2023-08-01T19:54:04.466899+0000","last_became_active":"2023-08-01T19:54:04.466500+0000","last_became_peered":"2023-08-01T19:54:04.466500+0000","last_unstale":"2023-08-01T19:54:04.466899+0000","last_undegraded":"2023-08-01T19:54:04.466899+0000","last_fullsized":"2023-08-01T19:54:04.466899+0000","mapping_epoch":16,"log_start":"0'0","ondisk_log_start":"0'0","created":16,"last_epoch_clean":17,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-08-01T19:54:04.040663+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-08-01T19:54:04.040663+0000","last_clean_scrub_stamp":"2023-08-01T19:54:04.040663+0000","objects_scrubbed":0,"log_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-08-03T07:36:38.654701+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[0,2],"acting":[0,2],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":0,"acting_primary":0,"purged_snaps":[]},{"pgid":"4.22","version":"0'0","reported_seq":9,"reported_epoch":17,"state":"active+clean","last_fresh":"2023-08-01T19:54:04.473914+0000","last_change":"2023-08-01T19:54:04.471945+0000","last_active":"2023-08-01T19:54:04.473914+0000","last_peered":"2023-08-01T19:54:04.473914+0000","last_clean":"2023-08-01T19:54:04.473914+0000","last_became_active":"2023-08-01T19:54:04.471371+0000","last_became_peered":"2023-08-01T19:54:04.471371+0000","last_unstale":"2023-08-01T19:54:04.473914+0000","last_undegraded":"2023-08-01T19:54:04.473914+0000","last_fullsized":"2023-08-01T19:54:04.473914+0000","mapping_epoch":16,"log_start":"0'0","ondisk_log_start":"0'0","created":16,"last_epoch_clean":17,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-08-01T19:54:04.040663+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-08-01T19:54:04.040663+0000","last_clean_scrub_stamp":"2023-08-01T19:54:04.040663+0000","objects_scrubbed":0,"log_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-08-02T22:17:59.847819+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[2,1],"acting":[2,1],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":2,"acting_primary":2,"purged_snaps":[]},{"pgid":"4.23","version":"0'0","reported_seq":8,"reported_epoch":17,"state":"active+clean","last_fresh":"2023-08-01T19:54:04.467847+0000","last_change":"2023-08-01T19:54:04.467847+0000","last_active":"2023-08-01T19:54:04.467847+0000","last_peered":"2023-08-01T19:54:04.467847+0000","last_clean":"2023-08-01T19:54:04.467847+0000","last_became_active":"2023-08-01T19:54:04.467111+0000","last_became_peered":"2023-08-01T19:54:04.467111+0000","last_unstale":"2023-08-01T19:54:04.467847+0000","last_undegraded":"2023-08-01T19:54:04.467847+0000","last_fullsized":"2023-08-01T19:54:04.467847+0000","mapping_epoch":16,"log_start":"0'0","ondisk_log_start":"0'0","created":16,"last_epoch_clean":17,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-08-01T19:54:04.040663+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-08-01T19:54:04.040663+0000","last_clean_scrub_stamp":"2023-08-01T19:54:04.040663+0000","objects_scrubbed":0,"log_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-08-03T00:42:19.379348+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[0,2],"acting":[0,2],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":0,"acting_primary":0,"purged_snaps":[]},{"pgid":"4.24","version":"0'0","reported_seq":9,"reported_epoch":17,"state":"active+clean","last_fresh":"2023-08-01T19:54:04.482540+0000","last_change":"2023-08-01T19:54:04.477128+0000","last_active":"2023-08-01T19:54:04.482540+0000","last_peered":"2023-08-01T19:54:04.482540+0000","last_clean":"2023-08-01T19:54:04.482540+0000","last_became_active":"2023-08-01T19:54:04.476819+0000","last_became_peered":"2023-08-01T19:54:04.476819+0000","last_unstale":"2023-08-01T19:54:04.482540+0000","last_undegraded":"2023-08-01T19:54:04.482540+0000","last_fullsized":"2023-08-01T19:54:04.482540+0000","mapping_epoch":16,"log_start":"0'0","ondisk_log_start":"0'0","created":16,"last_epoch_clean":17,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-08-01T19:54:04.040663+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-08-01T19:54:04.040663+0000","last_clean_scrub_stamp":"2023-08-01T19:54:04.040663+0000","objects_scrubbed":0,"log_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-08-03T02:20:23.354054+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[2,1],"acting":[2,1],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":2,"acting_primary":2,"purged_snaps":[]}],"pool_stats":[{"poolid":4,"num_pg":64,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"store_stats":{"total":0,"available":0,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},"log_size":0,"ondisk_log_size":0,"up":128,"acting":128,"num_store_stats":3},{"poolid":3,"num_pg":32,"stat_sum":{"num_bytes":2306,"num_objects":21,"num_object_clones":0,"num_object_copies":42,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":21,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":44,"num_write_kb":13,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":13,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"store_stats":{"total":0,"available":0,"internally_reserved":0,"allocated":65536,"data_stored":4612,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},"log_size":38,"ondisk_log_size":38,"up":64,"acting":64,"num_store_stats":3},{"poolid":1,"num_pg":1,"stat_sum":{"num_bytes":590368,"num_objects":2,"num_object_clones":0,"num_object_copies":4,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":2,"num_whiteouts":0,"num_read":136,"num_read_kb":118,"num_write":203,"num_write_kb":3460,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"store_stats":{"total":0,"available":0,"internally_reserved":0,"allocated":114688,"data_stored":1180736,"data_compressed":20662,"data_compressed_allocated":73728,"data_compressed_original":1146880,"omap_allocated":0,"internal_metadata":0},"log_size":157,"ondisk_log_size":157,"up":2,"acting":2,"num_store_stats":2},{"poolid":2,"num_pg":8,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"store_stats":{"total":0,"available":0,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},"log_size":0,"ondisk_log_size":0,"up":16,"acting":16,"num_store_stats":3}],"osd_stats":[{"osd":2,"up_from":9,"seq":38654705670,"num_pgs":67,"num_osds":1,"num_per_pool_osds":1,"num_per_pool_omap_osds":1,"kb":94371840,"kb_used":9256,"kb_used_data":224,"kb_used_omap":0,"kb_used_meta":9024,"kb_avail":94362584,"statfs":{"total":96636764160,"available":96627286016,"internally_reserved":0,"allocated":229376,"data_stored":642640,"data_compressed":10331,"data_compressed_allocated":36864,"data_compressed_original":573440,"omap_allocated":0,"internal_metadata":9240576},"hb_peers":[0,1],"snap_trim_queue_len":0,"num_snap_trimming":0,"num_shards_repaired":0,"op_queue_age_hist":{"histogram":[],"upper_bound":1},"perf_stat":{"commit_latency_ms":2,"apply_latency_ms":2,"commit_latency_ns":2000000,"apply_latency_ns":2000000},"alerts":[],"network_ping_times":[{"osd":0,"last update":"Thu Jan 1 00:00:00 1970","interfaces":[{"interface":"back","average":{"1min":0,"5min":0,"15min":0},"min":{"1min":0,"5min":0,"15min":0},"max":{"1min":0,"5min":0,"15min":0},"last":0.46899999999999997}]},{"osd":1,"last update":"Thu Jan 1 00:00:00 1970","interfaces":[{"interface":"back","average":{"1min":0,"5min":0,"15min":0},"min":{"1min":0,"5min":0,"15min":0},"max":{"1min":0,"5min":0,"15min":0},"last":0.52400000000000002}]}]},{"osd":0,"up_from":8,"seq":34359738373,"num_pgs":18,"num_osds":1,"num_per_pool_osds":1,"num_per_pool_omap_osds":1,"kb":94371840,"kb_used":12296,"kb_used_data":128,"kb_used_omap":0,"kb_used_meta":12160,"kb_avail":94359544,"statfs":{"total":96636764160,"available":96624173056,"internally_reserved":0,"allocated":131072,"data_stored":41002,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":12451840},"hb_peers":[1,2],"snap_trim_queue_len":0,"num_snap_trimming":0,"num_shards_repaired":0,"op_queue_age_hist":{"histogram":[],"upper_bound":1},"perf_stat":{"commit_latency_ms":2,"apply_latency_ms":2,"commit_latency_ns":2000000,"apply_latency_ns":2000000},"alerts":[],"network_ping_times":[{"osd":1,"last update":"Thu Jan 1 00:00:00 1970","interfaces":[{"interface":"back","average":{"1min":0,"5min":0,"15min":0},"min":{"1min":0,"5min":0,"15min":0},"max":{"1min":0,"5min":0,"15min":0},"last":0.46899999999999997}]},{"osd":2,"last update":"Thu Jan 1 00:00:00 1970","interfaces":[{"interface":"back","average":{"1min":0,"5min":0,"15min":0},"min":{"1min":0,"5min":0,"15min":0},"max":{"1min":0,"5min":0,"15min":0},"last":0.55800000000000005}]}]},{"osd":1,"up_from":8,"seq":34359738372,"num_pgs":52,"num_osds":1,"num_per_pool_osds":1,"num_per_pool_omap_osds":1,"kb":94371840,"kb_used":9328,"kb_used_data":232,"kb_used_omap":0,"kb_used_meta":9088,"kb_avail":94362512,"statfs":{"total":96636764160,"available":96627212288,"internally_reserved":0,"allocated":237568,"data_stored":643228,"data_compressed":10331,"data_compressed_allocated":36864,"data_compressed_original":573440,"omap_allocated":0,"internal_metadata":9306112},"hb_peers":[0,2],"snap_trim_queue_len":0,"num_snap_trimming":0,"num_shards_repaired":0,"op_queue_age_hist":{"histogram":[],"upper_bound":1},"perf_stat":{"commit_latency_ms":3,"apply_latency_ms":3,"commit_latency_ns":3000000,"apply_latency_ns":3000000},"alerts":[],"network_ping_times":[{"osd":0,"last update":"Thu Jan 1 00:00:00 1970","interfaces":[{"interface":"back","average":{"1min":0,"5min":0,"15min":0},"min":{"1min":0,"5min":0,"15min":0},"max":{"1min":0,"5min":0,"15min":0},"last":0.39500000000000002}]},{"osd":2,"last update":"Thu Jan 1 00:00:00 1970","interfaces":[{"interface":"back","average":{"1min":0,"5min":0,"15min":0},"min":{"1min":0,"5min":0,"15min":0},"max":{"1min":0,"5min":0,"15min":0},"last":0.57399999999999995}]}]}],"pool_statfs":[{"poolid":1,"osd":1,"total":0,"available":0,"internally_reserved":0,"allocated":57344,"data_stored":590368,"data_compressed":10331,"data_compressed_allocated":36864,"data_compressed_original":573440,"omap_allocated":0,"internal_metadata":0},{"poolid":1,"osd":2,"total":0,"available":0,"internally_reserved":0,"allocated":57344,"data_stored":590368,"data_compressed":10331,"data_compressed_allocated":36864,"data_compressed_original":573440,"omap_allocated":0,"internal_metadata":0},{"poolid":2,"osd":0,"total":0,"available":0,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":2,"osd":1,"total":0,"available":0,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":2,"osd":2,"total":0,"available":0,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":3,"osd":0,"total":0,"available":0,"internally_reserved":0,"allocated":8192,"data_stored":588,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":3,"osd":1,"total":0,"available":0,"internally_reserved":0,"allocated":32768,"data_stored":2306,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":3,"osd":2,"total":0,"available":0,"internally_reserved":0,"allocated":24576,"data_stored":1718,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":4,"osd":0,"total":0,"available":0,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":4,"osd":1,"total":0,"available":0,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":4,"osd":2,"total":0,"available":0,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0}]}} 2023-08-01T19:54:08.572 DEBUG:teuthology.orchestra.run.smithi006:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 120 ceph --cluster ceph pg dump --format=json 2023-08-01T19:54:08.931 INFO:teuthology.orchestra.run.smithi006.stdout: 2023-08-01T19:54:08.932 INFO:teuthology.orchestra.run.smithi006.stderr:dumped all 2023-08-01T19:54:08.943 INFO:teuthology.orchestra.run.smithi006.stdout:{"pg_ready":true,"pg_map":{"version":24,"stamp":"2023-08-01T19:54:07.908558+0000","last_osdmap_epoch":0,"last_pg_scan":0,"pg_stats_sum":{"stat_sum":{"num_bytes":592674,"num_objects":23,"num_object_clones":0,"num_object_copies":46,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":23,"num_whiteouts":0,"num_read":136,"num_read_kb":118,"num_write":247,"num_write_kb":3473,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":13,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"store_stats":{"total":0,"available":0,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},"log_size":195,"ondisk_log_size":195,"up":210,"acting":210,"num_store_stats":0},"osd_stats_sum":{"up_from":0,"seq":0,"num_pgs":137,"num_osds":3,"num_per_pool_osds":3,"num_per_pool_omap_osds":3,"kb":283115520,"kb_used":30880,"kb_used_data":584,"kb_used_omap":0,"kb_used_meta":30272,"kb_avail":283084640,"statfs":{"total":289910292480,"available":289878671360,"internally_reserved":0,"allocated":598016,"data_stored":1326870,"data_compressed":20662,"data_compressed_allocated":73728,"data_compressed_original":1146880,"omap_allocated":0,"internal_metadata":30998528},"hb_peers":[],"snap_trim_queue_len":0,"num_snap_trimming":0,"num_shards_repaired":0,"op_queue_age_hist":{"histogram":[],"upper_bound":1},"perf_stat":{"commit_latency_ms":7,"apply_latency_ms":7,"commit_latency_ns":7000000,"apply_latency_ns":7000000},"alerts":[],"network_ping_times":[]},"pg_stats_delta":{"stat_sum":{"num_bytes":2306,"num_objects":21,"num_object_clones":0,"num_object_copies":42,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":21,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":44,"num_write_kb":13,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":13,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"store_stats":{"total":0,"available":0,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},"log_size":0,"ondisk_log_size":0,"up":0,"acting":0,"num_store_stats":0,"stamp_delta":"4.867751"},"pg_stats":[{"pgid":"4.3f","version":"0'0","reported_seq":9,"reported_epoch":17,"state":"active+clean","last_fresh":"2023-08-01T19:54:04.477207+0000","last_change":"2023-08-01T19:54:04.473430+0000","last_active":"2023-08-01T19:54:04.477207+0000","last_peered":"2023-08-01T19:54:04.477207+0000","last_clean":"2023-08-01T19:54:04.477207+0000","last_became_active":"2023-08-01T19:54:04.472887+0000","last_became_peered":"2023-08-01T19:54:04.472887+0000","last_unstale":"2023-08-01T19:54:04.477207+0000","last_undegraded":"2023-08-01T19:54:04.477207+0000","last_fullsized":"2023-08-01T19:54:04.477207+0000","mapping_epoch":16,"log_start":"0'0","ondisk_log_start":"0'0","created":16,"last_epoch_clean":17,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-08-01T19:54:04.040663+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-08-01T19:54:04.040663+0000","last_clean_scrub_stamp":"2023-08-01T19:54:04.040663+0000","objects_scrubbed":0,"log_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-08-03T06:38:54.196605+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[2,0],"acting":[2,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":2,"acting_primary":2,"purged_snaps":[]},{"pgid":"4.3e","version":"0'0","reported_seq":9,"reported_epoch":17,"state":"active+clean","last_fresh":"2023-08-01T19:54:04.472547+0000","last_change":"2023-08-01T19:54:04.470501+0000","last_active":"2023-08-01T19:54:04.472547+0000","last_peered":"2023-08-01T19:54:04.472547+0000","last_clean":"2023-08-01T19:54:04.472547+0000","last_became_active":"2023-08-01T19:54:04.469692+0000","last_became_peered":"2023-08-01T19:54:04.469692+0000","last_unstale":"2023-08-01T19:54:04.472547+0000","last_undegraded":"2023-08-01T19:54:04.472547+0000","last_fullsized":"2023-08-01T19:54:04.472547+0000","mapping_epoch":16,"log_start":"0'0","ondisk_log_start":"0'0","created":16,"last_epoch_clean":17,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-08-01T19:54:04.040663+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-08-01T19:54:04.040663+0000","last_clean_scrub_stamp":"2023-08-01T19:54:04.040663+0000","objects_scrubbed":0,"log_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-08-03T02:19:35.201107+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[2,0],"acting":[2,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":2,"acting_primary":2,"purged_snaps":[]},{"pgid":"4.3d","version":"0'0","reported_seq":8,"reported_epoch":17,"state":"active+clean","last_fresh":"2023-08-01T19:54:04.472579+0000","last_change":"2023-08-01T19:54:04.472579+0000","last_active":"2023-08-01T19:54:04.472579+0000","last_peered":"2023-08-01T19:54:04.472579+0000","last_clean":"2023-08-01T19:54:04.472579+0000","last_became_active":"2023-08-01T19:54:04.471128+0000","last_became_peered":"2023-08-01T19:54:04.471128+0000","last_unstale":"2023-08-01T19:54:04.472579+0000","last_undegraded":"2023-08-01T19:54:04.472579+0000","last_fullsized":"2023-08-01T19:54:04.472579+0000","mapping_epoch":16,"log_start":"0'0","ondisk_log_start":"0'0","created":16,"last_epoch_clean":17,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-08-01T19:54:04.040663+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-08-01T19:54:04.040663+0000","last_clean_scrub_stamp":"2023-08-01T19:54:04.040663+0000","objects_scrubbed":0,"log_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-08-03T03:04:06.137335+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[1,2],"acting":[1,2],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":1,"acting_primary":1,"purged_snaps":[]},{"pgid":"4.3c","version":"0'0","reported_seq":8,"reported_epoch":17,"state":"active+clean","last_fresh":"2023-08-01T19:54:04.477908+0000","last_change":"2023-08-01T19:54:04.477908+0000","last_active":"2023-08-01T19:54:04.477908+0000","last_peered":"2023-08-01T19:54:04.477908+0000","last_clean":"2023-08-01T19:54:04.477908+0000","last_became_active":"2023-08-01T19:54:04.476684+0000","last_became_peered":"2023-08-01T19:54:04.476684+0000","last_unstale":"2023-08-01T19:54:04.477908+0000","last_undegraded":"2023-08-01T19:54:04.477908+0000","last_fullsized":"2023-08-01T19:54:04.477908+0000","mapping_epoch":16,"log_start":"0'0","ondisk_log_start":"0'0","created":16,"last_epoch_clean":17,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-08-01T19:54:04.040663+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-08-01T19:54:04.040663+0000","last_clean_scrub_stamp":"2023-08-01T19:54:04.040663+0000","objects_scrubbed":0,"log_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-08-03T03:56:55.336461+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[1,0],"acting":[1,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":1,"acting_primary":1,"purged_snaps":[]},{"pgid":"4.3b","version":"0'0","reported_seq":9,"reported_epoch":17,"state":"active+clean","last_fresh":"2023-08-01T19:54:04.469848+0000","last_change":"2023-08-01T19:54:04.467197+0000","last_active":"2023-08-01T19:54:04.469848+0000","last_peered":"2023-08-01T19:54:04.469848+0000","last_clean":"2023-08-01T19:54:04.469848+0000","last_became_active":"2023-08-01T19:54:04.466526+0000","last_became_peered":"2023-08-01T19:54:04.466526+0000","last_unstale":"2023-08-01T19:54:04.469848+0000","last_undegraded":"2023-08-01T19:54:04.469848+0000","last_fullsized":"2023-08-01T19:54:04.469848+0000","mapping_epoch":16,"log_start":"0'0","ondisk_log_start":"0'0","created":16,"last_epoch_clean":17,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-08-01T19:54:04.040663+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-08-01T19:54:04.040663+0000","last_clean_scrub_stamp":"2023-08-01T19:54:04.040663+0000","objects_scrubbed":0,"log_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-08-03T06:54:18.982174+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[2,0],"acting":[2,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":2,"acting_primary":2,"purged_snaps":[]},{"pgid":"4.3a","version":"0'0","reported_seq":8,"reported_epoch":17,"state":"active+clean","last_fresh":"2023-08-01T19:54:04.473296+0000","last_change":"2023-08-01T19:54:04.473296+0000","last_active":"2023-08-01T19:54:04.473296+0000","last_peered":"2023-08-01T19:54:04.473296+0000","last_clean":"2023-08-01T19:54:04.473296+0000","last_became_active":"2023-08-01T19:54:04.472324+0000","last_became_peered":"2023-08-01T19:54:04.472324+0000","last_unstale":"2023-08-01T19:54:04.473296+0000","last_undegraded":"2023-08-01T19:54:04.473296+0000","last_fullsized":"2023-08-01T19:54:04.473296+0000","mapping_epoch":16,"log_start":"0'0","ondisk_log_start":"0'0","created":16,"last_epoch_clean":17,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-08-01T19:54:04.040663+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-08-01T19:54:04.040663+0000","last_clean_scrub_stamp":"2023-08-01T19:54:04.040663+0000","objects_scrubbed":0,"log_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-08-02T23:15:11.148662+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[1,0],"acting":[1,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":1,"acting_primary":1,"purged_snaps":[]},{"pgid":"4.39","version":"0'0","reported_seq":8,"reported_epoch":17,"state":"active+clean","last_fresh":"2023-08-01T19:54:04.475322+0000","last_change":"2023-08-01T19:54:04.475322+0000","last_active":"2023-08-01T19:54:04.475322+0000","last_peered":"2023-08-01T19:54:04.475322+0000","last_clean":"2023-08-01T19:54:04.475322+0000","last_became_active":"2023-08-01T19:54:04.474591+0000","last_became_peered":"2023-08-01T19:54:04.474591+0000","last_unstale":"2023-08-01T19:54:04.475322+0000","last_undegraded":"2023-08-01T19:54:04.475322+0000","last_fullsized":"2023-08-01T19:54:04.475322+0000","mapping_epoch":16,"log_start":"0'0","ondisk_log_start":"0'0","created":16,"last_epoch_clean":17,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-08-01T19:54:04.040663+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-08-01T19:54:04.040663+0000","last_clean_scrub_stamp":"2023-08-01T19:54:04.040663+0000","objects_scrubbed":0,"log_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-08-03T00:29:53.554989+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[1,0],"acting":[1,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":1,"acting_primary":1,"purged_snaps":[]},{"pgid":"4.38","version":"0'0","reported_seq":8,"reported_epoch":17,"state":"active+clean","last_fresh":"2023-08-01T19:54:04.478505+0000","last_change":"2023-08-01T19:54:04.478505+0000","last_active":"2023-08-01T19:54:04.478505+0000","last_peered":"2023-08-01T19:54:04.478505+0000","last_clean":"2023-08-01T19:54:04.478505+0000","last_became_active":"2023-08-01T19:54:04.477325+0000","last_became_peered":"2023-08-01T19:54:04.477325+0000","last_unstale":"2023-08-01T19:54:04.478505+0000","last_undegraded":"2023-08-01T19:54:04.478505+0000","last_fullsized":"2023-08-01T19:54:04.478505+0000","mapping_epoch":16,"log_start":"0'0","ondisk_log_start":"0'0","created":16,"last_epoch_clean":17,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-08-01T19:54:04.040663+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-08-01T19:54:04.040663+0000","last_clean_scrub_stamp":"2023-08-01T19:54:04.040663+0000","objects_scrubbed":0,"log_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-08-03T01:38:12.939736+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[1,0],"acting":[1,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":1,"acting_primary":1,"purged_snaps":[]},{"pgid":"4.37","version":"0'0","reported_seq":8,"reported_epoch":17,"state":"active+clean","last_fresh":"2023-08-01T19:54:04.470971+0000","last_change":"2023-08-01T19:54:04.470971+0000","last_active":"2023-08-01T19:54:04.470971+0000","last_peered":"2023-08-01T19:54:04.470971+0000","last_clean":"2023-08-01T19:54:04.470971+0000","last_became_active":"2023-08-01T19:54:04.469011+0000","last_became_peered":"2023-08-01T19:54:04.469011+0000","last_unstale":"2023-08-01T19:54:04.470971+0000","last_undegraded":"2023-08-01T19:54:04.470971+0000","last_fullsized":"2023-08-01T19:54:04.470971+0000","mapping_epoch":16,"log_start":"0'0","ondisk_log_start":"0'0","created":16,"last_epoch_clean":17,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-08-01T19:54:04.040663+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-08-01T19:54:04.040663+0000","last_clean_scrub_stamp":"2023-08-01T19:54:04.040663+0000","objects_scrubbed":0,"log_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-08-03T06:50:03.420334+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[0,2],"acting":[0,2],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":0,"acting_primary":0,"purged_snaps":[]},{"pgid":"4.36","version":"0'0","reported_seq":9,"reported_epoch":17,"state":"active+clean","last_fresh":"2023-08-01T19:54:04.477220+0000","last_change":"2023-08-01T19:54:04.473523+0000","last_active":"2023-08-01T19:54:04.477220+0000","last_peered":"2023-08-01T19:54:04.477220+0000","last_clean":"2023-08-01T19:54:04.477220+0000","last_became_active":"2023-08-01T19:54:04.473084+0000","last_became_peered":"2023-08-01T19:54:04.473084+0000","last_unstale":"2023-08-01T19:54:04.477220+0000","last_undegraded":"2023-08-01T19:54:04.477220+0000","last_fullsized":"2023-08-01T19:54:04.477220+0000","mapping_epoch":16,"log_start":"0'0","ondisk_log_start":"0'0","created":16,"last_epoch_clean":17,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-08-01T19:54:04.040663+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-08-01T19:54:04.040663+0000","last_clean_scrub_stamp":"2023-08-01T19:54:04.040663+0000","objects_scrubbed":0,"log_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-08-03T04:28:59.042443+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[2,0],"acting":[2,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":2,"acting_primary":2,"purged_snaps":[]},{"pgid":"4.35","version":"0'0","reported_seq":8,"reported_epoch":17,"state":"active+clean","last_fresh":"2023-08-01T19:54:04.475816+0000","last_change":"2023-08-01T19:54:04.475816+0000","last_active":"2023-08-01T19:54:04.475816+0000","last_peered":"2023-08-01T19:54:04.475816+0000","last_clean":"2023-08-01T19:54:04.475816+0000","last_became_active":"2023-08-01T19:54:04.475061+0000","last_became_peered":"2023-08-01T19:54:04.475061+0000","last_unstale":"2023-08-01T19:54:04.475816+0000","last_undegraded":"2023-08-01T19:54:04.475816+0000","last_fullsized":"2023-08-01T19:54:04.475816+0000","mapping_epoch":16,"log_start":"0'0","ondisk_log_start":"0'0","created":16,"last_epoch_clean":17,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-08-01T19:54:04.040663+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-08-01T19:54:04.040663+0000","last_clean_scrub_stamp":"2023-08-01T19:54:04.040663+0000","objects_scrubbed":0,"log_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-08-02T22:07:41.305488+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[1,0],"acting":[1,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":1,"acting_primary":1,"purged_snaps":[]},{"pgid":"4.34","version":"0'0","reported_seq":9,"reported_epoch":17,"state":"active+clean","last_fresh":"2023-08-01T19:54:04.470323+0000","last_change":"2023-08-01T19:54:04.468009+0000","last_active":"2023-08-01T19:54:04.470323+0000","last_peered":"2023-08-01T19:54:04.470323+0000","last_clean":"2023-08-01T19:54:04.470323+0000","last_became_active":"2023-08-01T19:54:04.467568+0000","last_became_peered":"2023-08-01T19:54:04.467568+0000","last_unstale":"2023-08-01T19:54:04.470323+0000","last_undegraded":"2023-08-01T19:54:04.470323+0000","last_fullsized":"2023-08-01T19:54:04.470323+0000","mapping_epoch":16,"log_start":"0'0","ondisk_log_start":"0'0","created":16,"last_epoch_clean":17,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-08-01T19:54:04.040663+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-08-01T19:54:04.040663+0000","last_clean_scrub_stamp":"2023-08-01T19:54:04.040663+0000","objects_scrubbed":0,"log_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-08-03T04:53:44.017572+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[2,1],"acting":[2,1],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":2,"acting_primary":2,"purged_snaps":[]},{"pgid":"4.33","version":"0'0","reported_seq":9,"reported_epoch":17,"state":"active+clean","last_fresh":"2023-08-01T19:54:04.468611+0000","last_change":"2023-08-01T19:54:04.466770+0000","last_active":"2023-08-01T19:54:04.468611+0000","last_peered":"2023-08-01T19:54:04.468611+0000","last_clean":"2023-08-01T19:54:04.468611+0000","last_became_active":"2023-08-01T19:54:04.466460+0000","last_became_peered":"2023-08-01T19:54:04.466460+0000","last_unstale":"2023-08-01T19:54:04.468611+0000","last_undegraded":"2023-08-01T19:54:04.468611+0000","last_fullsized":"2023-08-01T19:54:04.468611+0000","mapping_epoch":16,"log_start":"0'0","ondisk_log_start":"0'0","created":16,"last_epoch_clean":17,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-08-01T19:54:04.040663+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-08-01T19:54:04.040663+0000","last_clean_scrub_stamp":"2023-08-01T19:54:04.040663+0000","objects_scrubbed":0,"log_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-08-03T06:04:11.595951+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[2,0],"acting":[2,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":2,"acting_primary":2,"purged_snaps":[]},{"pgid":"4.32","version":"0'0","reported_seq":8,"reported_epoch":17,"state":"active+clean","last_fresh":"2023-08-01T19:54:04.466634+0000","last_change":"2023-08-01T19:54:04.466634+0000","last_active":"2023-08-01T19:54:04.466634+0000","last_peered":"2023-08-01T19:54:04.466634+0000","last_clean":"2023-08-01T19:54:04.466634+0000","last_became_active":"2023-08-01T19:54:04.466302+0000","last_became_peered":"2023-08-01T19:54:04.466302+0000","last_unstale":"2023-08-01T19:54:04.466634+0000","last_undegraded":"2023-08-01T19:54:04.466634+0000","last_fullsized":"2023-08-01T19:54:04.466634+0000","mapping_epoch":16,"log_start":"0'0","ondisk_log_start":"0'0","created":16,"last_epoch_clean":17,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-08-01T19:54:04.040663+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-08-01T19:54:04.040663+0000","last_clean_scrub_stamp":"2023-08-01T19:54:04.040663+0000","objects_scrubbed":0,"log_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-08-03T05:46:11.085577+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[1,2],"acting":[1,2],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":1,"acting_primary":1,"purged_snaps":[]},{"pgid":"4.31","version":"0'0","reported_seq":8,"reported_epoch":17,"state":"active+clean","last_fresh":"2023-08-01T19:54:04.472407+0000","last_change":"2023-08-01T19:54:04.472407+0000","last_active":"2023-08-01T19:54:04.472407+0000","last_peered":"2023-08-01T19:54:04.472407+0000","last_clean":"2023-08-01T19:54:04.472407+0000","last_became_active":"2023-08-01T19:54:04.472008+0000","last_became_peered":"2023-08-01T19:54:04.472008+0000","last_unstale":"2023-08-01T19:54:04.472407+0000","last_undegraded":"2023-08-01T19:54:04.472407+0000","last_fullsized":"2023-08-01T19:54:04.472407+0000","mapping_epoch":16,"log_start":"0'0","ondisk_log_start":"0'0","created":16,"last_epoch_clean":17,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-08-01T19:54:04.040663+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-08-01T19:54:04.040663+0000","last_clean_scrub_stamp":"2023-08-01T19:54:04.040663+0000","objects_scrubbed":0,"log_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-08-02T22:42:25.293502+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[1,2],"acting":[1,2],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":1,"acting_primary":1,"purged_snaps":[]},{"pgid":"4.30","version":"0'0","reported_seq":8,"reported_epoch":17,"state":"active+clean","last_fresh":"2023-08-01T19:54:04.478283+0000","last_change":"2023-08-01T19:54:04.478283+0000","last_active":"2023-08-01T19:54:04.478283+0000","last_peered":"2023-08-01T19:54:04.478283+0000","last_clean":"2023-08-01T19:54:04.478283+0000","last_became_active":"2023-08-01T19:54:04.476620+0000","last_became_peered":"2023-08-01T19:54:04.476620+0000","last_unstale":"2023-08-01T19:54:04.478283+0000","last_undegraded":"2023-08-01T19:54:04.478283+0000","last_fullsized":"2023-08-01T19:54:04.478283+0000","mapping_epoch":16,"log_start":"0'0","ondisk_log_start":"0'0","created":16,"last_epoch_clean":17,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-08-01T19:54:04.040663+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-08-01T19:54:04.040663+0000","last_clean_scrub_stamp":"2023-08-01T19:54:04.040663+0000","objects_scrubbed":0,"log_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-08-03T02:27:17.063518+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[1,0],"acting":[1,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":1,"acting_primary":1,"purged_snaps":[]},{"pgid":"4.2f","version":"0'0","reported_seq":8,"reported_epoch":17,"state":"active+clean","last_fresh":"2023-08-01T19:54:04.470302+0000","last_change":"2023-08-01T19:54:04.470302+0000","last_active":"2023-08-01T19:54:04.470302+0000","last_peered":"2023-08-01T19:54:04.470302+0000","last_clean":"2023-08-01T19:54:04.470302+0000","last_became_active":"2023-08-01T19:54:04.468919+0000","last_became_peered":"2023-08-01T19:54:04.468919+0000","last_unstale":"2023-08-01T19:54:04.470302+0000","last_undegraded":"2023-08-01T19:54:04.470302+0000","last_fullsized":"2023-08-01T19:54:04.470302+0000","mapping_epoch":16,"log_start":"0'0","ondisk_log_start":"0'0","created":16,"last_epoch_clean":17,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-08-01T19:54:04.040663+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-08-01T19:54:04.040663+0000","last_clean_scrub_stamp":"2023-08-01T19:54:04.040663+0000","objects_scrubbed":0,"log_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-08-02T22:42:25.293502+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[0,2],"acting":[0,2],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":0,"acting_primary":0,"purged_snaps":[]},{"pgid":"4.2e","version":"0'0","reported_seq":9,"reported_epoch":17,"state":"active+clean","last_fresh":"2023-08-01T19:54:04.477303+0000","last_change":"2023-08-01T19:54:04.474058+0000","last_active":"2023-08-01T19:54:04.477303+0000","last_peered":"2023-08-01T19:54:04.477303+0000","last_clean":"2023-08-01T19:54:04.477303+0000","last_became_active":"2023-08-01T19:54:04.473355+0000","last_became_peered":"2023-08-01T19:54:04.473355+0000","last_unstale":"2023-08-01T19:54:04.477303+0000","last_undegraded":"2023-08-01T19:54:04.477303+0000","last_fullsized":"2023-08-01T19:54:04.477303+0000","mapping_epoch":16,"log_start":"0'0","ondisk_log_start":"0'0","created":16,"last_epoch_clean":17,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-08-01T19:54:04.040663+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-08-01T19:54:04.040663+0000","last_clean_scrub_stamp":"2023-08-01T19:54:04.040663+0000","objects_scrubbed":0,"log_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-08-03T04:55:54.197252+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[2,0],"acting":[2,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":2,"acting_primary":2,"purged_snaps":[]},{"pgid":"4.2d","version":"0'0","reported_seq":8,"reported_epoch":17,"state":"active+clean","last_fresh":"2023-08-01T19:54:04.468775+0000","last_change":"2023-08-01T19:54:04.468775+0000","last_active":"2023-08-01T19:54:04.468775+0000","last_peered":"2023-08-01T19:54:04.468775+0000","last_clean":"2023-08-01T19:54:04.468775+0000","last_became_active":"2023-08-01T19:54:04.467274+0000","last_became_peered":"2023-08-01T19:54:04.467274+0000","last_unstale":"2023-08-01T19:54:04.468775+0000","last_undegraded":"2023-08-01T19:54:04.468775+0000","last_fullsized":"2023-08-01T19:54:04.468775+0000","mapping_epoch":16,"log_start":"0'0","ondisk_log_start":"0'0","created":16,"last_epoch_clean":17,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-08-01T19:54:04.040663+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-08-01T19:54:04.040663+0000","last_clean_scrub_stamp":"2023-08-01T19:54:04.040663+0000","objects_scrubbed":0,"log_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-08-02T23:00:37.537286+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[0,2],"acting":[0,2],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":0,"acting_primary":0,"purged_snaps":[]},{"pgid":"4.2c","version":"0'0","reported_seq":8,"reported_epoch":17,"state":"active+clean","last_fresh":"2023-08-01T19:54:04.478409+0000","last_change":"2023-08-01T19:54:04.478409+0000","last_active":"2023-08-01T19:54:04.478409+0000","last_peered":"2023-08-01T19:54:04.478409+0000","last_clean":"2023-08-01T19:54:04.478409+0000","last_became_active":"2023-08-01T19:54:04.477133+0000","last_became_peered":"2023-08-01T19:54:04.477133+0000","last_unstale":"2023-08-01T19:54:04.478409+0000","last_undegraded":"2023-08-01T19:54:04.478409+0000","last_fullsized":"2023-08-01T19:54:04.478409+0000","mapping_epoch":16,"log_start":"0'0","ondisk_log_start":"0'0","created":16,"last_epoch_clean":17,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-08-01T19:54:04.040663+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-08-01T19:54:04.040663+0000","last_clean_scrub_stamp":"2023-08-01T19:54:04.040663+0000","objects_scrubbed":0,"log_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-08-02T22:15:19.744281+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[1,0],"acting":[1,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":1,"acting_primary":1,"purged_snaps":[]},{"pgid":"4.2b","version":"0'0","reported_seq":8,"reported_epoch":17,"state":"active+clean","last_fresh":"2023-08-01T19:54:04.474047+0000","last_change":"2023-08-01T19:54:04.474047+0000","last_active":"2023-08-01T19:54:04.474047+0000","last_peered":"2023-08-01T19:54:04.474047+0000","last_clean":"2023-08-01T19:54:04.474047+0000","last_became_active":"2023-08-01T19:54:04.473578+0000","last_became_peered":"2023-08-01T19:54:04.473578+0000","last_unstale":"2023-08-01T19:54:04.474047+0000","last_undegraded":"2023-08-01T19:54:04.474047+0000","last_fullsized":"2023-08-01T19:54:04.474047+0000","mapping_epoch":16,"log_start":"0'0","ondisk_log_start":"0'0","created":16,"last_epoch_clean":17,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-08-01T19:54:04.040663+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-08-01T19:54:04.040663+0000","last_clean_scrub_stamp":"2023-08-01T19:54:04.040663+0000","objects_scrubbed":0,"log_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-08-03T05:39:29.199142+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[1,0],"acting":[1,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":1,"acting_primary":1,"purged_snaps":[]},{"pgid":"4.2a","version":"0'0","reported_seq":9,"reported_epoch":17,"state":"active+clean","last_fresh":"2023-08-01T19:54:04.470833+0000","last_change":"2023-08-01T19:54:04.469281+0000","last_active":"2023-08-01T19:54:04.470833+0000","last_peered":"2023-08-01T19:54:04.470833+0000","last_clean":"2023-08-01T19:54:04.470833+0000","last_became_active":"2023-08-01T19:54:04.468771+0000","last_became_peered":"2023-08-01T19:54:04.468771+0000","last_unstale":"2023-08-01T19:54:04.470833+0000","last_undegraded":"2023-08-01T19:54:04.470833+0000","last_fullsized":"2023-08-01T19:54:04.470833+0000","mapping_epoch":16,"log_start":"0'0","ondisk_log_start":"0'0","created":16,"last_epoch_clean":17,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-08-01T19:54:04.040663+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-08-01T19:54:04.040663+0000","last_clean_scrub_stamp":"2023-08-01T19:54:04.040663+0000","objects_scrubbed":0,"log_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-08-03T01:15:27.748810+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[2,1],"acting":[2,1],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":2,"acting_primary":2,"purged_snaps":[]},{"pgid":"4.29","version":"0'0","reported_seq":8,"reported_epoch":17,"state":"active+clean","last_fresh":"2023-08-01T19:54:04.466694+0000","last_change":"2023-08-01T19:54:04.466694+0000","last_active":"2023-08-01T19:54:04.466694+0000","last_peered":"2023-08-01T19:54:04.466694+0000","last_clean":"2023-08-01T19:54:04.466694+0000","last_became_active":"2023-08-01T19:54:04.466250+0000","last_became_peered":"2023-08-01T19:54:04.466250+0000","last_unstale":"2023-08-01T19:54:04.466694+0000","last_undegraded":"2023-08-01T19:54:04.466694+0000","last_fullsized":"2023-08-01T19:54:04.466694+0000","mapping_epoch":16,"log_start":"0'0","ondisk_log_start":"0'0","created":16,"last_epoch_clean":17,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-08-01T19:54:04.040663+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-08-01T19:54:04.040663+0000","last_clean_scrub_stamp":"2023-08-01T19:54:04.040663+0000","objects_scrubbed":0,"log_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-08-03T01:00:18.725898+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[0,1],"acting":[0,1],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":0,"acting_primary":0,"purged_snaps":[]},{"pgid":"4.28","version":"0'0","reported_seq":9,"reported_epoch":17,"state":"active+clean","last_fresh":"2023-08-01T19:54:04.470337+0000","last_change":"2023-08-01T19:54:04.468160+0000","last_active":"2023-08-01T19:54:04.470337+0000","last_peered":"2023-08-01T19:54:04.470337+0000","last_clean":"2023-08-01T19:54:04.470337+0000","last_became_active":"2023-08-01T19:54:04.467625+0000","last_became_peered":"2023-08-01T19:54:04.467625+0000","last_unstale":"2023-08-01T19:54:04.470337+0000","last_undegraded":"2023-08-01T19:54:04.470337+0000","last_fullsized":"2023-08-01T19:54:04.470337+0000","mapping_epoch":16,"log_start":"0'0","ondisk_log_start":"0'0","created":16,"last_epoch_clean":17,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-08-01T19:54:04.040663+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-08-01T19:54:04.040663+0000","last_clean_scrub_stamp":"2023-08-01T19:54:04.040663+0000","objects_scrubbed":0,"log_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-08-02T21:27:52.506153+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[2,0],"acting":[2,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":2,"acting_primary":2,"purged_snaps":[]},{"pgid":"4.27","version":"0'0","reported_seq":9,"reported_epoch":17,"state":"active+clean","last_fresh":"2023-08-01T19:54:04.470777+0000","last_change":"2023-08-01T19:54:04.469187+0000","last_active":"2023-08-01T19:54:04.470777+0000","last_peered":"2023-08-01T19:54:04.470777+0000","last_clean":"2023-08-01T19:54:04.470777+0000","last_became_active":"2023-08-01T19:54:04.468628+0000","last_became_peered":"2023-08-01T19:54:04.468628+0000","last_unstale":"2023-08-01T19:54:04.470777+0000","last_undegraded":"2023-08-01T19:54:04.470777+0000","last_fullsized":"2023-08-01T19:54:04.470777+0000","mapping_epoch":16,"log_start":"0'0","ondisk_log_start":"0'0","created":16,"last_epoch_clean":17,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-08-01T19:54:04.040663+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-08-01T19:54:04.040663+0000","last_clean_scrub_stamp":"2023-08-01T19:54:04.040663+0000","objects_scrubbed":0,"log_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-08-03T00:07:29.565677+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[2,1],"acting":[2,1],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":2,"acting_primary":2,"purged_snaps":[]},{"pgid":"4.26","version":"0'0","reported_seq":8,"reported_epoch":17,"state":"active+clean","last_fresh":"2023-08-01T19:54:04.470942+0000","last_change":"2023-08-01T19:54:04.470942+0000","last_active":"2023-08-01T19:54:04.470942+0000","last_peered":"2023-08-01T19:54:04.470942+0000","last_clean":"2023-08-01T19:54:04.470942+0000","last_became_active":"2023-08-01T19:54:04.470564+0000","last_became_peered":"2023-08-01T19:54:04.470564+0000","last_unstale":"2023-08-01T19:54:04.470942+0000","last_undegraded":"2023-08-01T19:54:04.470942+0000","last_fullsized":"2023-08-01T19:54:04.470942+0000","mapping_epoch":16,"log_start":"0'0","ondisk_log_start":"0'0","created":16,"last_epoch_clean":17,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-08-01T19:54:04.040663+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-08-01T19:54:04.040663+0000","last_clean_scrub_stamp":"2023-08-01T19:54:04.040663+0000","objects_scrubbed":0,"log_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-08-03T04:43:21.408174+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[0,1],"acting":[0,1],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":0,"acting_primary":0,"purged_snaps":[]},{"pgid":"4.25","version":"0'0","reported_seq":8,"reported_epoch":17,"state":"active+clean","last_fresh":"2023-08-01T19:54:04.474813+0000","last_change":"2023-08-01T19:54:04.474813+0000","last_active":"2023-08-01T19:54:04.474813+0000","last_peered":"2023-08-01T19:54:04.474813+0000","last_clean":"2023-08-01T19:54:04.474813+0000","last_became_active":"2023-08-01T19:54:04.472530+0000","last_became_peered":"2023-08-01T19:54:04.472530+0000","last_unstale":"2023-08-01T19:54:04.474813+0000","last_undegraded":"2023-08-01T19:54:04.474813+0000","last_fullsized":"2023-08-01T19:54:04.474813+0000","mapping_epoch":16,"log_start":"0'0","ondisk_log_start":"0'0","created":16,"last_epoch_clean":17,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-08-01T19:54:04.040663+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-08-01T19:54:04.040663+0000","last_clean_scrub_stamp":"2023-08-01T19:54:04.040663+0000","objects_scrubbed":0,"log_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-08-03T01:00:18.725898+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[1,2],"acting":[1,2],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":1,"acting_primary":1,"purged_snaps":[]},{"pgid":"3.1a","version":"17'1","reported_seq":11,"reported_epoch":17,"state":"active+clean","last_fresh":"2023-08-01T19:54:04.473081+0000","last_change":"2023-08-01T19:54:04.063936+0000","last_active":"2023-08-01T19:54:04.473081+0000","last_peered":"2023-08-01T19:54:04.473081+0000","last_clean":"2023-08-01T19:54:04.473081+0000","last_became_active":"2023-08-01T19:54:04.063674+0000","last_became_peered":"2023-08-01T19:54:04.063674+0000","last_unstale":"2023-08-01T19:54:04.473081+0000","last_undegraded":"2023-08-01T19:54:04.473081+0000","last_fullsized":"2023-08-01T19:54:04.473081+0000","mapping_epoch":15,"log_start":"0'0","ondisk_log_start":"0'0","created":15,"last_epoch_clean":16,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-08-01T19:54:03.032665+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-08-01T19:54:03.032665+0000","last_clean_scrub_stamp":"2023-08-01T19:54:03.032665+0000","objects_scrubbed":0,"log_size":1,"ondisk_log_size":1,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-08-03T00:06:00.058200+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[2,0],"acting":[2,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":2,"acting_primary":2,"purged_snaps":[]},{"pgid":"4.1d","version":"0'0","reported_seq":9,"reported_epoch":17,"state":"active+clean","last_fresh":"2023-08-01T19:54:04.474051+0000","last_change":"2023-08-01T19:54:04.471916+0000","last_active":"2023-08-01T19:54:04.474051+0000","last_peered":"2023-08-01T19:54:04.474051+0000","last_clean":"2023-08-01T19:54:04.474051+0000","last_became_active":"2023-08-01T19:54:04.471480+0000","last_became_peered":"2023-08-01T19:54:04.471480+0000","last_unstale":"2023-08-01T19:54:04.474051+0000","last_undegraded":"2023-08-01T19:54:04.474051+0000","last_fullsized":"2023-08-01T19:54:04.474051+0000","mapping_epoch":16,"log_start":"0'0","ondisk_log_start":"0'0","created":16,"last_epoch_clean":17,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-08-01T19:54:04.040663+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-08-01T19:54:04.040663+0000","last_clean_scrub_stamp":"2023-08-01T19:54:04.040663+0000","objects_scrubbed":0,"log_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-08-02T21:19:17.547590+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[2,1],"acting":[2,1],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":2,"acting_primary":2,"purged_snaps":[]},{"pgid":"3.19","version":"0'0","reported_seq":9,"reported_epoch":16,"state":"active+clean","last_fresh":"2023-08-01T19:54:04.068905+0000","last_change":"2023-08-01T19:54:04.067837+0000","last_active":"2023-08-01T19:54:04.068905+0000","last_peered":"2023-08-01T19:54:04.068905+0000","last_clean":"2023-08-01T19:54:04.068905+0000","last_became_active":"2023-08-01T19:54:04.067535+0000","last_became_peered":"2023-08-01T19:54:04.067535+0000","last_unstale":"2023-08-01T19:54:04.068905+0000","last_undegraded":"2023-08-01T19:54:04.068905+0000","last_fullsized":"2023-08-01T19:54:04.068905+0000","mapping_epoch":15,"log_start":"0'0","ondisk_log_start":"0'0","created":15,"last_epoch_clean":16,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-08-01T19:54:03.032665+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-08-01T19:54:03.032665+0000","last_clean_scrub_stamp":"2023-08-01T19:54:03.032665+0000","objects_scrubbed":0,"log_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-08-02T20:56:47.324761+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[0,1],"acting":[0,1],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":0,"acting_primary":0,"purged_snaps":[]},{"pgid":"4.1e","version":"0'0","reported_seq":8,"reported_epoch":17,"state":"active+clean","last_fresh":"2023-08-01T19:54:04.470544+0000","last_change":"2023-08-01T19:54:04.470544+0000","last_active":"2023-08-01T19:54:04.470544+0000","last_peered":"2023-08-01T19:54:04.470544+0000","last_clean":"2023-08-01T19:54:04.470544+0000","last_became_active":"2023-08-01T19:54:04.469657+0000","last_became_peered":"2023-08-01T19:54:04.469657+0000","last_unstale":"2023-08-01T19:54:04.470544+0000","last_undegraded":"2023-08-01T19:54:04.470544+0000","last_fullsized":"2023-08-01T19:54:04.470544+0000","mapping_epoch":16,"log_start":"0'0","ondisk_log_start":"0'0","created":16,"last_epoch_clean":17,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-08-01T19:54:04.040663+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-08-01T19:54:04.040663+0000","last_clean_scrub_stamp":"2023-08-01T19:54:04.040663+0000","objects_scrubbed":0,"log_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-08-02T23:12:30.830199+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[0,1],"acting":[0,1],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":0,"acting_primary":0,"purged_snaps":[]},{"pgid":"3.18","version":"0'0","reported_seq":9,"reported_epoch":16,"state":"active+clean","last_fresh":"2023-08-01T19:54:04.065295+0000","last_change":"2023-08-01T19:54:04.064289+0000","last_active":"2023-08-01T19:54:04.065295+0000","last_peered":"2023-08-01T19:54:04.065295+0000","last_clean":"2023-08-01T19:54:04.065295+0000","last_became_active":"2023-08-01T19:54:04.063971+0000","last_became_peered":"2023-08-01T19:54:04.063971+0000","last_unstale":"2023-08-01T19:54:04.065295+0000","last_undegraded":"2023-08-01T19:54:04.065295+0000","last_fullsized":"2023-08-01T19:54:04.065295+0000","mapping_epoch":15,"log_start":"0'0","ondisk_log_start":"0'0","created":15,"last_epoch_clean":16,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-08-01T19:54:03.032665+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-08-01T19:54:03.032665+0000","last_clean_scrub_stamp":"2023-08-01T19:54:03.032665+0000","objects_scrubbed":0,"log_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-08-03T04:09:30.496098+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[0,2],"acting":[0,2],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":0,"acting_primary":0,"purged_snaps":[]},{"pgid":"4.1f","version":"0'0","reported_seq":9,"reported_epoch":17,"state":"active+clean","last_fresh":"2023-08-01T19:54:04.474406+0000","last_change":"2023-08-01T19:54:04.472227+0000","last_active":"2023-08-01T19:54:04.474406+0000","last_peered":"2023-08-01T19:54:04.474406+0000","last_clean":"2023-08-01T19:54:04.474406+0000","last_became_active":"2023-08-01T19:54:04.471767+0000","last_became_peered":"2023-08-01T19:54:04.471767+0000","last_unstale":"2023-08-01T19:54:04.474406+0000","last_undegraded":"2023-08-01T19:54:04.474406+0000","last_fullsized":"2023-08-01T19:54:04.474406+0000","mapping_epoch":16,"log_start":"0'0","ondisk_log_start":"0'0","created":16,"last_epoch_clean":17,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-08-01T19:54:04.040663+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-08-01T19:54:04.040663+0000","last_clean_scrub_stamp":"2023-08-01T19:54:04.040663+0000","objects_scrubbed":0,"log_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-08-02T20:25:25.280329+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[2,1],"acting":[2,1],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":2,"acting_primary":2,"purged_snaps":[]},{"pgid":"3.17","version":"0'0","reported_seq":9,"reported_epoch":16,"state":"active+clean","last_fresh":"2023-08-01T19:54:04.068922+0000","last_change":"2023-08-01T19:54:04.067975+0000","last_active":"2023-08-01T19:54:04.068922+0000","last_peered":"2023-08-01T19:54:04.068922+0000","last_clean":"2023-08-01T19:54:04.068922+0000","last_became_active":"2023-08-01T19:54:04.067577+0000","last_became_peered":"2023-08-01T19:54:04.067577+0000","last_unstale":"2023-08-01T19:54:04.068922+0000","last_undegraded":"2023-08-01T19:54:04.068922+0000","last_fullsized":"2023-08-01T19:54:04.068922+0000","mapping_epoch":15,"log_start":"0'0","ondisk_log_start":"0'0","created":15,"last_epoch_clean":16,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-08-01T19:54:03.032665+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-08-01T19:54:03.032665+0000","last_clean_scrub_stamp":"2023-08-01T19:54:03.032665+0000","objects_scrubbed":0,"log_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-08-03T07:13:34.025722+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[0,1],"acting":[0,1],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":0,"acting_primary":0,"purged_snaps":[]},{"pgid":"4.10","version":"0'0","reported_seq":8,"reported_epoch":17,"state":"active+clean","last_fresh":"2023-08-01T19:54:04.467146+0000","last_change":"2023-08-01T19:54:04.467146+0000","last_active":"2023-08-01T19:54:04.467146+0000","last_peered":"2023-08-01T19:54:04.467146+0000","last_clean":"2023-08-01T19:54:04.467146+0000","last_became_active":"2023-08-01T19:54:04.466627+0000","last_became_peered":"2023-08-01T19:54:04.466627+0000","last_unstale":"2023-08-01T19:54:04.467146+0000","last_undegraded":"2023-08-01T19:54:04.467146+0000","last_fullsized":"2023-08-01T19:54:04.467146+0000","mapping_epoch":16,"log_start":"0'0","ondisk_log_start":"0'0","created":16,"last_epoch_clean":17,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-08-01T19:54:04.040663+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-08-01T19:54:04.040663+0000","last_clean_scrub_stamp":"2023-08-01T19:54:04.040663+0000","objects_scrubbed":0,"log_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-08-03T04:43:26.793480+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[0,2],"acting":[0,2],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":0,"acting_primary":0,"purged_snaps":[]},{"pgid":"3.16","version":"0'0","reported_seq":9,"reported_epoch":16,"state":"active+clean","last_fresh":"2023-08-01T19:54:04.066517+0000","last_change":"2023-08-01T19:54:04.065042+0000","last_active":"2023-08-01T19:54:04.066517+0000","last_peered":"2023-08-01T19:54:04.066517+0000","last_clean":"2023-08-01T19:54:04.066517+0000","last_became_active":"2023-08-01T19:54:04.064040+0000","last_became_peered":"2023-08-01T19:54:04.064040+0000","last_unstale":"2023-08-01T19:54:04.066517+0000","last_undegraded":"2023-08-01T19:54:04.066517+0000","last_fullsized":"2023-08-01T19:54:04.066517+0000","mapping_epoch":15,"log_start":"0'0","ondisk_log_start":"0'0","created":15,"last_epoch_clean":16,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-08-01T19:54:03.032665+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-08-01T19:54:03.032665+0000","last_clean_scrub_stamp":"2023-08-01T19:54:03.032665+0000","objects_scrubbed":0,"log_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-08-03T03:40:43.460182+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[1,0],"acting":[1,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":1,"acting_primary":1,"purged_snaps":[]},{"pgid":"4.11","version":"0'0","reported_seq":8,"reported_epoch":17,"state":"active+clean","last_fresh":"2023-08-01T19:54:04.470401+0000","last_change":"2023-08-01T19:54:04.470401+0000","last_active":"2023-08-01T19:54:04.470401+0000","last_peered":"2023-08-01T19:54:04.470401+0000","last_clean":"2023-08-01T19:54:04.470401+0000","last_became_active":"2023-08-01T19:54:04.469680+0000","last_became_peered":"2023-08-01T19:54:04.469680+0000","last_unstale":"2023-08-01T19:54:04.470401+0000","last_undegraded":"2023-08-01T19:54:04.470401+0000","last_fullsized":"2023-08-01T19:54:04.470401+0000","mapping_epoch":16,"log_start":"0'0","ondisk_log_start":"0'0","created":16,"last_epoch_clean":17,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-08-01T19:54:04.040663+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-08-01T19:54:04.040663+0000","last_clean_scrub_stamp":"2023-08-01T19:54:04.040663+0000","objects_scrubbed":0,"log_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-08-03T03:58:06.360840+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[0,1],"acting":[0,1],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":0,"acting_primary":0,"purged_snaps":[]},{"pgid":"3.15","version":"17'3","reported_seq":13,"reported_epoch":17,"state":"active+clean","last_fresh":"2023-08-01T19:54:04.471749+0000","last_change":"2023-08-01T19:54:04.065443+0000","last_active":"2023-08-01T19:54:04.471749+0000","last_peered":"2023-08-01T19:54:04.471749+0000","last_clean":"2023-08-01T19:54:04.471749+0000","last_became_active":"2023-08-01T19:54:04.065112+0000","last_became_peered":"2023-08-01T19:54:04.065112+0000","last_unstale":"2023-08-01T19:54:04.471749+0000","last_undegraded":"2023-08-01T19:54:04.471749+0000","last_fullsized":"2023-08-01T19:54:04.471749+0000","mapping_epoch":15,"log_start":"0'0","ondisk_log_start":"0'0","created":15,"last_epoch_clean":16,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-08-01T19:54:03.032665+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-08-01T19:54:03.032665+0000","last_clean_scrub_stamp":"2023-08-01T19:54:03.032665+0000","objects_scrubbed":0,"log_size":3,"ondisk_log_size":3,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-08-03T03:27:50.887004+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":90,"num_objects":2,"num_object_clones":0,"num_object_copies":4,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":2,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":4,"num_write_kb":1,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":1,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[2,1],"acting":[2,1],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":2,"acting_primary":2,"purged_snaps":[]},{"pgid":"4.12","version":"0'0","reported_seq":8,"reported_epoch":17,"state":"active+clean","last_fresh":"2023-08-01T19:54:04.467822+0000","last_change":"2023-08-01T19:54:04.467822+0000","last_active":"2023-08-01T19:54:04.467822+0000","last_peered":"2023-08-01T19:54:04.467822+0000","last_clean":"2023-08-01T19:54:04.467822+0000","last_became_active":"2023-08-01T19:54:04.466667+0000","last_became_peered":"2023-08-01T19:54:04.466667+0000","last_unstale":"2023-08-01T19:54:04.467822+0000","last_undegraded":"2023-08-01T19:54:04.467822+0000","last_fullsized":"2023-08-01T19:54:04.467822+0000","mapping_epoch":16,"log_start":"0'0","ondisk_log_start":"0'0","created":16,"last_epoch_clean":17,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-08-01T19:54:04.040663+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-08-01T19:54:04.040663+0000","last_clean_scrub_stamp":"2023-08-01T19:54:04.040663+0000","objects_scrubbed":0,"log_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-08-03T02:57:18.148077+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[0,2],"acting":[0,2],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":0,"acting_primary":0,"purged_snaps":[]},{"pgid":"3.14","version":"17'6","reported_seq":15,"reported_epoch":17,"state":"active+clean","last_fresh":"2023-08-01T19:54:04.480371+0000","last_change":"2023-08-01T19:54:04.061419+0000","last_active":"2023-08-01T19:54:04.480371+0000","last_peered":"2023-08-01T19:54:04.480371+0000","last_clean":"2023-08-01T19:54:04.480371+0000","last_became_active":"2023-08-01T19:54:04.061078+0000","last_became_peered":"2023-08-01T19:54:04.061078+0000","last_unstale":"2023-08-01T19:54:04.480371+0000","last_undegraded":"2023-08-01T19:54:04.480371+0000","last_fullsized":"2023-08-01T19:54:04.480371+0000","mapping_epoch":15,"log_start":"0'0","ondisk_log_start":"0'0","created":15,"last_epoch_clean":16,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-08-01T19:54:03.032665+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-08-01T19:54:03.032665+0000","last_clean_scrub_stamp":"2023-08-01T19:54:03.032665+0000","objects_scrubbed":0,"log_size":6,"ondisk_log_size":6,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-08-02T21:35:44.874727+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":1536,"num_objects":4,"num_object_clones":0,"num_object_copies":8,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":4,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":6,"num_write_kb":3,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":1,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[1,2],"acting":[1,2],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":1,"acting_primary":1,"purged_snaps":[]},{"pgid":"4.13","version":"0'0","reported_seq":8,"reported_epoch":17,"state":"active+clean","last_fresh":"2023-08-01T19:54:04.466400+0000","last_change":"2023-08-01T19:54:04.466400+0000","last_active":"2023-08-01T19:54:04.466400+0000","last_peered":"2023-08-01T19:54:04.466400+0000","last_clean":"2023-08-01T19:54:04.466400+0000","last_became_active":"2023-08-01T19:54:04.465979+0000","last_became_peered":"2023-08-01T19:54:04.465979+0000","last_unstale":"2023-08-01T19:54:04.466400+0000","last_undegraded":"2023-08-01T19:54:04.466400+0000","last_fullsized":"2023-08-01T19:54:04.466400+0000","mapping_epoch":16,"log_start":"0'0","ondisk_log_start":"0'0","created":16,"last_epoch_clean":17,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-08-01T19:54:04.040663+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-08-01T19:54:04.040663+0000","last_clean_scrub_stamp":"2023-08-01T19:54:04.040663+0000","objects_scrubbed":0,"log_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-08-02T20:20:59.989030+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[1,2],"acting":[1,2],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":1,"acting_primary":1,"purged_snaps":[]},{"pgid":"3.13","version":"17'2","reported_seq":11,"reported_epoch":17,"state":"active+clean","last_fresh":"2023-08-01T19:54:04.474777+0000","last_change":"2023-08-01T19:54:04.065212+0000","last_active":"2023-08-01T19:54:04.474777+0000","last_peered":"2023-08-01T19:54:04.474777+0000","last_clean":"2023-08-01T19:54:04.474777+0000","last_became_active":"2023-08-01T19:54:04.064375+0000","last_became_peered":"2023-08-01T19:54:04.064375+0000","last_unstale":"2023-08-01T19:54:04.474777+0000","last_undegraded":"2023-08-01T19:54:04.474777+0000","last_fullsized":"2023-08-01T19:54:04.474777+0000","mapping_epoch":15,"log_start":"0'0","ondisk_log_start":"0'0","created":15,"last_epoch_clean":16,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-08-01T19:54:03.032665+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-08-01T19:54:03.032665+0000","last_clean_scrub_stamp":"2023-08-01T19:54:03.032665+0000","objects_scrubbed":0,"log_size":2,"ondisk_log_size":2,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-08-03T06:17:37.910752+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":34,"num_objects":2,"num_object_clones":0,"num_object_copies":4,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":2,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":3,"num_write_kb":6,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":1,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[1,0],"acting":[1,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":1,"acting_primary":1,"purged_snaps":[]},{"pgid":"4.14","version":"0'0","reported_seq":9,"reported_epoch":17,"state":"active+clean","last_fresh":"2023-08-01T19:54:04.465917+0000","last_change":"2023-08-01T19:54:04.464446+0000","last_active":"2023-08-01T19:54:04.465917+0000","last_peered":"2023-08-01T19:54:04.465917+0000","last_clean":"2023-08-01T19:54:04.465917+0000","last_became_active":"2023-08-01T19:54:04.464021+0000","last_became_peered":"2023-08-01T19:54:04.464021+0000","last_unstale":"2023-08-01T19:54:04.465917+0000","last_undegraded":"2023-08-01T19:54:04.465917+0000","last_fullsized":"2023-08-01T19:54:04.465917+0000","mapping_epoch":16,"log_start":"0'0","ondisk_log_start":"0'0","created":16,"last_epoch_clean":17,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-08-01T19:54:04.040663+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-08-01T19:54:04.040663+0000","last_clean_scrub_stamp":"2023-08-01T19:54:04.040663+0000","objects_scrubbed":0,"log_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-08-02T20:26:51.080849+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[2,0],"acting":[2,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":2,"acting_primary":2,"purged_snaps":[]},{"pgid":"3.12","version":"0'0","reported_seq":9,"reported_epoch":16,"state":"active+clean","last_fresh":"2023-08-01T19:54:04.068588+0000","last_change":"2023-08-01T19:54:04.066566+0000","last_active":"2023-08-01T19:54:04.068588+0000","last_peered":"2023-08-01T19:54:04.068588+0000","last_clean":"2023-08-01T19:54:04.068588+0000","last_became_active":"2023-08-01T19:54:04.066190+0000","last_became_peered":"2023-08-01T19:54:04.066190+0000","last_unstale":"2023-08-01T19:54:04.068588+0000","last_undegraded":"2023-08-01T19:54:04.068588+0000","last_fullsized":"2023-08-01T19:54:04.068588+0000","mapping_epoch":15,"log_start":"0'0","ondisk_log_start":"0'0","created":15,"last_epoch_clean":16,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-08-01T19:54:03.032665+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-08-01T19:54:03.032665+0000","last_clean_scrub_stamp":"2023-08-01T19:54:03.032665+0000","objects_scrubbed":0,"log_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-08-03T02:01:47.073630+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[0,1],"acting":[0,1],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":0,"acting_primary":0,"purged_snaps":[]},{"pgid":"4.15","version":"0'0","reported_seq":9,"reported_epoch":17,"state":"active+clean","last_fresh":"2023-08-01T19:54:04.470734+0000","last_change":"2023-08-01T19:54:04.468791+0000","last_active":"2023-08-01T19:54:04.470734+0000","last_peered":"2023-08-01T19:54:04.470734+0000","last_clean":"2023-08-01T19:54:04.470734+0000","last_became_active":"2023-08-01T19:54:04.468214+0000","last_became_peered":"2023-08-01T19:54:04.468214+0000","last_unstale":"2023-08-01T19:54:04.470734+0000","last_undegraded":"2023-08-01T19:54:04.470734+0000","last_fullsized":"2023-08-01T19:54:04.470734+0000","mapping_epoch":16,"log_start":"0'0","ondisk_log_start":"0'0","created":16,"last_epoch_clean":17,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-08-01T19:54:04.040663+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-08-01T19:54:04.040663+0000","last_clean_scrub_stamp":"2023-08-01T19:54:04.040663+0000","objects_scrubbed":0,"log_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-08-03T04:10:44.729287+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[2,0],"acting":[2,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":2,"acting_primary":2,"purged_snaps":[]},{"pgid":"3.11","version":"0'0","reported_seq":10,"reported_epoch":17,"state":"active+clean","last_fresh":"2023-08-01T19:54:04.457924+0000","last_change":"2023-08-01T19:54:04.064280+0000","last_active":"2023-08-01T19:54:04.457924+0000","last_peered":"2023-08-01T19:54:04.457924+0000","last_clean":"2023-08-01T19:54:04.457924+0000","last_became_active":"2023-08-01T19:54:04.064064+0000","last_became_peered":"2023-08-01T19:54:04.064064+0000","last_unstale":"2023-08-01T19:54:04.457924+0000","last_undegraded":"2023-08-01T19:54:04.457924+0000","last_fullsized":"2023-08-01T19:54:04.457924+0000","mapping_epoch":15,"log_start":"0'0","ondisk_log_start":"0'0","created":15,"last_epoch_clean":16,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-08-01T19:54:03.032665+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-08-01T19:54:03.032665+0000","last_clean_scrub_stamp":"2023-08-01T19:54:03.032665+0000","objects_scrubbed":0,"log_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-08-03T06:13:51.475710+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[2,1],"acting":[2,1],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":2,"acting_primary":2,"purged_snaps":[]},{"pgid":"4.16","version":"0'0","reported_seq":8,"reported_epoch":17,"state":"active+clean","last_fresh":"2023-08-01T19:54:04.469724+0000","last_change":"2023-08-01T19:54:04.469724+0000","last_active":"2023-08-01T19:54:04.469724+0000","last_peered":"2023-08-01T19:54:04.469724+0000","last_clean":"2023-08-01T19:54:04.469724+0000","last_became_active":"2023-08-01T19:54:04.469275+0000","last_became_peered":"2023-08-01T19:54:04.469275+0000","last_unstale":"2023-08-01T19:54:04.469724+0000","last_undegraded":"2023-08-01T19:54:04.469724+0000","last_fullsized":"2023-08-01T19:54:04.469724+0000","mapping_epoch":16,"log_start":"0'0","ondisk_log_start":"0'0","created":16,"last_epoch_clean":17,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-08-01T19:54:04.040663+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-08-01T19:54:04.040663+0000","last_clean_scrub_stamp":"2023-08-01T19:54:04.040663+0000","objects_scrubbed":0,"log_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-08-03T03:04:06.137335+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[0,1],"acting":[0,1],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":0,"acting_primary":0,"purged_snaps":[]},{"pgid":"3.10","version":"17'8","reported_seq":17,"reported_epoch":17,"state":"active+clean","last_fresh":"2023-08-01T19:54:04.480213+0000","last_change":"2023-08-01T19:54:04.060962+0000","last_active":"2023-08-01T19:54:04.480213+0000","last_peered":"2023-08-01T19:54:04.480213+0000","last_clean":"2023-08-01T19:54:04.480213+0000","last_became_active":"2023-08-01T19:54:04.060576+0000","last_became_peered":"2023-08-01T19:54:04.060576+0000","last_unstale":"2023-08-01T19:54:04.480213+0000","last_undegraded":"2023-08-01T19:54:04.480213+0000","last_fullsized":"2023-08-01T19:54:04.480213+0000","mapping_epoch":15,"log_start":"0'0","ondisk_log_start":"0'0","created":15,"last_epoch_clean":16,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-08-01T19:54:03.032665+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-08-01T19:54:03.032665+0000","last_clean_scrub_stamp":"2023-08-01T19:54:03.032665+0000","objects_scrubbed":0,"log_size":8,"ondisk_log_size":8,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-08-03T05:00:51.171444+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":4,"num_object_clones":0,"num_object_copies":8,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":4,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":12,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":4,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[1,2],"acting":[1,2],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":1,"acting_primary":1,"purged_snaps":[]},{"pgid":"4.17","version":"0'0","reported_seq":8,"reported_epoch":17,"state":"active+clean","last_fresh":"2023-08-01T19:54:04.472721+0000","last_change":"2023-08-01T19:54:04.472721+0000","last_active":"2023-08-01T19:54:04.472721+0000","last_peered":"2023-08-01T19:54:04.472721+0000","last_clean":"2023-08-01T19:54:04.472721+0000","last_became_active":"2023-08-01T19:54:04.472126+0000","last_became_peered":"2023-08-01T19:54:04.472126+0000","last_unstale":"2023-08-01T19:54:04.472721+0000","last_undegraded":"2023-08-01T19:54:04.472721+0000","last_fullsized":"2023-08-01T19:54:04.472721+0000","mapping_epoch":16,"log_start":"0'0","ondisk_log_start":"0'0","created":16,"last_epoch_clean":17,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-08-01T19:54:04.040663+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-08-01T19:54:04.040663+0000","last_clean_scrub_stamp":"2023-08-01T19:54:04.040663+0000","objects_scrubbed":0,"log_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-08-03T00:29:05.857138+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[0,1],"acting":[0,1],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":0,"acting_primary":0,"purged_snaps":[]},{"pgid":"3.f","version":"17'1","reported_seq":10,"reported_epoch":17,"state":"active+clean","last_fresh":"2023-08-01T19:54:04.469403+0000","last_change":"2023-08-01T19:54:04.060797+0000","last_active":"2023-08-01T19:54:04.469403+0000","last_peered":"2023-08-01T19:54:04.469403+0000","last_clean":"2023-08-01T19:54:04.469403+0000","last_became_active":"2023-08-01T19:54:04.060444+0000","last_became_peered":"2023-08-01T19:54:04.060444+0000","last_unstale":"2023-08-01T19:54:04.469403+0000","last_undegraded":"2023-08-01T19:54:04.469403+0000","last_fullsized":"2023-08-01T19:54:04.469403+0000","mapping_epoch":15,"log_start":"0'0","ondisk_log_start":"0'0","created":15,"last_epoch_clean":16,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-08-01T19:54:03.032665+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-08-01T19:54:03.032665+0000","last_clean_scrub_stamp":"2023-08-01T19:54:03.032665+0000","objects_scrubbed":0,"log_size":1,"ondisk_log_size":1,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-08-03T07:13:34.025722+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":22,"num_objects":1,"num_object_clones":0,"num_object_copies":2,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":1,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":1,"num_write_kb":1,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[1,2],"acting":[1,2],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":1,"acting_primary":1,"purged_snaps":[]},{"pgid":"4.8","version":"0'0","reported_seq":9,"reported_epoch":17,"state":"active+clean","last_fresh":"2023-08-01T19:54:04.470264+0000","last_change":"2023-08-01T19:54:04.467671+0000","last_active":"2023-08-01T19:54:04.470264+0000","last_peered":"2023-08-01T19:54:04.470264+0000","last_clean":"2023-08-01T19:54:04.470264+0000","last_became_active":"2023-08-01T19:54:04.467300+0000","last_became_peered":"2023-08-01T19:54:04.467300+0000","last_unstale":"2023-08-01T19:54:04.470264+0000","last_undegraded":"2023-08-01T19:54:04.470264+0000","last_fullsized":"2023-08-01T19:54:04.470264+0000","mapping_epoch":16,"log_start":"0'0","ondisk_log_start":"0'0","created":16,"last_epoch_clean":17,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-08-01T19:54:04.040663+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-08-01T19:54:04.040663+0000","last_clean_scrub_stamp":"2023-08-01T19:54:04.040663+0000","objects_scrubbed":0,"log_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-08-03T05:27:24.774345+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[2,1],"acting":[2,1],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":2,"acting_primary":2,"purged_snaps":[]},{"pgid":"3.e","version":"17'2","reported_seq":12,"reported_epoch":17,"state":"active+clean","last_fresh":"2023-08-01T19:54:04.471249+0000","last_change":"2023-08-01T19:54:04.065595+0000","last_active":"2023-08-01T19:54:04.471249+0000","last_peered":"2023-08-01T19:54:04.471249+0000","last_clean":"2023-08-01T19:54:04.471249+0000","last_became_active":"2023-08-01T19:54:04.065303+0000","last_became_peered":"2023-08-01T19:54:04.065303+0000","last_unstale":"2023-08-01T19:54:04.471249+0000","last_undegraded":"2023-08-01T19:54:04.471249+0000","last_fullsized":"2023-08-01T19:54:04.471249+0000","mapping_epoch":15,"log_start":"0'0","ondisk_log_start":"0'0","created":15,"last_epoch_clean":16,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-08-01T19:54:03.032665+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-08-01T19:54:03.032665+0000","last_clean_scrub_stamp":"2023-08-01T19:54:03.032665+0000","objects_scrubbed":0,"log_size":2,"ondisk_log_size":2,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-08-02T22:40:38.782053+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":1,"num_object_clones":0,"num_object_copies":2,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":1,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":3,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":1,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[2,1],"acting":[2,1],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":2,"acting_primary":2,"purged_snaps":[]},{"pgid":"4.9","version":"0'0","reported_seq":9,"reported_epoch":17,"state":"active+clean","last_fresh":"2023-08-01T19:54:04.470284+0000","last_change":"2023-08-01T19:54:04.468007+0000","last_active":"2023-08-01T19:54:04.470284+0000","last_peered":"2023-08-01T19:54:04.470284+0000","last_clean":"2023-08-01T19:54:04.470284+0000","last_became_active":"2023-08-01T19:54:04.467509+0000","last_became_peered":"2023-08-01T19:54:04.467509+0000","last_unstale":"2023-08-01T19:54:04.470284+0000","last_undegraded":"2023-08-01T19:54:04.470284+0000","last_fullsized":"2023-08-01T19:54:04.470284+0000","mapping_epoch":16,"log_start":"0'0","ondisk_log_start":"0'0","created":16,"last_epoch_clean":17,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-08-01T19:54:04.040663+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-08-01T19:54:04.040663+0000","last_clean_scrub_stamp":"2023-08-01T19:54:04.040663+0000","objects_scrubbed":0,"log_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-08-03T06:04:50.963711+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[2,0],"acting":[2,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":2,"acting_primary":2,"purged_snaps":[]},{"pgid":"3.d","version":"17'1","reported_seq":10,"reported_epoch":17,"state":"active+clean","last_fresh":"2023-08-01T19:54:04.468649+0000","last_change":"2023-08-01T19:54:04.062853+0000","last_active":"2023-08-01T19:54:04.468649+0000","last_peered":"2023-08-01T19:54:04.468649+0000","last_clean":"2023-08-01T19:54:04.468649+0000","last_became_active":"2023-08-01T19:54:04.062598+0000","last_became_peered":"2023-08-01T19:54:04.062598+0000","last_unstale":"2023-08-01T19:54:04.468649+0000","last_undegraded":"2023-08-01T19:54:04.468649+0000","last_fullsized":"2023-08-01T19:54:04.468649+0000","mapping_epoch":15,"log_start":"0'0","ondisk_log_start":"0'0","created":15,"last_epoch_clean":16,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-08-01T19:54:03.032665+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-08-01T19:54:03.032665+0000","last_clean_scrub_stamp":"2023-08-01T19:54:03.032665+0000","objects_scrubbed":0,"log_size":1,"ondisk_log_size":1,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-08-02T20:56:47.324761+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":70,"num_objects":1,"num_object_clones":0,"num_object_copies":2,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":1,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":1,"num_write_kb":1,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[1,2],"acting":[1,2],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":1,"acting_primary":1,"purged_snaps":[]},{"pgid":"4.a","version":"0'0","reported_seq":8,"reported_epoch":17,"state":"active+clean","last_fresh":"2023-08-01T19:54:04.471997+0000","last_change":"2023-08-01T19:54:04.471997+0000","last_active":"2023-08-01T19:54:04.471997+0000","last_peered":"2023-08-01T19:54:04.471997+0000","last_clean":"2023-08-01T19:54:04.471997+0000","last_became_active":"2023-08-01T19:54:04.471204+0000","last_became_peered":"2023-08-01T19:54:04.471204+0000","last_unstale":"2023-08-01T19:54:04.471997+0000","last_undegraded":"2023-08-01T19:54:04.471997+0000","last_fullsized":"2023-08-01T19:54:04.471997+0000","mapping_epoch":16,"log_start":"0'0","ondisk_log_start":"0'0","created":16,"last_epoch_clean":17,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-08-01T19:54:04.040663+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-08-01T19:54:04.040663+0000","last_clean_scrub_stamp":"2023-08-01T19:54:04.040663+0000","objects_scrubbed":0,"log_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-08-02T23:12:30.830199+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[1,0],"acting":[1,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":1,"acting_primary":1,"purged_snaps":[]},{"pgid":"3.c","version":"0'0","reported_seq":9,"reported_epoch":16,"state":"active+clean","last_fresh":"2023-08-01T19:54:04.066181+0000","last_change":"2023-08-01T19:54:04.063532+0000","last_active":"2023-08-01T19:54:04.066181+0000","last_peered":"2023-08-01T19:54:04.066181+0000","last_clean":"2023-08-01T19:54:04.066181+0000","last_became_active":"2023-08-01T19:54:04.063116+0000","last_became_peered":"2023-08-01T19:54:04.063116+0000","last_unstale":"2023-08-01T19:54:04.066181+0000","last_undegraded":"2023-08-01T19:54:04.066181+0000","last_fullsized":"2023-08-01T19:54:04.066181+0000","mapping_epoch":15,"log_start":"0'0","ondisk_log_start":"0'0","created":15,"last_epoch_clean":16,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-08-01T19:54:03.032665+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-08-01T19:54:03.032665+0000","last_clean_scrub_stamp":"2023-08-01T19:54:03.032665+0000","objects_scrubbed":0,"log_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-08-02T22:28:51.936138+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[1,0],"acting":[1,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":1,"acting_primary":1,"purged_snaps":[]},{"pgid":"4.b","version":"0'0","reported_seq":8,"reported_epoch":17,"state":"active+clean","last_fresh":"2023-08-01T19:54:04.470787+0000","last_change":"2023-08-01T19:54:04.470787+0000","last_active":"2023-08-01T19:54:04.470787+0000","last_peered":"2023-08-01T19:54:04.470787+0000","last_clean":"2023-08-01T19:54:04.470787+0000","last_became_active":"2023-08-01T19:54:04.470332+0000","last_became_peered":"2023-08-01T19:54:04.470332+0000","last_unstale":"2023-08-01T19:54:04.470787+0000","last_undegraded":"2023-08-01T19:54:04.470787+0000","last_fullsized":"2023-08-01T19:54:04.470787+0000","mapping_epoch":16,"log_start":"0'0","ondisk_log_start":"0'0","created":16,"last_epoch_clean":17,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-08-01T19:54:04.040663+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-08-01T19:54:04.040663+0000","last_clean_scrub_stamp":"2023-08-01T19:54:04.040663+0000","objects_scrubbed":0,"log_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-08-03T05:13:38.298401+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[0,1],"acting":[0,1],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":0,"acting_primary":0,"purged_snaps":[]},{"pgid":"3.b","version":"17'2","reported_seq":11,"reported_epoch":17,"state":"active+clean","last_fresh":"2023-08-01T19:54:04.472823+0000","last_change":"2023-08-01T19:54:04.066839+0000","last_active":"2023-08-01T19:54:04.472823+0000","last_peered":"2023-08-01T19:54:04.472823+0000","last_clean":"2023-08-01T19:54:04.472823+0000","last_became_active":"2023-08-01T19:54:04.065535+0000","last_became_peered":"2023-08-01T19:54:04.065535+0000","last_unstale":"2023-08-01T19:54:04.472823+0000","last_undegraded":"2023-08-01T19:54:04.472823+0000","last_fullsized":"2023-08-01T19:54:04.472823+0000","mapping_epoch":15,"log_start":"0'0","ondisk_log_start":"0'0","created":15,"last_epoch_clean":16,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-08-01T19:54:03.032665+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-08-01T19:54:03.032665+0000","last_clean_scrub_stamp":"2023-08-01T19:54:03.032665+0000","objects_scrubbed":0,"log_size":2,"ondisk_log_size":2,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-08-03T05:00:51.171444+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":1,"num_object_clones":0,"num_object_copies":2,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":1,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":1,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":1,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[0,1],"acting":[0,1],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":0,"acting_primary":0,"purged_snaps":[]},{"pgid":"4.c","version":"0'0","reported_seq":8,"reported_epoch":17,"state":"active+clean","last_fresh":"2023-08-01T19:54:04.478715+0000","last_change":"2023-08-01T19:54:04.478715+0000","last_active":"2023-08-01T19:54:04.478715+0000","last_peered":"2023-08-01T19:54:04.478715+0000","last_clean":"2023-08-01T19:54:04.478715+0000","last_became_active":"2023-08-01T19:54:04.477435+0000","last_became_peered":"2023-08-01T19:54:04.477435+0000","last_unstale":"2023-08-01T19:54:04.478715+0000","last_undegraded":"2023-08-01T19:54:04.478715+0000","last_fullsized":"2023-08-01T19:54:04.478715+0000","mapping_epoch":16,"log_start":"0'0","ondisk_log_start":"0'0","created":16,"last_epoch_clean":17,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-08-01T19:54:04.040663+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-08-01T19:54:04.040663+0000","last_clean_scrub_stamp":"2023-08-01T19:54:04.040663+0000","objects_scrubbed":0,"log_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-08-03T04:43:21.408174+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[1,0],"acting":[1,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":1,"acting_primary":1,"purged_snaps":[]},{"pgid":"3.a","version":"0'0","reported_seq":9,"reported_epoch":16,"state":"active+clean","last_fresh":"2023-08-01T19:54:04.066947+0000","last_change":"2023-08-01T19:54:04.065267+0000","last_active":"2023-08-01T19:54:04.066947+0000","last_peered":"2023-08-01T19:54:04.066947+0000","last_clean":"2023-08-01T19:54:04.066947+0000","last_became_active":"2023-08-01T19:54:04.064912+0000","last_became_peered":"2023-08-01T19:54:04.064912+0000","last_unstale":"2023-08-01T19:54:04.066947+0000","last_undegraded":"2023-08-01T19:54:04.066947+0000","last_fullsized":"2023-08-01T19:54:04.066947+0000","mapping_epoch":15,"log_start":"0'0","ondisk_log_start":"0'0","created":15,"last_epoch_clean":16,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-08-01T19:54:03.032665+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-08-01T19:54:03.032665+0000","last_clean_scrub_stamp":"2023-08-01T19:54:03.032665+0000","objects_scrubbed":0,"log_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-08-03T02:37:09.180970+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[1,0],"acting":[1,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":1,"acting_primary":1,"purged_snaps":[]},{"pgid":"4.d","version":"0'0","reported_seq":8,"reported_epoch":17,"state":"active+clean","last_fresh":"2023-08-01T19:54:04.474755+0000","last_change":"2023-08-01T19:54:04.474755+0000","last_active":"2023-08-01T19:54:04.474755+0000","last_peered":"2023-08-01T19:54:04.474755+0000","last_clean":"2023-08-01T19:54:04.474755+0000","last_became_active":"2023-08-01T19:54:04.471526+0000","last_became_peered":"2023-08-01T19:54:04.471526+0000","last_unstale":"2023-08-01T19:54:04.474755+0000","last_undegraded":"2023-08-01T19:54:04.474755+0000","last_fullsized":"2023-08-01T19:54:04.474755+0000","mapping_epoch":16,"log_start":"0'0","ondisk_log_start":"0'0","created":16,"last_epoch_clean":17,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-08-01T19:54:04.040663+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-08-01T19:54:04.040663+0000","last_clean_scrub_stamp":"2023-08-01T19:54:04.040663+0000","objects_scrubbed":0,"log_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-08-03T06:50:03.420334+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[1,2],"acting":[1,2],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":1,"acting_primary":1,"purged_snaps":[]},{"pgid":"3.9","version":"0'0","reported_seq":10,"reported_epoch":17,"state":"active+clean","last_fresh":"2023-08-01T19:54:04.457820+0000","last_change":"2023-08-01T19:54:04.065519+0000","last_active":"2023-08-01T19:54:04.457820+0000","last_peered":"2023-08-01T19:54:04.457820+0000","last_clean":"2023-08-01T19:54:04.457820+0000","last_became_active":"2023-08-01T19:54:04.065211+0000","last_became_peered":"2023-08-01T19:54:04.065211+0000","last_unstale":"2023-08-01T19:54:04.457820+0000","last_undegraded":"2023-08-01T19:54:04.457820+0000","last_fullsized":"2023-08-01T19:54:04.457820+0000","mapping_epoch":15,"log_start":"0'0","ondisk_log_start":"0'0","created":15,"last_epoch_clean":16,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-08-01T19:54:03.032665+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-08-01T19:54:03.032665+0000","last_clean_scrub_stamp":"2023-08-01T19:54:03.032665+0000","objects_scrubbed":0,"log_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-08-03T05:46:27.672957+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[2,1],"acting":[2,1],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":2,"acting_primary":2,"purged_snaps":[]},{"pgid":"4.e","version":"0'0","reported_seq":8,"reported_epoch":17,"state":"active+clean","last_fresh":"2023-08-01T19:54:04.473750+0000","last_change":"2023-08-01T19:54:04.473750+0000","last_active":"2023-08-01T19:54:04.473750+0000","last_peered":"2023-08-01T19:54:04.473750+0000","last_clean":"2023-08-01T19:54:04.473750+0000","last_became_active":"2023-08-01T19:54:04.471512+0000","last_became_peered":"2023-08-01T19:54:04.471512+0000","last_unstale":"2023-08-01T19:54:04.473750+0000","last_undegraded":"2023-08-01T19:54:04.473750+0000","last_fullsized":"2023-08-01T19:54:04.473750+0000","mapping_epoch":16,"log_start":"0'0","ondisk_log_start":"0'0","created":16,"last_epoch_clean":17,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-08-01T19:54:04.040663+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-08-01T19:54:04.040663+0000","last_clean_scrub_stamp":"2023-08-01T19:54:04.040663+0000","objects_scrubbed":0,"log_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-08-03T05:13:38.298401+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[1,2],"acting":[1,2],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":1,"acting_primary":1,"purged_snaps":[]},{"pgid":"3.8","version":"0'0","reported_seq":10,"reported_epoch":17,"state":"active+clean","last_fresh":"2023-08-01T19:54:04.458299+0000","last_change":"2023-08-01T19:54:04.063990+0000","last_active":"2023-08-01T19:54:04.458299+0000","last_peered":"2023-08-01T19:54:04.458299+0000","last_clean":"2023-08-01T19:54:04.458299+0000","last_became_active":"2023-08-01T19:54:04.063652+0000","last_became_peered":"2023-08-01T19:54:04.063652+0000","last_unstale":"2023-08-01T19:54:04.458299+0000","last_undegraded":"2023-08-01T19:54:04.458299+0000","last_fullsized":"2023-08-01T19:54:04.458299+0000","mapping_epoch":15,"log_start":"0'0","ondisk_log_start":"0'0","created":15,"last_epoch_clean":16,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-08-01T19:54:03.032665+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-08-01T19:54:03.032665+0000","last_clean_scrub_stamp":"2023-08-01T19:54:03.032665+0000","objects_scrubbed":0,"log_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-08-03T05:30:28.028091+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[2,0],"acting":[2,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":2,"acting_primary":2,"purged_snaps":[]},{"pgid":"4.f","version":"0'0","reported_seq":8,"reported_epoch":17,"state":"active+clean","last_fresh":"2023-08-01T19:54:04.469648+0000","last_change":"2023-08-01T19:54:04.469648+0000","last_active":"2023-08-01T19:54:04.469648+0000","last_peered":"2023-08-01T19:54:04.469648+0000","last_clean":"2023-08-01T19:54:04.469648+0000","last_became_active":"2023-08-01T19:54:04.468445+0000","last_became_peered":"2023-08-01T19:54:04.468445+0000","last_unstale":"2023-08-01T19:54:04.469648+0000","last_undegraded":"2023-08-01T19:54:04.469648+0000","last_fullsized":"2023-08-01T19:54:04.469648+0000","mapping_epoch":16,"log_start":"0'0","ondisk_log_start":"0'0","created":16,"last_epoch_clean":17,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-08-01T19:54:04.040663+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-08-01T19:54:04.040663+0000","last_clean_scrub_stamp":"2023-08-01T19:54:04.040663+0000","objects_scrubbed":0,"log_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-08-03T05:46:11.085577+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[0,2],"acting":[0,2],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":0,"acting_primary":0,"purged_snaps":[]},{"pgid":"2.4","version":"0'0","reported_seq":12,"reported_epoch":16,"state":"active+clean","last_fresh":"2023-08-01T19:54:04.062005+0000","last_change":"2023-08-01T19:53:58.973838+0000","last_active":"2023-08-01T19:54:04.062005+0000","last_peered":"2023-08-01T19:54:04.062005+0000","last_clean":"2023-08-01T19:54:04.062005+0000","last_became_active":"2023-08-01T19:53:58.973242+0000","last_became_peered":"2023-08-01T19:53:58.973242+0000","last_unstale":"2023-08-01T19:54:04.062005+0000","last_undegraded":"2023-08-01T19:54:04.062005+0000","last_fullsized":"2023-08-01T19:54:04.062005+0000","mapping_epoch":12,"log_start":"0'0","ondisk_log_start":"0'0","created":12,"last_epoch_clean":13,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-08-01T19:53:57.959448+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-08-01T19:53:57.959448+0000","last_clean_scrub_stamp":"2023-08-01T19:53:57.959448+0000","objects_scrubbed":0,"log_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-08-03T00:09:48.796549+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[0,2],"acting":[0,2],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":0,"acting_primary":0,"purged_snaps":[]},{"pgid":"3.5","version":"0'0","reported_seq":9,"reported_epoch":16,"state":"active+clean","last_fresh":"2023-08-01T19:54:04.066960+0000","last_change":"2023-08-01T19:54:04.065255+0000","last_active":"2023-08-01T19:54:04.066960+0000","last_peered":"2023-08-01T19:54:04.066960+0000","last_clean":"2023-08-01T19:54:04.066960+0000","last_became_active":"2023-08-01T19:54:04.064814+0000","last_became_peered":"2023-08-01T19:54:04.064814+0000","last_unstale":"2023-08-01T19:54:04.066960+0000","last_undegraded":"2023-08-01T19:54:04.066960+0000","last_fullsized":"2023-08-01T19:54:04.066960+0000","mapping_epoch":15,"log_start":"0'0","ondisk_log_start":"0'0","created":15,"last_epoch_clean":16,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-08-01T19:54:03.032665+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-08-01T19:54:03.032665+0000","last_clean_scrub_stamp":"2023-08-01T19:54:03.032665+0000","objects_scrubbed":0,"log_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-08-03T02:01:47.073630+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[1,0],"acting":[1,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":1,"acting_primary":1,"purged_snaps":[]},{"pgid":"4.2","version":"0'0","reported_seq":9,"reported_epoch":17,"state":"active+clean","last_fresh":"2023-08-01T19:54:04.473868+0000","last_change":"2023-08-01T19:54:04.471715+0000","last_active":"2023-08-01T19:54:04.473868+0000","last_peered":"2023-08-01T19:54:04.473868+0000","last_clean":"2023-08-01T19:54:04.473868+0000","last_became_active":"2023-08-01T19:54:04.471300+0000","last_became_peered":"2023-08-01T19:54:04.471300+0000","last_unstale":"2023-08-01T19:54:04.473868+0000","last_undegraded":"2023-08-01T19:54:04.473868+0000","last_fullsized":"2023-08-01T19:54:04.473868+0000","mapping_epoch":16,"log_start":"0'0","ondisk_log_start":"0'0","created":16,"last_epoch_clean":17,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-08-01T19:54:04.040663+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-08-01T19:54:04.040663+0000","last_clean_scrub_stamp":"2023-08-01T19:54:04.040663+0000","objects_scrubbed":0,"log_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-08-02T23:00:24.980203+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[2,1],"acting":[2,1],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":2,"acting_primary":2,"purged_snaps":[]},{"pgid":"2.2","version":"0'0","reported_seq":12,"reported_epoch":16,"state":"active+clean","last_fresh":"2023-08-01T19:54:04.058293+0000","last_change":"2023-08-01T19:53:58.973665+0000","last_active":"2023-08-01T19:54:04.058293+0000","last_peered":"2023-08-01T19:54:04.058293+0000","last_clean":"2023-08-01T19:54:04.058293+0000","last_became_active":"2023-08-01T19:53:58.973463+0000","last_became_peered":"2023-08-01T19:53:58.973463+0000","last_unstale":"2023-08-01T19:54:04.058293+0000","last_undegraded":"2023-08-01T19:54:04.058293+0000","last_fullsized":"2023-08-01T19:54:04.058293+0000","mapping_epoch":12,"log_start":"0'0","ondisk_log_start":"0'0","created":12,"last_epoch_clean":13,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-08-01T19:53:57.959448+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-08-01T19:53:57.959448+0000","last_clean_scrub_stamp":"2023-08-01T19:53:57.959448+0000","objects_scrubbed":0,"log_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-08-03T04:50:42.368892+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[1,0],"acting":[1,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":1,"acting_primary":1,"purged_snaps":[]},{"pgid":"3.3","version":"0'0","reported_seq":9,"reported_epoch":16,"state":"active+clean","last_fresh":"2023-08-01T19:54:04.067001+0000","last_change":"2023-08-01T19:54:04.065415+0000","last_active":"2023-08-01T19:54:04.067001+0000","last_peered":"2023-08-01T19:54:04.067001+0000","last_clean":"2023-08-01T19:54:04.067001+0000","last_became_active":"2023-08-01T19:54:04.065030+0000","last_became_peered":"2023-08-01T19:54:04.065030+0000","last_unstale":"2023-08-01T19:54:04.067001+0000","last_undegraded":"2023-08-01T19:54:04.067001+0000","last_fullsized":"2023-08-01T19:54:04.067001+0000","mapping_epoch":15,"log_start":"0'0","ondisk_log_start":"0'0","created":15,"last_epoch_clean":16,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-08-01T19:54:03.032665+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-08-01T19:54:03.032665+0000","last_clean_scrub_stamp":"2023-08-01T19:54:03.032665+0000","objects_scrubbed":0,"log_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-08-02T21:33:27.007118+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[1,0],"acting":[1,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":1,"acting_primary":1,"purged_snaps":[]},{"pgid":"4.4","version":"0'0","reported_seq":8,"reported_epoch":17,"state":"active+clean","last_fresh":"2023-08-01T19:54:04.468101+0000","last_change":"2023-08-01T19:54:04.468101+0000","last_active":"2023-08-01T19:54:04.468101+0000","last_peered":"2023-08-01T19:54:04.468101+0000","last_clean":"2023-08-01T19:54:04.468101+0000","last_became_active":"2023-08-01T19:54:04.467409+0000","last_became_peered":"2023-08-01T19:54:04.467409+0000","last_unstale":"2023-08-01T19:54:04.468101+0000","last_undegraded":"2023-08-01T19:54:04.468101+0000","last_fullsized":"2023-08-01T19:54:04.468101+0000","mapping_epoch":16,"log_start":"0'0","ondisk_log_start":"0'0","created":16,"last_epoch_clean":17,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-08-01T19:54:04.040663+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-08-01T19:54:04.040663+0000","last_clean_scrub_stamp":"2023-08-01T19:54:04.040663+0000","objects_scrubbed":0,"log_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-08-02T21:43:30.325991+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[0,2],"acting":[0,2],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":0,"acting_primary":0,"purged_snaps":[]},{"pgid":"2.1","version":"0'0","reported_seq":12,"reported_epoch":16,"state":"active+clean","last_fresh":"2023-08-01T19:54:04.061378+0000","last_change":"2023-08-01T19:53:58.973700+0000","last_active":"2023-08-01T19:54:04.061378+0000","last_peered":"2023-08-01T19:54:04.061378+0000","last_clean":"2023-08-01T19:54:04.061378+0000","last_became_active":"2023-08-01T19:53:58.973285+0000","last_became_peered":"2023-08-01T19:53:58.973285+0000","last_unstale":"2023-08-01T19:54:04.061378+0000","last_undegraded":"2023-08-01T19:54:04.061378+0000","last_fullsized":"2023-08-01T19:54:04.061378+0000","mapping_epoch":12,"log_start":"0'0","ondisk_log_start":"0'0","created":12,"last_epoch_clean":13,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-08-01T19:53:57.959448+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-08-01T19:53:57.959448+0000","last_clean_scrub_stamp":"2023-08-01T19:53:57.959448+0000","objects_scrubbed":0,"log_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-08-02T21:26:02.570824+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[0,2],"acting":[0,2],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":0,"acting_primary":0,"purged_snaps":[]},{"pgid":"3.0","version":"0'0","reported_seq":10,"reported_epoch":17,"state":"active+clean","last_fresh":"2023-08-01T19:54:04.457828+0000","last_change":"2023-08-01T19:54:04.064407+0000","last_active":"2023-08-01T19:54:04.457828+0000","last_peered":"2023-08-01T19:54:04.457828+0000","last_clean":"2023-08-01T19:54:04.457828+0000","last_became_active":"2023-08-01T19:54:04.064122+0000","last_became_peered":"2023-08-01T19:54:04.064122+0000","last_unstale":"2023-08-01T19:54:04.457828+0000","last_undegraded":"2023-08-01T19:54:04.457828+0000","last_fullsized":"2023-08-01T19:54:04.457828+0000","mapping_epoch":15,"log_start":"0'0","ondisk_log_start":"0'0","created":15,"last_epoch_clean":16,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-08-01T19:54:03.032665+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-08-01T19:54:03.032665+0000","last_clean_scrub_stamp":"2023-08-01T19:54:03.032665+0000","objects_scrubbed":0,"log_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-08-03T07:08:17.318689+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[2,1],"acting":[2,1],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":2,"acting_primary":2,"purged_snaps":[]},{"pgid":"4.7","version":"0'0","reported_seq":8,"reported_epoch":17,"state":"active+clean","last_fresh":"2023-08-01T19:54:04.469739+0000","last_change":"2023-08-01T19:54:04.469739+0000","last_active":"2023-08-01T19:54:04.469739+0000","last_peered":"2023-08-01T19:54:04.469739+0000","last_clean":"2023-08-01T19:54:04.469739+0000","last_became_active":"2023-08-01T19:54:04.468021+0000","last_became_peered":"2023-08-01T19:54:04.468021+0000","last_unstale":"2023-08-01T19:54:04.469739+0000","last_undegraded":"2023-08-01T19:54:04.469739+0000","last_fullsized":"2023-08-01T19:54:04.469739+0000","mapping_epoch":16,"log_start":"0'0","ondisk_log_start":"0'0","created":16,"last_epoch_clean":17,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-08-01T19:54:04.040663+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-08-01T19:54:04.040663+0000","last_clean_scrub_stamp":"2023-08-01T19:54:04.040663+0000","objects_scrubbed":0,"log_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-08-02T21:03:01.319028+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[0,2],"acting":[0,2],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":0,"acting_primary":0,"purged_snaps":[]},{"pgid":"2.3","version":"0'0","reported_seq":12,"reported_epoch":16,"state":"active+clean","last_fresh":"2023-08-01T19:54:04.058424+0000","last_change":"2023-08-01T19:53:58.973768+0000","last_active":"2023-08-01T19:54:04.058424+0000","last_peered":"2023-08-01T19:54:04.058424+0000","last_clean":"2023-08-01T19:54:04.058424+0000","last_became_active":"2023-08-01T19:53:58.973492+0000","last_became_peered":"2023-08-01T19:53:58.973492+0000","last_unstale":"2023-08-01T19:54:04.058424+0000","last_undegraded":"2023-08-01T19:54:04.058424+0000","last_fullsized":"2023-08-01T19:54:04.058424+0000","mapping_epoch":12,"log_start":"0'0","ondisk_log_start":"0'0","created":12,"last_epoch_clean":13,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-08-01T19:53:57.959448+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-08-01T19:53:57.959448+0000","last_clean_scrub_stamp":"2023-08-01T19:53:57.959448+0000","objects_scrubbed":0,"log_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-08-03T02:04:52.034667+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[1,0],"acting":[1,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":1,"acting_primary":1,"purged_snaps":[]},{"pgid":"1.0","version":"10'157","reported_seq":211,"reported_epoch":16,"state":"active+clean","last_fresh":"2023-08-01T19:54:04.058061+0000","last_change":"2023-08-01T19:53:51.746910+0000","last_active":"2023-08-01T19:54:04.058061+0000","last_peered":"2023-08-01T19:54:04.058061+0000","last_clean":"2023-08-01T19:54:04.058061+0000","last_became_active":"2023-08-01T19:53:51.746590+0000","last_became_peered":"2023-08-01T19:53:51.746590+0000","last_unstale":"2023-08-01T19:54:04.058061+0000","last_undegraded":"2023-08-01T19:54:04.058061+0000","last_fullsized":"2023-08-01T19:54:04.058061+0000","mapping_epoch":9,"log_start":"0'0","ondisk_log_start":"0'0","created":9,"last_epoch_clean":10,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-08-01T19:53:50.735626+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-08-01T19:53:50.735626+0000","last_clean_scrub_stamp":"2023-08-01T19:53:50.735626+0000","objects_scrubbed":0,"log_size":157,"ondisk_log_size":157,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-08-03T02:56:50.228294+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":590368,"num_objects":2,"num_object_clones":0,"num_object_copies":4,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":2,"num_whiteouts":0,"num_read":136,"num_read_kb":118,"num_write":203,"num_write_kb":3460,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[1,2],"acting":[1,2],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":1,"acting_primary":1,"purged_snaps":[]},{"pgid":"3.2","version":"0'0","reported_seq":9,"reported_epoch":16,"state":"active+clean","last_fresh":"2023-08-01T19:54:04.065343+0000","last_change":"2023-08-01T19:54:04.064009+0000","last_active":"2023-08-01T19:54:04.065343+0000","last_peered":"2023-08-01T19:54:04.065343+0000","last_clean":"2023-08-01T19:54:04.065343+0000","last_became_active":"2023-08-01T19:54:04.063665+0000","last_became_peered":"2023-08-01T19:54:04.063665+0000","last_unstale":"2023-08-01T19:54:04.065343+0000","last_undegraded":"2023-08-01T19:54:04.065343+0000","last_fullsized":"2023-08-01T19:54:04.065343+0000","mapping_epoch":15,"log_start":"0'0","ondisk_log_start":"0'0","created":15,"last_epoch_clean":16,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-08-01T19:54:03.032665+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-08-01T19:54:03.032665+0000","last_clean_scrub_stamp":"2023-08-01T19:54:03.032665+0000","objects_scrubbed":0,"log_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-08-03T04:04:46.983253+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[0,2],"acting":[0,2],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":0,"acting_primary":0,"purged_snaps":[]},{"pgid":"4.5","version":"0'0","reported_seq":8,"reported_epoch":17,"state":"active+clean","last_fresh":"2023-08-01T19:54:04.474061+0000","last_change":"2023-08-01T19:54:04.474061+0000","last_active":"2023-08-01T19:54:04.474061+0000","last_peered":"2023-08-01T19:54:04.474061+0000","last_clean":"2023-08-01T19:54:04.474061+0000","last_became_active":"2023-08-01T19:54:04.472128+0000","last_became_peered":"2023-08-01T19:54:04.472128+0000","last_unstale":"2023-08-01T19:54:04.474061+0000","last_undegraded":"2023-08-01T19:54:04.474061+0000","last_fullsized":"2023-08-01T19:54:04.474061+0000","mapping_epoch":16,"log_start":"0'0","ondisk_log_start":"0'0","created":16,"last_epoch_clean":17,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-08-01T19:54:04.040663+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-08-01T19:54:04.040663+0000","last_clean_scrub_stamp":"2023-08-01T19:54:04.040663+0000","objects_scrubbed":0,"log_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-08-03T00:29:05.857138+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[1,2],"acting":[1,2],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":1,"acting_primary":1,"purged_snaps":[]},{"pgid":"2.0","version":"0'0","reported_seq":12,"reported_epoch":16,"state":"active+clean","last_fresh":"2023-08-01T19:54:04.058064+0000","last_change":"2023-08-01T19:53:58.975968+0000","last_active":"2023-08-01T19:54:04.058064+0000","last_peered":"2023-08-01T19:54:04.058064+0000","last_clean":"2023-08-01T19:54:04.058064+0000","last_became_active":"2023-08-01T19:53:58.975706+0000","last_became_peered":"2023-08-01T19:53:58.975706+0000","last_unstale":"2023-08-01T19:54:04.058064+0000","last_undegraded":"2023-08-01T19:54:04.058064+0000","last_fullsized":"2023-08-01T19:54:04.058064+0000","mapping_epoch":12,"log_start":"0'0","ondisk_log_start":"0'0","created":12,"last_epoch_clean":13,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-08-01T19:53:57.959448+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-08-01T19:53:57.959448+0000","last_clean_scrub_stamp":"2023-08-01T19:53:57.959448+0000","objects_scrubbed":0,"log_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-08-03T00:02:15.204280+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[1,2],"acting":[1,2],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":1,"acting_primary":1,"purged_snaps":[]},{"pgid":"3.1","version":"0'0","reported_seq":9,"reported_epoch":16,"state":"active+clean","last_fresh":"2023-08-01T19:54:04.068652+0000","last_change":"2023-08-01T19:54:04.066707+0000","last_active":"2023-08-01T19:54:04.068652+0000","last_peered":"2023-08-01T19:54:04.068652+0000","last_clean":"2023-08-01T19:54:04.068652+0000","last_became_active":"2023-08-01T19:54:04.066334+0000","last_became_peered":"2023-08-01T19:54:04.066334+0000","last_unstale":"2023-08-01T19:54:04.068652+0000","last_undegraded":"2023-08-01T19:54:04.068652+0000","last_fullsized":"2023-08-01T19:54:04.068652+0000","mapping_epoch":15,"log_start":"0'0","ondisk_log_start":"0'0","created":15,"last_epoch_clean":16,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-08-01T19:54:03.032665+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-08-01T19:54:03.032665+0000","last_clean_scrub_stamp":"2023-08-01T19:54:03.032665+0000","objects_scrubbed":0,"log_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-08-03T02:40:15.210599+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[0,1],"acting":[0,1],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":0,"acting_primary":0,"purged_snaps":[]},{"pgid":"4.6","version":"0'0","reported_seq":9,"reported_epoch":17,"state":"active+clean","last_fresh":"2023-08-01T19:54:04.471325+0000","last_change":"2023-08-01T19:54:04.469877+0000","last_active":"2023-08-01T19:54:04.471325+0000","last_peered":"2023-08-01T19:54:04.471325+0000","last_clean":"2023-08-01T19:54:04.471325+0000","last_became_active":"2023-08-01T19:54:04.469528+0000","last_became_peered":"2023-08-01T19:54:04.469528+0000","last_unstale":"2023-08-01T19:54:04.471325+0000","last_undegraded":"2023-08-01T19:54:04.471325+0000","last_fullsized":"2023-08-01T19:54:04.471325+0000","mapping_epoch":16,"log_start":"0'0","ondisk_log_start":"0'0","created":16,"last_epoch_clean":17,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-08-01T19:54:04.040663+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-08-01T19:54:04.040663+0000","last_clean_scrub_stamp":"2023-08-01T19:54:04.040663+0000","objects_scrubbed":0,"log_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-08-03T02:24:19.067602+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[2,0],"acting":[2,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":2,"acting_primary":2,"purged_snaps":[]},{"pgid":"2.5","version":"0'0","reported_seq":13,"reported_epoch":17,"state":"active+clean","last_fresh":"2023-08-01T19:54:04.459098+0000","last_change":"2023-08-01T19:53:58.970683+0000","last_active":"2023-08-01T19:54:04.459098+0000","last_peered":"2023-08-01T19:54:04.459098+0000","last_clean":"2023-08-01T19:54:04.459098+0000","last_became_active":"2023-08-01T19:53:58.970437+0000","last_became_peered":"2023-08-01T19:53:58.970437+0000","last_unstale":"2023-08-01T19:54:04.459098+0000","last_undegraded":"2023-08-01T19:54:04.459098+0000","last_fullsized":"2023-08-01T19:54:04.459098+0000","mapping_epoch":12,"log_start":"0'0","ondisk_log_start":"0'0","created":12,"last_epoch_clean":13,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-08-01T19:53:57.959448+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-08-01T19:53:57.959448+0000","last_clean_scrub_stamp":"2023-08-01T19:53:57.959448+0000","objects_scrubbed":0,"log_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-08-02T23:54:08.273426+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[2,0],"acting":[2,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":2,"acting_primary":2,"purged_snaps":[]},{"pgid":"3.4","version":"0'0","reported_seq":9,"reported_epoch":16,"state":"active+clean","last_fresh":"2023-08-01T19:54:04.062998+0000","last_change":"2023-08-01T19:54:04.062283+0000","last_active":"2023-08-01T19:54:04.062998+0000","last_peered":"2023-08-01T19:54:04.062998+0000","last_clean":"2023-08-01T19:54:04.062998+0000","last_became_active":"2023-08-01T19:54:04.061796+0000","last_became_peered":"2023-08-01T19:54:04.061796+0000","last_unstale":"2023-08-01T19:54:04.062998+0000","last_undegraded":"2023-08-01T19:54:04.062998+0000","last_fullsized":"2023-08-01T19:54:04.062998+0000","mapping_epoch":15,"log_start":"0'0","ondisk_log_start":"0'0","created":15,"last_epoch_clean":16,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-08-01T19:54:03.032665+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-08-01T19:54:03.032665+0000","last_clean_scrub_stamp":"2023-08-01T19:54:03.032665+0000","objects_scrubbed":0,"log_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-08-02T19:54:08.401797+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[0,2],"acting":[0,2],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":0,"acting_primary":0,"purged_snaps":[]},{"pgid":"4.3","version":"0'0","reported_seq":9,"reported_epoch":17,"state":"active+clean","last_fresh":"2023-08-01T19:54:04.474487+0000","last_change":"2023-08-01T19:54:04.473088+0000","last_active":"2023-08-01T19:54:04.474487+0000","last_peered":"2023-08-01T19:54:04.474487+0000","last_clean":"2023-08-01T19:54:04.474487+0000","last_became_active":"2023-08-01T19:54:04.472611+0000","last_became_peered":"2023-08-01T19:54:04.472611+0000","last_unstale":"2023-08-01T19:54:04.474487+0000","last_undegraded":"2023-08-01T19:54:04.474487+0000","last_fullsized":"2023-08-01T19:54:04.474487+0000","mapping_epoch":16,"log_start":"0'0","ondisk_log_start":"0'0","created":16,"last_epoch_clean":17,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-08-01T19:54:04.040663+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-08-01T19:54:04.040663+0000","last_clean_scrub_stamp":"2023-08-01T19:54:04.040663+0000","objects_scrubbed":0,"log_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-08-03T07:27:26.537518+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[2,1],"acting":[2,1],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":2,"acting_primary":2,"purged_snaps":[]},{"pgid":"3.7","version":"17'2","reported_seq":11,"reported_epoch":17,"state":"active+clean","last_fresh":"2023-08-01T19:54:04.469241+0000","last_change":"2023-08-01T19:54:04.065147+0000","last_active":"2023-08-01T19:54:04.469241+0000","last_peered":"2023-08-01T19:54:04.469241+0000","last_clean":"2023-08-01T19:54:04.469241+0000","last_became_active":"2023-08-01T19:54:04.064779+0000","last_became_peered":"2023-08-01T19:54:04.064779+0000","last_unstale":"2023-08-01T19:54:04.469241+0000","last_undegraded":"2023-08-01T19:54:04.469241+0000","last_fullsized":"2023-08-01T19:54:04.469241+0000","mapping_epoch":15,"log_start":"0'0","ondisk_log_start":"0'0","created":15,"last_epoch_clean":16,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-08-01T19:54:03.032665+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-08-01T19:54:03.032665+0000","last_clean_scrub_stamp":"2023-08-01T19:54:03.032665+0000","objects_scrubbed":0,"log_size":2,"ondisk_log_size":2,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-08-03T03:43:45.667663+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":1,"num_object_clones":0,"num_object_copies":2,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":1,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":3,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":1,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[0,2],"acting":[0,2],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":0,"acting_primary":0,"purged_snaps":[]},{"pgid":"2.6","version":"0'0","reported_seq":12,"reported_epoch":16,"state":"active+clean","last_fresh":"2023-08-01T19:54:04.061844+0000","last_change":"2023-08-01T19:53:58.974077+0000","last_active":"2023-08-01T19:54:04.061844+0000","last_peered":"2023-08-01T19:54:04.061844+0000","last_clean":"2023-08-01T19:54:04.061844+0000","last_became_active":"2023-08-01T19:53:58.973396+0000","last_became_peered":"2023-08-01T19:53:58.973396+0000","last_unstale":"2023-08-01T19:54:04.061844+0000","last_undegraded":"2023-08-01T19:54:04.061844+0000","last_fullsized":"2023-08-01T19:54:04.061844+0000","mapping_epoch":12,"log_start":"0'0","ondisk_log_start":"0'0","created":12,"last_epoch_clean":13,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-08-01T19:53:57.959448+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-08-01T19:53:57.959448+0000","last_clean_scrub_stamp":"2023-08-01T19:53:57.959448+0000","objects_scrubbed":0,"log_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-08-02T22:13:50.940864+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[0,2],"acting":[0,2],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":0,"acting_primary":0,"purged_snaps":[]},{"pgid":"4.0","version":"0'0","reported_seq":8,"reported_epoch":17,"state":"active+clean","last_fresh":"2023-08-01T19:54:04.476807+0000","last_change":"2023-08-01T19:54:04.476807+0000","last_active":"2023-08-01T19:54:04.476807+0000","last_peered":"2023-08-01T19:54:04.476807+0000","last_clean":"2023-08-01T19:54:04.476807+0000","last_became_active":"2023-08-01T19:54:04.476453+0000","last_became_peered":"2023-08-01T19:54:04.476453+0000","last_unstale":"2023-08-01T19:54:04.476807+0000","last_undegraded":"2023-08-01T19:54:04.476807+0000","last_fullsized":"2023-08-01T19:54:04.476807+0000","mapping_epoch":16,"log_start":"0'0","ondisk_log_start":"0'0","created":16,"last_epoch_clean":17,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-08-01T19:54:04.040663+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-08-01T19:54:04.040663+0000","last_clean_scrub_stamp":"2023-08-01T19:54:04.040663+0000","objects_scrubbed":0,"log_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-08-02T20:20:59.989030+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[0,1],"acting":[0,1],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":0,"acting_primary":0,"purged_snaps":[]},{"pgid":"2.7","version":"0'0","reported_seq":12,"reported_epoch":16,"state":"active+clean","last_fresh":"2023-08-01T19:54:04.058795+0000","last_change":"2023-08-01T19:53:58.975936+0000","last_active":"2023-08-01T19:54:04.058795+0000","last_peered":"2023-08-01T19:54:04.058795+0000","last_clean":"2023-08-01T19:54:04.058795+0000","last_became_active":"2023-08-01T19:53:58.975680+0000","last_became_peered":"2023-08-01T19:53:58.975680+0000","last_unstale":"2023-08-01T19:54:04.058795+0000","last_undegraded":"2023-08-01T19:54:04.058795+0000","last_fullsized":"2023-08-01T19:54:04.058795+0000","mapping_epoch":12,"log_start":"0'0","ondisk_log_start":"0'0","created":12,"last_epoch_clean":13,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-08-01T19:53:57.959448+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-08-01T19:53:57.959448+0000","last_clean_scrub_stamp":"2023-08-01T19:53:57.959448+0000","objects_scrubbed":0,"log_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-08-03T05:17:03.508898+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[1,2],"acting":[1,2],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":1,"acting_primary":1,"purged_snaps":[]},{"pgid":"3.6","version":"0'0","reported_seq":9,"reported_epoch":16,"state":"active+clean","last_fresh":"2023-08-01T19:54:04.068935+0000","last_change":"2023-08-01T19:54:04.068041+0000","last_active":"2023-08-01T19:54:04.068935+0000","last_peered":"2023-08-01T19:54:04.068935+0000","last_clean":"2023-08-01T19:54:04.068935+0000","last_became_active":"2023-08-01T19:54:04.067613+0000","last_became_peered":"2023-08-01T19:54:04.067613+0000","last_unstale":"2023-08-01T19:54:04.068935+0000","last_undegraded":"2023-08-01T19:54:04.068935+0000","last_fullsized":"2023-08-01T19:54:04.068935+0000","mapping_epoch":15,"log_start":"0'0","ondisk_log_start":"0'0","created":15,"last_epoch_clean":16,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-08-01T19:54:03.032665+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-08-01T19:54:03.032665+0000","last_clean_scrub_stamp":"2023-08-01T19:54:03.032665+0000","objects_scrubbed":0,"log_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-08-02T21:35:44.874727+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[0,1],"acting":[0,1],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":0,"acting_primary":0,"purged_snaps":[]},{"pgid":"4.1","version":"0'0","reported_seq":9,"reported_epoch":17,"state":"active+clean","last_fresh":"2023-08-01T19:54:04.470826+0000","last_change":"2023-08-01T19:54:04.469243+0000","last_active":"2023-08-01T19:54:04.470826+0000","last_peered":"2023-08-01T19:54:04.470826+0000","last_clean":"2023-08-01T19:54:04.470826+0000","last_became_active":"2023-08-01T19:54:04.468835+0000","last_became_peered":"2023-08-01T19:54:04.468835+0000","last_unstale":"2023-08-01T19:54:04.470826+0000","last_undegraded":"2023-08-01T19:54:04.470826+0000","last_fullsized":"2023-08-01T19:54:04.470826+0000","mapping_epoch":16,"log_start":"0'0","ondisk_log_start":"0'0","created":16,"last_epoch_clean":17,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-08-01T19:54:04.040663+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-08-01T19:54:04.040663+0000","last_clean_scrub_stamp":"2023-08-01T19:54:04.040663+0000","objects_scrubbed":0,"log_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-08-03T04:43:58.358628+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[2,1],"acting":[2,1],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":2,"acting_primary":2,"purged_snaps":[]},{"pgid":"3.1b","version":"17'1","reported_seq":11,"reported_epoch":17,"state":"active+clean","last_fresh":"2023-08-01T19:54:04.471524+0000","last_change":"2023-08-01T19:54:04.066748+0000","last_active":"2023-08-01T19:54:04.471524+0000","last_peered":"2023-08-01T19:54:04.471524+0000","last_clean":"2023-08-01T19:54:04.471524+0000","last_became_active":"2023-08-01T19:54:04.066483+0000","last_became_peered":"2023-08-01T19:54:04.066483+0000","last_unstale":"2023-08-01T19:54:04.471524+0000","last_undegraded":"2023-08-01T19:54:04.471524+0000","last_fullsized":"2023-08-01T19:54:04.471524+0000","mapping_epoch":15,"log_start":"0'0","ondisk_log_start":"0'0","created":15,"last_epoch_clean":16,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-08-01T19:54:03.032665+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-08-01T19:54:03.032665+0000","last_clean_scrub_stamp":"2023-08-01T19:54:03.032665+0000","objects_scrubbed":0,"log_size":1,"ondisk_log_size":1,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-08-03T03:08:26.880362+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[2,1],"acting":[2,1],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":2,"acting_primary":2,"purged_snaps":[]},{"pgid":"4.1c","version":"0'0","reported_seq":9,"reported_epoch":17,"state":"active+clean","last_fresh":"2023-08-01T19:54:04.468766+0000","last_change":"2023-08-01T19:54:04.466766+0000","last_active":"2023-08-01T19:54:04.468766+0000","last_peered":"2023-08-01T19:54:04.468766+0000","last_clean":"2023-08-01T19:54:04.468766+0000","last_became_active":"2023-08-01T19:54:04.466417+0000","last_became_peered":"2023-08-01T19:54:04.466417+0000","last_unstale":"2023-08-01T19:54:04.468766+0000","last_undegraded":"2023-08-01T19:54:04.468766+0000","last_fullsized":"2023-08-01T19:54:04.468766+0000","mapping_epoch":16,"log_start":"0'0","ondisk_log_start":"0'0","created":16,"last_epoch_clean":17,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-08-01T19:54:04.040663+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-08-01T19:54:04.040663+0000","last_clean_scrub_stamp":"2023-08-01T19:54:04.040663+0000","objects_scrubbed":0,"log_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-08-02T22:01:53.643825+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[2,0],"acting":[2,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":2,"acting_primary":2,"purged_snaps":[]},{"pgid":"3.1c","version":"17'2","reported_seq":11,"reported_epoch":17,"state":"active+clean","last_fresh":"2023-08-01T19:54:04.477636+0000","last_change":"2023-08-01T19:54:04.065706+0000","last_active":"2023-08-01T19:54:04.477636+0000","last_peered":"2023-08-01T19:54:04.477636+0000","last_clean":"2023-08-01T19:54:04.477636+0000","last_became_active":"2023-08-01T19:54:04.064796+0000","last_became_peered":"2023-08-01T19:54:04.064796+0000","last_unstale":"2023-08-01T19:54:04.477636+0000","last_undegraded":"2023-08-01T19:54:04.477636+0000","last_fullsized":"2023-08-01T19:54:04.477636+0000","mapping_epoch":15,"log_start":"0'0","ondisk_log_start":"0'0","created":15,"last_epoch_clean":16,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-08-01T19:54:03.032665+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-08-01T19:54:03.032665+0000","last_clean_scrub_stamp":"2023-08-01T19:54:03.032665+0000","objects_scrubbed":0,"log_size":2,"ondisk_log_size":2,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-08-02T21:40:43.596301+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":1,"num_object_clones":0,"num_object_copies":2,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":1,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":3,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":1,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[1,0],"acting":[1,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":1,"acting_primary":1,"purged_snaps":[]},{"pgid":"4.1b","version":"0'0","reported_seq":8,"reported_epoch":17,"state":"active+clean","last_fresh":"2023-08-01T19:54:04.474971+0000","last_change":"2023-08-01T19:54:04.474971+0000","last_active":"2023-08-01T19:54:04.474971+0000","last_peered":"2023-08-01T19:54:04.474971+0000","last_clean":"2023-08-01T19:54:04.474971+0000","last_became_active":"2023-08-01T19:54:04.473957+0000","last_became_peered":"2023-08-01T19:54:04.473957+0000","last_unstale":"2023-08-01T19:54:04.474971+0000","last_undegraded":"2023-08-01T19:54:04.474971+0000","last_fullsized":"2023-08-01T19:54:04.474971+0000","mapping_epoch":16,"log_start":"0'0","ondisk_log_start":"0'0","created":16,"last_epoch_clean":17,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-08-01T19:54:04.040663+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-08-01T19:54:04.040663+0000","last_clean_scrub_stamp":"2023-08-01T19:54:04.040663+0000","objects_scrubbed":0,"log_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-08-02T21:59:19.682560+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[1,0],"acting":[1,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":1,"acting_primary":1,"purged_snaps":[]},{"pgid":"3.1d","version":"17'2","reported_seq":12,"reported_epoch":17,"state":"active+clean","last_fresh":"2023-08-01T19:54:04.471623+0000","last_change":"2023-08-01T19:54:04.065591+0000","last_active":"2023-08-01T19:54:04.471623+0000","last_peered":"2023-08-01T19:54:04.471623+0000","last_clean":"2023-08-01T19:54:04.471623+0000","last_became_active":"2023-08-01T19:54:04.065306+0000","last_became_peered":"2023-08-01T19:54:04.065306+0000","last_unstale":"2023-08-01T19:54:04.471623+0000","last_undegraded":"2023-08-01T19:54:04.471623+0000","last_fullsized":"2023-08-01T19:54:04.471623+0000","mapping_epoch":15,"log_start":"0'0","ondisk_log_start":"0'0","created":15,"last_epoch_clean":16,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-08-01T19:54:03.032665+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-08-01T19:54:03.032665+0000","last_clean_scrub_stamp":"2023-08-01T19:54:03.032665+0000","objects_scrubbed":0,"log_size":2,"ondisk_log_size":2,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-08-02T21:32:10.389227+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":1,"num_object_clones":0,"num_object_copies":2,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":1,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":3,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":1,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[2,1],"acting":[2,1],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":2,"acting_primary":2,"purged_snaps":[]},{"pgid":"4.1a","version":"0'0","reported_seq":8,"reported_epoch":17,"state":"active+clean","last_fresh":"2023-08-01T19:54:04.473302+0000","last_change":"2023-08-01T19:54:04.473302+0000","last_active":"2023-08-01T19:54:04.473302+0000","last_peered":"2023-08-01T19:54:04.473302+0000","last_clean":"2023-08-01T19:54:04.473302+0000","last_became_active":"2023-08-01T19:54:04.472452+0000","last_became_peered":"2023-08-01T19:54:04.472452+0000","last_unstale":"2023-08-01T19:54:04.473302+0000","last_undegraded":"2023-08-01T19:54:04.473302+0000","last_fullsized":"2023-08-01T19:54:04.473302+0000","mapping_epoch":16,"log_start":"0'0","ondisk_log_start":"0'0","created":16,"last_epoch_clean":17,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-08-01T19:54:04.040663+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-08-01T19:54:04.040663+0000","last_clean_scrub_stamp":"2023-08-01T19:54:04.040663+0000","objects_scrubbed":0,"log_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-08-02T21:02:39.542019+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[1,0],"acting":[1,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":1,"acting_primary":1,"purged_snaps":[]},{"pgid":"3.1e","version":"17'1","reported_seq":10,"reported_epoch":17,"state":"active+clean","last_fresh":"2023-08-01T19:54:04.460743+0000","last_change":"2023-08-01T19:54:04.064378+0000","last_active":"2023-08-01T19:54:04.460743+0000","last_peered":"2023-08-01T19:54:04.460743+0000","last_clean":"2023-08-01T19:54:04.460743+0000","last_became_active":"2023-08-01T19:54:04.063988+0000","last_became_peered":"2023-08-01T19:54:04.063988+0000","last_unstale":"2023-08-01T19:54:04.460743+0000","last_undegraded":"2023-08-01T19:54:04.460743+0000","last_fullsized":"2023-08-01T19:54:04.460743+0000","mapping_epoch":15,"log_start":"0'0","ondisk_log_start":"0'0","created":15,"last_epoch_clean":16,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-08-01T19:54:03.032665+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-08-01T19:54:03.032665+0000","last_clean_scrub_stamp":"2023-08-01T19:54:03.032665+0000","objects_scrubbed":0,"log_size":1,"ondisk_log_size":1,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-08-02T22:28:51.936138+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[0,2],"acting":[0,2],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":0,"acting_primary":0,"purged_snaps":[]},{"pgid":"4.19","version":"0'0","reported_seq":9,"reported_epoch":17,"state":"active+clean","last_fresh":"2023-08-01T19:54:04.469620+0000","last_change":"2023-08-01T19:54:04.467017+0000","last_active":"2023-08-01T19:54:04.469620+0000","last_peered":"2023-08-01T19:54:04.469620+0000","last_clean":"2023-08-01T19:54:04.469620+0000","last_became_active":"2023-08-01T19:54:04.466339+0000","last_became_peered":"2023-08-01T19:54:04.466339+0000","last_unstale":"2023-08-01T19:54:04.469620+0000","last_undegraded":"2023-08-01T19:54:04.469620+0000","last_fullsized":"2023-08-01T19:54:04.469620+0000","mapping_epoch":16,"log_start":"0'0","ondisk_log_start":"0'0","created":16,"last_epoch_clean":17,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-08-01T19:54:04.040663+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-08-01T19:54:04.040663+0000","last_clean_scrub_stamp":"2023-08-01T19:54:04.040663+0000","objects_scrubbed":0,"log_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-08-03T04:07:57.222873+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[2,0],"acting":[2,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":2,"acting_primary":2,"purged_snaps":[]},{"pgid":"3.1f","version":"17'4","reported_seq":13,"reported_epoch":17,"state":"active+clean","last_fresh":"2023-08-01T19:54:04.472208+0000","last_change":"2023-08-01T19:54:04.067767+0000","last_active":"2023-08-01T19:54:04.472208+0000","last_peered":"2023-08-01T19:54:04.472208+0000","last_clean":"2023-08-01T19:54:04.472208+0000","last_became_active":"2023-08-01T19:54:04.067414+0000","last_became_peered":"2023-08-01T19:54:04.067414+0000","last_unstale":"2023-08-01T19:54:04.472208+0000","last_undegraded":"2023-08-01T19:54:04.472208+0000","last_fullsized":"2023-08-01T19:54:04.472208+0000","mapping_epoch":15,"log_start":"0'0","ondisk_log_start":"0'0","created":15,"last_epoch_clean":16,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-08-01T19:54:03.032665+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-08-01T19:54:03.032665+0000","last_clean_scrub_stamp":"2023-08-01T19:54:03.032665+0000","objects_scrubbed":0,"log_size":4,"ondisk_log_size":4,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-08-02T21:33:27.007118+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":554,"num_objects":2,"num_object_clones":0,"num_object_copies":4,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":2,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":4,"num_write_kb":1,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":1,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[0,1],"acting":[0,1],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":0,"acting_primary":0,"purged_snaps":[]},{"pgid":"4.18","version":"0'0","reported_seq":8,"reported_epoch":17,"state":"active+clean","last_fresh":"2023-08-01T19:54:04.477588+0000","last_change":"2023-08-01T19:54:04.477588+0000","last_active":"2023-08-01T19:54:04.477588+0000","last_peered":"2023-08-01T19:54:04.477588+0000","last_clean":"2023-08-01T19:54:04.477588+0000","last_became_active":"2023-08-01T19:54:04.476194+0000","last_became_peered":"2023-08-01T19:54:04.476194+0000","last_unstale":"2023-08-01T19:54:04.477588+0000","last_undegraded":"2023-08-01T19:54:04.477588+0000","last_fullsized":"2023-08-01T19:54:04.477588+0000","mapping_epoch":16,"log_start":"0'0","ondisk_log_start":"0'0","created":16,"last_epoch_clean":17,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-08-01T19:54:04.040663+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-08-01T19:54:04.040663+0000","last_clean_scrub_stamp":"2023-08-01T19:54:04.040663+0000","objects_scrubbed":0,"log_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-08-03T03:58:06.360840+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[1,0],"acting":[1,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":1,"acting_primary":1,"purged_snaps":[]},{"pgid":"4.20","version":"0'0","reported_seq":8,"reported_epoch":17,"state":"active+clean","last_fresh":"2023-08-01T19:54:04.477904+0000","last_change":"2023-08-01T19:54:04.477904+0000","last_active":"2023-08-01T19:54:04.477904+0000","last_peered":"2023-08-01T19:54:04.477904+0000","last_clean":"2023-08-01T19:54:04.477904+0000","last_became_active":"2023-08-01T19:54:04.476564+0000","last_became_peered":"2023-08-01T19:54:04.476564+0000","last_unstale":"2023-08-01T19:54:04.477904+0000","last_undegraded":"2023-08-01T19:54:04.477904+0000","last_fullsized":"2023-08-01T19:54:04.477904+0000","mapping_epoch":16,"log_start":"0'0","ondisk_log_start":"0'0","created":16,"last_epoch_clean":17,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-08-01T19:54:04.040663+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-08-01T19:54:04.040663+0000","last_clean_scrub_stamp":"2023-08-01T19:54:04.040663+0000","objects_scrubbed":0,"log_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-08-03T02:21:47.656072+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[1,0],"acting":[1,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":1,"acting_primary":1,"purged_snaps":[]},{"pgid":"4.21","version":"0'0","reported_seq":8,"reported_epoch":17,"state":"active+clean","last_fresh":"2023-08-01T19:54:04.466899+0000","last_change":"2023-08-01T19:54:04.466899+0000","last_active":"2023-08-01T19:54:04.466899+0000","last_peered":"2023-08-01T19:54:04.466899+0000","last_clean":"2023-08-01T19:54:04.466899+0000","last_became_active":"2023-08-01T19:54:04.466500+0000","last_became_peered":"2023-08-01T19:54:04.466500+0000","last_unstale":"2023-08-01T19:54:04.466899+0000","last_undegraded":"2023-08-01T19:54:04.466899+0000","last_fullsized":"2023-08-01T19:54:04.466899+0000","mapping_epoch":16,"log_start":"0'0","ondisk_log_start":"0'0","created":16,"last_epoch_clean":17,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-08-01T19:54:04.040663+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-08-01T19:54:04.040663+0000","last_clean_scrub_stamp":"2023-08-01T19:54:04.040663+0000","objects_scrubbed":0,"log_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-08-03T07:36:38.654701+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[0,2],"acting":[0,2],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":0,"acting_primary":0,"purged_snaps":[]},{"pgid":"4.22","version":"0'0","reported_seq":9,"reported_epoch":17,"state":"active+clean","last_fresh":"2023-08-01T19:54:04.473914+0000","last_change":"2023-08-01T19:54:04.471945+0000","last_active":"2023-08-01T19:54:04.473914+0000","last_peered":"2023-08-01T19:54:04.473914+0000","last_clean":"2023-08-01T19:54:04.473914+0000","last_became_active":"2023-08-01T19:54:04.471371+0000","last_became_peered":"2023-08-01T19:54:04.471371+0000","last_unstale":"2023-08-01T19:54:04.473914+0000","last_undegraded":"2023-08-01T19:54:04.473914+0000","last_fullsized":"2023-08-01T19:54:04.473914+0000","mapping_epoch":16,"log_start":"0'0","ondisk_log_start":"0'0","created":16,"last_epoch_clean":17,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-08-01T19:54:04.040663+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-08-01T19:54:04.040663+0000","last_clean_scrub_stamp":"2023-08-01T19:54:04.040663+0000","objects_scrubbed":0,"log_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-08-02T22:17:59.847819+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[2,1],"acting":[2,1],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":2,"acting_primary":2,"purged_snaps":[]},{"pgid":"4.23","version":"0'0","reported_seq":8,"reported_epoch":17,"state":"active+clean","last_fresh":"2023-08-01T19:54:04.467847+0000","last_change":"2023-08-01T19:54:04.467847+0000","last_active":"2023-08-01T19:54:04.467847+0000","last_peered":"2023-08-01T19:54:04.467847+0000","last_clean":"2023-08-01T19:54:04.467847+0000","last_became_active":"2023-08-01T19:54:04.467111+0000","last_became_peered":"2023-08-01T19:54:04.467111+0000","last_unstale":"2023-08-01T19:54:04.467847+0000","last_undegraded":"2023-08-01T19:54:04.467847+0000","last_fullsized":"2023-08-01T19:54:04.467847+0000","mapping_epoch":16,"log_start":"0'0","ondisk_log_start":"0'0","created":16,"last_epoch_clean":17,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-08-01T19:54:04.040663+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-08-01T19:54:04.040663+0000","last_clean_scrub_stamp":"2023-08-01T19:54:04.040663+0000","objects_scrubbed":0,"log_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-08-03T00:42:19.379348+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[0,2],"acting":[0,2],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":0,"acting_primary":0,"purged_snaps":[]},{"pgid":"4.24","version":"0'0","reported_seq":9,"reported_epoch":17,"state":"active+clean","last_fresh":"2023-08-01T19:54:04.482540+0000","last_change":"2023-08-01T19:54:04.477128+0000","last_active":"2023-08-01T19:54:04.482540+0000","last_peered":"2023-08-01T19:54:04.482540+0000","last_clean":"2023-08-01T19:54:04.482540+0000","last_became_active":"2023-08-01T19:54:04.476819+0000","last_became_peered":"2023-08-01T19:54:04.476819+0000","last_unstale":"2023-08-01T19:54:04.482540+0000","last_undegraded":"2023-08-01T19:54:04.482540+0000","last_fullsized":"2023-08-01T19:54:04.482540+0000","mapping_epoch":16,"log_start":"0'0","ondisk_log_start":"0'0","created":16,"last_epoch_clean":17,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-08-01T19:54:04.040663+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-08-01T19:54:04.040663+0000","last_clean_scrub_stamp":"2023-08-01T19:54:04.040663+0000","objects_scrubbed":0,"log_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-08-03T02:20:23.354054+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[2,1],"acting":[2,1],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":2,"acting_primary":2,"purged_snaps":[]}],"pool_stats":[{"poolid":4,"num_pg":64,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"store_stats":{"total":0,"available":0,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},"log_size":0,"ondisk_log_size":0,"up":128,"acting":128,"num_store_stats":3},{"poolid":3,"num_pg":32,"stat_sum":{"num_bytes":2306,"num_objects":21,"num_object_clones":0,"num_object_copies":42,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":21,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":44,"num_write_kb":13,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":13,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"store_stats":{"total":0,"available":0,"internally_reserved":0,"allocated":65536,"data_stored":4612,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},"log_size":38,"ondisk_log_size":38,"up":64,"acting":64,"num_store_stats":3},{"poolid":1,"num_pg":1,"stat_sum":{"num_bytes":590368,"num_objects":2,"num_object_clones":0,"num_object_copies":4,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":2,"num_whiteouts":0,"num_read":136,"num_read_kb":118,"num_write":203,"num_write_kb":3460,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"store_stats":{"total":0,"available":0,"internally_reserved":0,"allocated":114688,"data_stored":1180736,"data_compressed":20662,"data_compressed_allocated":73728,"data_compressed_original":1146880,"omap_allocated":0,"internal_metadata":0},"log_size":157,"ondisk_log_size":157,"up":2,"acting":2,"num_store_stats":2},{"poolid":2,"num_pg":8,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"store_stats":{"total":0,"available":0,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},"log_size":0,"ondisk_log_size":0,"up":16,"acting":16,"num_store_stats":3}],"osd_stats":[{"osd":2,"up_from":9,"seq":38654705670,"num_pgs":67,"num_osds":1,"num_per_pool_osds":1,"num_per_pool_omap_osds":1,"kb":94371840,"kb_used":9256,"kb_used_data":224,"kb_used_omap":0,"kb_used_meta":9024,"kb_avail":94362584,"statfs":{"total":96636764160,"available":96627286016,"internally_reserved":0,"allocated":229376,"data_stored":642640,"data_compressed":10331,"data_compressed_allocated":36864,"data_compressed_original":573440,"omap_allocated":0,"internal_metadata":9240576},"hb_peers":[0,1],"snap_trim_queue_len":0,"num_snap_trimming":0,"num_shards_repaired":0,"op_queue_age_hist":{"histogram":[],"upper_bound":1},"perf_stat":{"commit_latency_ms":2,"apply_latency_ms":2,"commit_latency_ns":2000000,"apply_latency_ns":2000000},"alerts":[],"network_ping_times":[{"osd":0,"last update":"Thu Jan 1 00:00:00 1970","interfaces":[{"interface":"back","average":{"1min":0,"5min":0,"15min":0},"min":{"1min":0,"5min":0,"15min":0},"max":{"1min":0,"5min":0,"15min":0},"last":0.46899999999999997}]},{"osd":1,"last update":"Thu Jan 1 00:00:00 1970","interfaces":[{"interface":"back","average":{"1min":0,"5min":0,"15min":0},"min":{"1min":0,"5min":0,"15min":0},"max":{"1min":0,"5min":0,"15min":0},"last":0.52400000000000002}]}]},{"osd":0,"up_from":8,"seq":34359738373,"num_pgs":18,"num_osds":1,"num_per_pool_osds":1,"num_per_pool_omap_osds":1,"kb":94371840,"kb_used":12296,"kb_used_data":128,"kb_used_omap":0,"kb_used_meta":12160,"kb_avail":94359544,"statfs":{"total":96636764160,"available":96624173056,"internally_reserved":0,"allocated":131072,"data_stored":41002,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":12451840},"hb_peers":[1,2],"snap_trim_queue_len":0,"num_snap_trimming":0,"num_shards_repaired":0,"op_queue_age_hist":{"histogram":[],"upper_bound":1},"perf_stat":{"commit_latency_ms":2,"apply_latency_ms":2,"commit_latency_ns":2000000,"apply_latency_ns":2000000},"alerts":[],"network_ping_times":[{"osd":1,"last update":"Thu Jan 1 00:00:00 1970","interfaces":[{"interface":"back","average":{"1min":0,"5min":0,"15min":0},"min":{"1min":0,"5min":0,"15min":0},"max":{"1min":0,"5min":0,"15min":0},"last":0.46899999999999997}]},{"osd":2,"last update":"Thu Jan 1 00:00:00 1970","interfaces":[{"interface":"back","average":{"1min":0,"5min":0,"15min":0},"min":{"1min":0,"5min":0,"15min":0},"max":{"1min":0,"5min":0,"15min":0},"last":0.55800000000000005}]}]},{"osd":1,"up_from":8,"seq":34359738372,"num_pgs":52,"num_osds":1,"num_per_pool_osds":1,"num_per_pool_omap_osds":1,"kb":94371840,"kb_used":9328,"kb_used_data":232,"kb_used_omap":0,"kb_used_meta":9088,"kb_avail":94362512,"statfs":{"total":96636764160,"available":96627212288,"internally_reserved":0,"allocated":237568,"data_stored":643228,"data_compressed":10331,"data_compressed_allocated":36864,"data_compressed_original":573440,"omap_allocated":0,"internal_metadata":9306112},"hb_peers":[0,2],"snap_trim_queue_len":0,"num_snap_trimming":0,"num_shards_repaired":0,"op_queue_age_hist":{"histogram":[],"upper_bound":1},"perf_stat":{"commit_latency_ms":3,"apply_latency_ms":3,"commit_latency_ns":3000000,"apply_latency_ns":3000000},"alerts":[],"network_ping_times":[{"osd":0,"last update":"Thu Jan 1 00:00:00 1970","interfaces":[{"interface":"back","average":{"1min":0,"5min":0,"15min":0},"min":{"1min":0,"5min":0,"15min":0},"max":{"1min":0,"5min":0,"15min":0},"last":0.39500000000000002}]},{"osd":2,"last update":"Thu Jan 1 00:00:00 1970","interfaces":[{"interface":"back","average":{"1min":0,"5min":0,"15min":0},"min":{"1min":0,"5min":0,"15min":0},"max":{"1min":0,"5min":0,"15min":0},"last":0.57399999999999995}]}]}],"pool_statfs":[{"poolid":1,"osd":1,"total":0,"available":0,"internally_reserved":0,"allocated":57344,"data_stored":590368,"data_compressed":10331,"data_compressed_allocated":36864,"data_compressed_original":573440,"omap_allocated":0,"internal_metadata":0},{"poolid":1,"osd":2,"total":0,"available":0,"internally_reserved":0,"allocated":57344,"data_stored":590368,"data_compressed":10331,"data_compressed_allocated":36864,"data_compressed_original":573440,"omap_allocated":0,"internal_metadata":0},{"poolid":2,"osd":0,"total":0,"available":0,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":2,"osd":1,"total":0,"available":0,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":2,"osd":2,"total":0,"available":0,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":3,"osd":0,"total":0,"available":0,"internally_reserved":0,"allocated":8192,"data_stored":588,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":3,"osd":1,"total":0,"available":0,"internally_reserved":0,"allocated":32768,"data_stored":2306,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":3,"osd":2,"total":0,"available":0,"internally_reserved":0,"allocated":24576,"data_stored":1718,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":4,"osd":0,"total":0,"available":0,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":4,"osd":1,"total":0,"available":0,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":4,"osd":2,"total":0,"available":0,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0}]}} 2023-08-01T19:54:08.948 INFO:tasks.cephfs.filesystem.ceph_manager:clean! 2023-08-01T19:54:08.949 INFO:tasks.ceph:Waiting until ceph daemons up and pgs clean... 2023-08-01T19:54:08.949 INFO:tasks.ceph.ceph_manager.ceph:waiting for mgr available 2023-08-01T19:54:08.949 DEBUG:teuthology.orchestra.run.smithi006:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 120 ceph --cluster ceph mgr dump --format=json 2023-08-01T19:54:08.950 INFO:tasks.daemonwatchdog.daemon_watchdog:watchdog starting 2023-08-01T19:54:09.102 INFO:tasks.ceph.mds.a.smithi006.stderr:2023-08-01T19:54:09.100+0000 7fbb7f547700 -1 mds.pinger is_rank_lagging: rank=0 was never sent ping request. 2023-08-01T19:54:09.364 INFO:teuthology.orchestra.run.smithi006.stdout: 2023-08-01T19:54:09.376 INFO:teuthology.orchestra.run.smithi006.stdout:{"epoch":5,"active_gid":4108,"active_name":"x","active_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.6:6800","nonce":110618},{"type":"v1","addr":"172.21.15.6:6801","nonce":110618}]},"active_addr":"172.21.15.6:6801/110618","active_change":"2023-08-01T19:53:47.900533+0000","active_mgr_features":4540138320759226367,"available":true,"standbys":[{"gid":4106,"name":"y","mgr_features":4540138320759226367,"available_modules":[{"name":"alerts","can_run":true,"error_string":"","module_options":{"interval":{"name":"interval","type":"secs","level":"advanced","flags":1,"default_value":"60","min":"","max":"","enum_allowed":[],"desc":"How frequently to reexamine health status","long_desc":"","tags":[],"see_also":[]},"log_level":{"name":"log_level","type":"str","level":"advanced","flags":1,"default_value":"","min":"","max":"","enum_allowed":["","critical","debug","error","info","warning"],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_cluster":{"name":"log_to_cluster","type":"bool","level":"advanced","flags":1,"default_value":"False","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_cluster_level":{"name":"log_to_cluster_level","type":"str","level":"advanced","flags":1,"default_value":"info","min":"","max":"","enum_allowed":["","critical","debug","error","info","warning"],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_file":{"name":"log_to_file","type":"bool","level":"advanced","flags":1,"default_value":"False","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"smtp_destination":{"name":"smtp_destination","type":"str","level":"advanced","flags":1,"default_value":"","min":"","max":"","enum_allowed":[],"desc":"Email address to send alerts to","long_desc":"","tags":[],"see_also":[]},"smtp_from_name":{"name":"smtp_from_name","type":"str","level":"advanced","flags":1,"default_value":"Ceph","min":"","max":"","enum_allowed":[],"desc":"Email From: name","long_desc":"","tags":[],"see_also":[]},"smtp_host":{"name":"smtp_host","type":"str","level":"advanced","flags":1,"default_value":"","min":"","max":"","enum_allowed":[],"desc":"SMTP server","long_desc":"","tags":[],"see_also":[]},"smtp_password":{"name":"smtp_password","type":"str","level":"advanced","flags":1,"default_value":"","min":"","max":"","enum_allowed":[],"desc":"Password to authenticate with","long_desc":"","tags":[],"see_also":[]},"smtp_port":{"name":"smtp_port","type":"int","level":"advanced","flags":1,"default_value":"465","min":"","max":"","enum_allowed":[],"desc":"SMTP port","long_desc":"","tags":[],"see_also":[]},"smtp_sender":{"name":"smtp_sender","type":"str","level":"advanced","flags":1,"default_value":"","min":"","max":"","enum_allowed":[],"desc":"SMTP envelope sender","long_desc":"","tags":[],"see_also":[]},"smtp_ssl":{"name":"smtp_ssl","type":"bool","level":"advanced","flags":1,"default_value":"True","min":"","max":"","enum_allowed":[],"desc":"Use SSL to connect to SMTP server","long_desc":"","tags":[],"see_also":[]},"smtp_user":{"name":"smtp_user","type":"str","level":"advanced","flags":1,"default_value":"","min":"","max":"","enum_allowed":[],"desc":"User to authenticate as","long_desc":"","tags":[],"see_also":[]}}},{"name":"balancer","can_run":true,"error_string":"","module_options":{"active":{"name":"active","type":"bool","level":"advanced","flags":1,"default_value":"True","min":"","max":"","enum_allowed":[],"desc":"automatically balance PGs across cluster","long_desc":"","tags":[],"see_also":[]},"begin_time":{"name":"begin_time","type":"str","level":"advanced","flags":1,"default_value":"0000","min":"","max":"","enum_allowed":[],"desc":"beginning time of day to automatically balance","long_desc":"This is a time of day in the format HHMM.","tags":[],"see_also":[]},"begin_weekday":{"name":"begin_weekday","type":"uint","level":"advanced","flags":1,"default_value":"0","min":"0","max":"7","enum_allowed":[],"desc":"Restrict automatic balancing to this day of the week or later","long_desc":"0 or 7 = Sunday, 1 = Monday, etc.","tags":[],"see_also":[]},"crush_compat_max_iterations":{"name":"crush_compat_max_iterations","type":"uint","level":"advanced","flags":1,"default_value":"25","min":"1","max":"250","enum_allowed":[],"desc":"maximum number of iterations to attempt optimization","long_desc":"","tags":[],"see_also":[]},"crush_compat_metrics":{"name":"crush_compat_metrics","type":"str","level":"advanced","flags":1,"default_value":"pgs,objects,bytes","min":"","max":"","enum_allowed":[],"desc":"metrics with which to calculate OSD utilization","long_desc":"Value is a list of one or more of \"pgs\", \"objects\", or \"bytes\", and indicates which metrics to use to balance utilization.","tags":[],"see_also":[]},"crush_compat_step":{"name":"crush_compat_step","type":"float","level":"advanced","flags":1,"default_value":"0.5","min":"0.001","max":"0.999","enum_allowed":[],"desc":"aggressiveness of optimization","long_desc":".99 is very aggressive, .01 is less aggressive","tags":[],"see_also":[]},"end_time":{"name":"end_time","type":"str","level":"advanced","flags":1,"default_value":"2400","min":"","max":"","enum_allowed":[],"desc":"ending time of day to automatically balance","long_desc":"This is a time of day in the format HHMM.","tags":[],"see_also":[]},"end_weekday":{"name":"end_weekday","type":"uint","level":"advanced","flags":1,"default_value":"7","min":"0","max":"7","enum_allowed":[],"desc":"Restrict automatic balancing to days of the week earlier than this","long_desc":"0 or 7 = Sunday, 1 = Monday, etc.","tags":[],"see_also":[]},"log_level":{"name":"log_level","type":"str","level":"advanced","flags":1,"default_value":"","min":"","max":"","enum_allowed":["","critical","debug","error","info","warning"],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_cluster":{"name":"log_to_cluster","type":"bool","level":"advanced","flags":1,"default_value":"False","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_cluster_level":{"name":"log_to_cluster_level","type":"str","level":"advanced","flags":1,"default_value":"info","min":"","max":"","enum_allowed":["","critical","debug","error","info","warning"],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_file":{"name":"log_to_file","type":"bool","level":"advanced","flags":1,"default_value":"False","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"min_score":{"name":"min_score","type":"float","level":"advanced","flags":1,"default_value":"0","min":"","max":"","enum_allowed":[],"desc":"minimum score, below which no optimization is attempted","long_desc":"","tags":[],"see_also":[]},"mode":{"name":"mode","type":"str","level":"advanced","flags":1,"default_value":"upmap","min":"","max":"","enum_allowed":["crush-compat","none","upmap"],"desc":"Balancer mode","long_desc":"","tags":[],"see_also":[]},"pool_ids":{"name":"pool_ids","type":"str","level":"advanced","flags":1,"default_value":"","min":"","max":"","enum_allowed":[],"desc":"pools which the automatic balancing will be limited to","long_desc":"","tags":[],"see_also":[]},"sleep_interval":{"name":"sleep_interval","type":"secs","level":"advanced","flags":1,"default_value":"60","min":"","max":"","enum_allowed":[],"desc":"how frequently to wake up and attempt optimization","long_desc":"","tags":[],"see_also":[]},"upmap_max_deviation":{"name":"upmap_max_deviation","type":"int","level":"advanced","flags":1,"default_value":"5","min":"1","max":"","enum_allowed":[],"desc":"deviation below which no optimization is attempted","long_desc":"If the number of PGs are within this count then no optimization is attempted","tags":[],"see_also":[]},"upmap_max_optimizations":{"name":"upmap_max_optimizations","type":"uint","level":"advanced","flags":1,"default_value":"10","min":"","max":"","enum_allowed":[],"desc":"maximum upmap optimizations to make per attempt","long_desc":"","tags":[],"see_also":[]}}},{"name":"cephadm","can_run":true,"error_string":"","module_options":{"agent_down_multiplier":{"name":"agent_down_multiplier","type":"float","level":"advanced","flags":0,"default_value":"3.0","min":"","max":"","enum_allowed":[],"desc":"Multiplied by agent refresh rate to calculate how long agent must not report before being marked down","long_desc":"","tags":[],"see_also":[]},"agent_refresh_rate":{"name":"agent_refresh_rate","type":"secs","level":"advanced","flags":0,"default_value":"20","min":"","max":"","enum_allowed":[],"desc":"How often agent on each host will try to gather and send metadata","long_desc":"","tags":[],"see_also":[]},"agent_starting_port":{"name":"agent_starting_port","type":"int","level":"advanced","flags":0,"default_value":"4721","min":"","max":"","enum_allowed":[],"desc":"First port agent will try to bind to (will also try up to next 1000 subsequent ports if blocked)","long_desc":"","tags":[],"see_also":[]},"allow_ptrace":{"name":"allow_ptrace","type":"bool","level":"advanced","flags":0,"default_value":"False","min":"","max":"","enum_allowed":[],"desc":"allow SYS_PTRACE capability on ceph containers","long_desc":"The SYS_PTRACE capability is needed to attach to a process with gdb or strace. Enabling this options can allow debugging daemons that encounter problems at runtime.","tags":[],"see_also":[]},"autotune_interval":{"name":"autotune_interval","type":"secs","level":"advanced","flags":0,"default_value":"600","min":"","max":"","enum_allowed":[],"desc":"how frequently to autotune daemon memory","long_desc":"","tags":[],"see_also":[]},"autotune_memory_target_ratio":{"name":"autotune_memory_target_ratio","type":"float","level":"advanced","flags":0,"default_value":"0.7","min":"","max":"","enum_allowed":[],"desc":"ratio of total system memory to divide amongst autotuned daemons","long_desc":"","tags":[],"see_also":[]},"cgroups_split":{"name":"cgroups_split","type":"bool","level":"advanced","flags":0,"default_value":"True","min":"","max":"","enum_allowed":[],"desc":"Pass --cgroups=split when cephadm creates containers (currently podman only)","long_desc":"","tags":[],"see_also":[]},"config_checks_enabled":{"name":"config_checks_enabled","type":"bool","level":"advanced","flags":0,"default_value":"False","min":"","max":"","enum_allowed":[],"desc":"Enable or disable the cephadm configuration analysis","long_desc":"","tags":[],"see_also":[]},"config_dashboard":{"name":"config_dashboard","type":"bool","level":"advanced","flags":0,"default_value":"True","min":"","max":"","enum_allowed":[],"desc":"manage configs like API endpoints in Dashboard.","long_desc":"","tags":[],"see_also":[]},"container_image_alertmanager":{"name":"container_image_alertmanager","type":"str","level":"advanced","flags":0,"default_value":"quay.io/prometheus/alertmanager:v0.25.0","min":"","max":"","enum_allowed":[],"desc":"Prometheus container image","long_desc":"","tags":[],"see_also":[]},"container_image_base":{"name":"container_image_base","type":"str","level":"advanced","flags":1,"default_value":"quay.io/ceph/ceph","min":"","max":"","enum_allowed":[],"desc":"Container image name, without the tag","long_desc":"","tags":[],"see_also":[]},"container_image_grafana":{"name":"container_image_grafana","type":"str","level":"advanced","flags":0,"default_value":"quay.io/ceph/ceph-grafana:9.4.7","min":"","max":"","enum_allowed":[],"desc":"Prometheus container image","long_desc":"","tags":[],"see_also":[]},"container_image_haproxy":{"name":"container_image_haproxy","type":"str","level":"advanced","flags":0,"default_value":"quay.io/ceph/haproxy:2.3","min":"","max":"","enum_allowed":[],"desc":"HAproxy container image","long_desc":"","tags":[],"see_also":[]},"container_image_keepalived":{"name":"container_image_keepalived","type":"str","level":"advanced","flags":0,"default_value":"quay.io/ceph/keepalived:2.1.5","min":"","max":"","enum_allowed":[],"desc":"Keepalived container image","long_desc":"","tags":[],"see_also":[]},"container_image_loki":{"name":"container_image_loki","type":"str","level":"advanced","flags":0,"default_value":"docker.io/grafana/loki:2.4.0","min":"","max":"","enum_allowed":[],"desc":"Loki container image","long_desc":"","tags":[],"see_also":[]},"container_image_node_exporter":{"name":"container_image_node_exporter","type":"str","level":"advanced","flags":0,"default_value":"quay.io/prometheus/node-exporter:v1.5.0","min":"","max":"","enum_allowed":[],"desc":"Prometheus container image","long_desc":"","tags":[],"see_also":[]},"container_image_prometheus":{"name":"container_image_prometheus","type":"str","level":"advanced","flags":0,"default_value":"quay.io/prometheus/prometheus:v2.43.0","min":"","max":"","enum_allowed":[],"desc":"Prometheus container image","long_desc":"","tags":[],"see_also":[]},"container_image_promtail":{"name":"container_image_promtail","type":"str","level":"advanced","flags":0,"default_value":"docker.io/grafana/promtail:2.4.0","min":"","max":"","enum_allowed":[],"desc":"Promtail container image","long_desc":"","tags":[],"see_also":[]},"container_image_snmp_gateway":{"name":"container_image_snmp_gateway","type":"str","level":"advanced","flags":0,"default_value":"docker.io/maxwo/snmp-notifier:v1.2.1","min":"","max":"","enum_allowed":[],"desc":"SNMP Gateway container image","long_desc":"","tags":[],"see_also":[]},"container_init":{"name":"container_init","type":"bool","level":"advanced","flags":0,"default_value":"True","min":"","max":"","enum_allowed":[],"desc":"Run podman/docker with `--init`","long_desc":"","tags":[],"see_also":[]},"daemon_cache_timeout":{"name":"daemon_cache_timeout","type":"secs","level":"advanced","flags":0,"default_value":"600","min":"","max":"","enum_allowed":[],"desc":"seconds to cache service (daemon) inventory","long_desc":"","tags":[],"see_also":[]},"default_cephadm_command_timeout":{"name":"default_cephadm_command_timeout","type":"secs","level":"advanced","flags":0,"default_value":"900","min":"","max":"","enum_allowed":[],"desc":"Default timeout applied to cephadm commands run directly on the host (in seconds)","long_desc":"","tags":[],"see_also":[]},"default_registry":{"name":"default_registry","type":"str","level":"advanced","flags":0,"default_value":"docker.io","min":"","max":"","enum_allowed":[],"desc":"Search-registry to which we should normalize unqualified image names. This is not the default registry","long_desc":"","tags":[],"see_also":[]},"device_cache_timeout":{"name":"device_cache_timeout","type":"secs","level":"advanced","flags":0,"default_value":"1800","min":"","max":"","enum_allowed":[],"desc":"seconds to cache device inventory","long_desc":"","tags":[],"see_also":[]},"device_enhanced_scan":{"name":"device_enhanced_scan","type":"bool","level":"advanced","flags":0,"default_value":"False","min":"","max":"","enum_allowed":[],"desc":"Use libstoragemgmt during device scans","long_desc":"","tags":[],"see_also":[]},"facts_cache_timeout":{"name":"facts_cache_timeout","type":"secs","level":"advanced","flags":0,"default_value":"60","min":"","max":"","enum_allowed":[],"desc":"seconds to cache host facts data","long_desc":"","tags":[],"see_also":[]},"host_check_interval":{"name":"host_check_interval","type":"secs","level":"advanced","flags":0,"default_value":"600","min":"","max":"","enum_allowed":[],"desc":"how frequently to perform a host check","long_desc":"","tags":[],"see_also":[]},"log_level":{"name":"log_level","type":"str","level":"advanced","flags":1,"default_value":"","min":"","max":"","enum_allowed":["","critical","debug","error","info","warning"],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_refresh_metadata":{"name":"log_refresh_metadata","type":"bool","level":"advanced","flags":0,"default_value":"False","min":"","max":"","enum_allowed":[],"desc":"Log all refresh metadata. Includes daemon, device, and host info collected regularly. Only has effect if logging at debug level","long_desc":"","tags":[],"see_also":[]},"log_to_cluster":{"name":"log_to_cluster","type":"bool","level":"advanced","flags":0,"default_value":"True","min":"","max":"","enum_allowed":[],"desc":"log to the \"cephadm\" cluster log channel\"","long_desc":"","tags":[],"see_also":[]},"log_to_cluster_level":{"name":"log_to_cluster_level","type":"str","level":"advanced","flags":1,"default_value":"info","min":"","max":"","enum_allowed":["","critical","debug","error","info","warning"],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_file":{"name":"log_to_file","type":"bool","level":"advanced","flags":1,"default_value":"False","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"manage_etc_ceph_ceph_conf":{"name":"manage_etc_ceph_ceph_conf","type":"bool","level":"advanced","flags":0,"default_value":"False","min":"","max":"","enum_allowed":[],"desc":"Manage and own /etc/ceph/ceph.conf on the hosts.","long_desc":"","tags":[],"see_also":[]},"manage_etc_ceph_ceph_conf_hosts":{"name":"manage_etc_ceph_ceph_conf_hosts","type":"str","level":"advanced","flags":0,"default_value":"*","min":"","max":"","enum_allowed":[],"desc":"PlacementSpec describing on which hosts to manage /etc/ceph/ceph.conf","long_desc":"","tags":[],"see_also":[]},"max_count_per_host":{"name":"max_count_per_host","type":"int","level":"advanced","flags":0,"default_value":"10","min":"","max":"","enum_allowed":[],"desc":"max number of daemons per service per host","long_desc":"","tags":[],"see_also":[]},"max_osd_draining_count":{"name":"max_osd_draining_count","type":"int","level":"advanced","flags":0,"default_value":"10","min":"","max":"","enum_allowed":[],"desc":"max number of osds that will be drained simultaneously when osds are removed","long_desc":"","tags":[],"see_also":[]},"migration_current":{"name":"migration_current","type":"int","level":"advanced","flags":0,"default_value":"","min":"","max":"","enum_allowed":[],"desc":"internal - do not modify","long_desc":"","tags":[],"see_also":[]},"mode":{"name":"mode","type":"str","level":"advanced","flags":0,"default_value":"root","min":"","max":"","enum_allowed":["cephadm-package","root"],"desc":"mode for remote execution of cephadm","long_desc":"","tags":[],"see_also":[]},"prometheus_alerts_path":{"name":"prometheus_alerts_path","type":"str","level":"advanced","flags":0,"default_value":"/etc/prometheus/ceph/ceph_default_alerts.yml","min":"","max":"","enum_allowed":[],"desc":"location of alerts to include in prometheus deployments","long_desc":"","tags":[],"see_also":[]},"registry_insecure":{"name":"registry_insecure","type":"bool","level":"advanced","flags":0,"default_value":"False","min":"","max":"","enum_allowed":[],"desc":"Registry is to be considered insecure (no TLS available). Only for development purposes.","long_desc":"","tags":[],"see_also":[]},"registry_password":{"name":"registry_password","type":"str","level":"advanced","flags":0,"default_value":"","min":"","max":"","enum_allowed":[],"desc":"Custom repository password. Only used for logging into a registry.","long_desc":"","tags":[],"see_also":[]},"registry_url":{"name":"registry_url","type":"str","level":"advanced","flags":0,"default_value":"","min":"","max":"","enum_allowed":[],"desc":"Registry url for login purposes. This is not the default registry","long_desc":"","tags":[],"see_also":[]},"registry_username":{"name":"registry_username","type":"str","level":"advanced","flags":0,"default_value":"","min":"","max":"","enum_allowed":[],"desc":"Custom repository username. Only used for logging into a registry.","long_desc":"","tags":[],"see_also":[]},"ssh_config_file":{"name":"ssh_config_file","type":"str","level":"advanced","flags":0,"default_value":"","min":"","max":"","enum_allowed":[],"desc":"customized SSH config file to connect to managed hosts","long_desc":"","tags":[],"see_also":[]},"use_agent":{"name":"use_agent","type":"bool","level":"advanced","flags":0,"default_value":"False","min":"","max":"","enum_allowed":[],"desc":"Use cephadm agent on each host to gather and send metadata","long_desc":"","tags":[],"see_also":[]},"use_repo_digest":{"name":"use_repo_digest","type":"bool","level":"advanced","flags":0,"default_value":"True","min":"","max":"","enum_allowed":[],"desc":"Automatically convert image tags to image digest. Make sure all daemons use the same image","long_desc":"","tags":[],"see_also":[]},"warn_on_failed_host_check":{"name":"warn_on_failed_host_check","type":"bool","level":"advanced","flags":0,"default_value":"True","min":"","max":"","enum_allowed":[],"desc":"raise a health warning if the host check fails","long_desc":"","tags":[],"see_also":[]},"warn_on_stray_daemons":{"name":"warn_on_stray_daemons","type":"bool","level":"advanced","flags":0,"default_value":"True","min":"","max":"","enum_allowed":[],"desc":"raise a health warning if daemons are detected that are not managed by cephadm","long_desc":"","tags":[],"see_also":[]},"warn_on_stray_hosts":{"name":"warn_on_stray_hosts","type":"bool","level":"advanced","flags":0,"default_value":"True","min":"","max":"","enum_allowed":[],"desc":"raise a health warning if daemons are detected on a host that is not managed by cephadm","long_desc":"","tags":[],"see_also":[]}}},{"name":"crash","can_run":true,"error_string":"","module_options":{"log_level":{"name":"log_level","type":"str","level":"advanced","flags":1,"default_value":"","min":"","max":"","enum_allowed":["","critical","debug","error","info","warning"],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_cluster":{"name":"log_to_cluster","type":"bool","level":"advanced","flags":1,"default_value":"False","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_cluster_level":{"name":"log_to_cluster_level","type":"str","level":"advanced","flags":1,"default_value":"info","min":"","max":"","enum_allowed":["","critical","debug","error","info","warning"],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_file":{"name":"log_to_file","type":"bool","level":"advanced","flags":1,"default_value":"False","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"retain_interval":{"name":"retain_interval","type":"secs","level":"advanced","flags":1,"default_value":"31536000","min":"","max":"","enum_allowed":[],"desc":"how long to retain crashes before pruning them","long_desc":"","tags":[],"see_also":[]},"warn_recent_interval":{"name":"warn_recent_interval","type":"secs","level":"advanced","flags":1,"default_value":"1209600","min":"","max":"","enum_allowed":[],"desc":"time interval in which to warn about recent crashes","long_desc":"","tags":[],"see_also":[]}}},{"name":"dashboard","can_run":true,"error_string":"","module_options":{"ACCOUNT_LOCKOUT_ATTEMPTS":{"name":"ACCOUNT_LOCKOUT_ATTEMPTS","type":"int","level":"advanced","flags":0,"default_value":"10","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"ALERTMANAGER_API_HOST":{"name":"ALERTMANAGER_API_HOST","type":"str","level":"advanced","flags":0,"default_value":"","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"ALERTMANAGER_API_SSL_VERIFY":{"name":"ALERTMANAGER_API_SSL_VERIFY","type":"bool","level":"advanced","flags":0,"default_value":"True","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"AUDIT_API_ENABLED":{"name":"AUDIT_API_ENABLED","type":"bool","level":"advanced","flags":0,"default_value":"False","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"AUDIT_API_LOG_PAYLOAD":{"name":"AUDIT_API_LOG_PAYLOAD","type":"bool","level":"advanced","flags":0,"default_value":"True","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"ENABLE_BROWSABLE_API":{"name":"ENABLE_BROWSABLE_API","type":"bool","level":"advanced","flags":0,"default_value":"True","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"FEATURE_TOGGLE_CEPHFS":{"name":"FEATURE_TOGGLE_CEPHFS","type":"bool","level":"advanced","flags":0,"default_value":"True","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"FEATURE_TOGGLE_DASHBOARD":{"name":"FEATURE_TOGGLE_DASHBOARD","type":"bool","level":"advanced","flags":0,"default_value":"True","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"FEATURE_TOGGLE_ISCSI":{"name":"FEATURE_TOGGLE_ISCSI","type":"bool","level":"advanced","flags":0,"default_value":"True","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"FEATURE_TOGGLE_MIRRORING":{"name":"FEATURE_TOGGLE_MIRRORING","type":"bool","level":"advanced","flags":0,"default_value":"True","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"FEATURE_TOGGLE_NFS":{"name":"FEATURE_TOGGLE_NFS","type":"bool","level":"advanced","flags":0,"default_value":"True","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"FEATURE_TOGGLE_RBD":{"name":"FEATURE_TOGGLE_RBD","type":"bool","level":"advanced","flags":0,"default_value":"True","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"FEATURE_TOGGLE_RGW":{"name":"FEATURE_TOGGLE_RGW","type":"bool","level":"advanced","flags":0,"default_value":"True","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"GANESHA_CLUSTERS_RADOS_POOL_NAMESPACE":{"name":"GANESHA_CLUSTERS_RADOS_POOL_NAMESPACE","type":"str","level":"advanced","flags":0,"default_value":"","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"GRAFANA_API_PASSWORD":{"name":"GRAFANA_API_PASSWORD","type":"str","level":"advanced","flags":0,"default_value":"admin","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"GRAFANA_API_SSL_VERIFY":{"name":"GRAFANA_API_SSL_VERIFY","type":"bool","level":"advanced","flags":0,"default_value":"True","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"GRAFANA_API_URL":{"name":"GRAFANA_API_URL","type":"str","level":"advanced","flags":0,"default_value":"","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"GRAFANA_API_USERNAME":{"name":"GRAFANA_API_USERNAME","type":"str","level":"advanced","flags":0,"default_value":"admin","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"GRAFANA_FRONTEND_API_URL":{"name":"GRAFANA_FRONTEND_API_URL","type":"str","level":"advanced","flags":0,"default_value":"","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"GRAFANA_UPDATE_DASHBOARDS":{"name":"GRAFANA_UPDATE_DASHBOARDS","type":"bool","level":"advanced","flags":0,"default_value":"False","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"ISCSI_API_SSL_VERIFICATION":{"name":"ISCSI_API_SSL_VERIFICATION","type":"bool","level":"advanced","flags":0,"default_value":"True","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"ISSUE_TRACKER_API_KEY":{"name":"ISSUE_TRACKER_API_KEY","type":"str","level":"advanced","flags":0,"default_value":"","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"PROMETHEUS_API_HOST":{"name":"PROMETHEUS_API_HOST","type":"str","level":"advanced","flags":0,"default_value":"","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"PROMETHEUS_API_SSL_VERIFY":{"name":"PROMETHEUS_API_SSL_VERIFY","type":"bool","level":"advanced","flags":0,"default_value":"True","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"PWD_POLICY_CHECK_COMPLEXITY_ENABLED":{"name":"PWD_POLICY_CHECK_COMPLEXITY_ENABLED","type":"bool","level":"advanced","flags":0,"default_value":"False","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"PWD_POLICY_CHECK_EXCLUSION_LIST_ENABLED":{"name":"PWD_POLICY_CHECK_EXCLUSION_LIST_ENABLED","type":"bool","level":"advanced","flags":0,"default_value":"False","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"PWD_POLICY_CHECK_LENGTH_ENABLED":{"name":"PWD_POLICY_CHECK_LENGTH_ENABLED","type":"bool","level":"advanced","flags":0,"default_value":"True","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"PWD_POLICY_CHECK_OLDPWD_ENABLED":{"name":"PWD_POLICY_CHECK_OLDPWD_ENABLED","type":"bool","level":"advanced","flags":0,"default_value":"True","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"PWD_POLICY_CHECK_REPETITIVE_CHARS_ENABLED":{"name":"PWD_POLICY_CHECK_REPETITIVE_CHARS_ENABLED","type":"bool","level":"advanced","flags":0,"default_value":"False","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"PWD_POLICY_CHECK_SEQUENTIAL_CHARS_ENABLED":{"name":"PWD_POLICY_CHECK_SEQUENTIAL_CHARS_ENABLED","type":"bool","level":"advanced","flags":0,"default_value":"False","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"PWD_POLICY_CHECK_USERNAME_ENABLED":{"name":"PWD_POLICY_CHECK_USERNAME_ENABLED","type":"bool","level":"advanced","flags":0,"default_value":"False","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"PWD_POLICY_ENABLED":{"name":"PWD_POLICY_ENABLED","type":"bool","level":"advanced","flags":0,"default_value":"True","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"PWD_POLICY_EXCLUSION_LIST":{"name":"PWD_POLICY_EXCLUSION_LIST","type":"str","level":"advanced","flags":0,"default_value":"osd,host,dashboard,pool,block,nfs,ceph,monitors,gateway,logs,crush,maps","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"PWD_POLICY_MIN_COMPLEXITY":{"name":"PWD_POLICY_MIN_COMPLEXITY","type":"int","level":"advanced","flags":0,"default_value":"10","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"PWD_POLICY_MIN_LENGTH":{"name":"PWD_POLICY_MIN_LENGTH","type":"int","level":"advanced","flags":0,"default_value":"8","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"REST_REQUESTS_TIMEOUT":{"name":"REST_REQUESTS_TIMEOUT","type":"int","level":"advanced","flags":0,"default_value":"45","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"RGW_API_ACCESS_KEY":{"name":"RGW_API_ACCESS_KEY","type":"str","level":"advanced","flags":0,"default_value":"","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"RGW_API_ADMIN_RESOURCE":{"name":"RGW_API_ADMIN_RESOURCE","type":"str","level":"advanced","flags":0,"default_value":"admin","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"RGW_API_SECRET_KEY":{"name":"RGW_API_SECRET_KEY","type":"str","level":"advanced","flags":0,"default_value":"","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"RGW_API_SSL_VERIFY":{"name":"RGW_API_SSL_VERIFY","type":"bool","level":"advanced","flags":0,"default_value":"True","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"USER_PWD_EXPIRATION_SPAN":{"name":"USER_PWD_EXPIRATION_SPAN","type":"int","level":"advanced","flags":0,"default_value":"0","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"USER_PWD_EXPIRATION_WARNING_1":{"name":"USER_PWD_EXPIRATION_WARNING_1","type":"int","level":"advanced","flags":0,"default_value":"10","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"USER_PWD_EXPIRATION_WARNING_2":{"name":"USER_PWD_EXPIRATION_WARNING_2","type":"int","level":"advanced","flags":0,"default_value":"5","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"cross_origin_url":{"name":"cross_origin_url","type":"str","level":"advanced","flags":0,"default_value":"","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"crt_file":{"name":"crt_file","type":"str","level":"advanced","flags":0,"default_value":"","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"debug":{"name":"debug","type":"bool","level":"advanced","flags":0,"default_value":"False","min":"","max":"","enum_allowed":[],"desc":"Enable/disable debug options","long_desc":"","tags":[],"see_also":[]},"jwt_token_ttl":{"name":"jwt_token_ttl","type":"int","level":"advanced","flags":0,"default_value":"28800","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"key_file":{"name":"key_file","type":"str","level":"advanced","flags":0,"default_value":"","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_level":{"name":"log_level","type":"str","level":"advanced","flags":1,"default_value":"","min":"","max":"","enum_allowed":["","critical","debug","error","info","warning"],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_cluster":{"name":"log_to_cluster","type":"bool","level":"advanced","flags":1,"default_value":"False","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_cluster_level":{"name":"log_to_cluster_level","type":"str","level":"advanced","flags":1,"default_value":"info","min":"","max":"","enum_allowed":["","critical","debug","error","info","warning"],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_file":{"name":"log_to_file","type":"bool","level":"advanced","flags":1,"default_value":"False","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"motd":{"name":"motd","type":"str","level":"advanced","flags":0,"default_value":"","min":"","max":"","enum_allowed":[],"desc":"The message of the day","long_desc":"","tags":[],"see_also":[]},"redirect_resolve_ip_addr":{"name":"redirect_resolve_ip_addr","type":"bool","level":"advanced","flags":0,"default_value":"False","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"server_addr":{"name":"server_addr","type":"str","level":"advanced","flags":0,"default_value":"::","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"server_port":{"name":"server_port","type":"int","level":"advanced","flags":0,"default_value":"8080","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"ssl":{"name":"ssl","type":"bool","level":"advanced","flags":0,"default_value":"True","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"ssl_server_port":{"name":"ssl_server_port","type":"int","level":"advanced","flags":0,"default_value":"8443","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"standby_behaviour":{"name":"standby_behaviour","type":"str","level":"advanced","flags":0,"default_value":"redirect","min":"","max":"","enum_allowed":["error","redirect"],"desc":"","long_desc":"","tags":[],"see_also":[]},"standby_error_status_code":{"name":"standby_error_status_code","type":"int","level":"advanced","flags":0,"default_value":"500","min":"400","max":"599","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"url_prefix":{"name":"url_prefix","type":"str","level":"advanced","flags":0,"default_value":"","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]}}},{"name":"devicehealth","can_run":true,"error_string":"","module_options":{"enable_monitoring":{"name":"enable_monitoring","type":"bool","level":"advanced","flags":1,"default_value":"True","min":"","max":"","enum_allowed":[],"desc":"monitor device health metrics","long_desc":"","tags":[],"see_also":[]},"log_level":{"name":"log_level","type":"str","level":"advanced","flags":1,"default_value":"","min":"","max":"","enum_allowed":["","critical","debug","error","info","warning"],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_cluster":{"name":"log_to_cluster","type":"bool","level":"advanced","flags":1,"default_value":"False","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_cluster_level":{"name":"log_to_cluster_level","type":"str","level":"advanced","flags":1,"default_value":"info","min":"","max":"","enum_allowed":["","critical","debug","error","info","warning"],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_file":{"name":"log_to_file","type":"bool","level":"advanced","flags":1,"default_value":"False","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"mark_out_threshold":{"name":"mark_out_threshold","type":"secs","level":"advanced","flags":1,"default_value":"2419200","min":"","max":"","enum_allowed":[],"desc":"automatically mark OSD if it may fail before this long","long_desc":"","tags":[],"see_also":[]},"pool_name":{"name":"pool_name","type":"str","level":"advanced","flags":1,"default_value":"device_health_metrics","min":"","max":"","enum_allowed":[],"desc":"name of pool in which to store device health metrics","long_desc":"","tags":[],"see_also":[]},"retention_period":{"name":"retention_period","type":"secs","level":"advanced","flags":1,"default_value":"15552000","min":"","max":"","enum_allowed":[],"desc":"how long to retain device health metrics","long_desc":"","tags":[],"see_also":[]},"scrape_frequency":{"name":"scrape_frequency","type":"secs","level":"advanced","flags":1,"default_value":"86400","min":"","max":"","enum_allowed":[],"desc":"how frequently to scrape device health metrics","long_desc":"","tags":[],"see_also":[]},"self_heal":{"name":"self_heal","type":"bool","level":"advanced","flags":1,"default_value":"True","min":"","max":"","enum_allowed":[],"desc":"preemptively heal cluster around devices that may fail","long_desc":"","tags":[],"see_also":[]},"sleep_interval":{"name":"sleep_interval","type":"secs","level":"advanced","flags":1,"default_value":"600","min":"","max":"","enum_allowed":[],"desc":"how frequently to wake up and check device health","long_desc":"","tags":[],"see_also":[]},"warn_threshold":{"name":"warn_threshold","type":"secs","level":"advanced","flags":1,"default_value":"7257600","min":"","max":"","enum_allowed":[],"desc":"raise health warning if OSD may fail before this long","long_desc":"","tags":[],"see_also":[]}}},{"name":"diskprediction_local","can_run":true,"error_string":"","module_options":{"log_level":{"name":"log_level","type":"str","level":"advanced","flags":1,"default_value":"","min":"","max":"","enum_allowed":["","critical","debug","error","info","warning"],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_cluster":{"name":"log_to_cluster","type":"bool","level":"advanced","flags":1,"default_value":"False","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_cluster_level":{"name":"log_to_cluster_level","type":"str","level":"advanced","flags":1,"default_value":"info","min":"","max":"","enum_allowed":["","critical","debug","error","info","warning"],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_file":{"name":"log_to_file","type":"bool","level":"advanced","flags":1,"default_value":"False","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"predict_interval":{"name":"predict_interval","type":"str","level":"advanced","flags":0,"default_value":"86400","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"predictor_model":{"name":"predictor_model","type":"str","level":"advanced","flags":0,"default_value":"prophetstor","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"sleep_interval":{"name":"sleep_interval","type":"str","level":"advanced","flags":0,"default_value":"600","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]}}},{"name":"influx","can_run":false,"error_string":"influxdb python module not found","module_options":{"batch_size":{"name":"batch_size","type":"int","level":"advanced","flags":0,"default_value":"5000","min":"","max":"","enum_allowed":[],"desc":"How big batches of data points should be when sending to InfluxDB.","long_desc":"","tags":[],"see_also":[]},"database":{"name":"database","type":"str","level":"advanced","flags":0,"default_value":"ceph","min":"","max":"","enum_allowed":[],"desc":"InfluxDB database name. You will need to create this database and grant write privileges to the configured username or the username must have admin privileges to create it.","long_desc":"","tags":[],"see_also":[]},"hostname":{"name":"hostname","type":"str","level":"advanced","flags":0,"default_value":"","min":"","max":"","enum_allowed":[],"desc":"InfluxDB server hostname","long_desc":"","tags":[],"see_also":[]},"interval":{"name":"interval","type":"secs","level":"advanced","flags":0,"default_value":"30","min":"5","max":"","enum_allowed":[],"desc":"Time between reports to InfluxDB. Default 30 seconds.","long_desc":"","tags":[],"see_also":[]},"log_level":{"name":"log_level","type":"str","level":"advanced","flags":1,"default_value":"","min":"","max":"","enum_allowed":["","critical","debug","error","info","warning"],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_cluster":{"name":"log_to_cluster","type":"bool","level":"advanced","flags":1,"default_value":"False","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_cluster_level":{"name":"log_to_cluster_level","type":"str","level":"advanced","flags":1,"default_value":"info","min":"","max":"","enum_allowed":["","critical","debug","error","info","warning"],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_file":{"name":"log_to_file","type":"bool","level":"advanced","flags":1,"default_value":"False","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"password":{"name":"password","type":"str","level":"advanced","flags":0,"default_value":"","min":"","max":"","enum_allowed":[],"desc":"password of InfluxDB server user","long_desc":"","tags":[],"see_also":[]},"port":{"name":"port","type":"int","level":"advanced","flags":0,"default_value":"8086","min":"","max":"","enum_allowed":[],"desc":"InfluxDB server port","long_desc":"","tags":[],"see_also":[]},"ssl":{"name":"ssl","type":"str","level":"advanced","flags":0,"default_value":"false","min":"","max":"","enum_allowed":[],"desc":"Use https connection for InfluxDB server. Use \"true\" or \"false\".","long_desc":"","tags":[],"see_also":[]},"threads":{"name":"threads","type":"int","level":"advanced","flags":0,"default_value":"5","min":"1","max":"32","enum_allowed":[],"desc":"How many worker threads should be spawned for sending data to InfluxDB.","long_desc":"","tags":[],"see_also":[]},"username":{"name":"username","type":"str","level":"advanced","flags":0,"default_value":"","min":"","max":"","enum_allowed":[],"desc":"username of InfluxDB server user","long_desc":"","tags":[],"see_also":[]},"verify_ssl":{"name":"verify_ssl","type":"str","level":"advanced","flags":0,"default_value":"true","min":"","max":"","enum_allowed":[],"desc":"Verify https cert for InfluxDB server. Use \"true\" or \"false\".","long_desc":"","tags":[],"see_also":[]}}},{"name":"insights","can_run":true,"error_string":"","module_options":{"log_level":{"name":"log_level","type":"str","level":"advanced","flags":1,"default_value":"","min":"","max":"","enum_allowed":["","critical","debug","error","info","warning"],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_cluster":{"name":"log_to_cluster","type":"bool","level":"advanced","flags":1,"default_value":"False","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_cluster_level":{"name":"log_to_cluster_level","type":"str","level":"advanced","flags":1,"default_value":"info","min":"","max":"","enum_allowed":["","critical","debug","error","info","warning"],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_file":{"name":"log_to_file","type":"bool","level":"advanced","flags":1,"default_value":"False","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]}}},{"name":"iostat","can_run":true,"error_string":"","module_options":{"log_level":{"name":"log_level","type":"str","level":"advanced","flags":1,"default_value":"","min":"","max":"","enum_allowed":["","critical","debug","error","info","warning"],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_cluster":{"name":"log_to_cluster","type":"bool","level":"advanced","flags":1,"default_value":"False","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_cluster_level":{"name":"log_to_cluster_level","type":"str","level":"advanced","flags":1,"default_value":"info","min":"","max":"","enum_allowed":["","critical","debug","error","info","warning"],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_file":{"name":"log_to_file","type":"bool","level":"advanced","flags":1,"default_value":"False","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]}}},{"name":"localpool","can_run":true,"error_string":"","module_options":{"failure_domain":{"name":"failure_domain","type":"str","level":"advanced","flags":1,"default_value":"host","min":"","max":"","enum_allowed":[],"desc":"failure domain for any created local pool","long_desc":"what failure domain we should separate data replicas across.","tags":[],"see_also":[]},"log_level":{"name":"log_level","type":"str","level":"advanced","flags":1,"default_value":"","min":"","max":"","enum_allowed":["","critical","debug","error","info","warning"],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_cluster":{"name":"log_to_cluster","type":"bool","level":"advanced","flags":1,"default_value":"False","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_cluster_level":{"name":"log_to_cluster_level","type":"str","level":"advanced","flags":1,"default_value":"info","min":"","max":"","enum_allowed":["","critical","debug","error","info","warning"],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_file":{"name":"log_to_file","type":"bool","level":"advanced","flags":1,"default_value":"False","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"min_size":{"name":"min_size","type":"int","level":"advanced","flags":1,"default_value":"","min":"","max":"","enum_allowed":[],"desc":"default min_size for any created local pool","long_desc":"value to set min_size to (unchanged from Ceph's default if this option is not set)","tags":[],"see_also":[]},"num_rep":{"name":"num_rep","type":"int","level":"advanced","flags":1,"default_value":"3","min":"","max":"","enum_allowed":[],"desc":"default replica count for any created local pool","long_desc":"","tags":[],"see_also":[]},"pg_num":{"name":"pg_num","type":"int","level":"advanced","flags":1,"default_value":"128","min":"","max":"","enum_allowed":[],"desc":"default pg_num for any created local pool","long_desc":"","tags":[],"see_also":[]},"prefix":{"name":"prefix","type":"str","level":"advanced","flags":1,"default_value":"","min":"","max":"","enum_allowed":[],"desc":"name prefix for any created local pool","long_desc":"","tags":[],"see_also":[]},"subtree":{"name":"subtree","type":"str","level":"advanced","flags":1,"default_value":"rack","min":"","max":"","enum_allowed":[],"desc":"CRUSH level for which to create a local pool","long_desc":"which CRUSH subtree type the module should create a pool for.","tags":[],"see_also":[]}}},{"name":"mds_autoscaler","can_run":true,"error_string":"","module_options":{"log_level":{"name":"log_level","type":"str","level":"advanced","flags":1,"default_value":"","min":"","max":"","enum_allowed":["","critical","debug","error","info","warning"],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_cluster":{"name":"log_to_cluster","type":"bool","level":"advanced","flags":1,"default_value":"False","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_cluster_level":{"name":"log_to_cluster_level","type":"str","level":"advanced","flags":1,"default_value":"info","min":"","max":"","enum_allowed":["","critical","debug","error","info","warning"],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_file":{"name":"log_to_file","type":"bool","level":"advanced","flags":1,"default_value":"False","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]}}},{"name":"mirroring","can_run":true,"error_string":"","module_options":{"log_level":{"name":"log_level","type":"str","level":"advanced","flags":1,"default_value":"","min":"","max":"","enum_allowed":["","critical","debug","error","info","warning"],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_cluster":{"name":"log_to_cluster","type":"bool","level":"advanced","flags":1,"default_value":"False","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_cluster_level":{"name":"log_to_cluster_level","type":"str","level":"advanced","flags":1,"default_value":"info","min":"","max":"","enum_allowed":["","critical","debug","error","info","warning"],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_file":{"name":"log_to_file","type":"bool","level":"advanced","flags":1,"default_value":"False","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]}}},{"name":"nfs","can_run":true,"error_string":"","module_options":{"log_level":{"name":"log_level","type":"str","level":"advanced","flags":1,"default_value":"","min":"","max":"","enum_allowed":["","critical","debug","error","info","warning"],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_cluster":{"name":"log_to_cluster","type":"bool","level":"advanced","flags":1,"default_value":"False","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_cluster_level":{"name":"log_to_cluster_level","type":"str","level":"advanced","flags":1,"default_value":"info","min":"","max":"","enum_allowed":["","critical","debug","error","info","warning"],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_file":{"name":"log_to_file","type":"bool","level":"advanced","flags":1,"default_value":"False","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]}}},{"name":"orchestrator","can_run":true,"error_string":"","module_options":{"log_level":{"name":"log_level","type":"str","level":"advanced","flags":1,"default_value":"","min":"","max":"","enum_allowed":["","critical","debug","error","info","warning"],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_cluster":{"name":"log_to_cluster","type":"bool","level":"advanced","flags":1,"default_value":"False","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_cluster_level":{"name":"log_to_cluster_level","type":"str","level":"advanced","flags":1,"default_value":"info","min":"","max":"","enum_allowed":["","critical","debug","error","info","warning"],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_file":{"name":"log_to_file","type":"bool","level":"advanced","flags":1,"default_value":"False","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"orchestrator":{"name":"orchestrator","type":"str","level":"advanced","flags":1,"default_value":"","min":"","max":"","enum_allowed":["cephadm","rook","test_orchestrator"],"desc":"Orchestrator backend","long_desc":"","tags":[],"see_also":[]}}},{"name":"osd_perf_query","can_run":true,"error_string":"","module_options":{"log_level":{"name":"log_level","type":"str","level":"advanced","flags":1,"default_value":"","min":"","max":"","enum_allowed":["","critical","debug","error","info","warning"],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_cluster":{"name":"log_to_cluster","type":"bool","level":"advanced","flags":1,"default_value":"False","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_cluster_level":{"name":"log_to_cluster_level","type":"str","level":"advanced","flags":1,"default_value":"info","min":"","max":"","enum_allowed":["","critical","debug","error","info","warning"],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_file":{"name":"log_to_file","type":"bool","level":"advanced","flags":1,"default_value":"False","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]}}},{"name":"osd_support","can_run":true,"error_string":"","module_options":{"log_level":{"name":"log_level","type":"str","level":"advanced","flags":1,"default_value":"","min":"","max":"","enum_allowed":["","critical","debug","error","info","warning"],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_cluster":{"name":"log_to_cluster","type":"bool","level":"advanced","flags":1,"default_value":"False","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_cluster_level":{"name":"log_to_cluster_level","type":"str","level":"advanced","flags":1,"default_value":"info","min":"","max":"","enum_allowed":["","critical","debug","error","info","warning"],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_file":{"name":"log_to_file","type":"bool","level":"advanced","flags":1,"default_value":"False","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]}}},{"name":"pg_autoscaler","can_run":true,"error_string":"","module_options":{"log_level":{"name":"log_level","type":"str","level":"advanced","flags":1,"default_value":"","min":"","max":"","enum_allowed":["","critical","debug","error","info","warning"],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_cluster":{"name":"log_to_cluster","type":"bool","level":"advanced","flags":1,"default_value":"False","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_cluster_level":{"name":"log_to_cluster_level","type":"str","level":"advanced","flags":1,"default_value":"info","min":"","max":"","enum_allowed":["","critical","debug","error","info","warning"],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_file":{"name":"log_to_file","type":"bool","level":"advanced","flags":1,"default_value":"False","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"noautoscale":{"name":"noautoscale","type":"bool","level":"advanced","flags":0,"default_value":"False","min":"","max":"","enum_allowed":[],"desc":"global autoscale flag","long_desc":"Option to turn on/off the autoscaler for all pools","tags":[],"see_also":[]},"sleep_interval":{"name":"sleep_interval","type":"secs","level":"advanced","flags":0,"default_value":"60","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"threshold":{"name":"threshold","type":"float","level":"advanced","flags":0,"default_value":"3.0","min":"1.0","max":"","enum_allowed":[],"desc":"scaling threshold","long_desc":"The factor by which the `NEW PG_NUM` must vary from the current`PG_NUM` before being accepted. Cannot be less than 1.0","tags":[],"see_also":[]}}},{"name":"progress","can_run":true,"error_string":"","module_options":{"allow_pg_recovery_event":{"name":"allow_pg_recovery_event","type":"bool","level":"advanced","flags":1,"default_value":"False","min":"","max":"","enum_allowed":[],"desc":"allow the module to show pg recovery progress","long_desc":"","tags":[],"see_also":[]},"enabled":{"name":"enabled","type":"bool","level":"advanced","flags":0,"default_value":"True","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_level":{"name":"log_level","type":"str","level":"advanced","flags":1,"default_value":"","min":"","max":"","enum_allowed":["","critical","debug","error","info","warning"],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_cluster":{"name":"log_to_cluster","type":"bool","level":"advanced","flags":1,"default_value":"False","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_cluster_level":{"name":"log_to_cluster_level","type":"str","level":"advanced","flags":1,"default_value":"info","min":"","max":"","enum_allowed":["","critical","debug","error","info","warning"],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_file":{"name":"log_to_file","type":"bool","level":"advanced","flags":1,"default_value":"False","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"max_completed_events":{"name":"max_completed_events","type":"int","level":"advanced","flags":1,"default_value":"50","min":"","max":"","enum_allowed":[],"desc":"number of past completed events to remember","long_desc":"","tags":[],"see_also":[]},"sleep_interval":{"name":"sleep_interval","type":"secs","level":"advanced","flags":1,"default_value":"5","min":"","max":"","enum_allowed":[],"desc":"how long the module is going to sleep","long_desc":"","tags":[],"see_also":[]}}},{"name":"prometheus","can_run":true,"error_string":"","module_options":{"cache":{"name":"cache","type":"bool","level":"advanced","flags":0,"default_value":"True","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_level":{"name":"log_level","type":"str","level":"advanced","flags":1,"default_value":"","min":"","max":"","enum_allowed":["","critical","debug","error","info","warning"],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_cluster":{"name":"log_to_cluster","type":"bool","level":"advanced","flags":1,"default_value":"False","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_cluster_level":{"name":"log_to_cluster_level","type":"str","level":"advanced","flags":1,"default_value":"info","min":"","max":"","enum_allowed":["","critical","debug","error","info","warning"],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_file":{"name":"log_to_file","type":"bool","level":"advanced","flags":1,"default_value":"False","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"rbd_stats_pools":{"name":"rbd_stats_pools","type":"str","level":"advanced","flags":0,"default_value":"","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"rbd_stats_pools_refresh_interval":{"name":"rbd_stats_pools_refresh_interval","type":"int","level":"advanced","flags":0,"default_value":"300","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"scrape_interval":{"name":"scrape_interval","type":"float","level":"advanced","flags":0,"default_value":"15.0","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"server_addr":{"name":"server_addr","type":"str","level":"advanced","flags":0,"default_value":"::","min":"","max":"","enum_allowed":[],"desc":"the IPv4 or IPv6 address on which the module listens for HTTP requests","long_desc":"","tags":[],"see_also":[]},"server_port":{"name":"server_port","type":"int","level":"advanced","flags":1,"default_value":"9283","min":"","max":"","enum_allowed":[],"desc":"the port on which the module listens for HTTP requests","long_desc":"","tags":[],"see_also":[]},"stale_cache_strategy":{"name":"stale_cache_strategy","type":"str","level":"advanced","flags":0,"default_value":"log","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"standby_behaviour":{"name":"standby_behaviour","type":"str","level":"advanced","flags":1,"default_value":"default","min":"","max":"","enum_allowed":["default","error"],"desc":"","long_desc":"","tags":[],"see_also":[]},"standby_error_status_code":{"name":"standby_error_status_code","type":"int","level":"advanced","flags":1,"default_value":"500","min":"400","max":"599","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]}}},{"name":"rbd_support","can_run":true,"error_string":"","module_options":{"log_level":{"name":"log_level","type":"str","level":"advanced","flags":1,"default_value":"","min":"","max":"","enum_allowed":["","critical","debug","error","info","warning"],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_cluster":{"name":"log_to_cluster","type":"bool","level":"advanced","flags":1,"default_value":"False","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_cluster_level":{"name":"log_to_cluster_level","type":"str","level":"advanced","flags":1,"default_value":"info","min":"","max":"","enum_allowed":["","critical","debug","error","info","warning"],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_file":{"name":"log_to_file","type":"bool","level":"advanced","flags":1,"default_value":"False","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"max_concurrent_snap_create":{"name":"max_concurrent_snap_create","type":"int","level":"advanced","flags":0,"default_value":"10","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"mirror_snapshot_schedule":{"name":"mirror_snapshot_schedule","type":"str","level":"advanced","flags":0,"default_value":"","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"trash_purge_schedule":{"name":"trash_purge_schedule","type":"str","level":"advanced","flags":0,"default_value":"","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]}}},{"name":"restful","can_run":true,"error_string":"","module_options":{"enable_auth":{"name":"enable_auth","type":"bool","level":"advanced","flags":0,"default_value":"True","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"key_file":{"name":"key_file","type":"str","level":"advanced","flags":0,"default_value":"","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_level":{"name":"log_level","type":"str","level":"advanced","flags":1,"default_value":"","min":"","max":"","enum_allowed":["","critical","debug","error","info","warning"],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_cluster":{"name":"log_to_cluster","type":"bool","level":"advanced","flags":1,"default_value":"False","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_cluster_level":{"name":"log_to_cluster_level","type":"str","level":"advanced","flags":1,"default_value":"info","min":"","max":"","enum_allowed":["","critical","debug","error","info","warning"],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_file":{"name":"log_to_file","type":"bool","level":"advanced","flags":1,"default_value":"False","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"server_addr":{"name":"server_addr","type":"str","level":"advanced","flags":0,"default_value":"","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"server_port":{"name":"server_port","type":"str","level":"advanced","flags":0,"default_value":"","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]}}},{"name":"rgw","can_run":true,"error_string":"","module_options":{"log_level":{"name":"log_level","type":"str","level":"advanced","flags":1,"default_value":"","min":"","max":"","enum_allowed":["","critical","debug","error","info","warning"],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_cluster":{"name":"log_to_cluster","type":"bool","level":"advanced","flags":1,"default_value":"False","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_cluster_level":{"name":"log_to_cluster_level","type":"str","level":"advanced","flags":1,"default_value":"info","min":"","max":"","enum_allowed":["","critical","debug","error","info","warning"],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_file":{"name":"log_to_file","type":"bool","level":"advanced","flags":1,"default_value":"False","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]}}},{"name":"rook","can_run":true,"error_string":"","module_options":{"drive_group_interval":{"name":"drive_group_interval","type":"float","level":"advanced","flags":0,"default_value":"300.0","min":"","max":"","enum_allowed":[],"desc":"interval in seconds between re-application of applied drive_groups","long_desc":"","tags":[],"see_also":[]},"log_level":{"name":"log_level","type":"str","level":"advanced","flags":1,"default_value":"","min":"","max":"","enum_allowed":["","critical","debug","error","info","warning"],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_cluster":{"name":"log_to_cluster","type":"bool","level":"advanced","flags":1,"default_value":"False","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_cluster_level":{"name":"log_to_cluster_level","type":"str","level":"advanced","flags":1,"default_value":"info","min":"","max":"","enum_allowed":["","critical","debug","error","info","warning"],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_file":{"name":"log_to_file","type":"bool","level":"advanced","flags":1,"default_value":"False","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"storage_class":{"name":"storage_class","type":"str","level":"advanced","flags":0,"default_value":"local","min":"","max":"","enum_allowed":[],"desc":"storage class name for LSO-discovered PVs","long_desc":"","tags":[],"see_also":[]}}},{"name":"selftest","can_run":true,"error_string":"","module_options":{"log_level":{"name":"log_level","type":"str","level":"advanced","flags":1,"default_value":"","min":"","max":"","enum_allowed":["","critical","debug","error","info","warning"],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_cluster":{"name":"log_to_cluster","type":"bool","level":"advanced","flags":1,"default_value":"False","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_cluster_level":{"name":"log_to_cluster_level","type":"str","level":"advanced","flags":1,"default_value":"info","min":"","max":"","enum_allowed":["","critical","debug","error","info","warning"],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_file":{"name":"log_to_file","type":"bool","level":"advanced","flags":1,"default_value":"False","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"roption1":{"name":"roption1","type":"str","level":"advanced","flags":0,"default_value":"","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"roption2":{"name":"roption2","type":"str","level":"advanced","flags":0,"default_value":"xyz","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"rwoption1":{"name":"rwoption1","type":"str","level":"advanced","flags":0,"default_value":"","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"rwoption2":{"name":"rwoption2","type":"int","level":"advanced","flags":0,"default_value":"","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"rwoption3":{"name":"rwoption3","type":"float","level":"advanced","flags":0,"default_value":"","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"rwoption4":{"name":"rwoption4","type":"str","level":"advanced","flags":0,"default_value":"","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"rwoption5":{"name":"rwoption5","type":"bool","level":"advanced","flags":0,"default_value":"","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"rwoption6":{"name":"rwoption6","type":"bool","level":"advanced","flags":0,"default_value":"True","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"rwoption7":{"name":"rwoption7","type":"int","level":"advanced","flags":0,"default_value":"","min":"1","max":"42","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"testkey":{"name":"testkey","type":"str","level":"advanced","flags":0,"default_value":"","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"testlkey":{"name":"testlkey","type":"str","level":"advanced","flags":0,"default_value":"","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"testnewline":{"name":"testnewline","type":"str","level":"advanced","flags":0,"default_value":"","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]}}},{"name":"snap_schedule","can_run":true,"error_string":"","module_options":{"allow_m_granularity":{"name":"allow_m_granularity","type":"bool","level":"advanced","flags":1,"default_value":"False","min":"","max":"","enum_allowed":[],"desc":"allow minute scheduled snapshots","long_desc":"","tags":[],"see_also":[]},"dump_on_update":{"name":"dump_on_update","type":"bool","level":"advanced","flags":1,"default_value":"False","min":"","max":"","enum_allowed":[],"desc":"dump database to debug log on update","long_desc":"","tags":[],"see_also":[]},"log_level":{"name":"log_level","type":"str","level":"advanced","flags":1,"default_value":"","min":"","max":"","enum_allowed":["","critical","debug","error","info","warning"],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_cluster":{"name":"log_to_cluster","type":"bool","level":"advanced","flags":1,"default_value":"False","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_cluster_level":{"name":"log_to_cluster_level","type":"str","level":"advanced","flags":1,"default_value":"info","min":"","max":"","enum_allowed":["","critical","debug","error","info","warning"],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_file":{"name":"log_to_file","type":"bool","level":"advanced","flags":1,"default_value":"False","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]}}},{"name":"stats","can_run":true,"error_string":"","module_options":{"log_level":{"name":"log_level","type":"str","level":"advanced","flags":1,"default_value":"","min":"","max":"","enum_allowed":["","critical","debug","error","info","warning"],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_cluster":{"name":"log_to_cluster","type":"bool","level":"advanced","flags":1,"default_value":"False","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_cluster_level":{"name":"log_to_cluster_level","type":"str","level":"advanced","flags":1,"default_value":"info","min":"","max":"","enum_allowed":["","critical","debug","error","info","warning"],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_file":{"name":"log_to_file","type":"bool","level":"advanced","flags":1,"default_value":"False","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]}}},{"name":"status","can_run":true,"error_string":"","module_options":{"log_level":{"name":"log_level","type":"str","level":"advanced","flags":1,"default_value":"","min":"","max":"","enum_allowed":["","critical","debug","error","info","warning"],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_cluster":{"name":"log_to_cluster","type":"bool","level":"advanced","flags":1,"default_value":"False","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_cluster_level":{"name":"log_to_cluster_level","type":"str","level":"advanced","flags":1,"default_value":"info","min":"","max":"","enum_allowed":["","critical","debug","error","info","warning"],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_file":{"name":"log_to_file","type":"bool","level":"advanced","flags":1,"default_value":"False","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]}}},{"name":"telegraf","can_run":true,"error_string":"","module_options":{"address":{"name":"address","type":"str","level":"advanced","flags":0,"default_value":"unixgram:///tmp/telegraf.sock","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"interval":{"name":"interval","type":"secs","level":"advanced","flags":0,"default_value":"15","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_level":{"name":"log_level","type":"str","level":"advanced","flags":1,"default_value":"","min":"","max":"","enum_allowed":["","critical","debug","error","info","warning"],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_cluster":{"name":"log_to_cluster","type":"bool","level":"advanced","flags":1,"default_value":"False","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_cluster_level":{"name":"log_to_cluster_level","type":"str","level":"advanced","flags":1,"default_value":"info","min":"","max":"","enum_allowed":["","critical","debug","error","info","warning"],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_file":{"name":"log_to_file","type":"bool","level":"advanced","flags":1,"default_value":"False","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]}}},{"name":"telemetry","can_run":true,"error_string":"","module_options":{"channel_basic":{"name":"channel_basic","type":"bool","level":"advanced","flags":0,"default_value":"True","min":"","max":"","enum_allowed":[],"desc":"Share basic cluster information (size, version)","long_desc":"","tags":[],"see_also":[]},"channel_crash":{"name":"channel_crash","type":"bool","level":"advanced","flags":0,"default_value":"True","min":"","max":"","enum_allowed":[],"desc":"Share metadata about Ceph daemon crashes (version, stack straces, etc)","long_desc":"","tags":[],"see_also":[]},"channel_device":{"name":"channel_device","type":"bool","level":"advanced","flags":0,"default_value":"True","min":"","max":"","enum_allowed":[],"desc":"Share device health metrics (e.g., SMART data, minus potentially identifying info like serial numbers)","long_desc":"","tags":[],"see_also":[]},"channel_ident":{"name":"channel_ident","type":"bool","level":"advanced","flags":0,"default_value":"False","min":"","max":"","enum_allowed":[],"desc":"Share a user-provided description and/or contact email for the cluster","long_desc":"","tags":[],"see_also":[]},"channel_perf":{"name":"channel_perf","type":"bool","level":"advanced","flags":0,"default_value":"False","min":"","max":"","enum_allowed":[],"desc":"Share various performance metrics of a cluster","long_desc":"","tags":[],"see_also":[]},"contact":{"name":"contact","type":"str","level":"advanced","flags":0,"default_value":"","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"description":{"name":"description","type":"str","level":"advanced","flags":0,"default_value":"","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"device_url":{"name":"device_url","type":"str","level":"advanced","flags":0,"default_value":"https://telemetry.ceph.com/device","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"enabled":{"name":"enabled","type":"bool","level":"advanced","flags":0,"default_value":"False","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"interval":{"name":"interval","type":"int","level":"advanced","flags":0,"default_value":"24","min":"8","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"last_opt_revision":{"name":"last_opt_revision","type":"int","level":"advanced","flags":0,"default_value":"1","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"leaderboard":{"name":"leaderboard","type":"bool","level":"advanced","flags":0,"default_value":"False","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_level":{"name":"log_level","type":"str","level":"advanced","flags":1,"default_value":"","min":"","max":"","enum_allowed":["","critical","debug","error","info","warning"],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_cluster":{"name":"log_to_cluster","type":"bool","level":"advanced","flags":1,"default_value":"False","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_cluster_level":{"name":"log_to_cluster_level","type":"str","level":"advanced","flags":1,"default_value":"info","min":"","max":"","enum_allowed":["","critical","debug","error","info","warning"],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_file":{"name":"log_to_file","type":"bool","level":"advanced","flags":1,"default_value":"False","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"organization":{"name":"organization","type":"str","level":"advanced","flags":0,"default_value":"","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"proxy":{"name":"proxy","type":"str","level":"advanced","flags":0,"default_value":"","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"url":{"name":"url","type":"str","level":"advanced","flags":0,"default_value":"https://telemetry.ceph.com/report","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]}}},{"name":"test_orchestrator","can_run":true,"error_string":"","module_options":{"log_level":{"name":"log_level","type":"str","level":"advanced","flags":1,"default_value":"","min":"","max":"","enum_allowed":["","critical","debug","error","info","warning"],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_cluster":{"name":"log_to_cluster","type":"bool","level":"advanced","flags":1,"default_value":"False","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_cluster_level":{"name":"log_to_cluster_level","type":"str","level":"advanced","flags":1,"default_value":"info","min":"","max":"","enum_allowed":["","critical","debug","error","info","warning"],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_file":{"name":"log_to_file","type":"bool","level":"advanced","flags":1,"default_value":"False","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]}}},{"name":"volumes","can_run":true,"error_string":"","module_options":{"log_level":{"name":"log_level","type":"str","level":"advanced","flags":1,"default_value":"","min":"","max":"","enum_allowed":["","critical","debug","error","info","warning"],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_cluster":{"name":"log_to_cluster","type":"bool","level":"advanced","flags":1,"default_value":"False","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_cluster_level":{"name":"log_to_cluster_level","type":"str","level":"advanced","flags":1,"default_value":"info","min":"","max":"","enum_allowed":["","critical","debug","error","info","warning"],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_file":{"name":"log_to_file","type":"bool","level":"advanced","flags":1,"default_value":"False","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"max_concurrent_clones":{"name":"max_concurrent_clones","type":"int","level":"advanced","flags":0,"default_value":"4","min":"","max":"","enum_allowed":[],"desc":"Number of asynchronous cloner threads","long_desc":"","tags":[],"see_also":[]},"snapshot_clone_delay":{"name":"snapshot_clone_delay","type":"int","level":"advanced","flags":0,"default_value":"0","min":"","max":"","enum_allowed":[],"desc":"Delay clone begin operation by snapshot_clone_delay seconds","long_desc":"","tags":[],"see_also":[]}}},{"name":"zabbix","can_run":true,"error_string":"","module_options":{"discovery_interval":{"name":"discovery_interval","type":"uint","level":"advanced","flags":0,"default_value":"100","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"identifier":{"name":"identifier","type":"str","level":"advanced","flags":0,"default_value":"","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"interval":{"name":"interval","type":"secs","level":"advanced","flags":0,"default_value":"60","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_level":{"name":"log_level","type":"str","level":"advanced","flags":1,"default_value":"","min":"","max":"","enum_allowed":["","critical","debug","error","info","warning"],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_cluster":{"name":"log_to_cluster","type":"bool","level":"advanced","flags":1,"default_value":"False","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_cluster_level":{"name":"log_to_cluster_level","type":"str","level":"advanced","flags":1,"default_value":"info","min":"","max":"","enum_allowed":["","critical","debug","error","info","warning"],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_file":{"name":"log_to_file","type":"bool","level":"advanced","flags":1,"default_value":"False","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"zabbix_host":{"name":"zabbix_host","type":"str","level":"advanced","flags":0,"default_value":"","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"zabbix_port":{"name":"zabbix_port","type":"int","level":"advanced","flags":0,"default_value":"10051","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"zabbix_sender":{"name":"zabbix_sender","type":"str","level":"advanced","flags":0,"default_value":"/usr/bin/zabbix_sender","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]}}}]}],"modules":["iostat","nfs","restful"],"available_modules":[{"name":"alerts","can_run":true,"error_string":"","module_options":{"interval":{"name":"interval","type":"secs","level":"advanced","flags":1,"default_value":"60","min":"","max":"","enum_allowed":[],"desc":"How frequently to reexamine health status","long_desc":"","tags":[],"see_also":[]},"log_level":{"name":"log_level","type":"str","level":"advanced","flags":1,"default_value":"","min":"","max":"","enum_allowed":["","critical","debug","error","info","warning"],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_cluster":{"name":"log_to_cluster","type":"bool","level":"advanced","flags":1,"default_value":"False","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_cluster_level":{"name":"log_to_cluster_level","type":"str","level":"advanced","flags":1,"default_value":"info","min":"","max":"","enum_allowed":["","critical","debug","error","info","warning"],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_file":{"name":"log_to_file","type":"bool","level":"advanced","flags":1,"default_value":"False","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"smtp_destination":{"name":"smtp_destination","type":"str","level":"advanced","flags":1,"default_value":"","min":"","max":"","enum_allowed":[],"desc":"Email address to send alerts to","long_desc":"","tags":[],"see_also":[]},"smtp_from_name":{"name":"smtp_from_name","type":"str","level":"advanced","flags":1,"default_value":"Ceph","min":"","max":"","enum_allowed":[],"desc":"Email From: name","long_desc":"","tags":[],"see_also":[]},"smtp_host":{"name":"smtp_host","type":"str","level":"advanced","flags":1,"default_value":"","min":"","max":"","enum_allowed":[],"desc":"SMTP server","long_desc":"","tags":[],"see_also":[]},"smtp_password":{"name":"smtp_password","type":"str","level":"advanced","flags":1,"default_value":"","min":"","max":"","enum_allowed":[],"desc":"Password to authenticate with","long_desc":"","tags":[],"see_also":[]},"smtp_port":{"name":"smtp_port","type":"int","level":"advanced","flags":1,"default_value":"465","min":"","max":"","enum_allowed":[],"desc":"SMTP port","long_desc":"","tags":[],"see_also":[]},"smtp_sender":{"name":"smtp_sender","type":"str","level":"advanced","flags":1,"default_value":"","min":"","max":"","enum_allowed":[],"desc":"SMTP envelope sender","long_desc":"","tags":[],"see_also":[]},"smtp_ssl":{"name":"smtp_ssl","type":"bool","level":"advanced","flags":1,"default_value":"True","min":"","max":"","enum_allowed":[],"desc":"Use SSL to connect to SMTP server","long_desc":"","tags":[],"see_also":[]},"smtp_user":{"name":"smtp_user","type":"str","level":"advanced","flags":1,"default_value":"","min":"","max":"","enum_allowed":[],"desc":"User to authenticate as","long_desc":"","tags":[],"see_also":[]}}},{"name":"balancer","can_run":true,"error_string":"","module_options":{"active":{"name":"active","type":"bool","level":"advanced","flags":1,"default_value":"True","min":"","max":"","enum_allowed":[],"desc":"automatically balance PGs across cluster","long_desc":"","tags":[],"see_also":[]},"begin_time":{"name":"begin_time","type":"str","level":"advanced","flags":1,"default_value":"0000","min":"","max":"","enum_allowed":[],"desc":"beginning time of day to automatically balance","long_desc":"This is a time of day in the format HHMM.","tags":[],"see_also":[]},"begin_weekday":{"name":"begin_weekday","type":"uint","level":"advanced","flags":1,"default_value":"0","min":"0","max":"7","enum_allowed":[],"desc":"Restrict automatic balancing to this day of the week or later","long_desc":"0 or 7 = Sunday, 1 = Monday, etc.","tags":[],"see_also":[]},"crush_compat_max_iterations":{"name":"crush_compat_max_iterations","type":"uint","level":"advanced","flags":1,"default_value":"25","min":"1","max":"250","enum_allowed":[],"desc":"maximum number of iterations to attempt optimization","long_desc":"","tags":[],"see_also":[]},"crush_compat_metrics":{"name":"crush_compat_metrics","type":"str","level":"advanced","flags":1,"default_value":"pgs,objects,bytes","min":"","max":"","enum_allowed":[],"desc":"metrics with which to calculate OSD utilization","long_desc":"Value is a list of one or more of \"pgs\", \"objects\", or \"bytes\", and indicates which metrics to use to balance utilization.","tags":[],"see_also":[]},"crush_compat_step":{"name":"crush_compat_step","type":"float","level":"advanced","flags":1,"default_value":"0.5","min":"0.001","max":"0.999","enum_allowed":[],"desc":"aggressiveness of optimization","long_desc":".99 is very aggressive, .01 is less aggressive","tags":[],"see_also":[]},"end_time":{"name":"end_time","type":"str","level":"advanced","flags":1,"default_value":"2400","min":"","max":"","enum_allowed":[],"desc":"ending time of day to automatically balance","long_desc":"This is a time of day in the format HHMM.","tags":[],"see_also":[]},"end_weekday":{"name":"end_weekday","type":"uint","level":"advanced","flags":1,"default_value":"7","min":"0","max":"7","enum_allowed":[],"desc":"Restrict automatic balancing to days of the week earlier than this","long_desc":"0 or 7 = Sunday, 1 = Monday, etc.","tags":[],"see_also":[]},"log_level":{"name":"log_level","type":"str","level":"advanced","flags":1,"default_value":"","min":"","max":"","enum_allowed":["","critical","debug","error","info","warning"],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_cluster":{"name":"log_to_cluster","type":"bool","level":"advanced","flags":1,"default_value":"False","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_cluster_level":{"name":"log_to_cluster_level","type":"str","level":"advanced","flags":1,"default_value":"info","min":"","max":"","enum_allowed":["","critical","debug","error","info","warning"],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_file":{"name":"log_to_file","type":"bool","level":"advanced","flags":1,"default_value":"False","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"min_score":{"name":"min_score","type":"float","level":"advanced","flags":1,"default_value":"0","min":"","max":"","enum_allowed":[],"desc":"minimum score, below which no optimization is attempted","long_desc":"","tags":[],"see_also":[]},"mode":{"name":"mode","type":"str","level":"advanced","flags":1,"default_value":"upmap","min":"","max":"","enum_allowed":["crush-compat","none","upmap"],"desc":"Balancer mode","long_desc":"","tags":[],"see_also":[]},"pool_ids":{"name":"pool_ids","type":"str","level":"advanced","flags":1,"default_value":"","min":"","max":"","enum_allowed":[],"desc":"pools which the automatic balancing will be limited to","long_desc":"","tags":[],"see_also":[]},"sleep_interval":{"name":"sleep_interval","type":"secs","level":"advanced","flags":1,"default_value":"60","min":"","max":"","enum_allowed":[],"desc":"how frequently to wake up and attempt optimization","long_desc":"","tags":[],"see_also":[]},"upmap_max_deviation":{"name":"upmap_max_deviation","type":"int","level":"advanced","flags":1,"default_value":"5","min":"1","max":"","enum_allowed":[],"desc":"deviation below which no optimization is attempted","long_desc":"If the number of PGs are within this count then no optimization is attempted","tags":[],"see_also":[]},"upmap_max_optimizations":{"name":"upmap_max_optimizations","type":"uint","level":"advanced","flags":1,"default_value":"10","min":"","max":"","enum_allowed":[],"desc":"maximum upmap optimizations to make per attempt","long_desc":"","tags":[],"see_also":[]}}},{"name":"cephadm","can_run":true,"error_string":"","module_options":{"agent_down_multiplier":{"name":"agent_down_multiplier","type":"float","level":"advanced","flags":0,"default_value":"3.0","min":"","max":"","enum_allowed":[],"desc":"Multiplied by agent refresh rate to calculate how long agent must not report before being marked down","long_desc":"","tags":[],"see_also":[]},"agent_refresh_rate":{"name":"agent_refresh_rate","type":"secs","level":"advanced","flags":0,"default_value":"20","min":"","max":"","enum_allowed":[],"desc":"How often agent on each host will try to gather and send metadata","long_desc":"","tags":[],"see_also":[]},"agent_starting_port":{"name":"agent_starting_port","type":"int","level":"advanced","flags":0,"default_value":"4721","min":"","max":"","enum_allowed":[],"desc":"First port agent will try to bind to (will also try up to next 1000 subsequent ports if blocked)","long_desc":"","tags":[],"see_also":[]},"allow_ptrace":{"name":"allow_ptrace","type":"bool","level":"advanced","flags":0,"default_value":"False","min":"","max":"","enum_allowed":[],"desc":"allow SYS_PTRACE capability on ceph containers","long_desc":"The SYS_PTRACE capability is needed to attach to a process with gdb or strace. Enabling this options can allow debugging daemons that encounter problems at runtime.","tags":[],"see_also":[]},"autotune_interval":{"name":"autotune_interval","type":"secs","level":"advanced","flags":0,"default_value":"600","min":"","max":"","enum_allowed":[],"desc":"how frequently to autotune daemon memory","long_desc":"","tags":[],"see_also":[]},"autotune_memory_target_ratio":{"name":"autotune_memory_target_ratio","type":"float","level":"advanced","flags":0,"default_value":"0.7","min":"","max":"","enum_allowed":[],"desc":"ratio of total system memory to divide amongst autotuned daemons","long_desc":"","tags":[],"see_also":[]},"cgroups_split":{"name":"cgroups_split","type":"bool","level":"advanced","flags":0,"default_value":"True","min":"","max":"","enum_allowed":[],"desc":"Pass --cgroups=split when cephadm creates containers (currently podman only)","long_desc":"","tags":[],"see_also":[]},"config_checks_enabled":{"name":"config_checks_enabled","type":"bool","level":"advanced","flags":0,"default_value":"False","min":"","max":"","enum_allowed":[],"desc":"Enable or disable the cephadm configuration analysis","long_desc":"","tags":[],"see_also":[]},"config_dashboard":{"name":"config_dashboard","type":"bool","level":"advanced","flags":0,"default_value":"True","min":"","max":"","enum_allowed":[],"desc":"manage configs like API endpoints in Dashboard.","long_desc":"","tags":[],"see_also":[]},"container_image_alertmanager":{"name":"container_image_alertmanager","type":"str","level":"advanced","flags":0,"default_value":"quay.io/prometheus/alertmanager:v0.25.0","min":"","max":"","enum_allowed":[],"desc":"Prometheus container image","long_desc":"","tags":[],"see_also":[]},"container_image_base":{"name":"container_image_base","type":"str","level":"advanced","flags":1,"default_value":"quay.io/ceph/ceph","min":"","max":"","enum_allowed":[],"desc":"Container image name, without the tag","long_desc":"","tags":[],"see_also":[]},"container_image_grafana":{"name":"container_image_grafana","type":"str","level":"advanced","flags":0,"default_value":"quay.io/ceph/ceph-grafana:9.4.7","min":"","max":"","enum_allowed":[],"desc":"Prometheus container image","long_desc":"","tags":[],"see_also":[]},"container_image_haproxy":{"name":"container_image_haproxy","type":"str","level":"advanced","flags":0,"default_value":"quay.io/ceph/haproxy:2.3","min":"","max":"","enum_allowed":[],"desc":"HAproxy container image","long_desc":"","tags":[],"see_also":[]},"container_image_keepalived":{"name":"container_image_keepalived","type":"str","level":"advanced","flags":0,"default_value":"quay.io/ceph/keepalived:2.1.5","min":"","max":"","enum_allowed":[],"desc":"Keepalived container image","long_desc":"","tags":[],"see_also":[]},"container_image_loki":{"name":"container_image_loki","type":"str","level":"advanced","flags":0,"default_value":"docker.io/grafana/loki:2.4.0","min":"","max":"","enum_allowed":[],"desc":"Loki container image","long_desc":"","tags":[],"see_also":[]},"container_image_node_exporter":{"name":"container_image_node_exporter","type":"str","level":"advanced","flags":0,"default_value":"quay.io/prometheus/node-exporter:v1.5.0","min":"","max":"","enum_allowed":[],"desc":"Prometheus container image","long_desc":"","tags":[],"see_also":[]},"container_image_prometheus":{"name":"container_image_prometheus","type":"str","level":"advanced","flags":0,"default_value":"quay.io/prometheus/prometheus:v2.43.0","min":"","max":"","enum_allowed":[],"desc":"Prometheus container image","long_desc":"","tags":[],"see_also":[]},"container_image_promtail":{"name":"container_image_promtail","type":"str","level":"advanced","flags":0,"default_value":"docker.io/grafana/promtail:2.4.0","min":"","max":"","enum_allowed":[],"desc":"Promtail container image","long_desc":"","tags":[],"see_also":[]},"container_image_snmp_gateway":{"name":"container_image_snmp_gateway","type":"str","level":"advanced","flags":0,"default_value":"docker.io/maxwo/snmp-notifier:v1.2.1","min":"","max":"","enum_allowed":[],"desc":"SNMP Gateway container image","long_desc":"","tags":[],"see_also":[]},"container_init":{"name":"container_init","type":"bool","level":"advanced","flags":0,"default_value":"True","min":"","max":"","enum_allowed":[],"desc":"Run podman/docker with `--init`","long_desc":"","tags":[],"see_also":[]},"daemon_cache_timeout":{"name":"daemon_cache_timeout","type":"secs","level":"advanced","flags":0,"default_value":"600","min":"","max":"","enum_allowed":[],"desc":"seconds to cache service (daemon) inventory","long_desc":"","tags":[],"see_also":[]},"default_cephadm_command_timeout":{"name":"default_cephadm_command_timeout","type":"secs","level":"advanced","flags":0,"default_value":"900","min":"","max":"","enum_allowed":[],"desc":"Default timeout applied to cephadm commands run directly on the host (in seconds)","long_desc":"","tags":[],"see_also":[]},"default_registry":{"name":"default_registry","type":"str","level":"advanced","flags":0,"default_value":"docker.io","min":"","max":"","enum_allowed":[],"desc":"Search-registry to which we should normalize unqualified image names. This is not the default registry","long_desc":"","tags":[],"see_also":[]},"device_cache_timeout":{"name":"device_cache_timeout","type":"secs","level":"advanced","flags":0,"default_value":"1800","min":"","max":"","enum_allowed":[],"desc":"seconds to cache device inventory","long_desc":"","tags":[],"see_also":[]},"device_enhanced_scan":{"name":"device_enhanced_scan","type":"bool","level":"advanced","flags":0,"default_value":"False","min":"","max":"","enum_allowed":[],"desc":"Use libstoragemgmt during device scans","long_desc":"","tags":[],"see_also":[]},"facts_cache_timeout":{"name":"facts_cache_timeout","type":"secs","level":"advanced","flags":0,"default_value":"60","min":"","max":"","enum_allowed":[],"desc":"seconds to cache host facts data","long_desc":"","tags":[],"see_also":[]},"host_check_interval":{"name":"host_check_interval","type":"secs","level":"advanced","flags":0,"default_value":"600","min":"","max":"","enum_allowed":[],"desc":"how frequently to perform a host check","long_desc":"","tags":[],"see_also":[]},"log_level":{"name":"log_level","type":"str","level":"advanced","flags":1,"default_value":"","min":"","max":"","enum_allowed":["","critical","debug","error","info","warning"],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_refresh_metadata":{"name":"log_refresh_metadata","type":"bool","level":"advanced","flags":0,"default_value":"False","min":"","max":"","enum_allowed":[],"desc":"Log all refresh metadata. Includes daemon, device, and host info collected regularly. Only has effect if logging at debug level","long_desc":"","tags":[],"see_also":[]},"log_to_cluster":{"name":"log_to_cluster","type":"bool","level":"advanced","flags":0,"default_value":"True","min":"","max":"","enum_allowed":[],"desc":"log to the \"cephadm\" cluster log channel\"","long_desc":"","tags":[],"see_also":[]},"log_to_cluster_level":{"name":"log_to_cluster_level","type":"str","level":"advanced","flags":1,"default_value":"info","min":"","max":"","enum_allowed":["","critical","debug","error","info","warning"],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_file":{"name":"log_to_file","type":"bool","level":"advanced","flags":1,"default_value":"False","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"manage_etc_ceph_ceph_conf":{"name":"manage_etc_ceph_ceph_conf","type":"bool","level":"advanced","flags":0,"default_value":"False","min":"","max":"","enum_allowed":[],"desc":"Manage and own /etc/ceph/ceph.conf on the hosts.","long_desc":"","tags":[],"see_also":[]},"manage_etc_ceph_ceph_conf_hosts":{"name":"manage_etc_ceph_ceph_conf_hosts","type":"str","level":"advanced","flags":0,"default_value":"*","min":"","max":"","enum_allowed":[],"desc":"PlacementSpec describing on which hosts to manage /etc/ceph/ceph.conf","long_desc":"","tags":[],"see_also":[]},"max_count_per_host":{"name":"max_count_per_host","type":"int","level":"advanced","flags":0,"default_value":"10","min":"","max":"","enum_allowed":[],"desc":"max number of daemons per service per host","long_desc":"","tags":[],"see_also":[]},"max_osd_draining_count":{"name":"max_osd_draining_count","type":"int","level":"advanced","flags":0,"default_value":"10","min":"","max":"","enum_allowed":[],"desc":"max number of osds that will be drained simultaneously when osds are removed","long_desc":"","tags":[],"see_also":[]},"migration_current":{"name":"migration_current","type":"int","level":"advanced","flags":0,"default_value":"","min":"","max":"","enum_allowed":[],"desc":"internal - do not modify","long_desc":"","tags":[],"see_also":[]},"mode":{"name":"mode","type":"str","level":"advanced","flags":0,"default_value":"root","min":"","max":"","enum_allowed":["cephadm-package","root"],"desc":"mode for remote execution of cephadm","long_desc":"","tags":[],"see_also":[]},"prometheus_alerts_path":{"name":"prometheus_alerts_path","type":"str","level":"advanced","flags":0,"default_value":"/etc/prometheus/ceph/ceph_default_alerts.yml","min":"","max":"","enum_allowed":[],"desc":"location of alerts to include in prometheus deployments","long_desc":"","tags":[],"see_also":[]},"registry_insecure":{"name":"registry_insecure","type":"bool","level":"advanced","flags":0,"default_value":"False","min":"","max":"","enum_allowed":[],"desc":"Registry is to be considered insecure (no TLS available). Only for development purposes.","long_desc":"","tags":[],"see_also":[]},"registry_password":{"name":"registry_password","type":"str","level":"advanced","flags":0,"default_value":"","min":"","max":"","enum_allowed":[],"desc":"Custom repository password. Only used for logging into a registry.","long_desc":"","tags":[],"see_also":[]},"registry_url":{"name":"registry_url","type":"str","level":"advanced","flags":0,"default_value":"","min":"","max":"","enum_allowed":[],"desc":"Registry url for login purposes. This is not the default registry","long_desc":"","tags":[],"see_also":[]},"registry_username":{"name":"registry_username","type":"str","level":"advanced","flags":0,"default_value":"","min":"","max":"","enum_allowed":[],"desc":"Custom repository username. Only used for logging into a registry.","long_desc":"","tags":[],"see_also":[]},"ssh_config_file":{"name":"ssh_config_file","type":"str","level":"advanced","flags":0,"default_value":"","min":"","max":"","enum_allowed":[],"desc":"customized SSH config file to connect to managed hosts","long_desc":"","tags":[],"see_also":[]},"use_agent":{"name":"use_agent","type":"bool","level":"advanced","flags":0,"default_value":"False","min":"","max":"","enum_allowed":[],"desc":"Use cephadm agent on each host to gather and send metadata","long_desc":"","tags":[],"see_also":[]},"use_repo_digest":{"name":"use_repo_digest","type":"bool","level":"advanced","flags":0,"default_value":"True","min":"","max":"","enum_allowed":[],"desc":"Automatically convert image tags to image digest. Make sure all daemons use the same image","long_desc":"","tags":[],"see_also":[]},"warn_on_failed_host_check":{"name":"warn_on_failed_host_check","type":"bool","level":"advanced","flags":0,"default_value":"True","min":"","max":"","enum_allowed":[],"desc":"raise a health warning if the host check fails","long_desc":"","tags":[],"see_also":[]},"warn_on_stray_daemons":{"name":"warn_on_stray_daemons","type":"bool","level":"advanced","flags":0,"default_value":"True","min":"","max":"","enum_allowed":[],"desc":"raise a health warning if daemons are detected that are not managed by cephadm","long_desc":"","tags":[],"see_also":[]},"warn_on_stray_hosts":{"name":"warn_on_stray_hosts","type":"bool","level":"advanced","flags":0,"default_value":"True","min":"","max":"","enum_allowed":[],"desc":"raise a health warning if daemons are detected on a host that is not managed by cephadm","long_desc":"","tags":[],"see_also":[]}}},{"name":"crash","can_run":true,"error_string":"","module_options":{"log_level":{"name":"log_level","type":"str","level":"advanced","flags":1,"default_value":"","min":"","max":"","enum_allowed":["","critical","debug","error","info","warning"],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_cluster":{"name":"log_to_cluster","type":"bool","level":"advanced","flags":1,"default_value":"False","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_cluster_level":{"name":"log_to_cluster_level","type":"str","level":"advanced","flags":1,"default_value":"info","min":"","max":"","enum_allowed":["","critical","debug","error","info","warning"],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_file":{"name":"log_to_file","type":"bool","level":"advanced","flags":1,"default_value":"False","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"retain_interval":{"name":"retain_interval","type":"secs","level":"advanced","flags":1,"default_value":"31536000","min":"","max":"","enum_allowed":[],"desc":"how long to retain crashes before pruning them","long_desc":"","tags":[],"see_also":[]},"warn_recent_interval":{"name":"warn_recent_interval","type":"secs","level":"advanced","flags":1,"default_value":"1209600","min":"","max":"","enum_allowed":[],"desc":"time interval in which to warn about recent crashes","long_desc":"","tags":[],"see_also":[]}}},{"name":"dashboard","can_run":true,"error_string":"","module_options":{"ACCOUNT_LOCKOUT_ATTEMPTS":{"name":"ACCOUNT_LOCKOUT_ATTEMPTS","type":"int","level":"advanced","flags":0,"default_value":"10","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"ALERTMANAGER_API_HOST":{"name":"ALERTMANAGER_API_HOST","type":"str","level":"advanced","flags":0,"default_value":"","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"ALERTMANAGER_API_SSL_VERIFY":{"name":"ALERTMANAGER_API_SSL_VERIFY","type":"bool","level":"advanced","flags":0,"default_value":"True","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"AUDIT_API_ENABLED":{"name":"AUDIT_API_ENABLED","type":"bool","level":"advanced","flags":0,"default_value":"False","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"AUDIT_API_LOG_PAYLOAD":{"name":"AUDIT_API_LOG_PAYLOAD","type":"bool","level":"advanced","flags":0,"default_value":"True","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"ENABLE_BROWSABLE_API":{"name":"ENABLE_BROWSABLE_API","type":"bool","level":"advanced","flags":0,"default_value":"True","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"FEATURE_TOGGLE_CEPHFS":{"name":"FEATURE_TOGGLE_CEPHFS","type":"bool","level":"advanced","flags":0,"default_value":"True","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"FEATURE_TOGGLE_DASHBOARD":{"name":"FEATURE_TOGGLE_DASHBOARD","type":"bool","level":"advanced","flags":0,"default_value":"True","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"FEATURE_TOGGLE_ISCSI":{"name":"FEATURE_TOGGLE_ISCSI","type":"bool","level":"advanced","flags":0,"default_value":"True","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"FEATURE_TOGGLE_MIRRORING":{"name":"FEATURE_TOGGLE_MIRRORING","type":"bool","level":"advanced","flags":0,"default_value":"True","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"FEATURE_TOGGLE_NFS":{"name":"FEATURE_TOGGLE_NFS","type":"bool","level":"advanced","flags":0,"default_value":"True","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"FEATURE_TOGGLE_RBD":{"name":"FEATURE_TOGGLE_RBD","type":"bool","level":"advanced","flags":0,"default_value":"True","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"FEATURE_TOGGLE_RGW":{"name":"FEATURE_TOGGLE_RGW","type":"bool","level":"advanced","flags":0,"default_value":"True","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"GANESHA_CLUSTERS_RADOS_POOL_NAMESPACE":{"name":"GANESHA_CLUSTERS_RADOS_POOL_NAMESPACE","type":"str","level":"advanced","flags":0,"default_value":"","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"GRAFANA_API_PASSWORD":{"name":"GRAFANA_API_PASSWORD","type":"str","level":"advanced","flags":0,"default_value":"admin","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"GRAFANA_API_SSL_VERIFY":{"name":"GRAFANA_API_SSL_VERIFY","type":"bool","level":"advanced","flags":0,"default_value":"True","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"GRAFANA_API_URL":{"name":"GRAFANA_API_URL","type":"str","level":"advanced","flags":0,"default_value":"","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"GRAFANA_API_USERNAME":{"name":"GRAFANA_API_USERNAME","type":"str","level":"advanced","flags":0,"default_value":"admin","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"GRAFANA_FRONTEND_API_URL":{"name":"GRAFANA_FRONTEND_API_URL","type":"str","level":"advanced","flags":0,"default_value":"","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"GRAFANA_UPDATE_DASHBOARDS":{"name":"GRAFANA_UPDATE_DASHBOARDS","type":"bool","level":"advanced","flags":0,"default_value":"False","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"ISCSI_API_SSL_VERIFICATION":{"name":"ISCSI_API_SSL_VERIFICATION","type":"bool","level":"advanced","flags":0,"default_value":"True","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"ISSUE_TRACKER_API_KEY":{"name":"ISSUE_TRACKER_API_KEY","type":"str","level":"advanced","flags":0,"default_value":"","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"PROMETHEUS_API_HOST":{"name":"PROMETHEUS_API_HOST","type":"str","level":"advanced","flags":0,"default_value":"","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"PROMETHEUS_API_SSL_VERIFY":{"name":"PROMETHEUS_API_SSL_VERIFY","type":"bool","level":"advanced","flags":0,"default_value":"True","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"PWD_POLICY_CHECK_COMPLEXITY_ENABLED":{"name":"PWD_POLICY_CHECK_COMPLEXITY_ENABLED","type":"bool","level":"advanced","flags":0,"default_value":"False","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"PWD_POLICY_CHECK_EXCLUSION_LIST_ENABLED":{"name":"PWD_POLICY_CHECK_EXCLUSION_LIST_ENABLED","type":"bool","level":"advanced","flags":0,"default_value":"False","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"PWD_POLICY_CHECK_LENGTH_ENABLED":{"name":"PWD_POLICY_CHECK_LENGTH_ENABLED","type":"bool","level":"advanced","flags":0,"default_value":"True","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"PWD_POLICY_CHECK_OLDPWD_ENABLED":{"name":"PWD_POLICY_CHECK_OLDPWD_ENABLED","type":"bool","level":"advanced","flags":0,"default_value":"True","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"PWD_POLICY_CHECK_REPETITIVE_CHARS_ENABLED":{"name":"PWD_POLICY_CHECK_REPETITIVE_CHARS_ENABLED","type":"bool","level":"advanced","flags":0,"default_value":"False","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"PWD_POLICY_CHECK_SEQUENTIAL_CHARS_ENABLED":{"name":"PWD_POLICY_CHECK_SEQUENTIAL_CHARS_ENABLED","type":"bool","level":"advanced","flags":0,"default_value":"False","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"PWD_POLICY_CHECK_USERNAME_ENABLED":{"name":"PWD_POLICY_CHECK_USERNAME_ENABLED","type":"bool","level":"advanced","flags":0,"default_value":"False","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"PWD_POLICY_ENABLED":{"name":"PWD_POLICY_ENABLED","type":"bool","level":"advanced","flags":0,"default_value":"True","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"PWD_POLICY_EXCLUSION_LIST":{"name":"PWD_POLICY_EXCLUSION_LIST","type":"str","level":"advanced","flags":0,"default_value":"osd,host,dashboard,pool,block,nfs,ceph,monitors,gateway,logs,crush,maps","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"PWD_POLICY_MIN_COMPLEXITY":{"name":"PWD_POLICY_MIN_COMPLEXITY","type":"int","level":"advanced","flags":0,"default_value":"10","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"PWD_POLICY_MIN_LENGTH":{"name":"PWD_POLICY_MIN_LENGTH","type":"int","level":"advanced","flags":0,"default_value":"8","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"REST_REQUESTS_TIMEOUT":{"name":"REST_REQUESTS_TIMEOUT","type":"int","level":"advanced","flags":0,"default_value":"45","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"RGW_API_ACCESS_KEY":{"name":"RGW_API_ACCESS_KEY","type":"str","level":"advanced","flags":0,"default_value":"","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"RGW_API_ADMIN_RESOURCE":{"name":"RGW_API_ADMIN_RESOURCE","type":"str","level":"advanced","flags":0,"default_value":"admin","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"RGW_API_SECRET_KEY":{"name":"RGW_API_SECRET_KEY","type":"str","level":"advanced","flags":0,"default_value":"","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"RGW_API_SSL_VERIFY":{"name":"RGW_API_SSL_VERIFY","type":"bool","level":"advanced","flags":0,"default_value":"True","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"USER_PWD_EXPIRATION_SPAN":{"name":"USER_PWD_EXPIRATION_SPAN","type":"int","level":"advanced","flags":0,"default_value":"0","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"USER_PWD_EXPIRATION_WARNING_1":{"name":"USER_PWD_EXPIRATION_WARNING_1","type":"int","level":"advanced","flags":0,"default_value":"10","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"USER_PWD_EXPIRATION_WARNING_2":{"name":"USER_PWD_EXPIRATION_WARNING_2","type":"int","level":"advanced","flags":0,"default_value":"5","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"cross_origin_url":{"name":"cross_origin_url","type":"str","level":"advanced","flags":0,"default_value":"","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"crt_file":{"name":"crt_file","type":"str","level":"advanced","flags":0,"default_value":"","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"debug":{"name":"debug","type":"bool","level":"advanced","flags":0,"default_value":"False","min":"","max":"","enum_allowed":[],"desc":"Enable/disable debug options","long_desc":"","tags":[],"see_also":[]},"jwt_token_ttl":{"name":"jwt_token_ttl","type":"int","level":"advanced","flags":0,"default_value":"28800","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"key_file":{"name":"key_file","type":"str","level":"advanced","flags":0,"default_value":"","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_level":{"name":"log_level","type":"str","level":"advanced","flags":1,"default_value":"","min":"","max":"","enum_allowed":["","critical","debug","error","info","warning"],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_cluster":{"name":"log_to_cluster","type":"bool","level":"advanced","flags":1,"default_value":"False","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_cluster_level":{"name":"log_to_cluster_level","type":"str","level":"advanced","flags":1,"default_value":"info","min":"","max":"","enum_allowed":["","critical","debug","error","info","warning"],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_file":{"name":"log_to_file","type":"bool","level":"advanced","flags":1,"default_value":"False","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"motd":{"name":"motd","type":"str","level":"advanced","flags":0,"default_value":"","min":"","max":"","enum_allowed":[],"desc":"The message of the day","long_desc":"","tags":[],"see_also":[]},"redirect_resolve_ip_addr":{"name":"redirect_resolve_ip_addr","type":"bool","level":"advanced","flags":0,"default_value":"False","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"server_addr":{"name":"server_addr","type":"str","level":"advanced","flags":0,"default_value":"::","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"server_port":{"name":"server_port","type":"int","level":"advanced","flags":0,"default_value":"8080","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"ssl":{"name":"ssl","type":"bool","level":"advanced","flags":0,"default_value":"True","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"ssl_server_port":{"name":"ssl_server_port","type":"int","level":"advanced","flags":0,"default_value":"8443","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"standby_behaviour":{"name":"standby_behaviour","type":"str","level":"advanced","flags":0,"default_value":"redirect","min":"","max":"","enum_allowed":["error","redirect"],"desc":"","long_desc":"","tags":[],"see_also":[]},"standby_error_status_code":{"name":"standby_error_status_code","type":"int","level":"advanced","flags":0,"default_value":"500","min":"400","max":"599","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"url_prefix":{"name":"url_prefix","type":"str","level":"advanced","flags":0,"default_value":"","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]}}},{"name":"devicehealth","can_run":true,"error_string":"","module_options":{"enable_monitoring":{"name":"enable_monitoring","type":"bool","level":"advanced","flags":1,"default_value":"True","min":"","max":"","enum_allowed":[],"desc":"monitor device health metrics","long_desc":"","tags":[],"see_also":[]},"log_level":{"name":"log_level","type":"str","level":"advanced","flags":1,"default_value":"","min":"","max":"","enum_allowed":["","critical","debug","error","info","warning"],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_cluster":{"name":"log_to_cluster","type":"bool","level":"advanced","flags":1,"default_value":"False","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_cluster_level":{"name":"log_to_cluster_level","type":"str","level":"advanced","flags":1,"default_value":"info","min":"","max":"","enum_allowed":["","critical","debug","error","info","warning"],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_file":{"name":"log_to_file","type":"bool","level":"advanced","flags":1,"default_value":"False","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"mark_out_threshold":{"name":"mark_out_threshold","type":"secs","level":"advanced","flags":1,"default_value":"2419200","min":"","max":"","enum_allowed":[],"desc":"automatically mark OSD if it may fail before this long","long_desc":"","tags":[],"see_also":[]},"pool_name":{"name":"pool_name","type":"str","level":"advanced","flags":1,"default_value":"device_health_metrics","min":"","max":"","enum_allowed":[],"desc":"name of pool in which to store device health metrics","long_desc":"","tags":[],"see_also":[]},"retention_period":{"name":"retention_period","type":"secs","level":"advanced","flags":1,"default_value":"15552000","min":"","max":"","enum_allowed":[],"desc":"how long to retain device health metrics","long_desc":"","tags":[],"see_also":[]},"scrape_frequency":{"name":"scrape_frequency","type":"secs","level":"advanced","flags":1,"default_value":"86400","min":"","max":"","enum_allowed":[],"desc":"how frequently to scrape device health metrics","long_desc":"","tags":[],"see_also":[]},"self_heal":{"name":"self_heal","type":"bool","level":"advanced","flags":1,"default_value":"True","min":"","max":"","enum_allowed":[],"desc":"preemptively heal cluster around devices that may fail","long_desc":"","tags":[],"see_also":[]},"sleep_interval":{"name":"sleep_interval","type":"secs","level":"advanced","flags":1,"default_value":"600","min":"","max":"","enum_allowed":[],"desc":"how frequently to wake up and check device health","long_desc":"","tags":[],"see_also":[]},"warn_threshold":{"name":"warn_threshold","type":"secs","level":"advanced","flags":1,"default_value":"7257600","min":"","max":"","enum_allowed":[],"desc":"raise health warning if OSD may fail before this long","long_desc":"","tags":[],"see_also":[]}}},{"name":"diskprediction_local","can_run":true,"error_string":"","module_options":{"log_level":{"name":"log_level","type":"str","level":"advanced","flags":1,"default_value":"","min":"","max":"","enum_allowed":["","critical","debug","error","info","warning"],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_cluster":{"name":"log_to_cluster","type":"bool","level":"advanced","flags":1,"default_value":"False","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_cluster_level":{"name":"log_to_cluster_level","type":"str","level":"advanced","flags":1,"default_value":"info","min":"","max":"","enum_allowed":["","critical","debug","error","info","warning"],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_file":{"name":"log_to_file","type":"bool","level":"advanced","flags":1,"default_value":"False","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"predict_interval":{"name":"predict_interval","type":"str","level":"advanced","flags":0,"default_value":"86400","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"predictor_model":{"name":"predictor_model","type":"str","level":"advanced","flags":0,"default_value":"prophetstor","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"sleep_interval":{"name":"sleep_interval","type":"str","level":"advanced","flags":0,"default_value":"600","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]}}},{"name":"influx","can_run":false,"error_string":"influxdb python module not found","module_options":{"batch_size":{"name":"batch_size","type":"int","level":"advanced","flags":0,"default_value":"5000","min":"","max":"","enum_allowed":[],"desc":"How big batches of data points should be when sending to InfluxDB.","long_desc":"","tags":[],"see_also":[]},"database":{"name":"database","type":"str","level":"advanced","flags":0,"default_value":"ceph","min":"","max":"","enum_allowed":[],"desc":"InfluxDB database name. You will need to create this database and grant write privileges to the configured username or the username must have admin privileges to create it.","long_desc":"","tags":[],"see_also":[]},"hostname":{"name":"hostname","type":"str","level":"advanced","flags":0,"default_value":"","min":"","max":"","enum_allowed":[],"desc":"InfluxDB server hostname","long_desc":"","tags":[],"see_also":[]},"interval":{"name":"interval","type":"secs","level":"advanced","flags":0,"default_value":"30","min":"5","max":"","enum_allowed":[],"desc":"Time between reports to InfluxDB. Default 30 seconds.","long_desc":"","tags":[],"see_also":[]},"log_level":{"name":"log_level","type":"str","level":"advanced","flags":1,"default_value":"","min":"","max":"","enum_allowed":["","critical","debug","error","info","warning"],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_cluster":{"name":"log_to_cluster","type":"bool","level":"advanced","flags":1,"default_value":"False","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_cluster_level":{"name":"log_to_cluster_level","type":"str","level":"advanced","flags":1,"default_value":"info","min":"","max":"","enum_allowed":["","critical","debug","error","info","warning"],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_file":{"name":"log_to_file","type":"bool","level":"advanced","flags":1,"default_value":"False","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"password":{"name":"password","type":"str","level":"advanced","flags":0,"default_value":"","min":"","max":"","enum_allowed":[],"desc":"password of InfluxDB server user","long_desc":"","tags":[],"see_also":[]},"port":{"name":"port","type":"int","level":"advanced","flags":0,"default_value":"8086","min":"","max":"","enum_allowed":[],"desc":"InfluxDB server port","long_desc":"","tags":[],"see_also":[]},"ssl":{"name":"ssl","type":"str","level":"advanced","flags":0,"default_value":"false","min":"","max":"","enum_allowed":[],"desc":"Use https connection for InfluxDB server. Use \"true\" or \"false\".","long_desc":"","tags":[],"see_also":[]},"threads":{"name":"threads","type":"int","level":"advanced","flags":0,"default_value":"5","min":"1","max":"32","enum_allowed":[],"desc":"How many worker threads should be spawned for sending data to InfluxDB.","long_desc":"","tags":[],"see_also":[]},"username":{"name":"username","type":"str","level":"advanced","flags":0,"default_value":"","min":"","max":"","enum_allowed":[],"desc":"username of InfluxDB server user","long_desc":"","tags":[],"see_also":[]},"verify_ssl":{"name":"verify_ssl","type":"str","level":"advanced","flags":0,"default_value":"true","min":"","max":"","enum_allowed":[],"desc":"Verify https cert for InfluxDB server. Use \"true\" or \"false\".","long_desc":"","tags":[],"see_also":[]}}},{"name":"insights","can_run":true,"error_string":"","module_options":{"log_level":{"name":"log_level","type":"str","level":"advanced","flags":1,"default_value":"","min":"","max":"","enum_allowed":["","critical","debug","error","info","warning"],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_cluster":{"name":"log_to_cluster","type":"bool","level":"advanced","flags":1,"default_value":"False","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_cluster_level":{"name":"log_to_cluster_level","type":"str","level":"advanced","flags":1,"default_value":"info","min":"","max":"","enum_allowed":["","critical","debug","error","info","warning"],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_file":{"name":"log_to_file","type":"bool","level":"advanced","flags":1,"default_value":"False","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]}}},{"name":"iostat","can_run":true,"error_string":"","module_options":{"log_level":{"name":"log_level","type":"str","level":"advanced","flags":1,"default_value":"","min":"","max":"","enum_allowed":["","critical","debug","error","info","warning"],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_cluster":{"name":"log_to_cluster","type":"bool","level":"advanced","flags":1,"default_value":"False","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_cluster_level":{"name":"log_to_cluster_level","type":"str","level":"advanced","flags":1,"default_value":"info","min":"","max":"","enum_allowed":["","critical","debug","error","info","warning"],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_file":{"name":"log_to_file","type":"bool","level":"advanced","flags":1,"default_value":"False","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]}}},{"name":"localpool","can_run":true,"error_string":"","module_options":{"failure_domain":{"name":"failure_domain","type":"str","level":"advanced","flags":1,"default_value":"host","min":"","max":"","enum_allowed":[],"desc":"failure domain for any created local pool","long_desc":"what failure domain we should separate data replicas across.","tags":[],"see_also":[]},"log_level":{"name":"log_level","type":"str","level":"advanced","flags":1,"default_value":"","min":"","max":"","enum_allowed":["","critical","debug","error","info","warning"],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_cluster":{"name":"log_to_cluster","type":"bool","level":"advanced","flags":1,"default_value":"False","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_cluster_level":{"name":"log_to_cluster_level","type":"str","level":"advanced","flags":1,"default_value":"info","min":"","max":"","enum_allowed":["","critical","debug","error","info","warning"],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_file":{"name":"log_to_file","type":"bool","level":"advanced","flags":1,"default_value":"False","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"min_size":{"name":"min_size","type":"int","level":"advanced","flags":1,"default_value":"","min":"","max":"","enum_allowed":[],"desc":"default min_size for any created local pool","long_desc":"value to set min_size to (unchanged from Ceph's default if this option is not set)","tags":[],"see_also":[]},"num_rep":{"name":"num_rep","type":"int","level":"advanced","flags":1,"default_value":"3","min":"","max":"","enum_allowed":[],"desc":"default replica count for any created local pool","long_desc":"","tags":[],"see_also":[]},"pg_num":{"name":"pg_num","type":"int","level":"advanced","flags":1,"default_value":"128","min":"","max":"","enum_allowed":[],"desc":"default pg_num for any created local pool","long_desc":"","tags":[],"see_also":[]},"prefix":{"name":"prefix","type":"str","level":"advanced","flags":1,"default_value":"","min":"","max":"","enum_allowed":[],"desc":"name prefix for any created local pool","long_desc":"","tags":[],"see_also":[]},"subtree":{"name":"subtree","type":"str","level":"advanced","flags":1,"default_value":"rack","min":"","max":"","enum_allowed":[],"desc":"CRUSH level for which to create a local pool","long_desc":"which CRUSH subtree type the module should create a pool for.","tags":[],"see_also":[]}}},{"name":"mds_autoscaler","can_run":true,"error_string":"","module_options":{"log_level":{"name":"log_level","type":"str","level":"advanced","flags":1,"default_value":"","min":"","max":"","enum_allowed":["","critical","debug","error","info","warning"],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_cluster":{"name":"log_to_cluster","type":"bool","level":"advanced","flags":1,"default_value":"False","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_cluster_level":{"name":"log_to_cluster_level","type":"str","level":"advanced","flags":1,"default_value":"info","min":"","max":"","enum_allowed":["","critical","debug","error","info","warning"],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_file":{"name":"log_to_file","type":"bool","level":"advanced","flags":1,"default_value":"False","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]}}},{"name":"mirroring","can_run":true,"error_string":"","module_options":{"log_level":{"name":"log_level","type":"str","level":"advanced","flags":1,"default_value":"","min":"","max":"","enum_allowed":["","critical","debug","error","info","warning"],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_cluster":{"name":"log_to_cluster","type":"bool","level":"advanced","flags":1,"default_value":"False","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_cluster_level":{"name":"log_to_cluster_level","type":"str","level":"advanced","flags":1,"default_value":"info","min":"","max":"","enum_allowed":["","critical","debug","error","info","warning"],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_file":{"name":"log_to_file","type":"bool","level":"advanced","flags":1,"default_value":"False","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]}}},{"name":"nfs","can_run":true,"error_string":"","module_options":{"log_level":{"name":"log_level","type":"str","level":"advanced","flags":1,"default_value":"","min":"","max":"","enum_allowed":["","critical","debug","error","info","warning"],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_cluster":{"name":"log_to_cluster","type":"bool","level":"advanced","flags":1,"default_value":"False","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_cluster_level":{"name":"log_to_cluster_level","type":"str","level":"advanced","flags":1,"default_value":"info","min":"","max":"","enum_allowed":["","critical","debug","error","info","warning"],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_file":{"name":"log_to_file","type":"bool","level":"advanced","flags":1,"default_value":"False","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]}}},{"name":"orchestrator","can_run":true,"error_string":"","module_options":{"log_level":{"name":"log_level","type":"str","level":"advanced","flags":1,"default_value":"","min":"","max":"","enum_allowed":["","critical","debug","error","info","warning"],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_cluster":{"name":"log_to_cluster","type":"bool","level":"advanced","flags":1,"default_value":"False","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_cluster_level":{"name":"log_to_cluster_level","type":"str","level":"advanced","flags":1,"default_value":"info","min":"","max":"","enum_allowed":["","critical","debug","error","info","warning"],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_file":{"name":"log_to_file","type":"bool","level":"advanced","flags":1,"default_value":"False","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"orchestrator":{"name":"orchestrator","type":"str","level":"advanced","flags":1,"default_value":"","min":"","max":"","enum_allowed":["cephadm","rook","test_orchestrator"],"desc":"Orchestrator backend","long_desc":"","tags":[],"see_also":[]}}},{"name":"osd_perf_query","can_run":true,"error_string":"","module_options":{"log_level":{"name":"log_level","type":"str","level":"advanced","flags":1,"default_value":"","min":"","max":"","enum_allowed":["","critical","debug","error","info","warning"],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_cluster":{"name":"log_to_cluster","type":"bool","level":"advanced","flags":1,"default_value":"False","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_cluster_level":{"name":"log_to_cluster_level","type":"str","level":"advanced","flags":1,"default_value":"info","min":"","max":"","enum_allowed":["","critical","debug","error","info","warning"],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_file":{"name":"log_to_file","type":"bool","level":"advanced","flags":1,"default_value":"False","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]}}},{"name":"osd_support","can_run":true,"error_string":"","module_options":{"log_level":{"name":"log_level","type":"str","level":"advanced","flags":1,"default_value":"","min":"","max":"","enum_allowed":["","critical","debug","error","info","warning"],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_cluster":{"name":"log_to_cluster","type":"bool","level":"advanced","flags":1,"default_value":"False","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_cluster_level":{"name":"log_to_cluster_level","type":"str","level":"advanced","flags":1,"default_value":"info","min":"","max":"","enum_allowed":["","critical","debug","error","info","warning"],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_file":{"name":"log_to_file","type":"bool","level":"advanced","flags":1,"default_value":"False","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]}}},{"name":"pg_autoscaler","can_run":true,"error_string":"","module_options":{"log_level":{"name":"log_level","type":"str","level":"advanced","flags":1,"default_value":"","min":"","max":"","enum_allowed":["","critical","debug","error","info","warning"],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_cluster":{"name":"log_to_cluster","type":"bool","level":"advanced","flags":1,"default_value":"False","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_cluster_level":{"name":"log_to_cluster_level","type":"str","level":"advanced","flags":1,"default_value":"info","min":"","max":"","enum_allowed":["","critical","debug","error","info","warning"],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_file":{"name":"log_to_file","type":"bool","level":"advanced","flags":1,"default_value":"False","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"noautoscale":{"name":"noautoscale","type":"bool","level":"advanced","flags":0,"default_value":"False","min":"","max":"","enum_allowed":[],"desc":"global autoscale flag","long_desc":"Option to turn on/off the autoscaler for all pools","tags":[],"see_also":[]},"sleep_interval":{"name":"sleep_interval","type":"secs","level":"advanced","flags":0,"default_value":"60","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"threshold":{"name":"threshold","type":"float","level":"advanced","flags":0,"default_value":"3.0","min":"1.0","max":"","enum_allowed":[],"desc":"scaling threshold","long_desc":"The factor by which the `NEW PG_NUM` must vary from the current`PG_NUM` before being accepted. Cannot be less than 1.0","tags":[],"see_also":[]}}},{"name":"progress","can_run":true,"error_string":"","module_options":{"allow_pg_recovery_event":{"name":"allow_pg_recovery_event","type":"bool","level":"advanced","flags":1,"default_value":"False","min":"","max":"","enum_allowed":[],"desc":"allow the module to show pg recovery progress","long_desc":"","tags":[],"see_also":[]},"enabled":{"name":"enabled","type":"bool","level":"advanced","flags":0,"default_value":"True","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_level":{"name":"log_level","type":"str","level":"advanced","flags":1,"default_value":"","min":"","max":"","enum_allowed":["","critical","debug","error","info","warning"],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_cluster":{"name":"log_to_cluster","type":"bool","level":"advanced","flags":1,"default_value":"False","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_cluster_level":{"name":"log_to_cluster_level","type":"str","level":"advanced","flags":1,"default_value":"info","min":"","max":"","enum_allowed":["","critical","debug","error","info","warning"],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_file":{"name":"log_to_file","type":"bool","level":"advanced","flags":1,"default_value":"False","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"max_completed_events":{"name":"max_completed_events","type":"int","level":"advanced","flags":1,"default_value":"50","min":"","max":"","enum_allowed":[],"desc":"number of past completed events to remember","long_desc":"","tags":[],"see_also":[]},"sleep_interval":{"name":"sleep_interval","type":"secs","level":"advanced","flags":1,"default_value":"5","min":"","max":"","enum_allowed":[],"desc":"how long the module is going to sleep","long_desc":"","tags":[],"see_also":[]}}},{"name":"prometheus","can_run":true,"error_string":"","module_options":{"cache":{"name":"cache","type":"bool","level":"advanced","flags":0,"default_value":"True","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_level":{"name":"log_level","type":"str","level":"advanced","flags":1,"default_value":"","min":"","max":"","enum_allowed":["","critical","debug","error","info","warning"],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_cluster":{"name":"log_to_cluster","type":"bool","level":"advanced","flags":1,"default_value":"False","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_cluster_level":{"name":"log_to_cluster_level","type":"str","level":"advanced","flags":1,"default_value":"info","min":"","max":"","enum_allowed":["","critical","debug","error","info","warning"],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_file":{"name":"log_to_file","type":"bool","level":"advanced","flags":1,"default_value":"False","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"rbd_stats_pools":{"name":"rbd_stats_pools","type":"str","level":"advanced","flags":0,"default_value":"","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"rbd_stats_pools_refresh_interval":{"name":"rbd_stats_pools_refresh_interval","type":"int","level":"advanced","flags":0,"default_value":"300","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"scrape_interval":{"name":"scrape_interval","type":"float","level":"advanced","flags":0,"default_value":"15.0","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"server_addr":{"name":"server_addr","type":"str","level":"advanced","flags":0,"default_value":"::","min":"","max":"","enum_allowed":[],"desc":"the IPv4 or IPv6 address on which the module listens for HTTP requests","long_desc":"","tags":[],"see_also":[]},"server_port":{"name":"server_port","type":"int","level":"advanced","flags":1,"default_value":"9283","min":"","max":"","enum_allowed":[],"desc":"the port on which the module listens for HTTP requests","long_desc":"","tags":[],"see_also":[]},"stale_cache_strategy":{"name":"stale_cache_strategy","type":"str","level":"advanced","flags":0,"default_value":"log","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"standby_behaviour":{"name":"standby_behaviour","type":"str","level":"advanced","flags":1,"default_value":"default","min":"","max":"","enum_allowed":["default","error"],"desc":"","long_desc":"","tags":[],"see_also":[]},"standby_error_status_code":{"name":"standby_error_status_code","type":"int","level":"advanced","flags":1,"default_value":"500","min":"400","max":"599","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]}}},{"name":"rbd_support","can_run":true,"error_string":"","module_options":{"log_level":{"name":"log_level","type":"str","level":"advanced","flags":1,"default_value":"","min":"","max":"","enum_allowed":["","critical","debug","error","info","warning"],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_cluster":{"name":"log_to_cluster","type":"bool","level":"advanced","flags":1,"default_value":"False","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_cluster_level":{"name":"log_to_cluster_level","type":"str","level":"advanced","flags":1,"default_value":"info","min":"","max":"","enum_allowed":["","critical","debug","error","info","warning"],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_file":{"name":"log_to_file","type":"bool","level":"advanced","flags":1,"default_value":"False","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"max_concurrent_snap_create":{"name":"max_concurrent_snap_create","type":"int","level":"advanced","flags":0,"default_value":"10","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"mirror_snapshot_schedule":{"name":"mirror_snapshot_schedule","type":"str","level":"advanced","flags":0,"default_value":"","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"trash_purge_schedule":{"name":"trash_purge_schedule","type":"str","level":"advanced","flags":0,"default_value":"","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]}}},{"name":"restful","can_run":true,"error_string":"","module_options":{"enable_auth":{"name":"enable_auth","type":"bool","level":"advanced","flags":0,"default_value":"True","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"key_file":{"name":"key_file","type":"str","level":"advanced","flags":0,"default_value":"","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_level":{"name":"log_level","type":"str","level":"advanced","flags":1,"default_value":"","min":"","max":"","enum_allowed":["","critical","debug","error","info","warning"],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_cluster":{"name":"log_to_cluster","type":"bool","level":"advanced","flags":1,"default_value":"False","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_cluster_level":{"name":"log_to_cluster_level","type":"str","level":"advanced","flags":1,"default_value":"info","min":"","max":"","enum_allowed":["","critical","debug","error","info","warning"],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_file":{"name":"log_to_file","type":"bool","level":"advanced","flags":1,"default_value":"False","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"server_addr":{"name":"server_addr","type":"str","level":"advanced","flags":0,"default_value":"","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"server_port":{"name":"server_port","type":"str","level":"advanced","flags":0,"default_value":"","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]}}},{"name":"rgw","can_run":true,"error_string":"","module_options":{"log_level":{"name":"log_level","type":"str","level":"advanced","flags":1,"default_value":"","min":"","max":"","enum_allowed":["","critical","debug","error","info","warning"],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_cluster":{"name":"log_to_cluster","type":"bool","level":"advanced","flags":1,"default_value":"False","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_cluster_level":{"name":"log_to_cluster_level","type":"str","level":"advanced","flags":1,"default_value":"info","min":"","max":"","enum_allowed":["","critical","debug","error","info","warning"],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_file":{"name":"log_to_file","type":"bool","level":"advanced","flags":1,"default_value":"False","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]}}},{"name":"rook","can_run":true,"error_string":"","module_options":{"drive_group_interval":{"name":"drive_group_interval","type":"float","level":"advanced","flags":0,"default_value":"300.0","min":"","max":"","enum_allowed":[],"desc":"interval in seconds between re-application of applied drive_groups","long_desc":"","tags":[],"see_also":[]},"log_level":{"name":"log_level","type":"str","level":"advanced","flags":1,"default_value":"","min":"","max":"","enum_allowed":["","critical","debug","error","info","warning"],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_cluster":{"name":"log_to_cluster","type":"bool","level":"advanced","flags":1,"default_value":"False","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_cluster_level":{"name":"log_to_cluster_level","type":"str","level":"advanced","flags":1,"default_value":"info","min":"","max":"","enum_allowed":["","critical","debug","error","info","warning"],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_file":{"name":"log_to_file","type":"bool","level":"advanced","flags":1,"default_value":"False","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"storage_class":{"name":"storage_class","type":"str","level":"advanced","flags":0,"default_value":"local","min":"","max":"","enum_allowed":[],"desc":"storage class name for LSO-discovered PVs","long_desc":"","tags":[],"see_also":[]}}},{"name":"selftest","can_run":true,"error_string":"","module_options":{"log_level":{"name":"log_level","type":"str","level":"advanced","flags":1,"default_value":"","min":"","max":"","enum_allowed":["","critical","debug","error","info","warning"],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_cluster":{"name":"log_to_cluster","type":"bool","level":"advanced","flags":1,"default_value":"False","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_cluster_level":{"name":"log_to_cluster_level","type":"str","level":"advanced","flags":1,"default_value":"info","min":"","max":"","enum_allowed":["","critical","debug","error","info","warning"],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_file":{"name":"log_to_file","type":"bool","level":"advanced","flags":1,"default_value":"False","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"roption1":{"name":"roption1","type":"str","level":"advanced","flags":0,"default_value":"","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"roption2":{"name":"roption2","type":"str","level":"advanced","flags":0,"default_value":"xyz","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"rwoption1":{"name":"rwoption1","type":"str","level":"advanced","flags":0,"default_value":"","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"rwoption2":{"name":"rwoption2","type":"int","level":"advanced","flags":0,"default_value":"","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"rwoption3":{"name":"rwoption3","type":"float","level":"advanced","flags":0,"default_value":"","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"rwoption4":{"name":"rwoption4","type":"str","level":"advanced","flags":0,"default_value":"","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"rwoption5":{"name":"rwoption5","type":"bool","level":"advanced","flags":0,"default_value":"","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"rwoption6":{"name":"rwoption6","type":"bool","level":"advanced","flags":0,"default_value":"True","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"rwoption7":{"name":"rwoption7","type":"int","level":"advanced","flags":0,"default_value":"","min":"1","max":"42","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"testkey":{"name":"testkey","type":"str","level":"advanced","flags":0,"default_value":"","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"testlkey":{"name":"testlkey","type":"str","level":"advanced","flags":0,"default_value":"","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"testnewline":{"name":"testnewline","type":"str","level":"advanced","flags":0,"default_value":"","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]}}},{"name":"snap_schedule","can_run":true,"error_string":"","module_options":{"allow_m_granularity":{"name":"allow_m_granularity","type":"bool","level":"advanced","flags":1,"default_value":"False","min":"","max":"","enum_allowed":[],"desc":"allow minute scheduled snapshots","long_desc":"","tags":[],"see_also":[]},"dump_on_update":{"name":"dump_on_update","type":"bool","level":"advanced","flags":1,"default_value":"False","min":"","max":"","enum_allowed":[],"desc":"dump database to debug log on update","long_desc":"","tags":[],"see_also":[]},"log_level":{"name":"log_level","type":"str","level":"advanced","flags":1,"default_value":"","min":"","max":"","enum_allowed":["","critical","debug","error","info","warning"],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_cluster":{"name":"log_to_cluster","type":"bool","level":"advanced","flags":1,"default_value":"False","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_cluster_level":{"name":"log_to_cluster_level","type":"str","level":"advanced","flags":1,"default_value":"info","min":"","max":"","enum_allowed":["","critical","debug","error","info","warning"],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_file":{"name":"log_to_file","type":"bool","level":"advanced","flags":1,"default_value":"False","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]}}},{"name":"stats","can_run":true,"error_string":"","module_options":{"log_level":{"name":"log_level","type":"str","level":"advanced","flags":1,"default_value":"","min":"","max":"","enum_allowed":["","critical","debug","error","info","warning"],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_cluster":{"name":"log_to_cluster","type":"bool","level":"advanced","flags":1,"default_value":"False","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_cluster_level":{"name":"log_to_cluster_level","type":"str","level":"advanced","flags":1,"default_value":"info","min":"","max":"","enum_allowed":["","critical","debug","error","info","warning"],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_file":{"name":"log_to_file","type":"bool","level":"advanced","flags":1,"default_value":"False","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]}}},{"name":"status","can_run":true,"error_string":"","module_options":{"log_level":{"name":"log_level","type":"str","level":"advanced","flags":1,"default_value":"","min":"","max":"","enum_allowed":["","critical","debug","error","info","warning"],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_cluster":{"name":"log_to_cluster","type":"bool","level":"advanced","flags":1,"default_value":"False","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_cluster_level":{"name":"log_to_cluster_level","type":"str","level":"advanced","flags":1,"default_value":"info","min":"","max":"","enum_allowed":["","critical","debug","error","info","warning"],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_file":{"name":"log_to_file","type":"bool","level":"advanced","flags":1,"default_value":"False","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]}}},{"name":"telegraf","can_run":true,"error_string":"","module_options":{"address":{"name":"address","type":"str","level":"advanced","flags":0,"default_value":"unixgram:///tmp/telegraf.sock","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"interval":{"name":"interval","type":"secs","level":"advanced","flags":0,"default_value":"15","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_level":{"name":"log_level","type":"str","level":"advanced","flags":1,"default_value":"","min":"","max":"","enum_allowed":["","critical","debug","error","info","warning"],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_cluster":{"name":"log_to_cluster","type":"bool","level":"advanced","flags":1,"default_value":"False","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_cluster_level":{"name":"log_to_cluster_level","type":"str","level":"advanced","flags":1,"default_value":"info","min":"","max":"","enum_allowed":["","critical","debug","error","info","warning"],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_file":{"name":"log_to_file","type":"bool","level":"advanced","flags":1,"default_value":"False","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]}}},{"name":"telemetry","can_run":true,"error_string":"","module_options":{"channel_basic":{"name":"channel_basic","type":"bool","level":"advanced","flags":0,"default_value":"True","min":"","max":"","enum_allowed":[],"desc":"Share basic cluster information (size, version)","long_desc":"","tags":[],"see_also":[]},"channel_crash":{"name":"channel_crash","type":"bool","level":"advanced","flags":0,"default_value":"True","min":"","max":"","enum_allowed":[],"desc":"Share metadata about Ceph daemon crashes (version, stack straces, etc)","long_desc":"","tags":[],"see_also":[]},"channel_device":{"name":"channel_device","type":"bool","level":"advanced","flags":0,"default_value":"True","min":"","max":"","enum_allowed":[],"desc":"Share device health metrics (e.g., SMART data, minus potentially identifying info like serial numbers)","long_desc":"","tags":[],"see_also":[]},"channel_ident":{"name":"channel_ident","type":"bool","level":"advanced","flags":0,"default_value":"False","min":"","max":"","enum_allowed":[],"desc":"Share a user-provided description and/or contact email for the cluster","long_desc":"","tags":[],"see_also":[]},"channel_perf":{"name":"channel_perf","type":"bool","level":"advanced","flags":0,"default_value":"False","min":"","max":"","enum_allowed":[],"desc":"Share various performance metrics of a cluster","long_desc":"","tags":[],"see_also":[]},"contact":{"name":"contact","type":"str","level":"advanced","flags":0,"default_value":"","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"description":{"name":"description","type":"str","level":"advanced","flags":0,"default_value":"","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"device_url":{"name":"device_url","type":"str","level":"advanced","flags":0,"default_value":"https://telemetry.ceph.com/device","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"enabled":{"name":"enabled","type":"bool","level":"advanced","flags":0,"default_value":"False","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"interval":{"name":"interval","type":"int","level":"advanced","flags":0,"default_value":"24","min":"8","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"last_opt_revision":{"name":"last_opt_revision","type":"int","level":"advanced","flags":0,"default_value":"1","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"leaderboard":{"name":"leaderboard","type":"bool","level":"advanced","flags":0,"default_value":"False","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_level":{"name":"log_level","type":"str","level":"advanced","flags":1,"default_value":"","min":"","max":"","enum_allowed":["","critical","debug","error","info","warning"],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_cluster":{"name":"log_to_cluster","type":"bool","level":"advanced","flags":1,"default_value":"False","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_cluster_level":{"name":"log_to_cluster_level","type":"str","level":"advanced","flags":1,"default_value":"info","min":"","max":"","enum_allowed":["","critical","debug","error","info","warning"],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_file":{"name":"log_to_file","type":"bool","level":"advanced","flags":1,"default_value":"False","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"organization":{"name":"organization","type":"str","level":"advanced","flags":0,"default_value":"","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"proxy":{"name":"proxy","type":"str","level":"advanced","flags":0,"default_value":"","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"url":{"name":"url","type":"str","level":"advanced","flags":0,"default_value":"https://telemetry.ceph.com/report","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]}}},{"name":"test_orchestrator","can_run":true,"error_string":"","module_options":{"log_level":{"name":"log_level","type":"str","level":"advanced","flags":1,"default_value":"","min":"","max":"","enum_allowed":["","critical","debug","error","info","warning"],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_cluster":{"name":"log_to_cluster","type":"bool","level":"advanced","flags":1,"default_value":"False","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_cluster_level":{"name":"log_to_cluster_level","type":"str","level":"advanced","flags":1,"default_value":"info","min":"","max":"","enum_allowed":["","critical","debug","error","info","warning"],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_file":{"name":"log_to_file","type":"bool","level":"advanced","flags":1,"default_value":"False","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]}}},{"name":"volumes","can_run":true,"error_string":"","module_options":{"log_level":{"name":"log_level","type":"str","level":"advanced","flags":1,"default_value":"","min":"","max":"","enum_allowed":["","critical","debug","error","info","warning"],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_cluster":{"name":"log_to_cluster","type":"bool","level":"advanced","flags":1,"default_value":"False","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_cluster_level":{"name":"log_to_cluster_level","type":"str","level":"advanced","flags":1,"default_value":"info","min":"","max":"","enum_allowed":["","critical","debug","error","info","warning"],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_file":{"name":"log_to_file","type":"bool","level":"advanced","flags":1,"default_value":"False","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"max_concurrent_clones":{"name":"max_concurrent_clones","type":"int","level":"advanced","flags":0,"default_value":"4","min":"","max":"","enum_allowed":[],"desc":"Number of asynchronous cloner threads","long_desc":"","tags":[],"see_also":[]},"snapshot_clone_delay":{"name":"snapshot_clone_delay","type":"int","level":"advanced","flags":0,"default_value":"0","min":"","max":"","enum_allowed":[],"desc":"Delay clone begin operation by snapshot_clone_delay seconds","long_desc":"","tags":[],"see_also":[]}}},{"name":"zabbix","can_run":true,"error_string":"","module_options":{"discovery_interval":{"name":"discovery_interval","type":"uint","level":"advanced","flags":0,"default_value":"100","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"identifier":{"name":"identifier","type":"str","level":"advanced","flags":0,"default_value":"","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"interval":{"name":"interval","type":"secs","level":"advanced","flags":0,"default_value":"60","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_level":{"name":"log_level","type":"str","level":"advanced","flags":1,"default_value":"","min":"","max":"","enum_allowed":["","critical","debug","error","info","warning"],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_cluster":{"name":"log_to_cluster","type":"bool","level":"advanced","flags":1,"default_value":"False","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_cluster_level":{"name":"log_to_cluster_level","type":"str","level":"advanced","flags":1,"default_value":"info","min":"","max":"","enum_allowed":["","critical","debug","error","info","warning"],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_file":{"name":"log_to_file","type":"bool","level":"advanced","flags":1,"default_value":"False","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"zabbix_host":{"name":"zabbix_host","type":"str","level":"advanced","flags":0,"default_value":"","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"zabbix_port":{"name":"zabbix_port","type":"int","level":"advanced","flags":0,"default_value":"10051","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"zabbix_sender":{"name":"zabbix_sender","type":"str","level":"advanced","flags":0,"default_value":"/usr/bin/zabbix_sender","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]}}}],"services":{},"always_on_modules":{"octopus":["balancer","crash","devicehealth","orchestrator","pg_autoscaler","progress","rbd_support","status","telemetry","volumes"],"pacific":["balancer","crash","devicehealth","orchestrator","pg_autoscaler","progress","rbd_support","status","telemetry","volumes"],"quincy":["balancer","crash","devicehealth","orchestrator","pg_autoscaler","progress","rbd_support","status","telemetry","volumes"]},"last_failure_osd_epoch":0,"active_clients":[{"name":"devicehealth","addrvec":[{"type":"v2","addr":"172.21.15.6:0","nonce":3857933735}]},{"name":"libcephsqlite","addrvec":[{"type":"v2","addr":"172.21.15.6:0","nonce":2221671503}]},{"name":"rbd_support","addrvec":[{"type":"v2","addr":"172.21.15.6:0","nonce":645958230}]},{"name":"volumes","addrvec":[{"type":"v2","addr":"172.21.15.6:0","nonce":1547945514}]}]} 2023-08-01T19:54:09.382 INFO:tasks.ceph.ceph_manager.ceph:mgr available! 2023-08-01T19:54:09.382 INFO:tasks.ceph.ceph_manager.ceph:waiting for all up 2023-08-01T19:54:09.382 DEBUG:teuthology.orchestra.run.smithi006:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 120 ceph --cluster ceph osd dump --format=json 2023-08-01T19:54:09.707 INFO:teuthology.orchestra.run.smithi006.stdout: 2023-08-01T19:54:09.707 INFO:teuthology.orchestra.run.smithi006.stdout:{"epoch":18,"fsid":"a0e420cc-4df1-42a5-8bd4-a98c309a9349","created":"2023-08-01T19:53:41.279588+0000","modified":"2023-08-01T19:54:05.452537+0000","last_up_change":"2023-08-01T19:53:50.735626+0000","last_in_change":"2023-08-01T19:53:42.974751+0000","flags":"sortbitwise,recovery_deletes,purged_snapdirs,pglog_hardlimit","flags_num":5799936,"flags_set":["pglog_hardlimit","purged_snapdirs","recovery_deletes","sortbitwise"],"crush_version":5,"full_ratio":0.94999998807907104,"backfillfull_ratio":0.89999997615814209,"nearfull_ratio":0.85000002384185791,"cluster_snapshot":"","pool_max":4,"max_osd":3,"require_min_compat_client":"luminous","min_compat_client":"jewel","require_osd_release":"quincy","pools":[{"pool":1,"pool_name":".mgr","create_time":"2023-08-01T19:53:49.961944+0000","flags":1,"flags_names":"hashpspool","type":1,"size":2,"min_size":1,"crush_rule":0,"peering_crush_bucket_count":0,"peering_crush_bucket_target":0,"peering_crush_bucket_barrier":0,"peering_crush_bucket_mandatory_member":2147483647,"object_hash":2,"pg_autoscale_mode":"off","pg_num":1,"pg_placement_num":1,"pg_placement_num_target":1,"pg_num_target":1,"pg_num_pending":1,"last_pg_merge_meta":{"source_pgid":"0.0","ready_epoch":0,"last_epoch_started":0,"last_epoch_clean":0,"source_version":"0'0","target_version":"0'0"},"last_change":"11","last_force_op_resend":"0","last_force_op_resend_prenautilus":"0","last_force_op_resend_preluminous":"0","auid":0,"snap_mode":"selfmanaged","snap_seq":0,"snap_epoch":0,"pool_snaps":[],"removed_snaps":"[]","quota_max_bytes":0,"quota_max_objects":0,"tiers":[],"tier_of":-1,"read_tier":-1,"write_tier":-1,"cache_mode":"none","target_max_bytes":0,"target_max_objects":0,"cache_target_dirty_ratio_micro":400000,"cache_target_dirty_high_ratio_micro":600000,"cache_target_full_ratio_micro":800000,"cache_min_flush_age":0,"cache_min_evict_age":0,"erasure_code_profile":"","hit_set_params":{"type":"none"},"hit_set_period":0,"hit_set_count":0,"use_gmt_hitset":true,"min_read_recency_for_promote":0,"min_write_recency_for_promote":0,"hit_set_grade_decay_rate":0,"hit_set_search_last_n":0,"grade_table":[],"stripe_width":0,"expected_num_objects":0,"fast_read":false,"options":{"pg_num_max":32,"pg_num_min":1},"application_metadata":{"mgr":{}}},{"pool":2,"pool_name":"rbd","create_time":"2023-08-01T19:53:57.404091+0000","flags":1,"flags_names":"hashpspool","type":1,"size":2,"min_size":1,"crush_rule":0,"peering_crush_bucket_count":0,"peering_crush_bucket_target":0,"peering_crush_bucket_barrier":0,"peering_crush_bucket_mandatory_member":2147483647,"object_hash":2,"pg_autoscale_mode":"off","pg_num":8,"pg_placement_num":8,"pg_placement_num_target":8,"pg_num_target":8,"pg_num_pending":8,"last_pg_merge_meta":{"source_pgid":"0.0","ready_epoch":0,"last_epoch_started":0,"last_epoch_clean":0,"source_version":"0'0","target_version":"0'0"},"last_change":"14","last_force_op_resend":"0","last_force_op_resend_prenautilus":"0","last_force_op_resend_preluminous":"0","auid":0,"snap_mode":"selfmanaged","snap_seq":0,"snap_epoch":0,"pool_snaps":[],"removed_snaps":"[]","quota_max_bytes":0,"quota_max_objects":0,"tiers":[],"tier_of":-1,"read_tier":-1,"write_tier":-1,"cache_mode":"none","target_max_bytes":0,"target_max_objects":0,"cache_target_dirty_ratio_micro":400000,"cache_target_dirty_high_ratio_micro":600000,"cache_target_full_ratio_micro":800000,"cache_min_flush_age":0,"cache_min_evict_age":0,"erasure_code_profile":"","hit_set_params":{"type":"none"},"hit_set_period":0,"hit_set_count":0,"use_gmt_hitset":true,"min_read_recency_for_promote":0,"min_write_recency_for_promote":0,"hit_set_grade_decay_rate":0,"hit_set_search_last_n":0,"grade_table":[],"stripe_width":0,"expected_num_objects":0,"fast_read":false,"options":{},"application_metadata":{"rbd":{}}},{"pool":3,"pool_name":"cephfs_metadata","create_time":"2023-08-01T19:54:02.111247+0000","flags":1,"flags_names":"hashpspool","type":1,"size":2,"min_size":1,"crush_rule":0,"peering_crush_bucket_count":0,"peering_crush_bucket_target":0,"peering_crush_bucket_barrier":0,"peering_crush_bucket_mandatory_member":2147483647,"object_hash":2,"pg_autoscale_mode":"off","pg_num":32,"pg_placement_num":32,"pg_placement_num_target":32,"pg_num_target":32,"pg_num_pending":32,"last_pg_merge_meta":{"source_pgid":"0.0","ready_epoch":0,"last_epoch_started":0,"last_epoch_clean":0,"source_version":"0'0","target_version":"0'0"},"last_change":"17","last_force_op_resend":"0","last_force_op_resend_prenautilus":"0","last_force_op_resend_preluminous":"0","auid":0,"snap_mode":"selfmanaged","snap_seq":0,"snap_epoch":0,"pool_snaps":[],"removed_snaps":"[]","quota_max_bytes":0,"quota_max_objects":0,"tiers":[],"tier_of":-1,"read_tier":-1,"write_tier":-1,"cache_mode":"none","target_max_bytes":0,"target_max_objects":0,"cache_target_dirty_ratio_micro":400000,"cache_target_dirty_high_ratio_micro":600000,"cache_target_full_ratio_micro":800000,"cache_min_flush_age":0,"cache_min_evict_age":0,"erasure_code_profile":"","hit_set_params":{"type":"none"},"hit_set_period":0,"hit_set_count":0,"use_gmt_hitset":true,"min_read_recency_for_promote":0,"min_write_recency_for_promote":0,"hit_set_grade_decay_rate":0,"hit_set_search_last_n":0,"grade_table":[],"stripe_width":0,"expected_num_objects":0,"fast_read":false,"options":{"pg_autoscale_bias":4,"pg_num_min":16,"recovery_priority":5},"application_metadata":{"cephfs":{"metadata":"cephfs"}}},{"pool":4,"pool_name":"cephfs_data","create_time":"2023-08-01T19:54:03.430277+0000","flags":1,"flags_names":"hashpspool","type":1,"size":2,"min_size":1,"crush_rule":0,"peering_crush_bucket_count":0,"peering_crush_bucket_target":0,"peering_crush_bucket_barrier":0,"peering_crush_bucket_mandatory_member":2147483647,"object_hash":2,"pg_autoscale_mode":"off","pg_num":64,"pg_placement_num":64,"pg_placement_num_target":64,"pg_num_target":64,"pg_num_pending":64,"last_pg_merge_meta":{"source_pgid":"0.0","ready_epoch":0,"last_epoch_started":0,"last_epoch_clean":0,"source_version":"0'0","target_version":"0'0"},"last_change":"18","last_force_op_resend":"0","last_force_op_resend_prenautilus":"0","last_force_op_resend_preluminous":"0","auid":0,"snap_mode":"selfmanaged","snap_seq":0,"snap_epoch":0,"pool_snaps":[],"removed_snaps":"[]","quota_max_bytes":0,"quota_max_objects":0,"tiers":[],"tier_of":-1,"read_tier":-1,"write_tier":-1,"cache_mode":"none","target_max_bytes":0,"target_max_objects":0,"cache_target_dirty_ratio_micro":400000,"cache_target_dirty_high_ratio_micro":600000,"cache_target_full_ratio_micro":800000,"cache_min_flush_age":0,"cache_min_evict_age":0,"erasure_code_profile":"","hit_set_params":{"type":"none"},"hit_set_period":0,"hit_set_count":0,"use_gmt_hitset":true,"min_read_recency_for_promote":0,"min_write_recency_for_promote":0,"hit_set_grade_decay_rate":0,"hit_set_search_last_n":0,"grade_table":[],"stripe_width":0,"expected_num_objects":0,"fast_read":false,"options":{"pg_num_min":64,"target_size_ratio":0.89999997615814209},"application_metadata":{"cephfs":{"data":"cephfs"}}}],"osds":[{"osd":0,"uuid":"5dd675c7-2777-48f2-8009-ff0e0d4c7086","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":8,"up_thru":16,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.8:6800","nonce":111181},{"type":"v1","addr":"172.21.15.8:6801","nonce":111181}]},"cluster_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.8:6802","nonce":111181},{"type":"v1","addr":"172.21.15.8:6803","nonce":111181}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.8:6806","nonce":111181},{"type":"v1","addr":"172.21.15.8:6807","nonce":111181}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.8:6804","nonce":111181},{"type":"v1","addr":"172.21.15.8:6805","nonce":111181}]},"public_addr":"172.21.15.8:6801/111181","cluster_addr":"172.21.15.8:6803/111181","heartbeat_back_addr":"172.21.15.8:6807/111181","heartbeat_front_addr":"172.21.15.8:6805/111181","state":["exists","up"]},{"osd":1,"uuid":"7fc612c4-33ba-4a33-bca8-1f42ee8ed548","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":8,"up_thru":16,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.101:6800","nonce":111143},{"type":"v1","addr":"172.21.15.101:6801","nonce":111143}]},"cluster_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.101:6802","nonce":111143},{"type":"v1","addr":"172.21.15.101:6803","nonce":111143}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.101:6806","nonce":111143},{"type":"v1","addr":"172.21.15.101:6807","nonce":111143}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.101:6804","nonce":111143},{"type":"v1","addr":"172.21.15.101:6805","nonce":111143}]},"public_addr":"172.21.15.101:6801/111143","cluster_addr":"172.21.15.101:6803/111143","heartbeat_back_addr":"172.21.15.101:6807/111143","heartbeat_front_addr":"172.21.15.101:6805/111143","state":["exists","up"]},{"osd":2,"uuid":"f85cadbc-4230-4772-8f39-62ed52e220b1","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":9,"up_thru":16,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.155:6800","nonce":111339},{"type":"v1","addr":"172.21.15.155:6801","nonce":111339}]},"cluster_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.155:6802","nonce":111339},{"type":"v1","addr":"172.21.15.155:6803","nonce":111339}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.155:6806","nonce":111339},{"type":"v1","addr":"172.21.15.155:6807","nonce":111339}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.155:6804","nonce":111339},{"type":"v1","addr":"172.21.15.155:6805","nonce":111339}]},"public_addr":"172.21.15.155:6801/111339","cluster_addr":"172.21.15.155:6803/111339","heartbeat_back_addr":"172.21.15.155:6807/111339","heartbeat_front_addr":"172.21.15.155:6805/111339","state":["exists","up"]}],"osd_xinfo":[{"osd":0,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4540138320759226367,"old_weight":0,"last_purged_snaps_scrub":"2023-08-01T19:53:48.018154+0000","dead_epoch":0},{"osd":1,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4540138320759226367,"old_weight":0,"last_purged_snaps_scrub":"2023-08-01T19:53:48.000488+0000","dead_epoch":0},{"osd":2,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4540138320759226367,"old_weight":0,"last_purged_snaps_scrub":"2023-08-01T19:53:48.072529+0000","dead_epoch":0}],"pg_upmap":[],"pg_upmap_items":[],"pg_temp":[],"primary_temp":[],"blocklist":{},"range_blocklist":{},"erasure_code_profiles":{"default":{"crush-failure-domain":"osd","k":"2","m":"1","plugin":"jerasure","technique":"reed_sol_van"}},"removed_snaps_queue":[],"new_removed_snaps":[],"new_purged_snaps":[],"crush_node_flags":{},"device_class_flags":{},"stretch_mode":{"stretch_mode_enabled":false,"stretch_bucket_count":0,"degraded_stretch_mode":0,"recovering_stretch_mode":0,"stretch_mode_bucket":0}} 2023-08-01T19:54:09.721 INFO:tasks.ceph.ceph_manager.ceph:all up! 2023-08-01T19:54:09.721 DEBUG:teuthology.orchestra.run.smithi006:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 120 ceph --cluster ceph osd dump --format=json 2023-08-01T19:54:10.049 INFO:teuthology.orchestra.run.smithi006.stdout: 2023-08-01T19:54:10.050 INFO:teuthology.orchestra.run.smithi006.stdout:{"epoch":18,"fsid":"a0e420cc-4df1-42a5-8bd4-a98c309a9349","created":"2023-08-01T19:53:41.279588+0000","modified":"2023-08-01T19:54:05.452537+0000","last_up_change":"2023-08-01T19:53:50.735626+0000","last_in_change":"2023-08-01T19:53:42.974751+0000","flags":"sortbitwise,recovery_deletes,purged_snapdirs,pglog_hardlimit","flags_num":5799936,"flags_set":["pglog_hardlimit","purged_snapdirs","recovery_deletes","sortbitwise"],"crush_version":5,"full_ratio":0.94999998807907104,"backfillfull_ratio":0.89999997615814209,"nearfull_ratio":0.85000002384185791,"cluster_snapshot":"","pool_max":4,"max_osd":3,"require_min_compat_client":"luminous","min_compat_client":"jewel","require_osd_release":"quincy","pools":[{"pool":1,"pool_name":".mgr","create_time":"2023-08-01T19:53:49.961944+0000","flags":1,"flags_names":"hashpspool","type":1,"size":2,"min_size":1,"crush_rule":0,"peering_crush_bucket_count":0,"peering_crush_bucket_target":0,"peering_crush_bucket_barrier":0,"peering_crush_bucket_mandatory_member":2147483647,"object_hash":2,"pg_autoscale_mode":"off","pg_num":1,"pg_placement_num":1,"pg_placement_num_target":1,"pg_num_target":1,"pg_num_pending":1,"last_pg_merge_meta":{"source_pgid":"0.0","ready_epoch":0,"last_epoch_started":0,"last_epoch_clean":0,"source_version":"0'0","target_version":"0'0"},"last_change":"11","last_force_op_resend":"0","last_force_op_resend_prenautilus":"0","last_force_op_resend_preluminous":"0","auid":0,"snap_mode":"selfmanaged","snap_seq":0,"snap_epoch":0,"pool_snaps":[],"removed_snaps":"[]","quota_max_bytes":0,"quota_max_objects":0,"tiers":[],"tier_of":-1,"read_tier":-1,"write_tier":-1,"cache_mode":"none","target_max_bytes":0,"target_max_objects":0,"cache_target_dirty_ratio_micro":400000,"cache_target_dirty_high_ratio_micro":600000,"cache_target_full_ratio_micro":800000,"cache_min_flush_age":0,"cache_min_evict_age":0,"erasure_code_profile":"","hit_set_params":{"type":"none"},"hit_set_period":0,"hit_set_count":0,"use_gmt_hitset":true,"min_read_recency_for_promote":0,"min_write_recency_for_promote":0,"hit_set_grade_decay_rate":0,"hit_set_search_last_n":0,"grade_table":[],"stripe_width":0,"expected_num_objects":0,"fast_read":false,"options":{"pg_num_max":32,"pg_num_min":1},"application_metadata":{"mgr":{}}},{"pool":2,"pool_name":"rbd","create_time":"2023-08-01T19:53:57.404091+0000","flags":1,"flags_names":"hashpspool","type":1,"size":2,"min_size":1,"crush_rule":0,"peering_crush_bucket_count":0,"peering_crush_bucket_target":0,"peering_crush_bucket_barrier":0,"peering_crush_bucket_mandatory_member":2147483647,"object_hash":2,"pg_autoscale_mode":"off","pg_num":8,"pg_placement_num":8,"pg_placement_num_target":8,"pg_num_target":8,"pg_num_pending":8,"last_pg_merge_meta":{"source_pgid":"0.0","ready_epoch":0,"last_epoch_started":0,"last_epoch_clean":0,"source_version":"0'0","target_version":"0'0"},"last_change":"14","last_force_op_resend":"0","last_force_op_resend_prenautilus":"0","last_force_op_resend_preluminous":"0","auid":0,"snap_mode":"selfmanaged","snap_seq":0,"snap_epoch":0,"pool_snaps":[],"removed_snaps":"[]","quota_max_bytes":0,"quota_max_objects":0,"tiers":[],"tier_of":-1,"read_tier":-1,"write_tier":-1,"cache_mode":"none","target_max_bytes":0,"target_max_objects":0,"cache_target_dirty_ratio_micro":400000,"cache_target_dirty_high_ratio_micro":600000,"cache_target_full_ratio_micro":800000,"cache_min_flush_age":0,"cache_min_evict_age":0,"erasure_code_profile":"","hit_set_params":{"type":"none"},"hit_set_period":0,"hit_set_count":0,"use_gmt_hitset":true,"min_read_recency_for_promote":0,"min_write_recency_for_promote":0,"hit_set_grade_decay_rate":0,"hit_set_search_last_n":0,"grade_table":[],"stripe_width":0,"expected_num_objects":0,"fast_read":false,"options":{},"application_metadata":{"rbd":{}}},{"pool":3,"pool_name":"cephfs_metadata","create_time":"2023-08-01T19:54:02.111247+0000","flags":1,"flags_names":"hashpspool","type":1,"size":2,"min_size":1,"crush_rule":0,"peering_crush_bucket_count":0,"peering_crush_bucket_target":0,"peering_crush_bucket_barrier":0,"peering_crush_bucket_mandatory_member":2147483647,"object_hash":2,"pg_autoscale_mode":"off","pg_num":32,"pg_placement_num":32,"pg_placement_num_target":32,"pg_num_target":32,"pg_num_pending":32,"last_pg_merge_meta":{"source_pgid":"0.0","ready_epoch":0,"last_epoch_started":0,"last_epoch_clean":0,"source_version":"0'0","target_version":"0'0"},"last_change":"17","last_force_op_resend":"0","last_force_op_resend_prenautilus":"0","last_force_op_resend_preluminous":"0","auid":0,"snap_mode":"selfmanaged","snap_seq":0,"snap_epoch":0,"pool_snaps":[],"removed_snaps":"[]","quota_max_bytes":0,"quota_max_objects":0,"tiers":[],"tier_of":-1,"read_tier":-1,"write_tier":-1,"cache_mode":"none","target_max_bytes":0,"target_max_objects":0,"cache_target_dirty_ratio_micro":400000,"cache_target_dirty_high_ratio_micro":600000,"cache_target_full_ratio_micro":800000,"cache_min_flush_age":0,"cache_min_evict_age":0,"erasure_code_profile":"","hit_set_params":{"type":"none"},"hit_set_period":0,"hit_set_count":0,"use_gmt_hitset":true,"min_read_recency_for_promote":0,"min_write_recency_for_promote":0,"hit_set_grade_decay_rate":0,"hit_set_search_last_n":0,"grade_table":[],"stripe_width":0,"expected_num_objects":0,"fast_read":false,"options":{"pg_autoscale_bias":4,"pg_num_min":16,"recovery_priority":5},"application_metadata":{"cephfs":{"metadata":"cephfs"}}},{"pool":4,"pool_name":"cephfs_data","create_time":"2023-08-01T19:54:03.430277+0000","flags":1,"flags_names":"hashpspool","type":1,"size":2,"min_size":1,"crush_rule":0,"peering_crush_bucket_count":0,"peering_crush_bucket_target":0,"peering_crush_bucket_barrier":0,"peering_crush_bucket_mandatory_member":2147483647,"object_hash":2,"pg_autoscale_mode":"off","pg_num":64,"pg_placement_num":64,"pg_placement_num_target":64,"pg_num_target":64,"pg_num_pending":64,"last_pg_merge_meta":{"source_pgid":"0.0","ready_epoch":0,"last_epoch_started":0,"last_epoch_clean":0,"source_version":"0'0","target_version":"0'0"},"last_change":"18","last_force_op_resend":"0","last_force_op_resend_prenautilus":"0","last_force_op_resend_preluminous":"0","auid":0,"snap_mode":"selfmanaged","snap_seq":0,"snap_epoch":0,"pool_snaps":[],"removed_snaps":"[]","quota_max_bytes":0,"quota_max_objects":0,"tiers":[],"tier_of":-1,"read_tier":-1,"write_tier":-1,"cache_mode":"none","target_max_bytes":0,"target_max_objects":0,"cache_target_dirty_ratio_micro":400000,"cache_target_dirty_high_ratio_micro":600000,"cache_target_full_ratio_micro":800000,"cache_min_flush_age":0,"cache_min_evict_age":0,"erasure_code_profile":"","hit_set_params":{"type":"none"},"hit_set_period":0,"hit_set_count":0,"use_gmt_hitset":true,"min_read_recency_for_promote":0,"min_write_recency_for_promote":0,"hit_set_grade_decay_rate":0,"hit_set_search_last_n":0,"grade_table":[],"stripe_width":0,"expected_num_objects":0,"fast_read":false,"options":{"pg_num_min":64,"target_size_ratio":0.89999997615814209},"application_metadata":{"cephfs":{"data":"cephfs"}}}],"osds":[{"osd":0,"uuid":"5dd675c7-2777-48f2-8009-ff0e0d4c7086","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":8,"up_thru":16,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.8:6800","nonce":111181},{"type":"v1","addr":"172.21.15.8:6801","nonce":111181}]},"cluster_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.8:6802","nonce":111181},{"type":"v1","addr":"172.21.15.8:6803","nonce":111181}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.8:6806","nonce":111181},{"type":"v1","addr":"172.21.15.8:6807","nonce":111181}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.8:6804","nonce":111181},{"type":"v1","addr":"172.21.15.8:6805","nonce":111181}]},"public_addr":"172.21.15.8:6801/111181","cluster_addr":"172.21.15.8:6803/111181","heartbeat_back_addr":"172.21.15.8:6807/111181","heartbeat_front_addr":"172.21.15.8:6805/111181","state":["exists","up"]},{"osd":1,"uuid":"7fc612c4-33ba-4a33-bca8-1f42ee8ed548","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":8,"up_thru":16,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.101:6800","nonce":111143},{"type":"v1","addr":"172.21.15.101:6801","nonce":111143}]},"cluster_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.101:6802","nonce":111143},{"type":"v1","addr":"172.21.15.101:6803","nonce":111143}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.101:6806","nonce":111143},{"type":"v1","addr":"172.21.15.101:6807","nonce":111143}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.101:6804","nonce":111143},{"type":"v1","addr":"172.21.15.101:6805","nonce":111143}]},"public_addr":"172.21.15.101:6801/111143","cluster_addr":"172.21.15.101:6803/111143","heartbeat_back_addr":"172.21.15.101:6807/111143","heartbeat_front_addr":"172.21.15.101:6805/111143","state":["exists","up"]},{"osd":2,"uuid":"f85cadbc-4230-4772-8f39-62ed52e220b1","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":9,"up_thru":16,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.155:6800","nonce":111339},{"type":"v1","addr":"172.21.15.155:6801","nonce":111339}]},"cluster_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.155:6802","nonce":111339},{"type":"v1","addr":"172.21.15.155:6803","nonce":111339}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.155:6806","nonce":111339},{"type":"v1","addr":"172.21.15.155:6807","nonce":111339}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.155:6804","nonce":111339},{"type":"v1","addr":"172.21.15.155:6805","nonce":111339}]},"public_addr":"172.21.15.155:6801/111339","cluster_addr":"172.21.15.155:6803/111339","heartbeat_back_addr":"172.21.15.155:6807/111339","heartbeat_front_addr":"172.21.15.155:6805/111339","state":["exists","up"]}],"osd_xinfo":[{"osd":0,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4540138320759226367,"old_weight":0,"last_purged_snaps_scrub":"2023-08-01T19:53:48.018154+0000","dead_epoch":0},{"osd":1,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4540138320759226367,"old_weight":0,"last_purged_snaps_scrub":"2023-08-01T19:53:48.000488+0000","dead_epoch":0},{"osd":2,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4540138320759226367,"old_weight":0,"last_purged_snaps_scrub":"2023-08-01T19:53:48.072529+0000","dead_epoch":0}],"pg_upmap":[],"pg_upmap_items":[],"pg_temp":[],"primary_temp":[],"blocklist":{},"range_blocklist":{},"erasure_code_profiles":{"default":{"crush-failure-domain":"osd","k":"2","m":"1","plugin":"jerasure","technique":"reed_sol_van"}},"removed_snaps_queue":[],"new_removed_snaps":[],"new_purged_snaps":[],"crush_node_flags":{},"device_class_flags":{},"stretch_mode":{"stretch_mode_enabled":false,"stretch_bucket_count":0,"degraded_stretch_mode":0,"recovering_stretch_mode":0,"stretch_mode_bucket":0}} 2023-08-01T19:54:10.064 DEBUG:teuthology.orchestra.run.smithi006:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 120 ceph --cluster ceph tell osd.0 flush_pg_stats 2023-08-01T19:54:10.064 DEBUG:teuthology.orchestra.run.smithi006:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 120 ceph --cluster ceph tell osd.1 flush_pg_stats 2023-08-01T19:54:10.065 DEBUG:teuthology.orchestra.run.smithi006:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 120 ceph --cluster ceph tell osd.2 flush_pg_stats 2023-08-01T19:54:10.233 INFO:teuthology.orchestra.run.smithi006.stdout:38654705671 2023-08-01T19:54:10.234 DEBUG:teuthology.orchestra.run.smithi006:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 120 ceph --cluster ceph osd last-stat-seq osd.2 2023-08-01T19:54:10.234 INFO:teuthology.orchestra.run.smithi006.stdout:34359738375 2023-08-01T19:54:10.235 DEBUG:teuthology.orchestra.run.smithi006:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 120 ceph --cluster ceph osd last-stat-seq osd.0 2023-08-01T19:54:10.236 INFO:teuthology.orchestra.run.smithi006.stdout:34359738374 2023-08-01T19:54:10.236 DEBUG:teuthology.orchestra.run.smithi006:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 120 ceph --cluster ceph osd last-stat-seq osd.1 2023-08-01T19:54:10.610 INFO:teuthology.orchestra.run.smithi006.stdout:34359738372 2023-08-01T19:54:10.619 INFO:teuthology.orchestra.run.smithi006.stdout:34359738373 2023-08-01T19:54:10.623 INFO:teuthology.orchestra.run.smithi006.stdout:38654705670 2023-08-01T19:54:10.625 INFO:tasks.ceph.ceph_manager.ceph:need seq 34359738374 got 34359738372 for osd.1 2023-08-01T19:54:10.636 INFO:tasks.ceph.ceph_manager.ceph:need seq 34359738375 got 34359738373 for osd.0 2023-08-01T19:54:10.638 INFO:tasks.ceph.ceph_manager.ceph:need seq 38654705671 got 38654705670 for osd.2 2023-08-01T19:54:11.626 DEBUG:teuthology.orchestra.run.smithi006:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 120 ceph --cluster ceph osd last-stat-seq osd.1 2023-08-01T19:54:11.637 DEBUG:teuthology.orchestra.run.smithi006:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 120 ceph --cluster ceph osd last-stat-seq osd.0 2023-08-01T19:54:11.640 DEBUG:teuthology.orchestra.run.smithi006:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 120 ceph --cluster ceph osd last-stat-seq osd.2 2023-08-01T19:54:12.023 INFO:teuthology.orchestra.run.smithi006.stdout:34359738373 2023-08-01T19:54:12.037 INFO:tasks.ceph.ceph_manager.ceph:need seq 34359738375 got 34359738373 for osd.0 2023-08-01T19:54:12.059 INFO:teuthology.orchestra.run.smithi006.stdout:34359738372 2023-08-01T19:54:12.074 INFO:tasks.ceph.ceph_manager.ceph:need seq 34359738374 got 34359738372 for osd.1 2023-08-01T19:54:12.088 INFO:teuthology.orchestra.run.smithi006.stdout:38654705670 2023-08-01T19:54:12.102 INFO:tasks.ceph.ceph_manager.ceph:need seq 38654705671 got 38654705670 for osd.2 2023-08-01T19:54:13.038 DEBUG:teuthology.orchestra.run.smithi006:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 120 ceph --cluster ceph osd last-stat-seq osd.0 2023-08-01T19:54:13.075 DEBUG:teuthology.orchestra.run.smithi006:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 120 ceph --cluster ceph osd last-stat-seq osd.1 2023-08-01T19:54:13.102 DEBUG:teuthology.orchestra.run.smithi006:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 120 ceph --cluster ceph osd last-stat-seq osd.2 2023-08-01T19:54:13.387 INFO:teuthology.orchestra.run.smithi006.stdout:34359738375 2023-08-01T19:54:13.402 INFO:tasks.ceph.ceph_manager.ceph:need seq 34359738375 got 34359738375 for osd.0 2023-08-01T19:54:13.402 DEBUG:teuthology.parallel:result is None 2023-08-01T19:54:13.423 INFO:teuthology.orchestra.run.smithi006.stdout:34359738374 2023-08-01T19:54:13.437 INFO:tasks.ceph.ceph_manager.ceph:need seq 34359738374 got 34359738374 for osd.1 2023-08-01T19:54:13.437 DEBUG:teuthology.parallel:result is None 2023-08-01T19:54:13.462 INFO:teuthology.orchestra.run.smithi006.stdout:38654705672 2023-08-01T19:54:13.476 INFO:tasks.ceph.ceph_manager.ceph:need seq 38654705671 got 38654705672 for osd.2 2023-08-01T19:54:13.476 DEBUG:teuthology.parallel:result is None 2023-08-01T19:54:13.476 INFO:tasks.ceph.ceph_manager.ceph:waiting for clean 2023-08-01T19:54:13.477 DEBUG:teuthology.orchestra.run.smithi006:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 120 ceph --cluster ceph pg dump --format=json 2023-08-01T19:54:13.846 INFO:teuthology.orchestra.run.smithi006.stdout: 2023-08-01T19:54:13.847 INFO:teuthology.orchestra.run.smithi006.stderr:dumped all 2023-08-01T19:54:13.858 INFO:teuthology.orchestra.run.smithi006.stdout:{"pg_ready":true,"pg_map":{"version":26,"stamp":"2023-08-01T19:54:11.909227+0000","last_osdmap_epoch":0,"last_pg_scan":0,"pg_stats_sum":{"stat_sum":{"num_bytes":592674,"num_objects":24,"num_object_clones":0,"num_object_copies":48,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":24,"num_whiteouts":0,"num_read":136,"num_read_kb":118,"num_write":248,"num_write_kb":3473,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":14,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"store_stats":{"total":0,"available":0,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},"log_size":196,"ondisk_log_size":196,"up":210,"acting":210,"num_store_stats":0},"osd_stats_sum":{"up_from":0,"seq":0,"num_pgs":210,"num_osds":3,"num_per_pool_osds":3,"num_per_pool_omap_osds":3,"kb":283115520,"kb_used":31248,"kb_used_data":632,"kb_used_omap":0,"kb_used_meta":30592,"kb_avail":283084272,"statfs":{"total":289910292480,"available":289878294528,"internally_reserved":0,"allocated":647168,"data_stored":1350783,"data_compressed":20662,"data_compressed_allocated":73728,"data_compressed_original":1146880,"omap_allocated":0,"internal_metadata":31326208},"hb_peers":[],"snap_trim_queue_len":0,"num_snap_trimming":0,"num_shards_repaired":0,"op_queue_age_hist":{"histogram":[],"upper_bound":1},"perf_stat":{"commit_latency_ms":0,"apply_latency_ms":0,"commit_latency_ns":0,"apply_latency_ns":0},"alerts":[],"network_ping_times":[]},"pg_stats_delta":{"stat_sum":{"num_bytes":2306,"num_objects":22,"num_object_clones":0,"num_object_copies":44,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":22,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":45,"num_write_kb":13,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":14,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"store_stats":{"total":0,"available":0,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},"log_size":0,"ondisk_log_size":0,"up":0,"acting":0,"num_store_stats":0,"stamp_delta":"7.858395"},"pg_stats":[{"pgid":"4.3f","version":"0'0","reported_seq":9,"reported_epoch":17,"state":"active+clean","last_fresh":"2023-08-01T19:54:04.477207+0000","last_change":"2023-08-01T19:54:04.473430+0000","last_active":"2023-08-01T19:54:04.477207+0000","last_peered":"2023-08-01T19:54:04.477207+0000","last_clean":"2023-08-01T19:54:04.477207+0000","last_became_active":"2023-08-01T19:54:04.472887+0000","last_became_peered":"2023-08-01T19:54:04.472887+0000","last_unstale":"2023-08-01T19:54:04.477207+0000","last_undegraded":"2023-08-01T19:54:04.477207+0000","last_fullsized":"2023-08-01T19:54:04.477207+0000","mapping_epoch":16,"log_start":"0'0","ondisk_log_start":"0'0","created":16,"last_epoch_clean":17,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-08-01T19:54:04.040663+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-08-01T19:54:04.040663+0000","last_clean_scrub_stamp":"2023-08-01T19:54:04.040663+0000","objects_scrubbed":0,"log_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-08-03T06:38:54.196605+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[2,0],"acting":[2,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":2,"acting_primary":2,"purged_snaps":[]},{"pgid":"4.3e","version":"0'0","reported_seq":9,"reported_epoch":17,"state":"active+clean","last_fresh":"2023-08-01T19:54:04.472547+0000","last_change":"2023-08-01T19:54:04.470501+0000","last_active":"2023-08-01T19:54:04.472547+0000","last_peered":"2023-08-01T19:54:04.472547+0000","last_clean":"2023-08-01T19:54:04.472547+0000","last_became_active":"2023-08-01T19:54:04.469692+0000","last_became_peered":"2023-08-01T19:54:04.469692+0000","last_unstale":"2023-08-01T19:54:04.472547+0000","last_undegraded":"2023-08-01T19:54:04.472547+0000","last_fullsized":"2023-08-01T19:54:04.472547+0000","mapping_epoch":16,"log_start":"0'0","ondisk_log_start":"0'0","created":16,"last_epoch_clean":17,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-08-01T19:54:04.040663+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-08-01T19:54:04.040663+0000","last_clean_scrub_stamp":"2023-08-01T19:54:04.040663+0000","objects_scrubbed":0,"log_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-08-03T02:19:35.201107+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[2,0],"acting":[2,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":2,"acting_primary":2,"purged_snaps":[]},{"pgid":"4.3d","version":"0'0","reported_seq":9,"reported_epoch":17,"state":"active+clean","last_fresh":"2023-08-01T19:54:04.477342+0000","last_change":"2023-08-01T19:54:04.472579+0000","last_active":"2023-08-01T19:54:04.477342+0000","last_peered":"2023-08-01T19:54:04.477342+0000","last_clean":"2023-08-01T19:54:04.477342+0000","last_became_active":"2023-08-01T19:54:04.471128+0000","last_became_peered":"2023-08-01T19:54:04.471128+0000","last_unstale":"2023-08-01T19:54:04.477342+0000","last_undegraded":"2023-08-01T19:54:04.477342+0000","last_fullsized":"2023-08-01T19:54:04.477342+0000","mapping_epoch":16,"log_start":"0'0","ondisk_log_start":"0'0","created":16,"last_epoch_clean":17,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-08-01T19:54:04.040663+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-08-01T19:54:04.040663+0000","last_clean_scrub_stamp":"2023-08-01T19:54:04.040663+0000","objects_scrubbed":0,"log_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-08-03T03:04:06.137335+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[1,2],"acting":[1,2],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":1,"acting_primary":1,"purged_snaps":[]},{"pgid":"4.3c","version":"0'0","reported_seq":9,"reported_epoch":17,"state":"active+clean","last_fresh":"2023-08-01T19:54:04.479161+0000","last_change":"2023-08-01T19:54:04.477908+0000","last_active":"2023-08-01T19:54:04.479161+0000","last_peered":"2023-08-01T19:54:04.479161+0000","last_clean":"2023-08-01T19:54:04.479161+0000","last_became_active":"2023-08-01T19:54:04.476684+0000","last_became_peered":"2023-08-01T19:54:04.476684+0000","last_unstale":"2023-08-01T19:54:04.479161+0000","last_undegraded":"2023-08-01T19:54:04.479161+0000","last_fullsized":"2023-08-01T19:54:04.479161+0000","mapping_epoch":16,"log_start":"0'0","ondisk_log_start":"0'0","created":16,"last_epoch_clean":17,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-08-01T19:54:04.040663+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-08-01T19:54:04.040663+0000","last_clean_scrub_stamp":"2023-08-01T19:54:04.040663+0000","objects_scrubbed":0,"log_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-08-03T03:56:55.336461+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[1,0],"acting":[1,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":1,"acting_primary":1,"purged_snaps":[]},{"pgid":"4.3b","version":"0'0","reported_seq":9,"reported_epoch":17,"state":"active+clean","last_fresh":"2023-08-01T19:54:04.469848+0000","last_change":"2023-08-01T19:54:04.467197+0000","last_active":"2023-08-01T19:54:04.469848+0000","last_peered":"2023-08-01T19:54:04.469848+0000","last_clean":"2023-08-01T19:54:04.469848+0000","last_became_active":"2023-08-01T19:54:04.466526+0000","last_became_peered":"2023-08-01T19:54:04.466526+0000","last_unstale":"2023-08-01T19:54:04.469848+0000","last_undegraded":"2023-08-01T19:54:04.469848+0000","last_fullsized":"2023-08-01T19:54:04.469848+0000","mapping_epoch":16,"log_start":"0'0","ondisk_log_start":"0'0","created":16,"last_epoch_clean":17,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-08-01T19:54:04.040663+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-08-01T19:54:04.040663+0000","last_clean_scrub_stamp":"2023-08-01T19:54:04.040663+0000","objects_scrubbed":0,"log_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-08-03T06:54:18.982174+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[2,0],"acting":[2,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":2,"acting_primary":2,"purged_snaps":[]},{"pgid":"4.3a","version":"0'0","reported_seq":9,"reported_epoch":17,"state":"active+clean","last_fresh":"2023-08-01T19:54:04.477568+0000","last_change":"2023-08-01T19:54:04.473296+0000","last_active":"2023-08-01T19:54:04.477568+0000","last_peered":"2023-08-01T19:54:04.477568+0000","last_clean":"2023-08-01T19:54:04.477568+0000","last_became_active":"2023-08-01T19:54:04.472324+0000","last_became_peered":"2023-08-01T19:54:04.472324+0000","last_unstale":"2023-08-01T19:54:04.477568+0000","last_undegraded":"2023-08-01T19:54:04.477568+0000","last_fullsized":"2023-08-01T19:54:04.477568+0000","mapping_epoch":16,"log_start":"0'0","ondisk_log_start":"0'0","created":16,"last_epoch_clean":17,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-08-01T19:54:04.040663+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-08-01T19:54:04.040663+0000","last_clean_scrub_stamp":"2023-08-01T19:54:04.040663+0000","objects_scrubbed":0,"log_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-08-02T23:15:11.148662+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[1,0],"acting":[1,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":1,"acting_primary":1,"purged_snaps":[]},{"pgid":"4.39","version":"0'0","reported_seq":9,"reported_epoch":17,"state":"active+clean","last_fresh":"2023-08-01T19:54:04.478215+0000","last_change":"2023-08-01T19:54:04.475322+0000","last_active":"2023-08-01T19:54:04.478215+0000","last_peered":"2023-08-01T19:54:04.478215+0000","last_clean":"2023-08-01T19:54:04.478215+0000","last_became_active":"2023-08-01T19:54:04.474591+0000","last_became_peered":"2023-08-01T19:54:04.474591+0000","last_unstale":"2023-08-01T19:54:04.478215+0000","last_undegraded":"2023-08-01T19:54:04.478215+0000","last_fullsized":"2023-08-01T19:54:04.478215+0000","mapping_epoch":16,"log_start":"0'0","ondisk_log_start":"0'0","created":16,"last_epoch_clean":17,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-08-01T19:54:04.040663+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-08-01T19:54:04.040663+0000","last_clean_scrub_stamp":"2023-08-01T19:54:04.040663+0000","objects_scrubbed":0,"log_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-08-03T00:29:53.554989+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[1,0],"acting":[1,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":1,"acting_primary":1,"purged_snaps":[]},{"pgid":"4.38","version":"0'0","reported_seq":9,"reported_epoch":17,"state":"active+clean","last_fresh":"2023-08-01T19:54:04.479227+0000","last_change":"2023-08-01T19:54:04.478505+0000","last_active":"2023-08-01T19:54:04.479227+0000","last_peered":"2023-08-01T19:54:04.479227+0000","last_clean":"2023-08-01T19:54:04.479227+0000","last_became_active":"2023-08-01T19:54:04.477325+0000","last_became_peered":"2023-08-01T19:54:04.477325+0000","last_unstale":"2023-08-01T19:54:04.479227+0000","last_undegraded":"2023-08-01T19:54:04.479227+0000","last_fullsized":"2023-08-01T19:54:04.479227+0000","mapping_epoch":16,"log_start":"0'0","ondisk_log_start":"0'0","created":16,"last_epoch_clean":17,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-08-01T19:54:04.040663+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-08-01T19:54:04.040663+0000","last_clean_scrub_stamp":"2023-08-01T19:54:04.040663+0000","objects_scrubbed":0,"log_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-08-03T01:38:12.939736+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[1,0],"acting":[1,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":1,"acting_primary":1,"purged_snaps":[]},{"pgid":"4.37","version":"0'0","reported_seq":9,"reported_epoch":17,"state":"active+clean","last_fresh":"2023-08-01T19:54:04.472944+0000","last_change":"2023-08-01T19:54:04.470971+0000","last_active":"2023-08-01T19:54:04.472944+0000","last_peered":"2023-08-01T19:54:04.472944+0000","last_clean":"2023-08-01T19:54:04.472944+0000","last_became_active":"2023-08-01T19:54:04.469011+0000","last_became_peered":"2023-08-01T19:54:04.469011+0000","last_unstale":"2023-08-01T19:54:04.472944+0000","last_undegraded":"2023-08-01T19:54:04.472944+0000","last_fullsized":"2023-08-01T19:54:04.472944+0000","mapping_epoch":16,"log_start":"0'0","ondisk_log_start":"0'0","created":16,"last_epoch_clean":17,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-08-01T19:54:04.040663+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-08-01T19:54:04.040663+0000","last_clean_scrub_stamp":"2023-08-01T19:54:04.040663+0000","objects_scrubbed":0,"log_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-08-03T06:50:03.420334+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[0,2],"acting":[0,2],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":0,"acting_primary":0,"purged_snaps":[]},{"pgid":"4.36","version":"0'0","reported_seq":9,"reported_epoch":17,"state":"active+clean","last_fresh":"2023-08-01T19:54:04.477220+0000","last_change":"2023-08-01T19:54:04.473523+0000","last_active":"2023-08-01T19:54:04.477220+0000","last_peered":"2023-08-01T19:54:04.477220+0000","last_clean":"2023-08-01T19:54:04.477220+0000","last_became_active":"2023-08-01T19:54:04.473084+0000","last_became_peered":"2023-08-01T19:54:04.473084+0000","last_unstale":"2023-08-01T19:54:04.477220+0000","last_undegraded":"2023-08-01T19:54:04.477220+0000","last_fullsized":"2023-08-01T19:54:04.477220+0000","mapping_epoch":16,"log_start":"0'0","ondisk_log_start":"0'0","created":16,"last_epoch_clean":17,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-08-01T19:54:04.040663+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-08-01T19:54:04.040663+0000","last_clean_scrub_stamp":"2023-08-01T19:54:04.040663+0000","objects_scrubbed":0,"log_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-08-03T04:28:59.042443+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[2,0],"acting":[2,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":2,"acting_primary":2,"purged_snaps":[]},{"pgid":"4.35","version":"0'0","reported_seq":9,"reported_epoch":17,"state":"active+clean","last_fresh":"2023-08-01T19:54:04.478818+0000","last_change":"2023-08-01T19:54:04.475816+0000","last_active":"2023-08-01T19:54:04.478818+0000","last_peered":"2023-08-01T19:54:04.478818+0000","last_clean":"2023-08-01T19:54:04.478818+0000","last_became_active":"2023-08-01T19:54:04.475061+0000","last_became_peered":"2023-08-01T19:54:04.475061+0000","last_unstale":"2023-08-01T19:54:04.478818+0000","last_undegraded":"2023-08-01T19:54:04.478818+0000","last_fullsized":"2023-08-01T19:54:04.478818+0000","mapping_epoch":16,"log_start":"0'0","ondisk_log_start":"0'0","created":16,"last_epoch_clean":17,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-08-01T19:54:04.040663+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-08-01T19:54:04.040663+0000","last_clean_scrub_stamp":"2023-08-01T19:54:04.040663+0000","objects_scrubbed":0,"log_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-08-02T22:07:41.305488+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[1,0],"acting":[1,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":1,"acting_primary":1,"purged_snaps":[]},{"pgid":"4.34","version":"0'0","reported_seq":9,"reported_epoch":17,"state":"active+clean","last_fresh":"2023-08-01T19:54:04.470323+0000","last_change":"2023-08-01T19:54:04.468009+0000","last_active":"2023-08-01T19:54:04.470323+0000","last_peered":"2023-08-01T19:54:04.470323+0000","last_clean":"2023-08-01T19:54:04.470323+0000","last_became_active":"2023-08-01T19:54:04.467568+0000","last_became_peered":"2023-08-01T19:54:04.467568+0000","last_unstale":"2023-08-01T19:54:04.470323+0000","last_undegraded":"2023-08-01T19:54:04.470323+0000","last_fullsized":"2023-08-01T19:54:04.470323+0000","mapping_epoch":16,"log_start":"0'0","ondisk_log_start":"0'0","created":16,"last_epoch_clean":17,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-08-01T19:54:04.040663+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-08-01T19:54:04.040663+0000","last_clean_scrub_stamp":"2023-08-01T19:54:04.040663+0000","objects_scrubbed":0,"log_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-08-03T04:53:44.017572+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[2,1],"acting":[2,1],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":2,"acting_primary":2,"purged_snaps":[]},{"pgid":"4.33","version":"0'0","reported_seq":9,"reported_epoch":17,"state":"active+clean","last_fresh":"2023-08-01T19:54:04.468611+0000","last_change":"2023-08-01T19:54:04.466770+0000","last_active":"2023-08-01T19:54:04.468611+0000","last_peered":"2023-08-01T19:54:04.468611+0000","last_clean":"2023-08-01T19:54:04.468611+0000","last_became_active":"2023-08-01T19:54:04.466460+0000","last_became_peered":"2023-08-01T19:54:04.466460+0000","last_unstale":"2023-08-01T19:54:04.468611+0000","last_undegraded":"2023-08-01T19:54:04.468611+0000","last_fullsized":"2023-08-01T19:54:04.468611+0000","mapping_epoch":16,"log_start":"0'0","ondisk_log_start":"0'0","created":16,"last_epoch_clean":17,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-08-01T19:54:04.040663+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-08-01T19:54:04.040663+0000","last_clean_scrub_stamp":"2023-08-01T19:54:04.040663+0000","objects_scrubbed":0,"log_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-08-03T06:04:11.595951+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[2,0],"acting":[2,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":2,"acting_primary":2,"purged_snaps":[]},{"pgid":"4.32","version":"0'0","reported_seq":9,"reported_epoch":17,"state":"active+clean","last_fresh":"2023-08-01T19:54:04.469801+0000","last_change":"2023-08-01T19:54:04.466634+0000","last_active":"2023-08-01T19:54:04.469801+0000","last_peered":"2023-08-01T19:54:04.469801+0000","last_clean":"2023-08-01T19:54:04.469801+0000","last_became_active":"2023-08-01T19:54:04.466302+0000","last_became_peered":"2023-08-01T19:54:04.466302+0000","last_unstale":"2023-08-01T19:54:04.469801+0000","last_undegraded":"2023-08-01T19:54:04.469801+0000","last_fullsized":"2023-08-01T19:54:04.469801+0000","mapping_epoch":16,"log_start":"0'0","ondisk_log_start":"0'0","created":16,"last_epoch_clean":17,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-08-01T19:54:04.040663+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-08-01T19:54:04.040663+0000","last_clean_scrub_stamp":"2023-08-01T19:54:04.040663+0000","objects_scrubbed":0,"log_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-08-03T05:46:11.085577+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[1,2],"acting":[1,2],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":1,"acting_primary":1,"purged_snaps":[]},{"pgid":"4.31","version":"0'0","reported_seq":9,"reported_epoch":17,"state":"active+clean","last_fresh":"2023-08-01T19:54:04.476575+0000","last_change":"2023-08-01T19:54:04.472407+0000","last_active":"2023-08-01T19:54:04.476575+0000","last_peered":"2023-08-01T19:54:04.476575+0000","last_clean":"2023-08-01T19:54:04.476575+0000","last_became_active":"2023-08-01T19:54:04.472008+0000","last_became_peered":"2023-08-01T19:54:04.472008+0000","last_unstale":"2023-08-01T19:54:04.476575+0000","last_undegraded":"2023-08-01T19:54:04.476575+0000","last_fullsized":"2023-08-01T19:54:04.476575+0000","mapping_epoch":16,"log_start":"0'0","ondisk_log_start":"0'0","created":16,"last_epoch_clean":17,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-08-01T19:54:04.040663+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-08-01T19:54:04.040663+0000","last_clean_scrub_stamp":"2023-08-01T19:54:04.040663+0000","objects_scrubbed":0,"log_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-08-02T22:42:25.293502+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[1,2],"acting":[1,2],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":1,"acting_primary":1,"purged_snaps":[]},{"pgid":"4.30","version":"0'0","reported_seq":9,"reported_epoch":17,"state":"active+clean","last_fresh":"2023-08-01T19:54:04.479184+0000","last_change":"2023-08-01T19:54:04.478283+0000","last_active":"2023-08-01T19:54:04.479184+0000","last_peered":"2023-08-01T19:54:04.479184+0000","last_clean":"2023-08-01T19:54:04.479184+0000","last_became_active":"2023-08-01T19:54:04.476620+0000","last_became_peered":"2023-08-01T19:54:04.476620+0000","last_unstale":"2023-08-01T19:54:04.479184+0000","last_undegraded":"2023-08-01T19:54:04.479184+0000","last_fullsized":"2023-08-01T19:54:04.479184+0000","mapping_epoch":16,"log_start":"0'0","ondisk_log_start":"0'0","created":16,"last_epoch_clean":17,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-08-01T19:54:04.040663+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-08-01T19:54:04.040663+0000","last_clean_scrub_stamp":"2023-08-01T19:54:04.040663+0000","objects_scrubbed":0,"log_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-08-03T02:27:17.063518+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[1,0],"acting":[1,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":1,"acting_primary":1,"purged_snaps":[]},{"pgid":"4.2f","version":"0'0","reported_seq":9,"reported_epoch":17,"state":"active+clean","last_fresh":"2023-08-01T19:54:04.472916+0000","last_change":"2023-08-01T19:54:04.470302+0000","last_active":"2023-08-01T19:54:04.472916+0000","last_peered":"2023-08-01T19:54:04.472916+0000","last_clean":"2023-08-01T19:54:04.472916+0000","last_became_active":"2023-08-01T19:54:04.468919+0000","last_became_peered":"2023-08-01T19:54:04.468919+0000","last_unstale":"2023-08-01T19:54:04.472916+0000","last_undegraded":"2023-08-01T19:54:04.472916+0000","last_fullsized":"2023-08-01T19:54:04.472916+0000","mapping_epoch":16,"log_start":"0'0","ondisk_log_start":"0'0","created":16,"last_epoch_clean":17,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-08-01T19:54:04.040663+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-08-01T19:54:04.040663+0000","last_clean_scrub_stamp":"2023-08-01T19:54:04.040663+0000","objects_scrubbed":0,"log_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-08-02T22:42:25.293502+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[0,2],"acting":[0,2],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":0,"acting_primary":0,"purged_snaps":[]},{"pgid":"4.2e","version":"0'0","reported_seq":9,"reported_epoch":17,"state":"active+clean","last_fresh":"2023-08-01T19:54:04.477303+0000","last_change":"2023-08-01T19:54:04.474058+0000","last_active":"2023-08-01T19:54:04.477303+0000","last_peered":"2023-08-01T19:54:04.477303+0000","last_clean":"2023-08-01T19:54:04.477303+0000","last_became_active":"2023-08-01T19:54:04.473355+0000","last_became_peered":"2023-08-01T19:54:04.473355+0000","last_unstale":"2023-08-01T19:54:04.477303+0000","last_undegraded":"2023-08-01T19:54:04.477303+0000","last_fullsized":"2023-08-01T19:54:04.477303+0000","mapping_epoch":16,"log_start":"0'0","ondisk_log_start":"0'0","created":16,"last_epoch_clean":17,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-08-01T19:54:04.040663+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-08-01T19:54:04.040663+0000","last_clean_scrub_stamp":"2023-08-01T19:54:04.040663+0000","objects_scrubbed":0,"log_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-08-03T04:55:54.197252+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[2,0],"acting":[2,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":2,"acting_primary":2,"purged_snaps":[]},{"pgid":"4.2d","version":"0'0","reported_seq":9,"reported_epoch":17,"state":"active+clean","last_fresh":"2023-08-01T19:54:04.472287+0000","last_change":"2023-08-01T19:54:04.468775+0000","last_active":"2023-08-01T19:54:04.472287+0000","last_peered":"2023-08-01T19:54:04.472287+0000","last_clean":"2023-08-01T19:54:04.472287+0000","last_became_active":"2023-08-01T19:54:04.467274+0000","last_became_peered":"2023-08-01T19:54:04.467274+0000","last_unstale":"2023-08-01T19:54:04.472287+0000","last_undegraded":"2023-08-01T19:54:04.472287+0000","last_fullsized":"2023-08-01T19:54:04.472287+0000","mapping_epoch":16,"log_start":"0'0","ondisk_log_start":"0'0","created":16,"last_epoch_clean":17,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-08-01T19:54:04.040663+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-08-01T19:54:04.040663+0000","last_clean_scrub_stamp":"2023-08-01T19:54:04.040663+0000","objects_scrubbed":0,"log_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-08-02T23:00:37.537286+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[0,2],"acting":[0,2],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":0,"acting_primary":0,"purged_snaps":[]},{"pgid":"4.2c","version":"0'0","reported_seq":9,"reported_epoch":17,"state":"active+clean","last_fresh":"2023-08-01T19:54:04.479196+0000","last_change":"2023-08-01T19:54:04.478409+0000","last_active":"2023-08-01T19:54:04.479196+0000","last_peered":"2023-08-01T19:54:04.479196+0000","last_clean":"2023-08-01T19:54:04.479196+0000","last_became_active":"2023-08-01T19:54:04.477133+0000","last_became_peered":"2023-08-01T19:54:04.477133+0000","last_unstale":"2023-08-01T19:54:04.479196+0000","last_undegraded":"2023-08-01T19:54:04.479196+0000","last_fullsized":"2023-08-01T19:54:04.479196+0000","mapping_epoch":16,"log_start":"0'0","ondisk_log_start":"0'0","created":16,"last_epoch_clean":17,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-08-01T19:54:04.040663+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-08-01T19:54:04.040663+0000","last_clean_scrub_stamp":"2023-08-01T19:54:04.040663+0000","objects_scrubbed":0,"log_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-08-02T22:15:19.744281+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[1,0],"acting":[1,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":1,"acting_primary":1,"purged_snaps":[]},{"pgid":"4.2b","version":"0'0","reported_seq":9,"reported_epoch":17,"state":"active+clean","last_fresh":"2023-08-01T19:54:04.477876+0000","last_change":"2023-08-01T19:54:04.474047+0000","last_active":"2023-08-01T19:54:04.477876+0000","last_peered":"2023-08-01T19:54:04.477876+0000","last_clean":"2023-08-01T19:54:04.477876+0000","last_became_active":"2023-08-01T19:54:04.473578+0000","last_became_peered":"2023-08-01T19:54:04.473578+0000","last_unstale":"2023-08-01T19:54:04.477876+0000","last_undegraded":"2023-08-01T19:54:04.477876+0000","last_fullsized":"2023-08-01T19:54:04.477876+0000","mapping_epoch":16,"log_start":"0'0","ondisk_log_start":"0'0","created":16,"last_epoch_clean":17,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-08-01T19:54:04.040663+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-08-01T19:54:04.040663+0000","last_clean_scrub_stamp":"2023-08-01T19:54:04.040663+0000","objects_scrubbed":0,"log_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-08-03T05:39:29.199142+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[1,0],"acting":[1,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":1,"acting_primary":1,"purged_snaps":[]},{"pgid":"4.2a","version":"0'0","reported_seq":9,"reported_epoch":17,"state":"active+clean","last_fresh":"2023-08-01T19:54:04.470833+0000","last_change":"2023-08-01T19:54:04.469281+0000","last_active":"2023-08-01T19:54:04.470833+0000","last_peered":"2023-08-01T19:54:04.470833+0000","last_clean":"2023-08-01T19:54:04.470833+0000","last_became_active":"2023-08-01T19:54:04.468771+0000","last_became_peered":"2023-08-01T19:54:04.468771+0000","last_unstale":"2023-08-01T19:54:04.470833+0000","last_undegraded":"2023-08-01T19:54:04.470833+0000","last_fullsized":"2023-08-01T19:54:04.470833+0000","mapping_epoch":16,"log_start":"0'0","ondisk_log_start":"0'0","created":16,"last_epoch_clean":17,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-08-01T19:54:04.040663+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-08-01T19:54:04.040663+0000","last_clean_scrub_stamp":"2023-08-01T19:54:04.040663+0000","objects_scrubbed":0,"log_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-08-03T01:15:27.748810+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[2,1],"acting":[2,1],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":2,"acting_primary":2,"purged_snaps":[]},{"pgid":"4.29","version":"0'0","reported_seq":9,"reported_epoch":17,"state":"active+clean","last_fresh":"2023-08-01T19:54:04.471410+0000","last_change":"2023-08-01T19:54:04.466694+0000","last_active":"2023-08-01T19:54:04.471410+0000","last_peered":"2023-08-01T19:54:04.471410+0000","last_clean":"2023-08-01T19:54:04.471410+0000","last_became_active":"2023-08-01T19:54:04.466250+0000","last_became_peered":"2023-08-01T19:54:04.466250+0000","last_unstale":"2023-08-01T19:54:04.471410+0000","last_undegraded":"2023-08-01T19:54:04.471410+0000","last_fullsized":"2023-08-01T19:54:04.471410+0000","mapping_epoch":16,"log_start":"0'0","ondisk_log_start":"0'0","created":16,"last_epoch_clean":17,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-08-01T19:54:04.040663+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-08-01T19:54:04.040663+0000","last_clean_scrub_stamp":"2023-08-01T19:54:04.040663+0000","objects_scrubbed":0,"log_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-08-03T01:00:18.725898+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[0,1],"acting":[0,1],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":0,"acting_primary":0,"purged_snaps":[]},{"pgid":"4.28","version":"0'0","reported_seq":9,"reported_epoch":17,"state":"active+clean","last_fresh":"2023-08-01T19:54:04.470337+0000","last_change":"2023-08-01T19:54:04.468160+0000","last_active":"2023-08-01T19:54:04.470337+0000","last_peered":"2023-08-01T19:54:04.470337+0000","last_clean":"2023-08-01T19:54:04.470337+0000","last_became_active":"2023-08-01T19:54:04.467625+0000","last_became_peered":"2023-08-01T19:54:04.467625+0000","last_unstale":"2023-08-01T19:54:04.470337+0000","last_undegraded":"2023-08-01T19:54:04.470337+0000","last_fullsized":"2023-08-01T19:54:04.470337+0000","mapping_epoch":16,"log_start":"0'0","ondisk_log_start":"0'0","created":16,"last_epoch_clean":17,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-08-01T19:54:04.040663+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-08-01T19:54:04.040663+0000","last_clean_scrub_stamp":"2023-08-01T19:54:04.040663+0000","objects_scrubbed":0,"log_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-08-02T21:27:52.506153+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[2,0],"acting":[2,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":2,"acting_primary":2,"purged_snaps":[]},{"pgid":"4.27","version":"0'0","reported_seq":9,"reported_epoch":17,"state":"active+clean","last_fresh":"2023-08-01T19:54:04.470777+0000","last_change":"2023-08-01T19:54:04.469187+0000","last_active":"2023-08-01T19:54:04.470777+0000","last_peered":"2023-08-01T19:54:04.470777+0000","last_clean":"2023-08-01T19:54:04.470777+0000","last_became_active":"2023-08-01T19:54:04.468628+0000","last_became_peered":"2023-08-01T19:54:04.468628+0000","last_unstale":"2023-08-01T19:54:04.470777+0000","last_undegraded":"2023-08-01T19:54:04.470777+0000","last_fullsized":"2023-08-01T19:54:04.470777+0000","mapping_epoch":16,"log_start":"0'0","ondisk_log_start":"0'0","created":16,"last_epoch_clean":17,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-08-01T19:54:04.040663+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-08-01T19:54:04.040663+0000","last_clean_scrub_stamp":"2023-08-01T19:54:04.040663+0000","objects_scrubbed":0,"log_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-08-03T00:07:29.565677+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[2,1],"acting":[2,1],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":2,"acting_primary":2,"purged_snaps":[]},{"pgid":"4.26","version":"0'0","reported_seq":9,"reported_epoch":17,"state":"active+clean","last_fresh":"2023-08-01T19:54:04.472976+0000","last_change":"2023-08-01T19:54:04.470942+0000","last_active":"2023-08-01T19:54:04.472976+0000","last_peered":"2023-08-01T19:54:04.472976+0000","last_clean":"2023-08-01T19:54:04.472976+0000","last_became_active":"2023-08-01T19:54:04.470564+0000","last_became_peered":"2023-08-01T19:54:04.470564+0000","last_unstale":"2023-08-01T19:54:04.472976+0000","last_undegraded":"2023-08-01T19:54:04.472976+0000","last_fullsized":"2023-08-01T19:54:04.472976+0000","mapping_epoch":16,"log_start":"0'0","ondisk_log_start":"0'0","created":16,"last_epoch_clean":17,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-08-01T19:54:04.040663+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-08-01T19:54:04.040663+0000","last_clean_scrub_stamp":"2023-08-01T19:54:04.040663+0000","objects_scrubbed":0,"log_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-08-03T04:43:21.408174+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[0,1],"acting":[0,1],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":0,"acting_primary":0,"purged_snaps":[]},{"pgid":"4.25","version":"0'0","reported_seq":9,"reported_epoch":17,"state":"active+clean","last_fresh":"2023-08-01T19:54:04.478117+0000","last_change":"2023-08-01T19:54:04.474813+0000","last_active":"2023-08-01T19:54:04.478117+0000","last_peered":"2023-08-01T19:54:04.478117+0000","last_clean":"2023-08-01T19:54:04.478117+0000","last_became_active":"2023-08-01T19:54:04.472530+0000","last_became_peered":"2023-08-01T19:54:04.472530+0000","last_unstale":"2023-08-01T19:54:04.478117+0000","last_undegraded":"2023-08-01T19:54:04.478117+0000","last_fullsized":"2023-08-01T19:54:04.478117+0000","mapping_epoch":16,"log_start":"0'0","ondisk_log_start":"0'0","created":16,"last_epoch_clean":17,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-08-01T19:54:04.040663+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-08-01T19:54:04.040663+0000","last_clean_scrub_stamp":"2023-08-01T19:54:04.040663+0000","objects_scrubbed":0,"log_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-08-03T01:00:18.725898+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[1,2],"acting":[1,2],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":1,"acting_primary":1,"purged_snaps":[]},{"pgid":"3.1a","version":"17'1","reported_seq":11,"reported_epoch":17,"state":"active+clean","last_fresh":"2023-08-01T19:54:04.473081+0000","last_change":"2023-08-01T19:54:04.063936+0000","last_active":"2023-08-01T19:54:04.473081+0000","last_peered":"2023-08-01T19:54:04.473081+0000","last_clean":"2023-08-01T19:54:04.473081+0000","last_became_active":"2023-08-01T19:54:04.063674+0000","last_became_peered":"2023-08-01T19:54:04.063674+0000","last_unstale":"2023-08-01T19:54:04.473081+0000","last_undegraded":"2023-08-01T19:54:04.473081+0000","last_fullsized":"2023-08-01T19:54:04.473081+0000","mapping_epoch":15,"log_start":"0'0","ondisk_log_start":"0'0","created":15,"last_epoch_clean":16,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-08-01T19:54:03.032665+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-08-01T19:54:03.032665+0000","last_clean_scrub_stamp":"2023-08-01T19:54:03.032665+0000","objects_scrubbed":0,"log_size":1,"ondisk_log_size":1,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-08-03T00:06:00.058200+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[2,0],"acting":[2,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":2,"acting_primary":2,"purged_snaps":[]},{"pgid":"4.1d","version":"0'0","reported_seq":9,"reported_epoch":17,"state":"active+clean","last_fresh":"2023-08-01T19:54:04.474051+0000","last_change":"2023-08-01T19:54:04.471916+0000","last_active":"2023-08-01T19:54:04.474051+0000","last_peered":"2023-08-01T19:54:04.474051+0000","last_clean":"2023-08-01T19:54:04.474051+0000","last_became_active":"2023-08-01T19:54:04.471480+0000","last_became_peered":"2023-08-01T19:54:04.471480+0000","last_unstale":"2023-08-01T19:54:04.474051+0000","last_undegraded":"2023-08-01T19:54:04.474051+0000","last_fullsized":"2023-08-01T19:54:04.474051+0000","mapping_epoch":16,"log_start":"0'0","ondisk_log_start":"0'0","created":16,"last_epoch_clean":17,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-08-01T19:54:04.040663+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-08-01T19:54:04.040663+0000","last_clean_scrub_stamp":"2023-08-01T19:54:04.040663+0000","objects_scrubbed":0,"log_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-08-02T21:19:17.547590+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[2,1],"acting":[2,1],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":2,"acting_primary":2,"purged_snaps":[]},{"pgid":"3.19","version":"0'0","reported_seq":10,"reported_epoch":17,"state":"active+clean","last_fresh":"2023-08-01T19:54:04.458649+0000","last_change":"2023-08-01T19:54:04.067837+0000","last_active":"2023-08-01T19:54:04.458649+0000","last_peered":"2023-08-01T19:54:04.458649+0000","last_clean":"2023-08-01T19:54:04.458649+0000","last_became_active":"2023-08-01T19:54:04.067535+0000","last_became_peered":"2023-08-01T19:54:04.067535+0000","last_unstale":"2023-08-01T19:54:04.458649+0000","last_undegraded":"2023-08-01T19:54:04.458649+0000","last_fullsized":"2023-08-01T19:54:04.458649+0000","mapping_epoch":15,"log_start":"0'0","ondisk_log_start":"0'0","created":15,"last_epoch_clean":16,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-08-01T19:54:03.032665+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-08-01T19:54:03.032665+0000","last_clean_scrub_stamp":"2023-08-01T19:54:03.032665+0000","objects_scrubbed":0,"log_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-08-02T20:56:47.324761+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[0,1],"acting":[0,1],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":0,"acting_primary":0,"purged_snaps":[]},{"pgid":"4.1e","version":"0'0","reported_seq":9,"reported_epoch":17,"state":"active+clean","last_fresh":"2023-08-01T19:54:04.472940+0000","last_change":"2023-08-01T19:54:04.470544+0000","last_active":"2023-08-01T19:54:04.472940+0000","last_peered":"2023-08-01T19:54:04.472940+0000","last_clean":"2023-08-01T19:54:04.472940+0000","last_became_active":"2023-08-01T19:54:04.469657+0000","last_became_peered":"2023-08-01T19:54:04.469657+0000","last_unstale":"2023-08-01T19:54:04.472940+0000","last_undegraded":"2023-08-01T19:54:04.472940+0000","last_fullsized":"2023-08-01T19:54:04.472940+0000","mapping_epoch":16,"log_start":"0'0","ondisk_log_start":"0'0","created":16,"last_epoch_clean":17,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-08-01T19:54:04.040663+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-08-01T19:54:04.040663+0000","last_clean_scrub_stamp":"2023-08-01T19:54:04.040663+0000","objects_scrubbed":0,"log_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-08-02T23:12:30.830199+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[0,1],"acting":[0,1],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":0,"acting_primary":0,"purged_snaps":[]},{"pgid":"3.18","version":"0'0","reported_seq":10,"reported_epoch":17,"state":"active+clean","last_fresh":"2023-08-01T19:54:04.458389+0000","last_change":"2023-08-01T19:54:04.064289+0000","last_active":"2023-08-01T19:54:04.458389+0000","last_peered":"2023-08-01T19:54:04.458389+0000","last_clean":"2023-08-01T19:54:04.458389+0000","last_became_active":"2023-08-01T19:54:04.063971+0000","last_became_peered":"2023-08-01T19:54:04.063971+0000","last_unstale":"2023-08-01T19:54:04.458389+0000","last_undegraded":"2023-08-01T19:54:04.458389+0000","last_fullsized":"2023-08-01T19:54:04.458389+0000","mapping_epoch":15,"log_start":"0'0","ondisk_log_start":"0'0","created":15,"last_epoch_clean":16,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-08-01T19:54:03.032665+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-08-01T19:54:03.032665+0000","last_clean_scrub_stamp":"2023-08-01T19:54:03.032665+0000","objects_scrubbed":0,"log_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-08-03T04:09:30.496098+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[0,2],"acting":[0,2],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":0,"acting_primary":0,"purged_snaps":[]},{"pgid":"4.1f","version":"0'0","reported_seq":9,"reported_epoch":17,"state":"active+clean","last_fresh":"2023-08-01T19:54:04.474406+0000","last_change":"2023-08-01T19:54:04.472227+0000","last_active":"2023-08-01T19:54:04.474406+0000","last_peered":"2023-08-01T19:54:04.474406+0000","last_clean":"2023-08-01T19:54:04.474406+0000","last_became_active":"2023-08-01T19:54:04.471767+0000","last_became_peered":"2023-08-01T19:54:04.471767+0000","last_unstale":"2023-08-01T19:54:04.474406+0000","last_undegraded":"2023-08-01T19:54:04.474406+0000","last_fullsized":"2023-08-01T19:54:04.474406+0000","mapping_epoch":16,"log_start":"0'0","ondisk_log_start":"0'0","created":16,"last_epoch_clean":17,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-08-01T19:54:04.040663+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-08-01T19:54:04.040663+0000","last_clean_scrub_stamp":"2023-08-01T19:54:04.040663+0000","objects_scrubbed":0,"log_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-08-02T20:25:25.280329+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[2,1],"acting":[2,1],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":2,"acting_primary":2,"purged_snaps":[]},{"pgid":"3.17","version":"0'0","reported_seq":10,"reported_epoch":17,"state":"active+clean","last_fresh":"2023-08-01T19:54:04.462845+0000","last_change":"2023-08-01T19:54:04.067975+0000","last_active":"2023-08-01T19:54:04.462845+0000","last_peered":"2023-08-01T19:54:04.462845+0000","last_clean":"2023-08-01T19:54:04.462845+0000","last_became_active":"2023-08-01T19:54:04.067577+0000","last_became_peered":"2023-08-01T19:54:04.067577+0000","last_unstale":"2023-08-01T19:54:04.462845+0000","last_undegraded":"2023-08-01T19:54:04.462845+0000","last_fullsized":"2023-08-01T19:54:04.462845+0000","mapping_epoch":15,"log_start":"0'0","ondisk_log_start":"0'0","created":15,"last_epoch_clean":16,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-08-01T19:54:03.032665+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-08-01T19:54:03.032665+0000","last_clean_scrub_stamp":"2023-08-01T19:54:03.032665+0000","objects_scrubbed":0,"log_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-08-03T07:13:34.025722+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[0,1],"acting":[0,1],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":0,"acting_primary":0,"purged_snaps":[]},{"pgid":"4.10","version":"0'0","reported_seq":9,"reported_epoch":17,"state":"active+clean","last_fresh":"2023-08-01T19:54:04.472075+0000","last_change":"2023-08-01T19:54:04.467146+0000","last_active":"2023-08-01T19:54:04.472075+0000","last_peered":"2023-08-01T19:54:04.472075+0000","last_clean":"2023-08-01T19:54:04.472075+0000","last_became_active":"2023-08-01T19:54:04.466627+0000","last_became_peered":"2023-08-01T19:54:04.466627+0000","last_unstale":"2023-08-01T19:54:04.472075+0000","last_undegraded":"2023-08-01T19:54:04.472075+0000","last_fullsized":"2023-08-01T19:54:04.472075+0000","mapping_epoch":16,"log_start":"0'0","ondisk_log_start":"0'0","created":16,"last_epoch_clean":17,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-08-01T19:54:04.040663+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-08-01T19:54:04.040663+0000","last_clean_scrub_stamp":"2023-08-01T19:54:04.040663+0000","objects_scrubbed":0,"log_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-08-03T04:43:26.793480+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[0,2],"acting":[0,2],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":0,"acting_primary":0,"purged_snaps":[]},{"pgid":"3.16","version":"0'0","reported_seq":10,"reported_epoch":17,"state":"active+clean","last_fresh":"2023-08-01T19:54:04.468390+0000","last_change":"2023-08-01T19:54:04.065042+0000","last_active":"2023-08-01T19:54:04.468390+0000","last_peered":"2023-08-01T19:54:04.468390+0000","last_clean":"2023-08-01T19:54:04.468390+0000","last_became_active":"2023-08-01T19:54:04.064040+0000","last_became_peered":"2023-08-01T19:54:04.064040+0000","last_unstale":"2023-08-01T19:54:04.468390+0000","last_undegraded":"2023-08-01T19:54:04.468390+0000","last_fullsized":"2023-08-01T19:54:04.468390+0000","mapping_epoch":15,"log_start":"0'0","ondisk_log_start":"0'0","created":15,"last_epoch_clean":16,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-08-01T19:54:03.032665+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-08-01T19:54:03.032665+0000","last_clean_scrub_stamp":"2023-08-01T19:54:03.032665+0000","objects_scrubbed":0,"log_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-08-03T03:40:43.460182+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[1,0],"acting":[1,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":1,"acting_primary":1,"purged_snaps":[]},{"pgid":"4.11","version":"0'0","reported_seq":9,"reported_epoch":17,"state":"active+clean","last_fresh":"2023-08-01T19:54:04.472823+0000","last_change":"2023-08-01T19:54:04.470401+0000","last_active":"2023-08-01T19:54:04.472823+0000","last_peered":"2023-08-01T19:54:04.472823+0000","last_clean":"2023-08-01T19:54:04.472823+0000","last_became_active":"2023-08-01T19:54:04.469680+0000","last_became_peered":"2023-08-01T19:54:04.469680+0000","last_unstale":"2023-08-01T19:54:04.472823+0000","last_undegraded":"2023-08-01T19:54:04.472823+0000","last_fullsized":"2023-08-01T19:54:04.472823+0000","mapping_epoch":16,"log_start":"0'0","ondisk_log_start":"0'0","created":16,"last_epoch_clean":17,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-08-01T19:54:04.040663+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-08-01T19:54:04.040663+0000","last_clean_scrub_stamp":"2023-08-01T19:54:04.040663+0000","objects_scrubbed":0,"log_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-08-03T03:58:06.360840+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[0,1],"acting":[0,1],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":0,"acting_primary":0,"purged_snaps":[]},{"pgid":"3.15","version":"17'3","reported_seq":13,"reported_epoch":17,"state":"active+clean","last_fresh":"2023-08-01T19:54:04.471749+0000","last_change":"2023-08-01T19:54:04.065443+0000","last_active":"2023-08-01T19:54:04.471749+0000","last_peered":"2023-08-01T19:54:04.471749+0000","last_clean":"2023-08-01T19:54:04.471749+0000","last_became_active":"2023-08-01T19:54:04.065112+0000","last_became_peered":"2023-08-01T19:54:04.065112+0000","last_unstale":"2023-08-01T19:54:04.471749+0000","last_undegraded":"2023-08-01T19:54:04.471749+0000","last_fullsized":"2023-08-01T19:54:04.471749+0000","mapping_epoch":15,"log_start":"0'0","ondisk_log_start":"0'0","created":15,"last_epoch_clean":16,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-08-01T19:54:03.032665+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-08-01T19:54:03.032665+0000","last_clean_scrub_stamp":"2023-08-01T19:54:03.032665+0000","objects_scrubbed":0,"log_size":3,"ondisk_log_size":3,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-08-03T03:27:50.887004+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":90,"num_objects":2,"num_object_clones":0,"num_object_copies":4,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":2,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":4,"num_write_kb":1,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":1,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[2,1],"acting":[2,1],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":2,"acting_primary":2,"purged_snaps":[]},{"pgid":"4.12","version":"0'0","reported_seq":9,"reported_epoch":17,"state":"active+clean","last_fresh":"2023-08-01T19:54:04.471952+0000","last_change":"2023-08-01T19:54:04.467822+0000","last_active":"2023-08-01T19:54:04.471952+0000","last_peered":"2023-08-01T19:54:04.471952+0000","last_clean":"2023-08-01T19:54:04.471952+0000","last_became_active":"2023-08-01T19:54:04.466667+0000","last_became_peered":"2023-08-01T19:54:04.466667+0000","last_unstale":"2023-08-01T19:54:04.471952+0000","last_undegraded":"2023-08-01T19:54:04.471952+0000","last_fullsized":"2023-08-01T19:54:04.471952+0000","mapping_epoch":16,"log_start":"0'0","ondisk_log_start":"0'0","created":16,"last_epoch_clean":17,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-08-01T19:54:04.040663+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-08-01T19:54:04.040663+0000","last_clean_scrub_stamp":"2023-08-01T19:54:04.040663+0000","objects_scrubbed":0,"log_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-08-03T02:57:18.148077+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[0,2],"acting":[0,2],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":0,"acting_primary":0,"purged_snaps":[]},{"pgid":"3.14","version":"17'6","reported_seq":16,"reported_epoch":17,"state":"active+clean","last_fresh":"2023-08-01T19:54:04.485855+0000","last_change":"2023-08-01T19:54:04.061419+0000","last_active":"2023-08-01T19:54:04.485855+0000","last_peered":"2023-08-01T19:54:04.485855+0000","last_clean":"2023-08-01T19:54:04.485855+0000","last_became_active":"2023-08-01T19:54:04.061078+0000","last_became_peered":"2023-08-01T19:54:04.061078+0000","last_unstale":"2023-08-01T19:54:04.485855+0000","last_undegraded":"2023-08-01T19:54:04.485855+0000","last_fullsized":"2023-08-01T19:54:04.485855+0000","mapping_epoch":15,"log_start":"0'0","ondisk_log_start":"0'0","created":15,"last_epoch_clean":16,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-08-01T19:54:03.032665+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-08-01T19:54:03.032665+0000","last_clean_scrub_stamp":"2023-08-01T19:54:03.032665+0000","objects_scrubbed":0,"log_size":6,"ondisk_log_size":6,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-08-02T21:35:44.874727+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":1536,"num_objects":4,"num_object_clones":0,"num_object_copies":8,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":4,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":6,"num_write_kb":3,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":1,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[1,2],"acting":[1,2],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":1,"acting_primary":1,"purged_snaps":[]},{"pgid":"4.13","version":"0'0","reported_seq":9,"reported_epoch":17,"state":"active+clean","last_fresh":"2023-08-01T19:54:04.471426+0000","last_change":"2023-08-01T19:54:04.466400+0000","last_active":"2023-08-01T19:54:04.471426+0000","last_peered":"2023-08-01T19:54:04.471426+0000","last_clean":"2023-08-01T19:54:04.471426+0000","last_became_active":"2023-08-01T19:54:04.465979+0000","last_became_peered":"2023-08-01T19:54:04.465979+0000","last_unstale":"2023-08-01T19:54:04.471426+0000","last_undegraded":"2023-08-01T19:54:04.471426+0000","last_fullsized":"2023-08-01T19:54:04.471426+0000","mapping_epoch":16,"log_start":"0'0","ondisk_log_start":"0'0","created":16,"last_epoch_clean":17,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-08-01T19:54:04.040663+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-08-01T19:54:04.040663+0000","last_clean_scrub_stamp":"2023-08-01T19:54:04.040663+0000","objects_scrubbed":0,"log_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-08-02T20:20:59.989030+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[1,2],"acting":[1,2],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":1,"acting_primary":1,"purged_snaps":[]},{"pgid":"3.13","version":"17'2","reported_seq":12,"reported_epoch":17,"state":"active+clean","last_fresh":"2023-08-01T19:54:04.476009+0000","last_change":"2023-08-01T19:54:04.065212+0000","last_active":"2023-08-01T19:54:04.476009+0000","last_peered":"2023-08-01T19:54:04.476009+0000","last_clean":"2023-08-01T19:54:04.476009+0000","last_became_active":"2023-08-01T19:54:04.064375+0000","last_became_peered":"2023-08-01T19:54:04.064375+0000","last_unstale":"2023-08-01T19:54:04.476009+0000","last_undegraded":"2023-08-01T19:54:04.476009+0000","last_fullsized":"2023-08-01T19:54:04.476009+0000","mapping_epoch":15,"log_start":"0'0","ondisk_log_start":"0'0","created":15,"last_epoch_clean":16,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-08-01T19:54:03.032665+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-08-01T19:54:03.032665+0000","last_clean_scrub_stamp":"2023-08-01T19:54:03.032665+0000","objects_scrubbed":0,"log_size":2,"ondisk_log_size":2,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-08-03T06:17:37.910752+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":34,"num_objects":2,"num_object_clones":0,"num_object_copies":4,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":2,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":3,"num_write_kb":6,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":1,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[1,0],"acting":[1,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":1,"acting_primary":1,"purged_snaps":[]},{"pgid":"4.14","version":"0'0","reported_seq":9,"reported_epoch":17,"state":"active+clean","last_fresh":"2023-08-01T19:54:04.465917+0000","last_change":"2023-08-01T19:54:04.464446+0000","last_active":"2023-08-01T19:54:04.465917+0000","last_peered":"2023-08-01T19:54:04.465917+0000","last_clean":"2023-08-01T19:54:04.465917+0000","last_became_active":"2023-08-01T19:54:04.464021+0000","last_became_peered":"2023-08-01T19:54:04.464021+0000","last_unstale":"2023-08-01T19:54:04.465917+0000","last_undegraded":"2023-08-01T19:54:04.465917+0000","last_fullsized":"2023-08-01T19:54:04.465917+0000","mapping_epoch":16,"log_start":"0'0","ondisk_log_start":"0'0","created":16,"last_epoch_clean":17,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-08-01T19:54:04.040663+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-08-01T19:54:04.040663+0000","last_clean_scrub_stamp":"2023-08-01T19:54:04.040663+0000","objects_scrubbed":0,"log_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-08-02T20:26:51.080849+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[2,0],"acting":[2,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":2,"acting_primary":2,"purged_snaps":[]},{"pgid":"3.12","version":"0'0","reported_seq":10,"reported_epoch":17,"state":"active+clean","last_fresh":"2023-08-01T19:54:04.458866+0000","last_change":"2023-08-01T19:54:04.066566+0000","last_active":"2023-08-01T19:54:04.458866+0000","last_peered":"2023-08-01T19:54:04.458866+0000","last_clean":"2023-08-01T19:54:04.458866+0000","last_became_active":"2023-08-01T19:54:04.066190+0000","last_became_peered":"2023-08-01T19:54:04.066190+0000","last_unstale":"2023-08-01T19:54:04.458866+0000","last_undegraded":"2023-08-01T19:54:04.458866+0000","last_fullsized":"2023-08-01T19:54:04.458866+0000","mapping_epoch":15,"log_start":"0'0","ondisk_log_start":"0'0","created":15,"last_epoch_clean":16,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-08-01T19:54:03.032665+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-08-01T19:54:03.032665+0000","last_clean_scrub_stamp":"2023-08-01T19:54:03.032665+0000","objects_scrubbed":0,"log_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-08-03T02:01:47.073630+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[0,1],"acting":[0,1],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":0,"acting_primary":0,"purged_snaps":[]},{"pgid":"4.15","version":"0'0","reported_seq":9,"reported_epoch":17,"state":"active+clean","last_fresh":"2023-08-01T19:54:04.470734+0000","last_change":"2023-08-01T19:54:04.468791+0000","last_active":"2023-08-01T19:54:04.470734+0000","last_peered":"2023-08-01T19:54:04.470734+0000","last_clean":"2023-08-01T19:54:04.470734+0000","last_became_active":"2023-08-01T19:54:04.468214+0000","last_became_peered":"2023-08-01T19:54:04.468214+0000","last_unstale":"2023-08-01T19:54:04.470734+0000","last_undegraded":"2023-08-01T19:54:04.470734+0000","last_fullsized":"2023-08-01T19:54:04.470734+0000","mapping_epoch":16,"log_start":"0'0","ondisk_log_start":"0'0","created":16,"last_epoch_clean":17,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-08-01T19:54:04.040663+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-08-01T19:54:04.040663+0000","last_clean_scrub_stamp":"2023-08-01T19:54:04.040663+0000","objects_scrubbed":0,"log_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-08-03T04:10:44.729287+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[2,0],"acting":[2,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":2,"acting_primary":2,"purged_snaps":[]},{"pgid":"3.11","version":"0'0","reported_seq":10,"reported_epoch":17,"state":"active+clean","last_fresh":"2023-08-01T19:54:04.457924+0000","last_change":"2023-08-01T19:54:04.064280+0000","last_active":"2023-08-01T19:54:04.457924+0000","last_peered":"2023-08-01T19:54:04.457924+0000","last_clean":"2023-08-01T19:54:04.457924+0000","last_became_active":"2023-08-01T19:54:04.064064+0000","last_became_peered":"2023-08-01T19:54:04.064064+0000","last_unstale":"2023-08-01T19:54:04.457924+0000","last_undegraded":"2023-08-01T19:54:04.457924+0000","last_fullsized":"2023-08-01T19:54:04.457924+0000","mapping_epoch":15,"log_start":"0'0","ondisk_log_start":"0'0","created":15,"last_epoch_clean":16,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-08-01T19:54:03.032665+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-08-01T19:54:03.032665+0000","last_clean_scrub_stamp":"2023-08-01T19:54:03.032665+0000","objects_scrubbed":0,"log_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-08-03T06:13:51.475710+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[2,1],"acting":[2,1],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":2,"acting_primary":2,"purged_snaps":[]},{"pgid":"4.16","version":"0'0","reported_seq":9,"reported_epoch":17,"state":"active+clean","last_fresh":"2023-08-01T19:54:04.472609+0000","last_change":"2023-08-01T19:54:04.469724+0000","last_active":"2023-08-01T19:54:04.472609+0000","last_peered":"2023-08-01T19:54:04.472609+0000","last_clean":"2023-08-01T19:54:04.472609+0000","last_became_active":"2023-08-01T19:54:04.469275+0000","last_became_peered":"2023-08-01T19:54:04.469275+0000","last_unstale":"2023-08-01T19:54:04.472609+0000","last_undegraded":"2023-08-01T19:54:04.472609+0000","last_fullsized":"2023-08-01T19:54:04.472609+0000","mapping_epoch":16,"log_start":"0'0","ondisk_log_start":"0'0","created":16,"last_epoch_clean":17,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-08-01T19:54:04.040663+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-08-01T19:54:04.040663+0000","last_clean_scrub_stamp":"2023-08-01T19:54:04.040663+0000","objects_scrubbed":0,"log_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-08-03T03:04:06.137335+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[0,1],"acting":[0,1],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":0,"acting_primary":0,"purged_snaps":[]},{"pgid":"3.10","version":"17'8","reported_seq":18,"reported_epoch":17,"state":"active+clean","last_fresh":"2023-08-01T19:54:04.480319+0000","last_change":"2023-08-01T19:54:04.060962+0000","last_active":"2023-08-01T19:54:04.480319+0000","last_peered":"2023-08-01T19:54:04.480319+0000","last_clean":"2023-08-01T19:54:04.480319+0000","last_became_active":"2023-08-01T19:54:04.060576+0000","last_became_peered":"2023-08-01T19:54:04.060576+0000","last_unstale":"2023-08-01T19:54:04.480319+0000","last_undegraded":"2023-08-01T19:54:04.480319+0000","last_fullsized":"2023-08-01T19:54:04.480319+0000","mapping_epoch":15,"log_start":"0'0","ondisk_log_start":"0'0","created":15,"last_epoch_clean":16,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-08-01T19:54:03.032665+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-08-01T19:54:03.032665+0000","last_clean_scrub_stamp":"2023-08-01T19:54:03.032665+0000","objects_scrubbed":0,"log_size":8,"ondisk_log_size":8,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-08-03T05:00:51.171444+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":4,"num_object_clones":0,"num_object_copies":8,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":4,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":12,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":4,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[1,2],"acting":[1,2],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":1,"acting_primary":1,"purged_snaps":[]},{"pgid":"4.17","version":"0'0","reported_seq":9,"reported_epoch":17,"state":"active+clean","last_fresh":"2023-08-01T19:54:04.473595+0000","last_change":"2023-08-01T19:54:04.472721+0000","last_active":"2023-08-01T19:54:04.473595+0000","last_peered":"2023-08-01T19:54:04.473595+0000","last_clean":"2023-08-01T19:54:04.473595+0000","last_became_active":"2023-08-01T19:54:04.472126+0000","last_became_peered":"2023-08-01T19:54:04.472126+0000","last_unstale":"2023-08-01T19:54:04.473595+0000","last_undegraded":"2023-08-01T19:54:04.473595+0000","last_fullsized":"2023-08-01T19:54:04.473595+0000","mapping_epoch":16,"log_start":"0'0","ondisk_log_start":"0'0","created":16,"last_epoch_clean":17,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-08-01T19:54:04.040663+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-08-01T19:54:04.040663+0000","last_clean_scrub_stamp":"2023-08-01T19:54:04.040663+0000","objects_scrubbed":0,"log_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-08-03T00:29:05.857138+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[0,1],"acting":[0,1],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":0,"acting_primary":0,"purged_snaps":[]},{"pgid":"3.f","version":"17'1","reported_seq":11,"reported_epoch":17,"state":"active+clean","last_fresh":"2023-08-01T19:54:04.476116+0000","last_change":"2023-08-01T19:54:04.060797+0000","last_active":"2023-08-01T19:54:04.476116+0000","last_peered":"2023-08-01T19:54:04.476116+0000","last_clean":"2023-08-01T19:54:04.476116+0000","last_became_active":"2023-08-01T19:54:04.060444+0000","last_became_peered":"2023-08-01T19:54:04.060444+0000","last_unstale":"2023-08-01T19:54:04.476116+0000","last_undegraded":"2023-08-01T19:54:04.476116+0000","last_fullsized":"2023-08-01T19:54:04.476116+0000","mapping_epoch":15,"log_start":"0'0","ondisk_log_start":"0'0","created":15,"last_epoch_clean":16,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-08-01T19:54:03.032665+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-08-01T19:54:03.032665+0000","last_clean_scrub_stamp":"2023-08-01T19:54:03.032665+0000","objects_scrubbed":0,"log_size":1,"ondisk_log_size":1,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-08-03T07:13:34.025722+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":22,"num_objects":1,"num_object_clones":0,"num_object_copies":2,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":1,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":1,"num_write_kb":1,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[1,2],"acting":[1,2],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":1,"acting_primary":1,"purged_snaps":[]},{"pgid":"4.8","version":"0'0","reported_seq":9,"reported_epoch":17,"state":"active+clean","last_fresh":"2023-08-01T19:54:04.470264+0000","last_change":"2023-08-01T19:54:04.467671+0000","last_active":"2023-08-01T19:54:04.470264+0000","last_peered":"2023-08-01T19:54:04.470264+0000","last_clean":"2023-08-01T19:54:04.470264+0000","last_became_active":"2023-08-01T19:54:04.467300+0000","last_became_peered":"2023-08-01T19:54:04.467300+0000","last_unstale":"2023-08-01T19:54:04.470264+0000","last_undegraded":"2023-08-01T19:54:04.470264+0000","last_fullsized":"2023-08-01T19:54:04.470264+0000","mapping_epoch":16,"log_start":"0'0","ondisk_log_start":"0'0","created":16,"last_epoch_clean":17,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-08-01T19:54:04.040663+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-08-01T19:54:04.040663+0000","last_clean_scrub_stamp":"2023-08-01T19:54:04.040663+0000","objects_scrubbed":0,"log_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-08-03T05:27:24.774345+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[2,1],"acting":[2,1],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":2,"acting_primary":2,"purged_snaps":[]},{"pgid":"3.e","version":"17'2","reported_seq":12,"reported_epoch":17,"state":"active+clean","last_fresh":"2023-08-01T19:54:04.471249+0000","last_change":"2023-08-01T19:54:04.065595+0000","last_active":"2023-08-01T19:54:04.471249+0000","last_peered":"2023-08-01T19:54:04.471249+0000","last_clean":"2023-08-01T19:54:04.471249+0000","last_became_active":"2023-08-01T19:54:04.065303+0000","last_became_peered":"2023-08-01T19:54:04.065303+0000","last_unstale":"2023-08-01T19:54:04.471249+0000","last_undegraded":"2023-08-01T19:54:04.471249+0000","last_fullsized":"2023-08-01T19:54:04.471249+0000","mapping_epoch":15,"log_start":"0'0","ondisk_log_start":"0'0","created":15,"last_epoch_clean":16,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-08-01T19:54:03.032665+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-08-01T19:54:03.032665+0000","last_clean_scrub_stamp":"2023-08-01T19:54:03.032665+0000","objects_scrubbed":0,"log_size":2,"ondisk_log_size":2,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-08-02T22:40:38.782053+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":1,"num_object_clones":0,"num_object_copies":2,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":1,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":3,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":1,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[2,1],"acting":[2,1],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":2,"acting_primary":2,"purged_snaps":[]},{"pgid":"4.9","version":"0'0","reported_seq":9,"reported_epoch":17,"state":"active+clean","last_fresh":"2023-08-01T19:54:04.470284+0000","last_change":"2023-08-01T19:54:04.468007+0000","last_active":"2023-08-01T19:54:04.470284+0000","last_peered":"2023-08-01T19:54:04.470284+0000","last_clean":"2023-08-01T19:54:04.470284+0000","last_became_active":"2023-08-01T19:54:04.467509+0000","last_became_peered":"2023-08-01T19:54:04.467509+0000","last_unstale":"2023-08-01T19:54:04.470284+0000","last_undegraded":"2023-08-01T19:54:04.470284+0000","last_fullsized":"2023-08-01T19:54:04.470284+0000","mapping_epoch":16,"log_start":"0'0","ondisk_log_start":"0'0","created":16,"last_epoch_clean":17,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-08-01T19:54:04.040663+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-08-01T19:54:04.040663+0000","last_clean_scrub_stamp":"2023-08-01T19:54:04.040663+0000","objects_scrubbed":0,"log_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-08-03T06:04:50.963711+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[2,0],"acting":[2,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":2,"acting_primary":2,"purged_snaps":[]},{"pgid":"3.d","version":"17'1","reported_seq":11,"reported_epoch":17,"state":"active+clean","last_fresh":"2023-08-01T19:54:04.475997+0000","last_change":"2023-08-01T19:54:04.062853+0000","last_active":"2023-08-01T19:54:04.475997+0000","last_peered":"2023-08-01T19:54:04.475997+0000","last_clean":"2023-08-01T19:54:04.475997+0000","last_became_active":"2023-08-01T19:54:04.062598+0000","last_became_peered":"2023-08-01T19:54:04.062598+0000","last_unstale":"2023-08-01T19:54:04.475997+0000","last_undegraded":"2023-08-01T19:54:04.475997+0000","last_fullsized":"2023-08-01T19:54:04.475997+0000","mapping_epoch":15,"log_start":"0'0","ondisk_log_start":"0'0","created":15,"last_epoch_clean":16,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-08-01T19:54:03.032665+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-08-01T19:54:03.032665+0000","last_clean_scrub_stamp":"2023-08-01T19:54:03.032665+0000","objects_scrubbed":0,"log_size":1,"ondisk_log_size":1,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-08-02T20:56:47.324761+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":70,"num_objects":1,"num_object_clones":0,"num_object_copies":2,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":1,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":1,"num_write_kb":1,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[1,2],"acting":[1,2],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":1,"acting_primary":1,"purged_snaps":[]},{"pgid":"4.a","version":"0'0","reported_seq":9,"reported_epoch":17,"state":"active+clean","last_fresh":"2023-08-01T19:54:04.476248+0000","last_change":"2023-08-01T19:54:04.471997+0000","last_active":"2023-08-01T19:54:04.476248+0000","last_peered":"2023-08-01T19:54:04.476248+0000","last_clean":"2023-08-01T19:54:04.476248+0000","last_became_active":"2023-08-01T19:54:04.471204+0000","last_became_peered":"2023-08-01T19:54:04.471204+0000","last_unstale":"2023-08-01T19:54:04.476248+0000","last_undegraded":"2023-08-01T19:54:04.476248+0000","last_fullsized":"2023-08-01T19:54:04.476248+0000","mapping_epoch":16,"log_start":"0'0","ondisk_log_start":"0'0","created":16,"last_epoch_clean":17,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-08-01T19:54:04.040663+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-08-01T19:54:04.040663+0000","last_clean_scrub_stamp":"2023-08-01T19:54:04.040663+0000","objects_scrubbed":0,"log_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-08-02T23:12:30.830199+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[1,0],"acting":[1,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":1,"acting_primary":1,"purged_snaps":[]},{"pgid":"3.c","version":"0'0","reported_seq":10,"reported_epoch":17,"state":"active+clean","last_fresh":"2023-08-01T19:54:04.467464+0000","last_change":"2023-08-01T19:54:04.063532+0000","last_active":"2023-08-01T19:54:04.467464+0000","last_peered":"2023-08-01T19:54:04.467464+0000","last_clean":"2023-08-01T19:54:04.467464+0000","last_became_active":"2023-08-01T19:54:04.063116+0000","last_became_peered":"2023-08-01T19:54:04.063116+0000","last_unstale":"2023-08-01T19:54:04.467464+0000","last_undegraded":"2023-08-01T19:54:04.467464+0000","last_fullsized":"2023-08-01T19:54:04.467464+0000","mapping_epoch":15,"log_start":"0'0","ondisk_log_start":"0'0","created":15,"last_epoch_clean":16,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-08-01T19:54:03.032665+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-08-01T19:54:03.032665+0000","last_clean_scrub_stamp":"2023-08-01T19:54:03.032665+0000","objects_scrubbed":0,"log_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-08-02T22:28:51.936138+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[1,0],"acting":[1,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":1,"acting_primary":1,"purged_snaps":[]},{"pgid":"4.b","version":"0'0","reported_seq":9,"reported_epoch":17,"state":"active+clean","last_fresh":"2023-08-01T19:54:04.472955+0000","last_change":"2023-08-01T19:54:04.470787+0000","last_active":"2023-08-01T19:54:04.472955+0000","last_peered":"2023-08-01T19:54:04.472955+0000","last_clean":"2023-08-01T19:54:04.472955+0000","last_became_active":"2023-08-01T19:54:04.470332+0000","last_became_peered":"2023-08-01T19:54:04.470332+0000","last_unstale":"2023-08-01T19:54:04.472955+0000","last_undegraded":"2023-08-01T19:54:04.472955+0000","last_fullsized":"2023-08-01T19:54:04.472955+0000","mapping_epoch":16,"log_start":"0'0","ondisk_log_start":"0'0","created":16,"last_epoch_clean":17,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-08-01T19:54:04.040663+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-08-01T19:54:04.040663+0000","last_clean_scrub_stamp":"2023-08-01T19:54:04.040663+0000","objects_scrubbed":0,"log_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-08-03T05:13:38.298401+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[0,1],"acting":[0,1],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":0,"acting_primary":0,"purged_snaps":[]},{"pgid":"3.b","version":"17'2","reported_seq":12,"reported_epoch":17,"state":"active+clean","last_fresh":"2023-08-01T19:54:04.472965+0000","last_change":"2023-08-01T19:54:04.066839+0000","last_active":"2023-08-01T19:54:04.472965+0000","last_peered":"2023-08-01T19:54:04.472965+0000","last_clean":"2023-08-01T19:54:04.472965+0000","last_became_active":"2023-08-01T19:54:04.065535+0000","last_became_peered":"2023-08-01T19:54:04.065535+0000","last_unstale":"2023-08-01T19:54:04.472965+0000","last_undegraded":"2023-08-01T19:54:04.472965+0000","last_fullsized":"2023-08-01T19:54:04.472965+0000","mapping_epoch":15,"log_start":"0'0","ondisk_log_start":"0'0","created":15,"last_epoch_clean":16,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-08-01T19:54:03.032665+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-08-01T19:54:03.032665+0000","last_clean_scrub_stamp":"2023-08-01T19:54:03.032665+0000","objects_scrubbed":0,"log_size":2,"ondisk_log_size":2,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-08-03T05:00:51.171444+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":1,"num_object_clones":0,"num_object_copies":2,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":1,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":1,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":1,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[0,1],"acting":[0,1],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":0,"acting_primary":0,"purged_snaps":[]},{"pgid":"4.c","version":"0'0","reported_seq":9,"reported_epoch":17,"state":"active+clean","last_fresh":"2023-08-01T19:54:04.481357+0000","last_change":"2023-08-01T19:54:04.478715+0000","last_active":"2023-08-01T19:54:04.481357+0000","last_peered":"2023-08-01T19:54:04.481357+0000","last_clean":"2023-08-01T19:54:04.481357+0000","last_became_active":"2023-08-01T19:54:04.477435+0000","last_became_peered":"2023-08-01T19:54:04.477435+0000","last_unstale":"2023-08-01T19:54:04.481357+0000","last_undegraded":"2023-08-01T19:54:04.481357+0000","last_fullsized":"2023-08-01T19:54:04.481357+0000","mapping_epoch":16,"log_start":"0'0","ondisk_log_start":"0'0","created":16,"last_epoch_clean":17,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-08-01T19:54:04.040663+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-08-01T19:54:04.040663+0000","last_clean_scrub_stamp":"2023-08-01T19:54:04.040663+0000","objects_scrubbed":0,"log_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-08-03T04:43:21.408174+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[1,0],"acting":[1,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":1,"acting_primary":1,"purged_snaps":[]},{"pgid":"3.a","version":"0'0","reported_seq":10,"reported_epoch":17,"state":"active+clean","last_fresh":"2023-08-01T19:54:04.466981+0000","last_change":"2023-08-01T19:54:04.065267+0000","last_active":"2023-08-01T19:54:04.466981+0000","last_peered":"2023-08-01T19:54:04.466981+0000","last_clean":"2023-08-01T19:54:04.466981+0000","last_became_active":"2023-08-01T19:54:04.064912+0000","last_became_peered":"2023-08-01T19:54:04.064912+0000","last_unstale":"2023-08-01T19:54:04.466981+0000","last_undegraded":"2023-08-01T19:54:04.466981+0000","last_fullsized":"2023-08-01T19:54:04.466981+0000","mapping_epoch":15,"log_start":"0'0","ondisk_log_start":"0'0","created":15,"last_epoch_clean":16,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-08-01T19:54:03.032665+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-08-01T19:54:03.032665+0000","last_clean_scrub_stamp":"2023-08-01T19:54:03.032665+0000","objects_scrubbed":0,"log_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-08-03T02:37:09.180970+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[1,0],"acting":[1,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":1,"acting_primary":1,"purged_snaps":[]},{"pgid":"4.d","version":"0'0","reported_seq":9,"reported_epoch":17,"state":"active+clean","last_fresh":"2023-08-01T19:54:04.478084+0000","last_change":"2023-08-01T19:54:04.474755+0000","last_active":"2023-08-01T19:54:04.478084+0000","last_peered":"2023-08-01T19:54:04.478084+0000","last_clean":"2023-08-01T19:54:04.478084+0000","last_became_active":"2023-08-01T19:54:04.471526+0000","last_became_peered":"2023-08-01T19:54:04.471526+0000","last_unstale":"2023-08-01T19:54:04.478084+0000","last_undegraded":"2023-08-01T19:54:04.478084+0000","last_fullsized":"2023-08-01T19:54:04.478084+0000","mapping_epoch":16,"log_start":"0'0","ondisk_log_start":"0'0","created":16,"last_epoch_clean":17,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-08-01T19:54:04.040663+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-08-01T19:54:04.040663+0000","last_clean_scrub_stamp":"2023-08-01T19:54:04.040663+0000","objects_scrubbed":0,"log_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-08-03T06:50:03.420334+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[1,2],"acting":[1,2],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":1,"acting_primary":1,"purged_snaps":[]},{"pgid":"3.9","version":"0'0","reported_seq":10,"reported_epoch":17,"state":"active+clean","last_fresh":"2023-08-01T19:54:04.457820+0000","last_change":"2023-08-01T19:54:04.065519+0000","last_active":"2023-08-01T19:54:04.457820+0000","last_peered":"2023-08-01T19:54:04.457820+0000","last_clean":"2023-08-01T19:54:04.457820+0000","last_became_active":"2023-08-01T19:54:04.065211+0000","last_became_peered":"2023-08-01T19:54:04.065211+0000","last_unstale":"2023-08-01T19:54:04.457820+0000","last_undegraded":"2023-08-01T19:54:04.457820+0000","last_fullsized":"2023-08-01T19:54:04.457820+0000","mapping_epoch":15,"log_start":"0'0","ondisk_log_start":"0'0","created":15,"last_epoch_clean":16,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-08-01T19:54:03.032665+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-08-01T19:54:03.032665+0000","last_clean_scrub_stamp":"2023-08-01T19:54:03.032665+0000","objects_scrubbed":0,"log_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-08-03T05:46:27.672957+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[2,1],"acting":[2,1],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":2,"acting_primary":2,"purged_snaps":[]},{"pgid":"4.e","version":"0'0","reported_seq":9,"reported_epoch":17,"state":"active+clean","last_fresh":"2023-08-01T19:54:04.477674+0000","last_change":"2023-08-01T19:54:04.473750+0000","last_active":"2023-08-01T19:54:04.477674+0000","last_peered":"2023-08-01T19:54:04.477674+0000","last_clean":"2023-08-01T19:54:04.477674+0000","last_became_active":"2023-08-01T19:54:04.471512+0000","last_became_peered":"2023-08-01T19:54:04.471512+0000","last_unstale":"2023-08-01T19:54:04.477674+0000","last_undegraded":"2023-08-01T19:54:04.477674+0000","last_fullsized":"2023-08-01T19:54:04.477674+0000","mapping_epoch":16,"log_start":"0'0","ondisk_log_start":"0'0","created":16,"last_epoch_clean":17,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-08-01T19:54:04.040663+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-08-01T19:54:04.040663+0000","last_clean_scrub_stamp":"2023-08-01T19:54:04.040663+0000","objects_scrubbed":0,"log_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-08-03T05:13:38.298401+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[1,2],"acting":[1,2],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":1,"acting_primary":1,"purged_snaps":[]},{"pgid":"3.8","version":"0'0","reported_seq":10,"reported_epoch":17,"state":"active+clean","last_fresh":"2023-08-01T19:54:04.458299+0000","last_change":"2023-08-01T19:54:04.063990+0000","last_active":"2023-08-01T19:54:04.458299+0000","last_peered":"2023-08-01T19:54:04.458299+0000","last_clean":"2023-08-01T19:54:04.458299+0000","last_became_active":"2023-08-01T19:54:04.063652+0000","last_became_peered":"2023-08-01T19:54:04.063652+0000","last_unstale":"2023-08-01T19:54:04.458299+0000","last_undegraded":"2023-08-01T19:54:04.458299+0000","last_fullsized":"2023-08-01T19:54:04.458299+0000","mapping_epoch":15,"log_start":"0'0","ondisk_log_start":"0'0","created":15,"last_epoch_clean":16,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-08-01T19:54:03.032665+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-08-01T19:54:03.032665+0000","last_clean_scrub_stamp":"2023-08-01T19:54:03.032665+0000","objects_scrubbed":0,"log_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-08-03T05:30:28.028091+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[2,0],"acting":[2,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":2,"acting_primary":2,"purged_snaps":[]},{"pgid":"4.f","version":"0'0","reported_seq":9,"reported_epoch":17,"state":"active+clean","last_fresh":"2023-08-01T19:54:04.472898+0000","last_change":"2023-08-01T19:54:04.469648+0000","last_active":"2023-08-01T19:54:04.472898+0000","last_peered":"2023-08-01T19:54:04.472898+0000","last_clean":"2023-08-01T19:54:04.472898+0000","last_became_active":"2023-08-01T19:54:04.468445+0000","last_became_peered":"2023-08-01T19:54:04.468445+0000","last_unstale":"2023-08-01T19:54:04.472898+0000","last_undegraded":"2023-08-01T19:54:04.472898+0000","last_fullsized":"2023-08-01T19:54:04.472898+0000","mapping_epoch":16,"log_start":"0'0","ondisk_log_start":"0'0","created":16,"last_epoch_clean":17,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-08-01T19:54:04.040663+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-08-01T19:54:04.040663+0000","last_clean_scrub_stamp":"2023-08-01T19:54:04.040663+0000","objects_scrubbed":0,"log_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-08-03T05:46:11.085577+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[0,2],"acting":[0,2],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":0,"acting_primary":0,"purged_snaps":[]},{"pgid":"2.4","version":"0'0","reported_seq":13,"reported_epoch":17,"state":"active+clean","last_fresh":"2023-08-01T19:54:04.459326+0000","last_change":"2023-08-01T19:53:58.973838+0000","last_active":"2023-08-01T19:54:04.459326+0000","last_peered":"2023-08-01T19:54:04.459326+0000","last_clean":"2023-08-01T19:54:04.459326+0000","last_became_active":"2023-08-01T19:53:58.973242+0000","last_became_peered":"2023-08-01T19:53:58.973242+0000","last_unstale":"2023-08-01T19:54:04.459326+0000","last_undegraded":"2023-08-01T19:54:04.459326+0000","last_fullsized":"2023-08-01T19:54:04.459326+0000","mapping_epoch":12,"log_start":"0'0","ondisk_log_start":"0'0","created":12,"last_epoch_clean":13,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-08-01T19:53:57.959448+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-08-01T19:53:57.959448+0000","last_clean_scrub_stamp":"2023-08-01T19:53:57.959448+0000","objects_scrubbed":0,"log_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-08-03T00:09:48.796549+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[0,2],"acting":[0,2],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":0,"acting_primary":0,"purged_snaps":[]},{"pgid":"3.5","version":"0'0","reported_seq":10,"reported_epoch":17,"state":"active+clean","last_fresh":"2023-08-01T19:54:04.469510+0000","last_change":"2023-08-01T19:54:04.065255+0000","last_active":"2023-08-01T19:54:04.469510+0000","last_peered":"2023-08-01T19:54:04.469510+0000","last_clean":"2023-08-01T19:54:04.469510+0000","last_became_active":"2023-08-01T19:54:04.064814+0000","last_became_peered":"2023-08-01T19:54:04.064814+0000","last_unstale":"2023-08-01T19:54:04.469510+0000","last_undegraded":"2023-08-01T19:54:04.469510+0000","last_fullsized":"2023-08-01T19:54:04.469510+0000","mapping_epoch":15,"log_start":"0'0","ondisk_log_start":"0'0","created":15,"last_epoch_clean":16,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-08-01T19:54:03.032665+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-08-01T19:54:03.032665+0000","last_clean_scrub_stamp":"2023-08-01T19:54:03.032665+0000","objects_scrubbed":0,"log_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-08-03T02:01:47.073630+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[1,0],"acting":[1,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":1,"acting_primary":1,"purged_snaps":[]},{"pgid":"4.2","version":"0'0","reported_seq":9,"reported_epoch":17,"state":"active+clean","last_fresh":"2023-08-01T19:54:04.473868+0000","last_change":"2023-08-01T19:54:04.471715+0000","last_active":"2023-08-01T19:54:04.473868+0000","last_peered":"2023-08-01T19:54:04.473868+0000","last_clean":"2023-08-01T19:54:04.473868+0000","last_became_active":"2023-08-01T19:54:04.471300+0000","last_became_peered":"2023-08-01T19:54:04.471300+0000","last_unstale":"2023-08-01T19:54:04.473868+0000","last_undegraded":"2023-08-01T19:54:04.473868+0000","last_fullsized":"2023-08-01T19:54:04.473868+0000","mapping_epoch":16,"log_start":"0'0","ondisk_log_start":"0'0","created":16,"last_epoch_clean":17,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-08-01T19:54:04.040663+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-08-01T19:54:04.040663+0000","last_clean_scrub_stamp":"2023-08-01T19:54:04.040663+0000","objects_scrubbed":0,"log_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-08-02T23:00:24.980203+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[2,1],"acting":[2,1],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":2,"acting_primary":2,"purged_snaps":[]},{"pgid":"2.2","version":"0'0","reported_seq":13,"reported_epoch":17,"state":"active+clean","last_fresh":"2023-08-01T19:54:04.467109+0000","last_change":"2023-08-01T19:53:58.973665+0000","last_active":"2023-08-01T19:54:04.467109+0000","last_peered":"2023-08-01T19:54:04.467109+0000","last_clean":"2023-08-01T19:54:04.467109+0000","last_became_active":"2023-08-01T19:53:58.973463+0000","last_became_peered":"2023-08-01T19:53:58.973463+0000","last_unstale":"2023-08-01T19:54:04.467109+0000","last_undegraded":"2023-08-01T19:54:04.467109+0000","last_fullsized":"2023-08-01T19:54:04.467109+0000","mapping_epoch":12,"log_start":"0'0","ondisk_log_start":"0'0","created":12,"last_epoch_clean":13,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-08-01T19:53:57.959448+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-08-01T19:53:57.959448+0000","last_clean_scrub_stamp":"2023-08-01T19:53:57.959448+0000","objects_scrubbed":0,"log_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-08-03T04:50:42.368892+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[1,0],"acting":[1,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":1,"acting_primary":1,"purged_snaps":[]},{"pgid":"3.3","version":"0'0","reported_seq":10,"reported_epoch":17,"state":"active+clean","last_fresh":"2023-08-01T19:54:04.467459+0000","last_change":"2023-08-01T19:54:04.065415+0000","last_active":"2023-08-01T19:54:04.467459+0000","last_peered":"2023-08-01T19:54:04.467459+0000","last_clean":"2023-08-01T19:54:04.467459+0000","last_became_active":"2023-08-01T19:54:04.065030+0000","last_became_peered":"2023-08-01T19:54:04.065030+0000","last_unstale":"2023-08-01T19:54:04.467459+0000","last_undegraded":"2023-08-01T19:54:04.467459+0000","last_fullsized":"2023-08-01T19:54:04.467459+0000","mapping_epoch":15,"log_start":"0'0","ondisk_log_start":"0'0","created":15,"last_epoch_clean":16,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-08-01T19:54:03.032665+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-08-01T19:54:03.032665+0000","last_clean_scrub_stamp":"2023-08-01T19:54:03.032665+0000","objects_scrubbed":0,"log_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-08-02T21:33:27.007118+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[1,0],"acting":[1,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":1,"acting_primary":1,"purged_snaps":[]},{"pgid":"4.4","version":"0'0","reported_seq":9,"reported_epoch":17,"state":"active+clean","last_fresh":"2023-08-01T19:54:04.472012+0000","last_change":"2023-08-01T19:54:04.468101+0000","last_active":"2023-08-01T19:54:04.472012+0000","last_peered":"2023-08-01T19:54:04.472012+0000","last_clean":"2023-08-01T19:54:04.472012+0000","last_became_active":"2023-08-01T19:54:04.467409+0000","last_became_peered":"2023-08-01T19:54:04.467409+0000","last_unstale":"2023-08-01T19:54:04.472012+0000","last_undegraded":"2023-08-01T19:54:04.472012+0000","last_fullsized":"2023-08-01T19:54:04.472012+0000","mapping_epoch":16,"log_start":"0'0","ondisk_log_start":"0'0","created":16,"last_epoch_clean":17,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-08-01T19:54:04.040663+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-08-01T19:54:04.040663+0000","last_clean_scrub_stamp":"2023-08-01T19:54:04.040663+0000","objects_scrubbed":0,"log_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-08-02T21:43:30.325991+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[0,2],"acting":[0,2],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":0,"acting_primary":0,"purged_snaps":[]},{"pgid":"2.1","version":"0'0","reported_seq":13,"reported_epoch":17,"state":"active+clean","last_fresh":"2023-08-01T19:54:04.458490+0000","last_change":"2023-08-01T19:53:58.973700+0000","last_active":"2023-08-01T19:54:04.458490+0000","last_peered":"2023-08-01T19:54:04.458490+0000","last_clean":"2023-08-01T19:54:04.458490+0000","last_became_active":"2023-08-01T19:53:58.973285+0000","last_became_peered":"2023-08-01T19:53:58.973285+0000","last_unstale":"2023-08-01T19:54:04.458490+0000","last_undegraded":"2023-08-01T19:54:04.458490+0000","last_fullsized":"2023-08-01T19:54:04.458490+0000","mapping_epoch":12,"log_start":"0'0","ondisk_log_start":"0'0","created":12,"last_epoch_clean":13,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-08-01T19:53:57.959448+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-08-01T19:53:57.959448+0000","last_clean_scrub_stamp":"2023-08-01T19:53:57.959448+0000","objects_scrubbed":0,"log_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-08-02T21:26:02.570824+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[0,2],"acting":[0,2],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":0,"acting_primary":0,"purged_snaps":[]},{"pgid":"3.0","version":"0'0","reported_seq":10,"reported_epoch":17,"state":"active+clean","last_fresh":"2023-08-01T19:54:04.457828+0000","last_change":"2023-08-01T19:54:04.064407+0000","last_active":"2023-08-01T19:54:04.457828+0000","last_peered":"2023-08-01T19:54:04.457828+0000","last_clean":"2023-08-01T19:54:04.457828+0000","last_became_active":"2023-08-01T19:54:04.064122+0000","last_became_peered":"2023-08-01T19:54:04.064122+0000","last_unstale":"2023-08-01T19:54:04.457828+0000","last_undegraded":"2023-08-01T19:54:04.457828+0000","last_fullsized":"2023-08-01T19:54:04.457828+0000","mapping_epoch":15,"log_start":"0'0","ondisk_log_start":"0'0","created":15,"last_epoch_clean":16,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-08-01T19:54:03.032665+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-08-01T19:54:03.032665+0000","last_clean_scrub_stamp":"2023-08-01T19:54:03.032665+0000","objects_scrubbed":0,"log_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-08-03T07:08:17.318689+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[2,1],"acting":[2,1],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":2,"acting_primary":2,"purged_snaps":[]},{"pgid":"4.7","version":"0'0","reported_seq":9,"reported_epoch":17,"state":"active+clean","last_fresh":"2023-08-01T19:54:04.472871+0000","last_change":"2023-08-01T19:54:04.469739+0000","last_active":"2023-08-01T19:54:04.472871+0000","last_peered":"2023-08-01T19:54:04.472871+0000","last_clean":"2023-08-01T19:54:04.472871+0000","last_became_active":"2023-08-01T19:54:04.468021+0000","last_became_peered":"2023-08-01T19:54:04.468021+0000","last_unstale":"2023-08-01T19:54:04.472871+0000","last_undegraded":"2023-08-01T19:54:04.472871+0000","last_fullsized":"2023-08-01T19:54:04.472871+0000","mapping_epoch":16,"log_start":"0'0","ondisk_log_start":"0'0","created":16,"last_epoch_clean":17,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-08-01T19:54:04.040663+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-08-01T19:54:04.040663+0000","last_clean_scrub_stamp":"2023-08-01T19:54:04.040663+0000","objects_scrubbed":0,"log_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-08-02T21:03:01.319028+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[0,2],"acting":[0,2],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":0,"acting_primary":0,"purged_snaps":[]},{"pgid":"2.3","version":"0'0","reported_seq":13,"reported_epoch":17,"state":"active+clean","last_fresh":"2023-08-01T19:54:04.467483+0000","last_change":"2023-08-01T19:53:58.973768+0000","last_active":"2023-08-01T19:54:04.467483+0000","last_peered":"2023-08-01T19:54:04.467483+0000","last_clean":"2023-08-01T19:54:04.467483+0000","last_became_active":"2023-08-01T19:53:58.973492+0000","last_became_peered":"2023-08-01T19:53:58.973492+0000","last_unstale":"2023-08-01T19:54:04.467483+0000","last_undegraded":"2023-08-01T19:54:04.467483+0000","last_fullsized":"2023-08-01T19:54:04.467483+0000","mapping_epoch":12,"log_start":"0'0","ondisk_log_start":"0'0","created":12,"last_epoch_clean":13,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-08-01T19:53:57.959448+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-08-01T19:53:57.959448+0000","last_clean_scrub_stamp":"2023-08-01T19:53:57.959448+0000","objects_scrubbed":0,"log_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-08-03T02:04:52.034667+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[1,0],"acting":[1,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":1,"acting_primary":1,"purged_snaps":[]},{"pgid":"1.0","version":"10'157","reported_seq":212,"reported_epoch":17,"state":"active+clean","last_fresh":"2023-08-01T19:54:04.466599+0000","last_change":"2023-08-01T19:53:51.746910+0000","last_active":"2023-08-01T19:54:04.466599+0000","last_peered":"2023-08-01T19:54:04.466599+0000","last_clean":"2023-08-01T19:54:04.466599+0000","last_became_active":"2023-08-01T19:53:51.746590+0000","last_became_peered":"2023-08-01T19:53:51.746590+0000","last_unstale":"2023-08-01T19:54:04.466599+0000","last_undegraded":"2023-08-01T19:54:04.466599+0000","last_fullsized":"2023-08-01T19:54:04.466599+0000","mapping_epoch":9,"log_start":"0'0","ondisk_log_start":"0'0","created":9,"last_epoch_clean":10,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-08-01T19:53:50.735626+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-08-01T19:53:50.735626+0000","last_clean_scrub_stamp":"2023-08-01T19:53:50.735626+0000","objects_scrubbed":0,"log_size":157,"ondisk_log_size":157,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-08-03T02:56:50.228294+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":590368,"num_objects":2,"num_object_clones":0,"num_object_copies":4,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":2,"num_whiteouts":0,"num_read":136,"num_read_kb":118,"num_write":203,"num_write_kb":3460,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[1,2],"acting":[1,2],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":1,"acting_primary":1,"purged_snaps":[]},{"pgid":"3.2","version":"0'0","reported_seq":10,"reported_epoch":17,"state":"active+clean","last_fresh":"2023-08-01T19:54:04.458645+0000","last_change":"2023-08-01T19:54:04.064009+0000","last_active":"2023-08-01T19:54:04.458645+0000","last_peered":"2023-08-01T19:54:04.458645+0000","last_clean":"2023-08-01T19:54:04.458645+0000","last_became_active":"2023-08-01T19:54:04.063665+0000","last_became_peered":"2023-08-01T19:54:04.063665+0000","last_unstale":"2023-08-01T19:54:04.458645+0000","last_undegraded":"2023-08-01T19:54:04.458645+0000","last_fullsized":"2023-08-01T19:54:04.458645+0000","mapping_epoch":15,"log_start":"0'0","ondisk_log_start":"0'0","created":15,"last_epoch_clean":16,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-08-01T19:54:03.032665+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-08-01T19:54:03.032665+0000","last_clean_scrub_stamp":"2023-08-01T19:54:03.032665+0000","objects_scrubbed":0,"log_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-08-03T04:04:46.983253+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[0,2],"acting":[0,2],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":0,"acting_primary":0,"purged_snaps":[]},{"pgid":"4.5","version":"0'0","reported_seq":9,"reported_epoch":17,"state":"active+clean","last_fresh":"2023-08-01T19:54:04.477907+0000","last_change":"2023-08-01T19:54:04.474061+0000","last_active":"2023-08-01T19:54:04.477907+0000","last_peered":"2023-08-01T19:54:04.477907+0000","last_clean":"2023-08-01T19:54:04.477907+0000","last_became_active":"2023-08-01T19:54:04.472128+0000","last_became_peered":"2023-08-01T19:54:04.472128+0000","last_unstale":"2023-08-01T19:54:04.477907+0000","last_undegraded":"2023-08-01T19:54:04.477907+0000","last_fullsized":"2023-08-01T19:54:04.477907+0000","mapping_epoch":16,"log_start":"0'0","ondisk_log_start":"0'0","created":16,"last_epoch_clean":17,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-08-01T19:54:04.040663+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-08-01T19:54:04.040663+0000","last_clean_scrub_stamp":"2023-08-01T19:54:04.040663+0000","objects_scrubbed":0,"log_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-08-03T00:29:05.857138+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[1,2],"acting":[1,2],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":1,"acting_primary":1,"purged_snaps":[]},{"pgid":"2.0","version":"0'0","reported_seq":13,"reported_epoch":17,"state":"active+clean","last_fresh":"2023-08-01T19:54:04.466598+0000","last_change":"2023-08-01T19:53:58.975968+0000","last_active":"2023-08-01T19:54:04.466598+0000","last_peered":"2023-08-01T19:54:04.466598+0000","last_clean":"2023-08-01T19:54:04.466598+0000","last_became_active":"2023-08-01T19:53:58.975706+0000","last_became_peered":"2023-08-01T19:53:58.975706+0000","last_unstale":"2023-08-01T19:54:04.466598+0000","last_undegraded":"2023-08-01T19:54:04.466598+0000","last_fullsized":"2023-08-01T19:54:04.466598+0000","mapping_epoch":12,"log_start":"0'0","ondisk_log_start":"0'0","created":12,"last_epoch_clean":13,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-08-01T19:53:57.959448+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-08-01T19:53:57.959448+0000","last_clean_scrub_stamp":"2023-08-01T19:53:57.959448+0000","objects_scrubbed":0,"log_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-08-03T00:02:15.204280+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[1,2],"acting":[1,2],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":1,"acting_primary":1,"purged_snaps":[]},{"pgid":"3.1","version":"0'0","reported_seq":10,"reported_epoch":17,"state":"active+clean","last_fresh":"2023-08-01T19:54:04.458619+0000","last_change":"2023-08-01T19:54:04.066707+0000","last_active":"2023-08-01T19:54:04.458619+0000","last_peered":"2023-08-01T19:54:04.458619+0000","last_clean":"2023-08-01T19:54:04.458619+0000","last_became_active":"2023-08-01T19:54:04.066334+0000","last_became_peered":"2023-08-01T19:54:04.066334+0000","last_unstale":"2023-08-01T19:54:04.458619+0000","last_undegraded":"2023-08-01T19:54:04.458619+0000","last_fullsized":"2023-08-01T19:54:04.458619+0000","mapping_epoch":15,"log_start":"0'0","ondisk_log_start":"0'0","created":15,"last_epoch_clean":16,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-08-01T19:54:03.032665+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-08-01T19:54:03.032665+0000","last_clean_scrub_stamp":"2023-08-01T19:54:03.032665+0000","objects_scrubbed":0,"log_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-08-03T02:40:15.210599+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[0,1],"acting":[0,1],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":0,"acting_primary":0,"purged_snaps":[]},{"pgid":"4.6","version":"0'0","reported_seq":9,"reported_epoch":17,"state":"active+clean","last_fresh":"2023-08-01T19:54:04.471325+0000","last_change":"2023-08-01T19:54:04.469877+0000","last_active":"2023-08-01T19:54:04.471325+0000","last_peered":"2023-08-01T19:54:04.471325+0000","last_clean":"2023-08-01T19:54:04.471325+0000","last_became_active":"2023-08-01T19:54:04.469528+0000","last_became_peered":"2023-08-01T19:54:04.469528+0000","last_unstale":"2023-08-01T19:54:04.471325+0000","last_undegraded":"2023-08-01T19:54:04.471325+0000","last_fullsized":"2023-08-01T19:54:04.471325+0000","mapping_epoch":16,"log_start":"0'0","ondisk_log_start":"0'0","created":16,"last_epoch_clean":17,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-08-01T19:54:04.040663+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-08-01T19:54:04.040663+0000","last_clean_scrub_stamp":"2023-08-01T19:54:04.040663+0000","objects_scrubbed":0,"log_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-08-03T02:24:19.067602+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[2,0],"acting":[2,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":2,"acting_primary":2,"purged_snaps":[]},{"pgid":"2.5","version":"0'0","reported_seq":13,"reported_epoch":17,"state":"active+clean","last_fresh":"2023-08-01T19:54:04.459098+0000","last_change":"2023-08-01T19:53:58.970683+0000","last_active":"2023-08-01T19:54:04.459098+0000","last_peered":"2023-08-01T19:54:04.459098+0000","last_clean":"2023-08-01T19:54:04.459098+0000","last_became_active":"2023-08-01T19:53:58.970437+0000","last_became_peered":"2023-08-01T19:53:58.970437+0000","last_unstale":"2023-08-01T19:54:04.459098+0000","last_undegraded":"2023-08-01T19:54:04.459098+0000","last_fullsized":"2023-08-01T19:54:04.459098+0000","mapping_epoch":12,"log_start":"0'0","ondisk_log_start":"0'0","created":12,"last_epoch_clean":13,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-08-01T19:53:57.959448+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-08-01T19:53:57.959448+0000","last_clean_scrub_stamp":"2023-08-01T19:53:57.959448+0000","objects_scrubbed":0,"log_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-08-02T23:54:08.273426+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[2,0],"acting":[2,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":2,"acting_primary":2,"purged_snaps":[]},{"pgid":"3.4","version":"0'0","reported_seq":10,"reported_epoch":17,"state":"active+clean","last_fresh":"2023-08-01T19:54:04.458989+0000","last_change":"2023-08-01T19:54:04.062283+0000","last_active":"2023-08-01T19:54:04.458989+0000","last_peered":"2023-08-01T19:54:04.458989+0000","last_clean":"2023-08-01T19:54:04.458989+0000","last_became_active":"2023-08-01T19:54:04.061796+0000","last_became_peered":"2023-08-01T19:54:04.061796+0000","last_unstale":"2023-08-01T19:54:04.458989+0000","last_undegraded":"2023-08-01T19:54:04.458989+0000","last_fullsized":"2023-08-01T19:54:04.458989+0000","mapping_epoch":15,"log_start":"0'0","ondisk_log_start":"0'0","created":15,"last_epoch_clean":16,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-08-01T19:54:03.032665+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-08-01T19:54:03.032665+0000","last_clean_scrub_stamp":"2023-08-01T19:54:03.032665+0000","objects_scrubbed":0,"log_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-08-02T19:54:08.401797+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[0,2],"acting":[0,2],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":0,"acting_primary":0,"purged_snaps":[]},{"pgid":"4.3","version":"0'0","reported_seq":9,"reported_epoch":17,"state":"active+clean","last_fresh":"2023-08-01T19:54:04.474487+0000","last_change":"2023-08-01T19:54:04.473088+0000","last_active":"2023-08-01T19:54:04.474487+0000","last_peered":"2023-08-01T19:54:04.474487+0000","last_clean":"2023-08-01T19:54:04.474487+0000","last_became_active":"2023-08-01T19:54:04.472611+0000","last_became_peered":"2023-08-01T19:54:04.472611+0000","last_unstale":"2023-08-01T19:54:04.474487+0000","last_undegraded":"2023-08-01T19:54:04.474487+0000","last_fullsized":"2023-08-01T19:54:04.474487+0000","mapping_epoch":16,"log_start":"0'0","ondisk_log_start":"0'0","created":16,"last_epoch_clean":17,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-08-01T19:54:04.040663+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-08-01T19:54:04.040663+0000","last_clean_scrub_stamp":"2023-08-01T19:54:04.040663+0000","objects_scrubbed":0,"log_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-08-03T07:27:26.537518+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[2,1],"acting":[2,1],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":2,"acting_primary":2,"purged_snaps":[]},{"pgid":"3.7","version":"17'2","reported_seq":12,"reported_epoch":17,"state":"active+clean","last_fresh":"2023-08-01T19:54:04.471357+0000","last_change":"2023-08-01T19:54:04.065147+0000","last_active":"2023-08-01T19:54:04.471357+0000","last_peered":"2023-08-01T19:54:04.471357+0000","last_clean":"2023-08-01T19:54:04.471357+0000","last_became_active":"2023-08-01T19:54:04.064779+0000","last_became_peered":"2023-08-01T19:54:04.064779+0000","last_unstale":"2023-08-01T19:54:04.471357+0000","last_undegraded":"2023-08-01T19:54:04.471357+0000","last_fullsized":"2023-08-01T19:54:04.471357+0000","mapping_epoch":15,"log_start":"0'0","ondisk_log_start":"0'0","created":15,"last_epoch_clean":16,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-08-01T19:54:03.032665+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-08-01T19:54:03.032665+0000","last_clean_scrub_stamp":"2023-08-01T19:54:03.032665+0000","objects_scrubbed":0,"log_size":2,"ondisk_log_size":2,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-08-03T03:43:45.667663+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":1,"num_object_clones":0,"num_object_copies":2,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":1,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":3,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":1,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[0,2],"acting":[0,2],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":0,"acting_primary":0,"purged_snaps":[]},{"pgid":"2.6","version":"0'0","reported_seq":13,"reported_epoch":17,"state":"active+clean","last_fresh":"2023-08-01T19:54:04.460651+0000","last_change":"2023-08-01T19:53:58.974077+0000","last_active":"2023-08-01T19:54:04.460651+0000","last_peered":"2023-08-01T19:54:04.460651+0000","last_clean":"2023-08-01T19:54:04.460651+0000","last_became_active":"2023-08-01T19:53:58.973396+0000","last_became_peered":"2023-08-01T19:53:58.973396+0000","last_unstale":"2023-08-01T19:54:04.460651+0000","last_undegraded":"2023-08-01T19:54:04.460651+0000","last_fullsized":"2023-08-01T19:54:04.460651+0000","mapping_epoch":12,"log_start":"0'0","ondisk_log_start":"0'0","created":12,"last_epoch_clean":13,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-08-01T19:53:57.959448+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-08-01T19:53:57.959448+0000","last_clean_scrub_stamp":"2023-08-01T19:53:57.959448+0000","objects_scrubbed":0,"log_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-08-02T22:13:50.940864+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[0,2],"acting":[0,2],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":0,"acting_primary":0,"purged_snaps":[]},{"pgid":"4.0","version":"0'0","reported_seq":9,"reported_epoch":17,"state":"active+clean","last_fresh":"2023-08-01T19:54:04.477383+0000","last_change":"2023-08-01T19:54:04.476807+0000","last_active":"2023-08-01T19:54:04.477383+0000","last_peered":"2023-08-01T19:54:04.477383+0000","last_clean":"2023-08-01T19:54:04.477383+0000","last_became_active":"2023-08-01T19:54:04.476453+0000","last_became_peered":"2023-08-01T19:54:04.476453+0000","last_unstale":"2023-08-01T19:54:04.477383+0000","last_undegraded":"2023-08-01T19:54:04.477383+0000","last_fullsized":"2023-08-01T19:54:04.477383+0000","mapping_epoch":16,"log_start":"0'0","ondisk_log_start":"0'0","created":16,"last_epoch_clean":17,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-08-01T19:54:04.040663+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-08-01T19:54:04.040663+0000","last_clean_scrub_stamp":"2023-08-01T19:54:04.040663+0000","objects_scrubbed":0,"log_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-08-02T20:20:59.989030+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[0,1],"acting":[0,1],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":0,"acting_primary":0,"purged_snaps":[]},{"pgid":"2.7","version":"0'0","reported_seq":13,"reported_epoch":17,"state":"active+clean","last_fresh":"2023-08-01T19:54:04.469429+0000","last_change":"2023-08-01T19:53:58.975936+0000","last_active":"2023-08-01T19:54:04.469429+0000","last_peered":"2023-08-01T19:54:04.469429+0000","last_clean":"2023-08-01T19:54:04.469429+0000","last_became_active":"2023-08-01T19:53:58.975680+0000","last_became_peered":"2023-08-01T19:53:58.975680+0000","last_unstale":"2023-08-01T19:54:04.469429+0000","last_undegraded":"2023-08-01T19:54:04.469429+0000","last_fullsized":"2023-08-01T19:54:04.469429+0000","mapping_epoch":12,"log_start":"0'0","ondisk_log_start":"0'0","created":12,"last_epoch_clean":13,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-08-01T19:53:57.959448+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-08-01T19:53:57.959448+0000","last_clean_scrub_stamp":"2023-08-01T19:53:57.959448+0000","objects_scrubbed":0,"log_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-08-03T05:17:03.508898+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[1,2],"acting":[1,2],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":1,"acting_primary":1,"purged_snaps":[]},{"pgid":"3.6","version":"18'1","reported_seq":11,"reported_epoch":18,"state":"active+clean","last_fresh":"2023-08-01T19:54:06.924239+0000","last_change":"2023-08-01T19:54:04.068041+0000","last_active":"2023-08-01T19:54:06.924239+0000","last_peered":"2023-08-01T19:54:06.924239+0000","last_clean":"2023-08-01T19:54:06.924239+0000","last_became_active":"2023-08-01T19:54:04.067613+0000","last_became_peered":"2023-08-01T19:54:04.067613+0000","last_unstale":"2023-08-01T19:54:06.924239+0000","last_undegraded":"2023-08-01T19:54:06.924239+0000","last_fullsized":"2023-08-01T19:54:06.924239+0000","mapping_epoch":15,"log_start":"0'0","ondisk_log_start":"0'0","created":15,"last_epoch_clean":16,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-08-01T19:54:03.032665+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-08-01T19:54:03.032665+0000","last_clean_scrub_stamp":"2023-08-01T19:54:03.032665+0000","objects_scrubbed":0,"log_size":1,"ondisk_log_size":1,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-08-02T21:35:44.874727+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":1,"num_object_clones":0,"num_object_copies":2,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":1,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":1,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":1,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[0,1],"acting":[0,1],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":0,"acting_primary":0,"purged_snaps":[]},{"pgid":"4.1","version":"0'0","reported_seq":9,"reported_epoch":17,"state":"active+clean","last_fresh":"2023-08-01T19:54:04.470826+0000","last_change":"2023-08-01T19:54:04.469243+0000","last_active":"2023-08-01T19:54:04.470826+0000","last_peered":"2023-08-01T19:54:04.470826+0000","last_clean":"2023-08-01T19:54:04.470826+0000","last_became_active":"2023-08-01T19:54:04.468835+0000","last_became_peered":"2023-08-01T19:54:04.468835+0000","last_unstale":"2023-08-01T19:54:04.470826+0000","last_undegraded":"2023-08-01T19:54:04.470826+0000","last_fullsized":"2023-08-01T19:54:04.470826+0000","mapping_epoch":16,"log_start":"0'0","ondisk_log_start":"0'0","created":16,"last_epoch_clean":17,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-08-01T19:54:04.040663+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-08-01T19:54:04.040663+0000","last_clean_scrub_stamp":"2023-08-01T19:54:04.040663+0000","objects_scrubbed":0,"log_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-08-03T04:43:58.358628+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[2,1],"acting":[2,1],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":2,"acting_primary":2,"purged_snaps":[]},{"pgid":"3.1b","version":"17'1","reported_seq":11,"reported_epoch":17,"state":"active+clean","last_fresh":"2023-08-01T19:54:04.471524+0000","last_change":"2023-08-01T19:54:04.066748+0000","last_active":"2023-08-01T19:54:04.471524+0000","last_peered":"2023-08-01T19:54:04.471524+0000","last_clean":"2023-08-01T19:54:04.471524+0000","last_became_active":"2023-08-01T19:54:04.066483+0000","last_became_peered":"2023-08-01T19:54:04.066483+0000","last_unstale":"2023-08-01T19:54:04.471524+0000","last_undegraded":"2023-08-01T19:54:04.471524+0000","last_fullsized":"2023-08-01T19:54:04.471524+0000","mapping_epoch":15,"log_start":"0'0","ondisk_log_start":"0'0","created":15,"last_epoch_clean":16,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-08-01T19:54:03.032665+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-08-01T19:54:03.032665+0000","last_clean_scrub_stamp":"2023-08-01T19:54:03.032665+0000","objects_scrubbed":0,"log_size":1,"ondisk_log_size":1,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-08-03T03:08:26.880362+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[2,1],"acting":[2,1],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":2,"acting_primary":2,"purged_snaps":[]},{"pgid":"4.1c","version":"0'0","reported_seq":9,"reported_epoch":17,"state":"active+clean","last_fresh":"2023-08-01T19:54:04.468766+0000","last_change":"2023-08-01T19:54:04.466766+0000","last_active":"2023-08-01T19:54:04.468766+0000","last_peered":"2023-08-01T19:54:04.468766+0000","last_clean":"2023-08-01T19:54:04.468766+0000","last_became_active":"2023-08-01T19:54:04.466417+0000","last_became_peered":"2023-08-01T19:54:04.466417+0000","last_unstale":"2023-08-01T19:54:04.468766+0000","last_undegraded":"2023-08-01T19:54:04.468766+0000","last_fullsized":"2023-08-01T19:54:04.468766+0000","mapping_epoch":16,"log_start":"0'0","ondisk_log_start":"0'0","created":16,"last_epoch_clean":17,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-08-01T19:54:04.040663+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-08-01T19:54:04.040663+0000","last_clean_scrub_stamp":"2023-08-01T19:54:04.040663+0000","objects_scrubbed":0,"log_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-08-02T22:01:53.643825+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[2,0],"acting":[2,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":2,"acting_primary":2,"purged_snaps":[]},{"pgid":"3.1c","version":"17'2","reported_seq":12,"reported_epoch":17,"state":"active+clean","last_fresh":"2023-08-01T19:54:04.477825+0000","last_change":"2023-08-01T19:54:04.065706+0000","last_active":"2023-08-01T19:54:04.477825+0000","last_peered":"2023-08-01T19:54:04.477825+0000","last_clean":"2023-08-01T19:54:04.477825+0000","last_became_active":"2023-08-01T19:54:04.064796+0000","last_became_peered":"2023-08-01T19:54:04.064796+0000","last_unstale":"2023-08-01T19:54:04.477825+0000","last_undegraded":"2023-08-01T19:54:04.477825+0000","last_fullsized":"2023-08-01T19:54:04.477825+0000","mapping_epoch":15,"log_start":"0'0","ondisk_log_start":"0'0","created":15,"last_epoch_clean":16,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-08-01T19:54:03.032665+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-08-01T19:54:03.032665+0000","last_clean_scrub_stamp":"2023-08-01T19:54:03.032665+0000","objects_scrubbed":0,"log_size":2,"ondisk_log_size":2,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-08-02T21:40:43.596301+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":1,"num_object_clones":0,"num_object_copies":2,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":1,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":3,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":1,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[1,0],"acting":[1,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":1,"acting_primary":1,"purged_snaps":[]},{"pgid":"4.1b","version":"0'0","reported_seq":9,"reported_epoch":17,"state":"active+clean","last_fresh":"2023-08-01T19:54:04.478301+0000","last_change":"2023-08-01T19:54:04.474971+0000","last_active":"2023-08-01T19:54:04.478301+0000","last_peered":"2023-08-01T19:54:04.478301+0000","last_clean":"2023-08-01T19:54:04.478301+0000","last_became_active":"2023-08-01T19:54:04.473957+0000","last_became_peered":"2023-08-01T19:54:04.473957+0000","last_unstale":"2023-08-01T19:54:04.478301+0000","last_undegraded":"2023-08-01T19:54:04.478301+0000","last_fullsized":"2023-08-01T19:54:04.478301+0000","mapping_epoch":16,"log_start":"0'0","ondisk_log_start":"0'0","created":16,"last_epoch_clean":17,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-08-01T19:54:04.040663+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-08-01T19:54:04.040663+0000","last_clean_scrub_stamp":"2023-08-01T19:54:04.040663+0000","objects_scrubbed":0,"log_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-08-02T21:59:19.682560+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[1,0],"acting":[1,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":1,"acting_primary":1,"purged_snaps":[]},{"pgid":"3.1d","version":"17'2","reported_seq":12,"reported_epoch":17,"state":"active+clean","last_fresh":"2023-08-01T19:54:04.471623+0000","last_change":"2023-08-01T19:54:04.065591+0000","last_active":"2023-08-01T19:54:04.471623+0000","last_peered":"2023-08-01T19:54:04.471623+0000","last_clean":"2023-08-01T19:54:04.471623+0000","last_became_active":"2023-08-01T19:54:04.065306+0000","last_became_peered":"2023-08-01T19:54:04.065306+0000","last_unstale":"2023-08-01T19:54:04.471623+0000","last_undegraded":"2023-08-01T19:54:04.471623+0000","last_fullsized":"2023-08-01T19:54:04.471623+0000","mapping_epoch":15,"log_start":"0'0","ondisk_log_start":"0'0","created":15,"last_epoch_clean":16,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-08-01T19:54:03.032665+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-08-01T19:54:03.032665+0000","last_clean_scrub_stamp":"2023-08-01T19:54:03.032665+0000","objects_scrubbed":0,"log_size":2,"ondisk_log_size":2,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-08-02T21:32:10.389227+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":1,"num_object_clones":0,"num_object_copies":2,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":1,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":3,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":1,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[2,1],"acting":[2,1],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":2,"acting_primary":2,"purged_snaps":[]},{"pgid":"4.1a","version":"0'0","reported_seq":9,"reported_epoch":17,"state":"active+clean","last_fresh":"2023-08-01T19:54:04.477591+0000","last_change":"2023-08-01T19:54:04.473302+0000","last_active":"2023-08-01T19:54:04.477591+0000","last_peered":"2023-08-01T19:54:04.477591+0000","last_clean":"2023-08-01T19:54:04.477591+0000","last_became_active":"2023-08-01T19:54:04.472452+0000","last_became_peered":"2023-08-01T19:54:04.472452+0000","last_unstale":"2023-08-01T19:54:04.477591+0000","last_undegraded":"2023-08-01T19:54:04.477591+0000","last_fullsized":"2023-08-01T19:54:04.477591+0000","mapping_epoch":16,"log_start":"0'0","ondisk_log_start":"0'0","created":16,"last_epoch_clean":17,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-08-01T19:54:04.040663+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-08-01T19:54:04.040663+0000","last_clean_scrub_stamp":"2023-08-01T19:54:04.040663+0000","objects_scrubbed":0,"log_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-08-02T21:02:39.542019+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[1,0],"acting":[1,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":1,"acting_primary":1,"purged_snaps":[]},{"pgid":"3.1e","version":"17'1","reported_seq":11,"reported_epoch":17,"state":"active+clean","last_fresh":"2023-08-01T19:54:04.471416+0000","last_change":"2023-08-01T19:54:04.064378+0000","last_active":"2023-08-01T19:54:04.471416+0000","last_peered":"2023-08-01T19:54:04.471416+0000","last_clean":"2023-08-01T19:54:04.471416+0000","last_became_active":"2023-08-01T19:54:04.063988+0000","last_became_peered":"2023-08-01T19:54:04.063988+0000","last_unstale":"2023-08-01T19:54:04.471416+0000","last_undegraded":"2023-08-01T19:54:04.471416+0000","last_fullsized":"2023-08-01T19:54:04.471416+0000","mapping_epoch":15,"log_start":"0'0","ondisk_log_start":"0'0","created":15,"last_epoch_clean":16,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-08-01T19:54:03.032665+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-08-01T19:54:03.032665+0000","last_clean_scrub_stamp":"2023-08-01T19:54:03.032665+0000","objects_scrubbed":0,"log_size":1,"ondisk_log_size":1,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-08-02T22:28:51.936138+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[0,2],"acting":[0,2],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":0,"acting_primary":0,"purged_snaps":[]},{"pgid":"4.19","version":"0'0","reported_seq":9,"reported_epoch":17,"state":"active+clean","last_fresh":"2023-08-01T19:54:04.469620+0000","last_change":"2023-08-01T19:54:04.467017+0000","last_active":"2023-08-01T19:54:04.469620+0000","last_peered":"2023-08-01T19:54:04.469620+0000","last_clean":"2023-08-01T19:54:04.469620+0000","last_became_active":"2023-08-01T19:54:04.466339+0000","last_became_peered":"2023-08-01T19:54:04.466339+0000","last_unstale":"2023-08-01T19:54:04.469620+0000","last_undegraded":"2023-08-01T19:54:04.469620+0000","last_fullsized":"2023-08-01T19:54:04.469620+0000","mapping_epoch":16,"log_start":"0'0","ondisk_log_start":"0'0","created":16,"last_epoch_clean":17,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-08-01T19:54:04.040663+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-08-01T19:54:04.040663+0000","last_clean_scrub_stamp":"2023-08-01T19:54:04.040663+0000","objects_scrubbed":0,"log_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-08-03T04:07:57.222873+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[2,0],"acting":[2,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":2,"acting_primary":2,"purged_snaps":[]},{"pgid":"3.1f","version":"17'4","reported_seq":14,"reported_epoch":17,"state":"active+clean","last_fresh":"2023-08-01T19:54:04.472669+0000","last_change":"2023-08-01T19:54:04.067767+0000","last_active":"2023-08-01T19:54:04.472669+0000","last_peered":"2023-08-01T19:54:04.472669+0000","last_clean":"2023-08-01T19:54:04.472669+0000","last_became_active":"2023-08-01T19:54:04.067414+0000","last_became_peered":"2023-08-01T19:54:04.067414+0000","last_unstale":"2023-08-01T19:54:04.472669+0000","last_undegraded":"2023-08-01T19:54:04.472669+0000","last_fullsized":"2023-08-01T19:54:04.472669+0000","mapping_epoch":15,"log_start":"0'0","ondisk_log_start":"0'0","created":15,"last_epoch_clean":16,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-08-01T19:54:03.032665+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-08-01T19:54:03.032665+0000","last_clean_scrub_stamp":"2023-08-01T19:54:03.032665+0000","objects_scrubbed":0,"log_size":4,"ondisk_log_size":4,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-08-02T21:33:27.007118+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":554,"num_objects":2,"num_object_clones":0,"num_object_copies":4,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":2,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":4,"num_write_kb":1,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":1,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[0,1],"acting":[0,1],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":0,"acting_primary":0,"purged_snaps":[]},{"pgid":"4.18","version":"0'0","reported_seq":9,"reported_epoch":17,"state":"active+clean","last_fresh":"2023-08-01T19:54:04.478697+0000","last_change":"2023-08-01T19:54:04.477588+0000","last_active":"2023-08-01T19:54:04.478697+0000","last_peered":"2023-08-01T19:54:04.478697+0000","last_clean":"2023-08-01T19:54:04.478697+0000","last_became_active":"2023-08-01T19:54:04.476194+0000","last_became_peered":"2023-08-01T19:54:04.476194+0000","last_unstale":"2023-08-01T19:54:04.478697+0000","last_undegraded":"2023-08-01T19:54:04.478697+0000","last_fullsized":"2023-08-01T19:54:04.478697+0000","mapping_epoch":16,"log_start":"0'0","ondisk_log_start":"0'0","created":16,"last_epoch_clean":17,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-08-01T19:54:04.040663+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-08-01T19:54:04.040663+0000","last_clean_scrub_stamp":"2023-08-01T19:54:04.040663+0000","objects_scrubbed":0,"log_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-08-03T03:58:06.360840+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[1,0],"acting":[1,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":1,"acting_primary":1,"purged_snaps":[]},{"pgid":"4.20","version":"0'0","reported_seq":9,"reported_epoch":17,"state":"active+clean","last_fresh":"2023-08-01T19:54:04.479155+0000","last_change":"2023-08-01T19:54:04.477904+0000","last_active":"2023-08-01T19:54:04.479155+0000","last_peered":"2023-08-01T19:54:04.479155+0000","last_clean":"2023-08-01T19:54:04.479155+0000","last_became_active":"2023-08-01T19:54:04.476564+0000","last_became_peered":"2023-08-01T19:54:04.476564+0000","last_unstale":"2023-08-01T19:54:04.479155+0000","last_undegraded":"2023-08-01T19:54:04.479155+0000","last_fullsized":"2023-08-01T19:54:04.479155+0000","mapping_epoch":16,"log_start":"0'0","ondisk_log_start":"0'0","created":16,"last_epoch_clean":17,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-08-01T19:54:04.040663+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-08-01T19:54:04.040663+0000","last_clean_scrub_stamp":"2023-08-01T19:54:04.040663+0000","objects_scrubbed":0,"log_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-08-03T02:21:47.656072+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[1,0],"acting":[1,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":1,"acting_primary":1,"purged_snaps":[]},{"pgid":"4.21","version":"0'0","reported_seq":9,"reported_epoch":17,"state":"active+clean","last_fresh":"2023-08-01T19:54:04.471608+0000","last_change":"2023-08-01T19:54:04.466899+0000","last_active":"2023-08-01T19:54:04.471608+0000","last_peered":"2023-08-01T19:54:04.471608+0000","last_clean":"2023-08-01T19:54:04.471608+0000","last_became_active":"2023-08-01T19:54:04.466500+0000","last_became_peered":"2023-08-01T19:54:04.466500+0000","last_unstale":"2023-08-01T19:54:04.471608+0000","last_undegraded":"2023-08-01T19:54:04.471608+0000","last_fullsized":"2023-08-01T19:54:04.471608+0000","mapping_epoch":16,"log_start":"0'0","ondisk_log_start":"0'0","created":16,"last_epoch_clean":17,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-08-01T19:54:04.040663+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-08-01T19:54:04.040663+0000","last_clean_scrub_stamp":"2023-08-01T19:54:04.040663+0000","objects_scrubbed":0,"log_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-08-03T07:36:38.654701+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[0,2],"acting":[0,2],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":0,"acting_primary":0,"purged_snaps":[]},{"pgid":"4.22","version":"0'0","reported_seq":9,"reported_epoch":17,"state":"active+clean","last_fresh":"2023-08-01T19:54:04.473914+0000","last_change":"2023-08-01T19:54:04.471945+0000","last_active":"2023-08-01T19:54:04.473914+0000","last_peered":"2023-08-01T19:54:04.473914+0000","last_clean":"2023-08-01T19:54:04.473914+0000","last_became_active":"2023-08-01T19:54:04.471371+0000","last_became_peered":"2023-08-01T19:54:04.471371+0000","last_unstale":"2023-08-01T19:54:04.473914+0000","last_undegraded":"2023-08-01T19:54:04.473914+0000","last_fullsized":"2023-08-01T19:54:04.473914+0000","mapping_epoch":16,"log_start":"0'0","ondisk_log_start":"0'0","created":16,"last_epoch_clean":17,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-08-01T19:54:04.040663+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-08-01T19:54:04.040663+0000","last_clean_scrub_stamp":"2023-08-01T19:54:04.040663+0000","objects_scrubbed":0,"log_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-08-02T22:17:59.847819+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[2,1],"acting":[2,1],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":2,"acting_primary":2,"purged_snaps":[]},{"pgid":"4.23","version":"0'0","reported_seq":9,"reported_epoch":17,"state":"active+clean","last_fresh":"2023-08-01T19:54:04.472334+0000","last_change":"2023-08-01T19:54:04.467847+0000","last_active":"2023-08-01T19:54:04.472334+0000","last_peered":"2023-08-01T19:54:04.472334+0000","last_clean":"2023-08-01T19:54:04.472334+0000","last_became_active":"2023-08-01T19:54:04.467111+0000","last_became_peered":"2023-08-01T19:54:04.467111+0000","last_unstale":"2023-08-01T19:54:04.472334+0000","last_undegraded":"2023-08-01T19:54:04.472334+0000","last_fullsized":"2023-08-01T19:54:04.472334+0000","mapping_epoch":16,"log_start":"0'0","ondisk_log_start":"0'0","created":16,"last_epoch_clean":17,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-08-01T19:54:04.040663+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-08-01T19:54:04.040663+0000","last_clean_scrub_stamp":"2023-08-01T19:54:04.040663+0000","objects_scrubbed":0,"log_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-08-03T00:42:19.379348+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[0,2],"acting":[0,2],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":0,"acting_primary":0,"purged_snaps":[]},{"pgid":"4.24","version":"0'0","reported_seq":9,"reported_epoch":17,"state":"active+clean","last_fresh":"2023-08-01T19:54:04.482540+0000","last_change":"2023-08-01T19:54:04.477128+0000","last_active":"2023-08-01T19:54:04.482540+0000","last_peered":"2023-08-01T19:54:04.482540+0000","last_clean":"2023-08-01T19:54:04.482540+0000","last_became_active":"2023-08-01T19:54:04.476819+0000","last_became_peered":"2023-08-01T19:54:04.476819+0000","last_unstale":"2023-08-01T19:54:04.482540+0000","last_undegraded":"2023-08-01T19:54:04.482540+0000","last_fullsized":"2023-08-01T19:54:04.482540+0000","mapping_epoch":16,"log_start":"0'0","ondisk_log_start":"0'0","created":16,"last_epoch_clean":17,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-08-01T19:54:04.040663+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-08-01T19:54:04.040663+0000","last_clean_scrub_stamp":"2023-08-01T19:54:04.040663+0000","objects_scrubbed":0,"log_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-08-03T02:20:23.354054+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[2,1],"acting":[2,1],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":2,"acting_primary":2,"purged_snaps":[]}],"pool_stats":[{"poolid":4,"num_pg":64,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"store_stats":{"total":0,"available":0,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},"log_size":0,"ondisk_log_size":0,"up":128,"acting":128,"num_store_stats":3},{"poolid":3,"num_pg":32,"stat_sum":{"num_bytes":2306,"num_objects":22,"num_object_clones":0,"num_object_copies":44,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":22,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":45,"num_write_kb":13,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":14,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"store_stats":{"total":0,"available":0,"internally_reserved":0,"allocated":65536,"data_stored":4612,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},"log_size":39,"ondisk_log_size":39,"up":64,"acting":64,"num_store_stats":3},{"poolid":1,"num_pg":1,"stat_sum":{"num_bytes":590368,"num_objects":2,"num_object_clones":0,"num_object_copies":4,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":2,"num_whiteouts":0,"num_read":136,"num_read_kb":118,"num_write":203,"num_write_kb":3460,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"store_stats":{"total":0,"available":0,"internally_reserved":0,"allocated":114688,"data_stored":1180736,"data_compressed":20662,"data_compressed_allocated":73728,"data_compressed_original":1146880,"omap_allocated":0,"internal_metadata":0},"log_size":157,"ondisk_log_size":157,"up":2,"acting":2,"num_store_stats":2},{"poolid":2,"num_pg":8,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"store_stats":{"total":0,"available":0,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},"log_size":0,"ondisk_log_size":0,"up":16,"acting":16,"num_store_stats":3}],"osd_stats":[{"osd":2,"up_from":9,"seq":38654705672,"num_pgs":67,"num_osds":1,"num_per_pool_osds":1,"num_per_pool_omap_osds":1,"kb":94371840,"kb_used":9264,"kb_used_data":232,"kb_used_omap":0,"kb_used_meta":9024,"kb_avail":94362576,"statfs":{"total":96636764160,"available":96627277824,"internally_reserved":0,"allocated":237568,"data_stored":647231,"data_compressed":10331,"data_compressed_allocated":36864,"data_compressed_original":573440,"omap_allocated":0,"internal_metadata":9240576},"hb_peers":[0,1],"snap_trim_queue_len":0,"num_snap_trimming":0,"num_shards_repaired":0,"op_queue_age_hist":{"histogram":[],"upper_bound":1},"perf_stat":{"commit_latency_ms":0,"apply_latency_ms":0,"commit_latency_ns":0,"apply_latency_ns":0},"alerts":[],"network_ping_times":[{"osd":0,"last update":"Thu Jan 1 00:00:00 1970","interfaces":[{"interface":"back","average":{"1min":0,"5min":0,"15min":0},"min":{"1min":0,"5min":0,"15min":0},"max":{"1min":0,"5min":0,"15min":0},"last":0.40300000000000002}]},{"osd":1,"last update":"Thu Jan 1 00:00:00 1970","interfaces":[{"interface":"back","average":{"1min":0,"5min":0,"15min":0},"min":{"1min":0,"5min":0,"15min":0},"max":{"1min":0,"5min":0,"15min":0},"last":0.52000000000000002}]}]},{"osd":0,"up_from":8,"seq":34359738375,"num_pgs":72,"num_osds":1,"num_per_pool_osds":1,"num_per_pool_omap_osds":1,"kb":94371840,"kb_used":12648,"kb_used_data":160,"kb_used_omap":0,"kb_used_meta":12480,"kb_avail":94359192,"statfs":{"total":96636764160,"available":96623812608,"internally_reserved":0,"allocated":163840,"data_stored":55733,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":12779520},"hb_peers":[1,2],"snap_trim_queue_len":0,"num_snap_trimming":0,"num_shards_repaired":0,"op_queue_age_hist":{"histogram":[],"upper_bound":1},"perf_stat":{"commit_latency_ms":0,"apply_latency_ms":0,"commit_latency_ns":0,"apply_latency_ns":0},"alerts":[],"network_ping_times":[{"osd":1,"last update":"Thu Jan 1 00:00:00 1970","interfaces":[{"interface":"back","average":{"1min":0,"5min":0,"15min":0},"min":{"1min":0,"5min":0,"15min":0},"max":{"1min":0,"5min":0,"15min":0},"last":0.45200000000000001}]},{"osd":2,"last update":"Thu Jan 1 00:00:00 1970","interfaces":[{"interface":"back","average":{"1min":0,"5min":0,"15min":0},"min":{"1min":0,"5min":0,"15min":0},"max":{"1min":0,"5min":0,"15min":0},"last":0.52100000000000002}]}]},{"osd":1,"up_from":8,"seq":34359738374,"num_pgs":71,"num_osds":1,"num_per_pool_osds":1,"num_per_pool_omap_osds":1,"kb":94371840,"kb_used":9336,"kb_used_data":240,"kb_used_omap":0,"kb_used_meta":9088,"kb_avail":94362504,"statfs":{"total":96636764160,"available":96627204096,"internally_reserved":0,"allocated":245760,"data_stored":647819,"data_compressed":10331,"data_compressed_allocated":36864,"data_compressed_original":573440,"omap_allocated":0,"internal_metadata":9306112},"hb_peers":[0,2],"snap_trim_queue_len":0,"num_snap_trimming":0,"num_shards_repaired":0,"op_queue_age_hist":{"histogram":[],"upper_bound":1},"perf_stat":{"commit_latency_ms":0,"apply_latency_ms":0,"commit_latency_ns":0,"apply_latency_ns":0},"alerts":[],"network_ping_times":[{"osd":0,"last update":"Thu Jan 1 00:00:00 1970","interfaces":[{"interface":"back","average":{"1min":0,"5min":0,"15min":0},"min":{"1min":0,"5min":0,"15min":0},"max":{"1min":0,"5min":0,"15min":0},"last":0.53100000000000003}]},{"osd":2,"last update":"Thu Jan 1 00:00:00 1970","interfaces":[{"interface":"back","average":{"1min":0,"5min":0,"15min":0},"min":{"1min":0,"5min":0,"15min":0},"max":{"1min":0,"5min":0,"15min":0},"last":0.58299999999999996}]}]}],"pool_statfs":[{"poolid":1,"osd":1,"total":0,"available":0,"internally_reserved":0,"allocated":57344,"data_stored":590368,"data_compressed":10331,"data_compressed_allocated":36864,"data_compressed_original":573440,"omap_allocated":0,"internal_metadata":0},{"poolid":1,"osd":2,"total":0,"available":0,"internally_reserved":0,"allocated":57344,"data_stored":590368,"data_compressed":10331,"data_compressed_allocated":36864,"data_compressed_original":573440,"omap_allocated":0,"internal_metadata":0},{"poolid":2,"osd":0,"total":0,"available":0,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":2,"osd":1,"total":0,"available":0,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":2,"osd":2,"total":0,"available":0,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":3,"osd":0,"total":0,"available":0,"internally_reserved":0,"allocated":8192,"data_stored":588,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":3,"osd":1,"total":0,"available":0,"internally_reserved":0,"allocated":32768,"data_stored":2306,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":3,"osd":2,"total":0,"available":0,"internally_reserved":0,"allocated":24576,"data_stored":1718,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":4,"osd":0,"total":0,"available":0,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":4,"osd":1,"total":0,"available":0,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":4,"osd":2,"total":0,"available":0,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0}]}} 2023-08-01T19:54:13.864 DEBUG:teuthology.orchestra.run.smithi006:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 120 ceph --cluster ceph pg dump --format=json 2023-08-01T19:54:14.226 INFO:teuthology.orchestra.run.smithi006.stdout: 2023-08-01T19:54:14.227 INFO:teuthology.orchestra.run.smithi006.stderr:dumped all 2023-08-01T19:54:14.239 INFO:teuthology.orchestra.run.smithi006.stdout:{"pg_ready":true,"pg_map":{"version":27,"stamp":"2023-08-01T19:54:13.909652+0000","last_osdmap_epoch":0,"last_pg_scan":0,"pg_stats_sum":{"stat_sum":{"num_bytes":592674,"num_objects":24,"num_object_clones":0,"num_object_copies":48,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":24,"num_whiteouts":0,"num_read":136,"num_read_kb":118,"num_write":248,"num_write_kb":3473,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":14,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"store_stats":{"total":0,"available":0,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},"log_size":196,"ondisk_log_size":196,"up":210,"acting":210,"num_store_stats":0},"osd_stats_sum":{"up_from":0,"seq":0,"num_pgs":210,"num_osds":3,"num_per_pool_osds":3,"num_per_pool_omap_osds":3,"kb":283115520,"kb_used":31248,"kb_used_data":632,"kb_used_omap":0,"kb_used_meta":30592,"kb_avail":283084272,"statfs":{"total":289910292480,"available":289878294528,"internally_reserved":0,"allocated":647168,"data_stored":1350783,"data_compressed":20662,"data_compressed_allocated":73728,"data_compressed_original":1146880,"omap_allocated":0,"internal_metadata":31326208},"hb_peers":[],"snap_trim_queue_len":0,"num_snap_trimming":0,"num_shards_repaired":0,"op_queue_age_hist":{"histogram":[],"upper_bound":1},"perf_stat":{"commit_latency_ms":0,"apply_latency_ms":0,"commit_latency_ns":0,"apply_latency_ns":0},"alerts":[],"network_ping_times":[]},"pg_stats_delta":{"stat_sum":{"num_bytes":2306,"num_objects":22,"num_object_clones":0,"num_object_copies":44,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":22,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":45,"num_write_kb":13,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":14,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"store_stats":{"total":0,"available":0,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},"log_size":0,"ondisk_log_size":0,"up":0,"acting":0,"num_store_stats":0,"stamp_delta":"9.454041"},"pg_stats":[{"pgid":"4.3f","version":"0'0","reported_seq":9,"reported_epoch":17,"state":"active+clean","last_fresh":"2023-08-01T19:54:04.477207+0000","last_change":"2023-08-01T19:54:04.473430+0000","last_active":"2023-08-01T19:54:04.477207+0000","last_peered":"2023-08-01T19:54:04.477207+0000","last_clean":"2023-08-01T19:54:04.477207+0000","last_became_active":"2023-08-01T19:54:04.472887+0000","last_became_peered":"2023-08-01T19:54:04.472887+0000","last_unstale":"2023-08-01T19:54:04.477207+0000","last_undegraded":"2023-08-01T19:54:04.477207+0000","last_fullsized":"2023-08-01T19:54:04.477207+0000","mapping_epoch":16,"log_start":"0'0","ondisk_log_start":"0'0","created":16,"last_epoch_clean":17,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-08-01T19:54:04.040663+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-08-01T19:54:04.040663+0000","last_clean_scrub_stamp":"2023-08-01T19:54:04.040663+0000","objects_scrubbed":0,"log_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-08-03T06:38:54.196605+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[2,0],"acting":[2,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":2,"acting_primary":2,"purged_snaps":[]},{"pgid":"4.3e","version":"0'0","reported_seq":9,"reported_epoch":17,"state":"active+clean","last_fresh":"2023-08-01T19:54:04.472547+0000","last_change":"2023-08-01T19:54:04.470501+0000","last_active":"2023-08-01T19:54:04.472547+0000","last_peered":"2023-08-01T19:54:04.472547+0000","last_clean":"2023-08-01T19:54:04.472547+0000","last_became_active":"2023-08-01T19:54:04.469692+0000","last_became_peered":"2023-08-01T19:54:04.469692+0000","last_unstale":"2023-08-01T19:54:04.472547+0000","last_undegraded":"2023-08-01T19:54:04.472547+0000","last_fullsized":"2023-08-01T19:54:04.472547+0000","mapping_epoch":16,"log_start":"0'0","ondisk_log_start":"0'0","created":16,"last_epoch_clean":17,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-08-01T19:54:04.040663+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-08-01T19:54:04.040663+0000","last_clean_scrub_stamp":"2023-08-01T19:54:04.040663+0000","objects_scrubbed":0,"log_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-08-03T02:19:35.201107+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[2,0],"acting":[2,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":2,"acting_primary":2,"purged_snaps":[]},{"pgid":"4.3d","version":"0'0","reported_seq":9,"reported_epoch":17,"state":"active+clean","last_fresh":"2023-08-01T19:54:04.477342+0000","last_change":"2023-08-01T19:54:04.472579+0000","last_active":"2023-08-01T19:54:04.477342+0000","last_peered":"2023-08-01T19:54:04.477342+0000","last_clean":"2023-08-01T19:54:04.477342+0000","last_became_active":"2023-08-01T19:54:04.471128+0000","last_became_peered":"2023-08-01T19:54:04.471128+0000","last_unstale":"2023-08-01T19:54:04.477342+0000","last_undegraded":"2023-08-01T19:54:04.477342+0000","last_fullsized":"2023-08-01T19:54:04.477342+0000","mapping_epoch":16,"log_start":"0'0","ondisk_log_start":"0'0","created":16,"last_epoch_clean":17,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-08-01T19:54:04.040663+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-08-01T19:54:04.040663+0000","last_clean_scrub_stamp":"2023-08-01T19:54:04.040663+0000","objects_scrubbed":0,"log_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-08-03T03:04:06.137335+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[1,2],"acting":[1,2],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":1,"acting_primary":1,"purged_snaps":[]},{"pgid":"4.3c","version":"0'0","reported_seq":9,"reported_epoch":17,"state":"active+clean","last_fresh":"2023-08-01T19:54:04.479161+0000","last_change":"2023-08-01T19:54:04.477908+0000","last_active":"2023-08-01T19:54:04.479161+0000","last_peered":"2023-08-01T19:54:04.479161+0000","last_clean":"2023-08-01T19:54:04.479161+0000","last_became_active":"2023-08-01T19:54:04.476684+0000","last_became_peered":"2023-08-01T19:54:04.476684+0000","last_unstale":"2023-08-01T19:54:04.479161+0000","last_undegraded":"2023-08-01T19:54:04.479161+0000","last_fullsized":"2023-08-01T19:54:04.479161+0000","mapping_epoch":16,"log_start":"0'0","ondisk_log_start":"0'0","created":16,"last_epoch_clean":17,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-08-01T19:54:04.040663+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-08-01T19:54:04.040663+0000","last_clean_scrub_stamp":"2023-08-01T19:54:04.040663+0000","objects_scrubbed":0,"log_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-08-03T03:56:55.336461+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[1,0],"acting":[1,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":1,"acting_primary":1,"purged_snaps":[]},{"pgid":"4.3b","version":"0'0","reported_seq":9,"reported_epoch":17,"state":"active+clean","last_fresh":"2023-08-01T19:54:04.469848+0000","last_change":"2023-08-01T19:54:04.467197+0000","last_active":"2023-08-01T19:54:04.469848+0000","last_peered":"2023-08-01T19:54:04.469848+0000","last_clean":"2023-08-01T19:54:04.469848+0000","last_became_active":"2023-08-01T19:54:04.466526+0000","last_became_peered":"2023-08-01T19:54:04.466526+0000","last_unstale":"2023-08-01T19:54:04.469848+0000","last_undegraded":"2023-08-01T19:54:04.469848+0000","last_fullsized":"2023-08-01T19:54:04.469848+0000","mapping_epoch":16,"log_start":"0'0","ondisk_log_start":"0'0","created":16,"last_epoch_clean":17,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-08-01T19:54:04.040663+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-08-01T19:54:04.040663+0000","last_clean_scrub_stamp":"2023-08-01T19:54:04.040663+0000","objects_scrubbed":0,"log_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-08-03T06:54:18.982174+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[2,0],"acting":[2,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":2,"acting_primary":2,"purged_snaps":[]},{"pgid":"4.3a","version":"0'0","reported_seq":9,"reported_epoch":17,"state":"active+clean","last_fresh":"2023-08-01T19:54:04.477568+0000","last_change":"2023-08-01T19:54:04.473296+0000","last_active":"2023-08-01T19:54:04.477568+0000","last_peered":"2023-08-01T19:54:04.477568+0000","last_clean":"2023-08-01T19:54:04.477568+0000","last_became_active":"2023-08-01T19:54:04.472324+0000","last_became_peered":"2023-08-01T19:54:04.472324+0000","last_unstale":"2023-08-01T19:54:04.477568+0000","last_undegraded":"2023-08-01T19:54:04.477568+0000","last_fullsized":"2023-08-01T19:54:04.477568+0000","mapping_epoch":16,"log_start":"0'0","ondisk_log_start":"0'0","created":16,"last_epoch_clean":17,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-08-01T19:54:04.040663+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-08-01T19:54:04.040663+0000","last_clean_scrub_stamp":"2023-08-01T19:54:04.040663+0000","objects_scrubbed":0,"log_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-08-02T23:15:11.148662+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[1,0],"acting":[1,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":1,"acting_primary":1,"purged_snaps":[]},{"pgid":"4.39","version":"0'0","reported_seq":9,"reported_epoch":17,"state":"active+clean","last_fresh":"2023-08-01T19:54:04.478215+0000","last_change":"2023-08-01T19:54:04.475322+0000","last_active":"2023-08-01T19:54:04.478215+0000","last_peered":"2023-08-01T19:54:04.478215+0000","last_clean":"2023-08-01T19:54:04.478215+0000","last_became_active":"2023-08-01T19:54:04.474591+0000","last_became_peered":"2023-08-01T19:54:04.474591+0000","last_unstale":"2023-08-01T19:54:04.478215+0000","last_undegraded":"2023-08-01T19:54:04.478215+0000","last_fullsized":"2023-08-01T19:54:04.478215+0000","mapping_epoch":16,"log_start":"0'0","ondisk_log_start":"0'0","created":16,"last_epoch_clean":17,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-08-01T19:54:04.040663+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-08-01T19:54:04.040663+0000","last_clean_scrub_stamp":"2023-08-01T19:54:04.040663+0000","objects_scrubbed":0,"log_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-08-03T00:29:53.554989+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[1,0],"acting":[1,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":1,"acting_primary":1,"purged_snaps":[]},{"pgid":"4.38","version":"0'0","reported_seq":9,"reported_epoch":17,"state":"active+clean","last_fresh":"2023-08-01T19:54:04.479227+0000","last_change":"2023-08-01T19:54:04.478505+0000","last_active":"2023-08-01T19:54:04.479227+0000","last_peered":"2023-08-01T19:54:04.479227+0000","last_clean":"2023-08-01T19:54:04.479227+0000","last_became_active":"2023-08-01T19:54:04.477325+0000","last_became_peered":"2023-08-01T19:54:04.477325+0000","last_unstale":"2023-08-01T19:54:04.479227+0000","last_undegraded":"2023-08-01T19:54:04.479227+0000","last_fullsized":"2023-08-01T19:54:04.479227+0000","mapping_epoch":16,"log_start":"0'0","ondisk_log_start":"0'0","created":16,"last_epoch_clean":17,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-08-01T19:54:04.040663+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-08-01T19:54:04.040663+0000","last_clean_scrub_stamp":"2023-08-01T19:54:04.040663+0000","objects_scrubbed":0,"log_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-08-03T01:38:12.939736+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[1,0],"acting":[1,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":1,"acting_primary":1,"purged_snaps":[]},{"pgid":"4.37","version":"0'0","reported_seq":9,"reported_epoch":17,"state":"active+clean","last_fresh":"2023-08-01T19:54:04.472944+0000","last_change":"2023-08-01T19:54:04.470971+0000","last_active":"2023-08-01T19:54:04.472944+0000","last_peered":"2023-08-01T19:54:04.472944+0000","last_clean":"2023-08-01T19:54:04.472944+0000","last_became_active":"2023-08-01T19:54:04.469011+0000","last_became_peered":"2023-08-01T19:54:04.469011+0000","last_unstale":"2023-08-01T19:54:04.472944+0000","last_undegraded":"2023-08-01T19:54:04.472944+0000","last_fullsized":"2023-08-01T19:54:04.472944+0000","mapping_epoch":16,"log_start":"0'0","ondisk_log_start":"0'0","created":16,"last_epoch_clean":17,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-08-01T19:54:04.040663+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-08-01T19:54:04.040663+0000","last_clean_scrub_stamp":"2023-08-01T19:54:04.040663+0000","objects_scrubbed":0,"log_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-08-03T06:50:03.420334+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[0,2],"acting":[0,2],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":0,"acting_primary":0,"purged_snaps":[]},{"pgid":"4.36","version":"0'0","reported_seq":9,"reported_epoch":17,"state":"active+clean","last_fresh":"2023-08-01T19:54:04.477220+0000","last_change":"2023-08-01T19:54:04.473523+0000","last_active":"2023-08-01T19:54:04.477220+0000","last_peered":"2023-08-01T19:54:04.477220+0000","last_clean":"2023-08-01T19:54:04.477220+0000","last_became_active":"2023-08-01T19:54:04.473084+0000","last_became_peered":"2023-08-01T19:54:04.473084+0000","last_unstale":"2023-08-01T19:54:04.477220+0000","last_undegraded":"2023-08-01T19:54:04.477220+0000","last_fullsized":"2023-08-01T19:54:04.477220+0000","mapping_epoch":16,"log_start":"0'0","ondisk_log_start":"0'0","created":16,"last_epoch_clean":17,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-08-01T19:54:04.040663+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-08-01T19:54:04.040663+0000","last_clean_scrub_stamp":"2023-08-01T19:54:04.040663+0000","objects_scrubbed":0,"log_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-08-03T04:28:59.042443+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[2,0],"acting":[2,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":2,"acting_primary":2,"purged_snaps":[]},{"pgid":"4.35","version":"0'0","reported_seq":9,"reported_epoch":17,"state":"active+clean","last_fresh":"2023-08-01T19:54:04.478818+0000","last_change":"2023-08-01T19:54:04.475816+0000","last_active":"2023-08-01T19:54:04.478818+0000","last_peered":"2023-08-01T19:54:04.478818+0000","last_clean":"2023-08-01T19:54:04.478818+0000","last_became_active":"2023-08-01T19:54:04.475061+0000","last_became_peered":"2023-08-01T19:54:04.475061+0000","last_unstale":"2023-08-01T19:54:04.478818+0000","last_undegraded":"2023-08-01T19:54:04.478818+0000","last_fullsized":"2023-08-01T19:54:04.478818+0000","mapping_epoch":16,"log_start":"0'0","ondisk_log_start":"0'0","created":16,"last_epoch_clean":17,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-08-01T19:54:04.040663+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-08-01T19:54:04.040663+0000","last_clean_scrub_stamp":"2023-08-01T19:54:04.040663+0000","objects_scrubbed":0,"log_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-08-02T22:07:41.305488+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[1,0],"acting":[1,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":1,"acting_primary":1,"purged_snaps":[]},{"pgid":"4.34","version":"0'0","reported_seq":9,"reported_epoch":17,"state":"active+clean","last_fresh":"2023-08-01T19:54:04.470323+0000","last_change":"2023-08-01T19:54:04.468009+0000","last_active":"2023-08-01T19:54:04.470323+0000","last_peered":"2023-08-01T19:54:04.470323+0000","last_clean":"2023-08-01T19:54:04.470323+0000","last_became_active":"2023-08-01T19:54:04.467568+0000","last_became_peered":"2023-08-01T19:54:04.467568+0000","last_unstale":"2023-08-01T19:54:04.470323+0000","last_undegraded":"2023-08-01T19:54:04.470323+0000","last_fullsized":"2023-08-01T19:54:04.470323+0000","mapping_epoch":16,"log_start":"0'0","ondisk_log_start":"0'0","created":16,"last_epoch_clean":17,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-08-01T19:54:04.040663+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-08-01T19:54:04.040663+0000","last_clean_scrub_stamp":"2023-08-01T19:54:04.040663+0000","objects_scrubbed":0,"log_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-08-03T04:53:44.017572+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[2,1],"acting":[2,1],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":2,"acting_primary":2,"purged_snaps":[]},{"pgid":"4.33","version":"0'0","reported_seq":9,"reported_epoch":17,"state":"active+clean","last_fresh":"2023-08-01T19:54:04.468611+0000","last_change":"2023-08-01T19:54:04.466770+0000","last_active":"2023-08-01T19:54:04.468611+0000","last_peered":"2023-08-01T19:54:04.468611+0000","last_clean":"2023-08-01T19:54:04.468611+0000","last_became_active":"2023-08-01T19:54:04.466460+0000","last_became_peered":"2023-08-01T19:54:04.466460+0000","last_unstale":"2023-08-01T19:54:04.468611+0000","last_undegraded":"2023-08-01T19:54:04.468611+0000","last_fullsized":"2023-08-01T19:54:04.468611+0000","mapping_epoch":16,"log_start":"0'0","ondisk_log_start":"0'0","created":16,"last_epoch_clean":17,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-08-01T19:54:04.040663+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-08-01T19:54:04.040663+0000","last_clean_scrub_stamp":"2023-08-01T19:54:04.040663+0000","objects_scrubbed":0,"log_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-08-03T06:04:11.595951+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[2,0],"acting":[2,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":2,"acting_primary":2,"purged_snaps":[]},{"pgid":"4.32","version":"0'0","reported_seq":9,"reported_epoch":17,"state":"active+clean","last_fresh":"2023-08-01T19:54:04.469801+0000","last_change":"2023-08-01T19:54:04.466634+0000","last_active":"2023-08-01T19:54:04.469801+0000","last_peered":"2023-08-01T19:54:04.469801+0000","last_clean":"2023-08-01T19:54:04.469801+0000","last_became_active":"2023-08-01T19:54:04.466302+0000","last_became_peered":"2023-08-01T19:54:04.466302+0000","last_unstale":"2023-08-01T19:54:04.469801+0000","last_undegraded":"2023-08-01T19:54:04.469801+0000","last_fullsized":"2023-08-01T19:54:04.469801+0000","mapping_epoch":16,"log_start":"0'0","ondisk_log_start":"0'0","created":16,"last_epoch_clean":17,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-08-01T19:54:04.040663+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-08-01T19:54:04.040663+0000","last_clean_scrub_stamp":"2023-08-01T19:54:04.040663+0000","objects_scrubbed":0,"log_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-08-03T05:46:11.085577+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[1,2],"acting":[1,2],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":1,"acting_primary":1,"purged_snaps":[]},{"pgid":"4.31","version":"0'0","reported_seq":9,"reported_epoch":17,"state":"active+clean","last_fresh":"2023-08-01T19:54:04.476575+0000","last_change":"2023-08-01T19:54:04.472407+0000","last_active":"2023-08-01T19:54:04.476575+0000","last_peered":"2023-08-01T19:54:04.476575+0000","last_clean":"2023-08-01T19:54:04.476575+0000","last_became_active":"2023-08-01T19:54:04.472008+0000","last_became_peered":"2023-08-01T19:54:04.472008+0000","last_unstale":"2023-08-01T19:54:04.476575+0000","last_undegraded":"2023-08-01T19:54:04.476575+0000","last_fullsized":"2023-08-01T19:54:04.476575+0000","mapping_epoch":16,"log_start":"0'0","ondisk_log_start":"0'0","created":16,"last_epoch_clean":17,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-08-01T19:54:04.040663+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-08-01T19:54:04.040663+0000","last_clean_scrub_stamp":"2023-08-01T19:54:04.040663+0000","objects_scrubbed":0,"log_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-08-02T22:42:25.293502+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[1,2],"acting":[1,2],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":1,"acting_primary":1,"purged_snaps":[]},{"pgid":"4.30","version":"0'0","reported_seq":9,"reported_epoch":17,"state":"active+clean","last_fresh":"2023-08-01T19:54:04.479184+0000","last_change":"2023-08-01T19:54:04.478283+0000","last_active":"2023-08-01T19:54:04.479184+0000","last_peered":"2023-08-01T19:54:04.479184+0000","last_clean":"2023-08-01T19:54:04.479184+0000","last_became_active":"2023-08-01T19:54:04.476620+0000","last_became_peered":"2023-08-01T19:54:04.476620+0000","last_unstale":"2023-08-01T19:54:04.479184+0000","last_undegraded":"2023-08-01T19:54:04.479184+0000","last_fullsized":"2023-08-01T19:54:04.479184+0000","mapping_epoch":16,"log_start":"0'0","ondisk_log_start":"0'0","created":16,"last_epoch_clean":17,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-08-01T19:54:04.040663+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-08-01T19:54:04.040663+0000","last_clean_scrub_stamp":"2023-08-01T19:54:04.040663+0000","objects_scrubbed":0,"log_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-08-03T02:27:17.063518+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[1,0],"acting":[1,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":1,"acting_primary":1,"purged_snaps":[]},{"pgid":"4.2f","version":"0'0","reported_seq":9,"reported_epoch":17,"state":"active+clean","last_fresh":"2023-08-01T19:54:04.472916+0000","last_change":"2023-08-01T19:54:04.470302+0000","last_active":"2023-08-01T19:54:04.472916+0000","last_peered":"2023-08-01T19:54:04.472916+0000","last_clean":"2023-08-01T19:54:04.472916+0000","last_became_active":"2023-08-01T19:54:04.468919+0000","last_became_peered":"2023-08-01T19:54:04.468919+0000","last_unstale":"2023-08-01T19:54:04.472916+0000","last_undegraded":"2023-08-01T19:54:04.472916+0000","last_fullsized":"2023-08-01T19:54:04.472916+0000","mapping_epoch":16,"log_start":"0'0","ondisk_log_start":"0'0","created":16,"last_epoch_clean":17,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-08-01T19:54:04.040663+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-08-01T19:54:04.040663+0000","last_clean_scrub_stamp":"2023-08-01T19:54:04.040663+0000","objects_scrubbed":0,"log_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-08-02T22:42:25.293502+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[0,2],"acting":[0,2],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":0,"acting_primary":0,"purged_snaps":[]},{"pgid":"4.2e","version":"0'0","reported_seq":9,"reported_epoch":17,"state":"active+clean","last_fresh":"2023-08-01T19:54:04.477303+0000","last_change":"2023-08-01T19:54:04.474058+0000","last_active":"2023-08-01T19:54:04.477303+0000","last_peered":"2023-08-01T19:54:04.477303+0000","last_clean":"2023-08-01T19:54:04.477303+0000","last_became_active":"2023-08-01T19:54:04.473355+0000","last_became_peered":"2023-08-01T19:54:04.473355+0000","last_unstale":"2023-08-01T19:54:04.477303+0000","last_undegraded":"2023-08-01T19:54:04.477303+0000","last_fullsized":"2023-08-01T19:54:04.477303+0000","mapping_epoch":16,"log_start":"0'0","ondisk_log_start":"0'0","created":16,"last_epoch_clean":17,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-08-01T19:54:04.040663+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-08-01T19:54:04.040663+0000","last_clean_scrub_stamp":"2023-08-01T19:54:04.040663+0000","objects_scrubbed":0,"log_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-08-03T04:55:54.197252+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[2,0],"acting":[2,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":2,"acting_primary":2,"purged_snaps":[]},{"pgid":"4.2d","version":"0'0","reported_seq":9,"reported_epoch":17,"state":"active+clean","last_fresh":"2023-08-01T19:54:04.472287+0000","last_change":"2023-08-01T19:54:04.468775+0000","last_active":"2023-08-01T19:54:04.472287+0000","last_peered":"2023-08-01T19:54:04.472287+0000","last_clean":"2023-08-01T19:54:04.472287+0000","last_became_active":"2023-08-01T19:54:04.467274+0000","last_became_peered":"2023-08-01T19:54:04.467274+0000","last_unstale":"2023-08-01T19:54:04.472287+0000","last_undegraded":"2023-08-01T19:54:04.472287+0000","last_fullsized":"2023-08-01T19:54:04.472287+0000","mapping_epoch":16,"log_start":"0'0","ondisk_log_start":"0'0","created":16,"last_epoch_clean":17,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-08-01T19:54:04.040663+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-08-01T19:54:04.040663+0000","last_clean_scrub_stamp":"2023-08-01T19:54:04.040663+0000","objects_scrubbed":0,"log_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-08-02T23:00:37.537286+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[0,2],"acting":[0,2],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":0,"acting_primary":0,"purged_snaps":[]},{"pgid":"4.2c","version":"0'0","reported_seq":9,"reported_epoch":17,"state":"active+clean","last_fresh":"2023-08-01T19:54:04.479196+0000","last_change":"2023-08-01T19:54:04.478409+0000","last_active":"2023-08-01T19:54:04.479196+0000","last_peered":"2023-08-01T19:54:04.479196+0000","last_clean":"2023-08-01T19:54:04.479196+0000","last_became_active":"2023-08-01T19:54:04.477133+0000","last_became_peered":"2023-08-01T19:54:04.477133+0000","last_unstale":"2023-08-01T19:54:04.479196+0000","last_undegraded":"2023-08-01T19:54:04.479196+0000","last_fullsized":"2023-08-01T19:54:04.479196+0000","mapping_epoch":16,"log_start":"0'0","ondisk_log_start":"0'0","created":16,"last_epoch_clean":17,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-08-01T19:54:04.040663+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-08-01T19:54:04.040663+0000","last_clean_scrub_stamp":"2023-08-01T19:54:04.040663+0000","objects_scrubbed":0,"log_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-08-02T22:15:19.744281+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[1,0],"acting":[1,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":1,"acting_primary":1,"purged_snaps":[]},{"pgid":"4.2b","version":"0'0","reported_seq":9,"reported_epoch":17,"state":"active+clean","last_fresh":"2023-08-01T19:54:04.477876+0000","last_change":"2023-08-01T19:54:04.474047+0000","last_active":"2023-08-01T19:54:04.477876+0000","last_peered":"2023-08-01T19:54:04.477876+0000","last_clean":"2023-08-01T19:54:04.477876+0000","last_became_active":"2023-08-01T19:54:04.473578+0000","last_became_peered":"2023-08-01T19:54:04.473578+0000","last_unstale":"2023-08-01T19:54:04.477876+0000","last_undegraded":"2023-08-01T19:54:04.477876+0000","last_fullsized":"2023-08-01T19:54:04.477876+0000","mapping_epoch":16,"log_start":"0'0","ondisk_log_start":"0'0","created":16,"last_epoch_clean":17,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-08-01T19:54:04.040663+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-08-01T19:54:04.040663+0000","last_clean_scrub_stamp":"2023-08-01T19:54:04.040663+0000","objects_scrubbed":0,"log_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-08-03T05:39:29.199142+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[1,0],"acting":[1,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":1,"acting_primary":1,"purged_snaps":[]},{"pgid":"4.2a","version":"0'0","reported_seq":9,"reported_epoch":17,"state":"active+clean","last_fresh":"2023-08-01T19:54:04.470833+0000","last_change":"2023-08-01T19:54:04.469281+0000","last_active":"2023-08-01T19:54:04.470833+0000","last_peered":"2023-08-01T19:54:04.470833+0000","last_clean":"2023-08-01T19:54:04.470833+0000","last_became_active":"2023-08-01T19:54:04.468771+0000","last_became_peered":"2023-08-01T19:54:04.468771+0000","last_unstale":"2023-08-01T19:54:04.470833+0000","last_undegraded":"2023-08-01T19:54:04.470833+0000","last_fullsized":"2023-08-01T19:54:04.470833+0000","mapping_epoch":16,"log_start":"0'0","ondisk_log_start":"0'0","created":16,"last_epoch_clean":17,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-08-01T19:54:04.040663+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-08-01T19:54:04.040663+0000","last_clean_scrub_stamp":"2023-08-01T19:54:04.040663+0000","objects_scrubbed":0,"log_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-08-03T01:15:27.748810+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[2,1],"acting":[2,1],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":2,"acting_primary":2,"purged_snaps":[]},{"pgid":"4.29","version":"0'0","reported_seq":9,"reported_epoch":17,"state":"active+clean","last_fresh":"2023-08-01T19:54:04.471410+0000","last_change":"2023-08-01T19:54:04.466694+0000","last_active":"2023-08-01T19:54:04.471410+0000","last_peered":"2023-08-01T19:54:04.471410+0000","last_clean":"2023-08-01T19:54:04.471410+0000","last_became_active":"2023-08-01T19:54:04.466250+0000","last_became_peered":"2023-08-01T19:54:04.466250+0000","last_unstale":"2023-08-01T19:54:04.471410+0000","last_undegraded":"2023-08-01T19:54:04.471410+0000","last_fullsized":"2023-08-01T19:54:04.471410+0000","mapping_epoch":16,"log_start":"0'0","ondisk_log_start":"0'0","created":16,"last_epoch_clean":17,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-08-01T19:54:04.040663+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-08-01T19:54:04.040663+0000","last_clean_scrub_stamp":"2023-08-01T19:54:04.040663+0000","objects_scrubbed":0,"log_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-08-03T01:00:18.725898+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[0,1],"acting":[0,1],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":0,"acting_primary":0,"purged_snaps":[]},{"pgid":"4.28","version":"0'0","reported_seq":9,"reported_epoch":17,"state":"active+clean","last_fresh":"2023-08-01T19:54:04.470337+0000","last_change":"2023-08-01T19:54:04.468160+0000","last_active":"2023-08-01T19:54:04.470337+0000","last_peered":"2023-08-01T19:54:04.470337+0000","last_clean":"2023-08-01T19:54:04.470337+0000","last_became_active":"2023-08-01T19:54:04.467625+0000","last_became_peered":"2023-08-01T19:54:04.467625+0000","last_unstale":"2023-08-01T19:54:04.470337+0000","last_undegraded":"2023-08-01T19:54:04.470337+0000","last_fullsized":"2023-08-01T19:54:04.470337+0000","mapping_epoch":16,"log_start":"0'0","ondisk_log_start":"0'0","created":16,"last_epoch_clean":17,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-08-01T19:54:04.040663+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-08-01T19:54:04.040663+0000","last_clean_scrub_stamp":"2023-08-01T19:54:04.040663+0000","objects_scrubbed":0,"log_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-08-02T21:27:52.506153+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[2,0],"acting":[2,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":2,"acting_primary":2,"purged_snaps":[]},{"pgid":"4.27","version":"0'0","reported_seq":9,"reported_epoch":17,"state":"active+clean","last_fresh":"2023-08-01T19:54:04.470777+0000","last_change":"2023-08-01T19:54:04.469187+0000","last_active":"2023-08-01T19:54:04.470777+0000","last_peered":"2023-08-01T19:54:04.470777+0000","last_clean":"2023-08-01T19:54:04.470777+0000","last_became_active":"2023-08-01T19:54:04.468628+0000","last_became_peered":"2023-08-01T19:54:04.468628+0000","last_unstale":"2023-08-01T19:54:04.470777+0000","last_undegraded":"2023-08-01T19:54:04.470777+0000","last_fullsized":"2023-08-01T19:54:04.470777+0000","mapping_epoch":16,"log_start":"0'0","ondisk_log_start":"0'0","created":16,"last_epoch_clean":17,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-08-01T19:54:04.040663+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-08-01T19:54:04.040663+0000","last_clean_scrub_stamp":"2023-08-01T19:54:04.040663+0000","objects_scrubbed":0,"log_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-08-03T00:07:29.565677+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[2,1],"acting":[2,1],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":2,"acting_primary":2,"purged_snaps":[]},{"pgid":"4.26","version":"0'0","reported_seq":9,"reported_epoch":17,"state":"active+clean","last_fresh":"2023-08-01T19:54:04.472976+0000","last_change":"2023-08-01T19:54:04.470942+0000","last_active":"2023-08-01T19:54:04.472976+0000","last_peered":"2023-08-01T19:54:04.472976+0000","last_clean":"2023-08-01T19:54:04.472976+0000","last_became_active":"2023-08-01T19:54:04.470564+0000","last_became_peered":"2023-08-01T19:54:04.470564+0000","last_unstale":"2023-08-01T19:54:04.472976+0000","last_undegraded":"2023-08-01T19:54:04.472976+0000","last_fullsized":"2023-08-01T19:54:04.472976+0000","mapping_epoch":16,"log_start":"0'0","ondisk_log_start":"0'0","created":16,"last_epoch_clean":17,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-08-01T19:54:04.040663+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-08-01T19:54:04.040663+0000","last_clean_scrub_stamp":"2023-08-01T19:54:04.040663+0000","objects_scrubbed":0,"log_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-08-03T04:43:21.408174+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[0,1],"acting":[0,1],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":0,"acting_primary":0,"purged_snaps":[]},{"pgid":"4.25","version":"0'0","reported_seq":9,"reported_epoch":17,"state":"active+clean","last_fresh":"2023-08-01T19:54:04.478117+0000","last_change":"2023-08-01T19:54:04.474813+0000","last_active":"2023-08-01T19:54:04.478117+0000","last_peered":"2023-08-01T19:54:04.478117+0000","last_clean":"2023-08-01T19:54:04.478117+0000","last_became_active":"2023-08-01T19:54:04.472530+0000","last_became_peered":"2023-08-01T19:54:04.472530+0000","last_unstale":"2023-08-01T19:54:04.478117+0000","last_undegraded":"2023-08-01T19:54:04.478117+0000","last_fullsized":"2023-08-01T19:54:04.478117+0000","mapping_epoch":16,"log_start":"0'0","ondisk_log_start":"0'0","created":16,"last_epoch_clean":17,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-08-01T19:54:04.040663+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-08-01T19:54:04.040663+0000","last_clean_scrub_stamp":"2023-08-01T19:54:04.040663+0000","objects_scrubbed":0,"log_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-08-03T01:00:18.725898+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[1,2],"acting":[1,2],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":1,"acting_primary":1,"purged_snaps":[]},{"pgid":"3.1a","version":"17'1","reported_seq":11,"reported_epoch":17,"state":"active+clean","last_fresh":"2023-08-01T19:54:04.473081+0000","last_change":"2023-08-01T19:54:04.063936+0000","last_active":"2023-08-01T19:54:04.473081+0000","last_peered":"2023-08-01T19:54:04.473081+0000","last_clean":"2023-08-01T19:54:04.473081+0000","last_became_active":"2023-08-01T19:54:04.063674+0000","last_became_peered":"2023-08-01T19:54:04.063674+0000","last_unstale":"2023-08-01T19:54:04.473081+0000","last_undegraded":"2023-08-01T19:54:04.473081+0000","last_fullsized":"2023-08-01T19:54:04.473081+0000","mapping_epoch":15,"log_start":"0'0","ondisk_log_start":"0'0","created":15,"last_epoch_clean":16,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-08-01T19:54:03.032665+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-08-01T19:54:03.032665+0000","last_clean_scrub_stamp":"2023-08-01T19:54:03.032665+0000","objects_scrubbed":0,"log_size":1,"ondisk_log_size":1,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-08-03T00:06:00.058200+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[2,0],"acting":[2,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":2,"acting_primary":2,"purged_snaps":[]},{"pgid":"4.1d","version":"0'0","reported_seq":9,"reported_epoch":17,"state":"active+clean","last_fresh":"2023-08-01T19:54:04.474051+0000","last_change":"2023-08-01T19:54:04.471916+0000","last_active":"2023-08-01T19:54:04.474051+0000","last_peered":"2023-08-01T19:54:04.474051+0000","last_clean":"2023-08-01T19:54:04.474051+0000","last_became_active":"2023-08-01T19:54:04.471480+0000","last_became_peered":"2023-08-01T19:54:04.471480+0000","last_unstale":"2023-08-01T19:54:04.474051+0000","last_undegraded":"2023-08-01T19:54:04.474051+0000","last_fullsized":"2023-08-01T19:54:04.474051+0000","mapping_epoch":16,"log_start":"0'0","ondisk_log_start":"0'0","created":16,"last_epoch_clean":17,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-08-01T19:54:04.040663+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-08-01T19:54:04.040663+0000","last_clean_scrub_stamp":"2023-08-01T19:54:04.040663+0000","objects_scrubbed":0,"log_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-08-02T21:19:17.547590+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[2,1],"acting":[2,1],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":2,"acting_primary":2,"purged_snaps":[]},{"pgid":"3.19","version":"0'0","reported_seq":10,"reported_epoch":17,"state":"active+clean","last_fresh":"2023-08-01T19:54:04.458649+0000","last_change":"2023-08-01T19:54:04.067837+0000","last_active":"2023-08-01T19:54:04.458649+0000","last_peered":"2023-08-01T19:54:04.458649+0000","last_clean":"2023-08-01T19:54:04.458649+0000","last_became_active":"2023-08-01T19:54:04.067535+0000","last_became_peered":"2023-08-01T19:54:04.067535+0000","last_unstale":"2023-08-01T19:54:04.458649+0000","last_undegraded":"2023-08-01T19:54:04.458649+0000","last_fullsized":"2023-08-01T19:54:04.458649+0000","mapping_epoch":15,"log_start":"0'0","ondisk_log_start":"0'0","created":15,"last_epoch_clean":16,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-08-01T19:54:03.032665+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-08-01T19:54:03.032665+0000","last_clean_scrub_stamp":"2023-08-01T19:54:03.032665+0000","objects_scrubbed":0,"log_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-08-02T20:56:47.324761+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[0,1],"acting":[0,1],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":0,"acting_primary":0,"purged_snaps":[]},{"pgid":"4.1e","version":"0'0","reported_seq":9,"reported_epoch":17,"state":"active+clean","last_fresh":"2023-08-01T19:54:04.472940+0000","last_change":"2023-08-01T19:54:04.470544+0000","last_active":"2023-08-01T19:54:04.472940+0000","last_peered":"2023-08-01T19:54:04.472940+0000","last_clean":"2023-08-01T19:54:04.472940+0000","last_became_active":"2023-08-01T19:54:04.469657+0000","last_became_peered":"2023-08-01T19:54:04.469657+0000","last_unstale":"2023-08-01T19:54:04.472940+0000","last_undegraded":"2023-08-01T19:54:04.472940+0000","last_fullsized":"2023-08-01T19:54:04.472940+0000","mapping_epoch":16,"log_start":"0'0","ondisk_log_start":"0'0","created":16,"last_epoch_clean":17,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-08-01T19:54:04.040663+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-08-01T19:54:04.040663+0000","last_clean_scrub_stamp":"2023-08-01T19:54:04.040663+0000","objects_scrubbed":0,"log_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-08-02T23:12:30.830199+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[0,1],"acting":[0,1],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":0,"acting_primary":0,"purged_snaps":[]},{"pgid":"3.18","version":"0'0","reported_seq":10,"reported_epoch":17,"state":"active+clean","last_fresh":"2023-08-01T19:54:04.458389+0000","last_change":"2023-08-01T19:54:04.064289+0000","last_active":"2023-08-01T19:54:04.458389+0000","last_peered":"2023-08-01T19:54:04.458389+0000","last_clean":"2023-08-01T19:54:04.458389+0000","last_became_active":"2023-08-01T19:54:04.063971+0000","last_became_peered":"2023-08-01T19:54:04.063971+0000","last_unstale":"2023-08-01T19:54:04.458389+0000","last_undegraded":"2023-08-01T19:54:04.458389+0000","last_fullsized":"2023-08-01T19:54:04.458389+0000","mapping_epoch":15,"log_start":"0'0","ondisk_log_start":"0'0","created":15,"last_epoch_clean":16,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-08-01T19:54:03.032665+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-08-01T19:54:03.032665+0000","last_clean_scrub_stamp":"2023-08-01T19:54:03.032665+0000","objects_scrubbed":0,"log_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-08-03T04:09:30.496098+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[0,2],"acting":[0,2],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":0,"acting_primary":0,"purged_snaps":[]},{"pgid":"4.1f","version":"0'0","reported_seq":9,"reported_epoch":17,"state":"active+clean","last_fresh":"2023-08-01T19:54:04.474406+0000","last_change":"2023-08-01T19:54:04.472227+0000","last_active":"2023-08-01T19:54:04.474406+0000","last_peered":"2023-08-01T19:54:04.474406+0000","last_clean":"2023-08-01T19:54:04.474406+0000","last_became_active":"2023-08-01T19:54:04.471767+0000","last_became_peered":"2023-08-01T19:54:04.471767+0000","last_unstale":"2023-08-01T19:54:04.474406+0000","last_undegraded":"2023-08-01T19:54:04.474406+0000","last_fullsized":"2023-08-01T19:54:04.474406+0000","mapping_epoch":16,"log_start":"0'0","ondisk_log_start":"0'0","created":16,"last_epoch_clean":17,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-08-01T19:54:04.040663+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-08-01T19:54:04.040663+0000","last_clean_scrub_stamp":"2023-08-01T19:54:04.040663+0000","objects_scrubbed":0,"log_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-08-02T20:25:25.280329+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[2,1],"acting":[2,1],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":2,"acting_primary":2,"purged_snaps":[]},{"pgid":"3.17","version":"0'0","reported_seq":10,"reported_epoch":17,"state":"active+clean","last_fresh":"2023-08-01T19:54:04.462845+0000","last_change":"2023-08-01T19:54:04.067975+0000","last_active":"2023-08-01T19:54:04.462845+0000","last_peered":"2023-08-01T19:54:04.462845+0000","last_clean":"2023-08-01T19:54:04.462845+0000","last_became_active":"2023-08-01T19:54:04.067577+0000","last_became_peered":"2023-08-01T19:54:04.067577+0000","last_unstale":"2023-08-01T19:54:04.462845+0000","last_undegraded":"2023-08-01T19:54:04.462845+0000","last_fullsized":"2023-08-01T19:54:04.462845+0000","mapping_epoch":15,"log_start":"0'0","ondisk_log_start":"0'0","created":15,"last_epoch_clean":16,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-08-01T19:54:03.032665+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-08-01T19:54:03.032665+0000","last_clean_scrub_stamp":"2023-08-01T19:54:03.032665+0000","objects_scrubbed":0,"log_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-08-03T07:13:34.025722+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[0,1],"acting":[0,1],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":0,"acting_primary":0,"purged_snaps":[]},{"pgid":"4.10","version":"0'0","reported_seq":9,"reported_epoch":17,"state":"active+clean","last_fresh":"2023-08-01T19:54:04.472075+0000","last_change":"2023-08-01T19:54:04.467146+0000","last_active":"2023-08-01T19:54:04.472075+0000","last_peered":"2023-08-01T19:54:04.472075+0000","last_clean":"2023-08-01T19:54:04.472075+0000","last_became_active":"2023-08-01T19:54:04.466627+0000","last_became_peered":"2023-08-01T19:54:04.466627+0000","last_unstale":"2023-08-01T19:54:04.472075+0000","last_undegraded":"2023-08-01T19:54:04.472075+0000","last_fullsized":"2023-08-01T19:54:04.472075+0000","mapping_epoch":16,"log_start":"0'0","ondisk_log_start":"0'0","created":16,"last_epoch_clean":17,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-08-01T19:54:04.040663+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-08-01T19:54:04.040663+0000","last_clean_scrub_stamp":"2023-08-01T19:54:04.040663+0000","objects_scrubbed":0,"log_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-08-03T04:43:26.793480+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[0,2],"acting":[0,2],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":0,"acting_primary":0,"purged_snaps":[]},{"pgid":"3.16","version":"0'0","reported_seq":10,"reported_epoch":17,"state":"active+clean","last_fresh":"2023-08-01T19:54:04.468390+0000","last_change":"2023-08-01T19:54:04.065042+0000","last_active":"2023-08-01T19:54:04.468390+0000","last_peered":"2023-08-01T19:54:04.468390+0000","last_clean":"2023-08-01T19:54:04.468390+0000","last_became_active":"2023-08-01T19:54:04.064040+0000","last_became_peered":"2023-08-01T19:54:04.064040+0000","last_unstale":"2023-08-01T19:54:04.468390+0000","last_undegraded":"2023-08-01T19:54:04.468390+0000","last_fullsized":"2023-08-01T19:54:04.468390+0000","mapping_epoch":15,"log_start":"0'0","ondisk_log_start":"0'0","created":15,"last_epoch_clean":16,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-08-01T19:54:03.032665+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-08-01T19:54:03.032665+0000","last_clean_scrub_stamp":"2023-08-01T19:54:03.032665+0000","objects_scrubbed":0,"log_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-08-03T03:40:43.460182+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[1,0],"acting":[1,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":1,"acting_primary":1,"purged_snaps":[]},{"pgid":"4.11","version":"0'0","reported_seq":9,"reported_epoch":17,"state":"active+clean","last_fresh":"2023-08-01T19:54:04.472823+0000","last_change":"2023-08-01T19:54:04.470401+0000","last_active":"2023-08-01T19:54:04.472823+0000","last_peered":"2023-08-01T19:54:04.472823+0000","last_clean":"2023-08-01T19:54:04.472823+0000","last_became_active":"2023-08-01T19:54:04.469680+0000","last_became_peered":"2023-08-01T19:54:04.469680+0000","last_unstale":"2023-08-01T19:54:04.472823+0000","last_undegraded":"2023-08-01T19:54:04.472823+0000","last_fullsized":"2023-08-01T19:54:04.472823+0000","mapping_epoch":16,"log_start":"0'0","ondisk_log_start":"0'0","created":16,"last_epoch_clean":17,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-08-01T19:54:04.040663+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-08-01T19:54:04.040663+0000","last_clean_scrub_stamp":"2023-08-01T19:54:04.040663+0000","objects_scrubbed":0,"log_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-08-03T03:58:06.360840+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[0,1],"acting":[0,1],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":0,"acting_primary":0,"purged_snaps":[]},{"pgid":"3.15","version":"17'3","reported_seq":13,"reported_epoch":17,"state":"active+clean","last_fresh":"2023-08-01T19:54:04.471749+0000","last_change":"2023-08-01T19:54:04.065443+0000","last_active":"2023-08-01T19:54:04.471749+0000","last_peered":"2023-08-01T19:54:04.471749+0000","last_clean":"2023-08-01T19:54:04.471749+0000","last_became_active":"2023-08-01T19:54:04.065112+0000","last_became_peered":"2023-08-01T19:54:04.065112+0000","last_unstale":"2023-08-01T19:54:04.471749+0000","last_undegraded":"2023-08-01T19:54:04.471749+0000","last_fullsized":"2023-08-01T19:54:04.471749+0000","mapping_epoch":15,"log_start":"0'0","ondisk_log_start":"0'0","created":15,"last_epoch_clean":16,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-08-01T19:54:03.032665+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-08-01T19:54:03.032665+0000","last_clean_scrub_stamp":"2023-08-01T19:54:03.032665+0000","objects_scrubbed":0,"log_size":3,"ondisk_log_size":3,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-08-03T03:27:50.887004+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":90,"num_objects":2,"num_object_clones":0,"num_object_copies":4,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":2,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":4,"num_write_kb":1,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":1,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[2,1],"acting":[2,1],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":2,"acting_primary":2,"purged_snaps":[]},{"pgid":"4.12","version":"0'0","reported_seq":9,"reported_epoch":17,"state":"active+clean","last_fresh":"2023-08-01T19:54:04.471952+0000","last_change":"2023-08-01T19:54:04.467822+0000","last_active":"2023-08-01T19:54:04.471952+0000","last_peered":"2023-08-01T19:54:04.471952+0000","last_clean":"2023-08-01T19:54:04.471952+0000","last_became_active":"2023-08-01T19:54:04.466667+0000","last_became_peered":"2023-08-01T19:54:04.466667+0000","last_unstale":"2023-08-01T19:54:04.471952+0000","last_undegraded":"2023-08-01T19:54:04.471952+0000","last_fullsized":"2023-08-01T19:54:04.471952+0000","mapping_epoch":16,"log_start":"0'0","ondisk_log_start":"0'0","created":16,"last_epoch_clean":17,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-08-01T19:54:04.040663+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-08-01T19:54:04.040663+0000","last_clean_scrub_stamp":"2023-08-01T19:54:04.040663+0000","objects_scrubbed":0,"log_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-08-03T02:57:18.148077+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[0,2],"acting":[0,2],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":0,"acting_primary":0,"purged_snaps":[]},{"pgid":"3.14","version":"17'6","reported_seq":16,"reported_epoch":17,"state":"active+clean","last_fresh":"2023-08-01T19:54:04.485855+0000","last_change":"2023-08-01T19:54:04.061419+0000","last_active":"2023-08-01T19:54:04.485855+0000","last_peered":"2023-08-01T19:54:04.485855+0000","last_clean":"2023-08-01T19:54:04.485855+0000","last_became_active":"2023-08-01T19:54:04.061078+0000","last_became_peered":"2023-08-01T19:54:04.061078+0000","last_unstale":"2023-08-01T19:54:04.485855+0000","last_undegraded":"2023-08-01T19:54:04.485855+0000","last_fullsized":"2023-08-01T19:54:04.485855+0000","mapping_epoch":15,"log_start":"0'0","ondisk_log_start":"0'0","created":15,"last_epoch_clean":16,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-08-01T19:54:03.032665+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-08-01T19:54:03.032665+0000","last_clean_scrub_stamp":"2023-08-01T19:54:03.032665+0000","objects_scrubbed":0,"log_size":6,"ondisk_log_size":6,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-08-02T21:35:44.874727+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":1536,"num_objects":4,"num_object_clones":0,"num_object_copies":8,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":4,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":6,"num_write_kb":3,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":1,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[1,2],"acting":[1,2],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":1,"acting_primary":1,"purged_snaps":[]},{"pgid":"4.13","version":"0'0","reported_seq":9,"reported_epoch":17,"state":"active+clean","last_fresh":"2023-08-01T19:54:04.471426+0000","last_change":"2023-08-01T19:54:04.466400+0000","last_active":"2023-08-01T19:54:04.471426+0000","last_peered":"2023-08-01T19:54:04.471426+0000","last_clean":"2023-08-01T19:54:04.471426+0000","last_became_active":"2023-08-01T19:54:04.465979+0000","last_became_peered":"2023-08-01T19:54:04.465979+0000","last_unstale":"2023-08-01T19:54:04.471426+0000","last_undegraded":"2023-08-01T19:54:04.471426+0000","last_fullsized":"2023-08-01T19:54:04.471426+0000","mapping_epoch":16,"log_start":"0'0","ondisk_log_start":"0'0","created":16,"last_epoch_clean":17,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-08-01T19:54:04.040663+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-08-01T19:54:04.040663+0000","last_clean_scrub_stamp":"2023-08-01T19:54:04.040663+0000","objects_scrubbed":0,"log_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-08-02T20:20:59.989030+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[1,2],"acting":[1,2],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":1,"acting_primary":1,"purged_snaps":[]},{"pgid":"3.13","version":"17'2","reported_seq":12,"reported_epoch":17,"state":"active+clean","last_fresh":"2023-08-01T19:54:04.476009+0000","last_change":"2023-08-01T19:54:04.065212+0000","last_active":"2023-08-01T19:54:04.476009+0000","last_peered":"2023-08-01T19:54:04.476009+0000","last_clean":"2023-08-01T19:54:04.476009+0000","last_became_active":"2023-08-01T19:54:04.064375+0000","last_became_peered":"2023-08-01T19:54:04.064375+0000","last_unstale":"2023-08-01T19:54:04.476009+0000","last_undegraded":"2023-08-01T19:54:04.476009+0000","last_fullsized":"2023-08-01T19:54:04.476009+0000","mapping_epoch":15,"log_start":"0'0","ondisk_log_start":"0'0","created":15,"last_epoch_clean":16,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-08-01T19:54:03.032665+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-08-01T19:54:03.032665+0000","last_clean_scrub_stamp":"2023-08-01T19:54:03.032665+0000","objects_scrubbed":0,"log_size":2,"ondisk_log_size":2,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-08-03T06:17:37.910752+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":34,"num_objects":2,"num_object_clones":0,"num_object_copies":4,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":2,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":3,"num_write_kb":6,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":1,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[1,0],"acting":[1,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":1,"acting_primary":1,"purged_snaps":[]},{"pgid":"4.14","version":"0'0","reported_seq":9,"reported_epoch":17,"state":"active+clean","last_fresh":"2023-08-01T19:54:04.465917+0000","last_change":"2023-08-01T19:54:04.464446+0000","last_active":"2023-08-01T19:54:04.465917+0000","last_peered":"2023-08-01T19:54:04.465917+0000","last_clean":"2023-08-01T19:54:04.465917+0000","last_became_active":"2023-08-01T19:54:04.464021+0000","last_became_peered":"2023-08-01T19:54:04.464021+0000","last_unstale":"2023-08-01T19:54:04.465917+0000","last_undegraded":"2023-08-01T19:54:04.465917+0000","last_fullsized":"2023-08-01T19:54:04.465917+0000","mapping_epoch":16,"log_start":"0'0","ondisk_log_start":"0'0","created":16,"last_epoch_clean":17,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-08-01T19:54:04.040663+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-08-01T19:54:04.040663+0000","last_clean_scrub_stamp":"2023-08-01T19:54:04.040663+0000","objects_scrubbed":0,"log_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-08-02T20:26:51.080849+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[2,0],"acting":[2,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":2,"acting_primary":2,"purged_snaps":[]},{"pgid":"3.12","version":"0'0","reported_seq":10,"reported_epoch":17,"state":"active+clean","last_fresh":"2023-08-01T19:54:04.458866+0000","last_change":"2023-08-01T19:54:04.066566+0000","last_active":"2023-08-01T19:54:04.458866+0000","last_peered":"2023-08-01T19:54:04.458866+0000","last_clean":"2023-08-01T19:54:04.458866+0000","last_became_active":"2023-08-01T19:54:04.066190+0000","last_became_peered":"2023-08-01T19:54:04.066190+0000","last_unstale":"2023-08-01T19:54:04.458866+0000","last_undegraded":"2023-08-01T19:54:04.458866+0000","last_fullsized":"2023-08-01T19:54:04.458866+0000","mapping_epoch":15,"log_start":"0'0","ondisk_log_start":"0'0","created":15,"last_epoch_clean":16,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-08-01T19:54:03.032665+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-08-01T19:54:03.032665+0000","last_clean_scrub_stamp":"2023-08-01T19:54:03.032665+0000","objects_scrubbed":0,"log_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-08-03T02:01:47.073630+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[0,1],"acting":[0,1],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":0,"acting_primary":0,"purged_snaps":[]},{"pgid":"4.15","version":"0'0","reported_seq":9,"reported_epoch":17,"state":"active+clean","last_fresh":"2023-08-01T19:54:04.470734+0000","last_change":"2023-08-01T19:54:04.468791+0000","last_active":"2023-08-01T19:54:04.470734+0000","last_peered":"2023-08-01T19:54:04.470734+0000","last_clean":"2023-08-01T19:54:04.470734+0000","last_became_active":"2023-08-01T19:54:04.468214+0000","last_became_peered":"2023-08-01T19:54:04.468214+0000","last_unstale":"2023-08-01T19:54:04.470734+0000","last_undegraded":"2023-08-01T19:54:04.470734+0000","last_fullsized":"2023-08-01T19:54:04.470734+0000","mapping_epoch":16,"log_start":"0'0","ondisk_log_start":"0'0","created":16,"last_epoch_clean":17,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-08-01T19:54:04.040663+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-08-01T19:54:04.040663+0000","last_clean_scrub_stamp":"2023-08-01T19:54:04.040663+0000","objects_scrubbed":0,"log_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-08-03T04:10:44.729287+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[2,0],"acting":[2,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":2,"acting_primary":2,"purged_snaps":[]},{"pgid":"3.11","version":"0'0","reported_seq":10,"reported_epoch":17,"state":"active+clean","last_fresh":"2023-08-01T19:54:04.457924+0000","last_change":"2023-08-01T19:54:04.064280+0000","last_active":"2023-08-01T19:54:04.457924+0000","last_peered":"2023-08-01T19:54:04.457924+0000","last_clean":"2023-08-01T19:54:04.457924+0000","last_became_active":"2023-08-01T19:54:04.064064+0000","last_became_peered":"2023-08-01T19:54:04.064064+0000","last_unstale":"2023-08-01T19:54:04.457924+0000","last_undegraded":"2023-08-01T19:54:04.457924+0000","last_fullsized":"2023-08-01T19:54:04.457924+0000","mapping_epoch":15,"log_start":"0'0","ondisk_log_start":"0'0","created":15,"last_epoch_clean":16,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-08-01T19:54:03.032665+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-08-01T19:54:03.032665+0000","last_clean_scrub_stamp":"2023-08-01T19:54:03.032665+0000","objects_scrubbed":0,"log_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-08-03T06:13:51.475710+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[2,1],"acting":[2,1],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":2,"acting_primary":2,"purged_snaps":[]},{"pgid":"4.16","version":"0'0","reported_seq":9,"reported_epoch":17,"state":"active+clean","last_fresh":"2023-08-01T19:54:04.472609+0000","last_change":"2023-08-01T19:54:04.469724+0000","last_active":"2023-08-01T19:54:04.472609+0000","last_peered":"2023-08-01T19:54:04.472609+0000","last_clean":"2023-08-01T19:54:04.472609+0000","last_became_active":"2023-08-01T19:54:04.469275+0000","last_became_peered":"2023-08-01T19:54:04.469275+0000","last_unstale":"2023-08-01T19:54:04.472609+0000","last_undegraded":"2023-08-01T19:54:04.472609+0000","last_fullsized":"2023-08-01T19:54:04.472609+0000","mapping_epoch":16,"log_start":"0'0","ondisk_log_start":"0'0","created":16,"last_epoch_clean":17,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-08-01T19:54:04.040663+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-08-01T19:54:04.040663+0000","last_clean_scrub_stamp":"2023-08-01T19:54:04.040663+0000","objects_scrubbed":0,"log_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-08-03T03:04:06.137335+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[0,1],"acting":[0,1],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":0,"acting_primary":0,"purged_snaps":[]},{"pgid":"3.10","version":"17'8","reported_seq":18,"reported_epoch":17,"state":"active+clean","last_fresh":"2023-08-01T19:54:04.480319+0000","last_change":"2023-08-01T19:54:04.060962+0000","last_active":"2023-08-01T19:54:04.480319+0000","last_peered":"2023-08-01T19:54:04.480319+0000","last_clean":"2023-08-01T19:54:04.480319+0000","last_became_active":"2023-08-01T19:54:04.060576+0000","last_became_peered":"2023-08-01T19:54:04.060576+0000","last_unstale":"2023-08-01T19:54:04.480319+0000","last_undegraded":"2023-08-01T19:54:04.480319+0000","last_fullsized":"2023-08-01T19:54:04.480319+0000","mapping_epoch":15,"log_start":"0'0","ondisk_log_start":"0'0","created":15,"last_epoch_clean":16,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-08-01T19:54:03.032665+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-08-01T19:54:03.032665+0000","last_clean_scrub_stamp":"2023-08-01T19:54:03.032665+0000","objects_scrubbed":0,"log_size":8,"ondisk_log_size":8,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-08-03T05:00:51.171444+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":4,"num_object_clones":0,"num_object_copies":8,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":4,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":12,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":4,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[1,2],"acting":[1,2],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":1,"acting_primary":1,"purged_snaps":[]},{"pgid":"4.17","version":"0'0","reported_seq":9,"reported_epoch":17,"state":"active+clean","last_fresh":"2023-08-01T19:54:04.473595+0000","last_change":"2023-08-01T19:54:04.472721+0000","last_active":"2023-08-01T19:54:04.473595+0000","last_peered":"2023-08-01T19:54:04.473595+0000","last_clean":"2023-08-01T19:54:04.473595+0000","last_became_active":"2023-08-01T19:54:04.472126+0000","last_became_peered":"2023-08-01T19:54:04.472126+0000","last_unstale":"2023-08-01T19:54:04.473595+0000","last_undegraded":"2023-08-01T19:54:04.473595+0000","last_fullsized":"2023-08-01T19:54:04.473595+0000","mapping_epoch":16,"log_start":"0'0","ondisk_log_start":"0'0","created":16,"last_epoch_clean":17,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-08-01T19:54:04.040663+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-08-01T19:54:04.040663+0000","last_clean_scrub_stamp":"2023-08-01T19:54:04.040663+0000","objects_scrubbed":0,"log_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-08-03T00:29:05.857138+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[0,1],"acting":[0,1],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":0,"acting_primary":0,"purged_snaps":[]},{"pgid":"3.f","version":"17'1","reported_seq":11,"reported_epoch":17,"state":"active+clean","last_fresh":"2023-08-01T19:54:04.476116+0000","last_change":"2023-08-01T19:54:04.060797+0000","last_active":"2023-08-01T19:54:04.476116+0000","last_peered":"2023-08-01T19:54:04.476116+0000","last_clean":"2023-08-01T19:54:04.476116+0000","last_became_active":"2023-08-01T19:54:04.060444+0000","last_became_peered":"2023-08-01T19:54:04.060444+0000","last_unstale":"2023-08-01T19:54:04.476116+0000","last_undegraded":"2023-08-01T19:54:04.476116+0000","last_fullsized":"2023-08-01T19:54:04.476116+0000","mapping_epoch":15,"log_start":"0'0","ondisk_log_start":"0'0","created":15,"last_epoch_clean":16,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-08-01T19:54:03.032665+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-08-01T19:54:03.032665+0000","last_clean_scrub_stamp":"2023-08-01T19:54:03.032665+0000","objects_scrubbed":0,"log_size":1,"ondisk_log_size":1,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-08-03T07:13:34.025722+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":22,"num_objects":1,"num_object_clones":0,"num_object_copies":2,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":1,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":1,"num_write_kb":1,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[1,2],"acting":[1,2],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":1,"acting_primary":1,"purged_snaps":[]},{"pgid":"4.8","version":"0'0","reported_seq":9,"reported_epoch":17,"state":"active+clean","last_fresh":"2023-08-01T19:54:04.470264+0000","last_change":"2023-08-01T19:54:04.467671+0000","last_active":"2023-08-01T19:54:04.470264+0000","last_peered":"2023-08-01T19:54:04.470264+0000","last_clean":"2023-08-01T19:54:04.470264+0000","last_became_active":"2023-08-01T19:54:04.467300+0000","last_became_peered":"2023-08-01T19:54:04.467300+0000","last_unstale":"2023-08-01T19:54:04.470264+0000","last_undegraded":"2023-08-01T19:54:04.470264+0000","last_fullsized":"2023-08-01T19:54:04.470264+0000","mapping_epoch":16,"log_start":"0'0","ondisk_log_start":"0'0","created":16,"last_epoch_clean":17,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-08-01T19:54:04.040663+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-08-01T19:54:04.040663+0000","last_clean_scrub_stamp":"2023-08-01T19:54:04.040663+0000","objects_scrubbed":0,"log_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-08-03T05:27:24.774345+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[2,1],"acting":[2,1],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":2,"acting_primary":2,"purged_snaps":[]},{"pgid":"3.e","version":"17'2","reported_seq":12,"reported_epoch":17,"state":"active+clean","last_fresh":"2023-08-01T19:54:04.471249+0000","last_change":"2023-08-01T19:54:04.065595+0000","last_active":"2023-08-01T19:54:04.471249+0000","last_peered":"2023-08-01T19:54:04.471249+0000","last_clean":"2023-08-01T19:54:04.471249+0000","last_became_active":"2023-08-01T19:54:04.065303+0000","last_became_peered":"2023-08-01T19:54:04.065303+0000","last_unstale":"2023-08-01T19:54:04.471249+0000","last_undegraded":"2023-08-01T19:54:04.471249+0000","last_fullsized":"2023-08-01T19:54:04.471249+0000","mapping_epoch":15,"log_start":"0'0","ondisk_log_start":"0'0","created":15,"last_epoch_clean":16,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-08-01T19:54:03.032665+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-08-01T19:54:03.032665+0000","last_clean_scrub_stamp":"2023-08-01T19:54:03.032665+0000","objects_scrubbed":0,"log_size":2,"ondisk_log_size":2,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-08-02T22:40:38.782053+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":1,"num_object_clones":0,"num_object_copies":2,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":1,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":3,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":1,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[2,1],"acting":[2,1],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":2,"acting_primary":2,"purged_snaps":[]},{"pgid":"4.9","version":"0'0","reported_seq":9,"reported_epoch":17,"state":"active+clean","last_fresh":"2023-08-01T19:54:04.470284+0000","last_change":"2023-08-01T19:54:04.468007+0000","last_active":"2023-08-01T19:54:04.470284+0000","last_peered":"2023-08-01T19:54:04.470284+0000","last_clean":"2023-08-01T19:54:04.470284+0000","last_became_active":"2023-08-01T19:54:04.467509+0000","last_became_peered":"2023-08-01T19:54:04.467509+0000","last_unstale":"2023-08-01T19:54:04.470284+0000","last_undegraded":"2023-08-01T19:54:04.470284+0000","last_fullsized":"2023-08-01T19:54:04.470284+0000","mapping_epoch":16,"log_start":"0'0","ondisk_log_start":"0'0","created":16,"last_epoch_clean":17,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-08-01T19:54:04.040663+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-08-01T19:54:04.040663+0000","last_clean_scrub_stamp":"2023-08-01T19:54:04.040663+0000","objects_scrubbed":0,"log_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-08-03T06:04:50.963711+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[2,0],"acting":[2,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":2,"acting_primary":2,"purged_snaps":[]},{"pgid":"3.d","version":"17'1","reported_seq":11,"reported_epoch":17,"state":"active+clean","last_fresh":"2023-08-01T19:54:04.475997+0000","last_change":"2023-08-01T19:54:04.062853+0000","last_active":"2023-08-01T19:54:04.475997+0000","last_peered":"2023-08-01T19:54:04.475997+0000","last_clean":"2023-08-01T19:54:04.475997+0000","last_became_active":"2023-08-01T19:54:04.062598+0000","last_became_peered":"2023-08-01T19:54:04.062598+0000","last_unstale":"2023-08-01T19:54:04.475997+0000","last_undegraded":"2023-08-01T19:54:04.475997+0000","last_fullsized":"2023-08-01T19:54:04.475997+0000","mapping_epoch":15,"log_start":"0'0","ondisk_log_start":"0'0","created":15,"last_epoch_clean":16,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-08-01T19:54:03.032665+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-08-01T19:54:03.032665+0000","last_clean_scrub_stamp":"2023-08-01T19:54:03.032665+0000","objects_scrubbed":0,"log_size":1,"ondisk_log_size":1,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-08-02T20:56:47.324761+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":70,"num_objects":1,"num_object_clones":0,"num_object_copies":2,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":1,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":1,"num_write_kb":1,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[1,2],"acting":[1,2],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":1,"acting_primary":1,"purged_snaps":[]},{"pgid":"4.a","version":"0'0","reported_seq":9,"reported_epoch":17,"state":"active+clean","last_fresh":"2023-08-01T19:54:04.476248+0000","last_change":"2023-08-01T19:54:04.471997+0000","last_active":"2023-08-01T19:54:04.476248+0000","last_peered":"2023-08-01T19:54:04.476248+0000","last_clean":"2023-08-01T19:54:04.476248+0000","last_became_active":"2023-08-01T19:54:04.471204+0000","last_became_peered":"2023-08-01T19:54:04.471204+0000","last_unstale":"2023-08-01T19:54:04.476248+0000","last_undegraded":"2023-08-01T19:54:04.476248+0000","last_fullsized":"2023-08-01T19:54:04.476248+0000","mapping_epoch":16,"log_start":"0'0","ondisk_log_start":"0'0","created":16,"last_epoch_clean":17,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-08-01T19:54:04.040663+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-08-01T19:54:04.040663+0000","last_clean_scrub_stamp":"2023-08-01T19:54:04.040663+0000","objects_scrubbed":0,"log_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-08-02T23:12:30.830199+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[1,0],"acting":[1,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":1,"acting_primary":1,"purged_snaps":[]},{"pgid":"3.c","version":"0'0","reported_seq":10,"reported_epoch":17,"state":"active+clean","last_fresh":"2023-08-01T19:54:04.467464+0000","last_change":"2023-08-01T19:54:04.063532+0000","last_active":"2023-08-01T19:54:04.467464+0000","last_peered":"2023-08-01T19:54:04.467464+0000","last_clean":"2023-08-01T19:54:04.467464+0000","last_became_active":"2023-08-01T19:54:04.063116+0000","last_became_peered":"2023-08-01T19:54:04.063116+0000","last_unstale":"2023-08-01T19:54:04.467464+0000","last_undegraded":"2023-08-01T19:54:04.467464+0000","last_fullsized":"2023-08-01T19:54:04.467464+0000","mapping_epoch":15,"log_start":"0'0","ondisk_log_start":"0'0","created":15,"last_epoch_clean":16,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-08-01T19:54:03.032665+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-08-01T19:54:03.032665+0000","last_clean_scrub_stamp":"2023-08-01T19:54:03.032665+0000","objects_scrubbed":0,"log_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-08-02T22:28:51.936138+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[1,0],"acting":[1,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":1,"acting_primary":1,"purged_snaps":[]},{"pgid":"4.b","version":"0'0","reported_seq":9,"reported_epoch":17,"state":"active+clean","last_fresh":"2023-08-01T19:54:04.472955+0000","last_change":"2023-08-01T19:54:04.470787+0000","last_active":"2023-08-01T19:54:04.472955+0000","last_peered":"2023-08-01T19:54:04.472955+0000","last_clean":"2023-08-01T19:54:04.472955+0000","last_became_active":"2023-08-01T19:54:04.470332+0000","last_became_peered":"2023-08-01T19:54:04.470332+0000","last_unstale":"2023-08-01T19:54:04.472955+0000","last_undegraded":"2023-08-01T19:54:04.472955+0000","last_fullsized":"2023-08-01T19:54:04.472955+0000","mapping_epoch":16,"log_start":"0'0","ondisk_log_start":"0'0","created":16,"last_epoch_clean":17,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-08-01T19:54:04.040663+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-08-01T19:54:04.040663+0000","last_clean_scrub_stamp":"2023-08-01T19:54:04.040663+0000","objects_scrubbed":0,"log_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-08-03T05:13:38.298401+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[0,1],"acting":[0,1],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":0,"acting_primary":0,"purged_snaps":[]},{"pgid":"3.b","version":"17'2","reported_seq":12,"reported_epoch":17,"state":"active+clean","last_fresh":"2023-08-01T19:54:04.472965+0000","last_change":"2023-08-01T19:54:04.066839+0000","last_active":"2023-08-01T19:54:04.472965+0000","last_peered":"2023-08-01T19:54:04.472965+0000","last_clean":"2023-08-01T19:54:04.472965+0000","last_became_active":"2023-08-01T19:54:04.065535+0000","last_became_peered":"2023-08-01T19:54:04.065535+0000","last_unstale":"2023-08-01T19:54:04.472965+0000","last_undegraded":"2023-08-01T19:54:04.472965+0000","last_fullsized":"2023-08-01T19:54:04.472965+0000","mapping_epoch":15,"log_start":"0'0","ondisk_log_start":"0'0","created":15,"last_epoch_clean":16,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-08-01T19:54:03.032665+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-08-01T19:54:03.032665+0000","last_clean_scrub_stamp":"2023-08-01T19:54:03.032665+0000","objects_scrubbed":0,"log_size":2,"ondisk_log_size":2,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-08-03T05:00:51.171444+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":1,"num_object_clones":0,"num_object_copies":2,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":1,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":1,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":1,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[0,1],"acting":[0,1],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":0,"acting_primary":0,"purged_snaps":[]},{"pgid":"4.c","version":"0'0","reported_seq":9,"reported_epoch":17,"state":"active+clean","last_fresh":"2023-08-01T19:54:04.481357+0000","last_change":"2023-08-01T19:54:04.478715+0000","last_active":"2023-08-01T19:54:04.481357+0000","last_peered":"2023-08-01T19:54:04.481357+0000","last_clean":"2023-08-01T19:54:04.481357+0000","last_became_active":"2023-08-01T19:54:04.477435+0000","last_became_peered":"2023-08-01T19:54:04.477435+0000","last_unstale":"2023-08-01T19:54:04.481357+0000","last_undegraded":"2023-08-01T19:54:04.481357+0000","last_fullsized":"2023-08-01T19:54:04.481357+0000","mapping_epoch":16,"log_start":"0'0","ondisk_log_start":"0'0","created":16,"last_epoch_clean":17,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-08-01T19:54:04.040663+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-08-01T19:54:04.040663+0000","last_clean_scrub_stamp":"2023-08-01T19:54:04.040663+0000","objects_scrubbed":0,"log_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-08-03T04:43:21.408174+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[1,0],"acting":[1,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":1,"acting_primary":1,"purged_snaps":[]},{"pgid":"3.a","version":"0'0","reported_seq":10,"reported_epoch":17,"state":"active+clean","last_fresh":"2023-08-01T19:54:04.466981+0000","last_change":"2023-08-01T19:54:04.065267+0000","last_active":"2023-08-01T19:54:04.466981+0000","last_peered":"2023-08-01T19:54:04.466981+0000","last_clean":"2023-08-01T19:54:04.466981+0000","last_became_active":"2023-08-01T19:54:04.064912+0000","last_became_peered":"2023-08-01T19:54:04.064912+0000","last_unstale":"2023-08-01T19:54:04.466981+0000","last_undegraded":"2023-08-01T19:54:04.466981+0000","last_fullsized":"2023-08-01T19:54:04.466981+0000","mapping_epoch":15,"log_start":"0'0","ondisk_log_start":"0'0","created":15,"last_epoch_clean":16,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-08-01T19:54:03.032665+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-08-01T19:54:03.032665+0000","last_clean_scrub_stamp":"2023-08-01T19:54:03.032665+0000","objects_scrubbed":0,"log_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-08-03T02:37:09.180970+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[1,0],"acting":[1,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":1,"acting_primary":1,"purged_snaps":[]},{"pgid":"4.d","version":"0'0","reported_seq":9,"reported_epoch":17,"state":"active+clean","last_fresh":"2023-08-01T19:54:04.478084+0000","last_change":"2023-08-01T19:54:04.474755+0000","last_active":"2023-08-01T19:54:04.478084+0000","last_peered":"2023-08-01T19:54:04.478084+0000","last_clean":"2023-08-01T19:54:04.478084+0000","last_became_active":"2023-08-01T19:54:04.471526+0000","last_became_peered":"2023-08-01T19:54:04.471526+0000","last_unstale":"2023-08-01T19:54:04.478084+0000","last_undegraded":"2023-08-01T19:54:04.478084+0000","last_fullsized":"2023-08-01T19:54:04.478084+0000","mapping_epoch":16,"log_start":"0'0","ondisk_log_start":"0'0","created":16,"last_epoch_clean":17,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-08-01T19:54:04.040663+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-08-01T19:54:04.040663+0000","last_clean_scrub_stamp":"2023-08-01T19:54:04.040663+0000","objects_scrubbed":0,"log_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-08-03T06:50:03.420334+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[1,2],"acting":[1,2],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":1,"acting_primary":1,"purged_snaps":[]},{"pgid":"3.9","version":"0'0","reported_seq":10,"reported_epoch":17,"state":"active+clean","last_fresh":"2023-08-01T19:54:04.457820+0000","last_change":"2023-08-01T19:54:04.065519+0000","last_active":"2023-08-01T19:54:04.457820+0000","last_peered":"2023-08-01T19:54:04.457820+0000","last_clean":"2023-08-01T19:54:04.457820+0000","last_became_active":"2023-08-01T19:54:04.065211+0000","last_became_peered":"2023-08-01T19:54:04.065211+0000","last_unstale":"2023-08-01T19:54:04.457820+0000","last_undegraded":"2023-08-01T19:54:04.457820+0000","last_fullsized":"2023-08-01T19:54:04.457820+0000","mapping_epoch":15,"log_start":"0'0","ondisk_log_start":"0'0","created":15,"last_epoch_clean":16,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-08-01T19:54:03.032665+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-08-01T19:54:03.032665+0000","last_clean_scrub_stamp":"2023-08-01T19:54:03.032665+0000","objects_scrubbed":0,"log_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-08-03T05:46:27.672957+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[2,1],"acting":[2,1],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":2,"acting_primary":2,"purged_snaps":[]},{"pgid":"4.e","version":"0'0","reported_seq":9,"reported_epoch":17,"state":"active+clean","last_fresh":"2023-08-01T19:54:04.477674+0000","last_change":"2023-08-01T19:54:04.473750+0000","last_active":"2023-08-01T19:54:04.477674+0000","last_peered":"2023-08-01T19:54:04.477674+0000","last_clean":"2023-08-01T19:54:04.477674+0000","last_became_active":"2023-08-01T19:54:04.471512+0000","last_became_peered":"2023-08-01T19:54:04.471512+0000","last_unstale":"2023-08-01T19:54:04.477674+0000","last_undegraded":"2023-08-01T19:54:04.477674+0000","last_fullsized":"2023-08-01T19:54:04.477674+0000","mapping_epoch":16,"log_start":"0'0","ondisk_log_start":"0'0","created":16,"last_epoch_clean":17,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-08-01T19:54:04.040663+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-08-01T19:54:04.040663+0000","last_clean_scrub_stamp":"2023-08-01T19:54:04.040663+0000","objects_scrubbed":0,"log_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-08-03T05:13:38.298401+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[1,2],"acting":[1,2],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":1,"acting_primary":1,"purged_snaps":[]},{"pgid":"3.8","version":"0'0","reported_seq":10,"reported_epoch":17,"state":"active+clean","last_fresh":"2023-08-01T19:54:04.458299+0000","last_change":"2023-08-01T19:54:04.063990+0000","last_active":"2023-08-01T19:54:04.458299+0000","last_peered":"2023-08-01T19:54:04.458299+0000","last_clean":"2023-08-01T19:54:04.458299+0000","last_became_active":"2023-08-01T19:54:04.063652+0000","last_became_peered":"2023-08-01T19:54:04.063652+0000","last_unstale":"2023-08-01T19:54:04.458299+0000","last_undegraded":"2023-08-01T19:54:04.458299+0000","last_fullsized":"2023-08-01T19:54:04.458299+0000","mapping_epoch":15,"log_start":"0'0","ondisk_log_start":"0'0","created":15,"last_epoch_clean":16,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-08-01T19:54:03.032665+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-08-01T19:54:03.032665+0000","last_clean_scrub_stamp":"2023-08-01T19:54:03.032665+0000","objects_scrubbed":0,"log_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-08-03T05:30:28.028091+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[2,0],"acting":[2,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":2,"acting_primary":2,"purged_snaps":[]},{"pgid":"4.f","version":"0'0","reported_seq":9,"reported_epoch":17,"state":"active+clean","last_fresh":"2023-08-01T19:54:04.472898+0000","last_change":"2023-08-01T19:54:04.469648+0000","last_active":"2023-08-01T19:54:04.472898+0000","last_peered":"2023-08-01T19:54:04.472898+0000","last_clean":"2023-08-01T19:54:04.472898+0000","last_became_active":"2023-08-01T19:54:04.468445+0000","last_became_peered":"2023-08-01T19:54:04.468445+0000","last_unstale":"2023-08-01T19:54:04.472898+0000","last_undegraded":"2023-08-01T19:54:04.472898+0000","last_fullsized":"2023-08-01T19:54:04.472898+0000","mapping_epoch":16,"log_start":"0'0","ondisk_log_start":"0'0","created":16,"last_epoch_clean":17,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-08-01T19:54:04.040663+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-08-01T19:54:04.040663+0000","last_clean_scrub_stamp":"2023-08-01T19:54:04.040663+0000","objects_scrubbed":0,"log_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-08-03T05:46:11.085577+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[0,2],"acting":[0,2],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":0,"acting_primary":0,"purged_snaps":[]},{"pgid":"2.4","version":"0'0","reported_seq":13,"reported_epoch":17,"state":"active+clean","last_fresh":"2023-08-01T19:54:04.459326+0000","last_change":"2023-08-01T19:53:58.973838+0000","last_active":"2023-08-01T19:54:04.459326+0000","last_peered":"2023-08-01T19:54:04.459326+0000","last_clean":"2023-08-01T19:54:04.459326+0000","last_became_active":"2023-08-01T19:53:58.973242+0000","last_became_peered":"2023-08-01T19:53:58.973242+0000","last_unstale":"2023-08-01T19:54:04.459326+0000","last_undegraded":"2023-08-01T19:54:04.459326+0000","last_fullsized":"2023-08-01T19:54:04.459326+0000","mapping_epoch":12,"log_start":"0'0","ondisk_log_start":"0'0","created":12,"last_epoch_clean":13,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-08-01T19:53:57.959448+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-08-01T19:53:57.959448+0000","last_clean_scrub_stamp":"2023-08-01T19:53:57.959448+0000","objects_scrubbed":0,"log_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-08-03T00:09:48.796549+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[0,2],"acting":[0,2],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":0,"acting_primary":0,"purged_snaps":[]},{"pgid":"3.5","version":"0'0","reported_seq":10,"reported_epoch":17,"state":"active+clean","last_fresh":"2023-08-01T19:54:04.469510+0000","last_change":"2023-08-01T19:54:04.065255+0000","last_active":"2023-08-01T19:54:04.469510+0000","last_peered":"2023-08-01T19:54:04.469510+0000","last_clean":"2023-08-01T19:54:04.469510+0000","last_became_active":"2023-08-01T19:54:04.064814+0000","last_became_peered":"2023-08-01T19:54:04.064814+0000","last_unstale":"2023-08-01T19:54:04.469510+0000","last_undegraded":"2023-08-01T19:54:04.469510+0000","last_fullsized":"2023-08-01T19:54:04.469510+0000","mapping_epoch":15,"log_start":"0'0","ondisk_log_start":"0'0","created":15,"last_epoch_clean":16,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-08-01T19:54:03.032665+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-08-01T19:54:03.032665+0000","last_clean_scrub_stamp":"2023-08-01T19:54:03.032665+0000","objects_scrubbed":0,"log_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-08-03T02:01:47.073630+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[1,0],"acting":[1,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":1,"acting_primary":1,"purged_snaps":[]},{"pgid":"4.2","version":"0'0","reported_seq":9,"reported_epoch":17,"state":"active+clean","last_fresh":"2023-08-01T19:54:04.473868+0000","last_change":"2023-08-01T19:54:04.471715+0000","last_active":"2023-08-01T19:54:04.473868+0000","last_peered":"2023-08-01T19:54:04.473868+0000","last_clean":"2023-08-01T19:54:04.473868+0000","last_became_active":"2023-08-01T19:54:04.471300+0000","last_became_peered":"2023-08-01T19:54:04.471300+0000","last_unstale":"2023-08-01T19:54:04.473868+0000","last_undegraded":"2023-08-01T19:54:04.473868+0000","last_fullsized":"2023-08-01T19:54:04.473868+0000","mapping_epoch":16,"log_start":"0'0","ondisk_log_start":"0'0","created":16,"last_epoch_clean":17,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-08-01T19:54:04.040663+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-08-01T19:54:04.040663+0000","last_clean_scrub_stamp":"2023-08-01T19:54:04.040663+0000","objects_scrubbed":0,"log_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-08-02T23:00:24.980203+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[2,1],"acting":[2,1],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":2,"acting_primary":2,"purged_snaps":[]},{"pgid":"2.2","version":"0'0","reported_seq":13,"reported_epoch":17,"state":"active+clean","last_fresh":"2023-08-01T19:54:04.467109+0000","last_change":"2023-08-01T19:53:58.973665+0000","last_active":"2023-08-01T19:54:04.467109+0000","last_peered":"2023-08-01T19:54:04.467109+0000","last_clean":"2023-08-01T19:54:04.467109+0000","last_became_active":"2023-08-01T19:53:58.973463+0000","last_became_peered":"2023-08-01T19:53:58.973463+0000","last_unstale":"2023-08-01T19:54:04.467109+0000","last_undegraded":"2023-08-01T19:54:04.467109+0000","last_fullsized":"2023-08-01T19:54:04.467109+0000","mapping_epoch":12,"log_start":"0'0","ondisk_log_start":"0'0","created":12,"last_epoch_clean":13,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-08-01T19:53:57.959448+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-08-01T19:53:57.959448+0000","last_clean_scrub_stamp":"2023-08-01T19:53:57.959448+0000","objects_scrubbed":0,"log_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-08-03T04:50:42.368892+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[1,0],"acting":[1,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":1,"acting_primary":1,"purged_snaps":[]},{"pgid":"3.3","version":"0'0","reported_seq":10,"reported_epoch":17,"state":"active+clean","last_fresh":"2023-08-01T19:54:04.467459+0000","last_change":"2023-08-01T19:54:04.065415+0000","last_active":"2023-08-01T19:54:04.467459+0000","last_peered":"2023-08-01T19:54:04.467459+0000","last_clean":"2023-08-01T19:54:04.467459+0000","last_became_active":"2023-08-01T19:54:04.065030+0000","last_became_peered":"2023-08-01T19:54:04.065030+0000","last_unstale":"2023-08-01T19:54:04.467459+0000","last_undegraded":"2023-08-01T19:54:04.467459+0000","last_fullsized":"2023-08-01T19:54:04.467459+0000","mapping_epoch":15,"log_start":"0'0","ondisk_log_start":"0'0","created":15,"last_epoch_clean":16,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-08-01T19:54:03.032665+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-08-01T19:54:03.032665+0000","last_clean_scrub_stamp":"2023-08-01T19:54:03.032665+0000","objects_scrubbed":0,"log_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-08-02T21:33:27.007118+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[1,0],"acting":[1,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":1,"acting_primary":1,"purged_snaps":[]},{"pgid":"4.4","version":"0'0","reported_seq":9,"reported_epoch":17,"state":"active+clean","last_fresh":"2023-08-01T19:54:04.472012+0000","last_change":"2023-08-01T19:54:04.468101+0000","last_active":"2023-08-01T19:54:04.472012+0000","last_peered":"2023-08-01T19:54:04.472012+0000","last_clean":"2023-08-01T19:54:04.472012+0000","last_became_active":"2023-08-01T19:54:04.467409+0000","last_became_peered":"2023-08-01T19:54:04.467409+0000","last_unstale":"2023-08-01T19:54:04.472012+0000","last_undegraded":"2023-08-01T19:54:04.472012+0000","last_fullsized":"2023-08-01T19:54:04.472012+0000","mapping_epoch":16,"log_start":"0'0","ondisk_log_start":"0'0","created":16,"last_epoch_clean":17,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-08-01T19:54:04.040663+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-08-01T19:54:04.040663+0000","last_clean_scrub_stamp":"2023-08-01T19:54:04.040663+0000","objects_scrubbed":0,"log_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-08-02T21:43:30.325991+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[0,2],"acting":[0,2],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":0,"acting_primary":0,"purged_snaps":[]},{"pgid":"2.1","version":"0'0","reported_seq":13,"reported_epoch":17,"state":"active+clean","last_fresh":"2023-08-01T19:54:04.458490+0000","last_change":"2023-08-01T19:53:58.973700+0000","last_active":"2023-08-01T19:54:04.458490+0000","last_peered":"2023-08-01T19:54:04.458490+0000","last_clean":"2023-08-01T19:54:04.458490+0000","last_became_active":"2023-08-01T19:53:58.973285+0000","last_became_peered":"2023-08-01T19:53:58.973285+0000","last_unstale":"2023-08-01T19:54:04.458490+0000","last_undegraded":"2023-08-01T19:54:04.458490+0000","last_fullsized":"2023-08-01T19:54:04.458490+0000","mapping_epoch":12,"log_start":"0'0","ondisk_log_start":"0'0","created":12,"last_epoch_clean":13,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-08-01T19:53:57.959448+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-08-01T19:53:57.959448+0000","last_clean_scrub_stamp":"2023-08-01T19:53:57.959448+0000","objects_scrubbed":0,"log_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-08-02T21:26:02.570824+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[0,2],"acting":[0,2],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":0,"acting_primary":0,"purged_snaps":[]},{"pgid":"3.0","version":"0'0","reported_seq":10,"reported_epoch":17,"state":"active+clean","last_fresh":"2023-08-01T19:54:04.457828+0000","last_change":"2023-08-01T19:54:04.064407+0000","last_active":"2023-08-01T19:54:04.457828+0000","last_peered":"2023-08-01T19:54:04.457828+0000","last_clean":"2023-08-01T19:54:04.457828+0000","last_became_active":"2023-08-01T19:54:04.064122+0000","last_became_peered":"2023-08-01T19:54:04.064122+0000","last_unstale":"2023-08-01T19:54:04.457828+0000","last_undegraded":"2023-08-01T19:54:04.457828+0000","last_fullsized":"2023-08-01T19:54:04.457828+0000","mapping_epoch":15,"log_start":"0'0","ondisk_log_start":"0'0","created":15,"last_epoch_clean":16,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-08-01T19:54:03.032665+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-08-01T19:54:03.032665+0000","last_clean_scrub_stamp":"2023-08-01T19:54:03.032665+0000","objects_scrubbed":0,"log_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-08-03T07:08:17.318689+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[2,1],"acting":[2,1],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":2,"acting_primary":2,"purged_snaps":[]},{"pgid":"4.7","version":"0'0","reported_seq":9,"reported_epoch":17,"state":"active+clean","last_fresh":"2023-08-01T19:54:04.472871+0000","last_change":"2023-08-01T19:54:04.469739+0000","last_active":"2023-08-01T19:54:04.472871+0000","last_peered":"2023-08-01T19:54:04.472871+0000","last_clean":"2023-08-01T19:54:04.472871+0000","last_became_active":"2023-08-01T19:54:04.468021+0000","last_became_peered":"2023-08-01T19:54:04.468021+0000","last_unstale":"2023-08-01T19:54:04.472871+0000","last_undegraded":"2023-08-01T19:54:04.472871+0000","last_fullsized":"2023-08-01T19:54:04.472871+0000","mapping_epoch":16,"log_start":"0'0","ondisk_log_start":"0'0","created":16,"last_epoch_clean":17,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-08-01T19:54:04.040663+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-08-01T19:54:04.040663+0000","last_clean_scrub_stamp":"2023-08-01T19:54:04.040663+0000","objects_scrubbed":0,"log_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-08-02T21:03:01.319028+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[0,2],"acting":[0,2],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":0,"acting_primary":0,"purged_snaps":[]},{"pgid":"2.3","version":"0'0","reported_seq":13,"reported_epoch":17,"state":"active+clean","last_fresh":"2023-08-01T19:54:04.467483+0000","last_change":"2023-08-01T19:53:58.973768+0000","last_active":"2023-08-01T19:54:04.467483+0000","last_peered":"2023-08-01T19:54:04.467483+0000","last_clean":"2023-08-01T19:54:04.467483+0000","last_became_active":"2023-08-01T19:53:58.973492+0000","last_became_peered":"2023-08-01T19:53:58.973492+0000","last_unstale":"2023-08-01T19:54:04.467483+0000","last_undegraded":"2023-08-01T19:54:04.467483+0000","last_fullsized":"2023-08-01T19:54:04.467483+0000","mapping_epoch":12,"log_start":"0'0","ondisk_log_start":"0'0","created":12,"last_epoch_clean":13,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-08-01T19:53:57.959448+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-08-01T19:53:57.959448+0000","last_clean_scrub_stamp":"2023-08-01T19:53:57.959448+0000","objects_scrubbed":0,"log_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-08-03T02:04:52.034667+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[1,0],"acting":[1,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":1,"acting_primary":1,"purged_snaps":[]},{"pgid":"1.0","version":"10'157","reported_seq":212,"reported_epoch":17,"state":"active+clean","last_fresh":"2023-08-01T19:54:04.466599+0000","last_change":"2023-08-01T19:53:51.746910+0000","last_active":"2023-08-01T19:54:04.466599+0000","last_peered":"2023-08-01T19:54:04.466599+0000","last_clean":"2023-08-01T19:54:04.466599+0000","last_became_active":"2023-08-01T19:53:51.746590+0000","last_became_peered":"2023-08-01T19:53:51.746590+0000","last_unstale":"2023-08-01T19:54:04.466599+0000","last_undegraded":"2023-08-01T19:54:04.466599+0000","last_fullsized":"2023-08-01T19:54:04.466599+0000","mapping_epoch":9,"log_start":"0'0","ondisk_log_start":"0'0","created":9,"last_epoch_clean":10,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-08-01T19:53:50.735626+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-08-01T19:53:50.735626+0000","last_clean_scrub_stamp":"2023-08-01T19:53:50.735626+0000","objects_scrubbed":0,"log_size":157,"ondisk_log_size":157,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-08-03T02:56:50.228294+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":590368,"num_objects":2,"num_object_clones":0,"num_object_copies":4,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":2,"num_whiteouts":0,"num_read":136,"num_read_kb":118,"num_write":203,"num_write_kb":3460,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[1,2],"acting":[1,2],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":1,"acting_primary":1,"purged_snaps":[]},{"pgid":"3.2","version":"0'0","reported_seq":10,"reported_epoch":17,"state":"active+clean","last_fresh":"2023-08-01T19:54:04.458645+0000","last_change":"2023-08-01T19:54:04.064009+0000","last_active":"2023-08-01T19:54:04.458645+0000","last_peered":"2023-08-01T19:54:04.458645+0000","last_clean":"2023-08-01T19:54:04.458645+0000","last_became_active":"2023-08-01T19:54:04.063665+0000","last_became_peered":"2023-08-01T19:54:04.063665+0000","last_unstale":"2023-08-01T19:54:04.458645+0000","last_undegraded":"2023-08-01T19:54:04.458645+0000","last_fullsized":"2023-08-01T19:54:04.458645+0000","mapping_epoch":15,"log_start":"0'0","ondisk_log_start":"0'0","created":15,"last_epoch_clean":16,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-08-01T19:54:03.032665+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-08-01T19:54:03.032665+0000","last_clean_scrub_stamp":"2023-08-01T19:54:03.032665+0000","objects_scrubbed":0,"log_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-08-03T04:04:46.983253+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[0,2],"acting":[0,2],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":0,"acting_primary":0,"purged_snaps":[]},{"pgid":"4.5","version":"0'0","reported_seq":9,"reported_epoch":17,"state":"active+clean","last_fresh":"2023-08-01T19:54:04.477907+0000","last_change":"2023-08-01T19:54:04.474061+0000","last_active":"2023-08-01T19:54:04.477907+0000","last_peered":"2023-08-01T19:54:04.477907+0000","last_clean":"2023-08-01T19:54:04.477907+0000","last_became_active":"2023-08-01T19:54:04.472128+0000","last_became_peered":"2023-08-01T19:54:04.472128+0000","last_unstale":"2023-08-01T19:54:04.477907+0000","last_undegraded":"2023-08-01T19:54:04.477907+0000","last_fullsized":"2023-08-01T19:54:04.477907+0000","mapping_epoch":16,"log_start":"0'0","ondisk_log_start":"0'0","created":16,"last_epoch_clean":17,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-08-01T19:54:04.040663+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-08-01T19:54:04.040663+0000","last_clean_scrub_stamp":"2023-08-01T19:54:04.040663+0000","objects_scrubbed":0,"log_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-08-03T00:29:05.857138+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[1,2],"acting":[1,2],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":1,"acting_primary":1,"purged_snaps":[]},{"pgid":"2.0","version":"0'0","reported_seq":13,"reported_epoch":17,"state":"active+clean","last_fresh":"2023-08-01T19:54:04.466598+0000","last_change":"2023-08-01T19:53:58.975968+0000","last_active":"2023-08-01T19:54:04.466598+0000","last_peered":"2023-08-01T19:54:04.466598+0000","last_clean":"2023-08-01T19:54:04.466598+0000","last_became_active":"2023-08-01T19:53:58.975706+0000","last_became_peered":"2023-08-01T19:53:58.975706+0000","last_unstale":"2023-08-01T19:54:04.466598+0000","last_undegraded":"2023-08-01T19:54:04.466598+0000","last_fullsized":"2023-08-01T19:54:04.466598+0000","mapping_epoch":12,"log_start":"0'0","ondisk_log_start":"0'0","created":12,"last_epoch_clean":13,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-08-01T19:53:57.959448+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-08-01T19:53:57.959448+0000","last_clean_scrub_stamp":"2023-08-01T19:53:57.959448+0000","objects_scrubbed":0,"log_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-08-03T00:02:15.204280+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[1,2],"acting":[1,2],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":1,"acting_primary":1,"purged_snaps":[]},{"pgid":"3.1","version":"0'0","reported_seq":10,"reported_epoch":17,"state":"active+clean","last_fresh":"2023-08-01T19:54:04.458619+0000","last_change":"2023-08-01T19:54:04.066707+0000","last_active":"2023-08-01T19:54:04.458619+0000","last_peered":"2023-08-01T19:54:04.458619+0000","last_clean":"2023-08-01T19:54:04.458619+0000","last_became_active":"2023-08-01T19:54:04.066334+0000","last_became_peered":"2023-08-01T19:54:04.066334+0000","last_unstale":"2023-08-01T19:54:04.458619+0000","last_undegraded":"2023-08-01T19:54:04.458619+0000","last_fullsized":"2023-08-01T19:54:04.458619+0000","mapping_epoch":15,"log_start":"0'0","ondisk_log_start":"0'0","created":15,"last_epoch_clean":16,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-08-01T19:54:03.032665+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-08-01T19:54:03.032665+0000","last_clean_scrub_stamp":"2023-08-01T19:54:03.032665+0000","objects_scrubbed":0,"log_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-08-03T02:40:15.210599+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[0,1],"acting":[0,1],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":0,"acting_primary":0,"purged_snaps":[]},{"pgid":"4.6","version":"0'0","reported_seq":9,"reported_epoch":17,"state":"active+clean","last_fresh":"2023-08-01T19:54:04.471325+0000","last_change":"2023-08-01T19:54:04.469877+0000","last_active":"2023-08-01T19:54:04.471325+0000","last_peered":"2023-08-01T19:54:04.471325+0000","last_clean":"2023-08-01T19:54:04.471325+0000","last_became_active":"2023-08-01T19:54:04.469528+0000","last_became_peered":"2023-08-01T19:54:04.469528+0000","last_unstale":"2023-08-01T19:54:04.471325+0000","last_undegraded":"2023-08-01T19:54:04.471325+0000","last_fullsized":"2023-08-01T19:54:04.471325+0000","mapping_epoch":16,"log_start":"0'0","ondisk_log_start":"0'0","created":16,"last_epoch_clean":17,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-08-01T19:54:04.040663+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-08-01T19:54:04.040663+0000","last_clean_scrub_stamp":"2023-08-01T19:54:04.040663+0000","objects_scrubbed":0,"log_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-08-03T02:24:19.067602+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[2,0],"acting":[2,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":2,"acting_primary":2,"purged_snaps":[]},{"pgid":"2.5","version":"0'0","reported_seq":13,"reported_epoch":17,"state":"active+clean","last_fresh":"2023-08-01T19:54:04.459098+0000","last_change":"2023-08-01T19:53:58.970683+0000","last_active":"2023-08-01T19:54:04.459098+0000","last_peered":"2023-08-01T19:54:04.459098+0000","last_clean":"2023-08-01T19:54:04.459098+0000","last_became_active":"2023-08-01T19:53:58.970437+0000","last_became_peered":"2023-08-01T19:53:58.970437+0000","last_unstale":"2023-08-01T19:54:04.459098+0000","last_undegraded":"2023-08-01T19:54:04.459098+0000","last_fullsized":"2023-08-01T19:54:04.459098+0000","mapping_epoch":12,"log_start":"0'0","ondisk_log_start":"0'0","created":12,"last_epoch_clean":13,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-08-01T19:53:57.959448+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-08-01T19:53:57.959448+0000","last_clean_scrub_stamp":"2023-08-01T19:53:57.959448+0000","objects_scrubbed":0,"log_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-08-02T23:54:08.273426+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[2,0],"acting":[2,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":2,"acting_primary":2,"purged_snaps":[]},{"pgid":"3.4","version":"0'0","reported_seq":10,"reported_epoch":17,"state":"active+clean","last_fresh":"2023-08-01T19:54:04.458989+0000","last_change":"2023-08-01T19:54:04.062283+0000","last_active":"2023-08-01T19:54:04.458989+0000","last_peered":"2023-08-01T19:54:04.458989+0000","last_clean":"2023-08-01T19:54:04.458989+0000","last_became_active":"2023-08-01T19:54:04.061796+0000","last_became_peered":"2023-08-01T19:54:04.061796+0000","last_unstale":"2023-08-01T19:54:04.458989+0000","last_undegraded":"2023-08-01T19:54:04.458989+0000","last_fullsized":"2023-08-01T19:54:04.458989+0000","mapping_epoch":15,"log_start":"0'0","ondisk_log_start":"0'0","created":15,"last_epoch_clean":16,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-08-01T19:54:03.032665+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-08-01T19:54:03.032665+0000","last_clean_scrub_stamp":"2023-08-01T19:54:03.032665+0000","objects_scrubbed":0,"log_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-08-02T19:54:08.401797+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[0,2],"acting":[0,2],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":0,"acting_primary":0,"purged_snaps":[]},{"pgid":"4.3","version":"0'0","reported_seq":9,"reported_epoch":17,"state":"active+clean","last_fresh":"2023-08-01T19:54:04.474487+0000","last_change":"2023-08-01T19:54:04.473088+0000","last_active":"2023-08-01T19:54:04.474487+0000","last_peered":"2023-08-01T19:54:04.474487+0000","last_clean":"2023-08-01T19:54:04.474487+0000","last_became_active":"2023-08-01T19:54:04.472611+0000","last_became_peered":"2023-08-01T19:54:04.472611+0000","last_unstale":"2023-08-01T19:54:04.474487+0000","last_undegraded":"2023-08-01T19:54:04.474487+0000","last_fullsized":"2023-08-01T19:54:04.474487+0000","mapping_epoch":16,"log_start":"0'0","ondisk_log_start":"0'0","created":16,"last_epoch_clean":17,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-08-01T19:54:04.040663+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-08-01T19:54:04.040663+0000","last_clean_scrub_stamp":"2023-08-01T19:54:04.040663+0000","objects_scrubbed":0,"log_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-08-03T07:27:26.537518+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[2,1],"acting":[2,1],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":2,"acting_primary":2,"purged_snaps":[]},{"pgid":"3.7","version":"17'2","reported_seq":12,"reported_epoch":17,"state":"active+clean","last_fresh":"2023-08-01T19:54:04.471357+0000","last_change":"2023-08-01T19:54:04.065147+0000","last_active":"2023-08-01T19:54:04.471357+0000","last_peered":"2023-08-01T19:54:04.471357+0000","last_clean":"2023-08-01T19:54:04.471357+0000","last_became_active":"2023-08-01T19:54:04.064779+0000","last_became_peered":"2023-08-01T19:54:04.064779+0000","last_unstale":"2023-08-01T19:54:04.471357+0000","last_undegraded":"2023-08-01T19:54:04.471357+0000","last_fullsized":"2023-08-01T19:54:04.471357+0000","mapping_epoch":15,"log_start":"0'0","ondisk_log_start":"0'0","created":15,"last_epoch_clean":16,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-08-01T19:54:03.032665+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-08-01T19:54:03.032665+0000","last_clean_scrub_stamp":"2023-08-01T19:54:03.032665+0000","objects_scrubbed":0,"log_size":2,"ondisk_log_size":2,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-08-03T03:43:45.667663+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":1,"num_object_clones":0,"num_object_copies":2,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":1,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":3,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":1,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[0,2],"acting":[0,2],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":0,"acting_primary":0,"purged_snaps":[]},{"pgid":"2.6","version":"0'0","reported_seq":13,"reported_epoch":17,"state":"active+clean","last_fresh":"2023-08-01T19:54:04.460651+0000","last_change":"2023-08-01T19:53:58.974077+0000","last_active":"2023-08-01T19:54:04.460651+0000","last_peered":"2023-08-01T19:54:04.460651+0000","last_clean":"2023-08-01T19:54:04.460651+0000","last_became_active":"2023-08-01T19:53:58.973396+0000","last_became_peered":"2023-08-01T19:53:58.973396+0000","last_unstale":"2023-08-01T19:54:04.460651+0000","last_undegraded":"2023-08-01T19:54:04.460651+0000","last_fullsized":"2023-08-01T19:54:04.460651+0000","mapping_epoch":12,"log_start":"0'0","ondisk_log_start":"0'0","created":12,"last_epoch_clean":13,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-08-01T19:53:57.959448+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-08-01T19:53:57.959448+0000","last_clean_scrub_stamp":"2023-08-01T19:53:57.959448+0000","objects_scrubbed":0,"log_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-08-02T22:13:50.940864+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[0,2],"acting":[0,2],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":0,"acting_primary":0,"purged_snaps":[]},{"pgid":"4.0","version":"0'0","reported_seq":9,"reported_epoch":17,"state":"active+clean","last_fresh":"2023-08-01T19:54:04.477383+0000","last_change":"2023-08-01T19:54:04.476807+0000","last_active":"2023-08-01T19:54:04.477383+0000","last_peered":"2023-08-01T19:54:04.477383+0000","last_clean":"2023-08-01T19:54:04.477383+0000","last_became_active":"2023-08-01T19:54:04.476453+0000","last_became_peered":"2023-08-01T19:54:04.476453+0000","last_unstale":"2023-08-01T19:54:04.477383+0000","last_undegraded":"2023-08-01T19:54:04.477383+0000","last_fullsized":"2023-08-01T19:54:04.477383+0000","mapping_epoch":16,"log_start":"0'0","ondisk_log_start":"0'0","created":16,"last_epoch_clean":17,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-08-01T19:54:04.040663+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-08-01T19:54:04.040663+0000","last_clean_scrub_stamp":"2023-08-01T19:54:04.040663+0000","objects_scrubbed":0,"log_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-08-02T20:20:59.989030+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[0,1],"acting":[0,1],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":0,"acting_primary":0,"purged_snaps":[]},{"pgid":"2.7","version":"0'0","reported_seq":13,"reported_epoch":17,"state":"active+clean","last_fresh":"2023-08-01T19:54:04.469429+0000","last_change":"2023-08-01T19:53:58.975936+0000","last_active":"2023-08-01T19:54:04.469429+0000","last_peered":"2023-08-01T19:54:04.469429+0000","last_clean":"2023-08-01T19:54:04.469429+0000","last_became_active":"2023-08-01T19:53:58.975680+0000","last_became_peered":"2023-08-01T19:53:58.975680+0000","last_unstale":"2023-08-01T19:54:04.469429+0000","last_undegraded":"2023-08-01T19:54:04.469429+0000","last_fullsized":"2023-08-01T19:54:04.469429+0000","mapping_epoch":12,"log_start":"0'0","ondisk_log_start":"0'0","created":12,"last_epoch_clean":13,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-08-01T19:53:57.959448+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-08-01T19:53:57.959448+0000","last_clean_scrub_stamp":"2023-08-01T19:53:57.959448+0000","objects_scrubbed":0,"log_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-08-03T05:17:03.508898+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[1,2],"acting":[1,2],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":1,"acting_primary":1,"purged_snaps":[]},{"pgid":"3.6","version":"18'1","reported_seq":11,"reported_epoch":18,"state":"active+clean","last_fresh":"2023-08-01T19:54:06.924239+0000","last_change":"2023-08-01T19:54:04.068041+0000","last_active":"2023-08-01T19:54:06.924239+0000","last_peered":"2023-08-01T19:54:06.924239+0000","last_clean":"2023-08-01T19:54:06.924239+0000","last_became_active":"2023-08-01T19:54:04.067613+0000","last_became_peered":"2023-08-01T19:54:04.067613+0000","last_unstale":"2023-08-01T19:54:06.924239+0000","last_undegraded":"2023-08-01T19:54:06.924239+0000","last_fullsized":"2023-08-01T19:54:06.924239+0000","mapping_epoch":15,"log_start":"0'0","ondisk_log_start":"0'0","created":15,"last_epoch_clean":16,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-08-01T19:54:03.032665+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-08-01T19:54:03.032665+0000","last_clean_scrub_stamp":"2023-08-01T19:54:03.032665+0000","objects_scrubbed":0,"log_size":1,"ondisk_log_size":1,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-08-02T21:35:44.874727+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":1,"num_object_clones":0,"num_object_copies":2,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":1,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":1,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":1,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[0,1],"acting":[0,1],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":0,"acting_primary":0,"purged_snaps":[]},{"pgid":"4.1","version":"0'0","reported_seq":9,"reported_epoch":17,"state":"active+clean","last_fresh":"2023-08-01T19:54:04.470826+0000","last_change":"2023-08-01T19:54:04.469243+0000","last_active":"2023-08-01T19:54:04.470826+0000","last_peered":"2023-08-01T19:54:04.470826+0000","last_clean":"2023-08-01T19:54:04.470826+0000","last_became_active":"2023-08-01T19:54:04.468835+0000","last_became_peered":"2023-08-01T19:54:04.468835+0000","last_unstale":"2023-08-01T19:54:04.470826+0000","last_undegraded":"2023-08-01T19:54:04.470826+0000","last_fullsized":"2023-08-01T19:54:04.470826+0000","mapping_epoch":16,"log_start":"0'0","ondisk_log_start":"0'0","created":16,"last_epoch_clean":17,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-08-01T19:54:04.040663+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-08-01T19:54:04.040663+0000","last_clean_scrub_stamp":"2023-08-01T19:54:04.040663+0000","objects_scrubbed":0,"log_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-08-03T04:43:58.358628+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[2,1],"acting":[2,1],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":2,"acting_primary":2,"purged_snaps":[]},{"pgid":"3.1b","version":"17'1","reported_seq":11,"reported_epoch":17,"state":"active+clean","last_fresh":"2023-08-01T19:54:04.471524+0000","last_change":"2023-08-01T19:54:04.066748+0000","last_active":"2023-08-01T19:54:04.471524+0000","last_peered":"2023-08-01T19:54:04.471524+0000","last_clean":"2023-08-01T19:54:04.471524+0000","last_became_active":"2023-08-01T19:54:04.066483+0000","last_became_peered":"2023-08-01T19:54:04.066483+0000","last_unstale":"2023-08-01T19:54:04.471524+0000","last_undegraded":"2023-08-01T19:54:04.471524+0000","last_fullsized":"2023-08-01T19:54:04.471524+0000","mapping_epoch":15,"log_start":"0'0","ondisk_log_start":"0'0","created":15,"last_epoch_clean":16,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-08-01T19:54:03.032665+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-08-01T19:54:03.032665+0000","last_clean_scrub_stamp":"2023-08-01T19:54:03.032665+0000","objects_scrubbed":0,"log_size":1,"ondisk_log_size":1,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-08-03T03:08:26.880362+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[2,1],"acting":[2,1],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":2,"acting_primary":2,"purged_snaps":[]},{"pgid":"4.1c","version":"0'0","reported_seq":9,"reported_epoch":17,"state":"active+clean","last_fresh":"2023-08-01T19:54:04.468766+0000","last_change":"2023-08-01T19:54:04.466766+0000","last_active":"2023-08-01T19:54:04.468766+0000","last_peered":"2023-08-01T19:54:04.468766+0000","last_clean":"2023-08-01T19:54:04.468766+0000","last_became_active":"2023-08-01T19:54:04.466417+0000","last_became_peered":"2023-08-01T19:54:04.466417+0000","last_unstale":"2023-08-01T19:54:04.468766+0000","last_undegraded":"2023-08-01T19:54:04.468766+0000","last_fullsized":"2023-08-01T19:54:04.468766+0000","mapping_epoch":16,"log_start":"0'0","ondisk_log_start":"0'0","created":16,"last_epoch_clean":17,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-08-01T19:54:04.040663+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-08-01T19:54:04.040663+0000","last_clean_scrub_stamp":"2023-08-01T19:54:04.040663+0000","objects_scrubbed":0,"log_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-08-02T22:01:53.643825+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[2,0],"acting":[2,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":2,"acting_primary":2,"purged_snaps":[]},{"pgid":"3.1c","version":"17'2","reported_seq":12,"reported_epoch":17,"state":"active+clean","last_fresh":"2023-08-01T19:54:04.477825+0000","last_change":"2023-08-01T19:54:04.065706+0000","last_active":"2023-08-01T19:54:04.477825+0000","last_peered":"2023-08-01T19:54:04.477825+0000","last_clean":"2023-08-01T19:54:04.477825+0000","last_became_active":"2023-08-01T19:54:04.064796+0000","last_became_peered":"2023-08-01T19:54:04.064796+0000","last_unstale":"2023-08-01T19:54:04.477825+0000","last_undegraded":"2023-08-01T19:54:04.477825+0000","last_fullsized":"2023-08-01T19:54:04.477825+0000","mapping_epoch":15,"log_start":"0'0","ondisk_log_start":"0'0","created":15,"last_epoch_clean":16,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-08-01T19:54:03.032665+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-08-01T19:54:03.032665+0000","last_clean_scrub_stamp":"2023-08-01T19:54:03.032665+0000","objects_scrubbed":0,"log_size":2,"ondisk_log_size":2,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-08-02T21:40:43.596301+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":1,"num_object_clones":0,"num_object_copies":2,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":1,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":3,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":1,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[1,0],"acting":[1,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":1,"acting_primary":1,"purged_snaps":[]},{"pgid":"4.1b","version":"0'0","reported_seq":9,"reported_epoch":17,"state":"active+clean","last_fresh":"2023-08-01T19:54:04.478301+0000","last_change":"2023-08-01T19:54:04.474971+0000","last_active":"2023-08-01T19:54:04.478301+0000","last_peered":"2023-08-01T19:54:04.478301+0000","last_clean":"2023-08-01T19:54:04.478301+0000","last_became_active":"2023-08-01T19:54:04.473957+0000","last_became_peered":"2023-08-01T19:54:04.473957+0000","last_unstale":"2023-08-01T19:54:04.478301+0000","last_undegraded":"2023-08-01T19:54:04.478301+0000","last_fullsized":"2023-08-01T19:54:04.478301+0000","mapping_epoch":16,"log_start":"0'0","ondisk_log_start":"0'0","created":16,"last_epoch_clean":17,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-08-01T19:54:04.040663+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-08-01T19:54:04.040663+0000","last_clean_scrub_stamp":"2023-08-01T19:54:04.040663+0000","objects_scrubbed":0,"log_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-08-02T21:59:19.682560+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[1,0],"acting":[1,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":1,"acting_primary":1,"purged_snaps":[]},{"pgid":"3.1d","version":"17'2","reported_seq":12,"reported_epoch":17,"state":"active+clean","last_fresh":"2023-08-01T19:54:04.471623+0000","last_change":"2023-08-01T19:54:04.065591+0000","last_active":"2023-08-01T19:54:04.471623+0000","last_peered":"2023-08-01T19:54:04.471623+0000","last_clean":"2023-08-01T19:54:04.471623+0000","last_became_active":"2023-08-01T19:54:04.065306+0000","last_became_peered":"2023-08-01T19:54:04.065306+0000","last_unstale":"2023-08-01T19:54:04.471623+0000","last_undegraded":"2023-08-01T19:54:04.471623+0000","last_fullsized":"2023-08-01T19:54:04.471623+0000","mapping_epoch":15,"log_start":"0'0","ondisk_log_start":"0'0","created":15,"last_epoch_clean":16,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-08-01T19:54:03.032665+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-08-01T19:54:03.032665+0000","last_clean_scrub_stamp":"2023-08-01T19:54:03.032665+0000","objects_scrubbed":0,"log_size":2,"ondisk_log_size":2,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-08-02T21:32:10.389227+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":1,"num_object_clones":0,"num_object_copies":2,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":1,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":3,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":1,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[2,1],"acting":[2,1],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":2,"acting_primary":2,"purged_snaps":[]},{"pgid":"4.1a","version":"0'0","reported_seq":9,"reported_epoch":17,"state":"active+clean","last_fresh":"2023-08-01T19:54:04.477591+0000","last_change":"2023-08-01T19:54:04.473302+0000","last_active":"2023-08-01T19:54:04.477591+0000","last_peered":"2023-08-01T19:54:04.477591+0000","last_clean":"2023-08-01T19:54:04.477591+0000","last_became_active":"2023-08-01T19:54:04.472452+0000","last_became_peered":"2023-08-01T19:54:04.472452+0000","last_unstale":"2023-08-01T19:54:04.477591+0000","last_undegraded":"2023-08-01T19:54:04.477591+0000","last_fullsized":"2023-08-01T19:54:04.477591+0000","mapping_epoch":16,"log_start":"0'0","ondisk_log_start":"0'0","created":16,"last_epoch_clean":17,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-08-01T19:54:04.040663+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-08-01T19:54:04.040663+0000","last_clean_scrub_stamp":"2023-08-01T19:54:04.040663+0000","objects_scrubbed":0,"log_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-08-02T21:02:39.542019+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[1,0],"acting":[1,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":1,"acting_primary":1,"purged_snaps":[]},{"pgid":"3.1e","version":"17'1","reported_seq":11,"reported_epoch":17,"state":"active+clean","last_fresh":"2023-08-01T19:54:04.471416+0000","last_change":"2023-08-01T19:54:04.064378+0000","last_active":"2023-08-01T19:54:04.471416+0000","last_peered":"2023-08-01T19:54:04.471416+0000","last_clean":"2023-08-01T19:54:04.471416+0000","last_became_active":"2023-08-01T19:54:04.063988+0000","last_became_peered":"2023-08-01T19:54:04.063988+0000","last_unstale":"2023-08-01T19:54:04.471416+0000","last_undegraded":"2023-08-01T19:54:04.471416+0000","last_fullsized":"2023-08-01T19:54:04.471416+0000","mapping_epoch":15,"log_start":"0'0","ondisk_log_start":"0'0","created":15,"last_epoch_clean":16,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-08-01T19:54:03.032665+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-08-01T19:54:03.032665+0000","last_clean_scrub_stamp":"2023-08-01T19:54:03.032665+0000","objects_scrubbed":0,"log_size":1,"ondisk_log_size":1,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-08-02T22:28:51.936138+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[0,2],"acting":[0,2],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":0,"acting_primary":0,"purged_snaps":[]},{"pgid":"4.19","version":"0'0","reported_seq":9,"reported_epoch":17,"state":"active+clean","last_fresh":"2023-08-01T19:54:04.469620+0000","last_change":"2023-08-01T19:54:04.467017+0000","last_active":"2023-08-01T19:54:04.469620+0000","last_peered":"2023-08-01T19:54:04.469620+0000","last_clean":"2023-08-01T19:54:04.469620+0000","last_became_active":"2023-08-01T19:54:04.466339+0000","last_became_peered":"2023-08-01T19:54:04.466339+0000","last_unstale":"2023-08-01T19:54:04.469620+0000","last_undegraded":"2023-08-01T19:54:04.469620+0000","last_fullsized":"2023-08-01T19:54:04.469620+0000","mapping_epoch":16,"log_start":"0'0","ondisk_log_start":"0'0","created":16,"last_epoch_clean":17,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-08-01T19:54:04.040663+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-08-01T19:54:04.040663+0000","last_clean_scrub_stamp":"2023-08-01T19:54:04.040663+0000","objects_scrubbed":0,"log_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-08-03T04:07:57.222873+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[2,0],"acting":[2,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":2,"acting_primary":2,"purged_snaps":[]},{"pgid":"3.1f","version":"17'4","reported_seq":14,"reported_epoch":17,"state":"active+clean","last_fresh":"2023-08-01T19:54:04.472669+0000","last_change":"2023-08-01T19:54:04.067767+0000","last_active":"2023-08-01T19:54:04.472669+0000","last_peered":"2023-08-01T19:54:04.472669+0000","last_clean":"2023-08-01T19:54:04.472669+0000","last_became_active":"2023-08-01T19:54:04.067414+0000","last_became_peered":"2023-08-01T19:54:04.067414+0000","last_unstale":"2023-08-01T19:54:04.472669+0000","last_undegraded":"2023-08-01T19:54:04.472669+0000","last_fullsized":"2023-08-01T19:54:04.472669+0000","mapping_epoch":15,"log_start":"0'0","ondisk_log_start":"0'0","created":15,"last_epoch_clean":16,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-08-01T19:54:03.032665+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-08-01T19:54:03.032665+0000","last_clean_scrub_stamp":"2023-08-01T19:54:03.032665+0000","objects_scrubbed":0,"log_size":4,"ondisk_log_size":4,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-08-02T21:33:27.007118+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":554,"num_objects":2,"num_object_clones":0,"num_object_copies":4,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":2,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":4,"num_write_kb":1,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":1,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[0,1],"acting":[0,1],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":0,"acting_primary":0,"purged_snaps":[]},{"pgid":"4.18","version":"0'0","reported_seq":9,"reported_epoch":17,"state":"active+clean","last_fresh":"2023-08-01T19:54:04.478697+0000","last_change":"2023-08-01T19:54:04.477588+0000","last_active":"2023-08-01T19:54:04.478697+0000","last_peered":"2023-08-01T19:54:04.478697+0000","last_clean":"2023-08-01T19:54:04.478697+0000","last_became_active":"2023-08-01T19:54:04.476194+0000","last_became_peered":"2023-08-01T19:54:04.476194+0000","last_unstale":"2023-08-01T19:54:04.478697+0000","last_undegraded":"2023-08-01T19:54:04.478697+0000","last_fullsized":"2023-08-01T19:54:04.478697+0000","mapping_epoch":16,"log_start":"0'0","ondisk_log_start":"0'0","created":16,"last_epoch_clean":17,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-08-01T19:54:04.040663+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-08-01T19:54:04.040663+0000","last_clean_scrub_stamp":"2023-08-01T19:54:04.040663+0000","objects_scrubbed":0,"log_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-08-03T03:58:06.360840+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[1,0],"acting":[1,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":1,"acting_primary":1,"purged_snaps":[]},{"pgid":"4.20","version":"0'0","reported_seq":9,"reported_epoch":17,"state":"active+clean","last_fresh":"2023-08-01T19:54:04.479155+0000","last_change":"2023-08-01T19:54:04.477904+0000","last_active":"2023-08-01T19:54:04.479155+0000","last_peered":"2023-08-01T19:54:04.479155+0000","last_clean":"2023-08-01T19:54:04.479155+0000","last_became_active":"2023-08-01T19:54:04.476564+0000","last_became_peered":"2023-08-01T19:54:04.476564+0000","last_unstale":"2023-08-01T19:54:04.479155+0000","last_undegraded":"2023-08-01T19:54:04.479155+0000","last_fullsized":"2023-08-01T19:54:04.479155+0000","mapping_epoch":16,"log_start":"0'0","ondisk_log_start":"0'0","created":16,"last_epoch_clean":17,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-08-01T19:54:04.040663+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-08-01T19:54:04.040663+0000","last_clean_scrub_stamp":"2023-08-01T19:54:04.040663+0000","objects_scrubbed":0,"log_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-08-03T02:21:47.656072+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[1,0],"acting":[1,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":1,"acting_primary":1,"purged_snaps":[]},{"pgid":"4.21","version":"0'0","reported_seq":9,"reported_epoch":17,"state":"active+clean","last_fresh":"2023-08-01T19:54:04.471608+0000","last_change":"2023-08-01T19:54:04.466899+0000","last_active":"2023-08-01T19:54:04.471608+0000","last_peered":"2023-08-01T19:54:04.471608+0000","last_clean":"2023-08-01T19:54:04.471608+0000","last_became_active":"2023-08-01T19:54:04.466500+0000","last_became_peered":"2023-08-01T19:54:04.466500+0000","last_unstale":"2023-08-01T19:54:04.471608+0000","last_undegraded":"2023-08-01T19:54:04.471608+0000","last_fullsized":"2023-08-01T19:54:04.471608+0000","mapping_epoch":16,"log_start":"0'0","ondisk_log_start":"0'0","created":16,"last_epoch_clean":17,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-08-01T19:54:04.040663+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-08-01T19:54:04.040663+0000","last_clean_scrub_stamp":"2023-08-01T19:54:04.040663+0000","objects_scrubbed":0,"log_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-08-03T07:36:38.654701+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[0,2],"acting":[0,2],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":0,"acting_primary":0,"purged_snaps":[]},{"pgid":"4.22","version":"0'0","reported_seq":9,"reported_epoch":17,"state":"active+clean","last_fresh":"2023-08-01T19:54:04.473914+0000","last_change":"2023-08-01T19:54:04.471945+0000","last_active":"2023-08-01T19:54:04.473914+0000","last_peered":"2023-08-01T19:54:04.473914+0000","last_clean":"2023-08-01T19:54:04.473914+0000","last_became_active":"2023-08-01T19:54:04.471371+0000","last_became_peered":"2023-08-01T19:54:04.471371+0000","last_unstale":"2023-08-01T19:54:04.473914+0000","last_undegraded":"2023-08-01T19:54:04.473914+0000","last_fullsized":"2023-08-01T19:54:04.473914+0000","mapping_epoch":16,"log_start":"0'0","ondisk_log_start":"0'0","created":16,"last_epoch_clean":17,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-08-01T19:54:04.040663+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-08-01T19:54:04.040663+0000","last_clean_scrub_stamp":"2023-08-01T19:54:04.040663+0000","objects_scrubbed":0,"log_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-08-02T22:17:59.847819+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[2,1],"acting":[2,1],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":2,"acting_primary":2,"purged_snaps":[]},{"pgid":"4.23","version":"0'0","reported_seq":9,"reported_epoch":17,"state":"active+clean","last_fresh":"2023-08-01T19:54:04.472334+0000","last_change":"2023-08-01T19:54:04.467847+0000","last_active":"2023-08-01T19:54:04.472334+0000","last_peered":"2023-08-01T19:54:04.472334+0000","last_clean":"2023-08-01T19:54:04.472334+0000","last_became_active":"2023-08-01T19:54:04.467111+0000","last_became_peered":"2023-08-01T19:54:04.467111+0000","last_unstale":"2023-08-01T19:54:04.472334+0000","last_undegraded":"2023-08-01T19:54:04.472334+0000","last_fullsized":"2023-08-01T19:54:04.472334+0000","mapping_epoch":16,"log_start":"0'0","ondisk_log_start":"0'0","created":16,"last_epoch_clean":17,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-08-01T19:54:04.040663+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-08-01T19:54:04.040663+0000","last_clean_scrub_stamp":"2023-08-01T19:54:04.040663+0000","objects_scrubbed":0,"log_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-08-03T00:42:19.379348+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[0,2],"acting":[0,2],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":0,"acting_primary":0,"purged_snaps":[]},{"pgid":"4.24","version":"0'0","reported_seq":9,"reported_epoch":17,"state":"active+clean","last_fresh":"2023-08-01T19:54:04.482540+0000","last_change":"2023-08-01T19:54:04.477128+0000","last_active":"2023-08-01T19:54:04.482540+0000","last_peered":"2023-08-01T19:54:04.482540+0000","last_clean":"2023-08-01T19:54:04.482540+0000","last_became_active":"2023-08-01T19:54:04.476819+0000","last_became_peered":"2023-08-01T19:54:04.476819+0000","last_unstale":"2023-08-01T19:54:04.482540+0000","last_undegraded":"2023-08-01T19:54:04.482540+0000","last_fullsized":"2023-08-01T19:54:04.482540+0000","mapping_epoch":16,"log_start":"0'0","ondisk_log_start":"0'0","created":16,"last_epoch_clean":17,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-08-01T19:54:04.040663+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-08-01T19:54:04.040663+0000","last_clean_scrub_stamp":"2023-08-01T19:54:04.040663+0000","objects_scrubbed":0,"log_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-08-03T02:20:23.354054+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[2,1],"acting":[2,1],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":2,"acting_primary":2,"purged_snaps":[]}],"pool_stats":[{"poolid":4,"num_pg":64,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"store_stats":{"total":0,"available":0,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},"log_size":0,"ondisk_log_size":0,"up":128,"acting":128,"num_store_stats":3},{"poolid":3,"num_pg":32,"stat_sum":{"num_bytes":2306,"num_objects":22,"num_object_clones":0,"num_object_copies":44,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":22,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":45,"num_write_kb":13,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":14,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"store_stats":{"total":0,"available":0,"internally_reserved":0,"allocated":65536,"data_stored":4612,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},"log_size":39,"ondisk_log_size":39,"up":64,"acting":64,"num_store_stats":3},{"poolid":1,"num_pg":1,"stat_sum":{"num_bytes":590368,"num_objects":2,"num_object_clones":0,"num_object_copies":4,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":2,"num_whiteouts":0,"num_read":136,"num_read_kb":118,"num_write":203,"num_write_kb":3460,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"store_stats":{"total":0,"available":0,"internally_reserved":0,"allocated":114688,"data_stored":1180736,"data_compressed":20662,"data_compressed_allocated":73728,"data_compressed_original":1146880,"omap_allocated":0,"internal_metadata":0},"log_size":157,"ondisk_log_size":157,"up":2,"acting":2,"num_store_stats":2},{"poolid":2,"num_pg":8,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"store_stats":{"total":0,"available":0,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},"log_size":0,"ondisk_log_size":0,"up":16,"acting":16,"num_store_stats":3}],"osd_stats":[{"osd":2,"up_from":9,"seq":38654705672,"num_pgs":67,"num_osds":1,"num_per_pool_osds":1,"num_per_pool_omap_osds":1,"kb":94371840,"kb_used":9264,"kb_used_data":232,"kb_used_omap":0,"kb_used_meta":9024,"kb_avail":94362576,"statfs":{"total":96636764160,"available":96627277824,"internally_reserved":0,"allocated":237568,"data_stored":647231,"data_compressed":10331,"data_compressed_allocated":36864,"data_compressed_original":573440,"omap_allocated":0,"internal_metadata":9240576},"hb_peers":[0,1],"snap_trim_queue_len":0,"num_snap_trimming":0,"num_shards_repaired":0,"op_queue_age_hist":{"histogram":[],"upper_bound":1},"perf_stat":{"commit_latency_ms":0,"apply_latency_ms":0,"commit_latency_ns":0,"apply_latency_ns":0},"alerts":[],"network_ping_times":[{"osd":0,"last update":"Thu Jan 1 00:00:00 1970","interfaces":[{"interface":"back","average":{"1min":0,"5min":0,"15min":0},"min":{"1min":0,"5min":0,"15min":0},"max":{"1min":0,"5min":0,"15min":0},"last":0.40300000000000002}]},{"osd":1,"last update":"Thu Jan 1 00:00:00 1970","interfaces":[{"interface":"back","average":{"1min":0,"5min":0,"15min":0},"min":{"1min":0,"5min":0,"15min":0},"max":{"1min":0,"5min":0,"15min":0},"last":0.52000000000000002}]}]},{"osd":0,"up_from":8,"seq":34359738375,"num_pgs":72,"num_osds":1,"num_per_pool_osds":1,"num_per_pool_omap_osds":1,"kb":94371840,"kb_used":12648,"kb_used_data":160,"kb_used_omap":0,"kb_used_meta":12480,"kb_avail":94359192,"statfs":{"total":96636764160,"available":96623812608,"internally_reserved":0,"allocated":163840,"data_stored":55733,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":12779520},"hb_peers":[1,2],"snap_trim_queue_len":0,"num_snap_trimming":0,"num_shards_repaired":0,"op_queue_age_hist":{"histogram":[],"upper_bound":1},"perf_stat":{"commit_latency_ms":0,"apply_latency_ms":0,"commit_latency_ns":0,"apply_latency_ns":0},"alerts":[],"network_ping_times":[{"osd":1,"last update":"Thu Jan 1 00:00:00 1970","interfaces":[{"interface":"back","average":{"1min":0,"5min":0,"15min":0},"min":{"1min":0,"5min":0,"15min":0},"max":{"1min":0,"5min":0,"15min":0},"last":0.45200000000000001}]},{"osd":2,"last update":"Thu Jan 1 00:00:00 1970","interfaces":[{"interface":"back","average":{"1min":0,"5min":0,"15min":0},"min":{"1min":0,"5min":0,"15min":0},"max":{"1min":0,"5min":0,"15min":0},"last":0.52100000000000002}]}]},{"osd":1,"up_from":8,"seq":34359738374,"num_pgs":71,"num_osds":1,"num_per_pool_osds":1,"num_per_pool_omap_osds":1,"kb":94371840,"kb_used":9336,"kb_used_data":240,"kb_used_omap":0,"kb_used_meta":9088,"kb_avail":94362504,"statfs":{"total":96636764160,"available":96627204096,"internally_reserved":0,"allocated":245760,"data_stored":647819,"data_compressed":10331,"data_compressed_allocated":36864,"data_compressed_original":573440,"omap_allocated":0,"internal_metadata":9306112},"hb_peers":[0,2],"snap_trim_queue_len":0,"num_snap_trimming":0,"num_shards_repaired":0,"op_queue_age_hist":{"histogram":[],"upper_bound":1},"perf_stat":{"commit_latency_ms":0,"apply_latency_ms":0,"commit_latency_ns":0,"apply_latency_ns":0},"alerts":[],"network_ping_times":[{"osd":0,"last update":"Thu Jan 1 00:00:00 1970","interfaces":[{"interface":"back","average":{"1min":0,"5min":0,"15min":0},"min":{"1min":0,"5min":0,"15min":0},"max":{"1min":0,"5min":0,"15min":0},"last":0.53100000000000003}]},{"osd":2,"last update":"Thu Jan 1 00:00:00 1970","interfaces":[{"interface":"back","average":{"1min":0,"5min":0,"15min":0},"min":{"1min":0,"5min":0,"15min":0},"max":{"1min":0,"5min":0,"15min":0},"last":0.58299999999999996}]}]}],"pool_statfs":[{"poolid":1,"osd":1,"total":0,"available":0,"internally_reserved":0,"allocated":57344,"data_stored":590368,"data_compressed":10331,"data_compressed_allocated":36864,"data_compressed_original":573440,"omap_allocated":0,"internal_metadata":0},{"poolid":1,"osd":2,"total":0,"available":0,"internally_reserved":0,"allocated":57344,"data_stored":590368,"data_compressed":10331,"data_compressed_allocated":36864,"data_compressed_original":573440,"omap_allocated":0,"internal_metadata":0},{"poolid":2,"osd":0,"total":0,"available":0,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":2,"osd":1,"total":0,"available":0,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":2,"osd":2,"total":0,"available":0,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":3,"osd":0,"total":0,"available":0,"internally_reserved":0,"allocated":8192,"data_stored":588,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":3,"osd":1,"total":0,"available":0,"internally_reserved":0,"allocated":32768,"data_stored":2306,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":3,"osd":2,"total":0,"available":0,"internally_reserved":0,"allocated":24576,"data_stored":1718,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":4,"osd":0,"total":0,"available":0,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":4,"osd":1,"total":0,"available":0,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":4,"osd":2,"total":0,"available":0,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0}]}} 2023-08-01T19:54:14.246 INFO:tasks.ceph.ceph_manager.ceph:clean! 2023-08-01T19:54:14.246 INFO:tasks.ceph:Waiting until ceph cluster ceph is healthy... 2023-08-01T19:54:14.246 INFO:tasks.ceph.ceph_manager.ceph:wait_until_healthy 2023-08-01T19:54:14.247 DEBUG:teuthology.orchestra.run.smithi006:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 120 ceph --cluster ceph health --format=json 2023-08-01T19:54:14.642 INFO:teuthology.orchestra.run.smithi006.stdout: 2023-08-01T19:54:14.642 INFO:teuthology.orchestra.run.smithi006.stdout:{"status":"HEALTH_OK","checks":{},"mutes":[]} 2023-08-01T19:54:14.655 INFO:tasks.ceph.ceph_manager.ceph:wait_until_healthy done 2023-08-01T19:54:14.656 DEBUG:teuthology.orchestra.run.smithi006:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 120 ceph --cluster ceph osd dump --format=json 2023-08-01T19:54:14.980 INFO:teuthology.orchestra.run.smithi006.stdout: 2023-08-01T19:54:14.981 INFO:teuthology.orchestra.run.smithi006.stdout:{"epoch":18,"fsid":"a0e420cc-4df1-42a5-8bd4-a98c309a9349","created":"2023-08-01T19:53:41.279588+0000","modified":"2023-08-01T19:54:05.452537+0000","last_up_change":"2023-08-01T19:53:50.735626+0000","last_in_change":"2023-08-01T19:53:42.974751+0000","flags":"sortbitwise,recovery_deletes,purged_snapdirs,pglog_hardlimit","flags_num":5799936,"flags_set":["pglog_hardlimit","purged_snapdirs","recovery_deletes","sortbitwise"],"crush_version":5,"full_ratio":0.94999998807907104,"backfillfull_ratio":0.89999997615814209,"nearfull_ratio":0.85000002384185791,"cluster_snapshot":"","pool_max":4,"max_osd":3,"require_min_compat_client":"luminous","min_compat_client":"jewel","require_osd_release":"quincy","pools":[{"pool":1,"pool_name":".mgr","create_time":"2023-08-01T19:53:49.961944+0000","flags":1,"flags_names":"hashpspool","type":1,"size":2,"min_size":1,"crush_rule":0,"peering_crush_bucket_count":0,"peering_crush_bucket_target":0,"peering_crush_bucket_barrier":0,"peering_crush_bucket_mandatory_member":2147483647,"object_hash":2,"pg_autoscale_mode":"off","pg_num":1,"pg_placement_num":1,"pg_placement_num_target":1,"pg_num_target":1,"pg_num_pending":1,"last_pg_merge_meta":{"source_pgid":"0.0","ready_epoch":0,"last_epoch_started":0,"last_epoch_clean":0,"source_version":"0'0","target_version":"0'0"},"last_change":"11","last_force_op_resend":"0","last_force_op_resend_prenautilus":"0","last_force_op_resend_preluminous":"0","auid":0,"snap_mode":"selfmanaged","snap_seq":0,"snap_epoch":0,"pool_snaps":[],"removed_snaps":"[]","quota_max_bytes":0,"quota_max_objects":0,"tiers":[],"tier_of":-1,"read_tier":-1,"write_tier":-1,"cache_mode":"none","target_max_bytes":0,"target_max_objects":0,"cache_target_dirty_ratio_micro":400000,"cache_target_dirty_high_ratio_micro":600000,"cache_target_full_ratio_micro":800000,"cache_min_flush_age":0,"cache_min_evict_age":0,"erasure_code_profile":"","hit_set_params":{"type":"none"},"hit_set_period":0,"hit_set_count":0,"use_gmt_hitset":true,"min_read_recency_for_promote":0,"min_write_recency_for_promote":0,"hit_set_grade_decay_rate":0,"hit_set_search_last_n":0,"grade_table":[],"stripe_width":0,"expected_num_objects":0,"fast_read":false,"options":{"pg_num_max":32,"pg_num_min":1},"application_metadata":{"mgr":{}}},{"pool":2,"pool_name":"rbd","create_time":"2023-08-01T19:53:57.404091+0000","flags":1,"flags_names":"hashpspool","type":1,"size":2,"min_size":1,"crush_rule":0,"peering_crush_bucket_count":0,"peering_crush_bucket_target":0,"peering_crush_bucket_barrier":0,"peering_crush_bucket_mandatory_member":2147483647,"object_hash":2,"pg_autoscale_mode":"off","pg_num":8,"pg_placement_num":8,"pg_placement_num_target":8,"pg_num_target":8,"pg_num_pending":8,"last_pg_merge_meta":{"source_pgid":"0.0","ready_epoch":0,"last_epoch_started":0,"last_epoch_clean":0,"source_version":"0'0","target_version":"0'0"},"last_change":"14","last_force_op_resend":"0","last_force_op_resend_prenautilus":"0","last_force_op_resend_preluminous":"0","auid":0,"snap_mode":"selfmanaged","snap_seq":0,"snap_epoch":0,"pool_snaps":[],"removed_snaps":"[]","quota_max_bytes":0,"quota_max_objects":0,"tiers":[],"tier_of":-1,"read_tier":-1,"write_tier":-1,"cache_mode":"none","target_max_bytes":0,"target_max_objects":0,"cache_target_dirty_ratio_micro":400000,"cache_target_dirty_high_ratio_micro":600000,"cache_target_full_ratio_micro":800000,"cache_min_flush_age":0,"cache_min_evict_age":0,"erasure_code_profile":"","hit_set_params":{"type":"none"},"hit_set_period":0,"hit_set_count":0,"use_gmt_hitset":true,"min_read_recency_for_promote":0,"min_write_recency_for_promote":0,"hit_set_grade_decay_rate":0,"hit_set_search_last_n":0,"grade_table":[],"stripe_width":0,"expected_num_objects":0,"fast_read":false,"options":{},"application_metadata":{"rbd":{}}},{"pool":3,"pool_name":"cephfs_metadata","create_time":"2023-08-01T19:54:02.111247+0000","flags":1,"flags_names":"hashpspool","type":1,"size":2,"min_size":1,"crush_rule":0,"peering_crush_bucket_count":0,"peering_crush_bucket_target":0,"peering_crush_bucket_barrier":0,"peering_crush_bucket_mandatory_member":2147483647,"object_hash":2,"pg_autoscale_mode":"off","pg_num":32,"pg_placement_num":32,"pg_placement_num_target":32,"pg_num_target":32,"pg_num_pending":32,"last_pg_merge_meta":{"source_pgid":"0.0","ready_epoch":0,"last_epoch_started":0,"last_epoch_clean":0,"source_version":"0'0","target_version":"0'0"},"last_change":"17","last_force_op_resend":"0","last_force_op_resend_prenautilus":"0","last_force_op_resend_preluminous":"0","auid":0,"snap_mode":"selfmanaged","snap_seq":0,"snap_epoch":0,"pool_snaps":[],"removed_snaps":"[]","quota_max_bytes":0,"quota_max_objects":0,"tiers":[],"tier_of":-1,"read_tier":-1,"write_tier":-1,"cache_mode":"none","target_max_bytes":0,"target_max_objects":0,"cache_target_dirty_ratio_micro":400000,"cache_target_dirty_high_ratio_micro":600000,"cache_target_full_ratio_micro":800000,"cache_min_flush_age":0,"cache_min_evict_age":0,"erasure_code_profile":"","hit_set_params":{"type":"none"},"hit_set_period":0,"hit_set_count":0,"use_gmt_hitset":true,"min_read_recency_for_promote":0,"min_write_recency_for_promote":0,"hit_set_grade_decay_rate":0,"hit_set_search_last_n":0,"grade_table":[],"stripe_width":0,"expected_num_objects":0,"fast_read":false,"options":{"pg_autoscale_bias":4,"pg_num_min":16,"recovery_priority":5},"application_metadata":{"cephfs":{"metadata":"cephfs"}}},{"pool":4,"pool_name":"cephfs_data","create_time":"2023-08-01T19:54:03.430277+0000","flags":1,"flags_names":"hashpspool","type":1,"size":2,"min_size":1,"crush_rule":0,"peering_crush_bucket_count":0,"peering_crush_bucket_target":0,"peering_crush_bucket_barrier":0,"peering_crush_bucket_mandatory_member":2147483647,"object_hash":2,"pg_autoscale_mode":"off","pg_num":64,"pg_placement_num":64,"pg_placement_num_target":64,"pg_num_target":64,"pg_num_pending":64,"last_pg_merge_meta":{"source_pgid":"0.0","ready_epoch":0,"last_epoch_started":0,"last_epoch_clean":0,"source_version":"0'0","target_version":"0'0"},"last_change":"18","last_force_op_resend":"0","last_force_op_resend_prenautilus":"0","last_force_op_resend_preluminous":"0","auid":0,"snap_mode":"selfmanaged","snap_seq":0,"snap_epoch":0,"pool_snaps":[],"removed_snaps":"[]","quota_max_bytes":0,"quota_max_objects":0,"tiers":[],"tier_of":-1,"read_tier":-1,"write_tier":-1,"cache_mode":"none","target_max_bytes":0,"target_max_objects":0,"cache_target_dirty_ratio_micro":400000,"cache_target_dirty_high_ratio_micro":600000,"cache_target_full_ratio_micro":800000,"cache_min_flush_age":0,"cache_min_evict_age":0,"erasure_code_profile":"","hit_set_params":{"type":"none"},"hit_set_period":0,"hit_set_count":0,"use_gmt_hitset":true,"min_read_recency_for_promote":0,"min_write_recency_for_promote":0,"hit_set_grade_decay_rate":0,"hit_set_search_last_n":0,"grade_table":[],"stripe_width":0,"expected_num_objects":0,"fast_read":false,"options":{"pg_num_min":64,"target_size_ratio":0.89999997615814209},"application_metadata":{"cephfs":{"data":"cephfs"}}}],"osds":[{"osd":0,"uuid":"5dd675c7-2777-48f2-8009-ff0e0d4c7086","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":8,"up_thru":16,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.8:6800","nonce":111181},{"type":"v1","addr":"172.21.15.8:6801","nonce":111181}]},"cluster_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.8:6802","nonce":111181},{"type":"v1","addr":"172.21.15.8:6803","nonce":111181}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.8:6806","nonce":111181},{"type":"v1","addr":"172.21.15.8:6807","nonce":111181}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.8:6804","nonce":111181},{"type":"v1","addr":"172.21.15.8:6805","nonce":111181}]},"public_addr":"172.21.15.8:6801/111181","cluster_addr":"172.21.15.8:6803/111181","heartbeat_back_addr":"172.21.15.8:6807/111181","heartbeat_front_addr":"172.21.15.8:6805/111181","state":["exists","up"]},{"osd":1,"uuid":"7fc612c4-33ba-4a33-bca8-1f42ee8ed548","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":8,"up_thru":16,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.101:6800","nonce":111143},{"type":"v1","addr":"172.21.15.101:6801","nonce":111143}]},"cluster_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.101:6802","nonce":111143},{"type":"v1","addr":"172.21.15.101:6803","nonce":111143}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.101:6806","nonce":111143},{"type":"v1","addr":"172.21.15.101:6807","nonce":111143}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.101:6804","nonce":111143},{"type":"v1","addr":"172.21.15.101:6805","nonce":111143}]},"public_addr":"172.21.15.101:6801/111143","cluster_addr":"172.21.15.101:6803/111143","heartbeat_back_addr":"172.21.15.101:6807/111143","heartbeat_front_addr":"172.21.15.101:6805/111143","state":["exists","up"]},{"osd":2,"uuid":"f85cadbc-4230-4772-8f39-62ed52e220b1","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":9,"up_thru":16,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.155:6800","nonce":111339},{"type":"v1","addr":"172.21.15.155:6801","nonce":111339}]},"cluster_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.155:6802","nonce":111339},{"type":"v1","addr":"172.21.15.155:6803","nonce":111339}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.155:6806","nonce":111339},{"type":"v1","addr":"172.21.15.155:6807","nonce":111339}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.155:6804","nonce":111339},{"type":"v1","addr":"172.21.15.155:6805","nonce":111339}]},"public_addr":"172.21.15.155:6801/111339","cluster_addr":"172.21.15.155:6803/111339","heartbeat_back_addr":"172.21.15.155:6807/111339","heartbeat_front_addr":"172.21.15.155:6805/111339","state":["exists","up"]}],"osd_xinfo":[{"osd":0,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4540138320759226367,"old_weight":0,"last_purged_snaps_scrub":"2023-08-01T19:53:48.018154+0000","dead_epoch":0},{"osd":1,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4540138320759226367,"old_weight":0,"last_purged_snaps_scrub":"2023-08-01T19:53:48.000488+0000","dead_epoch":0},{"osd":2,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4540138320759226367,"old_weight":0,"last_purged_snaps_scrub":"2023-08-01T19:53:48.072529+0000","dead_epoch":0}],"pg_upmap":[],"pg_upmap_items":[],"pg_temp":[],"primary_temp":[],"blocklist":{},"range_blocklist":{},"erasure_code_profiles":{"default":{"crush-failure-domain":"osd","k":"2","m":"1","plugin":"jerasure","technique":"reed_sol_van"}},"removed_snaps_queue":[],"new_removed_snaps":[],"new_purged_snaps":[],"crush_node_flags":{},"device_class_flags":{},"stretch_mode":{"stretch_mode_enabled":false,"stretch_bucket_count":0,"degraded_stretch_mode":0,"recovering_stretch_mode":0,"stretch_mode_bucket":0}} 2023-08-01T19:54:14.994 INFO:tasks.cephfs.filesystem.ceph_manager:[{'pool': 1, 'pool_name': '.mgr', 'create_time': '2023-08-01T19:53:49.961944+0000', 'flags': 1, 'flags_names': 'hashpspool', 'type': 1, 'size': 2, 'min_size': 1, 'crush_rule': 0, 'peering_crush_bucket_count': 0, 'peering_crush_bucket_target': 0, 'peering_crush_bucket_barrier': 0, 'peering_crush_bucket_mandatory_member': 2147483647, 'object_hash': 2, 'pg_autoscale_mode': 'off', 'pg_num': 1, 'pg_placement_num': 1, 'pg_placement_num_target': 1, 'pg_num_target': 1, 'pg_num_pending': 1, 'last_pg_merge_meta': {'source_pgid': '0.0', 'ready_epoch': 0, 'last_epoch_started': 0, 'last_epoch_clean': 0, 'source_version': "0'0", 'target_version': "0'0"}, 'last_change': '11', 'last_force_op_resend': '0', 'last_force_op_resend_prenautilus': '0', 'last_force_op_resend_preluminous': '0', 'auid': 0, 'snap_mode': 'selfmanaged', 'snap_seq': 0, 'snap_epoch': 0, 'pool_snaps': [], 'removed_snaps': '[]', 'quota_max_bytes': 0, 'quota_max_objects': 0, 'tiers': [], 'tier_of': -1, 'read_tier': -1, 'write_tier': -1, 'cache_mode': 'none', 'target_max_bytes': 0, 'target_max_objects': 0, 'cache_target_dirty_ratio_micro': 400000, 'cache_target_dirty_high_ratio_micro': 600000, 'cache_target_full_ratio_micro': 800000, 'cache_min_flush_age': 0, 'cache_min_evict_age': 0, 'erasure_code_profile': '', 'hit_set_params': {'type': 'none'}, 'hit_set_period': 0, 'hit_set_count': 0, 'use_gmt_hitset': True, 'min_read_recency_for_promote': 0, 'min_write_recency_for_promote': 0, 'hit_set_grade_decay_rate': 0, 'hit_set_search_last_n': 0, 'grade_table': [], 'stripe_width': 0, 'expected_num_objects': 0, 'fast_read': False, 'options': {'pg_num_max': 32, 'pg_num_min': 1}, 'application_metadata': {'mgr': {}}}, {'pool': 2, 'pool_name': 'rbd', 'create_time': '2023-08-01T19:53:57.404091+0000', 'flags': 1, 'flags_names': 'hashpspool', 'type': 1, 'size': 2, 'min_size': 1, 'crush_rule': 0, 'peering_crush_bucket_count': 0, 'peering_crush_bucket_target': 0, 'peering_crush_bucket_barrier': 0, 'peering_crush_bucket_mandatory_member': 2147483647, 'object_hash': 2, 'pg_autoscale_mode': 'off', 'pg_num': 8, 'pg_placement_num': 8, 'pg_placement_num_target': 8, 'pg_num_target': 8, 'pg_num_pending': 8, 'last_pg_merge_meta': {'source_pgid': '0.0', 'ready_epoch': 0, 'last_epoch_started': 0, 'last_epoch_clean': 0, 'source_version': "0'0", 'target_version': "0'0"}, 'last_change': '14', 'last_force_op_resend': '0', 'last_force_op_resend_prenautilus': '0', 'last_force_op_resend_preluminous': '0', 'auid': 0, 'snap_mode': 'selfmanaged', 'snap_seq': 0, 'snap_epoch': 0, 'pool_snaps': [], 'removed_snaps': '[]', 'quota_max_bytes': 0, 'quota_max_objects': 0, 'tiers': [], 'tier_of': -1, 'read_tier': -1, 'write_tier': -1, 'cache_mode': 'none', 'target_max_bytes': 0, 'target_max_objects': 0, 'cache_target_dirty_ratio_micro': 400000, 'cache_target_dirty_high_ratio_micro': 600000, 'cache_target_full_ratio_micro': 800000, 'cache_min_flush_age': 0, 'cache_min_evict_age': 0, 'erasure_code_profile': '', 'hit_set_params': {'type': 'none'}, 'hit_set_period': 0, 'hit_set_count': 0, 'use_gmt_hitset': True, 'min_read_recency_for_promote': 0, 'min_write_recency_for_promote': 0, 'hit_set_grade_decay_rate': 0, 'hit_set_search_last_n': 0, 'grade_table': [], 'stripe_width': 0, 'expected_num_objects': 0, 'fast_read': False, 'options': {}, 'application_metadata': {'rbd': {}}}, {'pool': 3, 'pool_name': 'cephfs_metadata', 'create_time': '2023-08-01T19:54:02.111247+0000', 'flags': 1, 'flags_names': 'hashpspool', 'type': 1, 'size': 2, 'min_size': 1, 'crush_rule': 0, 'peering_crush_bucket_count': 0, 'peering_crush_bucket_target': 0, 'peering_crush_bucket_barrier': 0, 'peering_crush_bucket_mandatory_member': 2147483647, 'object_hash': 2, 'pg_autoscale_mode': 'off', 'pg_num': 32, 'pg_placement_num': 32, 'pg_placement_num_target': 32, 'pg_num_target': 32, 'pg_num_pending': 32, 'last_pg_merge_meta': {'source_pgid': '0.0', 'ready_epoch': 0, 'last_epoch_started': 0, 'last_epoch_clean': 0, 'source_version': "0'0", 'target_version': "0'0"}, 'last_change': '17', 'last_force_op_resend': '0', 'last_force_op_resend_prenautilus': '0', 'last_force_op_resend_preluminous': '0', 'auid': 0, 'snap_mode': 'selfmanaged', 'snap_seq': 0, 'snap_epoch': 0, 'pool_snaps': [], 'removed_snaps': '[]', 'quota_max_bytes': 0, 'quota_max_objects': 0, 'tiers': [], 'tier_of': -1, 'read_tier': -1, 'write_tier': -1, 'cache_mode': 'none', 'target_max_bytes': 0, 'target_max_objects': 0, 'cache_target_dirty_ratio_micro': 400000, 'cache_target_dirty_high_ratio_micro': 600000, 'cache_target_full_ratio_micro': 800000, 'cache_min_flush_age': 0, 'cache_min_evict_age': 0, 'erasure_code_profile': '', 'hit_set_params': {'type': 'none'}, 'hit_set_period': 0, 'hit_set_count': 0, 'use_gmt_hitset': True, 'min_read_recency_for_promote': 0, 'min_write_recency_for_promote': 0, 'hit_set_grade_decay_rate': 0, 'hit_set_search_last_n': 0, 'grade_table': [], 'stripe_width': 0, 'expected_num_objects': 0, 'fast_read': False, 'options': {'pg_autoscale_bias': 4, 'pg_num_min': 16, 'recovery_priority': 5}, 'application_metadata': {'cephfs': {'metadata': 'cephfs'}}}, {'pool': 4, 'pool_name': 'cephfs_data', 'create_time': '2023-08-01T19:54:03.430277+0000', 'flags': 1, 'flags_names': 'hashpspool', 'type': 1, 'size': 2, 'min_size': 1, 'crush_rule': 0, 'peering_crush_bucket_count': 0, 'peering_crush_bucket_target': 0, 'peering_crush_bucket_barrier': 0, 'peering_crush_bucket_mandatory_member': 2147483647, 'object_hash': 2, 'pg_autoscale_mode': 'off', 'pg_num': 64, 'pg_placement_num': 64, 'pg_placement_num_target': 64, 'pg_num_target': 64, 'pg_num_pending': 64, 'last_pg_merge_meta': {'source_pgid': '0.0', 'ready_epoch': 0, 'last_epoch_started': 0, 'last_epoch_clean': 0, 'source_version': "0'0", 'target_version': "0'0"}, 'last_change': '18', 'last_force_op_resend': '0', 'last_force_op_resend_prenautilus': '0', 'last_force_op_resend_preluminous': '0', 'auid': 0, 'snap_mode': 'selfmanaged', 'snap_seq': 0, 'snap_epoch': 0, 'pool_snaps': [], 'removed_snaps': '[]', 'quota_max_bytes': 0, 'quota_max_objects': 0, 'tiers': [], 'tier_of': -1, 'read_tier': -1, 'write_tier': -1, 'cache_mode': 'none', 'target_max_bytes': 0, 'target_max_objects': 0, 'cache_target_dirty_ratio_micro': 400000, 'cache_target_dirty_high_ratio_micro': 600000, 'cache_target_full_ratio_micro': 800000, 'cache_min_flush_age': 0, 'cache_min_evict_age': 0, 'erasure_code_profile': '', 'hit_set_params': {'type': 'none'}, 'hit_set_period': 0, 'hit_set_count': 0, 'use_gmt_hitset': True, 'min_read_recency_for_promote': 0, 'min_write_recency_for_promote': 0, 'hit_set_grade_decay_rate': 0, 'hit_set_search_last_n': 0, 'grade_table': [], 'stripe_width': 0, 'expected_num_objects': 0, 'fast_read': False, 'options': {'pg_num_min': 64, 'target_size_ratio': 0.8999999761581421}, 'application_metadata': {'cephfs': {'data': 'cephfs'}}}] 2023-08-01T19:54:14.995 DEBUG:teuthology.orchestra.run.smithi006:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 120 ceph --cluster ceph osd pool get .mgr pg_num 2023-08-01T19:54:15.321 INFO:teuthology.orchestra.run.smithi006.stdout:pg_num: 1 2023-08-01T19:54:15.335 DEBUG:teuthology.orchestra.run.smithi006:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 120 ceph --cluster ceph osd pool get rbd pg_num 2023-08-01T19:54:15.661 INFO:teuthology.orchestra.run.smithi006.stdout:pg_num: 8 2023-08-01T19:54:15.675 DEBUG:teuthology.orchestra.run.smithi006:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 120 ceph --cluster ceph osd pool get cephfs_metadata pg_num 2023-08-01T19:54:16.000 INFO:teuthology.orchestra.run.smithi006.stdout:pg_num: 32 2023-08-01T19:54:16.013 DEBUG:teuthology.orchestra.run.smithi006:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 120 ceph --cluster ceph osd pool get cephfs_data pg_num 2023-08-01T19:54:16.339 INFO:teuthology.orchestra.run.smithi006.stdout:pg_num: 64 2023-08-01T19:54:16.353 DEBUG:teuthology.orchestra.run.smithi006:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 120 ceph --cluster ceph fs dump --format=json 2023-08-01T19:54:16.722 INFO:teuthology.orchestra.run.smithi006.stdout: 2023-08-01T19:54:16.722 INFO:teuthology.orchestra.run.smithi006.stdout:{"epoch":6,"default_fscid":1,"compat":{"compat":{},"ro_compat":{},"incompat":{"feature_1":"base v0.20","feature_2":"client writeable ranges","feature_3":"default file layouts on dirs","feature_4":"dir inode in separate object","feature_5":"mds uses versioned encoding","feature_6":"dirfrag is stored in omap","feature_8":"no anchor table","feature_9":"file layout v2","feature_10":"snaprealm v2"}},"feature_flags":{"enable_multiple":true,"ever_enabled_multiple":true},"standbys":[],"filesystems":[{"mdsmap":{"epoch":6,"flags":18,"flags_state":{"joinable":true,"allow_snaps":true,"allow_multimds_snaps":true,"allow_standby_replay":false},"ever_allowed_features":0,"explicitly_allowed_features":0,"created":"2023-08-01T19:54:04.448302+0000","modified":"2023-08-01T19:54:07.465889+0000","tableserver":0,"root":0,"session_timeout":60,"session_autoclose":300,"required_client_features":{},"max_file_size":1099511627776,"last_failure":0,"last_failure_osd_epoch":0,"compat":{"compat":{},"ro_compat":{},"incompat":{"feature_1":"base v0.20","feature_2":"client writeable ranges","feature_3":"default file layouts on dirs","feature_4":"dir inode in separate object","feature_5":"mds uses versioned encoding","feature_6":"dirfrag is stored in omap","feature_7":"mds uses inline data","feature_8":"no anchor table","feature_9":"file layout v2","feature_10":"snaprealm v2"}},"max_mds":1,"in":[0],"up":{"mds_0":4202},"failed":[],"damaged":[],"stopped":[],"info":{"gid_4202":{"gid":4202,"name":"a","rank":0,"incarnation":3,"state":"up:active","state_seq":3,"addr":"172.21.15.6:6803/2433431095","addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.6:6802","nonce":2433431095},{"type":"v1","addr":"172.21.15.6:6803","nonce":2433431095}]},"join_fscid":-1,"export_targets":[],"features":4540138320759226367,"flags":0,"compat":{"compat":{},"ro_compat":{},"incompat":{"feature_1":"base v0.20","feature_2":"client writeable ranges","feature_3":"default file layouts on dirs","feature_4":"dir inode in separate object","feature_5":"mds uses versioned encoding","feature_6":"dirfrag is stored in omap","feature_7":"mds uses inline data","feature_8":"no anchor table","feature_9":"file layout v2","feature_10":"snaprealm v2"}}}},"data_pools":[4],"metadata_pool":3,"enabled":true,"fs_name":"cephfs","balancer":"","standby_count_wanted":0},"id":1}]} 2023-08-01T19:54:16.725 INFO:teuthology.orchestra.run.smithi006.stderr:dumped fsmap epoch 6 2023-08-01T19:54:16.837 DEBUG:tasks.cephfs.filesystem:are_daemons_healthy: mds map: {'epoch': 6, 'flags': 18, 'flags_state': {'joinable': True, 'allow_snaps': True, 'allow_multimds_snaps': True, 'allow_standby_replay': False}, 'ever_allowed_features': 0, 'explicitly_allowed_features': 0, 'created': '2023-08-01T19:54:04.448302+0000', 'modified': '2023-08-01T19:54:07.465889+0000', 'tableserver': 0, 'root': 0, 'session_timeout': 60, 'session_autoclose': 300, 'required_client_features': {}, 'max_file_size': 1099511627776, 'last_failure': 0, 'last_failure_osd_epoch': 0, 'compat': {'compat': {}, 'ro_compat': {}, 'incompat': {'feature_1': 'base v0.20', 'feature_2': 'client writeable ranges', 'feature_3': 'default file layouts on dirs', 'feature_4': 'dir inode in separate object', 'feature_5': 'mds uses versioned encoding', 'feature_6': 'dirfrag is stored in omap', 'feature_7': 'mds uses inline data', 'feature_8': 'no anchor table', 'feature_9': 'file layout v2', 'feature_10': 'snaprealm v2'}}, 'max_mds': 1, 'in': [0], 'up': {'mds_0': 4202}, 'failed': [], 'damaged': [], 'stopped': [], 'info': {'gid_4202': {'gid': 4202, 'name': 'a', 'rank': 0, 'incarnation': 3, 'state': 'up:active', 'state_seq': 3, 'addr': '172.21.15.6:6803/2433431095', 'addrs': {'addrvec': [{'type': 'v2', 'addr': '172.21.15.6:6802', 'nonce': 2433431095}, {'type': 'v1', 'addr': '172.21.15.6:6803', 'nonce': 2433431095}]}, 'join_fscid': -1, 'export_targets': [], 'features': 4540138320759226367, 'flags': 0, 'compat': {'compat': {}, 'ro_compat': {}, 'incompat': {'feature_1': 'base v0.20', 'feature_2': 'client writeable ranges', 'feature_3': 'default file layouts on dirs', 'feature_4': 'dir inode in separate object', 'feature_5': 'mds uses versioned encoding', 'feature_6': 'dirfrag is stored in omap', 'feature_7': 'mds uses inline data', 'feature_8': 'no anchor table', 'feature_9': 'file layout v2', 'feature_10': 'snaprealm v2'}}}}, 'data_pools': [4], 'metadata_pool': 3, 'enabled': True, 'fs_name': 'cephfs', 'balancer': '', 'standby_count_wanted': 0} 2023-08-01T19:54:16.837 DEBUG:tasks.cephfs.filesystem:are_daemons_healthy: 1/1 2023-08-01T19:54:16.837 DEBUG:teuthology.orchestra.run.smithi006:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 120 ceph --cluster ceph tell mds.a status 2023-08-01T19:54:16.972 INFO:teuthology.orchestra.run.smithi006.stderr:2023-08-01T19:54:16.970+0000 7f13b4ff9700 0 client.4436 ms_handle_reset on v2:172.21.15.6:6802/2433431095 2023-08-01T19:54:16.994 INFO:teuthology.orchestra.run.smithi006.stderr:2023-08-01T19:54:16.992+0000 7f13b4ff9700 0 client.4435 ms_handle_reset on v2:172.21.15.6:6802/2433431095 2023-08-01T19:54:16.994 INFO:teuthology.orchestra.run.smithi006.stdout:{ 2023-08-01T19:54:16.994 INFO:teuthology.orchestra.run.smithi006.stdout: "cluster_fsid": "a0e420cc-4df1-42a5-8bd4-a98c309a9349", 2023-08-01T19:54:16.994 INFO:teuthology.orchestra.run.smithi006.stdout: "whoami": 0, 2023-08-01T19:54:16.995 INFO:teuthology.orchestra.run.smithi006.stdout: "id": 4202, 2023-08-01T19:54:16.995 INFO:teuthology.orchestra.run.smithi006.stdout: "want_state": "up:active", 2023-08-01T19:54:16.995 INFO:teuthology.orchestra.run.smithi006.stdout: "state": "up:active", 2023-08-01T19:54:16.995 INFO:teuthology.orchestra.run.smithi006.stdout: "fs_name": "cephfs", 2023-08-01T19:54:16.995 INFO:teuthology.orchestra.run.smithi006.stdout: "rank_uptime": 12.540341229999999, 2023-08-01T19:54:16.995 INFO:teuthology.orchestra.run.smithi006.stdout: "mdsmap_epoch": 6, 2023-08-01T19:54:16.995 INFO:teuthology.orchestra.run.smithi006.stdout: "osdmap_epoch": 18, 2023-08-01T19:54:16.995 INFO:teuthology.orchestra.run.smithi006.stdout: "osdmap_epoch_barrier": 18, 2023-08-01T19:54:16.996 INFO:teuthology.orchestra.run.smithi006.stdout: "uptime": 17.917918187000001 2023-08-01T19:54:16.996 INFO:teuthology.orchestra.run.smithi006.stdout:} 2023-08-01T19:54:17.006 INFO:teuthology.run_tasks:Running task thrashosds... 2023-08-01T19:54:17.015 INFO:tasks.thrashosds:config is {'chance_down': 1.0, 'powercycle': True, 'timeout': 600, 'sighup_delay': 0.1, 'optrack_toggle_delay': 2.0, 'dump_ops_enable': 'true', 'noscrub_toggle_delay': 2.0, 'random_eio': 0.0} 2023-08-01T19:54:17.016 INFO:tasks.thrashosds:overrides is {'admin_socket': {'branch': 'quincy'}, 'ceph': {'conf': {'client.0': {'admin socket': '/var/run/ceph/ceph-$name.asok'}, 'mgr': {'debug mgr': 20, 'debug ms': 1}, 'mon': {'debug mon': 20, 'debug ms': 1, 'debug paxos': 20}, 'osd': {'bluestore block size': 96636764160, 'bluestore compression algorithm': 'lz4', 'bluestore compression mode': 'aggressive', 'bluestore fsck on mount': True, 'debug bluefs': '1/20', 'debug bluestore': '1/20', 'debug ms': 1, 'debug osd': 20, 'debug rocksdb': '4/10', 'mon osd backfillfull_ratio': 0.85, 'mon osd full ratio': 0.9, 'mon osd nearfull ratio': 0.8, 'osd failsafe full ratio': 0.95, 'osd max markdown count': 1000, 'osd objectstore': 'bluestore'}}, 'flavor': 'default', 'fs': 'xfs', 'log-ignorelist': ['\\(MDS_ALL_DOWN\\)', '\\(MDS_UP_LESS_THAN_MAX\\)', '\\(MDS_TRIM\\)', '\\(MDS_SLOW_REQUEST\\)', 'MDS_SLOW_METADATA_IO', 'Behind on trimming', 'overall HEALTH_', '\\(OSDMAP_FLAGS\\)', '\\(OSD_', '\\(PG_', '\\(POOL_', '\\(CACHE_POOL_', '\\(SMALLER_PGP_NUM\\)', '\\(OBJECT_', '\\(SLOW_OPS\\)', '\\(REQUEST_SLOW\\)', '\\(TOO_FEW_PGS\\)', 'slow request'], 'sha1': '893fa35fffd26b5b50498e64ff6f7c94584d30b6'}, 'ceph-deploy': {'conf': {'client': {'log file': '/var/log/ceph/ceph-$name.$pid.log'}, 'mon': {'osd default pool size': 2}}}, 'install': {'ceph': {'flavor': 'default', 'sha1': '893fa35fffd26b5b50498e64ff6f7c94584d30b6'}}, 'selinux': {'whitelist': ['scontext=system_u:system_r:logrotate_t:s0']}, 'thrashosds': {'bdev_inject_crash': 2, 'bdev_inject_crash_probability': 0.5}, 'workunit': {'branch': 'quincy', 'sha1': 'a185a2e2933b21246ce41dd13f03fd6f8f84f03d'}} 2023-08-01T19:54:17.016 INFO:tasks.thrashosds:config is {'chance_down': 1.0, 'powercycle': True, 'timeout': 600, 'sighup_delay': 0.1, 'optrack_toggle_delay': 2.0, 'dump_ops_enable': 'true', 'noscrub_toggle_delay': 2.0, 'random_eio': 0.0, 'bdev_inject_crash': 2, 'bdev_inject_crash_probability': 0.5} 2023-08-01T19:54:17.016 INFO:tasks.thrashosds:Doing preliminary sync to avoid collateral damage... 2023-08-01T19:54:17.017 DEBUG:teuthology.orchestra.run.smithi006:> sync 2023-08-01T19:54:17.163 DEBUG:teuthology.orchestra.run.smithi008:> sync 2023-08-01T19:54:17.234 DEBUG:teuthology.orchestra.run.smithi101:> sync 2023-08-01T19:54:17.385 DEBUG:teuthology.orchestra.run.smithi155:> sync 2023-08-01T19:54:17.512 DEBUG:tasks.thrashosds:checking console status of smithi006 2023-08-01T19:54:17.512 DEBUG:teuthology.orchestra.console.smithi006:Waiting for login prompt 2023-08-01T19:54:17.513 DEBUG:teuthology.orchestra.console.smithi006:pexpect command: console -M conserver.front.sepia.ceph.com -p 3109 -f smithi006 2023-08-01T19:54:17.688 DEBUG:teuthology.orchestra.console.smithi006:expect before: [Enter `^Ec?' for help] CentOS Stream 8 Kernel 4.18.0-500.el8.x86_64 on an x86_64 Activate the web console with: systemctl enable --now cockpit.socket 2023-08-01T19:54:17.688 DEBUG:teuthology.orchestra.console.smithi006:expect after: smithi006 login: 2023-08-01T19:54:17.742 DEBUG:teuthology.orchestra.console.smithi006:console disconnect output: [Enter `^Ec?' for help] CentOS Stream 8 Kernel 4.18.0-500.el8.x86_64 on an x86_64 Activate the web console with: systemctl enable --now cockpit.socket smithi006 login: [disconnect] 2023-08-01T19:54:17.843 DEBUG:tasks.thrashosds:checking console status of smithi008 2023-08-01T19:54:17.843 DEBUG:teuthology.orchestra.console.smithi008:Waiting for login prompt 2023-08-01T19:54:17.844 DEBUG:teuthology.orchestra.console.smithi008:pexpect command: console -M conserver.front.sepia.ceph.com -p 3109 -f smithi008 2023-08-01T19:54:18.016 DEBUG:teuthology.orchestra.console.smithi008:expect before: [Enter `^Ec?' for help] CentOS Stream 8 Kernel 4.18.0-500.el8.x86_64 on an x86_64 Activate the web console with: systemctl enable --now cockpit.socket 2023-08-01T19:54:18.017 DEBUG:teuthology.orchestra.console.smithi008:expect after: smithi008 login: 2023-08-01T19:54:18.068 DEBUG:teuthology.orchestra.console.smithi008:console disconnect output: [Enter `^Ec?' for help] CentOS Stream 8 Kernel 4.18.0-500.el8.x86_64 on an x86_64 Activate the web console with: systemctl enable --now cockpit.socket smithi008 login: [disconnect] 2023-08-01T19:54:18.170 DEBUG:tasks.thrashosds:checking console status of smithi101 2023-08-01T19:54:18.170 DEBUG:teuthology.orchestra.console.smithi101:Waiting for login prompt 2023-08-01T19:54:18.171 DEBUG:teuthology.orchestra.console.smithi101:pexpect command: console -M conserver.front.sepia.ceph.com -p 3109 -f smithi101 2023-08-01T19:54:18.297 DEBUG:teuthology.orchestra.console.smithi101:expect before: [Enter `^Ec?' for help] CentOS Stream 8 Kernel 4.18.0-500.el8.x86_64 on an x86_64 Activate the web console with: systemctl enable --now cockpit.socket 2023-08-01T19:54:18.298 DEBUG:teuthology.orchestra.console.smithi101:expect after: smithi101 login: 2023-08-01T19:54:18.351 DEBUG:teuthology.orchestra.console.smithi101:console disconnect output: [Enter `^Ec?' for help] CentOS Stream 8 Kernel 4.18.0-500.el8.x86_64 on an x86_64 Activate the web console with: systemctl enable --now cockpit.socket smithi101 login: [disconnect] 2023-08-01T19:54:18.452 DEBUG:tasks.thrashosds:checking console status of smithi155 2023-08-01T19:54:18.453 DEBUG:teuthology.orchestra.console.smithi155:Waiting for login prompt 2023-08-01T19:54:18.453 DEBUG:teuthology.orchestra.console.smithi155:pexpect command: console -M conserver.front.sepia.ceph.com -p 3109 -f smithi155 2023-08-01T19:54:18.610 DEBUG:teuthology.orchestra.console.smithi155:expect before: [Enter `^Ec?' for help] CentOS Stream 8 Kernel 4.18.0-500.el8.x86_64 on an x86_64 Activate the web console with: systemctl enable --now cockpit.socket 2023-08-01T19:54:18.611 DEBUG:teuthology.orchestra.console.smithi155:expect after: smithi155 login: 2023-08-01T19:54:18.663 DEBUG:teuthology.orchestra.console.smithi155:console disconnect output: [Enter `^Ec?' for help] CentOS Stream 8 Kernel 4.18.0-500.el8.x86_64 on an x86_64 Activate the web console with: systemctl enable --now cockpit.socket smithi155 login: [disconnect] 2023-08-01T19:54:18.764 DEBUG:teuthology.orchestra.run.smithi006:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 120 ceph --cluster ceph config set mgr mgr_debug_aggressive_pg_num_changes true 2023-08-01T19:54:19.124 INFO:tasks.thrashosds:Beginning thrashosds... 2023-08-01T19:54:19.125 INFO:tasks.ceph.ceph_manager.ceph:waiting for clean 2023-08-01T19:54:19.125 DEBUG:teuthology.orchestra.run.smithi006:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 120 ceph --cluster ceph pg dump --format=json 2023-08-01T19:54:19.457 INFO:teuthology.orchestra.run.smithi006.stdout: 2023-08-01T19:54:19.459 INFO:teuthology.orchestra.run.smithi006.stderr:dumped all 2023-08-01T19:54:19.466 INFO:teuthology.orchestra.run.smithi006.stdout:{"pg_ready":true,"pg_map":{"version":29,"stamp":"2023-08-01T19:54:17.910453+0000","last_osdmap_epoch":0,"last_pg_scan":0,"pg_stats_sum":{"stat_sum":{"num_bytes":592674,"num_objects":24,"num_object_clones":0,"num_object_copies":48,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":24,"num_whiteouts":0,"num_read":136,"num_read_kb":118,"num_write":248,"num_write_kb":3473,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":14,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"store_stats":{"total":0,"available":0,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},"log_size":196,"ondisk_log_size":196,"up":210,"acting":210,"num_store_stats":0},"osd_stats_sum":{"up_from":0,"seq":0,"num_pgs":210,"num_osds":3,"num_per_pool_osds":3,"num_per_pool_omap_osds":3,"kb":283115520,"kb_used":31248,"kb_used_data":632,"kb_used_omap":0,"kb_used_meta":30592,"kb_avail":283084272,"statfs":{"total":289910292480,"available":289878294528,"internally_reserved":0,"allocated":647168,"data_stored":1350783,"data_compressed":20662,"data_compressed_allocated":73728,"data_compressed_original":1146880,"omap_allocated":0,"internal_metadata":31326208},"hb_peers":[],"snap_trim_queue_len":0,"num_snap_trimming":0,"num_shards_repaired":0,"op_queue_age_hist":{"histogram":[],"upper_bound":1},"perf_stat":{"commit_latency_ms":0,"apply_latency_ms":0,"commit_latency_ns":0,"apply_latency_ns":0},"alerts":[],"network_ping_times":[]},"pg_stats_delta":{"stat_sum":{"num_bytes":90,"num_objects":5,"num_object_clones":0,"num_object_copies":10,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":5,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":11,"num_write_kb":1,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":4,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"store_stats":{"total":0,"available":0,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},"log_size":0,"ondisk_log_size":0,"up":0,"acting":0,"num_store_stats":0,"stamp_delta":"12.002246"},"pg_stats":[{"pgid":"4.3f","version":"0'0","reported_seq":9,"reported_epoch":17,"state":"active+clean","last_fresh":"2023-08-01T19:54:04.477207+0000","last_change":"2023-08-01T19:54:04.473430+0000","last_active":"2023-08-01T19:54:04.477207+0000","last_peered":"2023-08-01T19:54:04.477207+0000","last_clean":"2023-08-01T19:54:04.477207+0000","last_became_active":"2023-08-01T19:54:04.472887+0000","last_became_peered":"2023-08-01T19:54:04.472887+0000","last_unstale":"2023-08-01T19:54:04.477207+0000","last_undegraded":"2023-08-01T19:54:04.477207+0000","last_fullsized":"2023-08-01T19:54:04.477207+0000","mapping_epoch":16,"log_start":"0'0","ondisk_log_start":"0'0","created":16,"last_epoch_clean":17,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-08-01T19:54:04.040663+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-08-01T19:54:04.040663+0000","last_clean_scrub_stamp":"2023-08-01T19:54:04.040663+0000","objects_scrubbed":0,"log_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-08-03T06:38:54.196605+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[2,0],"acting":[2,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":2,"acting_primary":2,"purged_snaps":[]},{"pgid":"4.3e","version":"0'0","reported_seq":9,"reported_epoch":17,"state":"active+clean","last_fresh":"2023-08-01T19:54:04.472547+0000","last_change":"2023-08-01T19:54:04.470501+0000","last_active":"2023-08-01T19:54:04.472547+0000","last_peered":"2023-08-01T19:54:04.472547+0000","last_clean":"2023-08-01T19:54:04.472547+0000","last_became_active":"2023-08-01T19:54:04.469692+0000","last_became_peered":"2023-08-01T19:54:04.469692+0000","last_unstale":"2023-08-01T19:54:04.472547+0000","last_undegraded":"2023-08-01T19:54:04.472547+0000","last_fullsized":"2023-08-01T19:54:04.472547+0000","mapping_epoch":16,"log_start":"0'0","ondisk_log_start":"0'0","created":16,"last_epoch_clean":17,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-08-01T19:54:04.040663+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-08-01T19:54:04.040663+0000","last_clean_scrub_stamp":"2023-08-01T19:54:04.040663+0000","objects_scrubbed":0,"log_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-08-03T02:19:35.201107+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[2,0],"acting":[2,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":2,"acting_primary":2,"purged_snaps":[]},{"pgid":"4.3d","version":"0'0","reported_seq":9,"reported_epoch":17,"state":"active+clean","last_fresh":"2023-08-01T19:54:04.477342+0000","last_change":"2023-08-01T19:54:04.472579+0000","last_active":"2023-08-01T19:54:04.477342+0000","last_peered":"2023-08-01T19:54:04.477342+0000","last_clean":"2023-08-01T19:54:04.477342+0000","last_became_active":"2023-08-01T19:54:04.471128+0000","last_became_peered":"2023-08-01T19:54:04.471128+0000","last_unstale":"2023-08-01T19:54:04.477342+0000","last_undegraded":"2023-08-01T19:54:04.477342+0000","last_fullsized":"2023-08-01T19:54:04.477342+0000","mapping_epoch":16,"log_start":"0'0","ondisk_log_start":"0'0","created":16,"last_epoch_clean":17,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-08-01T19:54:04.040663+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-08-01T19:54:04.040663+0000","last_clean_scrub_stamp":"2023-08-01T19:54:04.040663+0000","objects_scrubbed":0,"log_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-08-03T03:04:06.137335+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[1,2],"acting":[1,2],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":1,"acting_primary":1,"purged_snaps":[]},{"pgid":"4.3c","version":"0'0","reported_seq":9,"reported_epoch":17,"state":"active+clean","last_fresh":"2023-08-01T19:54:04.479161+0000","last_change":"2023-08-01T19:54:04.477908+0000","last_active":"2023-08-01T19:54:04.479161+0000","last_peered":"2023-08-01T19:54:04.479161+0000","last_clean":"2023-08-01T19:54:04.479161+0000","last_became_active":"2023-08-01T19:54:04.476684+0000","last_became_peered":"2023-08-01T19:54:04.476684+0000","last_unstale":"2023-08-01T19:54:04.479161+0000","last_undegraded":"2023-08-01T19:54:04.479161+0000","last_fullsized":"2023-08-01T19:54:04.479161+0000","mapping_epoch":16,"log_start":"0'0","ondisk_log_start":"0'0","created":16,"last_epoch_clean":17,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-08-01T19:54:04.040663+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-08-01T19:54:04.040663+0000","last_clean_scrub_stamp":"2023-08-01T19:54:04.040663+0000","objects_scrubbed":0,"log_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-08-03T03:56:55.336461+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[1,0],"acting":[1,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":1,"acting_primary":1,"purged_snaps":[]},{"pgid":"4.3b","version":"0'0","reported_seq":9,"reported_epoch":17,"state":"active+clean","last_fresh":"2023-08-01T19:54:04.469848+0000","last_change":"2023-08-01T19:54:04.467197+0000","last_active":"2023-08-01T19:54:04.469848+0000","last_peered":"2023-08-01T19:54:04.469848+0000","last_clean":"2023-08-01T19:54:04.469848+0000","last_became_active":"2023-08-01T19:54:04.466526+0000","last_became_peered":"2023-08-01T19:54:04.466526+0000","last_unstale":"2023-08-01T19:54:04.469848+0000","last_undegraded":"2023-08-01T19:54:04.469848+0000","last_fullsized":"2023-08-01T19:54:04.469848+0000","mapping_epoch":16,"log_start":"0'0","ondisk_log_start":"0'0","created":16,"last_epoch_clean":17,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-08-01T19:54:04.040663+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-08-01T19:54:04.040663+0000","last_clean_scrub_stamp":"2023-08-01T19:54:04.040663+0000","objects_scrubbed":0,"log_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-08-03T06:54:18.982174+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[2,0],"acting":[2,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":2,"acting_primary":2,"purged_snaps":[]},{"pgid":"4.3a","version":"0'0","reported_seq":9,"reported_epoch":17,"state":"active+clean","last_fresh":"2023-08-01T19:54:04.477568+0000","last_change":"2023-08-01T19:54:04.473296+0000","last_active":"2023-08-01T19:54:04.477568+0000","last_peered":"2023-08-01T19:54:04.477568+0000","last_clean":"2023-08-01T19:54:04.477568+0000","last_became_active":"2023-08-01T19:54:04.472324+0000","last_became_peered":"2023-08-01T19:54:04.472324+0000","last_unstale":"2023-08-01T19:54:04.477568+0000","last_undegraded":"2023-08-01T19:54:04.477568+0000","last_fullsized":"2023-08-01T19:54:04.477568+0000","mapping_epoch":16,"log_start":"0'0","ondisk_log_start":"0'0","created":16,"last_epoch_clean":17,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-08-01T19:54:04.040663+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-08-01T19:54:04.040663+0000","last_clean_scrub_stamp":"2023-08-01T19:54:04.040663+0000","objects_scrubbed":0,"log_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-08-02T23:15:11.148662+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[1,0],"acting":[1,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":1,"acting_primary":1,"purged_snaps":[]},{"pgid":"4.39","version":"0'0","reported_seq":9,"reported_epoch":17,"state":"active+clean","last_fresh":"2023-08-01T19:54:04.478215+0000","last_change":"2023-08-01T19:54:04.475322+0000","last_active":"2023-08-01T19:54:04.478215+0000","last_peered":"2023-08-01T19:54:04.478215+0000","last_clean":"2023-08-01T19:54:04.478215+0000","last_became_active":"2023-08-01T19:54:04.474591+0000","last_became_peered":"2023-08-01T19:54:04.474591+0000","last_unstale":"2023-08-01T19:54:04.478215+0000","last_undegraded":"2023-08-01T19:54:04.478215+0000","last_fullsized":"2023-08-01T19:54:04.478215+0000","mapping_epoch":16,"log_start":"0'0","ondisk_log_start":"0'0","created":16,"last_epoch_clean":17,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-08-01T19:54:04.040663+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-08-01T19:54:04.040663+0000","last_clean_scrub_stamp":"2023-08-01T19:54:04.040663+0000","objects_scrubbed":0,"log_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-08-03T00:29:53.554989+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[1,0],"acting":[1,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":1,"acting_primary":1,"purged_snaps":[]},{"pgid":"4.38","version":"0'0","reported_seq":9,"reported_epoch":17,"state":"active+clean","last_fresh":"2023-08-01T19:54:04.479227+0000","last_change":"2023-08-01T19:54:04.478505+0000","last_active":"2023-08-01T19:54:04.479227+0000","last_peered":"2023-08-01T19:54:04.479227+0000","last_clean":"2023-08-01T19:54:04.479227+0000","last_became_active":"2023-08-01T19:54:04.477325+0000","last_became_peered":"2023-08-01T19:54:04.477325+0000","last_unstale":"2023-08-01T19:54:04.479227+0000","last_undegraded":"2023-08-01T19:54:04.479227+0000","last_fullsized":"2023-08-01T19:54:04.479227+0000","mapping_epoch":16,"log_start":"0'0","ondisk_log_start":"0'0","created":16,"last_epoch_clean":17,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-08-01T19:54:04.040663+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-08-01T19:54:04.040663+0000","last_clean_scrub_stamp":"2023-08-01T19:54:04.040663+0000","objects_scrubbed":0,"log_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-08-03T01:38:12.939736+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[1,0],"acting":[1,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":1,"acting_primary":1,"purged_snaps":[]},{"pgid":"4.37","version":"0'0","reported_seq":9,"reported_epoch":17,"state":"active+clean","last_fresh":"2023-08-01T19:54:04.472944+0000","last_change":"2023-08-01T19:54:04.470971+0000","last_active":"2023-08-01T19:54:04.472944+0000","last_peered":"2023-08-01T19:54:04.472944+0000","last_clean":"2023-08-01T19:54:04.472944+0000","last_became_active":"2023-08-01T19:54:04.469011+0000","last_became_peered":"2023-08-01T19:54:04.469011+0000","last_unstale":"2023-08-01T19:54:04.472944+0000","last_undegraded":"2023-08-01T19:54:04.472944+0000","last_fullsized":"2023-08-01T19:54:04.472944+0000","mapping_epoch":16,"log_start":"0'0","ondisk_log_start":"0'0","created":16,"last_epoch_clean":17,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-08-01T19:54:04.040663+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-08-01T19:54:04.040663+0000","last_clean_scrub_stamp":"2023-08-01T19:54:04.040663+0000","objects_scrubbed":0,"log_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-08-03T06:50:03.420334+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[0,2],"acting":[0,2],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":0,"acting_primary":0,"purged_snaps":[]},{"pgid":"4.36","version":"0'0","reported_seq":9,"reported_epoch":17,"state":"active+clean","last_fresh":"2023-08-01T19:54:04.477220+0000","last_change":"2023-08-01T19:54:04.473523+0000","last_active":"2023-08-01T19:54:04.477220+0000","last_peered":"2023-08-01T19:54:04.477220+0000","last_clean":"2023-08-01T19:54:04.477220+0000","last_became_active":"2023-08-01T19:54:04.473084+0000","last_became_peered":"2023-08-01T19:54:04.473084+0000","last_unstale":"2023-08-01T19:54:04.477220+0000","last_undegraded":"2023-08-01T19:54:04.477220+0000","last_fullsized":"2023-08-01T19:54:04.477220+0000","mapping_epoch":16,"log_start":"0'0","ondisk_log_start":"0'0","created":16,"last_epoch_clean":17,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-08-01T19:54:04.040663+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-08-01T19:54:04.040663+0000","last_clean_scrub_stamp":"2023-08-01T19:54:04.040663+0000","objects_scrubbed":0,"log_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-08-03T04:28:59.042443+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[2,0],"acting":[2,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":2,"acting_primary":2,"purged_snaps":[]},{"pgid":"4.35","version":"0'0","reported_seq":9,"reported_epoch":17,"state":"active+clean","last_fresh":"2023-08-01T19:54:04.478818+0000","last_change":"2023-08-01T19:54:04.475816+0000","last_active":"2023-08-01T19:54:04.478818+0000","last_peered":"2023-08-01T19:54:04.478818+0000","last_clean":"2023-08-01T19:54:04.478818+0000","last_became_active":"2023-08-01T19:54:04.475061+0000","last_became_peered":"2023-08-01T19:54:04.475061+0000","last_unstale":"2023-08-01T19:54:04.478818+0000","last_undegraded":"2023-08-01T19:54:04.478818+0000","last_fullsized":"2023-08-01T19:54:04.478818+0000","mapping_epoch":16,"log_start":"0'0","ondisk_log_start":"0'0","created":16,"last_epoch_clean":17,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-08-01T19:54:04.040663+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-08-01T19:54:04.040663+0000","last_clean_scrub_stamp":"2023-08-01T19:54:04.040663+0000","objects_scrubbed":0,"log_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-08-02T22:07:41.305488+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[1,0],"acting":[1,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":1,"acting_primary":1,"purged_snaps":[]},{"pgid":"4.34","version":"0'0","reported_seq":9,"reported_epoch":17,"state":"active+clean","last_fresh":"2023-08-01T19:54:04.470323+0000","last_change":"2023-08-01T19:54:04.468009+0000","last_active":"2023-08-01T19:54:04.470323+0000","last_peered":"2023-08-01T19:54:04.470323+0000","last_clean":"2023-08-01T19:54:04.470323+0000","last_became_active":"2023-08-01T19:54:04.467568+0000","last_became_peered":"2023-08-01T19:54:04.467568+0000","last_unstale":"2023-08-01T19:54:04.470323+0000","last_undegraded":"2023-08-01T19:54:04.470323+0000","last_fullsized":"2023-08-01T19:54:04.470323+0000","mapping_epoch":16,"log_start":"0'0","ondisk_log_start":"0'0","created":16,"last_epoch_clean":17,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-08-01T19:54:04.040663+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-08-01T19:54:04.040663+0000","last_clean_scrub_stamp":"2023-08-01T19:54:04.040663+0000","objects_scrubbed":0,"log_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-08-03T04:53:44.017572+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[2,1],"acting":[2,1],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":2,"acting_primary":2,"purged_snaps":[]},{"pgid":"4.33","version":"0'0","reported_seq":9,"reported_epoch":17,"state":"active+clean","last_fresh":"2023-08-01T19:54:04.468611+0000","last_change":"2023-08-01T19:54:04.466770+0000","last_active":"2023-08-01T19:54:04.468611+0000","last_peered":"2023-08-01T19:54:04.468611+0000","last_clean":"2023-08-01T19:54:04.468611+0000","last_became_active":"2023-08-01T19:54:04.466460+0000","last_became_peered":"2023-08-01T19:54:04.466460+0000","last_unstale":"2023-08-01T19:54:04.468611+0000","last_undegraded":"2023-08-01T19:54:04.468611+0000","last_fullsized":"2023-08-01T19:54:04.468611+0000","mapping_epoch":16,"log_start":"0'0","ondisk_log_start":"0'0","created":16,"last_epoch_clean":17,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-08-01T19:54:04.040663+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-08-01T19:54:04.040663+0000","last_clean_scrub_stamp":"2023-08-01T19:54:04.040663+0000","objects_scrubbed":0,"log_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-08-03T06:04:11.595951+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[2,0],"acting":[2,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":2,"acting_primary":2,"purged_snaps":[]},{"pgid":"4.32","version":"0'0","reported_seq":9,"reported_epoch":17,"state":"active+clean","last_fresh":"2023-08-01T19:54:04.469801+0000","last_change":"2023-08-01T19:54:04.466634+0000","last_active":"2023-08-01T19:54:04.469801+0000","last_peered":"2023-08-01T19:54:04.469801+0000","last_clean":"2023-08-01T19:54:04.469801+0000","last_became_active":"2023-08-01T19:54:04.466302+0000","last_became_peered":"2023-08-01T19:54:04.466302+0000","last_unstale":"2023-08-01T19:54:04.469801+0000","last_undegraded":"2023-08-01T19:54:04.469801+0000","last_fullsized":"2023-08-01T19:54:04.469801+0000","mapping_epoch":16,"log_start":"0'0","ondisk_log_start":"0'0","created":16,"last_epoch_clean":17,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-08-01T19:54:04.040663+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-08-01T19:54:04.040663+0000","last_clean_scrub_stamp":"2023-08-01T19:54:04.040663+0000","objects_scrubbed":0,"log_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-08-03T05:46:11.085577+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[1,2],"acting":[1,2],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":1,"acting_primary":1,"purged_snaps":[]},{"pgid":"4.31","version":"0'0","reported_seq":9,"reported_epoch":17,"state":"active+clean","last_fresh":"2023-08-01T19:54:04.476575+0000","last_change":"2023-08-01T19:54:04.472407+0000","last_active":"2023-08-01T19:54:04.476575+0000","last_peered":"2023-08-01T19:54:04.476575+0000","last_clean":"2023-08-01T19:54:04.476575+0000","last_became_active":"2023-08-01T19:54:04.472008+0000","last_became_peered":"2023-08-01T19:54:04.472008+0000","last_unstale":"2023-08-01T19:54:04.476575+0000","last_undegraded":"2023-08-01T19:54:04.476575+0000","last_fullsized":"2023-08-01T19:54:04.476575+0000","mapping_epoch":16,"log_start":"0'0","ondisk_log_start":"0'0","created":16,"last_epoch_clean":17,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-08-01T19:54:04.040663+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-08-01T19:54:04.040663+0000","last_clean_scrub_stamp":"2023-08-01T19:54:04.040663+0000","objects_scrubbed":0,"log_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-08-02T22:42:25.293502+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[1,2],"acting":[1,2],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":1,"acting_primary":1,"purged_snaps":[]},{"pgid":"4.30","version":"0'0","reported_seq":9,"reported_epoch":17,"state":"active+clean","last_fresh":"2023-08-01T19:54:04.479184+0000","last_change":"2023-08-01T19:54:04.478283+0000","last_active":"2023-08-01T19:54:04.479184+0000","last_peered":"2023-08-01T19:54:04.479184+0000","last_clean":"2023-08-01T19:54:04.479184+0000","last_became_active":"2023-08-01T19:54:04.476620+0000","last_became_peered":"2023-08-01T19:54:04.476620+0000","last_unstale":"2023-08-01T19:54:04.479184+0000","last_undegraded":"2023-08-01T19:54:04.479184+0000","last_fullsized":"2023-08-01T19:54:04.479184+0000","mapping_epoch":16,"log_start":"0'0","ondisk_log_start":"0'0","created":16,"last_epoch_clean":17,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-08-01T19:54:04.040663+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-08-01T19:54:04.040663+0000","last_clean_scrub_stamp":"2023-08-01T19:54:04.040663+0000","objects_scrubbed":0,"log_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-08-03T02:27:17.063518+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[1,0],"acting":[1,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":1,"acting_primary":1,"purged_snaps":[]},{"pgid":"4.2f","version":"0'0","reported_seq":9,"reported_epoch":17,"state":"active+clean","last_fresh":"2023-08-01T19:54:04.472916+0000","last_change":"2023-08-01T19:54:04.470302+0000","last_active":"2023-08-01T19:54:04.472916+0000","last_peered":"2023-08-01T19:54:04.472916+0000","last_clean":"2023-08-01T19:54:04.472916+0000","last_became_active":"2023-08-01T19:54:04.468919+0000","last_became_peered":"2023-08-01T19:54:04.468919+0000","last_unstale":"2023-08-01T19:54:04.472916+0000","last_undegraded":"2023-08-01T19:54:04.472916+0000","last_fullsized":"2023-08-01T19:54:04.472916+0000","mapping_epoch":16,"log_start":"0'0","ondisk_log_start":"0'0","created":16,"last_epoch_clean":17,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-08-01T19:54:04.040663+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-08-01T19:54:04.040663+0000","last_clean_scrub_stamp":"2023-08-01T19:54:04.040663+0000","objects_scrubbed":0,"log_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-08-02T22:42:25.293502+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[0,2],"acting":[0,2],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":0,"acting_primary":0,"purged_snaps":[]},{"pgid":"4.2e","version":"0'0","reported_seq":9,"reported_epoch":17,"state":"active+clean","last_fresh":"2023-08-01T19:54:04.477303+0000","last_change":"2023-08-01T19:54:04.474058+0000","last_active":"2023-08-01T19:54:04.477303+0000","last_peered":"2023-08-01T19:54:04.477303+0000","last_clean":"2023-08-01T19:54:04.477303+0000","last_became_active":"2023-08-01T19:54:04.473355+0000","last_became_peered":"2023-08-01T19:54:04.473355+0000","last_unstale":"2023-08-01T19:54:04.477303+0000","last_undegraded":"2023-08-01T19:54:04.477303+0000","last_fullsized":"2023-08-01T19:54:04.477303+0000","mapping_epoch":16,"log_start":"0'0","ondisk_log_start":"0'0","created":16,"last_epoch_clean":17,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-08-01T19:54:04.040663+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-08-01T19:54:04.040663+0000","last_clean_scrub_stamp":"2023-08-01T19:54:04.040663+0000","objects_scrubbed":0,"log_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-08-03T04:55:54.197252+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[2,0],"acting":[2,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":2,"acting_primary":2,"purged_snaps":[]},{"pgid":"4.2d","version":"0'0","reported_seq":9,"reported_epoch":17,"state":"active+clean","last_fresh":"2023-08-01T19:54:04.472287+0000","last_change":"2023-08-01T19:54:04.468775+0000","last_active":"2023-08-01T19:54:04.472287+0000","last_peered":"2023-08-01T19:54:04.472287+0000","last_clean":"2023-08-01T19:54:04.472287+0000","last_became_active":"2023-08-01T19:54:04.467274+0000","last_became_peered":"2023-08-01T19:54:04.467274+0000","last_unstale":"2023-08-01T19:54:04.472287+0000","last_undegraded":"2023-08-01T19:54:04.472287+0000","last_fullsized":"2023-08-01T19:54:04.472287+0000","mapping_epoch":16,"log_start":"0'0","ondisk_log_start":"0'0","created":16,"last_epoch_clean":17,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-08-01T19:54:04.040663+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-08-01T19:54:04.040663+0000","last_clean_scrub_stamp":"2023-08-01T19:54:04.040663+0000","objects_scrubbed":0,"log_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-08-02T23:00:37.537286+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[0,2],"acting":[0,2],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":0,"acting_primary":0,"purged_snaps":[]},{"pgid":"4.2c","version":"0'0","reported_seq":9,"reported_epoch":17,"state":"active+clean","last_fresh":"2023-08-01T19:54:04.479196+0000","last_change":"2023-08-01T19:54:04.478409+0000","last_active":"2023-08-01T19:54:04.479196+0000","last_peered":"2023-08-01T19:54:04.479196+0000","last_clean":"2023-08-01T19:54:04.479196+0000","last_became_active":"2023-08-01T19:54:04.477133+0000","last_became_peered":"2023-08-01T19:54:04.477133+0000","last_unstale":"2023-08-01T19:54:04.479196+0000","last_undegraded":"2023-08-01T19:54:04.479196+0000","last_fullsized":"2023-08-01T19:54:04.479196+0000","mapping_epoch":16,"log_start":"0'0","ondisk_log_start":"0'0","created":16,"last_epoch_clean":17,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-08-01T19:54:04.040663+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-08-01T19:54:04.040663+0000","last_clean_scrub_stamp":"2023-08-01T19:54:04.040663+0000","objects_scrubbed":0,"log_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-08-02T22:15:19.744281+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[1,0],"acting":[1,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":1,"acting_primary":1,"purged_snaps":[]},{"pgid":"4.2b","version":"0'0","reported_seq":9,"reported_epoch":17,"state":"active+clean","last_fresh":"2023-08-01T19:54:04.477876+0000","last_change":"2023-08-01T19:54:04.474047+0000","last_active":"2023-08-01T19:54:04.477876+0000","last_peered":"2023-08-01T19:54:04.477876+0000","last_clean":"2023-08-01T19:54:04.477876+0000","last_became_active":"2023-08-01T19:54:04.473578+0000","last_became_peered":"2023-08-01T19:54:04.473578+0000","last_unstale":"2023-08-01T19:54:04.477876+0000","last_undegraded":"2023-08-01T19:54:04.477876+0000","last_fullsized":"2023-08-01T19:54:04.477876+0000","mapping_epoch":16,"log_start":"0'0","ondisk_log_start":"0'0","created":16,"last_epoch_clean":17,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-08-01T19:54:04.040663+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-08-01T19:54:04.040663+0000","last_clean_scrub_stamp":"2023-08-01T19:54:04.040663+0000","objects_scrubbed":0,"log_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-08-03T05:39:29.199142+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[1,0],"acting":[1,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":1,"acting_primary":1,"purged_snaps":[]},{"pgid":"4.2a","version":"0'0","reported_seq":9,"reported_epoch":17,"state":"active+clean","last_fresh":"2023-08-01T19:54:04.470833+0000","last_change":"2023-08-01T19:54:04.469281+0000","last_active":"2023-08-01T19:54:04.470833+0000","last_peered":"2023-08-01T19:54:04.470833+0000","last_clean":"2023-08-01T19:54:04.470833+0000","last_became_active":"2023-08-01T19:54:04.468771+0000","last_became_peered":"2023-08-01T19:54:04.468771+0000","last_unstale":"2023-08-01T19:54:04.470833+0000","last_undegraded":"2023-08-01T19:54:04.470833+0000","last_fullsized":"2023-08-01T19:54:04.470833+0000","mapping_epoch":16,"log_start":"0'0","ondisk_log_start":"0'0","created":16,"last_epoch_clean":17,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-08-01T19:54:04.040663+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-08-01T19:54:04.040663+0000","last_clean_scrub_stamp":"2023-08-01T19:54:04.040663+0000","objects_scrubbed":0,"log_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-08-03T01:15:27.748810+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[2,1],"acting":[2,1],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":2,"acting_primary":2,"purged_snaps":[]},{"pgid":"4.29","version":"0'0","reported_seq":9,"reported_epoch":17,"state":"active+clean","last_fresh":"2023-08-01T19:54:04.471410+0000","last_change":"2023-08-01T19:54:04.466694+0000","last_active":"2023-08-01T19:54:04.471410+0000","last_peered":"2023-08-01T19:54:04.471410+0000","last_clean":"2023-08-01T19:54:04.471410+0000","last_became_active":"2023-08-01T19:54:04.466250+0000","last_became_peered":"2023-08-01T19:54:04.466250+0000","last_unstale":"2023-08-01T19:54:04.471410+0000","last_undegraded":"2023-08-01T19:54:04.471410+0000","last_fullsized":"2023-08-01T19:54:04.471410+0000","mapping_epoch":16,"log_start":"0'0","ondisk_log_start":"0'0","created":16,"last_epoch_clean":17,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-08-01T19:54:04.040663+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-08-01T19:54:04.040663+0000","last_clean_scrub_stamp":"2023-08-01T19:54:04.040663+0000","objects_scrubbed":0,"log_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-08-03T01:00:18.725898+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[0,1],"acting":[0,1],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":0,"acting_primary":0,"purged_snaps":[]},{"pgid":"4.28","version":"0'0","reported_seq":9,"reported_epoch":17,"state":"active+clean","last_fresh":"2023-08-01T19:54:04.470337+0000","last_change":"2023-08-01T19:54:04.468160+0000","last_active":"2023-08-01T19:54:04.470337+0000","last_peered":"2023-08-01T19:54:04.470337+0000","last_clean":"2023-08-01T19:54:04.470337+0000","last_became_active":"2023-08-01T19:54:04.467625+0000","last_became_peered":"2023-08-01T19:54:04.467625+0000","last_unstale":"2023-08-01T19:54:04.470337+0000","last_undegraded":"2023-08-01T19:54:04.470337+0000","last_fullsized":"2023-08-01T19:54:04.470337+0000","mapping_epoch":16,"log_start":"0'0","ondisk_log_start":"0'0","created":16,"last_epoch_clean":17,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-08-01T19:54:04.040663+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-08-01T19:54:04.040663+0000","last_clean_scrub_stamp":"2023-08-01T19:54:04.040663+0000","objects_scrubbed":0,"log_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-08-02T21:27:52.506153+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[2,0],"acting":[2,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":2,"acting_primary":2,"purged_snaps":[]},{"pgid":"4.27","version":"0'0","reported_seq":9,"reported_epoch":17,"state":"active+clean","last_fresh":"2023-08-01T19:54:04.470777+0000","last_change":"2023-08-01T19:54:04.469187+0000","last_active":"2023-08-01T19:54:04.470777+0000","last_peered":"2023-08-01T19:54:04.470777+0000","last_clean":"2023-08-01T19:54:04.470777+0000","last_became_active":"2023-08-01T19:54:04.468628+0000","last_became_peered":"2023-08-01T19:54:04.468628+0000","last_unstale":"2023-08-01T19:54:04.470777+0000","last_undegraded":"2023-08-01T19:54:04.470777+0000","last_fullsized":"2023-08-01T19:54:04.470777+0000","mapping_epoch":16,"log_start":"0'0","ondisk_log_start":"0'0","created":16,"last_epoch_clean":17,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-08-01T19:54:04.040663+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-08-01T19:54:04.040663+0000","last_clean_scrub_stamp":"2023-08-01T19:54:04.040663+0000","objects_scrubbed":0,"log_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-08-03T00:07:29.565677+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[2,1],"acting":[2,1],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":2,"acting_primary":2,"purged_snaps":[]},{"pgid":"4.26","version":"0'0","reported_seq":9,"reported_epoch":17,"state":"active+clean","last_fresh":"2023-08-01T19:54:04.472976+0000","last_change":"2023-08-01T19:54:04.470942+0000","last_active":"2023-08-01T19:54:04.472976+0000","last_peered":"2023-08-01T19:54:04.472976+0000","last_clean":"2023-08-01T19:54:04.472976+0000","last_became_active":"2023-08-01T19:54:04.470564+0000","last_became_peered":"2023-08-01T19:54:04.470564+0000","last_unstale":"2023-08-01T19:54:04.472976+0000","last_undegraded":"2023-08-01T19:54:04.472976+0000","last_fullsized":"2023-08-01T19:54:04.472976+0000","mapping_epoch":16,"log_start":"0'0","ondisk_log_start":"0'0","created":16,"last_epoch_clean":17,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-08-01T19:54:04.040663+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-08-01T19:54:04.040663+0000","last_clean_scrub_stamp":"2023-08-01T19:54:04.040663+0000","objects_scrubbed":0,"log_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-08-03T04:43:21.408174+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[0,1],"acting":[0,1],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":0,"acting_primary":0,"purged_snaps":[]},{"pgid":"4.25","version":"0'0","reported_seq":9,"reported_epoch":17,"state":"active+clean","last_fresh":"2023-08-01T19:54:04.478117+0000","last_change":"2023-08-01T19:54:04.474813+0000","last_active":"2023-08-01T19:54:04.478117+0000","last_peered":"2023-08-01T19:54:04.478117+0000","last_clean":"2023-08-01T19:54:04.478117+0000","last_became_active":"2023-08-01T19:54:04.472530+0000","last_became_peered":"2023-08-01T19:54:04.472530+0000","last_unstale":"2023-08-01T19:54:04.478117+0000","last_undegraded":"2023-08-01T19:54:04.478117+0000","last_fullsized":"2023-08-01T19:54:04.478117+0000","mapping_epoch":16,"log_start":"0'0","ondisk_log_start":"0'0","created":16,"last_epoch_clean":17,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-08-01T19:54:04.040663+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-08-01T19:54:04.040663+0000","last_clean_scrub_stamp":"2023-08-01T19:54:04.040663+0000","objects_scrubbed":0,"log_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-08-03T01:00:18.725898+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[1,2],"acting":[1,2],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":1,"acting_primary":1,"purged_snaps":[]},{"pgid":"3.1a","version":"17'1","reported_seq":11,"reported_epoch":17,"state":"active+clean","last_fresh":"2023-08-01T19:54:04.473081+0000","last_change":"2023-08-01T19:54:04.063936+0000","last_active":"2023-08-01T19:54:04.473081+0000","last_peered":"2023-08-01T19:54:04.473081+0000","last_clean":"2023-08-01T19:54:04.473081+0000","last_became_active":"2023-08-01T19:54:04.063674+0000","last_became_peered":"2023-08-01T19:54:04.063674+0000","last_unstale":"2023-08-01T19:54:04.473081+0000","last_undegraded":"2023-08-01T19:54:04.473081+0000","last_fullsized":"2023-08-01T19:54:04.473081+0000","mapping_epoch":15,"log_start":"0'0","ondisk_log_start":"0'0","created":15,"last_epoch_clean":16,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-08-01T19:54:03.032665+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-08-01T19:54:03.032665+0000","last_clean_scrub_stamp":"2023-08-01T19:54:03.032665+0000","objects_scrubbed":0,"log_size":1,"ondisk_log_size":1,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-08-03T00:06:00.058200+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[2,0],"acting":[2,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":2,"acting_primary":2,"purged_snaps":[]},{"pgid":"4.1d","version":"0'0","reported_seq":9,"reported_epoch":17,"state":"active+clean","last_fresh":"2023-08-01T19:54:04.474051+0000","last_change":"2023-08-01T19:54:04.471916+0000","last_active":"2023-08-01T19:54:04.474051+0000","last_peered":"2023-08-01T19:54:04.474051+0000","last_clean":"2023-08-01T19:54:04.474051+0000","last_became_active":"2023-08-01T19:54:04.471480+0000","last_became_peered":"2023-08-01T19:54:04.471480+0000","last_unstale":"2023-08-01T19:54:04.474051+0000","last_undegraded":"2023-08-01T19:54:04.474051+0000","last_fullsized":"2023-08-01T19:54:04.474051+0000","mapping_epoch":16,"log_start":"0'0","ondisk_log_start":"0'0","created":16,"last_epoch_clean":17,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-08-01T19:54:04.040663+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-08-01T19:54:04.040663+0000","last_clean_scrub_stamp":"2023-08-01T19:54:04.040663+0000","objects_scrubbed":0,"log_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-08-02T21:19:17.547590+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[2,1],"acting":[2,1],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":2,"acting_primary":2,"purged_snaps":[]},{"pgid":"3.19","version":"0'0","reported_seq":10,"reported_epoch":17,"state":"active+clean","last_fresh":"2023-08-01T19:54:04.458649+0000","last_change":"2023-08-01T19:54:04.067837+0000","last_active":"2023-08-01T19:54:04.458649+0000","last_peered":"2023-08-01T19:54:04.458649+0000","last_clean":"2023-08-01T19:54:04.458649+0000","last_became_active":"2023-08-01T19:54:04.067535+0000","last_became_peered":"2023-08-01T19:54:04.067535+0000","last_unstale":"2023-08-01T19:54:04.458649+0000","last_undegraded":"2023-08-01T19:54:04.458649+0000","last_fullsized":"2023-08-01T19:54:04.458649+0000","mapping_epoch":15,"log_start":"0'0","ondisk_log_start":"0'0","created":15,"last_epoch_clean":16,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-08-01T19:54:03.032665+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-08-01T19:54:03.032665+0000","last_clean_scrub_stamp":"2023-08-01T19:54:03.032665+0000","objects_scrubbed":0,"log_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-08-02T20:56:47.324761+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[0,1],"acting":[0,1],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":0,"acting_primary":0,"purged_snaps":[]},{"pgid":"4.1e","version":"0'0","reported_seq":9,"reported_epoch":17,"state":"active+clean","last_fresh":"2023-08-01T19:54:04.472940+0000","last_change":"2023-08-01T19:54:04.470544+0000","last_active":"2023-08-01T19:54:04.472940+0000","last_peered":"2023-08-01T19:54:04.472940+0000","last_clean":"2023-08-01T19:54:04.472940+0000","last_became_active":"2023-08-01T19:54:04.469657+0000","last_became_peered":"2023-08-01T19:54:04.469657+0000","last_unstale":"2023-08-01T19:54:04.472940+0000","last_undegraded":"2023-08-01T19:54:04.472940+0000","last_fullsized":"2023-08-01T19:54:04.472940+0000","mapping_epoch":16,"log_start":"0'0","ondisk_log_start":"0'0","created":16,"last_epoch_clean":17,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-08-01T19:54:04.040663+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-08-01T19:54:04.040663+0000","last_clean_scrub_stamp":"2023-08-01T19:54:04.040663+0000","objects_scrubbed":0,"log_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-08-02T23:12:30.830199+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[0,1],"acting":[0,1],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":0,"acting_primary":0,"purged_snaps":[]},{"pgid":"3.18","version":"0'0","reported_seq":10,"reported_epoch":17,"state":"active+clean","last_fresh":"2023-08-01T19:54:04.458389+0000","last_change":"2023-08-01T19:54:04.064289+0000","last_active":"2023-08-01T19:54:04.458389+0000","last_peered":"2023-08-01T19:54:04.458389+0000","last_clean":"2023-08-01T19:54:04.458389+0000","last_became_active":"2023-08-01T19:54:04.063971+0000","last_became_peered":"2023-08-01T19:54:04.063971+0000","last_unstale":"2023-08-01T19:54:04.458389+0000","last_undegraded":"2023-08-01T19:54:04.458389+0000","last_fullsized":"2023-08-01T19:54:04.458389+0000","mapping_epoch":15,"log_start":"0'0","ondisk_log_start":"0'0","created":15,"last_epoch_clean":16,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-08-01T19:54:03.032665+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-08-01T19:54:03.032665+0000","last_clean_scrub_stamp":"2023-08-01T19:54:03.032665+0000","objects_scrubbed":0,"log_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-08-03T04:09:30.496098+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[0,2],"acting":[0,2],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":0,"acting_primary":0,"purged_snaps":[]},{"pgid":"4.1f","version":"0'0","reported_seq":9,"reported_epoch":17,"state":"active+clean","last_fresh":"2023-08-01T19:54:04.474406+0000","last_change":"2023-08-01T19:54:04.472227+0000","last_active":"2023-08-01T19:54:04.474406+0000","last_peered":"2023-08-01T19:54:04.474406+0000","last_clean":"2023-08-01T19:54:04.474406+0000","last_became_active":"2023-08-01T19:54:04.471767+0000","last_became_peered":"2023-08-01T19:54:04.471767+0000","last_unstale":"2023-08-01T19:54:04.474406+0000","last_undegraded":"2023-08-01T19:54:04.474406+0000","last_fullsized":"2023-08-01T19:54:04.474406+0000","mapping_epoch":16,"log_start":"0'0","ondisk_log_start":"0'0","created":16,"last_epoch_clean":17,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-08-01T19:54:04.040663+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-08-01T19:54:04.040663+0000","last_clean_scrub_stamp":"2023-08-01T19:54:04.040663+0000","objects_scrubbed":0,"log_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-08-02T20:25:25.280329+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[2,1],"acting":[2,1],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":2,"acting_primary":2,"purged_snaps":[]},{"pgid":"3.17","version":"0'0","reported_seq":10,"reported_epoch":17,"state":"active+clean","last_fresh":"2023-08-01T19:54:04.462845+0000","last_change":"2023-08-01T19:54:04.067975+0000","last_active":"2023-08-01T19:54:04.462845+0000","last_peered":"2023-08-01T19:54:04.462845+0000","last_clean":"2023-08-01T19:54:04.462845+0000","last_became_active":"2023-08-01T19:54:04.067577+0000","last_became_peered":"2023-08-01T19:54:04.067577+0000","last_unstale":"2023-08-01T19:54:04.462845+0000","last_undegraded":"2023-08-01T19:54:04.462845+0000","last_fullsized":"2023-08-01T19:54:04.462845+0000","mapping_epoch":15,"log_start":"0'0","ondisk_log_start":"0'0","created":15,"last_epoch_clean":16,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-08-01T19:54:03.032665+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-08-01T19:54:03.032665+0000","last_clean_scrub_stamp":"2023-08-01T19:54:03.032665+0000","objects_scrubbed":0,"log_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-08-03T07:13:34.025722+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[0,1],"acting":[0,1],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":0,"acting_primary":0,"purged_snaps":[]},{"pgid":"4.10","version":"0'0","reported_seq":9,"reported_epoch":17,"state":"active+clean","last_fresh":"2023-08-01T19:54:04.472075+0000","last_change":"2023-08-01T19:54:04.467146+0000","last_active":"2023-08-01T19:54:04.472075+0000","last_peered":"2023-08-01T19:54:04.472075+0000","last_clean":"2023-08-01T19:54:04.472075+0000","last_became_active":"2023-08-01T19:54:04.466627+0000","last_became_peered":"2023-08-01T19:54:04.466627+0000","last_unstale":"2023-08-01T19:54:04.472075+0000","last_undegraded":"2023-08-01T19:54:04.472075+0000","last_fullsized":"2023-08-01T19:54:04.472075+0000","mapping_epoch":16,"log_start":"0'0","ondisk_log_start":"0'0","created":16,"last_epoch_clean":17,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-08-01T19:54:04.040663+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-08-01T19:54:04.040663+0000","last_clean_scrub_stamp":"2023-08-01T19:54:04.040663+0000","objects_scrubbed":0,"log_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-08-03T04:43:26.793480+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[0,2],"acting":[0,2],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":0,"acting_primary":0,"purged_snaps":[]},{"pgid":"3.16","version":"0'0","reported_seq":10,"reported_epoch":17,"state":"active+clean","last_fresh":"2023-08-01T19:54:04.468390+0000","last_change":"2023-08-01T19:54:04.065042+0000","last_active":"2023-08-01T19:54:04.468390+0000","last_peered":"2023-08-01T19:54:04.468390+0000","last_clean":"2023-08-01T19:54:04.468390+0000","last_became_active":"2023-08-01T19:54:04.064040+0000","last_became_peered":"2023-08-01T19:54:04.064040+0000","last_unstale":"2023-08-01T19:54:04.468390+0000","last_undegraded":"2023-08-01T19:54:04.468390+0000","last_fullsized":"2023-08-01T19:54:04.468390+0000","mapping_epoch":15,"log_start":"0'0","ondisk_log_start":"0'0","created":15,"last_epoch_clean":16,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-08-01T19:54:03.032665+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-08-01T19:54:03.032665+0000","last_clean_scrub_stamp":"2023-08-01T19:54:03.032665+0000","objects_scrubbed":0,"log_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-08-03T03:40:43.460182+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[1,0],"acting":[1,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":1,"acting_primary":1,"purged_snaps":[]},{"pgid":"4.11","version":"0'0","reported_seq":9,"reported_epoch":17,"state":"active+clean","last_fresh":"2023-08-01T19:54:04.472823+0000","last_change":"2023-08-01T19:54:04.470401+0000","last_active":"2023-08-01T19:54:04.472823+0000","last_peered":"2023-08-01T19:54:04.472823+0000","last_clean":"2023-08-01T19:54:04.472823+0000","last_became_active":"2023-08-01T19:54:04.469680+0000","last_became_peered":"2023-08-01T19:54:04.469680+0000","last_unstale":"2023-08-01T19:54:04.472823+0000","last_undegraded":"2023-08-01T19:54:04.472823+0000","last_fullsized":"2023-08-01T19:54:04.472823+0000","mapping_epoch":16,"log_start":"0'0","ondisk_log_start":"0'0","created":16,"last_epoch_clean":17,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-08-01T19:54:04.040663+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-08-01T19:54:04.040663+0000","last_clean_scrub_stamp":"2023-08-01T19:54:04.040663+0000","objects_scrubbed":0,"log_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-08-03T03:58:06.360840+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[0,1],"acting":[0,1],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":0,"acting_primary":0,"purged_snaps":[]},{"pgid":"3.15","version":"17'3","reported_seq":13,"reported_epoch":17,"state":"active+clean","last_fresh":"2023-08-01T19:54:04.471749+0000","last_change":"2023-08-01T19:54:04.065443+0000","last_active":"2023-08-01T19:54:04.471749+0000","last_peered":"2023-08-01T19:54:04.471749+0000","last_clean":"2023-08-01T19:54:04.471749+0000","last_became_active":"2023-08-01T19:54:04.065112+0000","last_became_peered":"2023-08-01T19:54:04.065112+0000","last_unstale":"2023-08-01T19:54:04.471749+0000","last_undegraded":"2023-08-01T19:54:04.471749+0000","last_fullsized":"2023-08-01T19:54:04.471749+0000","mapping_epoch":15,"log_start":"0'0","ondisk_log_start":"0'0","created":15,"last_epoch_clean":16,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-08-01T19:54:03.032665+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-08-01T19:54:03.032665+0000","last_clean_scrub_stamp":"2023-08-01T19:54:03.032665+0000","objects_scrubbed":0,"log_size":3,"ondisk_log_size":3,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-08-03T03:27:50.887004+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":90,"num_objects":2,"num_object_clones":0,"num_object_copies":4,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":2,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":4,"num_write_kb":1,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":1,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[2,1],"acting":[2,1],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":2,"acting_primary":2,"purged_snaps":[]},{"pgid":"4.12","version":"0'0","reported_seq":9,"reported_epoch":17,"state":"active+clean","last_fresh":"2023-08-01T19:54:04.471952+0000","last_change":"2023-08-01T19:54:04.467822+0000","last_active":"2023-08-01T19:54:04.471952+0000","last_peered":"2023-08-01T19:54:04.471952+0000","last_clean":"2023-08-01T19:54:04.471952+0000","last_became_active":"2023-08-01T19:54:04.466667+0000","last_became_peered":"2023-08-01T19:54:04.466667+0000","last_unstale":"2023-08-01T19:54:04.471952+0000","last_undegraded":"2023-08-01T19:54:04.471952+0000","last_fullsized":"2023-08-01T19:54:04.471952+0000","mapping_epoch":16,"log_start":"0'0","ondisk_log_start":"0'0","created":16,"last_epoch_clean":17,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-08-01T19:54:04.040663+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-08-01T19:54:04.040663+0000","last_clean_scrub_stamp":"2023-08-01T19:54:04.040663+0000","objects_scrubbed":0,"log_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-08-03T02:57:18.148077+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[0,2],"acting":[0,2],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":0,"acting_primary":0,"purged_snaps":[]},{"pgid":"3.14","version":"17'6","reported_seq":16,"reported_epoch":17,"state":"active+clean","last_fresh":"2023-08-01T19:54:04.485855+0000","last_change":"2023-08-01T19:54:04.061419+0000","last_active":"2023-08-01T19:54:04.485855+0000","last_peered":"2023-08-01T19:54:04.485855+0000","last_clean":"2023-08-01T19:54:04.485855+0000","last_became_active":"2023-08-01T19:54:04.061078+0000","last_became_peered":"2023-08-01T19:54:04.061078+0000","last_unstale":"2023-08-01T19:54:04.485855+0000","last_undegraded":"2023-08-01T19:54:04.485855+0000","last_fullsized":"2023-08-01T19:54:04.485855+0000","mapping_epoch":15,"log_start":"0'0","ondisk_log_start":"0'0","created":15,"last_epoch_clean":16,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-08-01T19:54:03.032665+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-08-01T19:54:03.032665+0000","last_clean_scrub_stamp":"2023-08-01T19:54:03.032665+0000","objects_scrubbed":0,"log_size":6,"ondisk_log_size":6,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-08-02T21:35:44.874727+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":1536,"num_objects":4,"num_object_clones":0,"num_object_copies":8,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":4,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":6,"num_write_kb":3,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":1,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[1,2],"acting":[1,2],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":1,"acting_primary":1,"purged_snaps":[]},{"pgid":"4.13","version":"0'0","reported_seq":9,"reported_epoch":17,"state":"active+clean","last_fresh":"2023-08-01T19:54:04.471426+0000","last_change":"2023-08-01T19:54:04.466400+0000","last_active":"2023-08-01T19:54:04.471426+0000","last_peered":"2023-08-01T19:54:04.471426+0000","last_clean":"2023-08-01T19:54:04.471426+0000","last_became_active":"2023-08-01T19:54:04.465979+0000","last_became_peered":"2023-08-01T19:54:04.465979+0000","last_unstale":"2023-08-01T19:54:04.471426+0000","last_undegraded":"2023-08-01T19:54:04.471426+0000","last_fullsized":"2023-08-01T19:54:04.471426+0000","mapping_epoch":16,"log_start":"0'0","ondisk_log_start":"0'0","created":16,"last_epoch_clean":17,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-08-01T19:54:04.040663+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-08-01T19:54:04.040663+0000","last_clean_scrub_stamp":"2023-08-01T19:54:04.040663+0000","objects_scrubbed":0,"log_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-08-02T20:20:59.989030+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[1,2],"acting":[1,2],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":1,"acting_primary":1,"purged_snaps":[]},{"pgid":"3.13","version":"17'2","reported_seq":12,"reported_epoch":17,"state":"active+clean","last_fresh":"2023-08-01T19:54:04.476009+0000","last_change":"2023-08-01T19:54:04.065212+0000","last_active":"2023-08-01T19:54:04.476009+0000","last_peered":"2023-08-01T19:54:04.476009+0000","last_clean":"2023-08-01T19:54:04.476009+0000","last_became_active":"2023-08-01T19:54:04.064375+0000","last_became_peered":"2023-08-01T19:54:04.064375+0000","last_unstale":"2023-08-01T19:54:04.476009+0000","last_undegraded":"2023-08-01T19:54:04.476009+0000","last_fullsized":"2023-08-01T19:54:04.476009+0000","mapping_epoch":15,"log_start":"0'0","ondisk_log_start":"0'0","created":15,"last_epoch_clean":16,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-08-01T19:54:03.032665+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-08-01T19:54:03.032665+0000","last_clean_scrub_stamp":"2023-08-01T19:54:03.032665+0000","objects_scrubbed":0,"log_size":2,"ondisk_log_size":2,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-08-03T06:17:37.910752+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":34,"num_objects":2,"num_object_clones":0,"num_object_copies":4,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":2,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":3,"num_write_kb":6,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":1,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[1,0],"acting":[1,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":1,"acting_primary":1,"purged_snaps":[]},{"pgid":"4.14","version":"0'0","reported_seq":9,"reported_epoch":17,"state":"active+clean","last_fresh":"2023-08-01T19:54:04.465917+0000","last_change":"2023-08-01T19:54:04.464446+0000","last_active":"2023-08-01T19:54:04.465917+0000","last_peered":"2023-08-01T19:54:04.465917+0000","last_clean":"2023-08-01T19:54:04.465917+0000","last_became_active":"2023-08-01T19:54:04.464021+0000","last_became_peered":"2023-08-01T19:54:04.464021+0000","last_unstale":"2023-08-01T19:54:04.465917+0000","last_undegraded":"2023-08-01T19:54:04.465917+0000","last_fullsized":"2023-08-01T19:54:04.465917+0000","mapping_epoch":16,"log_start":"0'0","ondisk_log_start":"0'0","created":16,"last_epoch_clean":17,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-08-01T19:54:04.040663+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-08-01T19:54:04.040663+0000","last_clean_scrub_stamp":"2023-08-01T19:54:04.040663+0000","objects_scrubbed":0,"log_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-08-02T20:26:51.080849+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[2,0],"acting":[2,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":2,"acting_primary":2,"purged_snaps":[]},{"pgid":"3.12","version":"0'0","reported_seq":10,"reported_epoch":17,"state":"active+clean","last_fresh":"2023-08-01T19:54:04.458866+0000","last_change":"2023-08-01T19:54:04.066566+0000","last_active":"2023-08-01T19:54:04.458866+0000","last_peered":"2023-08-01T19:54:04.458866+0000","last_clean":"2023-08-01T19:54:04.458866+0000","last_became_active":"2023-08-01T19:54:04.066190+0000","last_became_peered":"2023-08-01T19:54:04.066190+0000","last_unstale":"2023-08-01T19:54:04.458866+0000","last_undegraded":"2023-08-01T19:54:04.458866+0000","last_fullsized":"2023-08-01T19:54:04.458866+0000","mapping_epoch":15,"log_start":"0'0","ondisk_log_start":"0'0","created":15,"last_epoch_clean":16,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-08-01T19:54:03.032665+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-08-01T19:54:03.032665+0000","last_clean_scrub_stamp":"2023-08-01T19:54:03.032665+0000","objects_scrubbed":0,"log_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-08-03T02:01:47.073630+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[0,1],"acting":[0,1],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":0,"acting_primary":0,"purged_snaps":[]},{"pgid":"4.15","version":"0'0","reported_seq":9,"reported_epoch":17,"state":"active+clean","last_fresh":"2023-08-01T19:54:04.470734+0000","last_change":"2023-08-01T19:54:04.468791+0000","last_active":"2023-08-01T19:54:04.470734+0000","last_peered":"2023-08-01T19:54:04.470734+0000","last_clean":"2023-08-01T19:54:04.470734+0000","last_became_active":"2023-08-01T19:54:04.468214+0000","last_became_peered":"2023-08-01T19:54:04.468214+0000","last_unstale":"2023-08-01T19:54:04.470734+0000","last_undegraded":"2023-08-01T19:54:04.470734+0000","last_fullsized":"2023-08-01T19:54:04.470734+0000","mapping_epoch":16,"log_start":"0'0","ondisk_log_start":"0'0","created":16,"last_epoch_clean":17,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-08-01T19:54:04.040663+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-08-01T19:54:04.040663+0000","last_clean_scrub_stamp":"2023-08-01T19:54:04.040663+0000","objects_scrubbed":0,"log_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-08-03T04:10:44.729287+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[2,0],"acting":[2,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":2,"acting_primary":2,"purged_snaps":[]},{"pgid":"3.11","version":"0'0","reported_seq":10,"reported_epoch":17,"state":"active+clean","last_fresh":"2023-08-01T19:54:04.457924+0000","last_change":"2023-08-01T19:54:04.064280+0000","last_active":"2023-08-01T19:54:04.457924+0000","last_peered":"2023-08-01T19:54:04.457924+0000","last_clean":"2023-08-01T19:54:04.457924+0000","last_became_active":"2023-08-01T19:54:04.064064+0000","last_became_peered":"2023-08-01T19:54:04.064064+0000","last_unstale":"2023-08-01T19:54:04.457924+0000","last_undegraded":"2023-08-01T19:54:04.457924+0000","last_fullsized":"2023-08-01T19:54:04.457924+0000","mapping_epoch":15,"log_start":"0'0","ondisk_log_start":"0'0","created":15,"last_epoch_clean":16,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-08-01T19:54:03.032665+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-08-01T19:54:03.032665+0000","last_clean_scrub_stamp":"2023-08-01T19:54:03.032665+0000","objects_scrubbed":0,"log_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-08-03T06:13:51.475710+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[2,1],"acting":[2,1],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":2,"acting_primary":2,"purged_snaps":[]},{"pgid":"4.16","version":"0'0","reported_seq":9,"reported_epoch":17,"state":"active+clean","last_fresh":"2023-08-01T19:54:04.472609+0000","last_change":"2023-08-01T19:54:04.469724+0000","last_active":"2023-08-01T19:54:04.472609+0000","last_peered":"2023-08-01T19:54:04.472609+0000","last_clean":"2023-08-01T19:54:04.472609+0000","last_became_active":"2023-08-01T19:54:04.469275+0000","last_became_peered":"2023-08-01T19:54:04.469275+0000","last_unstale":"2023-08-01T19:54:04.472609+0000","last_undegraded":"2023-08-01T19:54:04.472609+0000","last_fullsized":"2023-08-01T19:54:04.472609+0000","mapping_epoch":16,"log_start":"0'0","ondisk_log_start":"0'0","created":16,"last_epoch_clean":17,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-08-01T19:54:04.040663+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-08-01T19:54:04.040663+0000","last_clean_scrub_stamp":"2023-08-01T19:54:04.040663+0000","objects_scrubbed":0,"log_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-08-03T03:04:06.137335+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[0,1],"acting":[0,1],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":0,"acting_primary":0,"purged_snaps":[]},{"pgid":"3.10","version":"17'8","reported_seq":18,"reported_epoch":17,"state":"active+clean","last_fresh":"2023-08-01T19:54:04.480319+0000","last_change":"2023-08-01T19:54:04.060962+0000","last_active":"2023-08-01T19:54:04.480319+0000","last_peered":"2023-08-01T19:54:04.480319+0000","last_clean":"2023-08-01T19:54:04.480319+0000","last_became_active":"2023-08-01T19:54:04.060576+0000","last_became_peered":"2023-08-01T19:54:04.060576+0000","last_unstale":"2023-08-01T19:54:04.480319+0000","last_undegraded":"2023-08-01T19:54:04.480319+0000","last_fullsized":"2023-08-01T19:54:04.480319+0000","mapping_epoch":15,"log_start":"0'0","ondisk_log_start":"0'0","created":15,"last_epoch_clean":16,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-08-01T19:54:03.032665+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-08-01T19:54:03.032665+0000","last_clean_scrub_stamp":"2023-08-01T19:54:03.032665+0000","objects_scrubbed":0,"log_size":8,"ondisk_log_size":8,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-08-03T05:00:51.171444+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":4,"num_object_clones":0,"num_object_copies":8,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":4,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":12,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":4,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[1,2],"acting":[1,2],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":1,"acting_primary":1,"purged_snaps":[]},{"pgid":"4.17","version":"0'0","reported_seq":9,"reported_epoch":17,"state":"active+clean","last_fresh":"2023-08-01T19:54:04.473595+0000","last_change":"2023-08-01T19:54:04.472721+0000","last_active":"2023-08-01T19:54:04.473595+0000","last_peered":"2023-08-01T19:54:04.473595+0000","last_clean":"2023-08-01T19:54:04.473595+0000","last_became_active":"2023-08-01T19:54:04.472126+0000","last_became_peered":"2023-08-01T19:54:04.472126+0000","last_unstale":"2023-08-01T19:54:04.473595+0000","last_undegraded":"2023-08-01T19:54:04.473595+0000","last_fullsized":"2023-08-01T19:54:04.473595+0000","mapping_epoch":16,"log_start":"0'0","ondisk_log_start":"0'0","created":16,"last_epoch_clean":17,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-08-01T19:54:04.040663+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-08-01T19:54:04.040663+0000","last_clean_scrub_stamp":"2023-08-01T19:54:04.040663+0000","objects_scrubbed":0,"log_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-08-03T00:29:05.857138+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[0,1],"acting":[0,1],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":0,"acting_primary":0,"purged_snaps":[]},{"pgid":"3.f","version":"17'1","reported_seq":11,"reported_epoch":17,"state":"active+clean","last_fresh":"2023-08-01T19:54:04.476116+0000","last_change":"2023-08-01T19:54:04.060797+0000","last_active":"2023-08-01T19:54:04.476116+0000","last_peered":"2023-08-01T19:54:04.476116+0000","last_clean":"2023-08-01T19:54:04.476116+0000","last_became_active":"2023-08-01T19:54:04.060444+0000","last_became_peered":"2023-08-01T19:54:04.060444+0000","last_unstale":"2023-08-01T19:54:04.476116+0000","last_undegraded":"2023-08-01T19:54:04.476116+0000","last_fullsized":"2023-08-01T19:54:04.476116+0000","mapping_epoch":15,"log_start":"0'0","ondisk_log_start":"0'0","created":15,"last_epoch_clean":16,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-08-01T19:54:03.032665+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-08-01T19:54:03.032665+0000","last_clean_scrub_stamp":"2023-08-01T19:54:03.032665+0000","objects_scrubbed":0,"log_size":1,"ondisk_log_size":1,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-08-03T07:13:34.025722+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":22,"num_objects":1,"num_object_clones":0,"num_object_copies":2,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":1,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":1,"num_write_kb":1,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[1,2],"acting":[1,2],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":1,"acting_primary":1,"purged_snaps":[]},{"pgid":"4.8","version":"0'0","reported_seq":9,"reported_epoch":17,"state":"active+clean","last_fresh":"2023-08-01T19:54:04.470264+0000","last_change":"2023-08-01T19:54:04.467671+0000","last_active":"2023-08-01T19:54:04.470264+0000","last_peered":"2023-08-01T19:54:04.470264+0000","last_clean":"2023-08-01T19:54:04.470264+0000","last_became_active":"2023-08-01T19:54:04.467300+0000","last_became_peered":"2023-08-01T19:54:04.467300+0000","last_unstale":"2023-08-01T19:54:04.470264+0000","last_undegraded":"2023-08-01T19:54:04.470264+0000","last_fullsized":"2023-08-01T19:54:04.470264+0000","mapping_epoch":16,"log_start":"0'0","ondisk_log_start":"0'0","created":16,"last_epoch_clean":17,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-08-01T19:54:04.040663+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-08-01T19:54:04.040663+0000","last_clean_scrub_stamp":"2023-08-01T19:54:04.040663+0000","objects_scrubbed":0,"log_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-08-03T05:27:24.774345+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[2,1],"acting":[2,1],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":2,"acting_primary":2,"purged_snaps":[]},{"pgid":"3.e","version":"17'2","reported_seq":12,"reported_epoch":17,"state":"active+clean","last_fresh":"2023-08-01T19:54:04.471249+0000","last_change":"2023-08-01T19:54:04.065595+0000","last_active":"2023-08-01T19:54:04.471249+0000","last_peered":"2023-08-01T19:54:04.471249+0000","last_clean":"2023-08-01T19:54:04.471249+0000","last_became_active":"2023-08-01T19:54:04.065303+0000","last_became_peered":"2023-08-01T19:54:04.065303+0000","last_unstale":"2023-08-01T19:54:04.471249+0000","last_undegraded":"2023-08-01T19:54:04.471249+0000","last_fullsized":"2023-08-01T19:54:04.471249+0000","mapping_epoch":15,"log_start":"0'0","ondisk_log_start":"0'0","created":15,"last_epoch_clean":16,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-08-01T19:54:03.032665+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-08-01T19:54:03.032665+0000","last_clean_scrub_stamp":"2023-08-01T19:54:03.032665+0000","objects_scrubbed":0,"log_size":2,"ondisk_log_size":2,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-08-02T22:40:38.782053+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":1,"num_object_clones":0,"num_object_copies":2,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":1,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":3,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":1,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[2,1],"acting":[2,1],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":2,"acting_primary":2,"purged_snaps":[]},{"pgid":"4.9","version":"0'0","reported_seq":9,"reported_epoch":17,"state":"active+clean","last_fresh":"2023-08-01T19:54:04.470284+0000","last_change":"2023-08-01T19:54:04.468007+0000","last_active":"2023-08-01T19:54:04.470284+0000","last_peered":"2023-08-01T19:54:04.470284+0000","last_clean":"2023-08-01T19:54:04.470284+0000","last_became_active":"2023-08-01T19:54:04.467509+0000","last_became_peered":"2023-08-01T19:54:04.467509+0000","last_unstale":"2023-08-01T19:54:04.470284+0000","last_undegraded":"2023-08-01T19:54:04.470284+0000","last_fullsized":"2023-08-01T19:54:04.470284+0000","mapping_epoch":16,"log_start":"0'0","ondisk_log_start":"0'0","created":16,"last_epoch_clean":17,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-08-01T19:54:04.040663+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-08-01T19:54:04.040663+0000","last_clean_scrub_stamp":"2023-08-01T19:54:04.040663+0000","objects_scrubbed":0,"log_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-08-03T06:04:50.963711+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[2,0],"acting":[2,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":2,"acting_primary":2,"purged_snaps":[]},{"pgid":"3.d","version":"17'1","reported_seq":11,"reported_epoch":17,"state":"active+clean","last_fresh":"2023-08-01T19:54:04.475997+0000","last_change":"2023-08-01T19:54:04.062853+0000","last_active":"2023-08-01T19:54:04.475997+0000","last_peered":"2023-08-01T19:54:04.475997+0000","last_clean":"2023-08-01T19:54:04.475997+0000","last_became_active":"2023-08-01T19:54:04.062598+0000","last_became_peered":"2023-08-01T19:54:04.062598+0000","last_unstale":"2023-08-01T19:54:04.475997+0000","last_undegraded":"2023-08-01T19:54:04.475997+0000","last_fullsized":"2023-08-01T19:54:04.475997+0000","mapping_epoch":15,"log_start":"0'0","ondisk_log_start":"0'0","created":15,"last_epoch_clean":16,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-08-01T19:54:03.032665+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-08-01T19:54:03.032665+0000","last_clean_scrub_stamp":"2023-08-01T19:54:03.032665+0000","objects_scrubbed":0,"log_size":1,"ondisk_log_size":1,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-08-02T20:56:47.324761+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":70,"num_objects":1,"num_object_clones":0,"num_object_copies":2,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":1,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":1,"num_write_kb":1,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[1,2],"acting":[1,2],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":1,"acting_primary":1,"purged_snaps":[]},{"pgid":"4.a","version":"0'0","reported_seq":9,"reported_epoch":17,"state":"active+clean","last_fresh":"2023-08-01T19:54:04.476248+0000","last_change":"2023-08-01T19:54:04.471997+0000","last_active":"2023-08-01T19:54:04.476248+0000","last_peered":"2023-08-01T19:54:04.476248+0000","last_clean":"2023-08-01T19:54:04.476248+0000","last_became_active":"2023-08-01T19:54:04.471204+0000","last_became_peered":"2023-08-01T19:54:04.471204+0000","last_unstale":"2023-08-01T19:54:04.476248+0000","last_undegraded":"2023-08-01T19:54:04.476248+0000","last_fullsized":"2023-08-01T19:54:04.476248+0000","mapping_epoch":16,"log_start":"0'0","ondisk_log_start":"0'0","created":16,"last_epoch_clean":17,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-08-01T19:54:04.040663+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-08-01T19:54:04.040663+0000","last_clean_scrub_stamp":"2023-08-01T19:54:04.040663+0000","objects_scrubbed":0,"log_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-08-02T23:12:30.830199+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[1,0],"acting":[1,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":1,"acting_primary":1,"purged_snaps":[]},{"pgid":"3.c","version":"0'0","reported_seq":10,"reported_epoch":17,"state":"active+clean","last_fresh":"2023-08-01T19:54:04.467464+0000","last_change":"2023-08-01T19:54:04.063532+0000","last_active":"2023-08-01T19:54:04.467464+0000","last_peered":"2023-08-01T19:54:04.467464+0000","last_clean":"2023-08-01T19:54:04.467464+0000","last_became_active":"2023-08-01T19:54:04.063116+0000","last_became_peered":"2023-08-01T19:54:04.063116+0000","last_unstale":"2023-08-01T19:54:04.467464+0000","last_undegraded":"2023-08-01T19:54:04.467464+0000","last_fullsized":"2023-08-01T19:54:04.467464+0000","mapping_epoch":15,"log_start":"0'0","ondisk_log_start":"0'0","created":15,"last_epoch_clean":16,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-08-01T19:54:03.032665+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-08-01T19:54:03.032665+0000","last_clean_scrub_stamp":"2023-08-01T19:54:03.032665+0000","objects_scrubbed":0,"log_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-08-02T22:28:51.936138+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[1,0],"acting":[1,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":1,"acting_primary":1,"purged_snaps":[]},{"pgid":"4.b","version":"0'0","reported_seq":9,"reported_epoch":17,"state":"active+clean","last_fresh":"2023-08-01T19:54:04.472955+0000","last_change":"2023-08-01T19:54:04.470787+0000","last_active":"2023-08-01T19:54:04.472955+0000","last_peered":"2023-08-01T19:54:04.472955+0000","last_clean":"2023-08-01T19:54:04.472955+0000","last_became_active":"2023-08-01T19:54:04.470332+0000","last_became_peered":"2023-08-01T19:54:04.470332+0000","last_unstale":"2023-08-01T19:54:04.472955+0000","last_undegraded":"2023-08-01T19:54:04.472955+0000","last_fullsized":"2023-08-01T19:54:04.472955+0000","mapping_epoch":16,"log_start":"0'0","ondisk_log_start":"0'0","created":16,"last_epoch_clean":17,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-08-01T19:54:04.040663+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-08-01T19:54:04.040663+0000","last_clean_scrub_stamp":"2023-08-01T19:54:04.040663+0000","objects_scrubbed":0,"log_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-08-03T05:13:38.298401+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[0,1],"acting":[0,1],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":0,"acting_primary":0,"purged_snaps":[]},{"pgid":"3.b","version":"17'2","reported_seq":12,"reported_epoch":17,"state":"active+clean","last_fresh":"2023-08-01T19:54:04.472965+0000","last_change":"2023-08-01T19:54:04.066839+0000","last_active":"2023-08-01T19:54:04.472965+0000","last_peered":"2023-08-01T19:54:04.472965+0000","last_clean":"2023-08-01T19:54:04.472965+0000","last_became_active":"2023-08-01T19:54:04.065535+0000","last_became_peered":"2023-08-01T19:54:04.065535+0000","last_unstale":"2023-08-01T19:54:04.472965+0000","last_undegraded":"2023-08-01T19:54:04.472965+0000","last_fullsized":"2023-08-01T19:54:04.472965+0000","mapping_epoch":15,"log_start":"0'0","ondisk_log_start":"0'0","created":15,"last_epoch_clean":16,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-08-01T19:54:03.032665+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-08-01T19:54:03.032665+0000","last_clean_scrub_stamp":"2023-08-01T19:54:03.032665+0000","objects_scrubbed":0,"log_size":2,"ondisk_log_size":2,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-08-03T05:00:51.171444+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":1,"num_object_clones":0,"num_object_copies":2,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":1,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":1,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":1,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[0,1],"acting":[0,1],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":0,"acting_primary":0,"purged_snaps":[]},{"pgid":"4.c","version":"0'0","reported_seq":9,"reported_epoch":17,"state":"active+clean","last_fresh":"2023-08-01T19:54:04.481357+0000","last_change":"2023-08-01T19:54:04.478715+0000","last_active":"2023-08-01T19:54:04.481357+0000","last_peered":"2023-08-01T19:54:04.481357+0000","last_clean":"2023-08-01T19:54:04.481357+0000","last_became_active":"2023-08-01T19:54:04.477435+0000","last_became_peered":"2023-08-01T19:54:04.477435+0000","last_unstale":"2023-08-01T19:54:04.481357+0000","last_undegraded":"2023-08-01T19:54:04.481357+0000","last_fullsized":"2023-08-01T19:54:04.481357+0000","mapping_epoch":16,"log_start":"0'0","ondisk_log_start":"0'0","created":16,"last_epoch_clean":17,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-08-01T19:54:04.040663+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-08-01T19:54:04.040663+0000","last_clean_scrub_stamp":"2023-08-01T19:54:04.040663+0000","objects_scrubbed":0,"log_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-08-03T04:43:21.408174+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[1,0],"acting":[1,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":1,"acting_primary":1,"purged_snaps":[]},{"pgid":"3.a","version":"0'0","reported_seq":10,"reported_epoch":17,"state":"active+clean","last_fresh":"2023-08-01T19:54:04.466981+0000","last_change":"2023-08-01T19:54:04.065267+0000","last_active":"2023-08-01T19:54:04.466981+0000","last_peered":"2023-08-01T19:54:04.466981+0000","last_clean":"2023-08-01T19:54:04.466981+0000","last_became_active":"2023-08-01T19:54:04.064912+0000","last_became_peered":"2023-08-01T19:54:04.064912+0000","last_unstale":"2023-08-01T19:54:04.466981+0000","last_undegraded":"2023-08-01T19:54:04.466981+0000","last_fullsized":"2023-08-01T19:54:04.466981+0000","mapping_epoch":15,"log_start":"0'0","ondisk_log_start":"0'0","created":15,"last_epoch_clean":16,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-08-01T19:54:03.032665+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-08-01T19:54:03.032665+0000","last_clean_scrub_stamp":"2023-08-01T19:54:03.032665+0000","objects_scrubbed":0,"log_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-08-03T02:37:09.180970+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[1,0],"acting":[1,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":1,"acting_primary":1,"purged_snaps":[]},{"pgid":"4.d","version":"0'0","reported_seq":9,"reported_epoch":17,"state":"active+clean","last_fresh":"2023-08-01T19:54:04.478084+0000","last_change":"2023-08-01T19:54:04.474755+0000","last_active":"2023-08-01T19:54:04.478084+0000","last_peered":"2023-08-01T19:54:04.478084+0000","last_clean":"2023-08-01T19:54:04.478084+0000","last_became_active":"2023-08-01T19:54:04.471526+0000","last_became_peered":"2023-08-01T19:54:04.471526+0000","last_unstale":"2023-08-01T19:54:04.478084+0000","last_undegraded":"2023-08-01T19:54:04.478084+0000","last_fullsized":"2023-08-01T19:54:04.478084+0000","mapping_epoch":16,"log_start":"0'0","ondisk_log_start":"0'0","created":16,"last_epoch_clean":17,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-08-01T19:54:04.040663+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-08-01T19:54:04.040663+0000","last_clean_scrub_stamp":"2023-08-01T19:54:04.040663+0000","objects_scrubbed":0,"log_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-08-03T06:50:03.420334+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[1,2],"acting":[1,2],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":1,"acting_primary":1,"purged_snaps":[]},{"pgid":"3.9","version":"0'0","reported_seq":10,"reported_epoch":17,"state":"active+clean","last_fresh":"2023-08-01T19:54:04.457820+0000","last_change":"2023-08-01T19:54:04.065519+0000","last_active":"2023-08-01T19:54:04.457820+0000","last_peered":"2023-08-01T19:54:04.457820+0000","last_clean":"2023-08-01T19:54:04.457820+0000","last_became_active":"2023-08-01T19:54:04.065211+0000","last_became_peered":"2023-08-01T19:54:04.065211+0000","last_unstale":"2023-08-01T19:54:04.457820+0000","last_undegraded":"2023-08-01T19:54:04.457820+0000","last_fullsized":"2023-08-01T19:54:04.457820+0000","mapping_epoch":15,"log_start":"0'0","ondisk_log_start":"0'0","created":15,"last_epoch_clean":16,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-08-01T19:54:03.032665+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-08-01T19:54:03.032665+0000","last_clean_scrub_stamp":"2023-08-01T19:54:03.032665+0000","objects_scrubbed":0,"log_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-08-03T05:46:27.672957+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[2,1],"acting":[2,1],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":2,"acting_primary":2,"purged_snaps":[]},{"pgid":"4.e","version":"0'0","reported_seq":9,"reported_epoch":17,"state":"active+clean","last_fresh":"2023-08-01T19:54:04.477674+0000","last_change":"2023-08-01T19:54:04.473750+0000","last_active":"2023-08-01T19:54:04.477674+0000","last_peered":"2023-08-01T19:54:04.477674+0000","last_clean":"2023-08-01T19:54:04.477674+0000","last_became_active":"2023-08-01T19:54:04.471512+0000","last_became_peered":"2023-08-01T19:54:04.471512+0000","last_unstale":"2023-08-01T19:54:04.477674+0000","last_undegraded":"2023-08-01T19:54:04.477674+0000","last_fullsized":"2023-08-01T19:54:04.477674+0000","mapping_epoch":16,"log_start":"0'0","ondisk_log_start":"0'0","created":16,"last_epoch_clean":17,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-08-01T19:54:04.040663+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-08-01T19:54:04.040663+0000","last_clean_scrub_stamp":"2023-08-01T19:54:04.040663+0000","objects_scrubbed":0,"log_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-08-03T05:13:38.298401+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[1,2],"acting":[1,2],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":1,"acting_primary":1,"purged_snaps":[]},{"pgid":"3.8","version":"0'0","reported_seq":10,"reported_epoch":17,"state":"active+clean","last_fresh":"2023-08-01T19:54:04.458299+0000","last_change":"2023-08-01T19:54:04.063990+0000","last_active":"2023-08-01T19:54:04.458299+0000","last_peered":"2023-08-01T19:54:04.458299+0000","last_clean":"2023-08-01T19:54:04.458299+0000","last_became_active":"2023-08-01T19:54:04.063652+0000","last_became_peered":"2023-08-01T19:54:04.063652+0000","last_unstale":"2023-08-01T19:54:04.458299+0000","last_undegraded":"2023-08-01T19:54:04.458299+0000","last_fullsized":"2023-08-01T19:54:04.458299+0000","mapping_epoch":15,"log_start":"0'0","ondisk_log_start":"0'0","created":15,"last_epoch_clean":16,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-08-01T19:54:03.032665+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-08-01T19:54:03.032665+0000","last_clean_scrub_stamp":"2023-08-01T19:54:03.032665+0000","objects_scrubbed":0,"log_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-08-03T05:30:28.028091+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[2,0],"acting":[2,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":2,"acting_primary":2,"purged_snaps":[]},{"pgid":"4.f","version":"0'0","reported_seq":9,"reported_epoch":17,"state":"active+clean","last_fresh":"2023-08-01T19:54:04.472898+0000","last_change":"2023-08-01T19:54:04.469648+0000","last_active":"2023-08-01T19:54:04.472898+0000","last_peered":"2023-08-01T19:54:04.472898+0000","last_clean":"2023-08-01T19:54:04.472898+0000","last_became_active":"2023-08-01T19:54:04.468445+0000","last_became_peered":"2023-08-01T19:54:04.468445+0000","last_unstale":"2023-08-01T19:54:04.472898+0000","last_undegraded":"2023-08-01T19:54:04.472898+0000","last_fullsized":"2023-08-01T19:54:04.472898+0000","mapping_epoch":16,"log_start":"0'0","ondisk_log_start":"0'0","created":16,"last_epoch_clean":17,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-08-01T19:54:04.040663+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-08-01T19:54:04.040663+0000","last_clean_scrub_stamp":"2023-08-01T19:54:04.040663+0000","objects_scrubbed":0,"log_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-08-03T05:46:11.085577+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[0,2],"acting":[0,2],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":0,"acting_primary":0,"purged_snaps":[]},{"pgid":"2.4","version":"0'0","reported_seq":13,"reported_epoch":17,"state":"active+clean","last_fresh":"2023-08-01T19:54:04.459326+0000","last_change":"2023-08-01T19:53:58.973838+0000","last_active":"2023-08-01T19:54:04.459326+0000","last_peered":"2023-08-01T19:54:04.459326+0000","last_clean":"2023-08-01T19:54:04.459326+0000","last_became_active":"2023-08-01T19:53:58.973242+0000","last_became_peered":"2023-08-01T19:53:58.973242+0000","last_unstale":"2023-08-01T19:54:04.459326+0000","last_undegraded":"2023-08-01T19:54:04.459326+0000","last_fullsized":"2023-08-01T19:54:04.459326+0000","mapping_epoch":12,"log_start":"0'0","ondisk_log_start":"0'0","created":12,"last_epoch_clean":13,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-08-01T19:53:57.959448+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-08-01T19:53:57.959448+0000","last_clean_scrub_stamp":"2023-08-01T19:53:57.959448+0000","objects_scrubbed":0,"log_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-08-03T00:09:48.796549+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[0,2],"acting":[0,2],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":0,"acting_primary":0,"purged_snaps":[]},{"pgid":"3.5","version":"0'0","reported_seq":10,"reported_epoch":17,"state":"active+clean","last_fresh":"2023-08-01T19:54:04.469510+0000","last_change":"2023-08-01T19:54:04.065255+0000","last_active":"2023-08-01T19:54:04.469510+0000","last_peered":"2023-08-01T19:54:04.469510+0000","last_clean":"2023-08-01T19:54:04.469510+0000","last_became_active":"2023-08-01T19:54:04.064814+0000","last_became_peered":"2023-08-01T19:54:04.064814+0000","last_unstale":"2023-08-01T19:54:04.469510+0000","last_undegraded":"2023-08-01T19:54:04.469510+0000","last_fullsized":"2023-08-01T19:54:04.469510+0000","mapping_epoch":15,"log_start":"0'0","ondisk_log_start":"0'0","created":15,"last_epoch_clean":16,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-08-01T19:54:03.032665+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-08-01T19:54:03.032665+0000","last_clean_scrub_stamp":"2023-08-01T19:54:03.032665+0000","objects_scrubbed":0,"log_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-08-03T02:01:47.073630+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[1,0],"acting":[1,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":1,"acting_primary":1,"purged_snaps":[]},{"pgid":"4.2","version":"0'0","reported_seq":9,"reported_epoch":17,"state":"active+clean","last_fresh":"2023-08-01T19:54:04.473868+0000","last_change":"2023-08-01T19:54:04.471715+0000","last_active":"2023-08-01T19:54:04.473868+0000","last_peered":"2023-08-01T19:54:04.473868+0000","last_clean":"2023-08-01T19:54:04.473868+0000","last_became_active":"2023-08-01T19:54:04.471300+0000","last_became_peered":"2023-08-01T19:54:04.471300+0000","last_unstale":"2023-08-01T19:54:04.473868+0000","last_undegraded":"2023-08-01T19:54:04.473868+0000","last_fullsized":"2023-08-01T19:54:04.473868+0000","mapping_epoch":16,"log_start":"0'0","ondisk_log_start":"0'0","created":16,"last_epoch_clean":17,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-08-01T19:54:04.040663+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-08-01T19:54:04.040663+0000","last_clean_scrub_stamp":"2023-08-01T19:54:04.040663+0000","objects_scrubbed":0,"log_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-08-02T23:00:24.980203+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[2,1],"acting":[2,1],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":2,"acting_primary":2,"purged_snaps":[]},{"pgid":"2.2","version":"0'0","reported_seq":13,"reported_epoch":17,"state":"active+clean","last_fresh":"2023-08-01T19:54:04.467109+0000","last_change":"2023-08-01T19:53:58.973665+0000","last_active":"2023-08-01T19:54:04.467109+0000","last_peered":"2023-08-01T19:54:04.467109+0000","last_clean":"2023-08-01T19:54:04.467109+0000","last_became_active":"2023-08-01T19:53:58.973463+0000","last_became_peered":"2023-08-01T19:53:58.973463+0000","last_unstale":"2023-08-01T19:54:04.467109+0000","last_undegraded":"2023-08-01T19:54:04.467109+0000","last_fullsized":"2023-08-01T19:54:04.467109+0000","mapping_epoch":12,"log_start":"0'0","ondisk_log_start":"0'0","created":12,"last_epoch_clean":13,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-08-01T19:53:57.959448+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-08-01T19:53:57.959448+0000","last_clean_scrub_stamp":"2023-08-01T19:53:57.959448+0000","objects_scrubbed":0,"log_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-08-03T04:50:42.368892+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[1,0],"acting":[1,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":1,"acting_primary":1,"purged_snaps":[]},{"pgid":"3.3","version":"0'0","reported_seq":10,"reported_epoch":17,"state":"active+clean","last_fresh":"2023-08-01T19:54:04.467459+0000","last_change":"2023-08-01T19:54:04.065415+0000","last_active":"2023-08-01T19:54:04.467459+0000","last_peered":"2023-08-01T19:54:04.467459+0000","last_clean":"2023-08-01T19:54:04.467459+0000","last_became_active":"2023-08-01T19:54:04.065030+0000","last_became_peered":"2023-08-01T19:54:04.065030+0000","last_unstale":"2023-08-01T19:54:04.467459+0000","last_undegraded":"2023-08-01T19:54:04.467459+0000","last_fullsized":"2023-08-01T19:54:04.467459+0000","mapping_epoch":15,"log_start":"0'0","ondisk_log_start":"0'0","created":15,"last_epoch_clean":16,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-08-01T19:54:03.032665+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-08-01T19:54:03.032665+0000","last_clean_scrub_stamp":"2023-08-01T19:54:03.032665+0000","objects_scrubbed":0,"log_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-08-02T21:33:27.007118+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[1,0],"acting":[1,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":1,"acting_primary":1,"purged_snaps":[]},{"pgid":"4.4","version":"0'0","reported_seq":9,"reported_epoch":17,"state":"active+clean","last_fresh":"2023-08-01T19:54:04.472012+0000","last_change":"2023-08-01T19:54:04.468101+0000","last_active":"2023-08-01T19:54:04.472012+0000","last_peered":"2023-08-01T19:54:04.472012+0000","last_clean":"2023-08-01T19:54:04.472012+0000","last_became_active":"2023-08-01T19:54:04.467409+0000","last_became_peered":"2023-08-01T19:54:04.467409+0000","last_unstale":"2023-08-01T19:54:04.472012+0000","last_undegraded":"2023-08-01T19:54:04.472012+0000","last_fullsized":"2023-08-01T19:54:04.472012+0000","mapping_epoch":16,"log_start":"0'0","ondisk_log_start":"0'0","created":16,"last_epoch_clean":17,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-08-01T19:54:04.040663+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-08-01T19:54:04.040663+0000","last_clean_scrub_stamp":"2023-08-01T19:54:04.040663+0000","objects_scrubbed":0,"log_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-08-02T21:43:30.325991+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[0,2],"acting":[0,2],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":0,"acting_primary":0,"purged_snaps":[]},{"pgid":"2.1","version":"0'0","reported_seq":13,"reported_epoch":17,"state":"active+clean","last_fresh":"2023-08-01T19:54:04.458490+0000","last_change":"2023-08-01T19:53:58.973700+0000","last_active":"2023-08-01T19:54:04.458490+0000","last_peered":"2023-08-01T19:54:04.458490+0000","last_clean":"2023-08-01T19:54:04.458490+0000","last_became_active":"2023-08-01T19:53:58.973285+0000","last_became_peered":"2023-08-01T19:53:58.973285+0000","last_unstale":"2023-08-01T19:54:04.458490+0000","last_undegraded":"2023-08-01T19:54:04.458490+0000","last_fullsized":"2023-08-01T19:54:04.458490+0000","mapping_epoch":12,"log_start":"0'0","ondisk_log_start":"0'0","created":12,"last_epoch_clean":13,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-08-01T19:53:57.959448+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-08-01T19:53:57.959448+0000","last_clean_scrub_stamp":"2023-08-01T19:53:57.959448+0000","objects_scrubbed":0,"log_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-08-02T21:26:02.570824+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[0,2],"acting":[0,2],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":0,"acting_primary":0,"purged_snaps":[]},{"pgid":"3.0","version":"0'0","reported_seq":10,"reported_epoch":17,"state":"active+clean","last_fresh":"2023-08-01T19:54:04.457828+0000","last_change":"2023-08-01T19:54:04.064407+0000","last_active":"2023-08-01T19:54:04.457828+0000","last_peered":"2023-08-01T19:54:04.457828+0000","last_clean":"2023-08-01T19:54:04.457828+0000","last_became_active":"2023-08-01T19:54:04.064122+0000","last_became_peered":"2023-08-01T19:54:04.064122+0000","last_unstale":"2023-08-01T19:54:04.457828+0000","last_undegraded":"2023-08-01T19:54:04.457828+0000","last_fullsized":"2023-08-01T19:54:04.457828+0000","mapping_epoch":15,"log_start":"0'0","ondisk_log_start":"0'0","created":15,"last_epoch_clean":16,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-08-01T19:54:03.032665+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-08-01T19:54:03.032665+0000","last_clean_scrub_stamp":"2023-08-01T19:54:03.032665+0000","objects_scrubbed":0,"log_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-08-03T07:08:17.318689+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[2,1],"acting":[2,1],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":2,"acting_primary":2,"purged_snaps":[]},{"pgid":"4.7","version":"0'0","reported_seq":9,"reported_epoch":17,"state":"active+clean","last_fresh":"2023-08-01T19:54:04.472871+0000","last_change":"2023-08-01T19:54:04.469739+0000","last_active":"2023-08-01T19:54:04.472871+0000","last_peered":"2023-08-01T19:54:04.472871+0000","last_clean":"2023-08-01T19:54:04.472871+0000","last_became_active":"2023-08-01T19:54:04.468021+0000","last_became_peered":"2023-08-01T19:54:04.468021+0000","last_unstale":"2023-08-01T19:54:04.472871+0000","last_undegraded":"2023-08-01T19:54:04.472871+0000","last_fullsized":"2023-08-01T19:54:04.472871+0000","mapping_epoch":16,"log_start":"0'0","ondisk_log_start":"0'0","created":16,"last_epoch_clean":17,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-08-01T19:54:04.040663+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-08-01T19:54:04.040663+0000","last_clean_scrub_stamp":"2023-08-01T19:54:04.040663+0000","objects_scrubbed":0,"log_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-08-02T21:03:01.319028+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[0,2],"acting":[0,2],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":0,"acting_primary":0,"purged_snaps":[]},{"pgid":"2.3","version":"0'0","reported_seq":13,"reported_epoch":17,"state":"active+clean","last_fresh":"2023-08-01T19:54:04.467483+0000","last_change":"2023-08-01T19:53:58.973768+0000","last_active":"2023-08-01T19:54:04.467483+0000","last_peered":"2023-08-01T19:54:04.467483+0000","last_clean":"2023-08-01T19:54:04.467483+0000","last_became_active":"2023-08-01T19:53:58.973492+0000","last_became_peered":"2023-08-01T19:53:58.973492+0000","last_unstale":"2023-08-01T19:54:04.467483+0000","last_undegraded":"2023-08-01T19:54:04.467483+0000","last_fullsized":"2023-08-01T19:54:04.467483+0000","mapping_epoch":12,"log_start":"0'0","ondisk_log_start":"0'0","created":12,"last_epoch_clean":13,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-08-01T19:53:57.959448+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-08-01T19:53:57.959448+0000","last_clean_scrub_stamp":"2023-08-01T19:53:57.959448+0000","objects_scrubbed":0,"log_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-08-03T02:04:52.034667+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[1,0],"acting":[1,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":1,"acting_primary":1,"purged_snaps":[]},{"pgid":"1.0","version":"10'157","reported_seq":212,"reported_epoch":17,"state":"active+clean","last_fresh":"2023-08-01T19:54:04.466599+0000","last_change":"2023-08-01T19:53:51.746910+0000","last_active":"2023-08-01T19:54:04.466599+0000","last_peered":"2023-08-01T19:54:04.466599+0000","last_clean":"2023-08-01T19:54:04.466599+0000","last_became_active":"2023-08-01T19:53:51.746590+0000","last_became_peered":"2023-08-01T19:53:51.746590+0000","last_unstale":"2023-08-01T19:54:04.466599+0000","last_undegraded":"2023-08-01T19:54:04.466599+0000","last_fullsized":"2023-08-01T19:54:04.466599+0000","mapping_epoch":9,"log_start":"0'0","ondisk_log_start":"0'0","created":9,"last_epoch_clean":10,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-08-01T19:53:50.735626+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-08-01T19:53:50.735626+0000","last_clean_scrub_stamp":"2023-08-01T19:53:50.735626+0000","objects_scrubbed":0,"log_size":157,"ondisk_log_size":157,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-08-03T02:56:50.228294+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":590368,"num_objects":2,"num_object_clones":0,"num_object_copies":4,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":2,"num_whiteouts":0,"num_read":136,"num_read_kb":118,"num_write":203,"num_write_kb":3460,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[1,2],"acting":[1,2],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":1,"acting_primary":1,"purged_snaps":[]},{"pgid":"3.2","version":"0'0","reported_seq":10,"reported_epoch":17,"state":"active+clean","last_fresh":"2023-08-01T19:54:04.458645+0000","last_change":"2023-08-01T19:54:04.064009+0000","last_active":"2023-08-01T19:54:04.458645+0000","last_peered":"2023-08-01T19:54:04.458645+0000","last_clean":"2023-08-01T19:54:04.458645+0000","last_became_active":"2023-08-01T19:54:04.063665+0000","last_became_peered":"2023-08-01T19:54:04.063665+0000","last_unstale":"2023-08-01T19:54:04.458645+0000","last_undegraded":"2023-08-01T19:54:04.458645+0000","last_fullsized":"2023-08-01T19:54:04.458645+0000","mapping_epoch":15,"log_start":"0'0","ondisk_log_start":"0'0","created":15,"last_epoch_clean":16,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-08-01T19:54:03.032665+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-08-01T19:54:03.032665+0000","last_clean_scrub_stamp":"2023-08-01T19:54:03.032665+0000","objects_scrubbed":0,"log_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-08-03T04:04:46.983253+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[0,2],"acting":[0,2],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":0,"acting_primary":0,"purged_snaps":[]},{"pgid":"4.5","version":"0'0","reported_seq":9,"reported_epoch":17,"state":"active+clean","last_fresh":"2023-08-01T19:54:04.477907+0000","last_change":"2023-08-01T19:54:04.474061+0000","last_active":"2023-08-01T19:54:04.477907+0000","last_peered":"2023-08-01T19:54:04.477907+0000","last_clean":"2023-08-01T19:54:04.477907+0000","last_became_active":"2023-08-01T19:54:04.472128+0000","last_became_peered":"2023-08-01T19:54:04.472128+0000","last_unstale":"2023-08-01T19:54:04.477907+0000","last_undegraded":"2023-08-01T19:54:04.477907+0000","last_fullsized":"2023-08-01T19:54:04.477907+0000","mapping_epoch":16,"log_start":"0'0","ondisk_log_start":"0'0","created":16,"last_epoch_clean":17,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-08-01T19:54:04.040663+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-08-01T19:54:04.040663+0000","last_clean_scrub_stamp":"2023-08-01T19:54:04.040663+0000","objects_scrubbed":0,"log_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-08-03T00:29:05.857138+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[1,2],"acting":[1,2],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":1,"acting_primary":1,"purged_snaps":[]},{"pgid":"2.0","version":"0'0","reported_seq":13,"reported_epoch":17,"state":"active+clean","last_fresh":"2023-08-01T19:54:04.466598+0000","last_change":"2023-08-01T19:53:58.975968+0000","last_active":"2023-08-01T19:54:04.466598+0000","last_peered":"2023-08-01T19:54:04.466598+0000","last_clean":"2023-08-01T19:54:04.466598+0000","last_became_active":"2023-08-01T19:53:58.975706+0000","last_became_peered":"2023-08-01T19:53:58.975706+0000","last_unstale":"2023-08-01T19:54:04.466598+0000","last_undegraded":"2023-08-01T19:54:04.466598+0000","last_fullsized":"2023-08-01T19:54:04.466598+0000","mapping_epoch":12,"log_start":"0'0","ondisk_log_start":"0'0","created":12,"last_epoch_clean":13,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-08-01T19:53:57.959448+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-08-01T19:53:57.959448+0000","last_clean_scrub_stamp":"2023-08-01T19:53:57.959448+0000","objects_scrubbed":0,"log_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-08-03T00:02:15.204280+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[1,2],"acting":[1,2],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":1,"acting_primary":1,"purged_snaps":[]},{"pgid":"3.1","version":"0'0","reported_seq":10,"reported_epoch":17,"state":"active+clean","last_fresh":"2023-08-01T19:54:04.458619+0000","last_change":"2023-08-01T19:54:04.066707+0000","last_active":"2023-08-01T19:54:04.458619+0000","last_peered":"2023-08-01T19:54:04.458619+0000","last_clean":"2023-08-01T19:54:04.458619+0000","last_became_active":"2023-08-01T19:54:04.066334+0000","last_became_peered":"2023-08-01T19:54:04.066334+0000","last_unstale":"2023-08-01T19:54:04.458619+0000","last_undegraded":"2023-08-01T19:54:04.458619+0000","last_fullsized":"2023-08-01T19:54:04.458619+0000","mapping_epoch":15,"log_start":"0'0","ondisk_log_start":"0'0","created":15,"last_epoch_clean":16,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-08-01T19:54:03.032665+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-08-01T19:54:03.032665+0000","last_clean_scrub_stamp":"2023-08-01T19:54:03.032665+0000","objects_scrubbed":0,"log_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-08-03T02:40:15.210599+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[0,1],"acting":[0,1],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":0,"acting_primary":0,"purged_snaps":[]},{"pgid":"4.6","version":"0'0","reported_seq":9,"reported_epoch":17,"state":"active+clean","last_fresh":"2023-08-01T19:54:04.471325+0000","last_change":"2023-08-01T19:54:04.469877+0000","last_active":"2023-08-01T19:54:04.471325+0000","last_peered":"2023-08-01T19:54:04.471325+0000","last_clean":"2023-08-01T19:54:04.471325+0000","last_became_active":"2023-08-01T19:54:04.469528+0000","last_became_peered":"2023-08-01T19:54:04.469528+0000","last_unstale":"2023-08-01T19:54:04.471325+0000","last_undegraded":"2023-08-01T19:54:04.471325+0000","last_fullsized":"2023-08-01T19:54:04.471325+0000","mapping_epoch":16,"log_start":"0'0","ondisk_log_start":"0'0","created":16,"last_epoch_clean":17,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-08-01T19:54:04.040663+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-08-01T19:54:04.040663+0000","last_clean_scrub_stamp":"2023-08-01T19:54:04.040663+0000","objects_scrubbed":0,"log_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-08-03T02:24:19.067602+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[2,0],"acting":[2,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":2,"acting_primary":2,"purged_snaps":[]},{"pgid":"2.5","version":"0'0","reported_seq":13,"reported_epoch":17,"state":"active+clean","last_fresh":"2023-08-01T19:54:04.459098+0000","last_change":"2023-08-01T19:53:58.970683+0000","last_active":"2023-08-01T19:54:04.459098+0000","last_peered":"2023-08-01T19:54:04.459098+0000","last_clean":"2023-08-01T19:54:04.459098+0000","last_became_active":"2023-08-01T19:53:58.970437+0000","last_became_peered":"2023-08-01T19:53:58.970437+0000","last_unstale":"2023-08-01T19:54:04.459098+0000","last_undegraded":"2023-08-01T19:54:04.459098+0000","last_fullsized":"2023-08-01T19:54:04.459098+0000","mapping_epoch":12,"log_start":"0'0","ondisk_log_start":"0'0","created":12,"last_epoch_clean":13,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-08-01T19:53:57.959448+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-08-01T19:53:57.959448+0000","last_clean_scrub_stamp":"2023-08-01T19:53:57.959448+0000","objects_scrubbed":0,"log_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-08-02T23:54:08.273426+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[2,0],"acting":[2,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":2,"acting_primary":2,"purged_snaps":[]},{"pgid":"3.4","version":"0'0","reported_seq":10,"reported_epoch":17,"state":"active+clean","last_fresh":"2023-08-01T19:54:04.458989+0000","last_change":"2023-08-01T19:54:04.062283+0000","last_active":"2023-08-01T19:54:04.458989+0000","last_peered":"2023-08-01T19:54:04.458989+0000","last_clean":"2023-08-01T19:54:04.458989+0000","last_became_active":"2023-08-01T19:54:04.061796+0000","last_became_peered":"2023-08-01T19:54:04.061796+0000","last_unstale":"2023-08-01T19:54:04.458989+0000","last_undegraded":"2023-08-01T19:54:04.458989+0000","last_fullsized":"2023-08-01T19:54:04.458989+0000","mapping_epoch":15,"log_start":"0'0","ondisk_log_start":"0'0","created":15,"last_epoch_clean":16,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-08-01T19:54:03.032665+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-08-01T19:54:03.032665+0000","last_clean_scrub_stamp":"2023-08-01T19:54:03.032665+0000","objects_scrubbed":0,"log_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-08-02T19:54:08.401797+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[0,2],"acting":[0,2],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":0,"acting_primary":0,"purged_snaps":[]},{"pgid":"4.3","version":"0'0","reported_seq":9,"reported_epoch":17,"state":"active+clean","last_fresh":"2023-08-01T19:54:04.474487+0000","last_change":"2023-08-01T19:54:04.473088+0000","last_active":"2023-08-01T19:54:04.474487+0000","last_peered":"2023-08-01T19:54:04.474487+0000","last_clean":"2023-08-01T19:54:04.474487+0000","last_became_active":"2023-08-01T19:54:04.472611+0000","last_became_peered":"2023-08-01T19:54:04.472611+0000","last_unstale":"2023-08-01T19:54:04.474487+0000","last_undegraded":"2023-08-01T19:54:04.474487+0000","last_fullsized":"2023-08-01T19:54:04.474487+0000","mapping_epoch":16,"log_start":"0'0","ondisk_log_start":"0'0","created":16,"last_epoch_clean":17,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-08-01T19:54:04.040663+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-08-01T19:54:04.040663+0000","last_clean_scrub_stamp":"2023-08-01T19:54:04.040663+0000","objects_scrubbed":0,"log_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-08-03T07:27:26.537518+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[2,1],"acting":[2,1],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":2,"acting_primary":2,"purged_snaps":[]},{"pgid":"3.7","version":"17'2","reported_seq":12,"reported_epoch":17,"state":"active+clean","last_fresh":"2023-08-01T19:54:04.471357+0000","last_change":"2023-08-01T19:54:04.065147+0000","last_active":"2023-08-01T19:54:04.471357+0000","last_peered":"2023-08-01T19:54:04.471357+0000","last_clean":"2023-08-01T19:54:04.471357+0000","last_became_active":"2023-08-01T19:54:04.064779+0000","last_became_peered":"2023-08-01T19:54:04.064779+0000","last_unstale":"2023-08-01T19:54:04.471357+0000","last_undegraded":"2023-08-01T19:54:04.471357+0000","last_fullsized":"2023-08-01T19:54:04.471357+0000","mapping_epoch":15,"log_start":"0'0","ondisk_log_start":"0'0","created":15,"last_epoch_clean":16,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-08-01T19:54:03.032665+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-08-01T19:54:03.032665+0000","last_clean_scrub_stamp":"2023-08-01T19:54:03.032665+0000","objects_scrubbed":0,"log_size":2,"ondisk_log_size":2,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-08-03T03:43:45.667663+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":1,"num_object_clones":0,"num_object_copies":2,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":1,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":3,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":1,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[0,2],"acting":[0,2],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":0,"acting_primary":0,"purged_snaps":[]},{"pgid":"2.6","version":"0'0","reported_seq":13,"reported_epoch":17,"state":"active+clean","last_fresh":"2023-08-01T19:54:04.460651+0000","last_change":"2023-08-01T19:53:58.974077+0000","last_active":"2023-08-01T19:54:04.460651+0000","last_peered":"2023-08-01T19:54:04.460651+0000","last_clean":"2023-08-01T19:54:04.460651+0000","last_became_active":"2023-08-01T19:53:58.973396+0000","last_became_peered":"2023-08-01T19:53:58.973396+0000","last_unstale":"2023-08-01T19:54:04.460651+0000","last_undegraded":"2023-08-01T19:54:04.460651+0000","last_fullsized":"2023-08-01T19:54:04.460651+0000","mapping_epoch":12,"log_start":"0'0","ondisk_log_start":"0'0","created":12,"last_epoch_clean":13,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-08-01T19:53:57.959448+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-08-01T19:53:57.959448+0000","last_clean_scrub_stamp":"2023-08-01T19:53:57.959448+0000","objects_scrubbed":0,"log_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-08-02T22:13:50.940864+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[0,2],"acting":[0,2],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":0,"acting_primary":0,"purged_snaps":[]},{"pgid":"4.0","version":"0'0","reported_seq":9,"reported_epoch":17,"state":"active+clean","last_fresh":"2023-08-01T19:54:04.477383+0000","last_change":"2023-08-01T19:54:04.476807+0000","last_active":"2023-08-01T19:54:04.477383+0000","last_peered":"2023-08-01T19:54:04.477383+0000","last_clean":"2023-08-01T19:54:04.477383+0000","last_became_active":"2023-08-01T19:54:04.476453+0000","last_became_peered":"2023-08-01T19:54:04.476453+0000","last_unstale":"2023-08-01T19:54:04.477383+0000","last_undegraded":"2023-08-01T19:54:04.477383+0000","last_fullsized":"2023-08-01T19:54:04.477383+0000","mapping_epoch":16,"log_start":"0'0","ondisk_log_start":"0'0","created":16,"last_epoch_clean":17,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-08-01T19:54:04.040663+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-08-01T19:54:04.040663+0000","last_clean_scrub_stamp":"2023-08-01T19:54:04.040663+0000","objects_scrubbed":0,"log_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-08-02T20:20:59.989030+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[0,1],"acting":[0,1],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":0,"acting_primary":0,"purged_snaps":[]},{"pgid":"2.7","version":"0'0","reported_seq":13,"reported_epoch":17,"state":"active+clean","last_fresh":"2023-08-01T19:54:04.469429+0000","last_change":"2023-08-01T19:53:58.975936+0000","last_active":"2023-08-01T19:54:04.469429+0000","last_peered":"2023-08-01T19:54:04.469429+0000","last_clean":"2023-08-01T19:54:04.469429+0000","last_became_active":"2023-08-01T19:53:58.975680+0000","last_became_peered":"2023-08-01T19:53:58.975680+0000","last_unstale":"2023-08-01T19:54:04.469429+0000","last_undegraded":"2023-08-01T19:54:04.469429+0000","last_fullsized":"2023-08-01T19:54:04.469429+0000","mapping_epoch":12,"log_start":"0'0","ondisk_log_start":"0'0","created":12,"last_epoch_clean":13,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-08-01T19:53:57.959448+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-08-01T19:53:57.959448+0000","last_clean_scrub_stamp":"2023-08-01T19:53:57.959448+0000","objects_scrubbed":0,"log_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-08-03T05:17:03.508898+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[1,2],"acting":[1,2],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":1,"acting_primary":1,"purged_snaps":[]},{"pgid":"3.6","version":"18'1","reported_seq":11,"reported_epoch":18,"state":"active+clean","last_fresh":"2023-08-01T19:54:06.924239+0000","last_change":"2023-08-01T19:54:04.068041+0000","last_active":"2023-08-01T19:54:06.924239+0000","last_peered":"2023-08-01T19:54:06.924239+0000","last_clean":"2023-08-01T19:54:06.924239+0000","last_became_active":"2023-08-01T19:54:04.067613+0000","last_became_peered":"2023-08-01T19:54:04.067613+0000","last_unstale":"2023-08-01T19:54:06.924239+0000","last_undegraded":"2023-08-01T19:54:06.924239+0000","last_fullsized":"2023-08-01T19:54:06.924239+0000","mapping_epoch":15,"log_start":"0'0","ondisk_log_start":"0'0","created":15,"last_epoch_clean":16,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-08-01T19:54:03.032665+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-08-01T19:54:03.032665+0000","last_clean_scrub_stamp":"2023-08-01T19:54:03.032665+0000","objects_scrubbed":0,"log_size":1,"ondisk_log_size":1,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-08-02T21:35:44.874727+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":1,"num_object_clones":0,"num_object_copies":2,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":1,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":1,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":1,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[0,1],"acting":[0,1],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":0,"acting_primary":0,"purged_snaps":[]},{"pgid":"4.1","version":"0'0","reported_seq":9,"reported_epoch":17,"state":"active+clean","last_fresh":"2023-08-01T19:54:04.470826+0000","last_change":"2023-08-01T19:54:04.469243+0000","last_active":"2023-08-01T19:54:04.470826+0000","last_peered":"2023-08-01T19:54:04.470826+0000","last_clean":"2023-08-01T19:54:04.470826+0000","last_became_active":"2023-08-01T19:54:04.468835+0000","last_became_peered":"2023-08-01T19:54:04.468835+0000","last_unstale":"2023-08-01T19:54:04.470826+0000","last_undegraded":"2023-08-01T19:54:04.470826+0000","last_fullsized":"2023-08-01T19:54:04.470826+0000","mapping_epoch":16,"log_start":"0'0","ondisk_log_start":"0'0","created":16,"last_epoch_clean":17,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-08-01T19:54:04.040663+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-08-01T19:54:04.040663+0000","last_clean_scrub_stamp":"2023-08-01T19:54:04.040663+0000","objects_scrubbed":0,"log_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-08-03T04:43:58.358628+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[2,1],"acting":[2,1],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":2,"acting_primary":2,"purged_snaps":[]},{"pgid":"3.1b","version":"17'1","reported_seq":11,"reported_epoch":17,"state":"active+clean","last_fresh":"2023-08-01T19:54:04.471524+0000","last_change":"2023-08-01T19:54:04.066748+0000","last_active":"2023-08-01T19:54:04.471524+0000","last_peered":"2023-08-01T19:54:04.471524+0000","last_clean":"2023-08-01T19:54:04.471524+0000","last_became_active":"2023-08-01T19:54:04.066483+0000","last_became_peered":"2023-08-01T19:54:04.066483+0000","last_unstale":"2023-08-01T19:54:04.471524+0000","last_undegraded":"2023-08-01T19:54:04.471524+0000","last_fullsized":"2023-08-01T19:54:04.471524+0000","mapping_epoch":15,"log_start":"0'0","ondisk_log_start":"0'0","created":15,"last_epoch_clean":16,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-08-01T19:54:03.032665+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-08-01T19:54:03.032665+0000","last_clean_scrub_stamp":"2023-08-01T19:54:03.032665+0000","objects_scrubbed":0,"log_size":1,"ondisk_log_size":1,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-08-03T03:08:26.880362+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[2,1],"acting":[2,1],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":2,"acting_primary":2,"purged_snaps":[]},{"pgid":"4.1c","version":"0'0","reported_seq":9,"reported_epoch":17,"state":"active+clean","last_fresh":"2023-08-01T19:54:04.468766+0000","last_change":"2023-08-01T19:54:04.466766+0000","last_active":"2023-08-01T19:54:04.468766+0000","last_peered":"2023-08-01T19:54:04.468766+0000","last_clean":"2023-08-01T19:54:04.468766+0000","last_became_active":"2023-08-01T19:54:04.466417+0000","last_became_peered":"2023-08-01T19:54:04.466417+0000","last_unstale":"2023-08-01T19:54:04.468766+0000","last_undegraded":"2023-08-01T19:54:04.468766+0000","last_fullsized":"2023-08-01T19:54:04.468766+0000","mapping_epoch":16,"log_start":"0'0","ondisk_log_start":"0'0","created":16,"last_epoch_clean":17,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-08-01T19:54:04.040663+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-08-01T19:54:04.040663+0000","last_clean_scrub_stamp":"2023-08-01T19:54:04.040663+0000","objects_scrubbed":0,"log_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-08-02T22:01:53.643825+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[2,0],"acting":[2,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":2,"acting_primary":2,"purged_snaps":[]},{"pgid":"3.1c","version":"17'2","reported_seq":12,"reported_epoch":17,"state":"active+clean","last_fresh":"2023-08-01T19:54:04.477825+0000","last_change":"2023-08-01T19:54:04.065706+0000","last_active":"2023-08-01T19:54:04.477825+0000","last_peered":"2023-08-01T19:54:04.477825+0000","last_clean":"2023-08-01T19:54:04.477825+0000","last_became_active":"2023-08-01T19:54:04.064796+0000","last_became_peered":"2023-08-01T19:54:04.064796+0000","last_unstale":"2023-08-01T19:54:04.477825+0000","last_undegraded":"2023-08-01T19:54:04.477825+0000","last_fullsized":"2023-08-01T19:54:04.477825+0000","mapping_epoch":15,"log_start":"0'0","ondisk_log_start":"0'0","created":15,"last_epoch_clean":16,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-08-01T19:54:03.032665+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-08-01T19:54:03.032665+0000","last_clean_scrub_stamp":"2023-08-01T19:54:03.032665+0000","objects_scrubbed":0,"log_size":2,"ondisk_log_size":2,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-08-02T21:40:43.596301+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":1,"num_object_clones":0,"num_object_copies":2,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":1,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":3,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":1,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[1,0],"acting":[1,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":1,"acting_primary":1,"purged_snaps":[]},{"pgid":"4.1b","version":"0'0","reported_seq":9,"reported_epoch":17,"state":"active+clean","last_fresh":"2023-08-01T19:54:04.478301+0000","last_change":"2023-08-01T19:54:04.474971+0000","last_active":"2023-08-01T19:54:04.478301+0000","last_peered":"2023-08-01T19:54:04.478301+0000","last_clean":"2023-08-01T19:54:04.478301+0000","last_became_active":"2023-08-01T19:54:04.473957+0000","last_became_peered":"2023-08-01T19:54:04.473957+0000","last_unstale":"2023-08-01T19:54:04.478301+0000","last_undegraded":"2023-08-01T19:54:04.478301+0000","last_fullsized":"2023-08-01T19:54:04.478301+0000","mapping_epoch":16,"log_start":"0'0","ondisk_log_start":"0'0","created":16,"last_epoch_clean":17,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-08-01T19:54:04.040663+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-08-01T19:54:04.040663+0000","last_clean_scrub_stamp":"2023-08-01T19:54:04.040663+0000","objects_scrubbed":0,"log_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-08-02T21:59:19.682560+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[1,0],"acting":[1,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":1,"acting_primary":1,"purged_snaps":[]},{"pgid":"3.1d","version":"17'2","reported_seq":12,"reported_epoch":17,"state":"active+clean","last_fresh":"2023-08-01T19:54:04.471623+0000","last_change":"2023-08-01T19:54:04.065591+0000","last_active":"2023-08-01T19:54:04.471623+0000","last_peered":"2023-08-01T19:54:04.471623+0000","last_clean":"2023-08-01T19:54:04.471623+0000","last_became_active":"2023-08-01T19:54:04.065306+0000","last_became_peered":"2023-08-01T19:54:04.065306+0000","last_unstale":"2023-08-01T19:54:04.471623+0000","last_undegraded":"2023-08-01T19:54:04.471623+0000","last_fullsized":"2023-08-01T19:54:04.471623+0000","mapping_epoch":15,"log_start":"0'0","ondisk_log_start":"0'0","created":15,"last_epoch_clean":16,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-08-01T19:54:03.032665+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-08-01T19:54:03.032665+0000","last_clean_scrub_stamp":"2023-08-01T19:54:03.032665+0000","objects_scrubbed":0,"log_size":2,"ondisk_log_size":2,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-08-02T21:32:10.389227+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":1,"num_object_clones":0,"num_object_copies":2,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":1,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":3,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":1,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[2,1],"acting":[2,1],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":2,"acting_primary":2,"purged_snaps":[]},{"pgid":"4.1a","version":"0'0","reported_seq":9,"reported_epoch":17,"state":"active+clean","last_fresh":"2023-08-01T19:54:04.477591+0000","last_change":"2023-08-01T19:54:04.473302+0000","last_active":"2023-08-01T19:54:04.477591+0000","last_peered":"2023-08-01T19:54:04.477591+0000","last_clean":"2023-08-01T19:54:04.477591+0000","last_became_active":"2023-08-01T19:54:04.472452+0000","last_became_peered":"2023-08-01T19:54:04.472452+0000","last_unstale":"2023-08-01T19:54:04.477591+0000","last_undegraded":"2023-08-01T19:54:04.477591+0000","last_fullsized":"2023-08-01T19:54:04.477591+0000","mapping_epoch":16,"log_start":"0'0","ondisk_log_start":"0'0","created":16,"last_epoch_clean":17,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-08-01T19:54:04.040663+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-08-01T19:54:04.040663+0000","last_clean_scrub_stamp":"2023-08-01T19:54:04.040663+0000","objects_scrubbed":0,"log_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-08-02T21:02:39.542019+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[1,0],"acting":[1,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":1,"acting_primary":1,"purged_snaps":[]},{"pgid":"3.1e","version":"17'1","reported_seq":11,"reported_epoch":17,"state":"active+clean","last_fresh":"2023-08-01T19:54:04.471416+0000","last_change":"2023-08-01T19:54:04.064378+0000","last_active":"2023-08-01T19:54:04.471416+0000","last_peered":"2023-08-01T19:54:04.471416+0000","last_clean":"2023-08-01T19:54:04.471416+0000","last_became_active":"2023-08-01T19:54:04.063988+0000","last_became_peered":"2023-08-01T19:54:04.063988+0000","last_unstale":"2023-08-01T19:54:04.471416+0000","last_undegraded":"2023-08-01T19:54:04.471416+0000","last_fullsized":"2023-08-01T19:54:04.471416+0000","mapping_epoch":15,"log_start":"0'0","ondisk_log_start":"0'0","created":15,"last_epoch_clean":16,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-08-01T19:54:03.032665+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-08-01T19:54:03.032665+0000","last_clean_scrub_stamp":"2023-08-01T19:54:03.032665+0000","objects_scrubbed":0,"log_size":1,"ondisk_log_size":1,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-08-02T22:28:51.936138+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[0,2],"acting":[0,2],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":0,"acting_primary":0,"purged_snaps":[]},{"pgid":"4.19","version":"0'0","reported_seq":9,"reported_epoch":17,"state":"active+clean","last_fresh":"2023-08-01T19:54:04.469620+0000","last_change":"2023-08-01T19:54:04.467017+0000","last_active":"2023-08-01T19:54:04.469620+0000","last_peered":"2023-08-01T19:54:04.469620+0000","last_clean":"2023-08-01T19:54:04.469620+0000","last_became_active":"2023-08-01T19:54:04.466339+0000","last_became_peered":"2023-08-01T19:54:04.466339+0000","last_unstale":"2023-08-01T19:54:04.469620+0000","last_undegraded":"2023-08-01T19:54:04.469620+0000","last_fullsized":"2023-08-01T19:54:04.469620+0000","mapping_epoch":16,"log_start":"0'0","ondisk_log_start":"0'0","created":16,"last_epoch_clean":17,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-08-01T19:54:04.040663+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-08-01T19:54:04.040663+0000","last_clean_scrub_stamp":"2023-08-01T19:54:04.040663+0000","objects_scrubbed":0,"log_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-08-03T04:07:57.222873+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[2,0],"acting":[2,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":2,"acting_primary":2,"purged_snaps":[]},{"pgid":"3.1f","version":"17'4","reported_seq":14,"reported_epoch":17,"state":"active+clean","last_fresh":"2023-08-01T19:54:04.472669+0000","last_change":"2023-08-01T19:54:04.067767+0000","last_active":"2023-08-01T19:54:04.472669+0000","last_peered":"2023-08-01T19:54:04.472669+0000","last_clean":"2023-08-01T19:54:04.472669+0000","last_became_active":"2023-08-01T19:54:04.067414+0000","last_became_peered":"2023-08-01T19:54:04.067414+0000","last_unstale":"2023-08-01T19:54:04.472669+0000","last_undegraded":"2023-08-01T19:54:04.472669+0000","last_fullsized":"2023-08-01T19:54:04.472669+0000","mapping_epoch":15,"log_start":"0'0","ondisk_log_start":"0'0","created":15,"last_epoch_clean":16,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-08-01T19:54:03.032665+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-08-01T19:54:03.032665+0000","last_clean_scrub_stamp":"2023-08-01T19:54:03.032665+0000","objects_scrubbed":0,"log_size":4,"ondisk_log_size":4,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-08-02T21:33:27.007118+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":554,"num_objects":2,"num_object_clones":0,"num_object_copies":4,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":2,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":4,"num_write_kb":1,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":1,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[0,1],"acting":[0,1],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":0,"acting_primary":0,"purged_snaps":[]},{"pgid":"4.18","version":"0'0","reported_seq":9,"reported_epoch":17,"state":"active+clean","last_fresh":"2023-08-01T19:54:04.478697+0000","last_change":"2023-08-01T19:54:04.477588+0000","last_active":"2023-08-01T19:54:04.478697+0000","last_peered":"2023-08-01T19:54:04.478697+0000","last_clean":"2023-08-01T19:54:04.478697+0000","last_became_active":"2023-08-01T19:54:04.476194+0000","last_became_peered":"2023-08-01T19:54:04.476194+0000","last_unstale":"2023-08-01T19:54:04.478697+0000","last_undegraded":"2023-08-01T19:54:04.478697+0000","last_fullsized":"2023-08-01T19:54:04.478697+0000","mapping_epoch":16,"log_start":"0'0","ondisk_log_start":"0'0","created":16,"last_epoch_clean":17,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-08-01T19:54:04.040663+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-08-01T19:54:04.040663+0000","last_clean_scrub_stamp":"2023-08-01T19:54:04.040663+0000","objects_scrubbed":0,"log_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-08-03T03:58:06.360840+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[1,0],"acting":[1,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":1,"acting_primary":1,"purged_snaps":[]},{"pgid":"4.20","version":"0'0","reported_seq":9,"reported_epoch":17,"state":"active+clean","last_fresh":"2023-08-01T19:54:04.479155+0000","last_change":"2023-08-01T19:54:04.477904+0000","last_active":"2023-08-01T19:54:04.479155+0000","last_peered":"2023-08-01T19:54:04.479155+0000","last_clean":"2023-08-01T19:54:04.479155+0000","last_became_active":"2023-08-01T19:54:04.476564+0000","last_became_peered":"2023-08-01T19:54:04.476564+0000","last_unstale":"2023-08-01T19:54:04.479155+0000","last_undegraded":"2023-08-01T19:54:04.479155+0000","last_fullsized":"2023-08-01T19:54:04.479155+0000","mapping_epoch":16,"log_start":"0'0","ondisk_log_start":"0'0","created":16,"last_epoch_clean":17,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-08-01T19:54:04.040663+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-08-01T19:54:04.040663+0000","last_clean_scrub_stamp":"2023-08-01T19:54:04.040663+0000","objects_scrubbed":0,"log_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-08-03T02:21:47.656072+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[1,0],"acting":[1,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":1,"acting_primary":1,"purged_snaps":[]},{"pgid":"4.21","version":"0'0","reported_seq":9,"reported_epoch":17,"state":"active+clean","last_fresh":"2023-08-01T19:54:04.471608+0000","last_change":"2023-08-01T19:54:04.466899+0000","last_active":"2023-08-01T19:54:04.471608+0000","last_peered":"2023-08-01T19:54:04.471608+0000","last_clean":"2023-08-01T19:54:04.471608+0000","last_became_active":"2023-08-01T19:54:04.466500+0000","last_became_peered":"2023-08-01T19:54:04.466500+0000","last_unstale":"2023-08-01T19:54:04.471608+0000","last_undegraded":"2023-08-01T19:54:04.471608+0000","last_fullsized":"2023-08-01T19:54:04.471608+0000","mapping_epoch":16,"log_start":"0'0","ondisk_log_start":"0'0","created":16,"last_epoch_clean":17,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-08-01T19:54:04.040663+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-08-01T19:54:04.040663+0000","last_clean_scrub_stamp":"2023-08-01T19:54:04.040663+0000","objects_scrubbed":0,"log_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-08-03T07:36:38.654701+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[0,2],"acting":[0,2],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":0,"acting_primary":0,"purged_snaps":[]},{"pgid":"4.22","version":"0'0","reported_seq":9,"reported_epoch":17,"state":"active+clean","last_fresh":"2023-08-01T19:54:04.473914+0000","last_change":"2023-08-01T19:54:04.471945+0000","last_active":"2023-08-01T19:54:04.473914+0000","last_peered":"2023-08-01T19:54:04.473914+0000","last_clean":"2023-08-01T19:54:04.473914+0000","last_became_active":"2023-08-01T19:54:04.471371+0000","last_became_peered":"2023-08-01T19:54:04.471371+0000","last_unstale":"2023-08-01T19:54:04.473914+0000","last_undegraded":"2023-08-01T19:54:04.473914+0000","last_fullsized":"2023-08-01T19:54:04.473914+0000","mapping_epoch":16,"log_start":"0'0","ondisk_log_start":"0'0","created":16,"last_epoch_clean":17,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-08-01T19:54:04.040663+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-08-01T19:54:04.040663+0000","last_clean_scrub_stamp":"2023-08-01T19:54:04.040663+0000","objects_scrubbed":0,"log_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-08-02T22:17:59.847819+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[2,1],"acting":[2,1],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":2,"acting_primary":2,"purged_snaps":[]},{"pgid":"4.23","version":"0'0","reported_seq":9,"reported_epoch":17,"state":"active+clean","last_fresh":"2023-08-01T19:54:04.472334+0000","last_change":"2023-08-01T19:54:04.467847+0000","last_active":"2023-08-01T19:54:04.472334+0000","last_peered":"2023-08-01T19:54:04.472334+0000","last_clean":"2023-08-01T19:54:04.472334+0000","last_became_active":"2023-08-01T19:54:04.467111+0000","last_became_peered":"2023-08-01T19:54:04.467111+0000","last_unstale":"2023-08-01T19:54:04.472334+0000","last_undegraded":"2023-08-01T19:54:04.472334+0000","last_fullsized":"2023-08-01T19:54:04.472334+0000","mapping_epoch":16,"log_start":"0'0","ondisk_log_start":"0'0","created":16,"last_epoch_clean":17,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-08-01T19:54:04.040663+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-08-01T19:54:04.040663+0000","last_clean_scrub_stamp":"2023-08-01T19:54:04.040663+0000","objects_scrubbed":0,"log_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-08-03T00:42:19.379348+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[0,2],"acting":[0,2],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":0,"acting_primary":0,"purged_snaps":[]},{"pgid":"4.24","version":"0'0","reported_seq":9,"reported_epoch":17,"state":"active+clean","last_fresh":"2023-08-01T19:54:04.482540+0000","last_change":"2023-08-01T19:54:04.477128+0000","last_active":"2023-08-01T19:54:04.482540+0000","last_peered":"2023-08-01T19:54:04.482540+0000","last_clean":"2023-08-01T19:54:04.482540+0000","last_became_active":"2023-08-01T19:54:04.476819+0000","last_became_peered":"2023-08-01T19:54:04.476819+0000","last_unstale":"2023-08-01T19:54:04.482540+0000","last_undegraded":"2023-08-01T19:54:04.482540+0000","last_fullsized":"2023-08-01T19:54:04.482540+0000","mapping_epoch":16,"log_start":"0'0","ondisk_log_start":"0'0","created":16,"last_epoch_clean":17,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-08-01T19:54:04.040663+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-08-01T19:54:04.040663+0000","last_clean_scrub_stamp":"2023-08-01T19:54:04.040663+0000","objects_scrubbed":0,"log_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-08-03T02:20:23.354054+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[2,1],"acting":[2,1],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":2,"acting_primary":2,"purged_snaps":[]}],"pool_stats":[{"poolid":4,"num_pg":64,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"store_stats":{"total":0,"available":0,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},"log_size":0,"ondisk_log_size":0,"up":128,"acting":128,"num_store_stats":3},{"poolid":3,"num_pg":32,"stat_sum":{"num_bytes":2306,"num_objects":22,"num_object_clones":0,"num_object_copies":44,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":22,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":45,"num_write_kb":13,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":14,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"store_stats":{"total":0,"available":0,"internally_reserved":0,"allocated":65536,"data_stored":4612,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},"log_size":39,"ondisk_log_size":39,"up":64,"acting":64,"num_store_stats":3},{"poolid":1,"num_pg":1,"stat_sum":{"num_bytes":590368,"num_objects":2,"num_object_clones":0,"num_object_copies":4,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":2,"num_whiteouts":0,"num_read":136,"num_read_kb":118,"num_write":203,"num_write_kb":3460,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"store_stats":{"total":0,"available":0,"internally_reserved":0,"allocated":114688,"data_stored":1180736,"data_compressed":20662,"data_compressed_allocated":73728,"data_compressed_original":1146880,"omap_allocated":0,"internal_metadata":0},"log_size":157,"ondisk_log_size":157,"up":2,"acting":2,"num_store_stats":2},{"poolid":2,"num_pg":8,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"store_stats":{"total":0,"available":0,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},"log_size":0,"ondisk_log_size":0,"up":16,"acting":16,"num_store_stats":3}],"osd_stats":[{"osd":2,"up_from":9,"seq":38654705673,"num_pgs":67,"num_osds":1,"num_per_pool_osds":1,"num_per_pool_omap_osds":1,"kb":94371840,"kb_used":9264,"kb_used_data":232,"kb_used_omap":0,"kb_used_meta":9024,"kb_avail":94362576,"statfs":{"total":96636764160,"available":96627277824,"internally_reserved":0,"allocated":237568,"data_stored":647231,"data_compressed":10331,"data_compressed_allocated":36864,"data_compressed_original":573440,"omap_allocated":0,"internal_metadata":9240576},"hb_peers":[0,1],"snap_trim_queue_len":0,"num_snap_trimming":0,"num_shards_repaired":0,"op_queue_age_hist":{"histogram":[],"upper_bound":1},"perf_stat":{"commit_latency_ms":0,"apply_latency_ms":0,"commit_latency_ns":0,"apply_latency_ns":0},"alerts":[],"network_ping_times":[{"osd":0,"last update":"Thu Jan 1 00:00:00 1970","interfaces":[{"interface":"back","average":{"1min":0,"5min":0,"15min":0},"min":{"1min":0,"5min":0,"15min":0},"max":{"1min":0,"5min":0,"15min":0},"last":0.47699999999999998}]},{"osd":1,"last update":"Thu Jan 1 00:00:00 1970","interfaces":[{"interface":"back","average":{"1min":0,"5min":0,"15min":0},"min":{"1min":0,"5min":0,"15min":0},"max":{"1min":0,"5min":0,"15min":0},"last":0.60299999999999998}]}]},{"osd":0,"up_from":8,"seq":34359738376,"num_pgs":72,"num_osds":1,"num_per_pool_osds":1,"num_per_pool_omap_osds":1,"kb":94371840,"kb_used":12648,"kb_used_data":160,"kb_used_omap":0,"kb_used_meta":12480,"kb_avail":94359192,"statfs":{"total":96636764160,"available":96623812608,"internally_reserved":0,"allocated":163840,"data_stored":55733,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":12779520},"hb_peers":[1,2],"snap_trim_queue_len":0,"num_snap_trimming":0,"num_shards_repaired":0,"op_queue_age_hist":{"histogram":[],"upper_bound":1},"perf_stat":{"commit_latency_ms":0,"apply_latency_ms":0,"commit_latency_ns":0,"apply_latency_ns":0},"alerts":[],"network_ping_times":[{"osd":1,"last update":"Thu Jan 1 00:00:00 1970","interfaces":[{"interface":"back","average":{"1min":0,"5min":0,"15min":0},"min":{"1min":0,"5min":0,"15min":0},"max":{"1min":0,"5min":0,"15min":0},"last":0.501}]},{"osd":2,"last update":"Thu Jan 1 00:00:00 1970","interfaces":[{"interface":"back","average":{"1min":0,"5min":0,"15min":0},"min":{"1min":0,"5min":0,"15min":0},"max":{"1min":0,"5min":0,"15min":0},"last":0.47599999999999998}]}]},{"osd":1,"up_from":8,"seq":34359738375,"num_pgs":71,"num_osds":1,"num_per_pool_osds":1,"num_per_pool_omap_osds":1,"kb":94371840,"kb_used":9336,"kb_used_data":240,"kb_used_omap":0,"kb_used_meta":9088,"kb_avail":94362504,"statfs":{"total":96636764160,"available":96627204096,"internally_reserved":0,"allocated":245760,"data_stored":647819,"data_compressed":10331,"data_compressed_allocated":36864,"data_compressed_original":573440,"omap_allocated":0,"internal_metadata":9306112},"hb_peers":[0,2],"snap_trim_queue_len":0,"num_snap_trimming":0,"num_shards_repaired":0,"op_queue_age_hist":{"histogram":[],"upper_bound":1},"perf_stat":{"commit_latency_ms":0,"apply_latency_ms":0,"commit_latency_ns":0,"apply_latency_ns":0},"alerts":[],"network_ping_times":[{"osd":0,"last update":"Thu Jan 1 00:00:00 1970","interfaces":[{"interface":"back","average":{"1min":0,"5min":0,"15min":0},"min":{"1min":0,"5min":0,"15min":0},"max":{"1min":0,"5min":0,"15min":0},"last":0.47999999999999998}]},{"osd":2,"last update":"Thu Jan 1 00:00:00 1970","interfaces":[{"interface":"back","average":{"1min":0,"5min":0,"15min":0},"min":{"1min":0,"5min":0,"15min":0},"max":{"1min":0,"5min":0,"15min":0},"last":0.51000000000000001}]}]}],"pool_statfs":[{"poolid":1,"osd":1,"total":0,"available":0,"internally_reserved":0,"allocated":57344,"data_stored":590368,"data_compressed":10331,"data_compressed_allocated":36864,"data_compressed_original":573440,"omap_allocated":0,"internal_metadata":0},{"poolid":1,"osd":2,"total":0,"available":0,"internally_reserved":0,"allocated":57344,"data_stored":590368,"data_compressed":10331,"data_compressed_allocated":36864,"data_compressed_original":573440,"omap_allocated":0,"internal_metadata":0},{"poolid":2,"osd":0,"total":0,"available":0,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":2,"osd":1,"total":0,"available":0,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":2,"osd":2,"total":0,"available":0,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":3,"osd":0,"total":0,"available":0,"internally_reserved":0,"allocated":8192,"data_stored":588,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":3,"osd":1,"total":0,"available":0,"internally_reserved":0,"allocated":32768,"data_stored":2306,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":3,"osd":2,"total":0,"available":0,"internally_reserved":0,"allocated":24576,"data_stored":1718,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":4,"osd":0,"total":0,"available":0,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":4,"osd":1,"total":0,"available":0,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":4,"osd":2,"total":0,"available":0,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0}]}} 2023-08-01T19:54:19.477 DEBUG:teuthology.orchestra.run.smithi006:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 120 ceph --cluster ceph pg dump --format=json 2023-08-01T19:54:19.837 INFO:teuthology.orchestra.run.smithi006.stdout: 2023-08-01T19:54:19.838 INFO:teuthology.orchestra.run.smithi006.stderr:dumped all 2023-08-01T19:54:19.849 INFO:teuthology.orchestra.run.smithi006.stdout:{"pg_ready":true,"pg_map":{"version":29,"stamp":"2023-08-01T19:54:17.910453+0000","last_osdmap_epoch":0,"last_pg_scan":0,"pg_stats_sum":{"stat_sum":{"num_bytes":592674,"num_objects":24,"num_object_clones":0,"num_object_copies":48,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":24,"num_whiteouts":0,"num_read":136,"num_read_kb":118,"num_write":248,"num_write_kb":3473,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":14,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"store_stats":{"total":0,"available":0,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},"log_size":196,"ondisk_log_size":196,"up":210,"acting":210,"num_store_stats":0},"osd_stats_sum":{"up_from":0,"seq":0,"num_pgs":210,"num_osds":3,"num_per_pool_osds":3,"num_per_pool_omap_osds":3,"kb":283115520,"kb_used":31248,"kb_used_data":632,"kb_used_omap":0,"kb_used_meta":30592,"kb_avail":283084272,"statfs":{"total":289910292480,"available":289878294528,"internally_reserved":0,"allocated":647168,"data_stored":1350783,"data_compressed":20662,"data_compressed_allocated":73728,"data_compressed_original":1146880,"omap_allocated":0,"internal_metadata":31326208},"hb_peers":[],"snap_trim_queue_len":0,"num_snap_trimming":0,"num_shards_repaired":0,"op_queue_age_hist":{"histogram":[],"upper_bound":1},"perf_stat":{"commit_latency_ms":0,"apply_latency_ms":0,"commit_latency_ns":0,"apply_latency_ns":0},"alerts":[],"network_ping_times":[]},"pg_stats_delta":{"stat_sum":{"num_bytes":90,"num_objects":5,"num_object_clones":0,"num_object_copies":10,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":5,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":11,"num_write_kb":1,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":4,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"store_stats":{"total":0,"available":0,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},"log_size":0,"ondisk_log_size":0,"up":0,"acting":0,"num_store_stats":0,"stamp_delta":"12.002246"},"pg_stats":[{"pgid":"4.3f","version":"0'0","reported_seq":9,"reported_epoch":17,"state":"active+clean","last_fresh":"2023-08-01T19:54:04.477207+0000","last_change":"2023-08-01T19:54:04.473430+0000","last_active":"2023-08-01T19:54:04.477207+0000","last_peered":"2023-08-01T19:54:04.477207+0000","last_clean":"2023-08-01T19:54:04.477207+0000","last_became_active":"2023-08-01T19:54:04.472887+0000","last_became_peered":"2023-08-01T19:54:04.472887+0000","last_unstale":"2023-08-01T19:54:04.477207+0000","last_undegraded":"2023-08-01T19:54:04.477207+0000","last_fullsized":"2023-08-01T19:54:04.477207+0000","mapping_epoch":16,"log_start":"0'0","ondisk_log_start":"0'0","created":16,"last_epoch_clean":17,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-08-01T19:54:04.040663+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-08-01T19:54:04.040663+0000","last_clean_scrub_stamp":"2023-08-01T19:54:04.040663+0000","objects_scrubbed":0,"log_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-08-03T06:38:54.196605+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[2,0],"acting":[2,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":2,"acting_primary":2,"purged_snaps":[]},{"pgid":"4.3e","version":"0'0","reported_seq":9,"reported_epoch":17,"state":"active+clean","last_fresh":"2023-08-01T19:54:04.472547+0000","last_change":"2023-08-01T19:54:04.470501+0000","last_active":"2023-08-01T19:54:04.472547+0000","last_peered":"2023-08-01T19:54:04.472547+0000","last_clean":"2023-08-01T19:54:04.472547+0000","last_became_active":"2023-08-01T19:54:04.469692+0000","last_became_peered":"2023-08-01T19:54:04.469692+0000","last_unstale":"2023-08-01T19:54:04.472547+0000","last_undegraded":"2023-08-01T19:54:04.472547+0000","last_fullsized":"2023-08-01T19:54:04.472547+0000","mapping_epoch":16,"log_start":"0'0","ondisk_log_start":"0'0","created":16,"last_epoch_clean":17,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-08-01T19:54:04.040663+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-08-01T19:54:04.040663+0000","last_clean_scrub_stamp":"2023-08-01T19:54:04.040663+0000","objects_scrubbed":0,"log_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-08-03T02:19:35.201107+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[2,0],"acting":[2,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":2,"acting_primary":2,"purged_snaps":[]},{"pgid":"4.3d","version":"0'0","reported_seq":9,"reported_epoch":17,"state":"active+clean","last_fresh":"2023-08-01T19:54:04.477342+0000","last_change":"2023-08-01T19:54:04.472579+0000","last_active":"2023-08-01T19:54:04.477342+0000","last_peered":"2023-08-01T19:54:04.477342+0000","last_clean":"2023-08-01T19:54:04.477342+0000","last_became_active":"2023-08-01T19:54:04.471128+0000","last_became_peered":"2023-08-01T19:54:04.471128+0000","last_unstale":"2023-08-01T19:54:04.477342+0000","last_undegraded":"2023-08-01T19:54:04.477342+0000","last_fullsized":"2023-08-01T19:54:04.477342+0000","mapping_epoch":16,"log_start":"0'0","ondisk_log_start":"0'0","created":16,"last_epoch_clean":17,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-08-01T19:54:04.040663+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-08-01T19:54:04.040663+0000","last_clean_scrub_stamp":"2023-08-01T19:54:04.040663+0000","objects_scrubbed":0,"log_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-08-03T03:04:06.137335+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[1,2],"acting":[1,2],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":1,"acting_primary":1,"purged_snaps":[]},{"pgid":"4.3c","version":"0'0","reported_seq":9,"reported_epoch":17,"state":"active+clean","last_fresh":"2023-08-01T19:54:04.479161+0000","last_change":"2023-08-01T19:54:04.477908+0000","last_active":"2023-08-01T19:54:04.479161+0000","last_peered":"2023-08-01T19:54:04.479161+0000","last_clean":"2023-08-01T19:54:04.479161+0000","last_became_active":"2023-08-01T19:54:04.476684+0000","last_became_peered":"2023-08-01T19:54:04.476684+0000","last_unstale":"2023-08-01T19:54:04.479161+0000","last_undegraded":"2023-08-01T19:54:04.479161+0000","last_fullsized":"2023-08-01T19:54:04.479161+0000","mapping_epoch":16,"log_start":"0'0","ondisk_log_start":"0'0","created":16,"last_epoch_clean":17,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-08-01T19:54:04.040663+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-08-01T19:54:04.040663+0000","last_clean_scrub_stamp":"2023-08-01T19:54:04.040663+0000","objects_scrubbed":0,"log_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-08-03T03:56:55.336461+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[1,0],"acting":[1,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":1,"acting_primary":1,"purged_snaps":[]},{"pgid":"4.3b","version":"0'0","reported_seq":9,"reported_epoch":17,"state":"active+clean","last_fresh":"2023-08-01T19:54:04.469848+0000","last_change":"2023-08-01T19:54:04.467197+0000","last_active":"2023-08-01T19:54:04.469848+0000","last_peered":"2023-08-01T19:54:04.469848+0000","last_clean":"2023-08-01T19:54:04.469848+0000","last_became_active":"2023-08-01T19:54:04.466526+0000","last_became_peered":"2023-08-01T19:54:04.466526+0000","last_unstale":"2023-08-01T19:54:04.469848+0000","last_undegraded":"2023-08-01T19:54:04.469848+0000","last_fullsized":"2023-08-01T19:54:04.469848+0000","mapping_epoch":16,"log_start":"0'0","ondisk_log_start":"0'0","created":16,"last_epoch_clean":17,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-08-01T19:54:04.040663+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-08-01T19:54:04.040663+0000","last_clean_scrub_stamp":"2023-08-01T19:54:04.040663+0000","objects_scrubbed":0,"log_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-08-03T06:54:18.982174+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[2,0],"acting":[2,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":2,"acting_primary":2,"purged_snaps":[]},{"pgid":"4.3a","version":"0'0","reported_seq":9,"reported_epoch":17,"state":"active+clean","last_fresh":"2023-08-01T19:54:04.477568+0000","last_change":"2023-08-01T19:54:04.473296+0000","last_active":"2023-08-01T19:54:04.477568+0000","last_peered":"2023-08-01T19:54:04.477568+0000","last_clean":"2023-08-01T19:54:04.477568+0000","last_became_active":"2023-08-01T19:54:04.472324+0000","last_became_peered":"2023-08-01T19:54:04.472324+0000","last_unstale":"2023-08-01T19:54:04.477568+0000","last_undegraded":"2023-08-01T19:54:04.477568+0000","last_fullsized":"2023-08-01T19:54:04.477568+0000","mapping_epoch":16,"log_start":"0'0","ondisk_log_start":"0'0","created":16,"last_epoch_clean":17,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-08-01T19:54:04.040663+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-08-01T19:54:04.040663+0000","last_clean_scrub_stamp":"2023-08-01T19:54:04.040663+0000","objects_scrubbed":0,"log_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-08-02T23:15:11.148662+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[1,0],"acting":[1,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":1,"acting_primary":1,"purged_snaps":[]},{"pgid":"4.39","version":"0'0","reported_seq":9,"reported_epoch":17,"state":"active+clean","last_fresh":"2023-08-01T19:54:04.478215+0000","last_change":"2023-08-01T19:54:04.475322+0000","last_active":"2023-08-01T19:54:04.478215+0000","last_peered":"2023-08-01T19:54:04.478215+0000","last_clean":"2023-08-01T19:54:04.478215+0000","last_became_active":"2023-08-01T19:54:04.474591+0000","last_became_peered":"2023-08-01T19:54:04.474591+0000","last_unstale":"2023-08-01T19:54:04.478215+0000","last_undegraded":"2023-08-01T19:54:04.478215+0000","last_fullsized":"2023-08-01T19:54:04.478215+0000","mapping_epoch":16,"log_start":"0'0","ondisk_log_start":"0'0","created":16,"last_epoch_clean":17,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-08-01T19:54:04.040663+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-08-01T19:54:04.040663+0000","last_clean_scrub_stamp":"2023-08-01T19:54:04.040663+0000","objects_scrubbed":0,"log_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-08-03T00:29:53.554989+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[1,0],"acting":[1,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":1,"acting_primary":1,"purged_snaps":[]},{"pgid":"4.38","version":"0'0","reported_seq":9,"reported_epoch":17,"state":"active+clean","last_fresh":"2023-08-01T19:54:04.479227+0000","last_change":"2023-08-01T19:54:04.478505+0000","last_active":"2023-08-01T19:54:04.479227+0000","last_peered":"2023-08-01T19:54:04.479227+0000","last_clean":"2023-08-01T19:54:04.479227+0000","last_became_active":"2023-08-01T19:54:04.477325+0000","last_became_peered":"2023-08-01T19:54:04.477325+0000","last_unstale":"2023-08-01T19:54:04.479227+0000","last_undegraded":"2023-08-01T19:54:04.479227+0000","last_fullsized":"2023-08-01T19:54:04.479227+0000","mapping_epoch":16,"log_start":"0'0","ondisk_log_start":"0'0","created":16,"last_epoch_clean":17,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-08-01T19:54:04.040663+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-08-01T19:54:04.040663+0000","last_clean_scrub_stamp":"2023-08-01T19:54:04.040663+0000","objects_scrubbed":0,"log_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-08-03T01:38:12.939736+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[1,0],"acting":[1,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":1,"acting_primary":1,"purged_snaps":[]},{"pgid":"4.37","version":"0'0","reported_seq":9,"reported_epoch":17,"state":"active+clean","last_fresh":"2023-08-01T19:54:04.472944+0000","last_change":"2023-08-01T19:54:04.470971+0000","last_active":"2023-08-01T19:54:04.472944+0000","last_peered":"2023-08-01T19:54:04.472944+0000","last_clean":"2023-08-01T19:54:04.472944+0000","last_became_active":"2023-08-01T19:54:04.469011+0000","last_became_peered":"2023-08-01T19:54:04.469011+0000","last_unstale":"2023-08-01T19:54:04.472944+0000","last_undegraded":"2023-08-01T19:54:04.472944+0000","last_fullsized":"2023-08-01T19:54:04.472944+0000","mapping_epoch":16,"log_start":"0'0","ondisk_log_start":"0'0","created":16,"last_epoch_clean":17,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-08-01T19:54:04.040663+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-08-01T19:54:04.040663+0000","last_clean_scrub_stamp":"2023-08-01T19:54:04.040663+0000","objects_scrubbed":0,"log_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-08-03T06:50:03.420334+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[0,2],"acting":[0,2],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":0,"acting_primary":0,"purged_snaps":[]},{"pgid":"4.36","version":"0'0","reported_seq":9,"reported_epoch":17,"state":"active+clean","last_fresh":"2023-08-01T19:54:04.477220+0000","last_change":"2023-08-01T19:54:04.473523+0000","last_active":"2023-08-01T19:54:04.477220+0000","last_peered":"2023-08-01T19:54:04.477220+0000","last_clean":"2023-08-01T19:54:04.477220+0000","last_became_active":"2023-08-01T19:54:04.473084+0000","last_became_peered":"2023-08-01T19:54:04.473084+0000","last_unstale":"2023-08-01T19:54:04.477220+0000","last_undegraded":"2023-08-01T19:54:04.477220+0000","last_fullsized":"2023-08-01T19:54:04.477220+0000","mapping_epoch":16,"log_start":"0'0","ondisk_log_start":"0'0","created":16,"last_epoch_clean":17,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-08-01T19:54:04.040663+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-08-01T19:54:04.040663+0000","last_clean_scrub_stamp":"2023-08-01T19:54:04.040663+0000","objects_scrubbed":0,"log_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-08-03T04:28:59.042443+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[2,0],"acting":[2,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":2,"acting_primary":2,"purged_snaps":[]},{"pgid":"4.35","version":"0'0","reported_seq":9,"reported_epoch":17,"state":"active+clean","last_fresh":"2023-08-01T19:54:04.478818+0000","last_change":"2023-08-01T19:54:04.475816+0000","last_active":"2023-08-01T19:54:04.478818+0000","last_peered":"2023-08-01T19:54:04.478818+0000","last_clean":"2023-08-01T19:54:04.478818+0000","last_became_active":"2023-08-01T19:54:04.475061+0000","last_became_peered":"2023-08-01T19:54:04.475061+0000","last_unstale":"2023-08-01T19:54:04.478818+0000","last_undegraded":"2023-08-01T19:54:04.478818+0000","last_fullsized":"2023-08-01T19:54:04.478818+0000","mapping_epoch":16,"log_start":"0'0","ondisk_log_start":"0'0","created":16,"last_epoch_clean":17,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-08-01T19:54:04.040663+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-08-01T19:54:04.040663+0000","last_clean_scrub_stamp":"2023-08-01T19:54:04.040663+0000","objects_scrubbed":0,"log_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-08-02T22:07:41.305488+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[1,0],"acting":[1,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":1,"acting_primary":1,"purged_snaps":[]},{"pgid":"4.34","version":"0'0","reported_seq":9,"reported_epoch":17,"state":"active+clean","last_fresh":"2023-08-01T19:54:04.470323+0000","last_change":"2023-08-01T19:54:04.468009+0000","last_active":"2023-08-01T19:54:04.470323+0000","last_peered":"2023-08-01T19:54:04.470323+0000","last_clean":"2023-08-01T19:54:04.470323+0000","last_became_active":"2023-08-01T19:54:04.467568+0000","last_became_peered":"2023-08-01T19:54:04.467568+0000","last_unstale":"2023-08-01T19:54:04.470323+0000","last_undegraded":"2023-08-01T19:54:04.470323+0000","last_fullsized":"2023-08-01T19:54:04.470323+0000","mapping_epoch":16,"log_start":"0'0","ondisk_log_start":"0'0","created":16,"last_epoch_clean":17,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-08-01T19:54:04.040663+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-08-01T19:54:04.040663+0000","last_clean_scrub_stamp":"2023-08-01T19:54:04.040663+0000","objects_scrubbed":0,"log_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-08-03T04:53:44.017572+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[2,1],"acting":[2,1],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":2,"acting_primary":2,"purged_snaps":[]},{"pgid":"4.33","version":"0'0","reported_seq":9,"reported_epoch":17,"state":"active+clean","last_fresh":"2023-08-01T19:54:04.468611+0000","last_change":"2023-08-01T19:54:04.466770+0000","last_active":"2023-08-01T19:54:04.468611+0000","last_peered":"2023-08-01T19:54:04.468611+0000","last_clean":"2023-08-01T19:54:04.468611+0000","last_became_active":"2023-08-01T19:54:04.466460+0000","last_became_peered":"2023-08-01T19:54:04.466460+0000","last_unstale":"2023-08-01T19:54:04.468611+0000","last_undegraded":"2023-08-01T19:54:04.468611+0000","last_fullsized":"2023-08-01T19:54:04.468611+0000","mapping_epoch":16,"log_start":"0'0","ondisk_log_start":"0'0","created":16,"last_epoch_clean":17,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-08-01T19:54:04.040663+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-08-01T19:54:04.040663+0000","last_clean_scrub_stamp":"2023-08-01T19:54:04.040663+0000","objects_scrubbed":0,"log_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-08-03T06:04:11.595951+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[2,0],"acting":[2,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":2,"acting_primary":2,"purged_snaps":[]},{"pgid":"4.32","version":"0'0","reported_seq":9,"reported_epoch":17,"state":"active+clean","last_fresh":"2023-08-01T19:54:04.469801+0000","last_change":"2023-08-01T19:54:04.466634+0000","last_active":"2023-08-01T19:54:04.469801+0000","last_peered":"2023-08-01T19:54:04.469801+0000","last_clean":"2023-08-01T19:54:04.469801+0000","last_became_active":"2023-08-01T19:54:04.466302+0000","last_became_peered":"2023-08-01T19:54:04.466302+0000","last_unstale":"2023-08-01T19:54:04.469801+0000","last_undegraded":"2023-08-01T19:54:04.469801+0000","last_fullsized":"2023-08-01T19:54:04.469801+0000","mapping_epoch":16,"log_start":"0'0","ondisk_log_start":"0'0","created":16,"last_epoch_clean":17,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-08-01T19:54:04.040663+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-08-01T19:54:04.040663+0000","last_clean_scrub_stamp":"2023-08-01T19:54:04.040663+0000","objects_scrubbed":0,"log_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-08-03T05:46:11.085577+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[1,2],"acting":[1,2],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":1,"acting_primary":1,"purged_snaps":[]},{"pgid":"4.31","version":"0'0","reported_seq":9,"reported_epoch":17,"state":"active+clean","last_fresh":"2023-08-01T19:54:04.476575+0000","last_change":"2023-08-01T19:54:04.472407+0000","last_active":"2023-08-01T19:54:04.476575+0000","last_peered":"2023-08-01T19:54:04.476575+0000","last_clean":"2023-08-01T19:54:04.476575+0000","last_became_active":"2023-08-01T19:54:04.472008+0000","last_became_peered":"2023-08-01T19:54:04.472008+0000","last_unstale":"2023-08-01T19:54:04.476575+0000","last_undegraded":"2023-08-01T19:54:04.476575+0000","last_fullsized":"2023-08-01T19:54:04.476575+0000","mapping_epoch":16,"log_start":"0'0","ondisk_log_start":"0'0","created":16,"last_epoch_clean":17,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-08-01T19:54:04.040663+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-08-01T19:54:04.040663+0000","last_clean_scrub_stamp":"2023-08-01T19:54:04.040663+0000","objects_scrubbed":0,"log_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-08-02T22:42:25.293502+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[1,2],"acting":[1,2],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":1,"acting_primary":1,"purged_snaps":[]},{"pgid":"4.30","version":"0'0","reported_seq":9,"reported_epoch":17,"state":"active+clean","last_fresh":"2023-08-01T19:54:04.479184+0000","last_change":"2023-08-01T19:54:04.478283+0000","last_active":"2023-08-01T19:54:04.479184+0000","last_peered":"2023-08-01T19:54:04.479184+0000","last_clean":"2023-08-01T19:54:04.479184+0000","last_became_active":"2023-08-01T19:54:04.476620+0000","last_became_peered":"2023-08-01T19:54:04.476620+0000","last_unstale":"2023-08-01T19:54:04.479184+0000","last_undegraded":"2023-08-01T19:54:04.479184+0000","last_fullsized":"2023-08-01T19:54:04.479184+0000","mapping_epoch":16,"log_start":"0'0","ondisk_log_start":"0'0","created":16,"last_epoch_clean":17,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-08-01T19:54:04.040663+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-08-01T19:54:04.040663+0000","last_clean_scrub_stamp":"2023-08-01T19:54:04.040663+0000","objects_scrubbed":0,"log_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-08-03T02:27:17.063518+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[1,0],"acting":[1,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":1,"acting_primary":1,"purged_snaps":[]},{"pgid":"4.2f","version":"0'0","reported_seq":9,"reported_epoch":17,"state":"active+clean","last_fresh":"2023-08-01T19:54:04.472916+0000","last_change":"2023-08-01T19:54:04.470302+0000","last_active":"2023-08-01T19:54:04.472916+0000","last_peered":"2023-08-01T19:54:04.472916+0000","last_clean":"2023-08-01T19:54:04.472916+0000","last_became_active":"2023-08-01T19:54:04.468919+0000","last_became_peered":"2023-08-01T19:54:04.468919+0000","last_unstale":"2023-08-01T19:54:04.472916+0000","last_undegraded":"2023-08-01T19:54:04.472916+0000","last_fullsized":"2023-08-01T19:54:04.472916+0000","mapping_epoch":16,"log_start":"0'0","ondisk_log_start":"0'0","created":16,"last_epoch_clean":17,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-08-01T19:54:04.040663+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-08-01T19:54:04.040663+0000","last_clean_scrub_stamp":"2023-08-01T19:54:04.040663+0000","objects_scrubbed":0,"log_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-08-02T22:42:25.293502+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[0,2],"acting":[0,2],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":0,"acting_primary":0,"purged_snaps":[]},{"pgid":"4.2e","version":"0'0","reported_seq":9,"reported_epoch":17,"state":"active+clean","last_fresh":"2023-08-01T19:54:04.477303+0000","last_change":"2023-08-01T19:54:04.474058+0000","last_active":"2023-08-01T19:54:04.477303+0000","last_peered":"2023-08-01T19:54:04.477303+0000","last_clean":"2023-08-01T19:54:04.477303+0000","last_became_active":"2023-08-01T19:54:04.473355+0000","last_became_peered":"2023-08-01T19:54:04.473355+0000","last_unstale":"2023-08-01T19:54:04.477303+0000","last_undegraded":"2023-08-01T19:54:04.477303+0000","last_fullsized":"2023-08-01T19:54:04.477303+0000","mapping_epoch":16,"log_start":"0'0","ondisk_log_start":"0'0","created":16,"last_epoch_clean":17,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-08-01T19:54:04.040663+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-08-01T19:54:04.040663+0000","last_clean_scrub_stamp":"2023-08-01T19:54:04.040663+0000","objects_scrubbed":0,"log_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-08-03T04:55:54.197252+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[2,0],"acting":[2,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":2,"acting_primary":2,"purged_snaps":[]},{"pgid":"4.2d","version":"0'0","reported_seq":9,"reported_epoch":17,"state":"active+clean","last_fresh":"2023-08-01T19:54:04.472287+0000","last_change":"2023-08-01T19:54:04.468775+0000","last_active":"2023-08-01T19:54:04.472287+0000","last_peered":"2023-08-01T19:54:04.472287+0000","last_clean":"2023-08-01T19:54:04.472287+0000","last_became_active":"2023-08-01T19:54:04.467274+0000","last_became_peered":"2023-08-01T19:54:04.467274+0000","last_unstale":"2023-08-01T19:54:04.472287+0000","last_undegraded":"2023-08-01T19:54:04.472287+0000","last_fullsized":"2023-08-01T19:54:04.472287+0000","mapping_epoch":16,"log_start":"0'0","ondisk_log_start":"0'0","created":16,"last_epoch_clean":17,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-08-01T19:54:04.040663+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-08-01T19:54:04.040663+0000","last_clean_scrub_stamp":"2023-08-01T19:54:04.040663+0000","objects_scrubbed":0,"log_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-08-02T23:00:37.537286+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[0,2],"acting":[0,2],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":0,"acting_primary":0,"purged_snaps":[]},{"pgid":"4.2c","version":"0'0","reported_seq":9,"reported_epoch":17,"state":"active+clean","last_fresh":"2023-08-01T19:54:04.479196+0000","last_change":"2023-08-01T19:54:04.478409+0000","last_active":"2023-08-01T19:54:04.479196+0000","last_peered":"2023-08-01T19:54:04.479196+0000","last_clean":"2023-08-01T19:54:04.479196+0000","last_became_active":"2023-08-01T19:54:04.477133+0000","last_became_peered":"2023-08-01T19:54:04.477133+0000","last_unstale":"2023-08-01T19:54:04.479196+0000","last_undegraded":"2023-08-01T19:54:04.479196+0000","last_fullsized":"2023-08-01T19:54:04.479196+0000","mapping_epoch":16,"log_start":"0'0","ondisk_log_start":"0'0","created":16,"last_epoch_clean":17,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-08-01T19:54:04.040663+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-08-01T19:54:04.040663+0000","last_clean_scrub_stamp":"2023-08-01T19:54:04.040663+0000","objects_scrubbed":0,"log_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-08-02T22:15:19.744281+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[1,0],"acting":[1,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":1,"acting_primary":1,"purged_snaps":[]},{"pgid":"4.2b","version":"0'0","reported_seq":9,"reported_epoch":17,"state":"active+clean","last_fresh":"2023-08-01T19:54:04.477876+0000","last_change":"2023-08-01T19:54:04.474047+0000","last_active":"2023-08-01T19:54:04.477876+0000","last_peered":"2023-08-01T19:54:04.477876+0000","last_clean":"2023-08-01T19:54:04.477876+0000","last_became_active":"2023-08-01T19:54:04.473578+0000","last_became_peered":"2023-08-01T19:54:04.473578+0000","last_unstale":"2023-08-01T19:54:04.477876+0000","last_undegraded":"2023-08-01T19:54:04.477876+0000","last_fullsized":"2023-08-01T19:54:04.477876+0000","mapping_epoch":16,"log_start":"0'0","ondisk_log_start":"0'0","created":16,"last_epoch_clean":17,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-08-01T19:54:04.040663+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-08-01T19:54:04.040663+0000","last_clean_scrub_stamp":"2023-08-01T19:54:04.040663+0000","objects_scrubbed":0,"log_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-08-03T05:39:29.199142+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[1,0],"acting":[1,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":1,"acting_primary":1,"purged_snaps":[]},{"pgid":"4.2a","version":"0'0","reported_seq":9,"reported_epoch":17,"state":"active+clean","last_fresh":"2023-08-01T19:54:04.470833+0000","last_change":"2023-08-01T19:54:04.469281+0000","last_active":"2023-08-01T19:54:04.470833+0000","last_peered":"2023-08-01T19:54:04.470833+0000","last_clean":"2023-08-01T19:54:04.470833+0000","last_became_active":"2023-08-01T19:54:04.468771+0000","last_became_peered":"2023-08-01T19:54:04.468771+0000","last_unstale":"2023-08-01T19:54:04.470833+0000","last_undegraded":"2023-08-01T19:54:04.470833+0000","last_fullsized":"2023-08-01T19:54:04.470833+0000","mapping_epoch":16,"log_start":"0'0","ondisk_log_start":"0'0","created":16,"last_epoch_clean":17,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-08-01T19:54:04.040663+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-08-01T19:54:04.040663+0000","last_clean_scrub_stamp":"2023-08-01T19:54:04.040663+0000","objects_scrubbed":0,"log_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-08-03T01:15:27.748810+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[2,1],"acting":[2,1],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":2,"acting_primary":2,"purged_snaps":[]},{"pgid":"4.29","version":"0'0","reported_seq":9,"reported_epoch":17,"state":"active+clean","last_fresh":"2023-08-01T19:54:04.471410+0000","last_change":"2023-08-01T19:54:04.466694+0000","last_active":"2023-08-01T19:54:04.471410+0000","last_peered":"2023-08-01T19:54:04.471410+0000","last_clean":"2023-08-01T19:54:04.471410+0000","last_became_active":"2023-08-01T19:54:04.466250+0000","last_became_peered":"2023-08-01T19:54:04.466250+0000","last_unstale":"2023-08-01T19:54:04.471410+0000","last_undegraded":"2023-08-01T19:54:04.471410+0000","last_fullsized":"2023-08-01T19:54:04.471410+0000","mapping_epoch":16,"log_start":"0'0","ondisk_log_start":"0'0","created":16,"last_epoch_clean":17,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-08-01T19:54:04.040663+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-08-01T19:54:04.040663+0000","last_clean_scrub_stamp":"2023-08-01T19:54:04.040663+0000","objects_scrubbed":0,"log_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-08-03T01:00:18.725898+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[0,1],"acting":[0,1],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":0,"acting_primary":0,"purged_snaps":[]},{"pgid":"4.28","version":"0'0","reported_seq":9,"reported_epoch":17,"state":"active+clean","last_fresh":"2023-08-01T19:54:04.470337+0000","last_change":"2023-08-01T19:54:04.468160+0000","last_active":"2023-08-01T19:54:04.470337+0000","last_peered":"2023-08-01T19:54:04.470337+0000","last_clean":"2023-08-01T19:54:04.470337+0000","last_became_active":"2023-08-01T19:54:04.467625+0000","last_became_peered":"2023-08-01T19:54:04.467625+0000","last_unstale":"2023-08-01T19:54:04.470337+0000","last_undegraded":"2023-08-01T19:54:04.470337+0000","last_fullsized":"2023-08-01T19:54:04.470337+0000","mapping_epoch":16,"log_start":"0'0","ondisk_log_start":"0'0","created":16,"last_epoch_clean":17,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-08-01T19:54:04.040663+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-08-01T19:54:04.040663+0000","last_clean_scrub_stamp":"2023-08-01T19:54:04.040663+0000","objects_scrubbed":0,"log_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-08-02T21:27:52.506153+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[2,0],"acting":[2,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":2,"acting_primary":2,"purged_snaps":[]},{"pgid":"4.27","version":"0'0","reported_seq":9,"reported_epoch":17,"state":"active+clean","last_fresh":"2023-08-01T19:54:04.470777+0000","last_change":"2023-08-01T19:54:04.469187+0000","last_active":"2023-08-01T19:54:04.470777+0000","last_peered":"2023-08-01T19:54:04.470777+0000","last_clean":"2023-08-01T19:54:04.470777+0000","last_became_active":"2023-08-01T19:54:04.468628+0000","last_became_peered":"2023-08-01T19:54:04.468628+0000","last_unstale":"2023-08-01T19:54:04.470777+0000","last_undegraded":"2023-08-01T19:54:04.470777+0000","last_fullsized":"2023-08-01T19:54:04.470777+0000","mapping_epoch":16,"log_start":"0'0","ondisk_log_start":"0'0","created":16,"last_epoch_clean":17,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-08-01T19:54:04.040663+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-08-01T19:54:04.040663+0000","last_clean_scrub_stamp":"2023-08-01T19:54:04.040663+0000","objects_scrubbed":0,"log_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-08-03T00:07:29.565677+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[2,1],"acting":[2,1],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":2,"acting_primary":2,"purged_snaps":[]},{"pgid":"4.26","version":"0'0","reported_seq":9,"reported_epoch":17,"state":"active+clean","last_fresh":"2023-08-01T19:54:04.472976+0000","last_change":"2023-08-01T19:54:04.470942+0000","last_active":"2023-08-01T19:54:04.472976+0000","last_peered":"2023-08-01T19:54:04.472976+0000","last_clean":"2023-08-01T19:54:04.472976+0000","last_became_active":"2023-08-01T19:54:04.470564+0000","last_became_peered":"2023-08-01T19:54:04.470564+0000","last_unstale":"2023-08-01T19:54:04.472976+0000","last_undegraded":"2023-08-01T19:54:04.472976+0000","last_fullsized":"2023-08-01T19:54:04.472976+0000","mapping_epoch":16,"log_start":"0'0","ondisk_log_start":"0'0","created":16,"last_epoch_clean":17,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-08-01T19:54:04.040663+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-08-01T19:54:04.040663+0000","last_clean_scrub_stamp":"2023-08-01T19:54:04.040663+0000","objects_scrubbed":0,"log_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-08-03T04:43:21.408174+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[0,1],"acting":[0,1],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":0,"acting_primary":0,"purged_snaps":[]},{"pgid":"4.25","version":"0'0","reported_seq":9,"reported_epoch":17,"state":"active+clean","last_fresh":"2023-08-01T19:54:04.478117+0000","last_change":"2023-08-01T19:54:04.474813+0000","last_active":"2023-08-01T19:54:04.478117+0000","last_peered":"2023-08-01T19:54:04.478117+0000","last_clean":"2023-08-01T19:54:04.478117+0000","last_became_active":"2023-08-01T19:54:04.472530+0000","last_became_peered":"2023-08-01T19:54:04.472530+0000","last_unstale":"2023-08-01T19:54:04.478117+0000","last_undegraded":"2023-08-01T19:54:04.478117+0000","last_fullsized":"2023-08-01T19:54:04.478117+0000","mapping_epoch":16,"log_start":"0'0","ondisk_log_start":"0'0","created":16,"last_epoch_clean":17,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-08-01T19:54:04.040663+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-08-01T19:54:04.040663+0000","last_clean_scrub_stamp":"2023-08-01T19:54:04.040663+0000","objects_scrubbed":0,"log_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-08-03T01:00:18.725898+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[1,2],"acting":[1,2],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":1,"acting_primary":1,"purged_snaps":[]},{"pgid":"3.1a","version":"17'1","reported_seq":11,"reported_epoch":17,"state":"active+clean","last_fresh":"2023-08-01T19:54:04.473081+0000","last_change":"2023-08-01T19:54:04.063936+0000","last_active":"2023-08-01T19:54:04.473081+0000","last_peered":"2023-08-01T19:54:04.473081+0000","last_clean":"2023-08-01T19:54:04.473081+0000","last_became_active":"2023-08-01T19:54:04.063674+0000","last_became_peered":"2023-08-01T19:54:04.063674+0000","last_unstale":"2023-08-01T19:54:04.473081+0000","last_undegraded":"2023-08-01T19:54:04.473081+0000","last_fullsized":"2023-08-01T19:54:04.473081+0000","mapping_epoch":15,"log_start":"0'0","ondisk_log_start":"0'0","created":15,"last_epoch_clean":16,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-08-01T19:54:03.032665+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-08-01T19:54:03.032665+0000","last_clean_scrub_stamp":"2023-08-01T19:54:03.032665+0000","objects_scrubbed":0,"log_size":1,"ondisk_log_size":1,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-08-03T00:06:00.058200+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[2,0],"acting":[2,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":2,"acting_primary":2,"purged_snaps":[]},{"pgid":"4.1d","version":"0'0","reported_seq":9,"reported_epoch":17,"state":"active+clean","last_fresh":"2023-08-01T19:54:04.474051+0000","last_change":"2023-08-01T19:54:04.471916+0000","last_active":"2023-08-01T19:54:04.474051+0000","last_peered":"2023-08-01T19:54:04.474051+0000","last_clean":"2023-08-01T19:54:04.474051+0000","last_became_active":"2023-08-01T19:54:04.471480+0000","last_became_peered":"2023-08-01T19:54:04.471480+0000","last_unstale":"2023-08-01T19:54:04.474051+0000","last_undegraded":"2023-08-01T19:54:04.474051+0000","last_fullsized":"2023-08-01T19:54:04.474051+0000","mapping_epoch":16,"log_start":"0'0","ondisk_log_start":"0'0","created":16,"last_epoch_clean":17,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-08-01T19:54:04.040663+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-08-01T19:54:04.040663+0000","last_clean_scrub_stamp":"2023-08-01T19:54:04.040663+0000","objects_scrubbed":0,"log_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-08-02T21:19:17.547590+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[2,1],"acting":[2,1],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":2,"acting_primary":2,"purged_snaps":[]},{"pgid":"3.19","version":"0'0","reported_seq":10,"reported_epoch":17,"state":"active+clean","last_fresh":"2023-08-01T19:54:04.458649+0000","last_change":"2023-08-01T19:54:04.067837+0000","last_active":"2023-08-01T19:54:04.458649+0000","last_peered":"2023-08-01T19:54:04.458649+0000","last_clean":"2023-08-01T19:54:04.458649+0000","last_became_active":"2023-08-01T19:54:04.067535+0000","last_became_peered":"2023-08-01T19:54:04.067535+0000","last_unstale":"2023-08-01T19:54:04.458649+0000","last_undegraded":"2023-08-01T19:54:04.458649+0000","last_fullsized":"2023-08-01T19:54:04.458649+0000","mapping_epoch":15,"log_start":"0'0","ondisk_log_start":"0'0","created":15,"last_epoch_clean":16,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-08-01T19:54:03.032665+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-08-01T19:54:03.032665+0000","last_clean_scrub_stamp":"2023-08-01T19:54:03.032665+0000","objects_scrubbed":0,"log_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-08-02T20:56:47.324761+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[0,1],"acting":[0,1],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":0,"acting_primary":0,"purged_snaps":[]},{"pgid":"4.1e","version":"0'0","reported_seq":9,"reported_epoch":17,"state":"active+clean","last_fresh":"2023-08-01T19:54:04.472940+0000","last_change":"2023-08-01T19:54:04.470544+0000","last_active":"2023-08-01T19:54:04.472940+0000","last_peered":"2023-08-01T19:54:04.472940+0000","last_clean":"2023-08-01T19:54:04.472940+0000","last_became_active":"2023-08-01T19:54:04.469657+0000","last_became_peered":"2023-08-01T19:54:04.469657+0000","last_unstale":"2023-08-01T19:54:04.472940+0000","last_undegraded":"2023-08-01T19:54:04.472940+0000","last_fullsized":"2023-08-01T19:54:04.472940+0000","mapping_epoch":16,"log_start":"0'0","ondisk_log_start":"0'0","created":16,"last_epoch_clean":17,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-08-01T19:54:04.040663+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-08-01T19:54:04.040663+0000","last_clean_scrub_stamp":"2023-08-01T19:54:04.040663+0000","objects_scrubbed":0,"log_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-08-02T23:12:30.830199+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[0,1],"acting":[0,1],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":0,"acting_primary":0,"purged_snaps":[]},{"pgid":"3.18","version":"0'0","reported_seq":10,"reported_epoch":17,"state":"active+clean","last_fresh":"2023-08-01T19:54:04.458389+0000","last_change":"2023-08-01T19:54:04.064289+0000","last_active":"2023-08-01T19:54:04.458389+0000","last_peered":"2023-08-01T19:54:04.458389+0000","last_clean":"2023-08-01T19:54:04.458389+0000","last_became_active":"2023-08-01T19:54:04.063971+0000","last_became_peered":"2023-08-01T19:54:04.063971+0000","last_unstale":"2023-08-01T19:54:04.458389+0000","last_undegraded":"2023-08-01T19:54:04.458389+0000","last_fullsized":"2023-08-01T19:54:04.458389+0000","mapping_epoch":15,"log_start":"0'0","ondisk_log_start":"0'0","created":15,"last_epoch_clean":16,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-08-01T19:54:03.032665+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-08-01T19:54:03.032665+0000","last_clean_scrub_stamp":"2023-08-01T19:54:03.032665+0000","objects_scrubbed":0,"log_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-08-03T04:09:30.496098+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[0,2],"acting":[0,2],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":0,"acting_primary":0,"purged_snaps":[]},{"pgid":"4.1f","version":"0'0","reported_seq":9,"reported_epoch":17,"state":"active+clean","last_fresh":"2023-08-01T19:54:04.474406+0000","last_change":"2023-08-01T19:54:04.472227+0000","last_active":"2023-08-01T19:54:04.474406+0000","last_peered":"2023-08-01T19:54:04.474406+0000","last_clean":"2023-08-01T19:54:04.474406+0000","last_became_active":"2023-08-01T19:54:04.471767+0000","last_became_peered":"2023-08-01T19:54:04.471767+0000","last_unstale":"2023-08-01T19:54:04.474406+0000","last_undegraded":"2023-08-01T19:54:04.474406+0000","last_fullsized":"2023-08-01T19:54:04.474406+0000","mapping_epoch":16,"log_start":"0'0","ondisk_log_start":"0'0","created":16,"last_epoch_clean":17,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-08-01T19:54:04.040663+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-08-01T19:54:04.040663+0000","last_clean_scrub_stamp":"2023-08-01T19:54:04.040663+0000","objects_scrubbed":0,"log_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-08-02T20:25:25.280329+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[2,1],"acting":[2,1],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":2,"acting_primary":2,"purged_snaps":[]},{"pgid":"3.17","version":"0'0","reported_seq":10,"reported_epoch":17,"state":"active+clean","last_fresh":"2023-08-01T19:54:04.462845+0000","last_change":"2023-08-01T19:54:04.067975+0000","last_active":"2023-08-01T19:54:04.462845+0000","last_peered":"2023-08-01T19:54:04.462845+0000","last_clean":"2023-08-01T19:54:04.462845+0000","last_became_active":"2023-08-01T19:54:04.067577+0000","last_became_peered":"2023-08-01T19:54:04.067577+0000","last_unstale":"2023-08-01T19:54:04.462845+0000","last_undegraded":"2023-08-01T19:54:04.462845+0000","last_fullsized":"2023-08-01T19:54:04.462845+0000","mapping_epoch":15,"log_start":"0'0","ondisk_log_start":"0'0","created":15,"last_epoch_clean":16,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-08-01T19:54:03.032665+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-08-01T19:54:03.032665+0000","last_clean_scrub_stamp":"2023-08-01T19:54:03.032665+0000","objects_scrubbed":0,"log_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-08-03T07:13:34.025722+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[0,1],"acting":[0,1],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":0,"acting_primary":0,"purged_snaps":[]},{"pgid":"4.10","version":"0'0","reported_seq":9,"reported_epoch":17,"state":"active+clean","last_fresh":"2023-08-01T19:54:04.472075+0000","last_change":"2023-08-01T19:54:04.467146+0000","last_active":"2023-08-01T19:54:04.472075+0000","last_peered":"2023-08-01T19:54:04.472075+0000","last_clean":"2023-08-01T19:54:04.472075+0000","last_became_active":"2023-08-01T19:54:04.466627+0000","last_became_peered":"2023-08-01T19:54:04.466627+0000","last_unstale":"2023-08-01T19:54:04.472075+0000","last_undegraded":"2023-08-01T19:54:04.472075+0000","last_fullsized":"2023-08-01T19:54:04.472075+0000","mapping_epoch":16,"log_start":"0'0","ondisk_log_start":"0'0","created":16,"last_epoch_clean":17,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-08-01T19:54:04.040663+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-08-01T19:54:04.040663+0000","last_clean_scrub_stamp":"2023-08-01T19:54:04.040663+0000","objects_scrubbed":0,"log_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-08-03T04:43:26.793480+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[0,2],"acting":[0,2],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":0,"acting_primary":0,"purged_snaps":[]},{"pgid":"3.16","version":"0'0","reported_seq":10,"reported_epoch":17,"state":"active+clean","last_fresh":"2023-08-01T19:54:04.468390+0000","last_change":"2023-08-01T19:54:04.065042+0000","last_active":"2023-08-01T19:54:04.468390+0000","last_peered":"2023-08-01T19:54:04.468390+0000","last_clean":"2023-08-01T19:54:04.468390+0000","last_became_active":"2023-08-01T19:54:04.064040+0000","last_became_peered":"2023-08-01T19:54:04.064040+0000","last_unstale":"2023-08-01T19:54:04.468390+0000","last_undegraded":"2023-08-01T19:54:04.468390+0000","last_fullsized":"2023-08-01T19:54:04.468390+0000","mapping_epoch":15,"log_start":"0'0","ondisk_log_start":"0'0","created":15,"last_epoch_clean":16,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-08-01T19:54:03.032665+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-08-01T19:54:03.032665+0000","last_clean_scrub_stamp":"2023-08-01T19:54:03.032665+0000","objects_scrubbed":0,"log_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-08-03T03:40:43.460182+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[1,0],"acting":[1,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":1,"acting_primary":1,"purged_snaps":[]},{"pgid":"4.11","version":"0'0","reported_seq":9,"reported_epoch":17,"state":"active+clean","last_fresh":"2023-08-01T19:54:04.472823+0000","last_change":"2023-08-01T19:54:04.470401+0000","last_active":"2023-08-01T19:54:04.472823+0000","last_peered":"2023-08-01T19:54:04.472823+0000","last_clean":"2023-08-01T19:54:04.472823+0000","last_became_active":"2023-08-01T19:54:04.469680+0000","last_became_peered":"2023-08-01T19:54:04.469680+0000","last_unstale":"2023-08-01T19:54:04.472823+0000","last_undegraded":"2023-08-01T19:54:04.472823+0000","last_fullsized":"2023-08-01T19:54:04.472823+0000","mapping_epoch":16,"log_start":"0'0","ondisk_log_start":"0'0","created":16,"last_epoch_clean":17,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-08-01T19:54:04.040663+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-08-01T19:54:04.040663+0000","last_clean_scrub_stamp":"2023-08-01T19:54:04.040663+0000","objects_scrubbed":0,"log_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-08-03T03:58:06.360840+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[0,1],"acting":[0,1],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":0,"acting_primary":0,"purged_snaps":[]},{"pgid":"3.15","version":"17'3","reported_seq":13,"reported_epoch":17,"state":"active+clean","last_fresh":"2023-08-01T19:54:04.471749+0000","last_change":"2023-08-01T19:54:04.065443+0000","last_active":"2023-08-01T19:54:04.471749+0000","last_peered":"2023-08-01T19:54:04.471749+0000","last_clean":"2023-08-01T19:54:04.471749+0000","last_became_active":"2023-08-01T19:54:04.065112+0000","last_became_peered":"2023-08-01T19:54:04.065112+0000","last_unstale":"2023-08-01T19:54:04.471749+0000","last_undegraded":"2023-08-01T19:54:04.471749+0000","last_fullsized":"2023-08-01T19:54:04.471749+0000","mapping_epoch":15,"log_start":"0'0","ondisk_log_start":"0'0","created":15,"last_epoch_clean":16,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-08-01T19:54:03.032665+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-08-01T19:54:03.032665+0000","last_clean_scrub_stamp":"2023-08-01T19:54:03.032665+0000","objects_scrubbed":0,"log_size":3,"ondisk_log_size":3,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-08-03T03:27:50.887004+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":90,"num_objects":2,"num_object_clones":0,"num_object_copies":4,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":2,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":4,"num_write_kb":1,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":1,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[2,1],"acting":[2,1],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":2,"acting_primary":2,"purged_snaps":[]},{"pgid":"4.12","version":"0'0","reported_seq":9,"reported_epoch":17,"state":"active+clean","last_fresh":"2023-08-01T19:54:04.471952+0000","last_change":"2023-08-01T19:54:04.467822+0000","last_active":"2023-08-01T19:54:04.471952+0000","last_peered":"2023-08-01T19:54:04.471952+0000","last_clean":"2023-08-01T19:54:04.471952+0000","last_became_active":"2023-08-01T19:54:04.466667+0000","last_became_peered":"2023-08-01T19:54:04.466667+0000","last_unstale":"2023-08-01T19:54:04.471952+0000","last_undegraded":"2023-08-01T19:54:04.471952+0000","last_fullsized":"2023-08-01T19:54:04.471952+0000","mapping_epoch":16,"log_start":"0'0","ondisk_log_start":"0'0","created":16,"last_epoch_clean":17,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-08-01T19:54:04.040663+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-08-01T19:54:04.040663+0000","last_clean_scrub_stamp":"2023-08-01T19:54:04.040663+0000","objects_scrubbed":0,"log_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-08-03T02:57:18.148077+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[0,2],"acting":[0,2],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":0,"acting_primary":0,"purged_snaps":[]},{"pgid":"3.14","version":"17'6","reported_seq":16,"reported_epoch":17,"state":"active+clean","last_fresh":"2023-08-01T19:54:04.485855+0000","last_change":"2023-08-01T19:54:04.061419+0000","last_active":"2023-08-01T19:54:04.485855+0000","last_peered":"2023-08-01T19:54:04.485855+0000","last_clean":"2023-08-01T19:54:04.485855+0000","last_became_active":"2023-08-01T19:54:04.061078+0000","last_became_peered":"2023-08-01T19:54:04.061078+0000","last_unstale":"2023-08-01T19:54:04.485855+0000","last_undegraded":"2023-08-01T19:54:04.485855+0000","last_fullsized":"2023-08-01T19:54:04.485855+0000","mapping_epoch":15,"log_start":"0'0","ondisk_log_start":"0'0","created":15,"last_epoch_clean":16,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-08-01T19:54:03.032665+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-08-01T19:54:03.032665+0000","last_clean_scrub_stamp":"2023-08-01T19:54:03.032665+0000","objects_scrubbed":0,"log_size":6,"ondisk_log_size":6,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-08-02T21:35:44.874727+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":1536,"num_objects":4,"num_object_clones":0,"num_object_copies":8,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":4,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":6,"num_write_kb":3,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":1,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[1,2],"acting":[1,2],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":1,"acting_primary":1,"purged_snaps":[]},{"pgid":"4.13","version":"0'0","reported_seq":9,"reported_epoch":17,"state":"active+clean","last_fresh":"2023-08-01T19:54:04.471426+0000","last_change":"2023-08-01T19:54:04.466400+0000","last_active":"2023-08-01T19:54:04.471426+0000","last_peered":"2023-08-01T19:54:04.471426+0000","last_clean":"2023-08-01T19:54:04.471426+0000","last_became_active":"2023-08-01T19:54:04.465979+0000","last_became_peered":"2023-08-01T19:54:04.465979+0000","last_unstale":"2023-08-01T19:54:04.471426+0000","last_undegraded":"2023-08-01T19:54:04.471426+0000","last_fullsized":"2023-08-01T19:54:04.471426+0000","mapping_epoch":16,"log_start":"0'0","ondisk_log_start":"0'0","created":16,"last_epoch_clean":17,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-08-01T19:54:04.040663+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-08-01T19:54:04.040663+0000","last_clean_scrub_stamp":"2023-08-01T19:54:04.040663+0000","objects_scrubbed":0,"log_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-08-02T20:20:59.989030+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[1,2],"acting":[1,2],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":1,"acting_primary":1,"purged_snaps":[]},{"pgid":"3.13","version":"17'2","reported_seq":12,"reported_epoch":17,"state":"active+clean","last_fresh":"2023-08-01T19:54:04.476009+0000","last_change":"2023-08-01T19:54:04.065212+0000","last_active":"2023-08-01T19:54:04.476009+0000","last_peered":"2023-08-01T19:54:04.476009+0000","last_clean":"2023-08-01T19:54:04.476009+0000","last_became_active":"2023-08-01T19:54:04.064375+0000","last_became_peered":"2023-08-01T19:54:04.064375+0000","last_unstale":"2023-08-01T19:54:04.476009+0000","last_undegraded":"2023-08-01T19:54:04.476009+0000","last_fullsized":"2023-08-01T19:54:04.476009+0000","mapping_epoch":15,"log_start":"0'0","ondisk_log_start":"0'0","created":15,"last_epoch_clean":16,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-08-01T19:54:03.032665+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-08-01T19:54:03.032665+0000","last_clean_scrub_stamp":"2023-08-01T19:54:03.032665+0000","objects_scrubbed":0,"log_size":2,"ondisk_log_size":2,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-08-03T06:17:37.910752+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":34,"num_objects":2,"num_object_clones":0,"num_object_copies":4,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":2,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":3,"num_write_kb":6,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":1,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[1,0],"acting":[1,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":1,"acting_primary":1,"purged_snaps":[]},{"pgid":"4.14","version":"0'0","reported_seq":9,"reported_epoch":17,"state":"active+clean","last_fresh":"2023-08-01T19:54:04.465917+0000","last_change":"2023-08-01T19:54:04.464446+0000","last_active":"2023-08-01T19:54:04.465917+0000","last_peered":"2023-08-01T19:54:04.465917+0000","last_clean":"2023-08-01T19:54:04.465917+0000","last_became_active":"2023-08-01T19:54:04.464021+0000","last_became_peered":"2023-08-01T19:54:04.464021+0000","last_unstale":"2023-08-01T19:54:04.465917+0000","last_undegraded":"2023-08-01T19:54:04.465917+0000","last_fullsized":"2023-08-01T19:54:04.465917+0000","mapping_epoch":16,"log_start":"0'0","ondisk_log_start":"0'0","created":16,"last_epoch_clean":17,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-08-01T19:54:04.040663+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-08-01T19:54:04.040663+0000","last_clean_scrub_stamp":"2023-08-01T19:54:04.040663+0000","objects_scrubbed":0,"log_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-08-02T20:26:51.080849+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[2,0],"acting":[2,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":2,"acting_primary":2,"purged_snaps":[]},{"pgid":"3.12","version":"0'0","reported_seq":10,"reported_epoch":17,"state":"active+clean","last_fresh":"2023-08-01T19:54:04.458866+0000","last_change":"2023-08-01T19:54:04.066566+0000","last_active":"2023-08-01T19:54:04.458866+0000","last_peered":"2023-08-01T19:54:04.458866+0000","last_clean":"2023-08-01T19:54:04.458866+0000","last_became_active":"2023-08-01T19:54:04.066190+0000","last_became_peered":"2023-08-01T19:54:04.066190+0000","last_unstale":"2023-08-01T19:54:04.458866+0000","last_undegraded":"2023-08-01T19:54:04.458866+0000","last_fullsized":"2023-08-01T19:54:04.458866+0000","mapping_epoch":15,"log_start":"0'0","ondisk_log_start":"0'0","created":15,"last_epoch_clean":16,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-08-01T19:54:03.032665+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-08-01T19:54:03.032665+0000","last_clean_scrub_stamp":"2023-08-01T19:54:03.032665+0000","objects_scrubbed":0,"log_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-08-03T02:01:47.073630+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[0,1],"acting":[0,1],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":0,"acting_primary":0,"purged_snaps":[]},{"pgid":"4.15","version":"0'0","reported_seq":9,"reported_epoch":17,"state":"active+clean","last_fresh":"2023-08-01T19:54:04.470734+0000","last_change":"2023-08-01T19:54:04.468791+0000","last_active":"2023-08-01T19:54:04.470734+0000","last_peered":"2023-08-01T19:54:04.470734+0000","last_clean":"2023-08-01T19:54:04.470734+0000","last_became_active":"2023-08-01T19:54:04.468214+0000","last_became_peered":"2023-08-01T19:54:04.468214+0000","last_unstale":"2023-08-01T19:54:04.470734+0000","last_undegraded":"2023-08-01T19:54:04.470734+0000","last_fullsized":"2023-08-01T19:54:04.470734+0000","mapping_epoch":16,"log_start":"0'0","ondisk_log_start":"0'0","created":16,"last_epoch_clean":17,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-08-01T19:54:04.040663+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-08-01T19:54:04.040663+0000","last_clean_scrub_stamp":"2023-08-01T19:54:04.040663+0000","objects_scrubbed":0,"log_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-08-03T04:10:44.729287+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[2,0],"acting":[2,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":2,"acting_primary":2,"purged_snaps":[]},{"pgid":"3.11","version":"0'0","reported_seq":10,"reported_epoch":17,"state":"active+clean","last_fresh":"2023-08-01T19:54:04.457924+0000","last_change":"2023-08-01T19:54:04.064280+0000","last_active":"2023-08-01T19:54:04.457924+0000","last_peered":"2023-08-01T19:54:04.457924+0000","last_clean":"2023-08-01T19:54:04.457924+0000","last_became_active":"2023-08-01T19:54:04.064064+0000","last_became_peered":"2023-08-01T19:54:04.064064+0000","last_unstale":"2023-08-01T19:54:04.457924+0000","last_undegraded":"2023-08-01T19:54:04.457924+0000","last_fullsized":"2023-08-01T19:54:04.457924+0000","mapping_epoch":15,"log_start":"0'0","ondisk_log_start":"0'0","created":15,"last_epoch_clean":16,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-08-01T19:54:03.032665+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-08-01T19:54:03.032665+0000","last_clean_scrub_stamp":"2023-08-01T19:54:03.032665+0000","objects_scrubbed":0,"log_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-08-03T06:13:51.475710+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[2,1],"acting":[2,1],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":2,"acting_primary":2,"purged_snaps":[]},{"pgid":"4.16","version":"0'0","reported_seq":9,"reported_epoch":17,"state":"active+clean","last_fresh":"2023-08-01T19:54:04.472609+0000","last_change":"2023-08-01T19:54:04.469724+0000","last_active":"2023-08-01T19:54:04.472609+0000","last_peered":"2023-08-01T19:54:04.472609+0000","last_clean":"2023-08-01T19:54:04.472609+0000","last_became_active":"2023-08-01T19:54:04.469275+0000","last_became_peered":"2023-08-01T19:54:04.469275+0000","last_unstale":"2023-08-01T19:54:04.472609+0000","last_undegraded":"2023-08-01T19:54:04.472609+0000","last_fullsized":"2023-08-01T19:54:04.472609+0000","mapping_epoch":16,"log_start":"0'0","ondisk_log_start":"0'0","created":16,"last_epoch_clean":17,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-08-01T19:54:04.040663+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-08-01T19:54:04.040663+0000","last_clean_scrub_stamp":"2023-08-01T19:54:04.040663+0000","objects_scrubbed":0,"log_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-08-03T03:04:06.137335+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[0,1],"acting":[0,1],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":0,"acting_primary":0,"purged_snaps":[]},{"pgid":"3.10","version":"17'8","reported_seq":18,"reported_epoch":17,"state":"active+clean","last_fresh":"2023-08-01T19:54:04.480319+0000","last_change":"2023-08-01T19:54:04.060962+0000","last_active":"2023-08-01T19:54:04.480319+0000","last_peered":"2023-08-01T19:54:04.480319+0000","last_clean":"2023-08-01T19:54:04.480319+0000","last_became_active":"2023-08-01T19:54:04.060576+0000","last_became_peered":"2023-08-01T19:54:04.060576+0000","last_unstale":"2023-08-01T19:54:04.480319+0000","last_undegraded":"2023-08-01T19:54:04.480319+0000","last_fullsized":"2023-08-01T19:54:04.480319+0000","mapping_epoch":15,"log_start":"0'0","ondisk_log_start":"0'0","created":15,"last_epoch_clean":16,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-08-01T19:54:03.032665+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-08-01T19:54:03.032665+0000","last_clean_scrub_stamp":"2023-08-01T19:54:03.032665+0000","objects_scrubbed":0,"log_size":8,"ondisk_log_size":8,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-08-03T05:00:51.171444+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":4,"num_object_clones":0,"num_object_copies":8,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":4,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":12,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":4,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[1,2],"acting":[1,2],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":1,"acting_primary":1,"purged_snaps":[]},{"pgid":"4.17","version":"0'0","reported_seq":9,"reported_epoch":17,"state":"active+clean","last_fresh":"2023-08-01T19:54:04.473595+0000","last_change":"2023-08-01T19:54:04.472721+0000","last_active":"2023-08-01T19:54:04.473595+0000","last_peered":"2023-08-01T19:54:04.473595+0000","last_clean":"2023-08-01T19:54:04.473595+0000","last_became_active":"2023-08-01T19:54:04.472126+0000","last_became_peered":"2023-08-01T19:54:04.472126+0000","last_unstale":"2023-08-01T19:54:04.473595+0000","last_undegraded":"2023-08-01T19:54:04.473595+0000","last_fullsized":"2023-08-01T19:54:04.473595+0000","mapping_epoch":16,"log_start":"0'0","ondisk_log_start":"0'0","created":16,"last_epoch_clean":17,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-08-01T19:54:04.040663+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-08-01T19:54:04.040663+0000","last_clean_scrub_stamp":"2023-08-01T19:54:04.040663+0000","objects_scrubbed":0,"log_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-08-03T00:29:05.857138+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[0,1],"acting":[0,1],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":0,"acting_primary":0,"purged_snaps":[]},{"pgid":"3.f","version":"17'1","reported_seq":11,"reported_epoch":17,"state":"active+clean","last_fresh":"2023-08-01T19:54:04.476116+0000","last_change":"2023-08-01T19:54:04.060797+0000","last_active":"2023-08-01T19:54:04.476116+0000","last_peered":"2023-08-01T19:54:04.476116+0000","last_clean":"2023-08-01T19:54:04.476116+0000","last_became_active":"2023-08-01T19:54:04.060444+0000","last_became_peered":"2023-08-01T19:54:04.060444+0000","last_unstale":"2023-08-01T19:54:04.476116+0000","last_undegraded":"2023-08-01T19:54:04.476116+0000","last_fullsized":"2023-08-01T19:54:04.476116+0000","mapping_epoch":15,"log_start":"0'0","ondisk_log_start":"0'0","created":15,"last_epoch_clean":16,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-08-01T19:54:03.032665+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-08-01T19:54:03.032665+0000","last_clean_scrub_stamp":"2023-08-01T19:54:03.032665+0000","objects_scrubbed":0,"log_size":1,"ondisk_log_size":1,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-08-03T07:13:34.025722+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":22,"num_objects":1,"num_object_clones":0,"num_object_copies":2,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":1,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":1,"num_write_kb":1,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[1,2],"acting":[1,2],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":1,"acting_primary":1,"purged_snaps":[]},{"pgid":"4.8","version":"0'0","reported_seq":9,"reported_epoch":17,"state":"active+clean","last_fresh":"2023-08-01T19:54:04.470264+0000","last_change":"2023-08-01T19:54:04.467671+0000","last_active":"2023-08-01T19:54:04.470264+0000","last_peered":"2023-08-01T19:54:04.470264+0000","last_clean":"2023-08-01T19:54:04.470264+0000","last_became_active":"2023-08-01T19:54:04.467300+0000","last_became_peered":"2023-08-01T19:54:04.467300+0000","last_unstale":"2023-08-01T19:54:04.470264+0000","last_undegraded":"2023-08-01T19:54:04.470264+0000","last_fullsized":"2023-08-01T19:54:04.470264+0000","mapping_epoch":16,"log_start":"0'0","ondisk_log_start":"0'0","created":16,"last_epoch_clean":17,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-08-01T19:54:04.040663+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-08-01T19:54:04.040663+0000","last_clean_scrub_stamp":"2023-08-01T19:54:04.040663+0000","objects_scrubbed":0,"log_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-08-03T05:27:24.774345+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[2,1],"acting":[2,1],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":2,"acting_primary":2,"purged_snaps":[]},{"pgid":"3.e","version":"17'2","reported_seq":12,"reported_epoch":17,"state":"active+clean","last_fresh":"2023-08-01T19:54:04.471249+0000","last_change":"2023-08-01T19:54:04.065595+0000","last_active":"2023-08-01T19:54:04.471249+0000","last_peered":"2023-08-01T19:54:04.471249+0000","last_clean":"2023-08-01T19:54:04.471249+0000","last_became_active":"2023-08-01T19:54:04.065303+0000","last_became_peered":"2023-08-01T19:54:04.065303+0000","last_unstale":"2023-08-01T19:54:04.471249+0000","last_undegraded":"2023-08-01T19:54:04.471249+0000","last_fullsized":"2023-08-01T19:54:04.471249+0000","mapping_epoch":15,"log_start":"0'0","ondisk_log_start":"0'0","created":15,"last_epoch_clean":16,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-08-01T19:54:03.032665+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-08-01T19:54:03.032665+0000","last_clean_scrub_stamp":"2023-08-01T19:54:03.032665+0000","objects_scrubbed":0,"log_size":2,"ondisk_log_size":2,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-08-02T22:40:38.782053+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":1,"num_object_clones":0,"num_object_copies":2,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":1,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":3,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":1,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[2,1],"acting":[2,1],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":2,"acting_primary":2,"purged_snaps":[]},{"pgid":"4.9","version":"0'0","reported_seq":9,"reported_epoch":17,"state":"active+clean","last_fresh":"2023-08-01T19:54:04.470284+0000","last_change":"2023-08-01T19:54:04.468007+0000","last_active":"2023-08-01T19:54:04.470284+0000","last_peered":"2023-08-01T19:54:04.470284+0000","last_clean":"2023-08-01T19:54:04.470284+0000","last_became_active":"2023-08-01T19:54:04.467509+0000","last_became_peered":"2023-08-01T19:54:04.467509+0000","last_unstale":"2023-08-01T19:54:04.470284+0000","last_undegraded":"2023-08-01T19:54:04.470284+0000","last_fullsized":"2023-08-01T19:54:04.470284+0000","mapping_epoch":16,"log_start":"0'0","ondisk_log_start":"0'0","created":16,"last_epoch_clean":17,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-08-01T19:54:04.040663+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-08-01T19:54:04.040663+0000","last_clean_scrub_stamp":"2023-08-01T19:54:04.040663+0000","objects_scrubbed":0,"log_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-08-03T06:04:50.963711+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[2,0],"acting":[2,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":2,"acting_primary":2,"purged_snaps":[]},{"pgid":"3.d","version":"17'1","reported_seq":11,"reported_epoch":17,"state":"active+clean","last_fresh":"2023-08-01T19:54:04.475997+0000","last_change":"2023-08-01T19:54:04.062853+0000","last_active":"2023-08-01T19:54:04.475997+0000","last_peered":"2023-08-01T19:54:04.475997+0000","last_clean":"2023-08-01T19:54:04.475997+0000","last_became_active":"2023-08-01T19:54:04.062598+0000","last_became_peered":"2023-08-01T19:54:04.062598+0000","last_unstale":"2023-08-01T19:54:04.475997+0000","last_undegraded":"2023-08-01T19:54:04.475997+0000","last_fullsized":"2023-08-01T19:54:04.475997+0000","mapping_epoch":15,"log_start":"0'0","ondisk_log_start":"0'0","created":15,"last_epoch_clean":16,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-08-01T19:54:03.032665+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-08-01T19:54:03.032665+0000","last_clean_scrub_stamp":"2023-08-01T19:54:03.032665+0000","objects_scrubbed":0,"log_size":1,"ondisk_log_size":1,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-08-02T20:56:47.324761+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":70,"num_objects":1,"num_object_clones":0,"num_object_copies":2,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":1,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":1,"num_write_kb":1,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[1,2],"acting":[1,2],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":1,"acting_primary":1,"purged_snaps":[]},{"pgid":"4.a","version":"0'0","reported_seq":9,"reported_epoch":17,"state":"active+clean","last_fresh":"2023-08-01T19:54:04.476248+0000","last_change":"2023-08-01T19:54:04.471997+0000","last_active":"2023-08-01T19:54:04.476248+0000","last_peered":"2023-08-01T19:54:04.476248+0000","last_clean":"2023-08-01T19:54:04.476248+0000","last_became_active":"2023-08-01T19:54:04.471204+0000","last_became_peered":"2023-08-01T19:54:04.471204+0000","last_unstale":"2023-08-01T19:54:04.476248+0000","last_undegraded":"2023-08-01T19:54:04.476248+0000","last_fullsized":"2023-08-01T19:54:04.476248+0000","mapping_epoch":16,"log_start":"0'0","ondisk_log_start":"0'0","created":16,"last_epoch_clean":17,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-08-01T19:54:04.040663+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-08-01T19:54:04.040663+0000","last_clean_scrub_stamp":"2023-08-01T19:54:04.040663+0000","objects_scrubbed":0,"log_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-08-02T23:12:30.830199+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[1,0],"acting":[1,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":1,"acting_primary":1,"purged_snaps":[]},{"pgid":"3.c","version":"0'0","reported_seq":10,"reported_epoch":17,"state":"active+clean","last_fresh":"2023-08-01T19:54:04.467464+0000","last_change":"2023-08-01T19:54:04.063532+0000","last_active":"2023-08-01T19:54:04.467464+0000","last_peered":"2023-08-01T19:54:04.467464+0000","last_clean":"2023-08-01T19:54:04.467464+0000","last_became_active":"2023-08-01T19:54:04.063116+0000","last_became_peered":"2023-08-01T19:54:04.063116+0000","last_unstale":"2023-08-01T19:54:04.467464+0000","last_undegraded":"2023-08-01T19:54:04.467464+0000","last_fullsized":"2023-08-01T19:54:04.467464+0000","mapping_epoch":15,"log_start":"0'0","ondisk_log_start":"0'0","created":15,"last_epoch_clean":16,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-08-01T19:54:03.032665+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-08-01T19:54:03.032665+0000","last_clean_scrub_stamp":"2023-08-01T19:54:03.032665+0000","objects_scrubbed":0,"log_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-08-02T22:28:51.936138+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[1,0],"acting":[1,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":1,"acting_primary":1,"purged_snaps":[]},{"pgid":"4.b","version":"0'0","reported_seq":9,"reported_epoch":17,"state":"active+clean","last_fresh":"2023-08-01T19:54:04.472955+0000","last_change":"2023-08-01T19:54:04.470787+0000","last_active":"2023-08-01T19:54:04.472955+0000","last_peered":"2023-08-01T19:54:04.472955+0000","last_clean":"2023-08-01T19:54:04.472955+0000","last_became_active":"2023-08-01T19:54:04.470332+0000","last_became_peered":"2023-08-01T19:54:04.470332+0000","last_unstale":"2023-08-01T19:54:04.472955+0000","last_undegraded":"2023-08-01T19:54:04.472955+0000","last_fullsized":"2023-08-01T19:54:04.472955+0000","mapping_epoch":16,"log_start":"0'0","ondisk_log_start":"0'0","created":16,"last_epoch_clean":17,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-08-01T19:54:04.040663+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-08-01T19:54:04.040663+0000","last_clean_scrub_stamp":"2023-08-01T19:54:04.040663+0000","objects_scrubbed":0,"log_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-08-03T05:13:38.298401+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[0,1],"acting":[0,1],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":0,"acting_primary":0,"purged_snaps":[]},{"pgid":"3.b","version":"17'2","reported_seq":12,"reported_epoch":17,"state":"active+clean","last_fresh":"2023-08-01T19:54:04.472965+0000","last_change":"2023-08-01T19:54:04.066839+0000","last_active":"2023-08-01T19:54:04.472965+0000","last_peered":"2023-08-01T19:54:04.472965+0000","last_clean":"2023-08-01T19:54:04.472965+0000","last_became_active":"2023-08-01T19:54:04.065535+0000","last_became_peered":"2023-08-01T19:54:04.065535+0000","last_unstale":"2023-08-01T19:54:04.472965+0000","last_undegraded":"2023-08-01T19:54:04.472965+0000","last_fullsized":"2023-08-01T19:54:04.472965+0000","mapping_epoch":15,"log_start":"0'0","ondisk_log_start":"0'0","created":15,"last_epoch_clean":16,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-08-01T19:54:03.032665+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-08-01T19:54:03.032665+0000","last_clean_scrub_stamp":"2023-08-01T19:54:03.032665+0000","objects_scrubbed":0,"log_size":2,"ondisk_log_size":2,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-08-03T05:00:51.171444+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":1,"num_object_clones":0,"num_object_copies":2,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":1,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":1,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":1,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[0,1],"acting":[0,1],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":0,"acting_primary":0,"purged_snaps":[]},{"pgid":"4.c","version":"0'0","reported_seq":9,"reported_epoch":17,"state":"active+clean","last_fresh":"2023-08-01T19:54:04.481357+0000","last_change":"2023-08-01T19:54:04.478715+0000","last_active":"2023-08-01T19:54:04.481357+0000","last_peered":"2023-08-01T19:54:04.481357+0000","last_clean":"2023-08-01T19:54:04.481357+0000","last_became_active":"2023-08-01T19:54:04.477435+0000","last_became_peered":"2023-08-01T19:54:04.477435+0000","last_unstale":"2023-08-01T19:54:04.481357+0000","last_undegraded":"2023-08-01T19:54:04.481357+0000","last_fullsized":"2023-08-01T19:54:04.481357+0000","mapping_epoch":16,"log_start":"0'0","ondisk_log_start":"0'0","created":16,"last_epoch_clean":17,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-08-01T19:54:04.040663+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-08-01T19:54:04.040663+0000","last_clean_scrub_stamp":"2023-08-01T19:54:04.040663+0000","objects_scrubbed":0,"log_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-08-03T04:43:21.408174+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[1,0],"acting":[1,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":1,"acting_primary":1,"purged_snaps":[]},{"pgid":"3.a","version":"0'0","reported_seq":10,"reported_epoch":17,"state":"active+clean","last_fresh":"2023-08-01T19:54:04.466981+0000","last_change":"2023-08-01T19:54:04.065267+0000","last_active":"2023-08-01T19:54:04.466981+0000","last_peered":"2023-08-01T19:54:04.466981+0000","last_clean":"2023-08-01T19:54:04.466981+0000","last_became_active":"2023-08-01T19:54:04.064912+0000","last_became_peered":"2023-08-01T19:54:04.064912+0000","last_unstale":"2023-08-01T19:54:04.466981+0000","last_undegraded":"2023-08-01T19:54:04.466981+0000","last_fullsized":"2023-08-01T19:54:04.466981+0000","mapping_epoch":15,"log_start":"0'0","ondisk_log_start":"0'0","created":15,"last_epoch_clean":16,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-08-01T19:54:03.032665+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-08-01T19:54:03.032665+0000","last_clean_scrub_stamp":"2023-08-01T19:54:03.032665+0000","objects_scrubbed":0,"log_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-08-03T02:37:09.180970+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[1,0],"acting":[1,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":1,"acting_primary":1,"purged_snaps":[]},{"pgid":"4.d","version":"0'0","reported_seq":9,"reported_epoch":17,"state":"active+clean","last_fresh":"2023-08-01T19:54:04.478084+0000","last_change":"2023-08-01T19:54:04.474755+0000","last_active":"2023-08-01T19:54:04.478084+0000","last_peered":"2023-08-01T19:54:04.478084+0000","last_clean":"2023-08-01T19:54:04.478084+0000","last_became_active":"2023-08-01T19:54:04.471526+0000","last_became_peered":"2023-08-01T19:54:04.471526+0000","last_unstale":"2023-08-01T19:54:04.478084+0000","last_undegraded":"2023-08-01T19:54:04.478084+0000","last_fullsized":"2023-08-01T19:54:04.478084+0000","mapping_epoch":16,"log_start":"0'0","ondisk_log_start":"0'0","created":16,"last_epoch_clean":17,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-08-01T19:54:04.040663+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-08-01T19:54:04.040663+0000","last_clean_scrub_stamp":"2023-08-01T19:54:04.040663+0000","objects_scrubbed":0,"log_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-08-03T06:50:03.420334+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[1,2],"acting":[1,2],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":1,"acting_primary":1,"purged_snaps":[]},{"pgid":"3.9","version":"0'0","reported_seq":10,"reported_epoch":17,"state":"active+clean","last_fresh":"2023-08-01T19:54:04.457820+0000","last_change":"2023-08-01T19:54:04.065519+0000","last_active":"2023-08-01T19:54:04.457820+0000","last_peered":"2023-08-01T19:54:04.457820+0000","last_clean":"2023-08-01T19:54:04.457820+0000","last_became_active":"2023-08-01T19:54:04.065211+0000","last_became_peered":"2023-08-01T19:54:04.065211+0000","last_unstale":"2023-08-01T19:54:04.457820+0000","last_undegraded":"2023-08-01T19:54:04.457820+0000","last_fullsized":"2023-08-01T19:54:04.457820+0000","mapping_epoch":15,"log_start":"0'0","ondisk_log_start":"0'0","created":15,"last_epoch_clean":16,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-08-01T19:54:03.032665+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-08-01T19:54:03.032665+0000","last_clean_scrub_stamp":"2023-08-01T19:54:03.032665+0000","objects_scrubbed":0,"log_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-08-03T05:46:27.672957+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[2,1],"acting":[2,1],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":2,"acting_primary":2,"purged_snaps":[]},{"pgid":"4.e","version":"0'0","reported_seq":9,"reported_epoch":17,"state":"active+clean","last_fresh":"2023-08-01T19:54:04.477674+0000","last_change":"2023-08-01T19:54:04.473750+0000","last_active":"2023-08-01T19:54:04.477674+0000","last_peered":"2023-08-01T19:54:04.477674+0000","last_clean":"2023-08-01T19:54:04.477674+0000","last_became_active":"2023-08-01T19:54:04.471512+0000","last_became_peered":"2023-08-01T19:54:04.471512+0000","last_unstale":"2023-08-01T19:54:04.477674+0000","last_undegraded":"2023-08-01T19:54:04.477674+0000","last_fullsized":"2023-08-01T19:54:04.477674+0000","mapping_epoch":16,"log_start":"0'0","ondisk_log_start":"0'0","created":16,"last_epoch_clean":17,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-08-01T19:54:04.040663+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-08-01T19:54:04.040663+0000","last_clean_scrub_stamp":"2023-08-01T19:54:04.040663+0000","objects_scrubbed":0,"log_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-08-03T05:13:38.298401+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[1,2],"acting":[1,2],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":1,"acting_primary":1,"purged_snaps":[]},{"pgid":"3.8","version":"0'0","reported_seq":10,"reported_epoch":17,"state":"active+clean","last_fresh":"2023-08-01T19:54:04.458299+0000","last_change":"2023-08-01T19:54:04.063990+0000","last_active":"2023-08-01T19:54:04.458299+0000","last_peered":"2023-08-01T19:54:04.458299+0000","last_clean":"2023-08-01T19:54:04.458299+0000","last_became_active":"2023-08-01T19:54:04.063652+0000","last_became_peered":"2023-08-01T19:54:04.063652+0000","last_unstale":"2023-08-01T19:54:04.458299+0000","last_undegraded":"2023-08-01T19:54:04.458299+0000","last_fullsized":"2023-08-01T19:54:04.458299+0000","mapping_epoch":15,"log_start":"0'0","ondisk_log_start":"0'0","created":15,"last_epoch_clean":16,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-08-01T19:54:03.032665+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-08-01T19:54:03.032665+0000","last_clean_scrub_stamp":"2023-08-01T19:54:03.032665+0000","objects_scrubbed":0,"log_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-08-03T05:30:28.028091+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[2,0],"acting":[2,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":2,"acting_primary":2,"purged_snaps":[]},{"pgid":"4.f","version":"0'0","reported_seq":9,"reported_epoch":17,"state":"active+clean","last_fresh":"2023-08-01T19:54:04.472898+0000","last_change":"2023-08-01T19:54:04.469648+0000","last_active":"2023-08-01T19:54:04.472898+0000","last_peered":"2023-08-01T19:54:04.472898+0000","last_clean":"2023-08-01T19:54:04.472898+0000","last_became_active":"2023-08-01T19:54:04.468445+0000","last_became_peered":"2023-08-01T19:54:04.468445+0000","last_unstale":"2023-08-01T19:54:04.472898+0000","last_undegraded":"2023-08-01T19:54:04.472898+0000","last_fullsized":"2023-08-01T19:54:04.472898+0000","mapping_epoch":16,"log_start":"0'0","ondisk_log_start":"0'0","created":16,"last_epoch_clean":17,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-08-01T19:54:04.040663+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-08-01T19:54:04.040663+0000","last_clean_scrub_stamp":"2023-08-01T19:54:04.040663+0000","objects_scrubbed":0,"log_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-08-03T05:46:11.085577+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[0,2],"acting":[0,2],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":0,"acting_primary":0,"purged_snaps":[]},{"pgid":"2.4","version":"0'0","reported_seq":13,"reported_epoch":17,"state":"active+clean","last_fresh":"2023-08-01T19:54:04.459326+0000","last_change":"2023-08-01T19:53:58.973838+0000","last_active":"2023-08-01T19:54:04.459326+0000","last_peered":"2023-08-01T19:54:04.459326+0000","last_clean":"2023-08-01T19:54:04.459326+0000","last_became_active":"2023-08-01T19:53:58.973242+0000","last_became_peered":"2023-08-01T19:53:58.973242+0000","last_unstale":"2023-08-01T19:54:04.459326+0000","last_undegraded":"2023-08-01T19:54:04.459326+0000","last_fullsized":"2023-08-01T19:54:04.459326+0000","mapping_epoch":12,"log_start":"0'0","ondisk_log_start":"0'0","created":12,"last_epoch_clean":13,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-08-01T19:53:57.959448+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-08-01T19:53:57.959448+0000","last_clean_scrub_stamp":"2023-08-01T19:53:57.959448+0000","objects_scrubbed":0,"log_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-08-03T00:09:48.796549+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[0,2],"acting":[0,2],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":0,"acting_primary":0,"purged_snaps":[]},{"pgid":"3.5","version":"0'0","reported_seq":10,"reported_epoch":17,"state":"active+clean","last_fresh":"2023-08-01T19:54:04.469510+0000","last_change":"2023-08-01T19:54:04.065255+0000","last_active":"2023-08-01T19:54:04.469510+0000","last_peered":"2023-08-01T19:54:04.469510+0000","last_clean":"2023-08-01T19:54:04.469510+0000","last_became_active":"2023-08-01T19:54:04.064814+0000","last_became_peered":"2023-08-01T19:54:04.064814+0000","last_unstale":"2023-08-01T19:54:04.469510+0000","last_undegraded":"2023-08-01T19:54:04.469510+0000","last_fullsized":"2023-08-01T19:54:04.469510+0000","mapping_epoch":15,"log_start":"0'0","ondisk_log_start":"0'0","created":15,"last_epoch_clean":16,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-08-01T19:54:03.032665+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-08-01T19:54:03.032665+0000","last_clean_scrub_stamp":"2023-08-01T19:54:03.032665+0000","objects_scrubbed":0,"log_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-08-03T02:01:47.073630+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[1,0],"acting":[1,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":1,"acting_primary":1,"purged_snaps":[]},{"pgid":"4.2","version":"0'0","reported_seq":9,"reported_epoch":17,"state":"active+clean","last_fresh":"2023-08-01T19:54:04.473868+0000","last_change":"2023-08-01T19:54:04.471715+0000","last_active":"2023-08-01T19:54:04.473868+0000","last_peered":"2023-08-01T19:54:04.473868+0000","last_clean":"2023-08-01T19:54:04.473868+0000","last_became_active":"2023-08-01T19:54:04.471300+0000","last_became_peered":"2023-08-01T19:54:04.471300+0000","last_unstale":"2023-08-01T19:54:04.473868+0000","last_undegraded":"2023-08-01T19:54:04.473868+0000","last_fullsized":"2023-08-01T19:54:04.473868+0000","mapping_epoch":16,"log_start":"0'0","ondisk_log_start":"0'0","created":16,"last_epoch_clean":17,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-08-01T19:54:04.040663+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-08-01T19:54:04.040663+0000","last_clean_scrub_stamp":"2023-08-01T19:54:04.040663+0000","objects_scrubbed":0,"log_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-08-02T23:00:24.980203+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[2,1],"acting":[2,1],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":2,"acting_primary":2,"purged_snaps":[]},{"pgid":"2.2","version":"0'0","reported_seq":13,"reported_epoch":17,"state":"active+clean","last_fresh":"2023-08-01T19:54:04.467109+0000","last_change":"2023-08-01T19:53:58.973665+0000","last_active":"2023-08-01T19:54:04.467109+0000","last_peered":"2023-08-01T19:54:04.467109+0000","last_clean":"2023-08-01T19:54:04.467109+0000","last_became_active":"2023-08-01T19:53:58.973463+0000","last_became_peered":"2023-08-01T19:53:58.973463+0000","last_unstale":"2023-08-01T19:54:04.467109+0000","last_undegraded":"2023-08-01T19:54:04.467109+0000","last_fullsized":"2023-08-01T19:54:04.467109+0000","mapping_epoch":12,"log_start":"0'0","ondisk_log_start":"0'0","created":12,"last_epoch_clean":13,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-08-01T19:53:57.959448+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-08-01T19:53:57.959448+0000","last_clean_scrub_stamp":"2023-08-01T19:53:57.959448+0000","objects_scrubbed":0,"log_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-08-03T04:50:42.368892+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[1,0],"acting":[1,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":1,"acting_primary":1,"purged_snaps":[]},{"pgid":"3.3","version":"0'0","reported_seq":10,"reported_epoch":17,"state":"active+clean","last_fresh":"2023-08-01T19:54:04.467459+0000","last_change":"2023-08-01T19:54:04.065415+0000","last_active":"2023-08-01T19:54:04.467459+0000","last_peered":"2023-08-01T19:54:04.467459+0000","last_clean":"2023-08-01T19:54:04.467459+0000","last_became_active":"2023-08-01T19:54:04.065030+0000","last_became_peered":"2023-08-01T19:54:04.065030+0000","last_unstale":"2023-08-01T19:54:04.467459+0000","last_undegraded":"2023-08-01T19:54:04.467459+0000","last_fullsized":"2023-08-01T19:54:04.467459+0000","mapping_epoch":15,"log_start":"0'0","ondisk_log_start":"0'0","created":15,"last_epoch_clean":16,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-08-01T19:54:03.032665+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-08-01T19:54:03.032665+0000","last_clean_scrub_stamp":"2023-08-01T19:54:03.032665+0000","objects_scrubbed":0,"log_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-08-02T21:33:27.007118+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[1,0],"acting":[1,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":1,"acting_primary":1,"purged_snaps":[]},{"pgid":"4.4","version":"0'0","reported_seq":9,"reported_epoch":17,"state":"active+clean","last_fresh":"2023-08-01T19:54:04.472012+0000","last_change":"2023-08-01T19:54:04.468101+0000","last_active":"2023-08-01T19:54:04.472012+0000","last_peered":"2023-08-01T19:54:04.472012+0000","last_clean":"2023-08-01T19:54:04.472012+0000","last_became_active":"2023-08-01T19:54:04.467409+0000","last_became_peered":"2023-08-01T19:54:04.467409+0000","last_unstale":"2023-08-01T19:54:04.472012+0000","last_undegraded":"2023-08-01T19:54:04.472012+0000","last_fullsized":"2023-08-01T19:54:04.472012+0000","mapping_epoch":16,"log_start":"0'0","ondisk_log_start":"0'0","created":16,"last_epoch_clean":17,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-08-01T19:54:04.040663+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-08-01T19:54:04.040663+0000","last_clean_scrub_stamp":"2023-08-01T19:54:04.040663+0000","objects_scrubbed":0,"log_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-08-02T21:43:30.325991+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[0,2],"acting":[0,2],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":0,"acting_primary":0,"purged_snaps":[]},{"pgid":"2.1","version":"0'0","reported_seq":13,"reported_epoch":17,"state":"active+clean","last_fresh":"2023-08-01T19:54:04.458490+0000","last_change":"2023-08-01T19:53:58.973700+0000","last_active":"2023-08-01T19:54:04.458490+0000","last_peered":"2023-08-01T19:54:04.458490+0000","last_clean":"2023-08-01T19:54:04.458490+0000","last_became_active":"2023-08-01T19:53:58.973285+0000","last_became_peered":"2023-08-01T19:53:58.973285+0000","last_unstale":"2023-08-01T19:54:04.458490+0000","last_undegraded":"2023-08-01T19:54:04.458490+0000","last_fullsized":"2023-08-01T19:54:04.458490+0000","mapping_epoch":12,"log_start":"0'0","ondisk_log_start":"0'0","created":12,"last_epoch_clean":13,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-08-01T19:53:57.959448+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-08-01T19:53:57.959448+0000","last_clean_scrub_stamp":"2023-08-01T19:53:57.959448+0000","objects_scrubbed":0,"log_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-08-02T21:26:02.570824+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[0,2],"acting":[0,2],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":0,"acting_primary":0,"purged_snaps":[]},{"pgid":"3.0","version":"0'0","reported_seq":10,"reported_epoch":17,"state":"active+clean","last_fresh":"2023-08-01T19:54:04.457828+0000","last_change":"2023-08-01T19:54:04.064407+0000","last_active":"2023-08-01T19:54:04.457828+0000","last_peered":"2023-08-01T19:54:04.457828+0000","last_clean":"2023-08-01T19:54:04.457828+0000","last_became_active":"2023-08-01T19:54:04.064122+0000","last_became_peered":"2023-08-01T19:54:04.064122+0000","last_unstale":"2023-08-01T19:54:04.457828+0000","last_undegraded":"2023-08-01T19:54:04.457828+0000","last_fullsized":"2023-08-01T19:54:04.457828+0000","mapping_epoch":15,"log_start":"0'0","ondisk_log_start":"0'0","created":15,"last_epoch_clean":16,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-08-01T19:54:03.032665+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-08-01T19:54:03.032665+0000","last_clean_scrub_stamp":"2023-08-01T19:54:03.032665+0000","objects_scrubbed":0,"log_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-08-03T07:08:17.318689+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[2,1],"acting":[2,1],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":2,"acting_primary":2,"purged_snaps":[]},{"pgid":"4.7","version":"0'0","reported_seq":9,"reported_epoch":17,"state":"active+clean","last_fresh":"2023-08-01T19:54:04.472871+0000","last_change":"2023-08-01T19:54:04.469739+0000","last_active":"2023-08-01T19:54:04.472871+0000","last_peered":"2023-08-01T19:54:04.472871+0000","last_clean":"2023-08-01T19:54:04.472871+0000","last_became_active":"2023-08-01T19:54:04.468021+0000","last_became_peered":"2023-08-01T19:54:04.468021+0000","last_unstale":"2023-08-01T19:54:04.472871+0000","last_undegraded":"2023-08-01T19:54:04.472871+0000","last_fullsized":"2023-08-01T19:54:04.472871+0000","mapping_epoch":16,"log_start":"0'0","ondisk_log_start":"0'0","created":16,"last_epoch_clean":17,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-08-01T19:54:04.040663+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-08-01T19:54:04.040663+0000","last_clean_scrub_stamp":"2023-08-01T19:54:04.040663+0000","objects_scrubbed":0,"log_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-08-02T21:03:01.319028+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[0,2],"acting":[0,2],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":0,"acting_primary":0,"purged_snaps":[]},{"pgid":"2.3","version":"0'0","reported_seq":13,"reported_epoch":17,"state":"active+clean","last_fresh":"2023-08-01T19:54:04.467483+0000","last_change":"2023-08-01T19:53:58.973768+0000","last_active":"2023-08-01T19:54:04.467483+0000","last_peered":"2023-08-01T19:54:04.467483+0000","last_clean":"2023-08-01T19:54:04.467483+0000","last_became_active":"2023-08-01T19:53:58.973492+0000","last_became_peered":"2023-08-01T19:53:58.973492+0000","last_unstale":"2023-08-01T19:54:04.467483+0000","last_undegraded":"2023-08-01T19:54:04.467483+0000","last_fullsized":"2023-08-01T19:54:04.467483+0000","mapping_epoch":12,"log_start":"0'0","ondisk_log_start":"0'0","created":12,"last_epoch_clean":13,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-08-01T19:53:57.959448+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-08-01T19:53:57.959448+0000","last_clean_scrub_stamp":"2023-08-01T19:53:57.959448+0000","objects_scrubbed":0,"log_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-08-03T02:04:52.034667+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[1,0],"acting":[1,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":1,"acting_primary":1,"purged_snaps":[]},{"pgid":"1.0","version":"10'157","reported_seq":212,"reported_epoch":17,"state":"active+clean","last_fresh":"2023-08-01T19:54:04.466599+0000","last_change":"2023-08-01T19:53:51.746910+0000","last_active":"2023-08-01T19:54:04.466599+0000","last_peered":"2023-08-01T19:54:04.466599+0000","last_clean":"2023-08-01T19:54:04.466599+0000","last_became_active":"2023-08-01T19:53:51.746590+0000","last_became_peered":"2023-08-01T19:53:51.746590+0000","last_unstale":"2023-08-01T19:54:04.466599+0000","last_undegraded":"2023-08-01T19:54:04.466599+0000","last_fullsized":"2023-08-01T19:54:04.466599+0000","mapping_epoch":9,"log_start":"0'0","ondisk_log_start":"0'0","created":9,"last_epoch_clean":10,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-08-01T19:53:50.735626+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-08-01T19:53:50.735626+0000","last_clean_scrub_stamp":"2023-08-01T19:53:50.735626+0000","objects_scrubbed":0,"log_size":157,"ondisk_log_size":157,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-08-03T02:56:50.228294+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":590368,"num_objects":2,"num_object_clones":0,"num_object_copies":4,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":2,"num_whiteouts":0,"num_read":136,"num_read_kb":118,"num_write":203,"num_write_kb":3460,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[1,2],"acting":[1,2],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":1,"acting_primary":1,"purged_snaps":[]},{"pgid":"3.2","version":"0'0","reported_seq":10,"reported_epoch":17,"state":"active+clean","last_fresh":"2023-08-01T19:54:04.458645+0000","last_change":"2023-08-01T19:54:04.064009+0000","last_active":"2023-08-01T19:54:04.458645+0000","last_peered":"2023-08-01T19:54:04.458645+0000","last_clean":"2023-08-01T19:54:04.458645+0000","last_became_active":"2023-08-01T19:54:04.063665+0000","last_became_peered":"2023-08-01T19:54:04.063665+0000","last_unstale":"2023-08-01T19:54:04.458645+0000","last_undegraded":"2023-08-01T19:54:04.458645+0000","last_fullsized":"2023-08-01T19:54:04.458645+0000","mapping_epoch":15,"log_start":"0'0","ondisk_log_start":"0'0","created":15,"last_epoch_clean":16,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-08-01T19:54:03.032665+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-08-01T19:54:03.032665+0000","last_clean_scrub_stamp":"2023-08-01T19:54:03.032665+0000","objects_scrubbed":0,"log_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-08-03T04:04:46.983253+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[0,2],"acting":[0,2],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":0,"acting_primary":0,"purged_snaps":[]},{"pgid":"4.5","version":"0'0","reported_seq":9,"reported_epoch":17,"state":"active+clean","last_fresh":"2023-08-01T19:54:04.477907+0000","last_change":"2023-08-01T19:54:04.474061+0000","last_active":"2023-08-01T19:54:04.477907+0000","last_peered":"2023-08-01T19:54:04.477907+0000","last_clean":"2023-08-01T19:54:04.477907+0000","last_became_active":"2023-08-01T19:54:04.472128+0000","last_became_peered":"2023-08-01T19:54:04.472128+0000","last_unstale":"2023-08-01T19:54:04.477907+0000","last_undegraded":"2023-08-01T19:54:04.477907+0000","last_fullsized":"2023-08-01T19:54:04.477907+0000","mapping_epoch":16,"log_start":"0'0","ondisk_log_start":"0'0","created":16,"last_epoch_clean":17,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-08-01T19:54:04.040663+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-08-01T19:54:04.040663+0000","last_clean_scrub_stamp":"2023-08-01T19:54:04.040663+0000","objects_scrubbed":0,"log_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-08-03T00:29:05.857138+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[1,2],"acting":[1,2],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":1,"acting_primary":1,"purged_snaps":[]},{"pgid":"2.0","version":"0'0","reported_seq":13,"reported_epoch":17,"state":"active+clean","last_fresh":"2023-08-01T19:54:04.466598+0000","last_change":"2023-08-01T19:53:58.975968+0000","last_active":"2023-08-01T19:54:04.466598+0000","last_peered":"2023-08-01T19:54:04.466598+0000","last_clean":"2023-08-01T19:54:04.466598+0000","last_became_active":"2023-08-01T19:53:58.975706+0000","last_became_peered":"2023-08-01T19:53:58.975706+0000","last_unstale":"2023-08-01T19:54:04.466598+0000","last_undegraded":"2023-08-01T19:54:04.466598+0000","last_fullsized":"2023-08-01T19:54:04.466598+0000","mapping_epoch":12,"log_start":"0'0","ondisk_log_start":"0'0","created":12,"last_epoch_clean":13,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-08-01T19:53:57.959448+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-08-01T19:53:57.959448+0000","last_clean_scrub_stamp":"2023-08-01T19:53:57.959448+0000","objects_scrubbed":0,"log_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-08-03T00:02:15.204280+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[1,2],"acting":[1,2],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":1,"acting_primary":1,"purged_snaps":[]},{"pgid":"3.1","version":"0'0","reported_seq":10,"reported_epoch":17,"state":"active+clean","last_fresh":"2023-08-01T19:54:04.458619+0000","last_change":"2023-08-01T19:54:04.066707+0000","last_active":"2023-08-01T19:54:04.458619+0000","last_peered":"2023-08-01T19:54:04.458619+0000","last_clean":"2023-08-01T19:54:04.458619+0000","last_became_active":"2023-08-01T19:54:04.066334+0000","last_became_peered":"2023-08-01T19:54:04.066334+0000","last_unstale":"2023-08-01T19:54:04.458619+0000","last_undegraded":"2023-08-01T19:54:04.458619+0000","last_fullsized":"2023-08-01T19:54:04.458619+0000","mapping_epoch":15,"log_start":"0'0","ondisk_log_start":"0'0","created":15,"last_epoch_clean":16,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-08-01T19:54:03.032665+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-08-01T19:54:03.032665+0000","last_clean_scrub_stamp":"2023-08-01T19:54:03.032665+0000","objects_scrubbed":0,"log_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-08-03T02:40:15.210599+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[0,1],"acting":[0,1],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":0,"acting_primary":0,"purged_snaps":[]},{"pgid":"4.6","version":"0'0","reported_seq":9,"reported_epoch":17,"state":"active+clean","last_fresh":"2023-08-01T19:54:04.471325+0000","last_change":"2023-08-01T19:54:04.469877+0000","last_active":"2023-08-01T19:54:04.471325+0000","last_peered":"2023-08-01T19:54:04.471325+0000","last_clean":"2023-08-01T19:54:04.471325+0000","last_became_active":"2023-08-01T19:54:04.469528+0000","last_became_peered":"2023-08-01T19:54:04.469528+0000","last_unstale":"2023-08-01T19:54:04.471325+0000","last_undegraded":"2023-08-01T19:54:04.471325+0000","last_fullsized":"2023-08-01T19:54:04.471325+0000","mapping_epoch":16,"log_start":"0'0","ondisk_log_start":"0'0","created":16,"last_epoch_clean":17,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-08-01T19:54:04.040663+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-08-01T19:54:04.040663+0000","last_clean_scrub_stamp":"2023-08-01T19:54:04.040663+0000","objects_scrubbed":0,"log_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-08-03T02:24:19.067602+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[2,0],"acting":[2,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":2,"acting_primary":2,"purged_snaps":[]},{"pgid":"2.5","version":"0'0","reported_seq":13,"reported_epoch":17,"state":"active+clean","last_fresh":"2023-08-01T19:54:04.459098+0000","last_change":"2023-08-01T19:53:58.970683+0000","last_active":"2023-08-01T19:54:04.459098+0000","last_peered":"2023-08-01T19:54:04.459098+0000","last_clean":"2023-08-01T19:54:04.459098+0000","last_became_active":"2023-08-01T19:53:58.970437+0000","last_became_peered":"2023-08-01T19:53:58.970437+0000","last_unstale":"2023-08-01T19:54:04.459098+0000","last_undegraded":"2023-08-01T19:54:04.459098+0000","last_fullsized":"2023-08-01T19:54:04.459098+0000","mapping_epoch":12,"log_start":"0'0","ondisk_log_start":"0'0","created":12,"last_epoch_clean":13,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-08-01T19:53:57.959448+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-08-01T19:53:57.959448+0000","last_clean_scrub_stamp":"2023-08-01T19:53:57.959448+0000","objects_scrubbed":0,"log_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-08-02T23:54:08.273426+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[2,0],"acting":[2,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":2,"acting_primary":2,"purged_snaps":[]},{"pgid":"3.4","version":"0'0","reported_seq":10,"reported_epoch":17,"state":"active+clean","last_fresh":"2023-08-01T19:54:04.458989+0000","last_change":"2023-08-01T19:54:04.062283+0000","last_active":"2023-08-01T19:54:04.458989+0000","last_peered":"2023-08-01T19:54:04.458989+0000","last_clean":"2023-08-01T19:54:04.458989+0000","last_became_active":"2023-08-01T19:54:04.061796+0000","last_became_peered":"2023-08-01T19:54:04.061796+0000","last_unstale":"2023-08-01T19:54:04.458989+0000","last_undegraded":"2023-08-01T19:54:04.458989+0000","last_fullsized":"2023-08-01T19:54:04.458989+0000","mapping_epoch":15,"log_start":"0'0","ondisk_log_start":"0'0","created":15,"last_epoch_clean":16,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-08-01T19:54:03.032665+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-08-01T19:54:03.032665+0000","last_clean_scrub_stamp":"2023-08-01T19:54:03.032665+0000","objects_scrubbed":0,"log_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-08-02T19:54:08.401797+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[0,2],"acting":[0,2],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":0,"acting_primary":0,"purged_snaps":[]},{"pgid":"4.3","version":"0'0","reported_seq":9,"reported_epoch":17,"state":"active+clean","last_fresh":"2023-08-01T19:54:04.474487+0000","last_change":"2023-08-01T19:54:04.473088+0000","last_active":"2023-08-01T19:54:04.474487+0000","last_peered":"2023-08-01T19:54:04.474487+0000","last_clean":"2023-08-01T19:54:04.474487+0000","last_became_active":"2023-08-01T19:54:04.472611+0000","last_became_peered":"2023-08-01T19:54:04.472611+0000","last_unstale":"2023-08-01T19:54:04.474487+0000","last_undegraded":"2023-08-01T19:54:04.474487+0000","last_fullsized":"2023-08-01T19:54:04.474487+0000","mapping_epoch":16,"log_start":"0'0","ondisk_log_start":"0'0","created":16,"last_epoch_clean":17,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-08-01T19:54:04.040663+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-08-01T19:54:04.040663+0000","last_clean_scrub_stamp":"2023-08-01T19:54:04.040663+0000","objects_scrubbed":0,"log_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-08-03T07:27:26.537518+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[2,1],"acting":[2,1],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":2,"acting_primary":2,"purged_snaps":[]},{"pgid":"3.7","version":"17'2","reported_seq":12,"reported_epoch":17,"state":"active+clean","last_fresh":"2023-08-01T19:54:04.471357+0000","last_change":"2023-08-01T19:54:04.065147+0000","last_active":"2023-08-01T19:54:04.471357+0000","last_peered":"2023-08-01T19:54:04.471357+0000","last_clean":"2023-08-01T19:54:04.471357+0000","last_became_active":"2023-08-01T19:54:04.064779+0000","last_became_peered":"2023-08-01T19:54:04.064779+0000","last_unstale":"2023-08-01T19:54:04.471357+0000","last_undegraded":"2023-08-01T19:54:04.471357+0000","last_fullsized":"2023-08-01T19:54:04.471357+0000","mapping_epoch":15,"log_start":"0'0","ondisk_log_start":"0'0","created":15,"last_epoch_clean":16,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-08-01T19:54:03.032665+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-08-01T19:54:03.032665+0000","last_clean_scrub_stamp":"2023-08-01T19:54:03.032665+0000","objects_scrubbed":0,"log_size":2,"ondisk_log_size":2,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-08-03T03:43:45.667663+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":1,"num_object_clones":0,"num_object_copies":2,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":1,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":3,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":1,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[0,2],"acting":[0,2],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":0,"acting_primary":0,"purged_snaps":[]},{"pgid":"2.6","version":"0'0","reported_seq":13,"reported_epoch":17,"state":"active+clean","last_fresh":"2023-08-01T19:54:04.460651+0000","last_change":"2023-08-01T19:53:58.974077+0000","last_active":"2023-08-01T19:54:04.460651+0000","last_peered":"2023-08-01T19:54:04.460651+0000","last_clean":"2023-08-01T19:54:04.460651+0000","last_became_active":"2023-08-01T19:53:58.973396+0000","last_became_peered":"2023-08-01T19:53:58.973396+0000","last_unstale":"2023-08-01T19:54:04.460651+0000","last_undegraded":"2023-08-01T19:54:04.460651+0000","last_fullsized":"2023-08-01T19:54:04.460651+0000","mapping_epoch":12,"log_start":"0'0","ondisk_log_start":"0'0","created":12,"last_epoch_clean":13,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-08-01T19:53:57.959448+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-08-01T19:53:57.959448+0000","last_clean_scrub_stamp":"2023-08-01T19:53:57.959448+0000","objects_scrubbed":0,"log_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-08-02T22:13:50.940864+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[0,2],"acting":[0,2],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":0,"acting_primary":0,"purged_snaps":[]},{"pgid":"4.0","version":"0'0","reported_seq":9,"reported_epoch":17,"state":"active+clean","last_fresh":"2023-08-01T19:54:04.477383+0000","last_change":"2023-08-01T19:54:04.476807+0000","last_active":"2023-08-01T19:54:04.477383+0000","last_peered":"2023-08-01T19:54:04.477383+0000","last_clean":"2023-08-01T19:54:04.477383+0000","last_became_active":"2023-08-01T19:54:04.476453+0000","last_became_peered":"2023-08-01T19:54:04.476453+0000","last_unstale":"2023-08-01T19:54:04.477383+0000","last_undegraded":"2023-08-01T19:54:04.477383+0000","last_fullsized":"2023-08-01T19:54:04.477383+0000","mapping_epoch":16,"log_start":"0'0","ondisk_log_start":"0'0","created":16,"last_epoch_clean":17,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-08-01T19:54:04.040663+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-08-01T19:54:04.040663+0000","last_clean_scrub_stamp":"2023-08-01T19:54:04.040663+0000","objects_scrubbed":0,"log_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-08-02T20:20:59.989030+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[0,1],"acting":[0,1],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":0,"acting_primary":0,"purged_snaps":[]},{"pgid":"2.7","version":"0'0","reported_seq":13,"reported_epoch":17,"state":"active+clean","last_fresh":"2023-08-01T19:54:04.469429+0000","last_change":"2023-08-01T19:53:58.975936+0000","last_active":"2023-08-01T19:54:04.469429+0000","last_peered":"2023-08-01T19:54:04.469429+0000","last_clean":"2023-08-01T19:54:04.469429+0000","last_became_active":"2023-08-01T19:53:58.975680+0000","last_became_peered":"2023-08-01T19:53:58.975680+0000","last_unstale":"2023-08-01T19:54:04.469429+0000","last_undegraded":"2023-08-01T19:54:04.469429+0000","last_fullsized":"2023-08-01T19:54:04.469429+0000","mapping_epoch":12,"log_start":"0'0","ondisk_log_start":"0'0","created":12,"last_epoch_clean":13,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-08-01T19:53:57.959448+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-08-01T19:53:57.959448+0000","last_clean_scrub_stamp":"2023-08-01T19:53:57.959448+0000","objects_scrubbed":0,"log_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-08-03T05:17:03.508898+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[1,2],"acting":[1,2],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":1,"acting_primary":1,"purged_snaps":[]},{"pgid":"3.6","version":"18'1","reported_seq":11,"reported_epoch":18,"state":"active+clean","last_fresh":"2023-08-01T19:54:06.924239+0000","last_change":"2023-08-01T19:54:04.068041+0000","last_active":"2023-08-01T19:54:06.924239+0000","last_peered":"2023-08-01T19:54:06.924239+0000","last_clean":"2023-08-01T19:54:06.924239+0000","last_became_active":"2023-08-01T19:54:04.067613+0000","last_became_peered":"2023-08-01T19:54:04.067613+0000","last_unstale":"2023-08-01T19:54:06.924239+0000","last_undegraded":"2023-08-01T19:54:06.924239+0000","last_fullsized":"2023-08-01T19:54:06.924239+0000","mapping_epoch":15,"log_start":"0'0","ondisk_log_start":"0'0","created":15,"last_epoch_clean":16,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-08-01T19:54:03.032665+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-08-01T19:54:03.032665+0000","last_clean_scrub_stamp":"2023-08-01T19:54:03.032665+0000","objects_scrubbed":0,"log_size":1,"ondisk_log_size":1,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-08-02T21:35:44.874727+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":1,"num_object_clones":0,"num_object_copies":2,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":1,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":1,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":1,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[0,1],"acting":[0,1],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":0,"acting_primary":0,"purged_snaps":[]},{"pgid":"4.1","version":"0'0","reported_seq":9,"reported_epoch":17,"state":"active+clean","last_fresh":"2023-08-01T19:54:04.470826+0000","last_change":"2023-08-01T19:54:04.469243+0000","last_active":"2023-08-01T19:54:04.470826+0000","last_peered":"2023-08-01T19:54:04.470826+0000","last_clean":"2023-08-01T19:54:04.470826+0000","last_became_active":"2023-08-01T19:54:04.468835+0000","last_became_peered":"2023-08-01T19:54:04.468835+0000","last_unstale":"2023-08-01T19:54:04.470826+0000","last_undegraded":"2023-08-01T19:54:04.470826+0000","last_fullsized":"2023-08-01T19:54:04.470826+0000","mapping_epoch":16,"log_start":"0'0","ondisk_log_start":"0'0","created":16,"last_epoch_clean":17,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-08-01T19:54:04.040663+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-08-01T19:54:04.040663+0000","last_clean_scrub_stamp":"2023-08-01T19:54:04.040663+0000","objects_scrubbed":0,"log_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-08-03T04:43:58.358628+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[2,1],"acting":[2,1],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":2,"acting_primary":2,"purged_snaps":[]},{"pgid":"3.1b","version":"17'1","reported_seq":11,"reported_epoch":17,"state":"active+clean","last_fresh":"2023-08-01T19:54:04.471524+0000","last_change":"2023-08-01T19:54:04.066748+0000","last_active":"2023-08-01T19:54:04.471524+0000","last_peered":"2023-08-01T19:54:04.471524+0000","last_clean":"2023-08-01T19:54:04.471524+0000","last_became_active":"2023-08-01T19:54:04.066483+0000","last_became_peered":"2023-08-01T19:54:04.066483+0000","last_unstale":"2023-08-01T19:54:04.471524+0000","last_undegraded":"2023-08-01T19:54:04.471524+0000","last_fullsized":"2023-08-01T19:54:04.471524+0000","mapping_epoch":15,"log_start":"0'0","ondisk_log_start":"0'0","created":15,"last_epoch_clean":16,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-08-01T19:54:03.032665+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-08-01T19:54:03.032665+0000","last_clean_scrub_stamp":"2023-08-01T19:54:03.032665+0000","objects_scrubbed":0,"log_size":1,"ondisk_log_size":1,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-08-03T03:08:26.880362+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[2,1],"acting":[2,1],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":2,"acting_primary":2,"purged_snaps":[]},{"pgid":"4.1c","version":"0'0","reported_seq":9,"reported_epoch":17,"state":"active+clean","last_fresh":"2023-08-01T19:54:04.468766+0000","last_change":"2023-08-01T19:54:04.466766+0000","last_active":"2023-08-01T19:54:04.468766+0000","last_peered":"2023-08-01T19:54:04.468766+0000","last_clean":"2023-08-01T19:54:04.468766+0000","last_became_active":"2023-08-01T19:54:04.466417+0000","last_became_peered":"2023-08-01T19:54:04.466417+0000","last_unstale":"2023-08-01T19:54:04.468766+0000","last_undegraded":"2023-08-01T19:54:04.468766+0000","last_fullsized":"2023-08-01T19:54:04.468766+0000","mapping_epoch":16,"log_start":"0'0","ondisk_log_start":"0'0","created":16,"last_epoch_clean":17,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-08-01T19:54:04.040663+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-08-01T19:54:04.040663+0000","last_clean_scrub_stamp":"2023-08-01T19:54:04.040663+0000","objects_scrubbed":0,"log_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-08-02T22:01:53.643825+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[2,0],"acting":[2,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":2,"acting_primary":2,"purged_snaps":[]},{"pgid":"3.1c","version":"17'2","reported_seq":12,"reported_epoch":17,"state":"active+clean","last_fresh":"2023-08-01T19:54:04.477825+0000","last_change":"2023-08-01T19:54:04.065706+0000","last_active":"2023-08-01T19:54:04.477825+0000","last_peered":"2023-08-01T19:54:04.477825+0000","last_clean":"2023-08-01T19:54:04.477825+0000","last_became_active":"2023-08-01T19:54:04.064796+0000","last_became_peered":"2023-08-01T19:54:04.064796+0000","last_unstale":"2023-08-01T19:54:04.477825+0000","last_undegraded":"2023-08-01T19:54:04.477825+0000","last_fullsized":"2023-08-01T19:54:04.477825+0000","mapping_epoch":15,"log_start":"0'0","ondisk_log_start":"0'0","created":15,"last_epoch_clean":16,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-08-01T19:54:03.032665+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-08-01T19:54:03.032665+0000","last_clean_scrub_stamp":"2023-08-01T19:54:03.032665+0000","objects_scrubbed":0,"log_size":2,"ondisk_log_size":2,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-08-02T21:40:43.596301+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":1,"num_object_clones":0,"num_object_copies":2,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":1,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":3,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":1,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[1,0],"acting":[1,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":1,"acting_primary":1,"purged_snaps":[]},{"pgid":"4.1b","version":"0'0","reported_seq":9,"reported_epoch":17,"state":"active+clean","last_fresh":"2023-08-01T19:54:04.478301+0000","last_change":"2023-08-01T19:54:04.474971+0000","last_active":"2023-08-01T19:54:04.478301+0000","last_peered":"2023-08-01T19:54:04.478301+0000","last_clean":"2023-08-01T19:54:04.478301+0000","last_became_active":"2023-08-01T19:54:04.473957+0000","last_became_peered":"2023-08-01T19:54:04.473957+0000","last_unstale":"2023-08-01T19:54:04.478301+0000","last_undegraded":"2023-08-01T19:54:04.478301+0000","last_fullsized":"2023-08-01T19:54:04.478301+0000","mapping_epoch":16,"log_start":"0'0","ondisk_log_start":"0'0","created":16,"last_epoch_clean":17,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-08-01T19:54:04.040663+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-08-01T19:54:04.040663+0000","last_clean_scrub_stamp":"2023-08-01T19:54:04.040663+0000","objects_scrubbed":0,"log_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-08-02T21:59:19.682560+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[1,0],"acting":[1,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":1,"acting_primary":1,"purged_snaps":[]},{"pgid":"3.1d","version":"17'2","reported_seq":12,"reported_epoch":17,"state":"active+clean","last_fresh":"2023-08-01T19:54:04.471623+0000","last_change":"2023-08-01T19:54:04.065591+0000","last_active":"2023-08-01T19:54:04.471623+0000","last_peered":"2023-08-01T19:54:04.471623+0000","last_clean":"2023-08-01T19:54:04.471623+0000","last_became_active":"2023-08-01T19:54:04.065306+0000","last_became_peered":"2023-08-01T19:54:04.065306+0000","last_unstale":"2023-08-01T19:54:04.471623+0000","last_undegraded":"2023-08-01T19:54:04.471623+0000","last_fullsized":"2023-08-01T19:54:04.471623+0000","mapping_epoch":15,"log_start":"0'0","ondisk_log_start":"0'0","created":15,"last_epoch_clean":16,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-08-01T19:54:03.032665+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-08-01T19:54:03.032665+0000","last_clean_scrub_stamp":"2023-08-01T19:54:03.032665+0000","objects_scrubbed":0,"log_size":2,"ondisk_log_size":2,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-08-02T21:32:10.389227+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":1,"num_object_clones":0,"num_object_copies":2,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":1,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":3,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":1,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[2,1],"acting":[2,1],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":2,"acting_primary":2,"purged_snaps":[]},{"pgid":"4.1a","version":"0'0","reported_seq":9,"reported_epoch":17,"state":"active+clean","last_fresh":"2023-08-01T19:54:04.477591+0000","last_change":"2023-08-01T19:54:04.473302+0000","last_active":"2023-08-01T19:54:04.477591+0000","last_peered":"2023-08-01T19:54:04.477591+0000","last_clean":"2023-08-01T19:54:04.477591+0000","last_became_active":"2023-08-01T19:54:04.472452+0000","last_became_peered":"2023-08-01T19:54:04.472452+0000","last_unstale":"2023-08-01T19:54:04.477591+0000","last_undegraded":"2023-08-01T19:54:04.477591+0000","last_fullsized":"2023-08-01T19:54:04.477591+0000","mapping_epoch":16,"log_start":"0'0","ondisk_log_start":"0'0","created":16,"last_epoch_clean":17,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-08-01T19:54:04.040663+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-08-01T19:54:04.040663+0000","last_clean_scrub_stamp":"2023-08-01T19:54:04.040663+0000","objects_scrubbed":0,"log_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-08-02T21:02:39.542019+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[1,0],"acting":[1,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":1,"acting_primary":1,"purged_snaps":[]},{"pgid":"3.1e","version":"17'1","reported_seq":11,"reported_epoch":17,"state":"active+clean","last_fresh":"2023-08-01T19:54:04.471416+0000","last_change":"2023-08-01T19:54:04.064378+0000","last_active":"2023-08-01T19:54:04.471416+0000","last_peered":"2023-08-01T19:54:04.471416+0000","last_clean":"2023-08-01T19:54:04.471416+0000","last_became_active":"2023-08-01T19:54:04.063988+0000","last_became_peered":"2023-08-01T19:54:04.063988+0000","last_unstale":"2023-08-01T19:54:04.471416+0000","last_undegraded":"2023-08-01T19:54:04.471416+0000","last_fullsized":"2023-08-01T19:54:04.471416+0000","mapping_epoch":15,"log_start":"0'0","ondisk_log_start":"0'0","created":15,"last_epoch_clean":16,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-08-01T19:54:03.032665+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-08-01T19:54:03.032665+0000","last_clean_scrub_stamp":"2023-08-01T19:54:03.032665+0000","objects_scrubbed":0,"log_size":1,"ondisk_log_size":1,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-08-02T22:28:51.936138+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[0,2],"acting":[0,2],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":0,"acting_primary":0,"purged_snaps":[]},{"pgid":"4.19","version":"0'0","reported_seq":9,"reported_epoch":17,"state":"active+clean","last_fresh":"2023-08-01T19:54:04.469620+0000","last_change":"2023-08-01T19:54:04.467017+0000","last_active":"2023-08-01T19:54:04.469620+0000","last_peered":"2023-08-01T19:54:04.469620+0000","last_clean":"2023-08-01T19:54:04.469620+0000","last_became_active":"2023-08-01T19:54:04.466339+0000","last_became_peered":"2023-08-01T19:54:04.466339+0000","last_unstale":"2023-08-01T19:54:04.469620+0000","last_undegraded":"2023-08-01T19:54:04.469620+0000","last_fullsized":"2023-08-01T19:54:04.469620+0000","mapping_epoch":16,"log_start":"0'0","ondisk_log_start":"0'0","created":16,"last_epoch_clean":17,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-08-01T19:54:04.040663+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-08-01T19:54:04.040663+0000","last_clean_scrub_stamp":"2023-08-01T19:54:04.040663+0000","objects_scrubbed":0,"log_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-08-03T04:07:57.222873+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[2,0],"acting":[2,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":2,"acting_primary":2,"purged_snaps":[]},{"pgid":"3.1f","version":"17'4","reported_seq":14,"reported_epoch":17,"state":"active+clean","last_fresh":"2023-08-01T19:54:04.472669+0000","last_change":"2023-08-01T19:54:04.067767+0000","last_active":"2023-08-01T19:54:04.472669+0000","last_peered":"2023-08-01T19:54:04.472669+0000","last_clean":"2023-08-01T19:54:04.472669+0000","last_became_active":"2023-08-01T19:54:04.067414+0000","last_became_peered":"2023-08-01T19:54:04.067414+0000","last_unstale":"2023-08-01T19:54:04.472669+0000","last_undegraded":"2023-08-01T19:54:04.472669+0000","last_fullsized":"2023-08-01T19:54:04.472669+0000","mapping_epoch":15,"log_start":"0'0","ondisk_log_start":"0'0","created":15,"last_epoch_clean":16,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-08-01T19:54:03.032665+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-08-01T19:54:03.032665+0000","last_clean_scrub_stamp":"2023-08-01T19:54:03.032665+0000","objects_scrubbed":0,"log_size":4,"ondisk_log_size":4,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-08-02T21:33:27.007118+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":554,"num_objects":2,"num_object_clones":0,"num_object_copies":4,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":2,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":4,"num_write_kb":1,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":1,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[0,1],"acting":[0,1],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":0,"acting_primary":0,"purged_snaps":[]},{"pgid":"4.18","version":"0'0","reported_seq":9,"reported_epoch":17,"state":"active+clean","last_fresh":"2023-08-01T19:54:04.478697+0000","last_change":"2023-08-01T19:54:04.477588+0000","last_active":"2023-08-01T19:54:04.478697+0000","last_peered":"2023-08-01T19:54:04.478697+0000","last_clean":"2023-08-01T19:54:04.478697+0000","last_became_active":"2023-08-01T19:54:04.476194+0000","last_became_peered":"2023-08-01T19:54:04.476194+0000","last_unstale":"2023-08-01T19:54:04.478697+0000","last_undegraded":"2023-08-01T19:54:04.478697+0000","last_fullsized":"2023-08-01T19:54:04.478697+0000","mapping_epoch":16,"log_start":"0'0","ondisk_log_start":"0'0","created":16,"last_epoch_clean":17,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-08-01T19:54:04.040663+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-08-01T19:54:04.040663+0000","last_clean_scrub_stamp":"2023-08-01T19:54:04.040663+0000","objects_scrubbed":0,"log_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-08-03T03:58:06.360840+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[1,0],"acting":[1,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":1,"acting_primary":1,"purged_snaps":[]},{"pgid":"4.20","version":"0'0","reported_seq":9,"reported_epoch":17,"state":"active+clean","last_fresh":"2023-08-01T19:54:04.479155+0000","last_change":"2023-08-01T19:54:04.477904+0000","last_active":"2023-08-01T19:54:04.479155+0000","last_peered":"2023-08-01T19:54:04.479155+0000","last_clean":"2023-08-01T19:54:04.479155+0000","last_became_active":"2023-08-01T19:54:04.476564+0000","last_became_peered":"2023-08-01T19:54:04.476564+0000","last_unstale":"2023-08-01T19:54:04.479155+0000","last_undegraded":"2023-08-01T19:54:04.479155+0000","last_fullsized":"2023-08-01T19:54:04.479155+0000","mapping_epoch":16,"log_start":"0'0","ondisk_log_start":"0'0","created":16,"last_epoch_clean":17,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-08-01T19:54:04.040663+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-08-01T19:54:04.040663+0000","last_clean_scrub_stamp":"2023-08-01T19:54:04.040663+0000","objects_scrubbed":0,"log_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-08-03T02:21:47.656072+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[1,0],"acting":[1,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":1,"acting_primary":1,"purged_snaps":[]},{"pgid":"4.21","version":"0'0","reported_seq":9,"reported_epoch":17,"state":"active+clean","last_fresh":"2023-08-01T19:54:04.471608+0000","last_change":"2023-08-01T19:54:04.466899+0000","last_active":"2023-08-01T19:54:04.471608+0000","last_peered":"2023-08-01T19:54:04.471608+0000","last_clean":"2023-08-01T19:54:04.471608+0000","last_became_active":"2023-08-01T19:54:04.466500+0000","last_became_peered":"2023-08-01T19:54:04.466500+0000","last_unstale":"2023-08-01T19:54:04.471608+0000","last_undegraded":"2023-08-01T19:54:04.471608+0000","last_fullsized":"2023-08-01T19:54:04.471608+0000","mapping_epoch":16,"log_start":"0'0","ondisk_log_start":"0'0","created":16,"last_epoch_clean":17,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-08-01T19:54:04.040663+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-08-01T19:54:04.040663+0000","last_clean_scrub_stamp":"2023-08-01T19:54:04.040663+0000","objects_scrubbed":0,"log_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-08-03T07:36:38.654701+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[0,2],"acting":[0,2],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":0,"acting_primary":0,"purged_snaps":[]},{"pgid":"4.22","version":"0'0","reported_seq":9,"reported_epoch":17,"state":"active+clean","last_fresh":"2023-08-01T19:54:04.473914+0000","last_change":"2023-08-01T19:54:04.471945+0000","last_active":"2023-08-01T19:54:04.473914+0000","last_peered":"2023-08-01T19:54:04.473914+0000","last_clean":"2023-08-01T19:54:04.473914+0000","last_became_active":"2023-08-01T19:54:04.471371+0000","last_became_peered":"2023-08-01T19:54:04.471371+0000","last_unstale":"2023-08-01T19:54:04.473914+0000","last_undegraded":"2023-08-01T19:54:04.473914+0000","last_fullsized":"2023-08-01T19:54:04.473914+0000","mapping_epoch":16,"log_start":"0'0","ondisk_log_start":"0'0","created":16,"last_epoch_clean":17,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-08-01T19:54:04.040663+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-08-01T19:54:04.040663+0000","last_clean_scrub_stamp":"2023-08-01T19:54:04.040663+0000","objects_scrubbed":0,"log_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-08-02T22:17:59.847819+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[2,1],"acting":[2,1],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":2,"acting_primary":2,"purged_snaps":[]},{"pgid":"4.23","version":"0'0","reported_seq":9,"reported_epoch":17,"state":"active+clean","last_fresh":"2023-08-01T19:54:04.472334+0000","last_change":"2023-08-01T19:54:04.467847+0000","last_active":"2023-08-01T19:54:04.472334+0000","last_peered":"2023-08-01T19:54:04.472334+0000","last_clean":"2023-08-01T19:54:04.472334+0000","last_became_active":"2023-08-01T19:54:04.467111+0000","last_became_peered":"2023-08-01T19:54:04.467111+0000","last_unstale":"2023-08-01T19:54:04.472334+0000","last_undegraded":"2023-08-01T19:54:04.472334+0000","last_fullsized":"2023-08-01T19:54:04.472334+0000","mapping_epoch":16,"log_start":"0'0","ondisk_log_start":"0'0","created":16,"last_epoch_clean":17,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-08-01T19:54:04.040663+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-08-01T19:54:04.040663+0000","last_clean_scrub_stamp":"2023-08-01T19:54:04.040663+0000","objects_scrubbed":0,"log_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-08-03T00:42:19.379348+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[0,2],"acting":[0,2],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":0,"acting_primary":0,"purged_snaps":[]},{"pgid":"4.24","version":"0'0","reported_seq":9,"reported_epoch":17,"state":"active+clean","last_fresh":"2023-08-01T19:54:04.482540+0000","last_change":"2023-08-01T19:54:04.477128+0000","last_active":"2023-08-01T19:54:04.482540+0000","last_peered":"2023-08-01T19:54:04.482540+0000","last_clean":"2023-08-01T19:54:04.482540+0000","last_became_active":"2023-08-01T19:54:04.476819+0000","last_became_peered":"2023-08-01T19:54:04.476819+0000","last_unstale":"2023-08-01T19:54:04.482540+0000","last_undegraded":"2023-08-01T19:54:04.482540+0000","last_fullsized":"2023-08-01T19:54:04.482540+0000","mapping_epoch":16,"log_start":"0'0","ondisk_log_start":"0'0","created":16,"last_epoch_clean":17,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-08-01T19:54:04.040663+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-08-01T19:54:04.040663+0000","last_clean_scrub_stamp":"2023-08-01T19:54:04.040663+0000","objects_scrubbed":0,"log_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-08-03T02:20:23.354054+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[2,1],"acting":[2,1],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":2,"acting_primary":2,"purged_snaps":[]}],"pool_stats":[{"poolid":4,"num_pg":64,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"store_stats":{"total":0,"available":0,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},"log_size":0,"ondisk_log_size":0,"up":128,"acting":128,"num_store_stats":3},{"poolid":3,"num_pg":32,"stat_sum":{"num_bytes":2306,"num_objects":22,"num_object_clones":0,"num_object_copies":44,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":22,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":45,"num_write_kb":13,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":14,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"store_stats":{"total":0,"available":0,"internally_reserved":0,"allocated":65536,"data_stored":4612,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},"log_size":39,"ondisk_log_size":39,"up":64,"acting":64,"num_store_stats":3},{"poolid":1,"num_pg":1,"stat_sum":{"num_bytes":590368,"num_objects":2,"num_object_clones":0,"num_object_copies":4,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":2,"num_whiteouts":0,"num_read":136,"num_read_kb":118,"num_write":203,"num_write_kb":3460,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"store_stats":{"total":0,"available":0,"internally_reserved":0,"allocated":114688,"data_stored":1180736,"data_compressed":20662,"data_compressed_allocated":73728,"data_compressed_original":1146880,"omap_allocated":0,"internal_metadata":0},"log_size":157,"ondisk_log_size":157,"up":2,"acting":2,"num_store_stats":2},{"poolid":2,"num_pg":8,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"store_stats":{"total":0,"available":0,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},"log_size":0,"ondisk_log_size":0,"up":16,"acting":16,"num_store_stats":3}],"osd_stats":[{"osd":2,"up_from":9,"seq":38654705673,"num_pgs":67,"num_osds":1,"num_per_pool_osds":1,"num_per_pool_omap_osds":1,"kb":94371840,"kb_used":9264,"kb_used_data":232,"kb_used_omap":0,"kb_used_meta":9024,"kb_avail":94362576,"statfs":{"total":96636764160,"available":96627277824,"internally_reserved":0,"allocated":237568,"data_stored":647231,"data_compressed":10331,"data_compressed_allocated":36864,"data_compressed_original":573440,"omap_allocated":0,"internal_metadata":9240576},"hb_peers":[0,1],"snap_trim_queue_len":0,"num_snap_trimming":0,"num_shards_repaired":0,"op_queue_age_hist":{"histogram":[],"upper_bound":1},"perf_stat":{"commit_latency_ms":0,"apply_latency_ms":0,"commit_latency_ns":0,"apply_latency_ns":0},"alerts":[],"network_ping_times":[{"osd":0,"last update":"Thu Jan 1 00:00:00 1970","interfaces":[{"interface":"back","average":{"1min":0,"5min":0,"15min":0},"min":{"1min":0,"5min":0,"15min":0},"max":{"1min":0,"5min":0,"15min":0},"last":0.47699999999999998}]},{"osd":1,"last update":"Thu Jan 1 00:00:00 1970","interfaces":[{"interface":"back","average":{"1min":0,"5min":0,"15min":0},"min":{"1min":0,"5min":0,"15min":0},"max":{"1min":0,"5min":0,"15min":0},"last":0.60299999999999998}]}]},{"osd":0,"up_from":8,"seq":34359738376,"num_pgs":72,"num_osds":1,"num_per_pool_osds":1,"num_per_pool_omap_osds":1,"kb":94371840,"kb_used":12648,"kb_used_data":160,"kb_used_omap":0,"kb_used_meta":12480,"kb_avail":94359192,"statfs":{"total":96636764160,"available":96623812608,"internally_reserved":0,"allocated":163840,"data_stored":55733,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":12779520},"hb_peers":[1,2],"snap_trim_queue_len":0,"num_snap_trimming":0,"num_shards_repaired":0,"op_queue_age_hist":{"histogram":[],"upper_bound":1},"perf_stat":{"commit_latency_ms":0,"apply_latency_ms":0,"commit_latency_ns":0,"apply_latency_ns":0},"alerts":[],"network_ping_times":[{"osd":1,"last update":"Thu Jan 1 00:00:00 1970","interfaces":[{"interface":"back","average":{"1min":0,"5min":0,"15min":0},"min":{"1min":0,"5min":0,"15min":0},"max":{"1min":0,"5min":0,"15min":0},"last":0.501}]},{"osd":2,"last update":"Thu Jan 1 00:00:00 1970","interfaces":[{"interface":"back","average":{"1min":0,"5min":0,"15min":0},"min":{"1min":0,"5min":0,"15min":0},"max":{"1min":0,"5min":0,"15min":0},"last":0.47599999999999998}]}]},{"osd":1,"up_from":8,"seq":34359738375,"num_pgs":71,"num_osds":1,"num_per_pool_osds":1,"num_per_pool_omap_osds":1,"kb":94371840,"kb_used":9336,"kb_used_data":240,"kb_used_omap":0,"kb_used_meta":9088,"kb_avail":94362504,"statfs":{"total":96636764160,"available":96627204096,"internally_reserved":0,"allocated":245760,"data_stored":647819,"data_compressed":10331,"data_compressed_allocated":36864,"data_compressed_original":573440,"omap_allocated":0,"internal_metadata":9306112},"hb_peers":[0,2],"snap_trim_queue_len":0,"num_snap_trimming":0,"num_shards_repaired":0,"op_queue_age_hist":{"histogram":[],"upper_bound":1},"perf_stat":{"commit_latency_ms":0,"apply_latency_ms":0,"commit_latency_ns":0,"apply_latency_ns":0},"alerts":[],"network_ping_times":[{"osd":0,"last update":"Thu Jan 1 00:00:00 1970","interfaces":[{"interface":"back","average":{"1min":0,"5min":0,"15min":0},"min":{"1min":0,"5min":0,"15min":0},"max":{"1min":0,"5min":0,"15min":0},"last":0.47999999999999998}]},{"osd":2,"last update":"Thu Jan 1 00:00:00 1970","interfaces":[{"interface":"back","average":{"1min":0,"5min":0,"15min":0},"min":{"1min":0,"5min":0,"15min":0},"max":{"1min":0,"5min":0,"15min":0},"last":0.51000000000000001}]}]}],"pool_statfs":[{"poolid":1,"osd":1,"total":0,"available":0,"internally_reserved":0,"allocated":57344,"data_stored":590368,"data_compressed":10331,"data_compressed_allocated":36864,"data_compressed_original":573440,"omap_allocated":0,"internal_metadata":0},{"poolid":1,"osd":2,"total":0,"available":0,"internally_reserved":0,"allocated":57344,"data_stored":590368,"data_compressed":10331,"data_compressed_allocated":36864,"data_compressed_original":573440,"omap_allocated":0,"internal_metadata":0},{"poolid":2,"osd":0,"total":0,"available":0,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":2,"osd":1,"total":0,"available":0,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":2,"osd":2,"total":0,"available":0,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":3,"osd":0,"total":0,"available":0,"internally_reserved":0,"allocated":8192,"data_stored":588,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":3,"osd":1,"total":0,"available":0,"internally_reserved":0,"allocated":32768,"data_stored":2306,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":3,"osd":2,"total":0,"available":0,"internally_reserved":0,"allocated":24576,"data_stored":1718,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":4,"osd":0,"total":0,"available":0,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":4,"osd":1,"total":0,"available":0,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":4,"osd":2,"total":0,"available":0,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0}]}} 2023-08-01T19:54:19.855 INFO:tasks.ceph.ceph_manager.ceph:clean! 2023-08-01T19:54:19.855 DEBUG:teuthology.orchestra.run.smithi006:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 120 ceph --cluster ceph osd dump 2023-08-01T19:54:20.218 INFO:teuthology.orchestra.run.smithi006.stdout:epoch 18 2023-08-01T19:54:20.218 INFO:teuthology.orchestra.run.smithi006.stdout:fsid a0e420cc-4df1-42a5-8bd4-a98c309a9349 2023-08-01T19:54:20.218 INFO:teuthology.orchestra.run.smithi006.stdout:created 2023-08-01T19:53:41.279588+0000 2023-08-01T19:54:20.219 INFO:teuthology.orchestra.run.smithi006.stdout:modified 2023-08-01T19:54:05.452537+0000 2023-08-01T19:54:20.219 INFO:teuthology.orchestra.run.smithi006.stdout:flags sortbitwise,recovery_deletes,purged_snapdirs,pglog_hardlimit 2023-08-01T19:54:20.219 INFO:teuthology.orchestra.run.smithi006.stdout:crush_version 5 2023-08-01T19:54:20.219 INFO:teuthology.orchestra.run.smithi006.stdout:full_ratio 0.95 2023-08-01T19:54:20.219 INFO:teuthology.orchestra.run.smithi006.stdout:backfillfull_ratio 0.9 2023-08-01T19:54:20.219 INFO:teuthology.orchestra.run.smithi006.stdout:nearfull_ratio 0.85 2023-08-01T19:54:20.219 INFO:teuthology.orchestra.run.smithi006.stdout:require_min_compat_client luminous 2023-08-01T19:54:20.220 INFO:teuthology.orchestra.run.smithi006.stdout:min_compat_client jewel 2023-08-01T19:54:20.220 INFO:teuthology.orchestra.run.smithi006.stdout:require_osd_release quincy 2023-08-01T19:54:20.220 INFO:teuthology.orchestra.run.smithi006.stdout:stretch_mode_enabled false 2023-08-01T19:54:20.220 INFO:teuthology.orchestra.run.smithi006.stdout:pool 1 '.mgr' replicated size 2 min_size 1 crush_rule 0 object_hash rjenkins pg_num 1 pgp_num 1 autoscale_mode off last_change 11 flags hashpspool stripe_width 0 pg_num_max 32 pg_num_min 1 application mgr 2023-08-01T19:54:20.220 INFO:teuthology.orchestra.run.smithi006.stdout:pool 2 'rbd' replicated size 2 min_size 1 crush_rule 0 object_hash rjenkins pg_num 8 pgp_num 8 autoscale_mode off last_change 14 flags hashpspool stripe_width 0 application rbd 2023-08-01T19:54:20.220 INFO:teuthology.orchestra.run.smithi006.stdout:pool 3 'cephfs_metadata' replicated size 2 min_size 1 crush_rule 0 object_hash rjenkins pg_num 32 pgp_num 32 autoscale_mode off last_change 17 flags hashpspool stripe_width 0 pg_autoscale_bias 4 pg_num_min 16 recovery_priority 5 application cephfs 2023-08-01T19:54:20.220 INFO:teuthology.orchestra.run.smithi006.stdout:pool 4 'cephfs_data' replicated size 2 min_size 1 crush_rule 0 object_hash rjenkins pg_num 64 pgp_num 64 autoscale_mode off last_change 18 flags hashpspool stripe_width 0 pg_num_min 64 target_size_ratio 0.9 application cephfs 2023-08-01T19:54:20.221 INFO:teuthology.orchestra.run.smithi006.stdout:max_osd 3 2023-08-01T19:54:20.221 INFO:teuthology.orchestra.run.smithi006.stdout:osd.0 up in weight 1 up_from 8 up_thru 16 down_at 0 last_clean_interval [0,0) [v2:172.21.15.8:6800/111181,v1:172.21.15.8:6801/111181] [v2:172.21.15.8:6802/111181,v1:172.21.15.8:6803/111181] exists,up 5dd675c7-2777-48f2-8009-ff0e0d4c7086 2023-08-01T19:54:20.221 INFO:teuthology.orchestra.run.smithi006.stdout:osd.1 up in weight 1 up_from 8 up_thru 16 down_at 0 last_clean_interval [0,0) [v2:172.21.15.101:6800/111143,v1:172.21.15.101:6801/111143] [v2:172.21.15.101:6802/111143,v1:172.21.15.101:6803/111143] exists,up 7fc612c4-33ba-4a33-bca8-1f42ee8ed548 2023-08-01T19:54:20.221 INFO:teuthology.orchestra.run.smithi006.stdout:osd.2 up in weight 1 up_from 9 up_thru 16 down_at 0 last_clean_interval [0,0) [v2:172.21.15.155:6800/111339,v1:172.21.15.155:6801/111339] [v2:172.21.15.155:6802/111339,v1:172.21.15.155:6803/111339] exists,up f85cadbc-4230-4772-8f39-62ed52e220b1 2023-08-01T19:54:20.231 INFO:tasks.ceph.ceph_manager.ceph:['osd.0 up in weight 1 up_from 8 up_thru 16 down_at 0 last_clean_interval [0,0) [v2:172.21.15.8:6800/111181,v1:172.21.15.8:6801/111181] [v2:172.21.15.8:6802/111181,v1:172.21.15.8:6803/111181] exists,up 5dd675c7-2777-48f2-8009-ff0e0d4c7086', 'osd.1 up in weight 1 up_from 8 up_thru 16 down_at 0 last_clean_interval [0,0) [v2:172.21.15.101:6800/111143,v1:172.21.15.101:6801/111143] [v2:172.21.15.101:6802/111143,v1:172.21.15.101:6803/111143] exists,up 7fc612c4-33ba-4a33-bca8-1f42ee8ed548', 'osd.2 up in weight 1 up_from 9 up_thru 16 down_at 0 last_clean_interval [0,0) [v2:172.21.15.155:6800/111339,v1:172.21.15.155:6801/111339] [v2:172.21.15.155:6802/111339,v1:172.21.15.155:6803/111339] exists,up f85cadbc-4230-4772-8f39-62ed52e220b1'] 2023-08-01T19:54:20.232 DEBUG:teuthology.orchestra.run.smithi006:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 0 ceph --cluster ceph --admin-daemon /var/run/ceph/ceph-mon.a.asok config show 2023-08-01T19:54:20.354 INFO:teuthology.orchestra.run.smithi006.stdout:{ 2023-08-01T19:54:20.355 INFO:teuthology.orchestra.run.smithi006.stdout: "name": "mon.a", 2023-08-01T19:54:20.355 INFO:teuthology.orchestra.run.smithi006.stdout: "cluster": "ceph", 2023-08-01T19:54:20.355 INFO:teuthology.orchestra.run.smithi006.stdout: "admin_socket": "/var/run/ceph/ceph-mon.a.asok", 2023-08-01T19:54:20.355 INFO:teuthology.orchestra.run.smithi006.stdout: "admin_socket_mode": "", 2023-08-01T19:54:20.355 INFO:teuthology.orchestra.run.smithi006.stdout: "auth_allow_insecure_global_id_reclaim": "true", 2023-08-01T19:54:20.355 INFO:teuthology.orchestra.run.smithi006.stdout: "auth_client_required": "cephx, none", 2023-08-01T19:54:20.355 INFO:teuthology.orchestra.run.smithi006.stdout: "auth_cluster_required": "cephx", 2023-08-01T19:54:20.356 INFO:teuthology.orchestra.run.smithi006.stdout: "auth_debug": "true", 2023-08-01T19:54:20.356 INFO:teuthology.orchestra.run.smithi006.stdout: "auth_expose_insecure_global_id_reclaim": "true", 2023-08-01T19:54:20.356 INFO:teuthology.orchestra.run.smithi006.stdout: "auth_mon_ticket_ttl": "660.000000", 2023-08-01T19:54:20.356 INFO:teuthology.orchestra.run.smithi006.stdout: "auth_service_required": "cephx", 2023-08-01T19:54:20.356 INFO:teuthology.orchestra.run.smithi006.stdout: "auth_service_ticket_ttl": "240.000000", 2023-08-01T19:54:20.356 INFO:teuthology.orchestra.run.smithi006.stdout: "auth_supported": "cephx", 2023-08-01T19:54:20.357 INFO:teuthology.orchestra.run.smithi006.stdout: "bdev_aio": "true", 2023-08-01T19:54:20.357 INFO:teuthology.orchestra.run.smithi006.stdout: "bdev_aio_max_queue_depth": "1024", 2023-08-01T19:54:20.357 INFO:teuthology.orchestra.run.smithi006.stdout: "bdev_aio_poll_ms": "250", 2023-08-01T19:54:20.357 INFO:teuthology.orchestra.run.smithi006.stdout: "bdev_aio_reap_max": "16", 2023-08-01T19:54:20.357 INFO:teuthology.orchestra.run.smithi006.stdout: "bdev_async_discard": "false", 2023-08-01T19:54:20.357 INFO:teuthology.orchestra.run.smithi006.stdout: "bdev_block_size": "4096", 2023-08-01T19:54:20.357 INFO:teuthology.orchestra.run.smithi006.stdout: "bdev_debug_aio": "false", 2023-08-01T19:54:20.357 INFO:teuthology.orchestra.run.smithi006.stdout: "bdev_debug_aio_log_age": "5.000000", 2023-08-01T19:54:20.358 INFO:teuthology.orchestra.run.smithi006.stdout: "bdev_debug_aio_suicide_timeout": "60.000000", 2023-08-01T19:54:20.358 INFO:teuthology.orchestra.run.smithi006.stdout: "bdev_debug_inflight_ios": "false", 2023-08-01T19:54:20.358 INFO:teuthology.orchestra.run.smithi006.stdout: "bdev_enable_discard": "false", 2023-08-01T19:54:20.358 INFO:teuthology.orchestra.run.smithi006.stdout: "bdev_flock_retry": "3", 2023-08-01T19:54:20.358 INFO:teuthology.orchestra.run.smithi006.stdout: "bdev_flock_retry_interval": "0.100000", 2023-08-01T19:54:20.358 INFO:teuthology.orchestra.run.smithi006.stdout: "bdev_inject_crash": "0", 2023-08-01T19:54:20.358 INFO:teuthology.orchestra.run.smithi006.stdout: "bdev_inject_crash_flush_delay": "2", 2023-08-01T19:54:20.359 INFO:teuthology.orchestra.run.smithi006.stdout: "bdev_ioring": "false", 2023-08-01T19:54:20.359 INFO:teuthology.orchestra.run.smithi006.stdout: "bdev_ioring_hipri": "false", 2023-08-01T19:54:20.359 INFO:teuthology.orchestra.run.smithi006.stdout: "bdev_ioring_sqthread_poll": "false", 2023-08-01T19:54:20.359 INFO:teuthology.orchestra.run.smithi006.stdout: "bdev_nvme_unbind_from_kernel": "false", 2023-08-01T19:54:20.359 INFO:teuthology.orchestra.run.smithi006.stdout: "bdev_read_buffer_alignment": "4096", 2023-08-01T19:54:20.359 INFO:teuthology.orchestra.run.smithi006.stdout: "bdev_read_preallocated_huge_buffers": "", 2023-08-01T19:54:20.359 INFO:teuthology.orchestra.run.smithi006.stdout: "bdev_type": "", 2023-08-01T19:54:20.359 INFO:teuthology.orchestra.run.smithi006.stdout: "bluefs_alloc_size": "1048576", 2023-08-01T19:54:20.360 INFO:teuthology.orchestra.run.smithi006.stdout: "bluefs_allocator": "hybrid", 2023-08-01T19:54:20.360 INFO:teuthology.orchestra.run.smithi006.stdout: "bluefs_buffered_io": "true", 2023-08-01T19:54:20.360 INFO:teuthology.orchestra.run.smithi006.stdout: "bluefs_check_for_zeros": "false", 2023-08-01T19:54:20.360 INFO:teuthology.orchestra.run.smithi006.stdout: "bluefs_check_volume_selector_often": "false", 2023-08-01T19:54:20.360 INFO:teuthology.orchestra.run.smithi006.stdout: "bluefs_check_volume_selector_on_umount": "false", 2023-08-01T19:54:20.360 INFO:teuthology.orchestra.run.smithi006.stdout: "bluefs_compact_log_sync": "false", 2023-08-01T19:54:20.360 INFO:teuthology.orchestra.run.smithi006.stdout: "bluefs_failed_shared_alloc_cooldown": "600.000000", 2023-08-01T19:54:20.361 INFO:teuthology.orchestra.run.smithi006.stdout: "bluefs_log_compact_min_ratio": "5.000000", 2023-08-01T19:54:20.361 INFO:teuthology.orchestra.run.smithi006.stdout: "bluefs_log_compact_min_size": "16777216", 2023-08-01T19:54:20.361 INFO:teuthology.orchestra.run.smithi006.stdout: "bluefs_log_replay_check_allocations": "true", 2023-08-01T19:54:20.361 INFO:teuthology.orchestra.run.smithi006.stdout: "bluefs_max_log_runway": "4194304", 2023-08-01T19:54:20.361 INFO:teuthology.orchestra.run.smithi006.stdout: "bluefs_max_prefetch": "1048576", 2023-08-01T19:54:20.361 INFO:teuthology.orchestra.run.smithi006.stdout: "bluefs_min_flush_size": "524288", 2023-08-01T19:54:20.361 INFO:teuthology.orchestra.run.smithi006.stdout: "bluefs_min_log_runway": "1048576", 2023-08-01T19:54:20.361 INFO:teuthology.orchestra.run.smithi006.stdout: "bluefs_replay_recovery": "false", 2023-08-01T19:54:20.362 INFO:teuthology.orchestra.run.smithi006.stdout: "bluefs_replay_recovery_disable_compact": "false", 2023-08-01T19:54:20.362 INFO:teuthology.orchestra.run.smithi006.stdout: "bluefs_shared_alloc_size": "65536", 2023-08-01T19:54:20.362 INFO:teuthology.orchestra.run.smithi006.stdout: "bluefs_sync_write": "false", 2023-08-01T19:54:20.362 INFO:teuthology.orchestra.run.smithi006.stdout: "bluestore_2q_cache_kin_ratio": "0.500000", 2023-08-01T19:54:20.362 INFO:teuthology.orchestra.run.smithi006.stdout: "bluestore_2q_cache_kout_ratio": "0.500000", 2023-08-01T19:54:20.362 INFO:teuthology.orchestra.run.smithi006.stdout: "bluestore_alloc_stats_dump_interval": "86400.000000", 2023-08-01T19:54:20.362 INFO:teuthology.orchestra.run.smithi006.stdout: "bluestore_allocation_from_file": "true", 2023-08-01T19:54:20.362 INFO:teuthology.orchestra.run.smithi006.stdout: "bluestore_allocator": "hybrid", 2023-08-01T19:54:20.363 INFO:teuthology.orchestra.run.smithi006.stdout: "bluestore_avl_alloc_bf_free_pct": "4", 2023-08-01T19:54:20.363 INFO:teuthology.orchestra.run.smithi006.stdout: "bluestore_avl_alloc_bf_threshold": "131072", 2023-08-01T19:54:20.363 INFO:teuthology.orchestra.run.smithi006.stdout: "bluestore_avl_alloc_ff_max_search_bytes": "16777216", 2023-08-01T19:54:20.363 INFO:teuthology.orchestra.run.smithi006.stdout: "bluestore_avl_alloc_ff_max_search_count": "100", 2023-08-01T19:54:20.363 INFO:teuthology.orchestra.run.smithi006.stdout: "bluestore_bitmapallocator_blocks_per_zone": "1024", 2023-08-01T19:54:20.363 INFO:teuthology.orchestra.run.smithi006.stdout: "bluestore_bitmapallocator_span_size": "1024", 2023-08-01T19:54:20.363 INFO:teuthology.orchestra.run.smithi006.stdout: "bluestore_blobid_prealloc": "10240", 2023-08-01T19:54:20.364 INFO:teuthology.orchestra.run.smithi006.stdout: "bluestore_block_create": "true", 2023-08-01T19:54:20.364 INFO:teuthology.orchestra.run.smithi006.stdout: "bluestore_block_db_create": "false", 2023-08-01T19:54:20.364 INFO:teuthology.orchestra.run.smithi006.stdout: "bluestore_block_db_path": "", 2023-08-01T19:54:20.364 INFO:teuthology.orchestra.run.smithi006.stdout: "bluestore_block_db_size": "0", 2023-08-01T19:54:20.364 INFO:teuthology.orchestra.run.smithi006.stdout: "bluestore_block_path": "", 2023-08-01T19:54:20.364 INFO:teuthology.orchestra.run.smithi006.stdout: "bluestore_block_preallocate_file": "false", 2023-08-01T19:54:20.364 INFO:teuthology.orchestra.run.smithi006.stdout: "bluestore_block_size": "107374182400", 2023-08-01T19:54:20.364 INFO:teuthology.orchestra.run.smithi006.stdout: "bluestore_block_wal_create": "false", 2023-08-01T19:54:20.365 INFO:teuthology.orchestra.run.smithi006.stdout: "bluestore_block_wal_path": "", 2023-08-01T19:54:20.365 INFO:teuthology.orchestra.run.smithi006.stdout: "bluestore_block_wal_size": "100663296", 2023-08-01T19:54:20.365 INFO:teuthology.orchestra.run.smithi006.stdout: "bluestore_bluefs": "true", 2023-08-01T19:54:20.365 INFO:teuthology.orchestra.run.smithi006.stdout: "bluestore_bluefs_alloc_failure_dump_interval": "0.000000", 2023-08-01T19:54:20.365 INFO:teuthology.orchestra.run.smithi006.stdout: "bluestore_bluefs_env_mirror": "false", 2023-08-01T19:54:20.365 INFO:teuthology.orchestra.run.smithi006.stdout: "bluestore_bluefs_max_free": "10737418240", 2023-08-01T19:54:20.365 INFO:teuthology.orchestra.run.smithi006.stdout: "bluestore_cache_age_bin_interval": "1.000000", 2023-08-01T19:54:20.366 INFO:teuthology.orchestra.run.smithi006.stdout: "bluestore_cache_age_bins_data": "1 2 6 24 120 720 0 0 0 0", 2023-08-01T19:54:20.366 INFO:teuthology.orchestra.run.smithi006.stdout: "bluestore_cache_age_bins_kv": "1 2 6 24 120 720 0 0 0 0", 2023-08-01T19:54:20.366 INFO:teuthology.orchestra.run.smithi006.stdout: "bluestore_cache_age_bins_kv_onode": "0 0 0 0 0 0 0 0 0 720", 2023-08-01T19:54:20.366 INFO:teuthology.orchestra.run.smithi006.stdout: "bluestore_cache_age_bins_meta": "1 2 6 24 120 720 0 0 0 0", 2023-08-01T19:54:20.366 INFO:teuthology.orchestra.run.smithi006.stdout: "bluestore_cache_autotune": "true", 2023-08-01T19:54:20.366 INFO:teuthology.orchestra.run.smithi006.stdout: "bluestore_cache_autotune_interval": "5.000000", 2023-08-01T19:54:20.366 INFO:teuthology.orchestra.run.smithi006.stdout: "bluestore_cache_kv_onode_ratio": "0.040000", 2023-08-01T19:54:20.366 INFO:teuthology.orchestra.run.smithi006.stdout: "bluestore_cache_kv_ratio": "0.450000", 2023-08-01T19:54:20.367 INFO:teuthology.orchestra.run.smithi006.stdout: "bluestore_cache_meta_ratio": "0.450000", 2023-08-01T19:54:20.367 INFO:teuthology.orchestra.run.smithi006.stdout: "bluestore_cache_size": "0", 2023-08-01T19:54:20.367 INFO:teuthology.orchestra.run.smithi006.stdout: "bluestore_cache_size_hdd": "1073741824", 2023-08-01T19:54:20.367 INFO:teuthology.orchestra.run.smithi006.stdout: "bluestore_cache_size_ssd": "3221225472", 2023-08-01T19:54:20.367 INFO:teuthology.orchestra.run.smithi006.stdout: "bluestore_cache_trim_interval": "0.050000", 2023-08-01T19:54:20.367 INFO:teuthology.orchestra.run.smithi006.stdout: "bluestore_cache_trim_max_skip_pinned": "1000", 2023-08-01T19:54:20.367 INFO:teuthology.orchestra.run.smithi006.stdout: "bluestore_cache_type": "2q", 2023-08-01T19:54:20.367 INFO:teuthology.orchestra.run.smithi006.stdout: "bluestore_cleaner_sleep_interval": "5.000000", 2023-08-01T19:54:20.368 INFO:teuthology.orchestra.run.smithi006.stdout: "bluestore_clone_cow": "true", 2023-08-01T19:54:20.368 INFO:teuthology.orchestra.run.smithi006.stdout: "bluestore_compression_algorithm": "snappy", 2023-08-01T19:54:20.368 INFO:teuthology.orchestra.run.smithi006.stdout: "bluestore_compression_max_blob_size": "0", 2023-08-01T19:54:20.368 INFO:teuthology.orchestra.run.smithi006.stdout: "bluestore_compression_max_blob_size_hdd": "65536", 2023-08-01T19:54:20.368 INFO:teuthology.orchestra.run.smithi006.stdout: "bluestore_compression_max_blob_size_ssd": "65536", 2023-08-01T19:54:20.368 INFO:teuthology.orchestra.run.smithi006.stdout: "bluestore_compression_min_blob_size": "0", 2023-08-01T19:54:20.368 INFO:teuthology.orchestra.run.smithi006.stdout: "bluestore_compression_min_blob_size_hdd": "8192", 2023-08-01T19:54:20.369 INFO:teuthology.orchestra.run.smithi006.stdout: "bluestore_compression_min_blob_size_ssd": "65536", 2023-08-01T19:54:20.369 INFO:teuthology.orchestra.run.smithi006.stdout: "bluestore_compression_mode": "none", 2023-08-01T19:54:20.369 INFO:teuthology.orchestra.run.smithi006.stdout: "bluestore_compression_required_ratio": "0.875000", 2023-08-01T19:54:20.369 INFO:teuthology.orchestra.run.smithi006.stdout: "bluestore_csum_type": "crc32c", 2023-08-01T19:54:20.369 INFO:teuthology.orchestra.run.smithi006.stdout: "bluestore_debug_enforce_settings": "default", 2023-08-01T19:54:20.369 INFO:teuthology.orchestra.run.smithi006.stdout: "bluestore_debug_freelist": "false", 2023-08-01T19:54:20.369 INFO:teuthology.orchestra.run.smithi006.stdout: "bluestore_debug_fsck_abort": "false", 2023-08-01T19:54:20.370 INFO:teuthology.orchestra.run.smithi006.stdout: "bluestore_debug_inject_allocation_from_file_failure": "0.000000", 2023-08-01T19:54:20.370 INFO:teuthology.orchestra.run.smithi006.stdout: "bluestore_debug_inject_bug21040": "false", 2023-08-01T19:54:20.370 INFO:teuthology.orchestra.run.smithi006.stdout: "bluestore_debug_inject_csum_err_probability": "0.000000", 2023-08-01T19:54:20.370 INFO:teuthology.orchestra.run.smithi006.stdout: "bluestore_debug_inject_read_err": "false", 2023-08-01T19:54:20.370 INFO:teuthology.orchestra.run.smithi006.stdout: "bluestore_debug_legacy_omap": "false", 2023-08-01T19:54:20.370 INFO:teuthology.orchestra.run.smithi006.stdout: "bluestore_debug_no_reuse_blocks": "false", 2023-08-01T19:54:20.370 INFO:teuthology.orchestra.run.smithi006.stdout: "bluestore_debug_omit_block_device_write": "false", 2023-08-01T19:54:20.370 INFO:teuthology.orchestra.run.smithi006.stdout: "bluestore_debug_omit_kv_commit": "false", 2023-08-01T19:54:20.371 INFO:teuthology.orchestra.run.smithi006.stdout: "bluestore_debug_permit_any_bdev_label": "false", 2023-08-01T19:54:20.371 INFO:teuthology.orchestra.run.smithi006.stdout: "bluestore_debug_prefill": "0.000000", 2023-08-01T19:54:20.371 INFO:teuthology.orchestra.run.smithi006.stdout: "bluestore_debug_prefragment_max": "1048576", 2023-08-01T19:54:20.371 INFO:teuthology.orchestra.run.smithi006.stdout: "bluestore_debug_random_read_err": "0.000000", 2023-08-01T19:54:20.371 INFO:teuthology.orchestra.run.smithi006.stdout: "bluestore_debug_randomize_serial_transaction": "0", 2023-08-01T19:54:20.371 INFO:teuthology.orchestra.run.smithi006.stdout: "bluestore_debug_small_allocations": "0", 2023-08-01T19:54:20.371 INFO:teuthology.orchestra.run.smithi006.stdout: "bluestore_debug_too_many_blobs_threshold": "24576", 2023-08-01T19:54:20.371 INFO:teuthology.orchestra.run.smithi006.stdout: "bluestore_default_buffered_read": "true", 2023-08-01T19:54:20.372 INFO:teuthology.orchestra.run.smithi006.stdout: "bluestore_default_buffered_write": "false", 2023-08-01T19:54:20.372 INFO:teuthology.orchestra.run.smithi006.stdout: "bluestore_deferred_batch_ops": "0", 2023-08-01T19:54:20.372 INFO:teuthology.orchestra.run.smithi006.stdout: "bluestore_deferred_batch_ops_hdd": "64", 2023-08-01T19:54:20.372 INFO:teuthology.orchestra.run.smithi006.stdout: "bluestore_deferred_batch_ops_ssd": "16", 2023-08-01T19:54:20.372 INFO:teuthology.orchestra.run.smithi006.stdout: "bluestore_extent_map_inline_shard_prealloc_size": "256", 2023-08-01T19:54:20.372 INFO:teuthology.orchestra.run.smithi006.stdout: "bluestore_extent_map_shard_max_size": "1200", 2023-08-01T19:54:20.372 INFO:teuthology.orchestra.run.smithi006.stdout: "bluestore_extent_map_shard_min_size": "150", 2023-08-01T19:54:20.373 INFO:teuthology.orchestra.run.smithi006.stdout: "bluestore_extent_map_shard_target_size": "500", 2023-08-01T19:54:20.373 INFO:teuthology.orchestra.run.smithi006.stdout: "bluestore_extent_map_shard_target_size_slop": "0.200000", 2023-08-01T19:54:20.373 INFO:teuthology.orchestra.run.smithi006.stdout: "bluestore_fail_eio": "false", 2023-08-01T19:54:20.373 INFO:teuthology.orchestra.run.smithi006.stdout: "bluestore_freelist_blocks_per_key": "128", 2023-08-01T19:54:20.373 INFO:teuthology.orchestra.run.smithi006.stdout: "bluestore_fsck_error_on_no_per_pg_omap": "false", 2023-08-01T19:54:20.373 INFO:teuthology.orchestra.run.smithi006.stdout: "bluestore_fsck_error_on_no_per_pool_omap": "false", 2023-08-01T19:54:20.373 INFO:teuthology.orchestra.run.smithi006.stdout: "bluestore_fsck_error_on_no_per_pool_stats": "false", 2023-08-01T19:54:20.373 INFO:teuthology.orchestra.run.smithi006.stdout: "bluestore_fsck_on_mkfs": "true", 2023-08-01T19:54:20.374 INFO:teuthology.orchestra.run.smithi006.stdout: "bluestore_fsck_on_mkfs_deep": "false", 2023-08-01T19:54:20.374 INFO:teuthology.orchestra.run.smithi006.stdout: "bluestore_fsck_on_mount": "false", 2023-08-01T19:54:20.374 INFO:teuthology.orchestra.run.smithi006.stdout: "bluestore_fsck_on_mount_deep": "false", 2023-08-01T19:54:20.374 INFO:teuthology.orchestra.run.smithi006.stdout: "bluestore_fsck_on_umount": "false", 2023-08-01T19:54:20.374 INFO:teuthology.orchestra.run.smithi006.stdout: "bluestore_fsck_on_umount_deep": "false", 2023-08-01T19:54:20.374 INFO:teuthology.orchestra.run.smithi006.stdout: "bluestore_fsck_quick_fix_on_mount": "false", 2023-08-01T19:54:20.374 INFO:teuthology.orchestra.run.smithi006.stdout: "bluestore_fsck_quick_fix_threads": "2", 2023-08-01T19:54:20.374 INFO:teuthology.orchestra.run.smithi006.stdout: "bluestore_fsck_read_bytes_cap": "67108864", 2023-08-01T19:54:20.375 INFO:teuthology.orchestra.run.smithi006.stdout: "bluestore_fsck_shared_blob_tracker_size": "0.031250", 2023-08-01T19:54:20.375 INFO:teuthology.orchestra.run.smithi006.stdout: "bluestore_gc_enable_blob_threshold": "0", 2023-08-01T19:54:20.375 INFO:teuthology.orchestra.run.smithi006.stdout: "bluestore_gc_enable_total_threshold": "0", 2023-08-01T19:54:20.375 INFO:teuthology.orchestra.run.smithi006.stdout: "bluestore_hybrid_alloc_mem_cap": "67108864", 2023-08-01T19:54:20.375 INFO:teuthology.orchestra.run.smithi006.stdout: "bluestore_ignore_data_csum": "false", 2023-08-01T19:54:20.375 INFO:teuthology.orchestra.run.smithi006.stdout: "bluestore_kv_sync_util_logging_s": "10.000000", 2023-08-01T19:54:20.375 INFO:teuthology.orchestra.run.smithi006.stdout: "bluestore_kvbackend": "rocksdb", 2023-08-01T19:54:20.375 INFO:teuthology.orchestra.run.smithi006.stdout: "bluestore_log_collection_list_age": "60.000000", 2023-08-01T19:54:20.376 INFO:teuthology.orchestra.run.smithi006.stdout: "bluestore_log_omap_iterator_age": "5.000000", 2023-08-01T19:54:20.376 INFO:teuthology.orchestra.run.smithi006.stdout: "bluestore_log_op_age": "5.000000", 2023-08-01T19:54:20.376 INFO:teuthology.orchestra.run.smithi006.stdout: "bluestore_max_alloc_size": "0", 2023-08-01T19:54:20.376 INFO:teuthology.orchestra.run.smithi006.stdout: "bluestore_max_blob_size": "0", 2023-08-01T19:54:20.376 INFO:teuthology.orchestra.run.smithi006.stdout: "bluestore_max_blob_size_hdd": "65536", 2023-08-01T19:54:20.376 INFO:teuthology.orchestra.run.smithi006.stdout: "bluestore_max_blob_size_ssd": "65536", 2023-08-01T19:54:20.376 INFO:teuthology.orchestra.run.smithi006.stdout: "bluestore_max_defer_interval": "3.000000", 2023-08-01T19:54:20.377 INFO:teuthology.orchestra.run.smithi006.stdout: "bluestore_max_deferred_txc": "32", 2023-08-01T19:54:20.377 INFO:teuthology.orchestra.run.smithi006.stdout: "bluestore_min_alloc_size": "0", 2023-08-01T19:54:20.377 INFO:teuthology.orchestra.run.smithi006.stdout: "bluestore_min_alloc_size_hdd": "4096", 2023-08-01T19:54:20.377 INFO:teuthology.orchestra.run.smithi006.stdout: "bluestore_min_alloc_size_ssd": "4096", 2023-08-01T19:54:20.377 INFO:teuthology.orchestra.run.smithi006.stdout: "bluestore_nid_prealloc": "1024", 2023-08-01T19:54:20.377 INFO:teuthology.orchestra.run.smithi006.stdout: "bluestore_prefer_deferred_size": "0", 2023-08-01T19:54:20.377 INFO:teuthology.orchestra.run.smithi006.stdout: "bluestore_prefer_deferred_size_hdd": "65536", 2023-08-01T19:54:20.377 INFO:teuthology.orchestra.run.smithi006.stdout: "bluestore_prefer_deferred_size_ssd": "0", 2023-08-01T19:54:20.378 INFO:teuthology.orchestra.run.smithi006.stdout: "bluestore_qfsck_on_mount": "true", 2023-08-01T19:54:20.378 INFO:teuthology.orchestra.run.smithi006.stdout: "bluestore_retry_disk_reads": "3", 2023-08-01T19:54:20.378 INFO:teuthology.orchestra.run.smithi006.stdout: "bluestore_rocksdb_cf": "true", 2023-08-01T19:54:20.378 INFO:teuthology.orchestra.run.smithi006.stdout: "bluestore_rocksdb_cfs": "m(3) p(3,0-12) O(3,0-13)=block_cache={type=binned_lru} L P", 2023-08-01T19:54:20.378 INFO:teuthology.orchestra.run.smithi006.stdout: "bluestore_rocksdb_options": "compression=kNoCompression,max_write_buffer_number=4,min_write_buffer_number_to_merge=1,recycle_log_file_num=4,write_buffer_size=268435456,writable_file_max_buffer_size=0,compaction_readahead_size=2097152,max_background_compactions=2,max_total_wal_size=1073741824", 2023-08-01T19:54:20.378 INFO:teuthology.orchestra.run.smithi006.stdout: "bluestore_rocksdb_options_annex": "", 2023-08-01T19:54:20.378 INFO:teuthology.orchestra.run.smithi006.stdout: "bluestore_spdk_coremask": "0x1", 2023-08-01T19:54:20.378 INFO:teuthology.orchestra.run.smithi006.stdout: "bluestore_spdk_io_sleep": "5", 2023-08-01T19:54:20.379 INFO:teuthology.orchestra.run.smithi006.stdout: "bluestore_spdk_max_io_completion": "0", 2023-08-01T19:54:20.379 INFO:teuthology.orchestra.run.smithi006.stdout: "bluestore_spdk_mem": "512", 2023-08-01T19:54:20.379 INFO:teuthology.orchestra.run.smithi006.stdout: "bluestore_sync_submit_transaction": "false", 2023-08-01T19:54:20.379 INFO:teuthology.orchestra.run.smithi006.stdout: "bluestore_throttle_bytes": "67108864", 2023-08-01T19:54:20.379 INFO:teuthology.orchestra.run.smithi006.stdout: "bluestore_throttle_cost_per_io": "0", 2023-08-01T19:54:20.379 INFO:teuthology.orchestra.run.smithi006.stdout: "bluestore_throttle_cost_per_io_hdd": "670000", 2023-08-01T19:54:20.379 INFO:teuthology.orchestra.run.smithi006.stdout: "bluestore_throttle_cost_per_io_ssd": "4000", 2023-08-01T19:54:20.379 INFO:teuthology.orchestra.run.smithi006.stdout: "bluestore_throttle_deferred_bytes": "134217728", 2023-08-01T19:54:20.380 INFO:teuthology.orchestra.run.smithi006.stdout: "bluestore_throttle_trace_rate": "0.000000", 2023-08-01T19:54:20.380 INFO:teuthology.orchestra.run.smithi006.stdout: "bluestore_tracing": "false", 2023-08-01T19:54:20.380 INFO:teuthology.orchestra.run.smithi006.stdout: "bluestore_use_optimal_io_size_for_min_alloc_size": "false", 2023-08-01T19:54:20.380 INFO:teuthology.orchestra.run.smithi006.stdout: "bluestore_volume_selection_policy": "use_some_extra", 2023-08-01T19:54:20.380 INFO:teuthology.orchestra.run.smithi006.stdout: "bluestore_volume_selection_reserved": "0", 2023-08-01T19:54:20.380 INFO:teuthology.orchestra.run.smithi006.stdout: "bluestore_volume_selection_reserved_factor": "2.000000", 2023-08-01T19:54:20.380 INFO:teuthology.orchestra.run.smithi006.stdout: "bluestore_warn_on_bluefs_spillover": "true", 2023-08-01T19:54:20.381 INFO:teuthology.orchestra.run.smithi006.stdout: "bluestore_warn_on_legacy_statfs": "true", 2023-08-01T19:54:20.381 INFO:teuthology.orchestra.run.smithi006.stdout: "bluestore_warn_on_no_per_pg_omap": "false", 2023-08-01T19:54:20.381 INFO:teuthology.orchestra.run.smithi006.stdout: "bluestore_warn_on_no_per_pool_omap": "true", 2023-08-01T19:54:20.381 INFO:teuthology.orchestra.run.smithi006.stdout: "bluestore_warn_on_spurious_read_errors": "true", 2023-08-01T19:54:20.381 INFO:teuthology.orchestra.run.smithi006.stdout: "bluestore_zero_block_detection": "false", 2023-08-01T19:54:20.381 INFO:teuthology.orchestra.run.smithi006.stdout: "cephadm_path": "/usr/sbin/cephadm", 2023-08-01T19:54:20.381 INFO:teuthology.orchestra.run.smithi006.stdout: "cephfs_mirror_action_update_interval": "2", 2023-08-01T19:54:20.382 INFO:teuthology.orchestra.run.smithi006.stdout: "cephfs_mirror_directory_scan_interval": "10", 2023-08-01T19:54:20.382 INFO:teuthology.orchestra.run.smithi006.stdout: "cephfs_mirror_max_concurrent_directory_syncs": "3", 2023-08-01T19:54:20.382 INFO:teuthology.orchestra.run.smithi006.stdout: "cephfs_mirror_max_consecutive_failures_per_directory": "10", 2023-08-01T19:54:20.382 INFO:teuthology.orchestra.run.smithi006.stdout: "cephfs_mirror_max_snapshot_sync_per_cycle": "3", 2023-08-01T19:54:20.382 INFO:teuthology.orchestra.run.smithi006.stdout: "cephfs_mirror_mount_timeout": "10", 2023-08-01T19:54:20.382 INFO:teuthology.orchestra.run.smithi006.stdout: "cephfs_mirror_restart_mirror_on_blocklist_interval": "30", 2023-08-01T19:54:20.382 INFO:teuthology.orchestra.run.smithi006.stdout: "cephfs_mirror_restart_mirror_on_failure_interval": "20", 2023-08-01T19:54:20.382 INFO:teuthology.orchestra.run.smithi006.stdout: "cephfs_mirror_retry_failed_directories_interval": "60", 2023-08-01T19:54:20.383 INFO:teuthology.orchestra.run.smithi006.stdout: "cephsqlite_blocklist_dead_locker": "true", 2023-08-01T19:54:20.383 INFO:teuthology.orchestra.run.smithi006.stdout: "cephsqlite_lock_renewal_interval": "2000", 2023-08-01T19:54:20.383 INFO:teuthology.orchestra.run.smithi006.stdout: "cephsqlite_lock_renewal_timeout": "30000", 2023-08-01T19:54:20.383 INFO:teuthology.orchestra.run.smithi006.stdout: "cephx_cluster_require_signatures": "false", 2023-08-01T19:54:20.383 INFO:teuthology.orchestra.run.smithi006.stdout: "cephx_cluster_require_version": "2", 2023-08-01T19:54:20.383 INFO:teuthology.orchestra.run.smithi006.stdout: "cephx_require_signatures": "false", 2023-08-01T19:54:20.383 INFO:teuthology.orchestra.run.smithi006.stdout: "cephx_require_version": "2", 2023-08-01T19:54:20.384 INFO:teuthology.orchestra.run.smithi006.stdout: "cephx_service_require_signatures": "false", 2023-08-01T19:54:20.384 INFO:teuthology.orchestra.run.smithi006.stdout: "cephx_service_require_version": "2", 2023-08-01T19:54:20.384 INFO:teuthology.orchestra.run.smithi006.stdout: "cephx_sign_messages": "true", 2023-08-01T19:54:20.384 INFO:teuthology.orchestra.run.smithi006.stdout: "chdir": "", 2023-08-01T19:54:20.384 INFO:teuthology.orchestra.run.smithi006.stdout: "client_acl_type": "", 2023-08-01T19:54:20.384 INFO:teuthology.orchestra.run.smithi006.stdout: "client_asio_thread_count": "2", 2023-08-01T19:54:20.384 INFO:teuthology.orchestra.run.smithi006.stdout: "client_cache_mid": "0.750000", 2023-08-01T19:54:20.385 INFO:teuthology.orchestra.run.smithi006.stdout: "client_cache_size": "16384", 2023-08-01T19:54:20.385 INFO:teuthology.orchestra.run.smithi006.stdout: "client_caps_release_delay": "5", 2023-08-01T19:54:20.385 INFO:teuthology.orchestra.run.smithi006.stdout: "client_check_pool_perm": "true", 2023-08-01T19:54:20.385 INFO:teuthology.orchestra.run.smithi006.stdout: "client_collect_and_send_global_metrics": "false", 2023-08-01T19:54:20.385 INFO:teuthology.orchestra.run.smithi006.stdout: "client_debug_force_sync_read": "false", 2023-08-01T19:54:20.385 INFO:teuthology.orchestra.run.smithi006.stdout: "client_debug_getattr_caps": "false", 2023-08-01T19:54:20.385 INFO:teuthology.orchestra.run.smithi006.stdout: "client_debug_inject_tick_delay": "0", 2023-08-01T19:54:20.385 INFO:teuthology.orchestra.run.smithi006.stdout: "client_die_on_failed_dentry_invalidate": "true", 2023-08-01T19:54:20.386 INFO:teuthology.orchestra.run.smithi006.stdout: "client_die_on_failed_remount": "false", 2023-08-01T19:54:20.386 INFO:teuthology.orchestra.run.smithi006.stdout: "client_dirsize_rbytes": "true", 2023-08-01T19:54:20.386 INFO:teuthology.orchestra.run.smithi006.stdout: "client_force_lazyio": "false", 2023-08-01T19:54:20.386 INFO:teuthology.orchestra.run.smithi006.stdout: "client_fs": "", 2023-08-01T19:54:20.386 INFO:teuthology.orchestra.run.smithi006.stdout: "client_inject_fixed_oldest_tid": "false", 2023-08-01T19:54:20.386 INFO:teuthology.orchestra.run.smithi006.stdout: "client_inject_release_failure": "false", 2023-08-01T19:54:20.386 INFO:teuthology.orchestra.run.smithi006.stdout: "client_max_inline_size": "4096", 2023-08-01T19:54:20.386 INFO:teuthology.orchestra.run.smithi006.stdout: "client_max_retries_on_remount_failure": "5", 2023-08-01T19:54:20.387 INFO:teuthology.orchestra.run.smithi006.stdout: "client_mds_namespace": "", 2023-08-01T19:54:20.387 INFO:teuthology.orchestra.run.smithi006.stdout: "client_metadata": "", 2023-08-01T19:54:20.387 INFO:teuthology.orchestra.run.smithi006.stdout: "client_mount_gid": "-1", 2023-08-01T19:54:20.387 INFO:teuthology.orchestra.run.smithi006.stdout: "client_mount_timeout": "300", 2023-08-01T19:54:20.387 INFO:teuthology.orchestra.run.smithi006.stdout: "client_mount_uid": "-1", 2023-08-01T19:54:20.387 INFO:teuthology.orchestra.run.smithi006.stdout: "client_mountpoint": "/", 2023-08-01T19:54:20.387 INFO:teuthology.orchestra.run.smithi006.stdout: "client_notify_timeout": "10", 2023-08-01T19:54:20.388 INFO:teuthology.orchestra.run.smithi006.stdout: "client_oc": "true", 2023-08-01T19:54:20.388 INFO:teuthology.orchestra.run.smithi006.stdout: "client_oc_max_dirty": "104857600", 2023-08-01T19:54:20.388 INFO:teuthology.orchestra.run.smithi006.stdout: "client_oc_max_dirty_age": "5.000000", 2023-08-01T19:54:20.388 INFO:teuthology.orchestra.run.smithi006.stdout: "client_oc_max_objects": "1000", 2023-08-01T19:54:20.388 INFO:teuthology.orchestra.run.smithi006.stdout: "client_oc_size": "209715200", 2023-08-01T19:54:20.388 INFO:teuthology.orchestra.run.smithi006.stdout: "client_oc_target_dirty": "8388608", 2023-08-01T19:54:20.388 INFO:teuthology.orchestra.run.smithi006.stdout: "client_permissions": "true", 2023-08-01T19:54:20.389 INFO:teuthology.orchestra.run.smithi006.stdout: "client_quota": "true", 2023-08-01T19:54:20.389 INFO:teuthology.orchestra.run.smithi006.stdout: "client_quota_df": "true", 2023-08-01T19:54:20.389 INFO:teuthology.orchestra.run.smithi006.stdout: "client_readahead_max_bytes": "0", 2023-08-01T19:54:20.389 INFO:teuthology.orchestra.run.smithi006.stdout: "client_readahead_max_periods": "4", 2023-08-01T19:54:20.389 INFO:teuthology.orchestra.run.smithi006.stdout: "client_readahead_min": "131072", 2023-08-01T19:54:20.389 INFO:teuthology.orchestra.run.smithi006.stdout: "client_reconnect_stale": "false", 2023-08-01T19:54:20.389 INFO:teuthology.orchestra.run.smithi006.stdout: "client_shutdown_timeout": "30", 2023-08-01T19:54:20.389 INFO:teuthology.orchestra.run.smithi006.stdout: "client_snapdir": ".snap", 2023-08-01T19:54:20.390 INFO:teuthology.orchestra.run.smithi006.stdout: "client_tick_interval": "1", 2023-08-01T19:54:20.390 INFO:teuthology.orchestra.run.smithi006.stdout: "client_trace": "", 2023-08-01T19:54:20.390 INFO:teuthology.orchestra.run.smithi006.stdout: "client_try_dentry_invalidate": "false", 2023-08-01T19:54:20.390 INFO:teuthology.orchestra.run.smithi006.stdout: "client_use_faked_inos": "false", 2023-08-01T19:54:20.390 INFO:teuthology.orchestra.run.smithi006.stdout: "client_use_random_mds": "false", 2023-08-01T19:54:20.390 INFO:teuthology.orchestra.run.smithi006.stdout: "clog_to_graylog": "false", 2023-08-01T19:54:20.390 INFO:teuthology.orchestra.run.smithi006.stdout: "clog_to_graylog_host": "127.0.0.1", 2023-08-01T19:54:20.391 INFO:teuthology.orchestra.run.smithi006.stdout: "clog_to_graylog_port": "12201", 2023-08-01T19:54:20.391 INFO:teuthology.orchestra.run.smithi006.stdout: "clog_to_monitors": "default=true", 2023-08-01T19:54:20.391 INFO:teuthology.orchestra.run.smithi006.stdout: "clog_to_syslog": "false", 2023-08-01T19:54:20.391 INFO:teuthology.orchestra.run.smithi006.stdout: "clog_to_syslog_facility": "default=daemon audit=local0", 2023-08-01T19:54:20.391 INFO:teuthology.orchestra.run.smithi006.stdout: "clog_to_syslog_level": "info", 2023-08-01T19:54:20.391 INFO:teuthology.orchestra.run.smithi006.stdout: "cluster_addr": "-", 2023-08-01T19:54:20.391 INFO:teuthology.orchestra.run.smithi006.stdout: "cluster_network": "", 2023-08-01T19:54:20.391 INFO:teuthology.orchestra.run.smithi006.stdout: "cluster_network_interface": "", 2023-08-01T19:54:20.392 INFO:teuthology.orchestra.run.smithi006.stdout: "compressor_zlib_isal": "false", 2023-08-01T19:54:20.392 INFO:teuthology.orchestra.run.smithi006.stdout: "compressor_zlib_level": "5", 2023-08-01T19:54:20.392 INFO:teuthology.orchestra.run.smithi006.stdout: "compressor_zlib_winsize": "-15", 2023-08-01T19:54:20.392 INFO:teuthology.orchestra.run.smithi006.stdout: "compressor_zstd_level": "1", 2023-08-01T19:54:20.392 INFO:teuthology.orchestra.run.smithi006.stdout: "container_image": "docker.io/ceph/daemon-base:latest-master-devel", 2023-08-01T19:54:20.392 INFO:teuthology.orchestra.run.smithi006.stdout: "crash_dir": "/var/lib/ceph/crash", 2023-08-01T19:54:20.392 INFO:teuthology.orchestra.run.smithi006.stdout: "crimson_alien_op_num_threads": "6", 2023-08-01T19:54:20.392 INFO:teuthology.orchestra.run.smithi006.stdout: "crimson_alien_thread_cpu_cores": "", 2023-08-01T19:54:20.393 INFO:teuthology.orchestra.run.smithi006.stdout: "crimson_osd_obc_lru_size": "10", 2023-08-01T19:54:20.393 INFO:teuthology.orchestra.run.smithi006.stdout: "crimson_osd_scheduler_concurrency": "0", 2023-08-01T19:54:20.393 INFO:teuthology.orchestra.run.smithi006.stdout: "crush_location": "", 2023-08-01T19:54:20.393 INFO:teuthology.orchestra.run.smithi006.stdout: "crush_location_hook": "", 2023-08-01T19:54:20.393 INFO:teuthology.orchestra.run.smithi006.stdout: "crush_location_hook_timeout": "10", 2023-08-01T19:54:20.393 INFO:teuthology.orchestra.run.smithi006.stdout: "daemonize": "false", 2023-08-01T19:54:20.393 INFO:teuthology.orchestra.run.smithi006.stdout: "debug_alienstore": "0/5", 2023-08-01T19:54:20.393 INFO:teuthology.orchestra.run.smithi006.stdout: "debug_allow_any_pool_priority": "false", 2023-08-01T19:54:20.394 INFO:teuthology.orchestra.run.smithi006.stdout: "debug_asok": "1/5", 2023-08-01T19:54:20.394 INFO:teuthology.orchestra.run.smithi006.stdout: "debug_asok_assert_abort": "false", 2023-08-01T19:54:20.394 INFO:teuthology.orchestra.run.smithi006.stdout: "debug_asserts_on_shutdown": "true", 2023-08-01T19:54:20.394 INFO:teuthology.orchestra.run.smithi006.stdout: "debug_auth": "20/20", 2023-08-01T19:54:20.394 INFO:teuthology.orchestra.run.smithi006.stdout: "debug_bdev": "1/3", 2023-08-01T19:54:20.394 INFO:teuthology.orchestra.run.smithi006.stdout: "debug_bluefs": "1/5", 2023-08-01T19:54:20.394 INFO:teuthology.orchestra.run.smithi006.stdout: "debug_bluestore": "1/5", 2023-08-01T19:54:20.394 INFO:teuthology.orchestra.run.smithi006.stdout: "debug_buffer": "0/1", 2023-08-01T19:54:20.395 INFO:teuthology.orchestra.run.smithi006.stdout: "debug_ceph_exporter": "1/5", 2023-08-01T19:54:20.395 INFO:teuthology.orchestra.run.smithi006.stdout: "debug_cephfs_mirror": "0/5", 2023-08-01T19:54:20.395 INFO:teuthology.orchestra.run.smithi006.stdout: "debug_cephsqlite": "0/5", 2023-08-01T19:54:20.395 INFO:teuthology.orchestra.run.smithi006.stdout: "debug_civetweb": "1/10", 2023-08-01T19:54:20.395 INFO:teuthology.orchestra.run.smithi006.stdout: "debug_client": "0/5", 2023-08-01T19:54:20.395 INFO:teuthology.orchestra.run.smithi006.stdout: "debug_compressor": "1/5", 2023-08-01T19:54:20.395 INFO:teuthology.orchestra.run.smithi006.stdout: "debug_context": "0/1", 2023-08-01T19:54:20.395 INFO:teuthology.orchestra.run.smithi006.stdout: "debug_crush": "1/1", 2023-08-01T19:54:20.396 INFO:teuthology.orchestra.run.smithi006.stdout: "debug_crypto": "1/5", 2023-08-01T19:54:20.396 INFO:teuthology.orchestra.run.smithi006.stdout: "debug_deliberately_leak_memory": "false", 2023-08-01T19:54:20.396 INFO:teuthology.orchestra.run.smithi006.stdout: "debug_disable_randomized_ping": "false", 2023-08-01T19:54:20.396 INFO:teuthology.orchestra.run.smithi006.stdout: "debug_dpdk": "1/5", 2023-08-01T19:54:20.396 INFO:teuthology.orchestra.run.smithi006.stdout: "debug_eventtrace": "1/5", 2023-08-01T19:54:20.396 INFO:teuthology.orchestra.run.smithi006.stdout: "debug_filer": "0/1", 2023-08-01T19:54:20.396 INFO:teuthology.orchestra.run.smithi006.stdout: "debug_filestore": "1/3", 2023-08-01T19:54:20.396 INFO:teuthology.orchestra.run.smithi006.stdout: "debug_finisher": "1/1", 2023-08-01T19:54:20.397 INFO:teuthology.orchestra.run.smithi006.stdout: "debug_fuse": "1/5", 2023-08-01T19:54:20.397 INFO:teuthology.orchestra.run.smithi006.stdout: "debug_heartbeat_testing_span": "0", 2023-08-01T19:54:20.397 INFO:teuthology.orchestra.run.smithi006.stdout: "debug_heartbeatmap": "1/5", 2023-08-01T19:54:20.397 INFO:teuthology.orchestra.run.smithi006.stdout: "debug_immutable_obj_cache": "0/5", 2023-08-01T19:54:20.397 INFO:teuthology.orchestra.run.smithi006.stdout: "debug_javaclient": "1/5", 2023-08-01T19:54:20.397 INFO:teuthology.orchestra.run.smithi006.stdout: "debug_journal": "1/3", 2023-08-01T19:54:20.397 INFO:teuthology.orchestra.run.smithi006.stdout: "debug_journaler": "0/5", 2023-08-01T19:54:20.397 INFO:teuthology.orchestra.run.smithi006.stdout: "debug_kstore": "1/5", 2023-08-01T19:54:20.398 INFO:teuthology.orchestra.run.smithi006.stdout: "debug_leveldb": "4/5", 2023-08-01T19:54:20.398 INFO:teuthology.orchestra.run.smithi006.stdout: "debug_lockdep": "0/1", 2023-08-01T19:54:20.398 INFO:teuthology.orchestra.run.smithi006.stdout: "debug_mclock": "1/5", 2023-08-01T19:54:20.398 INFO:teuthology.orchestra.run.smithi006.stdout: "debug_mds": "1/5", 2023-08-01T19:54:20.398 INFO:teuthology.orchestra.run.smithi006.stdout: "debug_mds_balancer": "1/5", 2023-08-01T19:54:20.398 INFO:teuthology.orchestra.run.smithi006.stdout: "debug_mds_locker": "1/5", 2023-08-01T19:54:20.398 INFO:teuthology.orchestra.run.smithi006.stdout: "debug_mds_log": "1/5", 2023-08-01T19:54:20.399 INFO:teuthology.orchestra.run.smithi006.stdout: "debug_mds_log_expire": "1/5", 2023-08-01T19:54:20.399 INFO:teuthology.orchestra.run.smithi006.stdout: "debug_mds_migrator": "1/5", 2023-08-01T19:54:20.399 INFO:teuthology.orchestra.run.smithi006.stdout: "debug_memdb": "4/5", 2023-08-01T19:54:20.399 INFO:teuthology.orchestra.run.smithi006.stdout: "debug_mgr": "2/5", 2023-08-01T19:54:20.399 INFO:teuthology.orchestra.run.smithi006.stdout: "debug_mgrc": "1/5", 2023-08-01T19:54:20.399 INFO:teuthology.orchestra.run.smithi006.stdout: "debug_mon": "20/20", 2023-08-01T19:54:20.400 INFO:teuthology.orchestra.run.smithi006.stdout: "debug_monc": "0/10", 2023-08-01T19:54:20.400 INFO:teuthology.orchestra.run.smithi006.stdout: "debug_ms": "1/1", 2023-08-01T19:54:20.400 INFO:teuthology.orchestra.run.smithi006.stdout: "debug_none": "0/5", 2023-08-01T19:54:20.400 INFO:teuthology.orchestra.run.smithi006.stdout: "debug_objclass": "0/5", 2023-08-01T19:54:20.400 INFO:teuthology.orchestra.run.smithi006.stdout: "debug_objectcacher": "0/5", 2023-08-01T19:54:20.400 INFO:teuthology.orchestra.run.smithi006.stdout: "debug_objecter": "0/1", 2023-08-01T19:54:20.400 INFO:teuthology.orchestra.run.smithi006.stdout: "debug_optracker": "0/5", 2023-08-01T19:54:20.400 INFO:teuthology.orchestra.run.smithi006.stdout: "debug_osd": "1/5", 2023-08-01T19:54:20.401 INFO:teuthology.orchestra.run.smithi006.stdout: "debug_paxos": "20/20", 2023-08-01T19:54:20.401 INFO:teuthology.orchestra.run.smithi006.stdout: "debug_perfcounter": "1/5", 2023-08-01T19:54:20.401 INFO:teuthology.orchestra.run.smithi006.stdout: "debug_prioritycache": "1/5", 2023-08-01T19:54:20.401 INFO:teuthology.orchestra.run.smithi006.stdout: "debug_rados": "0/5", 2023-08-01T19:54:20.401 INFO:teuthology.orchestra.run.smithi006.stdout: "debug_rbd": "0/5", 2023-08-01T19:54:20.401 INFO:teuthology.orchestra.run.smithi006.stdout: "debug_rbd_mirror": "0/5", 2023-08-01T19:54:20.401 INFO:teuthology.orchestra.run.smithi006.stdout: "debug_rbd_pwl": "0/5", 2023-08-01T19:54:20.401 INFO:teuthology.orchestra.run.smithi006.stdout: "debug_rbd_replay": "0/5", 2023-08-01T19:54:20.402 INFO:teuthology.orchestra.run.smithi006.stdout: "debug_refs": "0/0", 2023-08-01T19:54:20.402 INFO:teuthology.orchestra.run.smithi006.stdout: "debug_reserver": "1/1", 2023-08-01T19:54:20.402 INFO:teuthology.orchestra.run.smithi006.stdout: "debug_rgw": "1/5", 2023-08-01T19:54:20.402 INFO:teuthology.orchestra.run.smithi006.stdout: "debug_rgw_datacache": "1/5", 2023-08-01T19:54:20.402 INFO:teuthology.orchestra.run.smithi006.stdout: "debug_rgw_sync": "1/5", 2023-08-01T19:54:20.402 INFO:teuthology.orchestra.run.smithi006.stdout: "debug_rocksdb": "4/5", 2023-08-01T19:54:20.402 INFO:teuthology.orchestra.run.smithi006.stdout: "debug_seastore": "0/5", 2023-08-01T19:54:20.403 INFO:teuthology.orchestra.run.smithi006.stdout: "debug_seastore_cache": "0/5", 2023-08-01T19:54:20.403 INFO:teuthology.orchestra.run.smithi006.stdout: "debug_seastore_cleaner": "0/5", 2023-08-01T19:54:20.403 INFO:teuthology.orchestra.run.smithi006.stdout: "debug_seastore_device": "0/5", 2023-08-01T19:54:20.403 INFO:teuthology.orchestra.run.smithi006.stdout: "debug_seastore_journal": "0/5", 2023-08-01T19:54:20.403 INFO:teuthology.orchestra.run.smithi006.stdout: "debug_seastore_lba": "0/5", 2023-08-01T19:54:20.403 INFO:teuthology.orchestra.run.smithi006.stdout: "debug_seastore_odata": "0/5", 2023-08-01T19:54:20.403 INFO:teuthology.orchestra.run.smithi006.stdout: "debug_seastore_omap": "0/5", 2023-08-01T19:54:20.403 INFO:teuthology.orchestra.run.smithi006.stdout: "debug_seastore_onode": "0/5", 2023-08-01T19:54:20.404 INFO:teuthology.orchestra.run.smithi006.stdout: "debug_seastore_tm": "0/5", 2023-08-01T19:54:20.404 INFO:teuthology.orchestra.run.smithi006.stdout: "debug_striper": "0/1", 2023-08-01T19:54:20.404 INFO:teuthology.orchestra.run.smithi006.stdout: "debug_test": "0/5", 2023-08-01T19:54:20.404 INFO:teuthology.orchestra.run.smithi006.stdout: "debug_throttle": "1/1", 2023-08-01T19:54:20.404 INFO:teuthology.orchestra.run.smithi006.stdout: "debug_timer": "0/1", 2023-08-01T19:54:20.404 INFO:teuthology.orchestra.run.smithi006.stdout: "debug_tp": "0/5", 2023-08-01T19:54:20.404 INFO:teuthology.orchestra.run.smithi006.stdout: "device_failure_prediction_mode": "none", 2023-08-01T19:54:20.404 INFO:teuthology.orchestra.run.smithi006.stdout: "enable_experimental_unrecoverable_data_corrupting_features": "", 2023-08-01T19:54:20.405 INFO:teuthology.orchestra.run.smithi006.stdout: "erasure_code_dir": "/usr/lib64/ceph/erasure-code", 2023-08-01T19:54:20.405 INFO:teuthology.orchestra.run.smithi006.stdout: "err_to_graylog": "false", 2023-08-01T19:54:20.405 INFO:teuthology.orchestra.run.smithi006.stdout: "err_to_journald": "false", 2023-08-01T19:54:20.405 INFO:teuthology.orchestra.run.smithi006.stdout: "err_to_stderr": "true", 2023-08-01T19:54:20.405 INFO:teuthology.orchestra.run.smithi006.stdout: "err_to_syslog": "false", 2023-08-01T19:54:20.405 INFO:teuthology.orchestra.run.smithi006.stdout: "event_tracing": "false", 2023-08-01T19:54:20.405 INFO:teuthology.orchestra.run.smithi006.stdout: "exporter_addr": "0.0.0.0", 2023-08-01T19:54:20.405 INFO:teuthology.orchestra.run.smithi006.stdout: "exporter_http_port": "9926", 2023-08-01T19:54:20.406 INFO:teuthology.orchestra.run.smithi006.stdout: "exporter_prio_limit": "5", 2023-08-01T19:54:20.406 INFO:teuthology.orchestra.run.smithi006.stdout: "exporter_sock_dir": "/var/run/ceph/", 2023-08-01T19:54:20.406 INFO:teuthology.orchestra.run.smithi006.stdout: "exporter_sort_metrics": "true", 2023-08-01T19:54:20.406 INFO:teuthology.orchestra.run.smithi006.stdout: "exporter_stats_period": "5", 2023-08-01T19:54:20.406 INFO:teuthology.orchestra.run.smithi006.stdout: "fake_statfs_for_testing": "0", 2023-08-01T19:54:20.406 INFO:teuthology.orchestra.run.smithi006.stdout: "fatal_signal_handlers": "true", 2023-08-01T19:54:20.406 INFO:teuthology.orchestra.run.smithi006.stdout: "filer_max_purge_ops": "10", 2023-08-01T19:54:20.406 INFO:teuthology.orchestra.run.smithi006.stdout: "filer_max_truncate_ops": "128", 2023-08-01T19:54:20.407 INFO:teuthology.orchestra.run.smithi006.stdout: "filestore_apply_finisher_threads": "1", 2023-08-01T19:54:20.407 INFO:teuthology.orchestra.run.smithi006.stdout: "filestore_blackhole": "false", 2023-08-01T19:54:20.407 INFO:teuthology.orchestra.run.smithi006.stdout: "filestore_btrfs_clone_range": "true", 2023-08-01T19:54:20.407 INFO:teuthology.orchestra.run.smithi006.stdout: "filestore_btrfs_snap": "true", 2023-08-01T19:54:20.407 INFO:teuthology.orchestra.run.smithi006.stdout: "filestore_caller_concurrency": "10", 2023-08-01T19:54:20.407 INFO:teuthology.orchestra.run.smithi006.stdout: "filestore_collect_device_partition_information": "true", 2023-08-01T19:54:20.407 INFO:teuthology.orchestra.run.smithi006.stdout: "filestore_commit_timeout": "600.000000", 2023-08-01T19:54:20.407 INFO:teuthology.orchestra.run.smithi006.stdout: "filestore_debug_inject_read_err": "false", 2023-08-01T19:54:20.408 INFO:teuthology.orchestra.run.smithi006.stdout: "filestore_debug_omap_check": "false", 2023-08-01T19:54:20.408 INFO:teuthology.orchestra.run.smithi006.stdout: "filestore_debug_random_read_err": "0.000000", 2023-08-01T19:54:20.408 INFO:teuthology.orchestra.run.smithi006.stdout: "filestore_debug_verify_split": "false", 2023-08-01T19:54:20.408 INFO:teuthology.orchestra.run.smithi006.stdout: "filestore_dump_file": "", 2023-08-01T19:54:20.408 INFO:teuthology.orchestra.run.smithi006.stdout: "filestore_expected_throughput_bytes": "209715200.000000", 2023-08-01T19:54:20.408 INFO:teuthology.orchestra.run.smithi006.stdout: "filestore_expected_throughput_ops": "200.000000", 2023-08-01T19:54:20.408 INFO:teuthology.orchestra.run.smithi006.stdout: "filestore_fadvise": "true", 2023-08-01T19:54:20.409 INFO:teuthology.orchestra.run.smithi006.stdout: "filestore_fail_eio": "true", 2023-08-01T19:54:20.409 INFO:teuthology.orchestra.run.smithi006.stdout: "filestore_fd_cache_shards": "16", 2023-08-01T19:54:20.409 INFO:teuthology.orchestra.run.smithi006.stdout: "filestore_fd_cache_size": "128", 2023-08-01T19:54:20.409 INFO:teuthology.orchestra.run.smithi006.stdout: "filestore_fiemap": "false", 2023-08-01T19:54:20.409 INFO:teuthology.orchestra.run.smithi006.stdout: "filestore_fiemap_threshold": "4096", 2023-08-01T19:54:20.409 INFO:teuthology.orchestra.run.smithi006.stdout: "filestore_fsync_flushes_journal_data": "false", 2023-08-01T19:54:20.409 INFO:teuthology.orchestra.run.smithi006.stdout: "filestore_index_retry_probability": "0.000000", 2023-08-01T19:54:20.409 INFO:teuthology.orchestra.run.smithi006.stdout: "filestore_inject_stall": "0", 2023-08-01T19:54:20.410 INFO:teuthology.orchestra.run.smithi006.stdout: "filestore_journal_parallel": "false", 2023-08-01T19:54:20.410 INFO:teuthology.orchestra.run.smithi006.stdout: "filestore_journal_trailing": "false", 2023-08-01T19:54:20.410 INFO:teuthology.orchestra.run.smithi006.stdout: "filestore_journal_writeahead": "false", 2023-08-01T19:54:20.410 INFO:teuthology.orchestra.run.smithi006.stdout: "filestore_kill_at": "0", 2023-08-01T19:54:20.410 INFO:teuthology.orchestra.run.smithi006.stdout: "filestore_max_alloc_hint_size": "1048576", 2023-08-01T19:54:20.410 INFO:teuthology.orchestra.run.smithi006.stdout: "filestore_max_inline_xattr_size": "0", 2023-08-01T19:54:20.410 INFO:teuthology.orchestra.run.smithi006.stdout: "filestore_max_inline_xattr_size_btrfs": "2048", 2023-08-01T19:54:20.410 INFO:teuthology.orchestra.run.smithi006.stdout: "filestore_max_inline_xattr_size_other": "512", 2023-08-01T19:54:20.411 INFO:teuthology.orchestra.run.smithi006.stdout: "filestore_max_inline_xattr_size_xfs": "65536", 2023-08-01T19:54:20.411 INFO:teuthology.orchestra.run.smithi006.stdout: "filestore_max_inline_xattrs": "0", 2023-08-01T19:54:20.411 INFO:teuthology.orchestra.run.smithi006.stdout: "filestore_max_inline_xattrs_btrfs": "10", 2023-08-01T19:54:20.411 INFO:teuthology.orchestra.run.smithi006.stdout: "filestore_max_inline_xattrs_other": "2", 2023-08-01T19:54:20.411 INFO:teuthology.orchestra.run.smithi006.stdout: "filestore_max_inline_xattrs_xfs": "10", 2023-08-01T19:54:20.411 INFO:teuthology.orchestra.run.smithi006.stdout: "filestore_max_sync_interval": "5.000000", 2023-08-01T19:54:20.411 INFO:teuthology.orchestra.run.smithi006.stdout: "filestore_max_xattr_value_size": "0", 2023-08-01T19:54:20.411 INFO:teuthology.orchestra.run.smithi006.stdout: "filestore_max_xattr_value_size_btrfs": "65536", 2023-08-01T19:54:20.412 INFO:teuthology.orchestra.run.smithi006.stdout: "filestore_max_xattr_value_size_other": "1024", 2023-08-01T19:54:20.412 INFO:teuthology.orchestra.run.smithi006.stdout: "filestore_max_xattr_value_size_xfs": "65536", 2023-08-01T19:54:20.412 INFO:teuthology.orchestra.run.smithi006.stdout: "filestore_merge_threshold": "-10", 2023-08-01T19:54:20.412 INFO:teuthology.orchestra.run.smithi006.stdout: "filestore_min_sync_interval": "0.010000", 2023-08-01T19:54:20.412 INFO:teuthology.orchestra.run.smithi006.stdout: "filestore_odsync_write": "false", 2023-08-01T19:54:20.412 INFO:teuthology.orchestra.run.smithi006.stdout: "filestore_omap_backend": "rocksdb", 2023-08-01T19:54:20.412 INFO:teuthology.orchestra.run.smithi006.stdout: "filestore_omap_backend_path": "", 2023-08-01T19:54:20.413 INFO:teuthology.orchestra.run.smithi006.stdout: "filestore_omap_header_cache_size": "1024", 2023-08-01T19:54:20.413 INFO:teuthology.orchestra.run.smithi006.stdout: "filestore_ondisk_finisher_threads": "1", 2023-08-01T19:54:20.413 INFO:teuthology.orchestra.run.smithi006.stdout: "filestore_op_thread_suicide_timeout": "180", 2023-08-01T19:54:20.413 INFO:teuthology.orchestra.run.smithi006.stdout: "filestore_op_thread_timeout": "60", 2023-08-01T19:54:20.413 INFO:teuthology.orchestra.run.smithi006.stdout: "filestore_op_threads": "2", 2023-08-01T19:54:20.413 INFO:teuthology.orchestra.run.smithi006.stdout: "filestore_punch_hole": "false", 2023-08-01T19:54:20.413 INFO:teuthology.orchestra.run.smithi006.stdout: "filestore_queue_high_delay_multiple": "0.000000", 2023-08-01T19:54:20.413 INFO:teuthology.orchestra.run.smithi006.stdout: "filestore_queue_high_delay_multiple_bytes": "0.000000", 2023-08-01T19:54:20.414 INFO:teuthology.orchestra.run.smithi006.stdout: "filestore_queue_high_delay_multiple_ops": "0.000000", 2023-08-01T19:54:20.414 INFO:teuthology.orchestra.run.smithi006.stdout: "filestore_queue_high_threshhold": "0.900000", 2023-08-01T19:54:20.414 INFO:teuthology.orchestra.run.smithi006.stdout: "filestore_queue_low_threshhold": "0.300000", 2023-08-01T19:54:20.414 INFO:teuthology.orchestra.run.smithi006.stdout: "filestore_queue_max_bytes": "104857600", 2023-08-01T19:54:20.414 INFO:teuthology.orchestra.run.smithi006.stdout: "filestore_queue_max_delay_multiple": "0.000000", 2023-08-01T19:54:20.414 INFO:teuthology.orchestra.run.smithi006.stdout: "filestore_queue_max_delay_multiple_bytes": "0.000000", 2023-08-01T19:54:20.414 INFO:teuthology.orchestra.run.smithi006.stdout: "filestore_queue_max_delay_multiple_ops": "0.000000", 2023-08-01T19:54:20.415 INFO:teuthology.orchestra.run.smithi006.stdout: "filestore_queue_max_ops": "50", 2023-08-01T19:54:20.415 INFO:teuthology.orchestra.run.smithi006.stdout: "filestore_rocksdb_options": "max_background_jobs=10,compaction_readahead_size=2097152,compression=kNoCompression", 2023-08-01T19:54:20.415 INFO:teuthology.orchestra.run.smithi006.stdout: "filestore_seek_data_hole": "false", 2023-08-01T19:54:20.415 INFO:teuthology.orchestra.run.smithi006.stdout: "filestore_sloppy_crc": "false", 2023-08-01T19:54:20.415 INFO:teuthology.orchestra.run.smithi006.stdout: "filestore_sloppy_crc_block_size": "65536", 2023-08-01T19:54:20.415 INFO:teuthology.orchestra.run.smithi006.stdout: "filestore_splice": "false", 2023-08-01T19:54:20.415 INFO:teuthology.orchestra.run.smithi006.stdout: "filestore_split_multiple": "2", 2023-08-01T19:54:20.415 INFO:teuthology.orchestra.run.smithi006.stdout: "filestore_split_rand_factor": "20", 2023-08-01T19:54:20.416 INFO:teuthology.orchestra.run.smithi006.stdout: "filestore_update_to": "1000", 2023-08-01T19:54:20.416 INFO:teuthology.orchestra.run.smithi006.stdout: "filestore_wbthrottle_btrfs_bytes_hard_limit": "419430400", 2023-08-01T19:54:20.416 INFO:teuthology.orchestra.run.smithi006.stdout: "filestore_wbthrottle_btrfs_bytes_start_flusher": "41943040", 2023-08-01T19:54:20.416 INFO:teuthology.orchestra.run.smithi006.stdout: "filestore_wbthrottle_btrfs_inodes_hard_limit": "5000", 2023-08-01T19:54:20.416 INFO:teuthology.orchestra.run.smithi006.stdout: "filestore_wbthrottle_btrfs_inodes_start_flusher": "500", 2023-08-01T19:54:20.416 INFO:teuthology.orchestra.run.smithi006.stdout: "filestore_wbthrottle_btrfs_ios_hard_limit": "5000", 2023-08-01T19:54:20.416 INFO:teuthology.orchestra.run.smithi006.stdout: "filestore_wbthrottle_btrfs_ios_start_flusher": "500", 2023-08-01T19:54:20.417 INFO:teuthology.orchestra.run.smithi006.stdout: "filestore_wbthrottle_enable": "true", 2023-08-01T19:54:20.417 INFO:teuthology.orchestra.run.smithi006.stdout: "filestore_wbthrottle_xfs_bytes_hard_limit": "419430400", 2023-08-01T19:54:20.417 INFO:teuthology.orchestra.run.smithi006.stdout: "filestore_wbthrottle_xfs_bytes_start_flusher": "41943040", 2023-08-01T19:54:20.417 INFO:teuthology.orchestra.run.smithi006.stdout: "filestore_wbthrottle_xfs_inodes_hard_limit": "5000", 2023-08-01T19:54:20.417 INFO:teuthology.orchestra.run.smithi006.stdout: "filestore_wbthrottle_xfs_inodes_start_flusher": "500", 2023-08-01T19:54:20.417 INFO:teuthology.orchestra.run.smithi006.stdout: "filestore_wbthrottle_xfs_ios_hard_limit": "5000", 2023-08-01T19:54:20.417 INFO:teuthology.orchestra.run.smithi006.stdout: "filestore_wbthrottle_xfs_ios_start_flusher": "500", 2023-08-01T19:54:20.417 INFO:teuthology.orchestra.run.smithi006.stdout: "filestore_xfs_extsize": "false", 2023-08-01T19:54:20.418 INFO:teuthology.orchestra.run.smithi006.stdout: "filestore_zfs_snap": "false", 2023-08-01T19:54:20.418 INFO:teuthology.orchestra.run.smithi006.stdout: "fio_dir": "/tmp/fio", 2023-08-01T19:54:20.418 INFO:teuthology.orchestra.run.smithi006.stdout: "fsid": "a0e420cc-4df1-42a5-8bd4-a98c309a9349", 2023-08-01T19:54:20.418 INFO:teuthology.orchestra.run.smithi006.stdout: "fuse_allow_other": "true", 2023-08-01T19:54:20.418 INFO:teuthology.orchestra.run.smithi006.stdout: "fuse_atomic_o_trunc": "true", 2023-08-01T19:54:20.418 INFO:teuthology.orchestra.run.smithi006.stdout: "fuse_big_writes": "true", 2023-08-01T19:54:20.418 INFO:teuthology.orchestra.run.smithi006.stdout: "fuse_debug": "false", 2023-08-01T19:54:20.419 INFO:teuthology.orchestra.run.smithi006.stdout: "fuse_default_permissions": "false", 2023-08-01T19:54:20.419 INFO:teuthology.orchestra.run.smithi006.stdout: "fuse_disable_pagecache": "false", 2023-08-01T19:54:20.419 INFO:teuthology.orchestra.run.smithi006.stdout: "fuse_max_write": "0", 2023-08-01T19:54:20.419 INFO:teuthology.orchestra.run.smithi006.stdout: "fuse_multithreaded": "true", 2023-08-01T19:54:20.419 INFO:teuthology.orchestra.run.smithi006.stdout: "fuse_require_active_mds": "true", 2023-08-01T19:54:20.419 INFO:teuthology.orchestra.run.smithi006.stdout: "fuse_set_user_groups": "true", 2023-08-01T19:54:20.419 INFO:teuthology.orchestra.run.smithi006.stdout: "fuse_splice_move": "true", 2023-08-01T19:54:20.420 INFO:teuthology.orchestra.run.smithi006.stdout: "fuse_splice_read": "true", 2023-08-01T19:54:20.420 INFO:teuthology.orchestra.run.smithi006.stdout: "fuse_splice_write": "true", 2023-08-01T19:54:20.420 INFO:teuthology.orchestra.run.smithi006.stdout: "fuse_syncfs_on_mksnap": "true", 2023-08-01T19:54:20.420 INFO:teuthology.orchestra.run.smithi006.stdout: "fuse_use_invalidate_cb": "true", 2023-08-01T19:54:20.420 INFO:teuthology.orchestra.run.smithi006.stdout: "gss_ktab_client_file": "/var/lib/ceph/mon.a/gss_client_mon.a.ktab", 2023-08-01T19:54:20.420 INFO:teuthology.orchestra.run.smithi006.stdout: "gss_target_name": "ceph", 2023-08-01T19:54:20.420 INFO:teuthology.orchestra.run.smithi006.stdout: "heartbeat_file": "", 2023-08-01T19:54:20.420 INFO:teuthology.orchestra.run.smithi006.stdout: "heartbeat_inject_failure": "0", 2023-08-01T19:54:20.421 INFO:teuthology.orchestra.run.smithi006.stdout: "heartbeat_interval": "5", 2023-08-01T19:54:20.421 INFO:teuthology.orchestra.run.smithi006.stdout: "host": "smithi006", 2023-08-01T19:54:20.421 INFO:teuthology.orchestra.run.smithi006.stdout: "immutable_object_cache_client_dedicated_thread_num": "2", 2023-08-01T19:54:20.421 INFO:teuthology.orchestra.run.smithi006.stdout: "immutable_object_cache_max_inflight_ops": "128", 2023-08-01T19:54:20.421 INFO:teuthology.orchestra.run.smithi006.stdout: "immutable_object_cache_max_size": "1073741824", 2023-08-01T19:54:20.421 INFO:teuthology.orchestra.run.smithi006.stdout: "immutable_object_cache_path": "/tmp/ceph_immutable_object_cache", 2023-08-01T19:54:20.421 INFO:teuthology.orchestra.run.smithi006.stdout: "immutable_object_cache_qos_bps_burst": "0", 2023-08-01T19:54:20.421 INFO:teuthology.orchestra.run.smithi006.stdout: "immutable_object_cache_qos_bps_burst_seconds": "1", 2023-08-01T19:54:20.422 INFO:teuthology.orchestra.run.smithi006.stdout: "immutable_object_cache_qos_bps_limit": "0", 2023-08-01T19:54:20.422 INFO:teuthology.orchestra.run.smithi006.stdout: "immutable_object_cache_qos_iops_burst": "0", 2023-08-01T19:54:20.422 INFO:teuthology.orchestra.run.smithi006.stdout: "immutable_object_cache_qos_iops_burst_seconds": "1", 2023-08-01T19:54:20.422 INFO:teuthology.orchestra.run.smithi006.stdout: "immutable_object_cache_qos_iops_limit": "0", 2023-08-01T19:54:20.422 INFO:teuthology.orchestra.run.smithi006.stdout: "immutable_object_cache_qos_schedule_tick_min": "50", 2023-08-01T19:54:20.422 INFO:teuthology.orchestra.run.smithi006.stdout: "immutable_object_cache_sock": "/var/run/ceph/immutable_object_cache_sock", 2023-08-01T19:54:20.422 INFO:teuthology.orchestra.run.smithi006.stdout: "immutable_object_cache_watermark": "0.900000", 2023-08-01T19:54:20.423 INFO:teuthology.orchestra.run.smithi006.stdout: "inject_early_sigterm": "false", 2023-08-01T19:54:20.423 INFO:teuthology.orchestra.run.smithi006.stdout: "jaeger_tracing_enable": "false", 2023-08-01T19:54:20.423 INFO:teuthology.orchestra.run.smithi006.stdout: "journal_aio": "true", 2023-08-01T19:54:20.423 INFO:teuthology.orchestra.run.smithi006.stdout: "journal_align_min_size": "65536", 2023-08-01T19:54:20.423 INFO:teuthology.orchestra.run.smithi006.stdout: "journal_block_align": "true", 2023-08-01T19:54:20.423 INFO:teuthology.orchestra.run.smithi006.stdout: "journal_block_size": "4096", 2023-08-01T19:54:20.423 INFO:teuthology.orchestra.run.smithi006.stdout: "journal_dio": "true", 2023-08-01T19:54:20.423 INFO:teuthology.orchestra.run.smithi006.stdout: "journal_discard": "false", 2023-08-01T19:54:20.424 INFO:teuthology.orchestra.run.smithi006.stdout: "journal_force_aio": "false", 2023-08-01T19:54:20.424 INFO:teuthology.orchestra.run.smithi006.stdout: "journal_ignore_corruption": "false", 2023-08-01T19:54:20.424 INFO:teuthology.orchestra.run.smithi006.stdout: "journal_max_write_bytes": "10485760", 2023-08-01T19:54:20.424 INFO:teuthology.orchestra.run.smithi006.stdout: "journal_max_write_entries": "100", 2023-08-01T19:54:20.424 INFO:teuthology.orchestra.run.smithi006.stdout: "journal_replay_from": "0", 2023-08-01T19:54:20.424 INFO:teuthology.orchestra.run.smithi006.stdout: "journal_throttle_high_multiple": "0.000000", 2023-08-01T19:54:20.424 INFO:teuthology.orchestra.run.smithi006.stdout: "journal_throttle_high_threshhold": "0.900000", 2023-08-01T19:54:20.424 INFO:teuthology.orchestra.run.smithi006.stdout: "journal_throttle_low_threshhold": "0.600000", 2023-08-01T19:54:20.425 INFO:teuthology.orchestra.run.smithi006.stdout: "journal_throttle_max_multiple": "0.000000", 2023-08-01T19:54:20.425 INFO:teuthology.orchestra.run.smithi006.stdout: "journal_write_header_frequency": "0", 2023-08-01T19:54:20.425 INFO:teuthology.orchestra.run.smithi006.stdout: "journal_zero_on_create": "false", 2023-08-01T19:54:20.425 INFO:teuthology.orchestra.run.smithi006.stdout: "journaler_prefetch_periods": "10", 2023-08-01T19:54:20.425 INFO:teuthology.orchestra.run.smithi006.stdout: "journaler_prezero_periods": "5", 2023-08-01T19:54:20.425 INFO:teuthology.orchestra.run.smithi006.stdout: "journaler_write_head_interval": "15", 2023-08-01T19:54:20.425 INFO:teuthology.orchestra.run.smithi006.stdout: "key": "", 2023-08-01T19:54:20.426 INFO:teuthology.orchestra.run.smithi006.stdout: "keyfile": "", 2023-08-01T19:54:20.426 INFO:teuthology.orchestra.run.smithi006.stdout: "keyring": "/var/lib/ceph/mon/ceph-a/keyring", 2023-08-01T19:54:20.426 INFO:teuthology.orchestra.run.smithi006.stdout: "kstore_backend": "rocksdb", 2023-08-01T19:54:20.426 INFO:teuthology.orchestra.run.smithi006.stdout: "kstore_default_stripe_size": "65536", 2023-08-01T19:54:20.426 INFO:teuthology.orchestra.run.smithi006.stdout: "kstore_fsck_on_mount": "false", 2023-08-01T19:54:20.426 INFO:teuthology.orchestra.run.smithi006.stdout: "kstore_fsck_on_mount_deep": "true", 2023-08-01T19:54:20.426 INFO:teuthology.orchestra.run.smithi006.stdout: "kstore_max_bytes": "67108864", 2023-08-01T19:54:20.426 INFO:teuthology.orchestra.run.smithi006.stdout: "kstore_max_ops": "512", 2023-08-01T19:54:20.427 INFO:teuthology.orchestra.run.smithi006.stdout: "kstore_nid_prealloc": "1024", 2023-08-01T19:54:20.427 INFO:teuthology.orchestra.run.smithi006.stdout: "kstore_onode_map_size": "1024", 2023-08-01T19:54:20.427 INFO:teuthology.orchestra.run.smithi006.stdout: "kstore_rocksdb_options": "compression=kNoCompression", 2023-08-01T19:54:20.427 INFO:teuthology.orchestra.run.smithi006.stdout: "kstore_sync_submit_transaction": "false", 2023-08-01T19:54:20.427 INFO:teuthology.orchestra.run.smithi006.stdout: "kstore_sync_transaction": "false", 2023-08-01T19:54:20.427 INFO:teuthology.orchestra.run.smithi006.stdout: "leveldb_block_size": "65536", 2023-08-01T19:54:20.427 INFO:teuthology.orchestra.run.smithi006.stdout: "leveldb_bloom_size": "0", 2023-08-01T19:54:20.428 INFO:teuthology.orchestra.run.smithi006.stdout: "leveldb_cache_size": "536870912", 2023-08-01T19:54:20.428 INFO:teuthology.orchestra.run.smithi006.stdout: "leveldb_compact_on_mount": "false", 2023-08-01T19:54:20.428 INFO:teuthology.orchestra.run.smithi006.stdout: "leveldb_compression": "false", 2023-08-01T19:54:20.428 INFO:teuthology.orchestra.run.smithi006.stdout: "leveldb_log": "", 2023-08-01T19:54:20.428 INFO:teuthology.orchestra.run.smithi006.stdout: "leveldb_log_to_ceph_log": "true", 2023-08-01T19:54:20.428 INFO:teuthology.orchestra.run.smithi006.stdout: "leveldb_max_open_files": "0", 2023-08-01T19:54:20.428 INFO:teuthology.orchestra.run.smithi006.stdout: "leveldb_paranoid": "false", 2023-08-01T19:54:20.428 INFO:teuthology.orchestra.run.smithi006.stdout: "leveldb_write_buffer_size": "33554432", 2023-08-01T19:54:20.429 INFO:teuthology.orchestra.run.smithi006.stdout: "librados_thread_count": "2", 2023-08-01T19:54:20.429 INFO:teuthology.orchestra.run.smithi006.stdout: "lockdep": "false", 2023-08-01T19:54:20.429 INFO:teuthology.orchestra.run.smithi006.stdout: "lockdep_force_backtrace": "false", 2023-08-01T19:54:20.429 INFO:teuthology.orchestra.run.smithi006.stdout: "log_coarse_timestamps": "true", 2023-08-01T19:54:20.429 INFO:teuthology.orchestra.run.smithi006.stdout: "log_file": "/var/log/ceph/ceph-mon.a.log", 2023-08-01T19:54:20.429 INFO:teuthology.orchestra.run.smithi006.stdout: "log_flush_on_exit": "false", 2023-08-01T19:54:20.429 INFO:teuthology.orchestra.run.smithi006.stdout: "log_graylog_host": "127.0.0.1", 2023-08-01T19:54:20.429 INFO:teuthology.orchestra.run.smithi006.stdout: "log_graylog_port": "12201", 2023-08-01T19:54:20.430 INFO:teuthology.orchestra.run.smithi006.stdout: "log_max_new": "1000", 2023-08-01T19:54:20.430 INFO:teuthology.orchestra.run.smithi006.stdout: "log_max_recent": "10000", 2023-08-01T19:54:20.430 INFO:teuthology.orchestra.run.smithi006.stdout: "log_stderr_prefix": "", 2023-08-01T19:54:20.430 INFO:teuthology.orchestra.run.smithi006.stdout: "log_stop_at_utilization": "0.970000", 2023-08-01T19:54:20.430 INFO:teuthology.orchestra.run.smithi006.stdout: "log_to_file": "true", 2023-08-01T19:54:20.430 INFO:teuthology.orchestra.run.smithi006.stdout: "log_to_graylog": "false", 2023-08-01T19:54:20.430 INFO:teuthology.orchestra.run.smithi006.stdout: "log_to_journald": "false", 2023-08-01T19:54:20.430 INFO:teuthology.orchestra.run.smithi006.stdout: "log_to_stderr": "false", 2023-08-01T19:54:20.431 INFO:teuthology.orchestra.run.smithi006.stdout: "log_to_syslog": "false", 2023-08-01T19:54:20.431 INFO:teuthology.orchestra.run.smithi006.stdout: "max_rotating_auth_attempts": "10", 2023-08-01T19:54:20.431 INFO:teuthology.orchestra.run.smithi006.stdout: "mds_abort_on_newly_corrupt_dentry": "true", 2023-08-01T19:54:20.431 INFO:teuthology.orchestra.run.smithi006.stdout: "mds_action_on_write_error": "1", 2023-08-01T19:54:20.431 INFO:teuthology.orchestra.run.smithi006.stdout: "mds_alternate_name_max": "8192", 2023-08-01T19:54:20.431 INFO:teuthology.orchestra.run.smithi006.stdout: "mds_asio_thread_count": "2", 2023-08-01T19:54:20.431 INFO:teuthology.orchestra.run.smithi006.stdout: "mds_bal_export_pin": "true", 2023-08-01T19:54:20.431 INFO:teuthology.orchestra.run.smithi006.stdout: "mds_bal_fragment_dirs": "true", 2023-08-01T19:54:20.432 INFO:teuthology.orchestra.run.smithi006.stdout: "mds_bal_fragment_fast_factor": "1.500000", 2023-08-01T19:54:20.432 INFO:teuthology.orchestra.run.smithi006.stdout: "mds_bal_fragment_interval": "5", 2023-08-01T19:54:20.432 INFO:teuthology.orchestra.run.smithi006.stdout: "mds_bal_fragment_size_max": "100000", 2023-08-01T19:54:20.432 INFO:teuthology.orchestra.run.smithi006.stdout: "mds_bal_idle_threshold": "0.000000", 2023-08-01T19:54:20.432 INFO:teuthology.orchestra.run.smithi006.stdout: "mds_bal_interval": "10", 2023-08-01T19:54:20.432 INFO:teuthology.orchestra.run.smithi006.stdout: "mds_bal_max": "-1", 2023-08-01T19:54:20.432 INFO:teuthology.orchestra.run.smithi006.stdout: "mds_bal_max_until": "-1", 2023-08-01T19:54:20.433 INFO:teuthology.orchestra.run.smithi006.stdout: "mds_bal_merge_size": "50", 2023-08-01T19:54:20.433 INFO:teuthology.orchestra.run.smithi006.stdout: "mds_bal_midchunk": "0.300000", 2023-08-01T19:54:20.433 INFO:teuthology.orchestra.run.smithi006.stdout: "mds_bal_min_rebalance": "0.100000", 2023-08-01T19:54:20.433 INFO:teuthology.orchestra.run.smithi006.stdout: "mds_bal_min_start": "0.200000", 2023-08-01T19:54:20.433 INFO:teuthology.orchestra.run.smithi006.stdout: "mds_bal_minchunk": "0.001000", 2023-08-01T19:54:20.433 INFO:teuthology.orchestra.run.smithi006.stdout: "mds_bal_mode": "0", 2023-08-01T19:54:20.433 INFO:teuthology.orchestra.run.smithi006.stdout: "mds_bal_need_max": "1.200000", 2023-08-01T19:54:20.433 INFO:teuthology.orchestra.run.smithi006.stdout: "mds_bal_need_min": "0.800000", 2023-08-01T19:54:20.434 INFO:teuthology.orchestra.run.smithi006.stdout: "mds_bal_replicate_threshold": "8000.000000", 2023-08-01T19:54:20.434 INFO:teuthology.orchestra.run.smithi006.stdout: "mds_bal_sample_interval": "3.000000", 2023-08-01T19:54:20.434 INFO:teuthology.orchestra.run.smithi006.stdout: "mds_bal_split_bits": "3", 2023-08-01T19:54:20.434 INFO:teuthology.orchestra.run.smithi006.stdout: "mds_bal_split_rd": "25000.000000", 2023-08-01T19:54:20.434 INFO:teuthology.orchestra.run.smithi006.stdout: "mds_bal_split_size": "10000", 2023-08-01T19:54:20.434 INFO:teuthology.orchestra.run.smithi006.stdout: "mds_bal_split_wr": "10000.000000", 2023-08-01T19:54:20.434 INFO:teuthology.orchestra.run.smithi006.stdout: "mds_bal_target_decay": "10.000000", 2023-08-01T19:54:20.434 INFO:teuthology.orchestra.run.smithi006.stdout: "mds_bal_unreplicate_threshold": "0.000000", 2023-08-01T19:54:20.435 INFO:teuthology.orchestra.run.smithi006.stdout: "mds_beacon_grace": "15.000000", 2023-08-01T19:54:20.435 INFO:teuthology.orchestra.run.smithi006.stdout: "mds_beacon_interval": "4.000000", 2023-08-01T19:54:20.435 INFO:teuthology.orchestra.run.smithi006.stdout: "mds_beacon_mon_down_grace": "60", 2023-08-01T19:54:20.435 INFO:teuthology.orchestra.run.smithi006.stdout: "mds_cache_memory_limit": "4294967296", 2023-08-01T19:54:20.435 INFO:teuthology.orchestra.run.smithi006.stdout: "mds_cache_mid": "0.700000", 2023-08-01T19:54:20.435 INFO:teuthology.orchestra.run.smithi006.stdout: "mds_cache_release_free_interval": "10", 2023-08-01T19:54:20.435 INFO:teuthology.orchestra.run.smithi006.stdout: "mds_cache_reservation": "0.050000", 2023-08-01T19:54:20.436 INFO:teuthology.orchestra.run.smithi006.stdout: "mds_cache_trim_decay_rate": "1.000000", 2023-08-01T19:54:20.436 INFO:teuthology.orchestra.run.smithi006.stdout: "mds_cache_trim_interval": "1", 2023-08-01T19:54:20.436 INFO:teuthology.orchestra.run.smithi006.stdout: "mds_cache_trim_threshold": "262144", 2023-08-01T19:54:20.436 INFO:teuthology.orchestra.run.smithi006.stdout: "mds_cap_acquisition_throttle_retry_request_timeout": "0.500000", 2023-08-01T19:54:20.436 INFO:teuthology.orchestra.run.smithi006.stdout: "mds_cap_revoke_eviction_timeout": "0.000000", 2023-08-01T19:54:20.436 INFO:teuthology.orchestra.run.smithi006.stdout: "mds_client_delegate_inos_pct": "50", 2023-08-01T19:54:20.436 INFO:teuthology.orchestra.run.smithi006.stdout: "mds_client_prealloc_inos": "1000", 2023-08-01T19:54:20.436 INFO:teuthology.orchestra.run.smithi006.stdout: "mds_client_writeable_range_max_inc_objs": "1024", 2023-08-01T19:54:20.437 INFO:teuthology.orchestra.run.smithi006.stdout: "mds_connect_bootstrapping": "false", 2023-08-01T19:54:20.437 INFO:teuthology.orchestra.run.smithi006.stdout: "mds_damage_table_max_entries": "10000", 2023-08-01T19:54:20.437 INFO:teuthology.orchestra.run.smithi006.stdout: "mds_data": "/var/lib/ceph/mds/ceph-a", 2023-08-01T19:54:20.437 INFO:teuthology.orchestra.run.smithi006.stdout: "mds_debug_auth_pins": "false", 2023-08-01T19:54:20.437 INFO:teuthology.orchestra.run.smithi006.stdout: "mds_debug_frag": "false", 2023-08-01T19:54:20.437 INFO:teuthology.orchestra.run.smithi006.stdout: "mds_debug_scatterstat": "false", 2023-08-01T19:54:20.437 INFO:teuthology.orchestra.run.smithi006.stdout: "mds_debug_subtrees": "false", 2023-08-01T19:54:20.437 INFO:teuthology.orchestra.run.smithi006.stdout: "mds_decay_halflife": "5.000000", 2023-08-01T19:54:20.438 INFO:teuthology.orchestra.run.smithi006.stdout: "mds_default_dir_hash": "2", 2023-08-01T19:54:20.438 INFO:teuthology.orchestra.run.smithi006.stdout: "mds_defer_session_stale": "true", 2023-08-01T19:54:20.438 INFO:teuthology.orchestra.run.smithi006.stdout: "mds_deny_all_reconnect": "false", 2023-08-01T19:54:20.438 INFO:teuthology.orchestra.run.smithi006.stdout: "mds_dir_keys_per_op": "16384", 2023-08-01T19:54:20.438 INFO:teuthology.orchestra.run.smithi006.stdout: "mds_dir_max_commit_size": "10", 2023-08-01T19:54:20.438 INFO:teuthology.orchestra.run.smithi006.stdout: "mds_dir_max_entries": "0", 2023-08-01T19:54:20.438 INFO:teuthology.orchestra.run.smithi006.stdout: "mds_dirstat_min_interval": "1.000000", 2023-08-01T19:54:20.438 INFO:teuthology.orchestra.run.smithi006.stdout: "mds_dump_cache_after_rejoin": "false", 2023-08-01T19:54:20.439 INFO:teuthology.orchestra.run.smithi006.stdout: "mds_dump_cache_on_map": "false", 2023-08-01T19:54:20.439 INFO:teuthology.orchestra.run.smithi006.stdout: "mds_dump_cache_threshold_file": "0", 2023-08-01T19:54:20.439 INFO:teuthology.orchestra.run.smithi006.stdout: "mds_dump_cache_threshold_formatter": "1073741824", 2023-08-01T19:54:20.439 INFO:teuthology.orchestra.run.smithi006.stdout: "mds_early_reply": "true", 2023-08-01T19:54:20.439 INFO:teuthology.orchestra.run.smithi006.stdout: "mds_enable_op_tracker": "true", 2023-08-01T19:54:20.439 INFO:teuthology.orchestra.run.smithi006.stdout: "mds_enforce_unique_name": "true", 2023-08-01T19:54:20.439 INFO:teuthology.orchestra.run.smithi006.stdout: "mds_export_ephemeral_distributed": "true", 2023-08-01T19:54:20.439 INFO:teuthology.orchestra.run.smithi006.stdout: "mds_export_ephemeral_distributed_factor": "2.000000", 2023-08-01T19:54:20.440 INFO:teuthology.orchestra.run.smithi006.stdout: "mds_export_ephemeral_random": "true", 2023-08-01T19:54:20.440 INFO:teuthology.orchestra.run.smithi006.stdout: "mds_export_ephemeral_random_max": "0.010000", 2023-08-01T19:54:20.440 INFO:teuthology.orchestra.run.smithi006.stdout: "mds_forward_all_requests_to_auth": "false", 2023-08-01T19:54:20.440 INFO:teuthology.orchestra.run.smithi006.stdout: "mds_freeze_tree_timeout": "30.000000", 2023-08-01T19:54:20.440 INFO:teuthology.orchestra.run.smithi006.stdout: "mds_go_bad_corrupt_dentry": "true", 2023-08-01T19:54:20.440 INFO:teuthology.orchestra.run.smithi006.stdout: "mds_hack_allow_loading_invalid_metadata": "false", 2023-08-01T19:54:20.440 INFO:teuthology.orchestra.run.smithi006.stdout: "mds_health_cache_threshold": "1.500000", 2023-08-01T19:54:20.440 INFO:teuthology.orchestra.run.smithi006.stdout: "mds_health_summarize_threshold": "10", 2023-08-01T19:54:20.441 INFO:teuthology.orchestra.run.smithi006.stdout: "mds_heartbeat_grace": "15.000000", 2023-08-01T19:54:20.441 INFO:teuthology.orchestra.run.smithi006.stdout: "mds_heartbeat_reset_grace": "1000", 2023-08-01T19:54:20.441 INFO:teuthology.orchestra.run.smithi006.stdout: "mds_inject_health_dummy": "false", 2023-08-01T19:54:20.441 INFO:teuthology.orchestra.run.smithi006.stdout: "mds_inject_journal_corrupt_dentry_first": "0.000000", 2023-08-01T19:54:20.441 INFO:teuthology.orchestra.run.smithi006.stdout: "mds_inject_migrator_session_race": "false", 2023-08-01T19:54:20.441 INFO:teuthology.orchestra.run.smithi006.stdout: "mds_inject_rename_corrupt_dentry_first": "0.000000", 2023-08-01T19:54:20.441 INFO:teuthology.orchestra.run.smithi006.stdout: "mds_inject_skip_replaying_inotable": "false", 2023-08-01T19:54:20.441 INFO:teuthology.orchestra.run.smithi006.stdout: "mds_inject_traceless_reply_probability": "0.000000", 2023-08-01T19:54:20.442 INFO:teuthology.orchestra.run.smithi006.stdout: "mds_join_fs": "", 2023-08-01T19:54:20.442 INFO:teuthology.orchestra.run.smithi006.stdout: "mds_journal_format": "1", 2023-08-01T19:54:20.442 INFO:teuthology.orchestra.run.smithi006.stdout: "mds_kill_create_at": "0", 2023-08-01T19:54:20.442 INFO:teuthology.orchestra.run.smithi006.stdout: "mds_kill_export_at": "0", 2023-08-01T19:54:20.442 INFO:teuthology.orchestra.run.smithi006.stdout: "mds_kill_import_at": "0", 2023-08-01T19:54:20.442 INFO:teuthology.orchestra.run.smithi006.stdout: "mds_kill_journal_at": "0", 2023-08-01T19:54:20.442 INFO:teuthology.orchestra.run.smithi006.stdout: "mds_kill_journal_expire_at": "0", 2023-08-01T19:54:20.442 INFO:teuthology.orchestra.run.smithi006.stdout: "mds_kill_journal_replay_at": "0", 2023-08-01T19:54:20.443 INFO:teuthology.orchestra.run.smithi006.stdout: "mds_kill_link_at": "0", 2023-08-01T19:54:20.443 INFO:teuthology.orchestra.run.smithi006.stdout: "mds_kill_mdstable_at": "0", 2023-08-01T19:54:20.443 INFO:teuthology.orchestra.run.smithi006.stdout: "mds_kill_openc_at": "0", 2023-08-01T19:54:20.443 INFO:teuthology.orchestra.run.smithi006.stdout: "mds_kill_rename_at": "0", 2023-08-01T19:54:20.443 INFO:teuthology.orchestra.run.smithi006.stdout: "mds_kill_skip_replaying_inotable": "false", 2023-08-01T19:54:20.443 INFO:teuthology.orchestra.run.smithi006.stdout: "mds_log_events_per_segment": "1024", 2023-08-01T19:54:20.443 INFO:teuthology.orchestra.run.smithi006.stdout: "mds_log_max_events": "-1", 2023-08-01T19:54:20.444 INFO:teuthology.orchestra.run.smithi006.stdout: "mds_log_max_segments": "128", 2023-08-01T19:54:20.444 INFO:teuthology.orchestra.run.smithi006.stdout: "mds_log_pause": "false", 2023-08-01T19:54:20.444 INFO:teuthology.orchestra.run.smithi006.stdout: "mds_log_segment_size": "0", 2023-08-01T19:54:20.444 INFO:teuthology.orchestra.run.smithi006.stdout: "mds_log_skip_corrupt_events": "false", 2023-08-01T19:54:20.444 INFO:teuthology.orchestra.run.smithi006.stdout: "mds_log_warn_factor": "2.000000", 2023-08-01T19:54:20.444 INFO:teuthology.orchestra.run.smithi006.stdout: "mds_max_caps_per_client": "1048576", 2023-08-01T19:54:20.444 INFO:teuthology.orchestra.run.smithi006.stdout: "mds_max_completed_flushes": "100000", 2023-08-01T19:54:20.444 INFO:teuthology.orchestra.run.smithi006.stdout: "mds_max_completed_requests": "100000", 2023-08-01T19:54:20.445 INFO:teuthology.orchestra.run.smithi006.stdout: "mds_max_export_size": "20971520", 2023-08-01T19:54:20.445 INFO:teuthology.orchestra.run.smithi006.stdout: "mds_max_file_recover": "32", 2023-08-01T19:54:20.445 INFO:teuthology.orchestra.run.smithi006.stdout: "mds_max_purge_files": "64", 2023-08-01T19:54:20.445 INFO:teuthology.orchestra.run.smithi006.stdout: "mds_max_purge_ops": "8192", 2023-08-01T19:54:20.445 INFO:teuthology.orchestra.run.smithi006.stdout: "mds_max_purge_ops_per_pg": "0.500000", 2023-08-01T19:54:20.445 INFO:teuthology.orchestra.run.smithi006.stdout: "mds_max_scrub_ops_in_progress": "5", 2023-08-01T19:54:20.445 INFO:teuthology.orchestra.run.smithi006.stdout: "mds_max_snaps_per_dir": "100", 2023-08-01T19:54:20.445 INFO:teuthology.orchestra.run.smithi006.stdout: "mds_max_xattr_pairs_size": "65536", 2023-08-01T19:54:20.446 INFO:teuthology.orchestra.run.smithi006.stdout: "mds_metrics_update_interval": "2", 2023-08-01T19:54:20.446 INFO:teuthology.orchestra.run.smithi006.stdout: "mds_min_caps_per_client": "100", 2023-08-01T19:54:20.446 INFO:teuthology.orchestra.run.smithi006.stdout: "mds_min_caps_working_set": "10000", 2023-08-01T19:54:20.446 INFO:teuthology.orchestra.run.smithi006.stdout: "mds_mon_shutdown_timeout": "5.000000", 2023-08-01T19:54:20.446 INFO:teuthology.orchestra.run.smithi006.stdout: "mds_numa_node": "-1", 2023-08-01T19:54:20.446 INFO:teuthology.orchestra.run.smithi006.stdout: "mds_oft_prefetch_dirfrags": "false", 2023-08-01T19:54:20.446 INFO:teuthology.orchestra.run.smithi006.stdout: "mds_op_complaint_time": "30.000000", 2023-08-01T19:54:20.446 INFO:teuthology.orchestra.run.smithi006.stdout: "mds_op_history_duration": "600", 2023-08-01T19:54:20.447 INFO:teuthology.orchestra.run.smithi006.stdout: "mds_op_history_size": "20", 2023-08-01T19:54:20.447 INFO:teuthology.orchestra.run.smithi006.stdout: "mds_op_log_threshold": "5", 2023-08-01T19:54:20.447 INFO:teuthology.orchestra.run.smithi006.stdout: "mds_ping_grace": "15", 2023-08-01T19:54:20.447 INFO:teuthology.orchestra.run.smithi006.stdout: "mds_ping_interval": "5", 2023-08-01T19:54:20.447 INFO:teuthology.orchestra.run.smithi006.stdout: "mds_purge_queue_busy_flush_period": "1.000000", 2023-08-01T19:54:20.447 INFO:teuthology.orchestra.run.smithi006.stdout: "mds_recall_global_max_decay_threshold": "131072", 2023-08-01T19:54:20.447 INFO:teuthology.orchestra.run.smithi006.stdout: "mds_recall_max_caps": "30000", 2023-08-01T19:54:20.448 INFO:teuthology.orchestra.run.smithi006.stdout: "mds_recall_max_decay_rate": "1.500000", 2023-08-01T19:54:20.448 INFO:teuthology.orchestra.run.smithi006.stdout: "mds_recall_max_decay_threshold": "131072", 2023-08-01T19:54:20.448 INFO:teuthology.orchestra.run.smithi006.stdout: "mds_recall_warning_decay_rate": "60.000000", 2023-08-01T19:54:20.448 INFO:teuthology.orchestra.run.smithi006.stdout: "mds_recall_warning_threshold": "262144", 2023-08-01T19:54:20.448 INFO:teuthology.orchestra.run.smithi006.stdout: "mds_reconnect_timeout": "45.000000", 2023-08-01T19:54:20.448 INFO:teuthology.orchestra.run.smithi006.stdout: "mds_replay_interval": "1.000000", 2023-08-01T19:54:20.448 INFO:teuthology.orchestra.run.smithi006.stdout: "mds_replay_unsafe_with_closed_session": "false", 2023-08-01T19:54:20.449 INFO:teuthology.orchestra.run.smithi006.stdout: "mds_request_load_average_decay_rate": "60.000000", 2023-08-01T19:54:20.449 INFO:teuthology.orchestra.run.smithi006.stdout: "mds_root_ino_gid": "0", 2023-08-01T19:54:20.449 INFO:teuthology.orchestra.run.smithi006.stdout: "mds_root_ino_uid": "0", 2023-08-01T19:54:20.449 INFO:teuthology.orchestra.run.smithi006.stdout: "mds_scatter_nudge_interval": "5.000000", 2023-08-01T19:54:20.449 INFO:teuthology.orchestra.run.smithi006.stdout: "mds_session_blocklist_on_evict": "true", 2023-08-01T19:54:20.449 INFO:teuthology.orchestra.run.smithi006.stdout: "mds_session_blocklist_on_timeout": "true", 2023-08-01T19:54:20.449 INFO:teuthology.orchestra.run.smithi006.stdout: "mds_session_cache_liveness_decay_rate": "300.000000", 2023-08-01T19:54:20.449 INFO:teuthology.orchestra.run.smithi006.stdout: "mds_session_cache_liveness_magnitude": "10", 2023-08-01T19:54:20.450 INFO:teuthology.orchestra.run.smithi006.stdout: "mds_session_cap_acquisition_decay_rate": "10.000000", 2023-08-01T19:54:20.450 INFO:teuthology.orchestra.run.smithi006.stdout: "mds_session_cap_acquisition_throttle": "500000", 2023-08-01T19:54:20.450 INFO:teuthology.orchestra.run.smithi006.stdout: "mds_session_max_caps_throttle_ratio": "1.100000", 2023-08-01T19:54:20.450 INFO:teuthology.orchestra.run.smithi006.stdout: "mds_sessionmap_keys_per_op": "1024", 2023-08-01T19:54:20.450 INFO:teuthology.orchestra.run.smithi006.stdout: "mds_shutdown_check": "0", 2023-08-01T19:54:20.450 INFO:teuthology.orchestra.run.smithi006.stdout: "mds_skip_ino": "0", 2023-08-01T19:54:20.450 INFO:teuthology.orchestra.run.smithi006.stdout: "mds_sleep_rank_change": "0.000000", 2023-08-01T19:54:20.450 INFO:teuthology.orchestra.run.smithi006.stdout: "mds_snap_max_uid": "4294967294", 2023-08-01T19:54:20.451 INFO:teuthology.orchestra.run.smithi006.stdout: "mds_snap_min_uid": "0", 2023-08-01T19:54:20.451 INFO:teuthology.orchestra.run.smithi006.stdout: "mds_snap_rstat": "false", 2023-08-01T19:54:20.451 INFO:teuthology.orchestra.run.smithi006.stdout: "mds_standby_replay_damaged": "false", 2023-08-01T19:54:20.451 INFO:teuthology.orchestra.run.smithi006.stdout: "mds_symlink_recovery": "true", 2023-08-01T19:54:20.451 INFO:teuthology.orchestra.run.smithi006.stdout: "mds_task_status_update_interval": "2.000000", 2023-08-01T19:54:20.451 INFO:teuthology.orchestra.run.smithi006.stdout: "mds_thrash_exports": "0", 2023-08-01T19:54:20.451 INFO:teuthology.orchestra.run.smithi006.stdout: "mds_thrash_fragments": "0", 2023-08-01T19:54:20.452 INFO:teuthology.orchestra.run.smithi006.stdout: "mds_tick_interval": "5.000000", 2023-08-01T19:54:20.452 INFO:teuthology.orchestra.run.smithi006.stdout: "mds_valgrind_exit": "false", 2023-08-01T19:54:20.452 INFO:teuthology.orchestra.run.smithi006.stdout: "mds_verify_backtrace": "1", 2023-08-01T19:54:20.452 INFO:teuthology.orchestra.run.smithi006.stdout: "mds_verify_scatter": "false", 2023-08-01T19:54:20.452 INFO:teuthology.orchestra.run.smithi006.stdout: "mds_wipe_ino_prealloc": "false", 2023-08-01T19:54:20.452 INFO:teuthology.orchestra.run.smithi006.stdout: "mds_wipe_sessions": "false", 2023-08-01T19:54:20.452 INFO:teuthology.orchestra.run.smithi006.stdout: "mempool_debug": "false", 2023-08-01T19:54:20.452 INFO:teuthology.orchestra.run.smithi006.stdout: "memstore_debug_omit_block_device_write": "false", 2023-08-01T19:54:20.453 INFO:teuthology.orchestra.run.smithi006.stdout: "memstore_device_bytes": "1073741824", 2023-08-01T19:54:20.453 INFO:teuthology.orchestra.run.smithi006.stdout: "memstore_page_set": "false", 2023-08-01T19:54:20.453 INFO:teuthology.orchestra.run.smithi006.stdout: "memstore_page_size": "65536", 2023-08-01T19:54:20.453 INFO:teuthology.orchestra.run.smithi006.stdout: "mgr_client_bytes": "134217728", 2023-08-01T19:54:20.453 INFO:teuthology.orchestra.run.smithi006.stdout: "mgr_client_messages": "512", 2023-08-01T19:54:20.453 INFO:teuthology.orchestra.run.smithi006.stdout: "mgr_client_service_daemon_unregister_timeout": "1.000000", 2023-08-01T19:54:20.453 INFO:teuthology.orchestra.run.smithi006.stdout: "mgr_connect_retry_interval": "1.000000", 2023-08-01T19:54:20.453 INFO:teuthology.orchestra.run.smithi006.stdout: "mgr_data": "/var/lib/ceph/mgr/ceph-a", 2023-08-01T19:54:20.454 INFO:teuthology.orchestra.run.smithi006.stdout: "mgr_debug_aggressive_pg_num_changes": "false", 2023-08-01T19:54:20.454 INFO:teuthology.orchestra.run.smithi006.stdout: "mgr_disabled_modules": "", 2023-08-01T19:54:20.454 INFO:teuthology.orchestra.run.smithi006.stdout: "mgr_initial_modules": "restful iostat nfs", 2023-08-01T19:54:20.454 INFO:teuthology.orchestra.run.smithi006.stdout: "mgr_max_pg_num_change": "128", 2023-08-01T19:54:20.454 INFO:teuthology.orchestra.run.smithi006.stdout: "mgr_mds_bytes": "134217728", 2023-08-01T19:54:20.454 INFO:teuthology.orchestra.run.smithi006.stdout: "mgr_mds_messages": "128", 2023-08-01T19:54:20.454 INFO:teuthology.orchestra.run.smithi006.stdout: "mgr_module_path": "/usr/share/ceph/mgr", 2023-08-01T19:54:20.455 INFO:teuthology.orchestra.run.smithi006.stdout: "mgr_mon_bytes": "134217728", 2023-08-01T19:54:20.455 INFO:teuthology.orchestra.run.smithi006.stdout: "mgr_mon_messages": "128", 2023-08-01T19:54:20.455 INFO:teuthology.orchestra.run.smithi006.stdout: "mgr_osd_bytes": "536870912", 2023-08-01T19:54:20.455 INFO:teuthology.orchestra.run.smithi006.stdout: "mgr_osd_messages": "8192", 2023-08-01T19:54:20.455 INFO:teuthology.orchestra.run.smithi006.stdout: "mgr_pool": "true", 2023-08-01T19:54:20.455 INFO:teuthology.orchestra.run.smithi006.stdout: "mgr_service_beacon_grace": "60.000000", 2023-08-01T19:54:20.455 INFO:teuthology.orchestra.run.smithi006.stdout: "mgr_standby_modules": "true", 2023-08-01T19:54:20.455 INFO:teuthology.orchestra.run.smithi006.stdout: "mgr_stats_period": "5", 2023-08-01T19:54:20.456 INFO:teuthology.orchestra.run.smithi006.stdout: "mgr_stats_threshold": "5", 2023-08-01T19:54:20.456 INFO:teuthology.orchestra.run.smithi006.stdout: "mgr_tick_period": "2", 2023-08-01T19:54:20.456 INFO:teuthology.orchestra.run.smithi006.stdout: "mgr_ttl_cache_expire_seconds": "0", 2023-08-01T19:54:20.456 INFO:teuthology.orchestra.run.smithi006.stdout: "mon_accept_timeout_factor": "2.000000", 2023-08-01T19:54:20.456 INFO:teuthology.orchestra.run.smithi006.stdout: "mon_allow_pool_delete": "true", 2023-08-01T19:54:20.456 INFO:teuthology.orchestra.run.smithi006.stdout: "mon_allow_pool_size_one": "true", 2023-08-01T19:54:20.456 INFO:teuthology.orchestra.run.smithi006.stdout: "mon_auth_validate_all_caps": "true", 2023-08-01T19:54:20.457 INFO:teuthology.orchestra.run.smithi006.stdout: "mon_cache_target_full_warn_ratio": "0.660000", 2023-08-01T19:54:20.457 INFO:teuthology.orchestra.run.smithi006.stdout: "mon_clean_pg_upmaps_per_chunk": "256", 2023-08-01T19:54:20.457 INFO:teuthology.orchestra.run.smithi006.stdout: "mon_client_bytes": "104857600", 2023-08-01T19:54:20.457 INFO:teuthology.orchestra.run.smithi006.stdout: "mon_client_directed_command_retry": "2", 2023-08-01T19:54:20.457 INFO:teuthology.orchestra.run.smithi006.stdout: "mon_client_hunt_interval": "3.000000", 2023-08-01T19:54:20.457 INFO:teuthology.orchestra.run.smithi006.stdout: "mon_client_hunt_interval_backoff": "1.500000", 2023-08-01T19:54:20.457 INFO:teuthology.orchestra.run.smithi006.stdout: "mon_client_hunt_interval_max_multiple": "10.000000", 2023-08-01T19:54:20.457 INFO:teuthology.orchestra.run.smithi006.stdout: "mon_client_hunt_interval_min_multiple": "1.000000", 2023-08-01T19:54:20.458 INFO:teuthology.orchestra.run.smithi006.stdout: "mon_client_hunt_parallel": "3", 2023-08-01T19:54:20.458 INFO:teuthology.orchestra.run.smithi006.stdout: "mon_client_log_interval": "1.000000", 2023-08-01T19:54:20.458 INFO:teuthology.orchestra.run.smithi006.stdout: "mon_client_max_log_entries_per_message": "1000", 2023-08-01T19:54:20.458 INFO:teuthology.orchestra.run.smithi006.stdout: "mon_client_ping_interval": "10.000000", 2023-08-01T19:54:20.458 INFO:teuthology.orchestra.run.smithi006.stdout: "mon_client_ping_timeout": "30.000000", 2023-08-01T19:54:20.458 INFO:teuthology.orchestra.run.smithi006.stdout: "mon_clock_drift_allowed": "1.000000", 2023-08-01T19:54:20.459 INFO:teuthology.orchestra.run.smithi006.stdout: "mon_clock_drift_warn_backoff": "5.000000", 2023-08-01T19:54:20.459 INFO:teuthology.orchestra.run.smithi006.stdout: "mon_cluster_log_file": "default=/var/log/ceph/ceph.$channel.log cluster=/var/log/ceph/ceph.log", 2023-08-01T19:54:20.459 INFO:teuthology.orchestra.run.smithi006.stdout: "mon_cluster_log_file_level": "debug", 2023-08-01T19:54:20.459 INFO:teuthology.orchestra.run.smithi006.stdout: "mon_cluster_log_to_file": "true", 2023-08-01T19:54:20.459 INFO:teuthology.orchestra.run.smithi006.stdout: "mon_cluster_log_to_graylog": "false", 2023-08-01T19:54:20.459 INFO:teuthology.orchestra.run.smithi006.stdout: "mon_cluster_log_to_graylog_host": "127.0.0.1", 2023-08-01T19:54:20.459 INFO:teuthology.orchestra.run.smithi006.stdout: "mon_cluster_log_to_graylog_port": "12201", 2023-08-01T19:54:20.459 INFO:teuthology.orchestra.run.smithi006.stdout: "mon_cluster_log_to_journald": "false", 2023-08-01T19:54:20.460 INFO:teuthology.orchestra.run.smithi006.stdout: "mon_cluster_log_to_stderr": "false", 2023-08-01T19:54:20.460 INFO:teuthology.orchestra.run.smithi006.stdout: "mon_cluster_log_to_syslog": "default=false", 2023-08-01T19:54:20.460 INFO:teuthology.orchestra.run.smithi006.stdout: "mon_cluster_log_to_syslog_facility": "daemon", 2023-08-01T19:54:20.460 INFO:teuthology.orchestra.run.smithi006.stdout: "mon_cluster_log_to_syslog_level": "info", 2023-08-01T19:54:20.460 INFO:teuthology.orchestra.run.smithi006.stdout: "mon_compact_on_bootstrap": "false", 2023-08-01T19:54:20.460 INFO:teuthology.orchestra.run.smithi006.stdout: "mon_compact_on_start": "false", 2023-08-01T19:54:20.460 INFO:teuthology.orchestra.run.smithi006.stdout: "mon_compact_on_trim": "true", 2023-08-01T19:54:20.461 INFO:teuthology.orchestra.run.smithi006.stdout: "mon_con_tracker_persist_interval": "10", 2023-08-01T19:54:20.461 INFO:teuthology.orchestra.run.smithi006.stdout: "mon_con_tracker_score_halflife": "43200", 2023-08-01T19:54:20.461 INFO:teuthology.orchestra.run.smithi006.stdout: "mon_config_key_max_entry_size": "65536", 2023-08-01T19:54:20.461 INFO:teuthology.orchestra.run.smithi006.stdout: "mon_cpu_threads": "4", 2023-08-01T19:54:20.461 INFO:teuthology.orchestra.run.smithi006.stdout: "mon_crush_min_required_version": "hammer", 2023-08-01T19:54:20.461 INFO:teuthology.orchestra.run.smithi006.stdout: "mon_daemon_bytes": "419430400", 2023-08-01T19:54:20.461 INFO:teuthology.orchestra.run.smithi006.stdout: "mon_data": "/var/lib/ceph/mon/ceph-a", 2023-08-01T19:54:20.461 INFO:teuthology.orchestra.run.smithi006.stdout: "mon_data_avail_crit": "5", 2023-08-01T19:54:20.462 INFO:teuthology.orchestra.run.smithi006.stdout: "mon_data_avail_warn": "5", 2023-08-01T19:54:20.462 INFO:teuthology.orchestra.run.smithi006.stdout: "mon_data_size_warn": "16106127360", 2023-08-01T19:54:20.462 INFO:teuthology.orchestra.run.smithi006.stdout: "mon_debug_block_osdmap_trim": "false", 2023-08-01T19:54:20.462 INFO:teuthology.orchestra.run.smithi006.stdout: "mon_debug_deprecated_as_obsolete": "false", 2023-08-01T19:54:20.462 INFO:teuthology.orchestra.run.smithi006.stdout: "mon_debug_dump_json": "false", 2023-08-01T19:54:20.462 INFO:teuthology.orchestra.run.smithi006.stdout: "mon_debug_dump_location": "/var/log/ceph/ceph-mon.a.tdump", 2023-08-01T19:54:20.462 INFO:teuthology.orchestra.run.smithi006.stdout: "mon_debug_dump_transactions": "false", 2023-08-01T19:54:20.463 INFO:teuthology.orchestra.run.smithi006.stdout: "mon_debug_extra_checks": "false", 2023-08-01T19:54:20.463 INFO:teuthology.orchestra.run.smithi006.stdout: "mon_debug_no_initial_persistent_features": "false", 2023-08-01T19:54:20.463 INFO:teuthology.orchestra.run.smithi006.stdout: "mon_debug_no_require_bluestore_for_ec_overwrites": "false", 2023-08-01T19:54:20.463 INFO:teuthology.orchestra.run.smithi006.stdout: "mon_debug_no_require_pacific": "false", 2023-08-01T19:54:20.463 INFO:teuthology.orchestra.run.smithi006.stdout: "mon_debug_no_require_quincy": "false", 2023-08-01T19:54:20.463 INFO:teuthology.orchestra.run.smithi006.stdout: "mon_debug_unsafe_allow_tier_with_nonempty_snaps": "false", 2023-08-01T19:54:20.463 INFO:teuthology.orchestra.run.smithi006.stdout: "mon_delta_reset_interval": "10.000000", 2023-08-01T19:54:20.464 INFO:teuthology.orchestra.run.smithi006.stdout: "mon_dns_srv_name": "ceph-mon", 2023-08-01T19:54:20.464 INFO:teuthology.orchestra.run.smithi006.stdout: "mon_down_mkfs_grace": "120", 2023-08-01T19:54:20.464 INFO:teuthology.orchestra.run.smithi006.stdout: "mon_election_default_strategy": "1", 2023-08-01T19:54:20.464 INFO:teuthology.orchestra.run.smithi006.stdout: "mon_election_timeout": "5.000000", 2023-08-01T19:54:20.464 INFO:teuthology.orchestra.run.smithi006.stdout: "mon_elector_ignore_propose_margin": "0.000500", 2023-08-01T19:54:20.464 INFO:teuthology.orchestra.run.smithi006.stdout: "mon_elector_ping_divisor": "2", 2023-08-01T19:54:20.464 INFO:teuthology.orchestra.run.smithi006.stdout: "mon_elector_ping_timeout": "2.000000", 2023-08-01T19:54:20.464 INFO:teuthology.orchestra.run.smithi006.stdout: "mon_enable_op_tracker": "true", 2023-08-01T19:54:20.465 INFO:teuthology.orchestra.run.smithi006.stdout: "mon_fake_pool_delete": "false", 2023-08-01T19:54:20.465 INFO:teuthology.orchestra.run.smithi006.stdout: "mon_force_quorum_join": "false", 2023-08-01T19:54:20.465 INFO:teuthology.orchestra.run.smithi006.stdout: "mon_globalid_prealloc": "10000", 2023-08-01T19:54:20.465 INFO:teuthology.orchestra.run.smithi006.stdout: "mon_health_detail_to_clog": "false", 2023-08-01T19:54:20.465 INFO:teuthology.orchestra.run.smithi006.stdout: "mon_health_log_update_period": "5", 2023-08-01T19:54:20.465 INFO:teuthology.orchestra.run.smithi006.stdout: "mon_health_max_detail": "50", 2023-08-01T19:54:20.465 INFO:teuthology.orchestra.run.smithi006.stdout: "mon_health_to_clog": "true", 2023-08-01T19:54:20.465 INFO:teuthology.orchestra.run.smithi006.stdout: "mon_health_to_clog_interval": "600", 2023-08-01T19:54:20.466 INFO:teuthology.orchestra.run.smithi006.stdout: "mon_health_to_clog_tick_interval": "60.000000", 2023-08-01T19:54:20.466 INFO:teuthology.orchestra.run.smithi006.stdout: "mon_host": "172.21.15.6,[v2:172.21.15.6:3301,v1:172.21.15.6:6790],[v2:172.21.15.6:3302,v1:172.21.15.6:6791]", 2023-08-01T19:54:20.466 INFO:teuthology.orchestra.run.smithi006.stdout: "mon_host_override": "", 2023-08-01T19:54:20.466 INFO:teuthology.orchestra.run.smithi006.stdout: "mon_initial_members": "", 2023-08-01T19:54:20.466 INFO:teuthology.orchestra.run.smithi006.stdout: "mon_inject_pg_merge_bounce_probability": "0.000000", 2023-08-01T19:54:20.466 INFO:teuthology.orchestra.run.smithi006.stdout: "mon_inject_sync_get_chunk_delay": "0.000000", 2023-08-01T19:54:20.466 INFO:teuthology.orchestra.run.smithi006.stdout: "mon_inject_transaction_delay_max": "10.000000", 2023-08-01T19:54:20.466 INFO:teuthology.orchestra.run.smithi006.stdout: "mon_inject_transaction_delay_probability": "0.000000", 2023-08-01T19:54:20.467 INFO:teuthology.orchestra.run.smithi006.stdout: "mon_keyvaluedb": "rocksdb", 2023-08-01T19:54:20.467 INFO:teuthology.orchestra.run.smithi006.stdout: "mon_lease": "5.000000", 2023-08-01T19:54:20.467 INFO:teuthology.orchestra.run.smithi006.stdout: "mon_lease_ack_timeout_factor": "2.000000", 2023-08-01T19:54:20.467 INFO:teuthology.orchestra.run.smithi006.stdout: "mon_lease_renew_interval_factor": "0.600000", 2023-08-01T19:54:20.467 INFO:teuthology.orchestra.run.smithi006.stdout: "mon_log_full_interval": "50", 2023-08-01T19:54:20.467 INFO:teuthology.orchestra.run.smithi006.stdout: "mon_log_max": "10000", 2023-08-01T19:54:20.467 INFO:teuthology.orchestra.run.smithi006.stdout: "mon_log_max_summary": "50", 2023-08-01T19:54:20.467 INFO:teuthology.orchestra.run.smithi006.stdout: "mon_max_log_entries_per_event": "4096", 2023-08-01T19:54:20.468 INFO:teuthology.orchestra.run.smithi006.stdout: "mon_max_log_epochs": "500", 2023-08-01T19:54:20.468 INFO:teuthology.orchestra.run.smithi006.stdout: "mon_max_mdsmap_epochs": "500", 2023-08-01T19:54:20.468 INFO:teuthology.orchestra.run.smithi006.stdout: "mon_max_mgrmap_epochs": "500", 2023-08-01T19:54:20.468 INFO:teuthology.orchestra.run.smithi006.stdout: "mon_max_osd": "10000", 2023-08-01T19:54:20.468 INFO:teuthology.orchestra.run.smithi006.stdout: "mon_max_pg_per_osd": "10000", 2023-08-01T19:54:20.468 INFO:teuthology.orchestra.run.smithi006.stdout: "mon_max_pool_pg_num": "65536", 2023-08-01T19:54:20.468 INFO:teuthology.orchestra.run.smithi006.stdout: "mon_max_snap_prune_per_epoch": "100", 2023-08-01T19:54:20.469 INFO:teuthology.orchestra.run.smithi006.stdout: "mon_mds_blocklist_interval": "86400.000000", 2023-08-01T19:54:20.469 INFO:teuthology.orchestra.run.smithi006.stdout: "mon_mds_force_trim_to": "0", 2023-08-01T19:54:20.469 INFO:teuthology.orchestra.run.smithi006.stdout: "mon_mds_skip_sanity": "false", 2023-08-01T19:54:20.469 INFO:teuthology.orchestra.run.smithi006.stdout: "mon_memory_autotune": "true", 2023-08-01T19:54:20.469 INFO:teuthology.orchestra.run.smithi006.stdout: "mon_memory_target": "2147483648", 2023-08-01T19:54:20.469 INFO:teuthology.orchestra.run.smithi006.stdout: "mon_mgr_beacon_grace": "30", 2023-08-01T19:54:20.469 INFO:teuthology.orchestra.run.smithi006.stdout: "mon_mgr_blocklist_interval": "86400.000000", 2023-08-01T19:54:20.469 INFO:teuthology.orchestra.run.smithi006.stdout: "mon_mgr_digest_period": "5", 2023-08-01T19:54:20.470 INFO:teuthology.orchestra.run.smithi006.stdout: "mon_mgr_inactive_grace": "60", 2023-08-01T19:54:20.470 INFO:teuthology.orchestra.run.smithi006.stdout: "mon_mgr_mkfs_grace": "240", 2023-08-01T19:54:20.470 INFO:teuthology.orchestra.run.smithi006.stdout: "mon_mgr_proxy_client_bytes_ratio": "0.300000", 2023-08-01T19:54:20.470 INFO:teuthology.orchestra.run.smithi006.stdout: "mon_min_osdmap_epochs": "500", 2023-08-01T19:54:20.470 INFO:teuthology.orchestra.run.smithi006.stdout: "mon_op_complaint_time": "30", 2023-08-01T19:54:20.470 INFO:teuthology.orchestra.run.smithi006.stdout: "mon_op_history_duration": "600", 2023-08-01T19:54:20.470 INFO:teuthology.orchestra.run.smithi006.stdout: "mon_op_history_size": "20", 2023-08-01T19:54:20.470 INFO:teuthology.orchestra.run.smithi006.stdout: "mon_op_history_slow_op_size": "20", 2023-08-01T19:54:20.471 INFO:teuthology.orchestra.run.smithi006.stdout: "mon_op_history_slow_op_threshold": "10", 2023-08-01T19:54:20.471 INFO:teuthology.orchestra.run.smithi006.stdout: "mon_op_log_threshold": "5", 2023-08-01T19:54:20.471 INFO:teuthology.orchestra.run.smithi006.stdout: "mon_osd_adjust_down_out_interval": "true", 2023-08-01T19:54:20.471 INFO:teuthology.orchestra.run.smithi006.stdout: "mon_osd_adjust_heartbeat_grace": "true", 2023-08-01T19:54:20.471 INFO:teuthology.orchestra.run.smithi006.stdout: "mon_osd_auto_mark_auto_out_in": "true", 2023-08-01T19:54:20.471 INFO:teuthology.orchestra.run.smithi006.stdout: "mon_osd_auto_mark_in": "false", 2023-08-01T19:54:20.472 INFO:teuthology.orchestra.run.smithi006.stdout: "mon_osd_auto_mark_new_in": "true", 2023-08-01T19:54:20.472 INFO:teuthology.orchestra.run.smithi006.stdout: "mon_osd_backfillfull_ratio": "0.900000", 2023-08-01T19:54:20.472 INFO:teuthology.orchestra.run.smithi006.stdout: "mon_osd_blocklist_default_expire": "3600.000000", 2023-08-01T19:54:20.472 INFO:teuthology.orchestra.run.smithi006.stdout: "mon_osd_cache_size": "500", 2023-08-01T19:54:20.472 INFO:teuthology.orchestra.run.smithi006.stdout: "mon_osd_cache_size_min": "134217728", 2023-08-01T19:54:20.472 INFO:teuthology.orchestra.run.smithi006.stdout: "mon_osd_crush_smoke_test": "true", 2023-08-01T19:54:20.472 INFO:teuthology.orchestra.run.smithi006.stdout: "mon_osd_destroyed_out_interval": "600", 2023-08-01T19:54:20.472 INFO:teuthology.orchestra.run.smithi006.stdout: "mon_osd_down_out_interval": "600", 2023-08-01T19:54:20.473 INFO:teuthology.orchestra.run.smithi006.stdout: "mon_osd_down_out_subtree_limit": "rack", 2023-08-01T19:54:20.473 INFO:teuthology.orchestra.run.smithi006.stdout: "mon_osd_err_op_age_ratio": "128.000000", 2023-08-01T19:54:20.473 INFO:teuthology.orchestra.run.smithi006.stdout: "mon_osd_force_trim_to": "0", 2023-08-01T19:54:20.473 INFO:teuthology.orchestra.run.smithi006.stdout: "mon_osd_full_ratio": "0.950000", 2023-08-01T19:54:20.473 INFO:teuthology.orchestra.run.smithi006.stdout: "mon_osd_initial_require_min_compat_client": "luminous", 2023-08-01T19:54:20.473 INFO:teuthology.orchestra.run.smithi006.stdout: "mon_osd_laggy_halflife": "3600", 2023-08-01T19:54:20.473 INFO:teuthology.orchestra.run.smithi006.stdout: "mon_osd_laggy_max_interval": "300", 2023-08-01T19:54:20.473 INFO:teuthology.orchestra.run.smithi006.stdout: "mon_osd_laggy_weight": "0.300000", 2023-08-01T19:54:20.474 INFO:teuthology.orchestra.run.smithi006.stdout: "mon_osd_mapping_pgs_per_chunk": "4096", 2023-08-01T19:54:20.474 INFO:teuthology.orchestra.run.smithi006.stdout: "mon_osd_max_creating_pgs": "1024", 2023-08-01T19:54:20.474 INFO:teuthology.orchestra.run.smithi006.stdout: "mon_osd_max_initial_pgs": "1024", 2023-08-01T19:54:20.474 INFO:teuthology.orchestra.run.smithi006.stdout: "mon_osd_min_down_reporters": "2", 2023-08-01T19:54:20.474 INFO:teuthology.orchestra.run.smithi006.stdout: "mon_osd_min_in_ratio": "0.750000", 2023-08-01T19:54:20.474 INFO:teuthology.orchestra.run.smithi006.stdout: "mon_osd_min_up_ratio": "0.300000", 2023-08-01T19:54:20.474 INFO:teuthology.orchestra.run.smithi006.stdout: "mon_osd_nearfull_ratio": "0.850000", 2023-08-01T19:54:20.475 INFO:teuthology.orchestra.run.smithi006.stdout: "mon_osd_prime_pg_temp": "true", 2023-08-01T19:54:20.475 INFO:teuthology.orchestra.run.smithi006.stdout: "mon_osd_prime_pg_temp_max_estimate": "0.250000", 2023-08-01T19:54:20.475 INFO:teuthology.orchestra.run.smithi006.stdout: "mon_osd_prime_pg_temp_max_time": "0.500000", 2023-08-01T19:54:20.475 INFO:teuthology.orchestra.run.smithi006.stdout: "mon_osd_report_timeout": "900", 2023-08-01T19:54:20.475 INFO:teuthology.orchestra.run.smithi006.stdout: "mon_osd_reporter_subtree_level": "osd", 2023-08-01T19:54:20.475 INFO:teuthology.orchestra.run.smithi006.stdout: "mon_osd_snap_trim_queue_warn_on": "32768", 2023-08-01T19:54:20.475 INFO:teuthology.orchestra.run.smithi006.stdout: "mon_osd_warn_num_repaired": "10", 2023-08-01T19:54:20.475 INFO:teuthology.orchestra.run.smithi006.stdout: "mon_osd_warn_op_age": "32.000000", 2023-08-01T19:54:20.476 INFO:teuthology.orchestra.run.smithi006.stdout: "mon_osdmap_full_prune_enabled": "true", 2023-08-01T19:54:20.476 INFO:teuthology.orchestra.run.smithi006.stdout: "mon_osdmap_full_prune_interval": "10", 2023-08-01T19:54:20.476 INFO:teuthology.orchestra.run.smithi006.stdout: "mon_osdmap_full_prune_min": "10000", 2023-08-01T19:54:20.476 INFO:teuthology.orchestra.run.smithi006.stdout: "mon_osdmap_full_prune_txsize": "100", 2023-08-01T19:54:20.476 INFO:teuthology.orchestra.run.smithi006.stdout: "mon_pg_check_down_all_threshold": "0.500000", 2023-08-01T19:54:20.476 INFO:teuthology.orchestra.run.smithi006.stdout: "mon_pg_stuck_threshold": "60", 2023-08-01T19:54:20.476 INFO:teuthology.orchestra.run.smithi006.stdout: "mon_pg_warn_max_object_skew": "0.000000", 2023-08-01T19:54:20.476 INFO:teuthology.orchestra.run.smithi006.stdout: "mon_pg_warn_min_objects": "10000", 2023-08-01T19:54:20.477 INFO:teuthology.orchestra.run.smithi006.stdout: "mon_pg_warn_min_per_osd": "0", 2023-08-01T19:54:20.477 INFO:teuthology.orchestra.run.smithi006.stdout: "mon_pg_warn_min_pool_objects": "1000", 2023-08-01T19:54:20.477 INFO:teuthology.orchestra.run.smithi006.stdout: "mon_pool_quota_crit_threshold": "0", 2023-08-01T19:54:20.477 INFO:teuthology.orchestra.run.smithi006.stdout: "mon_pool_quota_warn_threshold": "0", 2023-08-01T19:54:20.477 INFO:teuthology.orchestra.run.smithi006.stdout: "mon_probe_timeout": "2.000000", 2023-08-01T19:54:20.477 INFO:teuthology.orchestra.run.smithi006.stdout: "mon_reweight_max_change": "0.050000", 2023-08-01T19:54:20.477 INFO:teuthology.orchestra.run.smithi006.stdout: "mon_reweight_max_osds": "4", 2023-08-01T19:54:20.477 INFO:teuthology.orchestra.run.smithi006.stdout: "mon_reweight_min_bytes_per_osd": "10", 2023-08-01T19:54:20.478 INFO:teuthology.orchestra.run.smithi006.stdout: "mon_reweight_min_pgs_per_osd": "4", 2023-08-01T19:54:20.478 INFO:teuthology.orchestra.run.smithi006.stdout: "mon_rocksdb_options": "write_buffer_size=33554432,compression=kNoCompression,level_compaction_dynamic_level_bytes=true", 2023-08-01T19:54:20.478 INFO:teuthology.orchestra.run.smithi006.stdout: "mon_scrub_inject_crc_mismatch": "0.000000", 2023-08-01T19:54:20.478 INFO:teuthology.orchestra.run.smithi006.stdout: "mon_scrub_inject_missing_keys": "0.000000", 2023-08-01T19:54:20.478 INFO:teuthology.orchestra.run.smithi006.stdout: "mon_scrub_interval": "86400", 2023-08-01T19:54:20.478 INFO:teuthology.orchestra.run.smithi006.stdout: "mon_scrub_max_keys": "100", 2023-08-01T19:54:20.478 INFO:teuthology.orchestra.run.smithi006.stdout: "mon_scrub_timeout": "300", 2023-08-01T19:54:20.479 INFO:teuthology.orchestra.run.smithi006.stdout: "mon_session_timeout": "300", 2023-08-01T19:54:20.479 INFO:teuthology.orchestra.run.smithi006.stdout: "mon_smart_report_timeout": "5", 2023-08-01T19:54:20.479 INFO:teuthology.orchestra.run.smithi006.stdout: "mon_stat_smooth_intervals": "6", 2023-08-01T19:54:20.479 INFO:teuthology.orchestra.run.smithi006.stdout: "mon_stretch_cluster_recovery_ratio": "0.600000", 2023-08-01T19:54:20.479 INFO:teuthology.orchestra.run.smithi006.stdout: "mon_stretch_pool_min_size": "2", 2023-08-01T19:54:20.479 INFO:teuthology.orchestra.run.smithi006.stdout: "mon_stretch_pool_size": "4", 2023-08-01T19:54:20.479 INFO:teuthology.orchestra.run.smithi006.stdout: "mon_stretch_recovery_min_wait": "15.000000", 2023-08-01T19:54:20.479 INFO:teuthology.orchestra.run.smithi006.stdout: "mon_subscribe_interval": "86400.000000", 2023-08-01T19:54:20.480 INFO:teuthology.orchestra.run.smithi006.stdout: "mon_sync_debug": "false", 2023-08-01T19:54:20.480 INFO:teuthology.orchestra.run.smithi006.stdout: "mon_sync_max_payload_keys": "2000", 2023-08-01T19:54:20.480 INFO:teuthology.orchestra.run.smithi006.stdout: "mon_sync_max_payload_size": "1048576", 2023-08-01T19:54:20.480 INFO:teuthology.orchestra.run.smithi006.stdout: "mon_sync_provider_kill_at": "0", 2023-08-01T19:54:20.480 INFO:teuthology.orchestra.run.smithi006.stdout: "mon_sync_requester_kill_at": "0", 2023-08-01T19:54:20.480 INFO:teuthology.orchestra.run.smithi006.stdout: "mon_sync_timeout": "60.000000", 2023-08-01T19:54:20.480 INFO:teuthology.orchestra.run.smithi006.stdout: "mon_target_pg_per_osd": "100", 2023-08-01T19:54:20.481 INFO:teuthology.orchestra.run.smithi006.stdout: "mon_tick_interval": "5", 2023-08-01T19:54:20.481 INFO:teuthology.orchestra.run.smithi006.stdout: "mon_timecheck_interval": "300.000000", 2023-08-01T19:54:20.481 INFO:teuthology.orchestra.run.smithi006.stdout: "mon_timecheck_skew_interval": "30.000000", 2023-08-01T19:54:20.481 INFO:teuthology.orchestra.run.smithi006.stdout: "mon_warn_older_version_delay": "604800", 2023-08-01T19:54:20.481 INFO:teuthology.orchestra.run.smithi006.stdout: "mon_warn_on_cache_pools_without_hit_sets": "true", 2023-08-01T19:54:20.481 INFO:teuthology.orchestra.run.smithi006.stdout: "mon_warn_on_crush_straw_calc_version_zero": "false", 2023-08-01T19:54:20.481 INFO:teuthology.orchestra.run.smithi006.stdout: "mon_warn_on_degraded_stretch_mode": "true", 2023-08-01T19:54:20.481 INFO:teuthology.orchestra.run.smithi006.stdout: "mon_warn_on_filestore_osds": "false", 2023-08-01T19:54:20.482 INFO:teuthology.orchestra.run.smithi006.stdout: "mon_warn_on_insecure_global_id_reclaim": "false", 2023-08-01T19:54:20.482 INFO:teuthology.orchestra.run.smithi006.stdout: "mon_warn_on_insecure_global_id_reclaim_allowed": "false", 2023-08-01T19:54:20.482 INFO:teuthology.orchestra.run.smithi006.stdout: "mon_warn_on_legacy_crush_tunables": "false", 2023-08-01T19:54:20.482 INFO:teuthology.orchestra.run.smithi006.stdout: "mon_warn_on_misplaced": "false", 2023-08-01T19:54:20.482 INFO:teuthology.orchestra.run.smithi006.stdout: "mon_warn_on_msgr2_not_enabled": "true", 2023-08-01T19:54:20.482 INFO:teuthology.orchestra.run.smithi006.stdout: "mon_warn_on_older_version": "true", 2023-08-01T19:54:20.482 INFO:teuthology.orchestra.run.smithi006.stdout: "mon_warn_on_osd_down_out_interval_zero": "false", 2023-08-01T19:54:20.482 INFO:teuthology.orchestra.run.smithi006.stdout: "mon_warn_on_pool_no_app": "true", 2023-08-01T19:54:20.483 INFO:teuthology.orchestra.run.smithi006.stdout: "mon_warn_on_pool_no_redundancy": "false", 2023-08-01T19:54:20.483 INFO:teuthology.orchestra.run.smithi006.stdout: "mon_warn_on_pool_pg_num_not_power_of_two": "false", 2023-08-01T19:54:20.483 INFO:teuthology.orchestra.run.smithi006.stdout: "mon_warn_on_slow_ping_ratio": "0.050000", 2023-08-01T19:54:20.483 INFO:teuthology.orchestra.run.smithi006.stdout: "mon_warn_on_slow_ping_time": "0.000000", 2023-08-01T19:54:20.483 INFO:teuthology.orchestra.run.smithi006.stdout: "mon_warn_on_too_few_osds": "false", 2023-08-01T19:54:20.483 INFO:teuthology.orchestra.run.smithi006.stdout: "mon_warn_pg_not_deep_scrubbed_ratio": "0.750000", 2023-08-01T19:54:20.483 INFO:teuthology.orchestra.run.smithi006.stdout: "mon_warn_pg_not_scrubbed_ratio": "0.500000", 2023-08-01T19:54:20.483 INFO:teuthology.orchestra.run.smithi006.stdout: "monmap": "", 2023-08-01T19:54:20.484 INFO:teuthology.orchestra.run.smithi006.stdout: "ms_async_op_threads": "3", 2023-08-01T19:54:20.484 INFO:teuthology.orchestra.run.smithi006.stdout: "ms_async_rdma_buffer_size": "131072", 2023-08-01T19:54:20.484 INFO:teuthology.orchestra.run.smithi006.stdout: "ms_async_rdma_cm": "false", 2023-08-01T19:54:20.484 INFO:teuthology.orchestra.run.smithi006.stdout: "ms_async_rdma_device_name": "", 2023-08-01T19:54:20.484 INFO:teuthology.orchestra.run.smithi006.stdout: "ms_async_rdma_dscp": "96", 2023-08-01T19:54:20.484 INFO:teuthology.orchestra.run.smithi006.stdout: "ms_async_rdma_enable_hugepage": "false", 2023-08-01T19:54:20.484 INFO:teuthology.orchestra.run.smithi006.stdout: "ms_async_rdma_gid_idx": "0", 2023-08-01T19:54:20.485 INFO:teuthology.orchestra.run.smithi006.stdout: "ms_async_rdma_local_gid": "", 2023-08-01T19:54:20.485 INFO:teuthology.orchestra.run.smithi006.stdout: "ms_async_rdma_polling_us": "1000", 2023-08-01T19:54:20.485 INFO:teuthology.orchestra.run.smithi006.stdout: "ms_async_rdma_port_num": "1", 2023-08-01T19:54:20.485 INFO:teuthology.orchestra.run.smithi006.stdout: "ms_async_rdma_receive_buffers": "32768", 2023-08-01T19:54:20.485 INFO:teuthology.orchestra.run.smithi006.stdout: "ms_async_rdma_receive_queue_len": "4096", 2023-08-01T19:54:20.485 INFO:teuthology.orchestra.run.smithi006.stdout: "ms_async_rdma_roce_ver": "1", 2023-08-01T19:54:20.485 INFO:teuthology.orchestra.run.smithi006.stdout: "ms_async_rdma_send_buffers": "1024", 2023-08-01T19:54:20.485 INFO:teuthology.orchestra.run.smithi006.stdout: "ms_async_rdma_sl": "3", 2023-08-01T19:54:20.486 INFO:teuthology.orchestra.run.smithi006.stdout: "ms_async_rdma_support_srq": "true", 2023-08-01T19:54:20.486 INFO:teuthology.orchestra.run.smithi006.stdout: "ms_async_rdma_type": "ib", 2023-08-01T19:54:20.486 INFO:teuthology.orchestra.run.smithi006.stdout: "ms_async_reap_threshold": "5", 2023-08-01T19:54:20.486 INFO:teuthology.orchestra.run.smithi006.stdout: "ms_bind_before_connect": "false", 2023-08-01T19:54:20.486 INFO:teuthology.orchestra.run.smithi006.stdout: "ms_bind_ipv4": "true", 2023-08-01T19:54:20.486 INFO:teuthology.orchestra.run.smithi006.stdout: "ms_bind_ipv6": "false", 2023-08-01T19:54:20.486 INFO:teuthology.orchestra.run.smithi006.stdout: "ms_bind_msgr1": "true", 2023-08-01T19:54:20.486 INFO:teuthology.orchestra.run.smithi006.stdout: "ms_bind_msgr2": "true", 2023-08-01T19:54:20.487 INFO:teuthology.orchestra.run.smithi006.stdout: "ms_bind_port_max": "7568", 2023-08-01T19:54:20.487 INFO:teuthology.orchestra.run.smithi006.stdout: "ms_bind_port_min": "6800", 2023-08-01T19:54:20.487 INFO:teuthology.orchestra.run.smithi006.stdout: "ms_bind_prefer_ipv4": "false", 2023-08-01T19:54:20.487 INFO:teuthology.orchestra.run.smithi006.stdout: "ms_bind_retry_count": "3", 2023-08-01T19:54:20.487 INFO:teuthology.orchestra.run.smithi006.stdout: "ms_bind_retry_delay": "5", 2023-08-01T19:54:20.487 INFO:teuthology.orchestra.run.smithi006.stdout: "ms_blackhole_client": "false", 2023-08-01T19:54:20.487 INFO:teuthology.orchestra.run.smithi006.stdout: "ms_blackhole_mds": "false", 2023-08-01T19:54:20.487 INFO:teuthology.orchestra.run.smithi006.stdout: "ms_blackhole_mgr": "false", 2023-08-01T19:54:20.488 INFO:teuthology.orchestra.run.smithi006.stdout: "ms_blackhole_mon": "false", 2023-08-01T19:54:20.488 INFO:teuthology.orchestra.run.smithi006.stdout: "ms_blackhole_osd": "false", 2023-08-01T19:54:20.488 INFO:teuthology.orchestra.run.smithi006.stdout: "ms_client_mode": "crc secure", 2023-08-01T19:54:20.488 INFO:teuthology.orchestra.run.smithi006.stdout: "ms_cluster_mode": "crc secure", 2023-08-01T19:54:20.488 INFO:teuthology.orchestra.run.smithi006.stdout: "ms_cluster_type": "", 2023-08-01T19:54:20.488 INFO:teuthology.orchestra.run.smithi006.stdout: "ms_compress_secure": "false", 2023-08-01T19:54:20.488 INFO:teuthology.orchestra.run.smithi006.stdout: "ms_connection_idle_timeout": "900", 2023-08-01T19:54:20.489 INFO:teuthology.orchestra.run.smithi006.stdout: "ms_connection_ready_timeout": "10", 2023-08-01T19:54:20.489 INFO:teuthology.orchestra.run.smithi006.stdout: "ms_crc_data": "true", 2023-08-01T19:54:20.489 INFO:teuthology.orchestra.run.smithi006.stdout: "ms_crc_header": "true", 2023-08-01T19:54:20.489 INFO:teuthology.orchestra.run.smithi006.stdout: "ms_die_on_bad_msg": "false", 2023-08-01T19:54:20.489 INFO:teuthology.orchestra.run.smithi006.stdout: "ms_die_on_bug": "true", 2023-08-01T19:54:20.489 INFO:teuthology.orchestra.run.smithi006.stdout: "ms_die_on_old_message": "true", 2023-08-01T19:54:20.489 INFO:teuthology.orchestra.run.smithi006.stdout: "ms_die_on_skipped_message": "false", 2023-08-01T19:54:20.490 INFO:teuthology.orchestra.run.smithi006.stdout: "ms_die_on_unhandled_msg": "false", 2023-08-01T19:54:20.490 INFO:teuthology.orchestra.run.smithi006.stdout: "ms_dispatch_throttle_bytes": "104857600", 2023-08-01T19:54:20.490 INFO:teuthology.orchestra.run.smithi006.stdout: "ms_dpdk_coremask": "0xF", 2023-08-01T19:54:20.490 INFO:teuthology.orchestra.run.smithi006.stdout: "ms_dpdk_debug_allow_loopback": "false", 2023-08-01T19:54:20.490 INFO:teuthology.orchestra.run.smithi006.stdout: "ms_dpdk_devs_allowlist": "", 2023-08-01T19:54:20.490 INFO:teuthology.orchestra.run.smithi006.stdout: "ms_dpdk_enable_tso": "true", 2023-08-01T19:54:20.490 INFO:teuthology.orchestra.run.smithi006.stdout: "ms_dpdk_gateway_ipv4_addr": "", 2023-08-01T19:54:20.490 INFO:teuthology.orchestra.run.smithi006.stdout: "ms_dpdk_host_ipv4_addr": "", 2023-08-01T19:54:20.491 INFO:teuthology.orchestra.run.smithi006.stdout: "ms_dpdk_hugepages": "", 2023-08-01T19:54:20.491 INFO:teuthology.orchestra.run.smithi006.stdout: "ms_dpdk_hw_flow_control": "true", 2023-08-01T19:54:20.491 INFO:teuthology.orchestra.run.smithi006.stdout: "ms_dpdk_hw_queue_weight": "1.000000", 2023-08-01T19:54:20.491 INFO:teuthology.orchestra.run.smithi006.stdout: "ms_dpdk_lro": "true", 2023-08-01T19:54:20.491 INFO:teuthology.orchestra.run.smithi006.stdout: "ms_dpdk_memory_channel": "4", 2023-08-01T19:54:20.491 INFO:teuthology.orchestra.run.smithi006.stdout: "ms_dpdk_netmask_ipv4_addr": "", 2023-08-01T19:54:20.491 INFO:teuthology.orchestra.run.smithi006.stdout: "ms_dpdk_pmd": "", 2023-08-01T19:54:20.491 INFO:teuthology.orchestra.run.smithi006.stdout: "ms_dpdk_port_id": "0", 2023-08-01T19:54:20.492 INFO:teuthology.orchestra.run.smithi006.stdout: "ms_dpdk_rx_buffer_count_per_core": "8192", 2023-08-01T19:54:20.492 INFO:teuthology.orchestra.run.smithi006.stdout: "ms_dump_corrupt_message_level": "1", 2023-08-01T19:54:20.492 INFO:teuthology.orchestra.run.smithi006.stdout: "ms_dump_on_send": "false", 2023-08-01T19:54:20.492 INFO:teuthology.orchestra.run.smithi006.stdout: "ms_initial_backoff": "0.200000", 2023-08-01T19:54:20.492 INFO:teuthology.orchestra.run.smithi006.stdout: "ms_inject_delay_max": "1.000000", 2023-08-01T19:54:20.492 INFO:teuthology.orchestra.run.smithi006.stdout: "ms_inject_delay_probability": "0.000000", 2023-08-01T19:54:20.492 INFO:teuthology.orchestra.run.smithi006.stdout: "ms_inject_delay_type": "", 2023-08-01T19:54:20.492 INFO:teuthology.orchestra.run.smithi006.stdout: "ms_inject_internal_delays": "0.000000", 2023-08-01T19:54:20.493 INFO:teuthology.orchestra.run.smithi006.stdout: "ms_inject_socket_failures": "0", 2023-08-01T19:54:20.493 INFO:teuthology.orchestra.run.smithi006.stdout: "ms_learn_addr_from_peer": "true", 2023-08-01T19:54:20.493 INFO:teuthology.orchestra.run.smithi006.stdout: "ms_max_accept_failures": "4", 2023-08-01T19:54:20.493 INFO:teuthology.orchestra.run.smithi006.stdout: "ms_max_backoff": "15.000000", 2023-08-01T19:54:20.493 INFO:teuthology.orchestra.run.smithi006.stdout: "ms_mon_client_mode": "secure crc", 2023-08-01T19:54:20.493 INFO:teuthology.orchestra.run.smithi006.stdout: "ms_mon_cluster_mode": "secure crc", 2023-08-01T19:54:20.493 INFO:teuthology.orchestra.run.smithi006.stdout: "ms_mon_service_mode": "secure crc", 2023-08-01T19:54:20.494 INFO:teuthology.orchestra.run.smithi006.stdout: "ms_osd_compress_min_size": "1024", 2023-08-01T19:54:20.494 INFO:teuthology.orchestra.run.smithi006.stdout: "ms_osd_compress_mode": "none", 2023-08-01T19:54:20.494 INFO:teuthology.orchestra.run.smithi006.stdout: "ms_osd_compression_algorithm": "snappy zlib zstd lz4", 2023-08-01T19:54:20.494 INFO:teuthology.orchestra.run.smithi006.stdout: "ms_pq_max_tokens_per_priority": "16777216", 2023-08-01T19:54:20.494 INFO:teuthology.orchestra.run.smithi006.stdout: "ms_pq_min_cost": "65536", 2023-08-01T19:54:20.494 INFO:teuthology.orchestra.run.smithi006.stdout: "ms_public_type": "", 2023-08-01T19:54:20.494 INFO:teuthology.orchestra.run.smithi006.stdout: "ms_service_mode": "crc secure", 2023-08-01T19:54:20.494 INFO:teuthology.orchestra.run.smithi006.stdout: "ms_tcp_listen_backlog": "512", 2023-08-01T19:54:20.495 INFO:teuthology.orchestra.run.smithi006.stdout: "ms_tcp_nodelay": "true", 2023-08-01T19:54:20.495 INFO:teuthology.orchestra.run.smithi006.stdout: "ms_tcp_prefetch_max_size": "4096", 2023-08-01T19:54:20.495 INFO:teuthology.orchestra.run.smithi006.stdout: "ms_tcp_rcvbuf": "0", 2023-08-01T19:54:20.495 INFO:teuthology.orchestra.run.smithi006.stdout: "ms_type": "async+posix", 2023-08-01T19:54:20.495 INFO:teuthology.orchestra.run.smithi006.stdout: "no_config_file": "false", 2023-08-01T19:54:20.495 INFO:teuthology.orchestra.run.smithi006.stdout: "objecter_completion_locks_per_session": "32", 2023-08-01T19:54:20.495 INFO:teuthology.orchestra.run.smithi006.stdout: "objecter_debug_inject_relock_delay": "false", 2023-08-01T19:54:20.495 INFO:teuthology.orchestra.run.smithi006.stdout: "objecter_inflight_op_bytes": "104857600", 2023-08-01T19:54:20.496 INFO:teuthology.orchestra.run.smithi006.stdout: "objecter_inflight_ops": "1024", 2023-08-01T19:54:20.496 INFO:teuthology.orchestra.run.smithi006.stdout: "objecter_inject_no_watch_ping": "false", 2023-08-01T19:54:20.496 INFO:teuthology.orchestra.run.smithi006.stdout: "objecter_retry_writes_after_first_reply": "false", 2023-08-01T19:54:20.496 INFO:teuthology.orchestra.run.smithi006.stdout: "objecter_tick_interval": "5.000000", 2023-08-01T19:54:20.496 INFO:teuthology.orchestra.run.smithi006.stdout: "objecter_timeout": "10.000000", 2023-08-01T19:54:20.496 INFO:teuthology.orchestra.run.smithi006.stdout: "objectstore_blackhole": "false", 2023-08-01T19:54:20.496 INFO:teuthology.orchestra.run.smithi006.stdout: "openssl_engine_opts": "", 2023-08-01T19:54:20.496 INFO:teuthology.orchestra.run.smithi006.stdout: "osd_agent_delay_time": "5.000000", 2023-08-01T19:54:20.497 INFO:teuthology.orchestra.run.smithi006.stdout: "osd_agent_hist_halflife": "1000", 2023-08-01T19:54:20.497 INFO:teuthology.orchestra.run.smithi006.stdout: "osd_agent_max_low_ops": "2", 2023-08-01T19:54:20.497 INFO:teuthology.orchestra.run.smithi006.stdout: "osd_agent_max_ops": "4", 2023-08-01T19:54:20.497 INFO:teuthology.orchestra.run.smithi006.stdout: "osd_agent_min_evict_effort": "0.100000", 2023-08-01T19:54:20.497 INFO:teuthology.orchestra.run.smithi006.stdout: "osd_agent_quantize_effort": "0.100000", 2023-08-01T19:54:20.497 INFO:teuthology.orchestra.run.smithi006.stdout: "osd_agent_slop": "0.020000", 2023-08-01T19:54:20.497 INFO:teuthology.orchestra.run.smithi006.stdout: "osd_aggregated_slow_ops_logging": "true", 2023-08-01T19:54:20.497 INFO:teuthology.orchestra.run.smithi006.stdout: "osd_allow_recovery_below_min_size": "true", 2023-08-01T19:54:20.498 INFO:teuthology.orchestra.run.smithi006.stdout: "osd_asio_thread_count": "2", 2023-08-01T19:54:20.498 INFO:teuthology.orchestra.run.smithi006.stdout: "osd_async_recovery_min_cost": "100", 2023-08-01T19:54:20.498 INFO:teuthology.orchestra.run.smithi006.stdout: "osd_auto_mark_unfound_lost": "false", 2023-08-01T19:54:20.498 INFO:teuthology.orchestra.run.smithi006.stdout: "osd_backfill_retry_interval": "30.000000", 2023-08-01T19:54:20.498 INFO:teuthology.orchestra.run.smithi006.stdout: "osd_backfill_scan_max": "512", 2023-08-01T19:54:20.498 INFO:teuthology.orchestra.run.smithi006.stdout: "osd_backfill_scan_min": "64", 2023-08-01T19:54:20.498 INFO:teuthology.orchestra.run.smithi006.stdout: "osd_backoff_on_degraded": "false", 2023-08-01T19:54:20.499 INFO:teuthology.orchestra.run.smithi006.stdout: "osd_backoff_on_peering": "false", 2023-08-01T19:54:20.499 INFO:teuthology.orchestra.run.smithi006.stdout: "osd_backoff_on_unfound": "true", 2023-08-01T19:54:20.499 INFO:teuthology.orchestra.run.smithi006.stdout: "osd_beacon_report_interval": "300", 2023-08-01T19:54:20.499 INFO:teuthology.orchestra.run.smithi006.stdout: "osd_bench_duration": "30", 2023-08-01T19:54:20.499 INFO:teuthology.orchestra.run.smithi006.stdout: "osd_bench_large_size_max_throughput": "104857600", 2023-08-01T19:54:20.499 INFO:teuthology.orchestra.run.smithi006.stdout: "osd_bench_max_block_size": "67108864", 2023-08-01T19:54:20.499 INFO:teuthology.orchestra.run.smithi006.stdout: "osd_bench_small_size_max_iops": "100", 2023-08-01T19:54:20.499 INFO:teuthology.orchestra.run.smithi006.stdout: "osd_blkin_trace_all": "false", 2023-08-01T19:54:20.500 INFO:teuthology.orchestra.run.smithi006.stdout: "osd_calc_pg_upmaps_aggressively": "true", 2023-08-01T19:54:20.500 INFO:teuthology.orchestra.run.smithi006.stdout: "osd_calc_pg_upmaps_local_fallback_retries": "100", 2023-08-01T19:54:20.500 INFO:teuthology.orchestra.run.smithi006.stdout: "osd_check_for_log_corruption": "false", 2023-08-01T19:54:20.500 INFO:teuthology.orchestra.run.smithi006.stdout: "osd_check_max_object_name_len_on_startup": "true", 2023-08-01T19:54:20.500 INFO:teuthology.orchestra.run.smithi006.stdout: "osd_class_default_list": "cephfs hello journal lock log numops otp rbd refcount rgw rgw_gc timeindex user version cas cmpomap queue 2pc_queue fifo", 2023-08-01T19:54:20.500 INFO:teuthology.orchestra.run.smithi006.stdout: "osd_class_dir": "/usr/lib64/rados-classes", 2023-08-01T19:54:20.500 INFO:teuthology.orchestra.run.smithi006.stdout: "osd_class_load_list": "cephfs hello journal lock log numops otp rbd refcount rgw rgw_gc timeindex user version cas cmpomap queue 2pc_queue fifo", 2023-08-01T19:54:20.501 INFO:teuthology.orchestra.run.smithi006.stdout: "osd_class_update_on_start": "true", 2023-08-01T19:54:20.501 INFO:teuthology.orchestra.run.smithi006.stdout: "osd_client_message_cap": "256", 2023-08-01T19:54:20.501 INFO:teuthology.orchestra.run.smithi006.stdout: "osd_client_message_size_cap": "524288000", 2023-08-01T19:54:20.501 INFO:teuthology.orchestra.run.smithi006.stdout: "osd_client_op_priority": "63", 2023-08-01T19:54:20.501 INFO:teuthology.orchestra.run.smithi006.stdout: "osd_client_watch_timeout": "30", 2023-08-01T19:54:20.501 INFO:teuthology.orchestra.run.smithi006.stdout: "osd_command_max_records": "256", 2023-08-01T19:54:20.501 INFO:teuthology.orchestra.run.smithi006.stdout: "osd_compact_on_start": "false", 2023-08-01T19:54:20.501 INFO:teuthology.orchestra.run.smithi006.stdout: "osd_copyfrom_max_chunk": "8388608", 2023-08-01T19:54:20.502 INFO:teuthology.orchestra.run.smithi006.stdout: "osd_crush_chooseleaf_type": "0", 2023-08-01T19:54:20.502 INFO:teuthology.orchestra.run.smithi006.stdout: "osd_crush_initial_weight": "-1.000000", 2023-08-01T19:54:20.502 INFO:teuthology.orchestra.run.smithi006.stdout: "osd_crush_update_on_start": "true", 2023-08-01T19:54:20.502 INFO:teuthology.orchestra.run.smithi006.stdout: "osd_crush_update_weight_set": "true", 2023-08-01T19:54:20.502 INFO:teuthology.orchestra.run.smithi006.stdout: "osd_data": "/var/lib/ceph/osd/ceph-a", 2023-08-01T19:54:20.502 INFO:teuthology.orchestra.run.smithi006.stdout: "osd_debug_crash_on_ignored_backoff": "false", 2023-08-01T19:54:20.502 INFO:teuthology.orchestra.run.smithi006.stdout: "osd_debug_deep_scrub_sleep": "0.000000", 2023-08-01T19:54:20.502 INFO:teuthology.orchestra.run.smithi006.stdout: "osd_debug_drop_ping_duration": "0", 2023-08-01T19:54:20.503 INFO:teuthology.orchestra.run.smithi006.stdout: "osd_debug_drop_ping_probability": "0.000000", 2023-08-01T19:54:20.503 INFO:teuthology.orchestra.run.smithi006.stdout: "osd_debug_feed_pullee": "-1", 2023-08-01T19:54:20.503 INFO:teuthology.orchestra.run.smithi006.stdout: "osd_debug_inject_copyfrom_error": "false", 2023-08-01T19:54:20.503 INFO:teuthology.orchestra.run.smithi006.stdout: "osd_debug_inject_dispatch_delay_duration": "0.100000", 2023-08-01T19:54:20.503 INFO:teuthology.orchestra.run.smithi006.stdout: "osd_debug_inject_dispatch_delay_probability": "0.000000", 2023-08-01T19:54:20.503 INFO:teuthology.orchestra.run.smithi006.stdout: "osd_debug_misdirected_ops": "false", 2023-08-01T19:54:20.503 INFO:teuthology.orchestra.run.smithi006.stdout: "osd_debug_no_acting_change": "false", 2023-08-01T19:54:20.503 INFO:teuthology.orchestra.run.smithi006.stdout: "osd_debug_no_purge_strays": "false", 2023-08-01T19:54:20.504 INFO:teuthology.orchestra.run.smithi006.stdout: "osd_debug_op_order": "false", 2023-08-01T19:54:20.504 INFO:teuthology.orchestra.run.smithi006.stdout: "osd_debug_pg_log_writeout": "false", 2023-08-01T19:54:20.504 INFO:teuthology.orchestra.run.smithi006.stdout: "osd_debug_pretend_recovery_active": "false", 2023-08-01T19:54:20.504 INFO:teuthology.orchestra.run.smithi006.stdout: "osd_debug_random_push_read_error": "0.000000", 2023-08-01T19:54:20.504 INFO:teuthology.orchestra.run.smithi006.stdout: "osd_debug_reject_backfill_probability": "0.000000", 2023-08-01T19:54:20.504 INFO:teuthology.orchestra.run.smithi006.stdout: "osd_debug_shutdown": "false", 2023-08-01T19:54:20.504 INFO:teuthology.orchestra.run.smithi006.stdout: "osd_debug_skip_full_check_in_backfill_reservation": "false", 2023-08-01T19:54:20.504 INFO:teuthology.orchestra.run.smithi006.stdout: "osd_debug_skip_full_check_in_recovery": "false", 2023-08-01T19:54:20.505 INFO:teuthology.orchestra.run.smithi006.stdout: "osd_debug_verify_cached_snaps": "false", 2023-08-01T19:54:20.505 INFO:teuthology.orchestra.run.smithi006.stdout: "osd_debug_verify_missing_on_start": "false", 2023-08-01T19:54:20.505 INFO:teuthology.orchestra.run.smithi006.stdout: "osd_debug_verify_snaps": "false", 2023-08-01T19:54:20.505 INFO:teuthology.orchestra.run.smithi006.stdout: "osd_debug_verify_stray_on_activate": "false", 2023-08-01T19:54:20.505 INFO:teuthology.orchestra.run.smithi006.stdout: "osd_deep_scrub_interval": "604800.000000", 2023-08-01T19:54:20.505 INFO:teuthology.orchestra.run.smithi006.stdout: "osd_deep_scrub_keys": "1024", 2023-08-01T19:54:20.505 INFO:teuthology.orchestra.run.smithi006.stdout: "osd_deep_scrub_large_omap_object_key_threshold": "200000", 2023-08-01T19:54:20.506 INFO:teuthology.orchestra.run.smithi006.stdout: "osd_deep_scrub_large_omap_object_value_sum_threshold": "1073741824", 2023-08-01T19:54:20.506 INFO:teuthology.orchestra.run.smithi006.stdout: "osd_deep_scrub_randomize_ratio": "0.150000", 2023-08-01T19:54:20.506 INFO:teuthology.orchestra.run.smithi006.stdout: "osd_deep_scrub_stride": "524288", 2023-08-01T19:54:20.506 INFO:teuthology.orchestra.run.smithi006.stdout: "osd_deep_scrub_update_digest_min_age": "7200", 2023-08-01T19:54:20.506 INFO:teuthology.orchestra.run.smithi006.stdout: "osd_default_data_pool_replay_window": "5", 2023-08-01T19:54:20.506 INFO:teuthology.orchestra.run.smithi006.stdout: "osd_default_notify_timeout": "30", 2023-08-01T19:54:20.506 INFO:teuthology.orchestra.run.smithi006.stdout: "osd_delete_sleep": "0.000000", 2023-08-01T19:54:20.506 INFO:teuthology.orchestra.run.smithi006.stdout: "osd_delete_sleep_hdd": "5.000000", 2023-08-01T19:54:20.507 INFO:teuthology.orchestra.run.smithi006.stdout: "osd_delete_sleep_hybrid": "1.000000", 2023-08-01T19:54:20.507 INFO:teuthology.orchestra.run.smithi006.stdout: "osd_delete_sleep_ssd": "1.000000", 2023-08-01T19:54:20.507 INFO:teuthology.orchestra.run.smithi006.stdout: "osd_discard_disconnected_ops": "true", 2023-08-01T19:54:20.507 INFO:teuthology.orchestra.run.smithi006.stdout: "osd_enable_op_tracker": "true", 2023-08-01T19:54:20.507 INFO:teuthology.orchestra.run.smithi006.stdout: "osd_erasure_code_plugins": "jerasure lrc", 2023-08-01T19:54:20.507 INFO:teuthology.orchestra.run.smithi006.stdout: "osd_failsafe_full_ratio": "0.970000", 2023-08-01T19:54:20.507 INFO:teuthology.orchestra.run.smithi006.stdout: "osd_fast_fail_on_connection_refused": "true", 2023-08-01T19:54:20.507 INFO:teuthology.orchestra.run.smithi006.stdout: "osd_fast_info": "true", 2023-08-01T19:54:20.508 INFO:teuthology.orchestra.run.smithi006.stdout: "osd_fast_shutdown": "true", 2023-08-01T19:54:20.508 INFO:teuthology.orchestra.run.smithi006.stdout: "osd_fast_shutdown_notify_mon": "true", 2023-08-01T19:54:20.508 INFO:teuthology.orchestra.run.smithi006.stdout: "osd_fast_shutdown_timeout": "15", 2023-08-01T19:54:20.508 INFO:teuthology.orchestra.run.smithi006.stdout: "osd_find_best_info_ignore_history_les": "false", 2023-08-01T19:54:20.508 INFO:teuthology.orchestra.run.smithi006.stdout: "osd_force_auth_primary_missing_objects": "100", 2023-08-01T19:54:20.508 INFO:teuthology.orchestra.run.smithi006.stdout: "osd_force_recovery_pg_log_entries_factor": "1.300000", 2023-08-01T19:54:20.508 INFO:teuthology.orchestra.run.smithi006.stdout: "osd_function_tracing": "false", 2023-08-01T19:54:20.508 INFO:teuthology.orchestra.run.smithi006.stdout: "osd_heartbeat_grace": "20", 2023-08-01T19:54:20.509 INFO:teuthology.orchestra.run.smithi006.stdout: "osd_heartbeat_interval": "6", 2023-08-01T19:54:20.509 INFO:teuthology.orchestra.run.smithi006.stdout: "osd_heartbeat_min_healthy_ratio": "0.330000", 2023-08-01T19:54:20.509 INFO:teuthology.orchestra.run.smithi006.stdout: "osd_heartbeat_min_peers": "10", 2023-08-01T19:54:20.509 INFO:teuthology.orchestra.run.smithi006.stdout: "osd_heartbeat_min_size": "2000", 2023-08-01T19:54:20.509 INFO:teuthology.orchestra.run.smithi006.stdout: "osd_heartbeat_stale": "600", 2023-08-01T19:54:20.509 INFO:teuthology.orchestra.run.smithi006.stdout: "osd_heartbeat_use_min_delay_socket": "false", 2023-08-01T19:54:20.509 INFO:teuthology.orchestra.run.smithi006.stdout: "osd_hit_set_max_size": "100000", 2023-08-01T19:54:20.509 INFO:teuthology.orchestra.run.smithi006.stdout: "osd_hit_set_min_size": "1000", 2023-08-01T19:54:20.510 INFO:teuthology.orchestra.run.smithi006.stdout: "osd_hit_set_namespace": ".ceph-internal", 2023-08-01T19:54:20.510 INFO:teuthology.orchestra.run.smithi006.stdout: "osd_ignore_stale_divergent_priors": "false", 2023-08-01T19:54:20.510 INFO:teuthology.orchestra.run.smithi006.stdout: "osd_inject_bad_map_crc_probability": "0.000000", 2023-08-01T19:54:20.510 INFO:teuthology.orchestra.run.smithi006.stdout: "osd_inject_failure_on_pg_removal": "false", 2023-08-01T19:54:20.510 INFO:teuthology.orchestra.run.smithi006.stdout: "osd_journal": "/var/lib/ceph/osd/ceph-a/journal", 2023-08-01T19:54:20.510 INFO:teuthology.orchestra.run.smithi006.stdout: "osd_journal_flush_on_shutdown": "true", 2023-08-01T19:54:20.510 INFO:teuthology.orchestra.run.smithi006.stdout: "osd_journal_size": "5120", 2023-08-01T19:54:20.511 INFO:teuthology.orchestra.run.smithi006.stdout: "osd_kill_backfill_at": "0", 2023-08-01T19:54:20.511 INFO:teuthology.orchestra.run.smithi006.stdout: "osd_loop_before_reset_tphandle": "64", 2023-08-01T19:54:20.511 INFO:teuthology.orchestra.run.smithi006.stdout: "osd_map_cache_size": "50", 2023-08-01T19:54:20.511 INFO:teuthology.orchestra.run.smithi006.stdout: "osd_map_dedup": "true", 2023-08-01T19:54:20.511 INFO:teuthology.orchestra.run.smithi006.stdout: "osd_map_message_max": "40", 2023-08-01T19:54:20.511 INFO:teuthology.orchestra.run.smithi006.stdout: "osd_map_message_max_bytes": "10485760", 2023-08-01T19:54:20.511 INFO:teuthology.orchestra.run.smithi006.stdout: "osd_map_share_max_epochs": "40", 2023-08-01T19:54:20.512 INFO:teuthology.orchestra.run.smithi006.stdout: "osd_max_attr_name_len": "100", 2023-08-01T19:54:20.512 INFO:teuthology.orchestra.run.smithi006.stdout: "osd_max_attr_size": "0", 2023-08-01T19:54:20.512 INFO:teuthology.orchestra.run.smithi006.stdout: "osd_max_backfills": "1", 2023-08-01T19:54:20.512 INFO:teuthology.orchestra.run.smithi006.stdout: "osd_max_markdown_count": "5", 2023-08-01T19:54:20.512 INFO:teuthology.orchestra.run.smithi006.stdout: "osd_max_markdown_period": "600", 2023-08-01T19:54:20.512 INFO:teuthology.orchestra.run.smithi006.stdout: "osd_max_object_name_len": "2048", 2023-08-01T19:54:20.512 INFO:teuthology.orchestra.run.smithi006.stdout: "osd_max_object_namespace_len": "256", 2023-08-01T19:54:20.513 INFO:teuthology.orchestra.run.smithi006.stdout: "osd_max_object_size": "134217728", 2023-08-01T19:54:20.513 INFO:teuthology.orchestra.run.smithi006.stdout: "osd_max_omap_bytes_per_request": "1073741824", 2023-08-01T19:54:20.513 INFO:teuthology.orchestra.run.smithi006.stdout: "osd_max_omap_entries_per_request": "1024", 2023-08-01T19:54:20.513 INFO:teuthology.orchestra.run.smithi006.stdout: "osd_max_pg_blocked_by": "16", 2023-08-01T19:54:20.513 INFO:teuthology.orchestra.run.smithi006.stdout: "osd_max_pg_log_entries": "10000", 2023-08-01T19:54:20.513 INFO:teuthology.orchestra.run.smithi006.stdout: "osd_max_pg_per_osd_hard_ratio": "3.000000", 2023-08-01T19:54:20.513 INFO:teuthology.orchestra.run.smithi006.stdout: "osd_max_pgls": "1024", 2023-08-01T19:54:20.514 INFO:teuthology.orchestra.run.smithi006.stdout: "osd_max_push_cost": "8388608", 2023-08-01T19:54:20.514 INFO:teuthology.orchestra.run.smithi006.stdout: "osd_max_push_objects": "10", 2023-08-01T19:54:20.514 INFO:teuthology.orchestra.run.smithi006.stdout: "osd_max_scrubs": "1", 2023-08-01T19:54:20.514 INFO:teuthology.orchestra.run.smithi006.stdout: "osd_max_snap_prune_intervals_per_epoch": "512", 2023-08-01T19:54:20.514 INFO:teuthology.orchestra.run.smithi006.stdout: "osd_max_trimming_pgs": "2", 2023-08-01T19:54:20.514 INFO:teuthology.orchestra.run.smithi006.stdout: "osd_max_write_op_reply_len": "64", 2023-08-01T19:54:20.514 INFO:teuthology.orchestra.run.smithi006.stdout: "osd_max_write_size": "90", 2023-08-01T19:54:20.514 INFO:teuthology.orchestra.run.smithi006.stdout: "osd_mclock_force_run_benchmark_on_init": "false", 2023-08-01T19:54:20.515 INFO:teuthology.orchestra.run.smithi006.stdout: "osd_mclock_iops_capacity_threshold_hdd": "500.000000", 2023-08-01T19:54:20.515 INFO:teuthology.orchestra.run.smithi006.stdout: "osd_mclock_iops_capacity_threshold_ssd": "80000.000000", 2023-08-01T19:54:20.515 INFO:teuthology.orchestra.run.smithi006.stdout: "osd_mclock_max_capacity_iops_hdd": "315.000000", 2023-08-01T19:54:20.515 INFO:teuthology.orchestra.run.smithi006.stdout: "osd_mclock_max_capacity_iops_ssd": "21500.000000", 2023-08-01T19:54:20.515 INFO:teuthology.orchestra.run.smithi006.stdout: "osd_mclock_max_sequential_bandwidth_hdd": "157286400", 2023-08-01T19:54:20.515 INFO:teuthology.orchestra.run.smithi006.stdout: "osd_mclock_max_sequential_bandwidth_ssd": "1258291200", 2023-08-01T19:54:20.515 INFO:teuthology.orchestra.run.smithi006.stdout: "osd_mclock_override_recovery_settings": "false", 2023-08-01T19:54:20.516 INFO:teuthology.orchestra.run.smithi006.stdout: "osd_mclock_profile": "balanced", 2023-08-01T19:54:20.516 INFO:teuthology.orchestra.run.smithi006.stdout: "osd_mclock_scheduler_anticipation_timeout": "0.000000", 2023-08-01T19:54:20.516 INFO:teuthology.orchestra.run.smithi006.stdout: "osd_mclock_scheduler_background_best_effort_lim": "0.000000", 2023-08-01T19:54:20.516 INFO:teuthology.orchestra.run.smithi006.stdout: "osd_mclock_scheduler_background_best_effort_res": "0.000000", 2023-08-01T19:54:20.516 INFO:teuthology.orchestra.run.smithi006.stdout: "osd_mclock_scheduler_background_best_effort_wgt": "1", 2023-08-01T19:54:20.516 INFO:teuthology.orchestra.run.smithi006.stdout: "osd_mclock_scheduler_background_recovery_lim": "0.000000", 2023-08-01T19:54:20.516 INFO:teuthology.orchestra.run.smithi006.stdout: "osd_mclock_scheduler_background_recovery_res": "0.000000", 2023-08-01T19:54:20.517 INFO:teuthology.orchestra.run.smithi006.stdout: "osd_mclock_scheduler_background_recovery_wgt": "1", 2023-08-01T19:54:20.517 INFO:teuthology.orchestra.run.smithi006.stdout: "osd_mclock_scheduler_client_lim": "0.000000", 2023-08-01T19:54:20.517 INFO:teuthology.orchestra.run.smithi006.stdout: "osd_mclock_scheduler_client_res": "0.000000", 2023-08-01T19:54:20.517 INFO:teuthology.orchestra.run.smithi006.stdout: "osd_mclock_scheduler_client_wgt": "1", 2023-08-01T19:54:20.517 INFO:teuthology.orchestra.run.smithi006.stdout: "osd_mclock_skip_benchmark": "false", 2023-08-01T19:54:20.517 INFO:teuthology.orchestra.run.smithi006.stdout: "osd_memory_base": "805306368", 2023-08-01T19:54:20.517 INFO:teuthology.orchestra.run.smithi006.stdout: "osd_memory_cache_min": "134217728", 2023-08-01T19:54:20.517 INFO:teuthology.orchestra.run.smithi006.stdout: "osd_memory_cache_resize_interval": "1.000000", 2023-08-01T19:54:20.518 INFO:teuthology.orchestra.run.smithi006.stdout: "osd_memory_expected_fragmentation": "0.150000", 2023-08-01T19:54:20.518 INFO:teuthology.orchestra.run.smithi006.stdout: "osd_memory_target": "4294967296", 2023-08-01T19:54:20.518 INFO:teuthology.orchestra.run.smithi006.stdout: "osd_memory_target_autotune": "false", 2023-08-01T19:54:20.518 INFO:teuthology.orchestra.run.smithi006.stdout: "osd_memory_target_cgroup_limit_ratio": "0.800000", 2023-08-01T19:54:20.518 INFO:teuthology.orchestra.run.smithi006.stdout: "osd_min_pg_log_entries": "250", 2023-08-01T19:54:20.518 INFO:teuthology.orchestra.run.smithi006.stdout: "osd_min_recovery_priority": "0", 2023-08-01T19:54:20.518 INFO:teuthology.orchestra.run.smithi006.stdout: "osd_mon_heartbeat_interval": "30", 2023-08-01T19:54:20.518 INFO:teuthology.orchestra.run.smithi006.stdout: "osd_mon_heartbeat_stat_stale": "3600", 2023-08-01T19:54:20.519 INFO:teuthology.orchestra.run.smithi006.stdout: "osd_mon_report_interval": "5", 2023-08-01T19:54:20.519 INFO:teuthology.orchestra.run.smithi006.stdout: "osd_mon_report_max_in_flight": "2", 2023-08-01T19:54:20.519 INFO:teuthology.orchestra.run.smithi006.stdout: "osd_mon_shutdown_timeout": "5.000000", 2023-08-01T19:54:20.519 INFO:teuthology.orchestra.run.smithi006.stdout: "osd_num_cache_shards": "32", 2023-08-01T19:54:20.519 INFO:teuthology.orchestra.run.smithi006.stdout: "osd_num_op_tracker_shard": "32", 2023-08-01T19:54:20.519 INFO:teuthology.orchestra.run.smithi006.stdout: "osd_numa_auto_affinity": "true", 2023-08-01T19:54:20.519 INFO:teuthology.orchestra.run.smithi006.stdout: "osd_numa_node": "-1", 2023-08-01T19:54:20.519 INFO:teuthology.orchestra.run.smithi006.stdout: "osd_numa_prefer_iface": "true", 2023-08-01T19:54:20.520 INFO:teuthology.orchestra.run.smithi006.stdout: "osd_object_clean_region_max_num_intervals": "10", 2023-08-01T19:54:20.520 INFO:teuthology.orchestra.run.smithi006.stdout: "osd_objecter_finishers": "1", 2023-08-01T19:54:20.520 INFO:teuthology.orchestra.run.smithi006.stdout: "osd_objectstore": "bluestore", 2023-08-01T19:54:20.520 INFO:teuthology.orchestra.run.smithi006.stdout: "osd_objectstore_fuse": "false", 2023-08-01T19:54:20.520 INFO:teuthology.orchestra.run.smithi006.stdout: "osd_objectstore_tracing": "false", 2023-08-01T19:54:20.520 INFO:teuthology.orchestra.run.smithi006.stdout: "osd_op_complaint_time": "30.000000", 2023-08-01T19:54:20.520 INFO:teuthology.orchestra.run.smithi006.stdout: "osd_op_history_duration": "600", 2023-08-01T19:54:20.520 INFO:teuthology.orchestra.run.smithi006.stdout: "osd_op_history_size": "20", 2023-08-01T19:54:20.521 INFO:teuthology.orchestra.run.smithi006.stdout: "osd_op_history_slow_op_size": "20", 2023-08-01T19:54:20.521 INFO:teuthology.orchestra.run.smithi006.stdout: "osd_op_history_slow_op_threshold": "10.000000", 2023-08-01T19:54:20.521 INFO:teuthology.orchestra.run.smithi006.stdout: "osd_op_log_threshold": "5", 2023-08-01T19:54:20.521 INFO:teuthology.orchestra.run.smithi006.stdout: "osd_op_num_shards": "0", 2023-08-01T19:54:20.521 INFO:teuthology.orchestra.run.smithi006.stdout: "osd_op_num_shards_hdd": "5", 2023-08-01T19:54:20.521 INFO:teuthology.orchestra.run.smithi006.stdout: "osd_op_num_shards_ssd": "8", 2023-08-01T19:54:20.521 INFO:teuthology.orchestra.run.smithi006.stdout: "osd_op_num_threads_per_shard": "0", 2023-08-01T19:54:20.521 INFO:teuthology.orchestra.run.smithi006.stdout: "osd_op_num_threads_per_shard_hdd": "1", 2023-08-01T19:54:20.522 INFO:teuthology.orchestra.run.smithi006.stdout: "osd_op_num_threads_per_shard_ssd": "2", 2023-08-01T19:54:20.522 INFO:teuthology.orchestra.run.smithi006.stdout: "osd_op_pq_max_tokens_per_priority": "4194304", 2023-08-01T19:54:20.522 INFO:teuthology.orchestra.run.smithi006.stdout: "osd_op_pq_min_cost": "65536", 2023-08-01T19:54:20.522 INFO:teuthology.orchestra.run.smithi006.stdout: "osd_op_queue": "mclock_scheduler", 2023-08-01T19:54:20.522 INFO:teuthology.orchestra.run.smithi006.stdout: "osd_op_queue_cut_off": "high", 2023-08-01T19:54:20.522 INFO:teuthology.orchestra.run.smithi006.stdout: "osd_op_thread_suicide_timeout": "150", 2023-08-01T19:54:20.522 INFO:teuthology.orchestra.run.smithi006.stdout: "osd_op_thread_timeout": "15", 2023-08-01T19:54:20.522 INFO:teuthology.orchestra.run.smithi006.stdout: "osd_open_classes_on_start": "true", 2023-08-01T19:54:20.523 INFO:teuthology.orchestra.run.smithi006.stdout: "osd_os_flags": "0", 2023-08-01T19:54:20.523 INFO:teuthology.orchestra.run.smithi006.stdout: "osd_peering_op_priority": "255", 2023-08-01T19:54:20.523 INFO:teuthology.orchestra.run.smithi006.stdout: "osd_pg_delete_cost": "1048576", 2023-08-01T19:54:20.523 INFO:teuthology.orchestra.run.smithi006.stdout: "osd_pg_delete_priority": "5", 2023-08-01T19:54:20.523 INFO:teuthology.orchestra.run.smithi006.stdout: "osd_pg_epoch_max_lag_factor": "2.000000", 2023-08-01T19:54:20.523 INFO:teuthology.orchestra.run.smithi006.stdout: "osd_pg_epoch_persisted_max_stale": "40", 2023-08-01T19:54:20.523 INFO:teuthology.orchestra.run.smithi006.stdout: "osd_pg_log_dups_tracked": "3000", 2023-08-01T19:54:20.523 INFO:teuthology.orchestra.run.smithi006.stdout: "osd_pg_log_trim_max": "10000", 2023-08-01T19:54:20.524 INFO:teuthology.orchestra.run.smithi006.stdout: "osd_pg_log_trim_min": "100", 2023-08-01T19:54:20.524 INFO:teuthology.orchestra.run.smithi006.stdout: "osd_pg_max_concurrent_snap_trims": "2", 2023-08-01T19:54:20.524 INFO:teuthology.orchestra.run.smithi006.stdout: "osd_pg_object_context_cache_count": "64", 2023-08-01T19:54:20.524 INFO:teuthology.orchestra.run.smithi006.stdout: "osd_pg_stat_report_interval_max": "500", 2023-08-01T19:54:20.524 INFO:teuthology.orchestra.run.smithi006.stdout: "osd_pool_default_cache_max_evict_check_size": "10", 2023-08-01T19:54:20.524 INFO:teuthology.orchestra.run.smithi006.stdout: "osd_pool_default_cache_min_evict_age": "0", 2023-08-01T19:54:20.524 INFO:teuthology.orchestra.run.smithi006.stdout: "osd_pool_default_cache_min_flush_age": "0", 2023-08-01T19:54:20.524 INFO:teuthology.orchestra.run.smithi006.stdout: "osd_pool_default_cache_target_dirty_high_ratio": "0.600000", 2023-08-01T19:54:20.525 INFO:teuthology.orchestra.run.smithi006.stdout: "osd_pool_default_cache_target_dirty_ratio": "0.400000", 2023-08-01T19:54:20.525 INFO:teuthology.orchestra.run.smithi006.stdout: "osd_pool_default_cache_target_full_ratio": "0.800000", 2023-08-01T19:54:20.525 INFO:teuthology.orchestra.run.smithi006.stdout: "osd_pool_default_crush_rule": "-1", 2023-08-01T19:54:20.525 INFO:teuthology.orchestra.run.smithi006.stdout: "osd_pool_default_ec_fast_read": "false", 2023-08-01T19:54:20.525 INFO:teuthology.orchestra.run.smithi006.stdout: "osd_pool_default_erasure_code_profile": "plugin=jerasure technique=reed_sol_van k=2 m=1 crush-failure-domain=osd", 2023-08-01T19:54:20.525 INFO:teuthology.orchestra.run.smithi006.stdout: "osd_pool_default_flag_bulk": "false", 2023-08-01T19:54:20.525 INFO:teuthology.orchestra.run.smithi006.stdout: "osd_pool_default_flag_hashpspool": "true", 2023-08-01T19:54:20.525 INFO:teuthology.orchestra.run.smithi006.stdout: "osd_pool_default_flag_nodelete": "false", 2023-08-01T19:54:20.526 INFO:teuthology.orchestra.run.smithi006.stdout: "osd_pool_default_flag_nopgchange": "false", 2023-08-01T19:54:20.526 INFO:teuthology.orchestra.run.smithi006.stdout: "osd_pool_default_flag_nosizechange": "false", 2023-08-01T19:54:20.526 INFO:teuthology.orchestra.run.smithi006.stdout: "osd_pool_default_flags": "0", 2023-08-01T19:54:20.526 INFO:teuthology.orchestra.run.smithi006.stdout: "osd_pool_default_hit_set_bloom_fpp": "0.050000", 2023-08-01T19:54:20.526 INFO:teuthology.orchestra.run.smithi006.stdout: "osd_pool_default_min_size": "0", 2023-08-01T19:54:20.526 INFO:teuthology.orchestra.run.smithi006.stdout: "osd_pool_default_pg_autoscale_mode": "off", 2023-08-01T19:54:20.526 INFO:teuthology.orchestra.run.smithi006.stdout: "osd_pool_default_pg_num": "32", 2023-08-01T19:54:20.527 INFO:teuthology.orchestra.run.smithi006.stdout: "osd_pool_default_pgp_num": "0", 2023-08-01T19:54:20.527 INFO:teuthology.orchestra.run.smithi006.stdout: "osd_pool_default_read_lease_ratio": "0.800000", 2023-08-01T19:54:20.527 INFO:teuthology.orchestra.run.smithi006.stdout: "osd_pool_default_size": "2", 2023-08-01T19:54:20.527 INFO:teuthology.orchestra.run.smithi006.stdout: "osd_pool_default_type": "replicated", 2023-08-01T19:54:20.527 INFO:teuthology.orchestra.run.smithi006.stdout: "osd_pool_erasure_code_stripe_unit": "4096", 2023-08-01T19:54:20.527 INFO:teuthology.orchestra.run.smithi006.stdout: "osd_pool_use_gmt_hitset": "true", 2023-08-01T19:54:20.527 INFO:teuthology.orchestra.run.smithi006.stdout: "osd_push_per_object_cost": "1000", 2023-08-01T19:54:20.527 INFO:teuthology.orchestra.run.smithi006.stdout: "osd_read_ec_check_for_errors": "false", 2023-08-01T19:54:20.528 INFO:teuthology.orchestra.run.smithi006.stdout: "osd_recover_clone_overlap": "true", 2023-08-01T19:54:20.528 INFO:teuthology.orchestra.run.smithi006.stdout: "osd_recover_clone_overlap_limit": "10", 2023-08-01T19:54:20.528 INFO:teuthology.orchestra.run.smithi006.stdout: "osd_recovery_cost": "20971520", 2023-08-01T19:54:20.528 INFO:teuthology.orchestra.run.smithi006.stdout: "osd_recovery_delay_start": "0.000000", 2023-08-01T19:54:20.528 INFO:teuthology.orchestra.run.smithi006.stdout: "osd_recovery_max_active": "0", 2023-08-01T19:54:20.528 INFO:teuthology.orchestra.run.smithi006.stdout: "osd_recovery_max_active_hdd": "3", 2023-08-01T19:54:20.528 INFO:teuthology.orchestra.run.smithi006.stdout: "osd_recovery_max_active_ssd": "10", 2023-08-01T19:54:20.528 INFO:teuthology.orchestra.run.smithi006.stdout: "osd_recovery_max_chunk": "8388608", 2023-08-01T19:54:20.529 INFO:teuthology.orchestra.run.smithi006.stdout: "osd_recovery_max_omap_entries_per_chunk": "8096", 2023-08-01T19:54:20.529 INFO:teuthology.orchestra.run.smithi006.stdout: "osd_recovery_max_single_start": "1", 2023-08-01T19:54:20.529 INFO:teuthology.orchestra.run.smithi006.stdout: "osd_recovery_op_priority": "3", 2023-08-01T19:54:20.529 INFO:teuthology.orchestra.run.smithi006.stdout: "osd_recovery_op_warn_multiple": "16", 2023-08-01T19:54:20.529 INFO:teuthology.orchestra.run.smithi006.stdout: "osd_recovery_priority": "5", 2023-08-01T19:54:20.529 INFO:teuthology.orchestra.run.smithi006.stdout: "osd_recovery_retry_interval": "30.000000", 2023-08-01T19:54:20.529 INFO:teuthology.orchestra.run.smithi006.stdout: "osd_recovery_sleep": "0.000000", 2023-08-01T19:54:20.530 INFO:teuthology.orchestra.run.smithi006.stdout: "osd_recovery_sleep_hdd": "0.100000", 2023-08-01T19:54:20.530 INFO:teuthology.orchestra.run.smithi006.stdout: "osd_recovery_sleep_hybrid": "0.025000", 2023-08-01T19:54:20.530 INFO:teuthology.orchestra.run.smithi006.stdout: "osd_recovery_sleep_ssd": "0.000000", 2023-08-01T19:54:20.530 INFO:teuthology.orchestra.run.smithi006.stdout: "osd_repair_during_recovery": "false", 2023-08-01T19:54:20.530 INFO:teuthology.orchestra.run.smithi006.stdout: "osd_requested_scrub_priority": "120", 2023-08-01T19:54:20.530 INFO:teuthology.orchestra.run.smithi006.stdout: "osd_rocksdb_iterator_bounds_enabled": "true", 2023-08-01T19:54:20.530 INFO:teuthology.orchestra.run.smithi006.stdout: "osd_rollback_to_cluster_snap": "", 2023-08-01T19:54:20.530 INFO:teuthology.orchestra.run.smithi006.stdout: "osd_scrub_auto_repair": "false", 2023-08-01T19:54:20.531 INFO:teuthology.orchestra.run.smithi006.stdout: "osd_scrub_auto_repair_num_errors": "5", 2023-08-01T19:54:20.531 INFO:teuthology.orchestra.run.smithi006.stdout: "osd_scrub_backoff_ratio": "0.660000", 2023-08-01T19:54:20.531 INFO:teuthology.orchestra.run.smithi006.stdout: "osd_scrub_begin_hour": "0", 2023-08-01T19:54:20.531 INFO:teuthology.orchestra.run.smithi006.stdout: "osd_scrub_begin_week_day": "0", 2023-08-01T19:54:20.531 INFO:teuthology.orchestra.run.smithi006.stdout: "osd_scrub_chunk_max": "25", 2023-08-01T19:54:20.531 INFO:teuthology.orchestra.run.smithi006.stdout: "osd_scrub_chunk_min": "5", 2023-08-01T19:54:20.531 INFO:teuthology.orchestra.run.smithi006.stdout: "osd_scrub_cost": "52428800", 2023-08-01T19:54:20.532 INFO:teuthology.orchestra.run.smithi006.stdout: "osd_scrub_during_recovery": "false", 2023-08-01T19:54:20.532 INFO:teuthology.orchestra.run.smithi006.stdout: "osd_scrub_end_hour": "0", 2023-08-01T19:54:20.532 INFO:teuthology.orchestra.run.smithi006.stdout: "osd_scrub_end_week_day": "0", 2023-08-01T19:54:20.532 INFO:teuthology.orchestra.run.smithi006.stdout: "osd_scrub_event_cost": "4096", 2023-08-01T19:54:20.532 INFO:teuthology.orchestra.run.smithi006.stdout: "osd_scrub_extended_sleep": "0.000000", 2023-08-01T19:54:20.532 INFO:teuthology.orchestra.run.smithi006.stdout: "osd_scrub_interval_randomize_ratio": "0.500000", 2023-08-01T19:54:20.532 INFO:teuthology.orchestra.run.smithi006.stdout: "osd_scrub_invalid_stats": "true", 2023-08-01T19:54:20.533 INFO:teuthology.orchestra.run.smithi006.stdout: "osd_scrub_load_threshold": "0.500000", 2023-08-01T19:54:20.533 INFO:teuthology.orchestra.run.smithi006.stdout: "osd_scrub_max_interval": "604800.000000", 2023-08-01T19:54:20.533 INFO:teuthology.orchestra.run.smithi006.stdout: "osd_scrub_max_preemptions": "5", 2023-08-01T19:54:20.533 INFO:teuthology.orchestra.run.smithi006.stdout: "osd_scrub_min_interval": "86400.000000", 2023-08-01T19:54:20.533 INFO:teuthology.orchestra.run.smithi006.stdout: "osd_scrub_priority": "5", 2023-08-01T19:54:20.533 INFO:teuthology.orchestra.run.smithi006.stdout: "osd_scrub_sleep": "0.000000", 2023-08-01T19:54:20.533 INFO:teuthology.orchestra.run.smithi006.stdout: "osd_shutdown_pgref_assert": "false", 2023-08-01T19:54:20.533 INFO:teuthology.orchestra.run.smithi006.stdout: "osd_skip_data_digest": "false", 2023-08-01T19:54:20.534 INFO:teuthology.orchestra.run.smithi006.stdout: "osd_smart_report_timeout": "5", 2023-08-01T19:54:20.534 INFO:teuthology.orchestra.run.smithi006.stdout: "osd_snap_trim_cost": "1048576", 2023-08-01T19:54:20.534 INFO:teuthology.orchestra.run.smithi006.stdout: "osd_snap_trim_priority": "5", 2023-08-01T19:54:20.534 INFO:teuthology.orchestra.run.smithi006.stdout: "osd_snap_trim_sleep": "0.000000", 2023-08-01T19:54:20.534 INFO:teuthology.orchestra.run.smithi006.stdout: "osd_snap_trim_sleep_hdd": "5.000000", 2023-08-01T19:54:20.534 INFO:teuthology.orchestra.run.smithi006.stdout: "osd_snap_trim_sleep_hybrid": "2.000000", 2023-08-01T19:54:20.534 INFO:teuthology.orchestra.run.smithi006.stdout: "osd_snap_trim_sleep_ssd": "0.000000", 2023-08-01T19:54:20.534 INFO:teuthology.orchestra.run.smithi006.stdout: "osd_target_pg_log_entries_per_osd": "300000", 2023-08-01T19:54:20.535 INFO:teuthology.orchestra.run.smithi006.stdout: "osd_target_transaction_size": "30", 2023-08-01T19:54:20.535 INFO:teuthology.orchestra.run.smithi006.stdout: "osd_tier_default_cache_hit_set_count": "4", 2023-08-01T19:54:20.535 INFO:teuthology.orchestra.run.smithi006.stdout: "osd_tier_default_cache_hit_set_grade_decay_rate": "20", 2023-08-01T19:54:20.535 INFO:teuthology.orchestra.run.smithi006.stdout: "osd_tier_default_cache_hit_set_period": "1200", 2023-08-01T19:54:20.535 INFO:teuthology.orchestra.run.smithi006.stdout: "osd_tier_default_cache_hit_set_search_last_n": "1", 2023-08-01T19:54:20.535 INFO:teuthology.orchestra.run.smithi006.stdout: "osd_tier_default_cache_hit_set_type": "bloom", 2023-08-01T19:54:20.535 INFO:teuthology.orchestra.run.smithi006.stdout: "osd_tier_default_cache_min_read_recency_for_promote": "1", 2023-08-01T19:54:20.535 INFO:teuthology.orchestra.run.smithi006.stdout: "osd_tier_default_cache_min_write_recency_for_promote": "1", 2023-08-01T19:54:20.536 INFO:teuthology.orchestra.run.smithi006.stdout: "osd_tier_default_cache_mode": "writeback", 2023-08-01T19:54:20.536 INFO:teuthology.orchestra.run.smithi006.stdout: "osd_tier_promote_max_bytes_sec": "5242880", 2023-08-01T19:54:20.536 INFO:teuthology.orchestra.run.smithi006.stdout: "osd_tier_promote_max_objects_sec": "25", 2023-08-01T19:54:20.536 INFO:teuthology.orchestra.run.smithi006.stdout: "osd_tracing": "false", 2023-08-01T19:54:20.536 INFO:teuthology.orchestra.run.smithi006.stdout: "osd_use_stale_snap": "false", 2023-08-01T19:54:20.536 INFO:teuthology.orchestra.run.smithi006.stdout: "osd_uuid": "00000000-0000-0000-0000-000000000000", 2023-08-01T19:54:20.536 INFO:teuthology.orchestra.run.smithi006.stdout: "osdc_blkin_trace_all": "false", 2023-08-01T19:54:20.536 INFO:teuthology.orchestra.run.smithi006.stdout: "paxos_kill_at": "0", 2023-08-01T19:54:20.537 INFO:teuthology.orchestra.run.smithi006.stdout: "paxos_max_join_drift": "10", 2023-08-01T19:54:20.537 INFO:teuthology.orchestra.run.smithi006.stdout: "paxos_min": "500", 2023-08-01T19:54:20.537 INFO:teuthology.orchestra.run.smithi006.stdout: "paxos_min_wait": "0.050000", 2023-08-01T19:54:20.537 INFO:teuthology.orchestra.run.smithi006.stdout: "paxos_propose_interval": "1.000000", 2023-08-01T19:54:20.537 INFO:teuthology.orchestra.run.smithi006.stdout: "paxos_service_trim_max": "500", 2023-08-01T19:54:20.537 INFO:teuthology.orchestra.run.smithi006.stdout: "paxos_service_trim_max_multiplier": "20", 2023-08-01T19:54:20.537 INFO:teuthology.orchestra.run.smithi006.stdout: "paxos_service_trim_min": "250", 2023-08-01T19:54:20.537 INFO:teuthology.orchestra.run.smithi006.stdout: "paxos_stash_full_interval": "25", 2023-08-01T19:54:20.538 INFO:teuthology.orchestra.run.smithi006.stdout: "paxos_trim_max": "500", 2023-08-01T19:54:20.538 INFO:teuthology.orchestra.run.smithi006.stdout: "paxos_trim_min": "250", 2023-08-01T19:54:20.538 INFO:teuthology.orchestra.run.smithi006.stdout: "perf": "true", 2023-08-01T19:54:20.538 INFO:teuthology.orchestra.run.smithi006.stdout: "pid_file": "/var/run/ceph/ceph-mon.a.pid", 2023-08-01T19:54:20.538 INFO:teuthology.orchestra.run.smithi006.stdout: "plugin_crypto_accelerator": "crypto_isal", 2023-08-01T19:54:20.538 INFO:teuthology.orchestra.run.smithi006.stdout: "plugin_dir": "/usr/lib64/ceph", 2023-08-01T19:54:20.538 INFO:teuthology.orchestra.run.smithi006.stdout: "public_addr": "-", 2023-08-01T19:54:20.539 INFO:teuthology.orchestra.run.smithi006.stdout: "public_addrv": "", 2023-08-01T19:54:20.539 INFO:teuthology.orchestra.run.smithi006.stdout: "public_bind_addr": "-", 2023-08-01T19:54:20.539 INFO:teuthology.orchestra.run.smithi006.stdout: "public_network": "", 2023-08-01T19:54:20.539 INFO:teuthology.orchestra.run.smithi006.stdout: "public_network_interface": "", 2023-08-01T19:54:20.539 INFO:teuthology.orchestra.run.smithi006.stdout: "qat_compressor_enabled": "false", 2023-08-01T19:54:20.539 INFO:teuthology.orchestra.run.smithi006.stdout: "rados_mon_op_timeout": "0", 2023-08-01T19:54:20.539 INFO:teuthology.orchestra.run.smithi006.stdout: "rados_osd_op_timeout": "0", 2023-08-01T19:54:20.539 INFO:teuthology.orchestra.run.smithi006.stdout: "rados_tracing": "false", 2023-08-01T19:54:20.540 INFO:teuthology.orchestra.run.smithi006.stdout: "rbd_atime_update_interval": "60", 2023-08-01T19:54:20.540 INFO:teuthology.orchestra.run.smithi006.stdout: "rbd_auto_exclusive_lock_until_manual_request": "true", 2023-08-01T19:54:20.540 INFO:teuthology.orchestra.run.smithi006.stdout: "rbd_balance_parent_reads": "false", 2023-08-01T19:54:20.540 INFO:teuthology.orchestra.run.smithi006.stdout: "rbd_balance_snap_reads": "false", 2023-08-01T19:54:20.540 INFO:teuthology.orchestra.run.smithi006.stdout: "rbd_blkin_trace_all": "false", 2023-08-01T19:54:20.540 INFO:teuthology.orchestra.run.smithi006.stdout: "rbd_blocklist_expire_seconds": "0", 2023-08-01T19:54:20.540 INFO:teuthology.orchestra.run.smithi006.stdout: "rbd_blocklist_on_break_lock": "true", 2023-08-01T19:54:20.540 INFO:teuthology.orchestra.run.smithi006.stdout: "rbd_cache": "true", 2023-08-01T19:54:20.541 INFO:teuthology.orchestra.run.smithi006.stdout: "rbd_cache_block_writes_upfront": "false", 2023-08-01T19:54:20.541 INFO:teuthology.orchestra.run.smithi006.stdout: "rbd_cache_max_dirty": "25165824", 2023-08-01T19:54:20.541 INFO:teuthology.orchestra.run.smithi006.stdout: "rbd_cache_max_dirty_age": "1.000000", 2023-08-01T19:54:20.541 INFO:teuthology.orchestra.run.smithi006.stdout: "rbd_cache_max_dirty_object": "0", 2023-08-01T19:54:20.541 INFO:teuthology.orchestra.run.smithi006.stdout: "rbd_cache_policy": "writearound", 2023-08-01T19:54:20.541 INFO:teuthology.orchestra.run.smithi006.stdout: "rbd_cache_size": "33554432", 2023-08-01T19:54:20.541 INFO:teuthology.orchestra.run.smithi006.stdout: "rbd_cache_target_dirty": "16777216", 2023-08-01T19:54:20.541 INFO:teuthology.orchestra.run.smithi006.stdout: "rbd_cache_writethrough_until_flush": "true", 2023-08-01T19:54:20.542 INFO:teuthology.orchestra.run.smithi006.stdout: "rbd_clone_copy_on_read": "false", 2023-08-01T19:54:20.542 INFO:teuthology.orchestra.run.smithi006.stdout: "rbd_compression_hint": "none", 2023-08-01T19:54:20.542 INFO:teuthology.orchestra.run.smithi006.stdout: "rbd_concurrent_management_ops": "10", 2023-08-01T19:54:20.542 INFO:teuthology.orchestra.run.smithi006.stdout: "rbd_config_pool_override_update_timestamp": "0", 2023-08-01T19:54:20.542 INFO:teuthology.orchestra.run.smithi006.stdout: "rbd_default_clone_format": "auto", 2023-08-01T19:54:20.542 INFO:teuthology.orchestra.run.smithi006.stdout: "rbd_default_data_pool": "", 2023-08-01T19:54:20.542 INFO:teuthology.orchestra.run.smithi006.stdout: "rbd_default_features": "61", 2023-08-01T19:54:20.542 INFO:teuthology.orchestra.run.smithi006.stdout: "rbd_default_format": "2", 2023-08-01T19:54:20.543 INFO:teuthology.orchestra.run.smithi006.stdout: "rbd_default_map_options": "", 2023-08-01T19:54:20.543 INFO:teuthology.orchestra.run.smithi006.stdout: "rbd_default_order": "22", 2023-08-01T19:54:20.543 INFO:teuthology.orchestra.run.smithi006.stdout: "rbd_default_pool": "rbd", 2023-08-01T19:54:20.543 INFO:teuthology.orchestra.run.smithi006.stdout: "rbd_default_snapshot_quiesce_mode": "required", 2023-08-01T19:54:20.543 INFO:teuthology.orchestra.run.smithi006.stdout: "rbd_default_stripe_count": "0", 2023-08-01T19:54:20.543 INFO:teuthology.orchestra.run.smithi006.stdout: "rbd_default_stripe_unit": "0", 2023-08-01T19:54:20.543 INFO:teuthology.orchestra.run.smithi006.stdout: "rbd_disable_zero_copy_writes": "true", 2023-08-01T19:54:20.543 INFO:teuthology.orchestra.run.smithi006.stdout: "rbd_discard_granularity_bytes": "65536", 2023-08-01T19:54:20.544 INFO:teuthology.orchestra.run.smithi006.stdout: "rbd_discard_on_zeroed_write_same": "true", 2023-08-01T19:54:20.544 INFO:teuthology.orchestra.run.smithi006.stdout: "rbd_enable_alloc_hint": "true", 2023-08-01T19:54:20.544 INFO:teuthology.orchestra.run.smithi006.stdout: "rbd_invalidate_object_map_on_timeout": "true", 2023-08-01T19:54:20.544 INFO:teuthology.orchestra.run.smithi006.stdout: "rbd_io_scheduler": "simple", 2023-08-01T19:54:20.544 INFO:teuthology.orchestra.run.smithi006.stdout: "rbd_io_scheduler_simple_max_delay": "0", 2023-08-01T19:54:20.544 INFO:teuthology.orchestra.run.smithi006.stdout: "rbd_journal_commit_age": "5.000000", 2023-08-01T19:54:20.544 INFO:teuthology.orchestra.run.smithi006.stdout: "rbd_journal_max_concurrent_object_sets": "0", 2023-08-01T19:54:20.544 INFO:teuthology.orchestra.run.smithi006.stdout: "rbd_journal_max_payload_bytes": "16384", 2023-08-01T19:54:20.545 INFO:teuthology.orchestra.run.smithi006.stdout: "rbd_journal_object_flush_age": "0.000000", 2023-08-01T19:54:20.545 INFO:teuthology.orchestra.run.smithi006.stdout: "rbd_journal_object_flush_bytes": "1048576", 2023-08-01T19:54:20.545 INFO:teuthology.orchestra.run.smithi006.stdout: "rbd_journal_object_flush_interval": "0", 2023-08-01T19:54:20.545 INFO:teuthology.orchestra.run.smithi006.stdout: "rbd_journal_object_max_in_flight_appends": "0", 2023-08-01T19:54:20.545 INFO:teuthology.orchestra.run.smithi006.stdout: "rbd_journal_object_writethrough_until_flush": "true", 2023-08-01T19:54:20.545 INFO:teuthology.orchestra.run.smithi006.stdout: "rbd_journal_order": "24", 2023-08-01T19:54:20.545 INFO:teuthology.orchestra.run.smithi006.stdout: "rbd_journal_pool": "", 2023-08-01T19:54:20.545 INFO:teuthology.orchestra.run.smithi006.stdout: "rbd_journal_splay_width": "4", 2023-08-01T19:54:20.546 INFO:teuthology.orchestra.run.smithi006.stdout: "rbd_localize_parent_reads": "false", 2023-08-01T19:54:20.546 INFO:teuthology.orchestra.run.smithi006.stdout: "rbd_localize_snap_reads": "false", 2023-08-01T19:54:20.546 INFO:teuthology.orchestra.run.smithi006.stdout: "rbd_mirror_concurrent_image_deletions": "1", 2023-08-01T19:54:20.546 INFO:teuthology.orchestra.run.smithi006.stdout: "rbd_mirror_concurrent_image_syncs": "5", 2023-08-01T19:54:20.546 INFO:teuthology.orchestra.run.smithi006.stdout: "rbd_mirror_delete_retry_interval": "30.000000", 2023-08-01T19:54:20.546 INFO:teuthology.orchestra.run.smithi006.stdout: "rbd_mirror_image_perf_stats_prio": "5", 2023-08-01T19:54:20.546 INFO:teuthology.orchestra.run.smithi006.stdout: "rbd_mirror_image_policy_migration_throttle": "300", 2023-08-01T19:54:20.546 INFO:teuthology.orchestra.run.smithi006.stdout: "rbd_mirror_image_policy_rebalance_timeout": "0.000000", 2023-08-01T19:54:20.547 INFO:teuthology.orchestra.run.smithi006.stdout: "rbd_mirror_image_policy_type": "simple", 2023-08-01T19:54:20.547 INFO:teuthology.orchestra.run.smithi006.stdout: "rbd_mirror_image_policy_update_throttle_interval": "1.000000", 2023-08-01T19:54:20.547 INFO:teuthology.orchestra.run.smithi006.stdout: "rbd_mirror_image_state_check_interval": "30", 2023-08-01T19:54:20.547 INFO:teuthology.orchestra.run.smithi006.stdout: "rbd_mirror_journal_commit_age": "5.000000", 2023-08-01T19:54:20.547 INFO:teuthology.orchestra.run.smithi006.stdout: "rbd_mirror_journal_poll_age": "5.000000", 2023-08-01T19:54:20.547 INFO:teuthology.orchestra.run.smithi006.stdout: "rbd_mirror_leader_heartbeat_interval": "5", 2023-08-01T19:54:20.547 INFO:teuthology.orchestra.run.smithi006.stdout: "rbd_mirror_leader_max_acquire_attempts_before_break": "3", 2023-08-01T19:54:20.548 INFO:teuthology.orchestra.run.smithi006.stdout: "rbd_mirror_leader_max_missed_heartbeats": "2", 2023-08-01T19:54:20.548 INFO:teuthology.orchestra.run.smithi006.stdout: "rbd_mirror_memory_autotune": "true", 2023-08-01T19:54:20.548 INFO:teuthology.orchestra.run.smithi006.stdout: "rbd_mirror_memory_base": "805306368", 2023-08-01T19:54:20.548 INFO:teuthology.orchestra.run.smithi006.stdout: "rbd_mirror_memory_cache_autotune_interval": "30.000000", 2023-08-01T19:54:20.548 INFO:teuthology.orchestra.run.smithi006.stdout: "rbd_mirror_memory_cache_min": "134217728", 2023-08-01T19:54:20.548 INFO:teuthology.orchestra.run.smithi006.stdout: "rbd_mirror_memory_cache_resize_interval": "5.000000", 2023-08-01T19:54:20.548 INFO:teuthology.orchestra.run.smithi006.stdout: "rbd_mirror_memory_expected_fragmentation": "0.150000", 2023-08-01T19:54:20.549 INFO:teuthology.orchestra.run.smithi006.stdout: "rbd_mirror_memory_target": "4294967296", 2023-08-01T19:54:20.549 INFO:teuthology.orchestra.run.smithi006.stdout: "rbd_mirror_perf_stats_prio": "5", 2023-08-01T19:54:20.549 INFO:teuthology.orchestra.run.smithi006.stdout: "rbd_mirror_pool_replayers_refresh_interval": "30", 2023-08-01T19:54:20.549 INFO:teuthology.orchestra.run.smithi006.stdout: "rbd_mirror_sync_point_update_age": "30.000000", 2023-08-01T19:54:20.549 INFO:teuthology.orchestra.run.smithi006.stdout: "rbd_mirroring_delete_delay": "0", 2023-08-01T19:54:20.549 INFO:teuthology.orchestra.run.smithi006.stdout: "rbd_mirroring_max_mirroring_snapshots": "5", 2023-08-01T19:54:20.549 INFO:teuthology.orchestra.run.smithi006.stdout: "rbd_mirroring_replay_delay": "0", 2023-08-01T19:54:20.549 INFO:teuthology.orchestra.run.smithi006.stdout: "rbd_mirroring_resync_after_disconnect": "false", 2023-08-01T19:54:20.550 INFO:teuthology.orchestra.run.smithi006.stdout: "rbd_move_parent_to_trash_on_remove": "false", 2023-08-01T19:54:20.550 INFO:teuthology.orchestra.run.smithi006.stdout: "rbd_move_to_trash_on_remove": "false", 2023-08-01T19:54:20.550 INFO:teuthology.orchestra.run.smithi006.stdout: "rbd_move_to_trash_on_remove_expire_seconds": "0", 2023-08-01T19:54:20.550 INFO:teuthology.orchestra.run.smithi006.stdout: "rbd_mtime_update_interval": "60", 2023-08-01T19:54:20.550 INFO:teuthology.orchestra.run.smithi006.stdout: "rbd_non_blocking_aio": "true", 2023-08-01T19:54:20.550 INFO:teuthology.orchestra.run.smithi006.stdout: "rbd_op_thread_timeout": "60", 2023-08-01T19:54:20.550 INFO:teuthology.orchestra.run.smithi006.stdout: "rbd_op_threads": "1", 2023-08-01T19:54:20.550 INFO:teuthology.orchestra.run.smithi006.stdout: "rbd_parent_cache_enabled": "false", 2023-08-01T19:54:20.551 INFO:teuthology.orchestra.run.smithi006.stdout: "rbd_persistent_cache_mode": "disabled", 2023-08-01T19:54:20.551 INFO:teuthology.orchestra.run.smithi006.stdout: "rbd_persistent_cache_path": "/tmp", 2023-08-01T19:54:20.551 INFO:teuthology.orchestra.run.smithi006.stdout: "rbd_persistent_cache_size": "1073741824", 2023-08-01T19:54:20.551 INFO:teuthology.orchestra.run.smithi006.stdout: "rbd_plugins": "", 2023-08-01T19:54:20.551 INFO:teuthology.orchestra.run.smithi006.stdout: "rbd_qos_bps_burst": "0", 2023-08-01T19:54:20.551 INFO:teuthology.orchestra.run.smithi006.stdout: "rbd_qos_bps_burst_seconds": "1", 2023-08-01T19:54:20.551 INFO:teuthology.orchestra.run.smithi006.stdout: "rbd_qos_bps_limit": "0", 2023-08-01T19:54:20.551 INFO:teuthology.orchestra.run.smithi006.stdout: "rbd_qos_exclude_ops": "0", 2023-08-01T19:54:20.552 INFO:teuthology.orchestra.run.smithi006.stdout: "rbd_qos_iops_burst": "0", 2023-08-01T19:54:20.552 INFO:teuthology.orchestra.run.smithi006.stdout: "rbd_qos_iops_burst_seconds": "1", 2023-08-01T19:54:20.552 INFO:teuthology.orchestra.run.smithi006.stdout: "rbd_qos_iops_limit": "0", 2023-08-01T19:54:20.552 INFO:teuthology.orchestra.run.smithi006.stdout: "rbd_qos_read_bps_burst": "0", 2023-08-01T19:54:20.552 INFO:teuthology.orchestra.run.smithi006.stdout: "rbd_qos_read_bps_burst_seconds": "1", 2023-08-01T19:54:20.552 INFO:teuthology.orchestra.run.smithi006.stdout: "rbd_qos_read_bps_limit": "0", 2023-08-01T19:54:20.552 INFO:teuthology.orchestra.run.smithi006.stdout: "rbd_qos_read_iops_burst": "0", 2023-08-01T19:54:20.553 INFO:teuthology.orchestra.run.smithi006.stdout: "rbd_qos_read_iops_burst_seconds": "1", 2023-08-01T19:54:20.553 INFO:teuthology.orchestra.run.smithi006.stdout: "rbd_qos_read_iops_limit": "0", 2023-08-01T19:54:20.553 INFO:teuthology.orchestra.run.smithi006.stdout: "rbd_qos_schedule_tick_min": "50", 2023-08-01T19:54:20.553 INFO:teuthology.orchestra.run.smithi006.stdout: "rbd_qos_write_bps_burst": "0", 2023-08-01T19:54:20.553 INFO:teuthology.orchestra.run.smithi006.stdout: "rbd_qos_write_bps_burst_seconds": "1", 2023-08-01T19:54:20.553 INFO:teuthology.orchestra.run.smithi006.stdout: "rbd_qos_write_bps_limit": "0", 2023-08-01T19:54:20.553 INFO:teuthology.orchestra.run.smithi006.stdout: "rbd_qos_write_iops_burst": "0", 2023-08-01T19:54:20.554 INFO:teuthology.orchestra.run.smithi006.stdout: "rbd_qos_write_iops_burst_seconds": "1", 2023-08-01T19:54:20.554 INFO:teuthology.orchestra.run.smithi006.stdout: "rbd_qos_write_iops_limit": "0", 2023-08-01T19:54:20.554 INFO:teuthology.orchestra.run.smithi006.stdout: "rbd_quiesce_notification_attempts": "10", 2023-08-01T19:54:20.554 INFO:teuthology.orchestra.run.smithi006.stdout: "rbd_read_from_replica_policy": "default", 2023-08-01T19:54:20.554 INFO:teuthology.orchestra.run.smithi006.stdout: "rbd_readahead_disable_after_bytes": "52428800", 2023-08-01T19:54:20.554 INFO:teuthology.orchestra.run.smithi006.stdout: "rbd_readahead_max_bytes": "524288", 2023-08-01T19:54:20.554 INFO:teuthology.orchestra.run.smithi006.stdout: "rbd_readahead_trigger_requests": "10", 2023-08-01T19:54:20.554 INFO:teuthology.orchestra.run.smithi006.stdout: "rbd_request_timed_out_seconds": "30", 2023-08-01T19:54:20.555 INFO:teuthology.orchestra.run.smithi006.stdout: "rbd_skip_partial_discard": "true", 2023-08-01T19:54:20.555 INFO:teuthology.orchestra.run.smithi006.stdout: "rbd_sparse_read_threshold_bytes": "65536", 2023-08-01T19:54:20.555 INFO:teuthology.orchestra.run.smithi006.stdout: "rbd_tracing": "false", 2023-08-01T19:54:20.555 INFO:teuthology.orchestra.run.smithi006.stdout: "rbd_validate_names": "true", 2023-08-01T19:54:20.555 INFO:teuthology.orchestra.run.smithi006.stdout: "rbd_validate_pool": "true", 2023-08-01T19:54:20.555 INFO:teuthology.orchestra.run.smithi006.stdout: "restapi_base_url": "", 2023-08-01T19:54:20.555 INFO:teuthology.orchestra.run.smithi006.stdout: "restapi_log_level": "", 2023-08-01T19:54:20.555 INFO:teuthology.orchestra.run.smithi006.stdout: "rgw_acl_grants_max_num": "100", 2023-08-01T19:54:20.556 INFO:teuthology.orchestra.run.smithi006.stdout: "rgw_admin_entry": "admin", 2023-08-01T19:54:20.556 INFO:teuthology.orchestra.run.smithi006.stdout: "rgw_backend_store": "rados", 2023-08-01T19:54:20.556 INFO:teuthology.orchestra.run.smithi006.stdout: "rgw_barbican_url": "", 2023-08-01T19:54:20.556 INFO:teuthology.orchestra.run.smithi006.stdout: "rgw_beast_enable_async": "true", 2023-08-01T19:54:20.556 INFO:teuthology.orchestra.run.smithi006.stdout: "rgw_bucket_default_quota_max_objects": "-1", 2023-08-01T19:54:20.556 INFO:teuthology.orchestra.run.smithi006.stdout: "rgw_bucket_default_quota_max_size": "-1", 2023-08-01T19:54:20.556 INFO:teuthology.orchestra.run.smithi006.stdout: "rgw_bucket_index_max_aio": "128", 2023-08-01T19:54:20.557 INFO:teuthology.orchestra.run.smithi006.stdout: "rgw_bucket_quota_cache_size": "10000", 2023-08-01T19:54:20.557 INFO:teuthology.orchestra.run.smithi006.stdout: "rgw_bucket_quota_ttl": "600", 2023-08-01T19:54:20.557 INFO:teuthology.orchestra.run.smithi006.stdout: "rgw_cache_enabled": "true", 2023-08-01T19:54:20.557 INFO:teuthology.orchestra.run.smithi006.stdout: "rgw_cache_expiry_interval": "900", 2023-08-01T19:54:20.557 INFO:teuthology.orchestra.run.smithi006.stdout: "rgw_cache_lru_size": "10000", 2023-08-01T19:54:20.557 INFO:teuthology.orchestra.run.smithi006.stdout: "rgw_content_length_compat": "false", 2023-08-01T19:54:20.557 INFO:teuthology.orchestra.run.smithi006.stdout: "rgw_copy_obj_progress": "true", 2023-08-01T19:54:20.558 INFO:teuthology.orchestra.run.smithi006.stdout: "rgw_copy_obj_progress_every_bytes": "1048576", 2023-08-01T19:54:20.558 INFO:teuthology.orchestra.run.smithi006.stdout: "rgw_cors_rules_max_num": "100", 2023-08-01T19:54:20.558 INFO:teuthology.orchestra.run.smithi006.stdout: "rgw_cross_domain_policy": "", 2023-08-01T19:54:20.558 INFO:teuthology.orchestra.run.smithi006.stdout: "rgw_crypt_default_encryption_key": "", 2023-08-01T19:54:20.558 INFO:teuthology.orchestra.run.smithi006.stdout: "rgw_crypt_kmip_addr": "", 2023-08-01T19:54:20.558 INFO:teuthology.orchestra.run.smithi006.stdout: "rgw_crypt_kmip_ca_path": "", 2023-08-01T19:54:20.558 INFO:teuthology.orchestra.run.smithi006.stdout: "rgw_crypt_kmip_client_cert": "", 2023-08-01T19:54:20.558 INFO:teuthology.orchestra.run.smithi006.stdout: "rgw_crypt_kmip_client_key": "", 2023-08-01T19:54:20.559 INFO:teuthology.orchestra.run.smithi006.stdout: "rgw_crypt_kmip_kms_key_template": "", 2023-08-01T19:54:20.559 INFO:teuthology.orchestra.run.smithi006.stdout: "rgw_crypt_kmip_password": "", 2023-08-01T19:54:20.559 INFO:teuthology.orchestra.run.smithi006.stdout: "rgw_crypt_kmip_s3_key_template": "$keyid", 2023-08-01T19:54:20.559 INFO:teuthology.orchestra.run.smithi006.stdout: "rgw_crypt_kmip_username": "", 2023-08-01T19:54:20.559 INFO:teuthology.orchestra.run.smithi006.stdout: "rgw_crypt_require_ssl": "true", 2023-08-01T19:54:20.559 INFO:teuthology.orchestra.run.smithi006.stdout: "rgw_crypt_s3_kms_backend": "barbican", 2023-08-01T19:54:20.559 INFO:teuthology.orchestra.run.smithi006.stdout: "rgw_crypt_s3_kms_encryption_keys": "", 2023-08-01T19:54:20.560 INFO:teuthology.orchestra.run.smithi006.stdout: "rgw_crypt_sse_s3_backend": "vault", 2023-08-01T19:54:20.560 INFO:teuthology.orchestra.run.smithi006.stdout: "rgw_crypt_sse_s3_key_template": "%bucket_id", 2023-08-01T19:54:20.560 INFO:teuthology.orchestra.run.smithi006.stdout: "rgw_crypt_sse_s3_vault_addr": "", 2023-08-01T19:54:20.560 INFO:teuthology.orchestra.run.smithi006.stdout: "rgw_crypt_sse_s3_vault_auth": "token", 2023-08-01T19:54:20.560 INFO:teuthology.orchestra.run.smithi006.stdout: "rgw_crypt_sse_s3_vault_namespace": "", 2023-08-01T19:54:20.560 INFO:teuthology.orchestra.run.smithi006.stdout: "rgw_crypt_sse_s3_vault_prefix": "", 2023-08-01T19:54:20.560 INFO:teuthology.orchestra.run.smithi006.stdout: "rgw_crypt_sse_s3_vault_secret_engine": "transit", 2023-08-01T19:54:20.560 INFO:teuthology.orchestra.run.smithi006.stdout: "rgw_crypt_sse_s3_vault_ssl_cacert": "", 2023-08-01T19:54:20.561 INFO:teuthology.orchestra.run.smithi006.stdout: "rgw_crypt_sse_s3_vault_ssl_clientcert": "", 2023-08-01T19:54:20.561 INFO:teuthology.orchestra.run.smithi006.stdout: "rgw_crypt_sse_s3_vault_ssl_clientkey": "", 2023-08-01T19:54:20.561 INFO:teuthology.orchestra.run.smithi006.stdout: "rgw_crypt_sse_s3_vault_token_file": "", 2023-08-01T19:54:20.561 INFO:teuthology.orchestra.run.smithi006.stdout: "rgw_crypt_sse_s3_vault_verify_ssl": "true", 2023-08-01T19:54:20.561 INFO:teuthology.orchestra.run.smithi006.stdout: "rgw_crypt_suppress_logs": "true", 2023-08-01T19:54:20.561 INFO:teuthology.orchestra.run.smithi006.stdout: "rgw_crypt_vault_addr": "", 2023-08-01T19:54:20.561 INFO:teuthology.orchestra.run.smithi006.stdout: "rgw_crypt_vault_auth": "token", 2023-08-01T19:54:20.561 INFO:teuthology.orchestra.run.smithi006.stdout: "rgw_crypt_vault_namespace": "", 2023-08-01T19:54:20.562 INFO:teuthology.orchestra.run.smithi006.stdout: "rgw_crypt_vault_prefix": "", 2023-08-01T19:54:20.562 INFO:teuthology.orchestra.run.smithi006.stdout: "rgw_crypt_vault_secret_engine": "transit", 2023-08-01T19:54:20.562 INFO:teuthology.orchestra.run.smithi006.stdout: "rgw_crypt_vault_ssl_cacert": "", 2023-08-01T19:54:20.562 INFO:teuthology.orchestra.run.smithi006.stdout: "rgw_crypt_vault_ssl_clientcert": "", 2023-08-01T19:54:20.562 INFO:teuthology.orchestra.run.smithi006.stdout: "rgw_crypt_vault_ssl_clientkey": "", 2023-08-01T19:54:20.562 INFO:teuthology.orchestra.run.smithi006.stdout: "rgw_crypt_vault_token_file": "", 2023-08-01T19:54:20.562 INFO:teuthology.orchestra.run.smithi006.stdout: "rgw_crypt_vault_verify_ssl": "true", 2023-08-01T19:54:20.563 INFO:teuthology.orchestra.run.smithi006.stdout: "rgw_curl_buffersize": "524288", 2023-08-01T19:54:20.563 INFO:teuthology.orchestra.run.smithi006.stdout: "rgw_curl_low_speed_limit": "1024", 2023-08-01T19:54:20.563 INFO:teuthology.orchestra.run.smithi006.stdout: "rgw_curl_low_speed_time": "300", 2023-08-01T19:54:20.563 INFO:teuthology.orchestra.run.smithi006.stdout: "rgw_curl_wait_timeout_ms": "1000", 2023-08-01T19:54:20.563 INFO:teuthology.orchestra.run.smithi006.stdout: "rgw_d3n_l1_datacache_persistent_path": "/tmp/rgw_datacache/", 2023-08-01T19:54:20.563 INFO:teuthology.orchestra.run.smithi006.stdout: "rgw_d3n_l1_datacache_size": "1073741824", 2023-08-01T19:54:20.563 INFO:teuthology.orchestra.run.smithi006.stdout: "rgw_d3n_l1_evict_cache_on_start": "true", 2023-08-01T19:54:20.563 INFO:teuthology.orchestra.run.smithi006.stdout: "rgw_d3n_l1_eviction_policy": "lru", 2023-08-01T19:54:20.564 INFO:teuthology.orchestra.run.smithi006.stdout: "rgw_d3n_l1_fadvise": "4", 2023-08-01T19:54:20.564 INFO:teuthology.orchestra.run.smithi006.stdout: "rgw_d3n_l1_local_datacache_enabled": "false", 2023-08-01T19:54:20.564 INFO:teuthology.orchestra.run.smithi006.stdout: "rgw_d3n_libaio_aio_num": "64", 2023-08-01T19:54:20.564 INFO:teuthology.orchestra.run.smithi006.stdout: "rgw_d3n_libaio_aio_threads": "20", 2023-08-01T19:54:20.564 INFO:teuthology.orchestra.run.smithi006.stdout: "rgw_data": "/var/lib/ceph/radosgw/ceph-a", 2023-08-01T19:54:20.564 INFO:teuthology.orchestra.run.smithi006.stdout: "rgw_data_log_changes_size": "1000", 2023-08-01T19:54:20.564 INFO:teuthology.orchestra.run.smithi006.stdout: "rgw_data_log_num_shards": "128", 2023-08-01T19:54:20.565 INFO:teuthology.orchestra.run.smithi006.stdout: "rgw_data_log_obj_prefix": "data_log", 2023-08-01T19:54:20.565 INFO:teuthology.orchestra.run.smithi006.stdout: "rgw_data_log_window": "30", 2023-08-01T19:54:20.565 INFO:teuthology.orchestra.run.smithi006.stdout: "rgw_data_notify_interval_msec": "200", 2023-08-01T19:54:20.565 INFO:teuthology.orchestra.run.smithi006.stdout: "rgw_default_data_log_backing": "fifo", 2023-08-01T19:54:20.565 INFO:teuthology.orchestra.run.smithi006.stdout: "rgw_default_realm_info_oid": "default.realm", 2023-08-01T19:54:20.565 INFO:teuthology.orchestra.run.smithi006.stdout: "rgw_default_region_info_oid": "default.region", 2023-08-01T19:54:20.565 INFO:teuthology.orchestra.run.smithi006.stdout: "rgw_default_zone_info_oid": "default.zone", 2023-08-01T19:54:20.565 INFO:teuthology.orchestra.run.smithi006.stdout: "rgw_default_zonegroup_info_oid": "default.zonegroup", 2023-08-01T19:54:20.566 INFO:teuthology.orchestra.run.smithi006.stdout: "rgw_defer_to_bucket_acls": "", 2023-08-01T19:54:20.566 INFO:teuthology.orchestra.run.smithi006.stdout: "rgw_delete_multi_obj_max_num": "1000", 2023-08-01T19:54:20.566 INFO:teuthology.orchestra.run.smithi006.stdout: "rgw_dmclock_admin_lim": "0.000000", 2023-08-01T19:54:20.566 INFO:teuthology.orchestra.run.smithi006.stdout: "rgw_dmclock_admin_res": "100.000000", 2023-08-01T19:54:20.566 INFO:teuthology.orchestra.run.smithi006.stdout: "rgw_dmclock_admin_wgt": "100.000000", 2023-08-01T19:54:20.566 INFO:teuthology.orchestra.run.smithi006.stdout: "rgw_dmclock_auth_lim": "0.000000", 2023-08-01T19:54:20.566 INFO:teuthology.orchestra.run.smithi006.stdout: "rgw_dmclock_auth_res": "200.000000", 2023-08-01T19:54:20.566 INFO:teuthology.orchestra.run.smithi006.stdout: "rgw_dmclock_auth_wgt": "100.000000", 2023-08-01T19:54:20.567 INFO:teuthology.orchestra.run.smithi006.stdout: "rgw_dmclock_data_lim": "0.000000", 2023-08-01T19:54:20.567 INFO:teuthology.orchestra.run.smithi006.stdout: "rgw_dmclock_data_res": "500.000000", 2023-08-01T19:54:20.567 INFO:teuthology.orchestra.run.smithi006.stdout: "rgw_dmclock_data_wgt": "500.000000", 2023-08-01T19:54:20.567 INFO:teuthology.orchestra.run.smithi006.stdout: "rgw_dmclock_metadata_lim": "0.000000", 2023-08-01T19:54:20.567 INFO:teuthology.orchestra.run.smithi006.stdout: "rgw_dmclock_metadata_res": "500.000000", 2023-08-01T19:54:20.567 INFO:teuthology.orchestra.run.smithi006.stdout: "rgw_dmclock_metadata_wgt": "500.000000", 2023-08-01T19:54:20.567 INFO:teuthology.orchestra.run.smithi006.stdout: "rgw_dns_name": "", 2023-08-01T19:54:20.567 INFO:teuthology.orchestra.run.smithi006.stdout: "rgw_dns_s3website_name": "", 2023-08-01T19:54:20.568 INFO:teuthology.orchestra.run.smithi006.stdout: "rgw_dynamic_resharding": "true", 2023-08-01T19:54:20.568 INFO:teuthology.orchestra.run.smithi006.stdout: "rgw_enable_apis": "s3, s3website, swift, swift_auth, admin, sts, iam, notifications", 2023-08-01T19:54:20.568 INFO:teuthology.orchestra.run.smithi006.stdout: "rgw_enable_gc_threads": "true", 2023-08-01T19:54:20.568 INFO:teuthology.orchestra.run.smithi006.stdout: "rgw_enable_lc_threads": "true", 2023-08-01T19:54:20.568 INFO:teuthology.orchestra.run.smithi006.stdout: "rgw_enable_ops_log": "false", 2023-08-01T19:54:20.568 INFO:teuthology.orchestra.run.smithi006.stdout: "rgw_enable_quota_threads": "true", 2023-08-01T19:54:20.568 INFO:teuthology.orchestra.run.smithi006.stdout: "rgw_enable_static_website": "false", 2023-08-01T19:54:20.568 INFO:teuthology.orchestra.run.smithi006.stdout: "rgw_enable_usage_log": "false", 2023-08-01T19:54:20.569 INFO:teuthology.orchestra.run.smithi006.stdout: "rgw_enforce_swift_acls": "true", 2023-08-01T19:54:20.569 INFO:teuthology.orchestra.run.smithi006.stdout: "rgw_exit_timeout_secs": "120", 2023-08-01T19:54:20.569 INFO:teuthology.orchestra.run.smithi006.stdout: "rgw_expose_bucket": "false", 2023-08-01T19:54:20.569 INFO:teuthology.orchestra.run.smithi006.stdout: "rgw_extended_http_attrs": "", 2023-08-01T19:54:20.569 INFO:teuthology.orchestra.run.smithi006.stdout: "rgw_frontend_defaults": "beast ssl_certificate=config://rgw/cert/$realm/$zone.crt ssl_private_key=config://rgw/cert/$realm/$zone.key", 2023-08-01T19:54:20.569 INFO:teuthology.orchestra.run.smithi006.stdout: "rgw_frontends": "beast port=7480", 2023-08-01T19:54:20.569 INFO:teuthology.orchestra.run.smithi006.stdout: "rgw_gc_max_concurrent_io": "10", 2023-08-01T19:54:20.570 INFO:teuthology.orchestra.run.smithi006.stdout: "rgw_gc_max_deferred": "50", 2023-08-01T19:54:20.570 INFO:teuthology.orchestra.run.smithi006.stdout: "rgw_gc_max_deferred_entries_size": "3072", 2023-08-01T19:54:20.570 INFO:teuthology.orchestra.run.smithi006.stdout: "rgw_gc_max_objs": "32", 2023-08-01T19:54:20.570 INFO:teuthology.orchestra.run.smithi006.stdout: "rgw_gc_max_queue_size": "134213632", 2023-08-01T19:54:20.570 INFO:teuthology.orchestra.run.smithi006.stdout: "rgw_gc_max_trim_chunk": "16", 2023-08-01T19:54:20.570 INFO:teuthology.orchestra.run.smithi006.stdout: "rgw_gc_obj_min_wait": "7200", 2023-08-01T19:54:20.570 INFO:teuthology.orchestra.run.smithi006.stdout: "rgw_gc_processor_max_time": "3600", 2023-08-01T19:54:20.570 INFO:teuthology.orchestra.run.smithi006.stdout: "rgw_gc_processor_period": "3600", 2023-08-01T19:54:20.571 INFO:teuthology.orchestra.run.smithi006.stdout: "rgw_get_obj_max_req_size": "4194304", 2023-08-01T19:54:20.571 INFO:teuthology.orchestra.run.smithi006.stdout: "rgw_get_obj_window_size": "16777216", 2023-08-01T19:54:20.571 INFO:teuthology.orchestra.run.smithi006.stdout: "rgw_healthcheck_disabling_path": "", 2023-08-01T19:54:20.571 INFO:teuthology.orchestra.run.smithi006.stdout: "rgw_ignore_get_invalid_range": "false", 2023-08-01T19:54:20.571 INFO:teuthology.orchestra.run.smithi006.stdout: "rgw_init_timeout": "300", 2023-08-01T19:54:20.571 INFO:teuthology.orchestra.run.smithi006.stdout: "rgw_inject_notify_timeout_probability": "0.000000", 2023-08-01T19:54:20.571 INFO:teuthology.orchestra.run.smithi006.stdout: "rgw_keystone_accepted_admin_roles": "", 2023-08-01T19:54:20.571 INFO:teuthology.orchestra.run.smithi006.stdout: "rgw_keystone_accepted_roles": "Member, admin", 2023-08-01T19:54:20.572 INFO:teuthology.orchestra.run.smithi006.stdout: "rgw_keystone_admin_domain": "", 2023-08-01T19:54:20.572 INFO:teuthology.orchestra.run.smithi006.stdout: "rgw_keystone_admin_password": "", 2023-08-01T19:54:20.572 INFO:teuthology.orchestra.run.smithi006.stdout: "rgw_keystone_admin_password_path": "", 2023-08-01T19:54:20.572 INFO:teuthology.orchestra.run.smithi006.stdout: "rgw_keystone_admin_project": "", 2023-08-01T19:54:20.572 INFO:teuthology.orchestra.run.smithi006.stdout: "rgw_keystone_admin_tenant": "", 2023-08-01T19:54:20.572 INFO:teuthology.orchestra.run.smithi006.stdout: "rgw_keystone_admin_token": "", 2023-08-01T19:54:20.572 INFO:teuthology.orchestra.run.smithi006.stdout: "rgw_keystone_admin_token_path": "", 2023-08-01T19:54:20.572 INFO:teuthology.orchestra.run.smithi006.stdout: "rgw_keystone_admin_user": "", 2023-08-01T19:54:20.573 INFO:teuthology.orchestra.run.smithi006.stdout: "rgw_keystone_api_version": "2", 2023-08-01T19:54:20.573 INFO:teuthology.orchestra.run.smithi006.stdout: "rgw_keystone_barbican_domain": "", 2023-08-01T19:54:20.573 INFO:teuthology.orchestra.run.smithi006.stdout: "rgw_keystone_barbican_password": "", 2023-08-01T19:54:20.573 INFO:teuthology.orchestra.run.smithi006.stdout: "rgw_keystone_barbican_project": "", 2023-08-01T19:54:20.573 INFO:teuthology.orchestra.run.smithi006.stdout: "rgw_keystone_barbican_tenant": "", 2023-08-01T19:54:20.573 INFO:teuthology.orchestra.run.smithi006.stdout: "rgw_keystone_barbican_user": "", 2023-08-01T19:54:20.573 INFO:teuthology.orchestra.run.smithi006.stdout: "rgw_keystone_implicit_tenants": "false", 2023-08-01T19:54:20.573 INFO:teuthology.orchestra.run.smithi006.stdout: "rgw_keystone_token_cache_size": "10000", 2023-08-01T19:54:20.574 INFO:teuthology.orchestra.run.smithi006.stdout: "rgw_keystone_url": "", 2023-08-01T19:54:20.574 INFO:teuthology.orchestra.run.smithi006.stdout: "rgw_keystone_verify_ssl": "true", 2023-08-01T19:54:20.574 INFO:teuthology.orchestra.run.smithi006.stdout: "rgw_lc_debug_interval": "-1", 2023-08-01T19:54:20.574 INFO:teuthology.orchestra.run.smithi006.stdout: "rgw_lc_lock_max_time": "90", 2023-08-01T19:54:20.574 INFO:teuthology.orchestra.run.smithi006.stdout: "rgw_lc_max_objs": "32", 2023-08-01T19:54:20.574 INFO:teuthology.orchestra.run.smithi006.stdout: "rgw_lc_max_rules": "1000", 2023-08-01T19:54:20.574 INFO:teuthology.orchestra.run.smithi006.stdout: "rgw_lc_max_worker": "3", 2023-08-01T19:54:20.574 INFO:teuthology.orchestra.run.smithi006.stdout: "rgw_lc_max_wp_worker": "3", 2023-08-01T19:54:20.575 INFO:teuthology.orchestra.run.smithi006.stdout: "rgw_lc_thread_delay": "0", 2023-08-01T19:54:20.575 INFO:teuthology.orchestra.run.smithi006.stdout: "rgw_ldap_binddn": "uid=admin,cn=users,dc=example,dc=com", 2023-08-01T19:54:20.575 INFO:teuthology.orchestra.run.smithi006.stdout: "rgw_ldap_dnattr": "uid", 2023-08-01T19:54:20.575 INFO:teuthology.orchestra.run.smithi006.stdout: "rgw_ldap_searchdn": "cn=users,cn=accounts,dc=example,dc=com", 2023-08-01T19:54:20.575 INFO:teuthology.orchestra.run.smithi006.stdout: "rgw_ldap_searchfilter": "", 2023-08-01T19:54:20.575 INFO:teuthology.orchestra.run.smithi006.stdout: "rgw_ldap_secret": "/etc/openldap/secret", 2023-08-01T19:54:20.575 INFO:teuthology.orchestra.run.smithi006.stdout: "rgw_ldap_uri": "ldaps://", 2023-08-01T19:54:20.575 INFO:teuthology.orchestra.run.smithi006.stdout: "rgw_lifecycle_work_time": "00:00-06:00", 2023-08-01T19:54:20.576 INFO:teuthology.orchestra.run.smithi006.stdout: "rgw_list_bucket_min_readahead": "1000", 2023-08-01T19:54:20.576 INFO:teuthology.orchestra.run.smithi006.stdout: "rgw_list_buckets_max_chunk": "1000", 2023-08-01T19:54:20.576 INFO:teuthology.orchestra.run.smithi006.stdout: "rgw_log_http_headers": "", 2023-08-01T19:54:20.576 INFO:teuthology.orchestra.run.smithi006.stdout: "rgw_log_nonexistent_bucket": "false", 2023-08-01T19:54:20.576 INFO:teuthology.orchestra.run.smithi006.stdout: "rgw_log_object_name": "%Y-%m-%d-%H-%i-%n", 2023-08-01T19:54:20.576 INFO:teuthology.orchestra.run.smithi006.stdout: "rgw_log_object_name_utc": "false", 2023-08-01T19:54:20.576 INFO:teuthology.orchestra.run.smithi006.stdout: "rgw_luarocks_location": "/tmp/luarocks", 2023-08-01T19:54:20.576 INFO:teuthology.orchestra.run.smithi006.stdout: "rgw_max_attr_name_len": "0", 2023-08-01T19:54:20.577 INFO:teuthology.orchestra.run.smithi006.stdout: "rgw_max_attr_size": "0", 2023-08-01T19:54:20.577 INFO:teuthology.orchestra.run.smithi006.stdout: "rgw_max_attrs_num_in_req": "0", 2023-08-01T19:54:20.577 INFO:teuthology.orchestra.run.smithi006.stdout: "rgw_max_chunk_size": "4194304", 2023-08-01T19:54:20.577 INFO:teuthology.orchestra.run.smithi006.stdout: "rgw_max_concurrent_requests": "1024", 2023-08-01T19:54:20.577 INFO:teuthology.orchestra.run.smithi006.stdout: "rgw_max_dynamic_shards": "1999", 2023-08-01T19:54:20.577 INFO:teuthology.orchestra.run.smithi006.stdout: "rgw_max_listing_results": "1000", 2023-08-01T19:54:20.577 INFO:teuthology.orchestra.run.smithi006.stdout: "rgw_max_notify_retries": "3", 2023-08-01T19:54:20.577 INFO:teuthology.orchestra.run.smithi006.stdout: "rgw_max_objs_per_shard": "100000", 2023-08-01T19:54:20.578 INFO:teuthology.orchestra.run.smithi006.stdout: "rgw_max_put_param_size": "1048576", 2023-08-01T19:54:20.578 INFO:teuthology.orchestra.run.smithi006.stdout: "rgw_max_put_size": "5368709120", 2023-08-01T19:54:20.578 INFO:teuthology.orchestra.run.smithi006.stdout: "rgw_max_slo_entries": "1000", 2023-08-01T19:54:20.578 INFO:teuthology.orchestra.run.smithi006.stdout: "rgw_md_log_max_shards": "64", 2023-08-01T19:54:20.578 INFO:teuthology.orchestra.run.smithi006.stdout: "rgw_md_notify_interval_msec": "200", 2023-08-01T19:54:20.578 INFO:teuthology.orchestra.run.smithi006.stdout: "rgw_mime_types_file": "/etc/mime.types", 2023-08-01T19:54:20.578 INFO:teuthology.orchestra.run.smithi006.stdout: "rgw_mp_lock_max_time": "600", 2023-08-01T19:54:20.578 INFO:teuthology.orchestra.run.smithi006.stdout: "rgw_multi_obj_del_max_aio": "16", 2023-08-01T19:54:20.579 INFO:teuthology.orchestra.run.smithi006.stdout: "rgw_multipart_min_part_size": "5242880", 2023-08-01T19:54:20.579 INFO:teuthology.orchestra.run.smithi006.stdout: "rgw_multipart_part_upload_limit": "10000", 2023-08-01T19:54:20.579 INFO:teuthology.orchestra.run.smithi006.stdout: "rgw_nfs_fhcache_partitions": "3", 2023-08-01T19:54:20.579 INFO:teuthology.orchestra.run.smithi006.stdout: "rgw_nfs_fhcache_size": "2017", 2023-08-01T19:54:20.579 INFO:teuthology.orchestra.run.smithi006.stdout: "rgw_nfs_lru_lane_hiwat": "911", 2023-08-01T19:54:20.579 INFO:teuthology.orchestra.run.smithi006.stdout: "rgw_nfs_lru_lanes": "5", 2023-08-01T19:54:20.579 INFO:teuthology.orchestra.run.smithi006.stdout: "rgw_nfs_max_gc": "300", 2023-08-01T19:54:20.579 INFO:teuthology.orchestra.run.smithi006.stdout: "rgw_nfs_namespace_expire_secs": "300", 2023-08-01T19:54:20.580 INFO:teuthology.orchestra.run.smithi006.stdout: "rgw_nfs_run_gc_threads": "false", 2023-08-01T19:54:20.580 INFO:teuthology.orchestra.run.smithi006.stdout: "rgw_nfs_run_lc_threads": "false", 2023-08-01T19:54:20.580 INFO:teuthology.orchestra.run.smithi006.stdout: "rgw_nfs_run_quota_threads": "false", 2023-08-01T19:54:20.580 INFO:teuthology.orchestra.run.smithi006.stdout: "rgw_nfs_run_sync_thread": "false", 2023-08-01T19:54:20.580 INFO:teuthology.orchestra.run.smithi006.stdout: "rgw_nfs_s3_fast_attrs": "false", 2023-08-01T19:54:20.580 INFO:teuthology.orchestra.run.smithi006.stdout: "rgw_nfs_write_completion_interval_s": "10", 2023-08-01T19:54:20.580 INFO:teuthology.orchestra.run.smithi006.stdout: "rgw_num_async_rados_threads": "32", 2023-08-01T19:54:20.580 INFO:teuthology.orchestra.run.smithi006.stdout: "rgw_num_control_oids": "8", 2023-08-01T19:54:20.581 INFO:teuthology.orchestra.run.smithi006.stdout: "rgw_numa_node": "-1", 2023-08-01T19:54:20.581 INFO:teuthology.orchestra.run.smithi006.stdout: "rgw_obj_stripe_size": "4194304", 2023-08-01T19:54:20.581 INFO:teuthology.orchestra.run.smithi006.stdout: "rgw_obj_tombstone_cache_size": "1000", 2023-08-01T19:54:20.581 INFO:teuthology.orchestra.run.smithi006.stdout: "rgw_objexp_chunk_size": "100", 2023-08-01T19:54:20.581 INFO:teuthology.orchestra.run.smithi006.stdout: "rgw_objexp_gc_interval": "600", 2023-08-01T19:54:20.581 INFO:teuthology.orchestra.run.smithi006.stdout: "rgw_objexp_hints_num_shards": "127", 2023-08-01T19:54:20.581 INFO:teuthology.orchestra.run.smithi006.stdout: "rgw_olh_pending_timeout_sec": "3600", 2023-08-01T19:54:20.581 INFO:teuthology.orchestra.run.smithi006.stdout: "rgw_op_thread_suicide_timeout": "0", 2023-08-01T19:54:20.582 INFO:teuthology.orchestra.run.smithi006.stdout: "rgw_op_thread_timeout": "600", 2023-08-01T19:54:20.582 INFO:teuthology.orchestra.run.smithi006.stdout: "rgw_op_tracing": "false", 2023-08-01T19:54:20.582 INFO:teuthology.orchestra.run.smithi006.stdout: "rgw_opa_token": "", 2023-08-01T19:54:20.582 INFO:teuthology.orchestra.run.smithi006.stdout: "rgw_opa_url": "", 2023-08-01T19:54:20.582 INFO:teuthology.orchestra.run.smithi006.stdout: "rgw_opa_verify_ssl": "true", 2023-08-01T19:54:20.582 INFO:teuthology.orchestra.run.smithi006.stdout: "rgw_ops_log_data_backlog": "5242880", 2023-08-01T19:54:20.582 INFO:teuthology.orchestra.run.smithi006.stdout: "rgw_ops_log_file_path": "", 2023-08-01T19:54:20.583 INFO:teuthology.orchestra.run.smithi006.stdout: "rgw_ops_log_rados": "true", 2023-08-01T19:54:20.583 INFO:teuthology.orchestra.run.smithi006.stdout: "rgw_ops_log_socket_path": "", 2023-08-01T19:54:20.583 INFO:teuthology.orchestra.run.smithi006.stdout: "rgw_override_bucket_index_max_shards": "0", 2023-08-01T19:54:20.583 INFO:teuthology.orchestra.run.smithi006.stdout: "rgw_period_latest_epoch_info_oid": ".latest_epoch", 2023-08-01T19:54:20.583 INFO:teuthology.orchestra.run.smithi006.stdout: "rgw_period_push_interval": "2.000000", 2023-08-01T19:54:20.583 INFO:teuthology.orchestra.run.smithi006.stdout: "rgw_period_push_interval_max": "30.000000", 2023-08-01T19:54:20.583 INFO:teuthology.orchestra.run.smithi006.stdout: "rgw_period_root_pool": ".rgw.root", 2023-08-01T19:54:20.583 INFO:teuthology.orchestra.run.smithi006.stdout: "rgw_print_continue": "true", 2023-08-01T19:54:20.584 INFO:teuthology.orchestra.run.smithi006.stdout: "rgw_print_prohibited_content_length": "false", 2023-08-01T19:54:20.584 INFO:teuthology.orchestra.run.smithi006.stdout: "rgw_put_obj_max_window_size": "67108864", 2023-08-01T19:54:20.584 INFO:teuthology.orchestra.run.smithi006.stdout: "rgw_put_obj_min_window_size": "16777216", 2023-08-01T19:54:20.584 INFO:teuthology.orchestra.run.smithi006.stdout: "rgw_rados_pool_autoscale_bias": "4.000000", 2023-08-01T19:54:20.584 INFO:teuthology.orchestra.run.smithi006.stdout: "rgw_rados_pool_recovery_priority": "5", 2023-08-01T19:54:20.584 INFO:teuthology.orchestra.run.smithi006.stdout: "rgw_rados_tracing": "false", 2023-08-01T19:54:20.584 INFO:teuthology.orchestra.run.smithi006.stdout: "rgw_realm": "", 2023-08-01T19:54:20.584 INFO:teuthology.orchestra.run.smithi006.stdout: "rgw_realm_id": "", 2023-08-01T19:54:20.585 INFO:teuthology.orchestra.run.smithi006.stdout: "rgw_realm_root_pool": ".rgw.root", 2023-08-01T19:54:20.585 INFO:teuthology.orchestra.run.smithi006.stdout: "rgw_region": "", 2023-08-01T19:54:20.585 INFO:teuthology.orchestra.run.smithi006.stdout: "rgw_region_root_pool": ".rgw.root", 2023-08-01T19:54:20.585 INFO:teuthology.orchestra.run.smithi006.stdout: "rgw_relaxed_region_enforcement": "false", 2023-08-01T19:54:20.585 INFO:teuthology.orchestra.run.smithi006.stdout: "rgw_relaxed_s3_bucket_names": "false", 2023-08-01T19:54:20.585 INFO:teuthology.orchestra.run.smithi006.stdout: "rgw_remote_addr_param": "REMOTE_ADDR", 2023-08-01T19:54:20.585 INFO:teuthology.orchestra.run.smithi006.stdout: "rgw_request_uri": "", 2023-08-01T19:54:20.586 INFO:teuthology.orchestra.run.smithi006.stdout: "rgw_reshard_batch_size": "64", 2023-08-01T19:54:20.586 INFO:teuthology.orchestra.run.smithi006.stdout: "rgw_reshard_bucket_lock_duration": "360", 2023-08-01T19:54:20.586 INFO:teuthology.orchestra.run.smithi006.stdout: "rgw_reshard_max_aio": "128", 2023-08-01T19:54:20.586 INFO:teuthology.orchestra.run.smithi006.stdout: "rgw_reshard_num_logs": "16", 2023-08-01T19:54:20.586 INFO:teuthology.orchestra.run.smithi006.stdout: "rgw_reshard_thread_interval": "600", 2023-08-01T19:54:20.586 INFO:teuthology.orchestra.run.smithi006.stdout: "rgw_resolve_cname": "false", 2023-08-01T19:54:20.586 INFO:teuthology.orchestra.run.smithi006.stdout: "rgw_rest_getusage_op_compat": "false", 2023-08-01T19:54:20.586 INFO:teuthology.orchestra.run.smithi006.stdout: "rgw_run_sync_thread": "true", 2023-08-01T19:54:20.587 INFO:teuthology.orchestra.run.smithi006.stdout: "rgw_s3_auth_order": "sts, external, local", 2023-08-01T19:54:20.587 INFO:teuthology.orchestra.run.smithi006.stdout: "rgw_s3_auth_use_keystone": "false", 2023-08-01T19:54:20.587 INFO:teuthology.orchestra.run.smithi006.stdout: "rgw_s3_auth_use_ldap": "false", 2023-08-01T19:54:20.587 INFO:teuthology.orchestra.run.smithi006.stdout: "rgw_s3_auth_use_rados": "true", 2023-08-01T19:54:20.587 INFO:teuthology.orchestra.run.smithi006.stdout: "rgw_s3_auth_use_sts": "false", 2023-08-01T19:54:20.587 INFO:teuthology.orchestra.run.smithi006.stdout: "rgw_s3_client_max_sig_ver": "-1", 2023-08-01T19:54:20.587 INFO:teuthology.orchestra.run.smithi006.stdout: "rgw_s3_success_create_obj_status": "0", 2023-08-01T19:54:20.587 INFO:teuthology.orchestra.run.smithi006.stdout: "rgw_safe_max_objects_per_shard": "102400", 2023-08-01T19:54:20.588 INFO:teuthology.orchestra.run.smithi006.stdout: "rgw_scheduler_type": "throttler", 2023-08-01T19:54:20.588 INFO:teuthology.orchestra.run.smithi006.stdout: "rgw_script_uri": "", 2023-08-01T19:54:20.588 INFO:teuthology.orchestra.run.smithi006.stdout: "rgw_service_provider_name": "", 2023-08-01T19:54:20.588 INFO:teuthology.orchestra.run.smithi006.stdout: "rgw_shard_warning_threshold": "90.000000", 2023-08-01T19:54:20.588 INFO:teuthology.orchestra.run.smithi006.stdout: "rgw_sts_client_id": "", 2023-08-01T19:54:20.588 INFO:teuthology.orchestra.run.smithi006.stdout: "rgw_sts_client_secret": "", 2023-08-01T19:54:20.588 INFO:teuthology.orchestra.run.smithi006.stdout: "rgw_sts_entry": "sts", 2023-08-01T19:54:20.588 INFO:teuthology.orchestra.run.smithi006.stdout: "rgw_sts_key": "sts", 2023-08-01T19:54:20.589 INFO:teuthology.orchestra.run.smithi006.stdout: "rgw_sts_max_session_duration": "43200", 2023-08-01T19:54:20.589 INFO:teuthology.orchestra.run.smithi006.stdout: "rgw_sts_min_session_duration": "900", 2023-08-01T19:54:20.589 INFO:teuthology.orchestra.run.smithi006.stdout: "rgw_sts_token_introspection_url": "", 2023-08-01T19:54:20.589 INFO:teuthology.orchestra.run.smithi006.stdout: "rgw_swift_account_in_url": "false", 2023-08-01T19:54:20.589 INFO:teuthology.orchestra.run.smithi006.stdout: "rgw_swift_auth_entry": "auth", 2023-08-01T19:54:20.589 INFO:teuthology.orchestra.run.smithi006.stdout: "rgw_swift_auth_url": "", 2023-08-01T19:54:20.589 INFO:teuthology.orchestra.run.smithi006.stdout: "rgw_swift_custom_header": "", 2023-08-01T19:54:20.590 INFO:teuthology.orchestra.run.smithi006.stdout: "rgw_swift_enforce_content_length": "false", 2023-08-01T19:54:20.590 INFO:teuthology.orchestra.run.smithi006.stdout: "rgw_swift_need_stats": "true", 2023-08-01T19:54:20.590 INFO:teuthology.orchestra.run.smithi006.stdout: "rgw_swift_tenant_name": "", 2023-08-01T19:54:20.590 INFO:teuthology.orchestra.run.smithi006.stdout: "rgw_swift_token_expiration": "86400", 2023-08-01T19:54:20.590 INFO:teuthology.orchestra.run.smithi006.stdout: "rgw_swift_url": "", 2023-08-01T19:54:20.590 INFO:teuthology.orchestra.run.smithi006.stdout: "rgw_swift_url_prefix": "swift", 2023-08-01T19:54:20.590 INFO:teuthology.orchestra.run.smithi006.stdout: "rgw_swift_versioning_enabled": "false", 2023-08-01T19:54:20.590 INFO:teuthology.orchestra.run.smithi006.stdout: "rgw_sync_data_inject_err_probability": "0.000000", 2023-08-01T19:54:20.591 INFO:teuthology.orchestra.run.smithi006.stdout: "rgw_sync_lease_period": "120", 2023-08-01T19:54:20.591 INFO:teuthology.orchestra.run.smithi006.stdout: "rgw_sync_log_trim_concurrent_buckets": "4", 2023-08-01T19:54:20.591 INFO:teuthology.orchestra.run.smithi006.stdout: "rgw_sync_log_trim_interval": "1200", 2023-08-01T19:54:20.591 INFO:teuthology.orchestra.run.smithi006.stdout: "rgw_sync_log_trim_max_buckets": "16", 2023-08-01T19:54:20.591 INFO:teuthology.orchestra.run.smithi006.stdout: "rgw_sync_log_trim_min_cold_buckets": "4", 2023-08-01T19:54:20.591 INFO:teuthology.orchestra.run.smithi006.stdout: "rgw_sync_meta_inject_err_probability": "0.000000", 2023-08-01T19:54:20.591 INFO:teuthology.orchestra.run.smithi006.stdout: "rgw_sync_obj_etag_verify": "false", 2023-08-01T19:54:20.591 INFO:teuthology.orchestra.run.smithi006.stdout: "rgw_sync_trace_history_size": "4096", 2023-08-01T19:54:20.592 INFO:teuthology.orchestra.run.smithi006.stdout: "rgw_sync_trace_per_node_log_size": "32", 2023-08-01T19:54:20.592 INFO:teuthology.orchestra.run.smithi006.stdout: "rgw_sync_trace_servicemap_update_interval": "10", 2023-08-01T19:54:20.592 INFO:teuthology.orchestra.run.smithi006.stdout: "rgw_thread_pool_size": "512", 2023-08-01T19:54:20.592 INFO:teuthology.orchestra.run.smithi006.stdout: "rgw_torrent_comment": "", 2023-08-01T19:54:20.592 INFO:teuthology.orchestra.run.smithi006.stdout: "rgw_torrent_createby": "", 2023-08-01T19:54:20.592 INFO:teuthology.orchestra.run.smithi006.stdout: "rgw_torrent_encoding": "", 2023-08-01T19:54:20.592 INFO:teuthology.orchestra.run.smithi006.stdout: "rgw_torrent_flag": "false", 2023-08-01T19:54:20.593 INFO:teuthology.orchestra.run.smithi006.stdout: "rgw_torrent_origin": "", 2023-08-01T19:54:20.593 INFO:teuthology.orchestra.run.smithi006.stdout: "rgw_torrent_sha_unit": "524288", 2023-08-01T19:54:20.593 INFO:teuthology.orchestra.run.smithi006.stdout: "rgw_torrent_tracker": "", 2023-08-01T19:54:20.593 INFO:teuthology.orchestra.run.smithi006.stdout: "rgw_trust_forwarded_https": "false", 2023-08-01T19:54:20.593 INFO:teuthology.orchestra.run.smithi006.stdout: "rgw_usage_log_flush_threshold": "1024", 2023-08-01T19:54:20.593 INFO:teuthology.orchestra.run.smithi006.stdout: "rgw_usage_log_tick_interval": "30", 2023-08-01T19:54:20.593 INFO:teuthology.orchestra.run.smithi006.stdout: "rgw_usage_max_shards": "32", 2023-08-01T19:54:20.593 INFO:teuthology.orchestra.run.smithi006.stdout: "rgw_usage_max_user_shards": "1", 2023-08-01T19:54:20.594 INFO:teuthology.orchestra.run.smithi006.stdout: "rgw_use_opa_authz": "false", 2023-08-01T19:54:20.594 INFO:teuthology.orchestra.run.smithi006.stdout: "rgw_user_default_quota_max_objects": "-1", 2023-08-01T19:54:20.594 INFO:teuthology.orchestra.run.smithi006.stdout: "rgw_user_default_quota_max_size": "-1", 2023-08-01T19:54:20.594 INFO:teuthology.orchestra.run.smithi006.stdout: "rgw_user_max_buckets": "1000", 2023-08-01T19:54:20.594 INFO:teuthology.orchestra.run.smithi006.stdout: "rgw_user_quota_bucket_sync_interval": "180", 2023-08-01T19:54:20.594 INFO:teuthology.orchestra.run.smithi006.stdout: "rgw_user_quota_sync_idle_users": "false", 2023-08-01T19:54:20.594 INFO:teuthology.orchestra.run.smithi006.stdout: "rgw_user_quota_sync_interval": "86400", 2023-08-01T19:54:20.594 INFO:teuthology.orchestra.run.smithi006.stdout: "rgw_user_quota_sync_wait_time": "86400", 2023-08-01T19:54:20.595 INFO:teuthology.orchestra.run.smithi006.stdout: "rgw_user_unique_email": "true", 2023-08-01T19:54:20.595 INFO:teuthology.orchestra.run.smithi006.stdout: "rgw_verify_ssl": "true", 2023-08-01T19:54:20.595 INFO:teuthology.orchestra.run.smithi006.stdout: "rgw_website_routing_rules_max_num": "50", 2023-08-01T19:54:20.595 INFO:teuthology.orchestra.run.smithi006.stdout: "rgw_zone": "", 2023-08-01T19:54:20.595 INFO:teuthology.orchestra.run.smithi006.stdout: "rgw_zone_id": "", 2023-08-01T19:54:20.595 INFO:teuthology.orchestra.run.smithi006.stdout: "rgw_zone_root_pool": ".rgw.root", 2023-08-01T19:54:20.595 INFO:teuthology.orchestra.run.smithi006.stdout: "rgw_zonegroup": "", 2023-08-01T19:54:20.595 INFO:teuthology.orchestra.run.smithi006.stdout: "rgw_zonegroup_id": "", 2023-08-01T19:54:20.596 INFO:teuthology.orchestra.run.smithi006.stdout: "rgw_zonegroup_root_pool": ".rgw.root", 2023-08-01T19:54:20.596 INFO:teuthology.orchestra.run.smithi006.stdout: "rocksdb_block_size": "4096", 2023-08-01T19:54:20.596 INFO:teuthology.orchestra.run.smithi006.stdout: "rocksdb_bloom_bits_per_key": "20", 2023-08-01T19:54:20.596 INFO:teuthology.orchestra.run.smithi006.stdout: "rocksdb_cache_index_and_filter_blocks": "true", 2023-08-01T19:54:20.596 INFO:teuthology.orchestra.run.smithi006.stdout: "rocksdb_cache_index_and_filter_blocks_with_high_priority": "false", 2023-08-01T19:54:20.596 INFO:teuthology.orchestra.run.smithi006.stdout: "rocksdb_cache_row_ratio": "0.000000", 2023-08-01T19:54:20.596 INFO:teuthology.orchestra.run.smithi006.stdout: "rocksdb_cache_shard_bits": "4", 2023-08-01T19:54:20.596 INFO:teuthology.orchestra.run.smithi006.stdout: "rocksdb_cache_size": "536870912", 2023-08-01T19:54:20.597 INFO:teuthology.orchestra.run.smithi006.stdout: "rocksdb_cache_type": "binned_lru", 2023-08-01T19:54:20.597 INFO:teuthology.orchestra.run.smithi006.stdout: "rocksdb_cf_compact_on_deletion": "true", 2023-08-01T19:54:20.597 INFO:teuthology.orchestra.run.smithi006.stdout: "rocksdb_cf_compact_on_deletion_sliding_window": "32768", 2023-08-01T19:54:20.597 INFO:teuthology.orchestra.run.smithi006.stdout: "rocksdb_cf_compact_on_deletion_trigger": "16384", 2023-08-01T19:54:20.597 INFO:teuthology.orchestra.run.smithi006.stdout: "rocksdb_collect_compaction_stats": "false", 2023-08-01T19:54:20.597 INFO:teuthology.orchestra.run.smithi006.stdout: "rocksdb_collect_extended_stats": "false", 2023-08-01T19:54:20.597 INFO:teuthology.orchestra.run.smithi006.stdout: "rocksdb_collect_memory_stats": "false", 2023-08-01T19:54:20.597 INFO:teuthology.orchestra.run.smithi006.stdout: "rocksdb_delete_range_threshold": "1048576", 2023-08-01T19:54:20.598 INFO:teuthology.orchestra.run.smithi006.stdout: "rocksdb_index_type": "binary_search", 2023-08-01T19:54:20.598 INFO:teuthology.orchestra.run.smithi006.stdout: "rocksdb_log_to_ceph_log": "true", 2023-08-01T19:54:20.598 INFO:teuthology.orchestra.run.smithi006.stdout: "rocksdb_metadata_block_size": "4096", 2023-08-01T19:54:20.598 INFO:teuthology.orchestra.run.smithi006.stdout: "rocksdb_partition_filters": "false", 2023-08-01T19:54:20.598 INFO:teuthology.orchestra.run.smithi006.stdout: "rocksdb_perf": "false", 2023-08-01T19:54:20.598 INFO:teuthology.orchestra.run.smithi006.stdout: "rocksdb_pin_l0_filter_and_index_blocks_in_cache": "false", 2023-08-01T19:54:20.598 INFO:teuthology.orchestra.run.smithi006.stdout: "rotating_keys_bootstrap_timeout": "30", 2023-08-01T19:54:20.598 INFO:teuthology.orchestra.run.smithi006.stdout: "rotating_keys_renewal_timeout": "10", 2023-08-01T19:54:20.599 INFO:teuthology.orchestra.run.smithi006.stdout: "run_dir": "/var/run/ceph", 2023-08-01T19:54:20.599 INFO:teuthology.orchestra.run.smithi006.stdout: "seastore_block_create": "true", 2023-08-01T19:54:20.599 INFO:teuthology.orchestra.run.smithi006.stdout: "seastore_cache_lru_size": "67108864", 2023-08-01T19:54:20.599 INFO:teuthology.orchestra.run.smithi006.stdout: "seastore_default_max_object_size": "16777216", 2023-08-01T19:54:20.599 INFO:teuthology.orchestra.run.smithi006.stdout: "seastore_default_object_metadata_reservation": "16777216", 2023-08-01T19:54:20.600 INFO:teuthology.orchestra.run.smithi006.stdout: "seastore_device_size": "107374182400", 2023-08-01T19:54:20.600 INFO:teuthology.orchestra.run.smithi006.stdout: "seastore_init_rewrite_segments_num_per_device": "6", 2023-08-01T19:54:20.600 INFO:teuthology.orchestra.run.smithi006.stdout: "seastore_journal_batch_capacity": "16", 2023-08-01T19:54:20.600 INFO:teuthology.orchestra.run.smithi006.stdout: "seastore_journal_batch_flush_size": "16777216", 2023-08-01T19:54:20.600 INFO:teuthology.orchestra.run.smithi006.stdout: "seastore_journal_batch_preferred_fullness": "0.950000", 2023-08-01T19:54:20.600 INFO:teuthology.orchestra.run.smithi006.stdout: "seastore_journal_iodepth_limit": "5", 2023-08-01T19:54:20.600 INFO:teuthology.orchestra.run.smithi006.stdout: "seastore_segment_size": "67108864", 2023-08-01T19:54:20.600 INFO:teuthology.orchestra.run.smithi006.stdout: "setgroup": "", 2023-08-01T19:54:20.601 INFO:teuthology.orchestra.run.smithi006.stdout: "setuser": "", 2023-08-01T19:54:20.601 INFO:teuthology.orchestra.run.smithi006.stdout: "setuser_match_path": "", 2023-08-01T19:54:20.601 INFO:teuthology.orchestra.run.smithi006.stdout: "target_max_misplaced_ratio": "0.050000", 2023-08-01T19:54:20.601 INFO:teuthology.orchestra.run.smithi006.stdout: "thp": "false", 2023-08-01T19:54:20.601 INFO:teuthology.orchestra.run.smithi006.stdout: "threadpool_default_timeout": "60", 2023-08-01T19:54:20.601 INFO:teuthology.orchestra.run.smithi006.stdout: "threadpool_empty_queue_max_wait": "2", 2023-08-01T19:54:20.601 INFO:teuthology.orchestra.run.smithi006.stdout: "throttler_perf_counter": "true" 2023-08-01T19:54:20.601 INFO:teuthology.orchestra.run.smithi006.stdout:} 2023-08-01T19:54:20.603 DEBUG:teuthology.orchestra.run.smithi006:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 120 ceph --cluster ceph -- tell 'mon.*' injectargs --mon_osd_down_out_interval=0 2023-08-01T19:54:20.740 INFO:teuthology.orchestra.run.smithi006.stdout:mon.a: {} 2023-08-01T19:54:20.749 INFO:teuthology.orchestra.run.smithi006.stdout:mon.b: {} 2023-08-01T19:54:20.758 INFO:teuthology.orchestra.run.smithi006.stdout:mon.c: {} 2023-08-01T19:54:20.760 INFO:teuthology.orchestra.run.smithi006.stderr:mon.a: mon_osd_down_out_interval = '0' (not observed, change may require restart) 2023-08-01T19:54:20.760 INFO:teuthology.orchestra.run.smithi006.stderr:mon.b: mon_osd_down_out_interval = '0' (not observed, change may require restart) 2023-08-01T19:54:20.760 INFO:teuthology.orchestra.run.smithi006.stderr:mon.c: mon_osd_down_out_interval = '0' (not observed, change may require restart) 2023-08-01T19:54:20.770 INFO:tasks.thrashosds.thrasher:Unable to test ceph-objectstore-tool, powercycle testing 2023-08-01T19:54:20.771 INFO:teuthology.run_tasks:Running task radosbench... 2023-08-01T19:54:20.781 INFO:tasks.radosbench:Beginning radosbench... 2023-08-01T19:54:20.782 INFO:tasks.ceph.ceph_manager.ceph:creating pool_name unique_pool_0 2023-08-01T19:54:20.782 DEBUG:teuthology.orchestra.run.smithi006:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 120 ceph --cluster ceph osd pool create unique_pool_0 16 2023-08-01T19:54:20.783 INFO:tasks.thrashosds.thrasher:starting do_thrash 2023-08-01T19:54:20.783 INFO:tasks.thrashosds.thrasher:in_osds: [0, 1, 2] out_osds: [] dead_osds: [] live_osds: [0, 1, 2] 2023-08-01T19:54:20.783 INFO:tasks.thrashosds.thrasher:choose_action: min_in 4 min_out 0 min_live 2 min_dead 0 chance_down 1.00 2023-08-01T19:54:20.783 INFO:tasks.thrashosds.thrasher:inject_pause on osd.1 2023-08-01T19:54:20.783 INFO:tasks.thrashosds.thrasher:Testing filestore_inject_stall pause injection for duration 3 2023-08-01T19:54:20.784 INFO:tasks.thrashosds.thrasher:Checking after 0, should_be_down=False 2023-08-01T19:54:20.784 DEBUG:teuthology.orchestra.run.smithi101:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 0 ceph --cluster ceph --admin-daemon /var/run/ceph/ceph-osd.1.asok config set filestore_inject_stall 3 2023-08-01T19:54:20.784 INFO:tasks.thrashosds.thrasher:starting do_sighup with a delay of 0.1 2023-08-01T19:54:20.785 INFO:tasks.thrashosds.thrasher:starting do_optrack_toggle with a delay of 2.0 2023-08-01T19:54:20.785 DEBUG:teuthology.orchestra.run.smithi006:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 120 ceph --cluster ceph -- tell 'osd.*' injectargs --osd_enable_op_tracker=false 2023-08-01T19:54:20.785 INFO:tasks.thrashosds.thrasher:starting do_dump_ops 2023-08-01T19:54:20.786 DEBUG:teuthology.orchestra.run.smithi008:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 30 ceph --cluster ceph --admin-daemon /var/run/ceph/ceph-osd.0.asok dump_ops_in_flight 2023-08-01T19:54:20.786 INFO:tasks.thrashosds.thrasher:starting do_noscrub_toggle with a delay of 2.0 2023-08-01T19:54:20.786 DEBUG:teuthology.orchestra.run.smithi006:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 120 ceph --cluster ceph osd set noscrub 2023-08-01T19:54:20.787 INFO:tasks.ceph.osd.1.smithi101.stderr:2023-08-01T19:54:20.784+0000 7fb0cb7f6700 -1 received signal: Hangup from /usr/bin/python3 /bin/daemon-helper kill ceph-osd -f --cluster ceph -i 1 (PID: 111141) UID: 0 2023-08-01T19:54:20.886 INFO:tasks.ceph.osd.0.smithi008.stderr:2023-08-01T19:54:20.885+0000 7f16a58f4700 -1 received signal: Hangup from /usr/bin/python3 /bin/daemon-helper kill ceph-osd -f --cluster ceph -i 0 (PID: 111179) UID: 0 2023-08-01T19:54:20.921 INFO:teuthology.orchestra.run.smithi101.stdout:{ 2023-08-01T19:54:20.921 INFO:teuthology.orchestra.run.smithi101.stdout: "success": "filestore_inject_stall = '3' (not observed, change may require restart) " 2023-08-01T19:54:20.921 INFO:teuthology.orchestra.run.smithi101.stdout:} 2023-08-01T19:54:20.929 INFO:teuthology.orchestra.run.smithi008.stdout:{ 2023-08-01T19:54:20.929 INFO:teuthology.orchestra.run.smithi008.stdout: "ops": [], 2023-08-01T19:54:20.929 INFO:teuthology.orchestra.run.smithi008.stdout: "num_ops": 0 2023-08-01T19:54:20.929 INFO:teuthology.orchestra.run.smithi008.stdout:} 2023-08-01T19:54:20.940 DEBUG:teuthology.orchestra.run.smithi008:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 30 ceph --cluster ceph --admin-daemon /var/run/ceph/ceph-osd.0.asok dump_blocked_ops 2023-08-01T19:54:20.947 INFO:teuthology.orchestra.run.smithi006.stdout:osd.0: {} 2023-08-01T19:54:20.966 INFO:teuthology.orchestra.run.smithi006.stdout:osd.1: {} 2023-08-01T19:54:20.985 INFO:teuthology.orchestra.run.smithi006.stdout:osd.2: {} 2023-08-01T19:54:20.986 INFO:teuthology.orchestra.run.smithi006.stderr:osd.0: osd_enable_op_tracker = 'false' 2023-08-01T19:54:20.987 INFO:teuthology.orchestra.run.smithi006.stderr:osd.1: osd_enable_op_tracker = 'false' 2023-08-01T19:54:20.987 INFO:teuthology.orchestra.run.smithi006.stderr:osd.2: osd_enable_op_tracker = 'false' 2023-08-01T19:54:21.022 INFO:tasks.ceph.osd.0.smithi008.stderr:2023-08-01T19:54:21.021+0000 7f16a58f4700 -1 received signal: Hangup from /usr/bin/python3 /bin/daemon-helper kill ceph-osd -f --cluster ceph -i 0 (PID: 111179) UID: 0 2023-08-01T19:54:21.088 INFO:tasks.ceph.osd.2.smithi155.stderr:2023-08-01T19:54:21.087+0000 7faa5c6ac700 -1 received signal: Hangup from /usr/bin/python3 /bin/daemon-helper kill ceph-osd -f --cluster ceph -i 2 (PID: 111337) UID: 0 2023-08-01T19:54:21.108 INFO:teuthology.orchestra.run.smithi008.stdout:ERROR: (22) Invalid argument 2023-08-01T19:54:21.108 INFO:teuthology.orchestra.run.smithi008.stdout:op_tracker tracking is not enabled now, so no ops are tracked currently, even those get stuck. Please enable "osd_enable_op_tracker", and the tracker will start to track new ops received afterwards. 2023-08-01T19:54:21.118 DEBUG:teuthology.orchestra.run.smithi008:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 30 ceph --cluster ceph --admin-daemon /var/run/ceph/ceph-osd.0.asok dump_historic_ops 2023-08-01T19:54:21.189 INFO:tasks.ceph.osd.2.smithi155.stderr:2023-08-01T19:54:21.187+0000 7faa5c6ac700 -1 received signal: Hangup from /usr/bin/python3 /bin/daemon-helper kill ceph-osd -f --cluster ceph -i 2 (PID: 111337) UID: 0 2023-08-01T19:54:21.286 INFO:teuthology.orchestra.run.smithi008.stdout:ERROR: (22) Invalid argument 2023-08-01T19:54:21.286 INFO:teuthology.orchestra.run.smithi008.stdout:op_tracker tracking is not enabled now, so no ops are tracked currently, even those get stuck. Please enable "osd_enable_op_tracker", and the tracker will start to track new ops received afterwards. 2023-08-01T19:54:21.289 INFO:tasks.ceph.osd.2.smithi155.stderr:2023-08-01T19:54:21.288+0000 7faa5c6ac700 -1 received signal: Hangup from /usr/bin/python3 /bin/daemon-helper kill ceph-osd -f --cluster ceph -i 2 (PID: 111337) UID: 0 2023-08-01T19:54:21.296 DEBUG:teuthology.orchestra.run.smithi101:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 30 ceph --cluster ceph --admin-daemon /var/run/ceph/ceph-osd.1.asok dump_ops_in_flight 2023-08-01T19:54:21.390 INFO:tasks.ceph.osd.0.smithi008.stderr:2023-08-01T19:54:21.389+0000 7f16a58f4700 -1 received signal: Hangup from /usr/bin/python3 /bin/daemon-helper kill ceph-osd -f --cluster ceph -i 0 (PID: 111179) UID: 0 2023-08-01T19:54:21.420 INFO:teuthology.orchestra.run.smithi101.stdout:ERROR: (22) Invalid argument 2023-08-01T19:54:21.421 INFO:teuthology.orchestra.run.smithi101.stdout:op_tracker tracking is not enabled now, so no ops are tracked currently, even those get stuck. Please enable "osd_enable_op_tracker", and the tracker will start to track new ops received afterwards. 2023-08-01T19:54:21.430 DEBUG:teuthology.orchestra.run.smithi101:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 30 ceph --cluster ceph --admin-daemon /var/run/ceph/ceph-osd.1.asok dump_blocked_ops 2023-08-01T19:54:21.492 INFO:tasks.ceph.osd.1.smithi101.stderr:2023-08-01T19:54:21.490+0000 7fb0cb7f6700 -1 received signal: Hangup from /usr/bin/python3 /bin/daemon-helper kill ceph-osd -f --cluster ceph -i 1 (PID: 111141) UID: 0 2023-08-01T19:54:21.552 INFO:teuthology.orchestra.run.smithi101.stdout:ERROR: (22) Invalid argument 2023-08-01T19:54:21.552 INFO:teuthology.orchestra.run.smithi101.stdout:op_tracker tracking is not enabled now, so no ops are tracked currently, even those get stuck. Please enable "osd_enable_op_tracker", and the tracker will start to track new ops received afterwards. 2023-08-01T19:54:21.561 DEBUG:teuthology.orchestra.run.smithi101:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 30 ceph --cluster ceph --admin-daemon /var/run/ceph/ceph-osd.1.asok dump_historic_ops 2023-08-01T19:54:21.593 INFO:tasks.ceph.osd.0.smithi008.stderr:2023-08-01T19:54:21.591+0000 7f16a58f4700 -1 received signal: Hangup from /usr/bin/python3 /bin/daemon-helper kill ceph-osd -f --cluster ceph -i 0 (PID: 111179) UID: 0 2023-08-01T19:54:21.694 INFO:tasks.ceph.osd.2.smithi155.stderr:2023-08-01T19:54:21.693+0000 7faa5c6ac700 -1 received signal: Hangup from /usr/bin/python3 /bin/daemon-helper kill ceph-osd -f --cluster ceph -i 2 (PID: 111337) UID: 0 2023-08-01T19:54:21.723 INFO:teuthology.orchestra.run.smithi101.stdout:ERROR: (22) Invalid argument 2023-08-01T19:54:21.724 INFO:teuthology.orchestra.run.smithi101.stdout:op_tracker tracking is not enabled now, so no ops are tracked currently, even those get stuck. Please enable "osd_enable_op_tracker", and the tracker will start to track new ops received afterwards. 2023-08-01T19:54:21.733 DEBUG:teuthology.orchestra.run.smithi155:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 30 ceph --cluster ceph --admin-daemon /var/run/ceph/ceph-osd.2.asok dump_ops_in_flight 2023-08-01T19:54:21.794 INFO:tasks.ceph.osd.1.smithi101.stderr:2023-08-01T19:54:21.793+0000 7fb0cb7f6700 -1 received signal: Hangup from /usr/bin/python3 /bin/daemon-helper kill ceph-osd -f --cluster ceph -i 1 (PID: 111141) UID: 0 2023-08-01T19:54:21.870 INFO:teuthology.orchestra.run.smithi155.stdout:ERROR: (22) Invalid argument 2023-08-01T19:54:21.870 INFO:teuthology.orchestra.run.smithi155.stdout:op_tracker tracking is not enabled now, so no ops are tracked currently, even those get stuck. Please enable "osd_enable_op_tracker", and the tracker will start to track new ops received afterwards. 2023-08-01T19:54:21.880 DEBUG:teuthology.orchestra.run.smithi155:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 30 ceph --cluster ceph --admin-daemon /var/run/ceph/ceph-osd.2.asok dump_blocked_ops 2023-08-01T19:54:21.895 INFO:tasks.ceph.osd.1.smithi101.stderr:2023-08-01T19:54:21.894+0000 7fb0cb7f6700 -1 received signal: Hangup from /usr/bin/python3 /bin/daemon-helper kill ceph-osd -f --cluster ceph -i 1 (PID: 111141) UID: 0 2023-08-01T19:54:21.996 INFO:tasks.ceph.osd.0.smithi008.stderr:2023-08-01T19:54:21.994+0000 7f16a58f4700 -1 received signal: Hangup from /usr/bin/python3 /bin/daemon-helper kill ceph-osd -f --cluster ceph -i 0 (PID: 111179) UID: 0 2023-08-01T19:54:22.003 INFO:teuthology.orchestra.run.smithi155.stdout:ERROR: (22) Invalid argument 2023-08-01T19:54:22.003 INFO:teuthology.orchestra.run.smithi155.stdout:op_tracker tracking is not enabled now, so no ops are tracked currently, even those get stuck. Please enable "osd_enable_op_tracker", and the tracker will start to track new ops received afterwards. 2023-08-01T19:54:22.013 DEBUG:teuthology.orchestra.run.smithi155:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 30 ceph --cluster ceph --admin-daemon /var/run/ceph/ceph-osd.2.asok dump_historic_ops 2023-08-01T19:54:22.096 INFO:tasks.ceph.osd.2.smithi155.stderr:2023-08-01T19:54:22.094+0000 7faa5c6ac700 -1 received signal: Hangup from /usr/bin/python3 /bin/daemon-helper kill ceph-osd -f --cluster ceph -i 2 (PID: 111337) UID: 0 2023-08-01T19:54:22.131 INFO:teuthology.orchestra.run.smithi006.stderr:pool 'unique_pool_0' created 2023-08-01T19:54:22.131 INFO:teuthology.orchestra.run.smithi006.stderr:noscrub is set 2023-08-01T19:54:22.139 INFO:teuthology.orchestra.run.smithi155.stdout:ERROR: (22) Invalid argument 2023-08-01T19:54:22.139 INFO:teuthology.orchestra.run.smithi155.stdout:op_tracker tracking is not enabled now, so no ops are tracked currently, even those get stuck. Please enable "osd_enable_op_tracker", and the tracker will start to track new ops received afterwards. 2023-08-01T19:54:22.146 DEBUG:teuthology.orchestra.run.smithi006:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 120 ceph --cluster ceph osd pool application enable unique_pool_0 rados --yes-i-really-mean-it || true 2023-08-01T19:54:22.149 DEBUG:teuthology.orchestra.run.smithi008:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 30 ceph --cluster ceph --admin-daemon /var/run/ceph/ceph-osd.0.asok dump_ops_in_flight 2023-08-01T19:54:22.196 INFO:tasks.ceph.osd.1.smithi101.stderr:2023-08-01T19:54:22.195+0000 7fb0cb7f6700 -1 received signal: Hangup from /usr/bin/python3 /bin/daemon-helper kill ceph-osd -f --cluster ceph -i 1 (PID: 111141) UID: 0 2023-08-01T19:54:22.291 INFO:teuthology.orchestra.run.smithi008.stdout:ERROR: (22) Invalid argument 2023-08-01T19:54:22.291 INFO:teuthology.orchestra.run.smithi008.stdout:op_tracker tracking is not enabled now, so no ops are tracked currently, even those get stuck. Please enable "osd_enable_op_tracker", and the tracker will start to track new ops received afterwards. 2023-08-01T19:54:22.297 INFO:tasks.ceph.osd.0.smithi008.stderr:2023-08-01T19:54:22.295+0000 7f16a58f4700 -1 received signal: Hangup from /usr/bin/python3 /bin/daemon-helper kill ceph-osd -f --cluster ceph -i 0 (PID: 111179) UID: 0 2023-08-01T19:54:22.301 DEBUG:teuthology.orchestra.run.smithi008:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 30 ceph --cluster ceph --admin-daemon /var/run/ceph/ceph-osd.0.asok dump_blocked_ops 2023-08-01T19:54:22.398 INFO:tasks.ceph.osd.1.smithi101.stderr:2023-08-01T19:54:22.397+0000 7fb0cb7f6700 -1 received signal: Hangup from /usr/bin/python3 /bin/daemon-helper kill ceph-osd -f --cluster ceph -i 1 (PID: 111141) UID: 0 2023-08-01T19:54:22.470 INFO:teuthology.orchestra.run.smithi008.stdout:ERROR: (22) Invalid argument 2023-08-01T19:54:22.470 INFO:teuthology.orchestra.run.smithi008.stdout:op_tracker tracking is not enabled now, so no ops are tracked currently, even those get stuck. Please enable "osd_enable_op_tracker", and the tracker will start to track new ops received afterwards. 2023-08-01T19:54:22.481 DEBUG:teuthology.orchestra.run.smithi008:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 30 ceph --cluster ceph --admin-daemon /var/run/ceph/ceph-osd.0.asok dump_historic_ops 2023-08-01T19:54:22.498 INFO:tasks.ceph.osd.2.smithi155.stderr:2023-08-01T19:54:22.497+0000 7faa5c6ac700 -1 received signal: Hangup from /usr/bin/python3 /bin/daemon-helper kill ceph-osd -f --cluster ceph -i 2 (PID: 111337) UID: 0 2023-08-01T19:54:22.599 INFO:tasks.ceph.osd.1.smithi101.stderr:2023-08-01T19:54:22.598+0000 7fb0cb7f6700 -1 received signal: Hangup from /usr/bin/python3 /bin/daemon-helper kill ceph-osd -f --cluster ceph -i 1 (PID: 111141) UID: 0 2023-08-01T19:54:22.608 INFO:teuthology.orchestra.run.smithi008.stdout:ERROR: (22) Invalid argument 2023-08-01T19:54:22.608 INFO:teuthology.orchestra.run.smithi008.stdout:op_tracker tracking is not enabled now, so no ops are tracked currently, even those get stuck. Please enable "osd_enable_op_tracker", and the tracker will start to track new ops received afterwards. 2023-08-01T19:54:22.618 DEBUG:teuthology.orchestra.run.smithi101:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 30 ceph --cluster ceph --admin-daemon /var/run/ceph/ceph-osd.1.asok dump_ops_in_flight 2023-08-01T19:54:22.700 INFO:tasks.ceph.osd.2.smithi155.stderr:2023-08-01T19:54:22.699+0000 7faa5c6ac700 -1 received signal: Hangup from /usr/bin/python3 /bin/daemon-helper kill ceph-osd -f --cluster ceph -i 2 (PID: 111337) UID: 0 2023-08-01T19:54:22.748 INFO:teuthology.orchestra.run.smithi101.stdout:ERROR: (22) Invalid argument 2023-08-01T19:54:22.748 INFO:teuthology.orchestra.run.smithi101.stdout:op_tracker tracking is not enabled now, so no ops are tracked currently, even those get stuck. Please enable "osd_enable_op_tracker", and the tracker will start to track new ops received afterwards. 2023-08-01T19:54:22.757 DEBUG:teuthology.orchestra.run.smithi101:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 30 ceph --cluster ceph --admin-daemon /var/run/ceph/ceph-osd.1.asok dump_blocked_ops 2023-08-01T19:54:22.801 INFO:tasks.ceph.osd.0.smithi008.stderr:2023-08-01T19:54:22.800+0000 7f16a58f4700 -1 received signal: Hangup from /usr/bin/python3 /bin/daemon-helper kill ceph-osd -f --cluster ceph -i 0 (PID: 111179) UID: 0 2023-08-01T19:54:22.879 INFO:teuthology.orchestra.run.smithi101.stdout:ERROR: (22) Invalid argument 2023-08-01T19:54:22.880 INFO:teuthology.orchestra.run.smithi101.stdout:op_tracker tracking is not enabled now, so no ops are tracked currently, even those get stuck. Please enable "osd_enable_op_tracker", and the tracker will start to track new ops received afterwards. 2023-08-01T19:54:22.889 DEBUG:teuthology.orchestra.run.smithi101:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 30 ceph --cluster ceph --admin-daemon /var/run/ceph/ceph-osd.1.asok dump_historic_ops 2023-08-01T19:54:22.932 INFO:tasks.ceph.osd.1.smithi101.stderr:2023-08-01T19:54:22.931+0000 7fb0cb7f6700 -1 received signal: Hangup from /usr/bin/python3 /bin/daemon-helper kill ceph-osd -f --cluster ceph -i 1 (PID: 111141) UID: 0 2023-08-01T19:54:23.003 DEBUG:teuthology.orchestra.run.smithi006:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 120 ceph --cluster ceph -- tell 'osd.*' injectargs --osd_enable_op_tracker=true 2023-08-01T19:54:23.004 INFO:tasks.ceph.osd.1.smithi101.stderr:2023-08-01T19:54:23.002+0000 7fb0cb7f6700 -1 received signal: Hangup from /usr/bin/python3 /bin/daemon-helper kill ceph-osd -f --cluster ceph -i 1 (PID: 111141) UID: 0 2023-08-01T19:54:23.012 INFO:teuthology.orchestra.run.smithi101.stdout:ERROR: (22) Invalid argument 2023-08-01T19:54:23.013 INFO:teuthology.orchestra.run.smithi101.stdout:op_tracker tracking is not enabled now, so no ops are tracked currently, even those get stuck. Please enable "osd_enable_op_tracker", and the tracker will start to track new ops received afterwards. 2023-08-01T19:54:23.022 DEBUG:teuthology.orchestra.run.smithi155:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 30 ceph --cluster ceph --admin-daemon /var/run/ceph/ceph-osd.2.asok dump_ops_in_flight 2023-08-01T19:54:23.104 INFO:tasks.ceph.osd.2.smithi155.stderr:2023-08-01T19:54:23.103+0000 7faa5c6ac700 -1 received signal: Hangup from /usr/bin/python3 /bin/daemon-helper kill ceph-osd -f --cluster ceph -i 2 (PID: 111337) UID: 0 2023-08-01T19:54:23.136 INFO:teuthology.orchestra.run.smithi006.stderr:enabled application 'rados' on pool 'unique_pool_0' 2023-08-01T19:54:23.162 INFO:teuthology.orchestra.run.smithi155.stdout:ERROR: (22) Invalid argument 2023-08-01T19:54:23.162 INFO:teuthology.orchestra.run.smithi155.stdout:op_tracker tracking is not enabled now, so no ops are tracked currently, even those get stuck. Please enable "osd_enable_op_tracker", and the tracker will start to track new ops received afterwards. 2023-08-01T19:54:23.166 INFO:teuthology.orchestra.run.smithi006.stdout:osd.0: {} 2023-08-01T19:54:23.172 DEBUG:teuthology.orchestra.run.smithi155:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 30 ceph --cluster ceph --admin-daemon /var/run/ceph/ceph-osd.2.asok dump_blocked_ops 2023-08-01T19:54:23.186 INFO:teuthology.orchestra.run.smithi006.stdout:osd.1: {} 2023-08-01T19:54:23.205 INFO:teuthology.orchestra.run.smithi006.stdout:osd.2: {} 2023-08-01T19:54:23.206 INFO:teuthology.orchestra.run.smithi006.stderr:osd.0: osd_enable_op_tracker = 'true' 2023-08-01T19:54:23.206 INFO:teuthology.orchestra.run.smithi006.stderr:osd.1: osd_enable_op_tracker = 'true' 2023-08-01T19:54:23.207 INFO:teuthology.orchestra.run.smithi006.stderr:osd.2: osd_enable_op_tracker = 'true' 2023-08-01T19:54:23.214 INFO:tasks.ceph.osd.2.smithi155.stderr:2023-08-01T19:54:23.212+0000 7faa5c6ac700 -1 received signal: Hangup from /usr/bin/python3 /bin/daemon-helper kill ceph-osd -f --cluster ceph -i 2 (PID: 111337) UID: 0 2023-08-01T19:54:23.306 INFO:tasks.ceph.osd.1.smithi101.stderr:2023-08-01T19:54:23.305+0000 7fb0cb7f6700 -1 received signal: Hangup from /usr/bin/python3 /bin/daemon-helper kill ceph-osd -f --cluster ceph -i 1 (PID: 111141) UID: 0 2023-08-01T19:54:23.335 INFO:teuthology.orchestra.run.smithi155.stdout:{ 2023-08-01T19:54:23.335 INFO:teuthology.orchestra.run.smithi155.stdout: "ops": [], 2023-08-01T19:54:23.335 INFO:teuthology.orchestra.run.smithi155.stdout: "complaint_time": 30, 2023-08-01T19:54:23.336 INFO:teuthology.orchestra.run.smithi155.stdout: "num_blocked_ops": 0 2023-08-01T19:54:23.336 INFO:teuthology.orchestra.run.smithi155.stdout:} 2023-08-01T19:54:23.345 DEBUG:teuthology.orchestra.run.smithi155:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 30 ceph --cluster ceph --admin-daemon /var/run/ceph/ceph-osd.2.asok dump_historic_ops 2023-08-01T19:54:23.407 INFO:tasks.ceph.osd.1.smithi101.stderr:2023-08-01T19:54:23.406+0000 7fb0cb7f6700 -1 received signal: Hangup from /usr/bin/python3 /bin/daemon-helper kill ceph-osd -f --cluster ceph -i 1 (PID: 111141) UID: 0 2023-08-01T19:54:23.469 INFO:teuthology.orchestra.run.smithi155.stdout:{ 2023-08-01T19:54:23.470 INFO:teuthology.orchestra.run.smithi155.stdout: "size": 20, 2023-08-01T19:54:23.470 INFO:teuthology.orchestra.run.smithi155.stdout: "duration": 600, 2023-08-01T19:54:23.470 INFO:teuthology.orchestra.run.smithi155.stdout: "ops": [ 2023-08-01T19:54:23.470 INFO:teuthology.orchestra.run.smithi155.stdout: { 2023-08-01T19:54:23.470 INFO:teuthology.orchestra.run.smithi155.stdout: "description": "osd_repop(client.4159.0:106 1.0 e10/9 1:1b0e96ae:devicehealth::main.db-journal.0000000000000000:head v 10'68, mlcod=10'64)", 2023-08-01T19:54:23.470 INFO:teuthology.orchestra.run.smithi155.stdout: "initiated_at": "2023-08-01T19:53:51.990141+0000", 2023-08-01T19:54:23.470 INFO:teuthology.orchestra.run.smithi155.stdout: "age": 31.477017568000001, 2023-08-01T19:54:23.471 INFO:teuthology.orchestra.run.smithi155.stdout: "duration": 0.0056552629999999998, 2023-08-01T19:54:23.471 INFO:teuthology.orchestra.run.smithi155.stdout: "type_data": { 2023-08-01T19:54:23.471 INFO:teuthology.orchestra.run.smithi155.stdout: "flag_point": "commit sent; apply or cleanup", 2023-08-01T19:54:23.471 INFO:teuthology.orchestra.run.smithi155.stdout: "events": [ 2023-08-01T19:54:23.471 INFO:teuthology.orchestra.run.smithi155.stdout: { 2023-08-01T19:54:23.471 INFO:teuthology.orchestra.run.smithi155.stdout: "event": "initiated", 2023-08-01T19:54:23.472 INFO:teuthology.orchestra.run.smithi155.stdout: "time": "2023-08-01T19:53:51.990141+0000", 2023-08-01T19:54:23.472 INFO:teuthology.orchestra.run.smithi155.stdout: "duration": 0 2023-08-01T19:54:23.472 INFO:teuthology.orchestra.run.smithi155.stdout: }, 2023-08-01T19:54:23.472 INFO:teuthology.orchestra.run.smithi155.stdout: { 2023-08-01T19:54:23.472 INFO:teuthology.orchestra.run.smithi155.stdout: "event": "throttled", 2023-08-01T19:54:23.472 INFO:teuthology.orchestra.run.smithi155.stdout: "time": "2023-08-01T19:53:51.990141+0000", 2023-08-01T19:54:23.473 INFO:teuthology.orchestra.run.smithi155.stdout: "duration": 0 2023-08-01T19:54:23.473 INFO:teuthology.orchestra.run.smithi155.stdout: }, 2023-08-01T19:54:23.473 INFO:teuthology.orchestra.run.smithi155.stdout: { 2023-08-01T19:54:23.473 INFO:teuthology.orchestra.run.smithi155.stdout: "event": "header_read", 2023-08-01T19:54:23.473 INFO:teuthology.orchestra.run.smithi155.stdout: "time": "2023-08-01T19:53:51.990141+0000", 2023-08-01T19:54:23.473 INFO:teuthology.orchestra.run.smithi155.stdout: "duration": 4294967295.9999995 2023-08-01T19:54:23.473 INFO:teuthology.orchestra.run.smithi155.stdout: }, 2023-08-01T19:54:23.474 INFO:teuthology.orchestra.run.smithi155.stdout: { 2023-08-01T19:54:23.474 INFO:teuthology.orchestra.run.smithi155.stdout: "event": "all_read", 2023-08-01T19:54:23.474 INFO:teuthology.orchestra.run.smithi155.stdout: "time": "2023-08-01T19:53:51.990204+0000", 2023-08-01T19:54:23.474 INFO:teuthology.orchestra.run.smithi155.stdout: "duration": 6.3718000000000002e-05 2023-08-01T19:54:23.474 INFO:teuthology.orchestra.run.smithi155.stdout: }, 2023-08-01T19:54:23.474 INFO:teuthology.orchestra.run.smithi155.stdout: { 2023-08-01T19:54:23.474 INFO:teuthology.orchestra.run.smithi155.stdout: "event": "dispatched", 2023-08-01T19:54:23.475 INFO:teuthology.orchestra.run.smithi155.stdout: "time": "2023-08-01T19:53:51.990214+0000", 2023-08-01T19:54:23.475 INFO:teuthology.orchestra.run.smithi155.stdout: "duration": 9.2289999999999992e-06 2023-08-01T19:54:23.475 INFO:teuthology.orchestra.run.smithi155.stdout: }, 2023-08-01T19:54:23.475 INFO:teuthology.orchestra.run.smithi155.stdout: { 2023-08-01T19:54:23.475 INFO:teuthology.orchestra.run.smithi155.stdout: "event": "queued_for_pg", 2023-08-01T19:54:23.475 INFO:teuthology.orchestra.run.smithi155.stdout: "time": "2023-08-01T19:53:51.990219+0000", 2023-08-01T19:54:23.475 INFO:teuthology.orchestra.run.smithi155.stdout: "duration": 5.9819999999999996e-06 2023-08-01T19:54:23.476 INFO:teuthology.orchestra.run.smithi155.stdout: }, 2023-08-01T19:54:23.476 INFO:teuthology.orchestra.run.smithi155.stdout: { 2023-08-01T19:54:23.476 INFO:teuthology.orchestra.run.smithi155.stdout: "event": "reached_pg", 2023-08-01T19:54:23.476 INFO:teuthology.orchestra.run.smithi155.stdout: "time": "2023-08-01T19:53:51.990247+0000", 2023-08-01T19:54:23.476 INFO:teuthology.orchestra.run.smithi155.stdout: "duration": 2.7929e-05 2023-08-01T19:54:23.476 INFO:teuthology.orchestra.run.smithi155.stdout: }, 2023-08-01T19:54:23.476 INFO:teuthology.orchestra.run.smithi155.stdout: { 2023-08-01T19:54:23.477 INFO:teuthology.orchestra.run.smithi155.stdout: "event": "started", 2023-08-01T19:54:23.477 INFO:teuthology.orchestra.run.smithi155.stdout: "time": "2023-08-01T19:53:51.990262+0000", 2023-08-01T19:54:23.477 INFO:teuthology.orchestra.run.smithi155.stdout: "duration": 1.4894e-05 2023-08-01T19:54:23.477 INFO:teuthology.orchestra.run.smithi155.stdout: }, 2023-08-01T19:54:23.477 INFO:teuthology.orchestra.run.smithi155.stdout: { 2023-08-01T19:54:23.477 INFO:teuthology.orchestra.run.smithi155.stdout: "event": "commit_sent", 2023-08-01T19:54:23.477 INFO:teuthology.orchestra.run.smithi155.stdout: "time": "2023-08-01T19:53:51.995758+0000", 2023-08-01T19:54:23.478 INFO:teuthology.orchestra.run.smithi155.stdout: "duration": 0.0054952120000000002 2023-08-01T19:54:23.478 INFO:teuthology.orchestra.run.smithi155.stdout: }, 2023-08-01T19:54:23.478 INFO:teuthology.orchestra.run.smithi155.stdout: { 2023-08-01T19:54:23.478 INFO:teuthology.orchestra.run.smithi155.stdout: "event": "done", 2023-08-01T19:54:23.478 INFO:teuthology.orchestra.run.smithi155.stdout: "time": "2023-08-01T19:53:51.995796+0000", 2023-08-01T19:54:23.478 INFO:teuthology.orchestra.run.smithi155.stdout: "duration": 3.8850999999999998e-05 2023-08-01T19:54:23.478 INFO:teuthology.orchestra.run.smithi155.stdout: } 2023-08-01T19:54:23.479 INFO:teuthology.orchestra.run.smithi155.stdout: ] 2023-08-01T19:54:23.479 INFO:teuthology.orchestra.run.smithi155.stdout: } 2023-08-01T19:54:23.479 INFO:teuthology.orchestra.run.smithi155.stdout: }, 2023-08-01T19:54:23.479 INFO:teuthology.orchestra.run.smithi155.stdout: { 2023-08-01T19:54:23.479 INFO:teuthology.orchestra.run.smithi155.stdout: "description": "osd_repop(client.4159.0:107 1.0 e10/9 1:1b0e96ae:devicehealth::main.db-journal.0000000000000000:head v 10'69, mlcod=10'64)", 2023-08-01T19:54:23.479 INFO:teuthology.orchestra.run.smithi155.stdout: "initiated_at": "2023-08-01T19:53:51.990731+0000", 2023-08-01T19:54:23.479 INFO:teuthology.orchestra.run.smithi155.stdout: "age": 31.476428063, 2023-08-01T19:54:23.480 INFO:teuthology.orchestra.run.smithi155.stdout: "duration": 0.0050864380000000004, 2023-08-01T19:54:23.480 INFO:teuthology.orchestra.run.smithi155.stdout: "type_data": { 2023-08-01T19:54:23.480 INFO:teuthology.orchestra.run.smithi155.stdout: "flag_point": "commit sent; apply or cleanup", 2023-08-01T19:54:23.480 INFO:teuthology.orchestra.run.smithi155.stdout: "events": [ 2023-08-01T19:54:23.480 INFO:teuthology.orchestra.run.smithi155.stdout: { 2023-08-01T19:54:23.480 INFO:teuthology.orchestra.run.smithi155.stdout: "event": "initiated", 2023-08-01T19:54:23.480 INFO:teuthology.orchestra.run.smithi155.stdout: "time": "2023-08-01T19:53:51.990731+0000", 2023-08-01T19:54:23.481 INFO:teuthology.orchestra.run.smithi155.stdout: "duration": 0 2023-08-01T19:54:23.481 INFO:teuthology.orchestra.run.smithi155.stdout: }, 2023-08-01T19:54:23.481 INFO:teuthology.orchestra.run.smithi155.stdout: { 2023-08-01T19:54:23.481 INFO:teuthology.orchestra.run.smithi155.stdout: "event": "throttled", 2023-08-01T19:54:23.481 INFO:teuthology.orchestra.run.smithi155.stdout: "time": "2023-08-01T19:53:51.990731+0000", 2023-08-01T19:54:23.481 INFO:teuthology.orchestra.run.smithi155.stdout: "duration": 0 2023-08-01T19:54:23.481 INFO:teuthology.orchestra.run.smithi155.stdout: }, 2023-08-01T19:54:23.482 INFO:teuthology.orchestra.run.smithi155.stdout: { 2023-08-01T19:54:23.482 INFO:teuthology.orchestra.run.smithi155.stdout: "event": "header_read", 2023-08-01T19:54:23.482 INFO:teuthology.orchestra.run.smithi155.stdout: "time": "2023-08-01T19:53:51.990730+0000", 2023-08-01T19:54:23.482 INFO:teuthology.orchestra.run.smithi155.stdout: "duration": 4294967295.999999 2023-08-01T19:54:23.482 INFO:teuthology.orchestra.run.smithi155.stdout: }, 2023-08-01T19:54:23.482 INFO:teuthology.orchestra.run.smithi155.stdout: { 2023-08-01T19:54:23.482 INFO:teuthology.orchestra.run.smithi155.stdout: "event": "all_read", 2023-08-01T19:54:23.482 INFO:teuthology.orchestra.run.smithi155.stdout: "time": "2023-08-01T19:53:51.990736+0000", 2023-08-01T19:54:23.483 INFO:teuthology.orchestra.run.smithi155.stdout: "duration": 6.3459999999999999e-06 2023-08-01T19:54:23.483 INFO:teuthology.orchestra.run.smithi155.stdout: }, 2023-08-01T19:54:23.483 INFO:teuthology.orchestra.run.smithi155.stdout: { 2023-08-01T19:54:23.483 INFO:teuthology.orchestra.run.smithi155.stdout: "event": "dispatched", 2023-08-01T19:54:23.483 INFO:teuthology.orchestra.run.smithi155.stdout: "time": "2023-08-01T19:53:51.990748+0000", 2023-08-01T19:54:23.483 INFO:teuthology.orchestra.run.smithi155.stdout: "duration": 1.1620999999999999e-05 2023-08-01T19:54:23.483 INFO:teuthology.orchestra.run.smithi155.stdout: }, 2023-08-01T19:54:23.484 INFO:teuthology.orchestra.run.smithi155.stdout: { 2023-08-01T19:54:23.484 INFO:teuthology.orchestra.run.smithi155.stdout: "event": "queued_for_pg", 2023-08-01T19:54:23.484 INFO:teuthology.orchestra.run.smithi155.stdout: "time": "2023-08-01T19:53:51.990755+0000", 2023-08-01T19:54:23.484 INFO:teuthology.orchestra.run.smithi155.stdout: "duration": 6.7599999999999997e-06 2023-08-01T19:54:23.484 INFO:teuthology.orchestra.run.smithi155.stdout: }, 2023-08-01T19:54:23.484 INFO:teuthology.orchestra.run.smithi155.stdout: { 2023-08-01T19:54:23.484 INFO:teuthology.orchestra.run.smithi155.stdout: "event": "reached_pg", 2023-08-01T19:54:23.485 INFO:teuthology.orchestra.run.smithi155.stdout: "time": "2023-08-01T19:53:51.990782+0000", 2023-08-01T19:54:23.485 INFO:teuthology.orchestra.run.smithi155.stdout: "duration": 2.7603e-05 2023-08-01T19:54:23.485 INFO:teuthology.orchestra.run.smithi155.stdout: }, 2023-08-01T19:54:23.485 INFO:teuthology.orchestra.run.smithi155.stdout: { 2023-08-01T19:54:23.485 INFO:teuthology.orchestra.run.smithi155.stdout: "event": "started", 2023-08-01T19:54:23.485 INFO:teuthology.orchestra.run.smithi155.stdout: "time": "2023-08-01T19:53:51.990796+0000", 2023-08-01T19:54:23.485 INFO:teuthology.orchestra.run.smithi155.stdout: "duration": 1.3389e-05 2023-08-01T19:54:23.486 INFO:teuthology.orchestra.run.smithi155.stdout: }, 2023-08-01T19:54:23.486 INFO:teuthology.orchestra.run.smithi155.stdout: { 2023-08-01T19:54:23.486 INFO:teuthology.orchestra.run.smithi155.stdout: "event": "commit_sent", 2023-08-01T19:54:23.486 INFO:teuthology.orchestra.run.smithi155.stdout: "time": "2023-08-01T19:53:51.995799+0000", 2023-08-01T19:54:23.486 INFO:teuthology.orchestra.run.smithi155.stdout: "duration": 0.0050034779999999996 2023-08-01T19:54:23.486 INFO:teuthology.orchestra.run.smithi155.stdout: }, 2023-08-01T19:54:23.486 INFO:teuthology.orchestra.run.smithi155.stdout: { 2023-08-01T19:54:23.487 INFO:teuthology.orchestra.run.smithi155.stdout: "event": "done", 2023-08-01T19:54:23.487 INFO:teuthology.orchestra.run.smithi155.stdout: "time": "2023-08-01T19:53:51.995817+0000", 2023-08-01T19:54:23.487 INFO:teuthology.orchestra.run.smithi155.stdout: "duration": 1.7995e-05 2023-08-01T19:54:23.487 INFO:teuthology.orchestra.run.smithi155.stdout: } 2023-08-01T19:54:23.487 INFO:teuthology.orchestra.run.smithi155.stdout: ] 2023-08-01T19:54:23.487 INFO:teuthology.orchestra.run.smithi155.stdout: } 2023-08-01T19:54:23.487 INFO:teuthology.orchestra.run.smithi155.stdout: }, 2023-08-01T19:54:23.487 INFO:teuthology.orchestra.run.smithi155.stdout: { 2023-08-01T19:54:23.488 INFO:teuthology.orchestra.run.smithi155.stdout: "description": "osd_repop(client.4159.0:110 1.0 e10/9 1:1b0e96ae:devicehealth::main.db-journal.0000000000000000:head v 10'72, mlcod=10'64)", 2023-08-01T19:54:23.488 INFO:teuthology.orchestra.run.smithi155.stdout: "initiated_at": "2023-08-01T19:53:51.993076+0000", 2023-08-01T19:54:23.488 INFO:teuthology.orchestra.run.smithi155.stdout: "age": 31.474082592999999, 2023-08-01T19:54:23.488 INFO:teuthology.orchestra.run.smithi155.stdout: "duration": 0.0052973450000000002, 2023-08-01T19:54:23.488 INFO:teuthology.orchestra.run.smithi155.stdout: "type_data": { 2023-08-01T19:54:23.488 INFO:teuthology.orchestra.run.smithi155.stdout: "flag_point": "commit sent; apply or cleanup", 2023-08-01T19:54:23.488 INFO:teuthology.orchestra.run.smithi155.stdout: "events": [ 2023-08-01T19:54:23.489 INFO:teuthology.orchestra.run.smithi155.stdout: { 2023-08-01T19:54:23.489 INFO:teuthology.orchestra.run.smithi155.stdout: "event": "initiated", 2023-08-01T19:54:23.489 INFO:teuthology.orchestra.run.smithi155.stdout: "time": "2023-08-01T19:53:51.993076+0000", 2023-08-01T19:54:23.489 INFO:teuthology.orchestra.run.smithi155.stdout: "duration": 0 2023-08-01T19:54:23.489 INFO:teuthology.orchestra.run.smithi155.stdout: }, 2023-08-01T19:54:23.489 INFO:teuthology.orchestra.run.smithi155.stdout: { 2023-08-01T19:54:23.489 INFO:teuthology.orchestra.run.smithi155.stdout: "event": "throttled", 2023-08-01T19:54:23.490 INFO:teuthology.orchestra.run.smithi155.stdout: "time": "2023-08-01T19:53:51.993076+0000", 2023-08-01T19:54:23.490 INFO:teuthology.orchestra.run.smithi155.stdout: "duration": 0 2023-08-01T19:54:23.490 INFO:teuthology.orchestra.run.smithi155.stdout: }, 2023-08-01T19:54:23.490 INFO:teuthology.orchestra.run.smithi155.stdout: { 2023-08-01T19:54:23.490 INFO:teuthology.orchestra.run.smithi155.stdout: "event": "header_read", 2023-08-01T19:54:23.490 INFO:teuthology.orchestra.run.smithi155.stdout: "time": "2023-08-01T19:53:51.993075+0000", 2023-08-01T19:54:23.490 INFO:teuthology.orchestra.run.smithi155.stdout: "duration": 4294967295.9999995 2023-08-01T19:54:23.491 INFO:teuthology.orchestra.run.smithi155.stdout: }, 2023-08-01T19:54:23.491 INFO:teuthology.orchestra.run.smithi155.stdout: { 2023-08-01T19:54:23.491 INFO:teuthology.orchestra.run.smithi155.stdout: "event": "all_read", 2023-08-01T19:54:23.491 INFO:teuthology.orchestra.run.smithi155.stdout: "time": "2023-08-01T19:53:51.993083+0000", 2023-08-01T19:54:23.491 INFO:teuthology.orchestra.run.smithi155.stdout: "duration": 7.1659999999999997e-06 2023-08-01T19:54:23.491 INFO:teuthology.orchestra.run.smithi155.stdout: }, 2023-08-01T19:54:23.491 INFO:teuthology.orchestra.run.smithi155.stdout: { 2023-08-01T19:54:23.492 INFO:teuthology.orchestra.run.smithi155.stdout: "event": "dispatched", 2023-08-01T19:54:23.492 INFO:teuthology.orchestra.run.smithi155.stdout: "time": "2023-08-01T19:53:51.993095+0000", 2023-08-01T19:54:23.492 INFO:teuthology.orchestra.run.smithi155.stdout: "duration": 1.2763e-05 2023-08-01T19:54:23.492 INFO:teuthology.orchestra.run.smithi155.stdout: }, 2023-08-01T19:54:23.492 INFO:teuthology.orchestra.run.smithi155.stdout: { 2023-08-01T19:54:23.492 INFO:teuthology.orchestra.run.smithi155.stdout: "event": "queued_for_pg", 2023-08-01T19:54:23.492 INFO:teuthology.orchestra.run.smithi155.stdout: "time": "2023-08-01T19:53:51.993101+0000", 2023-08-01T19:54:23.493 INFO:teuthology.orchestra.run.smithi155.stdout: "duration": 5.9699999999999996e-06 2023-08-01T19:54:23.493 INFO:teuthology.orchestra.run.smithi155.stdout: }, 2023-08-01T19:54:23.493 INFO:teuthology.orchestra.run.smithi155.stdout: { 2023-08-01T19:54:23.493 INFO:teuthology.orchestra.run.smithi155.stdout: "event": "reached_pg", 2023-08-01T19:54:23.493 INFO:teuthology.orchestra.run.smithi155.stdout: "time": "2023-08-01T19:53:51.993128+0000", 2023-08-01T19:54:23.493 INFO:teuthology.orchestra.run.smithi155.stdout: "duration": 2.7144e-05 2023-08-01T19:54:23.493 INFO:teuthology.orchestra.run.smithi155.stdout: }, 2023-08-01T19:54:23.493 INFO:teuthology.orchestra.run.smithi155.stdout: { 2023-08-01T19:54:23.494 INFO:teuthology.orchestra.run.smithi155.stdout: "event": "started", 2023-08-01T19:54:23.494 INFO:teuthology.orchestra.run.smithi155.stdout: "time": "2023-08-01T19:53:51.993141+0000", 2023-08-01T19:54:23.494 INFO:teuthology.orchestra.run.smithi155.stdout: "duration": 1.2330999999999999e-05 2023-08-01T19:54:23.494 INFO:teuthology.orchestra.run.smithi155.stdout: }, 2023-08-01T19:54:23.494 INFO:teuthology.orchestra.run.smithi155.stdout: { 2023-08-01T19:54:23.494 INFO:teuthology.orchestra.run.smithi155.stdout: "event": "commit_sent", 2023-08-01T19:54:23.494 INFO:teuthology.orchestra.run.smithi155.stdout: "time": "2023-08-01T19:53:51.998349+0000", 2023-08-01T19:54:23.495 INFO:teuthology.orchestra.run.smithi155.stdout: "duration": 0.0052080709999999999 2023-08-01T19:54:23.495 INFO:teuthology.orchestra.run.smithi155.stdout: }, 2023-08-01T19:54:23.495 INFO:teuthology.orchestra.run.smithi155.stdout: { 2023-08-01T19:54:23.495 INFO:teuthology.orchestra.run.smithi155.stdout: "event": "done", 2023-08-01T19:54:23.495 INFO:teuthology.orchestra.run.smithi155.stdout: "time": "2023-08-01T19:53:51.998373+0000", 2023-08-01T19:54:23.495 INFO:teuthology.orchestra.run.smithi155.stdout: "duration": 2.4593e-05 2023-08-01T19:54:23.495 INFO:teuthology.orchestra.run.smithi155.stdout: } 2023-08-01T19:54:23.496 INFO:teuthology.orchestra.run.smithi155.stdout: ] 2023-08-01T19:54:23.496 INFO:teuthology.orchestra.run.smithi155.stdout: } 2023-08-01T19:54:23.496 INFO:teuthology.orchestra.run.smithi155.stdout: }, 2023-08-01T19:54:23.496 INFO:teuthology.orchestra.run.smithi155.stdout: { 2023-08-01T19:54:23.496 INFO:teuthology.orchestra.run.smithi155.stdout: "description": "osd_repop(client.4159.0:117 1.0 e10/9 1:1b0e96ae:devicehealth::main.db-journal.0000000000000000:head v 10'79, mlcod=10'66)", 2023-08-01T19:54:23.496 INFO:teuthology.orchestra.run.smithi155.stdout: "initiated_at": "2023-08-01T19:53:51.995781+0000", 2023-08-01T19:54:23.496 INFO:teuthology.orchestra.run.smithi155.stdout: "age": 31.471377862000001, 2023-08-01T19:54:23.497 INFO:teuthology.orchestra.run.smithi155.stdout: "duration": 0.0051661370000000003, 2023-08-01T19:54:23.497 INFO:teuthology.orchestra.run.smithi155.stdout: "type_data": { 2023-08-01T19:54:23.497 INFO:teuthology.orchestra.run.smithi155.stdout: "flag_point": "commit sent; apply or cleanup", 2023-08-01T19:54:23.497 INFO:teuthology.orchestra.run.smithi155.stdout: "events": [ 2023-08-01T19:54:23.497 INFO:teuthology.orchestra.run.smithi155.stdout: { 2023-08-01T19:54:23.497 INFO:teuthology.orchestra.run.smithi155.stdout: "event": "initiated", 2023-08-01T19:54:23.497 INFO:teuthology.orchestra.run.smithi155.stdout: "time": "2023-08-01T19:53:51.995781+0000", 2023-08-01T19:54:23.498 INFO:teuthology.orchestra.run.smithi155.stdout: "duration": 0 2023-08-01T19:54:23.498 INFO:teuthology.orchestra.run.smithi155.stdout: }, 2023-08-01T19:54:23.498 INFO:teuthology.orchestra.run.smithi155.stdout: { 2023-08-01T19:54:23.498 INFO:teuthology.orchestra.run.smithi155.stdout: "event": "throttled", 2023-08-01T19:54:23.498 INFO:teuthology.orchestra.run.smithi155.stdout: "time": "2023-08-01T19:53:51.995781+0000", 2023-08-01T19:54:23.498 INFO:teuthology.orchestra.run.smithi155.stdout: "duration": 0 2023-08-01T19:54:23.498 INFO:teuthology.orchestra.run.smithi155.stdout: }, 2023-08-01T19:54:23.499 INFO:teuthology.orchestra.run.smithi155.stdout: { 2023-08-01T19:54:23.499 INFO:teuthology.orchestra.run.smithi155.stdout: "event": "header_read", 2023-08-01T19:54:23.499 INFO:teuthology.orchestra.run.smithi155.stdout: "time": "2023-08-01T19:53:51.995780+0000", 2023-08-01T19:54:23.499 INFO:teuthology.orchestra.run.smithi155.stdout: "duration": 4294967295.9999995 2023-08-01T19:54:23.499 INFO:teuthology.orchestra.run.smithi155.stdout: }, 2023-08-01T19:54:23.499 INFO:teuthology.orchestra.run.smithi155.stdout: { 2023-08-01T19:54:23.499 INFO:teuthology.orchestra.run.smithi155.stdout: "event": "all_read", 2023-08-01T19:54:23.499 INFO:teuthology.orchestra.run.smithi155.stdout: "time": "2023-08-01T19:53:51.995787+0000", 2023-08-01T19:54:23.500 INFO:teuthology.orchestra.run.smithi155.stdout: "duration": 6.8000000000000001e-06 2023-08-01T19:54:23.500 INFO:teuthology.orchestra.run.smithi155.stdout: }, 2023-08-01T19:54:23.500 INFO:teuthology.orchestra.run.smithi155.stdout: { 2023-08-01T19:54:23.500 INFO:teuthology.orchestra.run.smithi155.stdout: "event": "dispatched", 2023-08-01T19:54:23.500 INFO:teuthology.orchestra.run.smithi155.stdout: "time": "2023-08-01T19:53:51.995797+0000", 2023-08-01T19:54:23.500 INFO:teuthology.orchestra.run.smithi155.stdout: "duration": 9.7510000000000003e-06 2023-08-01T19:54:23.500 INFO:teuthology.orchestra.run.smithi155.stdout: }, 2023-08-01T19:54:23.501 INFO:teuthology.orchestra.run.smithi155.stdout: { 2023-08-01T19:54:23.501 INFO:teuthology.orchestra.run.smithi155.stdout: "event": "queued_for_pg", 2023-08-01T19:54:23.501 INFO:teuthology.orchestra.run.smithi155.stdout: "time": "2023-08-01T19:53:51.995804+0000", 2023-08-01T19:54:23.501 INFO:teuthology.orchestra.run.smithi155.stdout: "duration": 7.0790000000000003e-06 2023-08-01T19:54:23.501 INFO:teuthology.orchestra.run.smithi155.stdout: }, 2023-08-01T19:54:23.501 INFO:teuthology.orchestra.run.smithi155.stdout: { 2023-08-01T19:54:23.501 INFO:teuthology.orchestra.run.smithi155.stdout: "event": "reached_pg", 2023-08-01T19:54:23.502 INFO:teuthology.orchestra.run.smithi155.stdout: "time": "2023-08-01T19:53:51.995875+0000", 2023-08-01T19:54:23.502 INFO:teuthology.orchestra.run.smithi155.stdout: "duration": 7.0659000000000002e-05 2023-08-01T19:54:23.502 INFO:teuthology.orchestra.run.smithi155.stdout: }, 2023-08-01T19:54:23.502 INFO:teuthology.orchestra.run.smithi155.stdout: { 2023-08-01T19:54:23.502 INFO:teuthology.orchestra.run.smithi155.stdout: "event": "started", 2023-08-01T19:54:23.502 INFO:teuthology.orchestra.run.smithi155.stdout: "time": "2023-08-01T19:53:51.995897+0000", 2023-08-01T19:54:23.502 INFO:teuthology.orchestra.run.smithi155.stdout: "duration": 2.2388999999999999e-05 2023-08-01T19:54:23.503 INFO:teuthology.orchestra.run.smithi155.stdout: }, 2023-08-01T19:54:23.503 INFO:teuthology.orchestra.run.smithi155.stdout: { 2023-08-01T19:54:23.503 INFO:teuthology.orchestra.run.smithi155.stdout: "event": "commit_sent", 2023-08-01T19:54:23.503 INFO:teuthology.orchestra.run.smithi155.stdout: "time": "2023-08-01T19:53:52.000919+0000", 2023-08-01T19:54:23.503 INFO:teuthology.orchestra.run.smithi155.stdout: "duration": 0.0050220000000000004 2023-08-01T19:54:23.503 INFO:teuthology.orchestra.run.smithi155.stdout: }, 2023-08-01T19:54:23.503 INFO:teuthology.orchestra.run.smithi155.stdout: { 2023-08-01T19:54:23.504 INFO:teuthology.orchestra.run.smithi155.stdout: "event": "done", 2023-08-01T19:54:23.504 INFO:teuthology.orchestra.run.smithi155.stdout: "time": "2023-08-01T19:53:52.000947+0000", 2023-08-01T19:54:23.504 INFO:teuthology.orchestra.run.smithi155.stdout: "duration": 2.8059999999999999e-05 2023-08-01T19:54:23.504 INFO:teuthology.orchestra.run.smithi155.stdout: } 2023-08-01T19:54:23.504 INFO:teuthology.orchestra.run.smithi155.stdout: ] 2023-08-01T19:54:23.504 INFO:teuthology.orchestra.run.smithi155.stdout: } 2023-08-01T19:54:23.504 INFO:teuthology.orchestra.run.smithi155.stdout: }, 2023-08-01T19:54:23.505 INFO:teuthology.orchestra.run.smithi155.stdout: { 2023-08-01T19:54:23.505 INFO:teuthology.orchestra.run.smithi155.stdout: "description": "osd_repop(client.4159.0:155 1.0 e10/9 1:1b0e96ae:devicehealth::main.db-journal.0000000000000000:head v 10'109, mlcod=10'105)", 2023-08-01T19:54:23.505 INFO:teuthology.orchestra.run.smithi155.stdout: "initiated_at": "2023-08-01T19:53:52.189753+0000", 2023-08-01T19:54:23.505 INFO:teuthology.orchestra.run.smithi155.stdout: "age": 31.277405718000001, 2023-08-01T19:54:23.505 INFO:teuthology.orchestra.run.smithi155.stdout: "duration": 0.0053925659999999997, 2023-08-01T19:54:23.505 INFO:teuthology.orchestra.run.smithi155.stdout: "type_data": { 2023-08-01T19:54:23.505 INFO:teuthology.orchestra.run.smithi155.stdout: "flag_point": "commit sent; apply or cleanup", 2023-08-01T19:54:23.505 INFO:teuthology.orchestra.run.smithi155.stdout: "events": [ 2023-08-01T19:54:23.506 INFO:teuthology.orchestra.run.smithi155.stdout: { 2023-08-01T19:54:23.506 INFO:teuthology.orchestra.run.smithi155.stdout: "event": "initiated", 2023-08-01T19:54:23.506 INFO:teuthology.orchestra.run.smithi155.stdout: "time": "2023-08-01T19:53:52.189753+0000", 2023-08-01T19:54:23.506 INFO:teuthology.orchestra.run.smithi155.stdout: "duration": 0 2023-08-01T19:54:23.506 INFO:teuthology.orchestra.run.smithi155.stdout: }, 2023-08-01T19:54:23.506 INFO:teuthology.orchestra.run.smithi155.stdout: { 2023-08-01T19:54:23.506 INFO:teuthology.orchestra.run.smithi155.stdout: "event": "throttled", 2023-08-01T19:54:23.507 INFO:teuthology.orchestra.run.smithi155.stdout: "time": "2023-08-01T19:53:52.189753+0000", 2023-08-01T19:54:23.507 INFO:teuthology.orchestra.run.smithi155.stdout: "duration": 0 2023-08-01T19:54:23.507 INFO:teuthology.orchestra.run.smithi155.stdout: }, 2023-08-01T19:54:23.507 INFO:teuthology.orchestra.run.smithi155.stdout: { 2023-08-01T19:54:23.507 INFO:teuthology.orchestra.run.smithi155.stdout: "event": "header_read", 2023-08-01T19:54:23.507 INFO:teuthology.orchestra.run.smithi155.stdout: "time": "2023-08-01T19:53:52.189752+0000", 2023-08-01T19:54:23.507 INFO:teuthology.orchestra.run.smithi155.stdout: "duration": 4294967295.9999995 2023-08-01T19:54:23.508 INFO:teuthology.orchestra.run.smithi155.stdout: }, 2023-08-01T19:54:23.508 INFO:teuthology.orchestra.run.smithi155.stdout: { 2023-08-01T19:54:23.508 INFO:teuthology.orchestra.run.smithi155.stdout: "event": "all_read", 2023-08-01T19:54:23.508 INFO:teuthology.orchestra.run.smithi155.stdout: "time": "2023-08-01T19:53:52.189793+0000", 2023-08-01T19:54:23.508 INFO:teuthology.orchestra.run.smithi155.stdout: "duration": 4.1047000000000002e-05 2023-08-01T19:54:23.508 INFO:teuthology.orchestra.run.smithi155.stdout: }, 2023-08-01T19:54:23.508 INFO:teuthology.orchestra.run.smithi155.stdout: { 2023-08-01T19:54:23.509 INFO:teuthology.orchestra.run.smithi155.stdout: "event": "dispatched", 2023-08-01T19:54:23.509 INFO:teuthology.orchestra.run.smithi155.stdout: "time": "2023-08-01T19:53:52.189802+0000", 2023-08-01T19:54:23.509 INFO:teuthology.orchestra.run.smithi155.stdout: "duration": 8.3760000000000008e-06 2023-08-01T19:54:23.509 INFO:teuthology.orchestra.run.smithi155.stdout: }, 2023-08-01T19:54:23.509 INFO:teuthology.orchestra.run.smithi155.stdout: { 2023-08-01T19:54:23.509 INFO:teuthology.orchestra.run.smithi155.stdout: "event": "queued_for_pg", 2023-08-01T19:54:23.509 INFO:teuthology.orchestra.run.smithi155.stdout: "time": "2023-08-01T19:53:52.189805+0000", 2023-08-01T19:54:23.509 INFO:teuthology.orchestra.run.smithi155.stdout: "duration": 3.506e-06 2023-08-01T19:54:23.510 INFO:teuthology.orchestra.run.smithi155.stdout: }, 2023-08-01T19:54:23.510 INFO:teuthology.orchestra.run.smithi155.stdout: { 2023-08-01T19:54:23.510 INFO:teuthology.orchestra.run.smithi155.stdout: "event": "reached_pg", 2023-08-01T19:54:23.510 INFO:teuthology.orchestra.run.smithi155.stdout: "time": "2023-08-01T19:53:52.189830+0000", 2023-08-01T19:54:23.510 INFO:teuthology.orchestra.run.smithi155.stdout: "duration": 2.4567999999999999e-05 2023-08-01T19:54:23.510 INFO:teuthology.orchestra.run.smithi155.stdout: }, 2023-08-01T19:54:23.510 INFO:teuthology.orchestra.run.smithi155.stdout: { 2023-08-01T19:54:23.511 INFO:teuthology.orchestra.run.smithi155.stdout: "event": "started", 2023-08-01T19:54:23.511 INFO:teuthology.orchestra.run.smithi155.stdout: "time": "2023-08-01T19:53:52.189842+0000", 2023-08-01T19:54:23.511 INFO:teuthology.orchestra.run.smithi155.stdout: "duration": 1.1697e-05 2023-08-01T19:54:23.511 INFO:teuthology.orchestra.run.smithi155.stdout: }, 2023-08-01T19:54:23.511 INFO:teuthology.orchestra.run.smithi155.stdout: { 2023-08-01T19:54:23.511 INFO:teuthology.orchestra.run.smithi155.stdout: "event": "commit_sent", 2023-08-01T19:54:23.511 INFO:teuthology.orchestra.run.smithi155.stdout: "time": "2023-08-01T19:53:52.195122+0000", 2023-08-01T19:54:23.512 INFO:teuthology.orchestra.run.smithi155.stdout: "duration": 0.0052804210000000004 2023-08-01T19:54:23.512 INFO:teuthology.orchestra.run.smithi155.stdout: }, 2023-08-01T19:54:23.512 INFO:teuthology.orchestra.run.smithi155.stdout: { 2023-08-01T19:54:23.512 INFO:teuthology.orchestra.run.smithi155.stdout: "event": "done", 2023-08-01T19:54:23.512 INFO:teuthology.orchestra.run.smithi155.stdout: "time": "2023-08-01T19:53:52.195146+0000", 2023-08-01T19:54:23.512 INFO:teuthology.orchestra.run.smithi155.stdout: "duration": 2.3584999999999999e-05 2023-08-01T19:54:23.512 INFO:teuthology.orchestra.run.smithi155.stdout: } 2023-08-01T19:54:23.513 INFO:teuthology.orchestra.run.smithi155.stdout: ] 2023-08-01T19:54:23.513 INFO:teuthology.orchestra.run.smithi155.stdout: } 2023-08-01T19:54:23.513 INFO:teuthology.orchestra.run.smithi155.stdout: }, 2023-08-01T19:54:23.513 INFO:teuthology.orchestra.run.smithi155.stdout: { 2023-08-01T19:54:23.513 INFO:teuthology.orchestra.run.smithi155.stdout: "description": "osd_repop(client.4159.0:161 1.0 e10/9 1:1b0e96ae:devicehealth::main.db-journal.0000000000000000:head v 10'115, mlcod=10'106)", 2023-08-01T19:54:23.513 INFO:teuthology.orchestra.run.smithi155.stdout: "initiated_at": "2023-08-01T19:53:52.192018+0000", 2023-08-01T19:54:23.513 INFO:teuthology.orchestra.run.smithi155.stdout: "age": 31.275140457999999, 2023-08-01T19:54:23.514 INFO:teuthology.orchestra.run.smithi155.stdout: "duration": 0.0058077529999999997, 2023-08-01T19:54:23.514 INFO:teuthology.orchestra.run.smithi155.stdout: "type_data": { 2023-08-01T19:54:23.514 INFO:teuthology.orchestra.run.smithi155.stdout: "flag_point": "commit sent; apply or cleanup", 2023-08-01T19:54:23.514 INFO:teuthology.orchestra.run.smithi155.stdout: "events": [ 2023-08-01T19:54:23.514 INFO:teuthology.orchestra.run.smithi155.stdout: { 2023-08-01T19:54:23.514 INFO:teuthology.orchestra.run.smithi155.stdout: "event": "initiated", 2023-08-01T19:54:23.514 INFO:teuthology.orchestra.run.smithi155.stdout: "time": "2023-08-01T19:53:52.192018+0000", 2023-08-01T19:54:23.514 INFO:teuthology.orchestra.run.smithi155.stdout: "duration": 0 2023-08-01T19:54:23.515 INFO:teuthology.orchestra.run.smithi155.stdout: }, 2023-08-01T19:54:23.515 INFO:teuthology.orchestra.run.smithi155.stdout: { 2023-08-01T19:54:23.515 INFO:teuthology.orchestra.run.smithi155.stdout: "event": "throttled", 2023-08-01T19:54:23.515 INFO:teuthology.orchestra.run.smithi155.stdout: "time": "2023-08-01T19:53:52.192018+0000", 2023-08-01T19:54:23.515 INFO:teuthology.orchestra.run.smithi155.stdout: "duration": 0 2023-08-01T19:54:23.515 INFO:teuthology.orchestra.run.smithi155.stdout: }, 2023-08-01T19:54:23.515 INFO:teuthology.orchestra.run.smithi155.stdout: { 2023-08-01T19:54:23.516 INFO:teuthology.orchestra.run.smithi155.stdout: "event": "header_read", 2023-08-01T19:54:23.516 INFO:teuthology.orchestra.run.smithi155.stdout: "time": "2023-08-01T19:53:52.192018+0000", 2023-08-01T19:54:23.516 INFO:teuthology.orchestra.run.smithi155.stdout: "duration": 4294967295.9999995 2023-08-01T19:54:23.516 INFO:teuthology.orchestra.run.smithi155.stdout: }, 2023-08-01T19:54:23.516 INFO:teuthology.orchestra.run.smithi155.stdout: { 2023-08-01T19:54:23.516 INFO:teuthology.orchestra.run.smithi155.stdout: "event": "all_read", 2023-08-01T19:54:23.516 INFO:teuthology.orchestra.run.smithi155.stdout: "time": "2023-08-01T19:53:52.192075+0000", 2023-08-01T19:54:23.517 INFO:teuthology.orchestra.run.smithi155.stdout: "duration": 5.7404000000000001e-05 2023-08-01T19:54:23.517 INFO:teuthology.orchestra.run.smithi155.stdout: }, 2023-08-01T19:54:23.517 INFO:teuthology.orchestra.run.smithi155.stdout: { 2023-08-01T19:54:23.517 INFO:teuthology.orchestra.run.smithi155.stdout: "event": "dispatched", 2023-08-01T19:54:23.517 INFO:teuthology.orchestra.run.smithi155.stdout: "time": "2023-08-01T19:53:52.192082+0000", 2023-08-01T19:54:23.517 INFO:teuthology.orchestra.run.smithi155.stdout: "duration": 6.7340000000000002e-06 2023-08-01T19:54:23.517 INFO:teuthology.orchestra.run.smithi155.stdout: }, 2023-08-01T19:54:23.518 INFO:teuthology.orchestra.run.smithi155.stdout: { 2023-08-01T19:54:23.518 INFO:teuthology.orchestra.run.smithi155.stdout: "event": "queued_for_pg", 2023-08-01T19:54:23.518 INFO:teuthology.orchestra.run.smithi155.stdout: "time": "2023-08-01T19:53:52.192093+0000", 2023-08-01T19:54:23.518 INFO:teuthology.orchestra.run.smithi155.stdout: "duration": 1.1072e-05 2023-08-01T19:54:23.518 INFO:teuthology.orchestra.run.smithi155.stdout: }, 2023-08-01T19:54:23.518 INFO:teuthology.orchestra.run.smithi155.stdout: { 2023-08-01T19:54:23.518 INFO:teuthology.orchestra.run.smithi155.stdout: "event": "reached_pg", 2023-08-01T19:54:23.518 INFO:teuthology.orchestra.run.smithi155.stdout: "time": "2023-08-01T19:53:52.192118+0000", 2023-08-01T19:54:23.519 INFO:teuthology.orchestra.run.smithi155.stdout: "duration": 2.5071000000000001e-05 2023-08-01T19:54:23.519 INFO:teuthology.orchestra.run.smithi155.stdout: }, 2023-08-01T19:54:23.519 INFO:teuthology.orchestra.run.smithi155.stdout: { 2023-08-01T19:54:23.519 INFO:teuthology.orchestra.run.smithi155.stdout: "event": "started", 2023-08-01T19:54:23.519 INFO:teuthology.orchestra.run.smithi155.stdout: "time": "2023-08-01T19:53:52.192129+0000", 2023-08-01T19:54:23.519 INFO:teuthology.orchestra.run.smithi155.stdout: "duration": 1.1163e-05 2023-08-01T19:54:23.519 INFO:teuthology.orchestra.run.smithi155.stdout: }, 2023-08-01T19:54:23.520 INFO:teuthology.orchestra.run.smithi155.stdout: { 2023-08-01T19:54:23.520 INFO:teuthology.orchestra.run.smithi155.stdout: "event": "commit_sent", 2023-08-01T19:54:23.520 INFO:teuthology.orchestra.run.smithi155.stdout: "time": "2023-08-01T19:53:52.197790+0000", 2023-08-01T19:54:23.520 INFO:teuthology.orchestra.run.smithi155.stdout: "duration": 0.0056609499999999997 2023-08-01T19:54:23.520 INFO:teuthology.orchestra.run.smithi155.stdout: }, 2023-08-01T19:54:23.520 INFO:teuthology.orchestra.run.smithi155.stdout: { 2023-08-01T19:54:23.520 INFO:teuthology.orchestra.run.smithi155.stdout: "event": "done", 2023-08-01T19:54:23.521 INFO:teuthology.orchestra.run.smithi155.stdout: "time": "2023-08-01T19:53:52.197826+0000", 2023-08-01T19:54:23.521 INFO:teuthology.orchestra.run.smithi155.stdout: "duration": 3.5819999999999999e-05 2023-08-01T19:54:23.521 INFO:teuthology.orchestra.run.smithi155.stdout: } 2023-08-01T19:54:23.521 INFO:teuthology.orchestra.run.smithi155.stdout: ] 2023-08-01T19:54:23.521 INFO:teuthology.orchestra.run.smithi155.stdout: } 2023-08-01T19:54:23.521 INFO:teuthology.orchestra.run.smithi155.stdout: }, 2023-08-01T19:54:23.521 INFO:teuthology.orchestra.run.smithi155.stdout: { 2023-08-01T19:54:23.522 INFO:teuthology.orchestra.run.smithi155.stdout: "description": "osd_repop(client.4159.0:162 1.0 e10/9 1:1b0e96ae:devicehealth::main.db-journal.0000000000000000:head v 10'116, mlcod=10'106)", 2023-08-01T19:54:23.522 INFO:teuthology.orchestra.run.smithi155.stdout: "initiated_at": "2023-08-01T19:53:52.192445+0000", 2023-08-01T19:54:23.522 INFO:teuthology.orchestra.run.smithi155.stdout: "age": 31.274714073999998, 2023-08-01T19:54:23.522 INFO:teuthology.orchestra.run.smithi155.stdout: "duration": 0.0053993330000000001, 2023-08-01T19:54:23.522 INFO:teuthology.orchestra.run.smithi155.stdout: "type_data": { 2023-08-01T19:54:23.522 INFO:teuthology.orchestra.run.smithi155.stdout: "flag_point": "commit sent; apply or cleanup", 2023-08-01T19:54:23.522 INFO:teuthology.orchestra.run.smithi155.stdout: "events": [ 2023-08-01T19:54:23.522 INFO:teuthology.orchestra.run.smithi155.stdout: { 2023-08-01T19:54:23.523 INFO:teuthology.orchestra.run.smithi155.stdout: "event": "initiated", 2023-08-01T19:54:23.523 INFO:teuthology.orchestra.run.smithi155.stdout: "time": "2023-08-01T19:53:52.192445+0000", 2023-08-01T19:54:23.523 INFO:teuthology.orchestra.run.smithi155.stdout: "duration": 0 2023-08-01T19:54:23.523 INFO:teuthology.orchestra.run.smithi155.stdout: }, 2023-08-01T19:54:23.523 INFO:teuthology.orchestra.run.smithi155.stdout: { 2023-08-01T19:54:23.523 INFO:teuthology.orchestra.run.smithi155.stdout: "event": "throttled", 2023-08-01T19:54:23.523 INFO:teuthology.orchestra.run.smithi155.stdout: "time": "2023-08-01T19:53:52.192445+0000", 2023-08-01T19:54:23.524 INFO:teuthology.orchestra.run.smithi155.stdout: "duration": 0 2023-08-01T19:54:23.524 INFO:teuthology.orchestra.run.smithi155.stdout: }, 2023-08-01T19:54:23.524 INFO:teuthology.orchestra.run.smithi155.stdout: { 2023-08-01T19:54:23.524 INFO:teuthology.orchestra.run.smithi155.stdout: "event": "header_read", 2023-08-01T19:54:23.524 INFO:teuthology.orchestra.run.smithi155.stdout: "time": "2023-08-01T19:53:52.192444+0000", 2023-08-01T19:54:23.524 INFO:teuthology.orchestra.run.smithi155.stdout: "duration": 4294967295.9999995 2023-08-01T19:54:23.524 INFO:teuthology.orchestra.run.smithi155.stdout: }, 2023-08-01T19:54:23.525 INFO:teuthology.orchestra.run.smithi155.stdout: { 2023-08-01T19:54:23.525 INFO:teuthology.orchestra.run.smithi155.stdout: "event": "all_read", 2023-08-01T19:54:23.525 INFO:teuthology.orchestra.run.smithi155.stdout: "time": "2023-08-01T19:53:52.192452+0000", 2023-08-01T19:54:23.525 INFO:teuthology.orchestra.run.smithi155.stdout: "duration": 7.9419999999999995e-06 2023-08-01T19:54:23.525 INFO:teuthology.orchestra.run.smithi155.stdout: }, 2023-08-01T19:54:23.525 INFO:teuthology.orchestra.run.smithi155.stdout: { 2023-08-01T19:54:23.525 INFO:teuthology.orchestra.run.smithi155.stdout: "event": "dispatched", 2023-08-01T19:54:23.526 INFO:teuthology.orchestra.run.smithi155.stdout: "time": "2023-08-01T19:53:52.192460+0000", 2023-08-01T19:54:23.526 INFO:teuthology.orchestra.run.smithi155.stdout: "duration": 8.0620000000000001e-06 2023-08-01T19:54:23.526 INFO:teuthology.orchestra.run.smithi155.stdout: }, 2023-08-01T19:54:23.526 INFO:teuthology.orchestra.run.smithi155.stdout: { 2023-08-01T19:54:23.526 INFO:teuthology.orchestra.run.smithi155.stdout: "event": "queued_for_pg", 2023-08-01T19:54:23.526 INFO:teuthology.orchestra.run.smithi155.stdout: "time": "2023-08-01T19:53:52.192464+0000", 2023-08-01T19:54:23.526 INFO:teuthology.orchestra.run.smithi155.stdout: "duration": 3.9559999999999999e-06 2023-08-01T19:54:23.527 INFO:teuthology.orchestra.run.smithi155.stdout: }, 2023-08-01T19:54:23.527 INFO:teuthology.orchestra.run.smithi155.stdout: { 2023-08-01T19:54:23.527 INFO:teuthology.orchestra.run.smithi155.stdout: "event": "reached_pg", 2023-08-01T19:54:23.527 INFO:teuthology.orchestra.run.smithi155.stdout: "time": "2023-08-01T19:53:52.192486+0000", 2023-08-01T19:54:23.527 INFO:teuthology.orchestra.run.smithi155.stdout: "duration": 2.2154000000000002e-05 2023-08-01T19:54:23.527 INFO:teuthology.orchestra.run.smithi155.stdout: }, 2023-08-01T19:54:23.527 INFO:teuthology.orchestra.run.smithi155.stdout: { 2023-08-01T19:54:23.528 INFO:teuthology.orchestra.run.smithi155.stdout: "event": "started", 2023-08-01T19:54:23.528 INFO:teuthology.orchestra.run.smithi155.stdout: "time": "2023-08-01T19:53:52.192499+0000", 2023-08-01T19:54:23.528 INFO:teuthology.orchestra.run.smithi155.stdout: "duration": 1.3029e-05 2023-08-01T19:54:23.528 INFO:teuthology.orchestra.run.smithi155.stdout: }, 2023-08-01T19:54:23.528 INFO:teuthology.orchestra.run.smithi155.stdout: { 2023-08-01T19:54:23.528 INFO:teuthology.orchestra.run.smithi155.stdout: "event": "commit_sent", 2023-08-01T19:54:23.528 INFO:teuthology.orchestra.run.smithi155.stdout: "time": "2023-08-01T19:53:52.197828+0000", 2023-08-01T19:54:23.528 INFO:teuthology.orchestra.run.smithi155.stdout: "duration": 0.0053291600000000003 2023-08-01T19:54:23.529 INFO:teuthology.orchestra.run.smithi155.stdout: }, 2023-08-01T19:54:23.529 INFO:teuthology.orchestra.run.smithi155.stdout: { 2023-08-01T19:54:23.529 INFO:teuthology.orchestra.run.smithi155.stdout: "event": "done", 2023-08-01T19:54:23.529 INFO:teuthology.orchestra.run.smithi155.stdout: "time": "2023-08-01T19:53:52.197844+0000", 2023-08-01T19:54:23.529 INFO:teuthology.orchestra.run.smithi155.stdout: "duration": 1.5693999999999999e-05 2023-08-01T19:54:23.529 INFO:teuthology.orchestra.run.smithi155.stdout: } 2023-08-01T19:54:23.529 INFO:teuthology.orchestra.run.smithi155.stdout: ] 2023-08-01T19:54:23.530 INFO:teuthology.orchestra.run.smithi155.stdout: } 2023-08-01T19:54:23.530 INFO:teuthology.orchestra.run.smithi155.stdout: }, 2023-08-01T19:54:23.530 INFO:teuthology.orchestra.run.smithi155.stdout: { 2023-08-01T19:54:23.530 INFO:teuthology.orchestra.run.smithi155.stdout: "description": "osd_repop(client.4159.0:182 1.0 e10/9 1:1b0e96ae:devicehealth::main.db-journal.0000000000000000:head v 10'132, mlcod=10'127)", 2023-08-01T19:54:23.530 INFO:teuthology.orchestra.run.smithi155.stdout: "initiated_at": "2023-08-01T19:53:52.314106+0000", 2023-08-01T19:54:23.530 INFO:teuthology.orchestra.run.smithi155.stdout: "age": 31.153053052000001, 2023-08-01T19:54:23.530 INFO:teuthology.orchestra.run.smithi155.stdout: "duration": 0.006058852, 2023-08-01T19:54:23.531 INFO:teuthology.orchestra.run.smithi155.stdout: "type_data": { 2023-08-01T19:54:23.531 INFO:teuthology.orchestra.run.smithi155.stdout: "flag_point": "commit sent; apply or cleanup", 2023-08-01T19:54:23.531 INFO:teuthology.orchestra.run.smithi155.stdout: "events": [ 2023-08-01T19:54:23.531 INFO:teuthology.orchestra.run.smithi155.stdout: { 2023-08-01T19:54:23.531 INFO:teuthology.orchestra.run.smithi155.stdout: "event": "initiated", 2023-08-01T19:54:23.531 INFO:teuthology.orchestra.run.smithi155.stdout: "time": "2023-08-01T19:53:52.314106+0000", 2023-08-01T19:54:23.531 INFO:teuthology.orchestra.run.smithi155.stdout: "duration": 0 2023-08-01T19:54:23.532 INFO:teuthology.orchestra.run.smithi155.stdout: }, 2023-08-01T19:54:23.532 INFO:teuthology.orchestra.run.smithi155.stdout: { 2023-08-01T19:54:23.532 INFO:teuthology.orchestra.run.smithi155.stdout: "event": "throttled", 2023-08-01T19:54:23.532 INFO:teuthology.orchestra.run.smithi155.stdout: "time": "2023-08-01T19:53:52.314106+0000", 2023-08-01T19:54:23.532 INFO:teuthology.orchestra.run.smithi155.stdout: "duration": 0 2023-08-01T19:54:23.532 INFO:teuthology.orchestra.run.smithi155.stdout: }, 2023-08-01T19:54:23.532 INFO:teuthology.orchestra.run.smithi155.stdout: { 2023-08-01T19:54:23.533 INFO:teuthology.orchestra.run.smithi155.stdout: "event": "header_read", 2023-08-01T19:54:23.533 INFO:teuthology.orchestra.run.smithi155.stdout: "time": "2023-08-01T19:53:52.314105+0000", 2023-08-01T19:54:23.533 INFO:teuthology.orchestra.run.smithi155.stdout: "duration": 4294967295.9999995 2023-08-01T19:54:23.533 INFO:teuthology.orchestra.run.smithi155.stdout: }, 2023-08-01T19:54:23.533 INFO:teuthology.orchestra.run.smithi155.stdout: { 2023-08-01T19:54:23.533 INFO:teuthology.orchestra.run.smithi155.stdout: "event": "all_read", 2023-08-01T19:54:23.533 INFO:teuthology.orchestra.run.smithi155.stdout: "time": "2023-08-01T19:53:52.314164+0000", 2023-08-01T19:54:23.533 INFO:teuthology.orchestra.run.smithi155.stdout: "duration": 5.8548000000000003e-05 2023-08-01T19:54:23.534 INFO:teuthology.orchestra.run.smithi155.stdout: }, 2023-08-01T19:54:23.534 INFO:teuthology.orchestra.run.smithi155.stdout: { 2023-08-01T19:54:23.534 INFO:teuthology.orchestra.run.smithi155.stdout: "event": "dispatched", 2023-08-01T19:54:23.534 INFO:teuthology.orchestra.run.smithi155.stdout: "time": "2023-08-01T19:53:52.314171+0000", 2023-08-01T19:54:23.534 INFO:teuthology.orchestra.run.smithi155.stdout: "duration": 7.5490000000000001e-06 2023-08-01T19:54:23.534 INFO:teuthology.orchestra.run.smithi155.stdout: }, 2023-08-01T19:54:23.534 INFO:teuthology.orchestra.run.smithi155.stdout: { 2023-08-01T19:54:23.535 INFO:teuthology.orchestra.run.smithi155.stdout: "event": "queued_for_pg", 2023-08-01T19:54:23.535 INFO:teuthology.orchestra.run.smithi155.stdout: "time": "2023-08-01T19:53:52.314175+0000", 2023-08-01T19:54:23.535 INFO:teuthology.orchestra.run.smithi155.stdout: "duration": 3.4460000000000001e-06 2023-08-01T19:54:23.535 INFO:teuthology.orchestra.run.smithi155.stdout: }, 2023-08-01T19:54:23.535 INFO:teuthology.orchestra.run.smithi155.stdout: { 2023-08-01T19:54:23.535 INFO:teuthology.orchestra.run.smithi155.stdout: "event": "reached_pg", 2023-08-01T19:54:23.535 INFO:teuthology.orchestra.run.smithi155.stdout: "time": "2023-08-01T19:53:52.314210+0000", 2023-08-01T19:54:23.536 INFO:teuthology.orchestra.run.smithi155.stdout: "duration": 3.4876000000000003e-05 2023-08-01T19:54:23.536 INFO:teuthology.orchestra.run.smithi155.stdout: }, 2023-08-01T19:54:23.536 INFO:teuthology.orchestra.run.smithi155.stdout: { 2023-08-01T19:54:23.536 INFO:teuthology.orchestra.run.smithi155.stdout: "event": "started", 2023-08-01T19:54:23.536 INFO:teuthology.orchestra.run.smithi155.stdout: "time": "2023-08-01T19:53:52.314228+0000", 2023-08-01T19:54:23.536 INFO:teuthology.orchestra.run.smithi155.stdout: "duration": 1.8204000000000001e-05 2023-08-01T19:54:23.536 INFO:teuthology.orchestra.run.smithi155.stdout: }, 2023-08-01T19:54:23.537 INFO:teuthology.orchestra.run.smithi155.stdout: { 2023-08-01T19:54:23.537 INFO:teuthology.orchestra.run.smithi155.stdout: "event": "commit_sent", 2023-08-01T19:54:23.537 INFO:teuthology.orchestra.run.smithi155.stdout: "time": "2023-08-01T19:53:52.320137+0000", 2023-08-01T19:54:23.537 INFO:teuthology.orchestra.run.smithi155.stdout: "duration": 0.0059094109999999998 2023-08-01T19:54:23.537 INFO:teuthology.orchestra.run.smithi155.stdout: }, 2023-08-01T19:54:23.537 INFO:teuthology.orchestra.run.smithi155.stdout: { 2023-08-01T19:54:23.537 INFO:teuthology.orchestra.run.smithi155.stdout: "event": "done", 2023-08-01T19:54:23.538 INFO:teuthology.orchestra.run.smithi155.stdout: "time": "2023-08-01T19:53:52.320164+0000", 2023-08-01T19:54:23.538 INFO:teuthology.orchestra.run.smithi155.stdout: "duration": 2.7288e-05 2023-08-01T19:54:23.538 INFO:teuthology.orchestra.run.smithi155.stdout: } 2023-08-01T19:54:23.538 INFO:teuthology.orchestra.run.smithi155.stdout: ] 2023-08-01T19:54:23.538 INFO:teuthology.orchestra.run.smithi155.stdout: } 2023-08-01T19:54:23.538 INFO:teuthology.orchestra.run.smithi155.stdout: }, 2023-08-01T19:54:23.538 INFO:teuthology.orchestra.run.smithi155.stdout: { 2023-08-01T19:54:23.539 INFO:teuthology.orchestra.run.smithi155.stdout: "description": "osd_repop(client.4159.0:183 1.0 e10/9 1:1b0e96ae:devicehealth::main.db-journal.0000000000000000:head v 10'133, mlcod=10'127)", 2023-08-01T19:54:23.539 INFO:teuthology.orchestra.run.smithi155.stdout: "initiated_at": "2023-08-01T19:53:52.314559+0000", 2023-08-01T19:54:23.539 INFO:teuthology.orchestra.run.smithi155.stdout: "age": 31.152599963, 2023-08-01T19:54:23.539 INFO:teuthology.orchestra.run.smithi155.stdout: "duration": 0.0056295629999999998, 2023-08-01T19:54:23.539 INFO:teuthology.orchestra.run.smithi155.stdout: "type_data": { 2023-08-01T19:54:23.539 INFO:teuthology.orchestra.run.smithi155.stdout: "flag_point": "commit sent; apply or cleanup", 2023-08-01T19:54:23.539 INFO:teuthology.orchestra.run.smithi155.stdout: "events": [ 2023-08-01T19:54:23.539 INFO:teuthology.orchestra.run.smithi155.stdout: { 2023-08-01T19:54:23.540 INFO:teuthology.orchestra.run.smithi155.stdout: "event": "initiated", 2023-08-01T19:54:23.540 INFO:teuthology.orchestra.run.smithi155.stdout: "time": "2023-08-01T19:53:52.314559+0000", 2023-08-01T19:54:23.540 INFO:teuthology.orchestra.run.smithi155.stdout: "duration": 0 2023-08-01T19:54:23.540 INFO:teuthology.orchestra.run.smithi155.stdout: }, 2023-08-01T19:54:23.540 INFO:teuthology.orchestra.run.smithi155.stdout: { 2023-08-01T19:54:23.540 INFO:teuthology.orchestra.run.smithi155.stdout: "event": "throttled", 2023-08-01T19:54:23.540 INFO:teuthology.orchestra.run.smithi155.stdout: "time": "2023-08-01T19:53:52.314559+0000", 2023-08-01T19:54:23.541 INFO:teuthology.orchestra.run.smithi155.stdout: "duration": 0 2023-08-01T19:54:23.541 INFO:teuthology.orchestra.run.smithi155.stdout: }, 2023-08-01T19:54:23.541 INFO:teuthology.orchestra.run.smithi155.stdout: { 2023-08-01T19:54:23.541 INFO:teuthology.orchestra.run.smithi155.stdout: "event": "header_read", 2023-08-01T19:54:23.541 INFO:teuthology.orchestra.run.smithi155.stdout: "time": "2023-08-01T19:53:52.314558+0000", 2023-08-01T19:54:23.541 INFO:teuthology.orchestra.run.smithi155.stdout: "duration": 4294967295.9999995 2023-08-01T19:54:23.541 INFO:teuthology.orchestra.run.smithi155.stdout: }, 2023-08-01T19:54:23.542 INFO:teuthology.orchestra.run.smithi155.stdout: { 2023-08-01T19:54:23.542 INFO:teuthology.orchestra.run.smithi155.stdout: "event": "all_read", 2023-08-01T19:54:23.542 INFO:teuthology.orchestra.run.smithi155.stdout: "time": "2023-08-01T19:53:52.314562+0000", 2023-08-01T19:54:23.542 INFO:teuthology.orchestra.run.smithi155.stdout: "duration": 3.8419999999999998e-06 2023-08-01T19:54:23.542 INFO:teuthology.orchestra.run.smithi155.stdout: }, 2023-08-01T19:54:23.542 INFO:teuthology.orchestra.run.smithi155.stdout: { 2023-08-01T19:54:23.542 INFO:teuthology.orchestra.run.smithi155.stdout: "event": "dispatched", 2023-08-01T19:54:23.543 INFO:teuthology.orchestra.run.smithi155.stdout: "time": "2023-08-01T19:53:52.314568+0000", 2023-08-01T19:54:23.543 INFO:teuthology.orchestra.run.smithi155.stdout: "duration": 6.3130000000000004e-06 2023-08-01T19:54:23.543 INFO:teuthology.orchestra.run.smithi155.stdout: }, 2023-08-01T19:54:23.543 INFO:teuthology.orchestra.run.smithi155.stdout: { 2023-08-01T19:54:23.543 INFO:teuthology.orchestra.run.smithi155.stdout: "event": "queued_for_pg", 2023-08-01T19:54:23.543 INFO:teuthology.orchestra.run.smithi155.stdout: "time": "2023-08-01T19:53:52.314572+0000", 2023-08-01T19:54:23.543 INFO:teuthology.orchestra.run.smithi155.stdout: "duration": 3.912e-06 2023-08-01T19:54:23.544 INFO:teuthology.orchestra.run.smithi155.stdout: }, 2023-08-01T19:54:23.544 INFO:teuthology.orchestra.run.smithi155.stdout: { 2023-08-01T19:54:23.544 INFO:teuthology.orchestra.run.smithi155.stdout: "event": "reached_pg", 2023-08-01T19:54:23.544 INFO:teuthology.orchestra.run.smithi155.stdout: "time": "2023-08-01T19:53:52.314599+0000", 2023-08-01T19:54:23.544 INFO:teuthology.orchestra.run.smithi155.stdout: "duration": 2.6584000000000002e-05 2023-08-01T19:54:23.544 INFO:teuthology.orchestra.run.smithi155.stdout: }, 2023-08-01T19:54:23.544 INFO:teuthology.orchestra.run.smithi155.stdout: { 2023-08-01T19:54:23.545 INFO:teuthology.orchestra.run.smithi155.stdout: "event": "started", 2023-08-01T19:54:23.545 INFO:teuthology.orchestra.run.smithi155.stdout: "time": "2023-08-01T19:53:52.314611+0000", 2023-08-01T19:54:23.545 INFO:teuthology.orchestra.run.smithi155.stdout: "duration": 1.1851999999999999e-05 2023-08-01T19:54:23.545 INFO:teuthology.orchestra.run.smithi155.stdout: }, 2023-08-01T19:54:23.545 INFO:teuthology.orchestra.run.smithi155.stdout: { 2023-08-01T19:54:23.545 INFO:teuthology.orchestra.run.smithi155.stdout: "event": "commit_sent", 2023-08-01T19:54:23.545 INFO:teuthology.orchestra.run.smithi155.stdout: "time": "2023-08-01T19:53:52.320167+0000", 2023-08-01T19:54:23.545 INFO:teuthology.orchestra.run.smithi155.stdout: "duration": 0.005555674 2023-08-01T19:54:23.546 INFO:teuthology.orchestra.run.smithi155.stdout: }, 2023-08-01T19:54:23.546 INFO:teuthology.orchestra.run.smithi155.stdout: { 2023-08-01T19:54:23.546 INFO:teuthology.orchestra.run.smithi155.stdout: "event": "done", 2023-08-01T19:54:23.546 INFO:teuthology.orchestra.run.smithi155.stdout: "time": "2023-08-01T19:53:52.320188+0000", 2023-08-01T19:54:23.546 INFO:teuthology.orchestra.run.smithi155.stdout: "duration": 2.1780000000000002e-05 2023-08-01T19:54:23.546 INFO:teuthology.orchestra.run.smithi155.stdout: } 2023-08-01T19:54:23.546 INFO:teuthology.orchestra.run.smithi155.stdout: ] 2023-08-01T19:54:23.547 INFO:teuthology.orchestra.run.smithi155.stdout: } 2023-08-01T19:54:23.547 INFO:teuthology.orchestra.run.smithi155.stdout: }, 2023-08-01T19:54:23.547 INFO:teuthology.orchestra.run.smithi155.stdout: { 2023-08-01T19:54:23.547 INFO:teuthology.orchestra.run.smithi155.stdout: "description": "osd_repop(client.4159.0:184 1.0 e10/9 1:1b0e96ae:devicehealth::main.db-journal.0000000000000000:head v 10'134, mlcod=10'127)", 2023-08-01T19:54:23.547 INFO:teuthology.orchestra.run.smithi155.stdout: "initiated_at": "2023-08-01T19:53:52.315059+0000", 2023-08-01T19:54:23.547 INFO:teuthology.orchestra.run.smithi155.stdout: "age": 31.152099649, 2023-08-01T19:54:23.547 INFO:teuthology.orchestra.run.smithi155.stdout: "duration": 0.0051436340000000002, 2023-08-01T19:54:23.548 INFO:teuthology.orchestra.run.smithi155.stdout: "type_data": { 2023-08-01T19:54:23.548 INFO:teuthology.orchestra.run.smithi155.stdout: "flag_point": "commit sent; apply or cleanup", 2023-08-01T19:54:23.548 INFO:teuthology.orchestra.run.smithi155.stdout: "events": [ 2023-08-01T19:54:23.548 INFO:teuthology.orchestra.run.smithi155.stdout: { 2023-08-01T19:54:23.548 INFO:teuthology.orchestra.run.smithi155.stdout: "event": "initiated", 2023-08-01T19:54:23.548 INFO:teuthology.orchestra.run.smithi155.stdout: "time": "2023-08-01T19:53:52.315059+0000", 2023-08-01T19:54:23.548 INFO:teuthology.orchestra.run.smithi155.stdout: "duration": 0 2023-08-01T19:54:23.549 INFO:teuthology.orchestra.run.smithi155.stdout: }, 2023-08-01T19:54:23.549 INFO:teuthology.orchestra.run.smithi155.stdout: { 2023-08-01T19:54:23.549 INFO:teuthology.orchestra.run.smithi155.stdout: "event": "throttled", 2023-08-01T19:54:23.549 INFO:teuthology.orchestra.run.smithi155.stdout: "time": "2023-08-01T19:53:52.315059+0000", 2023-08-01T19:54:23.549 INFO:teuthology.orchestra.run.smithi155.stdout: "duration": 0 2023-08-01T19:54:23.549 INFO:teuthology.orchestra.run.smithi155.stdout: }, 2023-08-01T19:54:23.549 INFO:teuthology.orchestra.run.smithi155.stdout: { 2023-08-01T19:54:23.550 INFO:teuthology.orchestra.run.smithi155.stdout: "event": "header_read", 2023-08-01T19:54:23.550 INFO:teuthology.orchestra.run.smithi155.stdout: "time": "2023-08-01T19:53:52.315059+0000", 2023-08-01T19:54:23.550 INFO:teuthology.orchestra.run.smithi155.stdout: "duration": 4294967295.9999995 2023-08-01T19:54:23.550 INFO:teuthology.orchestra.run.smithi155.stdout: }, 2023-08-01T19:54:23.550 INFO:teuthology.orchestra.run.smithi155.stdout: { 2023-08-01T19:54:23.550 INFO:teuthology.orchestra.run.smithi155.stdout: "event": "all_read", 2023-08-01T19:54:23.550 INFO:teuthology.orchestra.run.smithi155.stdout: "time": "2023-08-01T19:53:52.315063+0000", 2023-08-01T19:54:23.550 INFO:teuthology.orchestra.run.smithi155.stdout: "duration": 4.2690000000000001e-06 2023-08-01T19:54:23.551 INFO:teuthology.orchestra.run.smithi155.stdout: }, 2023-08-01T19:54:23.551 INFO:teuthology.orchestra.run.smithi155.stdout: { 2023-08-01T19:54:23.551 INFO:teuthology.orchestra.run.smithi155.stdout: "event": "dispatched", 2023-08-01T19:54:23.551 INFO:teuthology.orchestra.run.smithi155.stdout: "time": "2023-08-01T19:53:52.315069+0000", 2023-08-01T19:54:23.551 INFO:teuthology.orchestra.run.smithi155.stdout: "duration": 6.6200000000000001e-06 2023-08-01T19:54:23.551 INFO:teuthology.orchestra.run.smithi155.stdout: }, 2023-08-01T19:54:23.551 INFO:teuthology.orchestra.run.smithi155.stdout: { 2023-08-01T19:54:23.552 INFO:teuthology.orchestra.run.smithi155.stdout: "event": "queued_for_pg", 2023-08-01T19:54:23.552 INFO:teuthology.orchestra.run.smithi155.stdout: "time": "2023-08-01T19:53:52.315072+0000", 2023-08-01T19:54:23.552 INFO:teuthology.orchestra.run.smithi155.stdout: "duration": 2.9299999999999999e-06 2023-08-01T19:54:23.552 INFO:teuthology.orchestra.run.smithi155.stdout: }, 2023-08-01T19:54:23.552 INFO:teuthology.orchestra.run.smithi155.stdout: { 2023-08-01T19:54:23.552 INFO:teuthology.orchestra.run.smithi155.stdout: "event": "reached_pg", 2023-08-01T19:54:23.552 INFO:teuthology.orchestra.run.smithi155.stdout: "time": "2023-08-01T19:53:52.315102+0000", 2023-08-01T19:54:23.553 INFO:teuthology.orchestra.run.smithi155.stdout: "duration": 2.9929000000000001e-05 2023-08-01T19:54:23.553 INFO:teuthology.orchestra.run.smithi155.stdout: }, 2023-08-01T19:54:23.553 INFO:teuthology.orchestra.run.smithi155.stdout: { 2023-08-01T19:54:23.553 INFO:teuthology.orchestra.run.smithi155.stdout: "event": "started", 2023-08-01T19:54:23.553 INFO:teuthology.orchestra.run.smithi155.stdout: "time": "2023-08-01T19:53:52.315121+0000", 2023-08-01T19:54:23.553 INFO:teuthology.orchestra.run.smithi155.stdout: "duration": 1.819e-05 2023-08-01T19:54:23.553 INFO:teuthology.orchestra.run.smithi155.stdout: }, 2023-08-01T19:54:23.554 INFO:teuthology.orchestra.run.smithi155.stdout: { 2023-08-01T19:54:23.554 INFO:teuthology.orchestra.run.smithi155.stdout: "event": "commit_sent", 2023-08-01T19:54:23.554 INFO:teuthology.orchestra.run.smithi155.stdout: "time": "2023-08-01T19:53:52.320189+0000", 2023-08-01T19:54:23.554 INFO:teuthology.orchestra.run.smithi155.stdout: "duration": 0.0050688640000000002 2023-08-01T19:54:23.554 INFO:teuthology.orchestra.run.smithi155.stdout: }, 2023-08-01T19:54:23.554 INFO:teuthology.orchestra.run.smithi155.stdout: { 2023-08-01T19:54:23.554 INFO:teuthology.orchestra.run.smithi155.stdout: "event": "done", 2023-08-01T19:54:23.555 INFO:teuthology.orchestra.run.smithi155.stdout: "time": "2023-08-01T19:53:52.320203+0000", 2023-08-01T19:54:23.555 INFO:teuthology.orchestra.run.smithi155.stdout: "duration": 1.3304e-05 2023-08-01T19:54:23.555 INFO:teuthology.orchestra.run.smithi155.stdout: } 2023-08-01T19:54:23.555 INFO:teuthology.orchestra.run.smithi155.stdout: ] 2023-08-01T19:54:23.555 INFO:teuthology.orchestra.run.smithi155.stdout: } 2023-08-01T19:54:23.555 INFO:teuthology.orchestra.run.smithi155.stdout: }, 2023-08-01T19:54:23.555 INFO:teuthology.orchestra.run.smithi155.stdout: { 2023-08-01T19:54:23.556 INFO:teuthology.orchestra.run.smithi155.stdout: "description": "osd_op(mds.0.3:14 3.15 3:a93a17c2:::604.00000000:head [omap-set-header] snapc 0=[] ondisk+write+known_if_redirected+full_force+supports_pool_eio e17)", 2023-08-01T19:54:23.556 INFO:teuthology.orchestra.run.smithi155.stdout: "initiated_at": "2023-08-01T19:54:04.459085+0000", 2023-08-01T19:54:23.556 INFO:teuthology.orchestra.run.smithi155.stdout: "age": 19.008073490000001, 2023-08-01T19:54:23.556 INFO:teuthology.orchestra.run.smithi155.stdout: "duration": 0.012196858, 2023-08-01T19:54:23.556 INFO:teuthology.orchestra.run.smithi155.stdout: "type_data": { 2023-08-01T19:54:23.556 INFO:teuthology.orchestra.run.smithi155.stdout: "flag_point": "commit sent; apply or cleanup", 2023-08-01T19:54:23.556 INFO:teuthology.orchestra.run.smithi155.stdout: "events": [ 2023-08-01T19:54:23.557 INFO:teuthology.orchestra.run.smithi155.stdout: { 2023-08-01T19:54:23.557 INFO:teuthology.orchestra.run.smithi155.stdout: "event": "initiated", 2023-08-01T19:54:23.557 INFO:teuthology.orchestra.run.smithi155.stdout: "time": "2023-08-01T19:54:04.459085+0000", 2023-08-01T19:54:23.557 INFO:teuthology.orchestra.run.smithi155.stdout: "duration": 0 2023-08-01T19:54:23.557 INFO:teuthology.orchestra.run.smithi155.stdout: }, 2023-08-01T19:54:23.557 INFO:teuthology.orchestra.run.smithi155.stdout: { 2023-08-01T19:54:23.557 INFO:teuthology.orchestra.run.smithi155.stdout: "event": "throttled", 2023-08-01T19:54:23.557 INFO:teuthology.orchestra.run.smithi155.stdout: "time": "2023-08-01T19:54:04.459085+0000", 2023-08-01T19:54:23.558 INFO:teuthology.orchestra.run.smithi155.stdout: "duration": 0 2023-08-01T19:54:23.558 INFO:teuthology.orchestra.run.smithi155.stdout: }, 2023-08-01T19:54:23.558 INFO:teuthology.orchestra.run.smithi155.stdout: { 2023-08-01T19:54:23.558 INFO:teuthology.orchestra.run.smithi155.stdout: "event": "header_read", 2023-08-01T19:54:23.558 INFO:teuthology.orchestra.run.smithi155.stdout: "time": "2023-08-01T19:54:04.459080+0000", 2023-08-01T19:54:23.558 INFO:teuthology.orchestra.run.smithi155.stdout: "duration": 4294967295.9999948 2023-08-01T19:54:23.558 INFO:teuthology.orchestra.run.smithi155.stdout: }, 2023-08-01T19:54:23.559 INFO:teuthology.orchestra.run.smithi155.stdout: { 2023-08-01T19:54:23.559 INFO:teuthology.orchestra.run.smithi155.stdout: "event": "all_read", 2023-08-01T19:54:23.559 INFO:teuthology.orchestra.run.smithi155.stdout: "time": "2023-08-01T19:54:04.459093+0000", 2023-08-01T19:54:23.559 INFO:teuthology.orchestra.run.smithi155.stdout: "duration": 1.3303e-05 2023-08-01T19:54:23.559 INFO:teuthology.orchestra.run.smithi155.stdout: }, 2023-08-01T19:54:23.559 INFO:teuthology.orchestra.run.smithi155.stdout: { 2023-08-01T19:54:23.559 INFO:teuthology.orchestra.run.smithi155.stdout: "event": "dispatched", 2023-08-01T19:54:23.560 INFO:teuthology.orchestra.run.smithi155.stdout: "time": "2023-08-01T19:54:04.459116+0000", 2023-08-01T19:54:23.560 INFO:teuthology.orchestra.run.smithi155.stdout: "duration": 2.2614000000000001e-05 2023-08-01T19:54:23.560 INFO:teuthology.orchestra.run.smithi155.stdout: }, 2023-08-01T19:54:23.560 INFO:teuthology.orchestra.run.smithi155.stdout: { 2023-08-01T19:54:23.560 INFO:teuthology.orchestra.run.smithi155.stdout: "event": "queued_for_pg", 2023-08-01T19:54:23.560 INFO:teuthology.orchestra.run.smithi155.stdout: "time": "2023-08-01T19:54:04.459132+0000", 2023-08-01T19:54:23.560 INFO:teuthology.orchestra.run.smithi155.stdout: "duration": 1.6356000000000001e-05 2023-08-01T19:54:23.561 INFO:teuthology.orchestra.run.smithi155.stdout: }, 2023-08-01T19:54:23.561 INFO:teuthology.orchestra.run.smithi155.stdout: { 2023-08-01T19:54:23.561 INFO:teuthology.orchestra.run.smithi155.stdout: "event": "reached_pg", 2023-08-01T19:54:23.561 INFO:teuthology.orchestra.run.smithi155.stdout: "time": "2023-08-01T19:54:04.461263+0000", 2023-08-01T19:54:23.561 INFO:teuthology.orchestra.run.smithi155.stdout: "duration": 0.0021311120000000001 2023-08-01T19:54:23.561 INFO:teuthology.orchestra.run.smithi155.stdout: }, 2023-08-01T19:54:23.561 INFO:teuthology.orchestra.run.smithi155.stdout: { 2023-08-01T19:54:23.562 INFO:teuthology.orchestra.run.smithi155.stdout: "event": "started", 2023-08-01T19:54:23.562 INFO:teuthology.orchestra.run.smithi155.stdout: "time": "2023-08-01T19:54:04.461385+0000", 2023-08-01T19:54:23.562 INFO:teuthology.orchestra.run.smithi155.stdout: "duration": 0.000121517 2023-08-01T19:54:23.562 INFO:teuthology.orchestra.run.smithi155.stdout: }, 2023-08-01T19:54:23.562 INFO:teuthology.orchestra.run.smithi155.stdout: { 2023-08-01T19:54:23.562 INFO:teuthology.orchestra.run.smithi155.stdout: "event": "waiting for subops from 1", 2023-08-01T19:54:23.562 INFO:teuthology.orchestra.run.smithi155.stdout: "time": "2023-08-01T19:54:04.461522+0000", 2023-08-01T19:54:23.562 INFO:teuthology.orchestra.run.smithi155.stdout: "duration": 0.000137212 2023-08-01T19:54:23.563 INFO:teuthology.orchestra.run.smithi155.stdout: }, 2023-08-01T19:54:23.563 INFO:teuthology.orchestra.run.smithi155.stdout: { 2023-08-01T19:54:23.563 INFO:teuthology.orchestra.run.smithi155.stdout: "event": "op_commit", 2023-08-01T19:54:23.563 INFO:teuthology.orchestra.run.smithi155.stdout: "time": "2023-08-01T19:54:04.463751+0000", 2023-08-01T19:54:23.563 INFO:teuthology.orchestra.run.smithi155.stdout: "duration": 0.002229389 2023-08-01T19:54:23.563 INFO:teuthology.orchestra.run.smithi155.stdout: }, 2023-08-01T19:54:23.563 INFO:teuthology.orchestra.run.smithi155.stdout: { 2023-08-01T19:54:23.564 INFO:teuthology.orchestra.run.smithi155.stdout: "event": "sub_op_commit_rec", 2023-08-01T19:54:23.564 INFO:teuthology.orchestra.run.smithi155.stdout: "time": "2023-08-01T19:54:04.471196+0000", 2023-08-01T19:54:23.564 INFO:teuthology.orchestra.run.smithi155.stdout: "duration": 0.0074447879999999999 2023-08-01T19:54:23.564 INFO:teuthology.orchestra.run.smithi155.stdout: }, 2023-08-01T19:54:23.564 INFO:teuthology.orchestra.run.smithi155.stdout: { 2023-08-01T19:54:23.564 INFO:teuthology.orchestra.run.smithi155.stdout: "event": "commit_sent", 2023-08-01T19:54:23.564 INFO:teuthology.orchestra.run.smithi155.stdout: "time": "2023-08-01T19:54:04.471244+0000", 2023-08-01T19:54:23.565 INFO:teuthology.orchestra.run.smithi155.stdout: "duration": 4.8285999999999998e-05 2023-08-01T19:54:23.565 INFO:teuthology.orchestra.run.smithi155.stdout: }, 2023-08-01T19:54:23.565 INFO:teuthology.orchestra.run.smithi155.stdout: { 2023-08-01T19:54:23.565 INFO:teuthology.orchestra.run.smithi155.stdout: "event": "done", 2023-08-01T19:54:23.565 INFO:teuthology.orchestra.run.smithi155.stdout: "time": "2023-08-01T19:54:04.471282+0000", 2023-08-01T19:54:23.565 INFO:teuthology.orchestra.run.smithi155.stdout: "duration": 3.7700999999999997e-05 2023-08-01T19:54:23.565 INFO:teuthology.orchestra.run.smithi155.stdout: } 2023-08-01T19:54:23.566 INFO:teuthology.orchestra.run.smithi155.stdout: ] 2023-08-01T19:54:23.566 INFO:teuthology.orchestra.run.smithi155.stdout: } 2023-08-01T19:54:23.566 INFO:teuthology.orchestra.run.smithi155.stdout: }, 2023-08-01T19:54:23.566 INFO:teuthology.orchestra.run.smithi155.stdout: { 2023-08-01T19:54:23.566 INFO:teuthology.orchestra.run.smithi155.stdout: "description": "osd_op(mds.0.3:15 3.15 3:a93a17c2:::604.00000000:head [create,setxattr parent (62) in=6b,setxattr layout (30) in=6b] snapc 0=[] ondisk+write+known_if_redirected+full_force+supports_pool_eio e17)", 2023-08-01T19:54:23.566 INFO:teuthology.orchestra.run.smithi155.stdout: "initiated_at": "2023-08-01T19:54:04.459510+0000", 2023-08-01T19:54:23.566 INFO:teuthology.orchestra.run.smithi155.stdout: "age": 19.007648677999999, 2023-08-01T19:54:23.567 INFO:teuthology.orchestra.run.smithi155.stdout: "duration": 0.011891071, 2023-08-01T19:54:23.567 INFO:teuthology.orchestra.run.smithi155.stdout: "type_data": { 2023-08-01T19:54:23.567 INFO:teuthology.orchestra.run.smithi155.stdout: "flag_point": "commit sent; apply or cleanup", 2023-08-01T19:54:23.567 INFO:teuthology.orchestra.run.smithi155.stdout: "events": [ 2023-08-01T19:54:23.567 INFO:teuthology.orchestra.run.smithi155.stdout: { 2023-08-01T19:54:23.567 INFO:teuthology.orchestra.run.smithi155.stdout: "event": "initiated", 2023-08-01T19:54:23.567 INFO:teuthology.orchestra.run.smithi155.stdout: "time": "2023-08-01T19:54:04.459510+0000", 2023-08-01T19:54:23.567 INFO:teuthology.orchestra.run.smithi155.stdout: "duration": 0 2023-08-01T19:54:23.568 INFO:teuthology.orchestra.run.smithi155.stdout: }, 2023-08-01T19:54:23.568 INFO:teuthology.orchestra.run.smithi155.stdout: { 2023-08-01T19:54:23.568 INFO:teuthology.orchestra.run.smithi155.stdout: "event": "throttled", 2023-08-01T19:54:23.568 INFO:teuthology.orchestra.run.smithi155.stdout: "time": "2023-08-01T19:54:04.459510+0000", 2023-08-01T19:54:23.568 INFO:teuthology.orchestra.run.smithi155.stdout: "duration": 0 2023-08-01T19:54:23.568 INFO:teuthology.orchestra.run.smithi155.stdout: }, 2023-08-01T19:54:23.568 INFO:teuthology.orchestra.run.smithi155.stdout: { 2023-08-01T19:54:23.569 INFO:teuthology.orchestra.run.smithi155.stdout: "event": "header_read", 2023-08-01T19:54:23.569 INFO:teuthology.orchestra.run.smithi155.stdout: "time": "2023-08-01T19:54:04.459509+0000", 2023-08-01T19:54:23.569 INFO:teuthology.orchestra.run.smithi155.stdout: "duration": 4294967295.999999 2023-08-01T19:54:23.569 INFO:teuthology.orchestra.run.smithi155.stdout: }, 2023-08-01T19:54:23.569 INFO:teuthology.orchestra.run.smithi155.stdout: { 2023-08-01T19:54:23.569 INFO:teuthology.orchestra.run.smithi155.stdout: "event": "all_read", 2023-08-01T19:54:23.569 INFO:teuthology.orchestra.run.smithi155.stdout: "time": "2023-08-01T19:54:04.459517+0000", 2023-08-01T19:54:23.570 INFO:teuthology.orchestra.run.smithi155.stdout: "duration": 8.3809999999999999e-06 2023-08-01T19:54:23.570 INFO:teuthology.orchestra.run.smithi155.stdout: }, 2023-08-01T19:54:23.570 INFO:teuthology.orchestra.run.smithi155.stdout: { 2023-08-01T19:54:23.570 INFO:teuthology.orchestra.run.smithi155.stdout: "event": "dispatched", 2023-08-01T19:54:23.570 INFO:teuthology.orchestra.run.smithi155.stdout: "time": "2023-08-01T19:54:04.459529+0000", 2023-08-01T19:54:23.570 INFO:teuthology.orchestra.run.smithi155.stdout: "duration": 1.146e-05 2023-08-01T19:54:23.570 INFO:teuthology.orchestra.run.smithi155.stdout: }, 2023-08-01T19:54:23.571 INFO:teuthology.orchestra.run.smithi155.stdout: { 2023-08-01T19:54:23.571 INFO:teuthology.orchestra.run.smithi155.stdout: "event": "queued_for_pg", 2023-08-01T19:54:23.571 INFO:teuthology.orchestra.run.smithi155.stdout: "time": "2023-08-01T19:54:04.459537+0000", 2023-08-01T19:54:23.571 INFO:teuthology.orchestra.run.smithi155.stdout: "duration": 8.0409999999999998e-06 2023-08-01T19:54:23.571 INFO:teuthology.orchestra.run.smithi155.stdout: }, 2023-08-01T19:54:23.571 INFO:teuthology.orchestra.run.smithi155.stdout: { 2023-08-01T19:54:23.571 INFO:teuthology.orchestra.run.smithi155.stdout: "event": "reached_pg", 2023-08-01T19:54:23.571 INFO:teuthology.orchestra.run.smithi155.stdout: "time": "2023-08-01T19:54:04.462056+0000", 2023-08-01T19:54:23.572 INFO:teuthology.orchestra.run.smithi155.stdout: "duration": 0.0025196620000000002 2023-08-01T19:54:23.572 INFO:teuthology.orchestra.run.smithi155.stdout: }, 2023-08-01T19:54:23.572 INFO:teuthology.orchestra.run.smithi155.stdout: { 2023-08-01T19:54:23.572 INFO:teuthology.orchestra.run.smithi155.stdout: "event": "started", 2023-08-01T19:54:23.572 INFO:teuthology.orchestra.run.smithi155.stdout: "time": "2023-08-01T19:54:04.462133+0000", 2023-08-01T19:54:23.572 INFO:teuthology.orchestra.run.smithi155.stdout: "duration": 7.6328999999999994e-05 2023-08-01T19:54:23.572 INFO:teuthology.orchestra.run.smithi155.stdout: }, 2023-08-01T19:54:23.573 INFO:teuthology.orchestra.run.smithi155.stdout: { 2023-08-01T19:54:23.573 INFO:teuthology.orchestra.run.smithi155.stdout: "event": "waiting for subops from 1", 2023-08-01T19:54:23.573 INFO:teuthology.orchestra.run.smithi155.stdout: "time": "2023-08-01T19:54:04.462310+0000", 2023-08-01T19:54:23.573 INFO:teuthology.orchestra.run.smithi155.stdout: "duration": 0.000177369 2023-08-01T19:54:23.573 INFO:teuthology.orchestra.run.smithi155.stdout: }, 2023-08-01T19:54:23.573 INFO:teuthology.orchestra.run.smithi155.stdout: { 2023-08-01T19:54:23.573 INFO:teuthology.orchestra.run.smithi155.stdout: "event": "op_commit", 2023-08-01T19:54:23.574 INFO:teuthology.orchestra.run.smithi155.stdout: "time": "2023-08-01T19:54:04.464364+0000", 2023-08-01T19:54:23.574 INFO:teuthology.orchestra.run.smithi155.stdout: "duration": 0.0020535089999999998 2023-08-01T19:54:23.574 INFO:teuthology.orchestra.run.smithi155.stdout: }, 2023-08-01T19:54:23.574 INFO:teuthology.orchestra.run.smithi155.stdout: { 2023-08-01T19:54:23.574 INFO:teuthology.orchestra.run.smithi155.stdout: "event": "sub_op_commit_rec", 2023-08-01T19:54:23.574 INFO:teuthology.orchestra.run.smithi155.stdout: "time": "2023-08-01T19:54:04.471322+0000", 2023-08-01T19:54:23.574 INFO:teuthology.orchestra.run.smithi155.stdout: "duration": 0.0069579969999999996 2023-08-01T19:54:23.575 INFO:teuthology.orchestra.run.smithi155.stdout: }, 2023-08-01T19:54:23.575 INFO:teuthology.orchestra.run.smithi155.stdout: { 2023-08-01T19:54:23.575 INFO:teuthology.orchestra.run.smithi155.stdout: "event": "commit_sent", 2023-08-01T19:54:23.575 INFO:teuthology.orchestra.run.smithi155.stdout: "time": "2023-08-01T19:54:04.471366+0000", 2023-08-01T19:54:23.575 INFO:teuthology.orchestra.run.smithi155.stdout: "duration": 4.4750999999999999e-05 2023-08-01T19:54:23.575 INFO:teuthology.orchestra.run.smithi155.stdout: }, 2023-08-01T19:54:23.575 INFO:teuthology.orchestra.run.smithi155.stdout: { 2023-08-01T19:54:23.575 INFO:teuthology.orchestra.run.smithi155.stdout: "event": "done", 2023-08-01T19:54:23.576 INFO:teuthology.orchestra.run.smithi155.stdout: "time": "2023-08-01T19:54:04.471401+0000", 2023-08-01T19:54:23.576 INFO:teuthology.orchestra.run.smithi155.stdout: "duration": 3.4743999999999998e-05 2023-08-01T19:54:23.576 INFO:teuthology.orchestra.run.smithi155.stdout: } 2023-08-01T19:54:23.576 INFO:teuthology.orchestra.run.smithi155.stdout: ] 2023-08-01T19:54:23.576 INFO:teuthology.orchestra.run.smithi155.stdout: } 2023-08-01T19:54:23.576 INFO:teuthology.orchestra.run.smithi155.stdout: }, 2023-08-01T19:54:23.576 INFO:teuthology.orchestra.run.smithi155.stdout: { 2023-08-01T19:54:23.577 INFO:teuthology.orchestra.run.smithi155.stdout: "description": "osd_op(mds.0.3:16 3.1d 3:b871830b:::605.00000000:head [omap-set-header] snapc 0=[] ondisk+write+known_if_redirected+full_force+supports_pool_eio e17)", 2023-08-01T19:54:23.577 INFO:teuthology.orchestra.run.smithi155.stdout: "initiated_at": "2023-08-01T19:54:04.459543+0000", 2023-08-01T19:54:23.577 INFO:teuthology.orchestra.run.smithi155.stdout: "age": 19.007615704999999, 2023-08-01T19:54:23.577 INFO:teuthology.orchestra.run.smithi155.stdout: "duration": 0.011986751, 2023-08-01T19:54:23.577 INFO:teuthology.orchestra.run.smithi155.stdout: "type_data": { 2023-08-01T19:54:23.577 INFO:teuthology.orchestra.run.smithi155.stdout: "flag_point": "commit sent; apply or cleanup", 2023-08-01T19:54:23.577 INFO:teuthology.orchestra.run.smithi155.stdout: "events": [ 2023-08-01T19:54:23.578 INFO:teuthology.orchestra.run.smithi155.stdout: { 2023-08-01T19:54:23.578 INFO:teuthology.orchestra.run.smithi155.stdout: "event": "initiated", 2023-08-01T19:54:23.578 INFO:teuthology.orchestra.run.smithi155.stdout: "time": "2023-08-01T19:54:04.459543+0000", 2023-08-01T19:54:23.578 INFO:teuthology.orchestra.run.smithi155.stdout: "duration": 0 2023-08-01T19:54:23.578 INFO:teuthology.orchestra.run.smithi155.stdout: }, 2023-08-01T19:54:23.578 INFO:teuthology.orchestra.run.smithi155.stdout: { 2023-08-01T19:54:23.578 INFO:teuthology.orchestra.run.smithi155.stdout: "event": "throttled", 2023-08-01T19:54:23.579 INFO:teuthology.orchestra.run.smithi155.stdout: "time": "2023-08-01T19:54:04.459543+0000", 2023-08-01T19:54:23.579 INFO:teuthology.orchestra.run.smithi155.stdout: "duration": 0 2023-08-01T19:54:23.579 INFO:teuthology.orchestra.run.smithi155.stdout: }, 2023-08-01T19:54:23.579 INFO:teuthology.orchestra.run.smithi155.stdout: { 2023-08-01T19:54:23.579 INFO:teuthology.orchestra.run.smithi155.stdout: "event": "header_read", 2023-08-01T19:54:23.579 INFO:teuthology.orchestra.run.smithi155.stdout: "time": "2023-08-01T19:54:04.459542+0000", 2023-08-01T19:54:23.579 INFO:teuthology.orchestra.run.smithi155.stdout: "duration": 4294967295.9999995 2023-08-01T19:54:23.580 INFO:teuthology.orchestra.run.smithi155.stdout: }, 2023-08-01T19:54:23.580 INFO:teuthology.orchestra.run.smithi155.stdout: { 2023-08-01T19:54:23.580 INFO:teuthology.orchestra.run.smithi155.stdout: "event": "all_read", 2023-08-01T19:54:23.580 INFO:teuthology.orchestra.run.smithi155.stdout: "time": "2023-08-01T19:54:04.459547+0000", 2023-08-01T19:54:23.580 INFO:teuthology.orchestra.run.smithi155.stdout: "duration": 4.3000000000000003e-06 2023-08-01T19:54:23.580 INFO:teuthology.orchestra.run.smithi155.stdout: }, 2023-08-01T19:54:23.580 INFO:teuthology.orchestra.run.smithi155.stdout: { 2023-08-01T19:54:23.581 INFO:teuthology.orchestra.run.smithi155.stdout: "event": "dispatched", 2023-08-01T19:54:23.581 INFO:teuthology.orchestra.run.smithi155.stdout: "time": "2023-08-01T19:54:04.459553+0000", 2023-08-01T19:54:23.581 INFO:teuthology.orchestra.run.smithi155.stdout: "duration": 6.4420000000000003e-06 2023-08-01T19:54:23.581 INFO:teuthology.orchestra.run.smithi155.stdout: }, 2023-08-01T19:54:23.581 INFO:teuthology.orchestra.run.smithi155.stdout: { 2023-08-01T19:54:23.581 INFO:teuthology.orchestra.run.smithi155.stdout: "event": "queued_for_pg", 2023-08-01T19:54:23.581 INFO:teuthology.orchestra.run.smithi155.stdout: "time": "2023-08-01T19:54:04.459558+0000", 2023-08-01T19:54:23.581 INFO:teuthology.orchestra.run.smithi155.stdout: "duration": 4.5199999999999999e-06 2023-08-01T19:54:23.582 INFO:teuthology.orchestra.run.smithi155.stdout: }, 2023-08-01T19:54:23.582 INFO:teuthology.orchestra.run.smithi155.stdout: { 2023-08-01T19:54:23.582 INFO:teuthology.orchestra.run.smithi155.stdout: "event": "reached_pg", 2023-08-01T19:54:23.582 INFO:teuthology.orchestra.run.smithi155.stdout: "time": "2023-08-01T19:54:04.462045+0000", 2023-08-01T19:54:23.582 INFO:teuthology.orchestra.run.smithi155.stdout: "duration": 0.0024870090000000001 2023-08-01T19:54:23.582 INFO:teuthology.orchestra.run.smithi155.stdout: }, 2023-08-01T19:54:23.582 INFO:teuthology.orchestra.run.smithi155.stdout: { 2023-08-01T19:54:23.583 INFO:teuthology.orchestra.run.smithi155.stdout: "event": "started", 2023-08-01T19:54:23.583 INFO:teuthology.orchestra.run.smithi155.stdout: "time": "2023-08-01T19:54:04.462158+0000", 2023-08-01T19:54:23.583 INFO:teuthology.orchestra.run.smithi155.stdout: "duration": 0.000113174 2023-08-01T19:54:23.583 INFO:teuthology.orchestra.run.smithi155.stdout: }, 2023-08-01T19:54:23.583 INFO:teuthology.orchestra.run.smithi155.stdout: { 2023-08-01T19:54:23.583 INFO:teuthology.orchestra.run.smithi155.stdout: "event": "waiting for subops from 1", 2023-08-01T19:54:23.583 INFO:teuthology.orchestra.run.smithi155.stdout: "time": "2023-08-01T19:54:04.462309+0000", 2023-08-01T19:54:23.584 INFO:teuthology.orchestra.run.smithi155.stdout: "duration": 0.00015103800000000001 2023-08-01T19:54:23.584 INFO:teuthology.orchestra.run.smithi155.stdout: }, 2023-08-01T19:54:23.584 INFO:teuthology.orchestra.run.smithi155.stdout: { 2023-08-01T19:54:23.584 INFO:teuthology.orchestra.run.smithi155.stdout: "event": "op_commit", 2023-08-01T19:54:23.584 INFO:teuthology.orchestra.run.smithi155.stdout: "time": "2023-08-01T19:54:04.464428+0000", 2023-08-01T19:54:23.584 INFO:teuthology.orchestra.run.smithi155.stdout: "duration": 0.0021189960000000002 2023-08-01T19:54:23.584 INFO:teuthology.orchestra.run.smithi155.stdout: }, 2023-08-01T19:54:23.585 INFO:teuthology.orchestra.run.smithi155.stdout: { 2023-08-01T19:54:23.585 INFO:teuthology.orchestra.run.smithi155.stdout: "event": "sub_op_commit_rec", 2023-08-01T19:54:23.585 INFO:teuthology.orchestra.run.smithi155.stdout: "time": "2023-08-01T19:54:04.471448+0000", 2023-08-01T19:54:23.585 INFO:teuthology.orchestra.run.smithi155.stdout: "duration": 0.0070201899999999999 2023-08-01T19:54:23.585 INFO:teuthology.orchestra.run.smithi155.stdout: }, 2023-08-01T19:54:23.585 INFO:teuthology.orchestra.run.smithi155.stdout: { 2023-08-01T19:54:23.585 INFO:teuthology.orchestra.run.smithi155.stdout: "event": "commit_sent", 2023-08-01T19:54:23.586 INFO:teuthology.orchestra.run.smithi155.stdout: "time": "2023-08-01T19:54:04.471493+0000", 2023-08-01T19:54:23.586 INFO:teuthology.orchestra.run.smithi155.stdout: "duration": 4.4681999999999997e-05 2023-08-01T19:54:23.586 INFO:teuthology.orchestra.run.smithi155.stdout: }, 2023-08-01T19:54:23.586 INFO:teuthology.orchestra.run.smithi155.stdout: { 2023-08-01T19:54:23.586 INFO:teuthology.orchestra.run.smithi155.stdout: "event": "done", 2023-08-01T19:54:23.586 INFO:teuthology.orchestra.run.smithi155.stdout: "time": "2023-08-01T19:54:04.471530+0000", 2023-08-01T19:54:23.586 INFO:teuthology.orchestra.run.smithi155.stdout: "duration": 3.6882999999999999e-05 2023-08-01T19:54:23.586 INFO:teuthology.orchestra.run.smithi155.stdout: } 2023-08-01T19:54:23.587 INFO:teuthology.orchestra.run.smithi155.stdout: ] 2023-08-01T19:54:23.587 INFO:teuthology.orchestra.run.smithi155.stdout: } 2023-08-01T19:54:23.587 INFO:teuthology.orchestra.run.smithi155.stdout: }, 2023-08-01T19:54:23.587 INFO:teuthology.orchestra.run.smithi155.stdout: { 2023-08-01T19:54:23.587 INFO:teuthology.orchestra.run.smithi155.stdout: "description": "osd_op(mds.0.3:17 3.1d 3:b871830b:::605.00000000:head [create,setxattr parent (62) in=6b,setxattr layout (30) in=6b] snapc 0=[] ondisk+write+known_if_redirected+full_force+supports_pool_eio e17)", 2023-08-01T19:54:23.587 INFO:teuthology.orchestra.run.smithi155.stdout: "initiated_at": "2023-08-01T19:54:04.459564+0000", 2023-08-01T19:54:23.587 INFO:teuthology.orchestra.run.smithi155.stdout: "age": 19.007594906000001, 2023-08-01T19:54:23.588 INFO:teuthology.orchestra.run.smithi155.stdout: "duration": 0.012103172000000001, 2023-08-01T19:54:23.588 INFO:teuthology.orchestra.run.smithi155.stdout: "type_data": { 2023-08-01T19:54:23.588 INFO:teuthology.orchestra.run.smithi155.stdout: "flag_point": "commit sent; apply or cleanup", 2023-08-01T19:54:23.588 INFO:teuthology.orchestra.run.smithi155.stdout: "events": [ 2023-08-01T19:54:23.588 INFO:teuthology.orchestra.run.smithi155.stdout: { 2023-08-01T19:54:23.588 INFO:teuthology.orchestra.run.smithi155.stdout: "event": "initiated", 2023-08-01T19:54:23.588 INFO:teuthology.orchestra.run.smithi155.stdout: "time": "2023-08-01T19:54:04.459564+0000", 2023-08-01T19:54:23.589 INFO:teuthology.orchestra.run.smithi155.stdout: "duration": 0 2023-08-01T19:54:23.589 INFO:teuthology.orchestra.run.smithi155.stdout: }, 2023-08-01T19:54:23.589 INFO:teuthology.orchestra.run.smithi155.stdout: { 2023-08-01T19:54:23.589 INFO:teuthology.orchestra.run.smithi155.stdout: "event": "throttled", 2023-08-01T19:54:23.589 INFO:teuthology.orchestra.run.smithi155.stdout: "time": "2023-08-01T19:54:04.459564+0000", 2023-08-01T19:54:23.589 INFO:teuthology.orchestra.run.smithi155.stdout: "duration": 0 2023-08-01T19:54:23.589 INFO:teuthology.orchestra.run.smithi155.stdout: }, 2023-08-01T19:54:23.590 INFO:teuthology.orchestra.run.smithi155.stdout: { 2023-08-01T19:54:23.590 INFO:teuthology.orchestra.run.smithi155.stdout: "event": "header_read", 2023-08-01T19:54:23.590 INFO:teuthology.orchestra.run.smithi155.stdout: "time": "2023-08-01T19:54:04.459563+0000", 2023-08-01T19:54:23.590 INFO:teuthology.orchestra.run.smithi155.stdout: "duration": 4294967295.9999995 2023-08-01T19:54:23.590 INFO:teuthology.orchestra.run.smithi155.stdout: }, 2023-08-01T19:54:23.590 INFO:teuthology.orchestra.run.smithi155.stdout: { 2023-08-01T19:54:23.590 INFO:teuthology.orchestra.run.smithi155.stdout: "event": "all_read", 2023-08-01T19:54:23.591 INFO:teuthology.orchestra.run.smithi155.stdout: "time": "2023-08-01T19:54:04.459567+0000", 2023-08-01T19:54:23.591 INFO:teuthology.orchestra.run.smithi155.stdout: "duration": 3.3349999999999998e-06 2023-08-01T19:54:23.591 INFO:teuthology.orchestra.run.smithi155.stdout: }, 2023-08-01T19:54:23.591 INFO:teuthology.orchestra.run.smithi155.stdout: { 2023-08-01T19:54:23.591 INFO:teuthology.orchestra.run.smithi155.stdout: "event": "dispatched", 2023-08-01T19:54:23.591 INFO:teuthology.orchestra.run.smithi155.stdout: "time": "2023-08-01T19:54:04.459575+0000", 2023-08-01T19:54:23.591 INFO:teuthology.orchestra.run.smithi155.stdout: "duration": 8.1610000000000003e-06 2023-08-01T19:54:23.591 INFO:teuthology.orchestra.run.smithi155.stdout: }, 2023-08-01T19:54:23.592 INFO:teuthology.orchestra.run.smithi155.stdout: { 2023-08-01T19:54:23.592 INFO:teuthology.orchestra.run.smithi155.stdout: "event": "queued_for_pg", 2023-08-01T19:54:23.592 INFO:teuthology.orchestra.run.smithi155.stdout: "time": "2023-08-01T19:54:04.459587+0000", 2023-08-01T19:54:23.592 INFO:teuthology.orchestra.run.smithi155.stdout: "duration": 1.2463000000000001e-05 2023-08-01T19:54:23.592 INFO:teuthology.orchestra.run.smithi155.stdout: }, 2023-08-01T19:54:23.592 INFO:teuthology.orchestra.run.smithi155.stdout: { 2023-08-01T19:54:23.592 INFO:teuthology.orchestra.run.smithi155.stdout: "event": "reached_pg", 2023-08-01T19:54:23.593 INFO:teuthology.orchestra.run.smithi155.stdout: "time": "2023-08-01T19:54:04.463155+0000", 2023-08-01T19:54:23.593 INFO:teuthology.orchestra.run.smithi155.stdout: "duration": 0.0035676890000000002 2023-08-01T19:54:23.593 INFO:teuthology.orchestra.run.smithi155.stdout: }, 2023-08-01T19:54:23.593 INFO:teuthology.orchestra.run.smithi155.stdout: { 2023-08-01T19:54:23.593 INFO:teuthology.orchestra.run.smithi155.stdout: "event": "started", 2023-08-01T19:54:23.593 INFO:teuthology.orchestra.run.smithi155.stdout: "time": "2023-08-01T19:54:04.463240+0000", 2023-08-01T19:54:23.593 INFO:teuthology.orchestra.run.smithi155.stdout: "duration": 8.4538999999999998e-05 2023-08-01T19:54:23.594 INFO:teuthology.orchestra.run.smithi155.stdout: }, 2023-08-01T19:54:23.594 INFO:teuthology.orchestra.run.smithi155.stdout: { 2023-08-01T19:54:23.594 INFO:teuthology.orchestra.run.smithi155.stdout: "event": "waiting for subops from 1", 2023-08-01T19:54:23.594 INFO:teuthology.orchestra.run.smithi155.stdout: "time": "2023-08-01T19:54:04.463328+0000", 2023-08-01T19:54:23.594 INFO:teuthology.orchestra.run.smithi155.stdout: "duration": 8.8562999999999999e-05 2023-08-01T19:54:23.594 INFO:teuthology.orchestra.run.smithi155.stdout: }, 2023-08-01T19:54:23.594 INFO:teuthology.orchestra.run.smithi155.stdout: { 2023-08-01T19:54:23.595 INFO:teuthology.orchestra.run.smithi155.stdout: "event": "op_commit", 2023-08-01T19:54:23.595 INFO:teuthology.orchestra.run.smithi155.stdout: "time": "2023-08-01T19:54:04.464445+0000", 2023-08-01T19:54:23.595 INFO:teuthology.orchestra.run.smithi155.stdout: "duration": 0.0011171779999999999 2023-08-01T19:54:23.595 INFO:teuthology.orchestra.run.smithi155.stdout: }, 2023-08-01T19:54:23.595 INFO:teuthology.orchestra.run.smithi155.stdout: { 2023-08-01T19:54:23.595 INFO:teuthology.orchestra.run.smithi155.stdout: "event": "sub_op_commit_rec", 2023-08-01T19:54:23.595 INFO:teuthology.orchestra.run.smithi155.stdout: "time": "2023-08-01T19:54:04.471567+0000", 2023-08-01T19:54:23.596 INFO:teuthology.orchestra.run.smithi155.stdout: "duration": 0.0071217479999999998 2023-08-01T19:54:23.596 INFO:teuthology.orchestra.run.smithi155.stdout: }, 2023-08-01T19:54:23.596 INFO:teuthology.orchestra.run.smithi155.stdout: { 2023-08-01T19:54:23.596 INFO:teuthology.orchestra.run.smithi155.stdout: "event": "commit_sent", 2023-08-01T19:54:23.596 INFO:teuthology.orchestra.run.smithi155.stdout: "time": "2023-08-01T19:54:04.471621+0000", 2023-08-01T19:54:23.596 INFO:teuthology.orchestra.run.smithi155.stdout: "duration": 5.4228000000000003e-05 2023-08-01T19:54:23.596 INFO:teuthology.orchestra.run.smithi155.stdout: }, 2023-08-01T19:54:23.596 INFO:teuthology.orchestra.run.smithi155.stdout: { 2023-08-01T19:54:23.597 INFO:teuthology.orchestra.run.smithi155.stdout: "event": "done", 2023-08-01T19:54:23.597 INFO:teuthology.orchestra.run.smithi155.stdout: "time": "2023-08-01T19:54:04.471667+0000", 2023-08-01T19:54:23.597 INFO:teuthology.orchestra.run.smithi155.stdout: "duration": 4.5686999999999998e-05 2023-08-01T19:54:23.597 INFO:teuthology.orchestra.run.smithi155.stdout: } 2023-08-01T19:54:23.597 INFO:teuthology.orchestra.run.smithi155.stdout: ] 2023-08-01T19:54:23.597 INFO:teuthology.orchestra.run.smithi155.stdout: } 2023-08-01T19:54:23.597 INFO:teuthology.orchestra.run.smithi155.stdout: }, 2023-08-01T19:54:23.598 INFO:teuthology.orchestra.run.smithi155.stdout: { 2023-08-01T19:54:23.598 INFO:teuthology.orchestra.run.smithi155.stdout: "description": "osd_op(mds.0.3:22 3.e 3:717a0223:::608.00000000:head [omap-set-header] snapc 0=[] ondisk+write+known_if_redirected+full_force+supports_pool_eio e17)", 2023-08-01T19:54:23.598 INFO:teuthology.orchestra.run.smithi155.stdout: "initiated_at": "2023-08-01T19:54:04.459594+0000", 2023-08-01T19:54:23.598 INFO:teuthology.orchestra.run.smithi155.stdout: "age": 19.007564689999999, 2023-08-01T19:54:23.598 INFO:teuthology.orchestra.run.smithi155.stdout: "duration": 0.011515043000000001, 2023-08-01T19:54:23.598 INFO:teuthology.orchestra.run.smithi155.stdout: "type_data": { 2023-08-01T19:54:23.598 INFO:teuthology.orchestra.run.smithi155.stdout: "flag_point": "commit sent; apply or cleanup", 2023-08-01T19:54:23.599 INFO:teuthology.orchestra.run.smithi155.stdout: "events": [ 2023-08-01T19:54:23.599 INFO:teuthology.orchestra.run.smithi155.stdout: { 2023-08-01T19:54:23.599 INFO:teuthology.orchestra.run.smithi155.stdout: "event": "initiated", 2023-08-01T19:54:23.599 INFO:teuthology.orchestra.run.smithi155.stdout: "time": "2023-08-01T19:54:04.459594+0000", 2023-08-01T19:54:23.599 INFO:teuthology.orchestra.run.smithi155.stdout: "duration": 0 2023-08-01T19:54:23.599 INFO:teuthology.orchestra.run.smithi155.stdout: }, 2023-08-01T19:54:23.599 INFO:teuthology.orchestra.run.smithi155.stdout: { 2023-08-01T19:54:23.600 INFO:teuthology.orchestra.run.smithi155.stdout: "event": "throttled", 2023-08-01T19:54:23.600 INFO:teuthology.orchestra.run.smithi155.stdout: "time": "2023-08-01T19:54:04.459594+0000", 2023-08-01T19:54:23.600 INFO:teuthology.orchestra.run.smithi155.stdout: "duration": 0 2023-08-01T19:54:23.600 INFO:teuthology.orchestra.run.smithi155.stdout: }, 2023-08-01T19:54:23.600 INFO:teuthology.orchestra.run.smithi155.stdout: { 2023-08-01T19:54:23.600 INFO:teuthology.orchestra.run.smithi155.stdout: "event": "header_read", 2023-08-01T19:54:23.600 INFO:teuthology.orchestra.run.smithi155.stdout: "time": "2023-08-01T19:54:04.459593+0000", 2023-08-01T19:54:23.601 INFO:teuthology.orchestra.run.smithi155.stdout: "duration": 4294967295.9999995 2023-08-01T19:54:23.601 INFO:teuthology.orchestra.run.smithi155.stdout: }, 2023-08-01T19:54:23.601 INFO:teuthology.orchestra.run.smithi155.stdout: { 2023-08-01T19:54:23.601 INFO:teuthology.orchestra.run.smithi155.stdout: "event": "all_read", 2023-08-01T19:54:23.601 INFO:teuthology.orchestra.run.smithi155.stdout: "time": "2023-08-01T19:54:04.459597+0000", 2023-08-01T19:54:23.601 INFO:teuthology.orchestra.run.smithi155.stdout: "duration": 3.9360000000000001e-06 2023-08-01T19:54:23.601 INFO:teuthology.orchestra.run.smithi155.stdout: }, 2023-08-01T19:54:23.601 INFO:teuthology.orchestra.run.smithi155.stdout: { 2023-08-01T19:54:23.602 INFO:teuthology.orchestra.run.smithi155.stdout: "event": "dispatched", 2023-08-01T19:54:23.602 INFO:teuthology.orchestra.run.smithi155.stdout: "time": "2023-08-01T19:54:04.459608+0000", 2023-08-01T19:54:23.602 INFO:teuthology.orchestra.run.smithi155.stdout: "duration": 1.0827e-05 2023-08-01T19:54:23.602 INFO:teuthology.orchestra.run.smithi155.stdout: }, 2023-08-01T19:54:23.602 INFO:teuthology.orchestra.run.smithi155.stdout: { 2023-08-01T19:54:23.602 INFO:teuthology.orchestra.run.smithi155.stdout: "event": "queued_for_pg", 2023-08-01T19:54:23.602 INFO:teuthology.orchestra.run.smithi155.stdout: "time": "2023-08-01T19:54:04.459613+0000", 2023-08-01T19:54:23.603 INFO:teuthology.orchestra.run.smithi155.stdout: "duration": 5.0459999999999996e-06 2023-08-01T19:54:23.603 INFO:teuthology.orchestra.run.smithi155.stdout: }, 2023-08-01T19:54:23.603 INFO:teuthology.orchestra.run.smithi155.stdout: { 2023-08-01T19:54:23.603 INFO:teuthology.orchestra.run.smithi155.stdout: "event": "reached_pg", 2023-08-01T19:54:23.603 INFO:teuthology.orchestra.run.smithi155.stdout: "time": "2023-08-01T19:54:04.461018+0000", 2023-08-01T19:54:23.603 INFO:teuthology.orchestra.run.smithi155.stdout: "duration": 0.0014048890000000001 2023-08-01T19:54:23.603 INFO:teuthology.orchestra.run.smithi155.stdout: }, 2023-08-01T19:54:23.604 INFO:teuthology.orchestra.run.smithi155.stdout: { 2023-08-01T19:54:23.604 INFO:teuthology.orchestra.run.smithi155.stdout: "event": "started", 2023-08-01T19:54:23.604 INFO:teuthology.orchestra.run.smithi155.stdout: "time": "2023-08-01T19:54:04.461203+0000", 2023-08-01T19:54:23.604 INFO:teuthology.orchestra.run.smithi155.stdout: "duration": 0.000184408 2023-08-01T19:54:23.604 INFO:teuthology.orchestra.run.smithi155.stdout: }, 2023-08-01T19:54:23.604 INFO:teuthology.orchestra.run.smithi155.stdout: { 2023-08-01T19:54:23.604 INFO:teuthology.orchestra.run.smithi155.stdout: "event": "waiting for subops from 1", 2023-08-01T19:54:23.605 INFO:teuthology.orchestra.run.smithi155.stdout: "time": "2023-08-01T19:54:04.461370+0000", 2023-08-01T19:54:23.605 INFO:teuthology.orchestra.run.smithi155.stdout: "duration": 0.00016767099999999999 2023-08-01T19:54:23.605 INFO:teuthology.orchestra.run.smithi155.stdout: }, 2023-08-01T19:54:23.605 INFO:teuthology.orchestra.run.smithi155.stdout: { 2023-08-01T19:54:23.605 INFO:teuthology.orchestra.run.smithi155.stdout: "event": "op_commit", 2023-08-01T19:54:23.605 INFO:teuthology.orchestra.run.smithi155.stdout: "time": "2023-08-01T19:54:04.463717+0000", 2023-08-01T19:54:23.605 INFO:teuthology.orchestra.run.smithi155.stdout: "duration": 0.002347142 2023-08-01T19:54:23.606 INFO:teuthology.orchestra.run.smithi155.stdout: }, 2023-08-01T19:54:23.606 INFO:teuthology.orchestra.run.smithi155.stdout: { 2023-08-01T19:54:23.606 INFO:teuthology.orchestra.run.smithi155.stdout: "event": "sub_op_commit_rec", 2023-08-01T19:54:23.606 INFO:teuthology.orchestra.run.smithi155.stdout: "time": "2023-08-01T19:54:04.471037+0000", 2023-08-01T19:54:23.606 INFO:teuthology.orchestra.run.smithi155.stdout: "duration": 0.0073200419999999997 2023-08-01T19:54:23.606 INFO:teuthology.orchestra.run.smithi155.stdout: }, 2023-08-01T19:54:23.606 INFO:teuthology.orchestra.run.smithi155.stdout: { 2023-08-01T19:54:23.606 INFO:teuthology.orchestra.run.smithi155.stdout: "event": "commit_sent", 2023-08-01T19:54:23.607 INFO:teuthology.orchestra.run.smithi155.stdout: "time": "2023-08-01T19:54:04.471074+0000", 2023-08-01T19:54:23.607 INFO:teuthology.orchestra.run.smithi155.stdout: "duration": 3.6820000000000003e-05 2023-08-01T19:54:23.607 INFO:teuthology.orchestra.run.smithi155.stdout: }, 2023-08-01T19:54:23.607 INFO:teuthology.orchestra.run.smithi155.stdout: { 2023-08-01T19:54:23.607 INFO:teuthology.orchestra.run.smithi155.stdout: "event": "done", 2023-08-01T19:54:23.607 INFO:teuthology.orchestra.run.smithi155.stdout: "time": "2023-08-01T19:54:04.471109+0000", 2023-08-01T19:54:23.607 INFO:teuthology.orchestra.run.smithi155.stdout: "duration": 3.4783000000000002e-05 2023-08-01T19:54:23.608 INFO:teuthology.orchestra.run.smithi155.stdout: } 2023-08-01T19:54:23.608 INFO:teuthology.orchestra.run.smithi155.stdout: ] 2023-08-01T19:54:23.608 INFO:teuthology.orchestra.run.smithi155.stdout: } 2023-08-01T19:54:23.608 INFO:teuthology.orchestra.run.smithi155.stdout: }, 2023-08-01T19:54:23.608 INFO:teuthology.orchestra.run.smithi155.stdout: { 2023-08-01T19:54:23.608 INFO:teuthology.orchestra.run.smithi155.stdout: "description": "osd_op(mds.0.3:23 3.e 3:717a0223:::608.00000000:head [create,setxattr parent (62) in=6b,setxattr layout (30) in=6b] snapc 0=[] ondisk+write+known_if_redirected+full_force+supports_pool_eio e17)", 2023-08-01T19:54:23.608 INFO:teuthology.orchestra.run.smithi155.stdout: "initiated_at": "2023-08-01T19:54:04.460009+0000", 2023-08-01T19:54:23.609 INFO:teuthology.orchestra.run.smithi155.stdout: "age": 19.007149286000001, 2023-08-01T19:54:23.609 INFO:teuthology.orchestra.run.smithi155.stdout: "duration": 0.011282011, 2023-08-01T19:54:23.609 INFO:teuthology.orchestra.run.smithi155.stdout: "type_data": { 2023-08-01T19:54:23.609 INFO:teuthology.orchestra.run.smithi155.stdout: "flag_point": "commit sent; apply or cleanup", 2023-08-01T19:54:23.609 INFO:teuthology.orchestra.run.smithi155.stdout: "events": [ 2023-08-01T19:54:23.609 INFO:teuthology.orchestra.run.smithi155.stdout: { 2023-08-01T19:54:23.609 INFO:teuthology.orchestra.run.smithi155.stdout: "event": "initiated", 2023-08-01T19:54:23.610 INFO:teuthology.orchestra.run.smithi155.stdout: "time": "2023-08-01T19:54:04.460009+0000", 2023-08-01T19:54:23.610 INFO:teuthology.orchestra.run.smithi155.stdout: "duration": 0 2023-08-01T19:54:23.610 INFO:teuthology.orchestra.run.smithi155.stdout: }, 2023-08-01T19:54:23.610 INFO:teuthology.orchestra.run.smithi155.stdout: { 2023-08-01T19:54:23.610 INFO:teuthology.orchestra.run.smithi155.stdout: "event": "throttled", 2023-08-01T19:54:23.610 INFO:teuthology.orchestra.run.smithi155.stdout: "time": "2023-08-01T19:54:04.460009+0000", 2023-08-01T19:54:23.610 INFO:teuthology.orchestra.run.smithi155.stdout: "duration": 0 2023-08-01T19:54:23.611 INFO:teuthology.orchestra.run.smithi155.stdout: }, 2023-08-01T19:54:23.611 INFO:teuthology.orchestra.run.smithi155.stdout: { 2023-08-01T19:54:23.611 INFO:teuthology.orchestra.run.smithi155.stdout: "event": "header_read", 2023-08-01T19:54:23.611 INFO:teuthology.orchestra.run.smithi155.stdout: "time": "2023-08-01T19:54:04.460008+0000", 2023-08-01T19:54:23.611 INFO:teuthology.orchestra.run.smithi155.stdout: "duration": 4294967295.999999 2023-08-01T19:54:23.611 INFO:teuthology.orchestra.run.smithi155.stdout: }, 2023-08-01T19:54:23.611 INFO:teuthology.orchestra.run.smithi155.stdout: { 2023-08-01T19:54:23.612 INFO:teuthology.orchestra.run.smithi155.stdout: "event": "all_read", 2023-08-01T19:54:23.612 INFO:teuthology.orchestra.run.smithi155.stdout: "time": "2023-08-01T19:54:04.460015+0000", 2023-08-01T19:54:23.612 INFO:teuthology.orchestra.run.smithi155.stdout: "duration": 6.9979999999999997e-06 2023-08-01T19:54:23.612 INFO:teuthology.orchestra.run.smithi155.stdout: }, 2023-08-01T19:54:23.612 INFO:teuthology.orchestra.run.smithi155.stdout: { 2023-08-01T19:54:23.612 INFO:teuthology.orchestra.run.smithi155.stdout: "event": "dispatched", 2023-08-01T19:54:23.612 INFO:teuthology.orchestra.run.smithi155.stdout: "time": "2023-08-01T19:54:04.460028+0000", 2023-08-01T19:54:23.612 INFO:teuthology.orchestra.run.smithi155.stdout: "duration": 1.2643000000000001e-05 2023-08-01T19:54:23.613 INFO:teuthology.orchestra.run.smithi155.stdout: }, 2023-08-01T19:54:23.613 INFO:teuthology.orchestra.run.smithi155.stdout: { 2023-08-01T19:54:23.613 INFO:teuthology.orchestra.run.smithi155.stdout: "event": "queued_for_pg", 2023-08-01T19:54:23.613 INFO:teuthology.orchestra.run.smithi155.stdout: "time": "2023-08-01T19:54:04.460035+0000", 2023-08-01T19:54:23.613 INFO:teuthology.orchestra.run.smithi155.stdout: "duration": 6.9759999999999998e-06 2023-08-01T19:54:23.613 INFO:teuthology.orchestra.run.smithi155.stdout: }, 2023-08-01T19:54:23.613 INFO:teuthology.orchestra.run.smithi155.stdout: { 2023-08-01T19:54:23.614 INFO:teuthology.orchestra.run.smithi155.stdout: "event": "reached_pg", 2023-08-01T19:54:23.614 INFO:teuthology.orchestra.run.smithi155.stdout: "time": "2023-08-01T19:54:04.461996+0000", 2023-08-01T19:54:23.614 INFO:teuthology.orchestra.run.smithi155.stdout: "duration": 0.0019604069999999999 2023-08-01T19:54:23.614 INFO:teuthology.orchestra.run.smithi155.stdout: }, 2023-08-01T19:54:23.614 INFO:teuthology.orchestra.run.smithi155.stdout: { 2023-08-01T19:54:23.614 INFO:teuthology.orchestra.run.smithi155.stdout: "event": "started", 2023-08-01T19:54:23.614 INFO:teuthology.orchestra.run.smithi155.stdout: "time": "2023-08-01T19:54:04.462085+0000", 2023-08-01T19:54:23.615 INFO:teuthology.orchestra.run.smithi155.stdout: "duration": 8.9611999999999995e-05 2023-08-01T19:54:23.615 INFO:teuthology.orchestra.run.smithi155.stdout: }, 2023-08-01T19:54:23.615 INFO:teuthology.orchestra.run.smithi155.stdout: { 2023-08-01T19:54:23.615 INFO:teuthology.orchestra.run.smithi155.stdout: "event": "waiting for subops from 1", 2023-08-01T19:54:23.615 INFO:teuthology.orchestra.run.smithi155.stdout: "time": "2023-08-01T19:54:04.462253+0000", 2023-08-01T19:54:23.615 INFO:teuthology.orchestra.run.smithi155.stdout: "duration": 0.00016825499999999999 2023-08-01T19:54:23.615 INFO:teuthology.orchestra.run.smithi155.stdout: }, 2023-08-01T19:54:23.616 INFO:teuthology.orchestra.run.smithi155.stdout: { 2023-08-01T19:54:23.616 INFO:teuthology.orchestra.run.smithi155.stdout: "event": "op_commit", 2023-08-01T19:54:23.616 INFO:teuthology.orchestra.run.smithi155.stdout: "time": "2023-08-01T19:54:04.464363+0000", 2023-08-01T19:54:23.616 INFO:teuthology.orchestra.run.smithi155.stdout: "duration": 0.0021093890000000001 2023-08-01T19:54:23.616 INFO:teuthology.orchestra.run.smithi155.stdout: }, 2023-08-01T19:54:23.616 INFO:teuthology.orchestra.run.smithi155.stdout: { 2023-08-01T19:54:23.616 INFO:teuthology.orchestra.run.smithi155.stdout: "event": "sub_op_commit_rec", 2023-08-01T19:54:23.617 INFO:teuthology.orchestra.run.smithi155.stdout: "time": "2023-08-01T19:54:04.471184+0000", 2023-08-01T19:54:23.617 INFO:teuthology.orchestra.run.smithi155.stdout: "duration": 0.0068216860000000004 2023-08-01T19:54:23.617 INFO:teuthology.orchestra.run.smithi155.stdout: }, 2023-08-01T19:54:23.617 INFO:teuthology.orchestra.run.smithi155.stdout: { 2023-08-01T19:54:23.617 INFO:teuthology.orchestra.run.smithi155.stdout: "event": "commit_sent", 2023-08-01T19:54:23.617 INFO:teuthology.orchestra.run.smithi155.stdout: "time": "2023-08-01T19:54:04.471248+0000", 2023-08-01T19:54:23.617 INFO:teuthology.orchestra.run.smithi155.stdout: "duration": 6.3287999999999994e-05 2023-08-01T19:54:23.617 INFO:teuthology.orchestra.run.smithi155.stdout: }, 2023-08-01T19:54:23.618 INFO:teuthology.orchestra.run.smithi155.stdout: { 2023-08-01T19:54:23.618 INFO:teuthology.orchestra.run.smithi155.stdout: "event": "done", 2023-08-01T19:54:23.618 INFO:teuthology.orchestra.run.smithi155.stdout: "time": "2023-08-01T19:54:04.471291+0000", 2023-08-01T19:54:23.618 INFO:teuthology.orchestra.run.smithi155.stdout: "duration": 4.3667000000000001e-05 2023-08-01T19:54:23.618 INFO:teuthology.orchestra.run.smithi155.stdout: } 2023-08-01T19:54:23.618 INFO:teuthology.orchestra.run.smithi155.stdout: ] 2023-08-01T19:54:23.618 INFO:teuthology.orchestra.run.smithi155.stdout: } 2023-08-01T19:54:23.619 INFO:teuthology.orchestra.run.smithi155.stdout: }, 2023-08-01T19:54:23.619 INFO:teuthology.orchestra.run.smithi155.stdout: { 2023-08-01T19:54:23.619 INFO:teuthology.orchestra.run.smithi155.stdout: "description": "osd_op(mds.0.3:30 3.15 3:aa448500:::500.00000000:head [writefull 0~90] snapc 0=[] ondisk+write+known_if_redirected+full_force+supports_pool_eio e17)", 2023-08-01T19:54:23.619 INFO:teuthology.orchestra.run.smithi155.stdout: "initiated_at": "2023-08-01T19:54:04.460042+0000", 2023-08-01T19:54:23.619 INFO:teuthology.orchestra.run.smithi155.stdout: "age": 19.007116993, 2023-08-01T19:54:23.619 INFO:teuthology.orchestra.run.smithi155.stdout: "duration": 0.011743254, 2023-08-01T19:54:23.619 INFO:teuthology.orchestra.run.smithi155.stdout: "type_data": { 2023-08-01T19:54:23.620 INFO:teuthology.orchestra.run.smithi155.stdout: "flag_point": "commit sent; apply or cleanup", 2023-08-01T19:54:23.620 INFO:teuthology.orchestra.run.smithi155.stdout: "events": [ 2023-08-01T19:54:23.620 INFO:teuthology.orchestra.run.smithi155.stdout: { 2023-08-01T19:54:23.620 INFO:teuthology.orchestra.run.smithi155.stdout: "event": "initiated", 2023-08-01T19:54:23.620 INFO:teuthology.orchestra.run.smithi155.stdout: "time": "2023-08-01T19:54:04.460042+0000", 2023-08-01T19:54:23.620 INFO:teuthology.orchestra.run.smithi155.stdout: "duration": 0 2023-08-01T19:54:23.620 INFO:teuthology.orchestra.run.smithi155.stdout: }, 2023-08-01T19:54:23.621 INFO:teuthology.orchestra.run.smithi155.stdout: { 2023-08-01T19:54:23.621 INFO:teuthology.orchestra.run.smithi155.stdout: "event": "throttled", 2023-08-01T19:54:23.621 INFO:teuthology.orchestra.run.smithi155.stdout: "time": "2023-08-01T19:54:04.460042+0000", 2023-08-01T19:54:23.621 INFO:teuthology.orchestra.run.smithi155.stdout: "duration": 0 2023-08-01T19:54:23.621 INFO:teuthology.orchestra.run.smithi155.stdout: }, 2023-08-01T19:54:23.621 INFO:teuthology.orchestra.run.smithi155.stdout: { 2023-08-01T19:54:23.621 INFO:teuthology.orchestra.run.smithi155.stdout: "event": "header_read", 2023-08-01T19:54:23.622 INFO:teuthology.orchestra.run.smithi155.stdout: "time": "2023-08-01T19:54:04.460041+0000", 2023-08-01T19:54:23.622 INFO:teuthology.orchestra.run.smithi155.stdout: "duration": 4294967295.9999995 2023-08-01T19:54:23.622 INFO:teuthology.orchestra.run.smithi155.stdout: }, 2023-08-01T19:54:23.622 INFO:teuthology.orchestra.run.smithi155.stdout: { 2023-08-01T19:54:23.622 INFO:teuthology.orchestra.run.smithi155.stdout: "event": "all_read", 2023-08-01T19:54:23.622 INFO:teuthology.orchestra.run.smithi155.stdout: "time": "2023-08-01T19:54:04.460046+0000", 2023-08-01T19:54:23.622 INFO:teuthology.orchestra.run.smithi155.stdout: "duration": 4.882e-06 2023-08-01T19:54:23.622 INFO:teuthology.orchestra.run.smithi155.stdout: }, 2023-08-01T19:54:23.623 INFO:teuthology.orchestra.run.smithi155.stdout: { 2023-08-01T19:54:23.623 INFO:teuthology.orchestra.run.smithi155.stdout: "event": "dispatched", 2023-08-01T19:54:23.623 INFO:teuthology.orchestra.run.smithi155.stdout: "time": "2023-08-01T19:54:04.460070+0000", 2023-08-01T19:54:23.623 INFO:teuthology.orchestra.run.smithi155.stdout: "duration": 2.3530999999999999e-05 2023-08-01T19:54:23.623 INFO:teuthology.orchestra.run.smithi155.stdout: }, 2023-08-01T19:54:23.623 INFO:teuthology.orchestra.run.smithi155.stdout: { 2023-08-01T19:54:23.623 INFO:teuthology.orchestra.run.smithi155.stdout: "event": "queued_for_pg", 2023-08-01T19:54:23.624 INFO:teuthology.orchestra.run.smithi155.stdout: "time": "2023-08-01T19:54:04.460090+0000", 2023-08-01T19:54:23.624 INFO:teuthology.orchestra.run.smithi155.stdout: "duration": 2.0349000000000001e-05 2023-08-01T19:54:23.624 INFO:teuthology.orchestra.run.smithi155.stdout: }, 2023-08-01T19:54:23.624 INFO:teuthology.orchestra.run.smithi155.stdout: { 2023-08-01T19:54:23.624 INFO:teuthology.orchestra.run.smithi155.stdout: "event": "reached_pg", 2023-08-01T19:54:23.624 INFO:teuthology.orchestra.run.smithi155.stdout: "time": "2023-08-01T19:54:04.462759+0000", 2023-08-01T19:54:23.624 INFO:teuthology.orchestra.run.smithi155.stdout: "duration": 0.0026694399999999999 2023-08-01T19:54:23.625 INFO:teuthology.orchestra.run.smithi155.stdout: }, 2023-08-01T19:54:23.625 INFO:teuthology.orchestra.run.smithi155.stdout: { 2023-08-01T19:54:23.625 INFO:teuthology.orchestra.run.smithi155.stdout: "event": "started", 2023-08-01T19:54:23.625 INFO:teuthology.orchestra.run.smithi155.stdout: "time": "2023-08-01T19:54:04.463193+0000", 2023-08-01T19:54:23.625 INFO:teuthology.orchestra.run.smithi155.stdout: "duration": 0.00043340099999999998 2023-08-01T19:54:23.625 INFO:teuthology.orchestra.run.smithi155.stdout: }, 2023-08-01T19:54:23.625 INFO:teuthology.orchestra.run.smithi155.stdout: { 2023-08-01T19:54:23.626 INFO:teuthology.orchestra.run.smithi155.stdout: "event": "waiting for subops from 1", 2023-08-01T19:54:23.626 INFO:teuthology.orchestra.run.smithi155.stdout: "time": "2023-08-01T19:54:04.463317+0000", 2023-08-01T19:54:23.626 INFO:teuthology.orchestra.run.smithi155.stdout: "duration": 0.00012457000000000001 2023-08-01T19:54:23.626 INFO:teuthology.orchestra.run.smithi155.stdout: }, 2023-08-01T19:54:23.626 INFO:teuthology.orchestra.run.smithi155.stdout: { 2023-08-01T19:54:23.626 INFO:teuthology.orchestra.run.smithi155.stdout: "event": "op_commit", 2023-08-01T19:54:23.626 INFO:teuthology.orchestra.run.smithi155.stdout: "time": "2023-08-01T19:54:04.465050+0000", 2023-08-01T19:54:23.626 INFO:teuthology.orchestra.run.smithi155.stdout: "duration": 0.001732473 2023-08-01T19:54:23.627 INFO:teuthology.orchestra.run.smithi155.stdout: }, 2023-08-01T19:54:23.627 INFO:teuthology.orchestra.run.smithi155.stdout: { 2023-08-01T19:54:23.627 INFO:teuthology.orchestra.run.smithi155.stdout: "event": "sub_op_commit_rec", 2023-08-01T19:54:23.627 INFO:teuthology.orchestra.run.smithi155.stdout: "time": "2023-08-01T19:54:04.471694+0000", 2023-08-01T19:54:23.627 INFO:teuthology.orchestra.run.smithi155.stdout: "duration": 0.006643871 2023-08-01T19:54:23.627 INFO:teuthology.orchestra.run.smithi155.stdout: }, 2023-08-01T19:54:23.627 INFO:teuthology.orchestra.run.smithi155.stdout: { 2023-08-01T19:54:23.628 INFO:teuthology.orchestra.run.smithi155.stdout: "event": "commit_sent", 2023-08-01T19:54:23.628 INFO:teuthology.orchestra.run.smithi155.stdout: "time": "2023-08-01T19:54:04.471748+0000", 2023-08-01T19:54:23.628 INFO:teuthology.orchestra.run.smithi155.stdout: "duration": 5.4008000000000002e-05 2023-08-01T19:54:23.628 INFO:teuthology.orchestra.run.smithi155.stdout: }, 2023-08-01T19:54:23.628 INFO:teuthology.orchestra.run.smithi155.stdout: { 2023-08-01T19:54:23.628 INFO:teuthology.orchestra.run.smithi155.stdout: "event": "done", 2023-08-01T19:54:23.628 INFO:teuthology.orchestra.run.smithi155.stdout: "time": "2023-08-01T19:54:04.471785+0000", 2023-08-01T19:54:23.629 INFO:teuthology.orchestra.run.smithi155.stdout: "duration": 3.7252999999999997e-05 2023-08-01T19:54:23.629 INFO:teuthology.orchestra.run.smithi155.stdout: } 2023-08-01T19:54:23.629 INFO:teuthology.orchestra.run.smithi155.stdout: ] 2023-08-01T19:54:23.629 INFO:teuthology.orchestra.run.smithi155.stdout: } 2023-08-01T19:54:23.629 INFO:teuthology.orchestra.run.smithi155.stdout: }, 2023-08-01T19:54:23.629 INFO:teuthology.orchestra.run.smithi155.stdout: { 2023-08-01T19:54:23.629 INFO:teuthology.orchestra.run.smithi155.stdout: "description": "osd_op(mds.0.3:33 3.1b 3:ddb4e4d7:::200.00000002:head [delete] snapc 0=[] ondisk+write+known_if_redirected+full_force+supports_pool_eio e17)", 2023-08-01T19:54:23.630 INFO:teuthology.orchestra.run.smithi155.stdout: "initiated_at": "2023-08-01T19:54:04.461353+0000", 2023-08-01T19:54:23.630 INFO:teuthology.orchestra.run.smithi155.stdout: "age": 19.005805873, 2023-08-01T19:54:23.630 INFO:teuthology.orchestra.run.smithi155.stdout: "duration": 0.010229175, 2023-08-01T19:54:23.630 INFO:teuthology.orchestra.run.smithi155.stdout: "type_data": { 2023-08-01T19:54:23.630 INFO:teuthology.orchestra.run.smithi155.stdout: "flag_point": "started", 2023-08-01T19:54:23.630 INFO:teuthology.orchestra.run.smithi155.stdout: "events": [ 2023-08-01T19:54:23.630 INFO:teuthology.orchestra.run.smithi155.stdout: { 2023-08-01T19:54:23.631 INFO:teuthology.orchestra.run.smithi155.stdout: "event": "initiated", 2023-08-01T19:54:23.631 INFO:teuthology.orchestra.run.smithi155.stdout: "time": "2023-08-01T19:54:04.461353+0000", 2023-08-01T19:54:23.631 INFO:teuthology.orchestra.run.smithi155.stdout: "duration": 0 2023-08-01T19:54:23.631 INFO:teuthology.orchestra.run.smithi155.stdout: }, 2023-08-01T19:54:23.631 INFO:teuthology.orchestra.run.smithi155.stdout: { 2023-08-01T19:54:23.631 INFO:teuthology.orchestra.run.smithi155.stdout: "event": "throttled", 2023-08-01T19:54:23.631 INFO:teuthology.orchestra.run.smithi155.stdout: "time": "2023-08-01T19:54:04.461353+0000", 2023-08-01T19:54:23.631 INFO:teuthology.orchestra.run.smithi155.stdout: "duration": 0 2023-08-01T19:54:23.632 INFO:teuthology.orchestra.run.smithi155.stdout: }, 2023-08-01T19:54:23.632 INFO:teuthology.orchestra.run.smithi155.stdout: { 2023-08-01T19:54:23.632 INFO:teuthology.orchestra.run.smithi155.stdout: "event": "header_read", 2023-08-01T19:54:23.632 INFO:teuthology.orchestra.run.smithi155.stdout: "time": "2023-08-01T19:54:04.461352+0000", 2023-08-01T19:54:23.632 INFO:teuthology.orchestra.run.smithi155.stdout: "duration": 4294967295.999999 2023-08-01T19:54:23.632 INFO:teuthology.orchestra.run.smithi155.stdout: }, 2023-08-01T19:54:23.632 INFO:teuthology.orchestra.run.smithi155.stdout: { 2023-08-01T19:54:23.633 INFO:teuthology.orchestra.run.smithi155.stdout: "event": "all_read", 2023-08-01T19:54:23.633 INFO:teuthology.orchestra.run.smithi155.stdout: "time": "2023-08-01T19:54:04.461357+0000", 2023-08-01T19:54:23.633 INFO:teuthology.orchestra.run.smithi155.stdout: "duration": 5.5210000000000002e-06 2023-08-01T19:54:23.633 INFO:teuthology.orchestra.run.smithi155.stdout: }, 2023-08-01T19:54:23.633 INFO:teuthology.orchestra.run.smithi155.stdout: { 2023-08-01T19:54:23.633 INFO:teuthology.orchestra.run.smithi155.stdout: "event": "dispatched", 2023-08-01T19:54:23.633 INFO:teuthology.orchestra.run.smithi155.stdout: "time": "2023-08-01T19:54:04.461368+0000", 2023-08-01T19:54:23.634 INFO:teuthology.orchestra.run.smithi155.stdout: "duration": 1.1005000000000001e-05 2023-08-01T19:54:23.634 INFO:teuthology.orchestra.run.smithi155.stdout: }, 2023-08-01T19:54:23.634 INFO:teuthology.orchestra.run.smithi155.stdout: { 2023-08-01T19:54:23.634 INFO:teuthology.orchestra.run.smithi155.stdout: "event": "queued_for_pg", 2023-08-01T19:54:23.634 INFO:teuthology.orchestra.run.smithi155.stdout: "time": "2023-08-01T19:54:04.461375+0000", 2023-08-01T19:54:23.634 INFO:teuthology.orchestra.run.smithi155.stdout: "duration": 6.5749999999999997e-06 2023-08-01T19:54:23.634 INFO:teuthology.orchestra.run.smithi155.stdout: }, 2023-08-01T19:54:23.635 INFO:teuthology.orchestra.run.smithi155.stdout: { 2023-08-01T19:54:23.635 INFO:teuthology.orchestra.run.smithi155.stdout: "event": "reached_pg", 2023-08-01T19:54:23.635 INFO:teuthology.orchestra.run.smithi155.stdout: "time": "2023-08-01T19:54:04.462224+0000", 2023-08-01T19:54:23.635 INFO:teuthology.orchestra.run.smithi155.stdout: "duration": 0.000849156 2023-08-01T19:54:23.635 INFO:teuthology.orchestra.run.smithi155.stdout: }, 2023-08-01T19:54:23.635 INFO:teuthology.orchestra.run.smithi155.stdout: { 2023-08-01T19:54:23.635 INFO:teuthology.orchestra.run.smithi155.stdout: "event": "started", 2023-08-01T19:54:23.636 INFO:teuthology.orchestra.run.smithi155.stdout: "time": "2023-08-01T19:54:04.462452+0000", 2023-08-01T19:54:23.636 INFO:teuthology.orchestra.run.smithi155.stdout: "duration": 0.000228416 2023-08-01T19:54:23.636 INFO:teuthology.orchestra.run.smithi155.stdout: }, 2023-08-01T19:54:23.636 INFO:teuthology.orchestra.run.smithi155.stdout: { 2023-08-01T19:54:23.636 INFO:teuthology.orchestra.run.smithi155.stdout: "event": "done", 2023-08-01T19:54:23.636 INFO:teuthology.orchestra.run.smithi155.stdout: "time": "2023-08-01T19:54:04.471582+0000", 2023-08-01T19:54:23.636 INFO:teuthology.orchestra.run.smithi155.stdout: "duration": 0.0091295119999999993 2023-08-01T19:54:23.637 INFO:teuthology.orchestra.run.smithi155.stdout: } 2023-08-01T19:54:23.637 INFO:teuthology.orchestra.run.smithi155.stdout: ] 2023-08-01T19:54:23.637 INFO:teuthology.orchestra.run.smithi155.stdout: } 2023-08-01T19:54:23.637 INFO:teuthology.orchestra.run.smithi155.stdout: }, 2023-08-01T19:54:23.637 INFO:teuthology.orchestra.run.smithi155.stdout: { 2023-08-01T19:54:23.637 INFO:teuthology.orchestra.run.smithi155.stdout: "description": "osd_op(mds.0.3:36 3.1a 3:5e41ab69:::200.00000005:head [delete] snapc 0=[] ondisk+write+known_if_redirected+full_force+supports_pool_eio e17)", 2023-08-01T19:54:23.637 INFO:teuthology.orchestra.run.smithi155.stdout: "initiated_at": "2023-08-01T19:54:04.461467+0000", 2023-08-01T19:54:23.637 INFO:teuthology.orchestra.run.smithi155.stdout: "age": 19.005691893000002, 2023-08-01T19:54:23.638 INFO:teuthology.orchestra.run.smithi155.stdout: "duration": 0.011682883, 2023-08-01T19:54:23.638 INFO:teuthology.orchestra.run.smithi155.stdout: "type_data": { 2023-08-01T19:54:23.638 INFO:teuthology.orchestra.run.smithi155.stdout: "flag_point": "started", 2023-08-01T19:54:23.638 INFO:teuthology.orchestra.run.smithi155.stdout: "events": [ 2023-08-01T19:54:23.638 INFO:teuthology.orchestra.run.smithi155.stdout: { 2023-08-01T19:54:23.638 INFO:teuthology.orchestra.run.smithi155.stdout: "event": "initiated", 2023-08-01T19:54:23.638 INFO:teuthology.orchestra.run.smithi155.stdout: "time": "2023-08-01T19:54:04.461467+0000", 2023-08-01T19:54:23.639 INFO:teuthology.orchestra.run.smithi155.stdout: "duration": 0 2023-08-01T19:54:23.639 INFO:teuthology.orchestra.run.smithi155.stdout: }, 2023-08-01T19:54:23.639 INFO:teuthology.orchestra.run.smithi155.stdout: { 2023-08-01T19:54:23.639 INFO:teuthology.orchestra.run.smithi155.stdout: "event": "throttled", 2023-08-01T19:54:23.639 INFO:teuthology.orchestra.run.smithi155.stdout: "time": "2023-08-01T19:54:04.461467+0000", 2023-08-01T19:54:23.639 INFO:teuthology.orchestra.run.smithi155.stdout: "duration": 0 2023-08-01T19:54:23.639 INFO:teuthology.orchestra.run.smithi155.stdout: }, 2023-08-01T19:54:23.640 INFO:teuthology.orchestra.run.smithi155.stdout: { 2023-08-01T19:54:23.640 INFO:teuthology.orchestra.run.smithi155.stdout: "event": "header_read", 2023-08-01T19:54:23.640 INFO:teuthology.orchestra.run.smithi155.stdout: "time": "2023-08-01T19:54:04.461466+0000", 2023-08-01T19:54:23.640 INFO:teuthology.orchestra.run.smithi155.stdout: "duration": 4294967295.999999 2023-08-01T19:54:23.640 INFO:teuthology.orchestra.run.smithi155.stdout: }, 2023-08-01T19:54:23.640 INFO:teuthology.orchestra.run.smithi155.stdout: { 2023-08-01T19:54:23.640 INFO:teuthology.orchestra.run.smithi155.stdout: "event": "all_read", 2023-08-01T19:54:23.641 INFO:teuthology.orchestra.run.smithi155.stdout: "time": "2023-08-01T19:54:04.461482+0000", 2023-08-01T19:54:23.641 INFO:teuthology.orchestra.run.smithi155.stdout: "duration": 1.5798e-05 2023-08-01T19:54:23.641 INFO:teuthology.orchestra.run.smithi155.stdout: }, 2023-08-01T19:54:23.641 INFO:teuthology.orchestra.run.smithi155.stdout: { 2023-08-01T19:54:23.641 INFO:teuthology.orchestra.run.smithi155.stdout: "event": "dispatched", 2023-08-01T19:54:23.641 INFO:teuthology.orchestra.run.smithi155.stdout: "time": "2023-08-01T19:54:04.461491+0000", 2023-08-01T19:54:23.641 INFO:teuthology.orchestra.run.smithi155.stdout: "duration": 8.9430000000000006e-06 2023-08-01T19:54:23.642 INFO:teuthology.orchestra.run.smithi155.stdout: }, 2023-08-01T19:54:23.642 INFO:teuthology.orchestra.run.smithi155.stdout: { 2023-08-01T19:54:23.642 INFO:teuthology.orchestra.run.smithi155.stdout: "event": "queued_for_pg", 2023-08-01T19:54:23.642 INFO:teuthology.orchestra.run.smithi155.stdout: "time": "2023-08-01T19:54:04.461496+0000", 2023-08-01T19:54:23.642 INFO:teuthology.orchestra.run.smithi155.stdout: "duration": 5.7880000000000003e-06 2023-08-01T19:54:23.642 INFO:teuthology.orchestra.run.smithi155.stdout: }, 2023-08-01T19:54:23.642 INFO:teuthology.orchestra.run.smithi155.stdout: { 2023-08-01T19:54:23.642 INFO:teuthology.orchestra.run.smithi155.stdout: "event": "reached_pg", 2023-08-01T19:54:23.643 INFO:teuthology.orchestra.run.smithi155.stdout: "time": "2023-08-01T19:54:04.462024+0000", 2023-08-01T19:54:23.643 INFO:teuthology.orchestra.run.smithi155.stdout: "duration": 0.00052711000000000001 2023-08-01T19:54:23.643 INFO:teuthology.orchestra.run.smithi155.stdout: }, 2023-08-01T19:54:23.643 INFO:teuthology.orchestra.run.smithi155.stdout: { 2023-08-01T19:54:23.643 INFO:teuthology.orchestra.run.smithi155.stdout: "event": "started", 2023-08-01T19:54:23.643 INFO:teuthology.orchestra.run.smithi155.stdout: "time": "2023-08-01T19:54:04.462161+0000", 2023-08-01T19:54:23.643 INFO:teuthology.orchestra.run.smithi155.stdout: "duration": 0.00013759800000000001 2023-08-01T19:54:23.644 INFO:teuthology.orchestra.run.smithi155.stdout: }, 2023-08-01T19:54:23.644 INFO:teuthology.orchestra.run.smithi155.stdout: { 2023-08-01T19:54:23.644 INFO:teuthology.orchestra.run.smithi155.stdout: "event": "done", 2023-08-01T19:54:23.644 INFO:teuthology.orchestra.run.smithi155.stdout: "time": "2023-08-01T19:54:04.473150+0000", 2023-08-01T19:54:23.644 INFO:teuthology.orchestra.run.smithi155.stdout: "duration": 0.010988476 2023-08-01T19:54:23.644 INFO:teuthology.orchestra.run.smithi155.stdout: } 2023-08-01T19:54:23.644 INFO:teuthology.orchestra.run.smithi155.stdout: ] 2023-08-01T19:54:23.645 INFO:teuthology.orchestra.run.smithi155.stdout: } 2023-08-01T19:54:23.645 INFO:teuthology.orchestra.run.smithi155.stdout: }, 2023-08-01T19:54:23.645 INFO:teuthology.orchestra.run.smithi155.stdout: { 2023-08-01T19:54:23.645 INFO:teuthology.orchestra.run.smithi155.stdout: "description": "osd_repop(mds.0.3:10 3.10 e17/15 3:0bd6d154:::602.00000000:head v 17'5, mlcod=0'0)", 2023-08-01T19:54:23.645 INFO:teuthology.orchestra.run.smithi155.stdout: "initiated_at": "2023-08-01T19:54:04.471785+0000", 2023-08-01T19:54:23.645 INFO:teuthology.orchestra.run.smithi155.stdout: "age": 18.995373824000001, 2023-08-01T19:54:23.645 INFO:teuthology.orchestra.run.smithi155.stdout: "duration": 0.0053983, 2023-08-01T19:54:23.646 INFO:teuthology.orchestra.run.smithi155.stdout: "type_data": { 2023-08-01T19:54:23.646 INFO:teuthology.orchestra.run.smithi155.stdout: "flag_point": "commit sent; apply or cleanup", 2023-08-01T19:54:23.646 INFO:teuthology.orchestra.run.smithi155.stdout: "events": [ 2023-08-01T19:54:23.646 INFO:teuthology.orchestra.run.smithi155.stdout: { 2023-08-01T19:54:23.646 INFO:teuthology.orchestra.run.smithi155.stdout: "event": "initiated", 2023-08-01T19:54:23.646 INFO:teuthology.orchestra.run.smithi155.stdout: "time": "2023-08-01T19:54:04.471785+0000", 2023-08-01T19:54:23.646 INFO:teuthology.orchestra.run.smithi155.stdout: "duration": 0 2023-08-01T19:54:23.646 INFO:teuthology.orchestra.run.smithi155.stdout: }, 2023-08-01T19:54:23.647 INFO:teuthology.orchestra.run.smithi155.stdout: { 2023-08-01T19:54:23.647 INFO:teuthology.orchestra.run.smithi155.stdout: "event": "throttled", 2023-08-01T19:54:23.647 INFO:teuthology.orchestra.run.smithi155.stdout: "time": "2023-08-01T19:54:04.471785+0000", 2023-08-01T19:54:23.647 INFO:teuthology.orchestra.run.smithi155.stdout: "duration": 0 2023-08-01T19:54:23.647 INFO:teuthology.orchestra.run.smithi155.stdout: }, 2023-08-01T19:54:23.647 INFO:teuthology.orchestra.run.smithi155.stdout: { 2023-08-01T19:54:23.647 INFO:teuthology.orchestra.run.smithi155.stdout: "event": "header_read", 2023-08-01T19:54:23.648 INFO:teuthology.orchestra.run.smithi155.stdout: "time": "2023-08-01T19:54:04.471785+0000", 2023-08-01T19:54:23.648 INFO:teuthology.orchestra.run.smithi155.stdout: "duration": 4294967295.9999995 2023-08-01T19:54:23.648 INFO:teuthology.orchestra.run.smithi155.stdout: }, 2023-08-01T19:54:23.648 INFO:teuthology.orchestra.run.smithi155.stdout: { 2023-08-01T19:54:23.648 INFO:teuthology.orchestra.run.smithi155.stdout: "event": "all_read", 2023-08-01T19:54:23.648 INFO:teuthology.orchestra.run.smithi155.stdout: "time": "2023-08-01T19:54:04.471823+0000", 2023-08-01T19:54:23.648 INFO:teuthology.orchestra.run.smithi155.stdout: "duration": 3.8640999999999998e-05 2023-08-01T19:54:23.649 INFO:teuthology.orchestra.run.smithi155.stdout: }, 2023-08-01T19:54:23.649 INFO:teuthology.orchestra.run.smithi155.stdout: { 2023-08-01T19:54:23.649 INFO:teuthology.orchestra.run.smithi155.stdout: "event": "dispatched", 2023-08-01T19:54:23.649 INFO:teuthology.orchestra.run.smithi155.stdout: "time": "2023-08-01T19:54:04.471831+0000", 2023-08-01T19:54:23.649 INFO:teuthology.orchestra.run.smithi155.stdout: "duration": 8.1349999999999992e-06 2023-08-01T19:54:23.649 INFO:teuthology.orchestra.run.smithi155.stdout: }, 2023-08-01T19:54:23.649 INFO:teuthology.orchestra.run.smithi155.stdout: { 2023-08-01T19:54:23.650 INFO:teuthology.orchestra.run.smithi155.stdout: "event": "queued_for_pg", 2023-08-01T19:54:23.650 INFO:teuthology.orchestra.run.smithi155.stdout: "time": "2023-08-01T19:54:04.471838+0000", 2023-08-01T19:54:23.650 INFO:teuthology.orchestra.run.smithi155.stdout: "duration": 6.2110000000000003e-06 2023-08-01T19:54:23.650 INFO:teuthology.orchestra.run.smithi155.stdout: }, 2023-08-01T19:54:23.650 INFO:teuthology.orchestra.run.smithi155.stdout: { 2023-08-01T19:54:23.650 INFO:teuthology.orchestra.run.smithi155.stdout: "event": "reached_pg", 2023-08-01T19:54:23.650 INFO:teuthology.orchestra.run.smithi155.stdout: "time": "2023-08-01T19:54:04.472998+0000", 2023-08-01T19:54:23.651 INFO:teuthology.orchestra.run.smithi155.stdout: "duration": 0.0011601440000000001 2023-08-01T19:54:23.651 INFO:teuthology.orchestra.run.smithi155.stdout: }, 2023-08-01T19:54:23.651 INFO:teuthology.orchestra.run.smithi155.stdout: { 2023-08-01T19:54:23.651 INFO:teuthology.orchestra.run.smithi155.stdout: "event": "started", 2023-08-01T19:54:23.651 INFO:teuthology.orchestra.run.smithi155.stdout: "time": "2023-08-01T19:54:04.473244+0000", 2023-08-01T19:54:23.651 INFO:teuthology.orchestra.run.smithi155.stdout: "duration": 0.00024628600000000002 2023-08-01T19:54:23.651 INFO:teuthology.orchestra.run.smithi155.stdout: }, 2023-08-01T19:54:23.652 INFO:teuthology.orchestra.run.smithi155.stdout: { 2023-08-01T19:54:23.652 INFO:teuthology.orchestra.run.smithi155.stdout: "event": "commit_sent", 2023-08-01T19:54:23.652 INFO:teuthology.orchestra.run.smithi155.stdout: "time": "2023-08-01T19:54:04.477147+0000", 2023-08-01T19:54:23.652 INFO:teuthology.orchestra.run.smithi155.stdout: "duration": 0.003902577 2023-08-01T19:54:23.652 INFO:teuthology.orchestra.run.smithi155.stdout: }, 2023-08-01T19:54:23.652 INFO:teuthology.orchestra.run.smithi155.stdout: { 2023-08-01T19:54:23.652 INFO:teuthology.orchestra.run.smithi155.stdout: "event": "done", 2023-08-01T19:54:23.652 INFO:teuthology.orchestra.run.smithi155.stdout: "time": "2023-08-01T19:54:04.477183+0000", 2023-08-01T19:54:23.653 INFO:teuthology.orchestra.run.smithi155.stdout: "duration": 3.6565e-05 2023-08-01T19:54:23.653 INFO:teuthology.orchestra.run.smithi155.stdout: } 2023-08-01T19:54:23.653 INFO:teuthology.orchestra.run.smithi155.stdout: ] 2023-08-01T19:54:23.653 INFO:teuthology.orchestra.run.smithi155.stdout: } 2023-08-01T19:54:23.653 INFO:teuthology.orchestra.run.smithi155.stdout: } 2023-08-01T19:54:23.653 INFO:teuthology.orchestra.run.smithi155.stdout: ] 2023-08-01T19:54:23.653 INFO:teuthology.orchestra.run.smithi155.stdout:} 2023-08-01T19:54:23.655 INFO:tasks.ceph.osd.2.smithi155.stderr:2023-08-01T19:54:23.654+0000 7faa5c6ac700 -1 received signal: Hangup from /usr/bin/python3 /bin/daemon-helper kill ceph-osd -f --cluster ceph -i 2 (PID: 111337) UID: 0 2023-08-01T19:54:23.655 DEBUG:teuthology.orchestra.run.smithi008:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 30 ceph --cluster ceph --admin-daemon /var/run/ceph/ceph-osd.0.asok dump_ops_in_flight 2023-08-01T19:54:23.755 INFO:tasks.ceph.osd.2.smithi155.stderr:2023-08-01T19:54:23.755+0000 7faa5c6ac700 -1 received signal: Hangup from /usr/bin/python3 /bin/daemon-helper kill ceph-osd -f --cluster ceph -i 2 (PID: 111337) UID: 0 2023-08-01T19:54:23.800 INFO:teuthology.orchestra.run.smithi008.stdout:{ 2023-08-01T19:54:23.800 INFO:teuthology.orchestra.run.smithi008.stdout: "ops": [], 2023-08-01T19:54:23.800 INFO:teuthology.orchestra.run.smithi008.stdout: "num_ops": 0 2023-08-01T19:54:23.800 INFO:teuthology.orchestra.run.smithi008.stdout:} 2023-08-01T19:54:23.810 DEBUG:teuthology.orchestra.run.smithi008:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 30 ceph --cluster ceph --admin-daemon /var/run/ceph/ceph-osd.0.asok dump_blocked_ops 2023-08-01T19:54:23.857 INFO:tasks.ceph.osd.2.smithi155.stderr:2023-08-01T19:54:23.855+0000 7faa5c6ac700 -1 received signal: Hangup from /usr/bin/python3 /bin/daemon-helper kill ceph-osd -f --cluster ceph -i 2 (PID: 111337) UID: 0 2023-08-01T19:54:23.939 INFO:teuthology.orchestra.run.smithi008.stdout:{ 2023-08-01T19:54:23.940 INFO:teuthology.orchestra.run.smithi008.stdout: "ops": [], 2023-08-01T19:54:23.940 INFO:teuthology.orchestra.run.smithi008.stdout: "complaint_time": 30, 2023-08-01T19:54:23.940 INFO:teuthology.orchestra.run.smithi008.stdout: "num_blocked_ops": 0 2023-08-01T19:54:23.940 INFO:teuthology.orchestra.run.smithi008.stdout:} 2023-08-01T19:54:23.949 DEBUG:teuthology.orchestra.run.smithi008:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 30 ceph --cluster ceph --admin-daemon /var/run/ceph/ceph-osd.0.asok dump_historic_ops 2023-08-01T19:54:23.957 INFO:tasks.ceph.osd.2.smithi155.stderr:2023-08-01T19:54:23.956+0000 7faa5c6ac700 -1 received signal: Hangup from /usr/bin/python3 /bin/daemon-helper kill ceph-osd -f --cluster ceph -i 2 (PID: 111337) UID: 0 2023-08-01T19:54:24.058 INFO:tasks.ceph.osd.0.smithi008.stderr:2023-08-01T19:54:24.056+0000 7f16a58f4700 -1 received signal: Hangup from /usr/bin/python3 /bin/daemon-helper kill ceph-osd -f --cluster ceph -i 0 (PID: 111179) UID: 0 2023-08-01T19:54:24.079 INFO:teuthology.orchestra.run.smithi008.stdout:{ 2023-08-01T19:54:24.079 INFO:teuthology.orchestra.run.smithi008.stdout: "size": 20, 2023-08-01T19:54:24.079 INFO:teuthology.orchestra.run.smithi008.stdout: "duration": 600, 2023-08-01T19:54:24.079 INFO:teuthology.orchestra.run.smithi008.stdout: "ops": [ 2023-08-01T19:54:24.080 INFO:teuthology.orchestra.run.smithi008.stdout: { 2023-08-01T19:54:24.080 INFO:teuthology.orchestra.run.smithi008.stdout: "description": "osd_op(mds.0.3:4 3.1f 3:ff5b34d6:::1.00000000:head [omap-set-header] snapc 0=[] ondisk+write+known_if_redirected+full_force+supports_pool_eio e17)", 2023-08-01T19:54:24.080 INFO:teuthology.orchestra.run.smithi008.stdout: "initiated_at": "2023-08-01T19:54:04.459058+0000", 2023-08-01T19:54:24.080 INFO:teuthology.orchestra.run.smithi008.stdout: "age": 19.617596533, 2023-08-01T19:54:24.080 INFO:teuthology.orchestra.run.smithi008.stdout: "duration": 0.011600047, 2023-08-01T19:54:24.080 INFO:teuthology.orchestra.run.smithi008.stdout: "type_data": { 2023-08-01T19:54:24.080 INFO:teuthology.orchestra.run.smithi008.stdout: "flag_point": "commit sent; apply or cleanup", 2023-08-01T19:54:24.081 INFO:teuthology.orchestra.run.smithi008.stdout: "events": [ 2023-08-01T19:54:24.081 INFO:teuthology.orchestra.run.smithi008.stdout: { 2023-08-01T19:54:24.081 INFO:teuthology.orchestra.run.smithi008.stdout: "event": "initiated", 2023-08-01T19:54:24.081 INFO:teuthology.orchestra.run.smithi008.stdout: "time": "2023-08-01T19:54:04.459058+0000", 2023-08-01T19:54:24.081 INFO:teuthology.orchestra.run.smithi008.stdout: "duration": 0 2023-08-01T19:54:24.081 INFO:teuthology.orchestra.run.smithi008.stdout: }, 2023-08-01T19:54:24.081 INFO:teuthology.orchestra.run.smithi008.stdout: { 2023-08-01T19:54:24.081 INFO:teuthology.orchestra.run.smithi008.stdout: "event": "throttled", 2023-08-01T19:54:24.082 INFO:teuthology.orchestra.run.smithi008.stdout: "time": "2023-08-01T19:54:04.459058+0000", 2023-08-01T19:54:24.082 INFO:teuthology.orchestra.run.smithi008.stdout: "duration": 0 2023-08-01T19:54:24.082 INFO:teuthology.orchestra.run.smithi008.stdout: }, 2023-08-01T19:54:24.082 INFO:teuthology.orchestra.run.smithi008.stdout: { 2023-08-01T19:54:24.082 INFO:teuthology.orchestra.run.smithi008.stdout: "event": "header_read", 2023-08-01T19:54:24.082 INFO:teuthology.orchestra.run.smithi008.stdout: "time": "2023-08-01T19:54:04.459052+0000", 2023-08-01T19:54:24.082 INFO:teuthology.orchestra.run.smithi008.stdout: "duration": 4294967295.9999938 2023-08-01T19:54:24.082 INFO:teuthology.orchestra.run.smithi008.stdout: }, 2023-08-01T19:54:24.083 INFO:teuthology.orchestra.run.smithi008.stdout: { 2023-08-01T19:54:24.083 INFO:teuthology.orchestra.run.smithi008.stdout: "event": "all_read", 2023-08-01T19:54:24.083 INFO:teuthology.orchestra.run.smithi008.stdout: "time": "2023-08-01T19:54:04.459069+0000", 2023-08-01T19:54:24.083 INFO:teuthology.orchestra.run.smithi008.stdout: "duration": 1.6395000000000001e-05 2023-08-01T19:54:24.083 INFO:teuthology.orchestra.run.smithi008.stdout: }, 2023-08-01T19:54:24.083 INFO:teuthology.orchestra.run.smithi008.stdout: { 2023-08-01T19:54:24.083 INFO:teuthology.orchestra.run.smithi008.stdout: "event": "dispatched", 2023-08-01T19:54:24.084 INFO:teuthology.orchestra.run.smithi008.stdout: "time": "2023-08-01T19:54:04.459083+0000", 2023-08-01T19:54:24.084 INFO:teuthology.orchestra.run.smithi008.stdout: "duration": 1.3869999999999999e-05 2023-08-01T19:54:24.084 INFO:teuthology.orchestra.run.smithi008.stdout: }, 2023-08-01T19:54:24.084 INFO:teuthology.orchestra.run.smithi008.stdout: { 2023-08-01T19:54:24.084 INFO:teuthology.orchestra.run.smithi008.stdout: "event": "queued_for_pg", 2023-08-01T19:54:24.084 INFO:teuthology.orchestra.run.smithi008.stdout: "time": "2023-08-01T19:54:04.459099+0000", 2023-08-01T19:54:24.084 INFO:teuthology.orchestra.run.smithi008.stdout: "duration": 1.681e-05 2023-08-01T19:54:24.084 INFO:teuthology.orchestra.run.smithi008.stdout: }, 2023-08-01T19:54:24.085 INFO:teuthology.orchestra.run.smithi008.stdout: { 2023-08-01T19:54:24.085 INFO:teuthology.orchestra.run.smithi008.stdout: "event": "reached_pg", 2023-08-01T19:54:24.085 INFO:teuthology.orchestra.run.smithi008.stdout: "time": "2023-08-01T19:54:04.459781+0000", 2023-08-01T19:54:24.085 INFO:teuthology.orchestra.run.smithi008.stdout: "duration": 0.00068143200000000004 2023-08-01T19:54:24.085 INFO:teuthology.orchestra.run.smithi008.stdout: }, 2023-08-01T19:54:24.085 INFO:teuthology.orchestra.run.smithi008.stdout: { 2023-08-01T19:54:24.085 INFO:teuthology.orchestra.run.smithi008.stdout: "event": "op must wait for map", 2023-08-01T19:54:24.085 INFO:teuthology.orchestra.run.smithi008.stdout: "time": "2023-08-01T19:54:04.459787+0000", 2023-08-01T19:54:24.086 INFO:teuthology.orchestra.run.smithi008.stdout: "duration": 6.562e-06 2023-08-01T19:54:24.086 INFO:teuthology.orchestra.run.smithi008.stdout: }, 2023-08-01T19:54:24.086 INFO:teuthology.orchestra.run.smithi008.stdout: { 2023-08-01T19:54:24.086 INFO:teuthology.orchestra.run.smithi008.stdout: "event": "reached_pg", 2023-08-01T19:54:24.086 INFO:teuthology.orchestra.run.smithi008.stdout: "time": "2023-08-01T19:54:04.461027+0000", 2023-08-01T19:54:24.086 INFO:teuthology.orchestra.run.smithi008.stdout: "duration": 0.001239846 2023-08-01T19:54:24.086 INFO:teuthology.orchestra.run.smithi008.stdout: }, 2023-08-01T19:54:24.086 INFO:teuthology.orchestra.run.smithi008.stdout: { 2023-08-01T19:54:24.087 INFO:teuthology.orchestra.run.smithi008.stdout: "event": "started", 2023-08-01T19:54:24.087 INFO:teuthology.orchestra.run.smithi008.stdout: "time": "2023-08-01T19:54:04.461333+0000", 2023-08-01T19:54:24.087 INFO:teuthology.orchestra.run.smithi008.stdout: "duration": 0.00030574999999999998 2023-08-01T19:54:24.087 INFO:teuthology.orchestra.run.smithi008.stdout: }, 2023-08-01T19:54:24.087 INFO:teuthology.orchestra.run.smithi008.stdout: { 2023-08-01T19:54:24.087 INFO:teuthology.orchestra.run.smithi008.stdout: "event": "waiting for subops from 1", 2023-08-01T19:54:24.087 INFO:teuthology.orchestra.run.smithi008.stdout: "time": "2023-08-01T19:54:04.461789+0000", 2023-08-01T19:54:24.087 INFO:teuthology.orchestra.run.smithi008.stdout: "duration": 0.00045635499999999998 2023-08-01T19:54:24.088 INFO:teuthology.orchestra.run.smithi008.stdout: }, 2023-08-01T19:54:24.088 INFO:teuthology.orchestra.run.smithi008.stdout: { 2023-08-01T19:54:24.088 INFO:teuthology.orchestra.run.smithi008.stdout: "event": "op_commit", 2023-08-01T19:54:24.088 INFO:teuthology.orchestra.run.smithi008.stdout: "time": "2023-08-01T19:54:04.464364+0000", 2023-08-01T19:54:24.088 INFO:teuthology.orchestra.run.smithi008.stdout: "duration": 0.002574603 2023-08-01T19:54:24.088 INFO:teuthology.orchestra.run.smithi008.stdout: }, 2023-08-01T19:54:24.088 INFO:teuthology.orchestra.run.smithi008.stdout: { 2023-08-01T19:54:24.089 INFO:teuthology.orchestra.run.smithi008.stdout: "event": "sub_op_commit_rec", 2023-08-01T19:54:24.089 INFO:teuthology.orchestra.run.smithi008.stdout: "time": "2023-08-01T19:54:04.470558+0000", 2023-08-01T19:54:24.089 INFO:teuthology.orchestra.run.smithi008.stdout: "duration": 0.0061936910000000003 2023-08-01T19:54:24.089 INFO:teuthology.orchestra.run.smithi008.stdout: }, 2023-08-01T19:54:24.089 INFO:teuthology.orchestra.run.smithi008.stdout: { 2023-08-01T19:54:24.089 INFO:teuthology.orchestra.run.smithi008.stdout: "event": "commit_sent", 2023-08-01T19:54:24.089 INFO:teuthology.orchestra.run.smithi008.stdout: "time": "2023-08-01T19:54:04.470615+0000", 2023-08-01T19:54:24.089 INFO:teuthology.orchestra.run.smithi008.stdout: "duration": 5.7138000000000001e-05 2023-08-01T19:54:24.090 INFO:teuthology.orchestra.run.smithi008.stdout: }, 2023-08-01T19:54:24.090 INFO:teuthology.orchestra.run.smithi008.stdout: { 2023-08-01T19:54:24.090 INFO:teuthology.orchestra.run.smithi008.stdout: "event": "done", 2023-08-01T19:54:24.090 INFO:teuthology.orchestra.run.smithi008.stdout: "time": "2023-08-01T19:54:04.470658+0000", 2023-08-01T19:54:24.090 INFO:teuthology.orchestra.run.smithi008.stdout: "duration": 4.3640999999999998e-05 2023-08-01T19:54:24.090 INFO:teuthology.orchestra.run.smithi008.stdout: } 2023-08-01T19:54:24.090 INFO:teuthology.orchestra.run.smithi008.stdout: ] 2023-08-01T19:54:24.090 INFO:teuthology.orchestra.run.smithi008.stdout: } 2023-08-01T19:54:24.091 INFO:teuthology.orchestra.run.smithi008.stdout: }, 2023-08-01T19:54:24.091 INFO:teuthology.orchestra.run.smithi008.stdout: { 2023-08-01T19:54:24.091 INFO:teuthology.orchestra.run.smithi008.stdout: "description": "osd_op(mds.0.3:5 3.1f 3:ff5b34d6:::1.00000000:head [create,setxattr parent (30) in=6b,setxattr layout (30) in=6b] snapc 0=[] ondisk+write+known_if_redirected+full_force+supports_pool_eio e17)", 2023-08-01T19:54:24.091 INFO:teuthology.orchestra.run.smithi008.stdout: "initiated_at": "2023-08-01T19:54:04.459120+0000", 2023-08-01T19:54:24.091 INFO:teuthology.orchestra.run.smithi008.stdout: "age": 19.617534975000002, 2023-08-01T19:54:24.091 INFO:teuthology.orchestra.run.smithi008.stdout: "duration": 0.012982585, 2023-08-01T19:54:24.091 INFO:teuthology.orchestra.run.smithi008.stdout: "type_data": { 2023-08-01T19:54:24.091 INFO:teuthology.orchestra.run.smithi008.stdout: "flag_point": "commit sent; apply or cleanup", 2023-08-01T19:54:24.092 INFO:teuthology.orchestra.run.smithi008.stdout: "events": [ 2023-08-01T19:54:24.092 INFO:teuthology.orchestra.run.smithi008.stdout: { 2023-08-01T19:54:24.092 INFO:teuthology.orchestra.run.smithi008.stdout: "event": "initiated", 2023-08-01T19:54:24.092 INFO:teuthology.orchestra.run.smithi008.stdout: "time": "2023-08-01T19:54:04.459120+0000", 2023-08-01T19:54:24.092 INFO:teuthology.orchestra.run.smithi008.stdout: "duration": 0 2023-08-01T19:54:24.092 INFO:teuthology.orchestra.run.smithi008.stdout: }, 2023-08-01T19:54:24.092 INFO:teuthology.orchestra.run.smithi008.stdout: { 2023-08-01T19:54:24.092 INFO:teuthology.orchestra.run.smithi008.stdout: "event": "throttled", 2023-08-01T19:54:24.093 INFO:teuthology.orchestra.run.smithi008.stdout: "time": "2023-08-01T19:54:04.459120+0000", 2023-08-01T19:54:24.093 INFO:teuthology.orchestra.run.smithi008.stdout: "duration": 0 2023-08-01T19:54:24.093 INFO:teuthology.orchestra.run.smithi008.stdout: }, 2023-08-01T19:54:24.093 INFO:teuthology.orchestra.run.smithi008.stdout: { 2023-08-01T19:54:24.093 INFO:teuthology.orchestra.run.smithi008.stdout: "event": "header_read", 2023-08-01T19:54:24.093 INFO:teuthology.orchestra.run.smithi008.stdout: "time": "2023-08-01T19:54:04.459119+0000", 2023-08-01T19:54:24.093 INFO:teuthology.orchestra.run.smithi008.stdout: "duration": 4294967295.999999 2023-08-01T19:54:24.093 INFO:teuthology.orchestra.run.smithi008.stdout: }, 2023-08-01T19:54:24.094 INFO:teuthology.orchestra.run.smithi008.stdout: { 2023-08-01T19:54:24.094 INFO:teuthology.orchestra.run.smithi008.stdout: "event": "all_read", 2023-08-01T19:54:24.094 INFO:teuthology.orchestra.run.smithi008.stdout: "time": "2023-08-01T19:54:04.459137+0000", 2023-08-01T19:54:24.094 INFO:teuthology.orchestra.run.smithi008.stdout: "duration": 1.7554000000000002e-05 2023-08-01T19:54:24.094 INFO:teuthology.orchestra.run.smithi008.stdout: }, 2023-08-01T19:54:24.094 INFO:teuthology.orchestra.run.smithi008.stdout: { 2023-08-01T19:54:24.094 INFO:teuthology.orchestra.run.smithi008.stdout: "event": "dispatched", 2023-08-01T19:54:24.094 INFO:teuthology.orchestra.run.smithi008.stdout: "time": "2023-08-01T19:54:04.459148+0000", 2023-08-01T19:54:24.095 INFO:teuthology.orchestra.run.smithi008.stdout: "duration": 1.1248e-05 2023-08-01T19:54:24.095 INFO:teuthology.orchestra.run.smithi008.stdout: }, 2023-08-01T19:54:24.095 INFO:teuthology.orchestra.run.smithi008.stdout: { 2023-08-01T19:54:24.095 INFO:teuthology.orchestra.run.smithi008.stdout: "event": "queued_for_pg", 2023-08-01T19:54:24.095 INFO:teuthology.orchestra.run.smithi008.stdout: "time": "2023-08-01T19:54:04.459167+0000", 2023-08-01T19:54:24.095 INFO:teuthology.orchestra.run.smithi008.stdout: "duration": 1.9457999999999999e-05 2023-08-01T19:54:24.095 INFO:teuthology.orchestra.run.smithi008.stdout: }, 2023-08-01T19:54:24.095 INFO:teuthology.orchestra.run.smithi008.stdout: { 2023-08-01T19:54:24.096 INFO:teuthology.orchestra.run.smithi008.stdout: "event": "reached_pg", 2023-08-01T19:54:24.096 INFO:teuthology.orchestra.run.smithi008.stdout: "time": "2023-08-01T19:54:04.459863+0000", 2023-08-01T19:54:24.096 INFO:teuthology.orchestra.run.smithi008.stdout: "duration": 0.000695325 2023-08-01T19:54:24.096 INFO:teuthology.orchestra.run.smithi008.stdout: }, 2023-08-01T19:54:24.096 INFO:teuthology.orchestra.run.smithi008.stdout: { 2023-08-01T19:54:24.096 INFO:teuthology.orchestra.run.smithi008.stdout: "event": "waiting_for_map not empty", 2023-08-01T19:54:24.096 INFO:teuthology.orchestra.run.smithi008.stdout: "time": "2023-08-01T19:54:04.459866+0000", 2023-08-01T19:54:24.097 INFO:teuthology.orchestra.run.smithi008.stdout: "duration": 3.1540000000000002e-06 2023-08-01T19:54:24.097 INFO:teuthology.orchestra.run.smithi008.stdout: }, 2023-08-01T19:54:24.097 INFO:teuthology.orchestra.run.smithi008.stdout: { 2023-08-01T19:54:24.097 INFO:teuthology.orchestra.run.smithi008.stdout: "event": "reached_pg", 2023-08-01T19:54:24.097 INFO:teuthology.orchestra.run.smithi008.stdout: "time": "2023-08-01T19:54:04.462285+0000", 2023-08-01T19:54:24.097 INFO:teuthology.orchestra.run.smithi008.stdout: "duration": 0.0024190560000000002 2023-08-01T19:54:24.097 INFO:teuthology.orchestra.run.smithi008.stdout: }, 2023-08-01T19:54:24.097 INFO:teuthology.orchestra.run.smithi008.stdout: { 2023-08-01T19:54:24.098 INFO:teuthology.orchestra.run.smithi008.stdout: "event": "started", 2023-08-01T19:54:24.098 INFO:teuthology.orchestra.run.smithi008.stdout: "time": "2023-08-01T19:54:04.462365+0000", 2023-08-01T19:54:24.098 INFO:teuthology.orchestra.run.smithi008.stdout: "duration": 8.0488999999999995e-05 2023-08-01T19:54:24.098 INFO:teuthology.orchestra.run.smithi008.stdout: }, 2023-08-01T19:54:24.098 INFO:teuthology.orchestra.run.smithi008.stdout: { 2023-08-01T19:54:24.098 INFO:teuthology.orchestra.run.smithi008.stdout: "event": "waiting for subops from 1", 2023-08-01T19:54:24.098 INFO:teuthology.orchestra.run.smithi008.stdout: "time": "2023-08-01T19:54:04.462560+0000", 2023-08-01T19:54:24.098 INFO:teuthology.orchestra.run.smithi008.stdout: "duration": 0.00019412300000000001 2023-08-01T19:54:24.099 INFO:teuthology.orchestra.run.smithi008.stdout: }, 2023-08-01T19:54:24.099 INFO:teuthology.orchestra.run.smithi008.stdout: { 2023-08-01T19:54:24.099 INFO:teuthology.orchestra.run.smithi008.stdout: "event": "op_commit", 2023-08-01T19:54:24.099 INFO:teuthology.orchestra.run.smithi008.stdout: "time": "2023-08-01T19:54:04.467069+0000", 2023-08-01T19:54:24.099 INFO:teuthology.orchestra.run.smithi008.stdout: "duration": 0.0045089709999999996 2023-08-01T19:54:24.099 INFO:teuthology.orchestra.run.smithi008.stdout: }, 2023-08-01T19:54:24.099 INFO:teuthology.orchestra.run.smithi008.stdout: { 2023-08-01T19:54:24.099 INFO:teuthology.orchestra.run.smithi008.stdout: "event": "sub_op_commit_rec", 2023-08-01T19:54:24.100 INFO:teuthology.orchestra.run.smithi008.stdout: "time": "2023-08-01T19:54:04.471986+0000", 2023-08-01T19:54:24.100 INFO:teuthology.orchestra.run.smithi008.stdout: "duration": 0.0049178499999999997 2023-08-01T19:54:24.100 INFO:teuthology.orchestra.run.smithi008.stdout: }, 2023-08-01T19:54:24.100 INFO:teuthology.orchestra.run.smithi008.stdout: { 2023-08-01T19:54:24.100 INFO:teuthology.orchestra.run.smithi008.stdout: "event": "commit_sent", 2023-08-01T19:54:24.100 INFO:teuthology.orchestra.run.smithi008.stdout: "time": "2023-08-01T19:54:04.472060+0000", 2023-08-01T19:54:24.100 INFO:teuthology.orchestra.run.smithi008.stdout: "duration": 7.4049999999999997e-05 2023-08-01T19:54:24.100 INFO:teuthology.orchestra.run.smithi008.stdout: }, 2023-08-01T19:54:24.101 INFO:teuthology.orchestra.run.smithi008.stdout: { 2023-08-01T19:54:24.101 INFO:teuthology.orchestra.run.smithi008.stdout: "event": "done", 2023-08-01T19:54:24.101 INFO:teuthology.orchestra.run.smithi008.stdout: "time": "2023-08-01T19:54:04.472102+0000", 2023-08-01T19:54:24.101 INFO:teuthology.orchestra.run.smithi008.stdout: "duration": 4.206e-05 2023-08-01T19:54:24.101 INFO:teuthology.orchestra.run.smithi008.stdout: } 2023-08-01T19:54:24.101 INFO:teuthology.orchestra.run.smithi008.stdout: ] 2023-08-01T19:54:24.101 INFO:teuthology.orchestra.run.smithi008.stdout: } 2023-08-01T19:54:24.101 INFO:teuthology.orchestra.run.smithi008.stdout: }, 2023-08-01T19:54:24.102 INFO:teuthology.orchestra.run.smithi008.stdout: { 2023-08-01T19:54:24.102 INFO:teuthology.orchestra.run.smithi008.stdout: "description": "osd_op(mds.0.3:24 3.7 3:e0b41d06:::609.00000000:head [omap-set-header] snapc 0=[] ondisk+write+known_if_redirected+full_force+supports_pool_eio e17)", 2023-08-01T19:54:24.102 INFO:teuthology.orchestra.run.smithi008.stdout: "initiated_at": "2023-08-01T19:54:04.459178+0000", 2023-08-01T19:54:24.102 INFO:teuthology.orchestra.run.smithi008.stdout: "age": 19.617476989, 2023-08-01T19:54:24.102 INFO:teuthology.orchestra.run.smithi008.stdout: "duration": 0.010109111, 2023-08-01T19:54:24.102 INFO:teuthology.orchestra.run.smithi008.stdout: "type_data": { 2023-08-01T19:54:24.102 INFO:teuthology.orchestra.run.smithi008.stdout: "flag_point": "commit sent; apply or cleanup", 2023-08-01T19:54:24.102 INFO:teuthology.orchestra.run.smithi008.stdout: "events": [ 2023-08-01T19:54:24.103 INFO:teuthology.orchestra.run.smithi008.stdout: { 2023-08-01T19:54:24.103 INFO:teuthology.orchestra.run.smithi008.stdout: "event": "initiated", 2023-08-01T19:54:24.103 INFO:teuthology.orchestra.run.smithi008.stdout: "time": "2023-08-01T19:54:04.459178+0000", 2023-08-01T19:54:24.103 INFO:teuthology.orchestra.run.smithi008.stdout: "duration": 0 2023-08-01T19:54:24.103 INFO:teuthology.orchestra.run.smithi008.stdout: }, 2023-08-01T19:54:24.103 INFO:teuthology.orchestra.run.smithi008.stdout: { 2023-08-01T19:54:24.103 INFO:teuthology.orchestra.run.smithi008.stdout: "event": "throttled", 2023-08-01T19:54:24.104 INFO:teuthology.orchestra.run.smithi008.stdout: "time": "2023-08-01T19:54:04.459178+0000", 2023-08-01T19:54:24.104 INFO:teuthology.orchestra.run.smithi008.stdout: "duration": 0 2023-08-01T19:54:24.104 INFO:teuthology.orchestra.run.smithi008.stdout: }, 2023-08-01T19:54:24.104 INFO:teuthology.orchestra.run.smithi008.stdout: { 2023-08-01T19:54:24.104 INFO:teuthology.orchestra.run.smithi008.stdout: "event": "header_read", 2023-08-01T19:54:24.104 INFO:teuthology.orchestra.run.smithi008.stdout: "time": "2023-08-01T19:54:04.459177+0000", 2023-08-01T19:54:24.104 INFO:teuthology.orchestra.run.smithi008.stdout: "duration": 4294967295.9999995 2023-08-01T19:54:24.104 INFO:teuthology.orchestra.run.smithi008.stdout: }, 2023-08-01T19:54:24.105 INFO:teuthology.orchestra.run.smithi008.stdout: { 2023-08-01T19:54:24.105 INFO:teuthology.orchestra.run.smithi008.stdout: "event": "all_read", 2023-08-01T19:54:24.105 INFO:teuthology.orchestra.run.smithi008.stdout: "time": "2023-08-01T19:54:04.459182+0000", 2023-08-01T19:54:24.105 INFO:teuthology.orchestra.run.smithi008.stdout: "duration": 5.0860000000000001e-06 2023-08-01T19:54:24.105 INFO:teuthology.orchestra.run.smithi008.stdout: }, 2023-08-01T19:54:24.105 INFO:teuthology.orchestra.run.smithi008.stdout: { 2023-08-01T19:54:24.105 INFO:teuthology.orchestra.run.smithi008.stdout: "event": "dispatched", 2023-08-01T19:54:24.105 INFO:teuthology.orchestra.run.smithi008.stdout: "time": "2023-08-01T19:54:04.459193+0000", 2023-08-01T19:54:24.106 INFO:teuthology.orchestra.run.smithi008.stdout: "duration": 1.029e-05 2023-08-01T19:54:24.106 INFO:teuthology.orchestra.run.smithi008.stdout: }, 2023-08-01T19:54:24.106 INFO:teuthology.orchestra.run.smithi008.stdout: { 2023-08-01T19:54:24.106 INFO:teuthology.orchestra.run.smithi008.stdout: "event": "queued_for_pg", 2023-08-01T19:54:24.106 INFO:teuthology.orchestra.run.smithi008.stdout: "time": "2023-08-01T19:54:04.459198+0000", 2023-08-01T19:54:24.106 INFO:teuthology.orchestra.run.smithi008.stdout: "duration": 5.2809999999999999e-06 2023-08-01T19:54:24.106 INFO:teuthology.orchestra.run.smithi008.stdout: }, 2023-08-01T19:54:24.107 INFO:teuthology.orchestra.run.smithi008.stdout: { 2023-08-01T19:54:24.107 INFO:teuthology.orchestra.run.smithi008.stdout: "event": "reached_pg", 2023-08-01T19:54:24.107 INFO:teuthology.orchestra.run.smithi008.stdout: "time": "2023-08-01T19:54:04.459882+0000", 2023-08-01T19:54:24.107 INFO:teuthology.orchestra.run.smithi008.stdout: "duration": 0.00068389299999999998 2023-08-01T19:54:24.107 INFO:teuthology.orchestra.run.smithi008.stdout: }, 2023-08-01T19:54:24.107 INFO:teuthology.orchestra.run.smithi008.stdout: { 2023-08-01T19:54:24.107 INFO:teuthology.orchestra.run.smithi008.stdout: "event": "op must wait for map", 2023-08-01T19:54:24.107 INFO:teuthology.orchestra.run.smithi008.stdout: "time": "2023-08-01T19:54:04.459886+0000", 2023-08-01T19:54:24.108 INFO:teuthology.orchestra.run.smithi008.stdout: "duration": 4.0199999999999996e-06 2023-08-01T19:54:24.108 INFO:teuthology.orchestra.run.smithi008.stdout: }, 2023-08-01T19:54:24.108 INFO:teuthology.orchestra.run.smithi008.stdout: { 2023-08-01T19:54:24.108 INFO:teuthology.orchestra.run.smithi008.stdout: "event": "reached_pg", 2023-08-01T19:54:24.108 INFO:teuthology.orchestra.run.smithi008.stdout: "time": "2023-08-01T19:54:04.461115+0000", 2023-08-01T19:54:24.108 INFO:teuthology.orchestra.run.smithi008.stdout: "duration": 0.0012296360000000001 2023-08-01T19:54:24.108 INFO:teuthology.orchestra.run.smithi008.stdout: }, 2023-08-01T19:54:24.108 INFO:teuthology.orchestra.run.smithi008.stdout: { 2023-08-01T19:54:24.109 INFO:teuthology.orchestra.run.smithi008.stdout: "event": "started", 2023-08-01T19:54:24.109 INFO:teuthology.orchestra.run.smithi008.stdout: "time": "2023-08-01T19:54:04.461774+0000", 2023-08-01T19:54:24.109 INFO:teuthology.orchestra.run.smithi008.stdout: "duration": 0.00065882899999999999 2023-08-01T19:54:24.109 INFO:teuthology.orchestra.run.smithi008.stdout: }, 2023-08-01T19:54:24.109 INFO:teuthology.orchestra.run.smithi008.stdout: { 2023-08-01T19:54:24.109 INFO:teuthology.orchestra.run.smithi008.stdout: "event": "waiting for subops from 2", 2023-08-01T19:54:24.109 INFO:teuthology.orchestra.run.smithi008.stdout: "time": "2023-08-01T19:54:04.461960+0000", 2023-08-01T19:54:24.109 INFO:teuthology.orchestra.run.smithi008.stdout: "duration": 0.00018570199999999999 2023-08-01T19:54:24.110 INFO:teuthology.orchestra.run.smithi008.stdout: }, 2023-08-01T19:54:24.110 INFO:teuthology.orchestra.run.smithi008.stdout: { 2023-08-01T19:54:24.110 INFO:teuthology.orchestra.run.smithi008.stdout: "event": "op_commit", 2023-08-01T19:54:24.110 INFO:teuthology.orchestra.run.smithi008.stdout: "time": "2023-08-01T19:54:04.464371+0000", 2023-08-01T19:54:24.110 INFO:teuthology.orchestra.run.smithi008.stdout: "duration": 0.0024114840000000002 2023-08-01T19:54:24.110 INFO:teuthology.orchestra.run.smithi008.stdout: }, 2023-08-01T19:54:24.110 INFO:teuthology.orchestra.run.smithi008.stdout: { 2023-08-01T19:54:24.111 INFO:teuthology.orchestra.run.smithi008.stdout: "event": "sub_op_commit_rec", 2023-08-01T19:54:24.111 INFO:teuthology.orchestra.run.smithi008.stdout: "time": "2023-08-01T19:54:04.469178+0000", 2023-08-01T19:54:24.111 INFO:teuthology.orchestra.run.smithi008.stdout: "duration": 0.0048067580000000004 2023-08-01T19:54:24.111 INFO:teuthology.orchestra.run.smithi008.stdout: }, 2023-08-01T19:54:24.111 INFO:teuthology.orchestra.run.smithi008.stdout: { 2023-08-01T19:54:24.111 INFO:teuthology.orchestra.run.smithi008.stdout: "event": "commit_sent", 2023-08-01T19:54:24.111 INFO:teuthology.orchestra.run.smithi008.stdout: "time": "2023-08-01T19:54:04.469239+0000", 2023-08-01T19:54:24.111 INFO:teuthology.orchestra.run.smithi008.stdout: "duration": 6.1007000000000001e-05 2023-08-01T19:54:24.112 INFO:teuthology.orchestra.run.smithi008.stdout: }, 2023-08-01T19:54:24.112 INFO:teuthology.orchestra.run.smithi008.stdout: { 2023-08-01T19:54:24.112 INFO:teuthology.orchestra.run.smithi008.stdout: "event": "done", 2023-08-01T19:54:24.112 INFO:teuthology.orchestra.run.smithi008.stdout: "time": "2023-08-01T19:54:04.469287+0000", 2023-08-01T19:54:24.112 INFO:teuthology.orchestra.run.smithi008.stdout: "duration": 4.7821999999999997e-05 2023-08-01T19:54:24.112 INFO:teuthology.orchestra.run.smithi008.stdout: } 2023-08-01T19:54:24.112 INFO:teuthology.orchestra.run.smithi008.stdout: ] 2023-08-01T19:54:24.112 INFO:teuthology.orchestra.run.smithi008.stdout: } 2023-08-01T19:54:24.113 INFO:teuthology.orchestra.run.smithi008.stdout: }, 2023-08-01T19:54:24.113 INFO:teuthology.orchestra.run.smithi008.stdout: { 2023-08-01T19:54:24.113 INFO:teuthology.orchestra.run.smithi008.stdout: "description": "osd_op(mds.0.3:25 3.7 3:e0b41d06:::609.00000000:head [create,setxattr parent (62) in=6b,setxattr layout (30) in=6b] snapc 0=[] ondisk+write+known_if_redirected+full_force+supports_pool_eio e17)", 2023-08-01T19:54:24.113 INFO:teuthology.orchestra.run.smithi008.stdout: "initiated_at": "2023-08-01T19:54:04.459206+0000", 2023-08-01T19:54:24.113 INFO:teuthology.orchestra.run.smithi008.stdout: "age": 19.617448624000001, 2023-08-01T19:54:24.113 INFO:teuthology.orchestra.run.smithi008.stdout: "duration": 0.012197100000000001, 2023-08-01T19:54:24.113 INFO:teuthology.orchestra.run.smithi008.stdout: "type_data": { 2023-08-01T19:54:24.113 INFO:teuthology.orchestra.run.smithi008.stdout: "flag_point": "commit sent; apply or cleanup", 2023-08-01T19:54:24.114 INFO:teuthology.orchestra.run.smithi008.stdout: "events": [ 2023-08-01T19:54:24.114 INFO:teuthology.orchestra.run.smithi008.stdout: { 2023-08-01T19:54:24.114 INFO:teuthology.orchestra.run.smithi008.stdout: "event": "initiated", 2023-08-01T19:54:24.114 INFO:teuthology.orchestra.run.smithi008.stdout: "time": "2023-08-01T19:54:04.459206+0000", 2023-08-01T19:54:24.114 INFO:teuthology.orchestra.run.smithi008.stdout: "duration": 0 2023-08-01T19:54:24.114 INFO:teuthology.orchestra.run.smithi008.stdout: }, 2023-08-01T19:54:24.114 INFO:teuthology.orchestra.run.smithi008.stdout: { 2023-08-01T19:54:24.115 INFO:teuthology.orchestra.run.smithi008.stdout: "event": "throttled", 2023-08-01T19:54:24.115 INFO:teuthology.orchestra.run.smithi008.stdout: "time": "2023-08-01T19:54:04.459206+0000", 2023-08-01T19:54:24.115 INFO:teuthology.orchestra.run.smithi008.stdout: "duration": 0 2023-08-01T19:54:24.115 INFO:teuthology.orchestra.run.smithi008.stdout: }, 2023-08-01T19:54:24.115 INFO:teuthology.orchestra.run.smithi008.stdout: { 2023-08-01T19:54:24.115 INFO:teuthology.orchestra.run.smithi008.stdout: "event": "header_read", 2023-08-01T19:54:24.115 INFO:teuthology.orchestra.run.smithi008.stdout: "time": "2023-08-01T19:54:04.459206+0000", 2023-08-01T19:54:24.115 INFO:teuthology.orchestra.run.smithi008.stdout: "duration": 4294967295.9999995 2023-08-01T19:54:24.116 INFO:teuthology.orchestra.run.smithi008.stdout: }, 2023-08-01T19:54:24.116 INFO:teuthology.orchestra.run.smithi008.stdout: { 2023-08-01T19:54:24.116 INFO:teuthology.orchestra.run.smithi008.stdout: "event": "all_read", 2023-08-01T19:54:24.116 INFO:teuthology.orchestra.run.smithi008.stdout: "time": "2023-08-01T19:54:04.459209+0000", 2023-08-01T19:54:24.116 INFO:teuthology.orchestra.run.smithi008.stdout: "duration": 3.7500000000000001e-06 2023-08-01T19:54:24.116 INFO:teuthology.orchestra.run.smithi008.stdout: }, 2023-08-01T19:54:24.116 INFO:teuthology.orchestra.run.smithi008.stdout: { 2023-08-01T19:54:24.116 INFO:teuthology.orchestra.run.smithi008.stdout: "event": "dispatched", 2023-08-01T19:54:24.117 INFO:teuthology.orchestra.run.smithi008.stdout: "time": "2023-08-01T19:54:04.459216+0000", 2023-08-01T19:54:24.117 INFO:teuthology.orchestra.run.smithi008.stdout: "duration": 6.7560000000000002e-06 2023-08-01T19:54:24.117 INFO:teuthology.orchestra.run.smithi008.stdout: }, 2023-08-01T19:54:24.117 INFO:teuthology.orchestra.run.smithi008.stdout: { 2023-08-01T19:54:24.117 INFO:teuthology.orchestra.run.smithi008.stdout: "event": "queued_for_pg", 2023-08-01T19:54:24.117 INFO:teuthology.orchestra.run.smithi008.stdout: "time": "2023-08-01T19:54:04.459221+0000", 2023-08-01T19:54:24.117 INFO:teuthology.orchestra.run.smithi008.stdout: "duration": 5.1760000000000001e-06 2023-08-01T19:54:24.117 INFO:teuthology.orchestra.run.smithi008.stdout: }, 2023-08-01T19:54:24.118 INFO:teuthology.orchestra.run.smithi008.stdout: { 2023-08-01T19:54:24.118 INFO:teuthology.orchestra.run.smithi008.stdout: "event": "reached_pg", 2023-08-01T19:54:24.118 INFO:teuthology.orchestra.run.smithi008.stdout: "time": "2023-08-01T19:54:04.459918+0000", 2023-08-01T19:54:24.118 INFO:teuthology.orchestra.run.smithi008.stdout: "duration": 0.000696716 2023-08-01T19:54:24.118 INFO:teuthology.orchestra.run.smithi008.stdout: }, 2023-08-01T19:54:24.118 INFO:teuthology.orchestra.run.smithi008.stdout: { 2023-08-01T19:54:24.118 INFO:teuthology.orchestra.run.smithi008.stdout: "event": "waiting_for_map not empty", 2023-08-01T19:54:24.118 INFO:teuthology.orchestra.run.smithi008.stdout: "time": "2023-08-01T19:54:04.459923+0000", 2023-08-01T19:54:24.119 INFO:teuthology.orchestra.run.smithi008.stdout: "duration": 4.4279999999999998e-06 2023-08-01T19:54:24.119 INFO:teuthology.orchestra.run.smithi008.stdout: }, 2023-08-01T19:54:24.119 INFO:teuthology.orchestra.run.smithi008.stdout: { 2023-08-01T19:54:24.119 INFO:teuthology.orchestra.run.smithi008.stdout: "event": "reached_pg", 2023-08-01T19:54:24.119 INFO:teuthology.orchestra.run.smithi008.stdout: "time": "2023-08-01T19:54:04.462299+0000", 2023-08-01T19:54:24.119 INFO:teuthology.orchestra.run.smithi008.stdout: "duration": 0.0023762929999999998 2023-08-01T19:54:24.119 INFO:teuthology.orchestra.run.smithi008.stdout: }, 2023-08-01T19:54:24.119 INFO:teuthology.orchestra.run.smithi008.stdout: { 2023-08-01T19:54:24.120 INFO:teuthology.orchestra.run.smithi008.stdout: "event": "started", 2023-08-01T19:54:24.120 INFO:teuthology.orchestra.run.smithi008.stdout: "time": "2023-08-01T19:54:04.462362+0000", 2023-08-01T19:54:24.120 INFO:teuthology.orchestra.run.smithi008.stdout: "duration": 6.2707999999999997e-05 2023-08-01T19:54:24.120 INFO:teuthology.orchestra.run.smithi008.stdout: }, 2023-08-01T19:54:24.120 INFO:teuthology.orchestra.run.smithi008.stdout: { 2023-08-01T19:54:24.120 INFO:teuthology.orchestra.run.smithi008.stdout: "event": "waiting for subops from 2", 2023-08-01T19:54:24.120 INFO:teuthology.orchestra.run.smithi008.stdout: "time": "2023-08-01T19:54:04.462468+0000", 2023-08-01T19:54:24.121 INFO:teuthology.orchestra.run.smithi008.stdout: "duration": 0.000106592 2023-08-01T19:54:24.121 INFO:teuthology.orchestra.run.smithi008.stdout: }, 2023-08-01T19:54:24.121 INFO:teuthology.orchestra.run.smithi008.stdout: { 2023-08-01T19:54:24.121 INFO:teuthology.orchestra.run.smithi008.stdout: "event": "op_commit", 2023-08-01T19:54:24.121 INFO:teuthology.orchestra.run.smithi008.stdout: "time": "2023-08-01T19:54:04.466803+0000", 2023-08-01T19:54:24.121 INFO:teuthology.orchestra.run.smithi008.stdout: "duration": 0.0043350410000000004 2023-08-01T19:54:24.121 INFO:teuthology.orchestra.run.smithi008.stdout: }, 2023-08-01T19:54:24.121 INFO:teuthology.orchestra.run.smithi008.stdout: { 2023-08-01T19:54:24.122 INFO:teuthology.orchestra.run.smithi008.stdout: "event": "sub_op_commit_rec", 2023-08-01T19:54:24.122 INFO:teuthology.orchestra.run.smithi008.stdout: "time": "2023-08-01T19:54:04.471130+0000", 2023-08-01T19:54:24.122 INFO:teuthology.orchestra.run.smithi008.stdout: "duration": 0.0043265329999999996 2023-08-01T19:54:24.122 INFO:teuthology.orchestra.run.smithi008.stdout: }, 2023-08-01T19:54:24.122 INFO:teuthology.orchestra.run.smithi008.stdout: { 2023-08-01T19:54:24.122 INFO:teuthology.orchestra.run.smithi008.stdout: "event": "commit_sent", 2023-08-01T19:54:24.122 INFO:teuthology.orchestra.run.smithi008.stdout: "time": "2023-08-01T19:54:04.471355+0000", 2023-08-01T19:54:24.122 INFO:teuthology.orchestra.run.smithi008.stdout: "duration": 0.00022495999999999999 2023-08-01T19:54:24.123 INFO:teuthology.orchestra.run.smithi008.stdout: }, 2023-08-01T19:54:24.123 INFO:teuthology.orchestra.run.smithi008.stdout: { 2023-08-01T19:54:24.123 INFO:teuthology.orchestra.run.smithi008.stdout: "event": "done", 2023-08-01T19:54:24.123 INFO:teuthology.orchestra.run.smithi008.stdout: "time": "2023-08-01T19:54:04.471403+0000", 2023-08-01T19:54:24.123 INFO:teuthology.orchestra.run.smithi008.stdout: "duration": 4.8662999999999998e-05 2023-08-01T19:54:24.123 INFO:teuthology.orchestra.run.smithi008.stdout: } 2023-08-01T19:54:24.123 INFO:teuthology.orchestra.run.smithi008.stdout: ] 2023-08-01T19:54:24.123 INFO:teuthology.orchestra.run.smithi008.stdout: } 2023-08-01T19:54:24.124 INFO:teuthology.orchestra.run.smithi008.stdout: }, 2023-08-01T19:54:24.124 INFO:teuthology.orchestra.run.smithi008.stdout: { 2023-08-01T19:54:24.124 INFO:teuthology.orchestra.run.smithi008.stdout: "description": "osd_op(mds.0.3:26 3.1f 3:fe07bba1:::100.00000000.inode:head [writefull 0~554] snapc 0=[] ondisk+write+known_if_redirected+full_force+supports_pool_eio e17)", 2023-08-01T19:54:24.124 INFO:teuthology.orchestra.run.smithi008.stdout: "initiated_at": "2023-08-01T19:54:04.459230+0000", 2023-08-01T19:54:24.124 INFO:teuthology.orchestra.run.smithi008.stdout: "age": 19.617425107999999, 2023-08-01T19:54:24.124 INFO:teuthology.orchestra.run.smithi008.stdout: "duration": 0.013017103, 2023-08-01T19:54:24.124 INFO:teuthology.orchestra.run.smithi008.stdout: "type_data": { 2023-08-01T19:54:24.124 INFO:teuthology.orchestra.run.smithi008.stdout: "flag_point": "commit sent; apply or cleanup", 2023-08-01T19:54:24.125 INFO:teuthology.orchestra.run.smithi008.stdout: "events": [ 2023-08-01T19:54:24.125 INFO:teuthology.orchestra.run.smithi008.stdout: { 2023-08-01T19:54:24.125 INFO:teuthology.orchestra.run.smithi008.stdout: "event": "initiated", 2023-08-01T19:54:24.125 INFO:teuthology.orchestra.run.smithi008.stdout: "time": "2023-08-01T19:54:04.459230+0000", 2023-08-01T19:54:24.125 INFO:teuthology.orchestra.run.smithi008.stdout: "duration": 0 2023-08-01T19:54:24.125 INFO:teuthology.orchestra.run.smithi008.stdout: }, 2023-08-01T19:54:24.125 INFO:teuthology.orchestra.run.smithi008.stdout: { 2023-08-01T19:54:24.125 INFO:teuthology.orchestra.run.smithi008.stdout: "event": "throttled", 2023-08-01T19:54:24.126 INFO:teuthology.orchestra.run.smithi008.stdout: "time": "2023-08-01T19:54:04.459230+0000", 2023-08-01T19:54:24.126 INFO:teuthology.orchestra.run.smithi008.stdout: "duration": 0 2023-08-01T19:54:24.126 INFO:teuthology.orchestra.run.smithi008.stdout: }, 2023-08-01T19:54:24.126 INFO:teuthology.orchestra.run.smithi008.stdout: { 2023-08-01T19:54:24.126 INFO:teuthology.orchestra.run.smithi008.stdout: "event": "header_read", 2023-08-01T19:54:24.126 INFO:teuthology.orchestra.run.smithi008.stdout: "time": "2023-08-01T19:54:04.459229+0000", 2023-08-01T19:54:24.126 INFO:teuthology.orchestra.run.smithi008.stdout: "duration": 4294967295.9999995 2023-08-01T19:54:24.127 INFO:teuthology.orchestra.run.smithi008.stdout: }, 2023-08-01T19:54:24.127 INFO:teuthology.orchestra.run.smithi008.stdout: { 2023-08-01T19:54:24.127 INFO:teuthology.orchestra.run.smithi008.stdout: "event": "all_read", 2023-08-01T19:54:24.127 INFO:teuthology.orchestra.run.smithi008.stdout: "time": "2023-08-01T19:54:04.459233+0000", 2023-08-01T19:54:24.127 INFO:teuthology.orchestra.run.smithi008.stdout: "duration": 3.7400000000000002e-06 2023-08-01T19:54:24.127 INFO:teuthology.orchestra.run.smithi008.stdout: }, 2023-08-01T19:54:24.127 INFO:teuthology.orchestra.run.smithi008.stdout: { 2023-08-01T19:54:24.127 INFO:teuthology.orchestra.run.smithi008.stdout: "event": "dispatched", 2023-08-01T19:54:24.128 INFO:teuthology.orchestra.run.smithi008.stdout: "time": "2023-08-01T19:54:04.459240+0000", 2023-08-01T19:54:24.128 INFO:teuthology.orchestra.run.smithi008.stdout: "duration": 6.9059999999999996e-06 2023-08-01T19:54:24.128 INFO:teuthology.orchestra.run.smithi008.stdout: }, 2023-08-01T19:54:24.128 INFO:teuthology.orchestra.run.smithi008.stdout: { 2023-08-01T19:54:24.128 INFO:teuthology.orchestra.run.smithi008.stdout: "event": "queued_for_pg", 2023-08-01T19:54:24.128 INFO:teuthology.orchestra.run.smithi008.stdout: "time": "2023-08-01T19:54:04.459245+0000", 2023-08-01T19:54:24.128 INFO:teuthology.orchestra.run.smithi008.stdout: "duration": 4.8890000000000001e-06 2023-08-01T19:54:24.129 INFO:teuthology.orchestra.run.smithi008.stdout: }, 2023-08-01T19:54:24.129 INFO:teuthology.orchestra.run.smithi008.stdout: { 2023-08-01T19:54:24.129 INFO:teuthology.orchestra.run.smithi008.stdout: "event": "reached_pg", 2023-08-01T19:54:24.129 INFO:teuthology.orchestra.run.smithi008.stdout: "time": "2023-08-01T19:54:04.459954+0000", 2023-08-01T19:54:24.129 INFO:teuthology.orchestra.run.smithi008.stdout: "duration": 0.00070883100000000004 2023-08-01T19:54:24.129 INFO:teuthology.orchestra.run.smithi008.stdout: }, 2023-08-01T19:54:24.129 INFO:teuthology.orchestra.run.smithi008.stdout: { 2023-08-01T19:54:24.129 INFO:teuthology.orchestra.run.smithi008.stdout: "event": "waiting_for_map not empty", 2023-08-01T19:54:24.130 INFO:teuthology.orchestra.run.smithi008.stdout: "time": "2023-08-01T19:54:04.459959+0000", 2023-08-01T19:54:24.130 INFO:teuthology.orchestra.run.smithi008.stdout: "duration": 5.1340000000000003e-06 2023-08-01T19:54:24.130 INFO:teuthology.orchestra.run.smithi008.stdout: }, 2023-08-01T19:54:24.130 INFO:teuthology.orchestra.run.smithi008.stdout: { 2023-08-01T19:54:24.130 INFO:teuthology.orchestra.run.smithi008.stdout: "event": "reached_pg", 2023-08-01T19:54:24.130 INFO:teuthology.orchestra.run.smithi008.stdout: "time": "2023-08-01T19:54:04.462796+0000", 2023-08-01T19:54:24.130 INFO:teuthology.orchestra.run.smithi008.stdout: "duration": 0.0028374070000000001 2023-08-01T19:54:24.130 INFO:teuthology.orchestra.run.smithi008.stdout: }, 2023-08-01T19:54:24.131 INFO:teuthology.orchestra.run.smithi008.stdout: { 2023-08-01T19:54:24.131 INFO:teuthology.orchestra.run.smithi008.stdout: "event": "started", 2023-08-01T19:54:24.131 INFO:teuthology.orchestra.run.smithi008.stdout: "time": "2023-08-01T19:54:04.463137+0000", 2023-08-01T19:54:24.131 INFO:teuthology.orchestra.run.smithi008.stdout: "duration": 0.00034093699999999998 2023-08-01T19:54:24.131 INFO:teuthology.orchestra.run.smithi008.stdout: }, 2023-08-01T19:54:24.131 INFO:teuthology.orchestra.run.smithi008.stdout: { 2023-08-01T19:54:24.131 INFO:teuthology.orchestra.run.smithi008.stdout: "event": "waiting for subops from 1", 2023-08-01T19:54:24.131 INFO:teuthology.orchestra.run.smithi008.stdout: "time": "2023-08-01T19:54:04.463290+0000", 2023-08-01T19:54:24.132 INFO:teuthology.orchestra.run.smithi008.stdout: "duration": 0.00015267899999999999 2023-08-01T19:54:24.132 INFO:teuthology.orchestra.run.smithi008.stdout: }, 2023-08-01T19:54:24.132 INFO:teuthology.orchestra.run.smithi008.stdout: { 2023-08-01T19:54:24.132 INFO:teuthology.orchestra.run.smithi008.stdout: "event": "op_commit", 2023-08-01T19:54:24.132 INFO:teuthology.orchestra.run.smithi008.stdout: "time": "2023-08-01T19:54:04.470442+0000", 2023-08-01T19:54:24.132 INFO:teuthology.orchestra.run.smithi008.stdout: "duration": 0.0071526230000000003 2023-08-01T19:54:24.132 INFO:teuthology.orchestra.run.smithi008.stdout: }, 2023-08-01T19:54:24.133 INFO:teuthology.orchestra.run.smithi008.stdout: { 2023-08-01T19:54:24.133 INFO:teuthology.orchestra.run.smithi008.stdout: "event": "sub_op_commit_rec", 2023-08-01T19:54:24.133 INFO:teuthology.orchestra.run.smithi008.stdout: "time": "2023-08-01T19:54:04.472154+0000", 2023-08-01T19:54:24.133 INFO:teuthology.orchestra.run.smithi008.stdout: "duration": 0.0017111450000000001 2023-08-01T19:54:24.133 INFO:teuthology.orchestra.run.smithi008.stdout: }, 2023-08-01T19:54:24.133 INFO:teuthology.orchestra.run.smithi008.stdout: { 2023-08-01T19:54:24.133 INFO:teuthology.orchestra.run.smithi008.stdout: "event": "commit_sent", 2023-08-01T19:54:24.133 INFO:teuthology.orchestra.run.smithi008.stdout: "time": "2023-08-01T19:54:04.472207+0000", 2023-08-01T19:54:24.134 INFO:teuthology.orchestra.run.smithi008.stdout: "duration": 5.3059999999999997e-05 2023-08-01T19:54:24.134 INFO:teuthology.orchestra.run.smithi008.stdout: }, 2023-08-01T19:54:24.134 INFO:teuthology.orchestra.run.smithi008.stdout: { 2023-08-01T19:54:24.134 INFO:teuthology.orchestra.run.smithi008.stdout: "event": "done", 2023-08-01T19:54:24.134 INFO:teuthology.orchestra.run.smithi008.stdout: "time": "2023-08-01T19:54:04.472247+0000", 2023-08-01T19:54:24.134 INFO:teuthology.orchestra.run.smithi008.stdout: "duration": 4.0213999999999998e-05 2023-08-01T19:54:24.134 INFO:teuthology.orchestra.run.smithi008.stdout: } 2023-08-01T19:54:24.134 INFO:teuthology.orchestra.run.smithi008.stdout: ] 2023-08-01T19:54:24.135 INFO:teuthology.orchestra.run.smithi008.stdout: } 2023-08-01T19:54:24.135 INFO:teuthology.orchestra.run.smithi008.stdout: }, 2023-08-01T19:54:24.135 INFO:teuthology.orchestra.run.smithi008.stdout: { 2023-08-01T19:54:24.135 INFO:teuthology.orchestra.run.smithi008.stdout: "description": "osd_op(mds.0.3:28 3.b 3:d0630e4c:::mds0_sessionmap:head [omap-set-header] snapc 0=[] ondisk+write+known_if_redirected+full_force+supports_pool_eio e17)", 2023-08-01T19:54:24.135 INFO:teuthology.orchestra.run.smithi008.stdout: "initiated_at": "2023-08-01T19:54:04.459251+0000", 2023-08-01T19:54:24.135 INFO:teuthology.orchestra.run.smithi008.stdout: "age": 19.617403905, 2023-08-01T19:54:24.135 INFO:teuthology.orchestra.run.smithi008.stdout: "duration": 0.01361938, 2023-08-01T19:54:24.135 INFO:teuthology.orchestra.run.smithi008.stdout: "type_data": { 2023-08-01T19:54:24.136 INFO:teuthology.orchestra.run.smithi008.stdout: "flag_point": "commit sent; apply or cleanup", 2023-08-01T19:54:24.136 INFO:teuthology.orchestra.run.smithi008.stdout: "events": [ 2023-08-01T19:54:24.136 INFO:teuthology.orchestra.run.smithi008.stdout: { 2023-08-01T19:54:24.136 INFO:teuthology.orchestra.run.smithi008.stdout: "event": "initiated", 2023-08-01T19:54:24.136 INFO:teuthology.orchestra.run.smithi008.stdout: "time": "2023-08-01T19:54:04.459251+0000", 2023-08-01T19:54:24.136 INFO:teuthology.orchestra.run.smithi008.stdout: "duration": 0 2023-08-01T19:54:24.136 INFO:teuthology.orchestra.run.smithi008.stdout: }, 2023-08-01T19:54:24.136 INFO:teuthology.orchestra.run.smithi008.stdout: { 2023-08-01T19:54:24.137 INFO:teuthology.orchestra.run.smithi008.stdout: "event": "throttled", 2023-08-01T19:54:24.137 INFO:teuthology.orchestra.run.smithi008.stdout: "time": "2023-08-01T19:54:04.459251+0000", 2023-08-01T19:54:24.137 INFO:teuthology.orchestra.run.smithi008.stdout: "duration": 0 2023-08-01T19:54:24.137 INFO:teuthology.orchestra.run.smithi008.stdout: }, 2023-08-01T19:54:24.137 INFO:teuthology.orchestra.run.smithi008.stdout: { 2023-08-01T19:54:24.137 INFO:teuthology.orchestra.run.smithi008.stdout: "event": "header_read", 2023-08-01T19:54:24.137 INFO:teuthology.orchestra.run.smithi008.stdout: "time": "2023-08-01T19:54:04.459251+0000", 2023-08-01T19:54:24.137 INFO:teuthology.orchestra.run.smithi008.stdout: "duration": 4294967295.9999995 2023-08-01T19:54:24.138 INFO:teuthology.orchestra.run.smithi008.stdout: }, 2023-08-01T19:54:24.138 INFO:teuthology.orchestra.run.smithi008.stdout: { 2023-08-01T19:54:24.138 INFO:teuthology.orchestra.run.smithi008.stdout: "event": "all_read", 2023-08-01T19:54:24.138 INFO:teuthology.orchestra.run.smithi008.stdout: "time": "2023-08-01T19:54:04.459258+0000", 2023-08-01T19:54:24.138 INFO:teuthology.orchestra.run.smithi008.stdout: "duration": 7.0029999999999997e-06 2023-08-01T19:54:24.138 INFO:teuthology.orchestra.run.smithi008.stdout: }, 2023-08-01T19:54:24.138 INFO:teuthology.orchestra.run.smithi008.stdout: { 2023-08-01T19:54:24.138 INFO:teuthology.orchestra.run.smithi008.stdout: "event": "dispatched", 2023-08-01T19:54:24.139 INFO:teuthology.orchestra.run.smithi008.stdout: "time": "2023-08-01T19:54:04.459267+0000", 2023-08-01T19:54:24.139 INFO:teuthology.orchestra.run.smithi008.stdout: "duration": 8.8810000000000002e-06 2023-08-01T19:54:24.139 INFO:teuthology.orchestra.run.smithi008.stdout: }, 2023-08-01T19:54:24.139 INFO:teuthology.orchestra.run.smithi008.stdout: { 2023-08-01T19:54:24.139 INFO:teuthology.orchestra.run.smithi008.stdout: "event": "queued_for_pg", 2023-08-01T19:54:24.139 INFO:teuthology.orchestra.run.smithi008.stdout: "time": "2023-08-01T19:54:04.459273+0000", 2023-08-01T19:54:24.139 INFO:teuthology.orchestra.run.smithi008.stdout: "duration": 5.9279999999999998e-06 2023-08-01T19:54:24.139 INFO:teuthology.orchestra.run.smithi008.stdout: }, 2023-08-01T19:54:24.140 INFO:teuthology.orchestra.run.smithi008.stdout: { 2023-08-01T19:54:24.140 INFO:teuthology.orchestra.run.smithi008.stdout: "event": "reached_pg", 2023-08-01T19:54:24.140 INFO:teuthology.orchestra.run.smithi008.stdout: "time": "2023-08-01T19:54:04.460798+0000", 2023-08-01T19:54:24.140 INFO:teuthology.orchestra.run.smithi008.stdout: "duration": 0.001525039 2023-08-01T19:54:24.140 INFO:teuthology.orchestra.run.smithi008.stdout: }, 2023-08-01T19:54:24.140 INFO:teuthology.orchestra.run.smithi008.stdout: { 2023-08-01T19:54:24.140 INFO:teuthology.orchestra.run.smithi008.stdout: "event": "started", 2023-08-01T19:54:24.141 INFO:teuthology.orchestra.run.smithi008.stdout: "time": "2023-08-01T19:54:04.460951+0000", 2023-08-01T19:54:24.141 INFO:teuthology.orchestra.run.smithi008.stdout: "duration": 0.000153024 2023-08-01T19:54:24.141 INFO:teuthology.orchestra.run.smithi008.stdout: }, 2023-08-01T19:54:24.141 INFO:teuthology.orchestra.run.smithi008.stdout: { 2023-08-01T19:54:24.141 INFO:teuthology.orchestra.run.smithi008.stdout: "event": "waiting for subops from 1", 2023-08-01T19:54:24.141 INFO:teuthology.orchestra.run.smithi008.stdout: "time": "2023-08-01T19:54:04.461116+0000", 2023-08-01T19:54:24.141 INFO:teuthology.orchestra.run.smithi008.stdout: "duration": 0.00016551000000000001 2023-08-01T19:54:24.141 INFO:teuthology.orchestra.run.smithi008.stdout: }, 2023-08-01T19:54:24.142 INFO:teuthology.orchestra.run.smithi008.stdout: { 2023-08-01T19:54:24.142 INFO:teuthology.orchestra.run.smithi008.stdout: "event": "op_commit", 2023-08-01T19:54:24.142 INFO:teuthology.orchestra.run.smithi008.stdout: "time": "2023-08-01T19:54:04.463448+0000", 2023-08-01T19:54:24.142 INFO:teuthology.orchestra.run.smithi008.stdout: "duration": 0.0023321689999999998 2023-08-01T19:54:24.142 INFO:teuthology.orchestra.run.smithi008.stdout: }, 2023-08-01T19:54:24.142 INFO:teuthology.orchestra.run.smithi008.stdout: { 2023-08-01T19:54:24.142 INFO:teuthology.orchestra.run.smithi008.stdout: "event": "sub_op_commit_rec", 2023-08-01T19:54:24.142 INFO:teuthology.orchestra.run.smithi008.stdout: "time": "2023-08-01T19:54:04.472778+0000", 2023-08-01T19:54:24.143 INFO:teuthology.orchestra.run.smithi008.stdout: "duration": 0.0093293779999999993 2023-08-01T19:54:24.143 INFO:teuthology.orchestra.run.smithi008.stdout: }, 2023-08-01T19:54:24.143 INFO:teuthology.orchestra.run.smithi008.stdout: { 2023-08-01T19:54:24.143 INFO:teuthology.orchestra.run.smithi008.stdout: "event": "commit_sent", 2023-08-01T19:54:24.143 INFO:teuthology.orchestra.run.smithi008.stdout: "time": "2023-08-01T19:54:04.472821+0000", 2023-08-01T19:54:24.143 INFO:teuthology.orchestra.run.smithi008.stdout: "duration": 4.3253000000000001e-05 2023-08-01T19:54:24.143 INFO:teuthology.orchestra.run.smithi008.stdout: }, 2023-08-01T19:54:24.143 INFO:teuthology.orchestra.run.smithi008.stdout: { 2023-08-01T19:54:24.144 INFO:teuthology.orchestra.run.smithi008.stdout: "event": "done", 2023-08-01T19:54:24.144 INFO:teuthology.orchestra.run.smithi008.stdout: "time": "2023-08-01T19:54:04.472870+0000", 2023-08-01T19:54:24.144 INFO:teuthology.orchestra.run.smithi008.stdout: "duration": 4.9478999999999998e-05 2023-08-01T19:54:24.144 INFO:teuthology.orchestra.run.smithi008.stdout: } 2023-08-01T19:54:24.144 INFO:teuthology.orchestra.run.smithi008.stdout: ] 2023-08-01T19:54:24.144 INFO:teuthology.orchestra.run.smithi008.stdout: } 2023-08-01T19:54:24.144 INFO:teuthology.orchestra.run.smithi008.stdout: }, 2023-08-01T19:54:24.144 INFO:teuthology.orchestra.run.smithi008.stdout: { 2023-08-01T19:54:24.145 INFO:teuthology.orchestra.run.smithi008.stdout: "description": "osd_op(mds.0.3:34 3.b 3:d5c7a900:::200.00000003:head [delete] snapc 0=[] ondisk+write+known_if_redirected+full_force+supports_pool_eio e17)", 2023-08-01T19:54:24.145 INFO:teuthology.orchestra.run.smithi008.stdout: "initiated_at": "2023-08-01T19:54:04.459662+0000", 2023-08-01T19:54:24.145 INFO:teuthology.orchestra.run.smithi008.stdout: "age": 19.616993201, 2023-08-01T19:54:24.145 INFO:teuthology.orchestra.run.smithi008.stdout: "duration": 0.013345101999999999, 2023-08-01T19:54:24.145 INFO:teuthology.orchestra.run.smithi008.stdout: "type_data": { 2023-08-01T19:54:24.145 INFO:teuthology.orchestra.run.smithi008.stdout: "flag_point": "started", 2023-08-01T19:54:24.145 INFO:teuthology.orchestra.run.smithi008.stdout: "events": [ 2023-08-01T19:54:24.145 INFO:teuthology.orchestra.run.smithi008.stdout: { 2023-08-01T19:54:24.146 INFO:teuthology.orchestra.run.smithi008.stdout: "event": "initiated", 2023-08-01T19:54:24.146 INFO:teuthology.orchestra.run.smithi008.stdout: "time": "2023-08-01T19:54:04.459662+0000", 2023-08-01T19:54:24.146 INFO:teuthology.orchestra.run.smithi008.stdout: "duration": 0 2023-08-01T19:54:24.146 INFO:teuthology.orchestra.run.smithi008.stdout: }, 2023-08-01T19:54:24.146 INFO:teuthology.orchestra.run.smithi008.stdout: { 2023-08-01T19:54:24.146 INFO:teuthology.orchestra.run.smithi008.stdout: "event": "throttled", 2023-08-01T19:54:24.146 INFO:teuthology.orchestra.run.smithi008.stdout: "time": "2023-08-01T19:54:04.459662+0000", 2023-08-01T19:54:24.147 INFO:teuthology.orchestra.run.smithi008.stdout: "duration": 0 2023-08-01T19:54:24.147 INFO:teuthology.orchestra.run.smithi008.stdout: }, 2023-08-01T19:54:24.147 INFO:teuthology.orchestra.run.smithi008.stdout: { 2023-08-01T19:54:24.147 INFO:teuthology.orchestra.run.smithi008.stdout: "event": "header_read", 2023-08-01T19:54:24.147 INFO:teuthology.orchestra.run.smithi008.stdout: "time": "2023-08-01T19:54:04.459661+0000", 2023-08-01T19:54:24.147 INFO:teuthology.orchestra.run.smithi008.stdout: "duration": 4294967295.999999 2023-08-01T19:54:24.147 INFO:teuthology.orchestra.run.smithi008.stdout: }, 2023-08-01T19:54:24.147 INFO:teuthology.orchestra.run.smithi008.stdout: { 2023-08-01T19:54:24.148 INFO:teuthology.orchestra.run.smithi008.stdout: "event": "all_read", 2023-08-01T19:54:24.148 INFO:teuthology.orchestra.run.smithi008.stdout: "time": "2023-08-01T19:54:04.459668+0000", 2023-08-01T19:54:24.148 INFO:teuthology.orchestra.run.smithi008.stdout: "duration": 7.0219999999999999e-06 2023-08-01T19:54:24.148 INFO:teuthology.orchestra.run.smithi008.stdout: }, 2023-08-01T19:54:24.148 INFO:teuthology.orchestra.run.smithi008.stdout: { 2023-08-01T19:54:24.148 INFO:teuthology.orchestra.run.smithi008.stdout: "event": "dispatched", 2023-08-01T19:54:24.148 INFO:teuthology.orchestra.run.smithi008.stdout: "time": "2023-08-01T19:54:04.459681+0000", 2023-08-01T19:54:24.148 INFO:teuthology.orchestra.run.smithi008.stdout: "duration": 1.2999999999999999e-05 2023-08-01T19:54:24.149 INFO:teuthology.orchestra.run.smithi008.stdout: }, 2023-08-01T19:54:24.149 INFO:teuthology.orchestra.run.smithi008.stdout: { 2023-08-01T19:54:24.149 INFO:teuthology.orchestra.run.smithi008.stdout: "event": "queued_for_pg", 2023-08-01T19:54:24.149 INFO:teuthology.orchestra.run.smithi008.stdout: "time": "2023-08-01T19:54:04.459690+0000", 2023-08-01T19:54:24.149 INFO:teuthology.orchestra.run.smithi008.stdout: "duration": 9.2529999999999993e-06 2023-08-01T19:54:24.149 INFO:teuthology.orchestra.run.smithi008.stdout: }, 2023-08-01T19:54:24.149 INFO:teuthology.orchestra.run.smithi008.stdout: { 2023-08-01T19:54:24.149 INFO:teuthology.orchestra.run.smithi008.stdout: "event": "reached_pg", 2023-08-01T19:54:24.150 INFO:teuthology.orchestra.run.smithi008.stdout: "time": "2023-08-01T19:54:04.461862+0000", 2023-08-01T19:54:24.150 INFO:teuthology.orchestra.run.smithi008.stdout: "duration": 0.002172345 2023-08-01T19:54:24.150 INFO:teuthology.orchestra.run.smithi008.stdout: }, 2023-08-01T19:54:24.150 INFO:teuthology.orchestra.run.smithi008.stdout: { 2023-08-01T19:54:24.150 INFO:teuthology.orchestra.run.smithi008.stdout: "event": "started", 2023-08-01T19:54:24.150 INFO:teuthology.orchestra.run.smithi008.stdout: "time": "2023-08-01T19:54:04.462013+0000", 2023-08-01T19:54:24.150 INFO:teuthology.orchestra.run.smithi008.stdout: "duration": 0.00015044200000000001 2023-08-01T19:54:24.150 INFO:teuthology.orchestra.run.smithi008.stdout: }, 2023-08-01T19:54:24.151 INFO:teuthology.orchestra.run.smithi008.stdout: { 2023-08-01T19:54:24.151 INFO:teuthology.orchestra.run.smithi008.stdout: "event": "done", 2023-08-01T19:54:24.151 INFO:teuthology.orchestra.run.smithi008.stdout: "time": "2023-08-01T19:54:04.473007+0000", 2023-08-01T19:54:24.151 INFO:teuthology.orchestra.run.smithi008.stdout: "duration": 0.010994141000000001 2023-08-01T19:54:24.151 INFO:teuthology.orchestra.run.smithi008.stdout: } 2023-08-01T19:54:24.151 INFO:teuthology.orchestra.run.smithi008.stdout: ] 2023-08-01T19:54:24.151 INFO:teuthology.orchestra.run.smithi008.stdout: } 2023-08-01T19:54:24.151 INFO:teuthology.orchestra.run.smithi008.stdout: }, 2023-08-01T19:54:24.152 INFO:teuthology.orchestra.run.smithi008.stdout: { 2023-08-01T19:54:24.152 INFO:teuthology.orchestra.run.smithi008.stdout: "description": "osd_op(mds.0.3:35 3.1f 3:f83d65d8:::200.00000004:head [delete] snapc 0=[] ondisk+write+known_if_redirected+full_force+supports_pool_eio e17)", 2023-08-01T19:54:24.152 INFO:teuthology.orchestra.run.smithi008.stdout: "initiated_at": "2023-08-01T19:54:04.460657+0000", 2023-08-01T19:54:24.152 INFO:teuthology.orchestra.run.smithi008.stdout: "age": 19.615997620000002, 2023-08-01T19:54:24.152 INFO:teuthology.orchestra.run.smithi008.stdout: "duration": 0.012077002, 2023-08-01T19:54:24.152 INFO:teuthology.orchestra.run.smithi008.stdout: "type_data": { 2023-08-01T19:54:24.152 INFO:teuthology.orchestra.run.smithi008.stdout: "flag_point": "started", 2023-08-01T19:54:24.153 INFO:teuthology.orchestra.run.smithi008.stdout: "events": [ 2023-08-01T19:54:24.153 INFO:teuthology.orchestra.run.smithi008.stdout: { 2023-08-01T19:54:24.153 INFO:teuthology.orchestra.run.smithi008.stdout: "event": "initiated", 2023-08-01T19:54:24.153 INFO:teuthology.orchestra.run.smithi008.stdout: "time": "2023-08-01T19:54:04.460657+0000", 2023-08-01T19:54:24.153 INFO:teuthology.orchestra.run.smithi008.stdout: "duration": 0 2023-08-01T19:54:24.153 INFO:teuthology.orchestra.run.smithi008.stdout: }, 2023-08-01T19:54:24.153 INFO:teuthology.orchestra.run.smithi008.stdout: { 2023-08-01T19:54:24.153 INFO:teuthology.orchestra.run.smithi008.stdout: "event": "throttled", 2023-08-01T19:54:24.154 INFO:teuthology.orchestra.run.smithi008.stdout: "time": "2023-08-01T19:54:04.460657+0000", 2023-08-01T19:54:24.154 INFO:teuthology.orchestra.run.smithi008.stdout: "duration": 0 2023-08-01T19:54:24.154 INFO:teuthology.orchestra.run.smithi008.stdout: }, 2023-08-01T19:54:24.154 INFO:teuthology.orchestra.run.smithi008.stdout: { 2023-08-01T19:54:24.154 INFO:teuthology.orchestra.run.smithi008.stdout: "event": "header_read", 2023-08-01T19:54:24.154 INFO:teuthology.orchestra.run.smithi008.stdout: "time": "2023-08-01T19:54:04.460656+0000", 2023-08-01T19:54:24.154 INFO:teuthology.orchestra.run.smithi008.stdout: "duration": 4294967295.999999 2023-08-01T19:54:24.154 INFO:teuthology.orchestra.run.smithi008.stdout: }, 2023-08-01T19:54:24.155 INFO:teuthology.orchestra.run.smithi008.stdout: { 2023-08-01T19:54:24.155 INFO:teuthology.orchestra.run.smithi008.stdout: "event": "all_read", 2023-08-01T19:54:24.155 INFO:teuthology.orchestra.run.smithi008.stdout: "time": "2023-08-01T19:54:04.460662+0000", 2023-08-01T19:54:24.155 INFO:teuthology.orchestra.run.smithi008.stdout: "duration": 5.7450000000000001e-06 2023-08-01T19:54:24.155 INFO:teuthology.orchestra.run.smithi008.stdout: }, 2023-08-01T19:54:24.155 INFO:teuthology.orchestra.run.smithi008.stdout: { 2023-08-01T19:54:24.155 INFO:teuthology.orchestra.run.smithi008.stdout: "event": "dispatched", 2023-08-01T19:54:24.155 INFO:teuthology.orchestra.run.smithi008.stdout: "time": "2023-08-01T19:54:04.460674+0000", 2023-08-01T19:54:24.156 INFO:teuthology.orchestra.run.smithi008.stdout: "duration": 1.2329e-05 2023-08-01T19:54:24.156 INFO:teuthology.orchestra.run.smithi008.stdout: }, 2023-08-01T19:54:24.156 INFO:teuthology.orchestra.run.smithi008.stdout: { 2023-08-01T19:54:24.156 INFO:teuthology.orchestra.run.smithi008.stdout: "event": "queued_for_pg", 2023-08-01T19:54:24.156 INFO:teuthology.orchestra.run.smithi008.stdout: "time": "2023-08-01T19:54:04.460685+0000", 2023-08-01T19:54:24.156 INFO:teuthology.orchestra.run.smithi008.stdout: "duration": 1.0137e-05 2023-08-01T19:54:24.156 INFO:teuthology.orchestra.run.smithi008.stdout: }, 2023-08-01T19:54:24.157 INFO:teuthology.orchestra.run.smithi008.stdout: { 2023-08-01T19:54:24.157 INFO:teuthology.orchestra.run.smithi008.stdout: "event": "reached_pg", 2023-08-01T19:54:24.157 INFO:teuthology.orchestra.run.smithi008.stdout: "time": "2023-08-01T19:54:04.464433+0000", 2023-08-01T19:54:24.157 INFO:teuthology.orchestra.run.smithi008.stdout: "duration": 0.0037482240000000001 2023-08-01T19:54:24.157 INFO:teuthology.orchestra.run.smithi008.stdout: }, 2023-08-01T19:54:24.157 INFO:teuthology.orchestra.run.smithi008.stdout: { 2023-08-01T19:54:24.157 INFO:teuthology.orchestra.run.smithi008.stdout: "event": "started", 2023-08-01T19:54:24.157 INFO:teuthology.orchestra.run.smithi008.stdout: "time": "2023-08-01T19:54:04.464646+0000", 2023-08-01T19:54:24.158 INFO:teuthology.orchestra.run.smithi008.stdout: "duration": 0.00021296800000000001 2023-08-01T19:54:24.158 INFO:teuthology.orchestra.run.smithi008.stdout: }, 2023-08-01T19:54:24.158 INFO:teuthology.orchestra.run.smithi008.stdout: { 2023-08-01T19:54:24.158 INFO:teuthology.orchestra.run.smithi008.stdout: "event": "done", 2023-08-01T19:54:24.158 INFO:teuthology.orchestra.run.smithi008.stdout: "time": "2023-08-01T19:54:04.472734+0000", 2023-08-01T19:54:24.158 INFO:teuthology.orchestra.run.smithi008.stdout: "duration": 0.0080884709999999999 2023-08-01T19:54:24.158 INFO:teuthology.orchestra.run.smithi008.stdout: } 2023-08-01T19:54:24.158 INFO:teuthology.orchestra.run.smithi008.stdout: ] 2023-08-01T19:54:24.159 INFO:teuthology.orchestra.run.smithi008.stdout: } 2023-08-01T19:54:24.159 INFO:teuthology.orchestra.run.smithi008.stdout: }, 2023-08-01T19:54:24.159 INFO:teuthology.orchestra.run.smithi008.stdout: { 2023-08-01T19:54:24.159 INFO:teuthology.orchestra.run.smithi008.stdout: "description": "osd_op(mds.0.3:37 3.1e 3:7bf7e7b5:::200.00000006:head [delete] snapc 0=[] ondisk+write+known_if_redirected+full_force+supports_pool_eio e17)", 2023-08-01T19:54:24.159 INFO:teuthology.orchestra.run.smithi008.stdout: "initiated_at": "2023-08-01T19:54:04.460701+0000", 2023-08-01T19:54:24.159 INFO:teuthology.orchestra.run.smithi008.stdout: "age": 19.615953412, 2023-08-01T19:54:24.159 INFO:teuthology.orchestra.run.smithi008.stdout: "duration": 0.010776287000000001, 2023-08-01T19:54:24.159 INFO:teuthology.orchestra.run.smithi008.stdout: "type_data": { 2023-08-01T19:54:24.160 INFO:teuthology.orchestra.run.smithi008.stdout: "flag_point": "started", 2023-08-01T19:54:24.160 INFO:teuthology.orchestra.run.smithi008.stdout: "events": [ 2023-08-01T19:54:24.160 INFO:teuthology.orchestra.run.smithi008.stdout: { 2023-08-01T19:54:24.160 INFO:teuthology.orchestra.run.smithi008.stdout: "event": "initiated", 2023-08-01T19:54:24.160 INFO:teuthology.orchestra.run.smithi008.stdout: "time": "2023-08-01T19:54:04.460701+0000", 2023-08-01T19:54:24.160 INFO:teuthology.orchestra.run.smithi008.stdout: "duration": 0 2023-08-01T19:54:24.160 INFO:teuthology.orchestra.run.smithi008.stdout: }, 2023-08-01T19:54:24.161 INFO:teuthology.orchestra.run.smithi008.stdout: { 2023-08-01T19:54:24.161 INFO:teuthology.orchestra.run.smithi008.stdout: "event": "throttled", 2023-08-01T19:54:24.161 INFO:teuthology.orchestra.run.smithi008.stdout: "time": "2023-08-01T19:54:04.460701+0000", 2023-08-01T19:54:24.161 INFO:teuthology.orchestra.run.smithi008.stdout: "duration": 0 2023-08-01T19:54:24.161 INFO:teuthology.orchestra.run.smithi008.stdout: }, 2023-08-01T19:54:24.161 INFO:teuthology.orchestra.run.smithi008.stdout: { 2023-08-01T19:54:24.161 INFO:teuthology.orchestra.run.smithi008.stdout: "event": "header_read", 2023-08-01T19:54:24.161 INFO:teuthology.orchestra.run.smithi008.stdout: "time": "2023-08-01T19:54:04.460701+0000", 2023-08-01T19:54:24.162 INFO:teuthology.orchestra.run.smithi008.stdout: "duration": 4294967295.999999 2023-08-01T19:54:24.162 INFO:teuthology.orchestra.run.smithi008.stdout: }, 2023-08-01T19:54:24.162 INFO:teuthology.orchestra.run.smithi008.stdout: { 2023-08-01T19:54:24.162 INFO:teuthology.orchestra.run.smithi008.stdout: "event": "all_read", 2023-08-01T19:54:24.162 INFO:teuthology.orchestra.run.smithi008.stdout: "time": "2023-08-01T19:54:04.460713+0000", 2023-08-01T19:54:24.162 INFO:teuthology.orchestra.run.smithi008.stdout: "duration": 1.2655e-05 2023-08-01T19:54:24.162 INFO:teuthology.orchestra.run.smithi008.stdout: }, 2023-08-01T19:54:24.162 INFO:teuthology.orchestra.run.smithi008.stdout: { 2023-08-01T19:54:24.163 INFO:teuthology.orchestra.run.smithi008.stdout: "event": "dispatched", 2023-08-01T19:54:24.163 INFO:teuthology.orchestra.run.smithi008.stdout: "time": "2023-08-01T19:54:04.460728+0000", 2023-08-01T19:54:24.163 INFO:teuthology.orchestra.run.smithi008.stdout: "duration": 1.4775e-05 2023-08-01T19:54:24.163 INFO:teuthology.orchestra.run.smithi008.stdout: }, 2023-08-01T19:54:24.163 INFO:teuthology.orchestra.run.smithi008.stdout: { 2023-08-01T19:54:24.163 INFO:teuthology.orchestra.run.smithi008.stdout: "event": "queued_for_pg", 2023-08-01T19:54:24.163 INFO:teuthology.orchestra.run.smithi008.stdout: "time": "2023-08-01T19:54:04.460734+0000", 2023-08-01T19:54:24.163 INFO:teuthology.orchestra.run.smithi008.stdout: "duration": 5.9039999999999997e-06 2023-08-01T19:54:24.164 INFO:teuthology.orchestra.run.smithi008.stdout: }, 2023-08-01T19:54:24.164 INFO:teuthology.orchestra.run.smithi008.stdout: { 2023-08-01T19:54:24.164 INFO:teuthology.orchestra.run.smithi008.stdout: "event": "reached_pg", 2023-08-01T19:54:24.164 INFO:teuthology.orchestra.run.smithi008.stdout: "time": "2023-08-01T19:54:04.464701+0000", 2023-08-01T19:54:24.164 INFO:teuthology.orchestra.run.smithi008.stdout: "duration": 0.0039670030000000002 2023-08-01T19:54:24.164 INFO:teuthology.orchestra.run.smithi008.stdout: }, 2023-08-01T19:54:24.164 INFO:teuthology.orchestra.run.smithi008.stdout: { 2023-08-01T19:54:24.164 INFO:teuthology.orchestra.run.smithi008.stdout: "event": "started", 2023-08-01T19:54:24.165 INFO:teuthology.orchestra.run.smithi008.stdout: "time": "2023-08-01T19:54:04.464820+0000", 2023-08-01T19:54:24.165 INFO:teuthology.orchestra.run.smithi008.stdout: "duration": 0.000118925 2023-08-01T19:54:24.165 INFO:teuthology.orchestra.run.smithi008.stdout: }, 2023-08-01T19:54:24.165 INFO:teuthology.orchestra.run.smithi008.stdout: { 2023-08-01T19:54:24.165 INFO:teuthology.orchestra.run.smithi008.stdout: "event": "done", 2023-08-01T19:54:24.165 INFO:teuthology.orchestra.run.smithi008.stdout: "time": "2023-08-01T19:54:04.471478+0000", 2023-08-01T19:54:24.165 INFO:teuthology.orchestra.run.smithi008.stdout: "duration": 0.0066579539999999998 2023-08-01T19:54:24.165 INFO:teuthology.orchestra.run.smithi008.stdout: } 2023-08-01T19:54:24.166 INFO:teuthology.orchestra.run.smithi008.stdout: ] 2023-08-01T19:54:24.166 INFO:teuthology.orchestra.run.smithi008.stdout: } 2023-08-01T19:54:24.166 INFO:teuthology.orchestra.run.smithi008.stdout: }, 2023-08-01T19:54:24.166 INFO:teuthology.orchestra.run.smithi008.stdout: { 2023-08-01T19:54:24.166 INFO:teuthology.orchestra.run.smithi008.stdout: "description": "pg_update_log_missing(3.1a epoch 17/15 rep_tid 4 entries 17'1 (0'0) error 3:5e41ab69:::200.00000005:head by mds.0.3:36 0.000000 -2 ObjectCleanRegions clean_offsets: [0~18446744073709551615], clean_omap: 1, new_object: 0 trim_to 0'0 roll_forward_to 0'0)", 2023-08-01T19:54:24.166 INFO:teuthology.orchestra.run.smithi008.stdout: "initiated_at": "2023-08-01T19:54:04.466994+0000", 2023-08-01T19:54:24.166 INFO:teuthology.orchestra.run.smithi008.stdout: "age": 19.609660413, 2023-08-01T19:54:24.166 INFO:teuthology.orchestra.run.smithi008.stdout: "duration": 0.0049135309999999996, 2023-08-01T19:54:24.167 INFO:teuthology.orchestra.run.smithi008.stdout: "type_data": { 2023-08-01T19:54:24.167 INFO:teuthology.orchestra.run.smithi008.stdout: "flag_point": "reached pg", 2023-08-01T19:54:24.167 INFO:teuthology.orchestra.run.smithi008.stdout: "events": [ 2023-08-01T19:54:24.167 INFO:teuthology.orchestra.run.smithi008.stdout: { 2023-08-01T19:54:24.167 INFO:teuthology.orchestra.run.smithi008.stdout: "event": "initiated", 2023-08-01T19:54:24.167 INFO:teuthology.orchestra.run.smithi008.stdout: "time": "2023-08-01T19:54:04.466994+0000", 2023-08-01T19:54:24.167 INFO:teuthology.orchestra.run.smithi008.stdout: "duration": 0 2023-08-01T19:54:24.167 INFO:teuthology.orchestra.run.smithi008.stdout: }, 2023-08-01T19:54:24.168 INFO:teuthology.orchestra.run.smithi008.stdout: { 2023-08-01T19:54:24.168 INFO:teuthology.orchestra.run.smithi008.stdout: "event": "throttled", 2023-08-01T19:54:24.168 INFO:teuthology.orchestra.run.smithi008.stdout: "time": "2023-08-01T19:54:04.466994+0000", 2023-08-01T19:54:24.168 INFO:teuthology.orchestra.run.smithi008.stdout: "duration": 0 2023-08-01T19:54:24.168 INFO:teuthology.orchestra.run.smithi008.stdout: }, 2023-08-01T19:54:24.168 INFO:teuthology.orchestra.run.smithi008.stdout: { 2023-08-01T19:54:24.168 INFO:teuthology.orchestra.run.smithi008.stdout: "event": "header_read", 2023-08-01T19:54:24.169 INFO:teuthology.orchestra.run.smithi008.stdout: "time": "2023-08-01T19:54:04.466994+0000", 2023-08-01T19:54:24.169 INFO:teuthology.orchestra.run.smithi008.stdout: "duration": 4294967295.9999995 2023-08-01T19:54:24.169 INFO:teuthology.orchestra.run.smithi008.stdout: }, 2023-08-01T19:54:24.169 INFO:teuthology.orchestra.run.smithi008.stdout: { 2023-08-01T19:54:24.169 INFO:teuthology.orchestra.run.smithi008.stdout: "event": "all_read", 2023-08-01T19:54:24.169 INFO:teuthology.orchestra.run.smithi008.stdout: "time": "2023-08-01T19:54:04.467003+0000", 2023-08-01T19:54:24.169 INFO:teuthology.orchestra.run.smithi008.stdout: "duration": 8.653e-06 2023-08-01T19:54:24.169 INFO:teuthology.orchestra.run.smithi008.stdout: }, 2023-08-01T19:54:24.170 INFO:teuthology.orchestra.run.smithi008.stdout: { 2023-08-01T19:54:24.170 INFO:teuthology.orchestra.run.smithi008.stdout: "event": "dispatched", 2023-08-01T19:54:24.170 INFO:teuthology.orchestra.run.smithi008.stdout: "time": "2023-08-01T19:54:04.467015+0000", 2023-08-01T19:54:24.170 INFO:teuthology.orchestra.run.smithi008.stdout: "duration": 1.2292e-05 2023-08-01T19:54:24.170 INFO:teuthology.orchestra.run.smithi008.stdout: }, 2023-08-01T19:54:24.170 INFO:teuthology.orchestra.run.smithi008.stdout: { 2023-08-01T19:54:24.170 INFO:teuthology.orchestra.run.smithi008.stdout: "event": "queued_for_pg", 2023-08-01T19:54:24.170 INFO:teuthology.orchestra.run.smithi008.stdout: "time": "2023-08-01T19:54:04.467078+0000", 2023-08-01T19:54:24.171 INFO:teuthology.orchestra.run.smithi008.stdout: "duration": 6.3356999999999997e-05 2023-08-01T19:54:24.171 INFO:teuthology.orchestra.run.smithi008.stdout: }, 2023-08-01T19:54:24.171 INFO:teuthology.orchestra.run.smithi008.stdout: { 2023-08-01T19:54:24.171 INFO:teuthology.orchestra.run.smithi008.stdout: "event": "reached_pg", 2023-08-01T19:54:24.171 INFO:teuthology.orchestra.run.smithi008.stdout: "time": "2023-08-01T19:54:04.467221+0000", 2023-08-01T19:54:24.171 INFO:teuthology.orchestra.run.smithi008.stdout: "duration": 0.00014283899999999999 2023-08-01T19:54:24.171 INFO:teuthology.orchestra.run.smithi008.stdout: }, 2023-08-01T19:54:24.171 INFO:teuthology.orchestra.run.smithi008.stdout: { 2023-08-01T19:54:24.172 INFO:teuthology.orchestra.run.smithi008.stdout: "event": "done", 2023-08-01T19:54:24.172 INFO:teuthology.orchestra.run.smithi008.stdout: "time": "2023-08-01T19:54:04.471908+0000", 2023-08-01T19:54:24.172 INFO:teuthology.orchestra.run.smithi008.stdout: "duration": 0.0046867489999999996 2023-08-01T19:54:24.172 INFO:teuthology.orchestra.run.smithi008.stdout: } 2023-08-01T19:54:24.172 INFO:teuthology.orchestra.run.smithi008.stdout: ] 2023-08-01T19:54:24.172 INFO:teuthology.orchestra.run.smithi008.stdout: } 2023-08-01T19:54:24.172 INFO:teuthology.orchestra.run.smithi008.stdout: }, 2023-08-01T19:54:24.172 INFO:teuthology.orchestra.run.smithi008.stdout: { 2023-08-01T19:54:24.173 INFO:teuthology.orchestra.run.smithi008.stdout: "description": "osd_repop_reply(mds.0.3:24 3.7 e17/15 ondisk, result = 0)", 2023-08-01T19:54:24.173 INFO:teuthology.orchestra.run.smithi008.stdout: "initiated_at": "2023-08-01T19:54:04.467888+0000", 2023-08-01T19:54:24.173 INFO:teuthology.orchestra.run.smithi008.stdout: "age": 19.608766745, 2023-08-01T19:54:24.173 INFO:teuthology.orchestra.run.smithi008.stdout: "duration": 0.0014075489999999999, 2023-08-01T19:54:24.173 INFO:teuthology.orchestra.run.smithi008.stdout: "type_data": { 2023-08-01T19:54:24.173 INFO:teuthology.orchestra.run.smithi008.stdout: "flag_point": "started", 2023-08-01T19:54:24.173 INFO:teuthology.orchestra.run.smithi008.stdout: "events": [ 2023-08-01T19:54:24.173 INFO:teuthology.orchestra.run.smithi008.stdout: { 2023-08-01T19:54:24.174 INFO:teuthology.orchestra.run.smithi008.stdout: "event": "initiated", 2023-08-01T19:54:24.174 INFO:teuthology.orchestra.run.smithi008.stdout: "time": "2023-08-01T19:54:04.467888+0000", 2023-08-01T19:54:24.174 INFO:teuthology.orchestra.run.smithi008.stdout: "duration": 0 2023-08-01T19:54:24.174 INFO:teuthology.orchestra.run.smithi008.stdout: }, 2023-08-01T19:54:24.174 INFO:teuthology.orchestra.run.smithi008.stdout: { 2023-08-01T19:54:24.174 INFO:teuthology.orchestra.run.smithi008.stdout: "event": "throttled", 2023-08-01T19:54:24.174 INFO:teuthology.orchestra.run.smithi008.stdout: "time": "2023-08-01T19:54:04.467888+0000", 2023-08-01T19:54:24.175 INFO:teuthology.orchestra.run.smithi008.stdout: "duration": 0 2023-08-01T19:54:24.175 INFO:teuthology.orchestra.run.smithi008.stdout: }, 2023-08-01T19:54:24.175 INFO:teuthology.orchestra.run.smithi008.stdout: { 2023-08-01T19:54:24.175 INFO:teuthology.orchestra.run.smithi008.stdout: "event": "header_read", 2023-08-01T19:54:24.175 INFO:teuthology.orchestra.run.smithi008.stdout: "time": "2023-08-01T19:54:04.467888+0000", 2023-08-01T19:54:24.175 INFO:teuthology.orchestra.run.smithi008.stdout: "duration": 4294967295.9999995 2023-08-01T19:54:24.175 INFO:teuthology.orchestra.run.smithi008.stdout: }, 2023-08-01T19:54:24.175 INFO:teuthology.orchestra.run.smithi008.stdout: { 2023-08-01T19:54:24.176 INFO:teuthology.orchestra.run.smithi008.stdout: "event": "all_read", 2023-08-01T19:54:24.176 INFO:teuthology.orchestra.run.smithi008.stdout: "time": "2023-08-01T19:54:04.467892+0000", 2023-08-01T19:54:24.176 INFO:teuthology.orchestra.run.smithi008.stdout: "duration": 3.9589999999999997e-06 2023-08-01T19:54:24.176 INFO:teuthology.orchestra.run.smithi008.stdout: }, 2023-08-01T19:54:24.176 INFO:teuthology.orchestra.run.smithi008.stdout: { 2023-08-01T19:54:24.176 INFO:teuthology.orchestra.run.smithi008.stdout: "event": "dispatched", 2023-08-01T19:54:24.176 INFO:teuthology.orchestra.run.smithi008.stdout: "time": "2023-08-01T19:54:04.467900+0000", 2023-08-01T19:54:24.176 INFO:teuthology.orchestra.run.smithi008.stdout: "duration": 8.0430000000000008e-06 2023-08-01T19:54:24.177 INFO:teuthology.orchestra.run.smithi008.stdout: }, 2023-08-01T19:54:24.177 INFO:teuthology.orchestra.run.smithi008.stdout: { 2023-08-01T19:54:24.177 INFO:teuthology.orchestra.run.smithi008.stdout: "event": "queued_for_pg", 2023-08-01T19:54:24.177 INFO:teuthology.orchestra.run.smithi008.stdout: "time": "2023-08-01T19:54:04.467921+0000", 2023-08-01T19:54:24.177 INFO:teuthology.orchestra.run.smithi008.stdout: "duration": 2.1251999999999999e-05 2023-08-01T19:54:24.177 INFO:teuthology.orchestra.run.smithi008.stdout: }, 2023-08-01T19:54:24.177 INFO:teuthology.orchestra.run.smithi008.stdout: { 2023-08-01T19:54:24.177 INFO:teuthology.orchestra.run.smithi008.stdout: "event": "reached_pg", 2023-08-01T19:54:24.178 INFO:teuthology.orchestra.run.smithi008.stdout: "time": "2023-08-01T19:54:04.469154+0000", 2023-08-01T19:54:24.178 INFO:teuthology.orchestra.run.smithi008.stdout: "duration": 0.001232948 2023-08-01T19:54:24.178 INFO:teuthology.orchestra.run.smithi008.stdout: }, 2023-08-01T19:54:24.178 INFO:teuthology.orchestra.run.smithi008.stdout: { 2023-08-01T19:54:24.178 INFO:teuthology.orchestra.run.smithi008.stdout: "event": "started", 2023-08-01T19:54:24.178 INFO:teuthology.orchestra.run.smithi008.stdout: "time": "2023-08-01T19:54:04.469172+0000", 2023-08-01T19:54:24.178 INFO:teuthology.orchestra.run.smithi008.stdout: "duration": 1.7662000000000001e-05 2023-08-01T19:54:24.178 INFO:teuthology.orchestra.run.smithi008.stdout: }, 2023-08-01T19:54:24.179 INFO:teuthology.orchestra.run.smithi008.stdout: { 2023-08-01T19:54:24.179 INFO:teuthology.orchestra.run.smithi008.stdout: "event": "done", 2023-08-01T19:54:24.179 INFO:teuthology.orchestra.run.smithi008.stdout: "time": "2023-08-01T19:54:04.469296+0000", 2023-08-01T19:54:24.179 INFO:teuthology.orchestra.run.smithi008.stdout: "duration": 0.000124058 2023-08-01T19:54:24.179 INFO:teuthology.orchestra.run.smithi008.stdout: } 2023-08-01T19:54:24.179 INFO:teuthology.orchestra.run.smithi008.stdout: ] 2023-08-01T19:54:24.179 INFO:teuthology.orchestra.run.smithi008.stdout: } 2023-08-01T19:54:24.180 INFO:teuthology.orchestra.run.smithi008.stdout: }, 2023-08-01T19:54:24.180 INFO:teuthology.orchestra.run.smithi008.stdout: { 2023-08-01T19:54:24.180 INFO:teuthology.orchestra.run.smithi008.stdout: "description": "osd_repop(mds.0.3:20 3.1c e17/15 3:3ed09add:::607.00000000:head v 17'1, mlcod=0'0)", 2023-08-01T19:54:24.180 INFO:teuthology.orchestra.run.smithi008.stdout: "initiated_at": "2023-08-01T19:54:04.469043+0000", 2023-08-01T19:54:24.180 INFO:teuthology.orchestra.run.smithi008.stdout: "age": 19.607611843000001, 2023-08-01T19:54:24.180 INFO:teuthology.orchestra.run.smithi008.stdout: "duration": 0.0033619159999999999, 2023-08-01T19:54:24.180 INFO:teuthology.orchestra.run.smithi008.stdout: "type_data": { 2023-08-01T19:54:24.180 INFO:teuthology.orchestra.run.smithi008.stdout: "flag_point": "commit sent; apply or cleanup", 2023-08-01T19:54:24.181 INFO:teuthology.orchestra.run.smithi008.stdout: "events": [ 2023-08-01T19:54:24.181 INFO:teuthology.orchestra.run.smithi008.stdout: { 2023-08-01T19:54:24.181 INFO:teuthology.orchestra.run.smithi008.stdout: "event": "initiated", 2023-08-01T19:54:24.181 INFO:teuthology.orchestra.run.smithi008.stdout: "time": "2023-08-01T19:54:04.469043+0000", 2023-08-01T19:54:24.181 INFO:teuthology.orchestra.run.smithi008.stdout: "duration": 0 2023-08-01T19:54:24.181 INFO:teuthology.orchestra.run.smithi008.stdout: }, 2023-08-01T19:54:24.181 INFO:teuthology.orchestra.run.smithi008.stdout: { 2023-08-01T19:54:24.181 INFO:teuthology.orchestra.run.smithi008.stdout: "event": "throttled", 2023-08-01T19:54:24.182 INFO:teuthology.orchestra.run.smithi008.stdout: "time": "2023-08-01T19:54:04.469043+0000", 2023-08-01T19:54:24.182 INFO:teuthology.orchestra.run.smithi008.stdout: "duration": 0 2023-08-01T19:54:24.182 INFO:teuthology.orchestra.run.smithi008.stdout: }, 2023-08-01T19:54:24.182 INFO:teuthology.orchestra.run.smithi008.stdout: { 2023-08-01T19:54:24.182 INFO:teuthology.orchestra.run.smithi008.stdout: "event": "header_read", 2023-08-01T19:54:24.182 INFO:teuthology.orchestra.run.smithi008.stdout: "time": "2023-08-01T19:54:04.469043+0000", 2023-08-01T19:54:24.182 INFO:teuthology.orchestra.run.smithi008.stdout: "duration": 4294967295.9999995 2023-08-01T19:54:24.182 INFO:teuthology.orchestra.run.smithi008.stdout: }, 2023-08-01T19:54:24.183 INFO:teuthology.orchestra.run.smithi008.stdout: { 2023-08-01T19:54:24.183 INFO:teuthology.orchestra.run.smithi008.stdout: "event": "all_read", 2023-08-01T19:54:24.183 INFO:teuthology.orchestra.run.smithi008.stdout: "time": "2023-08-01T19:54:04.469055+0000", 2023-08-01T19:54:24.183 INFO:teuthology.orchestra.run.smithi008.stdout: "duration": 1.2738000000000001e-05 2023-08-01T19:54:24.183 INFO:teuthology.orchestra.run.smithi008.stdout: }, 2023-08-01T19:54:24.183 INFO:teuthology.orchestra.run.smithi008.stdout: { 2023-08-01T19:54:24.183 INFO:teuthology.orchestra.run.smithi008.stdout: "event": "dispatched", 2023-08-01T19:54:24.183 INFO:teuthology.orchestra.run.smithi008.stdout: "time": "2023-08-01T19:54:04.469065+0000", 2023-08-01T19:54:24.184 INFO:teuthology.orchestra.run.smithi008.stdout: "duration": 9.3710000000000006e-06 2023-08-01T19:54:24.184 INFO:teuthology.orchestra.run.smithi008.stdout: }, 2023-08-01T19:54:24.184 INFO:teuthology.orchestra.run.smithi008.stdout: { 2023-08-01T19:54:24.184 INFO:teuthology.orchestra.run.smithi008.stdout: "event": "queued_for_pg", 2023-08-01T19:54:24.184 INFO:teuthology.orchestra.run.smithi008.stdout: "time": "2023-08-01T19:54:04.469072+0000", 2023-08-01T19:54:24.184 INFO:teuthology.orchestra.run.smithi008.stdout: "duration": 7.0269999999999998e-06 2023-08-01T19:54:24.184 INFO:teuthology.orchestra.run.smithi008.stdout: }, 2023-08-01T19:54:24.185 INFO:teuthology.orchestra.run.smithi008.stdout: { 2023-08-01T19:54:24.185 INFO:teuthology.orchestra.run.smithi008.stdout: "event": "reached_pg", 2023-08-01T19:54:24.185 INFO:teuthology.orchestra.run.smithi008.stdout: "time": "2023-08-01T19:54:04.469111+0000", 2023-08-01T19:54:24.185 INFO:teuthology.orchestra.run.smithi008.stdout: "duration": 3.9443999999999997e-05 2023-08-01T19:54:24.185 INFO:teuthology.orchestra.run.smithi008.stdout: }, 2023-08-01T19:54:24.185 INFO:teuthology.orchestra.run.smithi008.stdout: { 2023-08-01T19:54:24.185 INFO:teuthology.orchestra.run.smithi008.stdout: "event": "started", 2023-08-01T19:54:24.185 INFO:teuthology.orchestra.run.smithi008.stdout: "time": "2023-08-01T19:54:04.469144+0000", 2023-08-01T19:54:24.186 INFO:teuthology.orchestra.run.smithi008.stdout: "duration": 3.2326000000000002e-05 2023-08-01T19:54:24.186 INFO:teuthology.orchestra.run.smithi008.stdout: }, 2023-08-01T19:54:24.186 INFO:teuthology.orchestra.run.smithi008.stdout: { 2023-08-01T19:54:24.186 INFO:teuthology.orchestra.run.smithi008.stdout: "event": "commit_sent", 2023-08-01T19:54:24.186 INFO:teuthology.orchestra.run.smithi008.stdout: "time": "2023-08-01T19:54:04.472329+0000", 2023-08-01T19:54:24.186 INFO:teuthology.orchestra.run.smithi008.stdout: "duration": 0.0031858450000000001 2023-08-01T19:54:24.186 INFO:teuthology.orchestra.run.smithi008.stdout: }, 2023-08-01T19:54:24.186 INFO:teuthology.orchestra.run.smithi008.stdout: { 2023-08-01T19:54:24.187 INFO:teuthology.orchestra.run.smithi008.stdout: "event": "done", 2023-08-01T19:54:24.187 INFO:teuthology.orchestra.run.smithi008.stdout: "time": "2023-08-01T19:54:04.472405+0000", 2023-08-01T19:54:24.187 INFO:teuthology.orchestra.run.smithi008.stdout: "duration": 7.5548000000000002e-05 2023-08-01T19:54:24.187 INFO:teuthology.orchestra.run.smithi008.stdout: } 2023-08-01T19:54:24.187 INFO:teuthology.orchestra.run.smithi008.stdout: ] 2023-08-01T19:54:24.187 INFO:teuthology.orchestra.run.smithi008.stdout: } 2023-08-01T19:54:24.187 INFO:teuthology.orchestra.run.smithi008.stdout: }, 2023-08-01T19:54:24.187 INFO:teuthology.orchestra.run.smithi008.stdout: { 2023-08-01T19:54:24.188 INFO:teuthology.orchestra.run.smithi008.stdout: "description": "osd_repop(mds.0.3:29 3.13 e17/15 3:cd5a64a3:::100.00000000:head v 17'1, mlcod=0'0)", 2023-08-01T19:54:24.188 INFO:teuthology.orchestra.run.smithi008.stdout: "initiated_at": "2023-08-01T19:54:04.469132+0000", 2023-08-01T19:54:24.188 INFO:teuthology.orchestra.run.smithi008.stdout: "age": 19.607523148999999, 2023-08-01T19:54:24.188 INFO:teuthology.orchestra.run.smithi008.stdout: "duration": 0.0036056119999999998, 2023-08-01T19:54:24.188 INFO:teuthology.orchestra.run.smithi008.stdout: "type_data": { 2023-08-01T19:54:24.188 INFO:teuthology.orchestra.run.smithi008.stdout: "flag_point": "commit sent; apply or cleanup", 2023-08-01T19:54:24.188 INFO:teuthology.orchestra.run.smithi008.stdout: "events": [ 2023-08-01T19:54:24.188 INFO:teuthology.orchestra.run.smithi008.stdout: { 2023-08-01T19:54:24.189 INFO:teuthology.orchestra.run.smithi008.stdout: "event": "initiated", 2023-08-01T19:54:24.189 INFO:teuthology.orchestra.run.smithi008.stdout: "time": "2023-08-01T19:54:04.469132+0000", 2023-08-01T19:54:24.189 INFO:teuthology.orchestra.run.smithi008.stdout: "duration": 0 2023-08-01T19:54:24.189 INFO:teuthology.orchestra.run.smithi008.stdout: }, 2023-08-01T19:54:24.189 INFO:teuthology.orchestra.run.smithi008.stdout: { 2023-08-01T19:54:24.189 INFO:teuthology.orchestra.run.smithi008.stdout: "event": "throttled", 2023-08-01T19:54:24.189 INFO:teuthology.orchestra.run.smithi008.stdout: "time": "2023-08-01T19:54:04.469132+0000", 2023-08-01T19:54:24.189 INFO:teuthology.orchestra.run.smithi008.stdout: "duration": 0 2023-08-01T19:54:24.190 INFO:teuthology.orchestra.run.smithi008.stdout: }, 2023-08-01T19:54:24.190 INFO:teuthology.orchestra.run.smithi008.stdout: { 2023-08-01T19:54:24.190 INFO:teuthology.orchestra.run.smithi008.stdout: "event": "header_read", 2023-08-01T19:54:24.190 INFO:teuthology.orchestra.run.smithi008.stdout: "time": "2023-08-01T19:54:04.469131+0000", 2023-08-01T19:54:24.190 INFO:teuthology.orchestra.run.smithi008.stdout: "duration": 4294967295.9999995 2023-08-01T19:54:24.190 INFO:teuthology.orchestra.run.smithi008.stdout: }, 2023-08-01T19:54:24.190 INFO:teuthology.orchestra.run.smithi008.stdout: { 2023-08-01T19:54:24.190 INFO:teuthology.orchestra.run.smithi008.stdout: "event": "all_read", 2023-08-01T19:54:24.191 INFO:teuthology.orchestra.run.smithi008.stdout: "time": "2023-08-01T19:54:04.469147+0000", 2023-08-01T19:54:24.191 INFO:teuthology.orchestra.run.smithi008.stdout: "duration": 1.5288e-05 2023-08-01T19:54:24.191 INFO:teuthology.orchestra.run.smithi008.stdout: }, 2023-08-01T19:54:24.191 INFO:teuthology.orchestra.run.smithi008.stdout: { 2023-08-01T19:54:24.191 INFO:teuthology.orchestra.run.smithi008.stdout: "event": "dispatched", 2023-08-01T19:54:24.191 INFO:teuthology.orchestra.run.smithi008.stdout: "time": "2023-08-01T19:54:04.469154+0000", 2023-08-01T19:54:24.191 INFO:teuthology.orchestra.run.smithi008.stdout: "duration": 7.7819999999999994e-06 2023-08-01T19:54:24.191 INFO:teuthology.orchestra.run.smithi008.stdout: }, 2023-08-01T19:54:24.192 INFO:teuthology.orchestra.run.smithi008.stdout: { 2023-08-01T19:54:24.192 INFO:teuthology.orchestra.run.smithi008.stdout: "event": "queued_for_pg", 2023-08-01T19:54:24.192 INFO:teuthology.orchestra.run.smithi008.stdout: "time": "2023-08-01T19:54:04.469161+0000", 2023-08-01T19:54:24.192 INFO:teuthology.orchestra.run.smithi008.stdout: "duration": 6.4119999999999998e-06 2023-08-01T19:54:24.192 INFO:teuthology.orchestra.run.smithi008.stdout: }, 2023-08-01T19:54:24.192 INFO:teuthology.orchestra.run.smithi008.stdout: { 2023-08-01T19:54:24.192 INFO:teuthology.orchestra.run.smithi008.stdout: "event": "reached_pg", 2023-08-01T19:54:24.193 INFO:teuthology.orchestra.run.smithi008.stdout: "time": "2023-08-01T19:54:04.469239+0000", 2023-08-01T19:54:24.193 INFO:teuthology.orchestra.run.smithi008.stdout: "duration": 7.8381999999999996e-05 2023-08-01T19:54:24.193 INFO:teuthology.orchestra.run.smithi008.stdout: }, 2023-08-01T19:54:24.193 INFO:teuthology.orchestra.run.smithi008.stdout: { 2023-08-01T19:54:24.193 INFO:teuthology.orchestra.run.smithi008.stdout: "event": "started", 2023-08-01T19:54:24.193 INFO:teuthology.orchestra.run.smithi008.stdout: "time": "2023-08-01T19:54:04.469259+0000", 2023-08-01T19:54:24.193 INFO:teuthology.orchestra.run.smithi008.stdout: "duration": 1.9445000000000001e-05 2023-08-01T19:54:24.193 INFO:teuthology.orchestra.run.smithi008.stdout: }, 2023-08-01T19:54:24.194 INFO:teuthology.orchestra.run.smithi008.stdout: { 2023-08-01T19:54:24.194 INFO:teuthology.orchestra.run.smithi008.stdout: "event": "commit_sent", 2023-08-01T19:54:24.194 INFO:teuthology.orchestra.run.smithi008.stdout: "time": "2023-08-01T19:54:04.472699+0000", 2023-08-01T19:54:24.194 INFO:teuthology.orchestra.run.smithi008.stdout: "duration": 0.0034399640000000002 2023-08-01T19:54:24.194 INFO:teuthology.orchestra.run.smithi008.stdout: }, 2023-08-01T19:54:24.194 INFO:teuthology.orchestra.run.smithi008.stdout: { 2023-08-01T19:54:24.194 INFO:teuthology.orchestra.run.smithi008.stdout: "event": "done", 2023-08-01T19:54:24.194 INFO:teuthology.orchestra.run.smithi008.stdout: "time": "2023-08-01T19:54:04.472737+0000", 2023-08-01T19:54:24.195 INFO:teuthology.orchestra.run.smithi008.stdout: "duration": 3.8769000000000001e-05 2023-08-01T19:54:24.195 INFO:teuthology.orchestra.run.smithi008.stdout: } 2023-08-01T19:54:24.195 INFO:teuthology.orchestra.run.smithi008.stdout: ] 2023-08-01T19:54:24.195 INFO:teuthology.orchestra.run.smithi008.stdout: } 2023-08-01T19:54:24.195 INFO:teuthology.orchestra.run.smithi008.stdout: }, 2023-08-01T19:54:24.195 INFO:teuthology.orchestra.run.smithi008.stdout: { 2023-08-01T19:54:24.195 INFO:teuthology.orchestra.run.smithi008.stdout: "description": "osd_repop_reply(mds.0.3:4 3.1f e16/15 ondisk, result = 0)", 2023-08-01T19:54:24.195 INFO:teuthology.orchestra.run.smithi008.stdout: "initiated_at": "2023-08-01T19:54:04.469698+0000", 2023-08-01T19:54:24.196 INFO:teuthology.orchestra.run.smithi008.stdout: "age": 19.606956702000002, 2023-08-01T19:54:24.196 INFO:teuthology.orchestra.run.smithi008.stdout: "duration": 0.00096879300000000002, 2023-08-01T19:54:24.196 INFO:teuthology.orchestra.run.smithi008.stdout: "type_data": { 2023-08-01T19:54:24.196 INFO:teuthology.orchestra.run.smithi008.stdout: "flag_point": "started", 2023-08-01T19:54:24.196 INFO:teuthology.orchestra.run.smithi008.stdout: "events": [ 2023-08-01T19:54:24.196 INFO:teuthology.orchestra.run.smithi008.stdout: { 2023-08-01T19:54:24.196 INFO:teuthology.orchestra.run.smithi008.stdout: "event": "initiated", 2023-08-01T19:54:24.196 INFO:teuthology.orchestra.run.smithi008.stdout: "time": "2023-08-01T19:54:04.469698+0000", 2023-08-01T19:54:24.197 INFO:teuthology.orchestra.run.smithi008.stdout: "duration": 0 2023-08-01T19:54:24.197 INFO:teuthology.orchestra.run.smithi008.stdout: }, 2023-08-01T19:54:24.197 INFO:teuthology.orchestra.run.smithi008.stdout: { 2023-08-01T19:54:24.197 INFO:teuthology.orchestra.run.smithi008.stdout: "event": "throttled", 2023-08-01T19:54:24.197 INFO:teuthology.orchestra.run.smithi008.stdout: "time": "2023-08-01T19:54:04.469698+0000", 2023-08-01T19:54:24.197 INFO:teuthology.orchestra.run.smithi008.stdout: "duration": 0 2023-08-01T19:54:24.197 INFO:teuthology.orchestra.run.smithi008.stdout: }, 2023-08-01T19:54:24.197 INFO:teuthology.orchestra.run.smithi008.stdout: { 2023-08-01T19:54:24.198 INFO:teuthology.orchestra.run.smithi008.stdout: "event": "header_read", 2023-08-01T19:54:24.198 INFO:teuthology.orchestra.run.smithi008.stdout: "time": "2023-08-01T19:54:04.469698+0000", 2023-08-01T19:54:24.198 INFO:teuthology.orchestra.run.smithi008.stdout: "duration": 4294967295.9999995 2023-08-01T19:54:24.198 INFO:teuthology.orchestra.run.smithi008.stdout: }, 2023-08-01T19:54:24.198 INFO:teuthology.orchestra.run.smithi008.stdout: { 2023-08-01T19:54:24.198 INFO:teuthology.orchestra.run.smithi008.stdout: "event": "all_read", 2023-08-01T19:54:24.198 INFO:teuthology.orchestra.run.smithi008.stdout: "time": "2023-08-01T19:54:04.469702+0000", 2023-08-01T19:54:24.198 INFO:teuthology.orchestra.run.smithi008.stdout: "duration": 4.0080000000000004e-06 2023-08-01T19:54:24.199 INFO:teuthology.orchestra.run.smithi008.stdout: }, 2023-08-01T19:54:24.199 INFO:teuthology.orchestra.run.smithi008.stdout: { 2023-08-01T19:54:24.199 INFO:teuthology.orchestra.run.smithi008.stdout: "event": "dispatched", 2023-08-01T19:54:24.199 INFO:teuthology.orchestra.run.smithi008.stdout: "time": "2023-08-01T19:54:04.469714+0000", 2023-08-01T19:54:24.199 INFO:teuthology.orchestra.run.smithi008.stdout: "duration": 1.1984000000000001e-05 2023-08-01T19:54:24.199 INFO:teuthology.orchestra.run.smithi008.stdout: }, 2023-08-01T19:54:24.199 INFO:teuthology.orchestra.run.smithi008.stdout: { 2023-08-01T19:54:24.199 INFO:teuthology.orchestra.run.smithi008.stdout: "event": "queued_for_pg", 2023-08-01T19:54:24.200 INFO:teuthology.orchestra.run.smithi008.stdout: "time": "2023-08-01T19:54:04.469721+0000", 2023-08-01T19:54:24.200 INFO:teuthology.orchestra.run.smithi008.stdout: "duration": 6.7680000000000003e-06 2023-08-01T19:54:24.200 INFO:teuthology.orchestra.run.smithi008.stdout: }, 2023-08-01T19:54:24.200 INFO:teuthology.orchestra.run.smithi008.stdout: { 2023-08-01T19:54:24.200 INFO:teuthology.orchestra.run.smithi008.stdout: "event": "reached_pg", 2023-08-01T19:54:24.200 INFO:teuthology.orchestra.run.smithi008.stdout: "time": "2023-08-01T19:54:04.470484+0000", 2023-08-01T19:54:24.200 INFO:teuthology.orchestra.run.smithi008.stdout: "duration": 0.00076370400000000003 2023-08-01T19:54:24.201 INFO:teuthology.orchestra.run.smithi008.stdout: }, 2023-08-01T19:54:24.201 INFO:teuthology.orchestra.run.smithi008.stdout: { 2023-08-01T19:54:24.201 INFO:teuthology.orchestra.run.smithi008.stdout: "event": "started", 2023-08-01T19:54:24.201 INFO:teuthology.orchestra.run.smithi008.stdout: "time": "2023-08-01T19:54:04.470549+0000", 2023-08-01T19:54:24.201 INFO:teuthology.orchestra.run.smithi008.stdout: "duration": 6.4560999999999994e-05 2023-08-01T19:54:24.201 INFO:teuthology.orchestra.run.smithi008.stdout: }, 2023-08-01T19:54:24.201 INFO:teuthology.orchestra.run.smithi008.stdout: { 2023-08-01T19:54:24.201 INFO:teuthology.orchestra.run.smithi008.stdout: "event": "done", 2023-08-01T19:54:24.202 INFO:teuthology.orchestra.run.smithi008.stdout: "time": "2023-08-01T19:54:04.470667+0000", 2023-08-01T19:54:24.202 INFO:teuthology.orchestra.run.smithi008.stdout: "duration": 0.000118097 2023-08-01T19:54:24.202 INFO:teuthology.orchestra.run.smithi008.stdout: } 2023-08-01T19:54:24.202 INFO:teuthology.orchestra.run.smithi008.stdout: ] 2023-08-01T19:54:24.202 INFO:teuthology.orchestra.run.smithi008.stdout: } 2023-08-01T19:54:24.202 INFO:teuthology.orchestra.run.smithi008.stdout: }, 2023-08-01T19:54:24.202 INFO:teuthology.orchestra.run.smithi008.stdout: { 2023-08-01T19:54:24.202 INFO:teuthology.orchestra.run.smithi008.stdout: "description": "pg_update_log_missing_reply(3.1e epoch 17/15 rep_tid 8 lcod 17'1)", 2023-08-01T19:54:24.203 INFO:teuthology.orchestra.run.smithi008.stdout: "initiated_at": "2023-08-01T19:54:04.471008+0000", 2023-08-01T19:54:24.203 INFO:teuthology.orchestra.run.smithi008.stdout: "age": 19.605646418999999, 2023-08-01T19:54:24.203 INFO:teuthology.orchestra.run.smithi008.stdout: "duration": 0.00047385899999999998, 2023-08-01T19:54:24.203 INFO:teuthology.orchestra.run.smithi008.stdout: "type_data": { 2023-08-01T19:54:24.203 INFO:teuthology.orchestra.run.smithi008.stdout: "flag_point": "reached pg", 2023-08-01T19:54:24.203 INFO:teuthology.orchestra.run.smithi008.stdout: "events": [ 2023-08-01T19:54:24.203 INFO:teuthology.orchestra.run.smithi008.stdout: { 2023-08-01T19:54:24.203 INFO:teuthology.orchestra.run.smithi008.stdout: "event": "initiated", 2023-08-01T19:54:24.204 INFO:teuthology.orchestra.run.smithi008.stdout: "time": "2023-08-01T19:54:04.471008+0000", 2023-08-01T19:54:24.204 INFO:teuthology.orchestra.run.smithi008.stdout: "duration": 0 2023-08-01T19:54:24.204 INFO:teuthology.orchestra.run.smithi008.stdout: }, 2023-08-01T19:54:24.204 INFO:teuthology.orchestra.run.smithi008.stdout: { 2023-08-01T19:54:24.204 INFO:teuthology.orchestra.run.smithi008.stdout: "event": "throttled", 2023-08-01T19:54:24.204 INFO:teuthology.orchestra.run.smithi008.stdout: "time": "2023-08-01T19:54:04.471008+0000", 2023-08-01T19:54:24.204 INFO:teuthology.orchestra.run.smithi008.stdout: "duration": 0 2023-08-01T19:54:24.205 INFO:teuthology.orchestra.run.smithi008.stdout: }, 2023-08-01T19:54:24.205 INFO:teuthology.orchestra.run.smithi008.stdout: { 2023-08-01T19:54:24.205 INFO:teuthology.orchestra.run.smithi008.stdout: "event": "header_read", 2023-08-01T19:54:24.205 INFO:teuthology.orchestra.run.smithi008.stdout: "time": "2023-08-01T19:54:04.471008+0000", 2023-08-01T19:54:24.205 INFO:teuthology.orchestra.run.smithi008.stdout: "duration": 4294967295.9999995 2023-08-01T19:54:24.205 INFO:teuthology.orchestra.run.smithi008.stdout: }, 2023-08-01T19:54:24.205 INFO:teuthology.orchestra.run.smithi008.stdout: { 2023-08-01T19:54:24.205 INFO:teuthology.orchestra.run.smithi008.stdout: "event": "all_read", 2023-08-01T19:54:24.206 INFO:teuthology.orchestra.run.smithi008.stdout: "time": "2023-08-01T19:54:04.471011+0000", 2023-08-01T19:54:24.206 INFO:teuthology.orchestra.run.smithi008.stdout: "duration": 3.1200000000000002e-06 2023-08-01T19:54:24.206 INFO:teuthology.orchestra.run.smithi008.stdout: }, 2023-08-01T19:54:24.206 INFO:teuthology.orchestra.run.smithi008.stdout: { 2023-08-01T19:54:24.206 INFO:teuthology.orchestra.run.smithi008.stdout: "event": "dispatched", 2023-08-01T19:54:24.206 INFO:teuthology.orchestra.run.smithi008.stdout: "time": "2023-08-01T19:54:04.471020+0000", 2023-08-01T19:54:24.206 INFO:teuthology.orchestra.run.smithi008.stdout: "duration": 8.4719999999999995e-06 2023-08-01T19:54:24.206 INFO:teuthology.orchestra.run.smithi008.stdout: }, 2023-08-01T19:54:24.207 INFO:teuthology.orchestra.run.smithi008.stdout: { 2023-08-01T19:54:24.207 INFO:teuthology.orchestra.run.smithi008.stdout: "event": "queued_for_pg", 2023-08-01T19:54:24.207 INFO:teuthology.orchestra.run.smithi008.stdout: "time": "2023-08-01T19:54:04.471026+0000", 2023-08-01T19:54:24.207 INFO:teuthology.orchestra.run.smithi008.stdout: "duration": 6.1120000000000001e-06 2023-08-01T19:54:24.207 INFO:teuthology.orchestra.run.smithi008.stdout: }, 2023-08-01T19:54:24.207 INFO:teuthology.orchestra.run.smithi008.stdout: { 2023-08-01T19:54:24.207 INFO:teuthology.orchestra.run.smithi008.stdout: "event": "reached_pg", 2023-08-01T19:54:24.207 INFO:teuthology.orchestra.run.smithi008.stdout: "time": "2023-08-01T19:54:04.471384+0000", 2023-08-01T19:54:24.208 INFO:teuthology.orchestra.run.smithi008.stdout: "duration": 0.00035830999999999998 2023-08-01T19:54:24.208 INFO:teuthology.orchestra.run.smithi008.stdout: }, 2023-08-01T19:54:24.208 INFO:teuthology.orchestra.run.smithi008.stdout: { 2023-08-01T19:54:24.208 INFO:teuthology.orchestra.run.smithi008.stdout: "event": "done", 2023-08-01T19:54:24.208 INFO:teuthology.orchestra.run.smithi008.stdout: "time": "2023-08-01T19:54:04.471482+0000", 2023-08-01T19:54:24.208 INFO:teuthology.orchestra.run.smithi008.stdout: "duration": 9.8152000000000005e-05 2023-08-01T19:54:24.208 INFO:teuthology.orchestra.run.smithi008.stdout: } 2023-08-01T19:54:24.208 INFO:teuthology.orchestra.run.smithi008.stdout: ] 2023-08-01T19:54:24.209 INFO:teuthology.orchestra.run.smithi008.stdout: } 2023-08-01T19:54:24.209 INFO:teuthology.orchestra.run.smithi008.stdout: }, 2023-08-01T19:54:24.209 INFO:teuthology.orchestra.run.smithi008.stdout: { 2023-08-01T19:54:24.209 INFO:teuthology.orchestra.run.smithi008.stdout: "description": "osd_repop_reply(mds.0.3:25 3.7 e17/15 ondisk, result = 0)", 2023-08-01T19:54:24.209 INFO:teuthology.orchestra.run.smithi008.stdout: "initiated_at": "2023-08-01T19:54:04.471054+0000", 2023-08-01T19:54:24.209 INFO:teuthology.orchestra.run.smithi008.stdout: "age": 19.605600391999999, 2023-08-01T19:54:24.209 INFO:teuthology.orchestra.run.smithi008.stdout: "duration": 0.000356893, 2023-08-01T19:54:24.210 INFO:teuthology.orchestra.run.smithi008.stdout: "type_data": { 2023-08-01T19:54:24.210 INFO:teuthology.orchestra.run.smithi008.stdout: "flag_point": "started", 2023-08-01T19:54:24.210 INFO:teuthology.orchestra.run.smithi008.stdout: "events": [ 2023-08-01T19:54:24.210 INFO:teuthology.orchestra.run.smithi008.stdout: { 2023-08-01T19:54:24.210 INFO:teuthology.orchestra.run.smithi008.stdout: "event": "initiated", 2023-08-01T19:54:24.210 INFO:teuthology.orchestra.run.smithi008.stdout: "time": "2023-08-01T19:54:04.471054+0000", 2023-08-01T19:54:24.210 INFO:teuthology.orchestra.run.smithi008.stdout: "duration": 0 2023-08-01T19:54:24.210 INFO:teuthology.orchestra.run.smithi008.stdout: }, 2023-08-01T19:54:24.211 INFO:teuthology.orchestra.run.smithi008.stdout: { 2023-08-01T19:54:24.211 INFO:teuthology.orchestra.run.smithi008.stdout: "event": "throttled", 2023-08-01T19:54:24.211 INFO:teuthology.orchestra.run.smithi008.stdout: "time": "2023-08-01T19:54:04.471054+0000", 2023-08-01T19:54:24.211 INFO:teuthology.orchestra.run.smithi008.stdout: "duration": 0 2023-08-01T19:54:24.211 INFO:teuthology.orchestra.run.smithi008.stdout: }, 2023-08-01T19:54:24.211 INFO:teuthology.orchestra.run.smithi008.stdout: { 2023-08-01T19:54:24.211 INFO:teuthology.orchestra.run.smithi008.stdout: "event": "header_read", 2023-08-01T19:54:24.211 INFO:teuthology.orchestra.run.smithi008.stdout: "time": "2023-08-01T19:54:04.471054+0000", 2023-08-01T19:54:24.212 INFO:teuthology.orchestra.run.smithi008.stdout: "duration": 4294967295.9999995 2023-08-01T19:54:24.212 INFO:teuthology.orchestra.run.smithi008.stdout: }, 2023-08-01T19:54:24.212 INFO:teuthology.orchestra.run.smithi008.stdout: { 2023-08-01T19:54:24.212 INFO:teuthology.orchestra.run.smithi008.stdout: "event": "all_read", 2023-08-01T19:54:24.212 INFO:teuthology.orchestra.run.smithi008.stdout: "time": "2023-08-01T19:54:04.471059+0000", 2023-08-01T19:54:24.212 INFO:teuthology.orchestra.run.smithi008.stdout: "duration": 5.4419999999999997e-06 2023-08-01T19:54:24.212 INFO:teuthology.orchestra.run.smithi008.stdout: }, 2023-08-01T19:54:24.212 INFO:teuthology.orchestra.run.smithi008.stdout: { 2023-08-01T19:54:24.213 INFO:teuthology.orchestra.run.smithi008.stdout: "event": "dispatched", 2023-08-01T19:54:24.213 INFO:teuthology.orchestra.run.smithi008.stdout: "time": "2023-08-01T19:54:04.471069+0000", 2023-08-01T19:54:24.213 INFO:teuthology.orchestra.run.smithi008.stdout: "duration": 1.0156999999999999e-05 2023-08-01T19:54:24.213 INFO:teuthology.orchestra.run.smithi008.stdout: }, 2023-08-01T19:54:24.213 INFO:teuthology.orchestra.run.smithi008.stdout: { 2023-08-01T19:54:24.213 INFO:teuthology.orchestra.run.smithi008.stdout: "event": "queued_for_pg", 2023-08-01T19:54:24.213 INFO:teuthology.orchestra.run.smithi008.stdout: "time": "2023-08-01T19:54:04.471077+0000", 2023-08-01T19:54:24.213 INFO:teuthology.orchestra.run.smithi008.stdout: "duration": 7.2599999999999999e-06 2023-08-01T19:54:24.214 INFO:teuthology.orchestra.run.smithi008.stdout: }, 2023-08-01T19:54:24.214 INFO:teuthology.orchestra.run.smithi008.stdout: { 2023-08-01T19:54:24.214 INFO:teuthology.orchestra.run.smithi008.stdout: "event": "reached_pg", 2023-08-01T19:54:24.214 INFO:teuthology.orchestra.run.smithi008.stdout: "time": "2023-08-01T19:54:04.471115+0000", 2023-08-01T19:54:24.214 INFO:teuthology.orchestra.run.smithi008.stdout: "duration": 3.8331000000000003e-05 2023-08-01T19:54:24.214 INFO:teuthology.orchestra.run.smithi008.stdout: }, 2023-08-01T19:54:24.214 INFO:teuthology.orchestra.run.smithi008.stdout: { 2023-08-01T19:54:24.214 INFO:teuthology.orchestra.run.smithi008.stdout: "event": "started", 2023-08-01T19:54:24.215 INFO:teuthology.orchestra.run.smithi008.stdout: "time": "2023-08-01T19:54:04.471124+0000", 2023-08-01T19:54:24.215 INFO:teuthology.orchestra.run.smithi008.stdout: "duration": 9.2199999999999998e-06 2023-08-01T19:54:24.215 INFO:teuthology.orchestra.run.smithi008.stdout: }, 2023-08-01T19:54:24.215 INFO:teuthology.orchestra.run.smithi008.stdout: { 2023-08-01T19:54:24.215 INFO:teuthology.orchestra.run.smithi008.stdout: "event": "done", 2023-08-01T19:54:24.215 INFO:teuthology.orchestra.run.smithi008.stdout: "time": "2023-08-01T19:54:04.471411+0000", 2023-08-01T19:54:24.215 INFO:teuthology.orchestra.run.smithi008.stdout: "duration": 0.000287146 2023-08-01T19:54:24.216 INFO:teuthology.orchestra.run.smithi008.stdout: } 2023-08-01T19:54:24.216 INFO:teuthology.orchestra.run.smithi008.stdout: ] 2023-08-01T19:54:24.216 INFO:teuthology.orchestra.run.smithi008.stdout: } 2023-08-01T19:54:24.216 INFO:teuthology.orchestra.run.smithi008.stdout: }, 2023-08-01T19:54:24.216 INFO:teuthology.orchestra.run.smithi008.stdout: { 2023-08-01T19:54:24.216 INFO:teuthology.orchestra.run.smithi008.stdout: "description": "osd_repop(mds.0.3:27 3.13 e17/15 3:c91d4a1d:::mds0_inotable:head v 17'2, mlcod=0'0)", 2023-08-01T19:54:24.216 INFO:teuthology.orchestra.run.smithi008.stdout: "initiated_at": "2023-08-01T19:54:04.471969+0000", 2023-08-01T19:54:24.216 INFO:teuthology.orchestra.run.smithi008.stdout: "age": 19.604685519, 2023-08-01T19:54:24.217 INFO:teuthology.orchestra.run.smithi008.stdout: "duration": 0.0016025169999999999, 2023-08-01T19:54:24.217 INFO:teuthology.orchestra.run.smithi008.stdout: "type_data": { 2023-08-01T19:54:24.217 INFO:teuthology.orchestra.run.smithi008.stdout: "flag_point": "commit sent; apply or cleanup", 2023-08-01T19:54:24.217 INFO:teuthology.orchestra.run.smithi008.stdout: "events": [ 2023-08-01T19:54:24.217 INFO:teuthology.orchestra.run.smithi008.stdout: { 2023-08-01T19:54:24.217 INFO:teuthology.orchestra.run.smithi008.stdout: "event": "initiated", 2023-08-01T19:54:24.217 INFO:teuthology.orchestra.run.smithi008.stdout: "time": "2023-08-01T19:54:04.471969+0000", 2023-08-01T19:54:24.217 INFO:teuthology.orchestra.run.smithi008.stdout: "duration": 0 2023-08-01T19:54:24.218 INFO:teuthology.orchestra.run.smithi008.stdout: }, 2023-08-01T19:54:24.218 INFO:teuthology.orchestra.run.smithi008.stdout: { 2023-08-01T19:54:24.218 INFO:teuthology.orchestra.run.smithi008.stdout: "event": "throttled", 2023-08-01T19:54:24.218 INFO:teuthology.orchestra.run.smithi008.stdout: "time": "2023-08-01T19:54:04.471969+0000", 2023-08-01T19:54:24.218 INFO:teuthology.orchestra.run.smithi008.stdout: "duration": 0 2023-08-01T19:54:24.218 INFO:teuthology.orchestra.run.smithi008.stdout: }, 2023-08-01T19:54:24.218 INFO:teuthology.orchestra.run.smithi008.stdout: { 2023-08-01T19:54:24.218 INFO:teuthology.orchestra.run.smithi008.stdout: "event": "header_read", 2023-08-01T19:54:24.219 INFO:teuthology.orchestra.run.smithi008.stdout: "time": "2023-08-01T19:54:04.471969+0000", 2023-08-01T19:54:24.219 INFO:teuthology.orchestra.run.smithi008.stdout: "duration": 4294967295.9999995 2023-08-01T19:54:24.219 INFO:teuthology.orchestra.run.smithi008.stdout: }, 2023-08-01T19:54:24.219 INFO:teuthology.orchestra.run.smithi008.stdout: { 2023-08-01T19:54:24.219 INFO:teuthology.orchestra.run.smithi008.stdout: "event": "all_read", 2023-08-01T19:54:24.219 INFO:teuthology.orchestra.run.smithi008.stdout: "time": "2023-08-01T19:54:04.471975+0000", 2023-08-01T19:54:24.219 INFO:teuthology.orchestra.run.smithi008.stdout: "duration": 6.1070000000000001e-06 2023-08-01T19:54:24.219 INFO:teuthology.orchestra.run.smithi008.stdout: }, 2023-08-01T19:54:24.220 INFO:teuthology.orchestra.run.smithi008.stdout: { 2023-08-01T19:54:24.220 INFO:teuthology.orchestra.run.smithi008.stdout: "event": "dispatched", 2023-08-01T19:54:24.220 INFO:teuthology.orchestra.run.smithi008.stdout: "time": "2023-08-01T19:54:04.471982+0000", 2023-08-01T19:54:24.220 INFO:teuthology.orchestra.run.smithi008.stdout: "duration": 7.3239999999999997e-06 2023-08-01T19:54:24.220 INFO:teuthology.orchestra.run.smithi008.stdout: }, 2023-08-01T19:54:24.220 INFO:teuthology.orchestra.run.smithi008.stdout: { 2023-08-01T19:54:24.220 INFO:teuthology.orchestra.run.smithi008.stdout: "event": "queued_for_pg", 2023-08-01T19:54:24.220 INFO:teuthology.orchestra.run.smithi008.stdout: "time": "2023-08-01T19:54:04.471989+0000", 2023-08-01T19:54:24.221 INFO:teuthology.orchestra.run.smithi008.stdout: "duration": 6.9110000000000004e-06 2023-08-01T19:54:24.221 INFO:teuthology.orchestra.run.smithi008.stdout: }, 2023-08-01T19:54:24.221 INFO:teuthology.orchestra.run.smithi008.stdout: { 2023-08-01T19:54:24.221 INFO:teuthology.orchestra.run.smithi008.stdout: "event": "reached_pg", 2023-08-01T19:54:24.221 INFO:teuthology.orchestra.run.smithi008.stdout: "time": "2023-08-01T19:54:04.472128+0000", 2023-08-01T19:54:24.221 INFO:teuthology.orchestra.run.smithi008.stdout: "duration": 0.000139049 2023-08-01T19:54:24.221 INFO:teuthology.orchestra.run.smithi008.stdout: }, 2023-08-01T19:54:24.222 INFO:teuthology.orchestra.run.smithi008.stdout: { 2023-08-01T19:54:24.222 INFO:teuthology.orchestra.run.smithi008.stdout: "event": "started", 2023-08-01T19:54:24.222 INFO:teuthology.orchestra.run.smithi008.stdout: "time": "2023-08-01T19:54:04.472142+0000", 2023-08-01T19:54:24.222 INFO:teuthology.orchestra.run.smithi008.stdout: "duration": 1.3913e-05 2023-08-01T19:54:24.222 INFO:teuthology.orchestra.run.smithi008.stdout: }, 2023-08-01T19:54:24.222 INFO:teuthology.orchestra.run.smithi008.stdout: { 2023-08-01T19:54:24.222 INFO:teuthology.orchestra.run.smithi008.stdout: "event": "commit_sent", 2023-08-01T19:54:24.222 INFO:teuthology.orchestra.run.smithi008.stdout: "time": "2023-08-01T19:54:04.473536+0000", 2023-08-01T19:54:24.223 INFO:teuthology.orchestra.run.smithi008.stdout: "duration": 0.0013934049999999999 2023-08-01T19:54:24.223 INFO:teuthology.orchestra.run.smithi008.stdout: }, 2023-08-01T19:54:24.223 INFO:teuthology.orchestra.run.smithi008.stdout: { 2023-08-01T19:54:24.223 INFO:teuthology.orchestra.run.smithi008.stdout: "event": "done", 2023-08-01T19:54:24.223 INFO:teuthology.orchestra.run.smithi008.stdout: "time": "2023-08-01T19:54:04.473572+0000", 2023-08-01T19:54:24.223 INFO:teuthology.orchestra.run.smithi008.stdout: "duration": 3.6267999999999999e-05 2023-08-01T19:54:24.223 INFO:teuthology.orchestra.run.smithi008.stdout: } 2023-08-01T19:54:24.223 INFO:teuthology.orchestra.run.smithi008.stdout: ] 2023-08-01T19:54:24.224 INFO:teuthology.orchestra.run.smithi008.stdout: } 2023-08-01T19:54:24.224 INFO:teuthology.orchestra.run.smithi008.stdout: }, 2023-08-01T19:54:24.224 INFO:teuthology.orchestra.run.smithi008.stdout: { 2023-08-01T19:54:24.224 INFO:teuthology.orchestra.run.smithi008.stdout: "description": "osd_repop(mds.0.3:21 3.1c e17/15 3:3ed09add:::607.00000000:head v 17'2, mlcod=0'0)", 2023-08-01T19:54:24.224 INFO:teuthology.orchestra.run.smithi008.stdout: "initiated_at": "2023-08-01T19:54:04.472009+0000", 2023-08-01T19:54:24.224 INFO:teuthology.orchestra.run.smithi008.stdout: "age": 19.604645999999999, 2023-08-01T19:54:24.224 INFO:teuthology.orchestra.run.smithi008.stdout: "duration": 0.00153543, 2023-08-01T19:54:24.224 INFO:teuthology.orchestra.run.smithi008.stdout: "type_data": { 2023-08-01T19:54:24.225 INFO:teuthology.orchestra.run.smithi008.stdout: "flag_point": "commit sent; apply or cleanup", 2023-08-01T19:54:24.225 INFO:teuthology.orchestra.run.smithi008.stdout: "events": [ 2023-08-01T19:54:24.225 INFO:teuthology.orchestra.run.smithi008.stdout: { 2023-08-01T19:54:24.225 INFO:teuthology.orchestra.run.smithi008.stdout: "event": "initiated", 2023-08-01T19:54:24.225 INFO:teuthology.orchestra.run.smithi008.stdout: "time": "2023-08-01T19:54:04.472009+0000", 2023-08-01T19:54:24.225 INFO:teuthology.orchestra.run.smithi008.stdout: "duration": 0 2023-08-01T19:54:24.225 INFO:teuthology.orchestra.run.smithi008.stdout: }, 2023-08-01T19:54:24.225 INFO:teuthology.orchestra.run.smithi008.stdout: { 2023-08-01T19:54:24.226 INFO:teuthology.orchestra.run.smithi008.stdout: "event": "throttled", 2023-08-01T19:54:24.226 INFO:teuthology.orchestra.run.smithi008.stdout: "time": "2023-08-01T19:54:04.472009+0000", 2023-08-01T19:54:24.226 INFO:teuthology.orchestra.run.smithi008.stdout: "duration": 0 2023-08-01T19:54:24.226 INFO:teuthology.orchestra.run.smithi008.stdout: }, 2023-08-01T19:54:24.226 INFO:teuthology.orchestra.run.smithi008.stdout: { 2023-08-01T19:54:24.226 INFO:teuthology.orchestra.run.smithi008.stdout: "event": "header_read", 2023-08-01T19:54:24.226 INFO:teuthology.orchestra.run.smithi008.stdout: "time": "2023-08-01T19:54:04.472009+0000", 2023-08-01T19:54:24.226 INFO:teuthology.orchestra.run.smithi008.stdout: "duration": 4294967296 2023-08-01T19:54:24.227 INFO:teuthology.orchestra.run.smithi008.stdout: }, 2023-08-01T19:54:24.227 INFO:teuthology.orchestra.run.smithi008.stdout: { 2023-08-01T19:54:24.227 INFO:teuthology.orchestra.run.smithi008.stdout: "event": "all_read", 2023-08-01T19:54:24.227 INFO:teuthology.orchestra.run.smithi008.stdout: "time": "2023-08-01T19:54:04.472020+0000", 2023-08-01T19:54:24.227 INFO:teuthology.orchestra.run.smithi008.stdout: "duration": 1.1488000000000001e-05 2023-08-01T19:54:24.227 INFO:teuthology.orchestra.run.smithi008.stdout: }, 2023-08-01T19:54:24.227 INFO:teuthology.orchestra.run.smithi008.stdout: { 2023-08-01T19:54:24.227 INFO:teuthology.orchestra.run.smithi008.stdout: "event": "dispatched", 2023-08-01T19:54:24.228 INFO:teuthology.orchestra.run.smithi008.stdout: "time": "2023-08-01T19:54:04.472029+0000", 2023-08-01T19:54:24.228 INFO:teuthology.orchestra.run.smithi008.stdout: "duration": 8.4649999999999994e-06 2023-08-01T19:54:24.228 INFO:teuthology.orchestra.run.smithi008.stdout: }, 2023-08-01T19:54:24.228 INFO:teuthology.orchestra.run.smithi008.stdout: { 2023-08-01T19:54:24.228 INFO:teuthology.orchestra.run.smithi008.stdout: "event": "queued_for_pg", 2023-08-01T19:54:24.228 INFO:teuthology.orchestra.run.smithi008.stdout: "time": "2023-08-01T19:54:04.472044+0000", 2023-08-01T19:54:24.228 INFO:teuthology.orchestra.run.smithi008.stdout: "duration": 1.5157000000000001e-05 2023-08-01T19:54:24.229 INFO:teuthology.orchestra.run.smithi008.stdout: }, 2023-08-01T19:54:24.229 INFO:teuthology.orchestra.run.smithi008.stdout: { 2023-08-01T19:54:24.229 INFO:teuthology.orchestra.run.smithi008.stdout: "event": "reached_pg", 2023-08-01T19:54:24.229 INFO:teuthology.orchestra.run.smithi008.stdout: "time": "2023-08-01T19:54:04.472095+0000", 2023-08-01T19:54:24.229 INFO:teuthology.orchestra.run.smithi008.stdout: "duration": 5.1592999999999999e-05 2023-08-01T19:54:24.229 INFO:teuthology.orchestra.run.smithi008.stdout: }, 2023-08-01T19:54:24.229 INFO:teuthology.orchestra.run.smithi008.stdout: { 2023-08-01T19:54:24.229 INFO:teuthology.orchestra.run.smithi008.stdout: "event": "started", 2023-08-01T19:54:24.230 INFO:teuthology.orchestra.run.smithi008.stdout: "time": "2023-08-01T19:54:04.472116+0000", 2023-08-01T19:54:24.230 INFO:teuthology.orchestra.run.smithi008.stdout: "duration": 2.0377000000000002e-05 2023-08-01T19:54:24.230 INFO:teuthology.orchestra.run.smithi008.stdout: }, 2023-08-01T19:54:24.230 INFO:teuthology.orchestra.run.smithi008.stdout: { 2023-08-01T19:54:24.230 INFO:teuthology.orchestra.run.smithi008.stdout: "event": "commit_sent", 2023-08-01T19:54:24.230 INFO:teuthology.orchestra.run.smithi008.stdout: "time": "2023-08-01T19:54:04.473507+0000", 2023-08-01T19:54:24.230 INFO:teuthology.orchestra.run.smithi008.stdout: "duration": 0.001390987 2023-08-01T19:54:24.230 INFO:teuthology.orchestra.run.smithi008.stdout: }, 2023-08-01T19:54:24.231 INFO:teuthology.orchestra.run.smithi008.stdout: { 2023-08-01T19:54:24.231 INFO:teuthology.orchestra.run.smithi008.stdout: "event": "done", 2023-08-01T19:54:24.231 INFO:teuthology.orchestra.run.smithi008.stdout: "time": "2023-08-01T19:54:04.473544+0000", 2023-08-01T19:54:24.231 INFO:teuthology.orchestra.run.smithi008.stdout: "duration": 3.7543999999999998e-05 2023-08-01T19:54:24.231 INFO:teuthology.orchestra.run.smithi008.stdout: } 2023-08-01T19:54:24.231 INFO:teuthology.orchestra.run.smithi008.stdout: ] 2023-08-01T19:54:24.231 INFO:teuthology.orchestra.run.smithi008.stdout: } 2023-08-01T19:54:24.231 INFO:teuthology.orchestra.run.smithi008.stdout: }, 2023-08-01T19:54:24.232 INFO:teuthology.orchestra.run.smithi008.stdout: { 2023-08-01T19:54:24.232 INFO:teuthology.orchestra.run.smithi008.stdout: "description": "pg_update_log_missing_reply(3.1f epoch 17/15 rep_tid 7 lcod 17'4)", 2023-08-01T19:54:24.232 INFO:teuthology.orchestra.run.smithi008.stdout: "initiated_at": "2023-08-01T19:54:04.472294+0000", 2023-08-01T19:54:24.232 INFO:teuthology.orchestra.run.smithi008.stdout: "age": 19.604361205, 2023-08-01T19:54:24.232 INFO:teuthology.orchestra.run.smithi008.stdout: "duration": 0.00044598000000000001, 2023-08-01T19:54:24.232 INFO:teuthology.orchestra.run.smithi008.stdout: "type_data": { 2023-08-01T19:54:24.232 INFO:teuthology.orchestra.run.smithi008.stdout: "flag_point": "reached pg", 2023-08-01T19:54:24.232 INFO:teuthology.orchestra.run.smithi008.stdout: "events": [ 2023-08-01T19:54:24.233 INFO:teuthology.orchestra.run.smithi008.stdout: { 2023-08-01T19:54:24.233 INFO:teuthology.orchestra.run.smithi008.stdout: "event": "initiated", 2023-08-01T19:54:24.233 INFO:teuthology.orchestra.run.smithi008.stdout: "time": "2023-08-01T19:54:04.472294+0000", 2023-08-01T19:54:24.233 INFO:teuthology.orchestra.run.smithi008.stdout: "duration": 0 2023-08-01T19:54:24.233 INFO:teuthology.orchestra.run.smithi008.stdout: }, 2023-08-01T19:54:24.233 INFO:teuthology.orchestra.run.smithi008.stdout: { 2023-08-01T19:54:24.233 INFO:teuthology.orchestra.run.smithi008.stdout: "event": "throttled", 2023-08-01T19:54:24.233 INFO:teuthology.orchestra.run.smithi008.stdout: "time": "2023-08-01T19:54:04.472294+0000", 2023-08-01T19:54:24.234 INFO:teuthology.orchestra.run.smithi008.stdout: "duration": 0 2023-08-01T19:54:24.234 INFO:teuthology.orchestra.run.smithi008.stdout: }, 2023-08-01T19:54:24.234 INFO:teuthology.orchestra.run.smithi008.stdout: { 2023-08-01T19:54:24.234 INFO:teuthology.orchestra.run.smithi008.stdout: "event": "header_read", 2023-08-01T19:54:24.234 INFO:teuthology.orchestra.run.smithi008.stdout: "time": "2023-08-01T19:54:04.472293+0000", 2023-08-01T19:54:24.234 INFO:teuthology.orchestra.run.smithi008.stdout: "duration": 4294967295.9999995 2023-08-01T19:54:24.234 INFO:teuthology.orchestra.run.smithi008.stdout: }, 2023-08-01T19:54:24.235 INFO:teuthology.orchestra.run.smithi008.stdout: { 2023-08-01T19:54:24.235 INFO:teuthology.orchestra.run.smithi008.stdout: "event": "all_read", 2023-08-01T19:54:24.235 INFO:teuthology.orchestra.run.smithi008.stdout: "time": "2023-08-01T19:54:04.472298+0000", 2023-08-01T19:54:24.235 INFO:teuthology.orchestra.run.smithi008.stdout: "duration": 4.6759999999999998e-06 2023-08-01T19:54:24.235 INFO:teuthology.orchestra.run.smithi008.stdout: }, 2023-08-01T19:54:24.235 INFO:teuthology.orchestra.run.smithi008.stdout: { 2023-08-01T19:54:24.235 INFO:teuthology.orchestra.run.smithi008.stdout: "event": "dispatched", 2023-08-01T19:54:24.235 INFO:teuthology.orchestra.run.smithi008.stdout: "time": "2023-08-01T19:54:04.472309+0000", 2023-08-01T19:54:24.236 INFO:teuthology.orchestra.run.smithi008.stdout: "duration": 1.1192999999999999e-05 2023-08-01T19:54:24.236 INFO:teuthology.orchestra.run.smithi008.stdout: }, 2023-08-01T19:54:24.236 INFO:teuthology.orchestra.run.smithi008.stdout: { 2023-08-01T19:54:24.236 INFO:teuthology.orchestra.run.smithi008.stdout: "event": "queued_for_pg", 2023-08-01T19:54:24.236 INFO:teuthology.orchestra.run.smithi008.stdout: "time": "2023-08-01T19:54:04.472316+0000", 2023-08-01T19:54:24.236 INFO:teuthology.orchestra.run.smithi008.stdout: "duration": 6.9890000000000003e-06 2023-08-01T19:54:24.236 INFO:teuthology.orchestra.run.smithi008.stdout: }, 2023-08-01T19:54:24.236 INFO:teuthology.orchestra.run.smithi008.stdout: { 2023-08-01T19:54:24.237 INFO:teuthology.orchestra.run.smithi008.stdout: "event": "reached_pg", 2023-08-01T19:54:24.237 INFO:teuthology.orchestra.run.smithi008.stdout: "time": "2023-08-01T19:54:04.472639+0000", 2023-08-01T19:54:24.237 INFO:teuthology.orchestra.run.smithi008.stdout: "duration": 0.00032313600000000002 2023-08-01T19:54:24.237 INFO:teuthology.orchestra.run.smithi008.stdout: }, 2023-08-01T19:54:24.237 INFO:teuthology.orchestra.run.smithi008.stdout: { 2023-08-01T19:54:24.237 INFO:teuthology.orchestra.run.smithi008.stdout: "event": "done", 2023-08-01T19:54:24.237 INFO:teuthology.orchestra.run.smithi008.stdout: "time": "2023-08-01T19:54:04.472740+0000", 2023-08-01T19:54:24.237 INFO:teuthology.orchestra.run.smithi008.stdout: "duration": 0.00010061200000000001 2023-08-01T19:54:24.238 INFO:teuthology.orchestra.run.smithi008.stdout: } 2023-08-01T19:54:24.238 INFO:teuthology.orchestra.run.smithi008.stdout: ] 2023-08-01T19:54:24.238 INFO:teuthology.orchestra.run.smithi008.stdout: } 2023-08-01T19:54:24.238 INFO:teuthology.orchestra.run.smithi008.stdout: }, 2023-08-01T19:54:24.238 INFO:teuthology.orchestra.run.smithi008.stdout: { 2023-08-01T19:54:24.238 INFO:teuthology.orchestra.run.smithi008.stdout: "description": "osd_op(mds.0.3:39 3.6 3:654134d2:::mds0_openfiles.0:head [omap-clear,omap-set-header] snapc 0=[] ondisk+write+known_if_redirected+full_force+supports_pool_eio e18)", 2023-08-01T19:54:24.238 INFO:teuthology.orchestra.run.smithi008.stdout: "initiated_at": "2023-08-01T19:54:09.077791+0000", 2023-08-01T19:54:24.238 INFO:teuthology.orchestra.run.smithi008.stdout: "age": 14.998863568999999, 2023-08-01T19:54:24.239 INFO:teuthology.orchestra.run.smithi008.stdout: "duration": 0.001712018, 2023-08-01T19:54:24.239 INFO:teuthology.orchestra.run.smithi008.stdout: "type_data": { 2023-08-01T19:54:24.239 INFO:teuthology.orchestra.run.smithi008.stdout: "flag_point": "commit sent; apply or cleanup", 2023-08-01T19:54:24.239 INFO:teuthology.orchestra.run.smithi008.stdout: "events": [ 2023-08-01T19:54:24.239 INFO:teuthology.orchestra.run.smithi008.stdout: { 2023-08-01T19:54:24.239 INFO:teuthology.orchestra.run.smithi008.stdout: "event": "initiated", 2023-08-01T19:54:24.239 INFO:teuthology.orchestra.run.smithi008.stdout: "time": "2023-08-01T19:54:09.077791+0000", 2023-08-01T19:54:24.239 INFO:teuthology.orchestra.run.smithi008.stdout: "duration": 0 2023-08-01T19:54:24.240 INFO:teuthology.orchestra.run.smithi008.stdout: }, 2023-08-01T19:54:24.240 INFO:teuthology.orchestra.run.smithi008.stdout: { 2023-08-01T19:54:24.240 INFO:teuthology.orchestra.run.smithi008.stdout: "event": "throttled", 2023-08-01T19:54:24.240 INFO:teuthology.orchestra.run.smithi008.stdout: "time": "2023-08-01T19:54:09.077791+0000", 2023-08-01T19:54:24.240 INFO:teuthology.orchestra.run.smithi008.stdout: "duration": 0 2023-08-01T19:54:24.240 INFO:teuthology.orchestra.run.smithi008.stdout: }, 2023-08-01T19:54:24.240 INFO:teuthology.orchestra.run.smithi008.stdout: { 2023-08-01T19:54:24.240 INFO:teuthology.orchestra.run.smithi008.stdout: "event": "header_read", 2023-08-01T19:54:24.241 INFO:teuthology.orchestra.run.smithi008.stdout: "time": "2023-08-01T19:54:09.077788+0000", 2023-08-01T19:54:24.241 INFO:teuthology.orchestra.run.smithi008.stdout: "duration": 4294967295.9999971 2023-08-01T19:54:24.241 INFO:teuthology.orchestra.run.smithi008.stdout: }, 2023-08-01T19:54:24.241 INFO:teuthology.orchestra.run.smithi008.stdout: { 2023-08-01T19:54:24.241 INFO:teuthology.orchestra.run.smithi008.stdout: "event": "all_read", 2023-08-01T19:54:24.241 INFO:teuthology.orchestra.run.smithi008.stdout: "time": "2023-08-01T19:54:09.077803+0000", 2023-08-01T19:54:24.241 INFO:teuthology.orchestra.run.smithi008.stdout: "duration": 1.4756999999999999e-05 2023-08-01T19:54:24.241 INFO:teuthology.orchestra.run.smithi008.stdout: }, 2023-08-01T19:54:24.242 INFO:teuthology.orchestra.run.smithi008.stdout: { 2023-08-01T19:54:24.242 INFO:teuthology.orchestra.run.smithi008.stdout: "event": "dispatched", 2023-08-01T19:54:24.242 INFO:teuthology.orchestra.run.smithi008.stdout: "time": "2023-08-01T19:54:09.077838+0000", 2023-08-01T19:54:24.242 INFO:teuthology.orchestra.run.smithi008.stdout: "duration": 3.4446000000000002e-05 2023-08-01T19:54:24.242 INFO:teuthology.orchestra.run.smithi008.stdout: }, 2023-08-01T19:54:24.242 INFO:teuthology.orchestra.run.smithi008.stdout: { 2023-08-01T19:54:24.242 INFO:teuthology.orchestra.run.smithi008.stdout: "event": "queued_for_pg", 2023-08-01T19:54:24.243 INFO:teuthology.orchestra.run.smithi008.stdout: "time": "2023-08-01T19:54:09.077852+0000", 2023-08-01T19:54:24.243 INFO:teuthology.orchestra.run.smithi008.stdout: "duration": 1.471e-05 2023-08-01T19:54:24.243 INFO:teuthology.orchestra.run.smithi008.stdout: }, 2023-08-01T19:54:24.243 INFO:teuthology.orchestra.run.smithi008.stdout: { 2023-08-01T19:54:24.243 INFO:teuthology.orchestra.run.smithi008.stdout: "event": "reached_pg", 2023-08-01T19:54:24.243 INFO:teuthology.orchestra.run.smithi008.stdout: "time": "2023-08-01T19:54:09.077956+0000", 2023-08-01T19:54:24.243 INFO:teuthology.orchestra.run.smithi008.stdout: "duration": 0.000104073 2023-08-01T19:54:24.243 INFO:teuthology.orchestra.run.smithi008.stdout: }, 2023-08-01T19:54:24.244 INFO:teuthology.orchestra.run.smithi008.stdout: { 2023-08-01T19:54:24.244 INFO:teuthology.orchestra.run.smithi008.stdout: "event": "started", 2023-08-01T19:54:24.244 INFO:teuthology.orchestra.run.smithi008.stdout: "time": "2023-08-01T19:54:09.078061+0000", 2023-08-01T19:54:24.244 INFO:teuthology.orchestra.run.smithi008.stdout: "duration": 0.0001043 2023-08-01T19:54:24.244 INFO:teuthology.orchestra.run.smithi008.stdout: }, 2023-08-01T19:54:24.244 INFO:teuthology.orchestra.run.smithi008.stdout: { 2023-08-01T19:54:24.244 INFO:teuthology.orchestra.run.smithi008.stdout: "event": "waiting for subops from 1", 2023-08-01T19:54:24.244 INFO:teuthology.orchestra.run.smithi008.stdout: "time": "2023-08-01T19:54:09.078161+0000", 2023-08-01T19:54:24.245 INFO:teuthology.orchestra.run.smithi008.stdout: "duration": 0.00010060699999999999 2023-08-01T19:54:24.245 INFO:teuthology.orchestra.run.smithi008.stdout: }, 2023-08-01T19:54:24.245 INFO:teuthology.orchestra.run.smithi008.stdout: { 2023-08-01T19:54:24.245 INFO:teuthology.orchestra.run.smithi008.stdout: "event": "op_commit", 2023-08-01T19:54:24.245 INFO:teuthology.orchestra.run.smithi008.stdout: "time": "2023-08-01T19:54:09.078883+0000", 2023-08-01T19:54:24.245 INFO:teuthology.orchestra.run.smithi008.stdout: "duration": 0.00072164500000000003 2023-08-01T19:54:24.245 INFO:teuthology.orchestra.run.smithi008.stdout: }, 2023-08-01T19:54:24.245 INFO:teuthology.orchestra.run.smithi008.stdout: { 2023-08-01T19:54:24.246 INFO:teuthology.orchestra.run.smithi008.stdout: "event": "sub_op_commit_rec", 2023-08-01T19:54:24.246 INFO:teuthology.orchestra.run.smithi008.stdout: "time": "2023-08-01T19:54:09.079439+0000", 2023-08-01T19:54:24.246 INFO:teuthology.orchestra.run.smithi008.stdout: "duration": 0.00055606199999999996 2023-08-01T19:54:24.246 INFO:teuthology.orchestra.run.smithi008.stdout: }, 2023-08-01T19:54:24.246 INFO:teuthology.orchestra.run.smithi008.stdout: { 2023-08-01T19:54:24.246 INFO:teuthology.orchestra.run.smithi008.stdout: "event": "commit_sent", 2023-08-01T19:54:24.246 INFO:teuthology.orchestra.run.smithi008.stdout: "time": "2023-08-01T19:54:09.079474+0000", 2023-08-01T19:54:24.246 INFO:teuthology.orchestra.run.smithi008.stdout: "duration": 3.5265000000000002e-05 2023-08-01T19:54:24.247 INFO:teuthology.orchestra.run.smithi008.stdout: }, 2023-08-01T19:54:24.247 INFO:teuthology.orchestra.run.smithi008.stdout: { 2023-08-01T19:54:24.247 INFO:teuthology.orchestra.run.smithi008.stdout: "event": "done", 2023-08-01T19:54:24.247 INFO:teuthology.orchestra.run.smithi008.stdout: "time": "2023-08-01T19:54:09.079503+0000", 2023-08-01T19:54:24.247 INFO:teuthology.orchestra.run.smithi008.stdout: "duration": 2.9130000000000001e-05 2023-08-01T19:54:24.247 INFO:teuthology.orchestra.run.smithi008.stdout: } 2023-08-01T19:54:24.247 INFO:teuthology.orchestra.run.smithi008.stdout: ] 2023-08-01T19:54:24.247 INFO:teuthology.orchestra.run.smithi008.stdout: } 2023-08-01T19:54:24.248 INFO:teuthology.orchestra.run.smithi008.stdout: } 2023-08-01T19:54:24.248 INFO:teuthology.orchestra.run.smithi008.stdout: ] 2023-08-01T19:54:24.248 INFO:teuthology.orchestra.run.smithi008.stdout:} 2023-08-01T19:54:24.248 DEBUG:teuthology.orchestra.run.smithi006:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 120 ceph --cluster ceph osd set nodeep-scrub 2023-08-01T19:54:24.249 DEBUG:teuthology.orchestra.run.smithi006:> /bin/sh -c 'adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage rados --no-log-to-stderr --name client.0 -b 65536 --object-size 65536 -p unique_pool_0 bench 60 write' 2023-08-01T19:54:24.250 DEBUG:teuthology.orchestra.run.smithi101:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 30 ceph --cluster ceph --admin-daemon /var/run/ceph/ceph-osd.1.asok dump_ops_in_flight 2023-08-01T19:54:24.251 INFO:tasks.ceph.osd.1.smithi101.stderr:2023-08-01T19:54:24.249+0000 7fb0cb7f6700 -1 received signal: Hangup from /usr/bin/python3 /bin/daemon-helper kill ceph-osd -f --cluster ceph -i 1 (PID: 111141) UID: 0 2023-08-01T19:54:24.252 INFO:teuthology.run_tasks:Running task admin_socket... 2023-08-01T19:54:24.263 DEBUG:tasks.admin_socket:Running admin socket tests on client.0 2023-08-01T19:54:24.263 DEBUG:teuthology.orchestra.run.smithi006:> mkdir -- /home/ubuntu/cephtest/admin_socket_client.0 && while test '!' -e /var/run/ceph/ceph-client.0.asok ; do sleep 1 ; done 2023-08-01T19:54:24.311 INFO:tasks.radosbench.radosbench.0.smithi006.stdout:hints = 1 2023-08-01T19:54:24.312 INFO:tasks.radosbench.radosbench.0.smithi006.stdout:Maintaining 16 concurrent writes of 65536 bytes to objects of size 65536 for up to 60 seconds or 0 objects 2023-08-01T19:54:24.312 INFO:tasks.radosbench.radosbench.0.smithi006.stdout:Object prefix: benchmark_data_smithi006_114134 2023-08-01T19:54:24.312 INFO:tasks.radosbench.radosbench.0.smithi006.stdout: sec Cur ops started finished avg MB/s cur MB/s last lat(s) avg lat(s) 2023-08-01T19:54:24.313 INFO:tasks.radosbench.radosbench.0.smithi006.stdout: 0 0 0 0 0 0 - 0 2023-08-01T19:54:24.314 DEBUG:tasks.admin_socket:Testing objecter_requests with config {'test': 'http://git.ceph.com/?p={repo};a=blob_plain;f=src/test/admin_socket/objecter_requests;hb={branch}', 'branch': 'quincy'} 2023-08-01T19:54:24.315 DEBUG:teuthology.orchestra.run.smithi006:> wget -q -O /home/ubuntu/cephtest/admin_socket_client.0/objecter_requests -- 'http://git.ceph.com/?p=ceph.git;a=blob_plain;f=src/test/admin_socket/objecter_requests;hb=quincy' && chmod u=rx -- /home/ubuntu/cephtest/admin_socket_client.0/objecter_requests 2023-08-01T19:54:24.351 INFO:tasks.ceph.osd.2.smithi155.stderr:2023-08-01T19:54:24.349+0000 7faa5c6ac700 -1 received signal: Hangup from /usr/bin/python3 /bin/daemon-helper kill ceph-osd -f --cluster ceph -i 2 (PID: 111337) UID: 0 2023-08-01T19:54:24.418 INFO:teuthology.orchestra.run.smithi101.stdout:{ 2023-08-01T19:54:24.418 INFO:teuthology.orchestra.run.smithi101.stdout: "ops": [ 2023-08-01T19:54:24.418 INFO:teuthology.orchestra.run.smithi101.stdout: { 2023-08-01T19:54:24.419 INFO:teuthology.orchestra.run.smithi101.stdout: "description": "osd_op(client.4668.0:437 5.f 5:f2a8455b:::benchmark_data_smithi006_114134_object436:head [set-alloc-hint object_size 65536 write_size 65536,write 0~65536 in=65536b] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e21)", 2023-08-01T19:54:24.419 INFO:teuthology.orchestra.run.smithi101.stdout: "initiated_at": "2023-08-01T19:54:24.413490+0000", 2023-08-01T19:54:24.419 INFO:teuthology.orchestra.run.smithi101.stdout: "age": 0.0026984410000000002, 2023-08-01T19:54:24.419 INFO:teuthology.orchestra.run.smithi101.stdout: "duration": 0.0027191939999999999, 2023-08-01T19:54:24.419 INFO:teuthology.orchestra.run.smithi101.stdout: "type_data": { 2023-08-01T19:54:24.419 INFO:teuthology.orchestra.run.smithi101.stdout: "flag_point": "waiting for sub ops", 2023-08-01T19:54:24.419 INFO:teuthology.orchestra.run.smithi101.stdout: "client_info": { 2023-08-01T19:54:24.420 INFO:teuthology.orchestra.run.smithi101.stdout: "client": "client.4668", 2023-08-01T19:54:24.420 INFO:teuthology.orchestra.run.smithi101.stdout: "client_addr": "172.21.15.6:0/1709472247", 2023-08-01T19:54:24.420 INFO:teuthology.orchestra.run.smithi101.stdout: "tid": 437 2023-08-01T19:54:24.420 INFO:teuthology.orchestra.run.smithi101.stdout: }, 2023-08-01T19:54:24.420 INFO:teuthology.orchestra.run.smithi101.stdout: "events": [ 2023-08-01T19:54:24.420 INFO:teuthology.orchestra.run.smithi101.stdout: { 2023-08-01T19:54:24.421 INFO:teuthology.orchestra.run.smithi101.stdout: "event": "initiated", 2023-08-01T19:54:24.421 INFO:teuthology.orchestra.run.smithi101.stdout: "time": "2023-08-01T19:54:24.413490+0000", 2023-08-01T19:54:24.421 INFO:teuthology.orchestra.run.smithi101.stdout: "duration": 0 2023-08-01T19:54:24.421 INFO:teuthology.orchestra.run.smithi101.stdout: }, 2023-08-01T19:54:24.421 INFO:teuthology.orchestra.run.smithi101.stdout: { 2023-08-01T19:54:24.421 INFO:teuthology.orchestra.run.smithi101.stdout: "event": "throttled", 2023-08-01T19:54:24.421 INFO:teuthology.orchestra.run.smithi101.stdout: "time": "2023-08-01T19:54:24.413490+0000", 2023-08-01T19:54:24.422 INFO:teuthology.orchestra.run.smithi101.stdout: "duration": 0 2023-08-01T19:54:24.422 INFO:teuthology.orchestra.run.smithi101.stdout: }, 2023-08-01T19:54:24.422 INFO:teuthology.orchestra.run.smithi101.stdout: { 2023-08-01T19:54:24.422 INFO:teuthology.orchestra.run.smithi101.stdout: "event": "header_read", 2023-08-01T19:54:24.422 INFO:teuthology.orchestra.run.smithi101.stdout: "time": "2023-08-01T19:54:24.413490+0000", 2023-08-01T19:54:24.422 INFO:teuthology.orchestra.run.smithi101.stdout: "duration": 4294967295.9999995 2023-08-01T19:54:24.422 INFO:teuthology.orchestra.run.smithi101.stdout: }, 2023-08-01T19:54:24.422 INFO:teuthology.orchestra.run.smithi101.stdout: { 2023-08-01T19:54:24.423 INFO:teuthology.orchestra.run.smithi101.stdout: "event": "all_read", 2023-08-01T19:54:24.423 INFO:teuthology.orchestra.run.smithi101.stdout: "time": "2023-08-01T19:54:24.413560+0000", 2023-08-01T19:54:24.423 INFO:teuthology.orchestra.run.smithi101.stdout: "duration": 7.0823999999999998e-05 2023-08-01T19:54:24.423 INFO:teuthology.orchestra.run.smithi101.stdout: }, 2023-08-01T19:54:24.423 INFO:teuthology.orchestra.run.smithi101.stdout: { 2023-08-01T19:54:24.424 INFO:teuthology.orchestra.run.smithi101.stdout: "event": "dispatched", 2023-08-01T19:54:24.424 INFO:teuthology.orchestra.run.smithi101.stdout: "time": "2023-08-01T19:54:24.413569+0000", 2023-08-01T19:54:24.424 INFO:teuthology.orchestra.run.smithi101.stdout: "duration": 8.6859999999999995e-06 2023-08-01T19:54:24.424 INFO:teuthology.orchestra.run.smithi101.stdout: }, 2023-08-01T19:54:24.424 INFO:teuthology.orchestra.run.smithi101.stdout: { 2023-08-01T19:54:24.424 INFO:teuthology.orchestra.run.smithi101.stdout: "event": "queued_for_pg", 2023-08-01T19:54:24.424 INFO:teuthology.orchestra.run.smithi101.stdout: "time": "2023-08-01T19:54:24.413575+0000", 2023-08-01T19:54:24.425 INFO:teuthology.orchestra.run.smithi101.stdout: "duration": 5.6489999999999996e-06 2023-08-01T19:54:24.425 INFO:teuthology.orchestra.run.smithi101.stdout: }, 2023-08-01T19:54:24.425 INFO:teuthology.orchestra.run.smithi101.stdout: { 2023-08-01T19:54:24.425 INFO:teuthology.orchestra.run.smithi101.stdout: "event": "reached_pg", 2023-08-01T19:54:24.425 INFO:teuthology.orchestra.run.smithi101.stdout: "time": "2023-08-01T19:54:24.413676+0000", 2023-08-01T19:54:24.425 INFO:teuthology.orchestra.run.smithi101.stdout: "duration": 0.000101566 2023-08-01T19:54:24.425 INFO:teuthology.orchestra.run.smithi101.stdout: }, 2023-08-01T19:54:24.426 INFO:teuthology.orchestra.run.smithi101.stdout: { 2023-08-01T19:54:24.426 INFO:teuthology.orchestra.run.smithi101.stdout: "event": "started", 2023-08-01T19:54:24.426 INFO:teuthology.orchestra.run.smithi101.stdout: "time": "2023-08-01T19:54:24.413800+0000", 2023-08-01T19:54:24.426 INFO:teuthology.orchestra.run.smithi101.stdout: "duration": 0.00012314300000000001 2023-08-01T19:54:24.426 INFO:teuthology.orchestra.run.smithi101.stdout: }, 2023-08-01T19:54:24.426 INFO:teuthology.orchestra.run.smithi101.stdout: { 2023-08-01T19:54:24.426 INFO:teuthology.orchestra.run.smithi101.stdout: "event": "waiting for subops from 2", 2023-08-01T19:54:24.426 INFO:teuthology.orchestra.run.smithi101.stdout: "time": "2023-08-01T19:54:24.413938+0000", 2023-08-01T19:54:24.427 INFO:teuthology.orchestra.run.smithi101.stdout: "duration": 0.00013815400000000001 2023-08-01T19:54:24.427 INFO:teuthology.orchestra.run.smithi101.stdout: }, 2023-08-01T19:54:24.427 INFO:teuthology.orchestra.run.smithi101.stdout: { 2023-08-01T19:54:24.427 INFO:teuthology.orchestra.run.smithi101.stdout: "event": "op_commit", 2023-08-01T19:54:24.427 INFO:teuthology.orchestra.run.smithi101.stdout: "time": "2023-08-01T19:54:24.415401+0000", 2023-08-01T19:54:24.427 INFO:teuthology.orchestra.run.smithi101.stdout: "duration": 0.001463354 2023-08-01T19:54:24.428 INFO:teuthology.orchestra.run.smithi101.stdout: } 2023-08-01T19:54:24.428 INFO:teuthology.orchestra.run.smithi101.stdout: ] 2023-08-01T19:54:24.428 INFO:teuthology.orchestra.run.smithi101.stdout: } 2023-08-01T19:54:24.428 INFO:teuthology.orchestra.run.smithi101.stdout: }, 2023-08-01T19:54:24.429 INFO:teuthology.orchestra.run.smithi101.stdout: { 2023-08-01T19:54:24.429 INFO:teuthology.orchestra.run.smithi101.stdout: "description": "osd_op(client.4668.0:439 5.f 5:fd2a120b:::benchmark_data_smithi006_114134_object438:head [set-alloc-hint object_size 65536 write_size 65536,write 0~65536 in=65536b] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e21)", 2023-08-01T19:54:24.429 INFO:teuthology.orchestra.run.smithi101.stdout: "initiated_at": "2023-08-01T19:54:24.414552+0000", 2023-08-01T19:54:24.429 INFO:teuthology.orchestra.run.smithi101.stdout: "age": 0.001636534, 2023-08-01T19:54:24.429 INFO:teuthology.orchestra.run.smithi101.stdout: "duration": 0.0017288189999999999, 2023-08-01T19:54:24.429 INFO:teuthology.orchestra.run.smithi101.stdout: "type_data": { 2023-08-01T19:54:24.429 INFO:teuthology.orchestra.run.smithi101.stdout: "flag_point": "waiting for sub ops", 2023-08-01T19:54:24.430 INFO:teuthology.orchestra.run.smithi101.stdout: "client_info": { 2023-08-01T19:54:24.430 INFO:teuthology.orchestra.run.smithi101.stdout: "client": "client.4668", 2023-08-01T19:54:24.430 INFO:teuthology.orchestra.run.smithi101.stdout: "client_addr": "172.21.15.6:0/1709472247", 2023-08-01T19:54:24.430 INFO:teuthology.orchestra.run.smithi101.stdout: "tid": 439 2023-08-01T19:54:24.430 INFO:teuthology.orchestra.run.smithi101.stdout: }, 2023-08-01T19:54:24.430 INFO:teuthology.orchestra.run.smithi101.stdout: "events": [ 2023-08-01T19:54:24.430 INFO:teuthology.orchestra.run.smithi101.stdout: { 2023-08-01T19:54:24.431 INFO:teuthology.orchestra.run.smithi101.stdout: "event": "initiated", 2023-08-01T19:54:24.431 INFO:teuthology.orchestra.run.smithi101.stdout: "time": "2023-08-01T19:54:24.414552+0000", 2023-08-01T19:54:24.431 INFO:teuthology.orchestra.run.smithi101.stdout: "duration": 0 2023-08-01T19:54:24.431 INFO:teuthology.orchestra.run.smithi101.stdout: }, 2023-08-01T19:54:24.431 INFO:teuthology.orchestra.run.smithi101.stdout: { 2023-08-01T19:54:24.431 INFO:teuthology.orchestra.run.smithi101.stdout: "event": "throttled", 2023-08-01T19:54:24.431 INFO:teuthology.orchestra.run.smithi101.stdout: "time": "2023-08-01T19:54:24.414552+0000", 2023-08-01T19:54:24.432 INFO:teuthology.orchestra.run.smithi101.stdout: "duration": 0 2023-08-01T19:54:24.432 INFO:teuthology.orchestra.run.smithi101.stdout: }, 2023-08-01T19:54:24.432 INFO:teuthology.orchestra.run.smithi101.stdout: { 2023-08-01T19:54:24.432 INFO:teuthology.orchestra.run.smithi101.stdout: "event": "header_read", 2023-08-01T19:54:24.432 INFO:teuthology.orchestra.run.smithi101.stdout: "time": "2023-08-01T19:54:24.414551+0000", 2023-08-01T19:54:24.432 INFO:teuthology.orchestra.run.smithi101.stdout: "duration": 4294967295.999999 2023-08-01T19:54:24.432 INFO:teuthology.orchestra.run.smithi101.stdout: }, 2023-08-01T19:54:24.433 INFO:teuthology.orchestra.run.smithi101.stdout: { 2023-08-01T19:54:24.433 INFO:teuthology.orchestra.run.smithi101.stdout: "event": "all_read", 2023-08-01T19:54:24.433 INFO:teuthology.orchestra.run.smithi101.stdout: "time": "2023-08-01T19:54:24.414668+0000", 2023-08-01T19:54:24.433 INFO:teuthology.orchestra.run.smithi101.stdout: "duration": 0.000116202 2023-08-01T19:54:24.433 INFO:teuthology.orchestra.run.smithi101.stdout: }, 2023-08-01T19:54:24.433 INFO:teuthology.orchestra.run.smithi101.stdout: { 2023-08-01T19:54:24.433 INFO:teuthology.orchestra.run.smithi101.stdout: "event": "dispatched", 2023-08-01T19:54:24.434 INFO:teuthology.orchestra.run.smithi101.stdout: "time": "2023-08-01T19:54:24.414686+0000", 2023-08-01T19:54:24.434 INFO:teuthology.orchestra.run.smithi101.stdout: "duration": 1.8244999999999999e-05 2023-08-01T19:54:24.434 INFO:teuthology.orchestra.run.smithi101.stdout: }, 2023-08-01T19:54:24.434 INFO:teuthology.orchestra.run.smithi101.stdout: { 2023-08-01T19:54:24.434 INFO:teuthology.orchestra.run.smithi101.stdout: "event": "queued_for_pg", 2023-08-01T19:54:24.434 INFO:teuthology.orchestra.run.smithi101.stdout: "time": "2023-08-01T19:54:24.414692+0000", 2023-08-01T19:54:24.434 INFO:teuthology.orchestra.run.smithi101.stdout: "duration": 5.8030000000000002e-06 2023-08-01T19:54:24.435 INFO:teuthology.orchestra.run.smithi101.stdout: }, 2023-08-01T19:54:24.435 INFO:teuthology.orchestra.run.smithi101.stdout: { 2023-08-01T19:54:24.435 INFO:teuthology.orchestra.run.smithi101.stdout: "event": "reached_pg", 2023-08-01T19:54:24.435 INFO:teuthology.orchestra.run.smithi101.stdout: "time": "2023-08-01T19:54:24.414723+0000", 2023-08-01T19:54:24.435 INFO:teuthology.orchestra.run.smithi101.stdout: "duration": 3.1106999999999999e-05 2023-08-01T19:54:24.435 INFO:teuthology.orchestra.run.smithi101.stdout: }, 2023-08-01T19:54:24.435 INFO:teuthology.orchestra.run.smithi101.stdout: { 2023-08-01T19:54:24.436 INFO:teuthology.orchestra.run.smithi101.stdout: "event": "started", 2023-08-01T19:54:24.436 INFO:teuthology.orchestra.run.smithi101.stdout: "time": "2023-08-01T19:54:24.414824+0000", 2023-08-01T19:54:24.436 INFO:teuthology.orchestra.run.smithi101.stdout: "duration": 0.000101642 2023-08-01T19:54:24.436 INFO:teuthology.orchestra.run.smithi101.stdout: }, 2023-08-01T19:54:24.436 INFO:teuthology.orchestra.run.smithi101.stdout: { 2023-08-01T19:54:24.436 INFO:teuthology.orchestra.run.smithi101.stdout: "event": "waiting for subops from 2", 2023-08-01T19:54:24.436 INFO:teuthology.orchestra.run.smithi101.stdout: "time": "2023-08-01T19:54:24.414952+0000", 2023-08-01T19:54:24.437 INFO:teuthology.orchestra.run.smithi101.stdout: "duration": 0.00012803700000000001 2023-08-01T19:54:24.437 INFO:teuthology.orchestra.run.smithi101.stdout: } 2023-08-01T19:54:24.437 INFO:teuthology.orchestra.run.smithi101.stdout: ] 2023-08-01T19:54:24.437 INFO:teuthology.orchestra.run.smithi101.stdout: } 2023-08-01T19:54:24.437 INFO:teuthology.orchestra.run.smithi101.stdout: }, 2023-08-01T19:54:24.437 INFO:teuthology.orchestra.run.smithi101.stdout: { 2023-08-01T19:54:24.437 INFO:teuthology.orchestra.run.smithi101.stdout: "description": "osd_repop(client.4668.0:442 5.d e21/19 5:bf0993b7:::benchmark_data_smithi006_114134_object441:head v 21'30, mlcod=21'26)", 2023-08-01T19:54:24.438 INFO:teuthology.orchestra.run.smithi101.stdout: "initiated_at": "2023-08-01T19:54:24.415254+0000", 2023-08-01T19:54:24.438 INFO:teuthology.orchestra.run.smithi101.stdout: "age": 0.00093430800000000001, 2023-08-01T19:54:24.438 INFO:teuthology.orchestra.run.smithi101.stdout: "duration": 0.001106936, 2023-08-01T19:54:24.438 INFO:teuthology.orchestra.run.smithi101.stdout: "type_data": { 2023-08-01T19:54:24.438 INFO:teuthology.orchestra.run.smithi101.stdout: "flag_point": "started", 2023-08-01T19:54:24.438 INFO:teuthology.orchestra.run.smithi101.stdout: "events": [ 2023-08-01T19:54:24.439 INFO:teuthology.orchestra.run.smithi101.stdout: { 2023-08-01T19:54:24.439 INFO:teuthology.orchestra.run.smithi101.stdout: "event": "initiated", 2023-08-01T19:54:24.439 INFO:teuthology.orchestra.run.smithi101.stdout: "time": "2023-08-01T19:54:24.415254+0000", 2023-08-01T19:54:24.439 INFO:teuthology.orchestra.run.smithi101.stdout: "duration": 0 2023-08-01T19:54:24.439 INFO:teuthology.orchestra.run.smithi101.stdout: }, 2023-08-01T19:54:24.439 INFO:teuthology.orchestra.run.smithi101.stdout: { 2023-08-01T19:54:24.439 INFO:teuthology.orchestra.run.smithi101.stdout: "event": "throttled", 2023-08-01T19:54:24.440 INFO:teuthology.orchestra.run.smithi101.stdout: "time": "2023-08-01T19:54:24.415254+0000", 2023-08-01T19:54:24.440 INFO:teuthology.orchestra.run.smithi101.stdout: "duration": 0 2023-08-01T19:54:24.440 INFO:teuthology.orchestra.run.smithi101.stdout: }, 2023-08-01T19:54:24.440 INFO:teuthology.orchestra.run.smithi101.stdout: { 2023-08-01T19:54:24.440 INFO:teuthology.orchestra.run.smithi101.stdout: "event": "header_read", 2023-08-01T19:54:24.440 INFO:teuthology.orchestra.run.smithi101.stdout: "time": "2023-08-01T19:54:24.415254+0000", 2023-08-01T19:54:24.441 INFO:teuthology.orchestra.run.smithi101.stdout: "duration": 4294967296 2023-08-01T19:54:24.441 INFO:teuthology.orchestra.run.smithi101.stdout: }, 2023-08-01T19:54:24.441 INFO:teuthology.orchestra.run.smithi101.stdout: { 2023-08-01T19:54:24.441 INFO:teuthology.orchestra.run.smithi101.stdout: "event": "all_read", 2023-08-01T19:54:24.441 INFO:teuthology.orchestra.run.smithi101.stdout: "time": "2023-08-01T19:54:24.415326+0000", 2023-08-01T19:54:24.441 INFO:teuthology.orchestra.run.smithi101.stdout: "duration": 7.2193999999999994e-05 2023-08-01T19:54:24.442 INFO:teuthology.orchestra.run.smithi101.stdout: }, 2023-08-01T19:54:24.442 INFO:teuthology.orchestra.run.smithi101.stdout: { 2023-08-01T19:54:24.442 INFO:teuthology.orchestra.run.smithi101.stdout: "event": "dispatched", 2023-08-01T19:54:24.442 INFO:teuthology.orchestra.run.smithi101.stdout: "time": "2023-08-01T19:54:24.415351+0000", 2023-08-01T19:54:24.442 INFO:teuthology.orchestra.run.smithi101.stdout: "duration": 2.4335e-05 2023-08-01T19:54:24.442 INFO:teuthology.orchestra.run.smithi101.stdout: }, 2023-08-01T19:54:24.442 INFO:teuthology.orchestra.run.smithi101.stdout: { 2023-08-01T19:54:24.443 INFO:teuthology.orchestra.run.smithi101.stdout: "event": "queued_for_pg", 2023-08-01T19:54:24.443 INFO:teuthology.orchestra.run.smithi101.stdout: "time": "2023-08-01T19:54:24.415356+0000", 2023-08-01T19:54:24.443 INFO:teuthology.orchestra.run.smithi101.stdout: "duration": 5.1580000000000004e-06 2023-08-01T19:54:24.443 INFO:teuthology.orchestra.run.smithi101.stdout: }, 2023-08-01T19:54:24.443 INFO:teuthology.orchestra.run.smithi101.stdout: { 2023-08-01T19:54:24.443 INFO:teuthology.orchestra.run.smithi101.stdout: "event": "reached_pg", 2023-08-01T19:54:24.443 INFO:teuthology.orchestra.run.smithi101.stdout: "time": "2023-08-01T19:54:24.415384+0000", 2023-08-01T19:54:24.443 INFO:teuthology.orchestra.run.smithi101.stdout: "duration": 2.7668e-05 2023-08-01T19:54:24.444 INFO:teuthology.orchestra.run.smithi101.stdout: }, 2023-08-01T19:54:24.444 INFO:teuthology.orchestra.run.smithi101.stdout: { 2023-08-01T19:54:24.444 INFO:teuthology.orchestra.run.smithi101.stdout: "event": "started", 2023-08-01T19:54:24.444 INFO:teuthology.orchestra.run.smithi101.stdout: "time": "2023-08-01T19:54:24.415397+0000", 2023-08-01T19:54:24.444 INFO:teuthology.orchestra.run.smithi101.stdout: "duration": 1.3433e-05 2023-08-01T19:54:24.445 INFO:teuthology.orchestra.run.smithi101.stdout: } 2023-08-01T19:54:24.445 INFO:teuthology.orchestra.run.smithi101.stdout: ] 2023-08-01T19:54:24.445 INFO:teuthology.orchestra.run.smithi101.stdout: } 2023-08-01T19:54:24.445 INFO:teuthology.orchestra.run.smithi101.stdout: }, 2023-08-01T19:54:24.445 INFO:teuthology.orchestra.run.smithi101.stdout: { 2023-08-01T19:54:24.445 INFO:teuthology.orchestra.run.smithi101.stdout: "description": "osd_op(client.4668.0:446 5.1 5:88bf79bf:::benchmark_data_smithi006_114134_object445:head [set-alloc-hint object_size 65536 write_size 65536,write 0~65536 in=65536b] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e21)", 2023-08-01T19:54:24.445 INFO:teuthology.orchestra.run.smithi101.stdout: "initiated_at": "2023-08-01T19:54:24.415513+0000", 2023-08-01T19:54:24.446 INFO:teuthology.orchestra.run.smithi101.stdout: "age": 0.00067566600000000001, 2023-08-01T19:54:24.446 INFO:teuthology.orchestra.run.smithi101.stdout: "duration": 0.00091312200000000004, 2023-08-01T19:54:24.446 INFO:teuthology.orchestra.run.smithi101.stdout: "type_data": { 2023-08-01T19:54:24.446 INFO:teuthology.orchestra.run.smithi101.stdout: "flag_point": "waiting for sub ops", 2023-08-01T19:54:24.446 INFO:teuthology.orchestra.run.smithi101.stdout: "client_info": { 2023-08-01T19:54:24.446 INFO:teuthology.orchestra.run.smithi101.stdout: "client": "client.4668", 2023-08-01T19:54:24.447 INFO:teuthology.orchestra.run.smithi101.stdout: "client_addr": "172.21.15.6:0/1709472247", 2023-08-01T19:54:24.447 INFO:teuthology.orchestra.run.smithi101.stdout: "tid": 446 2023-08-01T19:54:24.447 INFO:teuthology.orchestra.run.smithi101.stdout: }, 2023-08-01T19:54:24.447 INFO:teuthology.orchestra.run.smithi101.stdout: "events": [ 2023-08-01T19:54:24.447 INFO:teuthology.orchestra.run.smithi101.stdout: { 2023-08-01T19:54:24.447 INFO:teuthology.orchestra.run.smithi101.stdout: "event": "initiated", 2023-08-01T19:54:24.448 INFO:teuthology.orchestra.run.smithi101.stdout: "time": "2023-08-01T19:54:24.415513+0000", 2023-08-01T19:54:24.448 INFO:teuthology.orchestra.run.smithi101.stdout: "duration": 0 2023-08-01T19:54:24.448 INFO:teuthology.orchestra.run.smithi101.stdout: }, 2023-08-01T19:54:24.448 INFO:teuthology.orchestra.run.smithi101.stdout: { 2023-08-01T19:54:24.448 INFO:teuthology.orchestra.run.smithi101.stdout: "event": "throttled", 2023-08-01T19:54:24.448 INFO:teuthology.orchestra.run.smithi101.stdout: "time": "2023-08-01T19:54:24.415513+0000", 2023-08-01T19:54:24.448 INFO:teuthology.orchestra.run.smithi101.stdout: "duration": 0 2023-08-01T19:54:24.449 INFO:teuthology.orchestra.run.smithi101.stdout: }, 2023-08-01T19:54:24.449 INFO:teuthology.orchestra.run.smithi101.stdout: { 2023-08-01T19:54:24.449 INFO:teuthology.orchestra.run.smithi101.stdout: "event": "header_read", 2023-08-01T19:54:24.449 INFO:teuthology.orchestra.run.smithi101.stdout: "time": "2023-08-01T19:54:24.415512+0000", 2023-08-01T19:54:24.449 INFO:teuthology.orchestra.run.smithi101.stdout: "duration": 4294967295.999999 2023-08-01T19:54:24.450 INFO:teuthology.orchestra.run.smithi101.stdout: }, 2023-08-01T19:54:24.450 INFO:teuthology.orchestra.run.smithi101.stdout: { 2023-08-01T19:54:24.450 INFO:teuthology.orchestra.run.smithi101.stdout: "event": "all_read", 2023-08-01T19:54:24.450 INFO:teuthology.orchestra.run.smithi101.stdout: "time": "2023-08-01T19:54:24.415573+0000", 2023-08-01T19:54:24.450 INFO:teuthology.orchestra.run.smithi101.stdout: "duration": 6.0921999999999997e-05 2023-08-01T19:54:24.450 INFO:teuthology.orchestra.run.smithi101.stdout: }, 2023-08-01T19:54:24.450 INFO:teuthology.orchestra.run.smithi101.stdout: { 2023-08-01T19:54:24.451 INFO:teuthology.orchestra.run.smithi101.stdout: "event": "dispatched", 2023-08-01T19:54:24.451 INFO:teuthology.orchestra.run.smithi101.stdout: "time": "2023-08-01T19:54:24.415584+0000", 2023-08-01T19:54:24.451 INFO:teuthology.orchestra.run.smithi101.stdout: "duration": 1.0438000000000001e-05 2023-08-01T19:54:24.451 INFO:teuthology.orchestra.run.smithi101.stdout: }, 2023-08-01T19:54:24.451 INFO:teuthology.orchestra.run.smithi101.stdout: { 2023-08-01T19:54:24.451 INFO:teuthology.orchestra.run.smithi101.stdout: "event": "queued_for_pg", 2023-08-01T19:54:24.451 INFO:teuthology.orchestra.run.smithi101.stdout: "time": "2023-08-01T19:54:24.415589+0000", 2023-08-01T19:54:24.452 INFO:teuthology.orchestra.run.smithi101.stdout: "duration": 5.8109999999999999e-06 2023-08-01T19:54:24.452 INFO:teuthology.orchestra.run.smithi101.stdout: }, 2023-08-01T19:54:24.452 INFO:teuthology.orchestra.run.smithi101.stdout: { 2023-08-01T19:54:24.452 INFO:teuthology.orchestra.run.smithi101.stdout: "event": "reached_pg", 2023-08-01T19:54:24.453 INFO:teuthology.orchestra.run.smithi101.stdout: "time": "2023-08-01T19:54:24.415620+0000", 2023-08-01T19:54:24.453 INFO:teuthology.orchestra.run.smithi101.stdout: "duration": 3.0307e-05 2023-08-01T19:54:24.453 INFO:teuthology.orchestra.run.smithi101.stdout: }, 2023-08-01T19:54:24.453 INFO:teuthology.orchestra.run.smithi101.stdout: { 2023-08-01T19:54:24.453 INFO:teuthology.orchestra.run.smithi101.stdout: "event": "started", 2023-08-01T19:54:24.453 INFO:teuthology.orchestra.run.smithi101.stdout: "time": "2023-08-01T19:54:24.415723+0000", 2023-08-01T19:54:24.453 INFO:teuthology.orchestra.run.smithi101.stdout: "duration": 0.00010386 2023-08-01T19:54:24.453 INFO:teuthology.orchestra.run.smithi101.stdout: }, 2023-08-01T19:54:24.454 INFO:teuthology.orchestra.run.smithi101.stdout: { 2023-08-01T19:54:24.454 INFO:teuthology.orchestra.run.smithi101.stdout: "event": "waiting for subops from 0", 2023-08-01T19:54:24.454 INFO:teuthology.orchestra.run.smithi101.stdout: "time": "2023-08-01T19:54:24.415800+0000", 2023-08-01T19:54:24.454 INFO:teuthology.orchestra.run.smithi101.stdout: "duration": 7.6216000000000003e-05 2023-08-01T19:54:24.454 INFO:teuthology.orchestra.run.smithi101.stdout: } 2023-08-01T19:54:24.454 INFO:teuthology.orchestra.run.smithi101.stdout: ] 2023-08-01T19:54:24.454 INFO:teuthology.orchestra.run.smithi101.stdout: } 2023-08-01T19:54:24.455 INFO:teuthology.orchestra.run.smithi101.stdout: }, 2023-08-01T19:54:24.455 INFO:teuthology.orchestra.run.smithi101.stdout: { 2023-08-01T19:54:24.455 INFO:teuthology.orchestra.run.smithi101.stdout: "description": "osd_op(client.4668.0:447 5.1 5:8317c0e7:::benchmark_data_smithi006_114134_object446:head [set-alloc-hint object_size 65536 write_size 65536,write 0~65536 in=65536b] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e21)", 2023-08-01T19:54:24.455 INFO:teuthology.orchestra.run.smithi101.stdout: "initiated_at": "2023-08-01T19:54:24.415599+0000", 2023-08-01T19:54:24.455 INFO:teuthology.orchestra.run.smithi101.stdout: "age": 0.00058984900000000004, 2023-08-01T19:54:24.455 INFO:teuthology.orchestra.run.smithi101.stdout: "duration": 0.00091908400000000003, 2023-08-01T19:54:24.455 INFO:teuthology.orchestra.run.smithi101.stdout: "type_data": { 2023-08-01T19:54:24.456 INFO:teuthology.orchestra.run.smithi101.stdout: "flag_point": "waiting for sub ops", 2023-08-01T19:54:24.456 INFO:teuthology.orchestra.run.smithi101.stdout: "client_info": { 2023-08-01T19:54:24.456 INFO:teuthology.orchestra.run.smithi101.stdout: "client": "client.4668", 2023-08-01T19:54:24.456 INFO:teuthology.orchestra.run.smithi101.stdout: "client_addr": "172.21.15.6:0/1709472247", 2023-08-01T19:54:24.456 INFO:teuthology.orchestra.run.smithi101.stdout: "tid": 447 2023-08-01T19:54:24.456 INFO:teuthology.orchestra.run.smithi101.stdout: }, 2023-08-01T19:54:24.456 INFO:teuthology.orchestra.run.smithi101.stdout: "events": [ 2023-08-01T19:54:24.456 INFO:teuthology.orchestra.run.smithi101.stdout: { 2023-08-01T19:54:24.457 INFO:teuthology.orchestra.run.smithi101.stdout: "event": "initiated", 2023-08-01T19:54:24.457 INFO:teuthology.orchestra.run.smithi101.stdout: "time": "2023-08-01T19:54:24.415599+0000", 2023-08-01T19:54:24.457 INFO:teuthology.orchestra.run.smithi101.stdout: "duration": 0 2023-08-01T19:54:24.457 INFO:teuthology.orchestra.run.smithi101.stdout: }, 2023-08-01T19:54:24.457 INFO:teuthology.orchestra.run.smithi101.stdout: { 2023-08-01T19:54:24.457 INFO:teuthology.orchestra.run.smithi101.stdout: "event": "throttled", 2023-08-01T19:54:24.457 INFO:teuthology.orchestra.run.smithi101.stdout: "time": "2023-08-01T19:54:24.415599+0000", 2023-08-01T19:54:24.458 INFO:teuthology.orchestra.run.smithi101.stdout: "duration": 0 2023-08-01T19:54:24.458 INFO:teuthology.orchestra.run.smithi101.stdout: }, 2023-08-01T19:54:24.458 INFO:teuthology.orchestra.run.smithi101.stdout: { 2023-08-01T19:54:24.458 INFO:teuthology.orchestra.run.smithi101.stdout: "event": "header_read", 2023-08-01T19:54:24.458 INFO:teuthology.orchestra.run.smithi101.stdout: "time": "2023-08-01T19:54:24.415598+0000", 2023-08-01T19:54:24.458 INFO:teuthology.orchestra.run.smithi101.stdout: "duration": 4294967295.9999995 2023-08-01T19:54:24.458 INFO:teuthology.orchestra.run.smithi101.stdout: }, 2023-08-01T19:54:24.458 INFO:teuthology.orchestra.run.smithi101.stdout: { 2023-08-01T19:54:24.459 INFO:teuthology.orchestra.run.smithi101.stdout: "event": "all_read", 2023-08-01T19:54:24.459 INFO:teuthology.orchestra.run.smithi101.stdout: "time": "2023-08-01T19:54:24.415628+0000", 2023-08-01T19:54:24.459 INFO:teuthology.orchestra.run.smithi101.stdout: "duration": 3.0105000000000001e-05 2023-08-01T19:54:24.459 INFO:teuthology.orchestra.run.smithi101.stdout: }, 2023-08-01T19:54:24.459 INFO:teuthology.orchestra.run.smithi101.stdout: { 2023-08-01T19:54:24.459 INFO:teuthology.orchestra.run.smithi101.stdout: "event": "dispatched", 2023-08-01T19:54:24.459 INFO:teuthology.orchestra.run.smithi101.stdout: "time": "2023-08-01T19:54:24.415636+0000", 2023-08-01T19:54:24.459 INFO:teuthology.orchestra.run.smithi101.stdout: "duration": 7.8229999999999995e-06 2023-08-01T19:54:24.460 INFO:teuthology.orchestra.run.smithi101.stdout: }, 2023-08-01T19:54:24.460 INFO:teuthology.orchestra.run.smithi101.stdout: { 2023-08-01T19:54:24.460 INFO:teuthology.orchestra.run.smithi101.stdout: "event": "queued_for_pg", 2023-08-01T19:54:24.460 INFO:teuthology.orchestra.run.smithi101.stdout: "time": "2023-08-01T19:54:24.415641+0000", 2023-08-01T19:54:24.460 INFO:teuthology.orchestra.run.smithi101.stdout: "duration": 4.7319999999999998e-06 2023-08-01T19:54:24.460 INFO:teuthology.orchestra.run.smithi101.stdout: }, 2023-08-01T19:54:24.460 INFO:teuthology.orchestra.run.smithi101.stdout: { 2023-08-01T19:54:24.460 INFO:teuthology.orchestra.run.smithi101.stdout: "event": "reached_pg", 2023-08-01T19:54:24.461 INFO:teuthology.orchestra.run.smithi101.stdout: "time": "2023-08-01T19:54:24.416072+0000", 2023-08-01T19:54:24.461 INFO:teuthology.orchestra.run.smithi101.stdout: "duration": 0.00043084599999999997 2023-08-01T19:54:24.461 INFO:teuthology.orchestra.run.smithi101.stdout: }, 2023-08-01T19:54:24.461 INFO:teuthology.orchestra.run.smithi101.stdout: { 2023-08-01T19:54:24.461 INFO:teuthology.orchestra.run.smithi101.stdout: "event": "started", 2023-08-01T19:54:24.461 INFO:teuthology.orchestra.run.smithi101.stdout: "time": "2023-08-01T19:54:24.416176+0000", 2023-08-01T19:54:24.461 INFO:teuthology.orchestra.run.smithi101.stdout: "duration": 0.00010411700000000001 2023-08-01T19:54:24.462 INFO:teuthology.orchestra.run.smithi101.stdout: }, 2023-08-01T19:54:24.462 INFO:teuthology.orchestra.run.smithi101.stdout: { 2023-08-01T19:54:24.462 INFO:teuthology.orchestra.run.smithi101.stdout: "event": "waiting for subops from 0", 2023-08-01T19:54:24.462 INFO:teuthology.orchestra.run.smithi101.stdout: "time": "2023-08-01T19:54:24.416315+0000", 2023-08-01T19:54:24.462 INFO:teuthology.orchestra.run.smithi101.stdout: "duration": 0.000138722 2023-08-01T19:54:24.462 INFO:teuthology.orchestra.run.smithi101.stdout: } 2023-08-01T19:54:24.462 INFO:teuthology.orchestra.run.smithi101.stdout: ] 2023-08-01T19:54:24.462 INFO:teuthology.orchestra.run.smithi101.stdout: } 2023-08-01T19:54:24.463 INFO:teuthology.orchestra.run.smithi101.stdout: }, 2023-08-01T19:54:24.463 INFO:teuthology.orchestra.run.smithi101.stdout: { 2023-08-01T19:54:24.463 INFO:teuthology.orchestra.run.smithi101.stdout: "description": "osd_op(client.4668.0:448 5.9 5:9c02cf41:::benchmark_data_smithi006_114134_object447:head [set-alloc-hint object_size 65536 write_size 65536,write 0~65536 in=65536b] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e21)", 2023-08-01T19:54:24.463 INFO:teuthology.orchestra.run.smithi101.stdout: "initiated_at": "2023-08-01T19:54:24.415666+0000", 2023-08-01T19:54:24.463 INFO:teuthology.orchestra.run.smithi101.stdout: "age": 0.00052286599999999998, 2023-08-01T19:54:24.463 INFO:teuthology.orchestra.run.smithi101.stdout: "duration": 0.00095064800000000001, 2023-08-01T19:54:24.463 INFO:teuthology.orchestra.run.smithi101.stdout: "type_data": { 2023-08-01T19:54:24.463 INFO:teuthology.orchestra.run.smithi101.stdout: "flag_point": "waiting for sub ops", 2023-08-01T19:54:24.464 INFO:teuthology.orchestra.run.smithi101.stdout: "client_info": { 2023-08-01T19:54:24.464 INFO:teuthology.orchestra.run.smithi101.stdout: "client": "client.4668", 2023-08-01T19:54:24.464 INFO:teuthology.orchestra.run.smithi101.stdout: "client_addr": "172.21.15.6:0/1709472247", 2023-08-01T19:54:24.464 INFO:teuthology.orchestra.run.smithi101.stdout: "tid": 448 2023-08-01T19:54:24.464 INFO:teuthology.orchestra.run.smithi101.stdout: }, 2023-08-01T19:54:24.464 INFO:teuthology.orchestra.run.smithi101.stdout: "events": [ 2023-08-01T19:54:24.464 INFO:teuthology.orchestra.run.smithi101.stdout: { 2023-08-01T19:54:24.464 INFO:teuthology.orchestra.run.smithi101.stdout: "event": "initiated", 2023-08-01T19:54:24.465 INFO:teuthology.orchestra.run.smithi101.stdout: "time": "2023-08-01T19:54:24.415666+0000", 2023-08-01T19:54:24.465 INFO:teuthology.orchestra.run.smithi101.stdout: "duration": 0 2023-08-01T19:54:24.465 INFO:teuthology.orchestra.run.smithi101.stdout: }, 2023-08-01T19:54:24.465 INFO:teuthology.orchestra.run.smithi101.stdout: { 2023-08-01T19:54:24.465 INFO:teuthology.orchestra.run.smithi101.stdout: "event": "throttled", 2023-08-01T19:54:24.465 INFO:teuthology.orchestra.run.smithi101.stdout: "time": "2023-08-01T19:54:24.415666+0000", 2023-08-01T19:54:24.465 INFO:teuthology.orchestra.run.smithi101.stdout: "duration": 0 2023-08-01T19:54:24.466 INFO:teuthology.orchestra.run.smithi101.stdout: }, 2023-08-01T19:54:24.466 INFO:teuthology.orchestra.run.smithi101.stdout: { 2023-08-01T19:54:24.466 INFO:teuthology.orchestra.run.smithi101.stdout: "event": "header_read", 2023-08-01T19:54:24.466 INFO:teuthology.orchestra.run.smithi101.stdout: "time": "2023-08-01T19:54:24.415665+0000", 2023-08-01T19:54:24.466 INFO:teuthology.orchestra.run.smithi101.stdout: "duration": 4294967295.9999995 2023-08-01T19:54:24.466 INFO:teuthology.orchestra.run.smithi101.stdout: }, 2023-08-01T19:54:24.466 INFO:teuthology.orchestra.run.smithi101.stdout: { 2023-08-01T19:54:24.466 INFO:teuthology.orchestra.run.smithi101.stdout: "event": "all_read", 2023-08-01T19:54:24.467 INFO:teuthology.orchestra.run.smithi101.stdout: "time": "2023-08-01T19:54:24.415720+0000", 2023-08-01T19:54:24.467 INFO:teuthology.orchestra.run.smithi101.stdout: "duration": 5.4667999999999999e-05 2023-08-01T19:54:24.467 INFO:teuthology.orchestra.run.smithi101.stdout: }, 2023-08-01T19:54:24.467 INFO:teuthology.orchestra.run.smithi101.stdout: { 2023-08-01T19:54:24.467 INFO:teuthology.orchestra.run.smithi101.stdout: "event": "dispatched", 2023-08-01T19:54:24.467 INFO:teuthology.orchestra.run.smithi101.stdout: "time": "2023-08-01T19:54:24.415729+0000", 2023-08-01T19:54:24.467 INFO:teuthology.orchestra.run.smithi101.stdout: "duration": 8.8440000000000004e-06 2023-08-01T19:54:24.467 INFO:teuthology.orchestra.run.smithi101.stdout: }, 2023-08-01T19:54:24.468 INFO:teuthology.orchestra.run.smithi101.stdout: { 2023-08-01T19:54:24.468 INFO:teuthology.orchestra.run.smithi101.stdout: "event": "queued_for_pg", 2023-08-01T19:54:24.468 INFO:teuthology.orchestra.run.smithi101.stdout: "time": "2023-08-01T19:54:24.415734+0000", 2023-08-01T19:54:24.468 INFO:teuthology.orchestra.run.smithi101.stdout: "duration": 5.378e-06 2023-08-01T19:54:24.468 INFO:teuthology.orchestra.run.smithi101.stdout: }, 2023-08-01T19:54:24.468 INFO:teuthology.orchestra.run.smithi101.stdout: { 2023-08-01T19:54:24.468 INFO:teuthology.orchestra.run.smithi101.stdout: "event": "reached_pg", 2023-08-01T19:54:24.468 INFO:teuthology.orchestra.run.smithi101.stdout: "time": "2023-08-01T19:54:24.416064+0000", 2023-08-01T19:54:24.469 INFO:teuthology.orchestra.run.smithi101.stdout: "duration": 0.00032968199999999998 2023-08-01T19:54:24.469 INFO:teuthology.orchestra.run.smithi101.stdout: }, 2023-08-01T19:54:24.469 INFO:teuthology.orchestra.run.smithi101.stdout: { 2023-08-01T19:54:24.469 INFO:teuthology.orchestra.run.smithi101.stdout: "event": "started", 2023-08-01T19:54:24.469 INFO:teuthology.orchestra.run.smithi101.stdout: "time": "2023-08-01T19:54:24.416165+0000", 2023-08-01T19:54:24.469 INFO:teuthology.orchestra.run.smithi101.stdout: "duration": 0.000101556 2023-08-01T19:54:24.469 INFO:teuthology.orchestra.run.smithi101.stdout: }, 2023-08-01T19:54:24.470 INFO:teuthology.orchestra.run.smithi101.stdout: { 2023-08-01T19:54:24.470 INFO:teuthology.orchestra.run.smithi101.stdout: "event": "waiting for subops from 2", 2023-08-01T19:54:24.470 INFO:teuthology.orchestra.run.smithi101.stdout: "time": "2023-08-01T19:54:24.416288+0000", 2023-08-01T19:54:24.470 INFO:teuthology.orchestra.run.smithi101.stdout: "duration": 0.00012214999999999999 2023-08-01T19:54:24.470 INFO:teuthology.orchestra.run.smithi101.stdout: } 2023-08-01T19:54:24.470 INFO:teuthology.orchestra.run.smithi101.stdout: ] 2023-08-01T19:54:24.470 INFO:teuthology.orchestra.run.smithi101.stdout: } 2023-08-01T19:54:24.470 INFO:teuthology.orchestra.run.smithi101.stdout: }, 2023-08-01T19:54:24.471 INFO:teuthology.orchestra.run.smithi101.stdout: { 2023-08-01T19:54:24.471 INFO:teuthology.orchestra.run.smithi101.stdout: "description": "osd_repop(client.4668.0:444 5.c e21/19 5:3e42c12c:::benchmark_data_smithi006_114134_object443:head v 21'26, mlcod=21'23)", 2023-08-01T19:54:24.471 INFO:teuthology.orchestra.run.smithi101.stdout: "initiated_at": "2023-08-01T19:54:24.415871+0000", 2023-08-01T19:54:24.471 INFO:teuthology.orchestra.run.smithi101.stdout: "age": 0.000317891, 2023-08-01T19:54:24.471 INFO:teuthology.orchestra.run.smithi101.stdout: "duration": 0.00084334999999999998, 2023-08-01T19:54:24.471 INFO:teuthology.orchestra.run.smithi101.stdout: "type_data": { 2023-08-01T19:54:24.471 INFO:teuthology.orchestra.run.smithi101.stdout: "flag_point": "started", 2023-08-01T19:54:24.471 INFO:teuthology.orchestra.run.smithi101.stdout: "events": [ 2023-08-01T19:54:24.472 INFO:teuthology.orchestra.run.smithi101.stdout: { 2023-08-01T19:54:24.472 INFO:teuthology.orchestra.run.smithi101.stdout: "event": "initiated", 2023-08-01T19:54:24.472 INFO:teuthology.orchestra.run.smithi101.stdout: "time": "2023-08-01T19:54:24.415871+0000", 2023-08-01T19:54:24.472 INFO:teuthology.orchestra.run.smithi101.stdout: "duration": 0 2023-08-01T19:54:24.472 INFO:teuthology.orchestra.run.smithi101.stdout: }, 2023-08-01T19:54:24.472 INFO:teuthology.orchestra.run.smithi101.stdout: { 2023-08-01T19:54:24.472 INFO:teuthology.orchestra.run.smithi101.stdout: "event": "throttled", 2023-08-01T19:54:24.473 INFO:teuthology.orchestra.run.smithi101.stdout: "time": "2023-08-01T19:54:24.415871+0000", 2023-08-01T19:54:24.473 INFO:teuthology.orchestra.run.smithi101.stdout: "duration": 0 2023-08-01T19:54:24.473 INFO:teuthology.orchestra.run.smithi101.stdout: }, 2023-08-01T19:54:24.473 INFO:teuthology.orchestra.run.smithi101.stdout: { 2023-08-01T19:54:24.473 INFO:teuthology.orchestra.run.smithi101.stdout: "event": "header_read", 2023-08-01T19:54:24.473 INFO:teuthology.orchestra.run.smithi101.stdout: "time": "2023-08-01T19:54:24.415870+0000", 2023-08-01T19:54:24.473 INFO:teuthology.orchestra.run.smithi101.stdout: "duration": 4294967295.9999995 2023-08-01T19:54:24.473 INFO:teuthology.orchestra.run.smithi101.stdout: }, 2023-08-01T19:54:24.474 INFO:teuthology.orchestra.run.smithi101.stdout: { 2023-08-01T19:54:24.474 INFO:teuthology.orchestra.run.smithi101.stdout: "event": "all_read", 2023-08-01T19:54:24.474 INFO:teuthology.orchestra.run.smithi101.stdout: "time": "2023-08-01T19:54:24.415989+0000", 2023-08-01T19:54:24.474 INFO:teuthology.orchestra.run.smithi101.stdout: "duration": 0.00011862900000000001 2023-08-01T19:54:24.474 INFO:teuthology.orchestra.run.smithi101.stdout: }, 2023-08-01T19:54:24.474 INFO:teuthology.orchestra.run.smithi101.stdout: { 2023-08-01T19:54:24.474 INFO:teuthology.orchestra.run.smithi101.stdout: "event": "dispatched", 2023-08-01T19:54:24.474 INFO:teuthology.orchestra.run.smithi101.stdout: "time": "2023-08-01T19:54:24.416003+0000", 2023-08-01T19:54:24.475 INFO:teuthology.orchestra.run.smithi101.stdout: "duration": 1.3695e-05 2023-08-01T19:54:24.475 INFO:teuthology.orchestra.run.smithi101.stdout: }, 2023-08-01T19:54:24.475 INFO:teuthology.orchestra.run.smithi101.stdout: { 2023-08-01T19:54:24.475 INFO:teuthology.orchestra.run.smithi101.stdout: "event": "queued_for_pg", 2023-08-01T19:54:24.475 INFO:teuthology.orchestra.run.smithi101.stdout: "time": "2023-08-01T19:54:24.416008+0000", 2023-08-01T19:54:24.475 INFO:teuthology.orchestra.run.smithi101.stdout: "duration": 5.2440000000000001e-06 2023-08-01T19:54:24.475 INFO:teuthology.orchestra.run.smithi101.stdout: }, 2023-08-01T19:54:24.475 INFO:teuthology.orchestra.run.smithi101.stdout: { 2023-08-01T19:54:24.476 INFO:teuthology.orchestra.run.smithi101.stdout: "event": "reached_pg", 2023-08-01T19:54:24.476 INFO:teuthology.orchestra.run.smithi101.stdout: "time": "2023-08-01T19:54:24.416037+0000", 2023-08-01T19:54:24.476 INFO:teuthology.orchestra.run.smithi101.stdout: "duration": 2.9008000000000001e-05 2023-08-01T19:54:24.476 INFO:teuthology.orchestra.run.smithi101.stdout: }, 2023-08-01T19:54:24.476 INFO:teuthology.orchestra.run.smithi101.stdout: { 2023-08-01T19:54:24.476 INFO:teuthology.orchestra.run.smithi101.stdout: "event": "started", 2023-08-01T19:54:24.476 INFO:teuthology.orchestra.run.smithi101.stdout: "time": "2023-08-01T19:54:24.416048+0000", 2023-08-01T19:54:24.477 INFO:teuthology.orchestra.run.smithi101.stdout: "duration": 1.0669999999999999e-05 2023-08-01T19:54:24.477 INFO:teuthology.orchestra.run.smithi101.stdout: } 2023-08-01T19:54:24.477 INFO:teuthology.orchestra.run.smithi101.stdout: ] 2023-08-01T19:54:24.477 INFO:teuthology.orchestra.run.smithi101.stdout: } 2023-08-01T19:54:24.477 INFO:teuthology.orchestra.run.smithi101.stdout: }, 2023-08-01T19:54:24.477 INFO:teuthology.orchestra.run.smithi101.stdout: { 2023-08-01T19:54:24.477 INFO:teuthology.orchestra.run.smithi101.stdout: "description": "osd_repop(client.4668.0:445 5.5 e21/19 5:a5c48c73:::benchmark_data_smithi006_114134_object444:head v 21'30, mlcod=21'28)", 2023-08-01T19:54:24.477 INFO:teuthology.orchestra.run.smithi101.stdout: "initiated_at": "2023-08-01T19:54:24.416017+0000", 2023-08-01T19:54:24.478 INFO:teuthology.orchestra.run.smithi101.stdout: "age": 0.00017176800000000001, 2023-08-01T19:54:24.478 INFO:teuthology.orchestra.run.smithi101.stdout: "duration": 0.000764466, 2023-08-01T19:54:24.478 INFO:teuthology.orchestra.run.smithi101.stdout: "type_data": { 2023-08-01T19:54:24.478 INFO:teuthology.orchestra.run.smithi101.stdout: "flag_point": "started", 2023-08-01T19:54:24.478 INFO:teuthology.orchestra.run.smithi101.stdout: "events": [ 2023-08-01T19:54:24.478 INFO:teuthology.orchestra.run.smithi101.stdout: { 2023-08-01T19:54:24.478 INFO:teuthology.orchestra.run.smithi101.stdout: "event": "initiated", 2023-08-01T19:54:24.478 INFO:teuthology.orchestra.run.smithi101.stdout: "time": "2023-08-01T19:54:24.416017+0000", 2023-08-01T19:54:24.479 INFO:teuthology.orchestra.run.smithi101.stdout: "duration": 0 2023-08-01T19:54:24.479 INFO:teuthology.orchestra.run.smithi101.stdout: }, 2023-08-01T19:54:24.479 INFO:teuthology.orchestra.run.smithi101.stdout: { 2023-08-01T19:54:24.479 INFO:teuthology.orchestra.run.smithi101.stdout: "event": "throttled", 2023-08-01T19:54:24.479 INFO:teuthology.orchestra.run.smithi101.stdout: "time": "2023-08-01T19:54:24.416017+0000", 2023-08-01T19:54:24.479 INFO:teuthology.orchestra.run.smithi101.stdout: "duration": 0 2023-08-01T19:54:24.479 INFO:teuthology.orchestra.run.smithi101.stdout: }, 2023-08-01T19:54:24.480 INFO:teuthology.orchestra.run.smithi101.stdout: { 2023-08-01T19:54:24.480 INFO:teuthology.orchestra.run.smithi101.stdout: "event": "header_read", 2023-08-01T19:54:24.480 INFO:teuthology.orchestra.run.smithi101.stdout: "time": "2023-08-01T19:54:24.416017+0000", 2023-08-01T19:54:24.480 INFO:teuthology.orchestra.run.smithi101.stdout: "duration": 4294967295.9999995 2023-08-01T19:54:24.480 INFO:teuthology.orchestra.run.smithi101.stdout: }, 2023-08-01T19:54:24.480 INFO:teuthology.orchestra.run.smithi101.stdout: { 2023-08-01T19:54:24.480 INFO:teuthology.orchestra.run.smithi101.stdout: "event": "all_read", 2023-08-01T19:54:24.480 INFO:teuthology.orchestra.run.smithi101.stdout: "time": "2023-08-01T19:54:24.416045+0000", 2023-08-01T19:54:24.481 INFO:teuthology.orchestra.run.smithi101.stdout: "duration": 2.7849000000000001e-05 2023-08-01T19:54:24.481 INFO:teuthology.orchestra.run.smithi101.stdout: }, 2023-08-01T19:54:24.481 INFO:teuthology.orchestra.run.smithi101.stdout: { 2023-08-01T19:54:24.481 INFO:teuthology.orchestra.run.smithi101.stdout: "event": "dispatched", 2023-08-01T19:54:24.481 INFO:teuthology.orchestra.run.smithi101.stdout: "time": "2023-08-01T19:54:24.416052+0000", 2023-08-01T19:54:24.481 INFO:teuthology.orchestra.run.smithi101.stdout: "duration": 7.892e-06 2023-08-01T19:54:24.481 INFO:teuthology.orchestra.run.smithi101.stdout: }, 2023-08-01T19:54:24.481 INFO:teuthology.orchestra.run.smithi101.stdout: { 2023-08-01T19:54:24.482 INFO:teuthology.orchestra.run.smithi101.stdout: "event": "queued_for_pg", 2023-08-01T19:54:24.482 INFO:teuthology.orchestra.run.smithi101.stdout: "time": "2023-08-01T19:54:24.416056+0000", 2023-08-01T19:54:24.482 INFO:teuthology.orchestra.run.smithi101.stdout: "duration": 3.8010000000000001e-06 2023-08-01T19:54:24.482 INFO:teuthology.orchestra.run.smithi101.stdout: }, 2023-08-01T19:54:24.482 INFO:teuthology.orchestra.run.smithi101.stdout: { 2023-08-01T19:54:24.482 INFO:teuthology.orchestra.run.smithi101.stdout: "event": "reached_pg", 2023-08-01T19:54:24.482 INFO:teuthology.orchestra.run.smithi101.stdout: "time": "2023-08-01T19:54:24.416091+0000", 2023-08-01T19:54:24.482 INFO:teuthology.orchestra.run.smithi101.stdout: "duration": 3.4391999999999999e-05 2023-08-01T19:54:24.483 INFO:teuthology.orchestra.run.smithi101.stdout: }, 2023-08-01T19:54:24.483 INFO:teuthology.orchestra.run.smithi101.stdout: { 2023-08-01T19:54:24.483 INFO:teuthology.orchestra.run.smithi101.stdout: "event": "started", 2023-08-01T19:54:24.483 INFO:teuthology.orchestra.run.smithi101.stdout: "time": "2023-08-01T19:54:24.416106+0000", 2023-08-01T19:54:24.483 INFO:teuthology.orchestra.run.smithi101.stdout: "duration": 1.5699999999999999e-05 2023-08-01T19:54:24.483 INFO:teuthology.orchestra.run.smithi101.stdout: } 2023-08-01T19:54:24.483 INFO:teuthology.orchestra.run.smithi101.stdout: ] 2023-08-01T19:54:24.484 INFO:teuthology.orchestra.run.smithi101.stdout: } 2023-08-01T19:54:24.484 INFO:teuthology.orchestra.run.smithi101.stdout: }, 2023-08-01T19:54:24.484 INFO:teuthology.orchestra.run.smithi101.stdout: { 2023-08-01T19:54:24.484 INFO:teuthology.orchestra.run.smithi101.stdout: "description": "osd_op(client.4668.0:451 5.7 5:eb2b2adb:::benchmark_data_smithi006_114134_object450:head [set-alloc-hint object_size 65536 write_size 65536,write 0~65536 in=65536b] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e21)", 2023-08-01T19:54:24.484 INFO:teuthology.orchestra.run.smithi101.stdout: "initiated_at": "2023-08-01T19:54:24.416360+0000", 2023-08-01T19:54:24.484 INFO:teuthology.orchestra.run.smithi101.stdout: "age": 4294967295.9998288, 2023-08-01T19:54:24.484 INFO:teuthology.orchestra.run.smithi101.stdout: "duration": 0.00049637200000000002, 2023-08-01T19:54:24.485 INFO:teuthology.orchestra.run.smithi101.stdout: "type_data": { 2023-08-01T19:54:24.485 INFO:teuthology.orchestra.run.smithi101.stdout: "flag_point": "waiting for sub ops", 2023-08-01T19:54:24.485 INFO:teuthology.orchestra.run.smithi101.stdout: "client_info": { 2023-08-01T19:54:24.485 INFO:teuthology.orchestra.run.smithi101.stdout: "client": "client.4668", 2023-08-01T19:54:24.485 INFO:teuthology.orchestra.run.smithi101.stdout: "client_addr": "172.21.15.6:0/1709472247", 2023-08-01T19:54:24.485 INFO:teuthology.orchestra.run.smithi101.stdout: "tid": 451 2023-08-01T19:54:24.485 INFO:teuthology.orchestra.run.smithi101.stdout: }, 2023-08-01T19:54:24.485 INFO:teuthology.orchestra.run.smithi101.stdout: "events": [ 2023-08-01T19:54:24.486 INFO:teuthology.orchestra.run.smithi101.stdout: { 2023-08-01T19:54:24.486 INFO:teuthology.orchestra.run.smithi101.stdout: "event": "initiated", 2023-08-01T19:54:24.486 INFO:teuthology.orchestra.run.smithi101.stdout: "time": "2023-08-01T19:54:24.416360+0000", 2023-08-01T19:54:24.486 INFO:teuthology.orchestra.run.smithi101.stdout: "duration": 0 2023-08-01T19:54:24.486 INFO:teuthology.orchestra.run.smithi101.stdout: }, 2023-08-01T19:54:24.486 INFO:teuthology.orchestra.run.smithi101.stdout: { 2023-08-01T19:54:24.486 INFO:teuthology.orchestra.run.smithi101.stdout: "event": "throttled", 2023-08-01T19:54:24.487 INFO:teuthology.orchestra.run.smithi101.stdout: "time": "2023-08-01T19:54:24.416360+0000", 2023-08-01T19:54:24.487 INFO:teuthology.orchestra.run.smithi101.stdout: "duration": 0 2023-08-01T19:54:24.487 INFO:teuthology.orchestra.run.smithi101.stdout: }, 2023-08-01T19:54:24.487 INFO:teuthology.orchestra.run.smithi101.stdout: { 2023-08-01T19:54:24.487 INFO:teuthology.orchestra.run.smithi101.stdout: "event": "header_read", 2023-08-01T19:54:24.487 INFO:teuthology.orchestra.run.smithi101.stdout: "time": "2023-08-01T19:54:24.416359+0000", 2023-08-01T19:54:24.487 INFO:teuthology.orchestra.run.smithi101.stdout: "duration": 4294967295.999999 2023-08-01T19:54:24.487 INFO:teuthology.orchestra.run.smithi101.stdout: }, 2023-08-01T19:54:24.488 INFO:teuthology.orchestra.run.smithi101.stdout: { 2023-08-01T19:54:24.488 INFO:teuthology.orchestra.run.smithi101.stdout: "event": "all_read", 2023-08-01T19:54:24.488 INFO:teuthology.orchestra.run.smithi101.stdout: "time": "2023-08-01T19:54:24.416385+0000", 2023-08-01T19:54:24.488 INFO:teuthology.orchestra.run.smithi101.stdout: "duration": 2.5967999999999999e-05 2023-08-01T19:54:24.488 INFO:teuthology.orchestra.run.smithi101.stdout: }, 2023-08-01T19:54:24.488 INFO:teuthology.orchestra.run.smithi101.stdout: { 2023-08-01T19:54:24.488 INFO:teuthology.orchestra.run.smithi101.stdout: "event": "dispatched", 2023-08-01T19:54:24.488 INFO:teuthology.orchestra.run.smithi101.stdout: "time": "2023-08-01T19:54:24.416392+0000", 2023-08-01T19:54:24.489 INFO:teuthology.orchestra.run.smithi101.stdout: "duration": 6.9920000000000001e-06 2023-08-01T19:54:24.489 INFO:teuthology.orchestra.run.smithi101.stdout: }, 2023-08-01T19:54:24.489 INFO:teuthology.orchestra.run.smithi101.stdout: { 2023-08-01T19:54:24.489 INFO:teuthology.orchestra.run.smithi101.stdout: "event": "queued_for_pg", 2023-08-01T19:54:24.489 INFO:teuthology.orchestra.run.smithi101.stdout: "time": "2023-08-01T19:54:24.416404+0000", 2023-08-01T19:54:24.489 INFO:teuthology.orchestra.run.smithi101.stdout: "duration": 1.1549000000000001e-05 2023-08-01T19:54:24.489 INFO:teuthology.orchestra.run.smithi101.stdout: }, 2023-08-01T19:54:24.490 INFO:teuthology.orchestra.run.smithi101.stdout: { 2023-08-01T19:54:24.490 INFO:teuthology.orchestra.run.smithi101.stdout: "event": "reached_pg", 2023-08-01T19:54:24.490 INFO:teuthology.orchestra.run.smithi101.stdout: "time": "2023-08-01T19:54:24.416529+0000", 2023-08-01T19:54:24.490 INFO:teuthology.orchestra.run.smithi101.stdout: "duration": 0.00012493500000000001 2023-08-01T19:54:24.490 INFO:teuthology.orchestra.run.smithi101.stdout: }, 2023-08-01T19:54:24.490 INFO:teuthology.orchestra.run.smithi101.stdout: { 2023-08-01T19:54:24.490 INFO:teuthology.orchestra.run.smithi101.stdout: "event": "started", 2023-08-01T19:54:24.490 INFO:teuthology.orchestra.run.smithi101.stdout: "time": "2023-08-01T19:54:24.416628+0000", 2023-08-01T19:54:24.491 INFO:teuthology.orchestra.run.smithi101.stdout: "duration": 9.9765000000000005e-05 2023-08-01T19:54:24.491 INFO:teuthology.orchestra.run.smithi101.stdout: }, 2023-08-01T19:54:24.491 INFO:teuthology.orchestra.run.smithi101.stdout: { 2023-08-01T19:54:24.491 INFO:teuthology.orchestra.run.smithi101.stdout: "event": "waiting for subops from 0", 2023-08-01T19:54:24.491 INFO:teuthology.orchestra.run.smithi101.stdout: "time": "2023-08-01T19:54:24.416745+0000", 2023-08-01T19:54:24.491 INFO:teuthology.orchestra.run.smithi101.stdout: "duration": 0.000116938 2023-08-01T19:54:24.491 INFO:teuthology.orchestra.run.smithi101.stdout: } 2023-08-01T19:54:24.491 INFO:teuthology.orchestra.run.smithi101.stdout: ] 2023-08-01T19:54:24.492 INFO:teuthology.orchestra.run.smithi101.stdout: } 2023-08-01T19:54:24.492 INFO:teuthology.orchestra.run.smithi101.stdout: }, 2023-08-01T19:54:24.492 INFO:teuthology.orchestra.run.smithi101.stdout: { 2023-08-01T19:54:24.492 INFO:teuthology.orchestra.run.smithi101.stdout: "description": "osd_repop(client.4668.0:450 5.5 e21/19 5:ab40c0c9:::benchmark_data_smithi006_114134_object449:head v 21'31, mlcod=21'28)", 2023-08-01T19:54:24.492 INFO:teuthology.orchestra.run.smithi101.stdout: "initiated_at": "2023-08-01T19:54:24.416567+0000", 2023-08-01T19:54:24.492 INFO:teuthology.orchestra.run.smithi101.stdout: "age": 4294967295.9996219, 2023-08-01T19:54:24.492 INFO:teuthology.orchestra.run.smithi101.stdout: "duration": 0.00037091899999999999, 2023-08-01T19:54:24.493 INFO:teuthology.orchestra.run.smithi101.stdout: "type_data": { 2023-08-01T19:54:24.493 INFO:teuthology.orchestra.run.smithi101.stdout: "flag_point": "started", 2023-08-01T19:54:24.493 INFO:teuthology.orchestra.run.smithi101.stdout: "events": [ 2023-08-01T19:54:24.493 INFO:teuthology.orchestra.run.smithi101.stdout: { 2023-08-01T19:54:24.493 INFO:teuthology.orchestra.run.smithi101.stdout: "event": "initiated", 2023-08-01T19:54:24.493 INFO:teuthology.orchestra.run.smithi101.stdout: "time": "2023-08-01T19:54:24.416567+0000", 2023-08-01T19:54:24.493 INFO:teuthology.orchestra.run.smithi101.stdout: "duration": 0 2023-08-01T19:54:24.493 INFO:teuthology.orchestra.run.smithi101.stdout: }, 2023-08-01T19:54:24.494 INFO:teuthology.orchestra.run.smithi101.stdout: { 2023-08-01T19:54:24.494 INFO:teuthology.orchestra.run.smithi101.stdout: "event": "throttled", 2023-08-01T19:54:24.494 INFO:teuthology.orchestra.run.smithi101.stdout: "time": "2023-08-01T19:54:24.416567+0000", 2023-08-01T19:54:24.494 INFO:teuthology.orchestra.run.smithi101.stdout: "duration": 0 2023-08-01T19:54:24.494 INFO:teuthology.orchestra.run.smithi101.stdout: }, 2023-08-01T19:54:24.494 INFO:teuthology.orchestra.run.smithi101.stdout: { 2023-08-01T19:54:24.494 INFO:teuthology.orchestra.run.smithi101.stdout: "event": "header_read", 2023-08-01T19:54:24.494 INFO:teuthology.orchestra.run.smithi101.stdout: "time": "2023-08-01T19:54:24.416566+0000", 2023-08-01T19:54:24.495 INFO:teuthology.orchestra.run.smithi101.stdout: "duration": 4294967295.9999995 2023-08-01T19:54:24.495 INFO:teuthology.orchestra.run.smithi101.stdout: }, 2023-08-01T19:54:24.495 INFO:teuthology.orchestra.run.smithi101.stdout: { 2023-08-01T19:54:24.495 INFO:teuthology.orchestra.run.smithi101.stdout: "event": "all_read", 2023-08-01T19:54:24.495 INFO:teuthology.orchestra.run.smithi101.stdout: "time": "2023-08-01T19:54:24.416627+0000", 2023-08-01T19:54:24.495 INFO:teuthology.orchestra.run.smithi101.stdout: "duration": 6.0788000000000001e-05 2023-08-01T19:54:24.495 INFO:teuthology.orchestra.run.smithi101.stdout: }, 2023-08-01T19:54:24.496 INFO:teuthology.orchestra.run.smithi101.stdout: { 2023-08-01T19:54:24.496 INFO:teuthology.orchestra.run.smithi101.stdout: "event": "dispatched", 2023-08-01T19:54:24.496 INFO:teuthology.orchestra.run.smithi101.stdout: "time": "2023-08-01T19:54:24.416634+0000", 2023-08-01T19:54:24.496 INFO:teuthology.orchestra.run.smithi101.stdout: "duration": 6.596e-06 2023-08-01T19:54:24.496 INFO:teuthology.orchestra.run.smithi101.stdout: }, 2023-08-01T19:54:24.496 INFO:teuthology.orchestra.run.smithi101.stdout: { 2023-08-01T19:54:24.496 INFO:teuthology.orchestra.run.smithi101.stdout: "event": "queued_for_pg", 2023-08-01T19:54:24.496 INFO:teuthology.orchestra.run.smithi101.stdout: "time": "2023-08-01T19:54:24.416638+0000", 2023-08-01T19:54:24.497 INFO:teuthology.orchestra.run.smithi101.stdout: "duration": 4.2760000000000002e-06 2023-08-01T19:54:24.497 INFO:teuthology.orchestra.run.smithi101.stdout: }, 2023-08-01T19:54:24.497 INFO:teuthology.orchestra.run.smithi101.stdout: { 2023-08-01T19:54:24.497 INFO:teuthology.orchestra.run.smithi101.stdout: "event": "reached_pg", 2023-08-01T19:54:24.497 INFO:teuthology.orchestra.run.smithi101.stdout: "time": "2023-08-01T19:54:24.416671+0000", 2023-08-01T19:54:24.497 INFO:teuthology.orchestra.run.smithi101.stdout: "duration": 3.2960000000000003e-05 2023-08-01T19:54:24.497 INFO:teuthology.orchestra.run.smithi101.stdout: }, 2023-08-01T19:54:24.497 INFO:teuthology.orchestra.run.smithi101.stdout: { 2023-08-01T19:54:24.498 INFO:teuthology.orchestra.run.smithi101.stdout: "event": "started", 2023-08-01T19:54:24.498 INFO:teuthology.orchestra.run.smithi101.stdout: "time": "2023-08-01T19:54:24.416688+0000", 2023-08-01T19:54:24.498 INFO:teuthology.orchestra.run.smithi101.stdout: "duration": 1.7368e-05 2023-08-01T19:54:24.498 INFO:teuthology.orchestra.run.smithi101.stdout: } 2023-08-01T19:54:24.498 INFO:teuthology.orchestra.run.smithi101.stdout: ] 2023-08-01T19:54:24.498 INFO:teuthology.orchestra.run.smithi101.stdout: } 2023-08-01T19:54:24.498 INFO:teuthology.orchestra.run.smithi101.stdout: } 2023-08-01T19:54:24.498 INFO:teuthology.orchestra.run.smithi101.stdout: ], 2023-08-01T19:54:24.499 INFO:teuthology.orchestra.run.smithi101.stdout: "num_ops": 10 2023-08-01T19:54:24.499 INFO:teuthology.orchestra.run.smithi101.stdout:} 2023-08-01T19:54:24.500 DEBUG:teuthology.orchestra.run.smithi101:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 30 ceph --cluster ceph --admin-daemon /var/run/ceph/ceph-osd.1.asok dump_blocked_ops 2023-08-01T19:54:24.501 INFO:tasks.ceph.osd.0.smithi008.stderr:2023-08-01T19:54:24.498+0000 7f16a58f4700 -1 received signal: Hangup from /usr/bin/python3 /bin/daemon-helper kill ceph-osd -f --cluster ceph -i 0 (PID: 111179) UID: 0 2023-08-01T19:54:24.601 INFO:tasks.ceph.osd.0.smithi008.stderr:2023-08-01T19:54:24.599+0000 7f16a58f4700 -1 received signal: Hangup from /usr/bin/python3 /bin/daemon-helper kill ceph-osd -f --cluster ceph -i 0 (PID: 111179) UID: 0 2023-08-01T19:54:24.674 INFO:teuthology.orchestra.run.smithi101.stdout:{ 2023-08-01T19:54:24.675 INFO:teuthology.orchestra.run.smithi101.stdout: "ops": [], 2023-08-01T19:54:24.675 INFO:teuthology.orchestra.run.smithi101.stdout: "complaint_time": 30, 2023-08-01T19:54:24.675 INFO:teuthology.orchestra.run.smithi101.stdout: "num_blocked_ops": 0 2023-08-01T19:54:24.675 INFO:teuthology.orchestra.run.smithi101.stdout:} 2023-08-01T19:54:24.686 DEBUG:teuthology.orchestra.run.smithi101:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 30 ceph --cluster ceph --admin-daemon /var/run/ceph/ceph-osd.1.asok dump_historic_ops 2023-08-01T19:54:24.729 INFO:tasks.ceph.osd.1.smithi101.stderr:2023-08-01T19:54:24.728+0000 7fb0cb7f6700 -1 received signal: Hangup from /usr/bin/python3 /bin/daemon-helper kill ceph-osd -f --cluster ceph -i 1 (PID: 111141) UID: 0 2023-08-01T19:54:24.802 INFO:tasks.ceph.osd.1.smithi101.stderr:2023-08-01T19:54:24.801+0000 7fb0cb7f6700 -1 received signal: Hangup from /usr/bin/python3 /bin/daemon-helper kill ceph-osd -f --cluster ceph -i 1 (PID: 111141) UID: 0 2023-08-01T19:54:24.859 INFO:teuthology.orchestra.run.smithi101.stdout:{ 2023-08-01T19:54:24.859 INFO:teuthology.orchestra.run.smithi101.stdout: "size": 20, 2023-08-01T19:54:24.859 INFO:teuthology.orchestra.run.smithi101.stdout: "duration": 600, 2023-08-01T19:54:24.860 INFO:teuthology.orchestra.run.smithi101.stdout: "ops": [ 2023-08-01T19:54:24.860 INFO:teuthology.orchestra.run.smithi101.stdout: { 2023-08-01T19:54:24.860 INFO:teuthology.orchestra.run.smithi101.stdout: "description": "osd_op(client.4159.0:207 1.0 1:1b0e96ae:devicehealth::main.db-journal.0000000000000000:head [write 131596~4] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e10)", 2023-08-01T19:54:24.860 INFO:teuthology.orchestra.run.smithi101.stdout: "initiated_at": "2023-08-01T19:53:52.527907+0000", 2023-08-01T19:54:24.860 INFO:teuthology.orchestra.run.smithi101.stdout: "age": 32.327673664000002, 2023-08-01T19:54:24.860 INFO:teuthology.orchestra.run.smithi101.stdout: "duration": 0.011422303, 2023-08-01T19:54:24.860 INFO:teuthology.orchestra.run.smithi101.stdout: "type_data": { 2023-08-01T19:54:24.861 INFO:teuthology.orchestra.run.smithi101.stdout: "flag_point": "commit sent; apply or cleanup", 2023-08-01T19:54:24.861 INFO:teuthology.orchestra.run.smithi101.stdout: "client_info": { 2023-08-01T19:54:24.861 INFO:teuthology.orchestra.run.smithi101.stdout: "client": "client.4159", 2023-08-01T19:54:24.861 INFO:teuthology.orchestra.run.smithi101.stdout: "client_addr": "172.21.15.6:0/2221671503", 2023-08-01T19:54:24.861 INFO:teuthology.orchestra.run.smithi101.stdout: "tid": 207 2023-08-01T19:54:24.861 INFO:teuthology.orchestra.run.smithi101.stdout: }, 2023-08-01T19:54:24.861 INFO:teuthology.orchestra.run.smithi101.stdout: "events": [ 2023-08-01T19:54:24.862 INFO:teuthology.orchestra.run.smithi101.stdout: { 2023-08-01T19:54:24.862 INFO:teuthology.orchestra.run.smithi101.stdout: "event": "initiated", 2023-08-01T19:54:24.862 INFO:teuthology.orchestra.run.smithi101.stdout: "time": "2023-08-01T19:53:52.527907+0000", 2023-08-01T19:54:24.862 INFO:teuthology.orchestra.run.smithi101.stdout: "duration": 0 2023-08-01T19:54:24.862 INFO:teuthology.orchestra.run.smithi101.stdout: }, 2023-08-01T19:54:24.862 INFO:teuthology.orchestra.run.smithi101.stdout: { 2023-08-01T19:54:24.862 INFO:teuthology.orchestra.run.smithi101.stdout: "event": "throttled", 2023-08-01T19:54:24.862 INFO:teuthology.orchestra.run.smithi101.stdout: "time": "2023-08-01T19:53:52.527907+0000", 2023-08-01T19:54:24.863 INFO:teuthology.orchestra.run.smithi101.stdout: "duration": 0 2023-08-01T19:54:24.863 INFO:teuthology.orchestra.run.smithi101.stdout: }, 2023-08-01T19:54:24.863 INFO:teuthology.orchestra.run.smithi101.stdout: { 2023-08-01T19:54:24.863 INFO:teuthology.orchestra.run.smithi101.stdout: "event": "header_read", 2023-08-01T19:54:24.863 INFO:teuthology.orchestra.run.smithi101.stdout: "time": "2023-08-01T19:53:52.527907+0000", 2023-08-01T19:54:24.863 INFO:teuthology.orchestra.run.smithi101.stdout: "duration": 4294967295.9999995 2023-08-01T19:54:24.863 INFO:teuthology.orchestra.run.smithi101.stdout: }, 2023-08-01T19:54:24.863 INFO:teuthology.orchestra.run.smithi101.stdout: { 2023-08-01T19:54:24.864 INFO:teuthology.orchestra.run.smithi101.stdout: "event": "all_read", 2023-08-01T19:54:24.864 INFO:teuthology.orchestra.run.smithi101.stdout: "time": "2023-08-01T19:53:52.527911+0000", 2023-08-01T19:54:24.864 INFO:teuthology.orchestra.run.smithi101.stdout: "duration": 3.7560000000000001e-06 2023-08-01T19:54:24.864 INFO:teuthology.orchestra.run.smithi101.stdout: }, 2023-08-01T19:54:24.864 INFO:teuthology.orchestra.run.smithi101.stdout: { 2023-08-01T19:54:24.864 INFO:teuthology.orchestra.run.smithi101.stdout: "event": "dispatched", 2023-08-01T19:54:24.864 INFO:teuthology.orchestra.run.smithi101.stdout: "time": "2023-08-01T19:53:52.527918+0000", 2023-08-01T19:54:24.865 INFO:teuthology.orchestra.run.smithi101.stdout: "duration": 7.6249999999999998e-06 2023-08-01T19:54:24.865 INFO:teuthology.orchestra.run.smithi101.stdout: }, 2023-08-01T19:54:24.865 INFO:teuthology.orchestra.run.smithi101.stdout: { 2023-08-01T19:54:24.865 INFO:teuthology.orchestra.run.smithi101.stdout: "event": "queued_for_pg", 2023-08-01T19:54:24.865 INFO:teuthology.orchestra.run.smithi101.stdout: "time": "2023-08-01T19:53:52.527922+0000", 2023-08-01T19:54:24.865 INFO:teuthology.orchestra.run.smithi101.stdout: "duration": 3.9029999999999997e-06 2023-08-01T19:54:24.865 INFO:teuthology.orchestra.run.smithi101.stdout: }, 2023-08-01T19:54:24.865 INFO:teuthology.orchestra.run.smithi101.stdout: { 2023-08-01T19:54:24.866 INFO:teuthology.orchestra.run.smithi101.stdout: "event": "reached_pg", 2023-08-01T19:54:24.866 INFO:teuthology.orchestra.run.smithi101.stdout: "time": "2023-08-01T19:53:52.533853+0000", 2023-08-01T19:54:24.866 INFO:teuthology.orchestra.run.smithi101.stdout: "duration": 0.005930439 2023-08-01T19:54:24.866 INFO:teuthology.orchestra.run.smithi101.stdout: }, 2023-08-01T19:54:24.866 INFO:teuthology.orchestra.run.smithi101.stdout: { 2023-08-01T19:54:24.866 INFO:teuthology.orchestra.run.smithi101.stdout: "event": "started", 2023-08-01T19:54:24.866 INFO:teuthology.orchestra.run.smithi101.stdout: "time": "2023-08-01T19:53:52.533898+0000", 2023-08-01T19:54:24.867 INFO:teuthology.orchestra.run.smithi101.stdout: "duration": 4.4802000000000002e-05 2023-08-01T19:54:24.867 INFO:teuthology.orchestra.run.smithi101.stdout: }, 2023-08-01T19:54:24.867 INFO:teuthology.orchestra.run.smithi101.stdout: { 2023-08-01T19:54:24.867 INFO:teuthology.orchestra.run.smithi101.stdout: "event": "waiting for subops from 2", 2023-08-01T19:54:24.867 INFO:teuthology.orchestra.run.smithi101.stdout: "time": "2023-08-01T19:53:52.533967+0000", 2023-08-01T19:54:24.867 INFO:teuthology.orchestra.run.smithi101.stdout: "duration": 6.9597000000000005e-05 2023-08-01T19:54:24.867 INFO:teuthology.orchestra.run.smithi101.stdout: }, 2023-08-01T19:54:24.867 INFO:teuthology.orchestra.run.smithi101.stdout: { 2023-08-01T19:54:24.868 INFO:teuthology.orchestra.run.smithi101.stdout: "event": "op_commit", 2023-08-01T19:54:24.868 INFO:teuthology.orchestra.run.smithi101.stdout: "time": "2023-08-01T19:53:52.539202+0000", 2023-08-01T19:54:24.868 INFO:teuthology.orchestra.run.smithi101.stdout: "duration": 0.0052351109999999998 2023-08-01T19:54:24.868 INFO:teuthology.orchestra.run.smithi101.stdout: }, 2023-08-01T19:54:24.868 INFO:teuthology.orchestra.run.smithi101.stdout: { 2023-08-01T19:54:24.868 INFO:teuthology.orchestra.run.smithi101.stdout: "event": "sub_op_commit_rec", 2023-08-01T19:54:24.868 INFO:teuthology.orchestra.run.smithi101.stdout: "time": "2023-08-01T19:53:52.539279+0000", 2023-08-01T19:54:24.868 INFO:teuthology.orchestra.run.smithi101.stdout: "duration": 7.7038000000000003e-05 2023-08-01T19:54:24.869 INFO:teuthology.orchestra.run.smithi101.stdout: }, 2023-08-01T19:54:24.869 INFO:teuthology.orchestra.run.smithi101.stdout: { 2023-08-01T19:54:24.869 INFO:teuthology.orchestra.run.smithi101.stdout: "event": "commit_sent", 2023-08-01T19:54:24.869 INFO:teuthology.orchestra.run.smithi101.stdout: "time": "2023-08-01T19:53:52.539309+0000", 2023-08-01T19:54:24.869 INFO:teuthology.orchestra.run.smithi101.stdout: "duration": 3.0122000000000001e-05 2023-08-01T19:54:24.869 INFO:teuthology.orchestra.run.smithi101.stdout: }, 2023-08-01T19:54:24.869 INFO:teuthology.orchestra.run.smithi101.stdout: { 2023-08-01T19:54:24.870 INFO:teuthology.orchestra.run.smithi101.stdout: "event": "done", 2023-08-01T19:54:24.870 INFO:teuthology.orchestra.run.smithi101.stdout: "time": "2023-08-01T19:53:52.539330+0000", 2023-08-01T19:54:24.870 INFO:teuthology.orchestra.run.smithi101.stdout: "duration": 2.0356e-05 2023-08-01T19:54:24.870 INFO:teuthology.orchestra.run.smithi101.stdout: } 2023-08-01T19:54:24.870 INFO:teuthology.orchestra.run.smithi101.stdout: ] 2023-08-01T19:54:24.870 INFO:teuthology.orchestra.run.smithi101.stdout: } 2023-08-01T19:54:24.870 INFO:teuthology.orchestra.run.smithi101.stdout: }, 2023-08-01T19:54:24.870 INFO:teuthology.orchestra.run.smithi101.stdout: { 2023-08-01T19:54:24.871 INFO:teuthology.orchestra.run.smithi101.stdout: "description": "osd_op(mds.0.3:6 3.10 3:0d82a743:::600.00000000:head [omap-set-header] snapc 0=[] ondisk+write+known_if_redirected+full_force+supports_pool_eio e17)", 2023-08-01T19:54:24.871 INFO:teuthology.orchestra.run.smithi101.stdout: "initiated_at": "2023-08-01T19:54:04.458774+0000", 2023-08-01T19:54:24.871 INFO:teuthology.orchestra.run.smithi101.stdout: "age": 20.396807401, 2023-08-01T19:54:24.871 INFO:teuthology.orchestra.run.smithi101.stdout: "duration": 0.017582611000000001, 2023-08-01T19:54:24.871 INFO:teuthology.orchestra.run.smithi101.stdout: "type_data": { 2023-08-01T19:54:24.871 INFO:teuthology.orchestra.run.smithi101.stdout: "flag_point": "commit sent; apply or cleanup", 2023-08-01T19:54:24.871 INFO:teuthology.orchestra.run.smithi101.stdout: "events": [ 2023-08-01T19:54:24.871 INFO:teuthology.orchestra.run.smithi101.stdout: { 2023-08-01T19:54:24.872 INFO:teuthology.orchestra.run.smithi101.stdout: "event": "initiated", 2023-08-01T19:54:24.872 INFO:teuthology.orchestra.run.smithi101.stdout: "time": "2023-08-01T19:54:04.458774+0000", 2023-08-01T19:54:24.872 INFO:teuthology.orchestra.run.smithi101.stdout: "duration": 0 2023-08-01T19:54:24.872 INFO:teuthology.orchestra.run.smithi101.stdout: }, 2023-08-01T19:54:24.872 INFO:teuthology.orchestra.run.smithi101.stdout: { 2023-08-01T19:54:24.872 INFO:teuthology.orchestra.run.smithi101.stdout: "event": "throttled", 2023-08-01T19:54:24.872 INFO:teuthology.orchestra.run.smithi101.stdout: "time": "2023-08-01T19:54:04.458774+0000", 2023-08-01T19:54:24.873 INFO:teuthology.orchestra.run.smithi101.stdout: "duration": 0 2023-08-01T19:54:24.873 INFO:teuthology.orchestra.run.smithi101.stdout: }, 2023-08-01T19:54:24.873 INFO:teuthology.orchestra.run.smithi101.stdout: { 2023-08-01T19:54:24.873 INFO:teuthology.orchestra.run.smithi101.stdout: "event": "header_read", 2023-08-01T19:54:24.873 INFO:teuthology.orchestra.run.smithi101.stdout: "time": "2023-08-01T19:54:04.458772+0000", 2023-08-01T19:54:24.873 INFO:teuthology.orchestra.run.smithi101.stdout: "duration": 4294967295.9999981 2023-08-01T19:54:24.873 INFO:teuthology.orchestra.run.smithi101.stdout: }, 2023-08-01T19:54:24.873 INFO:teuthology.orchestra.run.smithi101.stdout: { 2023-08-01T19:54:24.874 INFO:teuthology.orchestra.run.smithi101.stdout: "event": "all_read", 2023-08-01T19:54:24.874 INFO:teuthology.orchestra.run.smithi101.stdout: "time": "2023-08-01T19:54:04.458781+0000", 2023-08-01T19:54:24.874 INFO:teuthology.orchestra.run.smithi101.stdout: "duration": 8.6670000000000002e-06 2023-08-01T19:54:24.874 INFO:teuthology.orchestra.run.smithi101.stdout: }, 2023-08-01T19:54:24.874 INFO:teuthology.orchestra.run.smithi101.stdout: { 2023-08-01T19:54:24.874 INFO:teuthology.orchestra.run.smithi101.stdout: "event": "dispatched", 2023-08-01T19:54:24.874 INFO:teuthology.orchestra.run.smithi101.stdout: "time": "2023-08-01T19:54:04.458797+0000", 2023-08-01T19:54:24.874 INFO:teuthology.orchestra.run.smithi101.stdout: "duration": 1.6463000000000001e-05 2023-08-01T19:54:24.875 INFO:teuthology.orchestra.run.smithi101.stdout: }, 2023-08-01T19:54:24.875 INFO:teuthology.orchestra.run.smithi101.stdout: { 2023-08-01T19:54:24.875 INFO:teuthology.orchestra.run.smithi101.stdout: "event": "queued_for_pg", 2023-08-01T19:54:24.875 INFO:teuthology.orchestra.run.smithi101.stdout: "time": "2023-08-01T19:54:04.458810+0000", 2023-08-01T19:54:24.875 INFO:teuthology.orchestra.run.smithi101.stdout: "duration": 1.2753e-05 2023-08-01T19:54:24.875 INFO:teuthology.orchestra.run.smithi101.stdout: }, 2023-08-01T19:54:24.875 INFO:teuthology.orchestra.run.smithi101.stdout: { 2023-08-01T19:54:24.875 INFO:teuthology.orchestra.run.smithi101.stdout: "event": "reached_pg", 2023-08-01T19:54:24.876 INFO:teuthology.orchestra.run.smithi101.stdout: "time": "2023-08-01T19:54:04.458866+0000", 2023-08-01T19:54:24.876 INFO:teuthology.orchestra.run.smithi101.stdout: "duration": 5.6625000000000001e-05 2023-08-01T19:54:24.876 INFO:teuthology.orchestra.run.smithi101.stdout: }, 2023-08-01T19:54:24.876 INFO:teuthology.orchestra.run.smithi101.stdout: { 2023-08-01T19:54:24.876 INFO:teuthology.orchestra.run.smithi101.stdout: "event": "op must wait for map", 2023-08-01T19:54:24.876 INFO:teuthology.orchestra.run.smithi101.stdout: "time": "2023-08-01T19:54:04.458873+0000", 2023-08-01T19:54:24.876 INFO:teuthology.orchestra.run.smithi101.stdout: "duration": 6.9110000000000004e-06 2023-08-01T19:54:24.877 INFO:teuthology.orchestra.run.smithi101.stdout: }, 2023-08-01T19:54:24.877 INFO:teuthology.orchestra.run.smithi101.stdout: { 2023-08-01T19:54:24.877 INFO:teuthology.orchestra.run.smithi101.stdout: "event": "reached_pg", 2023-08-01T19:54:24.877 INFO:teuthology.orchestra.run.smithi101.stdout: "time": "2023-08-01T19:54:04.466999+0000", 2023-08-01T19:54:24.877 INFO:teuthology.orchestra.run.smithi101.stdout: "duration": 0.0081256550000000007 2023-08-01T19:54:24.877 INFO:teuthology.orchestra.run.smithi101.stdout: }, 2023-08-01T19:54:24.877 INFO:teuthology.orchestra.run.smithi101.stdout: { 2023-08-01T19:54:24.877 INFO:teuthology.orchestra.run.smithi101.stdout: "event": "started", 2023-08-01T19:54:24.878 INFO:teuthology.orchestra.run.smithi101.stdout: "time": "2023-08-01T19:54:04.467201+0000", 2023-08-01T19:54:24.878 INFO:teuthology.orchestra.run.smithi101.stdout: "duration": 0.00020166199999999999 2023-08-01T19:54:24.878 INFO:teuthology.orchestra.run.smithi101.stdout: }, 2023-08-01T19:54:24.878 INFO:teuthology.orchestra.run.smithi101.stdout: { 2023-08-01T19:54:24.878 INFO:teuthology.orchestra.run.smithi101.stdout: "event": "waiting for subops from 2", 2023-08-01T19:54:24.878 INFO:teuthology.orchestra.run.smithi101.stdout: "time": "2023-08-01T19:54:04.467350+0000", 2023-08-01T19:54:24.878 INFO:teuthology.orchestra.run.smithi101.stdout: "duration": 0.000149173 2023-08-01T19:54:24.878 INFO:teuthology.orchestra.run.smithi101.stdout: }, 2023-08-01T19:54:24.879 INFO:teuthology.orchestra.run.smithi101.stdout: { 2023-08-01T19:54:24.879 INFO:teuthology.orchestra.run.smithi101.stdout: "event": "op_commit", 2023-08-01T19:54:24.879 INFO:teuthology.orchestra.run.smithi101.stdout: "time": "2023-08-01T19:54:04.476168+0000", 2023-08-01T19:54:24.879 INFO:teuthology.orchestra.run.smithi101.stdout: "duration": 0.0088183250000000001 2023-08-01T19:54:24.879 INFO:teuthology.orchestra.run.smithi101.stdout: }, 2023-08-01T19:54:24.879 INFO:teuthology.orchestra.run.smithi101.stdout: { 2023-08-01T19:54:24.879 INFO:teuthology.orchestra.run.smithi101.stdout: "event": "sub_op_commit_rec", 2023-08-01T19:54:24.880 INFO:teuthology.orchestra.run.smithi101.stdout: "time": "2023-08-01T19:54:04.476239+0000", 2023-08-01T19:54:24.880 INFO:teuthology.orchestra.run.smithi101.stdout: "duration": 7.1296000000000003e-05 2023-08-01T19:54:24.880 INFO:teuthology.orchestra.run.smithi101.stdout: }, 2023-08-01T19:54:24.880 INFO:teuthology.orchestra.run.smithi101.stdout: { 2023-08-01T19:54:24.880 INFO:teuthology.orchestra.run.smithi101.stdout: "event": "commit_sent", 2023-08-01T19:54:24.880 INFO:teuthology.orchestra.run.smithi101.stdout: "time": "2023-08-01T19:54:04.476290+0000", 2023-08-01T19:54:24.880 INFO:teuthology.orchestra.run.smithi101.stdout: "duration": 5.0423999999999997e-05 2023-08-01T19:54:24.880 INFO:teuthology.orchestra.run.smithi101.stdout: }, 2023-08-01T19:54:24.881 INFO:teuthology.orchestra.run.smithi101.stdout: { 2023-08-01T19:54:24.881 INFO:teuthology.orchestra.run.smithi101.stdout: "event": "done", 2023-08-01T19:54:24.883 INFO:teuthology.orchestra.run.smithi101.stdout: "time": "2023-08-01T19:54:04.476356+0000", 2023-08-01T19:54:24.883 INFO:teuthology.orchestra.run.smithi101.stdout: "duration": 6.6439000000000005e-05 2023-08-01T19:54:24.883 INFO:teuthology.orchestra.run.smithi101.stdout: } 2023-08-01T19:54:24.884 INFO:teuthology.orchestra.run.smithi101.stdout: ] 2023-08-01T19:54:24.884 INFO:teuthology.orchestra.run.smithi101.stdout: } 2023-08-01T19:54:24.884 INFO:teuthology.orchestra.run.smithi101.stdout: }, 2023-08-01T19:54:24.884 INFO:teuthology.orchestra.run.smithi101.stdout: { 2023-08-01T19:54:24.884 INFO:teuthology.orchestra.run.smithi101.stdout: "description": "osd_op(mds.0.3:7 3.10 3:0d82a743:::600.00000000:head [create,setxattr parent (62) in=6b,setxattr layout (30) in=6b] snapc 0=[] ondisk+write+known_if_redirected+full_force+supports_pool_eio e17)", 2023-08-01T19:54:24.884 INFO:teuthology.orchestra.run.smithi101.stdout: "initiated_at": "2023-08-01T19:54:04.458830+0000", 2023-08-01T19:54:24.884 INFO:teuthology.orchestra.run.smithi101.stdout: "age": 20.396751013999999, 2023-08-01T19:54:24.885 INFO:teuthology.orchestra.run.smithi101.stdout: "duration": 0.018463726, 2023-08-01T19:54:24.885 INFO:teuthology.orchestra.run.smithi101.stdout: "type_data": { 2023-08-01T19:54:24.885 INFO:teuthology.orchestra.run.smithi101.stdout: "flag_point": "commit sent; apply or cleanup", 2023-08-01T19:54:24.885 INFO:teuthology.orchestra.run.smithi101.stdout: "events": [ 2023-08-01T19:54:24.885 INFO:teuthology.orchestra.run.smithi101.stdout: { 2023-08-01T19:54:24.885 INFO:teuthology.orchestra.run.smithi101.stdout: "event": "initiated", 2023-08-01T19:54:24.885 INFO:teuthology.orchestra.run.smithi101.stdout: "time": "2023-08-01T19:54:04.458830+0000", 2023-08-01T19:54:24.885 INFO:teuthology.orchestra.run.smithi101.stdout: "duration": 0 2023-08-01T19:54:24.886 INFO:teuthology.orchestra.run.smithi101.stdout: }, 2023-08-01T19:54:24.886 INFO:teuthology.orchestra.run.smithi101.stdout: { 2023-08-01T19:54:24.886 INFO:teuthology.orchestra.run.smithi101.stdout: "event": "throttled", 2023-08-01T19:54:24.886 INFO:teuthology.orchestra.run.smithi101.stdout: "time": "2023-08-01T19:54:04.458830+0000", 2023-08-01T19:54:24.886 INFO:teuthology.orchestra.run.smithi101.stdout: "duration": 0 2023-08-01T19:54:24.886 INFO:teuthology.orchestra.run.smithi101.stdout: }, 2023-08-01T19:54:24.886 INFO:teuthology.orchestra.run.smithi101.stdout: { 2023-08-01T19:54:24.886 INFO:teuthology.orchestra.run.smithi101.stdout: "event": "header_read", 2023-08-01T19:54:24.887 INFO:teuthology.orchestra.run.smithi101.stdout: "time": "2023-08-01T19:54:04.458829+0000", 2023-08-01T19:54:24.887 INFO:teuthology.orchestra.run.smithi101.stdout: "duration": 4294967295.999999 2023-08-01T19:54:24.887 INFO:teuthology.orchestra.run.smithi101.stdout: }, 2023-08-01T19:54:24.887 INFO:teuthology.orchestra.run.smithi101.stdout: { 2023-08-01T19:54:24.887 INFO:teuthology.orchestra.run.smithi101.stdout: "event": "all_read", 2023-08-01T19:54:24.887 INFO:teuthology.orchestra.run.smithi101.stdout: "time": "2023-08-01T19:54:04.458838+0000", 2023-08-01T19:54:24.887 INFO:teuthology.orchestra.run.smithi101.stdout: "duration": 8.5369999999999997e-06 2023-08-01T19:54:24.888 INFO:teuthology.orchestra.run.smithi101.stdout: }, 2023-08-01T19:54:24.888 INFO:teuthology.orchestra.run.smithi101.stdout: { 2023-08-01T19:54:24.888 INFO:teuthology.orchestra.run.smithi101.stdout: "event": "dispatched", 2023-08-01T19:54:24.888 INFO:teuthology.orchestra.run.smithi101.stdout: "time": "2023-08-01T19:54:04.458850+0000", 2023-08-01T19:54:24.888 INFO:teuthology.orchestra.run.smithi101.stdout: "duration": 1.203e-05 2023-08-01T19:54:24.888 INFO:teuthology.orchestra.run.smithi101.stdout: }, 2023-08-01T19:54:24.888 INFO:teuthology.orchestra.run.smithi101.stdout: { 2023-08-01T19:54:24.888 INFO:teuthology.orchestra.run.smithi101.stdout: "event": "queued_for_pg", 2023-08-01T19:54:24.889 INFO:teuthology.orchestra.run.smithi101.stdout: "time": "2023-08-01T19:54:04.458859+0000", 2023-08-01T19:54:24.889 INFO:teuthology.orchestra.run.smithi101.stdout: "duration": 8.9889999999999998e-06 2023-08-01T19:54:24.889 INFO:teuthology.orchestra.run.smithi101.stdout: }, 2023-08-01T19:54:24.889 INFO:teuthology.orchestra.run.smithi101.stdout: { 2023-08-01T19:54:24.889 INFO:teuthology.orchestra.run.smithi101.stdout: "event": "reached_pg", 2023-08-01T19:54:24.889 INFO:teuthology.orchestra.run.smithi101.stdout: "time": "2023-08-01T19:54:04.458926+0000", 2023-08-01T19:54:24.889 INFO:teuthology.orchestra.run.smithi101.stdout: "duration": 6.6741000000000004e-05 2023-08-01T19:54:24.890 INFO:teuthology.orchestra.run.smithi101.stdout: }, 2023-08-01T19:54:24.890 INFO:teuthology.orchestra.run.smithi101.stdout: { 2023-08-01T19:54:24.890 INFO:teuthology.orchestra.run.smithi101.stdout: "event": "waiting_for_map not empty", 2023-08-01T19:54:24.890 INFO:teuthology.orchestra.run.smithi101.stdout: "time": "2023-08-01T19:54:04.458929+0000", 2023-08-01T19:54:24.890 INFO:teuthology.orchestra.run.smithi101.stdout: "duration": 3.303e-06 2023-08-01T19:54:24.890 INFO:teuthology.orchestra.run.smithi101.stdout: }, 2023-08-01T19:54:24.890 INFO:teuthology.orchestra.run.smithi101.stdout: { 2023-08-01T19:54:24.890 INFO:teuthology.orchestra.run.smithi101.stdout: "event": "reached_pg", 2023-08-01T19:54:24.891 INFO:teuthology.orchestra.run.smithi101.stdout: "time": "2023-08-01T19:54:04.468692+0000", 2023-08-01T19:54:24.891 INFO:teuthology.orchestra.run.smithi101.stdout: "duration": 0.0097635910000000003 2023-08-01T19:54:24.891 INFO:teuthology.orchestra.run.smithi101.stdout: }, 2023-08-01T19:54:24.891 INFO:teuthology.orchestra.run.smithi101.stdout: { 2023-08-01T19:54:24.891 INFO:teuthology.orchestra.run.smithi101.stdout: "event": "started", 2023-08-01T19:54:24.891 INFO:teuthology.orchestra.run.smithi101.stdout: "time": "2023-08-01T19:54:04.468774+0000", 2023-08-01T19:54:24.891 INFO:teuthology.orchestra.run.smithi101.stdout: "duration": 8.1092000000000002e-05 2023-08-01T19:54:24.891 INFO:teuthology.orchestra.run.smithi101.stdout: }, 2023-08-01T19:54:24.892 INFO:teuthology.orchestra.run.smithi101.stdout: { 2023-08-01T19:54:24.892 INFO:teuthology.orchestra.run.smithi101.stdout: "event": "waiting for subops from 2", 2023-08-01T19:54:24.892 INFO:teuthology.orchestra.run.smithi101.stdout: "time": "2023-08-01T19:54:04.468934+0000", 2023-08-01T19:54:24.892 INFO:teuthology.orchestra.run.smithi101.stdout: "duration": 0.000160027 2023-08-01T19:54:24.892 INFO:teuthology.orchestra.run.smithi101.stdout: }, 2023-08-01T19:54:24.892 INFO:teuthology.orchestra.run.smithi101.stdout: { 2023-08-01T19:54:24.892 INFO:teuthology.orchestra.run.smithi101.stdout: "event": "op_commit", 2023-08-01T19:54:24.892 INFO:teuthology.orchestra.run.smithi101.stdout: "time": "2023-08-01T19:54:04.476174+0000", 2023-08-01T19:54:24.893 INFO:teuthology.orchestra.run.smithi101.stdout: "duration": 0.0072400479999999998 2023-08-01T19:54:24.893 INFO:teuthology.orchestra.run.smithi101.stdout: }, 2023-08-01T19:54:24.893 INFO:teuthology.orchestra.run.smithi101.stdout: { 2023-08-01T19:54:24.893 INFO:teuthology.orchestra.run.smithi101.stdout: "event": "sub_op_commit_rec", 2023-08-01T19:54:24.893 INFO:teuthology.orchestra.run.smithi101.stdout: "time": "2023-08-01T19:54:04.477206+0000", 2023-08-01T19:54:24.893 INFO:teuthology.orchestra.run.smithi101.stdout: "duration": 0.0010318969999999999 2023-08-01T19:54:24.893 INFO:teuthology.orchestra.run.smithi101.stdout: }, 2023-08-01T19:54:24.894 INFO:teuthology.orchestra.run.smithi101.stdout: { 2023-08-01T19:54:24.894 INFO:teuthology.orchestra.run.smithi101.stdout: "event": "commit_sent", 2023-08-01T19:54:24.894 INFO:teuthology.orchestra.run.smithi101.stdout: "time": "2023-08-01T19:54:04.477257+0000", 2023-08-01T19:54:24.894 INFO:teuthology.orchestra.run.smithi101.stdout: "duration": 5.1156000000000003e-05 2023-08-01T19:54:24.894 INFO:teuthology.orchestra.run.smithi101.stdout: }, 2023-08-01T19:54:24.894 INFO:teuthology.orchestra.run.smithi101.stdout: { 2023-08-01T19:54:24.894 INFO:teuthology.orchestra.run.smithi101.stdout: "event": "done", 2023-08-01T19:54:24.894 INFO:teuthology.orchestra.run.smithi101.stdout: "time": "2023-08-01T19:54:04.477294+0000", 2023-08-01T19:54:24.895 INFO:teuthology.orchestra.run.smithi101.stdout: "duration": 3.7150000000000002e-05 2023-08-01T19:54:24.895 INFO:teuthology.orchestra.run.smithi101.stdout: } 2023-08-01T19:54:24.895 INFO:teuthology.orchestra.run.smithi101.stdout: ] 2023-08-01T19:54:24.895 INFO:teuthology.orchestra.run.smithi101.stdout: } 2023-08-01T19:54:24.895 INFO:teuthology.orchestra.run.smithi101.stdout: }, 2023-08-01T19:54:24.895 INFO:teuthology.orchestra.run.smithi101.stdout: { 2023-08-01T19:54:24.895 INFO:teuthology.orchestra.run.smithi101.stdout: "description": "osd_op(mds.0.3:8 3.10 3:09401a81:::601.00000000:head [omap-set-header] snapc 0=[] ondisk+write+known_if_redirected+full_force+supports_pool_eio e17)", 2023-08-01T19:54:24.895 INFO:teuthology.orchestra.run.smithi101.stdout: "initiated_at": "2023-08-01T19:54:04.458869+0000", 2023-08-01T19:54:24.896 INFO:teuthology.orchestra.run.smithi101.stdout: "age": 20.396711878000001, 2023-08-01T19:54:24.896 INFO:teuthology.orchestra.run.smithi101.stdout: "duration": 0.018528932000000001, 2023-08-01T19:54:24.896 INFO:teuthology.orchestra.run.smithi101.stdout: "type_data": { 2023-08-01T19:54:24.896 INFO:teuthology.orchestra.run.smithi101.stdout: "flag_point": "commit sent; apply or cleanup", 2023-08-01T19:54:24.896 INFO:teuthology.orchestra.run.smithi101.stdout: "events": [ 2023-08-01T19:54:24.896 INFO:teuthology.orchestra.run.smithi101.stdout: { 2023-08-01T19:54:24.896 INFO:teuthology.orchestra.run.smithi101.stdout: "event": "initiated", 2023-08-01T19:54:24.897 INFO:teuthology.orchestra.run.smithi101.stdout: "time": "2023-08-01T19:54:04.458869+0000", 2023-08-01T19:54:24.897 INFO:teuthology.orchestra.run.smithi101.stdout: "duration": 0 2023-08-01T19:54:24.897 INFO:teuthology.orchestra.run.smithi101.stdout: }, 2023-08-01T19:54:24.897 INFO:teuthology.orchestra.run.smithi101.stdout: { 2023-08-01T19:54:24.897 INFO:teuthology.orchestra.run.smithi101.stdout: "event": "throttled", 2023-08-01T19:54:24.897 INFO:teuthology.orchestra.run.smithi101.stdout: "time": "2023-08-01T19:54:04.458869+0000", 2023-08-01T19:54:24.897 INFO:teuthology.orchestra.run.smithi101.stdout: "duration": 0 2023-08-01T19:54:24.897 INFO:teuthology.orchestra.run.smithi101.stdout: }, 2023-08-01T19:54:24.898 INFO:teuthology.orchestra.run.smithi101.stdout: { 2023-08-01T19:54:24.898 INFO:teuthology.orchestra.run.smithi101.stdout: "event": "header_read", 2023-08-01T19:54:24.898 INFO:teuthology.orchestra.run.smithi101.stdout: "time": "2023-08-01T19:54:04.458869+0000", 2023-08-01T19:54:24.898 INFO:teuthology.orchestra.run.smithi101.stdout: "duration": 4294967295.9999995 2023-08-01T19:54:24.898 INFO:teuthology.orchestra.run.smithi101.stdout: }, 2023-08-01T19:54:24.898 INFO:teuthology.orchestra.run.smithi101.stdout: { 2023-08-01T19:54:24.898 INFO:teuthology.orchestra.run.smithi101.stdout: "event": "all_read", 2023-08-01T19:54:24.898 INFO:teuthology.orchestra.run.smithi101.stdout: "time": "2023-08-01T19:54:04.458878+0000", 2023-08-01T19:54:24.899 INFO:teuthology.orchestra.run.smithi101.stdout: "duration": 9.4110000000000002e-06 2023-08-01T19:54:24.899 INFO:teuthology.orchestra.run.smithi101.stdout: }, 2023-08-01T19:54:24.899 INFO:teuthology.orchestra.run.smithi101.stdout: { 2023-08-01T19:54:24.899 INFO:teuthology.orchestra.run.smithi101.stdout: "event": "dispatched", 2023-08-01T19:54:24.899 INFO:teuthology.orchestra.run.smithi101.stdout: "time": "2023-08-01T19:54:04.458886+0000", 2023-08-01T19:54:24.899 INFO:teuthology.orchestra.run.smithi101.stdout: "duration": 7.6090000000000003e-06 2023-08-01T19:54:24.899 INFO:teuthology.orchestra.run.smithi101.stdout: }, 2023-08-01T19:54:24.899 INFO:teuthology.orchestra.run.smithi101.stdout: { 2023-08-01T19:54:24.900 INFO:teuthology.orchestra.run.smithi101.stdout: "event": "queued_for_pg", 2023-08-01T19:54:24.900 INFO:teuthology.orchestra.run.smithi101.stdout: "time": "2023-08-01T19:54:04.458890+0000", 2023-08-01T19:54:24.900 INFO:teuthology.orchestra.run.smithi101.stdout: "duration": 4.8470000000000003e-06 2023-08-01T19:54:24.900 INFO:teuthology.orchestra.run.smithi101.stdout: }, 2023-08-01T19:54:24.900 INFO:teuthology.orchestra.run.smithi101.stdout: { 2023-08-01T19:54:24.900 INFO:teuthology.orchestra.run.smithi101.stdout: "event": "reached_pg", 2023-08-01T19:54:24.900 INFO:teuthology.orchestra.run.smithi101.stdout: "time": "2023-08-01T19:54:04.458957+0000", 2023-08-01T19:54:24.900 INFO:teuthology.orchestra.run.smithi101.stdout: "duration": 6.6502999999999997e-05 2023-08-01T19:54:24.901 INFO:teuthology.orchestra.run.smithi101.stdout: }, 2023-08-01T19:54:24.901 INFO:teuthology.orchestra.run.smithi101.stdout: { 2023-08-01T19:54:24.901 INFO:teuthology.orchestra.run.smithi101.stdout: "event": "waiting_for_map not empty", 2023-08-01T19:54:24.901 INFO:teuthology.orchestra.run.smithi101.stdout: "time": "2023-08-01T19:54:04.458959+0000", 2023-08-01T19:54:24.901 INFO:teuthology.orchestra.run.smithi101.stdout: "duration": 2.3989999999999998e-06 2023-08-01T19:54:24.901 INFO:teuthology.orchestra.run.smithi101.stdout: }, 2023-08-01T19:54:24.901 INFO:teuthology.orchestra.run.smithi101.stdout: { 2023-08-01T19:54:24.902 INFO:teuthology.orchestra.run.smithi101.stdout: "event": "reached_pg", 2023-08-01T19:54:24.902 INFO:teuthology.orchestra.run.smithi101.stdout: "time": "2023-08-01T19:54:04.469554+0000", 2023-08-01T19:54:24.902 INFO:teuthology.orchestra.run.smithi101.stdout: "duration": 0.010594404 2023-08-01T19:54:24.902 INFO:teuthology.orchestra.run.smithi101.stdout: }, 2023-08-01T19:54:24.902 INFO:teuthology.orchestra.run.smithi101.stdout: { 2023-08-01T19:54:24.902 INFO:teuthology.orchestra.run.smithi101.stdout: "event": "started", 2023-08-01T19:54:24.902 INFO:teuthology.orchestra.run.smithi101.stdout: "time": "2023-08-01T19:54:04.469694+0000", 2023-08-01T19:54:24.902 INFO:teuthology.orchestra.run.smithi101.stdout: "duration": 0.00014006899999999999 2023-08-01T19:54:24.903 INFO:teuthology.orchestra.run.smithi101.stdout: }, 2023-08-01T19:54:24.903 INFO:teuthology.orchestra.run.smithi101.stdout: { 2023-08-01T19:54:24.903 INFO:teuthology.orchestra.run.smithi101.stdout: "event": "waiting for subops from 2", 2023-08-01T19:54:24.903 INFO:teuthology.orchestra.run.smithi101.stdout: "time": "2023-08-01T19:54:04.469826+0000", 2023-08-01T19:54:24.903 INFO:teuthology.orchestra.run.smithi101.stdout: "duration": 0.000132285 2023-08-01T19:54:24.903 INFO:teuthology.orchestra.run.smithi101.stdout: }, 2023-08-01T19:54:24.903 INFO:teuthology.orchestra.run.smithi101.stdout: { 2023-08-01T19:54:24.903 INFO:teuthology.orchestra.run.smithi101.stdout: "event": "op_commit", 2023-08-01T19:54:24.904 INFO:teuthology.orchestra.run.smithi101.stdout: "time": "2023-08-01T19:54:04.476179+0000", 2023-08-01T19:54:24.904 INFO:teuthology.orchestra.run.smithi101.stdout: "duration": 0.0063524289999999997 2023-08-01T19:54:24.904 INFO:teuthology.orchestra.run.smithi101.stdout: }, 2023-08-01T19:54:24.904 INFO:teuthology.orchestra.run.smithi101.stdout: { 2023-08-01T19:54:24.904 INFO:teuthology.orchestra.run.smithi101.stdout: "event": "sub_op_commit_rec", 2023-08-01T19:54:24.904 INFO:teuthology.orchestra.run.smithi101.stdout: "time": "2023-08-01T19:54:04.477334+0000", 2023-08-01T19:54:24.904 INFO:teuthology.orchestra.run.smithi101.stdout: "duration": 0.0011551070000000001 2023-08-01T19:54:24.905 INFO:teuthology.orchestra.run.smithi101.stdout: }, 2023-08-01T19:54:24.905 INFO:teuthology.orchestra.run.smithi101.stdout: { 2023-08-01T19:54:24.905 INFO:teuthology.orchestra.run.smithi101.stdout: "event": "commit_sent", 2023-08-01T19:54:24.905 INFO:teuthology.orchestra.run.smithi101.stdout: "time": "2023-08-01T19:54:04.477371+0000", 2023-08-01T19:54:24.905 INFO:teuthology.orchestra.run.smithi101.stdout: "duration": 3.7425000000000002e-05 2023-08-01T19:54:24.905 INFO:teuthology.orchestra.run.smithi101.stdout: }, 2023-08-01T19:54:24.905 INFO:teuthology.orchestra.run.smithi101.stdout: { 2023-08-01T19:54:24.905 INFO:teuthology.orchestra.run.smithi101.stdout: "event": "done", 2023-08-01T19:54:24.906 INFO:teuthology.orchestra.run.smithi101.stdout: "time": "2023-08-01T19:54:04.477398+0000", 2023-08-01T19:54:24.906 INFO:teuthology.orchestra.run.smithi101.stdout: "duration": 2.7078000000000001e-05 2023-08-01T19:54:24.906 INFO:teuthology.orchestra.run.smithi101.stdout: } 2023-08-01T19:54:24.906 INFO:teuthology.orchestra.run.smithi101.stdout: ] 2023-08-01T19:54:24.906 INFO:teuthology.orchestra.run.smithi101.stdout: } 2023-08-01T19:54:24.906 INFO:teuthology.orchestra.run.smithi101.stdout: }, 2023-08-01T19:54:24.906 INFO:teuthology.orchestra.run.smithi101.stdout: { 2023-08-01T19:54:24.906 INFO:teuthology.orchestra.run.smithi101.stdout: "description": "osd_op(mds.0.3:9 3.10 3:09401a81:::601.00000000:head [create,setxattr parent (62) in=6b,setxattr layout (30) in=6b] snapc 0=[] ondisk+write+known_if_redirected+full_force+supports_pool_eio e17)", 2023-08-01T19:54:24.907 INFO:teuthology.orchestra.run.smithi101.stdout: "initiated_at": "2023-08-01T19:54:04.458896+0000", 2023-08-01T19:54:24.907 INFO:teuthology.orchestra.run.smithi101.stdout: "age": 20.396684710999999, 2023-08-01T19:54:24.907 INFO:teuthology.orchestra.run.smithi101.stdout: "duration": 0.018577215000000001, 2023-08-01T19:54:24.907 INFO:teuthology.orchestra.run.smithi101.stdout: "type_data": { 2023-08-01T19:54:24.907 INFO:teuthology.orchestra.run.smithi101.stdout: "flag_point": "commit sent; apply or cleanup", 2023-08-01T19:54:24.907 INFO:teuthology.orchestra.run.smithi101.stdout: "events": [ 2023-08-01T19:54:24.907 INFO:teuthology.orchestra.run.smithi101.stdout: { 2023-08-01T19:54:24.908 INFO:teuthology.orchestra.run.smithi101.stdout: "event": "initiated", 2023-08-01T19:54:24.908 INFO:teuthology.orchestra.run.smithi101.stdout: "time": "2023-08-01T19:54:04.458896+0000", 2023-08-01T19:54:24.908 INFO:teuthology.orchestra.run.smithi101.stdout: "duration": 0 2023-08-01T19:54:24.908 INFO:teuthology.orchestra.run.smithi101.stdout: }, 2023-08-01T19:54:24.908 INFO:teuthology.orchestra.run.smithi101.stdout: { 2023-08-01T19:54:24.908 INFO:teuthology.orchestra.run.smithi101.stdout: "event": "throttled", 2023-08-01T19:54:24.908 INFO:teuthology.orchestra.run.smithi101.stdout: "time": "2023-08-01T19:54:04.458896+0000", 2023-08-01T19:54:24.908 INFO:teuthology.orchestra.run.smithi101.stdout: "duration": 0 2023-08-01T19:54:24.909 INFO:teuthology.orchestra.run.smithi101.stdout: }, 2023-08-01T19:54:24.909 INFO:teuthology.orchestra.run.smithi101.stdout: { 2023-08-01T19:54:24.909 INFO:teuthology.orchestra.run.smithi101.stdout: "event": "header_read", 2023-08-01T19:54:24.909 INFO:teuthology.orchestra.run.smithi101.stdout: "time": "2023-08-01T19:54:04.458896+0000", 2023-08-01T19:54:24.909 INFO:teuthology.orchestra.run.smithi101.stdout: "duration": 4294967295.9999995 2023-08-01T19:54:24.909 INFO:teuthology.orchestra.run.smithi101.stdout: }, 2023-08-01T19:54:24.909 INFO:teuthology.orchestra.run.smithi101.stdout: { 2023-08-01T19:54:24.909 INFO:teuthology.orchestra.run.smithi101.stdout: "event": "all_read", 2023-08-01T19:54:24.910 INFO:teuthology.orchestra.run.smithi101.stdout: "time": "2023-08-01T19:54:04.458900+0000", 2023-08-01T19:54:24.910 INFO:teuthology.orchestra.run.smithi101.stdout: "duration": 4.0829999999999997e-06 2023-08-01T19:54:24.910 INFO:teuthology.orchestra.run.smithi101.stdout: }, 2023-08-01T19:54:24.910 INFO:teuthology.orchestra.run.smithi101.stdout: { 2023-08-01T19:54:24.910 INFO:teuthology.orchestra.run.smithi101.stdout: "event": "dispatched", 2023-08-01T19:54:24.910 INFO:teuthology.orchestra.run.smithi101.stdout: "time": "2023-08-01T19:54:04.458906+0000", 2023-08-01T19:54:24.910 INFO:teuthology.orchestra.run.smithi101.stdout: "duration": 6.4099999999999996e-06 2023-08-01T19:54:24.910 INFO:teuthology.orchestra.run.smithi101.stdout: }, 2023-08-01T19:54:24.911 INFO:teuthology.orchestra.run.smithi101.stdout: { 2023-08-01T19:54:24.911 INFO:teuthology.orchestra.run.smithi101.stdout: "event": "queued_for_pg", 2023-08-01T19:54:24.911 INFO:teuthology.orchestra.run.smithi101.stdout: "time": "2023-08-01T19:54:04.458911+0000", 2023-08-01T19:54:24.911 INFO:teuthology.orchestra.run.smithi101.stdout: "duration": 4.0500000000000002e-06 2023-08-01T19:54:24.911 INFO:teuthology.orchestra.run.smithi101.stdout: }, 2023-08-01T19:54:24.911 INFO:teuthology.orchestra.run.smithi101.stdout: { 2023-08-01T19:54:24.911 INFO:teuthology.orchestra.run.smithi101.stdout: "event": "reached_pg", 2023-08-01T19:54:24.912 INFO:teuthology.orchestra.run.smithi101.stdout: "time": "2023-08-01T19:54:04.458981+0000", 2023-08-01T19:54:24.912 INFO:teuthology.orchestra.run.smithi101.stdout: "duration": 7.0121000000000002e-05 2023-08-01T19:54:24.912 INFO:teuthology.orchestra.run.smithi101.stdout: }, 2023-08-01T19:54:24.912 INFO:teuthology.orchestra.run.smithi101.stdout: { 2023-08-01T19:54:24.912 INFO:teuthology.orchestra.run.smithi101.stdout: "event": "waiting_for_map not empty", 2023-08-01T19:54:24.912 INFO:teuthology.orchestra.run.smithi101.stdout: "time": "2023-08-01T19:54:04.458983+0000", 2023-08-01T19:54:24.912 INFO:teuthology.orchestra.run.smithi101.stdout: "duration": 2.2299999999999998e-06 2023-08-01T19:54:24.912 INFO:teuthology.orchestra.run.smithi101.stdout: }, 2023-08-01T19:54:24.913 INFO:teuthology.orchestra.run.smithi101.stdout: { 2023-08-01T19:54:24.913 INFO:teuthology.orchestra.run.smithi101.stdout: "event": "reached_pg", 2023-08-01T19:54:24.913 INFO:teuthology.orchestra.run.smithi101.stdout: "time": "2023-08-01T19:54:04.470122+0000", 2023-08-01T19:54:24.913 INFO:teuthology.orchestra.run.smithi101.stdout: "duration": 0.011139593999999999 2023-08-01T19:54:24.913 INFO:teuthology.orchestra.run.smithi101.stdout: }, 2023-08-01T19:54:24.913 INFO:teuthology.orchestra.run.smithi101.stdout: { 2023-08-01T19:54:24.913 INFO:teuthology.orchestra.run.smithi101.stdout: "event": "started", 2023-08-01T19:54:24.914 INFO:teuthology.orchestra.run.smithi101.stdout: "time": "2023-08-01T19:54:04.470217+0000", 2023-08-01T19:54:24.914 INFO:teuthology.orchestra.run.smithi101.stdout: "duration": 9.4388000000000005e-05 2023-08-01T19:54:24.914 INFO:teuthology.orchestra.run.smithi101.stdout: }, 2023-08-01T19:54:24.914 INFO:teuthology.orchestra.run.smithi101.stdout: { 2023-08-01T19:54:24.914 INFO:teuthology.orchestra.run.smithi101.stdout: "event": "waiting for subops from 2", 2023-08-01T19:54:24.914 INFO:teuthology.orchestra.run.smithi101.stdout: "time": "2023-08-01T19:54:04.470714+0000", 2023-08-01T19:54:24.914 INFO:teuthology.orchestra.run.smithi101.stdout: "duration": 0.00049680999999999998 2023-08-01T19:54:24.914 INFO:teuthology.orchestra.run.smithi101.stdout: }, 2023-08-01T19:54:24.915 INFO:teuthology.orchestra.run.smithi101.stdout: { 2023-08-01T19:54:24.915 INFO:teuthology.orchestra.run.smithi101.stdout: "event": "op_commit", 2023-08-01T19:54:24.915 INFO:teuthology.orchestra.run.smithi101.stdout: "time": "2023-08-01T19:54:04.476183+0000", 2023-08-01T19:54:24.915 INFO:teuthology.orchestra.run.smithi101.stdout: "duration": 0.0054695880000000001 2023-08-01T19:54:24.915 INFO:teuthology.orchestra.run.smithi101.stdout: }, 2023-08-01T19:54:24.915 INFO:teuthology.orchestra.run.smithi101.stdout: { 2023-08-01T19:54:24.915 INFO:teuthology.orchestra.run.smithi101.stdout: "event": "sub_op_commit_rec", 2023-08-01T19:54:24.915 INFO:teuthology.orchestra.run.smithi101.stdout: "time": "2023-08-01T19:54:04.477428+0000", 2023-08-01T19:54:24.916 INFO:teuthology.orchestra.run.smithi101.stdout: "duration": 0.001244843 2023-08-01T19:54:24.916 INFO:teuthology.orchestra.run.smithi101.stdout: }, 2023-08-01T19:54:24.916 INFO:teuthology.orchestra.run.smithi101.stdout: { 2023-08-01T19:54:24.916 INFO:teuthology.orchestra.run.smithi101.stdout: "event": "commit_sent", 2023-08-01T19:54:24.916 INFO:teuthology.orchestra.run.smithi101.stdout: "time": "2023-08-01T19:54:04.477456+0000", 2023-08-01T19:54:24.916 INFO:teuthology.orchestra.run.smithi101.stdout: "duration": 2.7538e-05 2023-08-01T19:54:24.916 INFO:teuthology.orchestra.run.smithi101.stdout: }, 2023-08-01T19:54:24.917 INFO:teuthology.orchestra.run.smithi101.stdout: { 2023-08-01T19:54:24.917 INFO:teuthology.orchestra.run.smithi101.stdout: "event": "done", 2023-08-01T19:54:24.917 INFO:teuthology.orchestra.run.smithi101.stdout: "time": "2023-08-01T19:54:04.477474+0000", 2023-08-01T19:54:24.917 INFO:teuthology.orchestra.run.smithi101.stdout: "duration": 1.7974000000000001e-05 2023-08-01T19:54:24.917 INFO:teuthology.orchestra.run.smithi101.stdout: } 2023-08-01T19:54:24.917 INFO:teuthology.orchestra.run.smithi101.stdout: ] 2023-08-01T19:54:24.917 INFO:teuthology.orchestra.run.smithi101.stdout: } 2023-08-01T19:54:24.917 INFO:teuthology.orchestra.run.smithi101.stdout: }, 2023-08-01T19:54:24.918 INFO:teuthology.orchestra.run.smithi101.stdout: { 2023-08-01T19:54:24.918 INFO:teuthology.orchestra.run.smithi101.stdout: "description": "osd_op(mds.0.3:10 3.10 3:0bd6d154:::602.00000000:head [omap-set-header] snapc 0=[] ondisk+write+known_if_redirected+full_force+supports_pool_eio e17)", 2023-08-01T19:54:24.918 INFO:teuthology.orchestra.run.smithi101.stdout: "initiated_at": "2023-08-01T19:54:04.458927+0000", 2023-08-01T19:54:24.918 INFO:teuthology.orchestra.run.smithi101.stdout: "age": 20.396653733000001, 2023-08-01T19:54:24.918 INFO:teuthology.orchestra.run.smithi101.stdout: "duration": 0.019574352, 2023-08-01T19:54:24.918 INFO:teuthology.orchestra.run.smithi101.stdout: "type_data": { 2023-08-01T19:54:24.918 INFO:teuthology.orchestra.run.smithi101.stdout: "flag_point": "commit sent; apply or cleanup", 2023-08-01T19:54:24.918 INFO:teuthology.orchestra.run.smithi101.stdout: "events": [ 2023-08-01T19:54:24.919 INFO:teuthology.orchestra.run.smithi101.stdout: { 2023-08-01T19:54:24.919 INFO:teuthology.orchestra.run.smithi101.stdout: "event": "initiated", 2023-08-01T19:54:24.919 INFO:teuthology.orchestra.run.smithi101.stdout: "time": "2023-08-01T19:54:04.458927+0000", 2023-08-01T19:54:24.919 INFO:teuthology.orchestra.run.smithi101.stdout: "duration": 0 2023-08-01T19:54:24.919 INFO:teuthology.orchestra.run.smithi101.stdout: }, 2023-08-01T19:54:24.919 INFO:teuthology.orchestra.run.smithi101.stdout: { 2023-08-01T19:54:24.919 INFO:teuthology.orchestra.run.smithi101.stdout: "event": "throttled", 2023-08-01T19:54:24.919 INFO:teuthology.orchestra.run.smithi101.stdout: "time": "2023-08-01T19:54:04.458927+0000", 2023-08-01T19:54:24.920 INFO:teuthology.orchestra.run.smithi101.stdout: "duration": 0 2023-08-01T19:54:24.920 INFO:teuthology.orchestra.run.smithi101.stdout: }, 2023-08-01T19:54:24.920 INFO:teuthology.orchestra.run.smithi101.stdout: { 2023-08-01T19:54:24.920 INFO:teuthology.orchestra.run.smithi101.stdout: "event": "header_read", 2023-08-01T19:54:24.920 INFO:teuthology.orchestra.run.smithi101.stdout: "time": "2023-08-01T19:54:04.458927+0000", 2023-08-01T19:54:24.920 INFO:teuthology.orchestra.run.smithi101.stdout: "duration": 4294967295.9999995 2023-08-01T19:54:24.920 INFO:teuthology.orchestra.run.smithi101.stdout: }, 2023-08-01T19:54:24.921 INFO:teuthology.orchestra.run.smithi101.stdout: { 2023-08-01T19:54:24.921 INFO:teuthology.orchestra.run.smithi101.stdout: "event": "all_read", 2023-08-01T19:54:24.921 INFO:teuthology.orchestra.run.smithi101.stdout: "time": "2023-08-01T19:54:04.458931+0000", 2023-08-01T19:54:24.921 INFO:teuthology.orchestra.run.smithi101.stdout: "duration": 4.3000000000000003e-06 2023-08-01T19:54:24.921 INFO:teuthology.orchestra.run.smithi101.stdout: }, 2023-08-01T19:54:24.921 INFO:teuthology.orchestra.run.smithi101.stdout: { 2023-08-01T19:54:24.921 INFO:teuthology.orchestra.run.smithi101.stdout: "event": "dispatched", 2023-08-01T19:54:24.921 INFO:teuthology.orchestra.run.smithi101.stdout: "time": "2023-08-01T19:54:04.458938+0000", 2023-08-01T19:54:24.922 INFO:teuthology.orchestra.run.smithi101.stdout: "duration": 7.3220000000000004e-06 2023-08-01T19:54:24.922 INFO:teuthology.orchestra.run.smithi101.stdout: }, 2023-08-01T19:54:24.922 INFO:teuthology.orchestra.run.smithi101.stdout: { 2023-08-01T19:54:24.922 INFO:teuthology.orchestra.run.smithi101.stdout: "event": "queued_for_pg", 2023-08-01T19:54:24.922 INFO:teuthology.orchestra.run.smithi101.stdout: "time": "2023-08-01T19:54:04.458944+0000", 2023-08-01T19:54:24.922 INFO:teuthology.orchestra.run.smithi101.stdout: "duration": 5.3040000000000004e-06 2023-08-01T19:54:24.922 INFO:teuthology.orchestra.run.smithi101.stdout: }, 2023-08-01T19:54:24.922 INFO:teuthology.orchestra.run.smithi101.stdout: { 2023-08-01T19:54:24.923 INFO:teuthology.orchestra.run.smithi101.stdout: "event": "reached_pg", 2023-08-01T19:54:24.923 INFO:teuthology.orchestra.run.smithi101.stdout: "time": "2023-08-01T19:54:04.459006+0000", 2023-08-01T19:54:24.923 INFO:teuthology.orchestra.run.smithi101.stdout: "duration": 6.2081000000000004e-05 2023-08-01T19:54:24.923 INFO:teuthology.orchestra.run.smithi101.stdout: }, 2023-08-01T19:54:24.923 INFO:teuthology.orchestra.run.smithi101.stdout: { 2023-08-01T19:54:24.923 INFO:teuthology.orchestra.run.smithi101.stdout: "event": "waiting_for_map not empty", 2023-08-01T19:54:24.923 INFO:teuthology.orchestra.run.smithi101.stdout: "time": "2023-08-01T19:54:04.459008+0000", 2023-08-01T19:54:24.923 INFO:teuthology.orchestra.run.smithi101.stdout: "duration": 2.2500000000000001e-06 2023-08-01T19:54:24.924 INFO:teuthology.orchestra.run.smithi101.stdout: }, 2023-08-01T19:54:24.924 INFO:teuthology.orchestra.run.smithi101.stdout: { 2023-08-01T19:54:24.924 INFO:teuthology.orchestra.run.smithi101.stdout: "event": "reached_pg", 2023-08-01T19:54:24.924 INFO:teuthology.orchestra.run.smithi101.stdout: "time": "2023-08-01T19:54:04.470946+0000", 2023-08-01T19:54:24.924 INFO:teuthology.orchestra.run.smithi101.stdout: "duration": 0.011938347 2023-08-01T19:54:24.924 INFO:teuthology.orchestra.run.smithi101.stdout: }, 2023-08-01T19:54:24.924 INFO:teuthology.orchestra.run.smithi101.stdout: { 2023-08-01T19:54:24.925 INFO:teuthology.orchestra.run.smithi101.stdout: "event": "started", 2023-08-01T19:54:24.925 INFO:teuthology.orchestra.run.smithi101.stdout: "time": "2023-08-01T19:54:04.471071+0000", 2023-08-01T19:54:24.925 INFO:teuthology.orchestra.run.smithi101.stdout: "duration": 0.00012470299999999999 2023-08-01T19:54:24.925 INFO:teuthology.orchestra.run.smithi101.stdout: }, 2023-08-01T19:54:24.925 INFO:teuthology.orchestra.run.smithi101.stdout: { 2023-08-01T19:54:24.925 INFO:teuthology.orchestra.run.smithi101.stdout: "event": "waiting for subops from 2", 2023-08-01T19:54:24.925 INFO:teuthology.orchestra.run.smithi101.stdout: "time": "2023-08-01T19:54:04.471205+0000", 2023-08-01T19:54:24.925 INFO:teuthology.orchestra.run.smithi101.stdout: "duration": 0.000133891 2023-08-01T19:54:24.926 INFO:teuthology.orchestra.run.smithi101.stdout: }, 2023-08-01T19:54:24.926 INFO:teuthology.orchestra.run.smithi101.stdout: { 2023-08-01T19:54:24.926 INFO:teuthology.orchestra.run.smithi101.stdout: "event": "op_commit", 2023-08-01T19:54:24.926 INFO:teuthology.orchestra.run.smithi101.stdout: "time": "2023-08-01T19:54:04.477042+0000", 2023-08-01T19:54:24.926 INFO:teuthology.orchestra.run.smithi101.stdout: "duration": 0.0058374849999999999 2023-08-01T19:54:24.926 INFO:teuthology.orchestra.run.smithi101.stdout: }, 2023-08-01T19:54:24.926 INFO:teuthology.orchestra.run.smithi101.stdout: { 2023-08-01T19:54:24.926 INFO:teuthology.orchestra.run.smithi101.stdout: "event": "sub_op_commit_rec", 2023-08-01T19:54:24.927 INFO:teuthology.orchestra.run.smithi101.stdout: "time": "2023-08-01T19:54:04.478445+0000", 2023-08-01T19:54:24.927 INFO:teuthology.orchestra.run.smithi101.stdout: "duration": 0.0014023239999999999 2023-08-01T19:54:24.927 INFO:teuthology.orchestra.run.smithi101.stdout: }, 2023-08-01T19:54:24.927 INFO:teuthology.orchestra.run.smithi101.stdout: { 2023-08-01T19:54:24.927 INFO:teuthology.orchestra.run.smithi101.stdout: "event": "commit_sent", 2023-08-01T19:54:24.927 INFO:teuthology.orchestra.run.smithi101.stdout: "time": "2023-08-01T19:54:04.478478+0000", 2023-08-01T19:54:24.927 INFO:teuthology.orchestra.run.smithi101.stdout: "duration": 3.3503000000000001e-05 2023-08-01T19:54:24.928 INFO:teuthology.orchestra.run.smithi101.stdout: }, 2023-08-01T19:54:24.928 INFO:teuthology.orchestra.run.smithi101.stdout: { 2023-08-01T19:54:24.928 INFO:teuthology.orchestra.run.smithi101.stdout: "event": "done", 2023-08-01T19:54:24.928 INFO:teuthology.orchestra.run.smithi101.stdout: "time": "2023-08-01T19:54:04.478502+0000", 2023-08-01T19:54:24.928 INFO:teuthology.orchestra.run.smithi101.stdout: "duration": 2.3402000000000001e-05 2023-08-01T19:54:24.928 INFO:teuthology.orchestra.run.smithi101.stdout: } 2023-08-01T19:54:24.928 INFO:teuthology.orchestra.run.smithi101.stdout: ] 2023-08-01T19:54:24.928 INFO:teuthology.orchestra.run.smithi101.stdout: } 2023-08-01T19:54:24.929 INFO:teuthology.orchestra.run.smithi101.stdout: }, 2023-08-01T19:54:24.929 INFO:teuthology.orchestra.run.smithi101.stdout: { 2023-08-01T19:54:24.929 INFO:teuthology.orchestra.run.smithi101.stdout: "description": "osd_op(mds.0.3:11 3.10 3:0bd6d154:::602.00000000:head [create,setxattr parent (62) in=6b,setxattr layout (30) in=6b] snapc 0=[] ondisk+write+known_if_redirected+full_force+supports_pool_eio e17)", 2023-08-01T19:54:24.929 INFO:teuthology.orchestra.run.smithi101.stdout: "initiated_at": "2023-08-01T19:54:04.458960+0000", 2023-08-01T19:54:24.929 INFO:teuthology.orchestra.run.smithi101.stdout: "age": 20.396621284999998, 2023-08-01T19:54:24.929 INFO:teuthology.orchestra.run.smithi101.stdout: "duration": 0.019645459000000001, 2023-08-01T19:54:24.929 INFO:teuthology.orchestra.run.smithi101.stdout: "type_data": { 2023-08-01T19:54:24.929 INFO:teuthology.orchestra.run.smithi101.stdout: "flag_point": "commit sent; apply or cleanup", 2023-08-01T19:54:24.930 INFO:teuthology.orchestra.run.smithi101.stdout: "events": [ 2023-08-01T19:54:24.930 INFO:teuthology.orchestra.run.smithi101.stdout: { 2023-08-01T19:54:24.930 INFO:teuthology.orchestra.run.smithi101.stdout: "event": "initiated", 2023-08-01T19:54:24.930 INFO:teuthology.orchestra.run.smithi101.stdout: "time": "2023-08-01T19:54:04.458960+0000", 2023-08-01T19:54:24.930 INFO:teuthology.orchestra.run.smithi101.stdout: "duration": 0 2023-08-01T19:54:24.930 INFO:teuthology.orchestra.run.smithi101.stdout: }, 2023-08-01T19:54:24.930 INFO:teuthology.orchestra.run.smithi101.stdout: { 2023-08-01T19:54:24.930 INFO:teuthology.orchestra.run.smithi101.stdout: "event": "throttled", 2023-08-01T19:54:24.931 INFO:teuthology.orchestra.run.smithi101.stdout: "time": "2023-08-01T19:54:04.458960+0000", 2023-08-01T19:54:24.931 INFO:teuthology.orchestra.run.smithi101.stdout: "duration": 0 2023-08-01T19:54:24.931 INFO:teuthology.orchestra.run.smithi101.stdout: }, 2023-08-01T19:54:24.931 INFO:teuthology.orchestra.run.smithi101.stdout: { 2023-08-01T19:54:24.931 INFO:teuthology.orchestra.run.smithi101.stdout: "event": "header_read", 2023-08-01T19:54:24.931 INFO:teuthology.orchestra.run.smithi101.stdout: "time": "2023-08-01T19:54:04.458959+0000", 2023-08-01T19:54:24.931 INFO:teuthology.orchestra.run.smithi101.stdout: "duration": 4294967295.9999995 2023-08-01T19:54:24.932 INFO:teuthology.orchestra.run.smithi101.stdout: }, 2023-08-01T19:54:24.932 INFO:teuthology.orchestra.run.smithi101.stdout: { 2023-08-01T19:54:24.932 INFO:teuthology.orchestra.run.smithi101.stdout: "event": "all_read", 2023-08-01T19:54:24.932 INFO:teuthology.orchestra.run.smithi101.stdout: "time": "2023-08-01T19:54:04.458963+0000", 2023-08-01T19:54:24.932 INFO:teuthology.orchestra.run.smithi101.stdout: "duration": 3.9199999999999997e-06 2023-08-01T19:54:24.932 INFO:teuthology.orchestra.run.smithi101.stdout: }, 2023-08-01T19:54:24.932 INFO:teuthology.orchestra.run.smithi101.stdout: { 2023-08-01T19:54:24.932 INFO:teuthology.orchestra.run.smithi101.stdout: "event": "dispatched", 2023-08-01T19:54:24.933 INFO:teuthology.orchestra.run.smithi101.stdout: "time": "2023-08-01T19:54:04.458970+0000", 2023-08-01T19:54:24.933 INFO:teuthology.orchestra.run.smithi101.stdout: "duration": 7.0439999999999998e-06 2023-08-01T19:54:24.933 INFO:teuthology.orchestra.run.smithi101.stdout: }, 2023-08-01T19:54:24.933 INFO:teuthology.orchestra.run.smithi101.stdout: { 2023-08-01T19:54:24.933 INFO:teuthology.orchestra.run.smithi101.stdout: "event": "queued_for_pg", 2023-08-01T19:54:24.933 INFO:teuthology.orchestra.run.smithi101.stdout: "time": "2023-08-01T19:54:04.458976+0000", 2023-08-01T19:54:24.933 INFO:teuthology.orchestra.run.smithi101.stdout: "duration": 5.9540000000000001e-06 2023-08-01T19:54:24.933 INFO:teuthology.orchestra.run.smithi101.stdout: }, 2023-08-01T19:54:24.934 INFO:teuthology.orchestra.run.smithi101.stdout: { 2023-08-01T19:54:24.934 INFO:teuthology.orchestra.run.smithi101.stdout: "event": "reached_pg", 2023-08-01T19:54:24.934 INFO:teuthology.orchestra.run.smithi101.stdout: "time": "2023-08-01T19:54:04.459035+0000", 2023-08-01T19:54:24.934 INFO:teuthology.orchestra.run.smithi101.stdout: "duration": 5.8924e-05 2023-08-01T19:54:24.934 INFO:teuthology.orchestra.run.smithi101.stdout: }, 2023-08-01T19:54:24.934 INFO:teuthology.orchestra.run.smithi101.stdout: { 2023-08-01T19:54:24.934 INFO:teuthology.orchestra.run.smithi101.stdout: "event": "waiting_for_map not empty", 2023-08-01T19:54:24.934 INFO:teuthology.orchestra.run.smithi101.stdout: "time": "2023-08-01T19:54:04.459038+0000", 2023-08-01T19:54:24.935 INFO:teuthology.orchestra.run.smithi101.stdout: "duration": 3.2760000000000001e-06 2023-08-01T19:54:24.935 INFO:teuthology.orchestra.run.smithi101.stdout: }, 2023-08-01T19:54:24.935 INFO:teuthology.orchestra.run.smithi101.stdout: { 2023-08-01T19:54:24.935 INFO:teuthology.orchestra.run.smithi101.stdout: "event": "reached_pg", 2023-08-01T19:54:24.935 INFO:teuthology.orchestra.run.smithi101.stdout: "time": "2023-08-01T19:54:04.471511+0000", 2023-08-01T19:54:24.935 INFO:teuthology.orchestra.run.smithi101.stdout: "duration": 0.012473039999999999 2023-08-01T19:54:24.935 INFO:teuthology.orchestra.run.smithi101.stdout: }, 2023-08-01T19:54:24.936 INFO:teuthology.orchestra.run.smithi101.stdout: { 2023-08-01T19:54:24.936 INFO:teuthology.orchestra.run.smithi101.stdout: "event": "started", 2023-08-01T19:54:24.936 INFO:teuthology.orchestra.run.smithi101.stdout: "time": "2023-08-01T19:54:04.472086+0000", 2023-08-01T19:54:24.936 INFO:teuthology.orchestra.run.smithi101.stdout: "duration": 0.00057491699999999998 2023-08-01T19:54:24.936 INFO:teuthology.orchestra.run.smithi101.stdout: }, 2023-08-01T19:54:24.936 INFO:teuthology.orchestra.run.smithi101.stdout: { 2023-08-01T19:54:24.936 INFO:teuthology.orchestra.run.smithi101.stdout: "event": "waiting for subops from 2", 2023-08-01T19:54:24.936 INFO:teuthology.orchestra.run.smithi101.stdout: "time": "2023-08-01T19:54:04.472310+0000", 2023-08-01T19:54:24.937 INFO:teuthology.orchestra.run.smithi101.stdout: "duration": 0.00022396499999999999 2023-08-01T19:54:24.937 INFO:teuthology.orchestra.run.smithi101.stdout: }, 2023-08-01T19:54:24.937 INFO:teuthology.orchestra.run.smithi101.stdout: { 2023-08-01T19:54:24.937 INFO:teuthology.orchestra.run.smithi101.stdout: "event": "op_commit", 2023-08-01T19:54:24.937 INFO:teuthology.orchestra.run.smithi101.stdout: "time": "2023-08-01T19:54:04.478141+0000", 2023-08-01T19:54:24.937 INFO:teuthology.orchestra.run.smithi101.stdout: "duration": 0.0058312320000000004 2023-08-01T19:54:24.937 INFO:teuthology.orchestra.run.smithi101.stdout: }, 2023-08-01T19:54:24.937 INFO:teuthology.orchestra.run.smithi101.stdout: { 2023-08-01T19:54:24.938 INFO:teuthology.orchestra.run.smithi101.stdout: "event": "sub_op_commit_rec", 2023-08-01T19:54:24.938 INFO:teuthology.orchestra.run.smithi101.stdout: "time": "2023-08-01T19:54:04.478543+0000", 2023-08-01T19:54:24.938 INFO:teuthology.orchestra.run.smithi101.stdout: "duration": 0.00040160800000000002 2023-08-01T19:54:24.938 INFO:teuthology.orchestra.run.smithi101.stdout: }, 2023-08-01T19:54:24.938 INFO:teuthology.orchestra.run.smithi101.stdout: { 2023-08-01T19:54:24.938 INFO:teuthology.orchestra.run.smithi101.stdout: "event": "commit_sent", 2023-08-01T19:54:24.938 INFO:teuthology.orchestra.run.smithi101.stdout: "time": "2023-08-01T19:54:04.478584+0000", 2023-08-01T19:54:24.938 INFO:teuthology.orchestra.run.smithi101.stdout: "duration": 4.0989999999999999e-05 2023-08-01T19:54:24.939 INFO:teuthology.orchestra.run.smithi101.stdout: }, 2023-08-01T19:54:24.939 INFO:teuthology.orchestra.run.smithi101.stdout: { 2023-08-01T19:54:24.939 INFO:teuthology.orchestra.run.smithi101.stdout: "event": "done", 2023-08-01T19:54:24.939 INFO:teuthology.orchestra.run.smithi101.stdout: "time": "2023-08-01T19:54:04.478605+0000", 2023-08-01T19:54:24.939 INFO:teuthology.orchestra.run.smithi101.stdout: "duration": 2.1178e-05 2023-08-01T19:54:24.939 INFO:teuthology.orchestra.run.smithi101.stdout: } 2023-08-01T19:54:24.939 INFO:teuthology.orchestra.run.smithi101.stdout: ] 2023-08-01T19:54:24.940 INFO:teuthology.orchestra.run.smithi101.stdout: } 2023-08-01T19:54:24.940 INFO:teuthology.orchestra.run.smithi101.stdout: }, 2023-08-01T19:54:24.940 INFO:teuthology.orchestra.run.smithi101.stdout: { 2023-08-01T19:54:24.940 INFO:teuthology.orchestra.run.smithi101.stdout: "description": "osd_op(mds.0.3:12 3.10 3:0d89b25e:::603.00000000:head [omap-set-header] snapc 0=[] ondisk+write+known_if_redirected+full_force+supports_pool_eio e17)", 2023-08-01T19:54:24.940 INFO:teuthology.orchestra.run.smithi101.stdout: "initiated_at": "2023-08-01T19:54:04.458982+0000", 2023-08-01T19:54:24.940 INFO:teuthology.orchestra.run.smithi101.stdout: "age": 20.396599057, 2023-08-01T19:54:24.940 INFO:teuthology.orchestra.run.smithi101.stdout: "duration": 0.021266334000000001, 2023-08-01T19:54:24.940 INFO:teuthology.orchestra.run.smithi101.stdout: "type_data": { 2023-08-01T19:54:24.941 INFO:teuthology.orchestra.run.smithi101.stdout: "flag_point": "commit sent; apply or cleanup", 2023-08-01T19:54:24.941 INFO:teuthology.orchestra.run.smithi101.stdout: "events": [ 2023-08-01T19:54:24.941 INFO:teuthology.orchestra.run.smithi101.stdout: { 2023-08-01T19:54:24.941 INFO:teuthology.orchestra.run.smithi101.stdout: "event": "initiated", 2023-08-01T19:54:24.941 INFO:teuthology.orchestra.run.smithi101.stdout: "time": "2023-08-01T19:54:04.458982+0000", 2023-08-01T19:54:24.941 INFO:teuthology.orchestra.run.smithi101.stdout: "duration": 0 2023-08-01T19:54:24.941 INFO:teuthology.orchestra.run.smithi101.stdout: }, 2023-08-01T19:54:24.941 INFO:teuthology.orchestra.run.smithi101.stdout: { 2023-08-01T19:54:24.942 INFO:teuthology.orchestra.run.smithi101.stdout: "event": "throttled", 2023-08-01T19:54:24.942 INFO:teuthology.orchestra.run.smithi101.stdout: "time": "2023-08-01T19:54:04.458982+0000", 2023-08-01T19:54:24.942 INFO:teuthology.orchestra.run.smithi101.stdout: "duration": 0 2023-08-01T19:54:24.942 INFO:teuthology.orchestra.run.smithi101.stdout: }, 2023-08-01T19:54:24.942 INFO:teuthology.orchestra.run.smithi101.stdout: { 2023-08-01T19:54:24.942 INFO:teuthology.orchestra.run.smithi101.stdout: "event": "header_read", 2023-08-01T19:54:24.942 INFO:teuthology.orchestra.run.smithi101.stdout: "time": "2023-08-01T19:54:04.458982+0000", 2023-08-01T19:54:24.942 INFO:teuthology.orchestra.run.smithi101.stdout: "duration": 4294967295.9999995 2023-08-01T19:54:24.943 INFO:teuthology.orchestra.run.smithi101.stdout: }, 2023-08-01T19:54:24.943 INFO:teuthology.orchestra.run.smithi101.stdout: { 2023-08-01T19:54:24.943 INFO:teuthology.orchestra.run.smithi101.stdout: "event": "all_read", 2023-08-01T19:54:24.943 INFO:teuthology.orchestra.run.smithi101.stdout: "time": "2023-08-01T19:54:04.458985+0000", 2023-08-01T19:54:24.943 INFO:teuthology.orchestra.run.smithi101.stdout: "duration": 3.4800000000000001e-06 2023-08-01T19:54:24.943 INFO:teuthology.orchestra.run.smithi101.stdout: }, 2023-08-01T19:54:24.943 INFO:teuthology.orchestra.run.smithi101.stdout: { 2023-08-01T19:54:24.944 INFO:teuthology.orchestra.run.smithi101.stdout: "event": "dispatched", 2023-08-01T19:54:24.944 INFO:teuthology.orchestra.run.smithi101.stdout: "time": "2023-08-01T19:54:04.458992+0000", 2023-08-01T19:54:24.944 INFO:teuthology.orchestra.run.smithi101.stdout: "duration": 7.306e-06 2023-08-01T19:54:24.944 INFO:teuthology.orchestra.run.smithi101.stdout: }, 2023-08-01T19:54:24.944 INFO:teuthology.orchestra.run.smithi101.stdout: { 2023-08-01T19:54:24.944 INFO:teuthology.orchestra.run.smithi101.stdout: "event": "queued_for_pg", 2023-08-01T19:54:24.944 INFO:teuthology.orchestra.run.smithi101.stdout: "time": "2023-08-01T19:54:04.458997+0000", 2023-08-01T19:54:24.944 INFO:teuthology.orchestra.run.smithi101.stdout: "duration": 4.4530000000000004e-06 2023-08-01T19:54:24.945 INFO:teuthology.orchestra.run.smithi101.stdout: }, 2023-08-01T19:54:24.945 INFO:teuthology.orchestra.run.smithi101.stdout: { 2023-08-01T19:54:24.945 INFO:teuthology.orchestra.run.smithi101.stdout: "event": "reached_pg", 2023-08-01T19:54:24.945 INFO:teuthology.orchestra.run.smithi101.stdout: "time": "2023-08-01T19:54:04.459060+0000", 2023-08-01T19:54:24.945 INFO:teuthology.orchestra.run.smithi101.stdout: "duration": 6.3249000000000004e-05 2023-08-01T19:54:24.945 INFO:teuthology.orchestra.run.smithi101.stdout: }, 2023-08-01T19:54:24.945 INFO:teuthology.orchestra.run.smithi101.stdout: { 2023-08-01T19:54:24.945 INFO:teuthology.orchestra.run.smithi101.stdout: "event": "waiting_for_map not empty", 2023-08-01T19:54:24.946 INFO:teuthology.orchestra.run.smithi101.stdout: "time": "2023-08-01T19:54:04.459063+0000", 2023-08-01T19:54:24.946 INFO:teuthology.orchestra.run.smithi101.stdout: "duration": 2.717e-06 2023-08-01T19:54:24.946 INFO:teuthology.orchestra.run.smithi101.stdout: }, 2023-08-01T19:54:24.946 INFO:teuthology.orchestra.run.smithi101.stdout: { 2023-08-01T19:54:24.946 INFO:teuthology.orchestra.run.smithi101.stdout: "event": "reached_pg", 2023-08-01T19:54:24.946 INFO:teuthology.orchestra.run.smithi101.stdout: "time": "2023-08-01T19:54:04.473625+0000", 2023-08-01T19:54:24.946 INFO:teuthology.orchestra.run.smithi101.stdout: "duration": 0.014562007 2023-08-01T19:54:24.946 INFO:teuthology.orchestra.run.smithi101.stdout: }, 2023-08-01T19:54:24.947 INFO:teuthology.orchestra.run.smithi101.stdout: { 2023-08-01T19:54:24.947 INFO:teuthology.orchestra.run.smithi101.stdout: "event": "started", 2023-08-01T19:54:24.947 INFO:teuthology.orchestra.run.smithi101.stdout: "time": "2023-08-01T19:54:04.473757+0000", 2023-08-01T19:54:24.947 INFO:teuthology.orchestra.run.smithi101.stdout: "duration": 0.00013238599999999999 2023-08-01T19:54:24.947 INFO:teuthology.orchestra.run.smithi101.stdout: }, 2023-08-01T19:54:24.947 INFO:teuthology.orchestra.run.smithi101.stdout: { 2023-08-01T19:54:24.947 INFO:teuthology.orchestra.run.smithi101.stdout: "event": "waiting for subops from 2", 2023-08-01T19:54:24.948 INFO:teuthology.orchestra.run.smithi101.stdout: "time": "2023-08-01T19:54:04.473898+0000", 2023-08-01T19:54:24.948 INFO:teuthology.orchestra.run.smithi101.stdout: "duration": 0.00014039 2023-08-01T19:54:24.948 INFO:teuthology.orchestra.run.smithi101.stdout: }, 2023-08-01T19:54:24.948 INFO:teuthology.orchestra.run.smithi101.stdout: { 2023-08-01T19:54:24.948 INFO:teuthology.orchestra.run.smithi101.stdout: "event": "op_commit", 2023-08-01T19:54:24.948 INFO:teuthology.orchestra.run.smithi101.stdout: "time": "2023-08-01T19:54:04.478380+0000", 2023-08-01T19:54:24.948 INFO:teuthology.orchestra.run.smithi101.stdout: "duration": 0.0044827449999999998 2023-08-01T19:54:24.948 INFO:teuthology.orchestra.run.smithi101.stdout: }, 2023-08-01T19:54:24.949 INFO:teuthology.orchestra.run.smithi101.stdout: { 2023-08-01T19:54:24.949 INFO:teuthology.orchestra.run.smithi101.stdout: "event": "sub_op_commit_rec", 2023-08-01T19:54:24.949 INFO:teuthology.orchestra.run.smithi101.stdout: "time": "2023-08-01T19:54:04.480169+0000", 2023-08-01T19:54:24.949 INFO:teuthology.orchestra.run.smithi101.stdout: "duration": 0.0017886040000000001 2023-08-01T19:54:24.949 INFO:teuthology.orchestra.run.smithi101.stdout: }, 2023-08-01T19:54:24.949 INFO:teuthology.orchestra.run.smithi101.stdout: { 2023-08-01T19:54:24.949 INFO:teuthology.orchestra.run.smithi101.stdout: "event": "commit_sent", 2023-08-01T19:54:24.949 INFO:teuthology.orchestra.run.smithi101.stdout: "time": "2023-08-01T19:54:04.480212+0000", 2023-08-01T19:54:24.950 INFO:teuthology.orchestra.run.smithi101.stdout: "duration": 4.2687e-05 2023-08-01T19:54:24.950 INFO:teuthology.orchestra.run.smithi101.stdout: }, 2023-08-01T19:54:24.950 INFO:teuthology.orchestra.run.smithi101.stdout: { 2023-08-01T19:54:24.950 INFO:teuthology.orchestra.run.smithi101.stdout: "event": "done", 2023-08-01T19:54:24.950 INFO:teuthology.orchestra.run.smithi101.stdout: "time": "2023-08-01T19:54:04.480248+0000", 2023-08-01T19:54:24.950 INFO:teuthology.orchestra.run.smithi101.stdout: "duration": 3.6743999999999999e-05 2023-08-01T19:54:24.950 INFO:teuthology.orchestra.run.smithi101.stdout: } 2023-08-01T19:54:24.950 INFO:teuthology.orchestra.run.smithi101.stdout: ] 2023-08-01T19:54:24.951 INFO:teuthology.orchestra.run.smithi101.stdout: } 2023-08-01T19:54:24.951 INFO:teuthology.orchestra.run.smithi101.stdout: }, 2023-08-01T19:54:24.951 INFO:teuthology.orchestra.run.smithi101.stdout: { 2023-08-01T19:54:24.951 INFO:teuthology.orchestra.run.smithi101.stdout: "description": "osd_op(mds.0.3:13 3.10 3:0d89b25e:::603.00000000:head [create,setxattr parent (62) in=6b,setxattr layout (30) in=6b] snapc 0=[] ondisk+write+known_if_redirected+full_force+supports_pool_eio e17)", 2023-08-01T19:54:24.951 INFO:teuthology.orchestra.run.smithi101.stdout: "initiated_at": "2023-08-01T19:54:04.459010+0000", 2023-08-01T19:54:24.951 INFO:teuthology.orchestra.run.smithi101.stdout: "age": 20.396571337000001, 2023-08-01T19:54:24.951 INFO:teuthology.orchestra.run.smithi101.stdout: "duration": 0.021327220000000001, 2023-08-01T19:54:24.952 INFO:teuthology.orchestra.run.smithi101.stdout: "type_data": { 2023-08-01T19:54:24.952 INFO:teuthology.orchestra.run.smithi101.stdout: "flag_point": "commit sent; apply or cleanup", 2023-08-01T19:54:24.952 INFO:teuthology.orchestra.run.smithi101.stdout: "events": [ 2023-08-01T19:54:24.952 INFO:teuthology.orchestra.run.smithi101.stdout: { 2023-08-01T19:54:24.952 INFO:teuthology.orchestra.run.smithi101.stdout: "event": "initiated", 2023-08-01T19:54:24.952 INFO:teuthology.orchestra.run.smithi101.stdout: "time": "2023-08-01T19:54:04.459010+0000", 2023-08-01T19:54:24.952 INFO:teuthology.orchestra.run.smithi101.stdout: "duration": 0 2023-08-01T19:54:24.952 INFO:teuthology.orchestra.run.smithi101.stdout: }, 2023-08-01T19:54:24.953 INFO:teuthology.orchestra.run.smithi101.stdout: { 2023-08-01T19:54:24.953 INFO:teuthology.orchestra.run.smithi101.stdout: "event": "throttled", 2023-08-01T19:54:24.953 INFO:teuthology.orchestra.run.smithi101.stdout: "time": "2023-08-01T19:54:04.459010+0000", 2023-08-01T19:54:24.953 INFO:teuthology.orchestra.run.smithi101.stdout: "duration": 0 2023-08-01T19:54:24.953 INFO:teuthology.orchestra.run.smithi101.stdout: }, 2023-08-01T19:54:24.953 INFO:teuthology.orchestra.run.smithi101.stdout: { 2023-08-01T19:54:24.953 INFO:teuthology.orchestra.run.smithi101.stdout: "event": "header_read", 2023-08-01T19:54:24.953 INFO:teuthology.orchestra.run.smithi101.stdout: "time": "2023-08-01T19:54:04.459009+0000", 2023-08-01T19:54:24.954 INFO:teuthology.orchestra.run.smithi101.stdout: "duration": 4294967295.9999995 2023-08-01T19:54:24.954 INFO:teuthology.orchestra.run.smithi101.stdout: }, 2023-08-01T19:54:24.954 INFO:teuthology.orchestra.run.smithi101.stdout: { 2023-08-01T19:54:24.954 INFO:teuthology.orchestra.run.smithi101.stdout: "event": "all_read", 2023-08-01T19:54:24.954 INFO:teuthology.orchestra.run.smithi101.stdout: "time": "2023-08-01T19:54:04.459013+0000", 2023-08-01T19:54:24.954 INFO:teuthology.orchestra.run.smithi101.stdout: "duration": 3.8929999999999998e-06 2023-08-01T19:54:24.954 INFO:teuthology.orchestra.run.smithi101.stdout: }, 2023-08-01T19:54:24.954 INFO:teuthology.orchestra.run.smithi101.stdout: { 2023-08-01T19:54:24.955 INFO:teuthology.orchestra.run.smithi101.stdout: "event": "dispatched", 2023-08-01T19:54:24.955 INFO:teuthology.orchestra.run.smithi101.stdout: "time": "2023-08-01T19:54:04.459027+0000", 2023-08-01T19:54:24.955 INFO:teuthology.orchestra.run.smithi101.stdout: "duration": 1.3416e-05 2023-08-01T19:54:24.955 INFO:teuthology.orchestra.run.smithi101.stdout: }, 2023-08-01T19:54:24.955 INFO:teuthology.orchestra.run.smithi101.stdout: { 2023-08-01T19:54:24.955 INFO:teuthology.orchestra.run.smithi101.stdout: "event": "queued_for_pg", 2023-08-01T19:54:24.955 INFO:teuthology.orchestra.run.smithi101.stdout: "time": "2023-08-01T19:54:04.459033+0000", 2023-08-01T19:54:24.955 INFO:teuthology.orchestra.run.smithi101.stdout: "duration": 5.9800000000000003e-06 2023-08-01T19:54:24.956 INFO:teuthology.orchestra.run.smithi101.stdout: }, 2023-08-01T19:54:24.956 INFO:teuthology.orchestra.run.smithi101.stdout: { 2023-08-01T19:54:24.956 INFO:teuthology.orchestra.run.smithi101.stdout: "event": "reached_pg", 2023-08-01T19:54:24.956 INFO:teuthology.orchestra.run.smithi101.stdout: "time": "2023-08-01T19:54:04.459099+0000", 2023-08-01T19:54:24.956 INFO:teuthology.orchestra.run.smithi101.stdout: "duration": 6.6192999999999995e-05 2023-08-01T19:54:24.956 INFO:teuthology.orchestra.run.smithi101.stdout: }, 2023-08-01T19:54:24.956 INFO:teuthology.orchestra.run.smithi101.stdout: { 2023-08-01T19:54:24.957 INFO:teuthology.orchestra.run.smithi101.stdout: "event": "waiting_for_map not empty", 2023-08-01T19:54:24.957 INFO:teuthology.orchestra.run.smithi101.stdout: "time": "2023-08-01T19:54:04.459106+0000", 2023-08-01T19:54:24.957 INFO:teuthology.orchestra.run.smithi101.stdout: "duration": 6.8619999999999997e-06 2023-08-01T19:54:24.957 INFO:teuthology.orchestra.run.smithi101.stdout: }, 2023-08-01T19:54:24.957 INFO:teuthology.orchestra.run.smithi101.stdout: { 2023-08-01T19:54:24.957 INFO:teuthology.orchestra.run.smithi101.stdout: "event": "reached_pg", 2023-08-01T19:54:24.957 INFO:teuthology.orchestra.run.smithi101.stdout: "time": "2023-08-01T19:54:04.475182+0000", 2023-08-01T19:54:24.957 INFO:teuthology.orchestra.run.smithi101.stdout: "duration": 0.016076333000000002 2023-08-01T19:54:24.958 INFO:teuthology.orchestra.run.smithi101.stdout: }, 2023-08-01T19:54:24.958 INFO:teuthology.orchestra.run.smithi101.stdout: { 2023-08-01T19:54:24.958 INFO:teuthology.orchestra.run.smithi101.stdout: "event": "started", 2023-08-01T19:54:24.958 INFO:teuthology.orchestra.run.smithi101.stdout: "time": "2023-08-01T19:54:04.475353+0000", 2023-08-01T19:54:24.958 INFO:teuthology.orchestra.run.smithi101.stdout: "duration": 0.000171378 2023-08-01T19:54:24.958 INFO:teuthology.orchestra.run.smithi101.stdout: }, 2023-08-01T19:54:24.958 INFO:teuthology.orchestra.run.smithi101.stdout: { 2023-08-01T19:54:24.958 INFO:teuthology.orchestra.run.smithi101.stdout: "event": "waiting for subops from 2", 2023-08-01T19:54:24.959 INFO:teuthology.orchestra.run.smithi101.stdout: "time": "2023-08-01T19:54:04.475793+0000", 2023-08-01T19:54:24.959 INFO:teuthology.orchestra.run.smithi101.stdout: "duration": 0.000440123 2023-08-01T19:54:24.959 INFO:teuthology.orchestra.run.smithi101.stdout: }, 2023-08-01T19:54:24.959 INFO:teuthology.orchestra.run.smithi101.stdout: { 2023-08-01T19:54:24.959 INFO:teuthology.orchestra.run.smithi101.stdout: "event": "op_commit", 2023-08-01T19:54:24.959 INFO:teuthology.orchestra.run.smithi101.stdout: "time": "2023-08-01T19:54:04.478624+0000", 2023-08-01T19:54:24.959 INFO:teuthology.orchestra.run.smithi101.stdout: "duration": 0.0028305000000000001 2023-08-01T19:54:24.959 INFO:teuthology.orchestra.run.smithi101.stdout: }, 2023-08-01T19:54:24.960 INFO:teuthology.orchestra.run.smithi101.stdout: { 2023-08-01T19:54:24.960 INFO:teuthology.orchestra.run.smithi101.stdout: "event": "sub_op_commit_rec", 2023-08-01T19:54:24.960 INFO:teuthology.orchestra.run.smithi101.stdout: "time": "2023-08-01T19:54:04.480291+0000", 2023-08-01T19:54:24.960 INFO:teuthology.orchestra.run.smithi101.stdout: "duration": 0.0016670000000000001 2023-08-01T19:54:24.960 INFO:teuthology.orchestra.run.smithi101.stdout: }, 2023-08-01T19:54:24.960 INFO:teuthology.orchestra.run.smithi101.stdout: { 2023-08-01T19:54:24.960 INFO:teuthology.orchestra.run.smithi101.stdout: "event": "commit_sent", 2023-08-01T19:54:24.961 INFO:teuthology.orchestra.run.smithi101.stdout: "time": "2023-08-01T19:54:04.480318+0000", 2023-08-01T19:54:24.961 INFO:teuthology.orchestra.run.smithi101.stdout: "duration": 2.6815e-05 2023-08-01T19:54:24.961 INFO:teuthology.orchestra.run.smithi101.stdout: }, 2023-08-01T19:54:24.961 INFO:teuthology.orchestra.run.smithi101.stdout: { 2023-08-01T19:54:24.961 INFO:teuthology.orchestra.run.smithi101.stdout: "event": "done", 2023-08-01T19:54:24.961 INFO:teuthology.orchestra.run.smithi101.stdout: "time": "2023-08-01T19:54:04.480337+0000", 2023-08-01T19:54:24.961 INFO:teuthology.orchestra.run.smithi101.stdout: "duration": 1.9241000000000001e-05 2023-08-01T19:54:24.961 INFO:teuthology.orchestra.run.smithi101.stdout: } 2023-08-01T19:54:24.962 INFO:teuthology.orchestra.run.smithi101.stdout: ] 2023-08-01T19:54:24.962 INFO:teuthology.orchestra.run.smithi101.stdout: } 2023-08-01T19:54:24.962 INFO:teuthology.orchestra.run.smithi101.stdout: }, 2023-08-01T19:54:24.962 INFO:teuthology.orchestra.run.smithi101.stdout: { 2023-08-01T19:54:24.962 INFO:teuthology.orchestra.run.smithi101.stdout: "description": "osd_op(mds.0.3:18 3.14 3:2f55791f:::606.00000000:head [omap-set-header] snapc 0=[] ondisk+write+known_if_redirected+full_force+supports_pool_eio e17)", 2023-08-01T19:54:24.962 INFO:teuthology.orchestra.run.smithi101.stdout: "initiated_at": "2023-08-01T19:54:04.459039+0000", 2023-08-01T19:54:24.962 INFO:teuthology.orchestra.run.smithi101.stdout: "age": 20.396542043, 2023-08-01T19:54:24.962 INFO:teuthology.orchestra.run.smithi101.stdout: "duration": 0.018756419, 2023-08-01T19:54:24.963 INFO:teuthology.orchestra.run.smithi101.stdout: "type_data": { 2023-08-01T19:54:24.963 INFO:teuthology.orchestra.run.smithi101.stdout: "flag_point": "commit sent; apply or cleanup", 2023-08-01T19:54:24.963 INFO:teuthology.orchestra.run.smithi101.stdout: "events": [ 2023-08-01T19:54:24.963 INFO:teuthology.orchestra.run.smithi101.stdout: { 2023-08-01T19:54:24.963 INFO:teuthology.orchestra.run.smithi101.stdout: "event": "initiated", 2023-08-01T19:54:24.963 INFO:teuthology.orchestra.run.smithi101.stdout: "time": "2023-08-01T19:54:04.459039+0000", 2023-08-01T19:54:24.963 INFO:teuthology.orchestra.run.smithi101.stdout: "duration": 0 2023-08-01T19:54:24.963 INFO:teuthology.orchestra.run.smithi101.stdout: }, 2023-08-01T19:54:24.964 INFO:teuthology.orchestra.run.smithi101.stdout: { 2023-08-01T19:54:24.964 INFO:teuthology.orchestra.run.smithi101.stdout: "event": "throttled", 2023-08-01T19:54:24.964 INFO:teuthology.orchestra.run.smithi101.stdout: "time": "2023-08-01T19:54:04.459039+0000", 2023-08-01T19:54:24.964 INFO:teuthology.orchestra.run.smithi101.stdout: "duration": 0 2023-08-01T19:54:24.964 INFO:teuthology.orchestra.run.smithi101.stdout: }, 2023-08-01T19:54:24.964 INFO:teuthology.orchestra.run.smithi101.stdout: { 2023-08-01T19:54:24.964 INFO:teuthology.orchestra.run.smithi101.stdout: "event": "header_read", 2023-08-01T19:54:24.965 INFO:teuthology.orchestra.run.smithi101.stdout: "time": "2023-08-01T19:54:04.459039+0000", 2023-08-01T19:54:24.965 INFO:teuthology.orchestra.run.smithi101.stdout: "duration": 4294967295.9999995 2023-08-01T19:54:24.965 INFO:teuthology.orchestra.run.smithi101.stdout: }, 2023-08-01T19:54:24.965 INFO:teuthology.orchestra.run.smithi101.stdout: { 2023-08-01T19:54:24.965 INFO:teuthology.orchestra.run.smithi101.stdout: "event": "all_read", 2023-08-01T19:54:24.965 INFO:teuthology.orchestra.run.smithi101.stdout: "time": "2023-08-01T19:54:04.459043+0000", 2023-08-01T19:54:24.965 INFO:teuthology.orchestra.run.smithi101.stdout: "duration": 4.1500000000000001e-06 2023-08-01T19:54:24.965 INFO:teuthology.orchestra.run.smithi101.stdout: }, 2023-08-01T19:54:24.966 INFO:teuthology.orchestra.run.smithi101.stdout: { 2023-08-01T19:54:24.966 INFO:teuthology.orchestra.run.smithi101.stdout: "event": "dispatched", 2023-08-01T19:54:24.966 INFO:teuthology.orchestra.run.smithi101.stdout: "time": "2023-08-01T19:54:04.459051+0000", 2023-08-01T19:54:24.966 INFO:teuthology.orchestra.run.smithi101.stdout: "duration": 8.4190000000000002e-06 2023-08-01T19:54:24.966 INFO:teuthology.orchestra.run.smithi101.stdout: }, 2023-08-01T19:54:24.966 INFO:teuthology.orchestra.run.smithi101.stdout: { 2023-08-01T19:54:24.966 INFO:teuthology.orchestra.run.smithi101.stdout: "event": "queued_for_pg", 2023-08-01T19:54:24.966 INFO:teuthology.orchestra.run.smithi101.stdout: "time": "2023-08-01T19:54:04.459056+0000", 2023-08-01T19:54:24.967 INFO:teuthology.orchestra.run.smithi101.stdout: "duration": 5.339e-06 2023-08-01T19:54:24.967 INFO:teuthology.orchestra.run.smithi101.stdout: }, 2023-08-01T19:54:24.967 INFO:teuthology.orchestra.run.smithi101.stdout: { 2023-08-01T19:54:24.967 INFO:teuthology.orchestra.run.smithi101.stdout: "event": "reached_pg", 2023-08-01T19:54:24.967 INFO:teuthology.orchestra.run.smithi101.stdout: "time": "2023-08-01T19:54:04.459091+0000", 2023-08-01T19:54:24.967 INFO:teuthology.orchestra.run.smithi101.stdout: "duration": 3.4090000000000001e-05 2023-08-01T19:54:24.967 INFO:teuthology.orchestra.run.smithi101.stdout: }, 2023-08-01T19:54:24.967 INFO:teuthology.orchestra.run.smithi101.stdout: { 2023-08-01T19:54:24.968 INFO:teuthology.orchestra.run.smithi101.stdout: "event": "op must wait for map", 2023-08-01T19:54:24.968 INFO:teuthology.orchestra.run.smithi101.stdout: "time": "2023-08-01T19:54:04.459094+0000", 2023-08-01T19:54:24.968 INFO:teuthology.orchestra.run.smithi101.stdout: "duration": 3.303e-06 2023-08-01T19:54:24.968 INFO:teuthology.orchestra.run.smithi101.stdout: }, 2023-08-01T19:54:24.968 INFO:teuthology.orchestra.run.smithi101.stdout: { 2023-08-01T19:54:24.968 INFO:teuthology.orchestra.run.smithi101.stdout: "event": "reached_pg", 2023-08-01T19:54:24.968 INFO:teuthology.orchestra.run.smithi101.stdout: "time": "2023-08-01T19:54:04.469860+0000", 2023-08-01T19:54:24.969 INFO:teuthology.orchestra.run.smithi101.stdout: "duration": 0.010765749 2023-08-01T19:54:24.969 INFO:teuthology.orchestra.run.smithi101.stdout: }, 2023-08-01T19:54:24.969 INFO:teuthology.orchestra.run.smithi101.stdout: { 2023-08-01T19:54:24.969 INFO:teuthology.orchestra.run.smithi101.stdout: "event": "started", 2023-08-01T19:54:24.969 INFO:teuthology.orchestra.run.smithi101.stdout: "time": "2023-08-01T19:54:04.470008+0000", 2023-08-01T19:54:24.969 INFO:teuthology.orchestra.run.smithi101.stdout: "duration": 0.000148367 2023-08-01T19:54:24.969 INFO:teuthology.orchestra.run.smithi101.stdout: }, 2023-08-01T19:54:24.969 INFO:teuthology.orchestra.run.smithi101.stdout: { 2023-08-01T19:54:24.970 INFO:teuthology.orchestra.run.smithi101.stdout: "event": "waiting for subops from 2", 2023-08-01T19:54:24.970 INFO:teuthology.orchestra.run.smithi101.stdout: "time": "2023-08-01T19:54:04.470136+0000", 2023-08-01T19:54:24.970 INFO:teuthology.orchestra.run.smithi101.stdout: "duration": 0.000128329 2023-08-01T19:54:24.970 INFO:teuthology.orchestra.run.smithi101.stdout: }, 2023-08-01T19:54:24.970 INFO:teuthology.orchestra.run.smithi101.stdout: { 2023-08-01T19:54:24.970 INFO:teuthology.orchestra.run.smithi101.stdout: "event": "op_commit", 2023-08-01T19:54:24.970 INFO:teuthology.orchestra.run.smithi101.stdout: "time": "2023-08-01T19:54:04.476399+0000", 2023-08-01T19:54:24.970 INFO:teuthology.orchestra.run.smithi101.stdout: "duration": 0.0062627259999999997 2023-08-01T19:54:24.971 INFO:teuthology.orchestra.run.smithi101.stdout: }, 2023-08-01T19:54:24.971 INFO:teuthology.orchestra.run.smithi101.stdout: { 2023-08-01T19:54:24.971 INFO:teuthology.orchestra.run.smithi101.stdout: "event": "sub_op_commit_rec", 2023-08-01T19:54:24.971 INFO:teuthology.orchestra.run.smithi101.stdout: "time": "2023-08-01T19:54:04.477726+0000", 2023-08-01T19:54:24.971 INFO:teuthology.orchestra.run.smithi101.stdout: "duration": 0.001327103 2023-08-01T19:54:24.971 INFO:teuthology.orchestra.run.smithi101.stdout: }, 2023-08-01T19:54:24.971 INFO:teuthology.orchestra.run.smithi101.stdout: { 2023-08-01T19:54:24.971 INFO:teuthology.orchestra.run.smithi101.stdout: "event": "commit_sent", 2023-08-01T19:54:24.972 INFO:teuthology.orchestra.run.smithi101.stdout: "time": "2023-08-01T19:54:04.477771+0000", 2023-08-01T19:54:24.972 INFO:teuthology.orchestra.run.smithi101.stdout: "duration": 4.5232000000000003e-05 2023-08-01T19:54:24.972 INFO:teuthology.orchestra.run.smithi101.stdout: }, 2023-08-01T19:54:24.972 INFO:teuthology.orchestra.run.smithi101.stdout: { 2023-08-01T19:54:24.972 INFO:teuthology.orchestra.run.smithi101.stdout: "event": "done", 2023-08-01T19:54:24.972 INFO:teuthology.orchestra.run.smithi101.stdout: "time": "2023-08-01T19:54:04.477795+0000", 2023-08-01T19:54:24.972 INFO:teuthology.orchestra.run.smithi101.stdout: "duration": 2.4134999999999998e-05 2023-08-01T19:54:24.972 INFO:teuthology.orchestra.run.smithi101.stdout: } 2023-08-01T19:54:24.973 INFO:teuthology.orchestra.run.smithi101.stdout: ] 2023-08-01T19:54:24.973 INFO:teuthology.orchestra.run.smithi101.stdout: } 2023-08-01T19:54:24.973 INFO:teuthology.orchestra.run.smithi101.stdout: }, 2023-08-01T19:54:24.973 INFO:teuthology.orchestra.run.smithi101.stdout: { 2023-08-01T19:54:24.973 INFO:teuthology.orchestra.run.smithi101.stdout: "description": "osd_op(mds.0.3:19 3.14 3:2f55791f:::606.00000000:head [create,setxattr parent (62) in=6b,setxattr layout (30) in=6b] snapc 0=[] ondisk+write+known_if_redirected+full_force+supports_pool_eio e17)", 2023-08-01T19:54:24.973 INFO:teuthology.orchestra.run.smithi101.stdout: "initiated_at": "2023-08-01T19:54:04.459069+0000", 2023-08-01T19:54:24.973 INFO:teuthology.orchestra.run.smithi101.stdout: "age": 20.396512007999998, 2023-08-01T19:54:24.974 INFO:teuthology.orchestra.run.smithi101.stdout: "duration": 0.019523045999999999, 2023-08-01T19:54:24.974 INFO:teuthology.orchestra.run.smithi101.stdout: "type_data": { 2023-08-01T19:54:24.974 INFO:teuthology.orchestra.run.smithi101.stdout: "flag_point": "commit sent; apply or cleanup", 2023-08-01T19:54:24.974 INFO:teuthology.orchestra.run.smithi101.stdout: "events": [ 2023-08-01T19:54:24.974 INFO:teuthology.orchestra.run.smithi101.stdout: { 2023-08-01T19:54:24.974 INFO:teuthology.orchestra.run.smithi101.stdout: "event": "initiated", 2023-08-01T19:54:24.974 INFO:teuthology.orchestra.run.smithi101.stdout: "time": "2023-08-01T19:54:04.459069+0000", 2023-08-01T19:54:24.974 INFO:teuthology.orchestra.run.smithi101.stdout: "duration": 0 2023-08-01T19:54:24.975 INFO:teuthology.orchestra.run.smithi101.stdout: }, 2023-08-01T19:54:24.975 INFO:teuthology.orchestra.run.smithi101.stdout: { 2023-08-01T19:54:24.975 INFO:teuthology.orchestra.run.smithi101.stdout: "event": "throttled", 2023-08-01T19:54:24.975 INFO:teuthology.orchestra.run.smithi101.stdout: "time": "2023-08-01T19:54:04.459069+0000", 2023-08-01T19:54:24.975 INFO:teuthology.orchestra.run.smithi101.stdout: "duration": 0 2023-08-01T19:54:24.975 INFO:teuthology.orchestra.run.smithi101.stdout: }, 2023-08-01T19:54:24.975 INFO:teuthology.orchestra.run.smithi101.stdout: { 2023-08-01T19:54:24.975 INFO:teuthology.orchestra.run.smithi101.stdout: "event": "header_read", 2023-08-01T19:54:24.976 INFO:teuthology.orchestra.run.smithi101.stdout: "time": "2023-08-01T19:54:04.459069+0000", 2023-08-01T19:54:24.976 INFO:teuthology.orchestra.run.smithi101.stdout: "duration": 4294967295.9999995 2023-08-01T19:54:24.976 INFO:teuthology.orchestra.run.smithi101.stdout: }, 2023-08-01T19:54:24.976 INFO:teuthology.orchestra.run.smithi101.stdout: { 2023-08-01T19:54:24.976 INFO:teuthology.orchestra.run.smithi101.stdout: "event": "all_read", 2023-08-01T19:54:24.976 INFO:teuthology.orchestra.run.smithi101.stdout: "time": "2023-08-01T19:54:04.459072+0000", 2023-08-01T19:54:24.976 INFO:teuthology.orchestra.run.smithi101.stdout: "duration": 3.4570000000000001e-06 2023-08-01T19:54:24.976 INFO:teuthology.orchestra.run.smithi101.stdout: }, 2023-08-01T19:54:24.977 INFO:teuthology.orchestra.run.smithi101.stdout: { 2023-08-01T19:54:24.977 INFO:teuthology.orchestra.run.smithi101.stdout: "event": "dispatched", 2023-08-01T19:54:24.977 INFO:teuthology.orchestra.run.smithi101.stdout: "time": "2023-08-01T19:54:04.459080+0000", 2023-08-01T19:54:24.977 INFO:teuthology.orchestra.run.smithi101.stdout: "duration": 7.6009999999999997e-06 2023-08-01T19:54:24.977 INFO:teuthology.orchestra.run.smithi101.stdout: }, 2023-08-01T19:54:24.977 INFO:teuthology.orchestra.run.smithi101.stdout: { 2023-08-01T19:54:24.977 INFO:teuthology.orchestra.run.smithi101.stdout: "event": "queued_for_pg", 2023-08-01T19:54:24.977 INFO:teuthology.orchestra.run.smithi101.stdout: "time": "2023-08-01T19:54:04.459088+0000", 2023-08-01T19:54:24.978 INFO:teuthology.orchestra.run.smithi101.stdout: "duration": 8.0509999999999997e-06 2023-08-01T19:54:24.978 INFO:teuthology.orchestra.run.smithi101.stdout: }, 2023-08-01T19:54:24.978 INFO:teuthology.orchestra.run.smithi101.stdout: { 2023-08-01T19:54:24.978 INFO:teuthology.orchestra.run.smithi101.stdout: "event": "reached_pg", 2023-08-01T19:54:24.978 INFO:teuthology.orchestra.run.smithi101.stdout: "time": "2023-08-01T19:54:04.459120+0000", 2023-08-01T19:54:24.978 INFO:teuthology.orchestra.run.smithi101.stdout: "duration": 3.2078e-05 2023-08-01T19:54:24.978 INFO:teuthology.orchestra.run.smithi101.stdout: }, 2023-08-01T19:54:24.979 INFO:teuthology.orchestra.run.smithi101.stdout: { 2023-08-01T19:54:24.979 INFO:teuthology.orchestra.run.smithi101.stdout: "event": "waiting_for_map not empty", 2023-08-01T19:54:24.979 INFO:teuthology.orchestra.run.smithi101.stdout: "time": "2023-08-01T19:54:04.459123+0000", 2023-08-01T19:54:24.979 INFO:teuthology.orchestra.run.smithi101.stdout: "duration": 3.4699999999999998e-06 2023-08-01T19:54:24.979 INFO:teuthology.orchestra.run.smithi101.stdout: }, 2023-08-01T19:54:24.979 INFO:teuthology.orchestra.run.smithi101.stdout: { 2023-08-01T19:54:24.979 INFO:teuthology.orchestra.run.smithi101.stdout: "event": "reached_pg", 2023-08-01T19:54:24.979 INFO:teuthology.orchestra.run.smithi101.stdout: "time": "2023-08-01T19:54:04.471352+0000", 2023-08-01T19:54:24.980 INFO:teuthology.orchestra.run.smithi101.stdout: "duration": 0.01222926 2023-08-01T19:54:24.980 INFO:teuthology.orchestra.run.smithi101.stdout: }, 2023-08-01T19:54:24.980 INFO:teuthology.orchestra.run.smithi101.stdout: { 2023-08-01T19:54:24.980 INFO:teuthology.orchestra.run.smithi101.stdout: "event": "started", 2023-08-01T19:54:24.980 INFO:teuthology.orchestra.run.smithi101.stdout: "time": "2023-08-01T19:54:04.471495+0000", 2023-08-01T19:54:24.980 INFO:teuthology.orchestra.run.smithi101.stdout: "duration": 0.00014263899999999999 2023-08-01T19:54:24.980 INFO:teuthology.orchestra.run.smithi101.stdout: }, 2023-08-01T19:54:24.980 INFO:teuthology.orchestra.run.smithi101.stdout: { 2023-08-01T19:54:24.981 INFO:teuthology.orchestra.run.smithi101.stdout: "event": "waiting for subops from 2", 2023-08-01T19:54:24.981 INFO:teuthology.orchestra.run.smithi101.stdout: "time": "2023-08-01T19:54:04.472368+0000", 2023-08-01T19:54:24.981 INFO:teuthology.orchestra.run.smithi101.stdout: "duration": 0.00087245300000000003 2023-08-01T19:54:24.981 INFO:teuthology.orchestra.run.smithi101.stdout: }, 2023-08-01T19:54:24.981 INFO:teuthology.orchestra.run.smithi101.stdout: { 2023-08-01T19:54:24.981 INFO:teuthology.orchestra.run.smithi101.stdout: "event": "op_commit", 2023-08-01T19:54:24.981 INFO:teuthology.orchestra.run.smithi101.stdout: "time": "2023-08-01T19:54:04.477612+0000", 2023-08-01T19:54:24.981 INFO:teuthology.orchestra.run.smithi101.stdout: "duration": 0.0052442809999999999 2023-08-01T19:54:24.982 INFO:teuthology.orchestra.run.smithi101.stdout: }, 2023-08-01T19:54:24.982 INFO:teuthology.orchestra.run.smithi101.stdout: { 2023-08-01T19:54:24.982 INFO:teuthology.orchestra.run.smithi101.stdout: "event": "sub_op_commit_rec", 2023-08-01T19:54:24.982 INFO:teuthology.orchestra.run.smithi101.stdout: "time": "2023-08-01T19:54:04.478516+0000", 2023-08-01T19:54:24.982 INFO:teuthology.orchestra.run.smithi101.stdout: "duration": 0.00090399800000000004 2023-08-01T19:54:24.982 INFO:teuthology.orchestra.run.smithi101.stdout: }, 2023-08-01T19:54:24.982 INFO:teuthology.orchestra.run.smithi101.stdout: { 2023-08-01T19:54:24.982 INFO:teuthology.orchestra.run.smithi101.stdout: "event": "commit_sent", 2023-08-01T19:54:24.983 INFO:teuthology.orchestra.run.smithi101.stdout: "time": "2023-08-01T19:54:04.478555+0000", 2023-08-01T19:54:24.983 INFO:teuthology.orchestra.run.smithi101.stdout: "duration": 3.8977000000000003e-05 2023-08-01T19:54:24.983 INFO:teuthology.orchestra.run.smithi101.stdout: }, 2023-08-01T19:54:24.983 INFO:teuthology.orchestra.run.smithi101.stdout: { 2023-08-01T19:54:24.983 INFO:teuthology.orchestra.run.smithi101.stdout: "event": "done", 2023-08-01T19:54:24.983 INFO:teuthology.orchestra.run.smithi101.stdout: "time": "2023-08-01T19:54:04.478592+0000", 2023-08-01T19:54:24.983 INFO:teuthology.orchestra.run.smithi101.stdout: "duration": 3.7287999999999999e-05 2023-08-01T19:54:24.984 INFO:teuthology.orchestra.run.smithi101.stdout: } 2023-08-01T19:54:24.984 INFO:teuthology.orchestra.run.smithi101.stdout: ] 2023-08-01T19:54:24.984 INFO:teuthology.orchestra.run.smithi101.stdout: } 2023-08-01T19:54:24.984 INFO:teuthology.orchestra.run.smithi101.stdout: }, 2023-08-01T19:54:24.984 INFO:teuthology.orchestra.run.smithi101.stdout: { 2023-08-01T19:54:24.984 INFO:teuthology.orchestra.run.smithi101.stdout: "description": "osd_op(mds.0.3:20 3.1c 3:3ed09add:::607.00000000:head [omap-set-header] snapc 0=[] ondisk+write+known_if_redirected+full_force+supports_pool_eio e17)", 2023-08-01T19:54:24.984 INFO:teuthology.orchestra.run.smithi101.stdout: "initiated_at": "2023-08-01T19:54:04.459097+0000", 2023-08-01T19:54:24.984 INFO:teuthology.orchestra.run.smithi101.stdout: "age": 20.396484304000001, 2023-08-01T19:54:24.985 INFO:teuthology.orchestra.run.smithi101.stdout: "duration": 0.018578978999999999, 2023-08-01T19:54:24.985 INFO:teuthology.orchestra.run.smithi101.stdout: "type_data": { 2023-08-01T19:54:24.985 INFO:teuthology.orchestra.run.smithi101.stdout: "flag_point": "commit sent; apply or cleanup", 2023-08-01T19:54:24.985 INFO:teuthology.orchestra.run.smithi101.stdout: "events": [ 2023-08-01T19:54:24.985 INFO:teuthology.orchestra.run.smithi101.stdout: { 2023-08-01T19:54:24.985 INFO:teuthology.orchestra.run.smithi101.stdout: "event": "initiated", 2023-08-01T19:54:24.985 INFO:teuthology.orchestra.run.smithi101.stdout: "time": "2023-08-01T19:54:04.459097+0000", 2023-08-01T19:54:24.986 INFO:teuthology.orchestra.run.smithi101.stdout: "duration": 0 2023-08-01T19:54:24.986 INFO:teuthology.orchestra.run.smithi101.stdout: }, 2023-08-01T19:54:24.986 INFO:teuthology.orchestra.run.smithi101.stdout: { 2023-08-01T19:54:24.986 INFO:teuthology.orchestra.run.smithi101.stdout: "event": "throttled", 2023-08-01T19:54:24.986 INFO:teuthology.orchestra.run.smithi101.stdout: "time": "2023-08-01T19:54:04.459097+0000", 2023-08-01T19:54:24.986 INFO:teuthology.orchestra.run.smithi101.stdout: "duration": 0 2023-08-01T19:54:24.986 INFO:teuthology.orchestra.run.smithi101.stdout: }, 2023-08-01T19:54:24.986 INFO:teuthology.orchestra.run.smithi101.stdout: { 2023-08-01T19:54:24.987 INFO:teuthology.orchestra.run.smithi101.stdout: "event": "header_read", 2023-08-01T19:54:24.987 INFO:teuthology.orchestra.run.smithi101.stdout: "time": "2023-08-01T19:54:04.459096+0000", 2023-08-01T19:54:24.987 INFO:teuthology.orchestra.run.smithi101.stdout: "duration": 4294967295.9999995 2023-08-01T19:54:24.987 INFO:teuthology.orchestra.run.smithi101.stdout: }, 2023-08-01T19:54:24.987 INFO:teuthology.orchestra.run.smithi101.stdout: { 2023-08-01T19:54:24.987 INFO:teuthology.orchestra.run.smithi101.stdout: "event": "all_read", 2023-08-01T19:54:24.987 INFO:teuthology.orchestra.run.smithi101.stdout: "time": "2023-08-01T19:54:04.459105+0000", 2023-08-01T19:54:24.987 INFO:teuthology.orchestra.run.smithi101.stdout: "duration": 8.8259999999999999e-06 2023-08-01T19:54:24.988 INFO:teuthology.orchestra.run.smithi101.stdout: }, 2023-08-01T19:54:24.988 INFO:teuthology.orchestra.run.smithi101.stdout: { 2023-08-01T19:54:24.988 INFO:teuthology.orchestra.run.smithi101.stdout: "event": "dispatched", 2023-08-01T19:54:24.988 INFO:teuthology.orchestra.run.smithi101.stdout: "time": "2023-08-01T19:54:04.459112+0000", 2023-08-01T19:54:24.988 INFO:teuthology.orchestra.run.smithi101.stdout: "duration": 6.6660000000000002e-06 2023-08-01T19:54:24.988 INFO:teuthology.orchestra.run.smithi101.stdout: }, 2023-08-01T19:54:24.988 INFO:teuthology.orchestra.run.smithi101.stdout: { 2023-08-01T19:54:24.988 INFO:teuthology.orchestra.run.smithi101.stdout: "event": "queued_for_pg", 2023-08-01T19:54:24.989 INFO:teuthology.orchestra.run.smithi101.stdout: "time": "2023-08-01T19:54:04.459116+0000", 2023-08-01T19:54:24.989 INFO:teuthology.orchestra.run.smithi101.stdout: "duration": 4.2209999999999999e-06 2023-08-01T19:54:24.989 INFO:teuthology.orchestra.run.smithi101.stdout: }, 2023-08-01T19:54:24.989 INFO:teuthology.orchestra.run.smithi101.stdout: { 2023-08-01T19:54:24.989 INFO:teuthology.orchestra.run.smithi101.stdout: "event": "reached_pg", 2023-08-01T19:54:24.989 INFO:teuthology.orchestra.run.smithi101.stdout: "time": "2023-08-01T19:54:04.459141+0000", 2023-08-01T19:54:24.989 INFO:teuthology.orchestra.run.smithi101.stdout: "duration": 2.4627e-05 2023-08-01T19:54:24.990 INFO:teuthology.orchestra.run.smithi101.stdout: }, 2023-08-01T19:54:24.990 INFO:teuthology.orchestra.run.smithi101.stdout: { 2023-08-01T19:54:24.990 INFO:teuthology.orchestra.run.smithi101.stdout: "event": "op must wait for map", 2023-08-01T19:54:24.990 INFO:teuthology.orchestra.run.smithi101.stdout: "time": "2023-08-01T19:54:04.459144+0000", 2023-08-01T19:54:24.990 INFO:teuthology.orchestra.run.smithi101.stdout: "duration": 3.6559999999999998e-06 2023-08-01T19:54:24.990 INFO:teuthology.orchestra.run.smithi101.stdout: }, 2023-08-01T19:54:24.990 INFO:teuthology.orchestra.run.smithi101.stdout: { 2023-08-01T19:54:24.990 INFO:teuthology.orchestra.run.smithi101.stdout: "event": "reached_pg", 2023-08-01T19:54:24.991 INFO:teuthology.orchestra.run.smithi101.stdout: "time": "2023-08-01T19:54:04.468086+0000", 2023-08-01T19:54:24.991 INFO:teuthology.orchestra.run.smithi101.stdout: "duration": 0.0089415569999999993 2023-08-01T19:54:24.991 INFO:teuthology.orchestra.run.smithi101.stdout: }, 2023-08-01T19:54:24.991 INFO:teuthology.orchestra.run.smithi101.stdout: { 2023-08-01T19:54:24.991 INFO:teuthology.orchestra.run.smithi101.stdout: "event": "started", 2023-08-01T19:54:24.991 INFO:teuthology.orchestra.run.smithi101.stdout: "time": "2023-08-01T19:54:04.468204+0000", 2023-08-01T19:54:24.991 INFO:teuthology.orchestra.run.smithi101.stdout: "duration": 0.00011806700000000001 2023-08-01T19:54:24.991 INFO:teuthology.orchestra.run.smithi101.stdout: }, 2023-08-01T19:54:24.992 INFO:teuthology.orchestra.run.smithi101.stdout: { 2023-08-01T19:54:24.992 INFO:teuthology.orchestra.run.smithi101.stdout: "event": "waiting for subops from 0", 2023-08-01T19:54:24.992 INFO:teuthology.orchestra.run.smithi101.stdout: "time": "2023-08-01T19:54:04.468342+0000", 2023-08-01T19:54:24.992 INFO:teuthology.orchestra.run.smithi101.stdout: "duration": 0.000138269 2023-08-01T19:54:24.992 INFO:teuthology.orchestra.run.smithi101.stdout: }, 2023-08-01T19:54:24.992 INFO:teuthology.orchestra.run.smithi101.stdout: { 2023-08-01T19:54:24.992 INFO:teuthology.orchestra.run.smithi101.stdout: "event": "op_commit", 2023-08-01T19:54:24.992 INFO:teuthology.orchestra.run.smithi101.stdout: "time": "2023-08-01T19:54:04.474028+0000", 2023-08-01T19:54:24.993 INFO:teuthology.orchestra.run.smithi101.stdout: "duration": 0.005685458 2023-08-01T19:54:24.993 INFO:teuthology.orchestra.run.smithi101.stdout: }, 2023-08-01T19:54:24.993 INFO:teuthology.orchestra.run.smithi101.stdout: { 2023-08-01T19:54:24.993 INFO:teuthology.orchestra.run.smithi101.stdout: "event": "sub_op_commit_rec", 2023-08-01T19:54:24.993 INFO:teuthology.orchestra.run.smithi101.stdout: "time": "2023-08-01T19:54:04.477581+0000", 2023-08-01T19:54:24.993 INFO:teuthology.orchestra.run.smithi101.stdout: "duration": 0.0035531109999999999 2023-08-01T19:54:24.993 INFO:teuthology.orchestra.run.smithi101.stdout: }, 2023-08-01T19:54:24.993 INFO:teuthology.orchestra.run.smithi101.stdout: { 2023-08-01T19:54:24.994 INFO:teuthology.orchestra.run.smithi101.stdout: "event": "commit_sent", 2023-08-01T19:54:24.994 INFO:teuthology.orchestra.run.smithi101.stdout: "time": "2023-08-01T19:54:04.477635+0000", 2023-08-01T19:54:24.994 INFO:teuthology.orchestra.run.smithi101.stdout: "duration": 5.3769e-05 2023-08-01T19:54:24.994 INFO:teuthology.orchestra.run.smithi101.stdout: }, 2023-08-01T19:54:24.994 INFO:teuthology.orchestra.run.smithi101.stdout: { 2023-08-01T19:54:24.994 INFO:teuthology.orchestra.run.smithi101.stdout: "event": "done", 2023-08-01T19:54:24.994 INFO:teuthology.orchestra.run.smithi101.stdout: "time": "2023-08-01T19:54:04.477676+0000", 2023-08-01T19:54:24.995 INFO:teuthology.orchestra.run.smithi101.stdout: "duration": 4.1148e-05 2023-08-01T19:54:24.995 INFO:teuthology.orchestra.run.smithi101.stdout: } 2023-08-01T19:54:24.995 INFO:teuthology.orchestra.run.smithi101.stdout: ] 2023-08-01T19:54:24.995 INFO:teuthology.orchestra.run.smithi101.stdout: } 2023-08-01T19:54:24.995 INFO:teuthology.orchestra.run.smithi101.stdout: }, 2023-08-01T19:54:24.995 INFO:teuthology.orchestra.run.smithi101.stdout: { 2023-08-01T19:54:24.995 INFO:teuthology.orchestra.run.smithi101.stdout: "description": "osd_op(mds.0.3:21 3.1c 3:3ed09add:::607.00000000:head [create,setxattr parent (62) in=6b,setxattr layout (30) in=6b] snapc 0=[] ondisk+write+known_if_redirected+full_force+supports_pool_eio e17)", 2023-08-01T19:54:24.995 INFO:teuthology.orchestra.run.smithi101.stdout: "initiated_at": "2023-08-01T19:54:04.459123+0000", 2023-08-01T19:54:24.996 INFO:teuthology.orchestra.run.smithi101.stdout: "age": 20.396458147000001, 2023-08-01T19:54:24.996 INFO:teuthology.orchestra.run.smithi101.stdout: "duration": 0.018736452000000001, 2023-08-01T19:54:24.996 INFO:teuthology.orchestra.run.smithi101.stdout: "type_data": { 2023-08-01T19:54:24.996 INFO:teuthology.orchestra.run.smithi101.stdout: "flag_point": "commit sent; apply or cleanup", 2023-08-01T19:54:24.996 INFO:teuthology.orchestra.run.smithi101.stdout: "events": [ 2023-08-01T19:54:24.996 INFO:teuthology.orchestra.run.smithi101.stdout: { 2023-08-01T19:54:24.996 INFO:teuthology.orchestra.run.smithi101.stdout: "event": "initiated", 2023-08-01T19:54:24.996 INFO:teuthology.orchestra.run.smithi101.stdout: "time": "2023-08-01T19:54:04.459123+0000", 2023-08-01T19:54:24.997 INFO:teuthology.orchestra.run.smithi101.stdout: "duration": 0 2023-08-01T19:54:24.997 INFO:teuthology.orchestra.run.smithi101.stdout: }, 2023-08-01T19:54:24.997 INFO:teuthology.orchestra.run.smithi101.stdout: { 2023-08-01T19:54:24.997 INFO:teuthology.orchestra.run.smithi101.stdout: "event": "throttled", 2023-08-01T19:54:24.997 INFO:teuthology.orchestra.run.smithi101.stdout: "time": "2023-08-01T19:54:04.459123+0000", 2023-08-01T19:54:24.997 INFO:teuthology.orchestra.run.smithi101.stdout: "duration": 0 2023-08-01T19:54:24.997 INFO:teuthology.orchestra.run.smithi101.stdout: }, 2023-08-01T19:54:24.997 INFO:teuthology.orchestra.run.smithi101.stdout: { 2023-08-01T19:54:24.998 INFO:teuthology.orchestra.run.smithi101.stdout: "event": "header_read", 2023-08-01T19:54:24.998 INFO:teuthology.orchestra.run.smithi101.stdout: "time": "2023-08-01T19:54:04.459123+0000", 2023-08-01T19:54:24.998 INFO:teuthology.orchestra.run.smithi101.stdout: "duration": 4294967295.9999995 2023-08-01T19:54:24.998 INFO:teuthology.orchestra.run.smithi101.stdout: }, 2023-08-01T19:54:24.998 INFO:teuthology.orchestra.run.smithi101.stdout: { 2023-08-01T19:54:24.998 INFO:teuthology.orchestra.run.smithi101.stdout: "event": "all_read", 2023-08-01T19:54:24.998 INFO:teuthology.orchestra.run.smithi101.stdout: "time": "2023-08-01T19:54:04.459127+0000", 2023-08-01T19:54:24.999 INFO:teuthology.orchestra.run.smithi101.stdout: "duration": 4.5770000000000004e-06 2023-08-01T19:54:24.999 INFO:teuthology.orchestra.run.smithi101.stdout: }, 2023-08-01T19:54:24.999 INFO:teuthology.orchestra.run.smithi101.stdout: { 2023-08-01T19:54:24.999 INFO:teuthology.orchestra.run.smithi101.stdout: "event": "dispatched", 2023-08-01T19:54:24.999 INFO:teuthology.orchestra.run.smithi101.stdout: "time": "2023-08-01T19:54:04.459134+0000", 2023-08-01T19:54:24.999 INFO:teuthology.orchestra.run.smithi101.stdout: "duration": 6.5080000000000002e-06 2023-08-01T19:54:24.999 INFO:teuthology.orchestra.run.smithi101.stdout: }, 2023-08-01T19:54:24.999 INFO:teuthology.orchestra.run.smithi101.stdout: { 2023-08-01T19:54:25.000 INFO:teuthology.orchestra.run.smithi101.stdout: "event": "queued_for_pg", 2023-08-01T19:54:25.000 INFO:teuthology.orchestra.run.smithi101.stdout: "time": "2023-08-01T19:54:04.459138+0000", 2023-08-01T19:54:25.000 INFO:teuthology.orchestra.run.smithi101.stdout: "duration": 4.6249999999999998e-06 2023-08-01T19:54:25.000 INFO:teuthology.orchestra.run.smithi101.stdout: }, 2023-08-01T19:54:25.000 INFO:teuthology.orchestra.run.smithi101.stdout: { 2023-08-01T19:54:25.000 INFO:teuthology.orchestra.run.smithi101.stdout: "event": "reached_pg", 2023-08-01T19:54:25.000 INFO:teuthology.orchestra.run.smithi101.stdout: "time": "2023-08-01T19:54:04.459158+0000", 2023-08-01T19:54:25.000 INFO:teuthology.orchestra.run.smithi101.stdout: "duration": 1.9354000000000001e-05 2023-08-01T19:54:25.001 INFO:teuthology.orchestra.run.smithi101.stdout: }, 2023-08-01T19:54:25.001 INFO:teuthology.orchestra.run.smithi101.stdout: { 2023-08-01T19:54:25.001 INFO:teuthology.orchestra.run.smithi101.stdout: "event": "waiting_for_map not empty", 2023-08-01T19:54:25.001 INFO:teuthology.orchestra.run.smithi101.stdout: "time": "2023-08-01T19:54:04.459160+0000", 2023-08-01T19:54:25.001 INFO:teuthology.orchestra.run.smithi101.stdout: "duration": 2.2740000000000002e-06 2023-08-01T19:54:25.001 INFO:teuthology.orchestra.run.smithi101.stdout: }, 2023-08-01T19:54:25.002 INFO:teuthology.orchestra.run.smithi101.stdout: { 2023-08-01T19:54:25.002 INFO:teuthology.orchestra.run.smithi101.stdout: "event": "reached_pg", 2023-08-01T19:54:25.002 INFO:teuthology.orchestra.run.smithi101.stdout: "time": "2023-08-01T19:54:04.468839+0000", 2023-08-01T19:54:25.002 INFO:teuthology.orchestra.run.smithi101.stdout: "duration": 0.0096787109999999996 2023-08-01T19:54:25.002 INFO:teuthology.orchestra.run.smithi101.stdout: }, 2023-08-01T19:54:25.002 INFO:teuthology.orchestra.run.smithi101.stdout: { 2023-08-01T19:54:25.002 INFO:teuthology.orchestra.run.smithi101.stdout: "event": "started", 2023-08-01T19:54:25.002 INFO:teuthology.orchestra.run.smithi101.stdout: "time": "2023-08-01T19:54:04.469446+0000", 2023-08-01T19:54:25.003 INFO:teuthology.orchestra.run.smithi101.stdout: "duration": 0.00060714899999999997 2023-08-01T19:54:25.003 INFO:teuthology.orchestra.run.smithi101.stdout: }, 2023-08-01T19:54:25.003 INFO:teuthology.orchestra.run.smithi101.stdout: { 2023-08-01T19:54:25.003 INFO:teuthology.orchestra.run.smithi101.stdout: "event": "waiting for subops from 0", 2023-08-01T19:54:25.003 INFO:teuthology.orchestra.run.smithi101.stdout: "time": "2023-08-01T19:54:04.470133+0000", 2023-08-01T19:54:25.003 INFO:teuthology.orchestra.run.smithi101.stdout: "duration": 0.00068691900000000003 2023-08-01T19:54:25.003 INFO:teuthology.orchestra.run.smithi101.stdout: }, 2023-08-01T19:54:25.003 INFO:teuthology.orchestra.run.smithi101.stdout: { 2023-08-01T19:54:25.004 INFO:teuthology.orchestra.run.smithi101.stdout: "event": "op_commit", 2023-08-01T19:54:25.004 INFO:teuthology.orchestra.run.smithi101.stdout: "time": "2023-08-01T19:54:04.475933+0000", 2023-08-01T19:54:25.004 INFO:teuthology.orchestra.run.smithi101.stdout: "duration": 0.0058002560000000002 2023-08-01T19:54:25.004 INFO:teuthology.orchestra.run.smithi101.stdout: }, 2023-08-01T19:54:25.004 INFO:teuthology.orchestra.run.smithi101.stdout: { 2023-08-01T19:54:25.004 INFO:teuthology.orchestra.run.smithi101.stdout: "event": "sub_op_commit_rec", 2023-08-01T19:54:25.004 INFO:teuthology.orchestra.run.smithi101.stdout: "time": "2023-08-01T19:54:04.477749+0000", 2023-08-01T19:54:25.005 INFO:teuthology.orchestra.run.smithi101.stdout: "duration": 0.00181584 2023-08-01T19:54:25.005 INFO:teuthology.orchestra.run.smithi101.stdout: }, 2023-08-01T19:54:25.005 INFO:teuthology.orchestra.run.smithi101.stdout: { 2023-08-01T19:54:25.005 INFO:teuthology.orchestra.run.smithi101.stdout: "event": "commit_sent", 2023-08-01T19:54:25.005 INFO:teuthology.orchestra.run.smithi101.stdout: "time": "2023-08-01T19:54:04.477823+0000", 2023-08-01T19:54:25.005 INFO:teuthology.orchestra.run.smithi101.stdout: "duration": 7.4405000000000003e-05 2023-08-01T19:54:25.005 INFO:teuthology.orchestra.run.smithi101.stdout: }, 2023-08-01T19:54:25.005 INFO:teuthology.orchestra.run.smithi101.stdout: { 2023-08-01T19:54:25.006 INFO:teuthology.orchestra.run.smithi101.stdout: "event": "done", 2023-08-01T19:54:25.006 INFO:teuthology.orchestra.run.smithi101.stdout: "time": "2023-08-01T19:54:04.477859+0000", 2023-08-01T19:54:25.006 INFO:teuthology.orchestra.run.smithi101.stdout: "duration": 3.6211000000000003e-05 2023-08-01T19:54:25.006 INFO:teuthology.orchestra.run.smithi101.stdout: } 2023-08-01T19:54:25.006 INFO:teuthology.orchestra.run.smithi101.stdout: ] 2023-08-01T19:54:25.006 INFO:teuthology.orchestra.run.smithi101.stdout: } 2023-08-01T19:54:25.006 INFO:teuthology.orchestra.run.smithi101.stdout: }, 2023-08-01T19:54:25.006 INFO:teuthology.orchestra.run.smithi101.stdout: { 2023-08-01T19:54:25.007 INFO:teuthology.orchestra.run.smithi101.stdout: "description": "osd_op(mds.0.3:29 3.13 3:cd5a64a3:::100.00000000:head [omap-set-header,omap-set-vals] snapc 0=[] ondisk+write+known_if_redirected+full_force+supports_pool_eio e17)", 2023-08-01T19:54:25.007 INFO:teuthology.orchestra.run.smithi101.stdout: "initiated_at": "2023-08-01T19:54:04.459146+0000", 2023-08-01T19:54:25.007 INFO:teuthology.orchestra.run.smithi101.stdout: "age": 20.396434945999999, 2023-08-01T19:54:25.007 INFO:teuthology.orchestra.run.smithi101.stdout: "duration": 0.015668519999999998, 2023-08-01T19:54:25.007 INFO:teuthology.orchestra.run.smithi101.stdout: "type_data": { 2023-08-01T19:54:25.007 INFO:teuthology.orchestra.run.smithi101.stdout: "flag_point": "commit sent; apply or cleanup", 2023-08-01T19:54:25.007 INFO:teuthology.orchestra.run.smithi101.stdout: "events": [ 2023-08-01T19:54:25.008 INFO:teuthology.orchestra.run.smithi101.stdout: { 2023-08-01T19:54:25.008 INFO:teuthology.orchestra.run.smithi101.stdout: "event": "initiated", 2023-08-01T19:54:25.008 INFO:teuthology.orchestra.run.smithi101.stdout: "time": "2023-08-01T19:54:04.459146+0000", 2023-08-01T19:54:25.008 INFO:teuthology.orchestra.run.smithi101.stdout: "duration": 0 2023-08-01T19:54:25.008 INFO:teuthology.orchestra.run.smithi101.stdout: }, 2023-08-01T19:54:25.008 INFO:teuthology.orchestra.run.smithi101.stdout: { 2023-08-01T19:54:25.008 INFO:teuthology.orchestra.run.smithi101.stdout: "event": "throttled", 2023-08-01T19:54:25.008 INFO:teuthology.orchestra.run.smithi101.stdout: "time": "2023-08-01T19:54:04.459146+0000", 2023-08-01T19:54:25.009 INFO:teuthology.orchestra.run.smithi101.stdout: "duration": 0 2023-08-01T19:54:25.009 INFO:teuthology.orchestra.run.smithi101.stdout: }, 2023-08-01T19:54:25.009 INFO:teuthology.orchestra.run.smithi101.stdout: { 2023-08-01T19:54:25.009 INFO:teuthology.orchestra.run.smithi101.stdout: "event": "header_read", 2023-08-01T19:54:25.009 INFO:teuthology.orchestra.run.smithi101.stdout: "time": "2023-08-01T19:54:04.459146+0000", 2023-08-01T19:54:25.009 INFO:teuthology.orchestra.run.smithi101.stdout: "duration": 4294967295.9999995 2023-08-01T19:54:25.009 INFO:teuthology.orchestra.run.smithi101.stdout: }, 2023-08-01T19:54:25.010 INFO:teuthology.orchestra.run.smithi101.stdout: { 2023-08-01T19:54:25.010 INFO:teuthology.orchestra.run.smithi101.stdout: "event": "all_read", 2023-08-01T19:54:25.010 INFO:teuthology.orchestra.run.smithi101.stdout: "time": "2023-08-01T19:54:04.459155+0000", 2023-08-01T19:54:25.010 INFO:teuthology.orchestra.run.smithi101.stdout: "duration": 9.6020000000000006e-06 2023-08-01T19:54:25.010 INFO:teuthology.orchestra.run.smithi101.stdout: }, 2023-08-01T19:54:25.010 INFO:teuthology.orchestra.run.smithi101.stdout: { 2023-08-01T19:54:25.010 INFO:teuthology.orchestra.run.smithi101.stdout: "event": "dispatched", 2023-08-01T19:54:25.010 INFO:teuthology.orchestra.run.smithi101.stdout: "time": "2023-08-01T19:54:04.459162+0000", 2023-08-01T19:54:25.011 INFO:teuthology.orchestra.run.smithi101.stdout: "duration": 7.0439999999999998e-06 2023-08-01T19:54:25.011 INFO:teuthology.orchestra.run.smithi101.stdout: }, 2023-08-01T19:54:25.011 INFO:teuthology.orchestra.run.smithi101.stdout: { 2023-08-01T19:54:25.011 INFO:teuthology.orchestra.run.smithi101.stdout: "event": "queued_for_pg", 2023-08-01T19:54:25.011 INFO:teuthology.orchestra.run.smithi101.stdout: "time": "2023-08-01T19:54:04.459167+0000", 2023-08-01T19:54:25.011 INFO:teuthology.orchestra.run.smithi101.stdout: "duration": 4.3989999999999997e-06 2023-08-01T19:54:25.011 INFO:teuthology.orchestra.run.smithi101.stdout: }, 2023-08-01T19:54:25.011 INFO:teuthology.orchestra.run.smithi101.stdout: { 2023-08-01T19:54:25.012 INFO:teuthology.orchestra.run.smithi101.stdout: "event": "reached_pg", 2023-08-01T19:54:25.012 INFO:teuthology.orchestra.run.smithi101.stdout: "time": "2023-08-01T19:54:04.459201+0000", 2023-08-01T19:54:25.012 INFO:teuthology.orchestra.run.smithi101.stdout: "duration": 3.4406000000000002e-05 2023-08-01T19:54:25.012 INFO:teuthology.orchestra.run.smithi101.stdout: }, 2023-08-01T19:54:25.012 INFO:teuthology.orchestra.run.smithi101.stdout: { 2023-08-01T19:54:25.012 INFO:teuthology.orchestra.run.smithi101.stdout: "event": "op must wait for map", 2023-08-01T19:54:25.012 INFO:teuthology.orchestra.run.smithi101.stdout: "time": "2023-08-01T19:54:04.459206+0000", 2023-08-01T19:54:25.013 INFO:teuthology.orchestra.run.smithi101.stdout: "duration": 5.04e-06 2023-08-01T19:54:25.013 INFO:teuthology.orchestra.run.smithi101.stdout: }, 2023-08-01T19:54:25.013 INFO:teuthology.orchestra.run.smithi101.stdout: { 2023-08-01T19:54:25.013 INFO:teuthology.orchestra.run.smithi101.stdout: "event": "reached_pg", 2023-08-01T19:54:25.013 INFO:teuthology.orchestra.run.smithi101.stdout: "time": "2023-08-01T19:54:04.468278+0000", 2023-08-01T19:54:25.013 INFO:teuthology.orchestra.run.smithi101.stdout: "duration": 0.0090714899999999998 2023-08-01T19:54:25.013 INFO:teuthology.orchestra.run.smithi101.stdout: }, 2023-08-01T19:54:25.013 INFO:teuthology.orchestra.run.smithi101.stdout: { 2023-08-01T19:54:25.014 INFO:teuthology.orchestra.run.smithi101.stdout: "event": "started", 2023-08-01T19:54:25.014 INFO:teuthology.orchestra.run.smithi101.stdout: "time": "2023-08-01T19:54:04.468419+0000", 2023-08-01T19:54:25.014 INFO:teuthology.orchestra.run.smithi101.stdout: "duration": 0.00014119100000000001 2023-08-01T19:54:25.014 INFO:teuthology.orchestra.run.smithi101.stdout: }, 2023-08-01T19:54:25.014 INFO:teuthology.orchestra.run.smithi101.stdout: { 2023-08-01T19:54:25.014 INFO:teuthology.orchestra.run.smithi101.stdout: "event": "waiting for subops from 0", 2023-08-01T19:54:25.014 INFO:teuthology.orchestra.run.smithi101.stdout: "time": "2023-08-01T19:54:04.468598+0000", 2023-08-01T19:54:25.014 INFO:teuthology.orchestra.run.smithi101.stdout: "duration": 0.00017872799999999999 2023-08-01T19:54:25.015 INFO:teuthology.orchestra.run.smithi101.stdout: }, 2023-08-01T19:54:25.015 INFO:teuthology.orchestra.run.smithi101.stdout: { 2023-08-01T19:54:25.015 INFO:teuthology.orchestra.run.smithi101.stdout: "event": "op_commit", 2023-08-01T19:54:25.015 INFO:teuthology.orchestra.run.smithi101.stdout: "time": "2023-08-01T19:54:04.472625+0000", 2023-08-01T19:54:25.015 INFO:teuthology.orchestra.run.smithi101.stdout: "duration": 0.0040273729999999999 2023-08-01T19:54:25.015 INFO:teuthology.orchestra.run.smithi101.stdout: }, 2023-08-01T19:54:25.015 INFO:teuthology.orchestra.run.smithi101.stdout: { 2023-08-01T19:54:25.015 INFO:teuthology.orchestra.run.smithi101.stdout: "event": "sub_op_commit_rec", 2023-08-01T19:54:25.016 INFO:teuthology.orchestra.run.smithi101.stdout: "time": "2023-08-01T19:54:04.474719+0000", 2023-08-01T19:54:25.016 INFO:teuthology.orchestra.run.smithi101.stdout: "duration": 0.0020941509999999998 2023-08-01T19:54:25.016 INFO:teuthology.orchestra.run.smithi101.stdout: }, 2023-08-01T19:54:25.016 INFO:teuthology.orchestra.run.smithi101.stdout: { 2023-08-01T19:54:25.016 INFO:teuthology.orchestra.run.smithi101.stdout: "event": "commit_sent", 2023-08-01T19:54:25.016 INFO:teuthology.orchestra.run.smithi101.stdout: "time": "2023-08-01T19:54:04.474776+0000", 2023-08-01T19:54:25.016 INFO:teuthology.orchestra.run.smithi101.stdout: "duration": 5.6368e-05 2023-08-01T19:54:25.017 INFO:teuthology.orchestra.run.smithi101.stdout: }, 2023-08-01T19:54:25.017 INFO:teuthology.orchestra.run.smithi101.stdout: { 2023-08-01T19:54:25.017 INFO:teuthology.orchestra.run.smithi101.stdout: "event": "done", 2023-08-01T19:54:25.017 INFO:teuthology.orchestra.run.smithi101.stdout: "time": "2023-08-01T19:54:04.474815+0000", 2023-08-01T19:54:25.017 INFO:teuthology.orchestra.run.smithi101.stdout: "duration": 3.9112000000000001e-05 2023-08-01T19:54:25.017 INFO:teuthology.orchestra.run.smithi101.stdout: } 2023-08-01T19:54:25.017 INFO:teuthology.orchestra.run.smithi101.stdout: ] 2023-08-01T19:54:25.017 INFO:teuthology.orchestra.run.smithi101.stdout: } 2023-08-01T19:54:25.018 INFO:teuthology.orchestra.run.smithi101.stdout: }, 2023-08-01T19:54:25.018 INFO:teuthology.orchestra.run.smithi101.stdout: { 2023-08-01T19:54:25.018 INFO:teuthology.orchestra.run.smithi101.stdout: "description": "osd_op(mds.0.3:1 3.14 3:292cf221:::200.00000000:head [writefull 0~90] snapc 0=[] ondisk+write+known_if_redirected+full_force+supports_pool_eio e17)", 2023-08-01T19:54:25.018 INFO:teuthology.orchestra.run.smithi101.stdout: "initiated_at": "2023-08-01T19:54:04.459177+0000", 2023-08-01T19:54:25.018 INFO:teuthology.orchestra.run.smithi101.stdout: "age": 20.396404438000001, 2023-08-01T19:54:25.018 INFO:teuthology.orchestra.run.smithi101.stdout: "duration": 0.021067196, 2023-08-01T19:54:25.018 INFO:teuthology.orchestra.run.smithi101.stdout: "type_data": { 2023-08-01T19:54:25.018 INFO:teuthology.orchestra.run.smithi101.stdout: "flag_point": "commit sent; apply or cleanup", 2023-08-01T19:54:25.019 INFO:teuthology.orchestra.run.smithi101.stdout: "events": [ 2023-08-01T19:54:25.019 INFO:teuthology.orchestra.run.smithi101.stdout: { 2023-08-01T19:54:25.019 INFO:teuthology.orchestra.run.smithi101.stdout: "event": "initiated", 2023-08-01T19:54:25.019 INFO:teuthology.orchestra.run.smithi101.stdout: "time": "2023-08-01T19:54:04.459177+0000", 2023-08-01T19:54:25.019 INFO:teuthology.orchestra.run.smithi101.stdout: "duration": 0 2023-08-01T19:54:25.019 INFO:teuthology.orchestra.run.smithi101.stdout: }, 2023-08-01T19:54:25.019 INFO:teuthology.orchestra.run.smithi101.stdout: { 2023-08-01T19:54:25.019 INFO:teuthology.orchestra.run.smithi101.stdout: "event": "throttled", 2023-08-01T19:54:25.020 INFO:teuthology.orchestra.run.smithi101.stdout: "time": "2023-08-01T19:54:04.459177+0000", 2023-08-01T19:54:25.020 INFO:teuthology.orchestra.run.smithi101.stdout: "duration": 0 2023-08-01T19:54:25.020 INFO:teuthology.orchestra.run.smithi101.stdout: }, 2023-08-01T19:54:25.020 INFO:teuthology.orchestra.run.smithi101.stdout: { 2023-08-01T19:54:25.020 INFO:teuthology.orchestra.run.smithi101.stdout: "event": "header_read", 2023-08-01T19:54:25.020 INFO:teuthology.orchestra.run.smithi101.stdout: "time": "2023-08-01T19:54:04.459176+0000", 2023-08-01T19:54:25.020 INFO:teuthology.orchestra.run.smithi101.stdout: "duration": 4294967295.9999995 2023-08-01T19:54:25.021 INFO:teuthology.orchestra.run.smithi101.stdout: }, 2023-08-01T19:54:25.021 INFO:teuthology.orchestra.run.smithi101.stdout: { 2023-08-01T19:54:25.021 INFO:teuthology.orchestra.run.smithi101.stdout: "event": "all_read", 2023-08-01T19:54:25.021 INFO:teuthology.orchestra.run.smithi101.stdout: "time": "2023-08-01T19:54:04.459181+0000", 2023-08-01T19:54:25.021 INFO:teuthology.orchestra.run.smithi101.stdout: "duration": 5.2109999999999997e-06 2023-08-01T19:54:25.021 INFO:teuthology.orchestra.run.smithi101.stdout: }, 2023-08-01T19:54:25.021 INFO:teuthology.orchestra.run.smithi101.stdout: { 2023-08-01T19:54:25.021 INFO:teuthology.orchestra.run.smithi101.stdout: "event": "dispatched", 2023-08-01T19:54:25.022 INFO:teuthology.orchestra.run.smithi101.stdout: "time": "2023-08-01T19:54:04.459188+0000", 2023-08-01T19:54:25.022 INFO:teuthology.orchestra.run.smithi101.stdout: "duration": 6.6680000000000004e-06 2023-08-01T19:54:25.022 INFO:teuthology.orchestra.run.smithi101.stdout: }, 2023-08-01T19:54:25.022 INFO:teuthology.orchestra.run.smithi101.stdout: { 2023-08-01T19:54:25.022 INFO:teuthology.orchestra.run.smithi101.stdout: "event": "queued_for_pg", 2023-08-01T19:54:25.022 INFO:teuthology.orchestra.run.smithi101.stdout: "time": "2023-08-01T19:54:04.459192+0000", 2023-08-01T19:54:25.022 INFO:teuthology.orchestra.run.smithi101.stdout: "duration": 4.228e-06 2023-08-01T19:54:25.022 INFO:teuthology.orchestra.run.smithi101.stdout: }, 2023-08-01T19:54:25.023 INFO:teuthology.orchestra.run.smithi101.stdout: { 2023-08-01T19:54:25.023 INFO:teuthology.orchestra.run.smithi101.stdout: "event": "reached_pg", 2023-08-01T19:54:25.023 INFO:teuthology.orchestra.run.smithi101.stdout: "time": "2023-08-01T19:54:04.459219+0000", 2023-08-01T19:54:25.023 INFO:teuthology.orchestra.run.smithi101.stdout: "duration": 2.6930000000000001e-05 2023-08-01T19:54:25.023 INFO:teuthology.orchestra.run.smithi101.stdout: }, 2023-08-01T19:54:25.023 INFO:teuthology.orchestra.run.smithi101.stdout: { 2023-08-01T19:54:25.023 INFO:teuthology.orchestra.run.smithi101.stdout: "event": "waiting_for_map not empty", 2023-08-01T19:54:25.024 INFO:teuthology.orchestra.run.smithi101.stdout: "time": "2023-08-01T19:54:04.459223+0000", 2023-08-01T19:54:25.024 INFO:teuthology.orchestra.run.smithi101.stdout: "duration": 3.8469999999999998e-06 2023-08-01T19:54:25.024 INFO:teuthology.orchestra.run.smithi101.stdout: }, 2023-08-01T19:54:25.024 INFO:teuthology.orchestra.run.smithi101.stdout: { 2023-08-01T19:54:25.024 INFO:teuthology.orchestra.run.smithi101.stdout: "event": "reached_pg", 2023-08-01T19:54:25.024 INFO:teuthology.orchestra.run.smithi101.stdout: "time": "2023-08-01T19:54:04.473347+0000", 2023-08-01T19:54:25.024 INFO:teuthology.orchestra.run.smithi101.stdout: "duration": 0.014124319 2023-08-01T19:54:25.024 INFO:teuthology.orchestra.run.smithi101.stdout: }, 2023-08-01T19:54:25.025 INFO:teuthology.orchestra.run.smithi101.stdout: { 2023-08-01T19:54:25.025 INFO:teuthology.orchestra.run.smithi101.stdout: "event": "started", 2023-08-01T19:54:25.025 INFO:teuthology.orchestra.run.smithi101.stdout: "time": "2023-08-01T19:54:04.473480+0000", 2023-08-01T19:54:25.025 INFO:teuthology.orchestra.run.smithi101.stdout: "duration": 0.00013276799999999999 2023-08-01T19:54:25.025 INFO:teuthology.orchestra.run.smithi101.stdout: }, 2023-08-01T19:54:25.025 INFO:teuthology.orchestra.run.smithi101.stdout: { 2023-08-01T19:54:25.025 INFO:teuthology.orchestra.run.smithi101.stdout: "event": "waiting for subops from 2", 2023-08-01T19:54:25.025 INFO:teuthology.orchestra.run.smithi101.stdout: "time": "2023-08-01T19:54:04.473622+0000", 2023-08-01T19:54:25.026 INFO:teuthology.orchestra.run.smithi101.stdout: "duration": 0.00014154799999999999 2023-08-01T19:54:25.026 INFO:teuthology.orchestra.run.smithi101.stdout: }, 2023-08-01T19:54:25.026 INFO:teuthology.orchestra.run.smithi101.stdout: { 2023-08-01T19:54:25.026 INFO:teuthology.orchestra.run.smithi101.stdout: "event": "op_commit", 2023-08-01T19:54:25.026 INFO:teuthology.orchestra.run.smithi101.stdout: "time": "2023-08-01T19:54:04.478281+0000", 2023-08-01T19:54:25.026 INFO:teuthology.orchestra.run.smithi101.stdout: "duration": 0.004659252 2023-08-01T19:54:25.026 INFO:teuthology.orchestra.run.smithi101.stdout: }, 2023-08-01T19:54:25.027 INFO:teuthology.orchestra.run.smithi101.stdout: { 2023-08-01T19:54:25.027 INFO:teuthology.orchestra.run.smithi101.stdout: "event": "sub_op_commit_rec", 2023-08-01T19:54:25.027 INFO:teuthology.orchestra.run.smithi101.stdout: "time": "2023-08-01T19:54:04.480180+0000", 2023-08-01T19:54:25.027 INFO:teuthology.orchestra.run.smithi101.stdout: "duration": 0.0018986859999999999 2023-08-01T19:54:25.027 INFO:teuthology.orchestra.run.smithi101.stdout: }, 2023-08-01T19:54:25.027 INFO:teuthology.orchestra.run.smithi101.stdout: { 2023-08-01T19:54:25.027 INFO:teuthology.orchestra.run.smithi101.stdout: "event": "commit_sent", 2023-08-01T19:54:25.027 INFO:teuthology.orchestra.run.smithi101.stdout: "time": "2023-08-01T19:54:04.480209+0000", 2023-08-01T19:54:25.028 INFO:teuthology.orchestra.run.smithi101.stdout: "duration": 2.9244999999999999e-05 2023-08-01T19:54:25.028 INFO:teuthology.orchestra.run.smithi101.stdout: }, 2023-08-01T19:54:25.028 INFO:teuthology.orchestra.run.smithi101.stdout: { 2023-08-01T19:54:25.028 INFO:teuthology.orchestra.run.smithi101.stdout: "event": "done", 2023-08-01T19:54:25.028 INFO:teuthology.orchestra.run.smithi101.stdout: "time": "2023-08-01T19:54:04.480244+0000", 2023-08-01T19:54:25.028 INFO:teuthology.orchestra.run.smithi101.stdout: "duration": 3.4875000000000001e-05 2023-08-01T19:54:25.028 INFO:teuthology.orchestra.run.smithi101.stdout: } 2023-08-01T19:54:25.028 INFO:teuthology.orchestra.run.smithi101.stdout: ] 2023-08-01T19:54:25.029 INFO:teuthology.orchestra.run.smithi101.stdout: } 2023-08-01T19:54:25.029 INFO:teuthology.orchestra.run.smithi101.stdout: }, 2023-08-01T19:54:25.029 INFO:teuthology.orchestra.run.smithi101.stdout: { 2023-08-01T19:54:25.029 INFO:teuthology.orchestra.run.smithi101.stdout: "description": "osd_op(mds.0.3:2 3.f 3:f1f69726:::400.00000000:head [writefull 0~22] snapc 0=[] ondisk+write+known_if_redirected+full_force+supports_pool_eio e17)", 2023-08-01T19:54:25.029 INFO:teuthology.orchestra.run.smithi101.stdout: "initiated_at": "2023-08-01T19:54:04.459201+0000", 2023-08-01T19:54:25.029 INFO:teuthology.orchestra.run.smithi101.stdout: "age": 20.396380182000001, 2023-08-01T19:54:25.029 INFO:teuthology.orchestra.run.smithi101.stdout: "duration": 0.016952979, 2023-08-01T19:54:25.029 INFO:teuthology.orchestra.run.smithi101.stdout: "type_data": { 2023-08-01T19:54:25.030 INFO:teuthology.orchestra.run.smithi101.stdout: "flag_point": "commit sent; apply or cleanup", 2023-08-01T19:54:25.030 INFO:teuthology.orchestra.run.smithi101.stdout: "events": [ 2023-08-01T19:54:25.030 INFO:teuthology.orchestra.run.smithi101.stdout: { 2023-08-01T19:54:25.030 INFO:teuthology.orchestra.run.smithi101.stdout: "event": "initiated", 2023-08-01T19:54:25.030 INFO:teuthology.orchestra.run.smithi101.stdout: "time": "2023-08-01T19:54:04.459201+0000", 2023-08-01T19:54:25.030 INFO:teuthology.orchestra.run.smithi101.stdout: "duration": 0 2023-08-01T19:54:25.030 INFO:teuthology.orchestra.run.smithi101.stdout: }, 2023-08-01T19:54:25.030 INFO:teuthology.orchestra.run.smithi101.stdout: { 2023-08-01T19:54:25.031 INFO:teuthology.orchestra.run.smithi101.stdout: "event": "throttled", 2023-08-01T19:54:25.031 INFO:teuthology.orchestra.run.smithi101.stdout: "time": "2023-08-01T19:54:04.459201+0000", 2023-08-01T19:54:25.031 INFO:teuthology.orchestra.run.smithi101.stdout: "duration": 0 2023-08-01T19:54:25.031 INFO:teuthology.orchestra.run.smithi101.stdout: }, 2023-08-01T19:54:25.031 INFO:teuthology.orchestra.run.smithi101.stdout: { 2023-08-01T19:54:25.031 INFO:teuthology.orchestra.run.smithi101.stdout: "event": "header_read", 2023-08-01T19:54:25.031 INFO:teuthology.orchestra.run.smithi101.stdout: "time": "2023-08-01T19:54:04.459201+0000", 2023-08-01T19:54:25.032 INFO:teuthology.orchestra.run.smithi101.stdout: "duration": 4294967295.9999995 2023-08-01T19:54:25.032 INFO:teuthology.orchestra.run.smithi101.stdout: }, 2023-08-01T19:54:25.032 INFO:teuthology.orchestra.run.smithi101.stdout: { 2023-08-01T19:54:25.032 INFO:teuthology.orchestra.run.smithi101.stdout: "event": "all_read", 2023-08-01T19:54:25.032 INFO:teuthology.orchestra.run.smithi101.stdout: "time": "2023-08-01T19:54:04.459204+0000", 2023-08-01T19:54:25.032 INFO:teuthology.orchestra.run.smithi101.stdout: "duration": 3.5599999999999998e-06 2023-08-01T19:54:25.032 INFO:teuthology.orchestra.run.smithi101.stdout: }, 2023-08-01T19:54:25.032 INFO:teuthology.orchestra.run.smithi101.stdout: { 2023-08-01T19:54:25.033 INFO:teuthology.orchestra.run.smithi101.stdout: "event": "dispatched", 2023-08-01T19:54:25.033 INFO:teuthology.orchestra.run.smithi101.stdout: "time": "2023-08-01T19:54:04.459211+0000", 2023-08-01T19:54:25.033 INFO:teuthology.orchestra.run.smithi101.stdout: "duration": 6.9299999999999997e-06 2023-08-01T19:54:25.033 INFO:teuthology.orchestra.run.smithi101.stdout: }, 2023-08-01T19:54:25.033 INFO:teuthology.orchestra.run.smithi101.stdout: { 2023-08-01T19:54:25.033 INFO:teuthology.orchestra.run.smithi101.stdout: "event": "queued_for_pg", 2023-08-01T19:54:25.033 INFO:teuthology.orchestra.run.smithi101.stdout: "time": "2023-08-01T19:54:04.459216+0000", 2023-08-01T19:54:25.033 INFO:teuthology.orchestra.run.smithi101.stdout: "duration": 4.5050000000000001e-06 2023-08-01T19:54:25.034 INFO:teuthology.orchestra.run.smithi101.stdout: }, 2023-08-01T19:54:25.034 INFO:teuthology.orchestra.run.smithi101.stdout: { 2023-08-01T19:54:25.034 INFO:teuthology.orchestra.run.smithi101.stdout: "event": "reached_pg", 2023-08-01T19:54:25.034 INFO:teuthology.orchestra.run.smithi101.stdout: "time": "2023-08-01T19:54:04.459246+0000", 2023-08-01T19:54:25.034 INFO:teuthology.orchestra.run.smithi101.stdout: "duration": 3.0369999999999999e-05 2023-08-01T19:54:25.034 INFO:teuthology.orchestra.run.smithi101.stdout: }, 2023-08-01T19:54:25.034 INFO:teuthology.orchestra.run.smithi101.stdout: { 2023-08-01T19:54:25.035 INFO:teuthology.orchestra.run.smithi101.stdout: "event": "op must wait for map", 2023-08-01T19:54:25.035 INFO:teuthology.orchestra.run.smithi101.stdout: "time": "2023-08-01T19:54:04.459250+0000", 2023-08-01T19:54:25.035 INFO:teuthology.orchestra.run.smithi101.stdout: "duration": 3.6880000000000001e-06 2023-08-01T19:54:25.035 INFO:teuthology.orchestra.run.smithi101.stdout: }, 2023-08-01T19:54:25.035 INFO:teuthology.orchestra.run.smithi101.stdout: { 2023-08-01T19:54:25.035 INFO:teuthology.orchestra.run.smithi101.stdout: "event": "reached_pg", 2023-08-01T19:54:25.035 INFO:teuthology.orchestra.run.smithi101.stdout: "time": "2023-08-01T19:54:04.469499+0000", 2023-08-01T19:54:25.035 INFO:teuthology.orchestra.run.smithi101.stdout: "duration": 0.010249052 2023-08-01T19:54:25.036 INFO:teuthology.orchestra.run.smithi101.stdout: }, 2023-08-01T19:54:25.036 INFO:teuthology.orchestra.run.smithi101.stdout: { 2023-08-01T19:54:25.036 INFO:teuthology.orchestra.run.smithi101.stdout: "event": "started", 2023-08-01T19:54:25.036 INFO:teuthology.orchestra.run.smithi101.stdout: "time": "2023-08-01T19:54:04.469619+0000", 2023-08-01T19:54:25.036 INFO:teuthology.orchestra.run.smithi101.stdout: "duration": 0.000120061 2023-08-01T19:54:25.036 INFO:teuthology.orchestra.run.smithi101.stdout: }, 2023-08-01T19:54:25.036 INFO:teuthology.orchestra.run.smithi101.stdout: { 2023-08-01T19:54:25.036 INFO:teuthology.orchestra.run.smithi101.stdout: "event": "waiting for subops from 2", 2023-08-01T19:54:25.037 INFO:teuthology.orchestra.run.smithi101.stdout: "time": "2023-08-01T19:54:04.469903+0000", 2023-08-01T19:54:25.037 INFO:teuthology.orchestra.run.smithi101.stdout: "duration": 0.00028409799999999999 2023-08-01T19:54:25.037 INFO:teuthology.orchestra.run.smithi101.stdout: }, 2023-08-01T19:54:25.037 INFO:teuthology.orchestra.run.smithi101.stdout: { 2023-08-01T19:54:25.037 INFO:teuthology.orchestra.run.smithi101.stdout: "event": "sub_op_commit_rec", 2023-08-01T19:54:25.037 INFO:teuthology.orchestra.run.smithi101.stdout: "time": "2023-08-01T19:54:04.475166+0000", 2023-08-01T19:54:25.037 INFO:teuthology.orchestra.run.smithi101.stdout: "duration": 0.0052632460000000001 2023-08-01T19:54:25.038 INFO:teuthology.orchestra.run.smithi101.stdout: }, 2023-08-01T19:54:25.038 INFO:teuthology.orchestra.run.smithi101.stdout: { 2023-08-01T19:54:25.038 INFO:teuthology.orchestra.run.smithi101.stdout: "event": "op_commit", 2023-08-01T19:54:25.038 INFO:teuthology.orchestra.run.smithi101.stdout: "time": "2023-08-01T19:54:04.476056+0000", 2023-08-01T19:54:25.038 INFO:teuthology.orchestra.run.smithi101.stdout: "duration": 0.00089017499999999999 2023-08-01T19:54:25.038 INFO:teuthology.orchestra.run.smithi101.stdout: }, 2023-08-01T19:54:25.038 INFO:teuthology.orchestra.run.smithi101.stdout: { 2023-08-01T19:54:25.038 INFO:teuthology.orchestra.run.smithi101.stdout: "event": "commit_sent", 2023-08-01T19:54:25.039 INFO:teuthology.orchestra.run.smithi101.stdout: "time": "2023-08-01T19:54:04.476115+0000", 2023-08-01T19:54:25.039 INFO:teuthology.orchestra.run.smithi101.stdout: "duration": 5.8464999999999997e-05 2023-08-01T19:54:25.039 INFO:teuthology.orchestra.run.smithi101.stdout: }, 2023-08-01T19:54:25.039 INFO:teuthology.orchestra.run.smithi101.stdout: { 2023-08-01T19:54:25.039 INFO:teuthology.orchestra.run.smithi101.stdout: "event": "done", 2023-08-01T19:54:25.039 INFO:teuthology.orchestra.run.smithi101.stdout: "time": "2023-08-01T19:54:04.476154+0000", 2023-08-01T19:54:25.039 INFO:teuthology.orchestra.run.smithi101.stdout: "duration": 3.9229e-05 2023-08-01T19:54:25.039 INFO:teuthology.orchestra.run.smithi101.stdout: } 2023-08-01T19:54:25.040 INFO:teuthology.orchestra.run.smithi101.stdout: ] 2023-08-01T19:54:25.040 INFO:teuthology.orchestra.run.smithi101.stdout: } 2023-08-01T19:54:25.040 INFO:teuthology.orchestra.run.smithi101.stdout: }, 2023-08-01T19:54:25.040 INFO:teuthology.orchestra.run.smithi101.stdout: { 2023-08-01T19:54:25.040 INFO:teuthology.orchestra.run.smithi101.stdout: "description": "osd_op(mds.0.3:3 3.14 3:287034c4:::1.00000000.inode:head [writefull 0~554] snapc 0=[] ondisk+write+known_if_redirected+full_force+supports_pool_eio e17)", 2023-08-01T19:54:25.040 INFO:teuthology.orchestra.run.smithi101.stdout: "initiated_at": "2023-08-01T19:54:04.459226+0000", 2023-08-01T19:54:25.040 INFO:teuthology.orchestra.run.smithi101.stdout: "age": 20.396355359000001, 2023-08-01T19:54:25.040 INFO:teuthology.orchestra.run.smithi101.stdout: "duration": 0.021104531999999999, 2023-08-01T19:54:25.041 INFO:teuthology.orchestra.run.smithi101.stdout: "type_data": { 2023-08-01T19:54:25.041 INFO:teuthology.orchestra.run.smithi101.stdout: "flag_point": "commit sent; apply or cleanup", 2023-08-01T19:54:25.041 INFO:teuthology.orchestra.run.smithi101.stdout: "events": [ 2023-08-01T19:54:25.041 INFO:teuthology.orchestra.run.smithi101.stdout: { 2023-08-01T19:54:25.041 INFO:teuthology.orchestra.run.smithi101.stdout: "event": "initiated", 2023-08-01T19:54:25.041 INFO:teuthology.orchestra.run.smithi101.stdout: "time": "2023-08-01T19:54:04.459226+0000", 2023-08-01T19:54:25.041 INFO:teuthology.orchestra.run.smithi101.stdout: "duration": 0 2023-08-01T19:54:25.042 INFO:teuthology.orchestra.run.smithi101.stdout: }, 2023-08-01T19:54:25.042 INFO:teuthology.orchestra.run.smithi101.stdout: { 2023-08-01T19:54:25.042 INFO:teuthology.orchestra.run.smithi101.stdout: "event": "throttled", 2023-08-01T19:54:25.042 INFO:teuthology.orchestra.run.smithi101.stdout: "time": "2023-08-01T19:54:04.459226+0000", 2023-08-01T19:54:25.042 INFO:teuthology.orchestra.run.smithi101.stdout: "duration": 0 2023-08-01T19:54:25.042 INFO:teuthology.orchestra.run.smithi101.stdout: }, 2023-08-01T19:54:25.042 INFO:teuthology.orchestra.run.smithi101.stdout: { 2023-08-01T19:54:25.042 INFO:teuthology.orchestra.run.smithi101.stdout: "event": "header_read", 2023-08-01T19:54:25.043 INFO:teuthology.orchestra.run.smithi101.stdout: "time": "2023-08-01T19:54:04.459225+0000", 2023-08-01T19:54:25.043 INFO:teuthology.orchestra.run.smithi101.stdout: "duration": 4294967295.9999995 2023-08-01T19:54:25.043 INFO:teuthology.orchestra.run.smithi101.stdout: }, 2023-08-01T19:54:25.043 INFO:teuthology.orchestra.run.smithi101.stdout: { 2023-08-01T19:54:25.043 INFO:teuthology.orchestra.run.smithi101.stdout: "event": "all_read", 2023-08-01T19:54:25.043 INFO:teuthology.orchestra.run.smithi101.stdout: "time": "2023-08-01T19:54:04.459238+0000", 2023-08-01T19:54:25.043 INFO:teuthology.orchestra.run.smithi101.stdout: "duration": 1.2809000000000001e-05 2023-08-01T19:54:25.043 INFO:teuthology.orchestra.run.smithi101.stdout: }, 2023-08-01T19:54:25.044 INFO:teuthology.orchestra.run.smithi101.stdout: { 2023-08-01T19:54:25.044 INFO:teuthology.orchestra.run.smithi101.stdout: "event": "dispatched", 2023-08-01T19:54:25.044 INFO:teuthology.orchestra.run.smithi101.stdout: "time": "2023-08-01T19:54:04.459245+0000", 2023-08-01T19:54:25.044 INFO:teuthology.orchestra.run.smithi101.stdout: "duration": 6.6540000000000002e-06 2023-08-01T19:54:25.044 INFO:teuthology.orchestra.run.smithi101.stdout: }, 2023-08-01T19:54:25.044 INFO:teuthology.orchestra.run.smithi101.stdout: { 2023-08-01T19:54:25.044 INFO:teuthology.orchestra.run.smithi101.stdout: "event": "queued_for_pg", 2023-08-01T19:54:25.045 INFO:teuthology.orchestra.run.smithi101.stdout: "time": "2023-08-01T19:54:04.459249+0000", 2023-08-01T19:54:25.045 INFO:teuthology.orchestra.run.smithi101.stdout: "duration": 4.6e-06 2023-08-01T19:54:25.045 INFO:teuthology.orchestra.run.smithi101.stdout: }, 2023-08-01T19:54:25.045 INFO:teuthology.orchestra.run.smithi101.stdout: { 2023-08-01T19:54:25.045 INFO:teuthology.orchestra.run.smithi101.stdout: "event": "reached_pg", 2023-08-01T19:54:25.045 INFO:teuthology.orchestra.run.smithi101.stdout: "time": "2023-08-01T19:54:04.459276+0000", 2023-08-01T19:54:25.045 INFO:teuthology.orchestra.run.smithi101.stdout: "duration": 2.6373999999999999e-05 2023-08-01T19:54:25.045 INFO:teuthology.orchestra.run.smithi101.stdout: }, 2023-08-01T19:54:25.046 INFO:teuthology.orchestra.run.smithi101.stdout: { 2023-08-01T19:54:25.046 INFO:teuthology.orchestra.run.smithi101.stdout: "event": "waiting_for_map not empty", 2023-08-01T19:54:25.046 INFO:teuthology.orchestra.run.smithi101.stdout: "time": "2023-08-01T19:54:04.459278+0000", 2023-08-01T19:54:25.046 INFO:teuthology.orchestra.run.smithi101.stdout: "duration": 2.4980000000000001e-06 2023-08-01T19:54:25.046 INFO:teuthology.orchestra.run.smithi101.stdout: }, 2023-08-01T19:54:25.046 INFO:teuthology.orchestra.run.smithi101.stdout: { 2023-08-01T19:54:25.046 INFO:teuthology.orchestra.run.smithi101.stdout: "event": "reached_pg", 2023-08-01T19:54:25.047 INFO:teuthology.orchestra.run.smithi101.stdout: "time": "2023-08-01T19:54:04.474058+0000", 2023-08-01T19:54:25.047 INFO:teuthology.orchestra.run.smithi101.stdout: "duration": 0.014779979 2023-08-01T19:54:25.047 INFO:teuthology.orchestra.run.smithi101.stdout: }, 2023-08-01T19:54:25.047 INFO:teuthology.orchestra.run.smithi101.stdout: { 2023-08-01T19:54:25.047 INFO:teuthology.orchestra.run.smithi101.stdout: "event": "started", 2023-08-01T19:54:25.047 INFO:teuthology.orchestra.run.smithi101.stdout: "time": "2023-08-01T19:54:04.474614+0000", 2023-08-01T19:54:25.047 INFO:teuthology.orchestra.run.smithi101.stdout: "duration": 0.00055546899999999995 2023-08-01T19:54:25.047 INFO:teuthology.orchestra.run.smithi101.stdout: }, 2023-08-01T19:54:25.048 INFO:teuthology.orchestra.run.smithi101.stdout: { 2023-08-01T19:54:25.048 INFO:teuthology.orchestra.run.smithi101.stdout: "event": "waiting for subops from 2", 2023-08-01T19:54:25.048 INFO:teuthology.orchestra.run.smithi101.stdout: "time": "2023-08-01T19:54:04.474720+0000", 2023-08-01T19:54:25.048 INFO:teuthology.orchestra.run.smithi101.stdout: "duration": 0.00010645300000000001 2023-08-01T19:54:25.048 INFO:teuthology.orchestra.run.smithi101.stdout: }, 2023-08-01T19:54:25.048 INFO:teuthology.orchestra.run.smithi101.stdout: { 2023-08-01T19:54:25.048 INFO:teuthology.orchestra.run.smithi101.stdout: "event": "op_commit", 2023-08-01T19:54:25.048 INFO:teuthology.orchestra.run.smithi101.stdout: "time": "2023-08-01T19:54:04.478480+0000", 2023-08-01T19:54:25.049 INFO:teuthology.orchestra.run.smithi101.stdout: "duration": 0.0037600279999999999 2023-08-01T19:54:25.049 INFO:teuthology.orchestra.run.smithi101.stdout: }, 2023-08-01T19:54:25.049 INFO:teuthology.orchestra.run.smithi101.stdout: { 2023-08-01T19:54:25.049 INFO:teuthology.orchestra.run.smithi101.stdout: "event": "sub_op_commit_rec", 2023-08-01T19:54:25.049 INFO:teuthology.orchestra.run.smithi101.stdout: "time": "2023-08-01T19:54:04.480273+0000", 2023-08-01T19:54:25.049 INFO:teuthology.orchestra.run.smithi101.stdout: "duration": 0.001792465 2023-08-01T19:54:25.049 INFO:teuthology.orchestra.run.smithi101.stdout: }, 2023-08-01T19:54:25.049 INFO:teuthology.orchestra.run.smithi101.stdout: { 2023-08-01T19:54:25.050 INFO:teuthology.orchestra.run.smithi101.stdout: "event": "commit_sent", 2023-08-01T19:54:25.050 INFO:teuthology.orchestra.run.smithi101.stdout: "time": "2023-08-01T19:54:04.480304+0000", 2023-08-01T19:54:25.050 INFO:teuthology.orchestra.run.smithi101.stdout: "duration": 3.1708999999999997e-05 2023-08-01T19:54:25.050 INFO:teuthology.orchestra.run.smithi101.stdout: }, 2023-08-01T19:54:25.050 INFO:teuthology.orchestra.run.smithi101.stdout: { 2023-08-01T19:54:25.050 INFO:teuthology.orchestra.run.smithi101.stdout: "event": "done", 2023-08-01T19:54:25.050 INFO:teuthology.orchestra.run.smithi101.stdout: "time": "2023-08-01T19:54:04.480330+0000", 2023-08-01T19:54:25.051 INFO:teuthology.orchestra.run.smithi101.stdout: "duration": 2.5860999999999999e-05 2023-08-01T19:54:25.051 INFO:teuthology.orchestra.run.smithi101.stdout: } 2023-08-01T19:54:25.051 INFO:teuthology.orchestra.run.smithi101.stdout: ] 2023-08-01T19:54:25.051 INFO:teuthology.orchestra.run.smithi101.stdout: } 2023-08-01T19:54:25.051 INFO:teuthology.orchestra.run.smithi101.stdout: }, 2023-08-01T19:54:25.051 INFO:teuthology.orchestra.run.smithi101.stdout: { 2023-08-01T19:54:25.051 INFO:teuthology.orchestra.run.smithi101.stdout: "description": "osd_op(mds.0.3:27 3.13 3:c91d4a1d:::mds0_inotable:head [writefull 0~34] snapc 0=[] ondisk+write+known_if_redirected+full_force+supports_pool_eio e17)", 2023-08-01T19:54:25.051 INFO:teuthology.orchestra.run.smithi101.stdout: "initiated_at": "2023-08-01T19:54:04.459260+0000", 2023-08-01T19:54:25.052 INFO:teuthology.orchestra.run.smithi101.stdout: "age": 20.396321468, 2023-08-01T19:54:25.052 INFO:teuthology.orchestra.run.smithi101.stdout: "duration": 0.016792715999999999, 2023-08-01T19:54:25.052 INFO:teuthology.orchestra.run.smithi101.stdout: "type_data": { 2023-08-01T19:54:25.052 INFO:teuthology.orchestra.run.smithi101.stdout: "flag_point": "commit sent; apply or cleanup", 2023-08-01T19:54:25.052 INFO:teuthology.orchestra.run.smithi101.stdout: "events": [ 2023-08-01T19:54:25.052 INFO:teuthology.orchestra.run.smithi101.stdout: { 2023-08-01T19:54:25.052 INFO:teuthology.orchestra.run.smithi101.stdout: "event": "initiated", 2023-08-01T19:54:25.052 INFO:teuthology.orchestra.run.smithi101.stdout: "time": "2023-08-01T19:54:04.459260+0000", 2023-08-01T19:54:25.053 INFO:teuthology.orchestra.run.smithi101.stdout: "duration": 0 2023-08-01T19:54:25.053 INFO:teuthology.orchestra.run.smithi101.stdout: }, 2023-08-01T19:54:25.053 INFO:teuthology.orchestra.run.smithi101.stdout: { 2023-08-01T19:54:25.053 INFO:teuthology.orchestra.run.smithi101.stdout: "event": "throttled", 2023-08-01T19:54:25.053 INFO:teuthology.orchestra.run.smithi101.stdout: "time": "2023-08-01T19:54:04.459260+0000", 2023-08-01T19:54:25.053 INFO:teuthology.orchestra.run.smithi101.stdout: "duration": 0 2023-08-01T19:54:25.053 INFO:teuthology.orchestra.run.smithi101.stdout: }, 2023-08-01T19:54:25.053 INFO:teuthology.orchestra.run.smithi101.stdout: { 2023-08-01T19:54:25.054 INFO:teuthology.orchestra.run.smithi101.stdout: "event": "header_read", 2023-08-01T19:54:25.054 INFO:teuthology.orchestra.run.smithi101.stdout: "time": "2023-08-01T19:54:04.459259+0000", 2023-08-01T19:54:25.054 INFO:teuthology.orchestra.run.smithi101.stdout: "duration": 4294967295.9999995 2023-08-01T19:54:25.054 INFO:teuthology.orchestra.run.smithi101.stdout: }, 2023-08-01T19:54:25.054 INFO:teuthology.orchestra.run.smithi101.stdout: { 2023-08-01T19:54:25.054 INFO:teuthology.orchestra.run.smithi101.stdout: "event": "all_read", 2023-08-01T19:54:25.054 INFO:teuthology.orchestra.run.smithi101.stdout: "time": "2023-08-01T19:54:04.459263+0000", 2023-08-01T19:54:25.055 INFO:teuthology.orchestra.run.smithi101.stdout: "duration": 3.9249999999999997e-06 2023-08-01T19:54:25.055 INFO:teuthology.orchestra.run.smithi101.stdout: }, 2023-08-01T19:54:25.055 INFO:teuthology.orchestra.run.smithi101.stdout: { 2023-08-01T19:54:25.055 INFO:teuthology.orchestra.run.smithi101.stdout: "event": "dispatched", 2023-08-01T19:54:25.055 INFO:teuthology.orchestra.run.smithi101.stdout: "time": "2023-08-01T19:54:04.459270+0000", 2023-08-01T19:54:25.055 INFO:teuthology.orchestra.run.smithi101.stdout: "duration": 7.0180000000000004e-06 2023-08-01T19:54:25.055 INFO:teuthology.orchestra.run.smithi101.stdout: }, 2023-08-01T19:54:25.055 INFO:teuthology.orchestra.run.smithi101.stdout: { 2023-08-01T19:54:25.056 INFO:teuthology.orchestra.run.smithi101.stdout: "event": "queued_for_pg", 2023-08-01T19:54:25.056 INFO:teuthology.orchestra.run.smithi101.stdout: "time": "2023-08-01T19:54:04.459275+0000", 2023-08-01T19:54:25.056 INFO:teuthology.orchestra.run.smithi101.stdout: "duration": 4.763e-06 2023-08-01T19:54:25.056 INFO:teuthology.orchestra.run.smithi101.stdout: }, 2023-08-01T19:54:25.056 INFO:teuthology.orchestra.run.smithi101.stdout: { 2023-08-01T19:54:25.056 INFO:teuthology.orchestra.run.smithi101.stdout: "event": "reached_pg", 2023-08-01T19:54:25.056 INFO:teuthology.orchestra.run.smithi101.stdout: "time": "2023-08-01T19:54:04.459298+0000", 2023-08-01T19:54:25.057 INFO:teuthology.orchestra.run.smithi101.stdout: "duration": 2.3193e-05 2023-08-01T19:54:25.057 INFO:teuthology.orchestra.run.smithi101.stdout: }, 2023-08-01T19:54:25.057 INFO:teuthology.orchestra.run.smithi101.stdout: { 2023-08-01T19:54:25.057 INFO:teuthology.orchestra.run.smithi101.stdout: "event": "waiting_for_map not empty", 2023-08-01T19:54:25.057 INFO:teuthology.orchestra.run.smithi101.stdout: "time": "2023-08-01T19:54:04.459301+0000", 2023-08-01T19:54:25.057 INFO:teuthology.orchestra.run.smithi101.stdout: "duration": 3.0539999999999999e-06 2023-08-01T19:54:25.057 INFO:teuthology.orchestra.run.smithi101.stdout: }, 2023-08-01T19:54:25.057 INFO:teuthology.orchestra.run.smithi101.stdout: { 2023-08-01T19:54:25.058 INFO:teuthology.orchestra.run.smithi101.stdout: "event": "reached_pg", 2023-08-01T19:54:25.058 INFO:teuthology.orchestra.run.smithi101.stdout: "time": "2023-08-01T19:54:04.469447+0000", 2023-08-01T19:54:25.058 INFO:teuthology.orchestra.run.smithi101.stdout: "duration": 0.010145573999999999 2023-08-01T19:54:25.058 INFO:teuthology.orchestra.run.smithi101.stdout: }, 2023-08-01T19:54:25.058 INFO:teuthology.orchestra.run.smithi101.stdout: { 2023-08-01T19:54:25.058 INFO:teuthology.orchestra.run.smithi101.stdout: "event": "started", 2023-08-01T19:54:25.058 INFO:teuthology.orchestra.run.smithi101.stdout: "time": "2023-08-01T19:54:04.469559+0000", 2023-08-01T19:54:25.058 INFO:teuthology.orchestra.run.smithi101.stdout: "duration": 0.000112068 2023-08-01T19:54:25.059 INFO:teuthology.orchestra.run.smithi101.stdout: }, 2023-08-01T19:54:25.059 INFO:teuthology.orchestra.run.smithi101.stdout: { 2023-08-01T19:54:25.059 INFO:teuthology.orchestra.run.smithi101.stdout: "event": "waiting for subops from 0", 2023-08-01T19:54:25.059 INFO:teuthology.orchestra.run.smithi101.stdout: "time": "2023-08-01T19:54:04.469895+0000", 2023-08-01T19:54:25.059 INFO:teuthology.orchestra.run.smithi101.stdout: "duration": 0.000336604 2023-08-01T19:54:25.059 INFO:teuthology.orchestra.run.smithi101.stdout: }, 2023-08-01T19:54:25.059 INFO:teuthology.orchestra.run.smithi101.stdout: { 2023-08-01T19:54:25.059 INFO:teuthology.orchestra.run.smithi101.stdout: "event": "sub_op_commit_rec", 2023-08-01T19:54:25.060 INFO:teuthology.orchestra.run.smithi101.stdout: "time": "2023-08-01T19:54:04.475096+0000", 2023-08-01T19:54:25.060 INFO:teuthology.orchestra.run.smithi101.stdout: "duration": 0.0052010540000000001 2023-08-01T19:54:25.060 INFO:teuthology.orchestra.run.smithi101.stdout: }, 2023-08-01T19:54:25.060 INFO:teuthology.orchestra.run.smithi101.stdout: { 2023-08-01T19:54:25.060 INFO:teuthology.orchestra.run.smithi101.stdout: "event": "op_commit", 2023-08-01T19:54:25.060 INFO:teuthology.orchestra.run.smithi101.stdout: "time": "2023-08-01T19:54:04.475965+0000", 2023-08-01T19:54:25.060 INFO:teuthology.orchestra.run.smithi101.stdout: "duration": 0.00086860500000000005 2023-08-01T19:54:25.061 INFO:teuthology.orchestra.run.smithi101.stdout: }, 2023-08-01T19:54:25.061 INFO:teuthology.orchestra.run.smithi101.stdout: { 2023-08-01T19:54:25.061 INFO:teuthology.orchestra.run.smithi101.stdout: "event": "commit_sent", 2023-08-01T19:54:25.061 INFO:teuthology.orchestra.run.smithi101.stdout: "time": "2023-08-01T19:54:04.476007+0000", 2023-08-01T19:54:25.061 INFO:teuthology.orchestra.run.smithi101.stdout: "duration": 4.2228000000000003e-05 2023-08-01T19:54:25.061 INFO:teuthology.orchestra.run.smithi101.stdout: }, 2023-08-01T19:54:25.061 INFO:teuthology.orchestra.run.smithi101.stdout: { 2023-08-01T19:54:25.061 INFO:teuthology.orchestra.run.smithi101.stdout: "event": "done", 2023-08-01T19:54:25.062 INFO:teuthology.orchestra.run.smithi101.stdout: "time": "2023-08-01T19:54:04.476052+0000", 2023-08-01T19:54:25.062 INFO:teuthology.orchestra.run.smithi101.stdout: "duration": 4.5188000000000002e-05 2023-08-01T19:54:25.062 INFO:teuthology.orchestra.run.smithi101.stdout: } 2023-08-01T19:54:25.062 INFO:teuthology.orchestra.run.smithi101.stdout: ] 2023-08-01T19:54:25.062 INFO:teuthology.orchestra.run.smithi101.stdout: } 2023-08-01T19:54:25.062 INFO:teuthology.orchestra.run.smithi101.stdout: }, 2023-08-01T19:54:25.062 INFO:teuthology.orchestra.run.smithi101.stdout: { 2023-08-01T19:54:25.062 INFO:teuthology.orchestra.run.smithi101.stdout: "description": "osd_op(mds.0.3:31 3.d 3:b50e409b:::mds_snaptable:head [writefull 0~70] snapc 0=[] ondisk+write+known_if_redirected+full_force+supports_pool_eio e17)", 2023-08-01T19:54:25.063 INFO:teuthology.orchestra.run.smithi101.stdout: "initiated_at": "2023-08-01T19:54:04.459283+0000", 2023-08-01T19:54:25.063 INFO:teuthology.orchestra.run.smithi101.stdout: "age": 20.396298530999999, 2023-08-01T19:54:25.063 INFO:teuthology.orchestra.run.smithi101.stdout: "duration": 0.01676277, 2023-08-01T19:54:25.063 INFO:teuthology.orchestra.run.smithi101.stdout: "type_data": { 2023-08-01T19:54:25.063 INFO:teuthology.orchestra.run.smithi101.stdout: "flag_point": "commit sent; apply or cleanup", 2023-08-01T19:54:25.063 INFO:teuthology.orchestra.run.smithi101.stdout: "events": [ 2023-08-01T19:54:25.063 INFO:teuthology.orchestra.run.smithi101.stdout: { 2023-08-01T19:54:25.063 INFO:teuthology.orchestra.run.smithi101.stdout: "event": "initiated", 2023-08-01T19:54:25.064 INFO:teuthology.orchestra.run.smithi101.stdout: "time": "2023-08-01T19:54:04.459283+0000", 2023-08-01T19:54:25.064 INFO:teuthology.orchestra.run.smithi101.stdout: "duration": 0 2023-08-01T19:54:25.064 INFO:teuthology.orchestra.run.smithi101.stdout: }, 2023-08-01T19:54:25.064 INFO:teuthology.orchestra.run.smithi101.stdout: { 2023-08-01T19:54:25.064 INFO:teuthology.orchestra.run.smithi101.stdout: "event": "throttled", 2023-08-01T19:54:25.064 INFO:teuthology.orchestra.run.smithi101.stdout: "time": "2023-08-01T19:54:04.459283+0000", 2023-08-01T19:54:25.064 INFO:teuthology.orchestra.run.smithi101.stdout: "duration": 0 2023-08-01T19:54:25.065 INFO:teuthology.orchestra.run.smithi101.stdout: }, 2023-08-01T19:54:25.065 INFO:teuthology.orchestra.run.smithi101.stdout: { 2023-08-01T19:54:25.065 INFO:teuthology.orchestra.run.smithi101.stdout: "event": "header_read", 2023-08-01T19:54:25.065 INFO:teuthology.orchestra.run.smithi101.stdout: "time": "2023-08-01T19:54:04.459282+0000", 2023-08-01T19:54:25.065 INFO:teuthology.orchestra.run.smithi101.stdout: "duration": 4294967295.9999995 2023-08-01T19:54:25.065 INFO:teuthology.orchestra.run.smithi101.stdout: }, 2023-08-01T19:54:25.065 INFO:teuthology.orchestra.run.smithi101.stdout: { 2023-08-01T19:54:25.065 INFO:teuthology.orchestra.run.smithi101.stdout: "event": "all_read", 2023-08-01T19:54:25.066 INFO:teuthology.orchestra.run.smithi101.stdout: "time": "2023-08-01T19:54:04.459285+0000", 2023-08-01T19:54:25.066 INFO:teuthology.orchestra.run.smithi101.stdout: "duration": 3.2590000000000001e-06 2023-08-01T19:54:25.066 INFO:teuthology.orchestra.run.smithi101.stdout: }, 2023-08-01T19:54:25.066 INFO:teuthology.orchestra.run.smithi101.stdout: { 2023-08-01T19:54:25.066 INFO:teuthology.orchestra.run.smithi101.stdout: "event": "dispatched", 2023-08-01T19:54:25.066 INFO:teuthology.orchestra.run.smithi101.stdout: "time": "2023-08-01T19:54:04.459291+0000", 2023-08-01T19:54:25.066 INFO:teuthology.orchestra.run.smithi101.stdout: "duration": 6.0750000000000003e-06 2023-08-01T19:54:25.067 INFO:teuthology.orchestra.run.smithi101.stdout: }, 2023-08-01T19:54:25.067 INFO:teuthology.orchestra.run.smithi101.stdout: { 2023-08-01T19:54:25.067 INFO:teuthology.orchestra.run.smithi101.stdout: "event": "queued_for_pg", 2023-08-01T19:54:25.067 INFO:teuthology.orchestra.run.smithi101.stdout: "time": "2023-08-01T19:54:04.459295+0000", 2023-08-01T19:54:25.067 INFO:teuthology.orchestra.run.smithi101.stdout: "duration": 3.7500000000000001e-06 2023-08-01T19:54:25.067 INFO:teuthology.orchestra.run.smithi101.stdout: }, 2023-08-01T19:54:25.067 INFO:teuthology.orchestra.run.smithi101.stdout: { 2023-08-01T19:54:25.067 INFO:teuthology.orchestra.run.smithi101.stdout: "event": "reached_pg", 2023-08-01T19:54:25.068 INFO:teuthology.orchestra.run.smithi101.stdout: "time": "2023-08-01T19:54:04.459323+0000", 2023-08-01T19:54:25.068 INFO:teuthology.orchestra.run.smithi101.stdout: "duration": 2.7351e-05 2023-08-01T19:54:25.068 INFO:teuthology.orchestra.run.smithi101.stdout: }, 2023-08-01T19:54:25.068 INFO:teuthology.orchestra.run.smithi101.stdout: { 2023-08-01T19:54:25.068 INFO:teuthology.orchestra.run.smithi101.stdout: "event": "op must wait for map", 2023-08-01T19:54:25.068 INFO:teuthology.orchestra.run.smithi101.stdout: "time": "2023-08-01T19:54:04.459327+0000", 2023-08-01T19:54:25.068 INFO:teuthology.orchestra.run.smithi101.stdout: "duration": 4.1849999999999997e-06 2023-08-01T19:54:25.068 INFO:teuthology.orchestra.run.smithi101.stdout: }, 2023-08-01T19:54:25.069 INFO:teuthology.orchestra.run.smithi101.stdout: { 2023-08-01T19:54:25.069 INFO:teuthology.orchestra.run.smithi101.stdout: "event": "reached_pg", 2023-08-01T19:54:25.069 INFO:teuthology.orchestra.run.smithi101.stdout: "time": "2023-08-01T19:54:04.468708+0000", 2023-08-01T19:54:25.069 INFO:teuthology.orchestra.run.smithi101.stdout: "duration": 0.0093817420000000002 2023-08-01T19:54:25.069 INFO:teuthology.orchestra.run.smithi101.stdout: }, 2023-08-01T19:54:25.069 INFO:teuthology.orchestra.run.smithi101.stdout: { 2023-08-01T19:54:25.069 INFO:teuthology.orchestra.run.smithi101.stdout: "event": "started", 2023-08-01T19:54:25.069 INFO:teuthology.orchestra.run.smithi101.stdout: "time": "2023-08-01T19:54:04.468830+0000", 2023-08-01T19:54:25.070 INFO:teuthology.orchestra.run.smithi101.stdout: "duration": 0.000121339 2023-08-01T19:54:25.070 INFO:teuthology.orchestra.run.smithi101.stdout: }, 2023-08-01T19:54:25.070 INFO:teuthology.orchestra.run.smithi101.stdout: { 2023-08-01T19:54:25.070 INFO:teuthology.orchestra.run.smithi101.stdout: "event": "waiting for subops from 2", 2023-08-01T19:54:25.070 INFO:teuthology.orchestra.run.smithi101.stdout: "time": "2023-08-01T19:54:04.469611+0000", 2023-08-01T19:54:25.070 INFO:teuthology.orchestra.run.smithi101.stdout: "duration": 0.00078162900000000005 2023-08-01T19:54:25.070 INFO:teuthology.orchestra.run.smithi101.stdout: }, 2023-08-01T19:54:25.070 INFO:teuthology.orchestra.run.smithi101.stdout: { 2023-08-01T19:54:25.071 INFO:teuthology.orchestra.run.smithi101.stdout: "event": "sub_op_commit_rec", 2023-08-01T19:54:25.071 INFO:teuthology.orchestra.run.smithi101.stdout: "time": "2023-08-01T19:54:04.475478+0000", 2023-08-01T19:54:25.071 INFO:teuthology.orchestra.run.smithi101.stdout: "duration": 0.005866586 2023-08-01T19:54:25.071 INFO:teuthology.orchestra.run.smithi101.stdout: }, 2023-08-01T19:54:25.071 INFO:teuthology.orchestra.run.smithi101.stdout: { 2023-08-01T19:54:25.071 INFO:teuthology.orchestra.run.smithi101.stdout: "event": "op_commit", 2023-08-01T19:54:25.071 INFO:teuthology.orchestra.run.smithi101.stdout: "time": "2023-08-01T19:54:04.475941+0000", 2023-08-01T19:54:25.072 INFO:teuthology.orchestra.run.smithi101.stdout: "duration": 0.000462526 2023-08-01T19:54:25.072 INFO:teuthology.orchestra.run.smithi101.stdout: }, 2023-08-01T19:54:25.072 INFO:teuthology.orchestra.run.smithi101.stdout: { 2023-08-01T19:54:25.072 INFO:teuthology.orchestra.run.smithi101.stdout: "event": "commit_sent", 2023-08-01T19:54:25.072 INFO:teuthology.orchestra.run.smithi101.stdout: "time": "2023-08-01T19:54:04.475995+0000", 2023-08-01T19:54:25.072 INFO:teuthology.orchestra.run.smithi101.stdout: "duration": 5.4401000000000003e-05 2023-08-01T19:54:25.072 INFO:teuthology.orchestra.run.smithi101.stdout: }, 2023-08-01T19:54:25.072 INFO:teuthology.orchestra.run.smithi101.stdout: { 2023-08-01T19:54:25.073 INFO:teuthology.orchestra.run.smithi101.stdout: "event": "done", 2023-08-01T19:54:25.073 INFO:teuthology.orchestra.run.smithi101.stdout: "time": "2023-08-01T19:54:04.476045+0000", 2023-08-01T19:54:25.073 INFO:teuthology.orchestra.run.smithi101.stdout: "duration": 5.0389000000000002e-05 2023-08-01T19:54:25.073 INFO:teuthology.orchestra.run.smithi101.stdout: } 2023-08-01T19:54:25.073 INFO:teuthology.orchestra.run.smithi101.stdout: ] 2023-08-01T19:54:25.073 INFO:teuthology.orchestra.run.smithi101.stdout: } 2023-08-01T19:54:25.073 INFO:teuthology.orchestra.run.smithi101.stdout: }, 2023-08-01T19:54:25.073 INFO:teuthology.orchestra.run.smithi101.stdout: { 2023-08-01T19:54:25.074 INFO:teuthology.orchestra.run.smithi101.stdout: "description": "osd_op(mds.0.3:32 3.14 3:2e2fa760:::200.00000001:head [delete] snapc 0=[] ondisk+write+known_if_redirected+full_force+supports_pool_eio e17)", 2023-08-01T19:54:25.074 INFO:teuthology.orchestra.run.smithi101.stdout: "initiated_at": "2023-08-01T19:54:04.459304+0000", 2023-08-01T19:54:25.074 INFO:teuthology.orchestra.run.smithi101.stdout: "age": 20.396276698000001, 2023-08-01T19:54:25.074 INFO:teuthology.orchestra.run.smithi101.stdout: "duration": 0.021110606000000001, 2023-08-01T19:54:25.074 INFO:teuthology.orchestra.run.smithi101.stdout: "type_data": { 2023-08-01T19:54:25.074 INFO:teuthology.orchestra.run.smithi101.stdout: "flag_point": "started", 2023-08-01T19:54:25.074 INFO:teuthology.orchestra.run.smithi101.stdout: "events": [ 2023-08-01T19:54:25.075 INFO:teuthology.orchestra.run.smithi101.stdout: { 2023-08-01T19:54:25.075 INFO:teuthology.orchestra.run.smithi101.stdout: "event": "initiated", 2023-08-01T19:54:25.075 INFO:teuthology.orchestra.run.smithi101.stdout: "time": "2023-08-01T19:54:04.459304+0000", 2023-08-01T19:54:25.075 INFO:teuthology.orchestra.run.smithi101.stdout: "duration": 0 2023-08-01T19:54:25.075 INFO:teuthology.orchestra.run.smithi101.stdout: }, 2023-08-01T19:54:25.075 INFO:teuthology.orchestra.run.smithi101.stdout: { 2023-08-01T19:54:25.075 INFO:teuthology.orchestra.run.smithi101.stdout: "event": "throttled", 2023-08-01T19:54:25.075 INFO:teuthology.orchestra.run.smithi101.stdout: "time": "2023-08-01T19:54:04.459304+0000", 2023-08-01T19:54:25.076 INFO:teuthology.orchestra.run.smithi101.stdout: "duration": 0 2023-08-01T19:54:25.076 INFO:teuthology.orchestra.run.smithi101.stdout: }, 2023-08-01T19:54:25.076 INFO:teuthology.orchestra.run.smithi101.stdout: { 2023-08-01T19:54:25.076 INFO:teuthology.orchestra.run.smithi101.stdout: "event": "header_read", 2023-08-01T19:54:25.076 INFO:teuthology.orchestra.run.smithi101.stdout: "time": "2023-08-01T19:54:04.459304+0000", 2023-08-01T19:54:25.076 INFO:teuthology.orchestra.run.smithi101.stdout: "duration": 4294967295.9999995 2023-08-01T19:54:25.076 INFO:teuthology.orchestra.run.smithi101.stdout: }, 2023-08-01T19:54:25.076 INFO:teuthology.orchestra.run.smithi101.stdout: { 2023-08-01T19:54:25.077 INFO:teuthology.orchestra.run.smithi101.stdout: "event": "all_read", 2023-08-01T19:54:25.077 INFO:teuthology.orchestra.run.smithi101.stdout: "time": "2023-08-01T19:54:04.459306+0000", 2023-08-01T19:54:25.077 INFO:teuthology.orchestra.run.smithi101.stdout: "duration": 2.3889999999999999e-06 2023-08-01T19:54:25.077 INFO:teuthology.orchestra.run.smithi101.stdout: }, 2023-08-01T19:54:25.077 INFO:teuthology.orchestra.run.smithi101.stdout: { 2023-08-01T19:54:25.077 INFO:teuthology.orchestra.run.smithi101.stdout: "event": "dispatched", 2023-08-01T19:54:25.077 INFO:teuthology.orchestra.run.smithi101.stdout: "time": "2023-08-01T19:54:04.459314+0000", 2023-08-01T19:54:25.078 INFO:teuthology.orchestra.run.smithi101.stdout: "duration": 7.1180000000000003e-06 2023-08-01T19:54:25.078 INFO:teuthology.orchestra.run.smithi101.stdout: }, 2023-08-01T19:54:25.078 INFO:teuthology.orchestra.run.smithi101.stdout: { 2023-08-01T19:54:25.078 INFO:teuthology.orchestra.run.smithi101.stdout: "event": "queued_for_pg", 2023-08-01T19:54:25.078 INFO:teuthology.orchestra.run.smithi101.stdout: "time": "2023-08-01T19:54:04.459318+0000", 2023-08-01T19:54:25.078 INFO:teuthology.orchestra.run.smithi101.stdout: "duration": 4.0239999999999999e-06 2023-08-01T19:54:25.078 INFO:teuthology.orchestra.run.smithi101.stdout: }, 2023-08-01T19:54:25.078 INFO:teuthology.orchestra.run.smithi101.stdout: { 2023-08-01T19:54:25.079 INFO:teuthology.orchestra.run.smithi101.stdout: "event": "reached_pg", 2023-08-01T19:54:25.079 INFO:teuthology.orchestra.run.smithi101.stdout: "time": "2023-08-01T19:54:04.459340+0000", 2023-08-01T19:54:25.079 INFO:teuthology.orchestra.run.smithi101.stdout: "duration": 2.2476e-05 2023-08-01T19:54:25.079 INFO:teuthology.orchestra.run.smithi101.stdout: }, 2023-08-01T19:54:25.079 INFO:teuthology.orchestra.run.smithi101.stdout: { 2023-08-01T19:54:25.079 INFO:teuthology.orchestra.run.smithi101.stdout: "event": "waiting_for_map not empty", 2023-08-01T19:54:25.079 INFO:teuthology.orchestra.run.smithi101.stdout: "time": "2023-08-01T19:54:04.459342+0000", 2023-08-01T19:54:25.079 INFO:teuthology.orchestra.run.smithi101.stdout: "duration": 2.272e-06 2023-08-01T19:54:25.080 INFO:teuthology.orchestra.run.smithi101.stdout: }, 2023-08-01T19:54:25.080 INFO:teuthology.orchestra.run.smithi101.stdout: { 2023-08-01T19:54:25.080 INFO:teuthology.orchestra.run.smithi101.stdout: "event": "reached_pg", 2023-08-01T19:54:25.080 INFO:teuthology.orchestra.run.smithi101.stdout: "time": "2023-08-01T19:54:04.475922+0000", 2023-08-01T19:54:25.080 INFO:teuthology.orchestra.run.smithi101.stdout: "duration": 0.016579388 2023-08-01T19:54:25.080 INFO:teuthology.orchestra.run.smithi101.stdout: }, 2023-08-01T19:54:25.080 INFO:teuthology.orchestra.run.smithi101.stdout: { 2023-08-01T19:54:25.080 INFO:teuthology.orchestra.run.smithi101.stdout: "event": "started", 2023-08-01T19:54:25.081 INFO:teuthology.orchestra.run.smithi101.stdout: "time": "2023-08-01T19:54:04.476107+0000", 2023-08-01T19:54:25.081 INFO:teuthology.orchestra.run.smithi101.stdout: "duration": 0.00018486300000000001 2023-08-01T19:54:25.081 INFO:teuthology.orchestra.run.smithi101.stdout: }, 2023-08-01T19:54:25.081 INFO:teuthology.orchestra.run.smithi101.stdout: { 2023-08-01T19:54:25.081 INFO:teuthology.orchestra.run.smithi101.stdout: "event": "done", 2023-08-01T19:54:25.081 INFO:teuthology.orchestra.run.smithi101.stdout: "time": "2023-08-01T19:54:04.480415+0000", 2023-08-01T19:54:25.081 INFO:teuthology.orchestra.run.smithi101.stdout: "duration": 0.0043084589999999997 2023-08-01T19:54:25.082 INFO:teuthology.orchestra.run.smithi101.stdout: } 2023-08-01T19:54:25.082 INFO:teuthology.orchestra.run.smithi101.stdout: ] 2023-08-01T19:54:25.082 INFO:teuthology.orchestra.run.smithi101.stdout: } 2023-08-01T19:54:25.082 INFO:teuthology.orchestra.run.smithi101.stdout: } 2023-08-01T19:54:25.082 INFO:teuthology.orchestra.run.smithi101.stdout: ] 2023-08-01T19:54:25.082 INFO:teuthology.orchestra.run.smithi101.stdout:} 2023-08-01T19:54:25.083 INFO:tasks.ceph.osd.2.smithi155.stderr:2023-08-01T19:54:25.081+0000 7faa5c6ac700 -1 received signal: Hangup from /usr/bin/python3 /bin/daemon-helper kill ceph-osd -f --cluster ceph -i 2 (PID: 111337) UID: 0 2023-08-01T19:54:25.084 DEBUG:teuthology.orchestra.run.smithi006:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage ceph --admin-daemon /var/run/ceph/ceph-client.0.asok objecter_requests 2023-08-01T19:54:25.085 DEBUG:teuthology.orchestra.run.smithi155:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 30 ceph --cluster ceph --admin-daemon /var/run/ceph/ceph-osd.2.asok dump_ops_in_flight 2023-08-01T19:54:25.144 INFO:teuthology.orchestra.run.smithi006.stderr:nodeep-scrub is set 2023-08-01T19:54:25.184 INFO:tasks.ceph.osd.2.smithi155.stderr:2023-08-01T19:54:25.182+0000 7faa5c6ac700 -1 received signal: Hangup from /usr/bin/python3 /bin/daemon-helper kill ceph-osd -f --cluster ceph -i 2 (PID: 111337) UID: 0 2023-08-01T19:54:25.216 INFO:teuthology.orchestra.run.smithi006.stdout:{ 2023-08-01T19:54:25.216 INFO:teuthology.orchestra.run.smithi006.stdout: "ops": [ 2023-08-01T19:54:25.216 INFO:teuthology.orchestra.run.smithi006.stdout: { 2023-08-01T19:54:25.217 INFO:teuthology.orchestra.run.smithi006.stdout: "tid": 3993, 2023-08-01T19:54:25.217 INFO:teuthology.orchestra.run.smithi006.stdout: "pg": "5.dc87dee6", 2023-08-01T19:54:25.217 INFO:teuthology.orchestra.run.smithi006.stdout: "osd": 0, 2023-08-01T19:54:25.217 INFO:teuthology.orchestra.run.smithi006.stdout: "object_id": "benchmark_data_smithi006_114134_object3992", 2023-08-01T19:54:25.217 INFO:teuthology.orchestra.run.smithi006.stdout: "object_locator": "@5", 2023-08-01T19:54:25.217 INFO:teuthology.orchestra.run.smithi006.stdout: "target_object_id": "benchmark_data_smithi006_114134_object3992", 2023-08-01T19:54:25.217 INFO:teuthology.orchestra.run.smithi006.stdout: "target_object_locator": "@5", 2023-08-01T19:54:25.217 INFO:teuthology.orchestra.run.smithi006.stdout: "paused": 0, 2023-08-01T19:54:25.218 INFO:teuthology.orchestra.run.smithi006.stdout: "used_replica": 0, 2023-08-01T19:54:25.218 INFO:teuthology.orchestra.run.smithi006.stdout: "precalc_pgid": 0, 2023-08-01T19:54:25.218 INFO:teuthology.orchestra.run.smithi006.stdout: "last_sent": "890.576555s", 2023-08-01T19:54:25.218 INFO:teuthology.orchestra.run.smithi006.stdout: "age": 0.0039999620000000001, 2023-08-01T19:54:25.218 INFO:teuthology.orchestra.run.smithi006.stdout: "attempts": 1, 2023-08-01T19:54:25.218 INFO:teuthology.orchestra.run.smithi006.stdout: "snapid": "head", 2023-08-01T19:54:25.218 INFO:teuthology.orchestra.run.smithi006.stdout: "snap_context": "0=[]", 2023-08-01T19:54:25.219 INFO:teuthology.orchestra.run.smithi006.stdout: "mtime": "2023-08-01T19:54:25.211997+0000", 2023-08-01T19:54:25.219 INFO:teuthology.orchestra.run.smithi006.stdout: "osd_ops": [ 2023-08-01T19:54:25.219 INFO:teuthology.orchestra.run.smithi006.stdout: "set-alloc-hint object_size 65536 write_size 65536", 2023-08-01T19:54:25.219 INFO:teuthology.orchestra.run.smithi006.stdout: "write 0~65536 in=65536b" 2023-08-01T19:54:25.219 INFO:teuthology.orchestra.run.smithi006.stdout: ] 2023-08-01T19:54:25.219 INFO:teuthology.orchestra.run.smithi006.stdout: }, 2023-08-01T19:54:25.219 INFO:teuthology.orchestra.run.smithi006.stdout: { 2023-08-01T19:54:25.220 INFO:teuthology.orchestra.run.smithi006.stdout: "tid": 3994, 2023-08-01T19:54:25.220 INFO:teuthology.orchestra.run.smithi006.stdout: "pg": "5.8246a795", 2023-08-01T19:54:25.220 INFO:teuthology.orchestra.run.smithi006.stdout: "osd": 0, 2023-08-01T19:54:25.220 INFO:teuthology.orchestra.run.smithi006.stdout: "object_id": "benchmark_data_smithi006_114134_object3993", 2023-08-01T19:54:25.220 INFO:teuthology.orchestra.run.smithi006.stdout: "object_locator": "@5", 2023-08-01T19:54:25.220 INFO:teuthology.orchestra.run.smithi006.stdout: "target_object_id": "benchmark_data_smithi006_114134_object3993", 2023-08-01T19:54:25.221 INFO:teuthology.orchestra.run.smithi006.stdout: "target_object_locator": "@5", 2023-08-01T19:54:25.221 INFO:teuthology.orchestra.run.smithi006.stdout: "paused": 0, 2023-08-01T19:54:25.221 INFO:teuthology.orchestra.run.smithi006.stdout: "used_replica": 0, 2023-08-01T19:54:25.221 INFO:teuthology.orchestra.run.smithi006.stdout: "precalc_pgid": 0, 2023-08-01T19:54:25.221 INFO:teuthology.orchestra.run.smithi006.stdout: "last_sent": "890.578555s", 2023-08-01T19:54:25.221 INFO:teuthology.orchestra.run.smithi006.stdout: "age": 0.0019999810000000001, 2023-08-01T19:54:25.221 INFO:teuthology.orchestra.run.smithi006.stdout: "attempts": 1, 2023-08-01T19:54:25.221 INFO:teuthology.orchestra.run.smithi006.stdout: "snapid": "head", 2023-08-01T19:54:25.222 INFO:teuthology.orchestra.run.smithi006.stdout: "snap_context": "0=[]", 2023-08-01T19:54:25.222 INFO:teuthology.orchestra.run.smithi006.stdout: "mtime": "2023-08-01T19:54:25.213230+0000", 2023-08-01T19:54:25.222 INFO:teuthology.orchestra.run.smithi006.stdout: "osd_ops": [ 2023-08-01T19:54:25.222 INFO:teuthology.orchestra.run.smithi006.stdout: "set-alloc-hint object_size 65536 write_size 65536", 2023-08-01T19:54:25.222 INFO:teuthology.orchestra.run.smithi006.stdout: "write 0~65536 in=65536b" 2023-08-01T19:54:25.222 INFO:teuthology.orchestra.run.smithi006.stdout: ] 2023-08-01T19:54:25.222 INFO:teuthology.orchestra.run.smithi006.stdout: }, 2023-08-01T19:54:25.223 INFO:teuthology.orchestra.run.smithi006.stdout: { 2023-08-01T19:54:25.223 INFO:teuthology.orchestra.run.smithi006.stdout: "tid": 3995, 2023-08-01T19:54:25.223 INFO:teuthology.orchestra.run.smithi006.stdout: "pg": "5.462fc71c", 2023-08-01T19:54:25.223 INFO:teuthology.orchestra.run.smithi006.stdout: "osd": 0, 2023-08-01T19:54:25.223 INFO:teuthology.orchestra.run.smithi006.stdout: "object_id": "benchmark_data_smithi006_114134_object3994", 2023-08-01T19:54:25.223 INFO:teuthology.orchestra.run.smithi006.stdout: "object_locator": "@5", 2023-08-01T19:54:25.223 INFO:teuthology.orchestra.run.smithi006.stdout: "target_object_id": "benchmark_data_smithi006_114134_object3994", 2023-08-01T19:54:25.223 INFO:teuthology.orchestra.run.smithi006.stdout: "target_object_locator": "@5", 2023-08-01T19:54:25.224 INFO:teuthology.orchestra.run.smithi006.stdout: "paused": 0, 2023-08-01T19:54:25.224 INFO:teuthology.orchestra.run.smithi006.stdout: "used_replica": 0, 2023-08-01T19:54:25.224 INFO:teuthology.orchestra.run.smithi006.stdout: "precalc_pgid": 0, 2023-08-01T19:54:25.224 INFO:teuthology.orchestra.run.smithi006.stdout: "last_sent": "890.578555s", 2023-08-01T19:54:25.224 INFO:teuthology.orchestra.run.smithi006.stdout: "age": 0.0019999810000000001, 2023-08-01T19:54:25.224 INFO:teuthology.orchestra.run.smithi006.stdout: "attempts": 1, 2023-08-01T19:54:25.224 INFO:teuthology.orchestra.run.smithi006.stdout: "snapid": "head", 2023-08-01T19:54:25.224 INFO:teuthology.orchestra.run.smithi006.stdout: "snap_context": "0=[]", 2023-08-01T19:54:25.225 INFO:teuthology.orchestra.run.smithi006.stdout: "mtime": "2023-08-01T19:54:25.213336+0000", 2023-08-01T19:54:25.225 INFO:teuthology.orchestra.run.smithi006.stdout: "osd_ops": [ 2023-08-01T19:54:25.225 INFO:teuthology.orchestra.run.smithi006.stdout: "set-alloc-hint object_size 65536 write_size 65536", 2023-08-01T19:54:25.225 INFO:teuthology.orchestra.run.smithi006.stdout: "write 0~65536 in=65536b" 2023-08-01T19:54:25.225 INFO:teuthology.orchestra.run.smithi006.stdout: ] 2023-08-01T19:54:25.225 INFO:teuthology.orchestra.run.smithi006.stdout: }, 2023-08-01T19:54:25.225 INFO:teuthology.orchestra.run.smithi006.stdout: { 2023-08-01T19:54:25.226 INFO:teuthology.orchestra.run.smithi006.stdout: "tid": 3996, 2023-08-01T19:54:25.226 INFO:teuthology.orchestra.run.smithi006.stdout: "pg": "5.3d88bffc", 2023-08-01T19:54:25.226 INFO:teuthology.orchestra.run.smithi006.stdout: "osd": 0, 2023-08-01T19:54:25.226 INFO:teuthology.orchestra.run.smithi006.stdout: "object_id": "benchmark_data_smithi006_114134_object3995", 2023-08-01T19:54:25.226 INFO:teuthology.orchestra.run.smithi006.stdout: "object_locator": "@5", 2023-08-01T19:54:25.226 INFO:teuthology.orchestra.run.smithi006.stdout: "target_object_id": "benchmark_data_smithi006_114134_object3995", 2023-08-01T19:54:25.226 INFO:teuthology.orchestra.run.smithi006.stdout: "target_object_locator": "@5", 2023-08-01T19:54:25.226 INFO:teuthology.orchestra.run.smithi006.stdout: "paused": 0, 2023-08-01T19:54:25.227 INFO:teuthology.orchestra.run.smithi006.stdout: "used_replica": 0, 2023-08-01T19:54:25.227 INFO:teuthology.orchestra.run.smithi006.stdout: "precalc_pgid": 0, 2023-08-01T19:54:25.227 INFO:teuthology.orchestra.run.smithi006.stdout: "last_sent": "890.578555s", 2023-08-01T19:54:25.227 INFO:teuthology.orchestra.run.smithi006.stdout: "age": 0.0019999810000000001, 2023-08-01T19:54:25.227 INFO:teuthology.orchestra.run.smithi006.stdout: "attempts": 1, 2023-08-01T19:54:25.227 INFO:teuthology.orchestra.run.smithi006.stdout: "snapid": "head", 2023-08-01T19:54:25.227 INFO:teuthology.orchestra.run.smithi006.stdout: "snap_context": "0=[]", 2023-08-01T19:54:25.228 INFO:teuthology.orchestra.run.smithi006.stdout: "mtime": "2023-08-01T19:54:25.213388+0000", 2023-08-01T19:54:25.228 INFO:teuthology.orchestra.run.smithi006.stdout: "osd_ops": [ 2023-08-01T19:54:25.228 INFO:teuthology.orchestra.run.smithi006.stdout: "set-alloc-hint object_size 65536 write_size 65536", 2023-08-01T19:54:25.228 INFO:teuthology.orchestra.run.smithi006.stdout: "write 0~65536 in=65536b" 2023-08-01T19:54:25.228 INFO:teuthology.orchestra.run.smithi006.stdout: ] 2023-08-01T19:54:25.228 INFO:teuthology.orchestra.run.smithi006.stdout: }, 2023-08-01T19:54:25.228 INFO:teuthology.orchestra.run.smithi006.stdout: { 2023-08-01T19:54:25.229 INFO:teuthology.orchestra.run.smithi006.stdout: "tid": 3983, 2023-08-01T19:54:25.229 INFO:teuthology.orchestra.run.smithi006.stdout: "pg": "5.d2ad41e9", 2023-08-01T19:54:25.229 INFO:teuthology.orchestra.run.smithi006.stdout: "osd": 1, 2023-08-01T19:54:25.229 INFO:teuthology.orchestra.run.smithi006.stdout: "object_id": "benchmark_data_smithi006_114134_object3982", 2023-08-01T19:54:25.229 INFO:teuthology.orchestra.run.smithi006.stdout: "object_locator": "@5", 2023-08-01T19:54:25.229 INFO:teuthology.orchestra.run.smithi006.stdout: "target_object_id": "benchmark_data_smithi006_114134_object3982", 2023-08-01T19:54:25.229 INFO:teuthology.orchestra.run.smithi006.stdout: "target_object_locator": "@5", 2023-08-01T19:54:25.229 INFO:teuthology.orchestra.run.smithi006.stdout: "paused": 0, 2023-08-01T19:54:25.230 INFO:teuthology.orchestra.run.smithi006.stdout: "used_replica": 0, 2023-08-01T19:54:25.230 INFO:teuthology.orchestra.run.smithi006.stdout: "precalc_pgid": 0, 2023-08-01T19:54:25.230 INFO:teuthology.orchestra.run.smithi006.stdout: "last_sent": "890.575555s", 2023-08-01T19:54:25.230 INFO:teuthology.orchestra.run.smithi006.stdout: "age": 0.0049999529999999997, 2023-08-01T19:54:25.230 INFO:teuthology.orchestra.run.smithi006.stdout: "attempts": 1, 2023-08-01T19:54:25.230 INFO:teuthology.orchestra.run.smithi006.stdout: "snapid": "head", 2023-08-01T19:54:25.230 INFO:teuthology.orchestra.run.smithi006.stdout: "snap_context": "0=[]", 2023-08-01T19:54:25.230 INFO:teuthology.orchestra.run.smithi006.stdout: "mtime": "2023-08-01T19:54:25.210364+0000", 2023-08-01T19:54:25.231 INFO:teuthology.orchestra.run.smithi006.stdout: "osd_ops": [ 2023-08-01T19:54:25.231 INFO:teuthology.orchestra.run.smithi006.stdout: "set-alloc-hint object_size 65536 write_size 65536", 2023-08-01T19:54:25.231 INFO:teuthology.orchestra.run.smithi006.stdout: "write 0~65536 in=65536b" 2023-08-01T19:54:25.231 INFO:teuthology.orchestra.run.smithi006.stdout: ] 2023-08-01T19:54:25.231 INFO:teuthology.orchestra.run.smithi006.stdout: }, 2023-08-01T19:54:25.231 INFO:teuthology.orchestra.run.smithi006.stdout: { 2023-08-01T19:54:25.231 INFO:teuthology.orchestra.run.smithi006.stdout: "tid": 3984, 2023-08-01T19:54:25.232 INFO:teuthology.orchestra.run.smithi006.stdout: "pg": "5.52ceb77f", 2023-08-01T19:54:25.232 INFO:teuthology.orchestra.run.smithi006.stdout: "osd": 1, 2023-08-01T19:54:25.232 INFO:teuthology.orchestra.run.smithi006.stdout: "object_id": "benchmark_data_smithi006_114134_object3983", 2023-08-01T19:54:25.232 INFO:teuthology.orchestra.run.smithi006.stdout: "object_locator": "@5", 2023-08-01T19:54:25.232 INFO:teuthology.orchestra.run.smithi006.stdout: "target_object_id": "benchmark_data_smithi006_114134_object3983", 2023-08-01T19:54:25.232 INFO:teuthology.orchestra.run.smithi006.stdout: "target_object_locator": "@5", 2023-08-01T19:54:25.232 INFO:teuthology.orchestra.run.smithi006.stdout: "paused": 0, 2023-08-01T19:54:25.232 INFO:teuthology.orchestra.run.smithi006.stdout: "used_replica": 0, 2023-08-01T19:54:25.233 INFO:teuthology.orchestra.run.smithi006.stdout: "precalc_pgid": 0, 2023-08-01T19:54:25.233 INFO:teuthology.orchestra.run.smithi006.stdout: "last_sent": "890.575555s", 2023-08-01T19:54:25.233 INFO:teuthology.orchestra.run.smithi006.stdout: "age": 0.0049999529999999997, 2023-08-01T19:54:25.233 INFO:teuthology.orchestra.run.smithi006.stdout: "attempts": 1, 2023-08-01T19:54:25.233 INFO:teuthology.orchestra.run.smithi006.stdout: "snapid": "head", 2023-08-01T19:54:25.233 INFO:teuthology.orchestra.run.smithi006.stdout: "snap_context": "0=[]", 2023-08-01T19:54:25.233 INFO:teuthology.orchestra.run.smithi006.stdout: "mtime": "2023-08-01T19:54:25.210390+0000", 2023-08-01T19:54:25.233 INFO:teuthology.orchestra.run.smithi006.stdout: "osd_ops": [ 2023-08-01T19:54:25.234 INFO:teuthology.orchestra.run.smithi006.stdout: "set-alloc-hint object_size 65536 write_size 65536", 2023-08-01T19:54:25.234 INFO:teuthology.orchestra.run.smithi006.stdout: "write 0~65536 in=65536b" 2023-08-01T19:54:25.234 INFO:teuthology.orchestra.run.smithi006.stdout: ] 2023-08-01T19:54:25.234 INFO:teuthology.orchestra.run.smithi006.stdout: }, 2023-08-01T19:54:25.234 INFO:teuthology.orchestra.run.smithi006.stdout: { 2023-08-01T19:54:25.234 INFO:teuthology.orchestra.run.smithi006.stdout: "tid": 3986, 2023-08-01T19:54:25.234 INFO:teuthology.orchestra.run.smithi006.stdout: "pg": "5.a2ec5f21", 2023-08-01T19:54:25.234 INFO:teuthology.orchestra.run.smithi006.stdout: "osd": 1, 2023-08-01T19:54:25.235 INFO:teuthology.orchestra.run.smithi006.stdout: "object_id": "benchmark_data_smithi006_114134_object3985", 2023-08-01T19:54:25.235 INFO:teuthology.orchestra.run.smithi006.stdout: "object_locator": "@5", 2023-08-01T19:54:25.235 INFO:teuthology.orchestra.run.smithi006.stdout: "target_object_id": "benchmark_data_smithi006_114134_object3985", 2023-08-01T19:54:25.235 INFO:teuthology.orchestra.run.smithi006.stdout: "target_object_locator": "@5", 2023-08-01T19:54:25.235 INFO:teuthology.orchestra.run.smithi006.stdout: "paused": 0, 2023-08-01T19:54:25.235 INFO:teuthology.orchestra.run.smithi006.stdout: "used_replica": 0, 2023-08-01T19:54:25.235 INFO:teuthology.orchestra.run.smithi006.stdout: "precalc_pgid": 0, 2023-08-01T19:54:25.236 INFO:teuthology.orchestra.run.smithi006.stdout: "last_sent": "890.575555s", 2023-08-01T19:54:25.236 INFO:teuthology.orchestra.run.smithi006.stdout: "age": 0.0049999529999999997, 2023-08-01T19:54:25.236 INFO:teuthology.orchestra.run.smithi006.stdout: "attempts": 1, 2023-08-01T19:54:25.236 INFO:teuthology.orchestra.run.smithi006.stdout: "snapid": "head", 2023-08-01T19:54:25.236 INFO:teuthology.orchestra.run.smithi006.stdout: "snap_context": "0=[]", 2023-08-01T19:54:25.236 INFO:teuthology.orchestra.run.smithi006.stdout: "mtime": "2023-08-01T19:54:25.210442+0000", 2023-08-01T19:54:25.236 INFO:teuthology.orchestra.run.smithi006.stdout: "osd_ops": [ 2023-08-01T19:54:25.236 INFO:teuthology.orchestra.run.smithi006.stdout: "set-alloc-hint object_size 65536 write_size 65536", 2023-08-01T19:54:25.237 INFO:teuthology.orchestra.run.smithi006.stdout: "write 0~65536 in=65536b" 2023-08-01T19:54:25.237 INFO:teuthology.orchestra.run.smithi006.stdout: ] 2023-08-01T19:54:25.237 INFO:teuthology.orchestra.run.smithi006.stdout: }, 2023-08-01T19:54:25.237 INFO:teuthology.orchestra.run.smithi006.stdout: { 2023-08-01T19:54:25.237 INFO:teuthology.orchestra.run.smithi006.stdout: "tid": 3987, 2023-08-01T19:54:25.237 INFO:teuthology.orchestra.run.smithi006.stdout: "pg": "5.f0d0904f", 2023-08-01T19:54:25.237 INFO:teuthology.orchestra.run.smithi006.stdout: "osd": 1, 2023-08-01T19:54:25.237 INFO:teuthology.orchestra.run.smithi006.stdout: "object_id": "benchmark_data_smithi006_114134_object3986", 2023-08-01T19:54:25.238 INFO:teuthology.orchestra.run.smithi006.stdout: "object_locator": "@5", 2023-08-01T19:54:25.238 INFO:teuthology.orchestra.run.smithi006.stdout: "target_object_id": "benchmark_data_smithi006_114134_object3986", 2023-08-01T19:54:25.238 INFO:teuthology.orchestra.run.smithi006.stdout: "target_object_locator": "@5", 2023-08-01T19:54:25.238 INFO:teuthology.orchestra.run.smithi006.stdout: "paused": 0, 2023-08-01T19:54:25.238 INFO:teuthology.orchestra.run.smithi006.stdout: "used_replica": 0, 2023-08-01T19:54:25.238 INFO:teuthology.orchestra.run.smithi006.stdout: "precalc_pgid": 0, 2023-08-01T19:54:25.238 INFO:teuthology.orchestra.run.smithi006.stdout: "last_sent": "890.575555s", 2023-08-01T19:54:25.239 INFO:teuthology.orchestra.run.smithi006.stdout: "age": 0.0049999529999999997, 2023-08-01T19:54:25.239 INFO:teuthology.orchestra.run.smithi006.stdout: "attempts": 1, 2023-08-01T19:54:25.239 INFO:teuthology.orchestra.run.smithi006.stdout: "snapid": "head", 2023-08-01T19:54:25.239 INFO:teuthology.orchestra.run.smithi006.stdout: "snap_context": "0=[]", 2023-08-01T19:54:25.239 INFO:teuthology.orchestra.run.smithi006.stdout: "mtime": "2023-08-01T19:54:25.210463+0000", 2023-08-01T19:54:25.239 INFO:teuthology.orchestra.run.smithi006.stdout: "osd_ops": [ 2023-08-01T19:54:25.239 INFO:teuthology.orchestra.run.smithi006.stdout: "set-alloc-hint object_size 65536 write_size 65536", 2023-08-01T19:54:25.239 INFO:teuthology.orchestra.run.smithi006.stdout: "write 0~65536 in=65536b" 2023-08-01T19:54:25.240 INFO:teuthology.orchestra.run.smithi006.stdout: ] 2023-08-01T19:54:25.240 INFO:teuthology.orchestra.run.smithi006.stdout: }, 2023-08-01T19:54:25.240 INFO:teuthology.orchestra.run.smithi006.stdout: { 2023-08-01T19:54:25.240 INFO:teuthology.orchestra.run.smithi006.stdout: "tid": 3989, 2023-08-01T19:54:25.240 INFO:teuthology.orchestra.run.smithi006.stdout: "pg": "5.f01b86df", 2023-08-01T19:54:25.241 INFO:teuthology.orchestra.run.smithi006.stdout: "osd": 1, 2023-08-01T19:54:25.241 INFO:teuthology.orchestra.run.smithi006.stdout: "object_id": "benchmark_data_smithi006_114134_object3988", 2023-08-01T19:54:25.241 INFO:teuthology.orchestra.run.smithi006.stdout: "object_locator": "@5", 2023-08-01T19:54:25.241 INFO:teuthology.orchestra.run.smithi006.stdout: "target_object_id": "benchmark_data_smithi006_114134_object3988", 2023-08-01T19:54:25.241 INFO:teuthology.orchestra.run.smithi006.stdout: "target_object_locator": "@5", 2023-08-01T19:54:25.241 INFO:teuthology.orchestra.run.smithi006.stdout: "paused": 0, 2023-08-01T19:54:25.241 INFO:teuthology.orchestra.run.smithi006.stdout: "used_replica": 0, 2023-08-01T19:54:25.241 INFO:teuthology.orchestra.run.smithi006.stdout: "precalc_pgid": 0, 2023-08-01T19:54:25.242 INFO:teuthology.orchestra.run.smithi006.stdout: "last_sent": "890.575555s", 2023-08-01T19:54:25.242 INFO:teuthology.orchestra.run.smithi006.stdout: "age": 0.0049999529999999997, 2023-08-01T19:54:25.242 INFO:teuthology.orchestra.run.smithi006.stdout: "attempts": 1, 2023-08-01T19:54:25.242 INFO:teuthology.orchestra.run.smithi006.stdout: "snapid": "head", 2023-08-01T19:54:25.242 INFO:teuthology.orchestra.run.smithi006.stdout: "snap_context": "0=[]", 2023-08-01T19:54:25.242 INFO:teuthology.orchestra.run.smithi006.stdout: "mtime": "2023-08-01T19:54:25.210736+0000", 2023-08-01T19:54:25.242 INFO:teuthology.orchestra.run.smithi006.stdout: "osd_ops": [ 2023-08-01T19:54:25.243 INFO:teuthology.orchestra.run.smithi006.stdout: "set-alloc-hint object_size 65536 write_size 65536", 2023-08-01T19:54:25.243 INFO:teuthology.orchestra.run.smithi006.stdout: "write 0~65536 in=65536b" 2023-08-01T19:54:25.243 INFO:teuthology.orchestra.run.smithi006.stdout: ] 2023-08-01T19:54:25.243 INFO:teuthology.orchestra.run.smithi006.stdout: }, 2023-08-01T19:54:25.243 INFO:teuthology.orchestra.run.smithi006.stdout: { 2023-08-01T19:54:25.243 INFO:teuthology.orchestra.run.smithi006.stdout: "tid": 3980, 2023-08-01T19:54:25.243 INFO:teuthology.orchestra.run.smithi006.stdout: "pg": "5.7a3b86ad", 2023-08-01T19:54:25.243 INFO:teuthology.orchestra.run.smithi006.stdout: "osd": 2, 2023-08-01T19:54:25.244 INFO:teuthology.orchestra.run.smithi006.stdout: "object_id": "benchmark_data_smithi006_114134_object3979", 2023-08-01T19:54:25.244 INFO:teuthology.orchestra.run.smithi006.stdout: "object_locator": "@5", 2023-08-01T19:54:25.244 INFO:teuthology.orchestra.run.smithi006.stdout: "target_object_id": "benchmark_data_smithi006_114134_object3979", 2023-08-01T19:54:25.244 INFO:teuthology.orchestra.run.smithi006.stdout: "target_object_locator": "@5", 2023-08-01T19:54:25.244 INFO:teuthology.orchestra.run.smithi006.stdout: "paused": 0, 2023-08-01T19:54:25.244 INFO:teuthology.orchestra.run.smithi006.stdout: "used_replica": 0, 2023-08-01T19:54:25.244 INFO:teuthology.orchestra.run.smithi006.stdout: "precalc_pgid": 0, 2023-08-01T19:54:25.244 INFO:teuthology.orchestra.run.smithi006.stdout: "last_sent": "890.574555s", 2023-08-01T19:54:25.245 INFO:teuthology.orchestra.run.smithi006.stdout: "age": 0.0059999429999999998, 2023-08-01T19:54:25.245 INFO:teuthology.orchestra.run.smithi006.stdout: "attempts": 1, 2023-08-01T19:54:25.245 INFO:teuthology.orchestra.run.smithi006.stdout: "snapid": "head", 2023-08-01T19:54:25.245 INFO:teuthology.orchestra.run.smithi006.stdout: "snap_context": "0=[]", 2023-08-01T19:54:25.245 INFO:teuthology.orchestra.run.smithi006.stdout: "mtime": "2023-08-01T19:54:25.210101+0000", 2023-08-01T19:54:25.245 INFO:teuthology.orchestra.run.smithi006.stdout: "osd_ops": [ 2023-08-01T19:54:25.245 INFO:teuthology.orchestra.run.smithi006.stdout: "set-alloc-hint object_size 65536 write_size 65536", 2023-08-01T19:54:25.246 INFO:teuthology.orchestra.run.smithi006.stdout: "write 0~65536 in=65536b" 2023-08-01T19:54:25.246 INFO:teuthology.orchestra.run.smithi006.stdout: ] 2023-08-01T19:54:25.246 INFO:teuthology.orchestra.run.smithi006.stdout: }, 2023-08-01T19:54:25.246 INFO:teuthology.orchestra.run.smithi006.stdout: { 2023-08-01T19:54:25.246 INFO:teuthology.orchestra.run.smithi006.stdout: "tid": 3981, 2023-08-01T19:54:25.246 INFO:teuthology.orchestra.run.smithi006.stdout: "pg": "5.8553391e", 2023-08-01T19:54:25.246 INFO:teuthology.orchestra.run.smithi006.stdout: "osd": 2, 2023-08-01T19:54:25.246 INFO:teuthology.orchestra.run.smithi006.stdout: "object_id": "benchmark_data_smithi006_114134_object3980", 2023-08-01T19:54:25.247 INFO:teuthology.orchestra.run.smithi006.stdout: "object_locator": "@5", 2023-08-01T19:54:25.247 INFO:teuthology.orchestra.run.smithi006.stdout: "target_object_id": "benchmark_data_smithi006_114134_object3980", 2023-08-01T19:54:25.247 INFO:teuthology.orchestra.run.smithi006.stdout: "target_object_locator": "@5", 2023-08-01T19:54:25.247 INFO:teuthology.orchestra.run.smithi006.stdout: "paused": 0, 2023-08-01T19:54:25.247 INFO:teuthology.orchestra.run.smithi006.stdout: "used_replica": 0, 2023-08-01T19:54:25.247 INFO:teuthology.orchestra.run.smithi006.stdout: "precalc_pgid": 0, 2023-08-01T19:54:25.247 INFO:teuthology.orchestra.run.smithi006.stdout: "last_sent": "890.574555s", 2023-08-01T19:54:25.248 INFO:teuthology.orchestra.run.smithi006.stdout: "age": 0.0059999429999999998, 2023-08-01T19:54:25.248 INFO:teuthology.orchestra.run.smithi006.stdout: "attempts": 1, 2023-08-01T19:54:25.248 INFO:teuthology.orchestra.run.smithi006.stdout: "snapid": "head", 2023-08-01T19:54:25.248 INFO:teuthology.orchestra.run.smithi006.stdout: "snap_context": "0=[]", 2023-08-01T19:54:25.248 INFO:teuthology.orchestra.run.smithi006.stdout: "mtime": "2023-08-01T19:54:25.210198+0000", 2023-08-01T19:54:25.248 INFO:teuthology.orchestra.run.smithi006.stdout: "osd_ops": [ 2023-08-01T19:54:25.248 INFO:teuthology.orchestra.run.smithi006.stdout: "set-alloc-hint object_size 65536 write_size 65536", 2023-08-01T19:54:25.249 INFO:teuthology.orchestra.run.smithi006.stdout: "write 0~65536 in=65536b" 2023-08-01T19:54:25.249 INFO:teuthology.orchestra.run.smithi006.stdout: ] 2023-08-01T19:54:25.249 INFO:teuthology.orchestra.run.smithi006.stdout: }, 2023-08-01T19:54:25.249 INFO:teuthology.orchestra.run.smithi006.stdout: { 2023-08-01T19:54:25.249 INFO:teuthology.orchestra.run.smithi006.stdout: "tid": 3985, 2023-08-01T19:54:25.249 INFO:teuthology.orchestra.run.smithi006.stdout: "pg": "5.41193c80", 2023-08-01T19:54:25.249 INFO:teuthology.orchestra.run.smithi006.stdout: "osd": 2, 2023-08-01T19:54:25.249 INFO:teuthology.orchestra.run.smithi006.stdout: "object_id": "benchmark_data_smithi006_114134_object3984", 2023-08-01T19:54:25.250 INFO:teuthology.orchestra.run.smithi006.stdout: "object_locator": "@5", 2023-08-01T19:54:25.250 INFO:teuthology.orchestra.run.smithi006.stdout: "target_object_id": "benchmark_data_smithi006_114134_object3984", 2023-08-01T19:54:25.250 INFO:teuthology.orchestra.run.smithi006.stdout: "target_object_locator": "@5", 2023-08-01T19:54:25.250 INFO:teuthology.orchestra.run.smithi006.stdout: "paused": 0, 2023-08-01T19:54:25.250 INFO:teuthology.orchestra.run.smithi006.stdout: "used_replica": 0, 2023-08-01T19:54:25.250 INFO:teuthology.orchestra.run.smithi006.stdout: "precalc_pgid": 0, 2023-08-01T19:54:25.250 INFO:teuthology.orchestra.run.smithi006.stdout: "last_sent": "890.575555s", 2023-08-01T19:54:25.250 INFO:teuthology.orchestra.run.smithi006.stdout: "age": 0.0049999529999999997, 2023-08-01T19:54:25.251 INFO:teuthology.orchestra.run.smithi006.stdout: "attempts": 1, 2023-08-01T19:54:25.251 INFO:teuthology.orchestra.run.smithi006.stdout: "snapid": "head", 2023-08-01T19:54:25.251 INFO:teuthology.orchestra.run.smithi006.stdout: "snap_context": "0=[]", 2023-08-01T19:54:25.251 INFO:teuthology.orchestra.run.smithi006.stdout: "mtime": "2023-08-01T19:54:25.210399+0000", 2023-08-01T19:54:25.251 INFO:teuthology.orchestra.run.smithi006.stdout: "osd_ops": [ 2023-08-01T19:54:25.251 INFO:teuthology.orchestra.run.smithi006.stdout: "set-alloc-hint object_size 65536 write_size 65536", 2023-08-01T19:54:25.251 INFO:teuthology.orchestra.run.smithi006.stdout: "write 0~65536 in=65536b" 2023-08-01T19:54:25.252 INFO:teuthology.orchestra.run.smithi006.stdout: ] 2023-08-01T19:54:25.252 INFO:teuthology.orchestra.run.smithi006.stdout: }, 2023-08-01T19:54:25.252 INFO:teuthology.orchestra.run.smithi006.stdout: { 2023-08-01T19:54:25.252 INFO:teuthology.orchestra.run.smithi006.stdout: "tid": 3988, 2023-08-01T19:54:25.252 INFO:teuthology.orchestra.run.smithi006.stdout: "pg": "5.10d02f48", 2023-08-01T19:54:25.252 INFO:teuthology.orchestra.run.smithi006.stdout: "osd": 2, 2023-08-01T19:54:25.252 INFO:teuthology.orchestra.run.smithi006.stdout: "object_id": "benchmark_data_smithi006_114134_object3987", 2023-08-01T19:54:25.252 INFO:teuthology.orchestra.run.smithi006.stdout: "object_locator": "@5", 2023-08-01T19:54:25.253 INFO:teuthology.orchestra.run.smithi006.stdout: "target_object_id": "benchmark_data_smithi006_114134_object3987", 2023-08-01T19:54:25.253 INFO:teuthology.orchestra.run.smithi006.stdout: "target_object_locator": "@5", 2023-08-01T19:54:25.253 INFO:teuthology.orchestra.run.smithi006.stdout: "paused": 0, 2023-08-01T19:54:25.253 INFO:teuthology.orchestra.run.smithi006.stdout: "used_replica": 0, 2023-08-01T19:54:25.253 INFO:teuthology.orchestra.run.smithi006.stdout: "precalc_pgid": 0, 2023-08-01T19:54:25.253 INFO:teuthology.orchestra.run.smithi006.stdout: "last_sent": "890.575555s", 2023-08-01T19:54:25.253 INFO:teuthology.orchestra.run.smithi006.stdout: "age": 0.0049999529999999997, 2023-08-01T19:54:25.253 INFO:teuthology.orchestra.run.smithi006.stdout: "attempts": 1, 2023-08-01T19:54:25.254 INFO:teuthology.orchestra.run.smithi006.stdout: "snapid": "head", 2023-08-01T19:54:25.254 INFO:teuthology.orchestra.run.smithi006.stdout: "snap_context": "0=[]", 2023-08-01T19:54:25.254 INFO:teuthology.orchestra.run.smithi006.stdout: "mtime": "2023-08-01T19:54:25.210675+0000", 2023-08-01T19:54:25.254 INFO:teuthology.orchestra.run.smithi006.stdout: "osd_ops": [ 2023-08-01T19:54:25.254 INFO:teuthology.orchestra.run.smithi006.stdout: "set-alloc-hint object_size 65536 write_size 65536", 2023-08-01T19:54:25.254 INFO:teuthology.orchestra.run.smithi006.stdout: "write 0~65536 in=65536b" 2023-08-01T19:54:25.254 INFO:teuthology.orchestra.run.smithi006.stdout: ] 2023-08-01T19:54:25.254 INFO:teuthology.orchestra.run.smithi006.stdout: }, 2023-08-01T19:54:25.255 INFO:teuthology.orchestra.run.smithi006.stdout: { 2023-08-01T19:54:25.255 INFO:teuthology.orchestra.run.smithi006.stdout: "tid": 3990, 2023-08-01T19:54:25.255 INFO:teuthology.orchestra.run.smithi006.stdout: "pg": "5.dc1acda0", 2023-08-01T19:54:25.255 INFO:teuthology.orchestra.run.smithi006.stdout: "osd": 2, 2023-08-01T19:54:25.255 INFO:teuthology.orchestra.run.smithi006.stdout: "object_id": "benchmark_data_smithi006_114134_object3989", 2023-08-01T19:54:25.255 INFO:teuthology.orchestra.run.smithi006.stdout: "object_locator": "@5", 2023-08-01T19:54:25.255 INFO:teuthology.orchestra.run.smithi006.stdout: "target_object_id": "benchmark_data_smithi006_114134_object3989", 2023-08-01T19:54:25.256 INFO:teuthology.orchestra.run.smithi006.stdout: "target_object_locator": "@5", 2023-08-01T19:54:25.256 INFO:teuthology.orchestra.run.smithi006.stdout: "paused": 0, 2023-08-01T19:54:25.256 INFO:teuthology.orchestra.run.smithi006.stdout: "used_replica": 0, 2023-08-01T19:54:25.256 INFO:teuthology.orchestra.run.smithi006.stdout: "precalc_pgid": 0, 2023-08-01T19:54:25.256 INFO:teuthology.orchestra.run.smithi006.stdout: "last_sent": "890.576555s", 2023-08-01T19:54:25.256 INFO:teuthology.orchestra.run.smithi006.stdout: "age": 0.0039999620000000001, 2023-08-01T19:54:25.256 INFO:teuthology.orchestra.run.smithi006.stdout: "attempts": 1, 2023-08-01T19:54:25.256 INFO:teuthology.orchestra.run.smithi006.stdout: "snapid": "head", 2023-08-01T19:54:25.257 INFO:teuthology.orchestra.run.smithi006.stdout: "snap_context": "0=[]", 2023-08-01T19:54:25.257 INFO:teuthology.orchestra.run.smithi006.stdout: "mtime": "2023-08-01T19:54:25.211293+0000", 2023-08-01T19:54:25.257 INFO:teuthology.orchestra.run.smithi006.stdout: "osd_ops": [ 2023-08-01T19:54:25.257 INFO:teuthology.orchestra.run.smithi006.stdout: "set-alloc-hint object_size 65536 write_size 65536", 2023-08-01T19:54:25.257 INFO:teuthology.orchestra.run.smithi006.stdout: "write 0~65536 in=65536b" 2023-08-01T19:54:25.257 INFO:teuthology.orchestra.run.smithi006.stdout: ] 2023-08-01T19:54:25.257 INFO:teuthology.orchestra.run.smithi006.stdout: }, 2023-08-01T19:54:25.257 INFO:teuthology.orchestra.run.smithi006.stdout: { 2023-08-01T19:54:25.258 INFO:teuthology.orchestra.run.smithi006.stdout: "tid": 3991, 2023-08-01T19:54:25.258 INFO:teuthology.orchestra.run.smithi006.stdout: "pg": "5.e533c960", 2023-08-01T19:54:25.258 INFO:teuthology.orchestra.run.smithi006.stdout: "osd": 2, 2023-08-01T19:54:25.258 INFO:teuthology.orchestra.run.smithi006.stdout: "object_id": "benchmark_data_smithi006_114134_object3990", 2023-08-01T19:54:25.258 INFO:teuthology.orchestra.run.smithi006.stdout: "object_locator": "@5", 2023-08-01T19:54:25.258 INFO:teuthology.orchestra.run.smithi006.stdout: "target_object_id": "benchmark_data_smithi006_114134_object3990", 2023-08-01T19:54:25.258 INFO:teuthology.orchestra.run.smithi006.stdout: "target_object_locator": "@5", 2023-08-01T19:54:25.258 INFO:teuthology.orchestra.run.smithi006.stdout: "paused": 0, 2023-08-01T19:54:25.259 INFO:teuthology.orchestra.run.smithi006.stdout: "used_replica": 0, 2023-08-01T19:54:25.259 INFO:teuthology.orchestra.run.smithi006.stdout: "precalc_pgid": 0, 2023-08-01T19:54:25.259 INFO:teuthology.orchestra.run.smithi006.stdout: "last_sent": "890.576555s", 2023-08-01T19:54:25.259 INFO:teuthology.orchestra.run.smithi006.stdout: "age": 0.0039999620000000001, 2023-08-01T19:54:25.259 INFO:teuthology.orchestra.run.smithi006.stdout: "attempts": 1, 2023-08-01T19:54:25.259 INFO:teuthology.orchestra.run.smithi006.stdout: "snapid": "head", 2023-08-01T19:54:25.259 INFO:teuthology.orchestra.run.smithi006.stdout: "snap_context": "0=[]", 2023-08-01T19:54:25.260 INFO:teuthology.orchestra.run.smithi006.stdout: "mtime": "2023-08-01T19:54:25.211358+0000", 2023-08-01T19:54:25.260 INFO:teuthology.orchestra.run.smithi006.stdout: "osd_ops": [ 2023-08-01T19:54:25.260 INFO:teuthology.orchestra.run.smithi006.stdout: "set-alloc-hint object_size 65536 write_size 65536", 2023-08-01T19:54:25.260 INFO:teuthology.orchestra.run.smithi006.stdout: "write 0~65536 in=65536b" 2023-08-01T19:54:25.260 INFO:teuthology.orchestra.run.smithi006.stdout: ] 2023-08-01T19:54:25.260 INFO:teuthology.orchestra.run.smithi006.stdout: }, 2023-08-01T19:54:25.260 INFO:teuthology.orchestra.run.smithi006.stdout: { 2023-08-01T19:54:25.260 INFO:teuthology.orchestra.run.smithi006.stdout: "tid": 3992, 2023-08-01T19:54:25.261 INFO:teuthology.orchestra.run.smithi006.stdout: "pg": "5.63f244db", 2023-08-01T19:54:25.261 INFO:teuthology.orchestra.run.smithi006.stdout: "osd": 2, 2023-08-01T19:54:25.261 INFO:teuthology.orchestra.run.smithi006.stdout: "object_id": "benchmark_data_smithi006_114134_object3991", 2023-08-01T19:54:25.261 INFO:teuthology.orchestra.run.smithi006.stdout: "object_locator": "@5", 2023-08-01T19:54:25.261 INFO:teuthology.orchestra.run.smithi006.stdout: "target_object_id": "benchmark_data_smithi006_114134_object3991", 2023-08-01T19:54:25.261 INFO:teuthology.orchestra.run.smithi006.stdout: "target_object_locator": "@5", 2023-08-01T19:54:25.261 INFO:teuthology.orchestra.run.smithi006.stdout: "paused": 0, 2023-08-01T19:54:25.261 INFO:teuthology.orchestra.run.smithi006.stdout: "used_replica": 0, 2023-08-01T19:54:25.262 INFO:teuthology.orchestra.run.smithi006.stdout: "precalc_pgid": 0, 2023-08-01T19:54:25.262 INFO:teuthology.orchestra.run.smithi006.stdout: "last_sent": "890.576555s", 2023-08-01T19:54:25.262 INFO:teuthology.orchestra.run.smithi006.stdout: "age": 0.0039999620000000001, 2023-08-01T19:54:25.262 INFO:teuthology.orchestra.run.smithi006.stdout: "attempts": 1, 2023-08-01T19:54:25.262 INFO:teuthology.orchestra.run.smithi006.stdout: "snapid": "head", 2023-08-01T19:54:25.262 INFO:teuthology.orchestra.run.smithi006.stdout: "snap_context": "0=[]", 2023-08-01T19:54:25.262 INFO:teuthology.orchestra.run.smithi006.stdout: "mtime": "2023-08-01T19:54:25.211814+0000", 2023-08-01T19:54:25.263 INFO:teuthology.orchestra.run.smithi006.stdout: "osd_ops": [ 2023-08-01T19:54:25.263 INFO:teuthology.orchestra.run.smithi006.stdout: "set-alloc-hint object_size 65536 write_size 65536", 2023-08-01T19:54:25.263 INFO:teuthology.orchestra.run.smithi006.stdout: "write 0~65536 in=65536b" 2023-08-01T19:54:25.263 INFO:teuthology.orchestra.run.smithi006.stdout: ] 2023-08-01T19:54:25.263 INFO:teuthology.orchestra.run.smithi006.stdout: } 2023-08-01T19:54:25.263 INFO:teuthology.orchestra.run.smithi006.stdout: ], 2023-08-01T19:54:25.263 INFO:teuthology.orchestra.run.smithi006.stdout: "linger_ops": [], 2023-08-01T19:54:25.263 INFO:teuthology.orchestra.run.smithi006.stdout: "pool_ops": [], 2023-08-01T19:54:25.264 INFO:teuthology.orchestra.run.smithi006.stdout: "pool_stat_ops": [], 2023-08-01T19:54:25.264 INFO:teuthology.orchestra.run.smithi006.stdout: "statfs_ops": [], 2023-08-01T19:54:25.264 INFO:teuthology.orchestra.run.smithi006.stdout: "command_ops": [] 2023-08-01T19:54:25.264 INFO:teuthology.orchestra.run.smithi006.stdout:} 2023-08-01T19:54:25.264 DEBUG:teuthology.orchestra.run.smithi006:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 120 ceph --cluster ceph -- tell 'osd.*' injectargs --osd_enable_op_tracker=false 2023-08-01T19:54:25.265 INFO:teuthology.orchestra.run.smithi155.stdout:{ 2023-08-01T19:54:25.266 INFO:teuthology.orchestra.run.smithi155.stdout: "ops": [ 2023-08-01T19:54:25.266 INFO:teuthology.orchestra.run.smithi155.stdout: { 2023-08-01T19:54:25.266 INFO:teuthology.orchestra.run.smithi155.stdout: "description": "osd_op(client.4668.0:4188 5.8 5:14266ca5:::benchmark_data_smithi006_114134_object4187:head [set-alloc-hint object_size 65536 write_size 65536,write 0~65536 in=65536b] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e22)", 2023-08-01T19:54:25.266 INFO:teuthology.orchestra.run.smithi155.stdout: "initiated_at": "2023-08-01T19:54:25.252798+0000", 2023-08-01T19:54:25.266 INFO:teuthology.orchestra.run.smithi155.stdout: "age": 0.0027432480000000002, 2023-08-01T19:54:25.266 INFO:teuthology.orchestra.run.smithi155.stdout: "duration": 0.00276597, 2023-08-01T19:54:25.266 INFO:teuthology.orchestra.run.smithi155.stdout: "type_data": { 2023-08-01T19:54:25.267 INFO:teuthology.orchestra.run.smithi155.stdout: "flag_point": "waiting for sub ops", 2023-08-01T19:54:25.267 INFO:teuthology.orchestra.run.smithi155.stdout: "client_info": { 2023-08-01T19:54:25.267 INFO:teuthology.orchestra.run.smithi155.stdout: "client": "client.4668", 2023-08-01T19:54:25.267 INFO:teuthology.orchestra.run.smithi155.stdout: "client_addr": "172.21.15.6:0/1709472247", 2023-08-01T19:54:25.267 INFO:teuthology.orchestra.run.smithi155.stdout: "tid": 4188 2023-08-01T19:54:25.267 INFO:teuthology.orchestra.run.smithi155.stdout: }, 2023-08-01T19:54:25.267 INFO:teuthology.orchestra.run.smithi155.stdout: "events": [ 2023-08-01T19:54:25.267 INFO:teuthology.orchestra.run.smithi155.stdout: { 2023-08-01T19:54:25.268 INFO:teuthology.orchestra.run.smithi155.stdout: "event": "initiated", 2023-08-01T19:54:25.268 INFO:teuthology.orchestra.run.smithi155.stdout: "time": "2023-08-01T19:54:25.252798+0000", 2023-08-01T19:54:25.268 INFO:teuthology.orchestra.run.smithi155.stdout: "duration": 0 2023-08-01T19:54:25.268 INFO:teuthology.orchestra.run.smithi155.stdout: }, 2023-08-01T19:54:25.268 INFO:teuthology.orchestra.run.smithi155.stdout: { 2023-08-01T19:54:25.268 INFO:teuthology.orchestra.run.smithi155.stdout: "event": "throttled", 2023-08-01T19:54:25.268 INFO:teuthology.orchestra.run.smithi155.stdout: "time": "2023-08-01T19:54:25.252798+0000", 2023-08-01T19:54:25.269 INFO:teuthology.orchestra.run.smithi155.stdout: "duration": 0 2023-08-01T19:54:25.269 INFO:teuthology.orchestra.run.smithi155.stdout: }, 2023-08-01T19:54:25.269 INFO:teuthology.orchestra.run.smithi155.stdout: { 2023-08-01T19:54:25.269 INFO:teuthology.orchestra.run.smithi155.stdout: "event": "header_read", 2023-08-01T19:54:25.269 INFO:teuthology.orchestra.run.smithi155.stdout: "time": "2023-08-01T19:54:25.252798+0000", 2023-08-01T19:54:25.269 INFO:teuthology.orchestra.run.smithi155.stdout: "duration": 4294967295.9999995 2023-08-01T19:54:25.269 INFO:teuthology.orchestra.run.smithi155.stdout: }, 2023-08-01T19:54:25.269 INFO:teuthology.orchestra.run.smithi155.stdout: { 2023-08-01T19:54:25.270 INFO:teuthology.orchestra.run.smithi155.stdout: "event": "all_read", 2023-08-01T19:54:25.270 INFO:teuthology.orchestra.run.smithi155.stdout: "time": "2023-08-01T19:54:25.252834+0000", 2023-08-01T19:54:25.270 INFO:teuthology.orchestra.run.smithi155.stdout: "duration": 3.6403999999999999e-05 2023-08-01T19:54:25.270 INFO:teuthology.orchestra.run.smithi155.stdout: }, 2023-08-01T19:54:25.270 INFO:teuthology.orchestra.run.smithi155.stdout: { 2023-08-01T19:54:25.270 INFO:teuthology.orchestra.run.smithi155.stdout: "event": "dispatched", 2023-08-01T19:54:25.270 INFO:teuthology.orchestra.run.smithi155.stdout: "time": "2023-08-01T19:54:25.252852+0000", 2023-08-01T19:54:25.270 INFO:teuthology.orchestra.run.smithi155.stdout: "duration": 1.8286000000000001e-05 2023-08-01T19:54:25.271 INFO:teuthology.orchestra.run.smithi155.stdout: }, 2023-08-01T19:54:25.271 INFO:teuthology.orchestra.run.smithi155.stdout: { 2023-08-01T19:54:25.271 INFO:teuthology.orchestra.run.smithi155.stdout: "event": "queued_for_pg", 2023-08-01T19:54:25.271 INFO:teuthology.orchestra.run.smithi155.stdout: "time": "2023-08-01T19:54:25.252859+0000", 2023-08-01T19:54:25.271 INFO:teuthology.orchestra.run.smithi155.stdout: "duration": 6.1789999999999996e-06 2023-08-01T19:54:25.271 INFO:teuthology.orchestra.run.smithi155.stdout: }, 2023-08-01T19:54:25.271 INFO:teuthology.orchestra.run.smithi155.stdout: { 2023-08-01T19:54:25.272 INFO:teuthology.orchestra.run.smithi155.stdout: "event": "reached_pg", 2023-08-01T19:54:25.272 INFO:teuthology.orchestra.run.smithi155.stdout: "time": "2023-08-01T19:54:25.253258+0000", 2023-08-01T19:54:25.272 INFO:teuthology.orchestra.run.smithi155.stdout: "duration": 0.00039976900000000001 2023-08-01T19:54:25.272 INFO:teuthology.orchestra.run.smithi155.stdout: }, 2023-08-01T19:54:25.272 INFO:teuthology.orchestra.run.smithi155.stdout: { 2023-08-01T19:54:25.272 INFO:teuthology.orchestra.run.smithi155.stdout: "event": "started", 2023-08-01T19:54:25.272 INFO:teuthology.orchestra.run.smithi155.stdout: "time": "2023-08-01T19:54:25.253398+0000", 2023-08-01T19:54:25.272 INFO:teuthology.orchestra.run.smithi155.stdout: "duration": 0.000139944 2023-08-01T19:54:25.273 INFO:teuthology.orchestra.run.smithi155.stdout: }, 2023-08-01T19:54:25.273 INFO:teuthology.orchestra.run.smithi155.stdout: { 2023-08-01T19:54:25.273 INFO:teuthology.orchestra.run.smithi155.stdout: "event": "waiting for subops from 0", 2023-08-01T19:54:25.273 INFO:teuthology.orchestra.run.smithi155.stdout: "time": "2023-08-01T19:54:25.253528+0000", 2023-08-01T19:54:25.273 INFO:teuthology.orchestra.run.smithi155.stdout: "duration": 0.00012982 2023-08-01T19:54:25.273 INFO:teuthology.orchestra.run.smithi155.stdout: }, 2023-08-01T19:54:25.273 INFO:teuthology.orchestra.run.smithi155.stdout: { 2023-08-01T19:54:25.273 INFO:teuthology.orchestra.run.smithi155.stdout: "event": "op_commit", 2023-08-01T19:54:25.274 INFO:teuthology.orchestra.run.smithi155.stdout: "time": "2023-08-01T19:54:25.254711+0000", 2023-08-01T19:54:25.274 INFO:teuthology.orchestra.run.smithi155.stdout: "duration": 0.0011829469999999999 2023-08-01T19:54:25.274 INFO:teuthology.orchestra.run.smithi155.stdout: } 2023-08-01T19:54:25.274 INFO:teuthology.orchestra.run.smithi155.stdout: ] 2023-08-01T19:54:25.274 INFO:teuthology.orchestra.run.smithi155.stdout: } 2023-08-01T19:54:25.274 INFO:teuthology.orchestra.run.smithi155.stdout: }, 2023-08-01T19:54:25.274 INFO:teuthology.orchestra.run.smithi155.stdout: { 2023-08-01T19:54:25.275 INFO:teuthology.orchestra.run.smithi155.stdout: "description": "osd_op(client.4668.0:4189 5.d 5:b237549c:::benchmark_data_smithi006_114134_object4188:head [set-alloc-hint object_size 65536 write_size 65536,write 0~65536 in=65536b] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e22)", 2023-08-01T19:54:25.275 INFO:teuthology.orchestra.run.smithi155.stdout: "initiated_at": "2023-08-01T19:54:25.252866+0000", 2023-08-01T19:54:25.275 INFO:teuthology.orchestra.run.smithi155.stdout: "age": 0.0026757759999999999, 2023-08-01T19:54:25.275 INFO:teuthology.orchestra.run.smithi155.stdout: "duration": 0.0027585560000000001, 2023-08-01T19:54:25.275 INFO:teuthology.orchestra.run.smithi155.stdout: "type_data": { 2023-08-01T19:54:25.275 INFO:teuthology.orchestra.run.smithi155.stdout: "flag_point": "waiting for sub ops", 2023-08-01T19:54:25.275 INFO:teuthology.orchestra.run.smithi155.stdout: "client_info": { 2023-08-01T19:54:25.275 INFO:teuthology.orchestra.run.smithi155.stdout: "client": "client.4668", 2023-08-01T19:54:25.276 INFO:teuthology.orchestra.run.smithi155.stdout: "client_addr": "172.21.15.6:0/1709472247", 2023-08-01T19:54:25.276 INFO:teuthology.orchestra.run.smithi155.stdout: "tid": 4189 2023-08-01T19:54:25.276 INFO:teuthology.orchestra.run.smithi155.stdout: }, 2023-08-01T19:54:25.276 INFO:teuthology.orchestra.run.smithi155.stdout: "events": [ 2023-08-01T19:54:25.276 INFO:teuthology.orchestra.run.smithi155.stdout: { 2023-08-01T19:54:25.276 INFO:teuthology.orchestra.run.smithi155.stdout: "event": "initiated", 2023-08-01T19:54:25.276 INFO:teuthology.orchestra.run.smithi155.stdout: "time": "2023-08-01T19:54:25.252866+0000", 2023-08-01T19:54:25.277 INFO:teuthology.orchestra.run.smithi155.stdout: "duration": 0 2023-08-01T19:54:25.277 INFO:teuthology.orchestra.run.smithi155.stdout: }, 2023-08-01T19:54:25.277 INFO:teuthology.orchestra.run.smithi155.stdout: { 2023-08-01T19:54:25.277 INFO:teuthology.orchestra.run.smithi155.stdout: "event": "throttled", 2023-08-01T19:54:25.277 INFO:teuthology.orchestra.run.smithi155.stdout: "time": "2023-08-01T19:54:25.252866+0000", 2023-08-01T19:54:25.277 INFO:teuthology.orchestra.run.smithi155.stdout: "duration": 0 2023-08-01T19:54:25.277 INFO:teuthology.orchestra.run.smithi155.stdout: }, 2023-08-01T19:54:25.277 INFO:teuthology.orchestra.run.smithi155.stdout: { 2023-08-01T19:54:25.278 INFO:teuthology.orchestra.run.smithi155.stdout: "event": "header_read", 2023-08-01T19:54:25.278 INFO:teuthology.orchestra.run.smithi155.stdout: "time": "2023-08-01T19:54:25.252865+0000", 2023-08-01T19:54:25.278 INFO:teuthology.orchestra.run.smithi155.stdout: "duration": 4294967295.9999995 2023-08-01T19:54:25.278 INFO:teuthology.orchestra.run.smithi155.stdout: }, 2023-08-01T19:54:25.278 INFO:teuthology.orchestra.run.smithi155.stdout: { 2023-08-01T19:54:25.278 INFO:teuthology.orchestra.run.smithi155.stdout: "event": "all_read", 2023-08-01T19:54:25.278 INFO:teuthology.orchestra.run.smithi155.stdout: "time": "2023-08-01T19:54:25.252906+0000", 2023-08-01T19:54:25.278 INFO:teuthology.orchestra.run.smithi155.stdout: "duration": 4.0924000000000003e-05 2023-08-01T19:54:25.279 INFO:teuthology.orchestra.run.smithi155.stdout: }, 2023-08-01T19:54:25.279 INFO:teuthology.orchestra.run.smithi155.stdout: { 2023-08-01T19:54:25.279 INFO:teuthology.orchestra.run.smithi155.stdout: "event": "dispatched", 2023-08-01T19:54:25.279 INFO:teuthology.orchestra.run.smithi155.stdout: "time": "2023-08-01T19:54:25.252934+0000", 2023-08-01T19:54:25.279 INFO:teuthology.orchestra.run.smithi155.stdout: "duration": 2.7682999999999999e-05 2023-08-01T19:54:25.279 INFO:teuthology.orchestra.run.smithi155.stdout: }, 2023-08-01T19:54:25.279 INFO:teuthology.orchestra.run.smithi155.stdout: { 2023-08-01T19:54:25.280 INFO:teuthology.orchestra.run.smithi155.stdout: "event": "queued_for_pg", 2023-08-01T19:54:25.280 INFO:teuthology.orchestra.run.smithi155.stdout: "time": "2023-08-01T19:54:25.252939+0000", 2023-08-01T19:54:25.280 INFO:teuthology.orchestra.run.smithi155.stdout: "duration": 5.3689999999999998e-06 2023-08-01T19:54:25.280 INFO:teuthology.orchestra.run.smithi155.stdout: }, 2023-08-01T19:54:25.280 INFO:teuthology.orchestra.run.smithi155.stdout: { 2023-08-01T19:54:25.280 INFO:teuthology.orchestra.run.smithi155.stdout: "event": "reached_pg", 2023-08-01T19:54:25.280 INFO:teuthology.orchestra.run.smithi155.stdout: "time": "2023-08-01T19:54:25.253753+0000", 2023-08-01T19:54:25.280 INFO:teuthology.orchestra.run.smithi155.stdout: "duration": 0.00081406100000000004 2023-08-01T19:54:25.281 INFO:teuthology.orchestra.run.smithi155.stdout: }, 2023-08-01T19:54:25.281 INFO:teuthology.orchestra.run.smithi155.stdout: { 2023-08-01T19:54:25.281 INFO:teuthology.orchestra.run.smithi155.stdout: "event": "started", 2023-08-01T19:54:25.281 INFO:teuthology.orchestra.run.smithi155.stdout: "time": "2023-08-01T19:54:25.253859+0000", 2023-08-01T19:54:25.281 INFO:teuthology.orchestra.run.smithi155.stdout: "duration": 0.000105973 2023-08-01T19:54:25.281 INFO:teuthology.orchestra.run.smithi155.stdout: }, 2023-08-01T19:54:25.281 INFO:teuthology.orchestra.run.smithi155.stdout: { 2023-08-01T19:54:25.281 INFO:teuthology.orchestra.run.smithi155.stdout: "event": "waiting for subops from 1", 2023-08-01T19:54:25.282 INFO:teuthology.orchestra.run.smithi155.stdout: "time": "2023-08-01T19:54:25.253991+0000", 2023-08-01T19:54:25.282 INFO:teuthology.orchestra.run.smithi155.stdout: "duration": 0.00013152500000000001 2023-08-01T19:54:25.282 INFO:teuthology.orchestra.run.smithi155.stdout: }, 2023-08-01T19:54:25.282 INFO:teuthology.orchestra.run.smithi155.stdout: { 2023-08-01T19:54:25.282 INFO:teuthology.orchestra.run.smithi155.stdout: "event": "op_commit", 2023-08-01T19:54:25.282 INFO:teuthology.orchestra.run.smithi155.stdout: "time": "2023-08-01T19:54:25.255026+0000", 2023-08-01T19:54:25.282 INFO:teuthology.orchestra.run.smithi155.stdout: "duration": 0.001034905 2023-08-01T19:54:25.283 INFO:teuthology.orchestra.run.smithi155.stdout: } 2023-08-01T19:54:25.283 INFO:teuthology.orchestra.run.smithi155.stdout: ] 2023-08-01T19:54:25.283 INFO:teuthology.orchestra.run.smithi155.stdout: } 2023-08-01T19:54:25.283 INFO:teuthology.orchestra.run.smithi155.stdout: }, 2023-08-01T19:54:25.283 INFO:teuthology.orchestra.run.smithi155.stdout: { 2023-08-01T19:54:25.283 INFO:teuthology.orchestra.run.smithi155.stdout: "description": "osd_op(client.4668.0:4192 5.0 5:0f04f3e3:::benchmark_data_smithi006_114134_object4191:head [set-alloc-hint object_size 65536 write_size 65536,write 0~65536 in=65536b] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e22)", 2023-08-01T19:54:25.283 INFO:teuthology.orchestra.run.smithi155.stdout: "initiated_at": "2023-08-01T19:54:25.252947+0000", 2023-08-01T19:54:25.283 INFO:teuthology.orchestra.run.smithi155.stdout: "age": 0.0025941089999999998, 2023-08-01T19:54:25.284 INFO:teuthology.orchestra.run.smithi155.stdout: "duration": 0.0027239389999999999, 2023-08-01T19:54:25.284 INFO:teuthology.orchestra.run.smithi155.stdout: "type_data": { 2023-08-01T19:54:25.284 INFO:teuthology.orchestra.run.smithi155.stdout: "flag_point": "waiting for sub ops", 2023-08-01T19:54:25.284 INFO:teuthology.orchestra.run.smithi155.stdout: "client_info": { 2023-08-01T19:54:25.284 INFO:teuthology.orchestra.run.smithi155.stdout: "client": "client.4668", 2023-08-01T19:54:25.284 INFO:teuthology.orchestra.run.smithi155.stdout: "client_addr": "172.21.15.6:0/1709472247", 2023-08-01T19:54:25.284 INFO:teuthology.orchestra.run.smithi155.stdout: "tid": 4192 2023-08-01T19:54:25.284 INFO:teuthology.orchestra.run.smithi155.stdout: }, 2023-08-01T19:54:25.285 INFO:teuthology.orchestra.run.smithi155.stdout: "events": [ 2023-08-01T19:54:25.285 INFO:teuthology.orchestra.run.smithi155.stdout: { 2023-08-01T19:54:25.285 INFO:teuthology.orchestra.run.smithi155.stdout: "event": "initiated", 2023-08-01T19:54:25.285 INFO:teuthology.orchestra.run.smithi155.stdout: "time": "2023-08-01T19:54:25.252947+0000", 2023-08-01T19:54:25.285 INFO:teuthology.orchestra.run.smithi155.stdout: "duration": 0 2023-08-01T19:54:25.285 INFO:teuthology.orchestra.run.smithi155.stdout: }, 2023-08-01T19:54:25.285 INFO:teuthology.orchestra.run.smithi155.stdout: { 2023-08-01T19:54:25.285 INFO:teuthology.orchestra.run.smithi155.stdout: "event": "throttled", 2023-08-01T19:54:25.286 INFO:teuthology.orchestra.run.smithi155.stdout: "time": "2023-08-01T19:54:25.252947+0000", 2023-08-01T19:54:25.286 INFO:teuthology.orchestra.run.smithi155.stdout: "duration": 0 2023-08-01T19:54:25.286 INFO:teuthology.orchestra.run.smithi155.stdout: }, 2023-08-01T19:54:25.286 INFO:teuthology.orchestra.run.smithi155.stdout: { 2023-08-01T19:54:25.286 INFO:teuthology.orchestra.run.smithi155.stdout: "event": "header_read", 2023-08-01T19:54:25.286 INFO:teuthology.orchestra.run.smithi155.stdout: "time": "2023-08-01T19:54:25.252947+0000", 2023-08-01T19:54:25.286 INFO:teuthology.orchestra.run.smithi155.stdout: "duration": 4294967295.9999995 2023-08-01T19:54:25.287 INFO:teuthology.orchestra.run.smithi155.stdout: }, 2023-08-01T19:54:25.287 INFO:teuthology.orchestra.run.smithi155.stdout: { 2023-08-01T19:54:25.287 INFO:teuthology.orchestra.run.smithi155.stdout: "event": "all_read", 2023-08-01T19:54:25.287 INFO:teuthology.orchestra.run.smithi155.stdout: "time": "2023-08-01T19:54:25.253027+0000", 2023-08-01T19:54:25.287 INFO:teuthology.orchestra.run.smithi155.stdout: "duration": 8.0271000000000004e-05 2023-08-01T19:54:25.287 INFO:teuthology.orchestra.run.smithi155.stdout: }, 2023-08-01T19:54:25.287 INFO:teuthology.orchestra.run.smithi155.stdout: { 2023-08-01T19:54:25.287 INFO:teuthology.orchestra.run.smithi155.stdout: "event": "dispatched", 2023-08-01T19:54:25.288 INFO:teuthology.orchestra.run.smithi155.stdout: "time": "2023-08-01T19:54:25.253050+0000", 2023-08-01T19:54:25.288 INFO:teuthology.orchestra.run.smithi155.stdout: "duration": 2.2381000000000001e-05 2023-08-01T19:54:25.288 INFO:teuthology.orchestra.run.smithi155.stdout: }, 2023-08-01T19:54:25.288 INFO:teuthology.orchestra.run.smithi155.stdout: { 2023-08-01T19:54:25.288 INFO:teuthology.orchestra.run.smithi155.stdout: "event": "queued_for_pg", 2023-08-01T19:54:25.288 INFO:teuthology.orchestra.run.smithi155.stdout: "time": "2023-08-01T19:54:25.253055+0000", 2023-08-01T19:54:25.288 INFO:teuthology.orchestra.run.smithi155.stdout: "duration": 5.4759999999999997e-06 2023-08-01T19:54:25.288 INFO:teuthology.orchestra.run.smithi155.stdout: }, 2023-08-01T19:54:25.289 INFO:teuthology.orchestra.run.smithi155.stdout: { 2023-08-01T19:54:25.289 INFO:teuthology.orchestra.run.smithi155.stdout: "event": "reached_pg", 2023-08-01T19:54:25.289 INFO:teuthology.orchestra.run.smithi155.stdout: "time": "2023-08-01T19:54:25.253243+0000", 2023-08-01T19:54:25.289 INFO:teuthology.orchestra.run.smithi155.stdout: "duration": 0.000188056 2023-08-01T19:54:25.289 INFO:teuthology.orchestra.run.smithi155.stdout: }, 2023-08-01T19:54:25.289 INFO:teuthology.orchestra.run.smithi155.stdout: { 2023-08-01T19:54:25.289 INFO:teuthology.orchestra.run.smithi155.stdout: "event": "started", 2023-08-01T19:54:25.289 INFO:teuthology.orchestra.run.smithi155.stdout: "time": "2023-08-01T19:54:25.253356+0000", 2023-08-01T19:54:25.290 INFO:teuthology.orchestra.run.smithi155.stdout: "duration": 0.000112707 2023-08-01T19:54:25.290 INFO:teuthology.orchestra.run.smithi155.stdout: }, 2023-08-01T19:54:25.290 INFO:teuthology.orchestra.run.smithi155.stdout: { 2023-08-01T19:54:25.290 INFO:teuthology.orchestra.run.smithi155.stdout: "event": "waiting for subops from 0", 2023-08-01T19:54:25.290 INFO:teuthology.orchestra.run.smithi155.stdout: "time": "2023-08-01T19:54:25.253500+0000", 2023-08-01T19:54:25.290 INFO:teuthology.orchestra.run.smithi155.stdout: "duration": 0.00014440899999999999 2023-08-01T19:54:25.290 INFO:teuthology.orchestra.run.smithi155.stdout: }, 2023-08-01T19:54:25.291 INFO:teuthology.orchestra.run.smithi155.stdout: { 2023-08-01T19:54:25.291 INFO:teuthology.orchestra.run.smithi155.stdout: "event": "op_commit", 2023-08-01T19:54:25.291 INFO:teuthology.orchestra.run.smithi155.stdout: "time": "2023-08-01T19:54:25.254687+0000", 2023-08-01T19:54:25.291 INFO:teuthology.orchestra.run.smithi155.stdout: "duration": 0.001186529 2023-08-01T19:54:25.291 INFO:teuthology.orchestra.run.smithi155.stdout: } 2023-08-01T19:54:25.291 INFO:teuthology.orchestra.run.smithi155.stdout: ] 2023-08-01T19:54:25.291 INFO:teuthology.orchestra.run.smithi155.stdout: } 2023-08-01T19:54:25.291 INFO:teuthology.orchestra.run.smithi155.stdout: }, 2023-08-01T19:54:25.292 INFO:teuthology.orchestra.run.smithi155.stdout: { 2023-08-01T19:54:25.292 INFO:teuthology.orchestra.run.smithi155.stdout: "description": "osd_op(client.4668.0:4194 5.b 5:d14eb599:::benchmark_data_smithi006_114134_object4193:head [set-alloc-hint object_size 65536 write_size 65536,write 0~65536 in=65536b] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e22)", 2023-08-01T19:54:25.292 INFO:teuthology.orchestra.run.smithi155.stdout: "initiated_at": "2023-08-01T19:54:25.253063+0000", 2023-08-01T19:54:25.292 INFO:teuthology.orchestra.run.smithi155.stdout: "age": 0.0024786750000000001, 2023-08-01T19:54:25.292 INFO:teuthology.orchestra.run.smithi155.stdout: "duration": 0.0026557939999999999, 2023-08-01T19:54:25.292 INFO:teuthology.orchestra.run.smithi155.stdout: "type_data": { 2023-08-01T19:54:25.292 INFO:teuthology.orchestra.run.smithi155.stdout: "flag_point": "waiting for sub ops", 2023-08-01T19:54:25.292 INFO:teuthology.orchestra.run.smithi155.stdout: "client_info": { 2023-08-01T19:54:25.293 INFO:teuthology.orchestra.run.smithi155.stdout: "client": "client.4668", 2023-08-01T19:54:25.293 INFO:teuthology.orchestra.run.smithi155.stdout: "client_addr": "172.21.15.6:0/1709472247", 2023-08-01T19:54:25.293 INFO:teuthology.orchestra.run.smithi155.stdout: "tid": 4194 2023-08-01T19:54:25.293 INFO:teuthology.orchestra.run.smithi155.stdout: }, 2023-08-01T19:54:25.293 INFO:teuthology.orchestra.run.smithi155.stdout: "events": [ 2023-08-01T19:54:25.293 INFO:teuthology.orchestra.run.smithi155.stdout: { 2023-08-01T19:54:25.293 INFO:teuthology.orchestra.run.smithi155.stdout: "event": "initiated", 2023-08-01T19:54:25.293 INFO:teuthology.orchestra.run.smithi155.stdout: "time": "2023-08-01T19:54:25.253063+0000", 2023-08-01T19:54:25.294 INFO:teuthology.orchestra.run.smithi155.stdout: "duration": 0 2023-08-01T19:54:25.294 INFO:teuthology.orchestra.run.smithi155.stdout: }, 2023-08-01T19:54:25.294 INFO:teuthology.orchestra.run.smithi155.stdout: { 2023-08-01T19:54:25.294 INFO:teuthology.orchestra.run.smithi155.stdout: "event": "throttled", 2023-08-01T19:54:25.294 INFO:teuthology.orchestra.run.smithi155.stdout: "time": "2023-08-01T19:54:25.253063+0000", 2023-08-01T19:54:25.294 INFO:teuthology.orchestra.run.smithi155.stdout: "duration": 0 2023-08-01T19:54:25.294 INFO:teuthology.orchestra.run.smithi155.stdout: }, 2023-08-01T19:54:25.295 INFO:teuthology.orchestra.run.smithi155.stdout: { 2023-08-01T19:54:25.295 INFO:teuthology.orchestra.run.smithi155.stdout: "event": "header_read", 2023-08-01T19:54:25.295 INFO:teuthology.orchestra.run.smithi155.stdout: "time": "2023-08-01T19:54:25.253062+0000", 2023-08-01T19:54:25.295 INFO:teuthology.orchestra.run.smithi155.stdout: "duration": 4294967295.9999995 2023-08-01T19:54:25.295 INFO:teuthology.orchestra.run.smithi155.stdout: }, 2023-08-01T19:54:25.295 INFO:teuthology.orchestra.run.smithi155.stdout: { 2023-08-01T19:54:25.295 INFO:teuthology.orchestra.run.smithi155.stdout: "event": "all_read", 2023-08-01T19:54:25.295 INFO:teuthology.orchestra.run.smithi155.stdout: "time": "2023-08-01T19:54:25.253098+0000", 2023-08-01T19:54:25.296 INFO:teuthology.orchestra.run.smithi155.stdout: "duration": 3.5828000000000003e-05 2023-08-01T19:54:25.296 INFO:teuthology.orchestra.run.smithi155.stdout: }, 2023-08-01T19:54:25.296 INFO:teuthology.orchestra.run.smithi155.stdout: { 2023-08-01T19:54:25.296 INFO:teuthology.orchestra.run.smithi155.stdout: "event": "dispatched", 2023-08-01T19:54:25.296 INFO:teuthology.orchestra.run.smithi155.stdout: "time": "2023-08-01T19:54:25.253106+0000", 2023-08-01T19:54:25.296 INFO:teuthology.orchestra.run.smithi155.stdout: "duration": 7.7980000000000006e-06 2023-08-01T19:54:25.296 INFO:teuthology.orchestra.run.smithi155.stdout: }, 2023-08-01T19:54:25.296 INFO:teuthology.orchestra.run.smithi155.stdout: { 2023-08-01T19:54:25.297 INFO:teuthology.orchestra.run.smithi155.stdout: "event": "queued_for_pg", 2023-08-01T19:54:25.297 INFO:teuthology.orchestra.run.smithi155.stdout: "time": "2023-08-01T19:54:25.253111+0000", 2023-08-01T19:54:25.297 INFO:teuthology.orchestra.run.smithi155.stdout: "duration": 5.276e-06 2023-08-01T19:54:25.297 INFO:teuthology.orchestra.run.smithi155.stdout: }, 2023-08-01T19:54:25.297 INFO:teuthology.orchestra.run.smithi155.stdout: { 2023-08-01T19:54:25.297 INFO:teuthology.orchestra.run.smithi155.stdout: "event": "reached_pg", 2023-08-01T19:54:25.297 INFO:teuthology.orchestra.run.smithi155.stdout: "time": "2023-08-01T19:54:25.253187+0000", 2023-08-01T19:54:25.297 INFO:teuthology.orchestra.run.smithi155.stdout: "duration": 7.5412000000000002e-05 2023-08-01T19:54:25.298 INFO:teuthology.orchestra.run.smithi155.stdout: }, 2023-08-01T19:54:25.298 INFO:teuthology.orchestra.run.smithi155.stdout: { 2023-08-01T19:54:25.298 INFO:teuthology.orchestra.run.smithi155.stdout: "event": "started", 2023-08-01T19:54:25.298 INFO:teuthology.orchestra.run.smithi155.stdout: "time": "2023-08-01T19:54:25.253266+0000", 2023-08-01T19:54:25.298 INFO:teuthology.orchestra.run.smithi155.stdout: "duration": 7.9035999999999993e-05 2023-08-01T19:54:25.298 INFO:teuthology.orchestra.run.smithi155.stdout: }, 2023-08-01T19:54:25.298 INFO:teuthology.orchestra.run.smithi155.stdout: { 2023-08-01T19:54:25.298 INFO:teuthology.orchestra.run.smithi155.stdout: "event": "waiting for subops from 0", 2023-08-01T19:54:25.299 INFO:teuthology.orchestra.run.smithi155.stdout: "time": "2023-08-01T19:54:25.253360+0000", 2023-08-01T19:54:25.299 INFO:teuthology.orchestra.run.smithi155.stdout: "duration": 9.4217999999999998e-05 2023-08-01T19:54:25.299 INFO:teuthology.orchestra.run.smithi155.stdout: }, 2023-08-01T19:54:25.299 INFO:teuthology.orchestra.run.smithi155.stdout: { 2023-08-01T19:54:25.299 INFO:teuthology.orchestra.run.smithi155.stdout: "event": "op_commit", 2023-08-01T19:54:25.299 INFO:teuthology.orchestra.run.smithi155.stdout: "time": "2023-08-01T19:54:25.254725+0000", 2023-08-01T19:54:25.299 INFO:teuthology.orchestra.run.smithi155.stdout: "duration": 0.0013648779999999999 2023-08-01T19:54:25.300 INFO:teuthology.orchestra.run.smithi155.stdout: } 2023-08-01T19:54:25.300 INFO:teuthology.orchestra.run.smithi155.stdout: ] 2023-08-01T19:54:25.300 INFO:teuthology.orchestra.run.smithi155.stdout: } 2023-08-01T19:54:25.300 INFO:teuthology.orchestra.run.smithi155.stdout: }, 2023-08-01T19:54:25.300 INFO:teuthology.orchestra.run.smithi155.stdout: { 2023-08-01T19:54:25.300 INFO:teuthology.orchestra.run.smithi155.stdout: "description": "osd_op(client.4668.0:4198 5.e 5:7215e824:::benchmark_data_smithi006_114134_object4197:head [set-alloc-hint object_size 65536 write_size 65536,write 0~65536 in=65536b] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e22)", 2023-08-01T19:54:25.300 INFO:teuthology.orchestra.run.smithi155.stdout: "initiated_at": "2023-08-01T19:54:25.254794+0000", 2023-08-01T19:54:25.300 INFO:teuthology.orchestra.run.smithi155.stdout: "age": 0.00074774200000000002, 2023-08-01T19:54:25.301 INFO:teuthology.orchestra.run.smithi155.stdout: "duration": 0.0010025920000000001, 2023-08-01T19:54:25.301 INFO:teuthology.orchestra.run.smithi155.stdout: "type_data": { 2023-08-01T19:54:25.301 INFO:teuthology.orchestra.run.smithi155.stdout: "flag_point": "waiting for sub ops", 2023-08-01T19:54:25.301 INFO:teuthology.orchestra.run.smithi155.stdout: "client_info": { 2023-08-01T19:54:25.301 INFO:teuthology.orchestra.run.smithi155.stdout: "client": "client.4668", 2023-08-01T19:54:25.301 INFO:teuthology.orchestra.run.smithi155.stdout: "client_addr": "172.21.15.6:0/1709472247", 2023-08-01T19:54:25.301 INFO:teuthology.orchestra.run.smithi155.stdout: "tid": 4198 2023-08-01T19:54:25.301 INFO:teuthology.orchestra.run.smithi155.stdout: }, 2023-08-01T19:54:25.302 INFO:teuthology.orchestra.run.smithi155.stdout: "events": [ 2023-08-01T19:54:25.302 INFO:teuthology.orchestra.run.smithi155.stdout: { 2023-08-01T19:54:25.302 INFO:teuthology.orchestra.run.smithi155.stdout: "event": "initiated", 2023-08-01T19:54:25.302 INFO:teuthology.orchestra.run.smithi155.stdout: "time": "2023-08-01T19:54:25.254794+0000", 2023-08-01T19:54:25.302 INFO:teuthology.orchestra.run.smithi155.stdout: "duration": 0 2023-08-01T19:54:25.302 INFO:teuthology.orchestra.run.smithi155.stdout: }, 2023-08-01T19:54:25.302 INFO:teuthology.orchestra.run.smithi155.stdout: { 2023-08-01T19:54:25.302 INFO:teuthology.orchestra.run.smithi155.stdout: "event": "throttled", 2023-08-01T19:54:25.303 INFO:teuthology.orchestra.run.smithi155.stdout: "time": "2023-08-01T19:54:25.254794+0000", 2023-08-01T19:54:25.303 INFO:teuthology.orchestra.run.smithi155.stdout: "duration": 0 2023-08-01T19:54:25.303 INFO:teuthology.orchestra.run.smithi155.stdout: }, 2023-08-01T19:54:25.303 INFO:teuthology.orchestra.run.smithi155.stdout: { 2023-08-01T19:54:25.303 INFO:teuthology.orchestra.run.smithi155.stdout: "event": "header_read", 2023-08-01T19:54:25.303 INFO:teuthology.orchestra.run.smithi155.stdout: "time": "2023-08-01T19:54:25.254793+0000", 2023-08-01T19:54:25.303 INFO:teuthology.orchestra.run.smithi155.stdout: "duration": 4294967295.999999 2023-08-01T19:54:25.303 INFO:teuthology.orchestra.run.smithi155.stdout: }, 2023-08-01T19:54:25.304 INFO:teuthology.orchestra.run.smithi155.stdout: { 2023-08-01T19:54:25.304 INFO:teuthology.orchestra.run.smithi155.stdout: "event": "all_read", 2023-08-01T19:54:25.304 INFO:teuthology.orchestra.run.smithi155.stdout: "time": "2023-08-01T19:54:25.254879+0000", 2023-08-01T19:54:25.304 INFO:teuthology.orchestra.run.smithi155.stdout: "duration": 8.5760999999999994e-05 2023-08-01T19:54:25.304 INFO:teuthology.orchestra.run.smithi155.stdout: }, 2023-08-01T19:54:25.304 INFO:teuthology.orchestra.run.smithi155.stdout: { 2023-08-01T19:54:25.304 INFO:teuthology.orchestra.run.smithi155.stdout: "event": "dispatched", 2023-08-01T19:54:25.305 INFO:teuthology.orchestra.run.smithi155.stdout: "time": "2023-08-01T19:54:25.254890+0000", 2023-08-01T19:54:25.305 INFO:teuthology.orchestra.run.smithi155.stdout: "duration": 1.0879e-05 2023-08-01T19:54:25.305 INFO:teuthology.orchestra.run.smithi155.stdout: }, 2023-08-01T19:54:25.305 INFO:teuthology.orchestra.run.smithi155.stdout: { 2023-08-01T19:54:25.305 INFO:teuthology.orchestra.run.smithi155.stdout: "event": "queued_for_pg", 2023-08-01T19:54:25.305 INFO:teuthology.orchestra.run.smithi155.stdout: "time": "2023-08-01T19:54:25.254896+0000", 2023-08-01T19:54:25.305 INFO:teuthology.orchestra.run.smithi155.stdout: "duration": 6.3389999999999998e-06 2023-08-01T19:54:25.305 INFO:teuthology.orchestra.run.smithi155.stdout: }, 2023-08-01T19:54:25.306 INFO:teuthology.orchestra.run.smithi155.stdout: { 2023-08-01T19:54:25.306 INFO:teuthology.orchestra.run.smithi155.stdout: "event": "reached_pg", 2023-08-01T19:54:25.306 INFO:teuthology.orchestra.run.smithi155.stdout: "time": "2023-08-01T19:54:25.254926+0000", 2023-08-01T19:54:25.306 INFO:teuthology.orchestra.run.smithi155.stdout: "duration": 3.0580000000000002e-05 2023-08-01T19:54:25.306 INFO:teuthology.orchestra.run.smithi155.stdout: }, 2023-08-01T19:54:25.306 INFO:teuthology.orchestra.run.smithi155.stdout: { 2023-08-01T19:54:25.306 INFO:teuthology.orchestra.run.smithi155.stdout: "event": "started", 2023-08-01T19:54:25.306 INFO:teuthology.orchestra.run.smithi155.stdout: "time": "2023-08-01T19:54:25.255008+0000", 2023-08-01T19:54:25.307 INFO:teuthology.orchestra.run.smithi155.stdout: "duration": 8.1518000000000001e-05 2023-08-01T19:54:25.307 INFO:teuthology.orchestra.run.smithi155.stdout: }, 2023-08-01T19:54:25.307 INFO:teuthology.orchestra.run.smithi155.stdout: { 2023-08-01T19:54:25.307 INFO:teuthology.orchestra.run.smithi155.stdout: "event": "waiting for subops from 0", 2023-08-01T19:54:25.307 INFO:teuthology.orchestra.run.smithi155.stdout: "time": "2023-08-01T19:54:25.255092+0000", 2023-08-01T19:54:25.307 INFO:teuthology.orchestra.run.smithi155.stdout: "duration": 8.365e-05 2023-08-01T19:54:25.307 INFO:teuthology.orchestra.run.smithi155.stdout: } 2023-08-01T19:54:25.307 INFO:teuthology.orchestra.run.smithi155.stdout: ] 2023-08-01T19:54:25.308 INFO:teuthology.orchestra.run.smithi155.stdout: } 2023-08-01T19:54:25.308 INFO:teuthology.orchestra.run.smithi155.stdout: }, 2023-08-01T19:54:25.308 INFO:teuthology.orchestra.run.smithi155.stdout: { 2023-08-01T19:54:25.308 INFO:teuthology.orchestra.run.smithi155.stdout: "description": "osd_repop(client.4668.0:4200 5.a e22/19 5:561c010d:::benchmark_data_smithi006_114134_object4199:head v 22'253, mlcod=22'251)", 2023-08-01T19:54:25.308 INFO:teuthology.orchestra.run.smithi155.stdout: "initiated_at": "2023-08-01T19:54:25.255414+0000", 2023-08-01T19:54:25.308 INFO:teuthology.orchestra.run.smithi155.stdout: "age": 0.000127713, 2023-08-01T19:54:25.308 INFO:teuthology.orchestra.run.smithi155.stdout: "duration": 0.00047101700000000001, 2023-08-01T19:54:25.309 INFO:teuthology.orchestra.run.smithi155.stdout: "type_data": { 2023-08-01T19:54:25.309 INFO:teuthology.orchestra.run.smithi155.stdout: "flag_point": "started", 2023-08-01T19:54:25.309 INFO:teuthology.orchestra.run.smithi155.stdout: "events": [ 2023-08-01T19:54:25.309 INFO:teuthology.orchestra.run.smithi155.stdout: { 2023-08-01T19:54:25.309 INFO:teuthology.orchestra.run.smithi155.stdout: "event": "initiated", 2023-08-01T19:54:25.309 INFO:teuthology.orchestra.run.smithi155.stdout: "time": "2023-08-01T19:54:25.255414+0000", 2023-08-01T19:54:25.309 INFO:teuthology.orchestra.run.smithi155.stdout: "duration": 0 2023-08-01T19:54:25.309 INFO:teuthology.orchestra.run.smithi155.stdout: }, 2023-08-01T19:54:25.310 INFO:teuthology.orchestra.run.smithi155.stdout: { 2023-08-01T19:54:25.310 INFO:teuthology.orchestra.run.smithi155.stdout: "event": "throttled", 2023-08-01T19:54:25.310 INFO:teuthology.orchestra.run.smithi155.stdout: "time": "2023-08-01T19:54:25.255414+0000", 2023-08-01T19:54:25.310 INFO:teuthology.orchestra.run.smithi155.stdout: "duration": 0 2023-08-01T19:54:25.310 INFO:teuthology.orchestra.run.smithi155.stdout: }, 2023-08-01T19:54:25.310 INFO:teuthology.orchestra.run.smithi155.stdout: { 2023-08-01T19:54:25.310 INFO:teuthology.orchestra.run.smithi155.stdout: "event": "header_read", 2023-08-01T19:54:25.310 INFO:teuthology.orchestra.run.smithi155.stdout: "time": "2023-08-01T19:54:25.255413+0000", 2023-08-01T19:54:25.311 INFO:teuthology.orchestra.run.smithi155.stdout: "duration": 4294967295.9999995 2023-08-01T19:54:25.311 INFO:teuthology.orchestra.run.smithi155.stdout: }, 2023-08-01T19:54:25.311 INFO:teuthology.orchestra.run.smithi155.stdout: { 2023-08-01T19:54:25.311 INFO:teuthology.orchestra.run.smithi155.stdout: "event": "all_read", 2023-08-01T19:54:25.311 INFO:teuthology.orchestra.run.smithi155.stdout: "time": "2023-08-01T19:54:25.255499+0000", 2023-08-01T19:54:25.311 INFO:teuthology.orchestra.run.smithi155.stdout: "duration": 8.5167000000000006e-05 2023-08-01T19:54:25.311 INFO:teuthology.orchestra.run.smithi155.stdout: }, 2023-08-01T19:54:25.311 INFO:teuthology.orchestra.run.smithi155.stdout: { 2023-08-01T19:54:25.312 INFO:teuthology.orchestra.run.smithi155.stdout: "event": "dispatched", 2023-08-01T19:54:25.312 INFO:teuthology.orchestra.run.smithi155.stdout: "time": "2023-08-01T19:54:25.255511+0000", 2023-08-01T19:54:25.312 INFO:teuthology.orchestra.run.smithi155.stdout: "duration": 1.2091e-05 2023-08-01T19:54:25.312 INFO:teuthology.orchestra.run.smithi155.stdout: }, 2023-08-01T19:54:25.312 INFO:teuthology.orchestra.run.smithi155.stdout: { 2023-08-01T19:54:25.312 INFO:teuthology.orchestra.run.smithi155.stdout: "event": "queued_for_pg", 2023-08-01T19:54:25.312 INFO:teuthology.orchestra.run.smithi155.stdout: "time": "2023-08-01T19:54:25.255516+0000", 2023-08-01T19:54:25.312 INFO:teuthology.orchestra.run.smithi155.stdout: "duration": 5.6359999999999999e-06 2023-08-01T19:54:25.313 INFO:teuthology.orchestra.run.smithi155.stdout: }, 2023-08-01T19:54:25.313 INFO:teuthology.orchestra.run.smithi155.stdout: { 2023-08-01T19:54:25.313 INFO:teuthology.orchestra.run.smithi155.stdout: "event": "reached_pg", 2023-08-01T19:54:25.313 INFO:teuthology.orchestra.run.smithi155.stdout: "time": "2023-08-01T19:54:25.255545+0000", 2023-08-01T19:54:25.313 INFO:teuthology.orchestra.run.smithi155.stdout: "duration": 2.9179999999999998e-05 2023-08-01T19:54:25.313 INFO:teuthology.orchestra.run.smithi155.stdout: }, 2023-08-01T19:54:25.313 INFO:teuthology.orchestra.run.smithi155.stdout: { 2023-08-01T19:54:25.314 INFO:teuthology.orchestra.run.smithi155.stdout: "event": "started", 2023-08-01T19:54:25.314 INFO:teuthology.orchestra.run.smithi155.stdout: "time": "2023-08-01T19:54:25.255559+0000", 2023-08-01T19:54:25.314 INFO:teuthology.orchestra.run.smithi155.stdout: "duration": 1.3239e-05 2023-08-01T19:54:25.314 INFO:teuthology.orchestra.run.smithi155.stdout: } 2023-08-01T19:54:25.314 INFO:teuthology.orchestra.run.smithi155.stdout: ] 2023-08-01T19:54:25.314 INFO:teuthology.orchestra.run.smithi155.stdout: } 2023-08-01T19:54:25.314 INFO:teuthology.orchestra.run.smithi155.stdout: } 2023-08-01T19:54:25.314 INFO:teuthology.orchestra.run.smithi155.stdout: ], 2023-08-01T19:54:25.315 INFO:teuthology.orchestra.run.smithi155.stdout: "num_ops": 6 2023-08-01T19:54:25.315 INFO:teuthology.orchestra.run.smithi155.stdout:} 2023-08-01T19:54:25.316 DEBUG:tasks.admin_socket:admin socket command objecter_requests returned { "ops": [ { "tid": 3993, "pg": "5.dc87dee6", "osd": 0, "object_id": "benchmark_data_smithi006_114134_object3992", "object_locator": "@5", "target_object_id": "benchmark_data_smithi006_114134_object3992", "target_object_locator": "@5", "paused": 0, "used_replica": 0, "precalc_pgid": 0, "last_sent": "890.576555s", "age": 0.0039999620000000001, "attempts": 1, "snapid": "head", "snap_context": "0=[]", "mtime": "2023-08-01T19:54:25.211997+0000", "osd_ops": [ "set-alloc-hint object_size 65536 write_size 65536", "write 0~65536 in=65536b" ] }, { "tid": 3994, "pg": "5.8246a795", "osd": 0, "object_id": "benchmark_data_smithi006_114134_object3993", "object_locator": "@5", "target_object_id": "benchmark_data_smithi006_114134_object3993", "target_object_locator": "@5", "paused": 0, "used_replica": 0, "precalc_pgid": 0, "last_sent": "890.578555s", "age": 0.0019999810000000001, "attempts": 1, "snapid": "head", "snap_context": "0=[]", "mtime": "2023-08-01T19:54:25.213230+0000", "osd_ops": [ "set-alloc-hint object_size 65536 write_size 65536", "write 0~65536 in=65536b" ] }, { "tid": 3995, "pg": "5.462fc71c", "osd": 0, "object_id": "benchmark_data_smithi006_114134_object3994", "object_locator": "@5", "target_object_id": "benchmark_data_smithi006_114134_object3994", "target_object_locator": "@5", "paused": 0, "used_replica": 0, "precalc_pgid": 0, "last_sent": "890.578555s", "age": 0.0019999810000000001, "attempts": 1, "snapid": "head", "snap_context": "0=[]", "mtime": "2023-08-01T19:54:25.213336+0000", "osd_ops": [ "set-alloc-hint object_size 65536 write_size 65536", "write 0~65536 in=65536b" ] }, { "tid": 3996, "pg": "5.3d88bffc", "osd": 0, "object_id": "benchmark_data_smithi006_114134_object3995", "object_locator": "@5", "target_object_id": "benchmark_data_smithi006_114134_object3995", "target_object_locator": "@5", "paused": 0, "used_replica": 0, "precalc_pgid": 0, "last_sent": "890.578555s", "age": 0.0019999810000000001, "attempts": 1, "snapid": "head", "snap_context": "0=[]", "mtime": "2023-08-01T19:54:25.213388+0000", "osd_ops": [ "set-alloc-hint object_size 65536 write_size 65536", "write 0~65536 in=65536b" ] }, { "tid": 3983, "pg": "5.d2ad41e9", "osd": 1, "object_id": "benchmark_data_smithi006_114134_object3982", "object_locator": "@5", "target_object_id": "benchmark_data_smithi006_114134_object3982", "target_object_locator": "@5", "paused": 0, "used_replica": 0, "precalc_pgid": 0, "last_sent": "890.575555s", "age": 0.0049999529999999997, "attempts": 1, "snapid": "head", "snap_context": "0=[]", "mtime": "2023-08-01T19:54:25.210364+0000", "osd_ops": [ "set-alloc-hint object_size 65536 write_size 65536", "write 0~65536 in=65536b" ] }, { "tid": 3984, "pg": "5.52ceb77f", "osd": 1, "object_id": "benchmark_data_smithi006_114134_object3983", "object_locator": "@5", "target_object_id": "benchmark_data_smithi006_114134_object3983", "target_object_locator": "@5", "paused": 0, "used_replica": 0, "precalc_pgid": 0, "last_sent": "890.575555s", "age": 0.0049999529999999997, "attempts": 1, "snapid": "head", "snap_context": "0=[]", "mtime": "2023-08-01T19:54:25.210390+0000", "osd_ops": [ "set-alloc-hint object_size 65536 write_size 65536", "write 0~65536 in=65536b" ] }, { "tid": 3986, "pg": "5.a2ec5f21", "osd": 1, "object_id": "benchmark_data_smithi006_114134_object3985", "object_locator": "@5", "target_object_id": "benchmark_data_smithi006_114134_object3985", "target_object_locator": "@5", "paused": 0, "used_replica": 0, "precalc_pgid": 0, "last_sent": "890.575555s", "age": 0.0049999529999999997, "attempts": 1, "snapid": "head", "snap_context": "0=[]", "mtime": "2023-08-01T19:54:25.210442+0000", "osd_ops": [ "set-alloc-hint object_size 65536 write_size 65536", "write 0~65536 in=65536b" ] }, { "tid": 3987, "pg": "5.f0d0904f", "osd": 1, "object_id": "benchmark_data_smithi006_114134_object3986", "object_locator": "@5", "target_object_id": "benchmark_data_smithi006_114134_object3986", "target_object_locator": "@5", "paused": 0, "used_replica": 0, "precalc_pgid": 0, "last_sent": "890.575555s", "age": 0.0049999529999999997, "attempts": 1, "snapid": "head", "snap_context": "0=[]", "mtime": "2023-08-01T19:54:25.210463+0000", "osd_ops": [ "set-alloc-hint object_size 65536 write_size 65536", "write 0~65536 in=65536b" ] }, { "tid": 3989, "pg": "5.f01b86df", "osd": 1, "object_id": "benchmark_data_smithi006_114134_object3988", "object_locator": "@5", "target_object_id": "benchmark_data_smithi006_114134_object3988", "target_object_locator": "@5", "paused": 0, "used_replica": 0, "precalc_pgid": 0, "last_sent": "890.575555s", "age": 0.0049999529999999997, "attempts": 1, "snapid": "head", "snap_context": "0=[]", "mtime": "2023-08-01T19:54:25.210736+0000", "osd_ops": [ "set-alloc-hint object_size 65536 write_size 65536", "write 0~65536 in=65536b" ] }, { "tid": 3980, "pg": "5.7a3b86ad", "osd": 2, "object_id": "benchmark_data_smithi006_114134_object3979", "object_locator": "@5", "target_object_id": "benchmark_data_smithi006_114134_object3979", "target_object_locator": "@5", "paused": 0, "used_replica": 0, "precalc_pgid": 0, "last_sent": "890.574555s", "age": 0.0059999429999999998, "attempts": 1, "snapid": "head", "snap_context": "0=[]", "mtime": "2023-08-01T19:54:25.210101+0000", "osd_ops": [ "set-alloc-hint object_size 65536 write_size 65536", "write 0~65536 in=65536b" ] }, { "tid": 3981, "pg": "5.8553391e", "osd": 2, "object_id": "benchmark_data_smithi006_114134_object3980", "object_locator": "@5", "target_object_id": "benchmark_data_smithi006_114134_object3980", "target_object_locator": "@5", "paused": 0, "used_replica": 0, "precalc_pgid": 0, "last_sent": "890.574555s", "age": 0.0059999429999999998, "attempts": 1, "snapid": "head", "snap_context": "0=[]", "mtime": "2023-08-01T19:54:25.210198+0000", "osd_ops": [ "set-alloc-hint object_size 65536 write_size 65536", "write 0~65536 in=65536b" ] }, { "tid": 3985, "pg": "5.41193c80", "osd": 2, "object_id": "benchmark_data_smithi006_114134_object3984", "object_locator": "@5", "target_object_id": "benchmark_data_smithi006_114134_object3984", "target_object_locator": "@5", "paused": 0, "used_replica": 0, "precalc_pgid": 0, "last_sent": "890.575555s", "age": 0.0049999529999999997, "attempts": 1, "snapid": "head", "snap_context": "0=[]", "mtime": "2023-08-01T19:54:25.210399+0000", "osd_ops": [ "set-alloc-hint object_size 65536 write_size 65536", "write 0~65536 in=65536b" ] }, { "tid": 3988, "pg": "5.10d02f48", "osd": 2, "object_id": "benchmark_data_smithi006_114134_object3987", "object_locator": "@5", "target_object_id": "benchmark_data_smithi006_114134_object3987", "target_object_locator": "@5", "paused": 0, "used_replica": 0, "precalc_pgid": 0, "last_sent": "890.575555s", "age": 0.0049999529999999997, "attempts": 1, "snapid": "head", "snap_context": "0=[]", "mtime": "2023-08-01T19:54:25.210675+0000", "osd_ops": [ "set-alloc-hint object_size 65536 write_size 65536", "write 0~65536 in=65536b" ] }, { "tid": 3990, "pg": "5.dc1acda0", "osd": 2, "object_id": "benchmark_data_smithi006_114134_object3989", "object_locator": "@5", "target_object_id": "benchmark_data_smithi006_114134_object3989", "target_object_locator": "@5", "paused": 0, "used_replica": 0, "precalc_pgid": 0, "last_sent": "890.576555s", "age": 0.0039999620000000001, "attempts": 1, "snapid": "head", "snap_context": "0=[]", "mtime": "2023-08-01T19:54:25.211293+0000", "osd_ops": [ "set-alloc-hint object_size 65536 write_size 65536", "write 0~65536 in=65536b" ] }, { "tid": 3991, "pg": "5.e533c960", "osd": 2, "object_id": "benchmark_data_smithi006_114134_object3990", "object_locator": "@5", "target_object_id": "benchmark_data_smithi006_114134_object3990", "target_object_locator": "@5", "paused": 0, "used_replica": 0, "precalc_pgid": 0, "last_sent": "890.576555s", "age": 0.0039999620000000001, "attempts": 1, "snapid": "head", "snap_context": "0=[]", "mtime": "2023-08-01T19:54:25.211358+0000", "osd_ops": [ "set-alloc-hint object_size 65536 write_size 65536", "write 0~65536 in=65536b" ] }, { "tid": 3992, "pg": "5.63f244db", "osd": 2, "object_id": "benchmark_data_smithi006_114134_object3991", "object_locator": "@5", "target_object_id": "benchmark_data_smithi006_114134_object3991", "target_object_locator": "@5", "paused": 0, "used_replica": 0, "precalc_pgid": 0, "last_sent": "890.576555s", "age": 0.0039999620000000001, "attempts": 1, "snapid": "head", "snap_context": "0=[]", "mtime": "2023-08-01T19:54:25.211814+0000", "osd_ops": [ "set-alloc-hint object_size 65536 write_size 65536", "write 0~65536 in=65536b" ] } ], "linger_ops": [], "pool_ops": [], "pool_stat_ops": [], "statfs_ops": [], "command_ops": [] } 2023-08-01T19:54:25.316 DEBUG:teuthology.orchestra.run.smithi006:> /home/ubuntu/cephtest/admin_socket_client.0/objecter_requests 2023-08-01T19:54:25.317 INFO:tasks.radosbench.radosbench.0.smithi006.stdout: 1 16 4464 4448 277.987 278 0.00307216 0.00358437 2023-08-01T19:54:25.318 DEBUG:teuthology.orchestra.run.smithi155:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 30 ceph --cluster ceph --admin-daemon /var/run/ceph/ceph-osd.2.asok dump_blocked_ops 2023-08-01T19:54:25.319 INFO:tasks.ceph.osd.0.smithi008.stderr:2023-08-01T19:54:25.316+0000 7f16a58f4700 -1 received signal: Hangup from /usr/bin/python3 /bin/daemon-helper kill ceph-osd -f --cluster ceph -i 0 (PID: 111179) UID: 0 2023-08-01T19:54:25.403 DEBUG:teuthology.orchestra.run.smithi006:> rm -rf -- /home/ubuntu/cephtest/admin_socket_client.0 2023-08-01T19:54:25.418 INFO:tasks.ceph.osd.2.smithi155.stderr:2023-08-01T19:54:25.417+0000 7faa5c6ac700 -1 received signal: Hangup from /usr/bin/python3 /bin/daemon-helper kill ceph-osd -f --cluster ceph -i 2 (PID: 111337) UID: 0 2023-08-01T19:54:25.421 DEBUG:teuthology.parallel:result is None 2023-08-01T19:54:25.422 DEBUG:teuthology.run_tasks:Unwinding manager radosbench 2023-08-01T19:54:25.431 INFO:tasks.radosbench:joining radosbench (timing out after 2100s) 2023-08-01T19:54:25.431 INFO:teuthology.orchestra.run:waiting for 2100 2023-08-01T19:54:25.518 INFO:teuthology.orchestra.run.smithi006.stdout:osd.0: {} 2023-08-01T19:54:25.519 INFO:tasks.ceph.osd.0.smithi008.stderr:2023-08-01T19:54:25.518+0000 7f16a58f4700 -1 received signal: Hangup from /usr/bin/python3 /bin/daemon-helper kill ceph-osd -f --cluster ceph -i 0 (PID: 111179) UID: 0 2023-08-01T19:54:25.533 INFO:teuthology.orchestra.run.smithi155.stdout:{ 2023-08-01T19:54:25.534 INFO:teuthology.orchestra.run.smithi155.stdout: "ops": [], 2023-08-01T19:54:25.534 INFO:teuthology.orchestra.run.smithi155.stdout: "complaint_time": 30, 2023-08-01T19:54:25.534 INFO:teuthology.orchestra.run.smithi155.stdout: "num_blocked_ops": 0 2023-08-01T19:54:25.534 INFO:teuthology.orchestra.run.smithi155.stdout:} 2023-08-01T19:54:25.538 INFO:teuthology.orchestra.run.smithi006.stdout:osd.1: {} 2023-08-01T19:54:25.547 DEBUG:teuthology.orchestra.run.smithi155:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 30 ceph --cluster ceph --admin-daemon /var/run/ceph/ceph-osd.2.asok dump_historic_ops 2023-08-01T19:54:25.557 INFO:teuthology.orchestra.run.smithi006.stdout:osd.2: {} 2023-08-01T19:54:25.559 INFO:teuthology.orchestra.run.smithi006.stderr:osd.0: osd_enable_op_tracker = 'false' 2023-08-01T19:54:25.559 INFO:teuthology.orchestra.run.smithi006.stderr:osd.1: osd_enable_op_tracker = 'false' 2023-08-01T19:54:25.559 INFO:teuthology.orchestra.run.smithi006.stderr:osd.2: osd_enable_op_tracker = 'false' 2023-08-01T19:54:25.629 INFO:tasks.ceph.osd.2.smithi155.stderr:2023-08-01T19:54:25.628+0000 7faa5c6ac700 -1 received signal: Hangup from /usr/bin/python3 /bin/daemon-helper kill ceph-osd -f --cluster ceph -i 2 (PID: 111337) UID: 0 2023-08-01T19:54:25.722 INFO:tasks.ceph.osd.2.smithi155.stderr:2023-08-01T19:54:25.720+0000 7faa5c6ac700 -1 received signal: Hangup from /usr/bin/python3 /bin/daemon-helper kill ceph-osd -f --cluster ceph -i 2 (PID: 111337) UID: 0 2023-08-01T19:54:25.758 INFO:teuthology.orchestra.run.smithi155.stdout:ERROR: (22) Invalid argument 2023-08-01T19:54:25.758 INFO:teuthology.orchestra.run.smithi155.stdout:op_tracker tracking is not enabled now, so no ops are tracked currently, even those get stuck. Please enable "osd_enable_op_tracker", and the tracker will start to track new ops received afterwards. 2023-08-01T19:54:25.771 DEBUG:teuthology.orchestra.run.smithi008:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 30 ceph --cluster ceph --admin-daemon /var/run/ceph/ceph-osd.0.asok dump_ops_in_flight 2023-08-01T19:54:25.823 INFO:tasks.ceph.osd.0.smithi008.stderr:2023-08-01T19:54:25.821+0000 7f16a58f4700 -1 received signal: Hangup from /usr/bin/python3 /bin/daemon-helper kill ceph-osd -f --cluster ceph -i 0 (PID: 111179) UID: 0 2023-08-01T19:54:25.923 INFO:tasks.ceph.osd.1.smithi101.stderr:2023-08-01T19:54:25.922+0000 7fb0cb7f6700 -1 received signal: Hangup from /usr/bin/python3 /bin/daemon-helper kill ceph-osd -f --cluster ceph -i 1 (PID: 111141) UID: 0 2023-08-01T19:54:25.932 INFO:tasks.thrashosds.thrasher:in_osds: [0, 1, 2] out_osds: [] dead_osds: [] live_osds: [0, 1, 2] 2023-08-01T19:54:25.932 INFO:tasks.thrashosds.thrasher:choose_action: min_in 4 min_out 0 min_live 2 min_dead 0 chance_down 1.00 2023-08-01T19:54:25.932 INFO:tasks.thrashosds.thrasher:thrash_pg_upmap_items 2023-08-01T19:54:25.932 DEBUG:teuthology.orchestra.run.smithi006:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 120 ceph --cluster ceph osd dump -f json-pretty 2023-08-01T19:54:25.964 INFO:teuthology.orchestra.run.smithi008.stdout:ERROR: (22) Invalid argument 2023-08-01T19:54:25.965 INFO:teuthology.orchestra.run.smithi008.stdout:op_tracker tracking is not enabled now, so no ops are tracked currently, even those get stuck. Please enable "osd_enable_op_tracker", and the tracker will start to track new ops received afterwards. 2023-08-01T19:54:25.977 DEBUG:teuthology.orchestra.run.smithi008:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 30 ceph --cluster ceph --admin-daemon /var/run/ceph/ceph-osd.0.asok dump_blocked_ops 2023-08-01T19:54:26.060 INFO:tasks.ceph.osd.0.smithi008.stderr:2023-08-01T19:54:26.058+0000 7f16a58f4700 -1 received signal: Hangup from /usr/bin/python3 /bin/daemon-helper kill ceph-osd -f --cluster ceph -i 0 (PID: 111179) UID: 0 2023-08-01T19:54:26.125 INFO:tasks.ceph.osd.0.smithi008.stderr:2023-08-01T19:54:26.123+0000 7f16a58f4700 -1 received signal: Hangup from /usr/bin/python3 /bin/daemon-helper kill ceph-osd -f --cluster ceph -i 0 (PID: 111179) UID: 0 2023-08-01T19:54:26.210 INFO:teuthology.orchestra.run.smithi008.stdout:ERROR: (22) Invalid argument 2023-08-01T19:54:26.211 INFO:teuthology.orchestra.run.smithi008.stdout:op_tracker tracking is not enabled now, so no ops are tracked currently, even those get stuck. Please enable "osd_enable_op_tracker", and the tracker will start to track new ops received afterwards. 2023-08-01T19:54:26.224 DEBUG:teuthology.orchestra.run.smithi008:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 30 ceph --cluster ceph --admin-daemon /var/run/ceph/ceph-osd.0.asok dump_historic_ops 2023-08-01T19:54:26.225 INFO:tasks.ceph.osd.1.smithi101.stderr:2023-08-01T19:54:26.224+0000 7fb0cb7f6700 -1 received signal: Hangup from /usr/bin/python3 /bin/daemon-helper kill ceph-osd -f --cluster ceph -i 1 (PID: 111141) UID: 0 2023-08-01T19:54:26.281 INFO:teuthology.orchestra.run.smithi006.stdout: 2023-08-01T19:54:26.281 INFO:teuthology.orchestra.run.smithi006.stdout:{ 2023-08-01T19:54:26.281 INFO:teuthology.orchestra.run.smithi006.stdout: "epoch": 22, 2023-08-01T19:54:26.281 INFO:teuthology.orchestra.run.smithi006.stdout: "fsid": "a0e420cc-4df1-42a5-8bd4-a98c309a9349", 2023-08-01T19:54:26.281 INFO:teuthology.orchestra.run.smithi006.stdout: "created": "2023-08-01T19:53:41.279588+0000", 2023-08-01T19:54:26.282 INFO:teuthology.orchestra.run.smithi006.stdout: "modified": "2023-08-01T19:54:25.130812+0000", 2023-08-01T19:54:26.282 INFO:teuthology.orchestra.run.smithi006.stdout: "last_up_change": "2023-08-01T19:53:50.735626+0000", 2023-08-01T19:54:26.282 INFO:teuthology.orchestra.run.smithi006.stdout: "last_in_change": "2023-08-01T19:53:42.974751+0000", 2023-08-01T19:54:26.282 INFO:teuthology.orchestra.run.smithi006.stdout: "flags": "noscrub,nodeep-scrub,sortbitwise,recovery_deletes,purged_snapdirs,pglog_hardlimit", 2023-08-01T19:54:26.282 INFO:teuthology.orchestra.run.smithi006.stdout: "flags_num": 5806080, 2023-08-01T19:54:26.282 INFO:teuthology.orchestra.run.smithi006.stdout: "flags_set": [ 2023-08-01T19:54:26.282 INFO:teuthology.orchestra.run.smithi006.stdout: "nodeep-scrub", 2023-08-01T19:54:26.282 INFO:teuthology.orchestra.run.smithi006.stdout: "noscrub", 2023-08-01T19:54:26.283 INFO:teuthology.orchestra.run.smithi006.stdout: "pglog_hardlimit", 2023-08-01T19:54:26.283 INFO:teuthology.orchestra.run.smithi006.stdout: "purged_snapdirs", 2023-08-01T19:54:26.283 INFO:teuthology.orchestra.run.smithi006.stdout: "recovery_deletes", 2023-08-01T19:54:26.283 INFO:teuthology.orchestra.run.smithi006.stdout: "sortbitwise" 2023-08-01T19:54:26.283 INFO:teuthology.orchestra.run.smithi006.stdout: ], 2023-08-01T19:54:26.283 INFO:teuthology.orchestra.run.smithi006.stdout: "crush_version": 5, 2023-08-01T19:54:26.283 INFO:teuthology.orchestra.run.smithi006.stdout: "full_ratio": 0.94999998807907104, 2023-08-01T19:54:26.283 INFO:teuthology.orchestra.run.smithi006.stdout: "backfillfull_ratio": 0.89999997615814209, 2023-08-01T19:54:26.284 INFO:teuthology.orchestra.run.smithi006.stdout: "nearfull_ratio": 0.85000002384185791, 2023-08-01T19:54:26.284 INFO:teuthology.orchestra.run.smithi006.stdout: "cluster_snapshot": "", 2023-08-01T19:54:26.284 INFO:teuthology.orchestra.run.smithi006.stdout: "pool_max": 5, 2023-08-01T19:54:26.284 INFO:teuthology.orchestra.run.smithi006.stdout: "max_osd": 3, 2023-08-01T19:54:26.284 INFO:teuthology.orchestra.run.smithi006.stdout: "require_min_compat_client": "luminous", 2023-08-01T19:54:26.284 INFO:teuthology.orchestra.run.smithi006.stdout: "min_compat_client": "jewel", 2023-08-01T19:54:26.284 INFO:teuthology.orchestra.run.smithi006.stdout: "require_osd_release": "quincy", 2023-08-01T19:54:26.285 INFO:teuthology.orchestra.run.smithi006.stdout: "pools": [ 2023-08-01T19:54:26.285 INFO:teuthology.orchestra.run.smithi006.stdout: { 2023-08-01T19:54:26.285 INFO:teuthology.orchestra.run.smithi006.stdout: "pool": 1, 2023-08-01T19:54:26.285 INFO:teuthology.orchestra.run.smithi006.stdout: "pool_name": ".mgr", 2023-08-01T19:54:26.285 INFO:teuthology.orchestra.run.smithi006.stdout: "create_time": "2023-08-01T19:53:49.961944+0000", 2023-08-01T19:54:26.285 INFO:teuthology.orchestra.run.smithi006.stdout: "flags": 1, 2023-08-01T19:54:26.285 INFO:teuthology.orchestra.run.smithi006.stdout: "flags_names": "hashpspool", 2023-08-01T19:54:26.285 INFO:teuthology.orchestra.run.smithi006.stdout: "type": 1, 2023-08-01T19:54:26.286 INFO:teuthology.orchestra.run.smithi006.stdout: "size": 2, 2023-08-01T19:54:26.286 INFO:teuthology.orchestra.run.smithi006.stdout: "min_size": 1, 2023-08-01T19:54:26.286 INFO:teuthology.orchestra.run.smithi006.stdout: "crush_rule": 0, 2023-08-01T19:54:26.286 INFO:teuthology.orchestra.run.smithi006.stdout: "peering_crush_bucket_count": 0, 2023-08-01T19:54:26.286 INFO:teuthology.orchestra.run.smithi006.stdout: "peering_crush_bucket_target": 0, 2023-08-01T19:54:26.286 INFO:teuthology.orchestra.run.smithi006.stdout: "peering_crush_bucket_barrier": 0, 2023-08-01T19:54:26.286 INFO:teuthology.orchestra.run.smithi006.stdout: "peering_crush_bucket_mandatory_member": 2147483647, 2023-08-01T19:54:26.286 INFO:teuthology.orchestra.run.smithi006.stdout: "object_hash": 2, 2023-08-01T19:54:26.287 INFO:teuthology.orchestra.run.smithi006.stdout: "pg_autoscale_mode": "off", 2023-08-01T19:54:26.287 INFO:teuthology.orchestra.run.smithi006.stdout: "pg_num": 1, 2023-08-01T19:54:26.287 INFO:teuthology.orchestra.run.smithi006.stdout: "pg_placement_num": 1, 2023-08-01T19:54:26.287 INFO:teuthology.orchestra.run.smithi006.stdout: "pg_placement_num_target": 1, 2023-08-01T19:54:26.287 INFO:teuthology.orchestra.run.smithi006.stdout: "pg_num_target": 1, 2023-08-01T19:54:26.287 INFO:teuthology.orchestra.run.smithi006.stdout: "pg_num_pending": 1, 2023-08-01T19:54:26.287 INFO:teuthology.orchestra.run.smithi006.stdout: "last_pg_merge_meta": { 2023-08-01T19:54:26.288 INFO:teuthology.orchestra.run.smithi006.stdout: "source_pgid": "0.0", 2023-08-01T19:54:26.288 INFO:teuthology.orchestra.run.smithi006.stdout: "ready_epoch": 0, 2023-08-01T19:54:26.288 INFO:teuthology.orchestra.run.smithi006.stdout: "last_epoch_started": 0, 2023-08-01T19:54:26.288 INFO:teuthology.orchestra.run.smithi006.stdout: "last_epoch_clean": 0, 2023-08-01T19:54:26.288 INFO:teuthology.orchestra.run.smithi006.stdout: "source_version": "0'0", 2023-08-01T19:54:26.288 INFO:teuthology.orchestra.run.smithi006.stdout: "target_version": "0'0" 2023-08-01T19:54:26.288 INFO:teuthology.orchestra.run.smithi006.stdout: }, 2023-08-01T19:54:26.288 INFO:teuthology.orchestra.run.smithi006.stdout: "last_change": "11", 2023-08-01T19:54:26.289 INFO:teuthology.orchestra.run.smithi006.stdout: "last_force_op_resend": "0", 2023-08-01T19:54:26.289 INFO:teuthology.orchestra.run.smithi006.stdout: "last_force_op_resend_prenautilus": "0", 2023-08-01T19:54:26.289 INFO:teuthology.orchestra.run.smithi006.stdout: "last_force_op_resend_preluminous": "0", 2023-08-01T19:54:26.289 INFO:teuthology.orchestra.run.smithi006.stdout: "auid": 0, 2023-08-01T19:54:26.289 INFO:teuthology.orchestra.run.smithi006.stdout: "snap_mode": "selfmanaged", 2023-08-01T19:54:26.289 INFO:teuthology.orchestra.run.smithi006.stdout: "snap_seq": 0, 2023-08-01T19:54:26.289 INFO:teuthology.orchestra.run.smithi006.stdout: "snap_epoch": 0, 2023-08-01T19:54:26.290 INFO:teuthology.orchestra.run.smithi006.stdout: "pool_snaps": [], 2023-08-01T19:54:26.290 INFO:teuthology.orchestra.run.smithi006.stdout: "removed_snaps": "[]", 2023-08-01T19:54:26.290 INFO:teuthology.orchestra.run.smithi006.stdout: "quota_max_bytes": 0, 2023-08-01T19:54:26.290 INFO:teuthology.orchestra.run.smithi006.stdout: "quota_max_objects": 0, 2023-08-01T19:54:26.290 INFO:teuthology.orchestra.run.smithi006.stdout: "tiers": [], 2023-08-01T19:54:26.290 INFO:teuthology.orchestra.run.smithi006.stdout: "tier_of": -1, 2023-08-01T19:54:26.290 INFO:teuthology.orchestra.run.smithi006.stdout: "read_tier": -1, 2023-08-01T19:54:26.290 INFO:teuthology.orchestra.run.smithi006.stdout: "write_tier": -1, 2023-08-01T19:54:26.291 INFO:teuthology.orchestra.run.smithi006.stdout: "cache_mode": "none", 2023-08-01T19:54:26.291 INFO:teuthology.orchestra.run.smithi006.stdout: "target_max_bytes": 0, 2023-08-01T19:54:26.291 INFO:teuthology.orchestra.run.smithi006.stdout: "target_max_objects": 0, 2023-08-01T19:54:26.291 INFO:teuthology.orchestra.run.smithi006.stdout: "cache_target_dirty_ratio_micro": 400000, 2023-08-01T19:54:26.291 INFO:teuthology.orchestra.run.smithi006.stdout: "cache_target_dirty_high_ratio_micro": 600000, 2023-08-01T19:54:26.291 INFO:teuthology.orchestra.run.smithi006.stdout: "cache_target_full_ratio_micro": 800000, 2023-08-01T19:54:26.291 INFO:teuthology.orchestra.run.smithi006.stdout: "cache_min_flush_age": 0, 2023-08-01T19:54:26.291 INFO:teuthology.orchestra.run.smithi006.stdout: "cache_min_evict_age": 0, 2023-08-01T19:54:26.292 INFO:teuthology.orchestra.run.smithi006.stdout: "erasure_code_profile": "", 2023-08-01T19:54:26.292 INFO:teuthology.orchestra.run.smithi006.stdout: "hit_set_params": { 2023-08-01T19:54:26.292 INFO:teuthology.orchestra.run.smithi006.stdout: "type": "none" 2023-08-01T19:54:26.292 INFO:teuthology.orchestra.run.smithi006.stdout: }, 2023-08-01T19:54:26.292 INFO:teuthology.orchestra.run.smithi006.stdout: "hit_set_period": 0, 2023-08-01T19:54:26.292 INFO:teuthology.orchestra.run.smithi006.stdout: "hit_set_count": 0, 2023-08-01T19:54:26.292 INFO:teuthology.orchestra.run.smithi006.stdout: "use_gmt_hitset": true, 2023-08-01T19:54:26.292 INFO:teuthology.orchestra.run.smithi006.stdout: "min_read_recency_for_promote": 0, 2023-08-01T19:54:26.293 INFO:teuthology.orchestra.run.smithi006.stdout: "min_write_recency_for_promote": 0, 2023-08-01T19:54:26.293 INFO:teuthology.orchestra.run.smithi006.stdout: "hit_set_grade_decay_rate": 0, 2023-08-01T19:54:26.293 INFO:teuthology.orchestra.run.smithi006.stdout: "hit_set_search_last_n": 0, 2023-08-01T19:54:26.293 INFO:teuthology.orchestra.run.smithi006.stdout: "grade_table": [], 2023-08-01T19:54:26.293 INFO:teuthology.orchestra.run.smithi006.stdout: "stripe_width": 0, 2023-08-01T19:54:26.293 INFO:teuthology.orchestra.run.smithi006.stdout: "expected_num_objects": 0, 2023-08-01T19:54:26.293 INFO:teuthology.orchestra.run.smithi006.stdout: "fast_read": false, 2023-08-01T19:54:26.293 INFO:teuthology.orchestra.run.smithi006.stdout: "options": { 2023-08-01T19:54:26.294 INFO:teuthology.orchestra.run.smithi006.stdout: "pg_num_max": 32, 2023-08-01T19:54:26.294 INFO:teuthology.orchestra.run.smithi006.stdout: "pg_num_min": 1 2023-08-01T19:54:26.294 INFO:teuthology.orchestra.run.smithi006.stdout: }, 2023-08-01T19:54:26.294 INFO:teuthology.orchestra.run.smithi006.stdout: "application_metadata": { 2023-08-01T19:54:26.294 INFO:teuthology.orchestra.run.smithi006.stdout: "mgr": {} 2023-08-01T19:54:26.294 INFO:teuthology.orchestra.run.smithi006.stdout: } 2023-08-01T19:54:26.294 INFO:teuthology.orchestra.run.smithi006.stdout: }, 2023-08-01T19:54:26.295 INFO:teuthology.orchestra.run.smithi006.stdout: { 2023-08-01T19:54:26.295 INFO:teuthology.orchestra.run.smithi006.stdout: "pool": 2, 2023-08-01T19:54:26.295 INFO:teuthology.orchestra.run.smithi006.stdout: "pool_name": "rbd", 2023-08-01T19:54:26.295 INFO:teuthology.orchestra.run.smithi006.stdout: "create_time": "2023-08-01T19:53:57.404091+0000", 2023-08-01T19:54:26.295 INFO:teuthology.orchestra.run.smithi006.stdout: "flags": 1, 2023-08-01T19:54:26.295 INFO:teuthology.orchestra.run.smithi006.stdout: "flags_names": "hashpspool", 2023-08-01T19:54:26.295 INFO:teuthology.orchestra.run.smithi006.stdout: "type": 1, 2023-08-01T19:54:26.295 INFO:teuthology.orchestra.run.smithi006.stdout: "size": 2, 2023-08-01T19:54:26.296 INFO:teuthology.orchestra.run.smithi006.stdout: "min_size": 1, 2023-08-01T19:54:26.296 INFO:teuthology.orchestra.run.smithi006.stdout: "crush_rule": 0, 2023-08-01T19:54:26.296 INFO:teuthology.orchestra.run.smithi006.stdout: "peering_crush_bucket_count": 0, 2023-08-01T19:54:26.296 INFO:teuthology.orchestra.run.smithi006.stdout: "peering_crush_bucket_target": 0, 2023-08-01T19:54:26.296 INFO:teuthology.orchestra.run.smithi006.stdout: "peering_crush_bucket_barrier": 0, 2023-08-01T19:54:26.296 INFO:teuthology.orchestra.run.smithi006.stdout: "peering_crush_bucket_mandatory_member": 2147483647, 2023-08-01T19:54:26.296 INFO:teuthology.orchestra.run.smithi006.stdout: "object_hash": 2, 2023-08-01T19:54:26.297 INFO:teuthology.orchestra.run.smithi006.stdout: "pg_autoscale_mode": "off", 2023-08-01T19:54:26.297 INFO:teuthology.orchestra.run.smithi006.stdout: "pg_num": 8, 2023-08-01T19:54:26.297 INFO:teuthology.orchestra.run.smithi006.stdout: "pg_placement_num": 8, 2023-08-01T19:54:26.297 INFO:teuthology.orchestra.run.smithi006.stdout: "pg_placement_num_target": 8, 2023-08-01T19:54:26.297 INFO:teuthology.orchestra.run.smithi006.stdout: "pg_num_target": 8, 2023-08-01T19:54:26.297 INFO:teuthology.orchestra.run.smithi006.stdout: "pg_num_pending": 8, 2023-08-01T19:54:26.297 INFO:teuthology.orchestra.run.smithi006.stdout: "last_pg_merge_meta": { 2023-08-01T19:54:26.297 INFO:teuthology.orchestra.run.smithi006.stdout: "source_pgid": "0.0", 2023-08-01T19:54:26.298 INFO:teuthology.orchestra.run.smithi006.stdout: "ready_epoch": 0, 2023-08-01T19:54:26.298 INFO:teuthology.orchestra.run.smithi006.stdout: "last_epoch_started": 0, 2023-08-01T19:54:26.298 INFO:teuthology.orchestra.run.smithi006.stdout: "last_epoch_clean": 0, 2023-08-01T19:54:26.298 INFO:teuthology.orchestra.run.smithi006.stdout: "source_version": "0'0", 2023-08-01T19:54:26.298 INFO:teuthology.orchestra.run.smithi006.stdout: "target_version": "0'0" 2023-08-01T19:54:26.298 INFO:teuthology.orchestra.run.smithi006.stdout: }, 2023-08-01T19:54:26.298 INFO:teuthology.orchestra.run.smithi006.stdout: "last_change": "14", 2023-08-01T19:54:26.298 INFO:teuthology.orchestra.run.smithi006.stdout: "last_force_op_resend": "0", 2023-08-01T19:54:26.299 INFO:teuthology.orchestra.run.smithi006.stdout: "last_force_op_resend_prenautilus": "0", 2023-08-01T19:54:26.299 INFO:teuthology.orchestra.run.smithi006.stdout: "last_force_op_resend_preluminous": "0", 2023-08-01T19:54:26.299 INFO:teuthology.orchestra.run.smithi006.stdout: "auid": 0, 2023-08-01T19:54:26.299 INFO:teuthology.orchestra.run.smithi006.stdout: "snap_mode": "selfmanaged", 2023-08-01T19:54:26.299 INFO:teuthology.orchestra.run.smithi006.stdout: "snap_seq": 0, 2023-08-01T19:54:26.299 INFO:teuthology.orchestra.run.smithi006.stdout: "snap_epoch": 0, 2023-08-01T19:54:26.299 INFO:teuthology.orchestra.run.smithi006.stdout: "pool_snaps": [], 2023-08-01T19:54:26.300 INFO:teuthology.orchestra.run.smithi006.stdout: "removed_snaps": "[]", 2023-08-01T19:54:26.300 INFO:teuthology.orchestra.run.smithi006.stdout: "quota_max_bytes": 0, 2023-08-01T19:54:26.300 INFO:teuthology.orchestra.run.smithi006.stdout: "quota_max_objects": 0, 2023-08-01T19:54:26.300 INFO:teuthology.orchestra.run.smithi006.stdout: "tiers": [], 2023-08-01T19:54:26.300 INFO:teuthology.orchestra.run.smithi006.stdout: "tier_of": -1, 2023-08-01T19:54:26.300 INFO:teuthology.orchestra.run.smithi006.stdout: "read_tier": -1, 2023-08-01T19:54:26.300 INFO:teuthology.orchestra.run.smithi006.stdout: "write_tier": -1, 2023-08-01T19:54:26.300 INFO:teuthology.orchestra.run.smithi006.stdout: "cache_mode": "none", 2023-08-01T19:54:26.301 INFO:teuthology.orchestra.run.smithi006.stdout: "target_max_bytes": 0, 2023-08-01T19:54:26.301 INFO:teuthology.orchestra.run.smithi006.stdout: "target_max_objects": 0, 2023-08-01T19:54:26.301 INFO:teuthology.orchestra.run.smithi006.stdout: "cache_target_dirty_ratio_micro": 400000, 2023-08-01T19:54:26.301 INFO:teuthology.orchestra.run.smithi006.stdout: "cache_target_dirty_high_ratio_micro": 600000, 2023-08-01T19:54:26.301 INFO:teuthology.orchestra.run.smithi006.stdout: "cache_target_full_ratio_micro": 800000, 2023-08-01T19:54:26.301 INFO:teuthology.orchestra.run.smithi006.stdout: "cache_min_flush_age": 0, 2023-08-01T19:54:26.301 INFO:teuthology.orchestra.run.smithi006.stdout: "cache_min_evict_age": 0, 2023-08-01T19:54:26.301 INFO:teuthology.orchestra.run.smithi006.stdout: "erasure_code_profile": "", 2023-08-01T19:54:26.302 INFO:teuthology.orchestra.run.smithi006.stdout: "hit_set_params": { 2023-08-01T19:54:26.302 INFO:teuthology.orchestra.run.smithi006.stdout: "type": "none" 2023-08-01T19:54:26.302 INFO:teuthology.orchestra.run.smithi006.stdout: }, 2023-08-01T19:54:26.302 INFO:teuthology.orchestra.run.smithi006.stdout: "hit_set_period": 0, 2023-08-01T19:54:26.302 INFO:teuthology.orchestra.run.smithi006.stdout: "hit_set_count": 0, 2023-08-01T19:54:26.302 INFO:teuthology.orchestra.run.smithi006.stdout: "use_gmt_hitset": true, 2023-08-01T19:54:26.302 INFO:teuthology.orchestra.run.smithi006.stdout: "min_read_recency_for_promote": 0, 2023-08-01T19:54:26.303 INFO:teuthology.orchestra.run.smithi006.stdout: "min_write_recency_for_promote": 0, 2023-08-01T19:54:26.303 INFO:teuthology.orchestra.run.smithi006.stdout: "hit_set_grade_decay_rate": 0, 2023-08-01T19:54:26.303 INFO:teuthology.orchestra.run.smithi006.stdout: "hit_set_search_last_n": 0, 2023-08-01T19:54:26.303 INFO:teuthology.orchestra.run.smithi006.stdout: "grade_table": [], 2023-08-01T19:54:26.303 INFO:teuthology.orchestra.run.smithi006.stdout: "stripe_width": 0, 2023-08-01T19:54:26.303 INFO:teuthology.orchestra.run.smithi006.stdout: "expected_num_objects": 0, 2023-08-01T19:54:26.303 INFO:teuthology.orchestra.run.smithi006.stdout: "fast_read": false, 2023-08-01T19:54:26.303 INFO:teuthology.orchestra.run.smithi006.stdout: "options": {}, 2023-08-01T19:54:26.304 INFO:teuthology.orchestra.run.smithi006.stdout: "application_metadata": { 2023-08-01T19:54:26.304 INFO:teuthology.orchestra.run.smithi006.stdout: "rbd": {} 2023-08-01T19:54:26.304 INFO:teuthology.orchestra.run.smithi006.stdout: } 2023-08-01T19:54:26.304 INFO:teuthology.orchestra.run.smithi006.stdout: }, 2023-08-01T19:54:26.304 INFO:teuthology.orchestra.run.smithi006.stdout: { 2023-08-01T19:54:26.304 INFO:teuthology.orchestra.run.smithi006.stdout: "pool": 3, 2023-08-01T19:54:26.304 INFO:teuthology.orchestra.run.smithi006.stdout: "pool_name": "cephfs_metadata", 2023-08-01T19:54:26.304 INFO:teuthology.orchestra.run.smithi006.stdout: "create_time": "2023-08-01T19:54:02.111247+0000", 2023-08-01T19:54:26.305 INFO:teuthology.orchestra.run.smithi006.stdout: "flags": 1, 2023-08-01T19:54:26.305 INFO:teuthology.orchestra.run.smithi006.stdout: "flags_names": "hashpspool", 2023-08-01T19:54:26.305 INFO:teuthology.orchestra.run.smithi006.stdout: "type": 1, 2023-08-01T19:54:26.305 INFO:teuthology.orchestra.run.smithi006.stdout: "size": 2, 2023-08-01T19:54:26.305 INFO:teuthology.orchestra.run.smithi006.stdout: "min_size": 1, 2023-08-01T19:54:26.305 INFO:teuthology.orchestra.run.smithi006.stdout: "crush_rule": 0, 2023-08-01T19:54:26.305 INFO:teuthology.orchestra.run.smithi006.stdout: "peering_crush_bucket_count": 0, 2023-08-01T19:54:26.305 INFO:teuthology.orchestra.run.smithi006.stdout: "peering_crush_bucket_target": 0, 2023-08-01T19:54:26.306 INFO:teuthology.orchestra.run.smithi006.stdout: "peering_crush_bucket_barrier": 0, 2023-08-01T19:54:26.306 INFO:teuthology.orchestra.run.smithi006.stdout: "peering_crush_bucket_mandatory_member": 2147483647, 2023-08-01T19:54:26.306 INFO:teuthology.orchestra.run.smithi006.stdout: "object_hash": 2, 2023-08-01T19:54:26.306 INFO:teuthology.orchestra.run.smithi006.stdout: "pg_autoscale_mode": "off", 2023-08-01T19:54:26.306 INFO:teuthology.orchestra.run.smithi006.stdout: "pg_num": 32, 2023-08-01T19:54:26.306 INFO:teuthology.orchestra.run.smithi006.stdout: "pg_placement_num": 32, 2023-08-01T19:54:26.306 INFO:teuthology.orchestra.run.smithi006.stdout: "pg_placement_num_target": 32, 2023-08-01T19:54:26.306 INFO:teuthology.orchestra.run.smithi006.stdout: "pg_num_target": 32, 2023-08-01T19:54:26.307 INFO:teuthology.orchestra.run.smithi006.stdout: "pg_num_pending": 32, 2023-08-01T19:54:26.307 INFO:teuthology.orchestra.run.smithi006.stdout: "last_pg_merge_meta": { 2023-08-01T19:54:26.307 INFO:teuthology.orchestra.run.smithi006.stdout: "source_pgid": "0.0", 2023-08-01T19:54:26.307 INFO:teuthology.orchestra.run.smithi006.stdout: "ready_epoch": 0, 2023-08-01T19:54:26.307 INFO:teuthology.orchestra.run.smithi006.stdout: "last_epoch_started": 0, 2023-08-01T19:54:26.307 INFO:teuthology.orchestra.run.smithi006.stdout: "last_epoch_clean": 0, 2023-08-01T19:54:26.307 INFO:teuthology.orchestra.run.smithi006.stdout: "source_version": "0'0", 2023-08-01T19:54:26.308 INFO:teuthology.orchestra.run.smithi006.stdout: "target_version": "0'0" 2023-08-01T19:54:26.308 INFO:teuthology.orchestra.run.smithi006.stdout: }, 2023-08-01T19:54:26.308 INFO:teuthology.orchestra.run.smithi006.stdout: "last_change": "17", 2023-08-01T19:54:26.308 INFO:teuthology.orchestra.run.smithi006.stdout: "last_force_op_resend": "0", 2023-08-01T19:54:26.308 INFO:teuthology.orchestra.run.smithi006.stdout: "last_force_op_resend_prenautilus": "0", 2023-08-01T19:54:26.308 INFO:teuthology.orchestra.run.smithi006.stdout: "last_force_op_resend_preluminous": "0", 2023-08-01T19:54:26.308 INFO:teuthology.orchestra.run.smithi006.stdout: "auid": 0, 2023-08-01T19:54:26.308 INFO:teuthology.orchestra.run.smithi006.stdout: "snap_mode": "selfmanaged", 2023-08-01T19:54:26.309 INFO:teuthology.orchestra.run.smithi006.stdout: "snap_seq": 0, 2023-08-01T19:54:26.309 INFO:teuthology.orchestra.run.smithi006.stdout: "snap_epoch": 0, 2023-08-01T19:54:26.309 INFO:teuthology.orchestra.run.smithi006.stdout: "pool_snaps": [], 2023-08-01T19:54:26.309 INFO:teuthology.orchestra.run.smithi006.stdout: "removed_snaps": "[]", 2023-08-01T19:54:26.309 INFO:teuthology.orchestra.run.smithi006.stdout: "quota_max_bytes": 0, 2023-08-01T19:54:26.309 INFO:teuthology.orchestra.run.smithi006.stdout: "quota_max_objects": 0, 2023-08-01T19:54:26.309 INFO:teuthology.orchestra.run.smithi006.stdout: "tiers": [], 2023-08-01T19:54:26.309 INFO:teuthology.orchestra.run.smithi006.stdout: "tier_of": -1, 2023-08-01T19:54:26.310 INFO:teuthology.orchestra.run.smithi006.stdout: "read_tier": -1, 2023-08-01T19:54:26.310 INFO:teuthology.orchestra.run.smithi006.stdout: "write_tier": -1, 2023-08-01T19:54:26.310 INFO:teuthology.orchestra.run.smithi006.stdout: "cache_mode": "none", 2023-08-01T19:54:26.310 INFO:teuthology.orchestra.run.smithi006.stdout: "target_max_bytes": 0, 2023-08-01T19:54:26.310 INFO:teuthology.orchestra.run.smithi006.stdout: "target_max_objects": 0, 2023-08-01T19:54:26.310 INFO:teuthology.orchestra.run.smithi006.stdout: "cache_target_dirty_ratio_micro": 400000, 2023-08-01T19:54:26.310 INFO:teuthology.orchestra.run.smithi006.stdout: "cache_target_dirty_high_ratio_micro": 600000, 2023-08-01T19:54:26.310 INFO:teuthology.orchestra.run.smithi006.stdout: "cache_target_full_ratio_micro": 800000, 2023-08-01T19:54:26.311 INFO:teuthology.orchestra.run.smithi006.stdout: "cache_min_flush_age": 0, 2023-08-01T19:54:26.311 INFO:teuthology.orchestra.run.smithi006.stdout: "cache_min_evict_age": 0, 2023-08-01T19:54:26.311 INFO:teuthology.orchestra.run.smithi006.stdout: "erasure_code_profile": "", 2023-08-01T19:54:26.311 INFO:teuthology.orchestra.run.smithi006.stdout: "hit_set_params": { 2023-08-01T19:54:26.311 INFO:teuthology.orchestra.run.smithi006.stdout: "type": "none" 2023-08-01T19:54:26.311 INFO:teuthology.orchestra.run.smithi006.stdout: }, 2023-08-01T19:54:26.311 INFO:teuthology.orchestra.run.smithi006.stdout: "hit_set_period": 0, 2023-08-01T19:54:26.312 INFO:teuthology.orchestra.run.smithi006.stdout: "hit_set_count": 0, 2023-08-01T19:54:26.312 INFO:teuthology.orchestra.run.smithi006.stdout: "use_gmt_hitset": true, 2023-08-01T19:54:26.312 INFO:teuthology.orchestra.run.smithi006.stdout: "min_read_recency_for_promote": 0, 2023-08-01T19:54:26.312 INFO:teuthology.orchestra.run.smithi006.stdout: "min_write_recency_for_promote": 0, 2023-08-01T19:54:26.312 INFO:teuthology.orchestra.run.smithi006.stdout: "hit_set_grade_decay_rate": 0, 2023-08-01T19:54:26.312 INFO:teuthology.orchestra.run.smithi006.stdout: "hit_set_search_last_n": 0, 2023-08-01T19:54:26.312 INFO:teuthology.orchestra.run.smithi006.stdout: "grade_table": [], 2023-08-01T19:54:26.312 INFO:teuthology.orchestra.run.smithi006.stdout: "stripe_width": 0, 2023-08-01T19:54:26.313 INFO:teuthology.orchestra.run.smithi006.stdout: "expected_num_objects": 0, 2023-08-01T19:54:26.313 INFO:teuthology.orchestra.run.smithi006.stdout: "fast_read": false, 2023-08-01T19:54:26.313 INFO:teuthology.orchestra.run.smithi006.stdout: "options": { 2023-08-01T19:54:26.313 INFO:teuthology.orchestra.run.smithi006.stdout: "pg_autoscale_bias": 4, 2023-08-01T19:54:26.313 INFO:teuthology.orchestra.run.smithi006.stdout: "pg_num_min": 16, 2023-08-01T19:54:26.313 INFO:teuthology.orchestra.run.smithi006.stdout: "recovery_priority": 5 2023-08-01T19:54:26.313 INFO:teuthology.orchestra.run.smithi006.stdout: }, 2023-08-01T19:54:26.313 INFO:teuthology.orchestra.run.smithi006.stdout: "application_metadata": { 2023-08-01T19:54:26.314 INFO:teuthology.orchestra.run.smithi006.stdout: "cephfs": { 2023-08-01T19:54:26.314 INFO:teuthology.orchestra.run.smithi006.stdout: "metadata": "cephfs" 2023-08-01T19:54:26.314 INFO:teuthology.orchestra.run.smithi006.stdout: } 2023-08-01T19:54:26.314 INFO:teuthology.orchestra.run.smithi006.stdout: } 2023-08-01T19:54:26.314 INFO:teuthology.orchestra.run.smithi006.stdout: }, 2023-08-01T19:54:26.314 INFO:teuthology.orchestra.run.smithi006.stdout: { 2023-08-01T19:54:26.314 INFO:teuthology.orchestra.run.smithi006.stdout: "pool": 4, 2023-08-01T19:54:26.314 INFO:teuthology.orchestra.run.smithi006.stdout: "pool_name": "cephfs_data", 2023-08-01T19:54:26.315 INFO:teuthology.orchestra.run.smithi006.stdout: "create_time": "2023-08-01T19:54:03.430277+0000", 2023-08-01T19:54:26.315 INFO:teuthology.orchestra.run.smithi006.stdout: "flags": 1, 2023-08-01T19:54:26.315 INFO:teuthology.orchestra.run.smithi006.stdout: "flags_names": "hashpspool", 2023-08-01T19:54:26.315 INFO:teuthology.orchestra.run.smithi006.stdout: "type": 1, 2023-08-01T19:54:26.315 INFO:teuthology.orchestra.run.smithi006.stdout: "size": 2, 2023-08-01T19:54:26.315 INFO:teuthology.orchestra.run.smithi006.stdout: "min_size": 1, 2023-08-01T19:54:26.315 INFO:teuthology.orchestra.run.smithi006.stdout: "crush_rule": 0, 2023-08-01T19:54:26.316 INFO:teuthology.orchestra.run.smithi006.stdout: "peering_crush_bucket_count": 0, 2023-08-01T19:54:26.316 INFO:teuthology.orchestra.run.smithi006.stdout: "peering_crush_bucket_target": 0, 2023-08-01T19:54:26.316 INFO:teuthology.orchestra.run.smithi006.stdout: "peering_crush_bucket_barrier": 0, 2023-08-01T19:54:26.316 INFO:teuthology.orchestra.run.smithi006.stdout: "peering_crush_bucket_mandatory_member": 2147483647, 2023-08-01T19:54:26.316 INFO:teuthology.orchestra.run.smithi006.stdout: "object_hash": 2, 2023-08-01T19:54:26.316 INFO:teuthology.orchestra.run.smithi006.stdout: "pg_autoscale_mode": "off", 2023-08-01T19:54:26.316 INFO:teuthology.orchestra.run.smithi006.stdout: "pg_num": 64, 2023-08-01T19:54:26.316 INFO:teuthology.orchestra.run.smithi006.stdout: "pg_placement_num": 64, 2023-08-01T19:54:26.317 INFO:teuthology.orchestra.run.smithi006.stdout: "pg_placement_num_target": 64, 2023-08-01T19:54:26.317 INFO:teuthology.orchestra.run.smithi006.stdout: "pg_num_target": 64, 2023-08-01T19:54:26.317 INFO:teuthology.orchestra.run.smithi006.stdout: "pg_num_pending": 64, 2023-08-01T19:54:26.317 INFO:teuthology.orchestra.run.smithi006.stdout: "last_pg_merge_meta": { 2023-08-01T19:54:26.317 INFO:teuthology.orchestra.run.smithi006.stdout: "source_pgid": "0.0", 2023-08-01T19:54:26.317 INFO:teuthology.orchestra.run.smithi006.stdout: "ready_epoch": 0, 2023-08-01T19:54:26.317 INFO:teuthology.orchestra.run.smithi006.stdout: "last_epoch_started": 0, 2023-08-01T19:54:26.317 INFO:teuthology.orchestra.run.smithi006.stdout: "last_epoch_clean": 0, 2023-08-01T19:54:26.318 INFO:teuthology.orchestra.run.smithi006.stdout: "source_version": "0'0", 2023-08-01T19:54:26.318 INFO:teuthology.orchestra.run.smithi006.stdout: "target_version": "0'0" 2023-08-01T19:54:26.318 INFO:teuthology.orchestra.run.smithi006.stdout: }, 2023-08-01T19:54:26.318 INFO:teuthology.orchestra.run.smithi006.stdout: "last_change": "18", 2023-08-01T19:54:26.318 INFO:teuthology.orchestra.run.smithi006.stdout: "last_force_op_resend": "0", 2023-08-01T19:54:26.318 INFO:teuthology.orchestra.run.smithi006.stdout: "last_force_op_resend_prenautilus": "0", 2023-08-01T19:54:26.318 INFO:teuthology.orchestra.run.smithi006.stdout: "last_force_op_resend_preluminous": "0", 2023-08-01T19:54:26.318 INFO:teuthology.orchestra.run.smithi006.stdout: "auid": 0, 2023-08-01T19:54:26.319 INFO:teuthology.orchestra.run.smithi006.stdout: "snap_mode": "selfmanaged", 2023-08-01T19:54:26.319 INFO:teuthology.orchestra.run.smithi006.stdout: "snap_seq": 0, 2023-08-01T19:54:26.319 INFO:teuthology.orchestra.run.smithi006.stdout: "snap_epoch": 0, 2023-08-01T19:54:26.319 INFO:teuthology.orchestra.run.smithi006.stdout: "pool_snaps": [], 2023-08-01T19:54:26.319 INFO:teuthology.orchestra.run.smithi006.stdout: "removed_snaps": "[]", 2023-08-01T19:54:26.319 INFO:teuthology.orchestra.run.smithi006.stdout: "quota_max_bytes": 0, 2023-08-01T19:54:26.319 INFO:teuthology.orchestra.run.smithi006.stdout: "quota_max_objects": 0, 2023-08-01T19:54:26.319 INFO:teuthology.orchestra.run.smithi006.stdout: "tiers": [], 2023-08-01T19:54:26.320 INFO:teuthology.orchestra.run.smithi006.stdout: "tier_of": -1, 2023-08-01T19:54:26.320 INFO:teuthology.orchestra.run.smithi006.stdout: "read_tier": -1, 2023-08-01T19:54:26.320 INFO:teuthology.orchestra.run.smithi006.stdout: "write_tier": -1, 2023-08-01T19:54:26.320 INFO:teuthology.orchestra.run.smithi006.stdout: "cache_mode": "none", 2023-08-01T19:54:26.320 INFO:teuthology.orchestra.run.smithi006.stdout: "target_max_bytes": 0, 2023-08-01T19:54:26.320 INFO:teuthology.orchestra.run.smithi006.stdout: "target_max_objects": 0, 2023-08-01T19:54:26.320 INFO:teuthology.orchestra.run.smithi006.stdout: "cache_target_dirty_ratio_micro": 400000, 2023-08-01T19:54:26.321 INFO:teuthology.orchestra.run.smithi006.stdout: "cache_target_dirty_high_ratio_micro": 600000, 2023-08-01T19:54:26.321 INFO:teuthology.orchestra.run.smithi006.stdout: "cache_target_full_ratio_micro": 800000, 2023-08-01T19:54:26.321 INFO:teuthology.orchestra.run.smithi006.stdout: "cache_min_flush_age": 0, 2023-08-01T19:54:26.321 INFO:teuthology.orchestra.run.smithi006.stdout: "cache_min_evict_age": 0, 2023-08-01T19:54:26.321 INFO:teuthology.orchestra.run.smithi006.stdout: "erasure_code_profile": "", 2023-08-01T19:54:26.321 INFO:teuthology.orchestra.run.smithi006.stdout: "hit_set_params": { 2023-08-01T19:54:26.321 INFO:teuthology.orchestra.run.smithi006.stdout: "type": "none" 2023-08-01T19:54:26.321 INFO:teuthology.orchestra.run.smithi006.stdout: }, 2023-08-01T19:54:26.322 INFO:teuthology.orchestra.run.smithi006.stdout: "hit_set_period": 0, 2023-08-01T19:54:26.322 INFO:teuthology.orchestra.run.smithi006.stdout: "hit_set_count": 0, 2023-08-01T19:54:26.322 INFO:teuthology.orchestra.run.smithi006.stdout: "use_gmt_hitset": true, 2023-08-01T19:54:26.322 INFO:teuthology.orchestra.run.smithi006.stdout: "min_read_recency_for_promote": 0, 2023-08-01T19:54:26.322 INFO:teuthology.orchestra.run.smithi006.stdout: "min_write_recency_for_promote": 0, 2023-08-01T19:54:26.322 INFO:teuthology.orchestra.run.smithi006.stdout: "hit_set_grade_decay_rate": 0, 2023-08-01T19:54:26.322 INFO:teuthology.orchestra.run.smithi006.stdout: "hit_set_search_last_n": 0, 2023-08-01T19:54:26.322 INFO:teuthology.orchestra.run.smithi006.stdout: "grade_table": [], 2023-08-01T19:54:26.323 INFO:teuthology.orchestra.run.smithi006.stdout: "stripe_width": 0, 2023-08-01T19:54:26.323 INFO:teuthology.orchestra.run.smithi006.stdout: "expected_num_objects": 0, 2023-08-01T19:54:26.323 INFO:teuthology.orchestra.run.smithi006.stdout: "fast_read": false, 2023-08-01T19:54:26.323 INFO:teuthology.orchestra.run.smithi006.stdout: "options": { 2023-08-01T19:54:26.323 INFO:teuthology.orchestra.run.smithi006.stdout: "pg_num_min": 64, 2023-08-01T19:54:26.323 INFO:teuthology.orchestra.run.smithi006.stdout: "target_size_ratio": 0.89999997615814209 2023-08-01T19:54:26.323 INFO:teuthology.orchestra.run.smithi006.stdout: }, 2023-08-01T19:54:26.323 INFO:teuthology.orchestra.run.smithi006.stdout: "application_metadata": { 2023-08-01T19:54:26.324 INFO:teuthology.orchestra.run.smithi006.stdout: "cephfs": { 2023-08-01T19:54:26.324 INFO:teuthology.orchestra.run.smithi006.stdout: "data": "cephfs" 2023-08-01T19:54:26.324 INFO:teuthology.orchestra.run.smithi006.stdout: } 2023-08-01T19:54:26.324 INFO:teuthology.orchestra.run.smithi006.stdout: } 2023-08-01T19:54:26.324 INFO:teuthology.orchestra.run.smithi006.stdout: }, 2023-08-01T19:54:26.324 INFO:teuthology.orchestra.run.smithi006.stdout: { 2023-08-01T19:54:26.324 INFO:teuthology.orchestra.run.smithi006.stdout: "pool": 5, 2023-08-01T19:54:26.324 INFO:teuthology.orchestra.run.smithi006.stdout: "pool_name": "unique_pool_0", 2023-08-01T19:54:26.325 INFO:teuthology.orchestra.run.smithi006.stdout: "create_time": "2023-08-01T19:54:21.165668+0000", 2023-08-01T19:54:26.325 INFO:teuthology.orchestra.run.smithi006.stdout: "flags": 1, 2023-08-01T19:54:26.325 INFO:teuthology.orchestra.run.smithi006.stdout: "flags_names": "hashpspool", 2023-08-01T19:54:26.325 INFO:teuthology.orchestra.run.smithi006.stdout: "type": 1, 2023-08-01T19:54:26.325 INFO:teuthology.orchestra.run.smithi006.stdout: "size": 2, 2023-08-01T19:54:26.325 INFO:teuthology.orchestra.run.smithi006.stdout: "min_size": 1, 2023-08-01T19:54:26.325 INFO:teuthology.orchestra.run.smithi006.stdout: "crush_rule": 0, 2023-08-01T19:54:26.325 INFO:teuthology.orchestra.run.smithi006.stdout: "peering_crush_bucket_count": 0, 2023-08-01T19:54:26.326 INFO:teuthology.orchestra.run.smithi006.stdout: "peering_crush_bucket_target": 0, 2023-08-01T19:54:26.326 INFO:teuthology.orchestra.run.smithi006.stdout: "peering_crush_bucket_barrier": 0, 2023-08-01T19:54:26.326 INFO:teuthology.orchestra.run.smithi006.stdout: "peering_crush_bucket_mandatory_member": 2147483647, 2023-08-01T19:54:26.326 INFO:teuthology.orchestra.run.smithi006.stdout: "object_hash": 2, 2023-08-01T19:54:26.326 INFO:teuthology.orchestra.run.smithi006.stdout: "pg_autoscale_mode": "off", 2023-08-01T19:54:26.326 INFO:teuthology.orchestra.run.smithi006.stdout: "pg_num": 16, 2023-08-01T19:54:26.326 INFO:teuthology.orchestra.run.smithi006.stdout: "pg_placement_num": 16, 2023-08-01T19:54:26.326 INFO:teuthology.orchestra.run.smithi006.stdout: "pg_placement_num_target": 16, 2023-08-01T19:54:26.327 INFO:teuthology.orchestra.run.smithi006.stdout: "pg_num_target": 16, 2023-08-01T19:54:26.327 INFO:teuthology.orchestra.run.smithi006.stdout: "pg_num_pending": 16, 2023-08-01T19:54:26.327 INFO:teuthology.orchestra.run.smithi006.stdout: "last_pg_merge_meta": { 2023-08-01T19:54:26.327 INFO:teuthology.orchestra.run.smithi006.stdout: "source_pgid": "0.0", 2023-08-01T19:54:26.327 INFO:teuthology.orchestra.run.smithi006.stdout: "ready_epoch": 0, 2023-08-01T19:54:26.327 INFO:teuthology.orchestra.run.smithi006.stdout: "last_epoch_started": 0, 2023-08-01T19:54:26.327 INFO:teuthology.orchestra.run.smithi006.stdout: "last_epoch_clean": 0, 2023-08-01T19:54:26.328 INFO:teuthology.orchestra.run.smithi006.stdout: "source_version": "0'0", 2023-08-01T19:54:26.328 INFO:teuthology.orchestra.run.smithi006.stdout: "target_version": "0'0" 2023-08-01T19:54:26.328 INFO:teuthology.orchestra.run.smithi006.stdout: }, 2023-08-01T19:54:26.328 INFO:teuthology.orchestra.run.smithi006.stdout: "last_change": "21", 2023-08-01T19:54:26.328 INFO:teuthology.orchestra.run.smithi006.stdout: "last_force_op_resend": "0", 2023-08-01T19:54:26.328 INFO:teuthology.orchestra.run.smithi006.stdout: "last_force_op_resend_prenautilus": "0", 2023-08-01T19:54:26.328 INFO:teuthology.orchestra.run.smithi006.stdout: "last_force_op_resend_preluminous": "0", 2023-08-01T19:54:26.328 INFO:teuthology.orchestra.run.smithi006.stdout: "auid": 0, 2023-08-01T19:54:26.329 INFO:teuthology.orchestra.run.smithi006.stdout: "snap_mode": "selfmanaged", 2023-08-01T19:54:26.329 INFO:teuthology.orchestra.run.smithi006.stdout: "snap_seq": 0, 2023-08-01T19:54:26.329 INFO:teuthology.orchestra.run.smithi006.stdout: "snap_epoch": 0, 2023-08-01T19:54:26.329 INFO:teuthology.orchestra.run.smithi006.stdout: "pool_snaps": [], 2023-08-01T19:54:26.329 INFO:teuthology.orchestra.run.smithi006.stdout: "removed_snaps": "[]", 2023-08-01T19:54:26.329 INFO:teuthology.orchestra.run.smithi006.stdout: "quota_max_bytes": 0, 2023-08-01T19:54:26.329 INFO:teuthology.orchestra.run.smithi006.stdout: "quota_max_objects": 0, 2023-08-01T19:54:26.329 INFO:teuthology.orchestra.run.smithi006.stdout: "tiers": [], 2023-08-01T19:54:26.330 INFO:teuthology.orchestra.run.smithi006.stdout: "tier_of": -1, 2023-08-01T19:54:26.330 INFO:teuthology.orchestra.run.smithi006.stdout: "read_tier": -1, 2023-08-01T19:54:26.330 INFO:teuthology.orchestra.run.smithi006.stdout: "write_tier": -1, 2023-08-01T19:54:26.330 INFO:teuthology.orchestra.run.smithi006.stdout: "cache_mode": "none", 2023-08-01T19:54:26.330 INFO:teuthology.orchestra.run.smithi006.stdout: "target_max_bytes": 0, 2023-08-01T19:54:26.330 INFO:teuthology.orchestra.run.smithi006.stdout: "target_max_objects": 0, 2023-08-01T19:54:26.330 INFO:teuthology.orchestra.run.smithi006.stdout: "cache_target_dirty_ratio_micro": 400000, 2023-08-01T19:54:26.330 INFO:teuthology.orchestra.run.smithi006.stdout: "cache_target_dirty_high_ratio_micro": 600000, 2023-08-01T19:54:26.331 INFO:teuthology.orchestra.run.smithi006.stdout: "cache_target_full_ratio_micro": 800000, 2023-08-01T19:54:26.331 INFO:teuthology.orchestra.run.smithi006.stdout: "cache_min_flush_age": 0, 2023-08-01T19:54:26.331 INFO:teuthology.orchestra.run.smithi006.stdout: "cache_min_evict_age": 0, 2023-08-01T19:54:26.331 INFO:teuthology.orchestra.run.smithi006.stdout: "erasure_code_profile": "", 2023-08-01T19:54:26.331 INFO:teuthology.orchestra.run.smithi006.stdout: "hit_set_params": { 2023-08-01T19:54:26.331 INFO:teuthology.orchestra.run.smithi006.stdout: "type": "none" 2023-08-01T19:54:26.331 INFO:teuthology.orchestra.run.smithi006.stdout: }, 2023-08-01T19:54:26.332 INFO:teuthology.orchestra.run.smithi006.stdout: "hit_set_period": 0, 2023-08-01T19:54:26.332 INFO:teuthology.orchestra.run.smithi006.stdout: "hit_set_count": 0, 2023-08-01T19:54:26.332 INFO:teuthology.orchestra.run.smithi006.stdout: "use_gmt_hitset": true, 2023-08-01T19:54:26.332 INFO:teuthology.orchestra.run.smithi006.stdout: "min_read_recency_for_promote": 0, 2023-08-01T19:54:26.332 INFO:teuthology.orchestra.run.smithi006.stdout: "min_write_recency_for_promote": 0, 2023-08-01T19:54:26.332 INFO:teuthology.orchestra.run.smithi006.stdout: "hit_set_grade_decay_rate": 0, 2023-08-01T19:54:26.332 INFO:teuthology.orchestra.run.smithi006.stdout: "hit_set_search_last_n": 0, 2023-08-01T19:54:26.332 INFO:teuthology.orchestra.run.smithi006.stdout: "grade_table": [], 2023-08-01T19:54:26.333 INFO:teuthology.orchestra.run.smithi006.stdout: "stripe_width": 0, 2023-08-01T19:54:26.333 INFO:teuthology.orchestra.run.smithi006.stdout: "expected_num_objects": 0, 2023-08-01T19:54:26.333 INFO:teuthology.orchestra.run.smithi006.stdout: "fast_read": false, 2023-08-01T19:54:26.333 INFO:teuthology.orchestra.run.smithi006.stdout: "options": {}, 2023-08-01T19:54:26.333 INFO:teuthology.orchestra.run.smithi006.stdout: "application_metadata": { 2023-08-01T19:54:26.333 INFO:teuthology.orchestra.run.smithi006.stdout: "rados": {} 2023-08-01T19:54:26.333 INFO:teuthology.orchestra.run.smithi006.stdout: } 2023-08-01T19:54:26.333 INFO:teuthology.orchestra.run.smithi006.stdout: } 2023-08-01T19:54:26.334 INFO:teuthology.orchestra.run.smithi006.stdout: ], 2023-08-01T19:54:26.334 INFO:teuthology.orchestra.run.smithi006.stdout: "osds": [ 2023-08-01T19:54:26.334 INFO:teuthology.orchestra.run.smithi006.stdout: { 2023-08-01T19:54:26.334 INFO:teuthology.orchestra.run.smithi006.stdout: "osd": 0, 2023-08-01T19:54:26.334 INFO:teuthology.orchestra.run.smithi006.stdout: "uuid": "5dd675c7-2777-48f2-8009-ff0e0d4c7086", 2023-08-01T19:54:26.334 INFO:teuthology.orchestra.run.smithi006.stdout: "up": 1, 2023-08-01T19:54:26.334 INFO:teuthology.orchestra.run.smithi006.stdout: "in": 1, 2023-08-01T19:54:26.334 INFO:teuthology.orchestra.run.smithi006.stdout: "weight": 1, 2023-08-01T19:54:26.335 INFO:teuthology.orchestra.run.smithi006.stdout: "primary_affinity": 1, 2023-08-01T19:54:26.335 INFO:teuthology.orchestra.run.smithi006.stdout: "last_clean_begin": 0, 2023-08-01T19:54:26.335 INFO:teuthology.orchestra.run.smithi006.stdout: "last_clean_end": 0, 2023-08-01T19:54:26.335 INFO:teuthology.orchestra.run.smithi006.stdout: "up_from": 8, 2023-08-01T19:54:26.335 INFO:teuthology.orchestra.run.smithi006.stdout: "up_thru": 19, 2023-08-01T19:54:26.335 INFO:teuthology.orchestra.run.smithi006.stdout: "down_at": 0, 2023-08-01T19:54:26.335 INFO:teuthology.orchestra.run.smithi006.stdout: "lost_at": 0, 2023-08-01T19:54:26.335 INFO:teuthology.orchestra.run.smithi006.stdout: "public_addrs": { 2023-08-01T19:54:26.336 INFO:teuthology.orchestra.run.smithi006.stdout: "addrvec": [ 2023-08-01T19:54:26.336 INFO:teuthology.orchestra.run.smithi006.stdout: { 2023-08-01T19:54:26.336 INFO:teuthology.orchestra.run.smithi006.stdout: "type": "v2", 2023-08-01T19:54:26.336 INFO:teuthology.orchestra.run.smithi006.stdout: "addr": "172.21.15.8:6800", 2023-08-01T19:54:26.336 INFO:teuthology.orchestra.run.smithi006.stdout: "nonce": 111181 2023-08-01T19:54:26.336 INFO:teuthology.orchestra.run.smithi006.stdout: }, 2023-08-01T19:54:26.336 INFO:teuthology.orchestra.run.smithi006.stdout: { 2023-08-01T19:54:26.337 INFO:teuthology.orchestra.run.smithi006.stdout: "type": "v1", 2023-08-01T19:54:26.337 INFO:teuthology.orchestra.run.smithi006.stdout: "addr": "172.21.15.8:6801", 2023-08-01T19:54:26.337 INFO:teuthology.orchestra.run.smithi006.stdout: "nonce": 111181 2023-08-01T19:54:26.337 INFO:teuthology.orchestra.run.smithi006.stdout: } 2023-08-01T19:54:26.337 INFO:teuthology.orchestra.run.smithi006.stdout: ] 2023-08-01T19:54:26.337 INFO:teuthology.orchestra.run.smithi006.stdout: }, 2023-08-01T19:54:26.337 INFO:teuthology.orchestra.run.smithi006.stdout: "cluster_addrs": { 2023-08-01T19:54:26.337 INFO:teuthology.orchestra.run.smithi006.stdout: "addrvec": [ 2023-08-01T19:54:26.338 INFO:teuthology.orchestra.run.smithi006.stdout: { 2023-08-01T19:54:26.338 INFO:teuthology.orchestra.run.smithi006.stdout: "type": "v2", 2023-08-01T19:54:26.338 INFO:teuthology.orchestra.run.smithi006.stdout: "addr": "172.21.15.8:6802", 2023-08-01T19:54:26.338 INFO:teuthology.orchestra.run.smithi006.stdout: "nonce": 111181 2023-08-01T19:54:26.338 INFO:teuthology.orchestra.run.smithi006.stdout: }, 2023-08-01T19:54:26.338 INFO:teuthology.orchestra.run.smithi006.stdout: { 2023-08-01T19:54:26.338 INFO:teuthology.orchestra.run.smithi006.stdout: "type": "v1", 2023-08-01T19:54:26.338 INFO:teuthology.orchestra.run.smithi006.stdout: "addr": "172.21.15.8:6803", 2023-08-01T19:54:26.339 INFO:teuthology.orchestra.run.smithi006.stdout: "nonce": 111181 2023-08-01T19:54:26.339 INFO:teuthology.orchestra.run.smithi006.stdout: } 2023-08-01T19:54:26.339 INFO:teuthology.orchestra.run.smithi006.stdout: ] 2023-08-01T19:54:26.339 INFO:teuthology.orchestra.run.smithi006.stdout: }, 2023-08-01T19:54:26.339 INFO:teuthology.orchestra.run.smithi006.stdout: "heartbeat_back_addrs": { 2023-08-01T19:54:26.339 INFO:teuthology.orchestra.run.smithi006.stdout: "addrvec": [ 2023-08-01T19:54:26.339 INFO:teuthology.orchestra.run.smithi006.stdout: { 2023-08-01T19:54:26.339 INFO:teuthology.orchestra.run.smithi006.stdout: "type": "v2", 2023-08-01T19:54:26.340 INFO:teuthology.orchestra.run.smithi006.stdout: "addr": "172.21.15.8:6806", 2023-08-01T19:54:26.340 INFO:teuthology.orchestra.run.smithi006.stdout: "nonce": 111181 2023-08-01T19:54:26.340 INFO:teuthology.orchestra.run.smithi006.stdout: }, 2023-08-01T19:54:26.340 INFO:teuthology.orchestra.run.smithi006.stdout: { 2023-08-01T19:54:26.340 INFO:teuthology.orchestra.run.smithi006.stdout: "type": "v1", 2023-08-01T19:54:26.340 INFO:teuthology.orchestra.run.smithi006.stdout: "addr": "172.21.15.8:6807", 2023-08-01T19:54:26.340 INFO:teuthology.orchestra.run.smithi006.stdout: "nonce": 111181 2023-08-01T19:54:26.340 INFO:teuthology.orchestra.run.smithi006.stdout: } 2023-08-01T19:54:26.341 INFO:teuthology.orchestra.run.smithi006.stdout: ] 2023-08-01T19:54:26.341 INFO:teuthology.orchestra.run.smithi006.stdout: }, 2023-08-01T19:54:26.341 INFO:teuthology.orchestra.run.smithi006.stdout: "heartbeat_front_addrs": { 2023-08-01T19:54:26.341 INFO:teuthology.orchestra.run.smithi006.stdout: "addrvec": [ 2023-08-01T19:54:26.341 INFO:teuthology.orchestra.run.smithi006.stdout: { 2023-08-01T19:54:26.341 INFO:teuthology.orchestra.run.smithi006.stdout: "type": "v2", 2023-08-01T19:54:26.341 INFO:teuthology.orchestra.run.smithi006.stdout: "addr": "172.21.15.8:6804", 2023-08-01T19:54:26.342 INFO:teuthology.orchestra.run.smithi006.stdout: "nonce": 111181 2023-08-01T19:54:26.342 INFO:teuthology.orchestra.run.smithi006.stdout: }, 2023-08-01T19:54:26.342 INFO:teuthology.orchestra.run.smithi006.stdout: { 2023-08-01T19:54:26.342 INFO:teuthology.orchestra.run.smithi006.stdout: "type": "v1", 2023-08-01T19:54:26.342 INFO:teuthology.orchestra.run.smithi006.stdout: "addr": "172.21.15.8:6805", 2023-08-01T19:54:26.342 INFO:teuthology.orchestra.run.smithi006.stdout: "nonce": 111181 2023-08-01T19:54:26.342 INFO:teuthology.orchestra.run.smithi006.stdout: } 2023-08-01T19:54:26.342 INFO:teuthology.orchestra.run.smithi006.stdout: ] 2023-08-01T19:54:26.343 INFO:teuthology.orchestra.run.smithi006.stdout: }, 2023-08-01T19:54:26.343 INFO:teuthology.orchestra.run.smithi006.stdout: "public_addr": "172.21.15.8:6801/111181", 2023-08-01T19:54:26.343 INFO:teuthology.orchestra.run.smithi006.stdout: "cluster_addr": "172.21.15.8:6803/111181", 2023-08-01T19:54:26.343 INFO:teuthology.orchestra.run.smithi006.stdout: "heartbeat_back_addr": "172.21.15.8:6807/111181", 2023-08-01T19:54:26.343 INFO:teuthology.orchestra.run.smithi006.stdout: "heartbeat_front_addr": "172.21.15.8:6805/111181", 2023-08-01T19:54:26.343 INFO:teuthology.orchestra.run.smithi006.stdout: "state": [ 2023-08-01T19:54:26.343 INFO:teuthology.orchestra.run.smithi006.stdout: "exists", 2023-08-01T19:54:26.343 INFO:teuthology.orchestra.run.smithi006.stdout: "up" 2023-08-01T19:54:26.344 INFO:teuthology.orchestra.run.smithi006.stdout: ] 2023-08-01T19:54:26.344 INFO:teuthology.orchestra.run.smithi006.stdout: }, 2023-08-01T19:54:26.344 INFO:teuthology.orchestra.run.smithi006.stdout: { 2023-08-01T19:54:26.344 INFO:teuthology.orchestra.run.smithi006.stdout: "osd": 1, 2023-08-01T19:54:26.344 INFO:teuthology.orchestra.run.smithi006.stdout: "uuid": "7fc612c4-33ba-4a33-bca8-1f42ee8ed548", 2023-08-01T19:54:26.344 INFO:teuthology.orchestra.run.smithi006.stdout: "up": 1, 2023-08-01T19:54:26.344 INFO:teuthology.orchestra.run.smithi006.stdout: "in": 1, 2023-08-01T19:54:26.345 INFO:teuthology.orchestra.run.smithi006.stdout: "weight": 1, 2023-08-01T19:54:26.345 INFO:teuthology.orchestra.run.smithi006.stdout: "primary_affinity": 1, 2023-08-01T19:54:26.345 INFO:teuthology.orchestra.run.smithi006.stdout: "last_clean_begin": 0, 2023-08-01T19:54:26.345 INFO:teuthology.orchestra.run.smithi006.stdout: "last_clean_end": 0, 2023-08-01T19:54:26.345 INFO:teuthology.orchestra.run.smithi006.stdout: "up_from": 8, 2023-08-01T19:54:26.345 INFO:teuthology.orchestra.run.smithi006.stdout: "up_thru": 19, 2023-08-01T19:54:26.345 INFO:teuthology.orchestra.run.smithi006.stdout: "down_at": 0, 2023-08-01T19:54:26.346 INFO:teuthology.orchestra.run.smithi006.stdout: "lost_at": 0, 2023-08-01T19:54:26.346 INFO:teuthology.orchestra.run.smithi006.stdout: "public_addrs": { 2023-08-01T19:54:26.346 INFO:teuthology.orchestra.run.smithi006.stdout: "addrvec": [ 2023-08-01T19:54:26.346 INFO:teuthology.orchestra.run.smithi006.stdout: { 2023-08-01T19:54:26.346 INFO:teuthology.orchestra.run.smithi006.stdout: "type": "v2", 2023-08-01T19:54:26.346 INFO:teuthology.orchestra.run.smithi006.stdout: "addr": "172.21.15.101:6800", 2023-08-01T19:54:26.346 INFO:teuthology.orchestra.run.smithi006.stdout: "nonce": 111143 2023-08-01T19:54:26.346 INFO:teuthology.orchestra.run.smithi006.stdout: }, 2023-08-01T19:54:26.347 INFO:teuthology.orchestra.run.smithi006.stdout: { 2023-08-01T19:54:26.347 INFO:teuthology.orchestra.run.smithi006.stdout: "type": "v1", 2023-08-01T19:54:26.347 INFO:teuthology.orchestra.run.smithi006.stdout: "addr": "172.21.15.101:6801", 2023-08-01T19:54:26.347 INFO:teuthology.orchestra.run.smithi006.stdout: "nonce": 111143 2023-08-01T19:54:26.347 INFO:teuthology.orchestra.run.smithi006.stdout: } 2023-08-01T19:54:26.347 INFO:teuthology.orchestra.run.smithi006.stdout: ] 2023-08-01T19:54:26.347 INFO:teuthology.orchestra.run.smithi006.stdout: }, 2023-08-01T19:54:26.347 INFO:teuthology.orchestra.run.smithi006.stdout: "cluster_addrs": { 2023-08-01T19:54:26.348 INFO:teuthology.orchestra.run.smithi006.stdout: "addrvec": [ 2023-08-01T19:54:26.348 INFO:teuthology.orchestra.run.smithi006.stdout: { 2023-08-01T19:54:26.348 INFO:teuthology.orchestra.run.smithi006.stdout: "type": "v2", 2023-08-01T19:54:26.348 INFO:teuthology.orchestra.run.smithi006.stdout: "addr": "172.21.15.101:6802", 2023-08-01T19:54:26.348 INFO:teuthology.orchestra.run.smithi006.stdout: "nonce": 111143 2023-08-01T19:54:26.348 INFO:teuthology.orchestra.run.smithi006.stdout: }, 2023-08-01T19:54:26.348 INFO:teuthology.orchestra.run.smithi006.stdout: { 2023-08-01T19:54:26.348 INFO:teuthology.orchestra.run.smithi006.stdout: "type": "v1", 2023-08-01T19:54:26.349 INFO:teuthology.orchestra.run.smithi006.stdout: "addr": "172.21.15.101:6803", 2023-08-01T19:54:26.349 INFO:teuthology.orchestra.run.smithi006.stdout: "nonce": 111143 2023-08-01T19:54:26.349 INFO:teuthology.orchestra.run.smithi006.stdout: } 2023-08-01T19:54:26.349 INFO:teuthology.orchestra.run.smithi006.stdout: ] 2023-08-01T19:54:26.349 INFO:teuthology.orchestra.run.smithi006.stdout: }, 2023-08-01T19:54:26.349 INFO:teuthology.orchestra.run.smithi006.stdout: "heartbeat_back_addrs": { 2023-08-01T19:54:26.349 INFO:teuthology.orchestra.run.smithi006.stdout: "addrvec": [ 2023-08-01T19:54:26.349 INFO:teuthology.orchestra.run.smithi006.stdout: { 2023-08-01T19:54:26.350 INFO:teuthology.orchestra.run.smithi006.stdout: "type": "v2", 2023-08-01T19:54:26.350 INFO:teuthology.orchestra.run.smithi006.stdout: "addr": "172.21.15.101:6806", 2023-08-01T19:54:26.350 INFO:teuthology.orchestra.run.smithi006.stdout: "nonce": 111143 2023-08-01T19:54:26.350 INFO:teuthology.orchestra.run.smithi006.stdout: }, 2023-08-01T19:54:26.350 INFO:teuthology.orchestra.run.smithi006.stdout: { 2023-08-01T19:54:26.350 INFO:teuthology.orchestra.run.smithi006.stdout: "type": "v1", 2023-08-01T19:54:26.350 INFO:teuthology.orchestra.run.smithi006.stdout: "addr": "172.21.15.101:6807", 2023-08-01T19:54:26.350 INFO:teuthology.orchestra.run.smithi006.stdout: "nonce": 111143 2023-08-01T19:54:26.351 INFO:teuthology.orchestra.run.smithi006.stdout: } 2023-08-01T19:54:26.351 INFO:teuthology.orchestra.run.smithi006.stdout: ] 2023-08-01T19:54:26.351 INFO:teuthology.orchestra.run.smithi006.stdout: }, 2023-08-01T19:54:26.351 INFO:teuthology.orchestra.run.smithi006.stdout: "heartbeat_front_addrs": { 2023-08-01T19:54:26.351 INFO:teuthology.orchestra.run.smithi006.stdout: "addrvec": [ 2023-08-01T19:54:26.351 INFO:teuthology.orchestra.run.smithi006.stdout: { 2023-08-01T19:54:26.351 INFO:teuthology.orchestra.run.smithi006.stdout: "type": "v2", 2023-08-01T19:54:26.351 INFO:teuthology.orchestra.run.smithi006.stdout: "addr": "172.21.15.101:6804", 2023-08-01T19:54:26.352 INFO:teuthology.orchestra.run.smithi006.stdout: "nonce": 111143 2023-08-01T19:54:26.352 INFO:teuthology.orchestra.run.smithi006.stdout: }, 2023-08-01T19:54:26.352 INFO:teuthology.orchestra.run.smithi006.stdout: { 2023-08-01T19:54:26.352 INFO:teuthology.orchestra.run.smithi006.stdout: "type": "v1", 2023-08-01T19:54:26.352 INFO:teuthology.orchestra.run.smithi006.stdout: "addr": "172.21.15.101:6805", 2023-08-01T19:54:26.352 INFO:teuthology.orchestra.run.smithi006.stdout: "nonce": 111143 2023-08-01T19:54:26.352 INFO:teuthology.orchestra.run.smithi006.stdout: } 2023-08-01T19:54:26.353 INFO:teuthology.orchestra.run.smithi006.stdout: ] 2023-08-01T19:54:26.353 INFO:teuthology.orchestra.run.smithi006.stdout: }, 2023-08-01T19:54:26.353 INFO:teuthology.orchestra.run.smithi006.stdout: "public_addr": "172.21.15.101:6801/111143", 2023-08-01T19:54:26.353 INFO:teuthology.orchestra.run.smithi006.stdout: "cluster_addr": "172.21.15.101:6803/111143", 2023-08-01T19:54:26.353 INFO:teuthology.orchestra.run.smithi006.stdout: "heartbeat_back_addr": "172.21.15.101:6807/111143", 2023-08-01T19:54:26.353 INFO:teuthology.orchestra.run.smithi006.stdout: "heartbeat_front_addr": "172.21.15.101:6805/111143", 2023-08-01T19:54:26.353 INFO:teuthology.orchestra.run.smithi006.stdout: "state": [ 2023-08-01T19:54:26.353 INFO:teuthology.orchestra.run.smithi006.stdout: "exists", 2023-08-01T19:54:26.354 INFO:teuthology.orchestra.run.smithi006.stdout: "up" 2023-08-01T19:54:26.354 INFO:teuthology.orchestra.run.smithi006.stdout: ] 2023-08-01T19:54:26.354 INFO:teuthology.orchestra.run.smithi006.stdout: }, 2023-08-01T19:54:26.354 INFO:teuthology.orchestra.run.smithi006.stdout: { 2023-08-01T19:54:26.354 INFO:teuthology.orchestra.run.smithi006.stdout: "osd": 2, 2023-08-01T19:54:26.354 INFO:teuthology.orchestra.run.smithi006.stdout: "uuid": "f85cadbc-4230-4772-8f39-62ed52e220b1", 2023-08-01T19:54:26.354 INFO:teuthology.orchestra.run.smithi006.stdout: "up": 1, 2023-08-01T19:54:26.354 INFO:teuthology.orchestra.run.smithi006.stdout: "in": 1, 2023-08-01T19:54:26.355 INFO:teuthology.orchestra.run.smithi006.stdout: "weight": 1, 2023-08-01T19:54:26.355 INFO:teuthology.orchestra.run.smithi006.stdout: "primary_affinity": 1, 2023-08-01T19:54:26.355 INFO:teuthology.orchestra.run.smithi006.stdout: "last_clean_begin": 0, 2023-08-01T19:54:26.355 INFO:teuthology.orchestra.run.smithi006.stdout: "last_clean_end": 0, 2023-08-01T19:54:26.355 INFO:teuthology.orchestra.run.smithi006.stdout: "up_from": 9, 2023-08-01T19:54:26.355 INFO:teuthology.orchestra.run.smithi006.stdout: "up_thru": 19, 2023-08-01T19:54:26.355 INFO:teuthology.orchestra.run.smithi006.stdout: "down_at": 0, 2023-08-01T19:54:26.355 INFO:teuthology.orchestra.run.smithi006.stdout: "lost_at": 0, 2023-08-01T19:54:26.356 INFO:teuthology.orchestra.run.smithi006.stdout: "public_addrs": { 2023-08-01T19:54:26.356 INFO:teuthology.orchestra.run.smithi006.stdout: "addrvec": [ 2023-08-01T19:54:26.356 INFO:teuthology.orchestra.run.smithi006.stdout: { 2023-08-01T19:54:26.356 INFO:teuthology.orchestra.run.smithi006.stdout: "type": "v2", 2023-08-01T19:54:26.356 INFO:teuthology.orchestra.run.smithi006.stdout: "addr": "172.21.15.155:6800", 2023-08-01T19:54:26.356 INFO:teuthology.orchestra.run.smithi006.stdout: "nonce": 111339 2023-08-01T19:54:26.356 INFO:teuthology.orchestra.run.smithi006.stdout: }, 2023-08-01T19:54:26.356 INFO:teuthology.orchestra.run.smithi006.stdout: { 2023-08-01T19:54:26.357 INFO:teuthology.orchestra.run.smithi006.stdout: "type": "v1", 2023-08-01T19:54:26.357 INFO:teuthology.orchestra.run.smithi006.stdout: "addr": "172.21.15.155:6801", 2023-08-01T19:54:26.357 INFO:teuthology.orchestra.run.smithi006.stdout: "nonce": 111339 2023-08-01T19:54:26.357 INFO:teuthology.orchestra.run.smithi006.stdout: } 2023-08-01T19:54:26.357 INFO:teuthology.orchestra.run.smithi006.stdout: ] 2023-08-01T19:54:26.357 INFO:teuthology.orchestra.run.smithi006.stdout: }, 2023-08-01T19:54:26.357 INFO:teuthology.orchestra.run.smithi006.stdout: "cluster_addrs": { 2023-08-01T19:54:26.357 INFO:teuthology.orchestra.run.smithi006.stdout: "addrvec": [ 2023-08-01T19:54:26.358 INFO:teuthology.orchestra.run.smithi006.stdout: { 2023-08-01T19:54:26.358 INFO:teuthology.orchestra.run.smithi006.stdout: "type": "v2", 2023-08-01T19:54:26.358 INFO:teuthology.orchestra.run.smithi006.stdout: "addr": "172.21.15.155:6802", 2023-08-01T19:54:26.358 INFO:teuthology.orchestra.run.smithi006.stdout: "nonce": 111339 2023-08-01T19:54:26.358 INFO:teuthology.orchestra.run.smithi006.stdout: }, 2023-08-01T19:54:26.358 INFO:teuthology.orchestra.run.smithi006.stdout: { 2023-08-01T19:54:26.358 INFO:teuthology.orchestra.run.smithi006.stdout: "type": "v1", 2023-08-01T19:54:26.359 INFO:teuthology.orchestra.run.smithi006.stdout: "addr": "172.21.15.155:6803", 2023-08-01T19:54:26.359 INFO:teuthology.orchestra.run.smithi006.stdout: "nonce": 111339 2023-08-01T19:54:26.359 INFO:teuthology.orchestra.run.smithi006.stdout: } 2023-08-01T19:54:26.359 INFO:teuthology.orchestra.run.smithi006.stdout: ] 2023-08-01T19:54:26.359 INFO:teuthology.orchestra.run.smithi006.stdout: }, 2023-08-01T19:54:26.359 INFO:teuthology.orchestra.run.smithi006.stdout: "heartbeat_back_addrs": { 2023-08-01T19:54:26.359 INFO:teuthology.orchestra.run.smithi006.stdout: "addrvec": [ 2023-08-01T19:54:26.359 INFO:teuthology.orchestra.run.smithi006.stdout: { 2023-08-01T19:54:26.360 INFO:teuthology.orchestra.run.smithi006.stdout: "type": "v2", 2023-08-01T19:54:26.360 INFO:teuthology.orchestra.run.smithi006.stdout: "addr": "172.21.15.155:6806", 2023-08-01T19:54:26.360 INFO:teuthology.orchestra.run.smithi006.stdout: "nonce": 111339 2023-08-01T19:54:26.360 INFO:teuthology.orchestra.run.smithi006.stdout: }, 2023-08-01T19:54:26.360 INFO:teuthology.orchestra.run.smithi006.stdout: { 2023-08-01T19:54:26.360 INFO:teuthology.orchestra.run.smithi006.stdout: "type": "v1", 2023-08-01T19:54:26.360 INFO:teuthology.orchestra.run.smithi006.stdout: "addr": "172.21.15.155:6807", 2023-08-01T19:54:26.361 INFO:teuthology.orchestra.run.smithi006.stdout: "nonce": 111339 2023-08-01T19:54:26.361 INFO:teuthology.orchestra.run.smithi006.stdout: } 2023-08-01T19:54:26.361 INFO:teuthology.orchestra.run.smithi006.stdout: ] 2023-08-01T19:54:26.361 INFO:teuthology.orchestra.run.smithi006.stdout: }, 2023-08-01T19:54:26.361 INFO:teuthology.orchestra.run.smithi006.stdout: "heartbeat_front_addrs": { 2023-08-01T19:54:26.361 INFO:teuthology.orchestra.run.smithi006.stdout: "addrvec": [ 2023-08-01T19:54:26.361 INFO:teuthology.orchestra.run.smithi006.stdout: { 2023-08-01T19:54:26.361 INFO:teuthology.orchestra.run.smithi006.stdout: "type": "v2", 2023-08-01T19:54:26.362 INFO:teuthology.orchestra.run.smithi006.stdout: "addr": "172.21.15.155:6804", 2023-08-01T19:54:26.362 INFO:teuthology.orchestra.run.smithi006.stdout: "nonce": 111339 2023-08-01T19:54:26.362 INFO:teuthology.orchestra.run.smithi006.stdout: }, 2023-08-01T19:54:26.362 INFO:teuthology.orchestra.run.smithi006.stdout: { 2023-08-01T19:54:26.362 INFO:teuthology.orchestra.run.smithi006.stdout: "type": "v1", 2023-08-01T19:54:26.362 INFO:teuthology.orchestra.run.smithi006.stdout: "addr": "172.21.15.155:6805", 2023-08-01T19:54:26.362 INFO:teuthology.orchestra.run.smithi006.stdout: "nonce": 111339 2023-08-01T19:54:26.362 INFO:teuthology.orchestra.run.smithi006.stdout: } 2023-08-01T19:54:26.363 INFO:teuthology.orchestra.run.smithi006.stdout: ] 2023-08-01T19:54:26.363 INFO:teuthology.orchestra.run.smithi006.stdout: }, 2023-08-01T19:54:26.363 INFO:teuthology.orchestra.run.smithi006.stdout: "public_addr": "172.21.15.155:6801/111339", 2023-08-01T19:54:26.363 INFO:teuthology.orchestra.run.smithi006.stdout: "cluster_addr": "172.21.15.155:6803/111339", 2023-08-01T19:54:26.363 INFO:teuthology.orchestra.run.smithi006.stdout: "heartbeat_back_addr": "172.21.15.155:6807/111339", 2023-08-01T19:54:26.363 INFO:teuthology.orchestra.run.smithi006.stdout: "heartbeat_front_addr": "172.21.15.155:6805/111339", 2023-08-01T19:54:26.363 INFO:teuthology.orchestra.run.smithi006.stdout: "state": [ 2023-08-01T19:54:26.364 INFO:teuthology.orchestra.run.smithi006.stdout: "exists", 2023-08-01T19:54:26.364 INFO:teuthology.orchestra.run.smithi006.stdout: "up" 2023-08-01T19:54:26.364 INFO:teuthology.orchestra.run.smithi006.stdout: ] 2023-08-01T19:54:26.364 INFO:teuthology.orchestra.run.smithi006.stdout: } 2023-08-01T19:54:26.364 INFO:teuthology.orchestra.run.smithi006.stdout: ], 2023-08-01T19:54:26.364 INFO:teuthology.orchestra.run.smithi006.stdout: "osd_xinfo": [ 2023-08-01T19:54:26.364 INFO:teuthology.orchestra.run.smithi006.stdout: { 2023-08-01T19:54:26.364 INFO:teuthology.orchestra.run.smithi006.stdout: "osd": 0, 2023-08-01T19:54:26.365 INFO:teuthology.orchestra.run.smithi006.stdout: "down_stamp": "0.000000", 2023-08-01T19:54:26.365 INFO:teuthology.orchestra.run.smithi006.stdout: "laggy_probability": 0, 2023-08-01T19:54:26.365 INFO:teuthology.orchestra.run.smithi006.stdout: "laggy_interval": 0, 2023-08-01T19:54:26.365 INFO:teuthology.orchestra.run.smithi006.stdout: "features": 4540138320759226367, 2023-08-01T19:54:26.365 INFO:teuthology.orchestra.run.smithi006.stdout: "old_weight": 0, 2023-08-01T19:54:26.365 INFO:teuthology.orchestra.run.smithi006.stdout: "last_purged_snaps_scrub": "2023-08-01T19:53:48.018154+0000", 2023-08-01T19:54:26.365 INFO:teuthology.orchestra.run.smithi006.stdout: "dead_epoch": 0 2023-08-01T19:54:26.365 INFO:teuthology.orchestra.run.smithi006.stdout: }, 2023-08-01T19:54:26.366 INFO:teuthology.orchestra.run.smithi006.stdout: { 2023-08-01T19:54:26.366 INFO:teuthology.orchestra.run.smithi006.stdout: "osd": 1, 2023-08-01T19:54:26.366 INFO:teuthology.orchestra.run.smithi006.stdout: "down_stamp": "0.000000", 2023-08-01T19:54:26.366 INFO:teuthology.orchestra.run.smithi006.stdout: "laggy_probability": 0, 2023-08-01T19:54:26.366 INFO:teuthology.orchestra.run.smithi006.stdout: "laggy_interval": 0, 2023-08-01T19:54:26.366 INFO:teuthology.orchestra.run.smithi006.stdout: "features": 4540138320759226367, 2023-08-01T19:54:26.366 INFO:teuthology.orchestra.run.smithi006.stdout: "old_weight": 0, 2023-08-01T19:54:26.366 INFO:teuthology.orchestra.run.smithi006.stdout: "last_purged_snaps_scrub": "2023-08-01T19:53:48.000488+0000", 2023-08-01T19:54:26.367 INFO:teuthology.orchestra.run.smithi006.stdout: "dead_epoch": 0 2023-08-01T19:54:26.367 INFO:teuthology.orchestra.run.smithi006.stdout: }, 2023-08-01T19:54:26.367 INFO:teuthology.orchestra.run.smithi006.stdout: { 2023-08-01T19:54:26.367 INFO:teuthology.orchestra.run.smithi006.stdout: "osd": 2, 2023-08-01T19:54:26.367 INFO:teuthology.orchestra.run.smithi006.stdout: "down_stamp": "0.000000", 2023-08-01T19:54:26.367 INFO:teuthology.orchestra.run.smithi006.stdout: "laggy_probability": 0, 2023-08-01T19:54:26.367 INFO:teuthology.orchestra.run.smithi006.stdout: "laggy_interval": 0, 2023-08-01T19:54:26.367 INFO:teuthology.orchestra.run.smithi006.stdout: "features": 4540138320759226367, 2023-08-01T19:54:26.368 INFO:teuthology.orchestra.run.smithi006.stdout: "old_weight": 0, 2023-08-01T19:54:26.368 INFO:teuthology.orchestra.run.smithi006.stdout: "last_purged_snaps_scrub": "2023-08-01T19:53:48.072529+0000", 2023-08-01T19:54:26.368 INFO:teuthology.orchestra.run.smithi006.stdout: "dead_epoch": 0 2023-08-01T19:54:26.368 INFO:teuthology.orchestra.run.smithi006.stdout: } 2023-08-01T19:54:26.368 INFO:teuthology.orchestra.run.smithi006.stdout: ], 2023-08-01T19:54:26.368 INFO:teuthology.orchestra.run.smithi006.stdout: "pg_upmap": [], 2023-08-01T19:54:26.368 INFO:teuthology.orchestra.run.smithi006.stdout: "pg_upmap_items": [], 2023-08-01T19:54:26.368 INFO:teuthology.orchestra.run.smithi006.stdout: "pg_temp": [], 2023-08-01T19:54:26.369 INFO:teuthology.orchestra.run.smithi006.stdout: "primary_temp": [], 2023-08-01T19:54:26.369 INFO:teuthology.orchestra.run.smithi006.stdout: "blocklist": {}, 2023-08-01T19:54:26.369 INFO:teuthology.orchestra.run.smithi006.stdout: "range_blocklist": {}, 2023-08-01T19:54:26.369 INFO:teuthology.orchestra.run.smithi006.stdout: "erasure_code_profiles": { 2023-08-01T19:54:26.369 INFO:teuthology.orchestra.run.smithi006.stdout: "default": { 2023-08-01T19:54:26.369 INFO:teuthology.orchestra.run.smithi006.stdout: "crush-failure-domain": "osd", 2023-08-01T19:54:26.369 INFO:teuthology.orchestra.run.smithi006.stdout: "k": "2", 2023-08-01T19:54:26.369 INFO:teuthology.orchestra.run.smithi006.stdout: "m": "1", 2023-08-01T19:54:26.370 INFO:teuthology.orchestra.run.smithi006.stdout: "plugin": "jerasure", 2023-08-01T19:54:26.370 INFO:teuthology.orchestra.run.smithi006.stdout: "technique": "reed_sol_van" 2023-08-01T19:54:26.370 INFO:teuthology.orchestra.run.smithi006.stdout: } 2023-08-01T19:54:26.370 INFO:teuthology.orchestra.run.smithi006.stdout: }, 2023-08-01T19:54:26.370 INFO:teuthology.orchestra.run.smithi006.stdout: "removed_snaps_queue": [], 2023-08-01T19:54:26.370 INFO:teuthology.orchestra.run.smithi006.stdout: "new_removed_snaps": [], 2023-08-01T19:54:26.370 INFO:teuthology.orchestra.run.smithi006.stdout: "new_purged_snaps": [], 2023-08-01T19:54:26.370 INFO:teuthology.orchestra.run.smithi006.stdout: "crush_node_flags": {}, 2023-08-01T19:54:26.371 INFO:teuthology.orchestra.run.smithi006.stdout: "device_class_flags": {}, 2023-08-01T19:54:26.371 INFO:teuthology.orchestra.run.smithi006.stdout: "stretch_mode": { 2023-08-01T19:54:26.371 INFO:teuthology.orchestra.run.smithi006.stdout: "stretch_mode_enabled": false, 2023-08-01T19:54:26.371 INFO:teuthology.orchestra.run.smithi006.stdout: "stretch_bucket_count": 0, 2023-08-01T19:54:26.371 INFO:teuthology.orchestra.run.smithi006.stdout: "degraded_stretch_mode": 0, 2023-08-01T19:54:26.371 INFO:teuthology.orchestra.run.smithi006.stdout: "recovering_stretch_mode": 0, 2023-08-01T19:54:26.371 INFO:teuthology.orchestra.run.smithi006.stdout: "stretch_mode_bucket": 0 2023-08-01T19:54:26.371 INFO:teuthology.orchestra.run.smithi006.stdout: } 2023-08-01T19:54:26.372 INFO:teuthology.orchestra.run.smithi006.stdout:} 2023-08-01T19:54:26.373 INFO:tasks.thrashosds.thrasher:j is {'epoch': 22, 'fsid': 'a0e420cc-4df1-42a5-8bd4-a98c309a9349', 'created': '2023-08-01T19:53:41.279588+0000', 'modified': '2023-08-01T19:54:25.130812+0000', 'last_up_change': '2023-08-01T19:53:50.735626+0000', 'last_in_change': '2023-08-01T19:53:42.974751+0000', 'flags': 'noscrub,nodeep-scrub,sortbitwise,recovery_deletes,purged_snapdirs,pglog_hardlimit', 'flags_num': 5806080, 'flags_set': ['nodeep-scrub', 'noscrub', 'pglog_hardlimit', 'purged_snapdirs', 'recovery_deletes', 'sortbitwise'], 'crush_version': 5, 'full_ratio': 0.949999988079071, 'backfillfull_ratio': 0.8999999761581421, 'nearfull_ratio': 0.8500000238418579, 'cluster_snapshot': '', 'pool_max': 5, 'max_osd': 3, 'require_min_compat_client': 'luminous', 'min_compat_client': 'jewel', 'require_osd_release': 'quincy', 'pools': [{'pool': 1, 'pool_name': '.mgr', 'create_time': '2023-08-01T19:53:49.961944+0000', 'flags': 1, 'flags_names': 'hashpspool', 'type': 1, 'size': 2, 'min_size': 1, 'crush_rule': 0, 'peering_crush_bucket_count': 0, 'peering_crush_bucket_target': 0, 'peering_crush_bucket_barrier': 0, 'peering_crush_bucket_mandatory_member': 2147483647, 'object_hash': 2, 'pg_autoscale_mode': 'off', 'pg_num': 1, 'pg_placement_num': 1, 'pg_placement_num_target': 1, 'pg_num_target': 1, 'pg_num_pending': 1, 'last_pg_merge_meta': {'source_pgid': '0.0', 'ready_epoch': 0, 'last_epoch_started': 0, 'last_epoch_clean': 0, 'source_version': "0'0", 'target_version': "0'0"}, 'last_change': '11', 'last_force_op_resend': '0', 'last_force_op_resend_prenautilus': '0', 'last_force_op_resend_preluminous': '0', 'auid': 0, 'snap_mode': 'selfmanaged', 'snap_seq': 0, 'snap_epoch': 0, 'pool_snaps': [], 'removed_snaps': '[]', 'quota_max_bytes': 0, 'quota_max_objects': 0, 'tiers': [], 'tier_of': -1, 'read_tier': -1, 'write_tier': -1, 'cache_mode': 'none', 'target_max_bytes': 0, 'target_max_objects': 0, 'cache_target_dirty_ratio_micro': 400000, 'cache_target_dirty_high_ratio_micro': 600000, 'cache_target_full_ratio_micro': 800000, 'cache_min_flush_age': 0, 'cache_min_evict_age': 0, 'erasure_code_profile': '', 'hit_set_params': {'type': 'none'}, 'hit_set_period': 0, 'hit_set_count': 0, 'use_gmt_hitset': True, 'min_read_recency_for_promote': 0, 'min_write_recency_for_promote': 0, 'hit_set_grade_decay_rate': 0, 'hit_set_search_last_n': 0, 'grade_table': [], 'stripe_width': 0, 'expected_num_objects': 0, 'fast_read': False, 'options': {'pg_num_max': 32, 'pg_num_min': 1}, 'application_metadata': {'mgr': {}}}, {'pool': 2, 'pool_name': 'rbd', 'create_time': '2023-08-01T19:53:57.404091+0000', 'flags': 1, 'flags_names': 'hashpspool', 'type': 1, 'size': 2, 'min_size': 1, 'crush_rule': 0, 'peering_crush_bucket_count': 0, 'peering_crush_bucket_target': 0, 'peering_crush_bucket_barrier': 0, 'peering_crush_bucket_mandatory_member': 2147483647, 'object_hash': 2, 'pg_autoscale_mode': 'off', 'pg_num': 8, 'pg_placement_num': 8, 'pg_placement_num_target': 8, 'pg_num_target': 8, 'pg_num_pending': 8, 'last_pg_merge_meta': {'source_pgid': '0.0', 'ready_epoch': 0, 'last_epoch_started': 0, 'last_epoch_clean': 0, 'source_version': "0'0", 'target_version': "0'0"}, 'last_change': '14', 'last_force_op_resend': '0', 'last_force_op_resend_prenautilus': '0', 'last_force_op_resend_preluminous': '0', 'auid': 0, 'snap_mode': 'selfmanaged', 'snap_seq': 0, 'snap_epoch': 0, 'pool_snaps': [], 'removed_snaps': '[]', 'quota_max_bytes': 0, 'quota_max_objects': 0, 'tiers': [], 'tier_of': -1, 'read_tier': -1, 'write_tier': -1, 'cache_mode': 'none', 'target_max_bytes': 0, 'target_max_objects': 0, 'cache_target_dirty_ratio_micro': 400000, 'cache_target_dirty_high_ratio_micro': 600000, 'cache_target_full_ratio_micro': 800000, 'cache_min_flush_age': 0, 'cache_min_evict_age': 0, 'erasure_code_profile': '', 'hit_set_params': {'type': 'none'}, 'hit_set_period': 0, 'hit_set_count': 0, 'use_gmt_hitset': True, 'min_read_recency_for_promote': 0, 'min_write_recency_for_promote': 0, 'hit_set_grade_decay_rate': 0, 'hit_set_search_last_n': 0, 'grade_table': [], 'stripe_width': 0, 'expected_num_objects': 0, 'fast_read': False, 'options': {}, 'application_metadata': {'rbd': {}}}, {'pool': 3, 'pool_name': 'cephfs_metadata', 'create_time': '2023-08-01T19:54:02.111247+0000', 'flags': 1, 'flags_names': 'hashpspool', 'type': 1, 'size': 2, 'min_size': 1, 'crush_rule': 0, 'peering_crush_bucket_count': 0, 'peering_crush_bucket_target': 0, 'peering_crush_bucket_barrier': 0, 'peering_crush_bucket_mandatory_member': 2147483647, 'object_hash': 2, 'pg_autoscale_mode': 'off', 'pg_num': 32, 'pg_placement_num': 32, 'pg_placement_num_target': 32, 'pg_num_target': 32, 'pg_num_pending': 32, 'last_pg_merge_meta': {'source_pgid': '0.0', 'ready_epoch': 0, 'last_epoch_started': 0, 'last_epoch_clean': 0, 'source_version': "0'0", 'target_version': "0'0"}, 'last_change': '17', 'last_force_op_resend': '0', 'last_force_op_resend_prenautilus': '0', 'last_force_op_resend_preluminous': '0', 'auid': 0, 'snap_mode': 'selfmanaged', 'snap_seq': 0, 'snap_epoch': 0, 'pool_snaps': [], 'removed_snaps': '[]', 'quota_max_bytes': 0, 'quota_max_objects': 0, 'tiers': [], 'tier_of': -1, 'read_tier': -1, 'write_tier': -1, 'cache_mode': 'none', 'target_max_bytes': 0, 'target_max_objects': 0, 'cache_target_dirty_ratio_micro': 400000, 'cache_target_dirty_high_ratio_micro': 600000, 'cache_target_full_ratio_micro': 800000, 'cache_min_flush_age': 0, 'cache_min_evict_age': 0, 'erasure_code_profile': '', 'hit_set_params': {'type': 'none'}, 'hit_set_period': 0, 'hit_set_count': 0, 'use_gmt_hitset': True, 'min_read_recency_for_promote': 0, 'min_write_recency_for_promote': 0, 'hit_set_grade_decay_rate': 0, 'hit_set_search_last_n': 0, 'grade_table': [], 'stripe_width': 0, 'expected_num_objects': 0, 'fast_read': False, 'options': {'pg_autoscale_bias': 4, 'pg_num_min': 16, 'recovery_priority': 5}, 'application_metadata': {'cephfs': {'metadata': 'cephfs'}}}, {'pool': 4, 'pool_name': 'cephfs_data', 'create_time': '2023-08-01T19:54:03.430277+0000', 'flags': 1, 'flags_names': 'hashpspool', 'type': 1, 'size': 2, 'min_size': 1, 'crush_rule': 0, 'peering_crush_bucket_count': 0, 'peering_crush_bucket_target': 0, 'peering_crush_bucket_barrier': 0, 'peering_crush_bucket_mandatory_member': 2147483647, 'object_hash': 2, 'pg_autoscale_mode': 'off', 'pg_num': 64, 'pg_placement_num': 64, 'pg_placement_num_target': 64, 'pg_num_target': 64, 'pg_num_pending': 64, 'last_pg_merge_meta': {'source_pgid': '0.0', 'ready_epoch': 0, 'last_epoch_started': 0, 'last_epoch_clean': 0, 'source_version': "0'0", 'target_version': "0'0"}, 'last_change': '18', 'last_force_op_resend': '0', 'last_force_op_resend_prenautilus': '0', 'last_force_op_resend_preluminous': '0', 'auid': 0, 'snap_mode': 'selfmanaged', 'snap_seq': 0, 'snap_epoch': 0, 'pool_snaps': [], 'removed_snaps': '[]', 'quota_max_bytes': 0, 'quota_max_objects': 0, 'tiers': [], 'tier_of': -1, 'read_tier': -1, 'write_tier': -1, 'cache_mode': 'none', 'target_max_bytes': 0, 'target_max_objects': 0, 'cache_target_dirty_ratio_micro': 400000, 'cache_target_dirty_high_ratio_micro': 600000, 'cache_target_full_ratio_micro': 800000, 'cache_min_flush_age': 0, 'cache_min_evict_age': 0, 'erasure_code_profile': '', 'hit_set_params': {'type': 'none'}, 'hit_set_period': 0, 'hit_set_count': 0, 'use_gmt_hitset': True, 'min_read_recency_for_promote': 0, 'min_write_recency_for_promote': 0, 'hit_set_grade_decay_rate': 0, 'hit_set_search_last_n': 0, 'grade_table': [], 'stripe_width': 0, 'expected_num_objects': 0, 'fast_read': False, 'options': {'pg_num_min': 64, 'target_size_ratio': 0.8999999761581421}, 'application_metadata': {'cephfs': {'data': 'cephfs'}}}, {'pool': 5, 'pool_name': 'unique_pool_0', 'create_time': '2023-08-01T19:54:21.165668+0000', 'flags': 1, 'flags_names': 'hashpspool', 'type': 1, 'size': 2, 'min_size': 1, 'crush_rule': 0, 'peering_crush_bucket_count': 0, 'peering_crush_bucket_target': 0, 'peering_crush_bucket_barrier': 0, 'peering_crush_bucket_mandatory_member': 2147483647, 'object_hash': 2, 'pg_autoscale_mode': 'off', 'pg_num': 16, 'pg_placement_num': 16, 'pg_placement_num_target': 16, 'pg_num_target': 16, 'pg_num_pending': 16, 'last_pg_merge_meta': {'source_pgid': '0.0', 'ready_epoch': 0, 'last_epoch_started': 0, 'last_epoch_clean': 0, 'source_version': "0'0", 'target_version': "0'0"}, 'last_change': '21', 'last_force_op_resend': '0', 'last_force_op_resend_prenautilus': '0', 'last_force_op_resend_preluminous': '0', 'auid': 0, 'snap_mode': 'selfmanaged', 'snap_seq': 0, 'snap_epoch': 0, 'pool_snaps': [], 'removed_snaps': '[]', 'quota_max_bytes': 0, 'quota_max_objects': 0, 'tiers': [], 'tier_of': -1, 'read_tier': -1, 'write_tier': -1, 'cache_mode': 'none', 'target_max_bytes': 0, 'target_max_objects': 0, 'cache_target_dirty_ratio_micro': 400000, 'cache_target_dirty_high_ratio_micro': 600000, 'cache_target_full_ratio_micro': 800000, 'cache_min_flush_age': 0, 'cache_min_evict_age': 0, 'erasure_code_profile': '', 'hit_set_params': {'type': 'none'}, 'hit_set_period': 0, 'hit_set_count': 0, 'use_gmt_hitset': True, 'min_read_recency_for_promote': 0, 'min_write_recency_for_promote': 0, 'hit_set_grade_decay_rate': 0, 'hit_set_search_last_n': 0, 'grade_table': [], 'stripe_width': 0, 'expected_num_objects': 0, 'fast_read': False, 'options': {}, 'application_metadata': {'rados': {}}}], 'osds': [{'osd': 0, 'uuid': '5dd675c7-2777-48f2-8009-ff0e0d4c7086', 'up': 1, 'in': 1, 'weight': 1, 'primary_affinity': 1, 'last_clean_begin': 0, 'last_clean_end': 0, 'up_from': 8, 'up_thru': 19, 'down_at': 0, 'lost_at': 0, 'public_addrs': {'addrvec': [{'type': 'v2', 'addr': '172.21.15.8:6800', 'nonce': 111181}, {'type': 'v1', 'addr': '172.21.15.8:6801', 'nonce': 111181}]}, 'cluster_addrs': {'addrvec': [{'type': 'v2', 'addr': '172.21.15.8:6802', 'nonce': 111181}, {'type': 'v1', 'addr': '172.21.15.8:6803', 'nonce': 111181}]}, 'heartbeat_back_addrs': {'addrvec': [{'type': 'v2', 'addr': '172.21.15.8:6806', 'nonce': 111181}, {'type': 'v1', 'addr': '172.21.15.8:6807', 'nonce': 111181}]}, 'heartbeat_front_addrs': {'addrvec': [{'type': 'v2', 'addr': '172.21.15.8:6804', 'nonce': 111181}, {'type': 'v1', 'addr': '172.21.15.8:6805', 'nonce': 111181}]}, 'public_addr': '172.21.15.8:6801/111181', 'cluster_addr': '172.21.15.8:6803/111181', 'heartbeat_back_addr': '172.21.15.8:6807/111181', 'heartbeat_front_addr': '172.21.15.8:6805/111181', 'state': ['exists', 'up']}, {'osd': 1, 'uuid': '7fc612c4-33ba-4a33-bca8-1f42ee8ed548', 'up': 1, 'in': 1, 'weight': 1, 'primary_affinity': 1, 'last_clean_begin': 0, 'last_clean_end': 0, 'up_from': 8, 'up_thru': 19, 'down_at': 0, 'lost_at': 0, 'public_addrs': {'addrvec': [{'type': 'v2', 'addr': '172.21.15.101:6800', 'nonce': 111143}, {'type': 'v1', 'addr': '172.21.15.101:6801', 'nonce': 111143}]}, 'cluster_addrs': {'addrvec': [{'type': 'v2', 'addr': '172.21.15.101:6802', 'nonce': 111143}, {'type': 'v1', 'addr': '172.21.15.101:6803', 'nonce': 111143}]}, 'heartbeat_back_addrs': {'addrvec': [{'type': 'v2', 'addr': '172.21.15.101:6806', 'nonce': 111143}, {'type': 'v1', 'addr': '172.21.15.101:6807', 'nonce': 111143}]}, 'heartbeat_front_addrs': {'addrvec': [{'type': 'v2', 'addr': '172.21.15.101:6804', 'nonce': 111143}, {'type': 'v1', 'addr': '172.21.15.101:6805', 'nonce': 111143}]}, 'public_addr': '172.21.15.101:6801/111143', 'cluster_addr': '172.21.15.101:6803/111143', 'heartbeat_back_addr': '172.21.15.101:6807/111143', 'heartbeat_front_addr': '172.21.15.101:6805/111143', 'state': ['exists', 'up']}, {'osd': 2, 'uuid': 'f85cadbc-4230-4772-8f39-62ed52e220b1', 'up': 1, 'in': 1, 'weight': 1, 'primary_affinity': 1, 'last_clean_begin': 0, 'last_clean_end': 0, 'up_from': 9, 'up_thru': 19, 'down_at': 0, 'lost_at': 0, 'public_addrs': {'addrvec': [{'type': 'v2', 'addr': '172.21.15.155:6800', 'nonce': 111339}, {'type': 'v1', 'addr': '172.21.15.155:6801', 'nonce': 111339}]}, 'cluster_addrs': {'addrvec': [{'type': 'v2', 'addr': '172.21.15.155:6802', 'nonce': 111339}, {'type': 'v1', 'addr': '172.21.15.155:6803', 'nonce': 111339}]}, 'heartbeat_back_addrs': {'addrvec': [{'type': 'v2', 'addr': '172.21.15.155:6806', 'nonce': 111339}, {'type': 'v1', 'addr': '172.21.15.155:6807', 'nonce': 111339}]}, 'heartbeat_front_addrs': {'addrvec': [{'type': 'v2', 'addr': '172.21.15.155:6804', 'nonce': 111339}, {'type': 'v1', 'addr': '172.21.15.155:6805', 'nonce': 111339}]}, 'public_addr': '172.21.15.155:6801/111339', 'cluster_addr': '172.21.15.155:6803/111339', 'heartbeat_back_addr': '172.21.15.155:6807/111339', 'heartbeat_front_addr': '172.21.15.155:6805/111339', 'state': ['exists', 'up']}], 'osd_xinfo': [{'osd': 0, 'down_stamp': '0.000000', 'laggy_probability': 0, 'laggy_interval': 0, 'features': 4540138320759226367, 'old_weight': 0, 'last_purged_snaps_scrub': '2023-08-01T19:53:48.018154+0000', 'dead_epoch': 0}, {'osd': 1, 'down_stamp': '0.000000', 'laggy_probability': 0, 'laggy_interval': 0, 'features': 4540138320759226367, 'old_weight': 0, 'last_purged_snaps_scrub': '2023-08-01T19:53:48.000488+0000', 'dead_epoch': 0}, {'osd': 2, 'down_stamp': '0.000000', 'laggy_probability': 0, 'laggy_interval': 0, 'features': 4540138320759226367, 'old_weight': 0, 'last_purged_snaps_scrub': '2023-08-01T19:53:48.072529+0000', 'dead_epoch': 0}], 'pg_upmap': [], 'pg_upmap_items': [], 'pg_temp': [], 'primary_temp': [], 'blocklist': {}, 'range_blocklist': {}, 'erasure_code_profiles': {'default': {'crush-failure-domain': 'osd', 'k': '2', 'm': '1', 'plugin': 'jerasure', 'technique': 'reed_sol_van'}}, 'removed_snaps_queue': [], 'new_removed_snaps': [], 'new_purged_snaps': [], 'crush_node_flags': {}, 'device_class_flags': {}, 'stretch_mode': {'stretch_mode_enabled': False, 'stretch_bucket_count': 0, 'degraded_stretch_mode': 0, 'recovering_stretch_mode': 0, 'stretch_mode_bucket': 0}} 2023-08-01T19:54:26.374 DEBUG:teuthology.orchestra.run.smithi006:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 120 ceph --cluster ceph pg dump --format=json 2023-08-01T19:54:26.374 INFO:tasks.radosbench.radosbench.0.smithi006.stdout: 2 16 8545 8529 266.515 255.062 0.0022824 0.00374443 2023-08-01T19:54:26.375 INFO:tasks.ceph.osd.2.smithi155.stderr:2023-08-01T19:54:26.371+0000 7faa5c6ac700 -1 received signal: Hangup from /usr/bin/python3 /bin/daemon-helper kill ceph-osd -f --cluster ceph -i 2 (PID: 111337) UID: 0 2023-08-01T19:54:26.460 INFO:teuthology.orchestra.run.smithi008.stdout:ERROR: (22) Invalid argument 2023-08-01T19:54:26.461 INFO:teuthology.orchestra.run.smithi008.stdout:op_tracker tracking is not enabled now, so no ops are tracked currently, even those get stuck. Please enable "osd_enable_op_tracker", and the tracker will start to track new ops received afterwards. 2023-08-01T19:54:26.473 DEBUG:teuthology.orchestra.run.smithi101:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 30 ceph --cluster ceph --admin-daemon /var/run/ceph/ceph-osd.1.asok dump_ops_in_flight 2023-08-01T19:54:26.474 INFO:tasks.ceph.osd.1.smithi101.stderr:2023-08-01T19:54:26.471+0000 7fb0cb7f6700 -1 received signal: Hangup from /usr/bin/python3 /bin/daemon-helper kill ceph-osd -f --cluster ceph -i 1 (PID: 111141) UID: 0 2023-08-01T19:54:26.573 INFO:tasks.ceph.osd.0.smithi008.stderr:2023-08-01T19:54:26.572+0000 7f16a58f4700 -1 received signal: Hangup from /usr/bin/python3 /bin/daemon-helper kill ceph-osd -f --cluster ceph -i 0 (PID: 111179) UID: 0 2023-08-01T19:54:26.634 INFO:teuthology.orchestra.run.smithi101.stdout:ERROR: (22) Invalid argument 2023-08-01T19:54:26.634 INFO:teuthology.orchestra.run.smithi101.stdout:op_tracker tracking is not enabled now, so no ops are tracked currently, even those get stuck. Please enable "osd_enable_op_tracker", and the tracker will start to track new ops received afterwards. 2023-08-01T19:54:26.648 DEBUG:teuthology.orchestra.run.smithi101:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 30 ceph --cluster ceph --admin-daemon /var/run/ceph/ceph-osd.1.asok dump_blocked_ops 2023-08-01T19:54:26.691 INFO:tasks.ceph.osd.1.smithi101.stderr:2023-08-01T19:54:26.690+0000 7fb0cb7f6700 -1 received signal: Hangup from /usr/bin/python3 /bin/daemon-helper kill ceph-osd -f --cluster ceph -i 1 (PID: 111141) UID: 0 2023-08-01T19:54:26.734 INFO:teuthology.orchestra.run.smithi006.stdout: 2023-08-01T19:54:26.735 INFO:teuthology.orchestra.run.smithi006.stderr:dumped all 2023-08-01T19:54:26.747 INFO:teuthology.orchestra.run.smithi006.stdout:{"pg_ready":true,"pg_map":{"version":37,"stamp":"2023-08-01T19:54:25.912267+0000","last_osdmap_epoch":0,"last_pg_scan":0,"pg_stats_sum":{"stat_sum":{"num_bytes":107416354,"num_objects":1654,"num_object_clones":0,"num_object_copies":3308,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":1654,"num_whiteouts":0,"num_read":136,"num_read_kb":118,"num_write":1878,"num_write_kb":107793,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":14,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"store_stats":{"total":0,"available":0,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},"log_size":1826,"ondisk_log_size":1826,"up":230,"acting":230,"num_store_stats":0},"osd_stats_sum":{"up_from":0,"seq":0,"num_pgs":215,"num_osds":3,"num_per_pool_osds":3,"num_per_pool_omap_osds":3,"kb":283115520,"kb_used":31424,"kb_used_data":680,"kb_used_omap":0,"kb_used_meta":30720,"kb_avail":283084096,"statfs":{"total":289910292480,"available":289878114304,"internally_reserved":0,"allocated":696320,"data_stored":1370489,"data_compressed":20662,"data_compressed_allocated":73728,"data_compressed_original":1146880,"omap_allocated":0,"internal_metadata":31457280},"hb_peers":[],"snap_trim_queue_len":0,"num_snap_trimming":0,"num_shards_repaired":0,"op_queue_age_hist":{"histogram":[],"upper_bound":1},"perf_stat":{"commit_latency_ms":2,"apply_latency_ms":2,"commit_latency_ns":2000000,"apply_latency_ns":2000000},"alerts":[],"network_ping_times":[]},"pg_stats_delta":{"stat_sum":{"num_bytes":106823680,"num_objects":1630,"num_object_clones":0,"num_object_copies":3260,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":1630,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":1630,"num_write_kb":104320,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"store_stats":{"total":0,"available":0,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},"log_size":0,"ondisk_log_size":0,"up":0,"acting":0,"num_store_stats":0,"stamp_delta":"4.000996"},"pg_stats":[{"pgid":"4.3f","version":"0'0","reported_seq":9,"reported_epoch":17,"state":"active+clean","last_fresh":"2023-08-01T19:54:04.477207+0000","last_change":"2023-08-01T19:54:04.473430+0000","last_active":"2023-08-01T19:54:04.477207+0000","last_peered":"2023-08-01T19:54:04.477207+0000","last_clean":"2023-08-01T19:54:04.477207+0000","last_became_active":"2023-08-01T19:54:04.472887+0000","last_became_peered":"2023-08-01T19:54:04.472887+0000","last_unstale":"2023-08-01T19:54:04.477207+0000","last_undegraded":"2023-08-01T19:54:04.477207+0000","last_fullsized":"2023-08-01T19:54:04.477207+0000","mapping_epoch":16,"log_start":"0'0","ondisk_log_start":"0'0","created":16,"last_epoch_clean":17,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-08-01T19:54:04.040663+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-08-01T19:54:04.040663+0000","last_clean_scrub_stamp":"2023-08-01T19:54:04.040663+0000","objects_scrubbed":0,"log_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-08-03T06:38:54.196605+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[2,0],"acting":[2,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":2,"acting_primary":2,"purged_snaps":[]},{"pgid":"4.3e","version":"0'0","reported_seq":9,"reported_epoch":17,"state":"active+clean","last_fresh":"2023-08-01T19:54:04.472547+0000","last_change":"2023-08-01T19:54:04.470501+0000","last_active":"2023-08-01T19:54:04.472547+0000","last_peered":"2023-08-01T19:54:04.472547+0000","last_clean":"2023-08-01T19:54:04.472547+0000","last_became_active":"2023-08-01T19:54:04.469692+0000","last_became_peered":"2023-08-01T19:54:04.469692+0000","last_unstale":"2023-08-01T19:54:04.472547+0000","last_undegraded":"2023-08-01T19:54:04.472547+0000","last_fullsized":"2023-08-01T19:54:04.472547+0000","mapping_epoch":16,"log_start":"0'0","ondisk_log_start":"0'0","created":16,"last_epoch_clean":17,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-08-01T19:54:04.040663+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-08-01T19:54:04.040663+0000","last_clean_scrub_stamp":"2023-08-01T19:54:04.040663+0000","objects_scrubbed":0,"log_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-08-03T02:19:35.201107+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[2,0],"acting":[2,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":2,"acting_primary":2,"purged_snaps":[]},{"pgid":"4.3d","version":"0'0","reported_seq":12,"reported_epoch":20,"state":"active+clean","last_fresh":"2023-08-01T19:54:23.132243+0000","last_change":"2023-08-01T19:54:04.472579+0000","last_active":"2023-08-01T19:54:23.132243+0000","last_peered":"2023-08-01T19:54:23.132243+0000","last_clean":"2023-08-01T19:54:23.132243+0000","last_became_active":"2023-08-01T19:54:04.471128+0000","last_became_peered":"2023-08-01T19:54:04.471128+0000","last_unstale":"2023-08-01T19:54:23.132243+0000","last_undegraded":"2023-08-01T19:54:23.132243+0000","last_fullsized":"2023-08-01T19:54:23.132243+0000","mapping_epoch":16,"log_start":"0'0","ondisk_log_start":"0'0","created":16,"last_epoch_clean":17,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-08-01T19:54:04.040663+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-08-01T19:54:04.040663+0000","last_clean_scrub_stamp":"2023-08-01T19:54:04.040663+0000","objects_scrubbed":0,"log_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-08-03T03:04:06.137335+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[1,2],"acting":[1,2],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":1,"acting_primary":1,"purged_snaps":[]},{"pgid":"4.3c","version":"0'0","reported_seq":12,"reported_epoch":20,"state":"active+clean","last_fresh":"2023-08-01T19:54:23.131838+0000","last_change":"2023-08-01T19:54:04.477908+0000","last_active":"2023-08-01T19:54:23.131838+0000","last_peered":"2023-08-01T19:54:23.131838+0000","last_clean":"2023-08-01T19:54:23.131838+0000","last_became_active":"2023-08-01T19:54:04.476684+0000","last_became_peered":"2023-08-01T19:54:04.476684+0000","last_unstale":"2023-08-01T19:54:23.131838+0000","last_undegraded":"2023-08-01T19:54:23.131838+0000","last_fullsized":"2023-08-01T19:54:23.131838+0000","mapping_epoch":16,"log_start":"0'0","ondisk_log_start":"0'0","created":16,"last_epoch_clean":17,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-08-01T19:54:04.040663+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-08-01T19:54:04.040663+0000","last_clean_scrub_stamp":"2023-08-01T19:54:04.040663+0000","objects_scrubbed":0,"log_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-08-03T03:56:55.336461+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[1,0],"acting":[1,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":1,"acting_primary":1,"purged_snaps":[]},{"pgid":"4.3b","version":"0'0","reported_seq":9,"reported_epoch":17,"state":"active+clean","last_fresh":"2023-08-01T19:54:04.469848+0000","last_change":"2023-08-01T19:54:04.467197+0000","last_active":"2023-08-01T19:54:04.469848+0000","last_peered":"2023-08-01T19:54:04.469848+0000","last_clean":"2023-08-01T19:54:04.469848+0000","last_became_active":"2023-08-01T19:54:04.466526+0000","last_became_peered":"2023-08-01T19:54:04.466526+0000","last_unstale":"2023-08-01T19:54:04.469848+0000","last_undegraded":"2023-08-01T19:54:04.469848+0000","last_fullsized":"2023-08-01T19:54:04.469848+0000","mapping_epoch":16,"log_start":"0'0","ondisk_log_start":"0'0","created":16,"last_epoch_clean":17,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-08-01T19:54:04.040663+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-08-01T19:54:04.040663+0000","last_clean_scrub_stamp":"2023-08-01T19:54:04.040663+0000","objects_scrubbed":0,"log_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-08-03T06:54:18.982174+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[2,0],"acting":[2,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":2,"acting_primary":2,"purged_snaps":[]},{"pgid":"4.3a","version":"0'0","reported_seq":12,"reported_epoch":20,"state":"active+clean","last_fresh":"2023-08-01T19:54:23.131742+0000","last_change":"2023-08-01T19:54:04.473296+0000","last_active":"2023-08-01T19:54:23.131742+0000","last_peered":"2023-08-01T19:54:23.131742+0000","last_clean":"2023-08-01T19:54:23.131742+0000","last_became_active":"2023-08-01T19:54:04.472324+0000","last_became_peered":"2023-08-01T19:54:04.472324+0000","last_unstale":"2023-08-01T19:54:23.131742+0000","last_undegraded":"2023-08-01T19:54:23.131742+0000","last_fullsized":"2023-08-01T19:54:23.131742+0000","mapping_epoch":16,"log_start":"0'0","ondisk_log_start":"0'0","created":16,"last_epoch_clean":17,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-08-01T19:54:04.040663+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-08-01T19:54:04.040663+0000","last_clean_scrub_stamp":"2023-08-01T19:54:04.040663+0000","objects_scrubbed":0,"log_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-08-02T23:15:11.148662+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[1,0],"acting":[1,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":1,"acting_primary":1,"purged_snaps":[]},{"pgid":"4.39","version":"0'0","reported_seq":12,"reported_epoch":20,"state":"active+clean","last_fresh":"2023-08-01T19:54:23.132044+0000","last_change":"2023-08-01T19:54:04.475322+0000","last_active":"2023-08-01T19:54:23.132044+0000","last_peered":"2023-08-01T19:54:23.132044+0000","last_clean":"2023-08-01T19:54:23.132044+0000","last_became_active":"2023-08-01T19:54:04.474591+0000","last_became_peered":"2023-08-01T19:54:04.474591+0000","last_unstale":"2023-08-01T19:54:23.132044+0000","last_undegraded":"2023-08-01T19:54:23.132044+0000","last_fullsized":"2023-08-01T19:54:23.132044+0000","mapping_epoch":16,"log_start":"0'0","ondisk_log_start":"0'0","created":16,"last_epoch_clean":17,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-08-01T19:54:04.040663+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-08-01T19:54:04.040663+0000","last_clean_scrub_stamp":"2023-08-01T19:54:04.040663+0000","objects_scrubbed":0,"log_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-08-03T00:29:53.554989+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[1,0],"acting":[1,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":1,"acting_primary":1,"purged_snaps":[]},{"pgid":"4.38","version":"0'0","reported_seq":12,"reported_epoch":20,"state":"active+clean","last_fresh":"2023-08-01T19:54:23.131230+0000","last_change":"2023-08-01T19:54:04.478505+0000","last_active":"2023-08-01T19:54:23.131230+0000","last_peered":"2023-08-01T19:54:23.131230+0000","last_clean":"2023-08-01T19:54:23.131230+0000","last_became_active":"2023-08-01T19:54:04.477325+0000","last_became_peered":"2023-08-01T19:54:04.477325+0000","last_unstale":"2023-08-01T19:54:23.131230+0000","last_undegraded":"2023-08-01T19:54:23.131230+0000","last_fullsized":"2023-08-01T19:54:23.131230+0000","mapping_epoch":16,"log_start":"0'0","ondisk_log_start":"0'0","created":16,"last_epoch_clean":17,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-08-01T19:54:04.040663+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-08-01T19:54:04.040663+0000","last_clean_scrub_stamp":"2023-08-01T19:54:04.040663+0000","objects_scrubbed":0,"log_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-08-03T01:38:12.939736+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[1,0],"acting":[1,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":1,"acting_primary":1,"purged_snaps":[]},{"pgid":"4.37","version":"0'0","reported_seq":12,"reported_epoch":20,"state":"active+clean","last_fresh":"2023-08-01T19:54:23.136595+0000","last_change":"2023-08-01T19:54:04.470971+0000","last_active":"2023-08-01T19:54:23.136595+0000","last_peered":"2023-08-01T19:54:23.136595+0000","last_clean":"2023-08-01T19:54:23.136595+0000","last_became_active":"2023-08-01T19:54:04.469011+0000","last_became_peered":"2023-08-01T19:54:04.469011+0000","last_unstale":"2023-08-01T19:54:23.136595+0000","last_undegraded":"2023-08-01T19:54:23.136595+0000","last_fullsized":"2023-08-01T19:54:23.136595+0000","mapping_epoch":16,"log_start":"0'0","ondisk_log_start":"0'0","created":16,"last_epoch_clean":17,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-08-01T19:54:04.040663+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-08-01T19:54:04.040663+0000","last_clean_scrub_stamp":"2023-08-01T19:54:04.040663+0000","objects_scrubbed":0,"log_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-08-03T06:50:03.420334+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[0,2],"acting":[0,2],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":0,"acting_primary":0,"purged_snaps":[]},{"pgid":"4.36","version":"0'0","reported_seq":9,"reported_epoch":17,"state":"active+clean","last_fresh":"2023-08-01T19:54:04.477220+0000","last_change":"2023-08-01T19:54:04.473523+0000","last_active":"2023-08-01T19:54:04.477220+0000","last_peered":"2023-08-01T19:54:04.477220+0000","last_clean":"2023-08-01T19:54:04.477220+0000","last_became_active":"2023-08-01T19:54:04.473084+0000","last_became_peered":"2023-08-01T19:54:04.473084+0000","last_unstale":"2023-08-01T19:54:04.477220+0000","last_undegraded":"2023-08-01T19:54:04.477220+0000","last_fullsized":"2023-08-01T19:54:04.477220+0000","mapping_epoch":16,"log_start":"0'0","ondisk_log_start":"0'0","created":16,"last_epoch_clean":17,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-08-01T19:54:04.040663+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-08-01T19:54:04.040663+0000","last_clean_scrub_stamp":"2023-08-01T19:54:04.040663+0000","objects_scrubbed":0,"log_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-08-03T04:28:59.042443+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[2,0],"acting":[2,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":2,"acting_primary":2,"purged_snaps":[]},{"pgid":"4.35","version":"0'0","reported_seq":12,"reported_epoch":20,"state":"active+clean","last_fresh":"2023-08-01T19:54:23.132136+0000","last_change":"2023-08-01T19:54:04.475816+0000","last_active":"2023-08-01T19:54:23.132136+0000","last_peered":"2023-08-01T19:54:23.132136+0000","last_clean":"2023-08-01T19:54:23.132136+0000","last_became_active":"2023-08-01T19:54:04.475061+0000","last_became_peered":"2023-08-01T19:54:04.475061+0000","last_unstale":"2023-08-01T19:54:23.132136+0000","last_undegraded":"2023-08-01T19:54:23.132136+0000","last_fullsized":"2023-08-01T19:54:23.132136+0000","mapping_epoch":16,"log_start":"0'0","ondisk_log_start":"0'0","created":16,"last_epoch_clean":17,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-08-01T19:54:04.040663+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-08-01T19:54:04.040663+0000","last_clean_scrub_stamp":"2023-08-01T19:54:04.040663+0000","objects_scrubbed":0,"log_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-08-02T22:07:41.305488+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[1,0],"acting":[1,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":1,"acting_primary":1,"purged_snaps":[]},{"pgid":"4.34","version":"0'0","reported_seq":9,"reported_epoch":17,"state":"active+clean","last_fresh":"2023-08-01T19:54:04.470323+0000","last_change":"2023-08-01T19:54:04.468009+0000","last_active":"2023-08-01T19:54:04.470323+0000","last_peered":"2023-08-01T19:54:04.470323+0000","last_clean":"2023-08-01T19:54:04.470323+0000","last_became_active":"2023-08-01T19:54:04.467568+0000","last_became_peered":"2023-08-01T19:54:04.467568+0000","last_unstale":"2023-08-01T19:54:04.470323+0000","last_undegraded":"2023-08-01T19:54:04.470323+0000","last_fullsized":"2023-08-01T19:54:04.470323+0000","mapping_epoch":16,"log_start":"0'0","ondisk_log_start":"0'0","created":16,"last_epoch_clean":17,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-08-01T19:54:04.040663+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-08-01T19:54:04.040663+0000","last_clean_scrub_stamp":"2023-08-01T19:54:04.040663+0000","objects_scrubbed":0,"log_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-08-03T04:53:44.017572+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[2,1],"acting":[2,1],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":2,"acting_primary":2,"purged_snaps":[]},{"pgid":"4.33","version":"0'0","reported_seq":9,"reported_epoch":17,"state":"active+clean","last_fresh":"2023-08-01T19:54:04.468611+0000","last_change":"2023-08-01T19:54:04.466770+0000","last_active":"2023-08-01T19:54:04.468611+0000","last_peered":"2023-08-01T19:54:04.468611+0000","last_clean":"2023-08-01T19:54:04.468611+0000","last_became_active":"2023-08-01T19:54:04.466460+0000","last_became_peered":"2023-08-01T19:54:04.466460+0000","last_unstale":"2023-08-01T19:54:04.468611+0000","last_undegraded":"2023-08-01T19:54:04.468611+0000","last_fullsized":"2023-08-01T19:54:04.468611+0000","mapping_epoch":16,"log_start":"0'0","ondisk_log_start":"0'0","created":16,"last_epoch_clean":17,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-08-01T19:54:04.040663+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-08-01T19:54:04.040663+0000","last_clean_scrub_stamp":"2023-08-01T19:54:04.040663+0000","objects_scrubbed":0,"log_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-08-03T06:04:11.595951+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[2,0],"acting":[2,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":2,"acting_primary":2,"purged_snaps":[]},{"pgid":"4.32","version":"0'0","reported_seq":12,"reported_epoch":20,"state":"active+clean","last_fresh":"2023-08-01T19:54:23.132014+0000","last_change":"2023-08-01T19:54:04.466634+0000","last_active":"2023-08-01T19:54:23.132014+0000","last_peered":"2023-08-01T19:54:23.132014+0000","last_clean":"2023-08-01T19:54:23.132014+0000","last_became_active":"2023-08-01T19:54:04.466302+0000","last_became_peered":"2023-08-01T19:54:04.466302+0000","last_unstale":"2023-08-01T19:54:23.132014+0000","last_undegraded":"2023-08-01T19:54:23.132014+0000","last_fullsized":"2023-08-01T19:54:23.132014+0000","mapping_epoch":16,"log_start":"0'0","ondisk_log_start":"0'0","created":16,"last_epoch_clean":17,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-08-01T19:54:04.040663+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-08-01T19:54:04.040663+0000","last_clean_scrub_stamp":"2023-08-01T19:54:04.040663+0000","objects_scrubbed":0,"log_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-08-03T05:46:11.085577+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[1,2],"acting":[1,2],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":1,"acting_primary":1,"purged_snaps":[]},{"pgid":"4.31","version":"0'0","reported_seq":12,"reported_epoch":20,"state":"active+clean","last_fresh":"2023-08-01T19:54:23.131843+0000","last_change":"2023-08-01T19:54:04.472407+0000","last_active":"2023-08-01T19:54:23.131843+0000","last_peered":"2023-08-01T19:54:23.131843+0000","last_clean":"2023-08-01T19:54:23.131843+0000","last_became_active":"2023-08-01T19:54:04.472008+0000","last_became_peered":"2023-08-01T19:54:04.472008+0000","last_unstale":"2023-08-01T19:54:23.131843+0000","last_undegraded":"2023-08-01T19:54:23.131843+0000","last_fullsized":"2023-08-01T19:54:23.131843+0000","mapping_epoch":16,"log_start":"0'0","ondisk_log_start":"0'0","created":16,"last_epoch_clean":17,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-08-01T19:54:04.040663+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-08-01T19:54:04.040663+0000","last_clean_scrub_stamp":"2023-08-01T19:54:04.040663+0000","objects_scrubbed":0,"log_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-08-02T22:42:25.293502+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[1,2],"acting":[1,2],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":1,"acting_primary":1,"purged_snaps":[]},{"pgid":"4.30","version":"0'0","reported_seq":12,"reported_epoch":20,"state":"active+clean","last_fresh":"2023-08-01T19:54:23.131519+0000","last_change":"2023-08-01T19:54:04.478283+0000","last_active":"2023-08-01T19:54:23.131519+0000","last_peered":"2023-08-01T19:54:23.131519+0000","last_clean":"2023-08-01T19:54:23.131519+0000","last_became_active":"2023-08-01T19:54:04.476620+0000","last_became_peered":"2023-08-01T19:54:04.476620+0000","last_unstale":"2023-08-01T19:54:23.131519+0000","last_undegraded":"2023-08-01T19:54:23.131519+0000","last_fullsized":"2023-08-01T19:54:23.131519+0000","mapping_epoch":16,"log_start":"0'0","ondisk_log_start":"0'0","created":16,"last_epoch_clean":17,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-08-01T19:54:04.040663+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-08-01T19:54:04.040663+0000","last_clean_scrub_stamp":"2023-08-01T19:54:04.040663+0000","objects_scrubbed":0,"log_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-08-03T02:27:17.063518+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[1,0],"acting":[1,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":1,"acting_primary":1,"purged_snaps":[]},{"pgid":"4.2f","version":"0'0","reported_seq":12,"reported_epoch":20,"state":"active+clean","last_fresh":"2023-08-01T19:54:23.136673+0000","last_change":"2023-08-01T19:54:04.470302+0000","last_active":"2023-08-01T19:54:23.136673+0000","last_peered":"2023-08-01T19:54:23.136673+0000","last_clean":"2023-08-01T19:54:23.136673+0000","last_became_active":"2023-08-01T19:54:04.468919+0000","last_became_peered":"2023-08-01T19:54:04.468919+0000","last_unstale":"2023-08-01T19:54:23.136673+0000","last_undegraded":"2023-08-01T19:54:23.136673+0000","last_fullsized":"2023-08-01T19:54:23.136673+0000","mapping_epoch":16,"log_start":"0'0","ondisk_log_start":"0'0","created":16,"last_epoch_clean":17,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-08-01T19:54:04.040663+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-08-01T19:54:04.040663+0000","last_clean_scrub_stamp":"2023-08-01T19:54:04.040663+0000","objects_scrubbed":0,"log_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-08-02T22:42:25.293502+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[0,2],"acting":[0,2],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":0,"acting_primary":0,"purged_snaps":[]},{"pgid":"4.2e","version":"0'0","reported_seq":9,"reported_epoch":17,"state":"active+clean","last_fresh":"2023-08-01T19:54:04.477303+0000","last_change":"2023-08-01T19:54:04.474058+0000","last_active":"2023-08-01T19:54:04.477303+0000","last_peered":"2023-08-01T19:54:04.477303+0000","last_clean":"2023-08-01T19:54:04.477303+0000","last_became_active":"2023-08-01T19:54:04.473355+0000","last_became_peered":"2023-08-01T19:54:04.473355+0000","last_unstale":"2023-08-01T19:54:04.477303+0000","last_undegraded":"2023-08-01T19:54:04.477303+0000","last_fullsized":"2023-08-01T19:54:04.477303+0000","mapping_epoch":16,"log_start":"0'0","ondisk_log_start":"0'0","created":16,"last_epoch_clean":17,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-08-01T19:54:04.040663+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-08-01T19:54:04.040663+0000","last_clean_scrub_stamp":"2023-08-01T19:54:04.040663+0000","objects_scrubbed":0,"log_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-08-03T04:55:54.197252+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[2,0],"acting":[2,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":2,"acting_primary":2,"purged_snaps":[]},{"pgid":"4.2d","version":"0'0","reported_seq":12,"reported_epoch":20,"state":"active+clean","last_fresh":"2023-08-01T19:54:23.136465+0000","last_change":"2023-08-01T19:54:04.468775+0000","last_active":"2023-08-01T19:54:23.136465+0000","last_peered":"2023-08-01T19:54:23.136465+0000","last_clean":"2023-08-01T19:54:23.136465+0000","last_became_active":"2023-08-01T19:54:04.467274+0000","last_became_peered":"2023-08-01T19:54:04.467274+0000","last_unstale":"2023-08-01T19:54:23.136465+0000","last_undegraded":"2023-08-01T19:54:23.136465+0000","last_fullsized":"2023-08-01T19:54:23.136465+0000","mapping_epoch":16,"log_start":"0'0","ondisk_log_start":"0'0","created":16,"last_epoch_clean":17,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-08-01T19:54:04.040663+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-08-01T19:54:04.040663+0000","last_clean_scrub_stamp":"2023-08-01T19:54:04.040663+0000","objects_scrubbed":0,"log_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-08-02T23:00:37.537286+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[0,2],"acting":[0,2],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":0,"acting_primary":0,"purged_snaps":[]},{"pgid":"4.2c","version":"0'0","reported_seq":12,"reported_epoch":20,"state":"active+clean","last_fresh":"2023-08-01T19:54:23.131783+0000","last_change":"2023-08-01T19:54:04.478409+0000","last_active":"2023-08-01T19:54:23.131783+0000","last_peered":"2023-08-01T19:54:23.131783+0000","last_clean":"2023-08-01T19:54:23.131783+0000","last_became_active":"2023-08-01T19:54:04.477133+0000","last_became_peered":"2023-08-01T19:54:04.477133+0000","last_unstale":"2023-08-01T19:54:23.131783+0000","last_undegraded":"2023-08-01T19:54:23.131783+0000","last_fullsized":"2023-08-01T19:54:23.131783+0000","mapping_epoch":16,"log_start":"0'0","ondisk_log_start":"0'0","created":16,"last_epoch_clean":17,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-08-01T19:54:04.040663+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-08-01T19:54:04.040663+0000","last_clean_scrub_stamp":"2023-08-01T19:54:04.040663+0000","objects_scrubbed":0,"log_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-08-02T22:15:19.744281+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[1,0],"acting":[1,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":1,"acting_primary":1,"purged_snaps":[]},{"pgid":"4.2b","version":"0'0","reported_seq":12,"reported_epoch":20,"state":"active+clean","last_fresh":"2023-08-01T19:54:23.131819+0000","last_change":"2023-08-01T19:54:04.474047+0000","last_active":"2023-08-01T19:54:23.131819+0000","last_peered":"2023-08-01T19:54:23.131819+0000","last_clean":"2023-08-01T19:54:23.131819+0000","last_became_active":"2023-08-01T19:54:04.473578+0000","last_became_peered":"2023-08-01T19:54:04.473578+0000","last_unstale":"2023-08-01T19:54:23.131819+0000","last_undegraded":"2023-08-01T19:54:23.131819+0000","last_fullsized":"2023-08-01T19:54:23.131819+0000","mapping_epoch":16,"log_start":"0'0","ondisk_log_start":"0'0","created":16,"last_epoch_clean":17,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-08-01T19:54:04.040663+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-08-01T19:54:04.040663+0000","last_clean_scrub_stamp":"2023-08-01T19:54:04.040663+0000","objects_scrubbed":0,"log_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-08-03T05:39:29.199142+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[1,0],"acting":[1,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":1,"acting_primary":1,"purged_snaps":[]},{"pgid":"4.2a","version":"0'0","reported_seq":9,"reported_epoch":17,"state":"active+clean","last_fresh":"2023-08-01T19:54:04.470833+0000","last_change":"2023-08-01T19:54:04.469281+0000","last_active":"2023-08-01T19:54:04.470833+0000","last_peered":"2023-08-01T19:54:04.470833+0000","last_clean":"2023-08-01T19:54:04.470833+0000","last_became_active":"2023-08-01T19:54:04.468771+0000","last_became_peered":"2023-08-01T19:54:04.468771+0000","last_unstale":"2023-08-01T19:54:04.470833+0000","last_undegraded":"2023-08-01T19:54:04.470833+0000","last_fullsized":"2023-08-01T19:54:04.470833+0000","mapping_epoch":16,"log_start":"0'0","ondisk_log_start":"0'0","created":16,"last_epoch_clean":17,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-08-01T19:54:04.040663+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-08-01T19:54:04.040663+0000","last_clean_scrub_stamp":"2023-08-01T19:54:04.040663+0000","objects_scrubbed":0,"log_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-08-03T01:15:27.748810+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[2,1],"acting":[2,1],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":2,"acting_primary":2,"purged_snaps":[]},{"pgid":"4.29","version":"0'0","reported_seq":12,"reported_epoch":20,"state":"active+clean","last_fresh":"2023-08-01T19:54:23.135878+0000","last_change":"2023-08-01T19:54:04.466694+0000","last_active":"2023-08-01T19:54:23.135878+0000","last_peered":"2023-08-01T19:54:23.135878+0000","last_clean":"2023-08-01T19:54:23.135878+0000","last_became_active":"2023-08-01T19:54:04.466250+0000","last_became_peered":"2023-08-01T19:54:04.466250+0000","last_unstale":"2023-08-01T19:54:23.135878+0000","last_undegraded":"2023-08-01T19:54:23.135878+0000","last_fullsized":"2023-08-01T19:54:23.135878+0000","mapping_epoch":16,"log_start":"0'0","ondisk_log_start":"0'0","created":16,"last_epoch_clean":17,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-08-01T19:54:04.040663+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-08-01T19:54:04.040663+0000","last_clean_scrub_stamp":"2023-08-01T19:54:04.040663+0000","objects_scrubbed":0,"log_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-08-03T01:00:18.725898+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[0,1],"acting":[0,1],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":0,"acting_primary":0,"purged_snaps":[]},{"pgid":"4.28","version":"0'0","reported_seq":9,"reported_epoch":17,"state":"active+clean","last_fresh":"2023-08-01T19:54:04.470337+0000","last_change":"2023-08-01T19:54:04.468160+0000","last_active":"2023-08-01T19:54:04.470337+0000","last_peered":"2023-08-01T19:54:04.470337+0000","last_clean":"2023-08-01T19:54:04.470337+0000","last_became_active":"2023-08-01T19:54:04.467625+0000","last_became_peered":"2023-08-01T19:54:04.467625+0000","last_unstale":"2023-08-01T19:54:04.470337+0000","last_undegraded":"2023-08-01T19:54:04.470337+0000","last_fullsized":"2023-08-01T19:54:04.470337+0000","mapping_epoch":16,"log_start":"0'0","ondisk_log_start":"0'0","created":16,"last_epoch_clean":17,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-08-01T19:54:04.040663+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-08-01T19:54:04.040663+0000","last_clean_scrub_stamp":"2023-08-01T19:54:04.040663+0000","objects_scrubbed":0,"log_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-08-02T21:27:52.506153+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[2,0],"acting":[2,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":2,"acting_primary":2,"purged_snaps":[]},{"pgid":"4.27","version":"0'0","reported_seq":9,"reported_epoch":17,"state":"active+clean","last_fresh":"2023-08-01T19:54:04.470777+0000","last_change":"2023-08-01T19:54:04.469187+0000","last_active":"2023-08-01T19:54:04.470777+0000","last_peered":"2023-08-01T19:54:04.470777+0000","last_clean":"2023-08-01T19:54:04.470777+0000","last_became_active":"2023-08-01T19:54:04.468628+0000","last_became_peered":"2023-08-01T19:54:04.468628+0000","last_unstale":"2023-08-01T19:54:04.470777+0000","last_undegraded":"2023-08-01T19:54:04.470777+0000","last_fullsized":"2023-08-01T19:54:04.470777+0000","mapping_epoch":16,"log_start":"0'0","ondisk_log_start":"0'0","created":16,"last_epoch_clean":17,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-08-01T19:54:04.040663+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-08-01T19:54:04.040663+0000","last_clean_scrub_stamp":"2023-08-01T19:54:04.040663+0000","objects_scrubbed":0,"log_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-08-03T00:07:29.565677+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[2,1],"acting":[2,1],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":2,"acting_primary":2,"purged_snaps":[]},{"pgid":"4.26","version":"0'0","reported_seq":12,"reported_epoch":20,"state":"active+clean","last_fresh":"2023-08-01T19:54:23.136524+0000","last_change":"2023-08-01T19:54:04.470942+0000","last_active":"2023-08-01T19:54:23.136524+0000","last_peered":"2023-08-01T19:54:23.136524+0000","last_clean":"2023-08-01T19:54:23.136524+0000","last_became_active":"2023-08-01T19:54:04.470564+0000","last_became_peered":"2023-08-01T19:54:04.470564+0000","last_unstale":"2023-08-01T19:54:23.136524+0000","last_undegraded":"2023-08-01T19:54:23.136524+0000","last_fullsized":"2023-08-01T19:54:23.136524+0000","mapping_epoch":16,"log_start":"0'0","ondisk_log_start":"0'0","created":16,"last_epoch_clean":17,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-08-01T19:54:04.040663+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-08-01T19:54:04.040663+0000","last_clean_scrub_stamp":"2023-08-01T19:54:04.040663+0000","objects_scrubbed":0,"log_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-08-03T04:43:21.408174+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[0,1],"acting":[0,1],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":0,"acting_primary":0,"purged_snaps":[]},{"pgid":"4.25","version":"0'0","reported_seq":12,"reported_epoch":20,"state":"active+clean","last_fresh":"2023-08-01T19:54:23.132160+0000","last_change":"2023-08-01T19:54:04.474813+0000","last_active":"2023-08-01T19:54:23.132160+0000","last_peered":"2023-08-01T19:54:23.132160+0000","last_clean":"2023-08-01T19:54:23.132160+0000","last_became_active":"2023-08-01T19:54:04.472530+0000","last_became_peered":"2023-08-01T19:54:04.472530+0000","last_unstale":"2023-08-01T19:54:23.132160+0000","last_undegraded":"2023-08-01T19:54:23.132160+0000","last_fullsized":"2023-08-01T19:54:23.132160+0000","mapping_epoch":16,"log_start":"0'0","ondisk_log_start":"0'0","created":16,"last_epoch_clean":17,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-08-01T19:54:04.040663+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-08-01T19:54:04.040663+0000","last_clean_scrub_stamp":"2023-08-01T19:54:04.040663+0000","objects_scrubbed":0,"log_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-08-03T01:00:18.725898+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[1,2],"acting":[1,2],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":1,"acting_primary":1,"purged_snaps":[]},{"pgid":"3.1a","version":"17'1","reported_seq":11,"reported_epoch":17,"state":"active+clean","last_fresh":"2023-08-01T19:54:04.473081+0000","last_change":"2023-08-01T19:54:04.063936+0000","last_active":"2023-08-01T19:54:04.473081+0000","last_peered":"2023-08-01T19:54:04.473081+0000","last_clean":"2023-08-01T19:54:04.473081+0000","last_became_active":"2023-08-01T19:54:04.063674+0000","last_became_peered":"2023-08-01T19:54:04.063674+0000","last_unstale":"2023-08-01T19:54:04.473081+0000","last_undegraded":"2023-08-01T19:54:04.473081+0000","last_fullsized":"2023-08-01T19:54:04.473081+0000","mapping_epoch":15,"log_start":"0'0","ondisk_log_start":"0'0","created":15,"last_epoch_clean":16,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-08-01T19:54:03.032665+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-08-01T19:54:03.032665+0000","last_clean_scrub_stamp":"2023-08-01T19:54:03.032665+0000","objects_scrubbed":0,"log_size":1,"ondisk_log_size":1,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-08-03T00:06:00.058200+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[2,0],"acting":[2,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":2,"acting_primary":2,"purged_snaps":[]},{"pgid":"4.1d","version":"0'0","reported_seq":9,"reported_epoch":17,"state":"active+clean","last_fresh":"2023-08-01T19:54:04.474051+0000","last_change":"2023-08-01T19:54:04.471916+0000","last_active":"2023-08-01T19:54:04.474051+0000","last_peered":"2023-08-01T19:54:04.474051+0000","last_clean":"2023-08-01T19:54:04.474051+0000","last_became_active":"2023-08-01T19:54:04.471480+0000","last_became_peered":"2023-08-01T19:54:04.471480+0000","last_unstale":"2023-08-01T19:54:04.474051+0000","last_undegraded":"2023-08-01T19:54:04.474051+0000","last_fullsized":"2023-08-01T19:54:04.474051+0000","mapping_epoch":16,"log_start":"0'0","ondisk_log_start":"0'0","created":16,"last_epoch_clean":17,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-08-01T19:54:04.040663+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-08-01T19:54:04.040663+0000","last_clean_scrub_stamp":"2023-08-01T19:54:04.040663+0000","objects_scrubbed":0,"log_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-08-02T21:19:17.547590+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[2,1],"acting":[2,1],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":2,"acting_primary":2,"purged_snaps":[]},{"pgid":"3.19","version":"0'0","reported_seq":13,"reported_epoch":20,"state":"active+clean","last_fresh":"2023-08-01T19:54:23.136030+0000","last_change":"2023-08-01T19:54:04.067837+0000","last_active":"2023-08-01T19:54:23.136030+0000","last_peered":"2023-08-01T19:54:23.136030+0000","last_clean":"2023-08-01T19:54:23.136030+0000","last_became_active":"2023-08-01T19:54:04.067535+0000","last_became_peered":"2023-08-01T19:54:04.067535+0000","last_unstale":"2023-08-01T19:54:23.136030+0000","last_undegraded":"2023-08-01T19:54:23.136030+0000","last_fullsized":"2023-08-01T19:54:23.136030+0000","mapping_epoch":15,"log_start":"0'0","ondisk_log_start":"0'0","created":15,"last_epoch_clean":16,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-08-01T19:54:03.032665+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-08-01T19:54:03.032665+0000","last_clean_scrub_stamp":"2023-08-01T19:54:03.032665+0000","objects_scrubbed":0,"log_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-08-02T20:56:47.324761+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[0,1],"acting":[0,1],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":0,"acting_primary":0,"purged_snaps":[]},{"pgid":"4.1e","version":"0'0","reported_seq":12,"reported_epoch":20,"state":"active+clean","last_fresh":"2023-08-01T19:54:23.136786+0000","last_change":"2023-08-01T19:54:04.470544+0000","last_active":"2023-08-01T19:54:23.136786+0000","last_peered":"2023-08-01T19:54:23.136786+0000","last_clean":"2023-08-01T19:54:23.136786+0000","last_became_active":"2023-08-01T19:54:04.469657+0000","last_became_peered":"2023-08-01T19:54:04.469657+0000","last_unstale":"2023-08-01T19:54:23.136786+0000","last_undegraded":"2023-08-01T19:54:23.136786+0000","last_fullsized":"2023-08-01T19:54:23.136786+0000","mapping_epoch":16,"log_start":"0'0","ondisk_log_start":"0'0","created":16,"last_epoch_clean":17,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-08-01T19:54:04.040663+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-08-01T19:54:04.040663+0000","last_clean_scrub_stamp":"2023-08-01T19:54:04.040663+0000","objects_scrubbed":0,"log_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-08-02T23:12:30.830199+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[0,1],"acting":[0,1],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":0,"acting_primary":0,"purged_snaps":[]},{"pgid":"3.18","version":"0'0","reported_seq":13,"reported_epoch":20,"state":"active+clean","last_fresh":"2023-08-01T19:54:23.135608+0000","last_change":"2023-08-01T19:54:04.064289+0000","last_active":"2023-08-01T19:54:23.135608+0000","last_peered":"2023-08-01T19:54:23.135608+0000","last_clean":"2023-08-01T19:54:23.135608+0000","last_became_active":"2023-08-01T19:54:04.063971+0000","last_became_peered":"2023-08-01T19:54:04.063971+0000","last_unstale":"2023-08-01T19:54:23.135608+0000","last_undegraded":"2023-08-01T19:54:23.135608+0000","last_fullsized":"2023-08-01T19:54:23.135608+0000","mapping_epoch":15,"log_start":"0'0","ondisk_log_start":"0'0","created":15,"last_epoch_clean":16,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-08-01T19:54:03.032665+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-08-01T19:54:03.032665+0000","last_clean_scrub_stamp":"2023-08-01T19:54:03.032665+0000","objects_scrubbed":0,"log_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-08-03T04:09:30.496098+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[0,2],"acting":[0,2],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":0,"acting_primary":0,"purged_snaps":[]},{"pgid":"4.1f","version":"0'0","reported_seq":9,"reported_epoch":17,"state":"active+clean","last_fresh":"2023-08-01T19:54:04.474406+0000","last_change":"2023-08-01T19:54:04.472227+0000","last_active":"2023-08-01T19:54:04.474406+0000","last_peered":"2023-08-01T19:54:04.474406+0000","last_clean":"2023-08-01T19:54:04.474406+0000","last_became_active":"2023-08-01T19:54:04.471767+0000","last_became_peered":"2023-08-01T19:54:04.471767+0000","last_unstale":"2023-08-01T19:54:04.474406+0000","last_undegraded":"2023-08-01T19:54:04.474406+0000","last_fullsized":"2023-08-01T19:54:04.474406+0000","mapping_epoch":16,"log_start":"0'0","ondisk_log_start":"0'0","created":16,"last_epoch_clean":17,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-08-01T19:54:04.040663+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-08-01T19:54:04.040663+0000","last_clean_scrub_stamp":"2023-08-01T19:54:04.040663+0000","objects_scrubbed":0,"log_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-08-02T20:25:25.280329+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[2,1],"acting":[2,1],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":2,"acting_primary":2,"purged_snaps":[]},{"pgid":"3.17","version":"0'0","reported_seq":13,"reported_epoch":20,"state":"active+clean","last_fresh":"2023-08-01T19:54:23.136874+0000","last_change":"2023-08-01T19:54:04.067975+0000","last_active":"2023-08-01T19:54:23.136874+0000","last_peered":"2023-08-01T19:54:23.136874+0000","last_clean":"2023-08-01T19:54:23.136874+0000","last_became_active":"2023-08-01T19:54:04.067577+0000","last_became_peered":"2023-08-01T19:54:04.067577+0000","last_unstale":"2023-08-01T19:54:23.136874+0000","last_undegraded":"2023-08-01T19:54:23.136874+0000","last_fullsized":"2023-08-01T19:54:23.136874+0000","mapping_epoch":15,"log_start":"0'0","ondisk_log_start":"0'0","created":15,"last_epoch_clean":16,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-08-01T19:54:03.032665+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-08-01T19:54:03.032665+0000","last_clean_scrub_stamp":"2023-08-01T19:54:03.032665+0000","objects_scrubbed":0,"log_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-08-03T07:13:34.025722+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[0,1],"acting":[0,1],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":0,"acting_primary":0,"purged_snaps":[]},{"pgid":"4.10","version":"0'0","reported_seq":12,"reported_epoch":20,"state":"active+clean","last_fresh":"2023-08-01T19:54:23.135490+0000","last_change":"2023-08-01T19:54:04.467146+0000","last_active":"2023-08-01T19:54:23.135490+0000","last_peered":"2023-08-01T19:54:23.135490+0000","last_clean":"2023-08-01T19:54:23.135490+0000","last_became_active":"2023-08-01T19:54:04.466627+0000","last_became_peered":"2023-08-01T19:54:04.466627+0000","last_unstale":"2023-08-01T19:54:23.135490+0000","last_undegraded":"2023-08-01T19:54:23.135490+0000","last_fullsized":"2023-08-01T19:54:23.135490+0000","mapping_epoch":16,"log_start":"0'0","ondisk_log_start":"0'0","created":16,"last_epoch_clean":17,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-08-01T19:54:04.040663+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-08-01T19:54:04.040663+0000","last_clean_scrub_stamp":"2023-08-01T19:54:04.040663+0000","objects_scrubbed":0,"log_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-08-03T04:43:26.793480+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[0,2],"acting":[0,2],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":0,"acting_primary":0,"purged_snaps":[]},{"pgid":"3.16","version":"0'0","reported_seq":13,"reported_epoch":20,"state":"active+clean","last_fresh":"2023-08-01T19:54:23.132278+0000","last_change":"2023-08-01T19:54:04.065042+0000","last_active":"2023-08-01T19:54:23.132278+0000","last_peered":"2023-08-01T19:54:23.132278+0000","last_clean":"2023-08-01T19:54:23.132278+0000","last_became_active":"2023-08-01T19:54:04.064040+0000","last_became_peered":"2023-08-01T19:54:04.064040+0000","last_unstale":"2023-08-01T19:54:23.132278+0000","last_undegraded":"2023-08-01T19:54:23.132278+0000","last_fullsized":"2023-08-01T19:54:23.132278+0000","mapping_epoch":15,"log_start":"0'0","ondisk_log_start":"0'0","created":15,"last_epoch_clean":16,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-08-01T19:54:03.032665+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-08-01T19:54:03.032665+0000","last_clean_scrub_stamp":"2023-08-01T19:54:03.032665+0000","objects_scrubbed":0,"log_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-08-03T03:40:43.460182+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[1,0],"acting":[1,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":1,"acting_primary":1,"purged_snaps":[]},{"pgid":"4.11","version":"0'0","reported_seq":12,"reported_epoch":20,"state":"active+clean","last_fresh":"2023-08-01T19:54:23.136531+0000","last_change":"2023-08-01T19:54:04.470401+0000","last_active":"2023-08-01T19:54:23.136531+0000","last_peered":"2023-08-01T19:54:23.136531+0000","last_clean":"2023-08-01T19:54:23.136531+0000","last_became_active":"2023-08-01T19:54:04.469680+0000","last_became_peered":"2023-08-01T19:54:04.469680+0000","last_unstale":"2023-08-01T19:54:23.136531+0000","last_undegraded":"2023-08-01T19:54:23.136531+0000","last_fullsized":"2023-08-01T19:54:23.136531+0000","mapping_epoch":16,"log_start":"0'0","ondisk_log_start":"0'0","created":16,"last_epoch_clean":17,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-08-01T19:54:04.040663+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-08-01T19:54:04.040663+0000","last_clean_scrub_stamp":"2023-08-01T19:54:04.040663+0000","objects_scrubbed":0,"log_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-08-03T03:58:06.360840+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[0,1],"acting":[0,1],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":0,"acting_primary":0,"purged_snaps":[]},{"pgid":"3.15","version":"17'3","reported_seq":13,"reported_epoch":17,"state":"active+clean","last_fresh":"2023-08-01T19:54:04.471749+0000","last_change":"2023-08-01T19:54:04.065443+0000","last_active":"2023-08-01T19:54:04.471749+0000","last_peered":"2023-08-01T19:54:04.471749+0000","last_clean":"2023-08-01T19:54:04.471749+0000","last_became_active":"2023-08-01T19:54:04.065112+0000","last_became_peered":"2023-08-01T19:54:04.065112+0000","last_unstale":"2023-08-01T19:54:04.471749+0000","last_undegraded":"2023-08-01T19:54:04.471749+0000","last_fullsized":"2023-08-01T19:54:04.471749+0000","mapping_epoch":15,"log_start":"0'0","ondisk_log_start":"0'0","created":15,"last_epoch_clean":16,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-08-01T19:54:03.032665+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-08-01T19:54:03.032665+0000","last_clean_scrub_stamp":"2023-08-01T19:54:03.032665+0000","objects_scrubbed":0,"log_size":3,"ondisk_log_size":3,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-08-03T03:27:50.887004+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":90,"num_objects":2,"num_object_clones":0,"num_object_copies":4,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":2,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":4,"num_write_kb":1,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":1,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[2,1],"acting":[2,1],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":2,"acting_primary":2,"purged_snaps":[]},{"pgid":"4.12","version":"0'0","reported_seq":12,"reported_epoch":20,"state":"active+clean","last_fresh":"2023-08-01T19:54:23.136642+0000","last_change":"2023-08-01T19:54:04.467822+0000","last_active":"2023-08-01T19:54:23.136642+0000","last_peered":"2023-08-01T19:54:23.136642+0000","last_clean":"2023-08-01T19:54:23.136642+0000","last_became_active":"2023-08-01T19:54:04.466667+0000","last_became_peered":"2023-08-01T19:54:04.466667+0000","last_unstale":"2023-08-01T19:54:23.136642+0000","last_undegraded":"2023-08-01T19:54:23.136642+0000","last_fullsized":"2023-08-01T19:54:23.136642+0000","mapping_epoch":16,"log_start":"0'0","ondisk_log_start":"0'0","created":16,"last_epoch_clean":17,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-08-01T19:54:04.040663+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-08-01T19:54:04.040663+0000","last_clean_scrub_stamp":"2023-08-01T19:54:04.040663+0000","objects_scrubbed":0,"log_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-08-03T02:57:18.148077+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[0,2],"acting":[0,2],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":0,"acting_primary":0,"purged_snaps":[]},{"pgid":"3.14","version":"17'6","reported_seq":19,"reported_epoch":20,"state":"active+clean","last_fresh":"2023-08-01T19:54:23.131761+0000","last_change":"2023-08-01T19:54:04.061419+0000","last_active":"2023-08-01T19:54:23.131761+0000","last_peered":"2023-08-01T19:54:23.131761+0000","last_clean":"2023-08-01T19:54:23.131761+0000","last_became_active":"2023-08-01T19:54:04.061078+0000","last_became_peered":"2023-08-01T19:54:04.061078+0000","last_unstale":"2023-08-01T19:54:23.131761+0000","last_undegraded":"2023-08-01T19:54:23.131761+0000","last_fullsized":"2023-08-01T19:54:23.131761+0000","mapping_epoch":15,"log_start":"0'0","ondisk_log_start":"0'0","created":15,"last_epoch_clean":16,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-08-01T19:54:03.032665+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-08-01T19:54:03.032665+0000","last_clean_scrub_stamp":"2023-08-01T19:54:03.032665+0000","objects_scrubbed":0,"log_size":6,"ondisk_log_size":6,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-08-02T21:35:44.874727+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":1536,"num_objects":4,"num_object_clones":0,"num_object_copies":8,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":4,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":6,"num_write_kb":3,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":1,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[1,2],"acting":[1,2],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":1,"acting_primary":1,"purged_snaps":[]},{"pgid":"4.13","version":"0'0","reported_seq":12,"reported_epoch":20,"state":"active+clean","last_fresh":"2023-08-01T19:54:23.132025+0000","last_change":"2023-08-01T19:54:04.466400+0000","last_active":"2023-08-01T19:54:23.132025+0000","last_peered":"2023-08-01T19:54:23.132025+0000","last_clean":"2023-08-01T19:54:23.132025+0000","last_became_active":"2023-08-01T19:54:04.465979+0000","last_became_peered":"2023-08-01T19:54:04.465979+0000","last_unstale":"2023-08-01T19:54:23.132025+0000","last_undegraded":"2023-08-01T19:54:23.132025+0000","last_fullsized":"2023-08-01T19:54:23.132025+0000","mapping_epoch":16,"log_start":"0'0","ondisk_log_start":"0'0","created":16,"last_epoch_clean":17,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-08-01T19:54:04.040663+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-08-01T19:54:04.040663+0000","last_clean_scrub_stamp":"2023-08-01T19:54:04.040663+0000","objects_scrubbed":0,"log_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-08-02T20:20:59.989030+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[1,2],"acting":[1,2],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":1,"acting_primary":1,"purged_snaps":[]},{"pgid":"3.13","version":"17'2","reported_seq":15,"reported_epoch":20,"state":"active+clean","last_fresh":"2023-08-01T19:54:23.132007+0000","last_change":"2023-08-01T19:54:04.065212+0000","last_active":"2023-08-01T19:54:23.132007+0000","last_peered":"2023-08-01T19:54:23.132007+0000","last_clean":"2023-08-01T19:54:23.132007+0000","last_became_active":"2023-08-01T19:54:04.064375+0000","last_became_peered":"2023-08-01T19:54:04.064375+0000","last_unstale":"2023-08-01T19:54:23.132007+0000","last_undegraded":"2023-08-01T19:54:23.132007+0000","last_fullsized":"2023-08-01T19:54:23.132007+0000","mapping_epoch":15,"log_start":"0'0","ondisk_log_start":"0'0","created":15,"last_epoch_clean":16,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-08-01T19:54:03.032665+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-08-01T19:54:03.032665+0000","last_clean_scrub_stamp":"2023-08-01T19:54:03.032665+0000","objects_scrubbed":0,"log_size":2,"ondisk_log_size":2,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-08-03T06:17:37.910752+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":34,"num_objects":2,"num_object_clones":0,"num_object_copies":4,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":2,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":3,"num_write_kb":6,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":1,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[1,0],"acting":[1,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":1,"acting_primary":1,"purged_snaps":[]},{"pgid":"4.14","version":"0'0","reported_seq":9,"reported_epoch":17,"state":"active+clean","last_fresh":"2023-08-01T19:54:04.465917+0000","last_change":"2023-08-01T19:54:04.464446+0000","last_active":"2023-08-01T19:54:04.465917+0000","last_peered":"2023-08-01T19:54:04.465917+0000","last_clean":"2023-08-01T19:54:04.465917+0000","last_became_active":"2023-08-01T19:54:04.464021+0000","last_became_peered":"2023-08-01T19:54:04.464021+0000","last_unstale":"2023-08-01T19:54:04.465917+0000","last_undegraded":"2023-08-01T19:54:04.465917+0000","last_fullsized":"2023-08-01T19:54:04.465917+0000","mapping_epoch":16,"log_start":"0'0","ondisk_log_start":"0'0","created":16,"last_epoch_clean":17,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-08-01T19:54:04.040663+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-08-01T19:54:04.040663+0000","last_clean_scrub_stamp":"2023-08-01T19:54:04.040663+0000","objects_scrubbed":0,"log_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-08-02T20:26:51.080849+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[2,0],"acting":[2,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":2,"acting_primary":2,"purged_snaps":[]},{"pgid":"3.12","version":"0'0","reported_seq":13,"reported_epoch":20,"state":"active+clean","last_fresh":"2023-08-01T19:54:23.135984+0000","last_change":"2023-08-01T19:54:04.066566+0000","last_active":"2023-08-01T19:54:23.135984+0000","last_peered":"2023-08-01T19:54:23.135984+0000","last_clean":"2023-08-01T19:54:23.135984+0000","last_became_active":"2023-08-01T19:54:04.066190+0000","last_became_peered":"2023-08-01T19:54:04.066190+0000","last_unstale":"2023-08-01T19:54:23.135984+0000","last_undegraded":"2023-08-01T19:54:23.135984+0000","last_fullsized":"2023-08-01T19:54:23.135984+0000","mapping_epoch":15,"log_start":"0'0","ondisk_log_start":"0'0","created":15,"last_epoch_clean":16,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-08-01T19:54:03.032665+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-08-01T19:54:03.032665+0000","last_clean_scrub_stamp":"2023-08-01T19:54:03.032665+0000","objects_scrubbed":0,"log_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-08-03T02:01:47.073630+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[0,1],"acting":[0,1],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":0,"acting_primary":0,"purged_snaps":[]},{"pgid":"4.15","version":"0'0","reported_seq":9,"reported_epoch":17,"state":"active+clean","last_fresh":"2023-08-01T19:54:04.470734+0000","last_change":"2023-08-01T19:54:04.468791+0000","last_active":"2023-08-01T19:54:04.470734+0000","last_peered":"2023-08-01T19:54:04.470734+0000","last_clean":"2023-08-01T19:54:04.470734+0000","last_became_active":"2023-08-01T19:54:04.468214+0000","last_became_peered":"2023-08-01T19:54:04.468214+0000","last_unstale":"2023-08-01T19:54:04.470734+0000","last_undegraded":"2023-08-01T19:54:04.470734+0000","last_fullsized":"2023-08-01T19:54:04.470734+0000","mapping_epoch":16,"log_start":"0'0","ondisk_log_start":"0'0","created":16,"last_epoch_clean":17,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-08-01T19:54:04.040663+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-08-01T19:54:04.040663+0000","last_clean_scrub_stamp":"2023-08-01T19:54:04.040663+0000","objects_scrubbed":0,"log_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-08-03T04:10:44.729287+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[2,0],"acting":[2,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":2,"acting_primary":2,"purged_snaps":[]},{"pgid":"3.11","version":"0'0","reported_seq":10,"reported_epoch":17,"state":"active+clean","last_fresh":"2023-08-01T19:54:04.457924+0000","last_change":"2023-08-01T19:54:04.064280+0000","last_active":"2023-08-01T19:54:04.457924+0000","last_peered":"2023-08-01T19:54:04.457924+0000","last_clean":"2023-08-01T19:54:04.457924+0000","last_became_active":"2023-08-01T19:54:04.064064+0000","last_became_peered":"2023-08-01T19:54:04.064064+0000","last_unstale":"2023-08-01T19:54:04.457924+0000","last_undegraded":"2023-08-01T19:54:04.457924+0000","last_fullsized":"2023-08-01T19:54:04.457924+0000","mapping_epoch":15,"log_start":"0'0","ondisk_log_start":"0'0","created":15,"last_epoch_clean":16,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-08-01T19:54:03.032665+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-08-01T19:54:03.032665+0000","last_clean_scrub_stamp":"2023-08-01T19:54:03.032665+0000","objects_scrubbed":0,"log_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-08-03T06:13:51.475710+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[2,1],"acting":[2,1],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":2,"acting_primary":2,"purged_snaps":[]},{"pgid":"4.16","version":"0'0","reported_seq":12,"reported_epoch":20,"state":"active+clean","last_fresh":"2023-08-01T19:54:23.136819+0000","last_change":"2023-08-01T19:54:04.469724+0000","last_active":"2023-08-01T19:54:23.136819+0000","last_peered":"2023-08-01T19:54:23.136819+0000","last_clean":"2023-08-01T19:54:23.136819+0000","last_became_active":"2023-08-01T19:54:04.469275+0000","last_became_peered":"2023-08-01T19:54:04.469275+0000","last_unstale":"2023-08-01T19:54:23.136819+0000","last_undegraded":"2023-08-01T19:54:23.136819+0000","last_fullsized":"2023-08-01T19:54:23.136819+0000","mapping_epoch":16,"log_start":"0'0","ondisk_log_start":"0'0","created":16,"last_epoch_clean":17,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-08-01T19:54:04.040663+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-08-01T19:54:04.040663+0000","last_clean_scrub_stamp":"2023-08-01T19:54:04.040663+0000","objects_scrubbed":0,"log_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-08-03T03:04:06.137335+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[0,1],"acting":[0,1],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":0,"acting_primary":0,"purged_snaps":[]},{"pgid":"3.10","version":"17'8","reported_seq":21,"reported_epoch":20,"state":"active+clean","last_fresh":"2023-08-01T19:54:23.131750+0000","last_change":"2023-08-01T19:54:04.060962+0000","last_active":"2023-08-01T19:54:23.131750+0000","last_peered":"2023-08-01T19:54:23.131750+0000","last_clean":"2023-08-01T19:54:23.131750+0000","last_became_active":"2023-08-01T19:54:04.060576+0000","last_became_peered":"2023-08-01T19:54:04.060576+0000","last_unstale":"2023-08-01T19:54:23.131750+0000","last_undegraded":"2023-08-01T19:54:23.131750+0000","last_fullsized":"2023-08-01T19:54:23.131750+0000","mapping_epoch":15,"log_start":"0'0","ondisk_log_start":"0'0","created":15,"last_epoch_clean":16,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-08-01T19:54:03.032665+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-08-01T19:54:03.032665+0000","last_clean_scrub_stamp":"2023-08-01T19:54:03.032665+0000","objects_scrubbed":0,"log_size":8,"ondisk_log_size":8,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-08-03T05:00:51.171444+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":4,"num_object_clones":0,"num_object_copies":8,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":4,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":12,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":4,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[1,2],"acting":[1,2],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":1,"acting_primary":1,"purged_snaps":[]},{"pgid":"4.17","version":"0'0","reported_seq":12,"reported_epoch":20,"state":"active+clean","last_fresh":"2023-08-01T19:54:23.137584+0000","last_change":"2023-08-01T19:54:04.472721+0000","last_active":"2023-08-01T19:54:23.137584+0000","last_peered":"2023-08-01T19:54:23.137584+0000","last_clean":"2023-08-01T19:54:23.137584+0000","last_became_active":"2023-08-01T19:54:04.472126+0000","last_became_peered":"2023-08-01T19:54:04.472126+0000","last_unstale":"2023-08-01T19:54:23.137584+0000","last_undegraded":"2023-08-01T19:54:23.137584+0000","last_fullsized":"2023-08-01T19:54:23.137584+0000","mapping_epoch":16,"log_start":"0'0","ondisk_log_start":"0'0","created":16,"last_epoch_clean":17,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-08-01T19:54:04.040663+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-08-01T19:54:04.040663+0000","last_clean_scrub_stamp":"2023-08-01T19:54:04.040663+0000","objects_scrubbed":0,"log_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-08-03T00:29:05.857138+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[0,1],"acting":[0,1],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":0,"acting_primary":0,"purged_snaps":[]},{"pgid":"5.9","version":"21'176","reported_seq":182,"reported_epoch":21,"state":"active+clean","last_fresh":"2023-08-01T19:54:24.913251+0000","last_change":"2023-08-01T19:54:23.134838+0000","last_active":"2023-08-01T19:54:24.913251+0000","last_peered":"2023-08-01T19:54:24.913251+0000","last_clean":"2023-08-01T19:54:24.913251+0000","last_became_active":"2023-08-01T19:54:23.134628+0000","last_became_peered":"2023-08-01T19:54:23.134628+0000","last_unstale":"2023-08-01T19:54:24.913251+0000","last_undegraded":"2023-08-01T19:54:24.913251+0000","last_fullsized":"2023-08-01T19:54:24.913251+0000","mapping_epoch":19,"log_start":"0'0","ondisk_log_start":"0'0","created":19,"last_epoch_clean":20,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-08-01T19:54:22.116710+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-08-01T19:54:22.116710+0000","last_clean_scrub_stamp":"2023-08-01T19:54:22.116710+0000","objects_scrubbed":0,"log_size":176,"ondisk_log_size":176,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-08-03T05:57:20.085794+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":11534336,"num_objects":176,"num_object_clones":0,"num_object_copies":352,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":176,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":176,"num_write_kb":11264,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[1,2],"acting":[1,2],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":1,"acting_primary":1,"purged_snaps":[]},{"pgid":"3.f","version":"17'1","reported_seq":14,"reported_epoch":20,"state":"active+clean","last_fresh":"2023-08-01T19:54:23.132328+0000","last_change":"2023-08-01T19:54:04.060797+0000","last_active":"2023-08-01T19:54:23.132328+0000","last_peered":"2023-08-01T19:54:23.132328+0000","last_clean":"2023-08-01T19:54:23.132328+0000","last_became_active":"2023-08-01T19:54:04.060444+0000","last_became_peered":"2023-08-01T19:54:04.060444+0000","last_unstale":"2023-08-01T19:54:23.132328+0000","last_undegraded":"2023-08-01T19:54:23.132328+0000","last_fullsized":"2023-08-01T19:54:23.132328+0000","mapping_epoch":15,"log_start":"0'0","ondisk_log_start":"0'0","created":15,"last_epoch_clean":16,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-08-01T19:54:03.032665+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-08-01T19:54:03.032665+0000","last_clean_scrub_stamp":"2023-08-01T19:54:03.032665+0000","objects_scrubbed":0,"log_size":1,"ondisk_log_size":1,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-08-03T07:13:34.025722+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":22,"num_objects":1,"num_object_clones":0,"num_object_copies":2,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":1,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":1,"num_write_kb":1,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[1,2],"acting":[1,2],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":1,"acting_primary":1,"purged_snaps":[]},{"pgid":"4.8","version":"0'0","reported_seq":9,"reported_epoch":17,"state":"active+clean","last_fresh":"2023-08-01T19:54:04.470264+0000","last_change":"2023-08-01T19:54:04.467671+0000","last_active":"2023-08-01T19:54:04.470264+0000","last_peered":"2023-08-01T19:54:04.470264+0000","last_clean":"2023-08-01T19:54:04.470264+0000","last_became_active":"2023-08-01T19:54:04.467300+0000","last_became_peered":"2023-08-01T19:54:04.467300+0000","last_unstale":"2023-08-01T19:54:04.470264+0000","last_undegraded":"2023-08-01T19:54:04.470264+0000","last_fullsized":"2023-08-01T19:54:04.470264+0000","mapping_epoch":16,"log_start":"0'0","ondisk_log_start":"0'0","created":16,"last_epoch_clean":17,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-08-01T19:54:04.040663+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-08-01T19:54:04.040663+0000","last_clean_scrub_stamp":"2023-08-01T19:54:04.040663+0000","objects_scrubbed":0,"log_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-08-03T05:27:24.774345+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[2,1],"acting":[2,1],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":2,"acting_primary":2,"purged_snaps":[]},{"pgid":"5.8","version":"0'0","reported_seq":0,"reported_epoch":0,"state":"unknown","last_fresh":"2023-08-01T19:54:22.116710+0000","last_change":"2023-08-01T19:54:22.116710+0000","last_active":"2023-08-01T19:54:22.116710+0000","last_peered":"2023-08-01T19:54:22.116710+0000","last_clean":"2023-08-01T19:54:22.116710+0000","last_became_active":"0.000000","last_became_peered":"0.000000","last_unstale":"2023-08-01T19:54:22.116710+0000","last_undegraded":"2023-08-01T19:54:22.116710+0000","last_fullsized":"2023-08-01T19:54:22.116710+0000","mapping_epoch":0,"log_start":"0'0","ondisk_log_start":"0'0","created":0,"last_epoch_clean":0,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-08-01T19:54:22.116710+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-08-01T19:54:22.116710+0000","last_clean_scrub_stamp":"2023-08-01T19:54:22.116710+0000","objects_scrubbed":0,"log_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"--","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[],"acting":[],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":-1,"acting_primary":-1,"purged_snaps":[]},{"pgid":"3.e","version":"17'2","reported_seq":12,"reported_epoch":17,"state":"active+clean","last_fresh":"2023-08-01T19:54:04.471249+0000","last_change":"2023-08-01T19:54:04.065595+0000","last_active":"2023-08-01T19:54:04.471249+0000","last_peered":"2023-08-01T19:54:04.471249+0000","last_clean":"2023-08-01T19:54:04.471249+0000","last_became_active":"2023-08-01T19:54:04.065303+0000","last_became_peered":"2023-08-01T19:54:04.065303+0000","last_unstale":"2023-08-01T19:54:04.471249+0000","last_undegraded":"2023-08-01T19:54:04.471249+0000","last_fullsized":"2023-08-01T19:54:04.471249+0000","mapping_epoch":15,"log_start":"0'0","ondisk_log_start":"0'0","created":15,"last_epoch_clean":16,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-08-01T19:54:03.032665+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-08-01T19:54:03.032665+0000","last_clean_scrub_stamp":"2023-08-01T19:54:03.032665+0000","objects_scrubbed":0,"log_size":2,"ondisk_log_size":2,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-08-02T22:40:38.782053+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":1,"num_object_clones":0,"num_object_copies":2,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":1,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":3,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":1,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[2,1],"acting":[2,1],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":2,"acting_primary":2,"purged_snaps":[]},{"pgid":"4.9","version":"0'0","reported_seq":9,"reported_epoch":17,"state":"active+clean","last_fresh":"2023-08-01T19:54:04.470284+0000","last_change":"2023-08-01T19:54:04.468007+0000","last_active":"2023-08-01T19:54:04.470284+0000","last_peered":"2023-08-01T19:54:04.470284+0000","last_clean":"2023-08-01T19:54:04.470284+0000","last_became_active":"2023-08-01T19:54:04.467509+0000","last_became_peered":"2023-08-01T19:54:04.467509+0000","last_unstale":"2023-08-01T19:54:04.470284+0000","last_undegraded":"2023-08-01T19:54:04.470284+0000","last_fullsized":"2023-08-01T19:54:04.470284+0000","mapping_epoch":16,"log_start":"0'0","ondisk_log_start":"0'0","created":16,"last_epoch_clean":17,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-08-01T19:54:04.040663+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-08-01T19:54:04.040663+0000","last_clean_scrub_stamp":"2023-08-01T19:54:04.040663+0000","objects_scrubbed":0,"log_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-08-03T06:04:50.963711+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[2,0],"acting":[2,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":2,"acting_primary":2,"purged_snaps":[]},{"pgid":"5.b","version":"0'0","reported_seq":0,"reported_epoch":0,"state":"unknown","last_fresh":"2023-08-01T19:54:22.116710+0000","last_change":"2023-08-01T19:54:22.116710+0000","last_active":"2023-08-01T19:54:22.116710+0000","last_peered":"2023-08-01T19:54:22.116710+0000","last_clean":"2023-08-01T19:54:22.116710+0000","last_became_active":"0.000000","last_became_peered":"0.000000","last_unstale":"2023-08-01T19:54:22.116710+0000","last_undegraded":"2023-08-01T19:54:22.116710+0000","last_fullsized":"2023-08-01T19:54:22.116710+0000","mapping_epoch":0,"log_start":"0'0","ondisk_log_start":"0'0","created":0,"last_epoch_clean":0,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-08-01T19:54:22.116710+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-08-01T19:54:22.116710+0000","last_clean_scrub_stamp":"2023-08-01T19:54:22.116710+0000","objects_scrubbed":0,"log_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"--","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[],"acting":[],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":-1,"acting_primary":-1,"purged_snaps":[]},{"pgid":"3.d","version":"17'1","reported_seq":14,"reported_epoch":20,"state":"active+clean","last_fresh":"2023-08-01T19:54:23.132218+0000","last_change":"2023-08-01T19:54:04.062853+0000","last_active":"2023-08-01T19:54:23.132218+0000","last_peered":"2023-08-01T19:54:23.132218+0000","last_clean":"2023-08-01T19:54:23.132218+0000","last_became_active":"2023-08-01T19:54:04.062598+0000","last_became_peered":"2023-08-01T19:54:04.062598+0000","last_unstale":"2023-08-01T19:54:23.132218+0000","last_undegraded":"2023-08-01T19:54:23.132218+0000","last_fullsized":"2023-08-01T19:54:23.132218+0000","mapping_epoch":15,"log_start":"0'0","ondisk_log_start":"0'0","created":15,"last_epoch_clean":16,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-08-01T19:54:03.032665+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-08-01T19:54:03.032665+0000","last_clean_scrub_stamp":"2023-08-01T19:54:03.032665+0000","objects_scrubbed":0,"log_size":1,"ondisk_log_size":1,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-08-02T20:56:47.324761+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":70,"num_objects":1,"num_object_clones":0,"num_object_copies":2,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":1,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":1,"num_write_kb":1,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[1,2],"acting":[1,2],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":1,"acting_primary":1,"purged_snaps":[]},{"pgid":"4.a","version":"0'0","reported_seq":12,"reported_epoch":20,"state":"active+clean","last_fresh":"2023-08-01T19:54:23.131916+0000","last_change":"2023-08-01T19:54:04.471997+0000","last_active":"2023-08-01T19:54:23.131916+0000","last_peered":"2023-08-01T19:54:23.131916+0000","last_clean":"2023-08-01T19:54:23.131916+0000","last_became_active":"2023-08-01T19:54:04.471204+0000","last_became_peered":"2023-08-01T19:54:04.471204+0000","last_unstale":"2023-08-01T19:54:23.131916+0000","last_undegraded":"2023-08-01T19:54:23.131916+0000","last_fullsized":"2023-08-01T19:54:23.131916+0000","mapping_epoch":16,"log_start":"0'0","ondisk_log_start":"0'0","created":16,"last_epoch_clean":17,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-08-01T19:54:04.040663+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-08-01T19:54:04.040663+0000","last_clean_scrub_stamp":"2023-08-01T19:54:04.040663+0000","objects_scrubbed":0,"log_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-08-02T23:12:30.830199+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[1,0],"acting":[1,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":1,"acting_primary":1,"purged_snaps":[]},{"pgid":"5.a","version":"21'159","reported_seq":168,"reported_epoch":21,"state":"active+clean","last_fresh":"2023-08-01T19:54:24.912532+0000","last_change":"2023-08-01T19:54:23.138147+0000","last_active":"2023-08-01T19:54:24.912532+0000","last_peered":"2023-08-01T19:54:24.912532+0000","last_clean":"2023-08-01T19:54:24.912532+0000","last_became_active":"2023-08-01T19:54:23.137827+0000","last_became_peered":"2023-08-01T19:54:23.137827+0000","last_unstale":"2023-08-01T19:54:24.912532+0000","last_undegraded":"2023-08-01T19:54:24.912532+0000","last_fullsized":"2023-08-01T19:54:24.912532+0000","mapping_epoch":19,"log_start":"0'0","ondisk_log_start":"0'0","created":19,"last_epoch_clean":20,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-08-01T19:54:22.116710+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-08-01T19:54:22.116710+0000","last_clean_scrub_stamp":"2023-08-01T19:54:22.116710+0000","objects_scrubbed":0,"log_size":159,"ondisk_log_size":159,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-08-03T05:22:32.106433+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":10420224,"num_objects":159,"num_object_clones":0,"num_object_copies":318,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":159,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":159,"num_write_kb":10176,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[0,2],"acting":[0,2],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":0,"acting_primary":0,"purged_snaps":[]},{"pgid":"3.c","version":"0'0","reported_seq":13,"reported_epoch":20,"state":"active+clean","last_fresh":"2023-08-01T19:54:23.131545+0000","last_change":"2023-08-01T19:54:04.063532+0000","last_active":"2023-08-01T19:54:23.131545+0000","last_peered":"2023-08-01T19:54:23.131545+0000","last_clean":"2023-08-01T19:54:23.131545+0000","last_became_active":"2023-08-01T19:54:04.063116+0000","last_became_peered":"2023-08-01T19:54:04.063116+0000","last_unstale":"2023-08-01T19:54:23.131545+0000","last_undegraded":"2023-08-01T19:54:23.131545+0000","last_fullsized":"2023-08-01T19:54:23.131545+0000","mapping_epoch":15,"log_start":"0'0","ondisk_log_start":"0'0","created":15,"last_epoch_clean":16,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-08-01T19:54:03.032665+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-08-01T19:54:03.032665+0000","last_clean_scrub_stamp":"2023-08-01T19:54:03.032665+0000","objects_scrubbed":0,"log_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-08-02T22:28:51.936138+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[1,0],"acting":[1,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":1,"acting_primary":1,"purged_snaps":[]},{"pgid":"4.b","version":"0'0","reported_seq":12,"reported_epoch":20,"state":"active+clean","last_fresh":"2023-08-01T19:54:23.136414+0000","last_change":"2023-08-01T19:54:04.470787+0000","last_active":"2023-08-01T19:54:23.136414+0000","last_peered":"2023-08-01T19:54:23.136414+0000","last_clean":"2023-08-01T19:54:23.136414+0000","last_became_active":"2023-08-01T19:54:04.470332+0000","last_became_peered":"2023-08-01T19:54:04.470332+0000","last_unstale":"2023-08-01T19:54:23.136414+0000","last_undegraded":"2023-08-01T19:54:23.136414+0000","last_fullsized":"2023-08-01T19:54:23.136414+0000","mapping_epoch":16,"log_start":"0'0","ondisk_log_start":"0'0","created":16,"last_epoch_clean":17,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-08-01T19:54:04.040663+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-08-01T19:54:04.040663+0000","last_clean_scrub_stamp":"2023-08-01T19:54:04.040663+0000","objects_scrubbed":0,"log_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-08-03T05:13:38.298401+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[0,1],"acting":[0,1],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":0,"acting_primary":0,"purged_snaps":[]},{"pgid":"5.d","version":"0'0","reported_seq":0,"reported_epoch":0,"state":"unknown","last_fresh":"2023-08-01T19:54:22.116710+0000","last_change":"2023-08-01T19:54:22.116710+0000","last_active":"2023-08-01T19:54:22.116710+0000","last_peered":"2023-08-01T19:54:22.116710+0000","last_clean":"2023-08-01T19:54:22.116710+0000","last_became_active":"0.000000","last_became_peered":"0.000000","last_unstale":"2023-08-01T19:54:22.116710+0000","last_undegraded":"2023-08-01T19:54:22.116710+0000","last_fullsized":"2023-08-01T19:54:22.116710+0000","mapping_epoch":0,"log_start":"0'0","ondisk_log_start":"0'0","created":0,"last_epoch_clean":0,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-08-01T19:54:22.116710+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-08-01T19:54:22.116710+0000","last_clean_scrub_stamp":"2023-08-01T19:54:22.116710+0000","objects_scrubbed":0,"log_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"--","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[],"acting":[],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":-1,"acting_primary":-1,"purged_snaps":[]},{"pgid":"3.b","version":"17'2","reported_seq":15,"reported_epoch":20,"state":"active+clean","last_fresh":"2023-08-01T19:54:23.136351+0000","last_change":"2023-08-01T19:54:04.066839+0000","last_active":"2023-08-01T19:54:23.136351+0000","last_peered":"2023-08-01T19:54:23.136351+0000","last_clean":"2023-08-01T19:54:23.136351+0000","last_became_active":"2023-08-01T19:54:04.065535+0000","last_became_peered":"2023-08-01T19:54:04.065535+0000","last_unstale":"2023-08-01T19:54:23.136351+0000","last_undegraded":"2023-08-01T19:54:23.136351+0000","last_fullsized":"2023-08-01T19:54:23.136351+0000","mapping_epoch":15,"log_start":"0'0","ondisk_log_start":"0'0","created":15,"last_epoch_clean":16,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-08-01T19:54:03.032665+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-08-01T19:54:03.032665+0000","last_clean_scrub_stamp":"2023-08-01T19:54:03.032665+0000","objects_scrubbed":0,"log_size":2,"ondisk_log_size":2,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-08-03T05:00:51.171444+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":1,"num_object_clones":0,"num_object_copies":2,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":1,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":1,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":1,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[0,1],"acting":[0,1],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":0,"acting_primary":0,"purged_snaps":[]},{"pgid":"4.c","version":"0'0","reported_seq":12,"reported_epoch":20,"state":"active+clean","last_fresh":"2023-08-01T19:54:23.131603+0000","last_change":"2023-08-01T19:54:04.478715+0000","last_active":"2023-08-01T19:54:23.131603+0000","last_peered":"2023-08-01T19:54:23.131603+0000","last_clean":"2023-08-01T19:54:23.131603+0000","last_became_active":"2023-08-01T19:54:04.477435+0000","last_became_peered":"2023-08-01T19:54:04.477435+0000","last_unstale":"2023-08-01T19:54:23.131603+0000","last_undegraded":"2023-08-01T19:54:23.131603+0000","last_fullsized":"2023-08-01T19:54:23.131603+0000","mapping_epoch":16,"log_start":"0'0","ondisk_log_start":"0'0","created":16,"last_epoch_clean":17,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-08-01T19:54:04.040663+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-08-01T19:54:04.040663+0000","last_clean_scrub_stamp":"2023-08-01T19:54:04.040663+0000","objects_scrubbed":0,"log_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-08-03T04:43:21.408174+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[1,0],"acting":[1,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":1,"acting_primary":1,"purged_snaps":[]},{"pgid":"5.c","version":"21'172","reported_seq":181,"reported_epoch":21,"state":"active+clean","last_fresh":"2023-08-01T19:54:24.911887+0000","last_change":"2023-08-01T19:54:23.138439+0000","last_active":"2023-08-01T19:54:24.911887+0000","last_peered":"2023-08-01T19:54:24.911887+0000","last_clean":"2023-08-01T19:54:24.911887+0000","last_became_active":"2023-08-01T19:54:23.138051+0000","last_became_peered":"2023-08-01T19:54:23.138051+0000","last_unstale":"2023-08-01T19:54:24.911887+0000","last_undegraded":"2023-08-01T19:54:24.911887+0000","last_fullsized":"2023-08-01T19:54:24.911887+0000","mapping_epoch":19,"log_start":"0'0","ondisk_log_start":"0'0","created":19,"last_epoch_clean":20,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-08-01T19:54:22.116710+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-08-01T19:54:22.116710+0000","last_clean_scrub_stamp":"2023-08-01T19:54:22.116710+0000","objects_scrubbed":0,"log_size":172,"ondisk_log_size":172,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-08-03T03:01:16.402814+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":11272192,"num_objects":172,"num_object_clones":0,"num_object_copies":344,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":172,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":172,"num_write_kb":11008,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[0,1],"acting":[0,1],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":0,"acting_primary":0,"purged_snaps":[]},{"pgid":"3.a","version":"0'0","reported_seq":13,"reported_epoch":20,"state":"active+clean","last_fresh":"2023-08-01T19:54:23.131825+0000","last_change":"2023-08-01T19:54:04.065267+0000","last_active":"2023-08-01T19:54:23.131825+0000","last_peered":"2023-08-01T19:54:23.131825+0000","last_clean":"2023-08-01T19:54:23.131825+0000","last_became_active":"2023-08-01T19:54:04.064912+0000","last_became_peered":"2023-08-01T19:54:04.064912+0000","last_unstale":"2023-08-01T19:54:23.131825+0000","last_undegraded":"2023-08-01T19:54:23.131825+0000","last_fullsized":"2023-08-01T19:54:23.131825+0000","mapping_epoch":15,"log_start":"0'0","ondisk_log_start":"0'0","created":15,"last_epoch_clean":16,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-08-01T19:54:03.032665+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-08-01T19:54:03.032665+0000","last_clean_scrub_stamp":"2023-08-01T19:54:03.032665+0000","objects_scrubbed":0,"log_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-08-03T02:37:09.180970+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[1,0],"acting":[1,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":1,"acting_primary":1,"purged_snaps":[]},{"pgid":"4.d","version":"0'0","reported_seq":12,"reported_epoch":20,"state":"active+clean","last_fresh":"2023-08-01T19:54:23.132396+0000","last_change":"2023-08-01T19:54:04.474755+0000","last_active":"2023-08-01T19:54:23.132396+0000","last_peered":"2023-08-01T19:54:23.132396+0000","last_clean":"2023-08-01T19:54:23.132396+0000","last_became_active":"2023-08-01T19:54:04.471526+0000","last_became_peered":"2023-08-01T19:54:04.471526+0000","last_unstale":"2023-08-01T19:54:23.132396+0000","last_undegraded":"2023-08-01T19:54:23.132396+0000","last_fullsized":"2023-08-01T19:54:23.132396+0000","mapping_epoch":16,"log_start":"0'0","ondisk_log_start":"0'0","created":16,"last_epoch_clean":17,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-08-01T19:54:04.040663+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-08-01T19:54:04.040663+0000","last_clean_scrub_stamp":"2023-08-01T19:54:04.040663+0000","objects_scrubbed":0,"log_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-08-03T06:50:03.420334+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[1,2],"acting":[1,2],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":1,"acting_primary":1,"purged_snaps":[]},{"pgid":"5.f","version":"21'156","reported_seq":165,"reported_epoch":21,"state":"active+clean","last_fresh":"2023-08-01T19:54:24.907471+0000","last_change":"2023-08-01T19:54:23.134608+0000","last_active":"2023-08-01T19:54:24.907471+0000","last_peered":"2023-08-01T19:54:24.907471+0000","last_clean":"2023-08-01T19:54:24.907471+0000","last_became_active":"2023-08-01T19:54:23.134360+0000","last_became_peered":"2023-08-01T19:54:23.134360+0000","last_unstale":"2023-08-01T19:54:24.907471+0000","last_undegraded":"2023-08-01T19:54:24.907471+0000","last_fullsized":"2023-08-01T19:54:24.907471+0000","mapping_epoch":19,"log_start":"0'0","ondisk_log_start":"0'0","created":19,"last_epoch_clean":20,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-08-01T19:54:22.116710+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-08-01T19:54:22.116710+0000","last_clean_scrub_stamp":"2023-08-01T19:54:22.116710+0000","objects_scrubbed":0,"log_size":156,"ondisk_log_size":156,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-08-03T06:01:12.916557+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":10223616,"num_objects":156,"num_object_clones":0,"num_object_copies":312,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":156,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":156,"num_write_kb":9984,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[1,2],"acting":[1,2],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":1,"acting_primary":1,"purged_snaps":[]},{"pgid":"3.9","version":"0'0","reported_seq":10,"reported_epoch":17,"state":"active+clean","last_fresh":"2023-08-01T19:54:04.457820+0000","last_change":"2023-08-01T19:54:04.065519+0000","last_active":"2023-08-01T19:54:04.457820+0000","last_peered":"2023-08-01T19:54:04.457820+0000","last_clean":"2023-08-01T19:54:04.457820+0000","last_became_active":"2023-08-01T19:54:04.065211+0000","last_became_peered":"2023-08-01T19:54:04.065211+0000","last_unstale":"2023-08-01T19:54:04.457820+0000","last_undegraded":"2023-08-01T19:54:04.457820+0000","last_fullsized":"2023-08-01T19:54:04.457820+0000","mapping_epoch":15,"log_start":"0'0","ondisk_log_start":"0'0","created":15,"last_epoch_clean":16,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-08-01T19:54:03.032665+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-08-01T19:54:03.032665+0000","last_clean_scrub_stamp":"2023-08-01T19:54:03.032665+0000","objects_scrubbed":0,"log_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-08-03T05:46:27.672957+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[2,1],"acting":[2,1],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":2,"acting_primary":2,"purged_snaps":[]},{"pgid":"4.e","version":"0'0","reported_seq":12,"reported_epoch":20,"state":"active+clean","last_fresh":"2023-08-01T19:54:23.132315+0000","last_change":"2023-08-01T19:54:04.473750+0000","last_active":"2023-08-01T19:54:23.132315+0000","last_peered":"2023-08-01T19:54:23.132315+0000","last_clean":"2023-08-01T19:54:23.132315+0000","last_became_active":"2023-08-01T19:54:04.471512+0000","last_became_peered":"2023-08-01T19:54:04.471512+0000","last_unstale":"2023-08-01T19:54:23.132315+0000","last_undegraded":"2023-08-01T19:54:23.132315+0000","last_fullsized":"2023-08-01T19:54:23.132315+0000","mapping_epoch":16,"log_start":"0'0","ondisk_log_start":"0'0","created":16,"last_epoch_clean":17,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-08-01T19:54:04.040663+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-08-01T19:54:04.040663+0000","last_clean_scrub_stamp":"2023-08-01T19:54:04.040663+0000","objects_scrubbed":0,"log_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-08-03T05:13:38.298401+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[1,2],"acting":[1,2],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":1,"acting_primary":1,"purged_snaps":[]},{"pgid":"5.e","version":"0'0","reported_seq":0,"reported_epoch":0,"state":"unknown","last_fresh":"2023-08-01T19:54:22.116710+0000","last_change":"2023-08-01T19:54:22.116710+0000","last_active":"2023-08-01T19:54:22.116710+0000","last_peered":"2023-08-01T19:54:22.116710+0000","last_clean":"2023-08-01T19:54:22.116710+0000","last_became_active":"0.000000","last_became_peered":"0.000000","last_unstale":"2023-08-01T19:54:22.116710+0000","last_undegraded":"2023-08-01T19:54:22.116710+0000","last_fullsized":"2023-08-01T19:54:22.116710+0000","mapping_epoch":0,"log_start":"0'0","ondisk_log_start":"0'0","created":0,"last_epoch_clean":0,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-08-01T19:54:22.116710+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-08-01T19:54:22.116710+0000","last_clean_scrub_stamp":"2023-08-01T19:54:22.116710+0000","objects_scrubbed":0,"log_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"--","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[],"acting":[],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":-1,"acting_primary":-1,"purged_snaps":[]},{"pgid":"3.8","version":"0'0","reported_seq":10,"reported_epoch":17,"state":"active+clean","last_fresh":"2023-08-01T19:54:04.458299+0000","last_change":"2023-08-01T19:54:04.063990+0000","last_active":"2023-08-01T19:54:04.458299+0000","last_peered":"2023-08-01T19:54:04.458299+0000","last_clean":"2023-08-01T19:54:04.458299+0000","last_became_active":"2023-08-01T19:54:04.063652+0000","last_became_peered":"2023-08-01T19:54:04.063652+0000","last_unstale":"2023-08-01T19:54:04.458299+0000","last_undegraded":"2023-08-01T19:54:04.458299+0000","last_fullsized":"2023-08-01T19:54:04.458299+0000","mapping_epoch":15,"log_start":"0'0","ondisk_log_start":"0'0","created":15,"last_epoch_clean":16,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-08-01T19:54:03.032665+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-08-01T19:54:03.032665+0000","last_clean_scrub_stamp":"2023-08-01T19:54:03.032665+0000","objects_scrubbed":0,"log_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-08-03T05:30:28.028091+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[2,0],"acting":[2,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":2,"acting_primary":2,"purged_snaps":[]},{"pgid":"4.f","version":"0'0","reported_seq":12,"reported_epoch":20,"state":"active+clean","last_fresh":"2023-08-01T19:54:23.136771+0000","last_change":"2023-08-01T19:54:04.469648+0000","last_active":"2023-08-01T19:54:23.136771+0000","last_peered":"2023-08-01T19:54:23.136771+0000","last_clean":"2023-08-01T19:54:23.136771+0000","last_became_active":"2023-08-01T19:54:04.468445+0000","last_became_peered":"2023-08-01T19:54:04.468445+0000","last_unstale":"2023-08-01T19:54:23.136771+0000","last_undegraded":"2023-08-01T19:54:23.136771+0000","last_fullsized":"2023-08-01T19:54:23.136771+0000","mapping_epoch":16,"log_start":"0'0","ondisk_log_start":"0'0","created":16,"last_epoch_clean":17,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-08-01T19:54:04.040663+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-08-01T19:54:04.040663+0000","last_clean_scrub_stamp":"2023-08-01T19:54:04.040663+0000","objects_scrubbed":0,"log_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-08-03T05:46:11.085577+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[0,2],"acting":[0,2],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":0,"acting_primary":0,"purged_snaps":[]},{"pgid":"5.3","version":"21'182","reported_seq":191,"reported_epoch":21,"state":"active+clean","last_fresh":"2023-08-01T19:54:24.915230+0000","last_change":"2023-08-01T19:54:23.138357+0000","last_active":"2023-08-01T19:54:24.915230+0000","last_peered":"2023-08-01T19:54:24.915230+0000","last_clean":"2023-08-01T19:54:24.915230+0000","last_became_active":"2023-08-01T19:54:23.137942+0000","last_became_peered":"2023-08-01T19:54:23.137942+0000","last_unstale":"2023-08-01T19:54:24.915230+0000","last_undegraded":"2023-08-01T19:54:24.915230+0000","last_fullsized":"2023-08-01T19:54:24.915230+0000","mapping_epoch":19,"log_start":"0'0","ondisk_log_start":"0'0","created":19,"last_epoch_clean":20,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-08-01T19:54:22.116710+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-08-01T19:54:22.116710+0000","last_clean_scrub_stamp":"2023-08-01T19:54:22.116710+0000","objects_scrubbed":0,"log_size":182,"ondisk_log_size":182,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-08-03T01:44:47.434321+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":11927552,"num_objects":182,"num_object_clones":0,"num_object_copies":364,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":182,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":182,"num_write_kb":11648,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[0,1],"acting":[0,1],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":0,"acting_primary":0,"purged_snaps":[]},{"pgid":"2.4","version":"0'0","reported_seq":16,"reported_epoch":20,"state":"active+clean","last_fresh":"2023-08-01T19:54:23.136668+0000","last_change":"2023-08-01T19:53:58.973838+0000","last_active":"2023-08-01T19:54:23.136668+0000","last_peered":"2023-08-01T19:54:23.136668+0000","last_clean":"2023-08-01T19:54:23.136668+0000","last_became_active":"2023-08-01T19:53:58.973242+0000","last_became_peered":"2023-08-01T19:53:58.973242+0000","last_unstale":"2023-08-01T19:54:23.136668+0000","last_undegraded":"2023-08-01T19:54:23.136668+0000","last_fullsized":"2023-08-01T19:54:23.136668+0000","mapping_epoch":12,"log_start":"0'0","ondisk_log_start":"0'0","created":12,"last_epoch_clean":13,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-08-01T19:53:57.959448+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-08-01T19:53:57.959448+0000","last_clean_scrub_stamp":"2023-08-01T19:53:57.959448+0000","objects_scrubbed":0,"log_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-08-03T00:09:48.796549+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[0,2],"acting":[0,2],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":0,"acting_primary":0,"purged_snaps":[]},{"pgid":"3.5","version":"0'0","reported_seq":13,"reported_epoch":20,"state":"active+clean","last_fresh":"2023-08-01T19:54:23.132298+0000","last_change":"2023-08-01T19:54:04.065255+0000","last_active":"2023-08-01T19:54:23.132298+0000","last_peered":"2023-08-01T19:54:23.132298+0000","last_clean":"2023-08-01T19:54:23.132298+0000","last_became_active":"2023-08-01T19:54:04.064814+0000","last_became_peered":"2023-08-01T19:54:04.064814+0000","last_unstale":"2023-08-01T19:54:23.132298+0000","last_undegraded":"2023-08-01T19:54:23.132298+0000","last_fullsized":"2023-08-01T19:54:23.132298+0000","mapping_epoch":15,"log_start":"0'0","ondisk_log_start":"0'0","created":15,"last_epoch_clean":16,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-08-01T19:54:03.032665+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-08-01T19:54:03.032665+0000","last_clean_scrub_stamp":"2023-08-01T19:54:03.032665+0000","objects_scrubbed":0,"log_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-08-03T02:01:47.073630+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[1,0],"acting":[1,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":1,"acting_primary":1,"purged_snaps":[]},{"pgid":"4.2","version":"0'0","reported_seq":9,"reported_epoch":17,"state":"active+clean","last_fresh":"2023-08-01T19:54:04.473868+0000","last_change":"2023-08-01T19:54:04.471715+0000","last_active":"2023-08-01T19:54:04.473868+0000","last_peered":"2023-08-01T19:54:04.473868+0000","last_clean":"2023-08-01T19:54:04.473868+0000","last_became_active":"2023-08-01T19:54:04.471300+0000","last_became_peered":"2023-08-01T19:54:04.471300+0000","last_unstale":"2023-08-01T19:54:04.473868+0000","last_undegraded":"2023-08-01T19:54:04.473868+0000","last_fullsized":"2023-08-01T19:54:04.473868+0000","mapping_epoch":16,"log_start":"0'0","ondisk_log_start":"0'0","created":16,"last_epoch_clean":17,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-08-01T19:54:04.040663+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-08-01T19:54:04.040663+0000","last_clean_scrub_stamp":"2023-08-01T19:54:04.040663+0000","objects_scrubbed":0,"log_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-08-02T23:00:24.980203+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[2,1],"acting":[2,1],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":2,"acting_primary":2,"purged_snaps":[]},{"pgid":"5.5","version":"21'170","reported_seq":179,"reported_epoch":21,"state":"active+clean","last_fresh":"2023-08-01T19:54:24.907931+0000","last_change":"2023-08-01T19:54:23.137678+0000","last_active":"2023-08-01T19:54:24.907931+0000","last_peered":"2023-08-01T19:54:24.907931+0000","last_clean":"2023-08-01T19:54:24.907931+0000","last_became_active":"2023-08-01T19:54:23.136756+0000","last_became_peered":"2023-08-01T19:54:23.136756+0000","last_unstale":"2023-08-01T19:54:24.907931+0000","last_undegraded":"2023-08-01T19:54:24.907931+0000","last_fullsized":"2023-08-01T19:54:24.907931+0000","mapping_epoch":19,"log_start":"0'0","ondisk_log_start":"0'0","created":19,"last_epoch_clean":20,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-08-01T19:54:22.116710+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-08-01T19:54:22.116710+0000","last_clean_scrub_stamp":"2023-08-01T19:54:22.116710+0000","objects_scrubbed":0,"log_size":170,"ondisk_log_size":170,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-08-03T03:50:03.076219+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":11141120,"num_objects":170,"num_object_clones":0,"num_object_copies":340,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":170,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":170,"num_write_kb":10880,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[0,1],"acting":[0,1],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":0,"acting_primary":0,"purged_snaps":[]},{"pgid":"2.2","version":"0'0","reported_seq":16,"reported_epoch":20,"state":"active+clean","last_fresh":"2023-08-01T19:54:23.131990+0000","last_change":"2023-08-01T19:53:58.973665+0000","last_active":"2023-08-01T19:54:23.131990+0000","last_peered":"2023-08-01T19:54:23.131990+0000","last_clean":"2023-08-01T19:54:23.131990+0000","last_became_active":"2023-08-01T19:53:58.973463+0000","last_became_peered":"2023-08-01T19:53:58.973463+0000","last_unstale":"2023-08-01T19:54:23.131990+0000","last_undegraded":"2023-08-01T19:54:23.131990+0000","last_fullsized":"2023-08-01T19:54:23.131990+0000","mapping_epoch":12,"log_start":"0'0","ondisk_log_start":"0'0","created":12,"last_epoch_clean":13,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-08-01T19:53:57.959448+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-08-01T19:53:57.959448+0000","last_clean_scrub_stamp":"2023-08-01T19:53:57.959448+0000","objects_scrubbed":0,"log_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-08-03T04:50:42.368892+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[1,0],"acting":[1,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":1,"acting_primary":1,"purged_snaps":[]},{"pgid":"3.3","version":"0'0","reported_seq":13,"reported_epoch":20,"state":"active+clean","last_fresh":"2023-08-01T19:54:23.131926+0000","last_change":"2023-08-01T19:54:04.065415+0000","last_active":"2023-08-01T19:54:23.131926+0000","last_peered":"2023-08-01T19:54:23.131926+0000","last_clean":"2023-08-01T19:54:23.131926+0000","last_became_active":"2023-08-01T19:54:04.065030+0000","last_became_peered":"2023-08-01T19:54:04.065030+0000","last_unstale":"2023-08-01T19:54:23.131926+0000","last_undegraded":"2023-08-01T19:54:23.131926+0000","last_fullsized":"2023-08-01T19:54:23.131926+0000","mapping_epoch":15,"log_start":"0'0","ondisk_log_start":"0'0","created":15,"last_epoch_clean":16,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-08-01T19:54:03.032665+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-08-01T19:54:03.032665+0000","last_clean_scrub_stamp":"2023-08-01T19:54:03.032665+0000","objects_scrubbed":0,"log_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-08-02T21:33:27.007118+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[1,0],"acting":[1,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":1,"acting_primary":1,"purged_snaps":[]},{"pgid":"4.4","version":"0'0","reported_seq":12,"reported_epoch":20,"state":"active+clean","last_fresh":"2023-08-01T19:54:23.136596+0000","last_change":"2023-08-01T19:54:04.468101+0000","last_active":"2023-08-01T19:54:23.136596+0000","last_peered":"2023-08-01T19:54:23.136596+0000","last_clean":"2023-08-01T19:54:23.136596+0000","last_became_active":"2023-08-01T19:54:04.467409+0000","last_became_peered":"2023-08-01T19:54:04.467409+0000","last_unstale":"2023-08-01T19:54:23.136596+0000","last_undegraded":"2023-08-01T19:54:23.136596+0000","last_fullsized":"2023-08-01T19:54:23.136596+0000","mapping_epoch":16,"log_start":"0'0","ondisk_log_start":"0'0","created":16,"last_epoch_clean":17,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-08-01T19:54:04.040663+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-08-01T19:54:04.040663+0000","last_clean_scrub_stamp":"2023-08-01T19:54:04.040663+0000","objects_scrubbed":0,"log_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-08-02T21:43:30.325991+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[0,2],"acting":[0,2],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":0,"acting_primary":0,"purged_snaps":[]},{"pgid":"5.6","version":"21'162","reported_seq":171,"reported_epoch":21,"state":"active+clean","last_fresh":"2023-08-01T19:54:24.911336+0000","last_change":"2023-08-01T19:54:23.138275+0000","last_active":"2023-08-01T19:54:24.911336+0000","last_peered":"2023-08-01T19:54:24.911336+0000","last_clean":"2023-08-01T19:54:24.911336+0000","last_became_active":"2023-08-01T19:54:23.137973+0000","last_became_peered":"2023-08-01T19:54:23.137973+0000","last_unstale":"2023-08-01T19:54:24.911336+0000","last_undegraded":"2023-08-01T19:54:24.911336+0000","last_fullsized":"2023-08-01T19:54:24.911336+0000","mapping_epoch":19,"log_start":"0'0","ondisk_log_start":"0'0","created":19,"last_epoch_clean":20,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-08-01T19:54:22.116710+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-08-01T19:54:22.116710+0000","last_clean_scrub_stamp":"2023-08-01T19:54:22.116710+0000","objects_scrubbed":0,"log_size":162,"ondisk_log_size":162,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-08-03T01:19:10.526905+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":10616832,"num_objects":162,"num_object_clones":0,"num_object_copies":324,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":162,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":162,"num_write_kb":10368,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[0,1],"acting":[0,1],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":0,"acting_primary":0,"purged_snaps":[]},{"pgid":"2.1","version":"0'0","reported_seq":16,"reported_epoch":20,"state":"active+clean","last_fresh":"2023-08-01T19:54:23.136018+0000","last_change":"2023-08-01T19:53:58.973700+0000","last_active":"2023-08-01T19:54:23.136018+0000","last_peered":"2023-08-01T19:54:23.136018+0000","last_clean":"2023-08-01T19:54:23.136018+0000","last_became_active":"2023-08-01T19:53:58.973285+0000","last_became_peered":"2023-08-01T19:53:58.973285+0000","last_unstale":"2023-08-01T19:54:23.136018+0000","last_undegraded":"2023-08-01T19:54:23.136018+0000","last_fullsized":"2023-08-01T19:54:23.136018+0000","mapping_epoch":12,"log_start":"0'0","ondisk_log_start":"0'0","created":12,"last_epoch_clean":13,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-08-01T19:53:57.959448+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-08-01T19:53:57.959448+0000","last_clean_scrub_stamp":"2023-08-01T19:53:57.959448+0000","objects_scrubbed":0,"log_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-08-02T21:26:02.570824+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[0,2],"acting":[0,2],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":0,"acting_primary":0,"purged_snaps":[]},{"pgid":"3.0","version":"0'0","reported_seq":10,"reported_epoch":17,"state":"active+clean","last_fresh":"2023-08-01T19:54:04.457828+0000","last_change":"2023-08-01T19:54:04.064407+0000","last_active":"2023-08-01T19:54:04.457828+0000","last_peered":"2023-08-01T19:54:04.457828+0000","last_clean":"2023-08-01T19:54:04.457828+0000","last_became_active":"2023-08-01T19:54:04.064122+0000","last_became_peered":"2023-08-01T19:54:04.064122+0000","last_unstale":"2023-08-01T19:54:04.457828+0000","last_undegraded":"2023-08-01T19:54:04.457828+0000","last_fullsized":"2023-08-01T19:54:04.457828+0000","mapping_epoch":15,"log_start":"0'0","ondisk_log_start":"0'0","created":15,"last_epoch_clean":16,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-08-01T19:54:03.032665+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-08-01T19:54:03.032665+0000","last_clean_scrub_stamp":"2023-08-01T19:54:03.032665+0000","objects_scrubbed":0,"log_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-08-03T07:08:17.318689+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[2,1],"acting":[2,1],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":2,"acting_primary":2,"purged_snaps":[]},{"pgid":"4.7","version":"0'0","reported_seq":12,"reported_epoch":20,"state":"active+clean","last_fresh":"2023-08-01T19:54:23.137587+0000","last_change":"2023-08-01T19:54:04.469739+0000","last_active":"2023-08-01T19:54:23.137587+0000","last_peered":"2023-08-01T19:54:23.137587+0000","last_clean":"2023-08-01T19:54:23.137587+0000","last_became_active":"2023-08-01T19:54:04.468021+0000","last_became_peered":"2023-08-01T19:54:04.468021+0000","last_unstale":"2023-08-01T19:54:23.137587+0000","last_undegraded":"2023-08-01T19:54:23.137587+0000","last_fullsized":"2023-08-01T19:54:23.137587+0000","mapping_epoch":16,"log_start":"0'0","ondisk_log_start":"0'0","created":16,"last_epoch_clean":17,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-08-01T19:54:04.040663+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-08-01T19:54:04.040663+0000","last_clean_scrub_stamp":"2023-08-01T19:54:04.040663+0000","objects_scrubbed":0,"log_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-08-02T21:03:01.319028+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[0,2],"acting":[0,2],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":0,"acting_primary":0,"purged_snaps":[]},{"pgid":"5.4","version":"0'0","reported_seq":0,"reported_epoch":0,"state":"unknown","last_fresh":"2023-08-01T19:54:22.116710+0000","last_change":"2023-08-01T19:54:22.116710+0000","last_active":"2023-08-01T19:54:22.116710+0000","last_peered":"2023-08-01T19:54:22.116710+0000","last_clean":"2023-08-01T19:54:22.116710+0000","last_became_active":"0.000000","last_became_peered":"0.000000","last_unstale":"2023-08-01T19:54:22.116710+0000","last_undegraded":"2023-08-01T19:54:22.116710+0000","last_fullsized":"2023-08-01T19:54:22.116710+0000","mapping_epoch":0,"log_start":"0'0","ondisk_log_start":"0'0","created":0,"last_epoch_clean":0,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-08-01T19:54:22.116710+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-08-01T19:54:22.116710+0000","last_clean_scrub_stamp":"2023-08-01T19:54:22.116710+0000","objects_scrubbed":0,"log_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"--","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[],"acting":[],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":-1,"acting_primary":-1,"purged_snaps":[]},{"pgid":"2.3","version":"0'0","reported_seq":16,"reported_epoch":20,"state":"active+clean","last_fresh":"2023-08-01T19:54:23.131939+0000","last_change":"2023-08-01T19:53:58.973768+0000","last_active":"2023-08-01T19:54:23.131939+0000","last_peered":"2023-08-01T19:54:23.131939+0000","last_clean":"2023-08-01T19:54:23.131939+0000","last_became_active":"2023-08-01T19:53:58.973492+0000","last_became_peered":"2023-08-01T19:53:58.973492+0000","last_unstale":"2023-08-01T19:54:23.131939+0000","last_undegraded":"2023-08-01T19:54:23.131939+0000","last_fullsized":"2023-08-01T19:54:23.131939+0000","mapping_epoch":12,"log_start":"0'0","ondisk_log_start":"0'0","created":12,"last_epoch_clean":13,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-08-01T19:53:57.959448+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-08-01T19:53:57.959448+0000","last_clean_scrub_stamp":"2023-08-01T19:53:57.959448+0000","objects_scrubbed":0,"log_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-08-03T02:04:52.034667+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[1,0],"acting":[1,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":1,"acting_primary":1,"purged_snaps":[]},{"pgid":"1.0","version":"10'157","reported_seq":215,"reported_epoch":20,"state":"active+clean","last_fresh":"2023-08-01T19:54:23.131367+0000","last_change":"2023-08-01T19:53:51.746910+0000","last_active":"2023-08-01T19:54:23.131367+0000","last_peered":"2023-08-01T19:54:23.131367+0000","last_clean":"2023-08-01T19:54:23.131367+0000","last_became_active":"2023-08-01T19:53:51.746590+0000","last_became_peered":"2023-08-01T19:53:51.746590+0000","last_unstale":"2023-08-01T19:54:23.131367+0000","last_undegraded":"2023-08-01T19:54:23.131367+0000","last_fullsized":"2023-08-01T19:54:23.131367+0000","mapping_epoch":9,"log_start":"0'0","ondisk_log_start":"0'0","created":9,"last_epoch_clean":10,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-08-01T19:53:50.735626+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-08-01T19:53:50.735626+0000","last_clean_scrub_stamp":"2023-08-01T19:53:50.735626+0000","objects_scrubbed":0,"log_size":157,"ondisk_log_size":157,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-08-03T02:56:50.228294+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":590368,"num_objects":2,"num_object_clones":0,"num_object_copies":4,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":2,"num_whiteouts":0,"num_read":136,"num_read_kb":118,"num_write":203,"num_write_kb":3460,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[1,2],"acting":[1,2],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":1,"acting_primary":1,"purged_snaps":[]},{"pgid":"3.2","version":"0'0","reported_seq":13,"reported_epoch":20,"state":"active+clean","last_fresh":"2023-08-01T19:54:23.135765+0000","last_change":"2023-08-01T19:54:04.064009+0000","last_active":"2023-08-01T19:54:23.135765+0000","last_peered":"2023-08-01T19:54:23.135765+0000","last_clean":"2023-08-01T19:54:23.135765+0000","last_became_active":"2023-08-01T19:54:04.063665+0000","last_became_peered":"2023-08-01T19:54:04.063665+0000","last_unstale":"2023-08-01T19:54:23.135765+0000","last_undegraded":"2023-08-01T19:54:23.135765+0000","last_fullsized":"2023-08-01T19:54:23.135765+0000","mapping_epoch":15,"log_start":"0'0","ondisk_log_start":"0'0","created":15,"last_epoch_clean":16,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-08-01T19:54:03.032665+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-08-01T19:54:03.032665+0000","last_clean_scrub_stamp":"2023-08-01T19:54:03.032665+0000","objects_scrubbed":0,"log_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-08-03T04:04:46.983253+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[0,2],"acting":[0,2],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":0,"acting_primary":0,"purged_snaps":[]},{"pgid":"4.5","version":"0'0","reported_seq":12,"reported_epoch":20,"state":"active+clean","last_fresh":"2023-08-01T19:54:23.132327+0000","last_change":"2023-08-01T19:54:04.474061+0000","last_active":"2023-08-01T19:54:23.132327+0000","last_peered":"2023-08-01T19:54:23.132327+0000","last_clean":"2023-08-01T19:54:23.132327+0000","last_became_active":"2023-08-01T19:54:04.472128+0000","last_became_peered":"2023-08-01T19:54:04.472128+0000","last_unstale":"2023-08-01T19:54:23.132327+0000","last_undegraded":"2023-08-01T19:54:23.132327+0000","last_fullsized":"2023-08-01T19:54:23.132327+0000","mapping_epoch":16,"log_start":"0'0","ondisk_log_start":"0'0","created":16,"last_epoch_clean":17,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-08-01T19:54:04.040663+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-08-01T19:54:04.040663+0000","last_clean_scrub_stamp":"2023-08-01T19:54:04.040663+0000","objects_scrubbed":0,"log_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-08-03T00:29:05.857138+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[1,2],"acting":[1,2],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":1,"acting_primary":1,"purged_snaps":[]},{"pgid":"5.7","version":"21'150","reported_seq":158,"reported_epoch":21,"state":"active+clean","last_fresh":"2023-08-01T19:54:24.909300+0000","last_change":"2023-08-01T19:54:23.138337+0000","last_active":"2023-08-01T19:54:24.909300+0000","last_peered":"2023-08-01T19:54:24.909300+0000","last_clean":"2023-08-01T19:54:24.909300+0000","last_became_active":"2023-08-01T19:54:23.138056+0000","last_became_peered":"2023-08-01T19:54:23.138056+0000","last_unstale":"2023-08-01T19:54:24.909300+0000","last_undegraded":"2023-08-01T19:54:24.909300+0000","last_fullsized":"2023-08-01T19:54:24.909300+0000","mapping_epoch":19,"log_start":"0'0","ondisk_log_start":"0'0","created":19,"last_epoch_clean":20,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-08-01T19:54:22.116710+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-08-01T19:54:22.116710+0000","last_clean_scrub_stamp":"2023-08-01T19:54:22.116710+0000","objects_scrubbed":0,"log_size":150,"ondisk_log_size":150,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-08-03T06:58:19.846492+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":9830400,"num_objects":150,"num_object_clones":0,"num_object_copies":300,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":150,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":150,"num_write_kb":9600,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[1,0],"acting":[1,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":1,"acting_primary":1,"purged_snaps":[]},{"pgid":"2.0","version":"0'0","reported_seq":16,"reported_epoch":20,"state":"active+clean","last_fresh":"2023-08-01T19:54:23.131447+0000","last_change":"2023-08-01T19:53:58.975968+0000","last_active":"2023-08-01T19:54:23.131447+0000","last_peered":"2023-08-01T19:54:23.131447+0000","last_clean":"2023-08-01T19:54:23.131447+0000","last_became_active":"2023-08-01T19:53:58.975706+0000","last_became_peered":"2023-08-01T19:53:58.975706+0000","last_unstale":"2023-08-01T19:54:23.131447+0000","last_undegraded":"2023-08-01T19:54:23.131447+0000","last_fullsized":"2023-08-01T19:54:23.131447+0000","mapping_epoch":12,"log_start":"0'0","ondisk_log_start":"0'0","created":12,"last_epoch_clean":13,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-08-01T19:53:57.959448+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-08-01T19:53:57.959448+0000","last_clean_scrub_stamp":"2023-08-01T19:53:57.959448+0000","objects_scrubbed":0,"log_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-08-03T00:02:15.204280+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[1,2],"acting":[1,2],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":1,"acting_primary":1,"purged_snaps":[]},{"pgid":"3.1","version":"0'0","reported_seq":13,"reported_epoch":20,"state":"active+clean","last_fresh":"2023-08-01T19:54:23.135542+0000","last_change":"2023-08-01T19:54:04.066707+0000","last_active":"2023-08-01T19:54:23.135542+0000","last_peered":"2023-08-01T19:54:23.135542+0000","last_clean":"2023-08-01T19:54:23.135542+0000","last_became_active":"2023-08-01T19:54:04.066334+0000","last_became_peered":"2023-08-01T19:54:04.066334+0000","last_unstale":"2023-08-01T19:54:23.135542+0000","last_undegraded":"2023-08-01T19:54:23.135542+0000","last_fullsized":"2023-08-01T19:54:23.135542+0000","mapping_epoch":15,"log_start":"0'0","ondisk_log_start":"0'0","created":15,"last_epoch_clean":16,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-08-01T19:54:03.032665+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-08-01T19:54:03.032665+0000","last_clean_scrub_stamp":"2023-08-01T19:54:03.032665+0000","objects_scrubbed":0,"log_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-08-03T02:40:15.210599+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[0,1],"acting":[0,1],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":0,"acting_primary":0,"purged_snaps":[]},{"pgid":"4.6","version":"0'0","reported_seq":9,"reported_epoch":17,"state":"active+clean","last_fresh":"2023-08-01T19:54:04.471325+0000","last_change":"2023-08-01T19:54:04.469877+0000","last_active":"2023-08-01T19:54:04.471325+0000","last_peered":"2023-08-01T19:54:04.471325+0000","last_clean":"2023-08-01T19:54:04.471325+0000","last_became_active":"2023-08-01T19:54:04.469528+0000","last_became_peered":"2023-08-01T19:54:04.469528+0000","last_unstale":"2023-08-01T19:54:04.471325+0000","last_undegraded":"2023-08-01T19:54:04.471325+0000","last_fullsized":"2023-08-01T19:54:04.471325+0000","mapping_epoch":16,"log_start":"0'0","ondisk_log_start":"0'0","created":16,"last_epoch_clean":17,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-08-01T19:54:04.040663+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-08-01T19:54:04.040663+0000","last_clean_scrub_stamp":"2023-08-01T19:54:04.040663+0000","objects_scrubbed":0,"log_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-08-03T02:24:19.067602+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[2,0],"acting":[2,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":2,"acting_primary":2,"purged_snaps":[]},{"pgid":"5.2","version":"21'144","reported_seq":153,"reported_epoch":21,"state":"active+clean","last_fresh":"2023-08-01T19:54:24.899768+0000","last_change":"2023-08-01T19:54:23.138339+0000","last_active":"2023-08-01T19:54:24.899768+0000","last_peered":"2023-08-01T19:54:24.899768+0000","last_clean":"2023-08-01T19:54:24.899768+0000","last_became_active":"2023-08-01T19:54:23.137962+0000","last_became_peered":"2023-08-01T19:54:23.137962+0000","last_unstale":"2023-08-01T19:54:24.899768+0000","last_undegraded":"2023-08-01T19:54:24.899768+0000","last_fullsized":"2023-08-01T19:54:24.899768+0000","mapping_epoch":19,"log_start":"0'0","ondisk_log_start":"0'0","created":19,"last_epoch_clean":20,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-08-01T19:54:22.116710+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-08-01T19:54:22.116710+0000","last_clean_scrub_stamp":"2023-08-01T19:54:22.116710+0000","objects_scrubbed":0,"log_size":144,"ondisk_log_size":144,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-08-03T01:46:33.457242+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":9437184,"num_objects":144,"num_object_clones":0,"num_object_copies":288,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":144,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":144,"num_write_kb":9216,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[1,0],"acting":[1,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":1,"acting_primary":1,"purged_snaps":[]},{"pgid":"2.5","version":"0'0","reported_seq":13,"reported_epoch":17,"state":"active+clean","last_fresh":"2023-08-01T19:54:04.459098+0000","last_change":"2023-08-01T19:53:58.970683+0000","last_active":"2023-08-01T19:54:04.459098+0000","last_peered":"2023-08-01T19:54:04.459098+0000","last_clean":"2023-08-01T19:54:04.459098+0000","last_became_active":"2023-08-01T19:53:58.970437+0000","last_became_peered":"2023-08-01T19:53:58.970437+0000","last_unstale":"2023-08-01T19:54:04.459098+0000","last_undegraded":"2023-08-01T19:54:04.459098+0000","last_fullsized":"2023-08-01T19:54:04.459098+0000","mapping_epoch":12,"log_start":"0'0","ondisk_log_start":"0'0","created":12,"last_epoch_clean":13,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-08-01T19:53:57.959448+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-08-01T19:53:57.959448+0000","last_clean_scrub_stamp":"2023-08-01T19:53:57.959448+0000","objects_scrubbed":0,"log_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-08-02T23:54:08.273426+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[2,0],"acting":[2,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":2,"acting_primary":2,"purged_snaps":[]},{"pgid":"3.4","version":"0'0","reported_seq":13,"reported_epoch":20,"state":"active+clean","last_fresh":"2023-08-01T19:54:23.136482+0000","last_change":"2023-08-01T19:54:04.062283+0000","last_active":"2023-08-01T19:54:23.136482+0000","last_peered":"2023-08-01T19:54:23.136482+0000","last_clean":"2023-08-01T19:54:23.136482+0000","last_became_active":"2023-08-01T19:54:04.061796+0000","last_became_peered":"2023-08-01T19:54:04.061796+0000","last_unstale":"2023-08-01T19:54:23.136482+0000","last_undegraded":"2023-08-01T19:54:23.136482+0000","last_fullsized":"2023-08-01T19:54:23.136482+0000","mapping_epoch":15,"log_start":"0'0","ondisk_log_start":"0'0","created":15,"last_epoch_clean":16,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-08-01T19:54:03.032665+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-08-01T19:54:03.032665+0000","last_clean_scrub_stamp":"2023-08-01T19:54:03.032665+0000","objects_scrubbed":0,"log_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-08-02T19:54:08.401797+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[0,2],"acting":[0,2],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":0,"acting_primary":0,"purged_snaps":[]},{"pgid":"4.3","version":"0'0","reported_seq":9,"reported_epoch":17,"state":"active+clean","last_fresh":"2023-08-01T19:54:04.474487+0000","last_change":"2023-08-01T19:54:04.473088+0000","last_active":"2023-08-01T19:54:04.474487+0000","last_peered":"2023-08-01T19:54:04.474487+0000","last_clean":"2023-08-01T19:54:04.474487+0000","last_became_active":"2023-08-01T19:54:04.472611+0000","last_became_peered":"2023-08-01T19:54:04.472611+0000","last_unstale":"2023-08-01T19:54:04.474487+0000","last_undegraded":"2023-08-01T19:54:04.474487+0000","last_fullsized":"2023-08-01T19:54:04.474487+0000","mapping_epoch":16,"log_start":"0'0","ondisk_log_start":"0'0","created":16,"last_epoch_clean":17,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-08-01T19:54:04.040663+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-08-01T19:54:04.040663+0000","last_clean_scrub_stamp":"2023-08-01T19:54:04.040663+0000","objects_scrubbed":0,"log_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-08-03T07:27:26.537518+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[2,1],"acting":[2,1],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":2,"acting_primary":2,"purged_snaps":[]},{"pgid":"5.1","version":"21'159","reported_seq":168,"reported_epoch":21,"state":"active+clean","last_fresh":"2023-08-01T19:54:24.916313+0000","last_change":"2023-08-01T19:54:23.138225+0000","last_active":"2023-08-01T19:54:24.916313+0000","last_peered":"2023-08-01T19:54:24.916313+0000","last_clean":"2023-08-01T19:54:24.916313+0000","last_became_active":"2023-08-01T19:54:23.137955+0000","last_became_peered":"2023-08-01T19:54:23.137955+0000","last_unstale":"2023-08-01T19:54:24.916313+0000","last_undegraded":"2023-08-01T19:54:24.916313+0000","last_fullsized":"2023-08-01T19:54:24.916313+0000","mapping_epoch":19,"log_start":"0'0","ondisk_log_start":"0'0","created":19,"last_epoch_clean":20,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-08-01T19:54:22.116710+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-08-01T19:54:22.116710+0000","last_clean_scrub_stamp":"2023-08-01T19:54:22.116710+0000","objects_scrubbed":0,"log_size":159,"ondisk_log_size":159,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-08-03T03:58:00.471919+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":10420224,"num_objects":159,"num_object_clones":0,"num_object_copies":318,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":159,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":159,"num_write_kb":10176,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[1,0],"acting":[1,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":1,"acting_primary":1,"purged_snaps":[]},{"pgid":"3.7","version":"17'2","reported_seq":15,"reported_epoch":20,"state":"active+clean","last_fresh":"2023-08-01T19:54:23.136730+0000","last_change":"2023-08-01T19:54:04.065147+0000","last_active":"2023-08-01T19:54:23.136730+0000","last_peered":"2023-08-01T19:54:23.136730+0000","last_clean":"2023-08-01T19:54:23.136730+0000","last_became_active":"2023-08-01T19:54:04.064779+0000","last_became_peered":"2023-08-01T19:54:04.064779+0000","last_unstale":"2023-08-01T19:54:23.136730+0000","last_undegraded":"2023-08-01T19:54:23.136730+0000","last_fullsized":"2023-08-01T19:54:23.136730+0000","mapping_epoch":15,"log_start":"0'0","ondisk_log_start":"0'0","created":15,"last_epoch_clean":16,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-08-01T19:54:03.032665+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-08-01T19:54:03.032665+0000","last_clean_scrub_stamp":"2023-08-01T19:54:03.032665+0000","objects_scrubbed":0,"log_size":2,"ondisk_log_size":2,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-08-03T03:43:45.667663+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":1,"num_object_clones":0,"num_object_copies":2,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":1,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":3,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":1,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[0,2],"acting":[0,2],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":0,"acting_primary":0,"purged_snaps":[]},{"pgid":"2.6","version":"0'0","reported_seq":16,"reported_epoch":20,"state":"active+clean","last_fresh":"2023-08-01T19:54:23.137547+0000","last_change":"2023-08-01T19:53:58.974077+0000","last_active":"2023-08-01T19:54:23.137547+0000","last_peered":"2023-08-01T19:54:23.137547+0000","last_clean":"2023-08-01T19:54:23.137547+0000","last_became_active":"2023-08-01T19:53:58.973396+0000","last_became_peered":"2023-08-01T19:53:58.973396+0000","last_unstale":"2023-08-01T19:54:23.137547+0000","last_undegraded":"2023-08-01T19:54:23.137547+0000","last_fullsized":"2023-08-01T19:54:23.137547+0000","mapping_epoch":12,"log_start":"0'0","ondisk_log_start":"0'0","created":12,"last_epoch_clean":13,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-08-01T19:53:57.959448+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-08-01T19:53:57.959448+0000","last_clean_scrub_stamp":"2023-08-01T19:53:57.959448+0000","objects_scrubbed":0,"log_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-08-02T22:13:50.940864+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[0,2],"acting":[0,2],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":0,"acting_primary":0,"purged_snaps":[]},{"pgid":"4.0","version":"0'0","reported_seq":12,"reported_epoch":20,"state":"active+clean","last_fresh":"2023-08-01T19:54:23.135471+0000","last_change":"2023-08-01T19:54:04.476807+0000","last_active":"2023-08-01T19:54:23.135471+0000","last_peered":"2023-08-01T19:54:23.135471+0000","last_clean":"2023-08-01T19:54:23.135471+0000","last_became_active":"2023-08-01T19:54:04.476453+0000","last_became_peered":"2023-08-01T19:54:04.476453+0000","last_unstale":"2023-08-01T19:54:23.135471+0000","last_undegraded":"2023-08-01T19:54:23.135471+0000","last_fullsized":"2023-08-01T19:54:23.135471+0000","mapping_epoch":16,"log_start":"0'0","ondisk_log_start":"0'0","created":16,"last_epoch_clean":17,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-08-01T19:54:04.040663+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-08-01T19:54:04.040663+0000","last_clean_scrub_stamp":"2023-08-01T19:54:04.040663+0000","objects_scrubbed":0,"log_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-08-02T20:20:59.989030+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[0,1],"acting":[0,1],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":0,"acting_primary":0,"purged_snaps":[]},{"pgid":"5.0","version":"0'0","reported_seq":0,"reported_epoch":0,"state":"unknown","last_fresh":"2023-08-01T19:54:22.116710+0000","last_change":"2023-08-01T19:54:22.116710+0000","last_active":"2023-08-01T19:54:22.116710+0000","last_peered":"2023-08-01T19:54:22.116710+0000","last_clean":"2023-08-01T19:54:22.116710+0000","last_became_active":"0.000000","last_became_peered":"0.000000","last_unstale":"2023-08-01T19:54:22.116710+0000","last_undegraded":"2023-08-01T19:54:22.116710+0000","last_fullsized":"2023-08-01T19:54:22.116710+0000","mapping_epoch":0,"log_start":"0'0","ondisk_log_start":"0'0","created":0,"last_epoch_clean":0,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-08-01T19:54:22.116710+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-08-01T19:54:22.116710+0000","last_clean_scrub_stamp":"2023-08-01T19:54:22.116710+0000","objects_scrubbed":0,"log_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"--","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[],"acting":[],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":-1,"acting_primary":-1,"purged_snaps":[]},{"pgid":"2.7","version":"0'0","reported_seq":16,"reported_epoch":20,"state":"active+clean","last_fresh":"2023-08-01T19:54:23.132360+0000","last_change":"2023-08-01T19:53:58.975936+0000","last_active":"2023-08-01T19:54:23.132360+0000","last_peered":"2023-08-01T19:54:23.132360+0000","last_clean":"2023-08-01T19:54:23.132360+0000","last_became_active":"2023-08-01T19:53:58.975680+0000","last_became_peered":"2023-08-01T19:53:58.975680+0000","last_unstale":"2023-08-01T19:54:23.132360+0000","last_undegraded":"2023-08-01T19:54:23.132360+0000","last_fullsized":"2023-08-01T19:54:23.132360+0000","mapping_epoch":12,"log_start":"0'0","ondisk_log_start":"0'0","created":12,"last_epoch_clean":13,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-08-01T19:53:57.959448+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-08-01T19:53:57.959448+0000","last_clean_scrub_stamp":"2023-08-01T19:53:57.959448+0000","objects_scrubbed":0,"log_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-08-03T05:17:03.508898+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[1,2],"acting":[1,2],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":1,"acting_primary":1,"purged_snaps":[]},{"pgid":"3.6","version":"18'1","reported_seq":14,"reported_epoch":20,"state":"active+clean","last_fresh":"2023-08-01T19:54:23.136665+0000","last_change":"2023-08-01T19:54:04.068041+0000","last_active":"2023-08-01T19:54:23.136665+0000","last_peered":"2023-08-01T19:54:23.136665+0000","last_clean":"2023-08-01T19:54:23.136665+0000","last_became_active":"2023-08-01T19:54:04.067613+0000","last_became_peered":"2023-08-01T19:54:04.067613+0000","last_unstale":"2023-08-01T19:54:23.136665+0000","last_undegraded":"2023-08-01T19:54:23.136665+0000","last_fullsized":"2023-08-01T19:54:23.136665+0000","mapping_epoch":15,"log_start":"0'0","ondisk_log_start":"0'0","created":15,"last_epoch_clean":16,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-08-01T19:54:03.032665+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-08-01T19:54:03.032665+0000","last_clean_scrub_stamp":"2023-08-01T19:54:03.032665+0000","objects_scrubbed":0,"log_size":1,"ondisk_log_size":1,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-08-02T21:35:44.874727+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":1,"num_object_clones":0,"num_object_copies":2,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":1,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":1,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":1,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[0,1],"acting":[0,1],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":0,"acting_primary":0,"purged_snaps":[]},{"pgid":"4.1","version":"0'0","reported_seq":9,"reported_epoch":17,"state":"active+clean","last_fresh":"2023-08-01T19:54:04.470826+0000","last_change":"2023-08-01T19:54:04.469243+0000","last_active":"2023-08-01T19:54:04.470826+0000","last_peered":"2023-08-01T19:54:04.470826+0000","last_clean":"2023-08-01T19:54:04.470826+0000","last_became_active":"2023-08-01T19:54:04.468835+0000","last_became_peered":"2023-08-01T19:54:04.468835+0000","last_unstale":"2023-08-01T19:54:04.470826+0000","last_undegraded":"2023-08-01T19:54:04.470826+0000","last_fullsized":"2023-08-01T19:54:04.470826+0000","mapping_epoch":16,"log_start":"0'0","ondisk_log_start":"0'0","created":16,"last_epoch_clean":17,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-08-01T19:54:04.040663+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-08-01T19:54:04.040663+0000","last_clean_scrub_stamp":"2023-08-01T19:54:04.040663+0000","objects_scrubbed":0,"log_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-08-03T04:43:58.358628+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[2,1],"acting":[2,1],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":2,"acting_primary":2,"purged_snaps":[]},{"pgid":"3.1b","version":"17'1","reported_seq":11,"reported_epoch":17,"state":"active+clean","last_fresh":"2023-08-01T19:54:04.471524+0000","last_change":"2023-08-01T19:54:04.066748+0000","last_active":"2023-08-01T19:54:04.471524+0000","last_peered":"2023-08-01T19:54:04.471524+0000","last_clean":"2023-08-01T19:54:04.471524+0000","last_became_active":"2023-08-01T19:54:04.066483+0000","last_became_peered":"2023-08-01T19:54:04.066483+0000","last_unstale":"2023-08-01T19:54:04.471524+0000","last_undegraded":"2023-08-01T19:54:04.471524+0000","last_fullsized":"2023-08-01T19:54:04.471524+0000","mapping_epoch":15,"log_start":"0'0","ondisk_log_start":"0'0","created":15,"last_epoch_clean":16,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-08-01T19:54:03.032665+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-08-01T19:54:03.032665+0000","last_clean_scrub_stamp":"2023-08-01T19:54:03.032665+0000","objects_scrubbed":0,"log_size":1,"ondisk_log_size":1,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-08-03T03:08:26.880362+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[2,1],"acting":[2,1],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":2,"acting_primary":2,"purged_snaps":[]},{"pgid":"4.1c","version":"0'0","reported_seq":9,"reported_epoch":17,"state":"active+clean","last_fresh":"2023-08-01T19:54:04.468766+0000","last_change":"2023-08-01T19:54:04.466766+0000","last_active":"2023-08-01T19:54:04.468766+0000","last_peered":"2023-08-01T19:54:04.468766+0000","last_clean":"2023-08-01T19:54:04.468766+0000","last_became_active":"2023-08-01T19:54:04.466417+0000","last_became_peered":"2023-08-01T19:54:04.466417+0000","last_unstale":"2023-08-01T19:54:04.468766+0000","last_undegraded":"2023-08-01T19:54:04.468766+0000","last_fullsized":"2023-08-01T19:54:04.468766+0000","mapping_epoch":16,"log_start":"0'0","ondisk_log_start":"0'0","created":16,"last_epoch_clean":17,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-08-01T19:54:04.040663+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-08-01T19:54:04.040663+0000","last_clean_scrub_stamp":"2023-08-01T19:54:04.040663+0000","objects_scrubbed":0,"log_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-08-02T22:01:53.643825+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[2,0],"acting":[2,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":2,"acting_primary":2,"purged_snaps":[]},{"pgid":"3.1c","version":"17'2","reported_seq":15,"reported_epoch":20,"state":"active+clean","last_fresh":"2023-08-01T19:54:23.131700+0000","last_change":"2023-08-01T19:54:04.065706+0000","last_active":"2023-08-01T19:54:23.131700+0000","last_peered":"2023-08-01T19:54:23.131700+0000","last_clean":"2023-08-01T19:54:23.131700+0000","last_became_active":"2023-08-01T19:54:04.064796+0000","last_became_peered":"2023-08-01T19:54:04.064796+0000","last_unstale":"2023-08-01T19:54:23.131700+0000","last_undegraded":"2023-08-01T19:54:23.131700+0000","last_fullsized":"2023-08-01T19:54:23.131700+0000","mapping_epoch":15,"log_start":"0'0","ondisk_log_start":"0'0","created":15,"last_epoch_clean":16,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-08-01T19:54:03.032665+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-08-01T19:54:03.032665+0000","last_clean_scrub_stamp":"2023-08-01T19:54:03.032665+0000","objects_scrubbed":0,"log_size":2,"ondisk_log_size":2,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-08-02T21:40:43.596301+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":1,"num_object_clones":0,"num_object_copies":2,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":1,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":3,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":1,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[1,0],"acting":[1,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":1,"acting_primary":1,"purged_snaps":[]},{"pgid":"4.1b","version":"0'0","reported_seq":12,"reported_epoch":20,"state":"active+clean","last_fresh":"2023-08-01T19:54:23.131859+0000","last_change":"2023-08-01T19:54:04.474971+0000","last_active":"2023-08-01T19:54:23.131859+0000","last_peered":"2023-08-01T19:54:23.131859+0000","last_clean":"2023-08-01T19:54:23.131859+0000","last_became_active":"2023-08-01T19:54:04.473957+0000","last_became_peered":"2023-08-01T19:54:04.473957+0000","last_unstale":"2023-08-01T19:54:23.131859+0000","last_undegraded":"2023-08-01T19:54:23.131859+0000","last_fullsized":"2023-08-01T19:54:23.131859+0000","mapping_epoch":16,"log_start":"0'0","ondisk_log_start":"0'0","created":16,"last_epoch_clean":17,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-08-01T19:54:04.040663+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-08-01T19:54:04.040663+0000","last_clean_scrub_stamp":"2023-08-01T19:54:04.040663+0000","objects_scrubbed":0,"log_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-08-02T21:59:19.682560+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[1,0],"acting":[1,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":1,"acting_primary":1,"purged_snaps":[]},{"pgid":"3.1d","version":"17'2","reported_seq":12,"reported_epoch":17,"state":"active+clean","last_fresh":"2023-08-01T19:54:04.471623+0000","last_change":"2023-08-01T19:54:04.065591+0000","last_active":"2023-08-01T19:54:04.471623+0000","last_peered":"2023-08-01T19:54:04.471623+0000","last_clean":"2023-08-01T19:54:04.471623+0000","last_became_active":"2023-08-01T19:54:04.065306+0000","last_became_peered":"2023-08-01T19:54:04.065306+0000","last_unstale":"2023-08-01T19:54:04.471623+0000","last_undegraded":"2023-08-01T19:54:04.471623+0000","last_fullsized":"2023-08-01T19:54:04.471623+0000","mapping_epoch":15,"log_start":"0'0","ondisk_log_start":"0'0","created":15,"last_epoch_clean":16,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-08-01T19:54:03.032665+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-08-01T19:54:03.032665+0000","last_clean_scrub_stamp":"2023-08-01T19:54:03.032665+0000","objects_scrubbed":0,"log_size":2,"ondisk_log_size":2,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-08-02T21:32:10.389227+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":1,"num_object_clones":0,"num_object_copies":2,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":1,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":3,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":1,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[2,1],"acting":[2,1],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":2,"acting_primary":2,"purged_snaps":[]},{"pgid":"4.1a","version":"0'0","reported_seq":12,"reported_epoch":20,"state":"active+clean","last_fresh":"2023-08-01T19:54:23.131900+0000","last_change":"2023-08-01T19:54:04.473302+0000","last_active":"2023-08-01T19:54:23.131900+0000","last_peered":"2023-08-01T19:54:23.131900+0000","last_clean":"2023-08-01T19:54:23.131900+0000","last_became_active":"2023-08-01T19:54:04.472452+0000","last_became_peered":"2023-08-01T19:54:04.472452+0000","last_unstale":"2023-08-01T19:54:23.131900+0000","last_undegraded":"2023-08-01T19:54:23.131900+0000","last_fullsized":"2023-08-01T19:54:23.131900+0000","mapping_epoch":16,"log_start":"0'0","ondisk_log_start":"0'0","created":16,"last_epoch_clean":17,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-08-01T19:54:04.040663+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-08-01T19:54:04.040663+0000","last_clean_scrub_stamp":"2023-08-01T19:54:04.040663+0000","objects_scrubbed":0,"log_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-08-02T21:02:39.542019+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[1,0],"acting":[1,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":1,"acting_primary":1,"purged_snaps":[]},{"pgid":"3.1e","version":"17'1","reported_seq":14,"reported_epoch":20,"state":"active+clean","last_fresh":"2023-08-01T19:54:23.136929+0000","last_change":"2023-08-01T19:54:04.064378+0000","last_active":"2023-08-01T19:54:23.136929+0000","last_peered":"2023-08-01T19:54:23.136929+0000","last_clean":"2023-08-01T19:54:23.136929+0000","last_became_active":"2023-08-01T19:54:04.063988+0000","last_became_peered":"2023-08-01T19:54:04.063988+0000","last_unstale":"2023-08-01T19:54:23.136929+0000","last_undegraded":"2023-08-01T19:54:23.136929+0000","last_fullsized":"2023-08-01T19:54:23.136929+0000","mapping_epoch":15,"log_start":"0'0","ondisk_log_start":"0'0","created":15,"last_epoch_clean":16,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-08-01T19:54:03.032665+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-08-01T19:54:03.032665+0000","last_clean_scrub_stamp":"2023-08-01T19:54:03.032665+0000","objects_scrubbed":0,"log_size":1,"ondisk_log_size":1,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-08-02T22:28:51.936138+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[0,2],"acting":[0,2],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":0,"acting_primary":0,"purged_snaps":[]},{"pgid":"4.19","version":"0'0","reported_seq":9,"reported_epoch":17,"state":"active+clean","last_fresh":"2023-08-01T19:54:04.469620+0000","last_change":"2023-08-01T19:54:04.467017+0000","last_active":"2023-08-01T19:54:04.469620+0000","last_peered":"2023-08-01T19:54:04.469620+0000","last_clean":"2023-08-01T19:54:04.469620+0000","last_became_active":"2023-08-01T19:54:04.466339+0000","last_became_peered":"2023-08-01T19:54:04.466339+0000","last_unstale":"2023-08-01T19:54:04.469620+0000","last_undegraded":"2023-08-01T19:54:04.469620+0000","last_fullsized":"2023-08-01T19:54:04.469620+0000","mapping_epoch":16,"log_start":"0'0","ondisk_log_start":"0'0","created":16,"last_epoch_clean":17,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-08-01T19:54:04.040663+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-08-01T19:54:04.040663+0000","last_clean_scrub_stamp":"2023-08-01T19:54:04.040663+0000","objects_scrubbed":0,"log_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-08-03T04:07:57.222873+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[2,0],"acting":[2,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":2,"acting_primary":2,"purged_snaps":[]},{"pgid":"3.1f","version":"17'4","reported_seq":17,"reported_epoch":20,"state":"active+clean","last_fresh":"2023-08-01T19:54:23.136838+0000","last_change":"2023-08-01T19:54:04.067767+0000","last_active":"2023-08-01T19:54:23.136838+0000","last_peered":"2023-08-01T19:54:23.136838+0000","last_clean":"2023-08-01T19:54:23.136838+0000","last_became_active":"2023-08-01T19:54:04.067414+0000","last_became_peered":"2023-08-01T19:54:04.067414+0000","last_unstale":"2023-08-01T19:54:23.136838+0000","last_undegraded":"2023-08-01T19:54:23.136838+0000","last_fullsized":"2023-08-01T19:54:23.136838+0000","mapping_epoch":15,"log_start":"0'0","ondisk_log_start":"0'0","created":15,"last_epoch_clean":16,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-08-01T19:54:03.032665+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-08-01T19:54:03.032665+0000","last_clean_scrub_stamp":"2023-08-01T19:54:03.032665+0000","objects_scrubbed":0,"log_size":4,"ondisk_log_size":4,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-08-02T21:33:27.007118+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":554,"num_objects":2,"num_object_clones":0,"num_object_copies":4,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":2,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":4,"num_write_kb":1,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":1,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[0,1],"acting":[0,1],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":0,"acting_primary":0,"purged_snaps":[]},{"pgid":"4.18","version":"0'0","reported_seq":12,"reported_epoch":20,"state":"active+clean","last_fresh":"2023-08-01T19:54:23.131835+0000","last_change":"2023-08-01T19:54:04.477588+0000","last_active":"2023-08-01T19:54:23.131835+0000","last_peered":"2023-08-01T19:54:23.131835+0000","last_clean":"2023-08-01T19:54:23.131835+0000","last_became_active":"2023-08-01T19:54:04.476194+0000","last_became_peered":"2023-08-01T19:54:04.476194+0000","last_unstale":"2023-08-01T19:54:23.131835+0000","last_undegraded":"2023-08-01T19:54:23.131835+0000","last_fullsized":"2023-08-01T19:54:23.131835+0000","mapping_epoch":16,"log_start":"0'0","ondisk_log_start":"0'0","created":16,"last_epoch_clean":17,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-08-01T19:54:04.040663+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-08-01T19:54:04.040663+0000","last_clean_scrub_stamp":"2023-08-01T19:54:04.040663+0000","objects_scrubbed":0,"log_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-08-03T03:58:06.360840+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[1,0],"acting":[1,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":1,"acting_primary":1,"purged_snaps":[]},{"pgid":"4.20","version":"0'0","reported_seq":12,"reported_epoch":20,"state":"active+clean","last_fresh":"2023-08-01T19:54:23.131907+0000","last_change":"2023-08-01T19:54:04.477904+0000","last_active":"2023-08-01T19:54:23.131907+0000","last_peered":"2023-08-01T19:54:23.131907+0000","last_clean":"2023-08-01T19:54:23.131907+0000","last_became_active":"2023-08-01T19:54:04.476564+0000","last_became_peered":"2023-08-01T19:54:04.476564+0000","last_unstale":"2023-08-01T19:54:23.131907+0000","last_undegraded":"2023-08-01T19:54:23.131907+0000","last_fullsized":"2023-08-01T19:54:23.131907+0000","mapping_epoch":16,"log_start":"0'0","ondisk_log_start":"0'0","created":16,"last_epoch_clean":17,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-08-01T19:54:04.040663+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-08-01T19:54:04.040663+0000","last_clean_scrub_stamp":"2023-08-01T19:54:04.040663+0000","objects_scrubbed":0,"log_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-08-03T02:21:47.656072+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[1,0],"acting":[1,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":1,"acting_primary":1,"purged_snaps":[]},{"pgid":"4.21","version":"0'0","reported_seq":12,"reported_epoch":20,"state":"active+clean","last_fresh":"2023-08-01T19:54:23.135648+0000","last_change":"2023-08-01T19:54:04.466899+0000","last_active":"2023-08-01T19:54:23.135648+0000","last_peered":"2023-08-01T19:54:23.135648+0000","last_clean":"2023-08-01T19:54:23.135648+0000","last_became_active":"2023-08-01T19:54:04.466500+0000","last_became_peered":"2023-08-01T19:54:04.466500+0000","last_unstale":"2023-08-01T19:54:23.135648+0000","last_undegraded":"2023-08-01T19:54:23.135648+0000","last_fullsized":"2023-08-01T19:54:23.135648+0000","mapping_epoch":16,"log_start":"0'0","ondisk_log_start":"0'0","created":16,"last_epoch_clean":17,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-08-01T19:54:04.040663+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-08-01T19:54:04.040663+0000","last_clean_scrub_stamp":"2023-08-01T19:54:04.040663+0000","objects_scrubbed":0,"log_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-08-03T07:36:38.654701+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[0,2],"acting":[0,2],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":0,"acting_primary":0,"purged_snaps":[]},{"pgid":"4.22","version":"0'0","reported_seq":9,"reported_epoch":17,"state":"active+clean","last_fresh":"2023-08-01T19:54:04.473914+0000","last_change":"2023-08-01T19:54:04.471945+0000","last_active":"2023-08-01T19:54:04.473914+0000","last_peered":"2023-08-01T19:54:04.473914+0000","last_clean":"2023-08-01T19:54:04.473914+0000","last_became_active":"2023-08-01T19:54:04.471371+0000","last_became_peered":"2023-08-01T19:54:04.471371+0000","last_unstale":"2023-08-01T19:54:04.473914+0000","last_undegraded":"2023-08-01T19:54:04.473914+0000","last_fullsized":"2023-08-01T19:54:04.473914+0000","mapping_epoch":16,"log_start":"0'0","ondisk_log_start":"0'0","created":16,"last_epoch_clean":17,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-08-01T19:54:04.040663+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-08-01T19:54:04.040663+0000","last_clean_scrub_stamp":"2023-08-01T19:54:04.040663+0000","objects_scrubbed":0,"log_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-08-02T22:17:59.847819+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[2,1],"acting":[2,1],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":2,"acting_primary":2,"purged_snaps":[]},{"pgid":"4.23","version":"0'0","reported_seq":12,"reported_epoch":20,"state":"active+clean","last_fresh":"2023-08-01T19:54:23.136450+0000","last_change":"2023-08-01T19:54:04.467847+0000","last_active":"2023-08-01T19:54:23.136450+0000","last_peered":"2023-08-01T19:54:23.136450+0000","last_clean":"2023-08-01T19:54:23.136450+0000","last_became_active":"2023-08-01T19:54:04.467111+0000","last_became_peered":"2023-08-01T19:54:04.467111+0000","last_unstale":"2023-08-01T19:54:23.136450+0000","last_undegraded":"2023-08-01T19:54:23.136450+0000","last_fullsized":"2023-08-01T19:54:23.136450+0000","mapping_epoch":16,"log_start":"0'0","ondisk_log_start":"0'0","created":16,"last_epoch_clean":17,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-08-01T19:54:04.040663+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-08-01T19:54:04.040663+0000","last_clean_scrub_stamp":"2023-08-01T19:54:04.040663+0000","objects_scrubbed":0,"log_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-08-03T00:42:19.379348+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[0,2],"acting":[0,2],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":0,"acting_primary":0,"purged_snaps":[]},{"pgid":"4.24","version":"0'0","reported_seq":9,"reported_epoch":17,"state":"active+clean","last_fresh":"2023-08-01T19:54:04.482540+0000","last_change":"2023-08-01T19:54:04.477128+0000","last_active":"2023-08-01T19:54:04.482540+0000","last_peered":"2023-08-01T19:54:04.482540+0000","last_clean":"2023-08-01T19:54:04.482540+0000","last_became_active":"2023-08-01T19:54:04.476819+0000","last_became_peered":"2023-08-01T19:54:04.476819+0000","last_unstale":"2023-08-01T19:54:04.482540+0000","last_undegraded":"2023-08-01T19:54:04.482540+0000","last_fullsized":"2023-08-01T19:54:04.482540+0000","mapping_epoch":16,"log_start":"0'0","ondisk_log_start":"0'0","created":16,"last_epoch_clean":17,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-08-01T19:54:04.040663+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-08-01T19:54:04.040663+0000","last_clean_scrub_stamp":"2023-08-01T19:54:04.040663+0000","objects_scrubbed":0,"log_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-08-03T02:20:23.354054+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[2,1],"acting":[2,1],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":2,"acting_primary":2,"purged_snaps":[]}],"pool_stats":[{"poolid":5,"num_pg":16,"stat_sum":{"num_bytes":106823680,"num_objects":1630,"num_object_clones":0,"num_object_copies":3260,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":1630,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":1630,"num_write_kb":104320,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"store_stats":{"total":0,"available":0,"internally_reserved":0,"allocated":15552512,"data_stored":248840192,"data_compressed":1186876,"data_compressed_allocated":15552512,"data_compressed_original":248840192,"omap_allocated":0,"internal_metadata":0},"log_size":1630,"ondisk_log_size":1630,"up":20,"acting":20,"num_store_stats":2},{"poolid":4,"num_pg":64,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"store_stats":{"total":0,"available":0,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},"log_size":0,"ondisk_log_size":0,"up":128,"acting":128,"num_store_stats":3},{"poolid":3,"num_pg":32,"stat_sum":{"num_bytes":2306,"num_objects":22,"num_object_clones":0,"num_object_copies":44,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":22,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":45,"num_write_kb":13,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":14,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"store_stats":{"total":0,"available":0,"internally_reserved":0,"allocated":65536,"data_stored":4612,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},"log_size":39,"ondisk_log_size":39,"up":64,"acting":64,"num_store_stats":3},{"poolid":1,"num_pg":1,"stat_sum":{"num_bytes":590368,"num_objects":2,"num_object_clones":0,"num_object_copies":4,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":2,"num_whiteouts":0,"num_read":136,"num_read_kb":118,"num_write":203,"num_write_kb":3460,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"store_stats":{"total":0,"available":0,"internally_reserved":0,"allocated":114688,"data_stored":1180736,"data_compressed":20662,"data_compressed_allocated":73728,"data_compressed_original":1146880,"omap_allocated":0,"internal_metadata":0},"log_size":157,"ondisk_log_size":157,"up":2,"acting":2,"num_store_stats":2},{"poolid":2,"num_pg":8,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"store_stats":{"total":0,"available":0,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},"log_size":0,"ondisk_log_size":0,"up":16,"acting":16,"num_store_stats":3}],"osd_stats":[{"osd":2,"up_from":9,"seq":38654705674,"num_pgs":67,"num_osds":1,"num_per_pool_osds":1,"num_per_pool_omap_osds":1,"kb":94371840,"kb_used":9264,"kb_used_data":232,"kb_used_omap":0,"kb_used_meta":9024,"kb_avail":94362576,"statfs":{"total":96636764160,"available":96627277824,"internally_reserved":0,"allocated":237568,"data_stored":647231,"data_compressed":10331,"data_compressed_allocated":36864,"data_compressed_original":573440,"omap_allocated":0,"internal_metadata":9240576},"hb_peers":[0,1],"snap_trim_queue_len":0,"num_snap_trimming":0,"num_shards_repaired":0,"op_queue_age_hist":{"histogram":[],"upper_bound":1},"perf_stat":{"commit_latency_ms":0,"apply_latency_ms":0,"commit_latency_ns":0,"apply_latency_ns":0},"alerts":[],"network_ping_times":[{"osd":0,"last update":"Thu Jan 1 00:00:00 1970","interfaces":[{"interface":"back","average":{"1min":0,"5min":0,"15min":0},"min":{"1min":0,"5min":0,"15min":0},"max":{"1min":0,"5min":0,"15min":0},"last":0.58099999999999996}]},{"osd":1,"last update":"Thu Jan 1 00:00:00 1970","interfaces":[{"interface":"back","average":{"1min":0,"5min":0,"15min":0},"min":{"1min":0,"5min":0,"15min":0},"max":{"1min":0,"5min":0,"15min":0},"last":0.54200000000000004}]}]},{"osd":0,"up_from":8,"seq":34359738378,"num_pgs":77,"num_osds":1,"num_per_pool_osds":1,"num_per_pool_omap_osds":1,"kb":94371840,"kb_used":12736,"kb_used_data":184,"kb_used_omap":0,"kb_used_meta":12544,"kb_avail":94359104,"statfs":{"total":96636764160,"available":96623722496,"internally_reserved":0,"allocated":188416,"data_stored":65586,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":12845056},"hb_peers":[1,2],"snap_trim_queue_len":0,"num_snap_trimming":0,"num_shards_repaired":0,"op_queue_age_hist":{"histogram":[],"upper_bound":1},"perf_stat":{"commit_latency_ms":0,"apply_latency_ms":0,"commit_latency_ns":0,"apply_latency_ns":0},"alerts":[],"network_ping_times":[{"osd":1,"last update":"Thu Jan 1 00:00:00 1970","interfaces":[{"interface":"back","average":{"1min":0,"5min":0,"15min":0},"min":{"1min":0,"5min":0,"15min":0},"max":{"1min":0,"5min":0,"15min":0},"last":0.307}]},{"osd":2,"last update":"Thu Jan 1 00:00:00 1970","interfaces":[{"interface":"back","average":{"1min":0,"5min":0,"15min":0},"min":{"1min":0,"5min":0,"15min":0},"max":{"1min":0,"5min":0,"15min":0},"last":0.36899999999999999}]}]},{"osd":1,"up_from":8,"seq":34359738377,"num_pgs":71,"num_osds":1,"num_per_pool_osds":1,"num_per_pool_omap_osds":1,"kb":94371840,"kb_used":9424,"kb_used_data":264,"kb_used_omap":0,"kb_used_meta":9152,"kb_avail":94362416,"statfs":{"total":96636764160,"available":96627113984,"internally_reserved":0,"allocated":270336,"data_stored":657672,"data_compressed":10331,"data_compressed_allocated":36864,"data_compressed_original":573440,"omap_allocated":0,"internal_metadata":9371648},"hb_peers":[0,2],"snap_trim_queue_len":0,"num_snap_trimming":0,"num_shards_repaired":0,"op_queue_age_hist":{"histogram":[],"upper_bound":1},"perf_stat":{"commit_latency_ms":2,"apply_latency_ms":2,"commit_latency_ns":2000000,"apply_latency_ns":2000000},"alerts":[],"network_ping_times":[{"osd":0,"last update":"Thu Jan 1 00:00:00 1970","interfaces":[{"interface":"back","average":{"1min":0,"5min":0,"15min":0},"min":{"1min":0,"5min":0,"15min":0},"max":{"1min":0,"5min":0,"15min":0},"last":0.38900000000000001}]},{"osd":2,"last update":"Thu Jan 1 00:00:00 1970","interfaces":[{"interface":"back","average":{"1min":0,"5min":0,"15min":0},"min":{"1min":0,"5min":0,"15min":0},"max":{"1min":0,"5min":0,"15min":0},"last":0.44}]}]}],"pool_statfs":[{"poolid":1,"osd":1,"total":0,"available":0,"internally_reserved":0,"allocated":57344,"data_stored":590368,"data_compressed":10331,"data_compressed_allocated":36864,"data_compressed_original":573440,"omap_allocated":0,"internal_metadata":0},{"poolid":1,"osd":2,"total":0,"available":0,"internally_reserved":0,"allocated":57344,"data_stored":590368,"data_compressed":10331,"data_compressed_allocated":36864,"data_compressed_original":573440,"omap_allocated":0,"internal_metadata":0},{"poolid":2,"osd":0,"total":0,"available":0,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":2,"osd":1,"total":0,"available":0,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":2,"osd":2,"total":0,"available":0,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":3,"osd":0,"total":0,"available":0,"internally_reserved":0,"allocated":8192,"data_stored":588,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":3,"osd":1,"total":0,"available":0,"internally_reserved":0,"allocated":32768,"data_stored":2306,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":3,"osd":2,"total":0,"available":0,"internally_reserved":0,"allocated":24576,"data_stored":1718,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":4,"osd":0,"total":0,"available":0,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":4,"osd":1,"total":0,"available":0,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":4,"osd":2,"total":0,"available":0,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":5,"osd":0,"total":0,"available":0,"internally_reserved":0,"allocated":8814592,"data_stored":141033472,"data_compressed":672661,"data_compressed_allocated":8814592,"data_compressed_original":141033472,"omap_allocated":0,"internal_metadata":0},{"poolid":5,"osd":1,"total":0,"available":0,"internally_reserved":0,"allocated":6737920,"data_stored":107806720,"data_compressed":514215,"data_compressed_allocated":6737920,"data_compressed_original":107806720,"omap_allocated":0,"internal_metadata":0}]}} 2023-08-01T19:54:26.754 INFO:tasks.thrashosds.thrasher:Setting 3.8 to [0, 1, 2] 2023-08-01T19:54:26.754 INFO:tasks.thrashosds.thrasher:cmd ['osd', 'pg-upmap-items', '3.8', '0', '1', '2'] 2023-08-01T19:54:26.754 DEBUG:teuthology.orchestra.run.smithi006:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 120 ceph --cluster ceph osd pg-upmap-items 3.8 0 1 2 2023-08-01T19:54:26.774 INFO:tasks.ceph.osd.0.smithi008.stderr:2023-08-01T19:54:26.773+0000 7f16a58f4700 -1 received signal: Hangup from /usr/bin/python3 /bin/daemon-helper kill ceph-osd -f --cluster ceph -i 0 (PID: 111179) UID: 0 2023-08-01T19:54:26.815 INFO:teuthology.orchestra.run.smithi101.stdout:ERROR: (22) Invalid argument 2023-08-01T19:54:26.815 INFO:teuthology.orchestra.run.smithi101.stdout:op_tracker tracking is not enabled now, so no ops are tracked currently, even those get stuck. Please enable "osd_enable_op_tracker", and the tracker will start to track new ops received afterwards. 2023-08-01T19:54:26.828 DEBUG:teuthology.orchestra.run.smithi101:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 30 ceph --cluster ceph --admin-daemon /var/run/ceph/ceph-osd.1.asok dump_historic_ops 2023-08-01T19:54:26.875 INFO:tasks.ceph.osd.0.smithi008.stderr:2023-08-01T19:54:26.873+0000 7f16a58f4700 -1 received signal: Hangup from /usr/bin/python3 /bin/daemon-helper kill ceph-osd -f --cluster ceph -i 0 (PID: 111179) UID: 0 2023-08-01T19:54:26.976 INFO:tasks.ceph.osd.2.smithi155.stderr:2023-08-01T19:54:26.975+0000 7faa5c6ac700 -1 received signal: Hangup from /usr/bin/python3 /bin/daemon-helper kill ceph-osd -f --cluster ceph -i 2 (PID: 111337) UID: 0 2023-08-01T19:54:27.039 INFO:teuthology.orchestra.run.smithi101.stdout:ERROR: (22) Invalid argument 2023-08-01T19:54:27.039 INFO:teuthology.orchestra.run.smithi101.stdout:op_tracker tracking is not enabled now, so no ops are tracked currently, even those get stuck. Please enable "osd_enable_op_tracker", and the tracker will start to track new ops received afterwards. 2023-08-01T19:54:27.054 DEBUG:teuthology.orchestra.run.smithi155:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 30 ceph --cluster ceph --admin-daemon /var/run/ceph/ceph-osd.2.asok dump_ops_in_flight 2023-08-01T19:54:27.098 INFO:tasks.ceph.osd.2.smithi155.stderr:2023-08-01T19:54:27.096+0000 7faa5c6ac700 -1 received signal: Hangup from /usr/bin/python3 /bin/daemon-helper kill ceph-osd -f --cluster ceph -i 2 (PID: 111337) UID: 0 2023-08-01T19:54:27.140 INFO:teuthology.orchestra.run.smithi006.stderr:Error EINVAL: you must specify pairs of osd ids to be remapped 2023-08-01T19:54:27.143 DEBUG:teuthology.orchestra.run:got remote process result: 22 2023-08-01T19:54:27.143 INFO:tasks.thrashosds.thrasher:Failed to rm-pg-upmap-items, ignoring 2023-08-01T19:54:27.157 DEBUG:teuthology.orchestra.run.smithi006:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 120 ceph --cluster ceph osd unset noscrub 2023-08-01T19:54:27.178 INFO:tasks.ceph.osd.0.smithi008.stderr:2023-08-01T19:54:27.176+0000 7f16a58f4700 -1 received signal: Hangup from /usr/bin/python3 /bin/daemon-helper kill ceph-osd -f --cluster ceph -i 0 (PID: 111179) UID: 0 2023-08-01T19:54:27.225 INFO:teuthology.orchestra.run.smithi155.stdout:ERROR: (22) Invalid argument 2023-08-01T19:54:27.225 INFO:teuthology.orchestra.run.smithi155.stdout:op_tracker tracking is not enabled now, so no ops are tracked currently, even those get stuck. Please enable "osd_enable_op_tracker", and the tracker will start to track new ops received afterwards. 2023-08-01T19:54:27.237 DEBUG:teuthology.orchestra.run.smithi155:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 30 ceph --cluster ceph --admin-daemon /var/run/ceph/ceph-osd.2.asok dump_blocked_ops 2023-08-01T19:54:27.279 INFO:tasks.ceph.osd.1.smithi101.stderr:2023-08-01T19:54:27.277+0000 7fb0cb7f6700 -1 received signal: Hangup from /usr/bin/python3 /bin/daemon-helper kill ceph-osd -f --cluster ceph -i 1 (PID: 111141) UID: 0 2023-08-01T19:54:27.313 INFO:tasks.radosbench.radosbench.0.smithi006.stdout: 3 16 12344 12328 256.817 237.438 0.00563329 0.00388962 2023-08-01T19:54:27.380 INFO:tasks.ceph.osd.0.smithi008.stderr:2023-08-01T19:54:27.378+0000 7f16a58f4700 -1 received signal: Hangup from /usr/bin/python3 /bin/daemon-helper kill ceph-osd -f --cluster ceph -i 0 (PID: 111179) UID: 0 2023-08-01T19:54:27.436 INFO:teuthology.orchestra.run.smithi155.stdout:ERROR: (22) Invalid argument 2023-08-01T19:54:27.436 INFO:teuthology.orchestra.run.smithi155.stdout:op_tracker tracking is not enabled now, so no ops are tracked currently, even those get stuck. Please enable "osd_enable_op_tracker", and the tracker will start to track new ops received afterwards. 2023-08-01T19:54:27.448 DEBUG:teuthology.orchestra.run.smithi155:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 30 ceph --cluster ceph --admin-daemon /var/run/ceph/ceph-osd.2.asok dump_historic_ops 2023-08-01T19:54:27.492 INFO:tasks.ceph.osd.2.smithi155.stderr:2023-08-01T19:54:27.492+0000 7faa5c6ac700 -1 received signal: Hangup from /usr/bin/python3 /bin/daemon-helper kill ceph-osd -f --cluster ceph -i 2 (PID: 111337) UID: 0 2023-08-01T19:54:27.571 DEBUG:teuthology.orchestra.run.smithi006:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 120 ceph --cluster ceph -- tell 'osd.*' injectargs --osd_enable_op_tracker=true 2023-08-01T19:54:27.582 INFO:tasks.ceph.osd.1.smithi101.stderr:2023-08-01T19:54:27.580+0000 7fb0cb7f6700 -1 received signal: Hangup from /usr/bin/python3 /bin/daemon-helper kill ceph-osd -f --cluster ceph -i 1 (PID: 111141) UID: 0 2023-08-01T19:54:27.622 INFO:teuthology.orchestra.run.smithi155.stdout:ERROR: (22) Invalid argument 2023-08-01T19:54:27.622 INFO:teuthology.orchestra.run.smithi155.stdout:op_tracker tracking is not enabled now, so no ops are tracked currently, even those get stuck. Please enable "osd_enable_op_tracker", and the tracker will start to track new ops received afterwards. 2023-08-01T19:54:27.635 DEBUG:teuthology.orchestra.run.smithi008:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 30 ceph --cluster ceph --admin-daemon /var/run/ceph/ceph-osd.0.asok dump_ops_in_flight 2023-08-01T19:54:27.682 INFO:tasks.ceph.osd.1.smithi101.stderr:2023-08-01T19:54:27.681+0000 7fb0cb7f6700 -1 received signal: Hangup from /usr/bin/python3 /bin/daemon-helper kill ceph-osd -f --cluster ceph -i 1 (PID: 111141) UID: 0 2023-08-01T19:54:27.723 INFO:teuthology.orchestra.run.smithi006.stdout:osd.0: {} 2023-08-01T19:54:27.742 INFO:teuthology.orchestra.run.smithi006.stdout:osd.1: {} 2023-08-01T19:54:27.763 INFO:teuthology.orchestra.run.smithi006.stdout:osd.2: {} 2023-08-01T19:54:27.764 INFO:teuthology.orchestra.run.smithi006.stderr:osd.0: osd_enable_op_tracker = 'true' 2023-08-01T19:54:27.765 INFO:teuthology.orchestra.run.smithi006.stderr:osd.1: osd_enable_op_tracker = 'true' 2023-08-01T19:54:27.765 INFO:teuthology.orchestra.run.smithi006.stderr:osd.2: osd_enable_op_tracker = 'true' 2023-08-01T19:54:27.783 INFO:tasks.ceph.osd.1.smithi101.stderr:2023-08-01T19:54:27.782+0000 7fb0cb7f6700 -1 received signal: Hangup from /usr/bin/python3 /bin/daemon-helper kill ceph-osd -f --cluster ceph -i 1 (PID: 111141) UID: 0 2023-08-01T19:54:27.832 INFO:teuthology.orchestra.run.smithi008.stdout:{ 2023-08-01T19:54:27.832 INFO:teuthology.orchestra.run.smithi008.stdout: "ops": [ 2023-08-01T19:54:27.832 INFO:teuthology.orchestra.run.smithi008.stdout: { 2023-08-01T19:54:27.832 INFO:teuthology.orchestra.run.smithi008.stdout: "description": "osd_op(client.4668.0:14215 5.3 5:cd51c9e2:::benchmark_data_smithi006_114134_object14214:head [set-alloc-hint object_size 65536 write_size 65536,write 0~65536 in=65536b] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e22)", 2023-08-01T19:54:27.832 INFO:teuthology.orchestra.run.smithi008.stdout: "initiated_at": "2023-08-01T19:54:27.826909+0000", 2023-08-01T19:54:27.832 INFO:teuthology.orchestra.run.smithi008.stdout: "age": 0.0037016789999999998, 2023-08-01T19:54:27.832 INFO:teuthology.orchestra.run.smithi008.stdout: "duration": 0.003727574, 2023-08-01T19:54:27.833 INFO:teuthology.orchestra.run.smithi008.stdout: "type_data": { 2023-08-01T19:54:27.833 INFO:teuthology.orchestra.run.smithi008.stdout: "flag_point": "waiting for sub ops", 2023-08-01T19:54:27.833 INFO:teuthology.orchestra.run.smithi008.stdout: "client_info": { 2023-08-01T19:54:27.833 INFO:teuthology.orchestra.run.smithi008.stdout: "client": "client.4668", 2023-08-01T19:54:27.833 INFO:teuthology.orchestra.run.smithi008.stdout: "client_addr": "172.21.15.6:0/1709472247", 2023-08-01T19:54:27.833 INFO:teuthology.orchestra.run.smithi008.stdout: "tid": 14215 2023-08-01T19:54:27.833 INFO:teuthology.orchestra.run.smithi008.stdout: }, 2023-08-01T19:54:27.834 INFO:teuthology.orchestra.run.smithi008.stdout: "events": [ 2023-08-01T19:54:27.834 INFO:teuthology.orchestra.run.smithi008.stdout: { 2023-08-01T19:54:27.834 INFO:teuthology.orchestra.run.smithi008.stdout: "event": "initiated", 2023-08-01T19:54:27.834 INFO:teuthology.orchestra.run.smithi008.stdout: "time": "2023-08-01T19:54:27.826909+0000", 2023-08-01T19:54:27.834 INFO:teuthology.orchestra.run.smithi008.stdout: "duration": 0 2023-08-01T19:54:27.834 INFO:teuthology.orchestra.run.smithi008.stdout: }, 2023-08-01T19:54:27.834 INFO:teuthology.orchestra.run.smithi008.stdout: { 2023-08-01T19:54:27.834 INFO:teuthology.orchestra.run.smithi008.stdout: "event": "throttled", 2023-08-01T19:54:27.835 INFO:teuthology.orchestra.run.smithi008.stdout: "time": "2023-08-01T19:54:27.826909+0000", 2023-08-01T19:54:27.835 INFO:teuthology.orchestra.run.smithi008.stdout: "duration": 0 2023-08-01T19:54:27.835 INFO:teuthology.orchestra.run.smithi008.stdout: }, 2023-08-01T19:54:27.835 INFO:teuthology.orchestra.run.smithi008.stdout: { 2023-08-01T19:54:27.835 INFO:teuthology.orchestra.run.smithi008.stdout: "event": "header_read", 2023-08-01T19:54:27.835 INFO:teuthology.orchestra.run.smithi008.stdout: "time": "2023-08-01T19:54:27.826908+0000", 2023-08-01T19:54:27.835 INFO:teuthology.orchestra.run.smithi008.stdout: "duration": 4294967295.999999 2023-08-01T19:54:27.835 INFO:teuthology.orchestra.run.smithi008.stdout: }, 2023-08-01T19:54:27.836 INFO:teuthology.orchestra.run.smithi008.stdout: { 2023-08-01T19:54:27.836 INFO:teuthology.orchestra.run.smithi008.stdout: "event": "all_read", 2023-08-01T19:54:27.836 INFO:teuthology.orchestra.run.smithi008.stdout: "time": "2023-08-01T19:54:27.827655+0000", 2023-08-01T19:54:27.836 INFO:teuthology.orchestra.run.smithi008.stdout: "duration": 0.00074703699999999998 2023-08-01T19:54:27.836 INFO:teuthology.orchestra.run.smithi008.stdout: }, 2023-08-01T19:54:27.836 INFO:teuthology.orchestra.run.smithi008.stdout: { 2023-08-01T19:54:27.836 INFO:teuthology.orchestra.run.smithi008.stdout: "event": "dispatched", 2023-08-01T19:54:27.837 INFO:teuthology.orchestra.run.smithi008.stdout: "time": "2023-08-01T19:54:27.827666+0000", 2023-08-01T19:54:27.837 INFO:teuthology.orchestra.run.smithi008.stdout: "duration": 1.0696000000000001e-05 2023-08-01T19:54:27.837 INFO:teuthology.orchestra.run.smithi008.stdout: }, 2023-08-01T19:54:27.837 INFO:teuthology.orchestra.run.smithi008.stdout: { 2023-08-01T19:54:27.837 INFO:teuthology.orchestra.run.smithi008.stdout: "event": "queued_for_pg", 2023-08-01T19:54:27.837 INFO:teuthology.orchestra.run.smithi008.stdout: "time": "2023-08-01T19:54:27.827676+0000", 2023-08-01T19:54:27.837 INFO:teuthology.orchestra.run.smithi008.stdout: "duration": 1.024e-05 2023-08-01T19:54:27.837 INFO:teuthology.orchestra.run.smithi008.stdout: }, 2023-08-01T19:54:27.838 INFO:teuthology.orchestra.run.smithi008.stdout: { 2023-08-01T19:54:27.838 INFO:teuthology.orchestra.run.smithi008.stdout: "event": "reached_pg", 2023-08-01T19:54:27.838 INFO:teuthology.orchestra.run.smithi008.stdout: "time": "2023-08-01T19:54:27.828648+0000", 2023-08-01T19:54:27.838 INFO:teuthology.orchestra.run.smithi008.stdout: "duration": 0.00097195799999999998 2023-08-01T19:54:27.838 INFO:teuthology.orchestra.run.smithi008.stdout: }, 2023-08-01T19:54:27.838 INFO:teuthology.orchestra.run.smithi008.stdout: { 2023-08-01T19:54:27.838 INFO:teuthology.orchestra.run.smithi008.stdout: "event": "started", 2023-08-01T19:54:27.838 INFO:teuthology.orchestra.run.smithi008.stdout: "time": "2023-08-01T19:54:27.828775+0000", 2023-08-01T19:54:27.839 INFO:teuthology.orchestra.run.smithi008.stdout: "duration": 0.00012713399999999999 2023-08-01T19:54:27.839 INFO:teuthology.orchestra.run.smithi008.stdout: }, 2023-08-01T19:54:27.839 INFO:teuthology.orchestra.run.smithi008.stdout: { 2023-08-01T19:54:27.839 INFO:teuthology.orchestra.run.smithi008.stdout: "event": "waiting for subops from 1", 2023-08-01T19:54:27.839 INFO:teuthology.orchestra.run.smithi008.stdout: "time": "2023-08-01T19:54:27.828939+0000", 2023-08-01T19:54:27.839 INFO:teuthology.orchestra.run.smithi008.stdout: "duration": 0.000164461 2023-08-01T19:54:27.839 INFO:teuthology.orchestra.run.smithi008.stdout: }, 2023-08-01T19:54:27.839 INFO:teuthology.orchestra.run.smithi008.stdout: { 2023-08-01T19:54:27.840 INFO:teuthology.orchestra.run.smithi008.stdout: "event": "op_commit", 2023-08-01T19:54:27.840 INFO:teuthology.orchestra.run.smithi008.stdout: "time": "2023-08-01T19:54:27.830119+0000", 2023-08-01T19:54:27.840 INFO:teuthology.orchestra.run.smithi008.stdout: "duration": 0.001179484 2023-08-01T19:54:27.840 INFO:teuthology.orchestra.run.smithi008.stdout: } 2023-08-01T19:54:27.840 INFO:teuthology.orchestra.run.smithi008.stdout: ] 2023-08-01T19:54:27.840 INFO:teuthology.orchestra.run.smithi008.stdout: } 2023-08-01T19:54:27.840 INFO:teuthology.orchestra.run.smithi008.stdout: }, 2023-08-01T19:54:27.841 INFO:teuthology.orchestra.run.smithi008.stdout: { 2023-08-01T19:54:27.841 INFO:teuthology.orchestra.run.smithi008.stdout: "description": "osd_op(client.4668.0:14217 5.a 5:53a2bf31:::benchmark_data_smithi006_114134_object14216:head [set-alloc-hint object_size 65536 write_size 65536,write 0~65536 in=65536b] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e22)", 2023-08-01T19:54:27.841 INFO:teuthology.orchestra.run.smithi008.stdout: "initiated_at": "2023-08-01T19:54:27.827855+0000", 2023-08-01T19:54:27.841 INFO:teuthology.orchestra.run.smithi008.stdout: "age": 0.0027553, 2023-08-01T19:54:27.841 INFO:teuthology.orchestra.run.smithi008.stdout: "duration": 0.0028545049999999998, 2023-08-01T19:54:27.841 INFO:teuthology.orchestra.run.smithi008.stdout: "type_data": { 2023-08-01T19:54:27.842 INFO:teuthology.orchestra.run.smithi008.stdout: "flag_point": "waiting for sub ops", 2023-08-01T19:54:27.842 INFO:teuthology.orchestra.run.smithi008.stdout: "client_info": { 2023-08-01T19:54:27.842 INFO:teuthology.orchestra.run.smithi008.stdout: "client": "client.4668", 2023-08-01T19:54:27.842 INFO:teuthology.orchestra.run.smithi008.stdout: "client_addr": "172.21.15.6:0/1709472247", 2023-08-01T19:54:27.842 INFO:teuthology.orchestra.run.smithi008.stdout: "tid": 14217 2023-08-01T19:54:27.842 INFO:teuthology.orchestra.run.smithi008.stdout: }, 2023-08-01T19:54:27.842 INFO:teuthology.orchestra.run.smithi008.stdout: "events": [ 2023-08-01T19:54:27.842 INFO:teuthology.orchestra.run.smithi008.stdout: { 2023-08-01T19:54:27.843 INFO:teuthology.orchestra.run.smithi008.stdout: "event": "initiated", 2023-08-01T19:54:27.843 INFO:teuthology.orchestra.run.smithi008.stdout: "time": "2023-08-01T19:54:27.827855+0000", 2023-08-01T19:54:27.843 INFO:teuthology.orchestra.run.smithi008.stdout: "duration": 0 2023-08-01T19:54:27.843 INFO:teuthology.orchestra.run.smithi008.stdout: }, 2023-08-01T19:54:27.843 INFO:teuthology.orchestra.run.smithi008.stdout: { 2023-08-01T19:54:27.843 INFO:teuthology.orchestra.run.smithi008.stdout: "event": "throttled", 2023-08-01T19:54:27.843 INFO:teuthology.orchestra.run.smithi008.stdout: "time": "2023-08-01T19:54:27.827855+0000", 2023-08-01T19:54:27.843 INFO:teuthology.orchestra.run.smithi008.stdout: "duration": 0 2023-08-01T19:54:27.844 INFO:teuthology.orchestra.run.smithi008.stdout: }, 2023-08-01T19:54:27.844 INFO:teuthology.orchestra.run.smithi008.stdout: { 2023-08-01T19:54:27.844 INFO:teuthology.orchestra.run.smithi008.stdout: "event": "header_read", 2023-08-01T19:54:27.844 INFO:teuthology.orchestra.run.smithi008.stdout: "time": "2023-08-01T19:54:27.827854+0000", 2023-08-01T19:54:27.844 INFO:teuthology.orchestra.run.smithi008.stdout: "duration": 4294967295.999999 2023-08-01T19:54:27.844 INFO:teuthology.orchestra.run.smithi008.stdout: }, 2023-08-01T19:54:27.844 INFO:teuthology.orchestra.run.smithi008.stdout: { 2023-08-01T19:54:27.844 INFO:teuthology.orchestra.run.smithi008.stdout: "event": "all_read", 2023-08-01T19:54:27.845 INFO:teuthology.orchestra.run.smithi008.stdout: "time": "2023-08-01T19:54:27.827912+0000", 2023-08-01T19:54:27.845 INFO:teuthology.orchestra.run.smithi008.stdout: "duration": 5.7912999999999999e-05 2023-08-01T19:54:27.845 INFO:teuthology.orchestra.run.smithi008.stdout: }, 2023-08-01T19:54:27.846 INFO:teuthology.orchestra.run.smithi008.stdout: { 2023-08-01T19:54:27.846 INFO:teuthology.orchestra.run.smithi008.stdout: "event": "dispatched", 2023-08-01T19:54:27.846 INFO:teuthology.orchestra.run.smithi008.stdout: "time": "2023-08-01T19:54:27.827920+0000", 2023-08-01T19:54:27.846 INFO:teuthology.orchestra.run.smithi008.stdout: "duration": 7.4900000000000003e-06 2023-08-01T19:54:27.846 INFO:teuthology.orchestra.run.smithi008.stdout: }, 2023-08-01T19:54:27.846 INFO:teuthology.orchestra.run.smithi008.stdout: { 2023-08-01T19:54:27.846 INFO:teuthology.orchestra.run.smithi008.stdout: "event": "queued_for_pg", 2023-08-01T19:54:27.847 INFO:teuthology.orchestra.run.smithi008.stdout: "time": "2023-08-01T19:54:27.827925+0000", 2023-08-01T19:54:27.847 INFO:teuthology.orchestra.run.smithi008.stdout: "duration": 5.0189999999999997e-06 2023-08-01T19:54:27.847 INFO:teuthology.orchestra.run.smithi008.stdout: }, 2023-08-01T19:54:27.847 INFO:teuthology.orchestra.run.smithi008.stdout: { 2023-08-01T19:54:27.847 INFO:teuthology.orchestra.run.smithi008.stdout: "event": "reached_pg", 2023-08-01T19:54:27.847 INFO:teuthology.orchestra.run.smithi008.stdout: "time": "2023-08-01T19:54:27.827965+0000", 2023-08-01T19:54:27.847 INFO:teuthology.orchestra.run.smithi008.stdout: "duration": 4.0315999999999998e-05 2023-08-01T19:54:27.847 INFO:teuthology.orchestra.run.smithi008.stdout: }, 2023-08-01T19:54:27.848 INFO:teuthology.orchestra.run.smithi008.stdout: { 2023-08-01T19:54:27.848 INFO:teuthology.orchestra.run.smithi008.stdout: "event": "started", 2023-08-01T19:54:27.848 INFO:teuthology.orchestra.run.smithi008.stdout: "time": "2023-08-01T19:54:27.828049+0000", 2023-08-01T19:54:27.848 INFO:teuthology.orchestra.run.smithi008.stdout: "duration": 8.3452e-05 2023-08-01T19:54:27.848 INFO:teuthology.orchestra.run.smithi008.stdout: }, 2023-08-01T19:54:27.848 INFO:teuthology.orchestra.run.smithi008.stdout: { 2023-08-01T19:54:27.848 INFO:teuthology.orchestra.run.smithi008.stdout: "event": "waiting for subops from 2", 2023-08-01T19:54:27.848 INFO:teuthology.orchestra.run.smithi008.stdout: "time": "2023-08-01T19:54:27.828132+0000", 2023-08-01T19:54:27.849 INFO:teuthology.orchestra.run.smithi008.stdout: "duration": 8.3265999999999999e-05 2023-08-01T19:54:27.849 INFO:teuthology.orchestra.run.smithi008.stdout: }, 2023-08-01T19:54:27.849 INFO:teuthology.orchestra.run.smithi008.stdout: { 2023-08-01T19:54:27.849 INFO:teuthology.orchestra.run.smithi008.stdout: "event": "op_commit", 2023-08-01T19:54:27.849 INFO:teuthology.orchestra.run.smithi008.stdout: "time": "2023-08-01T19:54:27.829596+0000", 2023-08-01T19:54:27.849 INFO:teuthology.orchestra.run.smithi008.stdout: "duration": 0.0014635850000000001 2023-08-01T19:54:27.850 INFO:teuthology.orchestra.run.smithi008.stdout: } 2023-08-01T19:54:27.850 INFO:teuthology.orchestra.run.smithi008.stdout: ] 2023-08-01T19:54:27.850 INFO:teuthology.orchestra.run.smithi008.stdout: } 2023-08-01T19:54:27.850 INFO:teuthology.orchestra.run.smithi008.stdout: }, 2023-08-01T19:54:27.850 INFO:teuthology.orchestra.run.smithi008.stdout: { 2023-08-01T19:54:27.850 INFO:teuthology.orchestra.run.smithi008.stdout: "description": "osd_op(client.4668.0:14206 5.6 5:631922f1:::benchmark_data_smithi006_114134_object14205:head [set-alloc-hint object_size 65536 write_size 65536,write 0~65536 in=65536b] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e22)", 2023-08-01T19:54:27.850 INFO:teuthology.orchestra.run.smithi008.stdout: "initiated_at": "2023-08-01T19:54:27.825176+0000", 2023-08-01T19:54:27.850 INFO:teuthology.orchestra.run.smithi008.stdout: "age": 0.0054346749999999999, 2023-08-01T19:54:27.851 INFO:teuthology.orchestra.run.smithi008.stdout: "duration": 0.0055826920000000002, 2023-08-01T19:54:27.851 INFO:teuthology.orchestra.run.smithi008.stdout: "type_data": { 2023-08-01T19:54:27.851 INFO:teuthology.orchestra.run.smithi008.stdout: "flag_point": "waiting for sub ops", 2023-08-01T19:54:27.851 INFO:teuthology.orchestra.run.smithi008.stdout: "client_info": { 2023-08-01T19:54:27.851 INFO:teuthology.orchestra.run.smithi008.stdout: "client": "client.4668", 2023-08-01T19:54:27.851 INFO:teuthology.orchestra.run.smithi008.stdout: "client_addr": "172.21.15.6:0/1709472247", 2023-08-01T19:54:27.851 INFO:teuthology.orchestra.run.smithi008.stdout: "tid": 14206 2023-08-01T19:54:27.851 INFO:teuthology.orchestra.run.smithi008.stdout: }, 2023-08-01T19:54:27.852 INFO:teuthology.orchestra.run.smithi008.stdout: "events": [ 2023-08-01T19:54:27.852 INFO:teuthology.orchestra.run.smithi008.stdout: { 2023-08-01T19:54:27.852 INFO:teuthology.orchestra.run.smithi008.stdout: "event": "initiated", 2023-08-01T19:54:27.852 INFO:teuthology.orchestra.run.smithi008.stdout: "time": "2023-08-01T19:54:27.825176+0000", 2023-08-01T19:54:27.852 INFO:teuthology.orchestra.run.smithi008.stdout: "duration": 0 2023-08-01T19:54:27.852 INFO:teuthology.orchestra.run.smithi008.stdout: }, 2023-08-01T19:54:27.852 INFO:teuthology.orchestra.run.smithi008.stdout: { 2023-08-01T19:54:27.853 INFO:teuthology.orchestra.run.smithi008.stdout: "event": "throttled", 2023-08-01T19:54:27.853 INFO:teuthology.orchestra.run.smithi008.stdout: "time": "2023-08-01T19:54:27.825176+0000", 2023-08-01T19:54:27.853 INFO:teuthology.orchestra.run.smithi008.stdout: "duration": 0 2023-08-01T19:54:27.853 INFO:teuthology.orchestra.run.smithi008.stdout: }, 2023-08-01T19:54:27.853 INFO:teuthology.orchestra.run.smithi008.stdout: { 2023-08-01T19:54:27.853 INFO:teuthology.orchestra.run.smithi008.stdout: "event": "header_read", 2023-08-01T19:54:27.853 INFO:teuthology.orchestra.run.smithi008.stdout: "time": "2023-08-01T19:54:27.825175+0000", 2023-08-01T19:54:27.853 INFO:teuthology.orchestra.run.smithi008.stdout: "duration": 4294967295.999999 2023-08-01T19:54:27.854 INFO:teuthology.orchestra.run.smithi008.stdout: }, 2023-08-01T19:54:27.854 INFO:teuthology.orchestra.run.smithi008.stdout: { 2023-08-01T19:54:27.854 INFO:teuthology.orchestra.run.smithi008.stdout: "event": "all_read", 2023-08-01T19:54:27.854 INFO:teuthology.orchestra.run.smithi008.stdout: "time": "2023-08-01T19:54:27.825209+0000", 2023-08-01T19:54:27.854 INFO:teuthology.orchestra.run.smithi008.stdout: "duration": 3.3651e-05 2023-08-01T19:54:27.854 INFO:teuthology.orchestra.run.smithi008.stdout: }, 2023-08-01T19:54:27.854 INFO:teuthology.orchestra.run.smithi008.stdout: { 2023-08-01T19:54:27.854 INFO:teuthology.orchestra.run.smithi008.stdout: "event": "dispatched", 2023-08-01T19:54:27.855 INFO:teuthology.orchestra.run.smithi008.stdout: "time": "2023-08-01T19:54:27.825217+0000", 2023-08-01T19:54:27.855 INFO:teuthology.orchestra.run.smithi008.stdout: "duration": 7.8390000000000007e-06 2023-08-01T19:54:27.855 INFO:teuthology.orchestra.run.smithi008.stdout: }, 2023-08-01T19:54:27.855 INFO:teuthology.orchestra.run.smithi008.stdout: { 2023-08-01T19:54:27.855 INFO:teuthology.orchestra.run.smithi008.stdout: "event": "queued_for_pg", 2023-08-01T19:54:27.855 INFO:teuthology.orchestra.run.smithi008.stdout: "time": "2023-08-01T19:54:27.825223+0000", 2023-08-01T19:54:27.855 INFO:teuthology.orchestra.run.smithi008.stdout: "duration": 6.0789999999999997e-06 2023-08-01T19:54:27.855 INFO:teuthology.orchestra.run.smithi008.stdout: }, 2023-08-01T19:54:27.856 INFO:teuthology.orchestra.run.smithi008.stdout: { 2023-08-01T19:54:27.856 INFO:teuthology.orchestra.run.smithi008.stdout: "event": "reached_pg", 2023-08-01T19:54:27.856 INFO:teuthology.orchestra.run.smithi008.stdout: "time": "2023-08-01T19:54:27.825291+0000", 2023-08-01T19:54:27.856 INFO:teuthology.orchestra.run.smithi008.stdout: "duration": 6.8338999999999997e-05 2023-08-01T19:54:27.856 INFO:teuthology.orchestra.run.smithi008.stdout: }, 2023-08-01T19:54:27.856 INFO:teuthology.orchestra.run.smithi008.stdout: { 2023-08-01T19:54:27.856 INFO:teuthology.orchestra.run.smithi008.stdout: "event": "started", 2023-08-01T19:54:27.856 INFO:teuthology.orchestra.run.smithi008.stdout: "time": "2023-08-01T19:54:27.825408+0000", 2023-08-01T19:54:27.857 INFO:teuthology.orchestra.run.smithi008.stdout: "duration": 0.000116976 2023-08-01T19:54:27.857 INFO:teuthology.orchestra.run.smithi008.stdout: }, 2023-08-01T19:54:27.857 INFO:teuthology.orchestra.run.smithi008.stdout: { 2023-08-01T19:54:27.857 INFO:teuthology.orchestra.run.smithi008.stdout: "event": "waiting for subops from 1", 2023-08-01T19:54:27.857 INFO:teuthology.orchestra.run.smithi008.stdout: "time": "2023-08-01T19:54:27.825537+0000", 2023-08-01T19:54:27.857 INFO:teuthology.orchestra.run.smithi008.stdout: "duration": 0.00012935299999999999 2023-08-01T19:54:27.857 INFO:teuthology.orchestra.run.smithi008.stdout: }, 2023-08-01T19:54:27.858 INFO:teuthology.orchestra.run.smithi008.stdout: { 2023-08-01T19:54:27.858 INFO:teuthology.orchestra.run.smithi008.stdout: "event": "op_commit", 2023-08-01T19:54:27.858 INFO:teuthology.orchestra.run.smithi008.stdout: "time": "2023-08-01T19:54:27.827519+0000", 2023-08-01T19:54:27.858 INFO:teuthology.orchestra.run.smithi008.stdout: "duration": 0.0019816740000000001 2023-08-01T19:54:27.858 INFO:teuthology.orchestra.run.smithi008.stdout: } 2023-08-01T19:54:27.858 INFO:teuthology.orchestra.run.smithi008.stdout: ] 2023-08-01T19:54:27.858 INFO:teuthology.orchestra.run.smithi008.stdout: } 2023-08-01T19:54:27.858 INFO:teuthology.orchestra.run.smithi008.stdout: }, 2023-08-01T19:54:27.859 INFO:teuthology.orchestra.run.smithi008.stdout: { 2023-08-01T19:54:27.859 INFO:teuthology.orchestra.run.smithi008.stdout: "description": "osd_op(client.4668.0:14207 5.3 5:c913909e:::benchmark_data_smithi006_114134_object14206:head [set-alloc-hint object_size 65536 write_size 65536,write 0~65536 in=65536b] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e22)", 2023-08-01T19:54:27.859 INFO:teuthology.orchestra.run.smithi008.stdout: "initiated_at": "2023-08-01T19:54:27.825234+0000", 2023-08-01T19:54:27.859 INFO:teuthology.orchestra.run.smithi008.stdout: "age": 0.005376792, 2023-08-01T19:54:27.859 INFO:teuthology.orchestra.run.smithi008.stdout: "duration": 0.0055719719999999997, 2023-08-01T19:54:27.859 INFO:teuthology.orchestra.run.smithi008.stdout: "type_data": { 2023-08-01T19:54:27.859 INFO:teuthology.orchestra.run.smithi008.stdout: "flag_point": "waiting for sub ops", 2023-08-01T19:54:27.859 INFO:teuthology.orchestra.run.smithi008.stdout: "client_info": { 2023-08-01T19:54:27.860 INFO:teuthology.orchestra.run.smithi008.stdout: "client": "client.4668", 2023-08-01T19:54:27.860 INFO:teuthology.orchestra.run.smithi008.stdout: "client_addr": "172.21.15.6:0/1709472247", 2023-08-01T19:54:27.860 INFO:teuthology.orchestra.run.smithi008.stdout: "tid": 14207 2023-08-01T19:54:27.860 INFO:teuthology.orchestra.run.smithi008.stdout: }, 2023-08-01T19:54:27.860 INFO:teuthology.orchestra.run.smithi008.stdout: "events": [ 2023-08-01T19:54:27.860 INFO:teuthology.orchestra.run.smithi008.stdout: { 2023-08-01T19:54:27.860 INFO:teuthology.orchestra.run.smithi008.stdout: "event": "initiated", 2023-08-01T19:54:27.861 INFO:teuthology.orchestra.run.smithi008.stdout: "time": "2023-08-01T19:54:27.825234+0000", 2023-08-01T19:54:27.861 INFO:teuthology.orchestra.run.smithi008.stdout: "duration": 0 2023-08-01T19:54:27.861 INFO:teuthology.orchestra.run.smithi008.stdout: }, 2023-08-01T19:54:27.861 INFO:teuthology.orchestra.run.smithi008.stdout: { 2023-08-01T19:54:27.861 INFO:teuthology.orchestra.run.smithi008.stdout: "event": "throttled", 2023-08-01T19:54:27.861 INFO:teuthology.orchestra.run.smithi008.stdout: "time": "2023-08-01T19:54:27.825234+0000", 2023-08-01T19:54:27.861 INFO:teuthology.orchestra.run.smithi008.stdout: "duration": 0 2023-08-01T19:54:27.861 INFO:teuthology.orchestra.run.smithi008.stdout: }, 2023-08-01T19:54:27.862 INFO:teuthology.orchestra.run.smithi008.stdout: { 2023-08-01T19:54:27.862 INFO:teuthology.orchestra.run.smithi008.stdout: "event": "header_read", 2023-08-01T19:54:27.862 INFO:teuthology.orchestra.run.smithi008.stdout: "time": "2023-08-01T19:54:27.825233+0000", 2023-08-01T19:54:27.862 INFO:teuthology.orchestra.run.smithi008.stdout: "duration": 4294967295.9999995 2023-08-01T19:54:27.862 INFO:teuthology.orchestra.run.smithi008.stdout: }, 2023-08-01T19:54:27.862 INFO:teuthology.orchestra.run.smithi008.stdout: { 2023-08-01T19:54:27.862 INFO:teuthology.orchestra.run.smithi008.stdout: "event": "all_read", 2023-08-01T19:54:27.862 INFO:teuthology.orchestra.run.smithi008.stdout: "time": "2023-08-01T19:54:27.825264+0000", 2023-08-01T19:54:27.863 INFO:teuthology.orchestra.run.smithi008.stdout: "duration": 3.0821000000000002e-05 2023-08-01T19:54:27.863 INFO:teuthology.orchestra.run.smithi008.stdout: }, 2023-08-01T19:54:27.863 INFO:teuthology.orchestra.run.smithi008.stdout: { 2023-08-01T19:54:27.863 INFO:teuthology.orchestra.run.smithi008.stdout: "event": "dispatched", 2023-08-01T19:54:27.863 INFO:teuthology.orchestra.run.smithi008.stdout: "time": "2023-08-01T19:54:27.825273+0000", 2023-08-01T19:54:27.863 INFO:teuthology.orchestra.run.smithi008.stdout: "duration": 8.5979999999999997e-06 2023-08-01T19:54:27.863 INFO:teuthology.orchestra.run.smithi008.stdout: }, 2023-08-01T19:54:27.863 INFO:teuthology.orchestra.run.smithi008.stdout: { 2023-08-01T19:54:27.864 INFO:teuthology.orchestra.run.smithi008.stdout: "event": "queued_for_pg", 2023-08-01T19:54:27.864 INFO:teuthology.orchestra.run.smithi008.stdout: "time": "2023-08-01T19:54:27.825277+0000", 2023-08-01T19:54:27.864 INFO:teuthology.orchestra.run.smithi008.stdout: "duration": 4.3209999999999998e-06 2023-08-01T19:54:27.864 INFO:teuthology.orchestra.run.smithi008.stdout: }, 2023-08-01T19:54:27.864 INFO:teuthology.orchestra.run.smithi008.stdout: { 2023-08-01T19:54:27.864 INFO:teuthology.orchestra.run.smithi008.stdout: "event": "reached_pg", 2023-08-01T19:54:27.864 INFO:teuthology.orchestra.run.smithi008.stdout: "time": "2023-08-01T19:54:27.826118+0000", 2023-08-01T19:54:27.865 INFO:teuthology.orchestra.run.smithi008.stdout: "duration": 0.00084129400000000003 2023-08-01T19:54:27.865 INFO:teuthology.orchestra.run.smithi008.stdout: }, 2023-08-01T19:54:27.865 INFO:teuthology.orchestra.run.smithi008.stdout: { 2023-08-01T19:54:27.865 INFO:teuthology.orchestra.run.smithi008.stdout: "event": "started", 2023-08-01T19:54:27.865 INFO:teuthology.orchestra.run.smithi008.stdout: "time": "2023-08-01T19:54:27.826238+0000", 2023-08-01T19:54:27.865 INFO:teuthology.orchestra.run.smithi008.stdout: "duration": 0.00012010000000000001 2023-08-01T19:54:27.865 INFO:teuthology.orchestra.run.smithi008.stdout: }, 2023-08-01T19:54:27.865 INFO:teuthology.orchestra.run.smithi008.stdout: { 2023-08-01T19:54:27.866 INFO:teuthology.orchestra.run.smithi008.stdout: "event": "waiting for subops from 1", 2023-08-01T19:54:27.866 INFO:teuthology.orchestra.run.smithi008.stdout: "time": "2023-08-01T19:54:27.826372+0000", 2023-08-01T19:54:27.866 INFO:teuthology.orchestra.run.smithi008.stdout: "duration": 0.00013371800000000001 2023-08-01T19:54:27.866 INFO:teuthology.orchestra.run.smithi008.stdout: }, 2023-08-01T19:54:27.866 INFO:teuthology.orchestra.run.smithi008.stdout: { 2023-08-01T19:54:27.866 INFO:teuthology.orchestra.run.smithi008.stdout: "event": "op_commit", 2023-08-01T19:54:27.866 INFO:teuthology.orchestra.run.smithi008.stdout: "time": "2023-08-01T19:54:27.829541+0000", 2023-08-01T19:54:27.866 INFO:teuthology.orchestra.run.smithi008.stdout: "duration": 0.0031688649999999999 2023-08-01T19:54:27.867 INFO:teuthology.orchestra.run.smithi008.stdout: } 2023-08-01T19:54:27.867 INFO:teuthology.orchestra.run.smithi008.stdout: ] 2023-08-01T19:54:27.867 INFO:teuthology.orchestra.run.smithi008.stdout: } 2023-08-01T19:54:27.867 INFO:teuthology.orchestra.run.smithi008.stdout: }, 2023-08-01T19:54:27.867 INFO:teuthology.orchestra.run.smithi008.stdout: { 2023-08-01T19:54:27.867 INFO:teuthology.orchestra.run.smithi008.stdout: "description": "osd_op(client.4668.0:14209 5.3 5:ca40db85:::benchmark_data_smithi006_114134_object14208:head [set-alloc-hint object_size 65536 write_size 65536,write 0~65536 in=65536b] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e22)", 2023-08-01T19:54:27.868 INFO:teuthology.orchestra.run.smithi008.stdout: "initiated_at": "2023-08-01T19:54:27.826152+0000", 2023-08-01T19:54:27.868 INFO:teuthology.orchestra.run.smithi008.stdout: "age": 0.0044582770000000001, 2023-08-01T19:54:27.868 INFO:teuthology.orchestra.run.smithi008.stdout: "duration": 0.00469872, 2023-08-01T19:54:27.868 INFO:teuthology.orchestra.run.smithi008.stdout: "type_data": { 2023-08-01T19:54:27.868 INFO:teuthology.orchestra.run.smithi008.stdout: "flag_point": "waiting for sub ops", 2023-08-01T19:54:27.868 INFO:teuthology.orchestra.run.smithi008.stdout: "client_info": { 2023-08-01T19:54:27.868 INFO:teuthology.orchestra.run.smithi008.stdout: "client": "client.4668", 2023-08-01T19:54:27.868 INFO:teuthology.orchestra.run.smithi008.stdout: "client_addr": "172.21.15.6:0/1709472247", 2023-08-01T19:54:27.869 INFO:teuthology.orchestra.run.smithi008.stdout: "tid": 14209 2023-08-01T19:54:27.869 INFO:teuthology.orchestra.run.smithi008.stdout: }, 2023-08-01T19:54:27.869 INFO:teuthology.orchestra.run.smithi008.stdout: "events": [ 2023-08-01T19:54:27.869 INFO:teuthology.orchestra.run.smithi008.stdout: { 2023-08-01T19:54:27.869 INFO:teuthology.orchestra.run.smithi008.stdout: "event": "initiated", 2023-08-01T19:54:27.869 INFO:teuthology.orchestra.run.smithi008.stdout: "time": "2023-08-01T19:54:27.826152+0000", 2023-08-01T19:54:27.869 INFO:teuthology.orchestra.run.smithi008.stdout: "duration": 0 2023-08-01T19:54:27.869 INFO:teuthology.orchestra.run.smithi008.stdout: }, 2023-08-01T19:54:27.870 INFO:teuthology.orchestra.run.smithi008.stdout: { 2023-08-01T19:54:27.870 INFO:teuthology.orchestra.run.smithi008.stdout: "event": "throttled", 2023-08-01T19:54:27.870 INFO:teuthology.orchestra.run.smithi008.stdout: "time": "2023-08-01T19:54:27.826152+0000", 2023-08-01T19:54:27.870 INFO:teuthology.orchestra.run.smithi008.stdout: "duration": 0 2023-08-01T19:54:27.870 INFO:teuthology.orchestra.run.smithi008.stdout: }, 2023-08-01T19:54:27.870 INFO:teuthology.orchestra.run.smithi008.stdout: { 2023-08-01T19:54:27.870 INFO:teuthology.orchestra.run.smithi008.stdout: "event": "header_read", 2023-08-01T19:54:27.870 INFO:teuthology.orchestra.run.smithi008.stdout: "time": "2023-08-01T19:54:27.826151+0000", 2023-08-01T19:54:27.871 INFO:teuthology.orchestra.run.smithi008.stdout: "duration": 4294967295.999999 2023-08-01T19:54:27.871 INFO:teuthology.orchestra.run.smithi008.stdout: }, 2023-08-01T19:54:27.871 INFO:teuthology.orchestra.run.smithi008.stdout: { 2023-08-01T19:54:27.871 INFO:teuthology.orchestra.run.smithi008.stdout: "event": "all_read", 2023-08-01T19:54:27.871 INFO:teuthology.orchestra.run.smithi008.stdout: "time": "2023-08-01T19:54:27.826195+0000", 2023-08-01T19:54:27.871 INFO:teuthology.orchestra.run.smithi008.stdout: "duration": 4.3130000000000002e-05 2023-08-01T19:54:27.871 INFO:teuthology.orchestra.run.smithi008.stdout: }, 2023-08-01T19:54:27.871 INFO:teuthology.orchestra.run.smithi008.stdout: { 2023-08-01T19:54:27.872 INFO:teuthology.orchestra.run.smithi008.stdout: "event": "dispatched", 2023-08-01T19:54:27.872 INFO:teuthology.orchestra.run.smithi008.stdout: "time": "2023-08-01T19:54:27.826208+0000", 2023-08-01T19:54:27.872 INFO:teuthology.orchestra.run.smithi008.stdout: "duration": 1.3213e-05 2023-08-01T19:54:27.872 INFO:teuthology.orchestra.run.smithi008.stdout: }, 2023-08-01T19:54:27.872 INFO:teuthology.orchestra.run.smithi008.stdout: { 2023-08-01T19:54:27.872 INFO:teuthology.orchestra.run.smithi008.stdout: "event": "queued_for_pg", 2023-08-01T19:54:27.872 INFO:teuthology.orchestra.run.smithi008.stdout: "time": "2023-08-01T19:54:27.826214+0000", 2023-08-01T19:54:27.873 INFO:teuthology.orchestra.run.smithi008.stdout: "duration": 6.0560000000000001e-06 2023-08-01T19:54:27.873 INFO:teuthology.orchestra.run.smithi008.stdout: }, 2023-08-01T19:54:27.873 INFO:teuthology.orchestra.run.smithi008.stdout: { 2023-08-01T19:54:27.873 INFO:teuthology.orchestra.run.smithi008.stdout: "event": "reached_pg", 2023-08-01T19:54:27.873 INFO:teuthology.orchestra.run.smithi008.stdout: "time": "2023-08-01T19:54:27.826955+0000", 2023-08-01T19:54:27.873 INFO:teuthology.orchestra.run.smithi008.stdout: "duration": 0.00074102800000000002 2023-08-01T19:54:27.873 INFO:teuthology.orchestra.run.smithi008.stdout: }, 2023-08-01T19:54:27.873 INFO:teuthology.orchestra.run.smithi008.stdout: { 2023-08-01T19:54:27.874 INFO:teuthology.orchestra.run.smithi008.stdout: "event": "started", 2023-08-01T19:54:27.874 INFO:teuthology.orchestra.run.smithi008.stdout: "time": "2023-08-01T19:54:27.827075+0000", 2023-08-01T19:54:27.874 INFO:teuthology.orchestra.run.smithi008.stdout: "duration": 0.000120251 2023-08-01T19:54:27.874 INFO:teuthology.orchestra.run.smithi008.stdout: }, 2023-08-01T19:54:27.874 INFO:teuthology.orchestra.run.smithi008.stdout: { 2023-08-01T19:54:27.874 INFO:teuthology.orchestra.run.smithi008.stdout: "event": "waiting for subops from 1", 2023-08-01T19:54:27.874 INFO:teuthology.orchestra.run.smithi008.stdout: "time": "2023-08-01T19:54:27.827226+0000", 2023-08-01T19:54:27.874 INFO:teuthology.orchestra.run.smithi008.stdout: "duration": 0.000150684 2023-08-01T19:54:27.875 INFO:teuthology.orchestra.run.smithi008.stdout: }, 2023-08-01T19:54:27.875 INFO:teuthology.orchestra.run.smithi008.stdout: { 2023-08-01T19:54:27.875 INFO:teuthology.orchestra.run.smithi008.stdout: "event": "op_commit", 2023-08-01T19:54:27.875 INFO:teuthology.orchestra.run.smithi008.stdout: "time": "2023-08-01T19:54:27.829591+0000", 2023-08-01T19:54:27.875 INFO:teuthology.orchestra.run.smithi008.stdout: "duration": 0.002365701 2023-08-01T19:54:27.875 INFO:teuthology.orchestra.run.smithi008.stdout: } 2023-08-01T19:54:27.875 INFO:teuthology.orchestra.run.smithi008.stdout: ] 2023-08-01T19:54:27.875 INFO:teuthology.orchestra.run.smithi008.stdout: } 2023-08-01T19:54:27.876 INFO:teuthology.orchestra.run.smithi008.stdout: }, 2023-08-01T19:54:27.876 INFO:teuthology.orchestra.run.smithi008.stdout: { 2023-08-01T19:54:27.876 INFO:teuthology.orchestra.run.smithi008.stdout: "description": "osd_op(client.4668.0:14210 5.3 5:c1a12cde:::benchmark_data_smithi006_114134_object14209:head [set-alloc-hint object_size 65536 write_size 65536,write 0~65536 in=65536b] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e22)", 2023-08-01T19:54:27.876 INFO:teuthology.orchestra.run.smithi008.stdout: "initiated_at": "2023-08-01T19:54:27.826229+0000", 2023-08-01T19:54:27.876 INFO:teuthology.orchestra.run.smithi008.stdout: "age": 0.0043811450000000004, 2023-08-01T19:54:27.876 INFO:teuthology.orchestra.run.smithi008.stdout: "duration": 0.0046806809999999999, 2023-08-01T19:54:27.876 INFO:teuthology.orchestra.run.smithi008.stdout: "type_data": { 2023-08-01T19:54:27.877 INFO:teuthology.orchestra.run.smithi008.stdout: "flag_point": "waiting for sub ops", 2023-08-01T19:54:27.877 INFO:teuthology.orchestra.run.smithi008.stdout: "client_info": { 2023-08-01T19:54:27.877 INFO:teuthology.orchestra.run.smithi008.stdout: "client": "client.4668", 2023-08-01T19:54:27.877 INFO:teuthology.orchestra.run.smithi008.stdout: "client_addr": "172.21.15.6:0/1709472247", 2023-08-01T19:54:27.877 INFO:teuthology.orchestra.run.smithi008.stdout: "tid": 14210 2023-08-01T19:54:27.877 INFO:teuthology.orchestra.run.smithi008.stdout: }, 2023-08-01T19:54:27.877 INFO:teuthology.orchestra.run.smithi008.stdout: "events": [ 2023-08-01T19:54:27.877 INFO:teuthology.orchestra.run.smithi008.stdout: { 2023-08-01T19:54:27.878 INFO:teuthology.orchestra.run.smithi008.stdout: "event": "initiated", 2023-08-01T19:54:27.878 INFO:teuthology.orchestra.run.smithi008.stdout: "time": "2023-08-01T19:54:27.826229+0000", 2023-08-01T19:54:27.878 INFO:teuthology.orchestra.run.smithi008.stdout: "duration": 0 2023-08-01T19:54:27.878 INFO:teuthology.orchestra.run.smithi008.stdout: }, 2023-08-01T19:54:27.878 INFO:teuthology.orchestra.run.smithi008.stdout: { 2023-08-01T19:54:27.878 INFO:teuthology.orchestra.run.smithi008.stdout: "event": "throttled", 2023-08-01T19:54:27.878 INFO:teuthology.orchestra.run.smithi008.stdout: "time": "2023-08-01T19:54:27.826229+0000", 2023-08-01T19:54:27.878 INFO:teuthology.orchestra.run.smithi008.stdout: "duration": 0 2023-08-01T19:54:27.879 INFO:teuthology.orchestra.run.smithi008.stdout: }, 2023-08-01T19:54:27.879 INFO:teuthology.orchestra.run.smithi008.stdout: { 2023-08-01T19:54:27.879 INFO:teuthology.orchestra.run.smithi008.stdout: "event": "header_read", 2023-08-01T19:54:27.879 INFO:teuthology.orchestra.run.smithi008.stdout: "time": "2023-08-01T19:54:27.826229+0000", 2023-08-01T19:54:27.879 INFO:teuthology.orchestra.run.smithi008.stdout: "duration": 4294967295.9999995 2023-08-01T19:54:27.879 INFO:teuthology.orchestra.run.smithi008.stdout: }, 2023-08-01T19:54:27.879 INFO:teuthology.orchestra.run.smithi008.stdout: { 2023-08-01T19:54:27.879 INFO:teuthology.orchestra.run.smithi008.stdout: "event": "all_read", 2023-08-01T19:54:27.880 INFO:teuthology.orchestra.run.smithi008.stdout: "time": "2023-08-01T19:54:27.826337+0000", 2023-08-01T19:54:27.880 INFO:teuthology.orchestra.run.smithi008.stdout: "duration": 0.000107843 2023-08-01T19:54:27.880 INFO:teuthology.orchestra.run.smithi008.stdout: }, 2023-08-01T19:54:27.880 INFO:teuthology.orchestra.run.smithi008.stdout: { 2023-08-01T19:54:27.880 INFO:teuthology.orchestra.run.smithi008.stdout: "event": "dispatched", 2023-08-01T19:54:27.880 INFO:teuthology.orchestra.run.smithi008.stdout: "time": "2023-08-01T19:54:27.826351+0000", 2023-08-01T19:54:27.880 INFO:teuthology.orchestra.run.smithi008.stdout: "duration": 1.3947999999999999e-05 2023-08-01T19:54:27.881 INFO:teuthology.orchestra.run.smithi008.stdout: }, 2023-08-01T19:54:27.881 INFO:teuthology.orchestra.run.smithi008.stdout: { 2023-08-01T19:54:27.881 INFO:teuthology.orchestra.run.smithi008.stdout: "event": "queued_for_pg", 2023-08-01T19:54:27.881 INFO:teuthology.orchestra.run.smithi008.stdout: "time": "2023-08-01T19:54:27.826356+0000", 2023-08-01T19:54:27.881 INFO:teuthology.orchestra.run.smithi008.stdout: "duration": 5.8490000000000002e-06 2023-08-01T19:54:27.881 INFO:teuthology.orchestra.run.smithi008.stdout: }, 2023-08-01T19:54:27.881 INFO:teuthology.orchestra.run.smithi008.stdout: { 2023-08-01T19:54:27.881 INFO:teuthology.orchestra.run.smithi008.stdout: "event": "reached_pg", 2023-08-01T19:54:27.882 INFO:teuthology.orchestra.run.smithi008.stdout: "time": "2023-08-01T19:54:27.827909+0000", 2023-08-01T19:54:27.882 INFO:teuthology.orchestra.run.smithi008.stdout: "duration": 0.00155255 2023-08-01T19:54:27.882 INFO:teuthology.orchestra.run.smithi008.stdout: }, 2023-08-01T19:54:27.882 INFO:teuthology.orchestra.run.smithi008.stdout: { 2023-08-01T19:54:27.882 INFO:teuthology.orchestra.run.smithi008.stdout: "event": "started", 2023-08-01T19:54:27.882 INFO:teuthology.orchestra.run.smithi008.stdout: "time": "2023-08-01T19:54:27.828034+0000", 2023-08-01T19:54:27.882 INFO:teuthology.orchestra.run.smithi008.stdout: "duration": 0.000125406 2023-08-01T19:54:27.883 INFO:teuthology.orchestra.run.smithi008.stdout: }, 2023-08-01T19:54:27.883 INFO:teuthology.orchestra.run.smithi008.stdout: { 2023-08-01T19:54:27.883 INFO:teuthology.orchestra.run.smithi008.stdout: "event": "waiting for subops from 1", 2023-08-01T19:54:27.883 INFO:teuthology.orchestra.run.smithi008.stdout: "time": "2023-08-01T19:54:27.828173+0000", 2023-08-01T19:54:27.883 INFO:teuthology.orchestra.run.smithi008.stdout: "duration": 0.00013894100000000001 2023-08-01T19:54:27.883 INFO:teuthology.orchestra.run.smithi008.stdout: }, 2023-08-01T19:54:27.883 INFO:teuthology.orchestra.run.smithi008.stdout: { 2023-08-01T19:54:27.883 INFO:teuthology.orchestra.run.smithi008.stdout: "event": "op_commit", 2023-08-01T19:54:27.884 INFO:teuthology.orchestra.run.smithi008.stdout: "time": "2023-08-01T19:54:27.829596+0000", 2023-08-01T19:54:27.884 INFO:teuthology.orchestra.run.smithi008.stdout: "duration": 0.0014229749999999999 2023-08-01T19:54:27.884 INFO:teuthology.orchestra.run.smithi008.stdout: } 2023-08-01T19:54:27.884 INFO:teuthology.orchestra.run.smithi008.stdout: ] 2023-08-01T19:54:27.884 INFO:teuthology.orchestra.run.smithi008.stdout: } 2023-08-01T19:54:27.884 INFO:teuthology.orchestra.run.smithi008.stdout: } 2023-08-01T19:54:27.884 INFO:teuthology.orchestra.run.smithi008.stdout: ], 2023-08-01T19:54:27.884 INFO:teuthology.orchestra.run.smithi008.stdout: "num_ops": 6 2023-08-01T19:54:27.885 INFO:teuthology.orchestra.run.smithi008.stdout:} 2023-08-01T19:54:27.886 DEBUG:teuthology.orchestra.run.smithi008:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 30 ceph --cluster ceph --admin-daemon /var/run/ceph/ceph-osd.0.asok dump_blocked_ops 2023-08-01T19:54:27.886 INFO:tasks.ceph.osd.0.smithi008.stderr:2023-08-01T19:54:27.884+0000 7f16a58f4700 -1 received signal: Hangup from /usr/bin/python3 /bin/daemon-helper kill ceph-osd -f --cluster ceph -i 0 (PID: 111179) UID: 0 2023-08-01T19:54:27.986 INFO:tasks.ceph.osd.2.smithi155.stderr:2023-08-01T19:54:27.986+0000 7faa5c6ac700 -1 received signal: Hangup from /usr/bin/python3 /bin/daemon-helper kill ceph-osd -f --cluster ceph -i 2 (PID: 111337) UID: 0 2023-08-01T19:54:28.088 INFO:tasks.ceph.osd.2.smithi155.stderr:2023-08-01T19:54:28.087+0000 7faa5c6ac700 -1 received signal: Hangup from /usr/bin/python3 /bin/daemon-helper kill ceph-osd -f --cluster ceph -i 2 (PID: 111337) UID: 0 2023-08-01T19:54:28.129 INFO:teuthology.orchestra.run.smithi008.stdout:{ 2023-08-01T19:54:28.129 INFO:teuthology.orchestra.run.smithi008.stdout: "ops": [], 2023-08-01T19:54:28.129 INFO:teuthology.orchestra.run.smithi008.stdout: "complaint_time": 30, 2023-08-01T19:54:28.129 INFO:teuthology.orchestra.run.smithi008.stdout: "num_blocked_ops": 0 2023-08-01T19:54:28.129 INFO:teuthology.orchestra.run.smithi008.stdout:} 2023-08-01T19:54:28.145 DEBUG:teuthology.orchestra.run.smithi008:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 30 ceph --cluster ceph --admin-daemon /var/run/ceph/ceph-osd.0.asok dump_historic_ops 2023-08-01T19:54:28.153 INFO:teuthology.orchestra.run.smithi006.stderr:noscrub is unset 2023-08-01T19:54:28.189 INFO:tasks.ceph.osd.0.smithi008.stderr:2023-08-01T19:54:28.187+0000 7f16a58f4700 -1 received signal: Hangup from /usr/bin/python3 /bin/daemon-helper kill ceph-osd -f --cluster ceph -i 0 (PID: 111179) UID: 0 2023-08-01T19:54:28.289 INFO:tasks.ceph.osd.2.smithi155.stderr:2023-08-01T19:54:28.289+0000 7faa5c6ac700 -1 received signal: Hangup from /usr/bin/python3 /bin/daemon-helper kill ceph-osd -f --cluster ceph -i 2 (PID: 111337) UID: 0 2023-08-01T19:54:28.313 INFO:tasks.radosbench.radosbench.0.smithi006.stdout: 4 16 15909 15893 248.311 222.812 0.00319279 0.0040221 2023-08-01T19:54:28.338 INFO:teuthology.orchestra.run.smithi008.stdout:{ 2023-08-01T19:54:28.339 INFO:teuthology.orchestra.run.smithi008.stdout: "size": 20, 2023-08-01T19:54:28.339 INFO:teuthology.orchestra.run.smithi008.stdout: "duration": 600, 2023-08-01T19:54:28.339 INFO:teuthology.orchestra.run.smithi008.stdout: "ops": [ 2023-08-01T19:54:28.339 INFO:teuthology.orchestra.run.smithi008.stdout: { 2023-08-01T19:54:28.339 INFO:teuthology.orchestra.run.smithi008.stdout: "description": "osd_op(mds.0.3:4 3.1f 3:ff5b34d6:::1.00000000:head [omap-set-header] snapc 0=[] ondisk+write+known_if_redirected+full_force+supports_pool_eio e17)", 2023-08-01T19:54:28.340 INFO:teuthology.orchestra.run.smithi008.stdout: "initiated_at": "2023-08-01T19:54:04.459058+0000", 2023-08-01T19:54:28.340 INFO:teuthology.orchestra.run.smithi008.stdout: "age": 23.875915243000001, 2023-08-01T19:54:28.340 INFO:teuthology.orchestra.run.smithi008.stdout: "duration": 0.011600047, 2023-08-01T19:54:28.340 INFO:teuthology.orchestra.run.smithi008.stdout: "type_data": { 2023-08-01T19:54:28.341 INFO:teuthology.orchestra.run.smithi008.stdout: "flag_point": "commit sent; apply or cleanup", 2023-08-01T19:54:28.341 INFO:teuthology.orchestra.run.smithi008.stdout: "events": [ 2023-08-01T19:54:28.341 INFO:teuthology.orchestra.run.smithi008.stdout: { 2023-08-01T19:54:28.341 INFO:teuthology.orchestra.run.smithi008.stdout: "event": "initiated", 2023-08-01T19:54:28.342 INFO:teuthology.orchestra.run.smithi008.stdout: "time": "2023-08-01T19:54:04.459058+0000", 2023-08-01T19:54:28.342 INFO:teuthology.orchestra.run.smithi008.stdout: "duration": 0 2023-08-01T19:54:28.342 INFO:teuthology.orchestra.run.smithi008.stdout: }, 2023-08-01T19:54:28.342 INFO:teuthology.orchestra.run.smithi008.stdout: { 2023-08-01T19:54:28.342 INFO:teuthology.orchestra.run.smithi008.stdout: "event": "throttled", 2023-08-01T19:54:28.342 INFO:teuthology.orchestra.run.smithi008.stdout: "time": "2023-08-01T19:54:04.459058+0000", 2023-08-01T19:54:28.343 INFO:teuthology.orchestra.run.smithi008.stdout: "duration": 0 2023-08-01T19:54:28.343 INFO:teuthology.orchestra.run.smithi008.stdout: }, 2023-08-01T19:54:28.343 INFO:teuthology.orchestra.run.smithi008.stdout: { 2023-08-01T19:54:28.343 INFO:teuthology.orchestra.run.smithi008.stdout: "event": "header_read", 2023-08-01T19:54:28.344 INFO:teuthology.orchestra.run.smithi008.stdout: "time": "2023-08-01T19:54:04.459052+0000", 2023-08-01T19:54:28.344 INFO:teuthology.orchestra.run.smithi008.stdout: "duration": 4294967295.9999938 2023-08-01T19:54:28.344 INFO:teuthology.orchestra.run.smithi008.stdout: }, 2023-08-01T19:54:28.344 INFO:teuthology.orchestra.run.smithi008.stdout: { 2023-08-01T19:54:28.344 INFO:teuthology.orchestra.run.smithi008.stdout: "event": "all_read", 2023-08-01T19:54:28.344 INFO:teuthology.orchestra.run.smithi008.stdout: "time": "2023-08-01T19:54:04.459069+0000", 2023-08-01T19:54:28.345 INFO:teuthology.orchestra.run.smithi008.stdout: "duration": 1.6395000000000001e-05 2023-08-01T19:54:28.345 INFO:teuthology.orchestra.run.smithi008.stdout: }, 2023-08-01T19:54:28.345 INFO:teuthology.orchestra.run.smithi008.stdout: { 2023-08-01T19:54:28.345 INFO:teuthology.orchestra.run.smithi008.stdout: "event": "dispatched", 2023-08-01T19:54:28.345 INFO:teuthology.orchestra.run.smithi008.stdout: "time": "2023-08-01T19:54:04.459083+0000", 2023-08-01T19:54:28.345 INFO:teuthology.orchestra.run.smithi008.stdout: "duration": 1.3869999999999999e-05 2023-08-01T19:54:28.345 INFO:teuthology.orchestra.run.smithi008.stdout: }, 2023-08-01T19:54:28.346 INFO:teuthology.orchestra.run.smithi008.stdout: { 2023-08-01T19:54:28.346 INFO:teuthology.orchestra.run.smithi008.stdout: "event": "queued_for_pg", 2023-08-01T19:54:28.346 INFO:teuthology.orchestra.run.smithi008.stdout: "time": "2023-08-01T19:54:04.459099+0000", 2023-08-01T19:54:28.346 INFO:teuthology.orchestra.run.smithi008.stdout: "duration": 1.681e-05 2023-08-01T19:54:28.346 INFO:teuthology.orchestra.run.smithi008.stdout: }, 2023-08-01T19:54:28.346 INFO:teuthology.orchestra.run.smithi008.stdout: { 2023-08-01T19:54:28.346 INFO:teuthology.orchestra.run.smithi008.stdout: "event": "reached_pg", 2023-08-01T19:54:28.347 INFO:teuthology.orchestra.run.smithi008.stdout: "time": "2023-08-01T19:54:04.459781+0000", 2023-08-01T19:54:28.347 INFO:teuthology.orchestra.run.smithi008.stdout: "duration": 0.00068143200000000004 2023-08-01T19:54:28.347 INFO:teuthology.orchestra.run.smithi008.stdout: }, 2023-08-01T19:54:28.347 INFO:teuthology.orchestra.run.smithi008.stdout: { 2023-08-01T19:54:28.347 INFO:teuthology.orchestra.run.smithi008.stdout: "event": "op must wait for map", 2023-08-01T19:54:28.347 INFO:teuthology.orchestra.run.smithi008.stdout: "time": "2023-08-01T19:54:04.459787+0000", 2023-08-01T19:54:28.347 INFO:teuthology.orchestra.run.smithi008.stdout: "duration": 6.562e-06 2023-08-01T19:54:28.348 INFO:teuthology.orchestra.run.smithi008.stdout: }, 2023-08-01T19:54:28.348 INFO:teuthology.orchestra.run.smithi008.stdout: { 2023-08-01T19:54:28.348 INFO:teuthology.orchestra.run.smithi008.stdout: "event": "reached_pg", 2023-08-01T19:54:28.348 INFO:teuthology.orchestra.run.smithi008.stdout: "time": "2023-08-01T19:54:04.461027+0000", 2023-08-01T19:54:28.348 INFO:teuthology.orchestra.run.smithi008.stdout: "duration": 0.001239846 2023-08-01T19:54:28.348 INFO:teuthology.orchestra.run.smithi008.stdout: }, 2023-08-01T19:54:28.348 INFO:teuthology.orchestra.run.smithi008.stdout: { 2023-08-01T19:54:28.349 INFO:teuthology.orchestra.run.smithi008.stdout: "event": "started", 2023-08-01T19:54:28.349 INFO:teuthology.orchestra.run.smithi008.stdout: "time": "2023-08-01T19:54:04.461333+0000", 2023-08-01T19:54:28.349 INFO:teuthology.orchestra.run.smithi008.stdout: "duration": 0.00030574999999999998 2023-08-01T19:54:28.349 INFO:teuthology.orchestra.run.smithi008.stdout: }, 2023-08-01T19:54:28.350 INFO:teuthology.orchestra.run.smithi008.stdout: { 2023-08-01T19:54:28.350 INFO:teuthology.orchestra.run.smithi008.stdout: "event": "waiting for subops from 1", 2023-08-01T19:54:28.350 INFO:teuthology.orchestra.run.smithi008.stdout: "time": "2023-08-01T19:54:04.461789+0000", 2023-08-01T19:54:28.350 INFO:teuthology.orchestra.run.smithi008.stdout: "duration": 0.00045635499999999998 2023-08-01T19:54:28.350 INFO:teuthology.orchestra.run.smithi008.stdout: }, 2023-08-01T19:54:28.350 INFO:teuthology.orchestra.run.smithi008.stdout: { 2023-08-01T19:54:28.350 INFO:teuthology.orchestra.run.smithi008.stdout: "event": "op_commit", 2023-08-01T19:54:28.351 INFO:teuthology.orchestra.run.smithi008.stdout: "time": "2023-08-01T19:54:04.464364+0000", 2023-08-01T19:54:28.351 INFO:teuthology.orchestra.run.smithi008.stdout: "duration": 0.002574603 2023-08-01T19:54:28.351 INFO:teuthology.orchestra.run.smithi008.stdout: }, 2023-08-01T19:54:28.351 INFO:teuthology.orchestra.run.smithi008.stdout: { 2023-08-01T19:54:28.351 INFO:teuthology.orchestra.run.smithi008.stdout: "event": "sub_op_commit_rec", 2023-08-01T19:54:28.351 INFO:teuthology.orchestra.run.smithi008.stdout: "time": "2023-08-01T19:54:04.470558+0000", 2023-08-01T19:54:28.351 INFO:teuthology.orchestra.run.smithi008.stdout: "duration": 0.0061936910000000003 2023-08-01T19:54:28.352 INFO:teuthology.orchestra.run.smithi008.stdout: }, 2023-08-01T19:54:28.352 INFO:teuthology.orchestra.run.smithi008.stdout: { 2023-08-01T19:54:28.352 INFO:teuthology.orchestra.run.smithi008.stdout: "event": "commit_sent", 2023-08-01T19:54:28.352 INFO:teuthology.orchestra.run.smithi008.stdout: "time": "2023-08-01T19:54:04.470615+0000", 2023-08-01T19:54:28.352 INFO:teuthology.orchestra.run.smithi008.stdout: "duration": 5.7138000000000001e-05 2023-08-01T19:54:28.353 INFO:teuthology.orchestra.run.smithi008.stdout: }, 2023-08-01T19:54:28.353 INFO:teuthology.orchestra.run.smithi008.stdout: { 2023-08-01T19:54:28.353 INFO:teuthology.orchestra.run.smithi008.stdout: "event": "done", 2023-08-01T19:54:28.354 INFO:teuthology.orchestra.run.smithi008.stdout: "time": "2023-08-01T19:54:04.470658+0000", 2023-08-01T19:54:28.354 INFO:teuthology.orchestra.run.smithi008.stdout: "duration": 4.3640999999999998e-05 2023-08-01T19:54:28.354 INFO:teuthology.orchestra.run.smithi008.stdout: } 2023-08-01T19:54:28.354 INFO:teuthology.orchestra.run.smithi008.stdout: ] 2023-08-01T19:54:28.355 INFO:teuthology.orchestra.run.smithi008.stdout: } 2023-08-01T19:54:28.355 INFO:teuthology.orchestra.run.smithi008.stdout: }, 2023-08-01T19:54:28.355 INFO:teuthology.orchestra.run.smithi008.stdout: { 2023-08-01T19:54:28.356 INFO:teuthology.orchestra.run.smithi008.stdout: "description": "osd_op(mds.0.3:5 3.1f 3:ff5b34d6:::1.00000000:head [create,setxattr parent (30) in=6b,setxattr layout (30) in=6b] snapc 0=[] ondisk+write+known_if_redirected+full_force+supports_pool_eio e17)", 2023-08-01T19:54:28.356 INFO:teuthology.orchestra.run.smithi008.stdout: "initiated_at": "2023-08-01T19:54:04.459120+0000", 2023-08-01T19:54:28.356 INFO:teuthology.orchestra.run.smithi008.stdout: "age": 23.875853684999999, 2023-08-01T19:54:28.356 INFO:teuthology.orchestra.run.smithi008.stdout: "duration": 0.012982585, 2023-08-01T19:54:28.356 INFO:teuthology.orchestra.run.smithi008.stdout: "type_data": { 2023-08-01T19:54:28.356 INFO:teuthology.orchestra.run.smithi008.stdout: "flag_point": "commit sent; apply or cleanup", 2023-08-01T19:54:28.357 INFO:teuthology.orchestra.run.smithi008.stdout: "events": [ 2023-08-01T19:54:28.357 INFO:teuthology.orchestra.run.smithi008.stdout: { 2023-08-01T19:54:28.357 INFO:teuthology.orchestra.run.smithi008.stdout: "event": "initiated", 2023-08-01T19:54:28.357 INFO:teuthology.orchestra.run.smithi008.stdout: "time": "2023-08-01T19:54:04.459120+0000", 2023-08-01T19:54:28.358 INFO:teuthology.orchestra.run.smithi008.stdout: "duration": 0 2023-08-01T19:54:28.358 INFO:teuthology.orchestra.run.smithi008.stdout: }, 2023-08-01T19:54:28.358 INFO:teuthology.orchestra.run.smithi008.stdout: { 2023-08-01T19:54:28.358 INFO:teuthology.orchestra.run.smithi008.stdout: "event": "throttled", 2023-08-01T19:54:28.358 INFO:teuthology.orchestra.run.smithi008.stdout: "time": "2023-08-01T19:54:04.459120+0000", 2023-08-01T19:54:28.359 INFO:teuthology.orchestra.run.smithi008.stdout: "duration": 0 2023-08-01T19:54:28.359 INFO:teuthology.orchestra.run.smithi008.stdout: }, 2023-08-01T19:54:28.359 INFO:teuthology.orchestra.run.smithi008.stdout: { 2023-08-01T19:54:28.359 INFO:teuthology.orchestra.run.smithi008.stdout: "event": "header_read", 2023-08-01T19:54:28.359 INFO:teuthology.orchestra.run.smithi008.stdout: "time": "2023-08-01T19:54:04.459119+0000", 2023-08-01T19:54:28.359 INFO:teuthology.orchestra.run.smithi008.stdout: "duration": 4294967295.999999 2023-08-01T19:54:28.360 INFO:teuthology.orchestra.run.smithi008.stdout: }, 2023-08-01T19:54:28.360 INFO:teuthology.orchestra.run.smithi008.stdout: { 2023-08-01T19:54:28.360 INFO:teuthology.orchestra.run.smithi008.stdout: "event": "all_read", 2023-08-01T19:54:28.360 INFO:teuthology.orchestra.run.smithi008.stdout: "time": "2023-08-01T19:54:04.459137+0000", 2023-08-01T19:54:28.360 INFO:teuthology.orchestra.run.smithi008.stdout: "duration": 1.7554000000000002e-05 2023-08-01T19:54:28.360 INFO:teuthology.orchestra.run.smithi008.stdout: }, 2023-08-01T19:54:28.360 INFO:teuthology.orchestra.run.smithi008.stdout: { 2023-08-01T19:54:28.361 INFO:teuthology.orchestra.run.smithi008.stdout: "event": "dispatched", 2023-08-01T19:54:28.361 INFO:teuthology.orchestra.run.smithi008.stdout: "time": "2023-08-01T19:54:04.459148+0000", 2023-08-01T19:54:28.361 INFO:teuthology.orchestra.run.smithi008.stdout: "duration": 1.1248e-05 2023-08-01T19:54:28.361 INFO:teuthology.orchestra.run.smithi008.stdout: }, 2023-08-01T19:54:28.361 INFO:teuthology.orchestra.run.smithi008.stdout: { 2023-08-01T19:54:28.361 INFO:teuthology.orchestra.run.smithi008.stdout: "event": "queued_for_pg", 2023-08-01T19:54:28.361 INFO:teuthology.orchestra.run.smithi008.stdout: "time": "2023-08-01T19:54:04.459167+0000", 2023-08-01T19:54:28.362 INFO:teuthology.orchestra.run.smithi008.stdout: "duration": 1.9457999999999999e-05 2023-08-01T19:54:28.362 INFO:teuthology.orchestra.run.smithi008.stdout: }, 2023-08-01T19:54:28.362 INFO:teuthology.orchestra.run.smithi008.stdout: { 2023-08-01T19:54:28.362 INFO:teuthology.orchestra.run.smithi008.stdout: "event": "reached_pg", 2023-08-01T19:54:28.362 INFO:teuthology.orchestra.run.smithi008.stdout: "time": "2023-08-01T19:54:04.459863+0000", 2023-08-01T19:54:28.362 INFO:teuthology.orchestra.run.smithi008.stdout: "duration": 0.000695325 2023-08-01T19:54:28.362 INFO:teuthology.orchestra.run.smithi008.stdout: }, 2023-08-01T19:54:28.363 INFO:teuthology.orchestra.run.smithi008.stdout: { 2023-08-01T19:54:28.363 INFO:teuthology.orchestra.run.smithi008.stdout: "event": "waiting_for_map not empty", 2023-08-01T19:54:28.363 INFO:teuthology.orchestra.run.smithi008.stdout: "time": "2023-08-01T19:54:04.459866+0000", 2023-08-01T19:54:28.363 INFO:teuthology.orchestra.run.smithi008.stdout: "duration": 3.1540000000000002e-06 2023-08-01T19:54:28.363 INFO:teuthology.orchestra.run.smithi008.stdout: }, 2023-08-01T19:54:28.363 INFO:teuthology.orchestra.run.smithi008.stdout: { 2023-08-01T19:54:28.363 INFO:teuthology.orchestra.run.smithi008.stdout: "event": "reached_pg", 2023-08-01T19:54:28.364 INFO:teuthology.orchestra.run.smithi008.stdout: "time": "2023-08-01T19:54:04.462285+0000", 2023-08-01T19:54:28.364 INFO:teuthology.orchestra.run.smithi008.stdout: "duration": 0.0024190560000000002 2023-08-01T19:54:28.364 INFO:teuthology.orchestra.run.smithi008.stdout: }, 2023-08-01T19:54:28.364 INFO:teuthology.orchestra.run.smithi008.stdout: { 2023-08-01T19:54:28.364 INFO:teuthology.orchestra.run.smithi008.stdout: "event": "started", 2023-08-01T19:54:28.364 INFO:teuthology.orchestra.run.smithi008.stdout: "time": "2023-08-01T19:54:04.462365+0000", 2023-08-01T19:54:28.364 INFO:teuthology.orchestra.run.smithi008.stdout: "duration": 8.0488999999999995e-05 2023-08-01T19:54:28.365 INFO:teuthology.orchestra.run.smithi008.stdout: }, 2023-08-01T19:54:28.365 INFO:teuthology.orchestra.run.smithi008.stdout: { 2023-08-01T19:54:28.365 INFO:teuthology.orchestra.run.smithi008.stdout: "event": "waiting for subops from 1", 2023-08-01T19:54:28.365 INFO:teuthology.orchestra.run.smithi008.stdout: "time": "2023-08-01T19:54:04.462560+0000", 2023-08-01T19:54:28.366 INFO:teuthology.orchestra.run.smithi008.stdout: "duration": 0.00019412300000000001 2023-08-01T19:54:28.366 INFO:teuthology.orchestra.run.smithi008.stdout: }, 2023-08-01T19:54:28.366 INFO:teuthology.orchestra.run.smithi008.stdout: { 2023-08-01T19:54:28.367 INFO:teuthology.orchestra.run.smithi008.stdout: "event": "op_commit", 2023-08-01T19:54:28.367 INFO:teuthology.orchestra.run.smithi008.stdout: "time": "2023-08-01T19:54:04.467069+0000", 2023-08-01T19:54:28.367 INFO:teuthology.orchestra.run.smithi008.stdout: "duration": 0.0045089709999999996 2023-08-01T19:54:28.367 INFO:teuthology.orchestra.run.smithi008.stdout: }, 2023-08-01T19:54:28.368 INFO:teuthology.orchestra.run.smithi008.stdout: { 2023-08-01T19:54:28.368 INFO:teuthology.orchestra.run.smithi008.stdout: "event": "sub_op_commit_rec", 2023-08-01T19:54:28.368 INFO:teuthology.orchestra.run.smithi008.stdout: "time": "2023-08-01T19:54:04.471986+0000", 2023-08-01T19:54:28.368 INFO:teuthology.orchestra.run.smithi008.stdout: "duration": 0.0049178499999999997 2023-08-01T19:54:28.369 INFO:teuthology.orchestra.run.smithi008.stdout: }, 2023-08-01T19:54:28.369 INFO:teuthology.orchestra.run.smithi008.stdout: { 2023-08-01T19:54:28.369 INFO:teuthology.orchestra.run.smithi008.stdout: "event": "commit_sent", 2023-08-01T19:54:28.369 INFO:teuthology.orchestra.run.smithi008.stdout: "time": "2023-08-01T19:54:04.472060+0000", 2023-08-01T19:54:28.370 INFO:teuthology.orchestra.run.smithi008.stdout: "duration": 7.4049999999999997e-05 2023-08-01T19:54:28.370 INFO:teuthology.orchestra.run.smithi008.stdout: }, 2023-08-01T19:54:28.370 INFO:teuthology.orchestra.run.smithi008.stdout: { 2023-08-01T19:54:28.370 INFO:teuthology.orchestra.run.smithi008.stdout: "event": "done", 2023-08-01T19:54:28.370 INFO:teuthology.orchestra.run.smithi008.stdout: "time": "2023-08-01T19:54:04.472102+0000", 2023-08-01T19:54:28.371 INFO:teuthology.orchestra.run.smithi008.stdout: "duration": 4.206e-05 2023-08-01T19:54:28.371 INFO:teuthology.orchestra.run.smithi008.stdout: } 2023-08-01T19:54:28.371 INFO:teuthology.orchestra.run.smithi008.stdout: ] 2023-08-01T19:54:28.371 INFO:teuthology.orchestra.run.smithi008.stdout: } 2023-08-01T19:54:28.371 INFO:teuthology.orchestra.run.smithi008.stdout: }, 2023-08-01T19:54:28.371 INFO:teuthology.orchestra.run.smithi008.stdout: { 2023-08-01T19:54:28.372 INFO:teuthology.orchestra.run.smithi008.stdout: "description": "osd_op(mds.0.3:24 3.7 3:e0b41d06:::609.00000000:head [omap-set-header] snapc 0=[] ondisk+write+known_if_redirected+full_force+supports_pool_eio e17)", 2023-08-01T19:54:28.372 INFO:teuthology.orchestra.run.smithi008.stdout: "initiated_at": "2023-08-01T19:54:04.459178+0000", 2023-08-01T19:54:28.372 INFO:teuthology.orchestra.run.smithi008.stdout: "age": 23.875795699000001, 2023-08-01T19:54:28.372 INFO:teuthology.orchestra.run.smithi008.stdout: "duration": 0.010109111, 2023-08-01T19:54:28.372 INFO:teuthology.orchestra.run.smithi008.stdout: "type_data": { 2023-08-01T19:54:28.372 INFO:teuthology.orchestra.run.smithi008.stdout: "flag_point": "commit sent; apply or cleanup", 2023-08-01T19:54:28.372 INFO:teuthology.orchestra.run.smithi008.stdout: "events": [ 2023-08-01T19:54:28.373 INFO:teuthology.orchestra.run.smithi008.stdout: { 2023-08-01T19:54:28.373 INFO:teuthology.orchestra.run.smithi008.stdout: "event": "initiated", 2023-08-01T19:54:28.373 INFO:teuthology.orchestra.run.smithi008.stdout: "time": "2023-08-01T19:54:04.459178+0000", 2023-08-01T19:54:28.373 INFO:teuthology.orchestra.run.smithi008.stdout: "duration": 0 2023-08-01T19:54:28.373 INFO:teuthology.orchestra.run.smithi008.stdout: }, 2023-08-01T19:54:28.373 INFO:teuthology.orchestra.run.smithi008.stdout: { 2023-08-01T19:54:28.373 INFO:teuthology.orchestra.run.smithi008.stdout: "event": "throttled", 2023-08-01T19:54:28.374 INFO:teuthology.orchestra.run.smithi008.stdout: "time": "2023-08-01T19:54:04.459178+0000", 2023-08-01T19:54:28.374 INFO:teuthology.orchestra.run.smithi008.stdout: "duration": 0 2023-08-01T19:54:28.374 INFO:teuthology.orchestra.run.smithi008.stdout: }, 2023-08-01T19:54:28.374 INFO:teuthology.orchestra.run.smithi008.stdout: { 2023-08-01T19:54:28.374 INFO:teuthology.orchestra.run.smithi008.stdout: "event": "header_read", 2023-08-01T19:54:28.374 INFO:teuthology.orchestra.run.smithi008.stdout: "time": "2023-08-01T19:54:04.459177+0000", 2023-08-01T19:54:28.374 INFO:teuthology.orchestra.run.smithi008.stdout: "duration": 4294967295.9999995 2023-08-01T19:54:28.375 INFO:teuthology.orchestra.run.smithi008.stdout: }, 2023-08-01T19:54:28.375 INFO:teuthology.orchestra.run.smithi008.stdout: { 2023-08-01T19:54:28.375 INFO:teuthology.orchestra.run.smithi008.stdout: "event": "all_read", 2023-08-01T19:54:28.375 INFO:teuthology.orchestra.run.smithi008.stdout: "time": "2023-08-01T19:54:04.459182+0000", 2023-08-01T19:54:28.375 INFO:teuthology.orchestra.run.smithi008.stdout: "duration": 5.0860000000000001e-06 2023-08-01T19:54:28.375 INFO:teuthology.orchestra.run.smithi008.stdout: }, 2023-08-01T19:54:28.375 INFO:teuthology.orchestra.run.smithi008.stdout: { 2023-08-01T19:54:28.376 INFO:teuthology.orchestra.run.smithi008.stdout: "event": "dispatched", 2023-08-01T19:54:28.376 INFO:teuthology.orchestra.run.smithi008.stdout: "time": "2023-08-01T19:54:04.459193+0000", 2023-08-01T19:54:28.376 INFO:teuthology.orchestra.run.smithi008.stdout: "duration": 1.029e-05 2023-08-01T19:54:28.376 INFO:teuthology.orchestra.run.smithi008.stdout: }, 2023-08-01T19:54:28.376 INFO:teuthology.orchestra.run.smithi008.stdout: { 2023-08-01T19:54:28.376 INFO:teuthology.orchestra.run.smithi008.stdout: "event": "queued_for_pg", 2023-08-01T19:54:28.376 INFO:teuthology.orchestra.run.smithi008.stdout: "time": "2023-08-01T19:54:04.459198+0000", 2023-08-01T19:54:28.377 INFO:teuthology.orchestra.run.smithi008.stdout: "duration": 5.2809999999999999e-06 2023-08-01T19:54:28.377 INFO:teuthology.orchestra.run.smithi008.stdout: }, 2023-08-01T19:54:28.377 INFO:teuthology.orchestra.run.smithi008.stdout: { 2023-08-01T19:54:28.377 INFO:teuthology.orchestra.run.smithi008.stdout: "event": "reached_pg", 2023-08-01T19:54:28.377 INFO:teuthology.orchestra.run.smithi008.stdout: "time": "2023-08-01T19:54:04.459882+0000", 2023-08-01T19:54:28.377 INFO:teuthology.orchestra.run.smithi008.stdout: "duration": 0.00068389299999999998 2023-08-01T19:54:28.377 INFO:teuthology.orchestra.run.smithi008.stdout: }, 2023-08-01T19:54:28.378 INFO:teuthology.orchestra.run.smithi008.stdout: { 2023-08-01T19:54:28.378 INFO:teuthology.orchestra.run.smithi008.stdout: "event": "op must wait for map", 2023-08-01T19:54:28.378 INFO:teuthology.orchestra.run.smithi008.stdout: "time": "2023-08-01T19:54:04.459886+0000", 2023-08-01T19:54:28.378 INFO:teuthology.orchestra.run.smithi008.stdout: "duration": 4.0199999999999996e-06 2023-08-01T19:54:28.379 INFO:teuthology.orchestra.run.smithi008.stdout: }, 2023-08-01T19:54:28.379 INFO:teuthology.orchestra.run.smithi008.stdout: { 2023-08-01T19:54:28.379 INFO:teuthology.orchestra.run.smithi008.stdout: "event": "reached_pg", 2023-08-01T19:54:28.380 INFO:teuthology.orchestra.run.smithi008.stdout: "time": "2023-08-01T19:54:04.461115+0000", 2023-08-01T19:54:28.380 INFO:teuthology.orchestra.run.smithi008.stdout: "duration": 0.0012296360000000001 2023-08-01T19:54:28.380 INFO:teuthology.orchestra.run.smithi008.stdout: }, 2023-08-01T19:54:28.380 INFO:teuthology.orchestra.run.smithi008.stdout: { 2023-08-01T19:54:28.381 INFO:teuthology.orchestra.run.smithi008.stdout: "event": "started", 2023-08-01T19:54:28.381 INFO:teuthology.orchestra.run.smithi008.stdout: "time": "2023-08-01T19:54:04.461774+0000", 2023-08-01T19:54:28.381 INFO:teuthology.orchestra.run.smithi008.stdout: "duration": 0.00065882899999999999 2023-08-01T19:54:28.382 INFO:teuthology.orchestra.run.smithi008.stdout: }, 2023-08-01T19:54:28.382 INFO:teuthology.orchestra.run.smithi008.stdout: { 2023-08-01T19:54:28.382 INFO:teuthology.orchestra.run.smithi008.stdout: "event": "waiting for subops from 2", 2023-08-01T19:54:28.382 INFO:teuthology.orchestra.run.smithi008.stdout: "time": "2023-08-01T19:54:04.461960+0000", 2023-08-01T19:54:28.383 INFO:teuthology.orchestra.run.smithi008.stdout: "duration": 0.00018570199999999999 2023-08-01T19:54:28.383 INFO:teuthology.orchestra.run.smithi008.stdout: }, 2023-08-01T19:54:28.383 INFO:teuthology.orchestra.run.smithi008.stdout: { 2023-08-01T19:54:28.383 INFO:teuthology.orchestra.run.smithi008.stdout: "event": "op_commit", 2023-08-01T19:54:28.384 INFO:teuthology.orchestra.run.smithi008.stdout: "time": "2023-08-01T19:54:04.464371+0000", 2023-08-01T19:54:28.384 INFO:teuthology.orchestra.run.smithi008.stdout: "duration": 0.0024114840000000002 2023-08-01T19:54:28.384 INFO:teuthology.orchestra.run.smithi008.stdout: }, 2023-08-01T19:54:28.385 INFO:teuthology.orchestra.run.smithi008.stdout: { 2023-08-01T19:54:28.385 INFO:teuthology.orchestra.run.smithi008.stdout: "event": "sub_op_commit_rec", 2023-08-01T19:54:28.385 INFO:teuthology.orchestra.run.smithi008.stdout: "time": "2023-08-01T19:54:04.469178+0000", 2023-08-01T19:54:28.385 INFO:teuthology.orchestra.run.smithi008.stdout: "duration": 0.0048067580000000004 2023-08-01T19:54:28.386 INFO:teuthology.orchestra.run.smithi008.stdout: }, 2023-08-01T19:54:28.386 INFO:teuthology.orchestra.run.smithi008.stdout: { 2023-08-01T19:54:28.386 INFO:teuthology.orchestra.run.smithi008.stdout: "event": "commit_sent", 2023-08-01T19:54:28.386 INFO:teuthology.orchestra.run.smithi008.stdout: "time": "2023-08-01T19:54:04.469239+0000", 2023-08-01T19:54:28.387 INFO:teuthology.orchestra.run.smithi008.stdout: "duration": 6.1007000000000001e-05 2023-08-01T19:54:28.387 INFO:teuthology.orchestra.run.smithi008.stdout: }, 2023-08-01T19:54:28.387 INFO:teuthology.orchestra.run.smithi008.stdout: { 2023-08-01T19:54:28.387 INFO:teuthology.orchestra.run.smithi008.stdout: "event": "done", 2023-08-01T19:54:28.388 INFO:teuthology.orchestra.run.smithi008.stdout: "time": "2023-08-01T19:54:04.469287+0000", 2023-08-01T19:54:28.388 INFO:teuthology.orchestra.run.smithi008.stdout: "duration": 4.7821999999999997e-05 2023-08-01T19:54:28.388 INFO:teuthology.orchestra.run.smithi008.stdout: } 2023-08-01T19:54:28.389 INFO:teuthology.orchestra.run.smithi008.stdout: ] 2023-08-01T19:54:28.389 INFO:teuthology.orchestra.run.smithi008.stdout: } 2023-08-01T19:54:28.389 INFO:teuthology.orchestra.run.smithi008.stdout: }, 2023-08-01T19:54:28.389 INFO:teuthology.orchestra.run.smithi008.stdout: { 2023-08-01T19:54:28.390 INFO:teuthology.orchestra.run.smithi008.stdout: "description": "osd_op(mds.0.3:25 3.7 3:e0b41d06:::609.00000000:head [create,setxattr parent (62) in=6b,setxattr layout (30) in=6b] snapc 0=[] ondisk+write+known_if_redirected+full_force+supports_pool_eio e17)", 2023-08-01T19:54:28.390 INFO:teuthology.orchestra.run.smithi008.stdout: "initiated_at": "2023-08-01T19:54:04.459206+0000", 2023-08-01T19:54:28.390 INFO:teuthology.orchestra.run.smithi008.stdout: "age": 23.875767333999999, 2023-08-01T19:54:28.390 INFO:teuthology.orchestra.run.smithi008.stdout: "duration": 0.012197100000000001, 2023-08-01T19:54:28.391 INFO:teuthology.orchestra.run.smithi008.stdout: "type_data": { 2023-08-01T19:54:28.391 INFO:teuthology.orchestra.run.smithi008.stdout: "flag_point": "commit sent; apply or cleanup", 2023-08-01T19:54:28.391 INFO:teuthology.orchestra.run.smithi008.stdout: "events": [ 2023-08-01T19:54:28.391 INFO:teuthology.orchestra.run.smithi008.stdout: { 2023-08-01T19:54:28.392 INFO:teuthology.orchestra.run.smithi008.stdout: "event": "initiated", 2023-08-01T19:54:28.392 INFO:teuthology.orchestra.run.smithi008.stdout: "time": "2023-08-01T19:54:04.459206+0000", 2023-08-01T19:54:28.392 INFO:teuthology.orchestra.run.smithi008.stdout: "duration": 0 2023-08-01T19:54:28.392 INFO:teuthology.orchestra.run.smithi008.stdout: }, 2023-08-01T19:54:28.393 INFO:teuthology.orchestra.run.smithi008.stdout: { 2023-08-01T19:54:28.393 INFO:teuthology.orchestra.run.smithi008.stdout: "event": "throttled", 2023-08-01T19:54:28.393 INFO:teuthology.orchestra.run.smithi008.stdout: "time": "2023-08-01T19:54:04.459206+0000", 2023-08-01T19:54:28.393 INFO:teuthology.orchestra.run.smithi008.stdout: "duration": 0 2023-08-01T19:54:28.394 INFO:teuthology.orchestra.run.smithi008.stdout: }, 2023-08-01T19:54:28.394 INFO:teuthology.orchestra.run.smithi008.stdout: { 2023-08-01T19:54:28.394 INFO:teuthology.orchestra.run.smithi008.stdout: "event": "header_read", 2023-08-01T19:54:28.395 INFO:teuthology.orchestra.run.smithi008.stdout: "time": "2023-08-01T19:54:04.459206+0000", 2023-08-01T19:54:28.395 INFO:teuthology.orchestra.run.smithi008.stdout: "duration": 4294967295.9999995 2023-08-01T19:54:28.395 INFO:teuthology.orchestra.run.smithi008.stdout: }, 2023-08-01T19:54:28.395 INFO:teuthology.orchestra.run.smithi008.stdout: { 2023-08-01T19:54:28.396 INFO:teuthology.orchestra.run.smithi008.stdout: "event": "all_read", 2023-08-01T19:54:28.396 INFO:teuthology.orchestra.run.smithi008.stdout: "time": "2023-08-01T19:54:04.459209+0000", 2023-08-01T19:54:28.396 INFO:teuthology.orchestra.run.smithi008.stdout: "duration": 3.7500000000000001e-06 2023-08-01T19:54:28.396 INFO:teuthology.orchestra.run.smithi008.stdout: }, 2023-08-01T19:54:28.397 INFO:teuthology.orchestra.run.smithi008.stdout: { 2023-08-01T19:54:28.397 INFO:teuthology.orchestra.run.smithi008.stdout: "event": "dispatched", 2023-08-01T19:54:28.397 INFO:teuthology.orchestra.run.smithi008.stdout: "time": "2023-08-01T19:54:04.459216+0000", 2023-08-01T19:54:28.398 INFO:teuthology.orchestra.run.smithi008.stdout: "duration": 6.7560000000000002e-06 2023-08-01T19:54:28.398 INFO:teuthology.orchestra.run.smithi008.stdout: }, 2023-08-01T19:54:28.398 INFO:teuthology.orchestra.run.smithi008.stdout: { 2023-08-01T19:54:28.398 INFO:teuthology.orchestra.run.smithi008.stdout: "event": "queued_for_pg", 2023-08-01T19:54:28.399 INFO:teuthology.orchestra.run.smithi008.stdout: "time": "2023-08-01T19:54:04.459221+0000", 2023-08-01T19:54:28.399 INFO:teuthology.orchestra.run.smithi008.stdout: "duration": 5.1760000000000001e-06 2023-08-01T19:54:28.399 INFO:teuthology.orchestra.run.smithi008.stdout: }, 2023-08-01T19:54:28.399 INFO:teuthology.orchestra.run.smithi008.stdout: { 2023-08-01T19:54:28.400 INFO:teuthology.orchestra.run.smithi008.stdout: "event": "reached_pg", 2023-08-01T19:54:28.400 INFO:teuthology.orchestra.run.smithi008.stdout: "time": "2023-08-01T19:54:04.459918+0000", 2023-08-01T19:54:28.400 INFO:teuthology.orchestra.run.smithi008.stdout: "duration": 0.000696716 2023-08-01T19:54:28.401 INFO:teuthology.orchestra.run.smithi008.stdout: }, 2023-08-01T19:54:28.401 INFO:teuthology.orchestra.run.smithi008.stdout: { 2023-08-01T19:54:28.401 INFO:teuthology.orchestra.run.smithi008.stdout: "event": "waiting_for_map not empty", 2023-08-01T19:54:28.401 INFO:teuthology.orchestra.run.smithi008.stdout: "time": "2023-08-01T19:54:04.459923+0000", 2023-08-01T19:54:28.402 INFO:teuthology.orchestra.run.smithi008.stdout: "duration": 4.4279999999999998e-06 2023-08-01T19:54:28.402 INFO:teuthology.orchestra.run.smithi008.stdout: }, 2023-08-01T19:54:28.402 INFO:teuthology.orchestra.run.smithi008.stdout: { 2023-08-01T19:54:28.402 INFO:teuthology.orchestra.run.smithi008.stdout: "event": "reached_pg", 2023-08-01T19:54:28.402 INFO:teuthology.orchestra.run.smithi008.stdout: "time": "2023-08-01T19:54:04.462299+0000", 2023-08-01T19:54:28.402 INFO:teuthology.orchestra.run.smithi008.stdout: "duration": 0.0023762929999999998 2023-08-01T19:54:28.403 INFO:teuthology.orchestra.run.smithi008.stdout: }, 2023-08-01T19:54:28.403 INFO:teuthology.orchestra.run.smithi008.stdout: { 2023-08-01T19:54:28.403 INFO:teuthology.orchestra.run.smithi008.stdout: "event": "started", 2023-08-01T19:54:28.403 INFO:teuthology.orchestra.run.smithi008.stdout: "time": "2023-08-01T19:54:04.462362+0000", 2023-08-01T19:54:28.403 INFO:teuthology.orchestra.run.smithi008.stdout: "duration": 6.2707999999999997e-05 2023-08-01T19:54:28.403 INFO:teuthology.orchestra.run.smithi008.stdout: }, 2023-08-01T19:54:28.404 INFO:teuthology.orchestra.run.smithi008.stdout: { 2023-08-01T19:54:28.404 INFO:teuthology.orchestra.run.smithi008.stdout: "event": "waiting for subops from 2", 2023-08-01T19:54:28.404 INFO:teuthology.orchestra.run.smithi008.stdout: "time": "2023-08-01T19:54:04.462468+0000", 2023-08-01T19:54:28.405 INFO:teuthology.orchestra.run.smithi008.stdout: "duration": 0.000106592 2023-08-01T19:54:28.405 INFO:teuthology.orchestra.run.smithi008.stdout: }, 2023-08-01T19:54:28.405 INFO:teuthology.orchestra.run.smithi008.stdout: { 2023-08-01T19:54:28.405 INFO:teuthology.orchestra.run.smithi008.stdout: "event": "op_commit", 2023-08-01T19:54:28.405 INFO:teuthology.orchestra.run.smithi008.stdout: "time": "2023-08-01T19:54:04.466803+0000", 2023-08-01T19:54:28.405 INFO:teuthology.orchestra.run.smithi008.stdout: "duration": 0.0043350410000000004 2023-08-01T19:54:28.406 INFO:teuthology.orchestra.run.smithi008.stdout: }, 2023-08-01T19:54:28.406 INFO:teuthology.orchestra.run.smithi008.stdout: { 2023-08-01T19:54:28.406 INFO:teuthology.orchestra.run.smithi008.stdout: "event": "sub_op_commit_rec", 2023-08-01T19:54:28.406 INFO:teuthology.orchestra.run.smithi008.stdout: "time": "2023-08-01T19:54:04.471130+0000", 2023-08-01T19:54:28.406 INFO:teuthology.orchestra.run.smithi008.stdout: "duration": 0.0043265329999999996 2023-08-01T19:54:28.406 INFO:teuthology.orchestra.run.smithi008.stdout: }, 2023-08-01T19:54:28.406 INFO:teuthology.orchestra.run.smithi008.stdout: { 2023-08-01T19:54:28.407 INFO:teuthology.orchestra.run.smithi008.stdout: "event": "commit_sent", 2023-08-01T19:54:28.407 INFO:teuthology.orchestra.run.smithi008.stdout: "time": "2023-08-01T19:54:04.471355+0000", 2023-08-01T19:54:28.407 INFO:teuthology.orchestra.run.smithi008.stdout: "duration": 0.00022495999999999999 2023-08-01T19:54:28.407 INFO:teuthology.orchestra.run.smithi008.stdout: }, 2023-08-01T19:54:28.407 INFO:teuthology.orchestra.run.smithi008.stdout: { 2023-08-01T19:54:28.407 INFO:teuthology.orchestra.run.smithi008.stdout: "event": "done", 2023-08-01T19:54:28.407 INFO:teuthology.orchestra.run.smithi008.stdout: "time": "2023-08-01T19:54:04.471403+0000", 2023-08-01T19:54:28.408 INFO:teuthology.orchestra.run.smithi008.stdout: "duration": 4.8662999999999998e-05 2023-08-01T19:54:28.408 INFO:teuthology.orchestra.run.smithi008.stdout: } 2023-08-01T19:54:28.408 INFO:teuthology.orchestra.run.smithi008.stdout: ] 2023-08-01T19:54:28.408 INFO:teuthology.orchestra.run.smithi008.stdout: } 2023-08-01T19:54:28.408 INFO:teuthology.orchestra.run.smithi008.stdout: }, 2023-08-01T19:54:28.408 INFO:teuthology.orchestra.run.smithi008.stdout: { 2023-08-01T19:54:28.409 INFO:teuthology.orchestra.run.smithi008.stdout: "description": "osd_op(mds.0.3:26 3.1f 3:fe07bba1:::100.00000000.inode:head [writefull 0~554] snapc 0=[] ondisk+write+known_if_redirected+full_force+supports_pool_eio e17)", 2023-08-01T19:54:28.409 INFO:teuthology.orchestra.run.smithi008.stdout: "initiated_at": "2023-08-01T19:54:04.459230+0000", 2023-08-01T19:54:28.409 INFO:teuthology.orchestra.run.smithi008.stdout: "age": 23.875743818, 2023-08-01T19:54:28.409 INFO:teuthology.orchestra.run.smithi008.stdout: "duration": 0.013017103, 2023-08-01T19:54:28.409 INFO:teuthology.orchestra.run.smithi008.stdout: "type_data": { 2023-08-01T19:54:28.410 INFO:teuthology.orchestra.run.smithi008.stdout: "flag_point": "commit sent; apply or cleanup", 2023-08-01T19:54:28.410 INFO:teuthology.orchestra.run.smithi008.stdout: "events": [ 2023-08-01T19:54:28.410 INFO:teuthology.orchestra.run.smithi008.stdout: { 2023-08-01T19:54:28.410 INFO:teuthology.orchestra.run.smithi008.stdout: "event": "initiated", 2023-08-01T19:54:28.410 INFO:teuthology.orchestra.run.smithi008.stdout: "time": "2023-08-01T19:54:04.459230+0000", 2023-08-01T19:54:28.410 INFO:teuthology.orchestra.run.smithi008.stdout: "duration": 0 2023-08-01T19:54:28.410 INFO:teuthology.orchestra.run.smithi008.stdout: }, 2023-08-01T19:54:28.411 INFO:teuthology.orchestra.run.smithi008.stdout: { 2023-08-01T19:54:28.411 INFO:teuthology.orchestra.run.smithi008.stdout: "event": "throttled", 2023-08-01T19:54:28.411 INFO:teuthology.orchestra.run.smithi008.stdout: "time": "2023-08-01T19:54:04.459230+0000", 2023-08-01T19:54:28.411 INFO:teuthology.orchestra.run.smithi008.stdout: "duration": 0 2023-08-01T19:54:28.411 INFO:teuthology.orchestra.run.smithi008.stdout: }, 2023-08-01T19:54:28.411 INFO:teuthology.orchestra.run.smithi008.stdout: { 2023-08-01T19:54:28.411 INFO:teuthology.orchestra.run.smithi008.stdout: "event": "header_read", 2023-08-01T19:54:28.411 INFO:teuthology.orchestra.run.smithi008.stdout: "time": "2023-08-01T19:54:04.459229+0000", 2023-08-01T19:54:28.412 INFO:teuthology.orchestra.run.smithi008.stdout: "duration": 4294967295.9999995 2023-08-01T19:54:28.412 INFO:teuthology.orchestra.run.smithi008.stdout: }, 2023-08-01T19:54:28.412 INFO:teuthology.orchestra.run.smithi008.stdout: { 2023-08-01T19:54:28.412 INFO:teuthology.orchestra.run.smithi008.stdout: "event": "all_read", 2023-08-01T19:54:28.412 INFO:teuthology.orchestra.run.smithi008.stdout: "time": "2023-08-01T19:54:04.459233+0000", 2023-08-01T19:54:28.412 INFO:teuthology.orchestra.run.smithi008.stdout: "duration": 3.7400000000000002e-06 2023-08-01T19:54:28.412 INFO:teuthology.orchestra.run.smithi008.stdout: }, 2023-08-01T19:54:28.413 INFO:teuthology.orchestra.run.smithi008.stdout: { 2023-08-01T19:54:28.413 INFO:teuthology.orchestra.run.smithi008.stdout: "event": "dispatched", 2023-08-01T19:54:28.413 INFO:teuthology.orchestra.run.smithi008.stdout: "time": "2023-08-01T19:54:04.459240+0000", 2023-08-01T19:54:28.413 INFO:teuthology.orchestra.run.smithi008.stdout: "duration": 6.9059999999999996e-06 2023-08-01T19:54:28.413 INFO:teuthology.orchestra.run.smithi008.stdout: }, 2023-08-01T19:54:28.413 INFO:teuthology.orchestra.run.smithi008.stdout: { 2023-08-01T19:54:28.413 INFO:teuthology.orchestra.run.smithi008.stdout: "event": "queued_for_pg", 2023-08-01T19:54:28.414 INFO:teuthology.orchestra.run.smithi008.stdout: "time": "2023-08-01T19:54:04.459245+0000", 2023-08-01T19:54:28.414 INFO:teuthology.orchestra.run.smithi008.stdout: "duration": 4.8890000000000001e-06 2023-08-01T19:54:28.414 INFO:teuthology.orchestra.run.smithi008.stdout: }, 2023-08-01T19:54:28.414 INFO:teuthology.orchestra.run.smithi008.stdout: { 2023-08-01T19:54:28.415 INFO:teuthology.orchestra.run.smithi008.stdout: "event": "reached_pg", 2023-08-01T19:54:28.415 INFO:teuthology.orchestra.run.smithi008.stdout: "time": "2023-08-01T19:54:04.459954+0000", 2023-08-01T19:54:28.415 INFO:teuthology.orchestra.run.smithi008.stdout: "duration": 0.00070883100000000004 2023-08-01T19:54:28.415 INFO:teuthology.orchestra.run.smithi008.stdout: }, 2023-08-01T19:54:28.416 INFO:teuthology.orchestra.run.smithi008.stdout: { 2023-08-01T19:54:28.416 INFO:teuthology.orchestra.run.smithi008.stdout: "event": "waiting_for_map not empty", 2023-08-01T19:54:28.416 INFO:teuthology.orchestra.run.smithi008.stdout: "time": "2023-08-01T19:54:04.459959+0000", 2023-08-01T19:54:28.416 INFO:teuthology.orchestra.run.smithi008.stdout: "duration": 5.1340000000000003e-06 2023-08-01T19:54:28.416 INFO:teuthology.orchestra.run.smithi008.stdout: }, 2023-08-01T19:54:28.416 INFO:teuthology.orchestra.run.smithi008.stdout: { 2023-08-01T19:54:28.416 INFO:teuthology.orchestra.run.smithi008.stdout: "event": "reached_pg", 2023-08-01T19:54:28.417 INFO:teuthology.orchestra.run.smithi008.stdout: "time": "2023-08-01T19:54:04.462796+0000", 2023-08-01T19:54:28.417 INFO:teuthology.orchestra.run.smithi008.stdout: "duration": 0.0028374070000000001 2023-08-01T19:54:28.417 INFO:teuthology.orchestra.run.smithi008.stdout: }, 2023-08-01T19:54:28.417 INFO:teuthology.orchestra.run.smithi008.stdout: { 2023-08-01T19:54:28.417 INFO:teuthology.orchestra.run.smithi008.stdout: "event": "started", 2023-08-01T19:54:28.417 INFO:teuthology.orchestra.run.smithi008.stdout: "time": "2023-08-01T19:54:04.463137+0000", 2023-08-01T19:54:28.417 INFO:teuthology.orchestra.run.smithi008.stdout: "duration": 0.00034093699999999998 2023-08-01T19:54:28.418 INFO:teuthology.orchestra.run.smithi008.stdout: }, 2023-08-01T19:54:28.418 INFO:teuthology.orchestra.run.smithi008.stdout: { 2023-08-01T19:54:28.418 INFO:teuthology.orchestra.run.smithi008.stdout: "event": "waiting for subops from 1", 2023-08-01T19:54:28.418 INFO:teuthology.orchestra.run.smithi008.stdout: "time": "2023-08-01T19:54:04.463290+0000", 2023-08-01T19:54:28.418 INFO:teuthology.orchestra.run.smithi008.stdout: "duration": 0.00015267899999999999 2023-08-01T19:54:28.418 INFO:teuthology.orchestra.run.smithi008.stdout: }, 2023-08-01T19:54:28.418 INFO:teuthology.orchestra.run.smithi008.stdout: { 2023-08-01T19:54:28.419 INFO:teuthology.orchestra.run.smithi008.stdout: "event": "op_commit", 2023-08-01T19:54:28.419 INFO:teuthology.orchestra.run.smithi008.stdout: "time": "2023-08-01T19:54:04.470442+0000", 2023-08-01T19:54:28.419 INFO:teuthology.orchestra.run.smithi008.stdout: "duration": 0.0071526230000000003 2023-08-01T19:54:28.419 INFO:teuthology.orchestra.run.smithi008.stdout: }, 2023-08-01T19:54:28.419 INFO:teuthology.orchestra.run.smithi008.stdout: { 2023-08-01T19:54:28.419 INFO:teuthology.orchestra.run.smithi008.stdout: "event": "sub_op_commit_rec", 2023-08-01T19:54:28.419 INFO:teuthology.orchestra.run.smithi008.stdout: "time": "2023-08-01T19:54:04.472154+0000", 2023-08-01T19:54:28.420 INFO:teuthology.orchestra.run.smithi008.stdout: "duration": 0.0017111450000000001 2023-08-01T19:54:28.420 INFO:teuthology.orchestra.run.smithi008.stdout: }, 2023-08-01T19:54:28.420 INFO:teuthology.orchestra.run.smithi008.stdout: { 2023-08-01T19:54:28.420 INFO:teuthology.orchestra.run.smithi008.stdout: "event": "commit_sent", 2023-08-01T19:54:28.421 INFO:teuthology.orchestra.run.smithi008.stdout: "time": "2023-08-01T19:54:04.472207+0000", 2023-08-01T19:54:28.421 INFO:teuthology.orchestra.run.smithi008.stdout: "duration": 5.3059999999999997e-05 2023-08-01T19:54:28.421 INFO:teuthology.orchestra.run.smithi008.stdout: }, 2023-08-01T19:54:28.421 INFO:teuthology.orchestra.run.smithi008.stdout: { 2023-08-01T19:54:28.421 INFO:teuthology.orchestra.run.smithi008.stdout: "event": "done", 2023-08-01T19:54:28.421 INFO:teuthology.orchestra.run.smithi008.stdout: "time": "2023-08-01T19:54:04.472247+0000", 2023-08-01T19:54:28.421 INFO:teuthology.orchestra.run.smithi008.stdout: "duration": 4.0213999999999998e-05 2023-08-01T19:54:28.422 INFO:teuthology.orchestra.run.smithi008.stdout: } 2023-08-01T19:54:28.422 INFO:teuthology.orchestra.run.smithi008.stdout: ] 2023-08-01T19:54:28.422 INFO:teuthology.orchestra.run.smithi008.stdout: } 2023-08-01T19:54:28.422 INFO:teuthology.orchestra.run.smithi008.stdout: }, 2023-08-01T19:54:28.422 INFO:teuthology.orchestra.run.smithi008.stdout: { 2023-08-01T19:54:28.422 INFO:teuthology.orchestra.run.smithi008.stdout: "description": "osd_op(mds.0.3:28 3.b 3:d0630e4c:::mds0_sessionmap:head [omap-set-header] snapc 0=[] ondisk+write+known_if_redirected+full_force+supports_pool_eio e17)", 2023-08-01T19:54:28.422 INFO:teuthology.orchestra.run.smithi008.stdout: "initiated_at": "2023-08-01T19:54:04.459251+0000", 2023-08-01T19:54:28.423 INFO:teuthology.orchestra.run.smithi008.stdout: "age": 23.875722615000001, 2023-08-01T19:54:28.423 INFO:teuthology.orchestra.run.smithi008.stdout: "duration": 0.01361938, 2023-08-01T19:54:28.423 INFO:teuthology.orchestra.run.smithi008.stdout: "type_data": { 2023-08-01T19:54:28.423 INFO:teuthology.orchestra.run.smithi008.stdout: "flag_point": "commit sent; apply or cleanup", 2023-08-01T19:54:28.423 INFO:teuthology.orchestra.run.smithi008.stdout: "events": [ 2023-08-01T19:54:28.423 INFO:teuthology.orchestra.run.smithi008.stdout: { 2023-08-01T19:54:28.423 INFO:teuthology.orchestra.run.smithi008.stdout: "event": "initiated", 2023-08-01T19:54:28.424 INFO:teuthology.orchestra.run.smithi008.stdout: "time": "2023-08-01T19:54:04.459251+0000", 2023-08-01T19:54:28.424 INFO:teuthology.orchestra.run.smithi008.stdout: "duration": 0 2023-08-01T19:54:28.424 INFO:teuthology.orchestra.run.smithi008.stdout: }, 2023-08-01T19:54:28.424 INFO:teuthology.orchestra.run.smithi008.stdout: { 2023-08-01T19:54:28.424 INFO:teuthology.orchestra.run.smithi008.stdout: "event": "throttled", 2023-08-01T19:54:28.424 INFO:teuthology.orchestra.run.smithi008.stdout: "time": "2023-08-01T19:54:04.459251+0000", 2023-08-01T19:54:28.424 INFO:teuthology.orchestra.run.smithi008.stdout: "duration": 0 2023-08-01T19:54:28.425 INFO:teuthology.orchestra.run.smithi008.stdout: }, 2023-08-01T19:54:28.425 INFO:teuthology.orchestra.run.smithi008.stdout: { 2023-08-01T19:54:28.425 INFO:teuthology.orchestra.run.smithi008.stdout: "event": "header_read", 2023-08-01T19:54:28.425 INFO:teuthology.orchestra.run.smithi008.stdout: "time": "2023-08-01T19:54:04.459251+0000", 2023-08-01T19:54:28.425 INFO:teuthology.orchestra.run.smithi008.stdout: "duration": 4294967295.9999995 2023-08-01T19:54:28.425 INFO:teuthology.orchestra.run.smithi008.stdout: }, 2023-08-01T19:54:28.425 INFO:teuthology.orchestra.run.smithi008.stdout: { 2023-08-01T19:54:28.426 INFO:teuthology.orchestra.run.smithi008.stdout: "event": "all_read", 2023-08-01T19:54:28.426 INFO:teuthology.orchestra.run.smithi008.stdout: "time": "2023-08-01T19:54:04.459258+0000", 2023-08-01T19:54:28.426 INFO:teuthology.orchestra.run.smithi008.stdout: "duration": 7.0029999999999997e-06 2023-08-01T19:54:28.426 INFO:teuthology.orchestra.run.smithi008.stdout: }, 2023-08-01T19:54:28.426 INFO:teuthology.orchestra.run.smithi008.stdout: { 2023-08-01T19:54:28.426 INFO:teuthology.orchestra.run.smithi008.stdout: "event": "dispatched", 2023-08-01T19:54:28.426 INFO:teuthology.orchestra.run.smithi008.stdout: "time": "2023-08-01T19:54:04.459267+0000", 2023-08-01T19:54:28.427 INFO:teuthology.orchestra.run.smithi008.stdout: "duration": 8.8810000000000002e-06 2023-08-01T19:54:28.427 INFO:teuthology.orchestra.run.smithi008.stdout: }, 2023-08-01T19:54:28.427 INFO:teuthology.orchestra.run.smithi008.stdout: { 2023-08-01T19:54:28.427 INFO:teuthology.orchestra.run.smithi008.stdout: "event": "queued_for_pg", 2023-08-01T19:54:28.427 INFO:teuthology.orchestra.run.smithi008.stdout: "time": "2023-08-01T19:54:04.459273+0000", 2023-08-01T19:54:28.427 INFO:teuthology.orchestra.run.smithi008.stdout: "duration": 5.9279999999999998e-06 2023-08-01T19:54:28.428 INFO:teuthology.orchestra.run.smithi008.stdout: }, 2023-08-01T19:54:28.428 INFO:teuthology.orchestra.run.smithi008.stdout: { 2023-08-01T19:54:28.428 INFO:teuthology.orchestra.run.smithi008.stdout: "event": "reached_pg", 2023-08-01T19:54:28.429 INFO:teuthology.orchestra.run.smithi008.stdout: "time": "2023-08-01T19:54:04.460798+0000", 2023-08-01T19:54:28.429 INFO:teuthology.orchestra.run.smithi008.stdout: "duration": 0.001525039 2023-08-01T19:54:28.429 INFO:teuthology.orchestra.run.smithi008.stdout: }, 2023-08-01T19:54:28.429 INFO:teuthology.orchestra.run.smithi008.stdout: { 2023-08-01T19:54:28.429 INFO:teuthology.orchestra.run.smithi008.stdout: "event": "started", 2023-08-01T19:54:28.430 INFO:teuthology.orchestra.run.smithi008.stdout: "time": "2023-08-01T19:54:04.460951+0000", 2023-08-01T19:54:28.430 INFO:teuthology.orchestra.run.smithi008.stdout: "duration": 0.000153024 2023-08-01T19:54:28.430 INFO:teuthology.orchestra.run.smithi008.stdout: }, 2023-08-01T19:54:28.430 INFO:teuthology.orchestra.run.smithi008.stdout: { 2023-08-01T19:54:28.430 INFO:teuthology.orchestra.run.smithi008.stdout: "event": "waiting for subops from 1", 2023-08-01T19:54:28.430 INFO:teuthology.orchestra.run.smithi008.stdout: "time": "2023-08-01T19:54:04.461116+0000", 2023-08-01T19:54:28.430 INFO:teuthology.orchestra.run.smithi008.stdout: "duration": 0.00016551000000000001 2023-08-01T19:54:28.431 INFO:teuthology.orchestra.run.smithi008.stdout: }, 2023-08-01T19:54:28.431 INFO:teuthology.orchestra.run.smithi008.stdout: { 2023-08-01T19:54:28.431 INFO:teuthology.orchestra.run.smithi008.stdout: "event": "op_commit", 2023-08-01T19:54:28.431 INFO:teuthology.orchestra.run.smithi008.stdout: "time": "2023-08-01T19:54:04.463448+0000", 2023-08-01T19:54:28.431 INFO:teuthology.orchestra.run.smithi008.stdout: "duration": 0.0023321689999999998 2023-08-01T19:54:28.431 INFO:teuthology.orchestra.run.smithi008.stdout: }, 2023-08-01T19:54:28.431 INFO:teuthology.orchestra.run.smithi008.stdout: { 2023-08-01T19:54:28.431 INFO:teuthology.orchestra.run.smithi008.stdout: "event": "sub_op_commit_rec", 2023-08-01T19:54:28.432 INFO:teuthology.orchestra.run.smithi008.stdout: "time": "2023-08-01T19:54:04.472778+0000", 2023-08-01T19:54:28.432 INFO:teuthology.orchestra.run.smithi008.stdout: "duration": 0.0093293779999999993 2023-08-01T19:54:28.432 INFO:teuthology.orchestra.run.smithi008.stdout: }, 2023-08-01T19:54:28.432 INFO:teuthology.orchestra.run.smithi008.stdout: { 2023-08-01T19:54:28.432 INFO:teuthology.orchestra.run.smithi008.stdout: "event": "commit_sent", 2023-08-01T19:54:28.432 INFO:teuthology.orchestra.run.smithi008.stdout: "time": "2023-08-01T19:54:04.472821+0000", 2023-08-01T19:54:28.432 INFO:teuthology.orchestra.run.smithi008.stdout: "duration": 4.3253000000000001e-05 2023-08-01T19:54:28.433 INFO:teuthology.orchestra.run.smithi008.stdout: }, 2023-08-01T19:54:28.433 INFO:teuthology.orchestra.run.smithi008.stdout: { 2023-08-01T19:54:28.433 INFO:teuthology.orchestra.run.smithi008.stdout: "event": "done", 2023-08-01T19:54:28.433 INFO:teuthology.orchestra.run.smithi008.stdout: "time": "2023-08-01T19:54:04.472870+0000", 2023-08-01T19:54:28.433 INFO:teuthology.orchestra.run.smithi008.stdout: "duration": 4.9478999999999998e-05 2023-08-01T19:54:28.433 INFO:teuthology.orchestra.run.smithi008.stdout: } 2023-08-01T19:54:28.433 INFO:teuthology.orchestra.run.smithi008.stdout: ] 2023-08-01T19:54:28.434 INFO:teuthology.orchestra.run.smithi008.stdout: } 2023-08-01T19:54:28.434 INFO:teuthology.orchestra.run.smithi008.stdout: }, 2023-08-01T19:54:28.434 INFO:teuthology.orchestra.run.smithi008.stdout: { 2023-08-01T19:54:28.434 INFO:teuthology.orchestra.run.smithi008.stdout: "description": "osd_op(mds.0.3:34 3.b 3:d5c7a900:::200.00000003:head [delete] snapc 0=[] ondisk+write+known_if_redirected+full_force+supports_pool_eio e17)", 2023-08-01T19:54:28.435 INFO:teuthology.orchestra.run.smithi008.stdout: "initiated_at": "2023-08-01T19:54:04.459662+0000", 2023-08-01T19:54:28.435 INFO:teuthology.orchestra.run.smithi008.stdout: "age": 23.875311911000001, 2023-08-01T19:54:28.435 INFO:teuthology.orchestra.run.smithi008.stdout: "duration": 0.013345101999999999, 2023-08-01T19:54:28.435 INFO:teuthology.orchestra.run.smithi008.stdout: "type_data": { 2023-08-01T19:54:28.435 INFO:teuthology.orchestra.run.smithi008.stdout: "flag_point": "started", 2023-08-01T19:54:28.435 INFO:teuthology.orchestra.run.smithi008.stdout: "events": [ 2023-08-01T19:54:28.435 INFO:teuthology.orchestra.run.smithi008.stdout: { 2023-08-01T19:54:28.436 INFO:teuthology.orchestra.run.smithi008.stdout: "event": "initiated", 2023-08-01T19:54:28.436 INFO:teuthology.orchestra.run.smithi008.stdout: "time": "2023-08-01T19:54:04.459662+0000", 2023-08-01T19:54:28.436 INFO:teuthology.orchestra.run.smithi008.stdout: "duration": 0 2023-08-01T19:54:28.436 INFO:teuthology.orchestra.run.smithi008.stdout: }, 2023-08-01T19:54:28.436 INFO:teuthology.orchestra.run.smithi008.stdout: { 2023-08-01T19:54:28.436 INFO:teuthology.orchestra.run.smithi008.stdout: "event": "throttled", 2023-08-01T19:54:28.436 INFO:teuthology.orchestra.run.smithi008.stdout: "time": "2023-08-01T19:54:04.459662+0000", 2023-08-01T19:54:28.437 INFO:teuthology.orchestra.run.smithi008.stdout: "duration": 0 2023-08-01T19:54:28.437 INFO:teuthology.orchestra.run.smithi008.stdout: }, 2023-08-01T19:54:28.437 INFO:teuthology.orchestra.run.smithi008.stdout: { 2023-08-01T19:54:28.437 INFO:teuthology.orchestra.run.smithi008.stdout: "event": "header_read", 2023-08-01T19:54:28.437 INFO:teuthology.orchestra.run.smithi008.stdout: "time": "2023-08-01T19:54:04.459661+0000", 2023-08-01T19:54:28.437 INFO:teuthology.orchestra.run.smithi008.stdout: "duration": 4294967295.999999 2023-08-01T19:54:28.437 INFO:teuthology.orchestra.run.smithi008.stdout: }, 2023-08-01T19:54:28.438 INFO:teuthology.orchestra.run.smithi008.stdout: { 2023-08-01T19:54:28.438 INFO:teuthology.orchestra.run.smithi008.stdout: "event": "all_read", 2023-08-01T19:54:28.438 INFO:teuthology.orchestra.run.smithi008.stdout: "time": "2023-08-01T19:54:04.459668+0000", 2023-08-01T19:54:28.438 INFO:teuthology.orchestra.run.smithi008.stdout: "duration": 7.0219999999999999e-06 2023-08-01T19:54:28.438 INFO:teuthology.orchestra.run.smithi008.stdout: }, 2023-08-01T19:54:28.438 INFO:teuthology.orchestra.run.smithi008.stdout: { 2023-08-01T19:54:28.438 INFO:teuthology.orchestra.run.smithi008.stdout: "event": "dispatched", 2023-08-01T19:54:28.439 INFO:teuthology.orchestra.run.smithi008.stdout: "time": "2023-08-01T19:54:04.459681+0000", 2023-08-01T19:54:28.439 INFO:teuthology.orchestra.run.smithi008.stdout: "duration": 1.2999999999999999e-05 2023-08-01T19:54:28.439 INFO:teuthology.orchestra.run.smithi008.stdout: }, 2023-08-01T19:54:28.439 INFO:teuthology.orchestra.run.smithi008.stdout: { 2023-08-01T19:54:28.439 INFO:teuthology.orchestra.run.smithi008.stdout: "event": "queued_for_pg", 2023-08-01T19:54:28.439 INFO:teuthology.orchestra.run.smithi008.stdout: "time": "2023-08-01T19:54:04.459690+0000", 2023-08-01T19:54:28.439 INFO:teuthology.orchestra.run.smithi008.stdout: "duration": 9.2529999999999993e-06 2023-08-01T19:54:28.440 INFO:teuthology.orchestra.run.smithi008.stdout: }, 2023-08-01T19:54:28.440 INFO:teuthology.orchestra.run.smithi008.stdout: { 2023-08-01T19:54:28.440 INFO:teuthology.orchestra.run.smithi008.stdout: "event": "reached_pg", 2023-08-01T19:54:28.440 INFO:teuthology.orchestra.run.smithi008.stdout: "time": "2023-08-01T19:54:04.461862+0000", 2023-08-01T19:54:28.440 INFO:teuthology.orchestra.run.smithi008.stdout: "duration": 0.002172345 2023-08-01T19:54:28.441 INFO:teuthology.orchestra.run.smithi008.stdout: }, 2023-08-01T19:54:28.441 INFO:teuthology.orchestra.run.smithi008.stdout: { 2023-08-01T19:54:28.441 INFO:teuthology.orchestra.run.smithi008.stdout: "event": "started", 2023-08-01T19:54:28.441 INFO:teuthology.orchestra.run.smithi008.stdout: "time": "2023-08-01T19:54:04.462013+0000", 2023-08-01T19:54:28.442 INFO:teuthology.orchestra.run.smithi008.stdout: "duration": 0.00015044200000000001 2023-08-01T19:54:28.442 INFO:teuthology.orchestra.run.smithi008.stdout: }, 2023-08-01T19:54:28.442 INFO:teuthology.orchestra.run.smithi008.stdout: { 2023-08-01T19:54:28.442 INFO:teuthology.orchestra.run.smithi008.stdout: "event": "done", 2023-08-01T19:54:28.442 INFO:teuthology.orchestra.run.smithi008.stdout: "time": "2023-08-01T19:54:04.473007+0000", 2023-08-01T19:54:28.442 INFO:teuthology.orchestra.run.smithi008.stdout: "duration": 0.010994141000000001 2023-08-01T19:54:28.443 INFO:teuthology.orchestra.run.smithi008.stdout: } 2023-08-01T19:54:28.443 INFO:teuthology.orchestra.run.smithi008.stdout: ] 2023-08-01T19:54:28.443 INFO:teuthology.orchestra.run.smithi008.stdout: } 2023-08-01T19:54:28.443 INFO:teuthology.orchestra.run.smithi008.stdout: }, 2023-08-01T19:54:28.443 INFO:teuthology.orchestra.run.smithi008.stdout: { 2023-08-01T19:54:28.443 INFO:teuthology.orchestra.run.smithi008.stdout: "description": "osd_op(mds.0.3:35 3.1f 3:f83d65d8:::200.00000004:head [delete] snapc 0=[] ondisk+write+known_if_redirected+full_force+supports_pool_eio e17)", 2023-08-01T19:54:28.443 INFO:teuthology.orchestra.run.smithi008.stdout: "initiated_at": "2023-08-01T19:54:04.460657+0000", 2023-08-01T19:54:28.444 INFO:teuthology.orchestra.run.smithi008.stdout: "age": 23.874316329999999, 2023-08-01T19:54:28.444 INFO:teuthology.orchestra.run.smithi008.stdout: "duration": 0.012077002, 2023-08-01T19:54:28.444 INFO:teuthology.orchestra.run.smithi008.stdout: "type_data": { 2023-08-01T19:54:28.444 INFO:teuthology.orchestra.run.smithi008.stdout: "flag_point": "started", 2023-08-01T19:54:28.444 INFO:teuthology.orchestra.run.smithi008.stdout: "events": [ 2023-08-01T19:54:28.444 INFO:teuthology.orchestra.run.smithi008.stdout: { 2023-08-01T19:54:28.444 INFO:teuthology.orchestra.run.smithi008.stdout: "event": "initiated", 2023-08-01T19:54:28.445 INFO:teuthology.orchestra.run.smithi008.stdout: "time": "2023-08-01T19:54:04.460657+0000", 2023-08-01T19:54:28.445 INFO:teuthology.orchestra.run.smithi008.stdout: "duration": 0 2023-08-01T19:54:28.445 INFO:teuthology.orchestra.run.smithi008.stdout: }, 2023-08-01T19:54:28.445 INFO:teuthology.orchestra.run.smithi008.stdout: { 2023-08-01T19:54:28.445 INFO:teuthology.orchestra.run.smithi008.stdout: "event": "throttled", 2023-08-01T19:54:28.445 INFO:teuthology.orchestra.run.smithi008.stdout: "time": "2023-08-01T19:54:04.460657+0000", 2023-08-01T19:54:28.445 INFO:teuthology.orchestra.run.smithi008.stdout: "duration": 0 2023-08-01T19:54:28.446 INFO:teuthology.orchestra.run.smithi008.stdout: }, 2023-08-01T19:54:28.446 INFO:teuthology.orchestra.run.smithi008.stdout: { 2023-08-01T19:54:28.446 INFO:teuthology.orchestra.run.smithi008.stdout: "event": "header_read", 2023-08-01T19:54:28.446 INFO:teuthology.orchestra.run.smithi008.stdout: "time": "2023-08-01T19:54:04.460656+0000", 2023-08-01T19:54:28.446 INFO:teuthology.orchestra.run.smithi008.stdout: "duration": 4294967295.999999 2023-08-01T19:54:28.446 INFO:teuthology.orchestra.run.smithi008.stdout: }, 2023-08-01T19:54:28.446 INFO:teuthology.orchestra.run.smithi008.stdout: { 2023-08-01T19:54:28.447 INFO:teuthology.orchestra.run.smithi008.stdout: "event": "all_read", 2023-08-01T19:54:28.447 INFO:teuthology.orchestra.run.smithi008.stdout: "time": "2023-08-01T19:54:04.460662+0000", 2023-08-01T19:54:28.447 INFO:teuthology.orchestra.run.smithi008.stdout: "duration": 5.7450000000000001e-06 2023-08-01T19:54:28.447 INFO:teuthology.orchestra.run.smithi008.stdout: }, 2023-08-01T19:54:28.448 INFO:teuthology.orchestra.run.smithi008.stdout: { 2023-08-01T19:54:28.448 INFO:teuthology.orchestra.run.smithi008.stdout: "event": "dispatched", 2023-08-01T19:54:28.448 INFO:teuthology.orchestra.run.smithi008.stdout: "time": "2023-08-01T19:54:04.460674+0000", 2023-08-01T19:54:28.448 INFO:teuthology.orchestra.run.smithi008.stdout: "duration": 1.2329e-05 2023-08-01T19:54:28.448 INFO:teuthology.orchestra.run.smithi008.stdout: }, 2023-08-01T19:54:28.448 INFO:teuthology.orchestra.run.smithi008.stdout: { 2023-08-01T19:54:28.448 INFO:teuthology.orchestra.run.smithi008.stdout: "event": "queued_for_pg", 2023-08-01T19:54:28.449 INFO:teuthology.orchestra.run.smithi008.stdout: "time": "2023-08-01T19:54:04.460685+0000", 2023-08-01T19:54:28.449 INFO:teuthology.orchestra.run.smithi008.stdout: "duration": 1.0137e-05 2023-08-01T19:54:28.449 INFO:teuthology.orchestra.run.smithi008.stdout: }, 2023-08-01T19:54:28.449 INFO:teuthology.orchestra.run.smithi008.stdout: { 2023-08-01T19:54:28.449 INFO:teuthology.orchestra.run.smithi008.stdout: "event": "reached_pg", 2023-08-01T19:54:28.449 INFO:teuthology.orchestra.run.smithi008.stdout: "time": "2023-08-01T19:54:04.464433+0000", 2023-08-01T19:54:28.449 INFO:teuthology.orchestra.run.smithi008.stdout: "duration": 0.0037482240000000001 2023-08-01T19:54:28.450 INFO:teuthology.orchestra.run.smithi008.stdout: }, 2023-08-01T19:54:28.450 INFO:teuthology.orchestra.run.smithi008.stdout: { 2023-08-01T19:54:28.450 INFO:teuthology.orchestra.run.smithi008.stdout: "event": "started", 2023-08-01T19:54:28.450 INFO:teuthology.orchestra.run.smithi008.stdout: "time": "2023-08-01T19:54:04.464646+0000", 2023-08-01T19:54:28.450 INFO:teuthology.orchestra.run.smithi008.stdout: "duration": 0.00021296800000000001 2023-08-01T19:54:28.450 INFO:teuthology.orchestra.run.smithi008.stdout: }, 2023-08-01T19:54:28.450 INFO:teuthology.orchestra.run.smithi008.stdout: { 2023-08-01T19:54:28.450 INFO:teuthology.orchestra.run.smithi008.stdout: "event": "done", 2023-08-01T19:54:28.451 INFO:teuthology.orchestra.run.smithi008.stdout: "time": "2023-08-01T19:54:04.472734+0000", 2023-08-01T19:54:28.451 INFO:teuthology.orchestra.run.smithi008.stdout: "duration": 0.0080884709999999999 2023-08-01T19:54:28.451 INFO:teuthology.orchestra.run.smithi008.stdout: } 2023-08-01T19:54:28.451 INFO:teuthology.orchestra.run.smithi008.stdout: ] 2023-08-01T19:54:28.451 INFO:teuthology.orchestra.run.smithi008.stdout: } 2023-08-01T19:54:28.451 INFO:teuthology.orchestra.run.smithi008.stdout: }, 2023-08-01T19:54:28.451 INFO:teuthology.orchestra.run.smithi008.stdout: { 2023-08-01T19:54:28.452 INFO:teuthology.orchestra.run.smithi008.stdout: "description": "osd_op(mds.0.3:37 3.1e 3:7bf7e7b5:::200.00000006:head [delete] snapc 0=[] ondisk+write+known_if_redirected+full_force+supports_pool_eio e17)", 2023-08-01T19:54:28.452 INFO:teuthology.orchestra.run.smithi008.stdout: "initiated_at": "2023-08-01T19:54:04.460701+0000", 2023-08-01T19:54:28.452 INFO:teuthology.orchestra.run.smithi008.stdout: "age": 23.874272122000001, 2023-08-01T19:54:28.452 INFO:teuthology.orchestra.run.smithi008.stdout: "duration": 0.010776287000000001, 2023-08-01T19:54:28.452 INFO:teuthology.orchestra.run.smithi008.stdout: "type_data": { 2023-08-01T19:54:28.452 INFO:teuthology.orchestra.run.smithi008.stdout: "flag_point": "started", 2023-08-01T19:54:28.452 INFO:teuthology.orchestra.run.smithi008.stdout: "events": [ 2023-08-01T19:54:28.453 INFO:teuthology.orchestra.run.smithi008.stdout: { 2023-08-01T19:54:28.453 INFO:teuthology.orchestra.run.smithi008.stdout: "event": "initiated", 2023-08-01T19:54:28.453 INFO:teuthology.orchestra.run.smithi008.stdout: "time": "2023-08-01T19:54:04.460701+0000", 2023-08-01T19:54:28.453 INFO:teuthology.orchestra.run.smithi008.stdout: "duration": 0 2023-08-01T19:54:28.453 INFO:teuthology.orchestra.run.smithi008.stdout: }, 2023-08-01T19:54:28.453 INFO:teuthology.orchestra.run.smithi008.stdout: { 2023-08-01T19:54:28.453 INFO:teuthology.orchestra.run.smithi008.stdout: "event": "throttled", 2023-08-01T19:54:28.454 INFO:teuthology.orchestra.run.smithi008.stdout: "time": "2023-08-01T19:54:04.460701+0000", 2023-08-01T19:54:28.454 INFO:teuthology.orchestra.run.smithi008.stdout: "duration": 0 2023-08-01T19:54:28.454 INFO:teuthology.orchestra.run.smithi008.stdout: }, 2023-08-01T19:54:28.454 INFO:teuthology.orchestra.run.smithi008.stdout: { 2023-08-01T19:54:28.455 INFO:teuthology.orchestra.run.smithi008.stdout: "event": "header_read", 2023-08-01T19:54:28.455 INFO:teuthology.orchestra.run.smithi008.stdout: "time": "2023-08-01T19:54:04.460701+0000", 2023-08-01T19:54:28.455 INFO:teuthology.orchestra.run.smithi008.stdout: "duration": 4294967295.999999 2023-08-01T19:54:28.455 INFO:teuthology.orchestra.run.smithi008.stdout: }, 2023-08-01T19:54:28.455 INFO:teuthology.orchestra.run.smithi008.stdout: { 2023-08-01T19:54:28.456 INFO:teuthology.orchestra.run.smithi008.stdout: "event": "all_read", 2023-08-01T19:54:28.456 INFO:teuthology.orchestra.run.smithi008.stdout: "time": "2023-08-01T19:54:04.460713+0000", 2023-08-01T19:54:28.456 INFO:teuthology.orchestra.run.smithi008.stdout: "duration": 1.2655e-05 2023-08-01T19:54:28.456 INFO:teuthology.orchestra.run.smithi008.stdout: }, 2023-08-01T19:54:28.456 INFO:teuthology.orchestra.run.smithi008.stdout: { 2023-08-01T19:54:28.456 INFO:teuthology.orchestra.run.smithi008.stdout: "event": "dispatched", 2023-08-01T19:54:28.456 INFO:teuthology.orchestra.run.smithi008.stdout: "time": "2023-08-01T19:54:04.460728+0000", 2023-08-01T19:54:28.457 INFO:teuthology.orchestra.run.smithi008.stdout: "duration": 1.4775e-05 2023-08-01T19:54:28.457 INFO:teuthology.orchestra.run.smithi008.stdout: }, 2023-08-01T19:54:28.457 INFO:teuthology.orchestra.run.smithi008.stdout: { 2023-08-01T19:54:28.457 INFO:teuthology.orchestra.run.smithi008.stdout: "event": "queued_for_pg", 2023-08-01T19:54:28.457 INFO:teuthology.orchestra.run.smithi008.stdout: "time": "2023-08-01T19:54:04.460734+0000", 2023-08-01T19:54:28.457 INFO:teuthology.orchestra.run.smithi008.stdout: "duration": 5.9039999999999997e-06 2023-08-01T19:54:28.458 INFO:teuthology.orchestra.run.smithi008.stdout: }, 2023-08-01T19:54:28.458 INFO:teuthology.orchestra.run.smithi008.stdout: { 2023-08-01T19:54:28.458 INFO:teuthology.orchestra.run.smithi008.stdout: "event": "reached_pg", 2023-08-01T19:54:28.458 INFO:teuthology.orchestra.run.smithi008.stdout: "time": "2023-08-01T19:54:04.464701+0000", 2023-08-01T19:54:28.458 INFO:teuthology.orchestra.run.smithi008.stdout: "duration": 0.0039670030000000002 2023-08-01T19:54:28.458 INFO:teuthology.orchestra.run.smithi008.stdout: }, 2023-08-01T19:54:28.458 INFO:teuthology.orchestra.run.smithi008.stdout: { 2023-08-01T19:54:28.459 INFO:teuthology.orchestra.run.smithi008.stdout: "event": "started", 2023-08-01T19:54:28.459 INFO:teuthology.orchestra.run.smithi008.stdout: "time": "2023-08-01T19:54:04.464820+0000", 2023-08-01T19:54:28.459 INFO:teuthology.orchestra.run.smithi008.stdout: "duration": 0.000118925 2023-08-01T19:54:28.459 INFO:teuthology.orchestra.run.smithi008.stdout: }, 2023-08-01T19:54:28.459 INFO:teuthology.orchestra.run.smithi008.stdout: { 2023-08-01T19:54:28.459 INFO:teuthology.orchestra.run.smithi008.stdout: "event": "done", 2023-08-01T19:54:28.459 INFO:teuthology.orchestra.run.smithi008.stdout: "time": "2023-08-01T19:54:04.471478+0000", 2023-08-01T19:54:28.460 INFO:teuthology.orchestra.run.smithi008.stdout: "duration": 0.0066579539999999998 2023-08-01T19:54:28.460 INFO:teuthology.orchestra.run.smithi008.stdout: } 2023-08-01T19:54:28.460 INFO:teuthology.orchestra.run.smithi008.stdout: ] 2023-08-01T19:54:28.460 INFO:teuthology.orchestra.run.smithi008.stdout: } 2023-08-01T19:54:28.460 INFO:teuthology.orchestra.run.smithi008.stdout: }, 2023-08-01T19:54:28.460 INFO:teuthology.orchestra.run.smithi008.stdout: { 2023-08-01T19:54:28.460 INFO:teuthology.orchestra.run.smithi008.stdout: "description": "osd_op(client.4668.0:16 5.6 5:635c635c:::benchmark_data_smithi006_114134_object15:head [set-alloc-hint object_size 65536 write_size 65536,write 0~65536] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e21)", 2023-08-01T19:54:28.461 INFO:teuthology.orchestra.run.smithi008.stdout: "initiated_at": "2023-08-01T19:54:24.313825+0000", 2023-08-01T19:54:28.461 INFO:teuthology.orchestra.run.smithi008.stdout: "age": 4.0211482900000002, 2023-08-01T19:54:28.461 INFO:teuthology.orchestra.run.smithi008.stdout: "duration": 0.0082836330000000003, 2023-08-01T19:54:28.461 INFO:teuthology.orchestra.run.smithi008.stdout: "type_data": { 2023-08-01T19:54:28.461 INFO:teuthology.orchestra.run.smithi008.stdout: "flag_point": "commit sent; apply or cleanup", 2023-08-01T19:54:28.462 INFO:teuthology.orchestra.run.smithi008.stdout: "client_info": { 2023-08-01T19:54:28.462 INFO:teuthology.orchestra.run.smithi008.stdout: "client": "client.4668", 2023-08-01T19:54:28.462 INFO:teuthology.orchestra.run.smithi008.stdout: "client_addr": "172.21.15.6:0/1709472247", 2023-08-01T19:54:28.462 INFO:teuthology.orchestra.run.smithi008.stdout: "tid": 16 2023-08-01T19:54:28.462 INFO:teuthology.orchestra.run.smithi008.stdout: }, 2023-08-01T19:54:28.462 INFO:teuthology.orchestra.run.smithi008.stdout: "events": [ 2023-08-01T19:54:28.463 INFO:teuthology.orchestra.run.smithi008.stdout: { 2023-08-01T19:54:28.463 INFO:teuthology.orchestra.run.smithi008.stdout: "event": "initiated", 2023-08-01T19:54:28.463 INFO:teuthology.orchestra.run.smithi008.stdout: "time": "2023-08-01T19:54:24.313825+0000", 2023-08-01T19:54:28.463 INFO:teuthology.orchestra.run.smithi008.stdout: "duration": 0 2023-08-01T19:54:28.463 INFO:teuthology.orchestra.run.smithi008.stdout: }, 2023-08-01T19:54:28.463 INFO:teuthology.orchestra.run.smithi008.stdout: { 2023-08-01T19:54:28.463 INFO:teuthology.orchestra.run.smithi008.stdout: "event": "throttled", 2023-08-01T19:54:28.464 INFO:teuthology.orchestra.run.smithi008.stdout: "time": "2023-08-01T19:54:24.313825+0000", 2023-08-01T19:54:28.464 INFO:teuthology.orchestra.run.smithi008.stdout: "duration": 0 2023-08-01T19:54:28.464 INFO:teuthology.orchestra.run.smithi008.stdout: }, 2023-08-01T19:54:28.464 INFO:teuthology.orchestra.run.smithi008.stdout: { 2023-08-01T19:54:28.464 INFO:teuthology.orchestra.run.smithi008.stdout: "event": "header_read", 2023-08-01T19:54:28.464 INFO:teuthology.orchestra.run.smithi008.stdout: "time": "2023-08-01T19:54:24.313825+0000", 2023-08-01T19:54:28.464 INFO:teuthology.orchestra.run.smithi008.stdout: "duration": 4294967295.9999995 2023-08-01T19:54:28.464 INFO:teuthology.orchestra.run.smithi008.stdout: }, 2023-08-01T19:54:28.465 INFO:teuthology.orchestra.run.smithi008.stdout: { 2023-08-01T19:54:28.465 INFO:teuthology.orchestra.run.smithi008.stdout: "event": "all_read", 2023-08-01T19:54:28.465 INFO:teuthology.orchestra.run.smithi008.stdout: "time": "2023-08-01T19:54:24.313954+0000", 2023-08-01T19:54:28.465 INFO:teuthology.orchestra.run.smithi008.stdout: "duration": 0.00012931299999999999 2023-08-01T19:54:28.465 INFO:teuthology.orchestra.run.smithi008.stdout: }, 2023-08-01T19:54:28.465 INFO:teuthology.orchestra.run.smithi008.stdout: { 2023-08-01T19:54:28.465 INFO:teuthology.orchestra.run.smithi008.stdout: "event": "dispatched", 2023-08-01T19:54:28.466 INFO:teuthology.orchestra.run.smithi008.stdout: "time": "2023-08-01T19:54:24.313963+0000", 2023-08-01T19:54:28.466 INFO:teuthology.orchestra.run.smithi008.stdout: "duration": 8.6379999999999993e-06 2023-08-01T19:54:28.466 INFO:teuthology.orchestra.run.smithi008.stdout: }, 2023-08-01T19:54:28.466 INFO:teuthology.orchestra.run.smithi008.stdout: { 2023-08-01T19:54:28.466 INFO:teuthology.orchestra.run.smithi008.stdout: "event": "queued_for_pg", 2023-08-01T19:54:28.466 INFO:teuthology.orchestra.run.smithi008.stdout: "time": "2023-08-01T19:54:24.313970+0000", 2023-08-01T19:54:28.466 INFO:teuthology.orchestra.run.smithi008.stdout: "duration": 7.4379999999999998e-06 2023-08-01T19:54:28.467 INFO:teuthology.orchestra.run.smithi008.stdout: }, 2023-08-01T19:54:28.467 INFO:teuthology.orchestra.run.smithi008.stdout: { 2023-08-01T19:54:28.467 INFO:teuthology.orchestra.run.smithi008.stdout: "event": "reached_pg", 2023-08-01T19:54:28.467 INFO:teuthology.orchestra.run.smithi008.stdout: "time": "2023-08-01T19:54:24.313996+0000", 2023-08-01T19:54:28.467 INFO:teuthology.orchestra.run.smithi008.stdout: "duration": 2.5743000000000001e-05 2023-08-01T19:54:28.467 INFO:teuthology.orchestra.run.smithi008.stdout: }, 2023-08-01T19:54:28.468 INFO:teuthology.orchestra.run.smithi008.stdout: { 2023-08-01T19:54:28.468 INFO:teuthology.orchestra.run.smithi008.stdout: "event": "waiting_for_map not empty", 2023-08-01T19:54:28.468 INFO:teuthology.orchestra.run.smithi008.stdout: "time": "2023-08-01T19:54:24.313999+0000", 2023-08-01T19:54:28.469 INFO:teuthology.orchestra.run.smithi008.stdout: "duration": 2.6309999999999999e-06 2023-08-01T19:54:28.469 INFO:teuthology.orchestra.run.smithi008.stdout: }, 2023-08-01T19:54:28.469 INFO:teuthology.orchestra.run.smithi008.stdout: { 2023-08-01T19:54:28.469 INFO:teuthology.orchestra.run.smithi008.stdout: "event": "reached_pg", 2023-08-01T19:54:28.469 INFO:teuthology.orchestra.run.smithi008.stdout: "time": "2023-08-01T19:54:24.319723+0000", 2023-08-01T19:54:28.469 INFO:teuthology.orchestra.run.smithi008.stdout: "duration": 0.0057249629999999996 2023-08-01T19:54:28.469 INFO:teuthology.orchestra.run.smithi008.stdout: }, 2023-08-01T19:54:28.470 INFO:teuthology.orchestra.run.smithi008.stdout: { 2023-08-01T19:54:28.470 INFO:teuthology.orchestra.run.smithi008.stdout: "event": "started", 2023-08-01T19:54:28.470 INFO:teuthology.orchestra.run.smithi008.stdout: "time": "2023-08-01T19:54:24.319846+0000", 2023-08-01T19:54:28.470 INFO:teuthology.orchestra.run.smithi008.stdout: "duration": 0.000122168 2023-08-01T19:54:28.470 INFO:teuthology.orchestra.run.smithi008.stdout: }, 2023-08-01T19:54:28.470 INFO:teuthology.orchestra.run.smithi008.stdout: { 2023-08-01T19:54:28.470 INFO:teuthology.orchestra.run.smithi008.stdout: "event": "waiting for subops from 1", 2023-08-01T19:54:28.470 INFO:teuthology.orchestra.run.smithi008.stdout: "time": "2023-08-01T19:54:24.319998+0000", 2023-08-01T19:54:28.471 INFO:teuthology.orchestra.run.smithi008.stdout: "duration": 0.00015247399999999999 2023-08-01T19:54:28.471 INFO:teuthology.orchestra.run.smithi008.stdout: }, 2023-08-01T19:54:28.471 INFO:teuthology.orchestra.run.smithi008.stdout: { 2023-08-01T19:54:28.471 INFO:teuthology.orchestra.run.smithi008.stdout: "event": "op_commit", 2023-08-01T19:54:28.471 INFO:teuthology.orchestra.run.smithi008.stdout: "time": "2023-08-01T19:54:24.321830+0000", 2023-08-01T19:54:28.472 INFO:teuthology.orchestra.run.smithi008.stdout: "duration": 0.001831437 2023-08-01T19:54:28.472 INFO:teuthology.orchestra.run.smithi008.stdout: }, 2023-08-01T19:54:28.472 INFO:teuthology.orchestra.run.smithi008.stdout: { 2023-08-01T19:54:28.472 INFO:teuthology.orchestra.run.smithi008.stdout: "event": "sub_op_commit_rec", 2023-08-01T19:54:28.472 INFO:teuthology.orchestra.run.smithi008.stdout: "time": "2023-08-01T19:54:24.322052+0000", 2023-08-01T19:54:28.473 INFO:teuthology.orchestra.run.smithi008.stdout: "duration": 0.00022222299999999999 2023-08-01T19:54:28.473 INFO:teuthology.orchestra.run.smithi008.stdout: }, 2023-08-01T19:54:28.473 INFO:teuthology.orchestra.run.smithi008.stdout: { 2023-08-01T19:54:28.473 INFO:teuthology.orchestra.run.smithi008.stdout: "event": "commit_sent", 2023-08-01T19:54:28.474 INFO:teuthology.orchestra.run.smithi008.stdout: "time": "2023-08-01T19:54:24.322079+0000", 2023-08-01T19:54:28.474 INFO:teuthology.orchestra.run.smithi008.stdout: "duration": 2.6866e-05 2023-08-01T19:54:28.474 INFO:teuthology.orchestra.run.smithi008.stdout: }, 2023-08-01T19:54:28.474 INFO:teuthology.orchestra.run.smithi008.stdout: { 2023-08-01T19:54:28.474 INFO:teuthology.orchestra.run.smithi008.stdout: "event": "done", 2023-08-01T19:54:28.474 INFO:teuthology.orchestra.run.smithi008.stdout: "time": "2023-08-01T19:54:24.322109+0000", 2023-08-01T19:54:28.474 INFO:teuthology.orchestra.run.smithi008.stdout: "duration": 3.0298e-05 2023-08-01T19:54:28.475 INFO:teuthology.orchestra.run.smithi008.stdout: } 2023-08-01T19:54:28.475 INFO:teuthology.orchestra.run.smithi008.stdout: ] 2023-08-01T19:54:28.475 INFO:teuthology.orchestra.run.smithi008.stdout: } 2023-08-01T19:54:28.475 INFO:teuthology.orchestra.run.smithi008.stdout: }, 2023-08-01T19:54:28.475 INFO:teuthology.orchestra.run.smithi008.stdout: { 2023-08-01T19:54:28.475 INFO:teuthology.orchestra.run.smithi008.stdout: "description": "osd_op(client.4668.0:1170 5.c 5:3a973098:::benchmark_data_smithi006_114134_object1169:head [set-alloc-hint object_size 65536 write_size 65536,write 0~65536] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e21)", 2023-08-01T19:54:28.475 INFO:teuthology.orchestra.run.smithi008.stdout: "initiated_at": "2023-08-01T19:54:24.582058+0000", 2023-08-01T19:54:28.476 INFO:teuthology.orchestra.run.smithi008.stdout: "age": 3.752915249, 2023-08-01T19:54:28.476 INFO:teuthology.orchestra.run.smithi008.stdout: "duration": 0.01009762, 2023-08-01T19:54:28.476 INFO:teuthology.orchestra.run.smithi008.stdout: "type_data": { 2023-08-01T19:54:28.476 INFO:teuthology.orchestra.run.smithi008.stdout: "flag_point": "commit sent; apply or cleanup", 2023-08-01T19:54:28.476 INFO:teuthology.orchestra.run.smithi008.stdout: "client_info": { 2023-08-01T19:54:28.476 INFO:teuthology.orchestra.run.smithi008.stdout: "client": "client.4668", 2023-08-01T19:54:28.477 INFO:teuthology.orchestra.run.smithi008.stdout: "client_addr": "172.21.15.6:0/1709472247", 2023-08-01T19:54:28.477 INFO:teuthology.orchestra.run.smithi008.stdout: "tid": 1170 2023-08-01T19:54:28.477 INFO:teuthology.orchestra.run.smithi008.stdout: }, 2023-08-01T19:54:28.477 INFO:teuthology.orchestra.run.smithi008.stdout: "events": [ 2023-08-01T19:54:28.477 INFO:teuthology.orchestra.run.smithi008.stdout: { 2023-08-01T19:54:28.477 INFO:teuthology.orchestra.run.smithi008.stdout: "event": "initiated", 2023-08-01T19:54:28.477 INFO:teuthology.orchestra.run.smithi008.stdout: "time": "2023-08-01T19:54:24.582058+0000", 2023-08-01T19:54:28.478 INFO:teuthology.orchestra.run.smithi008.stdout: "duration": 0 2023-08-01T19:54:28.478 INFO:teuthology.orchestra.run.smithi008.stdout: }, 2023-08-01T19:54:28.478 INFO:teuthology.orchestra.run.smithi008.stdout: { 2023-08-01T19:54:28.478 INFO:teuthology.orchestra.run.smithi008.stdout: "event": "throttled", 2023-08-01T19:54:28.478 INFO:teuthology.orchestra.run.smithi008.stdout: "time": "2023-08-01T19:54:24.582058+0000", 2023-08-01T19:54:28.478 INFO:teuthology.orchestra.run.smithi008.stdout: "duration": 0 2023-08-01T19:54:28.478 INFO:teuthology.orchestra.run.smithi008.stdout: }, 2023-08-01T19:54:28.479 INFO:teuthology.orchestra.run.smithi008.stdout: { 2023-08-01T19:54:28.479 INFO:teuthology.orchestra.run.smithi008.stdout: "event": "header_read", 2023-08-01T19:54:28.479 INFO:teuthology.orchestra.run.smithi008.stdout: "time": "2023-08-01T19:54:24.582058+0000", 2023-08-01T19:54:28.479 INFO:teuthology.orchestra.run.smithi008.stdout: "duration": 4294967295.9999995 2023-08-01T19:54:28.480 INFO:teuthology.orchestra.run.smithi008.stdout: }, 2023-08-01T19:54:28.480 INFO:teuthology.orchestra.run.smithi008.stdout: { 2023-08-01T19:54:28.480 INFO:teuthology.orchestra.run.smithi008.stdout: "event": "all_read", 2023-08-01T19:54:28.480 INFO:teuthology.orchestra.run.smithi008.stdout: "time": "2023-08-01T19:54:24.582113+0000", 2023-08-01T19:54:28.481 INFO:teuthology.orchestra.run.smithi008.stdout: "duration": 5.5807000000000003e-05 2023-08-01T19:54:28.481 INFO:teuthology.orchestra.run.smithi008.stdout: }, 2023-08-01T19:54:28.481 INFO:teuthology.orchestra.run.smithi008.stdout: { 2023-08-01T19:54:28.482 INFO:teuthology.orchestra.run.smithi008.stdout: "event": "dispatched", 2023-08-01T19:54:28.482 INFO:teuthology.orchestra.run.smithi008.stdout: "time": "2023-08-01T19:54:24.582123+0000", 2023-08-01T19:54:28.482 INFO:teuthology.orchestra.run.smithi008.stdout: "duration": 9.4700000000000008e-06 2023-08-01T19:54:28.482 INFO:teuthology.orchestra.run.smithi008.stdout: }, 2023-08-01T19:54:28.483 INFO:teuthology.orchestra.run.smithi008.stdout: { 2023-08-01T19:54:28.483 INFO:teuthology.orchestra.run.smithi008.stdout: "event": "queued_for_pg", 2023-08-01T19:54:28.483 INFO:teuthology.orchestra.run.smithi008.stdout: "time": "2023-08-01T19:54:24.582129+0000", 2023-08-01T19:54:28.483 INFO:teuthology.orchestra.run.smithi008.stdout: "duration": 6.3759999999999996e-06 2023-08-01T19:54:28.484 INFO:teuthology.orchestra.run.smithi008.stdout: }, 2023-08-01T19:54:28.484 INFO:teuthology.orchestra.run.smithi008.stdout: { 2023-08-01T19:54:28.484 INFO:teuthology.orchestra.run.smithi008.stdout: "event": "reached_pg", 2023-08-01T19:54:28.484 INFO:teuthology.orchestra.run.smithi008.stdout: "time": "2023-08-01T19:54:24.582668+0000", 2023-08-01T19:54:28.485 INFO:teuthology.orchestra.run.smithi008.stdout: "duration": 0.00053866199999999997 2023-08-01T19:54:28.485 INFO:teuthology.orchestra.run.smithi008.stdout: }, 2023-08-01T19:54:28.485 INFO:teuthology.orchestra.run.smithi008.stdout: { 2023-08-01T19:54:28.485 INFO:teuthology.orchestra.run.smithi008.stdout: "event": "started", 2023-08-01T19:54:28.485 INFO:teuthology.orchestra.run.smithi008.stdout: "time": "2023-08-01T19:54:24.582798+0000", 2023-08-01T19:54:28.485 INFO:teuthology.orchestra.run.smithi008.stdout: "duration": 0.00013032699999999999 2023-08-01T19:54:28.486 INFO:teuthology.orchestra.run.smithi008.stdout: }, 2023-08-01T19:54:28.486 INFO:teuthology.orchestra.run.smithi008.stdout: { 2023-08-01T19:54:28.486 INFO:teuthology.orchestra.run.smithi008.stdout: "event": "waiting for subops from 1", 2023-08-01T19:54:28.486 INFO:teuthology.orchestra.run.smithi008.stdout: "time": "2023-08-01T19:54:24.582951+0000", 2023-08-01T19:54:28.486 INFO:teuthology.orchestra.run.smithi008.stdout: "duration": 0.000152318 2023-08-01T19:54:28.487 INFO:teuthology.orchestra.run.smithi008.stdout: }, 2023-08-01T19:54:28.487 INFO:teuthology.orchestra.run.smithi008.stdout: { 2023-08-01T19:54:28.487 INFO:teuthology.orchestra.run.smithi008.stdout: "event": "op_commit", 2023-08-01T19:54:28.487 INFO:teuthology.orchestra.run.smithi008.stdout: "time": "2023-08-01T19:54:24.584046+0000", 2023-08-01T19:54:28.487 INFO:teuthology.orchestra.run.smithi008.stdout: "duration": 0.001095284 2023-08-01T19:54:28.487 INFO:teuthology.orchestra.run.smithi008.stdout: }, 2023-08-01T19:54:28.488 INFO:teuthology.orchestra.run.smithi008.stdout: { 2023-08-01T19:54:28.488 INFO:teuthology.orchestra.run.smithi008.stdout: "event": "sub_op_commit_rec", 2023-08-01T19:54:28.488 INFO:teuthology.orchestra.run.smithi008.stdout: "time": "2023-08-01T19:54:24.592109+0000", 2023-08-01T19:54:28.488 INFO:teuthology.orchestra.run.smithi008.stdout: "duration": 0.0080626829999999993 2023-08-01T19:54:28.488 INFO:teuthology.orchestra.run.smithi008.stdout: }, 2023-08-01T19:54:28.488 INFO:teuthology.orchestra.run.smithi008.stdout: { 2023-08-01T19:54:28.488 INFO:teuthology.orchestra.run.smithi008.stdout: "event": "commit_sent", 2023-08-01T19:54:28.489 INFO:teuthology.orchestra.run.smithi008.stdout: "time": "2023-08-01T19:54:24.592136+0000", 2023-08-01T19:54:28.489 INFO:teuthology.orchestra.run.smithi008.stdout: "duration": 2.7132e-05 2023-08-01T19:54:28.489 INFO:teuthology.orchestra.run.smithi008.stdout: }, 2023-08-01T19:54:28.489 INFO:teuthology.orchestra.run.smithi008.stdout: { 2023-08-01T19:54:28.489 INFO:teuthology.orchestra.run.smithi008.stdout: "event": "done", 2023-08-01T19:54:28.489 INFO:teuthology.orchestra.run.smithi008.stdout: "time": "2023-08-01T19:54:24.592156+0000", 2023-08-01T19:54:28.489 INFO:teuthology.orchestra.run.smithi008.stdout: "duration": 2.0220999999999998e-05 2023-08-01T19:54:28.490 INFO:teuthology.orchestra.run.smithi008.stdout: } 2023-08-01T19:54:28.490 INFO:teuthology.orchestra.run.smithi008.stdout: ] 2023-08-01T19:54:28.490 INFO:teuthology.orchestra.run.smithi008.stdout: } 2023-08-01T19:54:28.490 INFO:teuthology.orchestra.run.smithi008.stdout: }, 2023-08-01T19:54:28.490 INFO:teuthology.orchestra.run.smithi008.stdout: { 2023-08-01T19:54:28.490 INFO:teuthology.orchestra.run.smithi008.stdout: "description": "osd_op(client.4668.0:3160 5.6 5:64070c89:::benchmark_data_smithi006_114134_object3159:head [set-alloc-hint object_size 65536 write_size 65536,write 0~65536] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e21)", 2023-08-01T19:54:28.490 INFO:teuthology.orchestra.run.smithi008.stdout: "initiated_at": "2023-08-01T19:54:25.025141+0000", 2023-08-01T19:54:28.491 INFO:teuthology.orchestra.run.smithi008.stdout: "age": 3.3098321180000001, 2023-08-01T19:54:28.491 INFO:teuthology.orchestra.run.smithi008.stdout: "duration": 0.0087117730000000008, 2023-08-01T19:54:28.491 INFO:teuthology.orchestra.run.smithi008.stdout: "type_data": { 2023-08-01T19:54:28.491 INFO:teuthology.orchestra.run.smithi008.stdout: "flag_point": "commit sent; apply or cleanup", 2023-08-01T19:54:28.491 INFO:teuthology.orchestra.run.smithi008.stdout: "client_info": { 2023-08-01T19:54:28.491 INFO:teuthology.orchestra.run.smithi008.stdout: "client": "client.4668", 2023-08-01T19:54:28.492 INFO:teuthology.orchestra.run.smithi008.stdout: "client_addr": "172.21.15.6:0/1709472247", 2023-08-01T19:54:28.492 INFO:teuthology.orchestra.run.smithi008.stdout: "tid": 3160 2023-08-01T19:54:28.492 INFO:teuthology.orchestra.run.smithi008.stdout: }, 2023-08-01T19:54:28.493 INFO:teuthology.orchestra.run.smithi008.stdout: "events": [ 2023-08-01T19:54:28.493 INFO:teuthology.orchestra.run.smithi008.stdout: { 2023-08-01T19:54:28.493 INFO:teuthology.orchestra.run.smithi008.stdout: "event": "initiated", 2023-08-01T19:54:28.493 INFO:teuthology.orchestra.run.smithi008.stdout: "time": "2023-08-01T19:54:25.025141+0000", 2023-08-01T19:54:28.494 INFO:teuthology.orchestra.run.smithi008.stdout: "duration": 0 2023-08-01T19:54:28.494 INFO:teuthology.orchestra.run.smithi008.stdout: }, 2023-08-01T19:54:28.494 INFO:teuthology.orchestra.run.smithi008.stdout: { 2023-08-01T19:54:28.495 INFO:teuthology.orchestra.run.smithi008.stdout: "event": "throttled", 2023-08-01T19:54:28.495 INFO:teuthology.orchestra.run.smithi008.stdout: "time": "2023-08-01T19:54:25.025141+0000", 2023-08-01T19:54:28.495 INFO:teuthology.orchestra.run.smithi008.stdout: "duration": 0 2023-08-01T19:54:28.495 INFO:teuthology.orchestra.run.smithi008.stdout: }, 2023-08-01T19:54:28.496 INFO:teuthology.orchestra.run.smithi008.stdout: { 2023-08-01T19:54:28.496 INFO:teuthology.orchestra.run.smithi008.stdout: "event": "header_read", 2023-08-01T19:54:28.496 INFO:teuthology.orchestra.run.smithi008.stdout: "time": "2023-08-01T19:54:25.025141+0000", 2023-08-01T19:54:28.496 INFO:teuthology.orchestra.run.smithi008.stdout: "duration": 4294967295.999999 2023-08-01T19:54:28.496 INFO:teuthology.orchestra.run.smithi008.stdout: }, 2023-08-01T19:54:28.497 INFO:teuthology.orchestra.run.smithi008.stdout: { 2023-08-01T19:54:28.497 INFO:teuthology.orchestra.run.smithi008.stdout: "event": "all_read", 2023-08-01T19:54:28.497 INFO:teuthology.orchestra.run.smithi008.stdout: "time": "2023-08-01T19:54:25.025204+0000", 2023-08-01T19:54:28.497 INFO:teuthology.orchestra.run.smithi008.stdout: "duration": 6.3115999999999997e-05 2023-08-01T19:54:28.497 INFO:teuthology.orchestra.run.smithi008.stdout: }, 2023-08-01T19:54:28.497 INFO:teuthology.orchestra.run.smithi008.stdout: { 2023-08-01T19:54:28.497 INFO:teuthology.orchestra.run.smithi008.stdout: "event": "dispatched", 2023-08-01T19:54:28.498 INFO:teuthology.orchestra.run.smithi008.stdout: "time": "2023-08-01T19:54:25.025215+0000", 2023-08-01T19:54:28.498 INFO:teuthology.orchestra.run.smithi008.stdout: "duration": 1.1073999999999999e-05 2023-08-01T19:54:28.498 INFO:teuthology.orchestra.run.smithi008.stdout: }, 2023-08-01T19:54:28.498 INFO:teuthology.orchestra.run.smithi008.stdout: { 2023-08-01T19:54:28.498 INFO:teuthology.orchestra.run.smithi008.stdout: "event": "queued_for_pg", 2023-08-01T19:54:28.498 INFO:teuthology.orchestra.run.smithi008.stdout: "time": "2023-08-01T19:54:25.025222+0000", 2023-08-01T19:54:28.499 INFO:teuthology.orchestra.run.smithi008.stdout: "duration": 6.9990000000000002e-06 2023-08-01T19:54:28.499 INFO:teuthology.orchestra.run.smithi008.stdout: }, 2023-08-01T19:54:28.499 INFO:teuthology.orchestra.run.smithi008.stdout: { 2023-08-01T19:54:28.499 INFO:teuthology.orchestra.run.smithi008.stdout: "event": "reached_pg", 2023-08-01T19:54:28.499 INFO:teuthology.orchestra.run.smithi008.stdout: "time": "2023-08-01T19:54:25.025267+0000", 2023-08-01T19:54:28.500 INFO:teuthology.orchestra.run.smithi008.stdout: "duration": 4.4841e-05 2023-08-01T19:54:28.500 INFO:teuthology.orchestra.run.smithi008.stdout: }, 2023-08-01T19:54:28.500 INFO:teuthology.orchestra.run.smithi008.stdout: { 2023-08-01T19:54:28.500 INFO:teuthology.orchestra.run.smithi008.stdout: "event": "started", 2023-08-01T19:54:28.500 INFO:teuthology.orchestra.run.smithi008.stdout: "time": "2023-08-01T19:54:25.025361+0000", 2023-08-01T19:54:28.500 INFO:teuthology.orchestra.run.smithi008.stdout: "duration": 9.4227000000000004e-05 2023-08-01T19:54:28.501 INFO:teuthology.orchestra.run.smithi008.stdout: }, 2023-08-01T19:54:28.501 INFO:teuthology.orchestra.run.smithi008.stdout: { 2023-08-01T19:54:28.501 INFO:teuthology.orchestra.run.smithi008.stdout: "event": "waiting for subops from 1", 2023-08-01T19:54:28.501 INFO:teuthology.orchestra.run.smithi008.stdout: "time": "2023-08-01T19:54:25.025442+0000", 2023-08-01T19:54:28.501 INFO:teuthology.orchestra.run.smithi008.stdout: "duration": 8.1495999999999994e-05 2023-08-01T19:54:28.501 INFO:teuthology.orchestra.run.smithi008.stdout: }, 2023-08-01T19:54:28.501 INFO:teuthology.orchestra.run.smithi008.stdout: { 2023-08-01T19:54:28.502 INFO:teuthology.orchestra.run.smithi008.stdout: "event": "op_commit", 2023-08-01T19:54:28.502 INFO:teuthology.orchestra.run.smithi008.stdout: "time": "2023-08-01T19:54:25.026203+0000", 2023-08-01T19:54:28.502 INFO:teuthology.orchestra.run.smithi008.stdout: "duration": 0.00076048900000000004 2023-08-01T19:54:28.502 INFO:teuthology.orchestra.run.smithi008.stdout: }, 2023-08-01T19:54:28.502 INFO:teuthology.orchestra.run.smithi008.stdout: { 2023-08-01T19:54:28.502 INFO:teuthology.orchestra.run.smithi008.stdout: "event": "sub_op_commit_rec", 2023-08-01T19:54:28.502 INFO:teuthology.orchestra.run.smithi008.stdout: "time": "2023-08-01T19:54:25.033802+0000", 2023-08-01T19:54:28.503 INFO:teuthology.orchestra.run.smithi008.stdout: "duration": 0.0075995189999999999 2023-08-01T19:54:28.503 INFO:teuthology.orchestra.run.smithi008.stdout: }, 2023-08-01T19:54:28.503 INFO:teuthology.orchestra.run.smithi008.stdout: { 2023-08-01T19:54:28.503 INFO:teuthology.orchestra.run.smithi008.stdout: "event": "commit_sent", 2023-08-01T19:54:28.503 INFO:teuthology.orchestra.run.smithi008.stdout: "time": "2023-08-01T19:54:25.033832+0000", 2023-08-01T19:54:28.503 INFO:teuthology.orchestra.run.smithi008.stdout: "duration": 2.9844000000000001e-05 2023-08-01T19:54:28.503 INFO:teuthology.orchestra.run.smithi008.stdout: }, 2023-08-01T19:54:28.504 INFO:teuthology.orchestra.run.smithi008.stdout: { 2023-08-01T19:54:28.504 INFO:teuthology.orchestra.run.smithi008.stdout: "event": "done", 2023-08-01T19:54:28.504 INFO:teuthology.orchestra.run.smithi008.stdout: "time": "2023-08-01T19:54:25.033853+0000", 2023-08-01T19:54:28.504 INFO:teuthology.orchestra.run.smithi008.stdout: "duration": 2.1075000000000001e-05 2023-08-01T19:54:28.504 INFO:teuthology.orchestra.run.smithi008.stdout: } 2023-08-01T19:54:28.504 INFO:teuthology.orchestra.run.smithi008.stdout: ] 2023-08-01T19:54:28.504 INFO:teuthology.orchestra.run.smithi008.stdout: } 2023-08-01T19:54:28.505 INFO:teuthology.orchestra.run.smithi008.stdout: }, 2023-08-01T19:54:28.505 INFO:teuthology.orchestra.run.smithi008.stdout: { 2023-08-01T19:54:28.505 INFO:teuthology.orchestra.run.smithi008.stdout: "description": "osd_op(client.4668.0:3169 5.c 5:3f7e2cf8:::benchmark_data_smithi006_114134_object3168:head [set-alloc-hint object_size 65536 write_size 65536,write 0~65536] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e21)", 2023-08-01T19:54:28.506 INFO:teuthology.orchestra.run.smithi008.stdout: "initiated_at": "2023-08-01T19:54:25.028174+0000", 2023-08-01T19:54:28.506 INFO:teuthology.orchestra.run.smithi008.stdout: "age": 3.3067999650000002, 2023-08-01T19:54:28.506 INFO:teuthology.orchestra.run.smithi008.stdout: "duration": 0.0083467230000000003, 2023-08-01T19:54:28.506 INFO:teuthology.orchestra.run.smithi008.stdout: "type_data": { 2023-08-01T19:54:28.507 INFO:teuthology.orchestra.run.smithi008.stdout: "flag_point": "commit sent; apply or cleanup", 2023-08-01T19:54:28.507 INFO:teuthology.orchestra.run.smithi008.stdout: "client_info": { 2023-08-01T19:54:28.507 INFO:teuthology.orchestra.run.smithi008.stdout: "client": "client.4668", 2023-08-01T19:54:28.507 INFO:teuthology.orchestra.run.smithi008.stdout: "client_addr": "172.21.15.6:0/1709472247", 2023-08-01T19:54:28.508 INFO:teuthology.orchestra.run.smithi008.stdout: "tid": 3169 2023-08-01T19:54:28.508 INFO:teuthology.orchestra.run.smithi008.stdout: }, 2023-08-01T19:54:28.508 INFO:teuthology.orchestra.run.smithi008.stdout: "events": [ 2023-08-01T19:54:28.508 INFO:teuthology.orchestra.run.smithi008.stdout: { 2023-08-01T19:54:28.508 INFO:teuthology.orchestra.run.smithi008.stdout: "event": "initiated", 2023-08-01T19:54:28.509 INFO:teuthology.orchestra.run.smithi008.stdout: "time": "2023-08-01T19:54:25.028174+0000", 2023-08-01T19:54:28.509 INFO:teuthology.orchestra.run.smithi008.stdout: "duration": 0 2023-08-01T19:54:28.509 INFO:teuthology.orchestra.run.smithi008.stdout: }, 2023-08-01T19:54:28.509 INFO:teuthology.orchestra.run.smithi008.stdout: { 2023-08-01T19:54:28.509 INFO:teuthology.orchestra.run.smithi008.stdout: "event": "throttled", 2023-08-01T19:54:28.509 INFO:teuthology.orchestra.run.smithi008.stdout: "time": "2023-08-01T19:54:25.028174+0000", 2023-08-01T19:54:28.509 INFO:teuthology.orchestra.run.smithi008.stdout: "duration": 0 2023-08-01T19:54:28.510 INFO:teuthology.orchestra.run.smithi008.stdout: }, 2023-08-01T19:54:28.510 INFO:teuthology.orchestra.run.smithi008.stdout: { 2023-08-01T19:54:28.510 INFO:teuthology.orchestra.run.smithi008.stdout: "event": "header_read", 2023-08-01T19:54:28.510 INFO:teuthology.orchestra.run.smithi008.stdout: "time": "2023-08-01T19:54:25.028173+0000", 2023-08-01T19:54:28.510 INFO:teuthology.orchestra.run.smithi008.stdout: "duration": 4294967295.999999 2023-08-01T19:54:28.510 INFO:teuthology.orchestra.run.smithi008.stdout: }, 2023-08-01T19:54:28.510 INFO:teuthology.orchestra.run.smithi008.stdout: { 2023-08-01T19:54:28.511 INFO:teuthology.orchestra.run.smithi008.stdout: "event": "all_read", 2023-08-01T19:54:28.511 INFO:teuthology.orchestra.run.smithi008.stdout: "time": "2023-08-01T19:54:25.028274+0000", 2023-08-01T19:54:28.511 INFO:teuthology.orchestra.run.smithi008.stdout: "duration": 0.000101056 2023-08-01T19:54:28.511 INFO:teuthology.orchestra.run.smithi008.stdout: }, 2023-08-01T19:54:28.511 INFO:teuthology.orchestra.run.smithi008.stdout: { 2023-08-01T19:54:28.511 INFO:teuthology.orchestra.run.smithi008.stdout: "event": "dispatched", 2023-08-01T19:54:28.511 INFO:teuthology.orchestra.run.smithi008.stdout: "time": "2023-08-01T19:54:25.028283+0000", 2023-08-01T19:54:28.512 INFO:teuthology.orchestra.run.smithi008.stdout: "duration": 9.4110000000000002e-06 2023-08-01T19:54:28.512 INFO:teuthology.orchestra.run.smithi008.stdout: }, 2023-08-01T19:54:28.512 INFO:teuthology.orchestra.run.smithi008.stdout: { 2023-08-01T19:54:28.512 INFO:teuthology.orchestra.run.smithi008.stdout: "event": "queued_for_pg", 2023-08-01T19:54:28.512 INFO:teuthology.orchestra.run.smithi008.stdout: "time": "2023-08-01T19:54:25.028289+0000", 2023-08-01T19:54:28.513 INFO:teuthology.orchestra.run.smithi008.stdout: "duration": 5.2519999999999999e-06 2023-08-01T19:54:28.513 INFO:teuthology.orchestra.run.smithi008.stdout: }, 2023-08-01T19:54:28.513 INFO:teuthology.orchestra.run.smithi008.stdout: { 2023-08-01T19:54:28.513 INFO:teuthology.orchestra.run.smithi008.stdout: "event": "reached_pg", 2023-08-01T19:54:28.513 INFO:teuthology.orchestra.run.smithi008.stdout: "time": "2023-08-01T19:54:25.028364+0000", 2023-08-01T19:54:28.513 INFO:teuthology.orchestra.run.smithi008.stdout: "duration": 7.4919999999999994e-05 2023-08-01T19:54:28.514 INFO:teuthology.orchestra.run.smithi008.stdout: }, 2023-08-01T19:54:28.514 INFO:teuthology.orchestra.run.smithi008.stdout: { 2023-08-01T19:54:28.514 INFO:teuthology.orchestra.run.smithi008.stdout: "event": "started", 2023-08-01T19:54:28.514 INFO:teuthology.orchestra.run.smithi008.stdout: "time": "2023-08-01T19:54:25.028523+0000", 2023-08-01T19:54:28.514 INFO:teuthology.orchestra.run.smithi008.stdout: "duration": 0.000159455 2023-08-01T19:54:28.514 INFO:teuthology.orchestra.run.smithi008.stdout: }, 2023-08-01T19:54:28.514 INFO:teuthology.orchestra.run.smithi008.stdout: { 2023-08-01T19:54:28.515 INFO:teuthology.orchestra.run.smithi008.stdout: "event": "waiting for subops from 1", 2023-08-01T19:54:28.515 INFO:teuthology.orchestra.run.smithi008.stdout: "time": "2023-08-01T19:54:25.028647+0000", 2023-08-01T19:54:28.515 INFO:teuthology.orchestra.run.smithi008.stdout: "duration": 0.00012386 2023-08-01T19:54:28.515 INFO:teuthology.orchestra.run.smithi008.stdout: }, 2023-08-01T19:54:28.515 INFO:teuthology.orchestra.run.smithi008.stdout: { 2023-08-01T19:54:28.515 INFO:teuthology.orchestra.run.smithi008.stdout: "event": "op_commit", 2023-08-01T19:54:28.515 INFO:teuthology.orchestra.run.smithi008.stdout: "time": "2023-08-01T19:54:25.030224+0000", 2023-08-01T19:54:28.516 INFO:teuthology.orchestra.run.smithi008.stdout: "duration": 0.00157752 2023-08-01T19:54:28.516 INFO:teuthology.orchestra.run.smithi008.stdout: }, 2023-08-01T19:54:28.516 INFO:teuthology.orchestra.run.smithi008.stdout: { 2023-08-01T19:54:28.516 INFO:teuthology.orchestra.run.smithi008.stdout: "event": "sub_op_commit_rec", 2023-08-01T19:54:28.516 INFO:teuthology.orchestra.run.smithi008.stdout: "time": "2023-08-01T19:54:25.036435+0000", 2023-08-01T19:54:28.516 INFO:teuthology.orchestra.run.smithi008.stdout: "duration": 0.0062110280000000004 2023-08-01T19:54:28.516 INFO:teuthology.orchestra.run.smithi008.stdout: }, 2023-08-01T19:54:28.517 INFO:teuthology.orchestra.run.smithi008.stdout: { 2023-08-01T19:54:28.517 INFO:teuthology.orchestra.run.smithi008.stdout: "event": "commit_sent", 2023-08-01T19:54:28.517 INFO:teuthology.orchestra.run.smithi008.stdout: "time": "2023-08-01T19:54:25.036477+0000", 2023-08-01T19:54:28.517 INFO:teuthology.orchestra.run.smithi008.stdout: "duration": 4.1470000000000001e-05 2023-08-01T19:54:28.517 INFO:teuthology.orchestra.run.smithi008.stdout: }, 2023-08-01T19:54:28.517 INFO:teuthology.orchestra.run.smithi008.stdout: { 2023-08-01T19:54:28.517 INFO:teuthology.orchestra.run.smithi008.stdout: "event": "done", 2023-08-01T19:54:28.518 INFO:teuthology.orchestra.run.smithi008.stdout: "time": "2023-08-01T19:54:25.036520+0000", 2023-08-01T19:54:28.518 INFO:teuthology.orchestra.run.smithi008.stdout: "duration": 4.3476000000000002e-05 2023-08-01T19:54:28.518 INFO:teuthology.orchestra.run.smithi008.stdout: } 2023-08-01T19:54:28.518 INFO:teuthology.orchestra.run.smithi008.stdout: ] 2023-08-01T19:54:28.518 INFO:teuthology.orchestra.run.smithi008.stdout: } 2023-08-01T19:54:28.518 INFO:teuthology.orchestra.run.smithi008.stdout: }, 2023-08-01T19:54:28.518 INFO:teuthology.orchestra.run.smithi008.stdout: { 2023-08-01T19:54:28.518 INFO:teuthology.orchestra.run.smithi008.stdout: "description": "osd_op(client.4668.0:3170 5.c 5:3461287b:::benchmark_data_smithi006_114134_object3169:head [set-alloc-hint object_size 65536 write_size 65536,write 0~65536] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e21)", 2023-08-01T19:54:28.519 INFO:teuthology.orchestra.run.smithi008.stdout: "initiated_at": "2023-08-01T19:54:25.028298+0000", 2023-08-01T19:54:28.519 INFO:teuthology.orchestra.run.smithi008.stdout: "age": 3.306675255, 2023-08-01T19:54:28.519 INFO:teuthology.orchestra.run.smithi008.stdout: "duration": 0.0083613079999999996, 2023-08-01T19:54:28.519 INFO:teuthology.orchestra.run.smithi008.stdout: "type_data": { 2023-08-01T19:54:28.520 INFO:teuthology.orchestra.run.smithi008.stdout: "flag_point": "commit sent; apply or cleanup", 2023-08-01T19:54:28.520 INFO:teuthology.orchestra.run.smithi008.stdout: "client_info": { 2023-08-01T19:54:28.520 INFO:teuthology.orchestra.run.smithi008.stdout: "client": "client.4668", 2023-08-01T19:54:28.521 INFO:teuthology.orchestra.run.smithi008.stdout: "client_addr": "172.21.15.6:0/1709472247", 2023-08-01T19:54:28.521 INFO:teuthology.orchestra.run.smithi008.stdout: "tid": 3170 2023-08-01T19:54:28.521 INFO:teuthology.orchestra.run.smithi008.stdout: }, 2023-08-01T19:54:28.521 INFO:teuthology.orchestra.run.smithi008.stdout: "events": [ 2023-08-01T19:54:28.522 INFO:teuthology.orchestra.run.smithi008.stdout: { 2023-08-01T19:54:28.522 INFO:teuthology.orchestra.run.smithi008.stdout: "event": "initiated", 2023-08-01T19:54:28.522 INFO:teuthology.orchestra.run.smithi008.stdout: "time": "2023-08-01T19:54:25.028298+0000", 2023-08-01T19:54:28.523 INFO:teuthology.orchestra.run.smithi008.stdout: "duration": 0 2023-08-01T19:54:28.523 INFO:teuthology.orchestra.run.smithi008.stdout: }, 2023-08-01T19:54:28.523 INFO:teuthology.orchestra.run.smithi008.stdout: { 2023-08-01T19:54:28.523 INFO:teuthology.orchestra.run.smithi008.stdout: "event": "throttled", 2023-08-01T19:54:28.523 INFO:teuthology.orchestra.run.smithi008.stdout: "time": "2023-08-01T19:54:25.028298+0000", 2023-08-01T19:54:28.523 INFO:teuthology.orchestra.run.smithi008.stdout: "duration": 0 2023-08-01T19:54:28.524 INFO:teuthology.orchestra.run.smithi008.stdout: }, 2023-08-01T19:54:28.524 INFO:teuthology.orchestra.run.smithi008.stdout: { 2023-08-01T19:54:28.524 INFO:teuthology.orchestra.run.smithi008.stdout: "event": "header_read", 2023-08-01T19:54:28.524 INFO:teuthology.orchestra.run.smithi008.stdout: "time": "2023-08-01T19:54:25.028298+0000", 2023-08-01T19:54:28.524 INFO:teuthology.orchestra.run.smithi008.stdout: "duration": 4294967295.9999995 2023-08-01T19:54:28.524 INFO:teuthology.orchestra.run.smithi008.stdout: }, 2023-08-01T19:54:28.524 INFO:teuthology.orchestra.run.smithi008.stdout: { 2023-08-01T19:54:28.525 INFO:teuthology.orchestra.run.smithi008.stdout: "event": "all_read", 2023-08-01T19:54:28.525 INFO:teuthology.orchestra.run.smithi008.stdout: "time": "2023-08-01T19:54:25.028462+0000", 2023-08-01T19:54:28.525 INFO:teuthology.orchestra.run.smithi008.stdout: "duration": 0.000163857 2023-08-01T19:54:28.525 INFO:teuthology.orchestra.run.smithi008.stdout: }, 2023-08-01T19:54:28.526 INFO:teuthology.orchestra.run.smithi008.stdout: { 2023-08-01T19:54:28.526 INFO:teuthology.orchestra.run.smithi008.stdout: "event": "dispatched", 2023-08-01T19:54:28.526 INFO:teuthology.orchestra.run.smithi008.stdout: "time": "2023-08-01T19:54:25.028474+0000", 2023-08-01T19:54:28.526 INFO:teuthology.orchestra.run.smithi008.stdout: "duration": 1.2132e-05 2023-08-01T19:54:28.526 INFO:teuthology.orchestra.run.smithi008.stdout: }, 2023-08-01T19:54:28.526 INFO:teuthology.orchestra.run.smithi008.stdout: { 2023-08-01T19:54:28.526 INFO:teuthology.orchestra.run.smithi008.stdout: "event": "queued_for_pg", 2023-08-01T19:54:28.527 INFO:teuthology.orchestra.run.smithi008.stdout: "time": "2023-08-01T19:54:25.028479+0000", 2023-08-01T19:54:28.527 INFO:teuthology.orchestra.run.smithi008.stdout: "duration": 5.6380000000000001e-06 2023-08-01T19:54:28.527 INFO:teuthology.orchestra.run.smithi008.stdout: }, 2023-08-01T19:54:28.527 INFO:teuthology.orchestra.run.smithi008.stdout: { 2023-08-01T19:54:28.527 INFO:teuthology.orchestra.run.smithi008.stdout: "event": "reached_pg", 2023-08-01T19:54:28.527 INFO:teuthology.orchestra.run.smithi008.stdout: "time": "2023-08-01T19:54:25.029144+0000", 2023-08-01T19:54:28.527 INFO:teuthology.orchestra.run.smithi008.stdout: "duration": 0.00066446500000000004 2023-08-01T19:54:28.528 INFO:teuthology.orchestra.run.smithi008.stdout: }, 2023-08-01T19:54:28.528 INFO:teuthology.orchestra.run.smithi008.stdout: { 2023-08-01T19:54:28.528 INFO:teuthology.orchestra.run.smithi008.stdout: "event": "started", 2023-08-01T19:54:28.528 INFO:teuthology.orchestra.run.smithi008.stdout: "time": "2023-08-01T19:54:25.029270+0000", 2023-08-01T19:54:28.528 INFO:teuthology.orchestra.run.smithi008.stdout: "duration": 0.00012600799999999999 2023-08-01T19:54:28.528 INFO:teuthology.orchestra.run.smithi008.stdout: }, 2023-08-01T19:54:28.528 INFO:teuthology.orchestra.run.smithi008.stdout: { 2023-08-01T19:54:28.529 INFO:teuthology.orchestra.run.smithi008.stdout: "event": "waiting for subops from 1", 2023-08-01T19:54:28.529 INFO:teuthology.orchestra.run.smithi008.stdout: "time": "2023-08-01T19:54:25.029432+0000", 2023-08-01T19:54:28.529 INFO:teuthology.orchestra.run.smithi008.stdout: "duration": 0.00016172300000000001 2023-08-01T19:54:28.529 INFO:teuthology.orchestra.run.smithi008.stdout: }, 2023-08-01T19:54:28.529 INFO:teuthology.orchestra.run.smithi008.stdout: { 2023-08-01T19:54:28.529 INFO:teuthology.orchestra.run.smithi008.stdout: "event": "op_commit", 2023-08-01T19:54:28.530 INFO:teuthology.orchestra.run.smithi008.stdout: "time": "2023-08-01T19:54:25.030647+0000", 2023-08-01T19:54:28.530 INFO:teuthology.orchestra.run.smithi008.stdout: "duration": 0.001215521 2023-08-01T19:54:28.530 INFO:teuthology.orchestra.run.smithi008.stdout: }, 2023-08-01T19:54:28.530 INFO:teuthology.orchestra.run.smithi008.stdout: { 2023-08-01T19:54:28.530 INFO:teuthology.orchestra.run.smithi008.stdout: "event": "sub_op_commit_rec", 2023-08-01T19:54:28.530 INFO:teuthology.orchestra.run.smithi008.stdout: "time": "2023-08-01T19:54:25.036573+0000", 2023-08-01T19:54:28.530 INFO:teuthology.orchestra.run.smithi008.stdout: "duration": 0.0059261100000000001 2023-08-01T19:54:28.530 INFO:teuthology.orchestra.run.smithi008.stdout: }, 2023-08-01T19:54:28.531 INFO:teuthology.orchestra.run.smithi008.stdout: { 2023-08-01T19:54:28.531 INFO:teuthology.orchestra.run.smithi008.stdout: "event": "commit_sent", 2023-08-01T19:54:28.531 INFO:teuthology.orchestra.run.smithi008.stdout: "time": "2023-08-01T19:54:25.036617+0000", 2023-08-01T19:54:28.531 INFO:teuthology.orchestra.run.smithi008.stdout: "duration": 4.3310999999999999e-05 2023-08-01T19:54:28.531 INFO:teuthology.orchestra.run.smithi008.stdout: }, 2023-08-01T19:54:28.531 INFO:teuthology.orchestra.run.smithi008.stdout: { 2023-08-01T19:54:28.531 INFO:teuthology.orchestra.run.smithi008.stdout: "event": "done", 2023-08-01T19:54:28.532 INFO:teuthology.orchestra.run.smithi008.stdout: "time": "2023-08-01T19:54:25.036660+0000", 2023-08-01T19:54:28.532 INFO:teuthology.orchestra.run.smithi008.stdout: "duration": 4.3102000000000002e-05 2023-08-01T19:54:28.532 INFO:teuthology.orchestra.run.smithi008.stdout: } 2023-08-01T19:54:28.532 INFO:teuthology.orchestra.run.smithi008.stdout: ] 2023-08-01T19:54:28.532 INFO:teuthology.orchestra.run.smithi008.stdout: } 2023-08-01T19:54:28.533 INFO:teuthology.orchestra.run.smithi008.stdout: }, 2023-08-01T19:54:28.533 INFO:teuthology.orchestra.run.smithi008.stdout: { 2023-08-01T19:54:28.533 INFO:teuthology.orchestra.run.smithi008.stdout: "description": "osd_op(client.4668.0:14630 5.6 5:67bc363e:::benchmark_data_smithi006_114134_object14629:head [set-alloc-hint object_size 65536 write_size 65536,write 0~65536] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e22)", 2023-08-01T19:54:28.533 INFO:teuthology.orchestra.run.smithi008.stdout: "initiated_at": "2023-08-01T19:54:27.941545+0000", 2023-08-01T19:54:28.534 INFO:teuthology.orchestra.run.smithi008.stdout: "age": 0.39342897199999999, 2023-08-01T19:54:28.534 INFO:teuthology.orchestra.run.smithi008.stdout: "duration": 0.0092248499999999997, 2023-08-01T19:54:28.534 INFO:teuthology.orchestra.run.smithi008.stdout: "type_data": { 2023-08-01T19:54:28.535 INFO:teuthology.orchestra.run.smithi008.stdout: "flag_point": "commit sent; apply or cleanup", 2023-08-01T19:54:28.535 INFO:teuthology.orchestra.run.smithi008.stdout: "client_info": { 2023-08-01T19:54:28.535 INFO:teuthology.orchestra.run.smithi008.stdout: "client": "client.4668", 2023-08-01T19:54:28.535 INFO:teuthology.orchestra.run.smithi008.stdout: "client_addr": "172.21.15.6:0/1709472247", 2023-08-01T19:54:28.536 INFO:teuthology.orchestra.run.smithi008.stdout: "tid": 14630 2023-08-01T19:54:28.536 INFO:teuthology.orchestra.run.smithi008.stdout: }, 2023-08-01T19:54:28.536 INFO:teuthology.orchestra.run.smithi008.stdout: "events": [ 2023-08-01T19:54:28.536 INFO:teuthology.orchestra.run.smithi008.stdout: { 2023-08-01T19:54:28.537 INFO:teuthology.orchestra.run.smithi008.stdout: "event": "initiated", 2023-08-01T19:54:28.537 INFO:teuthology.orchestra.run.smithi008.stdout: "time": "2023-08-01T19:54:27.941545+0000", 2023-08-01T19:54:28.537 INFO:teuthology.orchestra.run.smithi008.stdout: "duration": 0 2023-08-01T19:54:28.537 INFO:teuthology.orchestra.run.smithi008.stdout: }, 2023-08-01T19:54:28.538 INFO:teuthology.orchestra.run.smithi008.stdout: { 2023-08-01T19:54:28.538 INFO:teuthology.orchestra.run.smithi008.stdout: "event": "throttled", 2023-08-01T19:54:28.538 INFO:teuthology.orchestra.run.smithi008.stdout: "time": "2023-08-01T19:54:27.941545+0000", 2023-08-01T19:54:28.539 INFO:teuthology.orchestra.run.smithi008.stdout: "duration": 0 2023-08-01T19:54:28.539 INFO:teuthology.orchestra.run.smithi008.stdout: }, 2023-08-01T19:54:28.539 INFO:teuthology.orchestra.run.smithi008.stdout: { 2023-08-01T19:54:28.539 INFO:teuthology.orchestra.run.smithi008.stdout: "event": "header_read", 2023-08-01T19:54:28.540 INFO:teuthology.orchestra.run.smithi008.stdout: "time": "2023-08-01T19:54:27.941544+0000", 2023-08-01T19:54:28.540 INFO:teuthology.orchestra.run.smithi008.stdout: "duration": 4294967295.999999 2023-08-01T19:54:28.540 INFO:teuthology.orchestra.run.smithi008.stdout: }, 2023-08-01T19:54:28.540 INFO:teuthology.orchestra.run.smithi008.stdout: { 2023-08-01T19:54:28.540 INFO:teuthology.orchestra.run.smithi008.stdout: "event": "all_read", 2023-08-01T19:54:28.540 INFO:teuthology.orchestra.run.smithi008.stdout: "time": "2023-08-01T19:54:27.941572+0000", 2023-08-01T19:54:28.540 INFO:teuthology.orchestra.run.smithi008.stdout: "duration": 2.8276000000000002e-05 2023-08-01T19:54:28.541 INFO:teuthology.orchestra.run.smithi008.stdout: }, 2023-08-01T19:54:28.541 INFO:teuthology.orchestra.run.smithi008.stdout: { 2023-08-01T19:54:28.541 INFO:teuthology.orchestra.run.smithi008.stdout: "event": "dispatched", 2023-08-01T19:54:28.541 INFO:teuthology.orchestra.run.smithi008.stdout: "time": "2023-08-01T19:54:27.941583+0000", 2023-08-01T19:54:28.541 INFO:teuthology.orchestra.run.smithi008.stdout: "duration": 1.063e-05 2023-08-01T19:54:28.541 INFO:teuthology.orchestra.run.smithi008.stdout: }, 2023-08-01T19:54:28.541 INFO:teuthology.orchestra.run.smithi008.stdout: { 2023-08-01T19:54:28.542 INFO:teuthology.orchestra.run.smithi008.stdout: "event": "queued_for_pg", 2023-08-01T19:54:28.542 INFO:teuthology.orchestra.run.smithi008.stdout: "time": "2023-08-01T19:54:27.941589+0000", 2023-08-01T19:54:28.542 INFO:teuthology.orchestra.run.smithi008.stdout: "duration": 6.2890000000000003e-06 2023-08-01T19:54:28.542 INFO:teuthology.orchestra.run.smithi008.stdout: }, 2023-08-01T19:54:28.542 INFO:teuthology.orchestra.run.smithi008.stdout: { 2023-08-01T19:54:28.542 INFO:teuthology.orchestra.run.smithi008.stdout: "event": "reached_pg", 2023-08-01T19:54:28.542 INFO:teuthology.orchestra.run.smithi008.stdout: "time": "2023-08-01T19:54:27.941772+0000", 2023-08-01T19:54:28.543 INFO:teuthology.orchestra.run.smithi008.stdout: "duration": 0.00018343 2023-08-01T19:54:28.543 INFO:teuthology.orchestra.run.smithi008.stdout: }, 2023-08-01T19:54:28.543 INFO:teuthology.orchestra.run.smithi008.stdout: { 2023-08-01T19:54:28.543 INFO:teuthology.orchestra.run.smithi008.stdout: "event": "started", 2023-08-01T19:54:28.543 INFO:teuthology.orchestra.run.smithi008.stdout: "time": "2023-08-01T19:54:27.941875+0000", 2023-08-01T19:54:28.543 INFO:teuthology.orchestra.run.smithi008.stdout: "duration": 0.00010309100000000001 2023-08-01T19:54:28.543 INFO:teuthology.orchestra.run.smithi008.stdout: }, 2023-08-01T19:54:28.544 INFO:teuthology.orchestra.run.smithi008.stdout: { 2023-08-01T19:54:28.544 INFO:teuthology.orchestra.run.smithi008.stdout: "event": "waiting for subops from 1", 2023-08-01T19:54:28.544 INFO:teuthology.orchestra.run.smithi008.stdout: "time": "2023-08-01T19:54:27.941994+0000", 2023-08-01T19:54:28.544 INFO:teuthology.orchestra.run.smithi008.stdout: "duration": 0.000118916 2023-08-01T19:54:28.544 INFO:teuthology.orchestra.run.smithi008.stdout: }, 2023-08-01T19:54:28.544 INFO:teuthology.orchestra.run.smithi008.stdout: { 2023-08-01T19:54:28.544 INFO:teuthology.orchestra.run.smithi008.stdout: "event": "op_commit", 2023-08-01T19:54:28.545 INFO:teuthology.orchestra.run.smithi008.stdout: "time": "2023-08-01T19:54:27.945743+0000", 2023-08-01T19:54:28.545 INFO:teuthology.orchestra.run.smithi008.stdout: "duration": 0.0037486580000000002 2023-08-01T19:54:28.545 INFO:teuthology.orchestra.run.smithi008.stdout: }, 2023-08-01T19:54:28.545 INFO:teuthology.orchestra.run.smithi008.stdout: { 2023-08-01T19:54:28.545 INFO:teuthology.orchestra.run.smithi008.stdout: "event": "sub_op_commit_rec", 2023-08-01T19:54:28.546 INFO:teuthology.orchestra.run.smithi008.stdout: "time": "2023-08-01T19:54:27.950676+0000", 2023-08-01T19:54:28.546 INFO:teuthology.orchestra.run.smithi008.stdout: "duration": 0.0049327640000000001 2023-08-01T19:54:28.546 INFO:teuthology.orchestra.run.smithi008.stdout: }, 2023-08-01T19:54:28.546 INFO:teuthology.orchestra.run.smithi008.stdout: { 2023-08-01T19:54:28.546 INFO:teuthology.orchestra.run.smithi008.stdout: "event": "commit_sent", 2023-08-01T19:54:28.547 INFO:teuthology.orchestra.run.smithi008.stdout: "time": "2023-08-01T19:54:27.950731+0000", 2023-08-01T19:54:28.547 INFO:teuthology.orchestra.run.smithi008.stdout: "duration": 5.5365999999999998e-05 2023-08-01T19:54:28.547 INFO:teuthology.orchestra.run.smithi008.stdout: }, 2023-08-01T19:54:28.547 INFO:teuthology.orchestra.run.smithi008.stdout: { 2023-08-01T19:54:28.547 INFO:teuthology.orchestra.run.smithi008.stdout: "event": "done", 2023-08-01T19:54:28.547 INFO:teuthology.orchestra.run.smithi008.stdout: "time": "2023-08-01T19:54:27.950769+0000", 2023-08-01T19:54:28.547 INFO:teuthology.orchestra.run.smithi008.stdout: "duration": 3.8390999999999999e-05 2023-08-01T19:54:28.548 INFO:teuthology.orchestra.run.smithi008.stdout: } 2023-08-01T19:54:28.548 INFO:teuthology.orchestra.run.smithi008.stdout: ] 2023-08-01T19:54:28.548 INFO:teuthology.orchestra.run.smithi008.stdout: } 2023-08-01T19:54:28.548 INFO:teuthology.orchestra.run.smithi008.stdout: }, 2023-08-01T19:54:28.548 INFO:teuthology.orchestra.run.smithi008.stdout: { 2023-08-01T19:54:28.548 INFO:teuthology.orchestra.run.smithi008.stdout: "description": "osd_op(client.4668.0:14632 5.c 5:3aa1a0e6:::benchmark_data_smithi006_114134_object14631:head [set-alloc-hint object_size 65536 write_size 65536,write 0~65536] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e22)", 2023-08-01T19:54:28.549 INFO:teuthology.orchestra.run.smithi008.stdout: "initiated_at": "2023-08-01T19:54:27.941839+0000", 2023-08-01T19:54:28.549 INFO:teuthology.orchestra.run.smithi008.stdout: "age": 0.393134608, 2023-08-01T19:54:28.549 INFO:teuthology.orchestra.run.smithi008.stdout: "duration": 0.0089967950000000001, 2023-08-01T19:54:28.549 INFO:teuthology.orchestra.run.smithi008.stdout: "type_data": { 2023-08-01T19:54:28.549 INFO:teuthology.orchestra.run.smithi008.stdout: "flag_point": "commit sent; apply or cleanup", 2023-08-01T19:54:28.549 INFO:teuthology.orchestra.run.smithi008.stdout: "client_info": { 2023-08-01T19:54:28.549 INFO:teuthology.orchestra.run.smithi008.stdout: "client": "client.4668", 2023-08-01T19:54:28.549 INFO:teuthology.orchestra.run.smithi008.stdout: "client_addr": "172.21.15.6:0/1709472247", 2023-08-01T19:54:28.550 INFO:teuthology.orchestra.run.smithi008.stdout: "tid": 14632 2023-08-01T19:54:28.550 INFO:teuthology.orchestra.run.smithi008.stdout: }, 2023-08-01T19:54:28.550 INFO:teuthology.orchestra.run.smithi008.stdout: "events": [ 2023-08-01T19:54:28.550 INFO:teuthology.orchestra.run.smithi008.stdout: { 2023-08-01T19:54:28.550 INFO:teuthology.orchestra.run.smithi008.stdout: "event": "initiated", 2023-08-01T19:54:28.550 INFO:teuthology.orchestra.run.smithi008.stdout: "time": "2023-08-01T19:54:27.941839+0000", 2023-08-01T19:54:28.550 INFO:teuthology.orchestra.run.smithi008.stdout: "duration": 0 2023-08-01T19:54:28.551 INFO:teuthology.orchestra.run.smithi008.stdout: }, 2023-08-01T19:54:28.551 INFO:teuthology.orchestra.run.smithi008.stdout: { 2023-08-01T19:54:28.551 INFO:teuthology.orchestra.run.smithi008.stdout: "event": "throttled", 2023-08-01T19:54:28.551 INFO:teuthology.orchestra.run.smithi008.stdout: "time": "2023-08-01T19:54:27.941839+0000", 2023-08-01T19:54:28.551 INFO:teuthology.orchestra.run.smithi008.stdout: "duration": 0 2023-08-01T19:54:28.551 INFO:teuthology.orchestra.run.smithi008.stdout: }, 2023-08-01T19:54:28.551 INFO:teuthology.orchestra.run.smithi008.stdout: { 2023-08-01T19:54:28.552 INFO:teuthology.orchestra.run.smithi008.stdout: "event": "header_read", 2023-08-01T19:54:28.552 INFO:teuthology.orchestra.run.smithi008.stdout: "time": "2023-08-01T19:54:27.941838+0000", 2023-08-01T19:54:28.552 INFO:teuthology.orchestra.run.smithi008.stdout: "duration": 4294967295.999999 2023-08-01T19:54:28.552 INFO:teuthology.orchestra.run.smithi008.stdout: }, 2023-08-01T19:54:28.553 INFO:teuthology.orchestra.run.smithi008.stdout: { 2023-08-01T19:54:28.553 INFO:teuthology.orchestra.run.smithi008.stdout: "event": "all_read", 2023-08-01T19:54:28.553 INFO:teuthology.orchestra.run.smithi008.stdout: "time": "2023-08-01T19:54:27.941873+0000", 2023-08-01T19:54:28.553 INFO:teuthology.orchestra.run.smithi008.stdout: "duration": 3.5142999999999999e-05 2023-08-01T19:54:28.553 INFO:teuthology.orchestra.run.smithi008.stdout: }, 2023-08-01T19:54:28.553 INFO:teuthology.orchestra.run.smithi008.stdout: { 2023-08-01T19:54:28.553 INFO:teuthology.orchestra.run.smithi008.stdout: "event": "dispatched", 2023-08-01T19:54:28.554 INFO:teuthology.orchestra.run.smithi008.stdout: "time": "2023-08-01T19:54:27.941884+0000", 2023-08-01T19:54:28.554 INFO:teuthology.orchestra.run.smithi008.stdout: "duration": 1.0159999999999999e-05 2023-08-01T19:54:28.554 INFO:teuthology.orchestra.run.smithi008.stdout: }, 2023-08-01T19:54:28.554 INFO:teuthology.orchestra.run.smithi008.stdout: { 2023-08-01T19:54:28.554 INFO:teuthology.orchestra.run.smithi008.stdout: "event": "queued_for_pg", 2023-08-01T19:54:28.554 INFO:teuthology.orchestra.run.smithi008.stdout: "time": "2023-08-01T19:54:27.941888+0000", 2023-08-01T19:54:28.554 INFO:teuthology.orchestra.run.smithi008.stdout: "duration": 4.476e-06 2023-08-01T19:54:28.555 INFO:teuthology.orchestra.run.smithi008.stdout: }, 2023-08-01T19:54:28.555 INFO:teuthology.orchestra.run.smithi008.stdout: { 2023-08-01T19:54:28.555 INFO:teuthology.orchestra.run.smithi008.stdout: "event": "reached_pg", 2023-08-01T19:54:28.555 INFO:teuthology.orchestra.run.smithi008.stdout: "time": "2023-08-01T19:54:27.941925+0000", 2023-08-01T19:54:28.555 INFO:teuthology.orchestra.run.smithi008.stdout: "duration": 3.7342999999999998e-05 2023-08-01T19:54:28.555 INFO:teuthology.orchestra.run.smithi008.stdout: }, 2023-08-01T19:54:28.555 INFO:teuthology.orchestra.run.smithi008.stdout: { 2023-08-01T19:54:28.556 INFO:teuthology.orchestra.run.smithi008.stdout: "event": "started", 2023-08-01T19:54:28.556 INFO:teuthology.orchestra.run.smithi008.stdout: "time": "2023-08-01T19:54:27.942037+0000", 2023-08-01T19:54:28.556 INFO:teuthology.orchestra.run.smithi008.stdout: "duration": 0.000111555 2023-08-01T19:54:28.556 INFO:teuthology.orchestra.run.smithi008.stdout: }, 2023-08-01T19:54:28.556 INFO:teuthology.orchestra.run.smithi008.stdout: { 2023-08-01T19:54:28.556 INFO:teuthology.orchestra.run.smithi008.stdout: "event": "waiting for subops from 1", 2023-08-01T19:54:28.556 INFO:teuthology.orchestra.run.smithi008.stdout: "time": "2023-08-01T19:54:27.942166+0000", 2023-08-01T19:54:28.557 INFO:teuthology.orchestra.run.smithi008.stdout: "duration": 0.00012908900000000001 2023-08-01T19:54:28.557 INFO:teuthology.orchestra.run.smithi008.stdout: }, 2023-08-01T19:54:28.557 INFO:teuthology.orchestra.run.smithi008.stdout: { 2023-08-01T19:54:28.557 INFO:teuthology.orchestra.run.smithi008.stdout: "event": "op_commit", 2023-08-01T19:54:28.557 INFO:teuthology.orchestra.run.smithi008.stdout: "time": "2023-08-01T19:54:27.945851+0000", 2023-08-01T19:54:28.557 INFO:teuthology.orchestra.run.smithi008.stdout: "duration": 0.0036849830000000002 2023-08-01T19:54:28.557 INFO:teuthology.orchestra.run.smithi008.stdout: }, 2023-08-01T19:54:28.558 INFO:teuthology.orchestra.run.smithi008.stdout: { 2023-08-01T19:54:28.558 INFO:teuthology.orchestra.run.smithi008.stdout: "event": "sub_op_commit_rec", 2023-08-01T19:54:28.558 INFO:teuthology.orchestra.run.smithi008.stdout: "time": "2023-08-01T19:54:27.950745+0000", 2023-08-01T19:54:28.558 INFO:teuthology.orchestra.run.smithi008.stdout: "duration": 0.0048942029999999997 2023-08-01T19:54:28.558 INFO:teuthology.orchestra.run.smithi008.stdout: }, 2023-08-01T19:54:28.558 INFO:teuthology.orchestra.run.smithi008.stdout: { 2023-08-01T19:54:28.558 INFO:teuthology.orchestra.run.smithi008.stdout: "event": "commit_sent", 2023-08-01T19:54:28.559 INFO:teuthology.orchestra.run.smithi008.stdout: "time": "2023-08-01T19:54:27.950797+0000", 2023-08-01T19:54:28.559 INFO:teuthology.orchestra.run.smithi008.stdout: "duration": 5.1833999999999999e-05 2023-08-01T19:54:28.559 INFO:teuthology.orchestra.run.smithi008.stdout: }, 2023-08-01T19:54:28.559 INFO:teuthology.orchestra.run.smithi008.stdout: { 2023-08-01T19:54:28.560 INFO:teuthology.orchestra.run.smithi008.stdout: "event": "done", 2023-08-01T19:54:28.560 INFO:teuthology.orchestra.run.smithi008.stdout: "time": "2023-08-01T19:54:27.950836+0000", 2023-08-01T19:54:28.560 INFO:teuthology.orchestra.run.smithi008.stdout: "duration": 3.8729999999999997e-05 2023-08-01T19:54:28.561 INFO:teuthology.orchestra.run.smithi008.stdout: } 2023-08-01T19:54:28.561 INFO:teuthology.orchestra.run.smithi008.stdout: ] 2023-08-01T19:54:28.561 INFO:teuthology.orchestra.run.smithi008.stdout: } 2023-08-01T19:54:28.561 INFO:teuthology.orchestra.run.smithi008.stdout: }, 2023-08-01T19:54:28.562 INFO:teuthology.orchestra.run.smithi008.stdout: { 2023-08-01T19:54:28.562 INFO:teuthology.orchestra.run.smithi008.stdout: "description": "osd_op(client.4668.0:14633 5.6 5:628c1b70:::benchmark_data_smithi006_114134_object14632:head [set-alloc-hint object_size 65536 write_size 65536,write 0~65536] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e22)", 2023-08-01T19:54:28.562 INFO:teuthology.orchestra.run.smithi008.stdout: "initiated_at": "2023-08-01T19:54:27.941895+0000", 2023-08-01T19:54:28.562 INFO:teuthology.orchestra.run.smithi008.stdout: "age": 0.39307845600000002, 2023-08-01T19:54:28.563 INFO:teuthology.orchestra.run.smithi008.stdout: "duration": 0.0090076670000000005, 2023-08-01T19:54:28.563 INFO:teuthology.orchestra.run.smithi008.stdout: "type_data": { 2023-08-01T19:54:28.563 INFO:teuthology.orchestra.run.smithi008.stdout: "flag_point": "commit sent; apply or cleanup", 2023-08-01T19:54:28.563 INFO:teuthology.orchestra.run.smithi008.stdout: "client_info": { 2023-08-01T19:54:28.563 INFO:teuthology.orchestra.run.smithi008.stdout: "client": "client.4668", 2023-08-01T19:54:28.564 INFO:teuthology.orchestra.run.smithi008.stdout: "client_addr": "172.21.15.6:0/1709472247", 2023-08-01T19:54:28.564 INFO:teuthology.orchestra.run.smithi008.stdout: "tid": 14633 2023-08-01T19:54:28.564 INFO:teuthology.orchestra.run.smithi008.stdout: }, 2023-08-01T19:54:28.564 INFO:teuthology.orchestra.run.smithi008.stdout: "events": [ 2023-08-01T19:54:28.564 INFO:teuthology.orchestra.run.smithi008.stdout: { 2023-08-01T19:54:28.564 INFO:teuthology.orchestra.run.smithi008.stdout: "event": "initiated", 2023-08-01T19:54:28.564 INFO:teuthology.orchestra.run.smithi008.stdout: "time": "2023-08-01T19:54:27.941895+0000", 2023-08-01T19:54:28.565 INFO:teuthology.orchestra.run.smithi008.stdout: "duration": 0 2023-08-01T19:54:28.565 INFO:teuthology.orchestra.run.smithi008.stdout: }, 2023-08-01T19:54:28.565 INFO:teuthology.orchestra.run.smithi008.stdout: { 2023-08-01T19:54:28.565 INFO:teuthology.orchestra.run.smithi008.stdout: "event": "throttled", 2023-08-01T19:54:28.565 INFO:teuthology.orchestra.run.smithi008.stdout: "time": "2023-08-01T19:54:27.941895+0000", 2023-08-01T19:54:28.565 INFO:teuthology.orchestra.run.smithi008.stdout: "duration": 0 2023-08-01T19:54:28.565 INFO:teuthology.orchestra.run.smithi008.stdout: }, 2023-08-01T19:54:28.566 INFO:teuthology.orchestra.run.smithi008.stdout: { 2023-08-01T19:54:28.566 INFO:teuthology.orchestra.run.smithi008.stdout: "event": "header_read", 2023-08-01T19:54:28.566 INFO:teuthology.orchestra.run.smithi008.stdout: "time": "2023-08-01T19:54:27.941895+0000", 2023-08-01T19:54:28.566 INFO:teuthology.orchestra.run.smithi008.stdout: "duration": 4294967295.9999995 2023-08-01T19:54:28.566 INFO:teuthology.orchestra.run.smithi008.stdout: }, 2023-08-01T19:54:28.567 INFO:teuthology.orchestra.run.smithi008.stdout: { 2023-08-01T19:54:28.567 INFO:teuthology.orchestra.run.smithi008.stdout: "event": "all_read", 2023-08-01T19:54:28.567 INFO:teuthology.orchestra.run.smithi008.stdout: "time": "2023-08-01T19:54:27.941926+0000", 2023-08-01T19:54:28.567 INFO:teuthology.orchestra.run.smithi008.stdout: "duration": 3.1028000000000002e-05 2023-08-01T19:54:28.567 INFO:teuthology.orchestra.run.smithi008.stdout: }, 2023-08-01T19:54:28.567 INFO:teuthology.orchestra.run.smithi008.stdout: { 2023-08-01T19:54:28.568 INFO:teuthology.orchestra.run.smithi008.stdout: "event": "dispatched", 2023-08-01T19:54:28.568 INFO:teuthology.orchestra.run.smithi008.stdout: "time": "2023-08-01T19:54:27.941935+0000", 2023-08-01T19:54:28.568 INFO:teuthology.orchestra.run.smithi008.stdout: "duration": 8.8249999999999994e-06 2023-08-01T19:54:28.568 INFO:teuthology.orchestra.run.smithi008.stdout: }, 2023-08-01T19:54:28.568 INFO:teuthology.orchestra.run.smithi008.stdout: { 2023-08-01T19:54:28.568 INFO:teuthology.orchestra.run.smithi008.stdout: "event": "queued_for_pg", 2023-08-01T19:54:28.568 INFO:teuthology.orchestra.run.smithi008.stdout: "time": "2023-08-01T19:54:27.941939+0000", 2023-08-01T19:54:28.569 INFO:teuthology.orchestra.run.smithi008.stdout: "duration": 4.6530000000000002e-06 2023-08-01T19:54:28.569 INFO:teuthology.orchestra.run.smithi008.stdout: }, 2023-08-01T19:54:28.569 INFO:teuthology.orchestra.run.smithi008.stdout: { 2023-08-01T19:54:28.569 INFO:teuthology.orchestra.run.smithi008.stdout: "event": "reached_pg", 2023-08-01T19:54:28.569 INFO:teuthology.orchestra.run.smithi008.stdout: "time": "2023-08-01T19:54:27.942878+0000", 2023-08-01T19:54:28.569 INFO:teuthology.orchestra.run.smithi008.stdout: "duration": 0.00093848800000000002 2023-08-01T19:54:28.569 INFO:teuthology.orchestra.run.smithi008.stdout: }, 2023-08-01T19:54:28.569 INFO:teuthology.orchestra.run.smithi008.stdout: { 2023-08-01T19:54:28.570 INFO:teuthology.orchestra.run.smithi008.stdout: "event": "started", 2023-08-01T19:54:28.570 INFO:teuthology.orchestra.run.smithi008.stdout: "time": "2023-08-01T19:54:27.942996+0000", 2023-08-01T19:54:28.570 INFO:teuthology.orchestra.run.smithi008.stdout: "duration": 0.000118239 2023-08-01T19:54:28.570 INFO:teuthology.orchestra.run.smithi008.stdout: }, 2023-08-01T19:54:28.570 INFO:teuthology.orchestra.run.smithi008.stdout: { 2023-08-01T19:54:28.570 INFO:teuthology.orchestra.run.smithi008.stdout: "event": "waiting for subops from 1", 2023-08-01T19:54:28.570 INFO:teuthology.orchestra.run.smithi008.stdout: "time": "2023-08-01T19:54:27.943127+0000", 2023-08-01T19:54:28.571 INFO:teuthology.orchestra.run.smithi008.stdout: "duration": 0.00013097400000000001 2023-08-01T19:54:28.571 INFO:teuthology.orchestra.run.smithi008.stdout: }, 2023-08-01T19:54:28.571 INFO:teuthology.orchestra.run.smithi008.stdout: { 2023-08-01T19:54:28.571 INFO:teuthology.orchestra.run.smithi008.stdout: "event": "op_commit", 2023-08-01T19:54:28.571 INFO:teuthology.orchestra.run.smithi008.stdout: "time": "2023-08-01T19:54:27.946557+0000", 2023-08-01T19:54:28.571 INFO:teuthology.orchestra.run.smithi008.stdout: "duration": 0.0034294970000000001 2023-08-01T19:54:28.572 INFO:teuthology.orchestra.run.smithi008.stdout: }, 2023-08-01T19:54:28.572 INFO:teuthology.orchestra.run.smithi008.stdout: { 2023-08-01T19:54:28.572 INFO:teuthology.orchestra.run.smithi008.stdout: "event": "sub_op_commit_rec", 2023-08-01T19:54:28.573 INFO:teuthology.orchestra.run.smithi008.stdout: "time": "2023-08-01T19:54:27.950812+0000", 2023-08-01T19:54:28.573 INFO:teuthology.orchestra.run.smithi008.stdout: "duration": 0.0042552520000000002 2023-08-01T19:54:28.573 INFO:teuthology.orchestra.run.smithi008.stdout: }, 2023-08-01T19:54:28.573 INFO:teuthology.orchestra.run.smithi008.stdout: { 2023-08-01T19:54:28.574 INFO:teuthology.orchestra.run.smithi008.stdout: "event": "commit_sent", 2023-08-01T19:54:28.574 INFO:teuthology.orchestra.run.smithi008.stdout: "time": "2023-08-01T19:54:27.950875+0000", 2023-08-01T19:54:28.574 INFO:teuthology.orchestra.run.smithi008.stdout: "duration": 6.3170999999999995e-05 2023-08-01T19:54:28.574 INFO:teuthology.orchestra.run.smithi008.stdout: }, 2023-08-01T19:54:28.575 INFO:teuthology.orchestra.run.smithi008.stdout: { 2023-08-01T19:54:28.575 INFO:teuthology.orchestra.run.smithi008.stdout: "event": "done", 2023-08-01T19:54:28.575 INFO:teuthology.orchestra.run.smithi008.stdout: "time": "2023-08-01T19:54:27.950903+0000", 2023-08-01T19:54:28.576 INFO:teuthology.orchestra.run.smithi008.stdout: "duration": 2.7861999999999999e-05 2023-08-01T19:54:28.576 INFO:teuthology.orchestra.run.smithi008.stdout: } 2023-08-01T19:54:28.576 INFO:teuthology.orchestra.run.smithi008.stdout: ] 2023-08-01T19:54:28.576 INFO:teuthology.orchestra.run.smithi008.stdout: } 2023-08-01T19:54:28.577 INFO:teuthology.orchestra.run.smithi008.stdout: }, 2023-08-01T19:54:28.577 INFO:teuthology.orchestra.run.smithi008.stdout: { 2023-08-01T19:54:28.577 INFO:teuthology.orchestra.run.smithi008.stdout: "description": "osd_op(client.4668.0:14635 5.6 5:62488cc2:::benchmark_data_smithi006_114134_object14634:head [set-alloc-hint object_size 65536 write_size 65536,write 0~65536] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e22)", 2023-08-01T19:54:28.577 INFO:teuthology.orchestra.run.smithi008.stdout: "initiated_at": "2023-08-01T19:54:27.942161+0000", 2023-08-01T19:54:28.578 INFO:teuthology.orchestra.run.smithi008.stdout: "age": 0.39281254799999998, 2023-08-01T19:54:28.578 INFO:teuthology.orchestra.run.smithi008.stdout: "duration": 0.0091774539999999998, 2023-08-01T19:54:28.578 INFO:teuthology.orchestra.run.smithi008.stdout: "type_data": { 2023-08-01T19:54:28.578 INFO:teuthology.orchestra.run.smithi008.stdout: "flag_point": "commit sent; apply or cleanup", 2023-08-01T19:54:28.579 INFO:teuthology.orchestra.run.smithi008.stdout: "client_info": { 2023-08-01T19:54:28.579 INFO:teuthology.orchestra.run.smithi008.stdout: "client": "client.4668", 2023-08-01T19:54:28.579 INFO:teuthology.orchestra.run.smithi008.stdout: "client_addr": "172.21.15.6:0/1709472247", 2023-08-01T19:54:28.579 INFO:teuthology.orchestra.run.smithi008.stdout: "tid": 14635 2023-08-01T19:54:28.579 INFO:teuthology.orchestra.run.smithi008.stdout: }, 2023-08-01T19:54:28.579 INFO:teuthology.orchestra.run.smithi008.stdout: "events": [ 2023-08-01T19:54:28.580 INFO:teuthology.orchestra.run.smithi008.stdout: { 2023-08-01T19:54:28.580 INFO:teuthology.orchestra.run.smithi008.stdout: "event": "initiated", 2023-08-01T19:54:28.580 INFO:teuthology.orchestra.run.smithi008.stdout: "time": "2023-08-01T19:54:27.942161+0000", 2023-08-01T19:54:28.580 INFO:teuthology.orchestra.run.smithi008.stdout: "duration": 0 2023-08-01T19:54:28.580 INFO:teuthology.orchestra.run.smithi008.stdout: }, 2023-08-01T19:54:28.581 INFO:teuthology.orchestra.run.smithi008.stdout: { 2023-08-01T19:54:28.581 INFO:teuthology.orchestra.run.smithi008.stdout: "event": "throttled", 2023-08-01T19:54:28.581 INFO:teuthology.orchestra.run.smithi008.stdout: "time": "2023-08-01T19:54:27.942161+0000", 2023-08-01T19:54:28.581 INFO:teuthology.orchestra.run.smithi008.stdout: "duration": 0 2023-08-01T19:54:28.582 INFO:teuthology.orchestra.run.smithi008.stdout: }, 2023-08-01T19:54:28.582 INFO:teuthology.orchestra.run.smithi008.stdout: { 2023-08-01T19:54:28.582 INFO:teuthology.orchestra.run.smithi008.stdout: "event": "header_read", 2023-08-01T19:54:28.582 INFO:teuthology.orchestra.run.smithi008.stdout: "time": "2023-08-01T19:54:27.942161+0000", 2023-08-01T19:54:28.582 INFO:teuthology.orchestra.run.smithi008.stdout: "duration": 4294967295.9999995 2023-08-01T19:54:28.582 INFO:teuthology.orchestra.run.smithi008.stdout: }, 2023-08-01T19:54:28.582 INFO:teuthology.orchestra.run.smithi008.stdout: { 2023-08-01T19:54:28.582 INFO:teuthology.orchestra.run.smithi008.stdout: "event": "all_read", 2023-08-01T19:54:28.583 INFO:teuthology.orchestra.run.smithi008.stdout: "time": "2023-08-01T19:54:27.942191+0000", 2023-08-01T19:54:28.583 INFO:teuthology.orchestra.run.smithi008.stdout: "duration": 3.0530000000000001e-05 2023-08-01T19:54:28.583 INFO:teuthology.orchestra.run.smithi008.stdout: }, 2023-08-01T19:54:28.583 INFO:teuthology.orchestra.run.smithi008.stdout: { 2023-08-01T19:54:28.583 INFO:teuthology.orchestra.run.smithi008.stdout: "event": "dispatched", 2023-08-01T19:54:28.583 INFO:teuthology.orchestra.run.smithi008.stdout: "time": "2023-08-01T19:54:27.942198+0000", 2023-08-01T19:54:28.584 INFO:teuthology.orchestra.run.smithi008.stdout: "duration": 7.3499999999999999e-06 2023-08-01T19:54:28.584 INFO:teuthology.orchestra.run.smithi008.stdout: }, 2023-08-01T19:54:28.584 INFO:teuthology.orchestra.run.smithi008.stdout: { 2023-08-01T19:54:28.584 INFO:teuthology.orchestra.run.smithi008.stdout: "event": "queued_for_pg", 2023-08-01T19:54:28.584 INFO:teuthology.orchestra.run.smithi008.stdout: "time": "2023-08-01T19:54:27.942204+0000", 2023-08-01T19:54:28.584 INFO:teuthology.orchestra.run.smithi008.stdout: "duration": 5.772e-06 2023-08-01T19:54:28.585 INFO:teuthology.orchestra.run.smithi008.stdout: }, 2023-08-01T19:54:28.585 INFO:teuthology.orchestra.run.smithi008.stdout: { 2023-08-01T19:54:28.585 INFO:teuthology.orchestra.run.smithi008.stdout: "event": "reached_pg", 2023-08-01T19:54:28.585 INFO:teuthology.orchestra.run.smithi008.stdout: "time": "2023-08-01T19:54:27.944697+0000", 2023-08-01T19:54:28.586 INFO:teuthology.orchestra.run.smithi008.stdout: "duration": 0.0024932869999999998 2023-08-01T19:54:28.586 INFO:teuthology.orchestra.run.smithi008.stdout: }, 2023-08-01T19:54:28.586 INFO:teuthology.orchestra.run.smithi008.stdout: { 2023-08-01T19:54:28.586 INFO:teuthology.orchestra.run.smithi008.stdout: "event": "started", 2023-08-01T19:54:28.586 INFO:teuthology.orchestra.run.smithi008.stdout: "time": "2023-08-01T19:54:27.944827+0000", 2023-08-01T19:54:28.586 INFO:teuthology.orchestra.run.smithi008.stdout: "duration": 0.00012940299999999999 2023-08-01T19:54:28.586 INFO:teuthology.orchestra.run.smithi008.stdout: }, 2023-08-01T19:54:28.587 INFO:teuthology.orchestra.run.smithi008.stdout: { 2023-08-01T19:54:28.587 INFO:teuthology.orchestra.run.smithi008.stdout: "event": "waiting for subops from 1", 2023-08-01T19:54:28.587 INFO:teuthology.orchestra.run.smithi008.stdout: "time": "2023-08-01T19:54:27.944992+0000", 2023-08-01T19:54:28.587 INFO:teuthology.orchestra.run.smithi008.stdout: "duration": 0.00016507300000000001 2023-08-01T19:54:28.587 INFO:teuthology.orchestra.run.smithi008.stdout: }, 2023-08-01T19:54:28.587 INFO:teuthology.orchestra.run.smithi008.stdout: { 2023-08-01T19:54:28.587 INFO:teuthology.orchestra.run.smithi008.stdout: "event": "op_commit", 2023-08-01T19:54:28.588 INFO:teuthology.orchestra.run.smithi008.stdout: "time": "2023-08-01T19:54:27.947197+0000", 2023-08-01T19:54:28.588 INFO:teuthology.orchestra.run.smithi008.stdout: "duration": 0.0022045739999999999 2023-08-01T19:54:28.588 INFO:teuthology.orchestra.run.smithi008.stdout: }, 2023-08-01T19:54:28.588 INFO:teuthology.orchestra.run.smithi008.stdout: { 2023-08-01T19:54:28.588 INFO:teuthology.orchestra.run.smithi008.stdout: "event": "sub_op_commit_rec", 2023-08-01T19:54:28.588 INFO:teuthology.orchestra.run.smithi008.stdout: "time": "2023-08-01T19:54:27.951238+0000", 2023-08-01T19:54:28.588 INFO:teuthology.orchestra.run.smithi008.stdout: "duration": 0.0040418119999999997 2023-08-01T19:54:28.589 INFO:teuthology.orchestra.run.smithi008.stdout: }, 2023-08-01T19:54:28.589 INFO:teuthology.orchestra.run.smithi008.stdout: { 2023-08-01T19:54:28.589 INFO:teuthology.orchestra.run.smithi008.stdout: "event": "commit_sent", 2023-08-01T19:54:28.589 INFO:teuthology.orchestra.run.smithi008.stdout: "time": "2023-08-01T19:54:27.951278+0000", 2023-08-01T19:54:28.589 INFO:teuthology.orchestra.run.smithi008.stdout: "duration": 3.9406999999999997e-05 2023-08-01T19:54:28.589 INFO:teuthology.orchestra.run.smithi008.stdout: }, 2023-08-01T19:54:28.589 INFO:teuthology.orchestra.run.smithi008.stdout: { 2023-08-01T19:54:28.590 INFO:teuthology.orchestra.run.smithi008.stdout: "event": "done", 2023-08-01T19:54:28.590 INFO:teuthology.orchestra.run.smithi008.stdout: "time": "2023-08-01T19:54:27.951339+0000", 2023-08-01T19:54:28.590 INFO:teuthology.orchestra.run.smithi008.stdout: "duration": 6.0760000000000001e-05 2023-08-01T19:54:28.590 INFO:teuthology.orchestra.run.smithi008.stdout: } 2023-08-01T19:54:28.590 INFO:teuthology.orchestra.run.smithi008.stdout: ] 2023-08-01T19:54:28.590 INFO:teuthology.orchestra.run.smithi008.stdout: } 2023-08-01T19:54:28.590 INFO:teuthology.orchestra.run.smithi008.stdout: }, 2023-08-01T19:54:28.591 INFO:teuthology.orchestra.run.smithi008.stdout: { 2023-08-01T19:54:28.591 INFO:teuthology.orchestra.run.smithi008.stdout: "description": "osd_op(client.4668.0:15904 5.3 5:c2e836aa:::benchmark_data_smithi006_114134_object15903:head [set-alloc-hint object_size 65536 write_size 65536,write 0~65536] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e23)", 2023-08-01T19:54:28.591 INFO:teuthology.orchestra.run.smithi008.stdout: "initiated_at": "2023-08-01T19:54:28.310092+0000", 2023-08-01T19:54:28.591 INFO:teuthology.orchestra.run.smithi008.stdout: "age": 0.024881197000000001, 2023-08-01T19:54:28.591 INFO:teuthology.orchestra.run.smithi008.stdout: "duration": 0.010157974, 2023-08-01T19:54:28.591 INFO:teuthology.orchestra.run.smithi008.stdout: "type_data": { 2023-08-01T19:54:28.591 INFO:teuthology.orchestra.run.smithi008.stdout: "flag_point": "commit sent; apply or cleanup", 2023-08-01T19:54:28.591 INFO:teuthology.orchestra.run.smithi008.stdout: "client_info": { 2023-08-01T19:54:28.592 INFO:teuthology.orchestra.run.smithi008.stdout: "client": "client.4668", 2023-08-01T19:54:28.592 INFO:teuthology.orchestra.run.smithi008.stdout: "client_addr": "172.21.15.6:0/1709472247", 2023-08-01T19:54:28.592 INFO:teuthology.orchestra.run.smithi008.stdout: "tid": 15904 2023-08-01T19:54:28.592 INFO:teuthology.orchestra.run.smithi008.stdout: }, 2023-08-01T19:54:28.592 INFO:teuthology.orchestra.run.smithi008.stdout: "events": [ 2023-08-01T19:54:28.592 INFO:teuthology.orchestra.run.smithi008.stdout: { 2023-08-01T19:54:28.592 INFO:teuthology.orchestra.run.smithi008.stdout: "event": "initiated", 2023-08-01T19:54:28.593 INFO:teuthology.orchestra.run.smithi008.stdout: "time": "2023-08-01T19:54:28.310092+0000", 2023-08-01T19:54:28.593 INFO:teuthology.orchestra.run.smithi008.stdout: "duration": 0 2023-08-01T19:54:28.593 INFO:teuthology.orchestra.run.smithi008.stdout: }, 2023-08-01T19:54:28.593 INFO:teuthology.orchestra.run.smithi008.stdout: { 2023-08-01T19:54:28.593 INFO:teuthology.orchestra.run.smithi008.stdout: "event": "throttled", 2023-08-01T19:54:28.593 INFO:teuthology.orchestra.run.smithi008.stdout: "time": "2023-08-01T19:54:28.310092+0000", 2023-08-01T19:54:28.593 INFO:teuthology.orchestra.run.smithi008.stdout: "duration": 0 2023-08-01T19:54:28.594 INFO:teuthology.orchestra.run.smithi008.stdout: }, 2023-08-01T19:54:28.594 INFO:teuthology.orchestra.run.smithi008.stdout: { 2023-08-01T19:54:28.594 INFO:teuthology.orchestra.run.smithi008.stdout: "event": "header_read", 2023-08-01T19:54:28.594 INFO:teuthology.orchestra.run.smithi008.stdout: "time": "2023-08-01T19:54:28.310091+0000", 2023-08-01T19:54:28.594 INFO:teuthology.orchestra.run.smithi008.stdout: "duration": 4294967295.999999 2023-08-01T19:54:28.594 INFO:teuthology.orchestra.run.smithi008.stdout: }, 2023-08-01T19:54:28.594 INFO:teuthology.orchestra.run.smithi008.stdout: { 2023-08-01T19:54:28.595 INFO:teuthology.orchestra.run.smithi008.stdout: "event": "all_read", 2023-08-01T19:54:28.595 INFO:teuthology.orchestra.run.smithi008.stdout: "time": "2023-08-01T19:54:28.310161+0000", 2023-08-01T19:54:28.595 INFO:teuthology.orchestra.run.smithi008.stdout: "duration": 6.9165000000000006e-05 2023-08-01T19:54:28.595 INFO:teuthology.orchestra.run.smithi008.stdout: }, 2023-08-01T19:54:28.595 INFO:teuthology.orchestra.run.smithi008.stdout: { 2023-08-01T19:54:28.595 INFO:teuthology.orchestra.run.smithi008.stdout: "event": "dispatched", 2023-08-01T19:54:28.595 INFO:teuthology.orchestra.run.smithi008.stdout: "time": "2023-08-01T19:54:28.310172+0000", 2023-08-01T19:54:28.596 INFO:teuthology.orchestra.run.smithi008.stdout: "duration": 1.118e-05 2023-08-01T19:54:28.596 INFO:teuthology.orchestra.run.smithi008.stdout: }, 2023-08-01T19:54:28.596 INFO:teuthology.orchestra.run.smithi008.stdout: { 2023-08-01T19:54:28.596 INFO:teuthology.orchestra.run.smithi008.stdout: "event": "queued_for_pg", 2023-08-01T19:54:28.596 INFO:teuthology.orchestra.run.smithi008.stdout: "time": "2023-08-01T19:54:28.310177+0000", 2023-08-01T19:54:28.596 INFO:teuthology.orchestra.run.smithi008.stdout: "duration": 5.609e-06 2023-08-01T19:54:28.596 INFO:teuthology.orchestra.run.smithi008.stdout: }, 2023-08-01T19:54:28.597 INFO:teuthology.orchestra.run.smithi008.stdout: { 2023-08-01T19:54:28.597 INFO:teuthology.orchestra.run.smithi008.stdout: "event": "reached_pg", 2023-08-01T19:54:28.597 INFO:teuthology.orchestra.run.smithi008.stdout: "time": "2023-08-01T19:54:28.311550+0000", 2023-08-01T19:54:28.597 INFO:teuthology.orchestra.run.smithi008.stdout: "duration": 0.001372786 2023-08-01T19:54:28.597 INFO:teuthology.orchestra.run.smithi008.stdout: }, 2023-08-01T19:54:28.597 INFO:teuthology.orchestra.run.smithi008.stdout: { 2023-08-01T19:54:28.597 INFO:teuthology.orchestra.run.smithi008.stdout: "event": "started", 2023-08-01T19:54:28.598 INFO:teuthology.orchestra.run.smithi008.stdout: "time": "2023-08-01T19:54:28.311691+0000", 2023-08-01T19:54:28.598 INFO:teuthology.orchestra.run.smithi008.stdout: "duration": 0.000141111 2023-08-01T19:54:28.598 INFO:teuthology.orchestra.run.smithi008.stdout: }, 2023-08-01T19:54:28.598 INFO:teuthology.orchestra.run.smithi008.stdout: { 2023-08-01T19:54:28.598 INFO:teuthology.orchestra.run.smithi008.stdout: "event": "waiting for subops from 1", 2023-08-01T19:54:28.598 INFO:teuthology.orchestra.run.smithi008.stdout: "time": "2023-08-01T19:54:28.311833+0000", 2023-08-01T19:54:28.598 INFO:teuthology.orchestra.run.smithi008.stdout: "duration": 0.00014221700000000001 2023-08-01T19:54:28.598 INFO:teuthology.orchestra.run.smithi008.stdout: }, 2023-08-01T19:54:28.599 INFO:teuthology.orchestra.run.smithi008.stdout: { 2023-08-01T19:54:28.599 INFO:teuthology.orchestra.run.smithi008.stdout: "event": "op_commit", 2023-08-01T19:54:28.599 INFO:teuthology.orchestra.run.smithi008.stdout: "time": "2023-08-01T19:54:28.314482+0000", 2023-08-01T19:54:28.599 INFO:teuthology.orchestra.run.smithi008.stdout: "duration": 0.0026487049999999999 2023-08-01T19:54:28.599 INFO:teuthology.orchestra.run.smithi008.stdout: }, 2023-08-01T19:54:28.599 INFO:teuthology.orchestra.run.smithi008.stdout: { 2023-08-01T19:54:28.599 INFO:teuthology.orchestra.run.smithi008.stdout: "event": "sub_op_commit_rec", 2023-08-01T19:54:28.600 INFO:teuthology.orchestra.run.smithi008.stdout: "time": "2023-08-01T19:54:28.320174+0000", 2023-08-01T19:54:28.600 INFO:teuthology.orchestra.run.smithi008.stdout: "duration": 0.0056914959999999999 2023-08-01T19:54:28.600 INFO:teuthology.orchestra.run.smithi008.stdout: }, 2023-08-01T19:54:28.600 INFO:teuthology.orchestra.run.smithi008.stdout: { 2023-08-01T19:54:28.600 INFO:teuthology.orchestra.run.smithi008.stdout: "event": "commit_sent", 2023-08-01T19:54:28.600 INFO:teuthology.orchestra.run.smithi008.stdout: "time": "2023-08-01T19:54:28.320218+0000", 2023-08-01T19:54:28.600 INFO:teuthology.orchestra.run.smithi008.stdout: "duration": 4.4802000000000002e-05 2023-08-01T19:54:28.601 INFO:teuthology.orchestra.run.smithi008.stdout: }, 2023-08-01T19:54:28.601 INFO:teuthology.orchestra.run.smithi008.stdout: { 2023-08-01T19:54:28.601 INFO:teuthology.orchestra.run.smithi008.stdout: "event": "done", 2023-08-01T19:54:28.601 INFO:teuthology.orchestra.run.smithi008.stdout: "time": "2023-08-01T19:54:28.320250+0000", 2023-08-01T19:54:28.601 INFO:teuthology.orchestra.run.smithi008.stdout: "duration": 3.1897999999999999e-05 2023-08-01T19:54:28.601 INFO:teuthology.orchestra.run.smithi008.stdout: } 2023-08-01T19:54:28.601 INFO:teuthology.orchestra.run.smithi008.stdout: ] 2023-08-01T19:54:28.602 INFO:teuthology.orchestra.run.smithi008.stdout: } 2023-08-01T19:54:28.602 INFO:teuthology.orchestra.run.smithi008.stdout: }, 2023-08-01T19:54:28.602 INFO:teuthology.orchestra.run.smithi008.stdout: { 2023-08-01T19:54:28.602 INFO:teuthology.orchestra.run.smithi008.stdout: "description": "osd_op(client.4668.0:15927 5.3 5:ce5b4c35:::benchmark_data_smithi006_114134_object15926:head [set-alloc-hint object_size 65536 write_size 65536,write 0~65536] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e23)", 2023-08-01T19:54:28.602 INFO:teuthology.orchestra.run.smithi008.stdout: "initiated_at": "2023-08-01T19:54:28.317736+0000", 2023-08-01T19:54:28.602 INFO:teuthology.orchestra.run.smithi008.stdout: "age": 0.017237400999999999, 2023-08-01T19:54:28.602 INFO:teuthology.orchestra.run.smithi008.stdout: "duration": 0.0087957950000000003, 2023-08-01T19:54:28.603 INFO:teuthology.orchestra.run.smithi008.stdout: "type_data": { 2023-08-01T19:54:28.603 INFO:teuthology.orchestra.run.smithi008.stdout: "flag_point": "commit sent; apply or cleanup", 2023-08-01T19:54:28.603 INFO:teuthology.orchestra.run.smithi008.stdout: "client_info": { 2023-08-01T19:54:28.603 INFO:teuthology.orchestra.run.smithi008.stdout: "client": "client.4668", 2023-08-01T19:54:28.603 INFO:teuthology.orchestra.run.smithi008.stdout: "client_addr": "172.21.15.6:0/1709472247", 2023-08-01T19:54:28.603 INFO:teuthology.orchestra.run.smithi008.stdout: "tid": 15927 2023-08-01T19:54:28.603 INFO:teuthology.orchestra.run.smithi008.stdout: }, 2023-08-01T19:54:28.604 INFO:teuthology.orchestra.run.smithi008.stdout: "events": [ 2023-08-01T19:54:28.604 INFO:teuthology.orchestra.run.smithi008.stdout: { 2023-08-01T19:54:28.604 INFO:teuthology.orchestra.run.smithi008.stdout: "event": "initiated", 2023-08-01T19:54:28.604 INFO:teuthology.orchestra.run.smithi008.stdout: "time": "2023-08-01T19:54:28.317736+0000", 2023-08-01T19:54:28.604 INFO:teuthology.orchestra.run.smithi008.stdout: "duration": 0 2023-08-01T19:54:28.604 INFO:teuthology.orchestra.run.smithi008.stdout: }, 2023-08-01T19:54:28.604 INFO:teuthology.orchestra.run.smithi008.stdout: { 2023-08-01T19:54:28.605 INFO:teuthology.orchestra.run.smithi008.stdout: "event": "throttled", 2023-08-01T19:54:28.605 INFO:teuthology.orchestra.run.smithi008.stdout: "time": "2023-08-01T19:54:28.317736+0000", 2023-08-01T19:54:28.605 INFO:teuthology.orchestra.run.smithi008.stdout: "duration": 0 2023-08-01T19:54:28.605 INFO:teuthology.orchestra.run.smithi008.stdout: }, 2023-08-01T19:54:28.605 INFO:teuthology.orchestra.run.smithi008.stdout: { 2023-08-01T19:54:28.605 INFO:teuthology.orchestra.run.smithi008.stdout: "event": "header_read", 2023-08-01T19:54:28.605 INFO:teuthology.orchestra.run.smithi008.stdout: "time": "2023-08-01T19:54:28.317736+0000", 2023-08-01T19:54:28.606 INFO:teuthology.orchestra.run.smithi008.stdout: "duration": 4294967295.9999995 2023-08-01T19:54:28.606 INFO:teuthology.orchestra.run.smithi008.stdout: }, 2023-08-01T19:54:28.606 INFO:teuthology.orchestra.run.smithi008.stdout: { 2023-08-01T19:54:28.606 INFO:teuthology.orchestra.run.smithi008.stdout: "event": "all_read", 2023-08-01T19:54:28.606 INFO:teuthology.orchestra.run.smithi008.stdout: "time": "2023-08-01T19:54:28.317858+0000", 2023-08-01T19:54:28.606 INFO:teuthology.orchestra.run.smithi008.stdout: "duration": 0.00012205 2023-08-01T19:54:28.606 INFO:teuthology.orchestra.run.smithi008.stdout: }, 2023-08-01T19:54:28.606 INFO:teuthology.orchestra.run.smithi008.stdout: { 2023-08-01T19:54:28.607 INFO:teuthology.orchestra.run.smithi008.stdout: "event": "dispatched", 2023-08-01T19:54:28.607 INFO:teuthology.orchestra.run.smithi008.stdout: "time": "2023-08-01T19:54:28.317869+0000", 2023-08-01T19:54:28.607 INFO:teuthology.orchestra.run.smithi008.stdout: "duration": 1.1097999999999999e-05 2023-08-01T19:54:28.607 INFO:teuthology.orchestra.run.smithi008.stdout: }, 2023-08-01T19:54:28.607 INFO:teuthology.orchestra.run.smithi008.stdout: { 2023-08-01T19:54:28.607 INFO:teuthology.orchestra.run.smithi008.stdout: "event": "queued_for_pg", 2023-08-01T19:54:28.607 INFO:teuthology.orchestra.run.smithi008.stdout: "time": "2023-08-01T19:54:28.317875+0000", 2023-08-01T19:54:28.608 INFO:teuthology.orchestra.run.smithi008.stdout: "duration": 6.1500000000000004e-06 2023-08-01T19:54:28.608 INFO:teuthology.orchestra.run.smithi008.stdout: }, 2023-08-01T19:54:28.608 INFO:teuthology.orchestra.run.smithi008.stdout: { 2023-08-01T19:54:28.608 INFO:teuthology.orchestra.run.smithi008.stdout: "event": "reached_pg", 2023-08-01T19:54:28.608 INFO:teuthology.orchestra.run.smithi008.stdout: "time": "2023-08-01T19:54:28.320469+0000", 2023-08-01T19:54:28.608 INFO:teuthology.orchestra.run.smithi008.stdout: "duration": 0.0025936100000000001 2023-08-01T19:54:28.608 INFO:teuthology.orchestra.run.smithi008.stdout: }, 2023-08-01T19:54:28.609 INFO:teuthology.orchestra.run.smithi008.stdout: { 2023-08-01T19:54:28.609 INFO:teuthology.orchestra.run.smithi008.stdout: "event": "started", 2023-08-01T19:54:28.609 INFO:teuthology.orchestra.run.smithi008.stdout: "time": "2023-08-01T19:54:28.320615+0000", 2023-08-01T19:54:28.609 INFO:teuthology.orchestra.run.smithi008.stdout: "duration": 0.00014672900000000001 2023-08-01T19:54:28.609 INFO:teuthology.orchestra.run.smithi008.stdout: }, 2023-08-01T19:54:28.609 INFO:teuthology.orchestra.run.smithi008.stdout: { 2023-08-01T19:54:28.609 INFO:teuthology.orchestra.run.smithi008.stdout: "event": "waiting for subops from 1", 2023-08-01T19:54:28.610 INFO:teuthology.orchestra.run.smithi008.stdout: "time": "2023-08-01T19:54:28.320788+0000", 2023-08-01T19:54:28.610 INFO:teuthology.orchestra.run.smithi008.stdout: "duration": 0.000172769 2023-08-01T19:54:28.610 INFO:teuthology.orchestra.run.smithi008.stdout: }, 2023-08-01T19:54:28.610 INFO:teuthology.orchestra.run.smithi008.stdout: { 2023-08-01T19:54:28.610 INFO:teuthology.orchestra.run.smithi008.stdout: "event": "op_commit", 2023-08-01T19:54:28.610 INFO:teuthology.orchestra.run.smithi008.stdout: "time": "2023-08-01T19:54:28.322798+0000", 2023-08-01T19:54:28.610 INFO:teuthology.orchestra.run.smithi008.stdout: "duration": 0.0020095450000000002 2023-08-01T19:54:28.610 INFO:teuthology.orchestra.run.smithi008.stdout: }, 2023-08-01T19:54:28.611 INFO:teuthology.orchestra.run.smithi008.stdout: { 2023-08-01T19:54:28.611 INFO:teuthology.orchestra.run.smithi008.stdout: "event": "sub_op_commit_rec", 2023-08-01T19:54:28.611 INFO:teuthology.orchestra.run.smithi008.stdout: "time": "2023-08-01T19:54:28.326442+0000", 2023-08-01T19:54:28.611 INFO:teuthology.orchestra.run.smithi008.stdout: "duration": 0.0036447480000000002 2023-08-01T19:54:28.611 INFO:teuthology.orchestra.run.smithi008.stdout: }, 2023-08-01T19:54:28.611 INFO:teuthology.orchestra.run.smithi008.stdout: { 2023-08-01T19:54:28.611 INFO:teuthology.orchestra.run.smithi008.stdout: "event": "commit_sent", 2023-08-01T19:54:28.612 INFO:teuthology.orchestra.run.smithi008.stdout: "time": "2023-08-01T19:54:28.326492+0000", 2023-08-01T19:54:28.612 INFO:teuthology.orchestra.run.smithi008.stdout: "duration": 4.9373000000000003e-05 2023-08-01T19:54:28.612 INFO:teuthology.orchestra.run.smithi008.stdout: }, 2023-08-01T19:54:28.612 INFO:teuthology.orchestra.run.smithi008.stdout: { 2023-08-01T19:54:28.612 INFO:teuthology.orchestra.run.smithi008.stdout: "event": "done", 2023-08-01T19:54:28.612 INFO:teuthology.orchestra.run.smithi008.stdout: "time": "2023-08-01T19:54:28.326532+0000", 2023-08-01T19:54:28.612 INFO:teuthology.orchestra.run.smithi008.stdout: "duration": 4.0305000000000001e-05 2023-08-01T19:54:28.613 INFO:teuthology.orchestra.run.smithi008.stdout: } 2023-08-01T19:54:28.613 INFO:teuthology.orchestra.run.smithi008.stdout: ] 2023-08-01T19:54:28.613 INFO:teuthology.orchestra.run.smithi008.stdout: } 2023-08-01T19:54:28.613 INFO:teuthology.orchestra.run.smithi008.stdout: } 2023-08-01T19:54:28.613 INFO:teuthology.orchestra.run.smithi008.stdout: ] 2023-08-01T19:54:28.613 INFO:teuthology.orchestra.run.smithi008.stdout:} 2023-08-01T19:54:28.615 DEBUG:teuthology.orchestra.run.smithi101:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 30 ceph --cluster ceph --admin-daemon /var/run/ceph/ceph-osd.1.asok dump_ops_in_flight 2023-08-01T19:54:28.615 INFO:tasks.ceph.osd.2.smithi155.stderr:2023-08-01T19:54:28.614+0000 7faa5c6ac700 -1 received signal: Hangup from /usr/bin/python3 /bin/daemon-helper kill ceph-osd -f --cluster ceph -i 2 (PID: 111337) UID: 0 2023-08-01T19:54:28.715 INFO:tasks.ceph.osd.1.smithi101.stderr:2023-08-01T19:54:28.713+0000 7fb0cb7f6700 -1 received signal: Hangup from /usr/bin/python3 /bin/daemon-helper kill ceph-osd -f --cluster ceph -i 1 (PID: 111141) UID: 0 2023-08-01T19:54:28.786 INFO:teuthology.orchestra.run.smithi101.stdout:{ 2023-08-01T19:54:28.786 INFO:teuthology.orchestra.run.smithi101.stdout: "ops": [ 2023-08-01T19:54:28.787 INFO:teuthology.orchestra.run.smithi101.stdout: { 2023-08-01T19:54:28.787 INFO:teuthology.orchestra.run.smithi101.stdout: "description": "osd_op(client.4668.0:17590 5.7 5:ed6d8c1c:::benchmark_data_smithi006_114134_object17589:head [set-alloc-hint object_size 65536 write_size 65536,write 0~65536 in=65536b] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e23)", 2023-08-01T19:54:28.787 INFO:teuthology.orchestra.run.smithi101.stdout: "initiated_at": "2023-08-01T19:54:28.785376+0000", 2023-08-01T19:54:28.787 INFO:teuthology.orchestra.run.smithi101.stdout: "age": 0.00037831399999999998, 2023-08-01T19:54:28.787 INFO:teuthology.orchestra.run.smithi101.stdout: "duration": 0.00039757099999999999, 2023-08-01T19:54:28.787 INFO:teuthology.orchestra.run.smithi101.stdout: "type_data": { 2023-08-01T19:54:28.787 INFO:teuthology.orchestra.run.smithi101.stdout: "flag_point": "waiting for sub ops", 2023-08-01T19:54:28.788 INFO:teuthology.orchestra.run.smithi101.stdout: "client_info": { 2023-08-01T19:54:28.788 INFO:teuthology.orchestra.run.smithi101.stdout: "client": "client.4668", 2023-08-01T19:54:28.788 INFO:teuthology.orchestra.run.smithi101.stdout: "client_addr": "172.21.15.6:0/1709472247", 2023-08-01T19:54:28.788 INFO:teuthology.orchestra.run.smithi101.stdout: "tid": 17590 2023-08-01T19:54:28.788 INFO:teuthology.orchestra.run.smithi101.stdout: }, 2023-08-01T19:54:28.788 INFO:teuthology.orchestra.run.smithi101.stdout: "events": [ 2023-08-01T19:54:28.789 INFO:teuthology.orchestra.run.smithi101.stdout: { 2023-08-01T19:54:28.789 INFO:teuthology.orchestra.run.smithi101.stdout: "event": "initiated", 2023-08-01T19:54:28.789 INFO:teuthology.orchestra.run.smithi101.stdout: "time": "2023-08-01T19:54:28.785376+0000", 2023-08-01T19:54:28.789 INFO:teuthology.orchestra.run.smithi101.stdout: "duration": 0 2023-08-01T19:54:28.789 INFO:teuthology.orchestra.run.smithi101.stdout: }, 2023-08-01T19:54:28.789 INFO:teuthology.orchestra.run.smithi101.stdout: { 2023-08-01T19:54:28.789 INFO:teuthology.orchestra.run.smithi101.stdout: "event": "throttled", 2023-08-01T19:54:28.790 INFO:teuthology.orchestra.run.smithi101.stdout: "time": "2023-08-01T19:54:28.785376+0000", 2023-08-01T19:54:28.790 INFO:teuthology.orchestra.run.smithi101.stdout: "duration": 0 2023-08-01T19:54:28.790 INFO:teuthology.orchestra.run.smithi101.stdout: }, 2023-08-01T19:54:28.790 INFO:teuthology.orchestra.run.smithi101.stdout: { 2023-08-01T19:54:28.790 INFO:teuthology.orchestra.run.smithi101.stdout: "event": "header_read", 2023-08-01T19:54:28.790 INFO:teuthology.orchestra.run.smithi101.stdout: "time": "2023-08-01T19:54:28.785376+0000", 2023-08-01T19:54:28.790 INFO:teuthology.orchestra.run.smithi101.stdout: "duration": 4294967295.9999995 2023-08-01T19:54:28.790 INFO:teuthology.orchestra.run.smithi101.stdout: }, 2023-08-01T19:54:28.791 INFO:teuthology.orchestra.run.smithi101.stdout: { 2023-08-01T19:54:28.791 INFO:teuthology.orchestra.run.smithi101.stdout: "event": "all_read", 2023-08-01T19:54:28.791 INFO:teuthology.orchestra.run.smithi101.stdout: "time": "2023-08-01T19:54:28.785461+0000", 2023-08-01T19:54:28.791 INFO:teuthology.orchestra.run.smithi101.stdout: "duration": 8.5144999999999999e-05 2023-08-01T19:54:28.791 INFO:teuthology.orchestra.run.smithi101.stdout: }, 2023-08-01T19:54:28.791 INFO:teuthology.orchestra.run.smithi101.stdout: { 2023-08-01T19:54:28.791 INFO:teuthology.orchestra.run.smithi101.stdout: "event": "dispatched", 2023-08-01T19:54:28.792 INFO:teuthology.orchestra.run.smithi101.stdout: "time": "2023-08-01T19:54:28.785469+0000", 2023-08-01T19:54:28.792 INFO:teuthology.orchestra.run.smithi101.stdout: "duration": 8.5820000000000002e-06 2023-08-01T19:54:28.792 INFO:teuthology.orchestra.run.smithi101.stdout: }, 2023-08-01T19:54:28.792 INFO:teuthology.orchestra.run.smithi101.stdout: { 2023-08-01T19:54:28.792 INFO:teuthology.orchestra.run.smithi101.stdout: "event": "queued_for_pg", 2023-08-01T19:54:28.792 INFO:teuthology.orchestra.run.smithi101.stdout: "time": "2023-08-01T19:54:28.785475+0000", 2023-08-01T19:54:28.792 INFO:teuthology.orchestra.run.smithi101.stdout: "duration": 6.0260000000000004e-06 2023-08-01T19:54:28.793 INFO:teuthology.orchestra.run.smithi101.stdout: }, 2023-08-01T19:54:28.793 INFO:teuthology.orchestra.run.smithi101.stdout: { 2023-08-01T19:54:28.793 INFO:teuthology.orchestra.run.smithi101.stdout: "event": "reached_pg", 2023-08-01T19:54:28.793 INFO:teuthology.orchestra.run.smithi101.stdout: "time": "2023-08-01T19:54:28.785507+0000", 2023-08-01T19:54:28.793 INFO:teuthology.orchestra.run.smithi101.stdout: "duration": 3.1569999999999998e-05 2023-08-01T19:54:28.793 INFO:teuthology.orchestra.run.smithi101.stdout: }, 2023-08-01T19:54:28.793 INFO:teuthology.orchestra.run.smithi101.stdout: { 2023-08-01T19:54:28.794 INFO:teuthology.orchestra.run.smithi101.stdout: "event": "started", 2023-08-01T19:54:28.794 INFO:teuthology.orchestra.run.smithi101.stdout: "time": "2023-08-01T19:54:28.785587+0000", 2023-08-01T19:54:28.794 INFO:teuthology.orchestra.run.smithi101.stdout: "duration": 8.0438000000000005e-05 2023-08-01T19:54:28.794 INFO:teuthology.orchestra.run.smithi101.stdout: }, 2023-08-01T19:54:28.794 INFO:teuthology.orchestra.run.smithi101.stdout: { 2023-08-01T19:54:28.794 INFO:teuthology.orchestra.run.smithi101.stdout: "event": "waiting for subops from 0", 2023-08-01T19:54:28.794 INFO:teuthology.orchestra.run.smithi101.stdout: "time": "2023-08-01T19:54:28.785672+0000", 2023-08-01T19:54:28.795 INFO:teuthology.orchestra.run.smithi101.stdout: "duration": 8.4140000000000004e-05 2023-08-01T19:54:28.795 INFO:teuthology.orchestra.run.smithi101.stdout: } 2023-08-01T19:54:28.795 INFO:teuthology.orchestra.run.smithi101.stdout: ] 2023-08-01T19:54:28.795 INFO:teuthology.orchestra.run.smithi101.stdout: } 2023-08-01T19:54:28.795 INFO:teuthology.orchestra.run.smithi101.stdout: }, 2023-08-01T19:54:28.795 INFO:teuthology.orchestra.run.smithi101.stdout: { 2023-08-01T19:54:28.795 INFO:teuthology.orchestra.run.smithi101.stdout: "description": "osd_op(client.4668.0:17588 5.9 5:9b2310b7:::benchmark_data_smithi006_114134_object17587:head [set-alloc-hint object_size 65536 write_size 65536,write 0~65536 in=65536b] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e23)", 2023-08-01T19:54:28.796 INFO:teuthology.orchestra.run.smithi101.stdout: "initiated_at": "2023-08-01T19:54:28.783826+0000", 2023-08-01T19:54:28.796 INFO:teuthology.orchestra.run.smithi101.stdout: "age": 0.001929093, 2023-08-01T19:54:28.796 INFO:teuthology.orchestra.run.smithi101.stdout: "duration": 0.002002462, 2023-08-01T19:54:28.796 INFO:teuthology.orchestra.run.smithi101.stdout: "type_data": { 2023-08-01T19:54:28.796 INFO:teuthology.orchestra.run.smithi101.stdout: "flag_point": "waiting for sub ops", 2023-08-01T19:54:28.796 INFO:teuthology.orchestra.run.smithi101.stdout: "client_info": { 2023-08-01T19:54:28.796 INFO:teuthology.orchestra.run.smithi101.stdout: "client": "client.4668", 2023-08-01T19:54:28.797 INFO:teuthology.orchestra.run.smithi101.stdout: "client_addr": "172.21.15.6:0/1709472247", 2023-08-01T19:54:28.797 INFO:teuthology.orchestra.run.smithi101.stdout: "tid": 17588 2023-08-01T19:54:28.797 INFO:teuthology.orchestra.run.smithi101.stdout: }, 2023-08-01T19:54:28.797 INFO:teuthology.orchestra.run.smithi101.stdout: "events": [ 2023-08-01T19:54:28.797 INFO:teuthology.orchestra.run.smithi101.stdout: { 2023-08-01T19:54:28.797 INFO:teuthology.orchestra.run.smithi101.stdout: "event": "initiated", 2023-08-01T19:54:28.797 INFO:teuthology.orchestra.run.smithi101.stdout: "time": "2023-08-01T19:54:28.783826+0000", 2023-08-01T19:54:28.797 INFO:teuthology.orchestra.run.smithi101.stdout: "duration": 0 2023-08-01T19:54:28.798 INFO:teuthology.orchestra.run.smithi101.stdout: }, 2023-08-01T19:54:28.798 INFO:teuthology.orchestra.run.smithi101.stdout: { 2023-08-01T19:54:28.798 INFO:teuthology.orchestra.run.smithi101.stdout: "event": "throttled", 2023-08-01T19:54:28.798 INFO:teuthology.orchestra.run.smithi101.stdout: "time": "2023-08-01T19:54:28.783826+0000", 2023-08-01T19:54:28.798 INFO:teuthology.orchestra.run.smithi101.stdout: "duration": 0 2023-08-01T19:54:28.798 INFO:teuthology.orchestra.run.smithi101.stdout: }, 2023-08-01T19:54:28.798 INFO:teuthology.orchestra.run.smithi101.stdout: { 2023-08-01T19:54:28.799 INFO:teuthology.orchestra.run.smithi101.stdout: "event": "header_read", 2023-08-01T19:54:28.799 INFO:teuthology.orchestra.run.smithi101.stdout: "time": "2023-08-01T19:54:28.783825+0000", 2023-08-01T19:54:28.799 INFO:teuthology.orchestra.run.smithi101.stdout: "duration": 4294967295.999999 2023-08-01T19:54:28.799 INFO:teuthology.orchestra.run.smithi101.stdout: }, 2023-08-01T19:54:28.799 INFO:teuthology.orchestra.run.smithi101.stdout: { 2023-08-01T19:54:28.799 INFO:teuthology.orchestra.run.smithi101.stdout: "event": "all_read", 2023-08-01T19:54:28.799 INFO:teuthology.orchestra.run.smithi101.stdout: "time": "2023-08-01T19:54:28.783891+0000", 2023-08-01T19:54:28.800 INFO:teuthology.orchestra.run.smithi101.stdout: "duration": 6.5847999999999997e-05 2023-08-01T19:54:28.800 INFO:teuthology.orchestra.run.smithi101.stdout: }, 2023-08-01T19:54:28.800 INFO:teuthology.orchestra.run.smithi101.stdout: { 2023-08-01T19:54:28.800 INFO:teuthology.orchestra.run.smithi101.stdout: "event": "dispatched", 2023-08-01T19:54:28.800 INFO:teuthology.orchestra.run.smithi101.stdout: "time": "2023-08-01T19:54:28.783900+0000", 2023-08-01T19:54:28.800 INFO:teuthology.orchestra.run.smithi101.stdout: "duration": 9.6509999999999996e-06 2023-08-01T19:54:28.800 INFO:teuthology.orchestra.run.smithi101.stdout: }, 2023-08-01T19:54:28.801 INFO:teuthology.orchestra.run.smithi101.stdout: { 2023-08-01T19:54:28.801 INFO:teuthology.orchestra.run.smithi101.stdout: "event": "queued_for_pg", 2023-08-01T19:54:28.801 INFO:teuthology.orchestra.run.smithi101.stdout: "time": "2023-08-01T19:54:28.783906+0000", 2023-08-01T19:54:28.801 INFO:teuthology.orchestra.run.smithi101.stdout: "duration": 5.942e-06 2023-08-01T19:54:28.801 INFO:teuthology.orchestra.run.smithi101.stdout: }, 2023-08-01T19:54:28.801 INFO:teuthology.orchestra.run.smithi101.stdout: { 2023-08-01T19:54:28.801 INFO:teuthology.orchestra.run.smithi101.stdout: "event": "reached_pg", 2023-08-01T19:54:28.802 INFO:teuthology.orchestra.run.smithi101.stdout: "time": "2023-08-01T19:54:28.783932+0000", 2023-08-01T19:54:28.802 INFO:teuthology.orchestra.run.smithi101.stdout: "duration": 2.5383000000000001e-05 2023-08-01T19:54:28.802 INFO:teuthology.orchestra.run.smithi101.stdout: }, 2023-08-01T19:54:28.802 INFO:teuthology.orchestra.run.smithi101.stdout: { 2023-08-01T19:54:28.802 INFO:teuthology.orchestra.run.smithi101.stdout: "event": "started", 2023-08-01T19:54:28.802 INFO:teuthology.orchestra.run.smithi101.stdout: "time": "2023-08-01T19:54:28.784011+0000", 2023-08-01T19:54:28.802 INFO:teuthology.orchestra.run.smithi101.stdout: "duration": 7.9308999999999996e-05 2023-08-01T19:54:28.802 INFO:teuthology.orchestra.run.smithi101.stdout: }, 2023-08-01T19:54:28.803 INFO:teuthology.orchestra.run.smithi101.stdout: { 2023-08-01T19:54:28.803 INFO:teuthology.orchestra.run.smithi101.stdout: "event": "waiting for subops from 2", 2023-08-01T19:54:28.803 INFO:teuthology.orchestra.run.smithi101.stdout: "time": "2023-08-01T19:54:28.784097+0000", 2023-08-01T19:54:28.803 INFO:teuthology.orchestra.run.smithi101.stdout: "duration": 8.6112000000000005e-05 2023-08-01T19:54:28.803 INFO:teuthology.orchestra.run.smithi101.stdout: } 2023-08-01T19:54:28.803 INFO:teuthology.orchestra.run.smithi101.stdout: ] 2023-08-01T19:54:28.803 INFO:teuthology.orchestra.run.smithi101.stdout: } 2023-08-01T19:54:28.804 INFO:teuthology.orchestra.run.smithi101.stdout: } 2023-08-01T19:54:28.804 INFO:teuthology.orchestra.run.smithi101.stdout: ], 2023-08-01T19:54:28.804 INFO:teuthology.orchestra.run.smithi101.stdout: "num_ops": 2 2023-08-01T19:54:28.804 INFO:teuthology.orchestra.run.smithi101.stdout:} 2023-08-01T19:54:28.805 DEBUG:teuthology.orchestra.run.smithi101:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 30 ceph --cluster ceph --admin-daemon /var/run/ceph/ceph-osd.1.asok dump_blocked_ops 2023-08-01T19:54:28.846 INFO:tasks.ceph.osd.1.smithi101.stderr:2023-08-01T19:54:28.845+0000 7fb0cb7f6700 -1 received signal: Hangup from /usr/bin/python3 /bin/daemon-helper kill ceph-osd -f --cluster ceph -i 1 (PID: 111141) UID: 0 2023-08-01T19:54:28.917 INFO:tasks.ceph.osd.0.smithi008.stderr:2023-08-01T19:54:28.915+0000 7f16a58f4700 -1 received signal: Hangup from /usr/bin/python3 /bin/daemon-helper kill ceph-osd -f --cluster ceph -i 0 (PID: 111179) UID: 0 2023-08-01T19:54:29.015 INFO:teuthology.orchestra.run.smithi101.stdout:{ 2023-08-01T19:54:29.015 INFO:teuthology.orchestra.run.smithi101.stdout: "ops": [], 2023-08-01T19:54:29.016 INFO:teuthology.orchestra.run.smithi101.stdout: "complaint_time": 30, 2023-08-01T19:54:29.016 INFO:teuthology.orchestra.run.smithi101.stdout: "num_blocked_ops": 0 2023-08-01T19:54:29.016 INFO:teuthology.orchestra.run.smithi101.stdout:} 2023-08-01T19:54:29.017 INFO:tasks.ceph.osd.1.smithi101.stderr:2023-08-01T19:54:29.015+0000 7fb0cb7f6700 -1 received signal: Hangup from /usr/bin/python3 /bin/daemon-helper kill ceph-osd -f --cluster ceph -i 1 (PID: 111141) UID: 0 2023-08-01T19:54:29.030 DEBUG:teuthology.orchestra.run.smithi101:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 30 ceph --cluster ceph --admin-daemon /var/run/ceph/ceph-osd.1.asok dump_historic_ops 2023-08-01T19:54:29.117 INFO:tasks.ceph.osd.2.smithi155.stderr:2023-08-01T19:54:29.117+0000 7faa5c6ac700 -1 received signal: Hangup from /usr/bin/python3 /bin/daemon-helper kill ceph-osd -f --cluster ceph -i 2 (PID: 111337) UID: 0 2023-08-01T19:54:29.219 INFO:tasks.ceph.osd.0.smithi008.stderr:2023-08-01T19:54:29.217+0000 7f16a58f4700 -1 received signal: Hangup from /usr/bin/python3 /bin/daemon-helper kill ceph-osd -f --cluster ceph -i 0 (PID: 111179) UID: 0 2023-08-01T19:54:29.249 INFO:teuthology.orchestra.run.smithi101.stdout:{ 2023-08-01T19:54:29.250 INFO:teuthology.orchestra.run.smithi101.stdout: "size": 20, 2023-08-01T19:54:29.250 INFO:teuthology.orchestra.run.smithi101.stdout: "duration": 600, 2023-08-01T19:54:29.250 INFO:teuthology.orchestra.run.smithi101.stdout: "ops": [ 2023-08-01T19:54:29.250 INFO:teuthology.orchestra.run.smithi101.stdout: { 2023-08-01T19:54:29.251 INFO:teuthology.orchestra.run.smithi101.stdout: "description": "osd_op(mds.0.3:6 3.10 3:0d82a743:::600.00000000:head [omap-set-header] snapc 0=[] ondisk+write+known_if_redirected+full_force+supports_pool_eio e17)", 2023-08-01T19:54:29.251 INFO:teuthology.orchestra.run.smithi101.stdout: "initiated_at": "2023-08-01T19:54:04.458774+0000", 2023-08-01T19:54:29.251 INFO:teuthology.orchestra.run.smithi101.stdout: "age": 24.786373872999999, 2023-08-01T19:54:29.251 INFO:teuthology.orchestra.run.smithi101.stdout: "duration": 0.017582611000000001, 2023-08-01T19:54:29.252 INFO:teuthology.orchestra.run.smithi101.stdout: "type_data": { 2023-08-01T19:54:29.252 INFO:teuthology.orchestra.run.smithi101.stdout: "flag_point": "commit sent; apply or cleanup", 2023-08-01T19:54:29.252 INFO:teuthology.orchestra.run.smithi101.stdout: "events": [ 2023-08-01T19:54:29.252 INFO:teuthology.orchestra.run.smithi101.stdout: { 2023-08-01T19:54:29.253 INFO:teuthology.orchestra.run.smithi101.stdout: "event": "initiated", 2023-08-01T19:54:29.253 INFO:teuthology.orchestra.run.smithi101.stdout: "time": "2023-08-01T19:54:04.458774+0000", 2023-08-01T19:54:29.253 INFO:teuthology.orchestra.run.smithi101.stdout: "duration": 0 2023-08-01T19:54:29.253 INFO:teuthology.orchestra.run.smithi101.stdout: }, 2023-08-01T19:54:29.253 INFO:teuthology.orchestra.run.smithi101.stdout: { 2023-08-01T19:54:29.253 INFO:teuthology.orchestra.run.smithi101.stdout: "event": "throttled", 2023-08-01T19:54:29.253 INFO:teuthology.orchestra.run.smithi101.stdout: "time": "2023-08-01T19:54:04.458774+0000", 2023-08-01T19:54:29.254 INFO:teuthology.orchestra.run.smithi101.stdout: "duration": 0 2023-08-01T19:54:29.254 INFO:teuthology.orchestra.run.smithi101.stdout: }, 2023-08-01T19:54:29.254 INFO:teuthology.orchestra.run.smithi101.stdout: { 2023-08-01T19:54:29.254 INFO:teuthology.orchestra.run.smithi101.stdout: "event": "header_read", 2023-08-01T19:54:29.254 INFO:teuthology.orchestra.run.smithi101.stdout: "time": "2023-08-01T19:54:04.458772+0000", 2023-08-01T19:54:29.254 INFO:teuthology.orchestra.run.smithi101.stdout: "duration": 4294967295.9999981 2023-08-01T19:54:29.254 INFO:teuthology.orchestra.run.smithi101.stdout: }, 2023-08-01T19:54:29.254 INFO:teuthology.orchestra.run.smithi101.stdout: { 2023-08-01T19:54:29.255 INFO:teuthology.orchestra.run.smithi101.stdout: "event": "all_read", 2023-08-01T19:54:29.255 INFO:teuthology.orchestra.run.smithi101.stdout: "time": "2023-08-01T19:54:04.458781+0000", 2023-08-01T19:54:29.255 INFO:teuthology.orchestra.run.smithi101.stdout: "duration": 8.6670000000000002e-06 2023-08-01T19:54:29.255 INFO:teuthology.orchestra.run.smithi101.stdout: }, 2023-08-01T19:54:29.255 INFO:teuthology.orchestra.run.smithi101.stdout: { 2023-08-01T19:54:29.255 INFO:teuthology.orchestra.run.smithi101.stdout: "event": "dispatched", 2023-08-01T19:54:29.255 INFO:teuthology.orchestra.run.smithi101.stdout: "time": "2023-08-01T19:54:04.458797+0000", 2023-08-01T19:54:29.255 INFO:teuthology.orchestra.run.smithi101.stdout: "duration": 1.6463000000000001e-05 2023-08-01T19:54:29.256 INFO:teuthology.orchestra.run.smithi101.stdout: }, 2023-08-01T19:54:29.256 INFO:teuthology.orchestra.run.smithi101.stdout: { 2023-08-01T19:54:29.256 INFO:teuthology.orchestra.run.smithi101.stdout: "event": "queued_for_pg", 2023-08-01T19:54:29.256 INFO:teuthology.orchestra.run.smithi101.stdout: "time": "2023-08-01T19:54:04.458810+0000", 2023-08-01T19:54:29.256 INFO:teuthology.orchestra.run.smithi101.stdout: "duration": 1.2753e-05 2023-08-01T19:54:29.256 INFO:teuthology.orchestra.run.smithi101.stdout: }, 2023-08-01T19:54:29.256 INFO:teuthology.orchestra.run.smithi101.stdout: { 2023-08-01T19:54:29.257 INFO:teuthology.orchestra.run.smithi101.stdout: "event": "reached_pg", 2023-08-01T19:54:29.257 INFO:teuthology.orchestra.run.smithi101.stdout: "time": "2023-08-01T19:54:04.458866+0000", 2023-08-01T19:54:29.257 INFO:teuthology.orchestra.run.smithi101.stdout: "duration": 5.6625000000000001e-05 2023-08-01T19:54:29.257 INFO:teuthology.orchestra.run.smithi101.stdout: }, 2023-08-01T19:54:29.257 INFO:teuthology.orchestra.run.smithi101.stdout: { 2023-08-01T19:54:29.257 INFO:teuthology.orchestra.run.smithi101.stdout: "event": "op must wait for map", 2023-08-01T19:54:29.257 INFO:teuthology.orchestra.run.smithi101.stdout: "time": "2023-08-01T19:54:04.458873+0000", 2023-08-01T19:54:29.258 INFO:teuthology.orchestra.run.smithi101.stdout: "duration": 6.9110000000000004e-06 2023-08-01T19:54:29.258 INFO:teuthology.orchestra.run.smithi101.stdout: }, 2023-08-01T19:54:29.258 INFO:teuthology.orchestra.run.smithi101.stdout: { 2023-08-01T19:54:29.258 INFO:teuthology.orchestra.run.smithi101.stdout: "event": "reached_pg", 2023-08-01T19:54:29.258 INFO:teuthology.orchestra.run.smithi101.stdout: "time": "2023-08-01T19:54:04.466999+0000", 2023-08-01T19:54:29.258 INFO:teuthology.orchestra.run.smithi101.stdout: "duration": 0.0081256550000000007 2023-08-01T19:54:29.258 INFO:teuthology.orchestra.run.smithi101.stdout: }, 2023-08-01T19:54:29.259 INFO:teuthology.orchestra.run.smithi101.stdout: { 2023-08-01T19:54:29.259 INFO:teuthology.orchestra.run.smithi101.stdout: "event": "started", 2023-08-01T19:54:29.259 INFO:teuthology.orchestra.run.smithi101.stdout: "time": "2023-08-01T19:54:04.467201+0000", 2023-08-01T19:54:29.259 INFO:teuthology.orchestra.run.smithi101.stdout: "duration": 0.00020166199999999999 2023-08-01T19:54:29.259 INFO:teuthology.orchestra.run.smithi101.stdout: }, 2023-08-01T19:54:29.259 INFO:teuthology.orchestra.run.smithi101.stdout: { 2023-08-01T19:54:29.259 INFO:teuthology.orchestra.run.smithi101.stdout: "event": "waiting for subops from 2", 2023-08-01T19:54:29.260 INFO:teuthology.orchestra.run.smithi101.stdout: "time": "2023-08-01T19:54:04.467350+0000", 2023-08-01T19:54:29.260 INFO:teuthology.orchestra.run.smithi101.stdout: "duration": 0.000149173 2023-08-01T19:54:29.260 INFO:teuthology.orchestra.run.smithi101.stdout: }, 2023-08-01T19:54:29.260 INFO:teuthology.orchestra.run.smithi101.stdout: { 2023-08-01T19:54:29.260 INFO:teuthology.orchestra.run.smithi101.stdout: "event": "op_commit", 2023-08-01T19:54:29.261 INFO:teuthology.orchestra.run.smithi101.stdout: "time": "2023-08-01T19:54:04.476168+0000", 2023-08-01T19:54:29.261 INFO:teuthology.orchestra.run.smithi101.stdout: "duration": 0.0088183250000000001 2023-08-01T19:54:29.261 INFO:teuthology.orchestra.run.smithi101.stdout: }, 2023-08-01T19:54:29.261 INFO:teuthology.orchestra.run.smithi101.stdout: { 2023-08-01T19:54:29.261 INFO:teuthology.orchestra.run.smithi101.stdout: "event": "sub_op_commit_rec", 2023-08-01T19:54:29.261 INFO:teuthology.orchestra.run.smithi101.stdout: "time": "2023-08-01T19:54:04.476239+0000", 2023-08-01T19:54:29.261 INFO:teuthology.orchestra.run.smithi101.stdout: "duration": 7.1296000000000003e-05 2023-08-01T19:54:29.262 INFO:teuthology.orchestra.run.smithi101.stdout: }, 2023-08-01T19:54:29.262 INFO:teuthology.orchestra.run.smithi101.stdout: { 2023-08-01T19:54:29.262 INFO:teuthology.orchestra.run.smithi101.stdout: "event": "commit_sent", 2023-08-01T19:54:29.262 INFO:teuthology.orchestra.run.smithi101.stdout: "time": "2023-08-01T19:54:04.476290+0000", 2023-08-01T19:54:29.262 INFO:teuthology.orchestra.run.smithi101.stdout: "duration": 5.0423999999999997e-05 2023-08-01T19:54:29.262 INFO:teuthology.orchestra.run.smithi101.stdout: }, 2023-08-01T19:54:29.262 INFO:teuthology.orchestra.run.smithi101.stdout: { 2023-08-01T19:54:29.262 INFO:teuthology.orchestra.run.smithi101.stdout: "event": "done", 2023-08-01T19:54:29.263 INFO:teuthology.orchestra.run.smithi101.stdout: "time": "2023-08-01T19:54:04.476356+0000", 2023-08-01T19:54:29.263 INFO:teuthology.orchestra.run.smithi101.stdout: "duration": 6.6439000000000005e-05 2023-08-01T19:54:29.263 INFO:teuthology.orchestra.run.smithi101.stdout: } 2023-08-01T19:54:29.263 INFO:teuthology.orchestra.run.smithi101.stdout: ] 2023-08-01T19:54:29.263 INFO:teuthology.orchestra.run.smithi101.stdout: } 2023-08-01T19:54:29.263 INFO:teuthology.orchestra.run.smithi101.stdout: }, 2023-08-01T19:54:29.263 INFO:teuthology.orchestra.run.smithi101.stdout: { 2023-08-01T19:54:29.263 INFO:teuthology.orchestra.run.smithi101.stdout: "description": "osd_op(mds.0.3:7 3.10 3:0d82a743:::600.00000000:head [create,setxattr parent (62) in=6b,setxattr layout (30) in=6b] snapc 0=[] ondisk+write+known_if_redirected+full_force+supports_pool_eio e17)", 2023-08-01T19:54:29.264 INFO:teuthology.orchestra.run.smithi101.stdout: "initiated_at": "2023-08-01T19:54:04.458830+0000", 2023-08-01T19:54:29.264 INFO:teuthology.orchestra.run.smithi101.stdout: "age": 24.786317486000002, 2023-08-01T19:54:29.264 INFO:teuthology.orchestra.run.smithi101.stdout: "duration": 0.018463726, 2023-08-01T19:54:29.264 INFO:teuthology.orchestra.run.smithi101.stdout: "type_data": { 2023-08-01T19:54:29.264 INFO:teuthology.orchestra.run.smithi101.stdout: "flag_point": "commit sent; apply or cleanup", 2023-08-01T19:54:29.264 INFO:teuthology.orchestra.run.smithi101.stdout: "events": [ 2023-08-01T19:54:29.264 INFO:teuthology.orchestra.run.smithi101.stdout: { 2023-08-01T19:54:29.265 INFO:teuthology.orchestra.run.smithi101.stdout: "event": "initiated", 2023-08-01T19:54:29.265 INFO:teuthology.orchestra.run.smithi101.stdout: "time": "2023-08-01T19:54:04.458830+0000", 2023-08-01T19:54:29.265 INFO:teuthology.orchestra.run.smithi101.stdout: "duration": 0 2023-08-01T19:54:29.265 INFO:teuthology.orchestra.run.smithi101.stdout: }, 2023-08-01T19:54:29.265 INFO:teuthology.orchestra.run.smithi101.stdout: { 2023-08-01T19:54:29.265 INFO:teuthology.orchestra.run.smithi101.stdout: "event": "throttled", 2023-08-01T19:54:29.265 INFO:teuthology.orchestra.run.smithi101.stdout: "time": "2023-08-01T19:54:04.458830+0000", 2023-08-01T19:54:29.265 INFO:teuthology.orchestra.run.smithi101.stdout: "duration": 0 2023-08-01T19:54:29.266 INFO:teuthology.orchestra.run.smithi101.stdout: }, 2023-08-01T19:54:29.266 INFO:teuthology.orchestra.run.smithi101.stdout: { 2023-08-01T19:54:29.266 INFO:teuthology.orchestra.run.smithi101.stdout: "event": "header_read", 2023-08-01T19:54:29.266 INFO:teuthology.orchestra.run.smithi101.stdout: "time": "2023-08-01T19:54:04.458829+0000", 2023-08-01T19:54:29.266 INFO:teuthology.orchestra.run.smithi101.stdout: "duration": 4294967295.999999 2023-08-01T19:54:29.266 INFO:teuthology.orchestra.run.smithi101.stdout: }, 2023-08-01T19:54:29.266 INFO:teuthology.orchestra.run.smithi101.stdout: { 2023-08-01T19:54:29.266 INFO:teuthology.orchestra.run.smithi101.stdout: "event": "all_read", 2023-08-01T19:54:29.267 INFO:teuthology.orchestra.run.smithi101.stdout: "time": "2023-08-01T19:54:04.458838+0000", 2023-08-01T19:54:29.267 INFO:teuthology.orchestra.run.smithi101.stdout: "duration": 8.5369999999999997e-06 2023-08-01T19:54:29.267 INFO:teuthology.orchestra.run.smithi101.stdout: }, 2023-08-01T19:54:29.267 INFO:teuthology.orchestra.run.smithi101.stdout: { 2023-08-01T19:54:29.267 INFO:teuthology.orchestra.run.smithi101.stdout: "event": "dispatched", 2023-08-01T19:54:29.267 INFO:teuthology.orchestra.run.smithi101.stdout: "time": "2023-08-01T19:54:04.458850+0000", 2023-08-01T19:54:29.267 INFO:teuthology.orchestra.run.smithi101.stdout: "duration": 1.203e-05 2023-08-01T19:54:29.267 INFO:teuthology.orchestra.run.smithi101.stdout: }, 2023-08-01T19:54:29.268 INFO:teuthology.orchestra.run.smithi101.stdout: { 2023-08-01T19:54:29.268 INFO:teuthology.orchestra.run.smithi101.stdout: "event": "queued_for_pg", 2023-08-01T19:54:29.268 INFO:teuthology.orchestra.run.smithi101.stdout: "time": "2023-08-01T19:54:04.458859+0000", 2023-08-01T19:54:29.268 INFO:teuthology.orchestra.run.smithi101.stdout: "duration": 8.9889999999999998e-06 2023-08-01T19:54:29.268 INFO:teuthology.orchestra.run.smithi101.stdout: }, 2023-08-01T19:54:29.268 INFO:teuthology.orchestra.run.smithi101.stdout: { 2023-08-01T19:54:29.268 INFO:teuthology.orchestra.run.smithi101.stdout: "event": "reached_pg", 2023-08-01T19:54:29.269 INFO:teuthology.orchestra.run.smithi101.stdout: "time": "2023-08-01T19:54:04.458926+0000", 2023-08-01T19:54:29.269 INFO:teuthology.orchestra.run.smithi101.stdout: "duration": 6.6741000000000004e-05 2023-08-01T19:54:29.269 INFO:teuthology.orchestra.run.smithi101.stdout: }, 2023-08-01T19:54:29.269 INFO:teuthology.orchestra.run.smithi101.stdout: { 2023-08-01T19:54:29.269 INFO:teuthology.orchestra.run.smithi101.stdout: "event": "waiting_for_map not empty", 2023-08-01T19:54:29.269 INFO:teuthology.orchestra.run.smithi101.stdout: "time": "2023-08-01T19:54:04.458929+0000", 2023-08-01T19:54:29.269 INFO:teuthology.orchestra.run.smithi101.stdout: "duration": 3.303e-06 2023-08-01T19:54:29.269 INFO:teuthology.orchestra.run.smithi101.stdout: }, 2023-08-01T19:54:29.270 INFO:teuthology.orchestra.run.smithi101.stdout: { 2023-08-01T19:54:29.270 INFO:teuthology.orchestra.run.smithi101.stdout: "event": "reached_pg", 2023-08-01T19:54:29.270 INFO:teuthology.orchestra.run.smithi101.stdout: "time": "2023-08-01T19:54:04.468692+0000", 2023-08-01T19:54:29.270 INFO:teuthology.orchestra.run.smithi101.stdout: "duration": 0.0097635910000000003 2023-08-01T19:54:29.270 INFO:teuthology.orchestra.run.smithi101.stdout: }, 2023-08-01T19:54:29.270 INFO:teuthology.orchestra.run.smithi101.stdout: { 2023-08-01T19:54:29.270 INFO:teuthology.orchestra.run.smithi101.stdout: "event": "started", 2023-08-01T19:54:29.270 INFO:teuthology.orchestra.run.smithi101.stdout: "time": "2023-08-01T19:54:04.468774+0000", 2023-08-01T19:54:29.271 INFO:teuthology.orchestra.run.smithi101.stdout: "duration": 8.1092000000000002e-05 2023-08-01T19:54:29.271 INFO:teuthology.orchestra.run.smithi101.stdout: }, 2023-08-01T19:54:29.271 INFO:teuthology.orchestra.run.smithi101.stdout: { 2023-08-01T19:54:29.271 INFO:teuthology.orchestra.run.smithi101.stdout: "event": "waiting for subops from 2", 2023-08-01T19:54:29.271 INFO:teuthology.orchestra.run.smithi101.stdout: "time": "2023-08-01T19:54:04.468934+0000", 2023-08-01T19:54:29.271 INFO:teuthology.orchestra.run.smithi101.stdout: "duration": 0.000160027 2023-08-01T19:54:29.271 INFO:teuthology.orchestra.run.smithi101.stdout: }, 2023-08-01T19:54:29.271 INFO:teuthology.orchestra.run.smithi101.stdout: { 2023-08-01T19:54:29.272 INFO:teuthology.orchestra.run.smithi101.stdout: "event": "op_commit", 2023-08-01T19:54:29.272 INFO:teuthology.orchestra.run.smithi101.stdout: "time": "2023-08-01T19:54:04.476174+0000", 2023-08-01T19:54:29.272 INFO:teuthology.orchestra.run.smithi101.stdout: "duration": 0.0072400479999999998 2023-08-01T19:54:29.272 INFO:teuthology.orchestra.run.smithi101.stdout: }, 2023-08-01T19:54:29.272 INFO:teuthology.orchestra.run.smithi101.stdout: { 2023-08-01T19:54:29.272 INFO:teuthology.orchestra.run.smithi101.stdout: "event": "sub_op_commit_rec", 2023-08-01T19:54:29.272 INFO:teuthology.orchestra.run.smithi101.stdout: "time": "2023-08-01T19:54:04.477206+0000", 2023-08-01T19:54:29.273 INFO:teuthology.orchestra.run.smithi101.stdout: "duration": 0.0010318969999999999 2023-08-01T19:54:29.273 INFO:teuthology.orchestra.run.smithi101.stdout: }, 2023-08-01T19:54:29.273 INFO:teuthology.orchestra.run.smithi101.stdout: { 2023-08-01T19:54:29.273 INFO:teuthology.orchestra.run.smithi101.stdout: "event": "commit_sent", 2023-08-01T19:54:29.273 INFO:teuthology.orchestra.run.smithi101.stdout: "time": "2023-08-01T19:54:04.477257+0000", 2023-08-01T19:54:29.273 INFO:teuthology.orchestra.run.smithi101.stdout: "duration": 5.1156000000000003e-05 2023-08-01T19:54:29.273 INFO:teuthology.orchestra.run.smithi101.stdout: }, 2023-08-01T19:54:29.273 INFO:teuthology.orchestra.run.smithi101.stdout: { 2023-08-01T19:54:29.274 INFO:teuthology.orchestra.run.smithi101.stdout: "event": "done", 2023-08-01T19:54:29.274 INFO:teuthology.orchestra.run.smithi101.stdout: "time": "2023-08-01T19:54:04.477294+0000", 2023-08-01T19:54:29.274 INFO:teuthology.orchestra.run.smithi101.stdout: "duration": 3.7150000000000002e-05 2023-08-01T19:54:29.274 INFO:teuthology.orchestra.run.smithi101.stdout: } 2023-08-01T19:54:29.274 INFO:teuthology.orchestra.run.smithi101.stdout: ] 2023-08-01T19:54:29.274 INFO:teuthology.orchestra.run.smithi101.stdout: } 2023-08-01T19:54:29.274 INFO:teuthology.orchestra.run.smithi101.stdout: }, 2023-08-01T19:54:29.274 INFO:teuthology.orchestra.run.smithi101.stdout: { 2023-08-01T19:54:29.275 INFO:teuthology.orchestra.run.smithi101.stdout: "description": "osd_op(mds.0.3:8 3.10 3:09401a81:::601.00000000:head [omap-set-header] snapc 0=[] ondisk+write+known_if_redirected+full_force+supports_pool_eio e17)", 2023-08-01T19:54:29.275 INFO:teuthology.orchestra.run.smithi101.stdout: "initiated_at": "2023-08-01T19:54:04.458869+0000", 2023-08-01T19:54:29.275 INFO:teuthology.orchestra.run.smithi101.stdout: "age": 24.78627835, 2023-08-01T19:54:29.275 INFO:teuthology.orchestra.run.smithi101.stdout: "duration": 0.018528932000000001, 2023-08-01T19:54:29.275 INFO:teuthology.orchestra.run.smithi101.stdout: "type_data": { 2023-08-01T19:54:29.275 INFO:teuthology.orchestra.run.smithi101.stdout: "flag_point": "commit sent; apply or cleanup", 2023-08-01T19:54:29.275 INFO:teuthology.orchestra.run.smithi101.stdout: "events": [ 2023-08-01T19:54:29.275 INFO:teuthology.orchestra.run.smithi101.stdout: { 2023-08-01T19:54:29.276 INFO:teuthology.orchestra.run.smithi101.stdout: "event": "initiated", 2023-08-01T19:54:29.276 INFO:teuthology.orchestra.run.smithi101.stdout: "time": "2023-08-01T19:54:04.458869+0000", 2023-08-01T19:54:29.276 INFO:teuthology.orchestra.run.smithi101.stdout: "duration": 0 2023-08-01T19:54:29.276 INFO:teuthology.orchestra.run.smithi101.stdout: }, 2023-08-01T19:54:29.276 INFO:teuthology.orchestra.run.smithi101.stdout: { 2023-08-01T19:54:29.276 INFO:teuthology.orchestra.run.smithi101.stdout: "event": "throttled", 2023-08-01T19:54:29.276 INFO:teuthology.orchestra.run.smithi101.stdout: "time": "2023-08-01T19:54:04.458869+0000", 2023-08-01T19:54:29.277 INFO:teuthology.orchestra.run.smithi101.stdout: "duration": 0 2023-08-01T19:54:29.277 INFO:teuthology.orchestra.run.smithi101.stdout: }, 2023-08-01T19:54:29.277 INFO:teuthology.orchestra.run.smithi101.stdout: { 2023-08-01T19:54:29.277 INFO:teuthology.orchestra.run.smithi101.stdout: "event": "header_read", 2023-08-01T19:54:29.277 INFO:teuthology.orchestra.run.smithi101.stdout: "time": "2023-08-01T19:54:04.458869+0000", 2023-08-01T19:54:29.277 INFO:teuthology.orchestra.run.smithi101.stdout: "duration": 4294967295.9999995 2023-08-01T19:54:29.277 INFO:teuthology.orchestra.run.smithi101.stdout: }, 2023-08-01T19:54:29.277 INFO:teuthology.orchestra.run.smithi101.stdout: { 2023-08-01T19:54:29.278 INFO:teuthology.orchestra.run.smithi101.stdout: "event": "all_read", 2023-08-01T19:54:29.278 INFO:teuthology.orchestra.run.smithi101.stdout: "time": "2023-08-01T19:54:04.458878+0000", 2023-08-01T19:54:29.278 INFO:teuthology.orchestra.run.smithi101.stdout: "duration": 9.4110000000000002e-06 2023-08-01T19:54:29.278 INFO:teuthology.orchestra.run.smithi101.stdout: }, 2023-08-01T19:54:29.278 INFO:teuthology.orchestra.run.smithi101.stdout: { 2023-08-01T19:54:29.278 INFO:teuthology.orchestra.run.smithi101.stdout: "event": "dispatched", 2023-08-01T19:54:29.278 INFO:teuthology.orchestra.run.smithi101.stdout: "time": "2023-08-01T19:54:04.458886+0000", 2023-08-01T19:54:29.278 INFO:teuthology.orchestra.run.smithi101.stdout: "duration": 7.6090000000000003e-06 2023-08-01T19:54:29.279 INFO:teuthology.orchestra.run.smithi101.stdout: }, 2023-08-01T19:54:29.279 INFO:teuthology.orchestra.run.smithi101.stdout: { 2023-08-01T19:54:29.279 INFO:teuthology.orchestra.run.smithi101.stdout: "event": "queued_for_pg", 2023-08-01T19:54:29.279 INFO:teuthology.orchestra.run.smithi101.stdout: "time": "2023-08-01T19:54:04.458890+0000", 2023-08-01T19:54:29.279 INFO:teuthology.orchestra.run.smithi101.stdout: "duration": 4.8470000000000003e-06 2023-08-01T19:54:29.279 INFO:teuthology.orchestra.run.smithi101.stdout: }, 2023-08-01T19:54:29.279 INFO:teuthology.orchestra.run.smithi101.stdout: { 2023-08-01T19:54:29.279 INFO:teuthology.orchestra.run.smithi101.stdout: "event": "reached_pg", 2023-08-01T19:54:29.280 INFO:teuthology.orchestra.run.smithi101.stdout: "time": "2023-08-01T19:54:04.458957+0000", 2023-08-01T19:54:29.280 INFO:teuthology.orchestra.run.smithi101.stdout: "duration": 6.6502999999999997e-05 2023-08-01T19:54:29.280 INFO:teuthology.orchestra.run.smithi101.stdout: }, 2023-08-01T19:54:29.280 INFO:teuthology.orchestra.run.smithi101.stdout: { 2023-08-01T19:54:29.280 INFO:teuthology.orchestra.run.smithi101.stdout: "event": "waiting_for_map not empty", 2023-08-01T19:54:29.280 INFO:teuthology.orchestra.run.smithi101.stdout: "time": "2023-08-01T19:54:04.458959+0000", 2023-08-01T19:54:29.280 INFO:teuthology.orchestra.run.smithi101.stdout: "duration": 2.3989999999999998e-06 2023-08-01T19:54:29.281 INFO:teuthology.orchestra.run.smithi101.stdout: }, 2023-08-01T19:54:29.281 INFO:teuthology.orchestra.run.smithi101.stdout: { 2023-08-01T19:54:29.281 INFO:teuthology.orchestra.run.smithi101.stdout: "event": "reached_pg", 2023-08-01T19:54:29.281 INFO:teuthology.orchestra.run.smithi101.stdout: "time": "2023-08-01T19:54:04.469554+0000", 2023-08-01T19:54:29.281 INFO:teuthology.orchestra.run.smithi101.stdout: "duration": 0.010594404 2023-08-01T19:54:29.281 INFO:teuthology.orchestra.run.smithi101.stdout: }, 2023-08-01T19:54:29.281 INFO:teuthology.orchestra.run.smithi101.stdout: { 2023-08-01T19:54:29.281 INFO:teuthology.orchestra.run.smithi101.stdout: "event": "started", 2023-08-01T19:54:29.282 INFO:teuthology.orchestra.run.smithi101.stdout: "time": "2023-08-01T19:54:04.469694+0000", 2023-08-01T19:54:29.282 INFO:teuthology.orchestra.run.smithi101.stdout: "duration": 0.00014006899999999999 2023-08-01T19:54:29.282 INFO:teuthology.orchestra.run.smithi101.stdout: }, 2023-08-01T19:54:29.282 INFO:teuthology.orchestra.run.smithi101.stdout: { 2023-08-01T19:54:29.282 INFO:teuthology.orchestra.run.smithi101.stdout: "event": "waiting for subops from 2", 2023-08-01T19:54:29.282 INFO:teuthology.orchestra.run.smithi101.stdout: "time": "2023-08-01T19:54:04.469826+0000", 2023-08-01T19:54:29.282 INFO:teuthology.orchestra.run.smithi101.stdout: "duration": 0.000132285 2023-08-01T19:54:29.283 INFO:teuthology.orchestra.run.smithi101.stdout: }, 2023-08-01T19:54:29.283 INFO:teuthology.orchestra.run.smithi101.stdout: { 2023-08-01T19:54:29.283 INFO:teuthology.orchestra.run.smithi101.stdout: "event": "op_commit", 2023-08-01T19:54:29.283 INFO:teuthology.orchestra.run.smithi101.stdout: "time": "2023-08-01T19:54:04.476179+0000", 2023-08-01T19:54:29.283 INFO:teuthology.orchestra.run.smithi101.stdout: "duration": 0.0063524289999999997 2023-08-01T19:54:29.283 INFO:teuthology.orchestra.run.smithi101.stdout: }, 2023-08-01T19:54:29.283 INFO:teuthology.orchestra.run.smithi101.stdout: { 2023-08-01T19:54:29.283 INFO:teuthology.orchestra.run.smithi101.stdout: "event": "sub_op_commit_rec", 2023-08-01T19:54:29.284 INFO:teuthology.orchestra.run.smithi101.stdout: "time": "2023-08-01T19:54:04.477334+0000", 2023-08-01T19:54:29.284 INFO:teuthology.orchestra.run.smithi101.stdout: "duration": 0.0011551070000000001 2023-08-01T19:54:29.284 INFO:teuthology.orchestra.run.smithi101.stdout: }, 2023-08-01T19:54:29.284 INFO:teuthology.orchestra.run.smithi101.stdout: { 2023-08-01T19:54:29.284 INFO:teuthology.orchestra.run.smithi101.stdout: "event": "commit_sent", 2023-08-01T19:54:29.284 INFO:teuthology.orchestra.run.smithi101.stdout: "time": "2023-08-01T19:54:04.477371+0000", 2023-08-01T19:54:29.284 INFO:teuthology.orchestra.run.smithi101.stdout: "duration": 3.7425000000000002e-05 2023-08-01T19:54:29.285 INFO:teuthology.orchestra.run.smithi101.stdout: }, 2023-08-01T19:54:29.285 INFO:teuthology.orchestra.run.smithi101.stdout: { 2023-08-01T19:54:29.285 INFO:teuthology.orchestra.run.smithi101.stdout: "event": "done", 2023-08-01T19:54:29.285 INFO:teuthology.orchestra.run.smithi101.stdout: "time": "2023-08-01T19:54:04.477398+0000", 2023-08-01T19:54:29.285 INFO:teuthology.orchestra.run.smithi101.stdout: "duration": 2.7078000000000001e-05 2023-08-01T19:54:29.285 INFO:teuthology.orchestra.run.smithi101.stdout: } 2023-08-01T19:54:29.285 INFO:teuthology.orchestra.run.smithi101.stdout: ] 2023-08-01T19:54:29.285 INFO:teuthology.orchestra.run.smithi101.stdout: } 2023-08-01T19:54:29.286 INFO:teuthology.orchestra.run.smithi101.stdout: }, 2023-08-01T19:54:29.286 INFO:teuthology.orchestra.run.smithi101.stdout: { 2023-08-01T19:54:29.286 INFO:teuthology.orchestra.run.smithi101.stdout: "description": "osd_op(mds.0.3:9 3.10 3:09401a81:::601.00000000:head [create,setxattr parent (62) in=6b,setxattr layout (30) in=6b] snapc 0=[] ondisk+write+known_if_redirected+full_force+supports_pool_eio e17)", 2023-08-01T19:54:29.286 INFO:teuthology.orchestra.run.smithi101.stdout: "initiated_at": "2023-08-01T19:54:04.458896+0000", 2023-08-01T19:54:29.286 INFO:teuthology.orchestra.run.smithi101.stdout: "age": 24.786251183000001, 2023-08-01T19:54:29.286 INFO:teuthology.orchestra.run.smithi101.stdout: "duration": 0.018577215000000001, 2023-08-01T19:54:29.286 INFO:teuthology.orchestra.run.smithi101.stdout: "type_data": { 2023-08-01T19:54:29.286 INFO:teuthology.orchestra.run.smithi101.stdout: "flag_point": "commit sent; apply or cleanup", 2023-08-01T19:54:29.287 INFO:teuthology.orchestra.run.smithi101.stdout: "events": [ 2023-08-01T19:54:29.287 INFO:teuthology.orchestra.run.smithi101.stdout: { 2023-08-01T19:54:29.287 INFO:teuthology.orchestra.run.smithi101.stdout: "event": "initiated", 2023-08-01T19:54:29.287 INFO:teuthology.orchestra.run.smithi101.stdout: "time": "2023-08-01T19:54:04.458896+0000", 2023-08-01T19:54:29.287 INFO:teuthology.orchestra.run.smithi101.stdout: "duration": 0 2023-08-01T19:54:29.287 INFO:teuthology.orchestra.run.smithi101.stdout: }, 2023-08-01T19:54:29.287 INFO:teuthology.orchestra.run.smithi101.stdout: { 2023-08-01T19:54:29.287 INFO:teuthology.orchestra.run.smithi101.stdout: "event": "throttled", 2023-08-01T19:54:29.288 INFO:teuthology.orchestra.run.smithi101.stdout: "time": "2023-08-01T19:54:04.458896+0000", 2023-08-01T19:54:29.288 INFO:teuthology.orchestra.run.smithi101.stdout: "duration": 0 2023-08-01T19:54:29.288 INFO:teuthology.orchestra.run.smithi101.stdout: }, 2023-08-01T19:54:29.288 INFO:teuthology.orchestra.run.smithi101.stdout: { 2023-08-01T19:54:29.288 INFO:teuthology.orchestra.run.smithi101.stdout: "event": "header_read", 2023-08-01T19:54:29.288 INFO:teuthology.orchestra.run.smithi101.stdout: "time": "2023-08-01T19:54:04.458896+0000", 2023-08-01T19:54:29.288 INFO:teuthology.orchestra.run.smithi101.stdout: "duration": 4294967295.9999995 2023-08-01T19:54:29.288 INFO:teuthology.orchestra.run.smithi101.stdout: }, 2023-08-01T19:54:29.289 INFO:teuthology.orchestra.run.smithi101.stdout: { 2023-08-01T19:54:29.289 INFO:teuthology.orchestra.run.smithi101.stdout: "event": "all_read", 2023-08-01T19:54:29.289 INFO:teuthology.orchestra.run.smithi101.stdout: "time": "2023-08-01T19:54:04.458900+0000", 2023-08-01T19:54:29.289 INFO:teuthology.orchestra.run.smithi101.stdout: "duration": 4.0829999999999997e-06 2023-08-01T19:54:29.289 INFO:teuthology.orchestra.run.smithi101.stdout: }, 2023-08-01T19:54:29.289 INFO:teuthology.orchestra.run.smithi101.stdout: { 2023-08-01T19:54:29.289 INFO:teuthology.orchestra.run.smithi101.stdout: "event": "dispatched", 2023-08-01T19:54:29.290 INFO:teuthology.orchestra.run.smithi101.stdout: "time": "2023-08-01T19:54:04.458906+0000", 2023-08-01T19:54:29.290 INFO:teuthology.orchestra.run.smithi101.stdout: "duration": 6.4099999999999996e-06 2023-08-01T19:54:29.290 INFO:teuthology.orchestra.run.smithi101.stdout: }, 2023-08-01T19:54:29.290 INFO:teuthology.orchestra.run.smithi101.stdout: { 2023-08-01T19:54:29.290 INFO:teuthology.orchestra.run.smithi101.stdout: "event": "queued_for_pg", 2023-08-01T19:54:29.290 INFO:teuthology.orchestra.run.smithi101.stdout: "time": "2023-08-01T19:54:04.458911+0000", 2023-08-01T19:54:29.290 INFO:teuthology.orchestra.run.smithi101.stdout: "duration": 4.0500000000000002e-06 2023-08-01T19:54:29.290 INFO:teuthology.orchestra.run.smithi101.stdout: }, 2023-08-01T19:54:29.291 INFO:teuthology.orchestra.run.smithi101.stdout: { 2023-08-01T19:54:29.291 INFO:teuthology.orchestra.run.smithi101.stdout: "event": "reached_pg", 2023-08-01T19:54:29.291 INFO:teuthology.orchestra.run.smithi101.stdout: "time": "2023-08-01T19:54:04.458981+0000", 2023-08-01T19:54:29.291 INFO:teuthology.orchestra.run.smithi101.stdout: "duration": 7.0121000000000002e-05 2023-08-01T19:54:29.291 INFO:teuthology.orchestra.run.smithi101.stdout: }, 2023-08-01T19:54:29.291 INFO:teuthology.orchestra.run.smithi101.stdout: { 2023-08-01T19:54:29.291 INFO:teuthology.orchestra.run.smithi101.stdout: "event": "waiting_for_map not empty", 2023-08-01T19:54:29.291 INFO:teuthology.orchestra.run.smithi101.stdout: "time": "2023-08-01T19:54:04.458983+0000", 2023-08-01T19:54:29.292 INFO:teuthology.orchestra.run.smithi101.stdout: "duration": 2.2299999999999998e-06 2023-08-01T19:54:29.292 INFO:teuthology.orchestra.run.smithi101.stdout: }, 2023-08-01T19:54:29.292 INFO:teuthology.orchestra.run.smithi101.stdout: { 2023-08-01T19:54:29.292 INFO:teuthology.orchestra.run.smithi101.stdout: "event": "reached_pg", 2023-08-01T19:54:29.292 INFO:teuthology.orchestra.run.smithi101.stdout: "time": "2023-08-01T19:54:04.470122+0000", 2023-08-01T19:54:29.292 INFO:teuthology.orchestra.run.smithi101.stdout: "duration": 0.011139593999999999 2023-08-01T19:54:29.292 INFO:teuthology.orchestra.run.smithi101.stdout: }, 2023-08-01T19:54:29.292 INFO:teuthology.orchestra.run.smithi101.stdout: { 2023-08-01T19:54:29.293 INFO:teuthology.orchestra.run.smithi101.stdout: "event": "started", 2023-08-01T19:54:29.293 INFO:teuthology.orchestra.run.smithi101.stdout: "time": "2023-08-01T19:54:04.470217+0000", 2023-08-01T19:54:29.293 INFO:teuthology.orchestra.run.smithi101.stdout: "duration": 9.4388000000000005e-05 2023-08-01T19:54:29.293 INFO:teuthology.orchestra.run.smithi101.stdout: }, 2023-08-01T19:54:29.293 INFO:teuthology.orchestra.run.smithi101.stdout: { 2023-08-01T19:54:29.293 INFO:teuthology.orchestra.run.smithi101.stdout: "event": "waiting for subops from 2", 2023-08-01T19:54:29.293 INFO:teuthology.orchestra.run.smithi101.stdout: "time": "2023-08-01T19:54:04.470714+0000", 2023-08-01T19:54:29.293 INFO:teuthology.orchestra.run.smithi101.stdout: "duration": 0.00049680999999999998 2023-08-01T19:54:29.294 INFO:teuthology.orchestra.run.smithi101.stdout: }, 2023-08-01T19:54:29.294 INFO:teuthology.orchestra.run.smithi101.stdout: { 2023-08-01T19:54:29.294 INFO:teuthology.orchestra.run.smithi101.stdout: "event": "op_commit", 2023-08-01T19:54:29.294 INFO:teuthology.orchestra.run.smithi101.stdout: "time": "2023-08-01T19:54:04.476183+0000", 2023-08-01T19:54:29.294 INFO:teuthology.orchestra.run.smithi101.stdout: "duration": 0.0054695880000000001 2023-08-01T19:54:29.294 INFO:teuthology.orchestra.run.smithi101.stdout: }, 2023-08-01T19:54:29.294 INFO:teuthology.orchestra.run.smithi101.stdout: { 2023-08-01T19:54:29.294 INFO:teuthology.orchestra.run.smithi101.stdout: "event": "sub_op_commit_rec", 2023-08-01T19:54:29.295 INFO:teuthology.orchestra.run.smithi101.stdout: "time": "2023-08-01T19:54:04.477428+0000", 2023-08-01T19:54:29.295 INFO:teuthology.orchestra.run.smithi101.stdout: "duration": 0.001244843 2023-08-01T19:54:29.295 INFO:teuthology.orchestra.run.smithi101.stdout: }, 2023-08-01T19:54:29.295 INFO:teuthology.orchestra.run.smithi101.stdout: { 2023-08-01T19:54:29.295 INFO:teuthology.orchestra.run.smithi101.stdout: "event": "commit_sent", 2023-08-01T19:54:29.295 INFO:teuthology.orchestra.run.smithi101.stdout: "time": "2023-08-01T19:54:04.477456+0000", 2023-08-01T19:54:29.295 INFO:teuthology.orchestra.run.smithi101.stdout: "duration": 2.7538e-05 2023-08-01T19:54:29.295 INFO:teuthology.orchestra.run.smithi101.stdout: }, 2023-08-01T19:54:29.296 INFO:teuthology.orchestra.run.smithi101.stdout: { 2023-08-01T19:54:29.296 INFO:teuthology.orchestra.run.smithi101.stdout: "event": "done", 2023-08-01T19:54:29.296 INFO:teuthology.orchestra.run.smithi101.stdout: "time": "2023-08-01T19:54:04.477474+0000", 2023-08-01T19:54:29.296 INFO:teuthology.orchestra.run.smithi101.stdout: "duration": 1.7974000000000001e-05 2023-08-01T19:54:29.296 INFO:teuthology.orchestra.run.smithi101.stdout: } 2023-08-01T19:54:29.296 INFO:teuthology.orchestra.run.smithi101.stdout: ] 2023-08-01T19:54:29.296 INFO:teuthology.orchestra.run.smithi101.stdout: } 2023-08-01T19:54:29.296 INFO:teuthology.orchestra.run.smithi101.stdout: }, 2023-08-01T19:54:29.297 INFO:teuthology.orchestra.run.smithi101.stdout: { 2023-08-01T19:54:29.297 INFO:teuthology.orchestra.run.smithi101.stdout: "description": "osd_op(mds.0.3:10 3.10 3:0bd6d154:::602.00000000:head [omap-set-header] snapc 0=[] ondisk+write+known_if_redirected+full_force+supports_pool_eio e17)", 2023-08-01T19:54:29.297 INFO:teuthology.orchestra.run.smithi101.stdout: "initiated_at": "2023-08-01T19:54:04.458927+0000", 2023-08-01T19:54:29.297 INFO:teuthology.orchestra.run.smithi101.stdout: "age": 24.786220204999999, 2023-08-01T19:54:29.297 INFO:teuthology.orchestra.run.smithi101.stdout: "duration": 0.019574352, 2023-08-01T19:54:29.297 INFO:teuthology.orchestra.run.smithi101.stdout: "type_data": { 2023-08-01T19:54:29.297 INFO:teuthology.orchestra.run.smithi101.stdout: "flag_point": "commit sent; apply or cleanup", 2023-08-01T19:54:29.297 INFO:teuthology.orchestra.run.smithi101.stdout: "events": [ 2023-08-01T19:54:29.298 INFO:teuthology.orchestra.run.smithi101.stdout: { 2023-08-01T19:54:29.298 INFO:teuthology.orchestra.run.smithi101.stdout: "event": "initiated", 2023-08-01T19:54:29.298 INFO:teuthology.orchestra.run.smithi101.stdout: "time": "2023-08-01T19:54:04.458927+0000", 2023-08-01T19:54:29.298 INFO:teuthology.orchestra.run.smithi101.stdout: "duration": 0 2023-08-01T19:54:29.298 INFO:teuthology.orchestra.run.smithi101.stdout: }, 2023-08-01T19:54:29.298 INFO:teuthology.orchestra.run.smithi101.stdout: { 2023-08-01T19:54:29.298 INFO:teuthology.orchestra.run.smithi101.stdout: "event": "throttled", 2023-08-01T19:54:29.299 INFO:teuthology.orchestra.run.smithi101.stdout: "time": "2023-08-01T19:54:04.458927+0000", 2023-08-01T19:54:29.299 INFO:teuthology.orchestra.run.smithi101.stdout: "duration": 0 2023-08-01T19:54:29.299 INFO:teuthology.orchestra.run.smithi101.stdout: }, 2023-08-01T19:54:29.299 INFO:teuthology.orchestra.run.smithi101.stdout: { 2023-08-01T19:54:29.299 INFO:teuthology.orchestra.run.smithi101.stdout: "event": "header_read", 2023-08-01T19:54:29.299 INFO:teuthology.orchestra.run.smithi101.stdout: "time": "2023-08-01T19:54:04.458927+0000", 2023-08-01T19:54:29.299 INFO:teuthology.orchestra.run.smithi101.stdout: "duration": 4294967295.9999995 2023-08-01T19:54:29.299 INFO:teuthology.orchestra.run.smithi101.stdout: }, 2023-08-01T19:54:29.300 INFO:teuthology.orchestra.run.smithi101.stdout: { 2023-08-01T19:54:29.300 INFO:teuthology.orchestra.run.smithi101.stdout: "event": "all_read", 2023-08-01T19:54:29.300 INFO:teuthology.orchestra.run.smithi101.stdout: "time": "2023-08-01T19:54:04.458931+0000", 2023-08-01T19:54:29.300 INFO:teuthology.orchestra.run.smithi101.stdout: "duration": 4.3000000000000003e-06 2023-08-01T19:54:29.300 INFO:teuthology.orchestra.run.smithi101.stdout: }, 2023-08-01T19:54:29.300 INFO:teuthology.orchestra.run.smithi101.stdout: { 2023-08-01T19:54:29.300 INFO:teuthology.orchestra.run.smithi101.stdout: "event": "dispatched", 2023-08-01T19:54:29.300 INFO:teuthology.orchestra.run.smithi101.stdout: "time": "2023-08-01T19:54:04.458938+0000", 2023-08-01T19:54:29.301 INFO:teuthology.orchestra.run.smithi101.stdout: "duration": 7.3220000000000004e-06 2023-08-01T19:54:29.301 INFO:teuthology.orchestra.run.smithi101.stdout: }, 2023-08-01T19:54:29.301 INFO:teuthology.orchestra.run.smithi101.stdout: { 2023-08-01T19:54:29.301 INFO:teuthology.orchestra.run.smithi101.stdout: "event": "queued_for_pg", 2023-08-01T19:54:29.301 INFO:teuthology.orchestra.run.smithi101.stdout: "time": "2023-08-01T19:54:04.458944+0000", 2023-08-01T19:54:29.301 INFO:teuthology.orchestra.run.smithi101.stdout: "duration": 5.3040000000000004e-06 2023-08-01T19:54:29.301 INFO:teuthology.orchestra.run.smithi101.stdout: }, 2023-08-01T19:54:29.302 INFO:teuthology.orchestra.run.smithi101.stdout: { 2023-08-01T19:54:29.302 INFO:teuthology.orchestra.run.smithi101.stdout: "event": "reached_pg", 2023-08-01T19:54:29.302 INFO:teuthology.orchestra.run.smithi101.stdout: "time": "2023-08-01T19:54:04.459006+0000", 2023-08-01T19:54:29.302 INFO:teuthology.orchestra.run.smithi101.stdout: "duration": 6.2081000000000004e-05 2023-08-01T19:54:29.302 INFO:teuthology.orchestra.run.smithi101.stdout: }, 2023-08-01T19:54:29.302 INFO:teuthology.orchestra.run.smithi101.stdout: { 2023-08-01T19:54:29.302 INFO:teuthology.orchestra.run.smithi101.stdout: "event": "waiting_for_map not empty", 2023-08-01T19:54:29.302 INFO:teuthology.orchestra.run.smithi101.stdout: "time": "2023-08-01T19:54:04.459008+0000", 2023-08-01T19:54:29.303 INFO:teuthology.orchestra.run.smithi101.stdout: "duration": 2.2500000000000001e-06 2023-08-01T19:54:29.303 INFO:teuthology.orchestra.run.smithi101.stdout: }, 2023-08-01T19:54:29.303 INFO:teuthology.orchestra.run.smithi101.stdout: { 2023-08-01T19:54:29.303 INFO:teuthology.orchestra.run.smithi101.stdout: "event": "reached_pg", 2023-08-01T19:54:29.303 INFO:teuthology.orchestra.run.smithi101.stdout: "time": "2023-08-01T19:54:04.470946+0000", 2023-08-01T19:54:29.303 INFO:teuthology.orchestra.run.smithi101.stdout: "duration": 0.011938347 2023-08-01T19:54:29.303 INFO:teuthology.orchestra.run.smithi101.stdout: }, 2023-08-01T19:54:29.303 INFO:teuthology.orchestra.run.smithi101.stdout: { 2023-08-01T19:54:29.304 INFO:teuthology.orchestra.run.smithi101.stdout: "event": "started", 2023-08-01T19:54:29.304 INFO:teuthology.orchestra.run.smithi101.stdout: "time": "2023-08-01T19:54:04.471071+0000", 2023-08-01T19:54:29.304 INFO:teuthology.orchestra.run.smithi101.stdout: "duration": 0.00012470299999999999 2023-08-01T19:54:29.304 INFO:teuthology.orchestra.run.smithi101.stdout: }, 2023-08-01T19:54:29.304 INFO:teuthology.orchestra.run.smithi101.stdout: { 2023-08-01T19:54:29.304 INFO:teuthology.orchestra.run.smithi101.stdout: "event": "waiting for subops from 2", 2023-08-01T19:54:29.304 INFO:teuthology.orchestra.run.smithi101.stdout: "time": "2023-08-01T19:54:04.471205+0000", 2023-08-01T19:54:29.304 INFO:teuthology.orchestra.run.smithi101.stdout: "duration": 0.000133891 2023-08-01T19:54:29.305 INFO:teuthology.orchestra.run.smithi101.stdout: }, 2023-08-01T19:54:29.305 INFO:teuthology.orchestra.run.smithi101.stdout: { 2023-08-01T19:54:29.305 INFO:teuthology.orchestra.run.smithi101.stdout: "event": "op_commit", 2023-08-01T19:54:29.305 INFO:teuthology.orchestra.run.smithi101.stdout: "time": "2023-08-01T19:54:04.477042+0000", 2023-08-01T19:54:29.305 INFO:teuthology.orchestra.run.smithi101.stdout: "duration": 0.0058374849999999999 2023-08-01T19:54:29.305 INFO:teuthology.orchestra.run.smithi101.stdout: }, 2023-08-01T19:54:29.305 INFO:teuthology.orchestra.run.smithi101.stdout: { 2023-08-01T19:54:29.305 INFO:teuthology.orchestra.run.smithi101.stdout: "event": "sub_op_commit_rec", 2023-08-01T19:54:29.306 INFO:teuthology.orchestra.run.smithi101.stdout: "time": "2023-08-01T19:54:04.478445+0000", 2023-08-01T19:54:29.306 INFO:teuthology.orchestra.run.smithi101.stdout: "duration": 0.0014023239999999999 2023-08-01T19:54:29.306 INFO:teuthology.orchestra.run.smithi101.stdout: }, 2023-08-01T19:54:29.306 INFO:teuthology.orchestra.run.smithi101.stdout: { 2023-08-01T19:54:29.306 INFO:teuthology.orchestra.run.smithi101.stdout: "event": "commit_sent", 2023-08-01T19:54:29.306 INFO:teuthology.orchestra.run.smithi101.stdout: "time": "2023-08-01T19:54:04.478478+0000", 2023-08-01T19:54:29.306 INFO:teuthology.orchestra.run.smithi101.stdout: "duration": 3.3503000000000001e-05 2023-08-01T19:54:29.307 INFO:teuthology.orchestra.run.smithi101.stdout: }, 2023-08-01T19:54:29.307 INFO:teuthology.orchestra.run.smithi101.stdout: { 2023-08-01T19:54:29.307 INFO:teuthology.orchestra.run.smithi101.stdout: "event": "done", 2023-08-01T19:54:29.307 INFO:teuthology.orchestra.run.smithi101.stdout: "time": "2023-08-01T19:54:04.478502+0000", 2023-08-01T19:54:29.307 INFO:teuthology.orchestra.run.smithi101.stdout: "duration": 2.3402000000000001e-05 2023-08-01T19:54:29.307 INFO:teuthology.orchestra.run.smithi101.stdout: } 2023-08-01T19:54:29.307 INFO:teuthology.orchestra.run.smithi101.stdout: ] 2023-08-01T19:54:29.307 INFO:teuthology.orchestra.run.smithi101.stdout: } 2023-08-01T19:54:29.308 INFO:teuthology.orchestra.run.smithi101.stdout: }, 2023-08-01T19:54:29.308 INFO:teuthology.orchestra.run.smithi101.stdout: { 2023-08-01T19:54:29.308 INFO:teuthology.orchestra.run.smithi101.stdout: "description": "osd_op(mds.0.3:11 3.10 3:0bd6d154:::602.00000000:head [create,setxattr parent (62) in=6b,setxattr layout (30) in=6b] snapc 0=[] ondisk+write+known_if_redirected+full_force+supports_pool_eio e17)", 2023-08-01T19:54:29.308 INFO:teuthology.orchestra.run.smithi101.stdout: "initiated_at": "2023-08-01T19:54:04.458960+0000", 2023-08-01T19:54:29.308 INFO:teuthology.orchestra.run.smithi101.stdout: "age": 24.786187757, 2023-08-01T19:54:29.308 INFO:teuthology.orchestra.run.smithi101.stdout: "duration": 0.019645459000000001, 2023-08-01T19:54:29.308 INFO:teuthology.orchestra.run.smithi101.stdout: "type_data": { 2023-08-01T19:54:29.308 INFO:teuthology.orchestra.run.smithi101.stdout: "flag_point": "commit sent; apply or cleanup", 2023-08-01T19:54:29.309 INFO:teuthology.orchestra.run.smithi101.stdout: "events": [ 2023-08-01T19:54:29.309 INFO:teuthology.orchestra.run.smithi101.stdout: { 2023-08-01T19:54:29.309 INFO:teuthology.orchestra.run.smithi101.stdout: "event": "initiated", 2023-08-01T19:54:29.309 INFO:teuthology.orchestra.run.smithi101.stdout: "time": "2023-08-01T19:54:04.458960+0000", 2023-08-01T19:54:29.309 INFO:teuthology.orchestra.run.smithi101.stdout: "duration": 0 2023-08-01T19:54:29.309 INFO:teuthology.orchestra.run.smithi101.stdout: }, 2023-08-01T19:54:29.309 INFO:teuthology.orchestra.run.smithi101.stdout: { 2023-08-01T19:54:29.309 INFO:teuthology.orchestra.run.smithi101.stdout: "event": "throttled", 2023-08-01T19:54:29.310 INFO:teuthology.orchestra.run.smithi101.stdout: "time": "2023-08-01T19:54:04.458960+0000", 2023-08-01T19:54:29.310 INFO:teuthology.orchestra.run.smithi101.stdout: "duration": 0 2023-08-01T19:54:29.310 INFO:teuthology.orchestra.run.smithi101.stdout: }, 2023-08-01T19:54:29.310 INFO:teuthology.orchestra.run.smithi101.stdout: { 2023-08-01T19:54:29.310 INFO:teuthology.orchestra.run.smithi101.stdout: "event": "header_read", 2023-08-01T19:54:29.310 INFO:teuthology.orchestra.run.smithi101.stdout: "time": "2023-08-01T19:54:04.458959+0000", 2023-08-01T19:54:29.310 INFO:teuthology.orchestra.run.smithi101.stdout: "duration": 4294967295.9999995 2023-08-01T19:54:29.310 INFO:teuthology.orchestra.run.smithi101.stdout: }, 2023-08-01T19:54:29.311 INFO:teuthology.orchestra.run.smithi101.stdout: { 2023-08-01T19:54:29.311 INFO:teuthology.orchestra.run.smithi101.stdout: "event": "all_read", 2023-08-01T19:54:29.311 INFO:teuthology.orchestra.run.smithi101.stdout: "time": "2023-08-01T19:54:04.458963+0000", 2023-08-01T19:54:29.311 INFO:teuthology.orchestra.run.smithi101.stdout: "duration": 3.9199999999999997e-06 2023-08-01T19:54:29.311 INFO:teuthology.orchestra.run.smithi101.stdout: }, 2023-08-01T19:54:29.311 INFO:teuthology.orchestra.run.smithi101.stdout: { 2023-08-01T19:54:29.311 INFO:teuthology.orchestra.run.smithi101.stdout: "event": "dispatched", 2023-08-01T19:54:29.311 INFO:teuthology.orchestra.run.smithi101.stdout: "time": "2023-08-01T19:54:04.458970+0000", 2023-08-01T19:54:29.312 INFO:teuthology.orchestra.run.smithi101.stdout: "duration": 7.0439999999999998e-06 2023-08-01T19:54:29.312 INFO:teuthology.orchestra.run.smithi101.stdout: }, 2023-08-01T19:54:29.312 INFO:teuthology.orchestra.run.smithi101.stdout: { 2023-08-01T19:54:29.312 INFO:teuthology.orchestra.run.smithi101.stdout: "event": "queued_for_pg", 2023-08-01T19:54:29.312 INFO:teuthology.orchestra.run.smithi101.stdout: "time": "2023-08-01T19:54:04.458976+0000", 2023-08-01T19:54:29.312 INFO:teuthology.orchestra.run.smithi101.stdout: "duration": 5.9540000000000001e-06 2023-08-01T19:54:29.312 INFO:teuthology.orchestra.run.smithi101.stdout: }, 2023-08-01T19:54:29.313 INFO:teuthology.orchestra.run.smithi101.stdout: { 2023-08-01T19:54:29.313 INFO:teuthology.orchestra.run.smithi101.stdout: "event": "reached_pg", 2023-08-01T19:54:29.313 INFO:teuthology.orchestra.run.smithi101.stdout: "time": "2023-08-01T19:54:04.459035+0000", 2023-08-01T19:54:29.313 INFO:teuthology.orchestra.run.smithi101.stdout: "duration": 5.8924e-05 2023-08-01T19:54:29.313 INFO:teuthology.orchestra.run.smithi101.stdout: }, 2023-08-01T19:54:29.313 INFO:teuthology.orchestra.run.smithi101.stdout: { 2023-08-01T19:54:29.313 INFO:teuthology.orchestra.run.smithi101.stdout: "event": "waiting_for_map not empty", 2023-08-01T19:54:29.313 INFO:teuthology.orchestra.run.smithi101.stdout: "time": "2023-08-01T19:54:04.459038+0000", 2023-08-01T19:54:29.314 INFO:teuthology.orchestra.run.smithi101.stdout: "duration": 3.2760000000000001e-06 2023-08-01T19:54:29.314 INFO:teuthology.orchestra.run.smithi101.stdout: }, 2023-08-01T19:54:29.314 INFO:teuthology.orchestra.run.smithi101.stdout: { 2023-08-01T19:54:29.314 INFO:teuthology.orchestra.run.smithi101.stdout: "event": "reached_pg", 2023-08-01T19:54:29.314 INFO:teuthology.orchestra.run.smithi101.stdout: "time": "2023-08-01T19:54:04.471511+0000", 2023-08-01T19:54:29.314 INFO:teuthology.orchestra.run.smithi101.stdout: "duration": 0.012473039999999999 2023-08-01T19:54:29.314 INFO:teuthology.orchestra.run.smithi101.stdout: }, 2023-08-01T19:54:29.314 INFO:teuthology.orchestra.run.smithi101.stdout: { 2023-08-01T19:54:29.315 INFO:teuthology.orchestra.run.smithi101.stdout: "event": "started", 2023-08-01T19:54:29.315 INFO:teuthology.orchestra.run.smithi101.stdout: "time": "2023-08-01T19:54:04.472086+0000", 2023-08-01T19:54:29.315 INFO:teuthology.orchestra.run.smithi101.stdout: "duration": 0.00057491699999999998 2023-08-01T19:54:29.315 INFO:teuthology.orchestra.run.smithi101.stdout: }, 2023-08-01T19:54:29.315 INFO:teuthology.orchestra.run.smithi101.stdout: { 2023-08-01T19:54:29.315 INFO:teuthology.orchestra.run.smithi101.stdout: "event": "waiting for subops from 2", 2023-08-01T19:54:29.315 INFO:teuthology.orchestra.run.smithi101.stdout: "time": "2023-08-01T19:54:04.472310+0000", 2023-08-01T19:54:29.315 INFO:teuthology.orchestra.run.smithi101.stdout: "duration": 0.00022396499999999999 2023-08-01T19:54:29.316 INFO:teuthology.orchestra.run.smithi101.stdout: }, 2023-08-01T19:54:29.316 INFO:teuthology.orchestra.run.smithi101.stdout: { 2023-08-01T19:54:29.316 INFO:teuthology.orchestra.run.smithi101.stdout: "event": "op_commit", 2023-08-01T19:54:29.316 INFO:teuthology.orchestra.run.smithi101.stdout: "time": "2023-08-01T19:54:04.478141+0000", 2023-08-01T19:54:29.316 INFO:teuthology.orchestra.run.smithi101.stdout: "duration": 0.0058312320000000004 2023-08-01T19:54:29.316 INFO:teuthology.orchestra.run.smithi101.stdout: }, 2023-08-01T19:54:29.316 INFO:teuthology.orchestra.run.smithi101.stdout: { 2023-08-01T19:54:29.316 INFO:teuthology.orchestra.run.smithi101.stdout: "event": "sub_op_commit_rec", 2023-08-01T19:54:29.317 INFO:teuthology.orchestra.run.smithi101.stdout: "time": "2023-08-01T19:54:04.478543+0000", 2023-08-01T19:54:29.317 INFO:teuthology.orchestra.run.smithi101.stdout: "duration": 0.00040160800000000002 2023-08-01T19:54:29.317 INFO:teuthology.orchestra.run.smithi101.stdout: }, 2023-08-01T19:54:29.317 INFO:teuthology.orchestra.run.smithi101.stdout: { 2023-08-01T19:54:29.317 INFO:teuthology.orchestra.run.smithi101.stdout: "event": "commit_sent", 2023-08-01T19:54:29.317 INFO:teuthology.orchestra.run.smithi101.stdout: "time": "2023-08-01T19:54:04.478584+0000", 2023-08-01T19:54:29.317 INFO:teuthology.orchestra.run.smithi101.stdout: "duration": 4.0989999999999999e-05 2023-08-01T19:54:29.317 INFO:teuthology.orchestra.run.smithi101.stdout: }, 2023-08-01T19:54:29.318 INFO:teuthology.orchestra.run.smithi101.stdout: { 2023-08-01T19:54:29.318 INFO:teuthology.orchestra.run.smithi101.stdout: "event": "done", 2023-08-01T19:54:29.318 INFO:teuthology.orchestra.run.smithi101.stdout: "time": "2023-08-01T19:54:04.478605+0000", 2023-08-01T19:54:29.318 INFO:teuthology.orchestra.run.smithi101.stdout: "duration": 2.1178e-05 2023-08-01T19:54:29.318 INFO:teuthology.orchestra.run.smithi101.stdout: } 2023-08-01T19:54:29.318 INFO:teuthology.orchestra.run.smithi101.stdout: ] 2023-08-01T19:54:29.318 INFO:teuthology.orchestra.run.smithi101.stdout: } 2023-08-01T19:54:29.318 INFO:teuthology.orchestra.run.smithi101.stdout: }, 2023-08-01T19:54:29.319 INFO:teuthology.orchestra.run.smithi101.stdout: { 2023-08-01T19:54:29.319 INFO:teuthology.orchestra.run.smithi101.stdout: "description": "osd_op(mds.0.3:12 3.10 3:0d89b25e:::603.00000000:head [omap-set-header] snapc 0=[] ondisk+write+known_if_redirected+full_force+supports_pool_eio e17)", 2023-08-01T19:54:29.319 INFO:teuthology.orchestra.run.smithi101.stdout: "initiated_at": "2023-08-01T19:54:04.458982+0000", 2023-08-01T19:54:29.319 INFO:teuthology.orchestra.run.smithi101.stdout: "age": 24.786165529000002, 2023-08-01T19:54:29.319 INFO:teuthology.orchestra.run.smithi101.stdout: "duration": 0.021266334000000001, 2023-08-01T19:54:29.319 INFO:teuthology.orchestra.run.smithi101.stdout: "type_data": { 2023-08-01T19:54:29.319 INFO:teuthology.orchestra.run.smithi101.stdout: "flag_point": "commit sent; apply or cleanup", 2023-08-01T19:54:29.320 INFO:teuthology.orchestra.run.smithi101.stdout: "events": [ 2023-08-01T19:54:29.320 INFO:teuthology.orchestra.run.smithi101.stdout: { 2023-08-01T19:54:29.320 INFO:teuthology.orchestra.run.smithi101.stdout: "event": "initiated", 2023-08-01T19:54:29.320 INFO:teuthology.orchestra.run.smithi101.stdout: "time": "2023-08-01T19:54:04.458982+0000", 2023-08-01T19:54:29.320 INFO:teuthology.orchestra.run.smithi101.stdout: "duration": 0 2023-08-01T19:54:29.320 INFO:teuthology.orchestra.run.smithi101.stdout: }, 2023-08-01T19:54:29.320 INFO:teuthology.orchestra.run.smithi101.stdout: { 2023-08-01T19:54:29.320 INFO:teuthology.orchestra.run.smithi101.stdout: "event": "throttled", 2023-08-01T19:54:29.321 INFO:teuthology.orchestra.run.smithi101.stdout: "time": "2023-08-01T19:54:04.458982+0000", 2023-08-01T19:54:29.321 INFO:teuthology.orchestra.run.smithi101.stdout: "duration": 0 2023-08-01T19:54:29.321 INFO:teuthology.orchestra.run.smithi101.stdout: }, 2023-08-01T19:54:29.321 INFO:teuthology.orchestra.run.smithi101.stdout: { 2023-08-01T19:54:29.321 INFO:teuthology.orchestra.run.smithi101.stdout: "event": "header_read", 2023-08-01T19:54:29.321 INFO:teuthology.orchestra.run.smithi101.stdout: "time": "2023-08-01T19:54:04.458982+0000", 2023-08-01T19:54:29.321 INFO:teuthology.orchestra.run.smithi101.stdout: "duration": 4294967295.9999995 2023-08-01T19:54:29.321 INFO:teuthology.orchestra.run.smithi101.stdout: }, 2023-08-01T19:54:29.322 INFO:teuthology.orchestra.run.smithi101.stdout: { 2023-08-01T19:54:29.322 INFO:teuthology.orchestra.run.smithi101.stdout: "event": "all_read", 2023-08-01T19:54:29.322 INFO:teuthology.orchestra.run.smithi101.stdout: "time": "2023-08-01T19:54:04.458985+0000", 2023-08-01T19:54:29.322 INFO:teuthology.orchestra.run.smithi101.stdout: "duration": 3.4800000000000001e-06 2023-08-01T19:54:29.322 INFO:teuthology.orchestra.run.smithi101.stdout: }, 2023-08-01T19:54:29.322 INFO:teuthology.orchestra.run.smithi101.stdout: { 2023-08-01T19:54:29.322 INFO:teuthology.orchestra.run.smithi101.stdout: "event": "dispatched", 2023-08-01T19:54:29.322 INFO:teuthology.orchestra.run.smithi101.stdout: "time": "2023-08-01T19:54:04.458992+0000", 2023-08-01T19:54:29.323 INFO:teuthology.orchestra.run.smithi101.stdout: "duration": 7.306e-06 2023-08-01T19:54:29.323 INFO:teuthology.orchestra.run.smithi101.stdout: }, 2023-08-01T19:54:29.323 INFO:teuthology.orchestra.run.smithi101.stdout: { 2023-08-01T19:54:29.323 INFO:teuthology.orchestra.run.smithi101.stdout: "event": "queued_for_pg", 2023-08-01T19:54:29.323 INFO:teuthology.orchestra.run.smithi101.stdout: "time": "2023-08-01T19:54:04.458997+0000", 2023-08-01T19:54:29.323 INFO:teuthology.orchestra.run.smithi101.stdout: "duration": 4.4530000000000004e-06 2023-08-01T19:54:29.323 INFO:teuthology.orchestra.run.smithi101.stdout: }, 2023-08-01T19:54:29.323 INFO:teuthology.orchestra.run.smithi101.stdout: { 2023-08-01T19:54:29.324 INFO:teuthology.orchestra.run.smithi101.stdout: "event": "reached_pg", 2023-08-01T19:54:29.324 INFO:teuthology.orchestra.run.smithi101.stdout: "time": "2023-08-01T19:54:04.459060+0000", 2023-08-01T19:54:29.324 INFO:teuthology.orchestra.run.smithi101.stdout: "duration": 6.3249000000000004e-05 2023-08-01T19:54:29.324 INFO:teuthology.orchestra.run.smithi101.stdout: }, 2023-08-01T19:54:29.324 INFO:teuthology.orchestra.run.smithi101.stdout: { 2023-08-01T19:54:29.324 INFO:teuthology.orchestra.run.smithi101.stdout: "event": "waiting_for_map not empty", 2023-08-01T19:54:29.324 INFO:teuthology.orchestra.run.smithi101.stdout: "time": "2023-08-01T19:54:04.459063+0000", 2023-08-01T19:54:29.325 INFO:teuthology.orchestra.run.smithi101.stdout: "duration": 2.717e-06 2023-08-01T19:54:29.325 INFO:teuthology.orchestra.run.smithi101.stdout: }, 2023-08-01T19:54:29.325 INFO:teuthology.orchestra.run.smithi101.stdout: { 2023-08-01T19:54:29.325 INFO:teuthology.orchestra.run.smithi101.stdout: "event": "reached_pg", 2023-08-01T19:54:29.325 INFO:teuthology.orchestra.run.smithi101.stdout: "time": "2023-08-01T19:54:04.473625+0000", 2023-08-01T19:54:29.325 INFO:teuthology.orchestra.run.smithi101.stdout: "duration": 0.014562007 2023-08-01T19:54:29.325 INFO:teuthology.orchestra.run.smithi101.stdout: }, 2023-08-01T19:54:29.325 INFO:teuthology.orchestra.run.smithi101.stdout: { 2023-08-01T19:54:29.326 INFO:teuthology.orchestra.run.smithi101.stdout: "event": "started", 2023-08-01T19:54:29.326 INFO:teuthology.orchestra.run.smithi101.stdout: "time": "2023-08-01T19:54:04.473757+0000", 2023-08-01T19:54:29.326 INFO:teuthology.orchestra.run.smithi101.stdout: "duration": 0.00013238599999999999 2023-08-01T19:54:29.326 INFO:teuthology.orchestra.run.smithi101.stdout: }, 2023-08-01T19:54:29.326 INFO:teuthology.orchestra.run.smithi101.stdout: { 2023-08-01T19:54:29.326 INFO:teuthology.orchestra.run.smithi101.stdout: "event": "waiting for subops from 2", 2023-08-01T19:54:29.326 INFO:teuthology.orchestra.run.smithi101.stdout: "time": "2023-08-01T19:54:04.473898+0000", 2023-08-01T19:54:29.326 INFO:teuthology.orchestra.run.smithi101.stdout: "duration": 0.00014039 2023-08-01T19:54:29.327 INFO:teuthology.orchestra.run.smithi101.stdout: }, 2023-08-01T19:54:29.327 INFO:teuthology.orchestra.run.smithi101.stdout: { 2023-08-01T19:54:29.327 INFO:teuthology.orchestra.run.smithi101.stdout: "event": "op_commit", 2023-08-01T19:54:29.327 INFO:teuthology.orchestra.run.smithi101.stdout: "time": "2023-08-01T19:54:04.478380+0000", 2023-08-01T19:54:29.327 INFO:teuthology.orchestra.run.smithi101.stdout: "duration": 0.0044827449999999998 2023-08-01T19:54:29.327 INFO:teuthology.orchestra.run.smithi101.stdout: }, 2023-08-01T19:54:29.327 INFO:teuthology.orchestra.run.smithi101.stdout: { 2023-08-01T19:54:29.327 INFO:teuthology.orchestra.run.smithi101.stdout: "event": "sub_op_commit_rec", 2023-08-01T19:54:29.328 INFO:teuthology.orchestra.run.smithi101.stdout: "time": "2023-08-01T19:54:04.480169+0000", 2023-08-01T19:54:29.328 INFO:teuthology.orchestra.run.smithi101.stdout: "duration": 0.0017886040000000001 2023-08-01T19:54:29.328 INFO:teuthology.orchestra.run.smithi101.stdout: }, 2023-08-01T19:54:29.328 INFO:teuthology.orchestra.run.smithi101.stdout: { 2023-08-01T19:54:29.328 INFO:teuthology.orchestra.run.smithi101.stdout: "event": "commit_sent", 2023-08-01T19:54:29.328 INFO:teuthology.orchestra.run.smithi101.stdout: "time": "2023-08-01T19:54:04.480212+0000", 2023-08-01T19:54:29.328 INFO:teuthology.orchestra.run.smithi101.stdout: "duration": 4.2687e-05 2023-08-01T19:54:29.329 INFO:teuthology.orchestra.run.smithi101.stdout: }, 2023-08-01T19:54:29.329 INFO:teuthology.orchestra.run.smithi101.stdout: { 2023-08-01T19:54:29.329 INFO:teuthology.orchestra.run.smithi101.stdout: "event": "done", 2023-08-01T19:54:29.329 INFO:teuthology.orchestra.run.smithi101.stdout: "time": "2023-08-01T19:54:04.480248+0000", 2023-08-01T19:54:29.329 INFO:teuthology.orchestra.run.smithi101.stdout: "duration": 3.6743999999999999e-05 2023-08-01T19:54:29.329 INFO:teuthology.orchestra.run.smithi101.stdout: } 2023-08-01T19:54:29.329 INFO:teuthology.orchestra.run.smithi101.stdout: ] 2023-08-01T19:54:29.329 INFO:teuthology.orchestra.run.smithi101.stdout: } 2023-08-01T19:54:29.330 INFO:teuthology.orchestra.run.smithi101.stdout: }, 2023-08-01T19:54:29.330 INFO:teuthology.orchestra.run.smithi101.stdout: { 2023-08-01T19:54:29.330 INFO:teuthology.orchestra.run.smithi101.stdout: "description": "osd_op(mds.0.3:13 3.10 3:0d89b25e:::603.00000000:head [create,setxattr parent (62) in=6b,setxattr layout (30) in=6b] snapc 0=[] ondisk+write+known_if_redirected+full_force+supports_pool_eio e17)", 2023-08-01T19:54:29.330 INFO:teuthology.orchestra.run.smithi101.stdout: "initiated_at": "2023-08-01T19:54:04.459010+0000", 2023-08-01T19:54:29.330 INFO:teuthology.orchestra.run.smithi101.stdout: "age": 24.786137809, 2023-08-01T19:54:29.330 INFO:teuthology.orchestra.run.smithi101.stdout: "duration": 0.021327220000000001, 2023-08-01T19:54:29.330 INFO:teuthology.orchestra.run.smithi101.stdout: "type_data": { 2023-08-01T19:54:29.330 INFO:teuthology.orchestra.run.smithi101.stdout: "flag_point": "commit sent; apply or cleanup", 2023-08-01T19:54:29.331 INFO:teuthology.orchestra.run.smithi101.stdout: "events": [ 2023-08-01T19:54:29.331 INFO:teuthology.orchestra.run.smithi101.stdout: { 2023-08-01T19:54:29.331 INFO:teuthology.orchestra.run.smithi101.stdout: "event": "initiated", 2023-08-01T19:54:29.331 INFO:teuthology.orchestra.run.smithi101.stdout: "time": "2023-08-01T19:54:04.459010+0000", 2023-08-01T19:54:29.331 INFO:teuthology.orchestra.run.smithi101.stdout: "duration": 0 2023-08-01T19:54:29.331 INFO:teuthology.orchestra.run.smithi101.stdout: }, 2023-08-01T19:54:29.331 INFO:teuthology.orchestra.run.smithi101.stdout: { 2023-08-01T19:54:29.331 INFO:teuthology.orchestra.run.smithi101.stdout: "event": "throttled", 2023-08-01T19:54:29.332 INFO:teuthology.orchestra.run.smithi101.stdout: "time": "2023-08-01T19:54:04.459010+0000", 2023-08-01T19:54:29.332 INFO:teuthology.orchestra.run.smithi101.stdout: "duration": 0 2023-08-01T19:54:29.332 INFO:teuthology.orchestra.run.smithi101.stdout: }, 2023-08-01T19:54:29.332 INFO:teuthology.orchestra.run.smithi101.stdout: { 2023-08-01T19:54:29.332 INFO:teuthology.orchestra.run.smithi101.stdout: "event": "header_read", 2023-08-01T19:54:29.332 INFO:teuthology.orchestra.run.smithi101.stdout: "time": "2023-08-01T19:54:04.459009+0000", 2023-08-01T19:54:29.332 INFO:teuthology.orchestra.run.smithi101.stdout: "duration": 4294967295.9999995 2023-08-01T19:54:29.332 INFO:teuthology.orchestra.run.smithi101.stdout: }, 2023-08-01T19:54:29.333 INFO:teuthology.orchestra.run.smithi101.stdout: { 2023-08-01T19:54:29.333 INFO:teuthology.orchestra.run.smithi101.stdout: "event": "all_read", 2023-08-01T19:54:29.333 INFO:teuthology.orchestra.run.smithi101.stdout: "time": "2023-08-01T19:54:04.459013+0000", 2023-08-01T19:54:29.333 INFO:teuthology.orchestra.run.smithi101.stdout: "duration": 3.8929999999999998e-06 2023-08-01T19:54:29.333 INFO:teuthology.orchestra.run.smithi101.stdout: }, 2023-08-01T19:54:29.333 INFO:teuthology.orchestra.run.smithi101.stdout: { 2023-08-01T19:54:29.333 INFO:teuthology.orchestra.run.smithi101.stdout: "event": "dispatched", 2023-08-01T19:54:29.333 INFO:teuthology.orchestra.run.smithi101.stdout: "time": "2023-08-01T19:54:04.459027+0000", 2023-08-01T19:54:29.334 INFO:teuthology.orchestra.run.smithi101.stdout: "duration": 1.3416e-05 2023-08-01T19:54:29.334 INFO:teuthology.orchestra.run.smithi101.stdout: }, 2023-08-01T19:54:29.334 INFO:teuthology.orchestra.run.smithi101.stdout: { 2023-08-01T19:54:29.334 INFO:teuthology.orchestra.run.smithi101.stdout: "event": "queued_for_pg", 2023-08-01T19:54:29.334 INFO:teuthology.orchestra.run.smithi101.stdout: "time": "2023-08-01T19:54:04.459033+0000", 2023-08-01T19:54:29.334 INFO:teuthology.orchestra.run.smithi101.stdout: "duration": 5.9800000000000003e-06 2023-08-01T19:54:29.334 INFO:teuthology.orchestra.run.smithi101.stdout: }, 2023-08-01T19:54:29.334 INFO:teuthology.orchestra.run.smithi101.stdout: { 2023-08-01T19:54:29.335 INFO:teuthology.orchestra.run.smithi101.stdout: "event": "reached_pg", 2023-08-01T19:54:29.335 INFO:teuthology.orchestra.run.smithi101.stdout: "time": "2023-08-01T19:54:04.459099+0000", 2023-08-01T19:54:29.335 INFO:teuthology.orchestra.run.smithi101.stdout: "duration": 6.6192999999999995e-05 2023-08-01T19:54:29.335 INFO:teuthology.orchestra.run.smithi101.stdout: }, 2023-08-01T19:54:29.335 INFO:teuthology.orchestra.run.smithi101.stdout: { 2023-08-01T19:54:29.335 INFO:teuthology.orchestra.run.smithi101.stdout: "event": "waiting_for_map not empty", 2023-08-01T19:54:29.335 INFO:teuthology.orchestra.run.smithi101.stdout: "time": "2023-08-01T19:54:04.459106+0000", 2023-08-01T19:54:29.335 INFO:teuthology.orchestra.run.smithi101.stdout: "duration": 6.8619999999999997e-06 2023-08-01T19:54:29.336 INFO:teuthology.orchestra.run.smithi101.stdout: }, 2023-08-01T19:54:29.336 INFO:teuthology.orchestra.run.smithi101.stdout: { 2023-08-01T19:54:29.336 INFO:teuthology.orchestra.run.smithi101.stdout: "event": "reached_pg", 2023-08-01T19:54:29.336 INFO:teuthology.orchestra.run.smithi101.stdout: "time": "2023-08-01T19:54:04.475182+0000", 2023-08-01T19:54:29.336 INFO:teuthology.orchestra.run.smithi101.stdout: "duration": 0.016076333000000002 2023-08-01T19:54:29.336 INFO:teuthology.orchestra.run.smithi101.stdout: }, 2023-08-01T19:54:29.336 INFO:teuthology.orchestra.run.smithi101.stdout: { 2023-08-01T19:54:29.337 INFO:teuthology.orchestra.run.smithi101.stdout: "event": "started", 2023-08-01T19:54:29.337 INFO:teuthology.orchestra.run.smithi101.stdout: "time": "2023-08-01T19:54:04.475353+0000", 2023-08-01T19:54:29.337 INFO:teuthology.orchestra.run.smithi101.stdout: "duration": 0.000171378 2023-08-01T19:54:29.337 INFO:teuthology.orchestra.run.smithi101.stdout: }, 2023-08-01T19:54:29.337 INFO:teuthology.orchestra.run.smithi101.stdout: { 2023-08-01T19:54:29.337 INFO:teuthology.orchestra.run.smithi101.stdout: "event": "waiting for subops from 2", 2023-08-01T19:54:29.337 INFO:teuthology.orchestra.run.smithi101.stdout: "time": "2023-08-01T19:54:04.475793+0000", 2023-08-01T19:54:29.337 INFO:teuthology.orchestra.run.smithi101.stdout: "duration": 0.000440123 2023-08-01T19:54:29.338 INFO:teuthology.orchestra.run.smithi101.stdout: }, 2023-08-01T19:54:29.338 INFO:teuthology.orchestra.run.smithi101.stdout: { 2023-08-01T19:54:29.338 INFO:teuthology.orchestra.run.smithi101.stdout: "event": "op_commit", 2023-08-01T19:54:29.338 INFO:teuthology.orchestra.run.smithi101.stdout: "time": "2023-08-01T19:54:04.478624+0000", 2023-08-01T19:54:29.338 INFO:teuthology.orchestra.run.smithi101.stdout: "duration": 0.0028305000000000001 2023-08-01T19:54:29.338 INFO:teuthology.orchestra.run.smithi101.stdout: }, 2023-08-01T19:54:29.338 INFO:teuthology.orchestra.run.smithi101.stdout: { 2023-08-01T19:54:29.338 INFO:teuthology.orchestra.run.smithi101.stdout: "event": "sub_op_commit_rec", 2023-08-01T19:54:29.339 INFO:teuthology.orchestra.run.smithi101.stdout: "time": "2023-08-01T19:54:04.480291+0000", 2023-08-01T19:54:29.339 INFO:teuthology.orchestra.run.smithi101.stdout: "duration": 0.0016670000000000001 2023-08-01T19:54:29.339 INFO:teuthology.orchestra.run.smithi101.stdout: }, 2023-08-01T19:54:29.339 INFO:teuthology.orchestra.run.smithi101.stdout: { 2023-08-01T19:54:29.339 INFO:teuthology.orchestra.run.smithi101.stdout: "event": "commit_sent", 2023-08-01T19:54:29.339 INFO:teuthology.orchestra.run.smithi101.stdout: "time": "2023-08-01T19:54:04.480318+0000", 2023-08-01T19:54:29.339 INFO:teuthology.orchestra.run.smithi101.stdout: "duration": 2.6815e-05 2023-08-01T19:54:29.339 INFO:teuthology.orchestra.run.smithi101.stdout: }, 2023-08-01T19:54:29.340 INFO:teuthology.orchestra.run.smithi101.stdout: { 2023-08-01T19:54:29.340 INFO:teuthology.orchestra.run.smithi101.stdout: "event": "done", 2023-08-01T19:54:29.340 INFO:teuthology.orchestra.run.smithi101.stdout: "time": "2023-08-01T19:54:04.480337+0000", 2023-08-01T19:54:29.340 INFO:teuthology.orchestra.run.smithi101.stdout: "duration": 1.9241000000000001e-05 2023-08-01T19:54:29.340 INFO:teuthology.orchestra.run.smithi101.stdout: } 2023-08-01T19:54:29.340 INFO:teuthology.orchestra.run.smithi101.stdout: ] 2023-08-01T19:54:29.340 INFO:teuthology.orchestra.run.smithi101.stdout: } 2023-08-01T19:54:29.340 INFO:teuthology.orchestra.run.smithi101.stdout: }, 2023-08-01T19:54:29.341 INFO:teuthology.orchestra.run.smithi101.stdout: { 2023-08-01T19:54:29.341 INFO:teuthology.orchestra.run.smithi101.stdout: "description": "osd_op(mds.0.3:18 3.14 3:2f55791f:::606.00000000:head [omap-set-header] snapc 0=[] ondisk+write+known_if_redirected+full_force+supports_pool_eio e17)", 2023-08-01T19:54:29.341 INFO:teuthology.orchestra.run.smithi101.stdout: "initiated_at": "2023-08-01T19:54:04.459039+0000", 2023-08-01T19:54:29.341 INFO:teuthology.orchestra.run.smithi101.stdout: "age": 24.786108514999999, 2023-08-01T19:54:29.341 INFO:teuthology.orchestra.run.smithi101.stdout: "duration": 0.018756419, 2023-08-01T19:54:29.341 INFO:teuthology.orchestra.run.smithi101.stdout: "type_data": { 2023-08-01T19:54:29.341 INFO:teuthology.orchestra.run.smithi101.stdout: "flag_point": "commit sent; apply or cleanup", 2023-08-01T19:54:29.341 INFO:teuthology.orchestra.run.smithi101.stdout: "events": [ 2023-08-01T19:54:29.342 INFO:teuthology.orchestra.run.smithi101.stdout: { 2023-08-01T19:54:29.342 INFO:teuthology.orchestra.run.smithi101.stdout: "event": "initiated", 2023-08-01T19:54:29.342 INFO:teuthology.orchestra.run.smithi101.stdout: "time": "2023-08-01T19:54:04.459039+0000", 2023-08-01T19:54:29.342 INFO:teuthology.orchestra.run.smithi101.stdout: "duration": 0 2023-08-01T19:54:29.342 INFO:teuthology.orchestra.run.smithi101.stdout: }, 2023-08-01T19:54:29.342 INFO:teuthology.orchestra.run.smithi101.stdout: { 2023-08-01T19:54:29.342 INFO:teuthology.orchestra.run.smithi101.stdout: "event": "throttled", 2023-08-01T19:54:29.342 INFO:teuthology.orchestra.run.smithi101.stdout: "time": "2023-08-01T19:54:04.459039+0000", 2023-08-01T19:54:29.343 INFO:teuthology.orchestra.run.smithi101.stdout: "duration": 0 2023-08-01T19:54:29.343 INFO:teuthology.orchestra.run.smithi101.stdout: }, 2023-08-01T19:54:29.343 INFO:teuthology.orchestra.run.smithi101.stdout: { 2023-08-01T19:54:29.343 INFO:teuthology.orchestra.run.smithi101.stdout: "event": "header_read", 2023-08-01T19:54:29.343 INFO:teuthology.orchestra.run.smithi101.stdout: "time": "2023-08-01T19:54:04.459039+0000", 2023-08-01T19:54:29.343 INFO:teuthology.orchestra.run.smithi101.stdout: "duration": 4294967295.9999995 2023-08-01T19:54:29.343 INFO:teuthology.orchestra.run.smithi101.stdout: }, 2023-08-01T19:54:29.343 INFO:teuthology.orchestra.run.smithi101.stdout: { 2023-08-01T19:54:29.344 INFO:teuthology.orchestra.run.smithi101.stdout: "event": "all_read", 2023-08-01T19:54:29.344 INFO:teuthology.orchestra.run.smithi101.stdout: "time": "2023-08-01T19:54:04.459043+0000", 2023-08-01T19:54:29.344 INFO:teuthology.orchestra.run.smithi101.stdout: "duration": 4.1500000000000001e-06 2023-08-01T19:54:29.344 INFO:teuthology.orchestra.run.smithi101.stdout: }, 2023-08-01T19:54:29.344 INFO:teuthology.orchestra.run.smithi101.stdout: { 2023-08-01T19:54:29.344 INFO:teuthology.orchestra.run.smithi101.stdout: "event": "dispatched", 2023-08-01T19:54:29.344 INFO:teuthology.orchestra.run.smithi101.stdout: "time": "2023-08-01T19:54:04.459051+0000", 2023-08-01T19:54:29.345 INFO:teuthology.orchestra.run.smithi101.stdout: "duration": 8.4190000000000002e-06 2023-08-01T19:54:29.345 INFO:teuthology.orchestra.run.smithi101.stdout: }, 2023-08-01T19:54:29.345 INFO:teuthology.orchestra.run.smithi101.stdout: { 2023-08-01T19:54:29.345 INFO:teuthology.orchestra.run.smithi101.stdout: "event": "queued_for_pg", 2023-08-01T19:54:29.345 INFO:teuthology.orchestra.run.smithi101.stdout: "time": "2023-08-01T19:54:04.459056+0000", 2023-08-01T19:54:29.345 INFO:teuthology.orchestra.run.smithi101.stdout: "duration": 5.339e-06 2023-08-01T19:54:29.345 INFO:teuthology.orchestra.run.smithi101.stdout: }, 2023-08-01T19:54:29.345 INFO:teuthology.orchestra.run.smithi101.stdout: { 2023-08-01T19:54:29.346 INFO:teuthology.orchestra.run.smithi101.stdout: "event": "reached_pg", 2023-08-01T19:54:29.346 INFO:teuthology.orchestra.run.smithi101.stdout: "time": "2023-08-01T19:54:04.459091+0000", 2023-08-01T19:54:29.346 INFO:teuthology.orchestra.run.smithi101.stdout: "duration": 3.4090000000000001e-05 2023-08-01T19:54:29.346 INFO:teuthology.orchestra.run.smithi101.stdout: }, 2023-08-01T19:54:29.346 INFO:teuthology.orchestra.run.smithi101.stdout: { 2023-08-01T19:54:29.346 INFO:teuthology.orchestra.run.smithi101.stdout: "event": "op must wait for map", 2023-08-01T19:54:29.346 INFO:teuthology.orchestra.run.smithi101.stdout: "time": "2023-08-01T19:54:04.459094+0000", 2023-08-01T19:54:29.346 INFO:teuthology.orchestra.run.smithi101.stdout: "duration": 3.303e-06 2023-08-01T19:54:29.347 INFO:teuthology.orchestra.run.smithi101.stdout: }, 2023-08-01T19:54:29.347 INFO:teuthology.orchestra.run.smithi101.stdout: { 2023-08-01T19:54:29.347 INFO:teuthology.orchestra.run.smithi101.stdout: "event": "reached_pg", 2023-08-01T19:54:29.347 INFO:teuthology.orchestra.run.smithi101.stdout: "time": "2023-08-01T19:54:04.469860+0000", 2023-08-01T19:54:29.347 INFO:teuthology.orchestra.run.smithi101.stdout: "duration": 0.010765749 2023-08-01T19:54:29.347 INFO:teuthology.orchestra.run.smithi101.stdout: }, 2023-08-01T19:54:29.347 INFO:teuthology.orchestra.run.smithi101.stdout: { 2023-08-01T19:54:29.347 INFO:teuthology.orchestra.run.smithi101.stdout: "event": "started", 2023-08-01T19:54:29.348 INFO:teuthology.orchestra.run.smithi101.stdout: "time": "2023-08-01T19:54:04.470008+0000", 2023-08-01T19:54:29.348 INFO:teuthology.orchestra.run.smithi101.stdout: "duration": 0.000148367 2023-08-01T19:54:29.348 INFO:teuthology.orchestra.run.smithi101.stdout: }, 2023-08-01T19:54:29.348 INFO:teuthology.orchestra.run.smithi101.stdout: { 2023-08-01T19:54:29.348 INFO:teuthology.orchestra.run.smithi101.stdout: "event": "waiting for subops from 2", 2023-08-01T19:54:29.348 INFO:teuthology.orchestra.run.smithi101.stdout: "time": "2023-08-01T19:54:04.470136+0000", 2023-08-01T19:54:29.348 INFO:teuthology.orchestra.run.smithi101.stdout: "duration": 0.000128329 2023-08-01T19:54:29.348 INFO:teuthology.orchestra.run.smithi101.stdout: }, 2023-08-01T19:54:29.349 INFO:teuthology.orchestra.run.smithi101.stdout: { 2023-08-01T19:54:29.349 INFO:teuthology.orchestra.run.smithi101.stdout: "event": "op_commit", 2023-08-01T19:54:29.349 INFO:teuthology.orchestra.run.smithi101.stdout: "time": "2023-08-01T19:54:04.476399+0000", 2023-08-01T19:54:29.349 INFO:teuthology.orchestra.run.smithi101.stdout: "duration": 0.0062627259999999997 2023-08-01T19:54:29.349 INFO:teuthology.orchestra.run.smithi101.stdout: }, 2023-08-01T19:54:29.349 INFO:teuthology.orchestra.run.smithi101.stdout: { 2023-08-01T19:54:29.349 INFO:teuthology.orchestra.run.smithi101.stdout: "event": "sub_op_commit_rec", 2023-08-01T19:54:29.350 INFO:teuthology.orchestra.run.smithi101.stdout: "time": "2023-08-01T19:54:04.477726+0000", 2023-08-01T19:54:29.350 INFO:teuthology.orchestra.run.smithi101.stdout: "duration": 0.001327103 2023-08-01T19:54:29.350 INFO:teuthology.orchestra.run.smithi101.stdout: }, 2023-08-01T19:54:29.350 INFO:teuthology.orchestra.run.smithi101.stdout: { 2023-08-01T19:54:29.350 INFO:teuthology.orchestra.run.smithi101.stdout: "event": "commit_sent", 2023-08-01T19:54:29.350 INFO:teuthology.orchestra.run.smithi101.stdout: "time": "2023-08-01T19:54:04.477771+0000", 2023-08-01T19:54:29.350 INFO:teuthology.orchestra.run.smithi101.stdout: "duration": 4.5232000000000003e-05 2023-08-01T19:54:29.350 INFO:teuthology.orchestra.run.smithi101.stdout: }, 2023-08-01T19:54:29.351 INFO:teuthology.orchestra.run.smithi101.stdout: { 2023-08-01T19:54:29.351 INFO:teuthology.orchestra.run.smithi101.stdout: "event": "done", 2023-08-01T19:54:29.351 INFO:teuthology.orchestra.run.smithi101.stdout: "time": "2023-08-01T19:54:04.477795+0000", 2023-08-01T19:54:29.351 INFO:teuthology.orchestra.run.smithi101.stdout: "duration": 2.4134999999999998e-05 2023-08-01T19:54:29.351 INFO:teuthology.orchestra.run.smithi101.stdout: } 2023-08-01T19:54:29.351 INFO:teuthology.orchestra.run.smithi101.stdout: ] 2023-08-01T19:54:29.351 INFO:teuthology.orchestra.run.smithi101.stdout: } 2023-08-01T19:54:29.351 INFO:teuthology.orchestra.run.smithi101.stdout: }, 2023-08-01T19:54:29.352 INFO:teuthology.orchestra.run.smithi101.stdout: { 2023-08-01T19:54:29.352 INFO:teuthology.orchestra.run.smithi101.stdout: "description": "osd_op(mds.0.3:19 3.14 3:2f55791f:::606.00000000:head [create,setxattr parent (62) in=6b,setxattr layout (30) in=6b] snapc 0=[] ondisk+write+known_if_redirected+full_force+supports_pool_eio e17)", 2023-08-01T19:54:29.352 INFO:teuthology.orchestra.run.smithi101.stdout: "initiated_at": "2023-08-01T19:54:04.459069+0000", 2023-08-01T19:54:29.352 INFO:teuthology.orchestra.run.smithi101.stdout: "age": 24.78607848, 2023-08-01T19:54:29.352 INFO:teuthology.orchestra.run.smithi101.stdout: "duration": 0.019523045999999999, 2023-08-01T19:54:29.352 INFO:teuthology.orchestra.run.smithi101.stdout: "type_data": { 2023-08-01T19:54:29.352 INFO:teuthology.orchestra.run.smithi101.stdout: "flag_point": "commit sent; apply or cleanup", 2023-08-01T19:54:29.352 INFO:teuthology.orchestra.run.smithi101.stdout: "events": [ 2023-08-01T19:54:29.353 INFO:teuthology.orchestra.run.smithi101.stdout: { 2023-08-01T19:54:29.353 INFO:teuthology.orchestra.run.smithi101.stdout: "event": "initiated", 2023-08-01T19:54:29.353 INFO:teuthology.orchestra.run.smithi101.stdout: "time": "2023-08-01T19:54:04.459069+0000", 2023-08-01T19:54:29.353 INFO:teuthology.orchestra.run.smithi101.stdout: "duration": 0 2023-08-01T19:54:29.353 INFO:teuthology.orchestra.run.smithi101.stdout: }, 2023-08-01T19:54:29.353 INFO:teuthology.orchestra.run.smithi101.stdout: { 2023-08-01T19:54:29.353 INFO:teuthology.orchestra.run.smithi101.stdout: "event": "throttled", 2023-08-01T19:54:29.353 INFO:teuthology.orchestra.run.smithi101.stdout: "time": "2023-08-01T19:54:04.459069+0000", 2023-08-01T19:54:29.354 INFO:teuthology.orchestra.run.smithi101.stdout: "duration": 0 2023-08-01T19:54:29.354 INFO:teuthology.orchestra.run.smithi101.stdout: }, 2023-08-01T19:54:29.354 INFO:teuthology.orchestra.run.smithi101.stdout: { 2023-08-01T19:54:29.354 INFO:teuthology.orchestra.run.smithi101.stdout: "event": "header_read", 2023-08-01T19:54:29.354 INFO:teuthology.orchestra.run.smithi101.stdout: "time": "2023-08-01T19:54:04.459069+0000", 2023-08-01T19:54:29.354 INFO:teuthology.orchestra.run.smithi101.stdout: "duration": 4294967295.9999995 2023-08-01T19:54:29.354 INFO:teuthology.orchestra.run.smithi101.stdout: }, 2023-08-01T19:54:29.354 INFO:teuthology.orchestra.run.smithi101.stdout: { 2023-08-01T19:54:29.355 INFO:teuthology.orchestra.run.smithi101.stdout: "event": "all_read", 2023-08-01T19:54:29.355 INFO:teuthology.orchestra.run.smithi101.stdout: "time": "2023-08-01T19:54:04.459072+0000", 2023-08-01T19:54:29.355 INFO:teuthology.orchestra.run.smithi101.stdout: "duration": 3.4570000000000001e-06 2023-08-01T19:54:29.355 INFO:teuthology.orchestra.run.smithi101.stdout: }, 2023-08-01T19:54:29.355 INFO:teuthology.orchestra.run.smithi101.stdout: { 2023-08-01T19:54:29.355 INFO:teuthology.orchestra.run.smithi101.stdout: "event": "dispatched", 2023-08-01T19:54:29.355 INFO:teuthology.orchestra.run.smithi101.stdout: "time": "2023-08-01T19:54:04.459080+0000", 2023-08-01T19:54:29.356 INFO:teuthology.orchestra.run.smithi101.stdout: "duration": 7.6009999999999997e-06 2023-08-01T19:54:29.356 INFO:teuthology.orchestra.run.smithi101.stdout: }, 2023-08-01T19:54:29.356 INFO:teuthology.orchestra.run.smithi101.stdout: { 2023-08-01T19:54:29.356 INFO:teuthology.orchestra.run.smithi101.stdout: "event": "queued_for_pg", 2023-08-01T19:54:29.356 INFO:teuthology.orchestra.run.smithi101.stdout: "time": "2023-08-01T19:54:04.459088+0000", 2023-08-01T19:54:29.356 INFO:teuthology.orchestra.run.smithi101.stdout: "duration": 8.0509999999999997e-06 2023-08-01T19:54:29.356 INFO:teuthology.orchestra.run.smithi101.stdout: }, 2023-08-01T19:54:29.356 INFO:teuthology.orchestra.run.smithi101.stdout: { 2023-08-01T19:54:29.357 INFO:teuthology.orchestra.run.smithi101.stdout: "event": "reached_pg", 2023-08-01T19:54:29.357 INFO:teuthology.orchestra.run.smithi101.stdout: "time": "2023-08-01T19:54:04.459120+0000", 2023-08-01T19:54:29.357 INFO:teuthology.orchestra.run.smithi101.stdout: "duration": 3.2078e-05 2023-08-01T19:54:29.357 INFO:teuthology.orchestra.run.smithi101.stdout: }, 2023-08-01T19:54:29.357 INFO:teuthology.orchestra.run.smithi101.stdout: { 2023-08-01T19:54:29.357 INFO:teuthology.orchestra.run.smithi101.stdout: "event": "waiting_for_map not empty", 2023-08-01T19:54:29.357 INFO:teuthology.orchestra.run.smithi101.stdout: "time": "2023-08-01T19:54:04.459123+0000", 2023-08-01T19:54:29.357 INFO:teuthology.orchestra.run.smithi101.stdout: "duration": 3.4699999999999998e-06 2023-08-01T19:54:29.358 INFO:teuthology.orchestra.run.smithi101.stdout: }, 2023-08-01T19:54:29.358 INFO:teuthology.orchestra.run.smithi101.stdout: { 2023-08-01T19:54:29.358 INFO:teuthology.orchestra.run.smithi101.stdout: "event": "reached_pg", 2023-08-01T19:54:29.358 INFO:teuthology.orchestra.run.smithi101.stdout: "time": "2023-08-01T19:54:04.471352+0000", 2023-08-01T19:54:29.358 INFO:teuthology.orchestra.run.smithi101.stdout: "duration": 0.01222926 2023-08-01T19:54:29.358 INFO:teuthology.orchestra.run.smithi101.stdout: }, 2023-08-01T19:54:29.358 INFO:teuthology.orchestra.run.smithi101.stdout: { 2023-08-01T19:54:29.358 INFO:teuthology.orchestra.run.smithi101.stdout: "event": "started", 2023-08-01T19:54:29.359 INFO:teuthology.orchestra.run.smithi101.stdout: "time": "2023-08-01T19:54:04.471495+0000", 2023-08-01T19:54:29.359 INFO:teuthology.orchestra.run.smithi101.stdout: "duration": 0.00014263899999999999 2023-08-01T19:54:29.359 INFO:teuthology.orchestra.run.smithi101.stdout: }, 2023-08-01T19:54:29.359 INFO:teuthology.orchestra.run.smithi101.stdout: { 2023-08-01T19:54:29.359 INFO:teuthology.orchestra.run.smithi101.stdout: "event": "waiting for subops from 2", 2023-08-01T19:54:29.359 INFO:teuthology.orchestra.run.smithi101.stdout: "time": "2023-08-01T19:54:04.472368+0000", 2023-08-01T19:54:29.359 INFO:teuthology.orchestra.run.smithi101.stdout: "duration": 0.00087245300000000003 2023-08-01T19:54:29.359 INFO:teuthology.orchestra.run.smithi101.stdout: }, 2023-08-01T19:54:29.360 INFO:teuthology.orchestra.run.smithi101.stdout: { 2023-08-01T19:54:29.360 INFO:teuthology.orchestra.run.smithi101.stdout: "event": "op_commit", 2023-08-01T19:54:29.360 INFO:teuthology.orchestra.run.smithi101.stdout: "time": "2023-08-01T19:54:04.477612+0000", 2023-08-01T19:54:29.360 INFO:teuthology.orchestra.run.smithi101.stdout: "duration": 0.0052442809999999999 2023-08-01T19:54:29.360 INFO:teuthology.orchestra.run.smithi101.stdout: }, 2023-08-01T19:54:29.360 INFO:teuthology.orchestra.run.smithi101.stdout: { 2023-08-01T19:54:29.360 INFO:teuthology.orchestra.run.smithi101.stdout: "event": "sub_op_commit_rec", 2023-08-01T19:54:29.361 INFO:teuthology.orchestra.run.smithi101.stdout: "time": "2023-08-01T19:54:04.478516+0000", 2023-08-01T19:54:29.361 INFO:teuthology.orchestra.run.smithi101.stdout: "duration": 0.00090399800000000004 2023-08-01T19:54:29.361 INFO:teuthology.orchestra.run.smithi101.stdout: }, 2023-08-01T19:54:29.361 INFO:teuthology.orchestra.run.smithi101.stdout: { 2023-08-01T19:54:29.361 INFO:teuthology.orchestra.run.smithi101.stdout: "event": "commit_sent", 2023-08-01T19:54:29.361 INFO:teuthology.orchestra.run.smithi101.stdout: "time": "2023-08-01T19:54:04.478555+0000", 2023-08-01T19:54:29.361 INFO:teuthology.orchestra.run.smithi101.stdout: "duration": 3.8977000000000003e-05 2023-08-01T19:54:29.361 INFO:teuthology.orchestra.run.smithi101.stdout: }, 2023-08-01T19:54:29.362 INFO:teuthology.orchestra.run.smithi101.stdout: { 2023-08-01T19:54:29.362 INFO:teuthology.orchestra.run.smithi101.stdout: "event": "done", 2023-08-01T19:54:29.362 INFO:teuthology.orchestra.run.smithi101.stdout: "time": "2023-08-01T19:54:04.478592+0000", 2023-08-01T19:54:29.362 INFO:teuthology.orchestra.run.smithi101.stdout: "duration": 3.7287999999999999e-05 2023-08-01T19:54:29.362 INFO:teuthology.orchestra.run.smithi101.stdout: } 2023-08-01T19:54:29.362 INFO:teuthology.orchestra.run.smithi101.stdout: ] 2023-08-01T19:54:29.362 INFO:teuthology.orchestra.run.smithi101.stdout: } 2023-08-01T19:54:29.362 INFO:teuthology.orchestra.run.smithi101.stdout: }, 2023-08-01T19:54:29.363 INFO:teuthology.orchestra.run.smithi101.stdout: { 2023-08-01T19:54:29.363 INFO:teuthology.orchestra.run.smithi101.stdout: "description": "osd_op(mds.0.3:20 3.1c 3:3ed09add:::607.00000000:head [omap-set-header] snapc 0=[] ondisk+write+known_if_redirected+full_force+supports_pool_eio e17)", 2023-08-01T19:54:29.363 INFO:teuthology.orchestra.run.smithi101.stdout: "initiated_at": "2023-08-01T19:54:04.459097+0000", 2023-08-01T19:54:29.363 INFO:teuthology.orchestra.run.smithi101.stdout: "age": 24.786050776, 2023-08-01T19:54:29.363 INFO:teuthology.orchestra.run.smithi101.stdout: "duration": 0.018578978999999999, 2023-08-01T19:54:29.363 INFO:teuthology.orchestra.run.smithi101.stdout: "type_data": { 2023-08-01T19:54:29.363 INFO:teuthology.orchestra.run.smithi101.stdout: "flag_point": "commit sent; apply or cleanup", 2023-08-01T19:54:29.363 INFO:teuthology.orchestra.run.smithi101.stdout: "events": [ 2023-08-01T19:54:29.364 INFO:teuthology.orchestra.run.smithi101.stdout: { 2023-08-01T19:54:29.364 INFO:teuthology.orchestra.run.smithi101.stdout: "event": "initiated", 2023-08-01T19:54:29.364 INFO:teuthology.orchestra.run.smithi101.stdout: "time": "2023-08-01T19:54:04.459097+0000", 2023-08-01T19:54:29.364 INFO:teuthology.orchestra.run.smithi101.stdout: "duration": 0 2023-08-01T19:54:29.364 INFO:teuthology.orchestra.run.smithi101.stdout: }, 2023-08-01T19:54:29.364 INFO:teuthology.orchestra.run.smithi101.stdout: { 2023-08-01T19:54:29.364 INFO:teuthology.orchestra.run.smithi101.stdout: "event": "throttled", 2023-08-01T19:54:29.364 INFO:teuthology.orchestra.run.smithi101.stdout: "time": "2023-08-01T19:54:04.459097+0000", 2023-08-01T19:54:29.365 INFO:teuthology.orchestra.run.smithi101.stdout: "duration": 0 2023-08-01T19:54:29.365 INFO:teuthology.orchestra.run.smithi101.stdout: }, 2023-08-01T19:54:29.365 INFO:teuthology.orchestra.run.smithi101.stdout: { 2023-08-01T19:54:29.365 INFO:teuthology.orchestra.run.smithi101.stdout: "event": "header_read", 2023-08-01T19:54:29.365 INFO:teuthology.orchestra.run.smithi101.stdout: "time": "2023-08-01T19:54:04.459096+0000", 2023-08-01T19:54:29.365 INFO:teuthology.orchestra.run.smithi101.stdout: "duration": 4294967295.9999995 2023-08-01T19:54:29.365 INFO:teuthology.orchestra.run.smithi101.stdout: }, 2023-08-01T19:54:29.365 INFO:teuthology.orchestra.run.smithi101.stdout: { 2023-08-01T19:54:29.366 INFO:teuthology.orchestra.run.smithi101.stdout: "event": "all_read", 2023-08-01T19:54:29.366 INFO:teuthology.orchestra.run.smithi101.stdout: "time": "2023-08-01T19:54:04.459105+0000", 2023-08-01T19:54:29.366 INFO:teuthology.orchestra.run.smithi101.stdout: "duration": 8.8259999999999999e-06 2023-08-01T19:54:29.366 INFO:teuthology.orchestra.run.smithi101.stdout: }, 2023-08-01T19:54:29.366 INFO:teuthology.orchestra.run.smithi101.stdout: { 2023-08-01T19:54:29.366 INFO:teuthology.orchestra.run.smithi101.stdout: "event": "dispatched", 2023-08-01T19:54:29.366 INFO:teuthology.orchestra.run.smithi101.stdout: "time": "2023-08-01T19:54:04.459112+0000", 2023-08-01T19:54:29.366 INFO:teuthology.orchestra.run.smithi101.stdout: "duration": 6.6660000000000002e-06 2023-08-01T19:54:29.367 INFO:teuthology.orchestra.run.smithi101.stdout: }, 2023-08-01T19:54:29.367 INFO:teuthology.orchestra.run.smithi101.stdout: { 2023-08-01T19:54:29.367 INFO:teuthology.orchestra.run.smithi101.stdout: "event": "queued_for_pg", 2023-08-01T19:54:29.367 INFO:teuthology.orchestra.run.smithi101.stdout: "time": "2023-08-01T19:54:04.459116+0000", 2023-08-01T19:54:29.367 INFO:teuthology.orchestra.run.smithi101.stdout: "duration": 4.2209999999999999e-06 2023-08-01T19:54:29.367 INFO:teuthology.orchestra.run.smithi101.stdout: }, 2023-08-01T19:54:29.367 INFO:teuthology.orchestra.run.smithi101.stdout: { 2023-08-01T19:54:29.367 INFO:teuthology.orchestra.run.smithi101.stdout: "event": "reached_pg", 2023-08-01T19:54:29.368 INFO:teuthology.orchestra.run.smithi101.stdout: "time": "2023-08-01T19:54:04.459141+0000", 2023-08-01T19:54:29.368 INFO:teuthology.orchestra.run.smithi101.stdout: "duration": 2.4627e-05 2023-08-01T19:54:29.368 INFO:teuthology.orchestra.run.smithi101.stdout: }, 2023-08-01T19:54:29.368 INFO:teuthology.orchestra.run.smithi101.stdout: { 2023-08-01T19:54:29.368 INFO:teuthology.orchestra.run.smithi101.stdout: "event": "op must wait for map", 2023-08-01T19:54:29.368 INFO:teuthology.orchestra.run.smithi101.stdout: "time": "2023-08-01T19:54:04.459144+0000", 2023-08-01T19:54:29.368 INFO:teuthology.orchestra.run.smithi101.stdout: "duration": 3.6559999999999998e-06 2023-08-01T19:54:29.369 INFO:teuthology.orchestra.run.smithi101.stdout: }, 2023-08-01T19:54:29.369 INFO:teuthology.orchestra.run.smithi101.stdout: { 2023-08-01T19:54:29.369 INFO:teuthology.orchestra.run.smithi101.stdout: "event": "reached_pg", 2023-08-01T19:54:29.369 INFO:teuthology.orchestra.run.smithi101.stdout: "time": "2023-08-01T19:54:04.468086+0000", 2023-08-01T19:54:29.369 INFO:teuthology.orchestra.run.smithi101.stdout: "duration": 0.0089415569999999993 2023-08-01T19:54:29.369 INFO:teuthology.orchestra.run.smithi101.stdout: }, 2023-08-01T19:54:29.369 INFO:teuthology.orchestra.run.smithi101.stdout: { 2023-08-01T19:54:29.369 INFO:teuthology.orchestra.run.smithi101.stdout: "event": "started", 2023-08-01T19:54:29.370 INFO:teuthology.orchestra.run.smithi101.stdout: "time": "2023-08-01T19:54:04.468204+0000", 2023-08-01T19:54:29.370 INFO:teuthology.orchestra.run.smithi101.stdout: "duration": 0.00011806700000000001 2023-08-01T19:54:29.370 INFO:teuthology.orchestra.run.smithi101.stdout: }, 2023-08-01T19:54:29.370 INFO:teuthology.orchestra.run.smithi101.stdout: { 2023-08-01T19:54:29.370 INFO:teuthology.orchestra.run.smithi101.stdout: "event": "waiting for subops from 0", 2023-08-01T19:54:29.370 INFO:teuthology.orchestra.run.smithi101.stdout: "time": "2023-08-01T19:54:04.468342+0000", 2023-08-01T19:54:29.370 INFO:teuthology.orchestra.run.smithi101.stdout: "duration": 0.000138269 2023-08-01T19:54:29.370 INFO:teuthology.orchestra.run.smithi101.stdout: }, 2023-08-01T19:54:29.371 INFO:teuthology.orchestra.run.smithi101.stdout: { 2023-08-01T19:54:29.371 INFO:teuthology.orchestra.run.smithi101.stdout: "event": "op_commit", 2023-08-01T19:54:29.371 INFO:teuthology.orchestra.run.smithi101.stdout: "time": "2023-08-01T19:54:04.474028+0000", 2023-08-01T19:54:29.371 INFO:teuthology.orchestra.run.smithi101.stdout: "duration": 0.005685458 2023-08-01T19:54:29.371 INFO:teuthology.orchestra.run.smithi101.stdout: }, 2023-08-01T19:54:29.371 INFO:teuthology.orchestra.run.smithi101.stdout: { 2023-08-01T19:54:29.371 INFO:teuthology.orchestra.run.smithi101.stdout: "event": "sub_op_commit_rec", 2023-08-01T19:54:29.371 INFO:teuthology.orchestra.run.smithi101.stdout: "time": "2023-08-01T19:54:04.477581+0000", 2023-08-01T19:54:29.372 INFO:teuthology.orchestra.run.smithi101.stdout: "duration": 0.0035531109999999999 2023-08-01T19:54:29.372 INFO:teuthology.orchestra.run.smithi101.stdout: }, 2023-08-01T19:54:29.372 INFO:teuthology.orchestra.run.smithi101.stdout: { 2023-08-01T19:54:29.372 INFO:teuthology.orchestra.run.smithi101.stdout: "event": "commit_sent", 2023-08-01T19:54:29.372 INFO:teuthology.orchestra.run.smithi101.stdout: "time": "2023-08-01T19:54:04.477635+0000", 2023-08-01T19:54:29.372 INFO:teuthology.orchestra.run.smithi101.stdout: "duration": 5.3769e-05 2023-08-01T19:54:29.372 INFO:teuthology.orchestra.run.smithi101.stdout: }, 2023-08-01T19:54:29.372 INFO:teuthology.orchestra.run.smithi101.stdout: { 2023-08-01T19:54:29.373 INFO:teuthology.orchestra.run.smithi101.stdout: "event": "done", 2023-08-01T19:54:29.373 INFO:teuthology.orchestra.run.smithi101.stdout: "time": "2023-08-01T19:54:04.477676+0000", 2023-08-01T19:54:29.373 INFO:teuthology.orchestra.run.smithi101.stdout: "duration": 4.1148e-05 2023-08-01T19:54:29.373 INFO:teuthology.orchestra.run.smithi101.stdout: } 2023-08-01T19:54:29.373 INFO:teuthology.orchestra.run.smithi101.stdout: ] 2023-08-01T19:54:29.373 INFO:teuthology.orchestra.run.smithi101.stdout: } 2023-08-01T19:54:29.373 INFO:teuthology.orchestra.run.smithi101.stdout: }, 2023-08-01T19:54:29.373 INFO:teuthology.orchestra.run.smithi101.stdout: { 2023-08-01T19:54:29.374 INFO:teuthology.orchestra.run.smithi101.stdout: "description": "osd_op(mds.0.3:21 3.1c 3:3ed09add:::607.00000000:head [create,setxattr parent (62) in=6b,setxattr layout (30) in=6b] snapc 0=[] ondisk+write+known_if_redirected+full_force+supports_pool_eio e17)", 2023-08-01T19:54:29.374 INFO:teuthology.orchestra.run.smithi101.stdout: "initiated_at": "2023-08-01T19:54:04.459123+0000", 2023-08-01T19:54:29.374 INFO:teuthology.orchestra.run.smithi101.stdout: "age": 24.786024618999999, 2023-08-01T19:54:29.374 INFO:teuthology.orchestra.run.smithi101.stdout: "duration": 0.018736452000000001, 2023-08-01T19:54:29.374 INFO:teuthology.orchestra.run.smithi101.stdout: "type_data": { 2023-08-01T19:54:29.374 INFO:teuthology.orchestra.run.smithi101.stdout: "flag_point": "commit sent; apply or cleanup", 2023-08-01T19:54:29.374 INFO:teuthology.orchestra.run.smithi101.stdout: "events": [ 2023-08-01T19:54:29.374 INFO:teuthology.orchestra.run.smithi101.stdout: { 2023-08-01T19:54:29.375 INFO:teuthology.orchestra.run.smithi101.stdout: "event": "initiated", 2023-08-01T19:54:29.375 INFO:teuthology.orchestra.run.smithi101.stdout: "time": "2023-08-01T19:54:04.459123+0000", 2023-08-01T19:54:29.375 INFO:teuthology.orchestra.run.smithi101.stdout: "duration": 0 2023-08-01T19:54:29.375 INFO:teuthology.orchestra.run.smithi101.stdout: }, 2023-08-01T19:54:29.375 INFO:teuthology.orchestra.run.smithi101.stdout: { 2023-08-01T19:54:29.375 INFO:teuthology.orchestra.run.smithi101.stdout: "event": "throttled", 2023-08-01T19:54:29.375 INFO:teuthology.orchestra.run.smithi101.stdout: "time": "2023-08-01T19:54:04.459123+0000", 2023-08-01T19:54:29.376 INFO:teuthology.orchestra.run.smithi101.stdout: "duration": 0 2023-08-01T19:54:29.376 INFO:teuthology.orchestra.run.smithi101.stdout: }, 2023-08-01T19:54:29.376 INFO:teuthology.orchestra.run.smithi101.stdout: { 2023-08-01T19:54:29.376 INFO:teuthology.orchestra.run.smithi101.stdout: "event": "header_read", 2023-08-01T19:54:29.376 INFO:teuthology.orchestra.run.smithi101.stdout: "time": "2023-08-01T19:54:04.459123+0000", 2023-08-01T19:54:29.376 INFO:teuthology.orchestra.run.smithi101.stdout: "duration": 4294967295.9999995 2023-08-01T19:54:29.376 INFO:teuthology.orchestra.run.smithi101.stdout: }, 2023-08-01T19:54:29.376 INFO:teuthology.orchestra.run.smithi101.stdout: { 2023-08-01T19:54:29.377 INFO:teuthology.orchestra.run.smithi101.stdout: "event": "all_read", 2023-08-01T19:54:29.377 INFO:teuthology.orchestra.run.smithi101.stdout: "time": "2023-08-01T19:54:04.459127+0000", 2023-08-01T19:54:29.377 INFO:teuthology.orchestra.run.smithi101.stdout: "duration": 4.5770000000000004e-06 2023-08-01T19:54:29.377 INFO:teuthology.orchestra.run.smithi101.stdout: }, 2023-08-01T19:54:29.377 INFO:teuthology.orchestra.run.smithi101.stdout: { 2023-08-01T19:54:29.377 INFO:teuthology.orchestra.run.smithi101.stdout: "event": "dispatched", 2023-08-01T19:54:29.377 INFO:teuthology.orchestra.run.smithi101.stdout: "time": "2023-08-01T19:54:04.459134+0000", 2023-08-01T19:54:29.377 INFO:teuthology.orchestra.run.smithi101.stdout: "duration": 6.5080000000000002e-06 2023-08-01T19:54:29.378 INFO:teuthology.orchestra.run.smithi101.stdout: }, 2023-08-01T19:54:29.378 INFO:teuthology.orchestra.run.smithi101.stdout: { 2023-08-01T19:54:29.378 INFO:teuthology.orchestra.run.smithi101.stdout: "event": "queued_for_pg", 2023-08-01T19:54:29.378 INFO:teuthology.orchestra.run.smithi101.stdout: "time": "2023-08-01T19:54:04.459138+0000", 2023-08-01T19:54:29.378 INFO:teuthology.orchestra.run.smithi101.stdout: "duration": 4.6249999999999998e-06 2023-08-01T19:54:29.378 INFO:teuthology.orchestra.run.smithi101.stdout: }, 2023-08-01T19:54:29.378 INFO:teuthology.orchestra.run.smithi101.stdout: { 2023-08-01T19:54:29.378 INFO:teuthology.orchestra.run.smithi101.stdout: "event": "reached_pg", 2023-08-01T19:54:29.379 INFO:teuthology.orchestra.run.smithi101.stdout: "time": "2023-08-01T19:54:04.459158+0000", 2023-08-01T19:54:29.379 INFO:teuthology.orchestra.run.smithi101.stdout: "duration": 1.9354000000000001e-05 2023-08-01T19:54:29.379 INFO:teuthology.orchestra.run.smithi101.stdout: }, 2023-08-01T19:54:29.379 INFO:teuthology.orchestra.run.smithi101.stdout: { 2023-08-01T19:54:29.379 INFO:teuthology.orchestra.run.smithi101.stdout: "event": "waiting_for_map not empty", 2023-08-01T19:54:29.379 INFO:teuthology.orchestra.run.smithi101.stdout: "time": "2023-08-01T19:54:04.459160+0000", 2023-08-01T19:54:29.379 INFO:teuthology.orchestra.run.smithi101.stdout: "duration": 2.2740000000000002e-06 2023-08-01T19:54:29.379 INFO:teuthology.orchestra.run.smithi101.stdout: }, 2023-08-01T19:54:29.380 INFO:teuthology.orchestra.run.smithi101.stdout: { 2023-08-01T19:54:29.380 INFO:teuthology.orchestra.run.smithi101.stdout: "event": "reached_pg", 2023-08-01T19:54:29.380 INFO:teuthology.orchestra.run.smithi101.stdout: "time": "2023-08-01T19:54:04.468839+0000", 2023-08-01T19:54:29.380 INFO:teuthology.orchestra.run.smithi101.stdout: "duration": 0.0096787109999999996 2023-08-01T19:54:29.380 INFO:teuthology.orchestra.run.smithi101.stdout: }, 2023-08-01T19:54:29.380 INFO:teuthology.orchestra.run.smithi101.stdout: { 2023-08-01T19:54:29.380 INFO:teuthology.orchestra.run.smithi101.stdout: "event": "started", 2023-08-01T19:54:29.380 INFO:teuthology.orchestra.run.smithi101.stdout: "time": "2023-08-01T19:54:04.469446+0000", 2023-08-01T19:54:29.381 INFO:teuthology.orchestra.run.smithi101.stdout: "duration": 0.00060714899999999997 2023-08-01T19:54:29.381 INFO:teuthology.orchestra.run.smithi101.stdout: }, 2023-08-01T19:54:29.381 INFO:teuthology.orchestra.run.smithi101.stdout: { 2023-08-01T19:54:29.381 INFO:teuthology.orchestra.run.smithi101.stdout: "event": "waiting for subops from 0", 2023-08-01T19:54:29.381 INFO:teuthology.orchestra.run.smithi101.stdout: "time": "2023-08-01T19:54:04.470133+0000", 2023-08-01T19:54:29.381 INFO:teuthology.orchestra.run.smithi101.stdout: "duration": 0.00068691900000000003 2023-08-01T19:54:29.381 INFO:teuthology.orchestra.run.smithi101.stdout: }, 2023-08-01T19:54:29.381 INFO:teuthology.orchestra.run.smithi101.stdout: { 2023-08-01T19:54:29.382 INFO:teuthology.orchestra.run.smithi101.stdout: "event": "op_commit", 2023-08-01T19:54:29.382 INFO:teuthology.orchestra.run.smithi101.stdout: "time": "2023-08-01T19:54:04.475933+0000", 2023-08-01T19:54:29.382 INFO:teuthology.orchestra.run.smithi101.stdout: "duration": 0.0058002560000000002 2023-08-01T19:54:29.382 INFO:teuthology.orchestra.run.smithi101.stdout: }, 2023-08-01T19:54:29.382 INFO:teuthology.orchestra.run.smithi101.stdout: { 2023-08-01T19:54:29.382 INFO:teuthology.orchestra.run.smithi101.stdout: "event": "sub_op_commit_rec", 2023-08-01T19:54:29.382 INFO:teuthology.orchestra.run.smithi101.stdout: "time": "2023-08-01T19:54:04.477749+0000", 2023-08-01T19:54:29.382 INFO:teuthology.orchestra.run.smithi101.stdout: "duration": 0.00181584 2023-08-01T19:54:29.383 INFO:teuthology.orchestra.run.smithi101.stdout: }, 2023-08-01T19:54:29.383 INFO:teuthology.orchestra.run.smithi101.stdout: { 2023-08-01T19:54:29.383 INFO:teuthology.orchestra.run.smithi101.stdout: "event": "commit_sent", 2023-08-01T19:54:29.383 INFO:teuthology.orchestra.run.smithi101.stdout: "time": "2023-08-01T19:54:04.477823+0000", 2023-08-01T19:54:29.383 INFO:teuthology.orchestra.run.smithi101.stdout: "duration": 7.4405000000000003e-05 2023-08-01T19:54:29.383 INFO:teuthology.orchestra.run.smithi101.stdout: }, 2023-08-01T19:54:29.383 INFO:teuthology.orchestra.run.smithi101.stdout: { 2023-08-01T19:54:29.383 INFO:teuthology.orchestra.run.smithi101.stdout: "event": "done", 2023-08-01T19:54:29.384 INFO:teuthology.orchestra.run.smithi101.stdout: "time": "2023-08-01T19:54:04.477859+0000", 2023-08-01T19:54:29.384 INFO:teuthology.orchestra.run.smithi101.stdout: "duration": 3.6211000000000003e-05 2023-08-01T19:54:29.384 INFO:teuthology.orchestra.run.smithi101.stdout: } 2023-08-01T19:54:29.384 INFO:teuthology.orchestra.run.smithi101.stdout: ] 2023-08-01T19:54:29.384 INFO:teuthology.orchestra.run.smithi101.stdout: } 2023-08-01T19:54:29.384 INFO:teuthology.orchestra.run.smithi101.stdout: }, 2023-08-01T19:54:29.384 INFO:teuthology.orchestra.run.smithi101.stdout: { 2023-08-01T19:54:29.385 INFO:teuthology.orchestra.run.smithi101.stdout: "description": "osd_op(mds.0.3:29 3.13 3:cd5a64a3:::100.00000000:head [omap-set-header,omap-set-vals] snapc 0=[] ondisk+write+known_if_redirected+full_force+supports_pool_eio e17)", 2023-08-01T19:54:29.385 INFO:teuthology.orchestra.run.smithi101.stdout: "initiated_at": "2023-08-01T19:54:04.459146+0000", 2023-08-01T19:54:29.385 INFO:teuthology.orchestra.run.smithi101.stdout: "age": 24.786001418000001, 2023-08-01T19:54:29.385 INFO:teuthology.orchestra.run.smithi101.stdout: "duration": 0.015668519999999998, 2023-08-01T19:54:29.385 INFO:teuthology.orchestra.run.smithi101.stdout: "type_data": { 2023-08-01T19:54:29.385 INFO:teuthology.orchestra.run.smithi101.stdout: "flag_point": "commit sent; apply or cleanup", 2023-08-01T19:54:29.385 INFO:teuthology.orchestra.run.smithi101.stdout: "events": [ 2023-08-01T19:54:29.385 INFO:teuthology.orchestra.run.smithi101.stdout: { 2023-08-01T19:54:29.386 INFO:teuthology.orchestra.run.smithi101.stdout: "event": "initiated", 2023-08-01T19:54:29.386 INFO:teuthology.orchestra.run.smithi101.stdout: "time": "2023-08-01T19:54:04.459146+0000", 2023-08-01T19:54:29.386 INFO:teuthology.orchestra.run.smithi101.stdout: "duration": 0 2023-08-01T19:54:29.386 INFO:teuthology.orchestra.run.smithi101.stdout: }, 2023-08-01T19:54:29.386 INFO:teuthology.orchestra.run.smithi101.stdout: { 2023-08-01T19:54:29.386 INFO:teuthology.orchestra.run.smithi101.stdout: "event": "throttled", 2023-08-01T19:54:29.386 INFO:teuthology.orchestra.run.smithi101.stdout: "time": "2023-08-01T19:54:04.459146+0000", 2023-08-01T19:54:29.386 INFO:teuthology.orchestra.run.smithi101.stdout: "duration": 0 2023-08-01T19:54:29.387 INFO:teuthology.orchestra.run.smithi101.stdout: }, 2023-08-01T19:54:29.387 INFO:teuthology.orchestra.run.smithi101.stdout: { 2023-08-01T19:54:29.387 INFO:teuthology.orchestra.run.smithi101.stdout: "event": "header_read", 2023-08-01T19:54:29.387 INFO:teuthology.orchestra.run.smithi101.stdout: "time": "2023-08-01T19:54:04.459146+0000", 2023-08-01T19:54:29.387 INFO:teuthology.orchestra.run.smithi101.stdout: "duration": 4294967295.9999995 2023-08-01T19:54:29.387 INFO:teuthology.orchestra.run.smithi101.stdout: }, 2023-08-01T19:54:29.387 INFO:teuthology.orchestra.run.smithi101.stdout: { 2023-08-01T19:54:29.387 INFO:teuthology.orchestra.run.smithi101.stdout: "event": "all_read", 2023-08-01T19:54:29.388 INFO:teuthology.orchestra.run.smithi101.stdout: "time": "2023-08-01T19:54:04.459155+0000", 2023-08-01T19:54:29.388 INFO:teuthology.orchestra.run.smithi101.stdout: "duration": 9.6020000000000006e-06 2023-08-01T19:54:29.388 INFO:teuthology.orchestra.run.smithi101.stdout: }, 2023-08-01T19:54:29.388 INFO:teuthology.orchestra.run.smithi101.stdout: { 2023-08-01T19:54:29.388 INFO:teuthology.orchestra.run.smithi101.stdout: "event": "dispatched", 2023-08-01T19:54:29.388 INFO:teuthology.orchestra.run.smithi101.stdout: "time": "2023-08-01T19:54:04.459162+0000", 2023-08-01T19:54:29.388 INFO:teuthology.orchestra.run.smithi101.stdout: "duration": 7.0439999999999998e-06 2023-08-01T19:54:29.388 INFO:teuthology.orchestra.run.smithi101.stdout: }, 2023-08-01T19:54:29.389 INFO:teuthology.orchestra.run.smithi101.stdout: { 2023-08-01T19:54:29.389 INFO:teuthology.orchestra.run.smithi101.stdout: "event": "queued_for_pg", 2023-08-01T19:54:29.389 INFO:teuthology.orchestra.run.smithi101.stdout: "time": "2023-08-01T19:54:04.459167+0000", 2023-08-01T19:54:29.389 INFO:teuthology.orchestra.run.smithi101.stdout: "duration": 4.3989999999999997e-06 2023-08-01T19:54:29.389 INFO:teuthology.orchestra.run.smithi101.stdout: }, 2023-08-01T19:54:29.389 INFO:teuthology.orchestra.run.smithi101.stdout: { 2023-08-01T19:54:29.389 INFO:teuthology.orchestra.run.smithi101.stdout: "event": "reached_pg", 2023-08-01T19:54:29.389 INFO:teuthology.orchestra.run.smithi101.stdout: "time": "2023-08-01T19:54:04.459201+0000", 2023-08-01T19:54:29.390 INFO:teuthology.orchestra.run.smithi101.stdout: "duration": 3.4406000000000002e-05 2023-08-01T19:54:29.390 INFO:teuthology.orchestra.run.smithi101.stdout: }, 2023-08-01T19:54:29.390 INFO:teuthology.orchestra.run.smithi101.stdout: { 2023-08-01T19:54:29.390 INFO:teuthology.orchestra.run.smithi101.stdout: "event": "op must wait for map", 2023-08-01T19:54:29.390 INFO:teuthology.orchestra.run.smithi101.stdout: "time": "2023-08-01T19:54:04.459206+0000", 2023-08-01T19:54:29.390 INFO:teuthology.orchestra.run.smithi101.stdout: "duration": 5.04e-06 2023-08-01T19:54:29.390 INFO:teuthology.orchestra.run.smithi101.stdout: }, 2023-08-01T19:54:29.390 INFO:teuthology.orchestra.run.smithi101.stdout: { 2023-08-01T19:54:29.391 INFO:teuthology.orchestra.run.smithi101.stdout: "event": "reached_pg", 2023-08-01T19:54:29.391 INFO:teuthology.orchestra.run.smithi101.stdout: "time": "2023-08-01T19:54:04.468278+0000", 2023-08-01T19:54:29.391 INFO:teuthology.orchestra.run.smithi101.stdout: "duration": 0.0090714899999999998 2023-08-01T19:54:29.391 INFO:teuthology.orchestra.run.smithi101.stdout: }, 2023-08-01T19:54:29.391 INFO:teuthology.orchestra.run.smithi101.stdout: { 2023-08-01T19:54:29.391 INFO:teuthology.orchestra.run.smithi101.stdout: "event": "started", 2023-08-01T19:54:29.391 INFO:teuthology.orchestra.run.smithi101.stdout: "time": "2023-08-01T19:54:04.468419+0000", 2023-08-01T19:54:29.391 INFO:teuthology.orchestra.run.smithi101.stdout: "duration": 0.00014119100000000001 2023-08-01T19:54:29.392 INFO:teuthology.orchestra.run.smithi101.stdout: }, 2023-08-01T19:54:29.392 INFO:teuthology.orchestra.run.smithi101.stdout: { 2023-08-01T19:54:29.392 INFO:teuthology.orchestra.run.smithi101.stdout: "event": "waiting for subops from 0", 2023-08-01T19:54:29.392 INFO:teuthology.orchestra.run.smithi101.stdout: "time": "2023-08-01T19:54:04.468598+0000", 2023-08-01T19:54:29.392 INFO:teuthology.orchestra.run.smithi101.stdout: "duration": 0.00017872799999999999 2023-08-01T19:54:29.392 INFO:teuthology.orchestra.run.smithi101.stdout: }, 2023-08-01T19:54:29.392 INFO:teuthology.orchestra.run.smithi101.stdout: { 2023-08-01T19:54:29.393 INFO:teuthology.orchestra.run.smithi101.stdout: "event": "op_commit", 2023-08-01T19:54:29.393 INFO:teuthology.orchestra.run.smithi101.stdout: "time": "2023-08-01T19:54:04.472625+0000", 2023-08-01T19:54:29.393 INFO:teuthology.orchestra.run.smithi101.stdout: "duration": 0.0040273729999999999 2023-08-01T19:54:29.393 INFO:teuthology.orchestra.run.smithi101.stdout: }, 2023-08-01T19:54:29.393 INFO:teuthology.orchestra.run.smithi101.stdout: { 2023-08-01T19:54:29.393 INFO:teuthology.orchestra.run.smithi101.stdout: "event": "sub_op_commit_rec", 2023-08-01T19:54:29.393 INFO:teuthology.orchestra.run.smithi101.stdout: "time": "2023-08-01T19:54:04.474719+0000", 2023-08-01T19:54:29.393 INFO:teuthology.orchestra.run.smithi101.stdout: "duration": 0.0020941509999999998 2023-08-01T19:54:29.394 INFO:teuthology.orchestra.run.smithi101.stdout: }, 2023-08-01T19:54:29.394 INFO:teuthology.orchestra.run.smithi101.stdout: { 2023-08-01T19:54:29.394 INFO:teuthology.orchestra.run.smithi101.stdout: "event": "commit_sent", 2023-08-01T19:54:29.394 INFO:teuthology.orchestra.run.smithi101.stdout: "time": "2023-08-01T19:54:04.474776+0000", 2023-08-01T19:54:29.394 INFO:teuthology.orchestra.run.smithi101.stdout: "duration": 5.6368e-05 2023-08-01T19:54:29.394 INFO:teuthology.orchestra.run.smithi101.stdout: }, 2023-08-01T19:54:29.394 INFO:teuthology.orchestra.run.smithi101.stdout: { 2023-08-01T19:54:29.394 INFO:teuthology.orchestra.run.smithi101.stdout: "event": "done", 2023-08-01T19:54:29.395 INFO:teuthology.orchestra.run.smithi101.stdout: "time": "2023-08-01T19:54:04.474815+0000", 2023-08-01T19:54:29.395 INFO:teuthology.orchestra.run.smithi101.stdout: "duration": 3.9112000000000001e-05 2023-08-01T19:54:29.395 INFO:teuthology.orchestra.run.smithi101.stdout: } 2023-08-01T19:54:29.395 INFO:teuthology.orchestra.run.smithi101.stdout: ] 2023-08-01T19:54:29.395 INFO:teuthology.orchestra.run.smithi101.stdout: } 2023-08-01T19:54:29.395 INFO:teuthology.orchestra.run.smithi101.stdout: }, 2023-08-01T19:54:29.395 INFO:teuthology.orchestra.run.smithi101.stdout: { 2023-08-01T19:54:29.395 INFO:teuthology.orchestra.run.smithi101.stdout: "description": "osd_op(mds.0.3:1 3.14 3:292cf221:::200.00000000:head [writefull 0~90] snapc 0=[] ondisk+write+known_if_redirected+full_force+supports_pool_eio e17)", 2023-08-01T19:54:29.396 INFO:teuthology.orchestra.run.smithi101.stdout: "initiated_at": "2023-08-01T19:54:04.459177+0000", 2023-08-01T19:54:29.396 INFO:teuthology.orchestra.run.smithi101.stdout: "age": 24.78597091, 2023-08-01T19:54:29.396 INFO:teuthology.orchestra.run.smithi101.stdout: "duration": 0.021067196, 2023-08-01T19:54:29.396 INFO:teuthology.orchestra.run.smithi101.stdout: "type_data": { 2023-08-01T19:54:29.396 INFO:teuthology.orchestra.run.smithi101.stdout: "flag_point": "commit sent; apply or cleanup", 2023-08-01T19:54:29.396 INFO:teuthology.orchestra.run.smithi101.stdout: "events": [ 2023-08-01T19:54:29.396 INFO:teuthology.orchestra.run.smithi101.stdout: { 2023-08-01T19:54:29.396 INFO:teuthology.orchestra.run.smithi101.stdout: "event": "initiated", 2023-08-01T19:54:29.397 INFO:teuthology.orchestra.run.smithi101.stdout: "time": "2023-08-01T19:54:04.459177+0000", 2023-08-01T19:54:29.397 INFO:teuthology.orchestra.run.smithi101.stdout: "duration": 0 2023-08-01T19:54:29.397 INFO:teuthology.orchestra.run.smithi101.stdout: }, 2023-08-01T19:54:29.397 INFO:teuthology.orchestra.run.smithi101.stdout: { 2023-08-01T19:54:29.397 INFO:teuthology.orchestra.run.smithi101.stdout: "event": "throttled", 2023-08-01T19:54:29.397 INFO:teuthology.orchestra.run.smithi101.stdout: "time": "2023-08-01T19:54:04.459177+0000", 2023-08-01T19:54:29.397 INFO:teuthology.orchestra.run.smithi101.stdout: "duration": 0 2023-08-01T19:54:29.397 INFO:teuthology.orchestra.run.smithi101.stdout: }, 2023-08-01T19:54:29.398 INFO:teuthology.orchestra.run.smithi101.stdout: { 2023-08-01T19:54:29.398 INFO:teuthology.orchestra.run.smithi101.stdout: "event": "header_read", 2023-08-01T19:54:29.398 INFO:teuthology.orchestra.run.smithi101.stdout: "time": "2023-08-01T19:54:04.459176+0000", 2023-08-01T19:54:29.398 INFO:teuthology.orchestra.run.smithi101.stdout: "duration": 4294967295.9999995 2023-08-01T19:54:29.398 INFO:teuthology.orchestra.run.smithi101.stdout: }, 2023-08-01T19:54:29.398 INFO:teuthology.orchestra.run.smithi101.stdout: { 2023-08-01T19:54:29.398 INFO:teuthology.orchestra.run.smithi101.stdout: "event": "all_read", 2023-08-01T19:54:29.398 INFO:teuthology.orchestra.run.smithi101.stdout: "time": "2023-08-01T19:54:04.459181+0000", 2023-08-01T19:54:29.399 INFO:teuthology.orchestra.run.smithi101.stdout: "duration": 5.2109999999999997e-06 2023-08-01T19:54:29.399 INFO:teuthology.orchestra.run.smithi101.stdout: }, 2023-08-01T19:54:29.399 INFO:teuthology.orchestra.run.smithi101.stdout: { 2023-08-01T19:54:29.399 INFO:teuthology.orchestra.run.smithi101.stdout: "event": "dispatched", 2023-08-01T19:54:29.399 INFO:teuthology.orchestra.run.smithi101.stdout: "time": "2023-08-01T19:54:04.459188+0000", 2023-08-01T19:54:29.399 INFO:teuthology.orchestra.run.smithi101.stdout: "duration": 6.6680000000000004e-06 2023-08-01T19:54:29.399 INFO:teuthology.orchestra.run.smithi101.stdout: }, 2023-08-01T19:54:29.400 INFO:teuthology.orchestra.run.smithi101.stdout: { 2023-08-01T19:54:29.400 INFO:teuthology.orchestra.run.smithi101.stdout: "event": "queued_for_pg", 2023-08-01T19:54:29.400 INFO:teuthology.orchestra.run.smithi101.stdout: "time": "2023-08-01T19:54:04.459192+0000", 2023-08-01T19:54:29.400 INFO:teuthology.orchestra.run.smithi101.stdout: "duration": 4.228e-06 2023-08-01T19:54:29.400 INFO:teuthology.orchestra.run.smithi101.stdout: }, 2023-08-01T19:54:29.400 INFO:teuthology.orchestra.run.smithi101.stdout: { 2023-08-01T19:54:29.400 INFO:teuthology.orchestra.run.smithi101.stdout: "event": "reached_pg", 2023-08-01T19:54:29.401 INFO:teuthology.orchestra.run.smithi101.stdout: "time": "2023-08-01T19:54:04.459219+0000", 2023-08-01T19:54:29.401 INFO:teuthology.orchestra.run.smithi101.stdout: "duration": 2.6930000000000001e-05 2023-08-01T19:54:29.401 INFO:teuthology.orchestra.run.smithi101.stdout: }, 2023-08-01T19:54:29.401 INFO:teuthology.orchestra.run.smithi101.stdout: { 2023-08-01T19:54:29.401 INFO:teuthology.orchestra.run.smithi101.stdout: "event": "waiting_for_map not empty", 2023-08-01T19:54:29.401 INFO:teuthology.orchestra.run.smithi101.stdout: "time": "2023-08-01T19:54:04.459223+0000", 2023-08-01T19:54:29.401 INFO:teuthology.orchestra.run.smithi101.stdout: "duration": 3.8469999999999998e-06 2023-08-01T19:54:29.401 INFO:teuthology.orchestra.run.smithi101.stdout: }, 2023-08-01T19:54:29.402 INFO:teuthology.orchestra.run.smithi101.stdout: { 2023-08-01T19:54:29.402 INFO:teuthology.orchestra.run.smithi101.stdout: "event": "reached_pg", 2023-08-01T19:54:29.402 INFO:teuthology.orchestra.run.smithi101.stdout: "time": "2023-08-01T19:54:04.473347+0000", 2023-08-01T19:54:29.402 INFO:teuthology.orchestra.run.smithi101.stdout: "duration": 0.014124319 2023-08-01T19:54:29.402 INFO:teuthology.orchestra.run.smithi101.stdout: }, 2023-08-01T19:54:29.402 INFO:teuthology.orchestra.run.smithi101.stdout: { 2023-08-01T19:54:29.402 INFO:teuthology.orchestra.run.smithi101.stdout: "event": "started", 2023-08-01T19:54:29.402 INFO:teuthology.orchestra.run.smithi101.stdout: "time": "2023-08-01T19:54:04.473480+0000", 2023-08-01T19:54:29.403 INFO:teuthology.orchestra.run.smithi101.stdout: "duration": 0.00013276799999999999 2023-08-01T19:54:29.403 INFO:teuthology.orchestra.run.smithi101.stdout: }, 2023-08-01T19:54:29.403 INFO:teuthology.orchestra.run.smithi101.stdout: { 2023-08-01T19:54:29.403 INFO:teuthology.orchestra.run.smithi101.stdout: "event": "waiting for subops from 2", 2023-08-01T19:54:29.403 INFO:teuthology.orchestra.run.smithi101.stdout: "time": "2023-08-01T19:54:04.473622+0000", 2023-08-01T19:54:29.403 INFO:teuthology.orchestra.run.smithi101.stdout: "duration": 0.00014154799999999999 2023-08-01T19:54:29.403 INFO:teuthology.orchestra.run.smithi101.stdout: }, 2023-08-01T19:54:29.403 INFO:teuthology.orchestra.run.smithi101.stdout: { 2023-08-01T19:54:29.404 INFO:teuthology.orchestra.run.smithi101.stdout: "event": "op_commit", 2023-08-01T19:54:29.404 INFO:teuthology.orchestra.run.smithi101.stdout: "time": "2023-08-01T19:54:04.478281+0000", 2023-08-01T19:54:29.404 INFO:teuthology.orchestra.run.smithi101.stdout: "duration": 0.004659252 2023-08-01T19:54:29.404 INFO:teuthology.orchestra.run.smithi101.stdout: }, 2023-08-01T19:54:29.404 INFO:teuthology.orchestra.run.smithi101.stdout: { 2023-08-01T19:54:29.404 INFO:teuthology.orchestra.run.smithi101.stdout: "event": "sub_op_commit_rec", 2023-08-01T19:54:29.404 INFO:teuthology.orchestra.run.smithi101.stdout: "time": "2023-08-01T19:54:04.480180+0000", 2023-08-01T19:54:29.405 INFO:teuthology.orchestra.run.smithi101.stdout: "duration": 0.0018986859999999999 2023-08-01T19:54:29.405 INFO:teuthology.orchestra.run.smithi101.stdout: }, 2023-08-01T19:54:29.405 INFO:teuthology.orchestra.run.smithi101.stdout: { 2023-08-01T19:54:29.405 INFO:teuthology.orchestra.run.smithi101.stdout: "event": "commit_sent", 2023-08-01T19:54:29.405 INFO:teuthology.orchestra.run.smithi101.stdout: "time": "2023-08-01T19:54:04.480209+0000", 2023-08-01T19:54:29.405 INFO:teuthology.orchestra.run.smithi101.stdout: "duration": 2.9244999999999999e-05 2023-08-01T19:54:29.405 INFO:teuthology.orchestra.run.smithi101.stdout: }, 2023-08-01T19:54:29.405 INFO:teuthology.orchestra.run.smithi101.stdout: { 2023-08-01T19:54:29.406 INFO:teuthology.orchestra.run.smithi101.stdout: "event": "done", 2023-08-01T19:54:29.406 INFO:teuthology.orchestra.run.smithi101.stdout: "time": "2023-08-01T19:54:04.480244+0000", 2023-08-01T19:54:29.406 INFO:teuthology.orchestra.run.smithi101.stdout: "duration": 3.4875000000000001e-05 2023-08-01T19:54:29.406 INFO:teuthology.orchestra.run.smithi101.stdout: } 2023-08-01T19:54:29.406 INFO:teuthology.orchestra.run.smithi101.stdout: ] 2023-08-01T19:54:29.406 INFO:teuthology.orchestra.run.smithi101.stdout: } 2023-08-01T19:54:29.406 INFO:teuthology.orchestra.run.smithi101.stdout: }, 2023-08-01T19:54:29.406 INFO:teuthology.orchestra.run.smithi101.stdout: { 2023-08-01T19:54:29.407 INFO:teuthology.orchestra.run.smithi101.stdout: "description": "osd_op(mds.0.3:2 3.f 3:f1f69726:::400.00000000:head [writefull 0~22] snapc 0=[] ondisk+write+known_if_redirected+full_force+supports_pool_eio e17)", 2023-08-01T19:54:29.407 INFO:teuthology.orchestra.run.smithi101.stdout: "initiated_at": "2023-08-01T19:54:04.459201+0000", 2023-08-01T19:54:29.407 INFO:teuthology.orchestra.run.smithi101.stdout: "age": 24.785946654, 2023-08-01T19:54:29.407 INFO:teuthology.orchestra.run.smithi101.stdout: "duration": 0.016952979, 2023-08-01T19:54:29.407 INFO:teuthology.orchestra.run.smithi101.stdout: "type_data": { 2023-08-01T19:54:29.407 INFO:teuthology.orchestra.run.smithi101.stdout: "flag_point": "commit sent; apply or cleanup", 2023-08-01T19:54:29.407 INFO:teuthology.orchestra.run.smithi101.stdout: "events": [ 2023-08-01T19:54:29.407 INFO:teuthology.orchestra.run.smithi101.stdout: { 2023-08-01T19:54:29.408 INFO:teuthology.orchestra.run.smithi101.stdout: "event": "initiated", 2023-08-01T19:54:29.408 INFO:teuthology.orchestra.run.smithi101.stdout: "time": "2023-08-01T19:54:04.459201+0000", 2023-08-01T19:54:29.408 INFO:teuthology.orchestra.run.smithi101.stdout: "duration": 0 2023-08-01T19:54:29.408 INFO:teuthology.orchestra.run.smithi101.stdout: }, 2023-08-01T19:54:29.408 INFO:teuthology.orchestra.run.smithi101.stdout: { 2023-08-01T19:54:29.408 INFO:teuthology.orchestra.run.smithi101.stdout: "event": "throttled", 2023-08-01T19:54:29.408 INFO:teuthology.orchestra.run.smithi101.stdout: "time": "2023-08-01T19:54:04.459201+0000", 2023-08-01T19:54:29.408 INFO:teuthology.orchestra.run.smithi101.stdout: "duration": 0 2023-08-01T19:54:29.409 INFO:teuthology.orchestra.run.smithi101.stdout: }, 2023-08-01T19:54:29.409 INFO:teuthology.orchestra.run.smithi101.stdout: { 2023-08-01T19:54:29.409 INFO:teuthology.orchestra.run.smithi101.stdout: "event": "header_read", 2023-08-01T19:54:29.409 INFO:teuthology.orchestra.run.smithi101.stdout: "time": "2023-08-01T19:54:04.459201+0000", 2023-08-01T19:54:29.409 INFO:teuthology.orchestra.run.smithi101.stdout: "duration": 4294967295.9999995 2023-08-01T19:54:29.409 INFO:teuthology.orchestra.run.smithi101.stdout: }, 2023-08-01T19:54:29.409 INFO:teuthology.orchestra.run.smithi101.stdout: { 2023-08-01T19:54:29.409 INFO:teuthology.orchestra.run.smithi101.stdout: "event": "all_read", 2023-08-01T19:54:29.410 INFO:teuthology.orchestra.run.smithi101.stdout: "time": "2023-08-01T19:54:04.459204+0000", 2023-08-01T19:54:29.410 INFO:teuthology.orchestra.run.smithi101.stdout: "duration": 3.5599999999999998e-06 2023-08-01T19:54:29.410 INFO:teuthology.orchestra.run.smithi101.stdout: }, 2023-08-01T19:54:29.410 INFO:teuthology.orchestra.run.smithi101.stdout: { 2023-08-01T19:54:29.410 INFO:teuthology.orchestra.run.smithi101.stdout: "event": "dispatched", 2023-08-01T19:54:29.410 INFO:teuthology.orchestra.run.smithi101.stdout: "time": "2023-08-01T19:54:04.459211+0000", 2023-08-01T19:54:29.410 INFO:teuthology.orchestra.run.smithi101.stdout: "duration": 6.9299999999999997e-06 2023-08-01T19:54:29.411 INFO:teuthology.orchestra.run.smithi101.stdout: }, 2023-08-01T19:54:29.411 INFO:teuthology.orchestra.run.smithi101.stdout: { 2023-08-01T19:54:29.411 INFO:teuthology.orchestra.run.smithi101.stdout: "event": "queued_for_pg", 2023-08-01T19:54:29.411 INFO:teuthology.orchestra.run.smithi101.stdout: "time": "2023-08-01T19:54:04.459216+0000", 2023-08-01T19:54:29.411 INFO:teuthology.orchestra.run.smithi101.stdout: "duration": 4.5050000000000001e-06 2023-08-01T19:54:29.411 INFO:teuthology.orchestra.run.smithi101.stdout: }, 2023-08-01T19:54:29.411 INFO:teuthology.orchestra.run.smithi101.stdout: { 2023-08-01T19:54:29.411 INFO:teuthology.orchestra.run.smithi101.stdout: "event": "reached_pg", 2023-08-01T19:54:29.412 INFO:teuthology.orchestra.run.smithi101.stdout: "time": "2023-08-01T19:54:04.459246+0000", 2023-08-01T19:54:29.412 INFO:teuthology.orchestra.run.smithi101.stdout: "duration": 3.0369999999999999e-05 2023-08-01T19:54:29.412 INFO:teuthology.orchestra.run.smithi101.stdout: }, 2023-08-01T19:54:29.412 INFO:teuthology.orchestra.run.smithi101.stdout: { 2023-08-01T19:54:29.412 INFO:teuthology.orchestra.run.smithi101.stdout: "event": "op must wait for map", 2023-08-01T19:54:29.412 INFO:teuthology.orchestra.run.smithi101.stdout: "time": "2023-08-01T19:54:04.459250+0000", 2023-08-01T19:54:29.412 INFO:teuthology.orchestra.run.smithi101.stdout: "duration": 3.6880000000000001e-06 2023-08-01T19:54:29.413 INFO:teuthology.orchestra.run.smithi101.stdout: }, 2023-08-01T19:54:29.413 INFO:teuthology.orchestra.run.smithi101.stdout: { 2023-08-01T19:54:29.413 INFO:teuthology.orchestra.run.smithi101.stdout: "event": "reached_pg", 2023-08-01T19:54:29.413 INFO:teuthology.orchestra.run.smithi101.stdout: "time": "2023-08-01T19:54:04.469499+0000", 2023-08-01T19:54:29.413 INFO:teuthology.orchestra.run.smithi101.stdout: "duration": 0.010249052 2023-08-01T19:54:29.413 INFO:teuthology.orchestra.run.smithi101.stdout: }, 2023-08-01T19:54:29.413 INFO:teuthology.orchestra.run.smithi101.stdout: { 2023-08-01T19:54:29.413 INFO:teuthology.orchestra.run.smithi101.stdout: "event": "started", 2023-08-01T19:54:29.414 INFO:teuthology.orchestra.run.smithi101.stdout: "time": "2023-08-01T19:54:04.469619+0000", 2023-08-01T19:54:29.414 INFO:teuthology.orchestra.run.smithi101.stdout: "duration": 0.000120061 2023-08-01T19:54:29.414 INFO:teuthology.orchestra.run.smithi101.stdout: }, 2023-08-01T19:54:29.414 INFO:teuthology.orchestra.run.smithi101.stdout: { 2023-08-01T19:54:29.414 INFO:teuthology.orchestra.run.smithi101.stdout: "event": "waiting for subops from 2", 2023-08-01T19:54:29.414 INFO:teuthology.orchestra.run.smithi101.stdout: "time": "2023-08-01T19:54:04.469903+0000", 2023-08-01T19:54:29.414 INFO:teuthology.orchestra.run.smithi101.stdout: "duration": 0.00028409799999999999 2023-08-01T19:54:29.414 INFO:teuthology.orchestra.run.smithi101.stdout: }, 2023-08-01T19:54:29.415 INFO:teuthology.orchestra.run.smithi101.stdout: { 2023-08-01T19:54:29.415 INFO:teuthology.orchestra.run.smithi101.stdout: "event": "sub_op_commit_rec", 2023-08-01T19:54:29.415 INFO:teuthology.orchestra.run.smithi101.stdout: "time": "2023-08-01T19:54:04.475166+0000", 2023-08-01T19:54:29.415 INFO:teuthology.orchestra.run.smithi101.stdout: "duration": 0.0052632460000000001 2023-08-01T19:54:29.415 INFO:teuthology.orchestra.run.smithi101.stdout: }, 2023-08-01T19:54:29.415 INFO:teuthology.orchestra.run.smithi101.stdout: { 2023-08-01T19:54:29.415 INFO:teuthology.orchestra.run.smithi101.stdout: "event": "op_commit", 2023-08-01T19:54:29.415 INFO:teuthology.orchestra.run.smithi101.stdout: "time": "2023-08-01T19:54:04.476056+0000", 2023-08-01T19:54:29.416 INFO:teuthology.orchestra.run.smithi101.stdout: "duration": 0.00089017499999999999 2023-08-01T19:54:29.416 INFO:teuthology.orchestra.run.smithi101.stdout: }, 2023-08-01T19:54:29.416 INFO:teuthology.orchestra.run.smithi101.stdout: { 2023-08-01T19:54:29.416 INFO:teuthology.orchestra.run.smithi101.stdout: "event": "commit_sent", 2023-08-01T19:54:29.416 INFO:teuthology.orchestra.run.smithi101.stdout: "time": "2023-08-01T19:54:04.476115+0000", 2023-08-01T19:54:29.416 INFO:teuthology.orchestra.run.smithi101.stdout: "duration": 5.8464999999999997e-05 2023-08-01T19:54:29.416 INFO:teuthology.orchestra.run.smithi101.stdout: }, 2023-08-01T19:54:29.417 INFO:teuthology.orchestra.run.smithi101.stdout: { 2023-08-01T19:54:29.417 INFO:teuthology.orchestra.run.smithi101.stdout: "event": "done", 2023-08-01T19:54:29.417 INFO:teuthology.orchestra.run.smithi101.stdout: "time": "2023-08-01T19:54:04.476154+0000", 2023-08-01T19:54:29.417 INFO:teuthology.orchestra.run.smithi101.stdout: "duration": 3.9229e-05 2023-08-01T19:54:29.417 INFO:teuthology.orchestra.run.smithi101.stdout: } 2023-08-01T19:54:29.417 INFO:teuthology.orchestra.run.smithi101.stdout: ] 2023-08-01T19:54:29.417 INFO:teuthology.orchestra.run.smithi101.stdout: } 2023-08-01T19:54:29.417 INFO:teuthology.orchestra.run.smithi101.stdout: }, 2023-08-01T19:54:29.418 INFO:teuthology.orchestra.run.smithi101.stdout: { 2023-08-01T19:54:29.418 INFO:teuthology.orchestra.run.smithi101.stdout: "description": "osd_op(mds.0.3:3 3.14 3:287034c4:::1.00000000.inode:head [writefull 0~554] snapc 0=[] ondisk+write+known_if_redirected+full_force+supports_pool_eio e17)", 2023-08-01T19:54:29.418 INFO:teuthology.orchestra.run.smithi101.stdout: "initiated_at": "2023-08-01T19:54:04.459226+0000", 2023-08-01T19:54:29.418 INFO:teuthology.orchestra.run.smithi101.stdout: "age": 24.785921831, 2023-08-01T19:54:29.418 INFO:teuthology.orchestra.run.smithi101.stdout: "duration": 0.021104531999999999, 2023-08-01T19:54:29.418 INFO:teuthology.orchestra.run.smithi101.stdout: "type_data": { 2023-08-01T19:54:29.418 INFO:teuthology.orchestra.run.smithi101.stdout: "flag_point": "commit sent; apply or cleanup", 2023-08-01T19:54:29.418 INFO:teuthology.orchestra.run.smithi101.stdout: "events": [ 2023-08-01T19:54:29.419 INFO:teuthology.orchestra.run.smithi101.stdout: { 2023-08-01T19:54:29.419 INFO:teuthology.orchestra.run.smithi101.stdout: "event": "initiated", 2023-08-01T19:54:29.419 INFO:teuthology.orchestra.run.smithi101.stdout: "time": "2023-08-01T19:54:04.459226+0000", 2023-08-01T19:54:29.419 INFO:teuthology.orchestra.run.smithi101.stdout: "duration": 0 2023-08-01T19:54:29.419 INFO:teuthology.orchestra.run.smithi101.stdout: }, 2023-08-01T19:54:29.419 INFO:teuthology.orchestra.run.smithi101.stdout: { 2023-08-01T19:54:29.419 INFO:teuthology.orchestra.run.smithi101.stdout: "event": "throttled", 2023-08-01T19:54:29.419 INFO:teuthology.orchestra.run.smithi101.stdout: "time": "2023-08-01T19:54:04.459226+0000", 2023-08-01T19:54:29.420 INFO:teuthology.orchestra.run.smithi101.stdout: "duration": 0 2023-08-01T19:54:29.420 INFO:teuthology.orchestra.run.smithi101.stdout: }, 2023-08-01T19:54:29.420 INFO:teuthology.orchestra.run.smithi101.stdout: { 2023-08-01T19:54:29.420 INFO:teuthology.orchestra.run.smithi101.stdout: "event": "header_read", 2023-08-01T19:54:29.420 INFO:teuthology.orchestra.run.smithi101.stdout: "time": "2023-08-01T19:54:04.459225+0000", 2023-08-01T19:54:29.420 INFO:teuthology.orchestra.run.smithi101.stdout: "duration": 4294967295.9999995 2023-08-01T19:54:29.420 INFO:teuthology.orchestra.run.smithi101.stdout: }, 2023-08-01T19:54:29.420 INFO:teuthology.orchestra.run.smithi101.stdout: { 2023-08-01T19:54:29.421 INFO:teuthology.orchestra.run.smithi101.stdout: "event": "all_read", 2023-08-01T19:54:29.421 INFO:teuthology.orchestra.run.smithi101.stdout: "time": "2023-08-01T19:54:04.459238+0000", 2023-08-01T19:54:29.421 INFO:teuthology.orchestra.run.smithi101.stdout: "duration": 1.2809000000000001e-05 2023-08-01T19:54:29.421 INFO:teuthology.orchestra.run.smithi101.stdout: }, 2023-08-01T19:54:29.421 INFO:teuthology.orchestra.run.smithi101.stdout: { 2023-08-01T19:54:29.421 INFO:teuthology.orchestra.run.smithi101.stdout: "event": "dispatched", 2023-08-01T19:54:29.421 INFO:teuthology.orchestra.run.smithi101.stdout: "time": "2023-08-01T19:54:04.459245+0000", 2023-08-01T19:54:29.422 INFO:teuthology.orchestra.run.smithi101.stdout: "duration": 6.6540000000000002e-06 2023-08-01T19:54:29.422 INFO:teuthology.orchestra.run.smithi101.stdout: }, 2023-08-01T19:54:29.422 INFO:teuthology.orchestra.run.smithi101.stdout: { 2023-08-01T19:54:29.422 INFO:teuthology.orchestra.run.smithi101.stdout: "event": "queued_for_pg", 2023-08-01T19:54:29.422 INFO:teuthology.orchestra.run.smithi101.stdout: "time": "2023-08-01T19:54:04.459249+0000", 2023-08-01T19:54:29.422 INFO:teuthology.orchestra.run.smithi101.stdout: "duration": 4.6e-06 2023-08-01T19:54:29.422 INFO:teuthology.orchestra.run.smithi101.stdout: }, 2023-08-01T19:54:29.422 INFO:teuthology.orchestra.run.smithi101.stdout: { 2023-08-01T19:54:29.423 INFO:teuthology.orchestra.run.smithi101.stdout: "event": "reached_pg", 2023-08-01T19:54:29.423 INFO:teuthology.orchestra.run.smithi101.stdout: "time": "2023-08-01T19:54:04.459276+0000", 2023-08-01T19:54:29.423 INFO:teuthology.orchestra.run.smithi101.stdout: "duration": 2.6373999999999999e-05 2023-08-01T19:54:29.423 INFO:teuthology.orchestra.run.smithi101.stdout: }, 2023-08-01T19:54:29.423 INFO:teuthology.orchestra.run.smithi101.stdout: { 2023-08-01T19:54:29.423 INFO:teuthology.orchestra.run.smithi101.stdout: "event": "waiting_for_map not empty", 2023-08-01T19:54:29.423 INFO:teuthology.orchestra.run.smithi101.stdout: "time": "2023-08-01T19:54:04.459278+0000", 2023-08-01T19:54:29.423 INFO:teuthology.orchestra.run.smithi101.stdout: "duration": 2.4980000000000001e-06 2023-08-01T19:54:29.424 INFO:teuthology.orchestra.run.smithi101.stdout: }, 2023-08-01T19:54:29.424 INFO:teuthology.orchestra.run.smithi101.stdout: { 2023-08-01T19:54:29.424 INFO:teuthology.orchestra.run.smithi101.stdout: "event": "reached_pg", 2023-08-01T19:54:29.424 INFO:teuthology.orchestra.run.smithi101.stdout: "time": "2023-08-01T19:54:04.474058+0000", 2023-08-01T19:54:29.424 INFO:teuthology.orchestra.run.smithi101.stdout: "duration": 0.014779979 2023-08-01T19:54:29.424 INFO:teuthology.orchestra.run.smithi101.stdout: }, 2023-08-01T19:54:29.424 INFO:teuthology.orchestra.run.smithi101.stdout: { 2023-08-01T19:54:29.424 INFO:teuthology.orchestra.run.smithi101.stdout: "event": "started", 2023-08-01T19:54:29.425 INFO:teuthology.orchestra.run.smithi101.stdout: "time": "2023-08-01T19:54:04.474614+0000", 2023-08-01T19:54:29.425 INFO:teuthology.orchestra.run.smithi101.stdout: "duration": 0.00055546899999999995 2023-08-01T19:54:29.425 INFO:teuthology.orchestra.run.smithi101.stdout: }, 2023-08-01T19:54:29.425 INFO:teuthology.orchestra.run.smithi101.stdout: { 2023-08-01T19:54:29.425 INFO:teuthology.orchestra.run.smithi101.stdout: "event": "waiting for subops from 2", 2023-08-01T19:54:29.425 INFO:teuthology.orchestra.run.smithi101.stdout: "time": "2023-08-01T19:54:04.474720+0000", 2023-08-01T19:54:29.425 INFO:teuthology.orchestra.run.smithi101.stdout: "duration": 0.00010645300000000001 2023-08-01T19:54:29.425 INFO:teuthology.orchestra.run.smithi101.stdout: }, 2023-08-01T19:54:29.426 INFO:teuthology.orchestra.run.smithi101.stdout: { 2023-08-01T19:54:29.426 INFO:teuthology.orchestra.run.smithi101.stdout: "event": "op_commit", 2023-08-01T19:54:29.426 INFO:teuthology.orchestra.run.smithi101.stdout: "time": "2023-08-01T19:54:04.478480+0000", 2023-08-01T19:54:29.426 INFO:teuthology.orchestra.run.smithi101.stdout: "duration": 0.0037600279999999999 2023-08-01T19:54:29.426 INFO:teuthology.orchestra.run.smithi101.stdout: }, 2023-08-01T19:54:29.426 INFO:teuthology.orchestra.run.smithi101.stdout: { 2023-08-01T19:54:29.426 INFO:teuthology.orchestra.run.smithi101.stdout: "event": "sub_op_commit_rec", 2023-08-01T19:54:29.426 INFO:teuthology.orchestra.run.smithi101.stdout: "time": "2023-08-01T19:54:04.480273+0000", 2023-08-01T19:54:29.427 INFO:teuthology.orchestra.run.smithi101.stdout: "duration": 0.001792465 2023-08-01T19:54:29.427 INFO:teuthology.orchestra.run.smithi101.stdout: }, 2023-08-01T19:54:29.427 INFO:teuthology.orchestra.run.smithi101.stdout: { 2023-08-01T19:54:29.427 INFO:teuthology.orchestra.run.smithi101.stdout: "event": "commit_sent", 2023-08-01T19:54:29.427 INFO:teuthology.orchestra.run.smithi101.stdout: "time": "2023-08-01T19:54:04.480304+0000", 2023-08-01T19:54:29.427 INFO:teuthology.orchestra.run.smithi101.stdout: "duration": 3.1708999999999997e-05 2023-08-01T19:54:29.427 INFO:teuthology.orchestra.run.smithi101.stdout: }, 2023-08-01T19:54:29.427 INFO:teuthology.orchestra.run.smithi101.stdout: { 2023-08-01T19:54:29.428 INFO:teuthology.orchestra.run.smithi101.stdout: "event": "done", 2023-08-01T19:54:29.428 INFO:teuthology.orchestra.run.smithi101.stdout: "time": "2023-08-01T19:54:04.480330+0000", 2023-08-01T19:54:29.428 INFO:teuthology.orchestra.run.smithi101.stdout: "duration": 2.5860999999999999e-05 2023-08-01T19:54:29.428 INFO:teuthology.orchestra.run.smithi101.stdout: } 2023-08-01T19:54:29.428 INFO:teuthology.orchestra.run.smithi101.stdout: ] 2023-08-01T19:54:29.428 INFO:teuthology.orchestra.run.smithi101.stdout: } 2023-08-01T19:54:29.428 INFO:teuthology.orchestra.run.smithi101.stdout: }, 2023-08-01T19:54:29.429 INFO:teuthology.orchestra.run.smithi101.stdout: { 2023-08-01T19:54:29.429 INFO:teuthology.orchestra.run.smithi101.stdout: "description": "osd_op(mds.0.3:27 3.13 3:c91d4a1d:::mds0_inotable:head [writefull 0~34] snapc 0=[] ondisk+write+known_if_redirected+full_force+supports_pool_eio e17)", 2023-08-01T19:54:29.429 INFO:teuthology.orchestra.run.smithi101.stdout: "initiated_at": "2023-08-01T19:54:04.459260+0000", 2023-08-01T19:54:29.429 INFO:teuthology.orchestra.run.smithi101.stdout: "age": 24.785887939999999, 2023-08-01T19:54:29.429 INFO:teuthology.orchestra.run.smithi101.stdout: "duration": 0.016792715999999999, 2023-08-01T19:54:29.429 INFO:teuthology.orchestra.run.smithi101.stdout: "type_data": { 2023-08-01T19:54:29.429 INFO:teuthology.orchestra.run.smithi101.stdout: "flag_point": "commit sent; apply or cleanup", 2023-08-01T19:54:29.429 INFO:teuthology.orchestra.run.smithi101.stdout: "events": [ 2023-08-01T19:54:29.430 INFO:teuthology.orchestra.run.smithi101.stdout: { 2023-08-01T19:54:29.430 INFO:teuthology.orchestra.run.smithi101.stdout: "event": "initiated", 2023-08-01T19:54:29.430 INFO:teuthology.orchestra.run.smithi101.stdout: "time": "2023-08-01T19:54:04.459260+0000", 2023-08-01T19:54:29.430 INFO:teuthology.orchestra.run.smithi101.stdout: "duration": 0 2023-08-01T19:54:29.430 INFO:teuthology.orchestra.run.smithi101.stdout: }, 2023-08-01T19:54:29.430 INFO:teuthology.orchestra.run.smithi101.stdout: { 2023-08-01T19:54:29.430 INFO:teuthology.orchestra.run.smithi101.stdout: "event": "throttled", 2023-08-01T19:54:29.430 INFO:teuthology.orchestra.run.smithi101.stdout: "time": "2023-08-01T19:54:04.459260+0000", 2023-08-01T19:54:29.431 INFO:teuthology.orchestra.run.smithi101.stdout: "duration": 0 2023-08-01T19:54:29.431 INFO:teuthology.orchestra.run.smithi101.stdout: }, 2023-08-01T19:54:29.431 INFO:teuthology.orchestra.run.smithi101.stdout: { 2023-08-01T19:54:29.431 INFO:teuthology.orchestra.run.smithi101.stdout: "event": "header_read", 2023-08-01T19:54:29.431 INFO:teuthology.orchestra.run.smithi101.stdout: "time": "2023-08-01T19:54:04.459259+0000", 2023-08-01T19:54:29.431 INFO:teuthology.orchestra.run.smithi101.stdout: "duration": 4294967295.9999995 2023-08-01T19:54:29.431 INFO:teuthology.orchestra.run.smithi101.stdout: }, 2023-08-01T19:54:29.431 INFO:teuthology.orchestra.run.smithi101.stdout: { 2023-08-01T19:54:29.432 INFO:teuthology.orchestra.run.smithi101.stdout: "event": "all_read", 2023-08-01T19:54:29.432 INFO:teuthology.orchestra.run.smithi101.stdout: "time": "2023-08-01T19:54:04.459263+0000", 2023-08-01T19:54:29.432 INFO:teuthology.orchestra.run.smithi101.stdout: "duration": 3.9249999999999997e-06 2023-08-01T19:54:29.432 INFO:teuthology.orchestra.run.smithi101.stdout: }, 2023-08-01T19:54:29.432 INFO:teuthology.orchestra.run.smithi101.stdout: { 2023-08-01T19:54:29.432 INFO:teuthology.orchestra.run.smithi101.stdout: "event": "dispatched", 2023-08-01T19:54:29.432 INFO:teuthology.orchestra.run.smithi101.stdout: "time": "2023-08-01T19:54:04.459270+0000", 2023-08-01T19:54:29.432 INFO:teuthology.orchestra.run.smithi101.stdout: "duration": 7.0180000000000004e-06 2023-08-01T19:54:29.433 INFO:teuthology.orchestra.run.smithi101.stdout: }, 2023-08-01T19:54:29.433 INFO:teuthology.orchestra.run.smithi101.stdout: { 2023-08-01T19:54:29.433 INFO:teuthology.orchestra.run.smithi101.stdout: "event": "queued_for_pg", 2023-08-01T19:54:29.433 INFO:teuthology.orchestra.run.smithi101.stdout: "time": "2023-08-01T19:54:04.459275+0000", 2023-08-01T19:54:29.433 INFO:teuthology.orchestra.run.smithi101.stdout: "duration": 4.763e-06 2023-08-01T19:54:29.433 INFO:teuthology.orchestra.run.smithi101.stdout: }, 2023-08-01T19:54:29.433 INFO:teuthology.orchestra.run.smithi101.stdout: { 2023-08-01T19:54:29.433 INFO:teuthology.orchestra.run.smithi101.stdout: "event": "reached_pg", 2023-08-01T19:54:29.434 INFO:teuthology.orchestra.run.smithi101.stdout: "time": "2023-08-01T19:54:04.459298+0000", 2023-08-01T19:54:29.434 INFO:teuthology.orchestra.run.smithi101.stdout: "duration": 2.3193e-05 2023-08-01T19:54:29.434 INFO:teuthology.orchestra.run.smithi101.stdout: }, 2023-08-01T19:54:29.434 INFO:teuthology.orchestra.run.smithi101.stdout: { 2023-08-01T19:54:29.434 INFO:teuthology.orchestra.run.smithi101.stdout: "event": "waiting_for_map not empty", 2023-08-01T19:54:29.434 INFO:teuthology.orchestra.run.smithi101.stdout: "time": "2023-08-01T19:54:04.459301+0000", 2023-08-01T19:54:29.434 INFO:teuthology.orchestra.run.smithi101.stdout: "duration": 3.0539999999999999e-06 2023-08-01T19:54:29.435 INFO:teuthology.orchestra.run.smithi101.stdout: }, 2023-08-01T19:54:29.435 INFO:teuthology.orchestra.run.smithi101.stdout: { 2023-08-01T19:54:29.435 INFO:teuthology.orchestra.run.smithi101.stdout: "event": "reached_pg", 2023-08-01T19:54:29.435 INFO:teuthology.orchestra.run.smithi101.stdout: "time": "2023-08-01T19:54:04.469447+0000", 2023-08-01T19:54:29.435 INFO:teuthology.orchestra.run.smithi101.stdout: "duration": 0.010145573999999999 2023-08-01T19:54:29.435 INFO:teuthology.orchestra.run.smithi101.stdout: }, 2023-08-01T19:54:29.435 INFO:teuthology.orchestra.run.smithi101.stdout: { 2023-08-01T19:54:29.435 INFO:teuthology.orchestra.run.smithi101.stdout: "event": "started", 2023-08-01T19:54:29.436 INFO:teuthology.orchestra.run.smithi101.stdout: "time": "2023-08-01T19:54:04.469559+0000", 2023-08-01T19:54:29.436 INFO:teuthology.orchestra.run.smithi101.stdout: "duration": 0.000112068 2023-08-01T19:54:29.436 INFO:teuthology.orchestra.run.smithi101.stdout: }, 2023-08-01T19:54:29.436 INFO:teuthology.orchestra.run.smithi101.stdout: { 2023-08-01T19:54:29.436 INFO:teuthology.orchestra.run.smithi101.stdout: "event": "waiting for subops from 0", 2023-08-01T19:54:29.436 INFO:teuthology.orchestra.run.smithi101.stdout: "time": "2023-08-01T19:54:04.469895+0000", 2023-08-01T19:54:29.436 INFO:teuthology.orchestra.run.smithi101.stdout: "duration": 0.000336604 2023-08-01T19:54:29.437 INFO:teuthology.orchestra.run.smithi101.stdout: }, 2023-08-01T19:54:29.437 INFO:teuthology.orchestra.run.smithi101.stdout: { 2023-08-01T19:54:29.437 INFO:teuthology.orchestra.run.smithi101.stdout: "event": "sub_op_commit_rec", 2023-08-01T19:54:29.437 INFO:teuthology.orchestra.run.smithi101.stdout: "time": "2023-08-01T19:54:04.475096+0000", 2023-08-01T19:54:29.437 INFO:teuthology.orchestra.run.smithi101.stdout: "duration": 0.0052010540000000001 2023-08-01T19:54:29.437 INFO:teuthology.orchestra.run.smithi101.stdout: }, 2023-08-01T19:54:29.437 INFO:teuthology.orchestra.run.smithi101.stdout: { 2023-08-01T19:54:29.437 INFO:teuthology.orchestra.run.smithi101.stdout: "event": "op_commit", 2023-08-01T19:54:29.438 INFO:teuthology.orchestra.run.smithi101.stdout: "time": "2023-08-01T19:54:04.475965+0000", 2023-08-01T19:54:29.438 INFO:teuthology.orchestra.run.smithi101.stdout: "duration": 0.00086860500000000005 2023-08-01T19:54:29.438 INFO:teuthology.orchestra.run.smithi101.stdout: }, 2023-08-01T19:54:29.438 INFO:teuthology.orchestra.run.smithi101.stdout: { 2023-08-01T19:54:29.438 INFO:teuthology.orchestra.run.smithi101.stdout: "event": "commit_sent", 2023-08-01T19:54:29.438 INFO:teuthology.orchestra.run.smithi101.stdout: "time": "2023-08-01T19:54:04.476007+0000", 2023-08-01T19:54:29.438 INFO:teuthology.orchestra.run.smithi101.stdout: "duration": 4.2228000000000003e-05 2023-08-01T19:54:29.438 INFO:teuthology.orchestra.run.smithi101.stdout: }, 2023-08-01T19:54:29.439 INFO:teuthology.orchestra.run.smithi101.stdout: { 2023-08-01T19:54:29.439 INFO:teuthology.orchestra.run.smithi101.stdout: "event": "done", 2023-08-01T19:54:29.439 INFO:teuthology.orchestra.run.smithi101.stdout: "time": "2023-08-01T19:54:04.476052+0000", 2023-08-01T19:54:29.439 INFO:teuthology.orchestra.run.smithi101.stdout: "duration": 4.5188000000000002e-05 2023-08-01T19:54:29.439 INFO:teuthology.orchestra.run.smithi101.stdout: } 2023-08-01T19:54:29.439 INFO:teuthology.orchestra.run.smithi101.stdout: ] 2023-08-01T19:54:29.439 INFO:teuthology.orchestra.run.smithi101.stdout: } 2023-08-01T19:54:29.439 INFO:teuthology.orchestra.run.smithi101.stdout: }, 2023-08-01T19:54:29.440 INFO:teuthology.orchestra.run.smithi101.stdout: { 2023-08-01T19:54:29.440 INFO:teuthology.orchestra.run.smithi101.stdout: "description": "osd_op(mds.0.3:31 3.d 3:b50e409b:::mds_snaptable:head [writefull 0~70] snapc 0=[] ondisk+write+known_if_redirected+full_force+supports_pool_eio e17)", 2023-08-01T19:54:29.440 INFO:teuthology.orchestra.run.smithi101.stdout: "initiated_at": "2023-08-01T19:54:04.459283+0000", 2023-08-01T19:54:29.440 INFO:teuthology.orchestra.run.smithi101.stdout: "age": 24.785865003000001, 2023-08-01T19:54:29.440 INFO:teuthology.orchestra.run.smithi101.stdout: "duration": 0.01676277, 2023-08-01T19:54:29.440 INFO:teuthology.orchestra.run.smithi101.stdout: "type_data": { 2023-08-01T19:54:29.440 INFO:teuthology.orchestra.run.smithi101.stdout: "flag_point": "commit sent; apply or cleanup", 2023-08-01T19:54:29.440 INFO:teuthology.orchestra.run.smithi101.stdout: "events": [ 2023-08-01T19:54:29.441 INFO:teuthology.orchestra.run.smithi101.stdout: { 2023-08-01T19:54:29.441 INFO:teuthology.orchestra.run.smithi101.stdout: "event": "initiated", 2023-08-01T19:54:29.441 INFO:teuthology.orchestra.run.smithi101.stdout: "time": "2023-08-01T19:54:04.459283+0000", 2023-08-01T19:54:29.441 INFO:teuthology.orchestra.run.smithi101.stdout: "duration": 0 2023-08-01T19:54:29.441 INFO:teuthology.orchestra.run.smithi101.stdout: }, 2023-08-01T19:54:29.441 INFO:teuthology.orchestra.run.smithi101.stdout: { 2023-08-01T19:54:29.441 INFO:teuthology.orchestra.run.smithi101.stdout: "event": "throttled", 2023-08-01T19:54:29.442 INFO:teuthology.orchestra.run.smithi101.stdout: "time": "2023-08-01T19:54:04.459283+0000", 2023-08-01T19:54:29.442 INFO:teuthology.orchestra.run.smithi101.stdout: "duration": 0 2023-08-01T19:54:29.442 INFO:teuthology.orchestra.run.smithi101.stdout: }, 2023-08-01T19:54:29.442 INFO:teuthology.orchestra.run.smithi101.stdout: { 2023-08-01T19:54:29.442 INFO:teuthology.orchestra.run.smithi101.stdout: "event": "header_read", 2023-08-01T19:54:29.442 INFO:teuthology.orchestra.run.smithi101.stdout: "time": "2023-08-01T19:54:04.459282+0000", 2023-08-01T19:54:29.442 INFO:teuthology.orchestra.run.smithi101.stdout: "duration": 4294967295.9999995 2023-08-01T19:54:29.442 INFO:teuthology.orchestra.run.smithi101.stdout: }, 2023-08-01T19:54:29.443 INFO:teuthology.orchestra.run.smithi101.stdout: { 2023-08-01T19:54:29.443 INFO:teuthology.orchestra.run.smithi101.stdout: "event": "all_read", 2023-08-01T19:54:29.443 INFO:teuthology.orchestra.run.smithi101.stdout: "time": "2023-08-01T19:54:04.459285+0000", 2023-08-01T19:54:29.443 INFO:teuthology.orchestra.run.smithi101.stdout: "duration": 3.2590000000000001e-06 2023-08-01T19:54:29.443 INFO:teuthology.orchestra.run.smithi101.stdout: }, 2023-08-01T19:54:29.443 INFO:teuthology.orchestra.run.smithi101.stdout: { 2023-08-01T19:54:29.443 INFO:teuthology.orchestra.run.smithi101.stdout: "event": "dispatched", 2023-08-01T19:54:29.443 INFO:teuthology.orchestra.run.smithi101.stdout: "time": "2023-08-01T19:54:04.459291+0000", 2023-08-01T19:54:29.444 INFO:teuthology.orchestra.run.smithi101.stdout: "duration": 6.0750000000000003e-06 2023-08-01T19:54:29.444 INFO:teuthology.orchestra.run.smithi101.stdout: }, 2023-08-01T19:54:29.444 INFO:teuthology.orchestra.run.smithi101.stdout: { 2023-08-01T19:54:29.444 INFO:teuthology.orchestra.run.smithi101.stdout: "event": "queued_for_pg", 2023-08-01T19:54:29.444 INFO:teuthology.orchestra.run.smithi101.stdout: "time": "2023-08-01T19:54:04.459295+0000", 2023-08-01T19:54:29.444 INFO:teuthology.orchestra.run.smithi101.stdout: "duration": 3.7500000000000001e-06 2023-08-01T19:54:29.444 INFO:teuthology.orchestra.run.smithi101.stdout: }, 2023-08-01T19:54:29.444 INFO:teuthology.orchestra.run.smithi101.stdout: { 2023-08-01T19:54:29.445 INFO:teuthology.orchestra.run.smithi101.stdout: "event": "reached_pg", 2023-08-01T19:54:29.445 INFO:teuthology.orchestra.run.smithi101.stdout: "time": "2023-08-01T19:54:04.459323+0000", 2023-08-01T19:54:29.445 INFO:teuthology.orchestra.run.smithi101.stdout: "duration": 2.7351e-05 2023-08-01T19:54:29.445 INFO:teuthology.orchestra.run.smithi101.stdout: }, 2023-08-01T19:54:29.445 INFO:teuthology.orchestra.run.smithi101.stdout: { 2023-08-01T19:54:29.445 INFO:teuthology.orchestra.run.smithi101.stdout: "event": "op must wait for map", 2023-08-01T19:54:29.445 INFO:teuthology.orchestra.run.smithi101.stdout: "time": "2023-08-01T19:54:04.459327+0000", 2023-08-01T19:54:29.445 INFO:teuthology.orchestra.run.smithi101.stdout: "duration": 4.1849999999999997e-06 2023-08-01T19:54:29.446 INFO:teuthology.orchestra.run.smithi101.stdout: }, 2023-08-01T19:54:29.446 INFO:teuthology.orchestra.run.smithi101.stdout: { 2023-08-01T19:54:29.446 INFO:teuthology.orchestra.run.smithi101.stdout: "event": "reached_pg", 2023-08-01T19:54:29.446 INFO:teuthology.orchestra.run.smithi101.stdout: "time": "2023-08-01T19:54:04.468708+0000", 2023-08-01T19:54:29.446 INFO:teuthology.orchestra.run.smithi101.stdout: "duration": 0.0093817420000000002 2023-08-01T19:54:29.446 INFO:teuthology.orchestra.run.smithi101.stdout: }, 2023-08-01T19:54:29.446 INFO:teuthology.orchestra.run.smithi101.stdout: { 2023-08-01T19:54:29.446 INFO:teuthology.orchestra.run.smithi101.stdout: "event": "started", 2023-08-01T19:54:29.447 INFO:teuthology.orchestra.run.smithi101.stdout: "time": "2023-08-01T19:54:04.468830+0000", 2023-08-01T19:54:29.447 INFO:teuthology.orchestra.run.smithi101.stdout: "duration": 0.000121339 2023-08-01T19:54:29.447 INFO:teuthology.orchestra.run.smithi101.stdout: }, 2023-08-01T19:54:29.447 INFO:teuthology.orchestra.run.smithi101.stdout: { 2023-08-01T19:54:29.447 INFO:teuthology.orchestra.run.smithi101.stdout: "event": "waiting for subops from 2", 2023-08-01T19:54:29.447 INFO:teuthology.orchestra.run.smithi101.stdout: "time": "2023-08-01T19:54:04.469611+0000", 2023-08-01T19:54:29.447 INFO:teuthology.orchestra.run.smithi101.stdout: "duration": 0.00078162900000000005 2023-08-01T19:54:29.447 INFO:teuthology.orchestra.run.smithi101.stdout: }, 2023-08-01T19:54:29.448 INFO:teuthology.orchestra.run.smithi101.stdout: { 2023-08-01T19:54:29.448 INFO:teuthology.orchestra.run.smithi101.stdout: "event": "sub_op_commit_rec", 2023-08-01T19:54:29.448 INFO:teuthology.orchestra.run.smithi101.stdout: "time": "2023-08-01T19:54:04.475478+0000", 2023-08-01T19:54:29.448 INFO:teuthology.orchestra.run.smithi101.stdout: "duration": 0.005866586 2023-08-01T19:54:29.448 INFO:teuthology.orchestra.run.smithi101.stdout: }, 2023-08-01T19:54:29.448 INFO:teuthology.orchestra.run.smithi101.stdout: { 2023-08-01T19:54:29.448 INFO:teuthology.orchestra.run.smithi101.stdout: "event": "op_commit", 2023-08-01T19:54:29.449 INFO:teuthology.orchestra.run.smithi101.stdout: "time": "2023-08-01T19:54:04.475941+0000", 2023-08-01T19:54:29.449 INFO:teuthology.orchestra.run.smithi101.stdout: "duration": 0.000462526 2023-08-01T19:54:29.449 INFO:teuthology.orchestra.run.smithi101.stdout: }, 2023-08-01T19:54:29.449 INFO:teuthology.orchestra.run.smithi101.stdout: { 2023-08-01T19:54:29.449 INFO:teuthology.orchestra.run.smithi101.stdout: "event": "commit_sent", 2023-08-01T19:54:29.449 INFO:teuthology.orchestra.run.smithi101.stdout: "time": "2023-08-01T19:54:04.475995+0000", 2023-08-01T19:54:29.449 INFO:teuthology.orchestra.run.smithi101.stdout: "duration": 5.4401000000000003e-05 2023-08-01T19:54:29.449 INFO:teuthology.orchestra.run.smithi101.stdout: }, 2023-08-01T19:54:29.450 INFO:teuthology.orchestra.run.smithi101.stdout: { 2023-08-01T19:54:29.450 INFO:teuthology.orchestra.run.smithi101.stdout: "event": "done", 2023-08-01T19:54:29.450 INFO:teuthology.orchestra.run.smithi101.stdout: "time": "2023-08-01T19:54:04.476045+0000", 2023-08-01T19:54:29.450 INFO:teuthology.orchestra.run.smithi101.stdout: "duration": 5.0389000000000002e-05 2023-08-01T19:54:29.450 INFO:teuthology.orchestra.run.smithi101.stdout: } 2023-08-01T19:54:29.450 INFO:teuthology.orchestra.run.smithi101.stdout: ] 2023-08-01T19:54:29.450 INFO:teuthology.orchestra.run.smithi101.stdout: } 2023-08-01T19:54:29.450 INFO:teuthology.orchestra.run.smithi101.stdout: }, 2023-08-01T19:54:29.451 INFO:teuthology.orchestra.run.smithi101.stdout: { 2023-08-01T19:54:29.451 INFO:teuthology.orchestra.run.smithi101.stdout: "description": "osd_op(mds.0.3:32 3.14 3:2e2fa760:::200.00000001:head [delete] snapc 0=[] ondisk+write+known_if_redirected+full_force+supports_pool_eio e17)", 2023-08-01T19:54:29.451 INFO:teuthology.orchestra.run.smithi101.stdout: "initiated_at": "2023-08-01T19:54:04.459304+0000", 2023-08-01T19:54:29.451 INFO:teuthology.orchestra.run.smithi101.stdout: "age": 24.78584317, 2023-08-01T19:54:29.451 INFO:teuthology.orchestra.run.smithi101.stdout: "duration": 0.021110606000000001, 2023-08-01T19:54:29.451 INFO:teuthology.orchestra.run.smithi101.stdout: "type_data": { 2023-08-01T19:54:29.451 INFO:teuthology.orchestra.run.smithi101.stdout: "flag_point": "started", 2023-08-01T19:54:29.451 INFO:teuthology.orchestra.run.smithi101.stdout: "events": [ 2023-08-01T19:54:29.452 INFO:teuthology.orchestra.run.smithi101.stdout: { 2023-08-01T19:54:29.452 INFO:teuthology.orchestra.run.smithi101.stdout: "event": "initiated", 2023-08-01T19:54:29.452 INFO:teuthology.orchestra.run.smithi101.stdout: "time": "2023-08-01T19:54:04.459304+0000", 2023-08-01T19:54:29.452 INFO:teuthology.orchestra.run.smithi101.stdout: "duration": 0 2023-08-01T19:54:29.452 INFO:teuthology.orchestra.run.smithi101.stdout: }, 2023-08-01T19:54:29.452 INFO:teuthology.orchestra.run.smithi101.stdout: { 2023-08-01T19:54:29.452 INFO:teuthology.orchestra.run.smithi101.stdout: "event": "throttled", 2023-08-01T19:54:29.452 INFO:teuthology.orchestra.run.smithi101.stdout: "time": "2023-08-01T19:54:04.459304+0000", 2023-08-01T19:54:29.453 INFO:teuthology.orchestra.run.smithi101.stdout: "duration": 0 2023-08-01T19:54:29.453 INFO:teuthology.orchestra.run.smithi101.stdout: }, 2023-08-01T19:54:29.453 INFO:teuthology.orchestra.run.smithi101.stdout: { 2023-08-01T19:54:29.453 INFO:teuthology.orchestra.run.smithi101.stdout: "event": "header_read", 2023-08-01T19:54:29.453 INFO:teuthology.orchestra.run.smithi101.stdout: "time": "2023-08-01T19:54:04.459304+0000", 2023-08-01T19:54:29.453 INFO:teuthology.orchestra.run.smithi101.stdout: "duration": 4294967295.9999995 2023-08-01T19:54:29.453 INFO:teuthology.orchestra.run.smithi101.stdout: }, 2023-08-01T19:54:29.453 INFO:teuthology.orchestra.run.smithi101.stdout: { 2023-08-01T19:54:29.454 INFO:teuthology.orchestra.run.smithi101.stdout: "event": "all_read", 2023-08-01T19:54:29.454 INFO:teuthology.orchestra.run.smithi101.stdout: "time": "2023-08-01T19:54:04.459306+0000", 2023-08-01T19:54:29.454 INFO:teuthology.orchestra.run.smithi101.stdout: "duration": 2.3889999999999999e-06 2023-08-01T19:54:29.454 INFO:teuthology.orchestra.run.smithi101.stdout: }, 2023-08-01T19:54:29.454 INFO:teuthology.orchestra.run.smithi101.stdout: { 2023-08-01T19:54:29.454 INFO:teuthology.orchestra.run.smithi101.stdout: "event": "dispatched", 2023-08-01T19:54:29.454 INFO:teuthology.orchestra.run.smithi101.stdout: "time": "2023-08-01T19:54:04.459314+0000", 2023-08-01T19:54:29.454 INFO:teuthology.orchestra.run.smithi101.stdout: "duration": 7.1180000000000003e-06 2023-08-01T19:54:29.455 INFO:teuthology.orchestra.run.smithi101.stdout: }, 2023-08-01T19:54:29.455 INFO:teuthology.orchestra.run.smithi101.stdout: { 2023-08-01T19:54:29.455 INFO:teuthology.orchestra.run.smithi101.stdout: "event": "queued_for_pg", 2023-08-01T19:54:29.455 INFO:teuthology.orchestra.run.smithi101.stdout: "time": "2023-08-01T19:54:04.459318+0000", 2023-08-01T19:54:29.455 INFO:teuthology.orchestra.run.smithi101.stdout: "duration": 4.0239999999999999e-06 2023-08-01T19:54:29.455 INFO:teuthology.orchestra.run.smithi101.stdout: }, 2023-08-01T19:54:29.455 INFO:teuthology.orchestra.run.smithi101.stdout: { 2023-08-01T19:54:29.455 INFO:teuthology.orchestra.run.smithi101.stdout: "event": "reached_pg", 2023-08-01T19:54:29.456 INFO:teuthology.orchestra.run.smithi101.stdout: "time": "2023-08-01T19:54:04.459340+0000", 2023-08-01T19:54:29.456 INFO:teuthology.orchestra.run.smithi101.stdout: "duration": 2.2476e-05 2023-08-01T19:54:29.456 INFO:teuthology.orchestra.run.smithi101.stdout: }, 2023-08-01T19:54:29.456 INFO:teuthology.orchestra.run.smithi101.stdout: { 2023-08-01T19:54:29.456 INFO:teuthology.orchestra.run.smithi101.stdout: "event": "waiting_for_map not empty", 2023-08-01T19:54:29.456 INFO:teuthology.orchestra.run.smithi101.stdout: "time": "2023-08-01T19:54:04.459342+0000", 2023-08-01T19:54:29.456 INFO:teuthology.orchestra.run.smithi101.stdout: "duration": 2.272e-06 2023-08-01T19:54:29.456 INFO:teuthology.orchestra.run.smithi101.stdout: }, 2023-08-01T19:54:29.457 INFO:teuthology.orchestra.run.smithi101.stdout: { 2023-08-01T19:54:29.457 INFO:teuthology.orchestra.run.smithi101.stdout: "event": "reached_pg", 2023-08-01T19:54:29.457 INFO:teuthology.orchestra.run.smithi101.stdout: "time": "2023-08-01T19:54:04.475922+0000", 2023-08-01T19:54:29.457 INFO:teuthology.orchestra.run.smithi101.stdout: "duration": 0.016579388 2023-08-01T19:54:29.457 INFO:teuthology.orchestra.run.smithi101.stdout: }, 2023-08-01T19:54:29.457 INFO:teuthology.orchestra.run.smithi101.stdout: { 2023-08-01T19:54:29.457 INFO:teuthology.orchestra.run.smithi101.stdout: "event": "started", 2023-08-01T19:54:29.458 INFO:teuthology.orchestra.run.smithi101.stdout: "time": "2023-08-01T19:54:04.476107+0000", 2023-08-01T19:54:29.458 INFO:teuthology.orchestra.run.smithi101.stdout: "duration": 0.00018486300000000001 2023-08-01T19:54:29.458 INFO:teuthology.orchestra.run.smithi101.stdout: }, 2023-08-01T19:54:29.458 INFO:teuthology.orchestra.run.smithi101.stdout: { 2023-08-01T19:54:29.458 INFO:teuthology.orchestra.run.smithi101.stdout: "event": "done", 2023-08-01T19:54:29.458 INFO:teuthology.orchestra.run.smithi101.stdout: "time": "2023-08-01T19:54:04.480415+0000", 2023-08-01T19:54:29.458 INFO:teuthology.orchestra.run.smithi101.stdout: "duration": 0.0043084589999999997 2023-08-01T19:54:29.458 INFO:teuthology.orchestra.run.smithi101.stdout: } 2023-08-01T19:54:29.459 INFO:teuthology.orchestra.run.smithi101.stdout: ] 2023-08-01T19:54:29.459 INFO:teuthology.orchestra.run.smithi101.stdout: } 2023-08-01T19:54:29.459 INFO:teuthology.orchestra.run.smithi101.stdout: }, 2023-08-01T19:54:29.459 INFO:teuthology.orchestra.run.smithi101.stdout: { 2023-08-01T19:54:29.459 INFO:teuthology.orchestra.run.smithi101.stdout: "description": "osd_repop(client.4668.0:18360 5.6 e23/19 5:65d8e237:::benchmark_data_smithi006_114134_object18359:head v 23'1125, mlcod=23'1120)", 2023-08-01T19:54:29.459 INFO:teuthology.orchestra.run.smithi101.stdout: "initiated_at": "2023-08-01T19:54:28.996096+0000", 2023-08-01T19:54:29.459 INFO:teuthology.orchestra.run.smithi101.stdout: "age": 0.24905110899999999, 2023-08-01T19:54:29.459 INFO:teuthology.orchestra.run.smithi101.stdout: "duration": 0.015251308999999999, 2023-08-01T19:54:29.460 INFO:teuthology.orchestra.run.smithi101.stdout: "type_data": { 2023-08-01T19:54:29.460 INFO:teuthology.orchestra.run.smithi101.stdout: "flag_point": "commit sent; apply or cleanup", 2023-08-01T19:54:29.460 INFO:teuthology.orchestra.run.smithi101.stdout: "events": [ 2023-08-01T19:54:29.460 INFO:teuthology.orchestra.run.smithi101.stdout: { 2023-08-01T19:54:29.460 INFO:teuthology.orchestra.run.smithi101.stdout: "event": "initiated", 2023-08-01T19:54:29.460 INFO:teuthology.orchestra.run.smithi101.stdout: "time": "2023-08-01T19:54:28.996096+0000", 2023-08-01T19:54:29.460 INFO:teuthology.orchestra.run.smithi101.stdout: "duration": 0 2023-08-01T19:54:29.460 INFO:teuthology.orchestra.run.smithi101.stdout: }, 2023-08-01T19:54:29.461 INFO:teuthology.orchestra.run.smithi101.stdout: { 2023-08-01T19:54:29.461 INFO:teuthology.orchestra.run.smithi101.stdout: "event": "throttled", 2023-08-01T19:54:29.461 INFO:teuthology.orchestra.run.smithi101.stdout: "time": "2023-08-01T19:54:28.996096+0000", 2023-08-01T19:54:29.461 INFO:teuthology.orchestra.run.smithi101.stdout: "duration": 0 2023-08-01T19:54:29.461 INFO:teuthology.orchestra.run.smithi101.stdout: }, 2023-08-01T19:54:29.461 INFO:teuthology.orchestra.run.smithi101.stdout: { 2023-08-01T19:54:29.461 INFO:teuthology.orchestra.run.smithi101.stdout: "event": "header_read", 2023-08-01T19:54:29.461 INFO:teuthology.orchestra.run.smithi101.stdout: "time": "2023-08-01T19:54:28.996096+0000", 2023-08-01T19:54:29.462 INFO:teuthology.orchestra.run.smithi101.stdout: "duration": 4294967295.9999995 2023-08-01T19:54:29.462 INFO:teuthology.orchestra.run.smithi101.stdout: }, 2023-08-01T19:54:29.462 INFO:teuthology.orchestra.run.smithi101.stdout: { 2023-08-01T19:54:29.462 INFO:teuthology.orchestra.run.smithi101.stdout: "event": "all_read", 2023-08-01T19:54:29.462 INFO:teuthology.orchestra.run.smithi101.stdout: "time": "2023-08-01T19:54:28.996167+0000", 2023-08-01T19:54:29.462 INFO:teuthology.orchestra.run.smithi101.stdout: "duration": 7.0716999999999994e-05 2023-08-01T19:54:29.462 INFO:teuthology.orchestra.run.smithi101.stdout: }, 2023-08-01T19:54:29.462 INFO:teuthology.orchestra.run.smithi101.stdout: { 2023-08-01T19:54:29.463 INFO:teuthology.orchestra.run.smithi101.stdout: "event": "dispatched", 2023-08-01T19:54:29.463 INFO:teuthology.orchestra.run.smithi101.stdout: "time": "2023-08-01T19:54:28.996177+0000", 2023-08-01T19:54:29.463 INFO:teuthology.orchestra.run.smithi101.stdout: "duration": 1.0479000000000001e-05 2023-08-01T19:54:29.463 INFO:teuthology.orchestra.run.smithi101.stdout: }, 2023-08-01T19:54:29.463 INFO:teuthology.orchestra.run.smithi101.stdout: { 2023-08-01T19:54:29.463 INFO:teuthology.orchestra.run.smithi101.stdout: "event": "queued_for_pg", 2023-08-01T19:54:29.463 INFO:teuthology.orchestra.run.smithi101.stdout: "time": "2023-08-01T19:54:28.996182+0000", 2023-08-01T19:54:29.463 INFO:teuthology.orchestra.run.smithi101.stdout: "duration": 5.2329999999999997e-06 2023-08-01T19:54:29.464 INFO:teuthology.orchestra.run.smithi101.stdout: }, 2023-08-01T19:54:29.464 INFO:teuthology.orchestra.run.smithi101.stdout: { 2023-08-01T19:54:29.464 INFO:teuthology.orchestra.run.smithi101.stdout: "event": "reached_pg", 2023-08-01T19:54:29.464 INFO:teuthology.orchestra.run.smithi101.stdout: "time": "2023-08-01T19:54:28.996224+0000", 2023-08-01T19:54:29.464 INFO:teuthology.orchestra.run.smithi101.stdout: "duration": 4.1897999999999998e-05 2023-08-01T19:54:29.464 INFO:teuthology.orchestra.run.smithi101.stdout: }, 2023-08-01T19:54:29.464 INFO:teuthology.orchestra.run.smithi101.stdout: { 2023-08-01T19:54:29.464 INFO:teuthology.orchestra.run.smithi101.stdout: "event": "started", 2023-08-01T19:54:29.465 INFO:teuthology.orchestra.run.smithi101.stdout: "time": "2023-08-01T19:54:28.996236+0000", 2023-08-01T19:54:29.465 INFO:teuthology.orchestra.run.smithi101.stdout: "duration": 1.1980999999999999e-05 2023-08-01T19:54:29.465 INFO:teuthology.orchestra.run.smithi101.stdout: }, 2023-08-01T19:54:29.465 INFO:teuthology.orchestra.run.smithi101.stdout: { 2023-08-01T19:54:29.465 INFO:teuthology.orchestra.run.smithi101.stdout: "event": "commit_sent", 2023-08-01T19:54:29.465 INFO:teuthology.orchestra.run.smithi101.stdout: "time": "2023-08-01T19:54:29.011316+0000", 2023-08-01T19:54:29.465 INFO:teuthology.orchestra.run.smithi101.stdout: "duration": 0.015079323 2023-08-01T19:54:29.465 INFO:teuthology.orchestra.run.smithi101.stdout: }, 2023-08-01T19:54:29.466 INFO:teuthology.orchestra.run.smithi101.stdout: { 2023-08-01T19:54:29.466 INFO:teuthology.orchestra.run.smithi101.stdout: "event": "done", 2023-08-01T19:54:29.466 INFO:teuthology.orchestra.run.smithi101.stdout: "time": "2023-08-01T19:54:29.011348+0000", 2023-08-01T19:54:29.466 INFO:teuthology.orchestra.run.smithi101.stdout: "duration": 3.2228999999999999e-05 2023-08-01T19:54:29.466 INFO:teuthology.orchestra.run.smithi101.stdout: } 2023-08-01T19:54:29.466 INFO:teuthology.orchestra.run.smithi101.stdout: ] 2023-08-01T19:54:29.466 INFO:teuthology.orchestra.run.smithi101.stdout: } 2023-08-01T19:54:29.466 INFO:teuthology.orchestra.run.smithi101.stdout: } 2023-08-01T19:54:29.467 INFO:teuthology.orchestra.run.smithi101.stdout: ] 2023-08-01T19:54:29.467 INFO:teuthology.orchestra.run.smithi101.stdout:} 2023-08-01T19:54:29.468 INFO:tasks.radosbench.radosbench.0.smithi006.stdout: 5 16 19408 19392 242.383 218.688 0.00487657 0.00412233 2023-08-01T19:54:29.469 DEBUG:teuthology.orchestra.run.smithi155:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 30 ceph --cluster ceph --admin-daemon /var/run/ceph/ceph-osd.2.asok dump_ops_in_flight 2023-08-01T19:54:29.469 INFO:tasks.ceph.osd.1.smithi101.stderr:2023-08-01T19:54:29.466+0000 7fb0cb7f6700 -1 received signal: Hangup from /usr/bin/python3 /bin/daemon-helper kill ceph-osd -f --cluster ceph -i 1 (PID: 111141) UID: 0 2023-08-01T19:54:29.569 INFO:tasks.ceph.osd.1.smithi101.stderr:2023-08-01T19:54:29.568+0000 7fb0cb7f6700 -1 received signal: Hangup from /usr/bin/python3 /bin/daemon-helper kill ceph-osd -f --cluster ceph -i 1 (PID: 111141) UID: 0 2023-08-01T19:54:29.639 INFO:teuthology.orchestra.run.smithi155.stdout:{ 2023-08-01T19:54:29.640 INFO:teuthology.orchestra.run.smithi155.stdout: "ops": [ 2023-08-01T19:54:29.640 INFO:teuthology.orchestra.run.smithi155.stdout: { 2023-08-01T19:54:29.640 INFO:teuthology.orchestra.run.smithi155.stdout: "description": "osd_op(client.4668.0:20469 5.8 5:1102623e:::benchmark_data_smithi006_114134_object20468:head [set-alloc-hint object_size 65536 write_size 65536,write 0~65536 in=65536b] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e23)", 2023-08-01T19:54:29.640 INFO:teuthology.orchestra.run.smithi155.stdout: "initiated_at": "2023-08-01T19:54:29.628914+0000", 2023-08-01T19:54:29.640 INFO:teuthology.orchestra.run.smithi155.stdout: "age": 0.0085010970000000009, 2023-08-01T19:54:29.640 INFO:teuthology.orchestra.run.smithi155.stdout: "duration": 0.0085216440000000001, 2023-08-01T19:54:29.640 INFO:teuthology.orchestra.run.smithi155.stdout: "type_data": { 2023-08-01T19:54:29.641 INFO:teuthology.orchestra.run.smithi155.stdout: "flag_point": "waiting for sub ops", 2023-08-01T19:54:29.641 INFO:teuthology.orchestra.run.smithi155.stdout: "client_info": { 2023-08-01T19:54:29.641 INFO:teuthology.orchestra.run.smithi155.stdout: "client": "client.4668", 2023-08-01T19:54:29.641 INFO:teuthology.orchestra.run.smithi155.stdout: "client_addr": "172.21.15.6:0/1709472247", 2023-08-01T19:54:29.641 INFO:teuthology.orchestra.run.smithi155.stdout: "tid": 20469 2023-08-01T19:54:29.641 INFO:teuthology.orchestra.run.smithi155.stdout: }, 2023-08-01T19:54:29.641 INFO:teuthology.orchestra.run.smithi155.stdout: "events": [ 2023-08-01T19:54:29.641 INFO:teuthology.orchestra.run.smithi155.stdout: { 2023-08-01T19:54:29.642 INFO:teuthology.orchestra.run.smithi155.stdout: "event": "initiated", 2023-08-01T19:54:29.642 INFO:teuthology.orchestra.run.smithi155.stdout: "time": "2023-08-01T19:54:29.628914+0000", 2023-08-01T19:54:29.642 INFO:teuthology.orchestra.run.smithi155.stdout: "duration": 0 2023-08-01T19:54:29.642 INFO:teuthology.orchestra.run.smithi155.stdout: }, 2023-08-01T19:54:29.642 INFO:teuthology.orchestra.run.smithi155.stdout: { 2023-08-01T19:54:29.642 INFO:teuthology.orchestra.run.smithi155.stdout: "event": "throttled", 2023-08-01T19:54:29.642 INFO:teuthology.orchestra.run.smithi155.stdout: "time": "2023-08-01T19:54:29.628914+0000", 2023-08-01T19:54:29.642 INFO:teuthology.orchestra.run.smithi155.stdout: "duration": 0 2023-08-01T19:54:29.643 INFO:teuthology.orchestra.run.smithi155.stdout: }, 2023-08-01T19:54:29.643 INFO:teuthology.orchestra.run.smithi155.stdout: { 2023-08-01T19:54:29.643 INFO:teuthology.orchestra.run.smithi155.stdout: "event": "header_read", 2023-08-01T19:54:29.643 INFO:teuthology.orchestra.run.smithi155.stdout: "time": "2023-08-01T19:54:29.628913+0000", 2023-08-01T19:54:29.643 INFO:teuthology.orchestra.run.smithi155.stdout: "duration": 4294967295.999999 2023-08-01T19:54:29.643 INFO:teuthology.orchestra.run.smithi155.stdout: }, 2023-08-01T19:54:29.643 INFO:teuthology.orchestra.run.smithi155.stdout: { 2023-08-01T19:54:29.643 INFO:teuthology.orchestra.run.smithi155.stdout: "event": "all_read", 2023-08-01T19:54:29.644 INFO:teuthology.orchestra.run.smithi155.stdout: "time": "2023-08-01T19:54:29.628971+0000", 2023-08-01T19:54:29.644 INFO:teuthology.orchestra.run.smithi155.stdout: "duration": 5.8338000000000003e-05 2023-08-01T19:54:29.644 INFO:teuthology.orchestra.run.smithi155.stdout: }, 2023-08-01T19:54:29.644 INFO:teuthology.orchestra.run.smithi155.stdout: { 2023-08-01T19:54:29.644 INFO:teuthology.orchestra.run.smithi155.stdout: "event": "dispatched", 2023-08-01T19:54:29.644 INFO:teuthology.orchestra.run.smithi155.stdout: "time": "2023-08-01T19:54:29.628984+0000", 2023-08-01T19:54:29.644 INFO:teuthology.orchestra.run.smithi155.stdout: "duration": 1.2791e-05 2023-08-01T19:54:29.645 INFO:teuthology.orchestra.run.smithi155.stdout: }, 2023-08-01T19:54:29.645 INFO:teuthology.orchestra.run.smithi155.stdout: { 2023-08-01T19:54:29.645 INFO:teuthology.orchestra.run.smithi155.stdout: "event": "queued_for_pg", 2023-08-01T19:54:29.645 INFO:teuthology.orchestra.run.smithi155.stdout: "time": "2023-08-01T19:54:29.628989+0000", 2023-08-01T19:54:29.645 INFO:teuthology.orchestra.run.smithi155.stdout: "duration": 5.1080000000000001e-06 2023-08-01T19:54:29.645 INFO:teuthology.orchestra.run.smithi155.stdout: }, 2023-08-01T19:54:29.645 INFO:teuthology.orchestra.run.smithi155.stdout: { 2023-08-01T19:54:29.645 INFO:teuthology.orchestra.run.smithi155.stdout: "event": "reached_pg", 2023-08-01T19:54:29.646 INFO:teuthology.orchestra.run.smithi155.stdout: "time": "2023-08-01T19:54:29.629024+0000", 2023-08-01T19:54:29.646 INFO:teuthology.orchestra.run.smithi155.stdout: "duration": 3.4524999999999999e-05 2023-08-01T19:54:29.646 INFO:teuthology.orchestra.run.smithi155.stdout: }, 2023-08-01T19:54:29.646 INFO:teuthology.orchestra.run.smithi155.stdout: { 2023-08-01T19:54:29.646 INFO:teuthology.orchestra.run.smithi155.stdout: "event": "started", 2023-08-01T19:54:29.646 INFO:teuthology.orchestra.run.smithi155.stdout: "time": "2023-08-01T19:54:29.629152+0000", 2023-08-01T19:54:29.646 INFO:teuthology.orchestra.run.smithi155.stdout: "duration": 0.00012849500000000001 2023-08-01T19:54:29.646 INFO:teuthology.orchestra.run.smithi155.stdout: }, 2023-08-01T19:54:29.647 INFO:teuthology.orchestra.run.smithi155.stdout: { 2023-08-01T19:54:29.647 INFO:teuthology.orchestra.run.smithi155.stdout: "event": "waiting for subops from 0", 2023-08-01T19:54:29.647 INFO:teuthology.orchestra.run.smithi155.stdout: "time": "2023-08-01T19:54:29.629290+0000", 2023-08-01T19:54:29.647 INFO:teuthology.orchestra.run.smithi155.stdout: "duration": 0.000137866 2023-08-01T19:54:29.647 INFO:teuthology.orchestra.run.smithi155.stdout: }, 2023-08-01T19:54:29.647 INFO:teuthology.orchestra.run.smithi155.stdout: { 2023-08-01T19:54:29.647 INFO:teuthology.orchestra.run.smithi155.stdout: "event": "sub_op_commit_rec", 2023-08-01T19:54:29.648 INFO:teuthology.orchestra.run.smithi155.stdout: "time": "2023-08-01T19:54:29.631802+0000", 2023-08-01T19:54:29.648 INFO:teuthology.orchestra.run.smithi155.stdout: "duration": 0.0025122170000000002 2023-08-01T19:54:29.648 INFO:teuthology.orchestra.run.smithi155.stdout: } 2023-08-01T19:54:29.648 INFO:teuthology.orchestra.run.smithi155.stdout: ] 2023-08-01T19:54:29.648 INFO:teuthology.orchestra.run.smithi155.stdout: } 2023-08-01T19:54:29.648 INFO:teuthology.orchestra.run.smithi155.stdout: }, 2023-08-01T19:54:29.648 INFO:teuthology.orchestra.run.smithi155.stdout: { 2023-08-01T19:54:29.648 INFO:teuthology.orchestra.run.smithi155.stdout: "description": "osd_op(client.4668.0:20470 5.8 5:1c1639df:::benchmark_data_smithi006_114134_object20469:head [set-alloc-hint object_size 65536 write_size 65536,write 0~65536 in=65536b] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e23)", 2023-08-01T19:54:29.649 INFO:teuthology.orchestra.run.smithi155.stdout: "initiated_at": "2023-08-01T19:54:29.629039+0000", 2023-08-01T19:54:29.649 INFO:teuthology.orchestra.run.smithi155.stdout: "age": 0.0083759899999999998, 2023-08-01T19:54:29.649 INFO:teuthology.orchestra.run.smithi155.stdout: "duration": 0.0084511450000000002, 2023-08-01T19:54:29.649 INFO:teuthology.orchestra.run.smithi155.stdout: "type_data": { 2023-08-01T19:54:29.649 INFO:teuthology.orchestra.run.smithi155.stdout: "flag_point": "waiting for sub ops", 2023-08-01T19:54:29.649 INFO:teuthology.orchestra.run.smithi155.stdout: "client_info": { 2023-08-01T19:54:29.649 INFO:teuthology.orchestra.run.smithi155.stdout: "client": "client.4668", 2023-08-01T19:54:29.649 INFO:teuthology.orchestra.run.smithi155.stdout: "client_addr": "172.21.15.6:0/1709472247", 2023-08-01T19:54:29.650 INFO:teuthology.orchestra.run.smithi155.stdout: "tid": 20470 2023-08-01T19:54:29.650 INFO:teuthology.orchestra.run.smithi155.stdout: }, 2023-08-01T19:54:29.650 INFO:teuthology.orchestra.run.smithi155.stdout: "events": [ 2023-08-01T19:54:29.650 INFO:teuthology.orchestra.run.smithi155.stdout: { 2023-08-01T19:54:29.650 INFO:teuthology.orchestra.run.smithi155.stdout: "event": "initiated", 2023-08-01T19:54:29.650 INFO:teuthology.orchestra.run.smithi155.stdout: "time": "2023-08-01T19:54:29.629039+0000", 2023-08-01T19:54:29.650 INFO:teuthology.orchestra.run.smithi155.stdout: "duration": 0 2023-08-01T19:54:29.651 INFO:teuthology.orchestra.run.smithi155.stdout: }, 2023-08-01T19:54:29.651 INFO:teuthology.orchestra.run.smithi155.stdout: { 2023-08-01T19:54:29.651 INFO:teuthology.orchestra.run.smithi155.stdout: "event": "throttled", 2023-08-01T19:54:29.651 INFO:teuthology.orchestra.run.smithi155.stdout: "time": "2023-08-01T19:54:29.629039+0000", 2023-08-01T19:54:29.651 INFO:teuthology.orchestra.run.smithi155.stdout: "duration": 0 2023-08-01T19:54:29.651 INFO:teuthology.orchestra.run.smithi155.stdout: }, 2023-08-01T19:54:29.651 INFO:teuthology.orchestra.run.smithi155.stdout: { 2023-08-01T19:54:29.651 INFO:teuthology.orchestra.run.smithi155.stdout: "event": "header_read", 2023-08-01T19:54:29.652 INFO:teuthology.orchestra.run.smithi155.stdout: "time": "2023-08-01T19:54:29.629038+0000", 2023-08-01T19:54:29.652 INFO:teuthology.orchestra.run.smithi155.stdout: "duration": 4294967295.999999 2023-08-01T19:54:29.652 INFO:teuthology.orchestra.run.smithi155.stdout: }, 2023-08-01T19:54:29.652 INFO:teuthology.orchestra.run.smithi155.stdout: { 2023-08-01T19:54:29.652 INFO:teuthology.orchestra.run.smithi155.stdout: "event": "all_read", 2023-08-01T19:54:29.652 INFO:teuthology.orchestra.run.smithi155.stdout: "time": "2023-08-01T19:54:29.629115+0000", 2023-08-01T19:54:29.652 INFO:teuthology.orchestra.run.smithi155.stdout: "duration": 7.6953999999999995e-05 2023-08-01T19:54:29.652 INFO:teuthology.orchestra.run.smithi155.stdout: }, 2023-08-01T19:54:29.653 INFO:teuthology.orchestra.run.smithi155.stdout: { 2023-08-01T19:54:29.653 INFO:teuthology.orchestra.run.smithi155.stdout: "event": "dispatched", 2023-08-01T19:54:29.653 INFO:teuthology.orchestra.run.smithi155.stdout: "time": "2023-08-01T19:54:29.629126+0000", 2023-08-01T19:54:29.653 INFO:teuthology.orchestra.run.smithi155.stdout: "duration": 1.1351e-05 2023-08-01T19:54:29.653 INFO:teuthology.orchestra.run.smithi155.stdout: }, 2023-08-01T19:54:29.653 INFO:teuthology.orchestra.run.smithi155.stdout: { 2023-08-01T19:54:29.653 INFO:teuthology.orchestra.run.smithi155.stdout: "event": "queued_for_pg", 2023-08-01T19:54:29.653 INFO:teuthology.orchestra.run.smithi155.stdout: "time": "2023-08-01T19:54:29.629132+0000", 2023-08-01T19:54:29.654 INFO:teuthology.orchestra.run.smithi155.stdout: "duration": 6.246e-06 2023-08-01T19:54:29.654 INFO:teuthology.orchestra.run.smithi155.stdout: }, 2023-08-01T19:54:29.654 INFO:teuthology.orchestra.run.smithi155.stdout: { 2023-08-01T19:54:29.654 INFO:teuthology.orchestra.run.smithi155.stdout: "event": "reached_pg", 2023-08-01T19:54:29.654 INFO:teuthology.orchestra.run.smithi155.stdout: "time": "2023-08-01T19:54:29.630029+0000", 2023-08-01T19:54:29.654 INFO:teuthology.orchestra.run.smithi155.stdout: "duration": 0.000896848 2023-08-01T19:54:29.654 INFO:teuthology.orchestra.run.smithi155.stdout: }, 2023-08-01T19:54:29.654 INFO:teuthology.orchestra.run.smithi155.stdout: { 2023-08-01T19:54:29.655 INFO:teuthology.orchestra.run.smithi155.stdout: "event": "started", 2023-08-01T19:54:29.655 INFO:teuthology.orchestra.run.smithi155.stdout: "time": "2023-08-01T19:54:29.630111+0000", 2023-08-01T19:54:29.655 INFO:teuthology.orchestra.run.smithi155.stdout: "duration": 8.1860999999999994e-05 2023-08-01T19:54:29.655 INFO:teuthology.orchestra.run.smithi155.stdout: }, 2023-08-01T19:54:29.655 INFO:teuthology.orchestra.run.smithi155.stdout: { 2023-08-01T19:54:29.655 INFO:teuthology.orchestra.run.smithi155.stdout: "event": "waiting for subops from 0", 2023-08-01T19:54:29.655 INFO:teuthology.orchestra.run.smithi155.stdout: "time": "2023-08-01T19:54:29.630199+0000", 2023-08-01T19:54:29.655 INFO:teuthology.orchestra.run.smithi155.stdout: "duration": 8.7736000000000002e-05 2023-08-01T19:54:29.656 INFO:teuthology.orchestra.run.smithi155.stdout: }, 2023-08-01T19:54:29.656 INFO:teuthology.orchestra.run.smithi155.stdout: { 2023-08-01T19:54:29.656 INFO:teuthology.orchestra.run.smithi155.stdout: "event": "sub_op_commit_rec", 2023-08-01T19:54:29.656 INFO:teuthology.orchestra.run.smithi155.stdout: "time": "2023-08-01T19:54:29.632315+0000", 2023-08-01T19:54:29.656 INFO:teuthology.orchestra.run.smithi155.stdout: "duration": 0.002116251 2023-08-01T19:54:29.656 INFO:teuthology.orchestra.run.smithi155.stdout: } 2023-08-01T19:54:29.656 INFO:teuthology.orchestra.run.smithi155.stdout: ] 2023-08-01T19:54:29.657 INFO:teuthology.orchestra.run.smithi155.stdout: } 2023-08-01T19:54:29.657 INFO:teuthology.orchestra.run.smithi155.stdout: }, 2023-08-01T19:54:29.657 INFO:teuthology.orchestra.run.smithi155.stdout: { 2023-08-01T19:54:29.657 INFO:teuthology.orchestra.run.smithi155.stdout: "description": "osd_repop(client.4668.0:20472 5.a e23/19 5:51d7b182:::benchmark_data_smithi006_114134_object20471:head v 23'1246, mlcod=23'1244)", 2023-08-01T19:54:29.657 INFO:teuthology.orchestra.run.smithi155.stdout: "initiated_at": "2023-08-01T19:54:29.631195+0000", 2023-08-01T19:54:29.657 INFO:teuthology.orchestra.run.smithi155.stdout: "age": 0.006219891, 2023-08-01T19:54:29.657 INFO:teuthology.orchestra.run.smithi155.stdout: "duration": 0.0063658680000000002, 2023-08-01T19:54:29.657 INFO:teuthology.orchestra.run.smithi155.stdout: "type_data": { 2023-08-01T19:54:29.658 INFO:teuthology.orchestra.run.smithi155.stdout: "flag_point": "commit sent; apply or cleanup", 2023-08-01T19:54:29.658 INFO:teuthology.orchestra.run.smithi155.stdout: "events": [ 2023-08-01T19:54:29.658 INFO:teuthology.orchestra.run.smithi155.stdout: { 2023-08-01T19:54:29.658 INFO:teuthology.orchestra.run.smithi155.stdout: "event": "initiated", 2023-08-01T19:54:29.658 INFO:teuthology.orchestra.run.smithi155.stdout: "time": "2023-08-01T19:54:29.631195+0000", 2023-08-01T19:54:29.658 INFO:teuthology.orchestra.run.smithi155.stdout: "duration": 0 2023-08-01T19:54:29.658 INFO:teuthology.orchestra.run.smithi155.stdout: }, 2023-08-01T19:54:29.658 INFO:teuthology.orchestra.run.smithi155.stdout: { 2023-08-01T19:54:29.659 INFO:teuthology.orchestra.run.smithi155.stdout: "event": "throttled", 2023-08-01T19:54:29.659 INFO:teuthology.orchestra.run.smithi155.stdout: "time": "2023-08-01T19:54:29.631195+0000", 2023-08-01T19:54:29.659 INFO:teuthology.orchestra.run.smithi155.stdout: "duration": 0 2023-08-01T19:54:29.659 INFO:teuthology.orchestra.run.smithi155.stdout: }, 2023-08-01T19:54:29.659 INFO:teuthology.orchestra.run.smithi155.stdout: { 2023-08-01T19:54:29.659 INFO:teuthology.orchestra.run.smithi155.stdout: "event": "header_read", 2023-08-01T19:54:29.659 INFO:teuthology.orchestra.run.smithi155.stdout: "time": "2023-08-01T19:54:29.631194+0000", 2023-08-01T19:54:29.659 INFO:teuthology.orchestra.run.smithi155.stdout: "duration": 4294967295.9999995 2023-08-01T19:54:29.660 INFO:teuthology.orchestra.run.smithi155.stdout: }, 2023-08-01T19:54:29.660 INFO:teuthology.orchestra.run.smithi155.stdout: { 2023-08-01T19:54:29.660 INFO:teuthology.orchestra.run.smithi155.stdout: "event": "all_read", 2023-08-01T19:54:29.660 INFO:teuthology.orchestra.run.smithi155.stdout: "time": "2023-08-01T19:54:29.631239+0000", 2023-08-01T19:54:29.660 INFO:teuthology.orchestra.run.smithi155.stdout: "duration": 4.4814000000000002e-05 2023-08-01T19:54:29.660 INFO:teuthology.orchestra.run.smithi155.stdout: }, 2023-08-01T19:54:29.660 INFO:teuthology.orchestra.run.smithi155.stdout: { 2023-08-01T19:54:29.661 INFO:teuthology.orchestra.run.smithi155.stdout: "event": "dispatched", 2023-08-01T19:54:29.661 INFO:teuthology.orchestra.run.smithi155.stdout: "time": "2023-08-01T19:54:29.631253+0000", 2023-08-01T19:54:29.661 INFO:teuthology.orchestra.run.smithi155.stdout: "duration": 1.4143e-05 2023-08-01T19:54:29.661 INFO:teuthology.orchestra.run.smithi155.stdout: }, 2023-08-01T19:54:29.661 INFO:teuthology.orchestra.run.smithi155.stdout: { 2023-08-01T19:54:29.661 INFO:teuthology.orchestra.run.smithi155.stdout: "event": "queued_for_pg", 2023-08-01T19:54:29.661 INFO:teuthology.orchestra.run.smithi155.stdout: "time": "2023-08-01T19:54:29.631259+0000", 2023-08-01T19:54:29.661 INFO:teuthology.orchestra.run.smithi155.stdout: "duration": 5.5639999999999996e-06 2023-08-01T19:54:29.662 INFO:teuthology.orchestra.run.smithi155.stdout: }, 2023-08-01T19:54:29.662 INFO:teuthology.orchestra.run.smithi155.stdout: { 2023-08-01T19:54:29.662 INFO:teuthology.orchestra.run.smithi155.stdout: "event": "reached_pg", 2023-08-01T19:54:29.662 INFO:teuthology.orchestra.run.smithi155.stdout: "time": "2023-08-01T19:54:29.631294+0000", 2023-08-01T19:54:29.662 INFO:teuthology.orchestra.run.smithi155.stdout: "duration": 3.4986e-05 2023-08-01T19:54:29.662 INFO:teuthology.orchestra.run.smithi155.stdout: }, 2023-08-01T19:54:29.662 INFO:teuthology.orchestra.run.smithi155.stdout: { 2023-08-01T19:54:29.662 INFO:teuthology.orchestra.run.smithi155.stdout: "event": "started", 2023-08-01T19:54:29.663 INFO:teuthology.orchestra.run.smithi155.stdout: "time": "2023-08-01T19:54:29.631321+0000", 2023-08-01T19:54:29.663 INFO:teuthology.orchestra.run.smithi155.stdout: "duration": 2.6658000000000001e-05 2023-08-01T19:54:29.663 INFO:teuthology.orchestra.run.smithi155.stdout: }, 2023-08-01T19:54:29.663 INFO:teuthology.orchestra.run.smithi155.stdout: { 2023-08-01T19:54:29.663 INFO:teuthology.orchestra.run.smithi155.stdout: "event": "commit_sent", 2023-08-01T19:54:29.663 INFO:teuthology.orchestra.run.smithi155.stdout: "time": "2023-08-01T19:54:29.637544+0000", 2023-08-01T19:54:29.663 INFO:teuthology.orchestra.run.smithi155.stdout: "duration": 0.006223747 2023-08-01T19:54:29.663 INFO:teuthology.orchestra.run.smithi155.stdout: } 2023-08-01T19:54:29.664 INFO:teuthology.orchestra.run.smithi155.stdout: ] 2023-08-01T19:54:29.664 INFO:teuthology.orchestra.run.smithi155.stdout: } 2023-08-01T19:54:29.664 INFO:teuthology.orchestra.run.smithi155.stdout: }, 2023-08-01T19:54:29.664 INFO:teuthology.orchestra.run.smithi155.stdout: { 2023-08-01T19:54:29.664 INFO:teuthology.orchestra.run.smithi155.stdout: "description": "osd_repop(client.4668.0:20475 5.9 e23/19 5:99ce835c:::benchmark_data_smithi006_114134_object20474:head v 23'1320, mlcod=23'1317)", 2023-08-01T19:54:29.664 INFO:teuthology.orchestra.run.smithi155.stdout: "initiated_at": "2023-08-01T19:54:29.631652+0000", 2023-08-01T19:54:29.664 INFO:teuthology.orchestra.run.smithi155.stdout: "age": 0.0057625740000000003, 2023-08-01T19:54:29.664 INFO:teuthology.orchestra.run.smithi155.stdout: "duration": 0.0059962849999999996, 2023-08-01T19:54:29.665 INFO:teuthology.orchestra.run.smithi155.stdout: "type_data": { 2023-08-01T19:54:29.665 INFO:teuthology.orchestra.run.smithi155.stdout: "flag_point": "commit sent; apply or cleanup", 2023-08-01T19:54:29.665 INFO:teuthology.orchestra.run.smithi155.stdout: "events": [ 2023-08-01T19:54:29.665 INFO:teuthology.orchestra.run.smithi155.stdout: { 2023-08-01T19:54:29.665 INFO:teuthology.orchestra.run.smithi155.stdout: "event": "initiated", 2023-08-01T19:54:29.665 INFO:teuthology.orchestra.run.smithi155.stdout: "time": "2023-08-01T19:54:29.631652+0000", 2023-08-01T19:54:29.665 INFO:teuthology.orchestra.run.smithi155.stdout: "duration": 0 2023-08-01T19:54:29.666 INFO:teuthology.orchestra.run.smithi155.stdout: }, 2023-08-01T19:54:29.666 INFO:teuthology.orchestra.run.smithi155.stdout: { 2023-08-01T19:54:29.666 INFO:teuthology.orchestra.run.smithi155.stdout: "event": "throttled", 2023-08-01T19:54:29.666 INFO:teuthology.orchestra.run.smithi155.stdout: "time": "2023-08-01T19:54:29.631652+0000", 2023-08-01T19:54:29.666 INFO:teuthology.orchestra.run.smithi155.stdout: "duration": 0 2023-08-01T19:54:29.666 INFO:teuthology.orchestra.run.smithi155.stdout: }, 2023-08-01T19:54:29.666 INFO:teuthology.orchestra.run.smithi155.stdout: { 2023-08-01T19:54:29.666 INFO:teuthology.orchestra.run.smithi155.stdout: "event": "header_read", 2023-08-01T19:54:29.667 INFO:teuthology.orchestra.run.smithi155.stdout: "time": "2023-08-01T19:54:29.631652+0000", 2023-08-01T19:54:29.667 INFO:teuthology.orchestra.run.smithi155.stdout: "duration": 4294967295.9999995 2023-08-01T19:54:29.667 INFO:teuthology.orchestra.run.smithi155.stdout: }, 2023-08-01T19:54:29.667 INFO:teuthology.orchestra.run.smithi155.stdout: { 2023-08-01T19:54:29.667 INFO:teuthology.orchestra.run.smithi155.stdout: "event": "all_read", 2023-08-01T19:54:29.667 INFO:teuthology.orchestra.run.smithi155.stdout: "time": "2023-08-01T19:54:29.631747+0000", 2023-08-01T19:54:29.667 INFO:teuthology.orchestra.run.smithi155.stdout: "duration": 9.5519999999999993e-05 2023-08-01T19:54:29.667 INFO:teuthology.orchestra.run.smithi155.stdout: }, 2023-08-01T19:54:29.668 INFO:teuthology.orchestra.run.smithi155.stdout: { 2023-08-01T19:54:29.668 INFO:teuthology.orchestra.run.smithi155.stdout: "event": "dispatched", 2023-08-01T19:54:29.668 INFO:teuthology.orchestra.run.smithi155.stdout: "time": "2023-08-01T19:54:29.631759+0000", 2023-08-01T19:54:29.668 INFO:teuthology.orchestra.run.smithi155.stdout: "duration": 1.2079000000000001e-05 2023-08-01T19:54:29.668 INFO:teuthology.orchestra.run.smithi155.stdout: }, 2023-08-01T19:54:29.668 INFO:teuthology.orchestra.run.smithi155.stdout: { 2023-08-01T19:54:29.668 INFO:teuthology.orchestra.run.smithi155.stdout: "event": "queued_for_pg", 2023-08-01T19:54:29.668 INFO:teuthology.orchestra.run.smithi155.stdout: "time": "2023-08-01T19:54:29.631765+0000", 2023-08-01T19:54:29.669 INFO:teuthology.orchestra.run.smithi155.stdout: "duration": 5.4389999999999999e-06 2023-08-01T19:54:29.669 INFO:teuthology.orchestra.run.smithi155.stdout: }, 2023-08-01T19:54:29.669 INFO:teuthology.orchestra.run.smithi155.stdout: { 2023-08-01T19:54:29.669 INFO:teuthology.orchestra.run.smithi155.stdout: "event": "reached_pg", 2023-08-01T19:54:29.669 INFO:teuthology.orchestra.run.smithi155.stdout: "time": "2023-08-01T19:54:29.631792+0000", 2023-08-01T19:54:29.669 INFO:teuthology.orchestra.run.smithi155.stdout: "duration": 2.6721999999999999e-05 2023-08-01T19:54:29.669 INFO:teuthology.orchestra.run.smithi155.stdout: }, 2023-08-01T19:54:29.670 INFO:teuthology.orchestra.run.smithi155.stdout: { 2023-08-01T19:54:29.670 INFO:teuthology.orchestra.run.smithi155.stdout: "event": "started", 2023-08-01T19:54:29.670 INFO:teuthology.orchestra.run.smithi155.stdout: "time": "2023-08-01T19:54:29.631803+0000", 2023-08-01T19:54:29.670 INFO:teuthology.orchestra.run.smithi155.stdout: "duration": 1.1724e-05 2023-08-01T19:54:29.670 INFO:teuthology.orchestra.run.smithi155.stdout: }, 2023-08-01T19:54:29.670 INFO:teuthology.orchestra.run.smithi155.stdout: { 2023-08-01T19:54:29.670 INFO:teuthology.orchestra.run.smithi155.stdout: "event": "commit_sent", 2023-08-01T19:54:29.670 INFO:teuthology.orchestra.run.smithi155.stdout: "time": "2023-08-01T19:54:29.637631+0000", 2023-08-01T19:54:29.671 INFO:teuthology.orchestra.run.smithi155.stdout: "duration": 0.0058278660000000001 2023-08-01T19:54:29.671 INFO:teuthology.orchestra.run.smithi155.stdout: } 2023-08-01T19:54:29.671 INFO:teuthology.orchestra.run.smithi155.stdout: ] 2023-08-01T19:54:29.671 INFO:teuthology.orchestra.run.smithi155.stdout: } 2023-08-01T19:54:29.671 INFO:teuthology.orchestra.run.smithi155.stdout: }, 2023-08-01T19:54:29.671 INFO:teuthology.orchestra.run.smithi155.stdout: { 2023-08-01T19:54:29.671 INFO:teuthology.orchestra.run.smithi155.stdout: "description": "osd_op(client.4668.0:20478 5.0 5:0df1c0c4:::benchmark_data_smithi006_114134_object20477:head [set-alloc-hint object_size 65536 write_size 65536,write 0~65536 in=65536b] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e23)", 2023-08-01T19:54:29.671 INFO:teuthology.orchestra.run.smithi155.stdout: "initiated_at": "2023-08-01T19:54:29.633519+0000", 2023-08-01T19:54:29.672 INFO:teuthology.orchestra.run.smithi155.stdout: "age": 0.003895683, 2023-08-01T19:54:29.672 INFO:teuthology.orchestra.run.smithi155.stdout: "duration": 0.0041973970000000003, 2023-08-01T19:54:29.672 INFO:teuthology.orchestra.run.smithi155.stdout: "type_data": { 2023-08-01T19:54:29.672 INFO:teuthology.orchestra.run.smithi155.stdout: "flag_point": "waiting for sub ops", 2023-08-01T19:54:29.672 INFO:teuthology.orchestra.run.smithi155.stdout: "client_info": { 2023-08-01T19:54:29.672 INFO:teuthology.orchestra.run.smithi155.stdout: "client": "client.4668", 2023-08-01T19:54:29.672 INFO:teuthology.orchestra.run.smithi155.stdout: "client_addr": "172.21.15.6:0/1709472247", 2023-08-01T19:54:29.672 INFO:teuthology.orchestra.run.smithi155.stdout: "tid": 20478 2023-08-01T19:54:29.673 INFO:teuthology.orchestra.run.smithi155.stdout: }, 2023-08-01T19:54:29.673 INFO:teuthology.orchestra.run.smithi155.stdout: "events": [ 2023-08-01T19:54:29.673 INFO:teuthology.orchestra.run.smithi155.stdout: { 2023-08-01T19:54:29.673 INFO:teuthology.orchestra.run.smithi155.stdout: "event": "initiated", 2023-08-01T19:54:29.673 INFO:teuthology.orchestra.run.smithi155.stdout: "time": "2023-08-01T19:54:29.633519+0000", 2023-08-01T19:54:29.673 INFO:teuthology.orchestra.run.smithi155.stdout: "duration": 0 2023-08-01T19:54:29.673 INFO:teuthology.orchestra.run.smithi155.stdout: }, 2023-08-01T19:54:29.674 INFO:teuthology.orchestra.run.smithi155.stdout: { 2023-08-01T19:54:29.674 INFO:teuthology.orchestra.run.smithi155.stdout: "event": "throttled", 2023-08-01T19:54:29.674 INFO:teuthology.orchestra.run.smithi155.stdout: "time": "2023-08-01T19:54:29.633519+0000", 2023-08-01T19:54:29.674 INFO:teuthology.orchestra.run.smithi155.stdout: "duration": 0 2023-08-01T19:54:29.674 INFO:teuthology.orchestra.run.smithi155.stdout: }, 2023-08-01T19:54:29.674 INFO:teuthology.orchestra.run.smithi155.stdout: { 2023-08-01T19:54:29.674 INFO:teuthology.orchestra.run.smithi155.stdout: "event": "header_read", 2023-08-01T19:54:29.674 INFO:teuthology.orchestra.run.smithi155.stdout: "time": "2023-08-01T19:54:29.633519+0000", 2023-08-01T19:54:29.675 INFO:teuthology.orchestra.run.smithi155.stdout: "duration": 4294967295.9999995 2023-08-01T19:54:29.675 INFO:teuthology.orchestra.run.smithi155.stdout: }, 2023-08-01T19:54:29.675 INFO:teuthology.orchestra.run.smithi155.stdout: { 2023-08-01T19:54:29.675 INFO:teuthology.orchestra.run.smithi155.stdout: "event": "all_read", 2023-08-01T19:54:29.675 INFO:teuthology.orchestra.run.smithi155.stdout: "time": "2023-08-01T19:54:29.633628+0000", 2023-08-01T19:54:29.675 INFO:teuthology.orchestra.run.smithi155.stdout: "duration": 0.000109738 2023-08-01T19:54:29.675 INFO:teuthology.orchestra.run.smithi155.stdout: }, 2023-08-01T19:54:29.675 INFO:teuthology.orchestra.run.smithi155.stdout: { 2023-08-01T19:54:29.676 INFO:teuthology.orchestra.run.smithi155.stdout: "event": "dispatched", 2023-08-01T19:54:29.676 INFO:teuthology.orchestra.run.smithi155.stdout: "time": "2023-08-01T19:54:29.633638+0000", 2023-08-01T19:54:29.676 INFO:teuthology.orchestra.run.smithi155.stdout: "duration": 9.5380000000000008e-06 2023-08-01T19:54:29.676 INFO:teuthology.orchestra.run.smithi155.stdout: }, 2023-08-01T19:54:29.676 INFO:teuthology.orchestra.run.smithi155.stdout: { 2023-08-01T19:54:29.676 INFO:teuthology.orchestra.run.smithi155.stdout: "event": "queued_for_pg", 2023-08-01T19:54:29.676 INFO:teuthology.orchestra.run.smithi155.stdout: "time": "2023-08-01T19:54:29.633643+0000", 2023-08-01T19:54:29.676 INFO:teuthology.orchestra.run.smithi155.stdout: "duration": 5.4419999999999997e-06 2023-08-01T19:54:29.677 INFO:teuthology.orchestra.run.smithi155.stdout: }, 2023-08-01T19:54:29.677 INFO:teuthology.orchestra.run.smithi155.stdout: { 2023-08-01T19:54:29.677 INFO:teuthology.orchestra.run.smithi155.stdout: "event": "reached_pg", 2023-08-01T19:54:29.677 INFO:teuthology.orchestra.run.smithi155.stdout: "time": "2023-08-01T19:54:29.633670+0000", 2023-08-01T19:54:29.677 INFO:teuthology.orchestra.run.smithi155.stdout: "duration": 2.6551e-05 2023-08-01T19:54:29.677 INFO:teuthology.orchestra.run.smithi155.stdout: }, 2023-08-01T19:54:29.677 INFO:teuthology.orchestra.run.smithi155.stdout: { 2023-08-01T19:54:29.677 INFO:teuthology.orchestra.run.smithi155.stdout: "event": "started", 2023-08-01T19:54:29.678 INFO:teuthology.orchestra.run.smithi155.stdout: "time": "2023-08-01T19:54:29.633749+0000", 2023-08-01T19:54:29.678 INFO:teuthology.orchestra.run.smithi155.stdout: "duration": 7.9580999999999996e-05 2023-08-01T19:54:29.678 INFO:teuthology.orchestra.run.smithi155.stdout: }, 2023-08-01T19:54:29.678 INFO:teuthology.orchestra.run.smithi155.stdout: { 2023-08-01T19:54:29.678 INFO:teuthology.orchestra.run.smithi155.stdout: "event": "waiting for subops from 0", 2023-08-01T19:54:29.678 INFO:teuthology.orchestra.run.smithi155.stdout: "time": "2023-08-01T19:54:29.633831+0000", 2023-08-01T19:54:29.678 INFO:teuthology.orchestra.run.smithi155.stdout: "duration": 8.1038999999999994e-05 2023-08-01T19:54:29.678 INFO:teuthology.orchestra.run.smithi155.stdout: }, 2023-08-01T19:54:29.679 INFO:teuthology.orchestra.run.smithi155.stdout: { 2023-08-01T19:54:29.679 INFO:teuthology.orchestra.run.smithi155.stdout: "event": "sub_op_commit_rec", 2023-08-01T19:54:29.679 INFO:teuthology.orchestra.run.smithi155.stdout: "time": "2023-08-01T19:54:29.635902+0000", 2023-08-01T19:54:29.679 INFO:teuthology.orchestra.run.smithi155.stdout: "duration": 0.0020711319999999998 2023-08-01T19:54:29.679 INFO:teuthology.orchestra.run.smithi155.stdout: }, 2023-08-01T19:54:29.679 INFO:teuthology.orchestra.run.smithi155.stdout: { 2023-08-01T19:54:29.679 INFO:teuthology.orchestra.run.smithi155.stdout: "event": "op_commit", 2023-08-01T19:54:29.679 INFO:teuthology.orchestra.run.smithi155.stdout: "time": "2023-08-01T19:54:29.637691+0000", 2023-08-01T19:54:29.680 INFO:teuthology.orchestra.run.smithi155.stdout: "duration": 0.001789541 2023-08-01T19:54:29.680 INFO:teuthology.orchestra.run.smithi155.stdout: } 2023-08-01T19:54:29.680 INFO:teuthology.orchestra.run.smithi155.stdout: ] 2023-08-01T19:54:29.680 INFO:teuthology.orchestra.run.smithi155.stdout: } 2023-08-01T19:54:29.680 INFO:teuthology.orchestra.run.smithi155.stdout: }, 2023-08-01T19:54:29.680 INFO:teuthology.orchestra.run.smithi155.stdout: { 2023-08-01T19:54:29.680 INFO:teuthology.orchestra.run.smithi155.stdout: "description": "osd_op(client.4668.0:20480 5.e 5:7d3f6f26:::benchmark_data_smithi006_114134_object20479:head [set-alloc-hint object_size 65536 write_size 65536,write 0~65536 in=65536b] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e23)", 2023-08-01T19:54:29.681 INFO:teuthology.orchestra.run.smithi155.stdout: "initiated_at": "2023-08-01T19:54:29.633653+0000", 2023-08-01T19:54:29.681 INFO:teuthology.orchestra.run.smithi155.stdout: "age": 0.0037615919999999998, 2023-08-01T19:54:29.681 INFO:teuthology.orchestra.run.smithi155.stdout: "duration": 0.0041182440000000001, 2023-08-01T19:54:29.681 INFO:teuthology.orchestra.run.smithi155.stdout: "type_data": { 2023-08-01T19:54:29.681 INFO:teuthology.orchestra.run.smithi155.stdout: "flag_point": "waiting for sub ops", 2023-08-01T19:54:29.681 INFO:teuthology.orchestra.run.smithi155.stdout: "client_info": { 2023-08-01T19:54:29.681 INFO:teuthology.orchestra.run.smithi155.stdout: "client": "client.4668", 2023-08-01T19:54:29.681 INFO:teuthology.orchestra.run.smithi155.stdout: "client_addr": "172.21.15.6:0/1709472247", 2023-08-01T19:54:29.682 INFO:teuthology.orchestra.run.smithi155.stdout: "tid": 20480 2023-08-01T19:54:29.682 INFO:teuthology.orchestra.run.smithi155.stdout: }, 2023-08-01T19:54:29.682 INFO:teuthology.orchestra.run.smithi155.stdout: "events": [ 2023-08-01T19:54:29.682 INFO:teuthology.orchestra.run.smithi155.stdout: { 2023-08-01T19:54:29.682 INFO:teuthology.orchestra.run.smithi155.stdout: "event": "initiated", 2023-08-01T19:54:29.682 INFO:teuthology.orchestra.run.smithi155.stdout: "time": "2023-08-01T19:54:29.633653+0000", 2023-08-01T19:54:29.682 INFO:teuthology.orchestra.run.smithi155.stdout: "duration": 0 2023-08-01T19:54:29.682 INFO:teuthology.orchestra.run.smithi155.stdout: }, 2023-08-01T19:54:29.683 INFO:teuthology.orchestra.run.smithi155.stdout: { 2023-08-01T19:54:29.683 INFO:teuthology.orchestra.run.smithi155.stdout: "event": "throttled", 2023-08-01T19:54:29.683 INFO:teuthology.orchestra.run.smithi155.stdout: "time": "2023-08-01T19:54:29.633653+0000", 2023-08-01T19:54:29.683 INFO:teuthology.orchestra.run.smithi155.stdout: "duration": 0 2023-08-01T19:54:29.683 INFO:teuthology.orchestra.run.smithi155.stdout: }, 2023-08-01T19:54:29.683 INFO:teuthology.orchestra.run.smithi155.stdout: { 2023-08-01T19:54:29.683 INFO:teuthology.orchestra.run.smithi155.stdout: "event": "header_read", 2023-08-01T19:54:29.683 INFO:teuthology.orchestra.run.smithi155.stdout: "time": "2023-08-01T19:54:29.633653+0000", 2023-08-01T19:54:29.684 INFO:teuthology.orchestra.run.smithi155.stdout: "duration": 4294967295.9999995 2023-08-01T19:54:29.684 INFO:teuthology.orchestra.run.smithi155.stdout: }, 2023-08-01T19:54:29.684 INFO:teuthology.orchestra.run.smithi155.stdout: { 2023-08-01T19:54:29.684 INFO:teuthology.orchestra.run.smithi155.stdout: "event": "all_read", 2023-08-01T19:54:29.684 INFO:teuthology.orchestra.run.smithi155.stdout: "time": "2023-08-01T19:54:29.633751+0000", 2023-08-01T19:54:29.684 INFO:teuthology.orchestra.run.smithi155.stdout: "duration": 9.7918000000000007e-05 2023-08-01T19:54:29.684 INFO:teuthology.orchestra.run.smithi155.stdout: }, 2023-08-01T19:54:29.684 INFO:teuthology.orchestra.run.smithi155.stdout: { 2023-08-01T19:54:29.685 INFO:teuthology.orchestra.run.smithi155.stdout: "event": "dispatched", 2023-08-01T19:54:29.685 INFO:teuthology.orchestra.run.smithi155.stdout: "time": "2023-08-01T19:54:29.633767+0000", 2023-08-01T19:54:29.685 INFO:teuthology.orchestra.run.smithi155.stdout: "duration": 1.6424000000000001e-05 2023-08-01T19:54:29.685 INFO:teuthology.orchestra.run.smithi155.stdout: }, 2023-08-01T19:54:29.685 INFO:teuthology.orchestra.run.smithi155.stdout: { 2023-08-01T19:54:29.685 INFO:teuthology.orchestra.run.smithi155.stdout: "event": "queued_for_pg", 2023-08-01T19:54:29.685 INFO:teuthology.orchestra.run.smithi155.stdout: "time": "2023-08-01T19:54:29.633779+0000", 2023-08-01T19:54:29.685 INFO:teuthology.orchestra.run.smithi155.stdout: "duration": 1.1817999999999999e-05 2023-08-01T19:54:29.686 INFO:teuthology.orchestra.run.smithi155.stdout: }, 2023-08-01T19:54:29.686 INFO:teuthology.orchestra.run.smithi155.stdout: { 2023-08-01T19:54:29.686 INFO:teuthology.orchestra.run.smithi155.stdout: "event": "reached_pg", 2023-08-01T19:54:29.686 INFO:teuthology.orchestra.run.smithi155.stdout: "time": "2023-08-01T19:54:29.634712+0000", 2023-08-01T19:54:29.686 INFO:teuthology.orchestra.run.smithi155.stdout: "duration": 0.00093285199999999997 2023-08-01T19:54:29.686 INFO:teuthology.orchestra.run.smithi155.stdout: }, 2023-08-01T19:54:29.686 INFO:teuthology.orchestra.run.smithi155.stdout: { 2023-08-01T19:54:29.686 INFO:teuthology.orchestra.run.smithi155.stdout: "event": "started", 2023-08-01T19:54:29.687 INFO:teuthology.orchestra.run.smithi155.stdout: "time": "2023-08-01T19:54:29.634829+0000", 2023-08-01T19:54:29.687 INFO:teuthology.orchestra.run.smithi155.stdout: "duration": 0.00011707 2023-08-01T19:54:29.687 INFO:teuthology.orchestra.run.smithi155.stdout: }, 2023-08-01T19:54:29.687 INFO:teuthology.orchestra.run.smithi155.stdout: { 2023-08-01T19:54:29.687 INFO:teuthology.orchestra.run.smithi155.stdout: "event": "waiting for subops from 0", 2023-08-01T19:54:29.687 INFO:teuthology.orchestra.run.smithi155.stdout: "time": "2023-08-01T19:54:29.634943+0000", 2023-08-01T19:54:29.687 INFO:teuthology.orchestra.run.smithi155.stdout: "duration": 0.000114336 2023-08-01T19:54:29.687 INFO:teuthology.orchestra.run.smithi155.stdout: }, 2023-08-01T19:54:29.688 INFO:teuthology.orchestra.run.smithi155.stdout: { 2023-08-01T19:54:29.688 INFO:teuthology.orchestra.run.smithi155.stdout: "event": "sub_op_commit_rec", 2023-08-01T19:54:29.688 INFO:teuthology.orchestra.run.smithi155.stdout: "time": "2023-08-01T19:54:29.636358+0000", 2023-08-01T19:54:29.688 INFO:teuthology.orchestra.run.smithi155.stdout: "duration": 0.001414806 2023-08-01T19:54:29.688 INFO:teuthology.orchestra.run.smithi155.stdout: } 2023-08-01T19:54:29.688 INFO:teuthology.orchestra.run.smithi155.stdout: ] 2023-08-01T19:54:29.688 INFO:teuthology.orchestra.run.smithi155.stdout: } 2023-08-01T19:54:29.689 INFO:teuthology.orchestra.run.smithi155.stdout: }, 2023-08-01T19:54:29.689 INFO:teuthology.orchestra.run.smithi155.stdout: { 2023-08-01T19:54:29.689 INFO:teuthology.orchestra.run.smithi155.stdout: "description": "osd_op(client.4668.0:20484 5.d 5:bc6cebef:::benchmark_data_smithi006_114134_object20483:head [set-alloc-hint object_size 65536 write_size 65536,write 0~65536 in=65536b] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e23)", 2023-08-01T19:54:29.689 INFO:teuthology.orchestra.run.smithi155.stdout: "initiated_at": "2023-08-01T19:54:29.633797+0000", 2023-08-01T19:54:29.689 INFO:teuthology.orchestra.run.smithi155.stdout: "age": 0.003617875, 2023-08-01T19:54:29.689 INFO:teuthology.orchestra.run.smithi155.stdout: "duration": 0.0040323939999999999, 2023-08-01T19:54:29.689 INFO:teuthology.orchestra.run.smithi155.stdout: "type_data": { 2023-08-01T19:54:29.689 INFO:teuthology.orchestra.run.smithi155.stdout: "flag_point": "waiting for sub ops", 2023-08-01T19:54:29.690 INFO:teuthology.orchestra.run.smithi155.stdout: "client_info": { 2023-08-01T19:54:29.690 INFO:teuthology.orchestra.run.smithi155.stdout: "client": "client.4668", 2023-08-01T19:54:29.690 INFO:teuthology.orchestra.run.smithi155.stdout: "client_addr": "172.21.15.6:0/1709472247", 2023-08-01T19:54:29.690 INFO:teuthology.orchestra.run.smithi155.stdout: "tid": 20484 2023-08-01T19:54:29.690 INFO:teuthology.orchestra.run.smithi155.stdout: }, 2023-08-01T19:54:29.690 INFO:teuthology.orchestra.run.smithi155.stdout: "events": [ 2023-08-01T19:54:29.690 INFO:teuthology.orchestra.run.smithi155.stdout: { 2023-08-01T19:54:29.690 INFO:teuthology.orchestra.run.smithi155.stdout: "event": "initiated", 2023-08-01T19:54:29.691 INFO:teuthology.orchestra.run.smithi155.stdout: "time": "2023-08-01T19:54:29.633797+0000", 2023-08-01T19:54:29.691 INFO:teuthology.orchestra.run.smithi155.stdout: "duration": 0 2023-08-01T19:54:29.691 INFO:teuthology.orchestra.run.smithi155.stdout: }, 2023-08-01T19:54:29.691 INFO:teuthology.orchestra.run.smithi155.stdout: { 2023-08-01T19:54:29.691 INFO:teuthology.orchestra.run.smithi155.stdout: "event": "throttled", 2023-08-01T19:54:29.691 INFO:teuthology.orchestra.run.smithi155.stdout: "time": "2023-08-01T19:54:29.633797+0000", 2023-08-01T19:54:29.691 INFO:teuthology.orchestra.run.smithi155.stdout: "duration": 0 2023-08-01T19:54:29.691 INFO:teuthology.orchestra.run.smithi155.stdout: }, 2023-08-01T19:54:29.692 INFO:teuthology.orchestra.run.smithi155.stdout: { 2023-08-01T19:54:29.692 INFO:teuthology.orchestra.run.smithi155.stdout: "event": "header_read", 2023-08-01T19:54:29.692 INFO:teuthology.orchestra.run.smithi155.stdout: "time": "2023-08-01T19:54:29.633796+0000", 2023-08-01T19:54:29.692 INFO:teuthology.orchestra.run.smithi155.stdout: "duration": 4294967295.9999995 2023-08-01T19:54:29.692 INFO:teuthology.orchestra.run.smithi155.stdout: }, 2023-08-01T19:54:29.692 INFO:teuthology.orchestra.run.smithi155.stdout: { 2023-08-01T19:54:29.692 INFO:teuthology.orchestra.run.smithi155.stdout: "event": "all_read", 2023-08-01T19:54:29.692 INFO:teuthology.orchestra.run.smithi155.stdout: "time": "2023-08-01T19:54:29.633842+0000", 2023-08-01T19:54:29.693 INFO:teuthology.orchestra.run.smithi155.stdout: "duration": 4.5525999999999997e-05 2023-08-01T19:54:29.693 INFO:teuthology.orchestra.run.smithi155.stdout: }, 2023-08-01T19:54:29.693 INFO:teuthology.orchestra.run.smithi155.stdout: { 2023-08-01T19:54:29.693 INFO:teuthology.orchestra.run.smithi155.stdout: "event": "dispatched", 2023-08-01T19:54:29.693 INFO:teuthology.orchestra.run.smithi155.stdout: "time": "2023-08-01T19:54:29.633853+0000", 2023-08-01T19:54:29.693 INFO:teuthology.orchestra.run.smithi155.stdout: "duration": 1.1511e-05 2023-08-01T19:54:29.693 INFO:teuthology.orchestra.run.smithi155.stdout: }, 2023-08-01T19:54:29.693 INFO:teuthology.orchestra.run.smithi155.stdout: { 2023-08-01T19:54:29.694 INFO:teuthology.orchestra.run.smithi155.stdout: "event": "queued_for_pg", 2023-08-01T19:54:29.694 INFO:teuthology.orchestra.run.smithi155.stdout: "time": "2023-08-01T19:54:29.633858+0000", 2023-08-01T19:54:29.694 INFO:teuthology.orchestra.run.smithi155.stdout: "duration": 4.741e-06 2023-08-01T19:54:29.694 INFO:teuthology.orchestra.run.smithi155.stdout: }, 2023-08-01T19:54:29.694 INFO:teuthology.orchestra.run.smithi155.stdout: { 2023-08-01T19:54:29.694 INFO:teuthology.orchestra.run.smithi155.stdout: "event": "reached_pg", 2023-08-01T19:54:29.694 INFO:teuthology.orchestra.run.smithi155.stdout: "time": "2023-08-01T19:54:29.633897+0000", 2023-08-01T19:54:29.694 INFO:teuthology.orchestra.run.smithi155.stdout: "duration": 3.8461000000000003e-05 2023-08-01T19:54:29.695 INFO:teuthology.orchestra.run.smithi155.stdout: }, 2023-08-01T19:54:29.695 INFO:teuthology.orchestra.run.smithi155.stdout: { 2023-08-01T19:54:29.695 INFO:teuthology.orchestra.run.smithi155.stdout: "event": "started", 2023-08-01T19:54:29.695 INFO:teuthology.orchestra.run.smithi155.stdout: "time": "2023-08-01T19:54:29.633983+0000", 2023-08-01T19:54:29.695 INFO:teuthology.orchestra.run.smithi155.stdout: "duration": 8.6287999999999998e-05 2023-08-01T19:54:29.695 INFO:teuthology.orchestra.run.smithi155.stdout: }, 2023-08-01T19:54:29.695 INFO:teuthology.orchestra.run.smithi155.stdout: { 2023-08-01T19:54:29.695 INFO:teuthology.orchestra.run.smithi155.stdout: "event": "waiting for subops from 1", 2023-08-01T19:54:29.696 INFO:teuthology.orchestra.run.smithi155.stdout: "time": "2023-08-01T19:54:29.634092+0000", 2023-08-01T19:54:29.696 INFO:teuthology.orchestra.run.smithi155.stdout: "duration": 0.000109147 2023-08-01T19:54:29.696 INFO:teuthology.orchestra.run.smithi155.stdout: }, 2023-08-01T19:54:29.696 INFO:teuthology.orchestra.run.smithi155.stdout: { 2023-08-01T19:54:29.696 INFO:teuthology.orchestra.run.smithi155.stdout: "event": "op_commit", 2023-08-01T19:54:29.696 INFO:teuthology.orchestra.run.smithi155.stdout: "time": "2023-08-01T19:54:29.637658+0000", 2023-08-01T19:54:29.696 INFO:teuthology.orchestra.run.smithi155.stdout: "duration": 0.003565576 2023-08-01T19:54:29.697 INFO:teuthology.orchestra.run.smithi155.stdout: } 2023-08-01T19:54:29.697 INFO:teuthology.orchestra.run.smithi155.stdout: ] 2023-08-01T19:54:29.697 INFO:teuthology.orchestra.run.smithi155.stdout: } 2023-08-01T19:54:29.697 INFO:teuthology.orchestra.run.smithi155.stdout: }, 2023-08-01T19:54:29.697 INFO:teuthology.orchestra.run.smithi155.stdout: { 2023-08-01T19:54:29.697 INFO:teuthology.orchestra.run.smithi155.stdout: "description": "osd_op(client.4668.0:20485 5.e 5:70f9d295:::benchmark_data_smithi006_114134_object20484:head [set-alloc-hint object_size 65536 write_size 65536,write 0~65536 in=65536b] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e23)", 2023-08-01T19:54:29.697 INFO:teuthology.orchestra.run.smithi155.stdout: "initiated_at": "2023-08-01T19:54:29.636329+0000", 2023-08-01T19:54:29.697 INFO:teuthology.orchestra.run.smithi155.stdout: "age": 0.0010858370000000001, 2023-08-01T19:54:29.698 INFO:teuthology.orchestra.run.smithi155.stdout: "duration": 0.001549073, 2023-08-01T19:54:29.698 INFO:teuthology.orchestra.run.smithi155.stdout: "type_data": { 2023-08-01T19:54:29.698 INFO:teuthology.orchestra.run.smithi155.stdout: "flag_point": "waiting for sub ops", 2023-08-01T19:54:29.698 INFO:teuthology.orchestra.run.smithi155.stdout: "client_info": { 2023-08-01T19:54:29.698 INFO:teuthology.orchestra.run.smithi155.stdout: "client": "client.4668", 2023-08-01T19:54:29.698 INFO:teuthology.orchestra.run.smithi155.stdout: "client_addr": "172.21.15.6:0/1709472247", 2023-08-01T19:54:29.698 INFO:teuthology.orchestra.run.smithi155.stdout: "tid": 20485 2023-08-01T19:54:29.698 INFO:teuthology.orchestra.run.smithi155.stdout: }, 2023-08-01T19:54:29.699 INFO:teuthology.orchestra.run.smithi155.stdout: "events": [ 2023-08-01T19:54:29.699 INFO:teuthology.orchestra.run.smithi155.stdout: { 2023-08-01T19:54:29.699 INFO:teuthology.orchestra.run.smithi155.stdout: "event": "initiated", 2023-08-01T19:54:29.699 INFO:teuthology.orchestra.run.smithi155.stdout: "time": "2023-08-01T19:54:29.636329+0000", 2023-08-01T19:54:29.699 INFO:teuthology.orchestra.run.smithi155.stdout: "duration": 0 2023-08-01T19:54:29.699 INFO:teuthology.orchestra.run.smithi155.stdout: }, 2023-08-01T19:54:29.699 INFO:teuthology.orchestra.run.smithi155.stdout: { 2023-08-01T19:54:29.699 INFO:teuthology.orchestra.run.smithi155.stdout: "event": "throttled", 2023-08-01T19:54:29.700 INFO:teuthology.orchestra.run.smithi155.stdout: "time": "2023-08-01T19:54:29.636329+0000", 2023-08-01T19:54:29.700 INFO:teuthology.orchestra.run.smithi155.stdout: "duration": 0 2023-08-01T19:54:29.700 INFO:teuthology.orchestra.run.smithi155.stdout: }, 2023-08-01T19:54:29.700 INFO:teuthology.orchestra.run.smithi155.stdout: { 2023-08-01T19:54:29.700 INFO:teuthology.orchestra.run.smithi155.stdout: "event": "header_read", 2023-08-01T19:54:29.700 INFO:teuthology.orchestra.run.smithi155.stdout: "time": "2023-08-01T19:54:29.636328+0000", 2023-08-01T19:54:29.700 INFO:teuthology.orchestra.run.smithi155.stdout: "duration": 4294967295.999999 2023-08-01T19:54:29.700 INFO:teuthology.orchestra.run.smithi155.stdout: }, 2023-08-01T19:54:29.701 INFO:teuthology.orchestra.run.smithi155.stdout: { 2023-08-01T19:54:29.701 INFO:teuthology.orchestra.run.smithi155.stdout: "event": "all_read", 2023-08-01T19:54:29.701 INFO:teuthology.orchestra.run.smithi155.stdout: "time": "2023-08-01T19:54:29.636439+0000", 2023-08-01T19:54:29.701 INFO:teuthology.orchestra.run.smithi155.stdout: "duration": 0.00011074 2023-08-01T19:54:29.701 INFO:teuthology.orchestra.run.smithi155.stdout: }, 2023-08-01T19:54:29.701 INFO:teuthology.orchestra.run.smithi155.stdout: { 2023-08-01T19:54:29.701 INFO:teuthology.orchestra.run.smithi155.stdout: "event": "dispatched", 2023-08-01T19:54:29.701 INFO:teuthology.orchestra.run.smithi155.stdout: "time": "2023-08-01T19:54:29.636449+0000", 2023-08-01T19:54:29.702 INFO:teuthology.orchestra.run.smithi155.stdout: "duration": 9.9240000000000002e-06 2023-08-01T19:54:29.702 INFO:teuthology.orchestra.run.smithi155.stdout: }, 2023-08-01T19:54:29.702 INFO:teuthology.orchestra.run.smithi155.stdout: { 2023-08-01T19:54:29.702 INFO:teuthology.orchestra.run.smithi155.stdout: "event": "queued_for_pg", 2023-08-01T19:54:29.702 INFO:teuthology.orchestra.run.smithi155.stdout: "time": "2023-08-01T19:54:29.636453+0000", 2023-08-01T19:54:29.702 INFO:teuthology.orchestra.run.smithi155.stdout: "duration": 4.3069999999999996e-06 2023-08-01T19:54:29.702 INFO:teuthology.orchestra.run.smithi155.stdout: }, 2023-08-01T19:54:29.702 INFO:teuthology.orchestra.run.smithi155.stdout: { 2023-08-01T19:54:29.703 INFO:teuthology.orchestra.run.smithi155.stdout: "event": "reached_pg", 2023-08-01T19:54:29.703 INFO:teuthology.orchestra.run.smithi155.stdout: "time": "2023-08-01T19:54:29.636486+0000", 2023-08-01T19:54:29.703 INFO:teuthology.orchestra.run.smithi155.stdout: "duration": 3.2577999999999999e-05 2023-08-01T19:54:29.703 INFO:teuthology.orchestra.run.smithi155.stdout: }, 2023-08-01T19:54:29.703 INFO:teuthology.orchestra.run.smithi155.stdout: { 2023-08-01T19:54:29.703 INFO:teuthology.orchestra.run.smithi155.stdout: "event": "started", 2023-08-01T19:54:29.703 INFO:teuthology.orchestra.run.smithi155.stdout: "time": "2023-08-01T19:54:29.636601+0000", 2023-08-01T19:54:29.703 INFO:teuthology.orchestra.run.smithi155.stdout: "duration": 0.000115245 2023-08-01T19:54:29.704 INFO:teuthology.orchestra.run.smithi155.stdout: }, 2023-08-01T19:54:29.704 INFO:teuthology.orchestra.run.smithi155.stdout: { 2023-08-01T19:54:29.704 INFO:teuthology.orchestra.run.smithi155.stdout: "event": "waiting for subops from 0", 2023-08-01T19:54:29.704 INFO:teuthology.orchestra.run.smithi155.stdout: "time": "2023-08-01T19:54:29.636734+0000", 2023-08-01T19:54:29.704 INFO:teuthology.orchestra.run.smithi155.stdout: "duration": 0.00013340800000000001 2023-08-01T19:54:29.704 INFO:teuthology.orchestra.run.smithi155.stdout: } 2023-08-01T19:54:29.704 INFO:teuthology.orchestra.run.smithi155.stdout: ] 2023-08-01T19:54:29.705 INFO:teuthology.orchestra.run.smithi155.stdout: } 2023-08-01T19:54:29.705 INFO:teuthology.orchestra.run.smithi155.stdout: }, 2023-08-01T19:54:29.705 INFO:teuthology.orchestra.run.smithi155.stdout: { 2023-08-01T19:54:29.705 INFO:teuthology.orchestra.run.smithi155.stdout: "description": "osd_op(client.4668.0:20487 5.d 5:b35bd6e5:::benchmark_data_smithi006_114134_object20486:head [set-alloc-hint object_size 65536 write_size 65536,write 0~65536 in=65536b] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e23)", 2023-08-01T19:54:29.705 INFO:teuthology.orchestra.run.smithi155.stdout: "initiated_at": "2023-08-01T19:54:29.636494+0000", 2023-08-01T19:54:29.705 INFO:teuthology.orchestra.run.smithi155.stdout: "age": 0.00092101900000000003, 2023-08-01T19:54:29.705 INFO:teuthology.orchestra.run.smithi155.stdout: "duration": 0.0014269249999999999, 2023-08-01T19:54:29.705 INFO:teuthology.orchestra.run.smithi155.stdout: "type_data": { 2023-08-01T19:54:29.706 INFO:teuthology.orchestra.run.smithi155.stdout: "flag_point": "waiting for sub ops", 2023-08-01T19:54:29.706 INFO:teuthology.orchestra.run.smithi155.stdout: "client_info": { 2023-08-01T19:54:29.706 INFO:teuthology.orchestra.run.smithi155.stdout: "client": "client.4668", 2023-08-01T19:54:29.706 INFO:teuthology.orchestra.run.smithi155.stdout: "client_addr": "172.21.15.6:0/1709472247", 2023-08-01T19:54:29.706 INFO:teuthology.orchestra.run.smithi155.stdout: "tid": 20487 2023-08-01T19:54:29.706 INFO:teuthology.orchestra.run.smithi155.stdout: }, 2023-08-01T19:54:29.706 INFO:teuthology.orchestra.run.smithi155.stdout: "events": [ 2023-08-01T19:54:29.706 INFO:teuthology.orchestra.run.smithi155.stdout: { 2023-08-01T19:54:29.707 INFO:teuthology.orchestra.run.smithi155.stdout: "event": "initiated", 2023-08-01T19:54:29.707 INFO:teuthology.orchestra.run.smithi155.stdout: "time": "2023-08-01T19:54:29.636494+0000", 2023-08-01T19:54:29.707 INFO:teuthology.orchestra.run.smithi155.stdout: "duration": 0 2023-08-01T19:54:29.707 INFO:teuthology.orchestra.run.smithi155.stdout: }, 2023-08-01T19:54:29.707 INFO:teuthology.orchestra.run.smithi155.stdout: { 2023-08-01T19:54:29.707 INFO:teuthology.orchestra.run.smithi155.stdout: "event": "throttled", 2023-08-01T19:54:29.707 INFO:teuthology.orchestra.run.smithi155.stdout: "time": "2023-08-01T19:54:29.636494+0000", 2023-08-01T19:54:29.707 INFO:teuthology.orchestra.run.smithi155.stdout: "duration": 0 2023-08-01T19:54:29.708 INFO:teuthology.orchestra.run.smithi155.stdout: }, 2023-08-01T19:54:29.708 INFO:teuthology.orchestra.run.smithi155.stdout: { 2023-08-01T19:54:29.708 INFO:teuthology.orchestra.run.smithi155.stdout: "event": "header_read", 2023-08-01T19:54:29.708 INFO:teuthology.orchestra.run.smithi155.stdout: "time": "2023-08-01T19:54:29.636493+0000", 2023-08-01T19:54:29.708 INFO:teuthology.orchestra.run.smithi155.stdout: "duration": 4294967295.999999 2023-08-01T19:54:29.708 INFO:teuthology.orchestra.run.smithi155.stdout: }, 2023-08-01T19:54:29.708 INFO:teuthology.orchestra.run.smithi155.stdout: { 2023-08-01T19:54:29.709 INFO:teuthology.orchestra.run.smithi155.stdout: "event": "all_read", 2023-08-01T19:54:29.709 INFO:teuthology.orchestra.run.smithi155.stdout: "time": "2023-08-01T19:54:29.636554+0000", 2023-08-01T19:54:29.709 INFO:teuthology.orchestra.run.smithi155.stdout: "duration": 6.0315000000000001e-05 2023-08-01T19:54:29.709 INFO:teuthology.orchestra.run.smithi155.stdout: }, 2023-08-01T19:54:29.709 INFO:teuthology.orchestra.run.smithi155.stdout: { 2023-08-01T19:54:29.709 INFO:teuthology.orchestra.run.smithi155.stdout: "event": "dispatched", 2023-08-01T19:54:29.709 INFO:teuthology.orchestra.run.smithi155.stdout: "time": "2023-08-01T19:54:29.636559+0000", 2023-08-01T19:54:29.709 INFO:teuthology.orchestra.run.smithi155.stdout: "duration": 5.5450000000000003e-06 2023-08-01T19:54:29.710 INFO:teuthology.orchestra.run.smithi155.stdout: }, 2023-08-01T19:54:29.710 INFO:teuthology.orchestra.run.smithi155.stdout: { 2023-08-01T19:54:29.710 INFO:teuthology.orchestra.run.smithi155.stdout: "event": "queued_for_pg", 2023-08-01T19:54:29.710 INFO:teuthology.orchestra.run.smithi155.stdout: "time": "2023-08-01T19:54:29.636562+0000", 2023-08-01T19:54:29.710 INFO:teuthology.orchestra.run.smithi155.stdout: "duration": 3.0299999999999998e-06 2023-08-01T19:54:29.710 INFO:teuthology.orchestra.run.smithi155.stdout: }, 2023-08-01T19:54:29.710 INFO:teuthology.orchestra.run.smithi155.stdout: { 2023-08-01T19:54:29.710 INFO:teuthology.orchestra.run.smithi155.stdout: "event": "reached_pg", 2023-08-01T19:54:29.711 INFO:teuthology.orchestra.run.smithi155.stdout: "time": "2023-08-01T19:54:29.636594+0000", 2023-08-01T19:54:29.711 INFO:teuthology.orchestra.run.smithi155.stdout: "duration": 3.2379999999999998e-05 2023-08-01T19:54:29.711 INFO:teuthology.orchestra.run.smithi155.stdout: }, 2023-08-01T19:54:29.711 INFO:teuthology.orchestra.run.smithi155.stdout: { 2023-08-01T19:54:29.711 INFO:teuthology.orchestra.run.smithi155.stdout: "event": "started", 2023-08-01T19:54:29.711 INFO:teuthology.orchestra.run.smithi155.stdout: "time": "2023-08-01T19:54:29.636663+0000", 2023-08-01T19:54:29.711 INFO:teuthology.orchestra.run.smithi155.stdout: "duration": 6.8907999999999998e-05 2023-08-01T19:54:29.711 INFO:teuthology.orchestra.run.smithi155.stdout: }, 2023-08-01T19:54:29.712 INFO:teuthology.orchestra.run.smithi155.stdout: { 2023-08-01T19:54:29.712 INFO:teuthology.orchestra.run.smithi155.stdout: "event": "waiting for subops from 1", 2023-08-01T19:54:29.712 INFO:teuthology.orchestra.run.smithi155.stdout: "time": "2023-08-01T19:54:29.636738+0000", 2023-08-01T19:54:29.712 INFO:teuthology.orchestra.run.smithi155.stdout: "duration": 7.4962999999999994e-05 2023-08-01T19:54:29.712 INFO:teuthology.orchestra.run.smithi155.stdout: } 2023-08-01T19:54:29.712 INFO:teuthology.orchestra.run.smithi155.stdout: ] 2023-08-01T19:54:29.712 INFO:teuthology.orchestra.run.smithi155.stdout: } 2023-08-01T19:54:29.713 INFO:teuthology.orchestra.run.smithi155.stdout: }, 2023-08-01T19:54:29.713 INFO:teuthology.orchestra.run.smithi155.stdout: { 2023-08-01T19:54:29.713 INFO:teuthology.orchestra.run.smithi155.stdout: "description": "osd_op(client.4668.0:20489 5.0 5:0a9c7baf:::benchmark_data_smithi006_114134_object20488:head [set-alloc-hint object_size 65536 write_size 65536,write 0~65536 in=65536b] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e23)", 2023-08-01T19:54:29.713 INFO:teuthology.orchestra.run.smithi155.stdout: "initiated_at": "2023-08-01T19:54:29.637756+0000", 2023-08-01T19:54:29.713 INFO:teuthology.orchestra.run.smithi155.stdout: "age": 4294967295.9996595, 2023-08-01T19:54:29.713 INFO:teuthology.orchestra.run.smithi155.stdout: "duration": 0.00023131200000000001, 2023-08-01T19:54:29.713 INFO:teuthology.orchestra.run.smithi155.stdout: "type_data": { 2023-08-01T19:54:29.713 INFO:teuthology.orchestra.run.smithi155.stdout: "flag_point": "started", 2023-08-01T19:54:29.714 INFO:teuthology.orchestra.run.smithi155.stdout: "client_info": { 2023-08-01T19:54:29.714 INFO:teuthology.orchestra.run.smithi155.stdout: "client": "client.4668", 2023-08-01T19:54:29.714 INFO:teuthology.orchestra.run.smithi155.stdout: "client_addr": "172.21.15.6:0/1709472247", 2023-08-01T19:54:29.714 INFO:teuthology.orchestra.run.smithi155.stdout: "tid": 20489 2023-08-01T19:54:29.714 INFO:teuthology.orchestra.run.smithi155.stdout: }, 2023-08-01T19:54:29.714 INFO:teuthology.orchestra.run.smithi155.stdout: "events": [ 2023-08-01T19:54:29.714 INFO:teuthology.orchestra.run.smithi155.stdout: { 2023-08-01T19:54:29.714 INFO:teuthology.orchestra.run.smithi155.stdout: "event": "initiated", 2023-08-01T19:54:29.715 INFO:teuthology.orchestra.run.smithi155.stdout: "time": "2023-08-01T19:54:29.637756+0000", 2023-08-01T19:54:29.715 INFO:teuthology.orchestra.run.smithi155.stdout: "duration": 0 2023-08-01T19:54:29.715 INFO:teuthology.orchestra.run.smithi155.stdout: }, 2023-08-01T19:54:29.715 INFO:teuthology.orchestra.run.smithi155.stdout: { 2023-08-01T19:54:29.715 INFO:teuthology.orchestra.run.smithi155.stdout: "event": "throttled", 2023-08-01T19:54:29.715 INFO:teuthology.orchestra.run.smithi155.stdout: "time": "2023-08-01T19:54:29.637756+0000", 2023-08-01T19:54:29.715 INFO:teuthology.orchestra.run.smithi155.stdout: "duration": 0 2023-08-01T19:54:29.715 INFO:teuthology.orchestra.run.smithi155.stdout: }, 2023-08-01T19:54:29.716 INFO:teuthology.orchestra.run.smithi155.stdout: { 2023-08-01T19:54:29.716 INFO:teuthology.orchestra.run.smithi155.stdout: "event": "header_read", 2023-08-01T19:54:29.716 INFO:teuthology.orchestra.run.smithi155.stdout: "time": "2023-08-01T19:54:29.637755+0000", 2023-08-01T19:54:29.716 INFO:teuthology.orchestra.run.smithi155.stdout: "duration": 4294967295.999999 2023-08-01T19:54:29.716 INFO:teuthology.orchestra.run.smithi155.stdout: }, 2023-08-01T19:54:29.716 INFO:teuthology.orchestra.run.smithi155.stdout: { 2023-08-01T19:54:29.716 INFO:teuthology.orchestra.run.smithi155.stdout: "event": "all_read", 2023-08-01T19:54:29.717 INFO:teuthology.orchestra.run.smithi155.stdout: "time": "2023-08-01T19:54:29.637820+0000", 2023-08-01T19:54:29.717 INFO:teuthology.orchestra.run.smithi155.stdout: "duration": 6.4943000000000005e-05 2023-08-01T19:54:29.717 INFO:teuthology.orchestra.run.smithi155.stdout: }, 2023-08-01T19:54:29.717 INFO:teuthology.orchestra.run.smithi155.stdout: { 2023-08-01T19:54:29.717 INFO:teuthology.orchestra.run.smithi155.stdout: "event": "dispatched", 2023-08-01T19:54:29.717 INFO:teuthology.orchestra.run.smithi155.stdout: "time": "2023-08-01T19:54:29.637832+0000", 2023-08-01T19:54:29.717 INFO:teuthology.orchestra.run.smithi155.stdout: "duration": 1.203e-05 2023-08-01T19:54:29.717 INFO:teuthology.orchestra.run.smithi155.stdout: }, 2023-08-01T19:54:29.718 INFO:teuthology.orchestra.run.smithi155.stdout: { 2023-08-01T19:54:29.718 INFO:teuthology.orchestra.run.smithi155.stdout: "event": "queued_for_pg", 2023-08-01T19:54:29.718 INFO:teuthology.orchestra.run.smithi155.stdout: "time": "2023-08-01T19:54:29.637839+0000", 2023-08-01T19:54:29.718 INFO:teuthology.orchestra.run.smithi155.stdout: "duration": 7.5349999999999999e-06 2023-08-01T19:54:29.718 INFO:teuthology.orchestra.run.smithi155.stdout: }, 2023-08-01T19:54:29.718 INFO:teuthology.orchestra.run.smithi155.stdout: { 2023-08-01T19:54:29.718 INFO:teuthology.orchestra.run.smithi155.stdout: "event": "reached_pg", 2023-08-01T19:54:29.718 INFO:teuthology.orchestra.run.smithi155.stdout: "time": "2023-08-01T19:54:29.637864+0000", 2023-08-01T19:54:29.719 INFO:teuthology.orchestra.run.smithi155.stdout: "duration": 2.5236e-05 2023-08-01T19:54:29.719 INFO:teuthology.orchestra.run.smithi155.stdout: }, 2023-08-01T19:54:29.719 INFO:teuthology.orchestra.run.smithi155.stdout: { 2023-08-01T19:54:29.719 INFO:teuthology.orchestra.run.smithi155.stdout: "event": "started", 2023-08-01T19:54:29.719 INFO:teuthology.orchestra.run.smithi155.stdout: "time": "2023-08-01T19:54:29.637964+0000", 2023-08-01T19:54:29.719 INFO:teuthology.orchestra.run.smithi155.stdout: "duration": 9.9458999999999998e-05 2023-08-01T19:54:29.719 INFO:teuthology.orchestra.run.smithi155.stdout: } 2023-08-01T19:54:29.719 INFO:teuthology.orchestra.run.smithi155.stdout: ] 2023-08-01T19:54:29.720 INFO:teuthology.orchestra.run.smithi155.stdout: } 2023-08-01T19:54:29.720 INFO:teuthology.orchestra.run.smithi155.stdout: }, 2023-08-01T19:54:29.720 INFO:teuthology.orchestra.run.smithi155.stdout: { 2023-08-01T19:54:29.720 INFO:teuthology.orchestra.run.smithi155.stdout: "description": "osd_op(client.4668.0:20490 5.b 5:dbbd1eb6:::benchmark_data_smithi006_114134_object20489:head [set-alloc-hint object_size 65536 write_size 65536,write 0~65536 in=65536b] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e23)", 2023-08-01T19:54:29.720 INFO:teuthology.orchestra.run.smithi155.stdout: "initiated_at": "2023-08-01T19:54:29.637848+0000", 2023-08-01T19:54:29.720 INFO:teuthology.orchestra.run.smithi155.stdout: "age": 4294967295.999567, 2023-08-01T19:54:29.720 INFO:teuthology.orchestra.run.smithi155.stdout: "duration": 0.000221265, 2023-08-01T19:54:29.720 INFO:teuthology.orchestra.run.smithi155.stdout: "type_data": { 2023-08-01T19:54:29.721 INFO:teuthology.orchestra.run.smithi155.stdout: "flag_point": "reached pg", 2023-08-01T19:54:29.721 INFO:teuthology.orchestra.run.smithi155.stdout: "client_info": { 2023-08-01T19:54:29.721 INFO:teuthology.orchestra.run.smithi155.stdout: "client": "client.4668", 2023-08-01T19:54:29.721 INFO:teuthology.orchestra.run.smithi155.stdout: "client_addr": "172.21.15.6:0/1709472247", 2023-08-01T19:54:29.721 INFO:teuthology.orchestra.run.smithi155.stdout: "tid": 20490 2023-08-01T19:54:29.721 INFO:teuthology.orchestra.run.smithi155.stdout: }, 2023-08-01T19:54:29.721 INFO:teuthology.orchestra.run.smithi155.stdout: "events": [ 2023-08-01T19:54:29.722 INFO:teuthology.orchestra.run.smithi155.stdout: { 2023-08-01T19:54:29.722 INFO:teuthology.orchestra.run.smithi155.stdout: "event": "initiated", 2023-08-01T19:54:29.722 INFO:teuthology.orchestra.run.smithi155.stdout: "time": "2023-08-01T19:54:29.637848+0000", 2023-08-01T19:54:29.722 INFO:teuthology.orchestra.run.smithi155.stdout: "duration": 0 2023-08-01T19:54:29.722 INFO:teuthology.orchestra.run.smithi155.stdout: }, 2023-08-01T19:54:29.722 INFO:teuthology.orchestra.run.smithi155.stdout: { 2023-08-01T19:54:29.722 INFO:teuthology.orchestra.run.smithi155.stdout: "event": "throttled", 2023-08-01T19:54:29.722 INFO:teuthology.orchestra.run.smithi155.stdout: "time": "2023-08-01T19:54:29.637848+0000", 2023-08-01T19:54:29.723 INFO:teuthology.orchestra.run.smithi155.stdout: "duration": 0 2023-08-01T19:54:29.723 INFO:teuthology.orchestra.run.smithi155.stdout: }, 2023-08-01T19:54:29.723 INFO:teuthology.orchestra.run.smithi155.stdout: { 2023-08-01T19:54:29.723 INFO:teuthology.orchestra.run.smithi155.stdout: "event": "header_read", 2023-08-01T19:54:29.723 INFO:teuthology.orchestra.run.smithi155.stdout: "time": "2023-08-01T19:54:29.637847+0000", 2023-08-01T19:54:29.723 INFO:teuthology.orchestra.run.smithi155.stdout: "duration": 4294967295.9999995 2023-08-01T19:54:29.723 INFO:teuthology.orchestra.run.smithi155.stdout: }, 2023-08-01T19:54:29.723 INFO:teuthology.orchestra.run.smithi155.stdout: { 2023-08-01T19:54:29.724 INFO:teuthology.orchestra.run.smithi155.stdout: "event": "all_read", 2023-08-01T19:54:29.724 INFO:teuthology.orchestra.run.smithi155.stdout: "time": "2023-08-01T19:54:29.637886+0000", 2023-08-01T19:54:29.724 INFO:teuthology.orchestra.run.smithi155.stdout: "duration": 3.8102000000000002e-05 2023-08-01T19:54:29.724 INFO:teuthology.orchestra.run.smithi155.stdout: }, 2023-08-01T19:54:29.724 INFO:teuthology.orchestra.run.smithi155.stdout: { 2023-08-01T19:54:29.724 INFO:teuthology.orchestra.run.smithi155.stdout: "event": "dispatched", 2023-08-01T19:54:29.724 INFO:teuthology.orchestra.run.smithi155.stdout: "time": "2023-08-01T19:54:29.637896+0000", 2023-08-01T19:54:29.724 INFO:teuthology.orchestra.run.smithi155.stdout: "duration": 1.0178e-05 2023-08-01T19:54:29.725 INFO:teuthology.orchestra.run.smithi155.stdout: }, 2023-08-01T19:54:29.725 INFO:teuthology.orchestra.run.smithi155.stdout: { 2023-08-01T19:54:29.725 INFO:teuthology.orchestra.run.smithi155.stdout: "event": "queued_for_pg", 2023-08-01T19:54:29.725 INFO:teuthology.orchestra.run.smithi155.stdout: "time": "2023-08-01T19:54:29.637922+0000", 2023-08-01T19:54:29.725 INFO:teuthology.orchestra.run.smithi155.stdout: "duration": 2.6237e-05 2023-08-01T19:54:29.725 INFO:teuthology.orchestra.run.smithi155.stdout: }, 2023-08-01T19:54:29.725 INFO:teuthology.orchestra.run.smithi155.stdout: { 2023-08-01T19:54:29.725 INFO:teuthology.orchestra.run.smithi155.stdout: "event": "reached_pg", 2023-08-01T19:54:29.726 INFO:teuthology.orchestra.run.smithi155.stdout: "time": "2023-08-01T19:54:29.637961+0000", 2023-08-01T19:54:29.726 INFO:teuthology.orchestra.run.smithi155.stdout: "duration": 3.8738000000000001e-05 2023-08-01T19:54:29.726 INFO:teuthology.orchestra.run.smithi155.stdout: } 2023-08-01T19:54:29.726 INFO:teuthology.orchestra.run.smithi155.stdout: ] 2023-08-01T19:54:29.726 INFO:teuthology.orchestra.run.smithi155.stdout: } 2023-08-01T19:54:29.726 INFO:teuthology.orchestra.run.smithi155.stdout: }, 2023-08-01T19:54:29.726 INFO:teuthology.orchestra.run.smithi155.stdout: { 2023-08-01T19:54:29.726 INFO:teuthology.orchestra.run.smithi155.stdout: "description": "osd_op(client.4668.0:20491 5.4 5:2d798ad4:::benchmark_data_smithi006_114134_object20490:head [set-alloc-hint object_size 65536 write_size 65536,write 0~65536 in=65536b] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e23)", 2023-08-01T19:54:29.727 INFO:teuthology.orchestra.run.smithi155.stdout: "initiated_at": "2023-08-01T19:54:29.637938+0000", 2023-08-01T19:54:29.727 INFO:teuthology.orchestra.run.smithi155.stdout: "age": 4294967295.9994769, 2023-08-01T19:54:29.727 INFO:teuthology.orchestra.run.smithi155.stdout: "duration": 0.00021570899999999999, 2023-08-01T19:54:29.727 INFO:teuthology.orchestra.run.smithi155.stdout: "type_data": { 2023-08-01T19:54:29.727 INFO:teuthology.orchestra.run.smithi155.stdout: "flag_point": "started", 2023-08-01T19:54:29.727 INFO:teuthology.orchestra.run.smithi155.stdout: "client_info": { 2023-08-01T19:54:29.727 INFO:teuthology.orchestra.run.smithi155.stdout: "client": "client.4668", 2023-08-01T19:54:29.727 INFO:teuthology.orchestra.run.smithi155.stdout: "client_addr": "172.21.15.6:0/1709472247", 2023-08-01T19:54:29.728 INFO:teuthology.orchestra.run.smithi155.stdout: "tid": 20491 2023-08-01T19:54:29.728 INFO:teuthology.orchestra.run.smithi155.stdout: }, 2023-08-01T19:54:29.728 INFO:teuthology.orchestra.run.smithi155.stdout: "events": [ 2023-08-01T19:54:29.728 INFO:teuthology.orchestra.run.smithi155.stdout: { 2023-08-01T19:54:29.728 INFO:teuthology.orchestra.run.smithi155.stdout: "event": "initiated", 2023-08-01T19:54:29.728 INFO:teuthology.orchestra.run.smithi155.stdout: "time": "2023-08-01T19:54:29.637938+0000", 2023-08-01T19:54:29.728 INFO:teuthology.orchestra.run.smithi155.stdout: "duration": 0 2023-08-01T19:54:29.729 INFO:teuthology.orchestra.run.smithi155.stdout: }, 2023-08-01T19:54:29.729 INFO:teuthology.orchestra.run.smithi155.stdout: { 2023-08-01T19:54:29.729 INFO:teuthology.orchestra.run.smithi155.stdout: "event": "throttled", 2023-08-01T19:54:29.729 INFO:teuthology.orchestra.run.smithi155.stdout: "time": "2023-08-01T19:54:29.637938+0000", 2023-08-01T19:54:29.729 INFO:teuthology.orchestra.run.smithi155.stdout: "duration": 0 2023-08-01T19:54:29.729 INFO:teuthology.orchestra.run.smithi155.stdout: }, 2023-08-01T19:54:29.729 INFO:teuthology.orchestra.run.smithi155.stdout: { 2023-08-01T19:54:29.729 INFO:teuthology.orchestra.run.smithi155.stdout: "event": "header_read", 2023-08-01T19:54:29.730 INFO:teuthology.orchestra.run.smithi155.stdout: "time": "2023-08-01T19:54:29.637937+0000", 2023-08-01T19:54:29.730 INFO:teuthology.orchestra.run.smithi155.stdout: "duration": 4294967295.999999 2023-08-01T19:54:29.730 INFO:teuthology.orchestra.run.smithi155.stdout: }, 2023-08-01T19:54:29.730 INFO:teuthology.orchestra.run.smithi155.stdout: { 2023-08-01T19:54:29.730 INFO:teuthology.orchestra.run.smithi155.stdout: "event": "all_read", 2023-08-01T19:54:29.730 INFO:teuthology.orchestra.run.smithi155.stdout: "time": "2023-08-01T19:54:29.637959+0000", 2023-08-01T19:54:29.730 INFO:teuthology.orchestra.run.smithi155.stdout: "duration": 2.1973000000000001e-05 2023-08-01T19:54:29.730 INFO:teuthology.orchestra.run.smithi155.stdout: }, 2023-08-01T19:54:29.731 INFO:teuthology.orchestra.run.smithi155.stdout: { 2023-08-01T19:54:29.731 INFO:teuthology.orchestra.run.smithi155.stdout: "event": "dispatched", 2023-08-01T19:54:29.731 INFO:teuthology.orchestra.run.smithi155.stdout: "time": "2023-08-01T19:54:29.637968+0000", 2023-08-01T19:54:29.731 INFO:teuthology.orchestra.run.smithi155.stdout: "duration": 8.7420000000000003e-06 2023-08-01T19:54:29.731 INFO:teuthology.orchestra.run.smithi155.stdout: }, 2023-08-01T19:54:29.731 INFO:teuthology.orchestra.run.smithi155.stdout: { 2023-08-01T19:54:29.731 INFO:teuthology.orchestra.run.smithi155.stdout: "event": "queued_for_pg", 2023-08-01T19:54:29.731 INFO:teuthology.orchestra.run.smithi155.stdout: "time": "2023-08-01T19:54:29.637973+0000", 2023-08-01T19:54:29.732 INFO:teuthology.orchestra.run.smithi155.stdout: "duration": 4.5909999999999998e-06 2023-08-01T19:54:29.732 INFO:teuthology.orchestra.run.smithi155.stdout: }, 2023-08-01T19:54:29.732 INFO:teuthology.orchestra.run.smithi155.stdout: { 2023-08-01T19:54:29.732 INFO:teuthology.orchestra.run.smithi155.stdout: "event": "reached_pg", 2023-08-01T19:54:29.732 INFO:teuthology.orchestra.run.smithi155.stdout: "time": "2023-08-01T19:54:29.638014+0000", 2023-08-01T19:54:29.732 INFO:teuthology.orchestra.run.smithi155.stdout: "duration": 4.0902999999999998e-05 2023-08-01T19:54:29.732 INFO:teuthology.orchestra.run.smithi155.stdout: }, 2023-08-01T19:54:29.732 INFO:teuthology.orchestra.run.smithi155.stdout: { 2023-08-01T19:54:29.733 INFO:teuthology.orchestra.run.smithi155.stdout: "event": "started", 2023-08-01T19:54:29.733 INFO:teuthology.orchestra.run.smithi155.stdout: "time": "2023-08-01T19:54:29.638137+0000", 2023-08-01T19:54:29.733 INFO:teuthology.orchestra.run.smithi155.stdout: "duration": 0.000123528 2023-08-01T19:54:29.733 INFO:teuthology.orchestra.run.smithi155.stdout: } 2023-08-01T19:54:29.733 INFO:teuthology.orchestra.run.smithi155.stdout: ] 2023-08-01T19:54:29.733 INFO:teuthology.orchestra.run.smithi155.stdout: } 2023-08-01T19:54:29.733 INFO:teuthology.orchestra.run.smithi155.stdout: }, 2023-08-01T19:54:29.733 INFO:teuthology.orchestra.run.smithi155.stdout: { 2023-08-01T19:54:29.734 INFO:teuthology.orchestra.run.smithi155.stdout: "description": "osd_repop(client.4668.0:20488 5.f e23/19 5:f0266cce:::benchmark_data_smithi006_114134_object20487:head v 23'1291, mlcod=23'1288)", 2023-08-01T19:54:29.734 INFO:teuthology.orchestra.run.smithi155.stdout: "initiated_at": "2023-08-01T19:54:29.638068+0000", 2023-08-01T19:54:29.734 INFO:teuthology.orchestra.run.smithi155.stdout: "age": 4294967295.9993472, 2023-08-01T19:54:29.734 INFO:teuthology.orchestra.run.smithi155.stdout: "duration": 0.000218068, 2023-08-01T19:54:29.734 INFO:teuthology.orchestra.run.smithi155.stdout: "type_data": { 2023-08-01T19:54:29.734 INFO:teuthology.orchestra.run.smithi155.stdout: "flag_point": "started", 2023-08-01T19:54:29.734 INFO:teuthology.orchestra.run.smithi155.stdout: "events": [ 2023-08-01T19:54:29.735 INFO:teuthology.orchestra.run.smithi155.stdout: { 2023-08-01T19:54:29.735 INFO:teuthology.orchestra.run.smithi155.stdout: "event": "initiated", 2023-08-01T19:54:29.735 INFO:teuthology.orchestra.run.smithi155.stdout: "time": "2023-08-01T19:54:29.638068+0000", 2023-08-01T19:54:29.735 INFO:teuthology.orchestra.run.smithi155.stdout: "duration": 0 2023-08-01T19:54:29.735 INFO:teuthology.orchestra.run.smithi155.stdout: }, 2023-08-01T19:54:29.735 INFO:teuthology.orchestra.run.smithi155.stdout: { 2023-08-01T19:54:29.735 INFO:teuthology.orchestra.run.smithi155.stdout: "event": "throttled", 2023-08-01T19:54:29.735 INFO:teuthology.orchestra.run.smithi155.stdout: "time": "2023-08-01T19:54:29.638068+0000", 2023-08-01T19:54:29.736 INFO:teuthology.orchestra.run.smithi155.stdout: "duration": 0 2023-08-01T19:54:29.736 INFO:teuthology.orchestra.run.smithi155.stdout: }, 2023-08-01T19:54:29.736 INFO:teuthology.orchestra.run.smithi155.stdout: { 2023-08-01T19:54:29.736 INFO:teuthology.orchestra.run.smithi155.stdout: "event": "header_read", 2023-08-01T19:54:29.736 INFO:teuthology.orchestra.run.smithi155.stdout: "time": "2023-08-01T19:54:29.638067+0000", 2023-08-01T19:54:29.736 INFO:teuthology.orchestra.run.smithi155.stdout: "duration": 4294967295.9999995 2023-08-01T19:54:29.736 INFO:teuthology.orchestra.run.smithi155.stdout: }, 2023-08-01T19:54:29.736 INFO:teuthology.orchestra.run.smithi155.stdout: { 2023-08-01T19:54:29.737 INFO:teuthology.orchestra.run.smithi155.stdout: "event": "all_read", 2023-08-01T19:54:29.737 INFO:teuthology.orchestra.run.smithi155.stdout: "time": "2023-08-01T19:54:29.638169+0000", 2023-08-01T19:54:29.737 INFO:teuthology.orchestra.run.smithi155.stdout: "duration": 0.000101797 2023-08-01T19:54:29.737 INFO:teuthology.orchestra.run.smithi155.stdout: }, 2023-08-01T19:54:29.737 INFO:teuthology.orchestra.run.smithi155.stdout: { 2023-08-01T19:54:29.737 INFO:teuthology.orchestra.run.smithi155.stdout: "event": "dispatched", 2023-08-01T19:54:29.737 INFO:teuthology.orchestra.run.smithi155.stdout: "time": "2023-08-01T19:54:29.638181+0000", 2023-08-01T19:54:29.737 INFO:teuthology.orchestra.run.smithi155.stdout: "duration": 1.2629000000000001e-05 2023-08-01T19:54:29.738 INFO:teuthology.orchestra.run.smithi155.stdout: }, 2023-08-01T19:54:29.738 INFO:teuthology.orchestra.run.smithi155.stdout: { 2023-08-01T19:54:29.738 INFO:teuthology.orchestra.run.smithi155.stdout: "event": "queued_for_pg", 2023-08-01T19:54:29.738 INFO:teuthology.orchestra.run.smithi155.stdout: "time": "2023-08-01T19:54:29.638185+0000", 2023-08-01T19:54:29.738 INFO:teuthology.orchestra.run.smithi155.stdout: "duration": 3.6629999999999999e-06 2023-08-01T19:54:29.738 INFO:teuthology.orchestra.run.smithi155.stdout: }, 2023-08-01T19:54:29.738 INFO:teuthology.orchestra.run.smithi155.stdout: { 2023-08-01T19:54:29.738 INFO:teuthology.orchestra.run.smithi155.stdout: "event": "reached_pg", 2023-08-01T19:54:29.739 INFO:teuthology.orchestra.run.smithi155.stdout: "time": "2023-08-01T19:54:29.638217+0000", 2023-08-01T19:54:29.739 INFO:teuthology.orchestra.run.smithi155.stdout: "duration": 3.1510000000000002e-05 2023-08-01T19:54:29.739 INFO:teuthology.orchestra.run.smithi155.stdout: }, 2023-08-01T19:54:29.739 INFO:teuthology.orchestra.run.smithi155.stdout: { 2023-08-01T19:54:29.739 INFO:teuthology.orchestra.run.smithi155.stdout: "event": "started", 2023-08-01T19:54:29.739 INFO:teuthology.orchestra.run.smithi155.stdout: "time": "2023-08-01T19:54:29.638233+0000", 2023-08-01T19:54:29.739 INFO:teuthology.orchestra.run.smithi155.stdout: "duration": 1.6416999999999999e-05 2023-08-01T19:54:29.739 INFO:teuthology.orchestra.run.smithi155.stdout: } 2023-08-01T19:54:29.740 INFO:teuthology.orchestra.run.smithi155.stdout: ] 2023-08-01T19:54:29.740 INFO:teuthology.orchestra.run.smithi155.stdout: } 2023-08-01T19:54:29.740 INFO:teuthology.orchestra.run.smithi155.stdout: } 2023-08-01T19:54:29.740 INFO:teuthology.orchestra.run.smithi155.stdout: ], 2023-08-01T19:54:29.740 INFO:teuthology.orchestra.run.smithi155.stdout: "num_ops": 13 2023-08-01T19:54:29.740 INFO:teuthology.orchestra.run.smithi155.stdout:} 2023-08-01T19:54:29.742 DEBUG:teuthology.orchestra.run.smithi155:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 30 ceph --cluster ceph --admin-daemon /var/run/ceph/ceph-osd.2.asok dump_blocked_ops 2023-08-01T19:54:29.742 INFO:tasks.ceph.osd.2.smithi155.stderr:2023-08-01T19:54:29.741+0000 7faa5c6ac700 -1 received signal: Hangup from /usr/bin/python3 /bin/daemon-helper kill ceph-osd -f --cluster ceph -i 2 (PID: 111337) UID: 0 2023-08-01T19:54:29.776 DEBUG:teuthology.orchestra.run.smithi006:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 120 ceph --cluster ceph -- tell 'osd.*' injectargs --osd_enable_op_tracker=false 2023-08-01T19:54:29.842 INFO:tasks.ceph.osd.1.smithi101.stderr:2023-08-01T19:54:29.841+0000 7fb0cb7f6700 -1 received signal: Hangup from /usr/bin/python3 /bin/daemon-helper kill ceph-osd -f --cluster ceph -i 1 (PID: 111141) UID: 0 2023-08-01T19:54:29.931 INFO:teuthology.orchestra.run.smithi006.stdout:osd.0: {} 2023-08-01T19:54:29.943 INFO:tasks.ceph.osd.2.smithi155.stderr:2023-08-01T19:54:29.942+0000 7faa5c6ac700 -1 received signal: Hangup from /usr/bin/python3 /bin/daemon-helper kill ceph-osd -f --cluster ceph -i 2 (PID: 111337) UID: 0 2023-08-01T19:54:29.949 INFO:teuthology.orchestra.run.smithi155.stdout:{ 2023-08-01T19:54:29.949 INFO:teuthology.orchestra.run.smithi155.stdout: "ops": [], 2023-08-01T19:54:29.950 INFO:teuthology.orchestra.run.smithi155.stdout: "complaint_time": 30, 2023-08-01T19:54:29.950 INFO:teuthology.orchestra.run.smithi155.stdout: "num_blocked_ops": 0 2023-08-01T19:54:29.950 INFO:teuthology.orchestra.run.smithi155.stdout:} 2023-08-01T19:54:29.950 INFO:teuthology.orchestra.run.smithi006.stdout:osd.1: {} 2023-08-01T19:54:29.964 DEBUG:teuthology.orchestra.run.smithi155:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 30 ceph --cluster ceph --admin-daemon /var/run/ceph/ceph-osd.2.asok dump_historic_ops 2023-08-01T19:54:29.970 INFO:teuthology.orchestra.run.smithi006.stdout:osd.2: {} 2023-08-01T19:54:29.971 INFO:teuthology.orchestra.run.smithi006.stderr:osd.0: osd_enable_op_tracker = 'false' 2023-08-01T19:54:29.971 INFO:teuthology.orchestra.run.smithi006.stderr:osd.1: osd_enable_op_tracker = 'false' 2023-08-01T19:54:29.971 INFO:teuthology.orchestra.run.smithi006.stderr:osd.2: osd_enable_op_tracker = 'false' 2023-08-01T19:54:30.043 INFO:tasks.ceph.osd.1.smithi101.stderr:2023-08-01T19:54:30.042+0000 7fb0cb7f6700 -1 received signal: Hangup from /usr/bin/python3 /bin/daemon-helper kill ceph-osd -f --cluster ceph -i 1 (PID: 111141) UID: 0 2023-08-01T19:54:30.144 INFO:tasks.ceph.osd.2.smithi155.stderr:2023-08-01T19:54:30.143+0000 7faa5c6ac700 -1 received signal: Hangup from /usr/bin/python3 /bin/daemon-helper kill ceph-osd -f --cluster ceph -i 2 (PID: 111337) UID: 0 2023-08-01T19:54:30.166 DEBUG:teuthology.orchestra.run.smithi006:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 120 ceph --cluster ceph osd unset nodeep-scrub 2023-08-01T19:54:30.169 INFO:teuthology.orchestra.run.smithi155.stdout:ERROR: (22) Invalid argument 2023-08-01T19:54:30.169 INFO:teuthology.orchestra.run.smithi155.stdout:op_tracker tracking is not enabled now, so no ops are tracked currently, even those get stuck. Please enable "osd_enable_op_tracker", and the tracker will start to track new ops received afterwards. 2023-08-01T19:54:30.185 DEBUG:teuthology.orchestra.run.smithi008:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 30 ceph --cluster ceph --admin-daemon /var/run/ceph/ceph-osd.0.asok dump_ops_in_flight 2023-08-01T19:54:30.245 INFO:tasks.ceph.osd.2.smithi155.stderr:2023-08-01T19:54:30.244+0000 7faa5c6ac700 -1 received signal: Hangup from /usr/bin/python3 /bin/daemon-helper kill ceph-osd -f --cluster ceph -i 2 (PID: 111337) UID: 0 2023-08-01T19:54:30.313 INFO:tasks.radosbench.radosbench.0.smithi006.stdout: 6 16 22743 22727 236.723 208.438 0.00463386 0.00422088 2023-08-01T19:54:30.345 INFO:tasks.ceph.osd.1.smithi101.stderr:2023-08-01T19:54:30.344+0000 7fb0cb7f6700 -1 received signal: Hangup from /usr/bin/python3 /bin/daemon-helper kill ceph-osd -f --cluster ceph -i 1 (PID: 111141) UID: 0 2023-08-01T19:54:30.387 INFO:teuthology.orchestra.run.smithi008.stdout:ERROR: (22) Invalid argument 2023-08-01T19:54:30.388 INFO:teuthology.orchestra.run.smithi008.stdout:op_tracker tracking is not enabled now, so no ops are tracked currently, even those get stuck. Please enable "osd_enable_op_tracker", and the tracker will start to track new ops received afterwards. 2023-08-01T19:54:30.403 DEBUG:teuthology.orchestra.run.smithi008:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 30 ceph --cluster ceph --admin-daemon /var/run/ceph/ceph-osd.0.asok dump_blocked_ops 2023-08-01T19:54:30.447 INFO:tasks.ceph.osd.0.smithi008.stderr:2023-08-01T19:54:30.445+0000 7f16a58f4700 -1 received signal: Hangup from /usr/bin/python3 /bin/daemon-helper kill ceph-osd -f --cluster ceph -i 0 (PID: 111179) UID: 0 2023-08-01T19:54:30.547 INFO:tasks.ceph.osd.2.smithi155.stderr:2023-08-01T19:54:30.547+0000 7faa5c6ac700 -1 received signal: Hangup from /usr/bin/python3 /bin/daemon-helper kill ceph-osd -f --cluster ceph -i 2 (PID: 111337) UID: 0 2023-08-01T19:54:30.586 INFO:teuthology.orchestra.run.smithi008.stdout:ERROR: (22) Invalid argument 2023-08-01T19:54:30.586 INFO:teuthology.orchestra.run.smithi008.stdout:op_tracker tracking is not enabled now, so no ops are tracked currently, even those get stuck. Please enable "osd_enable_op_tracker", and the tracker will start to track new ops received afterwards. 2023-08-01T19:54:30.602 DEBUG:teuthology.orchestra.run.smithi008:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 30 ceph --cluster ceph --admin-daemon /var/run/ceph/ceph-osd.0.asok dump_historic_ops 2023-08-01T19:54:30.648 INFO:tasks.ceph.osd.1.smithi101.stderr:2023-08-01T19:54:30.647+0000 7fb0cb7f6700 -1 received signal: Hangup from /usr/bin/python3 /bin/daemon-helper kill ceph-osd -f --cluster ceph -i 1 (PID: 111141) UID: 0 2023-08-01T19:54:30.750 INFO:tasks.ceph.osd.0.smithi008.stderr:2023-08-01T19:54:30.748+0000 7f16a58f4700 -1 received signal: Hangup from /usr/bin/python3 /bin/daemon-helper kill ceph-osd -f --cluster ceph -i 0 (PID: 111179) UID: 0 2023-08-01T19:54:30.839 INFO:teuthology.orchestra.run.smithi008.stdout:ERROR: (22) Invalid argument 2023-08-01T19:54:30.839 INFO:teuthology.orchestra.run.smithi008.stdout:op_tracker tracking is not enabled now, so no ops are tracked currently, even those get stuck. Please enable "osd_enable_op_tracker", and the tracker will start to track new ops received afterwards. 2023-08-01T19:54:30.851 INFO:tasks.ceph.osd.0.smithi008.stderr:2023-08-01T19:54:30.849+0000 7f16a58f4700 -1 received signal: Hangup from /usr/bin/python3 /bin/daemon-helper kill ceph-osd -f --cluster ceph -i 0 (PID: 111179) UID: 0 2023-08-01T19:54:30.856 DEBUG:teuthology.orchestra.run.smithi101:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 30 ceph --cluster ceph --admin-daemon /var/run/ceph/ceph-osd.1.asok dump_ops_in_flight 2023-08-01T19:54:30.951 INFO:tasks.ceph.osd.1.smithi101.stderr:2023-08-01T19:54:30.950+0000 7fb0cb7f6700 -1 received signal: Hangup from /usr/bin/python3 /bin/daemon-helper kill ceph-osd -f --cluster ceph -i 1 (PID: 111141) UID: 0 2023-08-01T19:54:31.025 INFO:teuthology.orchestra.run.smithi101.stdout:ERROR: (22) Invalid argument 2023-08-01T19:54:31.025 INFO:teuthology.orchestra.run.smithi101.stdout:op_tracker tracking is not enabled now, so no ops are tracked currently, even those get stuck. Please enable "osd_enable_op_tracker", and the tracker will start to track new ops received afterwards. 2023-08-01T19:54:31.039 DEBUG:teuthology.orchestra.run.smithi101:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 30 ceph --cluster ceph --admin-daemon /var/run/ceph/ceph-osd.1.asok dump_blocked_ops 2023-08-01T19:54:31.052 INFO:tasks.ceph.osd.2.smithi155.stderr:2023-08-01T19:54:31.051+0000 7faa5c6ac700 -1 received signal: Hangup from /usr/bin/python3 /bin/daemon-helper kill ceph-osd -f --cluster ceph -i 2 (PID: 111337) UID: 0 2023-08-01T19:54:31.153 INFO:tasks.ceph.osd.1.smithi101.stderr:2023-08-01T19:54:31.152+0000 7fb0cb7f6700 -1 received signal: Hangup from /usr/bin/python3 /bin/daemon-helper kill ceph-osd -f --cluster ceph -i 1 (PID: 111141) UID: 0 2023-08-01T19:54:31.158 INFO:teuthology.orchestra.run.smithi006.stderr:nodeep-scrub is unset 2023-08-01T19:54:31.251 INFO:teuthology.orchestra.run.smithi101.stdout:ERROR: (22) Invalid argument 2023-08-01T19:54:31.251 INFO:teuthology.orchestra.run.smithi101.stdout:op_tracker tracking is not enabled now, so no ops are tracked currently, even those get stuck. Please enable "osd_enable_op_tracker", and the tracker will start to track new ops received afterwards. 2023-08-01T19:54:31.254 INFO:tasks.ceph.osd.1.smithi101.stderr:2023-08-01T19:54:31.253+0000 7fb0cb7f6700 -1 received signal: Hangup from /usr/bin/python3 /bin/daemon-helper kill ceph-osd -f --cluster ceph -i 1 (PID: 111141) UID: 0 2023-08-01T19:54:31.264 DEBUG:teuthology.orchestra.run.smithi101:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 30 ceph --cluster ceph --admin-daemon /var/run/ceph/ceph-osd.1.asok dump_historic_ops 2023-08-01T19:54:31.313 INFO:tasks.radosbench.radosbench.0.smithi006.stdout: 7 16 25907 25891 231.153 197.75 0.00610138 0.00432255 2023-08-01T19:54:31.355 INFO:tasks.ceph.osd.1.smithi101.stderr:2023-08-01T19:54:31.354+0000 7fb0cb7f6700 -1 received signal: Hangup from /usr/bin/python3 /bin/daemon-helper kill ceph-osd -f --cluster ceph -i 1 (PID: 111141) UID: 0 2023-08-01T19:54:31.455 INFO:tasks.ceph.osd.2.smithi155.stderr:2023-08-01T19:54:31.455+0000 7faa5c6ac700 -1 received signal: Hangup from /usr/bin/python3 /bin/daemon-helper kill ceph-osd -f --cluster ceph -i 2 (PID: 111337) UID: 0 2023-08-01T19:54:31.481 INFO:teuthology.orchestra.run.smithi101.stdout:ERROR: (22) Invalid argument 2023-08-01T19:54:31.481 INFO:teuthology.orchestra.run.smithi101.stdout:op_tracker tracking is not enabled now, so no ops are tracked currently, even those get stuck. Please enable "osd_enable_op_tracker", and the tracker will start to track new ops received afterwards. 2023-08-01T19:54:31.497 DEBUG:teuthology.orchestra.run.smithi155:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 30 ceph --cluster ceph --admin-daemon /var/run/ceph/ceph-osd.2.asok dump_ops_in_flight 2023-08-01T19:54:31.556 INFO:tasks.ceph.osd.0.smithi008.stderr:2023-08-01T19:54:31.554+0000 7f16a58f4700 -1 received signal: Hangup from /usr/bin/python3 /bin/daemon-helper kill ceph-osd -f --cluster ceph -i 0 (PID: 111179) UID: 0 2023-08-01T19:54:31.657 INFO:tasks.ceph.osd.0.smithi008.stderr:2023-08-01T19:54:31.655+0000 7f16a58f4700 -1 received signal: Hangup from /usr/bin/python3 /bin/daemon-helper kill ceph-osd -f --cluster ceph -i 0 (PID: 111179) UID: 0 2023-08-01T19:54:31.666 INFO:teuthology.orchestra.run.smithi155.stdout:ERROR: (22) Invalid argument 2023-08-01T19:54:31.666 INFO:teuthology.orchestra.run.smithi155.stdout:op_tracker tracking is not enabled now, so no ops are tracked currently, even those get stuck. Please enable "osd_enable_op_tracker", and the tracker will start to track new ops received afterwards. 2023-08-01T19:54:31.679 DEBUG:teuthology.orchestra.run.smithi155:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 30 ceph --cluster ceph --admin-daemon /var/run/ceph/ceph-osd.2.asok dump_blocked_ops 2023-08-01T19:54:31.758 INFO:tasks.ceph.osd.1.smithi101.stderr:2023-08-01T19:54:31.756+0000 7fb0cb7f6700 -1 received signal: Hangup from /usr/bin/python3 /bin/daemon-helper kill ceph-osd -f --cluster ceph -i 1 (PID: 111141) UID: 0 2023-08-01T19:54:31.851 INFO:teuthology.orchestra.run.smithi155.stdout:ERROR: (22) Invalid argument 2023-08-01T19:54:31.851 INFO:teuthology.orchestra.run.smithi155.stdout:op_tracker tracking is not enabled now, so no ops are tracked currently, even those get stuck. Please enable "osd_enable_op_tracker", and the tracker will start to track new ops received afterwards. 2023-08-01T19:54:31.858 INFO:tasks.ceph.osd.2.smithi155.stderr:2023-08-01T19:54:31.858+0000 7faa5c6ac700 -1 received signal: Hangup from /usr/bin/python3 /bin/daemon-helper kill ceph-osd -f --cluster ceph -i 2 (PID: 111337) UID: 0 2023-08-01T19:54:31.864 DEBUG:teuthology.orchestra.run.smithi155:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 30 ceph --cluster ceph --admin-daemon /var/run/ceph/ceph-osd.2.asok dump_historic_ops 2023-08-01T19:54:31.959 INFO:tasks.ceph.osd.2.smithi155.stderr:2023-08-01T19:54:31.959+0000 7faa5c6ac700 -1 received signal: Hangup from /usr/bin/python3 /bin/daemon-helper kill ceph-osd -f --cluster ceph -i 2 (PID: 111337) UID: 0 2023-08-01T19:54:31.983 DEBUG:teuthology.orchestra.run.smithi006:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 120 ceph --cluster ceph -- tell 'osd.*' injectargs --osd_enable_op_tracker=true 2023-08-01T19:54:32.061 INFO:tasks.ceph.osd.0.smithi008.stderr:2023-08-01T19:54:32.059+0000 7f16a58f4700 -1 received signal: Hangup from /usr/bin/python3 /bin/daemon-helper kill ceph-osd -f --cluster ceph -i 0 (PID: 111179) UID: 0 2023-08-01T19:54:32.073 INFO:teuthology.orchestra.run.smithi155.stdout:ERROR: (22) Invalid argument 2023-08-01T19:54:32.073 INFO:teuthology.orchestra.run.smithi155.stdout:op_tracker tracking is not enabled now, so no ops are tracked currently, even those get stuck. Please enable "osd_enable_op_tracker", and the tracker will start to track new ops received afterwards. 2023-08-01T19:54:32.088 DEBUG:teuthology.orchestra.run.smithi008:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 30 ceph --cluster ceph --admin-daemon /var/run/ceph/ceph-osd.0.asok dump_ops_in_flight 2023-08-01T19:54:32.133 INFO:teuthology.orchestra.run.smithi006.stdout:osd.0: {} 2023-08-01T19:54:32.144 INFO:tasks.thrashosds.thrasher:in_osds: [0, 1, 2] out_osds: [] dead_osds: [] live_osds: [0, 1, 2] 2023-08-01T19:54:32.144 INFO:tasks.thrashosds.thrasher:choose_action: min_in 4 min_out 0 min_live 2 min_dead 0 chance_down 1.00 2023-08-01T19:54:32.145 INFO:tasks.thrashosds.thrasher:thrash_pg_upmap_items 2023-08-01T19:54:32.145 DEBUG:teuthology.orchestra.run.smithi006:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 120 ceph --cluster ceph osd dump -f json-pretty 2023-08-01T19:54:32.153 INFO:teuthology.orchestra.run.smithi006.stdout:osd.1: {} 2023-08-01T19:54:32.161 INFO:tasks.ceph.osd.1.smithi101.stderr:2023-08-01T19:54:32.160+0000 7fb0cb7f6700 -1 received signal: Hangup from /usr/bin/python3 /bin/daemon-helper kill ceph-osd -f --cluster ceph -i 1 (PID: 111141) UID: 0 2023-08-01T19:54:32.177 INFO:teuthology.orchestra.run.smithi006.stdout:osd.2: {} 2023-08-01T19:54:32.178 INFO:teuthology.orchestra.run.smithi006.stderr:osd.0: osd_enable_op_tracker = 'true' 2023-08-01T19:54:32.179 INFO:teuthology.orchestra.run.smithi006.stderr:osd.1: osd_enable_op_tracker = 'true' 2023-08-01T19:54:32.179 INFO:teuthology.orchestra.run.smithi006.stderr:osd.2: osd_enable_op_tracker = 'true' 2023-08-01T19:54:32.262 INFO:tasks.ceph.osd.2.smithi155.stderr:2023-08-01T19:54:32.262+0000 7faa5c6ac700 -1 received signal: Hangup from /usr/bin/python3 /bin/daemon-helper kill ceph-osd -f --cluster ceph -i 2 (PID: 111337) UID: 0 2023-08-01T19:54:32.293 INFO:teuthology.orchestra.run.smithi008.stdout:{ 2023-08-01T19:54:32.293 INFO:teuthology.orchestra.run.smithi008.stdout: "ops": [ 2023-08-01T19:54:32.293 INFO:teuthology.orchestra.run.smithi008.stdout: { 2023-08-01T19:54:32.293 INFO:teuthology.orchestra.run.smithi008.stdout: "description": "osd_op(client.4668.0:28909 5.a 5:5bffb87d:::benchmark_data_smithi006_114134_object28908:head [set-alloc-hint object_size 65536 write_size 65536,write 0~65536 in=65536b] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e24)", 2023-08-01T19:54:32.293 INFO:teuthology.orchestra.run.smithi008.stdout: "initiated_at": "2023-08-01T19:54:32.287539+0000", 2023-08-01T19:54:32.293 INFO:teuthology.orchestra.run.smithi008.stdout: "age": 0.0020424990000000001, 2023-08-01T19:54:32.294 INFO:teuthology.orchestra.run.smithi008.stdout: "duration": 0.0020746520000000002, 2023-08-01T19:54:32.294 INFO:teuthology.orchestra.run.smithi008.stdout: "type_data": { 2023-08-01T19:54:32.294 INFO:teuthology.orchestra.run.smithi008.stdout: "flag_point": "waiting for sub ops", 2023-08-01T19:54:32.294 INFO:teuthology.orchestra.run.smithi008.stdout: "client_info": { 2023-08-01T19:54:32.294 INFO:teuthology.orchestra.run.smithi008.stdout: "client": "client.4668", 2023-08-01T19:54:32.294 INFO:teuthology.orchestra.run.smithi008.stdout: "client_addr": "172.21.15.6:0/1709472247", 2023-08-01T19:54:32.294 INFO:teuthology.orchestra.run.smithi008.stdout: "tid": 28909 2023-08-01T19:54:32.294 INFO:teuthology.orchestra.run.smithi008.stdout: }, 2023-08-01T19:54:32.295 INFO:teuthology.orchestra.run.smithi008.stdout: "events": [ 2023-08-01T19:54:32.295 INFO:teuthology.orchestra.run.smithi008.stdout: { 2023-08-01T19:54:32.295 INFO:teuthology.orchestra.run.smithi008.stdout: "event": "initiated", 2023-08-01T19:54:32.295 INFO:teuthology.orchestra.run.smithi008.stdout: "time": "2023-08-01T19:54:32.287539+0000", 2023-08-01T19:54:32.295 INFO:teuthology.orchestra.run.smithi008.stdout: "duration": 0 2023-08-01T19:54:32.295 INFO:teuthology.orchestra.run.smithi008.stdout: }, 2023-08-01T19:54:32.295 INFO:teuthology.orchestra.run.smithi008.stdout: { 2023-08-01T19:54:32.296 INFO:teuthology.orchestra.run.smithi008.stdout: "event": "throttled", 2023-08-01T19:54:32.296 INFO:teuthology.orchestra.run.smithi008.stdout: "time": "2023-08-01T19:54:32.287539+0000", 2023-08-01T19:54:32.296 INFO:teuthology.orchestra.run.smithi008.stdout: "duration": 0 2023-08-01T19:54:32.296 INFO:teuthology.orchestra.run.smithi008.stdout: }, 2023-08-01T19:54:32.296 INFO:teuthology.orchestra.run.smithi008.stdout: { 2023-08-01T19:54:32.296 INFO:teuthology.orchestra.run.smithi008.stdout: "event": "header_read", 2023-08-01T19:54:32.296 INFO:teuthology.orchestra.run.smithi008.stdout: "time": "2023-08-01T19:54:32.287538+0000", 2023-08-01T19:54:32.296 INFO:teuthology.orchestra.run.smithi008.stdout: "duration": 4294967295.9999995 2023-08-01T19:54:32.297 INFO:teuthology.orchestra.run.smithi008.stdout: }, 2023-08-01T19:54:32.297 INFO:teuthology.orchestra.run.smithi008.stdout: { 2023-08-01T19:54:32.297 INFO:teuthology.orchestra.run.smithi008.stdout: "event": "all_read", 2023-08-01T19:54:32.297 INFO:teuthology.orchestra.run.smithi008.stdout: "time": "2023-08-01T19:54:32.287622+0000", 2023-08-01T19:54:32.297 INFO:teuthology.orchestra.run.smithi008.stdout: "duration": 8.4300000000000003e-05 2023-08-01T19:54:32.297 INFO:teuthology.orchestra.run.smithi008.stdout: }, 2023-08-01T19:54:32.297 INFO:teuthology.orchestra.run.smithi008.stdout: { 2023-08-01T19:54:32.297 INFO:teuthology.orchestra.run.smithi008.stdout: "event": "dispatched", 2023-08-01T19:54:32.298 INFO:teuthology.orchestra.run.smithi008.stdout: "time": "2023-08-01T19:54:32.287631+0000", 2023-08-01T19:54:32.298 INFO:teuthology.orchestra.run.smithi008.stdout: "duration": 8.9469999999999992e-06 2023-08-01T19:54:32.298 INFO:teuthology.orchestra.run.smithi008.stdout: }, 2023-08-01T19:54:32.298 INFO:teuthology.orchestra.run.smithi008.stdout: { 2023-08-01T19:54:32.298 INFO:teuthology.orchestra.run.smithi008.stdout: "event": "queued_for_pg", 2023-08-01T19:54:32.298 INFO:teuthology.orchestra.run.smithi008.stdout: "time": "2023-08-01T19:54:32.287636+0000", 2023-08-01T19:54:32.298 INFO:teuthology.orchestra.run.smithi008.stdout: "duration": 4.6419999999999998e-06 2023-08-01T19:54:32.298 INFO:teuthology.orchestra.run.smithi008.stdout: }, 2023-08-01T19:54:32.299 INFO:teuthology.orchestra.run.smithi008.stdout: { 2023-08-01T19:54:32.299 INFO:teuthology.orchestra.run.smithi008.stdout: "event": "reached_pg", 2023-08-01T19:54:32.299 INFO:teuthology.orchestra.run.smithi008.stdout: "time": "2023-08-01T19:54:32.287678+0000", 2023-08-01T19:54:32.299 INFO:teuthology.orchestra.run.smithi008.stdout: "duration": 4.1878999999999997e-05 2023-08-01T19:54:32.299 INFO:teuthology.orchestra.run.smithi008.stdout: }, 2023-08-01T19:54:32.299 INFO:teuthology.orchestra.run.smithi008.stdout: { 2023-08-01T19:54:32.299 INFO:teuthology.orchestra.run.smithi008.stdout: "event": "started", 2023-08-01T19:54:32.299 INFO:teuthology.orchestra.run.smithi008.stdout: "time": "2023-08-01T19:54:32.287872+0000", 2023-08-01T19:54:32.300 INFO:teuthology.orchestra.run.smithi008.stdout: "duration": 0.00019399799999999999 2023-08-01T19:54:32.300 INFO:teuthology.orchestra.run.smithi008.stdout: }, 2023-08-01T19:54:32.300 INFO:teuthology.orchestra.run.smithi008.stdout: { 2023-08-01T19:54:32.300 INFO:teuthology.orchestra.run.smithi008.stdout: "event": "waiting for subops from 2", 2023-08-01T19:54:32.300 INFO:teuthology.orchestra.run.smithi008.stdout: "time": "2023-08-01T19:54:32.288049+0000", 2023-08-01T19:54:32.300 INFO:teuthology.orchestra.run.smithi008.stdout: "duration": 0.000177061 2023-08-01T19:54:32.300 INFO:teuthology.orchestra.run.smithi008.stdout: } 2023-08-01T19:54:32.301 INFO:teuthology.orchestra.run.smithi008.stdout: ] 2023-08-01T19:54:32.301 INFO:teuthology.orchestra.run.smithi008.stdout: } 2023-08-01T19:54:32.301 INFO:teuthology.orchestra.run.smithi008.stdout: }, 2023-08-01T19:54:32.301 INFO:teuthology.orchestra.run.smithi008.stdout: { 2023-08-01T19:54:32.301 INFO:teuthology.orchestra.run.smithi008.stdout: "description": "osd_repop(client.4668.0:28906 5.e e24/19 5:77b4f6c9:::benchmark_data_smithi006_114134_object28905:head v 24'1862, mlcod=24'1860)", 2023-08-01T19:54:32.301 INFO:teuthology.orchestra.run.smithi008.stdout: "initiated_at": "2023-08-01T19:54:32.287680+0000", 2023-08-01T19:54:32.301 INFO:teuthology.orchestra.run.smithi008.stdout: "age": 0.0019008409999999999, 2023-08-01T19:54:32.301 INFO:teuthology.orchestra.run.smithi008.stdout: "duration": 0.002030694, 2023-08-01T19:54:32.302 INFO:teuthology.orchestra.run.smithi008.stdout: "type_data": { 2023-08-01T19:54:32.302 INFO:teuthology.orchestra.run.smithi008.stdout: "flag_point": "started", 2023-08-01T19:54:32.302 INFO:teuthology.orchestra.run.smithi008.stdout: "events": [ 2023-08-01T19:54:32.302 INFO:teuthology.orchestra.run.smithi008.stdout: { 2023-08-01T19:54:32.302 INFO:teuthology.orchestra.run.smithi008.stdout: "event": "initiated", 2023-08-01T19:54:32.302 INFO:teuthology.orchestra.run.smithi008.stdout: "time": "2023-08-01T19:54:32.287680+0000", 2023-08-01T19:54:32.302 INFO:teuthology.orchestra.run.smithi008.stdout: "duration": 0 2023-08-01T19:54:32.302 INFO:teuthology.orchestra.run.smithi008.stdout: }, 2023-08-01T19:54:32.303 INFO:teuthology.orchestra.run.smithi008.stdout: { 2023-08-01T19:54:32.303 INFO:teuthology.orchestra.run.smithi008.stdout: "event": "throttled", 2023-08-01T19:54:32.303 INFO:teuthology.orchestra.run.smithi008.stdout: "time": "2023-08-01T19:54:32.287680+0000", 2023-08-01T19:54:32.303 INFO:teuthology.orchestra.run.smithi008.stdout: "duration": 0 2023-08-01T19:54:32.303 INFO:teuthology.orchestra.run.smithi008.stdout: }, 2023-08-01T19:54:32.303 INFO:teuthology.orchestra.run.smithi008.stdout: { 2023-08-01T19:54:32.303 INFO:teuthology.orchestra.run.smithi008.stdout: "event": "header_read", 2023-08-01T19:54:32.303 INFO:teuthology.orchestra.run.smithi008.stdout: "time": "2023-08-01T19:54:32.287680+0000", 2023-08-01T19:54:32.304 INFO:teuthology.orchestra.run.smithi008.stdout: "duration": 4294967295.9999995 2023-08-01T19:54:32.304 INFO:teuthology.orchestra.run.smithi008.stdout: }, 2023-08-01T19:54:32.304 INFO:teuthology.orchestra.run.smithi008.stdout: { 2023-08-01T19:54:32.304 INFO:teuthology.orchestra.run.smithi008.stdout: "event": "all_read", 2023-08-01T19:54:32.304 INFO:teuthology.orchestra.run.smithi008.stdout: "time": "2023-08-01T19:54:32.287741+0000", 2023-08-01T19:54:32.304 INFO:teuthology.orchestra.run.smithi008.stdout: "duration": 6.1416999999999998e-05 2023-08-01T19:54:32.304 INFO:teuthology.orchestra.run.smithi008.stdout: }, 2023-08-01T19:54:32.304 INFO:teuthology.orchestra.run.smithi008.stdout: { 2023-08-01T19:54:32.305 INFO:teuthology.orchestra.run.smithi008.stdout: "event": "dispatched", 2023-08-01T19:54:32.305 INFO:teuthology.orchestra.run.smithi008.stdout: "time": "2023-08-01T19:54:32.287752+0000", 2023-08-01T19:54:32.305 INFO:teuthology.orchestra.run.smithi008.stdout: "duration": 1.129e-05 2023-08-01T19:54:32.305 INFO:teuthology.orchestra.run.smithi008.stdout: }, 2023-08-01T19:54:32.305 INFO:teuthology.orchestra.run.smithi008.stdout: { 2023-08-01T19:54:32.305 INFO:teuthology.orchestra.run.smithi008.stdout: "event": "queued_for_pg", 2023-08-01T19:54:32.305 INFO:teuthology.orchestra.run.smithi008.stdout: "time": "2023-08-01T19:54:32.287758+0000", 2023-08-01T19:54:32.305 INFO:teuthology.orchestra.run.smithi008.stdout: "duration": 5.2730000000000002e-06 2023-08-01T19:54:32.306 INFO:teuthology.orchestra.run.smithi008.stdout: }, 2023-08-01T19:54:32.306 INFO:teuthology.orchestra.run.smithi008.stdout: { 2023-08-01T19:54:32.306 INFO:teuthology.orchestra.run.smithi008.stdout: "event": "reached_pg", 2023-08-01T19:54:32.306 INFO:teuthology.orchestra.run.smithi008.stdout: "time": "2023-08-01T19:54:32.287790+0000", 2023-08-01T19:54:32.306 INFO:teuthology.orchestra.run.smithi008.stdout: "duration": 3.2639999999999999e-05 2023-08-01T19:54:32.306 INFO:teuthology.orchestra.run.smithi008.stdout: }, 2023-08-01T19:54:32.306 INFO:teuthology.orchestra.run.smithi008.stdout: { 2023-08-01T19:54:32.306 INFO:teuthology.orchestra.run.smithi008.stdout: "event": "started", 2023-08-01T19:54:32.307 INFO:teuthology.orchestra.run.smithi008.stdout: "time": "2023-08-01T19:54:32.287802+0000", 2023-08-01T19:54:32.307 INFO:teuthology.orchestra.run.smithi008.stdout: "duration": 1.1525000000000001e-05 2023-08-01T19:54:32.307 INFO:teuthology.orchestra.run.smithi008.stdout: } 2023-08-01T19:54:32.307 INFO:teuthology.orchestra.run.smithi008.stdout: ] 2023-08-01T19:54:32.307 INFO:teuthology.orchestra.run.smithi008.stdout: } 2023-08-01T19:54:32.307 INFO:teuthology.orchestra.run.smithi008.stdout: }, 2023-08-01T19:54:32.307 INFO:teuthology.orchestra.run.smithi008.stdout: { 2023-08-01T19:54:32.307 INFO:teuthology.orchestra.run.smithi008.stdout: "description": "osd_repop(client.4668.0:28907 5.4 e24/19 5:28c62544:::benchmark_data_smithi006_114134_object28906:head v 24'1775, mlcod=24'1771)", 2023-08-01T19:54:32.308 INFO:teuthology.orchestra.run.smithi008.stdout: "initiated_at": "2023-08-01T19:54:32.287807+0000", 2023-08-01T19:54:32.308 INFO:teuthology.orchestra.run.smithi008.stdout: "age": 0.0017738560000000001, 2023-08-01T19:54:32.308 INFO:teuthology.orchestra.run.smithi008.stdout: "duration": 0.0019986700000000001, 2023-08-01T19:54:32.308 INFO:teuthology.orchestra.run.smithi008.stdout: "type_data": { 2023-08-01T19:54:32.308 INFO:teuthology.orchestra.run.smithi008.stdout: "flag_point": "started", 2023-08-01T19:54:32.308 INFO:teuthology.orchestra.run.smithi008.stdout: "events": [ 2023-08-01T19:54:32.308 INFO:teuthology.orchestra.run.smithi008.stdout: { 2023-08-01T19:54:32.308 INFO:teuthology.orchestra.run.smithi008.stdout: "event": "initiated", 2023-08-01T19:54:32.309 INFO:teuthology.orchestra.run.smithi008.stdout: "time": "2023-08-01T19:54:32.287807+0000", 2023-08-01T19:54:32.309 INFO:teuthology.orchestra.run.smithi008.stdout: "duration": 0 2023-08-01T19:54:32.309 INFO:teuthology.orchestra.run.smithi008.stdout: }, 2023-08-01T19:54:32.309 INFO:teuthology.orchestra.run.smithi008.stdout: { 2023-08-01T19:54:32.309 INFO:teuthology.orchestra.run.smithi008.stdout: "event": "throttled", 2023-08-01T19:54:32.309 INFO:teuthology.orchestra.run.smithi008.stdout: "time": "2023-08-01T19:54:32.287807+0000", 2023-08-01T19:54:32.309 INFO:teuthology.orchestra.run.smithi008.stdout: "duration": 0 2023-08-01T19:54:32.309 INFO:teuthology.orchestra.run.smithi008.stdout: }, 2023-08-01T19:54:32.310 INFO:teuthology.orchestra.run.smithi008.stdout: { 2023-08-01T19:54:32.310 INFO:teuthology.orchestra.run.smithi008.stdout: "event": "header_read", 2023-08-01T19:54:32.310 INFO:teuthology.orchestra.run.smithi008.stdout: "time": "2023-08-01T19:54:32.287807+0000", 2023-08-01T19:54:32.310 INFO:teuthology.orchestra.run.smithi008.stdout: "duration": 4294967295.9999995 2023-08-01T19:54:32.310 INFO:teuthology.orchestra.run.smithi008.stdout: }, 2023-08-01T19:54:32.310 INFO:teuthology.orchestra.run.smithi008.stdout: { 2023-08-01T19:54:32.310 INFO:teuthology.orchestra.run.smithi008.stdout: "event": "all_read", 2023-08-01T19:54:32.311 INFO:teuthology.orchestra.run.smithi008.stdout: "time": "2023-08-01T19:54:32.287908+0000", 2023-08-01T19:54:32.311 INFO:teuthology.orchestra.run.smithi008.stdout: "duration": 0.000100876 2023-08-01T19:54:32.311 INFO:teuthology.orchestra.run.smithi008.stdout: }, 2023-08-01T19:54:32.311 INFO:teuthology.orchestra.run.smithi008.stdout: { 2023-08-01T19:54:32.311 INFO:teuthology.orchestra.run.smithi008.stdout: "event": "dispatched", 2023-08-01T19:54:32.311 INFO:teuthology.orchestra.run.smithi008.stdout: "time": "2023-08-01T19:54:32.287915+0000", 2023-08-01T19:54:32.311 INFO:teuthology.orchestra.run.smithi008.stdout: "duration": 7.8259999999999993e-06 2023-08-01T19:54:32.311 INFO:teuthology.orchestra.run.smithi008.stdout: }, 2023-08-01T19:54:32.312 INFO:teuthology.orchestra.run.smithi008.stdout: { 2023-08-01T19:54:32.312 INFO:teuthology.orchestra.run.smithi008.stdout: "event": "queued_for_pg", 2023-08-01T19:54:32.312 INFO:teuthology.orchestra.run.smithi008.stdout: "time": "2023-08-01T19:54:32.287920+0000", 2023-08-01T19:54:32.312 INFO:teuthology.orchestra.run.smithi008.stdout: "duration": 4.1980000000000003e-06 2023-08-01T19:54:32.312 INFO:teuthology.orchestra.run.smithi008.stdout: }, 2023-08-01T19:54:32.312 INFO:teuthology.orchestra.run.smithi008.stdout: { 2023-08-01T19:54:32.312 INFO:teuthology.orchestra.run.smithi008.stdout: "event": "reached_pg", 2023-08-01T19:54:32.312 INFO:teuthology.orchestra.run.smithi008.stdout: "time": "2023-08-01T19:54:32.287948+0000", 2023-08-01T19:54:32.313 INFO:teuthology.orchestra.run.smithi008.stdout: "duration": 2.8515999999999999e-05 2023-08-01T19:54:32.313 INFO:teuthology.orchestra.run.smithi008.stdout: }, 2023-08-01T19:54:32.313 INFO:teuthology.orchestra.run.smithi008.stdout: { 2023-08-01T19:54:32.313 INFO:teuthology.orchestra.run.smithi008.stdout: "event": "started", 2023-08-01T19:54:32.313 INFO:teuthology.orchestra.run.smithi008.stdout: "time": "2023-08-01T19:54:32.287964+0000", 2023-08-01T19:54:32.313 INFO:teuthology.orchestra.run.smithi008.stdout: "duration": 1.5491000000000001e-05 2023-08-01T19:54:32.313 INFO:teuthology.orchestra.run.smithi008.stdout: } 2023-08-01T19:54:32.313 INFO:teuthology.orchestra.run.smithi008.stdout: ] 2023-08-01T19:54:32.314 INFO:teuthology.orchestra.run.smithi008.stdout: } 2023-08-01T19:54:32.314 INFO:teuthology.orchestra.run.smithi008.stdout: }, 2023-08-01T19:54:32.314 INFO:teuthology.orchestra.run.smithi008.stdout: { 2023-08-01T19:54:32.314 INFO:teuthology.orchestra.run.smithi008.stdout: "description": "osd_repop(client.4668.0:28908 5.2 e24/19 5:4accd129:::benchmark_data_smithi006_114134_object28907:head v 24'1865, mlcod=24'1863)", 2023-08-01T19:54:32.314 INFO:teuthology.orchestra.run.smithi008.stdout: "initiated_at": "2023-08-01T19:54:32.287824+0000", 2023-08-01T19:54:32.314 INFO:teuthology.orchestra.run.smithi008.stdout: "age": 0.0017568099999999999, 2023-08-01T19:54:32.314 INFO:teuthology.orchestra.run.smithi008.stdout: "duration": 0.0020414140000000001, 2023-08-01T19:54:32.314 INFO:teuthology.orchestra.run.smithi008.stdout: "type_data": { 2023-08-01T19:54:32.315 INFO:teuthology.orchestra.run.smithi008.stdout: "flag_point": "started", 2023-08-01T19:54:32.315 INFO:teuthology.orchestra.run.smithi008.stdout: "events": [ 2023-08-01T19:54:32.315 INFO:teuthology.orchestra.run.smithi008.stdout: { 2023-08-01T19:54:32.315 INFO:teuthology.orchestra.run.smithi008.stdout: "event": "initiated", 2023-08-01T19:54:32.315 INFO:teuthology.orchestra.run.smithi008.stdout: "time": "2023-08-01T19:54:32.287824+0000", 2023-08-01T19:54:32.315 INFO:teuthology.orchestra.run.smithi008.stdout: "duration": 0 2023-08-01T19:54:32.315 INFO:teuthology.orchestra.run.smithi008.stdout: }, 2023-08-01T19:54:32.315 INFO:teuthology.orchestra.run.smithi008.stdout: { 2023-08-01T19:54:32.316 INFO:teuthology.orchestra.run.smithi008.stdout: "event": "throttled", 2023-08-01T19:54:32.316 INFO:teuthology.orchestra.run.smithi008.stdout: "time": "2023-08-01T19:54:32.287824+0000", 2023-08-01T19:54:32.316 INFO:teuthology.orchestra.run.smithi008.stdout: "duration": 0 2023-08-01T19:54:32.316 INFO:teuthology.orchestra.run.smithi008.stdout: }, 2023-08-01T19:54:32.316 INFO:teuthology.orchestra.run.smithi008.stdout: { 2023-08-01T19:54:32.316 INFO:teuthology.orchestra.run.smithi008.stdout: "event": "header_read", 2023-08-01T19:54:32.316 INFO:teuthology.orchestra.run.smithi008.stdout: "time": "2023-08-01T19:54:32.287824+0000", 2023-08-01T19:54:32.316 INFO:teuthology.orchestra.run.smithi008.stdout: "duration": 4294967296 2023-08-01T19:54:32.317 INFO:teuthology.orchestra.run.smithi008.stdout: }, 2023-08-01T19:54:32.317 INFO:teuthology.orchestra.run.smithi008.stdout: { 2023-08-01T19:54:32.317 INFO:teuthology.orchestra.run.smithi008.stdout: "event": "all_read", 2023-08-01T19:54:32.317 INFO:teuthology.orchestra.run.smithi008.stdout: "time": "2023-08-01T19:54:32.287954+0000", 2023-08-01T19:54:32.317 INFO:teuthology.orchestra.run.smithi008.stdout: "duration": 0.00012960099999999999 2023-08-01T19:54:32.317 INFO:teuthology.orchestra.run.smithi008.stdout: }, 2023-08-01T19:54:32.317 INFO:teuthology.orchestra.run.smithi008.stdout: { 2023-08-01T19:54:32.318 INFO:teuthology.orchestra.run.smithi008.stdout: "event": "dispatched", 2023-08-01T19:54:32.318 INFO:teuthology.orchestra.run.smithi008.stdout: "time": "2023-08-01T19:54:32.287960+0000", 2023-08-01T19:54:32.318 INFO:teuthology.orchestra.run.smithi008.stdout: "duration": 6.6100000000000002e-06 2023-08-01T19:54:32.318 INFO:teuthology.orchestra.run.smithi008.stdout: }, 2023-08-01T19:54:32.318 INFO:teuthology.orchestra.run.smithi008.stdout: { 2023-08-01T19:54:32.318 INFO:teuthology.orchestra.run.smithi008.stdout: "event": "queued_for_pg", 2023-08-01T19:54:32.318 INFO:teuthology.orchestra.run.smithi008.stdout: "time": "2023-08-01T19:54:32.287964+0000", 2023-08-01T19:54:32.318 INFO:teuthology.orchestra.run.smithi008.stdout: "duration": 3.6430000000000001e-06 2023-08-01T19:54:32.319 INFO:teuthology.orchestra.run.smithi008.stdout: }, 2023-08-01T19:54:32.319 INFO:teuthology.orchestra.run.smithi008.stdout: { 2023-08-01T19:54:32.319 INFO:teuthology.orchestra.run.smithi008.stdout: "event": "reached_pg", 2023-08-01T19:54:32.319 INFO:teuthology.orchestra.run.smithi008.stdout: "time": "2023-08-01T19:54:32.288694+0000", 2023-08-01T19:54:32.319 INFO:teuthology.orchestra.run.smithi008.stdout: "duration": 0.00072963200000000002 2023-08-01T19:54:32.319 INFO:teuthology.orchestra.run.smithi008.stdout: }, 2023-08-01T19:54:32.319 INFO:teuthology.orchestra.run.smithi008.stdout: { 2023-08-01T19:54:32.319 INFO:teuthology.orchestra.run.smithi008.stdout: "event": "started", 2023-08-01T19:54:32.320 INFO:teuthology.orchestra.run.smithi008.stdout: "time": "2023-08-01T19:54:32.288717+0000", 2023-08-01T19:54:32.320 INFO:teuthology.orchestra.run.smithi008.stdout: "duration": 2.3768999999999999e-05 2023-08-01T19:54:32.320 INFO:teuthology.orchestra.run.smithi008.stdout: } 2023-08-01T19:54:32.320 INFO:teuthology.orchestra.run.smithi008.stdout: ] 2023-08-01T19:54:32.320 INFO:teuthology.orchestra.run.smithi008.stdout: } 2023-08-01T19:54:32.320 INFO:teuthology.orchestra.run.smithi008.stdout: }, 2023-08-01T19:54:32.320 INFO:teuthology.orchestra.run.smithi008.stdout: { 2023-08-01T19:54:32.320 INFO:teuthology.orchestra.run.smithi008.stdout: "description": "osd_repop(client.4668.0:28910 5.7 e24/19 5:eb9cd0fa:::benchmark_data_smithi006_114134_object28909:head v 24'1780, mlcod=24'1777)", 2023-08-01T19:54:32.321 INFO:teuthology.orchestra.run.smithi008.stdout: "initiated_at": "2023-08-01T19:54:32.288076+0000", 2023-08-01T19:54:32.321 INFO:teuthology.orchestra.run.smithi008.stdout: "age": 0.001504802, 2023-08-01T19:54:32.321 INFO:teuthology.orchestra.run.smithi008.stdout: "duration": 0.0018900779999999999, 2023-08-01T19:54:32.321 INFO:teuthology.orchestra.run.smithi008.stdout: "type_data": { 2023-08-01T19:54:32.321 INFO:teuthology.orchestra.run.smithi008.stdout: "flag_point": "started", 2023-08-01T19:54:32.321 INFO:teuthology.orchestra.run.smithi008.stdout: "events": [ 2023-08-01T19:54:32.321 INFO:teuthology.orchestra.run.smithi008.stdout: { 2023-08-01T19:54:32.321 INFO:teuthology.orchestra.run.smithi008.stdout: "event": "initiated", 2023-08-01T19:54:32.322 INFO:teuthology.orchestra.run.smithi008.stdout: "time": "2023-08-01T19:54:32.288076+0000", 2023-08-01T19:54:32.322 INFO:teuthology.orchestra.run.smithi008.stdout: "duration": 0 2023-08-01T19:54:32.322 INFO:teuthology.orchestra.run.smithi008.stdout: }, 2023-08-01T19:54:32.322 INFO:teuthology.orchestra.run.smithi008.stdout: { 2023-08-01T19:54:32.322 INFO:teuthology.orchestra.run.smithi008.stdout: "event": "throttled", 2023-08-01T19:54:32.322 INFO:teuthology.orchestra.run.smithi008.stdout: "time": "2023-08-01T19:54:32.288076+0000", 2023-08-01T19:54:32.322 INFO:teuthology.orchestra.run.smithi008.stdout: "duration": 0 2023-08-01T19:54:32.322 INFO:teuthology.orchestra.run.smithi008.stdout: }, 2023-08-01T19:54:32.323 INFO:teuthology.orchestra.run.smithi008.stdout: { 2023-08-01T19:54:32.323 INFO:teuthology.orchestra.run.smithi008.stdout: "event": "header_read", 2023-08-01T19:54:32.323 INFO:teuthology.orchestra.run.smithi008.stdout: "time": "2023-08-01T19:54:32.288076+0000", 2023-08-01T19:54:32.323 INFO:teuthology.orchestra.run.smithi008.stdout: "duration": 4294967295.9999995 2023-08-01T19:54:32.323 INFO:teuthology.orchestra.run.smithi008.stdout: }, 2023-08-01T19:54:32.323 INFO:teuthology.orchestra.run.smithi008.stdout: { 2023-08-01T19:54:32.323 INFO:teuthology.orchestra.run.smithi008.stdout: "event": "all_read", 2023-08-01T19:54:32.323 INFO:teuthology.orchestra.run.smithi008.stdout: "time": "2023-08-01T19:54:32.288170+0000", 2023-08-01T19:54:32.324 INFO:teuthology.orchestra.run.smithi008.stdout: "duration": 9.3776999999999993e-05 2023-08-01T19:54:32.324 INFO:teuthology.orchestra.run.smithi008.stdout: }, 2023-08-01T19:54:32.324 INFO:teuthology.orchestra.run.smithi008.stdout: { 2023-08-01T19:54:32.324 INFO:teuthology.orchestra.run.smithi008.stdout: "event": "dispatched", 2023-08-01T19:54:32.324 INFO:teuthology.orchestra.run.smithi008.stdout: "time": "2023-08-01T19:54:32.288178+0000", 2023-08-01T19:54:32.324 INFO:teuthology.orchestra.run.smithi008.stdout: "duration": 8.3599999999999996e-06 2023-08-01T19:54:32.324 INFO:teuthology.orchestra.run.smithi008.stdout: }, 2023-08-01T19:54:32.325 INFO:teuthology.orchestra.run.smithi008.stdout: { 2023-08-01T19:54:32.325 INFO:teuthology.orchestra.run.smithi008.stdout: "event": "queued_for_pg", 2023-08-01T19:54:32.325 INFO:teuthology.orchestra.run.smithi008.stdout: "time": "2023-08-01T19:54:32.288183+0000", 2023-08-01T19:54:32.325 INFO:teuthology.orchestra.run.smithi008.stdout: "duration": 5.3369999999999999e-06 2023-08-01T19:54:32.325 INFO:teuthology.orchestra.run.smithi008.stdout: }, 2023-08-01T19:54:32.325 INFO:teuthology.orchestra.run.smithi008.stdout: { 2023-08-01T19:54:32.325 INFO:teuthology.orchestra.run.smithi008.stdout: "event": "reached_pg", 2023-08-01T19:54:32.325 INFO:teuthology.orchestra.run.smithi008.stdout: "time": "2023-08-01T19:54:32.288304+0000", 2023-08-01T19:54:32.326 INFO:teuthology.orchestra.run.smithi008.stdout: "duration": 0.000120375 2023-08-01T19:54:32.326 INFO:teuthology.orchestra.run.smithi008.stdout: }, 2023-08-01T19:54:32.326 INFO:teuthology.orchestra.run.smithi008.stdout: { 2023-08-01T19:54:32.326 INFO:teuthology.orchestra.run.smithi008.stdout: "event": "started", 2023-08-01T19:54:32.326 INFO:teuthology.orchestra.run.smithi008.stdout: "time": "2023-08-01T19:54:32.288323+0000", 2023-08-01T19:54:32.326 INFO:teuthology.orchestra.run.smithi008.stdout: "duration": 1.9453000000000002e-05 2023-08-01T19:54:32.326 INFO:teuthology.orchestra.run.smithi008.stdout: } 2023-08-01T19:54:32.326 INFO:teuthology.orchestra.run.smithi008.stdout: ] 2023-08-01T19:54:32.327 INFO:teuthology.orchestra.run.smithi008.stdout: } 2023-08-01T19:54:32.327 INFO:teuthology.orchestra.run.smithi008.stdout: }, 2023-08-01T19:54:32.327 INFO:teuthology.orchestra.run.smithi008.stdout: { 2023-08-01T19:54:32.327 INFO:teuthology.orchestra.run.smithi008.stdout: "description": "osd_repop(client.4668.0:28913 5.0 e24/19 5:0586ec8b:::benchmark_data_smithi006_114134_object28912:head v 24'1838, mlcod=24'1834)", 2023-08-01T19:54:32.327 INFO:teuthology.orchestra.run.smithi008.stdout: "initiated_at": "2023-08-01T19:54:32.289352+0000", 2023-08-01T19:54:32.327 INFO:teuthology.orchestra.run.smithi008.stdout: "age": 0.00022900399999999999, 2023-08-01T19:54:32.327 INFO:teuthology.orchestra.run.smithi008.stdout: "duration": 0.00068672399999999999, 2023-08-01T19:54:32.327 INFO:teuthology.orchestra.run.smithi008.stdout: "type_data": { 2023-08-01T19:54:32.328 INFO:teuthology.orchestra.run.smithi008.stdout: "flag_point": "started", 2023-08-01T19:54:32.328 INFO:teuthology.orchestra.run.smithi008.stdout: "events": [ 2023-08-01T19:54:32.328 INFO:teuthology.orchestra.run.smithi008.stdout: { 2023-08-01T19:54:32.328 INFO:teuthology.orchestra.run.smithi008.stdout: "event": "initiated", 2023-08-01T19:54:32.328 INFO:teuthology.orchestra.run.smithi008.stdout: "time": "2023-08-01T19:54:32.289352+0000", 2023-08-01T19:54:32.328 INFO:teuthology.orchestra.run.smithi008.stdout: "duration": 0 2023-08-01T19:54:32.328 INFO:teuthology.orchestra.run.smithi008.stdout: }, 2023-08-01T19:54:32.328 INFO:teuthology.orchestra.run.smithi008.stdout: { 2023-08-01T19:54:32.329 INFO:teuthology.orchestra.run.smithi008.stdout: "event": "throttled", 2023-08-01T19:54:32.329 INFO:teuthology.orchestra.run.smithi008.stdout: "time": "2023-08-01T19:54:32.289352+0000", 2023-08-01T19:54:32.329 INFO:teuthology.orchestra.run.smithi008.stdout: "duration": 0 2023-08-01T19:54:32.329 INFO:teuthology.orchestra.run.smithi008.stdout: }, 2023-08-01T19:54:32.329 INFO:teuthology.orchestra.run.smithi008.stdout: { 2023-08-01T19:54:32.329 INFO:teuthology.orchestra.run.smithi008.stdout: "event": "header_read", 2023-08-01T19:54:32.329 INFO:teuthology.orchestra.run.smithi008.stdout: "time": "2023-08-01T19:54:32.289351+0000", 2023-08-01T19:54:32.329 INFO:teuthology.orchestra.run.smithi008.stdout: "duration": 4294967295.999999 2023-08-01T19:54:32.330 INFO:teuthology.orchestra.run.smithi008.stdout: }, 2023-08-01T19:54:32.330 INFO:teuthology.orchestra.run.smithi008.stdout: { 2023-08-01T19:54:32.330 INFO:teuthology.orchestra.run.smithi008.stdout: "event": "all_read", 2023-08-01T19:54:32.330 INFO:teuthology.orchestra.run.smithi008.stdout: "time": "2023-08-01T19:54:32.289421+0000", 2023-08-01T19:54:32.330 INFO:teuthology.orchestra.run.smithi008.stdout: "duration": 6.9991000000000001e-05 2023-08-01T19:54:32.330 INFO:teuthology.orchestra.run.smithi008.stdout: }, 2023-08-01T19:54:32.330 INFO:teuthology.orchestra.run.smithi008.stdout: { 2023-08-01T19:54:32.330 INFO:teuthology.orchestra.run.smithi008.stdout: "event": "dispatched", 2023-08-01T19:54:32.331 INFO:teuthology.orchestra.run.smithi008.stdout: "time": "2023-08-01T19:54:32.289436+0000", 2023-08-01T19:54:32.331 INFO:teuthology.orchestra.run.smithi008.stdout: "duration": 1.4415e-05 2023-08-01T19:54:32.331 INFO:teuthology.orchestra.run.smithi008.stdout: }, 2023-08-01T19:54:32.331 INFO:teuthology.orchestra.run.smithi008.stdout: { 2023-08-01T19:54:32.331 INFO:teuthology.orchestra.run.smithi008.stdout: "event": "queued_for_pg", 2023-08-01T19:54:32.331 INFO:teuthology.orchestra.run.smithi008.stdout: "time": "2023-08-01T19:54:32.289442+0000", 2023-08-01T19:54:32.331 INFO:teuthology.orchestra.run.smithi008.stdout: "duration": 6.9800000000000001e-06 2023-08-01T19:54:32.331 INFO:teuthology.orchestra.run.smithi008.stdout: }, 2023-08-01T19:54:32.332 INFO:teuthology.orchestra.run.smithi008.stdout: { 2023-08-01T19:54:32.332 INFO:teuthology.orchestra.run.smithi008.stdout: "event": "reached_pg", 2023-08-01T19:54:32.332 INFO:teuthology.orchestra.run.smithi008.stdout: "time": "2023-08-01T19:54:32.289485+0000", 2023-08-01T19:54:32.332 INFO:teuthology.orchestra.run.smithi008.stdout: "duration": 4.2613e-05 2023-08-01T19:54:32.332 INFO:teuthology.orchestra.run.smithi008.stdout: }, 2023-08-01T19:54:32.332 INFO:teuthology.orchestra.run.smithi008.stdout: { 2023-08-01T19:54:32.332 INFO:teuthology.orchestra.run.smithi008.stdout: "event": "started", 2023-08-01T19:54:32.333 INFO:teuthology.orchestra.run.smithi008.stdout: "time": "2023-08-01T19:54:32.289502+0000", 2023-08-01T19:54:32.333 INFO:teuthology.orchestra.run.smithi008.stdout: "duration": 1.715e-05 2023-08-01T19:54:32.333 INFO:teuthology.orchestra.run.smithi008.stdout: } 2023-08-01T19:54:32.333 INFO:teuthology.orchestra.run.smithi008.stdout: ] 2023-08-01T19:54:32.333 INFO:teuthology.orchestra.run.smithi008.stdout: } 2023-08-01T19:54:32.333 INFO:teuthology.orchestra.run.smithi008.stdout: }, 2023-08-01T19:54:32.333 INFO:teuthology.orchestra.run.smithi008.stdout: { 2023-08-01T19:54:32.333 INFO:teuthology.orchestra.run.smithi008.stdout: "description": "osd_op(client.4668.0:28912 5.5 5:a271fc7a:::benchmark_data_smithi006_114134_object28911:head [set-alloc-hint object_size 65536 write_size 65536,write 0~65536 in=65536b] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e24)", 2023-08-01T19:54:32.334 INFO:teuthology.orchestra.run.smithi008.stdout: "initiated_at": "2023-08-01T19:54:32.289444+0000", 2023-08-01T19:54:32.334 INFO:teuthology.orchestra.run.smithi008.stdout: "age": 0.00013664499999999999, 2023-08-01T19:54:32.334 INFO:teuthology.orchestra.run.smithi008.stdout: "duration": 0.00066277000000000003, 2023-08-01T19:54:32.334 INFO:teuthology.orchestra.run.smithi008.stdout: "type_data": { 2023-08-01T19:54:32.334 INFO:teuthology.orchestra.run.smithi008.stdout: "flag_point": "waiting for sub ops", 2023-08-01T19:54:32.334 INFO:teuthology.orchestra.run.smithi008.stdout: "client_info": { 2023-08-01T19:54:32.334 INFO:teuthology.orchestra.run.smithi008.stdout: "client": "client.4668", 2023-08-01T19:54:32.334 INFO:teuthology.orchestra.run.smithi008.stdout: "client_addr": "172.21.15.6:0/1709472247", 2023-08-01T19:54:32.335 INFO:teuthology.orchestra.run.smithi008.stdout: "tid": 28912 2023-08-01T19:54:32.335 INFO:teuthology.orchestra.run.smithi008.stdout: }, 2023-08-01T19:54:32.335 INFO:teuthology.orchestra.run.smithi008.stdout: "events": [ 2023-08-01T19:54:32.335 INFO:teuthology.orchestra.run.smithi008.stdout: { 2023-08-01T19:54:32.335 INFO:teuthology.orchestra.run.smithi008.stdout: "event": "initiated", 2023-08-01T19:54:32.335 INFO:teuthology.orchestra.run.smithi008.stdout: "time": "2023-08-01T19:54:32.289444+0000", 2023-08-01T19:54:32.335 INFO:teuthology.orchestra.run.smithi008.stdout: "duration": 0 2023-08-01T19:54:32.335 INFO:teuthology.orchestra.run.smithi008.stdout: }, 2023-08-01T19:54:32.336 INFO:teuthology.orchestra.run.smithi008.stdout: { 2023-08-01T19:54:32.336 INFO:teuthology.orchestra.run.smithi008.stdout: "event": "throttled", 2023-08-01T19:54:32.336 INFO:teuthology.orchestra.run.smithi008.stdout: "time": "2023-08-01T19:54:32.289444+0000", 2023-08-01T19:54:32.336 INFO:teuthology.orchestra.run.smithi008.stdout: "duration": 0 2023-08-01T19:54:32.336 INFO:teuthology.orchestra.run.smithi008.stdout: }, 2023-08-01T19:54:32.336 INFO:teuthology.orchestra.run.smithi008.stdout: { 2023-08-01T19:54:32.336 INFO:teuthology.orchestra.run.smithi008.stdout: "event": "header_read", 2023-08-01T19:54:32.336 INFO:teuthology.orchestra.run.smithi008.stdout: "time": "2023-08-01T19:54:32.289444+0000", 2023-08-01T19:54:32.337 INFO:teuthology.orchestra.run.smithi008.stdout: "duration": 4294967295.999999 2023-08-01T19:54:32.337 INFO:teuthology.orchestra.run.smithi008.stdout: }, 2023-08-01T19:54:32.337 INFO:teuthology.orchestra.run.smithi008.stdout: { 2023-08-01T19:54:32.337 INFO:teuthology.orchestra.run.smithi008.stdout: "event": "all_read", 2023-08-01T19:54:32.337 INFO:teuthology.orchestra.run.smithi008.stdout: "time": "2023-08-01T19:54:32.289478+0000", 2023-08-01T19:54:32.337 INFO:teuthology.orchestra.run.smithi008.stdout: "duration": 3.4654999999999999e-05 2023-08-01T19:54:32.337 INFO:teuthology.orchestra.run.smithi008.stdout: }, 2023-08-01T19:54:32.337 INFO:teuthology.orchestra.run.smithi008.stdout: { 2023-08-01T19:54:32.338 INFO:teuthology.orchestra.run.smithi008.stdout: "event": "dispatched", 2023-08-01T19:54:32.338 INFO:teuthology.orchestra.run.smithi008.stdout: "time": "2023-08-01T19:54:32.289489+0000", 2023-08-01T19:54:32.338 INFO:teuthology.orchestra.run.smithi008.stdout: "duration": 1.012e-05 2023-08-01T19:54:32.338 INFO:teuthology.orchestra.run.smithi008.stdout: }, 2023-08-01T19:54:32.338 INFO:teuthology.orchestra.run.smithi008.stdout: { 2023-08-01T19:54:32.338 INFO:teuthology.orchestra.run.smithi008.stdout: "event": "queued_for_pg", 2023-08-01T19:54:32.338 INFO:teuthology.orchestra.run.smithi008.stdout: "time": "2023-08-01T19:54:32.289494+0000", 2023-08-01T19:54:32.338 INFO:teuthology.orchestra.run.smithi008.stdout: "duration": 5.4070000000000001e-06 2023-08-01T19:54:32.339 INFO:teuthology.orchestra.run.smithi008.stdout: }, 2023-08-01T19:54:32.339 INFO:teuthology.orchestra.run.smithi008.stdout: { 2023-08-01T19:54:32.339 INFO:teuthology.orchestra.run.smithi008.stdout: "event": "reached_pg", 2023-08-01T19:54:32.339 INFO:teuthology.orchestra.run.smithi008.stdout: "time": "2023-08-01T19:54:32.289536+0000", 2023-08-01T19:54:32.339 INFO:teuthology.orchestra.run.smithi008.stdout: "duration": 4.2101000000000002e-05 2023-08-01T19:54:32.339 INFO:teuthology.orchestra.run.smithi008.stdout: }, 2023-08-01T19:54:32.339 INFO:teuthology.orchestra.run.smithi008.stdout: { 2023-08-01T19:54:32.339 INFO:teuthology.orchestra.run.smithi008.stdout: "event": "started", 2023-08-01T19:54:32.340 INFO:teuthology.orchestra.run.smithi008.stdout: "time": "2023-08-01T19:54:32.289667+0000", 2023-08-01T19:54:32.340 INFO:teuthology.orchestra.run.smithi008.stdout: "duration": 0.00013067999999999999 2023-08-01T19:54:32.340 INFO:teuthology.orchestra.run.smithi008.stdout: }, 2023-08-01T19:54:32.340 INFO:teuthology.orchestra.run.smithi008.stdout: { 2023-08-01T19:54:32.340 INFO:teuthology.orchestra.run.smithi008.stdout: "event": "waiting for subops from 1", 2023-08-01T19:54:32.340 INFO:teuthology.orchestra.run.smithi008.stdout: "time": "2023-08-01T19:54:32.289766+0000", 2023-08-01T19:54:32.340 INFO:teuthology.orchestra.run.smithi008.stdout: "duration": 9.9599999999999995e-05 2023-08-01T19:54:32.340 INFO:teuthology.orchestra.run.smithi008.stdout: } 2023-08-01T19:54:32.341 INFO:teuthology.orchestra.run.smithi008.stdout: ] 2023-08-01T19:54:32.341 INFO:teuthology.orchestra.run.smithi008.stdout: } 2023-08-01T19:54:32.341 INFO:teuthology.orchestra.run.smithi008.stdout: }, 2023-08-01T19:54:32.341 INFO:teuthology.orchestra.run.smithi008.stdout: { 2023-08-01T19:54:32.341 INFO:teuthology.orchestra.run.smithi008.stdout: "description": "osd_op(client.4668.0:28914 5.5 5.89248b75 (undecoded) ondisk+write+known_if_redirected+supports_pool_eio e24)", 2023-08-01T19:54:32.341 INFO:teuthology.orchestra.run.smithi008.stdout: "initiated_at": "2023-08-01T19:54:32.289505+0000", 2023-08-01T19:54:32.341 INFO:teuthology.orchestra.run.smithi008.stdout: "age": 7.5694999999999999e-05, 2023-08-01T19:54:32.341 INFO:teuthology.orchestra.run.smithi008.stdout: "duration": 0.00067845600000000002, 2023-08-01T19:54:32.342 INFO:teuthology.orchestra.run.smithi008.stdout: "type_data": { 2023-08-01T19:54:32.342 INFO:teuthology.orchestra.run.smithi008.stdout: "flag_point": "queued for pg", 2023-08-01T19:54:32.342 INFO:teuthology.orchestra.run.smithi008.stdout: "client_info": { 2023-08-01T19:54:32.342 INFO:teuthology.orchestra.run.smithi008.stdout: "client": "client.4668", 2023-08-01T19:54:32.342 INFO:teuthology.orchestra.run.smithi008.stdout: "client_addr": "172.21.15.6:0/1709472247", 2023-08-01T19:54:32.342 INFO:teuthology.orchestra.run.smithi008.stdout: "tid": 28914 2023-08-01T19:54:32.342 INFO:teuthology.orchestra.run.smithi008.stdout: }, 2023-08-01T19:54:32.343 INFO:teuthology.orchestra.run.smithi008.stdout: "events": [ 2023-08-01T19:54:32.343 INFO:teuthology.orchestra.run.smithi008.stdout: { 2023-08-01T19:54:32.343 INFO:teuthology.orchestra.run.smithi008.stdout: "event": "initiated", 2023-08-01T19:54:32.343 INFO:teuthology.orchestra.run.smithi008.stdout: "time": "2023-08-01T19:54:32.289505+0000", 2023-08-01T19:54:32.343 INFO:teuthology.orchestra.run.smithi008.stdout: "duration": 0 2023-08-01T19:54:32.343 INFO:teuthology.orchestra.run.smithi008.stdout: }, 2023-08-01T19:54:32.343 INFO:teuthology.orchestra.run.smithi008.stdout: { 2023-08-01T19:54:32.343 INFO:teuthology.orchestra.run.smithi008.stdout: "event": "throttled", 2023-08-01T19:54:32.344 INFO:teuthology.orchestra.run.smithi008.stdout: "time": "2023-08-01T19:54:32.289505+0000", 2023-08-01T19:54:32.344 INFO:teuthology.orchestra.run.smithi008.stdout: "duration": 0 2023-08-01T19:54:32.344 INFO:teuthology.orchestra.run.smithi008.stdout: }, 2023-08-01T19:54:32.344 INFO:teuthology.orchestra.run.smithi008.stdout: { 2023-08-01T19:54:32.344 INFO:teuthology.orchestra.run.smithi008.stdout: "event": "header_read", 2023-08-01T19:54:32.344 INFO:teuthology.orchestra.run.smithi008.stdout: "time": "2023-08-01T19:54:32.289505+0000", 2023-08-01T19:54:32.344 INFO:teuthology.orchestra.run.smithi008.stdout: "duration": 4294967295.9999995 2023-08-01T19:54:32.344 INFO:teuthology.orchestra.run.smithi008.stdout: }, 2023-08-01T19:54:32.345 INFO:teuthology.orchestra.run.smithi008.stdout: { 2023-08-01T19:54:32.345 INFO:teuthology.orchestra.run.smithi008.stdout: "event": "all_read", 2023-08-01T19:54:32.345 INFO:teuthology.orchestra.run.smithi008.stdout: "time": "2023-08-01T19:54:32.289533+0000", 2023-08-01T19:54:32.345 INFO:teuthology.orchestra.run.smithi008.stdout: "duration": 2.8169000000000001e-05 2023-08-01T19:54:32.345 INFO:teuthology.orchestra.run.smithi008.stdout: }, 2023-08-01T19:54:32.345 INFO:teuthology.orchestra.run.smithi008.stdout: { 2023-08-01T19:54:32.345 INFO:teuthology.orchestra.run.smithi008.stdout: "event": "dispatched", 2023-08-01T19:54:32.345 INFO:teuthology.orchestra.run.smithi008.stdout: "time": "2023-08-01T19:54:32.289543+0000", 2023-08-01T19:54:32.346 INFO:teuthology.orchestra.run.smithi008.stdout: "duration": 9.8770000000000005e-06 2023-08-01T19:54:32.346 INFO:teuthology.orchestra.run.smithi008.stdout: }, 2023-08-01T19:54:32.346 INFO:teuthology.orchestra.run.smithi008.stdout: { 2023-08-01T19:54:32.346 INFO:teuthology.orchestra.run.smithi008.stdout: "event": "queued_for_pg", 2023-08-01T19:54:32.346 INFO:teuthology.orchestra.run.smithi008.stdout: "time": "2023-08-01T19:54:32.289548+0000", 2023-08-01T19:54:32.346 INFO:teuthology.orchestra.run.smithi008.stdout: "duration": 5.186e-06 2023-08-01T19:54:32.346 INFO:teuthology.orchestra.run.smithi008.stdout: } 2023-08-01T19:54:32.346 INFO:teuthology.orchestra.run.smithi008.stdout: ] 2023-08-01T19:54:32.347 INFO:teuthology.orchestra.run.smithi008.stdout: } 2023-08-01T19:54:32.347 INFO:teuthology.orchestra.run.smithi008.stdout: }, 2023-08-01T19:54:32.347 INFO:teuthology.orchestra.run.smithi008.stdout: { 2023-08-01T19:54:32.347 INFO:teuthology.orchestra.run.smithi008.stdout: "description": "osd_op(client.4668.0:28916 5.c 5:30c0019f:::benchmark_data_smithi006_114134_object28915:head [set-alloc-hint object_size 65536 write_size 65536,write 0~65536 in=65536b] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e24)", 2023-08-01T19:54:32.347 INFO:teuthology.orchestra.run.smithi008.stdout: "initiated_at": "2023-08-01T19:54:32.289614+0000", 2023-08-01T19:54:32.347 INFO:teuthology.orchestra.run.smithi008.stdout: "age": 4294967295.9999676, 2023-08-01T19:54:32.347 INFO:teuthology.orchestra.run.smithi008.stdout: "duration": 0.00063245499999999997, 2023-08-01T19:54:32.347 INFO:teuthology.orchestra.run.smithi008.stdout: "type_data": { 2023-08-01T19:54:32.348 INFO:teuthology.orchestra.run.smithi008.stdout: "flag_point": "waiting for sub ops", 2023-08-01T19:54:32.348 INFO:teuthology.orchestra.run.smithi008.stdout: "client_info": { 2023-08-01T19:54:32.348 INFO:teuthology.orchestra.run.smithi008.stdout: "client": "client.4668", 2023-08-01T19:54:32.348 INFO:teuthology.orchestra.run.smithi008.stdout: "client_addr": "172.21.15.6:0/1709472247", 2023-08-01T19:54:32.348 INFO:teuthology.orchestra.run.smithi008.stdout: "tid": 28916 2023-08-01T19:54:32.348 INFO:teuthology.orchestra.run.smithi008.stdout: }, 2023-08-01T19:54:32.348 INFO:teuthology.orchestra.run.smithi008.stdout: "events": [ 2023-08-01T19:54:32.348 INFO:teuthology.orchestra.run.smithi008.stdout: { 2023-08-01T19:54:32.349 INFO:teuthology.orchestra.run.smithi008.stdout: "event": "initiated", 2023-08-01T19:54:32.349 INFO:teuthology.orchestra.run.smithi008.stdout: "time": "2023-08-01T19:54:32.289614+0000", 2023-08-01T19:54:32.349 INFO:teuthology.orchestra.run.smithi008.stdout: "duration": 0 2023-08-01T19:54:32.349 INFO:teuthology.orchestra.run.smithi008.stdout: }, 2023-08-01T19:54:32.349 INFO:teuthology.orchestra.run.smithi008.stdout: { 2023-08-01T19:54:32.349 INFO:teuthology.orchestra.run.smithi008.stdout: "event": "throttled", 2023-08-01T19:54:32.349 INFO:teuthology.orchestra.run.smithi008.stdout: "time": "2023-08-01T19:54:32.289614+0000", 2023-08-01T19:54:32.349 INFO:teuthology.orchestra.run.smithi008.stdout: "duration": 0 2023-08-01T19:54:32.350 INFO:teuthology.orchestra.run.smithi008.stdout: }, 2023-08-01T19:54:32.350 INFO:teuthology.orchestra.run.smithi008.stdout: { 2023-08-01T19:54:32.350 INFO:teuthology.orchestra.run.smithi008.stdout: "event": "header_read", 2023-08-01T19:54:32.350 INFO:teuthology.orchestra.run.smithi008.stdout: "time": "2023-08-01T19:54:32.289613+0000", 2023-08-01T19:54:32.350 INFO:teuthology.orchestra.run.smithi008.stdout: "duration": 4294967295.999999 2023-08-01T19:54:32.350 INFO:teuthology.orchestra.run.smithi008.stdout: }, 2023-08-01T19:54:32.350 INFO:teuthology.orchestra.run.smithi008.stdout: { 2023-08-01T19:54:32.350 INFO:teuthology.orchestra.run.smithi008.stdout: "event": "all_read", 2023-08-01T19:54:32.351 INFO:teuthology.orchestra.run.smithi008.stdout: "time": "2023-08-01T19:54:32.289668+0000", 2023-08-01T19:54:32.351 INFO:teuthology.orchestra.run.smithi008.stdout: "duration": 5.5099000000000002e-05 2023-08-01T19:54:32.351 INFO:teuthology.orchestra.run.smithi008.stdout: }, 2023-08-01T19:54:32.351 INFO:teuthology.orchestra.run.smithi008.stdout: { 2023-08-01T19:54:32.351 INFO:teuthology.orchestra.run.smithi008.stdout: "event": "dispatched", 2023-08-01T19:54:32.351 INFO:teuthology.orchestra.run.smithi008.stdout: "time": "2023-08-01T19:54:32.289677+0000", 2023-08-01T19:54:32.351 INFO:teuthology.orchestra.run.smithi008.stdout: "duration": 9.2390000000000008e-06 2023-08-01T19:54:32.351 INFO:teuthology.orchestra.run.smithi008.stdout: }, 2023-08-01T19:54:32.352 INFO:teuthology.orchestra.run.smithi008.stdout: { 2023-08-01T19:54:32.352 INFO:teuthology.orchestra.run.smithi008.stdout: "event": "queued_for_pg", 2023-08-01T19:54:32.352 INFO:teuthology.orchestra.run.smithi008.stdout: "time": "2023-08-01T19:54:32.289682+0000", 2023-08-01T19:54:32.352 INFO:teuthology.orchestra.run.smithi008.stdout: "duration": 4.9250000000000003e-06 2023-08-01T19:54:32.352 INFO:teuthology.orchestra.run.smithi008.stdout: }, 2023-08-01T19:54:32.352 INFO:teuthology.orchestra.run.smithi008.stdout: { 2023-08-01T19:54:32.352 INFO:teuthology.orchestra.run.smithi008.stdout: "event": "reached_pg", 2023-08-01T19:54:32.353 INFO:teuthology.orchestra.run.smithi008.stdout: "time": "2023-08-01T19:54:32.289722+0000", 2023-08-01T19:54:32.353 INFO:teuthology.orchestra.run.smithi008.stdout: "duration": 3.9594000000000001e-05 2023-08-01T19:54:32.353 INFO:teuthology.orchestra.run.smithi008.stdout: }, 2023-08-01T19:54:32.353 INFO:teuthology.orchestra.run.smithi008.stdout: { 2023-08-01T19:54:32.353 INFO:teuthology.orchestra.run.smithi008.stdout: "event": "started", 2023-08-01T19:54:32.353 INFO:teuthology.orchestra.run.smithi008.stdout: "time": "2023-08-01T19:54:32.289853+0000", 2023-08-01T19:54:32.353 INFO:teuthology.orchestra.run.smithi008.stdout: "duration": 0.00013134999999999999 2023-08-01T19:54:32.353 INFO:teuthology.orchestra.run.smithi008.stdout: }, 2023-08-01T19:54:32.354 INFO:teuthology.orchestra.run.smithi008.stdout: { 2023-08-01T19:54:32.354 INFO:teuthology.orchestra.run.smithi008.stdout: "event": "waiting for subops from 1", 2023-08-01T19:54:32.354 INFO:teuthology.orchestra.run.smithi008.stdout: "time": "2023-08-01T19:54:32.290025+0000", 2023-08-01T19:54:32.354 INFO:teuthology.orchestra.run.smithi008.stdout: "duration": 0.00017170400000000001 2023-08-01T19:54:32.354 INFO:teuthology.orchestra.run.smithi008.stdout: } 2023-08-01T19:54:32.354 INFO:teuthology.orchestra.run.smithi008.stdout: ] 2023-08-01T19:54:32.354 INFO:teuthology.orchestra.run.smithi008.stdout: } 2023-08-01T19:54:32.354 INFO:teuthology.orchestra.run.smithi008.stdout: }, 2023-08-01T19:54:32.355 INFO:teuthology.orchestra.run.smithi008.stdout: { 2023-08-01T19:54:32.355 INFO:teuthology.orchestra.run.smithi008.stdout: "description": "osd_repop(client.4668.0:28915 5.1 e24/19 5:8f13dba6:::benchmark_data_smithi006_114134_object28914:head v 24'1867, mlcod=24'1865)", 2023-08-01T19:54:32.355 INFO:teuthology.orchestra.run.smithi008.stdout: "initiated_at": "2023-08-01T19:54:32.289763+0000", 2023-08-01T19:54:32.355 INFO:teuthology.orchestra.run.smithi008.stdout: "age": 4294967295.9998178, 2023-08-01T19:54:32.355 INFO:teuthology.orchestra.run.smithi008.stdout: "duration": 0.00055453499999999999, 2023-08-01T19:54:32.355 INFO:teuthology.orchestra.run.smithi008.stdout: "type_data": { 2023-08-01T19:54:32.355 INFO:teuthology.orchestra.run.smithi008.stdout: "flag_point": "started", 2023-08-01T19:54:32.355 INFO:teuthology.orchestra.run.smithi008.stdout: "events": [ 2023-08-01T19:54:32.356 INFO:teuthology.orchestra.run.smithi008.stdout: { 2023-08-01T19:54:32.356 INFO:teuthology.orchestra.run.smithi008.stdout: "event": "initiated", 2023-08-01T19:54:32.356 INFO:teuthology.orchestra.run.smithi008.stdout: "time": "2023-08-01T19:54:32.289763+0000", 2023-08-01T19:54:32.356 INFO:teuthology.orchestra.run.smithi008.stdout: "duration": 0 2023-08-01T19:54:32.356 INFO:teuthology.orchestra.run.smithi008.stdout: }, 2023-08-01T19:54:32.356 INFO:teuthology.orchestra.run.smithi008.stdout: { 2023-08-01T19:54:32.356 INFO:teuthology.orchestra.run.smithi008.stdout: "event": "throttled", 2023-08-01T19:54:32.356 INFO:teuthology.orchestra.run.smithi008.stdout: "time": "2023-08-01T19:54:32.289763+0000", 2023-08-01T19:54:32.357 INFO:teuthology.orchestra.run.smithi008.stdout: "duration": 0 2023-08-01T19:54:32.357 INFO:teuthology.orchestra.run.smithi008.stdout: }, 2023-08-01T19:54:32.357 INFO:teuthology.orchestra.run.smithi008.stdout: { 2023-08-01T19:54:32.357 INFO:teuthology.orchestra.run.smithi008.stdout: "event": "header_read", 2023-08-01T19:54:32.357 INFO:teuthology.orchestra.run.smithi008.stdout: "time": "2023-08-01T19:54:32.289763+0000", 2023-08-01T19:54:32.357 INFO:teuthology.orchestra.run.smithi008.stdout: "duration": 4294967295.9999995 2023-08-01T19:54:32.357 INFO:teuthology.orchestra.run.smithi008.stdout: }, 2023-08-01T19:54:32.357 INFO:teuthology.orchestra.run.smithi008.stdout: { 2023-08-01T19:54:32.358 INFO:teuthology.orchestra.run.smithi008.stdout: "event": "all_read", 2023-08-01T19:54:32.358 INFO:teuthology.orchestra.run.smithi008.stdout: "time": "2023-08-01T19:54:32.289818+0000", 2023-08-01T19:54:32.358 INFO:teuthology.orchestra.run.smithi008.stdout: "duration": 5.5838999999999998e-05 2023-08-01T19:54:32.358 INFO:teuthology.orchestra.run.smithi008.stdout: }, 2023-08-01T19:54:32.358 INFO:teuthology.orchestra.run.smithi008.stdout: { 2023-08-01T19:54:32.358 INFO:teuthology.orchestra.run.smithi008.stdout: "event": "dispatched", 2023-08-01T19:54:32.358 INFO:teuthology.orchestra.run.smithi008.stdout: "time": "2023-08-01T19:54:32.289828+0000", 2023-08-01T19:54:32.358 INFO:teuthology.orchestra.run.smithi008.stdout: "duration": 9.1719999999999996e-06 2023-08-01T19:54:32.359 INFO:teuthology.orchestra.run.smithi008.stdout: }, 2023-08-01T19:54:32.359 INFO:teuthology.orchestra.run.smithi008.stdout: { 2023-08-01T19:54:32.359 INFO:teuthology.orchestra.run.smithi008.stdout: "event": "queued_for_pg", 2023-08-01T19:54:32.359 INFO:teuthology.orchestra.run.smithi008.stdout: "time": "2023-08-01T19:54:32.289833+0000", 2023-08-01T19:54:32.359 INFO:teuthology.orchestra.run.smithi008.stdout: "duration": 5.2950000000000001e-06 2023-08-01T19:54:32.359 INFO:teuthology.orchestra.run.smithi008.stdout: }, 2023-08-01T19:54:32.359 INFO:teuthology.orchestra.run.smithi008.stdout: { 2023-08-01T19:54:32.359 INFO:teuthology.orchestra.run.smithi008.stdout: "event": "reached_pg", 2023-08-01T19:54:32.360 INFO:teuthology.orchestra.run.smithi008.stdout: "time": "2023-08-01T19:54:32.289871+0000", 2023-08-01T19:54:32.360 INFO:teuthology.orchestra.run.smithi008.stdout: "duration": 3.7684e-05 2023-08-01T19:54:32.360 INFO:teuthology.orchestra.run.smithi008.stdout: }, 2023-08-01T19:54:32.360 INFO:teuthology.orchestra.run.smithi008.stdout: { 2023-08-01T19:54:32.360 INFO:teuthology.orchestra.run.smithi008.stdout: "event": "started", 2023-08-01T19:54:32.360 INFO:teuthology.orchestra.run.smithi008.stdout: "time": "2023-08-01T19:54:32.289890+0000", 2023-08-01T19:54:32.360 INFO:teuthology.orchestra.run.smithi008.stdout: "duration": 1.9570000000000001e-05 2023-08-01T19:54:32.360 INFO:teuthology.orchestra.run.smithi008.stdout: } 2023-08-01T19:54:32.361 INFO:teuthology.orchestra.run.smithi008.stdout: ] 2023-08-01T19:54:32.361 INFO:teuthology.orchestra.run.smithi008.stdout: } 2023-08-01T19:54:32.361 INFO:teuthology.orchestra.run.smithi008.stdout: }, 2023-08-01T19:54:32.361 INFO:teuthology.orchestra.run.smithi008.stdout: { 2023-08-01T19:54:32.361 INFO:teuthology.orchestra.run.smithi008.stdout: "description": "osd_op(client.4668.0:28917 5.5 5.5dd8a905 (undecoded) ondisk+write+known_if_redirected+supports_pool_eio e24)", 2023-08-01T19:54:32.361 INFO:teuthology.orchestra.run.smithi008.stdout: "initiated_at": "2023-08-01T19:54:32.289843+0000", 2023-08-01T19:54:32.361 INFO:teuthology.orchestra.run.smithi008.stdout: "age": 4294967295.9997387, 2023-08-01T19:54:32.361 INFO:teuthology.orchestra.run.smithi008.stdout: "duration": 0.00053982399999999995, 2023-08-01T19:54:32.362 INFO:teuthology.orchestra.run.smithi008.stdout: "type_data": { 2023-08-01T19:54:32.362 INFO:teuthology.orchestra.run.smithi008.stdout: "flag_point": "queued for pg", 2023-08-01T19:54:32.362 INFO:teuthology.orchestra.run.smithi008.stdout: "client_info": { 2023-08-01T19:54:32.362 INFO:teuthology.orchestra.run.smithi008.stdout: "client": "client.4668", 2023-08-01T19:54:32.362 INFO:teuthology.orchestra.run.smithi008.stdout: "client_addr": "172.21.15.6:0/1709472247", 2023-08-01T19:54:32.362 INFO:teuthology.orchestra.run.smithi008.stdout: "tid": 28917 2023-08-01T19:54:32.362 INFO:teuthology.orchestra.run.smithi008.stdout: }, 2023-08-01T19:54:32.362 INFO:teuthology.orchestra.run.smithi008.stdout: "events": [ 2023-08-01T19:54:32.363 INFO:teuthology.orchestra.run.smithi008.stdout: { 2023-08-01T19:54:32.363 INFO:teuthology.orchestra.run.smithi008.stdout: "event": "initiated", 2023-08-01T19:54:32.363 INFO:teuthology.orchestra.run.smithi008.stdout: "time": "2023-08-01T19:54:32.289843+0000", 2023-08-01T19:54:32.363 INFO:teuthology.orchestra.run.smithi008.stdout: "duration": 0 2023-08-01T19:54:32.363 INFO:teuthology.orchestra.run.smithi008.stdout: }, 2023-08-01T19:54:32.363 INFO:teuthology.orchestra.run.smithi008.stdout: { 2023-08-01T19:54:32.363 INFO:teuthology.orchestra.run.smithi008.stdout: "event": "throttled", 2023-08-01T19:54:32.363 INFO:teuthology.orchestra.run.smithi008.stdout: "time": "2023-08-01T19:54:32.289843+0000", 2023-08-01T19:54:32.364 INFO:teuthology.orchestra.run.smithi008.stdout: "duration": 0 2023-08-01T19:54:32.364 INFO:teuthology.orchestra.run.smithi008.stdout: }, 2023-08-01T19:54:32.364 INFO:teuthology.orchestra.run.smithi008.stdout: { 2023-08-01T19:54:32.364 INFO:teuthology.orchestra.run.smithi008.stdout: "event": "header_read", 2023-08-01T19:54:32.364 INFO:teuthology.orchestra.run.smithi008.stdout: "time": "2023-08-01T19:54:32.289842+0000", 2023-08-01T19:54:32.364 INFO:teuthology.orchestra.run.smithi008.stdout: "duration": 4294967295.999999 2023-08-01T19:54:32.364 INFO:teuthology.orchestra.run.smithi008.stdout: }, 2023-08-01T19:54:32.364 INFO:teuthology.orchestra.run.smithi008.stdout: { 2023-08-01T19:54:32.365 INFO:teuthology.orchestra.run.smithi008.stdout: "event": "all_read", 2023-08-01T19:54:32.365 INFO:teuthology.orchestra.run.smithi008.stdout: "time": "2023-08-01T19:54:32.289894+0000", 2023-08-01T19:54:32.365 INFO:teuthology.orchestra.run.smithi008.stdout: "duration": 5.2377999999999999e-05 2023-08-01T19:54:32.365 INFO:teuthology.orchestra.run.smithi008.stdout: }, 2023-08-01T19:54:32.365 INFO:teuthology.orchestra.run.smithi008.stdout: { 2023-08-01T19:54:32.365 INFO:teuthology.orchestra.run.smithi008.stdout: "event": "dispatched", 2023-08-01T19:54:32.365 INFO:teuthology.orchestra.run.smithi008.stdout: "time": "2023-08-01T19:54:32.289904+0000", 2023-08-01T19:54:32.366 INFO:teuthology.orchestra.run.smithi008.stdout: "duration": 9.2639999999999997e-06 2023-08-01T19:54:32.366 INFO:teuthology.orchestra.run.smithi008.stdout: }, 2023-08-01T19:54:32.366 INFO:teuthology.orchestra.run.smithi008.stdout: { 2023-08-01T19:54:32.366 INFO:teuthology.orchestra.run.smithi008.stdout: "event": "queued_for_pg", 2023-08-01T19:54:32.366 INFO:teuthology.orchestra.run.smithi008.stdout: "time": "2023-08-01T19:54:32.289908+0000", 2023-08-01T19:54:32.366 INFO:teuthology.orchestra.run.smithi008.stdout: "duration": 4.7790000000000003e-06 2023-08-01T19:54:32.366 INFO:teuthology.orchestra.run.smithi008.stdout: } 2023-08-01T19:54:32.366 INFO:teuthology.orchestra.run.smithi008.stdout: ] 2023-08-01T19:54:32.367 INFO:teuthology.orchestra.run.smithi008.stdout: } 2023-08-01T19:54:32.367 INFO:teuthology.orchestra.run.smithi008.stdout: }, 2023-08-01T19:54:32.367 INFO:teuthology.orchestra.run.smithi008.stdout: { 2023-08-01T19:54:32.367 INFO:teuthology.orchestra.run.smithi008.stdout: "description": "osd_op(client.4668.0:28919 5.6 5.66934b76 (undecoded) ondisk+write+known_if_redirected+supports_pool_eio e24)", 2023-08-01T19:54:32.367 INFO:teuthology.orchestra.run.smithi008.stdout: "initiated_at": "2023-08-01T19:54:32.290294+0000", 2023-08-01T19:54:32.367 INFO:teuthology.orchestra.run.smithi008.stdout: "age": 4294967295.9992867, 2023-08-01T19:54:32.367 INFO:teuthology.orchestra.run.smithi008.stdout: "duration": 0.00015429699999999999, 2023-08-01T19:54:32.367 INFO:teuthology.orchestra.run.smithi008.stdout: "type_data": { 2023-08-01T19:54:32.368 INFO:teuthology.orchestra.run.smithi008.stdout: "flag_point": "queued for pg", 2023-08-01T19:54:32.368 INFO:teuthology.orchestra.run.smithi008.stdout: "client_info": { 2023-08-01T19:54:32.368 INFO:teuthology.orchestra.run.smithi008.stdout: "client": "client.4668", 2023-08-01T19:54:32.368 INFO:teuthology.orchestra.run.smithi008.stdout: "client_addr": "172.21.15.6:0/1709472247", 2023-08-01T19:54:32.368 INFO:teuthology.orchestra.run.smithi008.stdout: "tid": 28919 2023-08-01T19:54:32.368 INFO:teuthology.orchestra.run.smithi008.stdout: }, 2023-08-01T19:54:32.368 INFO:teuthology.orchestra.run.smithi008.stdout: "events": [ 2023-08-01T19:54:32.368 INFO:teuthology.orchestra.run.smithi008.stdout: { 2023-08-01T19:54:32.369 INFO:teuthology.orchestra.run.smithi008.stdout: "event": "initiated", 2023-08-01T19:54:32.369 INFO:teuthology.orchestra.run.smithi008.stdout: "time": "2023-08-01T19:54:32.290294+0000", 2023-08-01T19:54:32.369 INFO:teuthology.orchestra.run.smithi008.stdout: "duration": 0 2023-08-01T19:54:32.369 INFO:teuthology.orchestra.run.smithi008.stdout: }, 2023-08-01T19:54:32.369 INFO:teuthology.orchestra.run.smithi008.stdout: { 2023-08-01T19:54:32.369 INFO:teuthology.orchestra.run.smithi008.stdout: "event": "throttled", 2023-08-01T19:54:32.369 INFO:teuthology.orchestra.run.smithi008.stdout: "time": "2023-08-01T19:54:32.290294+0000", 2023-08-01T19:54:32.369 INFO:teuthology.orchestra.run.smithi008.stdout: "duration": 0 2023-08-01T19:54:32.370 INFO:teuthology.orchestra.run.smithi008.stdout: }, 2023-08-01T19:54:32.370 INFO:teuthology.orchestra.run.smithi008.stdout: { 2023-08-01T19:54:32.370 INFO:teuthology.orchestra.run.smithi008.stdout: "event": "header_read", 2023-08-01T19:54:32.370 INFO:teuthology.orchestra.run.smithi008.stdout: "time": "2023-08-01T19:54:32.290293+0000", 2023-08-01T19:54:32.370 INFO:teuthology.orchestra.run.smithi008.stdout: "duration": 4294967295.999999 2023-08-01T19:54:32.370 INFO:teuthology.orchestra.run.smithi008.stdout: }, 2023-08-01T19:54:32.370 INFO:teuthology.orchestra.run.smithi008.stdout: { 2023-08-01T19:54:32.370 INFO:teuthology.orchestra.run.smithi008.stdout: "event": "all_read", 2023-08-01T19:54:32.371 INFO:teuthology.orchestra.run.smithi008.stdout: "time": "2023-08-01T19:54:32.290377+0000", 2023-08-01T19:54:32.371 INFO:teuthology.orchestra.run.smithi008.stdout: "duration": 8.3750000000000003e-05 2023-08-01T19:54:32.371 INFO:teuthology.orchestra.run.smithi008.stdout: }, 2023-08-01T19:54:32.371 INFO:teuthology.orchestra.run.smithi008.stdout: { 2023-08-01T19:54:32.371 INFO:teuthology.orchestra.run.smithi008.stdout: "event": "dispatched", 2023-08-01T19:54:32.371 INFO:teuthology.orchestra.run.smithi008.stdout: "time": "2023-08-01T19:54:32.290390+0000", 2023-08-01T19:54:32.371 INFO:teuthology.orchestra.run.smithi008.stdout: "duration": 1.2480000000000001e-05 2023-08-01T19:54:32.371 INFO:teuthology.orchestra.run.smithi008.stdout: }, 2023-08-01T19:54:32.372 INFO:teuthology.orchestra.run.smithi008.stdout: { 2023-08-01T19:54:32.372 INFO:teuthology.orchestra.run.smithi008.stdout: "event": "queued_for_pg", 2023-08-01T19:54:32.372 INFO:teuthology.orchestra.run.smithi008.stdout: "time": "2023-08-01T19:54:32.290396+0000", 2023-08-01T19:54:32.372 INFO:teuthology.orchestra.run.smithi008.stdout: "duration": 6.5899999999999996e-06 2023-08-01T19:54:32.372 INFO:teuthology.orchestra.run.smithi008.stdout: }, 2023-08-01T19:54:32.372 INFO:teuthology.orchestra.run.smithi008.stdout: { 2023-08-01T19:54:32.372 INFO:teuthology.orchestra.run.smithi008.stdout: "event": "reached_pg", 2023-08-01T19:54:32.372 INFO:teuthology.orchestra.run.smithi008.stdout: "time": "2023-08-01T19:54:32.290454+0000", 2023-08-01T19:54:32.373 INFO:teuthology.orchestra.run.smithi008.stdout: "duration": 5.7303999999999999e-05 2023-08-01T19:54:32.373 INFO:teuthology.orchestra.run.smithi008.stdout: } 2023-08-01T19:54:32.373 INFO:teuthology.orchestra.run.smithi008.stdout: ] 2023-08-01T19:54:32.373 INFO:teuthology.orchestra.run.smithi008.stdout: } 2023-08-01T19:54:32.373 INFO:teuthology.orchestra.run.smithi008.stdout: }, 2023-08-01T19:54:32.373 INFO:teuthology.orchestra.run.smithi008.stdout: { 2023-08-01T19:54:32.373 INFO:teuthology.orchestra.run.smithi008.stdout: "description": "osd_op(client.4668.0:28905 5.3 5:cd1042bd:::benchmark_data_smithi006_114134_object28904:head [set-alloc-hint object_size 65536 write_size 65536,write 0~65536 in=65536b] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e24)", 2023-08-01T19:54:32.373 INFO:teuthology.orchestra.run.smithi008.stdout: "initiated_at": "2023-08-01T19:54:32.287000+0000", 2023-08-01T19:54:32.374 INFO:teuthology.orchestra.run.smithi008.stdout: "age": 0.0025816110000000001, 2023-08-01T19:54:32.374 INFO:teuthology.orchestra.run.smithi008.stdout: "duration": 0.0035174099999999999, 2023-08-01T19:54:32.374 INFO:teuthology.orchestra.run.smithi008.stdout: "type_data": { 2023-08-01T19:54:32.374 INFO:teuthology.orchestra.run.smithi008.stdout: "flag_point": "waiting for sub ops", 2023-08-01T19:54:32.374 INFO:teuthology.orchestra.run.smithi008.stdout: "client_info": { 2023-08-01T19:54:32.374 INFO:teuthology.orchestra.run.smithi008.stdout: "client": "client.4668", 2023-08-01T19:54:32.374 INFO:teuthology.orchestra.run.smithi008.stdout: "client_addr": "172.21.15.6:0/1709472247", 2023-08-01T19:54:32.374 INFO:teuthology.orchestra.run.smithi008.stdout: "tid": 28905 2023-08-01T19:54:32.375 INFO:teuthology.orchestra.run.smithi008.stdout: }, 2023-08-01T19:54:32.375 INFO:teuthology.orchestra.run.smithi008.stdout: "events": [ 2023-08-01T19:54:32.375 INFO:teuthology.orchestra.run.smithi008.stdout: { 2023-08-01T19:54:32.375 INFO:teuthology.orchestra.run.smithi008.stdout: "event": "initiated", 2023-08-01T19:54:32.375 INFO:teuthology.orchestra.run.smithi008.stdout: "time": "2023-08-01T19:54:32.287000+0000", 2023-08-01T19:54:32.375 INFO:teuthology.orchestra.run.smithi008.stdout: "duration": 0 2023-08-01T19:54:32.375 INFO:teuthology.orchestra.run.smithi008.stdout: }, 2023-08-01T19:54:32.375 INFO:teuthology.orchestra.run.smithi008.stdout: { 2023-08-01T19:54:32.376 INFO:teuthology.orchestra.run.smithi008.stdout: "event": "throttled", 2023-08-01T19:54:32.376 INFO:teuthology.orchestra.run.smithi008.stdout: "time": "2023-08-01T19:54:32.287000+0000", 2023-08-01T19:54:32.376 INFO:teuthology.orchestra.run.smithi008.stdout: "duration": 0 2023-08-01T19:54:32.376 INFO:teuthology.orchestra.run.smithi008.stdout: }, 2023-08-01T19:54:32.376 INFO:teuthology.orchestra.run.smithi008.stdout: { 2023-08-01T19:54:32.376 INFO:teuthology.orchestra.run.smithi008.stdout: "event": "header_read", 2023-08-01T19:54:32.376 INFO:teuthology.orchestra.run.smithi008.stdout: "time": "2023-08-01T19:54:32.286998+0000", 2023-08-01T19:54:32.377 INFO:teuthology.orchestra.run.smithi008.stdout: "duration": 4294967295.9999986 2023-08-01T19:54:32.377 INFO:teuthology.orchestra.run.smithi008.stdout: }, 2023-08-01T19:54:32.377 INFO:teuthology.orchestra.run.smithi008.stdout: { 2023-08-01T19:54:32.377 INFO:teuthology.orchestra.run.smithi008.stdout: "event": "all_read", 2023-08-01T19:54:32.377 INFO:teuthology.orchestra.run.smithi008.stdout: "time": "2023-08-01T19:54:32.287030+0000", 2023-08-01T19:54:32.377 INFO:teuthology.orchestra.run.smithi008.stdout: "duration": 3.1834e-05 2023-08-01T19:54:32.377 INFO:teuthology.orchestra.run.smithi008.stdout: }, 2023-08-01T19:54:32.377 INFO:teuthology.orchestra.run.smithi008.stdout: { 2023-08-01T19:54:32.378 INFO:teuthology.orchestra.run.smithi008.stdout: "event": "dispatched", 2023-08-01T19:54:32.378 INFO:teuthology.orchestra.run.smithi008.stdout: "time": "2023-08-01T19:54:32.287043+0000", 2023-08-01T19:54:32.378 INFO:teuthology.orchestra.run.smithi008.stdout: "duration": 1.2678e-05 2023-08-01T19:54:32.378 INFO:teuthology.orchestra.run.smithi008.stdout: }, 2023-08-01T19:54:32.378 INFO:teuthology.orchestra.run.smithi008.stdout: { 2023-08-01T19:54:32.378 INFO:teuthology.orchestra.run.smithi008.stdout: "event": "queued_for_pg", 2023-08-01T19:54:32.378 INFO:teuthology.orchestra.run.smithi008.stdout: "time": "2023-08-01T19:54:32.287049+0000", 2023-08-01T19:54:32.378 INFO:teuthology.orchestra.run.smithi008.stdout: "duration": 5.8619999999999999e-06 2023-08-01T19:54:32.379 INFO:teuthology.orchestra.run.smithi008.stdout: }, 2023-08-01T19:54:32.379 INFO:teuthology.orchestra.run.smithi008.stdout: { 2023-08-01T19:54:32.379 INFO:teuthology.orchestra.run.smithi008.stdout: "event": "reached_pg", 2023-08-01T19:54:32.379 INFO:teuthology.orchestra.run.smithi008.stdout: "time": "2023-08-01T19:54:32.287092+0000", 2023-08-01T19:54:32.379 INFO:teuthology.orchestra.run.smithi008.stdout: "duration": 4.3093999999999998e-05 2023-08-01T19:54:32.379 INFO:teuthology.orchestra.run.smithi008.stdout: }, 2023-08-01T19:54:32.379 INFO:teuthology.orchestra.run.smithi008.stdout: { 2023-08-01T19:54:32.379 INFO:teuthology.orchestra.run.smithi008.stdout: "event": "started", 2023-08-01T19:54:32.380 INFO:teuthology.orchestra.run.smithi008.stdout: "time": "2023-08-01T19:54:32.287235+0000", 2023-08-01T19:54:32.380 INFO:teuthology.orchestra.run.smithi008.stdout: "duration": 0.00014354 2023-08-01T19:54:32.380 INFO:teuthology.orchestra.run.smithi008.stdout: }, 2023-08-01T19:54:32.380 INFO:teuthology.orchestra.run.smithi008.stdout: { 2023-08-01T19:54:32.380 INFO:teuthology.orchestra.run.smithi008.stdout: "event": "waiting for subops from 1", 2023-08-01T19:54:32.380 INFO:teuthology.orchestra.run.smithi008.stdout: "time": "2023-08-01T19:54:32.287341+0000", 2023-08-01T19:54:32.380 INFO:teuthology.orchestra.run.smithi008.stdout: "duration": 0.000106029 2023-08-01T19:54:32.380 INFO:teuthology.orchestra.run.smithi008.stdout: } 2023-08-01T19:54:32.381 INFO:teuthology.orchestra.run.smithi008.stdout: ] 2023-08-01T19:54:32.381 INFO:teuthology.orchestra.run.smithi008.stdout: } 2023-08-01T19:54:32.381 INFO:teuthology.orchestra.run.smithi008.stdout: } 2023-08-01T19:54:32.381 INFO:teuthology.orchestra.run.smithi008.stdout: ], 2023-08-01T19:54:32.381 INFO:teuthology.orchestra.run.smithi008.stdout: "num_ops": 13 2023-08-01T19:54:32.381 INFO:teuthology.orchestra.run.smithi008.stdout:} 2023-08-01T19:54:32.382 INFO:tasks.radosbench.radosbench.0.smithi006.stdout: 8 16 28981 28965 226.273 192.125 0.00539913 0.0044158 2023-08-01T19:54:32.382 INFO:tasks.ceph.osd.1.smithi101.stderr:2023-08-01T19:54:32.381+0000 7fb0cb7f6700 -1 received signal: Hangup from /usr/bin/python3 /bin/daemon-helper kill ceph-osd -f --cluster ceph -i 1 (PID: 111141) UID: 0 2023-08-01T19:54:32.383 DEBUG:teuthology.orchestra.run.smithi008:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 30 ceph --cluster ceph --admin-daemon /var/run/ceph/ceph-osd.0.asok dump_blocked_ops 2023-08-01T19:54:32.483 INFO:tasks.ceph.osd.1.smithi101.stderr:2023-08-01T19:54:32.482+0000 7fb0cb7f6700 -1 received signal: Hangup from /usr/bin/python3 /bin/daemon-helper kill ceph-osd -f --cluster ceph -i 1 (PID: 111141) UID: 0 2023-08-01T19:54:32.488 INFO:teuthology.orchestra.run.smithi006.stdout: 2023-08-01T19:54:32.488 INFO:teuthology.orchestra.run.smithi006.stdout:{ 2023-08-01T19:54:32.488 INFO:teuthology.orchestra.run.smithi006.stdout: "epoch": 24, 2023-08-01T19:54:32.488 INFO:teuthology.orchestra.run.smithi006.stdout: "fsid": "a0e420cc-4df1-42a5-8bd4-a98c309a9349", 2023-08-01T19:54:32.489 INFO:teuthology.orchestra.run.smithi006.stdout: "created": "2023-08-01T19:53:41.279588+0000", 2023-08-01T19:54:32.489 INFO:teuthology.orchestra.run.smithi006.stdout: "modified": "2023-08-01T19:54:31.148314+0000", 2023-08-01T19:54:32.489 INFO:teuthology.orchestra.run.smithi006.stdout: "last_up_change": "2023-08-01T19:53:50.735626+0000", 2023-08-01T19:54:32.489 INFO:teuthology.orchestra.run.smithi006.stdout: "last_in_change": "2023-08-01T19:53:42.974751+0000", 2023-08-01T19:54:32.489 INFO:teuthology.orchestra.run.smithi006.stdout: "flags": "sortbitwise,recovery_deletes,purged_snapdirs,pglog_hardlimit", 2023-08-01T19:54:32.489 INFO:teuthology.orchestra.run.smithi006.stdout: "flags_num": 5799936, 2023-08-01T19:54:32.489 INFO:teuthology.orchestra.run.smithi006.stdout: "flags_set": [ 2023-08-01T19:54:32.490 INFO:teuthology.orchestra.run.smithi006.stdout: "pglog_hardlimit", 2023-08-01T19:54:32.490 INFO:teuthology.orchestra.run.smithi006.stdout: "purged_snapdirs", 2023-08-01T19:54:32.490 INFO:teuthology.orchestra.run.smithi006.stdout: "recovery_deletes", 2023-08-01T19:54:32.490 INFO:teuthology.orchestra.run.smithi006.stdout: "sortbitwise" 2023-08-01T19:54:32.490 INFO:teuthology.orchestra.run.smithi006.stdout: ], 2023-08-01T19:54:32.490 INFO:teuthology.orchestra.run.smithi006.stdout: "crush_version": 5, 2023-08-01T19:54:32.490 INFO:teuthology.orchestra.run.smithi006.stdout: "full_ratio": 0.94999998807907104, 2023-08-01T19:54:32.490 INFO:teuthology.orchestra.run.smithi006.stdout: "backfillfull_ratio": 0.89999997615814209, 2023-08-01T19:54:32.491 INFO:teuthology.orchestra.run.smithi006.stdout: "nearfull_ratio": 0.85000002384185791, 2023-08-01T19:54:32.491 INFO:teuthology.orchestra.run.smithi006.stdout: "cluster_snapshot": "", 2023-08-01T19:54:32.491 INFO:teuthology.orchestra.run.smithi006.stdout: "pool_max": 5, 2023-08-01T19:54:32.491 INFO:teuthology.orchestra.run.smithi006.stdout: "max_osd": 3, 2023-08-01T19:54:32.491 INFO:teuthology.orchestra.run.smithi006.stdout: "require_min_compat_client": "luminous", 2023-08-01T19:54:32.491 INFO:teuthology.orchestra.run.smithi006.stdout: "min_compat_client": "jewel", 2023-08-01T19:54:32.491 INFO:teuthology.orchestra.run.smithi006.stdout: "require_osd_release": "quincy", 2023-08-01T19:54:32.491 INFO:teuthology.orchestra.run.smithi006.stdout: "pools": [ 2023-08-01T19:54:32.492 INFO:teuthology.orchestra.run.smithi006.stdout: { 2023-08-01T19:54:32.492 INFO:teuthology.orchestra.run.smithi006.stdout: "pool": 1, 2023-08-01T19:54:32.492 INFO:teuthology.orchestra.run.smithi006.stdout: "pool_name": ".mgr", 2023-08-01T19:54:32.492 INFO:teuthology.orchestra.run.smithi006.stdout: "create_time": "2023-08-01T19:53:49.961944+0000", 2023-08-01T19:54:32.492 INFO:teuthology.orchestra.run.smithi006.stdout: "flags": 1, 2023-08-01T19:54:32.492 INFO:teuthology.orchestra.run.smithi006.stdout: "flags_names": "hashpspool", 2023-08-01T19:54:32.492 INFO:teuthology.orchestra.run.smithi006.stdout: "type": 1, 2023-08-01T19:54:32.492 INFO:teuthology.orchestra.run.smithi006.stdout: "size": 2, 2023-08-01T19:54:32.493 INFO:teuthology.orchestra.run.smithi006.stdout: "min_size": 1, 2023-08-01T19:54:32.493 INFO:teuthology.orchestra.run.smithi006.stdout: "crush_rule": 0, 2023-08-01T19:54:32.493 INFO:teuthology.orchestra.run.smithi006.stdout: "peering_crush_bucket_count": 0, 2023-08-01T19:54:32.493 INFO:teuthology.orchestra.run.smithi006.stdout: "peering_crush_bucket_target": 0, 2023-08-01T19:54:32.493 INFO:teuthology.orchestra.run.smithi006.stdout: "peering_crush_bucket_barrier": 0, 2023-08-01T19:54:32.493 INFO:teuthology.orchestra.run.smithi006.stdout: "peering_crush_bucket_mandatory_member": 2147483647, 2023-08-01T19:54:32.493 INFO:teuthology.orchestra.run.smithi006.stdout: "object_hash": 2, 2023-08-01T19:54:32.493 INFO:teuthology.orchestra.run.smithi006.stdout: "pg_autoscale_mode": "off", 2023-08-01T19:54:32.494 INFO:teuthology.orchestra.run.smithi006.stdout: "pg_num": 1, 2023-08-01T19:54:32.494 INFO:teuthology.orchestra.run.smithi006.stdout: "pg_placement_num": 1, 2023-08-01T19:54:32.494 INFO:teuthology.orchestra.run.smithi006.stdout: "pg_placement_num_target": 1, 2023-08-01T19:54:32.494 INFO:teuthology.orchestra.run.smithi006.stdout: "pg_num_target": 1, 2023-08-01T19:54:32.494 INFO:teuthology.orchestra.run.smithi006.stdout: "pg_num_pending": 1, 2023-08-01T19:54:32.494 INFO:teuthology.orchestra.run.smithi006.stdout: "last_pg_merge_meta": { 2023-08-01T19:54:32.494 INFO:teuthology.orchestra.run.smithi006.stdout: "source_pgid": "0.0", 2023-08-01T19:54:32.494 INFO:teuthology.orchestra.run.smithi006.stdout: "ready_epoch": 0, 2023-08-01T19:54:32.495 INFO:teuthology.orchestra.run.smithi006.stdout: "last_epoch_started": 0, 2023-08-01T19:54:32.495 INFO:teuthology.orchestra.run.smithi006.stdout: "last_epoch_clean": 0, 2023-08-01T19:54:32.495 INFO:teuthology.orchestra.run.smithi006.stdout: "source_version": "0'0", 2023-08-01T19:54:32.495 INFO:teuthology.orchestra.run.smithi006.stdout: "target_version": "0'0" 2023-08-01T19:54:32.495 INFO:teuthology.orchestra.run.smithi006.stdout: }, 2023-08-01T19:54:32.495 INFO:teuthology.orchestra.run.smithi006.stdout: "last_change": "11", 2023-08-01T19:54:32.495 INFO:teuthology.orchestra.run.smithi006.stdout: "last_force_op_resend": "0", 2023-08-01T19:54:32.496 INFO:teuthology.orchestra.run.smithi006.stdout: "last_force_op_resend_prenautilus": "0", 2023-08-01T19:54:32.496 INFO:teuthology.orchestra.run.smithi006.stdout: "last_force_op_resend_preluminous": "0", 2023-08-01T19:54:32.496 INFO:teuthology.orchestra.run.smithi006.stdout: "auid": 0, 2023-08-01T19:54:32.496 INFO:teuthology.orchestra.run.smithi006.stdout: "snap_mode": "selfmanaged", 2023-08-01T19:54:32.496 INFO:teuthology.orchestra.run.smithi006.stdout: "snap_seq": 0, 2023-08-01T19:54:32.496 INFO:teuthology.orchestra.run.smithi006.stdout: "snap_epoch": 0, 2023-08-01T19:54:32.496 INFO:teuthology.orchestra.run.smithi006.stdout: "pool_snaps": [], 2023-08-01T19:54:32.496 INFO:teuthology.orchestra.run.smithi006.stdout: "removed_snaps": "[]", 2023-08-01T19:54:32.497 INFO:teuthology.orchestra.run.smithi006.stdout: "quota_max_bytes": 0, 2023-08-01T19:54:32.497 INFO:teuthology.orchestra.run.smithi006.stdout: "quota_max_objects": 0, 2023-08-01T19:54:32.497 INFO:teuthology.orchestra.run.smithi006.stdout: "tiers": [], 2023-08-01T19:54:32.497 INFO:teuthology.orchestra.run.smithi006.stdout: "tier_of": -1, 2023-08-01T19:54:32.497 INFO:teuthology.orchestra.run.smithi006.stdout: "read_tier": -1, 2023-08-01T19:54:32.497 INFO:teuthology.orchestra.run.smithi006.stdout: "write_tier": -1, 2023-08-01T19:54:32.497 INFO:teuthology.orchestra.run.smithi006.stdout: "cache_mode": "none", 2023-08-01T19:54:32.497 INFO:teuthology.orchestra.run.smithi006.stdout: "target_max_bytes": 0, 2023-08-01T19:54:32.498 INFO:teuthology.orchestra.run.smithi006.stdout: "target_max_objects": 0, 2023-08-01T19:54:32.498 INFO:teuthology.orchestra.run.smithi006.stdout: "cache_target_dirty_ratio_micro": 400000, 2023-08-01T19:54:32.498 INFO:teuthology.orchestra.run.smithi006.stdout: "cache_target_dirty_high_ratio_micro": 600000, 2023-08-01T19:54:32.498 INFO:teuthology.orchestra.run.smithi006.stdout: "cache_target_full_ratio_micro": 800000, 2023-08-01T19:54:32.498 INFO:teuthology.orchestra.run.smithi006.stdout: "cache_min_flush_age": 0, 2023-08-01T19:54:32.498 INFO:teuthology.orchestra.run.smithi006.stdout: "cache_min_evict_age": 0, 2023-08-01T19:54:32.498 INFO:teuthology.orchestra.run.smithi006.stdout: "erasure_code_profile": "", 2023-08-01T19:54:32.498 INFO:teuthology.orchestra.run.smithi006.stdout: "hit_set_params": { 2023-08-01T19:54:32.499 INFO:teuthology.orchestra.run.smithi006.stdout: "type": "none" 2023-08-01T19:54:32.499 INFO:teuthology.orchestra.run.smithi006.stdout: }, 2023-08-01T19:54:32.499 INFO:teuthology.orchestra.run.smithi006.stdout: "hit_set_period": 0, 2023-08-01T19:54:32.499 INFO:teuthology.orchestra.run.smithi006.stdout: "hit_set_count": 0, 2023-08-01T19:54:32.499 INFO:teuthology.orchestra.run.smithi006.stdout: "use_gmt_hitset": true, 2023-08-01T19:54:32.499 INFO:teuthology.orchestra.run.smithi006.stdout: "min_read_recency_for_promote": 0, 2023-08-01T19:54:32.499 INFO:teuthology.orchestra.run.smithi006.stdout: "min_write_recency_for_promote": 0, 2023-08-01T19:54:32.499 INFO:teuthology.orchestra.run.smithi006.stdout: "hit_set_grade_decay_rate": 0, 2023-08-01T19:54:32.500 INFO:teuthology.orchestra.run.smithi006.stdout: "hit_set_search_last_n": 0, 2023-08-01T19:54:32.500 INFO:teuthology.orchestra.run.smithi006.stdout: "grade_table": [], 2023-08-01T19:54:32.500 INFO:teuthology.orchestra.run.smithi006.stdout: "stripe_width": 0, 2023-08-01T19:54:32.500 INFO:teuthology.orchestra.run.smithi006.stdout: "expected_num_objects": 0, 2023-08-01T19:54:32.500 INFO:teuthology.orchestra.run.smithi006.stdout: "fast_read": false, 2023-08-01T19:54:32.500 INFO:teuthology.orchestra.run.smithi006.stdout: "options": { 2023-08-01T19:54:32.500 INFO:teuthology.orchestra.run.smithi006.stdout: "pg_num_max": 32, 2023-08-01T19:54:32.500 INFO:teuthology.orchestra.run.smithi006.stdout: "pg_num_min": 1 2023-08-01T19:54:32.501 INFO:teuthology.orchestra.run.smithi006.stdout: }, 2023-08-01T19:54:32.501 INFO:teuthology.orchestra.run.smithi006.stdout: "application_metadata": { 2023-08-01T19:54:32.501 INFO:teuthology.orchestra.run.smithi006.stdout: "mgr": {} 2023-08-01T19:54:32.501 INFO:teuthology.orchestra.run.smithi006.stdout: } 2023-08-01T19:54:32.501 INFO:teuthology.orchestra.run.smithi006.stdout: }, 2023-08-01T19:54:32.501 INFO:teuthology.orchestra.run.smithi006.stdout: { 2023-08-01T19:54:32.501 INFO:teuthology.orchestra.run.smithi006.stdout: "pool": 2, 2023-08-01T19:54:32.502 INFO:teuthology.orchestra.run.smithi006.stdout: "pool_name": "rbd", 2023-08-01T19:54:32.502 INFO:teuthology.orchestra.run.smithi006.stdout: "create_time": "2023-08-01T19:53:57.404091+0000", 2023-08-01T19:54:32.502 INFO:teuthology.orchestra.run.smithi006.stdout: "flags": 1, 2023-08-01T19:54:32.502 INFO:teuthology.orchestra.run.smithi006.stdout: "flags_names": "hashpspool", 2023-08-01T19:54:32.502 INFO:teuthology.orchestra.run.smithi006.stdout: "type": 1, 2023-08-01T19:54:32.502 INFO:teuthology.orchestra.run.smithi006.stdout: "size": 2, 2023-08-01T19:54:32.502 INFO:teuthology.orchestra.run.smithi006.stdout: "min_size": 1, 2023-08-01T19:54:32.502 INFO:teuthology.orchestra.run.smithi006.stdout: "crush_rule": 0, 2023-08-01T19:54:32.503 INFO:teuthology.orchestra.run.smithi006.stdout: "peering_crush_bucket_count": 0, 2023-08-01T19:54:32.503 INFO:teuthology.orchestra.run.smithi006.stdout: "peering_crush_bucket_target": 0, 2023-08-01T19:54:32.503 INFO:teuthology.orchestra.run.smithi006.stdout: "peering_crush_bucket_barrier": 0, 2023-08-01T19:54:32.503 INFO:teuthology.orchestra.run.smithi006.stdout: "peering_crush_bucket_mandatory_member": 2147483647, 2023-08-01T19:54:32.503 INFO:teuthology.orchestra.run.smithi006.stdout: "object_hash": 2, 2023-08-01T19:54:32.503 INFO:teuthology.orchestra.run.smithi006.stdout: "pg_autoscale_mode": "off", 2023-08-01T19:54:32.503 INFO:teuthology.orchestra.run.smithi006.stdout: "pg_num": 8, 2023-08-01T19:54:32.503 INFO:teuthology.orchestra.run.smithi006.stdout: "pg_placement_num": 8, 2023-08-01T19:54:32.504 INFO:teuthology.orchestra.run.smithi006.stdout: "pg_placement_num_target": 8, 2023-08-01T19:54:32.504 INFO:teuthology.orchestra.run.smithi006.stdout: "pg_num_target": 8, 2023-08-01T19:54:32.504 INFO:teuthology.orchestra.run.smithi006.stdout: "pg_num_pending": 8, 2023-08-01T19:54:32.504 INFO:teuthology.orchestra.run.smithi006.stdout: "last_pg_merge_meta": { 2023-08-01T19:54:32.504 INFO:teuthology.orchestra.run.smithi006.stdout: "source_pgid": "0.0", 2023-08-01T19:54:32.504 INFO:teuthology.orchestra.run.smithi006.stdout: "ready_epoch": 0, 2023-08-01T19:54:32.504 INFO:teuthology.orchestra.run.smithi006.stdout: "last_epoch_started": 0, 2023-08-01T19:54:32.504 INFO:teuthology.orchestra.run.smithi006.stdout: "last_epoch_clean": 0, 2023-08-01T19:54:32.505 INFO:teuthology.orchestra.run.smithi006.stdout: "source_version": "0'0", 2023-08-01T19:54:32.505 INFO:teuthology.orchestra.run.smithi006.stdout: "target_version": "0'0" 2023-08-01T19:54:32.505 INFO:teuthology.orchestra.run.smithi006.stdout: }, 2023-08-01T19:54:32.505 INFO:teuthology.orchestra.run.smithi006.stdout: "last_change": "14", 2023-08-01T19:54:32.505 INFO:teuthology.orchestra.run.smithi006.stdout: "last_force_op_resend": "0", 2023-08-01T19:54:32.505 INFO:teuthology.orchestra.run.smithi006.stdout: "last_force_op_resend_prenautilus": "0", 2023-08-01T19:54:32.505 INFO:teuthology.orchestra.run.smithi006.stdout: "last_force_op_resend_preluminous": "0", 2023-08-01T19:54:32.505 INFO:teuthology.orchestra.run.smithi006.stdout: "auid": 0, 2023-08-01T19:54:32.506 INFO:teuthology.orchestra.run.smithi006.stdout: "snap_mode": "selfmanaged", 2023-08-01T19:54:32.506 INFO:teuthology.orchestra.run.smithi006.stdout: "snap_seq": 0, 2023-08-01T19:54:32.506 INFO:teuthology.orchestra.run.smithi006.stdout: "snap_epoch": 0, 2023-08-01T19:54:32.506 INFO:teuthology.orchestra.run.smithi006.stdout: "pool_snaps": [], 2023-08-01T19:54:32.506 INFO:teuthology.orchestra.run.smithi006.stdout: "removed_snaps": "[]", 2023-08-01T19:54:32.506 INFO:teuthology.orchestra.run.smithi006.stdout: "quota_max_bytes": 0, 2023-08-01T19:54:32.506 INFO:teuthology.orchestra.run.smithi006.stdout: "quota_max_objects": 0, 2023-08-01T19:54:32.507 INFO:teuthology.orchestra.run.smithi006.stdout: "tiers": [], 2023-08-01T19:54:32.507 INFO:teuthology.orchestra.run.smithi006.stdout: "tier_of": -1, 2023-08-01T19:54:32.507 INFO:teuthology.orchestra.run.smithi006.stdout: "read_tier": -1, 2023-08-01T19:54:32.507 INFO:teuthology.orchestra.run.smithi006.stdout: "write_tier": -1, 2023-08-01T19:54:32.507 INFO:teuthology.orchestra.run.smithi006.stdout: "cache_mode": "none", 2023-08-01T19:54:32.507 INFO:teuthology.orchestra.run.smithi006.stdout: "target_max_bytes": 0, 2023-08-01T19:54:32.507 INFO:teuthology.orchestra.run.smithi006.stdout: "target_max_objects": 0, 2023-08-01T19:54:32.507 INFO:teuthology.orchestra.run.smithi006.stdout: "cache_target_dirty_ratio_micro": 400000, 2023-08-01T19:54:32.508 INFO:teuthology.orchestra.run.smithi006.stdout: "cache_target_dirty_high_ratio_micro": 600000, 2023-08-01T19:54:32.508 INFO:teuthology.orchestra.run.smithi006.stdout: "cache_target_full_ratio_micro": 800000, 2023-08-01T19:54:32.508 INFO:teuthology.orchestra.run.smithi006.stdout: "cache_min_flush_age": 0, 2023-08-01T19:54:32.508 INFO:teuthology.orchestra.run.smithi006.stdout: "cache_min_evict_age": 0, 2023-08-01T19:54:32.508 INFO:teuthology.orchestra.run.smithi006.stdout: "erasure_code_profile": "", 2023-08-01T19:54:32.508 INFO:teuthology.orchestra.run.smithi006.stdout: "hit_set_params": { 2023-08-01T19:54:32.508 INFO:teuthology.orchestra.run.smithi006.stdout: "type": "none" 2023-08-01T19:54:32.508 INFO:teuthology.orchestra.run.smithi006.stdout: }, 2023-08-01T19:54:32.509 INFO:teuthology.orchestra.run.smithi006.stdout: "hit_set_period": 0, 2023-08-01T19:54:32.509 INFO:teuthology.orchestra.run.smithi006.stdout: "hit_set_count": 0, 2023-08-01T19:54:32.509 INFO:teuthology.orchestra.run.smithi006.stdout: "use_gmt_hitset": true, 2023-08-01T19:54:32.509 INFO:teuthology.orchestra.run.smithi006.stdout: "min_read_recency_for_promote": 0, 2023-08-01T19:54:32.509 INFO:teuthology.orchestra.run.smithi006.stdout: "min_write_recency_for_promote": 0, 2023-08-01T19:54:32.509 INFO:teuthology.orchestra.run.smithi006.stdout: "hit_set_grade_decay_rate": 0, 2023-08-01T19:54:32.509 INFO:teuthology.orchestra.run.smithi006.stdout: "hit_set_search_last_n": 0, 2023-08-01T19:54:32.509 INFO:teuthology.orchestra.run.smithi006.stdout: "grade_table": [], 2023-08-01T19:54:32.510 INFO:teuthology.orchestra.run.smithi006.stdout: "stripe_width": 0, 2023-08-01T19:54:32.510 INFO:teuthology.orchestra.run.smithi006.stdout: "expected_num_objects": 0, 2023-08-01T19:54:32.510 INFO:teuthology.orchestra.run.smithi006.stdout: "fast_read": false, 2023-08-01T19:54:32.510 INFO:teuthology.orchestra.run.smithi006.stdout: "options": {}, 2023-08-01T19:54:32.510 INFO:teuthology.orchestra.run.smithi006.stdout: "application_metadata": { 2023-08-01T19:54:32.510 INFO:teuthology.orchestra.run.smithi006.stdout: "rbd": {} 2023-08-01T19:54:32.510 INFO:teuthology.orchestra.run.smithi006.stdout: } 2023-08-01T19:54:32.510 INFO:teuthology.orchestra.run.smithi006.stdout: }, 2023-08-01T19:54:32.511 INFO:teuthology.orchestra.run.smithi006.stdout: { 2023-08-01T19:54:32.511 INFO:teuthology.orchestra.run.smithi006.stdout: "pool": 3, 2023-08-01T19:54:32.511 INFO:teuthology.orchestra.run.smithi006.stdout: "pool_name": "cephfs_metadata", 2023-08-01T19:54:32.511 INFO:teuthology.orchestra.run.smithi006.stdout: "create_time": "2023-08-01T19:54:02.111247+0000", 2023-08-01T19:54:32.511 INFO:teuthology.orchestra.run.smithi006.stdout: "flags": 1, 2023-08-01T19:54:32.511 INFO:teuthology.orchestra.run.smithi006.stdout: "flags_names": "hashpspool", 2023-08-01T19:54:32.511 INFO:teuthology.orchestra.run.smithi006.stdout: "type": 1, 2023-08-01T19:54:32.511 INFO:teuthology.orchestra.run.smithi006.stdout: "size": 2, 2023-08-01T19:54:32.512 INFO:teuthology.orchestra.run.smithi006.stdout: "min_size": 1, 2023-08-01T19:54:32.512 INFO:teuthology.orchestra.run.smithi006.stdout: "crush_rule": 0, 2023-08-01T19:54:32.512 INFO:teuthology.orchestra.run.smithi006.stdout: "peering_crush_bucket_count": 0, 2023-08-01T19:54:32.512 INFO:teuthology.orchestra.run.smithi006.stdout: "peering_crush_bucket_target": 0, 2023-08-01T19:54:32.512 INFO:teuthology.orchestra.run.smithi006.stdout: "peering_crush_bucket_barrier": 0, 2023-08-01T19:54:32.512 INFO:teuthology.orchestra.run.smithi006.stdout: "peering_crush_bucket_mandatory_member": 2147483647, 2023-08-01T19:54:32.512 INFO:teuthology.orchestra.run.smithi006.stdout: "object_hash": 2, 2023-08-01T19:54:32.512 INFO:teuthology.orchestra.run.smithi006.stdout: "pg_autoscale_mode": "off", 2023-08-01T19:54:32.513 INFO:teuthology.orchestra.run.smithi006.stdout: "pg_num": 32, 2023-08-01T19:54:32.513 INFO:teuthology.orchestra.run.smithi006.stdout: "pg_placement_num": 32, 2023-08-01T19:54:32.513 INFO:teuthology.orchestra.run.smithi006.stdout: "pg_placement_num_target": 32, 2023-08-01T19:54:32.513 INFO:teuthology.orchestra.run.smithi006.stdout: "pg_num_target": 32, 2023-08-01T19:54:32.513 INFO:teuthology.orchestra.run.smithi006.stdout: "pg_num_pending": 32, 2023-08-01T19:54:32.513 INFO:teuthology.orchestra.run.smithi006.stdout: "last_pg_merge_meta": { 2023-08-01T19:54:32.513 INFO:teuthology.orchestra.run.smithi006.stdout: "source_pgid": "0.0", 2023-08-01T19:54:32.514 INFO:teuthology.orchestra.run.smithi006.stdout: "ready_epoch": 0, 2023-08-01T19:54:32.514 INFO:teuthology.orchestra.run.smithi006.stdout: "last_epoch_started": 0, 2023-08-01T19:54:32.514 INFO:teuthology.orchestra.run.smithi006.stdout: "last_epoch_clean": 0, 2023-08-01T19:54:32.514 INFO:teuthology.orchestra.run.smithi006.stdout: "source_version": "0'0", 2023-08-01T19:54:32.514 INFO:teuthology.orchestra.run.smithi006.stdout: "target_version": "0'0" 2023-08-01T19:54:32.514 INFO:teuthology.orchestra.run.smithi006.stdout: }, 2023-08-01T19:54:32.514 INFO:teuthology.orchestra.run.smithi006.stdout: "last_change": "17", 2023-08-01T19:54:32.514 INFO:teuthology.orchestra.run.smithi006.stdout: "last_force_op_resend": "0", 2023-08-01T19:54:32.515 INFO:teuthology.orchestra.run.smithi006.stdout: "last_force_op_resend_prenautilus": "0", 2023-08-01T19:54:32.515 INFO:teuthology.orchestra.run.smithi006.stdout: "last_force_op_resend_preluminous": "0", 2023-08-01T19:54:32.515 INFO:teuthology.orchestra.run.smithi006.stdout: "auid": 0, 2023-08-01T19:54:32.515 INFO:teuthology.orchestra.run.smithi006.stdout: "snap_mode": "selfmanaged", 2023-08-01T19:54:32.515 INFO:teuthology.orchestra.run.smithi006.stdout: "snap_seq": 0, 2023-08-01T19:54:32.515 INFO:teuthology.orchestra.run.smithi006.stdout: "snap_epoch": 0, 2023-08-01T19:54:32.515 INFO:teuthology.orchestra.run.smithi006.stdout: "pool_snaps": [], 2023-08-01T19:54:32.515 INFO:teuthology.orchestra.run.smithi006.stdout: "removed_snaps": "[]", 2023-08-01T19:54:32.516 INFO:teuthology.orchestra.run.smithi006.stdout: "quota_max_bytes": 0, 2023-08-01T19:54:32.516 INFO:teuthology.orchestra.run.smithi006.stdout: "quota_max_objects": 0, 2023-08-01T19:54:32.516 INFO:teuthology.orchestra.run.smithi006.stdout: "tiers": [], 2023-08-01T19:54:32.516 INFO:teuthology.orchestra.run.smithi006.stdout: "tier_of": -1, 2023-08-01T19:54:32.516 INFO:teuthology.orchestra.run.smithi006.stdout: "read_tier": -1, 2023-08-01T19:54:32.516 INFO:teuthology.orchestra.run.smithi006.stdout: "write_tier": -1, 2023-08-01T19:54:32.516 INFO:teuthology.orchestra.run.smithi006.stdout: "cache_mode": "none", 2023-08-01T19:54:32.516 INFO:teuthology.orchestra.run.smithi006.stdout: "target_max_bytes": 0, 2023-08-01T19:54:32.517 INFO:teuthology.orchestra.run.smithi006.stdout: "target_max_objects": 0, 2023-08-01T19:54:32.517 INFO:teuthology.orchestra.run.smithi006.stdout: "cache_target_dirty_ratio_micro": 400000, 2023-08-01T19:54:32.517 INFO:teuthology.orchestra.run.smithi006.stdout: "cache_target_dirty_high_ratio_micro": 600000, 2023-08-01T19:54:32.517 INFO:teuthology.orchestra.run.smithi006.stdout: "cache_target_full_ratio_micro": 800000, 2023-08-01T19:54:32.517 INFO:teuthology.orchestra.run.smithi006.stdout: "cache_min_flush_age": 0, 2023-08-01T19:54:32.517 INFO:teuthology.orchestra.run.smithi006.stdout: "cache_min_evict_age": 0, 2023-08-01T19:54:32.517 INFO:teuthology.orchestra.run.smithi006.stdout: "erasure_code_profile": "", 2023-08-01T19:54:32.517 INFO:teuthology.orchestra.run.smithi006.stdout: "hit_set_params": { 2023-08-01T19:54:32.518 INFO:teuthology.orchestra.run.smithi006.stdout: "type": "none" 2023-08-01T19:54:32.518 INFO:teuthology.orchestra.run.smithi006.stdout: }, 2023-08-01T19:54:32.518 INFO:teuthology.orchestra.run.smithi006.stdout: "hit_set_period": 0, 2023-08-01T19:54:32.518 INFO:teuthology.orchestra.run.smithi006.stdout: "hit_set_count": 0, 2023-08-01T19:54:32.518 INFO:teuthology.orchestra.run.smithi006.stdout: "use_gmt_hitset": true, 2023-08-01T19:54:32.518 INFO:teuthology.orchestra.run.smithi006.stdout: "min_read_recency_for_promote": 0, 2023-08-01T19:54:32.518 INFO:teuthology.orchestra.run.smithi006.stdout: "min_write_recency_for_promote": 0, 2023-08-01T19:54:32.519 INFO:teuthology.orchestra.run.smithi006.stdout: "hit_set_grade_decay_rate": 0, 2023-08-01T19:54:32.519 INFO:teuthology.orchestra.run.smithi006.stdout: "hit_set_search_last_n": 0, 2023-08-01T19:54:32.519 INFO:teuthology.orchestra.run.smithi006.stdout: "grade_table": [], 2023-08-01T19:54:32.519 INFO:teuthology.orchestra.run.smithi006.stdout: "stripe_width": 0, 2023-08-01T19:54:32.519 INFO:teuthology.orchestra.run.smithi006.stdout: "expected_num_objects": 0, 2023-08-01T19:54:32.519 INFO:teuthology.orchestra.run.smithi006.stdout: "fast_read": false, 2023-08-01T19:54:32.519 INFO:teuthology.orchestra.run.smithi006.stdout: "options": { 2023-08-01T19:54:32.519 INFO:teuthology.orchestra.run.smithi006.stdout: "pg_autoscale_bias": 4, 2023-08-01T19:54:32.520 INFO:teuthology.orchestra.run.smithi006.stdout: "pg_num_min": 16, 2023-08-01T19:54:32.520 INFO:teuthology.orchestra.run.smithi006.stdout: "recovery_priority": 5 2023-08-01T19:54:32.520 INFO:teuthology.orchestra.run.smithi006.stdout: }, 2023-08-01T19:54:32.520 INFO:teuthology.orchestra.run.smithi006.stdout: "application_metadata": { 2023-08-01T19:54:32.520 INFO:teuthology.orchestra.run.smithi006.stdout: "cephfs": { 2023-08-01T19:54:32.520 INFO:teuthology.orchestra.run.smithi006.stdout: "metadata": "cephfs" 2023-08-01T19:54:32.520 INFO:teuthology.orchestra.run.smithi006.stdout: } 2023-08-01T19:54:32.520 INFO:teuthology.orchestra.run.smithi006.stdout: } 2023-08-01T19:54:32.521 INFO:teuthology.orchestra.run.smithi006.stdout: }, 2023-08-01T19:54:32.521 INFO:teuthology.orchestra.run.smithi006.stdout: { 2023-08-01T19:54:32.521 INFO:teuthology.orchestra.run.smithi006.stdout: "pool": 4, 2023-08-01T19:54:32.521 INFO:teuthology.orchestra.run.smithi006.stdout: "pool_name": "cephfs_data", 2023-08-01T19:54:32.521 INFO:teuthology.orchestra.run.smithi006.stdout: "create_time": "2023-08-01T19:54:03.430277+0000", 2023-08-01T19:54:32.521 INFO:teuthology.orchestra.run.smithi006.stdout: "flags": 1, 2023-08-01T19:54:32.521 INFO:teuthology.orchestra.run.smithi006.stdout: "flags_names": "hashpspool", 2023-08-01T19:54:32.521 INFO:teuthology.orchestra.run.smithi006.stdout: "type": 1, 2023-08-01T19:54:32.522 INFO:teuthology.orchestra.run.smithi006.stdout: "size": 2, 2023-08-01T19:54:32.522 INFO:teuthology.orchestra.run.smithi006.stdout: "min_size": 1, 2023-08-01T19:54:32.522 INFO:teuthology.orchestra.run.smithi006.stdout: "crush_rule": 0, 2023-08-01T19:54:32.522 INFO:teuthology.orchestra.run.smithi006.stdout: "peering_crush_bucket_count": 0, 2023-08-01T19:54:32.522 INFO:teuthology.orchestra.run.smithi006.stdout: "peering_crush_bucket_target": 0, 2023-08-01T19:54:32.522 INFO:teuthology.orchestra.run.smithi006.stdout: "peering_crush_bucket_barrier": 0, 2023-08-01T19:54:32.522 INFO:teuthology.orchestra.run.smithi006.stdout: "peering_crush_bucket_mandatory_member": 2147483647, 2023-08-01T19:54:32.522 INFO:teuthology.orchestra.run.smithi006.stdout: "object_hash": 2, 2023-08-01T19:54:32.523 INFO:teuthology.orchestra.run.smithi006.stdout: "pg_autoscale_mode": "off", 2023-08-01T19:54:32.523 INFO:teuthology.orchestra.run.smithi006.stdout: "pg_num": 64, 2023-08-01T19:54:32.523 INFO:teuthology.orchestra.run.smithi006.stdout: "pg_placement_num": 64, 2023-08-01T19:54:32.523 INFO:teuthology.orchestra.run.smithi006.stdout: "pg_placement_num_target": 64, 2023-08-01T19:54:32.523 INFO:teuthology.orchestra.run.smithi006.stdout: "pg_num_target": 64, 2023-08-01T19:54:32.523 INFO:teuthology.orchestra.run.smithi006.stdout: "pg_num_pending": 64, 2023-08-01T19:54:32.523 INFO:teuthology.orchestra.run.smithi006.stdout: "last_pg_merge_meta": { 2023-08-01T19:54:32.523 INFO:teuthology.orchestra.run.smithi006.stdout: "source_pgid": "0.0", 2023-08-01T19:54:32.524 INFO:teuthology.orchestra.run.smithi006.stdout: "ready_epoch": 0, 2023-08-01T19:54:32.524 INFO:teuthology.orchestra.run.smithi006.stdout: "last_epoch_started": 0, 2023-08-01T19:54:32.524 INFO:teuthology.orchestra.run.smithi006.stdout: "last_epoch_clean": 0, 2023-08-01T19:54:32.524 INFO:teuthology.orchestra.run.smithi006.stdout: "source_version": "0'0", 2023-08-01T19:54:32.524 INFO:teuthology.orchestra.run.smithi006.stdout: "target_version": "0'0" 2023-08-01T19:54:32.524 INFO:teuthology.orchestra.run.smithi006.stdout: }, 2023-08-01T19:54:32.524 INFO:teuthology.orchestra.run.smithi006.stdout: "last_change": "18", 2023-08-01T19:54:32.524 INFO:teuthology.orchestra.run.smithi006.stdout: "last_force_op_resend": "0", 2023-08-01T19:54:32.525 INFO:teuthology.orchestra.run.smithi006.stdout: "last_force_op_resend_prenautilus": "0", 2023-08-01T19:54:32.525 INFO:teuthology.orchestra.run.smithi006.stdout: "last_force_op_resend_preluminous": "0", 2023-08-01T19:54:32.525 INFO:teuthology.orchestra.run.smithi006.stdout: "auid": 0, 2023-08-01T19:54:32.525 INFO:teuthology.orchestra.run.smithi006.stdout: "snap_mode": "selfmanaged", 2023-08-01T19:54:32.525 INFO:teuthology.orchestra.run.smithi006.stdout: "snap_seq": 0, 2023-08-01T19:54:32.525 INFO:teuthology.orchestra.run.smithi006.stdout: "snap_epoch": 0, 2023-08-01T19:54:32.525 INFO:teuthology.orchestra.run.smithi006.stdout: "pool_snaps": [], 2023-08-01T19:54:32.525 INFO:teuthology.orchestra.run.smithi006.stdout: "removed_snaps": "[]", 2023-08-01T19:54:32.526 INFO:teuthology.orchestra.run.smithi006.stdout: "quota_max_bytes": 0, 2023-08-01T19:54:32.526 INFO:teuthology.orchestra.run.smithi006.stdout: "quota_max_objects": 0, 2023-08-01T19:54:32.526 INFO:teuthology.orchestra.run.smithi006.stdout: "tiers": [], 2023-08-01T19:54:32.526 INFO:teuthology.orchestra.run.smithi006.stdout: "tier_of": -1, 2023-08-01T19:54:32.526 INFO:teuthology.orchestra.run.smithi006.stdout: "read_tier": -1, 2023-08-01T19:54:32.526 INFO:teuthology.orchestra.run.smithi006.stdout: "write_tier": -1, 2023-08-01T19:54:32.526 INFO:teuthology.orchestra.run.smithi006.stdout: "cache_mode": "none", 2023-08-01T19:54:32.526 INFO:teuthology.orchestra.run.smithi006.stdout: "target_max_bytes": 0, 2023-08-01T19:54:32.527 INFO:teuthology.orchestra.run.smithi006.stdout: "target_max_objects": 0, 2023-08-01T19:54:32.527 INFO:teuthology.orchestra.run.smithi006.stdout: "cache_target_dirty_ratio_micro": 400000, 2023-08-01T19:54:32.527 INFO:teuthology.orchestra.run.smithi006.stdout: "cache_target_dirty_high_ratio_micro": 600000, 2023-08-01T19:54:32.527 INFO:teuthology.orchestra.run.smithi006.stdout: "cache_target_full_ratio_micro": 800000, 2023-08-01T19:54:32.527 INFO:teuthology.orchestra.run.smithi006.stdout: "cache_min_flush_age": 0, 2023-08-01T19:54:32.527 INFO:teuthology.orchestra.run.smithi006.stdout: "cache_min_evict_age": 0, 2023-08-01T19:54:32.527 INFO:teuthology.orchestra.run.smithi006.stdout: "erasure_code_profile": "", 2023-08-01T19:54:32.528 INFO:teuthology.orchestra.run.smithi006.stdout: "hit_set_params": { 2023-08-01T19:54:32.528 INFO:teuthology.orchestra.run.smithi006.stdout: "type": "none" 2023-08-01T19:54:32.528 INFO:teuthology.orchestra.run.smithi006.stdout: }, 2023-08-01T19:54:32.528 INFO:teuthology.orchestra.run.smithi006.stdout: "hit_set_period": 0, 2023-08-01T19:54:32.528 INFO:teuthology.orchestra.run.smithi006.stdout: "hit_set_count": 0, 2023-08-01T19:54:32.528 INFO:teuthology.orchestra.run.smithi006.stdout: "use_gmt_hitset": true, 2023-08-01T19:54:32.528 INFO:teuthology.orchestra.run.smithi006.stdout: "min_read_recency_for_promote": 0, 2023-08-01T19:54:32.528 INFO:teuthology.orchestra.run.smithi006.stdout: "min_write_recency_for_promote": 0, 2023-08-01T19:54:32.529 INFO:teuthology.orchestra.run.smithi006.stdout: "hit_set_grade_decay_rate": 0, 2023-08-01T19:54:32.529 INFO:teuthology.orchestra.run.smithi006.stdout: "hit_set_search_last_n": 0, 2023-08-01T19:54:32.529 INFO:teuthology.orchestra.run.smithi006.stdout: "grade_table": [], 2023-08-01T19:54:32.529 INFO:teuthology.orchestra.run.smithi006.stdout: "stripe_width": 0, 2023-08-01T19:54:32.529 INFO:teuthology.orchestra.run.smithi006.stdout: "expected_num_objects": 0, 2023-08-01T19:54:32.529 INFO:teuthology.orchestra.run.smithi006.stdout: "fast_read": false, 2023-08-01T19:54:32.529 INFO:teuthology.orchestra.run.smithi006.stdout: "options": { 2023-08-01T19:54:32.529 INFO:teuthology.orchestra.run.smithi006.stdout: "pg_num_min": 64, 2023-08-01T19:54:32.530 INFO:teuthology.orchestra.run.smithi006.stdout: "target_size_ratio": 0.89999997615814209 2023-08-01T19:54:32.530 INFO:teuthology.orchestra.run.smithi006.stdout: }, 2023-08-01T19:54:32.530 INFO:teuthology.orchestra.run.smithi006.stdout: "application_metadata": { 2023-08-01T19:54:32.530 INFO:teuthology.orchestra.run.smithi006.stdout: "cephfs": { 2023-08-01T19:54:32.530 INFO:teuthology.orchestra.run.smithi006.stdout: "data": "cephfs" 2023-08-01T19:54:32.530 INFO:teuthology.orchestra.run.smithi006.stdout: } 2023-08-01T19:54:32.530 INFO:teuthology.orchestra.run.smithi006.stdout: } 2023-08-01T19:54:32.530 INFO:teuthology.orchestra.run.smithi006.stdout: }, 2023-08-01T19:54:32.531 INFO:teuthology.orchestra.run.smithi006.stdout: { 2023-08-01T19:54:32.531 INFO:teuthology.orchestra.run.smithi006.stdout: "pool": 5, 2023-08-01T19:54:32.531 INFO:teuthology.orchestra.run.smithi006.stdout: "pool_name": "unique_pool_0", 2023-08-01T19:54:32.531 INFO:teuthology.orchestra.run.smithi006.stdout: "create_time": "2023-08-01T19:54:21.165668+0000", 2023-08-01T19:54:32.531 INFO:teuthology.orchestra.run.smithi006.stdout: "flags": 1, 2023-08-01T19:54:32.531 INFO:teuthology.orchestra.run.smithi006.stdout: "flags_names": "hashpspool", 2023-08-01T19:54:32.531 INFO:teuthology.orchestra.run.smithi006.stdout: "type": 1, 2023-08-01T19:54:32.531 INFO:teuthology.orchestra.run.smithi006.stdout: "size": 2, 2023-08-01T19:54:32.532 INFO:teuthology.orchestra.run.smithi006.stdout: "min_size": 1, 2023-08-01T19:54:32.532 INFO:teuthology.orchestra.run.smithi006.stdout: "crush_rule": 0, 2023-08-01T19:54:32.532 INFO:teuthology.orchestra.run.smithi006.stdout: "peering_crush_bucket_count": 0, 2023-08-01T19:54:32.532 INFO:teuthology.orchestra.run.smithi006.stdout: "peering_crush_bucket_target": 0, 2023-08-01T19:54:32.532 INFO:teuthology.orchestra.run.smithi006.stdout: "peering_crush_bucket_barrier": 0, 2023-08-01T19:54:32.532 INFO:teuthology.orchestra.run.smithi006.stdout: "peering_crush_bucket_mandatory_member": 2147483647, 2023-08-01T19:54:32.532 INFO:teuthology.orchestra.run.smithi006.stdout: "object_hash": 2, 2023-08-01T19:54:32.532 INFO:teuthology.orchestra.run.smithi006.stdout: "pg_autoscale_mode": "off", 2023-08-01T19:54:32.533 INFO:teuthology.orchestra.run.smithi006.stdout: "pg_num": 16, 2023-08-01T19:54:32.533 INFO:teuthology.orchestra.run.smithi006.stdout: "pg_placement_num": 16, 2023-08-01T19:54:32.533 INFO:teuthology.orchestra.run.smithi006.stdout: "pg_placement_num_target": 16, 2023-08-01T19:54:32.533 INFO:teuthology.orchestra.run.smithi006.stdout: "pg_num_target": 16, 2023-08-01T19:54:32.533 INFO:teuthology.orchestra.run.smithi006.stdout: "pg_num_pending": 16, 2023-08-01T19:54:32.533 INFO:teuthology.orchestra.run.smithi006.stdout: "last_pg_merge_meta": { 2023-08-01T19:54:32.533 INFO:teuthology.orchestra.run.smithi006.stdout: "source_pgid": "0.0", 2023-08-01T19:54:32.533 INFO:teuthology.orchestra.run.smithi006.stdout: "ready_epoch": 0, 2023-08-01T19:54:32.534 INFO:teuthology.orchestra.run.smithi006.stdout: "last_epoch_started": 0, 2023-08-01T19:54:32.534 INFO:teuthology.orchestra.run.smithi006.stdout: "last_epoch_clean": 0, 2023-08-01T19:54:32.534 INFO:teuthology.orchestra.run.smithi006.stdout: "source_version": "0'0", 2023-08-01T19:54:32.534 INFO:teuthology.orchestra.run.smithi006.stdout: "target_version": "0'0" 2023-08-01T19:54:32.534 INFO:teuthology.orchestra.run.smithi006.stdout: }, 2023-08-01T19:54:32.534 INFO:teuthology.orchestra.run.smithi006.stdout: "last_change": "21", 2023-08-01T19:54:32.534 INFO:teuthology.orchestra.run.smithi006.stdout: "last_force_op_resend": "0", 2023-08-01T19:54:32.534 INFO:teuthology.orchestra.run.smithi006.stdout: "last_force_op_resend_prenautilus": "0", 2023-08-01T19:54:32.535 INFO:teuthology.orchestra.run.smithi006.stdout: "last_force_op_resend_preluminous": "0", 2023-08-01T19:54:32.535 INFO:teuthology.orchestra.run.smithi006.stdout: "auid": 0, 2023-08-01T19:54:32.535 INFO:teuthology.orchestra.run.smithi006.stdout: "snap_mode": "selfmanaged", 2023-08-01T19:54:32.535 INFO:teuthology.orchestra.run.smithi006.stdout: "snap_seq": 0, 2023-08-01T19:54:32.535 INFO:teuthology.orchestra.run.smithi006.stdout: "snap_epoch": 0, 2023-08-01T19:54:32.535 INFO:teuthology.orchestra.run.smithi006.stdout: "pool_snaps": [], 2023-08-01T19:54:32.535 INFO:teuthology.orchestra.run.smithi006.stdout: "removed_snaps": "[]", 2023-08-01T19:54:32.536 INFO:teuthology.orchestra.run.smithi006.stdout: "quota_max_bytes": 0, 2023-08-01T19:54:32.536 INFO:teuthology.orchestra.run.smithi006.stdout: "quota_max_objects": 0, 2023-08-01T19:54:32.536 INFO:teuthology.orchestra.run.smithi006.stdout: "tiers": [], 2023-08-01T19:54:32.536 INFO:teuthology.orchestra.run.smithi006.stdout: "tier_of": -1, 2023-08-01T19:54:32.536 INFO:teuthology.orchestra.run.smithi006.stdout: "read_tier": -1, 2023-08-01T19:54:32.536 INFO:teuthology.orchestra.run.smithi006.stdout: "write_tier": -1, 2023-08-01T19:54:32.536 INFO:teuthology.orchestra.run.smithi006.stdout: "cache_mode": "none", 2023-08-01T19:54:32.536 INFO:teuthology.orchestra.run.smithi006.stdout: "target_max_bytes": 0, 2023-08-01T19:54:32.537 INFO:teuthology.orchestra.run.smithi006.stdout: "target_max_objects": 0, 2023-08-01T19:54:32.537 INFO:teuthology.orchestra.run.smithi006.stdout: "cache_target_dirty_ratio_micro": 400000, 2023-08-01T19:54:32.537 INFO:teuthology.orchestra.run.smithi006.stdout: "cache_target_dirty_high_ratio_micro": 600000, 2023-08-01T19:54:32.537 INFO:teuthology.orchestra.run.smithi006.stdout: "cache_target_full_ratio_micro": 800000, 2023-08-01T19:54:32.537 INFO:teuthology.orchestra.run.smithi006.stdout: "cache_min_flush_age": 0, 2023-08-01T19:54:32.537 INFO:teuthology.orchestra.run.smithi006.stdout: "cache_min_evict_age": 0, 2023-08-01T19:54:32.537 INFO:teuthology.orchestra.run.smithi006.stdout: "erasure_code_profile": "", 2023-08-01T19:54:32.537 INFO:teuthology.orchestra.run.smithi006.stdout: "hit_set_params": { 2023-08-01T19:54:32.538 INFO:teuthology.orchestra.run.smithi006.stdout: "type": "none" 2023-08-01T19:54:32.538 INFO:teuthology.orchestra.run.smithi006.stdout: }, 2023-08-01T19:54:32.538 INFO:teuthology.orchestra.run.smithi006.stdout: "hit_set_period": 0, 2023-08-01T19:54:32.538 INFO:teuthology.orchestra.run.smithi006.stdout: "hit_set_count": 0, 2023-08-01T19:54:32.538 INFO:teuthology.orchestra.run.smithi006.stdout: "use_gmt_hitset": true, 2023-08-01T19:54:32.538 INFO:teuthology.orchestra.run.smithi006.stdout: "min_read_recency_for_promote": 0, 2023-08-01T19:54:32.538 INFO:teuthology.orchestra.run.smithi006.stdout: "min_write_recency_for_promote": 0, 2023-08-01T19:54:32.538 INFO:teuthology.orchestra.run.smithi006.stdout: "hit_set_grade_decay_rate": 0, 2023-08-01T19:54:32.539 INFO:teuthology.orchestra.run.smithi006.stdout: "hit_set_search_last_n": 0, 2023-08-01T19:54:32.539 INFO:teuthology.orchestra.run.smithi006.stdout: "grade_table": [], 2023-08-01T19:54:32.539 INFO:teuthology.orchestra.run.smithi006.stdout: "stripe_width": 0, 2023-08-01T19:54:32.539 INFO:teuthology.orchestra.run.smithi006.stdout: "expected_num_objects": 0, 2023-08-01T19:54:32.539 INFO:teuthology.orchestra.run.smithi006.stdout: "fast_read": false, 2023-08-01T19:54:32.539 INFO:teuthology.orchestra.run.smithi006.stdout: "options": {}, 2023-08-01T19:54:32.539 INFO:teuthology.orchestra.run.smithi006.stdout: "application_metadata": { 2023-08-01T19:54:32.539 INFO:teuthology.orchestra.run.smithi006.stdout: "rados": {} 2023-08-01T19:54:32.540 INFO:teuthology.orchestra.run.smithi006.stdout: } 2023-08-01T19:54:32.540 INFO:teuthology.orchestra.run.smithi006.stdout: } 2023-08-01T19:54:32.540 INFO:teuthology.orchestra.run.smithi006.stdout: ], 2023-08-01T19:54:32.540 INFO:teuthology.orchestra.run.smithi006.stdout: "osds": [ 2023-08-01T19:54:32.540 INFO:teuthology.orchestra.run.smithi006.stdout: { 2023-08-01T19:54:32.540 INFO:teuthology.orchestra.run.smithi006.stdout: "osd": 0, 2023-08-01T19:54:32.540 INFO:teuthology.orchestra.run.smithi006.stdout: "uuid": "5dd675c7-2777-48f2-8009-ff0e0d4c7086", 2023-08-01T19:54:32.540 INFO:teuthology.orchestra.run.smithi006.stdout: "up": 1, 2023-08-01T19:54:32.541 INFO:teuthology.orchestra.run.smithi006.stdout: "in": 1, 2023-08-01T19:54:32.541 INFO:teuthology.orchestra.run.smithi006.stdout: "weight": 1, 2023-08-01T19:54:32.541 INFO:teuthology.orchestra.run.smithi006.stdout: "primary_affinity": 1, 2023-08-01T19:54:32.541 INFO:teuthology.orchestra.run.smithi006.stdout: "last_clean_begin": 0, 2023-08-01T19:54:32.541 INFO:teuthology.orchestra.run.smithi006.stdout: "last_clean_end": 0, 2023-08-01T19:54:32.541 INFO:teuthology.orchestra.run.smithi006.stdout: "up_from": 8, 2023-08-01T19:54:32.541 INFO:teuthology.orchestra.run.smithi006.stdout: "up_thru": 19, 2023-08-01T19:54:32.541 INFO:teuthology.orchestra.run.smithi006.stdout: "down_at": 0, 2023-08-01T19:54:32.542 INFO:teuthology.orchestra.run.smithi006.stdout: "lost_at": 0, 2023-08-01T19:54:32.542 INFO:teuthology.orchestra.run.smithi006.stdout: "public_addrs": { 2023-08-01T19:54:32.542 INFO:teuthology.orchestra.run.smithi006.stdout: "addrvec": [ 2023-08-01T19:54:32.542 INFO:teuthology.orchestra.run.smithi006.stdout: { 2023-08-01T19:54:32.542 INFO:teuthology.orchestra.run.smithi006.stdout: "type": "v2", 2023-08-01T19:54:32.542 INFO:teuthology.orchestra.run.smithi006.stdout: "addr": "172.21.15.8:6800", 2023-08-01T19:54:32.542 INFO:teuthology.orchestra.run.smithi006.stdout: "nonce": 111181 2023-08-01T19:54:32.542 INFO:teuthology.orchestra.run.smithi006.stdout: }, 2023-08-01T19:54:32.543 INFO:teuthology.orchestra.run.smithi006.stdout: { 2023-08-01T19:54:32.543 INFO:teuthology.orchestra.run.smithi006.stdout: "type": "v1", 2023-08-01T19:54:32.543 INFO:teuthology.orchestra.run.smithi006.stdout: "addr": "172.21.15.8:6801", 2023-08-01T19:54:32.543 INFO:teuthology.orchestra.run.smithi006.stdout: "nonce": 111181 2023-08-01T19:54:32.543 INFO:teuthology.orchestra.run.smithi006.stdout: } 2023-08-01T19:54:32.543 INFO:teuthology.orchestra.run.smithi006.stdout: ] 2023-08-01T19:54:32.543 INFO:teuthology.orchestra.run.smithi006.stdout: }, 2023-08-01T19:54:32.543 INFO:teuthology.orchestra.run.smithi006.stdout: "cluster_addrs": { 2023-08-01T19:54:32.544 INFO:teuthology.orchestra.run.smithi006.stdout: "addrvec": [ 2023-08-01T19:54:32.544 INFO:teuthology.orchestra.run.smithi006.stdout: { 2023-08-01T19:54:32.544 INFO:teuthology.orchestra.run.smithi006.stdout: "type": "v2", 2023-08-01T19:54:32.544 INFO:teuthology.orchestra.run.smithi006.stdout: "addr": "172.21.15.8:6802", 2023-08-01T19:54:32.544 INFO:teuthology.orchestra.run.smithi006.stdout: "nonce": 111181 2023-08-01T19:54:32.544 INFO:teuthology.orchestra.run.smithi006.stdout: }, 2023-08-01T19:54:32.544 INFO:teuthology.orchestra.run.smithi006.stdout: { 2023-08-01T19:54:32.545 INFO:teuthology.orchestra.run.smithi006.stdout: "type": "v1", 2023-08-01T19:54:32.545 INFO:teuthology.orchestra.run.smithi006.stdout: "addr": "172.21.15.8:6803", 2023-08-01T19:54:32.545 INFO:teuthology.orchestra.run.smithi006.stdout: "nonce": 111181 2023-08-01T19:54:32.545 INFO:teuthology.orchestra.run.smithi006.stdout: } 2023-08-01T19:54:32.545 INFO:teuthology.orchestra.run.smithi006.stdout: ] 2023-08-01T19:54:32.545 INFO:teuthology.orchestra.run.smithi006.stdout: }, 2023-08-01T19:54:32.545 INFO:teuthology.orchestra.run.smithi006.stdout: "heartbeat_back_addrs": { 2023-08-01T19:54:32.545 INFO:teuthology.orchestra.run.smithi006.stdout: "addrvec": [ 2023-08-01T19:54:32.546 INFO:teuthology.orchestra.run.smithi006.stdout: { 2023-08-01T19:54:32.546 INFO:teuthology.orchestra.run.smithi006.stdout: "type": "v2", 2023-08-01T19:54:32.546 INFO:teuthology.orchestra.run.smithi006.stdout: "addr": "172.21.15.8:6806", 2023-08-01T19:54:32.546 INFO:teuthology.orchestra.run.smithi006.stdout: "nonce": 111181 2023-08-01T19:54:32.546 INFO:teuthology.orchestra.run.smithi006.stdout: }, 2023-08-01T19:54:32.546 INFO:teuthology.orchestra.run.smithi006.stdout: { 2023-08-01T19:54:32.546 INFO:teuthology.orchestra.run.smithi006.stdout: "type": "v1", 2023-08-01T19:54:32.546 INFO:teuthology.orchestra.run.smithi006.stdout: "addr": "172.21.15.8:6807", 2023-08-01T19:54:32.547 INFO:teuthology.orchestra.run.smithi006.stdout: "nonce": 111181 2023-08-01T19:54:32.547 INFO:teuthology.orchestra.run.smithi006.stdout: } 2023-08-01T19:54:32.547 INFO:teuthology.orchestra.run.smithi006.stdout: ] 2023-08-01T19:54:32.547 INFO:teuthology.orchestra.run.smithi006.stdout: }, 2023-08-01T19:54:32.547 INFO:teuthology.orchestra.run.smithi006.stdout: "heartbeat_front_addrs": { 2023-08-01T19:54:32.547 INFO:teuthology.orchestra.run.smithi006.stdout: "addrvec": [ 2023-08-01T19:54:32.547 INFO:teuthology.orchestra.run.smithi006.stdout: { 2023-08-01T19:54:32.547 INFO:teuthology.orchestra.run.smithi006.stdout: "type": "v2", 2023-08-01T19:54:32.548 INFO:teuthology.orchestra.run.smithi006.stdout: "addr": "172.21.15.8:6804", 2023-08-01T19:54:32.548 INFO:teuthology.orchestra.run.smithi006.stdout: "nonce": 111181 2023-08-01T19:54:32.548 INFO:teuthology.orchestra.run.smithi006.stdout: }, 2023-08-01T19:54:32.548 INFO:teuthology.orchestra.run.smithi006.stdout: { 2023-08-01T19:54:32.548 INFO:teuthology.orchestra.run.smithi006.stdout: "type": "v1", 2023-08-01T19:54:32.548 INFO:teuthology.orchestra.run.smithi006.stdout: "addr": "172.21.15.8:6805", 2023-08-01T19:54:32.548 INFO:teuthology.orchestra.run.smithi006.stdout: "nonce": 111181 2023-08-01T19:54:32.548 INFO:teuthology.orchestra.run.smithi006.stdout: } 2023-08-01T19:54:32.549 INFO:teuthology.orchestra.run.smithi006.stdout: ] 2023-08-01T19:54:32.549 INFO:teuthology.orchestra.run.smithi006.stdout: }, 2023-08-01T19:54:32.549 INFO:teuthology.orchestra.run.smithi006.stdout: "public_addr": "172.21.15.8:6801/111181", 2023-08-01T19:54:32.549 INFO:teuthology.orchestra.run.smithi006.stdout: "cluster_addr": "172.21.15.8:6803/111181", 2023-08-01T19:54:32.549 INFO:teuthology.orchestra.run.smithi006.stdout: "heartbeat_back_addr": "172.21.15.8:6807/111181", 2023-08-01T19:54:32.549 INFO:teuthology.orchestra.run.smithi006.stdout: "heartbeat_front_addr": "172.21.15.8:6805/111181", 2023-08-01T19:54:32.549 INFO:teuthology.orchestra.run.smithi006.stdout: "state": [ 2023-08-01T19:54:32.549 INFO:teuthology.orchestra.run.smithi006.stdout: "exists", 2023-08-01T19:54:32.550 INFO:teuthology.orchestra.run.smithi006.stdout: "up" 2023-08-01T19:54:32.550 INFO:teuthology.orchestra.run.smithi006.stdout: ] 2023-08-01T19:54:32.550 INFO:teuthology.orchestra.run.smithi006.stdout: }, 2023-08-01T19:54:32.550 INFO:teuthology.orchestra.run.smithi006.stdout: { 2023-08-01T19:54:32.550 INFO:teuthology.orchestra.run.smithi006.stdout: "osd": 1, 2023-08-01T19:54:32.550 INFO:teuthology.orchestra.run.smithi006.stdout: "uuid": "7fc612c4-33ba-4a33-bca8-1f42ee8ed548", 2023-08-01T19:54:32.550 INFO:teuthology.orchestra.run.smithi006.stdout: "up": 1, 2023-08-01T19:54:32.550 INFO:teuthology.orchestra.run.smithi006.stdout: "in": 1, 2023-08-01T19:54:32.551 INFO:teuthology.orchestra.run.smithi006.stdout: "weight": 1, 2023-08-01T19:54:32.551 INFO:teuthology.orchestra.run.smithi006.stdout: "primary_affinity": 1, 2023-08-01T19:54:32.551 INFO:teuthology.orchestra.run.smithi006.stdout: "last_clean_begin": 0, 2023-08-01T19:54:32.551 INFO:teuthology.orchestra.run.smithi006.stdout: "last_clean_end": 0, 2023-08-01T19:54:32.551 INFO:teuthology.orchestra.run.smithi006.stdout: "up_from": 8, 2023-08-01T19:54:32.551 INFO:teuthology.orchestra.run.smithi006.stdout: "up_thru": 19, 2023-08-01T19:54:32.551 INFO:teuthology.orchestra.run.smithi006.stdout: "down_at": 0, 2023-08-01T19:54:32.551 INFO:teuthology.orchestra.run.smithi006.stdout: "lost_at": 0, 2023-08-01T19:54:32.552 INFO:teuthology.orchestra.run.smithi006.stdout: "public_addrs": { 2023-08-01T19:54:32.552 INFO:teuthology.orchestra.run.smithi006.stdout: "addrvec": [ 2023-08-01T19:54:32.552 INFO:teuthology.orchestra.run.smithi006.stdout: { 2023-08-01T19:54:32.552 INFO:teuthology.orchestra.run.smithi006.stdout: "type": "v2", 2023-08-01T19:54:32.552 INFO:teuthology.orchestra.run.smithi006.stdout: "addr": "172.21.15.101:6800", 2023-08-01T19:54:32.552 INFO:teuthology.orchestra.run.smithi006.stdout: "nonce": 111143 2023-08-01T19:54:32.552 INFO:teuthology.orchestra.run.smithi006.stdout: }, 2023-08-01T19:54:32.553 INFO:teuthology.orchestra.run.smithi006.stdout: { 2023-08-01T19:54:32.553 INFO:teuthology.orchestra.run.smithi006.stdout: "type": "v1", 2023-08-01T19:54:32.553 INFO:teuthology.orchestra.run.smithi006.stdout: "addr": "172.21.15.101:6801", 2023-08-01T19:54:32.553 INFO:teuthology.orchestra.run.smithi006.stdout: "nonce": 111143 2023-08-01T19:54:32.553 INFO:teuthology.orchestra.run.smithi006.stdout: } 2023-08-01T19:54:32.553 INFO:teuthology.orchestra.run.smithi006.stdout: ] 2023-08-01T19:54:32.553 INFO:teuthology.orchestra.run.smithi006.stdout: }, 2023-08-01T19:54:32.553 INFO:teuthology.orchestra.run.smithi006.stdout: "cluster_addrs": { 2023-08-01T19:54:32.554 INFO:teuthology.orchestra.run.smithi006.stdout: "addrvec": [ 2023-08-01T19:54:32.554 INFO:teuthology.orchestra.run.smithi006.stdout: { 2023-08-01T19:54:32.554 INFO:teuthology.orchestra.run.smithi006.stdout: "type": "v2", 2023-08-01T19:54:32.554 INFO:teuthology.orchestra.run.smithi006.stdout: "addr": "172.21.15.101:6802", 2023-08-01T19:54:32.554 INFO:teuthology.orchestra.run.smithi006.stdout: "nonce": 111143 2023-08-01T19:54:32.554 INFO:teuthology.orchestra.run.smithi006.stdout: }, 2023-08-01T19:54:32.554 INFO:teuthology.orchestra.run.smithi006.stdout: { 2023-08-01T19:54:32.554 INFO:teuthology.orchestra.run.smithi006.stdout: "type": "v1", 2023-08-01T19:54:32.555 INFO:teuthology.orchestra.run.smithi006.stdout: "addr": "172.21.15.101:6803", 2023-08-01T19:54:32.555 INFO:teuthology.orchestra.run.smithi006.stdout: "nonce": 111143 2023-08-01T19:54:32.555 INFO:teuthology.orchestra.run.smithi006.stdout: } 2023-08-01T19:54:32.555 INFO:teuthology.orchestra.run.smithi006.stdout: ] 2023-08-01T19:54:32.555 INFO:teuthology.orchestra.run.smithi006.stdout: }, 2023-08-01T19:54:32.555 INFO:teuthology.orchestra.run.smithi006.stdout: "heartbeat_back_addrs": { 2023-08-01T19:54:32.555 INFO:teuthology.orchestra.run.smithi006.stdout: "addrvec": [ 2023-08-01T19:54:32.555 INFO:teuthology.orchestra.run.smithi006.stdout: { 2023-08-01T19:54:32.556 INFO:teuthology.orchestra.run.smithi006.stdout: "type": "v2", 2023-08-01T19:54:32.556 INFO:teuthology.orchestra.run.smithi006.stdout: "addr": "172.21.15.101:6806", 2023-08-01T19:54:32.556 INFO:teuthology.orchestra.run.smithi006.stdout: "nonce": 111143 2023-08-01T19:54:32.556 INFO:teuthology.orchestra.run.smithi006.stdout: }, 2023-08-01T19:54:32.556 INFO:teuthology.orchestra.run.smithi006.stdout: { 2023-08-01T19:54:32.556 INFO:teuthology.orchestra.run.smithi006.stdout: "type": "v1", 2023-08-01T19:54:32.556 INFO:teuthology.orchestra.run.smithi006.stdout: "addr": "172.21.15.101:6807", 2023-08-01T19:54:32.556 INFO:teuthology.orchestra.run.smithi006.stdout: "nonce": 111143 2023-08-01T19:54:32.557 INFO:teuthology.orchestra.run.smithi006.stdout: } 2023-08-01T19:54:32.557 INFO:teuthology.orchestra.run.smithi006.stdout: ] 2023-08-01T19:54:32.557 INFO:teuthology.orchestra.run.smithi006.stdout: }, 2023-08-01T19:54:32.557 INFO:teuthology.orchestra.run.smithi006.stdout: "heartbeat_front_addrs": { 2023-08-01T19:54:32.557 INFO:teuthology.orchestra.run.smithi006.stdout: "addrvec": [ 2023-08-01T19:54:32.557 INFO:teuthology.orchestra.run.smithi006.stdout: { 2023-08-01T19:54:32.557 INFO:teuthology.orchestra.run.smithi006.stdout: "type": "v2", 2023-08-01T19:54:32.557 INFO:teuthology.orchestra.run.smithi006.stdout: "addr": "172.21.15.101:6804", 2023-08-01T19:54:32.558 INFO:teuthology.orchestra.run.smithi006.stdout: "nonce": 111143 2023-08-01T19:54:32.558 INFO:teuthology.orchestra.run.smithi006.stdout: }, 2023-08-01T19:54:32.558 INFO:teuthology.orchestra.run.smithi006.stdout: { 2023-08-01T19:54:32.558 INFO:teuthology.orchestra.run.smithi006.stdout: "type": "v1", 2023-08-01T19:54:32.558 INFO:teuthology.orchestra.run.smithi006.stdout: "addr": "172.21.15.101:6805", 2023-08-01T19:54:32.558 INFO:teuthology.orchestra.run.smithi006.stdout: "nonce": 111143 2023-08-01T19:54:32.558 INFO:teuthology.orchestra.run.smithi006.stdout: } 2023-08-01T19:54:32.558 INFO:teuthology.orchestra.run.smithi006.stdout: ] 2023-08-01T19:54:32.559 INFO:teuthology.orchestra.run.smithi006.stdout: }, 2023-08-01T19:54:32.559 INFO:teuthology.orchestra.run.smithi006.stdout: "public_addr": "172.21.15.101:6801/111143", 2023-08-01T19:54:32.559 INFO:teuthology.orchestra.run.smithi006.stdout: "cluster_addr": "172.21.15.101:6803/111143", 2023-08-01T19:54:32.559 INFO:teuthology.orchestra.run.smithi006.stdout: "heartbeat_back_addr": "172.21.15.101:6807/111143", 2023-08-01T19:54:32.559 INFO:teuthology.orchestra.run.smithi006.stdout: "heartbeat_front_addr": "172.21.15.101:6805/111143", 2023-08-01T19:54:32.559 INFO:teuthology.orchestra.run.smithi006.stdout: "state": [ 2023-08-01T19:54:32.559 INFO:teuthology.orchestra.run.smithi006.stdout: "exists", 2023-08-01T19:54:32.559 INFO:teuthology.orchestra.run.smithi006.stdout: "up" 2023-08-01T19:54:32.560 INFO:teuthology.orchestra.run.smithi006.stdout: ] 2023-08-01T19:54:32.560 INFO:teuthology.orchestra.run.smithi006.stdout: }, 2023-08-01T19:54:32.560 INFO:teuthology.orchestra.run.smithi006.stdout: { 2023-08-01T19:54:32.560 INFO:teuthology.orchestra.run.smithi006.stdout: "osd": 2, 2023-08-01T19:54:32.560 INFO:teuthology.orchestra.run.smithi006.stdout: "uuid": "f85cadbc-4230-4772-8f39-62ed52e220b1", 2023-08-01T19:54:32.560 INFO:teuthology.orchestra.run.smithi006.stdout: "up": 1, 2023-08-01T19:54:32.560 INFO:teuthology.orchestra.run.smithi006.stdout: "in": 1, 2023-08-01T19:54:32.561 INFO:teuthology.orchestra.run.smithi006.stdout: "weight": 1, 2023-08-01T19:54:32.561 INFO:teuthology.orchestra.run.smithi006.stdout: "primary_affinity": 1, 2023-08-01T19:54:32.561 INFO:teuthology.orchestra.run.smithi006.stdout: "last_clean_begin": 0, 2023-08-01T19:54:32.561 INFO:teuthology.orchestra.run.smithi006.stdout: "last_clean_end": 0, 2023-08-01T19:54:32.561 INFO:teuthology.orchestra.run.smithi006.stdout: "up_from": 9, 2023-08-01T19:54:32.561 INFO:teuthology.orchestra.run.smithi006.stdout: "up_thru": 19, 2023-08-01T19:54:32.561 INFO:teuthology.orchestra.run.smithi006.stdout: "down_at": 0, 2023-08-01T19:54:32.561 INFO:teuthology.orchestra.run.smithi006.stdout: "lost_at": 0, 2023-08-01T19:54:32.562 INFO:teuthology.orchestra.run.smithi006.stdout: "public_addrs": { 2023-08-01T19:54:32.562 INFO:teuthology.orchestra.run.smithi006.stdout: "addrvec": [ 2023-08-01T19:54:32.562 INFO:teuthology.orchestra.run.smithi006.stdout: { 2023-08-01T19:54:32.562 INFO:teuthology.orchestra.run.smithi006.stdout: "type": "v2", 2023-08-01T19:54:32.562 INFO:teuthology.orchestra.run.smithi006.stdout: "addr": "172.21.15.155:6800", 2023-08-01T19:54:32.562 INFO:teuthology.orchestra.run.smithi006.stdout: "nonce": 111339 2023-08-01T19:54:32.562 INFO:teuthology.orchestra.run.smithi006.stdout: }, 2023-08-01T19:54:32.562 INFO:teuthology.orchestra.run.smithi006.stdout: { 2023-08-01T19:54:32.563 INFO:teuthology.orchestra.run.smithi006.stdout: "type": "v1", 2023-08-01T19:54:32.563 INFO:teuthology.orchestra.run.smithi006.stdout: "addr": "172.21.15.155:6801", 2023-08-01T19:54:32.563 INFO:teuthology.orchestra.run.smithi006.stdout: "nonce": 111339 2023-08-01T19:54:32.563 INFO:teuthology.orchestra.run.smithi006.stdout: } 2023-08-01T19:54:32.563 INFO:teuthology.orchestra.run.smithi006.stdout: ] 2023-08-01T19:54:32.563 INFO:teuthology.orchestra.run.smithi006.stdout: }, 2023-08-01T19:54:32.563 INFO:teuthology.orchestra.run.smithi006.stdout: "cluster_addrs": { 2023-08-01T19:54:32.563 INFO:teuthology.orchestra.run.smithi006.stdout: "addrvec": [ 2023-08-01T19:54:32.564 INFO:teuthology.orchestra.run.smithi006.stdout: { 2023-08-01T19:54:32.564 INFO:teuthology.orchestra.run.smithi006.stdout: "type": "v2", 2023-08-01T19:54:32.564 INFO:teuthology.orchestra.run.smithi006.stdout: "addr": "172.21.15.155:6802", 2023-08-01T19:54:32.564 INFO:teuthology.orchestra.run.smithi006.stdout: "nonce": 111339 2023-08-01T19:54:32.564 INFO:teuthology.orchestra.run.smithi006.stdout: }, 2023-08-01T19:54:32.564 INFO:teuthology.orchestra.run.smithi006.stdout: { 2023-08-01T19:54:32.564 INFO:teuthology.orchestra.run.smithi006.stdout: "type": "v1", 2023-08-01T19:54:32.564 INFO:teuthology.orchestra.run.smithi006.stdout: "addr": "172.21.15.155:6803", 2023-08-01T19:54:32.565 INFO:teuthology.orchestra.run.smithi006.stdout: "nonce": 111339 2023-08-01T19:54:32.565 INFO:teuthology.orchestra.run.smithi006.stdout: } 2023-08-01T19:54:32.565 INFO:teuthology.orchestra.run.smithi006.stdout: ] 2023-08-01T19:54:32.565 INFO:teuthology.orchestra.run.smithi006.stdout: }, 2023-08-01T19:54:32.565 INFO:teuthology.orchestra.run.smithi006.stdout: "heartbeat_back_addrs": { 2023-08-01T19:54:32.565 INFO:teuthology.orchestra.run.smithi006.stdout: "addrvec": [ 2023-08-01T19:54:32.565 INFO:teuthology.orchestra.run.smithi006.stdout: { 2023-08-01T19:54:32.565 INFO:teuthology.orchestra.run.smithi006.stdout: "type": "v2", 2023-08-01T19:54:32.566 INFO:teuthology.orchestra.run.smithi006.stdout: "addr": "172.21.15.155:6806", 2023-08-01T19:54:32.566 INFO:teuthology.orchestra.run.smithi006.stdout: "nonce": 111339 2023-08-01T19:54:32.566 INFO:teuthology.orchestra.run.smithi006.stdout: }, 2023-08-01T19:54:32.566 INFO:teuthology.orchestra.run.smithi006.stdout: { 2023-08-01T19:54:32.566 INFO:teuthology.orchestra.run.smithi006.stdout: "type": "v1", 2023-08-01T19:54:32.566 INFO:teuthology.orchestra.run.smithi006.stdout: "addr": "172.21.15.155:6807", 2023-08-01T19:54:32.566 INFO:teuthology.orchestra.run.smithi006.stdout: "nonce": 111339 2023-08-01T19:54:32.566 INFO:teuthology.orchestra.run.smithi006.stdout: } 2023-08-01T19:54:32.567 INFO:teuthology.orchestra.run.smithi006.stdout: ] 2023-08-01T19:54:32.567 INFO:teuthology.orchestra.run.smithi006.stdout: }, 2023-08-01T19:54:32.567 INFO:teuthology.orchestra.run.smithi006.stdout: "heartbeat_front_addrs": { 2023-08-01T19:54:32.567 INFO:teuthology.orchestra.run.smithi006.stdout: "addrvec": [ 2023-08-01T19:54:32.567 INFO:teuthology.orchestra.run.smithi006.stdout: { 2023-08-01T19:54:32.567 INFO:teuthology.orchestra.run.smithi006.stdout: "type": "v2", 2023-08-01T19:54:32.567 INFO:teuthology.orchestra.run.smithi006.stdout: "addr": "172.21.15.155:6804", 2023-08-01T19:54:32.567 INFO:teuthology.orchestra.run.smithi006.stdout: "nonce": 111339 2023-08-01T19:54:32.568 INFO:teuthology.orchestra.run.smithi006.stdout: }, 2023-08-01T19:54:32.568 INFO:teuthology.orchestra.run.smithi006.stdout: { 2023-08-01T19:54:32.568 INFO:teuthology.orchestra.run.smithi006.stdout: "type": "v1", 2023-08-01T19:54:32.568 INFO:teuthology.orchestra.run.smithi006.stdout: "addr": "172.21.15.155:6805", 2023-08-01T19:54:32.568 INFO:teuthology.orchestra.run.smithi006.stdout: "nonce": 111339 2023-08-01T19:54:32.568 INFO:teuthology.orchestra.run.smithi006.stdout: } 2023-08-01T19:54:32.568 INFO:teuthology.orchestra.run.smithi006.stdout: ] 2023-08-01T19:54:32.568 INFO:teuthology.orchestra.run.smithi006.stdout: }, 2023-08-01T19:54:32.569 INFO:teuthology.orchestra.run.smithi006.stdout: "public_addr": "172.21.15.155:6801/111339", 2023-08-01T19:54:32.569 INFO:teuthology.orchestra.run.smithi006.stdout: "cluster_addr": "172.21.15.155:6803/111339", 2023-08-01T19:54:32.569 INFO:teuthology.orchestra.run.smithi006.stdout: "heartbeat_back_addr": "172.21.15.155:6807/111339", 2023-08-01T19:54:32.569 INFO:teuthology.orchestra.run.smithi006.stdout: "heartbeat_front_addr": "172.21.15.155:6805/111339", 2023-08-01T19:54:32.569 INFO:teuthology.orchestra.run.smithi006.stdout: "state": [ 2023-08-01T19:54:32.569 INFO:teuthology.orchestra.run.smithi006.stdout: "exists", 2023-08-01T19:54:32.569 INFO:teuthology.orchestra.run.smithi006.stdout: "up" 2023-08-01T19:54:32.570 INFO:teuthology.orchestra.run.smithi006.stdout: ] 2023-08-01T19:54:32.570 INFO:teuthology.orchestra.run.smithi006.stdout: } 2023-08-01T19:54:32.570 INFO:teuthology.orchestra.run.smithi006.stdout: ], 2023-08-01T19:54:32.570 INFO:teuthology.orchestra.run.smithi006.stdout: "osd_xinfo": [ 2023-08-01T19:54:32.570 INFO:teuthology.orchestra.run.smithi006.stdout: { 2023-08-01T19:54:32.570 INFO:teuthology.orchestra.run.smithi006.stdout: "osd": 0, 2023-08-01T19:54:32.570 INFO:teuthology.orchestra.run.smithi006.stdout: "down_stamp": "0.000000", 2023-08-01T19:54:32.570 INFO:teuthology.orchestra.run.smithi006.stdout: "laggy_probability": 0, 2023-08-01T19:54:32.571 INFO:teuthology.orchestra.run.smithi006.stdout: "laggy_interval": 0, 2023-08-01T19:54:32.571 INFO:teuthology.orchestra.run.smithi006.stdout: "features": 4540138320759226367, 2023-08-01T19:54:32.571 INFO:teuthology.orchestra.run.smithi006.stdout: "old_weight": 0, 2023-08-01T19:54:32.571 INFO:teuthology.orchestra.run.smithi006.stdout: "last_purged_snaps_scrub": "2023-08-01T19:53:48.018154+0000", 2023-08-01T19:54:32.571 INFO:teuthology.orchestra.run.smithi006.stdout: "dead_epoch": 0 2023-08-01T19:54:32.571 INFO:teuthology.orchestra.run.smithi006.stdout: }, 2023-08-01T19:54:32.571 INFO:teuthology.orchestra.run.smithi006.stdout: { 2023-08-01T19:54:32.571 INFO:teuthology.orchestra.run.smithi006.stdout: "osd": 1, 2023-08-01T19:54:32.572 INFO:teuthology.orchestra.run.smithi006.stdout: "down_stamp": "0.000000", 2023-08-01T19:54:32.572 INFO:teuthology.orchestra.run.smithi006.stdout: "laggy_probability": 0, 2023-08-01T19:54:32.572 INFO:teuthology.orchestra.run.smithi006.stdout: "laggy_interval": 0, 2023-08-01T19:54:32.572 INFO:teuthology.orchestra.run.smithi006.stdout: "features": 4540138320759226367, 2023-08-01T19:54:32.572 INFO:teuthology.orchestra.run.smithi006.stdout: "old_weight": 0, 2023-08-01T19:54:32.572 INFO:teuthology.orchestra.run.smithi006.stdout: "last_purged_snaps_scrub": "2023-08-01T19:53:48.000488+0000", 2023-08-01T19:54:32.572 INFO:teuthology.orchestra.run.smithi006.stdout: "dead_epoch": 0 2023-08-01T19:54:32.572 INFO:teuthology.orchestra.run.smithi006.stdout: }, 2023-08-01T19:54:32.573 INFO:teuthology.orchestra.run.smithi006.stdout: { 2023-08-01T19:54:32.573 INFO:teuthology.orchestra.run.smithi006.stdout: "osd": 2, 2023-08-01T19:54:32.573 INFO:teuthology.orchestra.run.smithi006.stdout: "down_stamp": "0.000000", 2023-08-01T19:54:32.573 INFO:teuthology.orchestra.run.smithi006.stdout: "laggy_probability": 0, 2023-08-01T19:54:32.573 INFO:teuthology.orchestra.run.smithi006.stdout: "laggy_interval": 0, 2023-08-01T19:54:32.573 INFO:teuthology.orchestra.run.smithi006.stdout: "features": 4540138320759226367, 2023-08-01T19:54:32.573 INFO:teuthology.orchestra.run.smithi006.stdout: "old_weight": 0, 2023-08-01T19:54:32.573 INFO:teuthology.orchestra.run.smithi006.stdout: "last_purged_snaps_scrub": "2023-08-01T19:53:48.072529+0000", 2023-08-01T19:54:32.574 INFO:teuthology.orchestra.run.smithi006.stdout: "dead_epoch": 0 2023-08-01T19:54:32.574 INFO:teuthology.orchestra.run.smithi006.stdout: } 2023-08-01T19:54:32.574 INFO:teuthology.orchestra.run.smithi006.stdout: ], 2023-08-01T19:54:32.574 INFO:teuthology.orchestra.run.smithi006.stdout: "pg_upmap": [], 2023-08-01T19:54:32.574 INFO:teuthology.orchestra.run.smithi006.stdout: "pg_upmap_items": [], 2023-08-01T19:54:32.574 INFO:teuthology.orchestra.run.smithi006.stdout: "pg_temp": [], 2023-08-01T19:54:32.574 INFO:teuthology.orchestra.run.smithi006.stdout: "primary_temp": [], 2023-08-01T19:54:32.574 INFO:teuthology.orchestra.run.smithi006.stdout: "blocklist": {}, 2023-08-01T19:54:32.575 INFO:teuthology.orchestra.run.smithi006.stdout: "range_blocklist": {}, 2023-08-01T19:54:32.575 INFO:teuthology.orchestra.run.smithi006.stdout: "erasure_code_profiles": { 2023-08-01T19:54:32.575 INFO:teuthology.orchestra.run.smithi006.stdout: "default": { 2023-08-01T19:54:32.575 INFO:teuthology.orchestra.run.smithi006.stdout: "crush-failure-domain": "osd", 2023-08-01T19:54:32.575 INFO:teuthology.orchestra.run.smithi006.stdout: "k": "2", 2023-08-01T19:54:32.575 INFO:teuthology.orchestra.run.smithi006.stdout: "m": "1", 2023-08-01T19:54:32.575 INFO:teuthology.orchestra.run.smithi006.stdout: "plugin": "jerasure", 2023-08-01T19:54:32.575 INFO:teuthology.orchestra.run.smithi006.stdout: "technique": "reed_sol_van" 2023-08-01T19:54:32.576 INFO:teuthology.orchestra.run.smithi006.stdout: } 2023-08-01T19:54:32.576 INFO:teuthology.orchestra.run.smithi006.stdout: }, 2023-08-01T19:54:32.576 INFO:teuthology.orchestra.run.smithi006.stdout: "removed_snaps_queue": [], 2023-08-01T19:54:32.576 INFO:teuthology.orchestra.run.smithi006.stdout: "new_removed_snaps": [], 2023-08-01T19:54:32.576 INFO:teuthology.orchestra.run.smithi006.stdout: "new_purged_snaps": [], 2023-08-01T19:54:32.576 INFO:teuthology.orchestra.run.smithi006.stdout: "crush_node_flags": {}, 2023-08-01T19:54:32.576 INFO:teuthology.orchestra.run.smithi006.stdout: "device_class_flags": {}, 2023-08-01T19:54:32.576 INFO:teuthology.orchestra.run.smithi006.stdout: "stretch_mode": { 2023-08-01T19:54:32.577 INFO:teuthology.orchestra.run.smithi006.stdout: "stretch_mode_enabled": false, 2023-08-01T19:54:32.577 INFO:teuthology.orchestra.run.smithi006.stdout: "stretch_bucket_count": 0, 2023-08-01T19:54:32.577 INFO:teuthology.orchestra.run.smithi006.stdout: "degraded_stretch_mode": 0, 2023-08-01T19:54:32.577 INFO:teuthology.orchestra.run.smithi006.stdout: "recovering_stretch_mode": 0, 2023-08-01T19:54:32.577 INFO:teuthology.orchestra.run.smithi006.stdout: "stretch_mode_bucket": 0 2023-08-01T19:54:32.577 INFO:teuthology.orchestra.run.smithi006.stdout: } 2023-08-01T19:54:32.577 INFO:teuthology.orchestra.run.smithi006.stdout:} 2023-08-01T19:54:32.579 INFO:tasks.thrashosds.thrasher:j is {'epoch': 24, 'fsid': 'a0e420cc-4df1-42a5-8bd4-a98c309a9349', 'created': '2023-08-01T19:53:41.279588+0000', 'modified': '2023-08-01T19:54:31.148314+0000', 'last_up_change': '2023-08-01T19:53:50.735626+0000', 'last_in_change': '2023-08-01T19:53:42.974751+0000', 'flags': 'sortbitwise,recovery_deletes,purged_snapdirs,pglog_hardlimit', 'flags_num': 5799936, 'flags_set': ['pglog_hardlimit', 'purged_snapdirs', 'recovery_deletes', 'sortbitwise'], 'crush_version': 5, 'full_ratio': 0.949999988079071, 'backfillfull_ratio': 0.8999999761581421, 'nearfull_ratio': 0.8500000238418579, 'cluster_snapshot': '', 'pool_max': 5, 'max_osd': 3, 'require_min_compat_client': 'luminous', 'min_compat_client': 'jewel', 'require_osd_release': 'quincy', 'pools': [{'pool': 1, 'pool_name': '.mgr', 'create_time': '2023-08-01T19:53:49.961944+0000', 'flags': 1, 'flags_names': 'hashpspool', 'type': 1, 'size': 2, 'min_size': 1, 'crush_rule': 0, 'peering_crush_bucket_count': 0, 'peering_crush_bucket_target': 0, 'peering_crush_bucket_barrier': 0, 'peering_crush_bucket_mandatory_member': 2147483647, 'object_hash': 2, 'pg_autoscale_mode': 'off', 'pg_num': 1, 'pg_placement_num': 1, 'pg_placement_num_target': 1, 'pg_num_target': 1, 'pg_num_pending': 1, 'last_pg_merge_meta': {'source_pgid': '0.0', 'ready_epoch': 0, 'last_epoch_started': 0, 'last_epoch_clean': 0, 'source_version': "0'0", 'target_version': "0'0"}, 'last_change': '11', 'last_force_op_resend': '0', 'last_force_op_resend_prenautilus': '0', 'last_force_op_resend_preluminous': '0', 'auid': 0, 'snap_mode': 'selfmanaged', 'snap_seq': 0, 'snap_epoch': 0, 'pool_snaps': [], 'removed_snaps': '[]', 'quota_max_bytes': 0, 'quota_max_objects': 0, 'tiers': [], 'tier_of': -1, 'read_tier': -1, 'write_tier': -1, 'cache_mode': 'none', 'target_max_bytes': 0, 'target_max_objects': 0, 'cache_target_dirty_ratio_micro': 400000, 'cache_target_dirty_high_ratio_micro': 600000, 'cache_target_full_ratio_micro': 800000, 'cache_min_flush_age': 0, 'cache_min_evict_age': 0, 'erasure_code_profile': '', 'hit_set_params': {'type': 'none'}, 'hit_set_period': 0, 'hit_set_count': 0, 'use_gmt_hitset': True, 'min_read_recency_for_promote': 0, 'min_write_recency_for_promote': 0, 'hit_set_grade_decay_rate': 0, 'hit_set_search_last_n': 0, 'grade_table': [], 'stripe_width': 0, 'expected_num_objects': 0, 'fast_read': False, 'options': {'pg_num_max': 32, 'pg_num_min': 1}, 'application_metadata': {'mgr': {}}}, {'pool': 2, 'pool_name': 'rbd', 'create_time': '2023-08-01T19:53:57.404091+0000', 'flags': 1, 'flags_names': 'hashpspool', 'type': 1, 'size': 2, 'min_size': 1, 'crush_rule': 0, 'peering_crush_bucket_count': 0, 'peering_crush_bucket_target': 0, 'peering_crush_bucket_barrier': 0, 'peering_crush_bucket_mandatory_member': 2147483647, 'object_hash': 2, 'pg_autoscale_mode': 'off', 'pg_num': 8, 'pg_placement_num': 8, 'pg_placement_num_target': 8, 'pg_num_target': 8, 'pg_num_pending': 8, 'last_pg_merge_meta': {'source_pgid': '0.0', 'ready_epoch': 0, 'last_epoch_started': 0, 'last_epoch_clean': 0, 'source_version': "0'0", 'target_version': "0'0"}, 'last_change': '14', 'last_force_op_resend': '0', 'last_force_op_resend_prenautilus': '0', 'last_force_op_resend_preluminous': '0', 'auid': 0, 'snap_mode': 'selfmanaged', 'snap_seq': 0, 'snap_epoch': 0, 'pool_snaps': [], 'removed_snaps': '[]', 'quota_max_bytes': 0, 'quota_max_objects': 0, 'tiers': [], 'tier_of': -1, 'read_tier': -1, 'write_tier': -1, 'cache_mode': 'none', 'target_max_bytes': 0, 'target_max_objects': 0, 'cache_target_dirty_ratio_micro': 400000, 'cache_target_dirty_high_ratio_micro': 600000, 'cache_target_full_ratio_micro': 800000, 'cache_min_flush_age': 0, 'cache_min_evict_age': 0, 'erasure_code_profile': '', 'hit_set_params': {'type': 'none'}, 'hit_set_period': 0, 'hit_set_count': 0, 'use_gmt_hitset': True, 'min_read_recency_for_promote': 0, 'min_write_recency_for_promote': 0, 'hit_set_grade_decay_rate': 0, 'hit_set_search_last_n': 0, 'grade_table': [], 'stripe_width': 0, 'expected_num_objects': 0, 'fast_read': False, 'options': {}, 'application_metadata': {'rbd': {}}}, {'pool': 3, 'pool_name': 'cephfs_metadata', 'create_time': '2023-08-01T19:54:02.111247+0000', 'flags': 1, 'flags_names': 'hashpspool', 'type': 1, 'size': 2, 'min_size': 1, 'crush_rule': 0, 'peering_crush_bucket_count': 0, 'peering_crush_bucket_target': 0, 'peering_crush_bucket_barrier': 0, 'peering_crush_bucket_mandatory_member': 2147483647, 'object_hash': 2, 'pg_autoscale_mode': 'off', 'pg_num': 32, 'pg_placement_num': 32, 'pg_placement_num_target': 32, 'pg_num_target': 32, 'pg_num_pending': 32, 'last_pg_merge_meta': {'source_pgid': '0.0', 'ready_epoch': 0, 'last_epoch_started': 0, 'last_epoch_clean': 0, 'source_version': "0'0", 'target_version': "0'0"}, 'last_change': '17', 'last_force_op_resend': '0', 'last_force_op_resend_prenautilus': '0', 'last_force_op_resend_preluminous': '0', 'auid': 0, 'snap_mode': 'selfmanaged', 'snap_seq': 0, 'snap_epoch': 0, 'pool_snaps': [], 'removed_snaps': '[]', 'quota_max_bytes': 0, 'quota_max_objects': 0, 'tiers': [], 'tier_of': -1, 'read_tier': -1, 'write_tier': -1, 'cache_mode': 'none', 'target_max_bytes': 0, 'target_max_objects': 0, 'cache_target_dirty_ratio_micro': 400000, 'cache_target_dirty_high_ratio_micro': 600000, 'cache_target_full_ratio_micro': 800000, 'cache_min_flush_age': 0, 'cache_min_evict_age': 0, 'erasure_code_profile': '', 'hit_set_params': {'type': 'none'}, 'hit_set_period': 0, 'hit_set_count': 0, 'use_gmt_hitset': True, 'min_read_recency_for_promote': 0, 'min_write_recency_for_promote': 0, 'hit_set_grade_decay_rate': 0, 'hit_set_search_last_n': 0, 'grade_table': [], 'stripe_width': 0, 'expected_num_objects': 0, 'fast_read': False, 'options': {'pg_autoscale_bias': 4, 'pg_num_min': 16, 'recovery_priority': 5}, 'application_metadata': {'cephfs': {'metadata': 'cephfs'}}}, {'pool': 4, 'pool_name': 'cephfs_data', 'create_time': '2023-08-01T19:54:03.430277+0000', 'flags': 1, 'flags_names': 'hashpspool', 'type': 1, 'size': 2, 'min_size': 1, 'crush_rule': 0, 'peering_crush_bucket_count': 0, 'peering_crush_bucket_target': 0, 'peering_crush_bucket_barrier': 0, 'peering_crush_bucket_mandatory_member': 2147483647, 'object_hash': 2, 'pg_autoscale_mode': 'off', 'pg_num': 64, 'pg_placement_num': 64, 'pg_placement_num_target': 64, 'pg_num_target': 64, 'pg_num_pending': 64, 'last_pg_merge_meta': {'source_pgid': '0.0', 'ready_epoch': 0, 'last_epoch_started': 0, 'last_epoch_clean': 0, 'source_version': "0'0", 'target_version': "0'0"}, 'last_change': '18', 'last_force_op_resend': '0', 'last_force_op_resend_prenautilus': '0', 'last_force_op_resend_preluminous': '0', 'auid': 0, 'snap_mode': 'selfmanaged', 'snap_seq': 0, 'snap_epoch': 0, 'pool_snaps': [], 'removed_snaps': '[]', 'quota_max_bytes': 0, 'quota_max_objects': 0, 'tiers': [], 'tier_of': -1, 'read_tier': -1, 'write_tier': -1, 'cache_mode': 'none', 'target_max_bytes': 0, 'target_max_objects': 0, 'cache_target_dirty_ratio_micro': 400000, 'cache_target_dirty_high_ratio_micro': 600000, 'cache_target_full_ratio_micro': 800000, 'cache_min_flush_age': 0, 'cache_min_evict_age': 0, 'erasure_code_profile': '', 'hit_set_params': {'type': 'none'}, 'hit_set_period': 0, 'hit_set_count': 0, 'use_gmt_hitset': True, 'min_read_recency_for_promote': 0, 'min_write_recency_for_promote': 0, 'hit_set_grade_decay_rate': 0, 'hit_set_search_last_n': 0, 'grade_table': [], 'stripe_width': 0, 'expected_num_objects': 0, 'fast_read': False, 'options': {'pg_num_min': 64, 'target_size_ratio': 0.8999999761581421}, 'application_metadata': {'cephfs': {'data': 'cephfs'}}}, {'pool': 5, 'pool_name': 'unique_pool_0', 'create_time': '2023-08-01T19:54:21.165668+0000', 'flags': 1, 'flags_names': 'hashpspool', 'type': 1, 'size': 2, 'min_size': 1, 'crush_rule': 0, 'peering_crush_bucket_count': 0, 'peering_crush_bucket_target': 0, 'peering_crush_bucket_barrier': 0, 'peering_crush_bucket_mandatory_member': 2147483647, 'object_hash': 2, 'pg_autoscale_mode': 'off', 'pg_num': 16, 'pg_placement_num': 16, 'pg_placement_num_target': 16, 'pg_num_target': 16, 'pg_num_pending': 16, 'last_pg_merge_meta': {'source_pgid': '0.0', 'ready_epoch': 0, 'last_epoch_started': 0, 'last_epoch_clean': 0, 'source_version': "0'0", 'target_version': "0'0"}, 'last_change': '21', 'last_force_op_resend': '0', 'last_force_op_resend_prenautilus': '0', 'last_force_op_resend_preluminous': '0', 'auid': 0, 'snap_mode': 'selfmanaged', 'snap_seq': 0, 'snap_epoch': 0, 'pool_snaps': [], 'removed_snaps': '[]', 'quota_max_bytes': 0, 'quota_max_objects': 0, 'tiers': [], 'tier_of': -1, 'read_tier': -1, 'write_tier': -1, 'cache_mode': 'none', 'target_max_bytes': 0, 'target_max_objects': 0, 'cache_target_dirty_ratio_micro': 400000, 'cache_target_dirty_high_ratio_micro': 600000, 'cache_target_full_ratio_micro': 800000, 'cache_min_flush_age': 0, 'cache_min_evict_age': 0, 'erasure_code_profile': '', 'hit_set_params': {'type': 'none'}, 'hit_set_period': 0, 'hit_set_count': 0, 'use_gmt_hitset': True, 'min_read_recency_for_promote': 0, 'min_write_recency_for_promote': 0, 'hit_set_grade_decay_rate': 0, 'hit_set_search_last_n': 0, 'grade_table': [], 'stripe_width': 0, 'expected_num_objects': 0, 'fast_read': False, 'options': {}, 'application_metadata': {'rados': {}}}], 'osds': [{'osd': 0, 'uuid': '5dd675c7-2777-48f2-8009-ff0e0d4c7086', 'up': 1, 'in': 1, 'weight': 1, 'primary_affinity': 1, 'last_clean_begin': 0, 'last_clean_end': 0, 'up_from': 8, 'up_thru': 19, 'down_at': 0, 'lost_at': 0, 'public_addrs': {'addrvec': [{'type': 'v2', 'addr': '172.21.15.8:6800', 'nonce': 111181}, {'type': 'v1', 'addr': '172.21.15.8:6801', 'nonce': 111181}]}, 'cluster_addrs': {'addrvec': [{'type': 'v2', 'addr': '172.21.15.8:6802', 'nonce': 111181}, {'type': 'v1', 'addr': '172.21.15.8:6803', 'nonce': 111181}]}, 'heartbeat_back_addrs': {'addrvec': [{'type': 'v2', 'addr': '172.21.15.8:6806', 'nonce': 111181}, {'type': 'v1', 'addr': '172.21.15.8:6807', 'nonce': 111181}]}, 'heartbeat_front_addrs': {'addrvec': [{'type': 'v2', 'addr': '172.21.15.8:6804', 'nonce': 111181}, {'type': 'v1', 'addr': '172.21.15.8:6805', 'nonce': 111181}]}, 'public_addr': '172.21.15.8:6801/111181', 'cluster_addr': '172.21.15.8:6803/111181', 'heartbeat_back_addr': '172.21.15.8:6807/111181', 'heartbeat_front_addr': '172.21.15.8:6805/111181', 'state': ['exists', 'up']}, {'osd': 1, 'uuid': '7fc612c4-33ba-4a33-bca8-1f42ee8ed548', 'up': 1, 'in': 1, 'weight': 1, 'primary_affinity': 1, 'last_clean_begin': 0, 'last_clean_end': 0, 'up_from': 8, 'up_thru': 19, 'down_at': 0, 'lost_at': 0, 'public_addrs': {'addrvec': [{'type': 'v2', 'addr': '172.21.15.101:6800', 'nonce': 111143}, {'type': 'v1', 'addr': '172.21.15.101:6801', 'nonce': 111143}]}, 'cluster_addrs': {'addrvec': [{'type': 'v2', 'addr': '172.21.15.101:6802', 'nonce': 111143}, {'type': 'v1', 'addr': '172.21.15.101:6803', 'nonce': 111143}]}, 'heartbeat_back_addrs': {'addrvec': [{'type': 'v2', 'addr': '172.21.15.101:6806', 'nonce': 111143}, {'type': 'v1', 'addr': '172.21.15.101:6807', 'nonce': 111143}]}, 'heartbeat_front_addrs': {'addrvec': [{'type': 'v2', 'addr': '172.21.15.101:6804', 'nonce': 111143}, {'type': 'v1', 'addr': '172.21.15.101:6805', 'nonce': 111143}]}, 'public_addr': '172.21.15.101:6801/111143', 'cluster_addr': '172.21.15.101:6803/111143', 'heartbeat_back_addr': '172.21.15.101:6807/111143', 'heartbeat_front_addr': '172.21.15.101:6805/111143', 'state': ['exists', 'up']}, {'osd': 2, 'uuid': 'f85cadbc-4230-4772-8f39-62ed52e220b1', 'up': 1, 'in': 1, 'weight': 1, 'primary_affinity': 1, 'last_clean_begin': 0, 'last_clean_end': 0, 'up_from': 9, 'up_thru': 19, 'down_at': 0, 'lost_at': 0, 'public_addrs': {'addrvec': [{'type': 'v2', 'addr': '172.21.15.155:6800', 'nonce': 111339}, {'type': 'v1', 'addr': '172.21.15.155:6801', 'nonce': 111339}]}, 'cluster_addrs': {'addrvec': [{'type': 'v2', 'addr': '172.21.15.155:6802', 'nonce': 111339}, {'type': 'v1', 'addr': '172.21.15.155:6803', 'nonce': 111339}]}, 'heartbeat_back_addrs': {'addrvec': [{'type': 'v2', 'addr': '172.21.15.155:6806', 'nonce': 111339}, {'type': 'v1', 'addr': '172.21.15.155:6807', 'nonce': 111339}]}, 'heartbeat_front_addrs': {'addrvec': [{'type': 'v2', 'addr': '172.21.15.155:6804', 'nonce': 111339}, {'type': 'v1', 'addr': '172.21.15.155:6805', 'nonce': 111339}]}, 'public_addr': '172.21.15.155:6801/111339', 'cluster_addr': '172.21.15.155:6803/111339', 'heartbeat_back_addr': '172.21.15.155:6807/111339', 'heartbeat_front_addr': '172.21.15.155:6805/111339', 'state': ['exists', 'up']}], 'osd_xinfo': [{'osd': 0, 'down_stamp': '0.000000', 'laggy_probability': 0, 'laggy_interval': 0, 'features': 4540138320759226367, 'old_weight': 0, 'last_purged_snaps_scrub': '2023-08-01T19:53:48.018154+0000', 'dead_epoch': 0}, {'osd': 1, 'down_stamp': '0.000000', 'laggy_probability': 0, 'laggy_interval': 0, 'features': 4540138320759226367, 'old_weight': 0, 'last_purged_snaps_scrub': '2023-08-01T19:53:48.000488+0000', 'dead_epoch': 0}, {'osd': 2, 'down_stamp': '0.000000', 'laggy_probability': 0, 'laggy_interval': 0, 'features': 4540138320759226367, 'old_weight': 0, 'last_purged_snaps_scrub': '2023-08-01T19:53:48.072529+0000', 'dead_epoch': 0}], 'pg_upmap': [], 'pg_upmap_items': [], 'pg_temp': [], 'primary_temp': [], 'blocklist': {}, 'range_blocklist': {}, 'erasure_code_profiles': {'default': {'crush-failure-domain': 'osd', 'k': '2', 'm': '1', 'plugin': 'jerasure', 'technique': 'reed_sol_van'}}, 'removed_snaps_queue': [], 'new_removed_snaps': [], 'new_purged_snaps': [], 'crush_node_flags': {}, 'device_class_flags': {}, 'stretch_mode': {'stretch_mode_enabled': False, 'stretch_bucket_count': 0, 'degraded_stretch_mode': 0, 'recovering_stretch_mode': 0, 'stretch_mode_bucket': 0}} 2023-08-01T19:54:32.579 DEBUG:teuthology.orchestra.run.smithi006:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 120 ceph --cluster ceph pg dump --format=json 2023-08-01T19:54:32.580 INFO:teuthology.orchestra.run.smithi008.stdout:{ 2023-08-01T19:54:32.580 INFO:teuthology.orchestra.run.smithi008.stdout: "ops": [], 2023-08-01T19:54:32.581 INFO:teuthology.orchestra.run.smithi008.stdout: "complaint_time": 30, 2023-08-01T19:54:32.581 INFO:teuthology.orchestra.run.smithi008.stdout: "num_blocked_ops": 0 2023-08-01T19:54:32.581 INFO:teuthology.orchestra.run.smithi008.stdout:} 2023-08-01T19:54:32.584 INFO:tasks.ceph.osd.0.smithi008.stderr:2023-08-01T19:54:32.582+0000 7f16a58f4700 -1 received signal: Hangup from /usr/bin/python3 /bin/daemon-helper kill ceph-osd -f --cluster ceph -i 0 (PID: 111179) UID: 0 2023-08-01T19:54:32.596 DEBUG:teuthology.orchestra.run.smithi008:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 30 ceph --cluster ceph --admin-daemon /var/run/ceph/ceph-osd.0.asok dump_historic_ops 2023-08-01T19:54:32.684 INFO:tasks.ceph.osd.1.smithi101.stderr:2023-08-01T19:54:32.683+0000 7fb0cb7f6700 -1 received signal: Hangup from /usr/bin/python3 /bin/daemon-helper kill ceph-osd -f --cluster ceph -i 1 (PID: 111141) UID: 0 2023-08-01T19:54:32.785 INFO:tasks.ceph.osd.2.smithi155.stderr:2023-08-01T19:54:32.784+0000 7faa5c6ac700 -1 received signal: Hangup from /usr/bin/python3 /bin/daemon-helper kill ceph-osd -f --cluster ceph -i 2 (PID: 111337) UID: 0 2023-08-01T19:54:32.835 INFO:teuthology.orchestra.run.smithi008.stdout:{ 2023-08-01T19:54:32.836 INFO:teuthology.orchestra.run.smithi008.stdout: "size": 20, 2023-08-01T19:54:32.836 INFO:teuthology.orchestra.run.smithi008.stdout: "duration": 600, 2023-08-01T19:54:32.836 INFO:teuthology.orchestra.run.smithi008.stdout: "ops": [ 2023-08-01T19:54:32.836 INFO:teuthology.orchestra.run.smithi008.stdout: { 2023-08-01T19:54:32.836 INFO:teuthology.orchestra.run.smithi008.stdout: "description": "osd_op(mds.0.3:4 3.1f 3:ff5b34d6:::1.00000000:head [omap-set-header] snapc 0=[] ondisk+write+known_if_redirected+full_force+supports_pool_eio e17)", 2023-08-01T19:54:32.836 INFO:teuthology.orchestra.run.smithi008.stdout: "initiated_at": "2023-08-01T19:54:04.459058+0000", 2023-08-01T19:54:32.837 INFO:teuthology.orchestra.run.smithi008.stdout: "age": 28.373176733000001, 2023-08-01T19:54:32.837 INFO:teuthology.orchestra.run.smithi008.stdout: "duration": 0.011600047, 2023-08-01T19:54:32.837 INFO:teuthology.orchestra.run.smithi008.stdout: "type_data": { 2023-08-01T19:54:32.837 INFO:teuthology.orchestra.run.smithi008.stdout: "flag_point": "commit sent; apply or cleanup", 2023-08-01T19:54:32.837 INFO:teuthology.orchestra.run.smithi008.stdout: "events": [ 2023-08-01T19:54:32.837 INFO:teuthology.orchestra.run.smithi008.stdout: { 2023-08-01T19:54:32.837 INFO:teuthology.orchestra.run.smithi008.stdout: "event": "initiated", 2023-08-01T19:54:32.838 INFO:teuthology.orchestra.run.smithi008.stdout: "time": "2023-08-01T19:54:04.459058+0000", 2023-08-01T19:54:32.838 INFO:teuthology.orchestra.run.smithi008.stdout: "duration": 0 2023-08-01T19:54:32.838 INFO:teuthology.orchestra.run.smithi008.stdout: }, 2023-08-01T19:54:32.838 INFO:teuthology.orchestra.run.smithi008.stdout: { 2023-08-01T19:54:32.838 INFO:teuthology.orchestra.run.smithi008.stdout: "event": "throttled", 2023-08-01T19:54:32.838 INFO:teuthology.orchestra.run.smithi008.stdout: "time": "2023-08-01T19:54:04.459058+0000", 2023-08-01T19:54:32.838 INFO:teuthology.orchestra.run.smithi008.stdout: "duration": 0 2023-08-01T19:54:32.838 INFO:teuthology.orchestra.run.smithi008.stdout: }, 2023-08-01T19:54:32.839 INFO:teuthology.orchestra.run.smithi008.stdout: { 2023-08-01T19:54:32.839 INFO:teuthology.orchestra.run.smithi008.stdout: "event": "header_read", 2023-08-01T19:54:32.839 INFO:teuthology.orchestra.run.smithi008.stdout: "time": "2023-08-01T19:54:04.459052+0000", 2023-08-01T19:54:32.839 INFO:teuthology.orchestra.run.smithi008.stdout: "duration": 4294967295.9999938 2023-08-01T19:54:32.839 INFO:teuthology.orchestra.run.smithi008.stdout: }, 2023-08-01T19:54:32.839 INFO:teuthology.orchestra.run.smithi008.stdout: { 2023-08-01T19:54:32.839 INFO:teuthology.orchestra.run.smithi008.stdout: "event": "all_read", 2023-08-01T19:54:32.839 INFO:teuthology.orchestra.run.smithi008.stdout: "time": "2023-08-01T19:54:04.459069+0000", 2023-08-01T19:54:32.840 INFO:teuthology.orchestra.run.smithi008.stdout: "duration": 1.6395000000000001e-05 2023-08-01T19:54:32.840 INFO:teuthology.orchestra.run.smithi008.stdout: }, 2023-08-01T19:54:32.840 INFO:teuthology.orchestra.run.smithi008.stdout: { 2023-08-01T19:54:32.840 INFO:teuthology.orchestra.run.smithi008.stdout: "event": "dispatched", 2023-08-01T19:54:32.840 INFO:teuthology.orchestra.run.smithi008.stdout: "time": "2023-08-01T19:54:04.459083+0000", 2023-08-01T19:54:32.840 INFO:teuthology.orchestra.run.smithi008.stdout: "duration": 1.3869999999999999e-05 2023-08-01T19:54:32.840 INFO:teuthology.orchestra.run.smithi008.stdout: }, 2023-08-01T19:54:32.841 INFO:teuthology.orchestra.run.smithi008.stdout: { 2023-08-01T19:54:32.841 INFO:teuthology.orchestra.run.smithi008.stdout: "event": "queued_for_pg", 2023-08-01T19:54:32.841 INFO:teuthology.orchestra.run.smithi008.stdout: "time": "2023-08-01T19:54:04.459099+0000", 2023-08-01T19:54:32.841 INFO:teuthology.orchestra.run.smithi008.stdout: "duration": 1.681e-05 2023-08-01T19:54:32.841 INFO:teuthology.orchestra.run.smithi008.stdout: }, 2023-08-01T19:54:32.841 INFO:teuthology.orchestra.run.smithi008.stdout: { 2023-08-01T19:54:32.841 INFO:teuthology.orchestra.run.smithi008.stdout: "event": "reached_pg", 2023-08-01T19:54:32.842 INFO:teuthology.orchestra.run.smithi008.stdout: "time": "2023-08-01T19:54:04.459781+0000", 2023-08-01T19:54:32.842 INFO:teuthology.orchestra.run.smithi008.stdout: "duration": 0.00068143200000000004 2023-08-01T19:54:32.842 INFO:teuthology.orchestra.run.smithi008.stdout: }, 2023-08-01T19:54:32.842 INFO:teuthology.orchestra.run.smithi008.stdout: { 2023-08-01T19:54:32.842 INFO:teuthology.orchestra.run.smithi008.stdout: "event": "op must wait for map", 2023-08-01T19:54:32.842 INFO:teuthology.orchestra.run.smithi008.stdout: "time": "2023-08-01T19:54:04.459787+0000", 2023-08-01T19:54:32.842 INFO:teuthology.orchestra.run.smithi008.stdout: "duration": 6.562e-06 2023-08-01T19:54:32.843 INFO:teuthology.orchestra.run.smithi008.stdout: }, 2023-08-01T19:54:32.843 INFO:teuthology.orchestra.run.smithi008.stdout: { 2023-08-01T19:54:32.843 INFO:teuthology.orchestra.run.smithi008.stdout: "event": "reached_pg", 2023-08-01T19:54:32.843 INFO:teuthology.orchestra.run.smithi008.stdout: "time": "2023-08-01T19:54:04.461027+0000", 2023-08-01T19:54:32.843 INFO:teuthology.orchestra.run.smithi008.stdout: "duration": 0.001239846 2023-08-01T19:54:32.843 INFO:teuthology.orchestra.run.smithi008.stdout: }, 2023-08-01T19:54:32.843 INFO:teuthology.orchestra.run.smithi008.stdout: { 2023-08-01T19:54:32.843 INFO:teuthology.orchestra.run.smithi008.stdout: "event": "started", 2023-08-01T19:54:32.844 INFO:teuthology.orchestra.run.smithi008.stdout: "time": "2023-08-01T19:54:04.461333+0000", 2023-08-01T19:54:32.844 INFO:teuthology.orchestra.run.smithi008.stdout: "duration": 0.00030574999999999998 2023-08-01T19:54:32.844 INFO:teuthology.orchestra.run.smithi008.stdout: }, 2023-08-01T19:54:32.844 INFO:teuthology.orchestra.run.smithi008.stdout: { 2023-08-01T19:54:32.844 INFO:teuthology.orchestra.run.smithi008.stdout: "event": "waiting for subops from 1", 2023-08-01T19:54:32.844 INFO:teuthology.orchestra.run.smithi008.stdout: "time": "2023-08-01T19:54:04.461789+0000", 2023-08-01T19:54:32.844 INFO:teuthology.orchestra.run.smithi008.stdout: "duration": 0.00045635499999999998 2023-08-01T19:54:32.845 INFO:teuthology.orchestra.run.smithi008.stdout: }, 2023-08-01T19:54:32.845 INFO:teuthology.orchestra.run.smithi008.stdout: { 2023-08-01T19:54:32.845 INFO:teuthology.orchestra.run.smithi008.stdout: "event": "op_commit", 2023-08-01T19:54:32.845 INFO:teuthology.orchestra.run.smithi008.stdout: "time": "2023-08-01T19:54:04.464364+0000", 2023-08-01T19:54:32.845 INFO:teuthology.orchestra.run.smithi008.stdout: "duration": 0.002574603 2023-08-01T19:54:32.845 INFO:teuthology.orchestra.run.smithi008.stdout: }, 2023-08-01T19:54:32.845 INFO:teuthology.orchestra.run.smithi008.stdout: { 2023-08-01T19:54:32.845 INFO:teuthology.orchestra.run.smithi008.stdout: "event": "sub_op_commit_rec", 2023-08-01T19:54:32.846 INFO:teuthology.orchestra.run.smithi008.stdout: "time": "2023-08-01T19:54:04.470558+0000", 2023-08-01T19:54:32.846 INFO:teuthology.orchestra.run.smithi008.stdout: "duration": 0.0061936910000000003 2023-08-01T19:54:32.846 INFO:teuthology.orchestra.run.smithi008.stdout: }, 2023-08-01T19:54:32.846 INFO:teuthology.orchestra.run.smithi008.stdout: { 2023-08-01T19:54:32.846 INFO:teuthology.orchestra.run.smithi008.stdout: "event": "commit_sent", 2023-08-01T19:54:32.846 INFO:teuthology.orchestra.run.smithi008.stdout: "time": "2023-08-01T19:54:04.470615+0000", 2023-08-01T19:54:32.846 INFO:teuthology.orchestra.run.smithi008.stdout: "duration": 5.7138000000000001e-05 2023-08-01T19:54:32.846 INFO:teuthology.orchestra.run.smithi008.stdout: }, 2023-08-01T19:54:32.847 INFO:teuthology.orchestra.run.smithi008.stdout: { 2023-08-01T19:54:32.847 INFO:teuthology.orchestra.run.smithi008.stdout: "event": "done", 2023-08-01T19:54:32.847 INFO:teuthology.orchestra.run.smithi008.stdout: "time": "2023-08-01T19:54:04.470658+0000", 2023-08-01T19:54:32.847 INFO:teuthology.orchestra.run.smithi008.stdout: "duration": 4.3640999999999998e-05 2023-08-01T19:54:32.847 INFO:teuthology.orchestra.run.smithi008.stdout: } 2023-08-01T19:54:32.847 INFO:teuthology.orchestra.run.smithi008.stdout: ] 2023-08-01T19:54:32.847 INFO:teuthology.orchestra.run.smithi008.stdout: } 2023-08-01T19:54:32.847 INFO:teuthology.orchestra.run.smithi008.stdout: }, 2023-08-01T19:54:32.848 INFO:teuthology.orchestra.run.smithi008.stdout: { 2023-08-01T19:54:32.848 INFO:teuthology.orchestra.run.smithi008.stdout: "description": "osd_op(mds.0.3:5 3.1f 3:ff5b34d6:::1.00000000:head [create,setxattr parent (30) in=6b,setxattr layout (30) in=6b] snapc 0=[] ondisk+write+known_if_redirected+full_force+supports_pool_eio e17)", 2023-08-01T19:54:32.848 INFO:teuthology.orchestra.run.smithi008.stdout: "initiated_at": "2023-08-01T19:54:04.459120+0000", 2023-08-01T19:54:32.848 INFO:teuthology.orchestra.run.smithi008.stdout: "age": 28.373115174999999, 2023-08-01T19:54:32.848 INFO:teuthology.orchestra.run.smithi008.stdout: "duration": 0.012982585, 2023-08-01T19:54:32.848 INFO:teuthology.orchestra.run.smithi008.stdout: "type_data": { 2023-08-01T19:54:32.848 INFO:teuthology.orchestra.run.smithi008.stdout: "flag_point": "commit sent; apply or cleanup", 2023-08-01T19:54:32.848 INFO:teuthology.orchestra.run.smithi008.stdout: "events": [ 2023-08-01T19:54:32.849 INFO:teuthology.orchestra.run.smithi008.stdout: { 2023-08-01T19:54:32.849 INFO:teuthology.orchestra.run.smithi008.stdout: "event": "initiated", 2023-08-01T19:54:32.849 INFO:teuthology.orchestra.run.smithi008.stdout: "time": "2023-08-01T19:54:04.459120+0000", 2023-08-01T19:54:32.849 INFO:teuthology.orchestra.run.smithi008.stdout: "duration": 0 2023-08-01T19:54:32.849 INFO:teuthology.orchestra.run.smithi008.stdout: }, 2023-08-01T19:54:32.849 INFO:teuthology.orchestra.run.smithi008.stdout: { 2023-08-01T19:54:32.849 INFO:teuthology.orchestra.run.smithi008.stdout: "event": "throttled", 2023-08-01T19:54:32.850 INFO:teuthology.orchestra.run.smithi008.stdout: "time": "2023-08-01T19:54:04.459120+0000", 2023-08-01T19:54:32.850 INFO:teuthology.orchestra.run.smithi008.stdout: "duration": 0 2023-08-01T19:54:32.850 INFO:teuthology.orchestra.run.smithi008.stdout: }, 2023-08-01T19:54:32.850 INFO:teuthology.orchestra.run.smithi008.stdout: { 2023-08-01T19:54:32.850 INFO:teuthology.orchestra.run.smithi008.stdout: "event": "header_read", 2023-08-01T19:54:32.850 INFO:teuthology.orchestra.run.smithi008.stdout: "time": "2023-08-01T19:54:04.459119+0000", 2023-08-01T19:54:32.850 INFO:teuthology.orchestra.run.smithi008.stdout: "duration": 4294967295.999999 2023-08-01T19:54:32.850 INFO:teuthology.orchestra.run.smithi008.stdout: }, 2023-08-01T19:54:32.851 INFO:teuthology.orchestra.run.smithi008.stdout: { 2023-08-01T19:54:32.851 INFO:teuthology.orchestra.run.smithi008.stdout: "event": "all_read", 2023-08-01T19:54:32.851 INFO:teuthology.orchestra.run.smithi008.stdout: "time": "2023-08-01T19:54:04.459137+0000", 2023-08-01T19:54:32.851 INFO:teuthology.orchestra.run.smithi008.stdout: "duration": 1.7554000000000002e-05 2023-08-01T19:54:32.851 INFO:teuthology.orchestra.run.smithi008.stdout: }, 2023-08-01T19:54:32.851 INFO:teuthology.orchestra.run.smithi008.stdout: { 2023-08-01T19:54:32.851 INFO:teuthology.orchestra.run.smithi008.stdout: "event": "dispatched", 2023-08-01T19:54:32.851 INFO:teuthology.orchestra.run.smithi008.stdout: "time": "2023-08-01T19:54:04.459148+0000", 2023-08-01T19:54:32.852 INFO:teuthology.orchestra.run.smithi008.stdout: "duration": 1.1248e-05 2023-08-01T19:54:32.852 INFO:teuthology.orchestra.run.smithi008.stdout: }, 2023-08-01T19:54:32.852 INFO:teuthology.orchestra.run.smithi008.stdout: { 2023-08-01T19:54:32.852 INFO:teuthology.orchestra.run.smithi008.stdout: "event": "queued_for_pg", 2023-08-01T19:54:32.852 INFO:teuthology.orchestra.run.smithi008.stdout: "time": "2023-08-01T19:54:04.459167+0000", 2023-08-01T19:54:32.852 INFO:teuthology.orchestra.run.smithi008.stdout: "duration": 1.9457999999999999e-05 2023-08-01T19:54:32.852 INFO:teuthology.orchestra.run.smithi008.stdout: }, 2023-08-01T19:54:32.852 INFO:teuthology.orchestra.run.smithi008.stdout: { 2023-08-01T19:54:32.853 INFO:teuthology.orchestra.run.smithi008.stdout: "event": "reached_pg", 2023-08-01T19:54:32.853 INFO:teuthology.orchestra.run.smithi008.stdout: "time": "2023-08-01T19:54:04.459863+0000", 2023-08-01T19:54:32.853 INFO:teuthology.orchestra.run.smithi008.stdout: "duration": 0.000695325 2023-08-01T19:54:32.853 INFO:teuthology.orchestra.run.smithi008.stdout: }, 2023-08-01T19:54:32.853 INFO:teuthology.orchestra.run.smithi008.stdout: { 2023-08-01T19:54:32.853 INFO:teuthology.orchestra.run.smithi008.stdout: "event": "waiting_for_map not empty", 2023-08-01T19:54:32.853 INFO:teuthology.orchestra.run.smithi008.stdout: "time": "2023-08-01T19:54:04.459866+0000", 2023-08-01T19:54:32.853 INFO:teuthology.orchestra.run.smithi008.stdout: "duration": 3.1540000000000002e-06 2023-08-01T19:54:32.854 INFO:teuthology.orchestra.run.smithi008.stdout: }, 2023-08-01T19:54:32.854 INFO:teuthology.orchestra.run.smithi008.stdout: { 2023-08-01T19:54:32.854 INFO:teuthology.orchestra.run.smithi008.stdout: "event": "reached_pg", 2023-08-01T19:54:32.854 INFO:teuthology.orchestra.run.smithi008.stdout: "time": "2023-08-01T19:54:04.462285+0000", 2023-08-01T19:54:32.854 INFO:teuthology.orchestra.run.smithi008.stdout: "duration": 0.0024190560000000002 2023-08-01T19:54:32.854 INFO:teuthology.orchestra.run.smithi008.stdout: }, 2023-08-01T19:54:32.854 INFO:teuthology.orchestra.run.smithi008.stdout: { 2023-08-01T19:54:32.854 INFO:teuthology.orchestra.run.smithi008.stdout: "event": "started", 2023-08-01T19:54:32.855 INFO:teuthology.orchestra.run.smithi008.stdout: "time": "2023-08-01T19:54:04.462365+0000", 2023-08-01T19:54:32.855 INFO:teuthology.orchestra.run.smithi008.stdout: "duration": 8.0488999999999995e-05 2023-08-01T19:54:32.855 INFO:teuthology.orchestra.run.smithi008.stdout: }, 2023-08-01T19:54:32.855 INFO:teuthology.orchestra.run.smithi008.stdout: { 2023-08-01T19:54:32.855 INFO:teuthology.orchestra.run.smithi008.stdout: "event": "waiting for subops from 1", 2023-08-01T19:54:32.855 INFO:teuthology.orchestra.run.smithi008.stdout: "time": "2023-08-01T19:54:04.462560+0000", 2023-08-01T19:54:32.855 INFO:teuthology.orchestra.run.smithi008.stdout: "duration": 0.00019412300000000001 2023-08-01T19:54:32.855 INFO:teuthology.orchestra.run.smithi008.stdout: }, 2023-08-01T19:54:32.856 INFO:teuthology.orchestra.run.smithi008.stdout: { 2023-08-01T19:54:32.856 INFO:teuthology.orchestra.run.smithi008.stdout: "event": "op_commit", 2023-08-01T19:54:32.856 INFO:teuthology.orchestra.run.smithi008.stdout: "time": "2023-08-01T19:54:04.467069+0000", 2023-08-01T19:54:32.856 INFO:teuthology.orchestra.run.smithi008.stdout: "duration": 0.0045089709999999996 2023-08-01T19:54:32.856 INFO:teuthology.orchestra.run.smithi008.stdout: }, 2023-08-01T19:54:32.856 INFO:teuthology.orchestra.run.smithi008.stdout: { 2023-08-01T19:54:32.856 INFO:teuthology.orchestra.run.smithi008.stdout: "event": "sub_op_commit_rec", 2023-08-01T19:54:32.857 INFO:teuthology.orchestra.run.smithi008.stdout: "time": "2023-08-01T19:54:04.471986+0000", 2023-08-01T19:54:32.857 INFO:teuthology.orchestra.run.smithi008.stdout: "duration": 0.0049178499999999997 2023-08-01T19:54:32.857 INFO:teuthology.orchestra.run.smithi008.stdout: }, 2023-08-01T19:54:32.857 INFO:teuthology.orchestra.run.smithi008.stdout: { 2023-08-01T19:54:32.857 INFO:teuthology.orchestra.run.smithi008.stdout: "event": "commit_sent", 2023-08-01T19:54:32.857 INFO:teuthology.orchestra.run.smithi008.stdout: "time": "2023-08-01T19:54:04.472060+0000", 2023-08-01T19:54:32.857 INFO:teuthology.orchestra.run.smithi008.stdout: "duration": 7.4049999999999997e-05 2023-08-01T19:54:32.857 INFO:teuthology.orchestra.run.smithi008.stdout: }, 2023-08-01T19:54:32.858 INFO:teuthology.orchestra.run.smithi008.stdout: { 2023-08-01T19:54:32.858 INFO:teuthology.orchestra.run.smithi008.stdout: "event": "done", 2023-08-01T19:54:32.858 INFO:teuthology.orchestra.run.smithi008.stdout: "time": "2023-08-01T19:54:04.472102+0000", 2023-08-01T19:54:32.858 INFO:teuthology.orchestra.run.smithi008.stdout: "duration": 4.206e-05 2023-08-01T19:54:32.858 INFO:teuthology.orchestra.run.smithi008.stdout: } 2023-08-01T19:54:32.858 INFO:teuthology.orchestra.run.smithi008.stdout: ] 2023-08-01T19:54:32.858 INFO:teuthology.orchestra.run.smithi008.stdout: } 2023-08-01T19:54:32.858 INFO:teuthology.orchestra.run.smithi008.stdout: }, 2023-08-01T19:54:32.859 INFO:teuthology.orchestra.run.smithi008.stdout: { 2023-08-01T19:54:32.859 INFO:teuthology.orchestra.run.smithi008.stdout: "description": "osd_op(mds.0.3:25 3.7 3:e0b41d06:::609.00000000:head [create,setxattr parent (62) in=6b,setxattr layout (30) in=6b] snapc 0=[] ondisk+write+known_if_redirected+full_force+supports_pool_eio e17)", 2023-08-01T19:54:32.859 INFO:teuthology.orchestra.run.smithi008.stdout: "initiated_at": "2023-08-01T19:54:04.459206+0000", 2023-08-01T19:54:32.859 INFO:teuthology.orchestra.run.smithi008.stdout: "age": 28.373028823999999, 2023-08-01T19:54:32.859 INFO:teuthology.orchestra.run.smithi008.stdout: "duration": 0.012197100000000001, 2023-08-01T19:54:32.859 INFO:teuthology.orchestra.run.smithi008.stdout: "type_data": { 2023-08-01T19:54:32.859 INFO:teuthology.orchestra.run.smithi008.stdout: "flag_point": "commit sent; apply or cleanup", 2023-08-01T19:54:32.859 INFO:teuthology.orchestra.run.smithi008.stdout: "events": [ 2023-08-01T19:54:32.860 INFO:teuthology.orchestra.run.smithi008.stdout: { 2023-08-01T19:54:32.860 INFO:teuthology.orchestra.run.smithi008.stdout: "event": "initiated", 2023-08-01T19:54:32.860 INFO:teuthology.orchestra.run.smithi008.stdout: "time": "2023-08-01T19:54:04.459206+0000", 2023-08-01T19:54:32.860 INFO:teuthology.orchestra.run.smithi008.stdout: "duration": 0 2023-08-01T19:54:32.860 INFO:teuthology.orchestra.run.smithi008.stdout: }, 2023-08-01T19:54:32.860 INFO:teuthology.orchestra.run.smithi008.stdout: { 2023-08-01T19:54:32.860 INFO:teuthology.orchestra.run.smithi008.stdout: "event": "throttled", 2023-08-01T19:54:32.860 INFO:teuthology.orchestra.run.smithi008.stdout: "time": "2023-08-01T19:54:04.459206+0000", 2023-08-01T19:54:32.861 INFO:teuthology.orchestra.run.smithi008.stdout: "duration": 0 2023-08-01T19:54:32.861 INFO:teuthology.orchestra.run.smithi008.stdout: }, 2023-08-01T19:54:32.861 INFO:teuthology.orchestra.run.smithi008.stdout: { 2023-08-01T19:54:32.861 INFO:teuthology.orchestra.run.smithi008.stdout: "event": "header_read", 2023-08-01T19:54:32.861 INFO:teuthology.orchestra.run.smithi008.stdout: "time": "2023-08-01T19:54:04.459206+0000", 2023-08-01T19:54:32.861 INFO:teuthology.orchestra.run.smithi008.stdout: "duration": 4294967295.9999995 2023-08-01T19:54:32.861 INFO:teuthology.orchestra.run.smithi008.stdout: }, 2023-08-01T19:54:32.861 INFO:teuthology.orchestra.run.smithi008.stdout: { 2023-08-01T19:54:32.862 INFO:teuthology.orchestra.run.smithi008.stdout: "event": "all_read", 2023-08-01T19:54:32.862 INFO:teuthology.orchestra.run.smithi008.stdout: "time": "2023-08-01T19:54:04.459209+0000", 2023-08-01T19:54:32.862 INFO:teuthology.orchestra.run.smithi008.stdout: "duration": 3.7500000000000001e-06 2023-08-01T19:54:32.862 INFO:teuthology.orchestra.run.smithi008.stdout: }, 2023-08-01T19:54:32.862 INFO:teuthology.orchestra.run.smithi008.stdout: { 2023-08-01T19:54:32.862 INFO:teuthology.orchestra.run.smithi008.stdout: "event": "dispatched", 2023-08-01T19:54:32.862 INFO:teuthology.orchestra.run.smithi008.stdout: "time": "2023-08-01T19:54:04.459216+0000", 2023-08-01T19:54:32.863 INFO:teuthology.orchestra.run.smithi008.stdout: "duration": 6.7560000000000002e-06 2023-08-01T19:54:32.863 INFO:teuthology.orchestra.run.smithi008.stdout: }, 2023-08-01T19:54:32.863 INFO:teuthology.orchestra.run.smithi008.stdout: { 2023-08-01T19:54:32.863 INFO:teuthology.orchestra.run.smithi008.stdout: "event": "queued_for_pg", 2023-08-01T19:54:32.863 INFO:teuthology.orchestra.run.smithi008.stdout: "time": "2023-08-01T19:54:04.459221+0000", 2023-08-01T19:54:32.863 INFO:teuthology.orchestra.run.smithi008.stdout: "duration": 5.1760000000000001e-06 2023-08-01T19:54:32.863 INFO:teuthology.orchestra.run.smithi008.stdout: }, 2023-08-01T19:54:32.863 INFO:teuthology.orchestra.run.smithi008.stdout: { 2023-08-01T19:54:32.864 INFO:teuthology.orchestra.run.smithi008.stdout: "event": "reached_pg", 2023-08-01T19:54:32.864 INFO:teuthology.orchestra.run.smithi008.stdout: "time": "2023-08-01T19:54:04.459918+0000", 2023-08-01T19:54:32.864 INFO:teuthology.orchestra.run.smithi008.stdout: "duration": 0.000696716 2023-08-01T19:54:32.864 INFO:teuthology.orchestra.run.smithi008.stdout: }, 2023-08-01T19:54:32.864 INFO:teuthology.orchestra.run.smithi008.stdout: { 2023-08-01T19:54:32.864 INFO:teuthology.orchestra.run.smithi008.stdout: "event": "waiting_for_map not empty", 2023-08-01T19:54:32.864 INFO:teuthology.orchestra.run.smithi008.stdout: "time": "2023-08-01T19:54:04.459923+0000", 2023-08-01T19:54:32.864 INFO:teuthology.orchestra.run.smithi008.stdout: "duration": 4.4279999999999998e-06 2023-08-01T19:54:32.865 INFO:teuthology.orchestra.run.smithi008.stdout: }, 2023-08-01T19:54:32.865 INFO:teuthology.orchestra.run.smithi008.stdout: { 2023-08-01T19:54:32.865 INFO:teuthology.orchestra.run.smithi008.stdout: "event": "reached_pg", 2023-08-01T19:54:32.865 INFO:teuthology.orchestra.run.smithi008.stdout: "time": "2023-08-01T19:54:04.462299+0000", 2023-08-01T19:54:32.865 INFO:teuthology.orchestra.run.smithi008.stdout: "duration": 0.0023762929999999998 2023-08-01T19:54:32.865 INFO:teuthology.orchestra.run.smithi008.stdout: }, 2023-08-01T19:54:32.865 INFO:teuthology.orchestra.run.smithi008.stdout: { 2023-08-01T19:54:32.865 INFO:teuthology.orchestra.run.smithi008.stdout: "event": "started", 2023-08-01T19:54:32.866 INFO:teuthology.orchestra.run.smithi008.stdout: "time": "2023-08-01T19:54:04.462362+0000", 2023-08-01T19:54:32.866 INFO:teuthology.orchestra.run.smithi008.stdout: "duration": 6.2707999999999997e-05 2023-08-01T19:54:32.866 INFO:teuthology.orchestra.run.smithi008.stdout: }, 2023-08-01T19:54:32.866 INFO:teuthology.orchestra.run.smithi008.stdout: { 2023-08-01T19:54:32.866 INFO:teuthology.orchestra.run.smithi008.stdout: "event": "waiting for subops from 2", 2023-08-01T19:54:32.866 INFO:teuthology.orchestra.run.smithi008.stdout: "time": "2023-08-01T19:54:04.462468+0000", 2023-08-01T19:54:32.866 INFO:teuthology.orchestra.run.smithi008.stdout: "duration": 0.000106592 2023-08-01T19:54:32.866 INFO:teuthology.orchestra.run.smithi008.stdout: }, 2023-08-01T19:54:32.867 INFO:teuthology.orchestra.run.smithi008.stdout: { 2023-08-01T19:54:32.867 INFO:teuthology.orchestra.run.smithi008.stdout: "event": "op_commit", 2023-08-01T19:54:32.867 INFO:teuthology.orchestra.run.smithi008.stdout: "time": "2023-08-01T19:54:04.466803+0000", 2023-08-01T19:54:32.867 INFO:teuthology.orchestra.run.smithi008.stdout: "duration": 0.0043350410000000004 2023-08-01T19:54:32.867 INFO:teuthology.orchestra.run.smithi008.stdout: }, 2023-08-01T19:54:32.867 INFO:teuthology.orchestra.run.smithi008.stdout: { 2023-08-01T19:54:32.867 INFO:teuthology.orchestra.run.smithi008.stdout: "event": "sub_op_commit_rec", 2023-08-01T19:54:32.867 INFO:teuthology.orchestra.run.smithi008.stdout: "time": "2023-08-01T19:54:04.471130+0000", 2023-08-01T19:54:32.868 INFO:teuthology.orchestra.run.smithi008.stdout: "duration": 0.0043265329999999996 2023-08-01T19:54:32.868 INFO:teuthology.orchestra.run.smithi008.stdout: }, 2023-08-01T19:54:32.868 INFO:teuthology.orchestra.run.smithi008.stdout: { 2023-08-01T19:54:32.868 INFO:teuthology.orchestra.run.smithi008.stdout: "event": "commit_sent", 2023-08-01T19:54:32.868 INFO:teuthology.orchestra.run.smithi008.stdout: "time": "2023-08-01T19:54:04.471355+0000", 2023-08-01T19:54:32.868 INFO:teuthology.orchestra.run.smithi008.stdout: "duration": 0.00022495999999999999 2023-08-01T19:54:32.868 INFO:teuthology.orchestra.run.smithi008.stdout: }, 2023-08-01T19:54:32.868 INFO:teuthology.orchestra.run.smithi008.stdout: { 2023-08-01T19:54:32.869 INFO:teuthology.orchestra.run.smithi008.stdout: "event": "done", 2023-08-01T19:54:32.869 INFO:teuthology.orchestra.run.smithi008.stdout: "time": "2023-08-01T19:54:04.471403+0000", 2023-08-01T19:54:32.869 INFO:teuthology.orchestra.run.smithi008.stdout: "duration": 4.8662999999999998e-05 2023-08-01T19:54:32.869 INFO:teuthology.orchestra.run.smithi008.stdout: } 2023-08-01T19:54:32.869 INFO:teuthology.orchestra.run.smithi008.stdout: ] 2023-08-01T19:54:32.869 INFO:teuthology.orchestra.run.smithi008.stdout: } 2023-08-01T19:54:32.869 INFO:teuthology.orchestra.run.smithi008.stdout: }, 2023-08-01T19:54:32.869 INFO:teuthology.orchestra.run.smithi008.stdout: { 2023-08-01T19:54:32.870 INFO:teuthology.orchestra.run.smithi008.stdout: "description": "osd_op(mds.0.3:26 3.1f 3:fe07bba1:::100.00000000.inode:head [writefull 0~554] snapc 0=[] ondisk+write+known_if_redirected+full_force+supports_pool_eio e17)", 2023-08-01T19:54:32.870 INFO:teuthology.orchestra.run.smithi008.stdout: "initiated_at": "2023-08-01T19:54:04.459230+0000", 2023-08-01T19:54:32.870 INFO:teuthology.orchestra.run.smithi008.stdout: "age": 28.373005308, 2023-08-01T19:54:32.870 INFO:teuthology.orchestra.run.smithi008.stdout: "duration": 0.013017103, 2023-08-01T19:54:32.870 INFO:teuthology.orchestra.run.smithi008.stdout: "type_data": { 2023-08-01T19:54:32.870 INFO:teuthology.orchestra.run.smithi008.stdout: "flag_point": "commit sent; apply or cleanup", 2023-08-01T19:54:32.870 INFO:teuthology.orchestra.run.smithi008.stdout: "events": [ 2023-08-01T19:54:32.870 INFO:teuthology.orchestra.run.smithi008.stdout: { 2023-08-01T19:54:32.871 INFO:teuthology.orchestra.run.smithi008.stdout: "event": "initiated", 2023-08-01T19:54:32.871 INFO:teuthology.orchestra.run.smithi008.stdout: "time": "2023-08-01T19:54:04.459230+0000", 2023-08-01T19:54:32.871 INFO:teuthology.orchestra.run.smithi008.stdout: "duration": 0 2023-08-01T19:54:32.871 INFO:teuthology.orchestra.run.smithi008.stdout: }, 2023-08-01T19:54:32.871 INFO:teuthology.orchestra.run.smithi008.stdout: { 2023-08-01T19:54:32.871 INFO:teuthology.orchestra.run.smithi008.stdout: "event": "throttled", 2023-08-01T19:54:32.871 INFO:teuthology.orchestra.run.smithi008.stdout: "time": "2023-08-01T19:54:04.459230+0000", 2023-08-01T19:54:32.872 INFO:teuthology.orchestra.run.smithi008.stdout: "duration": 0 2023-08-01T19:54:32.872 INFO:teuthology.orchestra.run.smithi008.stdout: }, 2023-08-01T19:54:32.872 INFO:teuthology.orchestra.run.smithi008.stdout: { 2023-08-01T19:54:32.872 INFO:teuthology.orchestra.run.smithi008.stdout: "event": "header_read", 2023-08-01T19:54:32.872 INFO:teuthology.orchestra.run.smithi008.stdout: "time": "2023-08-01T19:54:04.459229+0000", 2023-08-01T19:54:32.872 INFO:teuthology.orchestra.run.smithi008.stdout: "duration": 4294967295.9999995 2023-08-01T19:54:32.872 INFO:teuthology.orchestra.run.smithi008.stdout: }, 2023-08-01T19:54:32.872 INFO:teuthology.orchestra.run.smithi008.stdout: { 2023-08-01T19:54:32.873 INFO:teuthology.orchestra.run.smithi008.stdout: "event": "all_read", 2023-08-01T19:54:32.873 INFO:teuthology.orchestra.run.smithi008.stdout: "time": "2023-08-01T19:54:04.459233+0000", 2023-08-01T19:54:32.873 INFO:teuthology.orchestra.run.smithi008.stdout: "duration": 3.7400000000000002e-06 2023-08-01T19:54:32.873 INFO:teuthology.orchestra.run.smithi008.stdout: }, 2023-08-01T19:54:32.873 INFO:teuthology.orchestra.run.smithi008.stdout: { 2023-08-01T19:54:32.873 INFO:teuthology.orchestra.run.smithi008.stdout: "event": "dispatched", 2023-08-01T19:54:32.873 INFO:teuthology.orchestra.run.smithi008.stdout: "time": "2023-08-01T19:54:04.459240+0000", 2023-08-01T19:54:32.873 INFO:teuthology.orchestra.run.smithi008.stdout: "duration": 6.9059999999999996e-06 2023-08-01T19:54:32.874 INFO:teuthology.orchestra.run.smithi008.stdout: }, 2023-08-01T19:54:32.874 INFO:teuthology.orchestra.run.smithi008.stdout: { 2023-08-01T19:54:32.874 INFO:teuthology.orchestra.run.smithi008.stdout: "event": "queued_for_pg", 2023-08-01T19:54:32.874 INFO:teuthology.orchestra.run.smithi008.stdout: "time": "2023-08-01T19:54:04.459245+0000", 2023-08-01T19:54:32.874 INFO:teuthology.orchestra.run.smithi008.stdout: "duration": 4.8890000000000001e-06 2023-08-01T19:54:32.874 INFO:teuthology.orchestra.run.smithi008.stdout: }, 2023-08-01T19:54:32.874 INFO:teuthology.orchestra.run.smithi008.stdout: { 2023-08-01T19:54:32.874 INFO:teuthology.orchestra.run.smithi008.stdout: "event": "reached_pg", 2023-08-01T19:54:32.875 INFO:teuthology.orchestra.run.smithi008.stdout: "time": "2023-08-01T19:54:04.459954+0000", 2023-08-01T19:54:32.875 INFO:teuthology.orchestra.run.smithi008.stdout: "duration": 0.00070883100000000004 2023-08-01T19:54:32.875 INFO:teuthology.orchestra.run.smithi008.stdout: }, 2023-08-01T19:54:32.875 INFO:teuthology.orchestra.run.smithi008.stdout: { 2023-08-01T19:54:32.875 INFO:teuthology.orchestra.run.smithi008.stdout: "event": "waiting_for_map not empty", 2023-08-01T19:54:32.875 INFO:teuthology.orchestra.run.smithi008.stdout: "time": "2023-08-01T19:54:04.459959+0000", 2023-08-01T19:54:32.875 INFO:teuthology.orchestra.run.smithi008.stdout: "duration": 5.1340000000000003e-06 2023-08-01T19:54:32.875 INFO:teuthology.orchestra.run.smithi008.stdout: }, 2023-08-01T19:54:32.876 INFO:teuthology.orchestra.run.smithi008.stdout: { 2023-08-01T19:54:32.876 INFO:teuthology.orchestra.run.smithi008.stdout: "event": "reached_pg", 2023-08-01T19:54:32.876 INFO:teuthology.orchestra.run.smithi008.stdout: "time": "2023-08-01T19:54:04.462796+0000", 2023-08-01T19:54:32.876 INFO:teuthology.orchestra.run.smithi008.stdout: "duration": 0.0028374070000000001 2023-08-01T19:54:32.876 INFO:teuthology.orchestra.run.smithi008.stdout: }, 2023-08-01T19:54:32.876 INFO:teuthology.orchestra.run.smithi008.stdout: { 2023-08-01T19:54:32.876 INFO:teuthology.orchestra.run.smithi008.stdout: "event": "started", 2023-08-01T19:54:32.876 INFO:teuthology.orchestra.run.smithi008.stdout: "time": "2023-08-01T19:54:04.463137+0000", 2023-08-01T19:54:32.877 INFO:teuthology.orchestra.run.smithi008.stdout: "duration": 0.00034093699999999998 2023-08-01T19:54:32.877 INFO:teuthology.orchestra.run.smithi008.stdout: }, 2023-08-01T19:54:32.877 INFO:teuthology.orchestra.run.smithi008.stdout: { 2023-08-01T19:54:32.877 INFO:teuthology.orchestra.run.smithi008.stdout: "event": "waiting for subops from 1", 2023-08-01T19:54:32.877 INFO:teuthology.orchestra.run.smithi008.stdout: "time": "2023-08-01T19:54:04.463290+0000", 2023-08-01T19:54:32.877 INFO:teuthology.orchestra.run.smithi008.stdout: "duration": 0.00015267899999999999 2023-08-01T19:54:32.877 INFO:teuthology.orchestra.run.smithi008.stdout: }, 2023-08-01T19:54:32.877 INFO:teuthology.orchestra.run.smithi008.stdout: { 2023-08-01T19:54:32.878 INFO:teuthology.orchestra.run.smithi008.stdout: "event": "op_commit", 2023-08-01T19:54:32.878 INFO:teuthology.orchestra.run.smithi008.stdout: "time": "2023-08-01T19:54:04.470442+0000", 2023-08-01T19:54:32.878 INFO:teuthology.orchestra.run.smithi008.stdout: "duration": 0.0071526230000000003 2023-08-01T19:54:32.878 INFO:teuthology.orchestra.run.smithi008.stdout: }, 2023-08-01T19:54:32.878 INFO:teuthology.orchestra.run.smithi008.stdout: { 2023-08-01T19:54:32.878 INFO:teuthology.orchestra.run.smithi008.stdout: "event": "sub_op_commit_rec", 2023-08-01T19:54:32.878 INFO:teuthology.orchestra.run.smithi008.stdout: "time": "2023-08-01T19:54:04.472154+0000", 2023-08-01T19:54:32.878 INFO:teuthology.orchestra.run.smithi008.stdout: "duration": 0.0017111450000000001 2023-08-01T19:54:32.879 INFO:teuthology.orchestra.run.smithi008.stdout: }, 2023-08-01T19:54:32.879 INFO:teuthology.orchestra.run.smithi008.stdout: { 2023-08-01T19:54:32.879 INFO:teuthology.orchestra.run.smithi008.stdout: "event": "commit_sent", 2023-08-01T19:54:32.879 INFO:teuthology.orchestra.run.smithi008.stdout: "time": "2023-08-01T19:54:04.472207+0000", 2023-08-01T19:54:32.879 INFO:teuthology.orchestra.run.smithi008.stdout: "duration": 5.3059999999999997e-05 2023-08-01T19:54:32.879 INFO:teuthology.orchestra.run.smithi008.stdout: }, 2023-08-01T19:54:32.879 INFO:teuthology.orchestra.run.smithi008.stdout: { 2023-08-01T19:54:32.879 INFO:teuthology.orchestra.run.smithi008.stdout: "event": "done", 2023-08-01T19:54:32.880 INFO:teuthology.orchestra.run.smithi008.stdout: "time": "2023-08-01T19:54:04.472247+0000", 2023-08-01T19:54:32.880 INFO:teuthology.orchestra.run.smithi008.stdout: "duration": 4.0213999999999998e-05 2023-08-01T19:54:32.880 INFO:teuthology.orchestra.run.smithi008.stdout: } 2023-08-01T19:54:32.880 INFO:teuthology.orchestra.run.smithi008.stdout: ] 2023-08-01T19:54:32.880 INFO:teuthology.orchestra.run.smithi008.stdout: } 2023-08-01T19:54:32.880 INFO:teuthology.orchestra.run.smithi008.stdout: }, 2023-08-01T19:54:32.880 INFO:teuthology.orchestra.run.smithi008.stdout: { 2023-08-01T19:54:32.881 INFO:teuthology.orchestra.run.smithi008.stdout: "description": "osd_op(mds.0.3:28 3.b 3:d0630e4c:::mds0_sessionmap:head [omap-set-header] snapc 0=[] ondisk+write+known_if_redirected+full_force+supports_pool_eio e17)", 2023-08-01T19:54:32.881 INFO:teuthology.orchestra.run.smithi008.stdout: "initiated_at": "2023-08-01T19:54:04.459251+0000", 2023-08-01T19:54:32.881 INFO:teuthology.orchestra.run.smithi008.stdout: "age": 28.372984105, 2023-08-01T19:54:32.881 INFO:teuthology.orchestra.run.smithi008.stdout: "duration": 0.01361938, 2023-08-01T19:54:32.881 INFO:teuthology.orchestra.run.smithi008.stdout: "type_data": { 2023-08-01T19:54:32.881 INFO:teuthology.orchestra.run.smithi008.stdout: "flag_point": "commit sent; apply or cleanup", 2023-08-01T19:54:32.881 INFO:teuthology.orchestra.run.smithi008.stdout: "events": [ 2023-08-01T19:54:32.881 INFO:teuthology.orchestra.run.smithi008.stdout: { 2023-08-01T19:54:32.882 INFO:teuthology.orchestra.run.smithi008.stdout: "event": "initiated", 2023-08-01T19:54:32.882 INFO:teuthology.orchestra.run.smithi008.stdout: "time": "2023-08-01T19:54:04.459251+0000", 2023-08-01T19:54:32.882 INFO:teuthology.orchestra.run.smithi008.stdout: "duration": 0 2023-08-01T19:54:32.882 INFO:teuthology.orchestra.run.smithi008.stdout: }, 2023-08-01T19:54:32.882 INFO:teuthology.orchestra.run.smithi008.stdout: { 2023-08-01T19:54:32.882 INFO:teuthology.orchestra.run.smithi008.stdout: "event": "throttled", 2023-08-01T19:54:32.882 INFO:teuthology.orchestra.run.smithi008.stdout: "time": "2023-08-01T19:54:04.459251+0000", 2023-08-01T19:54:32.882 INFO:teuthology.orchestra.run.smithi008.stdout: "duration": 0 2023-08-01T19:54:32.883 INFO:teuthology.orchestra.run.smithi008.stdout: }, 2023-08-01T19:54:32.883 INFO:teuthology.orchestra.run.smithi008.stdout: { 2023-08-01T19:54:32.883 INFO:teuthology.orchestra.run.smithi008.stdout: "event": "header_read", 2023-08-01T19:54:32.883 INFO:teuthology.orchestra.run.smithi008.stdout: "time": "2023-08-01T19:54:04.459251+0000", 2023-08-01T19:54:32.883 INFO:teuthology.orchestra.run.smithi008.stdout: "duration": 4294967295.9999995 2023-08-01T19:54:32.883 INFO:teuthology.orchestra.run.smithi008.stdout: }, 2023-08-01T19:54:32.883 INFO:teuthology.orchestra.run.smithi008.stdout: { 2023-08-01T19:54:32.883 INFO:teuthology.orchestra.run.smithi008.stdout: "event": "all_read", 2023-08-01T19:54:32.884 INFO:teuthology.orchestra.run.smithi008.stdout: "time": "2023-08-01T19:54:04.459258+0000", 2023-08-01T19:54:32.884 INFO:teuthology.orchestra.run.smithi008.stdout: "duration": 7.0029999999999997e-06 2023-08-01T19:54:32.884 INFO:teuthology.orchestra.run.smithi008.stdout: }, 2023-08-01T19:54:32.884 INFO:teuthology.orchestra.run.smithi008.stdout: { 2023-08-01T19:54:32.884 INFO:teuthology.orchestra.run.smithi008.stdout: "event": "dispatched", 2023-08-01T19:54:32.884 INFO:teuthology.orchestra.run.smithi008.stdout: "time": "2023-08-01T19:54:04.459267+0000", 2023-08-01T19:54:32.884 INFO:teuthology.orchestra.run.smithi008.stdout: "duration": 8.8810000000000002e-06 2023-08-01T19:54:32.884 INFO:teuthology.orchestra.run.smithi008.stdout: }, 2023-08-01T19:54:32.885 INFO:teuthology.orchestra.run.smithi008.stdout: { 2023-08-01T19:54:32.885 INFO:teuthology.orchestra.run.smithi008.stdout: "event": "queued_for_pg", 2023-08-01T19:54:32.885 INFO:teuthology.orchestra.run.smithi008.stdout: "time": "2023-08-01T19:54:04.459273+0000", 2023-08-01T19:54:32.885 INFO:teuthology.orchestra.run.smithi008.stdout: "duration": 5.9279999999999998e-06 2023-08-01T19:54:32.885 INFO:teuthology.orchestra.run.smithi008.stdout: }, 2023-08-01T19:54:32.885 INFO:teuthology.orchestra.run.smithi008.stdout: { 2023-08-01T19:54:32.885 INFO:teuthology.orchestra.run.smithi008.stdout: "event": "reached_pg", 2023-08-01T19:54:32.885 INFO:teuthology.orchestra.run.smithi008.stdout: "time": "2023-08-01T19:54:04.460798+0000", 2023-08-01T19:54:32.886 INFO:teuthology.orchestra.run.smithi008.stdout: "duration": 0.001525039 2023-08-01T19:54:32.886 INFO:teuthology.orchestra.run.smithi008.stdout: }, 2023-08-01T19:54:32.886 INFO:teuthology.orchestra.run.smithi008.stdout: { 2023-08-01T19:54:32.886 INFO:teuthology.orchestra.run.smithi008.stdout: "event": "started", 2023-08-01T19:54:32.886 INFO:teuthology.orchestra.run.smithi008.stdout: "time": "2023-08-01T19:54:04.460951+0000", 2023-08-01T19:54:32.886 INFO:teuthology.orchestra.run.smithi008.stdout: "duration": 0.000153024 2023-08-01T19:54:32.886 INFO:teuthology.orchestra.run.smithi008.stdout: }, 2023-08-01T19:54:32.886 INFO:teuthology.orchestra.run.smithi008.stdout: { 2023-08-01T19:54:32.887 INFO:teuthology.orchestra.run.smithi008.stdout: "event": "waiting for subops from 1", 2023-08-01T19:54:32.887 INFO:teuthology.orchestra.run.smithi008.stdout: "time": "2023-08-01T19:54:04.461116+0000", 2023-08-01T19:54:32.887 INFO:teuthology.orchestra.run.smithi008.stdout: "duration": 0.00016551000000000001 2023-08-01T19:54:32.887 INFO:teuthology.orchestra.run.smithi008.stdout: }, 2023-08-01T19:54:32.887 INFO:teuthology.orchestra.run.smithi008.stdout: { 2023-08-01T19:54:32.887 INFO:teuthology.orchestra.run.smithi008.stdout: "event": "op_commit", 2023-08-01T19:54:32.887 INFO:teuthology.orchestra.run.smithi008.stdout: "time": "2023-08-01T19:54:04.463448+0000", 2023-08-01T19:54:32.887 INFO:teuthology.orchestra.run.smithi008.stdout: "duration": 0.0023321689999999998 2023-08-01T19:54:32.888 INFO:teuthology.orchestra.run.smithi008.stdout: }, 2023-08-01T19:54:32.888 INFO:teuthology.orchestra.run.smithi008.stdout: { 2023-08-01T19:54:32.888 INFO:teuthology.orchestra.run.smithi008.stdout: "event": "sub_op_commit_rec", 2023-08-01T19:54:32.888 INFO:teuthology.orchestra.run.smithi008.stdout: "time": "2023-08-01T19:54:04.472778+0000", 2023-08-01T19:54:32.888 INFO:teuthology.orchestra.run.smithi008.stdout: "duration": 0.0093293779999999993 2023-08-01T19:54:32.888 INFO:teuthology.orchestra.run.smithi008.stdout: }, 2023-08-01T19:54:32.888 INFO:teuthology.orchestra.run.smithi008.stdout: { 2023-08-01T19:54:32.889 INFO:teuthology.orchestra.run.smithi008.stdout: "event": "commit_sent", 2023-08-01T19:54:32.889 INFO:teuthology.orchestra.run.smithi008.stdout: "time": "2023-08-01T19:54:04.472821+0000", 2023-08-01T19:54:32.889 INFO:teuthology.orchestra.run.smithi008.stdout: "duration": 4.3253000000000001e-05 2023-08-01T19:54:32.889 INFO:teuthology.orchestra.run.smithi008.stdout: }, 2023-08-01T19:54:32.889 INFO:teuthology.orchestra.run.smithi008.stdout: { 2023-08-01T19:54:32.889 INFO:teuthology.orchestra.run.smithi008.stdout: "event": "done", 2023-08-01T19:54:32.889 INFO:teuthology.orchestra.run.smithi008.stdout: "time": "2023-08-01T19:54:04.472870+0000", 2023-08-01T19:54:32.889 INFO:teuthology.orchestra.run.smithi008.stdout: "duration": 4.9478999999999998e-05 2023-08-01T19:54:32.890 INFO:teuthology.orchestra.run.smithi008.stdout: } 2023-08-01T19:54:32.890 INFO:teuthology.orchestra.run.smithi008.stdout: ] 2023-08-01T19:54:32.890 INFO:teuthology.orchestra.run.smithi008.stdout: } 2023-08-01T19:54:32.890 INFO:teuthology.orchestra.run.smithi008.stdout: }, 2023-08-01T19:54:32.890 INFO:teuthology.orchestra.run.smithi008.stdout: { 2023-08-01T19:54:32.890 INFO:teuthology.orchestra.run.smithi008.stdout: "description": "osd_op(mds.0.3:34 3.b 3:d5c7a900:::200.00000003:head [delete] snapc 0=[] ondisk+write+known_if_redirected+full_force+supports_pool_eio e17)", 2023-08-01T19:54:32.890 INFO:teuthology.orchestra.run.smithi008.stdout: "initiated_at": "2023-08-01T19:54:04.459662+0000", 2023-08-01T19:54:32.890 INFO:teuthology.orchestra.run.smithi008.stdout: "age": 28.372573401, 2023-08-01T19:54:32.891 INFO:teuthology.orchestra.run.smithi008.stdout: "duration": 0.013345101999999999, 2023-08-01T19:54:32.891 INFO:teuthology.orchestra.run.smithi008.stdout: "type_data": { 2023-08-01T19:54:32.891 INFO:teuthology.orchestra.run.smithi008.stdout: "flag_point": "started", 2023-08-01T19:54:32.891 INFO:teuthology.orchestra.run.smithi008.stdout: "events": [ 2023-08-01T19:54:32.891 INFO:teuthology.orchestra.run.smithi008.stdout: { 2023-08-01T19:54:32.891 INFO:teuthology.orchestra.run.smithi008.stdout: "event": "initiated", 2023-08-01T19:54:32.891 INFO:teuthology.orchestra.run.smithi008.stdout: "time": "2023-08-01T19:54:04.459662+0000", 2023-08-01T19:54:32.891 INFO:teuthology.orchestra.run.smithi008.stdout: "duration": 0 2023-08-01T19:54:32.892 INFO:teuthology.orchestra.run.smithi008.stdout: }, 2023-08-01T19:54:32.892 INFO:teuthology.orchestra.run.smithi008.stdout: { 2023-08-01T19:54:32.892 INFO:teuthology.orchestra.run.smithi008.stdout: "event": "throttled", 2023-08-01T19:54:32.892 INFO:teuthology.orchestra.run.smithi008.stdout: "time": "2023-08-01T19:54:04.459662+0000", 2023-08-01T19:54:32.892 INFO:teuthology.orchestra.run.smithi008.stdout: "duration": 0 2023-08-01T19:54:32.892 INFO:teuthology.orchestra.run.smithi008.stdout: }, 2023-08-01T19:54:32.892 INFO:teuthology.orchestra.run.smithi008.stdout: { 2023-08-01T19:54:32.892 INFO:teuthology.orchestra.run.smithi008.stdout: "event": "header_read", 2023-08-01T19:54:32.893 INFO:teuthology.orchestra.run.smithi008.stdout: "time": "2023-08-01T19:54:04.459661+0000", 2023-08-01T19:54:32.893 INFO:teuthology.orchestra.run.smithi008.stdout: "duration": 4294967295.999999 2023-08-01T19:54:32.893 INFO:teuthology.orchestra.run.smithi008.stdout: }, 2023-08-01T19:54:32.893 INFO:teuthology.orchestra.run.smithi008.stdout: { 2023-08-01T19:54:32.893 INFO:teuthology.orchestra.run.smithi008.stdout: "event": "all_read", 2023-08-01T19:54:32.893 INFO:teuthology.orchestra.run.smithi008.stdout: "time": "2023-08-01T19:54:04.459668+0000", 2023-08-01T19:54:32.893 INFO:teuthology.orchestra.run.smithi008.stdout: "duration": 7.0219999999999999e-06 2023-08-01T19:54:32.893 INFO:teuthology.orchestra.run.smithi008.stdout: }, 2023-08-01T19:54:32.894 INFO:teuthology.orchestra.run.smithi008.stdout: { 2023-08-01T19:54:32.894 INFO:teuthology.orchestra.run.smithi008.stdout: "event": "dispatched", 2023-08-01T19:54:32.894 INFO:teuthology.orchestra.run.smithi008.stdout: "time": "2023-08-01T19:54:04.459681+0000", 2023-08-01T19:54:32.894 INFO:teuthology.orchestra.run.smithi008.stdout: "duration": 1.2999999999999999e-05 2023-08-01T19:54:32.894 INFO:teuthology.orchestra.run.smithi008.stdout: }, 2023-08-01T19:54:32.894 INFO:teuthology.orchestra.run.smithi008.stdout: { 2023-08-01T19:54:32.894 INFO:teuthology.orchestra.run.smithi008.stdout: "event": "queued_for_pg", 2023-08-01T19:54:32.894 INFO:teuthology.orchestra.run.smithi008.stdout: "time": "2023-08-01T19:54:04.459690+0000", 2023-08-01T19:54:32.895 INFO:teuthology.orchestra.run.smithi008.stdout: "duration": 9.2529999999999993e-06 2023-08-01T19:54:32.895 INFO:teuthology.orchestra.run.smithi008.stdout: }, 2023-08-01T19:54:32.895 INFO:teuthology.orchestra.run.smithi008.stdout: { 2023-08-01T19:54:32.895 INFO:teuthology.orchestra.run.smithi008.stdout: "event": "reached_pg", 2023-08-01T19:54:32.895 INFO:teuthology.orchestra.run.smithi008.stdout: "time": "2023-08-01T19:54:04.461862+0000", 2023-08-01T19:54:32.895 INFO:teuthology.orchestra.run.smithi008.stdout: "duration": 0.002172345 2023-08-01T19:54:32.895 INFO:teuthology.orchestra.run.smithi008.stdout: }, 2023-08-01T19:54:32.895 INFO:teuthology.orchestra.run.smithi008.stdout: { 2023-08-01T19:54:32.896 INFO:teuthology.orchestra.run.smithi008.stdout: "event": "started", 2023-08-01T19:54:32.896 INFO:teuthology.orchestra.run.smithi008.stdout: "time": "2023-08-01T19:54:04.462013+0000", 2023-08-01T19:54:32.896 INFO:teuthology.orchestra.run.smithi008.stdout: "duration": 0.00015044200000000001 2023-08-01T19:54:32.896 INFO:teuthology.orchestra.run.smithi008.stdout: }, 2023-08-01T19:54:32.896 INFO:teuthology.orchestra.run.smithi008.stdout: { 2023-08-01T19:54:32.896 INFO:teuthology.orchestra.run.smithi008.stdout: "event": "done", 2023-08-01T19:54:32.896 INFO:teuthology.orchestra.run.smithi008.stdout: "time": "2023-08-01T19:54:04.473007+0000", 2023-08-01T19:54:32.897 INFO:teuthology.orchestra.run.smithi008.stdout: "duration": 0.010994141000000001 2023-08-01T19:54:32.897 INFO:teuthology.orchestra.run.smithi008.stdout: } 2023-08-01T19:54:32.897 INFO:teuthology.orchestra.run.smithi008.stdout: ] 2023-08-01T19:54:32.897 INFO:teuthology.orchestra.run.smithi008.stdout: } 2023-08-01T19:54:32.897 INFO:teuthology.orchestra.run.smithi008.stdout: }, 2023-08-01T19:54:32.897 INFO:teuthology.orchestra.run.smithi008.stdout: { 2023-08-01T19:54:32.897 INFO:teuthology.orchestra.run.smithi008.stdout: "description": "osd_op(mds.0.3:35 3.1f 3:f83d65d8:::200.00000004:head [delete] snapc 0=[] ondisk+write+known_if_redirected+full_force+supports_pool_eio e17)", 2023-08-01T19:54:32.897 INFO:teuthology.orchestra.run.smithi008.stdout: "initiated_at": "2023-08-01T19:54:04.460657+0000", 2023-08-01T19:54:32.898 INFO:teuthology.orchestra.run.smithi008.stdout: "age": 28.371577819999999, 2023-08-01T19:54:32.898 INFO:teuthology.orchestra.run.smithi008.stdout: "duration": 0.012077002, 2023-08-01T19:54:32.898 INFO:teuthology.orchestra.run.smithi008.stdout: "type_data": { 2023-08-01T19:54:32.898 INFO:teuthology.orchestra.run.smithi008.stdout: "flag_point": "started", 2023-08-01T19:54:32.898 INFO:teuthology.orchestra.run.smithi008.stdout: "events": [ 2023-08-01T19:54:32.898 INFO:teuthology.orchestra.run.smithi008.stdout: { 2023-08-01T19:54:32.898 INFO:teuthology.orchestra.run.smithi008.stdout: "event": "initiated", 2023-08-01T19:54:32.898 INFO:teuthology.orchestra.run.smithi008.stdout: "time": "2023-08-01T19:54:04.460657+0000", 2023-08-01T19:54:32.899 INFO:teuthology.orchestra.run.smithi008.stdout: "duration": 0 2023-08-01T19:54:32.899 INFO:teuthology.orchestra.run.smithi008.stdout: }, 2023-08-01T19:54:32.899 INFO:teuthology.orchestra.run.smithi008.stdout: { 2023-08-01T19:54:32.899 INFO:teuthology.orchestra.run.smithi008.stdout: "event": "throttled", 2023-08-01T19:54:32.899 INFO:teuthology.orchestra.run.smithi008.stdout: "time": "2023-08-01T19:54:04.460657+0000", 2023-08-01T19:54:32.899 INFO:teuthology.orchestra.run.smithi008.stdout: "duration": 0 2023-08-01T19:54:32.899 INFO:teuthology.orchestra.run.smithi008.stdout: }, 2023-08-01T19:54:32.899 INFO:teuthology.orchestra.run.smithi008.stdout: { 2023-08-01T19:54:32.900 INFO:teuthology.orchestra.run.smithi008.stdout: "event": "header_read", 2023-08-01T19:54:32.900 INFO:teuthology.orchestra.run.smithi008.stdout: "time": "2023-08-01T19:54:04.460656+0000", 2023-08-01T19:54:32.900 INFO:teuthology.orchestra.run.smithi008.stdout: "duration": 4294967295.999999 2023-08-01T19:54:32.900 INFO:teuthology.orchestra.run.smithi008.stdout: }, 2023-08-01T19:54:32.900 INFO:teuthology.orchestra.run.smithi008.stdout: { 2023-08-01T19:54:32.900 INFO:teuthology.orchestra.run.smithi008.stdout: "event": "all_read", 2023-08-01T19:54:32.900 INFO:teuthology.orchestra.run.smithi008.stdout: "time": "2023-08-01T19:54:04.460662+0000", 2023-08-01T19:54:32.900 INFO:teuthology.orchestra.run.smithi008.stdout: "duration": 5.7450000000000001e-06 2023-08-01T19:54:32.901 INFO:teuthology.orchestra.run.smithi008.stdout: }, 2023-08-01T19:54:32.901 INFO:teuthology.orchestra.run.smithi008.stdout: { 2023-08-01T19:54:32.901 INFO:teuthology.orchestra.run.smithi008.stdout: "event": "dispatched", 2023-08-01T19:54:32.901 INFO:teuthology.orchestra.run.smithi008.stdout: "time": "2023-08-01T19:54:04.460674+0000", 2023-08-01T19:54:32.901 INFO:teuthology.orchestra.run.smithi008.stdout: "duration": 1.2329e-05 2023-08-01T19:54:32.901 INFO:teuthology.orchestra.run.smithi008.stdout: }, 2023-08-01T19:54:32.901 INFO:teuthology.orchestra.run.smithi008.stdout: { 2023-08-01T19:54:32.901 INFO:teuthology.orchestra.run.smithi008.stdout: "event": "queued_for_pg", 2023-08-01T19:54:32.902 INFO:teuthology.orchestra.run.smithi008.stdout: "time": "2023-08-01T19:54:04.460685+0000", 2023-08-01T19:54:32.902 INFO:teuthology.orchestra.run.smithi008.stdout: "duration": 1.0137e-05 2023-08-01T19:54:32.902 INFO:teuthology.orchestra.run.smithi008.stdout: }, 2023-08-01T19:54:32.902 INFO:teuthology.orchestra.run.smithi008.stdout: { 2023-08-01T19:54:32.902 INFO:teuthology.orchestra.run.smithi008.stdout: "event": "reached_pg", 2023-08-01T19:54:32.902 INFO:teuthology.orchestra.run.smithi008.stdout: "time": "2023-08-01T19:54:04.464433+0000", 2023-08-01T19:54:32.902 INFO:teuthology.orchestra.run.smithi008.stdout: "duration": 0.0037482240000000001 2023-08-01T19:54:32.902 INFO:teuthology.orchestra.run.smithi008.stdout: }, 2023-08-01T19:54:32.903 INFO:teuthology.orchestra.run.smithi008.stdout: { 2023-08-01T19:54:32.903 INFO:teuthology.orchestra.run.smithi008.stdout: "event": "started", 2023-08-01T19:54:32.903 INFO:teuthology.orchestra.run.smithi008.stdout: "time": "2023-08-01T19:54:04.464646+0000", 2023-08-01T19:54:32.903 INFO:teuthology.orchestra.run.smithi008.stdout: "duration": 0.00021296800000000001 2023-08-01T19:54:32.903 INFO:teuthology.orchestra.run.smithi008.stdout: }, 2023-08-01T19:54:32.903 INFO:teuthology.orchestra.run.smithi008.stdout: { 2023-08-01T19:54:32.903 INFO:teuthology.orchestra.run.smithi008.stdout: "event": "done", 2023-08-01T19:54:32.903 INFO:teuthology.orchestra.run.smithi008.stdout: "time": "2023-08-01T19:54:04.472734+0000", 2023-08-01T19:54:32.904 INFO:teuthology.orchestra.run.smithi008.stdout: "duration": 0.0080884709999999999 2023-08-01T19:54:32.904 INFO:teuthology.orchestra.run.smithi008.stdout: } 2023-08-01T19:54:32.904 INFO:teuthology.orchestra.run.smithi008.stdout: ] 2023-08-01T19:54:32.904 INFO:teuthology.orchestra.run.smithi008.stdout: } 2023-08-01T19:54:32.904 INFO:teuthology.orchestra.run.smithi008.stdout: }, 2023-08-01T19:54:32.904 INFO:teuthology.orchestra.run.smithi008.stdout: { 2023-08-01T19:54:32.904 INFO:teuthology.orchestra.run.smithi008.stdout: "description": "osd_op(mds.0.3:37 3.1e 3:7bf7e7b5:::200.00000006:head [delete] snapc 0=[] ondisk+write+known_if_redirected+full_force+supports_pool_eio e17)", 2023-08-01T19:54:32.905 INFO:teuthology.orchestra.run.smithi008.stdout: "initiated_at": "2023-08-01T19:54:04.460701+0000", 2023-08-01T19:54:32.905 INFO:teuthology.orchestra.run.smithi008.stdout: "age": 28.371533612, 2023-08-01T19:54:32.905 INFO:teuthology.orchestra.run.smithi008.stdout: "duration": 0.010776287000000001, 2023-08-01T19:54:32.905 INFO:teuthology.orchestra.run.smithi008.stdout: "type_data": { 2023-08-01T19:54:32.905 INFO:teuthology.orchestra.run.smithi008.stdout: "flag_point": "started", 2023-08-01T19:54:32.905 INFO:teuthology.orchestra.run.smithi008.stdout: "events": [ 2023-08-01T19:54:32.905 INFO:teuthology.orchestra.run.smithi008.stdout: { 2023-08-01T19:54:32.905 INFO:teuthology.orchestra.run.smithi008.stdout: "event": "initiated", 2023-08-01T19:54:32.906 INFO:teuthology.orchestra.run.smithi008.stdout: "time": "2023-08-01T19:54:04.460701+0000", 2023-08-01T19:54:32.906 INFO:teuthology.orchestra.run.smithi008.stdout: "duration": 0 2023-08-01T19:54:32.906 INFO:teuthology.orchestra.run.smithi008.stdout: }, 2023-08-01T19:54:32.906 INFO:teuthology.orchestra.run.smithi008.stdout: { 2023-08-01T19:54:32.906 INFO:teuthology.orchestra.run.smithi008.stdout: "event": "throttled", 2023-08-01T19:54:32.906 INFO:teuthology.orchestra.run.smithi008.stdout: "time": "2023-08-01T19:54:04.460701+0000", 2023-08-01T19:54:32.906 INFO:teuthology.orchestra.run.smithi008.stdout: "duration": 0 2023-08-01T19:54:32.906 INFO:teuthology.orchestra.run.smithi008.stdout: }, 2023-08-01T19:54:32.907 INFO:teuthology.orchestra.run.smithi008.stdout: { 2023-08-01T19:54:32.907 INFO:teuthology.orchestra.run.smithi008.stdout: "event": "header_read", 2023-08-01T19:54:32.907 INFO:teuthology.orchestra.run.smithi008.stdout: "time": "2023-08-01T19:54:04.460701+0000", 2023-08-01T19:54:32.907 INFO:teuthology.orchestra.run.smithi008.stdout: "duration": 4294967295.999999 2023-08-01T19:54:32.907 INFO:teuthology.orchestra.run.smithi008.stdout: }, 2023-08-01T19:54:32.907 INFO:teuthology.orchestra.run.smithi008.stdout: { 2023-08-01T19:54:32.907 INFO:teuthology.orchestra.run.smithi008.stdout: "event": "all_read", 2023-08-01T19:54:32.907 INFO:teuthology.orchestra.run.smithi008.stdout: "time": "2023-08-01T19:54:04.460713+0000", 2023-08-01T19:54:32.908 INFO:teuthology.orchestra.run.smithi008.stdout: "duration": 1.2655e-05 2023-08-01T19:54:32.908 INFO:teuthology.orchestra.run.smithi008.stdout: }, 2023-08-01T19:54:32.908 INFO:teuthology.orchestra.run.smithi008.stdout: { 2023-08-01T19:54:32.908 INFO:teuthology.orchestra.run.smithi008.stdout: "event": "dispatched", 2023-08-01T19:54:32.908 INFO:teuthology.orchestra.run.smithi008.stdout: "time": "2023-08-01T19:54:04.460728+0000", 2023-08-01T19:54:32.908 INFO:teuthology.orchestra.run.smithi008.stdout: "duration": 1.4775e-05 2023-08-01T19:54:32.908 INFO:teuthology.orchestra.run.smithi008.stdout: }, 2023-08-01T19:54:32.908 INFO:teuthology.orchestra.run.smithi008.stdout: { 2023-08-01T19:54:32.909 INFO:teuthology.orchestra.run.smithi008.stdout: "event": "queued_for_pg", 2023-08-01T19:54:32.909 INFO:teuthology.orchestra.run.smithi008.stdout: "time": "2023-08-01T19:54:04.460734+0000", 2023-08-01T19:54:32.909 INFO:teuthology.orchestra.run.smithi008.stdout: "duration": 5.9039999999999997e-06 2023-08-01T19:54:32.909 INFO:teuthology.orchestra.run.smithi008.stdout: }, 2023-08-01T19:54:32.909 INFO:teuthology.orchestra.run.smithi008.stdout: { 2023-08-01T19:54:32.909 INFO:teuthology.orchestra.run.smithi008.stdout: "event": "reached_pg", 2023-08-01T19:54:32.909 INFO:teuthology.orchestra.run.smithi008.stdout: "time": "2023-08-01T19:54:04.464701+0000", 2023-08-01T19:54:32.909 INFO:teuthology.orchestra.run.smithi008.stdout: "duration": 0.0039670030000000002 2023-08-01T19:54:32.910 INFO:teuthology.orchestra.run.smithi008.stdout: }, 2023-08-01T19:54:32.910 INFO:teuthology.orchestra.run.smithi008.stdout: { 2023-08-01T19:54:32.910 INFO:teuthology.orchestra.run.smithi008.stdout: "event": "started", 2023-08-01T19:54:32.910 INFO:teuthology.orchestra.run.smithi008.stdout: "time": "2023-08-01T19:54:04.464820+0000", 2023-08-01T19:54:32.910 INFO:teuthology.orchestra.run.smithi008.stdout: "duration": 0.000118925 2023-08-01T19:54:32.910 INFO:teuthology.orchestra.run.smithi008.stdout: }, 2023-08-01T19:54:32.910 INFO:teuthology.orchestra.run.smithi008.stdout: { 2023-08-01T19:54:32.910 INFO:teuthology.orchestra.run.smithi008.stdout: "event": "done", 2023-08-01T19:54:32.911 INFO:teuthology.orchestra.run.smithi008.stdout: "time": "2023-08-01T19:54:04.471478+0000", 2023-08-01T19:54:32.911 INFO:teuthology.orchestra.run.smithi008.stdout: "duration": 0.0066579539999999998 2023-08-01T19:54:32.911 INFO:teuthology.orchestra.run.smithi008.stdout: } 2023-08-01T19:54:32.911 INFO:teuthology.orchestra.run.smithi008.stdout: ] 2023-08-01T19:54:32.911 INFO:teuthology.orchestra.run.smithi008.stdout: } 2023-08-01T19:54:32.911 INFO:teuthology.orchestra.run.smithi008.stdout: }, 2023-08-01T19:54:32.911 INFO:teuthology.orchestra.run.smithi008.stdout: { 2023-08-01T19:54:32.912 INFO:teuthology.orchestra.run.smithi008.stdout: "description": "osd_op(client.4668.0:17482 5.5 5:a43aa6fa:::benchmark_data_smithi006_114134_object17481:head [set-alloc-hint object_size 65536 write_size 65536,write 0~65536] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e23)", 2023-08-01T19:54:32.912 INFO:teuthology.orchestra.run.smithi008.stdout: "initiated_at": "2023-08-01T19:54:28.749880+0000", 2023-08-01T19:54:32.912 INFO:teuthology.orchestra.run.smithi008.stdout: "age": 4.0823555489999999, 2023-08-01T19:54:32.912 INFO:teuthology.orchestra.run.smithi008.stdout: "duration": 0.012550182999999999, 2023-08-01T19:54:32.912 INFO:teuthology.orchestra.run.smithi008.stdout: "type_data": { 2023-08-01T19:54:32.912 INFO:teuthology.orchestra.run.smithi008.stdout: "flag_point": "commit sent; apply or cleanup", 2023-08-01T19:54:32.912 INFO:teuthology.orchestra.run.smithi008.stdout: "client_info": { 2023-08-01T19:54:32.912 INFO:teuthology.orchestra.run.smithi008.stdout: "client": "client.4668", 2023-08-01T19:54:32.913 INFO:teuthology.orchestra.run.smithi008.stdout: "client_addr": "172.21.15.6:0/1709472247", 2023-08-01T19:54:32.913 INFO:teuthology.orchestra.run.smithi008.stdout: "tid": 17482 2023-08-01T19:54:32.913 INFO:teuthology.orchestra.run.smithi008.stdout: }, 2023-08-01T19:54:32.913 INFO:teuthology.orchestra.run.smithi008.stdout: "events": [ 2023-08-01T19:54:32.913 INFO:teuthology.orchestra.run.smithi008.stdout: { 2023-08-01T19:54:32.913 INFO:teuthology.orchestra.run.smithi008.stdout: "event": "initiated", 2023-08-01T19:54:32.913 INFO:teuthology.orchestra.run.smithi008.stdout: "time": "2023-08-01T19:54:28.749880+0000", 2023-08-01T19:54:32.913 INFO:teuthology.orchestra.run.smithi008.stdout: "duration": 0 2023-08-01T19:54:32.914 INFO:teuthology.orchestra.run.smithi008.stdout: }, 2023-08-01T19:54:32.914 INFO:teuthology.orchestra.run.smithi008.stdout: { 2023-08-01T19:54:32.914 INFO:teuthology.orchestra.run.smithi008.stdout: "event": "throttled", 2023-08-01T19:54:32.914 INFO:teuthology.orchestra.run.smithi008.stdout: "time": "2023-08-01T19:54:28.749880+0000", 2023-08-01T19:54:32.914 INFO:teuthology.orchestra.run.smithi008.stdout: "duration": 0 2023-08-01T19:54:32.914 INFO:teuthology.orchestra.run.smithi008.stdout: }, 2023-08-01T19:54:32.914 INFO:teuthology.orchestra.run.smithi008.stdout: { 2023-08-01T19:54:32.914 INFO:teuthology.orchestra.run.smithi008.stdout: "event": "header_read", 2023-08-01T19:54:32.915 INFO:teuthology.orchestra.run.smithi008.stdout: "time": "2023-08-01T19:54:28.749879+0000", 2023-08-01T19:54:32.915 INFO:teuthology.orchestra.run.smithi008.stdout: "duration": 4294967295.999999 2023-08-01T19:54:32.915 INFO:teuthology.orchestra.run.smithi008.stdout: }, 2023-08-01T19:54:32.915 INFO:teuthology.orchestra.run.smithi008.stdout: { 2023-08-01T19:54:32.915 INFO:teuthology.orchestra.run.smithi008.stdout: "event": "all_read", 2023-08-01T19:54:32.915 INFO:teuthology.orchestra.run.smithi008.stdout: "time": "2023-08-01T19:54:28.749962+0000", 2023-08-01T19:54:32.915 INFO:teuthology.orchestra.run.smithi008.stdout: "duration": 8.3164999999999994e-05 2023-08-01T19:54:32.915 INFO:teuthology.orchestra.run.smithi008.stdout: }, 2023-08-01T19:54:32.916 INFO:teuthology.orchestra.run.smithi008.stdout: { 2023-08-01T19:54:32.916 INFO:teuthology.orchestra.run.smithi008.stdout: "event": "dispatched", 2023-08-01T19:54:32.916 INFO:teuthology.orchestra.run.smithi008.stdout: "time": "2023-08-01T19:54:28.749972+0000", 2023-08-01T19:54:32.916 INFO:teuthology.orchestra.run.smithi008.stdout: "duration": 1.0324e-05 2023-08-01T19:54:32.916 INFO:teuthology.orchestra.run.smithi008.stdout: }, 2023-08-01T19:54:32.916 INFO:teuthology.orchestra.run.smithi008.stdout: { 2023-08-01T19:54:32.916 INFO:teuthology.orchestra.run.smithi008.stdout: "event": "queued_for_pg", 2023-08-01T19:54:32.916 INFO:teuthology.orchestra.run.smithi008.stdout: "time": "2023-08-01T19:54:28.749977+0000", 2023-08-01T19:54:32.917 INFO:teuthology.orchestra.run.smithi008.stdout: "duration": 4.8790000000000002e-06 2023-08-01T19:54:32.917 INFO:teuthology.orchestra.run.smithi008.stdout: }, 2023-08-01T19:54:32.917 INFO:teuthology.orchestra.run.smithi008.stdout: { 2023-08-01T19:54:32.917 INFO:teuthology.orchestra.run.smithi008.stdout: "event": "reached_pg", 2023-08-01T19:54:32.917 INFO:teuthology.orchestra.run.smithi008.stdout: "time": "2023-08-01T19:54:28.750016+0000", 2023-08-01T19:54:32.917 INFO:teuthology.orchestra.run.smithi008.stdout: "duration": 3.9045999999999999e-05 2023-08-01T19:54:32.917 INFO:teuthology.orchestra.run.smithi008.stdout: }, 2023-08-01T19:54:32.917 INFO:teuthology.orchestra.run.smithi008.stdout: { 2023-08-01T19:54:32.918 INFO:teuthology.orchestra.run.smithi008.stdout: "event": "started", 2023-08-01T19:54:32.918 INFO:teuthology.orchestra.run.smithi008.stdout: "time": "2023-08-01T19:54:28.750144+0000", 2023-08-01T19:54:32.918 INFO:teuthology.orchestra.run.smithi008.stdout: "duration": 0.00012822800000000001 2023-08-01T19:54:32.918 INFO:teuthology.orchestra.run.smithi008.stdout: }, 2023-08-01T19:54:32.918 INFO:teuthology.orchestra.run.smithi008.stdout: { 2023-08-01T19:54:32.918 INFO:teuthology.orchestra.run.smithi008.stdout: "event": "waiting for subops from 1", 2023-08-01T19:54:32.918 INFO:teuthology.orchestra.run.smithi008.stdout: "time": "2023-08-01T19:54:28.750274+0000", 2023-08-01T19:54:32.918 INFO:teuthology.orchestra.run.smithi008.stdout: "duration": 0.00013000199999999999 2023-08-01T19:54:32.919 INFO:teuthology.orchestra.run.smithi008.stdout: }, 2023-08-01T19:54:32.919 INFO:teuthology.orchestra.run.smithi008.stdout: { 2023-08-01T19:54:32.919 INFO:teuthology.orchestra.run.smithi008.stdout: "event": "op_commit", 2023-08-01T19:54:32.919 INFO:teuthology.orchestra.run.smithi008.stdout: "time": "2023-08-01T19:54:28.751923+0000", 2023-08-01T19:54:32.919 INFO:teuthology.orchestra.run.smithi008.stdout: "duration": 0.001648509 2023-08-01T19:54:32.919 INFO:teuthology.orchestra.run.smithi008.stdout: }, 2023-08-01T19:54:32.919 INFO:teuthology.orchestra.run.smithi008.stdout: { 2023-08-01T19:54:32.919 INFO:teuthology.orchestra.run.smithi008.stdout: "event": "sub_op_commit_rec", 2023-08-01T19:54:32.920 INFO:teuthology.orchestra.run.smithi008.stdout: "time": "2023-08-01T19:54:28.762336+0000", 2023-08-01T19:54:32.920 INFO:teuthology.orchestra.run.smithi008.stdout: "duration": 0.010413403 2023-08-01T19:54:32.920 INFO:teuthology.orchestra.run.smithi008.stdout: }, 2023-08-01T19:54:32.920 INFO:teuthology.orchestra.run.smithi008.stdout: { 2023-08-01T19:54:32.920 INFO:teuthology.orchestra.run.smithi008.stdout: "event": "commit_sent", 2023-08-01T19:54:32.920 INFO:teuthology.orchestra.run.smithi008.stdout: "time": "2023-08-01T19:54:28.762395+0000", 2023-08-01T19:54:32.920 INFO:teuthology.orchestra.run.smithi008.stdout: "duration": 5.9064000000000002e-05 2023-08-01T19:54:32.921 INFO:teuthology.orchestra.run.smithi008.stdout: }, 2023-08-01T19:54:32.921 INFO:teuthology.orchestra.run.smithi008.stdout: { 2023-08-01T19:54:32.921 INFO:teuthology.orchestra.run.smithi008.stdout: "event": "done", 2023-08-01T19:54:32.921 INFO:teuthology.orchestra.run.smithi008.stdout: "time": "2023-08-01T19:54:28.762430+0000", 2023-08-01T19:54:32.921 INFO:teuthology.orchestra.run.smithi008.stdout: "duration": 3.4403000000000002e-05 2023-08-01T19:54:32.921 INFO:teuthology.orchestra.run.smithi008.stdout: } 2023-08-01T19:54:32.921 INFO:teuthology.orchestra.run.smithi008.stdout: ] 2023-08-01T19:54:32.921 INFO:teuthology.orchestra.run.smithi008.stdout: } 2023-08-01T19:54:32.922 INFO:teuthology.orchestra.run.smithi008.stdout: }, 2023-08-01T19:54:32.922 INFO:teuthology.orchestra.run.smithi008.stdout: { 2023-08-01T19:54:32.922 INFO:teuthology.orchestra.run.smithi008.stdout: "description": "osd_op(client.4668.0:18360 5.6 5:65d8e237:::benchmark_data_smithi006_114134_object18359:head [set-alloc-hint object_size 65536 write_size 65536,write 0~65536] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e23)", 2023-08-01T19:54:32.922 INFO:teuthology.orchestra.run.smithi008.stdout: "initiated_at": "2023-08-01T19:54:28.994296+0000", 2023-08-01T19:54:32.922 INFO:teuthology.orchestra.run.smithi008.stdout: "age": 3.8379391680000001, 2023-08-01T19:54:32.922 INFO:teuthology.orchestra.run.smithi008.stdout: "duration": 0.017459669000000001, 2023-08-01T19:54:32.922 INFO:teuthology.orchestra.run.smithi008.stdout: "type_data": { 2023-08-01T19:54:32.922 INFO:teuthology.orchestra.run.smithi008.stdout: "flag_point": "commit sent; apply or cleanup", 2023-08-01T19:54:32.923 INFO:teuthology.orchestra.run.smithi008.stdout: "client_info": { 2023-08-01T19:54:32.923 INFO:teuthology.orchestra.run.smithi008.stdout: "client": "client.4668", 2023-08-01T19:54:32.923 INFO:teuthology.orchestra.run.smithi008.stdout: "client_addr": "172.21.15.6:0/1709472247", 2023-08-01T19:54:32.923 INFO:teuthology.orchestra.run.smithi008.stdout: "tid": 18360 2023-08-01T19:54:32.923 INFO:teuthology.orchestra.run.smithi008.stdout: }, 2023-08-01T19:54:32.923 INFO:teuthology.orchestra.run.smithi008.stdout: "events": [ 2023-08-01T19:54:32.923 INFO:teuthology.orchestra.run.smithi008.stdout: { 2023-08-01T19:54:32.923 INFO:teuthology.orchestra.run.smithi008.stdout: "event": "initiated", 2023-08-01T19:54:32.924 INFO:teuthology.orchestra.run.smithi008.stdout: "time": "2023-08-01T19:54:28.994296+0000", 2023-08-01T19:54:32.924 INFO:teuthology.orchestra.run.smithi008.stdout: "duration": 0 2023-08-01T19:54:32.924 INFO:teuthology.orchestra.run.smithi008.stdout: }, 2023-08-01T19:54:32.924 INFO:teuthology.orchestra.run.smithi008.stdout: { 2023-08-01T19:54:32.924 INFO:teuthology.orchestra.run.smithi008.stdout: "event": "throttled", 2023-08-01T19:54:32.924 INFO:teuthology.orchestra.run.smithi008.stdout: "time": "2023-08-01T19:54:28.994296+0000", 2023-08-01T19:54:32.924 INFO:teuthology.orchestra.run.smithi008.stdout: "duration": 0 2023-08-01T19:54:32.924 INFO:teuthology.orchestra.run.smithi008.stdout: }, 2023-08-01T19:54:32.925 INFO:teuthology.orchestra.run.smithi008.stdout: { 2023-08-01T19:54:32.925 INFO:teuthology.orchestra.run.smithi008.stdout: "event": "header_read", 2023-08-01T19:54:32.925 INFO:teuthology.orchestra.run.smithi008.stdout: "time": "2023-08-01T19:54:28.994295+0000", 2023-08-01T19:54:32.925 INFO:teuthology.orchestra.run.smithi008.stdout: "duration": 4294967295.9999995 2023-08-01T19:54:32.925 INFO:teuthology.orchestra.run.smithi008.stdout: }, 2023-08-01T19:54:32.925 INFO:teuthology.orchestra.run.smithi008.stdout: { 2023-08-01T19:54:32.925 INFO:teuthology.orchestra.run.smithi008.stdout: "event": "all_read", 2023-08-01T19:54:32.925 INFO:teuthology.orchestra.run.smithi008.stdout: "time": "2023-08-01T19:54:28.994381+0000", 2023-08-01T19:54:32.926 INFO:teuthology.orchestra.run.smithi008.stdout: "duration": 8.6055000000000002e-05 2023-08-01T19:54:32.926 INFO:teuthology.orchestra.run.smithi008.stdout: }, 2023-08-01T19:54:32.926 INFO:teuthology.orchestra.run.smithi008.stdout: { 2023-08-01T19:54:32.926 INFO:teuthology.orchestra.run.smithi008.stdout: "event": "dispatched", 2023-08-01T19:54:32.926 INFO:teuthology.orchestra.run.smithi008.stdout: "time": "2023-08-01T19:54:28.994390+0000", 2023-08-01T19:54:32.926 INFO:teuthology.orchestra.run.smithi008.stdout: "duration": 8.7530000000000007e-06 2023-08-01T19:54:32.926 INFO:teuthology.orchestra.run.smithi008.stdout: }, 2023-08-01T19:54:32.926 INFO:teuthology.orchestra.run.smithi008.stdout: { 2023-08-01T19:54:32.927 INFO:teuthology.orchestra.run.smithi008.stdout: "event": "queued_for_pg", 2023-08-01T19:54:32.927 INFO:teuthology.orchestra.run.smithi008.stdout: "time": "2023-08-01T19:54:28.994394+0000", 2023-08-01T19:54:32.927 INFO:teuthology.orchestra.run.smithi008.stdout: "duration": 3.4929999999999998e-06 2023-08-01T19:54:32.927 INFO:teuthology.orchestra.run.smithi008.stdout: }, 2023-08-01T19:54:32.927 INFO:teuthology.orchestra.run.smithi008.stdout: { 2023-08-01T19:54:32.927 INFO:teuthology.orchestra.run.smithi008.stdout: "event": "reached_pg", 2023-08-01T19:54:32.927 INFO:teuthology.orchestra.run.smithi008.stdout: "time": "2023-08-01T19:54:28.995799+0000", 2023-08-01T19:54:32.927 INFO:teuthology.orchestra.run.smithi008.stdout: "duration": 0.001405779 2023-08-01T19:54:32.928 INFO:teuthology.orchestra.run.smithi008.stdout: }, 2023-08-01T19:54:32.928 INFO:teuthology.orchestra.run.smithi008.stdout: { 2023-08-01T19:54:32.928 INFO:teuthology.orchestra.run.smithi008.stdout: "event": "started", 2023-08-01T19:54:32.928 INFO:teuthology.orchestra.run.smithi008.stdout: "time": "2023-08-01T19:54:28.995896+0000", 2023-08-01T19:54:32.928 INFO:teuthology.orchestra.run.smithi008.stdout: "duration": 9.6597999999999999e-05 2023-08-01T19:54:32.928 INFO:teuthology.orchestra.run.smithi008.stdout: }, 2023-08-01T19:54:32.928 INFO:teuthology.orchestra.run.smithi008.stdout: { 2023-08-01T19:54:32.929 INFO:teuthology.orchestra.run.smithi008.stdout: "event": "waiting for subops from 1", 2023-08-01T19:54:32.929 INFO:teuthology.orchestra.run.smithi008.stdout: "time": "2023-08-01T19:54:28.995985+0000", 2023-08-01T19:54:32.929 INFO:teuthology.orchestra.run.smithi008.stdout: "duration": 8.8479000000000004e-05 2023-08-01T19:54:32.929 INFO:teuthology.orchestra.run.smithi008.stdout: }, 2023-08-01T19:54:32.929 INFO:teuthology.orchestra.run.smithi008.stdout: { 2023-08-01T19:54:32.929 INFO:teuthology.orchestra.run.smithi008.stdout: "event": "op_commit", 2023-08-01T19:54:32.929 INFO:teuthology.orchestra.run.smithi008.stdout: "time": "2023-08-01T19:54:28.997700+0000", 2023-08-01T19:54:32.929 INFO:teuthology.orchestra.run.smithi008.stdout: "duration": 0.001714997 2023-08-01T19:54:32.930 INFO:teuthology.orchestra.run.smithi008.stdout: }, 2023-08-01T19:54:32.930 INFO:teuthology.orchestra.run.smithi008.stdout: { 2023-08-01T19:54:32.930 INFO:teuthology.orchestra.run.smithi008.stdout: "event": "sub_op_commit_rec", 2023-08-01T19:54:32.930 INFO:teuthology.orchestra.run.smithi008.stdout: "time": "2023-08-01T19:54:29.011671+0000", 2023-08-01T19:54:32.930 INFO:teuthology.orchestra.run.smithi008.stdout: "duration": 0.0139712 2023-08-01T19:54:32.930 INFO:teuthology.orchestra.run.smithi008.stdout: }, 2023-08-01T19:54:32.930 INFO:teuthology.orchestra.run.smithi008.stdout: { 2023-08-01T19:54:32.930 INFO:teuthology.orchestra.run.smithi008.stdout: "event": "commit_sent", 2023-08-01T19:54:32.931 INFO:teuthology.orchestra.run.smithi008.stdout: "time": "2023-08-01T19:54:29.011719+0000", 2023-08-01T19:54:32.931 INFO:teuthology.orchestra.run.smithi008.stdout: "duration": 4.8025000000000002e-05 2023-08-01T19:54:32.931 INFO:teuthology.orchestra.run.smithi008.stdout: }, 2023-08-01T19:54:32.931 INFO:teuthology.orchestra.run.smithi008.stdout: { 2023-08-01T19:54:32.931 INFO:teuthology.orchestra.run.smithi008.stdout: "event": "done", 2023-08-01T19:54:32.931 INFO:teuthology.orchestra.run.smithi008.stdout: "time": "2023-08-01T19:54:29.011756+0000", 2023-08-01T19:54:32.931 INFO:teuthology.orchestra.run.smithi008.stdout: "duration": 3.6825000000000001e-05 2023-08-01T19:54:32.931 INFO:teuthology.orchestra.run.smithi008.stdout: } 2023-08-01T19:54:32.932 INFO:teuthology.orchestra.run.smithi008.stdout: ] 2023-08-01T19:54:32.932 INFO:teuthology.orchestra.run.smithi008.stdout: } 2023-08-01T19:54:32.932 INFO:teuthology.orchestra.run.smithi008.stdout: }, 2023-08-01T19:54:32.932 INFO:teuthology.orchestra.run.smithi008.stdout: { 2023-08-01T19:54:32.932 INFO:teuthology.orchestra.run.smithi008.stdout: "description": "osd_op(client.4668.0:18361 5.6 5:65a8a093:::benchmark_data_smithi006_114134_object18360:head [set-alloc-hint object_size 65536 write_size 65536,write 0~65536] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e23)", 2023-08-01T19:54:32.932 INFO:teuthology.orchestra.run.smithi008.stdout: "initiated_at": "2023-08-01T19:54:28.994398+0000", 2023-08-01T19:54:32.932 INFO:teuthology.orchestra.run.smithi008.stdout: "age": 3.8378373090000002, 2023-08-01T19:54:32.932 INFO:teuthology.orchestra.run.smithi008.stdout: "duration": 0.017435484000000001, 2023-08-01T19:54:32.933 INFO:teuthology.orchestra.run.smithi008.stdout: "type_data": { 2023-08-01T19:54:32.933 INFO:teuthology.orchestra.run.smithi008.stdout: "flag_point": "commit sent; apply or cleanup", 2023-08-01T19:54:32.933 INFO:teuthology.orchestra.run.smithi008.stdout: "client_info": { 2023-08-01T19:54:32.933 INFO:teuthology.orchestra.run.smithi008.stdout: "client": "client.4668", 2023-08-01T19:54:32.933 INFO:teuthology.orchestra.run.smithi008.stdout: "client_addr": "172.21.15.6:0/1709472247", 2023-08-01T19:54:32.933 INFO:teuthology.orchestra.run.smithi008.stdout: "tid": 18361 2023-08-01T19:54:32.933 INFO:teuthology.orchestra.run.smithi008.stdout: }, 2023-08-01T19:54:32.933 INFO:teuthology.orchestra.run.smithi008.stdout: "events": [ 2023-08-01T19:54:32.934 INFO:teuthology.orchestra.run.smithi008.stdout: { 2023-08-01T19:54:32.934 INFO:teuthology.orchestra.run.smithi008.stdout: "event": "initiated", 2023-08-01T19:54:32.934 INFO:teuthology.orchestra.run.smithi008.stdout: "time": "2023-08-01T19:54:28.994398+0000", 2023-08-01T19:54:32.934 INFO:teuthology.orchestra.run.smithi008.stdout: "duration": 0 2023-08-01T19:54:32.934 INFO:teuthology.orchestra.run.smithi008.stdout: }, 2023-08-01T19:54:32.934 INFO:teuthology.orchestra.run.smithi008.stdout: { 2023-08-01T19:54:32.934 INFO:teuthology.orchestra.run.smithi008.stdout: "event": "throttled", 2023-08-01T19:54:32.935 INFO:teuthology.orchestra.run.smithi008.stdout: "time": "2023-08-01T19:54:28.994398+0000", 2023-08-01T19:54:32.935 INFO:teuthology.orchestra.run.smithi008.stdout: "duration": 0 2023-08-01T19:54:32.935 INFO:teuthology.orchestra.run.smithi008.stdout: }, 2023-08-01T19:54:32.935 INFO:teuthology.orchestra.run.smithi008.stdout: { 2023-08-01T19:54:32.935 INFO:teuthology.orchestra.run.smithi008.stdout: "event": "header_read", 2023-08-01T19:54:32.935 INFO:teuthology.orchestra.run.smithi008.stdout: "time": "2023-08-01T19:54:28.994397+0000", 2023-08-01T19:54:32.935 INFO:teuthology.orchestra.run.smithi008.stdout: "duration": 4294967295.9999995 2023-08-01T19:54:32.935 INFO:teuthology.orchestra.run.smithi008.stdout: }, 2023-08-01T19:54:32.936 INFO:teuthology.orchestra.run.smithi008.stdout: { 2023-08-01T19:54:32.936 INFO:teuthology.orchestra.run.smithi008.stdout: "event": "all_read", 2023-08-01T19:54:32.936 INFO:teuthology.orchestra.run.smithi008.stdout: "time": "2023-08-01T19:54:28.994475+0000", 2023-08-01T19:54:32.936 INFO:teuthology.orchestra.run.smithi008.stdout: "duration": 7.7408000000000002e-05 2023-08-01T19:54:32.936 INFO:teuthology.orchestra.run.smithi008.stdout: }, 2023-08-01T19:54:32.936 INFO:teuthology.orchestra.run.smithi008.stdout: { 2023-08-01T19:54:32.936 INFO:teuthology.orchestra.run.smithi008.stdout: "event": "dispatched", 2023-08-01T19:54:32.936 INFO:teuthology.orchestra.run.smithi008.stdout: "time": "2023-08-01T19:54:28.994480+0000", 2023-08-01T19:54:32.937 INFO:teuthology.orchestra.run.smithi008.stdout: "duration": 5.3589999999999999e-06 2023-08-01T19:54:32.937 INFO:teuthology.orchestra.run.smithi008.stdout: }, 2023-08-01T19:54:32.937 INFO:teuthology.orchestra.run.smithi008.stdout: { 2023-08-01T19:54:32.937 INFO:teuthology.orchestra.run.smithi008.stdout: "event": "queued_for_pg", 2023-08-01T19:54:32.937 INFO:teuthology.orchestra.run.smithi008.stdout: "time": "2023-08-01T19:54:28.994484+0000", 2023-08-01T19:54:32.937 INFO:teuthology.orchestra.run.smithi008.stdout: "duration": 3.9750000000000001e-06 2023-08-01T19:54:32.937 INFO:teuthology.orchestra.run.smithi008.stdout: }, 2023-08-01T19:54:32.937 INFO:teuthology.orchestra.run.smithi008.stdout: { 2023-08-01T19:54:32.938 INFO:teuthology.orchestra.run.smithi008.stdout: "event": "reached_pg", 2023-08-01T19:54:32.938 INFO:teuthology.orchestra.run.smithi008.stdout: "time": "2023-08-01T19:54:28.996504+0000", 2023-08-01T19:54:32.938 INFO:teuthology.orchestra.run.smithi008.stdout: "duration": 0.0020198550000000001 2023-08-01T19:54:32.938 INFO:teuthology.orchestra.run.smithi008.stdout: }, 2023-08-01T19:54:32.938 INFO:teuthology.orchestra.run.smithi008.stdout: { 2023-08-01T19:54:32.938 INFO:teuthology.orchestra.run.smithi008.stdout: "event": "started", 2023-08-01T19:54:32.938 INFO:teuthology.orchestra.run.smithi008.stdout: "time": "2023-08-01T19:54:28.996624+0000", 2023-08-01T19:54:32.938 INFO:teuthology.orchestra.run.smithi008.stdout: "duration": 0.000120118 2023-08-01T19:54:32.939 INFO:teuthology.orchestra.run.smithi008.stdout: }, 2023-08-01T19:54:32.939 INFO:teuthology.orchestra.run.smithi008.stdout: { 2023-08-01T19:54:32.939 INFO:teuthology.orchestra.run.smithi008.stdout: "event": "waiting for subops from 1", 2023-08-01T19:54:32.939 INFO:teuthology.orchestra.run.smithi008.stdout: "time": "2023-08-01T19:54:28.996790+0000", 2023-08-01T19:54:32.939 INFO:teuthology.orchestra.run.smithi008.stdout: "duration": 0.000165398 2023-08-01T19:54:32.939 INFO:teuthology.orchestra.run.smithi008.stdout: }, 2023-08-01T19:54:32.939 INFO:teuthology.orchestra.run.smithi008.stdout: { 2023-08-01T19:54:32.939 INFO:teuthology.orchestra.run.smithi008.stdout: "event": "op_commit", 2023-08-01T19:54:32.940 INFO:teuthology.orchestra.run.smithi008.stdout: "time": "2023-08-01T19:54:28.999061+0000", 2023-08-01T19:54:32.940 INFO:teuthology.orchestra.run.smithi008.stdout: "duration": 0.0022714800000000002 2023-08-01T19:54:32.940 INFO:teuthology.orchestra.run.smithi008.stdout: }, 2023-08-01T19:54:32.940 INFO:teuthology.orchestra.run.smithi008.stdout: { 2023-08-01T19:54:32.940 INFO:teuthology.orchestra.run.smithi008.stdout: "event": "sub_op_commit_rec", 2023-08-01T19:54:32.940 INFO:teuthology.orchestra.run.smithi008.stdout: "time": "2023-08-01T19:54:29.011788+0000", 2023-08-01T19:54:32.940 INFO:teuthology.orchestra.run.smithi008.stdout: "duration": 0.012726774999999999 2023-08-01T19:54:32.940 INFO:teuthology.orchestra.run.smithi008.stdout: }, 2023-08-01T19:54:32.941 INFO:teuthology.orchestra.run.smithi008.stdout: { 2023-08-01T19:54:32.941 INFO:teuthology.orchestra.run.smithi008.stdout: "event": "commit_sent", 2023-08-01T19:54:32.941 INFO:teuthology.orchestra.run.smithi008.stdout: "time": "2023-08-01T19:54:29.011815+0000", 2023-08-01T19:54:32.941 INFO:teuthology.orchestra.run.smithi008.stdout: "duration": 2.7032000000000001e-05 2023-08-01T19:54:32.941 INFO:teuthology.orchestra.run.smithi008.stdout: }, 2023-08-01T19:54:32.941 INFO:teuthology.orchestra.run.smithi008.stdout: { 2023-08-01T19:54:32.941 INFO:teuthology.orchestra.run.smithi008.stdout: "event": "done", 2023-08-01T19:54:32.941 INFO:teuthology.orchestra.run.smithi008.stdout: "time": "2023-08-01T19:54:29.011833+0000", 2023-08-01T19:54:32.942 INFO:teuthology.orchestra.run.smithi008.stdout: "duration": 1.8437e-05 2023-08-01T19:54:32.942 INFO:teuthology.orchestra.run.smithi008.stdout: } 2023-08-01T19:54:32.942 INFO:teuthology.orchestra.run.smithi008.stdout: ] 2023-08-01T19:54:32.942 INFO:teuthology.orchestra.run.smithi008.stdout: } 2023-08-01T19:54:32.942 INFO:teuthology.orchestra.run.smithi008.stdout: }, 2023-08-01T19:54:32.942 INFO:teuthology.orchestra.run.smithi008.stdout: { 2023-08-01T19:54:32.942 INFO:teuthology.orchestra.run.smithi008.stdout: "description": "osd_op(client.4668.0:18363 5.5 5:ab48299e:::benchmark_data_smithi006_114134_object18362:head [set-alloc-hint object_size 65536 write_size 65536,write 0~65536] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e23)", 2023-08-01T19:54:32.942 INFO:teuthology.orchestra.run.smithi008.stdout: "initiated_at": "2023-08-01T19:54:28.996467+0000", 2023-08-01T19:54:32.943 INFO:teuthology.orchestra.run.smithi008.stdout: "age": 3.835767868, 2023-08-01T19:54:32.943 INFO:teuthology.orchestra.run.smithi008.stdout: "duration": 0.015287689, 2023-08-01T19:54:32.943 INFO:teuthology.orchestra.run.smithi008.stdout: "type_data": { 2023-08-01T19:54:32.943 INFO:teuthology.orchestra.run.smithi008.stdout: "flag_point": "commit sent; apply or cleanup", 2023-08-01T19:54:32.943 INFO:teuthology.orchestra.run.smithi008.stdout: "client_info": { 2023-08-01T19:54:32.943 INFO:teuthology.orchestra.run.smithi008.stdout: "client": "client.4668", 2023-08-01T19:54:32.943 INFO:teuthology.orchestra.run.smithi008.stdout: "client_addr": "172.21.15.6:0/1709472247", 2023-08-01T19:54:32.943 INFO:teuthology.orchestra.run.smithi008.stdout: "tid": 18363 2023-08-01T19:54:32.944 INFO:teuthology.orchestra.run.smithi008.stdout: }, 2023-08-01T19:54:32.944 INFO:teuthology.orchestra.run.smithi008.stdout: "events": [ 2023-08-01T19:54:32.944 INFO:teuthology.orchestra.run.smithi008.stdout: { 2023-08-01T19:54:32.944 INFO:teuthology.orchestra.run.smithi008.stdout: "event": "initiated", 2023-08-01T19:54:32.944 INFO:teuthology.orchestra.run.smithi008.stdout: "time": "2023-08-01T19:54:28.996467+0000", 2023-08-01T19:54:32.944 INFO:teuthology.orchestra.run.smithi008.stdout: "duration": 0 2023-08-01T19:54:32.944 INFO:teuthology.orchestra.run.smithi008.stdout: }, 2023-08-01T19:54:32.945 INFO:teuthology.orchestra.run.smithi008.stdout: { 2023-08-01T19:54:32.945 INFO:teuthology.orchestra.run.smithi008.stdout: "event": "throttled", 2023-08-01T19:54:32.945 INFO:teuthology.orchestra.run.smithi008.stdout: "time": "2023-08-01T19:54:28.996467+0000", 2023-08-01T19:54:32.945 INFO:teuthology.orchestra.run.smithi008.stdout: "duration": 0 2023-08-01T19:54:32.948 INFO:teuthology.orchestra.run.smithi008.stdout: }, 2023-08-01T19:54:32.948 INFO:teuthology.orchestra.run.smithi008.stdout: { 2023-08-01T19:54:32.948 INFO:teuthology.orchestra.run.smithi008.stdout: "event": "header_read", 2023-08-01T19:54:32.949 INFO:teuthology.orchestra.run.smithi008.stdout: "time": "2023-08-01T19:54:28.996466+0000", 2023-08-01T19:54:32.949 INFO:teuthology.orchestra.run.smithi008.stdout: "duration": 4294967295.999999 2023-08-01T19:54:32.949 INFO:teuthology.orchestra.run.smithi008.stdout: }, 2023-08-01T19:54:32.949 INFO:teuthology.orchestra.run.smithi008.stdout: { 2023-08-01T19:54:32.949 INFO:teuthology.orchestra.run.smithi008.stdout: "event": "all_read", 2023-08-01T19:54:32.949 INFO:teuthology.orchestra.run.smithi008.stdout: "time": "2023-08-01T19:54:28.996519+0000", 2023-08-01T19:54:32.949 INFO:teuthology.orchestra.run.smithi008.stdout: "duration": 5.3075000000000003e-05 2023-08-01T19:54:32.949 INFO:teuthology.orchestra.run.smithi008.stdout: }, 2023-08-01T19:54:32.950 INFO:teuthology.orchestra.run.smithi008.stdout: { 2023-08-01T19:54:32.950 INFO:teuthology.orchestra.run.smithi008.stdout: "event": "dispatched", 2023-08-01T19:54:32.950 INFO:teuthology.orchestra.run.smithi008.stdout: "time": "2023-08-01T19:54:28.996529+0000", 2023-08-01T19:54:32.950 INFO:teuthology.orchestra.run.smithi008.stdout: "duration": 9.2499999999999995e-06 2023-08-01T19:54:32.950 INFO:teuthology.orchestra.run.smithi008.stdout: }, 2023-08-01T19:54:32.950 INFO:teuthology.orchestra.run.smithi008.stdout: { 2023-08-01T19:54:32.950 INFO:teuthology.orchestra.run.smithi008.stdout: "event": "queued_for_pg", 2023-08-01T19:54:32.950 INFO:teuthology.orchestra.run.smithi008.stdout: "time": "2023-08-01T19:54:28.996537+0000", 2023-08-01T19:54:32.951 INFO:teuthology.orchestra.run.smithi008.stdout: "duration": 8.4239999999999993e-06 2023-08-01T19:54:32.951 INFO:teuthology.orchestra.run.smithi008.stdout: }, 2023-08-01T19:54:32.951 INFO:teuthology.orchestra.run.smithi008.stdout: { 2023-08-01T19:54:32.951 INFO:teuthology.orchestra.run.smithi008.stdout: "event": "reached_pg", 2023-08-01T19:54:32.951 INFO:teuthology.orchestra.run.smithi008.stdout: "time": "2023-08-01T19:54:28.996590+0000", 2023-08-01T19:54:32.951 INFO:teuthology.orchestra.run.smithi008.stdout: "duration": 5.3047999999999998e-05 2023-08-01T19:54:32.951 INFO:teuthology.orchestra.run.smithi008.stdout: }, 2023-08-01T19:54:32.951 INFO:teuthology.orchestra.run.smithi008.stdout: { 2023-08-01T19:54:32.952 INFO:teuthology.orchestra.run.smithi008.stdout: "event": "started", 2023-08-01T19:54:32.952 INFO:teuthology.orchestra.run.smithi008.stdout: "time": "2023-08-01T19:54:28.996707+0000", 2023-08-01T19:54:32.952 INFO:teuthology.orchestra.run.smithi008.stdout: "duration": 0.000117005 2023-08-01T19:54:32.952 INFO:teuthology.orchestra.run.smithi008.stdout: }, 2023-08-01T19:54:32.952 INFO:teuthology.orchestra.run.smithi008.stdout: { 2023-08-01T19:54:32.952 INFO:teuthology.orchestra.run.smithi008.stdout: "event": "waiting for subops from 1", 2023-08-01T19:54:32.952 INFO:teuthology.orchestra.run.smithi008.stdout: "time": "2023-08-01T19:54:28.996807+0000", 2023-08-01T19:54:32.952 INFO:teuthology.orchestra.run.smithi008.stdout: "duration": 0.0001003 2023-08-01T19:54:32.953 INFO:teuthology.orchestra.run.smithi008.stdout: }, 2023-08-01T19:54:32.953 INFO:teuthology.orchestra.run.smithi008.stdout: { 2023-08-01T19:54:32.953 INFO:teuthology.orchestra.run.smithi008.stdout: "event": "op_commit", 2023-08-01T19:54:32.953 INFO:teuthology.orchestra.run.smithi008.stdout: "time": "2023-08-01T19:54:28.998511+0000", 2023-08-01T19:54:32.953 INFO:teuthology.orchestra.run.smithi008.stdout: "duration": 0.00170397 2023-08-01T19:54:32.953 INFO:teuthology.orchestra.run.smithi008.stdout: }, 2023-08-01T19:54:32.953 INFO:teuthology.orchestra.run.smithi008.stdout: { 2023-08-01T19:54:32.954 INFO:teuthology.orchestra.run.smithi008.stdout: "event": "sub_op_commit_rec", 2023-08-01T19:54:32.954 INFO:teuthology.orchestra.run.smithi008.stdout: "time": "2023-08-01T19:54:29.011698+0000", 2023-08-01T19:54:32.954 INFO:teuthology.orchestra.run.smithi008.stdout: "duration": 0.013186959 2023-08-01T19:54:32.954 INFO:teuthology.orchestra.run.smithi008.stdout: }, 2023-08-01T19:54:32.954 INFO:teuthology.orchestra.run.smithi008.stdout: { 2023-08-01T19:54:32.954 INFO:teuthology.orchestra.run.smithi008.stdout: "event": "commit_sent", 2023-08-01T19:54:32.954 INFO:teuthology.orchestra.run.smithi008.stdout: "time": "2023-08-01T19:54:29.011729+0000", 2023-08-01T19:54:32.954 INFO:teuthology.orchestra.run.smithi008.stdout: "duration": 3.044e-05 2023-08-01T19:54:32.955 INFO:teuthology.orchestra.run.smithi008.stdout: }, 2023-08-01T19:54:32.955 INFO:teuthology.orchestra.run.smithi008.stdout: { 2023-08-01T19:54:32.955 INFO:teuthology.orchestra.run.smithi008.stdout: "event": "done", 2023-08-01T19:54:32.955 INFO:teuthology.orchestra.run.smithi008.stdout: "time": "2023-08-01T19:54:29.011755+0000", 2023-08-01T19:54:32.955 INFO:teuthology.orchestra.run.smithi008.stdout: "duration": 2.6165000000000001e-05 2023-08-01T19:54:32.955 INFO:teuthology.orchestra.run.smithi008.stdout: } 2023-08-01T19:54:32.955 INFO:teuthology.orchestra.run.smithi008.stdout: ] 2023-08-01T19:54:32.955 INFO:teuthology.orchestra.run.smithi008.stdout: } 2023-08-01T19:54:32.956 INFO:teuthology.orchestra.run.smithi008.stdout: }, 2023-08-01T19:54:32.956 INFO:teuthology.orchestra.run.smithi008.stdout: { 2023-08-01T19:54:32.956 INFO:teuthology.orchestra.run.smithi008.stdout: "description": "osd_op(client.4668.0:18368 5.5 5:ac90765d:::benchmark_data_smithi006_114134_object18367:head [set-alloc-hint object_size 65536 write_size 65536,write 0~65536] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e23)", 2023-08-01T19:54:32.956 INFO:teuthology.orchestra.run.smithi008.stdout: "initiated_at": "2023-08-01T19:54:28.996987+0000", 2023-08-01T19:54:32.956 INFO:teuthology.orchestra.run.smithi008.stdout: "age": 3.835248021, 2023-08-01T19:54:32.956 INFO:teuthology.orchestra.run.smithi008.stdout: "duration": 0.014851731999999999, 2023-08-01T19:54:32.956 INFO:teuthology.orchestra.run.smithi008.stdout: "type_data": { 2023-08-01T19:54:32.956 INFO:teuthology.orchestra.run.smithi008.stdout: "flag_point": "commit sent; apply or cleanup", 2023-08-01T19:54:32.957 INFO:teuthology.orchestra.run.smithi008.stdout: "client_info": { 2023-08-01T19:54:32.957 INFO:teuthology.orchestra.run.smithi008.stdout: "client": "client.4668", 2023-08-01T19:54:32.957 INFO:teuthology.orchestra.run.smithi008.stdout: "client_addr": "172.21.15.6:0/1709472247", 2023-08-01T19:54:32.957 INFO:teuthology.orchestra.run.smithi008.stdout: "tid": 18368 2023-08-01T19:54:32.957 INFO:teuthology.orchestra.run.smithi008.stdout: }, 2023-08-01T19:54:32.957 INFO:teuthology.orchestra.run.smithi008.stdout: "events": [ 2023-08-01T19:54:32.957 INFO:teuthology.orchestra.run.smithi008.stdout: { 2023-08-01T19:54:32.957 INFO:teuthology.orchestra.run.smithi008.stdout: "event": "initiated", 2023-08-01T19:54:32.958 INFO:teuthology.orchestra.run.smithi008.stdout: "time": "2023-08-01T19:54:28.996987+0000", 2023-08-01T19:54:32.958 INFO:teuthology.orchestra.run.smithi008.stdout: "duration": 0 2023-08-01T19:54:32.958 INFO:teuthology.orchestra.run.smithi008.stdout: }, 2023-08-01T19:54:32.958 INFO:teuthology.orchestra.run.smithi008.stdout: { 2023-08-01T19:54:32.958 INFO:teuthology.orchestra.run.smithi008.stdout: "event": "throttled", 2023-08-01T19:54:32.958 INFO:teuthology.orchestra.run.smithi008.stdout: "time": "2023-08-01T19:54:28.996987+0000", 2023-08-01T19:54:32.958 INFO:teuthology.orchestra.run.smithi008.stdout: "duration": 0 2023-08-01T19:54:32.958 INFO:teuthology.orchestra.run.smithi008.stdout: }, 2023-08-01T19:54:32.959 INFO:teuthology.orchestra.run.smithi008.stdout: { 2023-08-01T19:54:32.959 INFO:teuthology.orchestra.run.smithi008.stdout: "event": "header_read", 2023-08-01T19:54:32.959 INFO:teuthology.orchestra.run.smithi008.stdout: "time": "2023-08-01T19:54:28.996986+0000", 2023-08-01T19:54:32.959 INFO:teuthology.orchestra.run.smithi008.stdout: "duration": 4294967295.999999 2023-08-01T19:54:32.959 INFO:teuthology.orchestra.run.smithi008.stdout: }, 2023-08-01T19:54:32.959 INFO:teuthology.orchestra.run.smithi008.stdout: { 2023-08-01T19:54:32.959 INFO:teuthology.orchestra.run.smithi008.stdout: "event": "all_read", 2023-08-01T19:54:32.959 INFO:teuthology.orchestra.run.smithi008.stdout: "time": "2023-08-01T19:54:28.997061+0000", 2023-08-01T19:54:32.960 INFO:teuthology.orchestra.run.smithi008.stdout: "duration": 7.4849000000000001e-05 2023-08-01T19:54:32.960 INFO:teuthology.orchestra.run.smithi008.stdout: }, 2023-08-01T19:54:32.960 INFO:teuthology.orchestra.run.smithi008.stdout: { 2023-08-01T19:54:32.960 INFO:teuthology.orchestra.run.smithi008.stdout: "event": "dispatched", 2023-08-01T19:54:32.960 INFO:teuthology.orchestra.run.smithi008.stdout: "time": "2023-08-01T19:54:28.997070+0000", 2023-08-01T19:54:32.960 INFO:teuthology.orchestra.run.smithi008.stdout: "duration": 8.7499999999999992e-06 2023-08-01T19:54:32.960 INFO:teuthology.orchestra.run.smithi008.stdout: }, 2023-08-01T19:54:32.961 INFO:teuthology.orchestra.run.smithi008.stdout: { 2023-08-01T19:54:32.961 INFO:teuthology.orchestra.run.smithi008.stdout: "event": "queued_for_pg", 2023-08-01T19:54:32.961 INFO:teuthology.orchestra.run.smithi008.stdout: "time": "2023-08-01T19:54:28.997076+0000", 2023-08-01T19:54:32.961 INFO:teuthology.orchestra.run.smithi008.stdout: "duration": 6.0510000000000002e-06 2023-08-01T19:54:32.961 INFO:teuthology.orchestra.run.smithi008.stdout: }, 2023-08-01T19:54:32.961 INFO:teuthology.orchestra.run.smithi008.stdout: { 2023-08-01T19:54:32.961 INFO:teuthology.orchestra.run.smithi008.stdout: "event": "reached_pg", 2023-08-01T19:54:32.961 INFO:teuthology.orchestra.run.smithi008.stdout: "time": "2023-08-01T19:54:28.997512+0000", 2023-08-01T19:54:32.962 INFO:teuthology.orchestra.run.smithi008.stdout: "duration": 0.00043637299999999999 2023-08-01T19:54:32.962 INFO:teuthology.orchestra.run.smithi008.stdout: }, 2023-08-01T19:54:32.962 INFO:teuthology.orchestra.run.smithi008.stdout: { 2023-08-01T19:54:32.962 INFO:teuthology.orchestra.run.smithi008.stdout: "event": "started", 2023-08-01T19:54:32.962 INFO:teuthology.orchestra.run.smithi008.stdout: "time": "2023-08-01T19:54:28.997634+0000", 2023-08-01T19:54:32.963 INFO:teuthology.orchestra.run.smithi008.stdout: "duration": 0.00012162100000000001 2023-08-01T19:54:32.963 INFO:teuthology.orchestra.run.smithi008.stdout: }, 2023-08-01T19:54:32.963 INFO:teuthology.orchestra.run.smithi008.stdout: { 2023-08-01T19:54:32.963 INFO:teuthology.orchestra.run.smithi008.stdout: "event": "waiting for subops from 1", 2023-08-01T19:54:32.963 INFO:teuthology.orchestra.run.smithi008.stdout: "time": "2023-08-01T19:54:28.997792+0000", 2023-08-01T19:54:32.963 INFO:teuthology.orchestra.run.smithi008.stdout: "duration": 0.00015851600000000001 2023-08-01T19:54:32.963 INFO:teuthology.orchestra.run.smithi008.stdout: }, 2023-08-01T19:54:32.963 INFO:teuthology.orchestra.run.smithi008.stdout: { 2023-08-01T19:54:32.964 INFO:teuthology.orchestra.run.smithi008.stdout: "event": "op_commit", 2023-08-01T19:54:32.964 INFO:teuthology.orchestra.run.smithi008.stdout: "time": "2023-08-01T19:54:28.999634+0000", 2023-08-01T19:54:32.964 INFO:teuthology.orchestra.run.smithi008.stdout: "duration": 0.001841046 2023-08-01T19:54:32.964 INFO:teuthology.orchestra.run.smithi008.stdout: }, 2023-08-01T19:54:32.964 INFO:teuthology.orchestra.run.smithi008.stdout: { 2023-08-01T19:54:32.964 INFO:teuthology.orchestra.run.smithi008.stdout: "event": "sub_op_commit_rec", 2023-08-01T19:54:32.964 INFO:teuthology.orchestra.run.smithi008.stdout: "time": "2023-08-01T19:54:29.011789+0000", 2023-08-01T19:54:32.965 INFO:teuthology.orchestra.run.smithi008.stdout: "duration": 0.012155011 2023-08-01T19:54:32.965 INFO:teuthology.orchestra.run.smithi008.stdout: }, 2023-08-01T19:54:32.965 INFO:teuthology.orchestra.run.smithi008.stdout: { 2023-08-01T19:54:32.965 INFO:teuthology.orchestra.run.smithi008.stdout: "event": "commit_sent", 2023-08-01T19:54:32.965 INFO:teuthology.orchestra.run.smithi008.stdout: "time": "2023-08-01T19:54:29.011818+0000", 2023-08-01T19:54:32.965 INFO:teuthology.orchestra.run.smithi008.stdout: "duration": 2.9152000000000001e-05 2023-08-01T19:54:32.965 INFO:teuthology.orchestra.run.smithi008.stdout: }, 2023-08-01T19:54:32.965 INFO:teuthology.orchestra.run.smithi008.stdout: { 2023-08-01T19:54:32.966 INFO:teuthology.orchestra.run.smithi008.stdout: "event": "done", 2023-08-01T19:54:32.966 INFO:teuthology.orchestra.run.smithi008.stdout: "time": "2023-08-01T19:54:29.011839+0000", 2023-08-01T19:54:32.966 INFO:teuthology.orchestra.run.smithi008.stdout: "duration": 2.1132999999999999e-05 2023-08-01T19:54:32.966 INFO:teuthology.orchestra.run.smithi008.stdout: } 2023-08-01T19:54:32.966 INFO:teuthology.orchestra.run.smithi008.stdout: ] 2023-08-01T19:54:32.966 INFO:teuthology.orchestra.run.smithi008.stdout: } 2023-08-01T19:54:32.966 INFO:teuthology.orchestra.run.smithi008.stdout: }, 2023-08-01T19:54:32.966 INFO:teuthology.orchestra.run.smithi008.stdout: { 2023-08-01T19:54:32.967 INFO:teuthology.orchestra.run.smithi008.stdout: "description": "osd_op(client.4668.0:18369 5.3 5:c557c7d0:::benchmark_data_smithi006_114134_object18368:head [set-alloc-hint object_size 65536 write_size 65536,write 0~65536] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e23)", 2023-08-01T19:54:32.967 INFO:teuthology.orchestra.run.smithi008.stdout: "initiated_at": "2023-08-01T19:54:28.997782+0000", 2023-08-01T19:54:32.967 INFO:teuthology.orchestra.run.smithi008.stdout: "age": 3.8344530470000002, 2023-08-01T19:54:32.967 INFO:teuthology.orchestra.run.smithi008.stdout: "duration": 0.013982608000000001, 2023-08-01T19:54:32.967 INFO:teuthology.orchestra.run.smithi008.stdout: "type_data": { 2023-08-01T19:54:32.967 INFO:teuthology.orchestra.run.smithi008.stdout: "flag_point": "commit sent; apply or cleanup", 2023-08-01T19:54:32.967 INFO:teuthology.orchestra.run.smithi008.stdout: "client_info": { 2023-08-01T19:54:32.968 INFO:teuthology.orchestra.run.smithi008.stdout: "client": "client.4668", 2023-08-01T19:54:32.968 INFO:teuthology.orchestra.run.smithi008.stdout: "client_addr": "172.21.15.6:0/1709472247", 2023-08-01T19:54:32.968 INFO:teuthology.orchestra.run.smithi008.stdout: "tid": 18369 2023-08-01T19:54:32.968 INFO:teuthology.orchestra.run.smithi008.stdout: }, 2023-08-01T19:54:32.968 INFO:teuthology.orchestra.run.smithi008.stdout: "events": [ 2023-08-01T19:54:32.968 INFO:teuthology.orchestra.run.smithi008.stdout: { 2023-08-01T19:54:32.968 INFO:teuthology.orchestra.run.smithi008.stdout: "event": "initiated", 2023-08-01T19:54:32.968 INFO:teuthology.orchestra.run.smithi008.stdout: "time": "2023-08-01T19:54:28.997782+0000", 2023-08-01T19:54:32.969 INFO:teuthology.orchestra.run.smithi008.stdout: "duration": 0 2023-08-01T19:54:32.969 INFO:teuthology.orchestra.run.smithi008.stdout: }, 2023-08-01T19:54:32.969 INFO:teuthology.orchestra.run.smithi008.stdout: { 2023-08-01T19:54:32.969 INFO:teuthology.orchestra.run.smithi008.stdout: "event": "throttled", 2023-08-01T19:54:32.969 INFO:teuthology.orchestra.run.smithi008.stdout: "time": "2023-08-01T19:54:28.997782+0000", 2023-08-01T19:54:32.969 INFO:teuthology.orchestra.run.smithi008.stdout: "duration": 0 2023-08-01T19:54:32.969 INFO:teuthology.orchestra.run.smithi008.stdout: }, 2023-08-01T19:54:32.970 INFO:teuthology.orchestra.run.smithi008.stdout: { 2023-08-01T19:54:32.970 INFO:teuthology.orchestra.run.smithi008.stdout: "event": "header_read", 2023-08-01T19:54:32.970 INFO:teuthology.orchestra.run.smithi008.stdout: "time": "2023-08-01T19:54:28.997781+0000", 2023-08-01T19:54:32.970 INFO:teuthology.orchestra.run.smithi008.stdout: "duration": 4294967295.9999995 2023-08-01T19:54:32.970 INFO:teuthology.orchestra.run.smithi008.stdout: }, 2023-08-01T19:54:32.970 INFO:teuthology.orchestra.run.smithi008.stdout: { 2023-08-01T19:54:32.970 INFO:teuthology.orchestra.run.smithi008.stdout: "event": "all_read", 2023-08-01T19:54:32.970 INFO:teuthology.orchestra.run.smithi008.stdout: "time": "2023-08-01T19:54:28.997859+0000", 2023-08-01T19:54:32.971 INFO:teuthology.orchestra.run.smithi008.stdout: "duration": 7.7420000000000001e-05 2023-08-01T19:54:32.971 INFO:teuthology.orchestra.run.smithi008.stdout: }, 2023-08-01T19:54:32.971 INFO:teuthology.orchestra.run.smithi008.stdout: { 2023-08-01T19:54:32.971 INFO:teuthology.orchestra.run.smithi008.stdout: "event": "dispatched", 2023-08-01T19:54:32.971 INFO:teuthology.orchestra.run.smithi008.stdout: "time": "2023-08-01T19:54:28.997866+0000", 2023-08-01T19:54:32.971 INFO:teuthology.orchestra.run.smithi008.stdout: "duration": 7.2910000000000002e-06 2023-08-01T19:54:32.971 INFO:teuthology.orchestra.run.smithi008.stdout: }, 2023-08-01T19:54:32.972 INFO:teuthology.orchestra.run.smithi008.stdout: { 2023-08-01T19:54:32.972 INFO:teuthology.orchestra.run.smithi008.stdout: "event": "queued_for_pg", 2023-08-01T19:54:32.972 INFO:teuthology.orchestra.run.smithi008.stdout: "time": "2023-08-01T19:54:28.997872+0000", 2023-08-01T19:54:32.972 INFO:teuthology.orchestra.run.smithi008.stdout: "duration": 6.0460000000000002e-06 2023-08-01T19:54:32.972 INFO:teuthology.orchestra.run.smithi008.stdout: }, 2023-08-01T19:54:32.972 INFO:teuthology.orchestra.run.smithi008.stdout: { 2023-08-01T19:54:32.972 INFO:teuthology.orchestra.run.smithi008.stdout: "event": "reached_pg", 2023-08-01T19:54:32.972 INFO:teuthology.orchestra.run.smithi008.stdout: "time": "2023-08-01T19:54:28.997931+0000", 2023-08-01T19:54:32.973 INFO:teuthology.orchestra.run.smithi008.stdout: "duration": 5.8692e-05 2023-08-01T19:54:32.973 INFO:teuthology.orchestra.run.smithi008.stdout: }, 2023-08-01T19:54:32.973 INFO:teuthology.orchestra.run.smithi008.stdout: { 2023-08-01T19:54:32.973 INFO:teuthology.orchestra.run.smithi008.stdout: "event": "started", 2023-08-01T19:54:32.973 INFO:teuthology.orchestra.run.smithi008.stdout: "time": "2023-08-01T19:54:28.998082+0000", 2023-08-01T19:54:32.973 INFO:teuthology.orchestra.run.smithi008.stdout: "duration": 0.000151438 2023-08-01T19:54:32.973 INFO:teuthology.orchestra.run.smithi008.stdout: }, 2023-08-01T19:54:32.973 INFO:teuthology.orchestra.run.smithi008.stdout: { 2023-08-01T19:54:32.974 INFO:teuthology.orchestra.run.smithi008.stdout: "event": "waiting for subops from 1", 2023-08-01T19:54:32.974 INFO:teuthology.orchestra.run.smithi008.stdout: "time": "2023-08-01T19:54:28.998216+0000", 2023-08-01T19:54:32.974 INFO:teuthology.orchestra.run.smithi008.stdout: "duration": 0.00013328099999999999 2023-08-01T19:54:32.974 INFO:teuthology.orchestra.run.smithi008.stdout: }, 2023-08-01T19:54:32.974 INFO:teuthology.orchestra.run.smithi008.stdout: { 2023-08-01T19:54:32.974 INFO:teuthology.orchestra.run.smithi008.stdout: "event": "op_commit", 2023-08-01T19:54:32.974 INFO:teuthology.orchestra.run.smithi008.stdout: "time": "2023-08-01T19:54:29.000045+0000", 2023-08-01T19:54:32.975 INFO:teuthology.orchestra.run.smithi008.stdout: "duration": 0.001829231 2023-08-01T19:54:32.975 INFO:teuthology.orchestra.run.smithi008.stdout: }, 2023-08-01T19:54:32.975 INFO:teuthology.orchestra.run.smithi008.stdout: { 2023-08-01T19:54:32.975 INFO:teuthology.orchestra.run.smithi008.stdout: "event": "sub_op_commit_rec", 2023-08-01T19:54:32.975 INFO:teuthology.orchestra.run.smithi008.stdout: "time": "2023-08-01T19:54:29.011719+0000", 2023-08-01T19:54:32.975 INFO:teuthology.orchestra.run.smithi008.stdout: "duration": 0.011673817 2023-08-01T19:54:32.975 INFO:teuthology.orchestra.run.smithi008.stdout: }, 2023-08-01T19:54:32.975 INFO:teuthology.orchestra.run.smithi008.stdout: { 2023-08-01T19:54:32.976 INFO:teuthology.orchestra.run.smithi008.stdout: "event": "commit_sent", 2023-08-01T19:54:32.976 INFO:teuthology.orchestra.run.smithi008.stdout: "time": "2023-08-01T19:54:29.011743+0000", 2023-08-01T19:54:32.976 INFO:teuthology.orchestra.run.smithi008.stdout: "duration": 2.4663000000000001e-05 2023-08-01T19:54:32.976 INFO:teuthology.orchestra.run.smithi008.stdout: }, 2023-08-01T19:54:32.976 INFO:teuthology.orchestra.run.smithi008.stdout: { 2023-08-01T19:54:32.976 INFO:teuthology.orchestra.run.smithi008.stdout: "event": "done", 2023-08-01T19:54:32.976 INFO:teuthology.orchestra.run.smithi008.stdout: "time": "2023-08-01T19:54:29.011765+0000", 2023-08-01T19:54:32.976 INFO:teuthology.orchestra.run.smithi008.stdout: "duration": 2.1410999999999999e-05 2023-08-01T19:54:32.977 INFO:teuthology.orchestra.run.smithi008.stdout: } 2023-08-01T19:54:32.977 INFO:teuthology.orchestra.run.smithi008.stdout: ] 2023-08-01T19:54:32.977 INFO:teuthology.orchestra.run.smithi008.stdout: } 2023-08-01T19:54:32.977 INFO:teuthology.orchestra.run.smithi008.stdout: }, 2023-08-01T19:54:32.977 INFO:teuthology.orchestra.run.smithi008.stdout: { 2023-08-01T19:54:32.977 INFO:teuthology.orchestra.run.smithi008.stdout: "description": "osd_op(client.4668.0:18378 5.6 5:6e76184f:::benchmark_data_smithi006_114134_object18377:head [set-alloc-hint object_size 65536 write_size 65536,write 0~65536] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e23)", 2023-08-01T19:54:32.977 INFO:teuthology.orchestra.run.smithi008.stdout: "initiated_at": "2023-08-01T19:54:29.001000+0000", 2023-08-01T19:54:32.977 INFO:teuthology.orchestra.run.smithi008.stdout: "age": 3.8312351119999999, 2023-08-01T19:54:32.978 INFO:teuthology.orchestra.run.smithi008.stdout: "duration": 0.011258522999999999, 2023-08-01T19:54:32.978 INFO:teuthology.orchestra.run.smithi008.stdout: "type_data": { 2023-08-01T19:54:32.978 INFO:teuthology.orchestra.run.smithi008.stdout: "flag_point": "commit sent; apply or cleanup", 2023-08-01T19:54:32.978 INFO:teuthology.orchestra.run.smithi008.stdout: "client_info": { 2023-08-01T19:54:32.978 INFO:teuthology.orchestra.run.smithi008.stdout: "client": "client.4668", 2023-08-01T19:54:32.978 INFO:teuthology.orchestra.run.smithi008.stdout: "client_addr": "172.21.15.6:0/1709472247", 2023-08-01T19:54:32.978 INFO:teuthology.orchestra.run.smithi008.stdout: "tid": 18378 2023-08-01T19:54:32.978 INFO:teuthology.orchestra.run.smithi008.stdout: }, 2023-08-01T19:54:32.979 INFO:teuthology.orchestra.run.smithi008.stdout: "events": [ 2023-08-01T19:54:32.979 INFO:teuthology.orchestra.run.smithi008.stdout: { 2023-08-01T19:54:32.979 INFO:teuthology.orchestra.run.smithi008.stdout: "event": "initiated", 2023-08-01T19:54:32.979 INFO:teuthology.orchestra.run.smithi008.stdout: "time": "2023-08-01T19:54:29.001000+0000", 2023-08-01T19:54:32.979 INFO:teuthology.orchestra.run.smithi008.stdout: "duration": 0 2023-08-01T19:54:32.979 INFO:teuthology.orchestra.run.smithi008.stdout: }, 2023-08-01T19:54:32.979 INFO:teuthology.orchestra.run.smithi008.stdout: { 2023-08-01T19:54:32.979 INFO:teuthology.orchestra.run.smithi008.stdout: "event": "throttled", 2023-08-01T19:54:32.980 INFO:teuthology.orchestra.run.smithi008.stdout: "time": "2023-08-01T19:54:29.001000+0000", 2023-08-01T19:54:32.980 INFO:teuthology.orchestra.run.smithi008.stdout: "duration": 0 2023-08-01T19:54:32.980 INFO:teuthology.orchestra.run.smithi008.stdout: }, 2023-08-01T19:54:32.980 INFO:teuthology.orchestra.run.smithi008.stdout: { 2023-08-01T19:54:32.980 INFO:teuthology.orchestra.run.smithi008.stdout: "event": "header_read", 2023-08-01T19:54:32.980 INFO:teuthology.orchestra.run.smithi008.stdout: "time": "2023-08-01T19:54:29.000999+0000", 2023-08-01T19:54:32.980 INFO:teuthology.orchestra.run.smithi008.stdout: "duration": 4294967295.999999 2023-08-01T19:54:32.981 INFO:teuthology.orchestra.run.smithi008.stdout: }, 2023-08-01T19:54:32.981 INFO:teuthology.orchestra.run.smithi008.stdout: { 2023-08-01T19:54:32.981 INFO:teuthology.orchestra.run.smithi008.stdout: "event": "all_read", 2023-08-01T19:54:32.981 INFO:teuthology.orchestra.run.smithi008.stdout: "time": "2023-08-01T19:54:29.001060+0000", 2023-08-01T19:54:32.981 INFO:teuthology.orchestra.run.smithi008.stdout: "duration": 6.0866999999999998e-05 2023-08-01T19:54:32.981 INFO:teuthology.orchestra.run.smithi008.stdout: }, 2023-08-01T19:54:32.981 INFO:teuthology.orchestra.run.smithi008.stdout: { 2023-08-01T19:54:32.981 INFO:teuthology.orchestra.run.smithi008.stdout: "event": "dispatched", 2023-08-01T19:54:32.982 INFO:teuthology.orchestra.run.smithi008.stdout: "time": "2023-08-01T19:54:29.001069+0000", 2023-08-01T19:54:32.982 INFO:teuthology.orchestra.run.smithi008.stdout: "duration": 8.5799999999999992e-06 2023-08-01T19:54:32.982 INFO:teuthology.orchestra.run.smithi008.stdout: }, 2023-08-01T19:54:32.982 INFO:teuthology.orchestra.run.smithi008.stdout: { 2023-08-01T19:54:32.982 INFO:teuthology.orchestra.run.smithi008.stdout: "event": "queued_for_pg", 2023-08-01T19:54:32.982 INFO:teuthology.orchestra.run.smithi008.stdout: "time": "2023-08-01T19:54:29.001073+0000", 2023-08-01T19:54:32.982 INFO:teuthology.orchestra.run.smithi008.stdout: "duration": 4.279e-06 2023-08-01T19:54:32.982 INFO:teuthology.orchestra.run.smithi008.stdout: }, 2023-08-01T19:54:32.983 INFO:teuthology.orchestra.run.smithi008.stdout: { 2023-08-01T19:54:32.983 INFO:teuthology.orchestra.run.smithi008.stdout: "event": "reached_pg", 2023-08-01T19:54:32.983 INFO:teuthology.orchestra.run.smithi008.stdout: "time": "2023-08-01T19:54:29.001115+0000", 2023-08-01T19:54:32.983 INFO:teuthology.orchestra.run.smithi008.stdout: "duration": 4.1918000000000001e-05 2023-08-01T19:54:32.983 INFO:teuthology.orchestra.run.smithi008.stdout: }, 2023-08-01T19:54:32.983 INFO:teuthology.orchestra.run.smithi008.stdout: { 2023-08-01T19:54:32.983 INFO:teuthology.orchestra.run.smithi008.stdout: "event": "started", 2023-08-01T19:54:32.983 INFO:teuthology.orchestra.run.smithi008.stdout: "time": "2023-08-01T19:54:29.001256+0000", 2023-08-01T19:54:32.984 INFO:teuthology.orchestra.run.smithi008.stdout: "duration": 0.000140844 2023-08-01T19:54:32.984 INFO:teuthology.orchestra.run.smithi008.stdout: }, 2023-08-01T19:54:32.984 INFO:teuthology.orchestra.run.smithi008.stdout: { 2023-08-01T19:54:32.984 INFO:teuthology.orchestra.run.smithi008.stdout: "event": "waiting for subops from 1", 2023-08-01T19:54:32.984 INFO:teuthology.orchestra.run.smithi008.stdout: "time": "2023-08-01T19:54:29.001410+0000", 2023-08-01T19:54:32.984 INFO:teuthology.orchestra.run.smithi008.stdout: "duration": 0.000154377 2023-08-01T19:54:32.984 INFO:teuthology.orchestra.run.smithi008.stdout: }, 2023-08-01T19:54:32.984 INFO:teuthology.orchestra.run.smithi008.stdout: { 2023-08-01T19:54:32.985 INFO:teuthology.orchestra.run.smithi008.stdout: "event": "op_commit", 2023-08-01T19:54:32.985 INFO:teuthology.orchestra.run.smithi008.stdout: "time": "2023-08-01T19:54:29.002950+0000", 2023-08-01T19:54:32.985 INFO:teuthology.orchestra.run.smithi008.stdout: "duration": 0.001540004 2023-08-01T19:54:32.985 INFO:teuthology.orchestra.run.smithi008.stdout: }, 2023-08-01T19:54:32.985 INFO:teuthology.orchestra.run.smithi008.stdout: { 2023-08-01T19:54:32.985 INFO:teuthology.orchestra.run.smithi008.stdout: "event": "sub_op_commit_rec", 2023-08-01T19:54:32.985 INFO:teuthology.orchestra.run.smithi008.stdout: "time": "2023-08-01T19:54:29.012186+0000", 2023-08-01T19:54:32.986 INFO:teuthology.orchestra.run.smithi008.stdout: "duration": 0.0092363289999999997 2023-08-01T19:54:32.986 INFO:teuthology.orchestra.run.smithi008.stdout: }, 2023-08-01T19:54:32.986 INFO:teuthology.orchestra.run.smithi008.stdout: { 2023-08-01T19:54:32.986 INFO:teuthology.orchestra.run.smithi008.stdout: "event": "commit_sent", 2023-08-01T19:54:32.986 INFO:teuthology.orchestra.run.smithi008.stdout: "time": "2023-08-01T19:54:29.012220+0000", 2023-08-01T19:54:32.986 INFO:teuthology.orchestra.run.smithi008.stdout: "duration": 3.3682e-05 2023-08-01T19:54:32.986 INFO:teuthology.orchestra.run.smithi008.stdout: }, 2023-08-01T19:54:32.986 INFO:teuthology.orchestra.run.smithi008.stdout: { 2023-08-01T19:54:32.987 INFO:teuthology.orchestra.run.smithi008.stdout: "event": "done", 2023-08-01T19:54:32.987 INFO:teuthology.orchestra.run.smithi008.stdout: "time": "2023-08-01T19:54:29.012258+0000", 2023-08-01T19:54:32.987 INFO:teuthology.orchestra.run.smithi008.stdout: "duration": 3.8393999999999999e-05 2023-08-01T19:54:32.987 INFO:teuthology.orchestra.run.smithi008.stdout: } 2023-08-01T19:54:32.987 INFO:teuthology.orchestra.run.smithi008.stdout: ] 2023-08-01T19:54:32.987 INFO:teuthology.orchestra.run.smithi008.stdout: } 2023-08-01T19:54:32.987 INFO:teuthology.orchestra.run.smithi008.stdout: }, 2023-08-01T19:54:32.987 INFO:teuthology.orchestra.run.smithi008.stdout: { 2023-08-01T19:54:32.988 INFO:teuthology.orchestra.run.smithi008.stdout: "description": "osd_op(client.4668.0:19949 5.a 5:5214d73c:::benchmark_data_smithi006_114134_object19948:head [set-alloc-hint object_size 65536 write_size 65536,write 0~65536] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e23)", 2023-08-01T19:54:32.988 INFO:teuthology.orchestra.run.smithi008.stdout: "initiated_at": "2023-08-01T19:54:29.472760+0000", 2023-08-01T19:54:32.988 INFO:teuthology.orchestra.run.smithi008.stdout: "age": 3.3594747659999999, 2023-08-01T19:54:32.988 INFO:teuthology.orchestra.run.smithi008.stdout: "duration": 0.012313249, 2023-08-01T19:54:32.988 INFO:teuthology.orchestra.run.smithi008.stdout: "type_data": { 2023-08-01T19:54:32.988 INFO:teuthology.orchestra.run.smithi008.stdout: "flag_point": "commit sent; apply or cleanup", 2023-08-01T19:54:32.988 INFO:teuthology.orchestra.run.smithi008.stdout: "client_info": { 2023-08-01T19:54:32.989 INFO:teuthology.orchestra.run.smithi008.stdout: "client": "client.4668", 2023-08-01T19:54:32.989 INFO:teuthology.orchestra.run.smithi008.stdout: "client_addr": "172.21.15.6:0/1709472247", 2023-08-01T19:54:32.989 INFO:teuthology.orchestra.run.smithi008.stdout: "tid": 19949 2023-08-01T19:54:32.989 INFO:teuthology.orchestra.run.smithi008.stdout: }, 2023-08-01T19:54:32.989 INFO:teuthology.orchestra.run.smithi008.stdout: "events": [ 2023-08-01T19:54:32.989 INFO:teuthology.orchestra.run.smithi008.stdout: { 2023-08-01T19:54:32.989 INFO:teuthology.orchestra.run.smithi008.stdout: "event": "initiated", 2023-08-01T19:54:32.989 INFO:teuthology.orchestra.run.smithi008.stdout: "time": "2023-08-01T19:54:29.472760+0000", 2023-08-01T19:54:32.990 INFO:teuthology.orchestra.run.smithi008.stdout: "duration": 0 2023-08-01T19:54:32.990 INFO:teuthology.orchestra.run.smithi008.stdout: }, 2023-08-01T19:54:32.990 INFO:teuthology.orchestra.run.smithi008.stdout: { 2023-08-01T19:54:32.990 INFO:teuthology.orchestra.run.smithi008.stdout: "event": "throttled", 2023-08-01T19:54:32.990 INFO:teuthology.orchestra.run.smithi008.stdout: "time": "2023-08-01T19:54:29.472760+0000", 2023-08-01T19:54:32.990 INFO:teuthology.orchestra.run.smithi008.stdout: "duration": 0 2023-08-01T19:54:32.990 INFO:teuthology.orchestra.run.smithi008.stdout: }, 2023-08-01T19:54:32.990 INFO:teuthology.orchestra.run.smithi008.stdout: { 2023-08-01T19:54:32.991 INFO:teuthology.orchestra.run.smithi008.stdout: "event": "header_read", 2023-08-01T19:54:32.991 INFO:teuthology.orchestra.run.smithi008.stdout: "time": "2023-08-01T19:54:29.472759+0000", 2023-08-01T19:54:32.991 INFO:teuthology.orchestra.run.smithi008.stdout: "duration": 4294967295.999999 2023-08-01T19:54:32.991 INFO:teuthology.orchestra.run.smithi008.stdout: }, 2023-08-01T19:54:32.991 INFO:teuthology.orchestra.run.smithi008.stdout: { 2023-08-01T19:54:32.991 INFO:teuthology.orchestra.run.smithi008.stdout: "event": "all_read", 2023-08-01T19:54:32.991 INFO:teuthology.orchestra.run.smithi008.stdout: "time": "2023-08-01T19:54:29.472831+0000", 2023-08-01T19:54:32.991 INFO:teuthology.orchestra.run.smithi008.stdout: "duration": 7.1501000000000005e-05 2023-08-01T19:54:32.992 INFO:teuthology.orchestra.run.smithi008.stdout: }, 2023-08-01T19:54:32.992 INFO:teuthology.orchestra.run.smithi008.stdout: { 2023-08-01T19:54:32.992 INFO:teuthology.orchestra.run.smithi008.stdout: "event": "dispatched", 2023-08-01T19:54:32.992 INFO:teuthology.orchestra.run.smithi008.stdout: "time": "2023-08-01T19:54:29.472839+0000", 2023-08-01T19:54:32.992 INFO:teuthology.orchestra.run.smithi008.stdout: "duration": 8.2309999999999996e-06 2023-08-01T19:54:32.992 INFO:teuthology.orchestra.run.smithi008.stdout: }, 2023-08-01T19:54:32.992 INFO:teuthology.orchestra.run.smithi008.stdout: { 2023-08-01T19:54:32.992 INFO:teuthology.orchestra.run.smithi008.stdout: "event": "queued_for_pg", 2023-08-01T19:54:32.993 INFO:teuthology.orchestra.run.smithi008.stdout: "time": "2023-08-01T19:54:29.472843+0000", 2023-08-01T19:54:32.993 INFO:teuthology.orchestra.run.smithi008.stdout: "duration": 4.1969999999999998e-06 2023-08-01T19:54:32.993 INFO:teuthology.orchestra.run.smithi008.stdout: }, 2023-08-01T19:54:32.993 INFO:teuthology.orchestra.run.smithi008.stdout: { 2023-08-01T19:54:32.993 INFO:teuthology.orchestra.run.smithi008.stdout: "event": "reached_pg", 2023-08-01T19:54:32.993 INFO:teuthology.orchestra.run.smithi008.stdout: "time": "2023-08-01T19:54:29.472869+0000", 2023-08-01T19:54:32.993 INFO:teuthology.orchestra.run.smithi008.stdout: "duration": 2.5877e-05 2023-08-01T19:54:32.993 INFO:teuthology.orchestra.run.smithi008.stdout: }, 2023-08-01T19:54:32.994 INFO:teuthology.orchestra.run.smithi008.stdout: { 2023-08-01T19:54:32.994 INFO:teuthology.orchestra.run.smithi008.stdout: "event": "started", 2023-08-01T19:54:32.994 INFO:teuthology.orchestra.run.smithi008.stdout: "time": "2023-08-01T19:54:29.472945+0000", 2023-08-01T19:54:32.994 INFO:teuthology.orchestra.run.smithi008.stdout: "duration": 7.5741000000000005e-05 2023-08-01T19:54:32.994 INFO:teuthology.orchestra.run.smithi008.stdout: }, 2023-08-01T19:54:32.994 INFO:teuthology.orchestra.run.smithi008.stdout: { 2023-08-01T19:54:32.994 INFO:teuthology.orchestra.run.smithi008.stdout: "event": "waiting for subops from 2", 2023-08-01T19:54:32.994 INFO:teuthology.orchestra.run.smithi008.stdout: "time": "2023-08-01T19:54:29.473035+0000", 2023-08-01T19:54:32.995 INFO:teuthology.orchestra.run.smithi008.stdout: "duration": 8.9820000000000004e-05 2023-08-01T19:54:32.995 INFO:teuthology.orchestra.run.smithi008.stdout: }, 2023-08-01T19:54:32.995 INFO:teuthology.orchestra.run.smithi008.stdout: { 2023-08-01T19:54:32.995 INFO:teuthology.orchestra.run.smithi008.stdout: "event": "op_commit", 2023-08-01T19:54:32.995 INFO:teuthology.orchestra.run.smithi008.stdout: "time": "2023-08-01T19:54:29.475834+0000", 2023-08-01T19:54:32.995 INFO:teuthology.orchestra.run.smithi008.stdout: "duration": 0.0027993610000000002 2023-08-01T19:54:32.995 INFO:teuthology.orchestra.run.smithi008.stdout: }, 2023-08-01T19:54:32.996 INFO:teuthology.orchestra.run.smithi008.stdout: { 2023-08-01T19:54:32.996 INFO:teuthology.orchestra.run.smithi008.stdout: "event": "sub_op_commit_rec", 2023-08-01T19:54:32.996 INFO:teuthology.orchestra.run.smithi008.stdout: "time": "2023-08-01T19:54:29.484975+0000", 2023-08-01T19:54:32.996 INFO:teuthology.orchestra.run.smithi008.stdout: "duration": 0.0091408510000000002 2023-08-01T19:54:32.996 INFO:teuthology.orchestra.run.smithi008.stdout: }, 2023-08-01T19:54:32.996 INFO:teuthology.orchestra.run.smithi008.stdout: { 2023-08-01T19:54:32.996 INFO:teuthology.orchestra.run.smithi008.stdout: "event": "commit_sent", 2023-08-01T19:54:32.996 INFO:teuthology.orchestra.run.smithi008.stdout: "time": "2023-08-01T19:54:29.485036+0000", 2023-08-01T19:54:32.997 INFO:teuthology.orchestra.run.smithi008.stdout: "duration": 6.1049000000000005e-05 2023-08-01T19:54:32.997 INFO:teuthology.orchestra.run.smithi008.stdout: }, 2023-08-01T19:54:32.997 INFO:teuthology.orchestra.run.smithi008.stdout: { 2023-08-01T19:54:32.997 INFO:teuthology.orchestra.run.smithi008.stdout: "event": "done", 2023-08-01T19:54:32.997 INFO:teuthology.orchestra.run.smithi008.stdout: "time": "2023-08-01T19:54:29.485074+0000", 2023-08-01T19:54:32.997 INFO:teuthology.orchestra.run.smithi008.stdout: "duration": 3.7651000000000003e-05 2023-08-01T19:54:32.997 INFO:teuthology.orchestra.run.smithi008.stdout: } 2023-08-01T19:54:32.997 INFO:teuthology.orchestra.run.smithi008.stdout: ] 2023-08-01T19:54:32.998 INFO:teuthology.orchestra.run.smithi008.stdout: } 2023-08-01T19:54:32.998 INFO:teuthology.orchestra.run.smithi008.stdout: }, 2023-08-01T19:54:32.998 INFO:teuthology.orchestra.run.smithi008.stdout: { 2023-08-01T19:54:32.998 INFO:teuthology.orchestra.run.smithi008.stdout: "description": "osd_op(client.4668.0:20542 5.a 5:5df1a5a3:::benchmark_data_smithi006_114134_object20541:head [set-alloc-hint object_size 65536 write_size 65536,write 0~65536] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e23)", 2023-08-01T19:54:32.998 INFO:teuthology.orchestra.run.smithi008.stdout: "initiated_at": "2023-08-01T19:54:29.655236+0000", 2023-08-01T19:54:32.998 INFO:teuthology.orchestra.run.smithi008.stdout: "age": 3.1769995350000002, 2023-08-01T19:54:32.998 INFO:teuthology.orchestra.run.smithi008.stdout: "duration": 0.011823313, 2023-08-01T19:54:32.998 INFO:teuthology.orchestra.run.smithi008.stdout: "type_data": { 2023-08-01T19:54:32.999 INFO:teuthology.orchestra.run.smithi008.stdout: "flag_point": "commit sent; apply or cleanup", 2023-08-01T19:54:32.999 INFO:teuthology.orchestra.run.smithi008.stdout: "client_info": { 2023-08-01T19:54:32.999 INFO:teuthology.orchestra.run.smithi008.stdout: "client": "client.4668", 2023-08-01T19:54:32.999 INFO:teuthology.orchestra.run.smithi008.stdout: "client_addr": "172.21.15.6:0/1709472247", 2023-08-01T19:54:32.999 INFO:teuthology.orchestra.run.smithi008.stdout: "tid": 20542 2023-08-01T19:54:32.999 INFO:teuthology.orchestra.run.smithi008.stdout: }, 2023-08-01T19:54:32.999 INFO:teuthology.orchestra.run.smithi008.stdout: "events": [ 2023-08-01T19:54:32.999 INFO:teuthology.orchestra.run.smithi008.stdout: { 2023-08-01T19:54:33.000 INFO:teuthology.orchestra.run.smithi008.stdout: "event": "initiated", 2023-08-01T19:54:33.000 INFO:teuthology.orchestra.run.smithi008.stdout: "time": "2023-08-01T19:54:29.655236+0000", 2023-08-01T19:54:33.000 INFO:teuthology.orchestra.run.smithi008.stdout: "duration": 0 2023-08-01T19:54:33.000 INFO:teuthology.orchestra.run.smithi008.stdout: }, 2023-08-01T19:54:33.000 INFO:teuthology.orchestra.run.smithi008.stdout: { 2023-08-01T19:54:33.000 INFO:teuthology.orchestra.run.smithi008.stdout: "event": "throttled", 2023-08-01T19:54:33.000 INFO:teuthology.orchestra.run.smithi008.stdout: "time": "2023-08-01T19:54:29.655236+0000", 2023-08-01T19:54:33.000 INFO:teuthology.orchestra.run.smithi008.stdout: "duration": 0 2023-08-01T19:54:33.001 INFO:teuthology.orchestra.run.smithi008.stdout: }, 2023-08-01T19:54:33.001 INFO:teuthology.orchestra.run.smithi008.stdout: { 2023-08-01T19:54:33.001 INFO:teuthology.orchestra.run.smithi008.stdout: "event": "header_read", 2023-08-01T19:54:33.001 INFO:teuthology.orchestra.run.smithi008.stdout: "time": "2023-08-01T19:54:29.655235+0000", 2023-08-01T19:54:33.001 INFO:teuthology.orchestra.run.smithi008.stdout: "duration": 4294967295.999999 2023-08-01T19:54:33.001 INFO:teuthology.orchestra.run.smithi008.stdout: }, 2023-08-01T19:54:33.001 INFO:teuthology.orchestra.run.smithi008.stdout: { 2023-08-01T19:54:33.002 INFO:teuthology.orchestra.run.smithi008.stdout: "event": "all_read", 2023-08-01T19:54:33.002 INFO:teuthology.orchestra.run.smithi008.stdout: "time": "2023-08-01T19:54:29.655339+0000", 2023-08-01T19:54:33.002 INFO:teuthology.orchestra.run.smithi008.stdout: "duration": 0.00010440799999999999 2023-08-01T19:54:33.002 INFO:teuthology.orchestra.run.smithi008.stdout: }, 2023-08-01T19:54:33.002 INFO:teuthology.orchestra.run.smithi008.stdout: { 2023-08-01T19:54:33.002 INFO:teuthology.orchestra.run.smithi008.stdout: "event": "dispatched", 2023-08-01T19:54:33.002 INFO:teuthology.orchestra.run.smithi008.stdout: "time": "2023-08-01T19:54:29.655353+0000", 2023-08-01T19:54:33.002 INFO:teuthology.orchestra.run.smithi008.stdout: "duration": 1.3448000000000001e-05 2023-08-01T19:54:33.003 INFO:teuthology.orchestra.run.smithi008.stdout: }, 2023-08-01T19:54:33.003 INFO:teuthology.orchestra.run.smithi008.stdout: { 2023-08-01T19:54:33.003 INFO:teuthology.orchestra.run.smithi008.stdout: "event": "queued_for_pg", 2023-08-01T19:54:33.003 INFO:teuthology.orchestra.run.smithi008.stdout: "time": "2023-08-01T19:54:29.655358+0000", 2023-08-01T19:54:33.003 INFO:teuthology.orchestra.run.smithi008.stdout: "duration": 5.4949999999999999e-06 2023-08-01T19:54:33.003 INFO:teuthology.orchestra.run.smithi008.stdout: }, 2023-08-01T19:54:33.003 INFO:teuthology.orchestra.run.smithi008.stdout: { 2023-08-01T19:54:33.003 INFO:teuthology.orchestra.run.smithi008.stdout: "event": "reached_pg", 2023-08-01T19:54:33.004 INFO:teuthology.orchestra.run.smithi008.stdout: "time": "2023-08-01T19:54:29.656052+0000", 2023-08-01T19:54:33.004 INFO:teuthology.orchestra.run.smithi008.stdout: "duration": 0.00069347699999999996 2023-08-01T19:54:33.004 INFO:teuthology.orchestra.run.smithi008.stdout: }, 2023-08-01T19:54:33.004 INFO:teuthology.orchestra.run.smithi008.stdout: { 2023-08-01T19:54:33.004 INFO:teuthology.orchestra.run.smithi008.stdout: "event": "started", 2023-08-01T19:54:33.004 INFO:teuthology.orchestra.run.smithi008.stdout: "time": "2023-08-01T19:54:29.656145+0000", 2023-08-01T19:54:33.004 INFO:teuthology.orchestra.run.smithi008.stdout: "duration": 9.3294999999999994e-05 2023-08-01T19:54:33.004 INFO:teuthology.orchestra.run.smithi008.stdout: }, 2023-08-01T19:54:33.005 INFO:teuthology.orchestra.run.smithi008.stdout: { 2023-08-01T19:54:33.005 INFO:teuthology.orchestra.run.smithi008.stdout: "event": "waiting for subops from 2", 2023-08-01T19:54:33.005 INFO:teuthology.orchestra.run.smithi008.stdout: "time": "2023-08-01T19:54:29.656228+0000", 2023-08-01T19:54:33.005 INFO:teuthology.orchestra.run.smithi008.stdout: "duration": 8.2779000000000001e-05 2023-08-01T19:54:33.005 INFO:teuthology.orchestra.run.smithi008.stdout: }, 2023-08-01T19:54:33.005 INFO:teuthology.orchestra.run.smithi008.stdout: { 2023-08-01T19:54:33.005 INFO:teuthology.orchestra.run.smithi008.stdout: "event": "op_commit", 2023-08-01T19:54:33.005 INFO:teuthology.orchestra.run.smithi008.stdout: "time": "2023-08-01T19:54:29.658584+0000", 2023-08-01T19:54:33.006 INFO:teuthology.orchestra.run.smithi008.stdout: "duration": 0.0023564480000000001 2023-08-01T19:54:33.006 INFO:teuthology.orchestra.run.smithi008.stdout: }, 2023-08-01T19:54:33.006 INFO:teuthology.orchestra.run.smithi008.stdout: { 2023-08-01T19:54:33.006 INFO:teuthology.orchestra.run.smithi008.stdout: "event": "sub_op_commit_rec", 2023-08-01T19:54:33.006 INFO:teuthology.orchestra.run.smithi008.stdout: "time": "2023-08-01T19:54:29.667006+0000", 2023-08-01T19:54:33.006 INFO:teuthology.orchestra.run.smithi008.stdout: "duration": 0.0084217849999999993 2023-08-01T19:54:33.006 INFO:teuthology.orchestra.run.smithi008.stdout: }, 2023-08-01T19:54:33.006 INFO:teuthology.orchestra.run.smithi008.stdout: { 2023-08-01T19:54:33.007 INFO:teuthology.orchestra.run.smithi008.stdout: "event": "commit_sent", 2023-08-01T19:54:33.007 INFO:teuthology.orchestra.run.smithi008.stdout: "time": "2023-08-01T19:54:29.667035+0000", 2023-08-01T19:54:33.007 INFO:teuthology.orchestra.run.smithi008.stdout: "duration": 2.9598e-05 2023-08-01T19:54:33.007 INFO:teuthology.orchestra.run.smithi008.stdout: }, 2023-08-01T19:54:33.007 INFO:teuthology.orchestra.run.smithi008.stdout: { 2023-08-01T19:54:33.007 INFO:teuthology.orchestra.run.smithi008.stdout: "event": "done", 2023-08-01T19:54:33.007 INFO:teuthology.orchestra.run.smithi008.stdout: "time": "2023-08-01T19:54:29.667059+0000", 2023-08-01T19:54:33.008 INFO:teuthology.orchestra.run.smithi008.stdout: "duration": 2.3439e-05 2023-08-01T19:54:33.008 INFO:teuthology.orchestra.run.smithi008.stdout: } 2023-08-01T19:54:33.008 INFO:teuthology.orchestra.run.smithi008.stdout: ] 2023-08-01T19:54:33.008 INFO:teuthology.orchestra.run.smithi008.stdout: } 2023-08-01T19:54:33.008 INFO:teuthology.orchestra.run.smithi008.stdout: }, 2023-08-01T19:54:33.008 INFO:teuthology.orchestra.run.smithi008.stdout: { 2023-08-01T19:54:33.008 INFO:teuthology.orchestra.run.smithi008.stdout: "description": "osd_op(client.4668.0:20544 5.a 5:52fb262b:::benchmark_data_smithi006_114134_object20543:head [set-alloc-hint object_size 65536 write_size 65536,write 0~65536] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e23)", 2023-08-01T19:54:33.008 INFO:teuthology.orchestra.run.smithi008.stdout: "initiated_at": "2023-08-01T19:54:29.655369+0000", 2023-08-01T19:54:33.009 INFO:teuthology.orchestra.run.smithi008.stdout: "age": 3.1768663770000001, 2023-08-01T19:54:33.009 INFO:teuthology.orchestra.run.smithi008.stdout: "duration": 0.013074334999999999, 2023-08-01T19:54:33.009 INFO:teuthology.orchestra.run.smithi008.stdout: "type_data": { 2023-08-01T19:54:33.009 INFO:teuthology.orchestra.run.smithi008.stdout: "flag_point": "commit sent; apply or cleanup", 2023-08-01T19:54:33.009 INFO:teuthology.orchestra.run.smithi008.stdout: "client_info": { 2023-08-01T19:54:33.009 INFO:teuthology.orchestra.run.smithi008.stdout: "client": "client.4668", 2023-08-01T19:54:33.009 INFO:teuthology.orchestra.run.smithi008.stdout: "client_addr": "172.21.15.6:0/1709472247", 2023-08-01T19:54:33.009 INFO:teuthology.orchestra.run.smithi008.stdout: "tid": 20544 2023-08-01T19:54:33.010 INFO:teuthology.orchestra.run.smithi008.stdout: }, 2023-08-01T19:54:33.010 INFO:teuthology.orchestra.run.smithi008.stdout: "events": [ 2023-08-01T19:54:33.010 INFO:teuthology.orchestra.run.smithi008.stdout: { 2023-08-01T19:54:33.010 INFO:teuthology.orchestra.run.smithi008.stdout: "event": "initiated", 2023-08-01T19:54:33.010 INFO:teuthology.orchestra.run.smithi008.stdout: "time": "2023-08-01T19:54:29.655369+0000", 2023-08-01T19:54:33.010 INFO:teuthology.orchestra.run.smithi008.stdout: "duration": 0 2023-08-01T19:54:33.010 INFO:teuthology.orchestra.run.smithi008.stdout: }, 2023-08-01T19:54:33.011 INFO:teuthology.orchestra.run.smithi008.stdout: { 2023-08-01T19:54:33.011 INFO:teuthology.orchestra.run.smithi008.stdout: "event": "throttled", 2023-08-01T19:54:33.011 INFO:teuthology.orchestra.run.smithi008.stdout: "time": "2023-08-01T19:54:29.655369+0000", 2023-08-01T19:54:33.011 INFO:teuthology.orchestra.run.smithi008.stdout: "duration": 0 2023-08-01T19:54:33.011 INFO:teuthology.orchestra.run.smithi008.stdout: }, 2023-08-01T19:54:33.011 INFO:teuthology.orchestra.run.smithi008.stdout: { 2023-08-01T19:54:33.011 INFO:teuthology.orchestra.run.smithi008.stdout: "event": "header_read", 2023-08-01T19:54:33.011 INFO:teuthology.orchestra.run.smithi008.stdout: "time": "2023-08-01T19:54:29.655368+0000", 2023-08-01T19:54:33.012 INFO:teuthology.orchestra.run.smithi008.stdout: "duration": 4294967295.9999995 2023-08-01T19:54:33.012 INFO:teuthology.orchestra.run.smithi008.stdout: }, 2023-08-01T19:54:33.012 INFO:teuthology.orchestra.run.smithi008.stdout: { 2023-08-01T19:54:33.012 INFO:teuthology.orchestra.run.smithi008.stdout: "event": "all_read", 2023-08-01T19:54:33.012 INFO:teuthology.orchestra.run.smithi008.stdout: "time": "2023-08-01T19:54:29.655405+0000", 2023-08-01T19:54:33.012 INFO:teuthology.orchestra.run.smithi008.stdout: "duration": 3.7316e-05 2023-08-01T19:54:33.012 INFO:teuthology.orchestra.run.smithi008.stdout: }, 2023-08-01T19:54:33.012 INFO:teuthology.orchestra.run.smithi008.stdout: { 2023-08-01T19:54:33.013 INFO:teuthology.orchestra.run.smithi008.stdout: "event": "dispatched", 2023-08-01T19:54:33.013 INFO:teuthology.orchestra.run.smithi008.stdout: "time": "2023-08-01T19:54:29.655416+0000", 2023-08-01T19:54:33.013 INFO:teuthology.orchestra.run.smithi008.stdout: "duration": 1.1102e-05 2023-08-01T19:54:33.013 INFO:teuthology.orchestra.run.smithi008.stdout: }, 2023-08-01T19:54:33.013 INFO:teuthology.orchestra.run.smithi008.stdout: { 2023-08-01T19:54:33.013 INFO:teuthology.orchestra.run.smithi008.stdout: "event": "queued_for_pg", 2023-08-01T19:54:33.014 INFO:teuthology.orchestra.run.smithi008.stdout: "time": "2023-08-01T19:54:29.655422+0000", 2023-08-01T19:54:33.014 INFO:teuthology.orchestra.run.smithi008.stdout: "duration": 5.9120000000000003e-06 2023-08-01T19:54:33.014 INFO:teuthology.orchestra.run.smithi008.stdout: }, 2023-08-01T19:54:33.014 INFO:teuthology.orchestra.run.smithi008.stdout: { 2023-08-01T19:54:33.014 INFO:teuthology.orchestra.run.smithi008.stdout: "event": "reached_pg", 2023-08-01T19:54:33.014 INFO:teuthology.orchestra.run.smithi008.stdout: "time": "2023-08-01T19:54:29.656834+0000", 2023-08-01T19:54:33.014 INFO:teuthology.orchestra.run.smithi008.stdout: "duration": 0.0014116829999999999 2023-08-01T19:54:33.015 INFO:teuthology.orchestra.run.smithi008.stdout: }, 2023-08-01T19:54:33.015 INFO:teuthology.orchestra.run.smithi008.stdout: { 2023-08-01T19:54:33.015 INFO:teuthology.orchestra.run.smithi008.stdout: "event": "started", 2023-08-01T19:54:33.015 INFO:teuthology.orchestra.run.smithi008.stdout: "time": "2023-08-01T19:54:29.656953+0000", 2023-08-01T19:54:33.015 INFO:teuthology.orchestra.run.smithi008.stdout: "duration": 0.00011851200000000001 2023-08-01T19:54:33.015 INFO:teuthology.orchestra.run.smithi008.stdout: }, 2023-08-01T19:54:33.016 INFO:teuthology.orchestra.run.smithi008.stdout: { 2023-08-01T19:54:33.016 INFO:teuthology.orchestra.run.smithi008.stdout: "event": "waiting for subops from 2", 2023-08-01T19:54:33.016 INFO:teuthology.orchestra.run.smithi008.stdout: "time": "2023-08-01T19:54:29.657099+0000", 2023-08-01T19:54:33.016 INFO:teuthology.orchestra.run.smithi008.stdout: "duration": 0.000146241 2023-08-01T19:54:33.016 INFO:teuthology.orchestra.run.smithi008.stdout: }, 2023-08-01T19:54:33.016 INFO:teuthology.orchestra.run.smithi008.stdout: { 2023-08-01T19:54:33.017 INFO:teuthology.orchestra.run.smithi008.stdout: "event": "op_commit", 2023-08-01T19:54:33.017 INFO:teuthology.orchestra.run.smithi008.stdout: "time": "2023-08-01T19:54:29.659538+0000", 2023-08-01T19:54:33.017 INFO:teuthology.orchestra.run.smithi008.stdout: "duration": 0.0024387549999999999 2023-08-01T19:54:33.017 INFO:teuthology.orchestra.run.smithi008.stdout: }, 2023-08-01T19:54:33.017 INFO:teuthology.orchestra.run.smithi008.stdout: { 2023-08-01T19:54:33.017 INFO:teuthology.orchestra.run.smithi008.stdout: "event": "sub_op_commit_rec", 2023-08-01T19:54:33.018 INFO:teuthology.orchestra.run.smithi008.stdout: "time": "2023-08-01T19:54:29.668362+0000", 2023-08-01T19:54:33.018 INFO:teuthology.orchestra.run.smithi008.stdout: "duration": 0.0088243590000000004 2023-08-01T19:54:33.018 INFO:teuthology.orchestra.run.smithi008.stdout: }, 2023-08-01T19:54:33.018 INFO:teuthology.orchestra.run.smithi008.stdout: { 2023-08-01T19:54:33.018 INFO:teuthology.orchestra.run.smithi008.stdout: "event": "commit_sent", 2023-08-01T19:54:33.018 INFO:teuthology.orchestra.run.smithi008.stdout: "time": "2023-08-01T19:54:29.668409+0000", 2023-08-01T19:54:33.018 INFO:teuthology.orchestra.run.smithi008.stdout: "duration": 4.7246000000000001e-05 2023-08-01T19:54:33.019 INFO:teuthology.orchestra.run.smithi008.stdout: }, 2023-08-01T19:54:33.019 INFO:teuthology.orchestra.run.smithi008.stdout: { 2023-08-01T19:54:33.019 INFO:teuthology.orchestra.run.smithi008.stdout: "event": "done", 2023-08-01T19:54:33.019 INFO:teuthology.orchestra.run.smithi008.stdout: "time": "2023-08-01T19:54:29.668443+0000", 2023-08-01T19:54:33.019 INFO:teuthology.orchestra.run.smithi008.stdout: "duration": 3.3844999999999999e-05 2023-08-01T19:54:33.019 INFO:teuthology.orchestra.run.smithi008.stdout: } 2023-08-01T19:54:33.019 INFO:teuthology.orchestra.run.smithi008.stdout: ] 2023-08-01T19:54:33.019 INFO:teuthology.orchestra.run.smithi008.stdout: } 2023-08-01T19:54:33.020 INFO:teuthology.orchestra.run.smithi008.stdout: }, 2023-08-01T19:54:33.020 INFO:teuthology.orchestra.run.smithi008.stdout: { 2023-08-01T19:54:33.020 INFO:teuthology.orchestra.run.smithi008.stdout: "description": "osd_op(client.4668.0:20547 5.a 5:54001317:::benchmark_data_smithi006_114134_object20546:head [set-alloc-hint object_size 65536 write_size 65536,write 0~65536] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e23)", 2023-08-01T19:54:33.020 INFO:teuthology.orchestra.run.smithi008.stdout: "initiated_at": "2023-08-01T19:54:29.655560+0000", 2023-08-01T19:54:33.020 INFO:teuthology.orchestra.run.smithi008.stdout: "age": 3.1766748339999999, 2023-08-01T19:54:33.020 INFO:teuthology.orchestra.run.smithi008.stdout: "duration": 0.014929586999999999, 2023-08-01T19:54:33.020 INFO:teuthology.orchestra.run.smithi008.stdout: "type_data": { 2023-08-01T19:54:33.020 INFO:teuthology.orchestra.run.smithi008.stdout: "flag_point": "commit sent; apply or cleanup", 2023-08-01T19:54:33.021 INFO:teuthology.orchestra.run.smithi008.stdout: "client_info": { 2023-08-01T19:54:33.021 INFO:teuthology.orchestra.run.smithi008.stdout: "client": "client.4668", 2023-08-01T19:54:33.021 INFO:teuthology.orchestra.run.smithi008.stdout: "client_addr": "172.21.15.6:0/1709472247", 2023-08-01T19:54:33.021 INFO:teuthology.orchestra.run.smithi008.stdout: "tid": 20547 2023-08-01T19:54:33.021 INFO:teuthology.orchestra.run.smithi008.stdout: }, 2023-08-01T19:54:33.021 INFO:teuthology.orchestra.run.smithi008.stdout: "events": [ 2023-08-01T19:54:33.021 INFO:teuthology.orchestra.run.smithi008.stdout: { 2023-08-01T19:54:33.022 INFO:teuthology.orchestra.run.smithi008.stdout: "event": "initiated", 2023-08-01T19:54:33.022 INFO:teuthology.orchestra.run.smithi008.stdout: "time": "2023-08-01T19:54:29.655560+0000", 2023-08-01T19:54:33.022 INFO:teuthology.orchestra.run.smithi008.stdout: "duration": 0 2023-08-01T19:54:33.022 INFO:teuthology.orchestra.run.smithi008.stdout: }, 2023-08-01T19:54:33.022 INFO:teuthology.orchestra.run.smithi008.stdout: { 2023-08-01T19:54:33.022 INFO:teuthology.orchestra.run.smithi008.stdout: "event": "throttled", 2023-08-01T19:54:33.022 INFO:teuthology.orchestra.run.smithi008.stdout: "time": "2023-08-01T19:54:29.655560+0000", 2023-08-01T19:54:33.022 INFO:teuthology.orchestra.run.smithi008.stdout: "duration": 0 2023-08-01T19:54:33.023 INFO:teuthology.orchestra.run.smithi008.stdout: }, 2023-08-01T19:54:33.023 INFO:teuthology.orchestra.run.smithi008.stdout: { 2023-08-01T19:54:33.023 INFO:teuthology.orchestra.run.smithi008.stdout: "event": "header_read", 2023-08-01T19:54:33.023 INFO:teuthology.orchestra.run.smithi008.stdout: "time": "2023-08-01T19:54:29.655560+0000", 2023-08-01T19:54:33.023 INFO:teuthology.orchestra.run.smithi008.stdout: "duration": 4294967295.9999995 2023-08-01T19:54:33.023 INFO:teuthology.orchestra.run.smithi008.stdout: }, 2023-08-01T19:54:33.023 INFO:teuthology.orchestra.run.smithi008.stdout: { 2023-08-01T19:54:33.023 INFO:teuthology.orchestra.run.smithi008.stdout: "event": "all_read", 2023-08-01T19:54:33.024 INFO:teuthology.orchestra.run.smithi008.stdout: "time": "2023-08-01T19:54:29.655590+0000", 2023-08-01T19:54:33.024 INFO:teuthology.orchestra.run.smithi008.stdout: "duration": 3.0467000000000002e-05 2023-08-01T19:54:33.024 INFO:teuthology.orchestra.run.smithi008.stdout: }, 2023-08-01T19:54:33.024 INFO:teuthology.orchestra.run.smithi008.stdout: { 2023-08-01T19:54:33.024 INFO:teuthology.orchestra.run.smithi008.stdout: "event": "dispatched", 2023-08-01T19:54:33.024 INFO:teuthology.orchestra.run.smithi008.stdout: "time": "2023-08-01T19:54:29.655600+0000", 2023-08-01T19:54:33.024 INFO:teuthology.orchestra.run.smithi008.stdout: "duration": 1.0103e-05 2023-08-01T19:54:33.024 INFO:teuthology.orchestra.run.smithi008.stdout: }, 2023-08-01T19:54:33.025 INFO:teuthology.orchestra.run.smithi008.stdout: { 2023-08-01T19:54:33.025 INFO:teuthology.orchestra.run.smithi008.stdout: "event": "queued_for_pg", 2023-08-01T19:54:33.025 INFO:teuthology.orchestra.run.smithi008.stdout: "time": "2023-08-01T19:54:29.655605+0000", 2023-08-01T19:54:33.025 INFO:teuthology.orchestra.run.smithi008.stdout: "duration": 4.1860000000000002e-06 2023-08-01T19:54:33.025 INFO:teuthology.orchestra.run.smithi008.stdout: }, 2023-08-01T19:54:33.025 INFO:teuthology.orchestra.run.smithi008.stdout: { 2023-08-01T19:54:33.025 INFO:teuthology.orchestra.run.smithi008.stdout: "event": "reached_pg", 2023-08-01T19:54:33.025 INFO:teuthology.orchestra.run.smithi008.stdout: "time": "2023-08-01T19:54:29.657832+0000", 2023-08-01T19:54:33.026 INFO:teuthology.orchestra.run.smithi008.stdout: "duration": 0.0022275630000000001 2023-08-01T19:54:33.026 INFO:teuthology.orchestra.run.smithi008.stdout: }, 2023-08-01T19:54:33.026 INFO:teuthology.orchestra.run.smithi008.stdout: { 2023-08-01T19:54:33.026 INFO:teuthology.orchestra.run.smithi008.stdout: "event": "started", 2023-08-01T19:54:33.026 INFO:teuthology.orchestra.run.smithi008.stdout: "time": "2023-08-01T19:54:29.657927+0000", 2023-08-01T19:54:33.026 INFO:teuthology.orchestra.run.smithi008.stdout: "duration": 9.5390000000000007e-05 2023-08-01T19:54:33.026 INFO:teuthology.orchestra.run.smithi008.stdout: }, 2023-08-01T19:54:33.026 INFO:teuthology.orchestra.run.smithi008.stdout: { 2023-08-01T19:54:33.027 INFO:teuthology.orchestra.run.smithi008.stdout: "event": "waiting for subops from 2", 2023-08-01T19:54:33.027 INFO:teuthology.orchestra.run.smithi008.stdout: "time": "2023-08-01T19:54:29.658008+0000", 2023-08-01T19:54:33.027 INFO:teuthology.orchestra.run.smithi008.stdout: "duration": 8.0671000000000001e-05 2023-08-01T19:54:33.027 INFO:teuthology.orchestra.run.smithi008.stdout: }, 2023-08-01T19:54:33.027 INFO:teuthology.orchestra.run.smithi008.stdout: { 2023-08-01T19:54:33.027 INFO:teuthology.orchestra.run.smithi008.stdout: "event": "op_commit", 2023-08-01T19:54:33.027 INFO:teuthology.orchestra.run.smithi008.stdout: "time": "2023-08-01T19:54:29.659542+0000", 2023-08-01T19:54:33.027 INFO:teuthology.orchestra.run.smithi008.stdout: "duration": 0.0015343220000000001 2023-08-01T19:54:33.028 INFO:teuthology.orchestra.run.smithi008.stdout: }, 2023-08-01T19:54:33.028 INFO:teuthology.orchestra.run.smithi008.stdout: { 2023-08-01T19:54:33.028 INFO:teuthology.orchestra.run.smithi008.stdout: "event": "sub_op_commit_rec", 2023-08-01T19:54:33.028 INFO:teuthology.orchestra.run.smithi008.stdout: "time": "2023-08-01T19:54:29.670439+0000", 2023-08-01T19:54:33.028 INFO:teuthology.orchestra.run.smithi008.stdout: "duration": 0.010896874000000001 2023-08-01T19:54:33.028 INFO:teuthology.orchestra.run.smithi008.stdout: }, 2023-08-01T19:54:33.028 INFO:teuthology.orchestra.run.smithi008.stdout: { 2023-08-01T19:54:33.029 INFO:teuthology.orchestra.run.smithi008.stdout: "event": "commit_sent", 2023-08-01T19:54:33.029 INFO:teuthology.orchestra.run.smithi008.stdout: "time": "2023-08-01T19:54:29.670467+0000", 2023-08-01T19:54:33.029 INFO:teuthology.orchestra.run.smithi008.stdout: "duration": 2.7433999999999999e-05 2023-08-01T19:54:33.029 INFO:teuthology.orchestra.run.smithi008.stdout: }, 2023-08-01T19:54:33.029 INFO:teuthology.orchestra.run.smithi008.stdout: { 2023-08-01T19:54:33.029 INFO:teuthology.orchestra.run.smithi008.stdout: "event": "done", 2023-08-01T19:54:33.029 INFO:teuthology.orchestra.run.smithi008.stdout: "time": "2023-08-01T19:54:29.670490+0000", 2023-08-01T19:54:33.029 INFO:teuthology.orchestra.run.smithi008.stdout: "duration": 2.3076000000000001e-05 2023-08-01T19:54:33.030 INFO:teuthology.orchestra.run.smithi008.stdout: } 2023-08-01T19:54:33.030 INFO:teuthology.orchestra.run.smithi008.stdout: ] 2023-08-01T19:54:33.030 INFO:teuthology.orchestra.run.smithi008.stdout: } 2023-08-01T19:54:33.030 INFO:teuthology.orchestra.run.smithi008.stdout: }, 2023-08-01T19:54:33.030 INFO:teuthology.orchestra.run.smithi008.stdout: { 2023-08-01T19:54:33.030 INFO:teuthology.orchestra.run.smithi008.stdout: "description": "osd_op(client.4668.0:29032 5.c 5:3368537b:::benchmark_data_smithi006_114134_object29031:head [set-alloc-hint object_size 65536 write_size 65536,write 0~65536] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e24)", 2023-08-01T19:54:33.030 INFO:teuthology.orchestra.run.smithi008.stdout: "initiated_at": "2023-08-01T19:54:32.328834+0000", 2023-08-01T19:54:33.030 INFO:teuthology.orchestra.run.smithi008.stdout: "age": 0.503400815, 2023-08-01T19:54:33.031 INFO:teuthology.orchestra.run.smithi008.stdout: "duration": 0.010659633999999999, 2023-08-01T19:54:33.031 INFO:teuthology.orchestra.run.smithi008.stdout: "type_data": { 2023-08-01T19:54:33.031 INFO:teuthology.orchestra.run.smithi008.stdout: "flag_point": "commit sent; apply or cleanup", 2023-08-01T19:54:33.031 INFO:teuthology.orchestra.run.smithi008.stdout: "client_info": { 2023-08-01T19:54:33.031 INFO:teuthology.orchestra.run.smithi008.stdout: "client": "client.4668", 2023-08-01T19:54:33.031 INFO:teuthology.orchestra.run.smithi008.stdout: "client_addr": "172.21.15.6:0/1709472247", 2023-08-01T19:54:33.031 INFO:teuthology.orchestra.run.smithi008.stdout: "tid": 29032 2023-08-01T19:54:33.031 INFO:teuthology.orchestra.run.smithi008.stdout: }, 2023-08-01T19:54:33.032 INFO:teuthology.orchestra.run.smithi008.stdout: "events": [ 2023-08-01T19:54:33.032 INFO:teuthology.orchestra.run.smithi008.stdout: { 2023-08-01T19:54:33.032 INFO:teuthology.orchestra.run.smithi008.stdout: "event": "initiated", 2023-08-01T19:54:33.032 INFO:teuthology.orchestra.run.smithi008.stdout: "time": "2023-08-01T19:54:32.328834+0000", 2023-08-01T19:54:33.032 INFO:teuthology.orchestra.run.smithi008.stdout: "duration": 0 2023-08-01T19:54:33.032 INFO:teuthology.orchestra.run.smithi008.stdout: }, 2023-08-01T19:54:33.032 INFO:teuthology.orchestra.run.smithi008.stdout: { 2023-08-01T19:54:33.033 INFO:teuthology.orchestra.run.smithi008.stdout: "event": "throttled", 2023-08-01T19:54:33.033 INFO:teuthology.orchestra.run.smithi008.stdout: "time": "2023-08-01T19:54:32.328834+0000", 2023-08-01T19:54:33.033 INFO:teuthology.orchestra.run.smithi008.stdout: "duration": 0 2023-08-01T19:54:33.033 INFO:teuthology.orchestra.run.smithi008.stdout: }, 2023-08-01T19:54:33.033 INFO:teuthology.orchestra.run.smithi008.stdout: { 2023-08-01T19:54:33.033 INFO:teuthology.orchestra.run.smithi008.stdout: "event": "header_read", 2023-08-01T19:54:33.033 INFO:teuthology.orchestra.run.smithi008.stdout: "time": "2023-08-01T19:54:32.328834+0000", 2023-08-01T19:54:33.033 INFO:teuthology.orchestra.run.smithi008.stdout: "duration": 4294967295.9999995 2023-08-01T19:54:33.034 INFO:teuthology.orchestra.run.smithi008.stdout: }, 2023-08-01T19:54:33.034 INFO:teuthology.orchestra.run.smithi008.stdout: { 2023-08-01T19:54:33.034 INFO:teuthology.orchestra.run.smithi008.stdout: "event": "all_read", 2023-08-01T19:54:33.034 INFO:teuthology.orchestra.run.smithi008.stdout: "time": "2023-08-01T19:54:32.328904+0000", 2023-08-01T19:54:33.034 INFO:teuthology.orchestra.run.smithi008.stdout: "duration": 7.0674999999999997e-05 2023-08-01T19:54:33.034 INFO:teuthology.orchestra.run.smithi008.stdout: }, 2023-08-01T19:54:33.034 INFO:teuthology.orchestra.run.smithi008.stdout: { 2023-08-01T19:54:33.034 INFO:teuthology.orchestra.run.smithi008.stdout: "event": "dispatched", 2023-08-01T19:54:33.035 INFO:teuthology.orchestra.run.smithi008.stdout: "time": "2023-08-01T19:54:32.328914+0000", 2023-08-01T19:54:33.035 INFO:teuthology.orchestra.run.smithi008.stdout: "duration": 1.0000000000000001e-05 2023-08-01T19:54:33.035 INFO:teuthology.orchestra.run.smithi008.stdout: }, 2023-08-01T19:54:33.035 INFO:teuthology.orchestra.run.smithi008.stdout: { 2023-08-01T19:54:33.035 INFO:teuthology.orchestra.run.smithi008.stdout: "event": "queued_for_pg", 2023-08-01T19:54:33.035 INFO:teuthology.orchestra.run.smithi008.stdout: "time": "2023-08-01T19:54:32.328920+0000", 2023-08-01T19:54:33.035 INFO:teuthology.orchestra.run.smithi008.stdout: "duration": 5.5040000000000002e-06 2023-08-01T19:54:33.035 INFO:teuthology.orchestra.run.smithi008.stdout: }, 2023-08-01T19:54:33.036 INFO:teuthology.orchestra.run.smithi008.stdout: { 2023-08-01T19:54:33.036 INFO:teuthology.orchestra.run.smithi008.stdout: "event": "reached_pg", 2023-08-01T19:54:33.036 INFO:teuthology.orchestra.run.smithi008.stdout: "time": "2023-08-01T19:54:32.330380+0000", 2023-08-01T19:54:33.036 INFO:teuthology.orchestra.run.smithi008.stdout: "duration": 0.001459709 2023-08-01T19:54:33.036 INFO:teuthology.orchestra.run.smithi008.stdout: }, 2023-08-01T19:54:33.036 INFO:teuthology.orchestra.run.smithi008.stdout: { 2023-08-01T19:54:33.036 INFO:teuthology.orchestra.run.smithi008.stdout: "event": "started", 2023-08-01T19:54:33.036 INFO:teuthology.orchestra.run.smithi008.stdout: "time": "2023-08-01T19:54:32.330518+0000", 2023-08-01T19:54:33.037 INFO:teuthology.orchestra.run.smithi008.stdout: "duration": 0.00013820299999999999 2023-08-01T19:54:33.037 INFO:teuthology.orchestra.run.smithi008.stdout: }, 2023-08-01T19:54:33.037 INFO:teuthology.orchestra.run.smithi008.stdout: { 2023-08-01T19:54:33.037 INFO:teuthology.orchestra.run.smithi008.stdout: "event": "waiting for subops from 1", 2023-08-01T19:54:33.037 INFO:teuthology.orchestra.run.smithi008.stdout: "time": "2023-08-01T19:54:32.330631+0000", 2023-08-01T19:54:33.037 INFO:teuthology.orchestra.run.smithi008.stdout: "duration": 0.00011336999999999999 2023-08-01T19:54:33.037 INFO:teuthology.orchestra.run.smithi008.stdout: }, 2023-08-01T19:54:33.037 INFO:teuthology.orchestra.run.smithi008.stdout: { 2023-08-01T19:54:33.038 INFO:teuthology.orchestra.run.smithi008.stdout: "event": "op_commit", 2023-08-01T19:54:33.038 INFO:teuthology.orchestra.run.smithi008.stdout: "time": "2023-08-01T19:54:32.334563+0000", 2023-08-01T19:54:33.038 INFO:teuthology.orchestra.run.smithi008.stdout: "duration": 0.0039318909999999999 2023-08-01T19:54:33.038 INFO:teuthology.orchestra.run.smithi008.stdout: }, 2023-08-01T19:54:33.038 INFO:teuthology.orchestra.run.smithi008.stdout: { 2023-08-01T19:54:33.038 INFO:teuthology.orchestra.run.smithi008.stdout: "event": "sub_op_commit_rec", 2023-08-01T19:54:33.038 INFO:teuthology.orchestra.run.smithi008.stdout: "time": "2023-08-01T19:54:32.339440+0000", 2023-08-01T19:54:33.039 INFO:teuthology.orchestra.run.smithi008.stdout: "duration": 0.004876811 2023-08-01T19:54:33.039 INFO:teuthology.orchestra.run.smithi008.stdout: }, 2023-08-01T19:54:33.039 INFO:teuthology.orchestra.run.smithi008.stdout: { 2023-08-01T19:54:33.039 INFO:teuthology.orchestra.run.smithi008.stdout: "event": "commit_sent", 2023-08-01T19:54:33.039 INFO:teuthology.orchestra.run.smithi008.stdout: "time": "2023-08-01T19:54:32.339469+0000", 2023-08-01T19:54:33.039 INFO:teuthology.orchestra.run.smithi008.stdout: "duration": 2.9587999999999999e-05 2023-08-01T19:54:33.039 INFO:teuthology.orchestra.run.smithi008.stdout: }, 2023-08-01T19:54:33.039 INFO:teuthology.orchestra.run.smithi008.stdout: { 2023-08-01T19:54:33.040 INFO:teuthology.orchestra.run.smithi008.stdout: "event": "done", 2023-08-01T19:54:33.040 INFO:teuthology.orchestra.run.smithi008.stdout: "time": "2023-08-01T19:54:32.339494+0000", 2023-08-01T19:54:33.040 INFO:teuthology.orchestra.run.smithi008.stdout: "duration": 2.4411000000000001e-05 2023-08-01T19:54:33.040 INFO:teuthology.orchestra.run.smithi008.stdout: } 2023-08-01T19:54:33.040 INFO:teuthology.orchestra.run.smithi008.stdout: ] 2023-08-01T19:54:33.040 INFO:teuthology.orchestra.run.smithi008.stdout: } 2023-08-01T19:54:33.040 INFO:teuthology.orchestra.run.smithi008.stdout: } 2023-08-01T19:54:33.040 INFO:teuthology.orchestra.run.smithi008.stdout: ] 2023-08-01T19:54:33.041 INFO:teuthology.orchestra.run.smithi008.stdout:} 2023-08-01T19:54:33.042 INFO:tasks.ceph.osd.1.smithi101.stderr:2023-08-01T19:54:33.040+0000 7fb0cb7f6700 -1 received signal: Hangup from /usr/bin/python3 /bin/daemon-helper kill ceph-osd -f --cluster ceph -i 1 (PID: 111141) UID: 0 2023-08-01T19:54:33.044 DEBUG:teuthology.orchestra.run.smithi101:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 30 ceph --cluster ceph --admin-daemon /var/run/ceph/ceph-osd.1.asok dump_ops_in_flight 2023-08-01T19:54:33.046 INFO:teuthology.orchestra.run.smithi006.stdout: 2023-08-01T19:54:33.048 INFO:teuthology.orchestra.run.smithi006.stderr:dumped all 2023-08-01T19:54:33.048 INFO:teuthology.orchestra.run.smithi006.stdout:{"pg_ready":true,"pg_map":{"version":42,"stamp":"2023-08-01T19:54:31.913190+0000","last_osdmap_epoch":0,"last_pg_scan":0,"pg_stats_sum":{"stat_sum":{"num_bytes":1493633826,"num_objects":22806,"num_object_clones":0,"num_object_copies":45612,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":22806,"num_whiteouts":0,"num_read":136,"num_read_kb":118,"num_write":23030,"num_write_kb":1461521,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":14,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"store_stats":{"total":0,"available":0,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},"log_size":22978,"ondisk_log_size":22978,"up":242,"acting":242,"num_store_stats":0},"osd_stats_sum":{"up_from":0,"seq":0,"num_pgs":242,"num_osds":3,"num_per_pool_osds":3,"num_per_pool_omap_osds":3,"kb":283115520,"kb_used":243576,"kb_used_data":157916,"kb_used_omap":0,"kb_used_meta":85632,"kb_avail":282871944,"statfs":{"total":289910292480,"available":289660870656,"internally_reserved":0,"allocated":161705984,"data_stored":2575414383,"data_compressed":12331106,"data_compressed_allocated":160948224,"data_compressed_original":2575138816,"omap_allocated":0,"internal_metadata":87687168},"hb_peers":[],"snap_trim_queue_len":0,"num_snap_trimming":0,"num_shards_repaired":0,"op_queue_age_hist":{"histogram":[5,1,4,10],"upper_bound":16},"perf_stat":{"commit_latency_ms":5,"apply_latency_ms":5,"commit_latency_ns":5000000,"apply_latency_ns":5000000},"alerts":[],"network_ping_times":[]},"pg_stats_delta":{"stat_sum":{"num_bytes":1386217472,"num_objects":21152,"num_object_clones":0,"num_object_copies":42304,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":21152,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":21152,"num_write_kb":1353728,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"store_stats":{"total":0,"available":0,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},"log_size":0,"ondisk_log_size":0,"up":0,"acting":0,"num_store_stats":0,"stamp_delta":"6.772733"},"pg_stats":[{"pgid":"4.3f","version":"0'0","reported_seq":14,"reported_epoch":22,"state":"active+clean","last_fresh":"2023-08-01T19:54:25.144499+0000","last_change":"2023-08-01T19:54:04.473430+0000","last_active":"2023-08-01T19:54:25.144499+0000","last_peered":"2023-08-01T19:54:25.144499+0000","last_clean":"2023-08-01T19:54:25.144499+0000","last_became_active":"2023-08-01T19:54:04.472887+0000","last_became_peered":"2023-08-01T19:54:04.472887+0000","last_unstale":"2023-08-01T19:54:25.144499+0000","last_undegraded":"2023-08-01T19:54:25.144499+0000","last_fullsized":"2023-08-01T19:54:25.144499+0000","mapping_epoch":16,"log_start":"0'0","ondisk_log_start":"0'0","created":16,"last_epoch_clean":17,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-08-01T19:54:04.040663+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-08-01T19:54:04.040663+0000","last_clean_scrub_stamp":"2023-08-01T19:54:04.040663+0000","objects_scrubbed":0,"log_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-08-03T06:38:54.196605+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[2,0],"acting":[2,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":2,"acting_primary":2,"purged_snaps":[]},{"pgid":"4.3e","version":"0'0","reported_seq":14,"reported_epoch":22,"state":"active+clean","last_fresh":"2023-08-01T19:54:25.144463+0000","last_change":"2023-08-01T19:54:04.470501+0000","last_active":"2023-08-01T19:54:25.144463+0000","last_peered":"2023-08-01T19:54:25.144463+0000","last_clean":"2023-08-01T19:54:25.144463+0000","last_became_active":"2023-08-01T19:54:04.469692+0000","last_became_peered":"2023-08-01T19:54:04.469692+0000","last_unstale":"2023-08-01T19:54:25.144463+0000","last_undegraded":"2023-08-01T19:54:25.144463+0000","last_fullsized":"2023-08-01T19:54:25.144463+0000","mapping_epoch":16,"log_start":"0'0","ondisk_log_start":"0'0","created":16,"last_epoch_clean":17,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-08-01T19:54:04.040663+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-08-01T19:54:04.040663+0000","last_clean_scrub_stamp":"2023-08-01T19:54:04.040663+0000","objects_scrubbed":0,"log_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-08-03T02:19:35.201107+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[2,0],"acting":[2,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":2,"acting_primary":2,"purged_snaps":[]},{"pgid":"4.3d","version":"0'0","reported_seq":14,"reported_epoch":22,"state":"active+clean","last_fresh":"2023-08-01T19:54:25.152298+0000","last_change":"2023-08-01T19:54:04.472579+0000","last_active":"2023-08-01T19:54:25.152298+0000","last_peered":"2023-08-01T19:54:25.152298+0000","last_clean":"2023-08-01T19:54:25.152298+0000","last_became_active":"2023-08-01T19:54:04.471128+0000","last_became_peered":"2023-08-01T19:54:04.471128+0000","last_unstale":"2023-08-01T19:54:25.152298+0000","last_undegraded":"2023-08-01T19:54:25.152298+0000","last_fullsized":"2023-08-01T19:54:25.152298+0000","mapping_epoch":16,"log_start":"0'0","ondisk_log_start":"0'0","created":16,"last_epoch_clean":17,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-08-01T19:54:04.040663+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-08-01T19:54:04.040663+0000","last_clean_scrub_stamp":"2023-08-01T19:54:04.040663+0000","objects_scrubbed":0,"log_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-08-03T03:04:06.137335+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[1,2],"acting":[1,2],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":1,"acting_primary":1,"purged_snaps":[]},{"pgid":"4.3c","version":"0'0","reported_seq":14,"reported_epoch":22,"state":"active+clean","last_fresh":"2023-08-01T19:54:25.152193+0000","last_change":"2023-08-01T19:54:04.477908+0000","last_active":"2023-08-01T19:54:25.152193+0000","last_peered":"2023-08-01T19:54:25.152193+0000","last_clean":"2023-08-01T19:54:25.152193+0000","last_became_active":"2023-08-01T19:54:04.476684+0000","last_became_peered":"2023-08-01T19:54:04.476684+0000","last_unstale":"2023-08-01T19:54:25.152193+0000","last_undegraded":"2023-08-01T19:54:25.152193+0000","last_fullsized":"2023-08-01T19:54:25.152193+0000","mapping_epoch":16,"log_start":"0'0","ondisk_log_start":"0'0","created":16,"last_epoch_clean":17,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-08-01T19:54:04.040663+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-08-01T19:54:04.040663+0000","last_clean_scrub_stamp":"2023-08-01T19:54:04.040663+0000","objects_scrubbed":0,"log_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-08-03T03:56:55.336461+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[1,0],"acting":[1,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":1,"acting_primary":1,"purged_snaps":[]},{"pgid":"4.3b","version":"0'0","reported_seq":14,"reported_epoch":22,"state":"active+clean","last_fresh":"2023-08-01T19:54:25.144771+0000","last_change":"2023-08-01T19:54:04.467197+0000","last_active":"2023-08-01T19:54:25.144771+0000","last_peered":"2023-08-01T19:54:25.144771+0000","last_clean":"2023-08-01T19:54:25.144771+0000","last_became_active":"2023-08-01T19:54:04.466526+0000","last_became_peered":"2023-08-01T19:54:04.466526+0000","last_unstale":"2023-08-01T19:54:25.144771+0000","last_undegraded":"2023-08-01T19:54:25.144771+0000","last_fullsized":"2023-08-01T19:54:25.144771+0000","mapping_epoch":16,"log_start":"0'0","ondisk_log_start":"0'0","created":16,"last_epoch_clean":17,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-08-01T19:54:04.040663+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-08-01T19:54:04.040663+0000","last_clean_scrub_stamp":"2023-08-01T19:54:04.040663+0000","objects_scrubbed":0,"log_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-08-03T06:54:18.982174+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[2,0],"acting":[2,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":2,"acting_primary":2,"purged_snaps":[]},{"pgid":"4.3a","version":"0'0","reported_seq":14,"reported_epoch":22,"state":"active+clean","last_fresh":"2023-08-01T19:54:25.151055+0000","last_change":"2023-08-01T19:54:04.473296+0000","last_active":"2023-08-01T19:54:25.151055+0000","last_peered":"2023-08-01T19:54:25.151055+0000","last_clean":"2023-08-01T19:54:25.151055+0000","last_became_active":"2023-08-01T19:54:04.472324+0000","last_became_peered":"2023-08-01T19:54:04.472324+0000","last_unstale":"2023-08-01T19:54:25.151055+0000","last_undegraded":"2023-08-01T19:54:25.151055+0000","last_fullsized":"2023-08-01T19:54:25.151055+0000","mapping_epoch":16,"log_start":"0'0","ondisk_log_start":"0'0","created":16,"last_epoch_clean":17,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-08-01T19:54:04.040663+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-08-01T19:54:04.040663+0000","last_clean_scrub_stamp":"2023-08-01T19:54:04.040663+0000","objects_scrubbed":0,"log_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-08-02T23:15:11.148662+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[1,0],"acting":[1,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":1,"acting_primary":1,"purged_snaps":[]},{"pgid":"4.39","version":"0'0","reported_seq":14,"reported_epoch":22,"state":"active+clean","last_fresh":"2023-08-01T19:54:25.151033+0000","last_change":"2023-08-01T19:54:04.475322+0000","last_active":"2023-08-01T19:54:25.151033+0000","last_peered":"2023-08-01T19:54:25.151033+0000","last_clean":"2023-08-01T19:54:25.151033+0000","last_became_active":"2023-08-01T19:54:04.474591+0000","last_became_peered":"2023-08-01T19:54:04.474591+0000","last_unstale":"2023-08-01T19:54:25.151033+0000","last_undegraded":"2023-08-01T19:54:25.151033+0000","last_fullsized":"2023-08-01T19:54:25.151033+0000","mapping_epoch":16,"log_start":"0'0","ondisk_log_start":"0'0","created":16,"last_epoch_clean":17,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-08-01T19:54:04.040663+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-08-01T19:54:04.040663+0000","last_clean_scrub_stamp":"2023-08-01T19:54:04.040663+0000","objects_scrubbed":0,"log_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-08-03T00:29:53.554989+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[1,0],"acting":[1,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":1,"acting_primary":1,"purged_snaps":[]},{"pgid":"4.38","version":"0'0","reported_seq":14,"reported_epoch":22,"state":"active+clean","last_fresh":"2023-08-01T19:54:25.150641+0000","last_change":"2023-08-01T19:54:04.478505+0000","last_active":"2023-08-01T19:54:25.150641+0000","last_peered":"2023-08-01T19:54:25.150641+0000","last_clean":"2023-08-01T19:54:25.150641+0000","last_became_active":"2023-08-01T19:54:04.477325+0000","last_became_peered":"2023-08-01T19:54:04.477325+0000","last_unstale":"2023-08-01T19:54:25.150641+0000","last_undegraded":"2023-08-01T19:54:25.150641+0000","last_fullsized":"2023-08-01T19:54:25.150641+0000","mapping_epoch":16,"log_start":"0'0","ondisk_log_start":"0'0","created":16,"last_epoch_clean":17,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-08-01T19:54:04.040663+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-08-01T19:54:04.040663+0000","last_clean_scrub_stamp":"2023-08-01T19:54:04.040663+0000","objects_scrubbed":0,"log_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-08-03T01:38:12.939736+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[1,0],"acting":[1,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":1,"acting_primary":1,"purged_snaps":[]},{"pgid":"4.37","version":"0'0","reported_seq":14,"reported_epoch":22,"state":"active+clean","last_fresh":"2023-08-01T19:54:25.145994+0000","last_change":"2023-08-01T19:54:04.470971+0000","last_active":"2023-08-01T19:54:25.145994+0000","last_peered":"2023-08-01T19:54:25.145994+0000","last_clean":"2023-08-01T19:54:25.145994+0000","last_became_active":"2023-08-01T19:54:04.469011+0000","last_became_peered":"2023-08-01T19:54:04.469011+0000","last_unstale":"2023-08-01T19:54:25.145994+0000","last_undegraded":"2023-08-01T19:54:25.145994+0000","last_fullsized":"2023-08-01T19:54:25.145994+0000","mapping_epoch":16,"log_start":"0'0","ondisk_log_start":"0'0","created":16,"last_epoch_clean":17,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-08-01T19:54:04.040663+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-08-01T19:54:04.040663+0000","last_clean_scrub_stamp":"2023-08-01T19:54:04.040663+0000","objects_scrubbed":0,"log_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-08-03T06:50:03.420334+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[0,2],"acting":[0,2],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":0,"acting_primary":0,"purged_snaps":[]},{"pgid":"4.36","version":"0'0","reported_seq":14,"reported_epoch":22,"state":"active+clean","last_fresh":"2023-08-01T19:54:25.144691+0000","last_change":"2023-08-01T19:54:04.473523+0000","last_active":"2023-08-01T19:54:25.144691+0000","last_peered":"2023-08-01T19:54:25.144691+0000","last_clean":"2023-08-01T19:54:25.144691+0000","last_became_active":"2023-08-01T19:54:04.473084+0000","last_became_peered":"2023-08-01T19:54:04.473084+0000","last_unstale":"2023-08-01T19:54:25.144691+0000","last_undegraded":"2023-08-01T19:54:25.144691+0000","last_fullsized":"2023-08-01T19:54:25.144691+0000","mapping_epoch":16,"log_start":"0'0","ondisk_log_start":"0'0","created":16,"last_epoch_clean":17,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-08-01T19:54:04.040663+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-08-01T19:54:04.040663+0000","last_clean_scrub_stamp":"2023-08-01T19:54:04.040663+0000","objects_scrubbed":0,"log_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-08-03T04:28:59.042443+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[2,0],"acting":[2,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":2,"acting_primary":2,"purged_snaps":[]},{"pgid":"4.35","version":"0'0","reported_seq":14,"reported_epoch":22,"state":"active+clean","last_fresh":"2023-08-01T19:54:25.151707+0000","last_change":"2023-08-01T19:54:04.475816+0000","last_active":"2023-08-01T19:54:25.151707+0000","last_peered":"2023-08-01T19:54:25.151707+0000","last_clean":"2023-08-01T19:54:25.151707+0000","last_became_active":"2023-08-01T19:54:04.475061+0000","last_became_peered":"2023-08-01T19:54:04.475061+0000","last_unstale":"2023-08-01T19:54:25.151707+0000","last_undegraded":"2023-08-01T19:54:25.151707+0000","last_fullsized":"2023-08-01T19:54:25.151707+0000","mapping_epoch":16,"log_start":"0'0","ondisk_log_start":"0'0","created":16,"last_epoch_clean":17,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-08-01T19:54:04.040663+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-08-01T19:54:04.040663+0000","last_clean_scrub_stamp":"2023-08-01T19:54:04.040663+0000","objects_scrubbed":0,"log_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-08-02T22:07:41.305488+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[1,0],"acting":[1,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":1,"acting_primary":1,"purged_snaps":[]},{"pgid":"4.34","version":"0'0","reported_seq":14,"reported_epoch":22,"state":"active+clean","last_fresh":"2023-08-01T19:54:25.144172+0000","last_change":"2023-08-01T19:54:04.468009+0000","last_active":"2023-08-01T19:54:25.144172+0000","last_peered":"2023-08-01T19:54:25.144172+0000","last_clean":"2023-08-01T19:54:25.144172+0000","last_became_active":"2023-08-01T19:54:04.467568+0000","last_became_peered":"2023-08-01T19:54:04.467568+0000","last_unstale":"2023-08-01T19:54:25.144172+0000","last_undegraded":"2023-08-01T19:54:25.144172+0000","last_fullsized":"2023-08-01T19:54:25.144172+0000","mapping_epoch":16,"log_start":"0'0","ondisk_log_start":"0'0","created":16,"last_epoch_clean":17,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-08-01T19:54:04.040663+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-08-01T19:54:04.040663+0000","last_clean_scrub_stamp":"2023-08-01T19:54:04.040663+0000","objects_scrubbed":0,"log_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-08-03T04:53:44.017572+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[2,1],"acting":[2,1],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":2,"acting_primary":2,"purged_snaps":[]},{"pgid":"4.33","version":"0'0","reported_seq":14,"reported_epoch":22,"state":"active+clean","last_fresh":"2023-08-01T19:54:25.144981+0000","last_change":"2023-08-01T19:54:04.466770+0000","last_active":"2023-08-01T19:54:25.144981+0000","last_peered":"2023-08-01T19:54:25.144981+0000","last_clean":"2023-08-01T19:54:25.144981+0000","last_became_active":"2023-08-01T19:54:04.466460+0000","last_became_peered":"2023-08-01T19:54:04.466460+0000","last_unstale":"2023-08-01T19:54:25.144981+0000","last_undegraded":"2023-08-01T19:54:25.144981+0000","last_fullsized":"2023-08-01T19:54:25.144981+0000","mapping_epoch":16,"log_start":"0'0","ondisk_log_start":"0'0","created":16,"last_epoch_clean":17,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-08-01T19:54:04.040663+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-08-01T19:54:04.040663+0000","last_clean_scrub_stamp":"2023-08-01T19:54:04.040663+0000","objects_scrubbed":0,"log_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-08-03T06:04:11.595951+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[2,0],"acting":[2,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":2,"acting_primary":2,"purged_snaps":[]},{"pgid":"4.32","version":"0'0","reported_seq":14,"reported_epoch":22,"state":"active+clean","last_fresh":"2023-08-01T19:54:25.152046+0000","last_change":"2023-08-01T19:54:04.466634+0000","last_active":"2023-08-01T19:54:25.152046+0000","last_peered":"2023-08-01T19:54:25.152046+0000","last_clean":"2023-08-01T19:54:25.152046+0000","last_became_active":"2023-08-01T19:54:04.466302+0000","last_became_peered":"2023-08-01T19:54:04.466302+0000","last_unstale":"2023-08-01T19:54:25.152046+0000","last_undegraded":"2023-08-01T19:54:25.152046+0000","last_fullsized":"2023-08-01T19:54:25.152046+0000","mapping_epoch":16,"log_start":"0'0","ondisk_log_start":"0'0","created":16,"last_epoch_clean":17,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-08-01T19:54:04.040663+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-08-01T19:54:04.040663+0000","last_clean_scrub_stamp":"2023-08-01T19:54:04.040663+0000","objects_scrubbed":0,"log_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-08-03T05:46:11.085577+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[1,2],"acting":[1,2],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":1,"acting_primary":1,"purged_snaps":[]},{"pgid":"4.31","version":"0'0","reported_seq":14,"reported_epoch":22,"state":"active+clean","last_fresh":"2023-08-01T19:54:25.150885+0000","last_change":"2023-08-01T19:54:04.472407+0000","last_active":"2023-08-01T19:54:25.150885+0000","last_peered":"2023-08-01T19:54:25.150885+0000","last_clean":"2023-08-01T19:54:25.150885+0000","last_became_active":"2023-08-01T19:54:04.472008+0000","last_became_peered":"2023-08-01T19:54:04.472008+0000","last_unstale":"2023-08-01T19:54:25.150885+0000","last_undegraded":"2023-08-01T19:54:25.150885+0000","last_fullsized":"2023-08-01T19:54:25.150885+0000","mapping_epoch":16,"log_start":"0'0","ondisk_log_start":"0'0","created":16,"last_epoch_clean":17,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-08-01T19:54:04.040663+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-08-01T19:54:04.040663+0000","last_clean_scrub_stamp":"2023-08-01T19:54:04.040663+0000","objects_scrubbed":0,"log_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-08-02T22:42:25.293502+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[1,2],"acting":[1,2],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":1,"acting_primary":1,"purged_snaps":[]},{"pgid":"4.30","version":"0'0","reported_seq":14,"reported_epoch":22,"state":"active+clean","last_fresh":"2023-08-01T19:54:25.150695+0000","last_change":"2023-08-01T19:54:04.478283+0000","last_active":"2023-08-01T19:54:25.150695+0000","last_peered":"2023-08-01T19:54:25.150695+0000","last_clean":"2023-08-01T19:54:25.150695+0000","last_became_active":"2023-08-01T19:54:04.476620+0000","last_became_peered":"2023-08-01T19:54:04.476620+0000","last_unstale":"2023-08-01T19:54:25.150695+0000","last_undegraded":"2023-08-01T19:54:25.150695+0000","last_fullsized":"2023-08-01T19:54:25.150695+0000","mapping_epoch":16,"log_start":"0'0","ondisk_log_start":"0'0","created":16,"last_epoch_clean":17,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-08-01T19:54:04.040663+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-08-01T19:54:04.040663+0000","last_clean_scrub_stamp":"2023-08-01T19:54:04.040663+0000","objects_scrubbed":0,"log_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-08-03T02:27:17.063518+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[1,0],"acting":[1,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":1,"acting_primary":1,"purged_snaps":[]},{"pgid":"4.2f","version":"0'0","reported_seq":14,"reported_epoch":22,"state":"active+clean","last_fresh":"2023-08-01T19:54:25.146017+0000","last_change":"2023-08-01T19:54:04.470302+0000","last_active":"2023-08-01T19:54:25.146017+0000","last_peered":"2023-08-01T19:54:25.146017+0000","last_clean":"2023-08-01T19:54:25.146017+0000","last_became_active":"2023-08-01T19:54:04.468919+0000","last_became_peered":"2023-08-01T19:54:04.468919+0000","last_unstale":"2023-08-01T19:54:25.146017+0000","last_undegraded":"2023-08-01T19:54:25.146017+0000","last_fullsized":"2023-08-01T19:54:25.146017+0000","mapping_epoch":16,"log_start":"0'0","ondisk_log_start":"0'0","created":16,"last_epoch_clean":17,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-08-01T19:54:04.040663+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-08-01T19:54:04.040663+0000","last_clean_scrub_stamp":"2023-08-01T19:54:04.040663+0000","objects_scrubbed":0,"log_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-08-02T22:42:25.293502+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[0,2],"acting":[0,2],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":0,"acting_primary":0,"purged_snaps":[]},{"pgid":"4.2e","version":"0'0","reported_seq":14,"reported_epoch":22,"state":"active+clean","last_fresh":"2023-08-01T19:54:25.144959+0000","last_change":"2023-08-01T19:54:04.474058+0000","last_active":"2023-08-01T19:54:25.144959+0000","last_peered":"2023-08-01T19:54:25.144959+0000","last_clean":"2023-08-01T19:54:25.144959+0000","last_became_active":"2023-08-01T19:54:04.473355+0000","last_became_peered":"2023-08-01T19:54:04.473355+0000","last_unstale":"2023-08-01T19:54:25.144959+0000","last_undegraded":"2023-08-01T19:54:25.144959+0000","last_fullsized":"2023-08-01T19:54:25.144959+0000","mapping_epoch":16,"log_start":"0'0","ondisk_log_start":"0'0","created":16,"last_epoch_clean":17,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-08-01T19:54:04.040663+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-08-01T19:54:04.040663+0000","last_clean_scrub_stamp":"2023-08-01T19:54:04.040663+0000","objects_scrubbed":0,"log_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-08-03T04:55:54.197252+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[2,0],"acting":[2,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":2,"acting_primary":2,"purged_snaps":[]},{"pgid":"4.2d","version":"0'0","reported_seq":14,"reported_epoch":22,"state":"active+clean","last_fresh":"2023-08-01T19:54:25.146350+0000","last_change":"2023-08-01T19:54:04.468775+0000","last_active":"2023-08-01T19:54:25.146350+0000","last_peered":"2023-08-01T19:54:25.146350+0000","last_clean":"2023-08-01T19:54:25.146350+0000","last_became_active":"2023-08-01T19:54:04.467274+0000","last_became_peered":"2023-08-01T19:54:04.467274+0000","last_unstale":"2023-08-01T19:54:25.146350+0000","last_undegraded":"2023-08-01T19:54:25.146350+0000","last_fullsized":"2023-08-01T19:54:25.146350+0000","mapping_epoch":16,"log_start":"0'0","ondisk_log_start":"0'0","created":16,"last_epoch_clean":17,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-08-01T19:54:04.040663+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-08-01T19:54:04.040663+0000","last_clean_scrub_stamp":"2023-08-01T19:54:04.040663+0000","objects_scrubbed":0,"log_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-08-02T23:00:37.537286+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[0,2],"acting":[0,2],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":0,"acting_primary":0,"purged_snaps":[]},{"pgid":"4.2c","version":"0'0","reported_seq":14,"reported_epoch":22,"state":"active+clean","last_fresh":"2023-08-01T19:54:25.152156+0000","last_change":"2023-08-01T19:54:04.478409+0000","last_active":"2023-08-01T19:54:25.152156+0000","last_peered":"2023-08-01T19:54:25.152156+0000","last_clean":"2023-08-01T19:54:25.152156+0000","last_became_active":"2023-08-01T19:54:04.477133+0000","last_became_peered":"2023-08-01T19:54:04.477133+0000","last_unstale":"2023-08-01T19:54:25.152156+0000","last_undegraded":"2023-08-01T19:54:25.152156+0000","last_fullsized":"2023-08-01T19:54:25.152156+0000","mapping_epoch":16,"log_start":"0'0","ondisk_log_start":"0'0","created":16,"last_epoch_clean":17,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-08-01T19:54:04.040663+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-08-01T19:54:04.040663+0000","last_clean_scrub_stamp":"2023-08-01T19:54:04.040663+0000","objects_scrubbed":0,"log_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-08-02T22:15:19.744281+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[1,0],"acting":[1,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":1,"acting_primary":1,"purged_snaps":[]},{"pgid":"4.2b","version":"0'0","reported_seq":14,"reported_epoch":22,"state":"active+clean","last_fresh":"2023-08-01T19:54:25.151246+0000","last_change":"2023-08-01T19:54:04.474047+0000","last_active":"2023-08-01T19:54:25.151246+0000","last_peered":"2023-08-01T19:54:25.151246+0000","last_clean":"2023-08-01T19:54:25.151246+0000","last_became_active":"2023-08-01T19:54:04.473578+0000","last_became_peered":"2023-08-01T19:54:04.473578+0000","last_unstale":"2023-08-01T19:54:25.151246+0000","last_undegraded":"2023-08-01T19:54:25.151246+0000","last_fullsized":"2023-08-01T19:54:25.151246+0000","mapping_epoch":16,"log_start":"0'0","ondisk_log_start":"0'0","created":16,"last_epoch_clean":17,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-08-01T19:54:04.040663+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-08-01T19:54:04.040663+0000","last_clean_scrub_stamp":"2023-08-01T19:54:04.040663+0000","objects_scrubbed":0,"log_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-08-03T05:39:29.199142+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[1,0],"acting":[1,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":1,"acting_primary":1,"purged_snaps":[]},{"pgid":"4.2a","version":"0'0","reported_seq":14,"reported_epoch":22,"state":"active+clean","last_fresh":"2023-08-01T19:54:25.144631+0000","last_change":"2023-08-01T19:54:04.469281+0000","last_active":"2023-08-01T19:54:25.144631+0000","last_peered":"2023-08-01T19:54:25.144631+0000","last_clean":"2023-08-01T19:54:25.144631+0000","last_became_active":"2023-08-01T19:54:04.468771+0000","last_became_peered":"2023-08-01T19:54:04.468771+0000","last_unstale":"2023-08-01T19:54:25.144631+0000","last_undegraded":"2023-08-01T19:54:25.144631+0000","last_fullsized":"2023-08-01T19:54:25.144631+0000","mapping_epoch":16,"log_start":"0'0","ondisk_log_start":"0'0","created":16,"last_epoch_clean":17,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-08-01T19:54:04.040663+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-08-01T19:54:04.040663+0000","last_clean_scrub_stamp":"2023-08-01T19:54:04.040663+0000","objects_scrubbed":0,"log_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-08-03T01:15:27.748810+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[2,1],"acting":[2,1],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":2,"acting_primary":2,"purged_snaps":[]},{"pgid":"4.29","version":"0'0","reported_seq":14,"reported_epoch":22,"state":"active+clean","last_fresh":"2023-08-01T19:54:25.145134+0000","last_change":"2023-08-01T19:54:04.466694+0000","last_active":"2023-08-01T19:54:25.145134+0000","last_peered":"2023-08-01T19:54:25.145134+0000","last_clean":"2023-08-01T19:54:25.145134+0000","last_became_active":"2023-08-01T19:54:04.466250+0000","last_became_peered":"2023-08-01T19:54:04.466250+0000","last_unstale":"2023-08-01T19:54:25.145134+0000","last_undegraded":"2023-08-01T19:54:25.145134+0000","last_fullsized":"2023-08-01T19:54:25.145134+0000","mapping_epoch":16,"log_start":"0'0","ondisk_log_start":"0'0","created":16,"last_epoch_clean":17,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-08-01T19:54:04.040663+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-08-01T19:54:04.040663+0000","last_clean_scrub_stamp":"2023-08-01T19:54:04.040663+0000","objects_scrubbed":0,"log_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-08-03T01:00:18.725898+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[0,1],"acting":[0,1],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":0,"acting_primary":0,"purged_snaps":[]},{"pgid":"4.28","version":"0'0","reported_seq":14,"reported_epoch":22,"state":"active+clean","last_fresh":"2023-08-01T19:54:25.143257+0000","last_change":"2023-08-01T19:54:04.468160+0000","last_active":"2023-08-01T19:54:25.143257+0000","last_peered":"2023-08-01T19:54:25.143257+0000","last_clean":"2023-08-01T19:54:25.143257+0000","last_became_active":"2023-08-01T19:54:04.467625+0000","last_became_peered":"2023-08-01T19:54:04.467625+0000","last_unstale":"2023-08-01T19:54:25.143257+0000","last_undegraded":"2023-08-01T19:54:25.143257+0000","last_fullsized":"2023-08-01T19:54:25.143257+0000","mapping_epoch":16,"log_start":"0'0","ondisk_log_start":"0'0","created":16,"last_epoch_clean":17,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-08-01T19:54:04.040663+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-08-01T19:54:04.040663+0000","last_clean_scrub_stamp":"2023-08-01T19:54:04.040663+0000","objects_scrubbed":0,"log_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-08-02T21:27:52.506153+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[2,0],"acting":[2,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":2,"acting_primary":2,"purged_snaps":[]},{"pgid":"4.27","version":"0'0","reported_seq":14,"reported_epoch":22,"state":"active+clean","last_fresh":"2023-08-01T19:54:25.144401+0000","last_change":"2023-08-01T19:54:04.469187+0000","last_active":"2023-08-01T19:54:25.144401+0000","last_peered":"2023-08-01T19:54:25.144401+0000","last_clean":"2023-08-01T19:54:25.144401+0000","last_became_active":"2023-08-01T19:54:04.468628+0000","last_became_peered":"2023-08-01T19:54:04.468628+0000","last_unstale":"2023-08-01T19:54:25.144401+0000","last_undegraded":"2023-08-01T19:54:25.144401+0000","last_fullsized":"2023-08-01T19:54:25.144401+0000","mapping_epoch":16,"log_start":"0'0","ondisk_log_start":"0'0","created":16,"last_epoch_clean":17,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-08-01T19:54:04.040663+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-08-01T19:54:04.040663+0000","last_clean_scrub_stamp":"2023-08-01T19:54:04.040663+0000","objects_scrubbed":0,"log_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-08-03T00:07:29.565677+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[2,1],"acting":[2,1],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":2,"acting_primary":2,"purged_snaps":[]},{"pgid":"4.26","version":"0'0","reported_seq":14,"reported_epoch":22,"state":"active+clean","last_fresh":"2023-08-01T19:54:25.146279+0000","last_change":"2023-08-01T19:54:04.470942+0000","last_active":"2023-08-01T19:54:25.146279+0000","last_peered":"2023-08-01T19:54:25.146279+0000","last_clean":"2023-08-01T19:54:25.146279+0000","last_became_active":"2023-08-01T19:54:04.470564+0000","last_became_peered":"2023-08-01T19:54:04.470564+0000","last_unstale":"2023-08-01T19:54:25.146279+0000","last_undegraded":"2023-08-01T19:54:25.146279+0000","last_fullsized":"2023-08-01T19:54:25.146279+0000","mapping_epoch":16,"log_start":"0'0","ondisk_log_start":"0'0","created":16,"last_epoch_clean":17,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-08-01T19:54:04.040663+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-08-01T19:54:04.040663+0000","last_clean_scrub_stamp":"2023-08-01T19:54:04.040663+0000","objects_scrubbed":0,"log_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-08-03T04:43:21.408174+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[0,1],"acting":[0,1],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":0,"acting_primary":0,"purged_snaps":[]},{"pgid":"4.25","version":"0'0","reported_seq":14,"reported_epoch":22,"state":"active+clean","last_fresh":"2023-08-01T19:54:25.151792+0000","last_change":"2023-08-01T19:54:04.474813+0000","last_active":"2023-08-01T19:54:25.151792+0000","last_peered":"2023-08-01T19:54:25.151792+0000","last_clean":"2023-08-01T19:54:25.151792+0000","last_became_active":"2023-08-01T19:54:04.472530+0000","last_became_peered":"2023-08-01T19:54:04.472530+0000","last_unstale":"2023-08-01T19:54:25.151792+0000","last_undegraded":"2023-08-01T19:54:25.151792+0000","last_fullsized":"2023-08-01T19:54:25.151792+0000","mapping_epoch":16,"log_start":"0'0","ondisk_log_start":"0'0","created":16,"last_epoch_clean":17,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-08-01T19:54:04.040663+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-08-01T19:54:04.040663+0000","last_clean_scrub_stamp":"2023-08-01T19:54:04.040663+0000","objects_scrubbed":0,"log_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-08-03T01:00:18.725898+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[1,2],"acting":[1,2],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":1,"acting_primary":1,"purged_snaps":[]},{"pgid":"3.1a","version":"17'1","reported_seq":16,"reported_epoch":22,"state":"active+clean","last_fresh":"2023-08-01T19:54:25.143829+0000","last_change":"2023-08-01T19:54:04.063936+0000","last_active":"2023-08-01T19:54:25.143829+0000","last_peered":"2023-08-01T19:54:25.143829+0000","last_clean":"2023-08-01T19:54:25.143829+0000","last_became_active":"2023-08-01T19:54:04.063674+0000","last_became_peered":"2023-08-01T19:54:04.063674+0000","last_unstale":"2023-08-01T19:54:25.143829+0000","last_undegraded":"2023-08-01T19:54:25.143829+0000","last_fullsized":"2023-08-01T19:54:25.143829+0000","mapping_epoch":15,"log_start":"0'0","ondisk_log_start":"0'0","created":15,"last_epoch_clean":16,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-08-01T19:54:03.032665+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-08-01T19:54:03.032665+0000","last_clean_scrub_stamp":"2023-08-01T19:54:03.032665+0000","objects_scrubbed":0,"log_size":1,"ondisk_log_size":1,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-08-03T00:06:00.058200+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[2,0],"acting":[2,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":2,"acting_primary":2,"purged_snaps":[]},{"pgid":"4.1d","version":"0'0","reported_seq":14,"reported_epoch":22,"state":"active+clean","last_fresh":"2023-08-01T19:54:25.144736+0000","last_change":"2023-08-01T19:54:04.471916+0000","last_active":"2023-08-01T19:54:25.144736+0000","last_peered":"2023-08-01T19:54:25.144736+0000","last_clean":"2023-08-01T19:54:25.144736+0000","last_became_active":"2023-08-01T19:54:04.471480+0000","last_became_peered":"2023-08-01T19:54:04.471480+0000","last_unstale":"2023-08-01T19:54:25.144736+0000","last_undegraded":"2023-08-01T19:54:25.144736+0000","last_fullsized":"2023-08-01T19:54:25.144736+0000","mapping_epoch":16,"log_start":"0'0","ondisk_log_start":"0'0","created":16,"last_epoch_clean":17,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-08-01T19:54:04.040663+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-08-01T19:54:04.040663+0000","last_clean_scrub_stamp":"2023-08-01T19:54:04.040663+0000","objects_scrubbed":0,"log_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-08-02T21:19:17.547590+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[2,1],"acting":[2,1],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":2,"acting_primary":2,"purged_snaps":[]},{"pgid":"3.19","version":"0'0","reported_seq":15,"reported_epoch":22,"state":"active+clean","last_fresh":"2023-08-01T19:54:25.145136+0000","last_change":"2023-08-01T19:54:04.067837+0000","last_active":"2023-08-01T19:54:25.145136+0000","last_peered":"2023-08-01T19:54:25.145136+0000","last_clean":"2023-08-01T19:54:25.145136+0000","last_became_active":"2023-08-01T19:54:04.067535+0000","last_became_peered":"2023-08-01T19:54:04.067535+0000","last_unstale":"2023-08-01T19:54:25.145136+0000","last_undegraded":"2023-08-01T19:54:25.145136+0000","last_fullsized":"2023-08-01T19:54:25.145136+0000","mapping_epoch":15,"log_start":"0'0","ondisk_log_start":"0'0","created":15,"last_epoch_clean":16,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-08-01T19:54:03.032665+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-08-01T19:54:03.032665+0000","last_clean_scrub_stamp":"2023-08-01T19:54:03.032665+0000","objects_scrubbed":0,"log_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-08-02T20:56:47.324761+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[0,1],"acting":[0,1],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":0,"acting_primary":0,"purged_snaps":[]},{"pgid":"4.1e","version":"0'0","reported_seq":14,"reported_epoch":22,"state":"active+clean","last_fresh":"2023-08-01T19:54:25.146446+0000","last_change":"2023-08-01T19:54:04.470544+0000","last_active":"2023-08-01T19:54:25.146446+0000","last_peered":"2023-08-01T19:54:25.146446+0000","last_clean":"2023-08-01T19:54:25.146446+0000","last_became_active":"2023-08-01T19:54:04.469657+0000","last_became_peered":"2023-08-01T19:54:04.469657+0000","last_unstale":"2023-08-01T19:54:25.146446+0000","last_undegraded":"2023-08-01T19:54:25.146446+0000","last_fullsized":"2023-08-01T19:54:25.146446+0000","mapping_epoch":16,"log_start":"0'0","ondisk_log_start":"0'0","created":16,"last_epoch_clean":17,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-08-01T19:54:04.040663+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-08-01T19:54:04.040663+0000","last_clean_scrub_stamp":"2023-08-01T19:54:04.040663+0000","objects_scrubbed":0,"log_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-08-02T23:12:30.830199+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[0,1],"acting":[0,1],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":0,"acting_primary":0,"purged_snaps":[]},{"pgid":"3.18","version":"0'0","reported_seq":15,"reported_epoch":22,"state":"active+clean","last_fresh":"2023-08-01T19:54:25.145371+0000","last_change":"2023-08-01T19:54:04.064289+0000","last_active":"2023-08-01T19:54:25.145371+0000","last_peered":"2023-08-01T19:54:25.145371+0000","last_clean":"2023-08-01T19:54:25.145371+0000","last_became_active":"2023-08-01T19:54:04.063971+0000","last_became_peered":"2023-08-01T19:54:04.063971+0000","last_unstale":"2023-08-01T19:54:25.145371+0000","last_undegraded":"2023-08-01T19:54:25.145371+0000","last_fullsized":"2023-08-01T19:54:25.145371+0000","mapping_epoch":15,"log_start":"0'0","ondisk_log_start":"0'0","created":15,"last_epoch_clean":16,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-08-01T19:54:03.032665+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-08-01T19:54:03.032665+0000","last_clean_scrub_stamp":"2023-08-01T19:54:03.032665+0000","objects_scrubbed":0,"log_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-08-03T04:09:30.496098+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[0,2],"acting":[0,2],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":0,"acting_primary":0,"purged_snaps":[]},{"pgid":"4.1f","version":"0'0","reported_seq":14,"reported_epoch":22,"state":"active+clean","last_fresh":"2023-08-01T19:54:25.144278+0000","last_change":"2023-08-01T19:54:04.472227+0000","last_active":"2023-08-01T19:54:25.144278+0000","last_peered":"2023-08-01T19:54:25.144278+0000","last_clean":"2023-08-01T19:54:25.144278+0000","last_became_active":"2023-08-01T19:54:04.471767+0000","last_became_peered":"2023-08-01T19:54:04.471767+0000","last_unstale":"2023-08-01T19:54:25.144278+0000","last_undegraded":"2023-08-01T19:54:25.144278+0000","last_fullsized":"2023-08-01T19:54:25.144278+0000","mapping_epoch":16,"log_start":"0'0","ondisk_log_start":"0'0","created":16,"last_epoch_clean":17,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-08-01T19:54:04.040663+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-08-01T19:54:04.040663+0000","last_clean_scrub_stamp":"2023-08-01T19:54:04.040663+0000","objects_scrubbed":0,"log_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-08-02T20:25:25.280329+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[2,1],"acting":[2,1],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":2,"acting_primary":2,"purged_snaps":[]},{"pgid":"3.17","version":"0'0","reported_seq":15,"reported_epoch":22,"state":"active+clean","last_fresh":"2023-08-01T19:54:25.146202+0000","last_change":"2023-08-01T19:54:04.067975+0000","last_active":"2023-08-01T19:54:25.146202+0000","last_peered":"2023-08-01T19:54:25.146202+0000","last_clean":"2023-08-01T19:54:25.146202+0000","last_became_active":"2023-08-01T19:54:04.067577+0000","last_became_peered":"2023-08-01T19:54:04.067577+0000","last_unstale":"2023-08-01T19:54:25.146202+0000","last_undegraded":"2023-08-01T19:54:25.146202+0000","last_fullsized":"2023-08-01T19:54:25.146202+0000","mapping_epoch":15,"log_start":"0'0","ondisk_log_start":"0'0","created":15,"last_epoch_clean":16,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-08-01T19:54:03.032665+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-08-01T19:54:03.032665+0000","last_clean_scrub_stamp":"2023-08-01T19:54:03.032665+0000","objects_scrubbed":0,"log_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-08-03T07:13:34.025722+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[0,1],"acting":[0,1],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":0,"acting_primary":0,"purged_snaps":[]},{"pgid":"4.10","version":"0'0","reported_seq":14,"reported_epoch":22,"state":"active+clean","last_fresh":"2023-08-01T19:54:25.145306+0000","last_change":"2023-08-01T19:54:04.467146+0000","last_active":"2023-08-01T19:54:25.145306+0000","last_peered":"2023-08-01T19:54:25.145306+0000","last_clean":"2023-08-01T19:54:25.145306+0000","last_became_active":"2023-08-01T19:54:04.466627+0000","last_became_peered":"2023-08-01T19:54:04.466627+0000","last_unstale":"2023-08-01T19:54:25.145306+0000","last_undegraded":"2023-08-01T19:54:25.145306+0000","last_fullsized":"2023-08-01T19:54:25.145306+0000","mapping_epoch":16,"log_start":"0'0","ondisk_log_start":"0'0","created":16,"last_epoch_clean":17,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-08-01T19:54:04.040663+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-08-01T19:54:04.040663+0000","last_clean_scrub_stamp":"2023-08-01T19:54:04.040663+0000","objects_scrubbed":0,"log_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-08-03T04:43:26.793480+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[0,2],"acting":[0,2],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":0,"acting_primary":0,"purged_snaps":[]},{"pgid":"3.16","version":"0'0","reported_seq":15,"reported_epoch":22,"state":"active+clean","last_fresh":"2023-08-01T19:54:25.151608+0000","last_change":"2023-08-01T19:54:04.065042+0000","last_active":"2023-08-01T19:54:25.151608+0000","last_peered":"2023-08-01T19:54:25.151608+0000","last_clean":"2023-08-01T19:54:25.151608+0000","last_became_active":"2023-08-01T19:54:04.064040+0000","last_became_peered":"2023-08-01T19:54:04.064040+0000","last_unstale":"2023-08-01T19:54:25.151608+0000","last_undegraded":"2023-08-01T19:54:25.151608+0000","last_fullsized":"2023-08-01T19:54:25.151608+0000","mapping_epoch":15,"log_start":"0'0","ondisk_log_start":"0'0","created":15,"last_epoch_clean":16,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-08-01T19:54:03.032665+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-08-01T19:54:03.032665+0000","last_clean_scrub_stamp":"2023-08-01T19:54:03.032665+0000","objects_scrubbed":0,"log_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-08-03T03:40:43.460182+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[1,0],"acting":[1,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":1,"acting_primary":1,"purged_snaps":[]},{"pgid":"4.11","version":"0'0","reported_seq":14,"reported_epoch":22,"state":"active+clean","last_fresh":"2023-08-01T19:54:25.145230+0000","last_change":"2023-08-01T19:54:04.470401+0000","last_active":"2023-08-01T19:54:25.145230+0000","last_peered":"2023-08-01T19:54:25.145230+0000","last_clean":"2023-08-01T19:54:25.145230+0000","last_became_active":"2023-08-01T19:54:04.469680+0000","last_became_peered":"2023-08-01T19:54:04.469680+0000","last_unstale":"2023-08-01T19:54:25.145230+0000","last_undegraded":"2023-08-01T19:54:25.145230+0000","last_fullsized":"2023-08-01T19:54:25.145230+0000","mapping_epoch":16,"log_start":"0'0","ondisk_log_start":"0'0","created":16,"last_epoch_clean":17,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-08-01T19:54:04.040663+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-08-01T19:54:04.040663+0000","last_clean_scrub_stamp":"2023-08-01T19:54:04.040663+0000","objects_scrubbed":0,"log_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-08-03T03:58:06.360840+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[0,1],"acting":[0,1],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":0,"acting_primary":0,"purged_snaps":[]},{"pgid":"3.15","version":"17'3","reported_seq":18,"reported_epoch":22,"state":"active+clean","last_fresh":"2023-08-01T19:54:25.144236+0000","last_change":"2023-08-01T19:54:04.065443+0000","last_active":"2023-08-01T19:54:25.144236+0000","last_peered":"2023-08-01T19:54:25.144236+0000","last_clean":"2023-08-01T19:54:25.144236+0000","last_became_active":"2023-08-01T19:54:04.065112+0000","last_became_peered":"2023-08-01T19:54:04.065112+0000","last_unstale":"2023-08-01T19:54:25.144236+0000","last_undegraded":"2023-08-01T19:54:25.144236+0000","last_fullsized":"2023-08-01T19:54:25.144236+0000","mapping_epoch":15,"log_start":"0'0","ondisk_log_start":"0'0","created":15,"last_epoch_clean":16,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-08-01T19:54:03.032665+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-08-01T19:54:03.032665+0000","last_clean_scrub_stamp":"2023-08-01T19:54:03.032665+0000","objects_scrubbed":0,"log_size":3,"ondisk_log_size":3,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-08-03T03:27:50.887004+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":90,"num_objects":2,"num_object_clones":0,"num_object_copies":4,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":2,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":4,"num_write_kb":1,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":1,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[2,1],"acting":[2,1],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":2,"acting_primary":2,"purged_snaps":[]},{"pgid":"4.12","version":"0'0","reported_seq":14,"reported_epoch":22,"state":"active+clean","last_fresh":"2023-08-01T19:54:25.146656+0000","last_change":"2023-08-01T19:54:04.467822+0000","last_active":"2023-08-01T19:54:25.146656+0000","last_peered":"2023-08-01T19:54:25.146656+0000","last_clean":"2023-08-01T19:54:25.146656+0000","last_became_active":"2023-08-01T19:54:04.466667+0000","last_became_peered":"2023-08-01T19:54:04.466667+0000","last_unstale":"2023-08-01T19:54:25.146656+0000","last_undegraded":"2023-08-01T19:54:25.146656+0000","last_fullsized":"2023-08-01T19:54:25.146656+0000","mapping_epoch":16,"log_start":"0'0","ondisk_log_start":"0'0","created":16,"last_epoch_clean":17,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-08-01T19:54:04.040663+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-08-01T19:54:04.040663+0000","last_clean_scrub_stamp":"2023-08-01T19:54:04.040663+0000","objects_scrubbed":0,"log_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-08-03T02:57:18.148077+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[0,2],"acting":[0,2],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":0,"acting_primary":0,"purged_snaps":[]},{"pgid":"3.14","version":"17'6","reported_seq":21,"reported_epoch":22,"state":"active+clean","last_fresh":"2023-08-01T19:54:25.152112+0000","last_change":"2023-08-01T19:54:04.061419+0000","last_active":"2023-08-01T19:54:25.152112+0000","last_peered":"2023-08-01T19:54:25.152112+0000","last_clean":"2023-08-01T19:54:25.152112+0000","last_became_active":"2023-08-01T19:54:04.061078+0000","last_became_peered":"2023-08-01T19:54:04.061078+0000","last_unstale":"2023-08-01T19:54:25.152112+0000","last_undegraded":"2023-08-01T19:54:25.152112+0000","last_fullsized":"2023-08-01T19:54:25.152112+0000","mapping_epoch":15,"log_start":"0'0","ondisk_log_start":"0'0","created":15,"last_epoch_clean":16,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-08-01T19:54:03.032665+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-08-01T19:54:03.032665+0000","last_clean_scrub_stamp":"2023-08-01T19:54:03.032665+0000","objects_scrubbed":0,"log_size":6,"ondisk_log_size":6,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-08-02T21:35:44.874727+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":1536,"num_objects":4,"num_object_clones":0,"num_object_copies":8,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":4,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":6,"num_write_kb":3,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":1,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[1,2],"acting":[1,2],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":1,"acting_primary":1,"purged_snaps":[]},{"pgid":"4.13","version":"0'0","reported_seq":14,"reported_epoch":22,"state":"active+clean","last_fresh":"2023-08-01T19:54:25.151567+0000","last_change":"2023-08-01T19:54:04.466400+0000","last_active":"2023-08-01T19:54:25.151567+0000","last_peered":"2023-08-01T19:54:25.151567+0000","last_clean":"2023-08-01T19:54:25.151567+0000","last_became_active":"2023-08-01T19:54:04.465979+0000","last_became_peered":"2023-08-01T19:54:04.465979+0000","last_unstale":"2023-08-01T19:54:25.151567+0000","last_undegraded":"2023-08-01T19:54:25.151567+0000","last_fullsized":"2023-08-01T19:54:25.151567+0000","mapping_epoch":16,"log_start":"0'0","ondisk_log_start":"0'0","created":16,"last_epoch_clean":17,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-08-01T19:54:04.040663+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-08-01T19:54:04.040663+0000","last_clean_scrub_stamp":"2023-08-01T19:54:04.040663+0000","objects_scrubbed":0,"log_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-08-02T20:20:59.989030+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[1,2],"acting":[1,2],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":1,"acting_primary":1,"purged_snaps":[]},{"pgid":"3.13","version":"17'2","reported_seq":17,"reported_epoch":22,"state":"active+clean","last_fresh":"2023-08-01T19:54:25.151614+0000","last_change":"2023-08-01T19:54:04.065212+0000","last_active":"2023-08-01T19:54:25.151614+0000","last_peered":"2023-08-01T19:54:25.151614+0000","last_clean":"2023-08-01T19:54:25.151614+0000","last_became_active":"2023-08-01T19:54:04.064375+0000","last_became_peered":"2023-08-01T19:54:04.064375+0000","last_unstale":"2023-08-01T19:54:25.151614+0000","last_undegraded":"2023-08-01T19:54:25.151614+0000","last_fullsized":"2023-08-01T19:54:25.151614+0000","mapping_epoch":15,"log_start":"0'0","ondisk_log_start":"0'0","created":15,"last_epoch_clean":16,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-08-01T19:54:03.032665+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-08-01T19:54:03.032665+0000","last_clean_scrub_stamp":"2023-08-01T19:54:03.032665+0000","objects_scrubbed":0,"log_size":2,"ondisk_log_size":2,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-08-03T06:17:37.910752+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":34,"num_objects":2,"num_object_clones":0,"num_object_copies":4,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":2,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":3,"num_write_kb":6,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":1,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[1,0],"acting":[1,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":1,"acting_primary":1,"purged_snaps":[]},{"pgid":"4.14","version":"0'0","reported_seq":14,"reported_epoch":22,"state":"active+clean","last_fresh":"2023-08-01T19:54:25.144257+0000","last_change":"2023-08-01T19:54:04.464446+0000","last_active":"2023-08-01T19:54:25.144257+0000","last_peered":"2023-08-01T19:54:25.144257+0000","last_clean":"2023-08-01T19:54:25.144257+0000","last_became_active":"2023-08-01T19:54:04.464021+0000","last_became_peered":"2023-08-01T19:54:04.464021+0000","last_unstale":"2023-08-01T19:54:25.144257+0000","last_undegraded":"2023-08-01T19:54:25.144257+0000","last_fullsized":"2023-08-01T19:54:25.144257+0000","mapping_epoch":16,"log_start":"0'0","ondisk_log_start":"0'0","created":16,"last_epoch_clean":17,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-08-01T19:54:04.040663+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-08-01T19:54:04.040663+0000","last_clean_scrub_stamp":"2023-08-01T19:54:04.040663+0000","objects_scrubbed":0,"log_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-08-02T20:26:51.080849+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[2,0],"acting":[2,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":2,"acting_primary":2,"purged_snaps":[]},{"pgid":"3.12","version":"0'0","reported_seq":15,"reported_epoch":22,"state":"active+clean","last_fresh":"2023-08-01T19:54:25.146760+0000","last_change":"2023-08-01T19:54:04.066566+0000","last_active":"2023-08-01T19:54:25.146760+0000","last_peered":"2023-08-01T19:54:25.146760+0000","last_clean":"2023-08-01T19:54:25.146760+0000","last_became_active":"2023-08-01T19:54:04.066190+0000","last_became_peered":"2023-08-01T19:54:04.066190+0000","last_unstale":"2023-08-01T19:54:25.146760+0000","last_undegraded":"2023-08-01T19:54:25.146760+0000","last_fullsized":"2023-08-01T19:54:25.146760+0000","mapping_epoch":15,"log_start":"0'0","ondisk_log_start":"0'0","created":15,"last_epoch_clean":16,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-08-01T19:54:03.032665+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-08-01T19:54:03.032665+0000","last_clean_scrub_stamp":"2023-08-01T19:54:03.032665+0000","objects_scrubbed":0,"log_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-08-03T02:01:47.073630+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[0,1],"acting":[0,1],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":0,"acting_primary":0,"purged_snaps":[]},{"pgid":"4.15","version":"0'0","reported_seq":14,"reported_epoch":22,"state":"active+clean","last_fresh":"2023-08-01T19:54:25.144556+0000","last_change":"2023-08-01T19:54:04.468791+0000","last_active":"2023-08-01T19:54:25.144556+0000","last_peered":"2023-08-01T19:54:25.144556+0000","last_clean":"2023-08-01T19:54:25.144556+0000","last_became_active":"2023-08-01T19:54:04.468214+0000","last_became_peered":"2023-08-01T19:54:04.468214+0000","last_unstale":"2023-08-01T19:54:25.144556+0000","last_undegraded":"2023-08-01T19:54:25.144556+0000","last_fullsized":"2023-08-01T19:54:25.144556+0000","mapping_epoch":16,"log_start":"0'0","ondisk_log_start":"0'0","created":16,"last_epoch_clean":17,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-08-01T19:54:04.040663+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-08-01T19:54:04.040663+0000","last_clean_scrub_stamp":"2023-08-01T19:54:04.040663+0000","objects_scrubbed":0,"log_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-08-03T04:10:44.729287+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[2,0],"acting":[2,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":2,"acting_primary":2,"purged_snaps":[]},{"pgid":"3.11","version":"0'0","reported_seq":15,"reported_epoch":22,"state":"active+clean","last_fresh":"2023-08-01T19:54:25.143232+0000","last_change":"2023-08-01T19:54:04.064280+0000","last_active":"2023-08-01T19:54:25.143232+0000","last_peered":"2023-08-01T19:54:25.143232+0000","last_clean":"2023-08-01T19:54:25.143232+0000","last_became_active":"2023-08-01T19:54:04.064064+0000","last_became_peered":"2023-08-01T19:54:04.064064+0000","last_unstale":"2023-08-01T19:54:25.143232+0000","last_undegraded":"2023-08-01T19:54:25.143232+0000","last_fullsized":"2023-08-01T19:54:25.143232+0000","mapping_epoch":15,"log_start":"0'0","ondisk_log_start":"0'0","created":15,"last_epoch_clean":16,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-08-01T19:54:03.032665+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-08-01T19:54:03.032665+0000","last_clean_scrub_stamp":"2023-08-01T19:54:03.032665+0000","objects_scrubbed":0,"log_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-08-03T06:13:51.475710+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[2,1],"acting":[2,1],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":2,"acting_primary":2,"purged_snaps":[]},{"pgid":"4.16","version":"0'0","reported_seq":14,"reported_epoch":22,"state":"active+clean","last_fresh":"2023-08-01T19:54:25.146535+0000","last_change":"2023-08-01T19:54:04.469724+0000","last_active":"2023-08-01T19:54:25.146535+0000","last_peered":"2023-08-01T19:54:25.146535+0000","last_clean":"2023-08-01T19:54:25.146535+0000","last_became_active":"2023-08-01T19:54:04.469275+0000","last_became_peered":"2023-08-01T19:54:04.469275+0000","last_unstale":"2023-08-01T19:54:25.146535+0000","last_undegraded":"2023-08-01T19:54:25.146535+0000","last_fullsized":"2023-08-01T19:54:25.146535+0000","mapping_epoch":16,"log_start":"0'0","ondisk_log_start":"0'0","created":16,"last_epoch_clean":17,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-08-01T19:54:04.040663+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-08-01T19:54:04.040663+0000","last_clean_scrub_stamp":"2023-08-01T19:54:04.040663+0000","objects_scrubbed":0,"log_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-08-03T03:04:06.137335+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[0,1],"acting":[0,1],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":0,"acting_primary":0,"purged_snaps":[]},{"pgid":"3.10","version":"17'8","reported_seq":23,"reported_epoch":22,"state":"active+clean","last_fresh":"2023-08-01T19:54:25.150853+0000","last_change":"2023-08-01T19:54:04.060962+0000","last_active":"2023-08-01T19:54:25.150853+0000","last_peered":"2023-08-01T19:54:25.150853+0000","last_clean":"2023-08-01T19:54:25.150853+0000","last_became_active":"2023-08-01T19:54:04.060576+0000","last_became_peered":"2023-08-01T19:54:04.060576+0000","last_unstale":"2023-08-01T19:54:25.150853+0000","last_undegraded":"2023-08-01T19:54:25.150853+0000","last_fullsized":"2023-08-01T19:54:25.150853+0000","mapping_epoch":15,"log_start":"0'0","ondisk_log_start":"0'0","created":15,"last_epoch_clean":16,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-08-01T19:54:03.032665+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-08-01T19:54:03.032665+0000","last_clean_scrub_stamp":"2023-08-01T19:54:03.032665+0000","objects_scrubbed":0,"log_size":8,"ondisk_log_size":8,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-08-03T05:00:51.171444+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":4,"num_object_clones":0,"num_object_copies":8,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":4,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":12,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":4,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[1,2],"acting":[1,2],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":1,"acting_primary":1,"purged_snaps":[]},{"pgid":"4.17","version":"0'0","reported_seq":14,"reported_epoch":22,"state":"active+clean","last_fresh":"2023-08-01T19:54:25.146401+0000","last_change":"2023-08-01T19:54:04.472721+0000","last_active":"2023-08-01T19:54:25.146401+0000","last_peered":"2023-08-01T19:54:25.146401+0000","last_clean":"2023-08-01T19:54:25.146401+0000","last_became_active":"2023-08-01T19:54:04.472126+0000","last_became_peered":"2023-08-01T19:54:04.472126+0000","last_unstale":"2023-08-01T19:54:25.146401+0000","last_undegraded":"2023-08-01T19:54:25.146401+0000","last_fullsized":"2023-08-01T19:54:25.146401+0000","mapping_epoch":16,"log_start":"0'0","ondisk_log_start":"0'0","created":16,"last_epoch_clean":17,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-08-01T19:54:04.040663+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-08-01T19:54:04.040663+0000","last_clean_scrub_stamp":"2023-08-01T19:54:04.040663+0000","objects_scrubbed":0,"log_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-08-03T00:29:05.857138+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[0,1],"acting":[0,1],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":0,"acting_primary":0,"purged_snaps":[]},{"pgid":"5.9","version":"23'1385","reported_seq":1396,"reported_epoch":23,"state":"active+clean","last_fresh":"2023-08-01T19:54:29.906592+0000","last_change":"2023-08-01T19:54:23.134838+0000","last_active":"2023-08-01T19:54:29.906592+0000","last_peered":"2023-08-01T19:54:29.906592+0000","last_clean":"2023-08-01T19:54:29.906592+0000","last_became_active":"2023-08-01T19:54:23.134628+0000","last_became_peered":"2023-08-01T19:54:23.134628+0000","last_unstale":"2023-08-01T19:54:29.906592+0000","last_undegraded":"2023-08-01T19:54:29.906592+0000","last_fullsized":"2023-08-01T19:54:29.906592+0000","mapping_epoch":19,"log_start":"0'0","ondisk_log_start":"0'0","created":19,"last_epoch_clean":20,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-08-01T19:54:22.116710+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-08-01T19:54:22.116710+0000","last_clean_scrub_stamp":"2023-08-01T19:54:22.116710+0000","objects_scrubbed":0,"log_size":1385,"ondisk_log_size":1385,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-08-03T05:57:20.085794+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":90767360,"num_objects":1385,"num_object_clones":0,"num_object_copies":2770,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":1385,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":1385,"num_write_kb":88640,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[1,2],"acting":[1,2],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":1,"acting_primary":1,"purged_snaps":[]},{"pgid":"3.f","version":"17'1","reported_seq":16,"reported_epoch":22,"state":"active+clean","last_fresh":"2023-08-01T19:54:25.152062+0000","last_change":"2023-08-01T19:54:04.060797+0000","last_active":"2023-08-01T19:54:25.152062+0000","last_peered":"2023-08-01T19:54:25.152062+0000","last_clean":"2023-08-01T19:54:25.152062+0000","last_became_active":"2023-08-01T19:54:04.060444+0000","last_became_peered":"2023-08-01T19:54:04.060444+0000","last_unstale":"2023-08-01T19:54:25.152062+0000","last_undegraded":"2023-08-01T19:54:25.152062+0000","last_fullsized":"2023-08-01T19:54:25.152062+0000","mapping_epoch":15,"log_start":"0'0","ondisk_log_start":"0'0","created":15,"last_epoch_clean":16,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-08-01T19:54:03.032665+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-08-01T19:54:03.032665+0000","last_clean_scrub_stamp":"2023-08-01T19:54:03.032665+0000","objects_scrubbed":0,"log_size":1,"ondisk_log_size":1,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-08-03T07:13:34.025722+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":22,"num_objects":1,"num_object_clones":0,"num_object_copies":2,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":1,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":1,"num_write_kb":1,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[1,2],"acting":[1,2],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":1,"acting_primary":1,"purged_snaps":[]},{"pgid":"4.8","version":"0'0","reported_seq":14,"reported_epoch":22,"state":"active+clean","last_fresh":"2023-08-01T19:54:25.142970+0000","last_change":"2023-08-01T19:54:04.467671+0000","last_active":"2023-08-01T19:54:25.142970+0000","last_peered":"2023-08-01T19:54:25.142970+0000","last_clean":"2023-08-01T19:54:25.142970+0000","last_became_active":"2023-08-01T19:54:04.467300+0000","last_became_peered":"2023-08-01T19:54:04.467300+0000","last_unstale":"2023-08-01T19:54:25.142970+0000","last_undegraded":"2023-08-01T19:54:25.142970+0000","last_fullsized":"2023-08-01T19:54:25.142970+0000","mapping_epoch":16,"log_start":"0'0","ondisk_log_start":"0'0","created":16,"last_epoch_clean":17,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-08-01T19:54:04.040663+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-08-01T19:54:04.040663+0000","last_clean_scrub_stamp":"2023-08-01T19:54:04.040663+0000","objects_scrubbed":0,"log_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-08-03T05:27:24.774345+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[2,1],"acting":[2,1],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":2,"acting_primary":2,"purged_snaps":[]},{"pgid":"5.8","version":"23'1558","reported_seq":1569,"reported_epoch":23,"state":"active+clean","last_fresh":"2023-08-01T19:54:31.035591+0000","last_change":"2023-08-01T19:54:23.139383+0000","last_active":"2023-08-01T19:54:31.035591+0000","last_peered":"2023-08-01T19:54:31.035591+0000","last_clean":"2023-08-01T19:54:31.035591+0000","last_became_active":"2023-08-01T19:54:23.139198+0000","last_became_peered":"2023-08-01T19:54:23.139198+0000","last_unstale":"2023-08-01T19:54:31.035591+0000","last_undegraded":"2023-08-01T19:54:31.035591+0000","last_fullsized":"2023-08-01T19:54:31.035591+0000","mapping_epoch":19,"log_start":"0'0","ondisk_log_start":"0'0","created":19,"last_epoch_clean":20,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-08-01T19:54:22.116710+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-08-01T19:54:22.116710+0000","last_clean_scrub_stamp":"2023-08-01T19:54:22.116710+0000","objects_scrubbed":0,"log_size":1558,"ondisk_log_size":1558,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-08-03T05:20:31.724064+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":102105088,"num_objects":1558,"num_object_clones":0,"num_object_copies":3116,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":1558,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":1558,"num_write_kb":99712,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[2,0],"acting":[2,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":2,"acting_primary":2,"purged_snaps":[]},{"pgid":"3.e","version":"17'2","reported_seq":17,"reported_epoch":22,"state":"active+clean","last_fresh":"2023-08-01T19:54:25.144545+0000","last_change":"2023-08-01T19:54:04.065595+0000","last_active":"2023-08-01T19:54:25.144545+0000","last_peered":"2023-08-01T19:54:25.144545+0000","last_clean":"2023-08-01T19:54:25.144545+0000","last_became_active":"2023-08-01T19:54:04.065303+0000","last_became_peered":"2023-08-01T19:54:04.065303+0000","last_unstale":"2023-08-01T19:54:25.144545+0000","last_undegraded":"2023-08-01T19:54:25.144545+0000","last_fullsized":"2023-08-01T19:54:25.144545+0000","mapping_epoch":15,"log_start":"0'0","ondisk_log_start":"0'0","created":15,"last_epoch_clean":16,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-08-01T19:54:03.032665+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-08-01T19:54:03.032665+0000","last_clean_scrub_stamp":"2023-08-01T19:54:03.032665+0000","objects_scrubbed":0,"log_size":2,"ondisk_log_size":2,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-08-02T22:40:38.782053+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":1,"num_object_clones":0,"num_object_copies":2,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":1,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":3,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":1,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[2,1],"acting":[2,1],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":2,"acting_primary":2,"purged_snaps":[]},{"pgid":"4.9","version":"0'0","reported_seq":14,"reported_epoch":22,"state":"active+clean","last_fresh":"2023-08-01T19:54:25.143350+0000","last_change":"2023-08-01T19:54:04.468007+0000","last_active":"2023-08-01T19:54:25.143350+0000","last_peered":"2023-08-01T19:54:25.143350+0000","last_clean":"2023-08-01T19:54:25.143350+0000","last_became_active":"2023-08-01T19:54:04.467509+0000","last_became_peered":"2023-08-01T19:54:04.467509+0000","last_unstale":"2023-08-01T19:54:25.143350+0000","last_undegraded":"2023-08-01T19:54:25.143350+0000","last_fullsized":"2023-08-01T19:54:25.143350+0000","mapping_epoch":16,"log_start":"0'0","ondisk_log_start":"0'0","created":16,"last_epoch_clean":17,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-08-01T19:54:04.040663+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-08-01T19:54:04.040663+0000","last_clean_scrub_stamp":"2023-08-01T19:54:04.040663+0000","objects_scrubbed":0,"log_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-08-03T06:04:50.963711+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[2,0],"acting":[2,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":2,"acting_primary":2,"purged_snaps":[]},{"pgid":"5.b","version":"23'1564","reported_seq":1575,"reported_epoch":23,"state":"active+clean","last_fresh":"2023-08-01T19:54:31.022389+0000","last_change":"2023-08-01T19:54:23.138143+0000","last_active":"2023-08-01T19:54:31.022389+0000","last_peered":"2023-08-01T19:54:31.022389+0000","last_clean":"2023-08-01T19:54:31.022389+0000","last_became_active":"2023-08-01T19:54:23.137922+0000","last_became_peered":"2023-08-01T19:54:23.137922+0000","last_unstale":"2023-08-01T19:54:31.022389+0000","last_undegraded":"2023-08-01T19:54:31.022389+0000","last_fullsized":"2023-08-01T19:54:31.022389+0000","mapping_epoch":19,"log_start":"0'0","ondisk_log_start":"0'0","created":19,"last_epoch_clean":20,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-08-01T19:54:22.116710+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-08-01T19:54:22.116710+0000","last_clean_scrub_stamp":"2023-08-01T19:54:22.116710+0000","objects_scrubbed":0,"log_size":1564,"ondisk_log_size":1564,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-08-02T23:27:13.080055+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":102498304,"num_objects":1564,"num_object_clones":0,"num_object_copies":3128,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":1564,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":1564,"num_write_kb":100096,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[2,0],"acting":[2,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":2,"acting_primary":2,"purged_snaps":[]},{"pgid":"3.d","version":"17'1","reported_seq":16,"reported_epoch":22,"state":"active+clean","last_fresh":"2023-08-01T19:54:25.152286+0000","last_change":"2023-08-01T19:54:04.062853+0000","last_active":"2023-08-01T19:54:25.152286+0000","last_peered":"2023-08-01T19:54:25.152286+0000","last_clean":"2023-08-01T19:54:25.152286+0000","last_became_active":"2023-08-01T19:54:04.062598+0000","last_became_peered":"2023-08-01T19:54:04.062598+0000","last_unstale":"2023-08-01T19:54:25.152286+0000","last_undegraded":"2023-08-01T19:54:25.152286+0000","last_fullsized":"2023-08-01T19:54:25.152286+0000","mapping_epoch":15,"log_start":"0'0","ondisk_log_start":"0'0","created":15,"last_epoch_clean":16,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-08-01T19:54:03.032665+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-08-01T19:54:03.032665+0000","last_clean_scrub_stamp":"2023-08-01T19:54:03.032665+0000","objects_scrubbed":0,"log_size":1,"ondisk_log_size":1,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-08-02T20:56:47.324761+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":70,"num_objects":1,"num_object_clones":0,"num_object_copies":2,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":1,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":1,"num_write_kb":1,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[1,2],"acting":[1,2],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":1,"acting_primary":1,"purged_snaps":[]},{"pgid":"4.a","version":"0'0","reported_seq":14,"reported_epoch":22,"state":"active+clean","last_fresh":"2023-08-01T19:54:25.152005+0000","last_change":"2023-08-01T19:54:04.471997+0000","last_active":"2023-08-01T19:54:25.152005+0000","last_peered":"2023-08-01T19:54:25.152005+0000","last_clean":"2023-08-01T19:54:25.152005+0000","last_became_active":"2023-08-01T19:54:04.471204+0000","last_became_peered":"2023-08-01T19:54:04.471204+0000","last_unstale":"2023-08-01T19:54:25.152005+0000","last_undegraded":"2023-08-01T19:54:25.152005+0000","last_fullsized":"2023-08-01T19:54:25.152005+0000","mapping_epoch":16,"log_start":"0'0","ondisk_log_start":"0'0","created":16,"last_epoch_clean":17,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-08-01T19:54:04.040663+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-08-01T19:54:04.040663+0000","last_clean_scrub_stamp":"2023-08-01T19:54:04.040663+0000","objects_scrubbed":0,"log_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-08-02T23:12:30.830199+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[1,0],"acting":[1,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":1,"acting_primary":1,"purged_snaps":[]},{"pgid":"5.a","version":"23'1318","reported_seq":1329,"reported_epoch":23,"state":"active+clean","last_fresh":"2023-08-01T19:54:29.904259+0000","last_change":"2023-08-01T19:54:23.138147+0000","last_active":"2023-08-01T19:54:29.904259+0000","last_peered":"2023-08-01T19:54:29.904259+0000","last_clean":"2023-08-01T19:54:29.904259+0000","last_became_active":"2023-08-01T19:54:23.137827+0000","last_became_peered":"2023-08-01T19:54:23.137827+0000","last_unstale":"2023-08-01T19:54:29.904259+0000","last_undegraded":"2023-08-01T19:54:29.904259+0000","last_fullsized":"2023-08-01T19:54:29.904259+0000","mapping_epoch":19,"log_start":"0'0","ondisk_log_start":"0'0","created":19,"last_epoch_clean":20,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-08-01T19:54:22.116710+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-08-01T19:54:22.116710+0000","last_clean_scrub_stamp":"2023-08-01T19:54:22.116710+0000","objects_scrubbed":0,"log_size":1318,"ondisk_log_size":1318,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-08-03T05:22:32.106433+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":86376448,"num_objects":1318,"num_object_clones":0,"num_object_copies":2636,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":1318,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":1318,"num_write_kb":84352,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[0,2],"acting":[0,2],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":0,"acting_primary":0,"purged_snaps":[]},{"pgid":"3.c","version":"0'0","reported_seq":15,"reported_epoch":22,"state":"active+clean","last_fresh":"2023-08-01T19:54:25.151641+0000","last_change":"2023-08-01T19:54:04.063532+0000","last_active":"2023-08-01T19:54:25.151641+0000","last_peered":"2023-08-01T19:54:25.151641+0000","last_clean":"2023-08-01T19:54:25.151641+0000","last_became_active":"2023-08-01T19:54:04.063116+0000","last_became_peered":"2023-08-01T19:54:04.063116+0000","last_unstale":"2023-08-01T19:54:25.151641+0000","last_undegraded":"2023-08-01T19:54:25.151641+0000","last_fullsized":"2023-08-01T19:54:25.151641+0000","mapping_epoch":15,"log_start":"0'0","ondisk_log_start":"0'0","created":15,"last_epoch_clean":16,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-08-01T19:54:03.032665+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-08-01T19:54:03.032665+0000","last_clean_scrub_stamp":"2023-08-01T19:54:03.032665+0000","objects_scrubbed":0,"log_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-08-02T22:28:51.936138+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[1,0],"acting":[1,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":1,"acting_primary":1,"purged_snaps":[]},{"pgid":"4.b","version":"0'0","reported_seq":14,"reported_epoch":22,"state":"active+clean","last_fresh":"2023-08-01T19:54:25.146141+0000","last_change":"2023-08-01T19:54:04.470787+0000","last_active":"2023-08-01T19:54:25.146141+0000","last_peered":"2023-08-01T19:54:25.146141+0000","last_clean":"2023-08-01T19:54:25.146141+0000","last_became_active":"2023-08-01T19:54:04.470332+0000","last_became_peered":"2023-08-01T19:54:04.470332+0000","last_unstale":"2023-08-01T19:54:25.146141+0000","last_undegraded":"2023-08-01T19:54:25.146141+0000","last_fullsized":"2023-08-01T19:54:25.146141+0000","mapping_epoch":16,"log_start":"0'0","ondisk_log_start":"0'0","created":16,"last_epoch_clean":17,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-08-01T19:54:04.040663+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-08-01T19:54:04.040663+0000","last_clean_scrub_stamp":"2023-08-01T19:54:04.040663+0000","objects_scrubbed":0,"log_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-08-03T05:13:38.298401+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[0,1],"acting":[0,1],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":0,"acting_primary":0,"purged_snaps":[]},{"pgid":"5.d","version":"23'1475","reported_seq":1486,"reported_epoch":23,"state":"active+clean","last_fresh":"2023-08-01T19:54:31.040349+0000","last_change":"2023-08-01T19:54:23.134380+0000","last_active":"2023-08-01T19:54:31.040349+0000","last_peered":"2023-08-01T19:54:31.040349+0000","last_clean":"2023-08-01T19:54:31.040349+0000","last_became_active":"2023-08-01T19:54:23.134100+0000","last_became_peered":"2023-08-01T19:54:23.134100+0000","last_unstale":"2023-08-01T19:54:31.040349+0000","last_undegraded":"2023-08-01T19:54:31.040349+0000","last_fullsized":"2023-08-01T19:54:31.040349+0000","mapping_epoch":19,"log_start":"0'0","ondisk_log_start":"0'0","created":19,"last_epoch_clean":20,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-08-01T19:54:22.116710+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-08-01T19:54:22.116710+0000","last_clean_scrub_stamp":"2023-08-01T19:54:22.116710+0000","objects_scrubbed":0,"log_size":1475,"ondisk_log_size":1475,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-08-02T22:07:43.756233+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":96665600,"num_objects":1475,"num_object_clones":0,"num_object_copies":2950,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":1475,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":1475,"num_write_kb":94400,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[2,1],"acting":[2,1],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":2,"acting_primary":2,"purged_snaps":[]},{"pgid":"3.b","version":"17'2","reported_seq":17,"reported_epoch":22,"state":"active+clean","last_fresh":"2023-08-01T19:54:25.145705+0000","last_change":"2023-08-01T19:54:04.066839+0000","last_active":"2023-08-01T19:54:25.145705+0000","last_peered":"2023-08-01T19:54:25.145705+0000","last_clean":"2023-08-01T19:54:25.145705+0000","last_became_active":"2023-08-01T19:54:04.065535+0000","last_became_peered":"2023-08-01T19:54:04.065535+0000","last_unstale":"2023-08-01T19:54:25.145705+0000","last_undegraded":"2023-08-01T19:54:25.145705+0000","last_fullsized":"2023-08-01T19:54:25.145705+0000","mapping_epoch":15,"log_start":"0'0","ondisk_log_start":"0'0","created":15,"last_epoch_clean":16,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-08-01T19:54:03.032665+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-08-01T19:54:03.032665+0000","last_clean_scrub_stamp":"2023-08-01T19:54:03.032665+0000","objects_scrubbed":0,"log_size":2,"ondisk_log_size":2,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-08-03T05:00:51.171444+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":1,"num_object_clones":0,"num_object_copies":2,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":1,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":1,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":1,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[0,1],"acting":[0,1],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":0,"acting_primary":0,"purged_snaps":[]},{"pgid":"4.c","version":"0'0","reported_seq":14,"reported_epoch":22,"state":"active+clean","last_fresh":"2023-08-01T19:54:25.151751+0000","last_change":"2023-08-01T19:54:04.478715+0000","last_active":"2023-08-01T19:54:25.151751+0000","last_peered":"2023-08-01T19:54:25.151751+0000","last_clean":"2023-08-01T19:54:25.151751+0000","last_became_active":"2023-08-01T19:54:04.477435+0000","last_became_peered":"2023-08-01T19:54:04.477435+0000","last_unstale":"2023-08-01T19:54:25.151751+0000","last_undegraded":"2023-08-01T19:54:25.151751+0000","last_fullsized":"2023-08-01T19:54:25.151751+0000","mapping_epoch":16,"log_start":"0'0","ondisk_log_start":"0'0","created":16,"last_epoch_clean":17,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-08-01T19:54:04.040663+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-08-01T19:54:04.040663+0000","last_clean_scrub_stamp":"2023-08-01T19:54:04.040663+0000","objects_scrubbed":0,"log_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-08-03T04:43:21.408174+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[1,0],"acting":[1,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":1,"acting_primary":1,"purged_snaps":[]},{"pgid":"5.c","version":"23'1347","reported_seq":1357,"reported_epoch":23,"state":"active+clean","last_fresh":"2023-08-01T19:54:29.920878+0000","last_change":"2023-08-01T19:54:23.138439+0000","last_active":"2023-08-01T19:54:29.920878+0000","last_peered":"2023-08-01T19:54:29.920878+0000","last_clean":"2023-08-01T19:54:29.920878+0000","last_became_active":"2023-08-01T19:54:23.138051+0000","last_became_peered":"2023-08-01T19:54:23.138051+0000","last_unstale":"2023-08-01T19:54:29.920878+0000","last_undegraded":"2023-08-01T19:54:29.920878+0000","last_fullsized":"2023-08-01T19:54:29.920878+0000","mapping_epoch":19,"log_start":"0'0","ondisk_log_start":"0'0","created":19,"last_epoch_clean":20,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-08-01T19:54:22.116710+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-08-01T19:54:22.116710+0000","last_clean_scrub_stamp":"2023-08-01T19:54:22.116710+0000","objects_scrubbed":0,"log_size":1347,"ondisk_log_size":1347,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-08-03T03:01:16.402814+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":88276992,"num_objects":1347,"num_object_clones":0,"num_object_copies":2694,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":1347,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":1347,"num_write_kb":86208,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[0,1],"acting":[0,1],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":0,"acting_primary":0,"purged_snaps":[]},{"pgid":"3.a","version":"0'0","reported_seq":15,"reported_epoch":22,"state":"active+clean","last_fresh":"2023-08-01T19:54:25.151124+0000","last_change":"2023-08-01T19:54:04.065267+0000","last_active":"2023-08-01T19:54:25.151124+0000","last_peered":"2023-08-01T19:54:25.151124+0000","last_clean":"2023-08-01T19:54:25.151124+0000","last_became_active":"2023-08-01T19:54:04.064912+0000","last_became_peered":"2023-08-01T19:54:04.064912+0000","last_unstale":"2023-08-01T19:54:25.151124+0000","last_undegraded":"2023-08-01T19:54:25.151124+0000","last_fullsized":"2023-08-01T19:54:25.151124+0000","mapping_epoch":15,"log_start":"0'0","ondisk_log_start":"0'0","created":15,"last_epoch_clean":16,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-08-01T19:54:03.032665+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-08-01T19:54:03.032665+0000","last_clean_scrub_stamp":"2023-08-01T19:54:03.032665+0000","objects_scrubbed":0,"log_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-08-03T02:37:09.180970+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[1,0],"acting":[1,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":1,"acting_primary":1,"purged_snaps":[]},{"pgid":"4.d","version":"0'0","reported_seq":14,"reported_epoch":22,"state":"active+clean","last_fresh":"2023-08-01T19:54:25.152389+0000","last_change":"2023-08-01T19:54:04.474755+0000","last_active":"2023-08-01T19:54:25.152389+0000","last_peered":"2023-08-01T19:54:25.152389+0000","last_clean":"2023-08-01T19:54:25.152389+0000","last_became_active":"2023-08-01T19:54:04.471526+0000","last_became_peered":"2023-08-01T19:54:04.471526+0000","last_unstale":"2023-08-01T19:54:25.152389+0000","last_undegraded":"2023-08-01T19:54:25.152389+0000","last_fullsized":"2023-08-01T19:54:25.152389+0000","mapping_epoch":16,"log_start":"0'0","ondisk_log_start":"0'0","created":16,"last_epoch_clean":17,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-08-01T19:54:04.040663+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-08-01T19:54:04.040663+0000","last_clean_scrub_stamp":"2023-08-01T19:54:04.040663+0000","objects_scrubbed":0,"log_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-08-03T06:50:03.420334+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[1,2],"acting":[1,2],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":1,"acting_primary":1,"purged_snaps":[]},{"pgid":"5.f","version":"23'1354","reported_seq":1365,"reported_epoch":23,"state":"active+clean","last_fresh":"2023-08-01T19:54:29.915960+0000","last_change":"2023-08-01T19:54:23.134608+0000","last_active":"2023-08-01T19:54:29.915960+0000","last_peered":"2023-08-01T19:54:29.915960+0000","last_clean":"2023-08-01T19:54:29.915960+0000","last_became_active":"2023-08-01T19:54:23.134360+0000","last_became_peered":"2023-08-01T19:54:23.134360+0000","last_unstale":"2023-08-01T19:54:29.915960+0000","last_undegraded":"2023-08-01T19:54:29.915960+0000","last_fullsized":"2023-08-01T19:54:29.915960+0000","mapping_epoch":19,"log_start":"0'0","ondisk_log_start":"0'0","created":19,"last_epoch_clean":20,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-08-01T19:54:22.116710+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-08-01T19:54:22.116710+0000","last_clean_scrub_stamp":"2023-08-01T19:54:22.116710+0000","objects_scrubbed":0,"log_size":1354,"ondisk_log_size":1354,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-08-03T06:01:12.916557+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":88735744,"num_objects":1354,"num_object_clones":0,"num_object_copies":2708,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":1354,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":1354,"num_write_kb":86656,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[1,2],"acting":[1,2],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":1,"acting_primary":1,"purged_snaps":[]},{"pgid":"3.9","version":"0'0","reported_seq":15,"reported_epoch":22,"state":"active+clean","last_fresh":"2023-08-01T19:54:25.143010+0000","last_change":"2023-08-01T19:54:04.065519+0000","last_active":"2023-08-01T19:54:25.143010+0000","last_peered":"2023-08-01T19:54:25.143010+0000","last_clean":"2023-08-01T19:54:25.143010+0000","last_became_active":"2023-08-01T19:54:04.065211+0000","last_became_peered":"2023-08-01T19:54:04.065211+0000","last_unstale":"2023-08-01T19:54:25.143010+0000","last_undegraded":"2023-08-01T19:54:25.143010+0000","last_fullsized":"2023-08-01T19:54:25.143010+0000","mapping_epoch":15,"log_start":"0'0","ondisk_log_start":"0'0","created":15,"last_epoch_clean":16,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-08-01T19:54:03.032665+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-08-01T19:54:03.032665+0000","last_clean_scrub_stamp":"2023-08-01T19:54:03.032665+0000","objects_scrubbed":0,"log_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-08-03T05:46:27.672957+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[2,1],"acting":[2,1],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":2,"acting_primary":2,"purged_snaps":[]},{"pgid":"4.e","version":"0'0","reported_seq":14,"reported_epoch":22,"state":"active+clean","last_fresh":"2023-08-01T19:54:25.151700+0000","last_change":"2023-08-01T19:54:04.473750+0000","last_active":"2023-08-01T19:54:25.151700+0000","last_peered":"2023-08-01T19:54:25.151700+0000","last_clean":"2023-08-01T19:54:25.151700+0000","last_became_active":"2023-08-01T19:54:04.471512+0000","last_became_peered":"2023-08-01T19:54:04.471512+0000","last_unstale":"2023-08-01T19:54:25.151700+0000","last_undegraded":"2023-08-01T19:54:25.151700+0000","last_fullsized":"2023-08-01T19:54:25.151700+0000","mapping_epoch":16,"log_start":"0'0","ondisk_log_start":"0'0","created":16,"last_epoch_clean":17,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-08-01T19:54:04.040663+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-08-01T19:54:04.040663+0000","last_clean_scrub_stamp":"2023-08-01T19:54:04.040663+0000","objects_scrubbed":0,"log_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-08-03T05:13:38.298401+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[1,2],"acting":[1,2],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":1,"acting_primary":1,"purged_snaps":[]},{"pgid":"5.e","version":"23'1614","reported_seq":1625,"reported_epoch":23,"state":"active+clean","last_fresh":"2023-08-01T19:54:31.042683+0000","last_change":"2023-08-01T19:54:23.138341+0000","last_active":"2023-08-01T19:54:31.042683+0000","last_peered":"2023-08-01T19:54:31.042683+0000","last_clean":"2023-08-01T19:54:31.042683+0000","last_became_active":"2023-08-01T19:54:23.138119+0000","last_became_peered":"2023-08-01T19:54:23.138119+0000","last_unstale":"2023-08-01T19:54:31.042683+0000","last_undegraded":"2023-08-01T19:54:31.042683+0000","last_fullsized":"2023-08-01T19:54:31.042683+0000","mapping_epoch":19,"log_start":"0'0","ondisk_log_start":"0'0","created":19,"last_epoch_clean":20,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-08-01T19:54:22.116710+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-08-01T19:54:22.116710+0000","last_clean_scrub_stamp":"2023-08-01T19:54:22.116710+0000","objects_scrubbed":0,"log_size":1614,"ondisk_log_size":1614,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-08-03T07:48:27.709982+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":105775104,"num_objects":1614,"num_object_clones":0,"num_object_copies":3228,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":1614,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":1614,"num_write_kb":103296,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[2,0],"acting":[2,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":2,"acting_primary":2,"purged_snaps":[]},{"pgid":"3.8","version":"0'0","reported_seq":15,"reported_epoch":22,"state":"active+clean","last_fresh":"2023-08-01T19:54:25.143113+0000","last_change":"2023-08-01T19:54:04.063990+0000","last_active":"2023-08-01T19:54:25.143113+0000","last_peered":"2023-08-01T19:54:25.143113+0000","last_clean":"2023-08-01T19:54:25.143113+0000","last_became_active":"2023-08-01T19:54:04.063652+0000","last_became_peered":"2023-08-01T19:54:04.063652+0000","last_unstale":"2023-08-01T19:54:25.143113+0000","last_undegraded":"2023-08-01T19:54:25.143113+0000","last_fullsized":"2023-08-01T19:54:25.143113+0000","mapping_epoch":15,"log_start":"0'0","ondisk_log_start":"0'0","created":15,"last_epoch_clean":16,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-08-01T19:54:03.032665+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-08-01T19:54:03.032665+0000","last_clean_scrub_stamp":"2023-08-01T19:54:03.032665+0000","objects_scrubbed":0,"log_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-08-03T05:30:28.028091+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[2,0],"acting":[2,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":2,"acting_primary":2,"purged_snaps":[]},{"pgid":"4.f","version":"0'0","reported_seq":14,"reported_epoch":22,"state":"active+clean","last_fresh":"2023-08-01T19:54:25.146116+0000","last_change":"2023-08-01T19:54:04.469648+0000","last_active":"2023-08-01T19:54:25.146116+0000","last_peered":"2023-08-01T19:54:25.146116+0000","last_clean":"2023-08-01T19:54:25.146116+0000","last_became_active":"2023-08-01T19:54:04.468445+0000","last_became_peered":"2023-08-01T19:54:04.468445+0000","last_unstale":"2023-08-01T19:54:25.146116+0000","last_undegraded":"2023-08-01T19:54:25.146116+0000","last_fullsized":"2023-08-01T19:54:25.146116+0000","mapping_epoch":16,"log_start":"0'0","ondisk_log_start":"0'0","created":16,"last_epoch_clean":17,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-08-01T19:54:04.040663+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-08-01T19:54:04.040663+0000","last_clean_scrub_stamp":"2023-08-01T19:54:04.040663+0000","objects_scrubbed":0,"log_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-08-03T05:46:11.085577+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[0,2],"acting":[0,2],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":0,"acting_primary":0,"purged_snaps":[]},{"pgid":"5.3","version":"23'1356","reported_seq":1367,"reported_epoch":23,"state":"active+clean","last_fresh":"2023-08-01T19:54:29.912041+0000","last_change":"2023-08-01T19:54:23.138357+0000","last_active":"2023-08-01T19:54:29.912041+0000","last_peered":"2023-08-01T19:54:29.912041+0000","last_clean":"2023-08-01T19:54:29.912041+0000","last_became_active":"2023-08-01T19:54:23.137942+0000","last_became_peered":"2023-08-01T19:54:23.137942+0000","last_unstale":"2023-08-01T19:54:29.912041+0000","last_undegraded":"2023-08-01T19:54:29.912041+0000","last_fullsized":"2023-08-01T19:54:29.912041+0000","mapping_epoch":19,"log_start":"0'0","ondisk_log_start":"0'0","created":19,"last_epoch_clean":20,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-08-01T19:54:22.116710+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-08-01T19:54:22.116710+0000","last_clean_scrub_stamp":"2023-08-01T19:54:22.116710+0000","objects_scrubbed":0,"log_size":1356,"ondisk_log_size":1356,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-08-03T01:44:47.434321+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":88866816,"num_objects":1356,"num_object_clones":0,"num_object_copies":2712,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":1356,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":1356,"num_write_kb":86784,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[0,1],"acting":[0,1],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":0,"acting_primary":0,"purged_snaps":[]},{"pgid":"2.4","version":"0'0","reported_seq":18,"reported_epoch":22,"state":"active+clean","last_fresh":"2023-08-01T19:54:25.147674+0000","last_change":"2023-08-01T19:53:58.973838+0000","last_active":"2023-08-01T19:54:25.147674+0000","last_peered":"2023-08-01T19:54:25.147674+0000","last_clean":"2023-08-01T19:54:25.147674+0000","last_became_active":"2023-08-01T19:53:58.973242+0000","last_became_peered":"2023-08-01T19:53:58.973242+0000","last_unstale":"2023-08-01T19:54:25.147674+0000","last_undegraded":"2023-08-01T19:54:25.147674+0000","last_fullsized":"2023-08-01T19:54:25.147674+0000","mapping_epoch":12,"log_start":"0'0","ondisk_log_start":"0'0","created":12,"last_epoch_clean":13,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-08-01T19:53:57.959448+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-08-01T19:53:57.959448+0000","last_clean_scrub_stamp":"2023-08-01T19:53:57.959448+0000","objects_scrubbed":0,"log_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-08-03T00:09:48.796549+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[0,2],"acting":[0,2],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":0,"acting_primary":0,"purged_snaps":[]},{"pgid":"3.5","version":"0'0","reported_seq":15,"reported_epoch":22,"state":"active+clean","last_fresh":"2023-08-01T19:54:25.152336+0000","last_change":"2023-08-01T19:54:04.065255+0000","last_active":"2023-08-01T19:54:25.152336+0000","last_peered":"2023-08-01T19:54:25.152336+0000","last_clean":"2023-08-01T19:54:25.152336+0000","last_became_active":"2023-08-01T19:54:04.064814+0000","last_became_peered":"2023-08-01T19:54:04.064814+0000","last_unstale":"2023-08-01T19:54:25.152336+0000","last_undegraded":"2023-08-01T19:54:25.152336+0000","last_fullsized":"2023-08-01T19:54:25.152336+0000","mapping_epoch":15,"log_start":"0'0","ondisk_log_start":"0'0","created":15,"last_epoch_clean":16,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-08-01T19:54:03.032665+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-08-01T19:54:03.032665+0000","last_clean_scrub_stamp":"2023-08-01T19:54:03.032665+0000","objects_scrubbed":0,"log_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-08-03T02:01:47.073630+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[1,0],"acting":[1,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":1,"acting_primary":1,"purged_snaps":[]},{"pgid":"4.2","version":"0'0","reported_seq":14,"reported_epoch":22,"state":"active+clean","last_fresh":"2023-08-01T19:54:25.143915+0000","last_change":"2023-08-01T19:54:04.471715+0000","last_active":"2023-08-01T19:54:25.143915+0000","last_peered":"2023-08-01T19:54:25.143915+0000","last_clean":"2023-08-01T19:54:25.143915+0000","last_became_active":"2023-08-01T19:54:04.471300+0000","last_became_peered":"2023-08-01T19:54:04.471300+0000","last_unstale":"2023-08-01T19:54:25.143915+0000","last_undegraded":"2023-08-01T19:54:25.143915+0000","last_fullsized":"2023-08-01T19:54:25.143915+0000","mapping_epoch":16,"log_start":"0'0","ondisk_log_start":"0'0","created":16,"last_epoch_clean":17,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-08-01T19:54:04.040663+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-08-01T19:54:04.040663+0000","last_clean_scrub_stamp":"2023-08-01T19:54:04.040663+0000","objects_scrubbed":0,"log_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-08-02T23:00:24.980203+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[2,1],"acting":[2,1],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":2,"acting_primary":2,"purged_snaps":[]},{"pgid":"5.5","version":"23'1309","reported_seq":1320,"reported_epoch":23,"state":"active+clean","last_fresh":"2023-08-01T19:54:29.896765+0000","last_change":"2023-08-01T19:54:23.137678+0000","last_active":"2023-08-01T19:54:29.896765+0000","last_peered":"2023-08-01T19:54:29.896765+0000","last_clean":"2023-08-01T19:54:29.896765+0000","last_became_active":"2023-08-01T19:54:23.136756+0000","last_became_peered":"2023-08-01T19:54:23.136756+0000","last_unstale":"2023-08-01T19:54:29.896765+0000","last_undegraded":"2023-08-01T19:54:29.896765+0000","last_fullsized":"2023-08-01T19:54:29.896765+0000","mapping_epoch":19,"log_start":"0'0","ondisk_log_start":"0'0","created":19,"last_epoch_clean":20,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-08-01T19:54:22.116710+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-08-01T19:54:22.116710+0000","last_clean_scrub_stamp":"2023-08-01T19:54:22.116710+0000","objects_scrubbed":0,"log_size":1309,"ondisk_log_size":1309,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-08-03T03:50:03.076219+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":85786624,"num_objects":1309,"num_object_clones":0,"num_object_copies":2618,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":1309,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":1309,"num_write_kb":83776,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[0,1],"acting":[0,1],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":0,"acting_primary":0,"purged_snaps":[]},{"pgid":"2.2","version":"0'0","reported_seq":18,"reported_epoch":22,"state":"active+clean","last_fresh":"2023-08-01T19:54:25.151800+0000","last_change":"2023-08-01T19:53:58.973665+0000","last_active":"2023-08-01T19:54:25.151800+0000","last_peered":"2023-08-01T19:54:25.151800+0000","last_clean":"2023-08-01T19:54:25.151800+0000","last_became_active":"2023-08-01T19:53:58.973463+0000","last_became_peered":"2023-08-01T19:53:58.973463+0000","last_unstale":"2023-08-01T19:54:25.151800+0000","last_undegraded":"2023-08-01T19:54:25.151800+0000","last_fullsized":"2023-08-01T19:54:25.151800+0000","mapping_epoch":12,"log_start":"0'0","ondisk_log_start":"0'0","created":12,"last_epoch_clean":13,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-08-01T19:53:57.959448+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-08-01T19:53:57.959448+0000","last_clean_scrub_stamp":"2023-08-01T19:53:57.959448+0000","objects_scrubbed":0,"log_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-08-03T04:50:42.368892+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[1,0],"acting":[1,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":1,"acting_primary":1,"purged_snaps":[]},{"pgid":"3.3","version":"0'0","reported_seq":15,"reported_epoch":22,"state":"active+clean","last_fresh":"2023-08-01T19:54:25.151385+0000","last_change":"2023-08-01T19:54:04.065415+0000","last_active":"2023-08-01T19:54:25.151385+0000","last_peered":"2023-08-01T19:54:25.151385+0000","last_clean":"2023-08-01T19:54:25.151385+0000","last_became_active":"2023-08-01T19:54:04.065030+0000","last_became_peered":"2023-08-01T19:54:04.065030+0000","last_unstale":"2023-08-01T19:54:25.151385+0000","last_undegraded":"2023-08-01T19:54:25.151385+0000","last_fullsized":"2023-08-01T19:54:25.151385+0000","mapping_epoch":15,"log_start":"0'0","ondisk_log_start":"0'0","created":15,"last_epoch_clean":16,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-08-01T19:54:03.032665+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-08-01T19:54:03.032665+0000","last_clean_scrub_stamp":"2023-08-01T19:54:03.032665+0000","objects_scrubbed":0,"log_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-08-02T21:33:27.007118+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[1,0],"acting":[1,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":1,"acting_primary":1,"purged_snaps":[]},{"pgid":"4.4","version":"0'0","reported_seq":14,"reported_epoch":22,"state":"active+clean","last_fresh":"2023-08-01T19:54:25.147597+0000","last_change":"2023-08-01T19:54:04.468101+0000","last_active":"2023-08-01T19:54:25.147597+0000","last_peered":"2023-08-01T19:54:25.147597+0000","last_clean":"2023-08-01T19:54:25.147597+0000","last_became_active":"2023-08-01T19:54:04.467409+0000","last_became_peered":"2023-08-01T19:54:04.467409+0000","last_unstale":"2023-08-01T19:54:25.147597+0000","last_undegraded":"2023-08-01T19:54:25.147597+0000","last_fullsized":"2023-08-01T19:54:25.147597+0000","mapping_epoch":16,"log_start":"0'0","ondisk_log_start":"0'0","created":16,"last_epoch_clean":17,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-08-01T19:54:04.040663+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-08-01T19:54:04.040663+0000","last_clean_scrub_stamp":"2023-08-01T19:54:04.040663+0000","objects_scrubbed":0,"log_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-08-02T21:43:30.325991+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[0,2],"acting":[0,2],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":0,"acting_primary":0,"purged_snaps":[]},{"pgid":"5.6","version":"23'1312","reported_seq":1323,"reported_epoch":23,"state":"active+clean","last_fresh":"2023-08-01T19:54:29.906707+0000","last_change":"2023-08-01T19:54:23.138275+0000","last_active":"2023-08-01T19:54:29.906707+0000","last_peered":"2023-08-01T19:54:29.906707+0000","last_clean":"2023-08-01T19:54:29.906707+0000","last_became_active":"2023-08-01T19:54:23.137973+0000","last_became_peered":"2023-08-01T19:54:23.137973+0000","last_unstale":"2023-08-01T19:54:29.906707+0000","last_undegraded":"2023-08-01T19:54:29.906707+0000","last_fullsized":"2023-08-01T19:54:29.906707+0000","mapping_epoch":19,"log_start":"0'0","ondisk_log_start":"0'0","created":19,"last_epoch_clean":20,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-08-01T19:54:22.116710+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-08-01T19:54:22.116710+0000","last_clean_scrub_stamp":"2023-08-01T19:54:22.116710+0000","objects_scrubbed":0,"log_size":1312,"ondisk_log_size":1312,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-08-03T01:19:10.526905+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":85983232,"num_objects":1312,"num_object_clones":0,"num_object_copies":2624,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":1312,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":1312,"num_write_kb":83968,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[0,1],"acting":[0,1],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":0,"acting_primary":0,"purged_snaps":[]},{"pgid":"2.1","version":"0'0","reported_seq":18,"reported_epoch":22,"state":"active+clean","last_fresh":"2023-08-01T19:54:25.145084+0000","last_change":"2023-08-01T19:53:58.973700+0000","last_active":"2023-08-01T19:54:25.145084+0000","last_peered":"2023-08-01T19:54:25.145084+0000","last_clean":"2023-08-01T19:54:25.145084+0000","last_became_active":"2023-08-01T19:53:58.973285+0000","last_became_peered":"2023-08-01T19:53:58.973285+0000","last_unstale":"2023-08-01T19:54:25.145084+0000","last_undegraded":"2023-08-01T19:54:25.145084+0000","last_fullsized":"2023-08-01T19:54:25.145084+0000","mapping_epoch":12,"log_start":"0'0","ondisk_log_start":"0'0","created":12,"last_epoch_clean":13,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-08-01T19:53:57.959448+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-08-01T19:53:57.959448+0000","last_clean_scrub_stamp":"2023-08-01T19:53:57.959448+0000","objects_scrubbed":0,"log_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-08-02T21:26:02.570824+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[0,2],"acting":[0,2],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":0,"acting_primary":0,"purged_snaps":[]},{"pgid":"3.0","version":"0'0","reported_seq":15,"reported_epoch":22,"state":"active+clean","last_fresh":"2023-08-01T19:54:25.143076+0000","last_change":"2023-08-01T19:54:04.064407+0000","last_active":"2023-08-01T19:54:25.143076+0000","last_peered":"2023-08-01T19:54:25.143076+0000","last_clean":"2023-08-01T19:54:25.143076+0000","last_became_active":"2023-08-01T19:54:04.064122+0000","last_became_peered":"2023-08-01T19:54:04.064122+0000","last_unstale":"2023-08-01T19:54:25.143076+0000","last_undegraded":"2023-08-01T19:54:25.143076+0000","last_fullsized":"2023-08-01T19:54:25.143076+0000","mapping_epoch":15,"log_start":"0'0","ondisk_log_start":"0'0","created":15,"last_epoch_clean":16,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-08-01T19:54:03.032665+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-08-01T19:54:03.032665+0000","last_clean_scrub_stamp":"2023-08-01T19:54:03.032665+0000","objects_scrubbed":0,"log_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-08-03T07:08:17.318689+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[2,1],"acting":[2,1],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":2,"acting_primary":2,"purged_snaps":[]},{"pgid":"4.7","version":"0'0","reported_seq":14,"reported_epoch":22,"state":"active+clean","last_fresh":"2023-08-01T19:54:25.146323+0000","last_change":"2023-08-01T19:54:04.469739+0000","last_active":"2023-08-01T19:54:25.146323+0000","last_peered":"2023-08-01T19:54:25.146323+0000","last_clean":"2023-08-01T19:54:25.146323+0000","last_became_active":"2023-08-01T19:54:04.468021+0000","last_became_peered":"2023-08-01T19:54:04.468021+0000","last_unstale":"2023-08-01T19:54:25.146323+0000","last_undegraded":"2023-08-01T19:54:25.146323+0000","last_fullsized":"2023-08-01T19:54:25.146323+0000","mapping_epoch":16,"log_start":"0'0","ondisk_log_start":"0'0","created":16,"last_epoch_clean":17,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-08-01T19:54:04.040663+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-08-01T19:54:04.040663+0000","last_clean_scrub_stamp":"2023-08-01T19:54:04.040663+0000","objects_scrubbed":0,"log_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-08-02T21:03:01.319028+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[0,2],"acting":[0,2],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":0,"acting_primary":0,"purged_snaps":[]},{"pgid":"5.4","version":"23'1519","reported_seq":1530,"reported_epoch":23,"state":"active+clean","last_fresh":"2023-08-01T19:54:31.017734+0000","last_change":"2023-08-01T19:54:23.138253+0000","last_active":"2023-08-01T19:54:31.017734+0000","last_peered":"2023-08-01T19:54:31.017734+0000","last_clean":"2023-08-01T19:54:31.017734+0000","last_became_active":"2023-08-01T19:54:23.137915+0000","last_became_peered":"2023-08-01T19:54:23.137915+0000","last_unstale":"2023-08-01T19:54:31.017734+0000","last_undegraded":"2023-08-01T19:54:31.017734+0000","last_fullsized":"2023-08-01T19:54:31.017734+0000","mapping_epoch":19,"log_start":"0'0","ondisk_log_start":"0'0","created":19,"last_epoch_clean":20,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-08-01T19:54:22.116710+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-08-01T19:54:22.116710+0000","last_clean_scrub_stamp":"2023-08-01T19:54:22.116710+0000","objects_scrubbed":0,"log_size":1519,"ondisk_log_size":1519,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-08-03T07:20:04.946515+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":99549184,"num_objects":1519,"num_object_clones":0,"num_object_copies":3038,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":1519,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":1519,"num_write_kb":97216,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[2,0],"acting":[2,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":2,"acting_primary":2,"purged_snaps":[]},{"pgid":"2.3","version":"0'0","reported_seq":18,"reported_epoch":22,"state":"active+clean","last_fresh":"2023-08-01T19:54:25.151404+0000","last_change":"2023-08-01T19:53:58.973768+0000","last_active":"2023-08-01T19:54:25.151404+0000","last_peered":"2023-08-01T19:54:25.151404+0000","last_clean":"2023-08-01T19:54:25.151404+0000","last_became_active":"2023-08-01T19:53:58.973492+0000","last_became_peered":"2023-08-01T19:53:58.973492+0000","last_unstale":"2023-08-01T19:54:25.151404+0000","last_undegraded":"2023-08-01T19:54:25.151404+0000","last_fullsized":"2023-08-01T19:54:25.151404+0000","mapping_epoch":12,"log_start":"0'0","ondisk_log_start":"0'0","created":12,"last_epoch_clean":13,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-08-01T19:53:57.959448+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-08-01T19:53:57.959448+0000","last_clean_scrub_stamp":"2023-08-01T19:53:57.959448+0000","objects_scrubbed":0,"log_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-08-03T02:04:52.034667+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[1,0],"acting":[1,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":1,"acting_primary":1,"purged_snaps":[]},{"pgid":"1.0","version":"10'157","reported_seq":217,"reported_epoch":22,"state":"active+clean","last_fresh":"2023-08-01T19:54:25.150737+0000","last_change":"2023-08-01T19:53:51.746910+0000","last_active":"2023-08-01T19:54:25.150737+0000","last_peered":"2023-08-01T19:54:25.150737+0000","last_clean":"2023-08-01T19:54:25.150737+0000","last_became_active":"2023-08-01T19:53:51.746590+0000","last_became_peered":"2023-08-01T19:53:51.746590+0000","last_unstale":"2023-08-01T19:54:25.150737+0000","last_undegraded":"2023-08-01T19:54:25.150737+0000","last_fullsized":"2023-08-01T19:54:25.150737+0000","mapping_epoch":9,"log_start":"0'0","ondisk_log_start":"0'0","created":9,"last_epoch_clean":10,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-08-01T19:53:50.735626+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-08-01T19:53:50.735626+0000","last_clean_scrub_stamp":"2023-08-01T19:53:50.735626+0000","objects_scrubbed":0,"log_size":157,"ondisk_log_size":157,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-08-03T02:56:50.228294+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":590368,"num_objects":2,"num_object_clones":0,"num_object_copies":4,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":2,"num_whiteouts":0,"num_read":136,"num_read_kb":118,"num_write":203,"num_write_kb":3460,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[1,2],"acting":[1,2],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":1,"acting_primary":1,"purged_snaps":[]},{"pgid":"3.2","version":"0'0","reported_seq":15,"reported_epoch":22,"state":"active+clean","last_fresh":"2023-08-01T19:54:25.146657+0000","last_change":"2023-08-01T19:54:04.064009+0000","last_active":"2023-08-01T19:54:25.146657+0000","last_peered":"2023-08-01T19:54:25.146657+0000","last_clean":"2023-08-01T19:54:25.146657+0000","last_became_active":"2023-08-01T19:54:04.063665+0000","last_became_peered":"2023-08-01T19:54:04.063665+0000","last_unstale":"2023-08-01T19:54:25.146657+0000","last_undegraded":"2023-08-01T19:54:25.146657+0000","last_fullsized":"2023-08-01T19:54:25.146657+0000","mapping_epoch":15,"log_start":"0'0","ondisk_log_start":"0'0","created":15,"last_epoch_clean":16,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-08-01T19:54:03.032665+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-08-01T19:54:03.032665+0000","last_clean_scrub_stamp":"2023-08-01T19:54:03.032665+0000","objects_scrubbed":0,"log_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-08-03T04:04:46.983253+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[0,2],"acting":[0,2],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":0,"acting_primary":0,"purged_snaps":[]},{"pgid":"4.5","version":"0'0","reported_seq":14,"reported_epoch":22,"state":"active+clean","last_fresh":"2023-08-01T19:54:25.152383+0000","last_change":"2023-08-01T19:54:04.474061+0000","last_active":"2023-08-01T19:54:25.152383+0000","last_peered":"2023-08-01T19:54:25.152383+0000","last_clean":"2023-08-01T19:54:25.152383+0000","last_became_active":"2023-08-01T19:54:04.472128+0000","last_became_peered":"2023-08-01T19:54:04.472128+0000","last_unstale":"2023-08-01T19:54:25.152383+0000","last_undegraded":"2023-08-01T19:54:25.152383+0000","last_fullsized":"2023-08-01T19:54:25.152383+0000","mapping_epoch":16,"log_start":"0'0","ondisk_log_start":"0'0","created":16,"last_epoch_clean":17,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-08-01T19:54:04.040663+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-08-01T19:54:04.040663+0000","last_clean_scrub_stamp":"2023-08-01T19:54:04.040663+0000","objects_scrubbed":0,"log_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-08-03T00:29:05.857138+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[1,2],"acting":[1,2],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":1,"acting_primary":1,"purged_snaps":[]},{"pgid":"5.7","version":"23'1325","reported_seq":1336,"reported_epoch":23,"state":"active+clean","last_fresh":"2023-08-01T19:54:29.917134+0000","last_change":"2023-08-01T19:54:23.138337+0000","last_active":"2023-08-01T19:54:29.917134+0000","last_peered":"2023-08-01T19:54:29.917134+0000","last_clean":"2023-08-01T19:54:29.917134+0000","last_became_active":"2023-08-01T19:54:23.138056+0000","last_became_peered":"2023-08-01T19:54:23.138056+0000","last_unstale":"2023-08-01T19:54:29.917134+0000","last_undegraded":"2023-08-01T19:54:29.917134+0000","last_fullsized":"2023-08-01T19:54:29.917134+0000","mapping_epoch":19,"log_start":"0'0","ondisk_log_start":"0'0","created":19,"last_epoch_clean":20,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-08-01T19:54:22.116710+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-08-01T19:54:22.116710+0000","last_clean_scrub_stamp":"2023-08-01T19:54:22.116710+0000","objects_scrubbed":0,"log_size":1325,"ondisk_log_size":1325,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-08-03T06:58:19.846492+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":86835200,"num_objects":1325,"num_object_clones":0,"num_object_copies":2650,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":1325,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":1325,"num_write_kb":84800,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[1,0],"acting":[1,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":1,"acting_primary":1,"purged_snaps":[]},{"pgid":"2.0","version":"0'0","reported_seq":18,"reported_epoch":22,"state":"active+clean","last_fresh":"2023-08-01T19:54:25.150764+0000","last_change":"2023-08-01T19:53:58.975968+0000","last_active":"2023-08-01T19:54:25.150764+0000","last_peered":"2023-08-01T19:54:25.150764+0000","last_clean":"2023-08-01T19:54:25.150764+0000","last_became_active":"2023-08-01T19:53:58.975706+0000","last_became_peered":"2023-08-01T19:53:58.975706+0000","last_unstale":"2023-08-01T19:54:25.150764+0000","last_undegraded":"2023-08-01T19:54:25.150764+0000","last_fullsized":"2023-08-01T19:54:25.150764+0000","mapping_epoch":12,"log_start":"0'0","ondisk_log_start":"0'0","created":12,"last_epoch_clean":13,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-08-01T19:53:57.959448+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-08-01T19:53:57.959448+0000","last_clean_scrub_stamp":"2023-08-01T19:53:57.959448+0000","objects_scrubbed":0,"log_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-08-03T00:02:15.204280+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[1,2],"acting":[1,2],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":1,"acting_primary":1,"purged_snaps":[]},{"pgid":"3.1","version":"0'0","reported_seq":15,"reported_epoch":22,"state":"active+clean","last_fresh":"2023-08-01T19:54:25.145037+0000","last_change":"2023-08-01T19:54:04.066707+0000","last_active":"2023-08-01T19:54:25.145037+0000","last_peered":"2023-08-01T19:54:25.145037+0000","last_clean":"2023-08-01T19:54:25.145037+0000","last_became_active":"2023-08-01T19:54:04.066334+0000","last_became_peered":"2023-08-01T19:54:04.066334+0000","last_unstale":"2023-08-01T19:54:25.145037+0000","last_undegraded":"2023-08-01T19:54:25.145037+0000","last_fullsized":"2023-08-01T19:54:25.145037+0000","mapping_epoch":15,"log_start":"0'0","ondisk_log_start":"0'0","created":15,"last_epoch_clean":16,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-08-01T19:54:03.032665+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-08-01T19:54:03.032665+0000","last_clean_scrub_stamp":"2023-08-01T19:54:03.032665+0000","objects_scrubbed":0,"log_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-08-03T02:40:15.210599+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[0,1],"acting":[0,1],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":0,"acting_primary":0,"purged_snaps":[]},{"pgid":"4.6","version":"0'0","reported_seq":14,"reported_epoch":22,"state":"active+clean","last_fresh":"2023-08-01T19:54:25.144777+0000","last_change":"2023-08-01T19:54:04.469877+0000","last_active":"2023-08-01T19:54:25.144777+0000","last_peered":"2023-08-01T19:54:25.144777+0000","last_clean":"2023-08-01T19:54:25.144777+0000","last_became_active":"2023-08-01T19:54:04.469528+0000","last_became_peered":"2023-08-01T19:54:04.469528+0000","last_unstale":"2023-08-01T19:54:25.144777+0000","last_undegraded":"2023-08-01T19:54:25.144777+0000","last_fullsized":"2023-08-01T19:54:25.144777+0000","mapping_epoch":16,"log_start":"0'0","ondisk_log_start":"0'0","created":16,"last_epoch_clean":17,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-08-01T19:54:04.040663+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-08-01T19:54:04.040663+0000","last_clean_scrub_stamp":"2023-08-01T19:54:04.040663+0000","objects_scrubbed":0,"log_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-08-03T02:24:19.067602+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[2,0],"acting":[2,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":2,"acting_primary":2,"purged_snaps":[]},{"pgid":"5.2","version":"23'1377","reported_seq":1387,"reported_epoch":23,"state":"active+clean","last_fresh":"2023-08-01T19:54:29.914528+0000","last_change":"2023-08-01T19:54:23.138339+0000","last_active":"2023-08-01T19:54:29.914528+0000","last_peered":"2023-08-01T19:54:29.914528+0000","last_clean":"2023-08-01T19:54:29.914528+0000","last_became_active":"2023-08-01T19:54:23.137962+0000","last_became_peered":"2023-08-01T19:54:23.137962+0000","last_unstale":"2023-08-01T19:54:29.914528+0000","last_undegraded":"2023-08-01T19:54:29.914528+0000","last_fullsized":"2023-08-01T19:54:29.914528+0000","mapping_epoch":19,"log_start":"0'0","ondisk_log_start":"0'0","created":19,"last_epoch_clean":20,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-08-01T19:54:22.116710+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-08-01T19:54:22.116710+0000","last_clean_scrub_stamp":"2023-08-01T19:54:22.116710+0000","objects_scrubbed":0,"log_size":1377,"ondisk_log_size":1377,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-08-03T01:46:33.457242+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":90243072,"num_objects":1377,"num_object_clones":0,"num_object_copies":2754,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":1377,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":1377,"num_write_kb":88128,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[1,0],"acting":[1,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":1,"acting_primary":1,"purged_snaps":[]},{"pgid":"2.5","version":"0'0","reported_seq":18,"reported_epoch":22,"state":"active+clean","last_fresh":"2023-08-01T19:54:25.144376+0000","last_change":"2023-08-01T19:53:58.970683+0000","last_active":"2023-08-01T19:54:25.144376+0000","last_peered":"2023-08-01T19:54:25.144376+0000","last_clean":"2023-08-01T19:54:25.144376+0000","last_became_active":"2023-08-01T19:53:58.970437+0000","last_became_peered":"2023-08-01T19:53:58.970437+0000","last_unstale":"2023-08-01T19:54:25.144376+0000","last_undegraded":"2023-08-01T19:54:25.144376+0000","last_fullsized":"2023-08-01T19:54:25.144376+0000","mapping_epoch":12,"log_start":"0'0","ondisk_log_start":"0'0","created":12,"last_epoch_clean":13,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-08-01T19:53:57.959448+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-08-01T19:53:57.959448+0000","last_clean_scrub_stamp":"2023-08-01T19:53:57.959448+0000","objects_scrubbed":0,"log_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-08-02T23:54:08.273426+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[2,0],"acting":[2,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":2,"acting_primary":2,"purged_snaps":[]},{"pgid":"3.4","version":"0'0","reported_seq":15,"reported_epoch":22,"state":"active+clean","last_fresh":"2023-08-01T19:54:25.147541+0000","last_change":"2023-08-01T19:54:04.062283+0000","last_active":"2023-08-01T19:54:25.147541+0000","last_peered":"2023-08-01T19:54:25.147541+0000","last_clean":"2023-08-01T19:54:25.147541+0000","last_became_active":"2023-08-01T19:54:04.061796+0000","last_became_peered":"2023-08-01T19:54:04.061796+0000","last_unstale":"2023-08-01T19:54:25.147541+0000","last_undegraded":"2023-08-01T19:54:25.147541+0000","last_fullsized":"2023-08-01T19:54:25.147541+0000","mapping_epoch":15,"log_start":"0'0","ondisk_log_start":"0'0","created":15,"last_epoch_clean":16,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-08-01T19:54:03.032665+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-08-01T19:54:03.032665+0000","last_clean_scrub_stamp":"2023-08-01T19:54:03.032665+0000","objects_scrubbed":0,"log_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-08-02T19:54:08.401797+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[0,2],"acting":[0,2],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":0,"acting_primary":0,"purged_snaps":[]},{"pgid":"4.3","version":"0'0","reported_seq":14,"reported_epoch":22,"state":"active+clean","last_fresh":"2023-08-01T19:54:25.144824+0000","last_change":"2023-08-01T19:54:04.473088+0000","last_active":"2023-08-01T19:54:25.144824+0000","last_peered":"2023-08-01T19:54:25.144824+0000","last_clean":"2023-08-01T19:54:25.144824+0000","last_became_active":"2023-08-01T19:54:04.472611+0000","last_became_peered":"2023-08-01T19:54:04.472611+0000","last_unstale":"2023-08-01T19:54:25.144824+0000","last_undegraded":"2023-08-01T19:54:25.144824+0000","last_fullsized":"2023-08-01T19:54:25.144824+0000","mapping_epoch":16,"log_start":"0'0","ondisk_log_start":"0'0","created":16,"last_epoch_clean":17,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-08-01T19:54:04.040663+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-08-01T19:54:04.040663+0000","last_clean_scrub_stamp":"2023-08-01T19:54:04.040663+0000","objects_scrubbed":0,"log_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-08-03T07:27:26.537518+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[2,1],"acting":[2,1],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":2,"acting_primary":2,"purged_snaps":[]},{"pgid":"5.1","version":"23'1364","reported_seq":1375,"reported_epoch":23,"state":"active+clean","last_fresh":"2023-08-01T19:54:29.911890+0000","last_change":"2023-08-01T19:54:23.138225+0000","last_active":"2023-08-01T19:54:29.911890+0000","last_peered":"2023-08-01T19:54:29.911890+0000","last_clean":"2023-08-01T19:54:29.911890+0000","last_became_active":"2023-08-01T19:54:23.137955+0000","last_became_peered":"2023-08-01T19:54:23.137955+0000","last_unstale":"2023-08-01T19:54:29.911890+0000","last_undegraded":"2023-08-01T19:54:29.911890+0000","last_fullsized":"2023-08-01T19:54:29.911890+0000","mapping_epoch":19,"log_start":"0'0","ondisk_log_start":"0'0","created":19,"last_epoch_clean":20,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-08-01T19:54:22.116710+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-08-01T19:54:22.116710+0000","last_clean_scrub_stamp":"2023-08-01T19:54:22.116710+0000","objects_scrubbed":0,"log_size":1364,"ondisk_log_size":1364,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-08-03T03:58:00.471919+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":89391104,"num_objects":1364,"num_object_clones":0,"num_object_copies":2728,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":1364,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":1364,"num_write_kb":87296,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[1,0],"acting":[1,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":1,"acting_primary":1,"purged_snaps":[]},{"pgid":"3.7","version":"17'2","reported_seq":17,"reported_epoch":22,"state":"active+clean","last_fresh":"2023-08-01T19:54:25.146102+0000","last_change":"2023-08-01T19:54:04.065147+0000","last_active":"2023-08-01T19:54:25.146102+0000","last_peered":"2023-08-01T19:54:25.146102+0000","last_clean":"2023-08-01T19:54:25.146102+0000","last_became_active":"2023-08-01T19:54:04.064779+0000","last_became_peered":"2023-08-01T19:54:04.064779+0000","last_unstale":"2023-08-01T19:54:25.146102+0000","last_undegraded":"2023-08-01T19:54:25.146102+0000","last_fullsized":"2023-08-01T19:54:25.146102+0000","mapping_epoch":15,"log_start":"0'0","ondisk_log_start":"0'0","created":15,"last_epoch_clean":16,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-08-01T19:54:03.032665+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-08-01T19:54:03.032665+0000","last_clean_scrub_stamp":"2023-08-01T19:54:03.032665+0000","objects_scrubbed":0,"log_size":2,"ondisk_log_size":2,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-08-03T03:43:45.667663+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":1,"num_object_clones":0,"num_object_copies":2,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":1,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":3,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":1,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[0,2],"acting":[0,2],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":0,"acting_primary":0,"purged_snaps":[]},{"pgid":"2.6","version":"0'0","reported_seq":18,"reported_epoch":22,"state":"active+clean","last_fresh":"2023-08-01T19:54:25.146736+0000","last_change":"2023-08-01T19:53:58.974077+0000","last_active":"2023-08-01T19:54:25.146736+0000","last_peered":"2023-08-01T19:54:25.146736+0000","last_clean":"2023-08-01T19:54:25.146736+0000","last_became_active":"2023-08-01T19:53:58.973396+0000","last_became_peered":"2023-08-01T19:53:58.973396+0000","last_unstale":"2023-08-01T19:54:25.146736+0000","last_undegraded":"2023-08-01T19:54:25.146736+0000","last_fullsized":"2023-08-01T19:54:25.146736+0000","mapping_epoch":12,"log_start":"0'0","ondisk_log_start":"0'0","created":12,"last_epoch_clean":13,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-08-01T19:53:57.959448+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-08-01T19:53:57.959448+0000","last_clean_scrub_stamp":"2023-08-01T19:53:57.959448+0000","objects_scrubbed":0,"log_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-08-02T22:13:50.940864+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[0,2],"acting":[0,2],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":0,"acting_primary":0,"purged_snaps":[]},{"pgid":"4.0","version":"0'0","reported_seq":14,"reported_epoch":22,"state":"active+clean","last_fresh":"2023-08-01T19:54:25.145289+0000","last_change":"2023-08-01T19:54:04.476807+0000","last_active":"2023-08-01T19:54:25.145289+0000","last_peered":"2023-08-01T19:54:25.145289+0000","last_clean":"2023-08-01T19:54:25.145289+0000","last_became_active":"2023-08-01T19:54:04.476453+0000","last_became_peered":"2023-08-01T19:54:04.476453+0000","last_unstale":"2023-08-01T19:54:25.145289+0000","last_undegraded":"2023-08-01T19:54:25.145289+0000","last_fullsized":"2023-08-01T19:54:25.145289+0000","mapping_epoch":16,"log_start":"0'0","ondisk_log_start":"0'0","created":16,"last_epoch_clean":17,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-08-01T19:54:04.040663+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-08-01T19:54:04.040663+0000","last_clean_scrub_stamp":"2023-08-01T19:54:04.040663+0000","objects_scrubbed":0,"log_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-08-02T20:20:59.989030+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[0,1],"acting":[0,1],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":0,"acting_primary":0,"purged_snaps":[]},{"pgid":"5.0","version":"23'1605","reported_seq":1616,"reported_epoch":23,"state":"active+clean","last_fresh":"2023-08-01T19:54:31.043342+0000","last_change":"2023-08-01T19:54:23.138369+0000","last_active":"2023-08-01T19:54:31.043342+0000","last_peered":"2023-08-01T19:54:31.043342+0000","last_clean":"2023-08-01T19:54:31.043342+0000","last_became_active":"2023-08-01T19:54:23.137857+0000","last_became_peered":"2023-08-01T19:54:23.137857+0000","last_unstale":"2023-08-01T19:54:31.043342+0000","last_undegraded":"2023-08-01T19:54:31.043342+0000","last_fullsized":"2023-08-01T19:54:31.043342+0000","mapping_epoch":19,"log_start":"0'0","ondisk_log_start":"0'0","created":19,"last_epoch_clean":20,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-08-01T19:54:22.116710+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-08-01T19:54:22.116710+0000","last_clean_scrub_stamp":"2023-08-01T19:54:22.116710+0000","objects_scrubbed":0,"log_size":1605,"ondisk_log_size":1605,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-08-03T06:02:44.391298+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":105185280,"num_objects":1605,"num_object_clones":0,"num_object_copies":3210,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":1605,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":1605,"num_write_kb":102720,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[2,0],"acting":[2,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":2,"acting_primary":2,"purged_snaps":[]},{"pgid":"2.7","version":"0'0","reported_seq":18,"reported_epoch":22,"state":"active+clean","last_fresh":"2023-08-01T19:54:25.152113+0000","last_change":"2023-08-01T19:53:58.975936+0000","last_active":"2023-08-01T19:54:25.152113+0000","last_peered":"2023-08-01T19:54:25.152113+0000","last_clean":"2023-08-01T19:54:25.152113+0000","last_became_active":"2023-08-01T19:53:58.975680+0000","last_became_peered":"2023-08-01T19:53:58.975680+0000","last_unstale":"2023-08-01T19:54:25.152113+0000","last_undegraded":"2023-08-01T19:54:25.152113+0000","last_fullsized":"2023-08-01T19:54:25.152113+0000","mapping_epoch":12,"log_start":"0'0","ondisk_log_start":"0'0","created":12,"last_epoch_clean":13,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-08-01T19:53:57.959448+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-08-01T19:53:57.959448+0000","last_clean_scrub_stamp":"2023-08-01T19:53:57.959448+0000","objects_scrubbed":0,"log_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-08-03T05:17:03.508898+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[1,2],"acting":[1,2],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":1,"acting_primary":1,"purged_snaps":[]},{"pgid":"3.6","version":"18'1","reported_seq":16,"reported_epoch":22,"state":"active+clean","last_fresh":"2023-08-01T19:54:25.146634+0000","last_change":"2023-08-01T19:54:04.068041+0000","last_active":"2023-08-01T19:54:25.146634+0000","last_peered":"2023-08-01T19:54:25.146634+0000","last_clean":"2023-08-01T19:54:25.146634+0000","last_became_active":"2023-08-01T19:54:04.067613+0000","last_became_peered":"2023-08-01T19:54:04.067613+0000","last_unstale":"2023-08-01T19:54:25.146634+0000","last_undegraded":"2023-08-01T19:54:25.146634+0000","last_fullsized":"2023-08-01T19:54:25.146634+0000","mapping_epoch":15,"log_start":"0'0","ondisk_log_start":"0'0","created":15,"last_epoch_clean":16,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-08-01T19:54:03.032665+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-08-01T19:54:03.032665+0000","last_clean_scrub_stamp":"2023-08-01T19:54:03.032665+0000","objects_scrubbed":0,"log_size":1,"ondisk_log_size":1,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-08-02T21:35:44.874727+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":1,"num_object_clones":0,"num_object_copies":2,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":1,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":1,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":1,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[0,1],"acting":[0,1],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":0,"acting_primary":0,"purged_snaps":[]},{"pgid":"4.1","version":"0'0","reported_seq":14,"reported_epoch":22,"state":"active+clean","last_fresh":"2023-08-01T19:54:25.143324+0000","last_change":"2023-08-01T19:54:04.469243+0000","last_active":"2023-08-01T19:54:25.143324+0000","last_peered":"2023-08-01T19:54:25.143324+0000","last_clean":"2023-08-01T19:54:25.143324+0000","last_became_active":"2023-08-01T19:54:04.468835+0000","last_became_peered":"2023-08-01T19:54:04.468835+0000","last_unstale":"2023-08-01T19:54:25.143324+0000","last_undegraded":"2023-08-01T19:54:25.143324+0000","last_fullsized":"2023-08-01T19:54:25.143324+0000","mapping_epoch":16,"log_start":"0'0","ondisk_log_start":"0'0","created":16,"last_epoch_clean":17,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-08-01T19:54:04.040663+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-08-01T19:54:04.040663+0000","last_clean_scrub_stamp":"2023-08-01T19:54:04.040663+0000","objects_scrubbed":0,"log_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-08-03T04:43:58.358628+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[2,1],"acting":[2,1],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":2,"acting_primary":2,"purged_snaps":[]},{"pgid":"3.1b","version":"17'1","reported_seq":16,"reported_epoch":22,"state":"active+clean","last_fresh":"2023-08-01T19:54:25.144989+0000","last_change":"2023-08-01T19:54:04.066748+0000","last_active":"2023-08-01T19:54:25.144989+0000","last_peered":"2023-08-01T19:54:25.144989+0000","last_clean":"2023-08-01T19:54:25.144989+0000","last_became_active":"2023-08-01T19:54:04.066483+0000","last_became_peered":"2023-08-01T19:54:04.066483+0000","last_unstale":"2023-08-01T19:54:25.144989+0000","last_undegraded":"2023-08-01T19:54:25.144989+0000","last_fullsized":"2023-08-01T19:54:25.144989+0000","mapping_epoch":15,"log_start":"0'0","ondisk_log_start":"0'0","created":15,"last_epoch_clean":16,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-08-01T19:54:03.032665+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-08-01T19:54:03.032665+0000","last_clean_scrub_stamp":"2023-08-01T19:54:03.032665+0000","objects_scrubbed":0,"log_size":1,"ondisk_log_size":1,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-08-03T03:08:26.880362+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[2,1],"acting":[2,1],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":2,"acting_primary":2,"purged_snaps":[]},{"pgid":"4.1c","version":"0'0","reported_seq":14,"reported_epoch":22,"state":"active+clean","last_fresh":"2023-08-01T19:54:25.144582+0000","last_change":"2023-08-01T19:54:04.466766+0000","last_active":"2023-08-01T19:54:25.144582+0000","last_peered":"2023-08-01T19:54:25.144582+0000","last_clean":"2023-08-01T19:54:25.144582+0000","last_became_active":"2023-08-01T19:54:04.466417+0000","last_became_peered":"2023-08-01T19:54:04.466417+0000","last_unstale":"2023-08-01T19:54:25.144582+0000","last_undegraded":"2023-08-01T19:54:25.144582+0000","last_fullsized":"2023-08-01T19:54:25.144582+0000","mapping_epoch":16,"log_start":"0'0","ondisk_log_start":"0'0","created":16,"last_epoch_clean":17,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-08-01T19:54:04.040663+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-08-01T19:54:04.040663+0000","last_clean_scrub_stamp":"2023-08-01T19:54:04.040663+0000","objects_scrubbed":0,"log_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-08-02T22:01:53.643825+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[2,0],"acting":[2,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":2,"acting_primary":2,"purged_snaps":[]},{"pgid":"3.1c","version":"17'2","reported_seq":17,"reported_epoch":22,"state":"active+clean","last_fresh":"2023-08-01T19:54:25.152073+0000","last_change":"2023-08-01T19:54:04.065706+0000","last_active":"2023-08-01T19:54:25.152073+0000","last_peered":"2023-08-01T19:54:25.152073+0000","last_clean":"2023-08-01T19:54:25.152073+0000","last_became_active":"2023-08-01T19:54:04.064796+0000","last_became_peered":"2023-08-01T19:54:04.064796+0000","last_unstale":"2023-08-01T19:54:25.152073+0000","last_undegraded":"2023-08-01T19:54:25.152073+0000","last_fullsized":"2023-08-01T19:54:25.152073+0000","mapping_epoch":15,"log_start":"0'0","ondisk_log_start":"0'0","created":15,"last_epoch_clean":16,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-08-01T19:54:03.032665+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-08-01T19:54:03.032665+0000","last_clean_scrub_stamp":"2023-08-01T19:54:03.032665+0000","objects_scrubbed":0,"log_size":2,"ondisk_log_size":2,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-08-02T21:40:43.596301+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":1,"num_object_clones":0,"num_object_copies":2,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":1,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":3,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":1,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[1,0],"acting":[1,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":1,"acting_primary":1,"purged_snaps":[]},{"pgid":"4.1b","version":"0'0","reported_seq":14,"reported_epoch":22,"state":"active+clean","last_fresh":"2023-08-01T19:54:25.151330+0000","last_change":"2023-08-01T19:54:04.474971+0000","last_active":"2023-08-01T19:54:25.151330+0000","last_peered":"2023-08-01T19:54:25.151330+0000","last_clean":"2023-08-01T19:54:25.151330+0000","last_became_active":"2023-08-01T19:54:04.473957+0000","last_became_peered":"2023-08-01T19:54:04.473957+0000","last_unstale":"2023-08-01T19:54:25.151330+0000","last_undegraded":"2023-08-01T19:54:25.151330+0000","last_fullsized":"2023-08-01T19:54:25.151330+0000","mapping_epoch":16,"log_start":"0'0","ondisk_log_start":"0'0","created":16,"last_epoch_clean":17,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-08-01T19:54:04.040663+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-08-01T19:54:04.040663+0000","last_clean_scrub_stamp":"2023-08-01T19:54:04.040663+0000","objects_scrubbed":0,"log_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-08-02T21:59:19.682560+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[1,0],"acting":[1,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":1,"acting_primary":1,"purged_snaps":[]},{"pgid":"3.1d","version":"17'2","reported_seq":17,"reported_epoch":22,"state":"active+clean","last_fresh":"2023-08-01T19:54:25.144467+0000","last_change":"2023-08-01T19:54:04.065591+0000","last_active":"2023-08-01T19:54:25.144467+0000","last_peered":"2023-08-01T19:54:25.144467+0000","last_clean":"2023-08-01T19:54:25.144467+0000","last_became_active":"2023-08-01T19:54:04.065306+0000","last_became_peered":"2023-08-01T19:54:04.065306+0000","last_unstale":"2023-08-01T19:54:25.144467+0000","last_undegraded":"2023-08-01T19:54:25.144467+0000","last_fullsized":"2023-08-01T19:54:25.144467+0000","mapping_epoch":15,"log_start":"0'0","ondisk_log_start":"0'0","created":15,"last_epoch_clean":16,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-08-01T19:54:03.032665+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-08-01T19:54:03.032665+0000","last_clean_scrub_stamp":"2023-08-01T19:54:03.032665+0000","objects_scrubbed":0,"log_size":2,"ondisk_log_size":2,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-08-02T21:32:10.389227+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":1,"num_object_clones":0,"num_object_copies":2,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":1,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":3,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":1,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[2,1],"acting":[2,1],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":2,"acting_primary":2,"purged_snaps":[]},{"pgid":"4.1a","version":"0'0","reported_seq":14,"reported_epoch":22,"state":"active+clean","last_fresh":"2023-08-01T19:54:25.151188+0000","last_change":"2023-08-01T19:54:04.473302+0000","last_active":"2023-08-01T19:54:25.151188+0000","last_peered":"2023-08-01T19:54:25.151188+0000","last_clean":"2023-08-01T19:54:25.151188+0000","last_became_active":"2023-08-01T19:54:04.472452+0000","last_became_peered":"2023-08-01T19:54:04.472452+0000","last_unstale":"2023-08-01T19:54:25.151188+0000","last_undegraded":"2023-08-01T19:54:25.151188+0000","last_fullsized":"2023-08-01T19:54:25.151188+0000","mapping_epoch":16,"log_start":"0'0","ondisk_log_start":"0'0","created":16,"last_epoch_clean":17,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-08-01T19:54:04.040663+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-08-01T19:54:04.040663+0000","last_clean_scrub_stamp":"2023-08-01T19:54:04.040663+0000","objects_scrubbed":0,"log_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-08-02T21:02:39.542019+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[1,0],"acting":[1,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":1,"acting_primary":1,"purged_snaps":[]},{"pgid":"3.1e","version":"17'1","reported_seq":16,"reported_epoch":22,"state":"active+clean","last_fresh":"2023-08-01T19:54:25.146639+0000","last_change":"2023-08-01T19:54:04.064378+0000","last_active":"2023-08-01T19:54:25.146639+0000","last_peered":"2023-08-01T19:54:25.146639+0000","last_clean":"2023-08-01T19:54:25.146639+0000","last_became_active":"2023-08-01T19:54:04.063988+0000","last_became_peered":"2023-08-01T19:54:04.063988+0000","last_unstale":"2023-08-01T19:54:25.146639+0000","last_undegraded":"2023-08-01T19:54:25.146639+0000","last_fullsized":"2023-08-01T19:54:25.146639+0000","mapping_epoch":15,"log_start":"0'0","ondisk_log_start":"0'0","created":15,"last_epoch_clean":16,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-08-01T19:54:03.032665+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-08-01T19:54:03.032665+0000","last_clean_scrub_stamp":"2023-08-01T19:54:03.032665+0000","objects_scrubbed":0,"log_size":1,"ondisk_log_size":1,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-08-02T22:28:51.936138+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[0,2],"acting":[0,2],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":0,"acting_primary":0,"purged_snaps":[]},{"pgid":"4.19","version":"0'0","reported_seq":14,"reported_epoch":22,"state":"active+clean","last_fresh":"2023-08-01T19:54:25.143429+0000","last_change":"2023-08-01T19:54:04.467017+0000","last_active":"2023-08-01T19:54:25.143429+0000","last_peered":"2023-08-01T19:54:25.143429+0000","last_clean":"2023-08-01T19:54:25.143429+0000","last_became_active":"2023-08-01T19:54:04.466339+0000","last_became_peered":"2023-08-01T19:54:04.466339+0000","last_unstale":"2023-08-01T19:54:25.143429+0000","last_undegraded":"2023-08-01T19:54:25.143429+0000","last_fullsized":"2023-08-01T19:54:25.143429+0000","mapping_epoch":16,"log_start":"0'0","ondisk_log_start":"0'0","created":16,"last_epoch_clean":17,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-08-01T19:54:04.040663+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-08-01T19:54:04.040663+0000","last_clean_scrub_stamp":"2023-08-01T19:54:04.040663+0000","objects_scrubbed":0,"log_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-08-03T04:07:57.222873+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[2,0],"acting":[2,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":2,"acting_primary":2,"purged_snaps":[]},{"pgid":"3.1f","version":"17'4","reported_seq":19,"reported_epoch":22,"state":"active+clean","last_fresh":"2023-08-01T19:54:25.146231+0000","last_change":"2023-08-01T19:54:04.067767+0000","last_active":"2023-08-01T19:54:25.146231+0000","last_peered":"2023-08-01T19:54:25.146231+0000","last_clean":"2023-08-01T19:54:25.146231+0000","last_became_active":"2023-08-01T19:54:04.067414+0000","last_became_peered":"2023-08-01T19:54:04.067414+0000","last_unstale":"2023-08-01T19:54:25.146231+0000","last_undegraded":"2023-08-01T19:54:25.146231+0000","last_fullsized":"2023-08-01T19:54:25.146231+0000","mapping_epoch":15,"log_start":"0'0","ondisk_log_start":"0'0","created":15,"last_epoch_clean":16,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-08-01T19:54:03.032665+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-08-01T19:54:03.032665+0000","last_clean_scrub_stamp":"2023-08-01T19:54:03.032665+0000","objects_scrubbed":0,"log_size":4,"ondisk_log_size":4,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-08-02T21:33:27.007118+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":554,"num_objects":2,"num_object_clones":0,"num_object_copies":4,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":2,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":4,"num_write_kb":1,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":1,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[0,1],"acting":[0,1],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":0,"acting_primary":0,"purged_snaps":[]},{"pgid":"4.18","version":"0'0","reported_seq":14,"reported_epoch":22,"state":"active+clean","last_fresh":"2023-08-01T19:54:25.150957+0000","last_change":"2023-08-01T19:54:04.477588+0000","last_active":"2023-08-01T19:54:25.150957+0000","last_peered":"2023-08-01T19:54:25.150957+0000","last_clean":"2023-08-01T19:54:25.150957+0000","last_became_active":"2023-08-01T19:54:04.476194+0000","last_became_peered":"2023-08-01T19:54:04.476194+0000","last_unstale":"2023-08-01T19:54:25.150957+0000","last_undegraded":"2023-08-01T19:54:25.150957+0000","last_fullsized":"2023-08-01T19:54:25.150957+0000","mapping_epoch":16,"log_start":"0'0","ondisk_log_start":"0'0","created":16,"last_epoch_clean":17,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-08-01T19:54:04.040663+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-08-01T19:54:04.040663+0000","last_clean_scrub_stamp":"2023-08-01T19:54:04.040663+0000","objects_scrubbed":0,"log_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-08-03T03:58:06.360840+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[1,0],"acting":[1,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":1,"acting_primary":1,"purged_snaps":[]},{"pgid":"4.20","version":"0'0","reported_seq":14,"reported_epoch":22,"state":"active+clean","last_fresh":"2023-08-01T19:54:25.150861+0000","last_change":"2023-08-01T19:54:04.477904+0000","last_active":"2023-08-01T19:54:25.150861+0000","last_peered":"2023-08-01T19:54:25.150861+0000","last_clean":"2023-08-01T19:54:25.150861+0000","last_became_active":"2023-08-01T19:54:04.476564+0000","last_became_peered":"2023-08-01T19:54:04.476564+0000","last_unstale":"2023-08-01T19:54:25.150861+0000","last_undegraded":"2023-08-01T19:54:25.150861+0000","last_fullsized":"2023-08-01T19:54:25.150861+0000","mapping_epoch":16,"log_start":"0'0","ondisk_log_start":"0'0","created":16,"last_epoch_clean":17,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-08-01T19:54:04.040663+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-08-01T19:54:04.040663+0000","last_clean_scrub_stamp":"2023-08-01T19:54:04.040663+0000","objects_scrubbed":0,"log_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-08-03T02:21:47.656072+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[1,0],"acting":[1,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":1,"acting_primary":1,"purged_snaps":[]},{"pgid":"4.21","version":"0'0","reported_seq":14,"reported_epoch":22,"state":"active+clean","last_fresh":"2023-08-01T19:54:25.145074+0000","last_change":"2023-08-01T19:54:04.466899+0000","last_active":"2023-08-01T19:54:25.145074+0000","last_peered":"2023-08-01T19:54:25.145074+0000","last_clean":"2023-08-01T19:54:25.145074+0000","last_became_active":"2023-08-01T19:54:04.466500+0000","last_became_peered":"2023-08-01T19:54:04.466500+0000","last_unstale":"2023-08-01T19:54:25.145074+0000","last_undegraded":"2023-08-01T19:54:25.145074+0000","last_fullsized":"2023-08-01T19:54:25.145074+0000","mapping_epoch":16,"log_start":"0'0","ondisk_log_start":"0'0","created":16,"last_epoch_clean":17,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-08-01T19:54:04.040663+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-08-01T19:54:04.040663+0000","last_clean_scrub_stamp":"2023-08-01T19:54:04.040663+0000","objects_scrubbed":0,"log_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-08-03T07:36:38.654701+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[0,2],"acting":[0,2],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":0,"acting_primary":0,"purged_snaps":[]},{"pgid":"4.22","version":"0'0","reported_seq":14,"reported_epoch":22,"state":"active+clean","last_fresh":"2023-08-01T19:54:25.144005+0000","last_change":"2023-08-01T19:54:04.471945+0000","last_active":"2023-08-01T19:54:25.144005+0000","last_peered":"2023-08-01T19:54:25.144005+0000","last_clean":"2023-08-01T19:54:25.144005+0000","last_became_active":"2023-08-01T19:54:04.471371+0000","last_became_peered":"2023-08-01T19:54:04.471371+0000","last_unstale":"2023-08-01T19:54:25.144005+0000","last_undegraded":"2023-08-01T19:54:25.144005+0000","last_fullsized":"2023-08-01T19:54:25.144005+0000","mapping_epoch":16,"log_start":"0'0","ondisk_log_start":"0'0","created":16,"last_epoch_clean":17,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-08-01T19:54:04.040663+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-08-01T19:54:04.040663+0000","last_clean_scrub_stamp":"2023-08-01T19:54:04.040663+0000","objects_scrubbed":0,"log_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-08-02T22:17:59.847819+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[2,1],"acting":[2,1],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":2,"acting_primary":2,"purged_snaps":[]},{"pgid":"4.23","version":"0'0","reported_seq":14,"reported_epoch":22,"state":"active+clean","last_fresh":"2023-08-01T19:54:25.146011+0000","last_change":"2023-08-01T19:54:04.467847+0000","last_active":"2023-08-01T19:54:25.146011+0000","last_peered":"2023-08-01T19:54:25.146011+0000","last_clean":"2023-08-01T19:54:25.146011+0000","last_became_active":"2023-08-01T19:54:04.467111+0000","last_became_peered":"2023-08-01T19:54:04.467111+0000","last_unstale":"2023-08-01T19:54:25.146011+0000","last_undegraded":"2023-08-01T19:54:25.146011+0000","last_fullsized":"2023-08-01T19:54:25.146011+0000","mapping_epoch":16,"log_start":"0'0","ondisk_log_start":"0'0","created":16,"last_epoch_clean":17,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-08-01T19:54:04.040663+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-08-01T19:54:04.040663+0000","last_clean_scrub_stamp":"2023-08-01T19:54:04.040663+0000","objects_scrubbed":0,"log_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-08-03T00:42:19.379348+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[0,2],"acting":[0,2],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":0,"acting_primary":0,"purged_snaps":[]},{"pgid":"4.24","version":"0'0","reported_seq":14,"reported_epoch":22,"state":"active+clean","last_fresh":"2023-08-01T19:54:25.144544+0000","last_change":"2023-08-01T19:54:04.477128+0000","last_active":"2023-08-01T19:54:25.144544+0000","last_peered":"2023-08-01T19:54:25.144544+0000","last_clean":"2023-08-01T19:54:25.144544+0000","last_became_active":"2023-08-01T19:54:04.476819+0000","last_became_peered":"2023-08-01T19:54:04.476819+0000","last_unstale":"2023-08-01T19:54:25.144544+0000","last_undegraded":"2023-08-01T19:54:25.144544+0000","last_fullsized":"2023-08-01T19:54:25.144544+0000","mapping_epoch":16,"log_start":"0'0","ondisk_log_start":"0'0","created":16,"last_epoch_clean":17,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-08-01T19:54:04.040663+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-08-01T19:54:04.040663+0000","last_clean_scrub_stamp":"2023-08-01T19:54:04.040663+0000","objects_scrubbed":0,"log_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-08-03T02:20:23.354054+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[2,1],"acting":[2,1],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":2,"acting_primary":2,"purged_snaps":[]}],"pool_stats":[{"poolid":5,"num_pg":16,"stat_sum":{"num_bytes":1493041152,"num_objects":22782,"num_object_clones":0,"num_object_copies":45564,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":22782,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":22782,"num_write_kb":1458048,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"store_stats":{"total":0,"available":0,"internally_reserved":0,"allocated":183930880,"data_stored":2942894080,"data_compressed":14077950,"data_compressed_allocated":183930880,"data_compressed_original":2942894080,"omap_allocated":0,"internal_metadata":0},"log_size":22782,"ondisk_log_size":22782,"up":32,"acting":32,"num_store_stats":3},{"poolid":4,"num_pg":64,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"store_stats":{"total":0,"available":0,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},"log_size":0,"ondisk_log_size":0,"up":128,"acting":128,"num_store_stats":3},{"poolid":3,"num_pg":32,"stat_sum":{"num_bytes":2306,"num_objects":22,"num_object_clones":0,"num_object_copies":44,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":22,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":45,"num_write_kb":13,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":14,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"store_stats":{"total":0,"available":0,"internally_reserved":0,"allocated":65536,"data_stored":4612,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},"log_size":39,"ondisk_log_size":39,"up":64,"acting":64,"num_store_stats":3},{"poolid":1,"num_pg":1,"stat_sum":{"num_bytes":590368,"num_objects":2,"num_object_clones":0,"num_object_copies":4,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":2,"num_whiteouts":0,"num_read":136,"num_read_kb":118,"num_write":203,"num_write_kb":3460,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"store_stats":{"total":0,"available":0,"internally_reserved":0,"allocated":114688,"data_stored":1180736,"data_compressed":20662,"data_compressed_allocated":73728,"data_compressed_original":1146880,"omap_allocated":0,"internal_metadata":0},"log_size":157,"ondisk_log_size":157,"up":2,"acting":2,"num_store_stats":2},{"poolid":2,"num_pg":8,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"store_stats":{"total":0,"available":0,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},"log_size":0,"ondisk_log_size":0,"up":16,"acting":16,"num_store_stats":3}],"osd_stats":[{"osd":2,"up_from":9,"seq":38654705676,"num_pgs":76,"num_osds":1,"num_per_pool_osds":1,"num_per_pool_omap_osds":1,"kb":94371840,"kb_used":75652,"kb_used_data":50236,"kb_used_omap":0,"kb_used_meta":25408,"kb_avail":94296188,"statfs":{"total":96636764160,"available":96559296512,"internally_reserved":0,"allocated":51441664,"data_stored":818953615,"data_compressed":3924640,"data_compressed_allocated":51179520,"data_compressed_original":818855936,"omap_allocated":0,"internal_metadata":26017792},"hb_peers":[0,1],"snap_trim_queue_len":0,"num_snap_trimming":0,"num_shards_repaired":0,"op_queue_age_hist":{"histogram":[4,0,3,1],"upper_bound":16},"perf_stat":{"commit_latency_ms":2,"apply_latency_ms":2,"commit_latency_ns":2000000,"apply_latency_ns":2000000},"alerts":[],"network_ping_times":[{"osd":0,"last update":"Thu Jan 1 00:00:00 1970","interfaces":[{"interface":"back","average":{"1min":0,"5min":0,"15min":0},"min":{"1min":0,"5min":0,"15min":0},"max":{"1min":0,"5min":0,"15min":0},"last":0.19500000000000001}]},{"osd":1,"last update":"Thu Jan 1 00:00:00 1970","interfaces":[{"interface":"back","average":{"1min":0,"5min":0,"15min":0},"min":{"1min":0,"5min":0,"15min":0},"max":{"1min":0,"5min":0,"15min":0},"last":0.28499999999999998}]}]},{"osd":0,"up_from":8,"seq":34359738379,"num_pgs":85,"num_osds":1,"num_per_pool_osds":1,"num_per_pool_omap_osds":1,"kb":94371840,"kb_used":96044,"kb_used_data":60512,"kb_used_omap":0,"kb_used_meta":35520,"kb_avail":94275796,"statfs":{"total":96636764160,"available":96538415104,"internally_reserved":0,"allocated":61964288,"data_stored":987903749,"data_compressed":4723867,"data_compressed_allocated":61739008,"data_compressed_original":987824128,"omap_allocated":0,"internal_metadata":36372480},"hb_peers":[1,2],"snap_trim_queue_len":0,"num_snap_trimming":0,"num_shards_repaired":0,"op_queue_age_hist":{"histogram":[],"upper_bound":1},"perf_stat":{"commit_latency_ms":1,"apply_latency_ms":1,"commit_latency_ns":1000000,"apply_latency_ns":1000000},"alerts":[],"network_ping_times":[{"osd":1,"last update":"Thu Jan 1 00:00:00 1970","interfaces":[{"interface":"back","average":{"1min":0,"5min":0,"15min":0},"min":{"1min":0,"5min":0,"15min":0},"max":{"1min":0,"5min":0,"15min":0},"last":0.183}]},{"osd":2,"last update":"Thu Jan 1 00:00:00 1970","interfaces":[{"interface":"back","average":{"1min":0,"5min":0,"15min":0},"min":{"1min":0,"5min":0,"15min":0},"max":{"1min":0,"5min":0,"15min":0},"last":0.28100000000000003}]}]},{"osd":1,"up_from":8,"seq":34359738378,"num_pgs":81,"num_osds":1,"num_per_pool_osds":1,"num_per_pool_omap_osds":1,"kb":94371840,"kb_used":71880,"kb_used_data":47168,"kb_used_omap":0,"kb_used_meta":24704,"kb_avail":94299960,"statfs":{"total":96636764160,"available":96563159040,"internally_reserved":0,"allocated":48300032,"data_stored":768557019,"data_compressed":3682599,"data_compressed_allocated":48029696,"data_compressed_original":768458752,"omap_allocated":0,"internal_metadata":25296896},"hb_peers":[0,2],"snap_trim_queue_len":0,"num_snap_trimming":0,"num_shards_repaired":0,"op_queue_age_hist":{"histogram":[1,1,1,9],"upper_bound":16},"perf_stat":{"commit_latency_ms":2,"apply_latency_ms":2,"commit_latency_ns":2000000,"apply_latency_ns":2000000},"alerts":[],"network_ping_times":[{"osd":0,"last update":"Thu Jan 1 00:00:00 1970","interfaces":[{"interface":"back","average":{"1min":0,"5min":0,"15min":0},"min":{"1min":0,"5min":0,"15min":0},"max":{"1min":0,"5min":0,"15min":0},"last":0.224}]},{"osd":2,"last update":"Thu Jan 1 00:00:00 1970","interfaces":[{"interface":"back","average":{"1min":0,"5min":0,"15min":0},"min":{"1min":0,"5min":0,"15min":0},"max":{"1min":0,"5min":0,"15min":0},"last":0.246}]}]}],"pool_statfs":[{"poolid":1,"osd":1,"total":0,"available":0,"internally_reserved":0,"allocated":57344,"data_stored":590368,"data_compressed":10331,"data_compressed_allocated":36864,"data_compressed_original":573440,"omap_allocated":0,"internal_metadata":0},{"poolid":1,"osd":2,"total":0,"available":0,"internally_reserved":0,"allocated":57344,"data_stored":590368,"data_compressed":10331,"data_compressed_allocated":36864,"data_compressed_original":573440,"omap_allocated":0,"internal_metadata":0},{"poolid":2,"osd":0,"total":0,"available":0,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":2,"osd":1,"total":0,"available":0,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":2,"osd":2,"total":0,"available":0,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":3,"osd":0,"total":0,"available":0,"internally_reserved":0,"allocated":8192,"data_stored":588,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":3,"osd":1,"total":0,"available":0,"internally_reserved":0,"allocated":32768,"data_stored":2306,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":3,"osd":2,"total":0,"available":0,"internally_reserved":0,"allocated":24576,"data_stored":1718,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":4,"osd":0,"total":0,"available":0,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":4,"osd":1,"total":0,"available":0,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":4,"osd":2,"total":0,"available":0,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":5,"osd":0,"total":0,"available":0,"internally_reserved":0,"allocated":71409664,"data_stored":1142554624,"data_compressed":5465221,"data_compressed_allocated":71409664,"data_compressed_original":1142554624,"omap_allocated":0,"internal_metadata":0},{"poolid":5,"osd":1,"total":0,"available":0,"internally_reserved":0,"allocated":54870016,"data_stored":877920256,"data_compressed":4199474,"data_compressed_allocated":54870016,"data_compressed_original":877920256,"omap_allocated":0,"internal_metadata":0},{"poolid":5,"osd":2,"total":0,"available":0,"internally_reserved":0,"allocated":57651200,"data_stored":922419200,"data_compressed":4413255,"data_compressed_allocated":57651200,"data_compressed_original":922419200,"omap_allocated":0,"internal_metadata":0}]}} 2023-08-01T19:54:33.054 INFO:tasks.thrashosds.thrasher:Setting 4.34 to [2, 0, 1] 2023-08-01T19:54:33.055 INFO:tasks.thrashosds.thrasher:cmd ['osd', 'pg-upmap-items', '4.34', '2', '0', '1'] 2023-08-01T19:54:33.055 DEBUG:teuthology.orchestra.run.smithi006:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 120 ceph --cluster ceph osd pg-upmap-items 4.34 2 0 1 2023-08-01T19:54:33.142 INFO:tasks.ceph.osd.2.smithi155.stderr:2023-08-01T19:54:33.141+0000 7faa5c6ac700 -1 received signal: Hangup from /usr/bin/python3 /bin/daemon-helper kill ceph-osd -f --cluster ceph -i 2 (PID: 111337) UID: 0 2023-08-01T19:54:33.170 DEBUG:teuthology.orchestra.run.smithi006:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 120 ceph --cluster ceph osd set noscrub 2023-08-01T19:54:33.235 INFO:teuthology.orchestra.run.smithi101.stdout:{ 2023-08-01T19:54:33.235 INFO:teuthology.orchestra.run.smithi101.stdout: "ops": [ 2023-08-01T19:54:33.235 INFO:teuthology.orchestra.run.smithi101.stdout: { 2023-08-01T19:54:33.236 INFO:teuthology.orchestra.run.smithi101.stdout: "description": "osd_repop(client.4668.0:31686 5.c e24/19 5:3d4453fd:::benchmark_data_smithi006_114134_object31685:head v 24'2018, mlcod=24'2014)", 2023-08-01T19:54:33.236 INFO:teuthology.orchestra.run.smithi101.stdout: "initiated_at": "2023-08-01T19:54:33.231446+0000", 2023-08-01T19:54:33.236 INFO:teuthology.orchestra.run.smithi101.stdout: "age": 0.0025502789999999999, 2023-08-01T19:54:33.236 INFO:teuthology.orchestra.run.smithi101.stdout: "duration": 0.0025667620000000002, 2023-08-01T19:54:33.236 INFO:teuthology.orchestra.run.smithi101.stdout: "type_data": { 2023-08-01T19:54:33.236 INFO:teuthology.orchestra.run.smithi101.stdout: "flag_point": "started", 2023-08-01T19:54:33.236 INFO:teuthology.orchestra.run.smithi101.stdout: "events": [ 2023-08-01T19:54:33.237 INFO:teuthology.orchestra.run.smithi101.stdout: { 2023-08-01T19:54:33.237 INFO:teuthology.orchestra.run.smithi101.stdout: "event": "initiated", 2023-08-01T19:54:33.237 INFO:teuthology.orchestra.run.smithi101.stdout: "time": "2023-08-01T19:54:33.231446+0000", 2023-08-01T19:54:33.237 INFO:teuthology.orchestra.run.smithi101.stdout: "duration": 0 2023-08-01T19:54:33.237 INFO:teuthology.orchestra.run.smithi101.stdout: }, 2023-08-01T19:54:33.237 INFO:teuthology.orchestra.run.smithi101.stdout: { 2023-08-01T19:54:33.237 INFO:teuthology.orchestra.run.smithi101.stdout: "event": "throttled", 2023-08-01T19:54:33.237 INFO:teuthology.orchestra.run.smithi101.stdout: "time": "2023-08-01T19:54:33.231446+0000", 2023-08-01T19:54:33.238 INFO:teuthology.orchestra.run.smithi101.stdout: "duration": 0 2023-08-01T19:54:33.238 INFO:teuthology.orchestra.run.smithi101.stdout: }, 2023-08-01T19:54:33.238 INFO:teuthology.orchestra.run.smithi101.stdout: { 2023-08-01T19:54:33.238 INFO:teuthology.orchestra.run.smithi101.stdout: "event": "header_read", 2023-08-01T19:54:33.238 INFO:teuthology.orchestra.run.smithi101.stdout: "time": "2023-08-01T19:54:33.231445+0000", 2023-08-01T19:54:33.238 INFO:teuthology.orchestra.run.smithi101.stdout: "duration": 4294967295.9999995 2023-08-01T19:54:33.238 INFO:teuthology.orchestra.run.smithi101.stdout: }, 2023-08-01T19:54:33.238 INFO:teuthology.orchestra.run.smithi101.stdout: { 2023-08-01T19:54:33.239 INFO:teuthology.orchestra.run.smithi101.stdout: "event": "all_read", 2023-08-01T19:54:33.239 INFO:teuthology.orchestra.run.smithi101.stdout: "time": "2023-08-01T19:54:33.231502+0000", 2023-08-01T19:54:33.239 INFO:teuthology.orchestra.run.smithi101.stdout: "duration": 5.6319000000000001e-05 2023-08-01T19:54:33.239 INFO:teuthology.orchestra.run.smithi101.stdout: }, 2023-08-01T19:54:33.239 INFO:teuthology.orchestra.run.smithi101.stdout: { 2023-08-01T19:54:33.239 INFO:teuthology.orchestra.run.smithi101.stdout: "event": "dispatched", 2023-08-01T19:54:33.239 INFO:teuthology.orchestra.run.smithi101.stdout: "time": "2023-08-01T19:54:33.231510+0000", 2023-08-01T19:54:33.240 INFO:teuthology.orchestra.run.smithi101.stdout: "duration": 8.1589999999999993e-06 2023-08-01T19:54:33.240 INFO:teuthology.orchestra.run.smithi101.stdout: }, 2023-08-01T19:54:33.240 INFO:teuthology.orchestra.run.smithi101.stdout: { 2023-08-01T19:54:33.240 INFO:teuthology.orchestra.run.smithi101.stdout: "event": "queued_for_pg", 2023-08-01T19:54:33.240 INFO:teuthology.orchestra.run.smithi101.stdout: "time": "2023-08-01T19:54:33.231514+0000", 2023-08-01T19:54:33.240 INFO:teuthology.orchestra.run.smithi101.stdout: "duration": 4.5340000000000001e-06 2023-08-01T19:54:33.240 INFO:teuthology.orchestra.run.smithi101.stdout: }, 2023-08-01T19:54:33.240 INFO:teuthology.orchestra.run.smithi101.stdout: { 2023-08-01T19:54:33.241 INFO:teuthology.orchestra.run.smithi101.stdout: "event": "reached_pg", 2023-08-01T19:54:33.241 INFO:teuthology.orchestra.run.smithi101.stdout: "time": "2023-08-01T19:54:33.231544+0000", 2023-08-01T19:54:33.241 INFO:teuthology.orchestra.run.smithi101.stdout: "duration": 2.9989e-05 2023-08-01T19:54:33.241 INFO:teuthology.orchestra.run.smithi101.stdout: }, 2023-08-01T19:54:33.241 INFO:teuthology.orchestra.run.smithi101.stdout: { 2023-08-01T19:54:33.241 INFO:teuthology.orchestra.run.smithi101.stdout: "event": "started", 2023-08-01T19:54:33.241 INFO:teuthology.orchestra.run.smithi101.stdout: "time": "2023-08-01T19:54:33.231558+0000", 2023-08-01T19:54:33.242 INFO:teuthology.orchestra.run.smithi101.stdout: "duration": 1.3361e-05 2023-08-01T19:54:33.242 INFO:teuthology.orchestra.run.smithi101.stdout: } 2023-08-01T19:54:33.242 INFO:teuthology.orchestra.run.smithi101.stdout: ] 2023-08-01T19:54:33.242 INFO:teuthology.orchestra.run.smithi101.stdout: } 2023-08-01T19:54:33.242 INFO:teuthology.orchestra.run.smithi101.stdout: }, 2023-08-01T19:54:33.242 INFO:teuthology.orchestra.run.smithi101.stdout: { 2023-08-01T19:54:33.242 INFO:teuthology.orchestra.run.smithi101.stdout: "description": "osd_op(client.4668.0:31688 5.9 5:9bfcf11a:::benchmark_data_smithi006_114134_object31687:head [set-alloc-hint object_size 65536 write_size 65536,write 0~65536 in=65536b] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e24)", 2023-08-01T19:54:33.242 INFO:teuthology.orchestra.run.smithi101.stdout: "initiated_at": "2023-08-01T19:54:33.232128+0000", 2023-08-01T19:54:33.243 INFO:teuthology.orchestra.run.smithi101.stdout: "age": 0.001868471, 2023-08-01T19:54:33.243 INFO:teuthology.orchestra.run.smithi101.stdout: "duration": 0.0019364199999999999, 2023-08-01T19:54:33.243 INFO:teuthology.orchestra.run.smithi101.stdout: "type_data": { 2023-08-01T19:54:33.243 INFO:teuthology.orchestra.run.smithi101.stdout: "flag_point": "waiting for sub ops", 2023-08-01T19:54:33.243 INFO:teuthology.orchestra.run.smithi101.stdout: "client_info": { 2023-08-01T19:54:33.243 INFO:teuthology.orchestra.run.smithi101.stdout: "client": "client.4668", 2023-08-01T19:54:33.243 INFO:teuthology.orchestra.run.smithi101.stdout: "client_addr": "172.21.15.6:0/1709472247", 2023-08-01T19:54:33.243 INFO:teuthology.orchestra.run.smithi101.stdout: "tid": 31688 2023-08-01T19:54:33.244 INFO:teuthology.orchestra.run.smithi101.stdout: }, 2023-08-01T19:54:33.244 INFO:teuthology.orchestra.run.smithi101.stdout: "events": [ 2023-08-01T19:54:33.244 INFO:teuthology.orchestra.run.smithi101.stdout: { 2023-08-01T19:54:33.244 INFO:teuthology.orchestra.run.smithi101.stdout: "event": "initiated", 2023-08-01T19:54:33.244 INFO:teuthology.orchestra.run.smithi101.stdout: "time": "2023-08-01T19:54:33.232128+0000", 2023-08-01T19:54:33.244 INFO:teuthology.orchestra.run.smithi101.stdout: "duration": 0 2023-08-01T19:54:33.244 INFO:teuthology.orchestra.run.smithi101.stdout: }, 2023-08-01T19:54:33.244 INFO:teuthology.orchestra.run.smithi101.stdout: { 2023-08-01T19:54:33.245 INFO:teuthology.orchestra.run.smithi101.stdout: "event": "throttled", 2023-08-01T19:54:33.245 INFO:teuthology.orchestra.run.smithi101.stdout: "time": "2023-08-01T19:54:33.232128+0000", 2023-08-01T19:54:33.245 INFO:teuthology.orchestra.run.smithi101.stdout: "duration": 0 2023-08-01T19:54:33.245 INFO:teuthology.orchestra.run.smithi101.stdout: }, 2023-08-01T19:54:33.245 INFO:teuthology.orchestra.run.smithi101.stdout: { 2023-08-01T19:54:33.245 INFO:teuthology.orchestra.run.smithi101.stdout: "event": "header_read", 2023-08-01T19:54:33.245 INFO:teuthology.orchestra.run.smithi101.stdout: "time": "2023-08-01T19:54:33.232127+0000", 2023-08-01T19:54:33.245 INFO:teuthology.orchestra.run.smithi101.stdout: "duration": 4294967295.999999 2023-08-01T19:54:33.246 INFO:teuthology.orchestra.run.smithi101.stdout: }, 2023-08-01T19:54:33.246 INFO:teuthology.orchestra.run.smithi101.stdout: { 2023-08-01T19:54:33.246 INFO:teuthology.orchestra.run.smithi101.stdout: "event": "all_read", 2023-08-01T19:54:33.246 INFO:teuthology.orchestra.run.smithi101.stdout: "time": "2023-08-01T19:54:33.232183+0000", 2023-08-01T19:54:33.246 INFO:teuthology.orchestra.run.smithi101.stdout: "duration": 5.6425999999999998e-05 2023-08-01T19:54:33.246 INFO:teuthology.orchestra.run.smithi101.stdout: }, 2023-08-01T19:54:33.246 INFO:teuthology.orchestra.run.smithi101.stdout: { 2023-08-01T19:54:33.246 INFO:teuthology.orchestra.run.smithi101.stdout: "event": "dispatched", 2023-08-01T19:54:33.247 INFO:teuthology.orchestra.run.smithi101.stdout: "time": "2023-08-01T19:54:33.232207+0000", 2023-08-01T19:54:33.247 INFO:teuthology.orchestra.run.smithi101.stdout: "duration": 2.3181999999999999e-05 2023-08-01T19:54:33.247 INFO:teuthology.orchestra.run.smithi101.stdout: }, 2023-08-01T19:54:33.247 INFO:teuthology.orchestra.run.smithi101.stdout: { 2023-08-01T19:54:33.247 INFO:teuthology.orchestra.run.smithi101.stdout: "event": "queued_for_pg", 2023-08-01T19:54:33.247 INFO:teuthology.orchestra.run.smithi101.stdout: "time": "2023-08-01T19:54:33.232214+0000", 2023-08-01T19:54:33.247 INFO:teuthology.orchestra.run.smithi101.stdout: "duration": 7.3470000000000001e-06 2023-08-01T19:54:33.248 INFO:teuthology.orchestra.run.smithi101.stdout: }, 2023-08-01T19:54:33.248 INFO:teuthology.orchestra.run.smithi101.stdout: { 2023-08-01T19:54:33.248 INFO:teuthology.orchestra.run.smithi101.stdout: "event": "reached_pg", 2023-08-01T19:54:33.248 INFO:teuthology.orchestra.run.smithi101.stdout: "time": "2023-08-01T19:54:33.232490+0000", 2023-08-01T19:54:33.248 INFO:teuthology.orchestra.run.smithi101.stdout: "duration": 0.00027606199999999999 2023-08-01T19:54:33.248 INFO:teuthology.orchestra.run.smithi101.stdout: }, 2023-08-01T19:54:33.248 INFO:teuthology.orchestra.run.smithi101.stdout: { 2023-08-01T19:54:33.248 INFO:teuthology.orchestra.run.smithi101.stdout: "event": "started", 2023-08-01T19:54:33.249 INFO:teuthology.orchestra.run.smithi101.stdout: "time": "2023-08-01T19:54:33.232584+0000", 2023-08-01T19:54:33.249 INFO:teuthology.orchestra.run.smithi101.stdout: "duration": 9.4393000000000002e-05 2023-08-01T19:54:33.249 INFO:teuthology.orchestra.run.smithi101.stdout: }, 2023-08-01T19:54:33.249 INFO:teuthology.orchestra.run.smithi101.stdout: { 2023-08-01T19:54:33.249 INFO:teuthology.orchestra.run.smithi101.stdout: "event": "waiting for subops from 2", 2023-08-01T19:54:33.249 INFO:teuthology.orchestra.run.smithi101.stdout: "time": "2023-08-01T19:54:33.232713+0000", 2023-08-01T19:54:33.249 INFO:teuthology.orchestra.run.smithi101.stdout: "duration": 0.000128274 2023-08-01T19:54:33.249 INFO:teuthology.orchestra.run.smithi101.stdout: } 2023-08-01T19:54:33.250 INFO:teuthology.orchestra.run.smithi101.stdout: ] 2023-08-01T19:54:33.250 INFO:teuthology.orchestra.run.smithi101.stdout: } 2023-08-01T19:54:33.250 INFO:teuthology.orchestra.run.smithi101.stdout: }, 2023-08-01T19:54:33.250 INFO:teuthology.orchestra.run.smithi101.stdout: { 2023-08-01T19:54:33.250 INFO:teuthology.orchestra.run.smithi101.stdout: "description": "osd_op(client.4668.0:31689 5.f 5:fcf35c4d:::benchmark_data_smithi006_114134_object31688:head [set-alloc-hint object_size 65536 write_size 65536,write 0~65536 in=65536b] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e24)", 2023-08-01T19:54:33.250 INFO:teuthology.orchestra.run.smithi101.stdout: "initiated_at": "2023-08-01T19:54:33.232228+0000", 2023-08-01T19:54:33.250 INFO:teuthology.orchestra.run.smithi101.stdout: "age": 0.0017683620000000001, 2023-08-01T19:54:33.250 INFO:teuthology.orchestra.run.smithi101.stdout: "duration": 0.001883982, 2023-08-01T19:54:33.251 INFO:teuthology.orchestra.run.smithi101.stdout: "type_data": { 2023-08-01T19:54:33.251 INFO:teuthology.orchestra.run.smithi101.stdout: "flag_point": "waiting for sub ops", 2023-08-01T19:54:33.251 INFO:teuthology.orchestra.run.smithi101.stdout: "client_info": { 2023-08-01T19:54:33.251 INFO:teuthology.orchestra.run.smithi101.stdout: "client": "client.4668", 2023-08-01T19:54:33.251 INFO:teuthology.orchestra.run.smithi101.stdout: "client_addr": "172.21.15.6:0/1709472247", 2023-08-01T19:54:33.251 INFO:teuthology.orchestra.run.smithi101.stdout: "tid": 31689 2023-08-01T19:54:33.251 INFO:teuthology.orchestra.run.smithi101.stdout: }, 2023-08-01T19:54:33.251 INFO:teuthology.orchestra.run.smithi101.stdout: "events": [ 2023-08-01T19:54:33.252 INFO:teuthology.orchestra.run.smithi101.stdout: { 2023-08-01T19:54:33.252 INFO:teuthology.orchestra.run.smithi101.stdout: "event": "initiated", 2023-08-01T19:54:33.252 INFO:teuthology.orchestra.run.smithi101.stdout: "time": "2023-08-01T19:54:33.232228+0000", 2023-08-01T19:54:33.252 INFO:teuthology.orchestra.run.smithi101.stdout: "duration": 0 2023-08-01T19:54:33.252 INFO:teuthology.orchestra.run.smithi101.stdout: }, 2023-08-01T19:54:33.252 INFO:teuthology.orchestra.run.smithi101.stdout: { 2023-08-01T19:54:33.252 INFO:teuthology.orchestra.run.smithi101.stdout: "event": "throttled", 2023-08-01T19:54:33.253 INFO:teuthology.orchestra.run.smithi101.stdout: "time": "2023-08-01T19:54:33.232228+0000", 2023-08-01T19:54:33.253 INFO:teuthology.orchestra.run.smithi101.stdout: "duration": 0 2023-08-01T19:54:33.253 INFO:teuthology.orchestra.run.smithi101.stdout: }, 2023-08-01T19:54:33.253 INFO:teuthology.orchestra.run.smithi101.stdout: { 2023-08-01T19:54:33.253 INFO:teuthology.orchestra.run.smithi101.stdout: "event": "header_read", 2023-08-01T19:54:33.253 INFO:teuthology.orchestra.run.smithi101.stdout: "time": "2023-08-01T19:54:33.232227+0000", 2023-08-01T19:54:33.253 INFO:teuthology.orchestra.run.smithi101.stdout: "duration": 4294967295.9999995 2023-08-01T19:54:33.253 INFO:teuthology.orchestra.run.smithi101.stdout: }, 2023-08-01T19:54:33.254 INFO:teuthology.orchestra.run.smithi101.stdout: { 2023-08-01T19:54:33.254 INFO:teuthology.orchestra.run.smithi101.stdout: "event": "all_read", 2023-08-01T19:54:33.254 INFO:teuthology.orchestra.run.smithi101.stdout: "time": "2023-08-01T19:54:33.232256+0000", 2023-08-01T19:54:33.254 INFO:teuthology.orchestra.run.smithi101.stdout: "duration": 2.8186000000000001e-05 2023-08-01T19:54:33.254 INFO:teuthology.orchestra.run.smithi101.stdout: }, 2023-08-01T19:54:33.254 INFO:teuthology.orchestra.run.smithi101.stdout: { 2023-08-01T19:54:33.254 INFO:teuthology.orchestra.run.smithi101.stdout: "event": "dispatched", 2023-08-01T19:54:33.254 INFO:teuthology.orchestra.run.smithi101.stdout: "time": "2023-08-01T19:54:33.232264+0000", 2023-08-01T19:54:33.255 INFO:teuthology.orchestra.run.smithi101.stdout: "duration": 8.6279999999999994e-06 2023-08-01T19:54:33.255 INFO:teuthology.orchestra.run.smithi101.stdout: }, 2023-08-01T19:54:33.255 INFO:teuthology.orchestra.run.smithi101.stdout: { 2023-08-01T19:54:33.255 INFO:teuthology.orchestra.run.smithi101.stdout: "event": "queued_for_pg", 2023-08-01T19:54:33.255 INFO:teuthology.orchestra.run.smithi101.stdout: "time": "2023-08-01T19:54:33.232270+0000", 2023-08-01T19:54:33.255 INFO:teuthology.orchestra.run.smithi101.stdout: "duration": 5.2800000000000003e-06 2023-08-01T19:54:33.255 INFO:teuthology.orchestra.run.smithi101.stdout: }, 2023-08-01T19:54:33.255 INFO:teuthology.orchestra.run.smithi101.stdout: { 2023-08-01T19:54:33.256 INFO:teuthology.orchestra.run.smithi101.stdout: "event": "reached_pg", 2023-08-01T19:54:33.256 INFO:teuthology.orchestra.run.smithi101.stdout: "time": "2023-08-01T19:54:33.232311+0000", 2023-08-01T19:54:33.256 INFO:teuthology.orchestra.run.smithi101.stdout: "duration": 4.1053999999999997e-05 2023-08-01T19:54:33.256 INFO:teuthology.orchestra.run.smithi101.stdout: }, 2023-08-01T19:54:33.256 INFO:teuthology.orchestra.run.smithi101.stdout: { 2023-08-01T19:54:33.256 INFO:teuthology.orchestra.run.smithi101.stdout: "event": "started", 2023-08-01T19:54:33.256 INFO:teuthology.orchestra.run.smithi101.stdout: "time": "2023-08-01T19:54:33.232420+0000", 2023-08-01T19:54:33.256 INFO:teuthology.orchestra.run.smithi101.stdout: "duration": 0.000109753 2023-08-01T19:54:33.257 INFO:teuthology.orchestra.run.smithi101.stdout: }, 2023-08-01T19:54:33.257 INFO:teuthology.orchestra.run.smithi101.stdout: { 2023-08-01T19:54:33.257 INFO:teuthology.orchestra.run.smithi101.stdout: "event": "waiting for subops from 2", 2023-08-01T19:54:33.257 INFO:teuthology.orchestra.run.smithi101.stdout: "time": "2023-08-01T19:54:33.232518+0000", 2023-08-01T19:54:33.257 INFO:teuthology.orchestra.run.smithi101.stdout: "duration": 9.7238999999999995e-05 2023-08-01T19:54:33.257 INFO:teuthology.orchestra.run.smithi101.stdout: } 2023-08-01T19:54:33.257 INFO:teuthology.orchestra.run.smithi101.stdout: ] 2023-08-01T19:54:33.257 INFO:teuthology.orchestra.run.smithi101.stdout: } 2023-08-01T19:54:33.258 INFO:teuthology.orchestra.run.smithi101.stdout: }, 2023-08-01T19:54:33.258 INFO:teuthology.orchestra.run.smithi101.stdout: { 2023-08-01T19:54:33.258 INFO:teuthology.orchestra.run.smithi101.stdout: "description": "osd_op(client.4668.0:31692 5.f 5:f6909e9d:::benchmark_data_smithi006_114134_object31691:head [set-alloc-hint object_size 65536 write_size 65536,write 0~65536 in=65536b] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e24)", 2023-08-01T19:54:33.258 INFO:teuthology.orchestra.run.smithi101.stdout: "initiated_at": "2023-08-01T19:54:33.232639+0000", 2023-08-01T19:54:33.258 INFO:teuthology.orchestra.run.smithi101.stdout: "age": 0.001357294, 2023-08-01T19:54:33.258 INFO:teuthology.orchestra.run.smithi101.stdout: "duration": 0.0015155189999999999, 2023-08-01T19:54:33.258 INFO:teuthology.orchestra.run.smithi101.stdout: "type_data": { 2023-08-01T19:54:33.259 INFO:teuthology.orchestra.run.smithi101.stdout: "flag_point": "waiting for sub ops", 2023-08-01T19:54:33.259 INFO:teuthology.orchestra.run.smithi101.stdout: "client_info": { 2023-08-01T19:54:33.259 INFO:teuthology.orchestra.run.smithi101.stdout: "client": "client.4668", 2023-08-01T19:54:33.259 INFO:teuthology.orchestra.run.smithi101.stdout: "client_addr": "172.21.15.6:0/1709472247", 2023-08-01T19:54:33.259 INFO:teuthology.orchestra.run.smithi101.stdout: "tid": 31692 2023-08-01T19:54:33.259 INFO:teuthology.orchestra.run.smithi101.stdout: }, 2023-08-01T19:54:33.259 INFO:teuthology.orchestra.run.smithi101.stdout: "events": [ 2023-08-01T19:54:33.259 INFO:teuthology.orchestra.run.smithi101.stdout: { 2023-08-01T19:54:33.260 INFO:teuthology.orchestra.run.smithi101.stdout: "event": "initiated", 2023-08-01T19:54:33.260 INFO:teuthology.orchestra.run.smithi101.stdout: "time": "2023-08-01T19:54:33.232639+0000", 2023-08-01T19:54:33.260 INFO:teuthology.orchestra.run.smithi101.stdout: "duration": 0 2023-08-01T19:54:33.260 INFO:teuthology.orchestra.run.smithi101.stdout: }, 2023-08-01T19:54:33.260 INFO:teuthology.orchestra.run.smithi101.stdout: { 2023-08-01T19:54:33.260 INFO:teuthology.orchestra.run.smithi101.stdout: "event": "throttled", 2023-08-01T19:54:33.260 INFO:teuthology.orchestra.run.smithi101.stdout: "time": "2023-08-01T19:54:33.232639+0000", 2023-08-01T19:54:33.260 INFO:teuthology.orchestra.run.smithi101.stdout: "duration": 0 2023-08-01T19:54:33.261 INFO:teuthology.orchestra.run.smithi101.stdout: }, 2023-08-01T19:54:33.261 INFO:teuthology.orchestra.run.smithi101.stdout: { 2023-08-01T19:54:33.261 INFO:teuthology.orchestra.run.smithi101.stdout: "event": "header_read", 2023-08-01T19:54:33.261 INFO:teuthology.orchestra.run.smithi101.stdout: "time": "2023-08-01T19:54:33.232638+0000", 2023-08-01T19:54:33.261 INFO:teuthology.orchestra.run.smithi101.stdout: "duration": 4294967295.999999 2023-08-01T19:54:33.261 INFO:teuthology.orchestra.run.smithi101.stdout: }, 2023-08-01T19:54:33.261 INFO:teuthology.orchestra.run.smithi101.stdout: { 2023-08-01T19:54:33.262 INFO:teuthology.orchestra.run.smithi101.stdout: "event": "all_read", 2023-08-01T19:54:33.262 INFO:teuthology.orchestra.run.smithi101.stdout: "time": "2023-08-01T19:54:33.232695+0000", 2023-08-01T19:54:33.262 INFO:teuthology.orchestra.run.smithi101.stdout: "duration": 5.6678999999999997e-05 2023-08-01T19:54:33.262 INFO:teuthology.orchestra.run.smithi101.stdout: }, 2023-08-01T19:54:33.262 INFO:teuthology.orchestra.run.smithi101.stdout: { 2023-08-01T19:54:33.262 INFO:teuthology.orchestra.run.smithi101.stdout: "event": "dispatched", 2023-08-01T19:54:33.262 INFO:teuthology.orchestra.run.smithi101.stdout: "time": "2023-08-01T19:54:33.232704+0000", 2023-08-01T19:54:33.262 INFO:teuthology.orchestra.run.smithi101.stdout: "duration": 9.3910000000000004e-06 2023-08-01T19:54:33.263 INFO:teuthology.orchestra.run.smithi101.stdout: }, 2023-08-01T19:54:33.263 INFO:teuthology.orchestra.run.smithi101.stdout: { 2023-08-01T19:54:33.263 INFO:teuthology.orchestra.run.smithi101.stdout: "event": "queued_for_pg", 2023-08-01T19:54:33.263 INFO:teuthology.orchestra.run.smithi101.stdout: "time": "2023-08-01T19:54:33.232710+0000", 2023-08-01T19:54:33.263 INFO:teuthology.orchestra.run.smithi101.stdout: "duration": 6.0170000000000002e-06 2023-08-01T19:54:33.263 INFO:teuthology.orchestra.run.smithi101.stdout: }, 2023-08-01T19:54:33.263 INFO:teuthology.orchestra.run.smithi101.stdout: { 2023-08-01T19:54:33.263 INFO:teuthology.orchestra.run.smithi101.stdout: "event": "reached_pg", 2023-08-01T19:54:33.264 INFO:teuthology.orchestra.run.smithi101.stdout: "time": "2023-08-01T19:54:33.233659+0000", 2023-08-01T19:54:33.264 INFO:teuthology.orchestra.run.smithi101.stdout: "duration": 0.00094826199999999995 2023-08-01T19:54:33.264 INFO:teuthology.orchestra.run.smithi101.stdout: }, 2023-08-01T19:54:33.264 INFO:teuthology.orchestra.run.smithi101.stdout: { 2023-08-01T19:54:33.264 INFO:teuthology.orchestra.run.smithi101.stdout: "event": "started", 2023-08-01T19:54:33.264 INFO:teuthology.orchestra.run.smithi101.stdout: "time": "2023-08-01T19:54:33.233748+0000", 2023-08-01T19:54:33.264 INFO:teuthology.orchestra.run.smithi101.stdout: "duration": 8.9674999999999998e-05 2023-08-01T19:54:33.264 INFO:teuthology.orchestra.run.smithi101.stdout: }, 2023-08-01T19:54:33.265 INFO:teuthology.orchestra.run.smithi101.stdout: { 2023-08-01T19:54:33.265 INFO:teuthology.orchestra.run.smithi101.stdout: "event": "waiting for subops from 2", 2023-08-01T19:54:33.265 INFO:teuthology.orchestra.run.smithi101.stdout: "time": "2023-08-01T19:54:33.233873+0000", 2023-08-01T19:54:33.265 INFO:teuthology.orchestra.run.smithi101.stdout: "duration": 0.000124888 2023-08-01T19:54:33.265 INFO:teuthology.orchestra.run.smithi101.stdout: } 2023-08-01T19:54:33.265 INFO:teuthology.orchestra.run.smithi101.stdout: ] 2023-08-01T19:54:33.265 INFO:teuthology.orchestra.run.smithi101.stdout: } 2023-08-01T19:54:33.265 INFO:teuthology.orchestra.run.smithi101.stdout: }, 2023-08-01T19:54:33.266 INFO:teuthology.orchestra.run.smithi101.stdout: { 2023-08-01T19:54:33.266 INFO:teuthology.orchestra.run.smithi101.stdout: "description": "osd_repop(client.4668.0:31690 5.3 e24/19 5:ca8c6108:::benchmark_data_smithi006_114134_object31689:head v 24'2016, mlcod=24'2013)", 2023-08-01T19:54:33.266 INFO:teuthology.orchestra.run.smithi101.stdout: "initiated_at": "2023-08-01T19:54:33.232765+0000", 2023-08-01T19:54:33.266 INFO:teuthology.orchestra.run.smithi101.stdout: "age": 0.001231645, 2023-08-01T19:54:33.266 INFO:teuthology.orchestra.run.smithi101.stdout: "duration": 0.0014315129999999999, 2023-08-01T19:54:33.266 INFO:teuthology.orchestra.run.smithi101.stdout: "type_data": { 2023-08-01T19:54:33.266 INFO:teuthology.orchestra.run.smithi101.stdout: "flag_point": "started", 2023-08-01T19:54:33.266 INFO:teuthology.orchestra.run.smithi101.stdout: "events": [ 2023-08-01T19:54:33.267 INFO:teuthology.orchestra.run.smithi101.stdout: { 2023-08-01T19:54:33.267 INFO:teuthology.orchestra.run.smithi101.stdout: "event": "initiated", 2023-08-01T19:54:33.267 INFO:teuthology.orchestra.run.smithi101.stdout: "time": "2023-08-01T19:54:33.232765+0000", 2023-08-01T19:54:33.267 INFO:teuthology.orchestra.run.smithi101.stdout: "duration": 0 2023-08-01T19:54:33.267 INFO:teuthology.orchestra.run.smithi101.stdout: }, 2023-08-01T19:54:33.267 INFO:teuthology.orchestra.run.smithi101.stdout: { 2023-08-01T19:54:33.267 INFO:teuthology.orchestra.run.smithi101.stdout: "event": "throttled", 2023-08-01T19:54:33.267 INFO:teuthology.orchestra.run.smithi101.stdout: "time": "2023-08-01T19:54:33.232765+0000", 2023-08-01T19:54:33.268 INFO:teuthology.orchestra.run.smithi101.stdout: "duration": 0 2023-08-01T19:54:33.268 INFO:teuthology.orchestra.run.smithi101.stdout: }, 2023-08-01T19:54:33.268 INFO:teuthology.orchestra.run.smithi101.stdout: { 2023-08-01T19:54:33.268 INFO:teuthology.orchestra.run.smithi101.stdout: "event": "header_read", 2023-08-01T19:54:33.268 INFO:teuthology.orchestra.run.smithi101.stdout: "time": "2023-08-01T19:54:33.232764+0000", 2023-08-01T19:54:33.268 INFO:teuthology.orchestra.run.smithi101.stdout: "duration": 4294967295.9999995 2023-08-01T19:54:33.268 INFO:teuthology.orchestra.run.smithi101.stdout: }, 2023-08-01T19:54:33.269 INFO:teuthology.orchestra.run.smithi101.stdout: { 2023-08-01T19:54:33.269 INFO:teuthology.orchestra.run.smithi101.stdout: "event": "all_read", 2023-08-01T19:54:33.269 INFO:teuthology.orchestra.run.smithi101.stdout: "time": "2023-08-01T19:54:33.232833+0000", 2023-08-01T19:54:33.269 INFO:teuthology.orchestra.run.smithi101.stdout: "duration": 6.9023000000000006e-05 2023-08-01T19:54:33.269 INFO:teuthology.orchestra.run.smithi101.stdout: }, 2023-08-01T19:54:33.269 INFO:teuthology.orchestra.run.smithi101.stdout: { 2023-08-01T19:54:33.269 INFO:teuthology.orchestra.run.smithi101.stdout: "event": "dispatched", 2023-08-01T19:54:33.269 INFO:teuthology.orchestra.run.smithi101.stdout: "time": "2023-08-01T19:54:33.232842+0000", 2023-08-01T19:54:33.270 INFO:teuthology.orchestra.run.smithi101.stdout: "duration": 9.1940000000000004e-06 2023-08-01T19:54:33.270 INFO:teuthology.orchestra.run.smithi101.stdout: }, 2023-08-01T19:54:33.270 INFO:teuthology.orchestra.run.smithi101.stdout: { 2023-08-01T19:54:33.270 INFO:teuthology.orchestra.run.smithi101.stdout: "event": "queued_for_pg", 2023-08-01T19:54:33.270 INFO:teuthology.orchestra.run.smithi101.stdout: "time": "2023-08-01T19:54:33.232848+0000", 2023-08-01T19:54:33.270 INFO:teuthology.orchestra.run.smithi101.stdout: "duration": 5.2660000000000001e-06 2023-08-01T19:54:33.270 INFO:teuthology.orchestra.run.smithi101.stdout: }, 2023-08-01T19:54:33.270 INFO:teuthology.orchestra.run.smithi101.stdout: { 2023-08-01T19:54:33.271 INFO:teuthology.orchestra.run.smithi101.stdout: "event": "reached_pg", 2023-08-01T19:54:33.271 INFO:teuthology.orchestra.run.smithi101.stdout: "time": "2023-08-01T19:54:33.232874+0000", 2023-08-01T19:54:33.271 INFO:teuthology.orchestra.run.smithi101.stdout: "duration": 2.6769999999999999e-05 2023-08-01T19:54:33.271 INFO:teuthology.orchestra.run.smithi101.stdout: }, 2023-08-01T19:54:33.271 INFO:teuthology.orchestra.run.smithi101.stdout: { 2023-08-01T19:54:33.271 INFO:teuthology.orchestra.run.smithi101.stdout: "event": "started", 2023-08-01T19:54:33.271 INFO:teuthology.orchestra.run.smithi101.stdout: "time": "2023-08-01T19:54:33.232890+0000", 2023-08-01T19:54:33.271 INFO:teuthology.orchestra.run.smithi101.stdout: "duration": 1.554e-05 2023-08-01T19:54:33.272 INFO:teuthology.orchestra.run.smithi101.stdout: } 2023-08-01T19:54:33.272 INFO:teuthology.orchestra.run.smithi101.stdout: ] 2023-08-01T19:54:33.272 INFO:teuthology.orchestra.run.smithi101.stdout: } 2023-08-01T19:54:33.272 INFO:teuthology.orchestra.run.smithi101.stdout: }, 2023-08-01T19:54:33.272 INFO:teuthology.orchestra.run.smithi101.stdout: { 2023-08-01T19:54:33.272 INFO:teuthology.orchestra.run.smithi101.stdout: "description": "osd_op(client.4668.0:31694 5.9 5:9c303a92:::benchmark_data_smithi006_114134_object31693:head [set-alloc-hint object_size 65536 write_size 65536,write 0~65536 in=65536b] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e24)", 2023-08-01T19:54:33.272 INFO:teuthology.orchestra.run.smithi101.stdout: "initiated_at": "2023-08-01T19:54:33.233175+0000", 2023-08-01T19:54:33.272 INFO:teuthology.orchestra.run.smithi101.stdout: "age": 0.00082158800000000005, 2023-08-01T19:54:33.273 INFO:teuthology.orchestra.run.smithi101.stdout: "duration": 0.001056942, 2023-08-01T19:54:33.273 INFO:teuthology.orchestra.run.smithi101.stdout: "type_data": { 2023-08-01T19:54:33.273 INFO:teuthology.orchestra.run.smithi101.stdout: "flag_point": "waiting for sub ops", 2023-08-01T19:54:33.273 INFO:teuthology.orchestra.run.smithi101.stdout: "client_info": { 2023-08-01T19:54:33.273 INFO:teuthology.orchestra.run.smithi101.stdout: "client": "client.4668", 2023-08-01T19:54:33.273 INFO:teuthology.orchestra.run.smithi101.stdout: "client_addr": "172.21.15.6:0/1709472247", 2023-08-01T19:54:33.273 INFO:teuthology.orchestra.run.smithi101.stdout: "tid": 31694 2023-08-01T19:54:33.273 INFO:teuthology.orchestra.run.smithi101.stdout: }, 2023-08-01T19:54:33.274 INFO:teuthology.orchestra.run.smithi101.stdout: "events": [ 2023-08-01T19:54:33.274 INFO:teuthology.orchestra.run.smithi101.stdout: { 2023-08-01T19:54:33.274 INFO:teuthology.orchestra.run.smithi101.stdout: "event": "initiated", 2023-08-01T19:54:33.274 INFO:teuthology.orchestra.run.smithi101.stdout: "time": "2023-08-01T19:54:33.233175+0000", 2023-08-01T19:54:33.274 INFO:teuthology.orchestra.run.smithi101.stdout: "duration": 0 2023-08-01T19:54:33.274 INFO:teuthology.orchestra.run.smithi101.stdout: }, 2023-08-01T19:54:33.274 INFO:teuthology.orchestra.run.smithi101.stdout: { 2023-08-01T19:54:33.275 INFO:teuthology.orchestra.run.smithi101.stdout: "event": "throttled", 2023-08-01T19:54:33.275 INFO:teuthology.orchestra.run.smithi101.stdout: "time": "2023-08-01T19:54:33.233175+0000", 2023-08-01T19:54:33.275 INFO:teuthology.orchestra.run.smithi101.stdout: "duration": 0 2023-08-01T19:54:33.275 INFO:teuthology.orchestra.run.smithi101.stdout: }, 2023-08-01T19:54:33.275 INFO:teuthology.orchestra.run.smithi101.stdout: { 2023-08-01T19:54:33.275 INFO:teuthology.orchestra.run.smithi101.stdout: "event": "header_read", 2023-08-01T19:54:33.275 INFO:teuthology.orchestra.run.smithi101.stdout: "time": "2023-08-01T19:54:33.233174+0000", 2023-08-01T19:54:33.275 INFO:teuthology.orchestra.run.smithi101.stdout: "duration": 4294967295.999999 2023-08-01T19:54:33.276 INFO:teuthology.orchestra.run.smithi101.stdout: }, 2023-08-01T19:54:33.276 INFO:teuthology.orchestra.run.smithi101.stdout: { 2023-08-01T19:54:33.276 INFO:teuthology.orchestra.run.smithi101.stdout: "event": "all_read", 2023-08-01T19:54:33.276 INFO:teuthology.orchestra.run.smithi101.stdout: "time": "2023-08-01T19:54:33.233294+0000", 2023-08-01T19:54:33.276 INFO:teuthology.orchestra.run.smithi101.stdout: "duration": 0.000120234 2023-08-01T19:54:33.276 INFO:teuthology.orchestra.run.smithi101.stdout: }, 2023-08-01T19:54:33.276 INFO:teuthology.orchestra.run.smithi101.stdout: { 2023-08-01T19:54:33.276 INFO:teuthology.orchestra.run.smithi101.stdout: "event": "dispatched", 2023-08-01T19:54:33.277 INFO:teuthology.orchestra.run.smithi101.stdout: "time": "2023-08-01T19:54:33.233305+0000", 2023-08-01T19:54:33.277 INFO:teuthology.orchestra.run.smithi101.stdout: "duration": 1.0959e-05 2023-08-01T19:54:33.277 INFO:teuthology.orchestra.run.smithi101.stdout: }, 2023-08-01T19:54:33.277 INFO:teuthology.orchestra.run.smithi101.stdout: { 2023-08-01T19:54:33.277 INFO:teuthology.orchestra.run.smithi101.stdout: "event": "queued_for_pg", 2023-08-01T19:54:33.277 INFO:teuthology.orchestra.run.smithi101.stdout: "time": "2023-08-01T19:54:33.233311+0000", 2023-08-01T19:54:33.277 INFO:teuthology.orchestra.run.smithi101.stdout: "duration": 5.4210000000000003e-06 2023-08-01T19:54:33.277 INFO:teuthology.orchestra.run.smithi101.stdout: }, 2023-08-01T19:54:33.278 INFO:teuthology.orchestra.run.smithi101.stdout: { 2023-08-01T19:54:33.278 INFO:teuthology.orchestra.run.smithi101.stdout: "event": "reached_pg", 2023-08-01T19:54:33.278 INFO:teuthology.orchestra.run.smithi101.stdout: "time": "2023-08-01T19:54:33.233635+0000", 2023-08-01T19:54:33.278 INFO:teuthology.orchestra.run.smithi101.stdout: "duration": 0.00032468999999999998 2023-08-01T19:54:33.278 INFO:teuthology.orchestra.run.smithi101.stdout: }, 2023-08-01T19:54:33.278 INFO:teuthology.orchestra.run.smithi101.stdout: { 2023-08-01T19:54:33.278 INFO:teuthology.orchestra.run.smithi101.stdout: "event": "started", 2023-08-01T19:54:33.278 INFO:teuthology.orchestra.run.smithi101.stdout: "time": "2023-08-01T19:54:33.233733+0000", 2023-08-01T19:54:33.279 INFO:teuthology.orchestra.run.smithi101.stdout: "duration": 9.7274000000000004e-05 2023-08-01T19:54:33.279 INFO:teuthology.orchestra.run.smithi101.stdout: }, 2023-08-01T19:54:33.279 INFO:teuthology.orchestra.run.smithi101.stdout: { 2023-08-01T19:54:33.279 INFO:teuthology.orchestra.run.smithi101.stdout: "event": "waiting for subops from 2", 2023-08-01T19:54:33.279 INFO:teuthology.orchestra.run.smithi101.stdout: "time": "2023-08-01T19:54:33.233810+0000", 2023-08-01T19:54:33.279 INFO:teuthology.orchestra.run.smithi101.stdout: "duration": 7.7868999999999996e-05 2023-08-01T19:54:33.279 INFO:teuthology.orchestra.run.smithi101.stdout: } 2023-08-01T19:54:33.279 INFO:teuthology.orchestra.run.smithi101.stdout: ] 2023-08-01T19:54:33.280 INFO:teuthology.orchestra.run.smithi101.stdout: } 2023-08-01T19:54:33.280 INFO:teuthology.orchestra.run.smithi101.stdout: }, 2023-08-01T19:54:33.280 INFO:teuthology.orchestra.run.smithi101.stdout: { 2023-08-01T19:54:33.280 INFO:teuthology.orchestra.run.smithi101.stdout: "description": "osd_repop(client.4668.0:31693 5.c e24/19 5:30f02129:::benchmark_data_smithi006_114134_object31692:head v 24'2019, mlcod=24'2015)", 2023-08-01T19:54:33.280 INFO:teuthology.orchestra.run.smithi101.stdout: "initiated_at": "2023-08-01T19:54:33.233638+0000", 2023-08-01T19:54:33.280 INFO:teuthology.orchestra.run.smithi101.stdout: "age": 0.000358353, 2023-08-01T19:54:33.280 INFO:teuthology.orchestra.run.smithi101.stdout: "duration": 0.00063375900000000002, 2023-08-01T19:54:33.280 INFO:teuthology.orchestra.run.smithi101.stdout: "type_data": { 2023-08-01T19:54:33.281 INFO:teuthology.orchestra.run.smithi101.stdout: "flag_point": "started", 2023-08-01T19:54:33.281 INFO:teuthology.orchestra.run.smithi101.stdout: "events": [ 2023-08-01T19:54:33.281 INFO:teuthology.orchestra.run.smithi101.stdout: { 2023-08-01T19:54:33.281 INFO:teuthology.orchestra.run.smithi101.stdout: "event": "initiated", 2023-08-01T19:54:33.281 INFO:teuthology.orchestra.run.smithi101.stdout: "time": "2023-08-01T19:54:33.233638+0000", 2023-08-01T19:54:33.281 INFO:teuthology.orchestra.run.smithi101.stdout: "duration": 0 2023-08-01T19:54:33.281 INFO:teuthology.orchestra.run.smithi101.stdout: }, 2023-08-01T19:54:33.281 INFO:teuthology.orchestra.run.smithi101.stdout: { 2023-08-01T19:54:33.282 INFO:teuthology.orchestra.run.smithi101.stdout: "event": "throttled", 2023-08-01T19:54:33.282 INFO:teuthology.orchestra.run.smithi101.stdout: "time": "2023-08-01T19:54:33.233638+0000", 2023-08-01T19:54:33.282 INFO:teuthology.orchestra.run.smithi101.stdout: "duration": 0 2023-08-01T19:54:33.282 INFO:teuthology.orchestra.run.smithi101.stdout: }, 2023-08-01T19:54:33.282 INFO:teuthology.orchestra.run.smithi101.stdout: { 2023-08-01T19:54:33.282 INFO:teuthology.orchestra.run.smithi101.stdout: "event": "header_read", 2023-08-01T19:54:33.282 INFO:teuthology.orchestra.run.smithi101.stdout: "time": "2023-08-01T19:54:33.233637+0000", 2023-08-01T19:54:33.283 INFO:teuthology.orchestra.run.smithi101.stdout: "duration": 4294967295.9999995 2023-08-01T19:54:33.283 INFO:teuthology.orchestra.run.smithi101.stdout: }, 2023-08-01T19:54:33.283 INFO:teuthology.orchestra.run.smithi101.stdout: { 2023-08-01T19:54:33.283 INFO:teuthology.orchestra.run.smithi101.stdout: "event": "all_read", 2023-08-01T19:54:33.283 INFO:teuthology.orchestra.run.smithi101.stdout: "time": "2023-08-01T19:54:33.233689+0000", 2023-08-01T19:54:33.283 INFO:teuthology.orchestra.run.smithi101.stdout: "duration": 5.1480999999999997e-05 2023-08-01T19:54:33.283 INFO:teuthology.orchestra.run.smithi101.stdout: }, 2023-08-01T19:54:33.283 INFO:teuthology.orchestra.run.smithi101.stdout: { 2023-08-01T19:54:33.284 INFO:teuthology.orchestra.run.smithi101.stdout: "event": "dispatched", 2023-08-01T19:54:33.284 INFO:teuthology.orchestra.run.smithi101.stdout: "time": "2023-08-01T19:54:33.233697+0000", 2023-08-01T19:54:33.284 INFO:teuthology.orchestra.run.smithi101.stdout: "duration": 8.0269999999999995e-06 2023-08-01T19:54:33.284 INFO:teuthology.orchestra.run.smithi101.stdout: }, 2023-08-01T19:54:33.284 INFO:teuthology.orchestra.run.smithi101.stdout: { 2023-08-01T19:54:33.284 INFO:teuthology.orchestra.run.smithi101.stdout: "event": "queued_for_pg", 2023-08-01T19:54:33.284 INFO:teuthology.orchestra.run.smithi101.stdout: "time": "2023-08-01T19:54:33.233702+0000", 2023-08-01T19:54:33.284 INFO:teuthology.orchestra.run.smithi101.stdout: "duration": 5.0579999999999997e-06 2023-08-01T19:54:33.285 INFO:teuthology.orchestra.run.smithi101.stdout: }, 2023-08-01T19:54:33.285 INFO:teuthology.orchestra.run.smithi101.stdout: { 2023-08-01T19:54:33.285 INFO:teuthology.orchestra.run.smithi101.stdout: "event": "reached_pg", 2023-08-01T19:54:33.285 INFO:teuthology.orchestra.run.smithi101.stdout: "time": "2023-08-01T19:54:33.233732+0000", 2023-08-01T19:54:33.285 INFO:teuthology.orchestra.run.smithi101.stdout: "duration": 2.9961999999999999e-05 2023-08-01T19:54:33.285 INFO:teuthology.orchestra.run.smithi101.stdout: }, 2023-08-01T19:54:33.285 INFO:teuthology.orchestra.run.smithi101.stdout: { 2023-08-01T19:54:33.285 INFO:teuthology.orchestra.run.smithi101.stdout: "event": "started", 2023-08-01T19:54:33.286 INFO:teuthology.orchestra.run.smithi101.stdout: "time": "2023-08-01T19:54:33.233749+0000", 2023-08-01T19:54:33.286 INFO:teuthology.orchestra.run.smithi101.stdout: "duration": 1.7227999999999998e-05 2023-08-01T19:54:33.286 INFO:teuthology.orchestra.run.smithi101.stdout: } 2023-08-01T19:54:33.286 INFO:teuthology.orchestra.run.smithi101.stdout: ] 2023-08-01T19:54:33.286 INFO:teuthology.orchestra.run.smithi101.stdout: } 2023-08-01T19:54:33.286 INFO:teuthology.orchestra.run.smithi101.stdout: }, 2023-08-01T19:54:33.286 INFO:teuthology.orchestra.run.smithi101.stdout: { 2023-08-01T19:54:33.286 INFO:teuthology.orchestra.run.smithi101.stdout: "description": "osd_op(client.4668.0:31696 5.2 5.7a19b9f2 (undecoded) ondisk+write+known_if_redirected+supports_pool_eio e24)", 2023-08-01T19:54:33.287 INFO:teuthology.orchestra.run.smithi101.stdout: "initiated_at": "2023-08-01T19:54:33.234187+0000", 2023-08-01T19:54:33.287 INFO:teuthology.orchestra.run.smithi101.stdout: "age": 4294967295.9998093, 2023-08-01T19:54:33.287 INFO:teuthology.orchestra.run.smithi101.stdout: "duration": 0.000122874, 2023-08-01T19:54:33.287 INFO:teuthology.orchestra.run.smithi101.stdout: "type_data": { 2023-08-01T19:54:33.287 INFO:teuthology.orchestra.run.smithi101.stdout: "flag_point": "queued for pg", 2023-08-01T19:54:33.287 INFO:teuthology.orchestra.run.smithi101.stdout: "client_info": { 2023-08-01T19:54:33.287 INFO:teuthology.orchestra.run.smithi101.stdout: "client": "client.4668", 2023-08-01T19:54:33.288 INFO:teuthology.orchestra.run.smithi101.stdout: "client_addr": "172.21.15.6:0/1709472247", 2023-08-01T19:54:33.288 INFO:teuthology.orchestra.run.smithi101.stdout: "tid": 31696 2023-08-01T19:54:33.288 INFO:teuthology.orchestra.run.smithi101.stdout: }, 2023-08-01T19:54:33.288 INFO:teuthology.orchestra.run.smithi101.stdout: "events": [ 2023-08-01T19:54:33.288 INFO:teuthology.orchestra.run.smithi101.stdout: { 2023-08-01T19:54:33.288 INFO:teuthology.orchestra.run.smithi101.stdout: "event": "initiated", 2023-08-01T19:54:33.288 INFO:teuthology.orchestra.run.smithi101.stdout: "time": "2023-08-01T19:54:33.234187+0000", 2023-08-01T19:54:33.288 INFO:teuthology.orchestra.run.smithi101.stdout: "duration": 0 2023-08-01T19:54:33.289 INFO:teuthology.orchestra.run.smithi101.stdout: }, 2023-08-01T19:54:33.289 INFO:teuthology.orchestra.run.smithi101.stdout: { 2023-08-01T19:54:33.289 INFO:teuthology.orchestra.run.smithi101.stdout: "event": "throttled", 2023-08-01T19:54:33.289 INFO:teuthology.orchestra.run.smithi101.stdout: "time": "2023-08-01T19:54:33.234187+0000", 2023-08-01T19:54:33.289 INFO:teuthology.orchestra.run.smithi101.stdout: "duration": 0 2023-08-01T19:54:33.289 INFO:teuthology.orchestra.run.smithi101.stdout: }, 2023-08-01T19:54:33.289 INFO:teuthology.orchestra.run.smithi101.stdout: { 2023-08-01T19:54:33.289 INFO:teuthology.orchestra.run.smithi101.stdout: "event": "header_read", 2023-08-01T19:54:33.290 INFO:teuthology.orchestra.run.smithi101.stdout: "time": "2023-08-01T19:54:33.234186+0000", 2023-08-01T19:54:33.290 INFO:teuthology.orchestra.run.smithi101.stdout: "duration": 4294967295.999999 2023-08-01T19:54:33.290 INFO:teuthology.orchestra.run.smithi101.stdout: }, 2023-08-01T19:54:33.290 INFO:teuthology.orchestra.run.smithi101.stdout: { 2023-08-01T19:54:33.290 INFO:teuthology.orchestra.run.smithi101.stdout: "event": "all_read", 2023-08-01T19:54:33.290 INFO:teuthology.orchestra.run.smithi101.stdout: "time": "2023-08-01T19:54:33.234280+0000", 2023-08-01T19:54:33.290 INFO:teuthology.orchestra.run.smithi101.stdout: "duration": 9.4061999999999995e-05 2023-08-01T19:54:33.290 INFO:teuthology.orchestra.run.smithi101.stdout: }, 2023-08-01T19:54:33.291 INFO:teuthology.orchestra.run.smithi101.stdout: { 2023-08-01T19:54:33.291 INFO:teuthology.orchestra.run.smithi101.stdout: "event": "dispatched", 2023-08-01T19:54:33.291 INFO:teuthology.orchestra.run.smithi101.stdout: "time": "2023-08-01T19:54:33.234293+0000", 2023-08-01T19:54:33.291 INFO:teuthology.orchestra.run.smithi101.stdout: "duration": 1.2468e-05 2023-08-01T19:54:33.291 INFO:teuthology.orchestra.run.smithi101.stdout: }, 2023-08-01T19:54:33.291 INFO:teuthology.orchestra.run.smithi101.stdout: { 2023-08-01T19:54:33.291 INFO:teuthology.orchestra.run.smithi101.stdout: "event": "queued_for_pg", 2023-08-01T19:54:33.291 INFO:teuthology.orchestra.run.smithi101.stdout: "time": "2023-08-01T19:54:33.234299+0000", 2023-08-01T19:54:33.292 INFO:teuthology.orchestra.run.smithi101.stdout: "duration": 5.9320000000000001e-06 2023-08-01T19:54:33.292 INFO:teuthology.orchestra.run.smithi101.stdout: } 2023-08-01T19:54:33.292 INFO:teuthology.orchestra.run.smithi101.stdout: ] 2023-08-01T19:54:33.292 INFO:teuthology.orchestra.run.smithi101.stdout: } 2023-08-01T19:54:33.292 INFO:teuthology.orchestra.run.smithi101.stdout: }, 2023-08-01T19:54:33.292 INFO:teuthology.orchestra.run.smithi101.stdout: { 2023-08-01T19:54:33.292 INFO:teuthology.orchestra.run.smithi101.stdout: "description": "osd_repop(client.4668.0:31683 5.d e24/19 5:be764a02:::benchmark_data_smithi006_114134_object31682:head v 24'1883, mlcod=24'1881)", 2023-08-01T19:54:33.292 INFO:teuthology.orchestra.run.smithi101.stdout: "initiated_at": "2023-08-01T19:54:33.230107+0000", 2023-08-01T19:54:33.293 INFO:teuthology.orchestra.run.smithi101.stdout: "age": 0.0038892699999999998, 2023-08-01T19:54:33.293 INFO:teuthology.orchestra.run.smithi101.stdout: "duration": 0.0042526780000000002, 2023-08-01T19:54:33.293 INFO:teuthology.orchestra.run.smithi101.stdout: "type_data": { 2023-08-01T19:54:33.293 INFO:teuthology.orchestra.run.smithi101.stdout: "flag_point": "started", 2023-08-01T19:54:33.293 INFO:teuthology.orchestra.run.smithi101.stdout: "events": [ 2023-08-01T19:54:33.293 INFO:teuthology.orchestra.run.smithi101.stdout: { 2023-08-01T19:54:33.293 INFO:teuthology.orchestra.run.smithi101.stdout: "event": "initiated", 2023-08-01T19:54:33.293 INFO:teuthology.orchestra.run.smithi101.stdout: "time": "2023-08-01T19:54:33.230107+0000", 2023-08-01T19:54:33.294 INFO:teuthology.orchestra.run.smithi101.stdout: "duration": 0 2023-08-01T19:54:33.294 INFO:teuthology.orchestra.run.smithi101.stdout: }, 2023-08-01T19:54:33.294 INFO:teuthology.orchestra.run.smithi101.stdout: { 2023-08-01T19:54:33.294 INFO:teuthology.orchestra.run.smithi101.stdout: "event": "throttled", 2023-08-01T19:54:33.294 INFO:teuthology.orchestra.run.smithi101.stdout: "time": "2023-08-01T19:54:33.230107+0000", 2023-08-01T19:54:33.294 INFO:teuthology.orchestra.run.smithi101.stdout: "duration": 0 2023-08-01T19:54:33.294 INFO:teuthology.orchestra.run.smithi101.stdout: }, 2023-08-01T19:54:33.295 INFO:teuthology.orchestra.run.smithi101.stdout: { 2023-08-01T19:54:33.295 INFO:teuthology.orchestra.run.smithi101.stdout: "event": "header_read", 2023-08-01T19:54:33.295 INFO:teuthology.orchestra.run.smithi101.stdout: "time": "2023-08-01T19:54:33.230107+0000", 2023-08-01T19:54:33.295 INFO:teuthology.orchestra.run.smithi101.stdout: "duration": 4294967295.9999995 2023-08-01T19:54:33.295 INFO:teuthology.orchestra.run.smithi101.stdout: }, 2023-08-01T19:54:33.295 INFO:teuthology.orchestra.run.smithi101.stdout: { 2023-08-01T19:54:33.295 INFO:teuthology.orchestra.run.smithi101.stdout: "event": "all_read", 2023-08-01T19:54:33.295 INFO:teuthology.orchestra.run.smithi101.stdout: "time": "2023-08-01T19:54:33.231002+0000", 2023-08-01T19:54:33.296 INFO:teuthology.orchestra.run.smithi101.stdout: "duration": 0.00089566799999999996 2023-08-01T19:54:33.296 INFO:teuthology.orchestra.run.smithi101.stdout: }, 2023-08-01T19:54:33.296 INFO:teuthology.orchestra.run.smithi101.stdout: { 2023-08-01T19:54:33.296 INFO:teuthology.orchestra.run.smithi101.stdout: "event": "dispatched", 2023-08-01T19:54:33.296 INFO:teuthology.orchestra.run.smithi101.stdout: "time": "2023-08-01T19:54:33.231009+0000", 2023-08-01T19:54:33.296 INFO:teuthology.orchestra.run.smithi101.stdout: "duration": 6.2759999999999997e-06 2023-08-01T19:54:33.296 INFO:teuthology.orchestra.run.smithi101.stdout: }, 2023-08-01T19:54:33.296 INFO:teuthology.orchestra.run.smithi101.stdout: { 2023-08-01T19:54:33.297 INFO:teuthology.orchestra.run.smithi101.stdout: "event": "queued_for_pg", 2023-08-01T19:54:33.297 INFO:teuthology.orchestra.run.smithi101.stdout: "time": "2023-08-01T19:54:33.231012+0000", 2023-08-01T19:54:33.297 INFO:teuthology.orchestra.run.smithi101.stdout: "duration": 3.5449999999999999e-06 2023-08-01T19:54:33.297 INFO:teuthology.orchestra.run.smithi101.stdout: }, 2023-08-01T19:54:33.297 INFO:teuthology.orchestra.run.smithi101.stdout: { 2023-08-01T19:54:33.297 INFO:teuthology.orchestra.run.smithi101.stdout: "event": "reached_pg", 2023-08-01T19:54:33.297 INFO:teuthology.orchestra.run.smithi101.stdout: "time": "2023-08-01T19:54:33.231049+0000", 2023-08-01T19:54:33.297 INFO:teuthology.orchestra.run.smithi101.stdout: "duration": 3.7129999999999999e-05 2023-08-01T19:54:33.298 INFO:teuthology.orchestra.run.smithi101.stdout: }, 2023-08-01T19:54:33.298 INFO:teuthology.orchestra.run.smithi101.stdout: { 2023-08-01T19:54:33.298 INFO:teuthology.orchestra.run.smithi101.stdout: "event": "started", 2023-08-01T19:54:33.298 INFO:teuthology.orchestra.run.smithi101.stdout: "time": "2023-08-01T19:54:33.231067+0000", 2023-08-01T19:54:33.298 INFO:teuthology.orchestra.run.smithi101.stdout: "duration": 1.7722000000000001e-05 2023-08-01T19:54:33.298 INFO:teuthology.orchestra.run.smithi101.stdout: } 2023-08-01T19:54:33.298 INFO:teuthology.orchestra.run.smithi101.stdout: ] 2023-08-01T19:54:33.298 INFO:teuthology.orchestra.run.smithi101.stdout: } 2023-08-01T19:54:33.299 INFO:teuthology.orchestra.run.smithi101.stdout: }, 2023-08-01T19:54:33.299 INFO:teuthology.orchestra.run.smithi101.stdout: { 2023-08-01T19:54:33.299 INFO:teuthology.orchestra.run.smithi101.stdout: "description": "osd_op(client.4668.0:31687 5.9 5:968fab1a:::benchmark_data_smithi006_114134_object31686:head [set-alloc-hint object_size 65536 write_size 65536,write 0~65536 in=65536b] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e24)", 2023-08-01T19:54:33.299 INFO:teuthology.orchestra.run.smithi101.stdout: "initiated_at": "2023-08-01T19:54:33.231029+0000", 2023-08-01T19:54:33.299 INFO:teuthology.orchestra.run.smithi101.stdout: "age": 0.0029670109999999999, 2023-08-01T19:54:33.299 INFO:teuthology.orchestra.run.smithi101.stdout: "duration": 0.003367915, 2023-08-01T19:54:33.299 INFO:teuthology.orchestra.run.smithi101.stdout: "type_data": { 2023-08-01T19:54:33.299 INFO:teuthology.orchestra.run.smithi101.stdout: "flag_point": "waiting for sub ops", 2023-08-01T19:54:33.300 INFO:teuthology.orchestra.run.smithi101.stdout: "client_info": { 2023-08-01T19:54:33.300 INFO:teuthology.orchestra.run.smithi101.stdout: "client": "client.4668", 2023-08-01T19:54:33.300 INFO:teuthology.orchestra.run.smithi101.stdout: "client_addr": "172.21.15.6:0/1709472247", 2023-08-01T19:54:33.300 INFO:teuthology.orchestra.run.smithi101.stdout: "tid": 31687 2023-08-01T19:54:33.300 INFO:teuthology.orchestra.run.smithi101.stdout: }, 2023-08-01T19:54:33.300 INFO:teuthology.orchestra.run.smithi101.stdout: "events": [ 2023-08-01T19:54:33.300 INFO:teuthology.orchestra.run.smithi101.stdout: { 2023-08-01T19:54:33.300 INFO:teuthology.orchestra.run.smithi101.stdout: "event": "initiated", 2023-08-01T19:54:33.301 INFO:teuthology.orchestra.run.smithi101.stdout: "time": "2023-08-01T19:54:33.231029+0000", 2023-08-01T19:54:33.301 INFO:teuthology.orchestra.run.smithi101.stdout: "duration": 0 2023-08-01T19:54:33.301 INFO:teuthology.orchestra.run.smithi101.stdout: }, 2023-08-01T19:54:33.301 INFO:teuthology.orchestra.run.smithi101.stdout: { 2023-08-01T19:54:33.301 INFO:teuthology.orchestra.run.smithi101.stdout: "event": "throttled", 2023-08-01T19:54:33.301 INFO:teuthology.orchestra.run.smithi101.stdout: "time": "2023-08-01T19:54:33.231029+0000", 2023-08-01T19:54:33.301 INFO:teuthology.orchestra.run.smithi101.stdout: "duration": 0 2023-08-01T19:54:33.301 INFO:teuthology.orchestra.run.smithi101.stdout: }, 2023-08-01T19:54:33.302 INFO:teuthology.orchestra.run.smithi101.stdout: { 2023-08-01T19:54:33.302 INFO:teuthology.orchestra.run.smithi101.stdout: "event": "header_read", 2023-08-01T19:54:33.302 INFO:teuthology.orchestra.run.smithi101.stdout: "time": "2023-08-01T19:54:33.231028+0000", 2023-08-01T19:54:33.302 INFO:teuthology.orchestra.run.smithi101.stdout: "duration": 4294967295.999999 2023-08-01T19:54:33.302 INFO:teuthology.orchestra.run.smithi101.stdout: }, 2023-08-01T19:54:33.302 INFO:teuthology.orchestra.run.smithi101.stdout: { 2023-08-01T19:54:33.302 INFO:teuthology.orchestra.run.smithi101.stdout: "event": "all_read", 2023-08-01T19:54:33.303 INFO:teuthology.orchestra.run.smithi101.stdout: "time": "2023-08-01T19:54:33.231054+0000", 2023-08-01T19:54:33.303 INFO:teuthology.orchestra.run.smithi101.stdout: "duration": 2.5327e-05 2023-08-01T19:54:33.303 INFO:teuthology.orchestra.run.smithi101.stdout: }, 2023-08-01T19:54:33.303 INFO:teuthology.orchestra.run.smithi101.stdout: { 2023-08-01T19:54:33.303 INFO:teuthology.orchestra.run.smithi101.stdout: "event": "dispatched", 2023-08-01T19:54:33.303 INFO:teuthology.orchestra.run.smithi101.stdout: "time": "2023-08-01T19:54:33.231059+0000", 2023-08-01T19:54:33.303 INFO:teuthology.orchestra.run.smithi101.stdout: "duration": 5.7610000000000004e-06 2023-08-01T19:54:33.303 INFO:teuthology.orchestra.run.smithi101.stdout: }, 2023-08-01T19:54:33.304 INFO:teuthology.orchestra.run.smithi101.stdout: { 2023-08-01T19:54:33.304 INFO:teuthology.orchestra.run.smithi101.stdout: "event": "queued_for_pg", 2023-08-01T19:54:33.304 INFO:teuthology.orchestra.run.smithi101.stdout: "time": "2023-08-01T19:54:33.231063+0000", 2023-08-01T19:54:33.304 INFO:teuthology.orchestra.run.smithi101.stdout: "duration": 3.3510000000000002e-06 2023-08-01T19:54:33.304 INFO:teuthology.orchestra.run.smithi101.stdout: }, 2023-08-01T19:54:33.304 INFO:teuthology.orchestra.run.smithi101.stdout: { 2023-08-01T19:54:33.304 INFO:teuthology.orchestra.run.smithi101.stdout: "event": "reached_pg", 2023-08-01T19:54:33.304 INFO:teuthology.orchestra.run.smithi101.stdout: "time": "2023-08-01T19:54:33.231094+0000", 2023-08-01T19:54:33.305 INFO:teuthology.orchestra.run.smithi101.stdout: "duration": 3.1470999999999997e-05 2023-08-01T19:54:33.305 INFO:teuthology.orchestra.run.smithi101.stdout: }, 2023-08-01T19:54:33.305 INFO:teuthology.orchestra.run.smithi101.stdout: { 2023-08-01T19:54:33.305 INFO:teuthology.orchestra.run.smithi101.stdout: "event": "started", 2023-08-01T19:54:33.305 INFO:teuthology.orchestra.run.smithi101.stdout: "time": "2023-08-01T19:54:33.231197+0000", 2023-08-01T19:54:33.305 INFO:teuthology.orchestra.run.smithi101.stdout: "duration": 0.000102897 2023-08-01T19:54:33.305 INFO:teuthology.orchestra.run.smithi101.stdout: }, 2023-08-01T19:54:33.305 INFO:teuthology.orchestra.run.smithi101.stdout: { 2023-08-01T19:54:33.306 INFO:teuthology.orchestra.run.smithi101.stdout: "event": "waiting for subops from 2", 2023-08-01T19:54:33.306 INFO:teuthology.orchestra.run.smithi101.stdout: "time": "2023-08-01T19:54:33.231298+0000", 2023-08-01T19:54:33.306 INFO:teuthology.orchestra.run.smithi101.stdout: "duration": 0.00010051 2023-08-01T19:54:33.306 INFO:teuthology.orchestra.run.smithi101.stdout: } 2023-08-01T19:54:33.306 INFO:teuthology.orchestra.run.smithi101.stdout: ] 2023-08-01T19:54:33.306 INFO:teuthology.orchestra.run.smithi101.stdout: } 2023-08-01T19:54:33.306 INFO:teuthology.orchestra.run.smithi101.stdout: } 2023-08-01T19:54:33.306 INFO:teuthology.orchestra.run.smithi101.stdout: ], 2023-08-01T19:54:33.307 INFO:teuthology.orchestra.run.smithi101.stdout: "num_ops": 10 2023-08-01T19:54:33.307 INFO:teuthology.orchestra.run.smithi101.stdout:} 2023-08-01T19:54:33.308 DEBUG:teuthology.orchestra.run.smithi101:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 30 ceph --cluster ceph --admin-daemon /var/run/ceph/ceph-osd.1.asok dump_blocked_ops 2023-08-01T19:54:33.308 INFO:tasks.ceph.osd.1.smithi101.stderr:2023-08-01T19:54:33.306+0000 7fb0cb7f6700 -1 received signal: Hangup from /usr/bin/python3 /bin/daemon-helper kill ceph-osd -f --cluster ceph -i 1 (PID: 111141) UID: 0 2023-08-01T19:54:33.313 INFO:tasks.radosbench.radosbench.0.smithi006.stdout: 9 16 31933 31917 221.63 184.5 0.00454676 0.00450926 2023-08-01T19:54:33.408 INFO:tasks.ceph.osd.2.smithi155.stderr:2023-08-01T19:54:33.408+0000 7faa5c6ac700 -1 received signal: Hangup from /usr/bin/python3 /bin/daemon-helper kill ceph-osd -f --cluster ceph -i 2 (PID: 111337) UID: 0 2023-08-01T19:54:33.423 INFO:teuthology.orchestra.run.smithi006.stderr:Error EINVAL: you must specify pairs of osd ids to be remapped 2023-08-01T19:54:33.427 DEBUG:teuthology.orchestra.run:got remote process result: 22 2023-08-01T19:54:33.427 INFO:tasks.thrashosds.thrasher:Failed to rm-pg-upmap-items, ignoring 2023-08-01T19:54:33.509 INFO:tasks.ceph.osd.1.smithi101.stderr:2023-08-01T19:54:33.508+0000 7fb0cb7f6700 -1 received signal: Hangup from /usr/bin/python3 /bin/daemon-helper kill ceph-osd -f --cluster ceph -i 1 (PID: 111141) UID: 0 2023-08-01T19:54:33.519 INFO:teuthology.orchestra.run.smithi101.stdout:{ 2023-08-01T19:54:33.519 INFO:teuthology.orchestra.run.smithi101.stdout: "ops": [], 2023-08-01T19:54:33.519 INFO:teuthology.orchestra.run.smithi101.stdout: "complaint_time": 30, 2023-08-01T19:54:33.519 INFO:teuthology.orchestra.run.smithi101.stdout: "num_blocked_ops": 0 2023-08-01T19:54:33.519 INFO:teuthology.orchestra.run.smithi101.stdout:} 2023-08-01T19:54:33.534 DEBUG:teuthology.orchestra.run.smithi101:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 30 ceph --cluster ceph --admin-daemon /var/run/ceph/ceph-osd.1.asok dump_historic_ops 2023-08-01T19:54:33.609 INFO:tasks.ceph.osd.2.smithi155.stderr:2023-08-01T19:54:33.609+0000 7faa5c6ac700 -1 received signal: Hangup from /usr/bin/python3 /bin/daemon-helper kill ceph-osd -f --cluster ceph -i 2 (PID: 111337) UID: 0 2023-08-01T19:54:33.710 INFO:tasks.ceph.osd.1.smithi101.stderr:2023-08-01T19:54:33.709+0000 7fb0cb7f6700 -1 received signal: Hangup from /usr/bin/python3 /bin/daemon-helper kill ceph-osd -f --cluster ceph -i 1 (PID: 111141) UID: 0 2023-08-01T19:54:33.754 INFO:teuthology.orchestra.run.smithi101.stdout:{ 2023-08-01T19:54:33.754 INFO:teuthology.orchestra.run.smithi101.stdout: "size": 20, 2023-08-01T19:54:33.754 INFO:teuthology.orchestra.run.smithi101.stdout: "duration": 600, 2023-08-01T19:54:33.754 INFO:teuthology.orchestra.run.smithi101.stdout: "ops": [ 2023-08-01T19:54:33.754 INFO:teuthology.orchestra.run.smithi101.stdout: { 2023-08-01T19:54:33.754 INFO:teuthology.orchestra.run.smithi101.stdout: "description": "osd_op(mds.0.3:6 3.10 3:0d82a743:::600.00000000:head [omap-set-header] snapc 0=[] ondisk+write+known_if_redirected+full_force+supports_pool_eio e17)", 2023-08-01T19:54:33.755 INFO:teuthology.orchestra.run.smithi101.stdout: "initiated_at": "2023-08-01T19:54:04.458774+0000", 2023-08-01T19:54:33.755 INFO:teuthology.orchestra.run.smithi101.stdout: "age": 29.292186751999999, 2023-08-01T19:54:33.755 INFO:teuthology.orchestra.run.smithi101.stdout: "duration": 0.017582611000000001, 2023-08-01T19:54:33.755 INFO:teuthology.orchestra.run.smithi101.stdout: "type_data": { 2023-08-01T19:54:33.755 INFO:teuthology.orchestra.run.smithi101.stdout: "flag_point": "commit sent; apply or cleanup", 2023-08-01T19:54:33.755 INFO:teuthology.orchestra.run.smithi101.stdout: "events": [ 2023-08-01T19:54:33.755 INFO:teuthology.orchestra.run.smithi101.stdout: { 2023-08-01T19:54:33.755 INFO:teuthology.orchestra.run.smithi101.stdout: "event": "initiated", 2023-08-01T19:54:33.756 INFO:teuthology.orchestra.run.smithi101.stdout: "time": "2023-08-01T19:54:04.458774+0000", 2023-08-01T19:54:33.756 INFO:teuthology.orchestra.run.smithi101.stdout: "duration": 0 2023-08-01T19:54:33.756 INFO:teuthology.orchestra.run.smithi101.stdout: }, 2023-08-01T19:54:33.756 INFO:teuthology.orchestra.run.smithi101.stdout: { 2023-08-01T19:54:33.756 INFO:teuthology.orchestra.run.smithi101.stdout: "event": "throttled", 2023-08-01T19:54:33.756 INFO:teuthology.orchestra.run.smithi101.stdout: "time": "2023-08-01T19:54:04.458774+0000", 2023-08-01T19:54:33.756 INFO:teuthology.orchestra.run.smithi101.stdout: "duration": 0 2023-08-01T19:54:33.757 INFO:teuthology.orchestra.run.smithi101.stdout: }, 2023-08-01T19:54:33.757 INFO:teuthology.orchestra.run.smithi101.stdout: { 2023-08-01T19:54:33.757 INFO:teuthology.orchestra.run.smithi101.stdout: "event": "header_read", 2023-08-01T19:54:33.757 INFO:teuthology.orchestra.run.smithi101.stdout: "time": "2023-08-01T19:54:04.458772+0000", 2023-08-01T19:54:33.757 INFO:teuthology.orchestra.run.smithi101.stdout: "duration": 4294967295.9999981 2023-08-01T19:54:33.757 INFO:teuthology.orchestra.run.smithi101.stdout: }, 2023-08-01T19:54:33.757 INFO:teuthology.orchestra.run.smithi101.stdout: { 2023-08-01T19:54:33.757 INFO:teuthology.orchestra.run.smithi101.stdout: "event": "all_read", 2023-08-01T19:54:33.758 INFO:teuthology.orchestra.run.smithi101.stdout: "time": "2023-08-01T19:54:04.458781+0000", 2023-08-01T19:54:33.758 INFO:teuthology.orchestra.run.smithi101.stdout: "duration": 8.6670000000000002e-06 2023-08-01T19:54:33.758 INFO:teuthology.orchestra.run.smithi101.stdout: }, 2023-08-01T19:54:33.758 INFO:teuthology.orchestra.run.smithi101.stdout: { 2023-08-01T19:54:33.758 INFO:teuthology.orchestra.run.smithi101.stdout: "event": "dispatched", 2023-08-01T19:54:33.758 INFO:teuthology.orchestra.run.smithi101.stdout: "time": "2023-08-01T19:54:04.458797+0000", 2023-08-01T19:54:33.758 INFO:teuthology.orchestra.run.smithi101.stdout: "duration": 1.6463000000000001e-05 2023-08-01T19:54:33.758 INFO:teuthology.orchestra.run.smithi101.stdout: }, 2023-08-01T19:54:33.759 INFO:teuthology.orchestra.run.smithi101.stdout: { 2023-08-01T19:54:33.759 INFO:teuthology.orchestra.run.smithi101.stdout: "event": "queued_for_pg", 2023-08-01T19:54:33.759 INFO:teuthology.orchestra.run.smithi101.stdout: "time": "2023-08-01T19:54:04.458810+0000", 2023-08-01T19:54:33.759 INFO:teuthology.orchestra.run.smithi101.stdout: "duration": 1.2753e-05 2023-08-01T19:54:33.759 INFO:teuthology.orchestra.run.smithi101.stdout: }, 2023-08-01T19:54:33.759 INFO:teuthology.orchestra.run.smithi101.stdout: { 2023-08-01T19:54:33.759 INFO:teuthology.orchestra.run.smithi101.stdout: "event": "reached_pg", 2023-08-01T19:54:33.759 INFO:teuthology.orchestra.run.smithi101.stdout: "time": "2023-08-01T19:54:04.458866+0000", 2023-08-01T19:54:33.760 INFO:teuthology.orchestra.run.smithi101.stdout: "duration": 5.6625000000000001e-05 2023-08-01T19:54:33.760 INFO:teuthology.orchestra.run.smithi101.stdout: }, 2023-08-01T19:54:33.760 INFO:teuthology.orchestra.run.smithi101.stdout: { 2023-08-01T19:54:33.760 INFO:teuthology.orchestra.run.smithi101.stdout: "event": "op must wait for map", 2023-08-01T19:54:33.760 INFO:teuthology.orchestra.run.smithi101.stdout: "time": "2023-08-01T19:54:04.458873+0000", 2023-08-01T19:54:33.760 INFO:teuthology.orchestra.run.smithi101.stdout: "duration": 6.9110000000000004e-06 2023-08-01T19:54:33.760 INFO:teuthology.orchestra.run.smithi101.stdout: }, 2023-08-01T19:54:33.761 INFO:teuthology.orchestra.run.smithi101.stdout: { 2023-08-01T19:54:33.761 INFO:teuthology.orchestra.run.smithi101.stdout: "event": "reached_pg", 2023-08-01T19:54:33.761 INFO:teuthology.orchestra.run.smithi101.stdout: "time": "2023-08-01T19:54:04.466999+0000", 2023-08-01T19:54:33.761 INFO:teuthology.orchestra.run.smithi101.stdout: "duration": 0.0081256550000000007 2023-08-01T19:54:33.761 INFO:teuthology.orchestra.run.smithi101.stdout: }, 2023-08-01T19:54:33.761 INFO:teuthology.orchestra.run.smithi101.stdout: { 2023-08-01T19:54:33.761 INFO:teuthology.orchestra.run.smithi101.stdout: "event": "started", 2023-08-01T19:54:33.761 INFO:teuthology.orchestra.run.smithi101.stdout: "time": "2023-08-01T19:54:04.467201+0000", 2023-08-01T19:54:33.762 INFO:teuthology.orchestra.run.smithi101.stdout: "duration": 0.00020166199999999999 2023-08-01T19:54:33.762 INFO:teuthology.orchestra.run.smithi101.stdout: }, 2023-08-01T19:54:33.762 INFO:teuthology.orchestra.run.smithi101.stdout: { 2023-08-01T19:54:33.762 INFO:teuthology.orchestra.run.smithi101.stdout: "event": "waiting for subops from 2", 2023-08-01T19:54:33.762 INFO:teuthology.orchestra.run.smithi101.stdout: "time": "2023-08-01T19:54:04.467350+0000", 2023-08-01T19:54:33.762 INFO:teuthology.orchestra.run.smithi101.stdout: "duration": 0.000149173 2023-08-01T19:54:33.762 INFO:teuthology.orchestra.run.smithi101.stdout: }, 2023-08-01T19:54:33.762 INFO:teuthology.orchestra.run.smithi101.stdout: { 2023-08-01T19:54:33.763 INFO:teuthology.orchestra.run.smithi101.stdout: "event": "op_commit", 2023-08-01T19:54:33.763 INFO:teuthology.orchestra.run.smithi101.stdout: "time": "2023-08-01T19:54:04.476168+0000", 2023-08-01T19:54:33.763 INFO:teuthology.orchestra.run.smithi101.stdout: "duration": 0.0088183250000000001 2023-08-01T19:54:33.763 INFO:teuthology.orchestra.run.smithi101.stdout: }, 2023-08-01T19:54:33.763 INFO:teuthology.orchestra.run.smithi101.stdout: { 2023-08-01T19:54:33.763 INFO:teuthology.orchestra.run.smithi101.stdout: "event": "sub_op_commit_rec", 2023-08-01T19:54:33.763 INFO:teuthology.orchestra.run.smithi101.stdout: "time": "2023-08-01T19:54:04.476239+0000", 2023-08-01T19:54:33.763 INFO:teuthology.orchestra.run.smithi101.stdout: "duration": 7.1296000000000003e-05 2023-08-01T19:54:33.764 INFO:teuthology.orchestra.run.smithi101.stdout: }, 2023-08-01T19:54:33.764 INFO:teuthology.orchestra.run.smithi101.stdout: { 2023-08-01T19:54:33.764 INFO:teuthology.orchestra.run.smithi101.stdout: "event": "commit_sent", 2023-08-01T19:54:33.764 INFO:teuthology.orchestra.run.smithi101.stdout: "time": "2023-08-01T19:54:04.476290+0000", 2023-08-01T19:54:33.764 INFO:teuthology.orchestra.run.smithi101.stdout: "duration": 5.0423999999999997e-05 2023-08-01T19:54:33.764 INFO:teuthology.orchestra.run.smithi101.stdout: }, 2023-08-01T19:54:33.764 INFO:teuthology.orchestra.run.smithi101.stdout: { 2023-08-01T19:54:33.764 INFO:teuthology.orchestra.run.smithi101.stdout: "event": "done", 2023-08-01T19:54:33.765 INFO:teuthology.orchestra.run.smithi101.stdout: "time": "2023-08-01T19:54:04.476356+0000", 2023-08-01T19:54:33.765 INFO:teuthology.orchestra.run.smithi101.stdout: "duration": 6.6439000000000005e-05 2023-08-01T19:54:33.765 INFO:teuthology.orchestra.run.smithi101.stdout: } 2023-08-01T19:54:33.765 INFO:teuthology.orchestra.run.smithi101.stdout: ] 2023-08-01T19:54:33.765 INFO:teuthology.orchestra.run.smithi101.stdout: } 2023-08-01T19:54:33.765 INFO:teuthology.orchestra.run.smithi101.stdout: }, 2023-08-01T19:54:33.765 INFO:teuthology.orchestra.run.smithi101.stdout: { 2023-08-01T19:54:33.766 INFO:teuthology.orchestra.run.smithi101.stdout: "description": "osd_op(mds.0.3:7 3.10 3:0d82a743:::600.00000000:head [create,setxattr parent (62) in=6b,setxattr layout (30) in=6b] snapc 0=[] ondisk+write+known_if_redirected+full_force+supports_pool_eio e17)", 2023-08-01T19:54:33.766 INFO:teuthology.orchestra.run.smithi101.stdout: "initiated_at": "2023-08-01T19:54:04.458830+0000", 2023-08-01T19:54:33.766 INFO:teuthology.orchestra.run.smithi101.stdout: "age": 29.292130364999998, 2023-08-01T19:54:33.766 INFO:teuthology.orchestra.run.smithi101.stdout: "duration": 0.018463726, 2023-08-01T19:54:33.766 INFO:teuthology.orchestra.run.smithi101.stdout: "type_data": { 2023-08-01T19:54:33.766 INFO:teuthology.orchestra.run.smithi101.stdout: "flag_point": "commit sent; apply or cleanup", 2023-08-01T19:54:33.766 INFO:teuthology.orchestra.run.smithi101.stdout: "events": [ 2023-08-01T19:54:33.766 INFO:teuthology.orchestra.run.smithi101.stdout: { 2023-08-01T19:54:33.767 INFO:teuthology.orchestra.run.smithi101.stdout: "event": "initiated", 2023-08-01T19:54:33.767 INFO:teuthology.orchestra.run.smithi101.stdout: "time": "2023-08-01T19:54:04.458830+0000", 2023-08-01T19:54:33.767 INFO:teuthology.orchestra.run.smithi101.stdout: "duration": 0 2023-08-01T19:54:33.767 INFO:teuthology.orchestra.run.smithi101.stdout: }, 2023-08-01T19:54:33.767 INFO:teuthology.orchestra.run.smithi101.stdout: { 2023-08-01T19:54:33.767 INFO:teuthology.orchestra.run.smithi101.stdout: "event": "throttled", 2023-08-01T19:54:33.767 INFO:teuthology.orchestra.run.smithi101.stdout: "time": "2023-08-01T19:54:04.458830+0000", 2023-08-01T19:54:33.767 INFO:teuthology.orchestra.run.smithi101.stdout: "duration": 0 2023-08-01T19:54:33.768 INFO:teuthology.orchestra.run.smithi101.stdout: }, 2023-08-01T19:54:33.768 INFO:teuthology.orchestra.run.smithi101.stdout: { 2023-08-01T19:54:33.768 INFO:teuthology.orchestra.run.smithi101.stdout: "event": "header_read", 2023-08-01T19:54:33.768 INFO:teuthology.orchestra.run.smithi101.stdout: "time": "2023-08-01T19:54:04.458829+0000", 2023-08-01T19:54:33.768 INFO:teuthology.orchestra.run.smithi101.stdout: "duration": 4294967295.999999 2023-08-01T19:54:33.768 INFO:teuthology.orchestra.run.smithi101.stdout: }, 2023-08-01T19:54:33.768 INFO:teuthology.orchestra.run.smithi101.stdout: { 2023-08-01T19:54:33.768 INFO:teuthology.orchestra.run.smithi101.stdout: "event": "all_read", 2023-08-01T19:54:33.769 INFO:teuthology.orchestra.run.smithi101.stdout: "time": "2023-08-01T19:54:04.458838+0000", 2023-08-01T19:54:33.769 INFO:teuthology.orchestra.run.smithi101.stdout: "duration": 8.5369999999999997e-06 2023-08-01T19:54:33.769 INFO:teuthology.orchestra.run.smithi101.stdout: }, 2023-08-01T19:54:33.769 INFO:teuthology.orchestra.run.smithi101.stdout: { 2023-08-01T19:54:33.769 INFO:teuthology.orchestra.run.smithi101.stdout: "event": "dispatched", 2023-08-01T19:54:33.769 INFO:teuthology.orchestra.run.smithi101.stdout: "time": "2023-08-01T19:54:04.458850+0000", 2023-08-01T19:54:33.769 INFO:teuthology.orchestra.run.smithi101.stdout: "duration": 1.203e-05 2023-08-01T19:54:33.769 INFO:teuthology.orchestra.run.smithi101.stdout: }, 2023-08-01T19:54:33.770 INFO:teuthology.orchestra.run.smithi101.stdout: { 2023-08-01T19:54:33.770 INFO:teuthology.orchestra.run.smithi101.stdout: "event": "queued_for_pg", 2023-08-01T19:54:33.770 INFO:teuthology.orchestra.run.smithi101.stdout: "time": "2023-08-01T19:54:04.458859+0000", 2023-08-01T19:54:33.770 INFO:teuthology.orchestra.run.smithi101.stdout: "duration": 8.9889999999999998e-06 2023-08-01T19:54:33.770 INFO:teuthology.orchestra.run.smithi101.stdout: }, 2023-08-01T19:54:33.770 INFO:teuthology.orchestra.run.smithi101.stdout: { 2023-08-01T19:54:33.770 INFO:teuthology.orchestra.run.smithi101.stdout: "event": "reached_pg", 2023-08-01T19:54:33.770 INFO:teuthology.orchestra.run.smithi101.stdout: "time": "2023-08-01T19:54:04.458926+0000", 2023-08-01T19:54:33.771 INFO:teuthology.orchestra.run.smithi101.stdout: "duration": 6.6741000000000004e-05 2023-08-01T19:54:33.771 INFO:teuthology.orchestra.run.smithi101.stdout: }, 2023-08-01T19:54:33.771 INFO:teuthology.orchestra.run.smithi101.stdout: { 2023-08-01T19:54:33.771 INFO:teuthology.orchestra.run.smithi101.stdout: "event": "waiting_for_map not empty", 2023-08-01T19:54:33.771 INFO:teuthology.orchestra.run.smithi101.stdout: "time": "2023-08-01T19:54:04.458929+0000", 2023-08-01T19:54:33.771 INFO:teuthology.orchestra.run.smithi101.stdout: "duration": 3.303e-06 2023-08-01T19:54:33.771 INFO:teuthology.orchestra.run.smithi101.stdout: }, 2023-08-01T19:54:33.771 INFO:teuthology.orchestra.run.smithi101.stdout: { 2023-08-01T19:54:33.772 INFO:teuthology.orchestra.run.smithi101.stdout: "event": "reached_pg", 2023-08-01T19:54:33.772 INFO:teuthology.orchestra.run.smithi101.stdout: "time": "2023-08-01T19:54:04.468692+0000", 2023-08-01T19:54:33.772 INFO:teuthology.orchestra.run.smithi101.stdout: "duration": 0.0097635910000000003 2023-08-01T19:54:33.772 INFO:teuthology.orchestra.run.smithi101.stdout: }, 2023-08-01T19:54:33.772 INFO:teuthology.orchestra.run.smithi101.stdout: { 2023-08-01T19:54:33.772 INFO:teuthology.orchestra.run.smithi101.stdout: "event": "started", 2023-08-01T19:54:33.772 INFO:teuthology.orchestra.run.smithi101.stdout: "time": "2023-08-01T19:54:04.468774+0000", 2023-08-01T19:54:33.773 INFO:teuthology.orchestra.run.smithi101.stdout: "duration": 8.1092000000000002e-05 2023-08-01T19:54:33.773 INFO:teuthology.orchestra.run.smithi101.stdout: }, 2023-08-01T19:54:33.773 INFO:teuthology.orchestra.run.smithi101.stdout: { 2023-08-01T19:54:33.773 INFO:teuthology.orchestra.run.smithi101.stdout: "event": "waiting for subops from 2", 2023-08-01T19:54:33.773 INFO:teuthology.orchestra.run.smithi101.stdout: "time": "2023-08-01T19:54:04.468934+0000", 2023-08-01T19:54:33.773 INFO:teuthology.orchestra.run.smithi101.stdout: "duration": 0.000160027 2023-08-01T19:54:33.773 INFO:teuthology.orchestra.run.smithi101.stdout: }, 2023-08-01T19:54:33.773 INFO:teuthology.orchestra.run.smithi101.stdout: { 2023-08-01T19:54:33.774 INFO:teuthology.orchestra.run.smithi101.stdout: "event": "op_commit", 2023-08-01T19:54:33.774 INFO:teuthology.orchestra.run.smithi101.stdout: "time": "2023-08-01T19:54:04.476174+0000", 2023-08-01T19:54:33.774 INFO:teuthology.orchestra.run.smithi101.stdout: "duration": 0.0072400479999999998 2023-08-01T19:54:33.774 INFO:teuthology.orchestra.run.smithi101.stdout: }, 2023-08-01T19:54:33.774 INFO:teuthology.orchestra.run.smithi101.stdout: { 2023-08-01T19:54:33.774 INFO:teuthology.orchestra.run.smithi101.stdout: "event": "sub_op_commit_rec", 2023-08-01T19:54:33.774 INFO:teuthology.orchestra.run.smithi101.stdout: "time": "2023-08-01T19:54:04.477206+0000", 2023-08-01T19:54:33.774 INFO:teuthology.orchestra.run.smithi101.stdout: "duration": 0.0010318969999999999 2023-08-01T19:54:33.775 INFO:teuthology.orchestra.run.smithi101.stdout: }, 2023-08-01T19:54:33.775 INFO:teuthology.orchestra.run.smithi101.stdout: { 2023-08-01T19:54:33.775 INFO:teuthology.orchestra.run.smithi101.stdout: "event": "commit_sent", 2023-08-01T19:54:33.775 INFO:teuthology.orchestra.run.smithi101.stdout: "time": "2023-08-01T19:54:04.477257+0000", 2023-08-01T19:54:33.775 INFO:teuthology.orchestra.run.smithi101.stdout: "duration": 5.1156000000000003e-05 2023-08-01T19:54:33.775 INFO:teuthology.orchestra.run.smithi101.stdout: }, 2023-08-01T19:54:33.775 INFO:teuthology.orchestra.run.smithi101.stdout: { 2023-08-01T19:54:33.775 INFO:teuthology.orchestra.run.smithi101.stdout: "event": "done", 2023-08-01T19:54:33.776 INFO:teuthology.orchestra.run.smithi101.stdout: "time": "2023-08-01T19:54:04.477294+0000", 2023-08-01T19:54:33.776 INFO:teuthology.orchestra.run.smithi101.stdout: "duration": 3.7150000000000002e-05 2023-08-01T19:54:33.776 INFO:teuthology.orchestra.run.smithi101.stdout: } 2023-08-01T19:54:33.776 INFO:teuthology.orchestra.run.smithi101.stdout: ] 2023-08-01T19:54:33.776 INFO:teuthology.orchestra.run.smithi101.stdout: } 2023-08-01T19:54:33.776 INFO:teuthology.orchestra.run.smithi101.stdout: }, 2023-08-01T19:54:33.776 INFO:teuthology.orchestra.run.smithi101.stdout: { 2023-08-01T19:54:33.776 INFO:teuthology.orchestra.run.smithi101.stdout: "description": "osd_op(mds.0.3:8 3.10 3:09401a81:::601.00000000:head [omap-set-header] snapc 0=[] ondisk+write+known_if_redirected+full_force+supports_pool_eio e17)", 2023-08-01T19:54:33.777 INFO:teuthology.orchestra.run.smithi101.stdout: "initiated_at": "2023-08-01T19:54:04.458869+0000", 2023-08-01T19:54:33.777 INFO:teuthology.orchestra.run.smithi101.stdout: "age": 29.292091229, 2023-08-01T19:54:33.777 INFO:teuthology.orchestra.run.smithi101.stdout: "duration": 0.018528932000000001, 2023-08-01T19:54:33.777 INFO:teuthology.orchestra.run.smithi101.stdout: "type_data": { 2023-08-01T19:54:33.777 INFO:teuthology.orchestra.run.smithi101.stdout: "flag_point": "commit sent; apply or cleanup", 2023-08-01T19:54:33.777 INFO:teuthology.orchestra.run.smithi101.stdout: "events": [ 2023-08-01T19:54:33.777 INFO:teuthology.orchestra.run.smithi101.stdout: { 2023-08-01T19:54:33.777 INFO:teuthology.orchestra.run.smithi101.stdout: "event": "initiated", 2023-08-01T19:54:33.778 INFO:teuthology.orchestra.run.smithi101.stdout: "time": "2023-08-01T19:54:04.458869+0000", 2023-08-01T19:54:33.778 INFO:teuthology.orchestra.run.smithi101.stdout: "duration": 0 2023-08-01T19:54:33.778 INFO:teuthology.orchestra.run.smithi101.stdout: }, 2023-08-01T19:54:33.778 INFO:teuthology.orchestra.run.smithi101.stdout: { 2023-08-01T19:54:33.778 INFO:teuthology.orchestra.run.smithi101.stdout: "event": "throttled", 2023-08-01T19:54:33.778 INFO:teuthology.orchestra.run.smithi101.stdout: "time": "2023-08-01T19:54:04.458869+0000", 2023-08-01T19:54:33.778 INFO:teuthology.orchestra.run.smithi101.stdout: "duration": 0 2023-08-01T19:54:33.779 INFO:teuthology.orchestra.run.smithi101.stdout: }, 2023-08-01T19:54:33.779 INFO:teuthology.orchestra.run.smithi101.stdout: { 2023-08-01T19:54:33.779 INFO:teuthology.orchestra.run.smithi101.stdout: "event": "header_read", 2023-08-01T19:54:33.779 INFO:teuthology.orchestra.run.smithi101.stdout: "time": "2023-08-01T19:54:04.458869+0000", 2023-08-01T19:54:33.779 INFO:teuthology.orchestra.run.smithi101.stdout: "duration": 4294967295.9999995 2023-08-01T19:54:33.779 INFO:teuthology.orchestra.run.smithi101.stdout: }, 2023-08-01T19:54:33.779 INFO:teuthology.orchestra.run.smithi101.stdout: { 2023-08-01T19:54:33.779 INFO:teuthology.orchestra.run.smithi101.stdout: "event": "all_read", 2023-08-01T19:54:33.780 INFO:teuthology.orchestra.run.smithi101.stdout: "time": "2023-08-01T19:54:04.458878+0000", 2023-08-01T19:54:33.780 INFO:teuthology.orchestra.run.smithi101.stdout: "duration": 9.4110000000000002e-06 2023-08-01T19:54:33.780 INFO:teuthology.orchestra.run.smithi101.stdout: }, 2023-08-01T19:54:33.780 INFO:teuthology.orchestra.run.smithi101.stdout: { 2023-08-01T19:54:33.780 INFO:teuthology.orchestra.run.smithi101.stdout: "event": "dispatched", 2023-08-01T19:54:33.780 INFO:teuthology.orchestra.run.smithi101.stdout: "time": "2023-08-01T19:54:04.458886+0000", 2023-08-01T19:54:33.780 INFO:teuthology.orchestra.run.smithi101.stdout: "duration": 7.6090000000000003e-06 2023-08-01T19:54:33.780 INFO:teuthology.orchestra.run.smithi101.stdout: }, 2023-08-01T19:54:33.781 INFO:teuthology.orchestra.run.smithi101.stdout: { 2023-08-01T19:54:33.781 INFO:teuthology.orchestra.run.smithi101.stdout: "event": "queued_for_pg", 2023-08-01T19:54:33.781 INFO:teuthology.orchestra.run.smithi101.stdout: "time": "2023-08-01T19:54:04.458890+0000", 2023-08-01T19:54:33.781 INFO:teuthology.orchestra.run.smithi101.stdout: "duration": 4.8470000000000003e-06 2023-08-01T19:54:33.781 INFO:teuthology.orchestra.run.smithi101.stdout: }, 2023-08-01T19:54:33.781 INFO:teuthology.orchestra.run.smithi101.stdout: { 2023-08-01T19:54:33.781 INFO:teuthology.orchestra.run.smithi101.stdout: "event": "reached_pg", 2023-08-01T19:54:33.781 INFO:teuthology.orchestra.run.smithi101.stdout: "time": "2023-08-01T19:54:04.458957+0000", 2023-08-01T19:54:33.782 INFO:teuthology.orchestra.run.smithi101.stdout: "duration": 6.6502999999999997e-05 2023-08-01T19:54:33.782 INFO:teuthology.orchestra.run.smithi101.stdout: }, 2023-08-01T19:54:33.782 INFO:teuthology.orchestra.run.smithi101.stdout: { 2023-08-01T19:54:33.782 INFO:teuthology.orchestra.run.smithi101.stdout: "event": "waiting_for_map not empty", 2023-08-01T19:54:33.782 INFO:teuthology.orchestra.run.smithi101.stdout: "time": "2023-08-01T19:54:04.458959+0000", 2023-08-01T19:54:33.782 INFO:teuthology.orchestra.run.smithi101.stdout: "duration": 2.3989999999999998e-06 2023-08-01T19:54:33.782 INFO:teuthology.orchestra.run.smithi101.stdout: }, 2023-08-01T19:54:33.782 INFO:teuthology.orchestra.run.smithi101.stdout: { 2023-08-01T19:54:33.783 INFO:teuthology.orchestra.run.smithi101.stdout: "event": "reached_pg", 2023-08-01T19:54:33.783 INFO:teuthology.orchestra.run.smithi101.stdout: "time": "2023-08-01T19:54:04.469554+0000", 2023-08-01T19:54:33.783 INFO:teuthology.orchestra.run.smithi101.stdout: "duration": 0.010594404 2023-08-01T19:54:33.783 INFO:teuthology.orchestra.run.smithi101.stdout: }, 2023-08-01T19:54:33.783 INFO:teuthology.orchestra.run.smithi101.stdout: { 2023-08-01T19:54:33.783 INFO:teuthology.orchestra.run.smithi101.stdout: "event": "started", 2023-08-01T19:54:33.783 INFO:teuthology.orchestra.run.smithi101.stdout: "time": "2023-08-01T19:54:04.469694+0000", 2023-08-01T19:54:33.783 INFO:teuthology.orchestra.run.smithi101.stdout: "duration": 0.00014006899999999999 2023-08-01T19:54:33.784 INFO:teuthology.orchestra.run.smithi101.stdout: }, 2023-08-01T19:54:33.784 INFO:teuthology.orchestra.run.smithi101.stdout: { 2023-08-01T19:54:33.784 INFO:teuthology.orchestra.run.smithi101.stdout: "event": "waiting for subops from 2", 2023-08-01T19:54:33.784 INFO:teuthology.orchestra.run.smithi101.stdout: "time": "2023-08-01T19:54:04.469826+0000", 2023-08-01T19:54:33.784 INFO:teuthology.orchestra.run.smithi101.stdout: "duration": 0.000132285 2023-08-01T19:54:33.784 INFO:teuthology.orchestra.run.smithi101.stdout: }, 2023-08-01T19:54:33.784 INFO:teuthology.orchestra.run.smithi101.stdout: { 2023-08-01T19:54:33.785 INFO:teuthology.orchestra.run.smithi101.stdout: "event": "op_commit", 2023-08-01T19:54:33.785 INFO:teuthology.orchestra.run.smithi101.stdout: "time": "2023-08-01T19:54:04.476179+0000", 2023-08-01T19:54:33.785 INFO:teuthology.orchestra.run.smithi101.stdout: "duration": 0.0063524289999999997 2023-08-01T19:54:33.785 INFO:teuthology.orchestra.run.smithi101.stdout: }, 2023-08-01T19:54:33.785 INFO:teuthology.orchestra.run.smithi101.stdout: { 2023-08-01T19:54:33.785 INFO:teuthology.orchestra.run.smithi101.stdout: "event": "sub_op_commit_rec", 2023-08-01T19:54:33.785 INFO:teuthology.orchestra.run.smithi101.stdout: "time": "2023-08-01T19:54:04.477334+0000", 2023-08-01T19:54:33.785 INFO:teuthology.orchestra.run.smithi101.stdout: "duration": 0.0011551070000000001 2023-08-01T19:54:33.786 INFO:teuthology.orchestra.run.smithi101.stdout: }, 2023-08-01T19:54:33.786 INFO:teuthology.orchestra.run.smithi101.stdout: { 2023-08-01T19:54:33.786 INFO:teuthology.orchestra.run.smithi101.stdout: "event": "commit_sent", 2023-08-01T19:54:33.786 INFO:teuthology.orchestra.run.smithi101.stdout: "time": "2023-08-01T19:54:04.477371+0000", 2023-08-01T19:54:33.786 INFO:teuthology.orchestra.run.smithi101.stdout: "duration": 3.7425000000000002e-05 2023-08-01T19:54:33.786 INFO:teuthology.orchestra.run.smithi101.stdout: }, 2023-08-01T19:54:33.786 INFO:teuthology.orchestra.run.smithi101.stdout: { 2023-08-01T19:54:33.786 INFO:teuthology.orchestra.run.smithi101.stdout: "event": "done", 2023-08-01T19:54:33.787 INFO:teuthology.orchestra.run.smithi101.stdout: "time": "2023-08-01T19:54:04.477398+0000", 2023-08-01T19:54:33.787 INFO:teuthology.orchestra.run.smithi101.stdout: "duration": 2.7078000000000001e-05 2023-08-01T19:54:33.787 INFO:teuthology.orchestra.run.smithi101.stdout: } 2023-08-01T19:54:33.787 INFO:teuthology.orchestra.run.smithi101.stdout: ] 2023-08-01T19:54:33.787 INFO:teuthology.orchestra.run.smithi101.stdout: } 2023-08-01T19:54:33.787 INFO:teuthology.orchestra.run.smithi101.stdout: }, 2023-08-01T19:54:33.787 INFO:teuthology.orchestra.run.smithi101.stdout: { 2023-08-01T19:54:33.787 INFO:teuthology.orchestra.run.smithi101.stdout: "description": "osd_op(mds.0.3:9 3.10 3:09401a81:::601.00000000:head [create,setxattr parent (62) in=6b,setxattr layout (30) in=6b] snapc 0=[] ondisk+write+known_if_redirected+full_force+supports_pool_eio e17)", 2023-08-01T19:54:33.788 INFO:teuthology.orchestra.run.smithi101.stdout: "initiated_at": "2023-08-01T19:54:04.458896+0000", 2023-08-01T19:54:33.788 INFO:teuthology.orchestra.run.smithi101.stdout: "age": 29.292064062000001, 2023-08-01T19:54:33.788 INFO:teuthology.orchestra.run.smithi101.stdout: "duration": 0.018577215000000001, 2023-08-01T19:54:33.788 INFO:teuthology.orchestra.run.smithi101.stdout: "type_data": { 2023-08-01T19:54:33.788 INFO:teuthology.orchestra.run.smithi101.stdout: "flag_point": "commit sent; apply or cleanup", 2023-08-01T19:54:33.788 INFO:teuthology.orchestra.run.smithi101.stdout: "events": [ 2023-08-01T19:54:33.788 INFO:teuthology.orchestra.run.smithi101.stdout: { 2023-08-01T19:54:33.788 INFO:teuthology.orchestra.run.smithi101.stdout: "event": "initiated", 2023-08-01T19:54:33.789 INFO:teuthology.orchestra.run.smithi101.stdout: "time": "2023-08-01T19:54:04.458896+0000", 2023-08-01T19:54:33.789 INFO:teuthology.orchestra.run.smithi101.stdout: "duration": 0 2023-08-01T19:54:33.789 INFO:teuthology.orchestra.run.smithi101.stdout: }, 2023-08-01T19:54:33.789 INFO:teuthology.orchestra.run.smithi101.stdout: { 2023-08-01T19:54:33.789 INFO:teuthology.orchestra.run.smithi101.stdout: "event": "throttled", 2023-08-01T19:54:33.789 INFO:teuthology.orchestra.run.smithi101.stdout: "time": "2023-08-01T19:54:04.458896+0000", 2023-08-01T19:54:33.789 INFO:teuthology.orchestra.run.smithi101.stdout: "duration": 0 2023-08-01T19:54:33.789 INFO:teuthology.orchestra.run.smithi101.stdout: }, 2023-08-01T19:54:33.790 INFO:teuthology.orchestra.run.smithi101.stdout: { 2023-08-01T19:54:33.790 INFO:teuthology.orchestra.run.smithi101.stdout: "event": "header_read", 2023-08-01T19:54:33.790 INFO:teuthology.orchestra.run.smithi101.stdout: "time": "2023-08-01T19:54:04.458896+0000", 2023-08-01T19:54:33.790 INFO:teuthology.orchestra.run.smithi101.stdout: "duration": 4294967295.9999995 2023-08-01T19:54:33.790 INFO:teuthology.orchestra.run.smithi101.stdout: }, 2023-08-01T19:54:33.790 INFO:teuthology.orchestra.run.smithi101.stdout: { 2023-08-01T19:54:33.790 INFO:teuthology.orchestra.run.smithi101.stdout: "event": "all_read", 2023-08-01T19:54:33.791 INFO:teuthology.orchestra.run.smithi101.stdout: "time": "2023-08-01T19:54:04.458900+0000", 2023-08-01T19:54:33.791 INFO:teuthology.orchestra.run.smithi101.stdout: "duration": 4.0829999999999997e-06 2023-08-01T19:54:33.791 INFO:teuthology.orchestra.run.smithi101.stdout: }, 2023-08-01T19:54:33.791 INFO:teuthology.orchestra.run.smithi101.stdout: { 2023-08-01T19:54:33.791 INFO:teuthology.orchestra.run.smithi101.stdout: "event": "dispatched", 2023-08-01T19:54:33.791 INFO:teuthology.orchestra.run.smithi101.stdout: "time": "2023-08-01T19:54:04.458906+0000", 2023-08-01T19:54:33.791 INFO:teuthology.orchestra.run.smithi101.stdout: "duration": 6.4099999999999996e-06 2023-08-01T19:54:33.791 INFO:teuthology.orchestra.run.smithi101.stdout: }, 2023-08-01T19:54:33.792 INFO:teuthology.orchestra.run.smithi101.stdout: { 2023-08-01T19:54:33.792 INFO:teuthology.orchestra.run.smithi101.stdout: "event": "queued_for_pg", 2023-08-01T19:54:33.792 INFO:teuthology.orchestra.run.smithi101.stdout: "time": "2023-08-01T19:54:04.458911+0000", 2023-08-01T19:54:33.792 INFO:teuthology.orchestra.run.smithi101.stdout: "duration": 4.0500000000000002e-06 2023-08-01T19:54:33.792 INFO:teuthology.orchestra.run.smithi101.stdout: }, 2023-08-01T19:54:33.792 INFO:teuthology.orchestra.run.smithi101.stdout: { 2023-08-01T19:54:33.792 INFO:teuthology.orchestra.run.smithi101.stdout: "event": "reached_pg", 2023-08-01T19:54:33.792 INFO:teuthology.orchestra.run.smithi101.stdout: "time": "2023-08-01T19:54:04.458981+0000", 2023-08-01T19:54:33.793 INFO:teuthology.orchestra.run.smithi101.stdout: "duration": 7.0121000000000002e-05 2023-08-01T19:54:33.793 INFO:teuthology.orchestra.run.smithi101.stdout: }, 2023-08-01T19:54:33.793 INFO:teuthology.orchestra.run.smithi101.stdout: { 2023-08-01T19:54:33.793 INFO:teuthology.orchestra.run.smithi101.stdout: "event": "waiting_for_map not empty", 2023-08-01T19:54:33.793 INFO:teuthology.orchestra.run.smithi101.stdout: "time": "2023-08-01T19:54:04.458983+0000", 2023-08-01T19:54:33.793 INFO:teuthology.orchestra.run.smithi101.stdout: "duration": 2.2299999999999998e-06 2023-08-01T19:54:33.793 INFO:teuthology.orchestra.run.smithi101.stdout: }, 2023-08-01T19:54:33.793 INFO:teuthology.orchestra.run.smithi101.stdout: { 2023-08-01T19:54:33.794 INFO:teuthology.orchestra.run.smithi101.stdout: "event": "reached_pg", 2023-08-01T19:54:33.794 INFO:teuthology.orchestra.run.smithi101.stdout: "time": "2023-08-01T19:54:04.470122+0000", 2023-08-01T19:54:33.794 INFO:teuthology.orchestra.run.smithi101.stdout: "duration": 0.011139593999999999 2023-08-01T19:54:33.794 INFO:teuthology.orchestra.run.smithi101.stdout: }, 2023-08-01T19:54:33.794 INFO:teuthology.orchestra.run.smithi101.stdout: { 2023-08-01T19:54:33.794 INFO:teuthology.orchestra.run.smithi101.stdout: "event": "started", 2023-08-01T19:54:33.794 INFO:teuthology.orchestra.run.smithi101.stdout: "time": "2023-08-01T19:54:04.470217+0000", 2023-08-01T19:54:33.794 INFO:teuthology.orchestra.run.smithi101.stdout: "duration": 9.4388000000000005e-05 2023-08-01T19:54:33.795 INFO:teuthology.orchestra.run.smithi101.stdout: }, 2023-08-01T19:54:33.795 INFO:teuthology.orchestra.run.smithi101.stdout: { 2023-08-01T19:54:33.795 INFO:teuthology.orchestra.run.smithi101.stdout: "event": "waiting for subops from 2", 2023-08-01T19:54:33.795 INFO:teuthology.orchestra.run.smithi101.stdout: "time": "2023-08-01T19:54:04.470714+0000", 2023-08-01T19:54:33.795 INFO:teuthology.orchestra.run.smithi101.stdout: "duration": 0.00049680999999999998 2023-08-01T19:54:33.795 INFO:teuthology.orchestra.run.smithi101.stdout: }, 2023-08-01T19:54:33.795 INFO:teuthology.orchestra.run.smithi101.stdout: { 2023-08-01T19:54:33.795 INFO:teuthology.orchestra.run.smithi101.stdout: "event": "op_commit", 2023-08-01T19:54:33.796 INFO:teuthology.orchestra.run.smithi101.stdout: "time": "2023-08-01T19:54:04.476183+0000", 2023-08-01T19:54:33.796 INFO:teuthology.orchestra.run.smithi101.stdout: "duration": 0.0054695880000000001 2023-08-01T19:54:33.796 INFO:teuthology.orchestra.run.smithi101.stdout: }, 2023-08-01T19:54:33.796 INFO:teuthology.orchestra.run.smithi101.stdout: { 2023-08-01T19:54:33.796 INFO:teuthology.orchestra.run.smithi101.stdout: "event": "sub_op_commit_rec", 2023-08-01T19:54:33.796 INFO:teuthology.orchestra.run.smithi101.stdout: "time": "2023-08-01T19:54:04.477428+0000", 2023-08-01T19:54:33.796 INFO:teuthology.orchestra.run.smithi101.stdout: "duration": 0.001244843 2023-08-01T19:54:33.797 INFO:teuthology.orchestra.run.smithi101.stdout: }, 2023-08-01T19:54:33.797 INFO:teuthology.orchestra.run.smithi101.stdout: { 2023-08-01T19:54:33.797 INFO:teuthology.orchestra.run.smithi101.stdout: "event": "commit_sent", 2023-08-01T19:54:33.797 INFO:teuthology.orchestra.run.smithi101.stdout: "time": "2023-08-01T19:54:04.477456+0000", 2023-08-01T19:54:33.797 INFO:teuthology.orchestra.run.smithi101.stdout: "duration": 2.7538e-05 2023-08-01T19:54:33.797 INFO:teuthology.orchestra.run.smithi101.stdout: }, 2023-08-01T19:54:33.797 INFO:teuthology.orchestra.run.smithi101.stdout: { 2023-08-01T19:54:33.797 INFO:teuthology.orchestra.run.smithi101.stdout: "event": "done", 2023-08-01T19:54:33.798 INFO:teuthology.orchestra.run.smithi101.stdout: "time": "2023-08-01T19:54:04.477474+0000", 2023-08-01T19:54:33.798 INFO:teuthology.orchestra.run.smithi101.stdout: "duration": 1.7974000000000001e-05 2023-08-01T19:54:33.798 INFO:teuthology.orchestra.run.smithi101.stdout: } 2023-08-01T19:54:33.798 INFO:teuthology.orchestra.run.smithi101.stdout: ] 2023-08-01T19:54:33.798 INFO:teuthology.orchestra.run.smithi101.stdout: } 2023-08-01T19:54:33.798 INFO:teuthology.orchestra.run.smithi101.stdout: }, 2023-08-01T19:54:33.798 INFO:teuthology.orchestra.run.smithi101.stdout: { 2023-08-01T19:54:33.798 INFO:teuthology.orchestra.run.smithi101.stdout: "description": "osd_op(mds.0.3:10 3.10 3:0bd6d154:::602.00000000:head [omap-set-header] snapc 0=[] ondisk+write+known_if_redirected+full_force+supports_pool_eio e17)", 2023-08-01T19:54:33.799 INFO:teuthology.orchestra.run.smithi101.stdout: "initiated_at": "2023-08-01T19:54:04.458927+0000", 2023-08-01T19:54:33.799 INFO:teuthology.orchestra.run.smithi101.stdout: "age": 29.292033084, 2023-08-01T19:54:33.799 INFO:teuthology.orchestra.run.smithi101.stdout: "duration": 0.019574352, 2023-08-01T19:54:33.799 INFO:teuthology.orchestra.run.smithi101.stdout: "type_data": { 2023-08-01T19:54:33.799 INFO:teuthology.orchestra.run.smithi101.stdout: "flag_point": "commit sent; apply or cleanup", 2023-08-01T19:54:33.799 INFO:teuthology.orchestra.run.smithi101.stdout: "events": [ 2023-08-01T19:54:33.799 INFO:teuthology.orchestra.run.smithi101.stdout: { 2023-08-01T19:54:33.799 INFO:teuthology.orchestra.run.smithi101.stdout: "event": "initiated", 2023-08-01T19:54:33.800 INFO:teuthology.orchestra.run.smithi101.stdout: "time": "2023-08-01T19:54:04.458927+0000", 2023-08-01T19:54:33.800 INFO:teuthology.orchestra.run.smithi101.stdout: "duration": 0 2023-08-01T19:54:33.800 INFO:teuthology.orchestra.run.smithi101.stdout: }, 2023-08-01T19:54:33.800 INFO:teuthology.orchestra.run.smithi101.stdout: { 2023-08-01T19:54:33.800 INFO:teuthology.orchestra.run.smithi101.stdout: "event": "throttled", 2023-08-01T19:54:33.800 INFO:teuthology.orchestra.run.smithi101.stdout: "time": "2023-08-01T19:54:04.458927+0000", 2023-08-01T19:54:33.800 INFO:teuthology.orchestra.run.smithi101.stdout: "duration": 0 2023-08-01T19:54:33.800 INFO:teuthology.orchestra.run.smithi101.stdout: }, 2023-08-01T19:54:33.801 INFO:teuthology.orchestra.run.smithi101.stdout: { 2023-08-01T19:54:33.801 INFO:teuthology.orchestra.run.smithi101.stdout: "event": "header_read", 2023-08-01T19:54:33.801 INFO:teuthology.orchestra.run.smithi101.stdout: "time": "2023-08-01T19:54:04.458927+0000", 2023-08-01T19:54:33.801 INFO:teuthology.orchestra.run.smithi101.stdout: "duration": 4294967295.9999995 2023-08-01T19:54:33.801 INFO:teuthology.orchestra.run.smithi101.stdout: }, 2023-08-01T19:54:33.801 INFO:teuthology.orchestra.run.smithi101.stdout: { 2023-08-01T19:54:33.801 INFO:teuthology.orchestra.run.smithi101.stdout: "event": "all_read", 2023-08-01T19:54:33.801 INFO:teuthology.orchestra.run.smithi101.stdout: "time": "2023-08-01T19:54:04.458931+0000", 2023-08-01T19:54:33.802 INFO:teuthology.orchestra.run.smithi101.stdout: "duration": 4.3000000000000003e-06 2023-08-01T19:54:33.802 INFO:teuthology.orchestra.run.smithi101.stdout: }, 2023-08-01T19:54:33.802 INFO:teuthology.orchestra.run.smithi101.stdout: { 2023-08-01T19:54:33.802 INFO:teuthology.orchestra.run.smithi101.stdout: "event": "dispatched", 2023-08-01T19:54:33.802 INFO:teuthology.orchestra.run.smithi101.stdout: "time": "2023-08-01T19:54:04.458938+0000", 2023-08-01T19:54:33.802 INFO:teuthology.orchestra.run.smithi101.stdout: "duration": 7.3220000000000004e-06 2023-08-01T19:54:33.802 INFO:teuthology.orchestra.run.smithi101.stdout: }, 2023-08-01T19:54:33.803 INFO:teuthology.orchestra.run.smithi101.stdout: { 2023-08-01T19:54:33.803 INFO:teuthology.orchestra.run.smithi101.stdout: "event": "queued_for_pg", 2023-08-01T19:54:33.803 INFO:teuthology.orchestra.run.smithi101.stdout: "time": "2023-08-01T19:54:04.458944+0000", 2023-08-01T19:54:33.803 INFO:teuthology.orchestra.run.smithi101.stdout: "duration": 5.3040000000000004e-06 2023-08-01T19:54:33.803 INFO:teuthology.orchestra.run.smithi101.stdout: }, 2023-08-01T19:54:33.803 INFO:teuthology.orchestra.run.smithi101.stdout: { 2023-08-01T19:54:33.803 INFO:teuthology.orchestra.run.smithi101.stdout: "event": "reached_pg", 2023-08-01T19:54:33.803 INFO:teuthology.orchestra.run.smithi101.stdout: "time": "2023-08-01T19:54:04.459006+0000", 2023-08-01T19:54:33.804 INFO:teuthology.orchestra.run.smithi101.stdout: "duration": 6.2081000000000004e-05 2023-08-01T19:54:33.804 INFO:teuthology.orchestra.run.smithi101.stdout: }, 2023-08-01T19:54:33.804 INFO:teuthology.orchestra.run.smithi101.stdout: { 2023-08-01T19:54:33.804 INFO:teuthology.orchestra.run.smithi101.stdout: "event": "waiting_for_map not empty", 2023-08-01T19:54:33.804 INFO:teuthology.orchestra.run.smithi101.stdout: "time": "2023-08-01T19:54:04.459008+0000", 2023-08-01T19:54:33.804 INFO:teuthology.orchestra.run.smithi101.stdout: "duration": 2.2500000000000001e-06 2023-08-01T19:54:33.804 INFO:teuthology.orchestra.run.smithi101.stdout: }, 2023-08-01T19:54:33.804 INFO:teuthology.orchestra.run.smithi101.stdout: { 2023-08-01T19:54:33.805 INFO:teuthology.orchestra.run.smithi101.stdout: "event": "reached_pg", 2023-08-01T19:54:33.805 INFO:teuthology.orchestra.run.smithi101.stdout: "time": "2023-08-01T19:54:04.470946+0000", 2023-08-01T19:54:33.805 INFO:teuthology.orchestra.run.smithi101.stdout: "duration": 0.011938347 2023-08-01T19:54:33.805 INFO:teuthology.orchestra.run.smithi101.stdout: }, 2023-08-01T19:54:33.805 INFO:teuthology.orchestra.run.smithi101.stdout: { 2023-08-01T19:54:33.805 INFO:teuthology.orchestra.run.smithi101.stdout: "event": "started", 2023-08-01T19:54:33.805 INFO:teuthology.orchestra.run.smithi101.stdout: "time": "2023-08-01T19:54:04.471071+0000", 2023-08-01T19:54:33.805 INFO:teuthology.orchestra.run.smithi101.stdout: "duration": 0.00012470299999999999 2023-08-01T19:54:33.806 INFO:teuthology.orchestra.run.smithi101.stdout: }, 2023-08-01T19:54:33.806 INFO:teuthology.orchestra.run.smithi101.stdout: { 2023-08-01T19:54:33.806 INFO:teuthology.orchestra.run.smithi101.stdout: "event": "waiting for subops from 2", 2023-08-01T19:54:33.806 INFO:teuthology.orchestra.run.smithi101.stdout: "time": "2023-08-01T19:54:04.471205+0000", 2023-08-01T19:54:33.807 INFO:teuthology.orchestra.run.smithi101.stdout: "duration": 0.000133891 2023-08-01T19:54:33.807 INFO:teuthology.orchestra.run.smithi101.stdout: }, 2023-08-01T19:54:33.807 INFO:teuthology.orchestra.run.smithi101.stdout: { 2023-08-01T19:54:33.807 INFO:teuthology.orchestra.run.smithi101.stdout: "event": "op_commit", 2023-08-01T19:54:33.807 INFO:teuthology.orchestra.run.smithi101.stdout: "time": "2023-08-01T19:54:04.477042+0000", 2023-08-01T19:54:33.807 INFO:teuthology.orchestra.run.smithi101.stdout: "duration": 0.0058374849999999999 2023-08-01T19:54:33.807 INFO:teuthology.orchestra.run.smithi101.stdout: }, 2023-08-01T19:54:33.807 INFO:teuthology.orchestra.run.smithi101.stdout: { 2023-08-01T19:54:33.808 INFO:teuthology.orchestra.run.smithi101.stdout: "event": "sub_op_commit_rec", 2023-08-01T19:54:33.808 INFO:teuthology.orchestra.run.smithi101.stdout: "time": "2023-08-01T19:54:04.478445+0000", 2023-08-01T19:54:33.808 INFO:teuthology.orchestra.run.smithi101.stdout: "duration": 0.0014023239999999999 2023-08-01T19:54:33.808 INFO:teuthology.orchestra.run.smithi101.stdout: }, 2023-08-01T19:54:33.808 INFO:teuthology.orchestra.run.smithi101.stdout: { 2023-08-01T19:54:33.808 INFO:teuthology.orchestra.run.smithi101.stdout: "event": "commit_sent", 2023-08-01T19:54:33.808 INFO:teuthology.orchestra.run.smithi101.stdout: "time": "2023-08-01T19:54:04.478478+0000", 2023-08-01T19:54:33.809 INFO:teuthology.orchestra.run.smithi101.stdout: "duration": 3.3503000000000001e-05 2023-08-01T19:54:33.809 INFO:teuthology.orchestra.run.smithi101.stdout: }, 2023-08-01T19:54:33.809 INFO:teuthology.orchestra.run.smithi101.stdout: { 2023-08-01T19:54:33.809 INFO:teuthology.orchestra.run.smithi101.stdout: "event": "done", 2023-08-01T19:54:33.809 INFO:teuthology.orchestra.run.smithi101.stdout: "time": "2023-08-01T19:54:04.478502+0000", 2023-08-01T19:54:33.809 INFO:teuthology.orchestra.run.smithi101.stdout: "duration": 2.3402000000000001e-05 2023-08-01T19:54:33.809 INFO:teuthology.orchestra.run.smithi101.stdout: } 2023-08-01T19:54:33.809 INFO:teuthology.orchestra.run.smithi101.stdout: ] 2023-08-01T19:54:33.810 INFO:teuthology.orchestra.run.smithi101.stdout: } 2023-08-01T19:54:33.810 INFO:teuthology.orchestra.run.smithi101.stdout: }, 2023-08-01T19:54:33.810 INFO:teuthology.orchestra.run.smithi101.stdout: { 2023-08-01T19:54:33.810 INFO:teuthology.orchestra.run.smithi101.stdout: "description": "osd_op(mds.0.3:11 3.10 3:0bd6d154:::602.00000000:head [create,setxattr parent (62) in=6b,setxattr layout (30) in=6b] snapc 0=[] ondisk+write+known_if_redirected+full_force+supports_pool_eio e17)", 2023-08-01T19:54:33.810 INFO:teuthology.orchestra.run.smithi101.stdout: "initiated_at": "2023-08-01T19:54:04.458960+0000", 2023-08-01T19:54:33.810 INFO:teuthology.orchestra.run.smithi101.stdout: "age": 29.292000636000001, 2023-08-01T19:54:33.810 INFO:teuthology.orchestra.run.smithi101.stdout: "duration": 0.019645459000000001, 2023-08-01T19:54:33.810 INFO:teuthology.orchestra.run.smithi101.stdout: "type_data": { 2023-08-01T19:54:33.811 INFO:teuthology.orchestra.run.smithi101.stdout: "flag_point": "commit sent; apply or cleanup", 2023-08-01T19:54:33.811 INFO:teuthology.orchestra.run.smithi101.stdout: "events": [ 2023-08-01T19:54:33.811 INFO:teuthology.orchestra.run.smithi101.stdout: { 2023-08-01T19:54:33.811 INFO:teuthology.orchestra.run.smithi101.stdout: "event": "initiated", 2023-08-01T19:54:33.811 INFO:teuthology.orchestra.run.smithi101.stdout: "time": "2023-08-01T19:54:04.458960+0000", 2023-08-01T19:54:33.811 INFO:teuthology.orchestra.run.smithi101.stdout: "duration": 0 2023-08-01T19:54:33.811 INFO:teuthology.orchestra.run.smithi101.stdout: }, 2023-08-01T19:54:33.811 INFO:teuthology.orchestra.run.smithi101.stdout: { 2023-08-01T19:54:33.812 INFO:teuthology.orchestra.run.smithi101.stdout: "event": "throttled", 2023-08-01T19:54:33.812 INFO:teuthology.orchestra.run.smithi101.stdout: "time": "2023-08-01T19:54:04.458960+0000", 2023-08-01T19:54:33.812 INFO:teuthology.orchestra.run.smithi101.stdout: "duration": 0 2023-08-01T19:54:33.812 INFO:teuthology.orchestra.run.smithi101.stdout: }, 2023-08-01T19:54:33.812 INFO:teuthology.orchestra.run.smithi101.stdout: { 2023-08-01T19:54:33.812 INFO:teuthology.orchestra.run.smithi101.stdout: "event": "header_read", 2023-08-01T19:54:33.812 INFO:teuthology.orchestra.run.smithi101.stdout: "time": "2023-08-01T19:54:04.458959+0000", 2023-08-01T19:54:33.813 INFO:teuthology.orchestra.run.smithi101.stdout: "duration": 4294967295.9999995 2023-08-01T19:54:33.813 INFO:teuthology.orchestra.run.smithi101.stdout: }, 2023-08-01T19:54:33.813 INFO:teuthology.orchestra.run.smithi101.stdout: { 2023-08-01T19:54:33.813 INFO:teuthology.orchestra.run.smithi101.stdout: "event": "all_read", 2023-08-01T19:54:33.813 INFO:teuthology.orchestra.run.smithi101.stdout: "time": "2023-08-01T19:54:04.458963+0000", 2023-08-01T19:54:33.813 INFO:teuthology.orchestra.run.smithi101.stdout: "duration": 3.9199999999999997e-06 2023-08-01T19:54:33.813 INFO:teuthology.orchestra.run.smithi101.stdout: }, 2023-08-01T19:54:33.813 INFO:teuthology.orchestra.run.smithi101.stdout: { 2023-08-01T19:54:33.814 INFO:teuthology.orchestra.run.smithi101.stdout: "event": "dispatched", 2023-08-01T19:54:33.814 INFO:teuthology.orchestra.run.smithi101.stdout: "time": "2023-08-01T19:54:04.458970+0000", 2023-08-01T19:54:33.814 INFO:teuthology.orchestra.run.smithi101.stdout: "duration": 7.0439999999999998e-06 2023-08-01T19:54:33.814 INFO:teuthology.orchestra.run.smithi101.stdout: }, 2023-08-01T19:54:33.814 INFO:teuthology.orchestra.run.smithi101.stdout: { 2023-08-01T19:54:33.814 INFO:teuthology.orchestra.run.smithi101.stdout: "event": "queued_for_pg", 2023-08-01T19:54:33.814 INFO:teuthology.orchestra.run.smithi101.stdout: "time": "2023-08-01T19:54:04.458976+0000", 2023-08-01T19:54:33.814 INFO:teuthology.orchestra.run.smithi101.stdout: "duration": 5.9540000000000001e-06 2023-08-01T19:54:33.815 INFO:teuthology.orchestra.run.smithi101.stdout: }, 2023-08-01T19:54:33.815 INFO:teuthology.orchestra.run.smithi101.stdout: { 2023-08-01T19:54:33.815 INFO:teuthology.orchestra.run.smithi101.stdout: "event": "reached_pg", 2023-08-01T19:54:33.815 INFO:teuthology.orchestra.run.smithi101.stdout: "time": "2023-08-01T19:54:04.459035+0000", 2023-08-01T19:54:33.815 INFO:teuthology.orchestra.run.smithi101.stdout: "duration": 5.8924e-05 2023-08-01T19:54:33.815 INFO:teuthology.orchestra.run.smithi101.stdout: }, 2023-08-01T19:54:33.815 INFO:teuthology.orchestra.run.smithi101.stdout: { 2023-08-01T19:54:33.815 INFO:teuthology.orchestra.run.smithi101.stdout: "event": "waiting_for_map not empty", 2023-08-01T19:54:33.816 INFO:teuthology.orchestra.run.smithi101.stdout: "time": "2023-08-01T19:54:04.459038+0000", 2023-08-01T19:54:33.816 INFO:teuthology.orchestra.run.smithi101.stdout: "duration": 3.2760000000000001e-06 2023-08-01T19:54:33.816 INFO:teuthology.orchestra.run.smithi101.stdout: }, 2023-08-01T19:54:33.816 INFO:teuthology.orchestra.run.smithi101.stdout: { 2023-08-01T19:54:33.816 INFO:teuthology.orchestra.run.smithi101.stdout: "event": "reached_pg", 2023-08-01T19:54:33.816 INFO:teuthology.orchestra.run.smithi101.stdout: "time": "2023-08-01T19:54:04.471511+0000", 2023-08-01T19:54:33.816 INFO:teuthology.orchestra.run.smithi101.stdout: "duration": 0.012473039999999999 2023-08-01T19:54:33.817 INFO:teuthology.orchestra.run.smithi101.stdout: }, 2023-08-01T19:54:33.817 INFO:teuthology.orchestra.run.smithi101.stdout: { 2023-08-01T19:54:33.817 INFO:teuthology.orchestra.run.smithi101.stdout: "event": "started", 2023-08-01T19:54:33.817 INFO:teuthology.orchestra.run.smithi101.stdout: "time": "2023-08-01T19:54:04.472086+0000", 2023-08-01T19:54:33.817 INFO:teuthology.orchestra.run.smithi101.stdout: "duration": 0.00057491699999999998 2023-08-01T19:54:33.817 INFO:teuthology.orchestra.run.smithi101.stdout: }, 2023-08-01T19:54:33.817 INFO:teuthology.orchestra.run.smithi101.stdout: { 2023-08-01T19:54:33.817 INFO:teuthology.orchestra.run.smithi101.stdout: "event": "waiting for subops from 2", 2023-08-01T19:54:33.818 INFO:teuthology.orchestra.run.smithi101.stdout: "time": "2023-08-01T19:54:04.472310+0000", 2023-08-01T19:54:33.818 INFO:teuthology.orchestra.run.smithi101.stdout: "duration": 0.00022396499999999999 2023-08-01T19:54:33.818 INFO:teuthology.orchestra.run.smithi101.stdout: }, 2023-08-01T19:54:33.818 INFO:teuthology.orchestra.run.smithi101.stdout: { 2023-08-01T19:54:33.818 INFO:teuthology.orchestra.run.smithi101.stdout: "event": "op_commit", 2023-08-01T19:54:33.818 INFO:teuthology.orchestra.run.smithi101.stdout: "time": "2023-08-01T19:54:04.478141+0000", 2023-08-01T19:54:33.818 INFO:teuthology.orchestra.run.smithi101.stdout: "duration": 0.0058312320000000004 2023-08-01T19:54:33.818 INFO:teuthology.orchestra.run.smithi101.stdout: }, 2023-08-01T19:54:33.819 INFO:teuthology.orchestra.run.smithi101.stdout: { 2023-08-01T19:54:33.819 INFO:teuthology.orchestra.run.smithi101.stdout: "event": "sub_op_commit_rec", 2023-08-01T19:54:33.819 INFO:teuthology.orchestra.run.smithi101.stdout: "time": "2023-08-01T19:54:04.478543+0000", 2023-08-01T19:54:33.819 INFO:teuthology.orchestra.run.smithi101.stdout: "duration": 0.00040160800000000002 2023-08-01T19:54:33.819 INFO:teuthology.orchestra.run.smithi101.stdout: }, 2023-08-01T19:54:33.819 INFO:teuthology.orchestra.run.smithi101.stdout: { 2023-08-01T19:54:33.819 INFO:teuthology.orchestra.run.smithi101.stdout: "event": "commit_sent", 2023-08-01T19:54:33.819 INFO:teuthology.orchestra.run.smithi101.stdout: "time": "2023-08-01T19:54:04.478584+0000", 2023-08-01T19:54:33.820 INFO:teuthology.orchestra.run.smithi101.stdout: "duration": 4.0989999999999999e-05 2023-08-01T19:54:33.820 INFO:teuthology.orchestra.run.smithi101.stdout: }, 2023-08-01T19:54:33.820 INFO:teuthology.orchestra.run.smithi101.stdout: { 2023-08-01T19:54:33.820 INFO:teuthology.orchestra.run.smithi101.stdout: "event": "done", 2023-08-01T19:54:33.820 INFO:teuthology.orchestra.run.smithi101.stdout: "time": "2023-08-01T19:54:04.478605+0000", 2023-08-01T19:54:33.820 INFO:teuthology.orchestra.run.smithi101.stdout: "duration": 2.1178e-05 2023-08-01T19:54:33.820 INFO:teuthology.orchestra.run.smithi101.stdout: } 2023-08-01T19:54:33.820 INFO:teuthology.orchestra.run.smithi101.stdout: ] 2023-08-01T19:54:33.821 INFO:teuthology.orchestra.run.smithi101.stdout: } 2023-08-01T19:54:33.821 INFO:teuthology.orchestra.run.smithi101.stdout: }, 2023-08-01T19:54:33.821 INFO:teuthology.orchestra.run.smithi101.stdout: { 2023-08-01T19:54:33.821 INFO:teuthology.orchestra.run.smithi101.stdout: "description": "osd_op(mds.0.3:12 3.10 3:0d89b25e:::603.00000000:head [omap-set-header] snapc 0=[] ondisk+write+known_if_redirected+full_force+supports_pool_eio e17)", 2023-08-01T19:54:33.821 INFO:teuthology.orchestra.run.smithi101.stdout: "initiated_at": "2023-08-01T19:54:04.458982+0000", 2023-08-01T19:54:33.821 INFO:teuthology.orchestra.run.smithi101.stdout: "age": 29.291978407999999, 2023-08-01T19:54:33.821 INFO:teuthology.orchestra.run.smithi101.stdout: "duration": 0.021266334000000001, 2023-08-01T19:54:33.821 INFO:teuthology.orchestra.run.smithi101.stdout: "type_data": { 2023-08-01T19:54:33.822 INFO:teuthology.orchestra.run.smithi101.stdout: "flag_point": "commit sent; apply or cleanup", 2023-08-01T19:54:33.822 INFO:teuthology.orchestra.run.smithi101.stdout: "events": [ 2023-08-01T19:54:33.822 INFO:teuthology.orchestra.run.smithi101.stdout: { 2023-08-01T19:54:33.822 INFO:teuthology.orchestra.run.smithi101.stdout: "event": "initiated", 2023-08-01T19:54:33.822 INFO:teuthology.orchestra.run.smithi101.stdout: "time": "2023-08-01T19:54:04.458982+0000", 2023-08-01T19:54:33.822 INFO:teuthology.orchestra.run.smithi101.stdout: "duration": 0 2023-08-01T19:54:33.822 INFO:teuthology.orchestra.run.smithi101.stdout: }, 2023-08-01T19:54:33.823 INFO:teuthology.orchestra.run.smithi101.stdout: { 2023-08-01T19:54:33.823 INFO:teuthology.orchestra.run.smithi101.stdout: "event": "throttled", 2023-08-01T19:54:33.823 INFO:teuthology.orchestra.run.smithi101.stdout: "time": "2023-08-01T19:54:04.458982+0000", 2023-08-01T19:54:33.823 INFO:teuthology.orchestra.run.smithi101.stdout: "duration": 0 2023-08-01T19:54:33.823 INFO:teuthology.orchestra.run.smithi101.stdout: }, 2023-08-01T19:54:33.823 INFO:teuthology.orchestra.run.smithi101.stdout: { 2023-08-01T19:54:33.823 INFO:teuthology.orchestra.run.smithi101.stdout: "event": "header_read", 2023-08-01T19:54:33.823 INFO:teuthology.orchestra.run.smithi101.stdout: "time": "2023-08-01T19:54:04.458982+0000", 2023-08-01T19:54:33.824 INFO:teuthology.orchestra.run.smithi101.stdout: "duration": 4294967295.9999995 2023-08-01T19:54:33.824 INFO:teuthology.orchestra.run.smithi101.stdout: }, 2023-08-01T19:54:33.824 INFO:teuthology.orchestra.run.smithi101.stdout: { 2023-08-01T19:54:33.824 INFO:teuthology.orchestra.run.smithi101.stdout: "event": "all_read", 2023-08-01T19:54:33.824 INFO:teuthology.orchestra.run.smithi101.stdout: "time": "2023-08-01T19:54:04.458985+0000", 2023-08-01T19:54:33.824 INFO:teuthology.orchestra.run.smithi101.stdout: "duration": 3.4800000000000001e-06 2023-08-01T19:54:33.824 INFO:teuthology.orchestra.run.smithi101.stdout: }, 2023-08-01T19:54:33.824 INFO:teuthology.orchestra.run.smithi101.stdout: { 2023-08-01T19:54:33.825 INFO:teuthology.orchestra.run.smithi101.stdout: "event": "dispatched", 2023-08-01T19:54:33.825 INFO:teuthology.orchestra.run.smithi101.stdout: "time": "2023-08-01T19:54:04.458992+0000", 2023-08-01T19:54:33.825 INFO:teuthology.orchestra.run.smithi101.stdout: "duration": 7.306e-06 2023-08-01T19:54:33.825 INFO:teuthology.orchestra.run.smithi101.stdout: }, 2023-08-01T19:54:33.825 INFO:teuthology.orchestra.run.smithi101.stdout: { 2023-08-01T19:54:33.825 INFO:teuthology.orchestra.run.smithi101.stdout: "event": "queued_for_pg", 2023-08-01T19:54:33.825 INFO:teuthology.orchestra.run.smithi101.stdout: "time": "2023-08-01T19:54:04.458997+0000", 2023-08-01T19:54:33.825 INFO:teuthology.orchestra.run.smithi101.stdout: "duration": 4.4530000000000004e-06 2023-08-01T19:54:33.826 INFO:teuthology.orchestra.run.smithi101.stdout: }, 2023-08-01T19:54:33.826 INFO:teuthology.orchestra.run.smithi101.stdout: { 2023-08-01T19:54:33.826 INFO:teuthology.orchestra.run.smithi101.stdout: "event": "reached_pg", 2023-08-01T19:54:33.826 INFO:teuthology.orchestra.run.smithi101.stdout: "time": "2023-08-01T19:54:04.459060+0000", 2023-08-01T19:54:33.826 INFO:teuthology.orchestra.run.smithi101.stdout: "duration": 6.3249000000000004e-05 2023-08-01T19:54:33.826 INFO:teuthology.orchestra.run.smithi101.stdout: }, 2023-08-01T19:54:33.826 INFO:teuthology.orchestra.run.smithi101.stdout: { 2023-08-01T19:54:33.826 INFO:teuthology.orchestra.run.smithi101.stdout: "event": "waiting_for_map not empty", 2023-08-01T19:54:33.827 INFO:teuthology.orchestra.run.smithi101.stdout: "time": "2023-08-01T19:54:04.459063+0000", 2023-08-01T19:54:33.827 INFO:teuthology.orchestra.run.smithi101.stdout: "duration": 2.717e-06 2023-08-01T19:54:33.827 INFO:teuthology.orchestra.run.smithi101.stdout: }, 2023-08-01T19:54:33.827 INFO:teuthology.orchestra.run.smithi101.stdout: { 2023-08-01T19:54:33.827 INFO:teuthology.orchestra.run.smithi101.stdout: "event": "reached_pg", 2023-08-01T19:54:33.827 INFO:teuthology.orchestra.run.smithi101.stdout: "time": "2023-08-01T19:54:04.473625+0000", 2023-08-01T19:54:33.827 INFO:teuthology.orchestra.run.smithi101.stdout: "duration": 0.014562007 2023-08-01T19:54:33.827 INFO:teuthology.orchestra.run.smithi101.stdout: }, 2023-08-01T19:54:33.828 INFO:teuthology.orchestra.run.smithi101.stdout: { 2023-08-01T19:54:33.828 INFO:teuthology.orchestra.run.smithi101.stdout: "event": "started", 2023-08-01T19:54:33.828 INFO:teuthology.orchestra.run.smithi101.stdout: "time": "2023-08-01T19:54:04.473757+0000", 2023-08-01T19:54:33.828 INFO:teuthology.orchestra.run.smithi101.stdout: "duration": 0.00013238599999999999 2023-08-01T19:54:33.828 INFO:teuthology.orchestra.run.smithi101.stdout: }, 2023-08-01T19:54:33.828 INFO:teuthology.orchestra.run.smithi101.stdout: { 2023-08-01T19:54:33.828 INFO:teuthology.orchestra.run.smithi101.stdout: "event": "waiting for subops from 2", 2023-08-01T19:54:33.829 INFO:teuthology.orchestra.run.smithi101.stdout: "time": "2023-08-01T19:54:04.473898+0000", 2023-08-01T19:54:33.829 INFO:teuthology.orchestra.run.smithi101.stdout: "duration": 0.00014039 2023-08-01T19:54:33.829 INFO:teuthology.orchestra.run.smithi101.stdout: }, 2023-08-01T19:54:33.829 INFO:teuthology.orchestra.run.smithi101.stdout: { 2023-08-01T19:54:33.829 INFO:teuthology.orchestra.run.smithi101.stdout: "event": "op_commit", 2023-08-01T19:54:33.829 INFO:teuthology.orchestra.run.smithi101.stdout: "time": "2023-08-01T19:54:04.478380+0000", 2023-08-01T19:54:33.829 INFO:teuthology.orchestra.run.smithi101.stdout: "duration": 0.0044827449999999998 2023-08-01T19:54:33.829 INFO:teuthology.orchestra.run.smithi101.stdout: }, 2023-08-01T19:54:33.830 INFO:teuthology.orchestra.run.smithi101.stdout: { 2023-08-01T19:54:33.830 INFO:teuthology.orchestra.run.smithi101.stdout: "event": "sub_op_commit_rec", 2023-08-01T19:54:33.830 INFO:teuthology.orchestra.run.smithi101.stdout: "time": "2023-08-01T19:54:04.480169+0000", 2023-08-01T19:54:33.830 INFO:teuthology.orchestra.run.smithi101.stdout: "duration": 0.0017886040000000001 2023-08-01T19:54:33.830 INFO:teuthology.orchestra.run.smithi101.stdout: }, 2023-08-01T19:54:33.830 INFO:teuthology.orchestra.run.smithi101.stdout: { 2023-08-01T19:54:33.830 INFO:teuthology.orchestra.run.smithi101.stdout: "event": "commit_sent", 2023-08-01T19:54:33.830 INFO:teuthology.orchestra.run.smithi101.stdout: "time": "2023-08-01T19:54:04.480212+0000", 2023-08-01T19:54:33.831 INFO:teuthology.orchestra.run.smithi101.stdout: "duration": 4.2687e-05 2023-08-01T19:54:33.831 INFO:teuthology.orchestra.run.smithi101.stdout: }, 2023-08-01T19:54:33.831 INFO:teuthology.orchestra.run.smithi101.stdout: { 2023-08-01T19:54:33.831 INFO:teuthology.orchestra.run.smithi101.stdout: "event": "done", 2023-08-01T19:54:33.831 INFO:teuthology.orchestra.run.smithi101.stdout: "time": "2023-08-01T19:54:04.480248+0000", 2023-08-01T19:54:33.831 INFO:teuthology.orchestra.run.smithi101.stdout: "duration": 3.6743999999999999e-05 2023-08-01T19:54:33.831 INFO:teuthology.orchestra.run.smithi101.stdout: } 2023-08-01T19:54:33.831 INFO:teuthology.orchestra.run.smithi101.stdout: ] 2023-08-01T19:54:33.832 INFO:teuthology.orchestra.run.smithi101.stdout: } 2023-08-01T19:54:33.832 INFO:teuthology.orchestra.run.smithi101.stdout: }, 2023-08-01T19:54:33.832 INFO:teuthology.orchestra.run.smithi101.stdout: { 2023-08-01T19:54:33.832 INFO:teuthology.orchestra.run.smithi101.stdout: "description": "osd_op(mds.0.3:13 3.10 3:0d89b25e:::603.00000000:head [create,setxattr parent (62) in=6b,setxattr layout (30) in=6b] snapc 0=[] ondisk+write+known_if_redirected+full_force+supports_pool_eio e17)", 2023-08-01T19:54:33.832 INFO:teuthology.orchestra.run.smithi101.stdout: "initiated_at": "2023-08-01T19:54:04.459010+0000", 2023-08-01T19:54:33.832 INFO:teuthology.orchestra.run.smithi101.stdout: "age": 29.291950688, 2023-08-01T19:54:33.832 INFO:teuthology.orchestra.run.smithi101.stdout: "duration": 0.021327220000000001, 2023-08-01T19:54:33.832 INFO:teuthology.orchestra.run.smithi101.stdout: "type_data": { 2023-08-01T19:54:33.833 INFO:teuthology.orchestra.run.smithi101.stdout: "flag_point": "commit sent; apply or cleanup", 2023-08-01T19:54:33.833 INFO:teuthology.orchestra.run.smithi101.stdout: "events": [ 2023-08-01T19:54:33.833 INFO:teuthology.orchestra.run.smithi101.stdout: { 2023-08-01T19:54:33.833 INFO:teuthology.orchestra.run.smithi101.stdout: "event": "initiated", 2023-08-01T19:54:33.833 INFO:teuthology.orchestra.run.smithi101.stdout: "time": "2023-08-01T19:54:04.459010+0000", 2023-08-01T19:54:33.833 INFO:teuthology.orchestra.run.smithi101.stdout: "duration": 0 2023-08-01T19:54:33.833 INFO:teuthology.orchestra.run.smithi101.stdout: }, 2023-08-01T19:54:33.834 INFO:teuthology.orchestra.run.smithi101.stdout: { 2023-08-01T19:54:33.834 INFO:teuthology.orchestra.run.smithi101.stdout: "event": "throttled", 2023-08-01T19:54:33.834 INFO:teuthology.orchestra.run.smithi101.stdout: "time": "2023-08-01T19:54:04.459010+0000", 2023-08-01T19:54:33.834 INFO:teuthology.orchestra.run.smithi101.stdout: "duration": 0 2023-08-01T19:54:33.834 INFO:teuthology.orchestra.run.smithi101.stdout: }, 2023-08-01T19:54:33.834 INFO:teuthology.orchestra.run.smithi101.stdout: { 2023-08-01T19:54:33.834 INFO:teuthology.orchestra.run.smithi101.stdout: "event": "header_read", 2023-08-01T19:54:33.834 INFO:teuthology.orchestra.run.smithi101.stdout: "time": "2023-08-01T19:54:04.459009+0000", 2023-08-01T19:54:33.835 INFO:teuthology.orchestra.run.smithi101.stdout: "duration": 4294967295.9999995 2023-08-01T19:54:33.835 INFO:teuthology.orchestra.run.smithi101.stdout: }, 2023-08-01T19:54:33.835 INFO:teuthology.orchestra.run.smithi101.stdout: { 2023-08-01T19:54:33.835 INFO:teuthology.orchestra.run.smithi101.stdout: "event": "all_read", 2023-08-01T19:54:33.835 INFO:teuthology.orchestra.run.smithi101.stdout: "time": "2023-08-01T19:54:04.459013+0000", 2023-08-01T19:54:33.835 INFO:teuthology.orchestra.run.smithi101.stdout: "duration": 3.8929999999999998e-06 2023-08-01T19:54:33.835 INFO:teuthology.orchestra.run.smithi101.stdout: }, 2023-08-01T19:54:33.835 INFO:teuthology.orchestra.run.smithi101.stdout: { 2023-08-01T19:54:33.836 INFO:teuthology.orchestra.run.smithi101.stdout: "event": "dispatched", 2023-08-01T19:54:33.836 INFO:teuthology.orchestra.run.smithi101.stdout: "time": "2023-08-01T19:54:04.459027+0000", 2023-08-01T19:54:33.836 INFO:teuthology.orchestra.run.smithi101.stdout: "duration": 1.3416e-05 2023-08-01T19:54:33.836 INFO:teuthology.orchestra.run.smithi101.stdout: }, 2023-08-01T19:54:33.836 INFO:teuthology.orchestra.run.smithi101.stdout: { 2023-08-01T19:54:33.836 INFO:teuthology.orchestra.run.smithi101.stdout: "event": "queued_for_pg", 2023-08-01T19:54:33.836 INFO:teuthology.orchestra.run.smithi101.stdout: "time": "2023-08-01T19:54:04.459033+0000", 2023-08-01T19:54:33.836 INFO:teuthology.orchestra.run.smithi101.stdout: "duration": 5.9800000000000003e-06 2023-08-01T19:54:33.837 INFO:teuthology.orchestra.run.smithi101.stdout: }, 2023-08-01T19:54:33.837 INFO:teuthology.orchestra.run.smithi101.stdout: { 2023-08-01T19:54:33.837 INFO:teuthology.orchestra.run.smithi101.stdout: "event": "reached_pg", 2023-08-01T19:54:33.837 INFO:teuthology.orchestra.run.smithi101.stdout: "time": "2023-08-01T19:54:04.459099+0000", 2023-08-01T19:54:33.837 INFO:teuthology.orchestra.run.smithi101.stdout: "duration": 6.6192999999999995e-05 2023-08-01T19:54:33.837 INFO:teuthology.orchestra.run.smithi101.stdout: }, 2023-08-01T19:54:33.837 INFO:teuthology.orchestra.run.smithi101.stdout: { 2023-08-01T19:54:33.837 INFO:teuthology.orchestra.run.smithi101.stdout: "event": "waiting_for_map not empty", 2023-08-01T19:54:33.838 INFO:teuthology.orchestra.run.smithi101.stdout: "time": "2023-08-01T19:54:04.459106+0000", 2023-08-01T19:54:33.838 INFO:teuthology.orchestra.run.smithi101.stdout: "duration": 6.8619999999999997e-06 2023-08-01T19:54:33.838 INFO:teuthology.orchestra.run.smithi101.stdout: }, 2023-08-01T19:54:33.838 INFO:teuthology.orchestra.run.smithi101.stdout: { 2023-08-01T19:54:33.838 INFO:teuthology.orchestra.run.smithi101.stdout: "event": "reached_pg", 2023-08-01T19:54:33.838 INFO:teuthology.orchestra.run.smithi101.stdout: "time": "2023-08-01T19:54:04.475182+0000", 2023-08-01T19:54:33.838 INFO:teuthology.orchestra.run.smithi101.stdout: "duration": 0.016076333000000002 2023-08-01T19:54:33.838 INFO:teuthology.orchestra.run.smithi101.stdout: }, 2023-08-01T19:54:33.839 INFO:teuthology.orchestra.run.smithi101.stdout: { 2023-08-01T19:54:33.839 INFO:teuthology.orchestra.run.smithi101.stdout: "event": "started", 2023-08-01T19:54:33.839 INFO:teuthology.orchestra.run.smithi101.stdout: "time": "2023-08-01T19:54:04.475353+0000", 2023-08-01T19:54:33.839 INFO:teuthology.orchestra.run.smithi101.stdout: "duration": 0.000171378 2023-08-01T19:54:33.839 INFO:teuthology.orchestra.run.smithi101.stdout: }, 2023-08-01T19:54:33.839 INFO:teuthology.orchestra.run.smithi101.stdout: { 2023-08-01T19:54:33.839 INFO:teuthology.orchestra.run.smithi101.stdout: "event": "waiting for subops from 2", 2023-08-01T19:54:33.839 INFO:teuthology.orchestra.run.smithi101.stdout: "time": "2023-08-01T19:54:04.475793+0000", 2023-08-01T19:54:33.840 INFO:teuthology.orchestra.run.smithi101.stdout: "duration": 0.000440123 2023-08-01T19:54:33.840 INFO:teuthology.orchestra.run.smithi101.stdout: }, 2023-08-01T19:54:33.840 INFO:teuthology.orchestra.run.smithi101.stdout: { 2023-08-01T19:54:33.840 INFO:teuthology.orchestra.run.smithi101.stdout: "event": "op_commit", 2023-08-01T19:54:33.840 INFO:teuthology.orchestra.run.smithi101.stdout: "time": "2023-08-01T19:54:04.478624+0000", 2023-08-01T19:54:33.840 INFO:teuthology.orchestra.run.smithi101.stdout: "duration": 0.0028305000000000001 2023-08-01T19:54:33.840 INFO:teuthology.orchestra.run.smithi101.stdout: }, 2023-08-01T19:54:33.841 INFO:teuthology.orchestra.run.smithi101.stdout: { 2023-08-01T19:54:33.841 INFO:teuthology.orchestra.run.smithi101.stdout: "event": "sub_op_commit_rec", 2023-08-01T19:54:33.841 INFO:teuthology.orchestra.run.smithi101.stdout: "time": "2023-08-01T19:54:04.480291+0000", 2023-08-01T19:54:33.841 INFO:teuthology.orchestra.run.smithi101.stdout: "duration": 0.0016670000000000001 2023-08-01T19:54:33.841 INFO:teuthology.orchestra.run.smithi101.stdout: }, 2023-08-01T19:54:33.841 INFO:teuthology.orchestra.run.smithi101.stdout: { 2023-08-01T19:54:33.841 INFO:teuthology.orchestra.run.smithi101.stdout: "event": "commit_sent", 2023-08-01T19:54:33.841 INFO:teuthology.orchestra.run.smithi101.stdout: "time": "2023-08-01T19:54:04.480318+0000", 2023-08-01T19:54:33.842 INFO:teuthology.orchestra.run.smithi101.stdout: "duration": 2.6815e-05 2023-08-01T19:54:33.842 INFO:teuthology.orchestra.run.smithi101.stdout: }, 2023-08-01T19:54:33.842 INFO:teuthology.orchestra.run.smithi101.stdout: { 2023-08-01T19:54:33.842 INFO:teuthology.orchestra.run.smithi101.stdout: "event": "done", 2023-08-01T19:54:33.842 INFO:teuthology.orchestra.run.smithi101.stdout: "time": "2023-08-01T19:54:04.480337+0000", 2023-08-01T19:54:33.842 INFO:teuthology.orchestra.run.smithi101.stdout: "duration": 1.9241000000000001e-05 2023-08-01T19:54:33.842 INFO:teuthology.orchestra.run.smithi101.stdout: } 2023-08-01T19:54:33.842 INFO:teuthology.orchestra.run.smithi101.stdout: ] 2023-08-01T19:54:33.843 INFO:teuthology.orchestra.run.smithi101.stdout: } 2023-08-01T19:54:33.843 INFO:teuthology.orchestra.run.smithi101.stdout: }, 2023-08-01T19:54:33.843 INFO:teuthology.orchestra.run.smithi101.stdout: { 2023-08-01T19:54:33.843 INFO:teuthology.orchestra.run.smithi101.stdout: "description": "osd_op(mds.0.3:18 3.14 3:2f55791f:::606.00000000:head [omap-set-header] snapc 0=[] ondisk+write+known_if_redirected+full_force+supports_pool_eio e17)", 2023-08-01T19:54:33.843 INFO:teuthology.orchestra.run.smithi101.stdout: "initiated_at": "2023-08-01T19:54:04.459039+0000", 2023-08-01T19:54:33.843 INFO:teuthology.orchestra.run.smithi101.stdout: "age": 29.291921393999999, 2023-08-01T19:54:33.843 INFO:teuthology.orchestra.run.smithi101.stdout: "duration": 0.018756419, 2023-08-01T19:54:33.843 INFO:teuthology.orchestra.run.smithi101.stdout: "type_data": { 2023-08-01T19:54:33.844 INFO:teuthology.orchestra.run.smithi101.stdout: "flag_point": "commit sent; apply or cleanup", 2023-08-01T19:54:33.844 INFO:teuthology.orchestra.run.smithi101.stdout: "events": [ 2023-08-01T19:54:33.844 INFO:teuthology.orchestra.run.smithi101.stdout: { 2023-08-01T19:54:33.844 INFO:teuthology.orchestra.run.smithi101.stdout: "event": "initiated", 2023-08-01T19:54:33.844 INFO:teuthology.orchestra.run.smithi101.stdout: "time": "2023-08-01T19:54:04.459039+0000", 2023-08-01T19:54:33.844 INFO:teuthology.orchestra.run.smithi101.stdout: "duration": 0 2023-08-01T19:54:33.844 INFO:teuthology.orchestra.run.smithi101.stdout: }, 2023-08-01T19:54:33.844 INFO:teuthology.orchestra.run.smithi101.stdout: { 2023-08-01T19:54:33.845 INFO:teuthology.orchestra.run.smithi101.stdout: "event": "throttled", 2023-08-01T19:54:33.845 INFO:teuthology.orchestra.run.smithi101.stdout: "time": "2023-08-01T19:54:04.459039+0000", 2023-08-01T19:54:33.845 INFO:teuthology.orchestra.run.smithi101.stdout: "duration": 0 2023-08-01T19:54:33.845 INFO:teuthology.orchestra.run.smithi101.stdout: }, 2023-08-01T19:54:33.845 INFO:teuthology.orchestra.run.smithi101.stdout: { 2023-08-01T19:54:33.845 INFO:teuthology.orchestra.run.smithi101.stdout: "event": "header_read", 2023-08-01T19:54:33.845 INFO:teuthology.orchestra.run.smithi101.stdout: "time": "2023-08-01T19:54:04.459039+0000", 2023-08-01T19:54:33.846 INFO:teuthology.orchestra.run.smithi101.stdout: "duration": 4294967295.9999995 2023-08-01T19:54:33.846 INFO:teuthology.orchestra.run.smithi101.stdout: }, 2023-08-01T19:54:33.846 INFO:teuthology.orchestra.run.smithi101.stdout: { 2023-08-01T19:54:33.846 INFO:teuthology.orchestra.run.smithi101.stdout: "event": "all_read", 2023-08-01T19:54:33.846 INFO:teuthology.orchestra.run.smithi101.stdout: "time": "2023-08-01T19:54:04.459043+0000", 2023-08-01T19:54:33.846 INFO:teuthology.orchestra.run.smithi101.stdout: "duration": 4.1500000000000001e-06 2023-08-01T19:54:33.846 INFO:teuthology.orchestra.run.smithi101.stdout: }, 2023-08-01T19:54:33.846 INFO:teuthology.orchestra.run.smithi101.stdout: { 2023-08-01T19:54:33.847 INFO:teuthology.orchestra.run.smithi101.stdout: "event": "dispatched", 2023-08-01T19:54:33.847 INFO:teuthology.orchestra.run.smithi101.stdout: "time": "2023-08-01T19:54:04.459051+0000", 2023-08-01T19:54:33.847 INFO:teuthology.orchestra.run.smithi101.stdout: "duration": 8.4190000000000002e-06 2023-08-01T19:54:33.847 INFO:teuthology.orchestra.run.smithi101.stdout: }, 2023-08-01T19:54:33.847 INFO:teuthology.orchestra.run.smithi101.stdout: { 2023-08-01T19:54:33.847 INFO:teuthology.orchestra.run.smithi101.stdout: "event": "queued_for_pg", 2023-08-01T19:54:33.847 INFO:teuthology.orchestra.run.smithi101.stdout: "time": "2023-08-01T19:54:04.459056+0000", 2023-08-01T19:54:33.847 INFO:teuthology.orchestra.run.smithi101.stdout: "duration": 5.339e-06 2023-08-01T19:54:33.848 INFO:teuthology.orchestra.run.smithi101.stdout: }, 2023-08-01T19:54:33.848 INFO:teuthology.orchestra.run.smithi101.stdout: { 2023-08-01T19:54:33.848 INFO:teuthology.orchestra.run.smithi101.stdout: "event": "reached_pg", 2023-08-01T19:54:33.848 INFO:teuthology.orchestra.run.smithi101.stdout: "time": "2023-08-01T19:54:04.459091+0000", 2023-08-01T19:54:33.848 INFO:teuthology.orchestra.run.smithi101.stdout: "duration": 3.4090000000000001e-05 2023-08-01T19:54:33.848 INFO:teuthology.orchestra.run.smithi101.stdout: }, 2023-08-01T19:54:33.848 INFO:teuthology.orchestra.run.smithi101.stdout: { 2023-08-01T19:54:33.848 INFO:teuthology.orchestra.run.smithi101.stdout: "event": "op must wait for map", 2023-08-01T19:54:33.849 INFO:teuthology.orchestra.run.smithi101.stdout: "time": "2023-08-01T19:54:04.459094+0000", 2023-08-01T19:54:33.849 INFO:teuthology.orchestra.run.smithi101.stdout: "duration": 3.303e-06 2023-08-01T19:54:33.849 INFO:teuthology.orchestra.run.smithi101.stdout: }, 2023-08-01T19:54:33.849 INFO:teuthology.orchestra.run.smithi101.stdout: { 2023-08-01T19:54:33.849 INFO:teuthology.orchestra.run.smithi101.stdout: "event": "reached_pg", 2023-08-01T19:54:33.849 INFO:teuthology.orchestra.run.smithi101.stdout: "time": "2023-08-01T19:54:04.469860+0000", 2023-08-01T19:54:33.849 INFO:teuthology.orchestra.run.smithi101.stdout: "duration": 0.010765749 2023-08-01T19:54:33.849 INFO:teuthology.orchestra.run.smithi101.stdout: }, 2023-08-01T19:54:33.850 INFO:teuthology.orchestra.run.smithi101.stdout: { 2023-08-01T19:54:33.850 INFO:teuthology.orchestra.run.smithi101.stdout: "event": "started", 2023-08-01T19:54:33.850 INFO:teuthology.orchestra.run.smithi101.stdout: "time": "2023-08-01T19:54:04.470008+0000", 2023-08-01T19:54:33.850 INFO:teuthology.orchestra.run.smithi101.stdout: "duration": 0.000148367 2023-08-01T19:54:33.850 INFO:teuthology.orchestra.run.smithi101.stdout: }, 2023-08-01T19:54:33.850 INFO:teuthology.orchestra.run.smithi101.stdout: { 2023-08-01T19:54:33.850 INFO:teuthology.orchestra.run.smithi101.stdout: "event": "waiting for subops from 2", 2023-08-01T19:54:33.850 INFO:teuthology.orchestra.run.smithi101.stdout: "time": "2023-08-01T19:54:04.470136+0000", 2023-08-01T19:54:33.851 INFO:teuthology.orchestra.run.smithi101.stdout: "duration": 0.000128329 2023-08-01T19:54:33.851 INFO:teuthology.orchestra.run.smithi101.stdout: }, 2023-08-01T19:54:33.851 INFO:teuthology.orchestra.run.smithi101.stdout: { 2023-08-01T19:54:33.851 INFO:teuthology.orchestra.run.smithi101.stdout: "event": "op_commit", 2023-08-01T19:54:33.851 INFO:teuthology.orchestra.run.smithi101.stdout: "time": "2023-08-01T19:54:04.476399+0000", 2023-08-01T19:54:33.851 INFO:teuthology.orchestra.run.smithi101.stdout: "duration": 0.0062627259999999997 2023-08-01T19:54:33.851 INFO:teuthology.orchestra.run.smithi101.stdout: }, 2023-08-01T19:54:33.852 INFO:teuthology.orchestra.run.smithi101.stdout: { 2023-08-01T19:54:33.852 INFO:teuthology.orchestra.run.smithi101.stdout: "event": "sub_op_commit_rec", 2023-08-01T19:54:33.852 INFO:teuthology.orchestra.run.smithi101.stdout: "time": "2023-08-01T19:54:04.477726+0000", 2023-08-01T19:54:33.852 INFO:teuthology.orchestra.run.smithi101.stdout: "duration": 0.001327103 2023-08-01T19:54:33.852 INFO:teuthology.orchestra.run.smithi101.stdout: }, 2023-08-01T19:54:33.852 INFO:teuthology.orchestra.run.smithi101.stdout: { 2023-08-01T19:54:33.852 INFO:teuthology.orchestra.run.smithi101.stdout: "event": "commit_sent", 2023-08-01T19:54:33.852 INFO:teuthology.orchestra.run.smithi101.stdout: "time": "2023-08-01T19:54:04.477771+0000", 2023-08-01T19:54:33.853 INFO:teuthology.orchestra.run.smithi101.stdout: "duration": 4.5232000000000003e-05 2023-08-01T19:54:33.853 INFO:teuthology.orchestra.run.smithi101.stdout: }, 2023-08-01T19:54:33.853 INFO:teuthology.orchestra.run.smithi101.stdout: { 2023-08-01T19:54:33.853 INFO:teuthology.orchestra.run.smithi101.stdout: "event": "done", 2023-08-01T19:54:33.853 INFO:teuthology.orchestra.run.smithi101.stdout: "time": "2023-08-01T19:54:04.477795+0000", 2023-08-01T19:54:33.853 INFO:teuthology.orchestra.run.smithi101.stdout: "duration": 2.4134999999999998e-05 2023-08-01T19:54:33.853 INFO:teuthology.orchestra.run.smithi101.stdout: } 2023-08-01T19:54:33.853 INFO:teuthology.orchestra.run.smithi101.stdout: ] 2023-08-01T19:54:33.854 INFO:teuthology.orchestra.run.smithi101.stdout: } 2023-08-01T19:54:33.854 INFO:teuthology.orchestra.run.smithi101.stdout: }, 2023-08-01T19:54:33.854 INFO:teuthology.orchestra.run.smithi101.stdout: { 2023-08-01T19:54:33.854 INFO:teuthology.orchestra.run.smithi101.stdout: "description": "osd_op(mds.0.3:19 3.14 3:2f55791f:::606.00000000:head [create,setxattr parent (62) in=6b,setxattr layout (30) in=6b] snapc 0=[] ondisk+write+known_if_redirected+full_force+supports_pool_eio e17)", 2023-08-01T19:54:33.854 INFO:teuthology.orchestra.run.smithi101.stdout: "initiated_at": "2023-08-01T19:54:04.459069+0000", 2023-08-01T19:54:33.854 INFO:teuthology.orchestra.run.smithi101.stdout: "age": 29.291891359000001, 2023-08-01T19:54:33.854 INFO:teuthology.orchestra.run.smithi101.stdout: "duration": 0.019523045999999999, 2023-08-01T19:54:33.854 INFO:teuthology.orchestra.run.smithi101.stdout: "type_data": { 2023-08-01T19:54:33.855 INFO:teuthology.orchestra.run.smithi101.stdout: "flag_point": "commit sent; apply or cleanup", 2023-08-01T19:54:33.855 INFO:teuthology.orchestra.run.smithi101.stdout: "events": [ 2023-08-01T19:54:33.855 INFO:teuthology.orchestra.run.smithi101.stdout: { 2023-08-01T19:54:33.855 INFO:teuthology.orchestra.run.smithi101.stdout: "event": "initiated", 2023-08-01T19:54:33.855 INFO:teuthology.orchestra.run.smithi101.stdout: "time": "2023-08-01T19:54:04.459069+0000", 2023-08-01T19:54:33.855 INFO:teuthology.orchestra.run.smithi101.stdout: "duration": 0 2023-08-01T19:54:33.855 INFO:teuthology.orchestra.run.smithi101.stdout: }, 2023-08-01T19:54:33.855 INFO:teuthology.orchestra.run.smithi101.stdout: { 2023-08-01T19:54:33.856 INFO:teuthology.orchestra.run.smithi101.stdout: "event": "throttled", 2023-08-01T19:54:33.856 INFO:teuthology.orchestra.run.smithi101.stdout: "time": "2023-08-01T19:54:04.459069+0000", 2023-08-01T19:54:33.856 INFO:teuthology.orchestra.run.smithi101.stdout: "duration": 0 2023-08-01T19:54:33.856 INFO:teuthology.orchestra.run.smithi101.stdout: }, 2023-08-01T19:54:33.856 INFO:teuthology.orchestra.run.smithi101.stdout: { 2023-08-01T19:54:33.856 INFO:teuthology.orchestra.run.smithi101.stdout: "event": "header_read", 2023-08-01T19:54:33.856 INFO:teuthology.orchestra.run.smithi101.stdout: "time": "2023-08-01T19:54:04.459069+0000", 2023-08-01T19:54:33.856 INFO:teuthology.orchestra.run.smithi101.stdout: "duration": 4294967295.9999995 2023-08-01T19:54:33.857 INFO:teuthology.orchestra.run.smithi101.stdout: }, 2023-08-01T19:54:33.857 INFO:teuthology.orchestra.run.smithi101.stdout: { 2023-08-01T19:54:33.857 INFO:teuthology.orchestra.run.smithi101.stdout: "event": "all_read", 2023-08-01T19:54:33.857 INFO:teuthology.orchestra.run.smithi101.stdout: "time": "2023-08-01T19:54:04.459072+0000", 2023-08-01T19:54:33.857 INFO:teuthology.orchestra.run.smithi101.stdout: "duration": 3.4570000000000001e-06 2023-08-01T19:54:33.857 INFO:teuthology.orchestra.run.smithi101.stdout: }, 2023-08-01T19:54:33.857 INFO:teuthology.orchestra.run.smithi101.stdout: { 2023-08-01T19:54:33.858 INFO:teuthology.orchestra.run.smithi101.stdout: "event": "dispatched", 2023-08-01T19:54:33.858 INFO:teuthology.orchestra.run.smithi101.stdout: "time": "2023-08-01T19:54:04.459080+0000", 2023-08-01T19:54:33.858 INFO:teuthology.orchestra.run.smithi101.stdout: "duration": 7.6009999999999997e-06 2023-08-01T19:54:33.858 INFO:teuthology.orchestra.run.smithi101.stdout: }, 2023-08-01T19:54:33.858 INFO:teuthology.orchestra.run.smithi101.stdout: { 2023-08-01T19:54:33.858 INFO:teuthology.orchestra.run.smithi101.stdout: "event": "queued_for_pg", 2023-08-01T19:54:33.858 INFO:teuthology.orchestra.run.smithi101.stdout: "time": "2023-08-01T19:54:04.459088+0000", 2023-08-01T19:54:33.858 INFO:teuthology.orchestra.run.smithi101.stdout: "duration": 8.0509999999999997e-06 2023-08-01T19:54:33.859 INFO:teuthology.orchestra.run.smithi101.stdout: }, 2023-08-01T19:54:33.859 INFO:teuthology.orchestra.run.smithi101.stdout: { 2023-08-01T19:54:33.859 INFO:teuthology.orchestra.run.smithi101.stdout: "event": "reached_pg", 2023-08-01T19:54:33.859 INFO:teuthology.orchestra.run.smithi101.stdout: "time": "2023-08-01T19:54:04.459120+0000", 2023-08-01T19:54:33.859 INFO:teuthology.orchestra.run.smithi101.stdout: "duration": 3.2078e-05 2023-08-01T19:54:33.859 INFO:teuthology.orchestra.run.smithi101.stdout: }, 2023-08-01T19:54:33.859 INFO:teuthology.orchestra.run.smithi101.stdout: { 2023-08-01T19:54:33.859 INFO:teuthology.orchestra.run.smithi101.stdout: "event": "waiting_for_map not empty", 2023-08-01T19:54:33.860 INFO:teuthology.orchestra.run.smithi101.stdout: "time": "2023-08-01T19:54:04.459123+0000", 2023-08-01T19:54:33.860 INFO:teuthology.orchestra.run.smithi101.stdout: "duration": 3.4699999999999998e-06 2023-08-01T19:54:33.860 INFO:teuthology.orchestra.run.smithi101.stdout: }, 2023-08-01T19:54:33.860 INFO:teuthology.orchestra.run.smithi101.stdout: { 2023-08-01T19:54:33.860 INFO:teuthology.orchestra.run.smithi101.stdout: "event": "reached_pg", 2023-08-01T19:54:33.860 INFO:teuthology.orchestra.run.smithi101.stdout: "time": "2023-08-01T19:54:04.471352+0000", 2023-08-01T19:54:33.860 INFO:teuthology.orchestra.run.smithi101.stdout: "duration": 0.01222926 2023-08-01T19:54:33.860 INFO:teuthology.orchestra.run.smithi101.stdout: }, 2023-08-01T19:54:33.861 INFO:teuthology.orchestra.run.smithi101.stdout: { 2023-08-01T19:54:33.861 INFO:teuthology.orchestra.run.smithi101.stdout: "event": "started", 2023-08-01T19:54:33.861 INFO:teuthology.orchestra.run.smithi101.stdout: "time": "2023-08-01T19:54:04.471495+0000", 2023-08-01T19:54:33.861 INFO:teuthology.orchestra.run.smithi101.stdout: "duration": 0.00014263899999999999 2023-08-01T19:54:33.861 INFO:teuthology.orchestra.run.smithi101.stdout: }, 2023-08-01T19:54:33.861 INFO:teuthology.orchestra.run.smithi101.stdout: { 2023-08-01T19:54:33.861 INFO:teuthology.orchestra.run.smithi101.stdout: "event": "waiting for subops from 2", 2023-08-01T19:54:33.861 INFO:teuthology.orchestra.run.smithi101.stdout: "time": "2023-08-01T19:54:04.472368+0000", 2023-08-01T19:54:33.862 INFO:teuthology.orchestra.run.smithi101.stdout: "duration": 0.00087245300000000003 2023-08-01T19:54:33.862 INFO:teuthology.orchestra.run.smithi101.stdout: }, 2023-08-01T19:54:33.862 INFO:teuthology.orchestra.run.smithi101.stdout: { 2023-08-01T19:54:33.862 INFO:teuthology.orchestra.run.smithi101.stdout: "event": "op_commit", 2023-08-01T19:54:33.862 INFO:teuthology.orchestra.run.smithi101.stdout: "time": "2023-08-01T19:54:04.477612+0000", 2023-08-01T19:54:33.862 INFO:teuthology.orchestra.run.smithi101.stdout: "duration": 0.0052442809999999999 2023-08-01T19:54:33.862 INFO:teuthology.orchestra.run.smithi101.stdout: }, 2023-08-01T19:54:33.862 INFO:teuthology.orchestra.run.smithi101.stdout: { 2023-08-01T19:54:33.863 INFO:teuthology.orchestra.run.smithi101.stdout: "event": "sub_op_commit_rec", 2023-08-01T19:54:33.863 INFO:teuthology.orchestra.run.smithi101.stdout: "time": "2023-08-01T19:54:04.478516+0000", 2023-08-01T19:54:33.863 INFO:teuthology.orchestra.run.smithi101.stdout: "duration": 0.00090399800000000004 2023-08-01T19:54:33.863 INFO:teuthology.orchestra.run.smithi101.stdout: }, 2023-08-01T19:54:33.863 INFO:teuthology.orchestra.run.smithi101.stdout: { 2023-08-01T19:54:33.863 INFO:teuthology.orchestra.run.smithi101.stdout: "event": "commit_sent", 2023-08-01T19:54:33.863 INFO:teuthology.orchestra.run.smithi101.stdout: "time": "2023-08-01T19:54:04.478555+0000", 2023-08-01T19:54:33.863 INFO:teuthology.orchestra.run.smithi101.stdout: "duration": 3.8977000000000003e-05 2023-08-01T19:54:33.864 INFO:teuthology.orchestra.run.smithi101.stdout: }, 2023-08-01T19:54:33.864 INFO:teuthology.orchestra.run.smithi101.stdout: { 2023-08-01T19:54:33.864 INFO:teuthology.orchestra.run.smithi101.stdout: "event": "done", 2023-08-01T19:54:33.864 INFO:teuthology.orchestra.run.smithi101.stdout: "time": "2023-08-01T19:54:04.478592+0000", 2023-08-01T19:54:33.864 INFO:teuthology.orchestra.run.smithi101.stdout: "duration": 3.7287999999999999e-05 2023-08-01T19:54:33.864 INFO:teuthology.orchestra.run.smithi101.stdout: } 2023-08-01T19:54:33.864 INFO:teuthology.orchestra.run.smithi101.stdout: ] 2023-08-01T19:54:33.865 INFO:teuthology.orchestra.run.smithi101.stdout: } 2023-08-01T19:54:33.865 INFO:teuthology.orchestra.run.smithi101.stdout: }, 2023-08-01T19:54:33.865 INFO:teuthology.orchestra.run.smithi101.stdout: { 2023-08-01T19:54:33.865 INFO:teuthology.orchestra.run.smithi101.stdout: "description": "osd_op(mds.0.3:20 3.1c 3:3ed09add:::607.00000000:head [omap-set-header] snapc 0=[] ondisk+write+known_if_redirected+full_force+supports_pool_eio e17)", 2023-08-01T19:54:33.865 INFO:teuthology.orchestra.run.smithi101.stdout: "initiated_at": "2023-08-01T19:54:04.459097+0000", 2023-08-01T19:54:33.865 INFO:teuthology.orchestra.run.smithi101.stdout: "age": 29.291863655, 2023-08-01T19:54:33.865 INFO:teuthology.orchestra.run.smithi101.stdout: "duration": 0.018578978999999999, 2023-08-01T19:54:33.865 INFO:teuthology.orchestra.run.smithi101.stdout: "type_data": { 2023-08-01T19:54:33.866 INFO:teuthology.orchestra.run.smithi101.stdout: "flag_point": "commit sent; apply or cleanup", 2023-08-01T19:54:33.866 INFO:teuthology.orchestra.run.smithi101.stdout: "events": [ 2023-08-01T19:54:33.866 INFO:teuthology.orchestra.run.smithi101.stdout: { 2023-08-01T19:54:33.866 INFO:teuthology.orchestra.run.smithi101.stdout: "event": "initiated", 2023-08-01T19:54:33.866 INFO:teuthology.orchestra.run.smithi101.stdout: "time": "2023-08-01T19:54:04.459097+0000", 2023-08-01T19:54:33.866 INFO:teuthology.orchestra.run.smithi101.stdout: "duration": 0 2023-08-01T19:54:33.866 INFO:teuthology.orchestra.run.smithi101.stdout: }, 2023-08-01T19:54:33.866 INFO:teuthology.orchestra.run.smithi101.stdout: { 2023-08-01T19:54:33.867 INFO:teuthology.orchestra.run.smithi101.stdout: "event": "throttled", 2023-08-01T19:54:33.867 INFO:teuthology.orchestra.run.smithi101.stdout: "time": "2023-08-01T19:54:04.459097+0000", 2023-08-01T19:54:33.867 INFO:teuthology.orchestra.run.smithi101.stdout: "duration": 0 2023-08-01T19:54:33.867 INFO:teuthology.orchestra.run.smithi101.stdout: }, 2023-08-01T19:54:33.867 INFO:teuthology.orchestra.run.smithi101.stdout: { 2023-08-01T19:54:33.867 INFO:teuthology.orchestra.run.smithi101.stdout: "event": "header_read", 2023-08-01T19:54:33.867 INFO:teuthology.orchestra.run.smithi101.stdout: "time": "2023-08-01T19:54:04.459096+0000", 2023-08-01T19:54:33.867 INFO:teuthology.orchestra.run.smithi101.stdout: "duration": 4294967295.9999995 2023-08-01T19:54:33.868 INFO:teuthology.orchestra.run.smithi101.stdout: }, 2023-08-01T19:54:33.868 INFO:teuthology.orchestra.run.smithi101.stdout: { 2023-08-01T19:54:33.868 INFO:teuthology.orchestra.run.smithi101.stdout: "event": "all_read", 2023-08-01T19:54:33.868 INFO:teuthology.orchestra.run.smithi101.stdout: "time": "2023-08-01T19:54:04.459105+0000", 2023-08-01T19:54:33.868 INFO:teuthology.orchestra.run.smithi101.stdout: "duration": 8.8259999999999999e-06 2023-08-01T19:54:33.868 INFO:teuthology.orchestra.run.smithi101.stdout: }, 2023-08-01T19:54:33.868 INFO:teuthology.orchestra.run.smithi101.stdout: { 2023-08-01T19:54:33.868 INFO:teuthology.orchestra.run.smithi101.stdout: "event": "dispatched", 2023-08-01T19:54:33.869 INFO:teuthology.orchestra.run.smithi101.stdout: "time": "2023-08-01T19:54:04.459112+0000", 2023-08-01T19:54:33.869 INFO:teuthology.orchestra.run.smithi101.stdout: "duration": 6.6660000000000002e-06 2023-08-01T19:54:33.869 INFO:teuthology.orchestra.run.smithi101.stdout: }, 2023-08-01T19:54:33.869 INFO:teuthology.orchestra.run.smithi101.stdout: { 2023-08-01T19:54:33.869 INFO:teuthology.orchestra.run.smithi101.stdout: "event": "queued_for_pg", 2023-08-01T19:54:33.869 INFO:teuthology.orchestra.run.smithi101.stdout: "time": "2023-08-01T19:54:04.459116+0000", 2023-08-01T19:54:33.869 INFO:teuthology.orchestra.run.smithi101.stdout: "duration": 4.2209999999999999e-06 2023-08-01T19:54:33.869 INFO:teuthology.orchestra.run.smithi101.stdout: }, 2023-08-01T19:54:33.870 INFO:teuthology.orchestra.run.smithi101.stdout: { 2023-08-01T19:54:33.870 INFO:teuthology.orchestra.run.smithi101.stdout: "event": "reached_pg", 2023-08-01T19:54:33.870 INFO:teuthology.orchestra.run.smithi101.stdout: "time": "2023-08-01T19:54:04.459141+0000", 2023-08-01T19:54:33.870 INFO:teuthology.orchestra.run.smithi101.stdout: "duration": 2.4627e-05 2023-08-01T19:54:33.870 INFO:teuthology.orchestra.run.smithi101.stdout: }, 2023-08-01T19:54:33.870 INFO:teuthology.orchestra.run.smithi101.stdout: { 2023-08-01T19:54:33.870 INFO:teuthology.orchestra.run.smithi101.stdout: "event": "op must wait for map", 2023-08-01T19:54:33.870 INFO:teuthology.orchestra.run.smithi101.stdout: "time": "2023-08-01T19:54:04.459144+0000", 2023-08-01T19:54:33.871 INFO:teuthology.orchestra.run.smithi101.stdout: "duration": 3.6559999999999998e-06 2023-08-01T19:54:33.871 INFO:teuthology.orchestra.run.smithi101.stdout: }, 2023-08-01T19:54:33.871 INFO:teuthology.orchestra.run.smithi101.stdout: { 2023-08-01T19:54:33.871 INFO:teuthology.orchestra.run.smithi101.stdout: "event": "reached_pg", 2023-08-01T19:54:33.871 INFO:teuthology.orchestra.run.smithi101.stdout: "time": "2023-08-01T19:54:04.468086+0000", 2023-08-01T19:54:33.871 INFO:teuthology.orchestra.run.smithi101.stdout: "duration": 0.0089415569999999993 2023-08-01T19:54:33.871 INFO:teuthology.orchestra.run.smithi101.stdout: }, 2023-08-01T19:54:33.871 INFO:teuthology.orchestra.run.smithi101.stdout: { 2023-08-01T19:54:33.872 INFO:teuthology.orchestra.run.smithi101.stdout: "event": "started", 2023-08-01T19:54:33.872 INFO:teuthology.orchestra.run.smithi101.stdout: "time": "2023-08-01T19:54:04.468204+0000", 2023-08-01T19:54:33.872 INFO:teuthology.orchestra.run.smithi101.stdout: "duration": 0.00011806700000000001 2023-08-01T19:54:33.872 INFO:teuthology.orchestra.run.smithi101.stdout: }, 2023-08-01T19:54:33.872 INFO:teuthology.orchestra.run.smithi101.stdout: { 2023-08-01T19:54:33.872 INFO:teuthology.orchestra.run.smithi101.stdout: "event": "waiting for subops from 0", 2023-08-01T19:54:33.872 INFO:teuthology.orchestra.run.smithi101.stdout: "time": "2023-08-01T19:54:04.468342+0000", 2023-08-01T19:54:33.873 INFO:teuthology.orchestra.run.smithi101.stdout: "duration": 0.000138269 2023-08-01T19:54:33.873 INFO:teuthology.orchestra.run.smithi101.stdout: }, 2023-08-01T19:54:33.873 INFO:teuthology.orchestra.run.smithi101.stdout: { 2023-08-01T19:54:33.873 INFO:teuthology.orchestra.run.smithi101.stdout: "event": "op_commit", 2023-08-01T19:54:33.873 INFO:teuthology.orchestra.run.smithi101.stdout: "time": "2023-08-01T19:54:04.474028+0000", 2023-08-01T19:54:33.873 INFO:teuthology.orchestra.run.smithi101.stdout: "duration": 0.005685458 2023-08-01T19:54:33.873 INFO:teuthology.orchestra.run.smithi101.stdout: }, 2023-08-01T19:54:33.873 INFO:teuthology.orchestra.run.smithi101.stdout: { 2023-08-01T19:54:33.874 INFO:teuthology.orchestra.run.smithi101.stdout: "event": "sub_op_commit_rec", 2023-08-01T19:54:33.874 INFO:teuthology.orchestra.run.smithi101.stdout: "time": "2023-08-01T19:54:04.477581+0000", 2023-08-01T19:54:33.874 INFO:teuthology.orchestra.run.smithi101.stdout: "duration": 0.0035531109999999999 2023-08-01T19:54:33.874 INFO:teuthology.orchestra.run.smithi101.stdout: }, 2023-08-01T19:54:33.874 INFO:teuthology.orchestra.run.smithi101.stdout: { 2023-08-01T19:54:33.874 INFO:teuthology.orchestra.run.smithi101.stdout: "event": "commit_sent", 2023-08-01T19:54:33.874 INFO:teuthology.orchestra.run.smithi101.stdout: "time": "2023-08-01T19:54:04.477635+0000", 2023-08-01T19:54:33.874 INFO:teuthology.orchestra.run.smithi101.stdout: "duration": 5.3769e-05 2023-08-01T19:54:33.875 INFO:teuthology.orchestra.run.smithi101.stdout: }, 2023-08-01T19:54:33.875 INFO:teuthology.orchestra.run.smithi101.stdout: { 2023-08-01T19:54:33.875 INFO:teuthology.orchestra.run.smithi101.stdout: "event": "done", 2023-08-01T19:54:33.875 INFO:teuthology.orchestra.run.smithi101.stdout: "time": "2023-08-01T19:54:04.477676+0000", 2023-08-01T19:54:33.875 INFO:teuthology.orchestra.run.smithi101.stdout: "duration": 4.1148e-05 2023-08-01T19:54:33.875 INFO:teuthology.orchestra.run.smithi101.stdout: } 2023-08-01T19:54:33.875 INFO:teuthology.orchestra.run.smithi101.stdout: ] 2023-08-01T19:54:33.876 INFO:teuthology.orchestra.run.smithi101.stdout: } 2023-08-01T19:54:33.876 INFO:teuthology.orchestra.run.smithi101.stdout: }, 2023-08-01T19:54:33.876 INFO:teuthology.orchestra.run.smithi101.stdout: { 2023-08-01T19:54:33.876 INFO:teuthology.orchestra.run.smithi101.stdout: "description": "osd_op(mds.0.3:21 3.1c 3:3ed09add:::607.00000000:head [create,setxattr parent (62) in=6b,setxattr layout (30) in=6b] snapc 0=[] ondisk+write+known_if_redirected+full_force+supports_pool_eio e17)", 2023-08-01T19:54:33.876 INFO:teuthology.orchestra.run.smithi101.stdout: "initiated_at": "2023-08-01T19:54:04.459123+0000", 2023-08-01T19:54:33.876 INFO:teuthology.orchestra.run.smithi101.stdout: "age": 29.291837498, 2023-08-01T19:54:33.876 INFO:teuthology.orchestra.run.smithi101.stdout: "duration": 0.018736452000000001, 2023-08-01T19:54:33.876 INFO:teuthology.orchestra.run.smithi101.stdout: "type_data": { 2023-08-01T19:54:33.877 INFO:teuthology.orchestra.run.smithi101.stdout: "flag_point": "commit sent; apply or cleanup", 2023-08-01T19:54:33.877 INFO:teuthology.orchestra.run.smithi101.stdout: "events": [ 2023-08-01T19:54:33.877 INFO:teuthology.orchestra.run.smithi101.stdout: { 2023-08-01T19:54:33.877 INFO:teuthology.orchestra.run.smithi101.stdout: "event": "initiated", 2023-08-01T19:54:33.877 INFO:teuthology.orchestra.run.smithi101.stdout: "time": "2023-08-01T19:54:04.459123+0000", 2023-08-01T19:54:33.877 INFO:teuthology.orchestra.run.smithi101.stdout: "duration": 0 2023-08-01T19:54:33.877 INFO:teuthology.orchestra.run.smithi101.stdout: }, 2023-08-01T19:54:33.877 INFO:teuthology.orchestra.run.smithi101.stdout: { 2023-08-01T19:54:33.878 INFO:teuthology.orchestra.run.smithi101.stdout: "event": "throttled", 2023-08-01T19:54:33.878 INFO:teuthology.orchestra.run.smithi101.stdout: "time": "2023-08-01T19:54:04.459123+0000", 2023-08-01T19:54:33.878 INFO:teuthology.orchestra.run.smithi101.stdout: "duration": 0 2023-08-01T19:54:33.878 INFO:teuthology.orchestra.run.smithi101.stdout: }, 2023-08-01T19:54:33.878 INFO:teuthology.orchestra.run.smithi101.stdout: { 2023-08-01T19:54:33.878 INFO:teuthology.orchestra.run.smithi101.stdout: "event": "header_read", 2023-08-01T19:54:33.878 INFO:teuthology.orchestra.run.smithi101.stdout: "time": "2023-08-01T19:54:04.459123+0000", 2023-08-01T19:54:33.878 INFO:teuthology.orchestra.run.smithi101.stdout: "duration": 4294967295.9999995 2023-08-01T19:54:33.879 INFO:teuthology.orchestra.run.smithi101.stdout: }, 2023-08-01T19:54:33.879 INFO:teuthology.orchestra.run.smithi101.stdout: { 2023-08-01T19:54:33.879 INFO:teuthology.orchestra.run.smithi101.stdout: "event": "all_read", 2023-08-01T19:54:33.879 INFO:teuthology.orchestra.run.smithi101.stdout: "time": "2023-08-01T19:54:04.459127+0000", 2023-08-01T19:54:33.879 INFO:teuthology.orchestra.run.smithi101.stdout: "duration": 4.5770000000000004e-06 2023-08-01T19:54:33.879 INFO:teuthology.orchestra.run.smithi101.stdout: }, 2023-08-01T19:54:33.879 INFO:teuthology.orchestra.run.smithi101.stdout: { 2023-08-01T19:54:33.879 INFO:teuthology.orchestra.run.smithi101.stdout: "event": "dispatched", 2023-08-01T19:54:33.880 INFO:teuthology.orchestra.run.smithi101.stdout: "time": "2023-08-01T19:54:04.459134+0000", 2023-08-01T19:54:33.880 INFO:teuthology.orchestra.run.smithi101.stdout: "duration": 6.5080000000000002e-06 2023-08-01T19:54:33.880 INFO:teuthology.orchestra.run.smithi101.stdout: }, 2023-08-01T19:54:33.880 INFO:teuthology.orchestra.run.smithi101.stdout: { 2023-08-01T19:54:33.880 INFO:teuthology.orchestra.run.smithi101.stdout: "event": "queued_for_pg", 2023-08-01T19:54:33.880 INFO:teuthology.orchestra.run.smithi101.stdout: "time": "2023-08-01T19:54:04.459138+0000", 2023-08-01T19:54:33.880 INFO:teuthology.orchestra.run.smithi101.stdout: "duration": 4.6249999999999998e-06 2023-08-01T19:54:33.881 INFO:teuthology.orchestra.run.smithi101.stdout: }, 2023-08-01T19:54:33.881 INFO:teuthology.orchestra.run.smithi101.stdout: { 2023-08-01T19:54:33.881 INFO:teuthology.orchestra.run.smithi101.stdout: "event": "reached_pg", 2023-08-01T19:54:33.881 INFO:teuthology.orchestra.run.smithi101.stdout: "time": "2023-08-01T19:54:04.459158+0000", 2023-08-01T19:54:33.881 INFO:teuthology.orchestra.run.smithi101.stdout: "duration": 1.9354000000000001e-05 2023-08-01T19:54:33.881 INFO:teuthology.orchestra.run.smithi101.stdout: }, 2023-08-01T19:54:33.881 INFO:teuthology.orchestra.run.smithi101.stdout: { 2023-08-01T19:54:33.881 INFO:teuthology.orchestra.run.smithi101.stdout: "event": "waiting_for_map not empty", 2023-08-01T19:54:33.882 INFO:teuthology.orchestra.run.smithi101.stdout: "time": "2023-08-01T19:54:04.459160+0000", 2023-08-01T19:54:33.882 INFO:teuthology.orchestra.run.smithi101.stdout: "duration": 2.2740000000000002e-06 2023-08-01T19:54:33.882 INFO:teuthology.orchestra.run.smithi101.stdout: }, 2023-08-01T19:54:33.882 INFO:teuthology.orchestra.run.smithi101.stdout: { 2023-08-01T19:54:33.882 INFO:teuthology.orchestra.run.smithi101.stdout: "event": "reached_pg", 2023-08-01T19:54:33.882 INFO:teuthology.orchestra.run.smithi101.stdout: "time": "2023-08-01T19:54:04.468839+0000", 2023-08-01T19:54:33.882 INFO:teuthology.orchestra.run.smithi101.stdout: "duration": 0.0096787109999999996 2023-08-01T19:54:33.882 INFO:teuthology.orchestra.run.smithi101.stdout: }, 2023-08-01T19:54:33.883 INFO:teuthology.orchestra.run.smithi101.stdout: { 2023-08-01T19:54:33.883 INFO:teuthology.orchestra.run.smithi101.stdout: "event": "started", 2023-08-01T19:54:33.883 INFO:teuthology.orchestra.run.smithi101.stdout: "time": "2023-08-01T19:54:04.469446+0000", 2023-08-01T19:54:33.883 INFO:teuthology.orchestra.run.smithi101.stdout: "duration": 0.00060714899999999997 2023-08-01T19:54:33.883 INFO:teuthology.orchestra.run.smithi101.stdout: }, 2023-08-01T19:54:33.883 INFO:teuthology.orchestra.run.smithi101.stdout: { 2023-08-01T19:54:33.883 INFO:teuthology.orchestra.run.smithi101.stdout: "event": "waiting for subops from 0", 2023-08-01T19:54:33.883 INFO:teuthology.orchestra.run.smithi101.stdout: "time": "2023-08-01T19:54:04.470133+0000", 2023-08-01T19:54:33.884 INFO:teuthology.orchestra.run.smithi101.stdout: "duration": 0.00068691900000000003 2023-08-01T19:54:33.884 INFO:teuthology.orchestra.run.smithi101.stdout: }, 2023-08-01T19:54:33.884 INFO:teuthology.orchestra.run.smithi101.stdout: { 2023-08-01T19:54:33.884 INFO:teuthology.orchestra.run.smithi101.stdout: "event": "op_commit", 2023-08-01T19:54:33.884 INFO:teuthology.orchestra.run.smithi101.stdout: "time": "2023-08-01T19:54:04.475933+0000", 2023-08-01T19:54:33.884 INFO:teuthology.orchestra.run.smithi101.stdout: "duration": 0.0058002560000000002 2023-08-01T19:54:33.884 INFO:teuthology.orchestra.run.smithi101.stdout: }, 2023-08-01T19:54:33.885 INFO:teuthology.orchestra.run.smithi101.stdout: { 2023-08-01T19:54:33.885 INFO:teuthology.orchestra.run.smithi101.stdout: "event": "sub_op_commit_rec", 2023-08-01T19:54:33.885 INFO:teuthology.orchestra.run.smithi101.stdout: "time": "2023-08-01T19:54:04.477749+0000", 2023-08-01T19:54:33.885 INFO:teuthology.orchestra.run.smithi101.stdout: "duration": 0.00181584 2023-08-01T19:54:33.885 INFO:teuthology.orchestra.run.smithi101.stdout: }, 2023-08-01T19:54:33.885 INFO:teuthology.orchestra.run.smithi101.stdout: { 2023-08-01T19:54:33.885 INFO:teuthology.orchestra.run.smithi101.stdout: "event": "commit_sent", 2023-08-01T19:54:33.885 INFO:teuthology.orchestra.run.smithi101.stdout: "time": "2023-08-01T19:54:04.477823+0000", 2023-08-01T19:54:33.886 INFO:teuthology.orchestra.run.smithi101.stdout: "duration": 7.4405000000000003e-05 2023-08-01T19:54:33.886 INFO:teuthology.orchestra.run.smithi101.stdout: }, 2023-08-01T19:54:33.886 INFO:teuthology.orchestra.run.smithi101.stdout: { 2023-08-01T19:54:33.886 INFO:teuthology.orchestra.run.smithi101.stdout: "event": "done", 2023-08-01T19:54:33.886 INFO:teuthology.orchestra.run.smithi101.stdout: "time": "2023-08-01T19:54:04.477859+0000", 2023-08-01T19:54:33.886 INFO:teuthology.orchestra.run.smithi101.stdout: "duration": 3.6211000000000003e-05 2023-08-01T19:54:33.886 INFO:teuthology.orchestra.run.smithi101.stdout: } 2023-08-01T19:54:33.887 INFO:teuthology.orchestra.run.smithi101.stdout: ] 2023-08-01T19:54:33.887 INFO:teuthology.orchestra.run.smithi101.stdout: } 2023-08-01T19:54:33.887 INFO:teuthology.orchestra.run.smithi101.stdout: }, 2023-08-01T19:54:33.887 INFO:teuthology.orchestra.run.smithi101.stdout: { 2023-08-01T19:54:33.887 INFO:teuthology.orchestra.run.smithi101.stdout: "description": "osd_op(mds.0.3:29 3.13 3:cd5a64a3:::100.00000000:head [omap-set-header,omap-set-vals] snapc 0=[] ondisk+write+known_if_redirected+full_force+supports_pool_eio e17)", 2023-08-01T19:54:33.887 INFO:teuthology.orchestra.run.smithi101.stdout: "initiated_at": "2023-08-01T19:54:04.459146+0000", 2023-08-01T19:54:33.887 INFO:teuthology.orchestra.run.smithi101.stdout: "age": 29.291814296999998, 2023-08-01T19:54:33.887 INFO:teuthology.orchestra.run.smithi101.stdout: "duration": 0.015668519999999998, 2023-08-01T19:54:33.888 INFO:teuthology.orchestra.run.smithi101.stdout: "type_data": { 2023-08-01T19:54:33.888 INFO:teuthology.orchestra.run.smithi101.stdout: "flag_point": "commit sent; apply or cleanup", 2023-08-01T19:54:33.888 INFO:teuthology.orchestra.run.smithi101.stdout: "events": [ 2023-08-01T19:54:33.888 INFO:teuthology.orchestra.run.smithi101.stdout: { 2023-08-01T19:54:33.888 INFO:teuthology.orchestra.run.smithi101.stdout: "event": "initiated", 2023-08-01T19:54:33.888 INFO:teuthology.orchestra.run.smithi101.stdout: "time": "2023-08-01T19:54:04.459146+0000", 2023-08-01T19:54:33.888 INFO:teuthology.orchestra.run.smithi101.stdout: "duration": 0 2023-08-01T19:54:33.888 INFO:teuthology.orchestra.run.smithi101.stdout: }, 2023-08-01T19:54:33.889 INFO:teuthology.orchestra.run.smithi101.stdout: { 2023-08-01T19:54:33.889 INFO:teuthology.orchestra.run.smithi101.stdout: "event": "throttled", 2023-08-01T19:54:33.889 INFO:teuthology.orchestra.run.smithi101.stdout: "time": "2023-08-01T19:54:04.459146+0000", 2023-08-01T19:54:33.889 INFO:teuthology.orchestra.run.smithi101.stdout: "duration": 0 2023-08-01T19:54:33.889 INFO:teuthology.orchestra.run.smithi101.stdout: }, 2023-08-01T19:54:33.889 INFO:teuthology.orchestra.run.smithi101.stdout: { 2023-08-01T19:54:33.889 INFO:teuthology.orchestra.run.smithi101.stdout: "event": "header_read", 2023-08-01T19:54:33.890 INFO:teuthology.orchestra.run.smithi101.stdout: "time": "2023-08-01T19:54:04.459146+0000", 2023-08-01T19:54:33.890 INFO:teuthology.orchestra.run.smithi101.stdout: "duration": 4294967295.9999995 2023-08-01T19:54:33.890 INFO:teuthology.orchestra.run.smithi101.stdout: }, 2023-08-01T19:54:33.890 INFO:teuthology.orchestra.run.smithi101.stdout: { 2023-08-01T19:54:33.890 INFO:teuthology.orchestra.run.smithi101.stdout: "event": "all_read", 2023-08-01T19:54:33.890 INFO:teuthology.orchestra.run.smithi101.stdout: "time": "2023-08-01T19:54:04.459155+0000", 2023-08-01T19:54:33.890 INFO:teuthology.orchestra.run.smithi101.stdout: "duration": 9.6020000000000006e-06 2023-08-01T19:54:33.890 INFO:teuthology.orchestra.run.smithi101.stdout: }, 2023-08-01T19:54:33.891 INFO:teuthology.orchestra.run.smithi101.stdout: { 2023-08-01T19:54:33.891 INFO:teuthology.orchestra.run.smithi101.stdout: "event": "dispatched", 2023-08-01T19:54:33.891 INFO:teuthology.orchestra.run.smithi101.stdout: "time": "2023-08-01T19:54:04.459162+0000", 2023-08-01T19:54:33.891 INFO:teuthology.orchestra.run.smithi101.stdout: "duration": 7.0439999999999998e-06 2023-08-01T19:54:33.891 INFO:teuthology.orchestra.run.smithi101.stdout: }, 2023-08-01T19:54:33.891 INFO:teuthology.orchestra.run.smithi101.stdout: { 2023-08-01T19:54:33.891 INFO:teuthology.orchestra.run.smithi101.stdout: "event": "queued_for_pg", 2023-08-01T19:54:33.891 INFO:teuthology.orchestra.run.smithi101.stdout: "time": "2023-08-01T19:54:04.459167+0000", 2023-08-01T19:54:33.892 INFO:teuthology.orchestra.run.smithi101.stdout: "duration": 4.3989999999999997e-06 2023-08-01T19:54:33.892 INFO:teuthology.orchestra.run.smithi101.stdout: }, 2023-08-01T19:54:33.892 INFO:teuthology.orchestra.run.smithi101.stdout: { 2023-08-01T19:54:33.892 INFO:teuthology.orchestra.run.smithi101.stdout: "event": "reached_pg", 2023-08-01T19:54:33.892 INFO:teuthology.orchestra.run.smithi101.stdout: "time": "2023-08-01T19:54:04.459201+0000", 2023-08-01T19:54:33.892 INFO:teuthology.orchestra.run.smithi101.stdout: "duration": 3.4406000000000002e-05 2023-08-01T19:54:33.892 INFO:teuthology.orchestra.run.smithi101.stdout: }, 2023-08-01T19:54:33.892 INFO:teuthology.orchestra.run.smithi101.stdout: { 2023-08-01T19:54:33.893 INFO:teuthology.orchestra.run.smithi101.stdout: "event": "op must wait for map", 2023-08-01T19:54:33.893 INFO:teuthology.orchestra.run.smithi101.stdout: "time": "2023-08-01T19:54:04.459206+0000", 2023-08-01T19:54:33.893 INFO:teuthology.orchestra.run.smithi101.stdout: "duration": 5.04e-06 2023-08-01T19:54:33.893 INFO:teuthology.orchestra.run.smithi101.stdout: }, 2023-08-01T19:54:33.893 INFO:teuthology.orchestra.run.smithi101.stdout: { 2023-08-01T19:54:33.893 INFO:teuthology.orchestra.run.smithi101.stdout: "event": "reached_pg", 2023-08-01T19:54:33.893 INFO:teuthology.orchestra.run.smithi101.stdout: "time": "2023-08-01T19:54:04.468278+0000", 2023-08-01T19:54:33.893 INFO:teuthology.orchestra.run.smithi101.stdout: "duration": 0.0090714899999999998 2023-08-01T19:54:33.894 INFO:teuthology.orchestra.run.smithi101.stdout: }, 2023-08-01T19:54:33.894 INFO:teuthology.orchestra.run.smithi101.stdout: { 2023-08-01T19:54:33.894 INFO:teuthology.orchestra.run.smithi101.stdout: "event": "started", 2023-08-01T19:54:33.894 INFO:teuthology.orchestra.run.smithi101.stdout: "time": "2023-08-01T19:54:04.468419+0000", 2023-08-01T19:54:33.894 INFO:teuthology.orchestra.run.smithi101.stdout: "duration": 0.00014119100000000001 2023-08-01T19:54:33.894 INFO:teuthology.orchestra.run.smithi101.stdout: }, 2023-08-01T19:54:33.894 INFO:teuthology.orchestra.run.smithi101.stdout: { 2023-08-01T19:54:33.894 INFO:teuthology.orchestra.run.smithi101.stdout: "event": "waiting for subops from 0", 2023-08-01T19:54:33.895 INFO:teuthology.orchestra.run.smithi101.stdout: "time": "2023-08-01T19:54:04.468598+0000", 2023-08-01T19:54:33.895 INFO:teuthology.orchestra.run.smithi101.stdout: "duration": 0.00017872799999999999 2023-08-01T19:54:33.895 INFO:teuthology.orchestra.run.smithi101.stdout: }, 2023-08-01T19:54:33.895 INFO:teuthology.orchestra.run.smithi101.stdout: { 2023-08-01T19:54:33.895 INFO:teuthology.orchestra.run.smithi101.stdout: "event": "op_commit", 2023-08-01T19:54:33.895 INFO:teuthology.orchestra.run.smithi101.stdout: "time": "2023-08-01T19:54:04.472625+0000", 2023-08-01T19:54:33.895 INFO:teuthology.orchestra.run.smithi101.stdout: "duration": 0.0040273729999999999 2023-08-01T19:54:33.895 INFO:teuthology.orchestra.run.smithi101.stdout: }, 2023-08-01T19:54:33.896 INFO:teuthology.orchestra.run.smithi101.stdout: { 2023-08-01T19:54:33.896 INFO:teuthology.orchestra.run.smithi101.stdout: "event": "sub_op_commit_rec", 2023-08-01T19:54:33.896 INFO:teuthology.orchestra.run.smithi101.stdout: "time": "2023-08-01T19:54:04.474719+0000", 2023-08-01T19:54:33.896 INFO:teuthology.orchestra.run.smithi101.stdout: "duration": 0.0020941509999999998 2023-08-01T19:54:33.896 INFO:teuthology.orchestra.run.smithi101.stdout: }, 2023-08-01T19:54:33.896 INFO:teuthology.orchestra.run.smithi101.stdout: { 2023-08-01T19:54:33.896 INFO:teuthology.orchestra.run.smithi101.stdout: "event": "commit_sent", 2023-08-01T19:54:33.897 INFO:teuthology.orchestra.run.smithi101.stdout: "time": "2023-08-01T19:54:04.474776+0000", 2023-08-01T19:54:33.897 INFO:teuthology.orchestra.run.smithi101.stdout: "duration": 5.6368e-05 2023-08-01T19:54:33.897 INFO:teuthology.orchestra.run.smithi101.stdout: }, 2023-08-01T19:54:33.897 INFO:teuthology.orchestra.run.smithi101.stdout: { 2023-08-01T19:54:33.897 INFO:teuthology.orchestra.run.smithi101.stdout: "event": "done", 2023-08-01T19:54:33.897 INFO:teuthology.orchestra.run.smithi101.stdout: "time": "2023-08-01T19:54:04.474815+0000", 2023-08-01T19:54:33.897 INFO:teuthology.orchestra.run.smithi101.stdout: "duration": 3.9112000000000001e-05 2023-08-01T19:54:33.897 INFO:teuthology.orchestra.run.smithi101.stdout: } 2023-08-01T19:54:33.898 INFO:teuthology.orchestra.run.smithi101.stdout: ] 2023-08-01T19:54:33.898 INFO:teuthology.orchestra.run.smithi101.stdout: } 2023-08-01T19:54:33.898 INFO:teuthology.orchestra.run.smithi101.stdout: }, 2023-08-01T19:54:33.898 INFO:teuthology.orchestra.run.smithi101.stdout: { 2023-08-01T19:54:33.898 INFO:teuthology.orchestra.run.smithi101.stdout: "description": "osd_op(mds.0.3:1 3.14 3:292cf221:::200.00000000:head [writefull 0~90] snapc 0=[] ondisk+write+known_if_redirected+full_force+supports_pool_eio e17)", 2023-08-01T19:54:33.898 INFO:teuthology.orchestra.run.smithi101.stdout: "initiated_at": "2023-08-01T19:54:04.459177+0000", 2023-08-01T19:54:33.898 INFO:teuthology.orchestra.run.smithi101.stdout: "age": 29.291783789, 2023-08-01T19:54:33.898 INFO:teuthology.orchestra.run.smithi101.stdout: "duration": 0.021067196, 2023-08-01T19:54:33.899 INFO:teuthology.orchestra.run.smithi101.stdout: "type_data": { 2023-08-01T19:54:33.899 INFO:teuthology.orchestra.run.smithi101.stdout: "flag_point": "commit sent; apply or cleanup", 2023-08-01T19:54:33.899 INFO:teuthology.orchestra.run.smithi101.stdout: "events": [ 2023-08-01T19:54:33.899 INFO:teuthology.orchestra.run.smithi101.stdout: { 2023-08-01T19:54:33.899 INFO:teuthology.orchestra.run.smithi101.stdout: "event": "initiated", 2023-08-01T19:54:33.899 INFO:teuthology.orchestra.run.smithi101.stdout: "time": "2023-08-01T19:54:04.459177+0000", 2023-08-01T19:54:33.899 INFO:teuthology.orchestra.run.smithi101.stdout: "duration": 0 2023-08-01T19:54:33.899 INFO:teuthology.orchestra.run.smithi101.stdout: }, 2023-08-01T19:54:33.900 INFO:teuthology.orchestra.run.smithi101.stdout: { 2023-08-01T19:54:33.900 INFO:teuthology.orchestra.run.smithi101.stdout: "event": "throttled", 2023-08-01T19:54:33.900 INFO:teuthology.orchestra.run.smithi101.stdout: "time": "2023-08-01T19:54:04.459177+0000", 2023-08-01T19:54:33.900 INFO:teuthology.orchestra.run.smithi101.stdout: "duration": 0 2023-08-01T19:54:33.900 INFO:teuthology.orchestra.run.smithi101.stdout: }, 2023-08-01T19:54:33.900 INFO:teuthology.orchestra.run.smithi101.stdout: { 2023-08-01T19:54:33.900 INFO:teuthology.orchestra.run.smithi101.stdout: "event": "header_read", 2023-08-01T19:54:33.901 INFO:teuthology.orchestra.run.smithi101.stdout: "time": "2023-08-01T19:54:04.459176+0000", 2023-08-01T19:54:33.901 INFO:teuthology.orchestra.run.smithi101.stdout: "duration": 4294967295.9999995 2023-08-01T19:54:33.901 INFO:teuthology.orchestra.run.smithi101.stdout: }, 2023-08-01T19:54:33.901 INFO:teuthology.orchestra.run.smithi101.stdout: { 2023-08-01T19:54:33.901 INFO:teuthology.orchestra.run.smithi101.stdout: "event": "all_read", 2023-08-01T19:54:33.901 INFO:teuthology.orchestra.run.smithi101.stdout: "time": "2023-08-01T19:54:04.459181+0000", 2023-08-01T19:54:33.901 INFO:teuthology.orchestra.run.smithi101.stdout: "duration": 5.2109999999999997e-06 2023-08-01T19:54:33.901 INFO:teuthology.orchestra.run.smithi101.stdout: }, 2023-08-01T19:54:33.902 INFO:teuthology.orchestra.run.smithi101.stdout: { 2023-08-01T19:54:33.902 INFO:teuthology.orchestra.run.smithi101.stdout: "event": "dispatched", 2023-08-01T19:54:33.902 INFO:teuthology.orchestra.run.smithi101.stdout: "time": "2023-08-01T19:54:04.459188+0000", 2023-08-01T19:54:33.902 INFO:teuthology.orchestra.run.smithi101.stdout: "duration": 6.6680000000000004e-06 2023-08-01T19:54:33.902 INFO:teuthology.orchestra.run.smithi101.stdout: }, 2023-08-01T19:54:33.902 INFO:teuthology.orchestra.run.smithi101.stdout: { 2023-08-01T19:54:33.902 INFO:teuthology.orchestra.run.smithi101.stdout: "event": "queued_for_pg", 2023-08-01T19:54:33.902 INFO:teuthology.orchestra.run.smithi101.stdout: "time": "2023-08-01T19:54:04.459192+0000", 2023-08-01T19:54:33.903 INFO:teuthology.orchestra.run.smithi101.stdout: "duration": 4.228e-06 2023-08-01T19:54:33.903 INFO:teuthology.orchestra.run.smithi101.stdout: }, 2023-08-01T19:54:33.903 INFO:teuthology.orchestra.run.smithi101.stdout: { 2023-08-01T19:54:33.903 INFO:teuthology.orchestra.run.smithi101.stdout: "event": "reached_pg", 2023-08-01T19:54:33.903 INFO:teuthology.orchestra.run.smithi101.stdout: "time": "2023-08-01T19:54:04.459219+0000", 2023-08-01T19:54:33.903 INFO:teuthology.orchestra.run.smithi101.stdout: "duration": 2.6930000000000001e-05 2023-08-01T19:54:33.903 INFO:teuthology.orchestra.run.smithi101.stdout: }, 2023-08-01T19:54:33.903 INFO:teuthology.orchestra.run.smithi101.stdout: { 2023-08-01T19:54:33.904 INFO:teuthology.orchestra.run.smithi101.stdout: "event": "waiting_for_map not empty", 2023-08-01T19:54:33.904 INFO:teuthology.orchestra.run.smithi101.stdout: "time": "2023-08-01T19:54:04.459223+0000", 2023-08-01T19:54:33.904 INFO:teuthology.orchestra.run.smithi101.stdout: "duration": 3.8469999999999998e-06 2023-08-01T19:54:33.904 INFO:teuthology.orchestra.run.smithi101.stdout: }, 2023-08-01T19:54:33.904 INFO:teuthology.orchestra.run.smithi101.stdout: { 2023-08-01T19:54:33.904 INFO:teuthology.orchestra.run.smithi101.stdout: "event": "reached_pg", 2023-08-01T19:54:33.904 INFO:teuthology.orchestra.run.smithi101.stdout: "time": "2023-08-01T19:54:04.473347+0000", 2023-08-01T19:54:33.904 INFO:teuthology.orchestra.run.smithi101.stdout: "duration": 0.014124319 2023-08-01T19:54:33.905 INFO:teuthology.orchestra.run.smithi101.stdout: }, 2023-08-01T19:54:33.905 INFO:teuthology.orchestra.run.smithi101.stdout: { 2023-08-01T19:54:33.905 INFO:teuthology.orchestra.run.smithi101.stdout: "event": "started", 2023-08-01T19:54:33.905 INFO:teuthology.orchestra.run.smithi101.stdout: "time": "2023-08-01T19:54:04.473480+0000", 2023-08-01T19:54:33.905 INFO:teuthology.orchestra.run.smithi101.stdout: "duration": 0.00013276799999999999 2023-08-01T19:54:33.905 INFO:teuthology.orchestra.run.smithi101.stdout: }, 2023-08-01T19:54:33.905 INFO:teuthology.orchestra.run.smithi101.stdout: { 2023-08-01T19:54:33.906 INFO:teuthology.orchestra.run.smithi101.stdout: "event": "waiting for subops from 2", 2023-08-01T19:54:33.906 INFO:teuthology.orchestra.run.smithi101.stdout: "time": "2023-08-01T19:54:04.473622+0000", 2023-08-01T19:54:33.906 INFO:teuthology.orchestra.run.smithi101.stdout: "duration": 0.00014154799999999999 2023-08-01T19:54:33.906 INFO:teuthology.orchestra.run.smithi101.stdout: }, 2023-08-01T19:54:33.906 INFO:teuthology.orchestra.run.smithi101.stdout: { 2023-08-01T19:54:33.906 INFO:teuthology.orchestra.run.smithi101.stdout: "event": "op_commit", 2023-08-01T19:54:33.906 INFO:teuthology.orchestra.run.smithi101.stdout: "time": "2023-08-01T19:54:04.478281+0000", 2023-08-01T19:54:33.906 INFO:teuthology.orchestra.run.smithi101.stdout: "duration": 0.004659252 2023-08-01T19:54:33.907 INFO:teuthology.orchestra.run.smithi101.stdout: }, 2023-08-01T19:54:33.907 INFO:teuthology.orchestra.run.smithi101.stdout: { 2023-08-01T19:54:33.907 INFO:teuthology.orchestra.run.smithi101.stdout: "event": "sub_op_commit_rec", 2023-08-01T19:54:33.907 INFO:teuthology.orchestra.run.smithi101.stdout: "time": "2023-08-01T19:54:04.480180+0000", 2023-08-01T19:54:33.907 INFO:teuthology.orchestra.run.smithi101.stdout: "duration": 0.0018986859999999999 2023-08-01T19:54:33.907 INFO:teuthology.orchestra.run.smithi101.stdout: }, 2023-08-01T19:54:33.907 INFO:teuthology.orchestra.run.smithi101.stdout: { 2023-08-01T19:54:33.907 INFO:teuthology.orchestra.run.smithi101.stdout: "event": "commit_sent", 2023-08-01T19:54:33.908 INFO:teuthology.orchestra.run.smithi101.stdout: "time": "2023-08-01T19:54:04.480209+0000", 2023-08-01T19:54:33.908 INFO:teuthology.orchestra.run.smithi101.stdout: "duration": 2.9244999999999999e-05 2023-08-01T19:54:33.908 INFO:teuthology.orchestra.run.smithi101.stdout: }, 2023-08-01T19:54:33.908 INFO:teuthology.orchestra.run.smithi101.stdout: { 2023-08-01T19:54:33.908 INFO:teuthology.orchestra.run.smithi101.stdout: "event": "done", 2023-08-01T19:54:33.908 INFO:teuthology.orchestra.run.smithi101.stdout: "time": "2023-08-01T19:54:04.480244+0000", 2023-08-01T19:54:33.908 INFO:teuthology.orchestra.run.smithi101.stdout: "duration": 3.4875000000000001e-05 2023-08-01T19:54:33.908 INFO:teuthology.orchestra.run.smithi101.stdout: } 2023-08-01T19:54:33.909 INFO:teuthology.orchestra.run.smithi101.stdout: ] 2023-08-01T19:54:33.909 INFO:teuthology.orchestra.run.smithi101.stdout: } 2023-08-01T19:54:33.909 INFO:teuthology.orchestra.run.smithi101.stdout: }, 2023-08-01T19:54:33.909 INFO:teuthology.orchestra.run.smithi101.stdout: { 2023-08-01T19:54:33.909 INFO:teuthology.orchestra.run.smithi101.stdout: "description": "osd_op(mds.0.3:2 3.f 3:f1f69726:::400.00000000:head [writefull 0~22] snapc 0=[] ondisk+write+known_if_redirected+full_force+supports_pool_eio e17)", 2023-08-01T19:54:33.909 INFO:teuthology.orchestra.run.smithi101.stdout: "initiated_at": "2023-08-01T19:54:04.459201+0000", 2023-08-01T19:54:33.909 INFO:teuthology.orchestra.run.smithi101.stdout: "age": 29.291759533, 2023-08-01T19:54:33.909 INFO:teuthology.orchestra.run.smithi101.stdout: "duration": 0.016952979, 2023-08-01T19:54:33.910 INFO:teuthology.orchestra.run.smithi101.stdout: "type_data": { 2023-08-01T19:54:33.910 INFO:teuthology.orchestra.run.smithi101.stdout: "flag_point": "commit sent; apply or cleanup", 2023-08-01T19:54:33.910 INFO:teuthology.orchestra.run.smithi101.stdout: "events": [ 2023-08-01T19:54:33.910 INFO:teuthology.orchestra.run.smithi101.stdout: { 2023-08-01T19:54:33.910 INFO:teuthology.orchestra.run.smithi101.stdout: "event": "initiated", 2023-08-01T19:54:33.910 INFO:teuthology.orchestra.run.smithi101.stdout: "time": "2023-08-01T19:54:04.459201+0000", 2023-08-01T19:54:33.910 INFO:teuthology.orchestra.run.smithi101.stdout: "duration": 0 2023-08-01T19:54:33.910 INFO:teuthology.orchestra.run.smithi101.stdout: }, 2023-08-01T19:54:33.911 INFO:teuthology.orchestra.run.smithi101.stdout: { 2023-08-01T19:54:33.911 INFO:teuthology.orchestra.run.smithi101.stdout: "event": "throttled", 2023-08-01T19:54:33.911 INFO:teuthology.orchestra.run.smithi101.stdout: "time": "2023-08-01T19:54:04.459201+0000", 2023-08-01T19:54:33.911 INFO:teuthology.orchestra.run.smithi101.stdout: "duration": 0 2023-08-01T19:54:33.911 INFO:teuthology.orchestra.run.smithi101.stdout: }, 2023-08-01T19:54:33.911 INFO:teuthology.orchestra.run.smithi101.stdout: { 2023-08-01T19:54:33.911 INFO:teuthology.orchestra.run.smithi101.stdout: "event": "header_read", 2023-08-01T19:54:33.912 INFO:teuthology.orchestra.run.smithi101.stdout: "time": "2023-08-01T19:54:04.459201+0000", 2023-08-01T19:54:33.912 INFO:teuthology.orchestra.run.smithi101.stdout: "duration": 4294967295.9999995 2023-08-01T19:54:33.912 INFO:teuthology.orchestra.run.smithi101.stdout: }, 2023-08-01T19:54:33.912 INFO:teuthology.orchestra.run.smithi101.stdout: { 2023-08-01T19:54:33.912 INFO:teuthology.orchestra.run.smithi101.stdout: "event": "all_read", 2023-08-01T19:54:33.912 INFO:teuthology.orchestra.run.smithi101.stdout: "time": "2023-08-01T19:54:04.459204+0000", 2023-08-01T19:54:33.912 INFO:teuthology.orchestra.run.smithi101.stdout: "duration": 3.5599999999999998e-06 2023-08-01T19:54:33.912 INFO:teuthology.orchestra.run.smithi101.stdout: }, 2023-08-01T19:54:33.913 INFO:teuthology.orchestra.run.smithi101.stdout: { 2023-08-01T19:54:33.913 INFO:teuthology.orchestra.run.smithi101.stdout: "event": "dispatched", 2023-08-01T19:54:33.913 INFO:teuthology.orchestra.run.smithi101.stdout: "time": "2023-08-01T19:54:04.459211+0000", 2023-08-01T19:54:33.913 INFO:teuthology.orchestra.run.smithi101.stdout: "duration": 6.9299999999999997e-06 2023-08-01T19:54:33.913 INFO:teuthology.orchestra.run.smithi101.stdout: }, 2023-08-01T19:54:33.913 INFO:teuthology.orchestra.run.smithi101.stdout: { 2023-08-01T19:54:33.914 INFO:teuthology.orchestra.run.smithi101.stdout: "event": "queued_for_pg", 2023-08-01T19:54:33.914 INFO:teuthology.orchestra.run.smithi101.stdout: "time": "2023-08-01T19:54:04.459216+0000", 2023-08-01T19:54:33.914 INFO:teuthology.orchestra.run.smithi101.stdout: "duration": 4.5050000000000001e-06 2023-08-01T19:54:33.914 INFO:teuthology.orchestra.run.smithi101.stdout: }, 2023-08-01T19:54:33.914 INFO:teuthology.orchestra.run.smithi101.stdout: { 2023-08-01T19:54:33.914 INFO:teuthology.orchestra.run.smithi101.stdout: "event": "reached_pg", 2023-08-01T19:54:33.914 INFO:teuthology.orchestra.run.smithi101.stdout: "time": "2023-08-01T19:54:04.459246+0000", 2023-08-01T19:54:33.915 INFO:teuthology.orchestra.run.smithi101.stdout: "duration": 3.0369999999999999e-05 2023-08-01T19:54:33.915 INFO:teuthology.orchestra.run.smithi101.stdout: }, 2023-08-01T19:54:33.915 INFO:teuthology.orchestra.run.smithi101.stdout: { 2023-08-01T19:54:33.915 INFO:teuthology.orchestra.run.smithi101.stdout: "event": "op must wait for map", 2023-08-01T19:54:33.915 INFO:teuthology.orchestra.run.smithi101.stdout: "time": "2023-08-01T19:54:04.459250+0000", 2023-08-01T19:54:33.915 INFO:teuthology.orchestra.run.smithi101.stdout: "duration": 3.6880000000000001e-06 2023-08-01T19:54:33.915 INFO:teuthology.orchestra.run.smithi101.stdout: }, 2023-08-01T19:54:33.915 INFO:teuthology.orchestra.run.smithi101.stdout: { 2023-08-01T19:54:33.916 INFO:teuthology.orchestra.run.smithi101.stdout: "event": "reached_pg", 2023-08-01T19:54:33.916 INFO:teuthology.orchestra.run.smithi101.stdout: "time": "2023-08-01T19:54:04.469499+0000", 2023-08-01T19:54:33.916 INFO:teuthology.orchestra.run.smithi101.stdout: "duration": 0.010249052 2023-08-01T19:54:33.916 INFO:teuthology.orchestra.run.smithi101.stdout: }, 2023-08-01T19:54:33.916 INFO:teuthology.orchestra.run.smithi101.stdout: { 2023-08-01T19:54:33.916 INFO:teuthology.orchestra.run.smithi101.stdout: "event": "started", 2023-08-01T19:54:33.916 INFO:teuthology.orchestra.run.smithi101.stdout: "time": "2023-08-01T19:54:04.469619+0000", 2023-08-01T19:54:33.916 INFO:teuthology.orchestra.run.smithi101.stdout: "duration": 0.000120061 2023-08-01T19:54:33.917 INFO:teuthology.orchestra.run.smithi101.stdout: }, 2023-08-01T19:54:33.917 INFO:teuthology.orchestra.run.smithi101.stdout: { 2023-08-01T19:54:33.917 INFO:teuthology.orchestra.run.smithi101.stdout: "event": "waiting for subops from 2", 2023-08-01T19:54:33.917 INFO:teuthology.orchestra.run.smithi101.stdout: "time": "2023-08-01T19:54:04.469903+0000", 2023-08-01T19:54:33.917 INFO:teuthology.orchestra.run.smithi101.stdout: "duration": 0.00028409799999999999 2023-08-01T19:54:33.917 INFO:teuthology.orchestra.run.smithi101.stdout: }, 2023-08-01T19:54:33.917 INFO:teuthology.orchestra.run.smithi101.stdout: { 2023-08-01T19:54:33.918 INFO:teuthology.orchestra.run.smithi101.stdout: "event": "sub_op_commit_rec", 2023-08-01T19:54:33.918 INFO:teuthology.orchestra.run.smithi101.stdout: "time": "2023-08-01T19:54:04.475166+0000", 2023-08-01T19:54:33.918 INFO:teuthology.orchestra.run.smithi101.stdout: "duration": 0.0052632460000000001 2023-08-01T19:54:33.918 INFO:teuthology.orchestra.run.smithi101.stdout: }, 2023-08-01T19:54:33.918 INFO:teuthology.orchestra.run.smithi101.stdout: { 2023-08-01T19:54:33.918 INFO:teuthology.orchestra.run.smithi101.stdout: "event": "op_commit", 2023-08-01T19:54:33.918 INFO:teuthology.orchestra.run.smithi101.stdout: "time": "2023-08-01T19:54:04.476056+0000", 2023-08-01T19:54:33.919 INFO:teuthology.orchestra.run.smithi101.stdout: "duration": 0.00089017499999999999 2023-08-01T19:54:33.919 INFO:teuthology.orchestra.run.smithi101.stdout: }, 2023-08-01T19:54:33.919 INFO:teuthology.orchestra.run.smithi101.stdout: { 2023-08-01T19:54:33.919 INFO:teuthology.orchestra.run.smithi101.stdout: "event": "commit_sent", 2023-08-01T19:54:33.919 INFO:teuthology.orchestra.run.smithi101.stdout: "time": "2023-08-01T19:54:04.476115+0000", 2023-08-01T19:54:33.919 INFO:teuthology.orchestra.run.smithi101.stdout: "duration": 5.8464999999999997e-05 2023-08-01T19:54:33.919 INFO:teuthology.orchestra.run.smithi101.stdout: }, 2023-08-01T19:54:33.919 INFO:teuthology.orchestra.run.smithi101.stdout: { 2023-08-01T19:54:33.920 INFO:teuthology.orchestra.run.smithi101.stdout: "event": "done", 2023-08-01T19:54:33.920 INFO:teuthology.orchestra.run.smithi101.stdout: "time": "2023-08-01T19:54:04.476154+0000", 2023-08-01T19:54:33.920 INFO:teuthology.orchestra.run.smithi101.stdout: "duration": 3.9229e-05 2023-08-01T19:54:33.920 INFO:teuthology.orchestra.run.smithi101.stdout: } 2023-08-01T19:54:33.920 INFO:teuthology.orchestra.run.smithi101.stdout: ] 2023-08-01T19:54:33.920 INFO:teuthology.orchestra.run.smithi101.stdout: } 2023-08-01T19:54:33.920 INFO:teuthology.orchestra.run.smithi101.stdout: }, 2023-08-01T19:54:33.920 INFO:teuthology.orchestra.run.smithi101.stdout: { 2023-08-01T19:54:33.921 INFO:teuthology.orchestra.run.smithi101.stdout: "description": "osd_op(mds.0.3:3 3.14 3:287034c4:::1.00000000.inode:head [writefull 0~554] snapc 0=[] ondisk+write+known_if_redirected+full_force+supports_pool_eio e17)", 2023-08-01T19:54:33.921 INFO:teuthology.orchestra.run.smithi101.stdout: "initiated_at": "2023-08-01T19:54:04.459226+0000", 2023-08-01T19:54:33.921 INFO:teuthology.orchestra.run.smithi101.stdout: "age": 29.29173471, 2023-08-01T19:54:33.921 INFO:teuthology.orchestra.run.smithi101.stdout: "duration": 0.021104531999999999, 2023-08-01T19:54:33.921 INFO:teuthology.orchestra.run.smithi101.stdout: "type_data": { 2023-08-01T19:54:33.921 INFO:teuthology.orchestra.run.smithi101.stdout: "flag_point": "commit sent; apply or cleanup", 2023-08-01T19:54:33.921 INFO:teuthology.orchestra.run.smithi101.stdout: "events": [ 2023-08-01T19:54:33.922 INFO:teuthology.orchestra.run.smithi101.stdout: { 2023-08-01T19:54:33.922 INFO:teuthology.orchestra.run.smithi101.stdout: "event": "initiated", 2023-08-01T19:54:33.922 INFO:teuthology.orchestra.run.smithi101.stdout: "time": "2023-08-01T19:54:04.459226+0000", 2023-08-01T19:54:33.922 INFO:teuthology.orchestra.run.smithi101.stdout: "duration": 0 2023-08-01T19:54:33.922 INFO:teuthology.orchestra.run.smithi101.stdout: }, 2023-08-01T19:54:33.922 INFO:teuthology.orchestra.run.smithi101.stdout: { 2023-08-01T19:54:33.922 INFO:teuthology.orchestra.run.smithi101.stdout: "event": "throttled", 2023-08-01T19:54:33.922 INFO:teuthology.orchestra.run.smithi101.stdout: "time": "2023-08-01T19:54:04.459226+0000", 2023-08-01T19:54:33.923 INFO:teuthology.orchestra.run.smithi101.stdout: "duration": 0 2023-08-01T19:54:33.923 INFO:teuthology.orchestra.run.smithi101.stdout: }, 2023-08-01T19:54:33.923 INFO:teuthology.orchestra.run.smithi101.stdout: { 2023-08-01T19:54:33.923 INFO:teuthology.orchestra.run.smithi101.stdout: "event": "header_read", 2023-08-01T19:54:33.923 INFO:teuthology.orchestra.run.smithi101.stdout: "time": "2023-08-01T19:54:04.459225+0000", 2023-08-01T19:54:33.923 INFO:teuthology.orchestra.run.smithi101.stdout: "duration": 4294967295.9999995 2023-08-01T19:54:33.923 INFO:teuthology.orchestra.run.smithi101.stdout: }, 2023-08-01T19:54:33.923 INFO:teuthology.orchestra.run.smithi101.stdout: { 2023-08-01T19:54:33.924 INFO:teuthology.orchestra.run.smithi101.stdout: "event": "all_read", 2023-08-01T19:54:33.924 INFO:teuthology.orchestra.run.smithi101.stdout: "time": "2023-08-01T19:54:04.459238+0000", 2023-08-01T19:54:33.924 INFO:teuthology.orchestra.run.smithi101.stdout: "duration": 1.2809000000000001e-05 2023-08-01T19:54:33.924 INFO:teuthology.orchestra.run.smithi101.stdout: }, 2023-08-01T19:54:33.924 INFO:teuthology.orchestra.run.smithi101.stdout: { 2023-08-01T19:54:33.924 INFO:teuthology.orchestra.run.smithi101.stdout: "event": "dispatched", 2023-08-01T19:54:33.924 INFO:teuthology.orchestra.run.smithi101.stdout: "time": "2023-08-01T19:54:04.459245+0000", 2023-08-01T19:54:33.925 INFO:teuthology.orchestra.run.smithi101.stdout: "duration": 6.6540000000000002e-06 2023-08-01T19:54:33.925 INFO:teuthology.orchestra.run.smithi101.stdout: }, 2023-08-01T19:54:33.925 INFO:teuthology.orchestra.run.smithi101.stdout: { 2023-08-01T19:54:33.925 INFO:teuthology.orchestra.run.smithi101.stdout: "event": "queued_for_pg", 2023-08-01T19:54:33.925 INFO:teuthology.orchestra.run.smithi101.stdout: "time": "2023-08-01T19:54:04.459249+0000", 2023-08-01T19:54:33.925 INFO:teuthology.orchestra.run.smithi101.stdout: "duration": 4.6e-06 2023-08-01T19:54:33.925 INFO:teuthology.orchestra.run.smithi101.stdout: }, 2023-08-01T19:54:33.926 INFO:teuthology.orchestra.run.smithi101.stdout: { 2023-08-01T19:54:33.926 INFO:teuthology.orchestra.run.smithi101.stdout: "event": "reached_pg", 2023-08-01T19:54:33.926 INFO:teuthology.orchestra.run.smithi101.stdout: "time": "2023-08-01T19:54:04.459276+0000", 2023-08-01T19:54:33.926 INFO:teuthology.orchestra.run.smithi101.stdout: "duration": 2.6373999999999999e-05 2023-08-01T19:54:33.926 INFO:teuthology.orchestra.run.smithi101.stdout: }, 2023-08-01T19:54:33.926 INFO:teuthology.orchestra.run.smithi101.stdout: { 2023-08-01T19:54:33.926 INFO:teuthology.orchestra.run.smithi101.stdout: "event": "waiting_for_map not empty", 2023-08-01T19:54:33.926 INFO:teuthology.orchestra.run.smithi101.stdout: "time": "2023-08-01T19:54:04.459278+0000", 2023-08-01T19:54:33.927 INFO:teuthology.orchestra.run.smithi101.stdout: "duration": 2.4980000000000001e-06 2023-08-01T19:54:33.927 INFO:teuthology.orchestra.run.smithi101.stdout: }, 2023-08-01T19:54:33.927 INFO:teuthology.orchestra.run.smithi101.stdout: { 2023-08-01T19:54:33.927 INFO:teuthology.orchestra.run.smithi101.stdout: "event": "reached_pg", 2023-08-01T19:54:33.927 INFO:teuthology.orchestra.run.smithi101.stdout: "time": "2023-08-01T19:54:04.474058+0000", 2023-08-01T19:54:33.927 INFO:teuthology.orchestra.run.smithi101.stdout: "duration": 0.014779979 2023-08-01T19:54:33.927 INFO:teuthology.orchestra.run.smithi101.stdout: }, 2023-08-01T19:54:33.927 INFO:teuthology.orchestra.run.smithi101.stdout: { 2023-08-01T19:54:33.928 INFO:teuthology.orchestra.run.smithi101.stdout: "event": "started", 2023-08-01T19:54:33.928 INFO:teuthology.orchestra.run.smithi101.stdout: "time": "2023-08-01T19:54:04.474614+0000", 2023-08-01T19:54:33.928 INFO:teuthology.orchestra.run.smithi101.stdout: "duration": 0.00055546899999999995 2023-08-01T19:54:33.928 INFO:teuthology.orchestra.run.smithi101.stdout: }, 2023-08-01T19:54:33.928 INFO:teuthology.orchestra.run.smithi101.stdout: { 2023-08-01T19:54:33.928 INFO:teuthology.orchestra.run.smithi101.stdout: "event": "waiting for subops from 2", 2023-08-01T19:54:33.928 INFO:teuthology.orchestra.run.smithi101.stdout: "time": "2023-08-01T19:54:04.474720+0000", 2023-08-01T19:54:33.929 INFO:teuthology.orchestra.run.smithi101.stdout: "duration": 0.00010645300000000001 2023-08-01T19:54:33.929 INFO:teuthology.orchestra.run.smithi101.stdout: }, 2023-08-01T19:54:33.929 INFO:teuthology.orchestra.run.smithi101.stdout: { 2023-08-01T19:54:33.929 INFO:teuthology.orchestra.run.smithi101.stdout: "event": "op_commit", 2023-08-01T19:54:33.929 INFO:teuthology.orchestra.run.smithi101.stdout: "time": "2023-08-01T19:54:04.478480+0000", 2023-08-01T19:54:33.929 INFO:teuthology.orchestra.run.smithi101.stdout: "duration": 0.0037600279999999999 2023-08-01T19:54:33.929 INFO:teuthology.orchestra.run.smithi101.stdout: }, 2023-08-01T19:54:33.929 INFO:teuthology.orchestra.run.smithi101.stdout: { 2023-08-01T19:54:33.930 INFO:teuthology.orchestra.run.smithi101.stdout: "event": "sub_op_commit_rec", 2023-08-01T19:54:33.930 INFO:teuthology.orchestra.run.smithi101.stdout: "time": "2023-08-01T19:54:04.480273+0000", 2023-08-01T19:54:33.930 INFO:teuthology.orchestra.run.smithi101.stdout: "duration": 0.001792465 2023-08-01T19:54:33.930 INFO:teuthology.orchestra.run.smithi101.stdout: }, 2023-08-01T19:54:33.930 INFO:teuthology.orchestra.run.smithi101.stdout: { 2023-08-01T19:54:33.930 INFO:teuthology.orchestra.run.smithi101.stdout: "event": "commit_sent", 2023-08-01T19:54:33.930 INFO:teuthology.orchestra.run.smithi101.stdout: "time": "2023-08-01T19:54:04.480304+0000", 2023-08-01T19:54:33.930 INFO:teuthology.orchestra.run.smithi101.stdout: "duration": 3.1708999999999997e-05 2023-08-01T19:54:33.931 INFO:teuthology.orchestra.run.smithi101.stdout: }, 2023-08-01T19:54:33.931 INFO:teuthology.orchestra.run.smithi101.stdout: { 2023-08-01T19:54:33.931 INFO:teuthology.orchestra.run.smithi101.stdout: "event": "done", 2023-08-01T19:54:33.931 INFO:teuthology.orchestra.run.smithi101.stdout: "time": "2023-08-01T19:54:04.480330+0000", 2023-08-01T19:54:33.931 INFO:teuthology.orchestra.run.smithi101.stdout: "duration": 2.5860999999999999e-05 2023-08-01T19:54:33.931 INFO:teuthology.orchestra.run.smithi101.stdout: } 2023-08-01T19:54:33.931 INFO:teuthology.orchestra.run.smithi101.stdout: ] 2023-08-01T19:54:33.932 INFO:teuthology.orchestra.run.smithi101.stdout: } 2023-08-01T19:54:33.932 INFO:teuthology.orchestra.run.smithi101.stdout: }, 2023-08-01T19:54:33.932 INFO:teuthology.orchestra.run.smithi101.stdout: { 2023-08-01T19:54:33.932 INFO:teuthology.orchestra.run.smithi101.stdout: "description": "osd_op(mds.0.3:27 3.13 3:c91d4a1d:::mds0_inotable:head [writefull 0~34] snapc 0=[] ondisk+write+known_if_redirected+full_force+supports_pool_eio e17)", 2023-08-01T19:54:33.932 INFO:teuthology.orchestra.run.smithi101.stdout: "initiated_at": "2023-08-01T19:54:04.459260+0000", 2023-08-01T19:54:33.932 INFO:teuthology.orchestra.run.smithi101.stdout: "age": 29.291700818999999, 2023-08-01T19:54:33.932 INFO:teuthology.orchestra.run.smithi101.stdout: "duration": 0.016792715999999999, 2023-08-01T19:54:33.932 INFO:teuthology.orchestra.run.smithi101.stdout: "type_data": { 2023-08-01T19:54:33.933 INFO:teuthology.orchestra.run.smithi101.stdout: "flag_point": "commit sent; apply or cleanup", 2023-08-01T19:54:33.933 INFO:teuthology.orchestra.run.smithi101.stdout: "events": [ 2023-08-01T19:54:33.933 INFO:teuthology.orchestra.run.smithi101.stdout: { 2023-08-01T19:54:33.933 INFO:teuthology.orchestra.run.smithi101.stdout: "event": "initiated", 2023-08-01T19:54:33.933 INFO:teuthology.orchestra.run.smithi101.stdout: "time": "2023-08-01T19:54:04.459260+0000", 2023-08-01T19:54:33.933 INFO:teuthology.orchestra.run.smithi101.stdout: "duration": 0 2023-08-01T19:54:33.933 INFO:teuthology.orchestra.run.smithi101.stdout: }, 2023-08-01T19:54:33.933 INFO:teuthology.orchestra.run.smithi101.stdout: { 2023-08-01T19:54:33.934 INFO:teuthology.orchestra.run.smithi101.stdout: "event": "throttled", 2023-08-01T19:54:33.934 INFO:teuthology.orchestra.run.smithi101.stdout: "time": "2023-08-01T19:54:04.459260+0000", 2023-08-01T19:54:33.934 INFO:teuthology.orchestra.run.smithi101.stdout: "duration": 0 2023-08-01T19:54:33.934 INFO:teuthology.orchestra.run.smithi101.stdout: }, 2023-08-01T19:54:33.934 INFO:teuthology.orchestra.run.smithi101.stdout: { 2023-08-01T19:54:33.934 INFO:teuthology.orchestra.run.smithi101.stdout: "event": "header_read", 2023-08-01T19:54:33.934 INFO:teuthology.orchestra.run.smithi101.stdout: "time": "2023-08-01T19:54:04.459259+0000", 2023-08-01T19:54:33.934 INFO:teuthology.orchestra.run.smithi101.stdout: "duration": 4294967295.9999995 2023-08-01T19:54:33.935 INFO:teuthology.orchestra.run.smithi101.stdout: }, 2023-08-01T19:54:33.935 INFO:teuthology.orchestra.run.smithi101.stdout: { 2023-08-01T19:54:33.935 INFO:teuthology.orchestra.run.smithi101.stdout: "event": "all_read", 2023-08-01T19:54:33.935 INFO:teuthology.orchestra.run.smithi101.stdout: "time": "2023-08-01T19:54:04.459263+0000", 2023-08-01T19:54:33.935 INFO:teuthology.orchestra.run.smithi101.stdout: "duration": 3.9249999999999997e-06 2023-08-01T19:54:33.935 INFO:teuthology.orchestra.run.smithi101.stdout: }, 2023-08-01T19:54:33.935 INFO:teuthology.orchestra.run.smithi101.stdout: { 2023-08-01T19:54:33.935 INFO:teuthology.orchestra.run.smithi101.stdout: "event": "dispatched", 2023-08-01T19:54:33.936 INFO:teuthology.orchestra.run.smithi101.stdout: "time": "2023-08-01T19:54:04.459270+0000", 2023-08-01T19:54:33.936 INFO:teuthology.orchestra.run.smithi101.stdout: "duration": 7.0180000000000004e-06 2023-08-01T19:54:33.936 INFO:teuthology.orchestra.run.smithi101.stdout: }, 2023-08-01T19:54:33.936 INFO:teuthology.orchestra.run.smithi101.stdout: { 2023-08-01T19:54:33.936 INFO:teuthology.orchestra.run.smithi101.stdout: "event": "queued_for_pg", 2023-08-01T19:54:33.936 INFO:teuthology.orchestra.run.smithi101.stdout: "time": "2023-08-01T19:54:04.459275+0000", 2023-08-01T19:54:33.936 INFO:teuthology.orchestra.run.smithi101.stdout: "duration": 4.763e-06 2023-08-01T19:54:33.937 INFO:teuthology.orchestra.run.smithi101.stdout: }, 2023-08-01T19:54:33.937 INFO:teuthology.orchestra.run.smithi101.stdout: { 2023-08-01T19:54:33.937 INFO:teuthology.orchestra.run.smithi101.stdout: "event": "reached_pg", 2023-08-01T19:54:33.937 INFO:teuthology.orchestra.run.smithi101.stdout: "time": "2023-08-01T19:54:04.459298+0000", 2023-08-01T19:54:33.937 INFO:teuthology.orchestra.run.smithi101.stdout: "duration": 2.3193e-05 2023-08-01T19:54:33.937 INFO:teuthology.orchestra.run.smithi101.stdout: }, 2023-08-01T19:54:33.937 INFO:teuthology.orchestra.run.smithi101.stdout: { 2023-08-01T19:54:33.937 INFO:teuthology.orchestra.run.smithi101.stdout: "event": "waiting_for_map not empty", 2023-08-01T19:54:33.938 INFO:teuthology.orchestra.run.smithi101.stdout: "time": "2023-08-01T19:54:04.459301+0000", 2023-08-01T19:54:33.938 INFO:teuthology.orchestra.run.smithi101.stdout: "duration": 3.0539999999999999e-06 2023-08-01T19:54:33.938 INFO:teuthology.orchestra.run.smithi101.stdout: }, 2023-08-01T19:54:33.938 INFO:teuthology.orchestra.run.smithi101.stdout: { 2023-08-01T19:54:33.938 INFO:teuthology.orchestra.run.smithi101.stdout: "event": "reached_pg", 2023-08-01T19:54:33.938 INFO:teuthology.orchestra.run.smithi101.stdout: "time": "2023-08-01T19:54:04.469447+0000", 2023-08-01T19:54:33.938 INFO:teuthology.orchestra.run.smithi101.stdout: "duration": 0.010145573999999999 2023-08-01T19:54:33.938 INFO:teuthology.orchestra.run.smithi101.stdout: }, 2023-08-01T19:54:33.939 INFO:teuthology.orchestra.run.smithi101.stdout: { 2023-08-01T19:54:33.939 INFO:teuthology.orchestra.run.smithi101.stdout: "event": "started", 2023-08-01T19:54:33.939 INFO:teuthology.orchestra.run.smithi101.stdout: "time": "2023-08-01T19:54:04.469559+0000", 2023-08-01T19:54:33.939 INFO:teuthology.orchestra.run.smithi101.stdout: "duration": 0.000112068 2023-08-01T19:54:33.939 INFO:teuthology.orchestra.run.smithi101.stdout: }, 2023-08-01T19:54:33.939 INFO:teuthology.orchestra.run.smithi101.stdout: { 2023-08-01T19:54:33.939 INFO:teuthology.orchestra.run.smithi101.stdout: "event": "waiting for subops from 0", 2023-08-01T19:54:33.940 INFO:teuthology.orchestra.run.smithi101.stdout: "time": "2023-08-01T19:54:04.469895+0000", 2023-08-01T19:54:33.940 INFO:teuthology.orchestra.run.smithi101.stdout: "duration": 0.000336604 2023-08-01T19:54:33.940 INFO:teuthology.orchestra.run.smithi101.stdout: }, 2023-08-01T19:54:33.940 INFO:teuthology.orchestra.run.smithi101.stdout: { 2023-08-01T19:54:33.940 INFO:teuthology.orchestra.run.smithi101.stdout: "event": "sub_op_commit_rec", 2023-08-01T19:54:33.940 INFO:teuthology.orchestra.run.smithi101.stdout: "time": "2023-08-01T19:54:04.475096+0000", 2023-08-01T19:54:33.940 INFO:teuthology.orchestra.run.smithi101.stdout: "duration": 0.0052010540000000001 2023-08-01T19:54:33.940 INFO:teuthology.orchestra.run.smithi101.stdout: }, 2023-08-01T19:54:33.941 INFO:teuthology.orchestra.run.smithi101.stdout: { 2023-08-01T19:54:33.941 INFO:teuthology.orchestra.run.smithi101.stdout: "event": "op_commit", 2023-08-01T19:54:33.941 INFO:teuthology.orchestra.run.smithi101.stdout: "time": "2023-08-01T19:54:04.475965+0000", 2023-08-01T19:54:33.941 INFO:teuthology.orchestra.run.smithi101.stdout: "duration": 0.00086860500000000005 2023-08-01T19:54:33.941 INFO:teuthology.orchestra.run.smithi101.stdout: }, 2023-08-01T19:54:33.941 INFO:teuthology.orchestra.run.smithi101.stdout: { 2023-08-01T19:54:33.941 INFO:teuthology.orchestra.run.smithi101.stdout: "event": "commit_sent", 2023-08-01T19:54:33.941 INFO:teuthology.orchestra.run.smithi101.stdout: "time": "2023-08-01T19:54:04.476007+0000", 2023-08-01T19:54:33.942 INFO:teuthology.orchestra.run.smithi101.stdout: "duration": 4.2228000000000003e-05 2023-08-01T19:54:33.942 INFO:teuthology.orchestra.run.smithi101.stdout: }, 2023-08-01T19:54:33.942 INFO:teuthology.orchestra.run.smithi101.stdout: { 2023-08-01T19:54:33.942 INFO:teuthology.orchestra.run.smithi101.stdout: "event": "done", 2023-08-01T19:54:33.942 INFO:teuthology.orchestra.run.smithi101.stdout: "time": "2023-08-01T19:54:04.476052+0000", 2023-08-01T19:54:33.942 INFO:teuthology.orchestra.run.smithi101.stdout: "duration": 4.5188000000000002e-05 2023-08-01T19:54:33.942 INFO:teuthology.orchestra.run.smithi101.stdout: } 2023-08-01T19:54:33.943 INFO:teuthology.orchestra.run.smithi101.stdout: ] 2023-08-01T19:54:33.943 INFO:teuthology.orchestra.run.smithi101.stdout: } 2023-08-01T19:54:33.943 INFO:teuthology.orchestra.run.smithi101.stdout: }, 2023-08-01T19:54:33.943 INFO:teuthology.orchestra.run.smithi101.stdout: { 2023-08-01T19:54:33.943 INFO:teuthology.orchestra.run.smithi101.stdout: "description": "osd_op(mds.0.3:31 3.d 3:b50e409b:::mds_snaptable:head [writefull 0~70] snapc 0=[] ondisk+write+known_if_redirected+full_force+supports_pool_eio e17)", 2023-08-01T19:54:33.943 INFO:teuthology.orchestra.run.smithi101.stdout: "initiated_at": "2023-08-01T19:54:04.459283+0000", 2023-08-01T19:54:33.943 INFO:teuthology.orchestra.run.smithi101.stdout: "age": 29.291677881999998, 2023-08-01T19:54:33.943 INFO:teuthology.orchestra.run.smithi101.stdout: "duration": 0.01676277, 2023-08-01T19:54:33.944 INFO:teuthology.orchestra.run.smithi101.stdout: "type_data": { 2023-08-01T19:54:33.944 INFO:teuthology.orchestra.run.smithi101.stdout: "flag_point": "commit sent; apply or cleanup", 2023-08-01T19:54:33.944 INFO:teuthology.orchestra.run.smithi101.stdout: "events": [ 2023-08-01T19:54:33.944 INFO:teuthology.orchestra.run.smithi101.stdout: { 2023-08-01T19:54:33.944 INFO:teuthology.orchestra.run.smithi101.stdout: "event": "initiated", 2023-08-01T19:54:33.944 INFO:teuthology.orchestra.run.smithi101.stdout: "time": "2023-08-01T19:54:04.459283+0000", 2023-08-01T19:54:33.944 INFO:teuthology.orchestra.run.smithi101.stdout: "duration": 0 2023-08-01T19:54:33.944 INFO:teuthology.orchestra.run.smithi101.stdout: }, 2023-08-01T19:54:33.945 INFO:teuthology.orchestra.run.smithi101.stdout: { 2023-08-01T19:54:33.945 INFO:teuthology.orchestra.run.smithi101.stdout: "event": "throttled", 2023-08-01T19:54:33.945 INFO:teuthology.orchestra.run.smithi101.stdout: "time": "2023-08-01T19:54:04.459283+0000", 2023-08-01T19:54:33.945 INFO:teuthology.orchestra.run.smithi101.stdout: "duration": 0 2023-08-01T19:54:33.945 INFO:teuthology.orchestra.run.smithi101.stdout: }, 2023-08-01T19:54:33.945 INFO:teuthology.orchestra.run.smithi101.stdout: { 2023-08-01T19:54:33.945 INFO:teuthology.orchestra.run.smithi101.stdout: "event": "header_read", 2023-08-01T19:54:33.945 INFO:teuthology.orchestra.run.smithi101.stdout: "time": "2023-08-01T19:54:04.459282+0000", 2023-08-01T19:54:33.946 INFO:teuthology.orchestra.run.smithi101.stdout: "duration": 4294967295.9999995 2023-08-01T19:54:33.946 INFO:teuthology.orchestra.run.smithi101.stdout: }, 2023-08-01T19:54:33.946 INFO:teuthology.orchestra.run.smithi101.stdout: { 2023-08-01T19:54:33.946 INFO:teuthology.orchestra.run.smithi101.stdout: "event": "all_read", 2023-08-01T19:54:33.946 INFO:teuthology.orchestra.run.smithi101.stdout: "time": "2023-08-01T19:54:04.459285+0000", 2023-08-01T19:54:33.946 INFO:teuthology.orchestra.run.smithi101.stdout: "duration": 3.2590000000000001e-06 2023-08-01T19:54:33.946 INFO:teuthology.orchestra.run.smithi101.stdout: }, 2023-08-01T19:54:33.947 INFO:teuthology.orchestra.run.smithi101.stdout: { 2023-08-01T19:54:33.947 INFO:teuthology.orchestra.run.smithi101.stdout: "event": "dispatched", 2023-08-01T19:54:33.947 INFO:teuthology.orchestra.run.smithi101.stdout: "time": "2023-08-01T19:54:04.459291+0000", 2023-08-01T19:54:33.947 INFO:teuthology.orchestra.run.smithi101.stdout: "duration": 6.0750000000000003e-06 2023-08-01T19:54:33.947 INFO:teuthology.orchestra.run.smithi101.stdout: }, 2023-08-01T19:54:33.947 INFO:teuthology.orchestra.run.smithi101.stdout: { 2023-08-01T19:54:33.947 INFO:teuthology.orchestra.run.smithi101.stdout: "event": "queued_for_pg", 2023-08-01T19:54:33.947 INFO:teuthology.orchestra.run.smithi101.stdout: "time": "2023-08-01T19:54:04.459295+0000", 2023-08-01T19:54:33.948 INFO:teuthology.orchestra.run.smithi101.stdout: "duration": 3.7500000000000001e-06 2023-08-01T19:54:33.948 INFO:teuthology.orchestra.run.smithi101.stdout: }, 2023-08-01T19:54:33.948 INFO:teuthology.orchestra.run.smithi101.stdout: { 2023-08-01T19:54:33.948 INFO:teuthology.orchestra.run.smithi101.stdout: "event": "reached_pg", 2023-08-01T19:54:33.948 INFO:teuthology.orchestra.run.smithi101.stdout: "time": "2023-08-01T19:54:04.459323+0000", 2023-08-01T19:54:33.948 INFO:teuthology.orchestra.run.smithi101.stdout: "duration": 2.7351e-05 2023-08-01T19:54:33.948 INFO:teuthology.orchestra.run.smithi101.stdout: }, 2023-08-01T19:54:33.948 INFO:teuthology.orchestra.run.smithi101.stdout: { 2023-08-01T19:54:33.949 INFO:teuthology.orchestra.run.smithi101.stdout: "event": "op must wait for map", 2023-08-01T19:54:33.949 INFO:teuthology.orchestra.run.smithi101.stdout: "time": "2023-08-01T19:54:04.459327+0000", 2023-08-01T19:54:33.949 INFO:teuthology.orchestra.run.smithi101.stdout: "duration": 4.1849999999999997e-06 2023-08-01T19:54:33.949 INFO:teuthology.orchestra.run.smithi101.stdout: }, 2023-08-01T19:54:33.949 INFO:teuthology.orchestra.run.smithi101.stdout: { 2023-08-01T19:54:33.949 INFO:teuthology.orchestra.run.smithi101.stdout: "event": "reached_pg", 2023-08-01T19:54:33.949 INFO:teuthology.orchestra.run.smithi101.stdout: "time": "2023-08-01T19:54:04.468708+0000", 2023-08-01T19:54:33.950 INFO:teuthology.orchestra.run.smithi101.stdout: "duration": 0.0093817420000000002 2023-08-01T19:54:33.950 INFO:teuthology.orchestra.run.smithi101.stdout: }, 2023-08-01T19:54:33.950 INFO:teuthology.orchestra.run.smithi101.stdout: { 2023-08-01T19:54:33.950 INFO:teuthology.orchestra.run.smithi101.stdout: "event": "started", 2023-08-01T19:54:33.950 INFO:teuthology.orchestra.run.smithi101.stdout: "time": "2023-08-01T19:54:04.468830+0000", 2023-08-01T19:54:33.950 INFO:teuthology.orchestra.run.smithi101.stdout: "duration": 0.000121339 2023-08-01T19:54:33.950 INFO:teuthology.orchestra.run.smithi101.stdout: }, 2023-08-01T19:54:33.950 INFO:teuthology.orchestra.run.smithi101.stdout: { 2023-08-01T19:54:33.951 INFO:teuthology.orchestra.run.smithi101.stdout: "event": "waiting for subops from 2", 2023-08-01T19:54:33.951 INFO:teuthology.orchestra.run.smithi101.stdout: "time": "2023-08-01T19:54:04.469611+0000", 2023-08-01T19:54:33.951 INFO:teuthology.orchestra.run.smithi101.stdout: "duration": 0.00078162900000000005 2023-08-01T19:54:33.951 INFO:teuthology.orchestra.run.smithi101.stdout: }, 2023-08-01T19:54:33.951 INFO:teuthology.orchestra.run.smithi101.stdout: { 2023-08-01T19:54:33.951 INFO:teuthology.orchestra.run.smithi101.stdout: "event": "sub_op_commit_rec", 2023-08-01T19:54:33.951 INFO:teuthology.orchestra.run.smithi101.stdout: "time": "2023-08-01T19:54:04.475478+0000", 2023-08-01T19:54:33.952 INFO:teuthology.orchestra.run.smithi101.stdout: "duration": 0.005866586 2023-08-01T19:54:33.952 INFO:teuthology.orchestra.run.smithi101.stdout: }, 2023-08-01T19:54:33.952 INFO:teuthology.orchestra.run.smithi101.stdout: { 2023-08-01T19:54:33.952 INFO:teuthology.orchestra.run.smithi101.stdout: "event": "op_commit", 2023-08-01T19:54:33.952 INFO:teuthology.orchestra.run.smithi101.stdout: "time": "2023-08-01T19:54:04.475941+0000", 2023-08-01T19:54:33.952 INFO:teuthology.orchestra.run.smithi101.stdout: "duration": 0.000462526 2023-08-01T19:54:33.952 INFO:teuthology.orchestra.run.smithi101.stdout: }, 2023-08-01T19:54:33.952 INFO:teuthology.orchestra.run.smithi101.stdout: { 2023-08-01T19:54:33.953 INFO:teuthology.orchestra.run.smithi101.stdout: "event": "commit_sent", 2023-08-01T19:54:33.953 INFO:teuthology.orchestra.run.smithi101.stdout: "time": "2023-08-01T19:54:04.475995+0000", 2023-08-01T19:54:33.953 INFO:teuthology.orchestra.run.smithi101.stdout: "duration": 5.4401000000000003e-05 2023-08-01T19:54:33.953 INFO:teuthology.orchestra.run.smithi101.stdout: }, 2023-08-01T19:54:33.953 INFO:teuthology.orchestra.run.smithi101.stdout: { 2023-08-01T19:54:33.953 INFO:teuthology.orchestra.run.smithi101.stdout: "event": "done", 2023-08-01T19:54:33.953 INFO:teuthology.orchestra.run.smithi101.stdout: "time": "2023-08-01T19:54:04.476045+0000", 2023-08-01T19:54:33.954 INFO:teuthology.orchestra.run.smithi101.stdout: "duration": 5.0389000000000002e-05 2023-08-01T19:54:33.954 INFO:teuthology.orchestra.run.smithi101.stdout: } 2023-08-01T19:54:33.954 INFO:teuthology.orchestra.run.smithi101.stdout: ] 2023-08-01T19:54:33.954 INFO:teuthology.orchestra.run.smithi101.stdout: } 2023-08-01T19:54:33.954 INFO:teuthology.orchestra.run.smithi101.stdout: }, 2023-08-01T19:54:33.954 INFO:teuthology.orchestra.run.smithi101.stdout: { 2023-08-01T19:54:33.954 INFO:teuthology.orchestra.run.smithi101.stdout: "description": "osd_op(mds.0.3:32 3.14 3:2e2fa760:::200.00000001:head [delete] snapc 0=[] ondisk+write+known_if_redirected+full_force+supports_pool_eio e17)", 2023-08-01T19:54:33.954 INFO:teuthology.orchestra.run.smithi101.stdout: "initiated_at": "2023-08-01T19:54:04.459304+0000", 2023-08-01T19:54:33.955 INFO:teuthology.orchestra.run.smithi101.stdout: "age": 29.291656049, 2023-08-01T19:54:33.955 INFO:teuthology.orchestra.run.smithi101.stdout: "duration": 0.021110606000000001, 2023-08-01T19:54:33.955 INFO:teuthology.orchestra.run.smithi101.stdout: "type_data": { 2023-08-01T19:54:33.955 INFO:teuthology.orchestra.run.smithi101.stdout: "flag_point": "started", 2023-08-01T19:54:33.955 INFO:teuthology.orchestra.run.smithi101.stdout: "events": [ 2023-08-01T19:54:33.955 INFO:teuthology.orchestra.run.smithi101.stdout: { 2023-08-01T19:54:33.955 INFO:teuthology.orchestra.run.smithi101.stdout: "event": "initiated", 2023-08-01T19:54:33.955 INFO:teuthology.orchestra.run.smithi101.stdout: "time": "2023-08-01T19:54:04.459304+0000", 2023-08-01T19:54:33.956 INFO:teuthology.orchestra.run.smithi101.stdout: "duration": 0 2023-08-01T19:54:33.956 INFO:teuthology.orchestra.run.smithi101.stdout: }, 2023-08-01T19:54:33.956 INFO:teuthology.orchestra.run.smithi101.stdout: { 2023-08-01T19:54:33.956 INFO:teuthology.orchestra.run.smithi101.stdout: "event": "throttled", 2023-08-01T19:54:33.956 INFO:teuthology.orchestra.run.smithi101.stdout: "time": "2023-08-01T19:54:04.459304+0000", 2023-08-01T19:54:33.956 INFO:teuthology.orchestra.run.smithi101.stdout: "duration": 0 2023-08-01T19:54:33.956 INFO:teuthology.orchestra.run.smithi101.stdout: }, 2023-08-01T19:54:33.956 INFO:teuthology.orchestra.run.smithi101.stdout: { 2023-08-01T19:54:33.957 INFO:teuthology.orchestra.run.smithi101.stdout: "event": "header_read", 2023-08-01T19:54:33.957 INFO:teuthology.orchestra.run.smithi101.stdout: "time": "2023-08-01T19:54:04.459304+0000", 2023-08-01T19:54:33.957 INFO:teuthology.orchestra.run.smithi101.stdout: "duration": 4294967295.9999995 2023-08-01T19:54:33.957 INFO:teuthology.orchestra.run.smithi101.stdout: }, 2023-08-01T19:54:33.957 INFO:teuthology.orchestra.run.smithi101.stdout: { 2023-08-01T19:54:33.957 INFO:teuthology.orchestra.run.smithi101.stdout: "event": "all_read", 2023-08-01T19:54:33.957 INFO:teuthology.orchestra.run.smithi101.stdout: "time": "2023-08-01T19:54:04.459306+0000", 2023-08-01T19:54:33.957 INFO:teuthology.orchestra.run.smithi101.stdout: "duration": 2.3889999999999999e-06 2023-08-01T19:54:33.958 INFO:teuthology.orchestra.run.smithi101.stdout: }, 2023-08-01T19:54:33.958 INFO:teuthology.orchestra.run.smithi101.stdout: { 2023-08-01T19:54:33.958 INFO:teuthology.orchestra.run.smithi101.stdout: "event": "dispatched", 2023-08-01T19:54:33.958 INFO:teuthology.orchestra.run.smithi101.stdout: "time": "2023-08-01T19:54:04.459314+0000", 2023-08-01T19:54:33.958 INFO:teuthology.orchestra.run.smithi101.stdout: "duration": 7.1180000000000003e-06 2023-08-01T19:54:33.958 INFO:teuthology.orchestra.run.smithi101.stdout: }, 2023-08-01T19:54:33.958 INFO:teuthology.orchestra.run.smithi101.stdout: { 2023-08-01T19:54:33.958 INFO:teuthology.orchestra.run.smithi101.stdout: "event": "queued_for_pg", 2023-08-01T19:54:33.959 INFO:teuthology.orchestra.run.smithi101.stdout: "time": "2023-08-01T19:54:04.459318+0000", 2023-08-01T19:54:33.959 INFO:teuthology.orchestra.run.smithi101.stdout: "duration": 4.0239999999999999e-06 2023-08-01T19:54:33.959 INFO:teuthology.orchestra.run.smithi101.stdout: }, 2023-08-01T19:54:33.959 INFO:teuthology.orchestra.run.smithi101.stdout: { 2023-08-01T19:54:33.959 INFO:teuthology.orchestra.run.smithi101.stdout: "event": "reached_pg", 2023-08-01T19:54:33.959 INFO:teuthology.orchestra.run.smithi101.stdout: "time": "2023-08-01T19:54:04.459340+0000", 2023-08-01T19:54:33.959 INFO:teuthology.orchestra.run.smithi101.stdout: "duration": 2.2476e-05 2023-08-01T19:54:33.960 INFO:teuthology.orchestra.run.smithi101.stdout: }, 2023-08-01T19:54:33.960 INFO:teuthology.orchestra.run.smithi101.stdout: { 2023-08-01T19:54:33.960 INFO:teuthology.orchestra.run.smithi101.stdout: "event": "waiting_for_map not empty", 2023-08-01T19:54:33.960 INFO:teuthology.orchestra.run.smithi101.stdout: "time": "2023-08-01T19:54:04.459342+0000", 2023-08-01T19:54:33.960 INFO:teuthology.orchestra.run.smithi101.stdout: "duration": 2.272e-06 2023-08-01T19:54:33.960 INFO:teuthology.orchestra.run.smithi101.stdout: }, 2023-08-01T19:54:33.960 INFO:teuthology.orchestra.run.smithi101.stdout: { 2023-08-01T19:54:33.960 INFO:teuthology.orchestra.run.smithi101.stdout: "event": "reached_pg", 2023-08-01T19:54:33.961 INFO:teuthology.orchestra.run.smithi101.stdout: "time": "2023-08-01T19:54:04.475922+0000", 2023-08-01T19:54:33.961 INFO:teuthology.orchestra.run.smithi101.stdout: "duration": 0.016579388 2023-08-01T19:54:33.961 INFO:teuthology.orchestra.run.smithi101.stdout: }, 2023-08-01T19:54:33.961 INFO:teuthology.orchestra.run.smithi101.stdout: { 2023-08-01T19:54:33.961 INFO:teuthology.orchestra.run.smithi101.stdout: "event": "started", 2023-08-01T19:54:33.961 INFO:teuthology.orchestra.run.smithi101.stdout: "time": "2023-08-01T19:54:04.476107+0000", 2023-08-01T19:54:33.961 INFO:teuthology.orchestra.run.smithi101.stdout: "duration": 0.00018486300000000001 2023-08-01T19:54:33.961 INFO:teuthology.orchestra.run.smithi101.stdout: }, 2023-08-01T19:54:33.962 INFO:teuthology.orchestra.run.smithi101.stdout: { 2023-08-01T19:54:33.962 INFO:teuthology.orchestra.run.smithi101.stdout: "event": "done", 2023-08-01T19:54:33.962 INFO:teuthology.orchestra.run.smithi101.stdout: "time": "2023-08-01T19:54:04.480415+0000", 2023-08-01T19:54:33.962 INFO:teuthology.orchestra.run.smithi101.stdout: "duration": 0.0043084589999999997 2023-08-01T19:54:33.962 INFO:teuthology.orchestra.run.smithi101.stdout: } 2023-08-01T19:54:33.962 INFO:teuthology.orchestra.run.smithi101.stdout: ] 2023-08-01T19:54:33.962 INFO:teuthology.orchestra.run.smithi101.stdout: } 2023-08-01T19:54:33.963 INFO:teuthology.orchestra.run.smithi101.stdout: }, 2023-08-01T19:54:33.963 INFO:teuthology.orchestra.run.smithi101.stdout: { 2023-08-01T19:54:33.963 INFO:teuthology.orchestra.run.smithi101.stdout: "description": "osd_repop(client.4668.0:18360 5.6 e23/19 5:65d8e237:::benchmark_data_smithi006_114134_object18359:head v 23'1125, mlcod=23'1120)", 2023-08-01T19:54:33.963 INFO:teuthology.orchestra.run.smithi101.stdout: "initiated_at": "2023-08-01T19:54:28.996096+0000", 2023-08-01T19:54:33.963 INFO:teuthology.orchestra.run.smithi101.stdout: "age": 4.7548639880000003, 2023-08-01T19:54:33.963 INFO:teuthology.orchestra.run.smithi101.stdout: "duration": 0.015251308999999999, 2023-08-01T19:54:33.963 INFO:teuthology.orchestra.run.smithi101.stdout: "type_data": { 2023-08-01T19:54:33.963 INFO:teuthology.orchestra.run.smithi101.stdout: "flag_point": "commit sent; apply or cleanup", 2023-08-01T19:54:33.964 INFO:teuthology.orchestra.run.smithi101.stdout: "events": [ 2023-08-01T19:54:33.964 INFO:teuthology.orchestra.run.smithi101.stdout: { 2023-08-01T19:54:33.964 INFO:teuthology.orchestra.run.smithi101.stdout: "event": "initiated", 2023-08-01T19:54:33.964 INFO:teuthology.orchestra.run.smithi101.stdout: "time": "2023-08-01T19:54:28.996096+0000", 2023-08-01T19:54:33.964 INFO:teuthology.orchestra.run.smithi101.stdout: "duration": 0 2023-08-01T19:54:33.964 INFO:teuthology.orchestra.run.smithi101.stdout: }, 2023-08-01T19:54:33.964 INFO:teuthology.orchestra.run.smithi101.stdout: { 2023-08-01T19:54:33.964 INFO:teuthology.orchestra.run.smithi101.stdout: "event": "throttled", 2023-08-01T19:54:33.965 INFO:teuthology.orchestra.run.smithi101.stdout: "time": "2023-08-01T19:54:28.996096+0000", 2023-08-01T19:54:33.965 INFO:teuthology.orchestra.run.smithi101.stdout: "duration": 0 2023-08-01T19:54:33.965 INFO:teuthology.orchestra.run.smithi101.stdout: }, 2023-08-01T19:54:33.965 INFO:teuthology.orchestra.run.smithi101.stdout: { 2023-08-01T19:54:33.965 INFO:teuthology.orchestra.run.smithi101.stdout: "event": "header_read", 2023-08-01T19:54:33.965 INFO:teuthology.orchestra.run.smithi101.stdout: "time": "2023-08-01T19:54:28.996096+0000", 2023-08-01T19:54:33.965 INFO:teuthology.orchestra.run.smithi101.stdout: "duration": 4294967295.9999995 2023-08-01T19:54:33.965 INFO:teuthology.orchestra.run.smithi101.stdout: }, 2023-08-01T19:54:33.966 INFO:teuthology.orchestra.run.smithi101.stdout: { 2023-08-01T19:54:33.966 INFO:teuthology.orchestra.run.smithi101.stdout: "event": "all_read", 2023-08-01T19:54:33.966 INFO:teuthology.orchestra.run.smithi101.stdout: "time": "2023-08-01T19:54:28.996167+0000", 2023-08-01T19:54:33.966 INFO:teuthology.orchestra.run.smithi101.stdout: "duration": 7.0716999999999994e-05 2023-08-01T19:54:33.966 INFO:teuthology.orchestra.run.smithi101.stdout: }, 2023-08-01T19:54:33.966 INFO:teuthology.orchestra.run.smithi101.stdout: { 2023-08-01T19:54:33.966 INFO:teuthology.orchestra.run.smithi101.stdout: "event": "dispatched", 2023-08-01T19:54:33.967 INFO:teuthology.orchestra.run.smithi101.stdout: "time": "2023-08-01T19:54:28.996177+0000", 2023-08-01T19:54:33.967 INFO:teuthology.orchestra.run.smithi101.stdout: "duration": 1.0479000000000001e-05 2023-08-01T19:54:33.967 INFO:teuthology.orchestra.run.smithi101.stdout: }, 2023-08-01T19:54:33.967 INFO:teuthology.orchestra.run.smithi101.stdout: { 2023-08-01T19:54:33.967 INFO:teuthology.orchestra.run.smithi101.stdout: "event": "queued_for_pg", 2023-08-01T19:54:33.967 INFO:teuthology.orchestra.run.smithi101.stdout: "time": "2023-08-01T19:54:28.996182+0000", 2023-08-01T19:54:33.967 INFO:teuthology.orchestra.run.smithi101.stdout: "duration": 5.2329999999999997e-06 2023-08-01T19:54:33.967 INFO:teuthology.orchestra.run.smithi101.stdout: }, 2023-08-01T19:54:33.968 INFO:teuthology.orchestra.run.smithi101.stdout: { 2023-08-01T19:54:33.968 INFO:teuthology.orchestra.run.smithi101.stdout: "event": "reached_pg", 2023-08-01T19:54:33.968 INFO:teuthology.orchestra.run.smithi101.stdout: "time": "2023-08-01T19:54:28.996224+0000", 2023-08-01T19:54:33.968 INFO:teuthology.orchestra.run.smithi101.stdout: "duration": 4.1897999999999998e-05 2023-08-01T19:54:33.968 INFO:teuthology.orchestra.run.smithi101.stdout: }, 2023-08-01T19:54:33.968 INFO:teuthology.orchestra.run.smithi101.stdout: { 2023-08-01T19:54:33.968 INFO:teuthology.orchestra.run.smithi101.stdout: "event": "started", 2023-08-01T19:54:33.968 INFO:teuthology.orchestra.run.smithi101.stdout: "time": "2023-08-01T19:54:28.996236+0000", 2023-08-01T19:54:33.969 INFO:teuthology.orchestra.run.smithi101.stdout: "duration": 1.1980999999999999e-05 2023-08-01T19:54:33.969 INFO:teuthology.orchestra.run.smithi101.stdout: }, 2023-08-01T19:54:33.969 INFO:teuthology.orchestra.run.smithi101.stdout: { 2023-08-01T19:54:33.969 INFO:teuthology.orchestra.run.smithi101.stdout: "event": "commit_sent", 2023-08-01T19:54:33.969 INFO:teuthology.orchestra.run.smithi101.stdout: "time": "2023-08-01T19:54:29.011316+0000", 2023-08-01T19:54:33.969 INFO:teuthology.orchestra.run.smithi101.stdout: "duration": 0.015079323 2023-08-01T19:54:33.969 INFO:teuthology.orchestra.run.smithi101.stdout: }, 2023-08-01T19:54:33.969 INFO:teuthology.orchestra.run.smithi101.stdout: { 2023-08-01T19:54:33.970 INFO:teuthology.orchestra.run.smithi101.stdout: "event": "done", 2023-08-01T19:54:33.970 INFO:teuthology.orchestra.run.smithi101.stdout: "time": "2023-08-01T19:54:29.011348+0000", 2023-08-01T19:54:33.970 INFO:teuthology.orchestra.run.smithi101.stdout: "duration": 3.2228999999999999e-05 2023-08-01T19:54:33.970 INFO:teuthology.orchestra.run.smithi101.stdout: } 2023-08-01T19:54:33.970 INFO:teuthology.orchestra.run.smithi101.stdout: ] 2023-08-01T19:54:33.970 INFO:teuthology.orchestra.run.smithi101.stdout: } 2023-08-01T19:54:33.970 INFO:teuthology.orchestra.run.smithi101.stdout: } 2023-08-01T19:54:33.971 INFO:teuthology.orchestra.run.smithi101.stdout: ] 2023-08-01T19:54:33.971 INFO:teuthology.orchestra.run.smithi101.stdout:} 2023-08-01T19:54:33.972 DEBUG:teuthology.orchestra.run.smithi155:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 30 ceph --cluster ceph --admin-daemon /var/run/ceph/ceph-osd.2.asok dump_ops_in_flight 2023-08-01T19:54:33.973 INFO:tasks.ceph.osd.2.smithi155.stderr:2023-08-01T19:54:33.971+0000 7faa5c6ac700 -1 received signal: Hangup from /usr/bin/python3 /bin/daemon-helper kill ceph-osd -f --cluster ceph -i 2 (PID: 111337) UID: 0 2023-08-01T19:54:34.072 INFO:tasks.ceph.osd.1.smithi101.stderr:2023-08-01T19:54:34.071+0000 7fb0cb7f6700 -1 received signal: Hangup from /usr/bin/python3 /bin/daemon-helper kill ceph-osd -f --cluster ceph -i 1 (PID: 111141) UID: 0 2023-08-01T19:54:34.147 INFO:teuthology.orchestra.run.smithi155.stdout:{ 2023-08-01T19:54:34.148 INFO:teuthology.orchestra.run.smithi155.stdout: "ops": [ 2023-08-01T19:54:34.148 INFO:teuthology.orchestra.run.smithi155.stdout: { 2023-08-01T19:54:34.148 INFO:teuthology.orchestra.run.smithi155.stdout: "description": "osd_op(client.4668.0:34318 5.4 5:2c9f4a18:::benchmark_data_smithi006_114134_object34317:head [set-alloc-hint object_size 65536 write_size 65536,write 0~65536 in=65536b] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e24)", 2023-08-01T19:54:34.148 INFO:teuthology.orchestra.run.smithi155.stdout: "initiated_at": "2023-08-01T19:54:34.141393+0000", 2023-08-01T19:54:34.148 INFO:teuthology.orchestra.run.smithi155.stdout: "age": 0.0048106090000000004, 2023-08-01T19:54:34.148 INFO:teuthology.orchestra.run.smithi155.stdout: "duration": 0.004831732, 2023-08-01T19:54:34.148 INFO:teuthology.orchestra.run.smithi155.stdout: "type_data": { 2023-08-01T19:54:34.149 INFO:teuthology.orchestra.run.smithi155.stdout: "flag_point": "waiting for sub ops", 2023-08-01T19:54:34.149 INFO:teuthology.orchestra.run.smithi155.stdout: "client_info": { 2023-08-01T19:54:34.149 INFO:teuthology.orchestra.run.smithi155.stdout: "client": "client.4668", 2023-08-01T19:54:34.149 INFO:teuthology.orchestra.run.smithi155.stdout: "client_addr": "172.21.15.6:0/1709472247", 2023-08-01T19:54:34.149 INFO:teuthology.orchestra.run.smithi155.stdout: "tid": 34318 2023-08-01T19:54:34.149 INFO:teuthology.orchestra.run.smithi155.stdout: }, 2023-08-01T19:54:34.149 INFO:teuthology.orchestra.run.smithi155.stdout: "events": [ 2023-08-01T19:54:34.150 INFO:teuthology.orchestra.run.smithi155.stdout: { 2023-08-01T19:54:34.150 INFO:teuthology.orchestra.run.smithi155.stdout: "event": "initiated", 2023-08-01T19:54:34.150 INFO:teuthology.orchestra.run.smithi155.stdout: "time": "2023-08-01T19:54:34.141393+0000", 2023-08-01T19:54:34.150 INFO:teuthology.orchestra.run.smithi155.stdout: "duration": 0 2023-08-01T19:54:34.150 INFO:teuthology.orchestra.run.smithi155.stdout: }, 2023-08-01T19:54:34.150 INFO:teuthology.orchestra.run.smithi155.stdout: { 2023-08-01T19:54:34.150 INFO:teuthology.orchestra.run.smithi155.stdout: "event": "throttled", 2023-08-01T19:54:34.150 INFO:teuthology.orchestra.run.smithi155.stdout: "time": "2023-08-01T19:54:34.141393+0000", 2023-08-01T19:54:34.151 INFO:teuthology.orchestra.run.smithi155.stdout: "duration": 0 2023-08-01T19:54:34.151 INFO:teuthology.orchestra.run.smithi155.stdout: }, 2023-08-01T19:54:34.151 INFO:teuthology.orchestra.run.smithi155.stdout: { 2023-08-01T19:54:34.151 INFO:teuthology.orchestra.run.smithi155.stdout: "event": "header_read", 2023-08-01T19:54:34.151 INFO:teuthology.orchestra.run.smithi155.stdout: "time": "2023-08-01T19:54:34.141392+0000", 2023-08-01T19:54:34.151 INFO:teuthology.orchestra.run.smithi155.stdout: "duration": 4294967295.999999 2023-08-01T19:54:34.151 INFO:teuthology.orchestra.run.smithi155.stdout: }, 2023-08-01T19:54:34.152 INFO:teuthology.orchestra.run.smithi155.stdout: { 2023-08-01T19:54:34.152 INFO:teuthology.orchestra.run.smithi155.stdout: "event": "all_read", 2023-08-01T19:54:34.152 INFO:teuthology.orchestra.run.smithi155.stdout: "time": "2023-08-01T19:54:34.141466+0000", 2023-08-01T19:54:34.152 INFO:teuthology.orchestra.run.smithi155.stdout: "duration": 7.4456000000000007e-05 2023-08-01T19:54:34.152 INFO:teuthology.orchestra.run.smithi155.stdout: }, 2023-08-01T19:54:34.152 INFO:teuthology.orchestra.run.smithi155.stdout: { 2023-08-01T19:54:34.152 INFO:teuthology.orchestra.run.smithi155.stdout: "event": "dispatched", 2023-08-01T19:54:34.153 INFO:teuthology.orchestra.run.smithi155.stdout: "time": "2023-08-01T19:54:34.141480+0000", 2023-08-01T19:54:34.153 INFO:teuthology.orchestra.run.smithi155.stdout: "duration": 1.3521e-05 2023-08-01T19:54:34.153 INFO:teuthology.orchestra.run.smithi155.stdout: }, 2023-08-01T19:54:34.153 INFO:teuthology.orchestra.run.smithi155.stdout: { 2023-08-01T19:54:34.153 INFO:teuthology.orchestra.run.smithi155.stdout: "event": "queued_for_pg", 2023-08-01T19:54:34.153 INFO:teuthology.orchestra.run.smithi155.stdout: "time": "2023-08-01T19:54:34.141486+0000", 2023-08-01T19:54:34.153 INFO:teuthology.orchestra.run.smithi155.stdout: "duration": 6.387e-06 2023-08-01T19:54:34.154 INFO:teuthology.orchestra.run.smithi155.stdout: }, 2023-08-01T19:54:34.154 INFO:teuthology.orchestra.run.smithi155.stdout: { 2023-08-01T19:54:34.154 INFO:teuthology.orchestra.run.smithi155.stdout: "event": "reached_pg", 2023-08-01T19:54:34.154 INFO:teuthology.orchestra.run.smithi155.stdout: "time": "2023-08-01T19:54:34.141525+0000", 2023-08-01T19:54:34.154 INFO:teuthology.orchestra.run.smithi155.stdout: "duration": 3.8442999999999998e-05 2023-08-01T19:54:34.154 INFO:teuthology.orchestra.run.smithi155.stdout: }, 2023-08-01T19:54:34.154 INFO:teuthology.orchestra.run.smithi155.stdout: { 2023-08-01T19:54:34.154 INFO:teuthology.orchestra.run.smithi155.stdout: "event": "started", 2023-08-01T19:54:34.155 INFO:teuthology.orchestra.run.smithi155.stdout: "time": "2023-08-01T19:54:34.141645+0000", 2023-08-01T19:54:34.155 INFO:teuthology.orchestra.run.smithi155.stdout: "duration": 0.00012069399999999999 2023-08-01T19:54:34.155 INFO:teuthology.orchestra.run.smithi155.stdout: }, 2023-08-01T19:54:34.155 INFO:teuthology.orchestra.run.smithi155.stdout: { 2023-08-01T19:54:34.155 INFO:teuthology.orchestra.run.smithi155.stdout: "event": "waiting for subops from 0", 2023-08-01T19:54:34.155 INFO:teuthology.orchestra.run.smithi155.stdout: "time": "2023-08-01T19:54:34.141781+0000", 2023-08-01T19:54:34.155 INFO:teuthology.orchestra.run.smithi155.stdout: "duration": 0.00013578799999999999 2023-08-01T19:54:34.156 INFO:teuthology.orchestra.run.smithi155.stdout: }, 2023-08-01T19:54:34.156 INFO:teuthology.orchestra.run.smithi155.stdout: { 2023-08-01T19:54:34.156 INFO:teuthology.orchestra.run.smithi155.stdout: "event": "sub_op_commit_rec", 2023-08-01T19:54:34.156 INFO:teuthology.orchestra.run.smithi155.stdout: "time": "2023-08-01T19:54:34.145565+0000", 2023-08-01T19:54:34.156 INFO:teuthology.orchestra.run.smithi155.stdout: "duration": 0.0037839390000000001 2023-08-01T19:54:34.156 INFO:teuthology.orchestra.run.smithi155.stdout: } 2023-08-01T19:54:34.156 INFO:teuthology.orchestra.run.smithi155.stdout: ] 2023-08-01T19:54:34.157 INFO:teuthology.orchestra.run.smithi155.stdout: } 2023-08-01T19:54:34.157 INFO:teuthology.orchestra.run.smithi155.stdout: }, 2023-08-01T19:54:34.157 INFO:teuthology.orchestra.run.smithi155.stdout: { 2023-08-01T19:54:34.157 INFO:teuthology.orchestra.run.smithi155.stdout: "description": "osd_op(client.4668.0:34321 5.b 5:d4a08129:::benchmark_data_smithi006_114134_object34320:head [set-alloc-hint object_size 65536 write_size 65536,write 0~65536 in=65536b] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e24)", 2023-08-01T19:54:34.157 INFO:teuthology.orchestra.run.smithi155.stdout: "initiated_at": "2023-08-01T19:54:34.142129+0000", 2023-08-01T19:54:34.157 INFO:teuthology.orchestra.run.smithi155.stdout: "age": 0.0040747789999999997, 2023-08-01T19:54:34.157 INFO:teuthology.orchestra.run.smithi155.stdout: "duration": 0.0041503699999999996, 2023-08-01T19:54:34.157 INFO:teuthology.orchestra.run.smithi155.stdout: "type_data": { 2023-08-01T19:54:34.158 INFO:teuthology.orchestra.run.smithi155.stdout: "flag_point": "waiting for sub ops", 2023-08-01T19:54:34.158 INFO:teuthology.orchestra.run.smithi155.stdout: "client_info": { 2023-08-01T19:54:34.158 INFO:teuthology.orchestra.run.smithi155.stdout: "client": "client.4668", 2023-08-01T19:54:34.158 INFO:teuthology.orchestra.run.smithi155.stdout: "client_addr": "172.21.15.6:0/1709472247", 2023-08-01T19:54:34.158 INFO:teuthology.orchestra.run.smithi155.stdout: "tid": 34321 2023-08-01T19:54:34.158 INFO:teuthology.orchestra.run.smithi155.stdout: }, 2023-08-01T19:54:34.158 INFO:teuthology.orchestra.run.smithi155.stdout: "events": [ 2023-08-01T19:54:34.158 INFO:teuthology.orchestra.run.smithi155.stdout: { 2023-08-01T19:54:34.159 INFO:teuthology.orchestra.run.smithi155.stdout: "event": "initiated", 2023-08-01T19:54:34.159 INFO:teuthology.orchestra.run.smithi155.stdout: "time": "2023-08-01T19:54:34.142129+0000", 2023-08-01T19:54:34.159 INFO:teuthology.orchestra.run.smithi155.stdout: "duration": 0 2023-08-01T19:54:34.159 INFO:teuthology.orchestra.run.smithi155.stdout: }, 2023-08-01T19:54:34.159 INFO:teuthology.orchestra.run.smithi155.stdout: { 2023-08-01T19:54:34.159 INFO:teuthology.orchestra.run.smithi155.stdout: "event": "throttled", 2023-08-01T19:54:34.159 INFO:teuthology.orchestra.run.smithi155.stdout: "time": "2023-08-01T19:54:34.142129+0000", 2023-08-01T19:54:34.160 INFO:teuthology.orchestra.run.smithi155.stdout: "duration": 0 2023-08-01T19:54:34.160 INFO:teuthology.orchestra.run.smithi155.stdout: }, 2023-08-01T19:54:34.160 INFO:teuthology.orchestra.run.smithi155.stdout: { 2023-08-01T19:54:34.160 INFO:teuthology.orchestra.run.smithi155.stdout: "event": "header_read", 2023-08-01T19:54:34.160 INFO:teuthology.orchestra.run.smithi155.stdout: "time": "2023-08-01T19:54:34.142128+0000", 2023-08-01T19:54:34.160 INFO:teuthology.orchestra.run.smithi155.stdout: "duration": 4294967295.999999 2023-08-01T19:54:34.160 INFO:teuthology.orchestra.run.smithi155.stdout: }, 2023-08-01T19:54:34.160 INFO:teuthology.orchestra.run.smithi155.stdout: { 2023-08-01T19:54:34.161 INFO:teuthology.orchestra.run.smithi155.stdout: "event": "all_read", 2023-08-01T19:54:34.161 INFO:teuthology.orchestra.run.smithi155.stdout: "time": "2023-08-01T19:54:34.142237+0000", 2023-08-01T19:54:34.161 INFO:teuthology.orchestra.run.smithi155.stdout: "duration": 0.000109232 2023-08-01T19:54:34.161 INFO:teuthology.orchestra.run.smithi155.stdout: }, 2023-08-01T19:54:34.161 INFO:teuthology.orchestra.run.smithi155.stdout: { 2023-08-01T19:54:34.161 INFO:teuthology.orchestra.run.smithi155.stdout: "event": "dispatched", 2023-08-01T19:54:34.161 INFO:teuthology.orchestra.run.smithi155.stdout: "time": "2023-08-01T19:54:34.142251+0000", 2023-08-01T19:54:34.162 INFO:teuthology.orchestra.run.smithi155.stdout: "duration": 1.3494e-05 2023-08-01T19:54:34.162 INFO:teuthology.orchestra.run.smithi155.stdout: }, 2023-08-01T19:54:34.162 INFO:teuthology.orchestra.run.smithi155.stdout: { 2023-08-01T19:54:34.162 INFO:teuthology.orchestra.run.smithi155.stdout: "event": "queued_for_pg", 2023-08-01T19:54:34.162 INFO:teuthology.orchestra.run.smithi155.stdout: "time": "2023-08-01T19:54:34.142257+0000", 2023-08-01T19:54:34.162 INFO:teuthology.orchestra.run.smithi155.stdout: "duration": 6.3199999999999996e-06 2023-08-01T19:54:34.162 INFO:teuthology.orchestra.run.smithi155.stdout: }, 2023-08-01T19:54:34.162 INFO:teuthology.orchestra.run.smithi155.stdout: { 2023-08-01T19:54:34.163 INFO:teuthology.orchestra.run.smithi155.stdout: "event": "reached_pg", 2023-08-01T19:54:34.163 INFO:teuthology.orchestra.run.smithi155.stdout: "time": "2023-08-01T19:54:34.142292+0000", 2023-08-01T19:54:34.163 INFO:teuthology.orchestra.run.smithi155.stdout: "duration": 3.5249000000000001e-05 2023-08-01T19:54:34.163 INFO:teuthology.orchestra.run.smithi155.stdout: }, 2023-08-01T19:54:34.163 INFO:teuthology.orchestra.run.smithi155.stdout: { 2023-08-01T19:54:34.163 INFO:teuthology.orchestra.run.smithi155.stdout: "event": "started", 2023-08-01T19:54:34.163 INFO:teuthology.orchestra.run.smithi155.stdout: "time": "2023-08-01T19:54:34.142366+0000", 2023-08-01T19:54:34.163 INFO:teuthology.orchestra.run.smithi155.stdout: "duration": 7.4257000000000004e-05 2023-08-01T19:54:34.164 INFO:teuthology.orchestra.run.smithi155.stdout: }, 2023-08-01T19:54:34.164 INFO:teuthology.orchestra.run.smithi155.stdout: { 2023-08-01T19:54:34.164 INFO:teuthology.orchestra.run.smithi155.stdout: "event": "waiting for subops from 0", 2023-08-01T19:54:34.164 INFO:teuthology.orchestra.run.smithi155.stdout: "time": "2023-08-01T19:54:34.142513+0000", 2023-08-01T19:54:34.164 INFO:teuthology.orchestra.run.smithi155.stdout: "duration": 0.00014643999999999999 2023-08-01T19:54:34.164 INFO:teuthology.orchestra.run.smithi155.stdout: }, 2023-08-01T19:54:34.164 INFO:teuthology.orchestra.run.smithi155.stdout: { 2023-08-01T19:54:34.165 INFO:teuthology.orchestra.run.smithi155.stdout: "event": "sub_op_commit_rec", 2023-08-01T19:54:34.165 INFO:teuthology.orchestra.run.smithi155.stdout: "time": "2023-08-01T19:54:34.145599+0000", 2023-08-01T19:54:34.165 INFO:teuthology.orchestra.run.smithi155.stdout: "duration": 0.0030865409999999999 2023-08-01T19:54:34.165 INFO:teuthology.orchestra.run.smithi155.stdout: } 2023-08-01T19:54:34.165 INFO:teuthology.orchestra.run.smithi155.stdout: ] 2023-08-01T19:54:34.165 INFO:teuthology.orchestra.run.smithi155.stdout: } 2023-08-01T19:54:34.165 INFO:teuthology.orchestra.run.smithi155.stdout: }, 2023-08-01T19:54:34.165 INFO:teuthology.orchestra.run.smithi155.stdout: { 2023-08-01T19:54:34.166 INFO:teuthology.orchestra.run.smithi155.stdout: "description": "osd_repop(client.4668.0:34314 5.a e24/19 5:524067da:::benchmark_data_smithi006_114134_object34313:head v 24'2120, mlcod=24'2117)", 2023-08-01T19:54:34.166 INFO:teuthology.orchestra.run.smithi155.stdout: "initiated_at": "2023-08-01T19:54:34.142397+0000", 2023-08-01T19:54:34.166 INFO:teuthology.orchestra.run.smithi155.stdout: "age": 0.0038070999999999999, 2023-08-01T19:54:34.166 INFO:teuthology.orchestra.run.smithi155.stdout: "duration": 0.0039288109999999999, 2023-08-01T19:54:34.166 INFO:teuthology.orchestra.run.smithi155.stdout: "type_data": { 2023-08-01T19:54:34.166 INFO:teuthology.orchestra.run.smithi155.stdout: "flag_point": "started", 2023-08-01T19:54:34.166 INFO:teuthology.orchestra.run.smithi155.stdout: "events": [ 2023-08-01T19:54:34.166 INFO:teuthology.orchestra.run.smithi155.stdout: { 2023-08-01T19:54:34.167 INFO:teuthology.orchestra.run.smithi155.stdout: "event": "initiated", 2023-08-01T19:54:34.167 INFO:teuthology.orchestra.run.smithi155.stdout: "time": "2023-08-01T19:54:34.142397+0000", 2023-08-01T19:54:34.167 INFO:teuthology.orchestra.run.smithi155.stdout: "duration": 0 2023-08-01T19:54:34.167 INFO:teuthology.orchestra.run.smithi155.stdout: }, 2023-08-01T19:54:34.167 INFO:teuthology.orchestra.run.smithi155.stdout: { 2023-08-01T19:54:34.167 INFO:teuthology.orchestra.run.smithi155.stdout: "event": "throttled", 2023-08-01T19:54:34.167 INFO:teuthology.orchestra.run.smithi155.stdout: "time": "2023-08-01T19:54:34.142397+0000", 2023-08-01T19:54:34.168 INFO:teuthology.orchestra.run.smithi155.stdout: "duration": 0 2023-08-01T19:54:34.168 INFO:teuthology.orchestra.run.smithi155.stdout: }, 2023-08-01T19:54:34.168 INFO:teuthology.orchestra.run.smithi155.stdout: { 2023-08-01T19:54:34.168 INFO:teuthology.orchestra.run.smithi155.stdout: "event": "header_read", 2023-08-01T19:54:34.168 INFO:teuthology.orchestra.run.smithi155.stdout: "time": "2023-08-01T19:54:34.142396+0000", 2023-08-01T19:54:34.168 INFO:teuthology.orchestra.run.smithi155.stdout: "duration": 4294967295.9999995 2023-08-01T19:54:34.168 INFO:teuthology.orchestra.run.smithi155.stdout: }, 2023-08-01T19:54:34.168 INFO:teuthology.orchestra.run.smithi155.stdout: { 2023-08-01T19:54:34.169 INFO:teuthology.orchestra.run.smithi155.stdout: "event": "all_read", 2023-08-01T19:54:34.169 INFO:teuthology.orchestra.run.smithi155.stdout: "time": "2023-08-01T19:54:34.142493+0000", 2023-08-01T19:54:34.169 INFO:teuthology.orchestra.run.smithi155.stdout: "duration": 9.6696999999999999e-05 2023-08-01T19:54:34.169 INFO:teuthology.orchestra.run.smithi155.stdout: }, 2023-08-01T19:54:34.169 INFO:teuthology.orchestra.run.smithi155.stdout: { 2023-08-01T19:54:34.169 INFO:teuthology.orchestra.run.smithi155.stdout: "event": "dispatched", 2023-08-01T19:54:34.169 INFO:teuthology.orchestra.run.smithi155.stdout: "time": "2023-08-01T19:54:34.142501+0000", 2023-08-01T19:54:34.170 INFO:teuthology.orchestra.run.smithi155.stdout: "duration": 8.7010000000000002e-06 2023-08-01T19:54:34.170 INFO:teuthology.orchestra.run.smithi155.stdout: }, 2023-08-01T19:54:34.170 INFO:teuthology.orchestra.run.smithi155.stdout: { 2023-08-01T19:54:34.170 INFO:teuthology.orchestra.run.smithi155.stdout: "event": "queued_for_pg", 2023-08-01T19:54:34.170 INFO:teuthology.orchestra.run.smithi155.stdout: "time": "2023-08-01T19:54:34.142507+0000", 2023-08-01T19:54:34.170 INFO:teuthology.orchestra.run.smithi155.stdout: "duration": 6.0270000000000001e-06 2023-08-01T19:54:34.170 INFO:teuthology.orchestra.run.smithi155.stdout: }, 2023-08-01T19:54:34.170 INFO:teuthology.orchestra.run.smithi155.stdout: { 2023-08-01T19:54:34.171 INFO:teuthology.orchestra.run.smithi155.stdout: "event": "reached_pg", 2023-08-01T19:54:34.171 INFO:teuthology.orchestra.run.smithi155.stdout: "time": "2023-08-01T19:54:34.142564+0000", 2023-08-01T19:54:34.171 INFO:teuthology.orchestra.run.smithi155.stdout: "duration": 5.6978000000000002e-05 2023-08-01T19:54:34.171 INFO:teuthology.orchestra.run.smithi155.stdout: }, 2023-08-01T19:54:34.171 INFO:teuthology.orchestra.run.smithi155.stdout: { 2023-08-01T19:54:34.171 INFO:teuthology.orchestra.run.smithi155.stdout: "event": "started", 2023-08-01T19:54:34.171 INFO:teuthology.orchestra.run.smithi155.stdout: "time": "2023-08-01T19:54:34.142577+0000", 2023-08-01T19:54:34.171 INFO:teuthology.orchestra.run.smithi155.stdout: "duration": 1.2532e-05 2023-08-01T19:54:34.172 INFO:teuthology.orchestra.run.smithi155.stdout: } 2023-08-01T19:54:34.172 INFO:teuthology.orchestra.run.smithi155.stdout: ] 2023-08-01T19:54:34.172 INFO:teuthology.orchestra.run.smithi155.stdout: } 2023-08-01T19:54:34.172 INFO:teuthology.orchestra.run.smithi155.stdout: }, 2023-08-01T19:54:34.172 INFO:teuthology.orchestra.run.smithi155.stdout: { 2023-08-01T19:54:34.172 INFO:teuthology.orchestra.run.smithi155.stdout: "description": "osd_repop(client.4668.0:34320 5.9 e24/19 5:9f13d942:::benchmark_data_smithi006_114134_object34319:head v 24'2188, mlcod=24'2185)", 2023-08-01T19:54:34.172 INFO:teuthology.orchestra.run.smithi155.stdout: "initiated_at": "2023-08-01T19:54:34.142576+0000", 2023-08-01T19:54:34.173 INFO:teuthology.orchestra.run.smithi155.stdout: "age": 0.003627595, 2023-08-01T19:54:34.173 INFO:teuthology.orchestra.run.smithi155.stdout: "duration": 0.0037839620000000001, 2023-08-01T19:54:34.173 INFO:teuthology.orchestra.run.smithi155.stdout: "type_data": { 2023-08-01T19:54:34.173 INFO:teuthology.orchestra.run.smithi155.stdout: "flag_point": "started", 2023-08-01T19:54:34.173 INFO:teuthology.orchestra.run.smithi155.stdout: "events": [ 2023-08-01T19:54:34.173 INFO:teuthology.orchestra.run.smithi155.stdout: { 2023-08-01T19:54:34.173 INFO:teuthology.orchestra.run.smithi155.stdout: "event": "initiated", 2023-08-01T19:54:34.173 INFO:teuthology.orchestra.run.smithi155.stdout: "time": "2023-08-01T19:54:34.142576+0000", 2023-08-01T19:54:34.174 INFO:teuthology.orchestra.run.smithi155.stdout: "duration": 0 2023-08-01T19:54:34.174 INFO:teuthology.orchestra.run.smithi155.stdout: }, 2023-08-01T19:54:34.174 INFO:teuthology.orchestra.run.smithi155.stdout: { 2023-08-01T19:54:34.174 INFO:teuthology.orchestra.run.smithi155.stdout: "event": "throttled", 2023-08-01T19:54:34.174 INFO:teuthology.orchestra.run.smithi155.stdout: "time": "2023-08-01T19:54:34.142576+0000", 2023-08-01T19:54:34.174 INFO:teuthology.orchestra.run.smithi155.stdout: "duration": 0 2023-08-01T19:54:34.174 INFO:teuthology.orchestra.run.smithi155.stdout: }, 2023-08-01T19:54:34.175 INFO:teuthology.orchestra.run.smithi155.stdout: { 2023-08-01T19:54:34.175 INFO:teuthology.orchestra.run.smithi155.stdout: "event": "header_read", 2023-08-01T19:54:34.175 INFO:teuthology.orchestra.run.smithi155.stdout: "time": "2023-08-01T19:54:34.142575+0000", 2023-08-01T19:54:34.175 INFO:teuthology.orchestra.run.smithi155.stdout: "duration": 4294967295.9999995 2023-08-01T19:54:34.175 INFO:teuthology.orchestra.run.smithi155.stdout: }, 2023-08-01T19:54:34.175 INFO:teuthology.orchestra.run.smithi155.stdout: { 2023-08-01T19:54:34.175 INFO:teuthology.orchestra.run.smithi155.stdout: "event": "all_read", 2023-08-01T19:54:34.175 INFO:teuthology.orchestra.run.smithi155.stdout: "time": "2023-08-01T19:54:34.142641+0000", 2023-08-01T19:54:34.176 INFO:teuthology.orchestra.run.smithi155.stdout: "duration": 6.6095999999999999e-05 2023-08-01T19:54:34.176 INFO:teuthology.orchestra.run.smithi155.stdout: }, 2023-08-01T19:54:34.176 INFO:teuthology.orchestra.run.smithi155.stdout: { 2023-08-01T19:54:34.176 INFO:teuthology.orchestra.run.smithi155.stdout: "event": "dispatched", 2023-08-01T19:54:34.176 INFO:teuthology.orchestra.run.smithi155.stdout: "time": "2023-08-01T19:54:34.142667+0000", 2023-08-01T19:54:34.176 INFO:teuthology.orchestra.run.smithi155.stdout: "duration": 2.5525999999999999e-05 2023-08-01T19:54:34.176 INFO:teuthology.orchestra.run.smithi155.stdout: }, 2023-08-01T19:54:34.177 INFO:teuthology.orchestra.run.smithi155.stdout: { 2023-08-01T19:54:34.177 INFO:teuthology.orchestra.run.smithi155.stdout: "event": "queued_for_pg", 2023-08-01T19:54:34.177 INFO:teuthology.orchestra.run.smithi155.stdout: "time": "2023-08-01T19:54:34.142673+0000", 2023-08-01T19:54:34.177 INFO:teuthology.orchestra.run.smithi155.stdout: "duration": 5.5500000000000002e-06 2023-08-01T19:54:34.177 INFO:teuthology.orchestra.run.smithi155.stdout: }, 2023-08-01T19:54:34.177 INFO:teuthology.orchestra.run.smithi155.stdout: { 2023-08-01T19:54:34.177 INFO:teuthology.orchestra.run.smithi155.stdout: "event": "reached_pg", 2023-08-01T19:54:34.177 INFO:teuthology.orchestra.run.smithi155.stdout: "time": "2023-08-01T19:54:34.142704+0000", 2023-08-01T19:54:34.178 INFO:teuthology.orchestra.run.smithi155.stdout: "duration": 3.1686999999999997e-05 2023-08-01T19:54:34.178 INFO:teuthology.orchestra.run.smithi155.stdout: }, 2023-08-01T19:54:34.178 INFO:teuthology.orchestra.run.smithi155.stdout: { 2023-08-01T19:54:34.178 INFO:teuthology.orchestra.run.smithi155.stdout: "event": "started", 2023-08-01T19:54:34.178 INFO:teuthology.orchestra.run.smithi155.stdout: "time": "2023-08-01T19:54:34.142719+0000", 2023-08-01T19:54:34.178 INFO:teuthology.orchestra.run.smithi155.stdout: "duration": 1.4864e-05 2023-08-01T19:54:34.178 INFO:teuthology.orchestra.run.smithi155.stdout: } 2023-08-01T19:54:34.179 INFO:teuthology.orchestra.run.smithi155.stdout: ] 2023-08-01T19:54:34.179 INFO:teuthology.orchestra.run.smithi155.stdout: } 2023-08-01T19:54:34.179 INFO:teuthology.orchestra.run.smithi155.stdout: }, 2023-08-01T19:54:34.179 INFO:teuthology.orchestra.run.smithi155.stdout: { 2023-08-01T19:54:34.179 INFO:teuthology.orchestra.run.smithi155.stdout: "description": "osd_repop(client.4668.0:34322 5.f e24/19 5:f37ac17b:::benchmark_data_smithi006_114134_object34321:head v 24'2166, mlcod=24'2164)", 2023-08-01T19:54:34.179 INFO:teuthology.orchestra.run.smithi155.stdout: "initiated_at": "2023-08-01T19:54:34.142692+0000", 2023-08-01T19:54:34.179 INFO:teuthology.orchestra.run.smithi155.stdout: "age": 0.003512037, 2023-08-01T19:54:34.179 INFO:teuthology.orchestra.run.smithi155.stdout: "duration": 0.0037015300000000002, 2023-08-01T19:54:34.180 INFO:teuthology.orchestra.run.smithi155.stdout: "type_data": { 2023-08-01T19:54:34.180 INFO:teuthology.orchestra.run.smithi155.stdout: "flag_point": "started", 2023-08-01T19:54:34.180 INFO:teuthology.orchestra.run.smithi155.stdout: "events": [ 2023-08-01T19:54:34.180 INFO:teuthology.orchestra.run.smithi155.stdout: { 2023-08-01T19:54:34.180 INFO:teuthology.orchestra.run.smithi155.stdout: "event": "initiated", 2023-08-01T19:54:34.180 INFO:teuthology.orchestra.run.smithi155.stdout: "time": "2023-08-01T19:54:34.142692+0000", 2023-08-01T19:54:34.180 INFO:teuthology.orchestra.run.smithi155.stdout: "duration": 0 2023-08-01T19:54:34.181 INFO:teuthology.orchestra.run.smithi155.stdout: }, 2023-08-01T19:54:34.181 INFO:teuthology.orchestra.run.smithi155.stdout: { 2023-08-01T19:54:34.181 INFO:teuthology.orchestra.run.smithi155.stdout: "event": "throttled", 2023-08-01T19:54:34.181 INFO:teuthology.orchestra.run.smithi155.stdout: "time": "2023-08-01T19:54:34.142692+0000", 2023-08-01T19:54:34.181 INFO:teuthology.orchestra.run.smithi155.stdout: "duration": 0 2023-08-01T19:54:34.181 INFO:teuthology.orchestra.run.smithi155.stdout: }, 2023-08-01T19:54:34.181 INFO:teuthology.orchestra.run.smithi155.stdout: { 2023-08-01T19:54:34.181 INFO:teuthology.orchestra.run.smithi155.stdout: "event": "header_read", 2023-08-01T19:54:34.182 INFO:teuthology.orchestra.run.smithi155.stdout: "time": "2023-08-01T19:54:34.142691+0000", 2023-08-01T19:54:34.182 INFO:teuthology.orchestra.run.smithi155.stdout: "duration": 4294967295.9999995 2023-08-01T19:54:34.182 INFO:teuthology.orchestra.run.smithi155.stdout: }, 2023-08-01T19:54:34.182 INFO:teuthology.orchestra.run.smithi155.stdout: { 2023-08-01T19:54:34.182 INFO:teuthology.orchestra.run.smithi155.stdout: "event": "all_read", 2023-08-01T19:54:34.182 INFO:teuthology.orchestra.run.smithi155.stdout: "time": "2023-08-01T19:54:34.142740+0000", 2023-08-01T19:54:34.182 INFO:teuthology.orchestra.run.smithi155.stdout: "duration": 4.8405999999999997e-05 2023-08-01T19:54:34.182 INFO:teuthology.orchestra.run.smithi155.stdout: }, 2023-08-01T19:54:34.183 INFO:teuthology.orchestra.run.smithi155.stdout: { 2023-08-01T19:54:34.183 INFO:teuthology.orchestra.run.smithi155.stdout: "event": "dispatched", 2023-08-01T19:54:34.183 INFO:teuthology.orchestra.run.smithi155.stdout: "time": "2023-08-01T19:54:34.142750+0000", 2023-08-01T19:54:34.183 INFO:teuthology.orchestra.run.smithi155.stdout: "duration": 1.013e-05 2023-08-01T19:54:34.183 INFO:teuthology.orchestra.run.smithi155.stdout: }, 2023-08-01T19:54:34.183 INFO:teuthology.orchestra.run.smithi155.stdout: { 2023-08-01T19:54:34.183 INFO:teuthology.orchestra.run.smithi155.stdout: "event": "queued_for_pg", 2023-08-01T19:54:34.184 INFO:teuthology.orchestra.run.smithi155.stdout: "time": "2023-08-01T19:54:34.142755+0000", 2023-08-01T19:54:34.184 INFO:teuthology.orchestra.run.smithi155.stdout: "duration": 4.7820000000000001e-06 2023-08-01T19:54:34.184 INFO:teuthology.orchestra.run.smithi155.stdout: }, 2023-08-01T19:54:34.184 INFO:teuthology.orchestra.run.smithi155.stdout: { 2023-08-01T19:54:34.184 INFO:teuthology.orchestra.run.smithi155.stdout: "event": "reached_pg", 2023-08-01T19:54:34.184 INFO:teuthology.orchestra.run.smithi155.stdout: "time": "2023-08-01T19:54:34.142790+0000", 2023-08-01T19:54:34.184 INFO:teuthology.orchestra.run.smithi155.stdout: "duration": 3.5227e-05 2023-08-01T19:54:34.184 INFO:teuthology.orchestra.run.smithi155.stdout: }, 2023-08-01T19:54:34.185 INFO:teuthology.orchestra.run.smithi155.stdout: { 2023-08-01T19:54:34.185 INFO:teuthology.orchestra.run.smithi155.stdout: "event": "started", 2023-08-01T19:54:34.185 INFO:teuthology.orchestra.run.smithi155.stdout: "time": "2023-08-01T19:54:34.142807+0000", 2023-08-01T19:54:34.185 INFO:teuthology.orchestra.run.smithi155.stdout: "duration": 1.77e-05 2023-08-01T19:54:34.185 INFO:teuthology.orchestra.run.smithi155.stdout: } 2023-08-01T19:54:34.185 INFO:teuthology.orchestra.run.smithi155.stdout: ] 2023-08-01T19:54:34.185 INFO:teuthology.orchestra.run.smithi155.stdout: } 2023-08-01T19:54:34.185 INFO:teuthology.orchestra.run.smithi155.stdout: }, 2023-08-01T19:54:34.186 INFO:teuthology.orchestra.run.smithi155.stdout: { 2023-08-01T19:54:34.186 INFO:teuthology.orchestra.run.smithi155.stdout: "description": "osd_op(client.4668.0:34323 5.b 5:dbb0c864:::benchmark_data_smithi006_114134_object34322:head [set-alloc-hint object_size 65536 write_size 65536,write 0~65536 in=65536b] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e24)", 2023-08-01T19:54:34.186 INFO:teuthology.orchestra.run.smithi155.stdout: "initiated_at": "2023-08-01T19:54:34.143669+0000", 2023-08-01T19:54:34.186 INFO:teuthology.orchestra.run.smithi155.stdout: "age": 0.0025346549999999998, 2023-08-01T19:54:34.186 INFO:teuthology.orchestra.run.smithi155.stdout: "duration": 0.0027597070000000001, 2023-08-01T19:54:34.186 INFO:teuthology.orchestra.run.smithi155.stdout: "type_data": { 2023-08-01T19:54:34.186 INFO:teuthology.orchestra.run.smithi155.stdout: "flag_point": "waiting for sub ops", 2023-08-01T19:54:34.187 INFO:teuthology.orchestra.run.smithi155.stdout: "client_info": { 2023-08-01T19:54:34.187 INFO:teuthology.orchestra.run.smithi155.stdout: "client": "client.4668", 2023-08-01T19:54:34.187 INFO:teuthology.orchestra.run.smithi155.stdout: "client_addr": "172.21.15.6:0/1709472247", 2023-08-01T19:54:34.187 INFO:teuthology.orchestra.run.smithi155.stdout: "tid": 34323 2023-08-01T19:54:34.187 INFO:teuthology.orchestra.run.smithi155.stdout: }, 2023-08-01T19:54:34.187 INFO:teuthology.orchestra.run.smithi155.stdout: "events": [ 2023-08-01T19:54:34.187 INFO:teuthology.orchestra.run.smithi155.stdout: { 2023-08-01T19:54:34.187 INFO:teuthology.orchestra.run.smithi155.stdout: "event": "initiated", 2023-08-01T19:54:34.188 INFO:teuthology.orchestra.run.smithi155.stdout: "time": "2023-08-01T19:54:34.143669+0000", 2023-08-01T19:54:34.188 INFO:teuthology.orchestra.run.smithi155.stdout: "duration": 0 2023-08-01T19:54:34.188 INFO:teuthology.orchestra.run.smithi155.stdout: }, 2023-08-01T19:54:34.188 INFO:teuthology.orchestra.run.smithi155.stdout: { 2023-08-01T19:54:34.188 INFO:teuthology.orchestra.run.smithi155.stdout: "event": "throttled", 2023-08-01T19:54:34.188 INFO:teuthology.orchestra.run.smithi155.stdout: "time": "2023-08-01T19:54:34.143669+0000", 2023-08-01T19:54:34.188 INFO:teuthology.orchestra.run.smithi155.stdout: "duration": 0 2023-08-01T19:54:34.189 INFO:teuthology.orchestra.run.smithi155.stdout: }, 2023-08-01T19:54:34.189 INFO:teuthology.orchestra.run.smithi155.stdout: { 2023-08-01T19:54:34.189 INFO:teuthology.orchestra.run.smithi155.stdout: "event": "header_read", 2023-08-01T19:54:34.189 INFO:teuthology.orchestra.run.smithi155.stdout: "time": "2023-08-01T19:54:34.143668+0000", 2023-08-01T19:54:34.189 INFO:teuthology.orchestra.run.smithi155.stdout: "duration": 4294967295.999999 2023-08-01T19:54:34.189 INFO:teuthology.orchestra.run.smithi155.stdout: }, 2023-08-01T19:54:34.189 INFO:teuthology.orchestra.run.smithi155.stdout: { 2023-08-01T19:54:34.189 INFO:teuthology.orchestra.run.smithi155.stdout: "event": "all_read", 2023-08-01T19:54:34.190 INFO:teuthology.orchestra.run.smithi155.stdout: "time": "2023-08-01T19:54:34.143729+0000", 2023-08-01T19:54:34.190 INFO:teuthology.orchestra.run.smithi155.stdout: "duration": 6.1536000000000002e-05 2023-08-01T19:54:34.190 INFO:teuthology.orchestra.run.smithi155.stdout: }, 2023-08-01T19:54:34.190 INFO:teuthology.orchestra.run.smithi155.stdout: { 2023-08-01T19:54:34.190 INFO:teuthology.orchestra.run.smithi155.stdout: "event": "dispatched", 2023-08-01T19:54:34.190 INFO:teuthology.orchestra.run.smithi155.stdout: "time": "2023-08-01T19:54:34.143756+0000", 2023-08-01T19:54:34.190 INFO:teuthology.orchestra.run.smithi155.stdout: "duration": 2.6149999999999999e-05 2023-08-01T19:54:34.190 INFO:teuthology.orchestra.run.smithi155.stdout: }, 2023-08-01T19:54:34.191 INFO:teuthology.orchestra.run.smithi155.stdout: { 2023-08-01T19:54:34.191 INFO:teuthology.orchestra.run.smithi155.stdout: "event": "queued_for_pg", 2023-08-01T19:54:34.191 INFO:teuthology.orchestra.run.smithi155.stdout: "time": "2023-08-01T19:54:34.143766+0000", 2023-08-01T19:54:34.191 INFO:teuthology.orchestra.run.smithi155.stdout: "duration": 9.9189999999999994e-06 2023-08-01T19:54:34.191 INFO:teuthology.orchestra.run.smithi155.stdout: }, 2023-08-01T19:54:34.191 INFO:teuthology.orchestra.run.smithi155.stdout: { 2023-08-01T19:54:34.191 INFO:teuthology.orchestra.run.smithi155.stdout: "event": "reached_pg", 2023-08-01T19:54:34.192 INFO:teuthology.orchestra.run.smithi155.stdout: "time": "2023-08-01T19:54:34.143797+0000", 2023-08-01T19:54:34.192 INFO:teuthology.orchestra.run.smithi155.stdout: "duration": 3.1219e-05 2023-08-01T19:54:34.192 INFO:teuthology.orchestra.run.smithi155.stdout: }, 2023-08-01T19:54:34.192 INFO:teuthology.orchestra.run.smithi155.stdout: { 2023-08-01T19:54:34.192 INFO:teuthology.orchestra.run.smithi155.stdout: "event": "started", 2023-08-01T19:54:34.192 INFO:teuthology.orchestra.run.smithi155.stdout: "time": "2023-08-01T19:54:34.143882+0000", 2023-08-01T19:54:34.192 INFO:teuthology.orchestra.run.smithi155.stdout: "duration": 8.4788000000000002e-05 2023-08-01T19:54:34.192 INFO:teuthology.orchestra.run.smithi155.stdout: }, 2023-08-01T19:54:34.193 INFO:teuthology.orchestra.run.smithi155.stdout: { 2023-08-01T19:54:34.193 INFO:teuthology.orchestra.run.smithi155.stdout: "event": "waiting for subops from 0", 2023-08-01T19:54:34.193 INFO:teuthology.orchestra.run.smithi155.stdout: "time": "2023-08-01T19:54:34.143960+0000", 2023-08-01T19:54:34.193 INFO:teuthology.orchestra.run.smithi155.stdout: "duration": 7.8022000000000006e-05 2023-08-01T19:54:34.193 INFO:teuthology.orchestra.run.smithi155.stdout: } 2023-08-01T19:54:34.193 INFO:teuthology.orchestra.run.smithi155.stdout: ] 2023-08-01T19:54:34.193 INFO:teuthology.orchestra.run.smithi155.stdout: } 2023-08-01T19:54:34.194 INFO:teuthology.orchestra.run.smithi155.stdout: }, 2023-08-01T19:54:34.194 INFO:teuthology.orchestra.run.smithi155.stdout: { 2023-08-01T19:54:34.194 INFO:teuthology.orchestra.run.smithi155.stdout: "description": "osd_op(client.4668.0:34324 5.e 5:79f31847:::benchmark_data_smithi006_114134_object34323:head [set-alloc-hint object_size 65536 write_size 65536,write 0~65536 in=65536b] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e24)", 2023-08-01T19:54:34.194 INFO:teuthology.orchestra.run.smithi155.stdout: "initiated_at": "2023-08-01T19:54:34.143775+0000", 2023-08-01T19:54:34.194 INFO:teuthology.orchestra.run.smithi155.stdout: "age": 0.0024282219999999998, 2023-08-01T19:54:34.194 INFO:teuthology.orchestra.run.smithi155.stdout: "duration": 0.0027219990000000001, 2023-08-01T19:54:34.194 INFO:teuthology.orchestra.run.smithi155.stdout: "type_data": { 2023-08-01T19:54:34.194 INFO:teuthology.orchestra.run.smithi155.stdout: "flag_point": "waiting for sub ops", 2023-08-01T19:54:34.195 INFO:teuthology.orchestra.run.smithi155.stdout: "client_info": { 2023-08-01T19:54:34.195 INFO:teuthology.orchestra.run.smithi155.stdout: "client": "client.4668", 2023-08-01T19:54:34.195 INFO:teuthology.orchestra.run.smithi155.stdout: "client_addr": "172.21.15.6:0/1709472247", 2023-08-01T19:54:34.195 INFO:teuthology.orchestra.run.smithi155.stdout: "tid": 34324 2023-08-01T19:54:34.195 INFO:teuthology.orchestra.run.smithi155.stdout: }, 2023-08-01T19:54:34.195 INFO:teuthology.orchestra.run.smithi155.stdout: "events": [ 2023-08-01T19:54:34.195 INFO:teuthology.orchestra.run.smithi155.stdout: { 2023-08-01T19:54:34.195 INFO:teuthology.orchestra.run.smithi155.stdout: "event": "initiated", 2023-08-01T19:54:34.196 INFO:teuthology.orchestra.run.smithi155.stdout: "time": "2023-08-01T19:54:34.143775+0000", 2023-08-01T19:54:34.196 INFO:teuthology.orchestra.run.smithi155.stdout: "duration": 0 2023-08-01T19:54:34.196 INFO:teuthology.orchestra.run.smithi155.stdout: }, 2023-08-01T19:54:34.196 INFO:teuthology.orchestra.run.smithi155.stdout: { 2023-08-01T19:54:34.196 INFO:teuthology.orchestra.run.smithi155.stdout: "event": "throttled", 2023-08-01T19:54:34.196 INFO:teuthology.orchestra.run.smithi155.stdout: "time": "2023-08-01T19:54:34.143775+0000", 2023-08-01T19:54:34.196 INFO:teuthology.orchestra.run.smithi155.stdout: "duration": 0 2023-08-01T19:54:34.197 INFO:teuthology.orchestra.run.smithi155.stdout: }, 2023-08-01T19:54:34.197 INFO:teuthology.orchestra.run.smithi155.stdout: { 2023-08-01T19:54:34.197 INFO:teuthology.orchestra.run.smithi155.stdout: "event": "header_read", 2023-08-01T19:54:34.197 INFO:teuthology.orchestra.run.smithi155.stdout: "time": "2023-08-01T19:54:34.143775+0000", 2023-08-01T19:54:34.197 INFO:teuthology.orchestra.run.smithi155.stdout: "duration": 4294967295.9999995 2023-08-01T19:54:34.197 INFO:teuthology.orchestra.run.smithi155.stdout: }, 2023-08-01T19:54:34.197 INFO:teuthology.orchestra.run.smithi155.stdout: { 2023-08-01T19:54:34.197 INFO:teuthology.orchestra.run.smithi155.stdout: "event": "all_read", 2023-08-01T19:54:34.198 INFO:teuthology.orchestra.run.smithi155.stdout: "time": "2023-08-01T19:54:34.143807+0000", 2023-08-01T19:54:34.198 INFO:teuthology.orchestra.run.smithi155.stdout: "duration": 3.2648000000000003e-05 2023-08-01T19:54:34.198 INFO:teuthology.orchestra.run.smithi155.stdout: }, 2023-08-01T19:54:34.198 INFO:teuthology.orchestra.run.smithi155.stdout: { 2023-08-01T19:54:34.198 INFO:teuthology.orchestra.run.smithi155.stdout: "event": "dispatched", 2023-08-01T19:54:34.198 INFO:teuthology.orchestra.run.smithi155.stdout: "time": "2023-08-01T19:54:34.143817+0000", 2023-08-01T19:54:34.198 INFO:teuthology.orchestra.run.smithi155.stdout: "duration": 9.3610000000000007e-06 2023-08-01T19:54:34.198 INFO:teuthology.orchestra.run.smithi155.stdout: }, 2023-08-01T19:54:34.199 INFO:teuthology.orchestra.run.smithi155.stdout: { 2023-08-01T19:54:34.199 INFO:teuthology.orchestra.run.smithi155.stdout: "event": "queued_for_pg", 2023-08-01T19:54:34.199 INFO:teuthology.orchestra.run.smithi155.stdout: "time": "2023-08-01T19:54:34.143822+0000", 2023-08-01T19:54:34.199 INFO:teuthology.orchestra.run.smithi155.stdout: "duration": 5.164e-06 2023-08-01T19:54:34.199 INFO:teuthology.orchestra.run.smithi155.stdout: }, 2023-08-01T19:54:34.199 INFO:teuthology.orchestra.run.smithi155.stdout: { 2023-08-01T19:54:34.199 INFO:teuthology.orchestra.run.smithi155.stdout: "event": "reached_pg", 2023-08-01T19:54:34.200 INFO:teuthology.orchestra.run.smithi155.stdout: "time": "2023-08-01T19:54:34.143863+0000", 2023-08-01T19:54:34.200 INFO:teuthology.orchestra.run.smithi155.stdout: "duration": 4.0534000000000002e-05 2023-08-01T19:54:34.200 INFO:teuthology.orchestra.run.smithi155.stdout: }, 2023-08-01T19:54:34.200 INFO:teuthology.orchestra.run.smithi155.stdout: { 2023-08-01T19:54:34.200 INFO:teuthology.orchestra.run.smithi155.stdout: "event": "started", 2023-08-01T19:54:34.200 INFO:teuthology.orchestra.run.smithi155.stdout: "time": "2023-08-01T19:54:34.143979+0000", 2023-08-01T19:54:34.200 INFO:teuthology.orchestra.run.smithi155.stdout: "duration": 0.000116685 2023-08-01T19:54:34.200 INFO:teuthology.orchestra.run.smithi155.stdout: }, 2023-08-01T19:54:34.201 INFO:teuthology.orchestra.run.smithi155.stdout: { 2023-08-01T19:54:34.201 INFO:teuthology.orchestra.run.smithi155.stdout: "event": "waiting for subops from 0", 2023-08-01T19:54:34.201 INFO:teuthology.orchestra.run.smithi155.stdout: "time": "2023-08-01T19:54:34.144108+0000", 2023-08-01T19:54:34.201 INFO:teuthology.orchestra.run.smithi155.stdout: "duration": 0.00012893799999999999 2023-08-01T19:54:34.201 INFO:teuthology.orchestra.run.smithi155.stdout: } 2023-08-01T19:54:34.201 INFO:teuthology.orchestra.run.smithi155.stdout: ] 2023-08-01T19:54:34.201 INFO:teuthology.orchestra.run.smithi155.stdout: } 2023-08-01T19:54:34.202 INFO:teuthology.orchestra.run.smithi155.stdout: }, 2023-08-01T19:54:34.202 INFO:teuthology.orchestra.run.smithi155.stdout: { 2023-08-01T19:54:34.202 INFO:teuthology.orchestra.run.smithi155.stdout: "description": "osd_op(client.4668.0:34329 5.4 5:2aa3311f:::benchmark_data_smithi006_114134_object34328:head [set-alloc-hint object_size 65536 write_size 65536,write 0~65536 in=65536b] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e24)", 2023-08-01T19:54:34.202 INFO:teuthology.orchestra.run.smithi155.stdout: "initiated_at": "2023-08-01T19:54:34.145440+0000", 2023-08-01T19:54:34.202 INFO:teuthology.orchestra.run.smithi155.stdout: "age": 0.00076382499999999999, 2023-08-01T19:54:34.202 INFO:teuthology.orchestra.run.smithi155.stdout: "duration": 0.001129239, 2023-08-01T19:54:34.202 INFO:teuthology.orchestra.run.smithi155.stdout: "type_data": { 2023-08-01T19:54:34.202 INFO:teuthology.orchestra.run.smithi155.stdout: "flag_point": "waiting for sub ops", 2023-08-01T19:54:34.203 INFO:teuthology.orchestra.run.smithi155.stdout: "client_info": { 2023-08-01T19:54:34.203 INFO:teuthology.orchestra.run.smithi155.stdout: "client": "client.4668", 2023-08-01T19:54:34.203 INFO:teuthology.orchestra.run.smithi155.stdout: "client_addr": "172.21.15.6:0/1709472247", 2023-08-01T19:54:34.203 INFO:teuthology.orchestra.run.smithi155.stdout: "tid": 34329 2023-08-01T19:54:34.203 INFO:teuthology.orchestra.run.smithi155.stdout: }, 2023-08-01T19:54:34.203 INFO:teuthology.orchestra.run.smithi155.stdout: "events": [ 2023-08-01T19:54:34.203 INFO:teuthology.orchestra.run.smithi155.stdout: { 2023-08-01T19:54:34.203 INFO:teuthology.orchestra.run.smithi155.stdout: "event": "initiated", 2023-08-01T19:54:34.204 INFO:teuthology.orchestra.run.smithi155.stdout: "time": "2023-08-01T19:54:34.145440+0000", 2023-08-01T19:54:34.204 INFO:teuthology.orchestra.run.smithi155.stdout: "duration": 0 2023-08-01T19:54:34.204 INFO:teuthology.orchestra.run.smithi155.stdout: }, 2023-08-01T19:54:34.204 INFO:teuthology.orchestra.run.smithi155.stdout: { 2023-08-01T19:54:34.204 INFO:teuthology.orchestra.run.smithi155.stdout: "event": "throttled", 2023-08-01T19:54:34.204 INFO:teuthology.orchestra.run.smithi155.stdout: "time": "2023-08-01T19:54:34.145440+0000", 2023-08-01T19:54:34.204 INFO:teuthology.orchestra.run.smithi155.stdout: "duration": 0 2023-08-01T19:54:34.205 INFO:teuthology.orchestra.run.smithi155.stdout: }, 2023-08-01T19:54:34.205 INFO:teuthology.orchestra.run.smithi155.stdout: { 2023-08-01T19:54:34.205 INFO:teuthology.orchestra.run.smithi155.stdout: "event": "header_read", 2023-08-01T19:54:34.205 INFO:teuthology.orchestra.run.smithi155.stdout: "time": "2023-08-01T19:54:34.145439+0000", 2023-08-01T19:54:34.205 INFO:teuthology.orchestra.run.smithi155.stdout: "duration": 4294967295.999999 2023-08-01T19:54:34.205 INFO:teuthology.orchestra.run.smithi155.stdout: }, 2023-08-01T19:54:34.205 INFO:teuthology.orchestra.run.smithi155.stdout: { 2023-08-01T19:54:34.205 INFO:teuthology.orchestra.run.smithi155.stdout: "event": "all_read", 2023-08-01T19:54:34.206 INFO:teuthology.orchestra.run.smithi155.stdout: "time": "2023-08-01T19:54:34.145553+0000", 2023-08-01T19:54:34.206 INFO:teuthology.orchestra.run.smithi155.stdout: "duration": 0.000114499 2023-08-01T19:54:34.206 INFO:teuthology.orchestra.run.smithi155.stdout: }, 2023-08-01T19:54:34.206 INFO:teuthology.orchestra.run.smithi155.stdout: { 2023-08-01T19:54:34.206 INFO:teuthology.orchestra.run.smithi155.stdout: "event": "dispatched", 2023-08-01T19:54:34.206 INFO:teuthology.orchestra.run.smithi155.stdout: "time": "2023-08-01T19:54:34.145570+0000", 2023-08-01T19:54:34.206 INFO:teuthology.orchestra.run.smithi155.stdout: "duration": 1.6116e-05 2023-08-01T19:54:34.207 INFO:teuthology.orchestra.run.smithi155.stdout: }, 2023-08-01T19:54:34.207 INFO:teuthology.orchestra.run.smithi155.stdout: { 2023-08-01T19:54:34.207 INFO:teuthology.orchestra.run.smithi155.stdout: "event": "queued_for_pg", 2023-08-01T19:54:34.207 INFO:teuthology.orchestra.run.smithi155.stdout: "time": "2023-08-01T19:54:34.145576+0000", 2023-08-01T19:54:34.207 INFO:teuthology.orchestra.run.smithi155.stdout: "duration": 6.5590000000000002e-06 2023-08-01T19:54:34.207 INFO:teuthology.orchestra.run.smithi155.stdout: }, 2023-08-01T19:54:34.207 INFO:teuthology.orchestra.run.smithi155.stdout: { 2023-08-01T19:54:34.207 INFO:teuthology.orchestra.run.smithi155.stdout: "event": "reached_pg", 2023-08-01T19:54:34.208 INFO:teuthology.orchestra.run.smithi155.stdout: "time": "2023-08-01T19:54:34.145603+0000", 2023-08-01T19:54:34.208 INFO:teuthology.orchestra.run.smithi155.stdout: "duration": 2.7212999999999998e-05 2023-08-01T19:54:34.208 INFO:teuthology.orchestra.run.smithi155.stdout: }, 2023-08-01T19:54:34.208 INFO:teuthology.orchestra.run.smithi155.stdout: { 2023-08-01T19:54:34.208 INFO:teuthology.orchestra.run.smithi155.stdout: "event": "started", 2023-08-01T19:54:34.208 INFO:teuthology.orchestra.run.smithi155.stdout: "time": "2023-08-01T19:54:34.145686+0000", 2023-08-01T19:54:34.208 INFO:teuthology.orchestra.run.smithi155.stdout: "duration": 8.3201000000000005e-05 2023-08-01T19:54:34.209 INFO:teuthology.orchestra.run.smithi155.stdout: }, 2023-08-01T19:54:34.209 INFO:teuthology.orchestra.run.smithi155.stdout: { 2023-08-01T19:54:34.209 INFO:teuthology.orchestra.run.smithi155.stdout: "event": "waiting for subops from 0", 2023-08-01T19:54:34.209 INFO:teuthology.orchestra.run.smithi155.stdout: "time": "2023-08-01T19:54:34.145766+0000", 2023-08-01T19:54:34.209 INFO:teuthology.orchestra.run.smithi155.stdout: "duration": 7.9943000000000004e-05 2023-08-01T19:54:34.209 INFO:teuthology.orchestra.run.smithi155.stdout: } 2023-08-01T19:54:34.209 INFO:teuthology.orchestra.run.smithi155.stdout: ] 2023-08-01T19:54:34.209 INFO:teuthology.orchestra.run.smithi155.stdout: } 2023-08-01T19:54:34.210 INFO:teuthology.orchestra.run.smithi155.stdout: } 2023-08-01T19:54:34.210 INFO:teuthology.orchestra.run.smithi155.stdout: ], 2023-08-01T19:54:34.210 INFO:teuthology.orchestra.run.smithi155.stdout: "num_ops": 8 2023-08-01T19:54:34.210 INFO:teuthology.orchestra.run.smithi155.stdout:} 2023-08-01T19:54:34.210 DEBUG:teuthology.orchestra.run.smithi006:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 120 ceph --cluster ceph -- tell 'osd.*' injectargs --osd_enable_op_tracker=false 2023-08-01T19:54:34.212 INFO:tasks.ceph.osd.1.smithi101.stderr:2023-08-01T19:54:34.209+0000 7fb0cb7f6700 -1 received signal: Hangup from /usr/bin/python3 /bin/daemon-helper kill ceph-osd -f --cluster ceph -i 1 (PID: 111141) UID: 0 2023-08-01T19:54:34.213 INFO:teuthology.orchestra.run.smithi006.stderr:noscrub is set 2023-08-01T19:54:34.213 DEBUG:teuthology.orchestra.run.smithi155:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 30 ceph --cluster ceph --admin-daemon /var/run/ceph/ceph-osd.2.asok dump_blocked_ops 2023-08-01T19:54:34.312 INFO:tasks.ceph.osd.1.smithi101.stderr:2023-08-01T19:54:34.311+0000 7fb0cb7f6700 -1 received signal: Hangup from /usr/bin/python3 /bin/daemon-helper kill ceph-osd -f --cluster ceph -i 1 (PID: 111141) UID: 0 2023-08-01T19:54:34.313 INFO:tasks.radosbench.radosbench.0.smithi006.stdout: 10 16 34793 34777 217.34 178.75 0.00555219 0.00459758 2023-08-01T19:54:34.391 INFO:teuthology.orchestra.run.smithi155.stdout:{ 2023-08-01T19:54:34.391 INFO:teuthology.orchestra.run.smithi155.stdout: "ops": [], 2023-08-01T19:54:34.391 INFO:teuthology.orchestra.run.smithi155.stdout: "complaint_time": 30, 2023-08-01T19:54:34.391 INFO:teuthology.orchestra.run.smithi155.stdout: "num_blocked_ops": 0 2023-08-01T19:54:34.391 INFO:teuthology.orchestra.run.smithi155.stdout:} 2023-08-01T19:54:34.404 INFO:teuthology.orchestra.run.smithi006.stdout:osd.0: {} 2023-08-01T19:54:34.405 DEBUG:teuthology.orchestra.run.smithi155:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 30 ceph --cluster ceph --admin-daemon /var/run/ceph/ceph-osd.2.asok dump_historic_ops 2023-08-01T19:54:34.413 INFO:tasks.ceph.osd.0.smithi008.stderr:2023-08-01T19:54:34.411+0000 7f16a58f4700 -1 received signal: Hangup from /usr/bin/python3 /bin/daemon-helper kill ceph-osd -f --cluster ceph -i 0 (PID: 111179) UID: 0 2023-08-01T19:54:34.425 INFO:teuthology.orchestra.run.smithi006.stdout:osd.1: {} 2023-08-01T19:54:34.446 INFO:teuthology.orchestra.run.smithi006.stdout:osd.2: {} 2023-08-01T19:54:34.447 INFO:teuthology.orchestra.run.smithi006.stderr:osd.0: osd_enable_op_tracker = 'false' 2023-08-01T19:54:34.447 INFO:teuthology.orchestra.run.smithi006.stderr:osd.1: osd_enable_op_tracker = 'false' 2023-08-01T19:54:34.448 INFO:teuthology.orchestra.run.smithi006.stderr:osd.2: osd_enable_op_tracker = 'false' 2023-08-01T19:54:34.514 INFO:tasks.ceph.osd.2.smithi155.stderr:2023-08-01T19:54:34.513+0000 7faa5c6ac700 -1 received signal: Hangup from /usr/bin/python3 /bin/daemon-helper kill ceph-osd -f --cluster ceph -i 2 (PID: 111337) UID: 0 2023-08-01T19:54:34.578 INFO:teuthology.orchestra.run.smithi155.stdout:ERROR: (22) Invalid argument 2023-08-01T19:54:34.578 INFO:teuthology.orchestra.run.smithi155.stdout:op_tracker tracking is not enabled now, so no ops are tracked currently, even those get stuck. Please enable "osd_enable_op_tracker", and the tracker will start to track new ops received afterwards. 2023-08-01T19:54:34.592 DEBUG:teuthology.orchestra.run.smithi008:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 30 ceph --cluster ceph --admin-daemon /var/run/ceph/ceph-osd.0.asok dump_ops_in_flight 2023-08-01T19:54:34.635 INFO:tasks.ceph.osd.0.smithi008.stderr:2023-08-01T19:54:34.633+0000 7f16a58f4700 -1 received signal: Hangup from /usr/bin/python3 /bin/daemon-helper kill ceph-osd -f --cluster ceph -i 0 (PID: 111179) UID: 0 2023-08-01T19:54:34.716 INFO:tasks.ceph.osd.1.smithi101.stderr:2023-08-01T19:54:34.715+0000 7fb0cb7f6700 -1 received signal: Hangup from /usr/bin/python3 /bin/daemon-helper kill ceph-osd -f --cluster ceph -i 1 (PID: 111141) UID: 0 2023-08-01T19:54:34.782 INFO:teuthology.orchestra.run.smithi008.stdout:ERROR: (22) Invalid argument 2023-08-01T19:54:34.783 INFO:teuthology.orchestra.run.smithi008.stdout:op_tracker tracking is not enabled now, so no ops are tracked currently, even those get stuck. Please enable "osd_enable_op_tracker", and the tracker will start to track new ops received afterwards. 2023-08-01T19:54:34.799 DEBUG:teuthology.orchestra.run.smithi008:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 30 ceph --cluster ceph --admin-daemon /var/run/ceph/ceph-osd.0.asok dump_blocked_ops 2023-08-01T19:54:34.817 INFO:tasks.ceph.osd.2.smithi155.stderr:2023-08-01T19:54:34.816+0000 7faa5c6ac700 -1 received signal: Hangup from /usr/bin/python3 /bin/daemon-helper kill ceph-osd -f --cluster ceph -i 2 (PID: 111337) UID: 0 2023-08-01T19:54:34.918 INFO:tasks.ceph.osd.2.smithi155.stderr:2023-08-01T19:54:34.917+0000 7faa5c6ac700 -1 received signal: Hangup from /usr/bin/python3 /bin/daemon-helper kill ceph-osd -f --cluster ceph -i 2 (PID: 111337) UID: 0 2023-08-01T19:54:35.019 INFO:tasks.ceph.osd.0.smithi008.stderr:2023-08-01T19:54:35.017+0000 7f16a58f4700 -1 received signal: Hangup from /usr/bin/python3 /bin/daemon-helper kill ceph-osd -f --cluster ceph -i 0 (PID: 111179) UID: 0 2023-08-01T19:54:35.038 INFO:teuthology.orchestra.run.smithi008.stdout:ERROR: (22) Invalid argument 2023-08-01T19:54:35.038 INFO:teuthology.orchestra.run.smithi008.stdout:op_tracker tracking is not enabled now, so no ops are tracked currently, even those get stuck. Please enable "osd_enable_op_tracker", and the tracker will start to track new ops received afterwards. 2023-08-01T19:54:35.055 DEBUG:teuthology.orchestra.run.smithi008:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 30 ceph --cluster ceph --admin-daemon /var/run/ceph/ceph-osd.0.asok dump_historic_ops 2023-08-01T19:54:35.141 INFO:tasks.ceph.osd.0.smithi008.stderr:2023-08-01T19:54:35.138+0000 7f16a58f4700 -1 received signal: Hangup from /usr/bin/python3 /bin/daemon-helper kill ceph-osd -f --cluster ceph -i 0 (PID: 111179) UID: 0 2023-08-01T19:54:35.221 INFO:tasks.ceph.osd.2.smithi155.stderr:2023-08-01T19:54:35.220+0000 7faa5c6ac700 -1 received signal: Hangup from /usr/bin/python3 /bin/daemon-helper kill ceph-osd -f --cluster ceph -i 2 (PID: 111337) UID: 0 2023-08-01T19:54:35.293 INFO:teuthology.orchestra.run.smithi008.stdout:ERROR: (22) Invalid argument 2023-08-01T19:54:35.293 INFO:teuthology.orchestra.run.smithi008.stdout:op_tracker tracking is not enabled now, so no ops are tracked currently, even those get stuck. Please enable "osd_enable_op_tracker", and the tracker will start to track new ops received afterwards. 2023-08-01T19:54:35.310 DEBUG:teuthology.orchestra.run.smithi101:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 30 ceph --cluster ceph --admin-daemon /var/run/ceph/ceph-osd.1.asok dump_ops_in_flight 2023-08-01T19:54:35.313 INFO:tasks.radosbench.radosbench.0.smithi006.stdout: 11 15 37530 37515 213.138 171.125 0.00428534 0.00468881 2023-08-01T19:54:35.353 INFO:tasks.ceph.osd.1.smithi101.stderr:2023-08-01T19:54:35.352+0000 7fb0cb7f6700 -1 received signal: Hangup from /usr/bin/python3 /bin/daemon-helper kill ceph-osd -f --cluster ceph -i 1 (PID: 111141) UID: 0 2023-08-01T19:54:35.423 INFO:tasks.ceph.osd.0.smithi008.stderr:2023-08-01T19:54:35.421+0000 7f16a58f4700 -1 received signal: Hangup from /usr/bin/python3 /bin/daemon-helper kill ceph-osd -f --cluster ceph -i 0 (PID: 111179) UID: 0 2023-08-01T19:54:35.484 INFO:teuthology.orchestra.run.smithi101.stdout:ERROR: (22) Invalid argument 2023-08-01T19:54:35.484 INFO:teuthology.orchestra.run.smithi101.stdout:op_tracker tracking is not enabled now, so no ops are tracked currently, even those get stuck. Please enable "osd_enable_op_tracker", and the tracker will start to track new ops received afterwards. 2023-08-01T19:54:35.497 DEBUG:teuthology.orchestra.run.smithi101:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 30 ceph --cluster ceph --admin-daemon /var/run/ceph/ceph-osd.1.asok dump_blocked_ops 2023-08-01T19:54:35.524 INFO:tasks.ceph.osd.2.smithi155.stderr:2023-08-01T19:54:35.523+0000 7faa5c6ac700 -1 received signal: Hangup from /usr/bin/python3 /bin/daemon-helper kill ceph-osd -f --cluster ceph -i 2 (PID: 111337) UID: 0 2023-08-01T19:54:35.624 INFO:tasks.ceph.osd.0.smithi008.stderr:2023-08-01T19:54:35.623+0000 7f16a58f4700 -1 received signal: Hangup from /usr/bin/python3 /bin/daemon-helper kill ceph-osd -f --cluster ceph -i 0 (PID: 111179) UID: 0 2023-08-01T19:54:35.712 INFO:teuthology.orchestra.run.smithi101.stdout:ERROR: (22) Invalid argument 2023-08-01T19:54:35.712 INFO:teuthology.orchestra.run.smithi101.stdout:op_tracker tracking is not enabled now, so no ops are tracked currently, even those get stuck. Please enable "osd_enable_op_tracker", and the tracker will start to track new ops received afterwards. 2023-08-01T19:54:35.725 DEBUG:teuthology.orchestra.run.smithi101:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 30 ceph --cluster ceph --admin-daemon /var/run/ceph/ceph-osd.1.asok dump_historic_ops 2023-08-01T19:54:35.726 INFO:tasks.ceph.osd.0.smithi008.stderr:2023-08-01T19:54:35.723+0000 7f16a58f4700 -1 received signal: Hangup from /usr/bin/python3 /bin/daemon-helper kill ceph-osd -f --cluster ceph -i 0 (PID: 111179) UID: 0 2023-08-01T19:54:35.826 INFO:tasks.ceph.osd.0.smithi008.stderr:2023-08-01T19:54:35.824+0000 7f16a58f4700 -1 received signal: Hangup from /usr/bin/python3 /bin/daemon-helper kill ceph-osd -f --cluster ceph -i 0 (PID: 111179) UID: 0 2023-08-01T19:54:35.901 INFO:teuthology.orchestra.run.smithi101.stdout:ERROR: (22) Invalid argument 2023-08-01T19:54:35.901 INFO:teuthology.orchestra.run.smithi101.stdout:op_tracker tracking is not enabled now, so no ops are tracked currently, even those get stuck. Please enable "osd_enable_op_tracker", and the tracker will start to track new ops received afterwards. 2023-08-01T19:54:35.916 DEBUG:teuthology.orchestra.run.smithi155:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 30 ceph --cluster ceph --admin-daemon /var/run/ceph/ceph-osd.2.asok dump_ops_in_flight 2023-08-01T19:54:35.927 INFO:tasks.ceph.osd.1.smithi101.stderr:2023-08-01T19:54:35.925+0000 7fb0cb7f6700 -1 received signal: Hangup from /usr/bin/python3 /bin/daemon-helper kill ceph-osd -f --cluster ceph -i 1 (PID: 111141) UID: 0 2023-08-01T19:54:36.028 INFO:tasks.ceph.osd.2.smithi155.stderr:2023-08-01T19:54:36.027+0000 7faa5c6ac700 -1 received signal: Hangup from /usr/bin/python3 /bin/daemon-helper kill ceph-osd -f --cluster ceph -i 2 (PID: 111337) UID: 0 2023-08-01T19:54:36.083 INFO:teuthology.orchestra.run.smithi155.stdout:ERROR: (22) Invalid argument 2023-08-01T19:54:36.084 INFO:teuthology.orchestra.run.smithi155.stdout:op_tracker tracking is not enabled now, so no ops are tracked currently, even those get stuck. Please enable "osd_enable_op_tracker", and the tracker will start to track new ops received afterwards. 2023-08-01T19:54:36.098 DEBUG:teuthology.orchestra.run.smithi155:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 30 ceph --cluster ceph --admin-daemon /var/run/ceph/ceph-osd.2.asok dump_blocked_ops 2023-08-01T19:54:36.129 INFO:tasks.ceph.osd.0.smithi008.stderr:2023-08-01T19:54:36.127+0000 7f16a58f4700 -1 received signal: Hangup from /usr/bin/python3 /bin/daemon-helper kill ceph-osd -f --cluster ceph -i 0 (PID: 111179) UID: 0 2023-08-01T19:54:36.214 DEBUG:teuthology.orchestra.run.smithi006:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 120 ceph --cluster ceph osd set nodeep-scrub 2023-08-01T19:54:36.229 INFO:tasks.ceph.osd.0.smithi008.stderr:2023-08-01T19:54:36.228+0000 7f16a58f4700 -1 received signal: Hangup from /usr/bin/python3 /bin/daemon-helper kill ceph-osd -f --cluster ceph -i 0 (PID: 111179) UID: 0 2023-08-01T19:54:36.302 INFO:teuthology.orchestra.run.smithi155.stdout:ERROR: (22) Invalid argument 2023-08-01T19:54:36.302 INFO:teuthology.orchestra.run.smithi155.stdout:op_tracker tracking is not enabled now, so no ops are tracked currently, even those get stuck. Please enable "osd_enable_op_tracker", and the tracker will start to track new ops received afterwards. 2023-08-01T19:54:36.313 INFO:tasks.radosbench.radosbench.0.smithi006.stdout: 12 16 40256 40240 209.568 170.312 0.00673789 0.00476851 2023-08-01T19:54:36.316 DEBUG:teuthology.orchestra.run.smithi155:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 30 ceph --cluster ceph --admin-daemon /var/run/ceph/ceph-osd.2.asok dump_historic_ops 2023-08-01T19:54:36.330 INFO:tasks.ceph.osd.1.smithi101.stderr:2023-08-01T19:54:36.329+0000 7fb0cb7f6700 -1 received signal: Hangup from /usr/bin/python3 /bin/daemon-helper kill ceph-osd -f --cluster ceph -i 1 (PID: 111141) UID: 0 2023-08-01T19:54:36.431 INFO:tasks.ceph.osd.1.smithi101.stderr:2023-08-01T19:54:36.430+0000 7fb0cb7f6700 -1 received signal: Hangup from /usr/bin/python3 /bin/daemon-helper kill ceph-osd -f --cluster ceph -i 1 (PID: 111141) UID: 0 2023-08-01T19:54:36.460 DEBUG:teuthology.orchestra.run.smithi006:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 120 ceph --cluster ceph -- tell 'osd.*' injectargs --osd_enable_op_tracker=true 2023-08-01T19:54:36.484 INFO:teuthology.orchestra.run.smithi155.stdout:ERROR: (22) Invalid argument 2023-08-01T19:54:36.484 INFO:teuthology.orchestra.run.smithi155.stdout:op_tracker tracking is not enabled now, so no ops are tracked currently, even those get stuck. Please enable "osd_enable_op_tracker", and the tracker will start to track new ops received afterwards. 2023-08-01T19:54:36.500 DEBUG:teuthology.orchestra.run.smithi008:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 30 ceph --cluster ceph --admin-daemon /var/run/ceph/ceph-osd.0.asok dump_ops_in_flight 2023-08-01T19:54:36.532 INFO:tasks.ceph.osd.1.smithi101.stderr:2023-08-01T19:54:36.531+0000 7fb0cb7f6700 -1 received signal: Hangup from /usr/bin/python3 /bin/daemon-helper kill ceph-osd -f --cluster ceph -i 1 (PID: 111141) UID: 0 2023-08-01T19:54:36.610 INFO:teuthology.orchestra.run.smithi006.stdout:osd.0: {} 2023-08-01T19:54:36.629 INFO:teuthology.orchestra.run.smithi006.stdout:osd.1: {} 2023-08-01T19:54:36.633 INFO:tasks.ceph.osd.1.smithi101.stderr:2023-08-01T19:54:36.632+0000 7fb0cb7f6700 -1 received signal: Hangup from /usr/bin/python3 /bin/daemon-helper kill ceph-osd -f --cluster ceph -i 1 (PID: 111141) UID: 0 2023-08-01T19:54:36.649 INFO:teuthology.orchestra.run.smithi006.stdout:osd.2: {} 2023-08-01T19:54:36.650 INFO:teuthology.orchestra.run.smithi006.stderr:osd.0: osd_enable_op_tracker = 'true' 2023-08-01T19:54:36.650 INFO:teuthology.orchestra.run.smithi006.stderr:osd.1: osd_enable_op_tracker = 'true' 2023-08-01T19:54:36.650 INFO:teuthology.orchestra.run.smithi006.stderr:osd.2: osd_enable_op_tracker = 'true' 2023-08-01T19:54:36.690 INFO:teuthology.orchestra.run.smithi008.stdout:{ 2023-08-01T19:54:36.690 INFO:teuthology.orchestra.run.smithi008.stdout: "ops": [ 2023-08-01T19:54:36.690 INFO:teuthology.orchestra.run.smithi008.stdout: { 2023-08-01T19:54:36.690 INFO:teuthology.orchestra.run.smithi008.stdout: "description": "osd_repop(client.4668.0:41202 5.0 e25/19 5:0b1a99f2:::benchmark_data_smithi006_114134_object41201:head v 25'2632, mlcod=25'2629)", 2023-08-01T19:54:36.690 INFO:teuthology.orchestra.run.smithi008.stdout: "initiated_at": "2023-08-01T19:54:36.686838+0000", 2023-08-01T19:54:36.690 INFO:teuthology.orchestra.run.smithi008.stdout: "age": 0.0013034500000000001, 2023-08-01T19:54:36.691 INFO:teuthology.orchestra.run.smithi008.stdout: "duration": 0.0013283469999999999, 2023-08-01T19:54:36.691 INFO:teuthology.orchestra.run.smithi008.stdout: "type_data": { 2023-08-01T19:54:36.691 INFO:teuthology.orchestra.run.smithi008.stdout: "flag_point": "started", 2023-08-01T19:54:36.691 INFO:teuthology.orchestra.run.smithi008.stdout: "events": [ 2023-08-01T19:54:36.691 INFO:teuthology.orchestra.run.smithi008.stdout: { 2023-08-01T19:54:36.691 INFO:teuthology.orchestra.run.smithi008.stdout: "event": "initiated", 2023-08-01T19:54:36.691 INFO:teuthology.orchestra.run.smithi008.stdout: "time": "2023-08-01T19:54:36.686838+0000", 2023-08-01T19:54:36.691 INFO:teuthology.orchestra.run.smithi008.stdout: "duration": 0 2023-08-01T19:54:36.692 INFO:teuthology.orchestra.run.smithi008.stdout: }, 2023-08-01T19:54:36.692 INFO:teuthology.orchestra.run.smithi008.stdout: { 2023-08-01T19:54:36.692 INFO:teuthology.orchestra.run.smithi008.stdout: "event": "throttled", 2023-08-01T19:54:36.692 INFO:teuthology.orchestra.run.smithi008.stdout: "time": "2023-08-01T19:54:36.686838+0000", 2023-08-01T19:54:36.692 INFO:teuthology.orchestra.run.smithi008.stdout: "duration": 0 2023-08-01T19:54:36.692 INFO:teuthology.orchestra.run.smithi008.stdout: }, 2023-08-01T19:54:36.692 INFO:teuthology.orchestra.run.smithi008.stdout: { 2023-08-01T19:54:36.693 INFO:teuthology.orchestra.run.smithi008.stdout: "event": "header_read", 2023-08-01T19:54:36.693 INFO:teuthology.orchestra.run.smithi008.stdout: "time": "2023-08-01T19:54:36.686837+0000", 2023-08-01T19:54:36.693 INFO:teuthology.orchestra.run.smithi008.stdout: "duration": 4294967295.9999995 2023-08-01T19:54:36.693 INFO:teuthology.orchestra.run.smithi008.stdout: }, 2023-08-01T19:54:36.693 INFO:teuthology.orchestra.run.smithi008.stdout: { 2023-08-01T19:54:36.693 INFO:teuthology.orchestra.run.smithi008.stdout: "event": "all_read", 2023-08-01T19:54:36.693 INFO:teuthology.orchestra.run.smithi008.stdout: "time": "2023-08-01T19:54:36.686868+0000", 2023-08-01T19:54:36.693 INFO:teuthology.orchestra.run.smithi008.stdout: "duration": 3.0888e-05 2023-08-01T19:54:36.694 INFO:teuthology.orchestra.run.smithi008.stdout: }, 2023-08-01T19:54:36.694 INFO:teuthology.orchestra.run.smithi008.stdout: { 2023-08-01T19:54:36.694 INFO:teuthology.orchestra.run.smithi008.stdout: "event": "dispatched", 2023-08-01T19:54:36.694 INFO:teuthology.orchestra.run.smithi008.stdout: "time": "2023-08-01T19:54:36.686876+0000", 2023-08-01T19:54:36.694 INFO:teuthology.orchestra.run.smithi008.stdout: "duration": 8.2509999999999994e-06 2023-08-01T19:54:36.694 INFO:teuthology.orchestra.run.smithi008.stdout: }, 2023-08-01T19:54:36.694 INFO:teuthology.orchestra.run.smithi008.stdout: { 2023-08-01T19:54:36.695 INFO:teuthology.orchestra.run.smithi008.stdout: "event": "queued_for_pg", 2023-08-01T19:54:36.695 INFO:teuthology.orchestra.run.smithi008.stdout: "time": "2023-08-01T19:54:36.686881+0000", 2023-08-01T19:54:36.695 INFO:teuthology.orchestra.run.smithi008.stdout: "duration": 5.0429999999999998e-06 2023-08-01T19:54:36.695 INFO:teuthology.orchestra.run.smithi008.stdout: }, 2023-08-01T19:54:36.695 INFO:teuthology.orchestra.run.smithi008.stdout: { 2023-08-01T19:54:36.695 INFO:teuthology.orchestra.run.smithi008.stdout: "event": "reached_pg", 2023-08-01T19:54:36.695 INFO:teuthology.orchestra.run.smithi008.stdout: "time": "2023-08-01T19:54:36.686917+0000", 2023-08-01T19:54:36.695 INFO:teuthology.orchestra.run.smithi008.stdout: "duration": 3.5821999999999997e-05 2023-08-01T19:54:36.696 INFO:teuthology.orchestra.run.smithi008.stdout: }, 2023-08-01T19:54:36.696 INFO:teuthology.orchestra.run.smithi008.stdout: { 2023-08-01T19:54:36.696 INFO:teuthology.orchestra.run.smithi008.stdout: "event": "started", 2023-08-01T19:54:36.696 INFO:teuthology.orchestra.run.smithi008.stdout: "time": "2023-08-01T19:54:36.686933+0000", 2023-08-01T19:54:36.696 INFO:teuthology.orchestra.run.smithi008.stdout: "duration": 1.5905000000000001e-05 2023-08-01T19:54:36.696 INFO:teuthology.orchestra.run.smithi008.stdout: } 2023-08-01T19:54:36.696 INFO:teuthology.orchestra.run.smithi008.stdout: ] 2023-08-01T19:54:36.697 INFO:teuthology.orchestra.run.smithi008.stdout: } 2023-08-01T19:54:36.697 INFO:teuthology.orchestra.run.smithi008.stdout: }, 2023-08-01T19:54:36.697 INFO:teuthology.orchestra.run.smithi008.stdout: { 2023-08-01T19:54:36.697 INFO:teuthology.orchestra.run.smithi008.stdout: "description": "osd_op(client.4668.0:41207 5.c 5:36888fd3:::benchmark_data_smithi006_114134_object41206:head [set-alloc-hint object_size 65536 write_size 65536,write 0~65536 in=65536b] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e25)", 2023-08-01T19:54:36.697 INFO:teuthology.orchestra.run.smithi008.stdout: "initiated_at": "2023-08-01T19:54:36.687571+0000", 2023-08-01T19:54:36.697 INFO:teuthology.orchestra.run.smithi008.stdout: "age": 0.00057075099999999998, 2023-08-01T19:54:36.697 INFO:teuthology.orchestra.run.smithi008.stdout: "duration": 0.00066784899999999998, 2023-08-01T19:54:36.697 INFO:teuthology.orchestra.run.smithi008.stdout: "type_data": { 2023-08-01T19:54:36.698 INFO:teuthology.orchestra.run.smithi008.stdout: "flag_point": "waiting for sub ops", 2023-08-01T19:54:36.698 INFO:teuthology.orchestra.run.smithi008.stdout: "client_info": { 2023-08-01T19:54:36.698 INFO:teuthology.orchestra.run.smithi008.stdout: "client": "client.4668", 2023-08-01T19:54:36.698 INFO:teuthology.orchestra.run.smithi008.stdout: "client_addr": "172.21.15.6:0/1709472247", 2023-08-01T19:54:36.698 INFO:teuthology.orchestra.run.smithi008.stdout: "tid": 41207 2023-08-01T19:54:36.698 INFO:teuthology.orchestra.run.smithi008.stdout: }, 2023-08-01T19:54:36.698 INFO:teuthology.orchestra.run.smithi008.stdout: "events": [ 2023-08-01T19:54:36.698 INFO:teuthology.orchestra.run.smithi008.stdout: { 2023-08-01T19:54:36.699 INFO:teuthology.orchestra.run.smithi008.stdout: "event": "initiated", 2023-08-01T19:54:36.699 INFO:teuthology.orchestra.run.smithi008.stdout: "time": "2023-08-01T19:54:36.687571+0000", 2023-08-01T19:54:36.699 INFO:teuthology.orchestra.run.smithi008.stdout: "duration": 0 2023-08-01T19:54:36.699 INFO:teuthology.orchestra.run.smithi008.stdout: }, 2023-08-01T19:54:36.699 INFO:teuthology.orchestra.run.smithi008.stdout: { 2023-08-01T19:54:36.699 INFO:teuthology.orchestra.run.smithi008.stdout: "event": "throttled", 2023-08-01T19:54:36.699 INFO:teuthology.orchestra.run.smithi008.stdout: "time": "2023-08-01T19:54:36.687571+0000", 2023-08-01T19:54:36.699 INFO:teuthology.orchestra.run.smithi008.stdout: "duration": 0 2023-08-01T19:54:36.700 INFO:teuthology.orchestra.run.smithi008.stdout: }, 2023-08-01T19:54:36.700 INFO:teuthology.orchestra.run.smithi008.stdout: { 2023-08-01T19:54:36.700 INFO:teuthology.orchestra.run.smithi008.stdout: "event": "header_read", 2023-08-01T19:54:36.700 INFO:teuthology.orchestra.run.smithi008.stdout: "time": "2023-08-01T19:54:36.687570+0000", 2023-08-01T19:54:36.700 INFO:teuthology.orchestra.run.smithi008.stdout: "duration": 4294967295.999999 2023-08-01T19:54:36.700 INFO:teuthology.orchestra.run.smithi008.stdout: }, 2023-08-01T19:54:36.700 INFO:teuthology.orchestra.run.smithi008.stdout: { 2023-08-01T19:54:36.701 INFO:teuthology.orchestra.run.smithi008.stdout: "event": "all_read", 2023-08-01T19:54:36.701 INFO:teuthology.orchestra.run.smithi008.stdout: "time": "2023-08-01T19:54:36.687688+0000", 2023-08-01T19:54:36.701 INFO:teuthology.orchestra.run.smithi008.stdout: "duration": 0.000118613 2023-08-01T19:54:36.701 INFO:teuthology.orchestra.run.smithi008.stdout: }, 2023-08-01T19:54:36.701 INFO:teuthology.orchestra.run.smithi008.stdout: { 2023-08-01T19:54:36.701 INFO:teuthology.orchestra.run.smithi008.stdout: "event": "dispatched", 2023-08-01T19:54:36.701 INFO:teuthology.orchestra.run.smithi008.stdout: "time": "2023-08-01T19:54:36.687698+0000", 2023-08-01T19:54:36.701 INFO:teuthology.orchestra.run.smithi008.stdout: "duration": 9.3810000000000005e-06 2023-08-01T19:54:36.702 INFO:teuthology.orchestra.run.smithi008.stdout: }, 2023-08-01T19:54:36.702 INFO:teuthology.orchestra.run.smithi008.stdout: { 2023-08-01T19:54:36.702 INFO:teuthology.orchestra.run.smithi008.stdout: "event": "queued_for_pg", 2023-08-01T19:54:36.702 INFO:teuthology.orchestra.run.smithi008.stdout: "time": "2023-08-01T19:54:36.687704+0000", 2023-08-01T19:54:36.702 INFO:teuthology.orchestra.run.smithi008.stdout: "duration": 6.5189999999999998e-06 2023-08-01T19:54:36.702 INFO:teuthology.orchestra.run.smithi008.stdout: }, 2023-08-01T19:54:36.702 INFO:teuthology.orchestra.run.smithi008.stdout: { 2023-08-01T19:54:36.702 INFO:teuthology.orchestra.run.smithi008.stdout: "event": "reached_pg", 2023-08-01T19:54:36.703 INFO:teuthology.orchestra.run.smithi008.stdout: "time": "2023-08-01T19:54:36.687756+0000", 2023-08-01T19:54:36.703 INFO:teuthology.orchestra.run.smithi008.stdout: "duration": 5.1827999999999999e-05 2023-08-01T19:54:36.703 INFO:teuthology.orchestra.run.smithi008.stdout: }, 2023-08-01T19:54:36.703 INFO:teuthology.orchestra.run.smithi008.stdout: { 2023-08-01T19:54:36.703 INFO:teuthology.orchestra.run.smithi008.stdout: "event": "started", 2023-08-01T19:54:36.703 INFO:teuthology.orchestra.run.smithi008.stdout: "time": "2023-08-01T19:54:36.687884+0000", 2023-08-01T19:54:36.703 INFO:teuthology.orchestra.run.smithi008.stdout: "duration": 0.00012796899999999999 2023-08-01T19:54:36.703 INFO:teuthology.orchestra.run.smithi008.stdout: }, 2023-08-01T19:54:36.704 INFO:teuthology.orchestra.run.smithi008.stdout: { 2023-08-01T19:54:36.704 INFO:teuthology.orchestra.run.smithi008.stdout: "event": "waiting for subops from 1", 2023-08-01T19:54:36.704 INFO:teuthology.orchestra.run.smithi008.stdout: "time": "2023-08-01T19:54:36.688026+0000", 2023-08-01T19:54:36.704 INFO:teuthology.orchestra.run.smithi008.stdout: "duration": 0.000142003 2023-08-01T19:54:36.704 INFO:teuthology.orchestra.run.smithi008.stdout: } 2023-08-01T19:54:36.704 INFO:teuthology.orchestra.run.smithi008.stdout: ] 2023-08-01T19:54:36.704 INFO:teuthology.orchestra.run.smithi008.stdout: } 2023-08-01T19:54:36.705 INFO:teuthology.orchestra.run.smithi008.stdout: }, 2023-08-01T19:54:36.705 INFO:teuthology.orchestra.run.smithi008.stdout: { 2023-08-01T19:54:36.705 INFO:teuthology.orchestra.run.smithi008.stdout: "description": "osd_repop(client.4668.0:41203 5.4 e25/19 5:28393e43:::benchmark_data_smithi006_114134_object41202:head v 25'2560, mlcod=25'2557)", 2023-08-01T19:54:36.705 INFO:teuthology.orchestra.run.smithi008.stdout: "initiated_at": "2023-08-01T19:54:36.687569+0000", 2023-08-01T19:54:36.705 INFO:teuthology.orchestra.run.smithi008.stdout: "age": 0.000572308, 2023-08-01T19:54:36.705 INFO:teuthology.orchestra.run.smithi008.stdout: "duration": 0.00074595800000000002, 2023-08-01T19:54:36.705 INFO:teuthology.orchestra.run.smithi008.stdout: "type_data": { 2023-08-01T19:54:36.705 INFO:teuthology.orchestra.run.smithi008.stdout: "flag_point": "started", 2023-08-01T19:54:36.706 INFO:teuthology.orchestra.run.smithi008.stdout: "events": [ 2023-08-01T19:54:36.706 INFO:teuthology.orchestra.run.smithi008.stdout: { 2023-08-01T19:54:36.706 INFO:teuthology.orchestra.run.smithi008.stdout: "event": "initiated", 2023-08-01T19:54:36.706 INFO:teuthology.orchestra.run.smithi008.stdout: "time": "2023-08-01T19:54:36.687569+0000", 2023-08-01T19:54:36.706 INFO:teuthology.orchestra.run.smithi008.stdout: "duration": 0 2023-08-01T19:54:36.706 INFO:teuthology.orchestra.run.smithi008.stdout: }, 2023-08-01T19:54:36.706 INFO:teuthology.orchestra.run.smithi008.stdout: { 2023-08-01T19:54:36.706 INFO:teuthology.orchestra.run.smithi008.stdout: "event": "throttled", 2023-08-01T19:54:36.707 INFO:teuthology.orchestra.run.smithi008.stdout: "time": "2023-08-01T19:54:36.687569+0000", 2023-08-01T19:54:36.707 INFO:teuthology.orchestra.run.smithi008.stdout: "duration": 0 2023-08-01T19:54:36.707 INFO:teuthology.orchestra.run.smithi008.stdout: }, 2023-08-01T19:54:36.707 INFO:teuthology.orchestra.run.smithi008.stdout: { 2023-08-01T19:54:36.707 INFO:teuthology.orchestra.run.smithi008.stdout: "event": "header_read", 2023-08-01T19:54:36.707 INFO:teuthology.orchestra.run.smithi008.stdout: "time": "2023-08-01T19:54:36.687568+0000", 2023-08-01T19:54:36.707 INFO:teuthology.orchestra.run.smithi008.stdout: "duration": 4294967295.9999995 2023-08-01T19:54:36.708 INFO:teuthology.orchestra.run.smithi008.stdout: }, 2023-08-01T19:54:36.708 INFO:teuthology.orchestra.run.smithi008.stdout: { 2023-08-01T19:54:36.708 INFO:teuthology.orchestra.run.smithi008.stdout: "event": "all_read", 2023-08-01T19:54:36.708 INFO:teuthology.orchestra.run.smithi008.stdout: "time": "2023-08-01T19:54:36.687690+0000", 2023-08-01T19:54:36.708 INFO:teuthology.orchestra.run.smithi008.stdout: "duration": 0.000121619 2023-08-01T19:54:36.708 INFO:teuthology.orchestra.run.smithi008.stdout: }, 2023-08-01T19:54:36.708 INFO:teuthology.orchestra.run.smithi008.stdout: { 2023-08-01T19:54:36.708 INFO:teuthology.orchestra.run.smithi008.stdout: "event": "dispatched", 2023-08-01T19:54:36.709 INFO:teuthology.orchestra.run.smithi008.stdout: "time": "2023-08-01T19:54:36.687702+0000", 2023-08-01T19:54:36.709 INFO:teuthology.orchestra.run.smithi008.stdout: "duration": 1.2123000000000001e-05 2023-08-01T19:54:36.709 INFO:teuthology.orchestra.run.smithi008.stdout: }, 2023-08-01T19:54:36.709 INFO:teuthology.orchestra.run.smithi008.stdout: { 2023-08-01T19:54:36.709 INFO:teuthology.orchestra.run.smithi008.stdout: "event": "queued_for_pg", 2023-08-01T19:54:36.709 INFO:teuthology.orchestra.run.smithi008.stdout: "time": "2023-08-01T19:54:36.687708+0000", 2023-08-01T19:54:36.709 INFO:teuthology.orchestra.run.smithi008.stdout: "duration": 6.0850000000000002e-06 2023-08-01T19:54:36.709 INFO:teuthology.orchestra.run.smithi008.stdout: }, 2023-08-01T19:54:36.710 INFO:teuthology.orchestra.run.smithi008.stdout: { 2023-08-01T19:54:36.710 INFO:teuthology.orchestra.run.smithi008.stdout: "event": "reached_pg", 2023-08-01T19:54:36.710 INFO:teuthology.orchestra.run.smithi008.stdout: "time": "2023-08-01T19:54:36.687738+0000", 2023-08-01T19:54:36.710 INFO:teuthology.orchestra.run.smithi008.stdout: "duration": 2.9595e-05 2023-08-01T19:54:36.710 INFO:teuthology.orchestra.run.smithi008.stdout: }, 2023-08-01T19:54:36.710 INFO:teuthology.orchestra.run.smithi008.stdout: { 2023-08-01T19:54:36.710 INFO:teuthology.orchestra.run.smithi008.stdout: "event": "started", 2023-08-01T19:54:36.710 INFO:teuthology.orchestra.run.smithi008.stdout: "time": "2023-08-01T19:54:36.687754+0000", 2023-08-01T19:54:36.711 INFO:teuthology.orchestra.run.smithi008.stdout: "duration": 1.6143000000000001e-05 2023-08-01T19:54:36.711 INFO:teuthology.orchestra.run.smithi008.stdout: } 2023-08-01T19:54:36.711 INFO:teuthology.orchestra.run.smithi008.stdout: ] 2023-08-01T19:54:36.711 INFO:teuthology.orchestra.run.smithi008.stdout: } 2023-08-01T19:54:36.711 INFO:teuthology.orchestra.run.smithi008.stdout: }, 2023-08-01T19:54:36.711 INFO:teuthology.orchestra.run.smithi008.stdout: { 2023-08-01T19:54:36.711 INFO:teuthology.orchestra.run.smithi008.stdout: "description": "osd_repop(client.4668.0:41205 5.b e25/19 5:d9d6745c:::benchmark_data_smithi006_114134_object41204:head v 25'2552, mlcod=25'2549)", 2023-08-01T19:54:36.711 INFO:teuthology.orchestra.run.smithi008.stdout: "initiated_at": "2023-08-01T19:54:36.687727+0000", 2023-08-01T19:54:36.712 INFO:teuthology.orchestra.run.smithi008.stdout: "age": 0.000414459, 2023-08-01T19:54:36.712 INFO:teuthology.orchestra.run.smithi008.stdout: "duration": 0.00065890399999999998, 2023-08-01T19:54:36.712 INFO:teuthology.orchestra.run.smithi008.stdout: "type_data": { 2023-08-01T19:54:36.712 INFO:teuthology.orchestra.run.smithi008.stdout: "flag_point": "started", 2023-08-01T19:54:36.712 INFO:teuthology.orchestra.run.smithi008.stdout: "events": [ 2023-08-01T19:54:36.712 INFO:teuthology.orchestra.run.smithi008.stdout: { 2023-08-01T19:54:36.712 INFO:teuthology.orchestra.run.smithi008.stdout: "event": "initiated", 2023-08-01T19:54:36.713 INFO:teuthology.orchestra.run.smithi008.stdout: "time": "2023-08-01T19:54:36.687727+0000", 2023-08-01T19:54:36.713 INFO:teuthology.orchestra.run.smithi008.stdout: "duration": 0 2023-08-01T19:54:36.713 INFO:teuthology.orchestra.run.smithi008.stdout: }, 2023-08-01T19:54:36.713 INFO:teuthology.orchestra.run.smithi008.stdout: { 2023-08-01T19:54:36.713 INFO:teuthology.orchestra.run.smithi008.stdout: "event": "throttled", 2023-08-01T19:54:36.713 INFO:teuthology.orchestra.run.smithi008.stdout: "time": "2023-08-01T19:54:36.687727+0000", 2023-08-01T19:54:36.713 INFO:teuthology.orchestra.run.smithi008.stdout: "duration": 0 2023-08-01T19:54:36.714 INFO:teuthology.orchestra.run.smithi008.stdout: }, 2023-08-01T19:54:36.714 INFO:teuthology.orchestra.run.smithi008.stdout: { 2023-08-01T19:54:36.714 INFO:teuthology.orchestra.run.smithi008.stdout: "event": "header_read", 2023-08-01T19:54:36.714 INFO:teuthology.orchestra.run.smithi008.stdout: "time": "2023-08-01T19:54:36.687726+0000", 2023-08-01T19:54:36.714 INFO:teuthology.orchestra.run.smithi008.stdout: "duration": 4294967295.9999995 2023-08-01T19:54:36.714 INFO:teuthology.orchestra.run.smithi008.stdout: }, 2023-08-01T19:54:36.714 INFO:teuthology.orchestra.run.smithi008.stdout: { 2023-08-01T19:54:36.714 INFO:teuthology.orchestra.run.smithi008.stdout: "event": "all_read", 2023-08-01T19:54:36.715 INFO:teuthology.orchestra.run.smithi008.stdout: "time": "2023-08-01T19:54:36.687851+0000", 2023-08-01T19:54:36.715 INFO:teuthology.orchestra.run.smithi008.stdout: "duration": 0.00012479200000000001 2023-08-01T19:54:36.715 INFO:teuthology.orchestra.run.smithi008.stdout: }, 2023-08-01T19:54:36.715 INFO:teuthology.orchestra.run.smithi008.stdout: { 2023-08-01T19:54:36.715 INFO:teuthology.orchestra.run.smithi008.stdout: "event": "dispatched", 2023-08-01T19:54:36.715 INFO:teuthology.orchestra.run.smithi008.stdout: "time": "2023-08-01T19:54:36.687861+0000", 2023-08-01T19:54:36.715 INFO:teuthology.orchestra.run.smithi008.stdout: "duration": 9.73e-06 2023-08-01T19:54:36.715 INFO:teuthology.orchestra.run.smithi008.stdout: }, 2023-08-01T19:54:36.716 INFO:teuthology.orchestra.run.smithi008.stdout: { 2023-08-01T19:54:36.716 INFO:teuthology.orchestra.run.smithi008.stdout: "event": "queued_for_pg", 2023-08-01T19:54:36.716 INFO:teuthology.orchestra.run.smithi008.stdout: "time": "2023-08-01T19:54:36.687868+0000", 2023-08-01T19:54:36.716 INFO:teuthology.orchestra.run.smithi008.stdout: "duration": 7.4059999999999999e-06 2023-08-01T19:54:36.716 INFO:teuthology.orchestra.run.smithi008.stdout: }, 2023-08-01T19:54:36.716 INFO:teuthology.orchestra.run.smithi008.stdout: { 2023-08-01T19:54:36.716 INFO:teuthology.orchestra.run.smithi008.stdout: "event": "reached_pg", 2023-08-01T19:54:36.717 INFO:teuthology.orchestra.run.smithi008.stdout: "time": "2023-08-01T19:54:36.687960+0000", 2023-08-01T19:54:36.717 INFO:teuthology.orchestra.run.smithi008.stdout: "duration": 9.2025000000000001e-05 2023-08-01T19:54:36.717 INFO:teuthology.orchestra.run.smithi008.stdout: }, 2023-08-01T19:54:36.717 INFO:teuthology.orchestra.run.smithi008.stdout: { 2023-08-01T19:54:36.717 INFO:teuthology.orchestra.run.smithi008.stdout: "event": "started", 2023-08-01T19:54:36.717 INFO:teuthology.orchestra.run.smithi008.stdout: "time": "2023-08-01T19:54:36.687986+0000", 2023-08-01T19:54:36.717 INFO:teuthology.orchestra.run.smithi008.stdout: "duration": 2.5316999999999998e-05 2023-08-01T19:54:36.717 INFO:teuthology.orchestra.run.smithi008.stdout: } 2023-08-01T19:54:36.718 INFO:teuthology.orchestra.run.smithi008.stdout: ] 2023-08-01T19:54:36.718 INFO:teuthology.orchestra.run.smithi008.stdout: } 2023-08-01T19:54:36.718 INFO:teuthology.orchestra.run.smithi008.stdout: }, 2023-08-01T19:54:36.718 INFO:teuthology.orchestra.run.smithi008.stdout: { 2023-08-01T19:54:36.718 INFO:teuthology.orchestra.run.smithi008.stdout: "description": "osd_repop(client.4668.0:41204 5.7 e25/19 5:ede12acc:::benchmark_data_smithi006_114134_object41203:head v 25'2526, mlcod=25'2523)", 2023-08-01T19:54:36.718 INFO:teuthology.orchestra.run.smithi008.stdout: "initiated_at": "2023-08-01T19:54:36.687788+0000", 2023-08-01T19:54:36.718 INFO:teuthology.orchestra.run.smithi008.stdout: "age": 0.000353257, 2023-08-01T19:54:36.718 INFO:teuthology.orchestra.run.smithi008.stdout: "duration": 0.00065909300000000003, 2023-08-01T19:54:36.719 INFO:teuthology.orchestra.run.smithi008.stdout: "type_data": { 2023-08-01T19:54:36.719 INFO:teuthology.orchestra.run.smithi008.stdout: "flag_point": "started", 2023-08-01T19:54:36.719 INFO:teuthology.orchestra.run.smithi008.stdout: "events": [ 2023-08-01T19:54:36.719 INFO:teuthology.orchestra.run.smithi008.stdout: { 2023-08-01T19:54:36.719 INFO:teuthology.orchestra.run.smithi008.stdout: "event": "initiated", 2023-08-01T19:54:36.719 INFO:teuthology.orchestra.run.smithi008.stdout: "time": "2023-08-01T19:54:36.687788+0000", 2023-08-01T19:54:36.719 INFO:teuthology.orchestra.run.smithi008.stdout: "duration": 0 2023-08-01T19:54:36.719 INFO:teuthology.orchestra.run.smithi008.stdout: }, 2023-08-01T19:54:36.720 INFO:teuthology.orchestra.run.smithi008.stdout: { 2023-08-01T19:54:36.720 INFO:teuthology.orchestra.run.smithi008.stdout: "event": "throttled", 2023-08-01T19:54:36.720 INFO:teuthology.orchestra.run.smithi008.stdout: "time": "2023-08-01T19:54:36.687788+0000", 2023-08-01T19:54:36.720 INFO:teuthology.orchestra.run.smithi008.stdout: "duration": 0 2023-08-01T19:54:36.720 INFO:teuthology.orchestra.run.smithi008.stdout: }, 2023-08-01T19:54:36.720 INFO:teuthology.orchestra.run.smithi008.stdout: { 2023-08-01T19:54:36.720 INFO:teuthology.orchestra.run.smithi008.stdout: "event": "header_read", 2023-08-01T19:54:36.721 INFO:teuthology.orchestra.run.smithi008.stdout: "time": "2023-08-01T19:54:36.687787+0000", 2023-08-01T19:54:36.721 INFO:teuthology.orchestra.run.smithi008.stdout: "duration": 4294967295.9999995 2023-08-01T19:54:36.721 INFO:teuthology.orchestra.run.smithi008.stdout: }, 2023-08-01T19:54:36.721 INFO:teuthology.orchestra.run.smithi008.stdout: { 2023-08-01T19:54:36.721 INFO:teuthology.orchestra.run.smithi008.stdout: "event": "all_read", 2023-08-01T19:54:36.721 INFO:teuthology.orchestra.run.smithi008.stdout: "time": "2023-08-01T19:54:36.687893+0000", 2023-08-01T19:54:36.721 INFO:teuthology.orchestra.run.smithi008.stdout: "duration": 0.00010537800000000001 2023-08-01T19:54:36.721 INFO:teuthology.orchestra.run.smithi008.stdout: }, 2023-08-01T19:54:36.722 INFO:teuthology.orchestra.run.smithi008.stdout: { 2023-08-01T19:54:36.722 INFO:teuthology.orchestra.run.smithi008.stdout: "event": "dispatched", 2023-08-01T19:54:36.722 INFO:teuthology.orchestra.run.smithi008.stdout: "time": "2023-08-01T19:54:36.687900+0000", 2023-08-01T19:54:36.722 INFO:teuthology.orchestra.run.smithi008.stdout: "duration": 7.6320000000000008e-06 2023-08-01T19:54:36.722 INFO:teuthology.orchestra.run.smithi008.stdout: }, 2023-08-01T19:54:36.722 INFO:teuthology.orchestra.run.smithi008.stdout: { 2023-08-01T19:54:36.722 INFO:teuthology.orchestra.run.smithi008.stdout: "event": "queued_for_pg", 2023-08-01T19:54:36.722 INFO:teuthology.orchestra.run.smithi008.stdout: "time": "2023-08-01T19:54:36.687905+0000", 2023-08-01T19:54:36.723 INFO:teuthology.orchestra.run.smithi008.stdout: "duration": 4.7439999999999998e-06 2023-08-01T19:54:36.723 INFO:teuthology.orchestra.run.smithi008.stdout: }, 2023-08-01T19:54:36.723 INFO:teuthology.orchestra.run.smithi008.stdout: { 2023-08-01T19:54:36.723 INFO:teuthology.orchestra.run.smithi008.stdout: "event": "reached_pg", 2023-08-01T19:54:36.723 INFO:teuthology.orchestra.run.smithi008.stdout: "time": "2023-08-01T19:54:36.688031+0000", 2023-08-01T19:54:36.723 INFO:teuthology.orchestra.run.smithi008.stdout: "duration": 0.000125353 2023-08-01T19:54:36.723 INFO:teuthology.orchestra.run.smithi008.stdout: }, 2023-08-01T19:54:36.723 INFO:teuthology.orchestra.run.smithi008.stdout: { 2023-08-01T19:54:36.724 INFO:teuthology.orchestra.run.smithi008.stdout: "event": "started", 2023-08-01T19:54:36.724 INFO:teuthology.orchestra.run.smithi008.stdout: "time": "2023-08-01T19:54:36.688048+0000", 2023-08-01T19:54:36.724 INFO:teuthology.orchestra.run.smithi008.stdout: "duration": 1.7750000000000001e-05 2023-08-01T19:54:36.724 INFO:teuthology.orchestra.run.smithi008.stdout: } 2023-08-01T19:54:36.724 INFO:teuthology.orchestra.run.smithi008.stdout: ] 2023-08-01T19:54:36.724 INFO:teuthology.orchestra.run.smithi008.stdout: } 2023-08-01T19:54:36.724 INFO:teuthology.orchestra.run.smithi008.stdout: }, 2023-08-01T19:54:36.725 INFO:teuthology.orchestra.run.smithi008.stdout: { 2023-08-01T19:54:36.725 INFO:teuthology.orchestra.run.smithi008.stdout: "description": "osd_op(client.4668.0:41198 5.a 5:5888cf21:::benchmark_data_smithi006_114134_object41197:head [set-alloc-hint object_size 65536 write_size 65536,write 0~65536 in=65536b] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e25)", 2023-08-01T19:54:36.725 INFO:teuthology.orchestra.run.smithi008.stdout: "initiated_at": "2023-08-01T19:54:36.684418+0000", 2023-08-01T19:54:36.725 INFO:teuthology.orchestra.run.smithi008.stdout: "age": 0.0037230900000000001, 2023-08-01T19:54:36.725 INFO:teuthology.orchestra.run.smithi008.stdout: "duration": 0.0040948670000000003, 2023-08-01T19:54:36.725 INFO:teuthology.orchestra.run.smithi008.stdout: "type_data": { 2023-08-01T19:54:36.725 INFO:teuthology.orchestra.run.smithi008.stdout: "flag_point": "waiting for sub ops", 2023-08-01T19:54:36.725 INFO:teuthology.orchestra.run.smithi008.stdout: "client_info": { 2023-08-01T19:54:36.726 INFO:teuthology.orchestra.run.smithi008.stdout: "client": "client.4668", 2023-08-01T19:54:36.726 INFO:teuthology.orchestra.run.smithi008.stdout: "client_addr": "172.21.15.6:0/1709472247", 2023-08-01T19:54:36.726 INFO:teuthology.orchestra.run.smithi008.stdout: "tid": 41198 2023-08-01T19:54:36.726 INFO:teuthology.orchestra.run.smithi008.stdout: }, 2023-08-01T19:54:36.726 INFO:teuthology.orchestra.run.smithi008.stdout: "events": [ 2023-08-01T19:54:36.726 INFO:teuthology.orchestra.run.smithi008.stdout: { 2023-08-01T19:54:36.726 INFO:teuthology.orchestra.run.smithi008.stdout: "event": "initiated", 2023-08-01T19:54:36.726 INFO:teuthology.orchestra.run.smithi008.stdout: "time": "2023-08-01T19:54:36.684418+0000", 2023-08-01T19:54:36.727 INFO:teuthology.orchestra.run.smithi008.stdout: "duration": 0 2023-08-01T19:54:36.727 INFO:teuthology.orchestra.run.smithi008.stdout: }, 2023-08-01T19:54:36.727 INFO:teuthology.orchestra.run.smithi008.stdout: { 2023-08-01T19:54:36.727 INFO:teuthology.orchestra.run.smithi008.stdout: "event": "throttled", 2023-08-01T19:54:36.727 INFO:teuthology.orchestra.run.smithi008.stdout: "time": "2023-08-01T19:54:36.684418+0000", 2023-08-01T19:54:36.727 INFO:teuthology.orchestra.run.smithi008.stdout: "duration": 0 2023-08-01T19:54:36.727 INFO:teuthology.orchestra.run.smithi008.stdout: }, 2023-08-01T19:54:36.727 INFO:teuthology.orchestra.run.smithi008.stdout: { 2023-08-01T19:54:36.728 INFO:teuthology.orchestra.run.smithi008.stdout: "event": "header_read", 2023-08-01T19:54:36.728 INFO:teuthology.orchestra.run.smithi008.stdout: "time": "2023-08-01T19:54:36.684417+0000", 2023-08-01T19:54:36.728 INFO:teuthology.orchestra.run.smithi008.stdout: "duration": 4294967295.999999 2023-08-01T19:54:36.728 INFO:teuthology.orchestra.run.smithi008.stdout: }, 2023-08-01T19:54:36.728 INFO:teuthology.orchestra.run.smithi008.stdout: { 2023-08-01T19:54:36.728 INFO:teuthology.orchestra.run.smithi008.stdout: "event": "all_read", 2023-08-01T19:54:36.728 INFO:teuthology.orchestra.run.smithi008.stdout: "time": "2023-08-01T19:54:36.684526+0000", 2023-08-01T19:54:36.729 INFO:teuthology.orchestra.run.smithi008.stdout: "duration": 0.000109121 2023-08-01T19:54:36.729 INFO:teuthology.orchestra.run.smithi008.stdout: }, 2023-08-01T19:54:36.729 INFO:teuthology.orchestra.run.smithi008.stdout: { 2023-08-01T19:54:36.729 INFO:teuthology.orchestra.run.smithi008.stdout: "event": "dispatched", 2023-08-01T19:54:36.729 INFO:teuthology.orchestra.run.smithi008.stdout: "time": "2023-08-01T19:54:36.684538+0000", 2023-08-01T19:54:36.729 INFO:teuthology.orchestra.run.smithi008.stdout: "duration": 1.2099000000000001e-05 2023-08-01T19:54:36.729 INFO:teuthology.orchestra.run.smithi008.stdout: }, 2023-08-01T19:54:36.729 INFO:teuthology.orchestra.run.smithi008.stdout: { 2023-08-01T19:54:36.730 INFO:teuthology.orchestra.run.smithi008.stdout: "event": "queued_for_pg", 2023-08-01T19:54:36.730 INFO:teuthology.orchestra.run.smithi008.stdout: "time": "2023-08-01T19:54:36.684545+0000", 2023-08-01T19:54:36.730 INFO:teuthology.orchestra.run.smithi008.stdout: "duration": 7.1219999999999997e-06 2023-08-01T19:54:36.730 INFO:teuthology.orchestra.run.smithi008.stdout: }, 2023-08-01T19:54:36.730 INFO:teuthology.orchestra.run.smithi008.stdout: { 2023-08-01T19:54:36.730 INFO:teuthology.orchestra.run.smithi008.stdout: "event": "reached_pg", 2023-08-01T19:54:36.730 INFO:teuthology.orchestra.run.smithi008.stdout: "time": "2023-08-01T19:54:36.685136+0000", 2023-08-01T19:54:36.730 INFO:teuthology.orchestra.run.smithi008.stdout: "duration": 0.00059063500000000005 2023-08-01T19:54:36.731 INFO:teuthology.orchestra.run.smithi008.stdout: }, 2023-08-01T19:54:36.731 INFO:teuthology.orchestra.run.smithi008.stdout: { 2023-08-01T19:54:36.731 INFO:teuthology.orchestra.run.smithi008.stdout: "event": "started", 2023-08-01T19:54:36.731 INFO:teuthology.orchestra.run.smithi008.stdout: "time": "2023-08-01T19:54:36.685259+0000", 2023-08-01T19:54:36.731 INFO:teuthology.orchestra.run.smithi008.stdout: "duration": 0.00012301599999999999 2023-08-01T19:54:36.731 INFO:teuthology.orchestra.run.smithi008.stdout: }, 2023-08-01T19:54:36.731 INFO:teuthology.orchestra.run.smithi008.stdout: { 2023-08-01T19:54:36.731 INFO:teuthology.orchestra.run.smithi008.stdout: "event": "waiting for subops from 2", 2023-08-01T19:54:36.732 INFO:teuthology.orchestra.run.smithi008.stdout: "time": "2023-08-01T19:54:36.685395+0000", 2023-08-01T19:54:36.732 INFO:teuthology.orchestra.run.smithi008.stdout: "duration": 0.00013612800000000001 2023-08-01T19:54:36.732 INFO:teuthology.orchestra.run.smithi008.stdout: } 2023-08-01T19:54:36.732 INFO:teuthology.orchestra.run.smithi008.stdout: ] 2023-08-01T19:54:36.732 INFO:teuthology.orchestra.run.smithi008.stdout: } 2023-08-01T19:54:36.732 INFO:teuthology.orchestra.run.smithi008.stdout: }, 2023-08-01T19:54:36.732 INFO:teuthology.orchestra.run.smithi008.stdout: { 2023-08-01T19:54:36.732 INFO:teuthology.orchestra.run.smithi008.stdout: "description": "osd_repop(client.4668.0:41196 5.b e25/19 5:d421b1cd:::benchmark_data_smithi006_114134_object41195:head v 25'2551, mlcod=25'2549)", 2023-08-01T19:54:36.733 INFO:teuthology.orchestra.run.smithi008.stdout: "initiated_at": "2023-08-01T19:54:36.684630+0000", 2023-08-01T19:54:36.733 INFO:teuthology.orchestra.run.smithi008.stdout: "age": 0.0035114209999999998, 2023-08-01T19:54:36.733 INFO:teuthology.orchestra.run.smithi008.stdout: "duration": 0.0039592309999999997, 2023-08-01T19:54:36.733 INFO:teuthology.orchestra.run.smithi008.stdout: "type_data": { 2023-08-01T19:54:36.733 INFO:teuthology.orchestra.run.smithi008.stdout: "flag_point": "started", 2023-08-01T19:54:36.733 INFO:teuthology.orchestra.run.smithi008.stdout: "events": [ 2023-08-01T19:54:36.733 INFO:teuthology.orchestra.run.smithi008.stdout: { 2023-08-01T19:54:36.733 INFO:teuthology.orchestra.run.smithi008.stdout: "event": "initiated", 2023-08-01T19:54:36.734 INFO:teuthology.orchestra.run.smithi008.stdout: "time": "2023-08-01T19:54:36.684630+0000", 2023-08-01T19:54:36.734 INFO:teuthology.orchestra.run.smithi008.stdout: "duration": 0 2023-08-01T19:54:36.734 INFO:teuthology.orchestra.run.smithi008.stdout: }, 2023-08-01T19:54:36.734 INFO:teuthology.orchestra.run.smithi008.stdout: { 2023-08-01T19:54:36.734 INFO:teuthology.orchestra.run.smithi008.stdout: "event": "throttled", 2023-08-01T19:54:36.734 INFO:teuthology.orchestra.run.smithi008.stdout: "time": "2023-08-01T19:54:36.684630+0000", 2023-08-01T19:54:36.734 INFO:teuthology.orchestra.run.smithi008.stdout: "duration": 0 2023-08-01T19:54:36.734 INFO:teuthology.orchestra.run.smithi008.stdout: }, 2023-08-01T19:54:36.735 INFO:teuthology.orchestra.run.smithi008.stdout: { 2023-08-01T19:54:36.735 INFO:teuthology.orchestra.run.smithi008.stdout: "event": "header_read", 2023-08-01T19:54:36.735 INFO:teuthology.orchestra.run.smithi008.stdout: "time": "2023-08-01T19:54:36.684630+0000", 2023-08-01T19:54:36.735 INFO:teuthology.orchestra.run.smithi008.stdout: "duration": 4294967295.9999995 2023-08-01T19:54:36.735 INFO:teuthology.orchestra.run.smithi008.stdout: }, 2023-08-01T19:54:36.735 INFO:teuthology.orchestra.run.smithi008.stdout: { 2023-08-01T19:54:36.735 INFO:teuthology.orchestra.run.smithi008.stdout: "event": "all_read", 2023-08-01T19:54:36.735 INFO:teuthology.orchestra.run.smithi008.stdout: "time": "2023-08-01T19:54:36.684732+0000", 2023-08-01T19:54:36.736 INFO:teuthology.orchestra.run.smithi008.stdout: "duration": 0.00010219 2023-08-01T19:54:36.736 INFO:teuthology.orchestra.run.smithi008.stdout: }, 2023-08-01T19:54:36.736 INFO:teuthology.orchestra.run.smithi008.stdout: { 2023-08-01T19:54:36.736 INFO:teuthology.orchestra.run.smithi008.stdout: "event": "dispatched", 2023-08-01T19:54:36.736 INFO:teuthology.orchestra.run.smithi008.stdout: "time": "2023-08-01T19:54:36.684743+0000", 2023-08-01T19:54:36.736 INFO:teuthology.orchestra.run.smithi008.stdout: "duration": 1.0736e-05 2023-08-01T19:54:36.736 INFO:teuthology.orchestra.run.smithi008.stdout: }, 2023-08-01T19:54:36.737 INFO:teuthology.orchestra.run.smithi008.stdout: { 2023-08-01T19:54:36.737 INFO:teuthology.orchestra.run.smithi008.stdout: "event": "queued_for_pg", 2023-08-01T19:54:36.737 INFO:teuthology.orchestra.run.smithi008.stdout: "time": "2023-08-01T19:54:36.684754+0000", 2023-08-01T19:54:36.737 INFO:teuthology.orchestra.run.smithi008.stdout: "duration": 1.1963e-05 2023-08-01T19:54:36.737 INFO:teuthology.orchestra.run.smithi008.stdout: }, 2023-08-01T19:54:36.737 INFO:teuthology.orchestra.run.smithi008.stdout: { 2023-08-01T19:54:36.737 INFO:teuthology.orchestra.run.smithi008.stdout: "event": "reached_pg", 2023-08-01T19:54:36.737 INFO:teuthology.orchestra.run.smithi008.stdout: "time": "2023-08-01T19:54:36.684790+0000", 2023-08-01T19:54:36.738 INFO:teuthology.orchestra.run.smithi008.stdout: "duration": 3.5602999999999998e-05 2023-08-01T19:54:36.738 INFO:teuthology.orchestra.run.smithi008.stdout: }, 2023-08-01T19:54:36.738 INFO:teuthology.orchestra.run.smithi008.stdout: { 2023-08-01T19:54:36.738 INFO:teuthology.orchestra.run.smithi008.stdout: "event": "started", 2023-08-01T19:54:36.738 INFO:teuthology.orchestra.run.smithi008.stdout: "time": "2023-08-01T19:54:36.684808+0000", 2023-08-01T19:54:36.738 INFO:teuthology.orchestra.run.smithi008.stdout: "duration": 1.7745999999999999e-05 2023-08-01T19:54:36.738 INFO:teuthology.orchestra.run.smithi008.stdout: } 2023-08-01T19:54:36.738 INFO:teuthology.orchestra.run.smithi008.stdout: ] 2023-08-01T19:54:36.739 INFO:teuthology.orchestra.run.smithi008.stdout: } 2023-08-01T19:54:36.739 INFO:teuthology.orchestra.run.smithi008.stdout: }, 2023-08-01T19:54:36.739 INFO:teuthology.orchestra.run.smithi008.stdout: { 2023-08-01T19:54:36.739 INFO:teuthology.orchestra.run.smithi008.stdout: "description": "osd_repop(client.4668.0:41195 5.7 e25/19 5:ef5dd9d7:::benchmark_data_smithi006_114134_object41194:head v 25'2525, mlcod=25'2523)", 2023-08-01T19:54:36.739 INFO:teuthology.orchestra.run.smithi008.stdout: "initiated_at": "2023-08-01T19:54:36.684614+0000", 2023-08-01T19:54:36.739 INFO:teuthology.orchestra.run.smithi008.stdout: "age": 0.0035276159999999999, 2023-08-01T19:54:36.739 INFO:teuthology.orchestra.run.smithi008.stdout: "duration": 0.0040369270000000001, 2023-08-01T19:54:36.739 INFO:teuthology.orchestra.run.smithi008.stdout: "type_data": { 2023-08-01T19:54:36.740 INFO:teuthology.orchestra.run.smithi008.stdout: "flag_point": "started", 2023-08-01T19:54:36.740 INFO:teuthology.orchestra.run.smithi008.stdout: "events": [ 2023-08-01T19:54:36.740 INFO:teuthology.orchestra.run.smithi008.stdout: { 2023-08-01T19:54:36.740 INFO:teuthology.orchestra.run.smithi008.stdout: "event": "initiated", 2023-08-01T19:54:36.740 INFO:teuthology.orchestra.run.smithi008.stdout: "time": "2023-08-01T19:54:36.684614+0000", 2023-08-01T19:54:36.740 INFO:teuthology.orchestra.run.smithi008.stdout: "duration": 0 2023-08-01T19:54:36.740 INFO:teuthology.orchestra.run.smithi008.stdout: }, 2023-08-01T19:54:36.740 INFO:teuthology.orchestra.run.smithi008.stdout: { 2023-08-01T19:54:36.741 INFO:teuthology.orchestra.run.smithi008.stdout: "event": "throttled", 2023-08-01T19:54:36.741 INFO:teuthology.orchestra.run.smithi008.stdout: "time": "2023-08-01T19:54:36.684614+0000", 2023-08-01T19:54:36.741 INFO:teuthology.orchestra.run.smithi008.stdout: "duration": 0 2023-08-01T19:54:36.741 INFO:teuthology.orchestra.run.smithi008.stdout: }, 2023-08-01T19:54:36.741 INFO:teuthology.orchestra.run.smithi008.stdout: { 2023-08-01T19:54:36.741 INFO:teuthology.orchestra.run.smithi008.stdout: "event": "header_read", 2023-08-01T19:54:36.741 INFO:teuthology.orchestra.run.smithi008.stdout: "time": "2023-08-01T19:54:36.684613+0000", 2023-08-01T19:54:36.742 INFO:teuthology.orchestra.run.smithi008.stdout: "duration": 4294967295.9999995 2023-08-01T19:54:36.742 INFO:teuthology.orchestra.run.smithi008.stdout: }, 2023-08-01T19:54:36.742 INFO:teuthology.orchestra.run.smithi008.stdout: { 2023-08-01T19:54:36.742 INFO:teuthology.orchestra.run.smithi008.stdout: "event": "all_read", 2023-08-01T19:54:36.742 INFO:teuthology.orchestra.run.smithi008.stdout: "time": "2023-08-01T19:54:36.684780+0000", 2023-08-01T19:54:36.742 INFO:teuthology.orchestra.run.smithi008.stdout: "duration": 0.000167178 2023-08-01T19:54:36.742 INFO:teuthology.orchestra.run.smithi008.stdout: }, 2023-08-01T19:54:36.742 INFO:teuthology.orchestra.run.smithi008.stdout: { 2023-08-01T19:54:36.743 INFO:teuthology.orchestra.run.smithi008.stdout: "event": "dispatched", 2023-08-01T19:54:36.743 INFO:teuthology.orchestra.run.smithi008.stdout: "time": "2023-08-01T19:54:36.684788+0000", 2023-08-01T19:54:36.743 INFO:teuthology.orchestra.run.smithi008.stdout: "duration": 7.9859999999999994e-06 2023-08-01T19:54:36.743 INFO:teuthology.orchestra.run.smithi008.stdout: }, 2023-08-01T19:54:36.743 INFO:teuthology.orchestra.run.smithi008.stdout: { 2023-08-01T19:54:36.743 INFO:teuthology.orchestra.run.smithi008.stdout: "event": "queued_for_pg", 2023-08-01T19:54:36.743 INFO:teuthology.orchestra.run.smithi008.stdout: "time": "2023-08-01T19:54:36.684792+0000", 2023-08-01T19:54:36.743 INFO:teuthology.orchestra.run.smithi008.stdout: "duration": 3.9140000000000001e-06 2023-08-01T19:54:36.744 INFO:teuthology.orchestra.run.smithi008.stdout: }, 2023-08-01T19:54:36.744 INFO:teuthology.orchestra.run.smithi008.stdout: { 2023-08-01T19:54:36.744 INFO:teuthology.orchestra.run.smithi008.stdout: "event": "reached_pg", 2023-08-01T19:54:36.744 INFO:teuthology.orchestra.run.smithi008.stdout: "time": "2023-08-01T19:54:36.684846+0000", 2023-08-01T19:54:36.744 INFO:teuthology.orchestra.run.smithi008.stdout: "duration": 5.4073999999999998e-05 2023-08-01T19:54:36.744 INFO:teuthology.orchestra.run.smithi008.stdout: }, 2023-08-01T19:54:36.744 INFO:teuthology.orchestra.run.smithi008.stdout: { 2023-08-01T19:54:36.745 INFO:teuthology.orchestra.run.smithi008.stdout: "event": "started", 2023-08-01T19:54:36.745 INFO:teuthology.orchestra.run.smithi008.stdout: "time": "2023-08-01T19:54:36.684864+0000", 2023-08-01T19:54:36.745 INFO:teuthology.orchestra.run.smithi008.stdout: "duration": 1.7365999999999999e-05 2023-08-01T19:54:36.745 INFO:teuthology.orchestra.run.smithi008.stdout: } 2023-08-01T19:54:36.745 INFO:teuthology.orchestra.run.smithi008.stdout: ] 2023-08-01T19:54:36.745 INFO:teuthology.orchestra.run.smithi008.stdout: } 2023-08-01T19:54:36.745 INFO:teuthology.orchestra.run.smithi008.stdout: }, 2023-08-01T19:54:36.745 INFO:teuthology.orchestra.run.smithi008.stdout: { 2023-08-01T19:54:36.746 INFO:teuthology.orchestra.run.smithi008.stdout: "description": "osd_op(client.4668.0:41200 5.3 5:c1c9dbc3:::benchmark_data_smithi006_114134_object41199:head [set-alloc-hint object_size 65536 write_size 65536,write 0~65536 in=65536b] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e25)", 2023-08-01T19:54:36.746 INFO:teuthology.orchestra.run.smithi008.stdout: "initiated_at": "2023-08-01T19:54:36.685118+0000", 2023-08-01T19:54:36.746 INFO:teuthology.orchestra.run.smithi008.stdout: "age": 0.00302302, 2023-08-01T19:54:36.746 INFO:teuthology.orchestra.run.smithi008.stdout: "duration": 0.003601412, 2023-08-01T19:54:36.746 INFO:teuthology.orchestra.run.smithi008.stdout: "type_data": { 2023-08-01T19:54:36.746 INFO:teuthology.orchestra.run.smithi008.stdout: "flag_point": "waiting for sub ops", 2023-08-01T19:54:36.746 INFO:teuthology.orchestra.run.smithi008.stdout: "client_info": { 2023-08-01T19:54:36.746 INFO:teuthology.orchestra.run.smithi008.stdout: "client": "client.4668", 2023-08-01T19:54:36.747 INFO:teuthology.orchestra.run.smithi008.stdout: "client_addr": "172.21.15.6:0/1709472247", 2023-08-01T19:54:36.747 INFO:teuthology.orchestra.run.smithi008.stdout: "tid": 41200 2023-08-01T19:54:36.747 INFO:teuthology.orchestra.run.smithi008.stdout: }, 2023-08-01T19:54:36.747 INFO:teuthology.orchestra.run.smithi008.stdout: "events": [ 2023-08-01T19:54:36.747 INFO:teuthology.orchestra.run.smithi008.stdout: { 2023-08-01T19:54:36.747 INFO:teuthology.orchestra.run.smithi008.stdout: "event": "initiated", 2023-08-01T19:54:36.747 INFO:teuthology.orchestra.run.smithi008.stdout: "time": "2023-08-01T19:54:36.685118+0000", 2023-08-01T19:54:36.747 INFO:teuthology.orchestra.run.smithi008.stdout: "duration": 0 2023-08-01T19:54:36.748 INFO:teuthology.orchestra.run.smithi008.stdout: }, 2023-08-01T19:54:36.748 INFO:teuthology.orchestra.run.smithi008.stdout: { 2023-08-01T19:54:36.748 INFO:teuthology.orchestra.run.smithi008.stdout: "event": "throttled", 2023-08-01T19:54:36.748 INFO:teuthology.orchestra.run.smithi008.stdout: "time": "2023-08-01T19:54:36.685118+0000", 2023-08-01T19:54:36.748 INFO:teuthology.orchestra.run.smithi008.stdout: "duration": 0 2023-08-01T19:54:36.748 INFO:teuthology.orchestra.run.smithi008.stdout: }, 2023-08-01T19:54:36.748 INFO:teuthology.orchestra.run.smithi008.stdout: { 2023-08-01T19:54:36.748 INFO:teuthology.orchestra.run.smithi008.stdout: "event": "header_read", 2023-08-01T19:54:36.749 INFO:teuthology.orchestra.run.smithi008.stdout: "time": "2023-08-01T19:54:36.685118+0000", 2023-08-01T19:54:36.749 INFO:teuthology.orchestra.run.smithi008.stdout: "duration": 4294967295.999999 2023-08-01T19:54:36.749 INFO:teuthology.orchestra.run.smithi008.stdout: }, 2023-08-01T19:54:36.749 INFO:teuthology.orchestra.run.smithi008.stdout: { 2023-08-01T19:54:36.749 INFO:teuthology.orchestra.run.smithi008.stdout: "event": "all_read", 2023-08-01T19:54:36.749 INFO:teuthology.orchestra.run.smithi008.stdout: "time": "2023-08-01T19:54:36.685147+0000", 2023-08-01T19:54:36.749 INFO:teuthology.orchestra.run.smithi008.stdout: "duration": 2.9085e-05 2023-08-01T19:54:36.750 INFO:teuthology.orchestra.run.smithi008.stdout: }, 2023-08-01T19:54:36.750 INFO:teuthology.orchestra.run.smithi008.stdout: { 2023-08-01T19:54:36.750 INFO:teuthology.orchestra.run.smithi008.stdout: "event": "dispatched", 2023-08-01T19:54:36.750 INFO:teuthology.orchestra.run.smithi008.stdout: "time": "2023-08-01T19:54:36.685156+0000", 2023-08-01T19:54:36.750 INFO:teuthology.orchestra.run.smithi008.stdout: "duration": 9.3479999999999993e-06 2023-08-01T19:54:36.750 INFO:teuthology.orchestra.run.smithi008.stdout: }, 2023-08-01T19:54:36.750 INFO:teuthology.orchestra.run.smithi008.stdout: { 2023-08-01T19:54:36.750 INFO:teuthology.orchestra.run.smithi008.stdout: "event": "queued_for_pg", 2023-08-01T19:54:36.751 INFO:teuthology.orchestra.run.smithi008.stdout: "time": "2023-08-01T19:54:36.685162+0000", 2023-08-01T19:54:36.751 INFO:teuthology.orchestra.run.smithi008.stdout: "duration": 5.6799999999999998e-06 2023-08-01T19:54:36.751 INFO:teuthology.orchestra.run.smithi008.stdout: }, 2023-08-01T19:54:36.751 INFO:teuthology.orchestra.run.smithi008.stdout: { 2023-08-01T19:54:36.751 INFO:teuthology.orchestra.run.smithi008.stdout: "event": "reached_pg", 2023-08-01T19:54:36.751 INFO:teuthology.orchestra.run.smithi008.stdout: "time": "2023-08-01T19:54:36.685248+0000", 2023-08-01T19:54:36.751 INFO:teuthology.orchestra.run.smithi008.stdout: "duration": 8.6626999999999996e-05 2023-08-01T19:54:36.751 INFO:teuthology.orchestra.run.smithi008.stdout: }, 2023-08-01T19:54:36.752 INFO:teuthology.orchestra.run.smithi008.stdout: { 2023-08-01T19:54:36.752 INFO:teuthology.orchestra.run.smithi008.stdout: "event": "started", 2023-08-01T19:54:36.752 INFO:teuthology.orchestra.run.smithi008.stdout: "time": "2023-08-01T19:54:36.685361+0000", 2023-08-01T19:54:36.752 INFO:teuthology.orchestra.run.smithi008.stdout: "duration": 0.000112711 2023-08-01T19:54:36.752 INFO:teuthology.orchestra.run.smithi008.stdout: }, 2023-08-01T19:54:36.752 INFO:teuthology.orchestra.run.smithi008.stdout: { 2023-08-01T19:54:36.752 INFO:teuthology.orchestra.run.smithi008.stdout: "event": "waiting for subops from 1", 2023-08-01T19:54:36.752 INFO:teuthology.orchestra.run.smithi008.stdout: "time": "2023-08-01T19:54:36.685494+0000", 2023-08-01T19:54:36.753 INFO:teuthology.orchestra.run.smithi008.stdout: "duration": 0.00013348799999999999 2023-08-01T19:54:36.753 INFO:teuthology.orchestra.run.smithi008.stdout: } 2023-08-01T19:54:36.753 INFO:teuthology.orchestra.run.smithi008.stdout: ] 2023-08-01T19:54:36.753 INFO:teuthology.orchestra.run.smithi008.stdout: } 2023-08-01T19:54:36.753 INFO:teuthology.orchestra.run.smithi008.stdout: }, 2023-08-01T19:54:36.753 INFO:teuthology.orchestra.run.smithi008.stdout: { 2023-08-01T19:54:36.753 INFO:teuthology.orchestra.run.smithi008.stdout: "description": "osd_op(client.4668.0:41201 5.a 5:5ea9a3b7:::benchmark_data_smithi006_114134_object41200:head [set-alloc-hint object_size 65536 write_size 65536,write 0~65536 in=65536b] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e25)", 2023-08-01T19:54:36.753 INFO:teuthology.orchestra.run.smithi008.stdout: "initiated_at": "2023-08-01T19:54:36.685172+0000", 2023-08-01T19:54:36.754 INFO:teuthology.orchestra.run.smithi008.stdout: "age": 0.002969508, 2023-08-01T19:54:36.754 INFO:teuthology.orchestra.run.smithi008.stdout: "duration": 0.003627992, 2023-08-01T19:54:36.754 INFO:teuthology.orchestra.run.smithi008.stdout: "type_data": { 2023-08-01T19:54:36.754 INFO:teuthology.orchestra.run.smithi008.stdout: "flag_point": "waiting for sub ops", 2023-08-01T19:54:36.754 INFO:teuthology.orchestra.run.smithi008.stdout: "client_info": { 2023-08-01T19:54:36.754 INFO:teuthology.orchestra.run.smithi008.stdout: "client": "client.4668", 2023-08-01T19:54:36.754 INFO:teuthology.orchestra.run.smithi008.stdout: "client_addr": "172.21.15.6:0/1709472247", 2023-08-01T19:54:36.754 INFO:teuthology.orchestra.run.smithi008.stdout: "tid": 41201 2023-08-01T19:54:36.755 INFO:teuthology.orchestra.run.smithi008.stdout: }, 2023-08-01T19:54:36.755 INFO:teuthology.orchestra.run.smithi008.stdout: "events": [ 2023-08-01T19:54:36.755 INFO:teuthology.orchestra.run.smithi008.stdout: { 2023-08-01T19:54:36.755 INFO:teuthology.orchestra.run.smithi008.stdout: "event": "initiated", 2023-08-01T19:54:36.755 INFO:teuthology.orchestra.run.smithi008.stdout: "time": "2023-08-01T19:54:36.685172+0000", 2023-08-01T19:54:36.755 INFO:teuthology.orchestra.run.smithi008.stdout: "duration": 0 2023-08-01T19:54:36.755 INFO:teuthology.orchestra.run.smithi008.stdout: }, 2023-08-01T19:54:36.756 INFO:teuthology.orchestra.run.smithi008.stdout: { 2023-08-01T19:54:36.756 INFO:teuthology.orchestra.run.smithi008.stdout: "event": "throttled", 2023-08-01T19:54:36.756 INFO:teuthology.orchestra.run.smithi008.stdout: "time": "2023-08-01T19:54:36.685172+0000", 2023-08-01T19:54:36.756 INFO:teuthology.orchestra.run.smithi008.stdout: "duration": 0 2023-08-01T19:54:36.756 INFO:teuthology.orchestra.run.smithi008.stdout: }, 2023-08-01T19:54:36.756 INFO:teuthology.orchestra.run.smithi008.stdout: { 2023-08-01T19:54:36.756 INFO:teuthology.orchestra.run.smithi008.stdout: "event": "header_read", 2023-08-01T19:54:36.756 INFO:teuthology.orchestra.run.smithi008.stdout: "time": "2023-08-01T19:54:36.685171+0000", 2023-08-01T19:54:36.757 INFO:teuthology.orchestra.run.smithi008.stdout: "duration": 4294967295.9999995 2023-08-01T19:54:36.757 INFO:teuthology.orchestra.run.smithi008.stdout: }, 2023-08-01T19:54:36.757 INFO:teuthology.orchestra.run.smithi008.stdout: { 2023-08-01T19:54:36.757 INFO:teuthology.orchestra.run.smithi008.stdout: "event": "all_read", 2023-08-01T19:54:36.757 INFO:teuthology.orchestra.run.smithi008.stdout: "time": "2023-08-01T19:54:36.685197+0000", 2023-08-01T19:54:36.757 INFO:teuthology.orchestra.run.smithi008.stdout: "duration": 2.6236000000000001e-05 2023-08-01T19:54:36.757 INFO:teuthology.orchestra.run.smithi008.stdout: }, 2023-08-01T19:54:36.757 INFO:teuthology.orchestra.run.smithi008.stdout: { 2023-08-01T19:54:36.758 INFO:teuthology.orchestra.run.smithi008.stdout: "event": "dispatched", 2023-08-01T19:54:36.758 INFO:teuthology.orchestra.run.smithi008.stdout: "time": "2023-08-01T19:54:36.685205+0000", 2023-08-01T19:54:36.758 INFO:teuthology.orchestra.run.smithi008.stdout: "duration": 7.7319999999999998e-06 2023-08-01T19:54:36.758 INFO:teuthology.orchestra.run.smithi008.stdout: }, 2023-08-01T19:54:36.758 INFO:teuthology.orchestra.run.smithi008.stdout: { 2023-08-01T19:54:36.758 INFO:teuthology.orchestra.run.smithi008.stdout: "event": "queued_for_pg", 2023-08-01T19:54:36.758 INFO:teuthology.orchestra.run.smithi008.stdout: "time": "2023-08-01T19:54:36.685211+0000", 2023-08-01T19:54:36.759 INFO:teuthology.orchestra.run.smithi008.stdout: "duration": 5.7189999999999998e-06 2023-08-01T19:54:36.759 INFO:teuthology.orchestra.run.smithi008.stdout: }, 2023-08-01T19:54:36.759 INFO:teuthology.orchestra.run.smithi008.stdout: { 2023-08-01T19:54:36.759 INFO:teuthology.orchestra.run.smithi008.stdout: "event": "reached_pg", 2023-08-01T19:54:36.759 INFO:teuthology.orchestra.run.smithi008.stdout: "time": "2023-08-01T19:54:36.686905+0000", 2023-08-01T19:54:36.759 INFO:teuthology.orchestra.run.smithi008.stdout: "duration": 0.001693824 2023-08-01T19:54:36.759 INFO:teuthology.orchestra.run.smithi008.stdout: }, 2023-08-01T19:54:36.759 INFO:teuthology.orchestra.run.smithi008.stdout: { 2023-08-01T19:54:36.760 INFO:teuthology.orchestra.run.smithi008.stdout: "event": "started", 2023-08-01T19:54:36.760 INFO:teuthology.orchestra.run.smithi008.stdout: "time": "2023-08-01T19:54:36.687026+0000", 2023-08-01T19:54:36.760 INFO:teuthology.orchestra.run.smithi008.stdout: "duration": 0.00012113899999999999 2023-08-01T19:54:36.760 INFO:teuthology.orchestra.run.smithi008.stdout: }, 2023-08-01T19:54:36.760 INFO:teuthology.orchestra.run.smithi008.stdout: { 2023-08-01T19:54:36.760 INFO:teuthology.orchestra.run.smithi008.stdout: "event": "waiting for subops from 2", 2023-08-01T19:54:36.760 INFO:teuthology.orchestra.run.smithi008.stdout: "time": "2023-08-01T19:54:36.687132+0000", 2023-08-01T19:54:36.761 INFO:teuthology.orchestra.run.smithi008.stdout: "duration": 0.000106337 2023-08-01T19:54:36.761 INFO:teuthology.orchestra.run.smithi008.stdout: } 2023-08-01T19:54:36.761 INFO:teuthology.orchestra.run.smithi008.stdout: ] 2023-08-01T19:54:36.761 INFO:teuthology.orchestra.run.smithi008.stdout: } 2023-08-01T19:54:36.761 INFO:teuthology.orchestra.run.smithi008.stdout: } 2023-08-01T19:54:36.761 INFO:teuthology.orchestra.run.smithi008.stdout: ], 2023-08-01T19:54:36.761 INFO:teuthology.orchestra.run.smithi008.stdout: "num_ops": 10 2023-08-01T19:54:36.762 INFO:teuthology.orchestra.run.smithi008.stdout:} 2023-08-01T19:54:36.763 DEBUG:teuthology.orchestra.run.smithi008:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 30 ceph --cluster ceph --admin-daemon /var/run/ceph/ceph-osd.0.asok dump_blocked_ops 2023-08-01T19:54:36.763 INFO:tasks.ceph.osd.0.smithi008.stderr:2023-08-01T19:54:36.762+0000 7f16a58f4700 -1 received signal: Hangup from /usr/bin/python3 /bin/daemon-helper kill ceph-osd -f --cluster ceph -i 0 (PID: 111179) UID: 0 2023-08-01T19:54:36.863 INFO:tasks.ceph.osd.2.smithi155.stderr:2023-08-01T19:54:36.861+0000 7faa5c6ac700 -1 received signal: Hangup from /usr/bin/python3 /bin/daemon-helper kill ceph-osd -f --cluster ceph -i 2 (PID: 111337) UID: 0 2023-08-01T19:54:36.963 INFO:tasks.ceph.osd.2.smithi155.stderr:2023-08-01T19:54:36.962+0000 7faa5c6ac700 -1 received signal: Hangup from /usr/bin/python3 /bin/daemon-helper kill ceph-osd -f --cluster ceph -i 2 (PID: 111337) UID: 0 2023-08-01T19:54:36.990 INFO:teuthology.orchestra.run.smithi008.stdout:{ 2023-08-01T19:54:36.990 INFO:teuthology.orchestra.run.smithi008.stdout: "ops": [], 2023-08-01T19:54:36.990 INFO:teuthology.orchestra.run.smithi008.stdout: "complaint_time": 30, 2023-08-01T19:54:36.990 INFO:teuthology.orchestra.run.smithi008.stdout: "num_blocked_ops": 0 2023-08-01T19:54:36.990 INFO:teuthology.orchestra.run.smithi008.stdout:} 2023-08-01T19:54:37.006 DEBUG:teuthology.orchestra.run.smithi008:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 30 ceph --cluster ceph --admin-daemon /var/run/ceph/ceph-osd.0.asok dump_historic_ops 2023-08-01T19:54:37.064 INFO:tasks.ceph.osd.0.smithi008.stderr:2023-08-01T19:54:37.063+0000 7f16a58f4700 -1 received signal: Hangup from /usr/bin/python3 /bin/daemon-helper kill ceph-osd -f --cluster ceph -i 0 (PID: 111179) UID: 0 2023-08-01T19:54:37.165 INFO:tasks.ceph.osd.2.smithi155.stderr:2023-08-01T19:54:37.163+0000 7faa5c6ac700 -1 received signal: Hangup from /usr/bin/python3 /bin/daemon-helper kill ceph-osd -f --cluster ceph -i 2 (PID: 111337) UID: 0 2023-08-01T19:54:37.179 INFO:teuthology.orchestra.run.smithi006.stderr:nodeep-scrub is set 2023-08-01T19:54:37.207 INFO:teuthology.orchestra.run.smithi008.stdout:{ 2023-08-01T19:54:37.207 INFO:teuthology.orchestra.run.smithi008.stdout: "size": 20, 2023-08-01T19:54:37.207 INFO:teuthology.orchestra.run.smithi008.stdout: "duration": 600, 2023-08-01T19:54:37.207 INFO:teuthology.orchestra.run.smithi008.stdout: "ops": [ 2023-08-01T19:54:37.207 INFO:teuthology.orchestra.run.smithi008.stdout: { 2023-08-01T19:54:37.207 INFO:teuthology.orchestra.run.smithi008.stdout: "description": "osd_op(mds.0.3:5 3.1f 3:ff5b34d6:::1.00000000:head [create,setxattr parent (30) in=6b,setxattr layout (30) in=6b] snapc 0=[] ondisk+write+known_if_redirected+full_force+supports_pool_eio e17)", 2023-08-01T19:54:37.208 INFO:teuthology.orchestra.run.smithi008.stdout: "initiated_at": "2023-08-01T19:54:04.459120+0000", 2023-08-01T19:54:37.208 INFO:teuthology.orchestra.run.smithi008.stdout: "age": 32.744356660999998, 2023-08-01T19:54:37.208 INFO:teuthology.orchestra.run.smithi008.stdout: "duration": 0.012982585, 2023-08-01T19:54:37.208 INFO:teuthology.orchestra.run.smithi008.stdout: "type_data": { 2023-08-01T19:54:37.208 INFO:teuthology.orchestra.run.smithi008.stdout: "flag_point": "commit sent; apply or cleanup", 2023-08-01T19:54:37.208 INFO:teuthology.orchestra.run.smithi008.stdout: "events": [ 2023-08-01T19:54:37.208 INFO:teuthology.orchestra.run.smithi008.stdout: { 2023-08-01T19:54:37.209 INFO:teuthology.orchestra.run.smithi008.stdout: "event": "initiated", 2023-08-01T19:54:37.209 INFO:teuthology.orchestra.run.smithi008.stdout: "time": "2023-08-01T19:54:04.459120+0000", 2023-08-01T19:54:37.209 INFO:teuthology.orchestra.run.smithi008.stdout: "duration": 0 2023-08-01T19:54:37.209 INFO:teuthology.orchestra.run.smithi008.stdout: }, 2023-08-01T19:54:37.209 INFO:teuthology.orchestra.run.smithi008.stdout: { 2023-08-01T19:54:37.209 INFO:teuthology.orchestra.run.smithi008.stdout: "event": "throttled", 2023-08-01T19:54:37.209 INFO:teuthology.orchestra.run.smithi008.stdout: "time": "2023-08-01T19:54:04.459120+0000", 2023-08-01T19:54:37.209 INFO:teuthology.orchestra.run.smithi008.stdout: "duration": 0 2023-08-01T19:54:37.210 INFO:teuthology.orchestra.run.smithi008.stdout: }, 2023-08-01T19:54:37.210 INFO:teuthology.orchestra.run.smithi008.stdout: { 2023-08-01T19:54:37.210 INFO:teuthology.orchestra.run.smithi008.stdout: "event": "header_read", 2023-08-01T19:54:37.210 INFO:teuthology.orchestra.run.smithi008.stdout: "time": "2023-08-01T19:54:04.459119+0000", 2023-08-01T19:54:37.210 INFO:teuthology.orchestra.run.smithi008.stdout: "duration": 4294967295.999999 2023-08-01T19:54:37.210 INFO:teuthology.orchestra.run.smithi008.stdout: }, 2023-08-01T19:54:37.210 INFO:teuthology.orchestra.run.smithi008.stdout: { 2023-08-01T19:54:37.210 INFO:teuthology.orchestra.run.smithi008.stdout: "event": "all_read", 2023-08-01T19:54:37.211 INFO:teuthology.orchestra.run.smithi008.stdout: "time": "2023-08-01T19:54:04.459137+0000", 2023-08-01T19:54:37.211 INFO:teuthology.orchestra.run.smithi008.stdout: "duration": 1.7554000000000002e-05 2023-08-01T19:54:37.211 INFO:teuthology.orchestra.run.smithi008.stdout: }, 2023-08-01T19:54:37.211 INFO:teuthology.orchestra.run.smithi008.stdout: { 2023-08-01T19:54:37.211 INFO:teuthology.orchestra.run.smithi008.stdout: "event": "dispatched", 2023-08-01T19:54:37.211 INFO:teuthology.orchestra.run.smithi008.stdout: "time": "2023-08-01T19:54:04.459148+0000", 2023-08-01T19:54:37.211 INFO:teuthology.orchestra.run.smithi008.stdout: "duration": 1.1248e-05 2023-08-01T19:54:37.212 INFO:teuthology.orchestra.run.smithi008.stdout: }, 2023-08-01T19:54:37.212 INFO:teuthology.orchestra.run.smithi008.stdout: { 2023-08-01T19:54:37.212 INFO:teuthology.orchestra.run.smithi008.stdout: "event": "queued_for_pg", 2023-08-01T19:54:37.212 INFO:teuthology.orchestra.run.smithi008.stdout: "time": "2023-08-01T19:54:04.459167+0000", 2023-08-01T19:54:37.212 INFO:teuthology.orchestra.run.smithi008.stdout: "duration": 1.9457999999999999e-05 2023-08-01T19:54:37.212 INFO:teuthology.orchestra.run.smithi008.stdout: }, 2023-08-01T19:54:37.212 INFO:teuthology.orchestra.run.smithi008.stdout: { 2023-08-01T19:54:37.212 INFO:teuthology.orchestra.run.smithi008.stdout: "event": "reached_pg", 2023-08-01T19:54:37.213 INFO:teuthology.orchestra.run.smithi008.stdout: "time": "2023-08-01T19:54:04.459863+0000", 2023-08-01T19:54:37.213 INFO:teuthology.orchestra.run.smithi008.stdout: "duration": 0.000695325 2023-08-01T19:54:37.213 INFO:teuthology.orchestra.run.smithi008.stdout: }, 2023-08-01T19:54:37.213 INFO:teuthology.orchestra.run.smithi008.stdout: { 2023-08-01T19:54:37.213 INFO:teuthology.orchestra.run.smithi008.stdout: "event": "waiting_for_map not empty", 2023-08-01T19:54:37.213 INFO:teuthology.orchestra.run.smithi008.stdout: "time": "2023-08-01T19:54:04.459866+0000", 2023-08-01T19:54:37.213 INFO:teuthology.orchestra.run.smithi008.stdout: "duration": 3.1540000000000002e-06 2023-08-01T19:54:37.213 INFO:teuthology.orchestra.run.smithi008.stdout: }, 2023-08-01T19:54:37.214 INFO:teuthology.orchestra.run.smithi008.stdout: { 2023-08-01T19:54:37.214 INFO:teuthology.orchestra.run.smithi008.stdout: "event": "reached_pg", 2023-08-01T19:54:37.214 INFO:teuthology.orchestra.run.smithi008.stdout: "time": "2023-08-01T19:54:04.462285+0000", 2023-08-01T19:54:37.214 INFO:teuthology.orchestra.run.smithi008.stdout: "duration": 0.0024190560000000002 2023-08-01T19:54:37.214 INFO:teuthology.orchestra.run.smithi008.stdout: }, 2023-08-01T19:54:37.214 INFO:teuthology.orchestra.run.smithi008.stdout: { 2023-08-01T19:54:37.214 INFO:teuthology.orchestra.run.smithi008.stdout: "event": "started", 2023-08-01T19:54:37.215 INFO:teuthology.orchestra.run.smithi008.stdout: "time": "2023-08-01T19:54:04.462365+0000", 2023-08-01T19:54:37.215 INFO:teuthology.orchestra.run.smithi008.stdout: "duration": 8.0488999999999995e-05 2023-08-01T19:54:37.215 INFO:teuthology.orchestra.run.smithi008.stdout: }, 2023-08-01T19:54:37.215 INFO:teuthology.orchestra.run.smithi008.stdout: { 2023-08-01T19:54:37.215 INFO:teuthology.orchestra.run.smithi008.stdout: "event": "waiting for subops from 1", 2023-08-01T19:54:37.215 INFO:teuthology.orchestra.run.smithi008.stdout: "time": "2023-08-01T19:54:04.462560+0000", 2023-08-01T19:54:37.215 INFO:teuthology.orchestra.run.smithi008.stdout: "duration": 0.00019412300000000001 2023-08-01T19:54:37.215 INFO:teuthology.orchestra.run.smithi008.stdout: }, 2023-08-01T19:54:37.216 INFO:teuthology.orchestra.run.smithi008.stdout: { 2023-08-01T19:54:37.216 INFO:teuthology.orchestra.run.smithi008.stdout: "event": "op_commit", 2023-08-01T19:54:37.216 INFO:teuthology.orchestra.run.smithi008.stdout: "time": "2023-08-01T19:54:04.467069+0000", 2023-08-01T19:54:37.216 INFO:teuthology.orchestra.run.smithi008.stdout: "duration": 0.0045089709999999996 2023-08-01T19:54:37.216 INFO:teuthology.orchestra.run.smithi008.stdout: }, 2023-08-01T19:54:37.216 INFO:teuthology.orchestra.run.smithi008.stdout: { 2023-08-01T19:54:37.216 INFO:teuthology.orchestra.run.smithi008.stdout: "event": "sub_op_commit_rec", 2023-08-01T19:54:37.216 INFO:teuthology.orchestra.run.smithi008.stdout: "time": "2023-08-01T19:54:04.471986+0000", 2023-08-01T19:54:37.217 INFO:teuthology.orchestra.run.smithi008.stdout: "duration": 0.0049178499999999997 2023-08-01T19:54:37.217 INFO:teuthology.orchestra.run.smithi008.stdout: }, 2023-08-01T19:54:37.217 INFO:teuthology.orchestra.run.smithi008.stdout: { 2023-08-01T19:54:37.217 INFO:teuthology.orchestra.run.smithi008.stdout: "event": "commit_sent", 2023-08-01T19:54:37.217 INFO:teuthology.orchestra.run.smithi008.stdout: "time": "2023-08-01T19:54:04.472060+0000", 2023-08-01T19:54:37.217 INFO:teuthology.orchestra.run.smithi008.stdout: "duration": 7.4049999999999997e-05 2023-08-01T19:54:37.217 INFO:teuthology.orchestra.run.smithi008.stdout: }, 2023-08-01T19:54:37.217 INFO:teuthology.orchestra.run.smithi008.stdout: { 2023-08-01T19:54:37.218 INFO:teuthology.orchestra.run.smithi008.stdout: "event": "done", 2023-08-01T19:54:37.218 INFO:teuthology.orchestra.run.smithi008.stdout: "time": "2023-08-01T19:54:04.472102+0000", 2023-08-01T19:54:37.218 INFO:teuthology.orchestra.run.smithi008.stdout: "duration": 4.206e-05 2023-08-01T19:54:37.218 INFO:teuthology.orchestra.run.smithi008.stdout: } 2023-08-01T19:54:37.218 INFO:teuthology.orchestra.run.smithi008.stdout: ] 2023-08-01T19:54:37.218 INFO:teuthology.orchestra.run.smithi008.stdout: } 2023-08-01T19:54:37.218 INFO:teuthology.orchestra.run.smithi008.stdout: }, 2023-08-01T19:54:37.218 INFO:teuthology.orchestra.run.smithi008.stdout: { 2023-08-01T19:54:37.219 INFO:teuthology.orchestra.run.smithi008.stdout: "description": "osd_op(mds.0.3:25 3.7 3:e0b41d06:::609.00000000:head [create,setxattr parent (62) in=6b,setxattr layout (30) in=6b] snapc 0=[] ondisk+write+known_if_redirected+full_force+supports_pool_eio e17)", 2023-08-01T19:54:37.219 INFO:teuthology.orchestra.run.smithi008.stdout: "initiated_at": "2023-08-01T19:54:04.459206+0000", 2023-08-01T19:54:37.219 INFO:teuthology.orchestra.run.smithi008.stdout: "age": 32.744270309999997, 2023-08-01T19:54:37.219 INFO:teuthology.orchestra.run.smithi008.stdout: "duration": 0.012197100000000001, 2023-08-01T19:54:37.219 INFO:teuthology.orchestra.run.smithi008.stdout: "type_data": { 2023-08-01T19:54:37.219 INFO:teuthology.orchestra.run.smithi008.stdout: "flag_point": "commit sent; apply or cleanup", 2023-08-01T19:54:37.219 INFO:teuthology.orchestra.run.smithi008.stdout: "events": [ 2023-08-01T19:54:37.219 INFO:teuthology.orchestra.run.smithi008.stdout: { 2023-08-01T19:54:37.220 INFO:teuthology.orchestra.run.smithi008.stdout: "event": "initiated", 2023-08-01T19:54:37.220 INFO:teuthology.orchestra.run.smithi008.stdout: "time": "2023-08-01T19:54:04.459206+0000", 2023-08-01T19:54:37.220 INFO:teuthology.orchestra.run.smithi008.stdout: "duration": 0 2023-08-01T19:54:37.220 INFO:teuthology.orchestra.run.smithi008.stdout: }, 2023-08-01T19:54:37.220 INFO:teuthology.orchestra.run.smithi008.stdout: { 2023-08-01T19:54:37.220 INFO:teuthology.orchestra.run.smithi008.stdout: "event": "throttled", 2023-08-01T19:54:37.220 INFO:teuthology.orchestra.run.smithi008.stdout: "time": "2023-08-01T19:54:04.459206+0000", 2023-08-01T19:54:37.221 INFO:teuthology.orchestra.run.smithi008.stdout: "duration": 0 2023-08-01T19:54:37.221 INFO:teuthology.orchestra.run.smithi008.stdout: }, 2023-08-01T19:54:37.221 INFO:teuthology.orchestra.run.smithi008.stdout: { 2023-08-01T19:54:37.221 INFO:teuthology.orchestra.run.smithi008.stdout: "event": "header_read", 2023-08-01T19:54:37.221 INFO:teuthology.orchestra.run.smithi008.stdout: "time": "2023-08-01T19:54:04.459206+0000", 2023-08-01T19:54:37.221 INFO:teuthology.orchestra.run.smithi008.stdout: "duration": 4294967295.9999995 2023-08-01T19:54:37.221 INFO:teuthology.orchestra.run.smithi008.stdout: }, 2023-08-01T19:54:37.221 INFO:teuthology.orchestra.run.smithi008.stdout: { 2023-08-01T19:54:37.222 INFO:teuthology.orchestra.run.smithi008.stdout: "event": "all_read", 2023-08-01T19:54:37.222 INFO:teuthology.orchestra.run.smithi008.stdout: "time": "2023-08-01T19:54:04.459209+0000", 2023-08-01T19:54:37.222 INFO:teuthology.orchestra.run.smithi008.stdout: "duration": 3.7500000000000001e-06 2023-08-01T19:54:37.222 INFO:teuthology.orchestra.run.smithi008.stdout: }, 2023-08-01T19:54:37.222 INFO:teuthology.orchestra.run.smithi008.stdout: { 2023-08-01T19:54:37.222 INFO:teuthology.orchestra.run.smithi008.stdout: "event": "dispatched", 2023-08-01T19:54:37.222 INFO:teuthology.orchestra.run.smithi008.stdout: "time": "2023-08-01T19:54:04.459216+0000", 2023-08-01T19:54:37.222 INFO:teuthology.orchestra.run.smithi008.stdout: "duration": 6.7560000000000002e-06 2023-08-01T19:54:37.223 INFO:teuthology.orchestra.run.smithi008.stdout: }, 2023-08-01T19:54:37.223 INFO:teuthology.orchestra.run.smithi008.stdout: { 2023-08-01T19:54:37.223 INFO:teuthology.orchestra.run.smithi008.stdout: "event": "queued_for_pg", 2023-08-01T19:54:37.223 INFO:teuthology.orchestra.run.smithi008.stdout: "time": "2023-08-01T19:54:04.459221+0000", 2023-08-01T19:54:37.223 INFO:teuthology.orchestra.run.smithi008.stdout: "duration": 5.1760000000000001e-06 2023-08-01T19:54:37.223 INFO:teuthology.orchestra.run.smithi008.stdout: }, 2023-08-01T19:54:37.223 INFO:teuthology.orchestra.run.smithi008.stdout: { 2023-08-01T19:54:37.223 INFO:teuthology.orchestra.run.smithi008.stdout: "event": "reached_pg", 2023-08-01T19:54:37.224 INFO:teuthology.orchestra.run.smithi008.stdout: "time": "2023-08-01T19:54:04.459918+0000", 2023-08-01T19:54:37.224 INFO:teuthology.orchestra.run.smithi008.stdout: "duration": 0.000696716 2023-08-01T19:54:37.224 INFO:teuthology.orchestra.run.smithi008.stdout: }, 2023-08-01T19:54:37.224 INFO:teuthology.orchestra.run.smithi008.stdout: { 2023-08-01T19:54:37.224 INFO:teuthology.orchestra.run.smithi008.stdout: "event": "waiting_for_map not empty", 2023-08-01T19:54:37.224 INFO:teuthology.orchestra.run.smithi008.stdout: "time": "2023-08-01T19:54:04.459923+0000", 2023-08-01T19:54:37.224 INFO:teuthology.orchestra.run.smithi008.stdout: "duration": 4.4279999999999998e-06 2023-08-01T19:54:37.225 INFO:teuthology.orchestra.run.smithi008.stdout: }, 2023-08-01T19:54:37.225 INFO:teuthology.orchestra.run.smithi008.stdout: { 2023-08-01T19:54:37.225 INFO:teuthology.orchestra.run.smithi008.stdout: "event": "reached_pg", 2023-08-01T19:54:37.225 INFO:teuthology.orchestra.run.smithi008.stdout: "time": "2023-08-01T19:54:04.462299+0000", 2023-08-01T19:54:37.225 INFO:teuthology.orchestra.run.smithi008.stdout: "duration": 0.0023762929999999998 2023-08-01T19:54:37.225 INFO:teuthology.orchestra.run.smithi008.stdout: }, 2023-08-01T19:54:37.225 INFO:teuthology.orchestra.run.smithi008.stdout: { 2023-08-01T19:54:37.225 INFO:teuthology.orchestra.run.smithi008.stdout: "event": "started", 2023-08-01T19:54:37.226 INFO:teuthology.orchestra.run.smithi008.stdout: "time": "2023-08-01T19:54:04.462362+0000", 2023-08-01T19:54:37.226 INFO:teuthology.orchestra.run.smithi008.stdout: "duration": 6.2707999999999997e-05 2023-08-01T19:54:37.226 INFO:teuthology.orchestra.run.smithi008.stdout: }, 2023-08-01T19:54:37.226 INFO:teuthology.orchestra.run.smithi008.stdout: { 2023-08-01T19:54:37.226 INFO:teuthology.orchestra.run.smithi008.stdout: "event": "waiting for subops from 2", 2023-08-01T19:54:37.226 INFO:teuthology.orchestra.run.smithi008.stdout: "time": "2023-08-01T19:54:04.462468+0000", 2023-08-01T19:54:37.226 INFO:teuthology.orchestra.run.smithi008.stdout: "duration": 0.000106592 2023-08-01T19:54:37.226 INFO:teuthology.orchestra.run.smithi008.stdout: }, 2023-08-01T19:54:37.227 INFO:teuthology.orchestra.run.smithi008.stdout: { 2023-08-01T19:54:37.227 INFO:teuthology.orchestra.run.smithi008.stdout: "event": "op_commit", 2023-08-01T19:54:37.227 INFO:teuthology.orchestra.run.smithi008.stdout: "time": "2023-08-01T19:54:04.466803+0000", 2023-08-01T19:54:37.227 INFO:teuthology.orchestra.run.smithi008.stdout: "duration": 0.0043350410000000004 2023-08-01T19:54:37.227 INFO:teuthology.orchestra.run.smithi008.stdout: }, 2023-08-01T19:54:37.227 INFO:teuthology.orchestra.run.smithi008.stdout: { 2023-08-01T19:54:37.227 INFO:teuthology.orchestra.run.smithi008.stdout: "event": "sub_op_commit_rec", 2023-08-01T19:54:37.228 INFO:teuthology.orchestra.run.smithi008.stdout: "time": "2023-08-01T19:54:04.471130+0000", 2023-08-01T19:54:37.228 INFO:teuthology.orchestra.run.smithi008.stdout: "duration": 0.0043265329999999996 2023-08-01T19:54:37.228 INFO:teuthology.orchestra.run.smithi008.stdout: }, 2023-08-01T19:54:37.228 INFO:teuthology.orchestra.run.smithi008.stdout: { 2023-08-01T19:54:37.228 INFO:teuthology.orchestra.run.smithi008.stdout: "event": "commit_sent", 2023-08-01T19:54:37.228 INFO:teuthology.orchestra.run.smithi008.stdout: "time": "2023-08-01T19:54:04.471355+0000", 2023-08-01T19:54:37.228 INFO:teuthology.orchestra.run.smithi008.stdout: "duration": 0.00022495999999999999 2023-08-01T19:54:37.228 INFO:teuthology.orchestra.run.smithi008.stdout: }, 2023-08-01T19:54:37.229 INFO:teuthology.orchestra.run.smithi008.stdout: { 2023-08-01T19:54:37.229 INFO:teuthology.orchestra.run.smithi008.stdout: "event": "done", 2023-08-01T19:54:37.229 INFO:teuthology.orchestra.run.smithi008.stdout: "time": "2023-08-01T19:54:04.471403+0000", 2023-08-01T19:54:37.229 INFO:teuthology.orchestra.run.smithi008.stdout: "duration": 4.8662999999999998e-05 2023-08-01T19:54:37.229 INFO:teuthology.orchestra.run.smithi008.stdout: } 2023-08-01T19:54:37.229 INFO:teuthology.orchestra.run.smithi008.stdout: ] 2023-08-01T19:54:37.229 INFO:teuthology.orchestra.run.smithi008.stdout: } 2023-08-01T19:54:37.229 INFO:teuthology.orchestra.run.smithi008.stdout: }, 2023-08-01T19:54:37.230 INFO:teuthology.orchestra.run.smithi008.stdout: { 2023-08-01T19:54:37.230 INFO:teuthology.orchestra.run.smithi008.stdout: "description": "osd_op(mds.0.3:26 3.1f 3:fe07bba1:::100.00000000.inode:head [writefull 0~554] snapc 0=[] ondisk+write+known_if_redirected+full_force+supports_pool_eio e17)", 2023-08-01T19:54:37.230 INFO:teuthology.orchestra.run.smithi008.stdout: "initiated_at": "2023-08-01T19:54:04.459230+0000", 2023-08-01T19:54:37.230 INFO:teuthology.orchestra.run.smithi008.stdout: "age": 32.744246793999999, 2023-08-01T19:54:37.230 INFO:teuthology.orchestra.run.smithi008.stdout: "duration": 0.013017103, 2023-08-01T19:54:37.230 INFO:teuthology.orchestra.run.smithi008.stdout: "type_data": { 2023-08-01T19:54:37.230 INFO:teuthology.orchestra.run.smithi008.stdout: "flag_point": "commit sent; apply or cleanup", 2023-08-01T19:54:37.231 INFO:teuthology.orchestra.run.smithi008.stdout: "events": [ 2023-08-01T19:54:37.231 INFO:teuthology.orchestra.run.smithi008.stdout: { 2023-08-01T19:54:37.231 INFO:teuthology.orchestra.run.smithi008.stdout: "event": "initiated", 2023-08-01T19:54:37.231 INFO:teuthology.orchestra.run.smithi008.stdout: "time": "2023-08-01T19:54:04.459230+0000", 2023-08-01T19:54:37.231 INFO:teuthology.orchestra.run.smithi008.stdout: "duration": 0 2023-08-01T19:54:37.231 INFO:teuthology.orchestra.run.smithi008.stdout: }, 2023-08-01T19:54:37.231 INFO:teuthology.orchestra.run.smithi008.stdout: { 2023-08-01T19:54:37.232 INFO:teuthology.orchestra.run.smithi008.stdout: "event": "throttled", 2023-08-01T19:54:37.232 INFO:teuthology.orchestra.run.smithi008.stdout: "time": "2023-08-01T19:54:04.459230+0000", 2023-08-01T19:54:37.232 INFO:teuthology.orchestra.run.smithi008.stdout: "duration": 0 2023-08-01T19:54:37.232 INFO:teuthology.orchestra.run.smithi008.stdout: }, 2023-08-01T19:54:37.232 INFO:teuthology.orchestra.run.smithi008.stdout: { 2023-08-01T19:54:37.232 INFO:teuthology.orchestra.run.smithi008.stdout: "event": "header_read", 2023-08-01T19:54:37.232 INFO:teuthology.orchestra.run.smithi008.stdout: "time": "2023-08-01T19:54:04.459229+0000", 2023-08-01T19:54:37.232 INFO:teuthology.orchestra.run.smithi008.stdout: "duration": 4294967295.9999995 2023-08-01T19:54:37.233 INFO:teuthology.orchestra.run.smithi008.stdout: }, 2023-08-01T19:54:37.233 INFO:teuthology.orchestra.run.smithi008.stdout: { 2023-08-01T19:54:37.233 INFO:teuthology.orchestra.run.smithi008.stdout: "event": "all_read", 2023-08-01T19:54:37.233 INFO:teuthology.orchestra.run.smithi008.stdout: "time": "2023-08-01T19:54:04.459233+0000", 2023-08-01T19:54:37.234 INFO:teuthology.orchestra.run.smithi008.stdout: "duration": 3.7400000000000002e-06 2023-08-01T19:54:37.234 INFO:teuthology.orchestra.run.smithi008.stdout: }, 2023-08-01T19:54:37.234 INFO:teuthology.orchestra.run.smithi008.stdout: { 2023-08-01T19:54:37.234 INFO:teuthology.orchestra.run.smithi008.stdout: "event": "dispatched", 2023-08-01T19:54:37.234 INFO:teuthology.orchestra.run.smithi008.stdout: "time": "2023-08-01T19:54:04.459240+0000", 2023-08-01T19:54:37.235 INFO:teuthology.orchestra.run.smithi008.stdout: "duration": 6.9059999999999996e-06 2023-08-01T19:54:37.235 INFO:teuthology.orchestra.run.smithi008.stdout: }, 2023-08-01T19:54:37.235 INFO:teuthology.orchestra.run.smithi008.stdout: { 2023-08-01T19:54:37.235 INFO:teuthology.orchestra.run.smithi008.stdout: "event": "queued_for_pg", 2023-08-01T19:54:37.235 INFO:teuthology.orchestra.run.smithi008.stdout: "time": "2023-08-01T19:54:04.459245+0000", 2023-08-01T19:54:37.235 INFO:teuthology.orchestra.run.smithi008.stdout: "duration": 4.8890000000000001e-06 2023-08-01T19:54:37.235 INFO:teuthology.orchestra.run.smithi008.stdout: }, 2023-08-01T19:54:37.235 INFO:teuthology.orchestra.run.smithi008.stdout: { 2023-08-01T19:54:37.236 INFO:teuthology.orchestra.run.smithi008.stdout: "event": "reached_pg", 2023-08-01T19:54:37.236 INFO:teuthology.orchestra.run.smithi008.stdout: "time": "2023-08-01T19:54:04.459954+0000", 2023-08-01T19:54:37.236 INFO:teuthology.orchestra.run.smithi008.stdout: "duration": 0.00070883100000000004 2023-08-01T19:54:37.236 INFO:teuthology.orchestra.run.smithi008.stdout: }, 2023-08-01T19:54:37.236 INFO:teuthology.orchestra.run.smithi008.stdout: { 2023-08-01T19:54:37.236 INFO:teuthology.orchestra.run.smithi008.stdout: "event": "waiting_for_map not empty", 2023-08-01T19:54:37.236 INFO:teuthology.orchestra.run.smithi008.stdout: "time": "2023-08-01T19:54:04.459959+0000", 2023-08-01T19:54:37.236 INFO:teuthology.orchestra.run.smithi008.stdout: "duration": 5.1340000000000003e-06 2023-08-01T19:54:37.237 INFO:teuthology.orchestra.run.smithi008.stdout: }, 2023-08-01T19:54:37.237 INFO:teuthology.orchestra.run.smithi008.stdout: { 2023-08-01T19:54:37.237 INFO:teuthology.orchestra.run.smithi008.stdout: "event": "reached_pg", 2023-08-01T19:54:37.237 INFO:teuthology.orchestra.run.smithi008.stdout: "time": "2023-08-01T19:54:04.462796+0000", 2023-08-01T19:54:37.237 INFO:teuthology.orchestra.run.smithi008.stdout: "duration": 0.0028374070000000001 2023-08-01T19:54:37.237 INFO:teuthology.orchestra.run.smithi008.stdout: }, 2023-08-01T19:54:37.237 INFO:teuthology.orchestra.run.smithi008.stdout: { 2023-08-01T19:54:37.237 INFO:teuthology.orchestra.run.smithi008.stdout: "event": "started", 2023-08-01T19:54:37.238 INFO:teuthology.orchestra.run.smithi008.stdout: "time": "2023-08-01T19:54:04.463137+0000", 2023-08-01T19:54:37.238 INFO:teuthology.orchestra.run.smithi008.stdout: "duration": 0.00034093699999999998 2023-08-01T19:54:37.238 INFO:teuthology.orchestra.run.smithi008.stdout: }, 2023-08-01T19:54:37.238 INFO:teuthology.orchestra.run.smithi008.stdout: { 2023-08-01T19:54:37.238 INFO:teuthology.orchestra.run.smithi008.stdout: "event": "waiting for subops from 1", 2023-08-01T19:54:37.238 INFO:teuthology.orchestra.run.smithi008.stdout: "time": "2023-08-01T19:54:04.463290+0000", 2023-08-01T19:54:37.238 INFO:teuthology.orchestra.run.smithi008.stdout: "duration": 0.00015267899999999999 2023-08-01T19:54:37.238 INFO:teuthology.orchestra.run.smithi008.stdout: }, 2023-08-01T19:54:37.239 INFO:teuthology.orchestra.run.smithi008.stdout: { 2023-08-01T19:54:37.239 INFO:teuthology.orchestra.run.smithi008.stdout: "event": "op_commit", 2023-08-01T19:54:37.239 INFO:teuthology.orchestra.run.smithi008.stdout: "time": "2023-08-01T19:54:04.470442+0000", 2023-08-01T19:54:37.239 INFO:teuthology.orchestra.run.smithi008.stdout: "duration": 0.0071526230000000003 2023-08-01T19:54:37.239 INFO:teuthology.orchestra.run.smithi008.stdout: }, 2023-08-01T19:54:37.239 INFO:teuthology.orchestra.run.smithi008.stdout: { 2023-08-01T19:54:37.239 INFO:teuthology.orchestra.run.smithi008.stdout: "event": "sub_op_commit_rec", 2023-08-01T19:54:37.240 INFO:teuthology.orchestra.run.smithi008.stdout: "time": "2023-08-01T19:54:04.472154+0000", 2023-08-01T19:54:37.240 INFO:teuthology.orchestra.run.smithi008.stdout: "duration": 0.0017111450000000001 2023-08-01T19:54:37.240 INFO:teuthology.orchestra.run.smithi008.stdout: }, 2023-08-01T19:54:37.240 INFO:teuthology.orchestra.run.smithi008.stdout: { 2023-08-01T19:54:37.240 INFO:teuthology.orchestra.run.smithi008.stdout: "event": "commit_sent", 2023-08-01T19:54:37.240 INFO:teuthology.orchestra.run.smithi008.stdout: "time": "2023-08-01T19:54:04.472207+0000", 2023-08-01T19:54:37.240 INFO:teuthology.orchestra.run.smithi008.stdout: "duration": 5.3059999999999997e-05 2023-08-01T19:54:37.240 INFO:teuthology.orchestra.run.smithi008.stdout: }, 2023-08-01T19:54:37.241 INFO:teuthology.orchestra.run.smithi008.stdout: { 2023-08-01T19:54:37.241 INFO:teuthology.orchestra.run.smithi008.stdout: "event": "done", 2023-08-01T19:54:37.241 INFO:teuthology.orchestra.run.smithi008.stdout: "time": "2023-08-01T19:54:04.472247+0000", 2023-08-01T19:54:37.241 INFO:teuthology.orchestra.run.smithi008.stdout: "duration": 4.0213999999999998e-05 2023-08-01T19:54:37.241 INFO:teuthology.orchestra.run.smithi008.stdout: } 2023-08-01T19:54:37.241 INFO:teuthology.orchestra.run.smithi008.stdout: ] 2023-08-01T19:54:37.241 INFO:teuthology.orchestra.run.smithi008.stdout: } 2023-08-01T19:54:37.241 INFO:teuthology.orchestra.run.smithi008.stdout: }, 2023-08-01T19:54:37.242 INFO:teuthology.orchestra.run.smithi008.stdout: { 2023-08-01T19:54:37.242 INFO:teuthology.orchestra.run.smithi008.stdout: "description": "osd_op(mds.0.3:28 3.b 3:d0630e4c:::mds0_sessionmap:head [omap-set-header] snapc 0=[] ondisk+write+known_if_redirected+full_force+supports_pool_eio e17)", 2023-08-01T19:54:37.242 INFO:teuthology.orchestra.run.smithi008.stdout: "initiated_at": "2023-08-01T19:54:04.459251+0000", 2023-08-01T19:54:37.242 INFO:teuthology.orchestra.run.smithi008.stdout: "age": 32.744225591000003, 2023-08-01T19:54:37.242 INFO:teuthology.orchestra.run.smithi008.stdout: "duration": 0.01361938, 2023-08-01T19:54:37.242 INFO:teuthology.orchestra.run.smithi008.stdout: "type_data": { 2023-08-01T19:54:37.242 INFO:teuthology.orchestra.run.smithi008.stdout: "flag_point": "commit sent; apply or cleanup", 2023-08-01T19:54:37.242 INFO:teuthology.orchestra.run.smithi008.stdout: "events": [ 2023-08-01T19:54:37.243 INFO:teuthology.orchestra.run.smithi008.stdout: { 2023-08-01T19:54:37.243 INFO:teuthology.orchestra.run.smithi008.stdout: "event": "initiated", 2023-08-01T19:54:37.243 INFO:teuthology.orchestra.run.smithi008.stdout: "time": "2023-08-01T19:54:04.459251+0000", 2023-08-01T19:54:37.243 INFO:teuthology.orchestra.run.smithi008.stdout: "duration": 0 2023-08-01T19:54:37.243 INFO:teuthology.orchestra.run.smithi008.stdout: }, 2023-08-01T19:54:37.243 INFO:teuthology.orchestra.run.smithi008.stdout: { 2023-08-01T19:54:37.243 INFO:teuthology.orchestra.run.smithi008.stdout: "event": "throttled", 2023-08-01T19:54:37.244 INFO:teuthology.orchestra.run.smithi008.stdout: "time": "2023-08-01T19:54:04.459251+0000", 2023-08-01T19:54:37.244 INFO:teuthology.orchestra.run.smithi008.stdout: "duration": 0 2023-08-01T19:54:37.244 INFO:teuthology.orchestra.run.smithi008.stdout: }, 2023-08-01T19:54:37.244 INFO:teuthology.orchestra.run.smithi008.stdout: { 2023-08-01T19:54:37.244 INFO:teuthology.orchestra.run.smithi008.stdout: "event": "header_read", 2023-08-01T19:54:37.244 INFO:teuthology.orchestra.run.smithi008.stdout: "time": "2023-08-01T19:54:04.459251+0000", 2023-08-01T19:54:37.244 INFO:teuthology.orchestra.run.smithi008.stdout: "duration": 4294967295.9999995 2023-08-01T19:54:37.244 INFO:teuthology.orchestra.run.smithi008.stdout: }, 2023-08-01T19:54:37.245 INFO:teuthology.orchestra.run.smithi008.stdout: { 2023-08-01T19:54:37.245 INFO:teuthology.orchestra.run.smithi008.stdout: "event": "all_read", 2023-08-01T19:54:37.245 INFO:teuthology.orchestra.run.smithi008.stdout: "time": "2023-08-01T19:54:04.459258+0000", 2023-08-01T19:54:37.245 INFO:teuthology.orchestra.run.smithi008.stdout: "duration": 7.0029999999999997e-06 2023-08-01T19:54:37.245 INFO:teuthology.orchestra.run.smithi008.stdout: }, 2023-08-01T19:54:37.245 INFO:teuthology.orchestra.run.smithi008.stdout: { 2023-08-01T19:54:37.245 INFO:teuthology.orchestra.run.smithi008.stdout: "event": "dispatched", 2023-08-01T19:54:37.245 INFO:teuthology.orchestra.run.smithi008.stdout: "time": "2023-08-01T19:54:04.459267+0000", 2023-08-01T19:54:37.246 INFO:teuthology.orchestra.run.smithi008.stdout: "duration": 8.8810000000000002e-06 2023-08-01T19:54:37.246 INFO:teuthology.orchestra.run.smithi008.stdout: }, 2023-08-01T19:54:37.246 INFO:teuthology.orchestra.run.smithi008.stdout: { 2023-08-01T19:54:37.246 INFO:teuthology.orchestra.run.smithi008.stdout: "event": "queued_for_pg", 2023-08-01T19:54:37.246 INFO:teuthology.orchestra.run.smithi008.stdout: "time": "2023-08-01T19:54:04.459273+0000", 2023-08-01T19:54:37.246 INFO:teuthology.orchestra.run.smithi008.stdout: "duration": 5.9279999999999998e-06 2023-08-01T19:54:37.246 INFO:teuthology.orchestra.run.smithi008.stdout: }, 2023-08-01T19:54:37.246 INFO:teuthology.orchestra.run.smithi008.stdout: { 2023-08-01T19:54:37.247 INFO:teuthology.orchestra.run.smithi008.stdout: "event": "reached_pg", 2023-08-01T19:54:37.247 INFO:teuthology.orchestra.run.smithi008.stdout: "time": "2023-08-01T19:54:04.460798+0000", 2023-08-01T19:54:37.247 INFO:teuthology.orchestra.run.smithi008.stdout: "duration": 0.001525039 2023-08-01T19:54:37.247 INFO:teuthology.orchestra.run.smithi008.stdout: }, 2023-08-01T19:54:37.247 INFO:teuthology.orchestra.run.smithi008.stdout: { 2023-08-01T19:54:37.247 INFO:teuthology.orchestra.run.smithi008.stdout: "event": "started", 2023-08-01T19:54:37.247 INFO:teuthology.orchestra.run.smithi008.stdout: "time": "2023-08-01T19:54:04.460951+0000", 2023-08-01T19:54:37.247 INFO:teuthology.orchestra.run.smithi008.stdout: "duration": 0.000153024 2023-08-01T19:54:37.248 INFO:teuthology.orchestra.run.smithi008.stdout: }, 2023-08-01T19:54:37.248 INFO:teuthology.orchestra.run.smithi008.stdout: { 2023-08-01T19:54:37.248 INFO:teuthology.orchestra.run.smithi008.stdout: "event": "waiting for subops from 1", 2023-08-01T19:54:37.248 INFO:teuthology.orchestra.run.smithi008.stdout: "time": "2023-08-01T19:54:04.461116+0000", 2023-08-01T19:54:37.248 INFO:teuthology.orchestra.run.smithi008.stdout: "duration": 0.00016551000000000001 2023-08-01T19:54:37.248 INFO:teuthology.orchestra.run.smithi008.stdout: }, 2023-08-01T19:54:37.248 INFO:teuthology.orchestra.run.smithi008.stdout: { 2023-08-01T19:54:37.249 INFO:teuthology.orchestra.run.smithi008.stdout: "event": "op_commit", 2023-08-01T19:54:37.249 INFO:teuthology.orchestra.run.smithi008.stdout: "time": "2023-08-01T19:54:04.463448+0000", 2023-08-01T19:54:37.249 INFO:teuthology.orchestra.run.smithi008.stdout: "duration": 0.0023321689999999998 2023-08-01T19:54:37.249 INFO:teuthology.orchestra.run.smithi008.stdout: }, 2023-08-01T19:54:37.249 INFO:teuthology.orchestra.run.smithi008.stdout: { 2023-08-01T19:54:37.249 INFO:teuthology.orchestra.run.smithi008.stdout: "event": "sub_op_commit_rec", 2023-08-01T19:54:37.249 INFO:teuthology.orchestra.run.smithi008.stdout: "time": "2023-08-01T19:54:04.472778+0000", 2023-08-01T19:54:37.249 INFO:teuthology.orchestra.run.smithi008.stdout: "duration": 0.0093293779999999993 2023-08-01T19:54:37.250 INFO:teuthology.orchestra.run.smithi008.stdout: }, 2023-08-01T19:54:37.250 INFO:teuthology.orchestra.run.smithi008.stdout: { 2023-08-01T19:54:37.250 INFO:teuthology.orchestra.run.smithi008.stdout: "event": "commit_sent", 2023-08-01T19:54:37.250 INFO:teuthology.orchestra.run.smithi008.stdout: "time": "2023-08-01T19:54:04.472821+0000", 2023-08-01T19:54:37.250 INFO:teuthology.orchestra.run.smithi008.stdout: "duration": 4.3253000000000001e-05 2023-08-01T19:54:37.250 INFO:teuthology.orchestra.run.smithi008.stdout: }, 2023-08-01T19:54:37.250 INFO:teuthology.orchestra.run.smithi008.stdout: { 2023-08-01T19:54:37.250 INFO:teuthology.orchestra.run.smithi008.stdout: "event": "done", 2023-08-01T19:54:37.251 INFO:teuthology.orchestra.run.smithi008.stdout: "time": "2023-08-01T19:54:04.472870+0000", 2023-08-01T19:54:37.251 INFO:teuthology.orchestra.run.smithi008.stdout: "duration": 4.9478999999999998e-05 2023-08-01T19:54:37.251 INFO:teuthology.orchestra.run.smithi008.stdout: } 2023-08-01T19:54:37.251 INFO:teuthology.orchestra.run.smithi008.stdout: ] 2023-08-01T19:54:37.251 INFO:teuthology.orchestra.run.smithi008.stdout: } 2023-08-01T19:54:37.251 INFO:teuthology.orchestra.run.smithi008.stdout: }, 2023-08-01T19:54:37.251 INFO:teuthology.orchestra.run.smithi008.stdout: { 2023-08-01T19:54:37.251 INFO:teuthology.orchestra.run.smithi008.stdout: "description": "osd_op(mds.0.3:34 3.b 3:d5c7a900:::200.00000003:head [delete] snapc 0=[] ondisk+write+known_if_redirected+full_force+supports_pool_eio e17)", 2023-08-01T19:54:37.252 INFO:teuthology.orchestra.run.smithi008.stdout: "initiated_at": "2023-08-01T19:54:04.459662+0000", 2023-08-01T19:54:37.252 INFO:teuthology.orchestra.run.smithi008.stdout: "age": 32.743814886999999, 2023-08-01T19:54:37.252 INFO:teuthology.orchestra.run.smithi008.stdout: "duration": 0.013345101999999999, 2023-08-01T19:54:37.252 INFO:teuthology.orchestra.run.smithi008.stdout: "type_data": { 2023-08-01T19:54:37.252 INFO:teuthology.orchestra.run.smithi008.stdout: "flag_point": "started", 2023-08-01T19:54:37.252 INFO:teuthology.orchestra.run.smithi008.stdout: "events": [ 2023-08-01T19:54:37.252 INFO:teuthology.orchestra.run.smithi008.stdout: { 2023-08-01T19:54:37.252 INFO:teuthology.orchestra.run.smithi008.stdout: "event": "initiated", 2023-08-01T19:54:37.253 INFO:teuthology.orchestra.run.smithi008.stdout: "time": "2023-08-01T19:54:04.459662+0000", 2023-08-01T19:54:37.253 INFO:teuthology.orchestra.run.smithi008.stdout: "duration": 0 2023-08-01T19:54:37.253 INFO:teuthology.orchestra.run.smithi008.stdout: }, 2023-08-01T19:54:37.253 INFO:teuthology.orchestra.run.smithi008.stdout: { 2023-08-01T19:54:37.253 INFO:teuthology.orchestra.run.smithi008.stdout: "event": "throttled", 2023-08-01T19:54:37.253 INFO:teuthology.orchestra.run.smithi008.stdout: "time": "2023-08-01T19:54:04.459662+0000", 2023-08-01T19:54:37.253 INFO:teuthology.orchestra.run.smithi008.stdout: "duration": 0 2023-08-01T19:54:37.253 INFO:teuthology.orchestra.run.smithi008.stdout: }, 2023-08-01T19:54:37.254 INFO:teuthology.orchestra.run.smithi008.stdout: { 2023-08-01T19:54:37.254 INFO:teuthology.orchestra.run.smithi008.stdout: "event": "header_read", 2023-08-01T19:54:37.254 INFO:teuthology.orchestra.run.smithi008.stdout: "time": "2023-08-01T19:54:04.459661+0000", 2023-08-01T19:54:37.254 INFO:teuthology.orchestra.run.smithi008.stdout: "duration": 4294967295.999999 2023-08-01T19:54:37.254 INFO:teuthology.orchestra.run.smithi008.stdout: }, 2023-08-01T19:54:37.254 INFO:teuthology.orchestra.run.smithi008.stdout: { 2023-08-01T19:54:37.254 INFO:teuthology.orchestra.run.smithi008.stdout: "event": "all_read", 2023-08-01T19:54:37.254 INFO:teuthology.orchestra.run.smithi008.stdout: "time": "2023-08-01T19:54:04.459668+0000", 2023-08-01T19:54:37.255 INFO:teuthology.orchestra.run.smithi008.stdout: "duration": 7.0219999999999999e-06 2023-08-01T19:54:37.255 INFO:teuthology.orchestra.run.smithi008.stdout: }, 2023-08-01T19:54:37.255 INFO:teuthology.orchestra.run.smithi008.stdout: { 2023-08-01T19:54:37.255 INFO:teuthology.orchestra.run.smithi008.stdout: "event": "dispatched", 2023-08-01T19:54:37.255 INFO:teuthology.orchestra.run.smithi008.stdout: "time": "2023-08-01T19:54:04.459681+0000", 2023-08-01T19:54:37.255 INFO:teuthology.orchestra.run.smithi008.stdout: "duration": 1.2999999999999999e-05 2023-08-01T19:54:37.255 INFO:teuthology.orchestra.run.smithi008.stdout: }, 2023-08-01T19:54:37.255 INFO:teuthology.orchestra.run.smithi008.stdout: { 2023-08-01T19:54:37.256 INFO:teuthology.orchestra.run.smithi008.stdout: "event": "queued_for_pg", 2023-08-01T19:54:37.256 INFO:teuthology.orchestra.run.smithi008.stdout: "time": "2023-08-01T19:54:04.459690+0000", 2023-08-01T19:54:37.256 INFO:teuthology.orchestra.run.smithi008.stdout: "duration": 9.2529999999999993e-06 2023-08-01T19:54:37.256 INFO:teuthology.orchestra.run.smithi008.stdout: }, 2023-08-01T19:54:37.256 INFO:teuthology.orchestra.run.smithi008.stdout: { 2023-08-01T19:54:37.256 INFO:teuthology.orchestra.run.smithi008.stdout: "event": "reached_pg", 2023-08-01T19:54:37.256 INFO:teuthology.orchestra.run.smithi008.stdout: "time": "2023-08-01T19:54:04.461862+0000", 2023-08-01T19:54:37.257 INFO:teuthology.orchestra.run.smithi008.stdout: "duration": 0.002172345 2023-08-01T19:54:37.257 INFO:teuthology.orchestra.run.smithi008.stdout: }, 2023-08-01T19:54:37.257 INFO:teuthology.orchestra.run.smithi008.stdout: { 2023-08-01T19:54:37.257 INFO:teuthology.orchestra.run.smithi008.stdout: "event": "started", 2023-08-01T19:54:37.257 INFO:teuthology.orchestra.run.smithi008.stdout: "time": "2023-08-01T19:54:04.462013+0000", 2023-08-01T19:54:37.257 INFO:teuthology.orchestra.run.smithi008.stdout: "duration": 0.00015044200000000001 2023-08-01T19:54:37.257 INFO:teuthology.orchestra.run.smithi008.stdout: }, 2023-08-01T19:54:37.257 INFO:teuthology.orchestra.run.smithi008.stdout: { 2023-08-01T19:54:37.258 INFO:teuthology.orchestra.run.smithi008.stdout: "event": "done", 2023-08-01T19:54:37.258 INFO:teuthology.orchestra.run.smithi008.stdout: "time": "2023-08-01T19:54:04.473007+0000", 2023-08-01T19:54:37.258 INFO:teuthology.orchestra.run.smithi008.stdout: "duration": 0.010994141000000001 2023-08-01T19:54:37.258 INFO:teuthology.orchestra.run.smithi008.stdout: } 2023-08-01T19:54:37.258 INFO:teuthology.orchestra.run.smithi008.stdout: ] 2023-08-01T19:54:37.258 INFO:teuthology.orchestra.run.smithi008.stdout: } 2023-08-01T19:54:37.258 INFO:teuthology.orchestra.run.smithi008.stdout: }, 2023-08-01T19:54:37.258 INFO:teuthology.orchestra.run.smithi008.stdout: { 2023-08-01T19:54:37.259 INFO:teuthology.orchestra.run.smithi008.stdout: "description": "osd_op(client.4668.0:17482 5.5 5:a43aa6fa:::benchmark_data_smithi006_114134_object17481:head [set-alloc-hint object_size 65536 write_size 65536,write 0~65536] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e23)", 2023-08-01T19:54:37.259 INFO:teuthology.orchestra.run.smithi008.stdout: "initiated_at": "2023-08-01T19:54:28.749880+0000", 2023-08-01T19:54:37.259 INFO:teuthology.orchestra.run.smithi008.stdout: "age": 8.4535970349999996, 2023-08-01T19:54:37.259 INFO:teuthology.orchestra.run.smithi008.stdout: "duration": 0.012550182999999999, 2023-08-01T19:54:37.259 INFO:teuthology.orchestra.run.smithi008.stdout: "type_data": { 2023-08-01T19:54:37.259 INFO:teuthology.orchestra.run.smithi008.stdout: "flag_point": "commit sent; apply or cleanup", 2023-08-01T19:54:37.259 INFO:teuthology.orchestra.run.smithi008.stdout: "client_info": { 2023-08-01T19:54:37.259 INFO:teuthology.orchestra.run.smithi008.stdout: "client": "client.4668", 2023-08-01T19:54:37.260 INFO:teuthology.orchestra.run.smithi008.stdout: "client_addr": "172.21.15.6:0/1709472247", 2023-08-01T19:54:37.260 INFO:teuthology.orchestra.run.smithi008.stdout: "tid": 17482 2023-08-01T19:54:37.260 INFO:teuthology.orchestra.run.smithi008.stdout: }, 2023-08-01T19:54:37.260 INFO:teuthology.orchestra.run.smithi008.stdout: "events": [ 2023-08-01T19:54:37.260 INFO:teuthology.orchestra.run.smithi008.stdout: { 2023-08-01T19:54:37.260 INFO:teuthology.orchestra.run.smithi008.stdout: "event": "initiated", 2023-08-01T19:54:37.260 INFO:teuthology.orchestra.run.smithi008.stdout: "time": "2023-08-01T19:54:28.749880+0000", 2023-08-01T19:54:37.260 INFO:teuthology.orchestra.run.smithi008.stdout: "duration": 0 2023-08-01T19:54:37.261 INFO:teuthology.orchestra.run.smithi008.stdout: }, 2023-08-01T19:54:37.261 INFO:teuthology.orchestra.run.smithi008.stdout: { 2023-08-01T19:54:37.261 INFO:teuthology.orchestra.run.smithi008.stdout: "event": "throttled", 2023-08-01T19:54:37.261 INFO:teuthology.orchestra.run.smithi008.stdout: "time": "2023-08-01T19:54:28.749880+0000", 2023-08-01T19:54:37.261 INFO:teuthology.orchestra.run.smithi008.stdout: "duration": 0 2023-08-01T19:54:37.261 INFO:teuthology.orchestra.run.smithi008.stdout: }, 2023-08-01T19:54:37.261 INFO:teuthology.orchestra.run.smithi008.stdout: { 2023-08-01T19:54:37.262 INFO:teuthology.orchestra.run.smithi008.stdout: "event": "header_read", 2023-08-01T19:54:37.262 INFO:teuthology.orchestra.run.smithi008.stdout: "time": "2023-08-01T19:54:28.749879+0000", 2023-08-01T19:54:37.262 INFO:teuthology.orchestra.run.smithi008.stdout: "duration": 4294967295.999999 2023-08-01T19:54:37.262 INFO:teuthology.orchestra.run.smithi008.stdout: }, 2023-08-01T19:54:37.262 INFO:teuthology.orchestra.run.smithi008.stdout: { 2023-08-01T19:54:37.262 INFO:teuthology.orchestra.run.smithi008.stdout: "event": "all_read", 2023-08-01T19:54:37.262 INFO:teuthology.orchestra.run.smithi008.stdout: "time": "2023-08-01T19:54:28.749962+0000", 2023-08-01T19:54:37.262 INFO:teuthology.orchestra.run.smithi008.stdout: "duration": 8.3164999999999994e-05 2023-08-01T19:54:37.263 INFO:teuthology.orchestra.run.smithi008.stdout: }, 2023-08-01T19:54:37.263 INFO:teuthology.orchestra.run.smithi008.stdout: { 2023-08-01T19:54:37.263 INFO:teuthology.orchestra.run.smithi008.stdout: "event": "dispatched", 2023-08-01T19:54:37.263 INFO:teuthology.orchestra.run.smithi008.stdout: "time": "2023-08-01T19:54:28.749972+0000", 2023-08-01T19:54:37.263 INFO:teuthology.orchestra.run.smithi008.stdout: "duration": 1.0324e-05 2023-08-01T19:54:37.263 INFO:teuthology.orchestra.run.smithi008.stdout: }, 2023-08-01T19:54:37.263 INFO:teuthology.orchestra.run.smithi008.stdout: { 2023-08-01T19:54:37.263 INFO:teuthology.orchestra.run.smithi008.stdout: "event": "queued_for_pg", 2023-08-01T19:54:37.264 INFO:teuthology.orchestra.run.smithi008.stdout: "time": "2023-08-01T19:54:28.749977+0000", 2023-08-01T19:54:37.264 INFO:teuthology.orchestra.run.smithi008.stdout: "duration": 4.8790000000000002e-06 2023-08-01T19:54:37.264 INFO:teuthology.orchestra.run.smithi008.stdout: }, 2023-08-01T19:54:37.264 INFO:teuthology.orchestra.run.smithi008.stdout: { 2023-08-01T19:54:37.264 INFO:teuthology.orchestra.run.smithi008.stdout: "event": "reached_pg", 2023-08-01T19:54:37.264 INFO:teuthology.orchestra.run.smithi008.stdout: "time": "2023-08-01T19:54:28.750016+0000", 2023-08-01T19:54:37.264 INFO:teuthology.orchestra.run.smithi008.stdout: "duration": 3.9045999999999999e-05 2023-08-01T19:54:37.264 INFO:teuthology.orchestra.run.smithi008.stdout: }, 2023-08-01T19:54:37.265 INFO:teuthology.orchestra.run.smithi008.stdout: { 2023-08-01T19:54:37.265 INFO:teuthology.orchestra.run.smithi008.stdout: "event": "started", 2023-08-01T19:54:37.265 INFO:teuthology.orchestra.run.smithi008.stdout: "time": "2023-08-01T19:54:28.750144+0000", 2023-08-01T19:54:37.265 INFO:teuthology.orchestra.run.smithi008.stdout: "duration": 0.00012822800000000001 2023-08-01T19:54:37.265 INFO:teuthology.orchestra.run.smithi008.stdout: }, 2023-08-01T19:54:37.265 INFO:teuthology.orchestra.run.smithi008.stdout: { 2023-08-01T19:54:37.265 INFO:teuthology.orchestra.run.smithi008.stdout: "event": "waiting for subops from 1", 2023-08-01T19:54:37.265 INFO:teuthology.orchestra.run.smithi008.stdout: "time": "2023-08-01T19:54:28.750274+0000", 2023-08-01T19:54:37.266 INFO:teuthology.orchestra.run.smithi008.stdout: "duration": 0.00013000199999999999 2023-08-01T19:54:37.266 INFO:teuthology.orchestra.run.smithi008.stdout: }, 2023-08-01T19:54:37.266 INFO:teuthology.orchestra.run.smithi008.stdout: { 2023-08-01T19:54:37.266 INFO:teuthology.orchestra.run.smithi008.stdout: "event": "op_commit", 2023-08-01T19:54:37.266 INFO:teuthology.orchestra.run.smithi008.stdout: "time": "2023-08-01T19:54:28.751923+0000", 2023-08-01T19:54:37.266 INFO:teuthology.orchestra.run.smithi008.stdout: "duration": 0.001648509 2023-08-01T19:54:37.266 INFO:teuthology.orchestra.run.smithi008.stdout: }, 2023-08-01T19:54:37.266 INFO:teuthology.orchestra.run.smithi008.stdout: { 2023-08-01T19:54:37.267 INFO:teuthology.orchestra.run.smithi008.stdout: "event": "sub_op_commit_rec", 2023-08-01T19:54:37.267 INFO:teuthology.orchestra.run.smithi008.stdout: "time": "2023-08-01T19:54:28.762336+0000", 2023-08-01T19:54:37.267 INFO:teuthology.orchestra.run.smithi008.stdout: "duration": 0.010413403 2023-08-01T19:54:37.267 INFO:teuthology.orchestra.run.smithi008.stdout: }, 2023-08-01T19:54:37.267 INFO:teuthology.orchestra.run.smithi008.stdout: { 2023-08-01T19:54:37.267 INFO:teuthology.orchestra.run.smithi008.stdout: "event": "commit_sent", 2023-08-01T19:54:37.267 INFO:teuthology.orchestra.run.smithi008.stdout: "time": "2023-08-01T19:54:28.762395+0000", 2023-08-01T19:54:37.268 INFO:teuthology.orchestra.run.smithi008.stdout: "duration": 5.9064000000000002e-05 2023-08-01T19:54:37.268 INFO:teuthology.orchestra.run.smithi008.stdout: }, 2023-08-01T19:54:37.268 INFO:teuthology.orchestra.run.smithi008.stdout: { 2023-08-01T19:54:37.268 INFO:teuthology.orchestra.run.smithi008.stdout: "event": "done", 2023-08-01T19:54:37.268 INFO:teuthology.orchestra.run.smithi008.stdout: "time": "2023-08-01T19:54:28.762430+0000", 2023-08-01T19:54:37.268 INFO:teuthology.orchestra.run.smithi008.stdout: "duration": 3.4403000000000002e-05 2023-08-01T19:54:37.268 INFO:teuthology.orchestra.run.smithi008.stdout: } 2023-08-01T19:54:37.268 INFO:teuthology.orchestra.run.smithi008.stdout: ] 2023-08-01T19:54:37.269 INFO:teuthology.orchestra.run.smithi008.stdout: } 2023-08-01T19:54:37.269 INFO:teuthology.orchestra.run.smithi008.stdout: }, 2023-08-01T19:54:37.269 INFO:teuthology.orchestra.run.smithi008.stdout: { 2023-08-01T19:54:37.269 INFO:teuthology.orchestra.run.smithi008.stdout: "description": "osd_op(client.4668.0:18360 5.6 5:65d8e237:::benchmark_data_smithi006_114134_object18359:head [set-alloc-hint object_size 65536 write_size 65536,write 0~65536] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e23)", 2023-08-01T19:54:37.269 INFO:teuthology.orchestra.run.smithi008.stdout: "initiated_at": "2023-08-01T19:54:28.994296+0000", 2023-08-01T19:54:37.269 INFO:teuthology.orchestra.run.smithi008.stdout: "age": 8.2091806540000007, 2023-08-01T19:54:37.269 INFO:teuthology.orchestra.run.smithi008.stdout: "duration": 0.017459669000000001, 2023-08-01T19:54:37.269 INFO:teuthology.orchestra.run.smithi008.stdout: "type_data": { 2023-08-01T19:54:37.270 INFO:teuthology.orchestra.run.smithi008.stdout: "flag_point": "commit sent; apply or cleanup", 2023-08-01T19:54:37.270 INFO:teuthology.orchestra.run.smithi008.stdout: "client_info": { 2023-08-01T19:54:37.270 INFO:teuthology.orchestra.run.smithi008.stdout: "client": "client.4668", 2023-08-01T19:54:37.270 INFO:teuthology.orchestra.run.smithi008.stdout: "client_addr": "172.21.15.6:0/1709472247", 2023-08-01T19:54:37.270 INFO:teuthology.orchestra.run.smithi008.stdout: "tid": 18360 2023-08-01T19:54:37.270 INFO:teuthology.orchestra.run.smithi008.stdout: }, 2023-08-01T19:54:37.270 INFO:teuthology.orchestra.run.smithi008.stdout: "events": [ 2023-08-01T19:54:37.270 INFO:teuthology.orchestra.run.smithi008.stdout: { 2023-08-01T19:54:37.271 INFO:teuthology.orchestra.run.smithi008.stdout: "event": "initiated", 2023-08-01T19:54:37.271 INFO:teuthology.orchestra.run.smithi008.stdout: "time": "2023-08-01T19:54:28.994296+0000", 2023-08-01T19:54:37.271 INFO:teuthology.orchestra.run.smithi008.stdout: "duration": 0 2023-08-01T19:54:37.271 INFO:teuthology.orchestra.run.smithi008.stdout: }, 2023-08-01T19:54:37.271 INFO:teuthology.orchestra.run.smithi008.stdout: { 2023-08-01T19:54:37.271 INFO:teuthology.orchestra.run.smithi008.stdout: "event": "throttled", 2023-08-01T19:54:37.271 INFO:teuthology.orchestra.run.smithi008.stdout: "time": "2023-08-01T19:54:28.994296+0000", 2023-08-01T19:54:37.271 INFO:teuthology.orchestra.run.smithi008.stdout: "duration": 0 2023-08-01T19:54:37.272 INFO:teuthology.orchestra.run.smithi008.stdout: }, 2023-08-01T19:54:37.272 INFO:teuthology.orchestra.run.smithi008.stdout: { 2023-08-01T19:54:37.272 INFO:teuthology.orchestra.run.smithi008.stdout: "event": "header_read", 2023-08-01T19:54:37.272 INFO:teuthology.orchestra.run.smithi008.stdout: "time": "2023-08-01T19:54:28.994295+0000", 2023-08-01T19:54:37.272 INFO:teuthology.orchestra.run.smithi008.stdout: "duration": 4294967295.9999995 2023-08-01T19:54:37.272 INFO:teuthology.orchestra.run.smithi008.stdout: }, 2023-08-01T19:54:37.272 INFO:teuthology.orchestra.run.smithi008.stdout: { 2023-08-01T19:54:37.272 INFO:teuthology.orchestra.run.smithi008.stdout: "event": "all_read", 2023-08-01T19:54:37.273 INFO:teuthology.orchestra.run.smithi008.stdout: "time": "2023-08-01T19:54:28.994381+0000", 2023-08-01T19:54:37.273 INFO:teuthology.orchestra.run.smithi008.stdout: "duration": 8.6055000000000002e-05 2023-08-01T19:54:37.273 INFO:teuthology.orchestra.run.smithi008.stdout: }, 2023-08-01T19:54:37.273 INFO:teuthology.orchestra.run.smithi008.stdout: { 2023-08-01T19:54:37.273 INFO:teuthology.orchestra.run.smithi008.stdout: "event": "dispatched", 2023-08-01T19:54:37.273 INFO:teuthology.orchestra.run.smithi008.stdout: "time": "2023-08-01T19:54:28.994390+0000", 2023-08-01T19:54:37.273 INFO:teuthology.orchestra.run.smithi008.stdout: "duration": 8.7530000000000007e-06 2023-08-01T19:54:37.273 INFO:teuthology.orchestra.run.smithi008.stdout: }, 2023-08-01T19:54:37.274 INFO:teuthology.orchestra.run.smithi008.stdout: { 2023-08-01T19:54:37.274 INFO:teuthology.orchestra.run.smithi008.stdout: "event": "queued_for_pg", 2023-08-01T19:54:37.274 INFO:teuthology.orchestra.run.smithi008.stdout: "time": "2023-08-01T19:54:28.994394+0000", 2023-08-01T19:54:37.274 INFO:teuthology.orchestra.run.smithi008.stdout: "duration": 3.4929999999999998e-06 2023-08-01T19:54:37.274 INFO:teuthology.orchestra.run.smithi008.stdout: }, 2023-08-01T19:54:37.274 INFO:teuthology.orchestra.run.smithi008.stdout: { 2023-08-01T19:54:37.274 INFO:teuthology.orchestra.run.smithi008.stdout: "event": "reached_pg", 2023-08-01T19:54:37.275 INFO:teuthology.orchestra.run.smithi008.stdout: "time": "2023-08-01T19:54:28.995799+0000", 2023-08-01T19:54:37.275 INFO:teuthology.orchestra.run.smithi008.stdout: "duration": 0.001405779 2023-08-01T19:54:37.275 INFO:teuthology.orchestra.run.smithi008.stdout: }, 2023-08-01T19:54:37.275 INFO:teuthology.orchestra.run.smithi008.stdout: { 2023-08-01T19:54:37.275 INFO:teuthology.orchestra.run.smithi008.stdout: "event": "started", 2023-08-01T19:54:37.275 INFO:teuthology.orchestra.run.smithi008.stdout: "time": "2023-08-01T19:54:28.995896+0000", 2023-08-01T19:54:37.275 INFO:teuthology.orchestra.run.smithi008.stdout: "duration": 9.6597999999999999e-05 2023-08-01T19:54:37.275 INFO:teuthology.orchestra.run.smithi008.stdout: }, 2023-08-01T19:54:37.276 INFO:teuthology.orchestra.run.smithi008.stdout: { 2023-08-01T19:54:37.276 INFO:teuthology.orchestra.run.smithi008.stdout: "event": "waiting for subops from 1", 2023-08-01T19:54:37.276 INFO:teuthology.orchestra.run.smithi008.stdout: "time": "2023-08-01T19:54:28.995985+0000", 2023-08-01T19:54:37.276 INFO:teuthology.orchestra.run.smithi008.stdout: "duration": 8.8479000000000004e-05 2023-08-01T19:54:37.276 INFO:teuthology.orchestra.run.smithi008.stdout: }, 2023-08-01T19:54:37.276 INFO:teuthology.orchestra.run.smithi008.stdout: { 2023-08-01T19:54:37.276 INFO:teuthology.orchestra.run.smithi008.stdout: "event": "op_commit", 2023-08-01T19:54:37.276 INFO:teuthology.orchestra.run.smithi008.stdout: "time": "2023-08-01T19:54:28.997700+0000", 2023-08-01T19:54:37.277 INFO:teuthology.orchestra.run.smithi008.stdout: "duration": 0.001714997 2023-08-01T19:54:37.277 INFO:teuthology.orchestra.run.smithi008.stdout: }, 2023-08-01T19:54:37.277 INFO:teuthology.orchestra.run.smithi008.stdout: { 2023-08-01T19:54:37.277 INFO:teuthology.orchestra.run.smithi008.stdout: "event": "sub_op_commit_rec", 2023-08-01T19:54:37.277 INFO:teuthology.orchestra.run.smithi008.stdout: "time": "2023-08-01T19:54:29.011671+0000", 2023-08-01T19:54:37.277 INFO:teuthology.orchestra.run.smithi008.stdout: "duration": 0.0139712 2023-08-01T19:54:37.277 INFO:teuthology.orchestra.run.smithi008.stdout: }, 2023-08-01T19:54:37.277 INFO:teuthology.orchestra.run.smithi008.stdout: { 2023-08-01T19:54:37.278 INFO:teuthology.orchestra.run.smithi008.stdout: "event": "commit_sent", 2023-08-01T19:54:37.278 INFO:teuthology.orchestra.run.smithi008.stdout: "time": "2023-08-01T19:54:29.011719+0000", 2023-08-01T19:54:37.278 INFO:teuthology.orchestra.run.smithi008.stdout: "duration": 4.8025000000000002e-05 2023-08-01T19:54:37.278 INFO:teuthology.orchestra.run.smithi008.stdout: }, 2023-08-01T19:54:37.278 INFO:teuthology.orchestra.run.smithi008.stdout: { 2023-08-01T19:54:37.278 INFO:teuthology.orchestra.run.smithi008.stdout: "event": "done", 2023-08-01T19:54:37.278 INFO:teuthology.orchestra.run.smithi008.stdout: "time": "2023-08-01T19:54:29.011756+0000", 2023-08-01T19:54:37.279 INFO:teuthology.orchestra.run.smithi008.stdout: "duration": 3.6825000000000001e-05 2023-08-01T19:54:37.279 INFO:teuthology.orchestra.run.smithi008.stdout: } 2023-08-01T19:54:37.279 INFO:teuthology.orchestra.run.smithi008.stdout: ] 2023-08-01T19:54:37.279 INFO:teuthology.orchestra.run.smithi008.stdout: } 2023-08-01T19:54:37.279 INFO:teuthology.orchestra.run.smithi008.stdout: }, 2023-08-01T19:54:37.279 INFO:teuthology.orchestra.run.smithi008.stdout: { 2023-08-01T19:54:37.279 INFO:teuthology.orchestra.run.smithi008.stdout: "description": "osd_op(client.4668.0:18361 5.6 5:65a8a093:::benchmark_data_smithi006_114134_object18360:head [set-alloc-hint object_size 65536 write_size 65536,write 0~65536] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e23)", 2023-08-01T19:54:37.279 INFO:teuthology.orchestra.run.smithi008.stdout: "initiated_at": "2023-08-01T19:54:28.994398+0000", 2023-08-01T19:54:37.280 INFO:teuthology.orchestra.run.smithi008.stdout: "age": 8.2090787949999999, 2023-08-01T19:54:37.280 INFO:teuthology.orchestra.run.smithi008.stdout: "duration": 0.017435484000000001, 2023-08-01T19:54:37.280 INFO:teuthology.orchestra.run.smithi008.stdout: "type_data": { 2023-08-01T19:54:37.280 INFO:teuthology.orchestra.run.smithi008.stdout: "flag_point": "commit sent; apply or cleanup", 2023-08-01T19:54:37.280 INFO:teuthology.orchestra.run.smithi008.stdout: "client_info": { 2023-08-01T19:54:37.280 INFO:teuthology.orchestra.run.smithi008.stdout: "client": "client.4668", 2023-08-01T19:54:37.280 INFO:teuthology.orchestra.run.smithi008.stdout: "client_addr": "172.21.15.6:0/1709472247", 2023-08-01T19:54:37.280 INFO:teuthology.orchestra.run.smithi008.stdout: "tid": 18361 2023-08-01T19:54:37.281 INFO:teuthology.orchestra.run.smithi008.stdout: }, 2023-08-01T19:54:37.281 INFO:teuthology.orchestra.run.smithi008.stdout: "events": [ 2023-08-01T19:54:37.281 INFO:teuthology.orchestra.run.smithi008.stdout: { 2023-08-01T19:54:37.281 INFO:teuthology.orchestra.run.smithi008.stdout: "event": "initiated", 2023-08-01T19:54:37.281 INFO:teuthology.orchestra.run.smithi008.stdout: "time": "2023-08-01T19:54:28.994398+0000", 2023-08-01T19:54:37.281 INFO:teuthology.orchestra.run.smithi008.stdout: "duration": 0 2023-08-01T19:54:37.281 INFO:teuthology.orchestra.run.smithi008.stdout: }, 2023-08-01T19:54:37.281 INFO:teuthology.orchestra.run.smithi008.stdout: { 2023-08-01T19:54:37.282 INFO:teuthology.orchestra.run.smithi008.stdout: "event": "throttled", 2023-08-01T19:54:37.282 INFO:teuthology.orchestra.run.smithi008.stdout: "time": "2023-08-01T19:54:28.994398+0000", 2023-08-01T19:54:37.282 INFO:teuthology.orchestra.run.smithi008.stdout: "duration": 0 2023-08-01T19:54:37.282 INFO:teuthology.orchestra.run.smithi008.stdout: }, 2023-08-01T19:54:37.282 INFO:teuthology.orchestra.run.smithi008.stdout: { 2023-08-01T19:54:37.282 INFO:teuthology.orchestra.run.smithi008.stdout: "event": "header_read", 2023-08-01T19:54:37.282 INFO:teuthology.orchestra.run.smithi008.stdout: "time": "2023-08-01T19:54:28.994397+0000", 2023-08-01T19:54:37.282 INFO:teuthology.orchestra.run.smithi008.stdout: "duration": 4294967295.9999995 2023-08-01T19:54:37.283 INFO:teuthology.orchestra.run.smithi008.stdout: }, 2023-08-01T19:54:37.283 INFO:teuthology.orchestra.run.smithi008.stdout: { 2023-08-01T19:54:37.283 INFO:teuthology.orchestra.run.smithi008.stdout: "event": "all_read", 2023-08-01T19:54:37.283 INFO:teuthology.orchestra.run.smithi008.stdout: "time": "2023-08-01T19:54:28.994475+0000", 2023-08-01T19:54:37.283 INFO:teuthology.orchestra.run.smithi008.stdout: "duration": 7.7408000000000002e-05 2023-08-01T19:54:37.283 INFO:teuthology.orchestra.run.smithi008.stdout: }, 2023-08-01T19:54:37.283 INFO:teuthology.orchestra.run.smithi008.stdout: { 2023-08-01T19:54:37.283 INFO:teuthology.orchestra.run.smithi008.stdout: "event": "dispatched", 2023-08-01T19:54:37.284 INFO:teuthology.orchestra.run.smithi008.stdout: "time": "2023-08-01T19:54:28.994480+0000", 2023-08-01T19:54:37.284 INFO:teuthology.orchestra.run.smithi008.stdout: "duration": 5.3589999999999999e-06 2023-08-01T19:54:37.284 INFO:teuthology.orchestra.run.smithi008.stdout: }, 2023-08-01T19:54:37.284 INFO:teuthology.orchestra.run.smithi008.stdout: { 2023-08-01T19:54:37.284 INFO:teuthology.orchestra.run.smithi008.stdout: "event": "queued_for_pg", 2023-08-01T19:54:37.284 INFO:teuthology.orchestra.run.smithi008.stdout: "time": "2023-08-01T19:54:28.994484+0000", 2023-08-01T19:54:37.284 INFO:teuthology.orchestra.run.smithi008.stdout: "duration": 3.9750000000000001e-06 2023-08-01T19:54:37.285 INFO:teuthology.orchestra.run.smithi008.stdout: }, 2023-08-01T19:54:37.285 INFO:teuthology.orchestra.run.smithi008.stdout: { 2023-08-01T19:54:37.285 INFO:teuthology.orchestra.run.smithi008.stdout: "event": "reached_pg", 2023-08-01T19:54:37.285 INFO:teuthology.orchestra.run.smithi008.stdout: "time": "2023-08-01T19:54:28.996504+0000", 2023-08-01T19:54:37.285 INFO:teuthology.orchestra.run.smithi008.stdout: "duration": 0.0020198550000000001 2023-08-01T19:54:37.285 INFO:teuthology.orchestra.run.smithi008.stdout: }, 2023-08-01T19:54:37.285 INFO:teuthology.orchestra.run.smithi008.stdout: { 2023-08-01T19:54:37.285 INFO:teuthology.orchestra.run.smithi008.stdout: "event": "started", 2023-08-01T19:54:37.286 INFO:teuthology.orchestra.run.smithi008.stdout: "time": "2023-08-01T19:54:28.996624+0000", 2023-08-01T19:54:37.286 INFO:teuthology.orchestra.run.smithi008.stdout: "duration": 0.000120118 2023-08-01T19:54:37.286 INFO:teuthology.orchestra.run.smithi008.stdout: }, 2023-08-01T19:54:37.286 INFO:teuthology.orchestra.run.smithi008.stdout: { 2023-08-01T19:54:37.286 INFO:teuthology.orchestra.run.smithi008.stdout: "event": "waiting for subops from 1", 2023-08-01T19:54:37.286 INFO:teuthology.orchestra.run.smithi008.stdout: "time": "2023-08-01T19:54:28.996790+0000", 2023-08-01T19:54:37.286 INFO:teuthology.orchestra.run.smithi008.stdout: "duration": 0.000165398 2023-08-01T19:54:37.286 INFO:teuthology.orchestra.run.smithi008.stdout: }, 2023-08-01T19:54:37.287 INFO:teuthology.orchestra.run.smithi008.stdout: { 2023-08-01T19:54:37.287 INFO:teuthology.orchestra.run.smithi008.stdout: "event": "op_commit", 2023-08-01T19:54:37.287 INFO:teuthology.orchestra.run.smithi008.stdout: "time": "2023-08-01T19:54:28.999061+0000", 2023-08-01T19:54:37.287 INFO:teuthology.orchestra.run.smithi008.stdout: "duration": 0.0022714800000000002 2023-08-01T19:54:37.287 INFO:teuthology.orchestra.run.smithi008.stdout: }, 2023-08-01T19:54:37.287 INFO:teuthology.orchestra.run.smithi008.stdout: { 2023-08-01T19:54:37.287 INFO:teuthology.orchestra.run.smithi008.stdout: "event": "sub_op_commit_rec", 2023-08-01T19:54:37.287 INFO:teuthology.orchestra.run.smithi008.stdout: "time": "2023-08-01T19:54:29.011788+0000", 2023-08-01T19:54:37.288 INFO:teuthology.orchestra.run.smithi008.stdout: "duration": 0.012726774999999999 2023-08-01T19:54:37.288 INFO:teuthology.orchestra.run.smithi008.stdout: }, 2023-08-01T19:54:37.288 INFO:teuthology.orchestra.run.smithi008.stdout: { 2023-08-01T19:54:37.288 INFO:teuthology.orchestra.run.smithi008.stdout: "event": "commit_sent", 2023-08-01T19:54:37.288 INFO:teuthology.orchestra.run.smithi008.stdout: "time": "2023-08-01T19:54:29.011815+0000", 2023-08-01T19:54:37.288 INFO:teuthology.orchestra.run.smithi008.stdout: "duration": 2.7032000000000001e-05 2023-08-01T19:54:37.288 INFO:teuthology.orchestra.run.smithi008.stdout: }, 2023-08-01T19:54:37.289 INFO:teuthology.orchestra.run.smithi008.stdout: { 2023-08-01T19:54:37.289 INFO:teuthology.orchestra.run.smithi008.stdout: "event": "done", 2023-08-01T19:54:37.289 INFO:teuthology.orchestra.run.smithi008.stdout: "time": "2023-08-01T19:54:29.011833+0000", 2023-08-01T19:54:37.289 INFO:teuthology.orchestra.run.smithi008.stdout: "duration": 1.8437e-05 2023-08-01T19:54:37.289 INFO:teuthology.orchestra.run.smithi008.stdout: } 2023-08-01T19:54:37.289 INFO:teuthology.orchestra.run.smithi008.stdout: ] 2023-08-01T19:54:37.289 INFO:teuthology.orchestra.run.smithi008.stdout: } 2023-08-01T19:54:37.290 INFO:teuthology.orchestra.run.smithi008.stdout: }, 2023-08-01T19:54:37.290 INFO:teuthology.orchestra.run.smithi008.stdout: { 2023-08-01T19:54:37.290 INFO:teuthology.orchestra.run.smithi008.stdout: "description": "osd_op(client.4668.0:18363 5.5 5:ab48299e:::benchmark_data_smithi006_114134_object18362:head [set-alloc-hint object_size 65536 write_size 65536,write 0~65536] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e23)", 2023-08-01T19:54:37.290 INFO:teuthology.orchestra.run.smithi008.stdout: "initiated_at": "2023-08-01T19:54:28.996467+0000", 2023-08-01T19:54:37.290 INFO:teuthology.orchestra.run.smithi008.stdout: "age": 8.2070093540000002, 2023-08-01T19:54:37.290 INFO:teuthology.orchestra.run.smithi008.stdout: "duration": 0.015287689, 2023-08-01T19:54:37.290 INFO:teuthology.orchestra.run.smithi008.stdout: "type_data": { 2023-08-01T19:54:37.290 INFO:teuthology.orchestra.run.smithi008.stdout: "flag_point": "commit sent; apply or cleanup", 2023-08-01T19:54:37.291 INFO:teuthology.orchestra.run.smithi008.stdout: "client_info": { 2023-08-01T19:54:37.291 INFO:teuthology.orchestra.run.smithi008.stdout: "client": "client.4668", 2023-08-01T19:54:37.291 INFO:teuthology.orchestra.run.smithi008.stdout: "client_addr": "172.21.15.6:0/1709472247", 2023-08-01T19:54:37.291 INFO:teuthology.orchestra.run.smithi008.stdout: "tid": 18363 2023-08-01T19:54:37.291 INFO:teuthology.orchestra.run.smithi008.stdout: }, 2023-08-01T19:54:37.291 INFO:teuthology.orchestra.run.smithi008.stdout: "events": [ 2023-08-01T19:54:37.291 INFO:teuthology.orchestra.run.smithi008.stdout: { 2023-08-01T19:54:37.291 INFO:teuthology.orchestra.run.smithi008.stdout: "event": "initiated", 2023-08-01T19:54:37.292 INFO:teuthology.orchestra.run.smithi008.stdout: "time": "2023-08-01T19:54:28.996467+0000", 2023-08-01T19:54:37.292 INFO:teuthology.orchestra.run.smithi008.stdout: "duration": 0 2023-08-01T19:54:37.292 INFO:teuthology.orchestra.run.smithi008.stdout: }, 2023-08-01T19:54:37.292 INFO:teuthology.orchestra.run.smithi008.stdout: { 2023-08-01T19:54:37.292 INFO:teuthology.orchestra.run.smithi008.stdout: "event": "throttled", 2023-08-01T19:54:37.292 INFO:teuthology.orchestra.run.smithi008.stdout: "time": "2023-08-01T19:54:28.996467+0000", 2023-08-01T19:54:37.292 INFO:teuthology.orchestra.run.smithi008.stdout: "duration": 0 2023-08-01T19:54:37.292 INFO:teuthology.orchestra.run.smithi008.stdout: }, 2023-08-01T19:54:37.293 INFO:teuthology.orchestra.run.smithi008.stdout: { 2023-08-01T19:54:37.293 INFO:teuthology.orchestra.run.smithi008.stdout: "event": "header_read", 2023-08-01T19:54:37.293 INFO:teuthology.orchestra.run.smithi008.stdout: "time": "2023-08-01T19:54:28.996466+0000", 2023-08-01T19:54:37.293 INFO:teuthology.orchestra.run.smithi008.stdout: "duration": 4294967295.999999 2023-08-01T19:54:37.293 INFO:teuthology.orchestra.run.smithi008.stdout: }, 2023-08-01T19:54:37.293 INFO:teuthology.orchestra.run.smithi008.stdout: { 2023-08-01T19:54:37.293 INFO:teuthology.orchestra.run.smithi008.stdout: "event": "all_read", 2023-08-01T19:54:37.293 INFO:teuthology.orchestra.run.smithi008.stdout: "time": "2023-08-01T19:54:28.996519+0000", 2023-08-01T19:54:37.294 INFO:teuthology.orchestra.run.smithi008.stdout: "duration": 5.3075000000000003e-05 2023-08-01T19:54:37.294 INFO:teuthology.orchestra.run.smithi008.stdout: }, 2023-08-01T19:54:37.294 INFO:teuthology.orchestra.run.smithi008.stdout: { 2023-08-01T19:54:37.294 INFO:teuthology.orchestra.run.smithi008.stdout: "event": "dispatched", 2023-08-01T19:54:37.294 INFO:teuthology.orchestra.run.smithi008.stdout: "time": "2023-08-01T19:54:28.996529+0000", 2023-08-01T19:54:37.294 INFO:teuthology.orchestra.run.smithi008.stdout: "duration": 9.2499999999999995e-06 2023-08-01T19:54:37.294 INFO:teuthology.orchestra.run.smithi008.stdout: }, 2023-08-01T19:54:37.295 INFO:teuthology.orchestra.run.smithi008.stdout: { 2023-08-01T19:54:37.295 INFO:teuthology.orchestra.run.smithi008.stdout: "event": "queued_for_pg", 2023-08-01T19:54:37.295 INFO:teuthology.orchestra.run.smithi008.stdout: "time": "2023-08-01T19:54:28.996537+0000", 2023-08-01T19:54:37.295 INFO:teuthology.orchestra.run.smithi008.stdout: "duration": 8.4239999999999993e-06 2023-08-01T19:54:37.295 INFO:teuthology.orchestra.run.smithi008.stdout: }, 2023-08-01T19:54:37.295 INFO:teuthology.orchestra.run.smithi008.stdout: { 2023-08-01T19:54:37.295 INFO:teuthology.orchestra.run.smithi008.stdout: "event": "reached_pg", 2023-08-01T19:54:37.295 INFO:teuthology.orchestra.run.smithi008.stdout: "time": "2023-08-01T19:54:28.996590+0000", 2023-08-01T19:54:37.296 INFO:teuthology.orchestra.run.smithi008.stdout: "duration": 5.3047999999999998e-05 2023-08-01T19:54:37.296 INFO:teuthology.orchestra.run.smithi008.stdout: }, 2023-08-01T19:54:37.296 INFO:teuthology.orchestra.run.smithi008.stdout: { 2023-08-01T19:54:37.296 INFO:teuthology.orchestra.run.smithi008.stdout: "event": "started", 2023-08-01T19:54:37.296 INFO:teuthology.orchestra.run.smithi008.stdout: "time": "2023-08-01T19:54:28.996707+0000", 2023-08-01T19:54:37.296 INFO:teuthology.orchestra.run.smithi008.stdout: "duration": 0.000117005 2023-08-01T19:54:37.296 INFO:teuthology.orchestra.run.smithi008.stdout: }, 2023-08-01T19:54:37.296 INFO:teuthology.orchestra.run.smithi008.stdout: { 2023-08-01T19:54:37.297 INFO:teuthology.orchestra.run.smithi008.stdout: "event": "waiting for subops from 1", 2023-08-01T19:54:37.297 INFO:teuthology.orchestra.run.smithi008.stdout: "time": "2023-08-01T19:54:28.996807+0000", 2023-08-01T19:54:37.297 INFO:teuthology.orchestra.run.smithi008.stdout: "duration": 0.0001003 2023-08-01T19:54:37.297 INFO:teuthology.orchestra.run.smithi008.stdout: }, 2023-08-01T19:54:37.297 INFO:teuthology.orchestra.run.smithi008.stdout: { 2023-08-01T19:54:37.297 INFO:teuthology.orchestra.run.smithi008.stdout: "event": "op_commit", 2023-08-01T19:54:37.297 INFO:teuthology.orchestra.run.smithi008.stdout: "time": "2023-08-01T19:54:28.998511+0000", 2023-08-01T19:54:37.298 INFO:teuthology.orchestra.run.smithi008.stdout: "duration": 0.00170397 2023-08-01T19:54:37.298 INFO:teuthology.orchestra.run.smithi008.stdout: }, 2023-08-01T19:54:37.298 INFO:teuthology.orchestra.run.smithi008.stdout: { 2023-08-01T19:54:37.298 INFO:teuthology.orchestra.run.smithi008.stdout: "event": "sub_op_commit_rec", 2023-08-01T19:54:37.298 INFO:teuthology.orchestra.run.smithi008.stdout: "time": "2023-08-01T19:54:29.011698+0000", 2023-08-01T19:54:37.298 INFO:teuthology.orchestra.run.smithi008.stdout: "duration": 0.013186959 2023-08-01T19:54:37.298 INFO:teuthology.orchestra.run.smithi008.stdout: }, 2023-08-01T19:54:37.298 INFO:teuthology.orchestra.run.smithi008.stdout: { 2023-08-01T19:54:37.299 INFO:teuthology.orchestra.run.smithi008.stdout: "event": "commit_sent", 2023-08-01T19:54:37.299 INFO:teuthology.orchestra.run.smithi008.stdout: "time": "2023-08-01T19:54:29.011729+0000", 2023-08-01T19:54:37.299 INFO:teuthology.orchestra.run.smithi008.stdout: "duration": 3.044e-05 2023-08-01T19:54:37.299 INFO:teuthology.orchestra.run.smithi008.stdout: }, 2023-08-01T19:54:37.299 INFO:teuthology.orchestra.run.smithi008.stdout: { 2023-08-01T19:54:37.299 INFO:teuthology.orchestra.run.smithi008.stdout: "event": "done", 2023-08-01T19:54:37.299 INFO:teuthology.orchestra.run.smithi008.stdout: "time": "2023-08-01T19:54:29.011755+0000", 2023-08-01T19:54:37.299 INFO:teuthology.orchestra.run.smithi008.stdout: "duration": 2.6165000000000001e-05 2023-08-01T19:54:37.300 INFO:teuthology.orchestra.run.smithi008.stdout: } 2023-08-01T19:54:37.300 INFO:teuthology.orchestra.run.smithi008.stdout: ] 2023-08-01T19:54:37.300 INFO:teuthology.orchestra.run.smithi008.stdout: } 2023-08-01T19:54:37.300 INFO:teuthology.orchestra.run.smithi008.stdout: }, 2023-08-01T19:54:37.300 INFO:teuthology.orchestra.run.smithi008.stdout: { 2023-08-01T19:54:37.300 INFO:teuthology.orchestra.run.smithi008.stdout: "description": "osd_op(client.4668.0:18368 5.5 5:ac90765d:::benchmark_data_smithi006_114134_object18367:head [set-alloc-hint object_size 65536 write_size 65536,write 0~65536] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e23)", 2023-08-01T19:54:37.300 INFO:teuthology.orchestra.run.smithi008.stdout: "initiated_at": "2023-08-01T19:54:28.996987+0000", 2023-08-01T19:54:37.300 INFO:teuthology.orchestra.run.smithi008.stdout: "age": 8.2064895070000006, 2023-08-01T19:54:37.301 INFO:teuthology.orchestra.run.smithi008.stdout: "duration": 0.014851731999999999, 2023-08-01T19:54:37.301 INFO:teuthology.orchestra.run.smithi008.stdout: "type_data": { 2023-08-01T19:54:37.301 INFO:teuthology.orchestra.run.smithi008.stdout: "flag_point": "commit sent; apply or cleanup", 2023-08-01T19:54:37.301 INFO:teuthology.orchestra.run.smithi008.stdout: "client_info": { 2023-08-01T19:54:37.301 INFO:teuthology.orchestra.run.smithi008.stdout: "client": "client.4668", 2023-08-01T19:54:37.301 INFO:teuthology.orchestra.run.smithi008.stdout: "client_addr": "172.21.15.6:0/1709472247", 2023-08-01T19:54:37.301 INFO:teuthology.orchestra.run.smithi008.stdout: "tid": 18368 2023-08-01T19:54:37.301 INFO:teuthology.orchestra.run.smithi008.stdout: }, 2023-08-01T19:54:37.302 INFO:teuthology.orchestra.run.smithi008.stdout: "events": [ 2023-08-01T19:54:37.302 INFO:teuthology.orchestra.run.smithi008.stdout: { 2023-08-01T19:54:37.302 INFO:teuthology.orchestra.run.smithi008.stdout: "event": "initiated", 2023-08-01T19:54:37.302 INFO:teuthology.orchestra.run.smithi008.stdout: "time": "2023-08-01T19:54:28.996987+0000", 2023-08-01T19:54:37.302 INFO:teuthology.orchestra.run.smithi008.stdout: "duration": 0 2023-08-01T19:54:37.302 INFO:teuthology.orchestra.run.smithi008.stdout: }, 2023-08-01T19:54:37.302 INFO:teuthology.orchestra.run.smithi008.stdout: { 2023-08-01T19:54:37.302 INFO:teuthology.orchestra.run.smithi008.stdout: "event": "throttled", 2023-08-01T19:54:37.303 INFO:teuthology.orchestra.run.smithi008.stdout: "time": "2023-08-01T19:54:28.996987+0000", 2023-08-01T19:54:37.303 INFO:teuthology.orchestra.run.smithi008.stdout: "duration": 0 2023-08-01T19:54:37.303 INFO:teuthology.orchestra.run.smithi008.stdout: }, 2023-08-01T19:54:37.303 INFO:teuthology.orchestra.run.smithi008.stdout: { 2023-08-01T19:54:37.303 INFO:teuthology.orchestra.run.smithi008.stdout: "event": "header_read", 2023-08-01T19:54:37.303 INFO:teuthology.orchestra.run.smithi008.stdout: "time": "2023-08-01T19:54:28.996986+0000", 2023-08-01T19:54:37.303 INFO:teuthology.orchestra.run.smithi008.stdout: "duration": 4294967295.999999 2023-08-01T19:54:37.303 INFO:teuthology.orchestra.run.smithi008.stdout: }, 2023-08-01T19:54:37.304 INFO:teuthology.orchestra.run.smithi008.stdout: { 2023-08-01T19:54:37.304 INFO:teuthology.orchestra.run.smithi008.stdout: "event": "all_read", 2023-08-01T19:54:37.304 INFO:teuthology.orchestra.run.smithi008.stdout: "time": "2023-08-01T19:54:28.997061+0000", 2023-08-01T19:54:37.304 INFO:teuthology.orchestra.run.smithi008.stdout: "duration": 7.4849000000000001e-05 2023-08-01T19:54:37.304 INFO:teuthology.orchestra.run.smithi008.stdout: }, 2023-08-01T19:54:37.304 INFO:teuthology.orchestra.run.smithi008.stdout: { 2023-08-01T19:54:37.304 INFO:teuthology.orchestra.run.smithi008.stdout: "event": "dispatched", 2023-08-01T19:54:37.304 INFO:teuthology.orchestra.run.smithi008.stdout: "time": "2023-08-01T19:54:28.997070+0000", 2023-08-01T19:54:37.305 INFO:teuthology.orchestra.run.smithi008.stdout: "duration": 8.7499999999999992e-06 2023-08-01T19:54:37.305 INFO:teuthology.orchestra.run.smithi008.stdout: }, 2023-08-01T19:54:37.305 INFO:teuthology.orchestra.run.smithi008.stdout: { 2023-08-01T19:54:37.305 INFO:teuthology.orchestra.run.smithi008.stdout: "event": "queued_for_pg", 2023-08-01T19:54:37.305 INFO:teuthology.orchestra.run.smithi008.stdout: "time": "2023-08-01T19:54:28.997076+0000", 2023-08-01T19:54:37.305 INFO:teuthology.orchestra.run.smithi008.stdout: "duration": 6.0510000000000002e-06 2023-08-01T19:54:37.305 INFO:teuthology.orchestra.run.smithi008.stdout: }, 2023-08-01T19:54:37.306 INFO:teuthology.orchestra.run.smithi008.stdout: { 2023-08-01T19:54:37.306 INFO:teuthology.orchestra.run.smithi008.stdout: "event": "reached_pg", 2023-08-01T19:54:37.306 INFO:teuthology.orchestra.run.smithi008.stdout: "time": "2023-08-01T19:54:28.997512+0000", 2023-08-01T19:54:37.306 INFO:teuthology.orchestra.run.smithi008.stdout: "duration": 0.00043637299999999999 2023-08-01T19:54:37.306 INFO:teuthology.orchestra.run.smithi008.stdout: }, 2023-08-01T19:54:37.306 INFO:teuthology.orchestra.run.smithi008.stdout: { 2023-08-01T19:54:37.306 INFO:teuthology.orchestra.run.smithi008.stdout: "event": "started", 2023-08-01T19:54:37.306 INFO:teuthology.orchestra.run.smithi008.stdout: "time": "2023-08-01T19:54:28.997634+0000", 2023-08-01T19:54:37.307 INFO:teuthology.orchestra.run.smithi008.stdout: "duration": 0.00012162100000000001 2023-08-01T19:54:37.307 INFO:teuthology.orchestra.run.smithi008.stdout: }, 2023-08-01T19:54:37.307 INFO:teuthology.orchestra.run.smithi008.stdout: { 2023-08-01T19:54:37.307 INFO:teuthology.orchestra.run.smithi008.stdout: "event": "waiting for subops from 1", 2023-08-01T19:54:37.307 INFO:teuthology.orchestra.run.smithi008.stdout: "time": "2023-08-01T19:54:28.997792+0000", 2023-08-01T19:54:37.307 INFO:teuthology.orchestra.run.smithi008.stdout: "duration": 0.00015851600000000001 2023-08-01T19:54:37.307 INFO:teuthology.orchestra.run.smithi008.stdout: }, 2023-08-01T19:54:37.307 INFO:teuthology.orchestra.run.smithi008.stdout: { 2023-08-01T19:54:37.308 INFO:teuthology.orchestra.run.smithi008.stdout: "event": "op_commit", 2023-08-01T19:54:37.308 INFO:teuthology.orchestra.run.smithi008.stdout: "time": "2023-08-01T19:54:28.999634+0000", 2023-08-01T19:54:37.308 INFO:teuthology.orchestra.run.smithi008.stdout: "duration": 0.001841046 2023-08-01T19:54:37.308 INFO:teuthology.orchestra.run.smithi008.stdout: }, 2023-08-01T19:54:37.308 INFO:teuthology.orchestra.run.smithi008.stdout: { 2023-08-01T19:54:37.308 INFO:teuthology.orchestra.run.smithi008.stdout: "event": "sub_op_commit_rec", 2023-08-01T19:54:37.308 INFO:teuthology.orchestra.run.smithi008.stdout: "time": "2023-08-01T19:54:29.011789+0000", 2023-08-01T19:54:37.308 INFO:teuthology.orchestra.run.smithi008.stdout: "duration": 0.012155011 2023-08-01T19:54:37.309 INFO:teuthology.orchestra.run.smithi008.stdout: }, 2023-08-01T19:54:37.309 INFO:teuthology.orchestra.run.smithi008.stdout: { 2023-08-01T19:54:37.309 INFO:teuthology.orchestra.run.smithi008.stdout: "event": "commit_sent", 2023-08-01T19:54:37.309 INFO:teuthology.orchestra.run.smithi008.stdout: "time": "2023-08-01T19:54:29.011818+0000", 2023-08-01T19:54:37.309 INFO:teuthology.orchestra.run.smithi008.stdout: "duration": 2.9152000000000001e-05 2023-08-01T19:54:37.309 INFO:teuthology.orchestra.run.smithi008.stdout: }, 2023-08-01T19:54:37.309 INFO:teuthology.orchestra.run.smithi008.stdout: { 2023-08-01T19:54:37.309 INFO:teuthology.orchestra.run.smithi008.stdout: "event": "done", 2023-08-01T19:54:37.310 INFO:teuthology.orchestra.run.smithi008.stdout: "time": "2023-08-01T19:54:29.011839+0000", 2023-08-01T19:54:37.310 INFO:teuthology.orchestra.run.smithi008.stdout: "duration": 2.1132999999999999e-05 2023-08-01T19:54:37.310 INFO:teuthology.orchestra.run.smithi008.stdout: } 2023-08-01T19:54:37.310 INFO:teuthology.orchestra.run.smithi008.stdout: ] 2023-08-01T19:54:37.310 INFO:teuthology.orchestra.run.smithi008.stdout: } 2023-08-01T19:54:37.310 INFO:teuthology.orchestra.run.smithi008.stdout: }, 2023-08-01T19:54:37.310 INFO:teuthology.orchestra.run.smithi008.stdout: { 2023-08-01T19:54:37.310 INFO:teuthology.orchestra.run.smithi008.stdout: "description": "osd_op(client.4668.0:18369 5.3 5:c557c7d0:::benchmark_data_smithi006_114134_object18368:head [set-alloc-hint object_size 65536 write_size 65536,write 0~65536] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e23)", 2023-08-01T19:54:37.311 INFO:teuthology.orchestra.run.smithi008.stdout: "initiated_at": "2023-08-01T19:54:28.997782+0000", 2023-08-01T19:54:37.311 INFO:teuthology.orchestra.run.smithi008.stdout: "age": 8.2056945330000008, 2023-08-01T19:54:37.311 INFO:teuthology.orchestra.run.smithi008.stdout: "duration": 0.013982608000000001, 2023-08-01T19:54:37.311 INFO:teuthology.orchestra.run.smithi008.stdout: "type_data": { 2023-08-01T19:54:37.311 INFO:teuthology.orchestra.run.smithi008.stdout: "flag_point": "commit sent; apply or cleanup", 2023-08-01T19:54:37.311 INFO:teuthology.orchestra.run.smithi008.stdout: "client_info": { 2023-08-01T19:54:37.311 INFO:teuthology.orchestra.run.smithi008.stdout: "client": "client.4668", 2023-08-01T19:54:37.311 INFO:teuthology.orchestra.run.smithi008.stdout: "client_addr": "172.21.15.6:0/1709472247", 2023-08-01T19:54:37.312 INFO:teuthology.orchestra.run.smithi008.stdout: "tid": 18369 2023-08-01T19:54:37.312 INFO:teuthology.orchestra.run.smithi008.stdout: }, 2023-08-01T19:54:37.312 INFO:teuthology.orchestra.run.smithi008.stdout: "events": [ 2023-08-01T19:54:37.312 INFO:teuthology.orchestra.run.smithi008.stdout: { 2023-08-01T19:54:37.312 INFO:teuthology.orchestra.run.smithi008.stdout: "event": "initiated", 2023-08-01T19:54:37.312 INFO:teuthology.orchestra.run.smithi008.stdout: "time": "2023-08-01T19:54:28.997782+0000", 2023-08-01T19:54:37.312 INFO:teuthology.orchestra.run.smithi008.stdout: "duration": 0 2023-08-01T19:54:37.313 INFO:teuthology.orchestra.run.smithi008.stdout: }, 2023-08-01T19:54:37.313 INFO:teuthology.orchestra.run.smithi008.stdout: { 2023-08-01T19:54:37.313 INFO:teuthology.orchestra.run.smithi008.stdout: "event": "throttled", 2023-08-01T19:54:37.313 INFO:teuthology.orchestra.run.smithi008.stdout: "time": "2023-08-01T19:54:28.997782+0000", 2023-08-01T19:54:37.313 INFO:teuthology.orchestra.run.smithi008.stdout: "duration": 0 2023-08-01T19:54:37.313 INFO:teuthology.orchestra.run.smithi008.stdout: }, 2023-08-01T19:54:37.313 INFO:teuthology.orchestra.run.smithi008.stdout: { 2023-08-01T19:54:37.313 INFO:teuthology.orchestra.run.smithi008.stdout: "event": "header_read", 2023-08-01T19:54:37.314 INFO:teuthology.orchestra.run.smithi008.stdout: "time": "2023-08-01T19:54:28.997781+0000", 2023-08-01T19:54:37.314 INFO:teuthology.orchestra.run.smithi008.stdout: "duration": 4294967295.9999995 2023-08-01T19:54:37.314 INFO:teuthology.orchestra.run.smithi008.stdout: }, 2023-08-01T19:54:37.314 INFO:teuthology.orchestra.run.smithi008.stdout: { 2023-08-01T19:54:37.314 INFO:teuthology.orchestra.run.smithi008.stdout: "event": "all_read", 2023-08-01T19:54:37.314 INFO:teuthology.orchestra.run.smithi008.stdout: "time": "2023-08-01T19:54:28.997859+0000", 2023-08-01T19:54:37.314 INFO:teuthology.orchestra.run.smithi008.stdout: "duration": 7.7420000000000001e-05 2023-08-01T19:54:37.314 INFO:teuthology.orchestra.run.smithi008.stdout: }, 2023-08-01T19:54:37.315 INFO:teuthology.orchestra.run.smithi008.stdout: { 2023-08-01T19:54:37.315 INFO:teuthology.orchestra.run.smithi008.stdout: "event": "dispatched", 2023-08-01T19:54:37.315 INFO:teuthology.orchestra.run.smithi008.stdout: "time": "2023-08-01T19:54:28.997866+0000", 2023-08-01T19:54:37.315 INFO:teuthology.orchestra.run.smithi008.stdout: "duration": 7.2910000000000002e-06 2023-08-01T19:54:37.315 INFO:teuthology.orchestra.run.smithi008.stdout: }, 2023-08-01T19:54:37.315 INFO:teuthology.orchestra.run.smithi008.stdout: { 2023-08-01T19:54:37.315 INFO:teuthology.orchestra.run.smithi008.stdout: "event": "queued_for_pg", 2023-08-01T19:54:37.315 INFO:teuthology.orchestra.run.smithi008.stdout: "time": "2023-08-01T19:54:28.997872+0000", 2023-08-01T19:54:37.316 INFO:teuthology.orchestra.run.smithi008.stdout: "duration": 6.0460000000000002e-06 2023-08-01T19:54:37.316 INFO:teuthology.orchestra.run.smithi008.stdout: }, 2023-08-01T19:54:37.316 INFO:teuthology.orchestra.run.smithi008.stdout: { 2023-08-01T19:54:37.316 INFO:teuthology.orchestra.run.smithi008.stdout: "event": "reached_pg", 2023-08-01T19:54:37.316 INFO:teuthology.orchestra.run.smithi008.stdout: "time": "2023-08-01T19:54:28.997931+0000", 2023-08-01T19:54:37.316 INFO:teuthology.orchestra.run.smithi008.stdout: "duration": 5.8692e-05 2023-08-01T19:54:37.316 INFO:teuthology.orchestra.run.smithi008.stdout: }, 2023-08-01T19:54:37.316 INFO:teuthology.orchestra.run.smithi008.stdout: { 2023-08-01T19:54:37.317 INFO:teuthology.orchestra.run.smithi008.stdout: "event": "started", 2023-08-01T19:54:37.317 INFO:teuthology.orchestra.run.smithi008.stdout: "time": "2023-08-01T19:54:28.998082+0000", 2023-08-01T19:54:37.317 INFO:teuthology.orchestra.run.smithi008.stdout: "duration": 0.000151438 2023-08-01T19:54:37.317 INFO:teuthology.orchestra.run.smithi008.stdout: }, 2023-08-01T19:54:37.317 INFO:teuthology.orchestra.run.smithi008.stdout: { 2023-08-01T19:54:37.317 INFO:teuthology.orchestra.run.smithi008.stdout: "event": "waiting for subops from 1", 2023-08-01T19:54:37.317 INFO:teuthology.orchestra.run.smithi008.stdout: "time": "2023-08-01T19:54:28.998216+0000", 2023-08-01T19:54:37.317 INFO:teuthology.orchestra.run.smithi008.stdout: "duration": 0.00013328099999999999 2023-08-01T19:54:37.318 INFO:teuthology.orchestra.run.smithi008.stdout: }, 2023-08-01T19:54:37.318 INFO:teuthology.orchestra.run.smithi008.stdout: { 2023-08-01T19:54:37.318 INFO:teuthology.orchestra.run.smithi008.stdout: "event": "op_commit", 2023-08-01T19:54:37.318 INFO:teuthology.orchestra.run.smithi008.stdout: "time": "2023-08-01T19:54:29.000045+0000", 2023-08-01T19:54:37.318 INFO:teuthology.orchestra.run.smithi008.stdout: "duration": 0.001829231 2023-08-01T19:54:37.318 INFO:teuthology.orchestra.run.smithi008.stdout: }, 2023-08-01T19:54:37.318 INFO:teuthology.orchestra.run.smithi008.stdout: { 2023-08-01T19:54:37.318 INFO:teuthology.orchestra.run.smithi008.stdout: "event": "sub_op_commit_rec", 2023-08-01T19:54:37.319 INFO:teuthology.orchestra.run.smithi008.stdout: "time": "2023-08-01T19:54:29.011719+0000", 2023-08-01T19:54:37.319 INFO:teuthology.orchestra.run.smithi008.stdout: "duration": 0.011673817 2023-08-01T19:54:37.319 INFO:teuthology.orchestra.run.smithi008.stdout: }, 2023-08-01T19:54:37.319 INFO:teuthology.orchestra.run.smithi008.stdout: { 2023-08-01T19:54:37.319 INFO:teuthology.orchestra.run.smithi008.stdout: "event": "commit_sent", 2023-08-01T19:54:37.319 INFO:teuthology.orchestra.run.smithi008.stdout: "time": "2023-08-01T19:54:29.011743+0000", 2023-08-01T19:54:37.319 INFO:teuthology.orchestra.run.smithi008.stdout: "duration": 2.4663000000000001e-05 2023-08-01T19:54:37.319 INFO:teuthology.orchestra.run.smithi008.stdout: }, 2023-08-01T19:54:37.320 INFO:teuthology.orchestra.run.smithi008.stdout: { 2023-08-01T19:54:37.320 INFO:teuthology.orchestra.run.smithi008.stdout: "event": "done", 2023-08-01T19:54:37.320 INFO:teuthology.orchestra.run.smithi008.stdout: "time": "2023-08-01T19:54:29.011765+0000", 2023-08-01T19:54:37.320 INFO:teuthology.orchestra.run.smithi008.stdout: "duration": 2.1410999999999999e-05 2023-08-01T19:54:37.320 INFO:teuthology.orchestra.run.smithi008.stdout: } 2023-08-01T19:54:37.320 INFO:teuthology.orchestra.run.smithi008.stdout: ] 2023-08-01T19:54:37.320 INFO:teuthology.orchestra.run.smithi008.stdout: } 2023-08-01T19:54:37.321 INFO:teuthology.orchestra.run.smithi008.stdout: }, 2023-08-01T19:54:37.321 INFO:teuthology.orchestra.run.smithi008.stdout: { 2023-08-01T19:54:37.321 INFO:teuthology.orchestra.run.smithi008.stdout: "description": "osd_op(client.4668.0:19949 5.a 5:5214d73c:::benchmark_data_smithi006_114134_object19948:head [set-alloc-hint object_size 65536 write_size 65536,write 0~65536] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e23)", 2023-08-01T19:54:37.321 INFO:teuthology.orchestra.run.smithi008.stdout: "initiated_at": "2023-08-01T19:54:29.472760+0000", 2023-08-01T19:54:37.321 INFO:teuthology.orchestra.run.smithi008.stdout: "age": 7.7307162519999997, 2023-08-01T19:54:37.321 INFO:teuthology.orchestra.run.smithi008.stdout: "duration": 0.012313249, 2023-08-01T19:54:37.321 INFO:teuthology.orchestra.run.smithi008.stdout: "type_data": { 2023-08-01T19:54:37.321 INFO:teuthology.orchestra.run.smithi008.stdout: "flag_point": "commit sent; apply or cleanup", 2023-08-01T19:54:37.322 INFO:teuthology.orchestra.run.smithi008.stdout: "client_info": { 2023-08-01T19:54:37.322 INFO:teuthology.orchestra.run.smithi008.stdout: "client": "client.4668", 2023-08-01T19:54:37.322 INFO:teuthology.orchestra.run.smithi008.stdout: "client_addr": "172.21.15.6:0/1709472247", 2023-08-01T19:54:37.322 INFO:teuthology.orchestra.run.smithi008.stdout: "tid": 19949 2023-08-01T19:54:37.322 INFO:teuthology.orchestra.run.smithi008.stdout: }, 2023-08-01T19:54:37.322 INFO:teuthology.orchestra.run.smithi008.stdout: "events": [ 2023-08-01T19:54:37.322 INFO:teuthology.orchestra.run.smithi008.stdout: { 2023-08-01T19:54:37.322 INFO:teuthology.orchestra.run.smithi008.stdout: "event": "initiated", 2023-08-01T19:54:37.323 INFO:teuthology.orchestra.run.smithi008.stdout: "time": "2023-08-01T19:54:29.472760+0000", 2023-08-01T19:54:37.323 INFO:teuthology.orchestra.run.smithi008.stdout: "duration": 0 2023-08-01T19:54:37.323 INFO:teuthology.orchestra.run.smithi008.stdout: }, 2023-08-01T19:54:37.323 INFO:teuthology.orchestra.run.smithi008.stdout: { 2023-08-01T19:54:37.323 INFO:teuthology.orchestra.run.smithi008.stdout: "event": "throttled", 2023-08-01T19:54:37.323 INFO:teuthology.orchestra.run.smithi008.stdout: "time": "2023-08-01T19:54:29.472760+0000", 2023-08-01T19:54:37.323 INFO:teuthology.orchestra.run.smithi008.stdout: "duration": 0 2023-08-01T19:54:37.323 INFO:teuthology.orchestra.run.smithi008.stdout: }, 2023-08-01T19:54:37.324 INFO:teuthology.orchestra.run.smithi008.stdout: { 2023-08-01T19:54:37.324 INFO:teuthology.orchestra.run.smithi008.stdout: "event": "header_read", 2023-08-01T19:54:37.324 INFO:teuthology.orchestra.run.smithi008.stdout: "time": "2023-08-01T19:54:29.472759+0000", 2023-08-01T19:54:37.324 INFO:teuthology.orchestra.run.smithi008.stdout: "duration": 4294967295.999999 2023-08-01T19:54:37.324 INFO:teuthology.orchestra.run.smithi008.stdout: }, 2023-08-01T19:54:37.324 INFO:teuthology.orchestra.run.smithi008.stdout: { 2023-08-01T19:54:37.324 INFO:teuthology.orchestra.run.smithi008.stdout: "event": "all_read", 2023-08-01T19:54:37.324 INFO:teuthology.orchestra.run.smithi008.stdout: "time": "2023-08-01T19:54:29.472831+0000", 2023-08-01T19:54:37.325 INFO:teuthology.orchestra.run.smithi008.stdout: "duration": 7.1501000000000005e-05 2023-08-01T19:54:37.325 INFO:teuthology.orchestra.run.smithi008.stdout: }, 2023-08-01T19:54:37.325 INFO:teuthology.orchestra.run.smithi008.stdout: { 2023-08-01T19:54:37.325 INFO:teuthology.orchestra.run.smithi008.stdout: "event": "dispatched", 2023-08-01T19:54:37.325 INFO:teuthology.orchestra.run.smithi008.stdout: "time": "2023-08-01T19:54:29.472839+0000", 2023-08-01T19:54:37.325 INFO:teuthology.orchestra.run.smithi008.stdout: "duration": 8.2309999999999996e-06 2023-08-01T19:54:37.325 INFO:teuthology.orchestra.run.smithi008.stdout: }, 2023-08-01T19:54:37.326 INFO:teuthology.orchestra.run.smithi008.stdout: { 2023-08-01T19:54:37.326 INFO:teuthology.orchestra.run.smithi008.stdout: "event": "queued_for_pg", 2023-08-01T19:54:37.326 INFO:teuthology.orchestra.run.smithi008.stdout: "time": "2023-08-01T19:54:29.472843+0000", 2023-08-01T19:54:37.326 INFO:teuthology.orchestra.run.smithi008.stdout: "duration": 4.1969999999999998e-06 2023-08-01T19:54:37.326 INFO:teuthology.orchestra.run.smithi008.stdout: }, 2023-08-01T19:54:37.326 INFO:teuthology.orchestra.run.smithi008.stdout: { 2023-08-01T19:54:37.326 INFO:teuthology.orchestra.run.smithi008.stdout: "event": "reached_pg", 2023-08-01T19:54:37.326 INFO:teuthology.orchestra.run.smithi008.stdout: "time": "2023-08-01T19:54:29.472869+0000", 2023-08-01T19:54:37.327 INFO:teuthology.orchestra.run.smithi008.stdout: "duration": 2.5877e-05 2023-08-01T19:54:37.327 INFO:teuthology.orchestra.run.smithi008.stdout: }, 2023-08-01T19:54:37.327 INFO:teuthology.orchestra.run.smithi008.stdout: { 2023-08-01T19:54:37.327 INFO:teuthology.orchestra.run.smithi008.stdout: "event": "started", 2023-08-01T19:54:37.327 INFO:teuthology.orchestra.run.smithi008.stdout: "time": "2023-08-01T19:54:29.472945+0000", 2023-08-01T19:54:37.327 INFO:teuthology.orchestra.run.smithi008.stdout: "duration": 7.5741000000000005e-05 2023-08-01T19:54:37.327 INFO:teuthology.orchestra.run.smithi008.stdout: }, 2023-08-01T19:54:37.327 INFO:teuthology.orchestra.run.smithi008.stdout: { 2023-08-01T19:54:37.328 INFO:teuthology.orchestra.run.smithi008.stdout: "event": "waiting for subops from 2", 2023-08-01T19:54:37.328 INFO:teuthology.orchestra.run.smithi008.stdout: "time": "2023-08-01T19:54:29.473035+0000", 2023-08-01T19:54:37.328 INFO:teuthology.orchestra.run.smithi008.stdout: "duration": 8.9820000000000004e-05 2023-08-01T19:54:37.328 INFO:teuthology.orchestra.run.smithi008.stdout: }, 2023-08-01T19:54:37.328 INFO:teuthology.orchestra.run.smithi008.stdout: { 2023-08-01T19:54:37.328 INFO:teuthology.orchestra.run.smithi008.stdout: "event": "op_commit", 2023-08-01T19:54:37.328 INFO:teuthology.orchestra.run.smithi008.stdout: "time": "2023-08-01T19:54:29.475834+0000", 2023-08-01T19:54:37.328 INFO:teuthology.orchestra.run.smithi008.stdout: "duration": 0.0027993610000000002 2023-08-01T19:54:37.329 INFO:teuthology.orchestra.run.smithi008.stdout: }, 2023-08-01T19:54:37.329 INFO:teuthology.orchestra.run.smithi008.stdout: { 2023-08-01T19:54:37.329 INFO:teuthology.orchestra.run.smithi008.stdout: "event": "sub_op_commit_rec", 2023-08-01T19:54:37.329 INFO:teuthology.orchestra.run.smithi008.stdout: "time": "2023-08-01T19:54:29.484975+0000", 2023-08-01T19:54:37.329 INFO:teuthology.orchestra.run.smithi008.stdout: "duration": 0.0091408510000000002 2023-08-01T19:54:37.329 INFO:teuthology.orchestra.run.smithi008.stdout: }, 2023-08-01T19:54:37.329 INFO:teuthology.orchestra.run.smithi008.stdout: { 2023-08-01T19:54:37.329 INFO:teuthology.orchestra.run.smithi008.stdout: "event": "commit_sent", 2023-08-01T19:54:37.330 INFO:teuthology.orchestra.run.smithi008.stdout: "time": "2023-08-01T19:54:29.485036+0000", 2023-08-01T19:54:37.330 INFO:teuthology.orchestra.run.smithi008.stdout: "duration": 6.1049000000000005e-05 2023-08-01T19:54:37.330 INFO:teuthology.orchestra.run.smithi008.stdout: }, 2023-08-01T19:54:37.330 INFO:teuthology.orchestra.run.smithi008.stdout: { 2023-08-01T19:54:37.330 INFO:teuthology.orchestra.run.smithi008.stdout: "event": "done", 2023-08-01T19:54:37.330 INFO:teuthology.orchestra.run.smithi008.stdout: "time": "2023-08-01T19:54:29.485074+0000", 2023-08-01T19:54:37.330 INFO:teuthology.orchestra.run.smithi008.stdout: "duration": 3.7651000000000003e-05 2023-08-01T19:54:37.331 INFO:teuthology.orchestra.run.smithi008.stdout: } 2023-08-01T19:54:37.331 INFO:teuthology.orchestra.run.smithi008.stdout: ] 2023-08-01T19:54:37.331 INFO:teuthology.orchestra.run.smithi008.stdout: } 2023-08-01T19:54:37.331 INFO:teuthology.orchestra.run.smithi008.stdout: }, 2023-08-01T19:54:37.331 INFO:teuthology.orchestra.run.smithi008.stdout: { 2023-08-01T19:54:37.331 INFO:teuthology.orchestra.run.smithi008.stdout: "description": "osd_op(client.4668.0:20544 5.a 5:52fb262b:::benchmark_data_smithi006_114134_object20543:head [set-alloc-hint object_size 65536 write_size 65536,write 0~65536] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e23)", 2023-08-01T19:54:37.331 INFO:teuthology.orchestra.run.smithi008.stdout: "initiated_at": "2023-08-01T19:54:29.655369+0000", 2023-08-01T19:54:37.331 INFO:teuthology.orchestra.run.smithi008.stdout: "age": 7.5481078630000003, 2023-08-01T19:54:37.332 INFO:teuthology.orchestra.run.smithi008.stdout: "duration": 0.013074334999999999, 2023-08-01T19:54:37.332 INFO:teuthology.orchestra.run.smithi008.stdout: "type_data": { 2023-08-01T19:54:37.332 INFO:teuthology.orchestra.run.smithi008.stdout: "flag_point": "commit sent; apply or cleanup", 2023-08-01T19:54:37.332 INFO:teuthology.orchestra.run.smithi008.stdout: "client_info": { 2023-08-01T19:54:37.332 INFO:teuthology.orchestra.run.smithi008.stdout: "client": "client.4668", 2023-08-01T19:54:37.332 INFO:teuthology.orchestra.run.smithi008.stdout: "client_addr": "172.21.15.6:0/1709472247", 2023-08-01T19:54:37.332 INFO:teuthology.orchestra.run.smithi008.stdout: "tid": 20544 2023-08-01T19:54:37.332 INFO:teuthology.orchestra.run.smithi008.stdout: }, 2023-08-01T19:54:37.333 INFO:teuthology.orchestra.run.smithi008.stdout: "events": [ 2023-08-01T19:54:37.333 INFO:teuthology.orchestra.run.smithi008.stdout: { 2023-08-01T19:54:37.333 INFO:teuthology.orchestra.run.smithi008.stdout: "event": "initiated", 2023-08-01T19:54:37.333 INFO:teuthology.orchestra.run.smithi008.stdout: "time": "2023-08-01T19:54:29.655369+0000", 2023-08-01T19:54:37.333 INFO:teuthology.orchestra.run.smithi008.stdout: "duration": 0 2023-08-01T19:54:37.333 INFO:teuthology.orchestra.run.smithi008.stdout: }, 2023-08-01T19:54:37.333 INFO:teuthology.orchestra.run.smithi008.stdout: { 2023-08-01T19:54:37.334 INFO:teuthology.orchestra.run.smithi008.stdout: "event": "throttled", 2023-08-01T19:54:37.334 INFO:teuthology.orchestra.run.smithi008.stdout: "time": "2023-08-01T19:54:29.655369+0000", 2023-08-01T19:54:37.334 INFO:teuthology.orchestra.run.smithi008.stdout: "duration": 0 2023-08-01T19:54:37.334 INFO:teuthology.orchestra.run.smithi008.stdout: }, 2023-08-01T19:54:37.334 INFO:teuthology.orchestra.run.smithi008.stdout: { 2023-08-01T19:54:37.334 INFO:teuthology.orchestra.run.smithi008.stdout: "event": "header_read", 2023-08-01T19:54:37.334 INFO:teuthology.orchestra.run.smithi008.stdout: "time": "2023-08-01T19:54:29.655368+0000", 2023-08-01T19:54:37.334 INFO:teuthology.orchestra.run.smithi008.stdout: "duration": 4294967295.9999995 2023-08-01T19:54:37.335 INFO:teuthology.orchestra.run.smithi008.stdout: }, 2023-08-01T19:54:37.335 INFO:teuthology.orchestra.run.smithi008.stdout: { 2023-08-01T19:54:37.335 INFO:teuthology.orchestra.run.smithi008.stdout: "event": "all_read", 2023-08-01T19:54:37.335 INFO:teuthology.orchestra.run.smithi008.stdout: "time": "2023-08-01T19:54:29.655405+0000", 2023-08-01T19:54:37.335 INFO:teuthology.orchestra.run.smithi008.stdout: "duration": 3.7316e-05 2023-08-01T19:54:37.335 INFO:teuthology.orchestra.run.smithi008.stdout: }, 2023-08-01T19:54:37.335 INFO:teuthology.orchestra.run.smithi008.stdout: { 2023-08-01T19:54:37.335 INFO:teuthology.orchestra.run.smithi008.stdout: "event": "dispatched", 2023-08-01T19:54:37.336 INFO:teuthology.orchestra.run.smithi008.stdout: "time": "2023-08-01T19:54:29.655416+0000", 2023-08-01T19:54:37.336 INFO:teuthology.orchestra.run.smithi008.stdout: "duration": 1.1102e-05 2023-08-01T19:54:37.336 INFO:teuthology.orchestra.run.smithi008.stdout: }, 2023-08-01T19:54:37.336 INFO:teuthology.orchestra.run.smithi008.stdout: { 2023-08-01T19:54:37.336 INFO:teuthology.orchestra.run.smithi008.stdout: "event": "queued_for_pg", 2023-08-01T19:54:37.336 INFO:teuthology.orchestra.run.smithi008.stdout: "time": "2023-08-01T19:54:29.655422+0000", 2023-08-01T19:54:37.336 INFO:teuthology.orchestra.run.smithi008.stdout: "duration": 5.9120000000000003e-06 2023-08-01T19:54:37.336 INFO:teuthology.orchestra.run.smithi008.stdout: }, 2023-08-01T19:54:37.337 INFO:teuthology.orchestra.run.smithi008.stdout: { 2023-08-01T19:54:37.337 INFO:teuthology.orchestra.run.smithi008.stdout: "event": "reached_pg", 2023-08-01T19:54:37.337 INFO:teuthology.orchestra.run.smithi008.stdout: "time": "2023-08-01T19:54:29.656834+0000", 2023-08-01T19:54:37.337 INFO:teuthology.orchestra.run.smithi008.stdout: "duration": 0.0014116829999999999 2023-08-01T19:54:37.337 INFO:teuthology.orchestra.run.smithi008.stdout: }, 2023-08-01T19:54:37.337 INFO:teuthology.orchestra.run.smithi008.stdout: { 2023-08-01T19:54:37.337 INFO:teuthology.orchestra.run.smithi008.stdout: "event": "started", 2023-08-01T19:54:37.338 INFO:teuthology.orchestra.run.smithi008.stdout: "time": "2023-08-01T19:54:29.656953+0000", 2023-08-01T19:54:37.338 INFO:teuthology.orchestra.run.smithi008.stdout: "duration": 0.00011851200000000001 2023-08-01T19:54:37.338 INFO:teuthology.orchestra.run.smithi008.stdout: }, 2023-08-01T19:54:37.338 INFO:teuthology.orchestra.run.smithi008.stdout: { 2023-08-01T19:54:37.338 INFO:teuthology.orchestra.run.smithi008.stdout: "event": "waiting for subops from 2", 2023-08-01T19:54:37.338 INFO:teuthology.orchestra.run.smithi008.stdout: "time": "2023-08-01T19:54:29.657099+0000", 2023-08-01T19:54:37.338 INFO:teuthology.orchestra.run.smithi008.stdout: "duration": 0.000146241 2023-08-01T19:54:37.338 INFO:teuthology.orchestra.run.smithi008.stdout: }, 2023-08-01T19:54:37.339 INFO:teuthology.orchestra.run.smithi008.stdout: { 2023-08-01T19:54:37.339 INFO:teuthology.orchestra.run.smithi008.stdout: "event": "op_commit", 2023-08-01T19:54:37.339 INFO:teuthology.orchestra.run.smithi008.stdout: "time": "2023-08-01T19:54:29.659538+0000", 2023-08-01T19:54:37.339 INFO:teuthology.orchestra.run.smithi008.stdout: "duration": 0.0024387549999999999 2023-08-01T19:54:37.339 INFO:teuthology.orchestra.run.smithi008.stdout: }, 2023-08-01T19:54:37.339 INFO:teuthology.orchestra.run.smithi008.stdout: { 2023-08-01T19:54:37.339 INFO:teuthology.orchestra.run.smithi008.stdout: "event": "sub_op_commit_rec", 2023-08-01T19:54:37.339 INFO:teuthology.orchestra.run.smithi008.stdout: "time": "2023-08-01T19:54:29.668362+0000", 2023-08-01T19:54:37.340 INFO:teuthology.orchestra.run.smithi008.stdout: "duration": 0.0088243590000000004 2023-08-01T19:54:37.340 INFO:teuthology.orchestra.run.smithi008.stdout: }, 2023-08-01T19:54:37.340 INFO:teuthology.orchestra.run.smithi008.stdout: { 2023-08-01T19:54:37.340 INFO:teuthology.orchestra.run.smithi008.stdout: "event": "commit_sent", 2023-08-01T19:54:37.340 INFO:teuthology.orchestra.run.smithi008.stdout: "time": "2023-08-01T19:54:29.668409+0000", 2023-08-01T19:54:37.340 INFO:teuthology.orchestra.run.smithi008.stdout: "duration": 4.7246000000000001e-05 2023-08-01T19:54:37.340 INFO:teuthology.orchestra.run.smithi008.stdout: }, 2023-08-01T19:54:37.340 INFO:teuthology.orchestra.run.smithi008.stdout: { 2023-08-01T19:54:37.341 INFO:teuthology.orchestra.run.smithi008.stdout: "event": "done", 2023-08-01T19:54:37.341 INFO:teuthology.orchestra.run.smithi008.stdout: "time": "2023-08-01T19:54:29.668443+0000", 2023-08-01T19:54:37.341 INFO:teuthology.orchestra.run.smithi008.stdout: "duration": 3.3844999999999999e-05 2023-08-01T19:54:37.341 INFO:teuthology.orchestra.run.smithi008.stdout: } 2023-08-01T19:54:37.341 INFO:teuthology.orchestra.run.smithi008.stdout: ] 2023-08-01T19:54:37.341 INFO:teuthology.orchestra.run.smithi008.stdout: } 2023-08-01T19:54:37.341 INFO:teuthology.orchestra.run.smithi008.stdout: }, 2023-08-01T19:54:37.341 INFO:teuthology.orchestra.run.smithi008.stdout: { 2023-08-01T19:54:37.342 INFO:teuthology.orchestra.run.smithi008.stdout: "description": "osd_op(client.4668.0:20547 5.a 5:54001317:::benchmark_data_smithi006_114134_object20546:head [set-alloc-hint object_size 65536 write_size 65536,write 0~65536] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e23)", 2023-08-01T19:54:37.342 INFO:teuthology.orchestra.run.smithi008.stdout: "initiated_at": "2023-08-01T19:54:29.655560+0000", 2023-08-01T19:54:37.342 INFO:teuthology.orchestra.run.smithi008.stdout: "age": 7.5479163199999997, 2023-08-01T19:54:37.342 INFO:teuthology.orchestra.run.smithi008.stdout: "duration": 0.014929586999999999, 2023-08-01T19:54:37.342 INFO:teuthology.orchestra.run.smithi008.stdout: "type_data": { 2023-08-01T19:54:37.342 INFO:teuthology.orchestra.run.smithi008.stdout: "flag_point": "commit sent; apply or cleanup", 2023-08-01T19:54:37.342 INFO:teuthology.orchestra.run.smithi008.stdout: "client_info": { 2023-08-01T19:54:37.342 INFO:teuthology.orchestra.run.smithi008.stdout: "client": "client.4668", 2023-08-01T19:54:37.343 INFO:teuthology.orchestra.run.smithi008.stdout: "client_addr": "172.21.15.6:0/1709472247", 2023-08-01T19:54:37.343 INFO:teuthology.orchestra.run.smithi008.stdout: "tid": 20547 2023-08-01T19:54:37.343 INFO:teuthology.orchestra.run.smithi008.stdout: }, 2023-08-01T19:54:37.343 INFO:teuthology.orchestra.run.smithi008.stdout: "events": [ 2023-08-01T19:54:37.343 INFO:teuthology.orchestra.run.smithi008.stdout: { 2023-08-01T19:54:37.343 INFO:teuthology.orchestra.run.smithi008.stdout: "event": "initiated", 2023-08-01T19:54:37.343 INFO:teuthology.orchestra.run.smithi008.stdout: "time": "2023-08-01T19:54:29.655560+0000", 2023-08-01T19:54:37.343 INFO:teuthology.orchestra.run.smithi008.stdout: "duration": 0 2023-08-01T19:54:37.344 INFO:teuthology.orchestra.run.smithi008.stdout: }, 2023-08-01T19:54:37.344 INFO:teuthology.orchestra.run.smithi008.stdout: { 2023-08-01T19:54:37.344 INFO:teuthology.orchestra.run.smithi008.stdout: "event": "throttled", 2023-08-01T19:54:37.344 INFO:teuthology.orchestra.run.smithi008.stdout: "time": "2023-08-01T19:54:29.655560+0000", 2023-08-01T19:54:37.344 INFO:teuthology.orchestra.run.smithi008.stdout: "duration": 0 2023-08-01T19:54:37.344 INFO:teuthology.orchestra.run.smithi008.stdout: }, 2023-08-01T19:54:37.344 INFO:teuthology.orchestra.run.smithi008.stdout: { 2023-08-01T19:54:37.345 INFO:teuthology.orchestra.run.smithi008.stdout: "event": "header_read", 2023-08-01T19:54:37.345 INFO:teuthology.orchestra.run.smithi008.stdout: "time": "2023-08-01T19:54:29.655560+0000", 2023-08-01T19:54:37.345 INFO:teuthology.orchestra.run.smithi008.stdout: "duration": 4294967295.9999995 2023-08-01T19:54:37.345 INFO:teuthology.orchestra.run.smithi008.stdout: }, 2023-08-01T19:54:37.345 INFO:teuthology.orchestra.run.smithi008.stdout: { 2023-08-01T19:54:37.345 INFO:teuthology.orchestra.run.smithi008.stdout: "event": "all_read", 2023-08-01T19:54:37.345 INFO:teuthology.orchestra.run.smithi008.stdout: "time": "2023-08-01T19:54:29.655590+0000", 2023-08-01T19:54:37.345 INFO:teuthology.orchestra.run.smithi008.stdout: "duration": 3.0467000000000002e-05 2023-08-01T19:54:37.346 INFO:teuthology.orchestra.run.smithi008.stdout: }, 2023-08-01T19:54:37.346 INFO:teuthology.orchestra.run.smithi008.stdout: { 2023-08-01T19:54:37.346 INFO:teuthology.orchestra.run.smithi008.stdout: "event": "dispatched", 2023-08-01T19:54:37.346 INFO:teuthology.orchestra.run.smithi008.stdout: "time": "2023-08-01T19:54:29.655600+0000", 2023-08-01T19:54:37.346 INFO:teuthology.orchestra.run.smithi008.stdout: "duration": 1.0103e-05 2023-08-01T19:54:37.346 INFO:teuthology.orchestra.run.smithi008.stdout: }, 2023-08-01T19:54:37.346 INFO:teuthology.orchestra.run.smithi008.stdout: { 2023-08-01T19:54:37.346 INFO:teuthology.orchestra.run.smithi008.stdout: "event": "queued_for_pg", 2023-08-01T19:54:37.347 INFO:teuthology.orchestra.run.smithi008.stdout: "time": "2023-08-01T19:54:29.655605+0000", 2023-08-01T19:54:37.347 INFO:teuthology.orchestra.run.smithi008.stdout: "duration": 4.1860000000000002e-06 2023-08-01T19:54:37.347 INFO:teuthology.orchestra.run.smithi008.stdout: }, 2023-08-01T19:54:37.347 INFO:teuthology.orchestra.run.smithi008.stdout: { 2023-08-01T19:54:37.347 INFO:teuthology.orchestra.run.smithi008.stdout: "event": "reached_pg", 2023-08-01T19:54:37.347 INFO:teuthology.orchestra.run.smithi008.stdout: "time": "2023-08-01T19:54:29.657832+0000", 2023-08-01T19:54:37.347 INFO:teuthology.orchestra.run.smithi008.stdout: "duration": 0.0022275630000000001 2023-08-01T19:54:37.347 INFO:teuthology.orchestra.run.smithi008.stdout: }, 2023-08-01T19:54:37.348 INFO:teuthology.orchestra.run.smithi008.stdout: { 2023-08-01T19:54:37.348 INFO:teuthology.orchestra.run.smithi008.stdout: "event": "started", 2023-08-01T19:54:37.348 INFO:teuthology.orchestra.run.smithi008.stdout: "time": "2023-08-01T19:54:29.657927+0000", 2023-08-01T19:54:37.348 INFO:teuthology.orchestra.run.smithi008.stdout: "duration": 9.5390000000000007e-05 2023-08-01T19:54:37.348 INFO:teuthology.orchestra.run.smithi008.stdout: }, 2023-08-01T19:54:37.348 INFO:teuthology.orchestra.run.smithi008.stdout: { 2023-08-01T19:54:37.348 INFO:teuthology.orchestra.run.smithi008.stdout: "event": "waiting for subops from 2", 2023-08-01T19:54:37.348 INFO:teuthology.orchestra.run.smithi008.stdout: "time": "2023-08-01T19:54:29.658008+0000", 2023-08-01T19:54:37.349 INFO:teuthology.orchestra.run.smithi008.stdout: "duration": 8.0671000000000001e-05 2023-08-01T19:54:37.349 INFO:teuthology.orchestra.run.smithi008.stdout: }, 2023-08-01T19:54:37.349 INFO:teuthology.orchestra.run.smithi008.stdout: { 2023-08-01T19:54:37.349 INFO:teuthology.orchestra.run.smithi008.stdout: "event": "op_commit", 2023-08-01T19:54:37.349 INFO:teuthology.orchestra.run.smithi008.stdout: "time": "2023-08-01T19:54:29.659542+0000", 2023-08-01T19:54:37.349 INFO:teuthology.orchestra.run.smithi008.stdout: "duration": 0.0015343220000000001 2023-08-01T19:54:37.349 INFO:teuthology.orchestra.run.smithi008.stdout: }, 2023-08-01T19:54:37.349 INFO:teuthology.orchestra.run.smithi008.stdout: { 2023-08-01T19:54:37.350 INFO:teuthology.orchestra.run.smithi008.stdout: "event": "sub_op_commit_rec", 2023-08-01T19:54:37.350 INFO:teuthology.orchestra.run.smithi008.stdout: "time": "2023-08-01T19:54:29.670439+0000", 2023-08-01T19:54:37.350 INFO:teuthology.orchestra.run.smithi008.stdout: "duration": 0.010896874000000001 2023-08-01T19:54:37.350 INFO:teuthology.orchestra.run.smithi008.stdout: }, 2023-08-01T19:54:37.350 INFO:teuthology.orchestra.run.smithi008.stdout: { 2023-08-01T19:54:37.350 INFO:teuthology.orchestra.run.smithi008.stdout: "event": "commit_sent", 2023-08-01T19:54:37.350 INFO:teuthology.orchestra.run.smithi008.stdout: "time": "2023-08-01T19:54:29.670467+0000", 2023-08-01T19:54:37.350 INFO:teuthology.orchestra.run.smithi008.stdout: "duration": 2.7433999999999999e-05 2023-08-01T19:54:37.351 INFO:teuthology.orchestra.run.smithi008.stdout: }, 2023-08-01T19:54:37.351 INFO:teuthology.orchestra.run.smithi008.stdout: { 2023-08-01T19:54:37.351 INFO:teuthology.orchestra.run.smithi008.stdout: "event": "done", 2023-08-01T19:54:37.351 INFO:teuthology.orchestra.run.smithi008.stdout: "time": "2023-08-01T19:54:29.670490+0000", 2023-08-01T19:54:37.351 INFO:teuthology.orchestra.run.smithi008.stdout: "duration": 2.3076000000000001e-05 2023-08-01T19:54:37.351 INFO:teuthology.orchestra.run.smithi008.stdout: } 2023-08-01T19:54:37.351 INFO:teuthology.orchestra.run.smithi008.stdout: ] 2023-08-01T19:54:37.351 INFO:teuthology.orchestra.run.smithi008.stdout: } 2023-08-01T19:54:37.352 INFO:teuthology.orchestra.run.smithi008.stdout: }, 2023-08-01T19:54:37.352 INFO:teuthology.orchestra.run.smithi008.stdout: { 2023-08-01T19:54:37.352 INFO:teuthology.orchestra.run.smithi008.stdout: "description": "osd_op(client.4668.0:31686 5.c 5:3d4453fd:::benchmark_data_smithi006_114134_object31685:head [set-alloc-hint object_size 65536 write_size 65536,write 0~65536] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e24)", 2023-08-01T19:54:37.352 INFO:teuthology.orchestra.run.smithi008.stdout: "initiated_at": "2023-08-01T19:54:33.230374+0000", 2023-08-01T19:54:37.352 INFO:teuthology.orchestra.run.smithi008.stdout: "age": 3.9731024719999999, 2023-08-01T19:54:37.352 INFO:teuthology.orchestra.run.smithi008.stdout: "duration": 0.014786407, 2023-08-01T19:54:37.352 INFO:teuthology.orchestra.run.smithi008.stdout: "type_data": { 2023-08-01T19:54:37.353 INFO:teuthology.orchestra.run.smithi008.stdout: "flag_point": "commit sent; apply or cleanup", 2023-08-01T19:54:37.353 INFO:teuthology.orchestra.run.smithi008.stdout: "client_info": { 2023-08-01T19:54:37.353 INFO:teuthology.orchestra.run.smithi008.stdout: "client": "client.4668", 2023-08-01T19:54:37.353 INFO:teuthology.orchestra.run.smithi008.stdout: "client_addr": "172.21.15.6:0/1709472247", 2023-08-01T19:54:37.353 INFO:teuthology.orchestra.run.smithi008.stdout: "tid": 31686 2023-08-01T19:54:37.353 INFO:teuthology.orchestra.run.smithi008.stdout: }, 2023-08-01T19:54:37.353 INFO:teuthology.orchestra.run.smithi008.stdout: "events": [ 2023-08-01T19:54:37.353 INFO:teuthology.orchestra.run.smithi008.stdout: { 2023-08-01T19:54:37.354 INFO:teuthology.orchestra.run.smithi008.stdout: "event": "initiated", 2023-08-01T19:54:37.354 INFO:teuthology.orchestra.run.smithi008.stdout: "time": "2023-08-01T19:54:33.230374+0000", 2023-08-01T19:54:37.354 INFO:teuthology.orchestra.run.smithi008.stdout: "duration": 0 2023-08-01T19:54:37.354 INFO:teuthology.orchestra.run.smithi008.stdout: }, 2023-08-01T19:54:37.354 INFO:teuthology.orchestra.run.smithi008.stdout: { 2023-08-01T19:54:37.354 INFO:teuthology.orchestra.run.smithi008.stdout: "event": "throttled", 2023-08-01T19:54:37.354 INFO:teuthology.orchestra.run.smithi008.stdout: "time": "2023-08-01T19:54:33.230374+0000", 2023-08-01T19:54:37.355 INFO:teuthology.orchestra.run.smithi008.stdout: "duration": 0 2023-08-01T19:54:37.355 INFO:teuthology.orchestra.run.smithi008.stdout: }, 2023-08-01T19:54:37.355 INFO:teuthology.orchestra.run.smithi008.stdout: { 2023-08-01T19:54:37.355 INFO:teuthology.orchestra.run.smithi008.stdout: "event": "header_read", 2023-08-01T19:54:37.355 INFO:teuthology.orchestra.run.smithi008.stdout: "time": "2023-08-01T19:54:33.230373+0000", 2023-08-01T19:54:37.355 INFO:teuthology.orchestra.run.smithi008.stdout: "duration": 4294967295.999999 2023-08-01T19:54:37.355 INFO:teuthology.orchestra.run.smithi008.stdout: }, 2023-08-01T19:54:37.355 INFO:teuthology.orchestra.run.smithi008.stdout: { 2023-08-01T19:54:37.356 INFO:teuthology.orchestra.run.smithi008.stdout: "event": "all_read", 2023-08-01T19:54:37.356 INFO:teuthology.orchestra.run.smithi008.stdout: "time": "2023-08-01T19:54:33.230444+0000", 2023-08-01T19:54:37.356 INFO:teuthology.orchestra.run.smithi008.stdout: "duration": 7.0624999999999996e-05 2023-08-01T19:54:37.356 INFO:teuthology.orchestra.run.smithi008.stdout: }, 2023-08-01T19:54:37.356 INFO:teuthology.orchestra.run.smithi008.stdout: { 2023-08-01T19:54:37.356 INFO:teuthology.orchestra.run.smithi008.stdout: "event": "dispatched", 2023-08-01T19:54:37.356 INFO:teuthology.orchestra.run.smithi008.stdout: "time": "2023-08-01T19:54:33.230455+0000", 2023-08-01T19:54:37.356 INFO:teuthology.orchestra.run.smithi008.stdout: "duration": 1.0669000000000001e-05 2023-08-01T19:54:37.357 INFO:teuthology.orchestra.run.smithi008.stdout: }, 2023-08-01T19:54:37.357 INFO:teuthology.orchestra.run.smithi008.stdout: { 2023-08-01T19:54:37.357 INFO:teuthology.orchestra.run.smithi008.stdout: "event": "queued_for_pg", 2023-08-01T19:54:37.357 INFO:teuthology.orchestra.run.smithi008.stdout: "time": "2023-08-01T19:54:33.230461+0000", 2023-08-01T19:54:37.357 INFO:teuthology.orchestra.run.smithi008.stdout: "duration": 6.3099999999999997e-06 2023-08-01T19:54:37.357 INFO:teuthology.orchestra.run.smithi008.stdout: }, 2023-08-01T19:54:37.357 INFO:teuthology.orchestra.run.smithi008.stdout: { 2023-08-01T19:54:37.358 INFO:teuthology.orchestra.run.smithi008.stdout: "event": "reached_pg", 2023-08-01T19:54:37.358 INFO:teuthology.orchestra.run.smithi008.stdout: "time": "2023-08-01T19:54:33.230816+0000", 2023-08-01T19:54:37.358 INFO:teuthology.orchestra.run.smithi008.stdout: "duration": 0.000355161 2023-08-01T19:54:37.358 INFO:teuthology.orchestra.run.smithi008.stdout: }, 2023-08-01T19:54:37.358 INFO:teuthology.orchestra.run.smithi008.stdout: { 2023-08-01T19:54:37.358 INFO:teuthology.orchestra.run.smithi008.stdout: "event": "started", 2023-08-01T19:54:37.358 INFO:teuthology.orchestra.run.smithi008.stdout: "time": "2023-08-01T19:54:33.230925+0000", 2023-08-01T19:54:37.358 INFO:teuthology.orchestra.run.smithi008.stdout: "duration": 0.0001091 2023-08-01T19:54:37.359 INFO:teuthology.orchestra.run.smithi008.stdout: }, 2023-08-01T19:54:37.359 INFO:teuthology.orchestra.run.smithi008.stdout: { 2023-08-01T19:54:37.359 INFO:teuthology.orchestra.run.smithi008.stdout: "event": "waiting for subops from 1", 2023-08-01T19:54:37.359 INFO:teuthology.orchestra.run.smithi008.stdout: "time": "2023-08-01T19:54:33.231057+0000", 2023-08-01T19:54:37.359 INFO:teuthology.orchestra.run.smithi008.stdout: "duration": 0.000131932 2023-08-01T19:54:37.359 INFO:teuthology.orchestra.run.smithi008.stdout: }, 2023-08-01T19:54:37.359 INFO:teuthology.orchestra.run.smithi008.stdout: { 2023-08-01T19:54:37.360 INFO:teuthology.orchestra.run.smithi008.stdout: "event": "op_commit", 2023-08-01T19:54:37.360 INFO:teuthology.orchestra.run.smithi008.stdout: "time": "2023-08-01T19:54:33.234362+0000", 2023-08-01T19:54:37.360 INFO:teuthology.orchestra.run.smithi008.stdout: "duration": 0.0033053370000000002 2023-08-01T19:54:37.360 INFO:teuthology.orchestra.run.smithi008.stdout: }, 2023-08-01T19:54:37.360 INFO:teuthology.orchestra.run.smithi008.stdout: { 2023-08-01T19:54:37.360 INFO:teuthology.orchestra.run.smithi008.stdout: "event": "sub_op_commit_rec", 2023-08-01T19:54:37.360 INFO:teuthology.orchestra.run.smithi008.stdout: "time": "2023-08-01T19:54:33.245059+0000", 2023-08-01T19:54:37.361 INFO:teuthology.orchestra.run.smithi008.stdout: "duration": 0.010696463999999999 2023-08-01T19:54:37.361 INFO:teuthology.orchestra.run.smithi008.stdout: }, 2023-08-01T19:54:37.361 INFO:teuthology.orchestra.run.smithi008.stdout: { 2023-08-01T19:54:37.361 INFO:teuthology.orchestra.run.smithi008.stdout: "event": "commit_sent", 2023-08-01T19:54:37.361 INFO:teuthology.orchestra.run.smithi008.stdout: "time": "2023-08-01T19:54:33.245116+0000", 2023-08-01T19:54:37.361 INFO:teuthology.orchestra.run.smithi008.stdout: "duration": 5.6990000000000002e-05 2023-08-01T19:54:37.361 INFO:teuthology.orchestra.run.smithi008.stdout: }, 2023-08-01T19:54:37.361 INFO:teuthology.orchestra.run.smithi008.stdout: { 2023-08-01T19:54:37.362 INFO:teuthology.orchestra.run.smithi008.stdout: "event": "done", 2023-08-01T19:54:37.362 INFO:teuthology.orchestra.run.smithi008.stdout: "time": "2023-08-01T19:54:33.245161+0000", 2023-08-01T19:54:37.362 INFO:teuthology.orchestra.run.smithi008.stdout: "duration": 4.4625e-05 2023-08-01T19:54:37.362 INFO:teuthology.orchestra.run.smithi008.stdout: } 2023-08-01T19:54:37.362 INFO:teuthology.orchestra.run.smithi008.stdout: ] 2023-08-01T19:54:37.362 INFO:teuthology.orchestra.run.smithi008.stdout: } 2023-08-01T19:54:37.362 INFO:teuthology.orchestra.run.smithi008.stdout: }, 2023-08-01T19:54:37.362 INFO:teuthology.orchestra.run.smithi008.stdout: { 2023-08-01T19:54:37.363 INFO:teuthology.orchestra.run.smithi008.stdout: "description": "osd_op(client.4668.0:31690 5.3 5:ca8c6108:::benchmark_data_smithi006_114134_object31689:head [set-alloc-hint object_size 65536 write_size 65536,write 0~65536] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e24)", 2023-08-01T19:54:37.363 INFO:teuthology.orchestra.run.smithi008.stdout: "initiated_at": "2023-08-01T19:54:33.232204+0000", 2023-08-01T19:54:37.363 INFO:teuthology.orchestra.run.smithi008.stdout: "age": 3.9712724669999999, 2023-08-01T19:54:37.363 INFO:teuthology.orchestra.run.smithi008.stdout: "duration": 0.013756551000000001, 2023-08-01T19:54:37.363 INFO:teuthology.orchestra.run.smithi008.stdout: "type_data": { 2023-08-01T19:54:37.363 INFO:teuthology.orchestra.run.smithi008.stdout: "flag_point": "commit sent; apply or cleanup", 2023-08-01T19:54:37.363 INFO:teuthology.orchestra.run.smithi008.stdout: "client_info": { 2023-08-01T19:54:37.363 INFO:teuthology.orchestra.run.smithi008.stdout: "client": "client.4668", 2023-08-01T19:54:37.364 INFO:teuthology.orchestra.run.smithi008.stdout: "client_addr": "172.21.15.6:0/1709472247", 2023-08-01T19:54:37.364 INFO:teuthology.orchestra.run.smithi008.stdout: "tid": 31690 2023-08-01T19:54:37.364 INFO:teuthology.orchestra.run.smithi008.stdout: }, 2023-08-01T19:54:37.364 INFO:teuthology.orchestra.run.smithi008.stdout: "events": [ 2023-08-01T19:54:37.364 INFO:teuthology.orchestra.run.smithi008.stdout: { 2023-08-01T19:54:37.364 INFO:teuthology.orchestra.run.smithi008.stdout: "event": "initiated", 2023-08-01T19:54:37.364 INFO:teuthology.orchestra.run.smithi008.stdout: "time": "2023-08-01T19:54:33.232204+0000", 2023-08-01T19:54:37.365 INFO:teuthology.orchestra.run.smithi008.stdout: "duration": 0 2023-08-01T19:54:37.365 INFO:teuthology.orchestra.run.smithi008.stdout: }, 2023-08-01T19:54:37.365 INFO:teuthology.orchestra.run.smithi008.stdout: { 2023-08-01T19:54:37.365 INFO:teuthology.orchestra.run.smithi008.stdout: "event": "throttled", 2023-08-01T19:54:37.365 INFO:teuthology.orchestra.run.smithi008.stdout: "time": "2023-08-01T19:54:33.232204+0000", 2023-08-01T19:54:37.365 INFO:teuthology.orchestra.run.smithi008.stdout: "duration": 0 2023-08-01T19:54:37.365 INFO:teuthology.orchestra.run.smithi008.stdout: }, 2023-08-01T19:54:37.365 INFO:teuthology.orchestra.run.smithi008.stdout: { 2023-08-01T19:54:37.366 INFO:teuthology.orchestra.run.smithi008.stdout: "event": "header_read", 2023-08-01T19:54:37.366 INFO:teuthology.orchestra.run.smithi008.stdout: "time": "2023-08-01T19:54:33.232203+0000", 2023-08-01T19:54:37.366 INFO:teuthology.orchestra.run.smithi008.stdout: "duration": 4294967295.999999 2023-08-01T19:54:37.366 INFO:teuthology.orchestra.run.smithi008.stdout: }, 2023-08-01T19:54:37.366 INFO:teuthology.orchestra.run.smithi008.stdout: { 2023-08-01T19:54:37.366 INFO:teuthology.orchestra.run.smithi008.stdout: "event": "all_read", 2023-08-01T19:54:37.366 INFO:teuthology.orchestra.run.smithi008.stdout: "time": "2023-08-01T19:54:33.232289+0000", 2023-08-01T19:54:37.366 INFO:teuthology.orchestra.run.smithi008.stdout: "duration": 8.6006000000000003e-05 2023-08-01T19:54:37.367 INFO:teuthology.orchestra.run.smithi008.stdout: }, 2023-08-01T19:54:37.367 INFO:teuthology.orchestra.run.smithi008.stdout: { 2023-08-01T19:54:37.367 INFO:teuthology.orchestra.run.smithi008.stdout: "event": "dispatched", 2023-08-01T19:54:37.367 INFO:teuthology.orchestra.run.smithi008.stdout: "time": "2023-08-01T19:54:33.232299+0000", 2023-08-01T19:54:37.367 INFO:teuthology.orchestra.run.smithi008.stdout: "duration": 9.4520000000000003e-06 2023-08-01T19:54:37.367 INFO:teuthology.orchestra.run.smithi008.stdout: }, 2023-08-01T19:54:37.367 INFO:teuthology.orchestra.run.smithi008.stdout: { 2023-08-01T19:54:37.367 INFO:teuthology.orchestra.run.smithi008.stdout: "event": "queued_for_pg", 2023-08-01T19:54:37.368 INFO:teuthology.orchestra.run.smithi008.stdout: "time": "2023-08-01T19:54:33.232303+0000", 2023-08-01T19:54:37.368 INFO:teuthology.orchestra.run.smithi008.stdout: "duration": 4.16e-06 2023-08-01T19:54:37.368 INFO:teuthology.orchestra.run.smithi008.stdout: }, 2023-08-01T19:54:37.368 INFO:teuthology.orchestra.run.smithi008.stdout: { 2023-08-01T19:54:37.368 INFO:teuthology.orchestra.run.smithi008.stdout: "event": "reached_pg", 2023-08-01T19:54:37.368 INFO:teuthology.orchestra.run.smithi008.stdout: "time": "2023-08-01T19:54:33.232353+0000", 2023-08-01T19:54:37.368 INFO:teuthology.orchestra.run.smithi008.stdout: "duration": 5.0463000000000001e-05 2023-08-01T19:54:37.368 INFO:teuthology.orchestra.run.smithi008.stdout: }, 2023-08-01T19:54:37.369 INFO:teuthology.orchestra.run.smithi008.stdout: { 2023-08-01T19:54:37.369 INFO:teuthology.orchestra.run.smithi008.stdout: "event": "started", 2023-08-01T19:54:37.369 INFO:teuthology.orchestra.run.smithi008.stdout: "time": "2023-08-01T19:54:33.232488+0000", 2023-08-01T19:54:37.369 INFO:teuthology.orchestra.run.smithi008.stdout: "duration": 0.00013489400000000001 2023-08-01T19:54:37.369 INFO:teuthology.orchestra.run.smithi008.stdout: }, 2023-08-01T19:54:37.369 INFO:teuthology.orchestra.run.smithi008.stdout: { 2023-08-01T19:54:37.369 INFO:teuthology.orchestra.run.smithi008.stdout: "event": "waiting for subops from 1", 2023-08-01T19:54:37.369 INFO:teuthology.orchestra.run.smithi008.stdout: "time": "2023-08-01T19:54:33.232648+0000", 2023-08-01T19:54:37.370 INFO:teuthology.orchestra.run.smithi008.stdout: "duration": 0.000160311 2023-08-01T19:54:37.370 INFO:teuthology.orchestra.run.smithi008.stdout: }, 2023-08-01T19:54:37.370 INFO:teuthology.orchestra.run.smithi008.stdout: { 2023-08-01T19:54:37.370 INFO:teuthology.orchestra.run.smithi008.stdout: "event": "op_commit", 2023-08-01T19:54:37.370 INFO:teuthology.orchestra.run.smithi008.stdout: "time": "2023-08-01T19:54:33.234740+0000", 2023-08-01T19:54:37.370 INFO:teuthology.orchestra.run.smithi008.stdout: "duration": 0.0020919110000000001 2023-08-01T19:54:37.370 INFO:teuthology.orchestra.run.smithi008.stdout: }, 2023-08-01T19:54:37.371 INFO:teuthology.orchestra.run.smithi008.stdout: { 2023-08-01T19:54:37.371 INFO:teuthology.orchestra.run.smithi008.stdout: "event": "sub_op_commit_rec", 2023-08-01T19:54:37.371 INFO:teuthology.orchestra.run.smithi008.stdout: "time": "2023-08-01T19:54:33.245903+0000", 2023-08-01T19:54:37.371 INFO:teuthology.orchestra.run.smithi008.stdout: "duration": 0.011162208 2023-08-01T19:54:37.371 INFO:teuthology.orchestra.run.smithi008.stdout: }, 2023-08-01T19:54:37.371 INFO:teuthology.orchestra.run.smithi008.stdout: { 2023-08-01T19:54:37.371 INFO:teuthology.orchestra.run.smithi008.stdout: "event": "commit_sent", 2023-08-01T19:54:37.371 INFO:teuthology.orchestra.run.smithi008.stdout: "time": "2023-08-01T19:54:33.245939+0000", 2023-08-01T19:54:37.372 INFO:teuthology.orchestra.run.smithi008.stdout: "duration": 3.6179e-05 2023-08-01T19:54:37.372 INFO:teuthology.orchestra.run.smithi008.stdout: }, 2023-08-01T19:54:37.372 INFO:teuthology.orchestra.run.smithi008.stdout: { 2023-08-01T19:54:37.372 INFO:teuthology.orchestra.run.smithi008.stdout: "event": "done", 2023-08-01T19:54:37.372 INFO:teuthology.orchestra.run.smithi008.stdout: "time": "2023-08-01T19:54:33.245961+0000", 2023-08-01T19:54:37.372 INFO:teuthology.orchestra.run.smithi008.stdout: "duration": 2.1945000000000001e-05 2023-08-01T19:54:37.372 INFO:teuthology.orchestra.run.smithi008.stdout: } 2023-08-01T19:54:37.372 INFO:teuthology.orchestra.run.smithi008.stdout: ] 2023-08-01T19:54:37.373 INFO:teuthology.orchestra.run.smithi008.stdout: } 2023-08-01T19:54:37.373 INFO:teuthology.orchestra.run.smithi008.stdout: }, 2023-08-01T19:54:37.373 INFO:teuthology.orchestra.run.smithi008.stdout: { 2023-08-01T19:54:37.373 INFO:teuthology.orchestra.run.smithi008.stdout: "description": "osd_op(client.4668.0:31693 5.c 5:30f02129:::benchmark_data_smithi006_114134_object31692:head [set-alloc-hint object_size 65536 write_size 65536,write 0~65536] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e24)", 2023-08-01T19:54:37.373 INFO:teuthology.orchestra.run.smithi008.stdout: "initiated_at": "2023-08-01T19:54:33.233153+0000", 2023-08-01T19:54:37.373 INFO:teuthology.orchestra.run.smithi008.stdout: "age": 3.970323182, 2023-08-01T19:54:37.373 INFO:teuthology.orchestra.run.smithi008.stdout: "duration": 0.012691908999999999, 2023-08-01T19:54:37.373 INFO:teuthology.orchestra.run.smithi008.stdout: "type_data": { 2023-08-01T19:54:37.374 INFO:teuthology.orchestra.run.smithi008.stdout: "flag_point": "commit sent; apply or cleanup", 2023-08-01T19:54:37.374 INFO:teuthology.orchestra.run.smithi008.stdout: "client_info": { 2023-08-01T19:54:37.374 INFO:teuthology.orchestra.run.smithi008.stdout: "client": "client.4668", 2023-08-01T19:54:37.374 INFO:teuthology.orchestra.run.smithi008.stdout: "client_addr": "172.21.15.6:0/1709472247", 2023-08-01T19:54:37.374 INFO:teuthology.orchestra.run.smithi008.stdout: "tid": 31693 2023-08-01T19:54:37.374 INFO:teuthology.orchestra.run.smithi008.stdout: }, 2023-08-01T19:54:37.374 INFO:teuthology.orchestra.run.smithi008.stdout: "events": [ 2023-08-01T19:54:37.374 INFO:teuthology.orchestra.run.smithi008.stdout: { 2023-08-01T19:54:37.375 INFO:teuthology.orchestra.run.smithi008.stdout: "event": "initiated", 2023-08-01T19:54:37.375 INFO:teuthology.orchestra.run.smithi008.stdout: "time": "2023-08-01T19:54:33.233153+0000", 2023-08-01T19:54:37.375 INFO:teuthology.orchestra.run.smithi008.stdout: "duration": 0 2023-08-01T19:54:37.375 INFO:teuthology.orchestra.run.smithi008.stdout: }, 2023-08-01T19:54:37.375 INFO:teuthology.orchestra.run.smithi008.stdout: { 2023-08-01T19:54:37.375 INFO:teuthology.orchestra.run.smithi008.stdout: "event": "throttled", 2023-08-01T19:54:37.375 INFO:teuthology.orchestra.run.smithi008.stdout: "time": "2023-08-01T19:54:33.233153+0000", 2023-08-01T19:54:37.376 INFO:teuthology.orchestra.run.smithi008.stdout: "duration": 0 2023-08-01T19:54:37.376 INFO:teuthology.orchestra.run.smithi008.stdout: }, 2023-08-01T19:54:37.376 INFO:teuthology.orchestra.run.smithi008.stdout: { 2023-08-01T19:54:37.376 INFO:teuthology.orchestra.run.smithi008.stdout: "event": "header_read", 2023-08-01T19:54:37.376 INFO:teuthology.orchestra.run.smithi008.stdout: "time": "2023-08-01T19:54:33.233153+0000", 2023-08-01T19:54:37.376 INFO:teuthology.orchestra.run.smithi008.stdout: "duration": 4294967295.999999 2023-08-01T19:54:37.376 INFO:teuthology.orchestra.run.smithi008.stdout: }, 2023-08-01T19:54:37.376 INFO:teuthology.orchestra.run.smithi008.stdout: { 2023-08-01T19:54:37.377 INFO:teuthology.orchestra.run.smithi008.stdout: "event": "all_read", 2023-08-01T19:54:37.377 INFO:teuthology.orchestra.run.smithi008.stdout: "time": "2023-08-01T19:54:33.233307+0000", 2023-08-01T19:54:37.377 INFO:teuthology.orchestra.run.smithi008.stdout: "duration": 0.00015473799999999999 2023-08-01T19:54:37.377 INFO:teuthology.orchestra.run.smithi008.stdout: }, 2023-08-01T19:54:37.377 INFO:teuthology.orchestra.run.smithi008.stdout: { 2023-08-01T19:54:37.377 INFO:teuthology.orchestra.run.smithi008.stdout: "event": "dispatched", 2023-08-01T19:54:37.377 INFO:teuthology.orchestra.run.smithi008.stdout: "time": "2023-08-01T19:54:33.233320+0000", 2023-08-01T19:54:37.377 INFO:teuthology.orchestra.run.smithi008.stdout: "duration": 1.3098999999999999e-05 2023-08-01T19:54:37.378 INFO:teuthology.orchestra.run.smithi008.stdout: }, 2023-08-01T19:54:37.378 INFO:teuthology.orchestra.run.smithi008.stdout: { 2023-08-01T19:54:37.378 INFO:teuthology.orchestra.run.smithi008.stdout: "event": "queued_for_pg", 2023-08-01T19:54:37.378 INFO:teuthology.orchestra.run.smithi008.stdout: "time": "2023-08-01T19:54:33.233327+0000", 2023-08-01T19:54:37.378 INFO:teuthology.orchestra.run.smithi008.stdout: "duration": 6.5549999999999999e-06 2023-08-01T19:54:37.378 INFO:teuthology.orchestra.run.smithi008.stdout: }, 2023-08-01T19:54:37.378 INFO:teuthology.orchestra.run.smithi008.stdout: { 2023-08-01T19:54:37.378 INFO:teuthology.orchestra.run.smithi008.stdout: "event": "reached_pg", 2023-08-01T19:54:37.379 INFO:teuthology.orchestra.run.smithi008.stdout: "time": "2023-08-01T19:54:33.233367+0000", 2023-08-01T19:54:37.379 INFO:teuthology.orchestra.run.smithi008.stdout: "duration": 3.9675999999999998e-05 2023-08-01T19:54:37.379 INFO:teuthology.orchestra.run.smithi008.stdout: }, 2023-08-01T19:54:37.379 INFO:teuthology.orchestra.run.smithi008.stdout: { 2023-08-01T19:54:37.379 INFO:teuthology.orchestra.run.smithi008.stdout: "event": "started", 2023-08-01T19:54:37.379 INFO:teuthology.orchestra.run.smithi008.stdout: "time": "2023-08-01T19:54:33.233448+0000", 2023-08-01T19:54:37.379 INFO:teuthology.orchestra.run.smithi008.stdout: "duration": 8.1088999999999996e-05 2023-08-01T19:54:37.379 INFO:teuthology.orchestra.run.smithi008.stdout: }, 2023-08-01T19:54:37.380 INFO:teuthology.orchestra.run.smithi008.stdout: { 2023-08-01T19:54:37.380 INFO:teuthology.orchestra.run.smithi008.stdout: "event": "waiting for subops from 1", 2023-08-01T19:54:37.380 INFO:teuthology.orchestra.run.smithi008.stdout: "time": "2023-08-01T19:54:33.233527+0000", 2023-08-01T19:54:37.380 INFO:teuthology.orchestra.run.smithi008.stdout: "duration": 7.9419000000000007e-05 2023-08-01T19:54:37.380 INFO:teuthology.orchestra.run.smithi008.stdout: }, 2023-08-01T19:54:37.380 INFO:teuthology.orchestra.run.smithi008.stdout: { 2023-08-01T19:54:37.380 INFO:teuthology.orchestra.run.smithi008.stdout: "event": "op_commit", 2023-08-01T19:54:37.381 INFO:teuthology.orchestra.run.smithi008.stdout: "time": "2023-08-01T19:54:33.236217+0000", 2023-08-01T19:54:37.381 INFO:teuthology.orchestra.run.smithi008.stdout: "duration": 0.0026894140000000002 2023-08-01T19:54:37.381 INFO:teuthology.orchestra.run.smithi008.stdout: }, 2023-08-01T19:54:37.381 INFO:teuthology.orchestra.run.smithi008.stdout: { 2023-08-01T19:54:37.381 INFO:teuthology.orchestra.run.smithi008.stdout: "event": "sub_op_commit_rec", 2023-08-01T19:54:37.381 INFO:teuthology.orchestra.run.smithi008.stdout: "time": "2023-08-01T19:54:33.245777+0000", 2023-08-01T19:54:37.381 INFO:teuthology.orchestra.run.smithi008.stdout: "duration": 0.0095604350000000008 2023-08-01T19:54:37.381 INFO:teuthology.orchestra.run.smithi008.stdout: }, 2023-08-01T19:54:37.382 INFO:teuthology.orchestra.run.smithi008.stdout: { 2023-08-01T19:54:37.382 INFO:teuthology.orchestra.run.smithi008.stdout: "event": "commit_sent", 2023-08-01T19:54:37.382 INFO:teuthology.orchestra.run.smithi008.stdout: "time": "2023-08-01T19:54:33.245814+0000", 2023-08-01T19:54:37.382 INFO:teuthology.orchestra.run.smithi008.stdout: "duration": 3.7149e-05 2023-08-01T19:54:37.382 INFO:teuthology.orchestra.run.smithi008.stdout: }, 2023-08-01T19:54:37.382 INFO:teuthology.orchestra.run.smithi008.stdout: { 2023-08-01T19:54:37.382 INFO:teuthology.orchestra.run.smithi008.stdout: "event": "done", 2023-08-01T19:54:37.382 INFO:teuthology.orchestra.run.smithi008.stdout: "time": "2023-08-01T19:54:33.245845+0000", 2023-08-01T19:54:37.383 INFO:teuthology.orchestra.run.smithi008.stdout: "duration": 3.1164000000000002e-05 2023-08-01T19:54:37.383 INFO:teuthology.orchestra.run.smithi008.stdout: } 2023-08-01T19:54:37.383 INFO:teuthology.orchestra.run.smithi008.stdout: ] 2023-08-01T19:54:37.383 INFO:teuthology.orchestra.run.smithi008.stdout: } 2023-08-01T19:54:37.383 INFO:teuthology.orchestra.run.smithi008.stdout: }, 2023-08-01T19:54:37.383 INFO:teuthology.orchestra.run.smithi008.stdout: { 2023-08-01T19:54:37.383 INFO:teuthology.orchestra.run.smithi008.stdout: "description": "osd_op(client.4668.0:31699 5.c 5:3c02dd19:::benchmark_data_smithi006_114134_object31698:head [set-alloc-hint object_size 65536 write_size 65536,write 0~65536] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e24)", 2023-08-01T19:54:37.383 INFO:teuthology.orchestra.run.smithi008.stdout: "initiated_at": "2023-08-01T19:54:33.234930+0000", 2023-08-01T19:54:37.384 INFO:teuthology.orchestra.run.smithi008.stdout: "age": 3.9685462, 2023-08-01T19:54:37.384 INFO:teuthology.orchestra.run.smithi008.stdout: "duration": 0.012766306999999999, 2023-08-01T19:54:37.384 INFO:teuthology.orchestra.run.smithi008.stdout: "type_data": { 2023-08-01T19:54:37.384 INFO:teuthology.orchestra.run.smithi008.stdout: "flag_point": "commit sent; apply or cleanup", 2023-08-01T19:54:37.384 INFO:teuthology.orchestra.run.smithi008.stdout: "client_info": { 2023-08-01T19:54:37.384 INFO:teuthology.orchestra.run.smithi008.stdout: "client": "client.4668", 2023-08-01T19:54:37.384 INFO:teuthology.orchestra.run.smithi008.stdout: "client_addr": "172.21.15.6:0/1709472247", 2023-08-01T19:54:37.385 INFO:teuthology.orchestra.run.smithi008.stdout: "tid": 31699 2023-08-01T19:54:37.385 INFO:teuthology.orchestra.run.smithi008.stdout: }, 2023-08-01T19:54:37.385 INFO:teuthology.orchestra.run.smithi008.stdout: "events": [ 2023-08-01T19:54:37.385 INFO:teuthology.orchestra.run.smithi008.stdout: { 2023-08-01T19:54:37.385 INFO:teuthology.orchestra.run.smithi008.stdout: "event": "initiated", 2023-08-01T19:54:37.385 INFO:teuthology.orchestra.run.smithi008.stdout: "time": "2023-08-01T19:54:33.234930+0000", 2023-08-01T19:54:37.385 INFO:teuthology.orchestra.run.smithi008.stdout: "duration": 0 2023-08-01T19:54:37.385 INFO:teuthology.orchestra.run.smithi008.stdout: }, 2023-08-01T19:54:37.386 INFO:teuthology.orchestra.run.smithi008.stdout: { 2023-08-01T19:54:37.386 INFO:teuthology.orchestra.run.smithi008.stdout: "event": "throttled", 2023-08-01T19:54:37.386 INFO:teuthology.orchestra.run.smithi008.stdout: "time": "2023-08-01T19:54:33.234930+0000", 2023-08-01T19:54:37.386 INFO:teuthology.orchestra.run.smithi008.stdout: "duration": 0 2023-08-01T19:54:37.386 INFO:teuthology.orchestra.run.smithi008.stdout: }, 2023-08-01T19:54:37.386 INFO:teuthology.orchestra.run.smithi008.stdout: { 2023-08-01T19:54:37.386 INFO:teuthology.orchestra.run.smithi008.stdout: "event": "header_read", 2023-08-01T19:54:37.386 INFO:teuthology.orchestra.run.smithi008.stdout: "time": "2023-08-01T19:54:33.234930+0000", 2023-08-01T19:54:37.387 INFO:teuthology.orchestra.run.smithi008.stdout: "duration": 4294967295.9999995 2023-08-01T19:54:37.387 INFO:teuthology.orchestra.run.smithi008.stdout: }, 2023-08-01T19:54:37.387 INFO:teuthology.orchestra.run.smithi008.stdout: { 2023-08-01T19:54:37.387 INFO:teuthology.orchestra.run.smithi008.stdout: "event": "all_read", 2023-08-01T19:54:37.387 INFO:teuthology.orchestra.run.smithi008.stdout: "time": "2023-08-01T19:54:33.234957+0000", 2023-08-01T19:54:37.387 INFO:teuthology.orchestra.run.smithi008.stdout: "duration": 2.7104999999999999e-05 2023-08-01T19:54:37.387 INFO:teuthology.orchestra.run.smithi008.stdout: }, 2023-08-01T19:54:37.387 INFO:teuthology.orchestra.run.smithi008.stdout: { 2023-08-01T19:54:37.388 INFO:teuthology.orchestra.run.smithi008.stdout: "event": "dispatched", 2023-08-01T19:54:37.388 INFO:teuthology.orchestra.run.smithi008.stdout: "time": "2023-08-01T19:54:33.234964+0000", 2023-08-01T19:54:37.388 INFO:teuthology.orchestra.run.smithi008.stdout: "duration": 7.1500000000000002e-06 2023-08-01T19:54:37.388 INFO:teuthology.orchestra.run.smithi008.stdout: }, 2023-08-01T19:54:37.388 INFO:teuthology.orchestra.run.smithi008.stdout: { 2023-08-01T19:54:37.388 INFO:teuthology.orchestra.run.smithi008.stdout: "event": "queued_for_pg", 2023-08-01T19:54:37.388 INFO:teuthology.orchestra.run.smithi008.stdout: "time": "2023-08-01T19:54:33.234969+0000", 2023-08-01T19:54:37.389 INFO:teuthology.orchestra.run.smithi008.stdout: "duration": 5.1139999999999997e-06 2023-08-01T19:54:37.389 INFO:teuthology.orchestra.run.smithi008.stdout: }, 2023-08-01T19:54:37.389 INFO:teuthology.orchestra.run.smithi008.stdout: { 2023-08-01T19:54:37.389 INFO:teuthology.orchestra.run.smithi008.stdout: "event": "reached_pg", 2023-08-01T19:54:37.389 INFO:teuthology.orchestra.run.smithi008.stdout: "time": "2023-08-01T19:54:33.235000+0000", 2023-08-01T19:54:37.389 INFO:teuthology.orchestra.run.smithi008.stdout: "duration": 3.0565999999999998e-05 2023-08-01T19:54:37.389 INFO:teuthology.orchestra.run.smithi008.stdout: }, 2023-08-01T19:54:37.390 INFO:teuthology.orchestra.run.smithi008.stdout: { 2023-08-01T19:54:37.390 INFO:teuthology.orchestra.run.smithi008.stdout: "event": "started", 2023-08-01T19:54:37.390 INFO:teuthology.orchestra.run.smithi008.stdout: "time": "2023-08-01T19:54:33.235109+0000", 2023-08-01T19:54:37.390 INFO:teuthology.orchestra.run.smithi008.stdout: "duration": 0.000109122 2023-08-01T19:54:37.390 INFO:teuthology.orchestra.run.smithi008.stdout: }, 2023-08-01T19:54:37.390 INFO:teuthology.orchestra.run.smithi008.stdout: { 2023-08-01T19:54:37.390 INFO:teuthology.orchestra.run.smithi008.stdout: "event": "waiting for subops from 1", 2023-08-01T19:54:37.390 INFO:teuthology.orchestra.run.smithi008.stdout: "time": "2023-08-01T19:54:33.235230+0000", 2023-08-01T19:54:37.391 INFO:teuthology.orchestra.run.smithi008.stdout: "duration": 0.00012136700000000001 2023-08-01T19:54:37.391 INFO:teuthology.orchestra.run.smithi008.stdout: }, 2023-08-01T19:54:37.391 INFO:teuthology.orchestra.run.smithi008.stdout: { 2023-08-01T19:54:37.391 INFO:teuthology.orchestra.run.smithi008.stdout: "event": "op_commit", 2023-08-01T19:54:37.391 INFO:teuthology.orchestra.run.smithi008.stdout: "time": "2023-08-01T19:54:33.238026+0000", 2023-08-01T19:54:37.391 INFO:teuthology.orchestra.run.smithi008.stdout: "duration": 0.0027958409999999999 2023-08-01T19:54:37.391 INFO:teuthology.orchestra.run.smithi008.stdout: }, 2023-08-01T19:54:37.391 INFO:teuthology.orchestra.run.smithi008.stdout: { 2023-08-01T19:54:37.392 INFO:teuthology.orchestra.run.smithi008.stdout: "event": "sub_op_commit_rec", 2023-08-01T19:54:37.392 INFO:teuthology.orchestra.run.smithi008.stdout: "time": "2023-08-01T19:54:33.247618+0000", 2023-08-01T19:54:37.392 INFO:teuthology.orchestra.run.smithi008.stdout: "duration": 0.0095918600000000007 2023-08-01T19:54:37.392 INFO:teuthology.orchestra.run.smithi008.stdout: }, 2023-08-01T19:54:37.392 INFO:teuthology.orchestra.run.smithi008.stdout: { 2023-08-01T19:54:37.392 INFO:teuthology.orchestra.run.smithi008.stdout: "event": "commit_sent", 2023-08-01T19:54:37.392 INFO:teuthology.orchestra.run.smithi008.stdout: "time": "2023-08-01T19:54:33.247664+0000", 2023-08-01T19:54:37.393 INFO:teuthology.orchestra.run.smithi008.stdout: "duration": 4.6414e-05 2023-08-01T19:54:37.393 INFO:teuthology.orchestra.run.smithi008.stdout: }, 2023-08-01T19:54:37.393 INFO:teuthology.orchestra.run.smithi008.stdout: { 2023-08-01T19:54:37.393 INFO:teuthology.orchestra.run.smithi008.stdout: "event": "done", 2023-08-01T19:54:37.393 INFO:teuthology.orchestra.run.smithi008.stdout: "time": "2023-08-01T19:54:33.247697+0000", 2023-08-01T19:54:37.393 INFO:teuthology.orchestra.run.smithi008.stdout: "duration": 3.2385000000000002e-05 2023-08-01T19:54:37.393 INFO:teuthology.orchestra.run.smithi008.stdout: } 2023-08-01T19:54:37.393 INFO:teuthology.orchestra.run.smithi008.stdout: ] 2023-08-01T19:54:37.394 INFO:teuthology.orchestra.run.smithi008.stdout: } 2023-08-01T19:54:37.394 INFO:teuthology.orchestra.run.smithi008.stdout: }, 2023-08-01T19:54:37.394 INFO:teuthology.orchestra.run.smithi008.stdout: { 2023-08-01T19:54:37.394 INFO:teuthology.orchestra.run.smithi008.stdout: "description": "osd_op(client.4668.0:33955 5.a 5:5d940260:::benchmark_data_smithi006_114134_object33954:head [set-alloc-hint object_size 65536 write_size 65536,write 0~65536] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e24)", 2023-08-01T19:54:37.394 INFO:teuthology.orchestra.run.smithi008.stdout: "initiated_at": "2023-08-01T19:54:34.009597+0000", 2023-08-01T19:54:37.394 INFO:teuthology.orchestra.run.smithi008.stdout: "age": 3.1938793209999998, 2023-08-01T19:54:37.394 INFO:teuthology.orchestra.run.smithi008.stdout: "duration": 0.012985946999999999, 2023-08-01T19:54:37.394 INFO:teuthology.orchestra.run.smithi008.stdout: "type_data": { 2023-08-01T19:54:37.395 INFO:teuthology.orchestra.run.smithi008.stdout: "flag_point": "commit sent; apply or cleanup", 2023-08-01T19:54:37.395 INFO:teuthology.orchestra.run.smithi008.stdout: "client_info": { 2023-08-01T19:54:37.395 INFO:teuthology.orchestra.run.smithi008.stdout: "client": "client.4668", 2023-08-01T19:54:37.395 INFO:teuthology.orchestra.run.smithi008.stdout: "client_addr": "172.21.15.6:0/1709472247", 2023-08-01T19:54:37.395 INFO:teuthology.orchestra.run.smithi008.stdout: "tid": 33955 2023-08-01T19:54:37.395 INFO:teuthology.orchestra.run.smithi008.stdout: }, 2023-08-01T19:54:37.395 INFO:teuthology.orchestra.run.smithi008.stdout: "events": [ 2023-08-01T19:54:37.395 INFO:teuthology.orchestra.run.smithi008.stdout: { 2023-08-01T19:54:37.396 INFO:teuthology.orchestra.run.smithi008.stdout: "event": "initiated", 2023-08-01T19:54:37.396 INFO:teuthology.orchestra.run.smithi008.stdout: "time": "2023-08-01T19:54:34.009597+0000", 2023-08-01T19:54:37.396 INFO:teuthology.orchestra.run.smithi008.stdout: "duration": 0 2023-08-01T19:54:37.396 INFO:teuthology.orchestra.run.smithi008.stdout: }, 2023-08-01T19:54:37.396 INFO:teuthology.orchestra.run.smithi008.stdout: { 2023-08-01T19:54:37.396 INFO:teuthology.orchestra.run.smithi008.stdout: "event": "throttled", 2023-08-01T19:54:37.396 INFO:teuthology.orchestra.run.smithi008.stdout: "time": "2023-08-01T19:54:34.009597+0000", 2023-08-01T19:54:37.396 INFO:teuthology.orchestra.run.smithi008.stdout: "duration": 0 2023-08-01T19:54:37.397 INFO:teuthology.orchestra.run.smithi008.stdout: }, 2023-08-01T19:54:37.397 INFO:teuthology.orchestra.run.smithi008.stdout: { 2023-08-01T19:54:37.397 INFO:teuthology.orchestra.run.smithi008.stdout: "event": "header_read", 2023-08-01T19:54:37.397 INFO:teuthology.orchestra.run.smithi008.stdout: "time": "2023-08-01T19:54:34.009596+0000", 2023-08-01T19:54:37.397 INFO:teuthology.orchestra.run.smithi008.stdout: "duration": 4294967295.999999 2023-08-01T19:54:37.397 INFO:teuthology.orchestra.run.smithi008.stdout: }, 2023-08-01T19:54:37.397 INFO:teuthology.orchestra.run.smithi008.stdout: { 2023-08-01T19:54:37.397 INFO:teuthology.orchestra.run.smithi008.stdout: "event": "all_read", 2023-08-01T19:54:37.398 INFO:teuthology.orchestra.run.smithi008.stdout: "time": "2023-08-01T19:54:34.009708+0000", 2023-08-01T19:54:37.398 INFO:teuthology.orchestra.run.smithi008.stdout: "duration": 0.000111709 2023-08-01T19:54:37.398 INFO:teuthology.orchestra.run.smithi008.stdout: }, 2023-08-01T19:54:37.398 INFO:teuthology.orchestra.run.smithi008.stdout: { 2023-08-01T19:54:37.398 INFO:teuthology.orchestra.run.smithi008.stdout: "event": "dispatched", 2023-08-01T19:54:37.398 INFO:teuthology.orchestra.run.smithi008.stdout: "time": "2023-08-01T19:54:34.009719+0000", 2023-08-01T19:54:37.398 INFO:teuthology.orchestra.run.smithi008.stdout: "duration": 1.0705e-05 2023-08-01T19:54:37.398 INFO:teuthology.orchestra.run.smithi008.stdout: }, 2023-08-01T19:54:37.399 INFO:teuthology.orchestra.run.smithi008.stdout: { 2023-08-01T19:54:37.399 INFO:teuthology.orchestra.run.smithi008.stdout: "event": "queued_for_pg", 2023-08-01T19:54:37.399 INFO:teuthology.orchestra.run.smithi008.stdout: "time": "2023-08-01T19:54:34.009724+0000", 2023-08-01T19:54:37.399 INFO:teuthology.orchestra.run.smithi008.stdout: "duration": 5.0150000000000003e-06 2023-08-01T19:54:37.399 INFO:teuthology.orchestra.run.smithi008.stdout: }, 2023-08-01T19:54:37.399 INFO:teuthology.orchestra.run.smithi008.stdout: { 2023-08-01T19:54:37.399 INFO:teuthology.orchestra.run.smithi008.stdout: "event": "reached_pg", 2023-08-01T19:54:37.400 INFO:teuthology.orchestra.run.smithi008.stdout: "time": "2023-08-01T19:54:34.009761+0000", 2023-08-01T19:54:37.400 INFO:teuthology.orchestra.run.smithi008.stdout: "duration": 3.7378e-05 2023-08-01T19:54:37.400 INFO:teuthology.orchestra.run.smithi008.stdout: }, 2023-08-01T19:54:37.400 INFO:teuthology.orchestra.run.smithi008.stdout: { 2023-08-01T19:54:37.400 INFO:teuthology.orchestra.run.smithi008.stdout: "event": "started", 2023-08-01T19:54:37.400 INFO:teuthology.orchestra.run.smithi008.stdout: "time": "2023-08-01T19:54:34.009844+0000", 2023-08-01T19:54:37.400 INFO:teuthology.orchestra.run.smithi008.stdout: "duration": 8.3164999999999994e-05 2023-08-01T19:54:37.400 INFO:teuthology.orchestra.run.smithi008.stdout: }, 2023-08-01T19:54:37.401 INFO:teuthology.orchestra.run.smithi008.stdout: { 2023-08-01T19:54:37.401 INFO:teuthology.orchestra.run.smithi008.stdout: "event": "waiting for subops from 2", 2023-08-01T19:54:37.401 INFO:teuthology.orchestra.run.smithi008.stdout: "time": "2023-08-01T19:54:34.009958+0000", 2023-08-01T19:54:37.401 INFO:teuthology.orchestra.run.smithi008.stdout: "duration": 0.000113985 2023-08-01T19:54:37.401 INFO:teuthology.orchestra.run.smithi008.stdout: }, 2023-08-01T19:54:37.401 INFO:teuthology.orchestra.run.smithi008.stdout: { 2023-08-01T19:54:37.401 INFO:teuthology.orchestra.run.smithi008.stdout: "event": "op_commit", 2023-08-01T19:54:37.402 INFO:tasks.radosbench.radosbench.0.smithi006.stdout: 13 16 42742 42726 205.398 155.375 0.00706097 0.00486551 2023-08-01T19:54:37.403 INFO:tasks.ceph.osd.2.smithi155.stderr:2023-08-01T19:54:37.401+0000 7faa5c6ac700 -1 received signal: Hangup from /usr/bin/python3 /bin/daemon-helper kill ceph-osd -f --cluster ceph -i 2 (PID: 111337) UID: 0 2023-08-01T19:54:37.403 INFO:teuthology.orchestra.run.smithi008.stdout: "time": "2023-08-01T19:54:34.012149+0000", 2023-08-01T19:54:37.404 INFO:teuthology.orchestra.run.smithi008.stdout: "duration": 0.0021906590000000002 2023-08-01T19:54:37.404 INFO:teuthology.orchestra.run.smithi008.stdout: }, 2023-08-01T19:54:37.404 INFO:teuthology.orchestra.run.smithi008.stdout: { 2023-08-01T19:54:37.404 INFO:teuthology.orchestra.run.smithi008.stdout: "event": "sub_op_commit_rec", 2023-08-01T19:54:37.404 INFO:teuthology.orchestra.run.smithi008.stdout: "time": "2023-08-01T19:54:34.022492+0000", 2023-08-01T19:54:37.404 INFO:teuthology.orchestra.run.smithi008.stdout: "duration": 0.01034263 2023-08-01T19:54:37.404 INFO:teuthology.orchestra.run.smithi008.stdout: }, 2023-08-01T19:54:37.404 INFO:teuthology.orchestra.run.smithi008.stdout: { 2023-08-01T19:54:37.405 INFO:teuthology.orchestra.run.smithi008.stdout: "event": "commit_sent", 2023-08-01T19:54:37.405 INFO:teuthology.orchestra.run.smithi008.stdout: "time": "2023-08-01T19:54:34.022545+0000", 2023-08-01T19:54:37.405 INFO:teuthology.orchestra.run.smithi008.stdout: "duration": 5.3084000000000002e-05 2023-08-01T19:54:37.405 INFO:teuthology.orchestra.run.smithi008.stdout: }, 2023-08-01T19:54:37.405 INFO:teuthology.orchestra.run.smithi008.stdout: { 2023-08-01T19:54:37.405 INFO:teuthology.orchestra.run.smithi008.stdout: "event": "done", 2023-08-01T19:54:37.405 INFO:teuthology.orchestra.run.smithi008.stdout: "time": "2023-08-01T19:54:34.022583+0000", 2023-08-01T19:54:37.406 INFO:teuthology.orchestra.run.smithi008.stdout: "duration": 3.8384999999999999e-05 2023-08-01T19:54:37.406 INFO:teuthology.orchestra.run.smithi008.stdout: } 2023-08-01T19:54:37.406 INFO:teuthology.orchestra.run.smithi008.stdout: ] 2023-08-01T19:54:37.406 INFO:teuthology.orchestra.run.smithi008.stdout: } 2023-08-01T19:54:37.406 INFO:teuthology.orchestra.run.smithi008.stdout: }, 2023-08-01T19:54:37.406 INFO:teuthology.orchestra.run.smithi008.stdout: { 2023-08-01T19:54:37.406 INFO:teuthology.orchestra.run.smithi008.stdout: "description": "osd_op(client.4668.0:41536 5.3 5:c62c0060:::benchmark_data_smithi006_114134_object41535:head [set-alloc-hint object_size 65536 write_size 65536,write 0~65536] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e25)", 2023-08-01T19:54:37.406 INFO:teuthology.orchestra.run.smithi008.stdout: "initiated_at": "2023-08-01T19:54:36.819258+0000", 2023-08-01T19:54:37.407 INFO:teuthology.orchestra.run.smithi008.stdout: "age": 0.38421878199999998, 2023-08-01T19:54:37.407 INFO:teuthology.orchestra.run.smithi008.stdout: "duration": 0.012931481, 2023-08-01T19:54:37.407 INFO:teuthology.orchestra.run.smithi008.stdout: "type_data": { 2023-08-01T19:54:37.407 INFO:teuthology.orchestra.run.smithi008.stdout: "flag_point": "commit sent; apply or cleanup", 2023-08-01T19:54:37.407 INFO:teuthology.orchestra.run.smithi008.stdout: "client_info": { 2023-08-01T19:54:37.407 INFO:teuthology.orchestra.run.smithi008.stdout: "client": "client.4668", 2023-08-01T19:54:37.407 INFO:teuthology.orchestra.run.smithi008.stdout: "client_addr": "172.21.15.6:0/1709472247", 2023-08-01T19:54:37.407 INFO:teuthology.orchestra.run.smithi008.stdout: "tid": 41536 2023-08-01T19:54:37.408 INFO:teuthology.orchestra.run.smithi008.stdout: }, 2023-08-01T19:54:37.408 INFO:teuthology.orchestra.run.smithi008.stdout: "events": [ 2023-08-01T19:54:37.408 INFO:teuthology.orchestra.run.smithi008.stdout: { 2023-08-01T19:54:37.408 INFO:teuthology.orchestra.run.smithi008.stdout: "event": "initiated", 2023-08-01T19:54:37.408 INFO:teuthology.orchestra.run.smithi008.stdout: "time": "2023-08-01T19:54:36.819258+0000", 2023-08-01T19:54:37.408 INFO:teuthology.orchestra.run.smithi008.stdout: "duration": 0 2023-08-01T19:54:37.408 INFO:teuthology.orchestra.run.smithi008.stdout: }, 2023-08-01T19:54:37.409 INFO:teuthology.orchestra.run.smithi008.stdout: { 2023-08-01T19:54:37.409 INFO:teuthology.orchestra.run.smithi008.stdout: "event": "throttled", 2023-08-01T19:54:37.409 INFO:teuthology.orchestra.run.smithi008.stdout: "time": "2023-08-01T19:54:36.819258+0000", 2023-08-01T19:54:37.409 INFO:teuthology.orchestra.run.smithi008.stdout: "duration": 0 2023-08-01T19:54:37.409 INFO:teuthology.orchestra.run.smithi008.stdout: }, 2023-08-01T19:54:37.409 INFO:teuthology.orchestra.run.smithi008.stdout: { 2023-08-01T19:54:37.409 INFO:teuthology.orchestra.run.smithi008.stdout: "event": "header_read", 2023-08-01T19:54:37.409 INFO:teuthology.orchestra.run.smithi008.stdout: "time": "2023-08-01T19:54:36.819256+0000", 2023-08-01T19:54:37.410 INFO:teuthology.orchestra.run.smithi008.stdout: "duration": 4294967295.9999986 2023-08-01T19:54:37.410 INFO:teuthology.orchestra.run.smithi008.stdout: }, 2023-08-01T19:54:37.410 INFO:teuthology.orchestra.run.smithi008.stdout: { 2023-08-01T19:54:37.410 INFO:teuthology.orchestra.run.smithi008.stdout: "event": "all_read", 2023-08-01T19:54:37.410 INFO:teuthology.orchestra.run.smithi008.stdout: "time": "2023-08-01T19:54:36.819357+0000", 2023-08-01T19:54:37.410 INFO:teuthology.orchestra.run.smithi008.stdout: "duration": 0.000100617 2023-08-01T19:54:37.410 INFO:teuthology.orchestra.run.smithi008.stdout: }, 2023-08-01T19:54:37.410 INFO:teuthology.orchestra.run.smithi008.stdout: { 2023-08-01T19:54:37.411 INFO:teuthology.orchestra.run.smithi008.stdout: "event": "dispatched", 2023-08-01T19:54:37.411 INFO:teuthology.orchestra.run.smithi008.stdout: "time": "2023-08-01T19:54:36.819369+0000", 2023-08-01T19:54:37.411 INFO:teuthology.orchestra.run.smithi008.stdout: "duration": 1.2046e-05 2023-08-01T19:54:37.411 INFO:teuthology.orchestra.run.smithi008.stdout: }, 2023-08-01T19:54:37.411 INFO:teuthology.orchestra.run.smithi008.stdout: { 2023-08-01T19:54:37.411 INFO:teuthology.orchestra.run.smithi008.stdout: "event": "queued_for_pg", 2023-08-01T19:54:37.411 INFO:teuthology.orchestra.run.smithi008.stdout: "time": "2023-08-01T19:54:36.819377+0000", 2023-08-01T19:54:37.411 INFO:teuthology.orchestra.run.smithi008.stdout: "duration": 7.9379999999999992e-06 2023-08-01T19:54:37.412 INFO:teuthology.orchestra.run.smithi008.stdout: }, 2023-08-01T19:54:37.412 INFO:teuthology.orchestra.run.smithi008.stdout: { 2023-08-01T19:54:37.412 INFO:teuthology.orchestra.run.smithi008.stdout: "event": "reached_pg", 2023-08-01T19:54:37.412 INFO:teuthology.orchestra.run.smithi008.stdout: "time": "2023-08-01T19:54:36.822494+0000", 2023-08-01T19:54:37.412 INFO:teuthology.orchestra.run.smithi008.stdout: "duration": 0.0031173770000000002 2023-08-01T19:54:37.412 INFO:teuthology.orchestra.run.smithi008.stdout: }, 2023-08-01T19:54:37.412 INFO:teuthology.orchestra.run.smithi008.stdout: { 2023-08-01T19:54:37.412 INFO:teuthology.orchestra.run.smithi008.stdout: "event": "started", 2023-08-01T19:54:37.413 INFO:teuthology.orchestra.run.smithi008.stdout: "time": "2023-08-01T19:54:36.822659+0000", 2023-08-01T19:54:37.413 INFO:teuthology.orchestra.run.smithi008.stdout: "duration": 0.00016432900000000001 2023-08-01T19:54:37.413 INFO:teuthology.orchestra.run.smithi008.stdout: }, 2023-08-01T19:54:37.413 INFO:teuthology.orchestra.run.smithi008.stdout: { 2023-08-01T19:54:37.413 INFO:teuthology.orchestra.run.smithi008.stdout: "event": "waiting for subops from 1", 2023-08-01T19:54:37.413 INFO:teuthology.orchestra.run.smithi008.stdout: "time": "2023-08-01T19:54:36.822837+0000", 2023-08-01T19:54:37.413 INFO:teuthology.orchestra.run.smithi008.stdout: "duration": 0.000178596 2023-08-01T19:54:37.414 INFO:teuthology.orchestra.run.smithi008.stdout: }, 2023-08-01T19:54:37.414 INFO:teuthology.orchestra.run.smithi008.stdout: { 2023-08-01T19:54:37.414 INFO:teuthology.orchestra.run.smithi008.stdout: "event": "op_commit", 2023-08-01T19:54:37.414 INFO:teuthology.orchestra.run.smithi008.stdout: "time": "2023-08-01T19:54:36.828003+0000", 2023-08-01T19:54:37.414 INFO:teuthology.orchestra.run.smithi008.stdout: "duration": 0.0051660639999999997 2023-08-01T19:54:37.414 INFO:teuthology.orchestra.run.smithi008.stdout: }, 2023-08-01T19:54:37.414 INFO:teuthology.orchestra.run.smithi008.stdout: { 2023-08-01T19:54:37.415 INFO:teuthology.orchestra.run.smithi008.stdout: "event": "sub_op_commit_rec", 2023-08-01T19:54:37.415 INFO:teuthology.orchestra.run.smithi008.stdout: "time": "2023-08-01T19:54:36.832094+0000", 2023-08-01T19:54:37.415 INFO:teuthology.orchestra.run.smithi008.stdout: "duration": 0.0040907729999999998 2023-08-01T19:54:37.415 INFO:teuthology.orchestra.run.smithi008.stdout: }, 2023-08-01T19:54:37.415 INFO:teuthology.orchestra.run.smithi008.stdout: { 2023-08-01T19:54:37.415 INFO:teuthology.orchestra.run.smithi008.stdout: "event": "commit_sent", 2023-08-01T19:54:37.415 INFO:teuthology.orchestra.run.smithi008.stdout: "time": "2023-08-01T19:54:36.832145+0000", 2023-08-01T19:54:37.415 INFO:teuthology.orchestra.run.smithi008.stdout: "duration": 5.0615000000000002e-05 2023-08-01T19:54:37.416 INFO:teuthology.orchestra.run.smithi008.stdout: }, 2023-08-01T19:54:37.416 INFO:teuthology.orchestra.run.smithi008.stdout: { 2023-08-01T19:54:37.416 INFO:teuthology.orchestra.run.smithi008.stdout: "event": "done", 2023-08-01T19:54:37.416 INFO:teuthology.orchestra.run.smithi008.stdout: "time": "2023-08-01T19:54:36.832189+0000", 2023-08-01T19:54:37.416 INFO:teuthology.orchestra.run.smithi008.stdout: "duration": 4.4480000000000001e-05 2023-08-01T19:54:37.416 INFO:teuthology.orchestra.run.smithi008.stdout: } 2023-08-01T19:54:37.416 INFO:teuthology.orchestra.run.smithi008.stdout: ] 2023-08-01T19:54:37.416 INFO:teuthology.orchestra.run.smithi008.stdout: } 2023-08-01T19:54:37.417 INFO:teuthology.orchestra.run.smithi008.stdout: } 2023-08-01T19:54:37.417 INFO:teuthology.orchestra.run.smithi008.stdout: ] 2023-08-01T19:54:37.417 INFO:teuthology.orchestra.run.smithi008.stdout:} 2023-08-01T19:54:37.417 DEBUG:teuthology.orchestra.run.smithi101:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 30 ceph --cluster ceph --admin-daemon /var/run/ceph/ceph-osd.1.asok dump_ops_in_flight 2023-08-01T19:54:37.503 INFO:tasks.ceph.osd.2.smithi155.stderr:2023-08-01T19:54:37.502+0000 7faa5c6ac700 -1 received signal: Hangup from /usr/bin/python3 /bin/daemon-helper kill ceph-osd -f --cluster ceph -i 2 (PID: 111337) UID: 0 2023-08-01T19:54:37.591 INFO:teuthology.orchestra.run.smithi101.stdout:{ 2023-08-01T19:54:37.592 INFO:teuthology.orchestra.run.smithi101.stdout: "ops": [ 2023-08-01T19:54:37.592 INFO:teuthology.orchestra.run.smithi101.stdout: { 2023-08-01T19:54:37.592 INFO:teuthology.orchestra.run.smithi101.stdout: "description": "osd_op(client.4668.0:43460 5.9 5:90aea9fb:::benchmark_data_smithi006_114134_object43459:head [set-alloc-hint object_size 65536 write_size 65536,write 0~65536 in=65536b] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e26)", 2023-08-01T19:54:37.592 INFO:teuthology.orchestra.run.smithi101.stdout: "initiated_at": "2023-08-01T19:54:37.583994+0000", 2023-08-01T19:54:37.592 INFO:teuthology.orchestra.run.smithi101.stdout: "age": 0.0057893880000000003, 2023-08-01T19:54:37.592 INFO:teuthology.orchestra.run.smithi101.stdout: "duration": 0.0058245010000000002, 2023-08-01T19:54:37.592 INFO:teuthology.orchestra.run.smithi101.stdout: "type_data": { 2023-08-01T19:54:37.593 INFO:teuthology.orchestra.run.smithi101.stdout: "flag_point": "waiting for sub ops", 2023-08-01T19:54:37.593 INFO:teuthology.orchestra.run.smithi101.stdout: "client_info": { 2023-08-01T19:54:37.593 INFO:teuthology.orchestra.run.smithi101.stdout: "client": "client.4668", 2023-08-01T19:54:37.593 INFO:teuthology.orchestra.run.smithi101.stdout: "client_addr": "172.21.15.6:0/1709472247", 2023-08-01T19:54:37.593 INFO:teuthology.orchestra.run.smithi101.stdout: "tid": 43460 2023-08-01T19:54:37.593 INFO:teuthology.orchestra.run.smithi101.stdout: }, 2023-08-01T19:54:37.593 INFO:teuthology.orchestra.run.smithi101.stdout: "events": [ 2023-08-01T19:54:37.593 INFO:teuthology.orchestra.run.smithi101.stdout: { 2023-08-01T19:54:37.594 INFO:teuthology.orchestra.run.smithi101.stdout: "event": "initiated", 2023-08-01T19:54:37.594 INFO:teuthology.orchestra.run.smithi101.stdout: "time": "2023-08-01T19:54:37.583994+0000", 2023-08-01T19:54:37.594 INFO:teuthology.orchestra.run.smithi101.stdout: "duration": 0 2023-08-01T19:54:37.594 INFO:teuthology.orchestra.run.smithi101.stdout: }, 2023-08-01T19:54:37.594 INFO:teuthology.orchestra.run.smithi101.stdout: { 2023-08-01T19:54:37.594 INFO:teuthology.orchestra.run.smithi101.stdout: "event": "throttled", 2023-08-01T19:54:37.594 INFO:teuthology.orchestra.run.smithi101.stdout: "time": "2023-08-01T19:54:37.583994+0000", 2023-08-01T19:54:37.595 INFO:teuthology.orchestra.run.smithi101.stdout: "duration": 0 2023-08-01T19:54:37.595 INFO:teuthology.orchestra.run.smithi101.stdout: }, 2023-08-01T19:54:37.595 INFO:teuthology.orchestra.run.smithi101.stdout: { 2023-08-01T19:54:37.595 INFO:teuthology.orchestra.run.smithi101.stdout: "event": "header_read", 2023-08-01T19:54:37.595 INFO:teuthology.orchestra.run.smithi101.stdout: "time": "2023-08-01T19:54:37.583994+0000", 2023-08-01T19:54:37.595 INFO:teuthology.orchestra.run.smithi101.stdout: "duration": 4294967295.9999995 2023-08-01T19:54:37.595 INFO:teuthology.orchestra.run.smithi101.stdout: }, 2023-08-01T19:54:37.595 INFO:teuthology.orchestra.run.smithi101.stdout: { 2023-08-01T19:54:37.596 INFO:teuthology.orchestra.run.smithi101.stdout: "event": "all_read", 2023-08-01T19:54:37.596 INFO:teuthology.orchestra.run.smithi101.stdout: "time": "2023-08-01T19:54:37.584084+0000", 2023-08-01T19:54:37.596 INFO:teuthology.orchestra.run.smithi101.stdout: "duration": 9.0897999999999996e-05 2023-08-01T19:54:37.596 INFO:teuthology.orchestra.run.smithi101.stdout: }, 2023-08-01T19:54:37.596 INFO:teuthology.orchestra.run.smithi101.stdout: { 2023-08-01T19:54:37.596 INFO:teuthology.orchestra.run.smithi101.stdout: "event": "dispatched", 2023-08-01T19:54:37.596 INFO:teuthology.orchestra.run.smithi101.stdout: "time": "2023-08-01T19:54:37.584093+0000", 2023-08-01T19:54:37.596 INFO:teuthology.orchestra.run.smithi101.stdout: "duration": 8.0949999999999996e-06 2023-08-01T19:54:37.597 INFO:teuthology.orchestra.run.smithi101.stdout: }, 2023-08-01T19:54:37.597 INFO:teuthology.orchestra.run.smithi101.stdout: { 2023-08-01T19:54:37.597 INFO:teuthology.orchestra.run.smithi101.stdout: "event": "queued_for_pg", 2023-08-01T19:54:37.597 INFO:teuthology.orchestra.run.smithi101.stdout: "time": "2023-08-01T19:54:37.584097+0000", 2023-08-01T19:54:37.597 INFO:teuthology.orchestra.run.smithi101.stdout: "duration": 4.7310000000000001e-06 2023-08-01T19:54:37.597 INFO:teuthology.orchestra.run.smithi101.stdout: }, 2023-08-01T19:54:37.597 INFO:teuthology.orchestra.run.smithi101.stdout: { 2023-08-01T19:54:37.597 INFO:teuthology.orchestra.run.smithi101.stdout: "event": "reached_pg", 2023-08-01T19:54:37.598 INFO:teuthology.orchestra.run.smithi101.stdout: "time": "2023-08-01T19:54:37.584132+0000", 2023-08-01T19:54:37.598 INFO:teuthology.orchestra.run.smithi101.stdout: "duration": 3.4375999999999997e-05 2023-08-01T19:54:37.598 INFO:teuthology.orchestra.run.smithi101.stdout: }, 2023-08-01T19:54:37.598 INFO:teuthology.orchestra.run.smithi101.stdout: { 2023-08-01T19:54:37.598 INFO:teuthology.orchestra.run.smithi101.stdout: "event": "started", 2023-08-01T19:54:37.598 INFO:teuthology.orchestra.run.smithi101.stdout: "time": "2023-08-01T19:54:37.584244+0000", 2023-08-01T19:54:37.598 INFO:teuthology.orchestra.run.smithi101.stdout: "duration": 0.000112691 2023-08-01T19:54:37.598 INFO:teuthology.orchestra.run.smithi101.stdout: }, 2023-08-01T19:54:37.599 INFO:teuthology.orchestra.run.smithi101.stdout: { 2023-08-01T19:54:37.599 INFO:teuthology.orchestra.run.smithi101.stdout: "event": "waiting for subops from 2", 2023-08-01T19:54:37.599 INFO:teuthology.orchestra.run.smithi101.stdout: "time": "2023-08-01T19:54:37.584364+0000", 2023-08-01T19:54:37.599 INFO:teuthology.orchestra.run.smithi101.stdout: "duration": 0.00012006399999999999 2023-08-01T19:54:37.599 INFO:teuthology.orchestra.run.smithi101.stdout: } 2023-08-01T19:54:37.599 INFO:teuthology.orchestra.run.smithi101.stdout: ] 2023-08-01T19:54:37.599 INFO:teuthology.orchestra.run.smithi101.stdout: } 2023-08-01T19:54:37.599 INFO:teuthology.orchestra.run.smithi101.stdout: }, 2023-08-01T19:54:37.600 INFO:teuthology.orchestra.run.smithi101.stdout: { 2023-08-01T19:54:37.600 INFO:teuthology.orchestra.run.smithi101.stdout: "description": "osd_op(client.4668.0:43461 5.1 5:87bce3e4:::benchmark_data_smithi006_114134_object43460:head [set-alloc-hint object_size 65536 write_size 65536,write 0~65536 in=65536b] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e26)", 2023-08-01T19:54:37.600 INFO:teuthology.orchestra.run.smithi101.stdout: "initiated_at": "2023-08-01T19:54:37.584105+0000", 2023-08-01T19:54:37.600 INFO:teuthology.orchestra.run.smithi101.stdout: "age": 0.0056787030000000002, 2023-08-01T19:54:37.600 INFO:teuthology.orchestra.run.smithi101.stdout: "duration": 0.0058050810000000001, 2023-08-01T19:54:37.600 INFO:teuthology.orchestra.run.smithi101.stdout: "type_data": { 2023-08-01T19:54:37.600 INFO:teuthology.orchestra.run.smithi101.stdout: "flag_point": "waiting for sub ops", 2023-08-01T19:54:37.601 INFO:teuthology.orchestra.run.smithi101.stdout: "client_info": { 2023-08-01T19:54:37.601 INFO:teuthology.orchestra.run.smithi101.stdout: "client": "client.4668", 2023-08-01T19:54:37.601 INFO:teuthology.orchestra.run.smithi101.stdout: "client_addr": "172.21.15.6:0/1709472247", 2023-08-01T19:54:37.601 INFO:teuthology.orchestra.run.smithi101.stdout: "tid": 43461 2023-08-01T19:54:37.601 INFO:teuthology.orchestra.run.smithi101.stdout: }, 2023-08-01T19:54:37.601 INFO:teuthology.orchestra.run.smithi101.stdout: "events": [ 2023-08-01T19:54:37.601 INFO:teuthology.orchestra.run.smithi101.stdout: { 2023-08-01T19:54:37.601 INFO:teuthology.orchestra.run.smithi101.stdout: "event": "initiated", 2023-08-01T19:54:37.602 INFO:teuthology.orchestra.run.smithi101.stdout: "time": "2023-08-01T19:54:37.584105+0000", 2023-08-01T19:54:37.602 INFO:teuthology.orchestra.run.smithi101.stdout: "duration": 0 2023-08-01T19:54:37.602 INFO:teuthology.orchestra.run.smithi101.stdout: }, 2023-08-01T19:54:37.602 INFO:teuthology.orchestra.run.smithi101.stdout: { 2023-08-01T19:54:37.602 INFO:teuthology.orchestra.run.smithi101.stdout: "event": "throttled", 2023-08-01T19:54:37.602 INFO:teuthology.orchestra.run.smithi101.stdout: "time": "2023-08-01T19:54:37.584105+0000", 2023-08-01T19:54:37.602 INFO:teuthology.orchestra.run.smithi101.stdout: "duration": 0 2023-08-01T19:54:37.602 INFO:teuthology.orchestra.run.smithi101.stdout: }, 2023-08-01T19:54:37.603 INFO:teuthology.orchestra.run.smithi101.stdout: { 2023-08-01T19:54:37.603 INFO:teuthology.orchestra.run.smithi101.stdout: "event": "header_read", 2023-08-01T19:54:37.603 INFO:teuthology.orchestra.run.smithi101.stdout: "time": "2023-08-01T19:54:37.584104+0000", 2023-08-01T19:54:37.603 INFO:teuthology.orchestra.run.smithi101.stdout: "duration": 4294967295.9999995 2023-08-01T19:54:37.603 INFO:teuthology.orchestra.run.smithi101.stdout: }, 2023-08-01T19:54:37.603 INFO:teuthology.orchestra.run.smithi101.stdout: { 2023-08-01T19:54:37.603 INFO:teuthology.orchestra.run.smithi101.stdout: "event": "all_read", 2023-08-01T19:54:37.603 INFO:teuthology.orchestra.run.smithi101.stdout: "time": "2023-08-01T19:54:37.584174+0000", 2023-08-01T19:54:37.604 INFO:teuthology.orchestra.run.smithi101.stdout: "duration": 7.0085000000000004e-05 2023-08-01T19:54:37.604 INFO:teuthology.orchestra.run.smithi101.stdout: }, 2023-08-01T19:54:37.604 INFO:teuthology.orchestra.run.smithi101.stdout: { 2023-08-01T19:54:37.604 INFO:teuthology.orchestra.run.smithi101.stdout: "event": "dispatched", 2023-08-01T19:54:37.604 INFO:teuthology.orchestra.run.smithi101.stdout: "time": "2023-08-01T19:54:37.584181+0000", 2023-08-01T19:54:37.604 INFO:teuthology.orchestra.run.smithi101.stdout: "duration": 6.8990000000000004e-06 2023-08-01T19:54:37.604 INFO:teuthology.orchestra.run.smithi101.stdout: }, 2023-08-01T19:54:37.604 INFO:teuthology.orchestra.run.smithi101.stdout: { 2023-08-01T19:54:37.605 INFO:teuthology.orchestra.run.smithi101.stdout: "event": "queued_for_pg", 2023-08-01T19:54:37.605 INFO:teuthology.orchestra.run.smithi101.stdout: "time": "2023-08-01T19:54:37.584185+0000", 2023-08-01T19:54:37.605 INFO:teuthology.orchestra.run.smithi101.stdout: "duration": 4.0520000000000003e-06 2023-08-01T19:54:37.605 INFO:teuthology.orchestra.run.smithi101.stdout: }, 2023-08-01T19:54:37.605 INFO:teuthology.orchestra.run.smithi101.stdout: { 2023-08-01T19:54:37.605 INFO:teuthology.orchestra.run.smithi101.stdout: "event": "reached_pg", 2023-08-01T19:54:37.605 INFO:teuthology.orchestra.run.smithi101.stdout: "time": "2023-08-01T19:54:37.585500+0000", 2023-08-01T19:54:37.605 INFO:teuthology.orchestra.run.smithi101.stdout: "duration": 0.001314923 2023-08-01T19:54:37.606 INFO:teuthology.orchestra.run.smithi101.stdout: }, 2023-08-01T19:54:37.606 INFO:teuthology.orchestra.run.smithi101.stdout: { 2023-08-01T19:54:37.606 INFO:teuthology.orchestra.run.smithi101.stdout: "event": "started", 2023-08-01T19:54:37.606 INFO:teuthology.orchestra.run.smithi101.stdout: "time": "2023-08-01T19:54:37.585633+0000", 2023-08-01T19:54:37.606 INFO:teuthology.orchestra.run.smithi101.stdout: "duration": 0.00013293199999999999 2023-08-01T19:54:37.606 INFO:teuthology.orchestra.run.smithi101.stdout: }, 2023-08-01T19:54:37.606 INFO:teuthology.orchestra.run.smithi101.stdout: { 2023-08-01T19:54:37.606 INFO:teuthology.orchestra.run.smithi101.stdout: "event": "waiting for subops from 0", 2023-08-01T19:54:37.607 INFO:teuthology.orchestra.run.smithi101.stdout: "time": "2023-08-01T19:54:37.585744+0000", 2023-08-01T19:54:37.607 INFO:teuthology.orchestra.run.smithi101.stdout: "duration": 0.000111038 2023-08-01T19:54:37.607 INFO:teuthology.orchestra.run.smithi101.stdout: }, 2023-08-01T19:54:37.607 INFO:teuthology.orchestra.run.smithi101.stdout: { 2023-08-01T19:54:37.607 INFO:teuthology.orchestra.run.smithi101.stdout: "event": "op_commit", 2023-08-01T19:54:37.607 INFO:teuthology.orchestra.run.smithi101.stdout: "time": "2023-08-01T19:54:37.589061+0000", 2023-08-01T19:54:37.607 INFO:teuthology.orchestra.run.smithi101.stdout: "duration": 0.0033166409999999999 2023-08-01T19:54:37.607 INFO:teuthology.orchestra.run.smithi101.stdout: } 2023-08-01T19:54:37.608 INFO:teuthology.orchestra.run.smithi101.stdout: ] 2023-08-01T19:54:37.608 INFO:teuthology.orchestra.run.smithi101.stdout: } 2023-08-01T19:54:37.608 INFO:teuthology.orchestra.run.smithi101.stdout: }, 2023-08-01T19:54:37.608 INFO:teuthology.orchestra.run.smithi101.stdout: { 2023-08-01T19:54:37.608 INFO:teuthology.orchestra.run.smithi101.stdout: "description": "osd_op(client.4668.0:43462 5.9 5:9729ca54:::benchmark_data_smithi006_114134_object43461:head [set-alloc-hint object_size 65536 write_size 65536,write 0~65536 in=65536b] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e26)", 2023-08-01T19:54:37.608 INFO:teuthology.orchestra.run.smithi101.stdout: "initiated_at": "2023-08-01T19:54:37.584191+0000", 2023-08-01T19:54:37.608 INFO:teuthology.orchestra.run.smithi101.stdout: "age": 0.0055928879999999999, 2023-08-01T19:54:37.609 INFO:teuthology.orchestra.run.smithi101.stdout: "duration": 0.0058116569999999996, 2023-08-01T19:54:37.609 INFO:teuthology.orchestra.run.smithi101.stdout: "type_data": { 2023-08-01T19:54:37.609 INFO:teuthology.orchestra.run.smithi101.stdout: "flag_point": "waiting for sub ops", 2023-08-01T19:54:37.609 INFO:teuthology.orchestra.run.smithi101.stdout: "client_info": { 2023-08-01T19:54:37.609 INFO:teuthology.orchestra.run.smithi101.stdout: "client": "client.4668", 2023-08-01T19:54:37.609 INFO:teuthology.orchestra.run.smithi101.stdout: "client_addr": "172.21.15.6:0/1709472247", 2023-08-01T19:54:37.609 INFO:teuthology.orchestra.run.smithi101.stdout: "tid": 43462 2023-08-01T19:54:37.609 INFO:teuthology.orchestra.run.smithi101.stdout: }, 2023-08-01T19:54:37.610 INFO:teuthology.orchestra.run.smithi101.stdout: "events": [ 2023-08-01T19:54:37.610 INFO:teuthology.orchestra.run.smithi101.stdout: { 2023-08-01T19:54:37.610 INFO:teuthology.orchestra.run.smithi101.stdout: "event": "initiated", 2023-08-01T19:54:37.610 INFO:teuthology.orchestra.run.smithi101.stdout: "time": "2023-08-01T19:54:37.584191+0000", 2023-08-01T19:54:37.610 INFO:teuthology.orchestra.run.smithi101.stdout: "duration": 0 2023-08-01T19:54:37.610 INFO:teuthology.orchestra.run.smithi101.stdout: }, 2023-08-01T19:54:37.610 INFO:teuthology.orchestra.run.smithi101.stdout: { 2023-08-01T19:54:37.610 INFO:teuthology.orchestra.run.smithi101.stdout: "event": "throttled", 2023-08-01T19:54:37.611 INFO:teuthology.orchestra.run.smithi101.stdout: "time": "2023-08-01T19:54:37.584191+0000", 2023-08-01T19:54:37.611 INFO:teuthology.orchestra.run.smithi101.stdout: "duration": 0 2023-08-01T19:54:37.611 INFO:teuthology.orchestra.run.smithi101.stdout: }, 2023-08-01T19:54:37.611 INFO:teuthology.orchestra.run.smithi101.stdout: { 2023-08-01T19:54:37.611 INFO:teuthology.orchestra.run.smithi101.stdout: "event": "header_read", 2023-08-01T19:54:37.611 INFO:teuthology.orchestra.run.smithi101.stdout: "time": "2023-08-01T19:54:37.584190+0000", 2023-08-01T19:54:37.611 INFO:teuthology.orchestra.run.smithi101.stdout: "duration": 4294967295.9999995 2023-08-01T19:54:37.611 INFO:teuthology.orchestra.run.smithi101.stdout: }, 2023-08-01T19:54:37.612 INFO:teuthology.orchestra.run.smithi101.stdout: { 2023-08-01T19:54:37.612 INFO:teuthology.orchestra.run.smithi101.stdout: "event": "all_read", 2023-08-01T19:54:37.612 INFO:teuthology.orchestra.run.smithi101.stdout: "time": "2023-08-01T19:54:37.584260+0000", 2023-08-01T19:54:37.612 INFO:teuthology.orchestra.run.smithi101.stdout: "duration": 7.0328999999999997e-05 2023-08-01T19:54:37.612 INFO:teuthology.orchestra.run.smithi101.stdout: }, 2023-08-01T19:54:37.612 INFO:teuthology.orchestra.run.smithi101.stdout: { 2023-08-01T19:54:37.612 INFO:teuthology.orchestra.run.smithi101.stdout: "event": "dispatched", 2023-08-01T19:54:37.612 INFO:teuthology.orchestra.run.smithi101.stdout: "time": "2023-08-01T19:54:37.584269+0000", 2023-08-01T19:54:37.613 INFO:teuthology.orchestra.run.smithi101.stdout: "duration": 8.4919999999999993e-06 2023-08-01T19:54:37.613 INFO:teuthology.orchestra.run.smithi101.stdout: }, 2023-08-01T19:54:37.613 INFO:teuthology.orchestra.run.smithi101.stdout: { 2023-08-01T19:54:37.613 INFO:teuthology.orchestra.run.smithi101.stdout: "event": "queued_for_pg", 2023-08-01T19:54:37.613 INFO:teuthology.orchestra.run.smithi101.stdout: "time": "2023-08-01T19:54:37.584274+0000", 2023-08-01T19:54:37.613 INFO:teuthology.orchestra.run.smithi101.stdout: "duration": 5.1769999999999997e-06 2023-08-01T19:54:37.613 INFO:teuthology.orchestra.run.smithi101.stdout: }, 2023-08-01T19:54:37.613 INFO:teuthology.orchestra.run.smithi101.stdout: { 2023-08-01T19:54:37.614 INFO:teuthology.orchestra.run.smithi101.stdout: "event": "reached_pg", 2023-08-01T19:54:37.614 INFO:teuthology.orchestra.run.smithi101.stdout: "time": "2023-08-01T19:54:37.585820+0000", 2023-08-01T19:54:37.614 INFO:teuthology.orchestra.run.smithi101.stdout: "duration": 0.0015454589999999999 2023-08-01T19:54:37.614 INFO:teuthology.orchestra.run.smithi101.stdout: }, 2023-08-01T19:54:37.614 INFO:teuthology.orchestra.run.smithi101.stdout: { 2023-08-01T19:54:37.614 INFO:teuthology.orchestra.run.smithi101.stdout: "event": "started", 2023-08-01T19:54:37.614 INFO:teuthology.orchestra.run.smithi101.stdout: "time": "2023-08-01T19:54:37.585897+0000", 2023-08-01T19:54:37.615 INFO:teuthology.orchestra.run.smithi101.stdout: "duration": 7.7474999999999999e-05 2023-08-01T19:54:37.615 INFO:teuthology.orchestra.run.smithi101.stdout: }, 2023-08-01T19:54:37.615 INFO:teuthology.orchestra.run.smithi101.stdout: { 2023-08-01T19:54:37.615 INFO:teuthology.orchestra.run.smithi101.stdout: "event": "waiting for subops from 2", 2023-08-01T19:54:37.615 INFO:teuthology.orchestra.run.smithi101.stdout: "time": "2023-08-01T19:54:37.585979+0000", 2023-08-01T19:54:37.615 INFO:teuthology.orchestra.run.smithi101.stdout: "duration": 8.1488000000000003e-05 2023-08-01T19:54:37.615 INFO:teuthology.orchestra.run.smithi101.stdout: } 2023-08-01T19:54:37.615 INFO:teuthology.orchestra.run.smithi101.stdout: ] 2023-08-01T19:54:37.616 INFO:teuthology.orchestra.run.smithi101.stdout: } 2023-08-01T19:54:37.616 INFO:teuthology.orchestra.run.smithi101.stdout: }, 2023-08-01T19:54:37.616 INFO:teuthology.orchestra.run.smithi101.stdout: { 2023-08-01T19:54:37.616 INFO:teuthology.orchestra.run.smithi101.stdout: "description": "osd_op(client.4668.0:43463 5.9 5:913e8fa2:::benchmark_data_smithi006_114134_object43462:head [set-alloc-hint object_size 65536 write_size 65536,write 0~65536 in=65536b] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e26)", 2023-08-01T19:54:37.616 INFO:teuthology.orchestra.run.smithi101.stdout: "initiated_at": "2023-08-01T19:54:37.584286+0000", 2023-08-01T19:54:37.616 INFO:teuthology.orchestra.run.smithi101.stdout: "age": 0.0054979, 2023-08-01T19:54:37.616 INFO:teuthology.orchestra.run.smithi101.stdout: "duration": 0.0058086880000000002, 2023-08-01T19:54:37.616 INFO:teuthology.orchestra.run.smithi101.stdout: "type_data": { 2023-08-01T19:54:37.617 INFO:teuthology.orchestra.run.smithi101.stdout: "flag_point": "waiting for sub ops", 2023-08-01T19:54:37.617 INFO:teuthology.orchestra.run.smithi101.stdout: "client_info": { 2023-08-01T19:54:37.617 INFO:teuthology.orchestra.run.smithi101.stdout: "client": "client.4668", 2023-08-01T19:54:37.617 INFO:teuthology.orchestra.run.smithi101.stdout: "client_addr": "172.21.15.6:0/1709472247", 2023-08-01T19:54:37.617 INFO:teuthology.orchestra.run.smithi101.stdout: "tid": 43463 2023-08-01T19:54:37.617 INFO:teuthology.orchestra.run.smithi101.stdout: }, 2023-08-01T19:54:37.617 INFO:teuthology.orchestra.run.smithi101.stdout: "events": [ 2023-08-01T19:54:37.618 INFO:teuthology.orchestra.run.smithi101.stdout: { 2023-08-01T19:54:37.618 INFO:teuthology.orchestra.run.smithi101.stdout: "event": "initiated", 2023-08-01T19:54:37.618 INFO:teuthology.orchestra.run.smithi101.stdout: "time": "2023-08-01T19:54:37.584286+0000", 2023-08-01T19:54:37.618 INFO:teuthology.orchestra.run.smithi101.stdout: "duration": 0 2023-08-01T19:54:37.618 INFO:teuthology.orchestra.run.smithi101.stdout: }, 2023-08-01T19:54:37.618 INFO:teuthology.orchestra.run.smithi101.stdout: { 2023-08-01T19:54:37.618 INFO:teuthology.orchestra.run.smithi101.stdout: "event": "throttled", 2023-08-01T19:54:37.618 INFO:teuthology.orchestra.run.smithi101.stdout: "time": "2023-08-01T19:54:37.584286+0000", 2023-08-01T19:54:37.619 INFO:teuthology.orchestra.run.smithi101.stdout: "duration": 0 2023-08-01T19:54:37.619 INFO:teuthology.orchestra.run.smithi101.stdout: }, 2023-08-01T19:54:37.619 INFO:teuthology.orchestra.run.smithi101.stdout: { 2023-08-01T19:54:37.619 INFO:teuthology.orchestra.run.smithi101.stdout: "event": "header_read", 2023-08-01T19:54:37.619 INFO:teuthology.orchestra.run.smithi101.stdout: "time": "2023-08-01T19:54:37.584285+0000", 2023-08-01T19:54:37.619 INFO:teuthology.orchestra.run.smithi101.stdout: "duration": 4294967295.9999995 2023-08-01T19:54:37.619 INFO:teuthology.orchestra.run.smithi101.stdout: }, 2023-08-01T19:54:37.619 INFO:teuthology.orchestra.run.smithi101.stdout: { 2023-08-01T19:54:37.620 INFO:teuthology.orchestra.run.smithi101.stdout: "event": "all_read", 2023-08-01T19:54:37.620 INFO:teuthology.orchestra.run.smithi101.stdout: "time": "2023-08-01T19:54:37.584362+0000", 2023-08-01T19:54:37.620 INFO:teuthology.orchestra.run.smithi101.stdout: "duration": 7.7027000000000006e-05 2023-08-01T19:54:37.620 INFO:teuthology.orchestra.run.smithi101.stdout: }, 2023-08-01T19:54:37.620 INFO:teuthology.orchestra.run.smithi101.stdout: { 2023-08-01T19:54:37.620 INFO:teuthology.orchestra.run.smithi101.stdout: "event": "dispatched", 2023-08-01T19:54:37.621 INFO:teuthology.orchestra.run.smithi101.stdout: "time": "2023-08-01T19:54:37.584370+0000", 2023-08-01T19:54:37.621 INFO:teuthology.orchestra.run.smithi101.stdout: "duration": 7.5120000000000002e-06 2023-08-01T19:54:37.621 INFO:teuthology.orchestra.run.smithi101.stdout: }, 2023-08-01T19:54:37.621 INFO:teuthology.orchestra.run.smithi101.stdout: { 2023-08-01T19:54:37.621 INFO:teuthology.orchestra.run.smithi101.stdout: "event": "queued_for_pg", 2023-08-01T19:54:37.621 INFO:teuthology.orchestra.run.smithi101.stdout: "time": "2023-08-01T19:54:37.584375+0000", 2023-08-01T19:54:37.621 INFO:teuthology.orchestra.run.smithi101.stdout: "duration": 4.8709999999999996e-06 2023-08-01T19:54:37.621 INFO:teuthology.orchestra.run.smithi101.stdout: }, 2023-08-01T19:54:37.622 INFO:teuthology.orchestra.run.smithi101.stdout: { 2023-08-01T19:54:37.622 INFO:teuthology.orchestra.run.smithi101.stdout: "event": "reached_pg", 2023-08-01T19:54:37.622 INFO:teuthology.orchestra.run.smithi101.stdout: "time": "2023-08-01T19:54:37.587280+0000", 2023-08-01T19:54:37.622 INFO:teuthology.orchestra.run.smithi101.stdout: "duration": 0.0029055169999999998 2023-08-01T19:54:37.622 INFO:teuthology.orchestra.run.smithi101.stdout: }, 2023-08-01T19:54:37.622 INFO:teuthology.orchestra.run.smithi101.stdout: { 2023-08-01T19:54:37.622 INFO:teuthology.orchestra.run.smithi101.stdout: "event": "started", 2023-08-01T19:54:37.623 INFO:teuthology.orchestra.run.smithi101.stdout: "time": "2023-08-01T19:54:37.587397+0000", 2023-08-01T19:54:37.623 INFO:teuthology.orchestra.run.smithi101.stdout: "duration": 0.000116488 2023-08-01T19:54:37.623 INFO:teuthology.orchestra.run.smithi101.stdout: }, 2023-08-01T19:54:37.623 INFO:teuthology.orchestra.run.smithi101.stdout: { 2023-08-01T19:54:37.623 INFO:teuthology.orchestra.run.smithi101.stdout: "event": "waiting for subops from 2", 2023-08-01T19:54:37.623 INFO:teuthology.orchestra.run.smithi101.stdout: "time": "2023-08-01T19:54:37.587569+0000", 2023-08-01T19:54:37.623 INFO:teuthology.orchestra.run.smithi101.stdout: "duration": 0.000172067 2023-08-01T19:54:37.624 INFO:teuthology.orchestra.run.smithi101.stdout: } 2023-08-01T19:54:37.624 INFO:teuthology.orchestra.run.smithi101.stdout: ] 2023-08-01T19:54:37.624 INFO:teuthology.orchestra.run.smithi101.stdout: } 2023-08-01T19:54:37.624 INFO:teuthology.orchestra.run.smithi101.stdout: }, 2023-08-01T19:54:37.624 INFO:teuthology.orchestra.run.smithi101.stdout: { 2023-08-01T19:54:37.624 INFO:teuthology.orchestra.run.smithi101.stdout: "description": "osd_op(client.4668.0:43465 5.1 5:881c0a34:::benchmark_data_smithi006_114134_object43464:head [set-alloc-hint object_size 65536 write_size 65536,write 0~65536 in=65536b] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e26)", 2023-08-01T19:54:37.624 INFO:teuthology.orchestra.run.smithi101.stdout: "initiated_at": "2023-08-01T19:54:37.584380+0000", 2023-08-01T19:54:37.625 INFO:teuthology.orchestra.run.smithi101.stdout: "age": 0.005403166, 2023-08-01T19:54:37.625 INFO:teuthology.orchestra.run.smithi101.stdout: "duration": 0.005799139, 2023-08-01T19:54:37.625 INFO:teuthology.orchestra.run.smithi101.stdout: "type_data": { 2023-08-01T19:54:37.625 INFO:teuthology.orchestra.run.smithi101.stdout: "flag_point": "waiting for sub ops", 2023-08-01T19:54:37.625 INFO:teuthology.orchestra.run.smithi101.stdout: "client_info": { 2023-08-01T19:54:37.625 INFO:teuthology.orchestra.run.smithi101.stdout: "client": "client.4668", 2023-08-01T19:54:37.626 INFO:teuthology.orchestra.run.smithi101.stdout: "client_addr": "172.21.15.6:0/1709472247", 2023-08-01T19:54:37.626 INFO:teuthology.orchestra.run.smithi101.stdout: "tid": 43465 2023-08-01T19:54:37.626 INFO:teuthology.orchestra.run.smithi101.stdout: }, 2023-08-01T19:54:37.626 INFO:teuthology.orchestra.run.smithi101.stdout: "events": [ 2023-08-01T19:54:37.626 INFO:teuthology.orchestra.run.smithi101.stdout: { 2023-08-01T19:54:37.626 INFO:teuthology.orchestra.run.smithi101.stdout: "event": "initiated", 2023-08-01T19:54:37.626 INFO:teuthology.orchestra.run.smithi101.stdout: "time": "2023-08-01T19:54:37.584380+0000", 2023-08-01T19:54:37.626 INFO:teuthology.orchestra.run.smithi101.stdout: "duration": 0 2023-08-01T19:54:37.627 INFO:teuthology.orchestra.run.smithi101.stdout: }, 2023-08-01T19:54:37.627 INFO:teuthology.orchestra.run.smithi101.stdout: { 2023-08-01T19:54:37.627 INFO:teuthology.orchestra.run.smithi101.stdout: "event": "throttled", 2023-08-01T19:54:37.627 INFO:teuthology.orchestra.run.smithi101.stdout: "time": "2023-08-01T19:54:37.584380+0000", 2023-08-01T19:54:37.627 INFO:teuthology.orchestra.run.smithi101.stdout: "duration": 0 2023-08-01T19:54:37.627 INFO:teuthology.orchestra.run.smithi101.stdout: }, 2023-08-01T19:54:37.627 INFO:teuthology.orchestra.run.smithi101.stdout: { 2023-08-01T19:54:37.628 INFO:teuthology.orchestra.run.smithi101.stdout: "event": "header_read", 2023-08-01T19:54:37.628 INFO:teuthology.orchestra.run.smithi101.stdout: "time": "2023-08-01T19:54:37.584380+0000", 2023-08-01T19:54:37.628 INFO:teuthology.orchestra.run.smithi101.stdout: "duration": 4294967295.9999995 2023-08-01T19:54:37.628 INFO:teuthology.orchestra.run.smithi101.stdout: }, 2023-08-01T19:54:37.628 INFO:teuthology.orchestra.run.smithi101.stdout: { 2023-08-01T19:54:37.628 INFO:teuthology.orchestra.run.smithi101.stdout: "event": "all_read", 2023-08-01T19:54:37.628 INFO:teuthology.orchestra.run.smithi101.stdout: "time": "2023-08-01T19:54:37.584443+0000", 2023-08-01T19:54:37.628 INFO:teuthology.orchestra.run.smithi101.stdout: "duration": 6.3309e-05 2023-08-01T19:54:37.629 INFO:teuthology.orchestra.run.smithi101.stdout: }, 2023-08-01T19:54:37.629 INFO:teuthology.orchestra.run.smithi101.stdout: { 2023-08-01T19:54:37.629 INFO:teuthology.orchestra.run.smithi101.stdout: "event": "dispatched", 2023-08-01T19:54:37.629 INFO:teuthology.orchestra.run.smithi101.stdout: "time": "2023-08-01T19:54:37.584452+0000", 2023-08-01T19:54:37.629 INFO:teuthology.orchestra.run.smithi101.stdout: "duration": 9.0909999999999999e-06 2023-08-01T19:54:37.629 INFO:teuthology.orchestra.run.smithi101.stdout: }, 2023-08-01T19:54:37.629 INFO:teuthology.orchestra.run.smithi101.stdout: { 2023-08-01T19:54:37.630 INFO:teuthology.orchestra.run.smithi101.stdout: "event": "queued_for_pg", 2023-08-01T19:54:37.630 INFO:teuthology.orchestra.run.smithi101.stdout: "time": "2023-08-01T19:54:37.584457+0000", 2023-08-01T19:54:37.630 INFO:teuthology.orchestra.run.smithi101.stdout: "duration": 5.1399999999999999e-06 2023-08-01T19:54:37.630 INFO:teuthology.orchestra.run.smithi101.stdout: }, 2023-08-01T19:54:37.630 INFO:teuthology.orchestra.run.smithi101.stdout: { 2023-08-01T19:54:37.630 INFO:teuthology.orchestra.run.smithi101.stdout: "event": "reached_pg", 2023-08-01T19:54:37.630 INFO:teuthology.orchestra.run.smithi101.stdout: "time": "2023-08-01T19:54:37.587265+0000", 2023-08-01T19:54:37.630 INFO:teuthology.orchestra.run.smithi101.stdout: "duration": 0.0028072829999999998 2023-08-01T19:54:37.631 INFO:teuthology.orchestra.run.smithi101.stdout: }, 2023-08-01T19:54:37.631 INFO:teuthology.orchestra.run.smithi101.stdout: { 2023-08-01T19:54:37.631 INFO:teuthology.orchestra.run.smithi101.stdout: "event": "started", 2023-08-01T19:54:37.631 INFO:teuthology.orchestra.run.smithi101.stdout: "time": "2023-08-01T19:54:37.587549+0000", 2023-08-01T19:54:37.631 INFO:teuthology.orchestra.run.smithi101.stdout: "duration": 0.000284419 2023-08-01T19:54:37.631 INFO:teuthology.orchestra.run.smithi101.stdout: }, 2023-08-01T19:54:37.631 INFO:teuthology.orchestra.run.smithi101.stdout: { 2023-08-01T19:54:37.632 INFO:teuthology.orchestra.run.smithi101.stdout: "event": "waiting for subops from 0", 2023-08-01T19:54:37.632 INFO:teuthology.orchestra.run.smithi101.stdout: "time": "2023-08-01T19:54:37.587683+0000", 2023-08-01T19:54:37.632 INFO:teuthology.orchestra.run.smithi101.stdout: "duration": 0.000133812 2023-08-01T19:54:37.632 INFO:teuthology.orchestra.run.smithi101.stdout: } 2023-08-01T19:54:37.632 INFO:teuthology.orchestra.run.smithi101.stdout: ] 2023-08-01T19:54:37.632 INFO:teuthology.orchestra.run.smithi101.stdout: } 2023-08-01T19:54:37.632 INFO:teuthology.orchestra.run.smithi101.stdout: }, 2023-08-01T19:54:37.633 INFO:teuthology.orchestra.run.smithi101.stdout: { 2023-08-01T19:54:37.633 INFO:teuthology.orchestra.run.smithi101.stdout: "description": "osd_op(client.4668.0:43466 5.7 5:ede27891:::benchmark_data_smithi006_114134_object43465:head [set-alloc-hint object_size 65536 write_size 65536,write 0~65536 in=65536b] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e26)", 2023-08-01T19:54:37.633 INFO:teuthology.orchestra.run.smithi101.stdout: "initiated_at": "2023-08-01T19:54:37.585905+0000", 2023-08-01T19:54:37.633 INFO:teuthology.orchestra.run.smithi101.stdout: "age": 0.003878828, 2023-08-01T19:54:37.633 INFO:teuthology.orchestra.run.smithi101.stdout: "duration": 0.0043625479999999999, 2023-08-01T19:54:37.633 INFO:teuthology.orchestra.run.smithi101.stdout: "type_data": { 2023-08-01T19:54:37.633 INFO:teuthology.orchestra.run.smithi101.stdout: "flag_point": "waiting for sub ops", 2023-08-01T19:54:37.633 INFO:teuthology.orchestra.run.smithi101.stdout: "client_info": { 2023-08-01T19:54:37.634 INFO:teuthology.orchestra.run.smithi101.stdout: "client": "client.4668", 2023-08-01T19:54:37.634 INFO:teuthology.orchestra.run.smithi101.stdout: "client_addr": "172.21.15.6:0/1709472247", 2023-08-01T19:54:37.634 INFO:teuthology.orchestra.run.smithi101.stdout: "tid": 43466 2023-08-01T19:54:37.634 INFO:teuthology.orchestra.run.smithi101.stdout: }, 2023-08-01T19:54:37.634 INFO:teuthology.orchestra.run.smithi101.stdout: "events": [ 2023-08-01T19:54:37.634 INFO:teuthology.orchestra.run.smithi101.stdout: { 2023-08-01T19:54:37.635 INFO:teuthology.orchestra.run.smithi101.stdout: "event": "initiated", 2023-08-01T19:54:37.635 INFO:teuthology.orchestra.run.smithi101.stdout: "time": "2023-08-01T19:54:37.585905+0000", 2023-08-01T19:54:37.635 INFO:teuthology.orchestra.run.smithi101.stdout: "duration": 0 2023-08-01T19:54:37.635 INFO:teuthology.orchestra.run.smithi101.stdout: }, 2023-08-01T19:54:37.635 INFO:teuthology.orchestra.run.smithi101.stdout: { 2023-08-01T19:54:37.635 INFO:teuthology.orchestra.run.smithi101.stdout: "event": "throttled", 2023-08-01T19:54:37.635 INFO:teuthology.orchestra.run.smithi101.stdout: "time": "2023-08-01T19:54:37.585905+0000", 2023-08-01T19:54:37.636 INFO:teuthology.orchestra.run.smithi101.stdout: "duration": 0 2023-08-01T19:54:37.636 INFO:teuthology.orchestra.run.smithi101.stdout: }, 2023-08-01T19:54:37.636 INFO:teuthology.orchestra.run.smithi101.stdout: { 2023-08-01T19:54:37.636 INFO:teuthology.orchestra.run.smithi101.stdout: "event": "header_read", 2023-08-01T19:54:37.636 INFO:teuthology.orchestra.run.smithi101.stdout: "time": "2023-08-01T19:54:37.585904+0000", 2023-08-01T19:54:37.636 INFO:teuthology.orchestra.run.smithi101.stdout: "duration": 4294967295.999999 2023-08-01T19:54:37.636 INFO:teuthology.orchestra.run.smithi101.stdout: }, 2023-08-01T19:54:37.637 INFO:teuthology.orchestra.run.smithi101.stdout: { 2023-08-01T19:54:37.637 INFO:teuthology.orchestra.run.smithi101.stdout: "event": "all_read", 2023-08-01T19:54:37.637 INFO:teuthology.orchestra.run.smithi101.stdout: "time": "2023-08-01T19:54:37.586041+0000", 2023-08-01T19:54:37.637 INFO:teuthology.orchestra.run.smithi101.stdout: "duration": 0.00013685300000000001 2023-08-01T19:54:37.637 INFO:teuthology.orchestra.run.smithi101.stdout: }, 2023-08-01T19:54:37.637 INFO:teuthology.orchestra.run.smithi101.stdout: { 2023-08-01T19:54:37.637 INFO:teuthology.orchestra.run.smithi101.stdout: "event": "dispatched", 2023-08-01T19:54:37.638 INFO:teuthology.orchestra.run.smithi101.stdout: "time": "2023-08-01T19:54:37.586051+0000", 2023-08-01T19:54:37.638 INFO:teuthology.orchestra.run.smithi101.stdout: "duration": 1.0144e-05 2023-08-01T19:54:37.638 INFO:teuthology.orchestra.run.smithi101.stdout: }, 2023-08-01T19:54:37.638 INFO:teuthology.orchestra.run.smithi101.stdout: { 2023-08-01T19:54:37.638 INFO:teuthology.orchestra.run.smithi101.stdout: "event": "queued_for_pg", 2023-08-01T19:54:37.638 INFO:teuthology.orchestra.run.smithi101.stdout: "time": "2023-08-01T19:54:37.586057+0000", 2023-08-01T19:54:37.638 INFO:teuthology.orchestra.run.smithi101.stdout: "duration": 5.7799999999999997e-06 2023-08-01T19:54:37.638 INFO:teuthology.orchestra.run.smithi101.stdout: }, 2023-08-01T19:54:37.639 INFO:teuthology.orchestra.run.smithi101.stdout: { 2023-08-01T19:54:37.639 INFO:teuthology.orchestra.run.smithi101.stdout: "event": "reached_pg", 2023-08-01T19:54:37.639 INFO:teuthology.orchestra.run.smithi101.stdout: "time": "2023-08-01T19:54:37.586101+0000", 2023-08-01T19:54:37.639 INFO:teuthology.orchestra.run.smithi101.stdout: "duration": 4.4549999999999999e-05 2023-08-01T19:54:37.639 INFO:teuthology.orchestra.run.smithi101.stdout: }, 2023-08-01T19:54:37.639 INFO:teuthology.orchestra.run.smithi101.stdout: { 2023-08-01T19:54:37.639 INFO:teuthology.orchestra.run.smithi101.stdout: "event": "started", 2023-08-01T19:54:37.639 INFO:teuthology.orchestra.run.smithi101.stdout: "time": "2023-08-01T19:54:37.586217+0000", 2023-08-01T19:54:37.640 INFO:teuthology.orchestra.run.smithi101.stdout: "duration": 0.000115513 2023-08-01T19:54:37.640 INFO:teuthology.orchestra.run.smithi101.stdout: }, 2023-08-01T19:54:37.640 INFO:teuthology.orchestra.run.smithi101.stdout: { 2023-08-01T19:54:37.640 INFO:teuthology.orchestra.run.smithi101.stdout: "event": "waiting for subops from 0", 2023-08-01T19:54:37.640 INFO:teuthology.orchestra.run.smithi101.stdout: "time": "2023-08-01T19:54:37.586346+0000", 2023-08-01T19:54:37.640 INFO:teuthology.orchestra.run.smithi101.stdout: "duration": 0.00012972400000000001 2023-08-01T19:54:37.641 INFO:teuthology.orchestra.run.smithi101.stdout: } 2023-08-01T19:54:37.641 INFO:teuthology.orchestra.run.smithi101.stdout: ] 2023-08-01T19:54:37.641 INFO:teuthology.orchestra.run.smithi101.stdout: } 2023-08-01T19:54:37.641 INFO:teuthology.orchestra.run.smithi101.stdout: }, 2023-08-01T19:54:37.641 INFO:teuthology.orchestra.run.smithi101.stdout: { 2023-08-01T19:54:37.641 INFO:teuthology.orchestra.run.smithi101.stdout: "description": "osd_repop(client.4668.0:43469 5.d e26/19 5:b4378710:::benchmark_data_smithi006_114134_object43468:head v 26'2590, mlcod=26'2588)", 2023-08-01T19:54:37.641 INFO:teuthology.orchestra.run.smithi101.stdout: "initiated_at": "2023-08-01T19:54:37.586620+0000", 2023-08-01T19:54:37.641 INFO:teuthology.orchestra.run.smithi101.stdout: "age": 0.0031635719999999999, 2023-08-01T19:54:37.642 INFO:teuthology.orchestra.run.smithi101.stdout: "duration": 0.0037469209999999998, 2023-08-01T19:54:37.642 INFO:teuthology.orchestra.run.smithi101.stdout: "type_data": { 2023-08-01T19:54:37.642 INFO:teuthology.orchestra.run.smithi101.stdout: "flag_point": "started", 2023-08-01T19:54:37.642 INFO:teuthology.orchestra.run.smithi101.stdout: "events": [ 2023-08-01T19:54:37.642 INFO:teuthology.orchestra.run.smithi101.stdout: { 2023-08-01T19:54:37.642 INFO:teuthology.orchestra.run.smithi101.stdout: "event": "initiated", 2023-08-01T19:54:37.642 INFO:teuthology.orchestra.run.smithi101.stdout: "time": "2023-08-01T19:54:37.586620+0000", 2023-08-01T19:54:37.642 INFO:teuthology.orchestra.run.smithi101.stdout: "duration": 0 2023-08-01T19:54:37.643 INFO:teuthology.orchestra.run.smithi101.stdout: }, 2023-08-01T19:54:37.643 INFO:teuthology.orchestra.run.smithi101.stdout: { 2023-08-01T19:54:37.643 INFO:teuthology.orchestra.run.smithi101.stdout: "event": "throttled", 2023-08-01T19:54:37.643 INFO:teuthology.orchestra.run.smithi101.stdout: "time": "2023-08-01T19:54:37.586620+0000", 2023-08-01T19:54:37.643 INFO:teuthology.orchestra.run.smithi101.stdout: "duration": 0 2023-08-01T19:54:37.643 INFO:teuthology.orchestra.run.smithi101.stdout: }, 2023-08-01T19:54:37.644 INFO:teuthology.orchestra.run.smithi101.stdout: { 2023-08-01T19:54:37.644 INFO:teuthology.orchestra.run.smithi101.stdout: "event": "header_read", 2023-08-01T19:54:37.644 INFO:teuthology.orchestra.run.smithi101.stdout: "time": "2023-08-01T19:54:37.586619+0000", 2023-08-01T19:54:37.644 INFO:teuthology.orchestra.run.smithi101.stdout: "duration": 4294967295.999999 2023-08-01T19:54:37.644 INFO:teuthology.orchestra.run.smithi101.stdout: }, 2023-08-01T19:54:37.644 INFO:teuthology.orchestra.run.smithi101.stdout: { 2023-08-01T19:54:37.644 INFO:teuthology.orchestra.run.smithi101.stdout: "event": "all_read", 2023-08-01T19:54:37.645 INFO:teuthology.orchestra.run.smithi101.stdout: "time": "2023-08-01T19:54:37.586684+0000", 2023-08-01T19:54:37.645 INFO:teuthology.orchestra.run.smithi101.stdout: "duration": 6.4753999999999997e-05 2023-08-01T19:54:37.645 INFO:teuthology.orchestra.run.smithi101.stdout: }, 2023-08-01T19:54:37.645 INFO:teuthology.orchestra.run.smithi101.stdout: { 2023-08-01T19:54:37.645 INFO:teuthology.orchestra.run.smithi101.stdout: "event": "dispatched", 2023-08-01T19:54:37.645 INFO:teuthology.orchestra.run.smithi101.stdout: "time": "2023-08-01T19:54:37.586695+0000", 2023-08-01T19:54:37.645 INFO:teuthology.orchestra.run.smithi101.stdout: "duration": 1.1032e-05 2023-08-01T19:54:37.645 INFO:teuthology.orchestra.run.smithi101.stdout: }, 2023-08-01T19:54:37.646 INFO:teuthology.orchestra.run.smithi101.stdout: { 2023-08-01T19:54:37.646 INFO:teuthology.orchestra.run.smithi101.stdout: "event": "queued_for_pg", 2023-08-01T19:54:37.646 INFO:teuthology.orchestra.run.smithi101.stdout: "time": "2023-08-01T19:54:37.586701+0000", 2023-08-01T19:54:37.646 INFO:teuthology.orchestra.run.smithi101.stdout: "duration": 5.6189999999999999e-06 2023-08-01T19:54:37.646 INFO:teuthology.orchestra.run.smithi101.stdout: }, 2023-08-01T19:54:37.646 INFO:teuthology.orchestra.run.smithi101.stdout: { 2023-08-01T19:54:37.646 INFO:teuthology.orchestra.run.smithi101.stdout: "event": "reached_pg", 2023-08-01T19:54:37.647 INFO:teuthology.orchestra.run.smithi101.stdout: "time": "2023-08-01T19:54:37.586744+0000", 2023-08-01T19:54:37.647 INFO:teuthology.orchestra.run.smithi101.stdout: "duration": 4.3648e-05 2023-08-01T19:54:37.647 INFO:teuthology.orchestra.run.smithi101.stdout: }, 2023-08-01T19:54:37.647 INFO:teuthology.orchestra.run.smithi101.stdout: { 2023-08-01T19:54:37.647 INFO:teuthology.orchestra.run.smithi101.stdout: "event": "started", 2023-08-01T19:54:37.647 INFO:teuthology.orchestra.run.smithi101.stdout: "time": "2023-08-01T19:54:37.586768+0000", 2023-08-01T19:54:37.647 INFO:teuthology.orchestra.run.smithi101.stdout: "duration": 2.3937000000000001e-05 2023-08-01T19:54:37.647 INFO:teuthology.orchestra.run.smithi101.stdout: } 2023-08-01T19:54:37.648 INFO:teuthology.orchestra.run.smithi101.stdout: ] 2023-08-01T19:54:37.648 INFO:teuthology.orchestra.run.smithi101.stdout: } 2023-08-01T19:54:37.648 INFO:teuthology.orchestra.run.smithi101.stdout: }, 2023-08-01T19:54:37.648 INFO:teuthology.orchestra.run.smithi101.stdout: { 2023-08-01T19:54:37.648 INFO:teuthology.orchestra.run.smithi101.stdout: "description": "osd_op(client.4668.0:43470 5.9 5:9287d969:::benchmark_data_smithi006_114134_object43469:head [set-alloc-hint object_size 65536 write_size 65536,write 0~65536 in=65536b] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e26)", 2023-08-01T19:54:37.648 INFO:teuthology.orchestra.run.smithi101.stdout: "initiated_at": "2023-08-01T19:54:37.587284+0000", 2023-08-01T19:54:37.648 INFO:teuthology.orchestra.run.smithi101.stdout: "age": 0.0024992370000000001, 2023-08-01T19:54:37.648 INFO:teuthology.orchestra.run.smithi101.stdout: "duration": 0.003178157, 2023-08-01T19:54:37.649 INFO:teuthology.orchestra.run.smithi101.stdout: "type_data": { 2023-08-01T19:54:37.649 INFO:teuthology.orchestra.run.smithi101.stdout: "flag_point": "waiting for sub ops", 2023-08-01T19:54:37.649 INFO:teuthology.orchestra.run.smithi101.stdout: "client_info": { 2023-08-01T19:54:37.649 INFO:teuthology.orchestra.run.smithi101.stdout: "client": "client.4668", 2023-08-01T19:54:37.649 INFO:teuthology.orchestra.run.smithi101.stdout: "client_addr": "172.21.15.6:0/1709472247", 2023-08-01T19:54:37.649 INFO:teuthology.orchestra.run.smithi101.stdout: "tid": 43470 2023-08-01T19:54:37.649 INFO:teuthology.orchestra.run.smithi101.stdout: }, 2023-08-01T19:54:37.649 INFO:teuthology.orchestra.run.smithi101.stdout: "events": [ 2023-08-01T19:54:37.650 INFO:teuthology.orchestra.run.smithi101.stdout: { 2023-08-01T19:54:37.650 INFO:teuthology.orchestra.run.smithi101.stdout: "event": "initiated", 2023-08-01T19:54:37.650 INFO:teuthology.orchestra.run.smithi101.stdout: "time": "2023-08-01T19:54:37.587284+0000", 2023-08-01T19:54:37.650 INFO:teuthology.orchestra.run.smithi101.stdout: "duration": 0 2023-08-01T19:54:37.650 INFO:teuthology.orchestra.run.smithi101.stdout: }, 2023-08-01T19:54:37.650 INFO:teuthology.orchestra.run.smithi101.stdout: { 2023-08-01T19:54:37.650 INFO:teuthology.orchestra.run.smithi101.stdout: "event": "throttled", 2023-08-01T19:54:37.650 INFO:teuthology.orchestra.run.smithi101.stdout: "time": "2023-08-01T19:54:37.587284+0000", 2023-08-01T19:54:37.651 INFO:teuthology.orchestra.run.smithi101.stdout: "duration": 0 2023-08-01T19:54:37.651 INFO:teuthology.orchestra.run.smithi101.stdout: }, 2023-08-01T19:54:37.651 INFO:teuthology.orchestra.run.smithi101.stdout: { 2023-08-01T19:54:37.651 INFO:teuthology.orchestra.run.smithi101.stdout: "event": "header_read", 2023-08-01T19:54:37.651 INFO:teuthology.orchestra.run.smithi101.stdout: "time": "2023-08-01T19:54:37.587283+0000", 2023-08-01T19:54:37.651 INFO:teuthology.orchestra.run.smithi101.stdout: "duration": 4294967295.9999986 2023-08-01T19:54:37.651 INFO:teuthology.orchestra.run.smithi101.stdout: }, 2023-08-01T19:54:37.651 INFO:teuthology.orchestra.run.smithi101.stdout: { 2023-08-01T19:54:37.652 INFO:teuthology.orchestra.run.smithi101.stdout: "event": "all_read", 2023-08-01T19:54:37.652 INFO:teuthology.orchestra.run.smithi101.stdout: "time": "2023-08-01T19:54:37.587340+0000", 2023-08-01T19:54:37.652 INFO:teuthology.orchestra.run.smithi101.stdout: "duration": 5.6677e-05 2023-08-01T19:54:37.652 INFO:teuthology.orchestra.run.smithi101.stdout: }, 2023-08-01T19:54:37.652 INFO:teuthology.orchestra.run.smithi101.stdout: { 2023-08-01T19:54:37.652 INFO:teuthology.orchestra.run.smithi101.stdout: "event": "dispatched", 2023-08-01T19:54:37.652 INFO:teuthology.orchestra.run.smithi101.stdout: "time": "2023-08-01T19:54:37.587350+0000", 2023-08-01T19:54:37.653 INFO:teuthology.orchestra.run.smithi101.stdout: "duration": 1.0584000000000001e-05 2023-08-01T19:54:37.653 INFO:teuthology.orchestra.run.smithi101.stdout: }, 2023-08-01T19:54:37.653 INFO:teuthology.orchestra.run.smithi101.stdout: { 2023-08-01T19:54:37.653 INFO:teuthology.orchestra.run.smithi101.stdout: "event": "queued_for_pg", 2023-08-01T19:54:37.653 INFO:teuthology.orchestra.run.smithi101.stdout: "time": "2023-08-01T19:54:37.587356+0000", 2023-08-01T19:54:37.653 INFO:teuthology.orchestra.run.smithi101.stdout: "duration": 6.0440000000000001e-06 2023-08-01T19:54:37.653 INFO:teuthology.orchestra.run.smithi101.stdout: }, 2023-08-01T19:54:37.653 INFO:teuthology.orchestra.run.smithi101.stdout: { 2023-08-01T19:54:37.653 INFO:teuthology.orchestra.run.smithi101.stdout: "event": "reached_pg", 2023-08-01T19:54:37.654 INFO:teuthology.orchestra.run.smithi101.stdout: "time": "2023-08-01T19:54:37.588944+0000", 2023-08-01T19:54:37.654 INFO:teuthology.orchestra.run.smithi101.stdout: "duration": 0.0015871279999999999 2023-08-01T19:54:37.654 INFO:teuthology.orchestra.run.smithi101.stdout: }, 2023-08-01T19:54:37.654 INFO:teuthology.orchestra.run.smithi101.stdout: { 2023-08-01T19:54:37.654 INFO:teuthology.orchestra.run.smithi101.stdout: "event": "started", 2023-08-01T19:54:37.654 INFO:teuthology.orchestra.run.smithi101.stdout: "time": "2023-08-01T19:54:37.589029+0000", 2023-08-01T19:54:37.654 INFO:teuthology.orchestra.run.smithi101.stdout: "duration": 8.5037999999999995e-05 2023-08-01T19:54:37.654 INFO:teuthology.orchestra.run.smithi101.stdout: }, 2023-08-01T19:54:37.655 INFO:teuthology.orchestra.run.smithi101.stdout: { 2023-08-01T19:54:37.655 INFO:teuthology.orchestra.run.smithi101.stdout: "event": "waiting for subops from 2", 2023-08-01T19:54:37.655 INFO:teuthology.orchestra.run.smithi101.stdout: "time": "2023-08-01T19:54:37.589109+0000", 2023-08-01T19:54:37.655 INFO:teuthology.orchestra.run.smithi101.stdout: "duration": 8.0538999999999996e-05 2023-08-01T19:54:37.655 INFO:teuthology.orchestra.run.smithi101.stdout: } 2023-08-01T19:54:37.655 INFO:teuthology.orchestra.run.smithi101.stdout: ] 2023-08-01T19:54:37.655 INFO:teuthology.orchestra.run.smithi101.stdout: } 2023-08-01T19:54:37.655 INFO:teuthology.orchestra.run.smithi101.stdout: }, 2023-08-01T19:54:37.656 INFO:teuthology.orchestra.run.smithi101.stdout: { 2023-08-01T19:54:37.656 INFO:teuthology.orchestra.run.smithi101.stdout: "description": "osd_op(client.4668.0:43471 5.7 5:ebbd6aa9:::benchmark_data_smithi006_114134_object43470:head [set-alloc-hint object_size 65536 write_size 65536,write 0~65536 in=65536b] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e26)", 2023-08-01T19:54:37.656 INFO:teuthology.orchestra.run.smithi101.stdout: "initiated_at": "2023-08-01T19:54:37.588325+0000", 2023-08-01T19:54:37.656 INFO:teuthology.orchestra.run.smithi101.stdout: "age": 0.001458427, 2023-08-01T19:54:37.656 INFO:teuthology.orchestra.run.smithi101.stdout: "duration": 0.0022250260000000002, 2023-08-01T19:54:37.656 INFO:teuthology.orchestra.run.smithi101.stdout: "type_data": { 2023-08-01T19:54:37.656 INFO:teuthology.orchestra.run.smithi101.stdout: "flag_point": "waiting for sub ops", 2023-08-01T19:54:37.657 INFO:teuthology.orchestra.run.smithi101.stdout: "client_info": { 2023-08-01T19:54:37.657 INFO:teuthology.orchestra.run.smithi101.stdout: "client": "client.4668", 2023-08-01T19:54:37.657 INFO:teuthology.orchestra.run.smithi101.stdout: "client_addr": "172.21.15.6:0/1709472247", 2023-08-01T19:54:37.657 INFO:teuthology.orchestra.run.smithi101.stdout: "tid": 43471 2023-08-01T19:54:37.657 INFO:teuthology.orchestra.run.smithi101.stdout: }, 2023-08-01T19:54:37.657 INFO:teuthology.orchestra.run.smithi101.stdout: "events": [ 2023-08-01T19:54:37.657 INFO:teuthology.orchestra.run.smithi101.stdout: { 2023-08-01T19:54:37.657 INFO:teuthology.orchestra.run.smithi101.stdout: "event": "initiated", 2023-08-01T19:54:37.658 INFO:teuthology.orchestra.run.smithi101.stdout: "time": "2023-08-01T19:54:37.588325+0000", 2023-08-01T19:54:37.658 INFO:teuthology.orchestra.run.smithi101.stdout: "duration": 0 2023-08-01T19:54:37.658 INFO:teuthology.orchestra.run.smithi101.stdout: }, 2023-08-01T19:54:37.658 INFO:teuthology.orchestra.run.smithi101.stdout: { 2023-08-01T19:54:37.658 INFO:teuthology.orchestra.run.smithi101.stdout: "event": "throttled", 2023-08-01T19:54:37.658 INFO:teuthology.orchestra.run.smithi101.stdout: "time": "2023-08-01T19:54:37.588325+0000", 2023-08-01T19:54:37.658 INFO:teuthology.orchestra.run.smithi101.stdout: "duration": 0 2023-08-01T19:54:37.658 INFO:teuthology.orchestra.run.smithi101.stdout: }, 2023-08-01T19:54:37.659 INFO:teuthology.orchestra.run.smithi101.stdout: { 2023-08-01T19:54:37.659 INFO:teuthology.orchestra.run.smithi101.stdout: "event": "header_read", 2023-08-01T19:54:37.659 INFO:teuthology.orchestra.run.smithi101.stdout: "time": "2023-08-01T19:54:37.588324+0000", 2023-08-01T19:54:37.659 INFO:teuthology.orchestra.run.smithi101.stdout: "duration": 4294967295.999999 2023-08-01T19:54:37.659 INFO:teuthology.orchestra.run.smithi101.stdout: }, 2023-08-01T19:54:37.659 INFO:teuthology.orchestra.run.smithi101.stdout: { 2023-08-01T19:54:37.659 INFO:teuthology.orchestra.run.smithi101.stdout: "event": "all_read", 2023-08-01T19:54:37.659 INFO:teuthology.orchestra.run.smithi101.stdout: "time": "2023-08-01T19:54:37.588399+0000", 2023-08-01T19:54:37.660 INFO:teuthology.orchestra.run.smithi101.stdout: "duration": 7.4973000000000002e-05 2023-08-01T19:54:37.660 INFO:teuthology.orchestra.run.smithi101.stdout: }, 2023-08-01T19:54:37.660 INFO:teuthology.orchestra.run.smithi101.stdout: { 2023-08-01T19:54:37.660 INFO:teuthology.orchestra.run.smithi101.stdout: "event": "dispatched", 2023-08-01T19:54:37.660 INFO:teuthology.orchestra.run.smithi101.stdout: "time": "2023-08-01T19:54:37.588410+0000", 2023-08-01T19:54:37.660 INFO:teuthology.orchestra.run.smithi101.stdout: "duration": 1.0715e-05 2023-08-01T19:54:37.660 INFO:teuthology.orchestra.run.smithi101.stdout: }, 2023-08-01T19:54:37.660 INFO:teuthology.orchestra.run.smithi101.stdout: { 2023-08-01T19:54:37.661 INFO:teuthology.orchestra.run.smithi101.stdout: "event": "queued_for_pg", 2023-08-01T19:54:37.661 INFO:teuthology.orchestra.run.smithi101.stdout: "time": "2023-08-01T19:54:37.588416+0000", 2023-08-01T19:54:37.661 INFO:teuthology.orchestra.run.smithi101.stdout: "duration": 5.7440000000000004e-06 2023-08-01T19:54:37.661 INFO:teuthology.orchestra.run.smithi101.stdout: }, 2023-08-01T19:54:37.661 INFO:teuthology.orchestra.run.smithi101.stdout: { 2023-08-01T19:54:37.661 INFO:teuthology.orchestra.run.smithi101.stdout: "event": "reached_pg", 2023-08-01T19:54:37.661 INFO:teuthology.orchestra.run.smithi101.stdout: "time": "2023-08-01T19:54:37.588460+0000", 2023-08-01T19:54:37.661 INFO:teuthology.orchestra.run.smithi101.stdout: "duration": 4.4347000000000001e-05 2023-08-01T19:54:37.662 INFO:teuthology.orchestra.run.smithi101.stdout: }, 2023-08-01T19:54:37.662 INFO:teuthology.orchestra.run.smithi101.stdout: { 2023-08-01T19:54:37.662 INFO:teuthology.orchestra.run.smithi101.stdout: "event": "started", 2023-08-01T19:54:37.662 INFO:teuthology.orchestra.run.smithi101.stdout: "time": "2023-08-01T19:54:37.588603+0000", 2023-08-01T19:54:37.662 INFO:teuthology.orchestra.run.smithi101.stdout: "duration": 0.00014312400000000001 2023-08-01T19:54:37.662 INFO:teuthology.orchestra.run.smithi101.stdout: }, 2023-08-01T19:54:37.662 INFO:teuthology.orchestra.run.smithi101.stdout: { 2023-08-01T19:54:37.662 INFO:teuthology.orchestra.run.smithi101.stdout: "event": "waiting for subops from 0", 2023-08-01T19:54:37.663 INFO:teuthology.orchestra.run.smithi101.stdout: "time": "2023-08-01T19:54:37.588745+0000", 2023-08-01T19:54:37.663 INFO:teuthology.orchestra.run.smithi101.stdout: "duration": 0.00014194899999999999 2023-08-01T19:54:37.663 INFO:teuthology.orchestra.run.smithi101.stdout: } 2023-08-01T19:54:37.663 INFO:teuthology.orchestra.run.smithi101.stdout: ] 2023-08-01T19:54:37.663 INFO:teuthology.orchestra.run.smithi101.stdout: } 2023-08-01T19:54:37.663 INFO:teuthology.orchestra.run.smithi101.stdout: }, 2023-08-01T19:54:37.663 INFO:teuthology.orchestra.run.smithi101.stdout: { 2023-08-01T19:54:37.663 INFO:teuthology.orchestra.run.smithi101.stdout: "description": "osd_repop(client.4668.0:43472 5.d e26/19 5:b34eab56:::benchmark_data_smithi006_114134_object43471:head v 26'2591, mlcod=26'2588)", 2023-08-01T19:54:37.664 INFO:teuthology.orchestra.run.smithi101.stdout: "initiated_at": "2023-08-01T19:54:37.589714+0000", 2023-08-01T19:54:37.664 INFO:teuthology.orchestra.run.smithi101.stdout: "age": 6.9805e-05, 2023-08-01T19:54:37.664 INFO:teuthology.orchestra.run.smithi101.stdout: "duration": 0.00091530300000000002, 2023-08-01T19:54:37.664 INFO:teuthology.orchestra.run.smithi101.stdout: "type_data": { 2023-08-01T19:54:37.664 INFO:teuthology.orchestra.run.smithi101.stdout: "flag_point": "started", 2023-08-01T19:54:37.664 INFO:teuthology.orchestra.run.smithi101.stdout: "events": [ 2023-08-01T19:54:37.664 INFO:teuthology.orchestra.run.smithi101.stdout: { 2023-08-01T19:54:37.665 INFO:teuthology.orchestra.run.smithi101.stdout: "event": "initiated", 2023-08-01T19:54:37.665 INFO:teuthology.orchestra.run.smithi101.stdout: "time": "2023-08-01T19:54:37.589714+0000", 2023-08-01T19:54:37.665 INFO:teuthology.orchestra.run.smithi101.stdout: "duration": 0 2023-08-01T19:54:37.665 INFO:teuthology.orchestra.run.smithi101.stdout: }, 2023-08-01T19:54:37.665 INFO:teuthology.orchestra.run.smithi101.stdout: { 2023-08-01T19:54:37.665 INFO:teuthology.orchestra.run.smithi101.stdout: "event": "throttled", 2023-08-01T19:54:37.665 INFO:teuthology.orchestra.run.smithi101.stdout: "time": "2023-08-01T19:54:37.589714+0000", 2023-08-01T19:54:37.665 INFO:teuthology.orchestra.run.smithi101.stdout: "duration": 0 2023-08-01T19:54:37.666 INFO:teuthology.orchestra.run.smithi101.stdout: }, 2023-08-01T19:54:37.666 INFO:teuthology.orchestra.run.smithi101.stdout: { 2023-08-01T19:54:37.666 INFO:teuthology.orchestra.run.smithi101.stdout: "event": "header_read", 2023-08-01T19:54:37.666 INFO:teuthology.orchestra.run.smithi101.stdout: "time": "2023-08-01T19:54:37.589713+0000", 2023-08-01T19:54:37.666 INFO:teuthology.orchestra.run.smithi101.stdout: "duration": 4294967295.9999995 2023-08-01T19:54:37.666 INFO:teuthology.orchestra.run.smithi101.stdout: }, 2023-08-01T19:54:37.666 INFO:teuthology.orchestra.run.smithi101.stdout: { 2023-08-01T19:54:37.666 INFO:teuthology.orchestra.run.smithi101.stdout: "event": "all_read", 2023-08-01T19:54:37.667 INFO:teuthology.orchestra.run.smithi101.stdout: "time": "2023-08-01T19:54:37.589791+0000", 2023-08-01T19:54:37.667 INFO:teuthology.orchestra.run.smithi101.stdout: "duration": 7.7443999999999999e-05 2023-08-01T19:54:37.667 INFO:teuthology.orchestra.run.smithi101.stdout: }, 2023-08-01T19:54:37.667 INFO:teuthology.orchestra.run.smithi101.stdout: { 2023-08-01T19:54:37.667 INFO:teuthology.orchestra.run.smithi101.stdout: "event": "dispatched", 2023-08-01T19:54:37.667 INFO:teuthology.orchestra.run.smithi101.stdout: "time": "2023-08-01T19:54:37.589798+0000", 2023-08-01T19:54:37.667 INFO:teuthology.orchestra.run.smithi101.stdout: "duration": 6.8349999999999998e-06 2023-08-01T19:54:37.668 INFO:teuthology.orchestra.run.smithi101.stdout: }, 2023-08-01T19:54:37.668 INFO:teuthology.orchestra.run.smithi101.stdout: { 2023-08-01T19:54:37.668 INFO:teuthology.orchestra.run.smithi101.stdout: "event": "queued_for_pg", 2023-08-01T19:54:37.668 INFO:teuthology.orchestra.run.smithi101.stdout: "time": "2023-08-01T19:54:37.589802+0000", 2023-08-01T19:54:37.668 INFO:teuthology.orchestra.run.smithi101.stdout: "duration": 4.1300000000000003e-06 2023-08-01T19:54:37.668 INFO:teuthology.orchestra.run.smithi101.stdout: }, 2023-08-01T19:54:37.668 INFO:teuthology.orchestra.run.smithi101.stdout: { 2023-08-01T19:54:37.669 INFO:teuthology.orchestra.run.smithi101.stdout: "event": "reached_pg", 2023-08-01T19:54:37.669 INFO:teuthology.orchestra.run.smithi101.stdout: "time": "2023-08-01T19:54:37.589825+0000", 2023-08-01T19:54:37.669 INFO:teuthology.orchestra.run.smithi101.stdout: "duration": 2.2901999999999999e-05 2023-08-01T19:54:37.669 INFO:teuthology.orchestra.run.smithi101.stdout: }, 2023-08-01T19:54:37.669 INFO:teuthology.orchestra.run.smithi101.stdout: { 2023-08-01T19:54:37.669 INFO:teuthology.orchestra.run.smithi101.stdout: "event": "started", 2023-08-01T19:54:37.669 INFO:teuthology.orchestra.run.smithi101.stdout: "time": "2023-08-01T19:54:37.589838+0000", 2023-08-01T19:54:37.669 INFO:teuthology.orchestra.run.smithi101.stdout: "duration": 1.3621999999999999e-05 2023-08-01T19:54:37.670 INFO:teuthology.orchestra.run.smithi101.stdout: } 2023-08-01T19:54:37.670 INFO:teuthology.orchestra.run.smithi101.stdout: ] 2023-08-01T19:54:37.670 INFO:teuthology.orchestra.run.smithi101.stdout: } 2023-08-01T19:54:37.670 INFO:teuthology.orchestra.run.smithi101.stdout: } 2023-08-01T19:54:37.670 INFO:teuthology.orchestra.run.smithi101.stdout: ], 2023-08-01T19:54:37.670 INFO:teuthology.orchestra.run.smithi101.stdout: "num_ops": 10 2023-08-01T19:54:37.670 INFO:teuthology.orchestra.run.smithi101.stdout:} 2023-08-01T19:54:37.672 INFO:tasks.ceph.osd.2.smithi155.stderr:2023-08-01T19:54:37.670+0000 7faa5c6ac700 -1 received signal: Hangup from /usr/bin/python3 /bin/daemon-helper kill ceph-osd -f --cluster ceph -i 2 (PID: 111337) UID: 0 2023-08-01T19:54:37.672 DEBUG:teuthology.orchestra.run.smithi101:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 30 ceph --cluster ceph --admin-daemon /var/run/ceph/ceph-osd.1.asok dump_blocked_ops 2023-08-01T19:54:37.772 INFO:tasks.ceph.osd.2.smithi155.stderr:2023-08-01T19:54:37.771+0000 7faa5c6ac700 -1 received signal: Hangup from /usr/bin/python3 /bin/daemon-helper kill ceph-osd -f --cluster ceph -i 2 (PID: 111337) UID: 0 2023-08-01T19:54:37.842 INFO:teuthology.orchestra.run.smithi101.stdout:{ 2023-08-01T19:54:37.842 INFO:teuthology.orchestra.run.smithi101.stdout: "ops": [], 2023-08-01T19:54:37.842 INFO:teuthology.orchestra.run.smithi101.stdout: "complaint_time": 30, 2023-08-01T19:54:37.842 INFO:teuthology.orchestra.run.smithi101.stdout: "num_blocked_ops": 0 2023-08-01T19:54:37.842 INFO:teuthology.orchestra.run.smithi101.stdout:} 2023-08-01T19:54:37.857 DEBUG:teuthology.orchestra.run.smithi101:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 30 ceph --cluster ceph --admin-daemon /var/run/ceph/ceph-osd.1.asok dump_historic_ops 2023-08-01T19:54:37.900 INFO:tasks.ceph.osd.1.smithi101.stderr:2023-08-01T19:54:37.899+0000 7fb0cb7f6700 -1 received signal: Hangup from /usr/bin/python3 /bin/daemon-helper kill ceph-osd -f --cluster ceph -i 1 (PID: 111141) UID: 0 2023-08-01T19:54:37.973 INFO:tasks.ceph.osd.0.smithi008.stderr:2023-08-01T19:54:37.972+0000 7f16a58f4700 -1 received signal: Hangup from /usr/bin/python3 /bin/daemon-helper kill ceph-osd -f --cluster ceph -i 0 (PID: 111179) UID: 0 2023-08-01T19:54:38.033 INFO:teuthology.orchestra.run.smithi101.stdout:{ 2023-08-01T19:54:38.034 INFO:teuthology.orchestra.run.smithi101.stdout: "size": 20, 2023-08-01T19:54:38.034 INFO:teuthology.orchestra.run.smithi101.stdout: "duration": 600, 2023-08-01T19:54:38.034 INFO:teuthology.orchestra.run.smithi101.stdout: "ops": [ 2023-08-01T19:54:38.034 INFO:teuthology.orchestra.run.smithi101.stdout: { 2023-08-01T19:54:38.034 INFO:teuthology.orchestra.run.smithi101.stdout: "description": "osd_op(mds.0.3:6 3.10 3:0d82a743:::600.00000000:head [omap-set-header] snapc 0=[] ondisk+write+known_if_redirected+full_force+supports_pool_eio e17)", 2023-08-01T19:54:38.034 INFO:teuthology.orchestra.run.smithi101.stdout: "initiated_at": "2023-08-01T19:54:04.458774+0000", 2023-08-01T19:54:38.034 INFO:teuthology.orchestra.run.smithi101.stdout: "age": 33.571530363000001, 2023-08-01T19:54:38.035 INFO:teuthology.orchestra.run.smithi101.stdout: "duration": 0.017582611000000001, 2023-08-01T19:54:38.035 INFO:teuthology.orchestra.run.smithi101.stdout: "type_data": { 2023-08-01T19:54:38.035 INFO:teuthology.orchestra.run.smithi101.stdout: "flag_point": "commit sent; apply or cleanup", 2023-08-01T19:54:38.035 INFO:teuthology.orchestra.run.smithi101.stdout: "events": [ 2023-08-01T19:54:38.035 INFO:teuthology.orchestra.run.smithi101.stdout: { 2023-08-01T19:54:38.035 INFO:teuthology.orchestra.run.smithi101.stdout: "event": "initiated", 2023-08-01T19:54:38.035 INFO:teuthology.orchestra.run.smithi101.stdout: "time": "2023-08-01T19:54:04.458774+0000", 2023-08-01T19:54:38.035 INFO:teuthology.orchestra.run.smithi101.stdout: "duration": 0 2023-08-01T19:54:38.036 INFO:teuthology.orchestra.run.smithi101.stdout: }, 2023-08-01T19:54:38.036 INFO:teuthology.orchestra.run.smithi101.stdout: { 2023-08-01T19:54:38.036 INFO:teuthology.orchestra.run.smithi101.stdout: "event": "throttled", 2023-08-01T19:54:38.036 INFO:teuthology.orchestra.run.smithi101.stdout: "time": "2023-08-01T19:54:04.458774+0000", 2023-08-01T19:54:38.036 INFO:teuthology.orchestra.run.smithi101.stdout: "duration": 0 2023-08-01T19:54:38.036 INFO:teuthology.orchestra.run.smithi101.stdout: }, 2023-08-01T19:54:38.036 INFO:teuthology.orchestra.run.smithi101.stdout: { 2023-08-01T19:54:38.037 INFO:teuthology.orchestra.run.smithi101.stdout: "event": "header_read", 2023-08-01T19:54:38.037 INFO:teuthology.orchestra.run.smithi101.stdout: "time": "2023-08-01T19:54:04.458772+0000", 2023-08-01T19:54:38.037 INFO:teuthology.orchestra.run.smithi101.stdout: "duration": 4294967295.9999981 2023-08-01T19:54:38.037 INFO:teuthology.orchestra.run.smithi101.stdout: }, 2023-08-01T19:54:38.037 INFO:teuthology.orchestra.run.smithi101.stdout: { 2023-08-01T19:54:38.037 INFO:teuthology.orchestra.run.smithi101.stdout: "event": "all_read", 2023-08-01T19:54:38.037 INFO:teuthology.orchestra.run.smithi101.stdout: "time": "2023-08-01T19:54:04.458781+0000", 2023-08-01T19:54:38.037 INFO:teuthology.orchestra.run.smithi101.stdout: "duration": 8.6670000000000002e-06 2023-08-01T19:54:38.038 INFO:teuthology.orchestra.run.smithi101.stdout: }, 2023-08-01T19:54:38.038 INFO:teuthology.orchestra.run.smithi101.stdout: { 2023-08-01T19:54:38.038 INFO:teuthology.orchestra.run.smithi101.stdout: "event": "dispatched", 2023-08-01T19:54:38.038 INFO:teuthology.orchestra.run.smithi101.stdout: "time": "2023-08-01T19:54:04.458797+0000", 2023-08-01T19:54:38.038 INFO:teuthology.orchestra.run.smithi101.stdout: "duration": 1.6463000000000001e-05 2023-08-01T19:54:38.038 INFO:teuthology.orchestra.run.smithi101.stdout: }, 2023-08-01T19:54:38.038 INFO:teuthology.orchestra.run.smithi101.stdout: { 2023-08-01T19:54:38.038 INFO:teuthology.orchestra.run.smithi101.stdout: "event": "queued_for_pg", 2023-08-01T19:54:38.039 INFO:teuthology.orchestra.run.smithi101.stdout: "time": "2023-08-01T19:54:04.458810+0000", 2023-08-01T19:54:38.039 INFO:teuthology.orchestra.run.smithi101.stdout: "duration": 1.2753e-05 2023-08-01T19:54:38.039 INFO:teuthology.orchestra.run.smithi101.stdout: }, 2023-08-01T19:54:38.039 INFO:teuthology.orchestra.run.smithi101.stdout: { 2023-08-01T19:54:38.039 INFO:teuthology.orchestra.run.smithi101.stdout: "event": "reached_pg", 2023-08-01T19:54:38.039 INFO:teuthology.orchestra.run.smithi101.stdout: "time": "2023-08-01T19:54:04.458866+0000", 2023-08-01T19:54:38.039 INFO:teuthology.orchestra.run.smithi101.stdout: "duration": 5.6625000000000001e-05 2023-08-01T19:54:38.039 INFO:teuthology.orchestra.run.smithi101.stdout: }, 2023-08-01T19:54:38.040 INFO:teuthology.orchestra.run.smithi101.stdout: { 2023-08-01T19:54:38.040 INFO:teuthology.orchestra.run.smithi101.stdout: "event": "op must wait for map", 2023-08-01T19:54:38.040 INFO:teuthology.orchestra.run.smithi101.stdout: "time": "2023-08-01T19:54:04.458873+0000", 2023-08-01T19:54:38.040 INFO:teuthology.orchestra.run.smithi101.stdout: "duration": 6.9110000000000004e-06 2023-08-01T19:54:38.040 INFO:teuthology.orchestra.run.smithi101.stdout: }, 2023-08-01T19:54:38.040 INFO:teuthology.orchestra.run.smithi101.stdout: { 2023-08-01T19:54:38.040 INFO:teuthology.orchestra.run.smithi101.stdout: "event": "reached_pg", 2023-08-01T19:54:38.041 INFO:teuthology.orchestra.run.smithi101.stdout: "time": "2023-08-01T19:54:04.466999+0000", 2023-08-01T19:54:38.041 INFO:teuthology.orchestra.run.smithi101.stdout: "duration": 0.0081256550000000007 2023-08-01T19:54:38.041 INFO:teuthology.orchestra.run.smithi101.stdout: }, 2023-08-01T19:54:38.041 INFO:teuthology.orchestra.run.smithi101.stdout: { 2023-08-01T19:54:38.041 INFO:teuthology.orchestra.run.smithi101.stdout: "event": "started", 2023-08-01T19:54:38.041 INFO:teuthology.orchestra.run.smithi101.stdout: "time": "2023-08-01T19:54:04.467201+0000", 2023-08-01T19:54:38.041 INFO:teuthology.orchestra.run.smithi101.stdout: "duration": 0.00020166199999999999 2023-08-01T19:54:38.041 INFO:teuthology.orchestra.run.smithi101.stdout: }, 2023-08-01T19:54:38.042 INFO:teuthology.orchestra.run.smithi101.stdout: { 2023-08-01T19:54:38.042 INFO:teuthology.orchestra.run.smithi101.stdout: "event": "waiting for subops from 2", 2023-08-01T19:54:38.042 INFO:teuthology.orchestra.run.smithi101.stdout: "time": "2023-08-01T19:54:04.467350+0000", 2023-08-01T19:54:38.042 INFO:teuthology.orchestra.run.smithi101.stdout: "duration": 0.000149173 2023-08-01T19:54:38.042 INFO:teuthology.orchestra.run.smithi101.stdout: }, 2023-08-01T19:54:38.042 INFO:teuthology.orchestra.run.smithi101.stdout: { 2023-08-01T19:54:38.042 INFO:teuthology.orchestra.run.smithi101.stdout: "event": "op_commit", 2023-08-01T19:54:38.043 INFO:teuthology.orchestra.run.smithi101.stdout: "time": "2023-08-01T19:54:04.476168+0000", 2023-08-01T19:54:38.043 INFO:teuthology.orchestra.run.smithi101.stdout: "duration": 0.0088183250000000001 2023-08-01T19:54:38.043 INFO:teuthology.orchestra.run.smithi101.stdout: }, 2023-08-01T19:54:38.043 INFO:teuthology.orchestra.run.smithi101.stdout: { 2023-08-01T19:54:38.043 INFO:teuthology.orchestra.run.smithi101.stdout: "event": "sub_op_commit_rec", 2023-08-01T19:54:38.043 INFO:teuthology.orchestra.run.smithi101.stdout: "time": "2023-08-01T19:54:04.476239+0000", 2023-08-01T19:54:38.043 INFO:teuthology.orchestra.run.smithi101.stdout: "duration": 7.1296000000000003e-05 2023-08-01T19:54:38.044 INFO:teuthology.orchestra.run.smithi101.stdout: }, 2023-08-01T19:54:38.044 INFO:teuthology.orchestra.run.smithi101.stdout: { 2023-08-01T19:54:38.044 INFO:teuthology.orchestra.run.smithi101.stdout: "event": "commit_sent", 2023-08-01T19:54:38.044 INFO:teuthology.orchestra.run.smithi101.stdout: "time": "2023-08-01T19:54:04.476290+0000", 2023-08-01T19:54:38.044 INFO:teuthology.orchestra.run.smithi101.stdout: "duration": 5.0423999999999997e-05 2023-08-01T19:54:38.044 INFO:teuthology.orchestra.run.smithi101.stdout: }, 2023-08-01T19:54:38.044 INFO:teuthology.orchestra.run.smithi101.stdout: { 2023-08-01T19:54:38.044 INFO:teuthology.orchestra.run.smithi101.stdout: "event": "done", 2023-08-01T19:54:38.045 INFO:teuthology.orchestra.run.smithi101.stdout: "time": "2023-08-01T19:54:04.476356+0000", 2023-08-01T19:54:38.045 INFO:teuthology.orchestra.run.smithi101.stdout: "duration": 6.6439000000000005e-05 2023-08-01T19:54:38.045 INFO:teuthology.orchestra.run.smithi101.stdout: } 2023-08-01T19:54:38.045 INFO:teuthology.orchestra.run.smithi101.stdout: ] 2023-08-01T19:54:38.045 INFO:teuthology.orchestra.run.smithi101.stdout: } 2023-08-01T19:54:38.045 INFO:teuthology.orchestra.run.smithi101.stdout: }, 2023-08-01T19:54:38.045 INFO:teuthology.orchestra.run.smithi101.stdout: { 2023-08-01T19:54:38.046 INFO:teuthology.orchestra.run.smithi101.stdout: "description": "osd_op(mds.0.3:7 3.10 3:0d82a743:::600.00000000:head [create,setxattr parent (62) in=6b,setxattr layout (30) in=6b] snapc 0=[] ondisk+write+known_if_redirected+full_force+supports_pool_eio e17)", 2023-08-01T19:54:38.046 INFO:teuthology.orchestra.run.smithi101.stdout: "initiated_at": "2023-08-01T19:54:04.458830+0000", 2023-08-01T19:54:38.046 INFO:teuthology.orchestra.run.smithi101.stdout: "age": 33.571473976, 2023-08-01T19:54:38.046 INFO:teuthology.orchestra.run.smithi101.stdout: "duration": 0.018463726, 2023-08-01T19:54:38.046 INFO:teuthology.orchestra.run.smithi101.stdout: "type_data": { 2023-08-01T19:54:38.046 INFO:teuthology.orchestra.run.smithi101.stdout: "flag_point": "commit sent; apply or cleanup", 2023-08-01T19:54:38.046 INFO:teuthology.orchestra.run.smithi101.stdout: "events": [ 2023-08-01T19:54:38.047 INFO:teuthology.orchestra.run.smithi101.stdout: { 2023-08-01T19:54:38.047 INFO:teuthology.orchestra.run.smithi101.stdout: "event": "initiated", 2023-08-01T19:54:38.047 INFO:teuthology.orchestra.run.smithi101.stdout: "time": "2023-08-01T19:54:04.458830+0000", 2023-08-01T19:54:38.047 INFO:teuthology.orchestra.run.smithi101.stdout: "duration": 0 2023-08-01T19:54:38.047 INFO:teuthology.orchestra.run.smithi101.stdout: }, 2023-08-01T19:54:38.047 INFO:teuthology.orchestra.run.smithi101.stdout: { 2023-08-01T19:54:38.047 INFO:teuthology.orchestra.run.smithi101.stdout: "event": "throttled", 2023-08-01T19:54:38.047 INFO:teuthology.orchestra.run.smithi101.stdout: "time": "2023-08-01T19:54:04.458830+0000", 2023-08-01T19:54:38.048 INFO:teuthology.orchestra.run.smithi101.stdout: "duration": 0 2023-08-01T19:54:38.048 INFO:teuthology.orchestra.run.smithi101.stdout: }, 2023-08-01T19:54:38.048 INFO:teuthology.orchestra.run.smithi101.stdout: { 2023-08-01T19:54:38.048 INFO:teuthology.orchestra.run.smithi101.stdout: "event": "header_read", 2023-08-01T19:54:38.048 INFO:teuthology.orchestra.run.smithi101.stdout: "time": "2023-08-01T19:54:04.458829+0000", 2023-08-01T19:54:38.048 INFO:teuthology.orchestra.run.smithi101.stdout: "duration": 4294967295.999999 2023-08-01T19:54:38.048 INFO:teuthology.orchestra.run.smithi101.stdout: }, 2023-08-01T19:54:38.048 INFO:teuthology.orchestra.run.smithi101.stdout: { 2023-08-01T19:54:38.049 INFO:teuthology.orchestra.run.smithi101.stdout: "event": "all_read", 2023-08-01T19:54:38.049 INFO:teuthology.orchestra.run.smithi101.stdout: "time": "2023-08-01T19:54:04.458838+0000", 2023-08-01T19:54:38.049 INFO:teuthology.orchestra.run.smithi101.stdout: "duration": 8.5369999999999997e-06 2023-08-01T19:54:38.049 INFO:teuthology.orchestra.run.smithi101.stdout: }, 2023-08-01T19:54:38.049 INFO:teuthology.orchestra.run.smithi101.stdout: { 2023-08-01T19:54:38.049 INFO:teuthology.orchestra.run.smithi101.stdout: "event": "dispatched", 2023-08-01T19:54:38.049 INFO:teuthology.orchestra.run.smithi101.stdout: "time": "2023-08-01T19:54:04.458850+0000", 2023-08-01T19:54:38.049 INFO:teuthology.orchestra.run.smithi101.stdout: "duration": 1.203e-05 2023-08-01T19:54:38.050 INFO:teuthology.orchestra.run.smithi101.stdout: }, 2023-08-01T19:54:38.050 INFO:teuthology.orchestra.run.smithi101.stdout: { 2023-08-01T19:54:38.050 INFO:teuthology.orchestra.run.smithi101.stdout: "event": "queued_for_pg", 2023-08-01T19:54:38.050 INFO:teuthology.orchestra.run.smithi101.stdout: "time": "2023-08-01T19:54:04.458859+0000", 2023-08-01T19:54:38.050 INFO:teuthology.orchestra.run.smithi101.stdout: "duration": 8.9889999999999998e-06 2023-08-01T19:54:38.050 INFO:teuthology.orchestra.run.smithi101.stdout: }, 2023-08-01T19:54:38.050 INFO:teuthology.orchestra.run.smithi101.stdout: { 2023-08-01T19:54:38.051 INFO:teuthology.orchestra.run.smithi101.stdout: "event": "reached_pg", 2023-08-01T19:54:38.051 INFO:teuthology.orchestra.run.smithi101.stdout: "time": "2023-08-01T19:54:04.458926+0000", 2023-08-01T19:54:38.051 INFO:teuthology.orchestra.run.smithi101.stdout: "duration": 6.6741000000000004e-05 2023-08-01T19:54:38.051 INFO:teuthology.orchestra.run.smithi101.stdout: }, 2023-08-01T19:54:38.051 INFO:teuthology.orchestra.run.smithi101.stdout: { 2023-08-01T19:54:38.051 INFO:teuthology.orchestra.run.smithi101.stdout: "event": "waiting_for_map not empty", 2023-08-01T19:54:38.051 INFO:teuthology.orchestra.run.smithi101.stdout: "time": "2023-08-01T19:54:04.458929+0000", 2023-08-01T19:54:38.051 INFO:teuthology.orchestra.run.smithi101.stdout: "duration": 3.303e-06 2023-08-01T19:54:38.052 INFO:teuthology.orchestra.run.smithi101.stdout: }, 2023-08-01T19:54:38.052 INFO:teuthology.orchestra.run.smithi101.stdout: { 2023-08-01T19:54:38.052 INFO:teuthology.orchestra.run.smithi101.stdout: "event": "reached_pg", 2023-08-01T19:54:38.052 INFO:teuthology.orchestra.run.smithi101.stdout: "time": "2023-08-01T19:54:04.468692+0000", 2023-08-01T19:54:38.052 INFO:teuthology.orchestra.run.smithi101.stdout: "duration": 0.0097635910000000003 2023-08-01T19:54:38.052 INFO:teuthology.orchestra.run.smithi101.stdout: }, 2023-08-01T19:54:38.052 INFO:teuthology.orchestra.run.smithi101.stdout: { 2023-08-01T19:54:38.053 INFO:teuthology.orchestra.run.smithi101.stdout: "event": "started", 2023-08-01T19:54:38.053 INFO:teuthology.orchestra.run.smithi101.stdout: "time": "2023-08-01T19:54:04.468774+0000", 2023-08-01T19:54:38.053 INFO:teuthology.orchestra.run.smithi101.stdout: "duration": 8.1092000000000002e-05 2023-08-01T19:54:38.053 INFO:teuthology.orchestra.run.smithi101.stdout: }, 2023-08-01T19:54:38.053 INFO:teuthology.orchestra.run.smithi101.stdout: { 2023-08-01T19:54:38.053 INFO:teuthology.orchestra.run.smithi101.stdout: "event": "waiting for subops from 2", 2023-08-01T19:54:38.053 INFO:teuthology.orchestra.run.smithi101.stdout: "time": "2023-08-01T19:54:04.468934+0000", 2023-08-01T19:54:38.054 INFO:teuthology.orchestra.run.smithi101.stdout: "duration": 0.000160027 2023-08-01T19:54:38.054 INFO:teuthology.orchestra.run.smithi101.stdout: }, 2023-08-01T19:54:38.054 INFO:teuthology.orchestra.run.smithi101.stdout: { 2023-08-01T19:54:38.054 INFO:teuthology.orchestra.run.smithi101.stdout: "event": "op_commit", 2023-08-01T19:54:38.054 INFO:teuthology.orchestra.run.smithi101.stdout: "time": "2023-08-01T19:54:04.476174+0000", 2023-08-01T19:54:38.054 INFO:teuthology.orchestra.run.smithi101.stdout: "duration": 0.0072400479999999998 2023-08-01T19:54:38.054 INFO:teuthology.orchestra.run.smithi101.stdout: }, 2023-08-01T19:54:38.055 INFO:teuthology.orchestra.run.smithi101.stdout: { 2023-08-01T19:54:38.055 INFO:teuthology.orchestra.run.smithi101.stdout: "event": "sub_op_commit_rec", 2023-08-01T19:54:38.055 INFO:teuthology.orchestra.run.smithi101.stdout: "time": "2023-08-01T19:54:04.477206+0000", 2023-08-01T19:54:38.055 INFO:teuthology.orchestra.run.smithi101.stdout: "duration": 0.0010318969999999999 2023-08-01T19:54:38.055 INFO:teuthology.orchestra.run.smithi101.stdout: }, 2023-08-01T19:54:38.055 INFO:teuthology.orchestra.run.smithi101.stdout: { 2023-08-01T19:54:38.055 INFO:teuthology.orchestra.run.smithi101.stdout: "event": "commit_sent", 2023-08-01T19:54:38.056 INFO:teuthology.orchestra.run.smithi101.stdout: "time": "2023-08-01T19:54:04.477257+0000", 2023-08-01T19:54:38.056 INFO:teuthology.orchestra.run.smithi101.stdout: "duration": 5.1156000000000003e-05 2023-08-01T19:54:38.056 INFO:teuthology.orchestra.run.smithi101.stdout: }, 2023-08-01T19:54:38.056 INFO:teuthology.orchestra.run.smithi101.stdout: { 2023-08-01T19:54:38.056 INFO:teuthology.orchestra.run.smithi101.stdout: "event": "done", 2023-08-01T19:54:38.056 INFO:teuthology.orchestra.run.smithi101.stdout: "time": "2023-08-01T19:54:04.477294+0000", 2023-08-01T19:54:38.056 INFO:teuthology.orchestra.run.smithi101.stdout: "duration": 3.7150000000000002e-05 2023-08-01T19:54:38.056 INFO:teuthology.orchestra.run.smithi101.stdout: } 2023-08-01T19:54:38.057 INFO:teuthology.orchestra.run.smithi101.stdout: ] 2023-08-01T19:54:38.057 INFO:teuthology.orchestra.run.smithi101.stdout: } 2023-08-01T19:54:38.057 INFO:teuthology.orchestra.run.smithi101.stdout: }, 2023-08-01T19:54:38.057 INFO:teuthology.orchestra.run.smithi101.stdout: { 2023-08-01T19:54:38.057 INFO:teuthology.orchestra.run.smithi101.stdout: "description": "osd_op(mds.0.3:8 3.10 3:09401a81:::601.00000000:head [omap-set-header] snapc 0=[] ondisk+write+known_if_redirected+full_force+supports_pool_eio e17)", 2023-08-01T19:54:38.057 INFO:teuthology.orchestra.run.smithi101.stdout: "initiated_at": "2023-08-01T19:54:04.458869+0000", 2023-08-01T19:54:38.057 INFO:teuthology.orchestra.run.smithi101.stdout: "age": 33.571434840000002, 2023-08-01T19:54:38.057 INFO:teuthology.orchestra.run.smithi101.stdout: "duration": 0.018528932000000001, 2023-08-01T19:54:38.058 INFO:teuthology.orchestra.run.smithi101.stdout: "type_data": { 2023-08-01T19:54:38.058 INFO:teuthology.orchestra.run.smithi101.stdout: "flag_point": "commit sent; apply or cleanup", 2023-08-01T19:54:38.058 INFO:teuthology.orchestra.run.smithi101.stdout: "events": [ 2023-08-01T19:54:38.058 INFO:teuthology.orchestra.run.smithi101.stdout: { 2023-08-01T19:54:38.058 INFO:teuthology.orchestra.run.smithi101.stdout: "event": "initiated", 2023-08-01T19:54:38.058 INFO:teuthology.orchestra.run.smithi101.stdout: "time": "2023-08-01T19:54:04.458869+0000", 2023-08-01T19:54:38.058 INFO:teuthology.orchestra.run.smithi101.stdout: "duration": 0 2023-08-01T19:54:38.058 INFO:teuthology.orchestra.run.smithi101.stdout: }, 2023-08-01T19:54:38.059 INFO:teuthology.orchestra.run.smithi101.stdout: { 2023-08-01T19:54:38.059 INFO:teuthology.orchestra.run.smithi101.stdout: "event": "throttled", 2023-08-01T19:54:38.059 INFO:teuthology.orchestra.run.smithi101.stdout: "time": "2023-08-01T19:54:04.458869+0000", 2023-08-01T19:54:38.059 INFO:teuthology.orchestra.run.smithi101.stdout: "duration": 0 2023-08-01T19:54:38.059 INFO:teuthology.orchestra.run.smithi101.stdout: }, 2023-08-01T19:54:38.059 INFO:teuthology.orchestra.run.smithi101.stdout: { 2023-08-01T19:54:38.059 INFO:teuthology.orchestra.run.smithi101.stdout: "event": "header_read", 2023-08-01T19:54:38.060 INFO:teuthology.orchestra.run.smithi101.stdout: "time": "2023-08-01T19:54:04.458869+0000", 2023-08-01T19:54:38.060 INFO:teuthology.orchestra.run.smithi101.stdout: "duration": 4294967295.9999995 2023-08-01T19:54:38.060 INFO:teuthology.orchestra.run.smithi101.stdout: }, 2023-08-01T19:54:38.060 INFO:teuthology.orchestra.run.smithi101.stdout: { 2023-08-01T19:54:38.060 INFO:teuthology.orchestra.run.smithi101.stdout: "event": "all_read", 2023-08-01T19:54:38.060 INFO:teuthology.orchestra.run.smithi101.stdout: "time": "2023-08-01T19:54:04.458878+0000", 2023-08-01T19:54:38.060 INFO:teuthology.orchestra.run.smithi101.stdout: "duration": 9.4110000000000002e-06 2023-08-01T19:54:38.060 INFO:teuthology.orchestra.run.smithi101.stdout: }, 2023-08-01T19:54:38.061 INFO:teuthology.orchestra.run.smithi101.stdout: { 2023-08-01T19:54:38.061 INFO:teuthology.orchestra.run.smithi101.stdout: "event": "dispatched", 2023-08-01T19:54:38.061 INFO:teuthology.orchestra.run.smithi101.stdout: "time": "2023-08-01T19:54:04.458886+0000", 2023-08-01T19:54:38.061 INFO:teuthology.orchestra.run.smithi101.stdout: "duration": 7.6090000000000003e-06 2023-08-01T19:54:38.061 INFO:teuthology.orchestra.run.smithi101.stdout: }, 2023-08-01T19:54:38.061 INFO:teuthology.orchestra.run.smithi101.stdout: { 2023-08-01T19:54:38.061 INFO:teuthology.orchestra.run.smithi101.stdout: "event": "queued_for_pg", 2023-08-01T19:54:38.061 INFO:teuthology.orchestra.run.smithi101.stdout: "time": "2023-08-01T19:54:04.458890+0000", 2023-08-01T19:54:38.062 INFO:teuthology.orchestra.run.smithi101.stdout: "duration": 4.8470000000000003e-06 2023-08-01T19:54:38.062 INFO:teuthology.orchestra.run.smithi101.stdout: }, 2023-08-01T19:54:38.062 INFO:teuthology.orchestra.run.smithi101.stdout: { 2023-08-01T19:54:38.062 INFO:teuthology.orchestra.run.smithi101.stdout: "event": "reached_pg", 2023-08-01T19:54:38.062 INFO:teuthology.orchestra.run.smithi101.stdout: "time": "2023-08-01T19:54:04.458957+0000", 2023-08-01T19:54:38.062 INFO:teuthology.orchestra.run.smithi101.stdout: "duration": 6.6502999999999997e-05 2023-08-01T19:54:38.062 INFO:teuthology.orchestra.run.smithi101.stdout: }, 2023-08-01T19:54:38.062 INFO:teuthology.orchestra.run.smithi101.stdout: { 2023-08-01T19:54:38.063 INFO:teuthology.orchestra.run.smithi101.stdout: "event": "waiting_for_map not empty", 2023-08-01T19:54:38.063 INFO:teuthology.orchestra.run.smithi101.stdout: "time": "2023-08-01T19:54:04.458959+0000", 2023-08-01T19:54:38.063 INFO:teuthology.orchestra.run.smithi101.stdout: "duration": 2.3989999999999998e-06 2023-08-01T19:54:38.063 INFO:teuthology.orchestra.run.smithi101.stdout: }, 2023-08-01T19:54:38.063 INFO:teuthology.orchestra.run.smithi101.stdout: { 2023-08-01T19:54:38.063 INFO:teuthology.orchestra.run.smithi101.stdout: "event": "reached_pg", 2023-08-01T19:54:38.063 INFO:teuthology.orchestra.run.smithi101.stdout: "time": "2023-08-01T19:54:04.469554+0000", 2023-08-01T19:54:38.064 INFO:teuthology.orchestra.run.smithi101.stdout: "duration": 0.010594404 2023-08-01T19:54:38.064 INFO:teuthology.orchestra.run.smithi101.stdout: }, 2023-08-01T19:54:38.064 INFO:teuthology.orchestra.run.smithi101.stdout: { 2023-08-01T19:54:38.064 INFO:teuthology.orchestra.run.smithi101.stdout: "event": "started", 2023-08-01T19:54:38.064 INFO:teuthology.orchestra.run.smithi101.stdout: "time": "2023-08-01T19:54:04.469694+0000", 2023-08-01T19:54:38.064 INFO:teuthology.orchestra.run.smithi101.stdout: "duration": 0.00014006899999999999 2023-08-01T19:54:38.064 INFO:teuthology.orchestra.run.smithi101.stdout: }, 2023-08-01T19:54:38.065 INFO:teuthology.orchestra.run.smithi101.stdout: { 2023-08-01T19:54:38.065 INFO:teuthology.orchestra.run.smithi101.stdout: "event": "waiting for subops from 2", 2023-08-01T19:54:38.065 INFO:teuthology.orchestra.run.smithi101.stdout: "time": "2023-08-01T19:54:04.469826+0000", 2023-08-01T19:54:38.065 INFO:teuthology.orchestra.run.smithi101.stdout: "duration": 0.000132285 2023-08-01T19:54:38.065 INFO:teuthology.orchestra.run.smithi101.stdout: }, 2023-08-01T19:54:38.065 INFO:teuthology.orchestra.run.smithi101.stdout: { 2023-08-01T19:54:38.065 INFO:teuthology.orchestra.run.smithi101.stdout: "event": "op_commit", 2023-08-01T19:54:38.065 INFO:teuthology.orchestra.run.smithi101.stdout: "time": "2023-08-01T19:54:04.476179+0000", 2023-08-01T19:54:38.066 INFO:teuthology.orchestra.run.smithi101.stdout: "duration": 0.0063524289999999997 2023-08-01T19:54:38.066 INFO:teuthology.orchestra.run.smithi101.stdout: }, 2023-08-01T19:54:38.066 INFO:teuthology.orchestra.run.smithi101.stdout: { 2023-08-01T19:54:38.066 INFO:teuthology.orchestra.run.smithi101.stdout: "event": "sub_op_commit_rec", 2023-08-01T19:54:38.066 INFO:teuthology.orchestra.run.smithi101.stdout: "time": "2023-08-01T19:54:04.477334+0000", 2023-08-01T19:54:38.066 INFO:teuthology.orchestra.run.smithi101.stdout: "duration": 0.0011551070000000001 2023-08-01T19:54:38.066 INFO:teuthology.orchestra.run.smithi101.stdout: }, 2023-08-01T19:54:38.067 INFO:teuthology.orchestra.run.smithi101.stdout: { 2023-08-01T19:54:38.067 INFO:teuthology.orchestra.run.smithi101.stdout: "event": "commit_sent", 2023-08-01T19:54:38.067 INFO:teuthology.orchestra.run.smithi101.stdout: "time": "2023-08-01T19:54:04.477371+0000", 2023-08-01T19:54:38.067 INFO:teuthology.orchestra.run.smithi101.stdout: "duration": 3.7425000000000002e-05 2023-08-01T19:54:38.067 INFO:teuthology.orchestra.run.smithi101.stdout: }, 2023-08-01T19:54:38.067 INFO:teuthology.orchestra.run.smithi101.stdout: { 2023-08-01T19:54:38.067 INFO:teuthology.orchestra.run.smithi101.stdout: "event": "done", 2023-08-01T19:54:38.068 INFO:teuthology.orchestra.run.smithi101.stdout: "time": "2023-08-01T19:54:04.477398+0000", 2023-08-01T19:54:38.068 INFO:teuthology.orchestra.run.smithi101.stdout: "duration": 2.7078000000000001e-05 2023-08-01T19:54:38.068 INFO:teuthology.orchestra.run.smithi101.stdout: } 2023-08-01T19:54:38.068 INFO:teuthology.orchestra.run.smithi101.stdout: ] 2023-08-01T19:54:38.068 INFO:teuthology.orchestra.run.smithi101.stdout: } 2023-08-01T19:54:38.068 INFO:teuthology.orchestra.run.smithi101.stdout: }, 2023-08-01T19:54:38.068 INFO:teuthology.orchestra.run.smithi101.stdout: { 2023-08-01T19:54:38.068 INFO:teuthology.orchestra.run.smithi101.stdout: "description": "osd_op(mds.0.3:9 3.10 3:09401a81:::601.00000000:head [create,setxattr parent (62) in=6b,setxattr layout (30) in=6b] snapc 0=[] ondisk+write+known_if_redirected+full_force+supports_pool_eio e17)", 2023-08-01T19:54:38.069 INFO:teuthology.orchestra.run.smithi101.stdout: "initiated_at": "2023-08-01T19:54:04.458896+0000", 2023-08-01T19:54:38.069 INFO:teuthology.orchestra.run.smithi101.stdout: "age": 33.571407673000003, 2023-08-01T19:54:38.069 INFO:teuthology.orchestra.run.smithi101.stdout: "duration": 0.018577215000000001, 2023-08-01T19:54:38.069 INFO:teuthology.orchestra.run.smithi101.stdout: "type_data": { 2023-08-01T19:54:38.069 INFO:teuthology.orchestra.run.smithi101.stdout: "flag_point": "commit sent; apply or cleanup", 2023-08-01T19:54:38.069 INFO:teuthology.orchestra.run.smithi101.stdout: "events": [ 2023-08-01T19:54:38.070 INFO:teuthology.orchestra.run.smithi101.stdout: { 2023-08-01T19:54:38.070 INFO:teuthology.orchestra.run.smithi101.stdout: "event": "initiated", 2023-08-01T19:54:38.070 INFO:teuthology.orchestra.run.smithi101.stdout: "time": "2023-08-01T19:54:04.458896+0000", 2023-08-01T19:54:38.070 INFO:teuthology.orchestra.run.smithi101.stdout: "duration": 0 2023-08-01T19:54:38.070 INFO:teuthology.orchestra.run.smithi101.stdout: }, 2023-08-01T19:54:38.070 INFO:teuthology.orchestra.run.smithi101.stdout: { 2023-08-01T19:54:38.070 INFO:teuthology.orchestra.run.smithi101.stdout: "event": "throttled", 2023-08-01T19:54:38.070 INFO:teuthology.orchestra.run.smithi101.stdout: "time": "2023-08-01T19:54:04.458896+0000", 2023-08-01T19:54:38.071 INFO:teuthology.orchestra.run.smithi101.stdout: "duration": 0 2023-08-01T19:54:38.071 INFO:teuthology.orchestra.run.smithi101.stdout: }, 2023-08-01T19:54:38.071 INFO:teuthology.orchestra.run.smithi101.stdout: { 2023-08-01T19:54:38.071 INFO:teuthology.orchestra.run.smithi101.stdout: "event": "header_read", 2023-08-01T19:54:38.071 INFO:teuthology.orchestra.run.smithi101.stdout: "time": "2023-08-01T19:54:04.458896+0000", 2023-08-01T19:54:38.071 INFO:teuthology.orchestra.run.smithi101.stdout: "duration": 4294967295.9999995 2023-08-01T19:54:38.071 INFO:teuthology.orchestra.run.smithi101.stdout: }, 2023-08-01T19:54:38.071 INFO:teuthology.orchestra.run.smithi101.stdout: { 2023-08-01T19:54:38.072 INFO:teuthology.orchestra.run.smithi101.stdout: "event": "all_read", 2023-08-01T19:54:38.072 INFO:teuthology.orchestra.run.smithi101.stdout: "time": "2023-08-01T19:54:04.458900+0000", 2023-08-01T19:54:38.072 INFO:teuthology.orchestra.run.smithi101.stdout: "duration": 4.0829999999999997e-06 2023-08-01T19:54:38.072 INFO:teuthology.orchestra.run.smithi101.stdout: }, 2023-08-01T19:54:38.072 INFO:teuthology.orchestra.run.smithi101.stdout: { 2023-08-01T19:54:38.072 INFO:teuthology.orchestra.run.smithi101.stdout: "event": "dispatched", 2023-08-01T19:54:38.072 INFO:teuthology.orchestra.run.smithi101.stdout: "time": "2023-08-01T19:54:04.458906+0000", 2023-08-01T19:54:38.073 INFO:teuthology.orchestra.run.smithi101.stdout: "duration": 6.4099999999999996e-06 2023-08-01T19:54:38.073 INFO:teuthology.orchestra.run.smithi101.stdout: }, 2023-08-01T19:54:38.073 INFO:teuthology.orchestra.run.smithi101.stdout: { 2023-08-01T19:54:38.073 INFO:teuthology.orchestra.run.smithi101.stdout: "event": "queued_for_pg", 2023-08-01T19:54:38.073 INFO:teuthology.orchestra.run.smithi101.stdout: "time": "2023-08-01T19:54:04.458911+0000", 2023-08-01T19:54:38.073 INFO:teuthology.orchestra.run.smithi101.stdout: "duration": 4.0500000000000002e-06 2023-08-01T19:54:38.073 INFO:teuthology.orchestra.run.smithi101.stdout: }, 2023-08-01T19:54:38.073 INFO:teuthology.orchestra.run.smithi101.stdout: { 2023-08-01T19:54:38.074 INFO:teuthology.orchestra.run.smithi101.stdout: "event": "reached_pg", 2023-08-01T19:54:38.074 INFO:teuthology.orchestra.run.smithi101.stdout: "time": "2023-08-01T19:54:04.458981+0000", 2023-08-01T19:54:38.074 INFO:teuthology.orchestra.run.smithi101.stdout: "duration": 7.0121000000000002e-05 2023-08-01T19:54:38.074 INFO:teuthology.orchestra.run.smithi101.stdout: }, 2023-08-01T19:54:38.074 INFO:teuthology.orchestra.run.smithi101.stdout: { 2023-08-01T19:54:38.074 INFO:teuthology.orchestra.run.smithi101.stdout: "event": "waiting_for_map not empty", 2023-08-01T19:54:38.074 INFO:teuthology.orchestra.run.smithi101.stdout: "time": "2023-08-01T19:54:04.458983+0000", 2023-08-01T19:54:38.074 INFO:teuthology.orchestra.run.smithi101.stdout: "duration": 2.2299999999999998e-06 2023-08-01T19:54:38.075 INFO:teuthology.orchestra.run.smithi101.stdout: }, 2023-08-01T19:54:38.075 INFO:teuthology.orchestra.run.smithi101.stdout: { 2023-08-01T19:54:38.075 INFO:teuthology.orchestra.run.smithi101.stdout: "event": "reached_pg", 2023-08-01T19:54:38.075 INFO:teuthology.orchestra.run.smithi101.stdout: "time": "2023-08-01T19:54:04.470122+0000", 2023-08-01T19:54:38.075 INFO:teuthology.orchestra.run.smithi101.stdout: "duration": 0.011139593999999999 2023-08-01T19:54:38.075 INFO:teuthology.orchestra.run.smithi101.stdout: }, 2023-08-01T19:54:38.075 INFO:teuthology.orchestra.run.smithi101.stdout: { 2023-08-01T19:54:38.075 INFO:teuthology.orchestra.run.smithi101.stdout: "event": "started", 2023-08-01T19:54:38.076 INFO:teuthology.orchestra.run.smithi101.stdout: "time": "2023-08-01T19:54:04.470217+0000", 2023-08-01T19:54:38.076 INFO:teuthology.orchestra.run.smithi101.stdout: "duration": 9.4388000000000005e-05 2023-08-01T19:54:38.076 INFO:teuthology.orchestra.run.smithi101.stdout: }, 2023-08-01T19:54:38.076 INFO:teuthology.orchestra.run.smithi101.stdout: { 2023-08-01T19:54:38.076 INFO:teuthology.orchestra.run.smithi101.stdout: "event": "waiting for subops from 2", 2023-08-01T19:54:38.076 INFO:teuthology.orchestra.run.smithi101.stdout: "time": "2023-08-01T19:54:04.470714+0000", 2023-08-01T19:54:38.076 INFO:teuthology.orchestra.run.smithi101.stdout: "duration": 0.00049680999999999998 2023-08-01T19:54:38.076 INFO:teuthology.orchestra.run.smithi101.stdout: }, 2023-08-01T19:54:38.077 INFO:teuthology.orchestra.run.smithi101.stdout: { 2023-08-01T19:54:38.077 INFO:teuthology.orchestra.run.smithi101.stdout: "event": "op_commit", 2023-08-01T19:54:38.077 INFO:teuthology.orchestra.run.smithi101.stdout: "time": "2023-08-01T19:54:04.476183+0000", 2023-08-01T19:54:38.077 INFO:teuthology.orchestra.run.smithi101.stdout: "duration": 0.0054695880000000001 2023-08-01T19:54:38.077 INFO:teuthology.orchestra.run.smithi101.stdout: }, 2023-08-01T19:54:38.077 INFO:teuthology.orchestra.run.smithi101.stdout: { 2023-08-01T19:54:38.077 INFO:teuthology.orchestra.run.smithi101.stdout: "event": "sub_op_commit_rec", 2023-08-01T19:54:38.077 INFO:teuthology.orchestra.run.smithi101.stdout: "time": "2023-08-01T19:54:04.477428+0000", 2023-08-01T19:54:38.078 INFO:teuthology.orchestra.run.smithi101.stdout: "duration": 0.001244843 2023-08-01T19:54:38.078 INFO:teuthology.orchestra.run.smithi101.stdout: }, 2023-08-01T19:54:38.078 INFO:teuthology.orchestra.run.smithi101.stdout: { 2023-08-01T19:54:38.078 INFO:teuthology.orchestra.run.smithi101.stdout: "event": "commit_sent", 2023-08-01T19:54:38.078 INFO:teuthology.orchestra.run.smithi101.stdout: "time": "2023-08-01T19:54:04.477456+0000", 2023-08-01T19:54:38.078 INFO:teuthology.orchestra.run.smithi101.stdout: "duration": 2.7538e-05 2023-08-01T19:54:38.078 INFO:teuthology.orchestra.run.smithi101.stdout: }, 2023-08-01T19:54:38.078 INFO:teuthology.orchestra.run.smithi101.stdout: { 2023-08-01T19:54:38.079 INFO:teuthology.orchestra.run.smithi101.stdout: "event": "done", 2023-08-01T19:54:38.079 INFO:teuthology.orchestra.run.smithi101.stdout: "time": "2023-08-01T19:54:04.477474+0000", 2023-08-01T19:54:38.079 INFO:teuthology.orchestra.run.smithi101.stdout: "duration": 1.7974000000000001e-05 2023-08-01T19:54:38.079 INFO:teuthology.orchestra.run.smithi101.stdout: } 2023-08-01T19:54:38.079 INFO:teuthology.orchestra.run.smithi101.stdout: ] 2023-08-01T19:54:38.079 INFO:teuthology.orchestra.run.smithi101.stdout: } 2023-08-01T19:54:38.079 INFO:teuthology.orchestra.run.smithi101.stdout: }, 2023-08-01T19:54:38.079 INFO:teuthology.orchestra.run.smithi101.stdout: { 2023-08-01T19:54:38.080 INFO:teuthology.orchestra.run.smithi101.stdout: "description": "osd_op(mds.0.3:10 3.10 3:0bd6d154:::602.00000000:head [omap-set-header] snapc 0=[] ondisk+write+known_if_redirected+full_force+supports_pool_eio e17)", 2023-08-01T19:54:38.080 INFO:teuthology.orchestra.run.smithi101.stdout: "initiated_at": "2023-08-01T19:54:04.458927+0000", 2023-08-01T19:54:38.080 INFO:teuthology.orchestra.run.smithi101.stdout: "age": 33.571376694999998, 2023-08-01T19:54:38.080 INFO:teuthology.orchestra.run.smithi101.stdout: "duration": 0.019574352, 2023-08-01T19:54:38.080 INFO:teuthology.orchestra.run.smithi101.stdout: "type_data": { 2023-08-01T19:54:38.080 INFO:teuthology.orchestra.run.smithi101.stdout: "flag_point": "commit sent; apply or cleanup", 2023-08-01T19:54:38.080 INFO:teuthology.orchestra.run.smithi101.stdout: "events": [ 2023-08-01T19:54:38.081 INFO:teuthology.orchestra.run.smithi101.stdout: { 2023-08-01T19:54:38.081 INFO:teuthology.orchestra.run.smithi101.stdout: "event": "initiated", 2023-08-01T19:54:38.081 INFO:teuthology.orchestra.run.smithi101.stdout: "time": "2023-08-01T19:54:04.458927+0000", 2023-08-01T19:54:38.081 INFO:teuthology.orchestra.run.smithi101.stdout: "duration": 0 2023-08-01T19:54:38.081 INFO:teuthology.orchestra.run.smithi101.stdout: }, 2023-08-01T19:54:38.081 INFO:teuthology.orchestra.run.smithi101.stdout: { 2023-08-01T19:54:38.081 INFO:teuthology.orchestra.run.smithi101.stdout: "event": "throttled", 2023-08-01T19:54:38.081 INFO:teuthology.orchestra.run.smithi101.stdout: "time": "2023-08-01T19:54:04.458927+0000", 2023-08-01T19:54:38.082 INFO:teuthology.orchestra.run.smithi101.stdout: "duration": 0 2023-08-01T19:54:38.082 INFO:teuthology.orchestra.run.smithi101.stdout: }, 2023-08-01T19:54:38.082 INFO:teuthology.orchestra.run.smithi101.stdout: { 2023-08-01T19:54:38.082 INFO:teuthology.orchestra.run.smithi101.stdout: "event": "header_read", 2023-08-01T19:54:38.082 INFO:teuthology.orchestra.run.smithi101.stdout: "time": "2023-08-01T19:54:04.458927+0000", 2023-08-01T19:54:38.082 INFO:teuthology.orchestra.run.smithi101.stdout: "duration": 4294967295.9999995 2023-08-01T19:54:38.082 INFO:teuthology.orchestra.run.smithi101.stdout: }, 2023-08-01T19:54:38.082 INFO:teuthology.orchestra.run.smithi101.stdout: { 2023-08-01T19:54:38.083 INFO:teuthology.orchestra.run.smithi101.stdout: "event": "all_read", 2023-08-01T19:54:38.083 INFO:teuthology.orchestra.run.smithi101.stdout: "time": "2023-08-01T19:54:04.458931+0000", 2023-08-01T19:54:38.083 INFO:teuthology.orchestra.run.smithi101.stdout: "duration": 4.3000000000000003e-06 2023-08-01T19:54:38.083 INFO:teuthology.orchestra.run.smithi101.stdout: }, 2023-08-01T19:54:38.083 INFO:teuthology.orchestra.run.smithi101.stdout: { 2023-08-01T19:54:38.083 INFO:teuthology.orchestra.run.smithi101.stdout: "event": "dispatched", 2023-08-01T19:54:38.083 INFO:teuthology.orchestra.run.smithi101.stdout: "time": "2023-08-01T19:54:04.458938+0000", 2023-08-01T19:54:38.083 INFO:teuthology.orchestra.run.smithi101.stdout: "duration": 7.3220000000000004e-06 2023-08-01T19:54:38.084 INFO:teuthology.orchestra.run.smithi101.stdout: }, 2023-08-01T19:54:38.084 INFO:teuthology.orchestra.run.smithi101.stdout: { 2023-08-01T19:54:38.084 INFO:teuthology.orchestra.run.smithi101.stdout: "event": "queued_for_pg", 2023-08-01T19:54:38.084 INFO:teuthology.orchestra.run.smithi101.stdout: "time": "2023-08-01T19:54:04.458944+0000", 2023-08-01T19:54:38.084 INFO:teuthology.orchestra.run.smithi101.stdout: "duration": 5.3040000000000004e-06 2023-08-01T19:54:38.084 INFO:teuthology.orchestra.run.smithi101.stdout: }, 2023-08-01T19:54:38.084 INFO:teuthology.orchestra.run.smithi101.stdout: { 2023-08-01T19:54:38.084 INFO:teuthology.orchestra.run.smithi101.stdout: "event": "reached_pg", 2023-08-01T19:54:38.085 INFO:teuthology.orchestra.run.smithi101.stdout: "time": "2023-08-01T19:54:04.459006+0000", 2023-08-01T19:54:38.085 INFO:teuthology.orchestra.run.smithi101.stdout: "duration": 6.2081000000000004e-05 2023-08-01T19:54:38.085 INFO:teuthology.orchestra.run.smithi101.stdout: }, 2023-08-01T19:54:38.085 INFO:teuthology.orchestra.run.smithi101.stdout: { 2023-08-01T19:54:38.085 INFO:teuthology.orchestra.run.smithi101.stdout: "event": "waiting_for_map not empty", 2023-08-01T19:54:38.085 INFO:teuthology.orchestra.run.smithi101.stdout: "time": "2023-08-01T19:54:04.459008+0000", 2023-08-01T19:54:38.085 INFO:teuthology.orchestra.run.smithi101.stdout: "duration": 2.2500000000000001e-06 2023-08-01T19:54:38.086 INFO:teuthology.orchestra.run.smithi101.stdout: }, 2023-08-01T19:54:38.086 INFO:teuthology.orchestra.run.smithi101.stdout: { 2023-08-01T19:54:38.086 INFO:teuthology.orchestra.run.smithi101.stdout: "event": "reached_pg", 2023-08-01T19:54:38.086 INFO:teuthology.orchestra.run.smithi101.stdout: "time": "2023-08-01T19:54:04.470946+0000", 2023-08-01T19:54:38.086 INFO:teuthology.orchestra.run.smithi101.stdout: "duration": 0.011938347 2023-08-01T19:54:38.086 INFO:teuthology.orchestra.run.smithi101.stdout: }, 2023-08-01T19:54:38.086 INFO:teuthology.orchestra.run.smithi101.stdout: { 2023-08-01T19:54:38.086 INFO:teuthology.orchestra.run.smithi101.stdout: "event": "started", 2023-08-01T19:54:38.087 INFO:teuthology.orchestra.run.smithi101.stdout: "time": "2023-08-01T19:54:04.471071+0000", 2023-08-01T19:54:38.087 INFO:teuthology.orchestra.run.smithi101.stdout: "duration": 0.00012470299999999999 2023-08-01T19:54:38.087 INFO:teuthology.orchestra.run.smithi101.stdout: }, 2023-08-01T19:54:38.087 INFO:teuthology.orchestra.run.smithi101.stdout: { 2023-08-01T19:54:38.087 INFO:teuthology.orchestra.run.smithi101.stdout: "event": "waiting for subops from 2", 2023-08-01T19:54:38.087 INFO:teuthology.orchestra.run.smithi101.stdout: "time": "2023-08-01T19:54:04.471205+0000", 2023-08-01T19:54:38.087 INFO:teuthology.orchestra.run.smithi101.stdout: "duration": 0.000133891 2023-08-01T19:54:38.087 INFO:teuthology.orchestra.run.smithi101.stdout: }, 2023-08-01T19:54:38.088 INFO:teuthology.orchestra.run.smithi101.stdout: { 2023-08-01T19:54:38.088 INFO:teuthology.orchestra.run.smithi101.stdout: "event": "op_commit", 2023-08-01T19:54:38.088 INFO:teuthology.orchestra.run.smithi101.stdout: "time": "2023-08-01T19:54:04.477042+0000", 2023-08-01T19:54:38.088 INFO:teuthology.orchestra.run.smithi101.stdout: "duration": 0.0058374849999999999 2023-08-01T19:54:38.088 INFO:teuthology.orchestra.run.smithi101.stdout: }, 2023-08-01T19:54:38.088 INFO:teuthology.orchestra.run.smithi101.stdout: { 2023-08-01T19:54:38.088 INFO:teuthology.orchestra.run.smithi101.stdout: "event": "sub_op_commit_rec", 2023-08-01T19:54:38.088 INFO:teuthology.orchestra.run.smithi101.stdout: "time": "2023-08-01T19:54:04.478445+0000", 2023-08-01T19:54:38.089 INFO:teuthology.orchestra.run.smithi101.stdout: "duration": 0.0014023239999999999 2023-08-01T19:54:38.089 INFO:teuthology.orchestra.run.smithi101.stdout: }, 2023-08-01T19:54:38.089 INFO:teuthology.orchestra.run.smithi101.stdout: { 2023-08-01T19:54:38.089 INFO:teuthology.orchestra.run.smithi101.stdout: "event": "commit_sent", 2023-08-01T19:54:38.089 INFO:teuthology.orchestra.run.smithi101.stdout: "time": "2023-08-01T19:54:04.478478+0000", 2023-08-01T19:54:38.089 INFO:teuthology.orchestra.run.smithi101.stdout: "duration": 3.3503000000000001e-05 2023-08-01T19:54:38.089 INFO:teuthology.orchestra.run.smithi101.stdout: }, 2023-08-01T19:54:38.089 INFO:teuthology.orchestra.run.smithi101.stdout: { 2023-08-01T19:54:38.090 INFO:teuthology.orchestra.run.smithi101.stdout: "event": "done", 2023-08-01T19:54:38.090 INFO:teuthology.orchestra.run.smithi101.stdout: "time": "2023-08-01T19:54:04.478502+0000", 2023-08-01T19:54:38.090 INFO:teuthology.orchestra.run.smithi101.stdout: "duration": 2.3402000000000001e-05 2023-08-01T19:54:38.090 INFO:teuthology.orchestra.run.smithi101.stdout: } 2023-08-01T19:54:38.090 INFO:teuthology.orchestra.run.smithi101.stdout: ] 2023-08-01T19:54:38.090 INFO:teuthology.orchestra.run.smithi101.stdout: } 2023-08-01T19:54:38.090 INFO:teuthology.orchestra.run.smithi101.stdout: }, 2023-08-01T19:54:38.090 INFO:teuthology.orchestra.run.smithi101.stdout: { 2023-08-01T19:54:38.091 INFO:teuthology.orchestra.run.smithi101.stdout: "description": "osd_op(mds.0.3:11 3.10 3:0bd6d154:::602.00000000:head [create,setxattr parent (62) in=6b,setxattr layout (30) in=6b] snapc 0=[] ondisk+write+known_if_redirected+full_force+supports_pool_eio e17)", 2023-08-01T19:54:38.091 INFO:teuthology.orchestra.run.smithi101.stdout: "initiated_at": "2023-08-01T19:54:04.458960+0000", 2023-08-01T19:54:38.091 INFO:teuthology.orchestra.run.smithi101.stdout: "age": 33.571344246999999, 2023-08-01T19:54:38.091 INFO:teuthology.orchestra.run.smithi101.stdout: "duration": 0.019645459000000001, 2023-08-01T19:54:38.091 INFO:teuthology.orchestra.run.smithi101.stdout: "type_data": { 2023-08-01T19:54:38.091 INFO:teuthology.orchestra.run.smithi101.stdout: "flag_point": "commit sent; apply or cleanup", 2023-08-01T19:54:38.091 INFO:teuthology.orchestra.run.smithi101.stdout: "events": [ 2023-08-01T19:54:38.091 INFO:teuthology.orchestra.run.smithi101.stdout: { 2023-08-01T19:54:38.092 INFO:teuthology.orchestra.run.smithi101.stdout: "event": "initiated", 2023-08-01T19:54:38.092 INFO:teuthology.orchestra.run.smithi101.stdout: "time": "2023-08-01T19:54:04.458960+0000", 2023-08-01T19:54:38.092 INFO:teuthology.orchestra.run.smithi101.stdout: "duration": 0 2023-08-01T19:54:38.092 INFO:teuthology.orchestra.run.smithi101.stdout: }, 2023-08-01T19:54:38.092 INFO:teuthology.orchestra.run.smithi101.stdout: { 2023-08-01T19:54:38.092 INFO:teuthology.orchestra.run.smithi101.stdout: "event": "throttled", 2023-08-01T19:54:38.092 INFO:teuthology.orchestra.run.smithi101.stdout: "time": "2023-08-01T19:54:04.458960+0000", 2023-08-01T19:54:38.093 INFO:teuthology.orchestra.run.smithi101.stdout: "duration": 0 2023-08-01T19:54:38.093 INFO:teuthology.orchestra.run.smithi101.stdout: }, 2023-08-01T19:54:38.093 INFO:teuthology.orchestra.run.smithi101.stdout: { 2023-08-01T19:54:38.093 INFO:teuthology.orchestra.run.smithi101.stdout: "event": "header_read", 2023-08-01T19:54:38.093 INFO:teuthology.orchestra.run.smithi101.stdout: "time": "2023-08-01T19:54:04.458959+0000", 2023-08-01T19:54:38.093 INFO:teuthology.orchestra.run.smithi101.stdout: "duration": 4294967295.9999995 2023-08-01T19:54:38.093 INFO:teuthology.orchestra.run.smithi101.stdout: }, 2023-08-01T19:54:38.093 INFO:teuthology.orchestra.run.smithi101.stdout: { 2023-08-01T19:54:38.094 INFO:teuthology.orchestra.run.smithi101.stdout: "event": "all_read", 2023-08-01T19:54:38.094 INFO:teuthology.orchestra.run.smithi101.stdout: "time": "2023-08-01T19:54:04.458963+0000", 2023-08-01T19:54:38.094 INFO:teuthology.orchestra.run.smithi101.stdout: "duration": 3.9199999999999997e-06 2023-08-01T19:54:38.094 INFO:teuthology.orchestra.run.smithi101.stdout: }, 2023-08-01T19:54:38.094 INFO:teuthology.orchestra.run.smithi101.stdout: { 2023-08-01T19:54:38.094 INFO:teuthology.orchestra.run.smithi101.stdout: "event": "dispatched", 2023-08-01T19:54:38.094 INFO:teuthology.orchestra.run.smithi101.stdout: "time": "2023-08-01T19:54:04.458970+0000", 2023-08-01T19:54:38.094 INFO:teuthology.orchestra.run.smithi101.stdout: "duration": 7.0439999999999998e-06 2023-08-01T19:54:38.095 INFO:teuthology.orchestra.run.smithi101.stdout: }, 2023-08-01T19:54:38.095 INFO:teuthology.orchestra.run.smithi101.stdout: { 2023-08-01T19:54:38.095 INFO:teuthology.orchestra.run.smithi101.stdout: "event": "queued_for_pg", 2023-08-01T19:54:38.095 INFO:teuthology.orchestra.run.smithi101.stdout: "time": "2023-08-01T19:54:04.458976+0000", 2023-08-01T19:54:38.095 INFO:teuthology.orchestra.run.smithi101.stdout: "duration": 5.9540000000000001e-06 2023-08-01T19:54:38.095 INFO:teuthology.orchestra.run.smithi101.stdout: }, 2023-08-01T19:54:38.095 INFO:teuthology.orchestra.run.smithi101.stdout: { 2023-08-01T19:54:38.095 INFO:teuthology.orchestra.run.smithi101.stdout: "event": "reached_pg", 2023-08-01T19:54:38.096 INFO:teuthology.orchestra.run.smithi101.stdout: "time": "2023-08-01T19:54:04.459035+0000", 2023-08-01T19:54:38.096 INFO:teuthology.orchestra.run.smithi101.stdout: "duration": 5.8924e-05 2023-08-01T19:54:38.096 INFO:teuthology.orchestra.run.smithi101.stdout: }, 2023-08-01T19:54:38.096 INFO:teuthology.orchestra.run.smithi101.stdout: { 2023-08-01T19:54:38.096 INFO:teuthology.orchestra.run.smithi101.stdout: "event": "waiting_for_map not empty", 2023-08-01T19:54:38.096 INFO:teuthology.orchestra.run.smithi101.stdout: "time": "2023-08-01T19:54:04.459038+0000", 2023-08-01T19:54:38.096 INFO:teuthology.orchestra.run.smithi101.stdout: "duration": 3.2760000000000001e-06 2023-08-01T19:54:38.096 INFO:teuthology.orchestra.run.smithi101.stdout: }, 2023-08-01T19:54:38.097 INFO:teuthology.orchestra.run.smithi101.stdout: { 2023-08-01T19:54:38.097 INFO:teuthology.orchestra.run.smithi101.stdout: "event": "reached_pg", 2023-08-01T19:54:38.097 INFO:teuthology.orchestra.run.smithi101.stdout: "time": "2023-08-01T19:54:04.471511+0000", 2023-08-01T19:54:38.097 INFO:teuthology.orchestra.run.smithi101.stdout: "duration": 0.012473039999999999 2023-08-01T19:54:38.097 INFO:teuthology.orchestra.run.smithi101.stdout: }, 2023-08-01T19:54:38.097 INFO:teuthology.orchestra.run.smithi101.stdout: { 2023-08-01T19:54:38.097 INFO:teuthology.orchestra.run.smithi101.stdout: "event": "started", 2023-08-01T19:54:38.097 INFO:teuthology.orchestra.run.smithi101.stdout: "time": "2023-08-01T19:54:04.472086+0000", 2023-08-01T19:54:38.098 INFO:teuthology.orchestra.run.smithi101.stdout: "duration": 0.00057491699999999998 2023-08-01T19:54:38.098 INFO:teuthology.orchestra.run.smithi101.stdout: }, 2023-08-01T19:54:38.098 INFO:teuthology.orchestra.run.smithi101.stdout: { 2023-08-01T19:54:38.098 INFO:teuthology.orchestra.run.smithi101.stdout: "event": "waiting for subops from 2", 2023-08-01T19:54:38.098 INFO:teuthology.orchestra.run.smithi101.stdout: "time": "2023-08-01T19:54:04.472310+0000", 2023-08-01T19:54:38.098 INFO:teuthology.orchestra.run.smithi101.stdout: "duration": 0.00022396499999999999 2023-08-01T19:54:38.098 INFO:teuthology.orchestra.run.smithi101.stdout: }, 2023-08-01T19:54:38.098 INFO:teuthology.orchestra.run.smithi101.stdout: { 2023-08-01T19:54:38.099 INFO:teuthology.orchestra.run.smithi101.stdout: "event": "op_commit", 2023-08-01T19:54:38.099 INFO:teuthology.orchestra.run.smithi101.stdout: "time": "2023-08-01T19:54:04.478141+0000", 2023-08-01T19:54:38.099 INFO:teuthology.orchestra.run.smithi101.stdout: "duration": 0.0058312320000000004 2023-08-01T19:54:38.099 INFO:teuthology.orchestra.run.smithi101.stdout: }, 2023-08-01T19:54:38.099 INFO:teuthology.orchestra.run.smithi101.stdout: { 2023-08-01T19:54:38.099 INFO:teuthology.orchestra.run.smithi101.stdout: "event": "sub_op_commit_rec", 2023-08-01T19:54:38.099 INFO:teuthology.orchestra.run.smithi101.stdout: "time": "2023-08-01T19:54:04.478543+0000", 2023-08-01T19:54:38.099 INFO:teuthology.orchestra.run.smithi101.stdout: "duration": 0.00040160800000000002 2023-08-01T19:54:38.100 INFO:teuthology.orchestra.run.smithi101.stdout: }, 2023-08-01T19:54:38.100 INFO:teuthology.orchestra.run.smithi101.stdout: { 2023-08-01T19:54:38.100 INFO:teuthology.orchestra.run.smithi101.stdout: "event": "commit_sent", 2023-08-01T19:54:38.100 INFO:teuthology.orchestra.run.smithi101.stdout: "time": "2023-08-01T19:54:04.478584+0000", 2023-08-01T19:54:38.100 INFO:teuthology.orchestra.run.smithi101.stdout: "duration": 4.0989999999999999e-05 2023-08-01T19:54:38.100 INFO:teuthology.orchestra.run.smithi101.stdout: }, 2023-08-01T19:54:38.100 INFO:teuthology.orchestra.run.smithi101.stdout: { 2023-08-01T19:54:38.101 INFO:teuthology.orchestra.run.smithi101.stdout: "event": "done", 2023-08-01T19:54:38.101 INFO:teuthology.orchestra.run.smithi101.stdout: "time": "2023-08-01T19:54:04.478605+0000", 2023-08-01T19:54:38.101 INFO:teuthology.orchestra.run.smithi101.stdout: "duration": 2.1178e-05 2023-08-01T19:54:38.101 INFO:teuthology.orchestra.run.smithi101.stdout: } 2023-08-01T19:54:38.101 INFO:teuthology.orchestra.run.smithi101.stdout: ] 2023-08-01T19:54:38.101 INFO:teuthology.orchestra.run.smithi101.stdout: } 2023-08-01T19:54:38.101 INFO:teuthology.orchestra.run.smithi101.stdout: }, 2023-08-01T19:54:38.101 INFO:teuthology.orchestra.run.smithi101.stdout: { 2023-08-01T19:54:38.102 INFO:teuthology.orchestra.run.smithi101.stdout: "description": "osd_op(mds.0.3:12 3.10 3:0d89b25e:::603.00000000:head [omap-set-header] snapc 0=[] ondisk+write+known_if_redirected+full_force+supports_pool_eio e17)", 2023-08-01T19:54:38.102 INFO:teuthology.orchestra.run.smithi101.stdout: "initiated_at": "2023-08-01T19:54:04.458982+0000", 2023-08-01T19:54:38.102 INFO:teuthology.orchestra.run.smithi101.stdout: "age": 33.571322019, 2023-08-01T19:54:38.102 INFO:teuthology.orchestra.run.smithi101.stdout: "duration": 0.021266334000000001, 2023-08-01T19:54:38.102 INFO:teuthology.orchestra.run.smithi101.stdout: "type_data": { 2023-08-01T19:54:38.102 INFO:teuthology.orchestra.run.smithi101.stdout: "flag_point": "commit sent; apply or cleanup", 2023-08-01T19:54:38.102 INFO:teuthology.orchestra.run.smithi101.stdout: "events": [ 2023-08-01T19:54:38.102 INFO:teuthology.orchestra.run.smithi101.stdout: { 2023-08-01T19:54:38.103 INFO:teuthology.orchestra.run.smithi101.stdout: "event": "initiated", 2023-08-01T19:54:38.103 INFO:teuthology.orchestra.run.smithi101.stdout: "time": "2023-08-01T19:54:04.458982+0000", 2023-08-01T19:54:38.103 INFO:teuthology.orchestra.run.smithi101.stdout: "duration": 0 2023-08-01T19:54:38.103 INFO:teuthology.orchestra.run.smithi101.stdout: }, 2023-08-01T19:54:38.103 INFO:teuthology.orchestra.run.smithi101.stdout: { 2023-08-01T19:54:38.103 INFO:teuthology.orchestra.run.smithi101.stdout: "event": "throttled", 2023-08-01T19:54:38.103 INFO:teuthology.orchestra.run.smithi101.stdout: "time": "2023-08-01T19:54:04.458982+0000", 2023-08-01T19:54:38.103 INFO:teuthology.orchestra.run.smithi101.stdout: "duration": 0 2023-08-01T19:54:38.104 INFO:teuthology.orchestra.run.smithi101.stdout: }, 2023-08-01T19:54:38.104 INFO:teuthology.orchestra.run.smithi101.stdout: { 2023-08-01T19:54:38.104 INFO:teuthology.orchestra.run.smithi101.stdout: "event": "header_read", 2023-08-01T19:54:38.104 INFO:teuthology.orchestra.run.smithi101.stdout: "time": "2023-08-01T19:54:04.458982+0000", 2023-08-01T19:54:38.104 INFO:teuthology.orchestra.run.smithi101.stdout: "duration": 4294967295.9999995 2023-08-01T19:54:38.104 INFO:teuthology.orchestra.run.smithi101.stdout: }, 2023-08-01T19:54:38.104 INFO:teuthology.orchestra.run.smithi101.stdout: { 2023-08-01T19:54:38.104 INFO:teuthology.orchestra.run.smithi101.stdout: "event": "all_read", 2023-08-01T19:54:38.105 INFO:teuthology.orchestra.run.smithi101.stdout: "time": "2023-08-01T19:54:04.458985+0000", 2023-08-01T19:54:38.105 INFO:teuthology.orchestra.run.smithi101.stdout: "duration": 3.4800000000000001e-06 2023-08-01T19:54:38.105 INFO:teuthology.orchestra.run.smithi101.stdout: }, 2023-08-01T19:54:38.105 INFO:teuthology.orchestra.run.smithi101.stdout: { 2023-08-01T19:54:38.105 INFO:teuthology.orchestra.run.smithi101.stdout: "event": "dispatched", 2023-08-01T19:54:38.105 INFO:teuthology.orchestra.run.smithi101.stdout: "time": "2023-08-01T19:54:04.458992+0000", 2023-08-01T19:54:38.105 INFO:teuthology.orchestra.run.smithi101.stdout: "duration": 7.306e-06 2023-08-01T19:54:38.105 INFO:teuthology.orchestra.run.smithi101.stdout: }, 2023-08-01T19:54:38.106 INFO:teuthology.orchestra.run.smithi101.stdout: { 2023-08-01T19:54:38.106 INFO:teuthology.orchestra.run.smithi101.stdout: "event": "queued_for_pg", 2023-08-01T19:54:38.106 INFO:teuthology.orchestra.run.smithi101.stdout: "time": "2023-08-01T19:54:04.458997+0000", 2023-08-01T19:54:38.106 INFO:teuthology.orchestra.run.smithi101.stdout: "duration": 4.4530000000000004e-06 2023-08-01T19:54:38.106 INFO:teuthology.orchestra.run.smithi101.stdout: }, 2023-08-01T19:54:38.106 INFO:teuthology.orchestra.run.smithi101.stdout: { 2023-08-01T19:54:38.106 INFO:teuthology.orchestra.run.smithi101.stdout: "event": "reached_pg", 2023-08-01T19:54:38.106 INFO:teuthology.orchestra.run.smithi101.stdout: "time": "2023-08-01T19:54:04.459060+0000", 2023-08-01T19:54:38.107 INFO:teuthology.orchestra.run.smithi101.stdout: "duration": 6.3249000000000004e-05 2023-08-01T19:54:38.107 INFO:teuthology.orchestra.run.smithi101.stdout: }, 2023-08-01T19:54:38.107 INFO:teuthology.orchestra.run.smithi101.stdout: { 2023-08-01T19:54:38.107 INFO:teuthology.orchestra.run.smithi101.stdout: "event": "waiting_for_map not empty", 2023-08-01T19:54:38.107 INFO:teuthology.orchestra.run.smithi101.stdout: "time": "2023-08-01T19:54:04.459063+0000", 2023-08-01T19:54:38.107 INFO:teuthology.orchestra.run.smithi101.stdout: "duration": 2.717e-06 2023-08-01T19:54:38.107 INFO:teuthology.orchestra.run.smithi101.stdout: }, 2023-08-01T19:54:38.108 INFO:teuthology.orchestra.run.smithi101.stdout: { 2023-08-01T19:54:38.108 INFO:teuthology.orchestra.run.smithi101.stdout: "event": "reached_pg", 2023-08-01T19:54:38.108 INFO:teuthology.orchestra.run.smithi101.stdout: "time": "2023-08-01T19:54:04.473625+0000", 2023-08-01T19:54:38.108 INFO:teuthology.orchestra.run.smithi101.stdout: "duration": 0.014562007 2023-08-01T19:54:38.108 INFO:teuthology.orchestra.run.smithi101.stdout: }, 2023-08-01T19:54:38.108 INFO:teuthology.orchestra.run.smithi101.stdout: { 2023-08-01T19:54:38.108 INFO:teuthology.orchestra.run.smithi101.stdout: "event": "started", 2023-08-01T19:54:38.108 INFO:teuthology.orchestra.run.smithi101.stdout: "time": "2023-08-01T19:54:04.473757+0000", 2023-08-01T19:54:38.109 INFO:teuthology.orchestra.run.smithi101.stdout: "duration": 0.00013238599999999999 2023-08-01T19:54:38.109 INFO:teuthology.orchestra.run.smithi101.stdout: }, 2023-08-01T19:54:38.109 INFO:teuthology.orchestra.run.smithi101.stdout: { 2023-08-01T19:54:38.109 INFO:teuthology.orchestra.run.smithi101.stdout: "event": "waiting for subops from 2", 2023-08-01T19:54:38.109 INFO:teuthology.orchestra.run.smithi101.stdout: "time": "2023-08-01T19:54:04.473898+0000", 2023-08-01T19:54:38.109 INFO:teuthology.orchestra.run.smithi101.stdout: "duration": 0.00014039 2023-08-01T19:54:38.109 INFO:teuthology.orchestra.run.smithi101.stdout: }, 2023-08-01T19:54:38.109 INFO:teuthology.orchestra.run.smithi101.stdout: { 2023-08-01T19:54:38.110 INFO:teuthology.orchestra.run.smithi101.stdout: "event": "op_commit", 2023-08-01T19:54:38.110 INFO:teuthology.orchestra.run.smithi101.stdout: "time": "2023-08-01T19:54:04.478380+0000", 2023-08-01T19:54:38.110 INFO:teuthology.orchestra.run.smithi101.stdout: "duration": 0.0044827449999999998 2023-08-01T19:54:38.110 INFO:teuthology.orchestra.run.smithi101.stdout: }, 2023-08-01T19:54:38.110 INFO:teuthology.orchestra.run.smithi101.stdout: { 2023-08-01T19:54:38.110 INFO:teuthology.orchestra.run.smithi101.stdout: "event": "sub_op_commit_rec", 2023-08-01T19:54:38.110 INFO:teuthology.orchestra.run.smithi101.stdout: "time": "2023-08-01T19:54:04.480169+0000", 2023-08-01T19:54:38.110 INFO:teuthology.orchestra.run.smithi101.stdout: "duration": 0.0017886040000000001 2023-08-01T19:54:38.111 INFO:teuthology.orchestra.run.smithi101.stdout: }, 2023-08-01T19:54:38.111 INFO:teuthology.orchestra.run.smithi101.stdout: { 2023-08-01T19:54:38.111 INFO:teuthology.orchestra.run.smithi101.stdout: "event": "commit_sent", 2023-08-01T19:54:38.111 INFO:teuthology.orchestra.run.smithi101.stdout: "time": "2023-08-01T19:54:04.480212+0000", 2023-08-01T19:54:38.111 INFO:teuthology.orchestra.run.smithi101.stdout: "duration": 4.2687e-05 2023-08-01T19:54:38.111 INFO:teuthology.orchestra.run.smithi101.stdout: }, 2023-08-01T19:54:38.111 INFO:teuthology.orchestra.run.smithi101.stdout: { 2023-08-01T19:54:38.111 INFO:teuthology.orchestra.run.smithi101.stdout: "event": "done", 2023-08-01T19:54:38.112 INFO:teuthology.orchestra.run.smithi101.stdout: "time": "2023-08-01T19:54:04.480248+0000", 2023-08-01T19:54:38.112 INFO:teuthology.orchestra.run.smithi101.stdout: "duration": 3.6743999999999999e-05 2023-08-01T19:54:38.112 INFO:teuthology.orchestra.run.smithi101.stdout: } 2023-08-01T19:54:38.112 INFO:teuthology.orchestra.run.smithi101.stdout: ] 2023-08-01T19:54:38.112 INFO:teuthology.orchestra.run.smithi101.stdout: } 2023-08-01T19:54:38.112 INFO:teuthology.orchestra.run.smithi101.stdout: }, 2023-08-01T19:54:38.112 INFO:teuthology.orchestra.run.smithi101.stdout: { 2023-08-01T19:54:38.113 INFO:teuthology.orchestra.run.smithi101.stdout: "description": "osd_op(mds.0.3:13 3.10 3:0d89b25e:::603.00000000:head [create,setxattr parent (62) in=6b,setxattr layout (30) in=6b] snapc 0=[] ondisk+write+known_if_redirected+full_force+supports_pool_eio e17)", 2023-08-01T19:54:38.113 INFO:teuthology.orchestra.run.smithi101.stdout: "initiated_at": "2023-08-01T19:54:04.459010+0000", 2023-08-01T19:54:38.113 INFO:teuthology.orchestra.run.smithi101.stdout: "age": 33.571294299000002, 2023-08-01T19:54:38.113 INFO:teuthology.orchestra.run.smithi101.stdout: "duration": 0.021327220000000001, 2023-08-01T19:54:38.113 INFO:teuthology.orchestra.run.smithi101.stdout: "type_data": { 2023-08-01T19:54:38.113 INFO:teuthology.orchestra.run.smithi101.stdout: "flag_point": "commit sent; apply or cleanup", 2023-08-01T19:54:38.113 INFO:teuthology.orchestra.run.smithi101.stdout: "events": [ 2023-08-01T19:54:38.113 INFO:teuthology.orchestra.run.smithi101.stdout: { 2023-08-01T19:54:38.114 INFO:teuthology.orchestra.run.smithi101.stdout: "event": "initiated", 2023-08-01T19:54:38.114 INFO:teuthology.orchestra.run.smithi101.stdout: "time": "2023-08-01T19:54:04.459010+0000", 2023-08-01T19:54:38.114 INFO:teuthology.orchestra.run.smithi101.stdout: "duration": 0 2023-08-01T19:54:38.114 INFO:teuthology.orchestra.run.smithi101.stdout: }, 2023-08-01T19:54:38.114 INFO:teuthology.orchestra.run.smithi101.stdout: { 2023-08-01T19:54:38.114 INFO:teuthology.orchestra.run.smithi101.stdout: "event": "throttled", 2023-08-01T19:54:38.114 INFO:teuthology.orchestra.run.smithi101.stdout: "time": "2023-08-01T19:54:04.459010+0000", 2023-08-01T19:54:38.114 INFO:teuthology.orchestra.run.smithi101.stdout: "duration": 0 2023-08-01T19:54:38.115 INFO:teuthology.orchestra.run.smithi101.stdout: }, 2023-08-01T19:54:38.115 INFO:teuthology.orchestra.run.smithi101.stdout: { 2023-08-01T19:54:38.115 INFO:teuthology.orchestra.run.smithi101.stdout: "event": "header_read", 2023-08-01T19:54:38.115 INFO:teuthology.orchestra.run.smithi101.stdout: "time": "2023-08-01T19:54:04.459009+0000", 2023-08-01T19:54:38.115 INFO:teuthology.orchestra.run.smithi101.stdout: "duration": 4294967295.9999995 2023-08-01T19:54:38.115 INFO:teuthology.orchestra.run.smithi101.stdout: }, 2023-08-01T19:54:38.115 INFO:teuthology.orchestra.run.smithi101.stdout: { 2023-08-01T19:54:38.115 INFO:teuthology.orchestra.run.smithi101.stdout: "event": "all_read", 2023-08-01T19:54:38.116 INFO:teuthology.orchestra.run.smithi101.stdout: "time": "2023-08-01T19:54:04.459013+0000", 2023-08-01T19:54:38.116 INFO:teuthology.orchestra.run.smithi101.stdout: "duration": 3.8929999999999998e-06 2023-08-01T19:54:38.116 INFO:teuthology.orchestra.run.smithi101.stdout: }, 2023-08-01T19:54:38.116 INFO:teuthology.orchestra.run.smithi101.stdout: { 2023-08-01T19:54:38.116 INFO:teuthology.orchestra.run.smithi101.stdout: "event": "dispatched", 2023-08-01T19:54:38.116 INFO:teuthology.orchestra.run.smithi101.stdout: "time": "2023-08-01T19:54:04.459027+0000", 2023-08-01T19:54:38.116 INFO:teuthology.orchestra.run.smithi101.stdout: "duration": 1.3416e-05 2023-08-01T19:54:38.116 INFO:teuthology.orchestra.run.smithi101.stdout: }, 2023-08-01T19:54:38.117 INFO:teuthology.orchestra.run.smithi101.stdout: { 2023-08-01T19:54:38.117 INFO:teuthology.orchestra.run.smithi101.stdout: "event": "queued_for_pg", 2023-08-01T19:54:38.117 INFO:teuthology.orchestra.run.smithi101.stdout: "time": "2023-08-01T19:54:04.459033+0000", 2023-08-01T19:54:38.117 INFO:teuthology.orchestra.run.smithi101.stdout: "duration": 5.9800000000000003e-06 2023-08-01T19:54:38.117 INFO:teuthology.orchestra.run.smithi101.stdout: }, 2023-08-01T19:54:38.117 INFO:teuthology.orchestra.run.smithi101.stdout: { 2023-08-01T19:54:38.117 INFO:teuthology.orchestra.run.smithi101.stdout: "event": "reached_pg", 2023-08-01T19:54:38.117 INFO:teuthology.orchestra.run.smithi101.stdout: "time": "2023-08-01T19:54:04.459099+0000", 2023-08-01T19:54:38.118 INFO:teuthology.orchestra.run.smithi101.stdout: "duration": 6.6192999999999995e-05 2023-08-01T19:54:38.118 INFO:teuthology.orchestra.run.smithi101.stdout: }, 2023-08-01T19:54:38.118 INFO:teuthology.orchestra.run.smithi101.stdout: { 2023-08-01T19:54:38.118 INFO:teuthology.orchestra.run.smithi101.stdout: "event": "waiting_for_map not empty", 2023-08-01T19:54:38.118 INFO:teuthology.orchestra.run.smithi101.stdout: "time": "2023-08-01T19:54:04.459106+0000", 2023-08-01T19:54:38.118 INFO:teuthology.orchestra.run.smithi101.stdout: "duration": 6.8619999999999997e-06 2023-08-01T19:54:38.118 INFO:teuthology.orchestra.run.smithi101.stdout: }, 2023-08-01T19:54:38.119 INFO:teuthology.orchestra.run.smithi101.stdout: { 2023-08-01T19:54:38.119 INFO:teuthology.orchestra.run.smithi101.stdout: "event": "reached_pg", 2023-08-01T19:54:38.119 INFO:teuthology.orchestra.run.smithi101.stdout: "time": "2023-08-01T19:54:04.475182+0000", 2023-08-01T19:54:38.119 INFO:teuthology.orchestra.run.smithi101.stdout: "duration": 0.016076333000000002 2023-08-01T19:54:38.119 INFO:teuthology.orchestra.run.smithi101.stdout: }, 2023-08-01T19:54:38.119 INFO:teuthology.orchestra.run.smithi101.stdout: { 2023-08-01T19:54:38.119 INFO:teuthology.orchestra.run.smithi101.stdout: "event": "started", 2023-08-01T19:54:38.119 INFO:teuthology.orchestra.run.smithi101.stdout: "time": "2023-08-01T19:54:04.475353+0000", 2023-08-01T19:54:38.120 INFO:teuthology.orchestra.run.smithi101.stdout: "duration": 0.000171378 2023-08-01T19:54:38.120 INFO:teuthology.orchestra.run.smithi101.stdout: }, 2023-08-01T19:54:38.120 INFO:teuthology.orchestra.run.smithi101.stdout: { 2023-08-01T19:54:38.120 INFO:teuthology.orchestra.run.smithi101.stdout: "event": "waiting for subops from 2", 2023-08-01T19:54:38.120 INFO:teuthology.orchestra.run.smithi101.stdout: "time": "2023-08-01T19:54:04.475793+0000", 2023-08-01T19:54:38.120 INFO:teuthology.orchestra.run.smithi101.stdout: "duration": 0.000440123 2023-08-01T19:54:38.120 INFO:teuthology.orchestra.run.smithi101.stdout: }, 2023-08-01T19:54:38.120 INFO:teuthology.orchestra.run.smithi101.stdout: { 2023-08-01T19:54:38.121 INFO:teuthology.orchestra.run.smithi101.stdout: "event": "op_commit", 2023-08-01T19:54:38.121 INFO:teuthology.orchestra.run.smithi101.stdout: "time": "2023-08-01T19:54:04.478624+0000", 2023-08-01T19:54:38.121 INFO:teuthology.orchestra.run.smithi101.stdout: "duration": 0.0028305000000000001 2023-08-01T19:54:38.121 INFO:teuthology.orchestra.run.smithi101.stdout: }, 2023-08-01T19:54:38.121 INFO:teuthology.orchestra.run.smithi101.stdout: { 2023-08-01T19:54:38.121 INFO:teuthology.orchestra.run.smithi101.stdout: "event": "sub_op_commit_rec", 2023-08-01T19:54:38.121 INFO:teuthology.orchestra.run.smithi101.stdout: "time": "2023-08-01T19:54:04.480291+0000", 2023-08-01T19:54:38.121 INFO:teuthology.orchestra.run.smithi101.stdout: "duration": 0.0016670000000000001 2023-08-01T19:54:38.122 INFO:teuthology.orchestra.run.smithi101.stdout: }, 2023-08-01T19:54:38.122 INFO:teuthology.orchestra.run.smithi101.stdout: { 2023-08-01T19:54:38.122 INFO:teuthology.orchestra.run.smithi101.stdout: "event": "commit_sent", 2023-08-01T19:54:38.122 INFO:teuthology.orchestra.run.smithi101.stdout: "time": "2023-08-01T19:54:04.480318+0000", 2023-08-01T19:54:38.122 INFO:teuthology.orchestra.run.smithi101.stdout: "duration": 2.6815e-05 2023-08-01T19:54:38.122 INFO:teuthology.orchestra.run.smithi101.stdout: }, 2023-08-01T19:54:38.122 INFO:teuthology.orchestra.run.smithi101.stdout: { 2023-08-01T19:54:38.122 INFO:teuthology.orchestra.run.smithi101.stdout: "event": "done", 2023-08-01T19:54:38.123 INFO:teuthology.orchestra.run.smithi101.stdout: "time": "2023-08-01T19:54:04.480337+0000", 2023-08-01T19:54:38.123 INFO:teuthology.orchestra.run.smithi101.stdout: "duration": 1.9241000000000001e-05 2023-08-01T19:54:38.123 INFO:teuthology.orchestra.run.smithi101.stdout: } 2023-08-01T19:54:38.123 INFO:teuthology.orchestra.run.smithi101.stdout: ] 2023-08-01T19:54:38.123 INFO:teuthology.orchestra.run.smithi101.stdout: } 2023-08-01T19:54:38.123 INFO:teuthology.orchestra.run.smithi101.stdout: }, 2023-08-01T19:54:38.123 INFO:teuthology.orchestra.run.smithi101.stdout: { 2023-08-01T19:54:38.123 INFO:teuthology.orchestra.run.smithi101.stdout: "description": "osd_op(mds.0.3:18 3.14 3:2f55791f:::606.00000000:head [omap-set-header] snapc 0=[] ondisk+write+known_if_redirected+full_force+supports_pool_eio e17)", 2023-08-01T19:54:38.124 INFO:teuthology.orchestra.run.smithi101.stdout: "initiated_at": "2023-08-01T19:54:04.459039+0000", 2023-08-01T19:54:38.124 INFO:teuthology.orchestra.run.smithi101.stdout: "age": 33.571265005000001, 2023-08-01T19:54:38.124 INFO:teuthology.orchestra.run.smithi101.stdout: "duration": 0.018756419, 2023-08-01T19:54:38.124 INFO:teuthology.orchestra.run.smithi101.stdout: "type_data": { 2023-08-01T19:54:38.124 INFO:teuthology.orchestra.run.smithi101.stdout: "flag_point": "commit sent; apply or cleanup", 2023-08-01T19:54:38.124 INFO:teuthology.orchestra.run.smithi101.stdout: "events": [ 2023-08-01T19:54:38.124 INFO:teuthology.orchestra.run.smithi101.stdout: { 2023-08-01T19:54:38.125 INFO:teuthology.orchestra.run.smithi101.stdout: "event": "initiated", 2023-08-01T19:54:38.125 INFO:teuthology.orchestra.run.smithi101.stdout: "time": "2023-08-01T19:54:04.459039+0000", 2023-08-01T19:54:38.125 INFO:teuthology.orchestra.run.smithi101.stdout: "duration": 0 2023-08-01T19:54:38.125 INFO:teuthology.orchestra.run.smithi101.stdout: }, 2023-08-01T19:54:38.125 INFO:teuthology.orchestra.run.smithi101.stdout: { 2023-08-01T19:54:38.125 INFO:teuthology.orchestra.run.smithi101.stdout: "event": "throttled", 2023-08-01T19:54:38.125 INFO:teuthology.orchestra.run.smithi101.stdout: "time": "2023-08-01T19:54:04.459039+0000", 2023-08-01T19:54:38.125 INFO:teuthology.orchestra.run.smithi101.stdout: "duration": 0 2023-08-01T19:54:38.126 INFO:teuthology.orchestra.run.smithi101.stdout: }, 2023-08-01T19:54:38.126 INFO:teuthology.orchestra.run.smithi101.stdout: { 2023-08-01T19:54:38.126 INFO:teuthology.orchestra.run.smithi101.stdout: "event": "header_read", 2023-08-01T19:54:38.126 INFO:teuthology.orchestra.run.smithi101.stdout: "time": "2023-08-01T19:54:04.459039+0000", 2023-08-01T19:54:38.126 INFO:teuthology.orchestra.run.smithi101.stdout: "duration": 4294967295.9999995 2023-08-01T19:54:38.126 INFO:teuthology.orchestra.run.smithi101.stdout: }, 2023-08-01T19:54:38.126 INFO:teuthology.orchestra.run.smithi101.stdout: { 2023-08-01T19:54:38.126 INFO:teuthology.orchestra.run.smithi101.stdout: "event": "all_read", 2023-08-01T19:54:38.127 INFO:teuthology.orchestra.run.smithi101.stdout: "time": "2023-08-01T19:54:04.459043+0000", 2023-08-01T19:54:38.127 INFO:teuthology.orchestra.run.smithi101.stdout: "duration": 4.1500000000000001e-06 2023-08-01T19:54:38.127 INFO:teuthology.orchestra.run.smithi101.stdout: }, 2023-08-01T19:54:38.127 INFO:teuthology.orchestra.run.smithi101.stdout: { 2023-08-01T19:54:38.127 INFO:teuthology.orchestra.run.smithi101.stdout: "event": "dispatched", 2023-08-01T19:54:38.127 INFO:teuthology.orchestra.run.smithi101.stdout: "time": "2023-08-01T19:54:04.459051+0000", 2023-08-01T19:54:38.127 INFO:teuthology.orchestra.run.smithi101.stdout: "duration": 8.4190000000000002e-06 2023-08-01T19:54:38.127 INFO:teuthology.orchestra.run.smithi101.stdout: }, 2023-08-01T19:54:38.128 INFO:teuthology.orchestra.run.smithi101.stdout: { 2023-08-01T19:54:38.128 INFO:teuthology.orchestra.run.smithi101.stdout: "event": "queued_for_pg", 2023-08-01T19:54:38.128 INFO:teuthology.orchestra.run.smithi101.stdout: "time": "2023-08-01T19:54:04.459056+0000", 2023-08-01T19:54:38.128 INFO:teuthology.orchestra.run.smithi101.stdout: "duration": 5.339e-06 2023-08-01T19:54:38.128 INFO:teuthology.orchestra.run.smithi101.stdout: }, 2023-08-01T19:54:38.128 INFO:teuthology.orchestra.run.smithi101.stdout: { 2023-08-01T19:54:38.128 INFO:teuthology.orchestra.run.smithi101.stdout: "event": "reached_pg", 2023-08-01T19:54:38.129 INFO:teuthology.orchestra.run.smithi101.stdout: "time": "2023-08-01T19:54:04.459091+0000", 2023-08-01T19:54:38.129 INFO:teuthology.orchestra.run.smithi101.stdout: "duration": 3.4090000000000001e-05 2023-08-01T19:54:38.129 INFO:teuthology.orchestra.run.smithi101.stdout: }, 2023-08-01T19:54:38.129 INFO:teuthology.orchestra.run.smithi101.stdout: { 2023-08-01T19:54:38.129 INFO:teuthology.orchestra.run.smithi101.stdout: "event": "op must wait for map", 2023-08-01T19:54:38.129 INFO:teuthology.orchestra.run.smithi101.stdout: "time": "2023-08-01T19:54:04.459094+0000", 2023-08-01T19:54:38.129 INFO:teuthology.orchestra.run.smithi101.stdout: "duration": 3.303e-06 2023-08-01T19:54:38.129 INFO:teuthology.orchestra.run.smithi101.stdout: }, 2023-08-01T19:54:38.130 INFO:teuthology.orchestra.run.smithi101.stdout: { 2023-08-01T19:54:38.130 INFO:teuthology.orchestra.run.smithi101.stdout: "event": "reached_pg", 2023-08-01T19:54:38.130 INFO:teuthology.orchestra.run.smithi101.stdout: "time": "2023-08-01T19:54:04.469860+0000", 2023-08-01T19:54:38.130 INFO:teuthology.orchestra.run.smithi101.stdout: "duration": 0.010765749 2023-08-01T19:54:38.130 INFO:teuthology.orchestra.run.smithi101.stdout: }, 2023-08-01T19:54:38.130 INFO:teuthology.orchestra.run.smithi101.stdout: { 2023-08-01T19:54:38.130 INFO:teuthology.orchestra.run.smithi101.stdout: "event": "started", 2023-08-01T19:54:38.130 INFO:teuthology.orchestra.run.smithi101.stdout: "time": "2023-08-01T19:54:04.470008+0000", 2023-08-01T19:54:38.131 INFO:teuthology.orchestra.run.smithi101.stdout: "duration": 0.000148367 2023-08-01T19:54:38.131 INFO:teuthology.orchestra.run.smithi101.stdout: }, 2023-08-01T19:54:38.131 INFO:teuthology.orchestra.run.smithi101.stdout: { 2023-08-01T19:54:38.131 INFO:teuthology.orchestra.run.smithi101.stdout: "event": "waiting for subops from 2", 2023-08-01T19:54:38.131 INFO:teuthology.orchestra.run.smithi101.stdout: "time": "2023-08-01T19:54:04.470136+0000", 2023-08-01T19:54:38.131 INFO:teuthology.orchestra.run.smithi101.stdout: "duration": 0.000128329 2023-08-01T19:54:38.131 INFO:teuthology.orchestra.run.smithi101.stdout: }, 2023-08-01T19:54:38.131 INFO:teuthology.orchestra.run.smithi101.stdout: { 2023-08-01T19:54:38.132 INFO:teuthology.orchestra.run.smithi101.stdout: "event": "op_commit", 2023-08-01T19:54:38.132 INFO:teuthology.orchestra.run.smithi101.stdout: "time": "2023-08-01T19:54:04.476399+0000", 2023-08-01T19:54:38.132 INFO:teuthology.orchestra.run.smithi101.stdout: "duration": 0.0062627259999999997 2023-08-01T19:54:38.132 INFO:teuthology.orchestra.run.smithi101.stdout: }, 2023-08-01T19:54:38.132 INFO:teuthology.orchestra.run.smithi101.stdout: { 2023-08-01T19:54:38.132 INFO:teuthology.orchestra.run.smithi101.stdout: "event": "sub_op_commit_rec", 2023-08-01T19:54:38.132 INFO:teuthology.orchestra.run.smithi101.stdout: "time": "2023-08-01T19:54:04.477726+0000", 2023-08-01T19:54:38.132 INFO:teuthology.orchestra.run.smithi101.stdout: "duration": 0.001327103 2023-08-01T19:54:38.133 INFO:teuthology.orchestra.run.smithi101.stdout: }, 2023-08-01T19:54:38.133 INFO:teuthology.orchestra.run.smithi101.stdout: { 2023-08-01T19:54:38.133 INFO:teuthology.orchestra.run.smithi101.stdout: "event": "commit_sent", 2023-08-01T19:54:38.133 INFO:teuthology.orchestra.run.smithi101.stdout: "time": "2023-08-01T19:54:04.477771+0000", 2023-08-01T19:54:38.133 INFO:teuthology.orchestra.run.smithi101.stdout: "duration": 4.5232000000000003e-05 2023-08-01T19:54:38.133 INFO:teuthology.orchestra.run.smithi101.stdout: }, 2023-08-01T19:54:38.133 INFO:teuthology.orchestra.run.smithi101.stdout: { 2023-08-01T19:54:38.134 INFO:teuthology.orchestra.run.smithi101.stdout: "event": "done", 2023-08-01T19:54:38.134 INFO:teuthology.orchestra.run.smithi101.stdout: "time": "2023-08-01T19:54:04.477795+0000", 2023-08-01T19:54:38.134 INFO:teuthology.orchestra.run.smithi101.stdout: "duration": 2.4134999999999998e-05 2023-08-01T19:54:38.134 INFO:teuthology.orchestra.run.smithi101.stdout: } 2023-08-01T19:54:38.134 INFO:teuthology.orchestra.run.smithi101.stdout: ] 2023-08-01T19:54:38.134 INFO:teuthology.orchestra.run.smithi101.stdout: } 2023-08-01T19:54:38.134 INFO:teuthology.orchestra.run.smithi101.stdout: }, 2023-08-01T19:54:38.134 INFO:teuthology.orchestra.run.smithi101.stdout: { 2023-08-01T19:54:38.135 INFO:teuthology.orchestra.run.smithi101.stdout: "description": "osd_op(mds.0.3:19 3.14 3:2f55791f:::606.00000000:head [create,setxattr parent (62) in=6b,setxattr layout (30) in=6b] snapc 0=[] ondisk+write+known_if_redirected+full_force+supports_pool_eio e17)", 2023-08-01T19:54:38.135 INFO:teuthology.orchestra.run.smithi101.stdout: "initiated_at": "2023-08-01T19:54:04.459069+0000", 2023-08-01T19:54:38.135 INFO:teuthology.orchestra.run.smithi101.stdout: "age": 33.571234969999999, 2023-08-01T19:54:38.135 INFO:teuthology.orchestra.run.smithi101.stdout: "duration": 0.019523045999999999, 2023-08-01T19:54:38.135 INFO:teuthology.orchestra.run.smithi101.stdout: "type_data": { 2023-08-01T19:54:38.135 INFO:teuthology.orchestra.run.smithi101.stdout: "flag_point": "commit sent; apply or cleanup", 2023-08-01T19:54:38.135 INFO:teuthology.orchestra.run.smithi101.stdout: "events": [ 2023-08-01T19:54:38.135 INFO:teuthology.orchestra.run.smithi101.stdout: { 2023-08-01T19:54:38.136 INFO:teuthology.orchestra.run.smithi101.stdout: "event": "initiated", 2023-08-01T19:54:38.136 INFO:teuthology.orchestra.run.smithi101.stdout: "time": "2023-08-01T19:54:04.459069+0000", 2023-08-01T19:54:38.136 INFO:teuthology.orchestra.run.smithi101.stdout: "duration": 0 2023-08-01T19:54:38.136 INFO:teuthology.orchestra.run.smithi101.stdout: }, 2023-08-01T19:54:38.136 INFO:teuthology.orchestra.run.smithi101.stdout: { 2023-08-01T19:54:38.136 INFO:teuthology.orchestra.run.smithi101.stdout: "event": "throttled", 2023-08-01T19:54:38.136 INFO:teuthology.orchestra.run.smithi101.stdout: "time": "2023-08-01T19:54:04.459069+0000", 2023-08-01T19:54:38.136 INFO:teuthology.orchestra.run.smithi101.stdout: "duration": 0 2023-08-01T19:54:38.137 INFO:teuthology.orchestra.run.smithi101.stdout: }, 2023-08-01T19:54:38.137 INFO:teuthology.orchestra.run.smithi101.stdout: { 2023-08-01T19:54:38.137 INFO:teuthology.orchestra.run.smithi101.stdout: "event": "header_read", 2023-08-01T19:54:38.137 INFO:teuthology.orchestra.run.smithi101.stdout: "time": "2023-08-01T19:54:04.459069+0000", 2023-08-01T19:54:38.137 INFO:teuthology.orchestra.run.smithi101.stdout: "duration": 4294967295.9999995 2023-08-01T19:54:38.137 INFO:teuthology.orchestra.run.smithi101.stdout: }, 2023-08-01T19:54:38.137 INFO:teuthology.orchestra.run.smithi101.stdout: { 2023-08-01T19:54:38.137 INFO:teuthology.orchestra.run.smithi101.stdout: "event": "all_read", 2023-08-01T19:54:38.138 INFO:teuthology.orchestra.run.smithi101.stdout: "time": "2023-08-01T19:54:04.459072+0000", 2023-08-01T19:54:38.138 INFO:teuthology.orchestra.run.smithi101.stdout: "duration": 3.4570000000000001e-06 2023-08-01T19:54:38.138 INFO:teuthology.orchestra.run.smithi101.stdout: }, 2023-08-01T19:54:38.138 INFO:teuthology.orchestra.run.smithi101.stdout: { 2023-08-01T19:54:38.138 INFO:teuthology.orchestra.run.smithi101.stdout: "event": "dispatched", 2023-08-01T19:54:38.138 INFO:teuthology.orchestra.run.smithi101.stdout: "time": "2023-08-01T19:54:04.459080+0000", 2023-08-01T19:54:38.138 INFO:teuthology.orchestra.run.smithi101.stdout: "duration": 7.6009999999999997e-06 2023-08-01T19:54:38.138 INFO:teuthology.orchestra.run.smithi101.stdout: }, 2023-08-01T19:54:38.139 INFO:teuthology.orchestra.run.smithi101.stdout: { 2023-08-01T19:54:38.139 INFO:teuthology.orchestra.run.smithi101.stdout: "event": "queued_for_pg", 2023-08-01T19:54:38.139 INFO:teuthology.orchestra.run.smithi101.stdout: "time": "2023-08-01T19:54:04.459088+0000", 2023-08-01T19:54:38.139 INFO:teuthology.orchestra.run.smithi101.stdout: "duration": 8.0509999999999997e-06 2023-08-01T19:54:38.139 INFO:teuthology.orchestra.run.smithi101.stdout: }, 2023-08-01T19:54:38.139 INFO:teuthology.orchestra.run.smithi101.stdout: { 2023-08-01T19:54:38.139 INFO:teuthology.orchestra.run.smithi101.stdout: "event": "reached_pg", 2023-08-01T19:54:38.139 INFO:teuthology.orchestra.run.smithi101.stdout: "time": "2023-08-01T19:54:04.459120+0000", 2023-08-01T19:54:38.140 INFO:teuthology.orchestra.run.smithi101.stdout: "duration": 3.2078e-05 2023-08-01T19:54:38.140 INFO:teuthology.orchestra.run.smithi101.stdout: }, 2023-08-01T19:54:38.140 INFO:teuthology.orchestra.run.smithi101.stdout: { 2023-08-01T19:54:38.140 INFO:teuthology.orchestra.run.smithi101.stdout: "event": "waiting_for_map not empty", 2023-08-01T19:54:38.140 INFO:teuthology.orchestra.run.smithi101.stdout: "time": "2023-08-01T19:54:04.459123+0000", 2023-08-01T19:54:38.140 INFO:teuthology.orchestra.run.smithi101.stdout: "duration": 3.4699999999999998e-06 2023-08-01T19:54:38.140 INFO:teuthology.orchestra.run.smithi101.stdout: }, 2023-08-01T19:54:38.141 INFO:teuthology.orchestra.run.smithi101.stdout: { 2023-08-01T19:54:38.141 INFO:teuthology.orchestra.run.smithi101.stdout: "event": "reached_pg", 2023-08-01T19:54:38.141 INFO:teuthology.orchestra.run.smithi101.stdout: "time": "2023-08-01T19:54:04.471352+0000", 2023-08-01T19:54:38.141 INFO:teuthology.orchestra.run.smithi101.stdout: "duration": 0.01222926 2023-08-01T19:54:38.141 INFO:teuthology.orchestra.run.smithi101.stdout: }, 2023-08-01T19:54:38.141 INFO:teuthology.orchestra.run.smithi101.stdout: { 2023-08-01T19:54:38.141 INFO:teuthology.orchestra.run.smithi101.stdout: "event": "started", 2023-08-01T19:54:38.141 INFO:teuthology.orchestra.run.smithi101.stdout: "time": "2023-08-01T19:54:04.471495+0000", 2023-08-01T19:54:38.142 INFO:teuthology.orchestra.run.smithi101.stdout: "duration": 0.00014263899999999999 2023-08-01T19:54:38.142 INFO:teuthology.orchestra.run.smithi101.stdout: }, 2023-08-01T19:54:38.142 INFO:teuthology.orchestra.run.smithi101.stdout: { 2023-08-01T19:54:38.142 INFO:teuthology.orchestra.run.smithi101.stdout: "event": "waiting for subops from 2", 2023-08-01T19:54:38.142 INFO:teuthology.orchestra.run.smithi101.stdout: "time": "2023-08-01T19:54:04.472368+0000", 2023-08-01T19:54:38.142 INFO:teuthology.orchestra.run.smithi101.stdout: "duration": 0.00087245300000000003 2023-08-01T19:54:38.142 INFO:teuthology.orchestra.run.smithi101.stdout: }, 2023-08-01T19:54:38.142 INFO:teuthology.orchestra.run.smithi101.stdout: { 2023-08-01T19:54:38.143 INFO:teuthology.orchestra.run.smithi101.stdout: "event": "op_commit", 2023-08-01T19:54:38.143 INFO:teuthology.orchestra.run.smithi101.stdout: "time": "2023-08-01T19:54:04.477612+0000", 2023-08-01T19:54:38.143 INFO:teuthology.orchestra.run.smithi101.stdout: "duration": 0.0052442809999999999 2023-08-01T19:54:38.143 INFO:teuthology.orchestra.run.smithi101.stdout: }, 2023-08-01T19:54:38.143 INFO:teuthology.orchestra.run.smithi101.stdout: { 2023-08-01T19:54:38.143 INFO:teuthology.orchestra.run.smithi101.stdout: "event": "sub_op_commit_rec", 2023-08-01T19:54:38.143 INFO:teuthology.orchestra.run.smithi101.stdout: "time": "2023-08-01T19:54:04.478516+0000", 2023-08-01T19:54:38.143 INFO:teuthology.orchestra.run.smithi101.stdout: "duration": 0.00090399800000000004 2023-08-01T19:54:38.144 INFO:teuthology.orchestra.run.smithi101.stdout: }, 2023-08-01T19:54:38.144 INFO:teuthology.orchestra.run.smithi101.stdout: { 2023-08-01T19:54:38.144 INFO:teuthology.orchestra.run.smithi101.stdout: "event": "commit_sent", 2023-08-01T19:54:38.144 INFO:teuthology.orchestra.run.smithi101.stdout: "time": "2023-08-01T19:54:04.478555+0000", 2023-08-01T19:54:38.144 INFO:teuthology.orchestra.run.smithi101.stdout: "duration": 3.8977000000000003e-05 2023-08-01T19:54:38.144 INFO:teuthology.orchestra.run.smithi101.stdout: }, 2023-08-01T19:54:38.144 INFO:teuthology.orchestra.run.smithi101.stdout: { 2023-08-01T19:54:38.144 INFO:teuthology.orchestra.run.smithi101.stdout: "event": "done", 2023-08-01T19:54:38.145 INFO:teuthology.orchestra.run.smithi101.stdout: "time": "2023-08-01T19:54:04.478592+0000", 2023-08-01T19:54:38.145 INFO:teuthology.orchestra.run.smithi101.stdout: "duration": 3.7287999999999999e-05 2023-08-01T19:54:38.145 INFO:teuthology.orchestra.run.smithi101.stdout: } 2023-08-01T19:54:38.145 INFO:teuthology.orchestra.run.smithi101.stdout: ] 2023-08-01T19:54:38.145 INFO:teuthology.orchestra.run.smithi101.stdout: } 2023-08-01T19:54:38.145 INFO:teuthology.orchestra.run.smithi101.stdout: }, 2023-08-01T19:54:38.145 INFO:teuthology.orchestra.run.smithi101.stdout: { 2023-08-01T19:54:38.145 INFO:teuthology.orchestra.run.smithi101.stdout: "description": "osd_op(mds.0.3:20 3.1c 3:3ed09add:::607.00000000:head [omap-set-header] snapc 0=[] ondisk+write+known_if_redirected+full_force+supports_pool_eio e17)", 2023-08-01T19:54:38.146 INFO:teuthology.orchestra.run.smithi101.stdout: "initiated_at": "2023-08-01T19:54:04.459097+0000", 2023-08-01T19:54:38.146 INFO:teuthology.orchestra.run.smithi101.stdout: "age": 33.571207266000002, 2023-08-01T19:54:38.146 INFO:teuthology.orchestra.run.smithi101.stdout: "duration": 0.018578978999999999, 2023-08-01T19:54:38.146 INFO:teuthology.orchestra.run.smithi101.stdout: "type_data": { 2023-08-01T19:54:38.146 INFO:teuthology.orchestra.run.smithi101.stdout: "flag_point": "commit sent; apply or cleanup", 2023-08-01T19:54:38.146 INFO:teuthology.orchestra.run.smithi101.stdout: "events": [ 2023-08-01T19:54:38.146 INFO:teuthology.orchestra.run.smithi101.stdout: { 2023-08-01T19:54:38.146 INFO:teuthology.orchestra.run.smithi101.stdout: "event": "initiated", 2023-08-01T19:54:38.147 INFO:teuthology.orchestra.run.smithi101.stdout: "time": "2023-08-01T19:54:04.459097+0000", 2023-08-01T19:54:38.147 INFO:teuthology.orchestra.run.smithi101.stdout: "duration": 0 2023-08-01T19:54:38.147 INFO:teuthology.orchestra.run.smithi101.stdout: }, 2023-08-01T19:54:38.147 INFO:teuthology.orchestra.run.smithi101.stdout: { 2023-08-01T19:54:38.147 INFO:teuthology.orchestra.run.smithi101.stdout: "event": "throttled", 2023-08-01T19:54:38.147 INFO:teuthology.orchestra.run.smithi101.stdout: "time": "2023-08-01T19:54:04.459097+0000", 2023-08-01T19:54:38.147 INFO:teuthology.orchestra.run.smithi101.stdout: "duration": 0 2023-08-01T19:54:38.148 INFO:teuthology.orchestra.run.smithi101.stdout: }, 2023-08-01T19:54:38.148 INFO:teuthology.orchestra.run.smithi101.stdout: { 2023-08-01T19:54:38.148 INFO:teuthology.orchestra.run.smithi101.stdout: "event": "header_read", 2023-08-01T19:54:38.148 INFO:teuthology.orchestra.run.smithi101.stdout: "time": "2023-08-01T19:54:04.459096+0000", 2023-08-01T19:54:38.148 INFO:teuthology.orchestra.run.smithi101.stdout: "duration": 4294967295.9999995 2023-08-01T19:54:38.148 INFO:teuthology.orchestra.run.smithi101.stdout: }, 2023-08-01T19:54:38.148 INFO:teuthology.orchestra.run.smithi101.stdout: { 2023-08-01T19:54:38.148 INFO:teuthology.orchestra.run.smithi101.stdout: "event": "all_read", 2023-08-01T19:54:38.149 INFO:teuthology.orchestra.run.smithi101.stdout: "time": "2023-08-01T19:54:04.459105+0000", 2023-08-01T19:54:38.149 INFO:teuthology.orchestra.run.smithi101.stdout: "duration": 8.8259999999999999e-06 2023-08-01T19:54:38.149 INFO:teuthology.orchestra.run.smithi101.stdout: }, 2023-08-01T19:54:38.149 INFO:teuthology.orchestra.run.smithi101.stdout: { 2023-08-01T19:54:38.149 INFO:teuthology.orchestra.run.smithi101.stdout: "event": "dispatched", 2023-08-01T19:54:38.149 INFO:teuthology.orchestra.run.smithi101.stdout: "time": "2023-08-01T19:54:04.459112+0000", 2023-08-01T19:54:38.149 INFO:teuthology.orchestra.run.smithi101.stdout: "duration": 6.6660000000000002e-06 2023-08-01T19:54:38.149 INFO:teuthology.orchestra.run.smithi101.stdout: }, 2023-08-01T19:54:38.150 INFO:teuthology.orchestra.run.smithi101.stdout: { 2023-08-01T19:54:38.150 INFO:teuthology.orchestra.run.smithi101.stdout: "event": "queued_for_pg", 2023-08-01T19:54:38.150 INFO:teuthology.orchestra.run.smithi101.stdout: "time": "2023-08-01T19:54:04.459116+0000", 2023-08-01T19:54:38.150 INFO:teuthology.orchestra.run.smithi101.stdout: "duration": 4.2209999999999999e-06 2023-08-01T19:54:38.150 INFO:teuthology.orchestra.run.smithi101.stdout: }, 2023-08-01T19:54:38.150 INFO:teuthology.orchestra.run.smithi101.stdout: { 2023-08-01T19:54:38.150 INFO:teuthology.orchestra.run.smithi101.stdout: "event": "reached_pg", 2023-08-01T19:54:38.150 INFO:teuthology.orchestra.run.smithi101.stdout: "time": "2023-08-01T19:54:04.459141+0000", 2023-08-01T19:54:38.151 INFO:teuthology.orchestra.run.smithi101.stdout: "duration": 2.4627e-05 2023-08-01T19:54:38.151 INFO:teuthology.orchestra.run.smithi101.stdout: }, 2023-08-01T19:54:38.151 INFO:teuthology.orchestra.run.smithi101.stdout: { 2023-08-01T19:54:38.151 INFO:teuthology.orchestra.run.smithi101.stdout: "event": "op must wait for map", 2023-08-01T19:54:38.151 INFO:teuthology.orchestra.run.smithi101.stdout: "time": "2023-08-01T19:54:04.459144+0000", 2023-08-01T19:54:38.151 INFO:teuthology.orchestra.run.smithi101.stdout: "duration": 3.6559999999999998e-06 2023-08-01T19:54:38.151 INFO:teuthology.orchestra.run.smithi101.stdout: }, 2023-08-01T19:54:38.151 INFO:teuthology.orchestra.run.smithi101.stdout: { 2023-08-01T19:54:38.152 INFO:teuthology.orchestra.run.smithi101.stdout: "event": "reached_pg", 2023-08-01T19:54:38.152 INFO:teuthology.orchestra.run.smithi101.stdout: "time": "2023-08-01T19:54:04.468086+0000", 2023-08-01T19:54:38.152 INFO:teuthology.orchestra.run.smithi101.stdout: "duration": 0.0089415569999999993 2023-08-01T19:54:38.152 INFO:teuthology.orchestra.run.smithi101.stdout: }, 2023-08-01T19:54:38.152 INFO:teuthology.orchestra.run.smithi101.stdout: { 2023-08-01T19:54:38.152 INFO:teuthology.orchestra.run.smithi101.stdout: "event": "started", 2023-08-01T19:54:38.152 INFO:teuthology.orchestra.run.smithi101.stdout: "time": "2023-08-01T19:54:04.468204+0000", 2023-08-01T19:54:38.152 INFO:teuthology.orchestra.run.smithi101.stdout: "duration": 0.00011806700000000001 2023-08-01T19:54:38.153 INFO:teuthology.orchestra.run.smithi101.stdout: }, 2023-08-01T19:54:38.153 INFO:teuthology.orchestra.run.smithi101.stdout: { 2023-08-01T19:54:38.153 INFO:teuthology.orchestra.run.smithi101.stdout: "event": "waiting for subops from 0", 2023-08-01T19:54:38.153 INFO:teuthology.orchestra.run.smithi101.stdout: "time": "2023-08-01T19:54:04.468342+0000", 2023-08-01T19:54:38.153 INFO:teuthology.orchestra.run.smithi101.stdout: "duration": 0.000138269 2023-08-01T19:54:38.153 INFO:teuthology.orchestra.run.smithi101.stdout: }, 2023-08-01T19:54:38.153 INFO:teuthology.orchestra.run.smithi101.stdout: { 2023-08-01T19:54:38.153 INFO:teuthology.orchestra.run.smithi101.stdout: "event": "op_commit", 2023-08-01T19:54:38.154 INFO:teuthology.orchestra.run.smithi101.stdout: "time": "2023-08-01T19:54:04.474028+0000", 2023-08-01T19:54:38.154 INFO:teuthology.orchestra.run.smithi101.stdout: "duration": 0.005685458 2023-08-01T19:54:38.154 INFO:teuthology.orchestra.run.smithi101.stdout: }, 2023-08-01T19:54:38.154 INFO:teuthology.orchestra.run.smithi101.stdout: { 2023-08-01T19:54:38.154 INFO:teuthology.orchestra.run.smithi101.stdout: "event": "sub_op_commit_rec", 2023-08-01T19:54:38.154 INFO:teuthology.orchestra.run.smithi101.stdout: "time": "2023-08-01T19:54:04.477581+0000", 2023-08-01T19:54:38.154 INFO:teuthology.orchestra.run.smithi101.stdout: "duration": 0.0035531109999999999 2023-08-01T19:54:38.154 INFO:teuthology.orchestra.run.smithi101.stdout: }, 2023-08-01T19:54:38.155 INFO:teuthology.orchestra.run.smithi101.stdout: { 2023-08-01T19:54:38.155 INFO:teuthology.orchestra.run.smithi101.stdout: "event": "commit_sent", 2023-08-01T19:54:38.155 INFO:teuthology.orchestra.run.smithi101.stdout: "time": "2023-08-01T19:54:04.477635+0000", 2023-08-01T19:54:38.155 INFO:teuthology.orchestra.run.smithi101.stdout: "duration": 5.3769e-05 2023-08-01T19:54:38.155 INFO:teuthology.orchestra.run.smithi101.stdout: }, 2023-08-01T19:54:38.155 INFO:teuthology.orchestra.run.smithi101.stdout: { 2023-08-01T19:54:38.155 INFO:teuthology.orchestra.run.smithi101.stdout: "event": "done", 2023-08-01T19:54:38.155 INFO:teuthology.orchestra.run.smithi101.stdout: "time": "2023-08-01T19:54:04.477676+0000", 2023-08-01T19:54:38.156 INFO:teuthology.orchestra.run.smithi101.stdout: "duration": 4.1148e-05 2023-08-01T19:54:38.156 INFO:teuthology.orchestra.run.smithi101.stdout: } 2023-08-01T19:54:38.156 INFO:teuthology.orchestra.run.smithi101.stdout: ] 2023-08-01T19:54:38.156 INFO:teuthology.orchestra.run.smithi101.stdout: } 2023-08-01T19:54:38.156 INFO:teuthology.orchestra.run.smithi101.stdout: }, 2023-08-01T19:54:38.156 INFO:teuthology.orchestra.run.smithi101.stdout: { 2023-08-01T19:54:38.156 INFO:teuthology.orchestra.run.smithi101.stdout: "description": "osd_op(mds.0.3:21 3.1c 3:3ed09add:::607.00000000:head [create,setxattr parent (62) in=6b,setxattr layout (30) in=6b] snapc 0=[] ondisk+write+known_if_redirected+full_force+supports_pool_eio e17)", 2023-08-01T19:54:38.157 INFO:teuthology.orchestra.run.smithi101.stdout: "initiated_at": "2023-08-01T19:54:04.459123+0000", 2023-08-01T19:54:38.157 INFO:teuthology.orchestra.run.smithi101.stdout: "age": 33.571181109000001, 2023-08-01T19:54:38.157 INFO:teuthology.orchestra.run.smithi101.stdout: "duration": 0.018736452000000001, 2023-08-01T19:54:38.157 INFO:teuthology.orchestra.run.smithi101.stdout: "type_data": { 2023-08-01T19:54:38.157 INFO:teuthology.orchestra.run.smithi101.stdout: "flag_point": "commit sent; apply or cleanup", 2023-08-01T19:54:38.157 INFO:teuthology.orchestra.run.smithi101.stdout: "events": [ 2023-08-01T19:54:38.157 INFO:teuthology.orchestra.run.smithi101.stdout: { 2023-08-01T19:54:38.157 INFO:teuthology.orchestra.run.smithi101.stdout: "event": "initiated", 2023-08-01T19:54:38.158 INFO:teuthology.orchestra.run.smithi101.stdout: "time": "2023-08-01T19:54:04.459123+0000", 2023-08-01T19:54:38.158 INFO:teuthology.orchestra.run.smithi101.stdout: "duration": 0 2023-08-01T19:54:38.158 INFO:teuthology.orchestra.run.smithi101.stdout: }, 2023-08-01T19:54:38.158 INFO:teuthology.orchestra.run.smithi101.stdout: { 2023-08-01T19:54:38.158 INFO:teuthology.orchestra.run.smithi101.stdout: "event": "throttled", 2023-08-01T19:54:38.158 INFO:teuthology.orchestra.run.smithi101.stdout: "time": "2023-08-01T19:54:04.459123+0000", 2023-08-01T19:54:38.158 INFO:teuthology.orchestra.run.smithi101.stdout: "duration": 0 2023-08-01T19:54:38.158 INFO:teuthology.orchestra.run.smithi101.stdout: }, 2023-08-01T19:54:38.159 INFO:teuthology.orchestra.run.smithi101.stdout: { 2023-08-01T19:54:38.159 INFO:teuthology.orchestra.run.smithi101.stdout: "event": "header_read", 2023-08-01T19:54:38.159 INFO:teuthology.orchestra.run.smithi101.stdout: "time": "2023-08-01T19:54:04.459123+0000", 2023-08-01T19:54:38.159 INFO:teuthology.orchestra.run.smithi101.stdout: "duration": 4294967295.9999995 2023-08-01T19:54:38.159 INFO:teuthology.orchestra.run.smithi101.stdout: }, 2023-08-01T19:54:38.159 INFO:teuthology.orchestra.run.smithi101.stdout: { 2023-08-01T19:54:38.159 INFO:teuthology.orchestra.run.smithi101.stdout: "event": "all_read", 2023-08-01T19:54:38.159 INFO:teuthology.orchestra.run.smithi101.stdout: "time": "2023-08-01T19:54:04.459127+0000", 2023-08-01T19:54:38.160 INFO:teuthology.orchestra.run.smithi101.stdout: "duration": 4.5770000000000004e-06 2023-08-01T19:54:38.160 INFO:teuthology.orchestra.run.smithi101.stdout: }, 2023-08-01T19:54:38.160 INFO:teuthology.orchestra.run.smithi101.stdout: { 2023-08-01T19:54:38.160 INFO:teuthology.orchestra.run.smithi101.stdout: "event": "dispatched", 2023-08-01T19:54:38.160 INFO:teuthology.orchestra.run.smithi101.stdout: "time": "2023-08-01T19:54:04.459134+0000", 2023-08-01T19:54:38.160 INFO:teuthology.orchestra.run.smithi101.stdout: "duration": 6.5080000000000002e-06 2023-08-01T19:54:38.160 INFO:teuthology.orchestra.run.smithi101.stdout: }, 2023-08-01T19:54:38.161 INFO:teuthology.orchestra.run.smithi101.stdout: { 2023-08-01T19:54:38.161 INFO:teuthology.orchestra.run.smithi101.stdout: "event": "queued_for_pg", 2023-08-01T19:54:38.161 INFO:teuthology.orchestra.run.smithi101.stdout: "time": "2023-08-01T19:54:04.459138+0000", 2023-08-01T19:54:38.161 INFO:teuthology.orchestra.run.smithi101.stdout: "duration": 4.6249999999999998e-06 2023-08-01T19:54:38.161 INFO:teuthology.orchestra.run.smithi101.stdout: }, 2023-08-01T19:54:38.161 INFO:teuthology.orchestra.run.smithi101.stdout: { 2023-08-01T19:54:38.161 INFO:teuthology.orchestra.run.smithi101.stdout: "event": "reached_pg", 2023-08-01T19:54:38.161 INFO:teuthology.orchestra.run.smithi101.stdout: "time": "2023-08-01T19:54:04.459158+0000", 2023-08-01T19:54:38.162 INFO:teuthology.orchestra.run.smithi101.stdout: "duration": 1.9354000000000001e-05 2023-08-01T19:54:38.162 INFO:teuthology.orchestra.run.smithi101.stdout: }, 2023-08-01T19:54:38.162 INFO:teuthology.orchestra.run.smithi101.stdout: { 2023-08-01T19:54:38.162 INFO:teuthology.orchestra.run.smithi101.stdout: "event": "waiting_for_map not empty", 2023-08-01T19:54:38.162 INFO:teuthology.orchestra.run.smithi101.stdout: "time": "2023-08-01T19:54:04.459160+0000", 2023-08-01T19:54:38.162 INFO:teuthology.orchestra.run.smithi101.stdout: "duration": 2.2740000000000002e-06 2023-08-01T19:54:38.162 INFO:teuthology.orchestra.run.smithi101.stdout: }, 2023-08-01T19:54:38.162 INFO:teuthology.orchestra.run.smithi101.stdout: { 2023-08-01T19:54:38.163 INFO:teuthology.orchestra.run.smithi101.stdout: "event": "reached_pg", 2023-08-01T19:54:38.163 INFO:teuthology.orchestra.run.smithi101.stdout: "time": "2023-08-01T19:54:04.468839+0000", 2023-08-01T19:54:38.163 INFO:teuthology.orchestra.run.smithi101.stdout: "duration": 0.0096787109999999996 2023-08-01T19:54:38.163 INFO:teuthology.orchestra.run.smithi101.stdout: }, 2023-08-01T19:54:38.163 INFO:teuthology.orchestra.run.smithi101.stdout: { 2023-08-01T19:54:38.163 INFO:teuthology.orchestra.run.smithi101.stdout: "event": "started", 2023-08-01T19:54:38.163 INFO:teuthology.orchestra.run.smithi101.stdout: "time": "2023-08-01T19:54:04.469446+0000", 2023-08-01T19:54:38.163 INFO:teuthology.orchestra.run.smithi101.stdout: "duration": 0.00060714899999999997 2023-08-01T19:54:38.164 INFO:teuthology.orchestra.run.smithi101.stdout: }, 2023-08-01T19:54:38.164 INFO:teuthology.orchestra.run.smithi101.stdout: { 2023-08-01T19:54:38.164 INFO:teuthology.orchestra.run.smithi101.stdout: "event": "waiting for subops from 0", 2023-08-01T19:54:38.164 INFO:teuthology.orchestra.run.smithi101.stdout: "time": "2023-08-01T19:54:04.470133+0000", 2023-08-01T19:54:38.164 INFO:teuthology.orchestra.run.smithi101.stdout: "duration": 0.00068691900000000003 2023-08-01T19:54:38.164 INFO:teuthology.orchestra.run.smithi101.stdout: }, 2023-08-01T19:54:38.164 INFO:teuthology.orchestra.run.smithi101.stdout: { 2023-08-01T19:54:38.164 INFO:teuthology.orchestra.run.smithi101.stdout: "event": "op_commit", 2023-08-01T19:54:38.165 INFO:teuthology.orchestra.run.smithi101.stdout: "time": "2023-08-01T19:54:04.475933+0000", 2023-08-01T19:54:38.165 INFO:teuthology.orchestra.run.smithi101.stdout: "duration": 0.0058002560000000002 2023-08-01T19:54:38.165 INFO:teuthology.orchestra.run.smithi101.stdout: }, 2023-08-01T19:54:38.165 INFO:teuthology.orchestra.run.smithi101.stdout: { 2023-08-01T19:54:38.165 INFO:teuthology.orchestra.run.smithi101.stdout: "event": "sub_op_commit_rec", 2023-08-01T19:54:38.165 INFO:teuthology.orchestra.run.smithi101.stdout: "time": "2023-08-01T19:54:04.477749+0000", 2023-08-01T19:54:38.165 INFO:teuthology.orchestra.run.smithi101.stdout: "duration": 0.00181584 2023-08-01T19:54:38.165 INFO:teuthology.orchestra.run.smithi101.stdout: }, 2023-08-01T19:54:38.166 INFO:teuthology.orchestra.run.smithi101.stdout: { 2023-08-01T19:54:38.166 INFO:teuthology.orchestra.run.smithi101.stdout: "event": "commit_sent", 2023-08-01T19:54:38.166 INFO:teuthology.orchestra.run.smithi101.stdout: "time": "2023-08-01T19:54:04.477823+0000", 2023-08-01T19:54:38.166 INFO:teuthology.orchestra.run.smithi101.stdout: "duration": 7.4405000000000003e-05 2023-08-01T19:54:38.166 INFO:teuthology.orchestra.run.smithi101.stdout: }, 2023-08-01T19:54:38.166 INFO:teuthology.orchestra.run.smithi101.stdout: { 2023-08-01T19:54:38.166 INFO:teuthology.orchestra.run.smithi101.stdout: "event": "done", 2023-08-01T19:54:38.166 INFO:teuthology.orchestra.run.smithi101.stdout: "time": "2023-08-01T19:54:04.477859+0000", 2023-08-01T19:54:38.167 INFO:teuthology.orchestra.run.smithi101.stdout: "duration": 3.6211000000000003e-05 2023-08-01T19:54:38.167 INFO:teuthology.orchestra.run.smithi101.stdout: } 2023-08-01T19:54:38.167 INFO:teuthology.orchestra.run.smithi101.stdout: ] 2023-08-01T19:54:38.167 INFO:teuthology.orchestra.run.smithi101.stdout: } 2023-08-01T19:54:38.167 INFO:teuthology.orchestra.run.smithi101.stdout: }, 2023-08-01T19:54:38.167 INFO:teuthology.orchestra.run.smithi101.stdout: { 2023-08-01T19:54:38.167 INFO:teuthology.orchestra.run.smithi101.stdout: "description": "osd_op(mds.0.3:29 3.13 3:cd5a64a3:::100.00000000:head [omap-set-header,omap-set-vals] snapc 0=[] ondisk+write+known_if_redirected+full_force+supports_pool_eio e17)", 2023-08-01T19:54:38.168 INFO:teuthology.orchestra.run.smithi101.stdout: "initiated_at": "2023-08-01T19:54:04.459146+0000", 2023-08-01T19:54:38.168 INFO:teuthology.orchestra.run.smithi101.stdout: "age": 33.571157908000004, 2023-08-01T19:54:38.168 INFO:teuthology.orchestra.run.smithi101.stdout: "duration": 0.015668519999999998, 2023-08-01T19:54:38.168 INFO:teuthology.orchestra.run.smithi101.stdout: "type_data": { 2023-08-01T19:54:38.168 INFO:teuthology.orchestra.run.smithi101.stdout: "flag_point": "commit sent; apply or cleanup", 2023-08-01T19:54:38.168 INFO:teuthology.orchestra.run.smithi101.stdout: "events": [ 2023-08-01T19:54:38.168 INFO:teuthology.orchestra.run.smithi101.stdout: { 2023-08-01T19:54:38.168 INFO:teuthology.orchestra.run.smithi101.stdout: "event": "initiated", 2023-08-01T19:54:38.169 INFO:teuthology.orchestra.run.smithi101.stdout: "time": "2023-08-01T19:54:04.459146+0000", 2023-08-01T19:54:38.169 INFO:teuthology.orchestra.run.smithi101.stdout: "duration": 0 2023-08-01T19:54:38.169 INFO:teuthology.orchestra.run.smithi101.stdout: }, 2023-08-01T19:54:38.169 INFO:teuthology.orchestra.run.smithi101.stdout: { 2023-08-01T19:54:38.169 INFO:teuthology.orchestra.run.smithi101.stdout: "event": "throttled", 2023-08-01T19:54:38.169 INFO:teuthology.orchestra.run.smithi101.stdout: "time": "2023-08-01T19:54:04.459146+0000", 2023-08-01T19:54:38.169 INFO:teuthology.orchestra.run.smithi101.stdout: "duration": 0 2023-08-01T19:54:38.169 INFO:teuthology.orchestra.run.smithi101.stdout: }, 2023-08-01T19:54:38.170 INFO:teuthology.orchestra.run.smithi101.stdout: { 2023-08-01T19:54:38.170 INFO:teuthology.orchestra.run.smithi101.stdout: "event": "header_read", 2023-08-01T19:54:38.170 INFO:teuthology.orchestra.run.smithi101.stdout: "time": "2023-08-01T19:54:04.459146+0000", 2023-08-01T19:54:38.170 INFO:teuthology.orchestra.run.smithi101.stdout: "duration": 4294967295.9999995 2023-08-01T19:54:38.170 INFO:teuthology.orchestra.run.smithi101.stdout: }, 2023-08-01T19:54:38.170 INFO:teuthology.orchestra.run.smithi101.stdout: { 2023-08-01T19:54:38.170 INFO:teuthology.orchestra.run.smithi101.stdout: "event": "all_read", 2023-08-01T19:54:38.170 INFO:teuthology.orchestra.run.smithi101.stdout: "time": "2023-08-01T19:54:04.459155+0000", 2023-08-01T19:54:38.171 INFO:teuthology.orchestra.run.smithi101.stdout: "duration": 9.6020000000000006e-06 2023-08-01T19:54:38.171 INFO:teuthology.orchestra.run.smithi101.stdout: }, 2023-08-01T19:54:38.171 INFO:teuthology.orchestra.run.smithi101.stdout: { 2023-08-01T19:54:38.171 INFO:teuthology.orchestra.run.smithi101.stdout: "event": "dispatched", 2023-08-01T19:54:38.171 INFO:teuthology.orchestra.run.smithi101.stdout: "time": "2023-08-01T19:54:04.459162+0000", 2023-08-01T19:54:38.171 INFO:teuthology.orchestra.run.smithi101.stdout: "duration": 7.0439999999999998e-06 2023-08-01T19:54:38.171 INFO:teuthology.orchestra.run.smithi101.stdout: }, 2023-08-01T19:54:38.171 INFO:teuthology.orchestra.run.smithi101.stdout: { 2023-08-01T19:54:38.172 INFO:teuthology.orchestra.run.smithi101.stdout: "event": "queued_for_pg", 2023-08-01T19:54:38.172 INFO:teuthology.orchestra.run.smithi101.stdout: "time": "2023-08-01T19:54:04.459167+0000", 2023-08-01T19:54:38.172 INFO:teuthology.orchestra.run.smithi101.stdout: "duration": 4.3989999999999997e-06 2023-08-01T19:54:38.172 INFO:teuthology.orchestra.run.smithi101.stdout: }, 2023-08-01T19:54:38.172 INFO:teuthology.orchestra.run.smithi101.stdout: { 2023-08-01T19:54:38.172 INFO:teuthology.orchestra.run.smithi101.stdout: "event": "reached_pg", 2023-08-01T19:54:38.172 INFO:teuthology.orchestra.run.smithi101.stdout: "time": "2023-08-01T19:54:04.459201+0000", 2023-08-01T19:54:38.172 INFO:teuthology.orchestra.run.smithi101.stdout: "duration": 3.4406000000000002e-05 2023-08-01T19:54:38.173 INFO:teuthology.orchestra.run.smithi101.stdout: }, 2023-08-01T19:54:38.173 INFO:teuthology.orchestra.run.smithi101.stdout: { 2023-08-01T19:54:38.173 INFO:teuthology.orchestra.run.smithi101.stdout: "event": "op must wait for map", 2023-08-01T19:54:38.173 INFO:teuthology.orchestra.run.smithi101.stdout: "time": "2023-08-01T19:54:04.459206+0000", 2023-08-01T19:54:38.173 INFO:teuthology.orchestra.run.smithi101.stdout: "duration": 5.04e-06 2023-08-01T19:54:38.173 INFO:teuthology.orchestra.run.smithi101.stdout: }, 2023-08-01T19:54:38.173 INFO:teuthology.orchestra.run.smithi101.stdout: { 2023-08-01T19:54:38.173 INFO:teuthology.orchestra.run.smithi101.stdout: "event": "reached_pg", 2023-08-01T19:54:38.174 INFO:teuthology.orchestra.run.smithi101.stdout: "time": "2023-08-01T19:54:04.468278+0000", 2023-08-01T19:54:38.174 INFO:teuthology.orchestra.run.smithi101.stdout: "duration": 0.0090714899999999998 2023-08-01T19:54:38.174 INFO:teuthology.orchestra.run.smithi101.stdout: }, 2023-08-01T19:54:38.174 INFO:teuthology.orchestra.run.smithi101.stdout: { 2023-08-01T19:54:38.174 INFO:teuthology.orchestra.run.smithi101.stdout: "event": "started", 2023-08-01T19:54:38.174 INFO:teuthology.orchestra.run.smithi101.stdout: "time": "2023-08-01T19:54:04.468419+0000", 2023-08-01T19:54:38.174 INFO:teuthology.orchestra.run.smithi101.stdout: "duration": 0.00014119100000000001 2023-08-01T19:54:38.174 INFO:teuthology.orchestra.run.smithi101.stdout: }, 2023-08-01T19:54:38.175 INFO:teuthology.orchestra.run.smithi101.stdout: { 2023-08-01T19:54:38.175 INFO:teuthology.orchestra.run.smithi101.stdout: "event": "waiting for subops from 0", 2023-08-01T19:54:38.175 INFO:teuthology.orchestra.run.smithi101.stdout: "time": "2023-08-01T19:54:04.468598+0000", 2023-08-01T19:54:38.175 INFO:teuthology.orchestra.run.smithi101.stdout: "duration": 0.00017872799999999999 2023-08-01T19:54:38.175 INFO:teuthology.orchestra.run.smithi101.stdout: }, 2023-08-01T19:54:38.175 INFO:teuthology.orchestra.run.smithi101.stdout: { 2023-08-01T19:54:38.175 INFO:teuthology.orchestra.run.smithi101.stdout: "event": "op_commit", 2023-08-01T19:54:38.175 INFO:teuthology.orchestra.run.smithi101.stdout: "time": "2023-08-01T19:54:04.472625+0000", 2023-08-01T19:54:38.176 INFO:teuthology.orchestra.run.smithi101.stdout: "duration": 0.0040273729999999999 2023-08-01T19:54:38.176 INFO:teuthology.orchestra.run.smithi101.stdout: }, 2023-08-01T19:54:38.176 INFO:teuthology.orchestra.run.smithi101.stdout: { 2023-08-01T19:54:38.176 INFO:teuthology.orchestra.run.smithi101.stdout: "event": "sub_op_commit_rec", 2023-08-01T19:54:38.176 INFO:teuthology.orchestra.run.smithi101.stdout: "time": "2023-08-01T19:54:04.474719+0000", 2023-08-01T19:54:38.176 INFO:teuthology.orchestra.run.smithi101.stdout: "duration": 0.0020941509999999998 2023-08-01T19:54:38.176 INFO:teuthology.orchestra.run.smithi101.stdout: }, 2023-08-01T19:54:38.177 INFO:teuthology.orchestra.run.smithi101.stdout: { 2023-08-01T19:54:38.177 INFO:teuthology.orchestra.run.smithi101.stdout: "event": "commit_sent", 2023-08-01T19:54:38.177 INFO:teuthology.orchestra.run.smithi101.stdout: "time": "2023-08-01T19:54:04.474776+0000", 2023-08-01T19:54:38.177 INFO:teuthology.orchestra.run.smithi101.stdout: "duration": 5.6368e-05 2023-08-01T19:54:38.177 INFO:teuthology.orchestra.run.smithi101.stdout: }, 2023-08-01T19:54:38.177 INFO:teuthology.orchestra.run.smithi101.stdout: { 2023-08-01T19:54:38.177 INFO:teuthology.orchestra.run.smithi101.stdout: "event": "done", 2023-08-01T19:54:38.177 INFO:teuthology.orchestra.run.smithi101.stdout: "time": "2023-08-01T19:54:04.474815+0000", 2023-08-01T19:54:38.178 INFO:teuthology.orchestra.run.smithi101.stdout: "duration": 3.9112000000000001e-05 2023-08-01T19:54:38.178 INFO:teuthology.orchestra.run.smithi101.stdout: } 2023-08-01T19:54:38.178 INFO:teuthology.orchestra.run.smithi101.stdout: ] 2023-08-01T19:54:38.178 INFO:teuthology.orchestra.run.smithi101.stdout: } 2023-08-01T19:54:38.178 INFO:teuthology.orchestra.run.smithi101.stdout: }, 2023-08-01T19:54:38.178 INFO:teuthology.orchestra.run.smithi101.stdout: { 2023-08-01T19:54:38.178 INFO:teuthology.orchestra.run.smithi101.stdout: "description": "osd_op(mds.0.3:1 3.14 3:292cf221:::200.00000000:head [writefull 0~90] snapc 0=[] ondisk+write+known_if_redirected+full_force+supports_pool_eio e17)", 2023-08-01T19:54:38.178 INFO:teuthology.orchestra.run.smithi101.stdout: "initiated_at": "2023-08-01T19:54:04.459177+0000", 2023-08-01T19:54:38.179 INFO:teuthology.orchestra.run.smithi101.stdout: "age": 33.571127400000002, 2023-08-01T19:54:38.179 INFO:teuthology.orchestra.run.smithi101.stdout: "duration": 0.021067196, 2023-08-01T19:54:38.179 INFO:teuthology.orchestra.run.smithi101.stdout: "type_data": { 2023-08-01T19:54:38.179 INFO:teuthology.orchestra.run.smithi101.stdout: "flag_point": "commit sent; apply or cleanup", 2023-08-01T19:54:38.179 INFO:teuthology.orchestra.run.smithi101.stdout: "events": [ 2023-08-01T19:54:38.179 INFO:teuthology.orchestra.run.smithi101.stdout: { 2023-08-01T19:54:38.179 INFO:teuthology.orchestra.run.smithi101.stdout: "event": "initiated", 2023-08-01T19:54:38.179 INFO:teuthology.orchestra.run.smithi101.stdout: "time": "2023-08-01T19:54:04.459177+0000", 2023-08-01T19:54:38.180 INFO:teuthology.orchestra.run.smithi101.stdout: "duration": 0 2023-08-01T19:54:38.180 INFO:teuthology.orchestra.run.smithi101.stdout: }, 2023-08-01T19:54:38.180 INFO:teuthology.orchestra.run.smithi101.stdout: { 2023-08-01T19:54:38.180 INFO:teuthology.orchestra.run.smithi101.stdout: "event": "throttled", 2023-08-01T19:54:38.180 INFO:teuthology.orchestra.run.smithi101.stdout: "time": "2023-08-01T19:54:04.459177+0000", 2023-08-01T19:54:38.180 INFO:teuthology.orchestra.run.smithi101.stdout: "duration": 0 2023-08-01T19:54:38.180 INFO:teuthology.orchestra.run.smithi101.stdout: }, 2023-08-01T19:54:38.180 INFO:teuthology.orchestra.run.smithi101.stdout: { 2023-08-01T19:54:38.181 INFO:teuthology.orchestra.run.smithi101.stdout: "event": "header_read", 2023-08-01T19:54:38.181 INFO:teuthology.orchestra.run.smithi101.stdout: "time": "2023-08-01T19:54:04.459176+0000", 2023-08-01T19:54:38.181 INFO:teuthology.orchestra.run.smithi101.stdout: "duration": 4294967295.9999995 2023-08-01T19:54:38.181 INFO:teuthology.orchestra.run.smithi101.stdout: }, 2023-08-01T19:54:38.181 INFO:teuthology.orchestra.run.smithi101.stdout: { 2023-08-01T19:54:38.181 INFO:teuthology.orchestra.run.smithi101.stdout: "event": "all_read", 2023-08-01T19:54:38.181 INFO:teuthology.orchestra.run.smithi101.stdout: "time": "2023-08-01T19:54:04.459181+0000", 2023-08-01T19:54:38.181 INFO:teuthology.orchestra.run.smithi101.stdout: "duration": 5.2109999999999997e-06 2023-08-01T19:54:38.182 INFO:teuthology.orchestra.run.smithi101.stdout: }, 2023-08-01T19:54:38.182 INFO:teuthology.orchestra.run.smithi101.stdout: { 2023-08-01T19:54:38.182 INFO:teuthology.orchestra.run.smithi101.stdout: "event": "dispatched", 2023-08-01T19:54:38.182 INFO:teuthology.orchestra.run.smithi101.stdout: "time": "2023-08-01T19:54:04.459188+0000", 2023-08-01T19:54:38.182 INFO:teuthology.orchestra.run.smithi101.stdout: "duration": 6.6680000000000004e-06 2023-08-01T19:54:38.182 INFO:teuthology.orchestra.run.smithi101.stdout: }, 2023-08-01T19:54:38.182 INFO:teuthology.orchestra.run.smithi101.stdout: { 2023-08-01T19:54:38.182 INFO:teuthology.orchestra.run.smithi101.stdout: "event": "queued_for_pg", 2023-08-01T19:54:38.183 INFO:teuthology.orchestra.run.smithi101.stdout: "time": "2023-08-01T19:54:04.459192+0000", 2023-08-01T19:54:38.183 INFO:teuthology.orchestra.run.smithi101.stdout: "duration": 4.228e-06 2023-08-01T19:54:38.183 INFO:teuthology.orchestra.run.smithi101.stdout: }, 2023-08-01T19:54:38.183 INFO:teuthology.orchestra.run.smithi101.stdout: { 2023-08-01T19:54:38.183 INFO:teuthology.orchestra.run.smithi101.stdout: "event": "reached_pg", 2023-08-01T19:54:38.183 INFO:teuthology.orchestra.run.smithi101.stdout: "time": "2023-08-01T19:54:04.459219+0000", 2023-08-01T19:54:38.183 INFO:teuthology.orchestra.run.smithi101.stdout: "duration": 2.6930000000000001e-05 2023-08-01T19:54:38.184 INFO:teuthology.orchestra.run.smithi101.stdout: }, 2023-08-01T19:54:38.184 INFO:teuthology.orchestra.run.smithi101.stdout: { 2023-08-01T19:54:38.184 INFO:teuthology.orchestra.run.smithi101.stdout: "event": "waiting_for_map not empty", 2023-08-01T19:54:38.184 INFO:teuthology.orchestra.run.smithi101.stdout: "time": "2023-08-01T19:54:04.459223+0000", 2023-08-01T19:54:38.184 INFO:teuthology.orchestra.run.smithi101.stdout: "duration": 3.8469999999999998e-06 2023-08-01T19:54:38.184 INFO:teuthology.orchestra.run.smithi101.stdout: }, 2023-08-01T19:54:38.184 INFO:teuthology.orchestra.run.smithi101.stdout: { 2023-08-01T19:54:38.184 INFO:teuthology.orchestra.run.smithi101.stdout: "event": "reached_pg", 2023-08-01T19:54:38.185 INFO:teuthology.orchestra.run.smithi101.stdout: "time": "2023-08-01T19:54:04.473347+0000", 2023-08-01T19:54:38.185 INFO:teuthology.orchestra.run.smithi101.stdout: "duration": 0.014124319 2023-08-01T19:54:38.185 INFO:teuthology.orchestra.run.smithi101.stdout: }, 2023-08-01T19:54:38.185 INFO:teuthology.orchestra.run.smithi101.stdout: { 2023-08-01T19:54:38.185 INFO:teuthology.orchestra.run.smithi101.stdout: "event": "started", 2023-08-01T19:54:38.185 INFO:teuthology.orchestra.run.smithi101.stdout: "time": "2023-08-01T19:54:04.473480+0000", 2023-08-01T19:54:38.185 INFO:teuthology.orchestra.run.smithi101.stdout: "duration": 0.00013276799999999999 2023-08-01T19:54:38.185 INFO:teuthology.orchestra.run.smithi101.stdout: }, 2023-08-01T19:54:38.186 INFO:teuthology.orchestra.run.smithi101.stdout: { 2023-08-01T19:54:38.186 INFO:teuthology.orchestra.run.smithi101.stdout: "event": "waiting for subops from 2", 2023-08-01T19:54:38.186 INFO:teuthology.orchestra.run.smithi101.stdout: "time": "2023-08-01T19:54:04.473622+0000", 2023-08-01T19:54:38.186 INFO:teuthology.orchestra.run.smithi101.stdout: "duration": 0.00014154799999999999 2023-08-01T19:54:38.186 INFO:teuthology.orchestra.run.smithi101.stdout: }, 2023-08-01T19:54:38.186 INFO:teuthology.orchestra.run.smithi101.stdout: { 2023-08-01T19:54:38.186 INFO:teuthology.orchestra.run.smithi101.stdout: "event": "op_commit", 2023-08-01T19:54:38.186 INFO:teuthology.orchestra.run.smithi101.stdout: "time": "2023-08-01T19:54:04.478281+0000", 2023-08-01T19:54:38.187 INFO:teuthology.orchestra.run.smithi101.stdout: "duration": 0.004659252 2023-08-01T19:54:38.187 INFO:teuthology.orchestra.run.smithi101.stdout: }, 2023-08-01T19:54:38.187 INFO:teuthology.orchestra.run.smithi101.stdout: { 2023-08-01T19:54:38.187 INFO:teuthology.orchestra.run.smithi101.stdout: "event": "sub_op_commit_rec", 2023-08-01T19:54:38.187 INFO:teuthology.orchestra.run.smithi101.stdout: "time": "2023-08-01T19:54:04.480180+0000", 2023-08-01T19:54:38.187 INFO:teuthology.orchestra.run.smithi101.stdout: "duration": 0.0018986859999999999 2023-08-01T19:54:38.187 INFO:teuthology.orchestra.run.smithi101.stdout: }, 2023-08-01T19:54:38.187 INFO:teuthology.orchestra.run.smithi101.stdout: { 2023-08-01T19:54:38.188 INFO:teuthology.orchestra.run.smithi101.stdout: "event": "commit_sent", 2023-08-01T19:54:38.188 INFO:teuthology.orchestra.run.smithi101.stdout: "time": "2023-08-01T19:54:04.480209+0000", 2023-08-01T19:54:38.188 INFO:teuthology.orchestra.run.smithi101.stdout: "duration": 2.9244999999999999e-05 2023-08-01T19:54:38.188 INFO:teuthology.orchestra.run.smithi101.stdout: }, 2023-08-01T19:54:38.188 INFO:teuthology.orchestra.run.smithi101.stdout: { 2023-08-01T19:54:38.188 INFO:teuthology.orchestra.run.smithi101.stdout: "event": "done", 2023-08-01T19:54:38.188 INFO:teuthology.orchestra.run.smithi101.stdout: "time": "2023-08-01T19:54:04.480244+0000", 2023-08-01T19:54:38.188 INFO:teuthology.orchestra.run.smithi101.stdout: "duration": 3.4875000000000001e-05 2023-08-01T19:54:38.189 INFO:teuthology.orchestra.run.smithi101.stdout: } 2023-08-01T19:54:38.189 INFO:teuthology.orchestra.run.smithi101.stdout: ] 2023-08-01T19:54:38.189 INFO:teuthology.orchestra.run.smithi101.stdout: } 2023-08-01T19:54:38.189 INFO:teuthology.orchestra.run.smithi101.stdout: }, 2023-08-01T19:54:38.189 INFO:teuthology.orchestra.run.smithi101.stdout: { 2023-08-01T19:54:38.189 INFO:teuthology.orchestra.run.smithi101.stdout: "description": "osd_op(mds.0.3:2 3.f 3:f1f69726:::400.00000000:head [writefull 0~22] snapc 0=[] ondisk+write+known_if_redirected+full_force+supports_pool_eio e17)", 2023-08-01T19:54:38.189 INFO:teuthology.orchestra.run.smithi101.stdout: "initiated_at": "2023-08-01T19:54:04.459201+0000", 2023-08-01T19:54:38.189 INFO:teuthology.orchestra.run.smithi101.stdout: "age": 33.571103143999999, 2023-08-01T19:54:38.190 INFO:teuthology.orchestra.run.smithi101.stdout: "duration": 0.016952979, 2023-08-01T19:54:38.190 INFO:teuthology.orchestra.run.smithi101.stdout: "type_data": { 2023-08-01T19:54:38.190 INFO:teuthology.orchestra.run.smithi101.stdout: "flag_point": "commit sent; apply or cleanup", 2023-08-01T19:54:38.190 INFO:teuthology.orchestra.run.smithi101.stdout: "events": [ 2023-08-01T19:54:38.190 INFO:teuthology.orchestra.run.smithi101.stdout: { 2023-08-01T19:54:38.190 INFO:teuthology.orchestra.run.smithi101.stdout: "event": "initiated", 2023-08-01T19:54:38.190 INFO:teuthology.orchestra.run.smithi101.stdout: "time": "2023-08-01T19:54:04.459201+0000", 2023-08-01T19:54:38.190 INFO:teuthology.orchestra.run.smithi101.stdout: "duration": 0 2023-08-01T19:54:38.191 INFO:teuthology.orchestra.run.smithi101.stdout: }, 2023-08-01T19:54:38.191 INFO:teuthology.orchestra.run.smithi101.stdout: { 2023-08-01T19:54:38.191 INFO:teuthology.orchestra.run.smithi101.stdout: "event": "throttled", 2023-08-01T19:54:38.191 INFO:teuthology.orchestra.run.smithi101.stdout: "time": "2023-08-01T19:54:04.459201+0000", 2023-08-01T19:54:38.191 INFO:teuthology.orchestra.run.smithi101.stdout: "duration": 0 2023-08-01T19:54:38.191 INFO:teuthology.orchestra.run.smithi101.stdout: }, 2023-08-01T19:54:38.191 INFO:teuthology.orchestra.run.smithi101.stdout: { 2023-08-01T19:54:38.191 INFO:teuthology.orchestra.run.smithi101.stdout: "event": "header_read", 2023-08-01T19:54:38.192 INFO:teuthology.orchestra.run.smithi101.stdout: "time": "2023-08-01T19:54:04.459201+0000", 2023-08-01T19:54:38.192 INFO:teuthology.orchestra.run.smithi101.stdout: "duration": 4294967295.9999995 2023-08-01T19:54:38.192 INFO:teuthology.orchestra.run.smithi101.stdout: }, 2023-08-01T19:54:38.192 INFO:teuthology.orchestra.run.smithi101.stdout: { 2023-08-01T19:54:38.192 INFO:teuthology.orchestra.run.smithi101.stdout: "event": "all_read", 2023-08-01T19:54:38.192 INFO:teuthology.orchestra.run.smithi101.stdout: "time": "2023-08-01T19:54:04.459204+0000", 2023-08-01T19:54:38.192 INFO:teuthology.orchestra.run.smithi101.stdout: "duration": 3.5599999999999998e-06 2023-08-01T19:54:38.193 INFO:teuthology.orchestra.run.smithi101.stdout: }, 2023-08-01T19:54:38.193 INFO:teuthology.orchestra.run.smithi101.stdout: { 2023-08-01T19:54:38.193 INFO:teuthology.orchestra.run.smithi101.stdout: "event": "dispatched", 2023-08-01T19:54:38.193 INFO:teuthology.orchestra.run.smithi101.stdout: "time": "2023-08-01T19:54:04.459211+0000", 2023-08-01T19:54:38.193 INFO:teuthology.orchestra.run.smithi101.stdout: "duration": 6.9299999999999997e-06 2023-08-01T19:54:38.193 INFO:teuthology.orchestra.run.smithi101.stdout: }, 2023-08-01T19:54:38.193 INFO:teuthology.orchestra.run.smithi101.stdout: { 2023-08-01T19:54:38.193 INFO:teuthology.orchestra.run.smithi101.stdout: "event": "queued_for_pg", 2023-08-01T19:54:38.194 INFO:teuthology.orchestra.run.smithi101.stdout: "time": "2023-08-01T19:54:04.459216+0000", 2023-08-01T19:54:38.194 INFO:teuthology.orchestra.run.smithi101.stdout: "duration": 4.5050000000000001e-06 2023-08-01T19:54:38.194 INFO:teuthology.orchestra.run.smithi101.stdout: }, 2023-08-01T19:54:38.194 INFO:teuthology.orchestra.run.smithi101.stdout: { 2023-08-01T19:54:38.194 INFO:teuthology.orchestra.run.smithi101.stdout: "event": "reached_pg", 2023-08-01T19:54:38.194 INFO:teuthology.orchestra.run.smithi101.stdout: "time": "2023-08-01T19:54:04.459246+0000", 2023-08-01T19:54:38.194 INFO:teuthology.orchestra.run.smithi101.stdout: "duration": 3.0369999999999999e-05 2023-08-01T19:54:38.194 INFO:teuthology.orchestra.run.smithi101.stdout: }, 2023-08-01T19:54:38.195 INFO:teuthology.orchestra.run.smithi101.stdout: { 2023-08-01T19:54:38.195 INFO:teuthology.orchestra.run.smithi101.stdout: "event": "op must wait for map", 2023-08-01T19:54:38.195 INFO:teuthology.orchestra.run.smithi101.stdout: "time": "2023-08-01T19:54:04.459250+0000", 2023-08-01T19:54:38.195 INFO:teuthology.orchestra.run.smithi101.stdout: "duration": 3.6880000000000001e-06 2023-08-01T19:54:38.195 INFO:teuthology.orchestra.run.smithi101.stdout: }, 2023-08-01T19:54:38.195 INFO:teuthology.orchestra.run.smithi101.stdout: { 2023-08-01T19:54:38.195 INFO:teuthology.orchestra.run.smithi101.stdout: "event": "reached_pg", 2023-08-01T19:54:38.195 INFO:teuthology.orchestra.run.smithi101.stdout: "time": "2023-08-01T19:54:04.469499+0000", 2023-08-01T19:54:38.196 INFO:teuthology.orchestra.run.smithi101.stdout: "duration": 0.010249052 2023-08-01T19:54:38.196 INFO:teuthology.orchestra.run.smithi101.stdout: }, 2023-08-01T19:54:38.196 INFO:teuthology.orchestra.run.smithi101.stdout: { 2023-08-01T19:54:38.196 INFO:teuthology.orchestra.run.smithi101.stdout: "event": "started", 2023-08-01T19:54:38.196 INFO:teuthology.orchestra.run.smithi101.stdout: "time": "2023-08-01T19:54:04.469619+0000", 2023-08-01T19:54:38.196 INFO:teuthology.orchestra.run.smithi101.stdout: "duration": 0.000120061 2023-08-01T19:54:38.196 INFO:teuthology.orchestra.run.smithi101.stdout: }, 2023-08-01T19:54:38.196 INFO:teuthology.orchestra.run.smithi101.stdout: { 2023-08-01T19:54:38.197 INFO:teuthology.orchestra.run.smithi101.stdout: "event": "waiting for subops from 2", 2023-08-01T19:54:38.197 INFO:teuthology.orchestra.run.smithi101.stdout: "time": "2023-08-01T19:54:04.469903+0000", 2023-08-01T19:54:38.197 INFO:teuthology.orchestra.run.smithi101.stdout: "duration": 0.00028409799999999999 2023-08-01T19:54:38.197 INFO:teuthology.orchestra.run.smithi101.stdout: }, 2023-08-01T19:54:38.197 INFO:teuthology.orchestra.run.smithi101.stdout: { 2023-08-01T19:54:38.197 INFO:teuthology.orchestra.run.smithi101.stdout: "event": "sub_op_commit_rec", 2023-08-01T19:54:38.197 INFO:teuthology.orchestra.run.smithi101.stdout: "time": "2023-08-01T19:54:04.475166+0000", 2023-08-01T19:54:38.197 INFO:teuthology.orchestra.run.smithi101.stdout: "duration": 0.0052632460000000001 2023-08-01T19:54:38.198 INFO:teuthology.orchestra.run.smithi101.stdout: }, 2023-08-01T19:54:38.198 INFO:teuthology.orchestra.run.smithi101.stdout: { 2023-08-01T19:54:38.198 INFO:teuthology.orchestra.run.smithi101.stdout: "event": "op_commit", 2023-08-01T19:54:38.198 INFO:teuthology.orchestra.run.smithi101.stdout: "time": "2023-08-01T19:54:04.476056+0000", 2023-08-01T19:54:38.198 INFO:teuthology.orchestra.run.smithi101.stdout: "duration": 0.00089017499999999999 2023-08-01T19:54:38.198 INFO:teuthology.orchestra.run.smithi101.stdout: }, 2023-08-01T19:54:38.198 INFO:teuthology.orchestra.run.smithi101.stdout: { 2023-08-01T19:54:38.198 INFO:teuthology.orchestra.run.smithi101.stdout: "event": "commit_sent", 2023-08-01T19:54:38.199 INFO:teuthology.orchestra.run.smithi101.stdout: "time": "2023-08-01T19:54:04.476115+0000", 2023-08-01T19:54:38.199 INFO:teuthology.orchestra.run.smithi101.stdout: "duration": 5.8464999999999997e-05 2023-08-01T19:54:38.199 INFO:teuthology.orchestra.run.smithi101.stdout: }, 2023-08-01T19:54:38.199 INFO:teuthology.orchestra.run.smithi101.stdout: { 2023-08-01T19:54:38.199 INFO:teuthology.orchestra.run.smithi101.stdout: "event": "done", 2023-08-01T19:54:38.199 INFO:teuthology.orchestra.run.smithi101.stdout: "time": "2023-08-01T19:54:04.476154+0000", 2023-08-01T19:54:38.199 INFO:teuthology.orchestra.run.smithi101.stdout: "duration": 3.9229e-05 2023-08-01T19:54:38.199 INFO:teuthology.orchestra.run.smithi101.stdout: } 2023-08-01T19:54:38.200 INFO:teuthology.orchestra.run.smithi101.stdout: ] 2023-08-01T19:54:38.200 INFO:teuthology.orchestra.run.smithi101.stdout: } 2023-08-01T19:54:38.200 INFO:teuthology.orchestra.run.smithi101.stdout: }, 2023-08-01T19:54:38.200 INFO:teuthology.orchestra.run.smithi101.stdout: { 2023-08-01T19:54:38.200 INFO:teuthology.orchestra.run.smithi101.stdout: "description": "osd_op(mds.0.3:3 3.14 3:287034c4:::1.00000000.inode:head [writefull 0~554] snapc 0=[] ondisk+write+known_if_redirected+full_force+supports_pool_eio e17)", 2023-08-01T19:54:38.200 INFO:teuthology.orchestra.run.smithi101.stdout: "initiated_at": "2023-08-01T19:54:04.459226+0000", 2023-08-01T19:54:38.200 INFO:teuthology.orchestra.run.smithi101.stdout: "age": 33.571078321000002, 2023-08-01T19:54:38.201 INFO:teuthology.orchestra.run.smithi101.stdout: "duration": 0.021104531999999999, 2023-08-01T19:54:38.201 INFO:teuthology.orchestra.run.smithi101.stdout: "type_data": { 2023-08-01T19:54:38.201 INFO:teuthology.orchestra.run.smithi101.stdout: "flag_point": "commit sent; apply or cleanup", 2023-08-01T19:54:38.201 INFO:teuthology.orchestra.run.smithi101.stdout: "events": [ 2023-08-01T19:54:38.201 INFO:teuthology.orchestra.run.smithi101.stdout: { 2023-08-01T19:54:38.201 INFO:teuthology.orchestra.run.smithi101.stdout: "event": "initiated", 2023-08-01T19:54:38.201 INFO:teuthology.orchestra.run.smithi101.stdout: "time": "2023-08-01T19:54:04.459226+0000", 2023-08-01T19:54:38.201 INFO:teuthology.orchestra.run.smithi101.stdout: "duration": 0 2023-08-01T19:54:38.202 INFO:teuthology.orchestra.run.smithi101.stdout: }, 2023-08-01T19:54:38.202 INFO:teuthology.orchestra.run.smithi101.stdout: { 2023-08-01T19:54:38.202 INFO:teuthology.orchestra.run.smithi101.stdout: "event": "throttled", 2023-08-01T19:54:38.202 INFO:teuthology.orchestra.run.smithi101.stdout: "time": "2023-08-01T19:54:04.459226+0000", 2023-08-01T19:54:38.202 INFO:teuthology.orchestra.run.smithi101.stdout: "duration": 0 2023-08-01T19:54:38.202 INFO:teuthology.orchestra.run.smithi101.stdout: }, 2023-08-01T19:54:38.202 INFO:teuthology.orchestra.run.smithi101.stdout: { 2023-08-01T19:54:38.202 INFO:teuthology.orchestra.run.smithi101.stdout: "event": "header_read", 2023-08-01T19:54:38.203 INFO:teuthology.orchestra.run.smithi101.stdout: "time": "2023-08-01T19:54:04.459225+0000", 2023-08-01T19:54:38.203 INFO:teuthology.orchestra.run.smithi101.stdout: "duration": 4294967295.9999995 2023-08-01T19:54:38.203 INFO:teuthology.orchestra.run.smithi101.stdout: }, 2023-08-01T19:54:38.203 INFO:teuthology.orchestra.run.smithi101.stdout: { 2023-08-01T19:54:38.203 INFO:teuthology.orchestra.run.smithi101.stdout: "event": "all_read", 2023-08-01T19:54:38.203 INFO:teuthology.orchestra.run.smithi101.stdout: "time": "2023-08-01T19:54:04.459238+0000", 2023-08-01T19:54:38.203 INFO:teuthology.orchestra.run.smithi101.stdout: "duration": 1.2809000000000001e-05 2023-08-01T19:54:38.203 INFO:teuthology.orchestra.run.smithi101.stdout: }, 2023-08-01T19:54:38.204 INFO:teuthology.orchestra.run.smithi101.stdout: { 2023-08-01T19:54:38.204 INFO:teuthology.orchestra.run.smithi101.stdout: "event": "dispatched", 2023-08-01T19:54:38.204 INFO:teuthology.orchestra.run.smithi101.stdout: "time": "2023-08-01T19:54:04.459245+0000", 2023-08-01T19:54:38.204 INFO:teuthology.orchestra.run.smithi101.stdout: "duration": 6.6540000000000002e-06 2023-08-01T19:54:38.204 INFO:teuthology.orchestra.run.smithi101.stdout: }, 2023-08-01T19:54:38.204 INFO:teuthology.orchestra.run.smithi101.stdout: { 2023-08-01T19:54:38.204 INFO:teuthology.orchestra.run.smithi101.stdout: "event": "queued_for_pg", 2023-08-01T19:54:38.204 INFO:teuthology.orchestra.run.smithi101.stdout: "time": "2023-08-01T19:54:04.459249+0000", 2023-08-01T19:54:38.205 INFO:teuthology.orchestra.run.smithi101.stdout: "duration": 4.6e-06 2023-08-01T19:54:38.205 INFO:teuthology.orchestra.run.smithi101.stdout: }, 2023-08-01T19:54:38.205 INFO:teuthology.orchestra.run.smithi101.stdout: { 2023-08-01T19:54:38.205 INFO:teuthology.orchestra.run.smithi101.stdout: "event": "reached_pg", 2023-08-01T19:54:38.205 INFO:teuthology.orchestra.run.smithi101.stdout: "time": "2023-08-01T19:54:04.459276+0000", 2023-08-01T19:54:38.205 INFO:teuthology.orchestra.run.smithi101.stdout: "duration": 2.6373999999999999e-05 2023-08-01T19:54:38.205 INFO:teuthology.orchestra.run.smithi101.stdout: }, 2023-08-01T19:54:38.206 INFO:teuthology.orchestra.run.smithi101.stdout: { 2023-08-01T19:54:38.206 INFO:teuthology.orchestra.run.smithi101.stdout: "event": "waiting_for_map not empty", 2023-08-01T19:54:38.206 INFO:teuthology.orchestra.run.smithi101.stdout: "time": "2023-08-01T19:54:04.459278+0000", 2023-08-01T19:54:38.206 INFO:teuthology.orchestra.run.smithi101.stdout: "duration": 2.4980000000000001e-06 2023-08-01T19:54:38.206 INFO:teuthology.orchestra.run.smithi101.stdout: }, 2023-08-01T19:54:38.206 INFO:teuthology.orchestra.run.smithi101.stdout: { 2023-08-01T19:54:38.206 INFO:teuthology.orchestra.run.smithi101.stdout: "event": "reached_pg", 2023-08-01T19:54:38.206 INFO:teuthology.orchestra.run.smithi101.stdout: "time": "2023-08-01T19:54:04.474058+0000", 2023-08-01T19:54:38.207 INFO:teuthology.orchestra.run.smithi101.stdout: "duration": 0.014779979 2023-08-01T19:54:38.207 INFO:teuthology.orchestra.run.smithi101.stdout: }, 2023-08-01T19:54:38.207 INFO:teuthology.orchestra.run.smithi101.stdout: { 2023-08-01T19:54:38.207 INFO:teuthology.orchestra.run.smithi101.stdout: "event": "started", 2023-08-01T19:54:38.207 INFO:teuthology.orchestra.run.smithi101.stdout: "time": "2023-08-01T19:54:04.474614+0000", 2023-08-01T19:54:38.207 INFO:teuthology.orchestra.run.smithi101.stdout: "duration": 0.00055546899999999995 2023-08-01T19:54:38.207 INFO:teuthology.orchestra.run.smithi101.stdout: }, 2023-08-01T19:54:38.207 INFO:teuthology.orchestra.run.smithi101.stdout: { 2023-08-01T19:54:38.208 INFO:teuthology.orchestra.run.smithi101.stdout: "event": "waiting for subops from 2", 2023-08-01T19:54:38.208 INFO:teuthology.orchestra.run.smithi101.stdout: "time": "2023-08-01T19:54:04.474720+0000", 2023-08-01T19:54:38.208 INFO:teuthology.orchestra.run.smithi101.stdout: "duration": 0.00010645300000000001 2023-08-01T19:54:38.208 INFO:teuthology.orchestra.run.smithi101.stdout: }, 2023-08-01T19:54:38.208 INFO:teuthology.orchestra.run.smithi101.stdout: { 2023-08-01T19:54:38.208 INFO:teuthology.orchestra.run.smithi101.stdout: "event": "op_commit", 2023-08-01T19:54:38.208 INFO:teuthology.orchestra.run.smithi101.stdout: "time": "2023-08-01T19:54:04.478480+0000", 2023-08-01T19:54:38.208 INFO:teuthology.orchestra.run.smithi101.stdout: "duration": 0.0037600279999999999 2023-08-01T19:54:38.209 INFO:teuthology.orchestra.run.smithi101.stdout: }, 2023-08-01T19:54:38.209 INFO:teuthology.orchestra.run.smithi101.stdout: { 2023-08-01T19:54:38.209 INFO:teuthology.orchestra.run.smithi101.stdout: "event": "sub_op_commit_rec", 2023-08-01T19:54:38.209 INFO:teuthology.orchestra.run.smithi101.stdout: "time": "2023-08-01T19:54:04.480273+0000", 2023-08-01T19:54:38.209 INFO:teuthology.orchestra.run.smithi101.stdout: "duration": 0.001792465 2023-08-01T19:54:38.209 INFO:teuthology.orchestra.run.smithi101.stdout: }, 2023-08-01T19:54:38.209 INFO:teuthology.orchestra.run.smithi101.stdout: { 2023-08-01T19:54:38.209 INFO:teuthology.orchestra.run.smithi101.stdout: "event": "commit_sent", 2023-08-01T19:54:38.210 INFO:teuthology.orchestra.run.smithi101.stdout: "time": "2023-08-01T19:54:04.480304+0000", 2023-08-01T19:54:38.210 INFO:teuthology.orchestra.run.smithi101.stdout: "duration": 3.1708999999999997e-05 2023-08-01T19:54:38.210 INFO:teuthology.orchestra.run.smithi101.stdout: }, 2023-08-01T19:54:38.210 INFO:teuthology.orchestra.run.smithi101.stdout: { 2023-08-01T19:54:38.210 INFO:teuthology.orchestra.run.smithi101.stdout: "event": "done", 2023-08-01T19:54:38.210 INFO:teuthology.orchestra.run.smithi101.stdout: "time": "2023-08-01T19:54:04.480330+0000", 2023-08-01T19:54:38.210 INFO:teuthology.orchestra.run.smithi101.stdout: "duration": 2.5860999999999999e-05 2023-08-01T19:54:38.210 INFO:teuthology.orchestra.run.smithi101.stdout: } 2023-08-01T19:54:38.211 INFO:teuthology.orchestra.run.smithi101.stdout: ] 2023-08-01T19:54:38.211 INFO:teuthology.orchestra.run.smithi101.stdout: } 2023-08-01T19:54:38.211 INFO:teuthology.orchestra.run.smithi101.stdout: }, 2023-08-01T19:54:38.211 INFO:teuthology.orchestra.run.smithi101.stdout: { 2023-08-01T19:54:38.211 INFO:teuthology.orchestra.run.smithi101.stdout: "description": "osd_op(mds.0.3:27 3.13 3:c91d4a1d:::mds0_inotable:head [writefull 0~34] snapc 0=[] ondisk+write+known_if_redirected+full_force+supports_pool_eio e17)", 2023-08-01T19:54:38.211 INFO:teuthology.orchestra.run.smithi101.stdout: "initiated_at": "2023-08-01T19:54:04.459260+0000", 2023-08-01T19:54:38.211 INFO:teuthology.orchestra.run.smithi101.stdout: "age": 33.571044430000001, 2023-08-01T19:54:38.211 INFO:teuthology.orchestra.run.smithi101.stdout: "duration": 0.016792715999999999, 2023-08-01T19:54:38.212 INFO:teuthology.orchestra.run.smithi101.stdout: "type_data": { 2023-08-01T19:54:38.212 INFO:teuthology.orchestra.run.smithi101.stdout: "flag_point": "commit sent; apply or cleanup", 2023-08-01T19:54:38.212 INFO:teuthology.orchestra.run.smithi101.stdout: "events": [ 2023-08-01T19:54:38.212 INFO:teuthology.orchestra.run.smithi101.stdout: { 2023-08-01T19:54:38.212 INFO:teuthology.orchestra.run.smithi101.stdout: "event": "initiated", 2023-08-01T19:54:38.212 INFO:teuthology.orchestra.run.smithi101.stdout: "time": "2023-08-01T19:54:04.459260+0000", 2023-08-01T19:54:38.212 INFO:teuthology.orchestra.run.smithi101.stdout: "duration": 0 2023-08-01T19:54:38.212 INFO:teuthology.orchestra.run.smithi101.stdout: }, 2023-08-01T19:54:38.213 INFO:teuthology.orchestra.run.smithi101.stdout: { 2023-08-01T19:54:38.213 INFO:teuthology.orchestra.run.smithi101.stdout: "event": "throttled", 2023-08-01T19:54:38.213 INFO:teuthology.orchestra.run.smithi101.stdout: "time": "2023-08-01T19:54:04.459260+0000", 2023-08-01T19:54:38.213 INFO:teuthology.orchestra.run.smithi101.stdout: "duration": 0 2023-08-01T19:54:38.213 INFO:teuthology.orchestra.run.smithi101.stdout: }, 2023-08-01T19:54:38.213 INFO:teuthology.orchestra.run.smithi101.stdout: { 2023-08-01T19:54:38.213 INFO:teuthology.orchestra.run.smithi101.stdout: "event": "header_read", 2023-08-01T19:54:38.213 INFO:teuthology.orchestra.run.smithi101.stdout: "time": "2023-08-01T19:54:04.459259+0000", 2023-08-01T19:54:38.214 INFO:teuthology.orchestra.run.smithi101.stdout: "duration": 4294967295.9999995 2023-08-01T19:54:38.214 INFO:teuthology.orchestra.run.smithi101.stdout: }, 2023-08-01T19:54:38.214 INFO:teuthology.orchestra.run.smithi101.stdout: { 2023-08-01T19:54:38.214 INFO:teuthology.orchestra.run.smithi101.stdout: "event": "all_read", 2023-08-01T19:54:38.214 INFO:teuthology.orchestra.run.smithi101.stdout: "time": "2023-08-01T19:54:04.459263+0000", 2023-08-01T19:54:38.214 INFO:teuthology.orchestra.run.smithi101.stdout: "duration": 3.9249999999999997e-06 2023-08-01T19:54:38.214 INFO:teuthology.orchestra.run.smithi101.stdout: }, 2023-08-01T19:54:38.214 INFO:teuthology.orchestra.run.smithi101.stdout: { 2023-08-01T19:54:38.215 INFO:teuthology.orchestra.run.smithi101.stdout: "event": "dispatched", 2023-08-01T19:54:38.215 INFO:teuthology.orchestra.run.smithi101.stdout: "time": "2023-08-01T19:54:04.459270+0000", 2023-08-01T19:54:38.215 INFO:teuthology.orchestra.run.smithi101.stdout: "duration": 7.0180000000000004e-06 2023-08-01T19:54:38.215 INFO:teuthology.orchestra.run.smithi101.stdout: }, 2023-08-01T19:54:38.215 INFO:teuthology.orchestra.run.smithi101.stdout: { 2023-08-01T19:54:38.215 INFO:teuthology.orchestra.run.smithi101.stdout: "event": "queued_for_pg", 2023-08-01T19:54:38.215 INFO:teuthology.orchestra.run.smithi101.stdout: "time": "2023-08-01T19:54:04.459275+0000", 2023-08-01T19:54:38.215 INFO:teuthology.orchestra.run.smithi101.stdout: "duration": 4.763e-06 2023-08-01T19:54:38.216 INFO:teuthology.orchestra.run.smithi101.stdout: }, 2023-08-01T19:54:38.216 INFO:teuthology.orchestra.run.smithi101.stdout: { 2023-08-01T19:54:38.216 INFO:teuthology.orchestra.run.smithi101.stdout: "event": "reached_pg", 2023-08-01T19:54:38.216 INFO:teuthology.orchestra.run.smithi101.stdout: "time": "2023-08-01T19:54:04.459298+0000", 2023-08-01T19:54:38.216 INFO:teuthology.orchestra.run.smithi101.stdout: "duration": 2.3193e-05 2023-08-01T19:54:38.216 INFO:teuthology.orchestra.run.smithi101.stdout: }, 2023-08-01T19:54:38.216 INFO:teuthology.orchestra.run.smithi101.stdout: { 2023-08-01T19:54:38.217 INFO:teuthology.orchestra.run.smithi101.stdout: "event": "waiting_for_map not empty", 2023-08-01T19:54:38.217 INFO:teuthology.orchestra.run.smithi101.stdout: "time": "2023-08-01T19:54:04.459301+0000", 2023-08-01T19:54:38.217 INFO:teuthology.orchestra.run.smithi101.stdout: "duration": 3.0539999999999999e-06 2023-08-01T19:54:38.217 INFO:teuthology.orchestra.run.smithi101.stdout: }, 2023-08-01T19:54:38.217 INFO:teuthology.orchestra.run.smithi101.stdout: { 2023-08-01T19:54:38.217 INFO:teuthology.orchestra.run.smithi101.stdout: "event": "reached_pg", 2023-08-01T19:54:38.217 INFO:teuthology.orchestra.run.smithi101.stdout: "time": "2023-08-01T19:54:04.469447+0000", 2023-08-01T19:54:38.217 INFO:teuthology.orchestra.run.smithi101.stdout: "duration": 0.010145573999999999 2023-08-01T19:54:38.218 INFO:teuthology.orchestra.run.smithi101.stdout: }, 2023-08-01T19:54:38.218 INFO:teuthology.orchestra.run.smithi101.stdout: { 2023-08-01T19:54:38.218 INFO:teuthology.orchestra.run.smithi101.stdout: "event": "started", 2023-08-01T19:54:38.218 INFO:teuthology.orchestra.run.smithi101.stdout: "time": "2023-08-01T19:54:04.469559+0000", 2023-08-01T19:54:38.218 INFO:teuthology.orchestra.run.smithi101.stdout: "duration": 0.000112068 2023-08-01T19:54:38.218 INFO:teuthology.orchestra.run.smithi101.stdout: }, 2023-08-01T19:54:38.218 INFO:teuthology.orchestra.run.smithi101.stdout: { 2023-08-01T19:54:38.218 INFO:teuthology.orchestra.run.smithi101.stdout: "event": "waiting for subops from 0", 2023-08-01T19:54:38.219 INFO:teuthology.orchestra.run.smithi101.stdout: "time": "2023-08-01T19:54:04.469895+0000", 2023-08-01T19:54:38.219 INFO:teuthology.orchestra.run.smithi101.stdout: "duration": 0.000336604 2023-08-01T19:54:38.219 INFO:teuthology.orchestra.run.smithi101.stdout: }, 2023-08-01T19:54:38.219 INFO:teuthology.orchestra.run.smithi101.stdout: { 2023-08-01T19:54:38.219 INFO:teuthology.orchestra.run.smithi101.stdout: "event": "sub_op_commit_rec", 2023-08-01T19:54:38.219 INFO:teuthology.orchestra.run.smithi101.stdout: "time": "2023-08-01T19:54:04.475096+0000", 2023-08-01T19:54:38.219 INFO:teuthology.orchestra.run.smithi101.stdout: "duration": 0.0052010540000000001 2023-08-01T19:54:38.219 INFO:teuthology.orchestra.run.smithi101.stdout: }, 2023-08-01T19:54:38.220 INFO:teuthology.orchestra.run.smithi101.stdout: { 2023-08-01T19:54:38.220 INFO:teuthology.orchestra.run.smithi101.stdout: "event": "op_commit", 2023-08-01T19:54:38.220 INFO:teuthology.orchestra.run.smithi101.stdout: "time": "2023-08-01T19:54:04.475965+0000", 2023-08-01T19:54:38.220 INFO:teuthology.orchestra.run.smithi101.stdout: "duration": 0.00086860500000000005 2023-08-01T19:54:38.220 INFO:teuthology.orchestra.run.smithi101.stdout: }, 2023-08-01T19:54:38.220 INFO:teuthology.orchestra.run.smithi101.stdout: { 2023-08-01T19:54:38.220 INFO:teuthology.orchestra.run.smithi101.stdout: "event": "commit_sent", 2023-08-01T19:54:38.220 INFO:teuthology.orchestra.run.smithi101.stdout: "time": "2023-08-01T19:54:04.476007+0000", 2023-08-01T19:54:38.221 INFO:teuthology.orchestra.run.smithi101.stdout: "duration": 4.2228000000000003e-05 2023-08-01T19:54:38.221 INFO:teuthology.orchestra.run.smithi101.stdout: }, 2023-08-01T19:54:38.221 INFO:teuthology.orchestra.run.smithi101.stdout: { 2023-08-01T19:54:38.221 INFO:teuthology.orchestra.run.smithi101.stdout: "event": "done", 2023-08-01T19:54:38.221 INFO:teuthology.orchestra.run.smithi101.stdout: "time": "2023-08-01T19:54:04.476052+0000", 2023-08-01T19:54:38.221 INFO:teuthology.orchestra.run.smithi101.stdout: "duration": 4.5188000000000002e-05 2023-08-01T19:54:38.221 INFO:teuthology.orchestra.run.smithi101.stdout: } 2023-08-01T19:54:38.221 INFO:teuthology.orchestra.run.smithi101.stdout: ] 2023-08-01T19:54:38.222 INFO:teuthology.orchestra.run.smithi101.stdout: } 2023-08-01T19:54:38.222 INFO:teuthology.orchestra.run.smithi101.stdout: }, 2023-08-01T19:54:38.222 INFO:teuthology.orchestra.run.smithi101.stdout: { 2023-08-01T19:54:38.222 INFO:teuthology.orchestra.run.smithi101.stdout: "description": "osd_op(mds.0.3:31 3.d 3:b50e409b:::mds_snaptable:head [writefull 0~70] snapc 0=[] ondisk+write+known_if_redirected+full_force+supports_pool_eio e17)", 2023-08-01T19:54:38.222 INFO:teuthology.orchestra.run.smithi101.stdout: "initiated_at": "2023-08-01T19:54:04.459283+0000", 2023-08-01T19:54:38.222 INFO:teuthology.orchestra.run.smithi101.stdout: "age": 33.571021493000003, 2023-08-01T19:54:38.222 INFO:teuthology.orchestra.run.smithi101.stdout: "duration": 0.01676277, 2023-08-01T19:54:38.222 INFO:teuthology.orchestra.run.smithi101.stdout: "type_data": { 2023-08-01T19:54:38.223 INFO:teuthology.orchestra.run.smithi101.stdout: "flag_point": "commit sent; apply or cleanup", 2023-08-01T19:54:38.223 INFO:teuthology.orchestra.run.smithi101.stdout: "events": [ 2023-08-01T19:54:38.223 INFO:teuthology.orchestra.run.smithi101.stdout: { 2023-08-01T19:54:38.223 INFO:teuthology.orchestra.run.smithi101.stdout: "event": "initiated", 2023-08-01T19:54:38.223 INFO:teuthology.orchestra.run.smithi101.stdout: "time": "2023-08-01T19:54:04.459283+0000", 2023-08-01T19:54:38.223 INFO:teuthology.orchestra.run.smithi101.stdout: "duration": 0 2023-08-01T19:54:38.223 INFO:teuthology.orchestra.run.smithi101.stdout: }, 2023-08-01T19:54:38.223 INFO:teuthology.orchestra.run.smithi101.stdout: { 2023-08-01T19:54:38.224 INFO:teuthology.orchestra.run.smithi101.stdout: "event": "throttled", 2023-08-01T19:54:38.224 INFO:teuthology.orchestra.run.smithi101.stdout: "time": "2023-08-01T19:54:04.459283+0000", 2023-08-01T19:54:38.224 INFO:teuthology.orchestra.run.smithi101.stdout: "duration": 0 2023-08-01T19:54:38.224 INFO:teuthology.orchestra.run.smithi101.stdout: }, 2023-08-01T19:54:38.224 INFO:teuthology.orchestra.run.smithi101.stdout: { 2023-08-01T19:54:38.224 INFO:teuthology.orchestra.run.smithi101.stdout: "event": "header_read", 2023-08-01T19:54:38.224 INFO:teuthology.orchestra.run.smithi101.stdout: "time": "2023-08-01T19:54:04.459282+0000", 2023-08-01T19:54:38.224 INFO:teuthology.orchestra.run.smithi101.stdout: "duration": 4294967295.9999995 2023-08-01T19:54:38.225 INFO:teuthology.orchestra.run.smithi101.stdout: }, 2023-08-01T19:54:38.225 INFO:teuthology.orchestra.run.smithi101.stdout: { 2023-08-01T19:54:38.225 INFO:teuthology.orchestra.run.smithi101.stdout: "event": "all_read", 2023-08-01T19:54:38.225 INFO:teuthology.orchestra.run.smithi101.stdout: "time": "2023-08-01T19:54:04.459285+0000", 2023-08-01T19:54:38.225 INFO:teuthology.orchestra.run.smithi101.stdout: "duration": 3.2590000000000001e-06 2023-08-01T19:54:38.225 INFO:teuthology.orchestra.run.smithi101.stdout: }, 2023-08-01T19:54:38.225 INFO:teuthology.orchestra.run.smithi101.stdout: { 2023-08-01T19:54:38.226 INFO:teuthology.orchestra.run.smithi101.stdout: "event": "dispatched", 2023-08-01T19:54:38.226 INFO:teuthology.orchestra.run.smithi101.stdout: "time": "2023-08-01T19:54:04.459291+0000", 2023-08-01T19:54:38.226 INFO:teuthology.orchestra.run.smithi101.stdout: "duration": 6.0750000000000003e-06 2023-08-01T19:54:38.226 INFO:teuthology.orchestra.run.smithi101.stdout: }, 2023-08-01T19:54:38.226 INFO:teuthology.orchestra.run.smithi101.stdout: { 2023-08-01T19:54:38.226 INFO:teuthology.orchestra.run.smithi101.stdout: "event": "queued_for_pg", 2023-08-01T19:54:38.226 INFO:teuthology.orchestra.run.smithi101.stdout: "time": "2023-08-01T19:54:04.459295+0000", 2023-08-01T19:54:38.226 INFO:teuthology.orchestra.run.smithi101.stdout: "duration": 3.7500000000000001e-06 2023-08-01T19:54:38.227 INFO:teuthology.orchestra.run.smithi101.stdout: }, 2023-08-01T19:54:38.227 INFO:teuthology.orchestra.run.smithi101.stdout: { 2023-08-01T19:54:38.227 INFO:teuthology.orchestra.run.smithi101.stdout: "event": "reached_pg", 2023-08-01T19:54:38.227 INFO:teuthology.orchestra.run.smithi101.stdout: "time": "2023-08-01T19:54:04.459323+0000", 2023-08-01T19:54:38.227 INFO:teuthology.orchestra.run.smithi101.stdout: "duration": 2.7351e-05 2023-08-01T19:54:38.227 INFO:teuthology.orchestra.run.smithi101.stdout: }, 2023-08-01T19:54:38.227 INFO:teuthology.orchestra.run.smithi101.stdout: { 2023-08-01T19:54:38.227 INFO:teuthology.orchestra.run.smithi101.stdout: "event": "op must wait for map", 2023-08-01T19:54:38.228 INFO:teuthology.orchestra.run.smithi101.stdout: "time": "2023-08-01T19:54:04.459327+0000", 2023-08-01T19:54:38.228 INFO:teuthology.orchestra.run.smithi101.stdout: "duration": 4.1849999999999997e-06 2023-08-01T19:54:38.228 INFO:teuthology.orchestra.run.smithi101.stdout: }, 2023-08-01T19:54:38.228 INFO:teuthology.orchestra.run.smithi101.stdout: { 2023-08-01T19:54:38.228 INFO:teuthology.orchestra.run.smithi101.stdout: "event": "reached_pg", 2023-08-01T19:54:38.228 INFO:teuthology.orchestra.run.smithi101.stdout: "time": "2023-08-01T19:54:04.468708+0000", 2023-08-01T19:54:38.228 INFO:teuthology.orchestra.run.smithi101.stdout: "duration": 0.0093817420000000002 2023-08-01T19:54:38.228 INFO:teuthology.orchestra.run.smithi101.stdout: }, 2023-08-01T19:54:38.229 INFO:teuthology.orchestra.run.smithi101.stdout: { 2023-08-01T19:54:38.229 INFO:teuthology.orchestra.run.smithi101.stdout: "event": "started", 2023-08-01T19:54:38.229 INFO:teuthology.orchestra.run.smithi101.stdout: "time": "2023-08-01T19:54:04.468830+0000", 2023-08-01T19:54:38.229 INFO:teuthology.orchestra.run.smithi101.stdout: "duration": 0.000121339 2023-08-01T19:54:38.229 INFO:teuthology.orchestra.run.smithi101.stdout: }, 2023-08-01T19:54:38.229 INFO:teuthology.orchestra.run.smithi101.stdout: { 2023-08-01T19:54:38.229 INFO:teuthology.orchestra.run.smithi101.stdout: "event": "waiting for subops from 2", 2023-08-01T19:54:38.229 INFO:teuthology.orchestra.run.smithi101.stdout: "time": "2023-08-01T19:54:04.469611+0000", 2023-08-01T19:54:38.230 INFO:teuthology.orchestra.run.smithi101.stdout: "duration": 0.00078162900000000005 2023-08-01T19:54:38.230 INFO:teuthology.orchestra.run.smithi101.stdout: }, 2023-08-01T19:54:38.230 INFO:teuthology.orchestra.run.smithi101.stdout: { 2023-08-01T19:54:38.230 INFO:teuthology.orchestra.run.smithi101.stdout: "event": "sub_op_commit_rec", 2023-08-01T19:54:38.230 INFO:teuthology.orchestra.run.smithi101.stdout: "time": "2023-08-01T19:54:04.475478+0000", 2023-08-01T19:54:38.230 INFO:teuthology.orchestra.run.smithi101.stdout: "duration": 0.005866586 2023-08-01T19:54:38.230 INFO:teuthology.orchestra.run.smithi101.stdout: }, 2023-08-01T19:54:38.230 INFO:teuthology.orchestra.run.smithi101.stdout: { 2023-08-01T19:54:38.231 INFO:teuthology.orchestra.run.smithi101.stdout: "event": "op_commit", 2023-08-01T19:54:38.231 INFO:teuthology.orchestra.run.smithi101.stdout: "time": "2023-08-01T19:54:04.475941+0000", 2023-08-01T19:54:38.231 INFO:teuthology.orchestra.run.smithi101.stdout: "duration": 0.000462526 2023-08-01T19:54:38.231 INFO:teuthology.orchestra.run.smithi101.stdout: }, 2023-08-01T19:54:38.231 INFO:teuthology.orchestra.run.smithi101.stdout: { 2023-08-01T19:54:38.231 INFO:teuthology.orchestra.run.smithi101.stdout: "event": "commit_sent", 2023-08-01T19:54:38.231 INFO:teuthology.orchestra.run.smithi101.stdout: "time": "2023-08-01T19:54:04.475995+0000", 2023-08-01T19:54:38.231 INFO:teuthology.orchestra.run.smithi101.stdout: "duration": 5.4401000000000003e-05 2023-08-01T19:54:38.232 INFO:teuthology.orchestra.run.smithi101.stdout: }, 2023-08-01T19:54:38.232 INFO:teuthology.orchestra.run.smithi101.stdout: { 2023-08-01T19:54:38.232 INFO:teuthology.orchestra.run.smithi101.stdout: "event": "done", 2023-08-01T19:54:38.232 INFO:teuthology.orchestra.run.smithi101.stdout: "time": "2023-08-01T19:54:04.476045+0000", 2023-08-01T19:54:38.232 INFO:teuthology.orchestra.run.smithi101.stdout: "duration": 5.0389000000000002e-05 2023-08-01T19:54:38.232 INFO:teuthology.orchestra.run.smithi101.stdout: } 2023-08-01T19:54:38.232 INFO:teuthology.orchestra.run.smithi101.stdout: ] 2023-08-01T19:54:38.232 INFO:teuthology.orchestra.run.smithi101.stdout: } 2023-08-01T19:54:38.233 INFO:teuthology.orchestra.run.smithi101.stdout: }, 2023-08-01T19:54:38.233 INFO:teuthology.orchestra.run.smithi101.stdout: { 2023-08-01T19:54:38.233 INFO:teuthology.orchestra.run.smithi101.stdout: "description": "osd_op(mds.0.3:32 3.14 3:2e2fa760:::200.00000001:head [delete] snapc 0=[] ondisk+write+known_if_redirected+full_force+supports_pool_eio e17)", 2023-08-01T19:54:38.233 INFO:teuthology.orchestra.run.smithi101.stdout: "initiated_at": "2023-08-01T19:54:04.459304+0000", 2023-08-01T19:54:38.233 INFO:teuthology.orchestra.run.smithi101.stdout: "age": 33.570999659999998, 2023-08-01T19:54:38.233 INFO:teuthology.orchestra.run.smithi101.stdout: "duration": 0.021110606000000001, 2023-08-01T19:54:38.233 INFO:teuthology.orchestra.run.smithi101.stdout: "type_data": { 2023-08-01T19:54:38.234 INFO:teuthology.orchestra.run.smithi101.stdout: "flag_point": "started", 2023-08-01T19:54:38.234 INFO:teuthology.orchestra.run.smithi101.stdout: "events": [ 2023-08-01T19:54:38.234 INFO:teuthology.orchestra.run.smithi101.stdout: { 2023-08-01T19:54:38.234 INFO:teuthology.orchestra.run.smithi101.stdout: "event": "initiated", 2023-08-01T19:54:38.234 INFO:teuthology.orchestra.run.smithi101.stdout: "time": "2023-08-01T19:54:04.459304+0000", 2023-08-01T19:54:38.234 INFO:teuthology.orchestra.run.smithi101.stdout: "duration": 0 2023-08-01T19:54:38.234 INFO:teuthology.orchestra.run.smithi101.stdout: }, 2023-08-01T19:54:38.234 INFO:teuthology.orchestra.run.smithi101.stdout: { 2023-08-01T19:54:38.235 INFO:teuthology.orchestra.run.smithi101.stdout: "event": "throttled", 2023-08-01T19:54:38.235 INFO:teuthology.orchestra.run.smithi101.stdout: "time": "2023-08-01T19:54:04.459304+0000", 2023-08-01T19:54:38.235 INFO:teuthology.orchestra.run.smithi101.stdout: "duration": 0 2023-08-01T19:54:38.235 INFO:teuthology.orchestra.run.smithi101.stdout: }, 2023-08-01T19:54:38.235 INFO:teuthology.orchestra.run.smithi101.stdout: { 2023-08-01T19:54:38.235 INFO:teuthology.orchestra.run.smithi101.stdout: "event": "header_read", 2023-08-01T19:54:38.235 INFO:teuthology.orchestra.run.smithi101.stdout: "time": "2023-08-01T19:54:04.459304+0000", 2023-08-01T19:54:38.235 INFO:teuthology.orchestra.run.smithi101.stdout: "duration": 4294967295.9999995 2023-08-01T19:54:38.236 INFO:teuthology.orchestra.run.smithi101.stdout: }, 2023-08-01T19:54:38.236 INFO:teuthology.orchestra.run.smithi101.stdout: { 2023-08-01T19:54:38.236 INFO:teuthology.orchestra.run.smithi101.stdout: "event": "all_read", 2023-08-01T19:54:38.236 INFO:teuthology.orchestra.run.smithi101.stdout: "time": "2023-08-01T19:54:04.459306+0000", 2023-08-01T19:54:38.236 INFO:teuthology.orchestra.run.smithi101.stdout: "duration": 2.3889999999999999e-06 2023-08-01T19:54:38.236 INFO:teuthology.orchestra.run.smithi101.stdout: }, 2023-08-01T19:54:38.236 INFO:teuthology.orchestra.run.smithi101.stdout: { 2023-08-01T19:54:38.236 INFO:teuthology.orchestra.run.smithi101.stdout: "event": "dispatched", 2023-08-01T19:54:38.237 INFO:teuthology.orchestra.run.smithi101.stdout: "time": "2023-08-01T19:54:04.459314+0000", 2023-08-01T19:54:38.237 INFO:teuthology.orchestra.run.smithi101.stdout: "duration": 7.1180000000000003e-06 2023-08-01T19:54:38.237 INFO:teuthology.orchestra.run.smithi101.stdout: }, 2023-08-01T19:54:38.237 INFO:teuthology.orchestra.run.smithi101.stdout: { 2023-08-01T19:54:38.237 INFO:teuthology.orchestra.run.smithi101.stdout: "event": "queued_for_pg", 2023-08-01T19:54:38.237 INFO:teuthology.orchestra.run.smithi101.stdout: "time": "2023-08-01T19:54:04.459318+0000", 2023-08-01T19:54:38.237 INFO:teuthology.orchestra.run.smithi101.stdout: "duration": 4.0239999999999999e-06 2023-08-01T19:54:38.237 INFO:teuthology.orchestra.run.smithi101.stdout: }, 2023-08-01T19:54:38.238 INFO:teuthology.orchestra.run.smithi101.stdout: { 2023-08-01T19:54:38.238 INFO:teuthology.orchestra.run.smithi101.stdout: "event": "reached_pg", 2023-08-01T19:54:38.238 INFO:teuthology.orchestra.run.smithi101.stdout: "time": "2023-08-01T19:54:04.459340+0000", 2023-08-01T19:54:38.238 INFO:teuthology.orchestra.run.smithi101.stdout: "duration": 2.2476e-05 2023-08-01T19:54:38.238 INFO:teuthology.orchestra.run.smithi101.stdout: }, 2023-08-01T19:54:38.238 INFO:teuthology.orchestra.run.smithi101.stdout: { 2023-08-01T19:54:38.238 INFO:teuthology.orchestra.run.smithi101.stdout: "event": "waiting_for_map not empty", 2023-08-01T19:54:38.239 INFO:teuthology.orchestra.run.smithi101.stdout: "time": "2023-08-01T19:54:04.459342+0000", 2023-08-01T19:54:38.239 INFO:teuthology.orchestra.run.smithi101.stdout: "duration": 2.272e-06 2023-08-01T19:54:38.239 INFO:teuthology.orchestra.run.smithi101.stdout: }, 2023-08-01T19:54:38.239 INFO:teuthology.orchestra.run.smithi101.stdout: { 2023-08-01T19:54:38.239 INFO:teuthology.orchestra.run.smithi101.stdout: "event": "reached_pg", 2023-08-01T19:54:38.239 INFO:teuthology.orchestra.run.smithi101.stdout: "time": "2023-08-01T19:54:04.475922+0000", 2023-08-01T19:54:38.239 INFO:teuthology.orchestra.run.smithi101.stdout: "duration": 0.016579388 2023-08-01T19:54:38.239 INFO:teuthology.orchestra.run.smithi101.stdout: }, 2023-08-01T19:54:38.240 INFO:teuthology.orchestra.run.smithi101.stdout: { 2023-08-01T19:54:38.240 INFO:teuthology.orchestra.run.smithi101.stdout: "event": "started", 2023-08-01T19:54:38.240 INFO:teuthology.orchestra.run.smithi101.stdout: "time": "2023-08-01T19:54:04.476107+0000", 2023-08-01T19:54:38.240 INFO:teuthology.orchestra.run.smithi101.stdout: "duration": 0.00018486300000000001 2023-08-01T19:54:38.240 INFO:teuthology.orchestra.run.smithi101.stdout: }, 2023-08-01T19:54:38.240 INFO:teuthology.orchestra.run.smithi101.stdout: { 2023-08-01T19:54:38.240 INFO:teuthology.orchestra.run.smithi101.stdout: "event": "done", 2023-08-01T19:54:38.240 INFO:teuthology.orchestra.run.smithi101.stdout: "time": "2023-08-01T19:54:04.480415+0000", 2023-08-01T19:54:38.241 INFO:teuthology.orchestra.run.smithi101.stdout: "duration": 0.0043084589999999997 2023-08-01T19:54:38.241 INFO:teuthology.orchestra.run.smithi101.stdout: } 2023-08-01T19:54:38.241 INFO:teuthology.orchestra.run.smithi101.stdout: ] 2023-08-01T19:54:38.241 INFO:teuthology.orchestra.run.smithi101.stdout: } 2023-08-01T19:54:38.241 INFO:teuthology.orchestra.run.smithi101.stdout: }, 2023-08-01T19:54:38.241 INFO:teuthology.orchestra.run.smithi101.stdout: { 2023-08-01T19:54:38.241 INFO:teuthology.orchestra.run.smithi101.stdout: "description": "osd_op(client.4668.0:33938 5.f 5:f86a7015:::benchmark_data_smithi006_114134_object33937:head [set-alloc-hint object_size 65536 write_size 65536,write 0~65536] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e24)", 2023-08-01T19:54:38.241 INFO:teuthology.orchestra.run.smithi101.stdout: "initiated_at": "2023-08-01T19:54:34.001821+0000", 2023-08-01T19:54:38.242 INFO:teuthology.orchestra.run.smithi101.stdout: "age": 4.028483424, 2023-08-01T19:54:38.242 INFO:teuthology.orchestra.run.smithi101.stdout: "duration": 0.015845003, 2023-08-01T19:54:38.242 INFO:teuthology.orchestra.run.smithi101.stdout: "type_data": { 2023-08-01T19:54:38.242 INFO:teuthology.orchestra.run.smithi101.stdout: "flag_point": "commit sent; apply or cleanup", 2023-08-01T19:54:38.242 INFO:teuthology.orchestra.run.smithi101.stdout: "client_info": { 2023-08-01T19:54:38.242 INFO:teuthology.orchestra.run.smithi101.stdout: "client": "client.4668", 2023-08-01T19:54:38.242 INFO:teuthology.orchestra.run.smithi101.stdout: "client_addr": "172.21.15.6:0/1709472247", 2023-08-01T19:54:38.242 INFO:teuthology.orchestra.run.smithi101.stdout: "tid": 33938 2023-08-01T19:54:38.243 INFO:teuthology.orchestra.run.smithi101.stdout: }, 2023-08-01T19:54:38.243 INFO:teuthology.orchestra.run.smithi101.stdout: "events": [ 2023-08-01T19:54:38.243 INFO:teuthology.orchestra.run.smithi101.stdout: { 2023-08-01T19:54:38.243 INFO:teuthology.orchestra.run.smithi101.stdout: "event": "initiated", 2023-08-01T19:54:38.243 INFO:teuthology.orchestra.run.smithi101.stdout: "time": "2023-08-01T19:54:34.001821+0000", 2023-08-01T19:54:38.243 INFO:teuthology.orchestra.run.smithi101.stdout: "duration": 0 2023-08-01T19:54:38.243 INFO:teuthology.orchestra.run.smithi101.stdout: }, 2023-08-01T19:54:38.243 INFO:teuthology.orchestra.run.smithi101.stdout: { 2023-08-01T19:54:38.244 INFO:teuthology.orchestra.run.smithi101.stdout: "event": "throttled", 2023-08-01T19:54:38.244 INFO:teuthology.orchestra.run.smithi101.stdout: "time": "2023-08-01T19:54:34.001821+0000", 2023-08-01T19:54:38.244 INFO:teuthology.orchestra.run.smithi101.stdout: "duration": 0 2023-08-01T19:54:38.244 INFO:teuthology.orchestra.run.smithi101.stdout: }, 2023-08-01T19:54:38.244 INFO:teuthology.orchestra.run.smithi101.stdout: { 2023-08-01T19:54:38.244 INFO:teuthology.orchestra.run.smithi101.stdout: "event": "header_read", 2023-08-01T19:54:38.244 INFO:teuthology.orchestra.run.smithi101.stdout: "time": "2023-08-01T19:54:34.001820+0000", 2023-08-01T19:54:38.244 INFO:teuthology.orchestra.run.smithi101.stdout: "duration": 4294967295.9999995 2023-08-01T19:54:38.245 INFO:teuthology.orchestra.run.smithi101.stdout: }, 2023-08-01T19:54:38.245 INFO:teuthology.orchestra.run.smithi101.stdout: { 2023-08-01T19:54:38.245 INFO:teuthology.orchestra.run.smithi101.stdout: "event": "all_read", 2023-08-01T19:54:38.245 INFO:teuthology.orchestra.run.smithi101.stdout: "time": "2023-08-01T19:54:34.001901+0000", 2023-08-01T19:54:38.245 INFO:teuthology.orchestra.run.smithi101.stdout: "duration": 8.0606999999999996e-05 2023-08-01T19:54:38.245 INFO:teuthology.orchestra.run.smithi101.stdout: }, 2023-08-01T19:54:38.245 INFO:teuthology.orchestra.run.smithi101.stdout: { 2023-08-01T19:54:38.245 INFO:teuthology.orchestra.run.smithi101.stdout: "event": "dispatched", 2023-08-01T19:54:38.246 INFO:teuthology.orchestra.run.smithi101.stdout: "time": "2023-08-01T19:54:34.001913+0000", 2023-08-01T19:54:38.246 INFO:teuthology.orchestra.run.smithi101.stdout: "duration": 1.2627e-05 2023-08-01T19:54:38.246 INFO:teuthology.orchestra.run.smithi101.stdout: }, 2023-08-01T19:54:38.246 INFO:teuthology.orchestra.run.smithi101.stdout: { 2023-08-01T19:54:38.246 INFO:teuthology.orchestra.run.smithi101.stdout: "event": "queued_for_pg", 2023-08-01T19:54:38.246 INFO:teuthology.orchestra.run.smithi101.stdout: "time": "2023-08-01T19:54:34.001917+0000", 2023-08-01T19:54:38.246 INFO:teuthology.orchestra.run.smithi101.stdout: "duration": 3.6940000000000001e-06 2023-08-01T19:54:38.246 INFO:teuthology.orchestra.run.smithi101.stdout: }, 2023-08-01T19:54:38.247 INFO:teuthology.orchestra.run.smithi101.stdout: { 2023-08-01T19:54:38.247 INFO:teuthology.orchestra.run.smithi101.stdout: "event": "reached_pg", 2023-08-01T19:54:38.247 INFO:teuthology.orchestra.run.smithi101.stdout: "time": "2023-08-01T19:54:34.001939+0000", 2023-08-01T19:54:38.247 INFO:teuthology.orchestra.run.smithi101.stdout: "duration": 2.243e-05 2023-08-01T19:54:38.247 INFO:teuthology.orchestra.run.smithi101.stdout: }, 2023-08-01T19:54:38.247 INFO:teuthology.orchestra.run.smithi101.stdout: { 2023-08-01T19:54:38.247 INFO:teuthology.orchestra.run.smithi101.stdout: "event": "started", 2023-08-01T19:54:38.248 INFO:teuthology.orchestra.run.smithi101.stdout: "time": "2023-08-01T19:54:34.002032+0000", 2023-08-01T19:54:38.248 INFO:teuthology.orchestra.run.smithi101.stdout: "duration": 9.2053999999999997e-05 2023-08-01T19:54:38.248 INFO:teuthology.orchestra.run.smithi101.stdout: }, 2023-08-01T19:54:38.248 INFO:teuthology.orchestra.run.smithi101.stdout: { 2023-08-01T19:54:38.248 INFO:teuthology.orchestra.run.smithi101.stdout: "event": "waiting for subops from 2", 2023-08-01T19:54:38.248 INFO:teuthology.orchestra.run.smithi101.stdout: "time": "2023-08-01T19:54:34.002107+0000", 2023-08-01T19:54:38.248 INFO:teuthology.orchestra.run.smithi101.stdout: "duration": 7.5160999999999994e-05 2023-08-01T19:54:38.248 INFO:teuthology.orchestra.run.smithi101.stdout: }, 2023-08-01T19:54:38.249 INFO:teuthology.orchestra.run.smithi101.stdout: { 2023-08-01T19:54:38.249 INFO:teuthology.orchestra.run.smithi101.stdout: "event": "op_commit", 2023-08-01T19:54:38.249 INFO:teuthology.orchestra.run.smithi101.stdout: "time": "2023-08-01T19:54:34.008660+0000", 2023-08-01T19:54:38.249 INFO:teuthology.orchestra.run.smithi101.stdout: "duration": 0.0065528950000000004 2023-08-01T19:54:38.249 INFO:teuthology.orchestra.run.smithi101.stdout: }, 2023-08-01T19:54:38.249 INFO:teuthology.orchestra.run.smithi101.stdout: { 2023-08-01T19:54:38.249 INFO:teuthology.orchestra.run.smithi101.stdout: "event": "sub_op_commit_rec", 2023-08-01T19:54:38.249 INFO:teuthology.orchestra.run.smithi101.stdout: "time": "2023-08-01T19:54:34.017612+0000", 2023-08-01T19:54:38.250 INFO:teuthology.orchestra.run.smithi101.stdout: "duration": 0.0089521489999999995 2023-08-01T19:54:38.250 INFO:teuthology.orchestra.run.smithi101.stdout: }, 2023-08-01T19:54:38.250 INFO:teuthology.orchestra.run.smithi101.stdout: { 2023-08-01T19:54:38.250 INFO:teuthology.orchestra.run.smithi101.stdout: "event": "commit_sent", 2023-08-01T19:54:38.250 INFO:teuthology.orchestra.run.smithi101.stdout: "time": "2023-08-01T19:54:34.017643+0000", 2023-08-01T19:54:38.250 INFO:teuthology.orchestra.run.smithi101.stdout: "duration": 3.0988000000000002e-05 2023-08-01T19:54:38.250 INFO:teuthology.orchestra.run.smithi101.stdout: }, 2023-08-01T19:54:38.250 INFO:teuthology.orchestra.run.smithi101.stdout: { 2023-08-01T19:54:38.251 INFO:teuthology.orchestra.run.smithi101.stdout: "event": "done", 2023-08-01T19:54:38.251 INFO:teuthology.orchestra.run.smithi101.stdout: "time": "2023-08-01T19:54:34.017666+0000", 2023-08-01T19:54:38.251 INFO:teuthology.orchestra.run.smithi101.stdout: "duration": 2.2898999999999999e-05 2023-08-01T19:54:38.251 INFO:teuthology.orchestra.run.smithi101.stdout: } 2023-08-01T19:54:38.251 INFO:teuthology.orchestra.run.smithi101.stdout: ] 2023-08-01T19:54:38.251 INFO:teuthology.orchestra.run.smithi101.stdout: } 2023-08-01T19:54:38.251 INFO:teuthology.orchestra.run.smithi101.stdout: } 2023-08-01T19:54:38.251 INFO:teuthology.orchestra.run.smithi101.stdout: ] 2023-08-01T19:54:38.252 INFO:teuthology.orchestra.run.smithi101.stdout:} 2023-08-01T19:54:38.253 DEBUG:teuthology.orchestra.run.smithi155:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 30 ceph --cluster ceph --admin-daemon /var/run/ceph/ceph-osd.2.asok dump_ops_in_flight 2023-08-01T19:54:38.253 INFO:tasks.ceph.osd.1.smithi101.stderr:2023-08-01T19:54:38.251+0000 7fb0cb7f6700 -1 received signal: Hangup from /usr/bin/python3 /bin/daemon-helper kill ceph-osd -f --cluster ceph -i 1 (PID: 111141) UID: 0 2023-08-01T19:54:38.313 INFO:tasks.radosbench.radosbench.0.smithi006.stdout: 14 16 45290 45274 202.101 159.25 0.00568344 0.00494476 2023-08-01T19:54:38.353 INFO:tasks.ceph.osd.1.smithi101.stderr:2023-08-01T19:54:38.352+0000 7fb0cb7f6700 -1 received signal: Hangup from /usr/bin/python3 /bin/daemon-helper kill ceph-osd -f --cluster ceph -i 1 (PID: 111141) UID: 0 2023-08-01T19:54:38.424 INFO:teuthology.orchestra.run.smithi155.stdout:{ 2023-08-01T19:54:38.424 INFO:teuthology.orchestra.run.smithi155.stdout: "ops": [ 2023-08-01T19:54:38.424 INFO:teuthology.orchestra.run.smithi155.stdout: { 2023-08-01T19:54:38.424 INFO:teuthology.orchestra.run.smithi155.stdout: "description": "osd_op(client.4668.0:45559 5.8 5:1e920d3d:::benchmark_data_smithi006_114134_object45558:head [set-alloc-hint object_size 65536 write_size 65536,write 0~65536 in=65536b] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e26)", 2023-08-01T19:54:38.425 INFO:teuthology.orchestra.run.smithi155.stdout: "initiated_at": "2023-08-01T19:54:38.417450+0000", 2023-08-01T19:54:38.425 INFO:teuthology.orchestra.run.smithi155.stdout: "age": 0.0054197739999999996, 2023-08-01T19:54:38.425 INFO:teuthology.orchestra.run.smithi155.stdout: "duration": 0.005440856, 2023-08-01T19:54:38.425 INFO:teuthology.orchestra.run.smithi155.stdout: "type_data": { 2023-08-01T19:54:38.425 INFO:teuthology.orchestra.run.smithi155.stdout: "flag_point": "waiting for sub ops", 2023-08-01T19:54:38.425 INFO:teuthology.orchestra.run.smithi155.stdout: "client_info": { 2023-08-01T19:54:38.425 INFO:teuthology.orchestra.run.smithi155.stdout: "client": "client.4668", 2023-08-01T19:54:38.425 INFO:teuthology.orchestra.run.smithi155.stdout: "client_addr": "172.21.15.6:0/1709472247", 2023-08-01T19:54:38.426 INFO:teuthology.orchestra.run.smithi155.stdout: "tid": 45559 2023-08-01T19:54:38.426 INFO:teuthology.orchestra.run.smithi155.stdout: }, 2023-08-01T19:54:38.426 INFO:teuthology.orchestra.run.smithi155.stdout: "events": [ 2023-08-01T19:54:38.426 INFO:teuthology.orchestra.run.smithi155.stdout: { 2023-08-01T19:54:38.426 INFO:teuthology.orchestra.run.smithi155.stdout: "event": "initiated", 2023-08-01T19:54:38.426 INFO:teuthology.orchestra.run.smithi155.stdout: "time": "2023-08-01T19:54:38.417450+0000", 2023-08-01T19:54:38.426 INFO:teuthology.orchestra.run.smithi155.stdout: "duration": 0 2023-08-01T19:54:38.426 INFO:teuthology.orchestra.run.smithi155.stdout: }, 2023-08-01T19:54:38.427 INFO:teuthology.orchestra.run.smithi155.stdout: { 2023-08-01T19:54:38.427 INFO:teuthology.orchestra.run.smithi155.stdout: "event": "throttled", 2023-08-01T19:54:38.427 INFO:teuthology.orchestra.run.smithi155.stdout: "time": "2023-08-01T19:54:38.417450+0000", 2023-08-01T19:54:38.427 INFO:teuthology.orchestra.run.smithi155.stdout: "duration": 0 2023-08-01T19:54:38.427 INFO:teuthology.orchestra.run.smithi155.stdout: }, 2023-08-01T19:54:38.427 INFO:teuthology.orchestra.run.smithi155.stdout: { 2023-08-01T19:54:38.427 INFO:teuthology.orchestra.run.smithi155.stdout: "event": "header_read", 2023-08-01T19:54:38.428 INFO:teuthology.orchestra.run.smithi155.stdout: "time": "2023-08-01T19:54:38.417449+0000", 2023-08-01T19:54:38.428 INFO:teuthology.orchestra.run.smithi155.stdout: "duration": 4294967295.999999 2023-08-01T19:54:38.428 INFO:teuthology.orchestra.run.smithi155.stdout: }, 2023-08-01T19:54:38.428 INFO:teuthology.orchestra.run.smithi155.stdout: { 2023-08-01T19:54:38.428 INFO:teuthology.orchestra.run.smithi155.stdout: "event": "all_read", 2023-08-01T19:54:38.428 INFO:teuthology.orchestra.run.smithi155.stdout: "time": "2023-08-01T19:54:38.417524+0000", 2023-08-01T19:54:38.428 INFO:teuthology.orchestra.run.smithi155.stdout: "duration": 7.4548999999999994e-05 2023-08-01T19:54:38.428 INFO:teuthology.orchestra.run.smithi155.stdout: }, 2023-08-01T19:54:38.429 INFO:teuthology.orchestra.run.smithi155.stdout: { 2023-08-01T19:54:38.429 INFO:teuthology.orchestra.run.smithi155.stdout: "event": "dispatched", 2023-08-01T19:54:38.429 INFO:teuthology.orchestra.run.smithi155.stdout: "time": "2023-08-01T19:54:38.417532+0000", 2023-08-01T19:54:38.429 INFO:teuthology.orchestra.run.smithi155.stdout: "duration": 8.7299999999999994e-06 2023-08-01T19:54:38.429 INFO:teuthology.orchestra.run.smithi155.stdout: }, 2023-08-01T19:54:38.429 INFO:teuthology.orchestra.run.smithi155.stdout: { 2023-08-01T19:54:38.429 INFO:teuthology.orchestra.run.smithi155.stdout: "event": "queued_for_pg", 2023-08-01T19:54:38.429 INFO:teuthology.orchestra.run.smithi155.stdout: "time": "2023-08-01T19:54:38.417537+0000", 2023-08-01T19:54:38.430 INFO:teuthology.orchestra.run.smithi155.stdout: "duration": 4.1500000000000001e-06 2023-08-01T19:54:38.430 INFO:teuthology.orchestra.run.smithi155.stdout: }, 2023-08-01T19:54:38.430 INFO:teuthology.orchestra.run.smithi155.stdout: { 2023-08-01T19:54:38.430 INFO:teuthology.orchestra.run.smithi155.stdout: "event": "reached_pg", 2023-08-01T19:54:38.430 INFO:teuthology.orchestra.run.smithi155.stdout: "time": "2023-08-01T19:54:38.417564+0000", 2023-08-01T19:54:38.430 INFO:teuthology.orchestra.run.smithi155.stdout: "duration": 2.7809000000000001e-05 2023-08-01T19:54:38.430 INFO:teuthology.orchestra.run.smithi155.stdout: }, 2023-08-01T19:54:38.431 INFO:teuthology.orchestra.run.smithi155.stdout: { 2023-08-01T19:54:38.431 INFO:teuthology.orchestra.run.smithi155.stdout: "event": "started", 2023-08-01T19:54:38.431 INFO:teuthology.orchestra.run.smithi155.stdout: "time": "2023-08-01T19:54:38.417646+0000", 2023-08-01T19:54:38.431 INFO:teuthology.orchestra.run.smithi155.stdout: "duration": 8.1217999999999994e-05 2023-08-01T19:54:38.431 INFO:teuthology.orchestra.run.smithi155.stdout: }, 2023-08-01T19:54:38.431 INFO:teuthology.orchestra.run.smithi155.stdout: { 2023-08-01T19:54:38.431 INFO:teuthology.orchestra.run.smithi155.stdout: "event": "waiting for subops from 0", 2023-08-01T19:54:38.431 INFO:teuthology.orchestra.run.smithi155.stdout: "time": "2023-08-01T19:54:38.417738+0000", 2023-08-01T19:54:38.432 INFO:teuthology.orchestra.run.smithi155.stdout: "duration": 9.2283999999999999e-05 2023-08-01T19:54:38.432 INFO:teuthology.orchestra.run.smithi155.stdout: }, 2023-08-01T19:54:38.432 INFO:teuthology.orchestra.run.smithi155.stdout: { 2023-08-01T19:54:38.432 INFO:teuthology.orchestra.run.smithi155.stdout: "event": "sub_op_commit_rec", 2023-08-01T19:54:38.432 INFO:teuthology.orchestra.run.smithi155.stdout: "time": "2023-08-01T19:54:38.421530+0000", 2023-08-01T19:54:38.432 INFO:teuthology.orchestra.run.smithi155.stdout: "duration": 0.0037920139999999998 2023-08-01T19:54:38.432 INFO:teuthology.orchestra.run.smithi155.stdout: } 2023-08-01T19:54:38.432 INFO:teuthology.orchestra.run.smithi155.stdout: ] 2023-08-01T19:54:38.433 INFO:teuthology.orchestra.run.smithi155.stdout: } 2023-08-01T19:54:38.433 INFO:teuthology.orchestra.run.smithi155.stdout: }, 2023-08-01T19:54:38.433 INFO:teuthology.orchestra.run.smithi155.stdout: { 2023-08-01T19:54:38.433 INFO:teuthology.orchestra.run.smithi155.stdout: "description": "osd_op(client.4668.0:45560 5.8 5:1d501ed4:::benchmark_data_smithi006_114134_object45559:head [set-alloc-hint object_size 65536 write_size 65536,write 0~65536 in=65536b] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e26)", 2023-08-01T19:54:38.433 INFO:teuthology.orchestra.run.smithi155.stdout: "initiated_at": "2023-08-01T19:54:38.419084+0000", 2023-08-01T19:54:38.433 INFO:teuthology.orchestra.run.smithi155.stdout: "age": 0.0037855689999999999, 2023-08-01T19:54:38.433 INFO:teuthology.orchestra.run.smithi155.stdout: "duration": 0.003863895, 2023-08-01T19:54:38.433 INFO:teuthology.orchestra.run.smithi155.stdout: "type_data": { 2023-08-01T19:54:38.434 INFO:teuthology.orchestra.run.smithi155.stdout: "flag_point": "waiting for sub ops", 2023-08-01T19:54:38.434 INFO:teuthology.orchestra.run.smithi155.stdout: "client_info": { 2023-08-01T19:54:38.434 INFO:teuthology.orchestra.run.smithi155.stdout: "client": "client.4668", 2023-08-01T19:54:38.434 INFO:teuthology.orchestra.run.smithi155.stdout: "client_addr": "172.21.15.6:0/1709472247", 2023-08-01T19:54:38.434 INFO:teuthology.orchestra.run.smithi155.stdout: "tid": 45560 2023-08-01T19:54:38.434 INFO:teuthology.orchestra.run.smithi155.stdout: }, 2023-08-01T19:54:38.434 INFO:teuthology.orchestra.run.smithi155.stdout: "events": [ 2023-08-01T19:54:38.435 INFO:teuthology.orchestra.run.smithi155.stdout: { 2023-08-01T19:54:38.435 INFO:teuthology.orchestra.run.smithi155.stdout: "event": "initiated", 2023-08-01T19:54:38.435 INFO:teuthology.orchestra.run.smithi155.stdout: "time": "2023-08-01T19:54:38.419084+0000", 2023-08-01T19:54:38.435 INFO:teuthology.orchestra.run.smithi155.stdout: "duration": 0 2023-08-01T19:54:38.435 INFO:teuthology.orchestra.run.smithi155.stdout: }, 2023-08-01T19:54:38.435 INFO:teuthology.orchestra.run.smithi155.stdout: { 2023-08-01T19:54:38.435 INFO:teuthology.orchestra.run.smithi155.stdout: "event": "throttled", 2023-08-01T19:54:38.435 INFO:teuthology.orchestra.run.smithi155.stdout: "time": "2023-08-01T19:54:38.419084+0000", 2023-08-01T19:54:38.436 INFO:teuthology.orchestra.run.smithi155.stdout: "duration": 0 2023-08-01T19:54:38.436 INFO:teuthology.orchestra.run.smithi155.stdout: }, 2023-08-01T19:54:38.436 INFO:teuthology.orchestra.run.smithi155.stdout: { 2023-08-01T19:54:38.436 INFO:teuthology.orchestra.run.smithi155.stdout: "event": "header_read", 2023-08-01T19:54:38.436 INFO:teuthology.orchestra.run.smithi155.stdout: "time": "2023-08-01T19:54:38.419083+0000", 2023-08-01T19:54:38.436 INFO:teuthology.orchestra.run.smithi155.stdout: "duration": 4294967295.999999 2023-08-01T19:54:38.436 INFO:teuthology.orchestra.run.smithi155.stdout: }, 2023-08-01T19:54:38.436 INFO:teuthology.orchestra.run.smithi155.stdout: { 2023-08-01T19:54:38.437 INFO:teuthology.orchestra.run.smithi155.stdout: "event": "all_read", 2023-08-01T19:54:38.437 INFO:teuthology.orchestra.run.smithi155.stdout: "time": "2023-08-01T19:54:38.419160+0000", 2023-08-01T19:54:38.437 INFO:teuthology.orchestra.run.smithi155.stdout: "duration": 7.6412e-05 2023-08-01T19:54:38.437 INFO:teuthology.orchestra.run.smithi155.stdout: }, 2023-08-01T19:54:38.437 INFO:teuthology.orchestra.run.smithi155.stdout: { 2023-08-01T19:54:38.437 INFO:teuthology.orchestra.run.smithi155.stdout: "event": "dispatched", 2023-08-01T19:54:38.437 INFO:teuthology.orchestra.run.smithi155.stdout: "time": "2023-08-01T19:54:38.419170+0000", 2023-08-01T19:54:38.437 INFO:teuthology.orchestra.run.smithi155.stdout: "duration": 1.0366999999999999e-05 2023-08-01T19:54:38.438 INFO:teuthology.orchestra.run.smithi155.stdout: }, 2023-08-01T19:54:38.438 INFO:teuthology.orchestra.run.smithi155.stdout: { 2023-08-01T19:54:38.438 INFO:teuthology.orchestra.run.smithi155.stdout: "event": "queued_for_pg", 2023-08-01T19:54:38.438 INFO:teuthology.orchestra.run.smithi155.stdout: "time": "2023-08-01T19:54:38.419181+0000", 2023-08-01T19:54:38.438 INFO:teuthology.orchestra.run.smithi155.stdout: "duration": 1.0726e-05 2023-08-01T19:54:38.438 INFO:teuthology.orchestra.run.smithi155.stdout: }, 2023-08-01T19:54:38.438 INFO:teuthology.orchestra.run.smithi155.stdout: { 2023-08-01T19:54:38.438 INFO:teuthology.orchestra.run.smithi155.stdout: "event": "reached_pg", 2023-08-01T19:54:38.439 INFO:teuthology.orchestra.run.smithi155.stdout: "time": "2023-08-01T19:54:38.419207+0000", 2023-08-01T19:54:38.439 INFO:teuthology.orchestra.run.smithi155.stdout: "duration": 2.6006000000000001e-05 2023-08-01T19:54:38.439 INFO:teuthology.orchestra.run.smithi155.stdout: }, 2023-08-01T19:54:38.439 INFO:teuthology.orchestra.run.smithi155.stdout: { 2023-08-01T19:54:38.439 INFO:teuthology.orchestra.run.smithi155.stdout: "event": "started", 2023-08-01T19:54:38.439 INFO:teuthology.orchestra.run.smithi155.stdout: "time": "2023-08-01T19:54:38.419289+0000", 2023-08-01T19:54:38.439 INFO:teuthology.orchestra.run.smithi155.stdout: "duration": 8.1706999999999995e-05 2023-08-01T19:54:38.439 INFO:teuthology.orchestra.run.smithi155.stdout: }, 2023-08-01T19:54:38.440 INFO:teuthology.orchestra.run.smithi155.stdout: { 2023-08-01T19:54:38.440 INFO:teuthology.orchestra.run.smithi155.stdout: "event": "waiting for subops from 0", 2023-08-01T19:54:38.440 INFO:teuthology.orchestra.run.smithi155.stdout: "time": "2023-08-01T19:54:38.419368+0000", 2023-08-01T19:54:38.440 INFO:teuthology.orchestra.run.smithi155.stdout: "duration": 7.8913999999999997e-05 2023-08-01T19:54:38.440 INFO:teuthology.orchestra.run.smithi155.stdout: } 2023-08-01T19:54:38.440 INFO:teuthology.orchestra.run.smithi155.stdout: ] 2023-08-01T19:54:38.440 INFO:teuthology.orchestra.run.smithi155.stdout: } 2023-08-01T19:54:38.441 INFO:teuthology.orchestra.run.smithi155.stdout: }, 2023-08-01T19:54:38.441 INFO:teuthology.orchestra.run.smithi155.stdout: { 2023-08-01T19:54:38.441 INFO:teuthology.orchestra.run.smithi155.stdout: "description": "osd_op(client.4668.0:45563 5.e 5:7022dea8:::benchmark_data_smithi006_114134_object45562:head [set-alloc-hint object_size 65536 write_size 65536,write 0~65536 in=65536b] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e26)", 2023-08-01T19:54:38.441 INFO:teuthology.orchestra.run.smithi155.stdout: "initiated_at": "2023-08-01T19:54:38.419188+0000", 2023-08-01T19:54:38.441 INFO:teuthology.orchestra.run.smithi155.stdout: "age": 0.0036812899999999998, 2023-08-01T19:54:38.441 INFO:teuthology.orchestra.run.smithi155.stdout: "duration": 0.003807108, 2023-08-01T19:54:38.441 INFO:teuthology.orchestra.run.smithi155.stdout: "type_data": { 2023-08-01T19:54:38.441 INFO:teuthology.orchestra.run.smithi155.stdout: "flag_point": "waiting for sub ops", 2023-08-01T19:54:38.442 INFO:teuthology.orchestra.run.smithi155.stdout: "client_info": { 2023-08-01T19:54:38.442 INFO:teuthology.orchestra.run.smithi155.stdout: "client": "client.4668", 2023-08-01T19:54:38.442 INFO:teuthology.orchestra.run.smithi155.stdout: "client_addr": "172.21.15.6:0/1709472247", 2023-08-01T19:54:38.442 INFO:teuthology.orchestra.run.smithi155.stdout: "tid": 45563 2023-08-01T19:54:38.442 INFO:teuthology.orchestra.run.smithi155.stdout: }, 2023-08-01T19:54:38.442 INFO:teuthology.orchestra.run.smithi155.stdout: "events": [ 2023-08-01T19:54:38.442 INFO:teuthology.orchestra.run.smithi155.stdout: { 2023-08-01T19:54:38.442 INFO:teuthology.orchestra.run.smithi155.stdout: "event": "initiated", 2023-08-01T19:54:38.443 INFO:teuthology.orchestra.run.smithi155.stdout: "time": "2023-08-01T19:54:38.419188+0000", 2023-08-01T19:54:38.443 INFO:teuthology.orchestra.run.smithi155.stdout: "duration": 0 2023-08-01T19:54:38.443 INFO:teuthology.orchestra.run.smithi155.stdout: }, 2023-08-01T19:54:38.443 INFO:teuthology.orchestra.run.smithi155.stdout: { 2023-08-01T19:54:38.443 INFO:teuthology.orchestra.run.smithi155.stdout: "event": "throttled", 2023-08-01T19:54:38.443 INFO:teuthology.orchestra.run.smithi155.stdout: "time": "2023-08-01T19:54:38.419188+0000", 2023-08-01T19:54:38.443 INFO:teuthology.orchestra.run.smithi155.stdout: "duration": 0 2023-08-01T19:54:38.443 INFO:teuthology.orchestra.run.smithi155.stdout: }, 2023-08-01T19:54:38.444 INFO:teuthology.orchestra.run.smithi155.stdout: { 2023-08-01T19:54:38.444 INFO:teuthology.orchestra.run.smithi155.stdout: "event": "header_read", 2023-08-01T19:54:38.444 INFO:teuthology.orchestra.run.smithi155.stdout: "time": "2023-08-01T19:54:38.419188+0000", 2023-08-01T19:54:38.444 INFO:teuthology.orchestra.run.smithi155.stdout: "duration": 4294967295.9999995 2023-08-01T19:54:38.444 INFO:teuthology.orchestra.run.smithi155.stdout: }, 2023-08-01T19:54:38.444 INFO:teuthology.orchestra.run.smithi155.stdout: { 2023-08-01T19:54:38.444 INFO:teuthology.orchestra.run.smithi155.stdout: "event": "all_read", 2023-08-01T19:54:38.445 INFO:teuthology.orchestra.run.smithi155.stdout: "time": "2023-08-01T19:54:38.419264+0000", 2023-08-01T19:54:38.445 INFO:teuthology.orchestra.run.smithi155.stdout: "duration": 7.5869000000000002e-05 2023-08-01T19:54:38.445 INFO:teuthology.orchestra.run.smithi155.stdout: }, 2023-08-01T19:54:38.445 INFO:teuthology.orchestra.run.smithi155.stdout: { 2023-08-01T19:54:38.445 INFO:teuthology.orchestra.run.smithi155.stdout: "event": "dispatched", 2023-08-01T19:54:38.445 INFO:teuthology.orchestra.run.smithi155.stdout: "time": "2023-08-01T19:54:38.419270+0000", 2023-08-01T19:54:38.445 INFO:teuthology.orchestra.run.smithi155.stdout: "duration": 6.1750000000000002e-06 2023-08-01T19:54:38.445 INFO:teuthology.orchestra.run.smithi155.stdout: }, 2023-08-01T19:54:38.446 INFO:teuthology.orchestra.run.smithi155.stdout: { 2023-08-01T19:54:38.446 INFO:teuthology.orchestra.run.smithi155.stdout: "event": "queued_for_pg", 2023-08-01T19:54:38.446 INFO:teuthology.orchestra.run.smithi155.stdout: "time": "2023-08-01T19:54:38.419273+0000", 2023-08-01T19:54:38.446 INFO:teuthology.orchestra.run.smithi155.stdout: "duration": 3.2200000000000001e-06 2023-08-01T19:54:38.446 INFO:teuthology.orchestra.run.smithi155.stdout: }, 2023-08-01T19:54:38.446 INFO:teuthology.orchestra.run.smithi155.stdout: { 2023-08-01T19:54:38.446 INFO:teuthology.orchestra.run.smithi155.stdout: "event": "reached_pg", 2023-08-01T19:54:38.446 INFO:teuthology.orchestra.run.smithi155.stdout: "time": "2023-08-01T19:54:38.419300+0000", 2023-08-01T19:54:38.447 INFO:teuthology.orchestra.run.smithi155.stdout: "duration": 2.7163000000000001e-05 2023-08-01T19:54:38.447 INFO:teuthology.orchestra.run.smithi155.stdout: }, 2023-08-01T19:54:38.447 INFO:teuthology.orchestra.run.smithi155.stdout: { 2023-08-01T19:54:38.447 INFO:teuthology.orchestra.run.smithi155.stdout: "event": "started", 2023-08-01T19:54:38.447 INFO:teuthology.orchestra.run.smithi155.stdout: "time": "2023-08-01T19:54:38.419373+0000", 2023-08-01T19:54:38.447 INFO:teuthology.orchestra.run.smithi155.stdout: "duration": 7.2242000000000004e-05 2023-08-01T19:54:38.447 INFO:teuthology.orchestra.run.smithi155.stdout: }, 2023-08-01T19:54:38.447 INFO:teuthology.orchestra.run.smithi155.stdout: { 2023-08-01T19:54:38.448 INFO:teuthology.orchestra.run.smithi155.stdout: "event": "waiting for subops from 0", 2023-08-01T19:54:38.448 INFO:teuthology.orchestra.run.smithi155.stdout: "time": "2023-08-01T19:54:38.419487+0000", 2023-08-01T19:54:38.448 INFO:teuthology.orchestra.run.smithi155.stdout: "duration": 0.000113875 2023-08-01T19:54:38.448 INFO:teuthology.orchestra.run.smithi155.stdout: }, 2023-08-01T19:54:38.448 INFO:teuthology.orchestra.run.smithi155.stdout: { 2023-08-01T19:54:38.448 INFO:teuthology.orchestra.run.smithi155.stdout: "event": "op_commit", 2023-08-01T19:54:38.448 INFO:teuthology.orchestra.run.smithi155.stdout: "time": "2023-08-01T19:54:38.422524+0000", 2023-08-01T19:54:38.448 INFO:teuthology.orchestra.run.smithi155.stdout: "duration": 0.0030376719999999999 2023-08-01T19:54:38.449 INFO:teuthology.orchestra.run.smithi155.stdout: } 2023-08-01T19:54:38.449 INFO:teuthology.orchestra.run.smithi155.stdout: ] 2023-08-01T19:54:38.449 INFO:teuthology.orchestra.run.smithi155.stdout: } 2023-08-01T19:54:38.449 INFO:teuthology.orchestra.run.smithi155.stdout: }, 2023-08-01T19:54:38.449 INFO:teuthology.orchestra.run.smithi155.stdout: { 2023-08-01T19:54:38.449 INFO:teuthology.orchestra.run.smithi155.stdout: "description": "osd_repop(client.4668.0:45567 5.a e26/19 5:5a0987b1:::benchmark_data_smithi006_114134_object45566:head v 26'2843, mlcod=26'2841)", 2023-08-01T19:54:38.449 INFO:teuthology.orchestra.run.smithi155.stdout: "initiated_at": "2023-08-01T19:54:38.421508+0000", 2023-08-01T19:54:38.450 INFO:teuthology.orchestra.run.smithi155.stdout: "age": 0.0013617150000000001, 2023-08-01T19:54:38.450 INFO:teuthology.orchestra.run.smithi155.stdout: "duration": 0.00153714, 2023-08-01T19:54:38.450 INFO:teuthology.orchestra.run.smithi155.stdout: "type_data": { 2023-08-01T19:54:38.450 INFO:teuthology.orchestra.run.smithi155.stdout: "flag_point": "started", 2023-08-01T19:54:38.450 INFO:teuthology.orchestra.run.smithi155.stdout: "events": [ 2023-08-01T19:54:38.450 INFO:teuthology.orchestra.run.smithi155.stdout: { 2023-08-01T19:54:38.450 INFO:teuthology.orchestra.run.smithi155.stdout: "event": "initiated", 2023-08-01T19:54:38.450 INFO:teuthology.orchestra.run.smithi155.stdout: "time": "2023-08-01T19:54:38.421508+0000", 2023-08-01T19:54:38.451 INFO:teuthology.orchestra.run.smithi155.stdout: "duration": 0 2023-08-01T19:54:38.451 INFO:teuthology.orchestra.run.smithi155.stdout: }, 2023-08-01T19:54:38.451 INFO:teuthology.orchestra.run.smithi155.stdout: { 2023-08-01T19:54:38.451 INFO:teuthology.orchestra.run.smithi155.stdout: "event": "throttled", 2023-08-01T19:54:38.451 INFO:teuthology.orchestra.run.smithi155.stdout: "time": "2023-08-01T19:54:38.421508+0000", 2023-08-01T19:54:38.451 INFO:teuthology.orchestra.run.smithi155.stdout: "duration": 0 2023-08-01T19:54:38.451 INFO:teuthology.orchestra.run.smithi155.stdout: }, 2023-08-01T19:54:38.451 INFO:teuthology.orchestra.run.smithi155.stdout: { 2023-08-01T19:54:38.452 INFO:teuthology.orchestra.run.smithi155.stdout: "event": "header_read", 2023-08-01T19:54:38.452 INFO:teuthology.orchestra.run.smithi155.stdout: "time": "2023-08-01T19:54:38.421508+0000", 2023-08-01T19:54:38.452 INFO:teuthology.orchestra.run.smithi155.stdout: "duration": 4294967295.9999995 2023-08-01T19:54:38.452 INFO:teuthology.orchestra.run.smithi155.stdout: }, 2023-08-01T19:54:38.452 INFO:teuthology.orchestra.run.smithi155.stdout: { 2023-08-01T19:54:38.452 INFO:teuthology.orchestra.run.smithi155.stdout: "event": "all_read", 2023-08-01T19:54:38.452 INFO:teuthology.orchestra.run.smithi155.stdout: "time": "2023-08-01T19:54:38.421537+0000", 2023-08-01T19:54:38.452 INFO:teuthology.orchestra.run.smithi155.stdout: "duration": 2.8785e-05 2023-08-01T19:54:38.453 INFO:teuthology.orchestra.run.smithi155.stdout: }, 2023-08-01T19:54:38.453 INFO:teuthology.orchestra.run.smithi155.stdout: { 2023-08-01T19:54:38.453 INFO:teuthology.orchestra.run.smithi155.stdout: "event": "dispatched", 2023-08-01T19:54:38.453 INFO:teuthology.orchestra.run.smithi155.stdout: "time": "2023-08-01T19:54:38.421542+0000", 2023-08-01T19:54:38.453 INFO:teuthology.orchestra.run.smithi155.stdout: "duration": 5.6799999999999998e-06 2023-08-01T19:54:38.453 INFO:teuthology.orchestra.run.smithi155.stdout: }, 2023-08-01T19:54:38.453 INFO:teuthology.orchestra.run.smithi155.stdout: { 2023-08-01T19:54:38.454 INFO:teuthology.orchestra.run.smithi155.stdout: "event": "queued_for_pg", 2023-08-01T19:54:38.454 INFO:teuthology.orchestra.run.smithi155.stdout: "time": "2023-08-01T19:54:38.421545+0000", 2023-08-01T19:54:38.454 INFO:teuthology.orchestra.run.smithi155.stdout: "duration": 2.8100000000000002e-06 2023-08-01T19:54:38.454 INFO:teuthology.orchestra.run.smithi155.stdout: }, 2023-08-01T19:54:38.454 INFO:teuthology.orchestra.run.smithi155.stdout: { 2023-08-01T19:54:38.454 INFO:teuthology.orchestra.run.smithi155.stdout: "event": "reached_pg", 2023-08-01T19:54:38.454 INFO:teuthology.orchestra.run.smithi155.stdout: "time": "2023-08-01T19:54:38.421572+0000", 2023-08-01T19:54:38.454 INFO:teuthology.orchestra.run.smithi155.stdout: "duration": 2.6991e-05 2023-08-01T19:54:38.455 INFO:teuthology.orchestra.run.smithi155.stdout: }, 2023-08-01T19:54:38.455 INFO:teuthology.orchestra.run.smithi155.stdout: { 2023-08-01T19:54:38.455 INFO:teuthology.orchestra.run.smithi155.stdout: "event": "started", 2023-08-01T19:54:38.455 INFO:teuthology.orchestra.run.smithi155.stdout: "time": "2023-08-01T19:54:38.421583+0000", 2023-08-01T19:54:38.455 INFO:teuthology.orchestra.run.smithi155.stdout: "duration": 1.1258e-05 2023-08-01T19:54:38.455 INFO:teuthology.orchestra.run.smithi155.stdout: } 2023-08-01T19:54:38.455 INFO:teuthology.orchestra.run.smithi155.stdout: ] 2023-08-01T19:54:38.455 INFO:teuthology.orchestra.run.smithi155.stdout: } 2023-08-01T19:54:38.456 INFO:teuthology.orchestra.run.smithi155.stdout: }, 2023-08-01T19:54:38.456 INFO:teuthology.orchestra.run.smithi155.stdout: { 2023-08-01T19:54:38.456 INFO:teuthology.orchestra.run.smithi155.stdout: "description": "osd_op(client.4668.0:45571 5.8 5:15aebcc9:::benchmark_data_smithi006_114134_object45570:head [set-alloc-hint object_size 65536 write_size 65536,write 0~65536 in=65536b] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e26)", 2023-08-01T19:54:38.456 INFO:teuthology.orchestra.run.smithi155.stdout: "initiated_at": "2023-08-01T19:54:38.421685+0000", 2023-08-01T19:54:38.456 INFO:teuthology.orchestra.run.smithi155.stdout: "age": 0.0011847400000000001, 2023-08-01T19:54:38.456 INFO:teuthology.orchestra.run.smithi155.stdout: "duration": 0.0013964559999999999, 2023-08-01T19:54:38.456 INFO:teuthology.orchestra.run.smithi155.stdout: "type_data": { 2023-08-01T19:54:38.456 INFO:teuthology.orchestra.run.smithi155.stdout: "flag_point": "waiting for sub ops", 2023-08-01T19:54:38.457 INFO:teuthology.orchestra.run.smithi155.stdout: "client_info": { 2023-08-01T19:54:38.457 INFO:teuthology.orchestra.run.smithi155.stdout: "client": "client.4668", 2023-08-01T19:54:38.457 INFO:teuthology.orchestra.run.smithi155.stdout: "client_addr": "172.21.15.6:0/1709472247", 2023-08-01T19:54:38.457 INFO:teuthology.orchestra.run.smithi155.stdout: "tid": 45571 2023-08-01T19:54:38.457 INFO:teuthology.orchestra.run.smithi155.stdout: }, 2023-08-01T19:54:38.457 INFO:teuthology.orchestra.run.smithi155.stdout: "events": [ 2023-08-01T19:54:38.457 INFO:teuthology.orchestra.run.smithi155.stdout: { 2023-08-01T19:54:38.457 INFO:teuthology.orchestra.run.smithi155.stdout: "event": "initiated", 2023-08-01T19:54:38.458 INFO:teuthology.orchestra.run.smithi155.stdout: "time": "2023-08-01T19:54:38.421685+0000", 2023-08-01T19:54:38.458 INFO:teuthology.orchestra.run.smithi155.stdout: "duration": 0 2023-08-01T19:54:38.458 INFO:teuthology.orchestra.run.smithi155.stdout: }, 2023-08-01T19:54:38.458 INFO:teuthology.orchestra.run.smithi155.stdout: { 2023-08-01T19:54:38.458 INFO:teuthology.orchestra.run.smithi155.stdout: "event": "throttled", 2023-08-01T19:54:38.458 INFO:teuthology.orchestra.run.smithi155.stdout: "time": "2023-08-01T19:54:38.421685+0000", 2023-08-01T19:54:38.458 INFO:teuthology.orchestra.run.smithi155.stdout: "duration": 0 2023-08-01T19:54:38.459 INFO:teuthology.orchestra.run.smithi155.stdout: }, 2023-08-01T19:54:38.459 INFO:teuthology.orchestra.run.smithi155.stdout: { 2023-08-01T19:54:38.459 INFO:teuthology.orchestra.run.smithi155.stdout: "event": "header_read", 2023-08-01T19:54:38.459 INFO:teuthology.orchestra.run.smithi155.stdout: "time": "2023-08-01T19:54:38.421684+0000", 2023-08-01T19:54:38.459 INFO:teuthology.orchestra.run.smithi155.stdout: "duration": 4294967295.999999 2023-08-01T19:54:38.459 INFO:teuthology.orchestra.run.smithi155.stdout: }, 2023-08-01T19:54:38.459 INFO:teuthology.orchestra.run.smithi155.stdout: { 2023-08-01T19:54:38.459 INFO:teuthology.orchestra.run.smithi155.stdout: "event": "all_read", 2023-08-01T19:54:38.460 INFO:teuthology.orchestra.run.smithi155.stdout: "time": "2023-08-01T19:54:38.421776+0000", 2023-08-01T19:54:38.460 INFO:teuthology.orchestra.run.smithi155.stdout: "duration": 9.1793999999999996e-05 2023-08-01T19:54:38.460 INFO:teuthology.orchestra.run.smithi155.stdout: }, 2023-08-01T19:54:38.460 INFO:teuthology.orchestra.run.smithi155.stdout: { 2023-08-01T19:54:38.460 INFO:teuthology.orchestra.run.smithi155.stdout: "event": "dispatched", 2023-08-01T19:54:38.460 INFO:teuthology.orchestra.run.smithi155.stdout: "time": "2023-08-01T19:54:38.421784+0000", 2023-08-01T19:54:38.460 INFO:teuthology.orchestra.run.smithi155.stdout: "duration": 8.5189999999999992e-06 2023-08-01T19:54:38.460 INFO:teuthology.orchestra.run.smithi155.stdout: }, 2023-08-01T19:54:38.461 INFO:teuthology.orchestra.run.smithi155.stdout: { 2023-08-01T19:54:38.461 INFO:teuthology.orchestra.run.smithi155.stdout: "event": "queued_for_pg", 2023-08-01T19:54:38.461 INFO:teuthology.orchestra.run.smithi155.stdout: "time": "2023-08-01T19:54:38.421791+0000", 2023-08-01T19:54:38.461 INFO:teuthology.orchestra.run.smithi155.stdout: "duration": 6.9360000000000002e-06 2023-08-01T19:54:38.461 INFO:teuthology.orchestra.run.smithi155.stdout: }, 2023-08-01T19:54:38.461 INFO:teuthology.orchestra.run.smithi155.stdout: { 2023-08-01T19:54:38.461 INFO:teuthology.orchestra.run.smithi155.stdout: "event": "reached_pg", 2023-08-01T19:54:38.461 INFO:teuthology.orchestra.run.smithi155.stdout: "time": "2023-08-01T19:54:38.421826+0000", 2023-08-01T19:54:38.462 INFO:teuthology.orchestra.run.smithi155.stdout: "duration": 3.5120999999999998e-05 2023-08-01T19:54:38.462 INFO:teuthology.orchestra.run.smithi155.stdout: }, 2023-08-01T19:54:38.462 INFO:teuthology.orchestra.run.smithi155.stdout: { 2023-08-01T19:54:38.462 INFO:teuthology.orchestra.run.smithi155.stdout: "event": "started", 2023-08-01T19:54:38.462 INFO:teuthology.orchestra.run.smithi155.stdout: "time": "2023-08-01T19:54:38.421947+0000", 2023-08-01T19:54:38.462 INFO:teuthology.orchestra.run.smithi155.stdout: "duration": 0.000120908 2023-08-01T19:54:38.462 INFO:teuthology.orchestra.run.smithi155.stdout: }, 2023-08-01T19:54:38.462 INFO:teuthology.orchestra.run.smithi155.stdout: { 2023-08-01T19:54:38.463 INFO:teuthology.orchestra.run.smithi155.stdout: "event": "waiting for subops from 0", 2023-08-01T19:54:38.463 INFO:teuthology.orchestra.run.smithi155.stdout: "time": "2023-08-01T19:54:38.422085+0000", 2023-08-01T19:54:38.463 INFO:teuthology.orchestra.run.smithi155.stdout: "duration": 0.00013767900000000001 2023-08-01T19:54:38.463 INFO:teuthology.orchestra.run.smithi155.stdout: } 2023-08-01T19:54:38.463 INFO:teuthology.orchestra.run.smithi155.stdout: ] 2023-08-01T19:54:38.463 INFO:teuthology.orchestra.run.smithi155.stdout: } 2023-08-01T19:54:38.463 INFO:teuthology.orchestra.run.smithi155.stdout: }, 2023-08-01T19:54:38.463 INFO:teuthology.orchestra.run.smithi155.stdout: { 2023-08-01T19:54:38.464 INFO:teuthology.orchestra.run.smithi155.stdout: "description": "osd_op(client.4668.0:45572 5.0 5:0b82d25b:::benchmark_data_smithi006_114134_object45571:head [set-alloc-hint object_size 65536 write_size 65536,write 0~65536 in=65536b] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e26)", 2023-08-01T19:54:38.464 INFO:teuthology.orchestra.run.smithi155.stdout: "initiated_at": "2023-08-01T19:54:38.421799+0000", 2023-08-01T19:54:38.464 INFO:teuthology.orchestra.run.smithi155.stdout: "age": 0.001070288, 2023-08-01T19:54:38.464 INFO:teuthology.orchestra.run.smithi155.stdout: "duration": 0.0013254549999999999, 2023-08-01T19:54:38.464 INFO:teuthology.orchestra.run.smithi155.stdout: "type_data": { 2023-08-01T19:54:38.464 INFO:teuthology.orchestra.run.smithi155.stdout: "flag_point": "waiting for sub ops", 2023-08-01T19:54:38.464 INFO:teuthology.orchestra.run.smithi155.stdout: "client_info": { 2023-08-01T19:54:38.465 INFO:teuthology.orchestra.run.smithi155.stdout: "client": "client.4668", 2023-08-01T19:54:38.465 INFO:teuthology.orchestra.run.smithi155.stdout: "client_addr": "172.21.15.6:0/1709472247", 2023-08-01T19:54:38.465 INFO:teuthology.orchestra.run.smithi155.stdout: "tid": 45572 2023-08-01T19:54:38.465 INFO:teuthology.orchestra.run.smithi155.stdout: }, 2023-08-01T19:54:38.465 INFO:teuthology.orchestra.run.smithi155.stdout: "events": [ 2023-08-01T19:54:38.465 INFO:teuthology.orchestra.run.smithi155.stdout: { 2023-08-01T19:54:38.465 INFO:teuthology.orchestra.run.smithi155.stdout: "event": "initiated", 2023-08-01T19:54:38.465 INFO:teuthology.orchestra.run.smithi155.stdout: "time": "2023-08-01T19:54:38.421799+0000", 2023-08-01T19:54:38.466 INFO:teuthology.orchestra.run.smithi155.stdout: "duration": 0 2023-08-01T19:54:38.466 INFO:teuthology.orchestra.run.smithi155.stdout: }, 2023-08-01T19:54:38.466 INFO:teuthology.orchestra.run.smithi155.stdout: { 2023-08-01T19:54:38.466 INFO:teuthology.orchestra.run.smithi155.stdout: "event": "throttled", 2023-08-01T19:54:38.466 INFO:teuthology.orchestra.run.smithi155.stdout: "time": "2023-08-01T19:54:38.421799+0000", 2023-08-01T19:54:38.466 INFO:teuthology.orchestra.run.smithi155.stdout: "duration": 0 2023-08-01T19:54:38.466 INFO:teuthology.orchestra.run.smithi155.stdout: }, 2023-08-01T19:54:38.466 INFO:teuthology.orchestra.run.smithi155.stdout: { 2023-08-01T19:54:38.467 INFO:teuthology.orchestra.run.smithi155.stdout: "event": "header_read", 2023-08-01T19:54:38.467 INFO:teuthology.orchestra.run.smithi155.stdout: "time": "2023-08-01T19:54:38.421799+0000", 2023-08-01T19:54:38.467 INFO:teuthology.orchestra.run.smithi155.stdout: "duration": 4294967295.9999995 2023-08-01T19:54:38.467 INFO:teuthology.orchestra.run.smithi155.stdout: }, 2023-08-01T19:54:38.467 INFO:teuthology.orchestra.run.smithi155.stdout: { 2023-08-01T19:54:38.467 INFO:teuthology.orchestra.run.smithi155.stdout: "event": "all_read", 2023-08-01T19:54:38.467 INFO:teuthology.orchestra.run.smithi155.stdout: "time": "2023-08-01T19:54:38.421852+0000", 2023-08-01T19:54:38.467 INFO:teuthology.orchestra.run.smithi155.stdout: "duration": 5.3229999999999997e-05 2023-08-01T19:54:38.468 INFO:teuthology.orchestra.run.smithi155.stdout: }, 2023-08-01T19:54:38.468 INFO:teuthology.orchestra.run.smithi155.stdout: { 2023-08-01T19:54:38.468 INFO:teuthology.orchestra.run.smithi155.stdout: "event": "dispatched", 2023-08-01T19:54:38.468 INFO:teuthology.orchestra.run.smithi155.stdout: "time": "2023-08-01T19:54:38.421858+0000", 2023-08-01T19:54:38.468 INFO:teuthology.orchestra.run.smithi155.stdout: "duration": 5.2700000000000004e-06 2023-08-01T19:54:38.468 INFO:teuthology.orchestra.run.smithi155.stdout: }, 2023-08-01T19:54:38.468 INFO:teuthology.orchestra.run.smithi155.stdout: { 2023-08-01T19:54:38.469 INFO:teuthology.orchestra.run.smithi155.stdout: "event": "queued_for_pg", 2023-08-01T19:54:38.469 INFO:teuthology.orchestra.run.smithi155.stdout: "time": "2023-08-01T19:54:38.421861+0000", 2023-08-01T19:54:38.469 INFO:teuthology.orchestra.run.smithi155.stdout: "duration": 3.2009999999999999e-06 2023-08-01T19:54:38.469 INFO:teuthology.orchestra.run.smithi155.stdout: }, 2023-08-01T19:54:38.469 INFO:teuthology.orchestra.run.smithi155.stdout: { 2023-08-01T19:54:38.469 INFO:teuthology.orchestra.run.smithi155.stdout: "event": "reached_pg", 2023-08-01T19:54:38.469 INFO:teuthology.orchestra.run.smithi155.stdout: "time": "2023-08-01T19:54:38.421883+0000", 2023-08-01T19:54:38.469 INFO:teuthology.orchestra.run.smithi155.stdout: "duration": 2.2291000000000001e-05 2023-08-01T19:54:38.470 INFO:teuthology.orchestra.run.smithi155.stdout: }, 2023-08-01T19:54:38.470 INFO:teuthology.orchestra.run.smithi155.stdout: { 2023-08-01T19:54:38.470 INFO:teuthology.orchestra.run.smithi155.stdout: "event": "started", 2023-08-01T19:54:38.470 INFO:teuthology.orchestra.run.smithi155.stdout: "time": "2023-08-01T19:54:38.421956+0000", 2023-08-01T19:54:38.470 INFO:teuthology.orchestra.run.smithi155.stdout: "duration": 7.2556000000000001e-05 2023-08-01T19:54:38.470 INFO:teuthology.orchestra.run.smithi155.stdout: }, 2023-08-01T19:54:38.470 INFO:teuthology.orchestra.run.smithi155.stdout: { 2023-08-01T19:54:38.470 INFO:teuthology.orchestra.run.smithi155.stdout: "event": "waiting for subops from 0", 2023-08-01T19:54:38.471 INFO:teuthology.orchestra.run.smithi155.stdout: "time": "2023-08-01T19:54:38.422039+0000", 2023-08-01T19:54:38.471 INFO:teuthology.orchestra.run.smithi155.stdout: "duration": 8.3306999999999994e-05 2023-08-01T19:54:38.471 INFO:teuthology.orchestra.run.smithi155.stdout: } 2023-08-01T19:54:38.471 INFO:teuthology.orchestra.run.smithi155.stdout: ] 2023-08-01T19:54:38.471 INFO:teuthology.orchestra.run.smithi155.stdout: } 2023-08-01T19:54:38.471 INFO:teuthology.orchestra.run.smithi155.stdout: } 2023-08-01T19:54:38.471 INFO:teuthology.orchestra.run.smithi155.stdout: ], 2023-08-01T19:54:38.471 INFO:teuthology.orchestra.run.smithi155.stdout: "num_ops": 6 2023-08-01T19:54:38.472 INFO:teuthology.orchestra.run.smithi155.stdout:} 2023-08-01T19:54:38.472 INFO:tasks.thrashosds.thrasher:in_osds: [0, 1, 2] out_osds: [] dead_osds: [] live_osds: [0, 1, 2] 2023-08-01T19:54:38.472 INFO:tasks.thrashosds.thrasher:choose_action: min_in 4 min_out 0 min_live 2 min_dead 0 chance_down 1.00 2023-08-01T19:54:38.472 INFO:tasks.thrashosds.thrasher:thrash_pg_upmap_items 2023-08-01T19:54:38.472 DEBUG:teuthology.orchestra.run.smithi006:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 120 ceph --cluster ceph osd dump -f json-pretty 2023-08-01T19:54:38.474 DEBUG:teuthology.orchestra.run.smithi155:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 30 ceph --cluster ceph --admin-daemon /var/run/ceph/ceph-osd.2.asok dump_blocked_ops 2023-08-01T19:54:38.474 INFO:tasks.ceph.osd.2.smithi155.stderr:2023-08-01T19:54:38.472+0000 7faa5c6ac700 -1 received signal: Hangup from /usr/bin/python3 /bin/daemon-helper kill ceph-osd -f --cluster ceph -i 2 (PID: 111337) UID: 0 2023-08-01T19:54:38.575 INFO:tasks.ceph.osd.0.smithi008.stderr:2023-08-01T19:54:38.574+0000 7f16a58f4700 -1 received signal: Hangup from /usr/bin/python3 /bin/daemon-helper kill ceph-osd -f --cluster ceph -i 0 (PID: 111179) UID: 0 2023-08-01T19:54:38.662 DEBUG:teuthology.orchestra.run.smithi006:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 120 ceph --cluster ceph -- tell 'osd.*' injectargs --osd_enable_op_tracker=false 2023-08-01T19:54:38.675 INFO:tasks.ceph.osd.2.smithi155.stderr:2023-08-01T19:54:38.673+0000 7faa5c6ac700 -1 received signal: Hangup from /usr/bin/python3 /bin/daemon-helper kill ceph-osd -f --cluster ceph -i 2 (PID: 111337) UID: 0 2023-08-01T19:54:38.683 INFO:teuthology.orchestra.run.smithi155.stdout:{ 2023-08-01T19:54:38.683 INFO:teuthology.orchestra.run.smithi155.stdout: "ops": [], 2023-08-01T19:54:38.683 INFO:teuthology.orchestra.run.smithi155.stdout: "complaint_time": 30, 2023-08-01T19:54:38.683 INFO:teuthology.orchestra.run.smithi155.stdout: "num_blocked_ops": 0 2023-08-01T19:54:38.683 INFO:teuthology.orchestra.run.smithi155.stdout:} 2023-08-01T19:54:38.696 DEBUG:teuthology.orchestra.run.smithi155:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 30 ceph --cluster ceph --admin-daemon /var/run/ceph/ceph-osd.2.asok dump_historic_ops 2023-08-01T19:54:38.776 INFO:tasks.ceph.osd.1.smithi101.stderr:2023-08-01T19:54:38.775+0000 7fb0cb7f6700 -1 received signal: Hangup from /usr/bin/python3 /bin/daemon-helper kill ceph-osd -f --cluster ceph -i 1 (PID: 111141) UID: 0 2023-08-01T19:54:38.812 INFO:teuthology.orchestra.run.smithi006.stdout:osd.0: {} 2023-08-01T19:54:38.828 INFO:teuthology.orchestra.run.smithi006.stdout: 2023-08-01T19:54:38.829 INFO:teuthology.orchestra.run.smithi006.stdout:{ 2023-08-01T19:54:38.829 INFO:teuthology.orchestra.run.smithi006.stdout: "epoch": 26, 2023-08-01T19:54:38.829 INFO:teuthology.orchestra.run.smithi006.stdout: "fsid": "a0e420cc-4df1-42a5-8bd4-a98c309a9349", 2023-08-01T19:54:38.829 INFO:teuthology.orchestra.run.smithi006.stdout: "created": "2023-08-01T19:53:41.279588+0000", 2023-08-01T19:54:38.829 INFO:teuthology.orchestra.run.smithi006.stdout: "modified": "2023-08-01T19:54:37.167406+0000", 2023-08-01T19:54:38.829 INFO:teuthology.orchestra.run.smithi006.stdout: "last_up_change": "2023-08-01T19:53:50.735626+0000", 2023-08-01T19:54:38.829 INFO:teuthology.orchestra.run.smithi006.stdout: "last_in_change": "2023-08-01T19:53:42.974751+0000", 2023-08-01T19:54:38.829 INFO:teuthology.orchestra.run.smithi006.stdout: "flags": "noscrub,nodeep-scrub,sortbitwise,recovery_deletes,purged_snapdirs,pglog_hardlimit", 2023-08-01T19:54:38.830 INFO:teuthology.orchestra.run.smithi006.stdout: "flags_num": 5806080, 2023-08-01T19:54:38.830 INFO:teuthology.orchestra.run.smithi006.stdout: "flags_set": [ 2023-08-01T19:54:38.830 INFO:teuthology.orchestra.run.smithi006.stdout: "nodeep-scrub", 2023-08-01T19:54:38.830 INFO:teuthology.orchestra.run.smithi006.stdout: "noscrub", 2023-08-01T19:54:38.830 INFO:teuthology.orchestra.run.smithi006.stdout: "pglog_hardlimit", 2023-08-01T19:54:38.830 INFO:teuthology.orchestra.run.smithi006.stdout: "purged_snapdirs", 2023-08-01T19:54:38.830 INFO:teuthology.orchestra.run.smithi006.stdout: "recovery_deletes", 2023-08-01T19:54:38.831 INFO:teuthology.orchestra.run.smithi006.stdout: "sortbitwise" 2023-08-01T19:54:38.831 INFO:teuthology.orchestra.run.smithi006.stdout: ], 2023-08-01T19:54:38.831 INFO:teuthology.orchestra.run.smithi006.stdout: "crush_version": 5, 2023-08-01T19:54:38.831 INFO:teuthology.orchestra.run.smithi006.stdout: "full_ratio": 0.94999998807907104, 2023-08-01T19:54:38.831 INFO:teuthology.orchestra.run.smithi006.stdout: "backfillfull_ratio": 0.89999997615814209, 2023-08-01T19:54:38.831 INFO:teuthology.orchestra.run.smithi006.stdout: "nearfull_ratio": 0.85000002384185791, 2023-08-01T19:54:38.831 INFO:teuthology.orchestra.run.smithi006.stdout: "cluster_snapshot": "", 2023-08-01T19:54:38.831 INFO:teuthology.orchestra.run.smithi006.stdout: "pool_max": 5, 2023-08-01T19:54:38.832 INFO:teuthology.orchestra.run.smithi006.stdout: "max_osd": 3, 2023-08-01T19:54:38.832 INFO:teuthology.orchestra.run.smithi006.stdout: "require_min_compat_client": "luminous", 2023-08-01T19:54:38.832 INFO:teuthology.orchestra.run.smithi006.stdout: "min_compat_client": "jewel", 2023-08-01T19:54:38.832 INFO:teuthology.orchestra.run.smithi006.stdout: "require_osd_release": "quincy", 2023-08-01T19:54:38.832 INFO:teuthology.orchestra.run.smithi006.stdout: "pools": [ 2023-08-01T19:54:38.832 INFO:teuthology.orchestra.run.smithi006.stdout: { 2023-08-01T19:54:38.832 INFO:teuthology.orchestra.run.smithi006.stdout: "pool": 1, 2023-08-01T19:54:38.832 INFO:teuthology.orchestra.run.smithi006.stdout: "pool_name": ".mgr", 2023-08-01T19:54:38.833 INFO:teuthology.orchestra.run.smithi006.stdout: "create_time": "2023-08-01T19:53:49.961944+0000", 2023-08-01T19:54:38.833 INFO:teuthology.orchestra.run.smithi006.stdout: "flags": 1, 2023-08-01T19:54:38.833 INFO:teuthology.orchestra.run.smithi006.stdout: "flags_names": "hashpspool", 2023-08-01T19:54:38.833 INFO:teuthology.orchestra.run.smithi006.stdout: "type": 1, 2023-08-01T19:54:38.833 INFO:teuthology.orchestra.run.smithi006.stdout: "size": 2, 2023-08-01T19:54:38.833 INFO:teuthology.orchestra.run.smithi006.stdout: "min_size": 1, 2023-08-01T19:54:38.833 INFO:teuthology.orchestra.run.smithi006.stdout: "crush_rule": 0, 2023-08-01T19:54:38.833 INFO:teuthology.orchestra.run.smithi006.stdout: "peering_crush_bucket_count": 0, 2023-08-01T19:54:38.834 INFO:teuthology.orchestra.run.smithi006.stdout: "peering_crush_bucket_target": 0, 2023-08-01T19:54:38.834 INFO:teuthology.orchestra.run.smithi006.stdout: "peering_crush_bucket_barrier": 0, 2023-08-01T19:54:38.834 INFO:teuthology.orchestra.run.smithi006.stdout: "peering_crush_bucket_mandatory_member": 2147483647, 2023-08-01T19:54:38.834 INFO:teuthology.orchestra.run.smithi006.stdout: "object_hash": 2, 2023-08-01T19:54:38.834 INFO:teuthology.orchestra.run.smithi006.stdout: "pg_autoscale_mode": "off", 2023-08-01T19:54:38.834 INFO:teuthology.orchestra.run.smithi006.stdout: "pg_num": 1, 2023-08-01T19:54:38.834 INFO:teuthology.orchestra.run.smithi006.stdout: "pg_placement_num": 1, 2023-08-01T19:54:38.835 INFO:teuthology.orchestra.run.smithi006.stdout: "pg_placement_num_target": 1, 2023-08-01T19:54:38.835 INFO:teuthology.orchestra.run.smithi006.stdout: "pg_num_target": 1, 2023-08-01T19:54:38.835 INFO:teuthology.orchestra.run.smithi006.stdout: "pg_num_pending": 1, 2023-08-01T19:54:38.835 INFO:teuthology.orchestra.run.smithi006.stdout: "last_pg_merge_meta": { 2023-08-01T19:54:38.835 INFO:teuthology.orchestra.run.smithi006.stdout: "source_pgid": "0.0", 2023-08-01T19:54:38.835 INFO:teuthology.orchestra.run.smithi006.stdout: "ready_epoch": 0, 2023-08-01T19:54:38.835 INFO:teuthology.orchestra.run.smithi006.stdout: "last_epoch_started": 0, 2023-08-01T19:54:38.835 INFO:teuthology.orchestra.run.smithi006.stdout: "last_epoch_clean": 0, 2023-08-01T19:54:38.836 INFO:teuthology.orchestra.run.smithi006.stdout: "source_version": "0'0", 2023-08-01T19:54:38.836 INFO:teuthology.orchestra.run.smithi006.stdout: "target_version": "0'0" 2023-08-01T19:54:38.836 INFO:teuthology.orchestra.run.smithi006.stdout: }, 2023-08-01T19:54:38.836 INFO:teuthology.orchestra.run.smithi006.stdout: "last_change": "11", 2023-08-01T19:54:38.836 INFO:teuthology.orchestra.run.smithi006.stdout: "last_force_op_resend": "0", 2023-08-01T19:54:38.836 INFO:teuthology.orchestra.run.smithi006.stdout: "last_force_op_resend_prenautilus": "0", 2023-08-01T19:54:38.836 INFO:teuthology.orchestra.run.smithi006.stdout: "last_force_op_resend_preluminous": "0", 2023-08-01T19:54:38.836 INFO:teuthology.orchestra.run.smithi006.stdout: "auid": 0, 2023-08-01T19:54:38.837 INFO:teuthology.orchestra.run.smithi006.stdout: "snap_mode": "selfmanaged", 2023-08-01T19:54:38.837 INFO:teuthology.orchestra.run.smithi006.stdout: "snap_seq": 0, 2023-08-01T19:54:38.837 INFO:teuthology.orchestra.run.smithi006.stdout: "snap_epoch": 0, 2023-08-01T19:54:38.837 INFO:teuthology.orchestra.run.smithi006.stdout: "pool_snaps": [], 2023-08-01T19:54:38.837 INFO:teuthology.orchestra.run.smithi006.stdout: "removed_snaps": "[]", 2023-08-01T19:54:38.837 INFO:teuthology.orchestra.run.smithi006.stdout: "quota_max_bytes": 0, 2023-08-01T19:54:38.837 INFO:teuthology.orchestra.run.smithi006.stdout: "quota_max_objects": 0, 2023-08-01T19:54:38.837 INFO:teuthology.orchestra.run.smithi006.stdout: "tiers": [], 2023-08-01T19:54:38.838 INFO:teuthology.orchestra.run.smithi006.stdout: "tier_of": -1, 2023-08-01T19:54:38.838 INFO:teuthology.orchestra.run.smithi006.stdout: "read_tier": -1, 2023-08-01T19:54:38.838 INFO:teuthology.orchestra.run.smithi006.stdout: "write_tier": -1, 2023-08-01T19:54:38.838 INFO:teuthology.orchestra.run.smithi006.stdout: "cache_mode": "none", 2023-08-01T19:54:38.838 INFO:teuthology.orchestra.run.smithi006.stdout: "target_max_bytes": 0, 2023-08-01T19:54:38.838 INFO:teuthology.orchestra.run.smithi006.stdout: "target_max_objects": 0, 2023-08-01T19:54:38.838 INFO:teuthology.orchestra.run.smithi006.stdout: "cache_target_dirty_ratio_micro": 400000, 2023-08-01T19:54:38.838 INFO:teuthology.orchestra.run.smithi006.stdout: "cache_target_dirty_high_ratio_micro": 600000, 2023-08-01T19:54:38.839 INFO:teuthology.orchestra.run.smithi006.stdout: "cache_target_full_ratio_micro": 800000, 2023-08-01T19:54:38.839 INFO:teuthology.orchestra.run.smithi006.stdout: "cache_min_flush_age": 0, 2023-08-01T19:54:38.839 INFO:teuthology.orchestra.run.smithi006.stdout: "cache_min_evict_age": 0, 2023-08-01T19:54:38.839 INFO:teuthology.orchestra.run.smithi006.stdout: "erasure_code_profile": "", 2023-08-01T19:54:38.839 INFO:teuthology.orchestra.run.smithi006.stdout: "hit_set_params": { 2023-08-01T19:54:38.839 INFO:teuthology.orchestra.run.smithi006.stdout: "type": "none" 2023-08-01T19:54:38.839 INFO:teuthology.orchestra.run.smithi006.stdout: }, 2023-08-01T19:54:38.839 INFO:teuthology.orchestra.run.smithi006.stdout: "hit_set_period": 0, 2023-08-01T19:54:38.840 INFO:teuthology.orchestra.run.smithi006.stdout: "hit_set_count": 0, 2023-08-01T19:54:38.840 INFO:teuthology.orchestra.run.smithi006.stdout: "use_gmt_hitset": true, 2023-08-01T19:54:38.840 INFO:teuthology.orchestra.run.smithi006.stdout: "min_read_recency_for_promote": 0, 2023-08-01T19:54:38.840 INFO:teuthology.orchestra.run.smithi006.stdout: "min_write_recency_for_promote": 0, 2023-08-01T19:54:38.840 INFO:teuthology.orchestra.run.smithi006.stdout: "hit_set_grade_decay_rate": 0, 2023-08-01T19:54:38.840 INFO:teuthology.orchestra.run.smithi006.stdout: "hit_set_search_last_n": 0, 2023-08-01T19:54:38.840 INFO:teuthology.orchestra.run.smithi006.stdout: "grade_table": [], 2023-08-01T19:54:38.841 INFO:teuthology.orchestra.run.smithi006.stdout: "stripe_width": 0, 2023-08-01T19:54:38.841 INFO:teuthology.orchestra.run.smithi006.stdout: "expected_num_objects": 0, 2023-08-01T19:54:38.841 INFO:teuthology.orchestra.run.smithi006.stdout: "fast_read": false, 2023-08-01T19:54:38.841 INFO:teuthology.orchestra.run.smithi006.stdout: "options": { 2023-08-01T19:54:38.841 INFO:teuthology.orchestra.run.smithi006.stdout: "pg_num_max": 32, 2023-08-01T19:54:38.841 INFO:teuthology.orchestra.run.smithi006.stdout: "pg_num_min": 1 2023-08-01T19:54:38.841 INFO:teuthology.orchestra.run.smithi006.stdout: }, 2023-08-01T19:54:38.841 INFO:teuthology.orchestra.run.smithi006.stdout: "application_metadata": { 2023-08-01T19:54:38.842 INFO:teuthology.orchestra.run.smithi006.stdout: "mgr": {} 2023-08-01T19:54:38.842 INFO:teuthology.orchestra.run.smithi006.stdout: } 2023-08-01T19:54:38.842 INFO:teuthology.orchestra.run.smithi006.stdout: }, 2023-08-01T19:54:38.842 INFO:teuthology.orchestra.run.smithi006.stdout: { 2023-08-01T19:54:38.842 INFO:teuthology.orchestra.run.smithi006.stdout: "pool": 2, 2023-08-01T19:54:38.842 INFO:teuthology.orchestra.run.smithi006.stdout: "pool_name": "rbd", 2023-08-01T19:54:38.842 INFO:teuthology.orchestra.run.smithi006.stdout: "create_time": "2023-08-01T19:53:57.404091+0000", 2023-08-01T19:54:38.842 INFO:teuthology.orchestra.run.smithi006.stdout: "flags": 1, 2023-08-01T19:54:38.843 INFO:teuthology.orchestra.run.smithi006.stdout: "flags_names": "hashpspool", 2023-08-01T19:54:38.843 INFO:teuthology.orchestra.run.smithi006.stdout: "type": 1, 2023-08-01T19:54:38.843 INFO:teuthology.orchestra.run.smithi006.stdout: "size": 2, 2023-08-01T19:54:38.843 INFO:teuthology.orchestra.run.smithi006.stdout: "min_size": 1, 2023-08-01T19:54:38.843 INFO:teuthology.orchestra.run.smithi006.stdout: "crush_rule": 0, 2023-08-01T19:54:38.843 INFO:teuthology.orchestra.run.smithi006.stdout: "peering_crush_bucket_count": 0, 2023-08-01T19:54:38.843 INFO:teuthology.orchestra.run.smithi006.stdout: "peering_crush_bucket_target": 0, 2023-08-01T19:54:38.843 INFO:teuthology.orchestra.run.smithi006.stdout: "peering_crush_bucket_barrier": 0, 2023-08-01T19:54:38.844 INFO:teuthology.orchestra.run.smithi006.stdout: "peering_crush_bucket_mandatory_member": 2147483647, 2023-08-01T19:54:38.844 INFO:teuthology.orchestra.run.smithi006.stdout: "object_hash": 2, 2023-08-01T19:54:38.844 INFO:teuthology.orchestra.run.smithi006.stdout: "pg_autoscale_mode": "off", 2023-08-01T19:54:38.844 INFO:teuthology.orchestra.run.smithi006.stdout: "pg_num": 8, 2023-08-01T19:54:38.844 INFO:teuthology.orchestra.run.smithi006.stdout: "pg_placement_num": 8, 2023-08-01T19:54:38.844 INFO:teuthology.orchestra.run.smithi006.stdout: "pg_placement_num_target": 8, 2023-08-01T19:54:38.844 INFO:teuthology.orchestra.run.smithi006.stdout: "pg_num_target": 8, 2023-08-01T19:54:38.844 INFO:teuthology.orchestra.run.smithi006.stdout: "pg_num_pending": 8, 2023-08-01T19:54:38.845 INFO:teuthology.orchestra.run.smithi006.stdout: "last_pg_merge_meta": { 2023-08-01T19:54:38.845 INFO:teuthology.orchestra.run.smithi006.stdout: "source_pgid": "0.0", 2023-08-01T19:54:38.845 INFO:teuthology.orchestra.run.smithi006.stdout: "ready_epoch": 0, 2023-08-01T19:54:38.845 INFO:teuthology.orchestra.run.smithi006.stdout: "last_epoch_started": 0, 2023-08-01T19:54:38.845 INFO:teuthology.orchestra.run.smithi006.stdout: "last_epoch_clean": 0, 2023-08-01T19:54:38.845 INFO:teuthology.orchestra.run.smithi006.stdout: "source_version": "0'0", 2023-08-01T19:54:38.845 INFO:teuthology.orchestra.run.smithi006.stdout: "target_version": "0'0" 2023-08-01T19:54:38.845 INFO:teuthology.orchestra.run.smithi006.stdout: }, 2023-08-01T19:54:38.846 INFO:teuthology.orchestra.run.smithi006.stdout: "last_change": "14", 2023-08-01T19:54:38.846 INFO:teuthology.orchestra.run.smithi006.stdout: "last_force_op_resend": "0", 2023-08-01T19:54:38.846 INFO:teuthology.orchestra.run.smithi006.stdout: "last_force_op_resend_prenautilus": "0", 2023-08-01T19:54:38.846 INFO:teuthology.orchestra.run.smithi006.stdout: "last_force_op_resend_preluminous": "0", 2023-08-01T19:54:38.846 INFO:teuthology.orchestra.run.smithi006.stdout: "auid": 0, 2023-08-01T19:54:38.846 INFO:teuthology.orchestra.run.smithi006.stdout: "snap_mode": "selfmanaged", 2023-08-01T19:54:38.846 INFO:teuthology.orchestra.run.smithi006.stdout: "snap_seq": 0, 2023-08-01T19:54:38.846 INFO:teuthology.orchestra.run.smithi006.stdout: "snap_epoch": 0, 2023-08-01T19:54:38.847 INFO:teuthology.orchestra.run.smithi006.stdout: "pool_snaps": [], 2023-08-01T19:54:38.847 INFO:teuthology.orchestra.run.smithi006.stdout: "removed_snaps": "[]", 2023-08-01T19:54:38.847 INFO:teuthology.orchestra.run.smithi006.stdout: "quota_max_bytes": 0, 2023-08-01T19:54:38.847 INFO:teuthology.orchestra.run.smithi006.stdout: "quota_max_objects": 0, 2023-08-01T19:54:38.847 INFO:teuthology.orchestra.run.smithi006.stdout: "tiers": [], 2023-08-01T19:54:38.847 INFO:teuthology.orchestra.run.smithi006.stdout: "tier_of": -1, 2023-08-01T19:54:38.847 INFO:teuthology.orchestra.run.smithi006.stdout: "read_tier": -1, 2023-08-01T19:54:38.848 INFO:teuthology.orchestra.run.smithi006.stdout: "write_tier": -1, 2023-08-01T19:54:38.848 INFO:teuthology.orchestra.run.smithi006.stdout: "cache_mode": "none", 2023-08-01T19:54:38.848 INFO:teuthology.orchestra.run.smithi006.stdout: "target_max_bytes": 0, 2023-08-01T19:54:38.848 INFO:teuthology.orchestra.run.smithi006.stdout: "target_max_objects": 0, 2023-08-01T19:54:38.848 INFO:teuthology.orchestra.run.smithi006.stdout: "cache_target_dirty_ratio_micro": 400000, 2023-08-01T19:54:38.848 INFO:teuthology.orchestra.run.smithi006.stdout: "cache_target_dirty_high_ratio_micro": 600000, 2023-08-01T19:54:38.848 INFO:teuthology.orchestra.run.smithi006.stdout: "cache_target_full_ratio_micro": 800000, 2023-08-01T19:54:38.848 INFO:teuthology.orchestra.run.smithi006.stdout: "cache_min_flush_age": 0, 2023-08-01T19:54:38.849 INFO:teuthology.orchestra.run.smithi006.stdout: "cache_min_evict_age": 0, 2023-08-01T19:54:38.849 INFO:teuthology.orchestra.run.smithi006.stdout: "erasure_code_profile": "", 2023-08-01T19:54:38.849 INFO:teuthology.orchestra.run.smithi006.stdout: "hit_set_params": { 2023-08-01T19:54:38.849 INFO:teuthology.orchestra.run.smithi006.stdout: "type": "none" 2023-08-01T19:54:38.849 INFO:teuthology.orchestra.run.smithi006.stdout: }, 2023-08-01T19:54:38.849 INFO:teuthology.orchestra.run.smithi006.stdout: "hit_set_period": 0, 2023-08-01T19:54:38.849 INFO:teuthology.orchestra.run.smithi006.stdout: "hit_set_count": 0, 2023-08-01T19:54:38.849 INFO:teuthology.orchestra.run.smithi006.stdout: "use_gmt_hitset": true, 2023-08-01T19:54:38.850 INFO:teuthology.orchestra.run.smithi006.stdout: "min_read_recency_for_promote": 0, 2023-08-01T19:54:38.850 INFO:teuthology.orchestra.run.smithi006.stdout: "min_write_recency_for_promote": 0, 2023-08-01T19:54:38.850 INFO:teuthology.orchestra.run.smithi006.stdout: "hit_set_grade_decay_rate": 0, 2023-08-01T19:54:38.850 INFO:teuthology.orchestra.run.smithi006.stdout: "hit_set_search_last_n": 0, 2023-08-01T19:54:38.850 INFO:teuthology.orchestra.run.smithi006.stdout: "grade_table": [], 2023-08-01T19:54:38.850 INFO:teuthology.orchestra.run.smithi006.stdout: "stripe_width": 0, 2023-08-01T19:54:38.850 INFO:teuthology.orchestra.run.smithi006.stdout: "expected_num_objects": 0, 2023-08-01T19:54:38.850 INFO:teuthology.orchestra.run.smithi006.stdout: "fast_read": false, 2023-08-01T19:54:38.851 INFO:teuthology.orchestra.run.smithi006.stdout: "options": {}, 2023-08-01T19:54:38.851 INFO:teuthology.orchestra.run.smithi006.stdout: "application_metadata": { 2023-08-01T19:54:38.851 INFO:teuthology.orchestra.run.smithi006.stdout: "rbd": {} 2023-08-01T19:54:38.851 INFO:teuthology.orchestra.run.smithi006.stdout: } 2023-08-01T19:54:38.851 INFO:teuthology.orchestra.run.smithi006.stdout: }, 2023-08-01T19:54:38.851 INFO:teuthology.orchestra.run.smithi006.stdout: { 2023-08-01T19:54:38.851 INFO:teuthology.orchestra.run.smithi006.stdout: "pool": 3, 2023-08-01T19:54:38.851 INFO:teuthology.orchestra.run.smithi006.stdout: "pool_name": "cephfs_metadata", 2023-08-01T19:54:38.852 INFO:teuthology.orchestra.run.smithi006.stdout: "create_time": "2023-08-01T19:54:02.111247+0000", 2023-08-01T19:54:38.852 INFO:teuthology.orchestra.run.smithi006.stdout: "flags": 1, 2023-08-01T19:54:38.852 INFO:teuthology.orchestra.run.smithi006.stdout: "flags_names": "hashpspool", 2023-08-01T19:54:38.852 INFO:teuthology.orchestra.run.smithi006.stdout: "type": 1, 2023-08-01T19:54:38.852 INFO:teuthology.orchestra.run.smithi006.stdout: "size": 2, 2023-08-01T19:54:38.852 INFO:teuthology.orchestra.run.smithi006.stdout: "min_size": 1, 2023-08-01T19:54:38.852 INFO:teuthology.orchestra.run.smithi006.stdout: "crush_rule": 0, 2023-08-01T19:54:38.852 INFO:teuthology.orchestra.run.smithi006.stdout: "peering_crush_bucket_count": 0, 2023-08-01T19:54:38.853 INFO:teuthology.orchestra.run.smithi006.stdout: "peering_crush_bucket_target": 0, 2023-08-01T19:54:38.853 INFO:teuthology.orchestra.run.smithi006.stdout: "peering_crush_bucket_barrier": 0, 2023-08-01T19:54:38.853 INFO:teuthology.orchestra.run.smithi006.stdout: "peering_crush_bucket_mandatory_member": 2147483647, 2023-08-01T19:54:38.853 INFO:teuthology.orchestra.run.smithi006.stdout: "object_hash": 2, 2023-08-01T19:54:38.853 INFO:teuthology.orchestra.run.smithi006.stdout: "pg_autoscale_mode": "off", 2023-08-01T19:54:38.853 INFO:teuthology.orchestra.run.smithi006.stdout: "pg_num": 32, 2023-08-01T19:54:38.853 INFO:teuthology.orchestra.run.smithi006.stdout: "pg_placement_num": 32, 2023-08-01T19:54:38.854 INFO:teuthology.orchestra.run.smithi006.stdout: "pg_placement_num_target": 32, 2023-08-01T19:54:38.854 INFO:teuthology.orchestra.run.smithi006.stdout: "pg_num_target": 32, 2023-08-01T19:54:38.854 INFO:teuthology.orchestra.run.smithi006.stdout: "pg_num_pending": 32, 2023-08-01T19:54:38.854 INFO:teuthology.orchestra.run.smithi006.stdout: "last_pg_merge_meta": { 2023-08-01T19:54:38.854 INFO:teuthology.orchestra.run.smithi006.stdout: "source_pgid": "0.0", 2023-08-01T19:54:38.854 INFO:teuthology.orchestra.run.smithi006.stdout: "ready_epoch": 0, 2023-08-01T19:54:38.854 INFO:teuthology.orchestra.run.smithi006.stdout: "last_epoch_started": 0, 2023-08-01T19:54:38.854 INFO:teuthology.orchestra.run.smithi006.stdout: "last_epoch_clean": 0, 2023-08-01T19:54:38.855 INFO:teuthology.orchestra.run.smithi006.stdout: "source_version": "0'0", 2023-08-01T19:54:38.855 INFO:teuthology.orchestra.run.smithi006.stdout: "target_version": "0'0" 2023-08-01T19:54:38.855 INFO:teuthology.orchestra.run.smithi006.stdout: }, 2023-08-01T19:54:38.855 INFO:teuthology.orchestra.run.smithi006.stdout: "last_change": "17", 2023-08-01T19:54:38.855 INFO:teuthology.orchestra.run.smithi006.stdout: "last_force_op_resend": "0", 2023-08-01T19:54:38.855 INFO:teuthology.orchestra.run.smithi006.stdout: "last_force_op_resend_prenautilus": "0", 2023-08-01T19:54:38.855 INFO:teuthology.orchestra.run.smithi006.stdout: "last_force_op_resend_preluminous": "0", 2023-08-01T19:54:38.855 INFO:teuthology.orchestra.run.smithi006.stdout: "auid": 0, 2023-08-01T19:54:38.856 INFO:teuthology.orchestra.run.smithi006.stdout: "snap_mode": "selfmanaged", 2023-08-01T19:54:38.856 INFO:teuthology.orchestra.run.smithi006.stdout: "snap_seq": 0, 2023-08-01T19:54:38.856 INFO:teuthology.orchestra.run.smithi006.stdout: "snap_epoch": 0, 2023-08-01T19:54:38.856 INFO:teuthology.orchestra.run.smithi006.stdout: "pool_snaps": [], 2023-08-01T19:54:38.856 INFO:teuthology.orchestra.run.smithi006.stdout: "removed_snaps": "[]", 2023-08-01T19:54:38.856 INFO:teuthology.orchestra.run.smithi006.stdout: "quota_max_bytes": 0, 2023-08-01T19:54:38.856 INFO:teuthology.orchestra.run.smithi006.stdout: "quota_max_objects": 0, 2023-08-01T19:54:38.856 INFO:teuthology.orchestra.run.smithi006.stdout: "tiers": [], 2023-08-01T19:54:38.857 INFO:teuthology.orchestra.run.smithi006.stdout: "tier_of": -1, 2023-08-01T19:54:38.857 INFO:teuthology.orchestra.run.smithi006.stdout: "read_tier": -1, 2023-08-01T19:54:38.857 INFO:teuthology.orchestra.run.smithi006.stdout: "write_tier": -1, 2023-08-01T19:54:38.857 INFO:teuthology.orchestra.run.smithi006.stdout: "cache_mode": "none", 2023-08-01T19:54:38.857 INFO:teuthology.orchestra.run.smithi006.stdout: "target_max_bytes": 0, 2023-08-01T19:54:38.857 INFO:teuthology.orchestra.run.smithi006.stdout: "target_max_objects": 0, 2023-08-01T19:54:38.857 INFO:teuthology.orchestra.run.smithi006.stdout: "cache_target_dirty_ratio_micro": 400000, 2023-08-01T19:54:38.857 INFO:teuthology.orchestra.run.smithi006.stdout: "cache_target_dirty_high_ratio_micro": 600000, 2023-08-01T19:54:38.858 INFO:teuthology.orchestra.run.smithi006.stdout: "cache_target_full_ratio_micro": 800000, 2023-08-01T19:54:38.858 INFO:teuthology.orchestra.run.smithi006.stdout: "cache_min_flush_age": 0, 2023-08-01T19:54:38.858 INFO:teuthology.orchestra.run.smithi006.stdout: "cache_min_evict_age": 0, 2023-08-01T19:54:38.858 INFO:teuthology.orchestra.run.smithi006.stdout: "erasure_code_profile": "", 2023-08-01T19:54:38.858 INFO:teuthology.orchestra.run.smithi006.stdout: "hit_set_params": { 2023-08-01T19:54:38.858 INFO:teuthology.orchestra.run.smithi006.stdout: "type": "none" 2023-08-01T19:54:38.858 INFO:teuthology.orchestra.run.smithi006.stdout: }, 2023-08-01T19:54:38.858 INFO:teuthology.orchestra.run.smithi006.stdout: "hit_set_period": 0, 2023-08-01T19:54:38.859 INFO:teuthology.orchestra.run.smithi006.stdout: "hit_set_count": 0, 2023-08-01T19:54:38.859 INFO:teuthology.orchestra.run.smithi006.stdout: "use_gmt_hitset": true, 2023-08-01T19:54:38.859 INFO:teuthology.orchestra.run.smithi006.stdout: "min_read_recency_for_promote": 0, 2023-08-01T19:54:38.859 INFO:teuthology.orchestra.run.smithi006.stdout: "min_write_recency_for_promote": 0, 2023-08-01T19:54:38.859 INFO:teuthology.orchestra.run.smithi006.stdout: "hit_set_grade_decay_rate": 0, 2023-08-01T19:54:38.859 INFO:teuthology.orchestra.run.smithi006.stdout: "hit_set_search_last_n": 0, 2023-08-01T19:54:38.859 INFO:teuthology.orchestra.run.smithi006.stdout: "grade_table": [], 2023-08-01T19:54:38.859 INFO:teuthology.orchestra.run.smithi006.stdout: "stripe_width": 0, 2023-08-01T19:54:38.860 INFO:teuthology.orchestra.run.smithi006.stdout: "expected_num_objects": 0, 2023-08-01T19:54:38.860 INFO:teuthology.orchestra.run.smithi006.stdout: "fast_read": false, 2023-08-01T19:54:38.860 INFO:teuthology.orchestra.run.smithi006.stdout: "options": { 2023-08-01T19:54:38.860 INFO:teuthology.orchestra.run.smithi006.stdout: "pg_autoscale_bias": 4, 2023-08-01T19:54:38.860 INFO:teuthology.orchestra.run.smithi006.stdout: "pg_num_min": 16, 2023-08-01T19:54:38.860 INFO:teuthology.orchestra.run.smithi006.stdout: "recovery_priority": 5 2023-08-01T19:54:38.860 INFO:teuthology.orchestra.run.smithi006.stdout: }, 2023-08-01T19:54:38.860 INFO:teuthology.orchestra.run.smithi006.stdout: "application_metadata": { 2023-08-01T19:54:38.861 INFO:teuthology.orchestra.run.smithi006.stdout: "cephfs": { 2023-08-01T19:54:38.861 INFO:teuthology.orchestra.run.smithi006.stdout: "metadata": "cephfs" 2023-08-01T19:54:38.861 INFO:teuthology.orchestra.run.smithi006.stdout: } 2023-08-01T19:54:38.861 INFO:teuthology.orchestra.run.smithi006.stdout: } 2023-08-01T19:54:38.861 INFO:teuthology.orchestra.run.smithi006.stdout: }, 2023-08-01T19:54:38.861 INFO:teuthology.orchestra.run.smithi006.stdout: { 2023-08-01T19:54:38.861 INFO:teuthology.orchestra.run.smithi006.stdout: "pool": 4, 2023-08-01T19:54:38.862 INFO:teuthology.orchestra.run.smithi006.stdout: "pool_name": "cephfs_data", 2023-08-01T19:54:38.862 INFO:teuthology.orchestra.run.smithi006.stdout: "create_time": "2023-08-01T19:54:03.430277+0000", 2023-08-01T19:54:38.862 INFO:teuthology.orchestra.run.smithi006.stdout: "flags": 1, 2023-08-01T19:54:38.862 INFO:teuthology.orchestra.run.smithi006.stdout: "flags_names": "hashpspool", 2023-08-01T19:54:38.862 INFO:teuthology.orchestra.run.smithi006.stdout: "type": 1, 2023-08-01T19:54:38.862 INFO:teuthology.orchestra.run.smithi006.stdout: "size": 2, 2023-08-01T19:54:38.862 INFO:teuthology.orchestra.run.smithi006.stdout: "min_size": 1, 2023-08-01T19:54:38.862 INFO:teuthology.orchestra.run.smithi006.stdout: "crush_rule": 0, 2023-08-01T19:54:38.863 INFO:teuthology.orchestra.run.smithi006.stdout: "peering_crush_bucket_count": 0, 2023-08-01T19:54:38.863 INFO:teuthology.orchestra.run.smithi006.stdout: "peering_crush_bucket_target": 0, 2023-08-01T19:54:38.863 INFO:teuthology.orchestra.run.smithi006.stdout: "peering_crush_bucket_barrier": 0, 2023-08-01T19:54:38.863 INFO:teuthology.orchestra.run.smithi006.stdout: "peering_crush_bucket_mandatory_member": 2147483647, 2023-08-01T19:54:38.863 INFO:teuthology.orchestra.run.smithi006.stdout: "object_hash": 2, 2023-08-01T19:54:38.863 INFO:teuthology.orchestra.run.smithi006.stdout: "pg_autoscale_mode": "off", 2023-08-01T19:54:38.863 INFO:teuthology.orchestra.run.smithi006.stdout: "pg_num": 64, 2023-08-01T19:54:38.863 INFO:teuthology.orchestra.run.smithi006.stdout: "pg_placement_num": 64, 2023-08-01T19:54:38.864 INFO:teuthology.orchestra.run.smithi006.stdout: "pg_placement_num_target": 64, 2023-08-01T19:54:38.864 INFO:teuthology.orchestra.run.smithi006.stdout: "pg_num_target": 64, 2023-08-01T19:54:38.864 INFO:teuthology.orchestra.run.smithi006.stdout: "pg_num_pending": 64, 2023-08-01T19:54:38.864 INFO:teuthology.orchestra.run.smithi006.stdout: "last_pg_merge_meta": { 2023-08-01T19:54:38.864 INFO:teuthology.orchestra.run.smithi006.stdout: "source_pgid": "0.0", 2023-08-01T19:54:38.864 INFO:teuthology.orchestra.run.smithi006.stdout: "ready_epoch": 0, 2023-08-01T19:54:38.864 INFO:teuthology.orchestra.run.smithi006.stdout: "last_epoch_started": 0, 2023-08-01T19:54:38.864 INFO:teuthology.orchestra.run.smithi006.stdout: "last_epoch_clean": 0, 2023-08-01T19:54:38.865 INFO:teuthology.orchestra.run.smithi006.stdout: "source_version": "0'0", 2023-08-01T19:54:38.865 INFO:teuthology.orchestra.run.smithi006.stdout: "target_version": "0'0" 2023-08-01T19:54:38.865 INFO:teuthology.orchestra.run.smithi006.stdout: }, 2023-08-01T19:54:38.865 INFO:teuthology.orchestra.run.smithi006.stdout: "last_change": "18", 2023-08-01T19:54:38.865 INFO:teuthology.orchestra.run.smithi006.stdout: "last_force_op_resend": "0", 2023-08-01T19:54:38.865 INFO:teuthology.orchestra.run.smithi006.stdout: "last_force_op_resend_prenautilus": "0", 2023-08-01T19:54:38.865 INFO:teuthology.orchestra.run.smithi006.stdout: "last_force_op_resend_preluminous": "0", 2023-08-01T19:54:38.865 INFO:teuthology.orchestra.run.smithi006.stdout: "auid": 0, 2023-08-01T19:54:38.866 INFO:teuthology.orchestra.run.smithi006.stdout: "snap_mode": "selfmanaged", 2023-08-01T19:54:38.866 INFO:teuthology.orchestra.run.smithi006.stdout: "snap_seq": 0, 2023-08-01T19:54:38.866 INFO:teuthology.orchestra.run.smithi006.stdout: "snap_epoch": 0, 2023-08-01T19:54:38.866 INFO:teuthology.orchestra.run.smithi006.stdout: "pool_snaps": [], 2023-08-01T19:54:38.866 INFO:teuthology.orchestra.run.smithi006.stdout: "removed_snaps": "[]", 2023-08-01T19:54:38.866 INFO:teuthology.orchestra.run.smithi006.stdout: "quota_max_bytes": 0, 2023-08-01T19:54:38.866 INFO:teuthology.orchestra.run.smithi006.stdout: "quota_max_objects": 0, 2023-08-01T19:54:38.866 INFO:teuthology.orchestra.run.smithi006.stdout: "tiers": [], 2023-08-01T19:54:38.867 INFO:teuthology.orchestra.run.smithi006.stdout: "tier_of": -1, 2023-08-01T19:54:38.867 INFO:teuthology.orchestra.run.smithi006.stdout: "read_tier": -1, 2023-08-01T19:54:38.867 INFO:teuthology.orchestra.run.smithi006.stdout: "write_tier": -1, 2023-08-01T19:54:38.867 INFO:teuthology.orchestra.run.smithi006.stdout: "cache_mode": "none", 2023-08-01T19:54:38.867 INFO:teuthology.orchestra.run.smithi006.stdout: "target_max_bytes": 0, 2023-08-01T19:54:38.867 INFO:teuthology.orchestra.run.smithi006.stdout: "target_max_objects": 0, 2023-08-01T19:54:38.867 INFO:teuthology.orchestra.run.smithi006.stdout: "cache_target_dirty_ratio_micro": 400000, 2023-08-01T19:54:38.867 INFO:teuthology.orchestra.run.smithi006.stdout: "cache_target_dirty_high_ratio_micro": 600000, 2023-08-01T19:54:38.868 INFO:teuthology.orchestra.run.smithi006.stdout: "cache_target_full_ratio_micro": 800000, 2023-08-01T19:54:38.868 INFO:teuthology.orchestra.run.smithi006.stdout: "cache_min_flush_age": 0, 2023-08-01T19:54:38.868 INFO:teuthology.orchestra.run.smithi006.stdout: "cache_min_evict_age": 0, 2023-08-01T19:54:38.868 INFO:teuthology.orchestra.run.smithi006.stdout: "erasure_code_profile": "", 2023-08-01T19:54:38.868 INFO:teuthology.orchestra.run.smithi006.stdout: "hit_set_params": { 2023-08-01T19:54:38.868 INFO:teuthology.orchestra.run.smithi006.stdout: "type": "none" 2023-08-01T19:54:38.868 INFO:teuthology.orchestra.run.smithi006.stdout: }, 2023-08-01T19:54:38.869 INFO:teuthology.orchestra.run.smithi006.stdout: "hit_set_period": 0, 2023-08-01T19:54:38.869 INFO:teuthology.orchestra.run.smithi006.stdout: "hit_set_count": 0, 2023-08-01T19:54:38.869 INFO:teuthology.orchestra.run.smithi006.stdout: "use_gmt_hitset": true, 2023-08-01T19:54:38.869 INFO:teuthology.orchestra.run.smithi006.stdout: "min_read_recency_for_promote": 0, 2023-08-01T19:54:38.869 INFO:teuthology.orchestra.run.smithi006.stdout: "min_write_recency_for_promote": 0, 2023-08-01T19:54:38.869 INFO:teuthology.orchestra.run.smithi006.stdout: "hit_set_grade_decay_rate": 0, 2023-08-01T19:54:38.869 INFO:teuthology.orchestra.run.smithi006.stdout: "hit_set_search_last_n": 0, 2023-08-01T19:54:38.869 INFO:teuthology.orchestra.run.smithi006.stdout: "grade_table": [], 2023-08-01T19:54:38.870 INFO:teuthology.orchestra.run.smithi006.stdout: "stripe_width": 0, 2023-08-01T19:54:38.870 INFO:teuthology.orchestra.run.smithi006.stdout: "expected_num_objects": 0, 2023-08-01T19:54:38.870 INFO:teuthology.orchestra.run.smithi006.stdout: "fast_read": false, 2023-08-01T19:54:38.870 INFO:teuthology.orchestra.run.smithi006.stdout: "options": { 2023-08-01T19:54:38.870 INFO:teuthology.orchestra.run.smithi006.stdout: "pg_num_min": 64, 2023-08-01T19:54:38.870 INFO:teuthology.orchestra.run.smithi006.stdout: "target_size_ratio": 0.89999997615814209 2023-08-01T19:54:38.870 INFO:teuthology.orchestra.run.smithi006.stdout: }, 2023-08-01T19:54:38.870 INFO:teuthology.orchestra.run.smithi006.stdout: "application_metadata": { 2023-08-01T19:54:38.871 INFO:teuthology.orchestra.run.smithi006.stdout: "cephfs": { 2023-08-01T19:54:38.871 INFO:teuthology.orchestra.run.smithi006.stdout: "data": "cephfs" 2023-08-01T19:54:38.871 INFO:teuthology.orchestra.run.smithi006.stdout: } 2023-08-01T19:54:38.871 INFO:teuthology.orchestra.run.smithi006.stdout: } 2023-08-01T19:54:38.871 INFO:teuthology.orchestra.run.smithi006.stdout: }, 2023-08-01T19:54:38.871 INFO:teuthology.orchestra.run.smithi006.stdout: { 2023-08-01T19:54:38.871 INFO:teuthology.orchestra.run.smithi006.stdout: "pool": 5, 2023-08-01T19:54:38.871 INFO:teuthology.orchestra.run.smithi006.stdout: "pool_name": "unique_pool_0", 2023-08-01T19:54:38.872 INFO:teuthology.orchestra.run.smithi006.stdout: "create_time": "2023-08-01T19:54:21.165668+0000", 2023-08-01T19:54:38.872 INFO:teuthology.orchestra.run.smithi006.stdout: "flags": 1, 2023-08-01T19:54:38.872 INFO:teuthology.orchestra.run.smithi006.stdout: "flags_names": "hashpspool", 2023-08-01T19:54:38.872 INFO:teuthology.orchestra.run.smithi006.stdout: "type": 1, 2023-08-01T19:54:38.872 INFO:teuthology.orchestra.run.smithi006.stdout: "size": 2, 2023-08-01T19:54:38.872 INFO:teuthology.orchestra.run.smithi006.stdout: "min_size": 1, 2023-08-01T19:54:38.872 INFO:teuthology.orchestra.run.smithi006.stdout: "crush_rule": 0, 2023-08-01T19:54:38.872 INFO:teuthology.orchestra.run.smithi006.stdout: "peering_crush_bucket_count": 0, 2023-08-01T19:54:38.873 INFO:teuthology.orchestra.run.smithi006.stdout: "peering_crush_bucket_target": 0, 2023-08-01T19:54:38.873 INFO:teuthology.orchestra.run.smithi006.stdout: "peering_crush_bucket_barrier": 0, 2023-08-01T19:54:38.873 INFO:teuthology.orchestra.run.smithi006.stdout: "peering_crush_bucket_mandatory_member": 2147483647, 2023-08-01T19:54:38.873 INFO:teuthology.orchestra.run.smithi006.stdout: "object_hash": 2, 2023-08-01T19:54:38.873 INFO:teuthology.orchestra.run.smithi006.stdout: "pg_autoscale_mode": "off", 2023-08-01T19:54:38.873 INFO:teuthology.orchestra.run.smithi006.stdout: "pg_num": 16, 2023-08-01T19:54:38.873 INFO:teuthology.orchestra.run.smithi006.stdout: "pg_placement_num": 16, 2023-08-01T19:54:38.873 INFO:teuthology.orchestra.run.smithi006.stdout: "pg_placement_num_target": 16, 2023-08-01T19:54:38.874 INFO:teuthology.orchestra.run.smithi006.stdout: "pg_num_target": 16, 2023-08-01T19:54:38.874 INFO:teuthology.orchestra.run.smithi006.stdout: "pg_num_pending": 16, 2023-08-01T19:54:38.874 INFO:teuthology.orchestra.run.smithi006.stdout: "last_pg_merge_meta": { 2023-08-01T19:54:38.874 INFO:teuthology.orchestra.run.smithi006.stdout: "source_pgid": "0.0", 2023-08-01T19:54:38.874 INFO:teuthology.orchestra.run.smithi006.stdout: "ready_epoch": 0, 2023-08-01T19:54:38.874 INFO:teuthology.orchestra.run.smithi006.stdout: "last_epoch_started": 0, 2023-08-01T19:54:38.874 INFO:teuthology.orchestra.run.smithi006.stdout: "last_epoch_clean": 0, 2023-08-01T19:54:38.874 INFO:teuthology.orchestra.run.smithi006.stdout: "source_version": "0'0", 2023-08-01T19:54:38.875 INFO:teuthology.orchestra.run.smithi006.stdout: "target_version": "0'0" 2023-08-01T19:54:38.875 INFO:teuthology.orchestra.run.smithi006.stdout: }, 2023-08-01T19:54:38.875 INFO:teuthology.orchestra.run.smithi006.stdout: "last_change": "21", 2023-08-01T19:54:38.875 INFO:teuthology.orchestra.run.smithi006.stdout: "last_force_op_resend": "0", 2023-08-01T19:54:38.875 INFO:teuthology.orchestra.run.smithi006.stdout: "last_force_op_resend_prenautilus": "0", 2023-08-01T19:54:38.875 INFO:teuthology.orchestra.run.smithi006.stdout: "last_force_op_resend_preluminous": "0", 2023-08-01T19:54:38.875 INFO:teuthology.orchestra.run.smithi006.stdout: "auid": 0, 2023-08-01T19:54:38.875 INFO:teuthology.orchestra.run.smithi006.stdout: "snap_mode": "selfmanaged", 2023-08-01T19:54:38.876 INFO:teuthology.orchestra.run.smithi006.stdout: "snap_seq": 0, 2023-08-01T19:54:38.876 INFO:teuthology.orchestra.run.smithi006.stdout: "snap_epoch": 0, 2023-08-01T19:54:38.876 INFO:teuthology.orchestra.run.smithi006.stdout: "pool_snaps": [], 2023-08-01T19:54:38.876 INFO:teuthology.orchestra.run.smithi006.stdout: "removed_snaps": "[]", 2023-08-01T19:54:38.876 INFO:teuthology.orchestra.run.smithi006.stdout: "quota_max_bytes": 0, 2023-08-01T19:54:38.876 INFO:teuthology.orchestra.run.smithi006.stdout: "quota_max_objects": 0, 2023-08-01T19:54:38.876 INFO:teuthology.orchestra.run.smithi006.stdout: "tiers": [], 2023-08-01T19:54:38.877 INFO:teuthology.orchestra.run.smithi006.stdout: "tier_of": -1, 2023-08-01T19:54:38.877 INFO:teuthology.orchestra.run.smithi006.stdout: "read_tier": -1, 2023-08-01T19:54:38.877 INFO:teuthology.orchestra.run.smithi006.stdout: "write_tier": -1, 2023-08-01T19:54:38.877 INFO:teuthology.orchestra.run.smithi006.stdout: "cache_mode": "none", 2023-08-01T19:54:38.877 INFO:teuthology.orchestra.run.smithi006.stdout: "target_max_bytes": 0, 2023-08-01T19:54:38.877 INFO:teuthology.orchestra.run.smithi006.stdout: "target_max_objects": 0, 2023-08-01T19:54:38.877 INFO:teuthology.orchestra.run.smithi006.stdout: "cache_target_dirty_ratio_micro": 400000, 2023-08-01T19:54:38.877 INFO:teuthology.orchestra.run.smithi006.stdout: "cache_target_dirty_high_ratio_micro": 600000, 2023-08-01T19:54:38.878 INFO:teuthology.orchestra.run.smithi006.stdout: "cache_target_full_ratio_micro": 800000, 2023-08-01T19:54:38.878 INFO:teuthology.orchestra.run.smithi006.stdout: "cache_min_flush_age": 0, 2023-08-01T19:54:38.878 INFO:teuthology.orchestra.run.smithi006.stdout: "cache_min_evict_age": 0, 2023-08-01T19:54:38.878 INFO:teuthology.orchestra.run.smithi006.stdout: "erasure_code_profile": "", 2023-08-01T19:54:38.878 INFO:teuthology.orchestra.run.smithi006.stdout: "hit_set_params": { 2023-08-01T19:54:38.878 INFO:teuthology.orchestra.run.smithi006.stdout: "type": "none" 2023-08-01T19:54:38.878 INFO:teuthology.orchestra.run.smithi006.stdout: }, 2023-08-01T19:54:38.878 INFO:teuthology.orchestra.run.smithi006.stdout: "hit_set_period": 0, 2023-08-01T19:54:38.879 INFO:teuthology.orchestra.run.smithi006.stdout: "hit_set_count": 0, 2023-08-01T19:54:38.879 INFO:teuthology.orchestra.run.smithi006.stdout: "use_gmt_hitset": true, 2023-08-01T19:54:38.879 INFO:teuthology.orchestra.run.smithi006.stdout: "min_read_recency_for_promote": 0, 2023-08-01T19:54:38.879 INFO:teuthology.orchestra.run.smithi006.stdout: "min_write_recency_for_promote": 0, 2023-08-01T19:54:38.879 INFO:teuthology.orchestra.run.smithi006.stdout: "hit_set_grade_decay_rate": 0, 2023-08-01T19:54:38.879 INFO:teuthology.orchestra.run.smithi006.stdout: "hit_set_search_last_n": 0, 2023-08-01T19:54:38.879 INFO:teuthology.orchestra.run.smithi006.stdout: "grade_table": [], 2023-08-01T19:54:38.879 INFO:teuthology.orchestra.run.smithi006.stdout: "stripe_width": 0, 2023-08-01T19:54:38.880 INFO:teuthology.orchestra.run.smithi006.stdout: "expected_num_objects": 0, 2023-08-01T19:54:38.880 INFO:teuthology.orchestra.run.smithi006.stdout: "fast_read": false, 2023-08-01T19:54:38.880 INFO:teuthology.orchestra.run.smithi006.stdout: "options": {}, 2023-08-01T19:54:38.880 INFO:teuthology.orchestra.run.smithi006.stdout: "application_metadata": { 2023-08-01T19:54:38.880 INFO:teuthology.orchestra.run.smithi006.stdout: "rados": {} 2023-08-01T19:54:38.880 INFO:teuthology.orchestra.run.smithi006.stdout: } 2023-08-01T19:54:38.880 INFO:teuthology.orchestra.run.smithi006.stdout: } 2023-08-01T19:54:38.880 INFO:teuthology.orchestra.run.smithi006.stdout: ], 2023-08-01T19:54:38.881 INFO:teuthology.orchestra.run.smithi006.stdout: "osds": [ 2023-08-01T19:54:38.881 INFO:teuthology.orchestra.run.smithi006.stdout: { 2023-08-01T19:54:38.881 INFO:teuthology.orchestra.run.smithi006.stdout: "osd": 0, 2023-08-01T19:54:38.881 INFO:teuthology.orchestra.run.smithi006.stdout: "uuid": "5dd675c7-2777-48f2-8009-ff0e0d4c7086", 2023-08-01T19:54:38.881 INFO:teuthology.orchestra.run.smithi006.stdout: "up": 1, 2023-08-01T19:54:38.881 INFO:teuthology.orchestra.run.smithi006.stdout: "in": 1, 2023-08-01T19:54:38.881 INFO:teuthology.orchestra.run.smithi006.stdout: "weight": 1, 2023-08-01T19:54:38.881 INFO:teuthology.orchestra.run.smithi006.stdout: "primary_affinity": 1, 2023-08-01T19:54:38.882 INFO:teuthology.orchestra.run.smithi006.stdout: "last_clean_begin": 0, 2023-08-01T19:54:38.882 INFO:teuthology.orchestra.run.smithi006.stdout: "last_clean_end": 0, 2023-08-01T19:54:38.882 INFO:teuthology.orchestra.run.smithi006.stdout: "up_from": 8, 2023-08-01T19:54:38.882 INFO:teuthology.orchestra.run.smithi006.stdout: "up_thru": 19, 2023-08-01T19:54:38.882 INFO:teuthology.orchestra.run.smithi006.stdout: "down_at": 0, 2023-08-01T19:54:38.882 INFO:teuthology.orchestra.run.smithi006.stdout: "lost_at": 0, 2023-08-01T19:54:38.882 INFO:teuthology.orchestra.run.smithi006.stdout: "public_addrs": { 2023-08-01T19:54:38.882 INFO:teuthology.orchestra.run.smithi006.stdout: "addrvec": [ 2023-08-01T19:54:38.883 INFO:teuthology.orchestra.run.smithi006.stdout: { 2023-08-01T19:54:38.883 INFO:teuthology.orchestra.run.smithi006.stdout: "type": "v2", 2023-08-01T19:54:38.883 INFO:teuthology.orchestra.run.smithi006.stdout: "addr": "172.21.15.8:6800", 2023-08-01T19:54:38.883 INFO:teuthology.orchestra.run.smithi006.stdout: "nonce": 111181 2023-08-01T19:54:38.883 INFO:teuthology.orchestra.run.smithi006.stdout: }, 2023-08-01T19:54:38.883 INFO:teuthology.orchestra.run.smithi006.stdout: { 2023-08-01T19:54:38.883 INFO:teuthology.orchestra.run.smithi006.stdout: "type": "v1", 2023-08-01T19:54:38.883 INFO:teuthology.orchestra.run.smithi006.stdout: "addr": "172.21.15.8:6801", 2023-08-01T19:54:38.884 INFO:teuthology.orchestra.run.smithi006.stdout: "nonce": 111181 2023-08-01T19:54:38.884 INFO:teuthology.orchestra.run.smithi006.stdout: } 2023-08-01T19:54:38.884 INFO:teuthology.orchestra.run.smithi006.stdout: ] 2023-08-01T19:54:38.884 INFO:teuthology.orchestra.run.smithi006.stdout: }, 2023-08-01T19:54:38.884 INFO:teuthology.orchestra.run.smithi006.stdout: "cluster_addrs": { 2023-08-01T19:54:38.884 INFO:teuthology.orchestra.run.smithi006.stdout: "addrvec": [ 2023-08-01T19:54:38.884 INFO:teuthology.orchestra.run.smithi006.stdout: { 2023-08-01T19:54:38.885 INFO:teuthology.orchestra.run.smithi006.stdout: "type": "v2", 2023-08-01T19:54:38.885 INFO:teuthology.orchestra.run.smithi006.stdout: "addr": "172.21.15.8:6802", 2023-08-01T19:54:38.885 INFO:teuthology.orchestra.run.smithi006.stdout: "nonce": 111181 2023-08-01T19:54:38.885 INFO:teuthology.orchestra.run.smithi006.stdout: }, 2023-08-01T19:54:38.885 INFO:teuthology.orchestra.run.smithi006.stdout: { 2023-08-01T19:54:38.885 INFO:teuthology.orchestra.run.smithi006.stdout: "type": "v1", 2023-08-01T19:54:38.885 INFO:teuthology.orchestra.run.smithi006.stdout: "addr": "172.21.15.8:6803", 2023-08-01T19:54:38.885 INFO:teuthology.orchestra.run.smithi006.stdout: "nonce": 111181 2023-08-01T19:54:38.886 INFO:teuthology.orchestra.run.smithi006.stdout: } 2023-08-01T19:54:38.886 INFO:teuthology.orchestra.run.smithi006.stdout: ] 2023-08-01T19:54:38.886 INFO:teuthology.orchestra.run.smithi006.stdout: }, 2023-08-01T19:54:38.886 INFO:teuthology.orchestra.run.smithi006.stdout: "heartbeat_back_addrs": { 2023-08-01T19:54:38.886 INFO:teuthology.orchestra.run.smithi006.stdout: "addrvec": [ 2023-08-01T19:54:38.886 INFO:teuthology.orchestra.run.smithi006.stdout: { 2023-08-01T19:54:38.886 INFO:teuthology.orchestra.run.smithi006.stdout: "type": "v2", 2023-08-01T19:54:38.886 INFO:teuthology.orchestra.run.smithi006.stdout: "addr": "172.21.15.8:6806", 2023-08-01T19:54:38.887 INFO:teuthology.orchestra.run.smithi006.stdout: "nonce": 111181 2023-08-01T19:54:38.887 INFO:teuthology.orchestra.run.smithi006.stdout: }, 2023-08-01T19:54:38.887 INFO:teuthology.orchestra.run.smithi006.stdout: { 2023-08-01T19:54:38.887 INFO:teuthology.orchestra.run.smithi006.stdout: "type": "v1", 2023-08-01T19:54:38.887 INFO:teuthology.orchestra.run.smithi006.stdout: "addr": "172.21.15.8:6807", 2023-08-01T19:54:38.887 INFO:teuthology.orchestra.run.smithi006.stdout: "nonce": 111181 2023-08-01T19:54:38.887 INFO:teuthology.orchestra.run.smithi006.stdout: } 2023-08-01T19:54:38.887 INFO:teuthology.orchestra.run.smithi006.stdout: ] 2023-08-01T19:54:38.888 INFO:teuthology.orchestra.run.smithi006.stdout: }, 2023-08-01T19:54:38.888 INFO:teuthology.orchestra.run.smithi006.stdout: "heartbeat_front_addrs": { 2023-08-01T19:54:38.888 INFO:teuthology.orchestra.run.smithi006.stdout: "addrvec": [ 2023-08-01T19:54:38.888 INFO:teuthology.orchestra.run.smithi006.stdout: { 2023-08-01T19:54:38.888 INFO:teuthology.orchestra.run.smithi006.stdout: "type": "v2", 2023-08-01T19:54:38.888 INFO:teuthology.orchestra.run.smithi006.stdout: "addr": "172.21.15.8:6804", 2023-08-01T19:54:38.888 INFO:teuthology.orchestra.run.smithi006.stdout: "nonce": 111181 2023-08-01T19:54:38.888 INFO:teuthology.orchestra.run.smithi006.stdout: }, 2023-08-01T19:54:38.889 INFO:teuthology.orchestra.run.smithi006.stdout: { 2023-08-01T19:54:38.889 INFO:teuthology.orchestra.run.smithi006.stdout: "type": "v1", 2023-08-01T19:54:38.889 INFO:teuthology.orchestra.run.smithi006.stdout: "addr": "172.21.15.8:6805", 2023-08-01T19:54:38.889 INFO:teuthology.orchestra.run.smithi006.stdout: "nonce": 111181 2023-08-01T19:54:38.889 INFO:teuthology.orchestra.run.smithi006.stdout: } 2023-08-01T19:54:38.889 INFO:teuthology.orchestra.run.smithi006.stdout: ] 2023-08-01T19:54:38.889 INFO:teuthology.orchestra.run.smithi006.stdout: }, 2023-08-01T19:54:38.889 INFO:teuthology.orchestra.run.smithi006.stdout: "public_addr": "172.21.15.8:6801/111181", 2023-08-01T19:54:38.890 INFO:teuthology.orchestra.run.smithi006.stdout: "cluster_addr": "172.21.15.8:6803/111181", 2023-08-01T19:54:38.890 INFO:teuthology.orchestra.run.smithi006.stdout: "heartbeat_back_addr": "172.21.15.8:6807/111181", 2023-08-01T19:54:38.890 INFO:teuthology.orchestra.run.smithi006.stdout: "heartbeat_front_addr": "172.21.15.8:6805/111181", 2023-08-01T19:54:38.890 INFO:teuthology.orchestra.run.smithi006.stdout: "state": [ 2023-08-01T19:54:38.890 INFO:teuthology.orchestra.run.smithi006.stdout: "exists", 2023-08-01T19:54:38.890 INFO:teuthology.orchestra.run.smithi006.stdout: "up" 2023-08-01T19:54:38.890 INFO:teuthology.orchestra.run.smithi006.stdout: ] 2023-08-01T19:54:38.891 INFO:teuthology.orchestra.run.smithi006.stdout: }, 2023-08-01T19:54:38.891 INFO:teuthology.orchestra.run.smithi006.stdout: { 2023-08-01T19:54:38.891 INFO:teuthology.orchestra.run.smithi006.stdout: "osd": 1, 2023-08-01T19:54:38.891 INFO:teuthology.orchestra.run.smithi006.stdout: "uuid": "7fc612c4-33ba-4a33-bca8-1f42ee8ed548", 2023-08-01T19:54:38.891 INFO:teuthology.orchestra.run.smithi006.stdout: "up": 1, 2023-08-01T19:54:38.891 INFO:teuthology.orchestra.run.smithi006.stdout: "in": 1, 2023-08-01T19:54:38.891 INFO:teuthology.orchestra.run.smithi006.stdout: "weight": 1, 2023-08-01T19:54:38.891 INFO:teuthology.orchestra.run.smithi006.stdout: "primary_affinity": 1, 2023-08-01T19:54:38.892 INFO:teuthology.orchestra.run.smithi006.stdout: "last_clean_begin": 0, 2023-08-01T19:54:38.892 INFO:teuthology.orchestra.run.smithi006.stdout: "last_clean_end": 0, 2023-08-01T19:54:38.892 INFO:teuthology.orchestra.run.smithi006.stdout: "up_from": 8, 2023-08-01T19:54:38.892 INFO:teuthology.orchestra.run.smithi006.stdout: "up_thru": 19, 2023-08-01T19:54:38.892 INFO:teuthology.orchestra.run.smithi006.stdout: "down_at": 0, 2023-08-01T19:54:38.892 INFO:teuthology.orchestra.run.smithi006.stdout: "lost_at": 0, 2023-08-01T19:54:38.892 INFO:teuthology.orchestra.run.smithi006.stdout: "public_addrs": { 2023-08-01T19:54:38.892 INFO:teuthology.orchestra.run.smithi006.stdout: "addrvec": [ 2023-08-01T19:54:38.893 INFO:teuthology.orchestra.run.smithi006.stdout: { 2023-08-01T19:54:38.893 INFO:teuthology.orchestra.run.smithi006.stdout: "type": "v2", 2023-08-01T19:54:38.893 INFO:teuthology.orchestra.run.smithi006.stdout: "addr": "172.21.15.101:6800", 2023-08-01T19:54:38.893 INFO:teuthology.orchestra.run.smithi006.stdout: "nonce": 111143 2023-08-01T19:54:38.893 INFO:teuthology.orchestra.run.smithi006.stdout: }, 2023-08-01T19:54:38.893 INFO:teuthology.orchestra.run.smithi006.stdout: { 2023-08-01T19:54:38.893 INFO:teuthology.orchestra.run.smithi006.stdout: "type": "v1", 2023-08-01T19:54:38.893 INFO:teuthology.orchestra.run.smithi006.stdout: "addr": "172.21.15.101:6801", 2023-08-01T19:54:38.894 INFO:teuthology.orchestra.run.smithi006.stdout: "nonce": 111143 2023-08-01T19:54:38.894 INFO:teuthology.orchestra.run.smithi006.stdout: } 2023-08-01T19:54:38.894 INFO:teuthology.orchestra.run.smithi006.stdout: ] 2023-08-01T19:54:38.894 INFO:teuthology.orchestra.run.smithi006.stdout: }, 2023-08-01T19:54:38.894 INFO:teuthology.orchestra.run.smithi006.stdout: "cluster_addrs": { 2023-08-01T19:54:38.894 INFO:teuthology.orchestra.run.smithi006.stdout: "addrvec": [ 2023-08-01T19:54:38.894 INFO:teuthology.orchestra.run.smithi006.stdout: { 2023-08-01T19:54:38.894 INFO:teuthology.orchestra.run.smithi006.stdout: "type": "v2", 2023-08-01T19:54:38.895 INFO:teuthology.orchestra.run.smithi006.stdout: "addr": "172.21.15.101:6802", 2023-08-01T19:54:38.895 INFO:teuthology.orchestra.run.smithi006.stdout: "nonce": 111143 2023-08-01T19:54:38.895 INFO:teuthology.orchestra.run.smithi006.stdout: }, 2023-08-01T19:54:38.895 INFO:teuthology.orchestra.run.smithi006.stdout: { 2023-08-01T19:54:38.895 INFO:teuthology.orchestra.run.smithi006.stdout: "type": "v1", 2023-08-01T19:54:38.895 INFO:teuthology.orchestra.run.smithi006.stdout: "addr": "172.21.15.101:6803", 2023-08-01T19:54:38.895 INFO:teuthology.orchestra.run.smithi006.stdout: "nonce": 111143 2023-08-01T19:54:38.895 INFO:teuthology.orchestra.run.smithi006.stdout: } 2023-08-01T19:54:38.896 INFO:teuthology.orchestra.run.smithi006.stdout: ] 2023-08-01T19:54:38.896 INFO:teuthology.orchestra.run.smithi006.stdout: }, 2023-08-01T19:54:38.896 INFO:teuthology.orchestra.run.smithi006.stdout: "heartbeat_back_addrs": { 2023-08-01T19:54:38.896 INFO:teuthology.orchestra.run.smithi006.stdout: "addrvec": [ 2023-08-01T19:54:38.896 INFO:teuthology.orchestra.run.smithi006.stdout: { 2023-08-01T19:54:38.896 INFO:teuthology.orchestra.run.smithi006.stdout: "type": "v2", 2023-08-01T19:54:38.896 INFO:teuthology.orchestra.run.smithi006.stdout: "addr": "172.21.15.101:6806", 2023-08-01T19:54:38.897 INFO:teuthology.orchestra.run.smithi006.stdout: "nonce": 111143 2023-08-01T19:54:38.897 INFO:teuthology.orchestra.run.smithi006.stdout: }, 2023-08-01T19:54:38.897 INFO:teuthology.orchestra.run.smithi006.stdout: { 2023-08-01T19:54:38.897 INFO:teuthology.orchestra.run.smithi006.stdout: "type": "v1", 2023-08-01T19:54:38.897 INFO:teuthology.orchestra.run.smithi006.stdout: "addr": "172.21.15.101:6807", 2023-08-01T19:54:38.897 INFO:teuthology.orchestra.run.smithi006.stdout: "nonce": 111143 2023-08-01T19:54:38.897 INFO:teuthology.orchestra.run.smithi006.stdout: } 2023-08-01T19:54:38.897 INFO:teuthology.orchestra.run.smithi006.stdout: ] 2023-08-01T19:54:38.898 INFO:teuthology.orchestra.run.smithi006.stdout: }, 2023-08-01T19:54:38.898 INFO:teuthology.orchestra.run.smithi006.stdout: "heartbeat_front_addrs": { 2023-08-01T19:54:38.898 INFO:teuthology.orchestra.run.smithi006.stdout: "addrvec": [ 2023-08-01T19:54:38.898 INFO:teuthology.orchestra.run.smithi006.stdout: { 2023-08-01T19:54:38.898 INFO:teuthology.orchestra.run.smithi006.stdout: "type": "v2", 2023-08-01T19:54:38.898 INFO:teuthology.orchestra.run.smithi006.stdout: "addr": "172.21.15.101:6804", 2023-08-01T19:54:38.898 INFO:teuthology.orchestra.run.smithi006.stdout: "nonce": 111143 2023-08-01T19:54:38.898 INFO:teuthology.orchestra.run.smithi006.stdout: }, 2023-08-01T19:54:38.899 INFO:teuthology.orchestra.run.smithi006.stdout: { 2023-08-01T19:54:38.899 INFO:teuthology.orchestra.run.smithi006.stdout: "type": "v1", 2023-08-01T19:54:38.899 INFO:teuthology.orchestra.run.smithi006.stdout: "addr": "172.21.15.101:6805", 2023-08-01T19:54:38.899 INFO:teuthology.orchestra.run.smithi006.stdout: "nonce": 111143 2023-08-01T19:54:38.899 INFO:teuthology.orchestra.run.smithi006.stdout: } 2023-08-01T19:54:38.899 INFO:teuthology.orchestra.run.smithi006.stdout: ] 2023-08-01T19:54:38.899 INFO:teuthology.orchestra.run.smithi006.stdout: }, 2023-08-01T19:54:38.899 INFO:teuthology.orchestra.run.smithi006.stdout: "public_addr": "172.21.15.101:6801/111143", 2023-08-01T19:54:38.900 INFO:teuthology.orchestra.run.smithi006.stdout: "cluster_addr": "172.21.15.101:6803/111143", 2023-08-01T19:54:38.900 INFO:teuthology.orchestra.run.smithi006.stdout: "heartbeat_back_addr": "172.21.15.101:6807/111143", 2023-08-01T19:54:38.900 INFO:teuthology.orchestra.run.smithi006.stdout: "heartbeat_front_addr": "172.21.15.101:6805/111143", 2023-08-01T19:54:38.900 INFO:teuthology.orchestra.run.smithi006.stdout: "state": [ 2023-08-01T19:54:38.900 INFO:teuthology.orchestra.run.smithi006.stdout: "exists", 2023-08-01T19:54:38.900 INFO:teuthology.orchestra.run.smithi006.stdout: "up" 2023-08-01T19:54:38.900 INFO:teuthology.orchestra.run.smithi006.stdout: ] 2023-08-01T19:54:38.900 INFO:teuthology.orchestra.run.smithi006.stdout: }, 2023-08-01T19:54:38.901 INFO:teuthology.orchestra.run.smithi006.stdout: { 2023-08-01T19:54:38.901 INFO:teuthology.orchestra.run.smithi006.stdout: "osd": 2, 2023-08-01T19:54:38.901 INFO:teuthology.orchestra.run.smithi006.stdout: "uuid": "f85cadbc-4230-4772-8f39-62ed52e220b1", 2023-08-01T19:54:38.901 INFO:teuthology.orchestra.run.smithi006.stdout: "up": 1, 2023-08-01T19:54:38.901 INFO:teuthology.orchestra.run.smithi006.stdout: "in": 1, 2023-08-01T19:54:38.901 INFO:teuthology.orchestra.run.smithi006.stdout: "weight": 1, 2023-08-01T19:54:38.901 INFO:teuthology.orchestra.run.smithi006.stdout: "primary_affinity": 1, 2023-08-01T19:54:38.901 INFO:teuthology.orchestra.run.smithi006.stdout: "last_clean_begin": 0, 2023-08-01T19:54:38.902 INFO:teuthology.orchestra.run.smithi006.stdout: "last_clean_end": 0, 2023-08-01T19:54:38.902 INFO:teuthology.orchestra.run.smithi006.stdout: "up_from": 9, 2023-08-01T19:54:38.902 INFO:teuthology.orchestra.run.smithi006.stdout: "up_thru": 19, 2023-08-01T19:54:38.902 INFO:teuthology.orchestra.run.smithi006.stdout: "down_at": 0, 2023-08-01T19:54:38.902 INFO:teuthology.orchestra.run.smithi006.stdout: "lost_at": 0, 2023-08-01T19:54:38.902 INFO:teuthology.orchestra.run.smithi006.stdout: "public_addrs": { 2023-08-01T19:54:38.902 INFO:teuthology.orchestra.run.smithi006.stdout: "addrvec": [ 2023-08-01T19:54:38.902 INFO:teuthology.orchestra.run.smithi006.stdout: { 2023-08-01T19:54:38.903 INFO:teuthology.orchestra.run.smithi006.stdout: "type": "v2", 2023-08-01T19:54:38.903 INFO:teuthology.orchestra.run.smithi006.stdout: "addr": "172.21.15.155:6800", 2023-08-01T19:54:38.903 INFO:teuthology.orchestra.run.smithi006.stdout: "nonce": 111339 2023-08-01T19:54:38.903 INFO:teuthology.orchestra.run.smithi006.stdout: }, 2023-08-01T19:54:38.903 INFO:teuthology.orchestra.run.smithi006.stdout: { 2023-08-01T19:54:38.903 INFO:teuthology.orchestra.run.smithi006.stdout: "type": "v1", 2023-08-01T19:54:38.903 INFO:teuthology.orchestra.run.smithi006.stdout: "addr": "172.21.15.155:6801", 2023-08-01T19:54:38.903 INFO:teuthology.orchestra.run.smithi006.stdout: "nonce": 111339 2023-08-01T19:54:38.904 INFO:teuthology.orchestra.run.smithi006.stdout: } 2023-08-01T19:54:38.904 INFO:teuthology.orchestra.run.smithi006.stdout: ] 2023-08-01T19:54:38.904 INFO:teuthology.orchestra.run.smithi006.stdout: }, 2023-08-01T19:54:38.904 INFO:teuthology.orchestra.run.smithi006.stdout: "cluster_addrs": { 2023-08-01T19:54:38.904 INFO:teuthology.orchestra.run.smithi006.stdout: "addrvec": [ 2023-08-01T19:54:38.904 INFO:teuthology.orchestra.run.smithi006.stdout: { 2023-08-01T19:54:38.904 INFO:teuthology.orchestra.run.smithi006.stdout: "type": "v2", 2023-08-01T19:54:38.905 INFO:teuthology.orchestra.run.smithi006.stdout: "addr": "172.21.15.155:6802", 2023-08-01T19:54:38.905 INFO:teuthology.orchestra.run.smithi006.stdout: "nonce": 111339 2023-08-01T19:54:38.905 INFO:teuthology.orchestra.run.smithi006.stdout: }, 2023-08-01T19:54:38.905 INFO:teuthology.orchestra.run.smithi006.stdout: { 2023-08-01T19:54:38.905 INFO:teuthology.orchestra.run.smithi006.stdout: "type": "v1", 2023-08-01T19:54:38.905 INFO:teuthology.orchestra.run.smithi006.stdout: "addr": "172.21.15.155:6803", 2023-08-01T19:54:38.905 INFO:teuthology.orchestra.run.smithi006.stdout: "nonce": 111339 2023-08-01T19:54:38.905 INFO:teuthology.orchestra.run.smithi006.stdout: } 2023-08-01T19:54:38.906 INFO:teuthology.orchestra.run.smithi006.stdout: ] 2023-08-01T19:54:38.906 INFO:teuthology.orchestra.run.smithi006.stdout: }, 2023-08-01T19:54:38.906 INFO:teuthology.orchestra.run.smithi006.stdout: "heartbeat_back_addrs": { 2023-08-01T19:54:38.906 INFO:teuthology.orchestra.run.smithi006.stdout: "addrvec": [ 2023-08-01T19:54:38.906 INFO:teuthology.orchestra.run.smithi006.stdout: { 2023-08-01T19:54:38.906 INFO:teuthology.orchestra.run.smithi006.stdout: "type": "v2", 2023-08-01T19:54:38.906 INFO:teuthology.orchestra.run.smithi006.stdout: "addr": "172.21.15.155:6806", 2023-08-01T19:54:38.906 INFO:teuthology.orchestra.run.smithi006.stdout: "nonce": 111339 2023-08-01T19:54:38.907 INFO:teuthology.orchestra.run.smithi006.stdout: }, 2023-08-01T19:54:38.907 INFO:teuthology.orchestra.run.smithi006.stdout: { 2023-08-01T19:54:38.907 INFO:teuthology.orchestra.run.smithi006.stdout: "type": "v1", 2023-08-01T19:54:38.907 INFO:teuthology.orchestra.run.smithi006.stdout: "addr": "172.21.15.155:6807", 2023-08-01T19:54:38.907 INFO:teuthology.orchestra.run.smithi006.stdout: "nonce": 111339 2023-08-01T19:54:38.907 INFO:teuthology.orchestra.run.smithi006.stdout: } 2023-08-01T19:54:38.907 INFO:teuthology.orchestra.run.smithi006.stdout: ] 2023-08-01T19:54:38.907 INFO:teuthology.orchestra.run.smithi006.stdout: }, 2023-08-01T19:54:38.908 INFO:teuthology.orchestra.run.smithi006.stdout: "heartbeat_front_addrs": { 2023-08-01T19:54:38.908 INFO:teuthology.orchestra.run.smithi006.stdout: "addrvec": [ 2023-08-01T19:54:38.908 INFO:teuthology.orchestra.run.smithi006.stdout: { 2023-08-01T19:54:38.908 INFO:teuthology.orchestra.run.smithi006.stdout: "type": "v2", 2023-08-01T19:54:38.908 INFO:teuthology.orchestra.run.smithi006.stdout: "addr": "172.21.15.155:6804", 2023-08-01T19:54:38.908 INFO:teuthology.orchestra.run.smithi006.stdout: "nonce": 111339 2023-08-01T19:54:38.908 INFO:teuthology.orchestra.run.smithi006.stdout: }, 2023-08-01T19:54:38.908 INFO:teuthology.orchestra.run.smithi006.stdout: { 2023-08-01T19:54:38.909 INFO:teuthology.orchestra.run.smithi006.stdout: "type": "v1", 2023-08-01T19:54:38.909 INFO:teuthology.orchestra.run.smithi006.stdout: "addr": "172.21.15.155:6805", 2023-08-01T19:54:38.909 INFO:teuthology.orchestra.run.smithi006.stdout: "nonce": 111339 2023-08-01T19:54:38.909 INFO:teuthology.orchestra.run.smithi006.stdout: } 2023-08-01T19:54:38.909 INFO:teuthology.orchestra.run.smithi006.stdout: ] 2023-08-01T19:54:38.909 INFO:teuthology.orchestra.run.smithi006.stdout: }, 2023-08-01T19:54:38.909 INFO:teuthology.orchestra.run.smithi006.stdout: "public_addr": "172.21.15.155:6801/111339", 2023-08-01T19:54:38.909 INFO:teuthology.orchestra.run.smithi006.stdout: "cluster_addr": "172.21.15.155:6803/111339", 2023-08-01T19:54:38.910 INFO:teuthology.orchestra.run.smithi006.stdout: "heartbeat_back_addr": "172.21.15.155:6807/111339", 2023-08-01T19:54:38.910 INFO:teuthology.orchestra.run.smithi006.stdout: "heartbeat_front_addr": "172.21.15.155:6805/111339", 2023-08-01T19:54:38.910 INFO:teuthology.orchestra.run.smithi006.stdout: "state": [ 2023-08-01T19:54:38.910 INFO:teuthology.orchestra.run.smithi006.stdout: "exists", 2023-08-01T19:54:38.910 INFO:teuthology.orchestra.run.smithi006.stdout: "up" 2023-08-01T19:54:38.910 INFO:teuthology.orchestra.run.smithi006.stdout: ] 2023-08-01T19:54:38.910 INFO:teuthology.orchestra.run.smithi006.stdout: } 2023-08-01T19:54:38.910 INFO:teuthology.orchestra.run.smithi006.stdout: ], 2023-08-01T19:54:38.911 INFO:teuthology.orchestra.run.smithi006.stdout: "osd_xinfo": [ 2023-08-01T19:54:38.911 INFO:teuthology.orchestra.run.smithi006.stdout: { 2023-08-01T19:54:38.911 INFO:teuthology.orchestra.run.smithi006.stdout: "osd": 0, 2023-08-01T19:54:38.911 INFO:teuthology.orchestra.run.smithi006.stdout: "down_stamp": "0.000000", 2023-08-01T19:54:38.911 INFO:teuthology.orchestra.run.smithi006.stdout: "laggy_probability": 0, 2023-08-01T19:54:38.911 INFO:teuthology.orchestra.run.smithi006.stdout: "laggy_interval": 0, 2023-08-01T19:54:38.911 INFO:teuthology.orchestra.run.smithi006.stdout: "features": 4540138320759226367, 2023-08-01T19:54:38.911 INFO:teuthology.orchestra.run.smithi006.stdout: "old_weight": 0, 2023-08-01T19:54:38.912 INFO:teuthology.orchestra.run.smithi006.stdout: "last_purged_snaps_scrub": "2023-08-01T19:53:48.018154+0000", 2023-08-01T19:54:38.912 INFO:teuthology.orchestra.run.smithi006.stdout: "dead_epoch": 0 2023-08-01T19:54:38.912 INFO:teuthology.orchestra.run.smithi006.stdout: }, 2023-08-01T19:54:38.912 INFO:teuthology.orchestra.run.smithi006.stdout: { 2023-08-01T19:54:38.912 INFO:teuthology.orchestra.run.smithi006.stdout: "osd": 1, 2023-08-01T19:54:38.912 INFO:teuthology.orchestra.run.smithi006.stdout: "down_stamp": "0.000000", 2023-08-01T19:54:38.912 INFO:teuthology.orchestra.run.smithi006.stdout: "laggy_probability": 0, 2023-08-01T19:54:38.913 INFO:teuthology.orchestra.run.smithi006.stdout: "laggy_interval": 0, 2023-08-01T19:54:38.913 INFO:teuthology.orchestra.run.smithi006.stdout: "features": 4540138320759226367, 2023-08-01T19:54:38.913 INFO:teuthology.orchestra.run.smithi006.stdout: "old_weight": 0, 2023-08-01T19:54:38.913 INFO:teuthology.orchestra.run.smithi006.stdout: "last_purged_snaps_scrub": "2023-08-01T19:53:48.000488+0000", 2023-08-01T19:54:38.913 INFO:teuthology.orchestra.run.smithi006.stdout: "dead_epoch": 0 2023-08-01T19:54:38.913 INFO:teuthology.orchestra.run.smithi006.stdout: }, 2023-08-01T19:54:38.913 INFO:teuthology.orchestra.run.smithi006.stdout: { 2023-08-01T19:54:38.913 INFO:teuthology.orchestra.run.smithi006.stdout: "osd": 2, 2023-08-01T19:54:38.914 INFO:teuthology.orchestra.run.smithi006.stdout: "down_stamp": "0.000000", 2023-08-01T19:54:38.914 INFO:teuthology.orchestra.run.smithi006.stdout: "laggy_probability": 0, 2023-08-01T19:54:38.914 INFO:teuthology.orchestra.run.smithi006.stdout: "laggy_interval": 0, 2023-08-01T19:54:38.914 INFO:teuthology.orchestra.run.smithi006.stdout: "features": 4540138320759226367, 2023-08-01T19:54:38.914 INFO:teuthology.orchestra.run.smithi006.stdout: "old_weight": 0, 2023-08-01T19:54:38.914 INFO:teuthology.orchestra.run.smithi006.stdout: "last_purged_snaps_scrub": "2023-08-01T19:53:48.072529+0000", 2023-08-01T19:54:38.914 INFO:teuthology.orchestra.run.smithi006.stdout: "dead_epoch": 0 2023-08-01T19:54:38.914 INFO:teuthology.orchestra.run.smithi006.stdout: } 2023-08-01T19:54:38.915 INFO:teuthology.orchestra.run.smithi006.stdout: ], 2023-08-01T19:54:38.915 INFO:teuthology.orchestra.run.smithi006.stdout: "pg_upmap": [], 2023-08-01T19:54:38.915 INFO:teuthology.orchestra.run.smithi006.stdout: "pg_upmap_items": [], 2023-08-01T19:54:38.915 INFO:teuthology.orchestra.run.smithi006.stdout: "pg_temp": [], 2023-08-01T19:54:38.915 INFO:teuthology.orchestra.run.smithi006.stdout: "primary_temp": [], 2023-08-01T19:54:38.915 INFO:teuthology.orchestra.run.smithi006.stdout: "blocklist": {}, 2023-08-01T19:54:38.915 INFO:teuthology.orchestra.run.smithi006.stdout: "range_blocklist": {}, 2023-08-01T19:54:38.915 INFO:teuthology.orchestra.run.smithi006.stdout: "erasure_code_profiles": { 2023-08-01T19:54:38.916 INFO:teuthology.orchestra.run.smithi006.stdout: "default": { 2023-08-01T19:54:38.916 INFO:teuthology.orchestra.run.smithi006.stdout: "crush-failure-domain": "osd", 2023-08-01T19:54:38.916 INFO:teuthology.orchestra.run.smithi006.stdout: "k": "2", 2023-08-01T19:54:38.916 INFO:teuthology.orchestra.run.smithi006.stdout: "m": "1", 2023-08-01T19:54:38.916 INFO:teuthology.orchestra.run.smithi006.stdout: "plugin": "jerasure", 2023-08-01T19:54:38.916 INFO:teuthology.orchestra.run.smithi006.stdout: "technique": "reed_sol_van" 2023-08-01T19:54:38.916 INFO:teuthology.orchestra.run.smithi006.stdout: } 2023-08-01T19:54:38.916 INFO:teuthology.orchestra.run.smithi006.stdout: }, 2023-08-01T19:54:38.917 INFO:teuthology.orchestra.run.smithi006.stdout: "removed_snaps_queue": [], 2023-08-01T19:54:38.917 INFO:teuthology.orchestra.run.smithi006.stdout: "new_removed_snaps": [], 2023-08-01T19:54:38.917 INFO:teuthology.orchestra.run.smithi006.stdout: "new_purged_snaps": [], 2023-08-01T19:54:38.917 INFO:teuthology.orchestra.run.smithi006.stdout: "crush_node_flags": {}, 2023-08-01T19:54:38.917 INFO:teuthology.orchestra.run.smithi006.stdout: "device_class_flags": {}, 2023-08-01T19:54:38.917 INFO:teuthology.orchestra.run.smithi006.stdout: "stretch_mode": { 2023-08-01T19:54:38.917 INFO:teuthology.orchestra.run.smithi006.stdout: "stretch_mode_enabled": false, 2023-08-01T19:54:38.917 INFO:teuthology.orchestra.run.smithi006.stdout: "stretch_bucket_count": 0, 2023-08-01T19:54:38.918 INFO:teuthology.orchestra.run.smithi006.stdout: "degraded_stretch_mode": 0, 2023-08-01T19:54:38.918 INFO:teuthology.orchestra.run.smithi006.stdout: "recovering_stretch_mode": 0, 2023-08-01T19:54:38.918 INFO:teuthology.orchestra.run.smithi006.stdout: "stretch_mode_bucket": 0 2023-08-01T19:54:38.918 INFO:teuthology.orchestra.run.smithi006.stdout: } 2023-08-01T19:54:38.918 INFO:teuthology.orchestra.run.smithi006.stdout:} 2023-08-01T19:54:38.919 INFO:teuthology.orchestra.run.smithi155.stdout:ERROR: (22) Invalid argument 2023-08-01T19:54:38.919 INFO:teuthology.orchestra.run.smithi155.stdout:op_tracker tracking is not enabled now, so no ops are tracked currently, even those get stuck. Please enable "osd_enable_op_tracker", and the tracker will start to track new ops received afterwards. 2023-08-01T19:54:38.919 INFO:teuthology.orchestra.run.smithi006.stdout:osd.1: {} 2023-08-01T19:54:38.920 INFO:tasks.ceph.osd.1.smithi101.stderr:2023-08-01T19:54:38.918+0000 7fb0cb7f6700 -1 received signal: Hangup from /usr/bin/python3 /bin/daemon-helper kill ceph-osd -f --cluster ceph -i 1 (PID: 111141) UID: 0 2023-08-01T19:54:38.921 INFO:tasks.thrashosds.thrasher:j is {'epoch': 26, 'fsid': 'a0e420cc-4df1-42a5-8bd4-a98c309a9349', 'created': '2023-08-01T19:53:41.279588+0000', 'modified': '2023-08-01T19:54:37.167406+0000', 'last_up_change': '2023-08-01T19:53:50.735626+0000', 'last_in_change': '2023-08-01T19:53:42.974751+0000', 'flags': 'noscrub,nodeep-scrub,sortbitwise,recovery_deletes,purged_snapdirs,pglog_hardlimit', 'flags_num': 5806080, 'flags_set': ['nodeep-scrub', 'noscrub', 'pglog_hardlimit', 'purged_snapdirs', 'recovery_deletes', 'sortbitwise'], 'crush_version': 5, 'full_ratio': 0.949999988079071, 'backfillfull_ratio': 0.8999999761581421, 'nearfull_ratio': 0.8500000238418579, 'cluster_snapshot': '', 'pool_max': 5, 'max_osd': 3, 'require_min_compat_client': 'luminous', 'min_compat_client': 'jewel', 'require_osd_release': 'quincy', 'pools': [{'pool': 1, 'pool_name': '.mgr', 'create_time': '2023-08-01T19:53:49.961944+0000', 'flags': 1, 'flags_names': 'hashpspool', 'type': 1, 'size': 2, 'min_size': 1, 'crush_rule': 0, 'peering_crush_bucket_count': 0, 'peering_crush_bucket_target': 0, 'peering_crush_bucket_barrier': 0, 'peering_crush_bucket_mandatory_member': 2147483647, 'object_hash': 2, 'pg_autoscale_mode': 'off', 'pg_num': 1, 'pg_placement_num': 1, 'pg_placement_num_target': 1, 'pg_num_target': 1, 'pg_num_pending': 1, 'last_pg_merge_meta': {'source_pgid': '0.0', 'ready_epoch': 0, 'last_epoch_started': 0, 'last_epoch_clean': 0, 'source_version': "0'0", 'target_version': "0'0"}, 'last_change': '11', 'last_force_op_resend': '0', 'last_force_op_resend_prenautilus': '0', 'last_force_op_resend_preluminous': '0', 'auid': 0, 'snap_mode': 'selfmanaged', 'snap_seq': 0, 'snap_epoch': 0, 'pool_snaps': [], 'removed_snaps': '[]', 'quota_max_bytes': 0, 'quota_max_objects': 0, 'tiers': [], 'tier_of': -1, 'read_tier': -1, 'write_tier': -1, 'cache_mode': 'none', 'target_max_bytes': 0, 'target_max_objects': 0, 'cache_target_dirty_ratio_micro': 400000, 'cache_target_dirty_high_ratio_micro': 600000, 'cache_target_full_ratio_micro': 800000, 'cache_min_flush_age': 0, 'cache_min_evict_age': 0, 'erasure_code_profile': '', 'hit_set_params': {'type': 'none'}, 'hit_set_period': 0, 'hit_set_count': 0, 'use_gmt_hitset': True, 'min_read_recency_for_promote': 0, 'min_write_recency_for_promote': 0, 'hit_set_grade_decay_rate': 0, 'hit_set_search_last_n': 0, 'grade_table': [], 'stripe_width': 0, 'expected_num_objects': 0, 'fast_read': False, 'options': {'pg_num_max': 32, 'pg_num_min': 1}, 'application_metadata': {'mgr': {}}}, {'pool': 2, 'pool_name': 'rbd', 'create_time': '2023-08-01T19:53:57.404091+0000', 'flags': 1, 'flags_names': 'hashpspool', 'type': 1, 'size': 2, 'min_size': 1, 'crush_rule': 0, 'peering_crush_bucket_count': 0, 'peering_crush_bucket_target': 0, 'peering_crush_bucket_barrier': 0, 'peering_crush_bucket_mandatory_member': 2147483647, 'object_hash': 2, 'pg_autoscale_mode': 'off', 'pg_num': 8, 'pg_placement_num': 8, 'pg_placement_num_target': 8, 'pg_num_target': 8, 'pg_num_pending': 8, 'last_pg_merge_meta': {'source_pgid': '0.0', 'ready_epoch': 0, 'last_epoch_started': 0, 'last_epoch_clean': 0, 'source_version': "0'0", 'target_version': "0'0"}, 'last_change': '14', 'last_force_op_resend': '0', 'last_force_op_resend_prenautilus': '0', 'last_force_op_resend_preluminous': '0', 'auid': 0, 'snap_mode': 'selfmanaged', 'snap_seq': 0, 'snap_epoch': 0, 'pool_snaps': [], 'removed_snaps': '[]', 'quota_max_bytes': 0, 'quota_max_objects': 0, 'tiers': [], 'tier_of': -1, 'read_tier': -1, 'write_tier': -1, 'cache_mode': 'none', 'target_max_bytes': 0, 'target_max_objects': 0, 'cache_target_dirty_ratio_micro': 400000, 'cache_target_dirty_high_ratio_micro': 600000, 'cache_target_full_ratio_micro': 800000, 'cache_min_flush_age': 0, 'cache_min_evict_age': 0, 'erasure_code_profile': '', 'hit_set_params': {'type': 'none'}, 'hit_set_period': 0, 'hit_set_count': 0, 'use_gmt_hitset': True, 'min_read_recency_for_promote': 0, 'min_write_recency_for_promote': 0, 'hit_set_grade_decay_rate': 0, 'hit_set_search_last_n': 0, 'grade_table': [], 'stripe_width': 0, 'expected_num_objects': 0, 'fast_read': False, 'options': {}, 'application_metadata': {'rbd': {}}}, {'pool': 3, 'pool_name': 'cephfs_metadata', 'create_time': '2023-08-01T19:54:02.111247+0000', 'flags': 1, 'flags_names': 'hashpspool', 'type': 1, 'size': 2, 'min_size': 1, 'crush_rule': 0, 'peering_crush_bucket_count': 0, 'peering_crush_bucket_target': 0, 'peering_crush_bucket_barrier': 0, 'peering_crush_bucket_mandatory_member': 2147483647, 'object_hash': 2, 'pg_autoscale_mode': 'off', 'pg_num': 32, 'pg_placement_num': 32, 'pg_placement_num_target': 32, 'pg_num_target': 32, 'pg_num_pending': 32, 'last_pg_merge_meta': {'source_pgid': '0.0', 'ready_epoch': 0, 'last_epoch_started': 0, 'last_epoch_clean': 0, 'source_version': "0'0", 'target_version': "0'0"}, 'last_change': '17', 'last_force_op_resend': '0', 'last_force_op_resend_prenautilus': '0', 'last_force_op_resend_preluminous': '0', 'auid': 0, 'snap_mode': 'selfmanaged', 'snap_seq': 0, 'snap_epoch': 0, 'pool_snaps': [], 'removed_snaps': '[]', 'quota_max_bytes': 0, 'quota_max_objects': 0, 'tiers': [], 'tier_of': -1, 'read_tier': -1, 'write_tier': -1, 'cache_mode': 'none', 'target_max_bytes': 0, 'target_max_objects': 0, 'cache_target_dirty_ratio_micro': 400000, 'cache_target_dirty_high_ratio_micro': 600000, 'cache_target_full_ratio_micro': 800000, 'cache_min_flush_age': 0, 'cache_min_evict_age': 0, 'erasure_code_profile': '', 'hit_set_params': {'type': 'none'}, 'hit_set_period': 0, 'hit_set_count': 0, 'use_gmt_hitset': True, 'min_read_recency_for_promote': 0, 'min_write_recency_for_promote': 0, 'hit_set_grade_decay_rate': 0, 'hit_set_search_last_n': 0, 'grade_table': [], 'stripe_width': 0, 'expected_num_objects': 0, 'fast_read': False, 'options': {'pg_autoscale_bias': 4, 'pg_num_min': 16, 'recovery_priority': 5}, 'application_metadata': {'cephfs': {'metadata': 'cephfs'}}}, {'pool': 4, 'pool_name': 'cephfs_data', 'create_time': '2023-08-01T19:54:03.430277+0000', 'flags': 1, 'flags_names': 'hashpspool', 'type': 1, 'size': 2, 'min_size': 1, 'crush_rule': 0, 'peering_crush_bucket_count': 0, 'peering_crush_bucket_target': 0, 'peering_crush_bucket_barrier': 0, 'peering_crush_bucket_mandatory_member': 2147483647, 'object_hash': 2, 'pg_autoscale_mode': 'off', 'pg_num': 64, 'pg_placement_num': 64, 'pg_placement_num_target': 64, 'pg_num_target': 64, 'pg_num_pending': 64, 'last_pg_merge_meta': {'source_pgid': '0.0', 'ready_epoch': 0, 'last_epoch_started': 0, 'last_epoch_clean': 0, 'source_version': "0'0", 'target_version': "0'0"}, 'last_change': '18', 'last_force_op_resend': '0', 'last_force_op_resend_prenautilus': '0', 'last_force_op_resend_preluminous': '0', 'auid': 0, 'snap_mode': 'selfmanaged', 'snap_seq': 0, 'snap_epoch': 0, 'pool_snaps': [], 'removed_snaps': '[]', 'quota_max_bytes': 0, 'quota_max_objects': 0, 'tiers': [], 'tier_of': -1, 'read_tier': -1, 'write_tier': -1, 'cache_mode': 'none', 'target_max_bytes': 0, 'target_max_objects': 0, 'cache_target_dirty_ratio_micro': 400000, 'cache_target_dirty_high_ratio_micro': 600000, 'cache_target_full_ratio_micro': 800000, 'cache_min_flush_age': 0, 'cache_min_evict_age': 0, 'erasure_code_profile': '', 'hit_set_params': {'type': 'none'}, 'hit_set_period': 0, 'hit_set_count': 0, 'use_gmt_hitset': True, 'min_read_recency_for_promote': 0, 'min_write_recency_for_promote': 0, 'hit_set_grade_decay_rate': 0, 'hit_set_search_last_n': 0, 'grade_table': [], 'stripe_width': 0, 'expected_num_objects': 0, 'fast_read': False, 'options': {'pg_num_min': 64, 'target_size_ratio': 0.8999999761581421}, 'application_metadata': {'cephfs': {'data': 'cephfs'}}}, {'pool': 5, 'pool_name': 'unique_pool_0', 'create_time': '2023-08-01T19:54:21.165668+0000', 'flags': 1, 'flags_names': 'hashpspool', 'type': 1, 'size': 2, 'min_size': 1, 'crush_rule': 0, 'peering_crush_bucket_count': 0, 'peering_crush_bucket_target': 0, 'peering_crush_bucket_barrier': 0, 'peering_crush_bucket_mandatory_member': 2147483647, 'object_hash': 2, 'pg_autoscale_mode': 'off', 'pg_num': 16, 'pg_placement_num': 16, 'pg_placement_num_target': 16, 'pg_num_target': 16, 'pg_num_pending': 16, 'last_pg_merge_meta': {'source_pgid': '0.0', 'ready_epoch': 0, 'last_epoch_started': 0, 'last_epoch_clean': 0, 'source_version': "0'0", 'target_version': "0'0"}, 'last_change': '21', 'last_force_op_resend': '0', 'last_force_op_resend_prenautilus': '0', 'last_force_op_resend_preluminous': '0', 'auid': 0, 'snap_mode': 'selfmanaged', 'snap_seq': 0, 'snap_epoch': 0, 'pool_snaps': [], 'removed_snaps': '[]', 'quota_max_bytes': 0, 'quota_max_objects': 0, 'tiers': [], 'tier_of': -1, 'read_tier': -1, 'write_tier': -1, 'cache_mode': 'none', 'target_max_bytes': 0, 'target_max_objects': 0, 'cache_target_dirty_ratio_micro': 400000, 'cache_target_dirty_high_ratio_micro': 600000, 'cache_target_full_ratio_micro': 800000, 'cache_min_flush_age': 0, 'cache_min_evict_age': 0, 'erasure_code_profile': '', 'hit_set_params': {'type': 'none'}, 'hit_set_period': 0, 'hit_set_count': 0, 'use_gmt_hitset': True, 'min_read_recency_for_promote': 0, 'min_write_recency_for_promote': 0, 'hit_set_grade_decay_rate': 0, 'hit_set_search_last_n': 0, 'grade_table': [], 'stripe_width': 0, 'expected_num_objects': 0, 'fast_read': False, 'options': {}, 'application_metadata': {'rados': {}}}], 'osds': [{'osd': 0, 'uuid': '5dd675c7-2777-48f2-8009-ff0e0d4c7086', 'up': 1, 'in': 1, 'weight': 1, 'primary_affinity': 1, 'last_clean_begin': 0, 'last_clean_end': 0, 'up_from': 8, 'up_thru': 19, 'down_at': 0, 'lost_at': 0, 'public_addrs': {'addrvec': [{'type': 'v2', 'addr': '172.21.15.8:6800', 'nonce': 111181}, {'type': 'v1', 'addr': '172.21.15.8:6801', 'nonce': 111181}]}, 'cluster_addrs': {'addrvec': [{'type': 'v2', 'addr': '172.21.15.8:6802', 'nonce': 111181}, {'type': 'v1', 'addr': '172.21.15.8:6803', 'nonce': 111181}]}, 'heartbeat_back_addrs': {'addrvec': [{'type': 'v2', 'addr': '172.21.15.8:6806', 'nonce': 111181}, {'type': 'v1', 'addr': '172.21.15.8:6807', 'nonce': 111181}]}, 'heartbeat_front_addrs': {'addrvec': [{'type': 'v2', 'addr': '172.21.15.8:6804', 'nonce': 111181}, {'type': 'v1', 'addr': '172.21.15.8:6805', 'nonce': 111181}]}, 'public_addr': '172.21.15.8:6801/111181', 'cluster_addr': '172.21.15.8:6803/111181', 'heartbeat_back_addr': '172.21.15.8:6807/111181', 'heartbeat_front_addr': '172.21.15.8:6805/111181', 'state': ['exists', 'up']}, {'osd': 1, 'uuid': '7fc612c4-33ba-4a33-bca8-1f42ee8ed548', 'up': 1, 'in': 1, 'weight': 1, 'primary_affinity': 1, 'last_clean_begin': 0, 'last_clean_end': 0, 'up_from': 8, 'up_thru': 19, 'down_at': 0, 'lost_at': 0, 'public_addrs': {'addrvec': [{'type': 'v2', 'addr': '172.21.15.101:6800', 'nonce': 111143}, {'type': 'v1', 'addr': '172.21.15.101:6801', 'nonce': 111143}]}, 'cluster_addrs': {'addrvec': [{'type': 'v2', 'addr': '172.21.15.101:6802', 'nonce': 111143}, {'type': 'v1', 'addr': '172.21.15.101:6803', 'nonce': 111143}]}, 'heartbeat_back_addrs': {'addrvec': [{'type': 'v2', 'addr': '172.21.15.101:6806', 'nonce': 111143}, {'type': 'v1', 'addr': '172.21.15.101:6807', 'nonce': 111143}]}, 'heartbeat_front_addrs': {'addrvec': [{'type': 'v2', 'addr': '172.21.15.101:6804', 'nonce': 111143}, {'type': 'v1', 'addr': '172.21.15.101:6805', 'nonce': 111143}]}, 'public_addr': '172.21.15.101:6801/111143', 'cluster_addr': '172.21.15.101:6803/111143', 'heartbeat_back_addr': '172.21.15.101:6807/111143', 'heartbeat_front_addr': '172.21.15.101:6805/111143', 'state': ['exists', 'up']}, {'osd': 2, 'uuid': 'f85cadbc-4230-4772-8f39-62ed52e220b1', 'up': 1, 'in': 1, 'weight': 1, 'primary_affinity': 1, 'last_clean_begin': 0, 'last_clean_end': 0, 'up_from': 9, 'up_thru': 19, 'down_at': 0, 'lost_at': 0, 'public_addrs': {'addrvec': [{'type': 'v2', 'addr': '172.21.15.155:6800', 'nonce': 111339}, {'type': 'v1', 'addr': '172.21.15.155:6801', 'nonce': 111339}]}, 'cluster_addrs': {'addrvec': [{'type': 'v2', 'addr': '172.21.15.155:6802', 'nonce': 111339}, {'type': 'v1', 'addr': '172.21.15.155:6803', 'nonce': 111339}]}, 'heartbeat_back_addrs': {'addrvec': [{'type': 'v2', 'addr': '172.21.15.155:6806', 'nonce': 111339}, {'type': 'v1', 'addr': '172.21.15.155:6807', 'nonce': 111339}]}, 'heartbeat_front_addrs': {'addrvec': [{'type': 'v2', 'addr': '172.21.15.155:6804', 'nonce': 111339}, {'type': 'v1', 'addr': '172.21.15.155:6805', 'nonce': 111339}]}, 'public_addr': '172.21.15.155:6801/111339', 'cluster_addr': '172.21.15.155:6803/111339', 'heartbeat_back_addr': '172.21.15.155:6807/111339', 'heartbeat_front_addr': '172.21.15.155:6805/111339', 'state': ['exists', 'up']}], 'osd_xinfo': [{'osd': 0, 'down_stamp': '0.000000', 'laggy_probability': 0, 'laggy_interval': 0, 'features': 4540138320759226367, 'old_weight': 0, 'last_purged_snaps_scrub': '2023-08-01T19:53:48.018154+0000', 'dead_epoch': 0}, {'osd': 1, 'down_stamp': '0.000000', 'laggy_probability': 0, 'laggy_interval': 0, 'features': 4540138320759226367, 'old_weight': 0, 'last_purged_snaps_scrub': '2023-08-01T19:53:48.000488+0000', 'dead_epoch': 0}, {'osd': 2, 'down_stamp': '0.000000', 'laggy_probability': 0, 'laggy_interval': 0, 'features': 4540138320759226367, 'old_weight': 0, 'last_purged_snaps_scrub': '2023-08-01T19:53:48.072529+0000', 'dead_epoch': 0}], 'pg_upmap': [], 'pg_upmap_items': [], 'pg_temp': [], 'primary_temp': [], 'blocklist': {}, 'range_blocklist': {}, 'erasure_code_profiles': {'default': {'crush-failure-domain': 'osd', 'k': '2', 'm': '1', 'plugin': 'jerasure', 'technique': 'reed_sol_van'}}, 'removed_snaps_queue': [], 'new_removed_snaps': [], 'new_purged_snaps': [], 'crush_node_flags': {}, 'device_class_flags': {}, 'stretch_mode': {'stretch_mode_enabled': False, 'stretch_bucket_count': 0, 'degraded_stretch_mode': 0, 'recovering_stretch_mode': 0, 'stretch_mode_bucket': 0}} 2023-08-01T19:54:38.921 DEBUG:teuthology.orchestra.run.smithi006:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 120 ceph --cluster ceph pg dump --format=json 2023-08-01T19:54:38.922 INFO:teuthology.orchestra.run.smithi006.stdout:osd.2: {} 2023-08-01T19:54:38.923 INFO:teuthology.orchestra.run.smithi006.stderr:osd.0: osd_enable_op_tracker = 'false' 2023-08-01T19:54:38.923 INFO:teuthology.orchestra.run.smithi006.stderr:osd.1: osd_enable_op_tracker = 'false' 2023-08-01T19:54:38.923 INFO:teuthology.orchestra.run.smithi006.stderr:osd.2: osd_enable_op_tracker = 'false' 2023-08-01T19:54:38.924 DEBUG:teuthology.orchestra.run.smithi008:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 30 ceph --cluster ceph --admin-daemon /var/run/ceph/ceph-osd.0.asok dump_ops_in_flight 2023-08-01T19:54:39.020 INFO:tasks.ceph.osd.2.smithi155.stderr:2023-08-01T19:54:39.018+0000 7faa5c6ac700 -1 received signal: Hangup from /usr/bin/python3 /bin/daemon-helper kill ceph-osd -f --cluster ceph -i 2 (PID: 111337) UID: 0 2023-08-01T19:54:39.120 INFO:tasks.ceph.osd.2.smithi155.stderr:2023-08-01T19:54:39.119+0000 7faa5c6ac700 -1 received signal: Hangup from /usr/bin/python3 /bin/daemon-helper kill ceph-osd -f --cluster ceph -i 2 (PID: 111337) UID: 0 2023-08-01T19:54:39.122 INFO:teuthology.orchestra.run.smithi008.stdout:ERROR: (22) Invalid argument 2023-08-01T19:54:39.122 INFO:teuthology.orchestra.run.smithi008.stdout:op_tracker tracking is not enabled now, so no ops are tracked currently, even those get stuck. Please enable "osd_enable_op_tracker", and the tracker will start to track new ops received afterwards. 2023-08-01T19:54:39.138 DEBUG:teuthology.orchestra.run.smithi008:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 30 ceph --cluster ceph --admin-daemon /var/run/ceph/ceph-osd.0.asok dump_blocked_ops 2023-08-01T19:54:39.193 DEBUG:teuthology.orchestra.run.smithi006:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 120 ceph --cluster ceph osd unset noscrub 2023-08-01T19:54:39.221 INFO:tasks.ceph.osd.0.smithi008.stderr:2023-08-01T19:54:39.221+0000 7f16a58f4700 -1 received signal: Hangup from /usr/bin/python3 /bin/daemon-helper kill ceph-osd -f --cluster ceph -i 0 (PID: 111179) UID: 0 2023-08-01T19:54:39.313 INFO:teuthology.orchestra.run.smithi006.stdout: 2023-08-01T19:54:39.314 INFO:tasks.radosbench.radosbench.0.smithi006.stdout: 15 16 47695 47679 198.648 150.312 0.00536978 0.00503071 2023-08-01T19:54:39.315 INFO:teuthology.orchestra.run.smithi006.stderr:dumped all 2023-08-01T19:54:39.323 INFO:tasks.ceph.osd.2.smithi155.stderr:2023-08-01T19:54:39.321+0000 7faa5c6ac700 -1 received signal: Hangup from /usr/bin/python3 /bin/daemon-helper kill ceph-osd -f --cluster ceph -i 2 (PID: 111337) UID: 0 2023-08-01T19:54:39.327 INFO:teuthology.orchestra.run.smithi008.stdout:ERROR: (22) Invalid argument 2023-08-01T19:54:39.327 INFO:teuthology.orchestra.run.smithi008.stdout:op_tracker tracking is not enabled now, so no ops are tracked currently, even those get stuck. Please enable "osd_enable_op_tracker", and the tracker will start to track new ops received afterwards. 2023-08-01T19:54:39.328 INFO:teuthology.orchestra.run.smithi006.stdout:{"pg_ready":true,"pg_map":{"version":47,"stamp":"2023-08-01T19:54:37.914413+0000","last_osdmap_epoch":0,"last_pg_scan":0,"pg_stats_sum":{"stat_sum":{"num_bytes":2466515746,"num_objects":37651,"num_object_clones":0,"num_object_copies":75302,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":37651,"num_whiteouts":0,"num_read":136,"num_read_kb":118,"num_write":37875,"num_write_kb":2411601,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":14,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"store_stats":{"total":0,"available":0,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},"log_size":37823,"ondisk_log_size":37823,"up":242,"acting":242,"num_store_stats":0},"osd_stats_sum":{"up_from":0,"seq":0,"num_pgs":242,"num_osds":3,"num_per_pool_osds":3,"num_per_pool_omap_osds":3,"kb":283115520,"kb_used":384772,"kb_used_data":281260,"kb_used_omap":0,"kb_used_meta":103488,"kb_avail":282730748,"statfs":{"total":289910292480,"available":289516285952,"internally_reserved":0,"allocated":288010240,"data_stored":4595514307,"data_compressed":22009842,"data_compressed_allocated":287203328,"data_compressed_original":4595220480,"omap_allocated":0,"internal_metadata":105971712},"hb_peers":[],"snap_trim_queue_len":0,"num_snap_trimming":0,"num_shards_repaired":0,"op_queue_age_hist":{"histogram":[5,2,8,3],"upper_bound":16},"perf_stat":{"commit_latency_ms":6,"apply_latency_ms":6,"commit_latency_ns":6000000,"apply_latency_ns":6000000},"alerts":[],"network_ping_times":[]},"pg_stats_delta":{"stat_sum":{"num_bytes":972881920,"num_objects":14845,"num_object_clones":0,"num_object_copies":29690,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":14845,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":14845,"num_write_kb":950080,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"store_stats":{"total":0,"available":0,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},"log_size":0,"ondisk_log_size":0,"up":0,"acting":0,"num_store_stats":0,"stamp_delta":"6.760454"},"pg_stats":[{"pgid":"4.3f","version":"0'0","reported_seq":16,"reported_epoch":24,"state":"active+clean","last_fresh":"2023-08-01T19:54:31.157499+0000","last_change":"2023-08-01T19:54:04.473430+0000","last_active":"2023-08-01T19:54:31.157499+0000","last_peered":"2023-08-01T19:54:31.157499+0000","last_clean":"2023-08-01T19:54:31.157499+0000","last_became_active":"2023-08-01T19:54:04.472887+0000","last_became_peered":"2023-08-01T19:54:04.472887+0000","last_unstale":"2023-08-01T19:54:31.157499+0000","last_undegraded":"2023-08-01T19:54:31.157499+0000","last_fullsized":"2023-08-01T19:54:31.157499+0000","mapping_epoch":16,"log_start":"0'0","ondisk_log_start":"0'0","created":16,"last_epoch_clean":17,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-08-01T19:54:04.040663+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-08-01T19:54:04.040663+0000","last_clean_scrub_stamp":"2023-08-01T19:54:04.040663+0000","objects_scrubbed":0,"log_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-08-03T06:38:54.196605+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[2,0],"acting":[2,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":2,"acting_primary":2,"purged_snaps":[]},{"pgid":"4.3e","version":"0'0","reported_seq":16,"reported_epoch":24,"state":"active+clean","last_fresh":"2023-08-01T19:54:31.157132+0000","last_change":"2023-08-01T19:54:04.470501+0000","last_active":"2023-08-01T19:54:31.157132+0000","last_peered":"2023-08-01T19:54:31.157132+0000","last_clean":"2023-08-01T19:54:31.157132+0000","last_became_active":"2023-08-01T19:54:04.469692+0000","last_became_peered":"2023-08-01T19:54:04.469692+0000","last_unstale":"2023-08-01T19:54:31.157132+0000","last_undegraded":"2023-08-01T19:54:31.157132+0000","last_fullsized":"2023-08-01T19:54:31.157132+0000","mapping_epoch":16,"log_start":"0'0","ondisk_log_start":"0'0","created":16,"last_epoch_clean":17,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-08-01T19:54:04.040663+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-08-01T19:54:04.040663+0000","last_clean_scrub_stamp":"2023-08-01T19:54:04.040663+0000","objects_scrubbed":0,"log_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-08-03T02:19:35.201107+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[2,0],"acting":[2,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":2,"acting_primary":2,"purged_snaps":[]},{"pgid":"4.3d","version":"0'0","reported_seq":16,"reported_epoch":24,"state":"active+clean","last_fresh":"2023-08-01T19:54:31.164987+0000","last_change":"2023-08-01T19:54:04.472579+0000","last_active":"2023-08-01T19:54:31.164987+0000","last_peered":"2023-08-01T19:54:31.164987+0000","last_clean":"2023-08-01T19:54:31.164987+0000","last_became_active":"2023-08-01T19:54:04.471128+0000","last_became_peered":"2023-08-01T19:54:04.471128+0000","last_unstale":"2023-08-01T19:54:31.164987+0000","last_undegraded":"2023-08-01T19:54:31.164987+0000","last_fullsized":"2023-08-01T19:54:31.164987+0000","mapping_epoch":16,"log_start":"0'0","ondisk_log_start":"0'0","created":16,"last_epoch_clean":17,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-08-01T19:54:04.040663+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-08-01T19:54:04.040663+0000","last_clean_scrub_stamp":"2023-08-01T19:54:04.040663+0000","objects_scrubbed":0,"log_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-08-03T03:04:06.137335+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[1,2],"acting":[1,2],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":1,"acting_primary":1,"purged_snaps":[]},{"pgid":"4.3c","version":"0'0","reported_seq":16,"reported_epoch":24,"state":"active+clean","last_fresh":"2023-08-01T19:54:31.164415+0000","last_change":"2023-08-01T19:54:04.477908+0000","last_active":"2023-08-01T19:54:31.164415+0000","last_peered":"2023-08-01T19:54:31.164415+0000","last_clean":"2023-08-01T19:54:31.164415+0000","last_became_active":"2023-08-01T19:54:04.476684+0000","last_became_peered":"2023-08-01T19:54:04.476684+0000","last_unstale":"2023-08-01T19:54:31.164415+0000","last_undegraded":"2023-08-01T19:54:31.164415+0000","last_fullsized":"2023-08-01T19:54:31.164415+0000","mapping_epoch":16,"log_start":"0'0","ondisk_log_start":"0'0","created":16,"last_epoch_clean":17,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-08-01T19:54:04.040663+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-08-01T19:54:04.040663+0000","last_clean_scrub_stamp":"2023-08-01T19:54:04.040663+0000","objects_scrubbed":0,"log_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-08-03T03:56:55.336461+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[1,0],"acting":[1,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":1,"acting_primary":1,"purged_snaps":[]},{"pgid":"4.3b","version":"0'0","reported_seq":16,"reported_epoch":24,"state":"active+clean","last_fresh":"2023-08-01T19:54:31.157382+0000","last_change":"2023-08-01T19:54:04.467197+0000","last_active":"2023-08-01T19:54:31.157382+0000","last_peered":"2023-08-01T19:54:31.157382+0000","last_clean":"2023-08-01T19:54:31.157382+0000","last_became_active":"2023-08-01T19:54:04.466526+0000","last_became_peered":"2023-08-01T19:54:04.466526+0000","last_unstale":"2023-08-01T19:54:31.157382+0000","last_undegraded":"2023-08-01T19:54:31.157382+0000","last_fullsized":"2023-08-01T19:54:31.157382+0000","mapping_epoch":16,"log_start":"0'0","ondisk_log_start":"0'0","created":16,"last_epoch_clean":17,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-08-01T19:54:04.040663+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-08-01T19:54:04.040663+0000","last_clean_scrub_stamp":"2023-08-01T19:54:04.040663+0000","objects_scrubbed":0,"log_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-08-03T06:54:18.982174+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[2,0],"acting":[2,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":2,"acting_primary":2,"purged_snaps":[]},{"pgid":"4.3a","version":"0'0","reported_seq":16,"reported_epoch":24,"state":"active+clean","last_fresh":"2023-08-01T19:54:31.163487+0000","last_change":"2023-08-01T19:54:04.473296+0000","last_active":"2023-08-01T19:54:31.163487+0000","last_peered":"2023-08-01T19:54:31.163487+0000","last_clean":"2023-08-01T19:54:31.163487+0000","last_became_active":"2023-08-01T19:54:04.472324+0000","last_became_peered":"2023-08-01T19:54:04.472324+0000","last_unstale":"2023-08-01T19:54:31.163487+0000","last_undegraded":"2023-08-01T19:54:31.163487+0000","last_fullsized":"2023-08-01T19:54:31.163487+0000","mapping_epoch":16,"log_start":"0'0","ondisk_log_start":"0'0","created":16,"last_epoch_clean":17,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-08-01T19:54:04.040663+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-08-01T19:54:04.040663+0000","last_clean_scrub_stamp":"2023-08-01T19:54:04.040663+0000","objects_scrubbed":0,"log_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-08-02T23:15:11.148662+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[1,0],"acting":[1,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":1,"acting_primary":1,"purged_snaps":[]},{"pgid":"4.39","version":"0'0","reported_seq":16,"reported_epoch":24,"state":"active+clean","last_fresh":"2023-08-01T19:54:31.164712+0000","last_change":"2023-08-01T19:54:04.475322+0000","last_active":"2023-08-01T19:54:31.164712+0000","last_peered":"2023-08-01T19:54:31.164712+0000","last_clean":"2023-08-01T19:54:31.164712+0000","last_became_active":"2023-08-01T19:54:04.474591+0000","last_became_peered":"2023-08-01T19:54:04.474591+0000","last_unstale":"2023-08-01T19:54:31.164712+0000","last_undegraded":"2023-08-01T19:54:31.164712+0000","last_fullsized":"2023-08-01T19:54:31.164712+0000","mapping_epoch":16,"log_start":"0'0","ondisk_log_start":"0'0","created":16,"last_epoch_clean":17,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-08-01T19:54:04.040663+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-08-01T19:54:04.040663+0000","last_clean_scrub_stamp":"2023-08-01T19:54:04.040663+0000","objects_scrubbed":0,"log_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-08-03T00:29:53.554989+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[1,0],"acting":[1,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":1,"acting_primary":1,"purged_snaps":[]},{"pgid":"4.38","version":"0'0","reported_seq":16,"reported_epoch":24,"state":"active+clean","last_fresh":"2023-08-01T19:54:31.163158+0000","last_change":"2023-08-01T19:54:04.478505+0000","last_active":"2023-08-01T19:54:31.163158+0000","last_peered":"2023-08-01T19:54:31.163158+0000","last_clean":"2023-08-01T19:54:31.163158+0000","last_became_active":"2023-08-01T19:54:04.477325+0000","last_became_peered":"2023-08-01T19:54:04.477325+0000","last_unstale":"2023-08-01T19:54:31.163158+0000","last_undegraded":"2023-08-01T19:54:31.163158+0000","last_fullsized":"2023-08-01T19:54:31.163158+0000","mapping_epoch":16,"log_start":"0'0","ondisk_log_start":"0'0","created":16,"last_epoch_clean":17,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-08-01T19:54:04.040663+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-08-01T19:54:04.040663+0000","last_clean_scrub_stamp":"2023-08-01T19:54:04.040663+0000","objects_scrubbed":0,"log_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-08-03T01:38:12.939736+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[1,0],"acting":[1,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":1,"acting_primary":1,"purged_snaps":[]},{"pgid":"4.37","version":"0'0","reported_seq":16,"reported_epoch":24,"state":"active+clean","last_fresh":"2023-08-01T19:54:31.156991+0000","last_change":"2023-08-01T19:54:04.470971+0000","last_active":"2023-08-01T19:54:31.156991+0000","last_peered":"2023-08-01T19:54:31.156991+0000","last_clean":"2023-08-01T19:54:31.156991+0000","last_became_active":"2023-08-01T19:54:04.469011+0000","last_became_peered":"2023-08-01T19:54:04.469011+0000","last_unstale":"2023-08-01T19:54:31.156991+0000","last_undegraded":"2023-08-01T19:54:31.156991+0000","last_fullsized":"2023-08-01T19:54:31.156991+0000","mapping_epoch":16,"log_start":"0'0","ondisk_log_start":"0'0","created":16,"last_epoch_clean":17,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-08-01T19:54:04.040663+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-08-01T19:54:04.040663+0000","last_clean_scrub_stamp":"2023-08-01T19:54:04.040663+0000","objects_scrubbed":0,"log_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-08-03T06:50:03.420334+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[0,2],"acting":[0,2],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":0,"acting_primary":0,"purged_snaps":[]},{"pgid":"4.36","version":"0'0","reported_seq":16,"reported_epoch":24,"state":"active+clean","last_fresh":"2023-08-01T19:54:31.157448+0000","last_change":"2023-08-01T19:54:04.473523+0000","last_active":"2023-08-01T19:54:31.157448+0000","last_peered":"2023-08-01T19:54:31.157448+0000","last_clean":"2023-08-01T19:54:31.157448+0000","last_became_active":"2023-08-01T19:54:04.473084+0000","last_became_peered":"2023-08-01T19:54:04.473084+0000","last_unstale":"2023-08-01T19:54:31.157448+0000","last_undegraded":"2023-08-01T19:54:31.157448+0000","last_fullsized":"2023-08-01T19:54:31.157448+0000","mapping_epoch":16,"log_start":"0'0","ondisk_log_start":"0'0","created":16,"last_epoch_clean":17,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-08-01T19:54:04.040663+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-08-01T19:54:04.040663+0000","last_clean_scrub_stamp":"2023-08-01T19:54:04.040663+0000","objects_scrubbed":0,"log_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-08-03T04:28:59.042443+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[2,0],"acting":[2,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":2,"acting_primary":2,"purged_snaps":[]},{"pgid":"4.35","version":"0'0","reported_seq":16,"reported_epoch":24,"state":"active+clean","last_fresh":"2023-08-01T19:54:31.164863+0000","last_change":"2023-08-01T19:54:04.475816+0000","last_active":"2023-08-01T19:54:31.164863+0000","last_peered":"2023-08-01T19:54:31.164863+0000","last_clean":"2023-08-01T19:54:31.164863+0000","last_became_active":"2023-08-01T19:54:04.475061+0000","last_became_peered":"2023-08-01T19:54:04.475061+0000","last_unstale":"2023-08-01T19:54:31.164863+0000","last_undegraded":"2023-08-01T19:54:31.164863+0000","last_fullsized":"2023-08-01T19:54:31.164863+0000","mapping_epoch":16,"log_start":"0'0","ondisk_log_start":"0'0","created":16,"last_epoch_clean":17,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-08-01T19:54:04.040663+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-08-01T19:54:04.040663+0000","last_clean_scrub_stamp":"2023-08-01T19:54:04.040663+0000","objects_scrubbed":0,"log_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-08-02T22:07:41.305488+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[1,0],"acting":[1,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":1,"acting_primary":1,"purged_snaps":[]},{"pgid":"4.34","version":"0'0","reported_seq":16,"reported_epoch":24,"state":"active+clean","last_fresh":"2023-08-01T19:54:31.156617+0000","last_change":"2023-08-01T19:54:04.468009+0000","last_active":"2023-08-01T19:54:31.156617+0000","last_peered":"2023-08-01T19:54:31.156617+0000","last_clean":"2023-08-01T19:54:31.156617+0000","last_became_active":"2023-08-01T19:54:04.467568+0000","last_became_peered":"2023-08-01T19:54:04.467568+0000","last_unstale":"2023-08-01T19:54:31.156617+0000","last_undegraded":"2023-08-01T19:54:31.156617+0000","last_fullsized":"2023-08-01T19:54:31.156617+0000","mapping_epoch":16,"log_start":"0'0","ondisk_log_start":"0'0","created":16,"last_epoch_clean":17,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-08-01T19:54:04.040663+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-08-01T19:54:04.040663+0000","last_clean_scrub_stamp":"2023-08-01T19:54:04.040663+0000","objects_scrubbed":0,"log_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-08-03T04:53:44.017572+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[2,1],"acting":[2,1],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":2,"acting_primary":2,"purged_snaps":[]},{"pgid":"4.33","version":"0'0","reported_seq":16,"reported_epoch":24,"state":"active+clean","last_fresh":"2023-08-01T19:54:31.157586+0000","last_change":"2023-08-01T19:54:04.466770+0000","last_active":"2023-08-01T19:54:31.157586+0000","last_peered":"2023-08-01T19:54:31.157586+0000","last_clean":"2023-08-01T19:54:31.157586+0000","last_became_active":"2023-08-01T19:54:04.466460+0000","last_became_peered":"2023-08-01T19:54:04.466460+0000","last_unstale":"2023-08-01T19:54:31.157586+0000","last_undegraded":"2023-08-01T19:54:31.157586+0000","last_fullsized":"2023-08-01T19:54:31.157586+0000","mapping_epoch":16,"log_start":"0'0","ondisk_log_start":"0'0","created":16,"last_epoch_clean":17,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-08-01T19:54:04.040663+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-08-01T19:54:04.040663+0000","last_clean_scrub_stamp":"2023-08-01T19:54:04.040663+0000","objects_scrubbed":0,"log_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-08-03T06:04:11.595951+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[2,0],"acting":[2,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":2,"acting_primary":2,"purged_snaps":[]},{"pgid":"4.32","version":"0'0","reported_seq":16,"reported_epoch":24,"state":"active+clean","last_fresh":"2023-08-01T19:54:31.163959+0000","last_change":"2023-08-01T19:54:04.466634+0000","last_active":"2023-08-01T19:54:31.163959+0000","last_peered":"2023-08-01T19:54:31.163959+0000","last_clean":"2023-08-01T19:54:31.163959+0000","last_became_active":"2023-08-01T19:54:04.466302+0000","last_became_peered":"2023-08-01T19:54:04.466302+0000","last_unstale":"2023-08-01T19:54:31.163959+0000","last_undegraded":"2023-08-01T19:54:31.163959+0000","last_fullsized":"2023-08-01T19:54:31.163959+0000","mapping_epoch":16,"log_start":"0'0","ondisk_log_start":"0'0","created":16,"last_epoch_clean":17,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-08-01T19:54:04.040663+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-08-01T19:54:04.040663+0000","last_clean_scrub_stamp":"2023-08-01T19:54:04.040663+0000","objects_scrubbed":0,"log_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-08-03T05:46:11.085577+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[1,2],"acting":[1,2],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":1,"acting_primary":1,"purged_snaps":[]},{"pgid":"4.31","version":"0'0","reported_seq":16,"reported_epoch":24,"state":"active+clean","last_fresh":"2023-08-01T19:54:31.164586+0000","last_change":"2023-08-01T19:54:04.472407+0000","last_active":"2023-08-01T19:54:31.164586+0000","last_peered":"2023-08-01T19:54:31.164586+0000","last_clean":"2023-08-01T19:54:31.164586+0000","last_became_active":"2023-08-01T19:54:04.472008+0000","last_became_peered":"2023-08-01T19:54:04.472008+0000","last_unstale":"2023-08-01T19:54:31.164586+0000","last_undegraded":"2023-08-01T19:54:31.164586+0000","last_fullsized":"2023-08-01T19:54:31.164586+0000","mapping_epoch":16,"log_start":"0'0","ondisk_log_start":"0'0","created":16,"last_epoch_clean":17,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-08-01T19:54:04.040663+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-08-01T19:54:04.040663+0000","last_clean_scrub_stamp":"2023-08-01T19:54:04.040663+0000","objects_scrubbed":0,"log_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-08-02T22:42:25.293502+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[1,2],"acting":[1,2],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":1,"acting_primary":1,"purged_snaps":[]},{"pgid":"4.30","version":"0'0","reported_seq":16,"reported_epoch":24,"state":"active+clean","last_fresh":"2023-08-01T19:54:31.163232+0000","last_change":"2023-08-01T19:54:04.478283+0000","last_active":"2023-08-01T19:54:31.163232+0000","last_peered":"2023-08-01T19:54:31.163232+0000","last_clean":"2023-08-01T19:54:31.163232+0000","last_became_active":"2023-08-01T19:54:04.476620+0000","last_became_peered":"2023-08-01T19:54:04.476620+0000","last_unstale":"2023-08-01T19:54:31.163232+0000","last_undegraded":"2023-08-01T19:54:31.163232+0000","last_fullsized":"2023-08-01T19:54:31.163232+0000","mapping_epoch":16,"log_start":"0'0","ondisk_log_start":"0'0","created":16,"last_epoch_clean":17,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-08-01T19:54:04.040663+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-08-01T19:54:04.040663+0000","last_clean_scrub_stamp":"2023-08-01T19:54:04.040663+0000","objects_scrubbed":0,"log_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-08-03T02:27:17.063518+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[1,0],"acting":[1,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":1,"acting_primary":1,"purged_snaps":[]},{"pgid":"4.2f","version":"0'0","reported_seq":16,"reported_epoch":24,"state":"active+clean","last_fresh":"2023-08-01T19:54:31.157090+0000","last_change":"2023-08-01T19:54:04.470302+0000","last_active":"2023-08-01T19:54:31.157090+0000","last_peered":"2023-08-01T19:54:31.157090+0000","last_clean":"2023-08-01T19:54:31.157090+0000","last_became_active":"2023-08-01T19:54:04.468919+0000","last_became_peered":"2023-08-01T19:54:04.468919+0000","last_unstale":"2023-08-01T19:54:31.157090+0000","last_undegraded":"2023-08-01T19:54:31.157090+0000","last_fullsized":"2023-08-01T19:54:31.157090+0000","mapping_epoch":16,"log_start":"0'0","ondisk_log_start":"0'0","created":16,"last_epoch_clean":17,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-08-01T19:54:04.040663+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-08-01T19:54:04.040663+0000","last_clean_scrub_stamp":"2023-08-01T19:54:04.040663+0000","objects_scrubbed":0,"log_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-08-02T22:42:25.293502+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[0,2],"acting":[0,2],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":0,"acting_primary":0,"purged_snaps":[]},{"pgid":"4.2e","version":"0'0","reported_seq":16,"reported_epoch":24,"state":"active+clean","last_fresh":"2023-08-01T19:54:31.157532+0000","last_change":"2023-08-01T19:54:04.474058+0000","last_active":"2023-08-01T19:54:31.157532+0000","last_peered":"2023-08-01T19:54:31.157532+0000","last_clean":"2023-08-01T19:54:31.157532+0000","last_became_active":"2023-08-01T19:54:04.473355+0000","last_became_peered":"2023-08-01T19:54:04.473355+0000","last_unstale":"2023-08-01T19:54:31.157532+0000","last_undegraded":"2023-08-01T19:54:31.157532+0000","last_fullsized":"2023-08-01T19:54:31.157532+0000","mapping_epoch":16,"log_start":"0'0","ondisk_log_start":"0'0","created":16,"last_epoch_clean":17,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-08-01T19:54:04.040663+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-08-01T19:54:04.040663+0000","last_clean_scrub_stamp":"2023-08-01T19:54:04.040663+0000","objects_scrubbed":0,"log_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-08-03T04:55:54.197252+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[2,0],"acting":[2,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":2,"acting_primary":2,"purged_snaps":[]},{"pgid":"4.2d","version":"0'0","reported_seq":16,"reported_epoch":24,"state":"active+clean","last_fresh":"2023-08-01T19:54:31.157078+0000","last_change":"2023-08-01T19:54:04.468775+0000","last_active":"2023-08-01T19:54:31.157078+0000","last_peered":"2023-08-01T19:54:31.157078+0000","last_clean":"2023-08-01T19:54:31.157078+0000","last_became_active":"2023-08-01T19:54:04.467274+0000","last_became_peered":"2023-08-01T19:54:04.467274+0000","last_unstale":"2023-08-01T19:54:31.157078+0000","last_undegraded":"2023-08-01T19:54:31.157078+0000","last_fullsized":"2023-08-01T19:54:31.157078+0000","mapping_epoch":16,"log_start":"0'0","ondisk_log_start":"0'0","created":16,"last_epoch_clean":17,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-08-01T19:54:04.040663+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-08-01T19:54:04.040663+0000","last_clean_scrub_stamp":"2023-08-01T19:54:04.040663+0000","objects_scrubbed":0,"log_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-08-02T23:00:37.537286+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[0,2],"acting":[0,2],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":0,"acting_primary":0,"purged_snaps":[]},{"pgid":"4.2c","version":"0'0","reported_seq":16,"reported_epoch":24,"state":"active+clean","last_fresh":"2023-08-01T19:54:31.164340+0000","last_change":"2023-08-01T19:54:04.478409+0000","last_active":"2023-08-01T19:54:31.164340+0000","last_peered":"2023-08-01T19:54:31.164340+0000","last_clean":"2023-08-01T19:54:31.164340+0000","last_became_active":"2023-08-01T19:54:04.477133+0000","last_became_peered":"2023-08-01T19:54:04.477133+0000","last_unstale":"2023-08-01T19:54:31.164340+0000","last_undegraded":"2023-08-01T19:54:31.164340+0000","last_fullsized":"2023-08-01T19:54:31.164340+0000","mapping_epoch":16,"log_start":"0'0","ondisk_log_start":"0'0","created":16,"last_epoch_clean":17,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-08-01T19:54:04.040663+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-08-01T19:54:04.040663+0000","last_clean_scrub_stamp":"2023-08-01T19:54:04.040663+0000","objects_scrubbed":0,"log_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-08-02T22:15:19.744281+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[1,0],"acting":[1,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":1,"acting_primary":1,"purged_snaps":[]},{"pgid":"4.2b","version":"0'0","reported_seq":16,"reported_epoch":24,"state":"active+clean","last_fresh":"2023-08-01T19:54:31.163675+0000","last_change":"2023-08-01T19:54:04.474047+0000","last_active":"2023-08-01T19:54:31.163675+0000","last_peered":"2023-08-01T19:54:31.163675+0000","last_clean":"2023-08-01T19:54:31.163675+0000","last_became_active":"2023-08-01T19:54:04.473578+0000","last_became_peered":"2023-08-01T19:54:04.473578+0000","last_unstale":"2023-08-01T19:54:31.163675+0000","last_undegraded":"2023-08-01T19:54:31.163675+0000","last_fullsized":"2023-08-01T19:54:31.163675+0000","mapping_epoch":16,"log_start":"0'0","ondisk_log_start":"0'0","created":16,"last_epoch_clean":17,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-08-01T19:54:04.040663+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-08-01T19:54:04.040663+0000","last_clean_scrub_stamp":"2023-08-01T19:54:04.040663+0000","objects_scrubbed":0,"log_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-08-03T05:39:29.199142+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[1,0],"acting":[1,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":1,"acting_primary":1,"purged_snaps":[]},{"pgid":"4.2a","version":"0'0","reported_seq":16,"reported_epoch":24,"state":"active+clean","last_fresh":"2023-08-01T19:54:31.156789+0000","last_change":"2023-08-01T19:54:04.469281+0000","last_active":"2023-08-01T19:54:31.156789+0000","last_peered":"2023-08-01T19:54:31.156789+0000","last_clean":"2023-08-01T19:54:31.156789+0000","last_became_active":"2023-08-01T19:54:04.468771+0000","last_became_peered":"2023-08-01T19:54:04.468771+0000","last_unstale":"2023-08-01T19:54:31.156789+0000","last_undegraded":"2023-08-01T19:54:31.156789+0000","last_fullsized":"2023-08-01T19:54:31.156789+0000","mapping_epoch":16,"log_start":"0'0","ondisk_log_start":"0'0","created":16,"last_epoch_clean":17,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-08-01T19:54:04.040663+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-08-01T19:54:04.040663+0000","last_clean_scrub_stamp":"2023-08-01T19:54:04.040663+0000","objects_scrubbed":0,"log_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-08-03T01:15:27.748810+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[2,1],"acting":[2,1],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":2,"acting_primary":2,"purged_snaps":[]},{"pgid":"4.29","version":"0'0","reported_seq":16,"reported_epoch":24,"state":"active+clean","last_fresh":"2023-08-01T19:54:31.156693+0000","last_change":"2023-08-01T19:54:04.466694+0000","last_active":"2023-08-01T19:54:31.156693+0000","last_peered":"2023-08-01T19:54:31.156693+0000","last_clean":"2023-08-01T19:54:31.156693+0000","last_became_active":"2023-08-01T19:54:04.466250+0000","last_became_peered":"2023-08-01T19:54:04.466250+0000","last_unstale":"2023-08-01T19:54:31.156693+0000","last_undegraded":"2023-08-01T19:54:31.156693+0000","last_fullsized":"2023-08-01T19:54:31.156693+0000","mapping_epoch":16,"log_start":"0'0","ondisk_log_start":"0'0","created":16,"last_epoch_clean":17,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-08-01T19:54:04.040663+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-08-01T19:54:04.040663+0000","last_clean_scrub_stamp":"2023-08-01T19:54:04.040663+0000","objects_scrubbed":0,"log_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-08-03T01:00:18.725898+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[0,1],"acting":[0,1],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":0,"acting_primary":0,"purged_snaps":[]},{"pgid":"4.28","version":"0'0","reported_seq":16,"reported_epoch":24,"state":"active+clean","last_fresh":"2023-08-01T19:54:31.156610+0000","last_change":"2023-08-01T19:54:04.468160+0000","last_active":"2023-08-01T19:54:31.156610+0000","last_peered":"2023-08-01T19:54:31.156610+0000","last_clean":"2023-08-01T19:54:31.156610+0000","last_became_active":"2023-08-01T19:54:04.467625+0000","last_became_peered":"2023-08-01T19:54:04.467625+0000","last_unstale":"2023-08-01T19:54:31.156610+0000","last_undegraded":"2023-08-01T19:54:31.156610+0000","last_fullsized":"2023-08-01T19:54:31.156610+0000","mapping_epoch":16,"log_start":"0'0","ondisk_log_start":"0'0","created":16,"last_epoch_clean":17,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-08-01T19:54:04.040663+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-08-01T19:54:04.040663+0000","last_clean_scrub_stamp":"2023-08-01T19:54:04.040663+0000","objects_scrubbed":0,"log_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-08-02T21:27:52.506153+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[2,0],"acting":[2,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":2,"acting_primary":2,"purged_snaps":[]},{"pgid":"4.27","version":"0'0","reported_seq":16,"reported_epoch":24,"state":"active+clean","last_fresh":"2023-08-01T19:54:31.157322+0000","last_change":"2023-08-01T19:54:04.469187+0000","last_active":"2023-08-01T19:54:31.157322+0000","last_peered":"2023-08-01T19:54:31.157322+0000","last_clean":"2023-08-01T19:54:31.157322+0000","last_became_active":"2023-08-01T19:54:04.468628+0000","last_became_peered":"2023-08-01T19:54:04.468628+0000","last_unstale":"2023-08-01T19:54:31.157322+0000","last_undegraded":"2023-08-01T19:54:31.157322+0000","last_fullsized":"2023-08-01T19:54:31.157322+0000","mapping_epoch":16,"log_start":"0'0","ondisk_log_start":"0'0","created":16,"last_epoch_clean":17,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-08-01T19:54:04.040663+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-08-01T19:54:04.040663+0000","last_clean_scrub_stamp":"2023-08-01T19:54:04.040663+0000","objects_scrubbed":0,"log_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-08-03T00:07:29.565677+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[2,1],"acting":[2,1],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":2,"acting_primary":2,"purged_snaps":[]},{"pgid":"4.26","version":"0'0","reported_seq":16,"reported_epoch":24,"state":"active+clean","last_fresh":"2023-08-01T19:54:31.157514+0000","last_change":"2023-08-01T19:54:04.470942+0000","last_active":"2023-08-01T19:54:31.157514+0000","last_peered":"2023-08-01T19:54:31.157514+0000","last_clean":"2023-08-01T19:54:31.157514+0000","last_became_active":"2023-08-01T19:54:04.470564+0000","last_became_peered":"2023-08-01T19:54:04.470564+0000","last_unstale":"2023-08-01T19:54:31.157514+0000","last_undegraded":"2023-08-01T19:54:31.157514+0000","last_fullsized":"2023-08-01T19:54:31.157514+0000","mapping_epoch":16,"log_start":"0'0","ondisk_log_start":"0'0","created":16,"last_epoch_clean":17,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-08-01T19:54:04.040663+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-08-01T19:54:04.040663+0000","last_clean_scrub_stamp":"2023-08-01T19:54:04.040663+0000","objects_scrubbed":0,"log_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-08-03T04:43:21.408174+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[0,1],"acting":[0,1],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":0,"acting_primary":0,"purged_snaps":[]},{"pgid":"4.25","version":"0'0","reported_seq":16,"reported_epoch":24,"state":"active+clean","last_fresh":"2023-08-01T19:54:31.164905+0000","last_change":"2023-08-01T19:54:04.474813+0000","last_active":"2023-08-01T19:54:31.164905+0000","last_peered":"2023-08-01T19:54:31.164905+0000","last_clean":"2023-08-01T19:54:31.164905+0000","last_became_active":"2023-08-01T19:54:04.472530+0000","last_became_peered":"2023-08-01T19:54:04.472530+0000","last_unstale":"2023-08-01T19:54:31.164905+0000","last_undegraded":"2023-08-01T19:54:31.164905+0000","last_fullsized":"2023-08-01T19:54:31.164905+0000","mapping_epoch":16,"log_start":"0'0","ondisk_log_start":"0'0","created":16,"last_epoch_clean":17,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-08-01T19:54:04.040663+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-08-01T19:54:04.040663+0000","last_clean_scrub_stamp":"2023-08-01T19:54:04.040663+0000","objects_scrubbed":0,"log_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-08-03T01:00:18.725898+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[1,2],"acting":[1,2],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":1,"acting_primary":1,"purged_snaps":[]},{"pgid":"3.1a","version":"17'1","reported_seq":18,"reported_epoch":24,"state":"active+clean","last_fresh":"2023-08-01T19:54:31.156654+0000","last_change":"2023-08-01T19:54:04.063936+0000","last_active":"2023-08-01T19:54:31.156654+0000","last_peered":"2023-08-01T19:54:31.156654+0000","last_clean":"2023-08-01T19:54:31.156654+0000","last_became_active":"2023-08-01T19:54:04.063674+0000","last_became_peered":"2023-08-01T19:54:04.063674+0000","last_unstale":"2023-08-01T19:54:31.156654+0000","last_undegraded":"2023-08-01T19:54:31.156654+0000","last_fullsized":"2023-08-01T19:54:31.156654+0000","mapping_epoch":15,"log_start":"0'0","ondisk_log_start":"0'0","created":15,"last_epoch_clean":16,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-08-01T19:54:03.032665+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-08-01T19:54:03.032665+0000","last_clean_scrub_stamp":"2023-08-01T19:54:03.032665+0000","objects_scrubbed":0,"log_size":1,"ondisk_log_size":1,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-08-03T00:06:00.058200+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[2,0],"acting":[2,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":2,"acting_primary":2,"purged_snaps":[]},{"pgid":"4.1d","version":"0'0","reported_seq":16,"reported_epoch":24,"state":"active+clean","last_fresh":"2023-08-01T19:54:31.157294+0000","last_change":"2023-08-01T19:54:04.471916+0000","last_active":"2023-08-01T19:54:31.157294+0000","last_peered":"2023-08-01T19:54:31.157294+0000","last_clean":"2023-08-01T19:54:31.157294+0000","last_became_active":"2023-08-01T19:54:04.471480+0000","last_became_peered":"2023-08-01T19:54:04.471480+0000","last_unstale":"2023-08-01T19:54:31.157294+0000","last_undegraded":"2023-08-01T19:54:31.157294+0000","last_fullsized":"2023-08-01T19:54:31.157294+0000","mapping_epoch":16,"log_start":"0'0","ondisk_log_start":"0'0","created":16,"last_epoch_clean":17,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-08-01T19:54:04.040663+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-08-01T19:54:04.040663+0000","last_clean_scrub_stamp":"2023-08-01T19:54:04.040663+0000","objects_scrubbed":0,"log_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-08-02T21:19:17.547590+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[2,1],"acting":[2,1],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":2,"acting_primary":2,"purged_snaps":[]},{"pgid":"3.19","version":"0'0","reported_seq":17,"reported_epoch":24,"state":"active+clean","last_fresh":"2023-08-01T19:54:31.156789+0000","last_change":"2023-08-01T19:54:04.067837+0000","last_active":"2023-08-01T19:54:31.156789+0000","last_peered":"2023-08-01T19:54:31.156789+0000","last_clean":"2023-08-01T19:54:31.156789+0000","last_became_active":"2023-08-01T19:54:04.067535+0000","last_became_peered":"2023-08-01T19:54:04.067535+0000","last_unstale":"2023-08-01T19:54:31.156789+0000","last_undegraded":"2023-08-01T19:54:31.156789+0000","last_fullsized":"2023-08-01T19:54:31.156789+0000","mapping_epoch":15,"log_start":"0'0","ondisk_log_start":"0'0","created":15,"last_epoch_clean":16,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-08-01T19:54:03.032665+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-08-01T19:54:03.032665+0000","last_clean_scrub_stamp":"2023-08-01T19:54:03.032665+0000","objects_scrubbed":0,"log_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-08-02T20:56:47.324761+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[0,1],"acting":[0,1],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":0,"acting_primary":0,"purged_snaps":[]},{"pgid":"4.1e","version":"0'0","reported_seq":16,"reported_epoch":24,"state":"active+clean","last_fresh":"2023-08-01T19:54:31.157767+0000","last_change":"2023-08-01T19:54:04.470544+0000","last_active":"2023-08-01T19:54:31.157767+0000","last_peered":"2023-08-01T19:54:31.157767+0000","last_clean":"2023-08-01T19:54:31.157767+0000","last_became_active":"2023-08-01T19:54:04.469657+0000","last_became_peered":"2023-08-01T19:54:04.469657+0000","last_unstale":"2023-08-01T19:54:31.157767+0000","last_undegraded":"2023-08-01T19:54:31.157767+0000","last_fullsized":"2023-08-01T19:54:31.157767+0000","mapping_epoch":16,"log_start":"0'0","ondisk_log_start":"0'0","created":16,"last_epoch_clean":17,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-08-01T19:54:04.040663+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-08-01T19:54:04.040663+0000","last_clean_scrub_stamp":"2023-08-01T19:54:04.040663+0000","objects_scrubbed":0,"log_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-08-02T23:12:30.830199+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[0,1],"acting":[0,1],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":0,"acting_primary":0,"purged_snaps":[]},{"pgid":"3.18","version":"0'0","reported_seq":17,"reported_epoch":24,"state":"active+clean","last_fresh":"2023-08-01T19:54:31.156667+0000","last_change":"2023-08-01T19:54:04.064289+0000","last_active":"2023-08-01T19:54:31.156667+0000","last_peered":"2023-08-01T19:54:31.156667+0000","last_clean":"2023-08-01T19:54:31.156667+0000","last_became_active":"2023-08-01T19:54:04.063971+0000","last_became_peered":"2023-08-01T19:54:04.063971+0000","last_unstale":"2023-08-01T19:54:31.156667+0000","last_undegraded":"2023-08-01T19:54:31.156667+0000","last_fullsized":"2023-08-01T19:54:31.156667+0000","mapping_epoch":15,"log_start":"0'0","ondisk_log_start":"0'0","created":15,"last_epoch_clean":16,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-08-01T19:54:03.032665+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-08-01T19:54:03.032665+0000","last_clean_scrub_stamp":"2023-08-01T19:54:03.032665+0000","objects_scrubbed":0,"log_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-08-03T04:09:30.496098+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[0,2],"acting":[0,2],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":0,"acting_primary":0,"purged_snaps":[]},{"pgid":"4.1f","version":"0'0","reported_seq":16,"reported_epoch":24,"state":"active+clean","last_fresh":"2023-08-01T19:54:31.157241+0000","last_change":"2023-08-01T19:54:04.472227+0000","last_active":"2023-08-01T19:54:31.157241+0000","last_peered":"2023-08-01T19:54:31.157241+0000","last_clean":"2023-08-01T19:54:31.157241+0000","last_became_active":"2023-08-01T19:54:04.471767+0000","last_became_peered":"2023-08-01T19:54:04.471767+0000","last_unstale":"2023-08-01T19:54:31.157241+0000","last_undegraded":"2023-08-01T19:54:31.157241+0000","last_fullsized":"2023-08-01T19:54:31.157241+0000","mapping_epoch":16,"log_start":"0'0","ondisk_log_start":"0'0","created":16,"last_epoch_clean":17,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-08-01T19:54:04.040663+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-08-01T19:54:04.040663+0000","last_clean_scrub_stamp":"2023-08-01T19:54:04.040663+0000","objects_scrubbed":0,"log_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-08-02T20:25:25.280329+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[2,1],"acting":[2,1],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":2,"acting_primary":2,"purged_snaps":[]},{"pgid":"3.17","version":"0'0","reported_seq":17,"reported_epoch":24,"state":"active+clean","last_fresh":"2023-08-01T19:54:31.157284+0000","last_change":"2023-08-01T19:54:04.067975+0000","last_active":"2023-08-01T19:54:31.157284+0000","last_peered":"2023-08-01T19:54:31.157284+0000","last_clean":"2023-08-01T19:54:31.157284+0000","last_became_active":"2023-08-01T19:54:04.067577+0000","last_became_peered":"2023-08-01T19:54:04.067577+0000","last_unstale":"2023-08-01T19:54:31.157284+0000","last_undegraded":"2023-08-01T19:54:31.157284+0000","last_fullsized":"2023-08-01T19:54:31.157284+0000","mapping_epoch":15,"log_start":"0'0","ondisk_log_start":"0'0","created":15,"last_epoch_clean":16,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-08-01T19:54:03.032665+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-08-01T19:54:03.032665+0000","last_clean_scrub_stamp":"2023-08-01T19:54:03.032665+0000","objects_scrubbed":0,"log_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-08-03T07:13:34.025722+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[0,1],"acting":[0,1],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":0,"acting_primary":0,"purged_snaps":[]},{"pgid":"4.10","version":"0'0","reported_seq":16,"reported_epoch":24,"state":"active+clean","last_fresh":"2023-08-01T19:54:31.156492+0000","last_change":"2023-08-01T19:54:04.467146+0000","last_active":"2023-08-01T19:54:31.156492+0000","last_peered":"2023-08-01T19:54:31.156492+0000","last_clean":"2023-08-01T19:54:31.156492+0000","last_became_active":"2023-08-01T19:54:04.466627+0000","last_became_peered":"2023-08-01T19:54:04.466627+0000","last_unstale":"2023-08-01T19:54:31.156492+0000","last_undegraded":"2023-08-01T19:54:31.156492+0000","last_fullsized":"2023-08-01T19:54:31.156492+0000","mapping_epoch":16,"log_start":"0'0","ondisk_log_start":"0'0","created":16,"last_epoch_clean":17,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-08-01T19:54:04.040663+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-08-01T19:54:04.040663+0000","last_clean_scrub_stamp":"2023-08-01T19:54:04.040663+0000","objects_scrubbed":0,"log_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-08-03T04:43:26.793480+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[0,2],"acting":[0,2],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":0,"acting_primary":0,"purged_snaps":[]},{"pgid":"3.16","version":"0'0","reported_seq":17,"reported_epoch":24,"state":"active+clean","last_fresh":"2023-08-01T19:54:31.164586+0000","last_change":"2023-08-01T19:54:04.065042+0000","last_active":"2023-08-01T19:54:31.164586+0000","last_peered":"2023-08-01T19:54:31.164586+0000","last_clean":"2023-08-01T19:54:31.164586+0000","last_became_active":"2023-08-01T19:54:04.064040+0000","last_became_peered":"2023-08-01T19:54:04.064040+0000","last_unstale":"2023-08-01T19:54:31.164586+0000","last_undegraded":"2023-08-01T19:54:31.164586+0000","last_fullsized":"2023-08-01T19:54:31.164586+0000","mapping_epoch":15,"log_start":"0'0","ondisk_log_start":"0'0","created":15,"last_epoch_clean":16,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-08-01T19:54:03.032665+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-08-01T19:54:03.032665+0000","last_clean_scrub_stamp":"2023-08-01T19:54:03.032665+0000","objects_scrubbed":0,"log_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-08-03T03:40:43.460182+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[1,0],"acting":[1,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":1,"acting_primary":1,"purged_snaps":[]},{"pgid":"4.11","version":"0'0","reported_seq":16,"reported_epoch":24,"state":"active+clean","last_fresh":"2023-08-01T19:54:31.157521+0000","last_change":"2023-08-01T19:54:04.470401+0000","last_active":"2023-08-01T19:54:31.157521+0000","last_peered":"2023-08-01T19:54:31.157521+0000","last_clean":"2023-08-01T19:54:31.157521+0000","last_became_active":"2023-08-01T19:54:04.469680+0000","last_became_peered":"2023-08-01T19:54:04.469680+0000","last_unstale":"2023-08-01T19:54:31.157521+0000","last_undegraded":"2023-08-01T19:54:31.157521+0000","last_fullsized":"2023-08-01T19:54:31.157521+0000","mapping_epoch":16,"log_start":"0'0","ondisk_log_start":"0'0","created":16,"last_epoch_clean":17,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-08-01T19:54:04.040663+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-08-01T19:54:04.040663+0000","last_clean_scrub_stamp":"2023-08-01T19:54:04.040663+0000","objects_scrubbed":0,"log_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-08-03T03:58:06.360840+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[0,1],"acting":[0,1],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":0,"acting_primary":0,"purged_snaps":[]},{"pgid":"3.15","version":"17'3","reported_seq":20,"reported_epoch":24,"state":"active+clean","last_fresh":"2023-08-01T19:54:31.156825+0000","last_change":"2023-08-01T19:54:04.065443+0000","last_active":"2023-08-01T19:54:31.156825+0000","last_peered":"2023-08-01T19:54:31.156825+0000","last_clean":"2023-08-01T19:54:31.156825+0000","last_became_active":"2023-08-01T19:54:04.065112+0000","last_became_peered":"2023-08-01T19:54:04.065112+0000","last_unstale":"2023-08-01T19:54:31.156825+0000","last_undegraded":"2023-08-01T19:54:31.156825+0000","last_fullsized":"2023-08-01T19:54:31.156825+0000","mapping_epoch":15,"log_start":"0'0","ondisk_log_start":"0'0","created":15,"last_epoch_clean":16,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-08-01T19:54:03.032665+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-08-01T19:54:03.032665+0000","last_clean_scrub_stamp":"2023-08-01T19:54:03.032665+0000","objects_scrubbed":0,"log_size":3,"ondisk_log_size":3,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-08-03T03:27:50.887004+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":90,"num_objects":2,"num_object_clones":0,"num_object_copies":4,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":2,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":4,"num_write_kb":1,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":1,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[2,1],"acting":[2,1],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":2,"acting_primary":2,"purged_snaps":[]},{"pgid":"4.12","version":"0'0","reported_seq":16,"reported_epoch":24,"state":"active+clean","last_fresh":"2023-08-01T19:54:31.157443+0000","last_change":"2023-08-01T19:54:04.467822+0000","last_active":"2023-08-01T19:54:31.157443+0000","last_peered":"2023-08-01T19:54:31.157443+0000","last_clean":"2023-08-01T19:54:31.157443+0000","last_became_active":"2023-08-01T19:54:04.466667+0000","last_became_peered":"2023-08-01T19:54:04.466667+0000","last_unstale":"2023-08-01T19:54:31.157443+0000","last_undegraded":"2023-08-01T19:54:31.157443+0000","last_fullsized":"2023-08-01T19:54:31.157443+0000","mapping_epoch":16,"log_start":"0'0","ondisk_log_start":"0'0","created":16,"last_epoch_clean":17,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-08-01T19:54:04.040663+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-08-01T19:54:04.040663+0000","last_clean_scrub_stamp":"2023-08-01T19:54:04.040663+0000","objects_scrubbed":0,"log_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-08-03T02:57:18.148077+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[0,2],"acting":[0,2],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":0,"acting_primary":0,"purged_snaps":[]},{"pgid":"3.14","version":"17'6","reported_seq":23,"reported_epoch":24,"state":"active+clean","last_fresh":"2023-08-01T19:54:31.164273+0000","last_change":"2023-08-01T19:54:04.061419+0000","last_active":"2023-08-01T19:54:31.164273+0000","last_peered":"2023-08-01T19:54:31.164273+0000","last_clean":"2023-08-01T19:54:31.164273+0000","last_became_active":"2023-08-01T19:54:04.061078+0000","last_became_peered":"2023-08-01T19:54:04.061078+0000","last_unstale":"2023-08-01T19:54:31.164273+0000","last_undegraded":"2023-08-01T19:54:31.164273+0000","last_fullsized":"2023-08-01T19:54:31.164273+0000","mapping_epoch":15,"log_start":"0'0","ondisk_log_start":"0'0","created":15,"last_epoch_clean":16,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-08-01T19:54:03.032665+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-08-01T19:54:03.032665+0000","last_clean_scrub_stamp":"2023-08-01T19:54:03.032665+0000","objects_scrubbed":0,"log_size":6,"ondisk_log_size":6,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-08-02T21:35:44.874727+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":1536,"num_objects":4,"num_object_clones":0,"num_object_copies":8,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":4,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":6,"num_write_kb":3,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":1,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[1,2],"acting":[1,2],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":1,"acting_primary":1,"purged_snaps":[]},{"pgid":"4.13","version":"0'0","reported_seq":16,"reported_epoch":24,"state":"active+clean","last_fresh":"2023-08-01T19:54:31.163919+0000","last_change":"2023-08-01T19:54:04.466400+0000","last_active":"2023-08-01T19:54:31.163919+0000","last_peered":"2023-08-01T19:54:31.163919+0000","last_clean":"2023-08-01T19:54:31.163919+0000","last_became_active":"2023-08-01T19:54:04.465979+0000","last_became_peered":"2023-08-01T19:54:04.465979+0000","last_unstale":"2023-08-01T19:54:31.163919+0000","last_undegraded":"2023-08-01T19:54:31.163919+0000","last_fullsized":"2023-08-01T19:54:31.163919+0000","mapping_epoch":16,"log_start":"0'0","ondisk_log_start":"0'0","created":16,"last_epoch_clean":17,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-08-01T19:54:04.040663+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-08-01T19:54:04.040663+0000","last_clean_scrub_stamp":"2023-08-01T19:54:04.040663+0000","objects_scrubbed":0,"log_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-08-02T20:20:59.989030+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[1,2],"acting":[1,2],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":1,"acting_primary":1,"purged_snaps":[]},{"pgid":"3.13","version":"17'2","reported_seq":19,"reported_epoch":24,"state":"active+clean","last_fresh":"2023-08-01T19:54:31.163847+0000","last_change":"2023-08-01T19:54:04.065212+0000","last_active":"2023-08-01T19:54:31.163847+0000","last_peered":"2023-08-01T19:54:31.163847+0000","last_clean":"2023-08-01T19:54:31.163847+0000","last_became_active":"2023-08-01T19:54:04.064375+0000","last_became_peered":"2023-08-01T19:54:04.064375+0000","last_unstale":"2023-08-01T19:54:31.163847+0000","last_undegraded":"2023-08-01T19:54:31.163847+0000","last_fullsized":"2023-08-01T19:54:31.163847+0000","mapping_epoch":15,"log_start":"0'0","ondisk_log_start":"0'0","created":15,"last_epoch_clean":16,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-08-01T19:54:03.032665+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-08-01T19:54:03.032665+0000","last_clean_scrub_stamp":"2023-08-01T19:54:03.032665+0000","objects_scrubbed":0,"log_size":2,"ondisk_log_size":2,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-08-03T06:17:37.910752+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":34,"num_objects":2,"num_object_clones":0,"num_object_copies":4,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":2,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":3,"num_write_kb":6,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":1,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[1,0],"acting":[1,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":1,"acting_primary":1,"purged_snaps":[]},{"pgid":"4.14","version":"0'0","reported_seq":16,"reported_epoch":24,"state":"active+clean","last_fresh":"2023-08-01T19:54:31.156704+0000","last_change":"2023-08-01T19:54:04.464446+0000","last_active":"2023-08-01T19:54:31.156704+0000","last_peered":"2023-08-01T19:54:31.156704+0000","last_clean":"2023-08-01T19:54:31.156704+0000","last_became_active":"2023-08-01T19:54:04.464021+0000","last_became_peered":"2023-08-01T19:54:04.464021+0000","last_unstale":"2023-08-01T19:54:31.156704+0000","last_undegraded":"2023-08-01T19:54:31.156704+0000","last_fullsized":"2023-08-01T19:54:31.156704+0000","mapping_epoch":16,"log_start":"0'0","ondisk_log_start":"0'0","created":16,"last_epoch_clean":17,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-08-01T19:54:04.040663+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-08-01T19:54:04.040663+0000","last_clean_scrub_stamp":"2023-08-01T19:54:04.040663+0000","objects_scrubbed":0,"log_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-08-02T20:26:51.080849+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[2,0],"acting":[2,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":2,"acting_primary":2,"purged_snaps":[]},{"pgid":"3.12","version":"0'0","reported_seq":17,"reported_epoch":24,"state":"active+clean","last_fresh":"2023-08-01T19:54:31.157475+0000","last_change":"2023-08-01T19:54:04.066566+0000","last_active":"2023-08-01T19:54:31.157475+0000","last_peered":"2023-08-01T19:54:31.157475+0000","last_clean":"2023-08-01T19:54:31.157475+0000","last_became_active":"2023-08-01T19:54:04.066190+0000","last_became_peered":"2023-08-01T19:54:04.066190+0000","last_unstale":"2023-08-01T19:54:31.157475+0000","last_undegraded":"2023-08-01T19:54:31.157475+0000","last_fullsized":"2023-08-01T19:54:31.157475+0000","mapping_epoch":15,"log_start":"0'0","ondisk_log_start":"0'0","created":15,"last_epoch_clean":16,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-08-01T19:54:03.032665+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-08-01T19:54:03.032665+0000","last_clean_scrub_stamp":"2023-08-01T19:54:03.032665+0000","objects_scrubbed":0,"log_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-08-03T02:01:47.073630+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[0,1],"acting":[0,1],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":0,"acting_primary":0,"purged_snaps":[]},{"pgid":"4.15","version":"0'0","reported_seq":16,"reported_epoch":24,"state":"active+clean","last_fresh":"2023-08-01T19:54:31.157196+0000","last_change":"2023-08-01T19:54:04.468791+0000","last_active":"2023-08-01T19:54:31.157196+0000","last_peered":"2023-08-01T19:54:31.157196+0000","last_clean":"2023-08-01T19:54:31.157196+0000","last_became_active":"2023-08-01T19:54:04.468214+0000","last_became_peered":"2023-08-01T19:54:04.468214+0000","last_unstale":"2023-08-01T19:54:31.157196+0000","last_undegraded":"2023-08-01T19:54:31.157196+0000","last_fullsized":"2023-08-01T19:54:31.157196+0000","mapping_epoch":16,"log_start":"0'0","ondisk_log_start":"0'0","created":16,"last_epoch_clean":17,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-08-01T19:54:04.040663+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-08-01T19:54:04.040663+0000","last_clean_scrub_stamp":"2023-08-01T19:54:04.040663+0000","objects_scrubbed":0,"log_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-08-03T04:10:44.729287+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[2,0],"acting":[2,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":2,"acting_primary":2,"purged_snaps":[]},{"pgid":"3.11","version":"0'0","reported_seq":17,"reported_epoch":24,"state":"active+clean","last_fresh":"2023-08-01T19:54:31.156936+0000","last_change":"2023-08-01T19:54:04.064280+0000","last_active":"2023-08-01T19:54:31.156936+0000","last_peered":"2023-08-01T19:54:31.156936+0000","last_clean":"2023-08-01T19:54:31.156936+0000","last_became_active":"2023-08-01T19:54:04.064064+0000","last_became_peered":"2023-08-01T19:54:04.064064+0000","last_unstale":"2023-08-01T19:54:31.156936+0000","last_undegraded":"2023-08-01T19:54:31.156936+0000","last_fullsized":"2023-08-01T19:54:31.156936+0000","mapping_epoch":15,"log_start":"0'0","ondisk_log_start":"0'0","created":15,"last_epoch_clean":16,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-08-01T19:54:03.032665+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-08-01T19:54:03.032665+0000","last_clean_scrub_stamp":"2023-08-01T19:54:03.032665+0000","objects_scrubbed":0,"log_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-08-03T06:13:51.475710+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[2,1],"acting":[2,1],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":2,"acting_primary":2,"purged_snaps":[]},{"pgid":"4.16","version":"0'0","reported_seq":16,"reported_epoch":24,"state":"active+clean","last_fresh":"2023-08-01T19:54:31.157775+0000","last_change":"2023-08-01T19:54:04.469724+0000","last_active":"2023-08-01T19:54:31.157775+0000","last_peered":"2023-08-01T19:54:31.157775+0000","last_clean":"2023-08-01T19:54:31.157775+0000","last_became_active":"2023-08-01T19:54:04.469275+0000","last_became_peered":"2023-08-01T19:54:04.469275+0000","last_unstale":"2023-08-01T19:54:31.157775+0000","last_undegraded":"2023-08-01T19:54:31.157775+0000","last_fullsized":"2023-08-01T19:54:31.157775+0000","mapping_epoch":16,"log_start":"0'0","ondisk_log_start":"0'0","created":16,"last_epoch_clean":17,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-08-01T19:54:04.040663+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-08-01T19:54:04.040663+0000","last_clean_scrub_stamp":"2023-08-01T19:54:04.040663+0000","objects_scrubbed":0,"log_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-08-03T03:04:06.137335+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[0,1],"acting":[0,1],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":0,"acting_primary":0,"purged_snaps":[]},{"pgid":"3.10","version":"17'8","reported_seq":25,"reported_epoch":24,"state":"active+clean","last_fresh":"2023-08-01T19:54:31.163590+0000","last_change":"2023-08-01T19:54:04.060962+0000","last_active":"2023-08-01T19:54:31.163590+0000","last_peered":"2023-08-01T19:54:31.163590+0000","last_clean":"2023-08-01T19:54:31.163590+0000","last_became_active":"2023-08-01T19:54:04.060576+0000","last_became_peered":"2023-08-01T19:54:04.060576+0000","last_unstale":"2023-08-01T19:54:31.163590+0000","last_undegraded":"2023-08-01T19:54:31.163590+0000","last_fullsized":"2023-08-01T19:54:31.163590+0000","mapping_epoch":15,"log_start":"0'0","ondisk_log_start":"0'0","created":15,"last_epoch_clean":16,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-08-01T19:54:03.032665+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-08-01T19:54:03.032665+0000","last_clean_scrub_stamp":"2023-08-01T19:54:03.032665+0000","objects_scrubbed":0,"log_size":8,"ondisk_log_size":8,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-08-03T05:00:51.171444+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":4,"num_object_clones":0,"num_object_copies":8,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":4,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":12,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":4,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[1,2],"acting":[1,2],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":1,"acting_primary":1,"purged_snaps":[]},{"pgid":"4.17","version":"0'0","reported_seq":16,"reported_epoch":24,"state":"active+clean","last_fresh":"2023-08-01T19:54:31.157444+0000","last_change":"2023-08-01T19:54:04.472721+0000","last_active":"2023-08-01T19:54:31.157444+0000","last_peered":"2023-08-01T19:54:31.157444+0000","last_clean":"2023-08-01T19:54:31.157444+0000","last_became_active":"2023-08-01T19:54:04.472126+0000","last_became_peered":"2023-08-01T19:54:04.472126+0000","last_unstale":"2023-08-01T19:54:31.157444+0000","last_undegraded":"2023-08-01T19:54:31.157444+0000","last_fullsized":"2023-08-01T19:54:31.157444+0000","mapping_epoch":16,"log_start":"0'0","ondisk_log_start":"0'0","created":16,"last_epoch_clean":17,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-08-01T19:54:04.040663+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-08-01T19:54:04.040663+0000","last_clean_scrub_stamp":"2023-08-01T19:54:04.040663+0000","objects_scrubbed":0,"log_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-08-03T00:29:05.857138+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[0,1],"acting":[0,1],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":0,"acting_primary":0,"purged_snaps":[]},{"pgid":"5.9","version":"25'2334","reported_seq":2346,"reported_epoch":25,"state":"active+clean","last_fresh":"2023-08-01T19:54:34.915434+0000","last_change":"2023-08-01T19:54:23.134838+0000","last_active":"2023-08-01T19:54:34.915434+0000","last_peered":"2023-08-01T19:54:34.915434+0000","last_clean":"2023-08-01T19:54:34.915434+0000","last_became_active":"2023-08-01T19:54:23.134628+0000","last_became_peered":"2023-08-01T19:54:23.134628+0000","last_unstale":"2023-08-01T19:54:34.915434+0000","last_undegraded":"2023-08-01T19:54:34.915434+0000","last_fullsized":"2023-08-01T19:54:34.915434+0000","mapping_epoch":19,"log_start":"0'0","ondisk_log_start":"0'0","created":19,"last_epoch_clean":20,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-08-01T19:54:22.116710+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-08-01T19:54:22.116710+0000","last_clean_scrub_stamp":"2023-08-01T19:54:22.116710+0000","objects_scrubbed":0,"log_size":2334,"ondisk_log_size":2334,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-08-03T05:57:20.085794+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":152961024,"num_objects":2334,"num_object_clones":0,"num_object_copies":4668,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":2334,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":2334,"num_write_kb":149376,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[1,2],"acting":[1,2],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":1,"acting_primary":1,"purged_snaps":[]},{"pgid":"3.f","version":"17'1","reported_seq":18,"reported_epoch":24,"state":"active+clean","last_fresh":"2023-08-01T19:54:31.164812+0000","last_change":"2023-08-01T19:54:04.060797+0000","last_active":"2023-08-01T19:54:31.164812+0000","last_peered":"2023-08-01T19:54:31.164812+0000","last_clean":"2023-08-01T19:54:31.164812+0000","last_became_active":"2023-08-01T19:54:04.060444+0000","last_became_peered":"2023-08-01T19:54:04.060444+0000","last_unstale":"2023-08-01T19:54:31.164812+0000","last_undegraded":"2023-08-01T19:54:31.164812+0000","last_fullsized":"2023-08-01T19:54:31.164812+0000","mapping_epoch":15,"log_start":"0'0","ondisk_log_start":"0'0","created":15,"last_epoch_clean":16,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-08-01T19:54:03.032665+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-08-01T19:54:03.032665+0000","last_clean_scrub_stamp":"2023-08-01T19:54:03.032665+0000","objects_scrubbed":0,"log_size":1,"ondisk_log_size":1,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-08-03T07:13:34.025722+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":22,"num_objects":1,"num_object_clones":0,"num_object_copies":2,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":1,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":1,"num_write_kb":1,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[1,2],"acting":[1,2],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":1,"acting_primary":1,"purged_snaps":[]},{"pgid":"4.8","version":"0'0","reported_seq":16,"reported_epoch":24,"state":"active+clean","last_fresh":"2023-08-01T19:54:31.156285+0000","last_change":"2023-08-01T19:54:04.467671+0000","last_active":"2023-08-01T19:54:31.156285+0000","last_peered":"2023-08-01T19:54:31.156285+0000","last_clean":"2023-08-01T19:54:31.156285+0000","last_became_active":"2023-08-01T19:54:04.467300+0000","last_became_peered":"2023-08-01T19:54:04.467300+0000","last_unstale":"2023-08-01T19:54:31.156285+0000","last_undegraded":"2023-08-01T19:54:31.156285+0000","last_fullsized":"2023-08-01T19:54:31.156285+0000","mapping_epoch":16,"log_start":"0'0","ondisk_log_start":"0'0","created":16,"last_epoch_clean":17,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-08-01T19:54:04.040663+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-08-01T19:54:04.040663+0000","last_clean_scrub_stamp":"2023-08-01T19:54:04.040663+0000","objects_scrubbed":0,"log_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-08-03T05:27:24.774345+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[2,1],"acting":[2,1],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":2,"acting_primary":2,"purged_snaps":[]},{"pgid":"5.8","version":"25'2479","reported_seq":2492,"reported_epoch":25,"state":"active+clean","last_fresh":"2023-08-01T19:54:36.040328+0000","last_change":"2023-08-01T19:54:23.139383+0000","last_active":"2023-08-01T19:54:36.040328+0000","last_peered":"2023-08-01T19:54:36.040328+0000","last_clean":"2023-08-01T19:54:36.040328+0000","last_became_active":"2023-08-01T19:54:23.139198+0000","last_became_peered":"2023-08-01T19:54:23.139198+0000","last_unstale":"2023-08-01T19:54:36.040328+0000","last_undegraded":"2023-08-01T19:54:36.040328+0000","last_fullsized":"2023-08-01T19:54:36.040328+0000","mapping_epoch":19,"log_start":"0'0","ondisk_log_start":"0'0","created":19,"last_epoch_clean":20,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-08-01T19:54:22.116710+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-08-01T19:54:22.116710+0000","last_clean_scrub_stamp":"2023-08-01T19:54:22.116710+0000","objects_scrubbed":0,"log_size":2479,"ondisk_log_size":2479,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-08-03T05:20:31.724064+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":162463744,"num_objects":2479,"num_object_clones":0,"num_object_copies":4958,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":2479,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":2479,"num_write_kb":158656,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[2,0],"acting":[2,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":2,"acting_primary":2,"purged_snaps":[]},{"pgid":"3.e","version":"17'2","reported_seq":19,"reported_epoch":24,"state":"active+clean","last_fresh":"2023-08-01T19:54:31.157310+0000","last_change":"2023-08-01T19:54:04.065595+0000","last_active":"2023-08-01T19:54:31.157310+0000","last_peered":"2023-08-01T19:54:31.157310+0000","last_clean":"2023-08-01T19:54:31.157310+0000","last_became_active":"2023-08-01T19:54:04.065303+0000","last_became_peered":"2023-08-01T19:54:04.065303+0000","last_unstale":"2023-08-01T19:54:31.157310+0000","last_undegraded":"2023-08-01T19:54:31.157310+0000","last_fullsized":"2023-08-01T19:54:31.157310+0000","mapping_epoch":15,"log_start":"0'0","ondisk_log_start":"0'0","created":15,"last_epoch_clean":16,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-08-01T19:54:03.032665+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-08-01T19:54:03.032665+0000","last_clean_scrub_stamp":"2023-08-01T19:54:03.032665+0000","objects_scrubbed":0,"log_size":2,"ondisk_log_size":2,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-08-02T22:40:38.782053+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":1,"num_object_clones":0,"num_object_copies":2,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":1,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":3,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":1,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[2,1],"acting":[2,1],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":2,"acting_primary":2,"purged_snaps":[]},{"pgid":"4.9","version":"0'0","reported_seq":16,"reported_epoch":24,"state":"active+clean","last_fresh":"2023-08-01T19:54:31.157116+0000","last_change":"2023-08-01T19:54:04.468007+0000","last_active":"2023-08-01T19:54:31.157116+0000","last_peered":"2023-08-01T19:54:31.157116+0000","last_clean":"2023-08-01T19:54:31.157116+0000","last_became_active":"2023-08-01T19:54:04.467509+0000","last_became_peered":"2023-08-01T19:54:04.467509+0000","last_unstale":"2023-08-01T19:54:31.157116+0000","last_undegraded":"2023-08-01T19:54:31.157116+0000","last_fullsized":"2023-08-01T19:54:31.157116+0000","mapping_epoch":16,"log_start":"0'0","ondisk_log_start":"0'0","created":16,"last_epoch_clean":17,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-08-01T19:54:04.040663+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-08-01T19:54:04.040663+0000","last_clean_scrub_stamp":"2023-08-01T19:54:04.040663+0000","objects_scrubbed":0,"log_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-08-03T06:04:50.963711+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[2,0],"acting":[2,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":2,"acting_primary":2,"purged_snaps":[]},{"pgid":"5.b","version":"25'2435","reported_seq":2448,"reported_epoch":25,"state":"active+clean","last_fresh":"2023-08-01T19:54:36.033731+0000","last_change":"2023-08-01T19:54:23.138143+0000","last_active":"2023-08-01T19:54:36.033731+0000","last_peered":"2023-08-01T19:54:36.033731+0000","last_clean":"2023-08-01T19:54:36.033731+0000","last_became_active":"2023-08-01T19:54:23.137922+0000","last_became_peered":"2023-08-01T19:54:23.137922+0000","last_unstale":"2023-08-01T19:54:36.033731+0000","last_undegraded":"2023-08-01T19:54:36.033731+0000","last_fullsized":"2023-08-01T19:54:36.033731+0000","mapping_epoch":19,"log_start":"0'0","ondisk_log_start":"0'0","created":19,"last_epoch_clean":20,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-08-01T19:54:22.116710+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-08-01T19:54:22.116710+0000","last_clean_scrub_stamp":"2023-08-01T19:54:22.116710+0000","objects_scrubbed":0,"log_size":2435,"ondisk_log_size":2435,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-08-02T23:27:13.080055+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":159580160,"num_objects":2435,"num_object_clones":0,"num_object_copies":4870,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":2435,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":2435,"num_write_kb":155840,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[2,0],"acting":[2,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":2,"acting_primary":2,"purged_snaps":[]},{"pgid":"3.d","version":"17'1","reported_seq":18,"reported_epoch":24,"state":"active+clean","last_fresh":"2023-08-01T19:54:31.164949+0000","last_change":"2023-08-01T19:54:04.062853+0000","last_active":"2023-08-01T19:54:31.164949+0000","last_peered":"2023-08-01T19:54:31.164949+0000","last_clean":"2023-08-01T19:54:31.164949+0000","last_became_active":"2023-08-01T19:54:04.062598+0000","last_became_peered":"2023-08-01T19:54:04.062598+0000","last_unstale":"2023-08-01T19:54:31.164949+0000","last_undegraded":"2023-08-01T19:54:31.164949+0000","last_fullsized":"2023-08-01T19:54:31.164949+0000","mapping_epoch":15,"log_start":"0'0","ondisk_log_start":"0'0","created":15,"last_epoch_clean":16,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-08-01T19:54:03.032665+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-08-01T19:54:03.032665+0000","last_clean_scrub_stamp":"2023-08-01T19:54:03.032665+0000","objects_scrubbed":0,"log_size":1,"ondisk_log_size":1,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-08-02T20:56:47.324761+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":70,"num_objects":1,"num_object_clones":0,"num_object_copies":2,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":1,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":1,"num_write_kb":1,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[1,2],"acting":[1,2],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":1,"acting_primary":1,"purged_snaps":[]},{"pgid":"4.a","version":"0'0","reported_seq":16,"reported_epoch":24,"state":"active+clean","last_fresh":"2023-08-01T19:54:31.163742+0000","last_change":"2023-08-01T19:54:04.471997+0000","last_active":"2023-08-01T19:54:31.163742+0000","last_peered":"2023-08-01T19:54:31.163742+0000","last_clean":"2023-08-01T19:54:31.163742+0000","last_became_active":"2023-08-01T19:54:04.471204+0000","last_became_peered":"2023-08-01T19:54:04.471204+0000","last_unstale":"2023-08-01T19:54:31.163742+0000","last_undegraded":"2023-08-01T19:54:31.163742+0000","last_fullsized":"2023-08-01T19:54:31.163742+0000","mapping_epoch":16,"log_start":"0'0","ondisk_log_start":"0'0","created":16,"last_epoch_clean":17,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-08-01T19:54:04.040663+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-08-01T19:54:04.040663+0000","last_clean_scrub_stamp":"2023-08-01T19:54:04.040663+0000","objects_scrubbed":0,"log_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-08-02T23:12:30.830199+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[1,0],"acting":[1,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":1,"acting_primary":1,"purged_snaps":[]},{"pgid":"5.a","version":"25'2259","reported_seq":2272,"reported_epoch":25,"state":"active+clean","last_fresh":"2023-08-01T19:54:34.918191+0000","last_change":"2023-08-01T19:54:23.138147+0000","last_active":"2023-08-01T19:54:34.918191+0000","last_peered":"2023-08-01T19:54:34.918191+0000","last_clean":"2023-08-01T19:54:34.918191+0000","last_became_active":"2023-08-01T19:54:23.137827+0000","last_became_peered":"2023-08-01T19:54:23.137827+0000","last_unstale":"2023-08-01T19:54:34.918191+0000","last_undegraded":"2023-08-01T19:54:34.918191+0000","last_fullsized":"2023-08-01T19:54:34.918191+0000","mapping_epoch":19,"log_start":"0'0","ondisk_log_start":"0'0","created":19,"last_epoch_clean":20,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-08-01T19:54:22.116710+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-08-01T19:54:22.116710+0000","last_clean_scrub_stamp":"2023-08-01T19:54:22.116710+0000","objects_scrubbed":0,"log_size":2259,"ondisk_log_size":2259,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-08-03T05:22:32.106433+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":148045824,"num_objects":2259,"num_object_clones":0,"num_object_copies":4518,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":2259,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":2259,"num_write_kb":144576,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[0,2],"acting":[0,2],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":0,"acting_primary":0,"purged_snaps":[]},{"pgid":"3.c","version":"0'0","reported_seq":17,"reported_epoch":24,"state":"active+clean","last_fresh":"2023-08-01T19:54:31.164015+0000","last_change":"2023-08-01T19:54:04.063532+0000","last_active":"2023-08-01T19:54:31.164015+0000","last_peered":"2023-08-01T19:54:31.164015+0000","last_clean":"2023-08-01T19:54:31.164015+0000","last_became_active":"2023-08-01T19:54:04.063116+0000","last_became_peered":"2023-08-01T19:54:04.063116+0000","last_unstale":"2023-08-01T19:54:31.164015+0000","last_undegraded":"2023-08-01T19:54:31.164015+0000","last_fullsized":"2023-08-01T19:54:31.164015+0000","mapping_epoch":15,"log_start":"0'0","ondisk_log_start":"0'0","created":15,"last_epoch_clean":16,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-08-01T19:54:03.032665+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-08-01T19:54:03.032665+0000","last_clean_scrub_stamp":"2023-08-01T19:54:03.032665+0000","objects_scrubbed":0,"log_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-08-02T22:28:51.936138+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[1,0],"acting":[1,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":1,"acting_primary":1,"purged_snaps":[]},{"pgid":"4.b","version":"0'0","reported_seq":16,"reported_epoch":24,"state":"active+clean","last_fresh":"2023-08-01T19:54:31.157074+0000","last_change":"2023-08-01T19:54:04.470787+0000","last_active":"2023-08-01T19:54:31.157074+0000","last_peered":"2023-08-01T19:54:31.157074+0000","last_clean":"2023-08-01T19:54:31.157074+0000","last_became_active":"2023-08-01T19:54:04.470332+0000","last_became_peered":"2023-08-01T19:54:04.470332+0000","last_unstale":"2023-08-01T19:54:31.157074+0000","last_undegraded":"2023-08-01T19:54:31.157074+0000","last_fullsized":"2023-08-01T19:54:31.157074+0000","mapping_epoch":16,"log_start":"0'0","ondisk_log_start":"0'0","created":16,"last_epoch_clean":17,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-08-01T19:54:04.040663+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-08-01T19:54:04.040663+0000","last_clean_scrub_stamp":"2023-08-01T19:54:04.040663+0000","objects_scrubbed":0,"log_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-08-03T05:13:38.298401+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[0,1],"acting":[0,1],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":0,"acting_primary":0,"purged_snaps":[]},{"pgid":"5.d","version":"25'2356","reported_seq":2369,"reported_epoch":25,"state":"active+clean","last_fresh":"2023-08-01T19:54:36.041055+0000","last_change":"2023-08-01T19:54:23.134380+0000","last_active":"2023-08-01T19:54:36.041055+0000","last_peered":"2023-08-01T19:54:36.041055+0000","last_clean":"2023-08-01T19:54:36.041055+0000","last_became_active":"2023-08-01T19:54:23.134100+0000","last_became_peered":"2023-08-01T19:54:23.134100+0000","last_unstale":"2023-08-01T19:54:36.041055+0000","last_undegraded":"2023-08-01T19:54:36.041055+0000","last_fullsized":"2023-08-01T19:54:36.041055+0000","mapping_epoch":19,"log_start":"0'0","ondisk_log_start":"0'0","created":19,"last_epoch_clean":20,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-08-01T19:54:22.116710+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-08-01T19:54:22.116710+0000","last_clean_scrub_stamp":"2023-08-01T19:54:22.116710+0000","objects_scrubbed":0,"log_size":2356,"ondisk_log_size":2356,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-08-02T22:07:43.756233+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":154402816,"num_objects":2356,"num_object_clones":0,"num_object_copies":4712,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":2356,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":2356,"num_write_kb":150784,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[2,1],"acting":[2,1],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":2,"acting_primary":2,"purged_snaps":[]},{"pgid":"3.b","version":"17'2","reported_seq":19,"reported_epoch":24,"state":"active+clean","last_fresh":"2023-08-01T19:54:31.156954+0000","last_change":"2023-08-01T19:54:04.066839+0000","last_active":"2023-08-01T19:54:31.156954+0000","last_peered":"2023-08-01T19:54:31.156954+0000","last_clean":"2023-08-01T19:54:31.156954+0000","last_became_active":"2023-08-01T19:54:04.065535+0000","last_became_peered":"2023-08-01T19:54:04.065535+0000","last_unstale":"2023-08-01T19:54:31.156954+0000","last_undegraded":"2023-08-01T19:54:31.156954+0000","last_fullsized":"2023-08-01T19:54:31.156954+0000","mapping_epoch":15,"log_start":"0'0","ondisk_log_start":"0'0","created":15,"last_epoch_clean":16,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-08-01T19:54:03.032665+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-08-01T19:54:03.032665+0000","last_clean_scrub_stamp":"2023-08-01T19:54:03.032665+0000","objects_scrubbed":0,"log_size":2,"ondisk_log_size":2,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-08-03T05:00:51.171444+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":1,"num_object_clones":0,"num_object_copies":2,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":1,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":1,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":1,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[0,1],"acting":[0,1],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":0,"acting_primary":0,"purged_snaps":[]},{"pgid":"4.c","version":"0'0","reported_seq":16,"reported_epoch":24,"state":"active+clean","last_fresh":"2023-08-01T19:54:31.164089+0000","last_change":"2023-08-01T19:54:04.478715+0000","last_active":"2023-08-01T19:54:31.164089+0000","last_peered":"2023-08-01T19:54:31.164089+0000","last_clean":"2023-08-01T19:54:31.164089+0000","last_became_active":"2023-08-01T19:54:04.477435+0000","last_became_peered":"2023-08-01T19:54:04.477435+0000","last_unstale":"2023-08-01T19:54:31.164089+0000","last_undegraded":"2023-08-01T19:54:31.164089+0000","last_fullsized":"2023-08-01T19:54:31.164089+0000","mapping_epoch":16,"log_start":"0'0","ondisk_log_start":"0'0","created":16,"last_epoch_clean":17,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-08-01T19:54:04.040663+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-08-01T19:54:04.040663+0000","last_clean_scrub_stamp":"2023-08-01T19:54:04.040663+0000","objects_scrubbed":0,"log_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-08-03T04:43:21.408174+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[1,0],"acting":[1,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":1,"acting_primary":1,"purged_snaps":[]},{"pgid":"5.c","version":"25'2331","reported_seq":2344,"reported_epoch":25,"state":"active+clean","last_fresh":"2023-08-01T19:54:34.911087+0000","last_change":"2023-08-01T19:54:23.138439+0000","last_active":"2023-08-01T19:54:34.911087+0000","last_peered":"2023-08-01T19:54:34.911087+0000","last_clean":"2023-08-01T19:54:34.911087+0000","last_became_active":"2023-08-01T19:54:23.138051+0000","last_became_peered":"2023-08-01T19:54:23.138051+0000","last_unstale":"2023-08-01T19:54:34.911087+0000","last_undegraded":"2023-08-01T19:54:34.911087+0000","last_fullsized":"2023-08-01T19:54:34.911087+0000","mapping_epoch":19,"log_start":"0'0","ondisk_log_start":"0'0","created":19,"last_epoch_clean":20,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-08-01T19:54:22.116710+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-08-01T19:54:22.116710+0000","last_clean_scrub_stamp":"2023-08-01T19:54:22.116710+0000","objects_scrubbed":0,"log_size":2331,"ondisk_log_size":2331,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-08-03T03:01:16.402814+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":152764416,"num_objects":2331,"num_object_clones":0,"num_object_copies":4662,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":2331,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":2331,"num_write_kb":149184,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[0,1],"acting":[0,1],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":0,"acting_primary":0,"purged_snaps":[]},{"pgid":"3.a","version":"0'0","reported_seq":17,"reported_epoch":24,"state":"active+clean","last_fresh":"2023-08-01T19:54:31.163582+0000","last_change":"2023-08-01T19:54:04.065267+0000","last_active":"2023-08-01T19:54:31.163582+0000","last_peered":"2023-08-01T19:54:31.163582+0000","last_clean":"2023-08-01T19:54:31.163582+0000","last_became_active":"2023-08-01T19:54:04.064912+0000","last_became_peered":"2023-08-01T19:54:04.064912+0000","last_unstale":"2023-08-01T19:54:31.163582+0000","last_undegraded":"2023-08-01T19:54:31.163582+0000","last_fullsized":"2023-08-01T19:54:31.163582+0000","mapping_epoch":15,"log_start":"0'0","ondisk_log_start":"0'0","created":15,"last_epoch_clean":16,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-08-01T19:54:03.032665+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-08-01T19:54:03.032665+0000","last_clean_scrub_stamp":"2023-08-01T19:54:03.032665+0000","objects_scrubbed":0,"log_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-08-03T02:37:09.180970+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[1,0],"acting":[1,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":1,"acting_primary":1,"purged_snaps":[]},{"pgid":"4.d","version":"0'0","reported_seq":16,"reported_epoch":24,"state":"active+clean","last_fresh":"2023-08-01T19:54:31.165115+0000","last_change":"2023-08-01T19:54:04.474755+0000","last_active":"2023-08-01T19:54:31.165115+0000","last_peered":"2023-08-01T19:54:31.165115+0000","last_clean":"2023-08-01T19:54:31.165115+0000","last_became_active":"2023-08-01T19:54:04.471526+0000","last_became_peered":"2023-08-01T19:54:04.471526+0000","last_unstale":"2023-08-01T19:54:31.165115+0000","last_undegraded":"2023-08-01T19:54:31.165115+0000","last_fullsized":"2023-08-01T19:54:31.165115+0000","mapping_epoch":16,"log_start":"0'0","ondisk_log_start":"0'0","created":16,"last_epoch_clean":17,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-08-01T19:54:04.040663+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-08-01T19:54:04.040663+0000","last_clean_scrub_stamp":"2023-08-01T19:54:04.040663+0000","objects_scrubbed":0,"log_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-08-03T06:50:03.420334+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[1,2],"acting":[1,2],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":1,"acting_primary":1,"purged_snaps":[]},{"pgid":"5.f","version":"25'2299","reported_seq":2312,"reported_epoch":25,"state":"active+clean","last_fresh":"2023-08-01T19:54:34.911458+0000","last_change":"2023-08-01T19:54:23.134608+0000","last_active":"2023-08-01T19:54:34.911458+0000","last_peered":"2023-08-01T19:54:34.911458+0000","last_clean":"2023-08-01T19:54:34.911458+0000","last_became_active":"2023-08-01T19:54:23.134360+0000","last_became_peered":"2023-08-01T19:54:23.134360+0000","last_unstale":"2023-08-01T19:54:34.911458+0000","last_undegraded":"2023-08-01T19:54:34.911458+0000","last_fullsized":"2023-08-01T19:54:34.911458+0000","mapping_epoch":19,"log_start":"0'0","ondisk_log_start":"0'0","created":19,"last_epoch_clean":20,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-08-01T19:54:22.116710+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-08-01T19:54:22.116710+0000","last_clean_scrub_stamp":"2023-08-01T19:54:22.116710+0000","objects_scrubbed":0,"log_size":2299,"ondisk_log_size":2299,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-08-03T06:01:12.916557+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":150667264,"num_objects":2299,"num_object_clones":0,"num_object_copies":4598,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":2299,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":2299,"num_write_kb":147136,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[1,2],"acting":[1,2],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":1,"acting_primary":1,"purged_snaps":[]},{"pgid":"3.9","version":"0'0","reported_seq":17,"reported_epoch":24,"state":"active+clean","last_fresh":"2023-08-01T19:54:31.156369+0000","last_change":"2023-08-01T19:54:04.065519+0000","last_active":"2023-08-01T19:54:31.156369+0000","last_peered":"2023-08-01T19:54:31.156369+0000","last_clean":"2023-08-01T19:54:31.156369+0000","last_became_active":"2023-08-01T19:54:04.065211+0000","last_became_peered":"2023-08-01T19:54:04.065211+0000","last_unstale":"2023-08-01T19:54:31.156369+0000","last_undegraded":"2023-08-01T19:54:31.156369+0000","last_fullsized":"2023-08-01T19:54:31.156369+0000","mapping_epoch":15,"log_start":"0'0","ondisk_log_start":"0'0","created":15,"last_epoch_clean":16,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-08-01T19:54:03.032665+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-08-01T19:54:03.032665+0000","last_clean_scrub_stamp":"2023-08-01T19:54:03.032665+0000","objects_scrubbed":0,"log_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-08-03T05:46:27.672957+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[2,1],"acting":[2,1],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":2,"acting_primary":2,"purged_snaps":[]},{"pgid":"4.e","version":"0'0","reported_seq":16,"reported_epoch":24,"state":"active+clean","last_fresh":"2023-08-01T19:54:31.164647+0000","last_change":"2023-08-01T19:54:04.473750+0000","last_active":"2023-08-01T19:54:31.164647+0000","last_peered":"2023-08-01T19:54:31.164647+0000","last_clean":"2023-08-01T19:54:31.164647+0000","last_became_active":"2023-08-01T19:54:04.471512+0000","last_became_peered":"2023-08-01T19:54:04.471512+0000","last_unstale":"2023-08-01T19:54:31.164647+0000","last_undegraded":"2023-08-01T19:54:31.164647+0000","last_fullsized":"2023-08-01T19:54:31.164647+0000","mapping_epoch":16,"log_start":"0'0","ondisk_log_start":"0'0","created":16,"last_epoch_clean":17,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-08-01T19:54:04.040663+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-08-01T19:54:04.040663+0000","last_clean_scrub_stamp":"2023-08-01T19:54:04.040663+0000","objects_scrubbed":0,"log_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-08-03T05:13:38.298401+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[1,2],"acting":[1,2],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":1,"acting_primary":1,"purged_snaps":[]},{"pgid":"5.e","version":"25'2514","reported_seq":2527,"reported_epoch":25,"state":"active+clean","last_fresh":"2023-08-01T19:54:36.034016+0000","last_change":"2023-08-01T19:54:23.138341+0000","last_active":"2023-08-01T19:54:36.034016+0000","last_peered":"2023-08-01T19:54:36.034016+0000","last_clean":"2023-08-01T19:54:36.034016+0000","last_became_active":"2023-08-01T19:54:23.138119+0000","last_became_peered":"2023-08-01T19:54:23.138119+0000","last_unstale":"2023-08-01T19:54:36.034016+0000","last_undegraded":"2023-08-01T19:54:36.034016+0000","last_fullsized":"2023-08-01T19:54:36.034016+0000","mapping_epoch":19,"log_start":"0'0","ondisk_log_start":"0'0","created":19,"last_epoch_clean":20,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-08-01T19:54:22.116710+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-08-01T19:54:22.116710+0000","last_clean_scrub_stamp":"2023-08-01T19:54:22.116710+0000","objects_scrubbed":0,"log_size":2514,"ondisk_log_size":2514,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-08-03T07:48:27.709982+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":164757504,"num_objects":2514,"num_object_clones":0,"num_object_copies":5028,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":2514,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":2514,"num_write_kb":160896,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[2,0],"acting":[2,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":2,"acting_primary":2,"purged_snaps":[]},{"pgid":"3.8","version":"0'0","reported_seq":17,"reported_epoch":24,"state":"active+clean","last_fresh":"2023-08-01T19:54:31.156431+0000","last_change":"2023-08-01T19:54:04.063990+0000","last_active":"2023-08-01T19:54:31.156431+0000","last_peered":"2023-08-01T19:54:31.156431+0000","last_clean":"2023-08-01T19:54:31.156431+0000","last_became_active":"2023-08-01T19:54:04.063652+0000","last_became_peered":"2023-08-01T19:54:04.063652+0000","last_unstale":"2023-08-01T19:54:31.156431+0000","last_undegraded":"2023-08-01T19:54:31.156431+0000","last_fullsized":"2023-08-01T19:54:31.156431+0000","mapping_epoch":15,"log_start":"0'0","ondisk_log_start":"0'0","created":15,"last_epoch_clean":16,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-08-01T19:54:03.032665+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-08-01T19:54:03.032665+0000","last_clean_scrub_stamp":"2023-08-01T19:54:03.032665+0000","objects_scrubbed":0,"log_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-08-03T05:30:28.028091+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[2,0],"acting":[2,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":2,"acting_primary":2,"purged_snaps":[]},{"pgid":"4.f","version":"0'0","reported_seq":16,"reported_epoch":24,"state":"active+clean","last_fresh":"2023-08-01T19:54:31.157186+0000","last_change":"2023-08-01T19:54:04.469648+0000","last_active":"2023-08-01T19:54:31.157186+0000","last_peered":"2023-08-01T19:54:31.157186+0000","last_clean":"2023-08-01T19:54:31.157186+0000","last_became_active":"2023-08-01T19:54:04.468445+0000","last_became_peered":"2023-08-01T19:54:04.468445+0000","last_unstale":"2023-08-01T19:54:31.157186+0000","last_undegraded":"2023-08-01T19:54:31.157186+0000","last_fullsized":"2023-08-01T19:54:31.157186+0000","mapping_epoch":16,"log_start":"0'0","ondisk_log_start":"0'0","created":16,"last_epoch_clean":17,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-08-01T19:54:04.040663+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-08-01T19:54:04.040663+0000","last_clean_scrub_stamp":"2023-08-01T19:54:04.040663+0000","objects_scrubbed":0,"log_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-08-03T05:46:11.085577+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[0,2],"acting":[0,2],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":0,"acting_primary":0,"purged_snaps":[]},{"pgid":"5.3","version":"25'2302","reported_seq":2315,"reported_epoch":25,"state":"active+clean","last_fresh":"2023-08-01T19:54:34.913402+0000","last_change":"2023-08-01T19:54:23.138357+0000","last_active":"2023-08-01T19:54:34.913402+0000","last_peered":"2023-08-01T19:54:34.913402+0000","last_clean":"2023-08-01T19:54:34.913402+0000","last_became_active":"2023-08-01T19:54:23.137942+0000","last_became_peered":"2023-08-01T19:54:23.137942+0000","last_unstale":"2023-08-01T19:54:34.913402+0000","last_undegraded":"2023-08-01T19:54:34.913402+0000","last_fullsized":"2023-08-01T19:54:34.913402+0000","mapping_epoch":19,"log_start":"0'0","ondisk_log_start":"0'0","created":19,"last_epoch_clean":20,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-08-01T19:54:22.116710+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-08-01T19:54:22.116710+0000","last_clean_scrub_stamp":"2023-08-01T19:54:22.116710+0000","objects_scrubbed":0,"log_size":2302,"ondisk_log_size":2302,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-08-03T01:44:47.434321+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":150863872,"num_objects":2302,"num_object_clones":0,"num_object_copies":4604,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":2302,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":2302,"num_write_kb":147328,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[0,1],"acting":[0,1],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":0,"acting_primary":0,"purged_snaps":[]},{"pgid":"2.4","version":"0'0","reported_seq":20,"reported_epoch":24,"state":"active+clean","last_fresh":"2023-08-01T19:54:31.157788+0000","last_change":"2023-08-01T19:53:58.973838+0000","last_active":"2023-08-01T19:54:31.157788+0000","last_peered":"2023-08-01T19:54:31.157788+0000","last_clean":"2023-08-01T19:54:31.157788+0000","last_became_active":"2023-08-01T19:53:58.973242+0000","last_became_peered":"2023-08-01T19:53:58.973242+0000","last_unstale":"2023-08-01T19:54:31.157788+0000","last_undegraded":"2023-08-01T19:54:31.157788+0000","last_fullsized":"2023-08-01T19:54:31.157788+0000","mapping_epoch":12,"log_start":"0'0","ondisk_log_start":"0'0","created":12,"last_epoch_clean":13,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-08-01T19:53:57.959448+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-08-01T19:53:57.959448+0000","last_clean_scrub_stamp":"2023-08-01T19:53:57.959448+0000","objects_scrubbed":0,"log_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-08-03T00:09:48.796549+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[0,2],"acting":[0,2],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":0,"acting_primary":0,"purged_snaps":[]},{"pgid":"3.5","version":"0'0","reported_seq":17,"reported_epoch":24,"state":"active+clean","last_fresh":"2023-08-01T19:54:31.165034+0000","last_change":"2023-08-01T19:54:04.065255+0000","last_active":"2023-08-01T19:54:31.165034+0000","last_peered":"2023-08-01T19:54:31.165034+0000","last_clean":"2023-08-01T19:54:31.165034+0000","last_became_active":"2023-08-01T19:54:04.064814+0000","last_became_peered":"2023-08-01T19:54:04.064814+0000","last_unstale":"2023-08-01T19:54:31.165034+0000","last_undegraded":"2023-08-01T19:54:31.165034+0000","last_fullsized":"2023-08-01T19:54:31.165034+0000","mapping_epoch":15,"log_start":"0'0","ondisk_log_start":"0'0","created":15,"last_epoch_clean":16,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-08-01T19:54:03.032665+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-08-01T19:54:03.032665+0000","last_clean_scrub_stamp":"2023-08-01T19:54:03.032665+0000","objects_scrubbed":0,"log_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-08-03T02:01:47.073630+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[1,0],"acting":[1,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":1,"acting_primary":1,"purged_snaps":[]},{"pgid":"4.2","version":"0'0","reported_seq":16,"reported_epoch":24,"state":"active+clean","last_fresh":"2023-08-01T19:54:31.156769+0000","last_change":"2023-08-01T19:54:04.471715+0000","last_active":"2023-08-01T19:54:31.156769+0000","last_peered":"2023-08-01T19:54:31.156769+0000","last_clean":"2023-08-01T19:54:31.156769+0000","last_became_active":"2023-08-01T19:54:04.471300+0000","last_became_peered":"2023-08-01T19:54:04.471300+0000","last_unstale":"2023-08-01T19:54:31.156769+0000","last_undegraded":"2023-08-01T19:54:31.156769+0000","last_fullsized":"2023-08-01T19:54:31.156769+0000","mapping_epoch":16,"log_start":"0'0","ondisk_log_start":"0'0","created":16,"last_epoch_clean":17,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-08-01T19:54:04.040663+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-08-01T19:54:04.040663+0000","last_clean_scrub_stamp":"2023-08-01T19:54:04.040663+0000","objects_scrubbed":0,"log_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-08-02T23:00:24.980203+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[2,1],"acting":[2,1],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":2,"acting_primary":2,"purged_snaps":[]},{"pgid":"5.5","version":"25'2225","reported_seq":2238,"reported_epoch":25,"state":"active+clean","last_fresh":"2023-08-01T19:54:34.896881+0000","last_change":"2023-08-01T19:54:23.137678+0000","last_active":"2023-08-01T19:54:34.896881+0000","last_peered":"2023-08-01T19:54:34.896881+0000","last_clean":"2023-08-01T19:54:34.896881+0000","last_became_active":"2023-08-01T19:54:23.136756+0000","last_became_peered":"2023-08-01T19:54:23.136756+0000","last_unstale":"2023-08-01T19:54:34.896881+0000","last_undegraded":"2023-08-01T19:54:34.896881+0000","last_fullsized":"2023-08-01T19:54:34.896881+0000","mapping_epoch":19,"log_start":"0'0","ondisk_log_start":"0'0","created":19,"last_epoch_clean":20,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-08-01T19:54:22.116710+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-08-01T19:54:22.116710+0000","last_clean_scrub_stamp":"2023-08-01T19:54:22.116710+0000","objects_scrubbed":0,"log_size":2225,"ondisk_log_size":2225,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-08-03T03:50:03.076219+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":145817600,"num_objects":2225,"num_object_clones":0,"num_object_copies":4450,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":2225,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":2225,"num_write_kb":142400,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[0,1],"acting":[0,1],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":0,"acting_primary":0,"purged_snaps":[]},{"pgid":"2.2","version":"0'0","reported_seq":20,"reported_epoch":24,"state":"active+clean","last_fresh":"2023-08-01T19:54:31.163877+0000","last_change":"2023-08-01T19:53:58.973665+0000","last_active":"2023-08-01T19:54:31.163877+0000","last_peered":"2023-08-01T19:54:31.163877+0000","last_clean":"2023-08-01T19:54:31.163877+0000","last_became_active":"2023-08-01T19:53:58.973463+0000","last_became_peered":"2023-08-01T19:53:58.973463+0000","last_unstale":"2023-08-01T19:54:31.163877+0000","last_undegraded":"2023-08-01T19:54:31.163877+0000","last_fullsized":"2023-08-01T19:54:31.163877+0000","mapping_epoch":12,"log_start":"0'0","ondisk_log_start":"0'0","created":12,"last_epoch_clean":13,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-08-01T19:53:57.959448+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-08-01T19:53:57.959448+0000","last_clean_scrub_stamp":"2023-08-01T19:53:57.959448+0000","objects_scrubbed":0,"log_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-08-03T04:50:42.368892+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[1,0],"acting":[1,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":1,"acting_primary":1,"purged_snaps":[]},{"pgid":"3.3","version":"0'0","reported_seq":17,"reported_epoch":24,"state":"active+clean","last_fresh":"2023-08-01T19:54:31.163772+0000","last_change":"2023-08-01T19:54:04.065415+0000","last_active":"2023-08-01T19:54:31.163772+0000","last_peered":"2023-08-01T19:54:31.163772+0000","last_clean":"2023-08-01T19:54:31.163772+0000","last_became_active":"2023-08-01T19:54:04.065030+0000","last_became_peered":"2023-08-01T19:54:04.065030+0000","last_unstale":"2023-08-01T19:54:31.163772+0000","last_undegraded":"2023-08-01T19:54:31.163772+0000","last_fullsized":"2023-08-01T19:54:31.163772+0000","mapping_epoch":15,"log_start":"0'0","ondisk_log_start":"0'0","created":15,"last_epoch_clean":16,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-08-01T19:54:03.032665+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-08-01T19:54:03.032665+0000","last_clean_scrub_stamp":"2023-08-01T19:54:03.032665+0000","objects_scrubbed":0,"log_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-08-02T21:33:27.007118+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[1,0],"acting":[1,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":1,"acting_primary":1,"purged_snaps":[]},{"pgid":"4.4","version":"0'0","reported_seq":16,"reported_epoch":24,"state":"active+clean","last_fresh":"2023-08-01T19:54:31.157420+0000","last_change":"2023-08-01T19:54:04.468101+0000","last_active":"2023-08-01T19:54:31.157420+0000","last_peered":"2023-08-01T19:54:31.157420+0000","last_clean":"2023-08-01T19:54:31.157420+0000","last_became_active":"2023-08-01T19:54:04.467409+0000","last_became_peered":"2023-08-01T19:54:04.467409+0000","last_unstale":"2023-08-01T19:54:31.157420+0000","last_undegraded":"2023-08-01T19:54:31.157420+0000","last_fullsized":"2023-08-01T19:54:31.157420+0000","mapping_epoch":16,"log_start":"0'0","ondisk_log_start":"0'0","created":16,"last_epoch_clean":17,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-08-01T19:54:04.040663+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-08-01T19:54:04.040663+0000","last_clean_scrub_stamp":"2023-08-01T19:54:04.040663+0000","objects_scrubbed":0,"log_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-08-02T21:43:30.325991+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[0,2],"acting":[0,2],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":0,"acting_primary":0,"purged_snaps":[]},{"pgid":"5.6","version":"25'2238","reported_seq":2251,"reported_epoch":25,"state":"active+clean","last_fresh":"2023-08-01T19:54:34.920923+0000","last_change":"2023-08-01T19:54:23.138275+0000","last_active":"2023-08-01T19:54:34.920923+0000","last_peered":"2023-08-01T19:54:34.920923+0000","last_clean":"2023-08-01T19:54:34.920923+0000","last_became_active":"2023-08-01T19:54:23.137973+0000","last_became_peered":"2023-08-01T19:54:23.137973+0000","last_unstale":"2023-08-01T19:54:34.920923+0000","last_undegraded":"2023-08-01T19:54:34.920923+0000","last_fullsized":"2023-08-01T19:54:34.920923+0000","mapping_epoch":19,"log_start":"0'0","ondisk_log_start":"0'0","created":19,"last_epoch_clean":20,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-08-01T19:54:22.116710+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-08-01T19:54:22.116710+0000","last_clean_scrub_stamp":"2023-08-01T19:54:22.116710+0000","objects_scrubbed":0,"log_size":2238,"ondisk_log_size":2238,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-08-03T01:19:10.526905+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":146669568,"num_objects":2238,"num_object_clones":0,"num_object_copies":4476,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":2238,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":2238,"num_write_kb":143232,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[0,1],"acting":[0,1],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":0,"acting_primary":0,"purged_snaps":[]},{"pgid":"2.1","version":"0'0","reported_seq":20,"reported_epoch":24,"state":"active+clean","last_fresh":"2023-08-01T19:54:31.156699+0000","last_change":"2023-08-01T19:53:58.973700+0000","last_active":"2023-08-01T19:54:31.156699+0000","last_peered":"2023-08-01T19:54:31.156699+0000","last_clean":"2023-08-01T19:54:31.156699+0000","last_became_active":"2023-08-01T19:53:58.973285+0000","last_became_peered":"2023-08-01T19:53:58.973285+0000","last_unstale":"2023-08-01T19:54:31.156699+0000","last_undegraded":"2023-08-01T19:54:31.156699+0000","last_fullsized":"2023-08-01T19:54:31.156699+0000","mapping_epoch":12,"log_start":"0'0","ondisk_log_start":"0'0","created":12,"last_epoch_clean":13,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-08-01T19:53:57.959448+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-08-01T19:53:57.959448+0000","last_clean_scrub_stamp":"2023-08-01T19:53:57.959448+0000","objects_scrubbed":0,"log_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-08-02T21:26:02.570824+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[0,2],"acting":[0,2],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":0,"acting_primary":0,"purged_snaps":[]},{"pgid":"3.0","version":"0'0","reported_seq":17,"reported_epoch":24,"state":"active+clean","last_fresh":"2023-08-01T19:54:31.156382+0000","last_change":"2023-08-01T19:54:04.064407+0000","last_active":"2023-08-01T19:54:31.156382+0000","last_peered":"2023-08-01T19:54:31.156382+0000","last_clean":"2023-08-01T19:54:31.156382+0000","last_became_active":"2023-08-01T19:54:04.064122+0000","last_became_peered":"2023-08-01T19:54:04.064122+0000","last_unstale":"2023-08-01T19:54:31.156382+0000","last_undegraded":"2023-08-01T19:54:31.156382+0000","last_fullsized":"2023-08-01T19:54:31.156382+0000","mapping_epoch":15,"log_start":"0'0","ondisk_log_start":"0'0","created":15,"last_epoch_clean":16,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-08-01T19:54:03.032665+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-08-01T19:54:03.032665+0000","last_clean_scrub_stamp":"2023-08-01T19:54:03.032665+0000","objects_scrubbed":0,"log_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-08-03T07:08:17.318689+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[2,1],"acting":[2,1],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":2,"acting_primary":2,"purged_snaps":[]},{"pgid":"4.7","version":"0'0","reported_seq":16,"reported_epoch":24,"state":"active+clean","last_fresh":"2023-08-01T19:54:31.157358+0000","last_change":"2023-08-01T19:54:04.469739+0000","last_active":"2023-08-01T19:54:31.157358+0000","last_peered":"2023-08-01T19:54:31.157358+0000","last_clean":"2023-08-01T19:54:31.157358+0000","last_became_active":"2023-08-01T19:54:04.468021+0000","last_became_peered":"2023-08-01T19:54:04.468021+0000","last_unstale":"2023-08-01T19:54:31.157358+0000","last_undegraded":"2023-08-01T19:54:31.157358+0000","last_fullsized":"2023-08-01T19:54:31.157358+0000","mapping_epoch":16,"log_start":"0'0","ondisk_log_start":"0'0","created":16,"last_epoch_clean":17,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-08-01T19:54:04.040663+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-08-01T19:54:04.040663+0000","last_clean_scrub_stamp":"2023-08-01T19:54:04.040663+0000","objects_scrubbed":0,"log_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-08-02T21:03:01.319028+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[0,2],"acting":[0,2],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":0,"acting_primary":0,"purged_snaps":[]},{"pgid":"5.4","version":"25'2456","reported_seq":2469,"reported_epoch":25,"state":"active+clean","last_fresh":"2023-08-01T19:54:36.046970+0000","last_change":"2023-08-01T19:54:23.138253+0000","last_active":"2023-08-01T19:54:36.046970+0000","last_peered":"2023-08-01T19:54:36.046970+0000","last_clean":"2023-08-01T19:54:36.046970+0000","last_became_active":"2023-08-01T19:54:23.137915+0000","last_became_peered":"2023-08-01T19:54:23.137915+0000","last_unstale":"2023-08-01T19:54:36.046970+0000","last_undegraded":"2023-08-01T19:54:36.046970+0000","last_fullsized":"2023-08-01T19:54:36.046970+0000","mapping_epoch":19,"log_start":"0'0","ondisk_log_start":"0'0","created":19,"last_epoch_clean":20,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-08-01T19:54:22.116710+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-08-01T19:54:22.116710+0000","last_clean_scrub_stamp":"2023-08-01T19:54:22.116710+0000","objects_scrubbed":0,"log_size":2456,"ondisk_log_size":2456,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-08-03T07:20:04.946515+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":160956416,"num_objects":2456,"num_object_clones":0,"num_object_copies":4912,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":2456,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":2456,"num_write_kb":157184,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[2,0],"acting":[2,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":2,"acting_primary":2,"purged_snaps":[]},{"pgid":"2.3","version":"0'0","reported_seq":20,"reported_epoch":24,"state":"active+clean","last_fresh":"2023-08-01T19:54:31.163809+0000","last_change":"2023-08-01T19:53:58.973768+0000","last_active":"2023-08-01T19:54:31.163809+0000","last_peered":"2023-08-01T19:54:31.163809+0000","last_clean":"2023-08-01T19:54:31.163809+0000","last_became_active":"2023-08-01T19:53:58.973492+0000","last_became_peered":"2023-08-01T19:53:58.973492+0000","last_unstale":"2023-08-01T19:54:31.163809+0000","last_undegraded":"2023-08-01T19:54:31.163809+0000","last_fullsized":"2023-08-01T19:54:31.163809+0000","mapping_epoch":12,"log_start":"0'0","ondisk_log_start":"0'0","created":12,"last_epoch_clean":13,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-08-01T19:53:57.959448+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-08-01T19:53:57.959448+0000","last_clean_scrub_stamp":"2023-08-01T19:53:57.959448+0000","objects_scrubbed":0,"log_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-08-03T02:04:52.034667+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[1,0],"acting":[1,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":1,"acting_primary":1,"purged_snaps":[]},{"pgid":"1.0","version":"10'157","reported_seq":219,"reported_epoch":24,"state":"active+clean","last_fresh":"2023-08-01T19:54:31.163695+0000","last_change":"2023-08-01T19:53:51.746910+0000","last_active":"2023-08-01T19:54:31.163695+0000","last_peered":"2023-08-01T19:54:31.163695+0000","last_clean":"2023-08-01T19:54:31.163695+0000","last_became_active":"2023-08-01T19:53:51.746590+0000","last_became_peered":"2023-08-01T19:53:51.746590+0000","last_unstale":"2023-08-01T19:54:31.163695+0000","last_undegraded":"2023-08-01T19:54:31.163695+0000","last_fullsized":"2023-08-01T19:54:31.163695+0000","mapping_epoch":9,"log_start":"0'0","ondisk_log_start":"0'0","created":9,"last_epoch_clean":10,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-08-01T19:53:50.735626+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-08-01T19:53:50.735626+0000","last_clean_scrub_stamp":"2023-08-01T19:53:50.735626+0000","objects_scrubbed":0,"log_size":157,"ondisk_log_size":157,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-08-03T02:56:50.228294+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":590368,"num_objects":2,"num_object_clones":0,"num_object_copies":4,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":2,"num_whiteouts":0,"num_read":136,"num_read_kb":118,"num_write":203,"num_write_kb":3460,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[1,2],"acting":[1,2],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":1,"acting_primary":1,"purged_snaps":[]},{"pgid":"3.2","version":"0'0","reported_seq":17,"reported_epoch":24,"state":"active+clean","last_fresh":"2023-08-01T19:54:31.157217+0000","last_change":"2023-08-01T19:54:04.064009+0000","last_active":"2023-08-01T19:54:31.157217+0000","last_peered":"2023-08-01T19:54:31.157217+0000","last_clean":"2023-08-01T19:54:31.157217+0000","last_became_active":"2023-08-01T19:54:04.063665+0000","last_became_peered":"2023-08-01T19:54:04.063665+0000","last_unstale":"2023-08-01T19:54:31.157217+0000","last_undegraded":"2023-08-01T19:54:31.157217+0000","last_fullsized":"2023-08-01T19:54:31.157217+0000","mapping_epoch":15,"log_start":"0'0","ondisk_log_start":"0'0","created":15,"last_epoch_clean":16,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-08-01T19:54:03.032665+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-08-01T19:54:03.032665+0000","last_clean_scrub_stamp":"2023-08-01T19:54:03.032665+0000","objects_scrubbed":0,"log_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-08-03T04:04:46.983253+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[0,2],"acting":[0,2],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":0,"acting_primary":0,"purged_snaps":[]},{"pgid":"4.5","version":"0'0","reported_seq":16,"reported_epoch":24,"state":"active+clean","last_fresh":"2023-08-01T19:54:31.165078+0000","last_change":"2023-08-01T19:54:04.474061+0000","last_active":"2023-08-01T19:54:31.165078+0000","last_peered":"2023-08-01T19:54:31.165078+0000","last_clean":"2023-08-01T19:54:31.165078+0000","last_became_active":"2023-08-01T19:54:04.472128+0000","last_became_peered":"2023-08-01T19:54:04.472128+0000","last_unstale":"2023-08-01T19:54:31.165078+0000","last_undegraded":"2023-08-01T19:54:31.165078+0000","last_fullsized":"2023-08-01T19:54:31.165078+0000","mapping_epoch":16,"log_start":"0'0","ondisk_log_start":"0'0","created":16,"last_epoch_clean":17,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-08-01T19:54:04.040663+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-08-01T19:54:04.040663+0000","last_clean_scrub_stamp":"2023-08-01T19:54:04.040663+0000","objects_scrubbed":0,"log_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-08-03T00:29:05.857138+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[1,2],"acting":[1,2],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":1,"acting_primary":1,"purged_snaps":[]},{"pgid":"5.7","version":"25'2226","reported_seq":2239,"reported_epoch":25,"state":"active+clean","last_fresh":"2023-08-01T19:54:34.910943+0000","last_change":"2023-08-01T19:54:23.138337+0000","last_active":"2023-08-01T19:54:34.910943+0000","last_peered":"2023-08-01T19:54:34.910943+0000","last_clean":"2023-08-01T19:54:34.910943+0000","last_became_active":"2023-08-01T19:54:23.138056+0000","last_became_peered":"2023-08-01T19:54:23.138056+0000","last_unstale":"2023-08-01T19:54:34.910943+0000","last_undegraded":"2023-08-01T19:54:34.910943+0000","last_fullsized":"2023-08-01T19:54:34.910943+0000","mapping_epoch":19,"log_start":"0'0","ondisk_log_start":"0'0","created":19,"last_epoch_clean":20,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-08-01T19:54:22.116710+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-08-01T19:54:22.116710+0000","last_clean_scrub_stamp":"2023-08-01T19:54:22.116710+0000","objects_scrubbed":0,"log_size":2226,"ondisk_log_size":2226,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-08-03T06:58:19.846492+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":145883136,"num_objects":2226,"num_object_clones":0,"num_object_copies":4452,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":2226,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":2226,"num_write_kb":142464,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[1,0],"acting":[1,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":1,"acting_primary":1,"purged_snaps":[]},{"pgid":"2.0","version":"0'0","reported_seq":20,"reported_epoch":24,"state":"active+clean","last_fresh":"2023-08-01T19:54:31.163379+0000","last_change":"2023-08-01T19:53:58.975968+0000","last_active":"2023-08-01T19:54:31.163379+0000","last_peered":"2023-08-01T19:54:31.163379+0000","last_clean":"2023-08-01T19:54:31.163379+0000","last_became_active":"2023-08-01T19:53:58.975706+0000","last_became_peered":"2023-08-01T19:53:58.975706+0000","last_unstale":"2023-08-01T19:54:31.163379+0000","last_undegraded":"2023-08-01T19:54:31.163379+0000","last_fullsized":"2023-08-01T19:54:31.163379+0000","mapping_epoch":12,"log_start":"0'0","ondisk_log_start":"0'0","created":12,"last_epoch_clean":13,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-08-01T19:53:57.959448+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-08-01T19:53:57.959448+0000","last_clean_scrub_stamp":"2023-08-01T19:53:57.959448+0000","objects_scrubbed":0,"log_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-08-03T00:02:15.204280+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[1,2],"acting":[1,2],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":1,"acting_primary":1,"purged_snaps":[]},{"pgid":"3.1","version":"0'0","reported_seq":17,"reported_epoch":24,"state":"active+clean","last_fresh":"2023-08-01T19:54:31.156483+0000","last_change":"2023-08-01T19:54:04.066707+0000","last_active":"2023-08-01T19:54:31.156483+0000","last_peered":"2023-08-01T19:54:31.156483+0000","last_clean":"2023-08-01T19:54:31.156483+0000","last_became_active":"2023-08-01T19:54:04.066334+0000","last_became_peered":"2023-08-01T19:54:04.066334+0000","last_unstale":"2023-08-01T19:54:31.156483+0000","last_undegraded":"2023-08-01T19:54:31.156483+0000","last_fullsized":"2023-08-01T19:54:31.156483+0000","mapping_epoch":15,"log_start":"0'0","ondisk_log_start":"0'0","created":15,"last_epoch_clean":16,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-08-01T19:54:03.032665+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-08-01T19:54:03.032665+0000","last_clean_scrub_stamp":"2023-08-01T19:54:03.032665+0000","objects_scrubbed":0,"log_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-08-03T02:40:15.210599+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[0,1],"acting":[0,1],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":0,"acting_primary":0,"purged_snaps":[]},{"pgid":"4.6","version":"0'0","reported_seq":16,"reported_epoch":24,"state":"active+clean","last_fresh":"2023-08-01T19:54:31.157485+0000","last_change":"2023-08-01T19:54:04.469877+0000","last_active":"2023-08-01T19:54:31.157485+0000","last_peered":"2023-08-01T19:54:31.157485+0000","last_clean":"2023-08-01T19:54:31.157485+0000","last_became_active":"2023-08-01T19:54:04.469528+0000","last_became_peered":"2023-08-01T19:54:04.469528+0000","last_unstale":"2023-08-01T19:54:31.157485+0000","last_undegraded":"2023-08-01T19:54:31.157485+0000","last_fullsized":"2023-08-01T19:54:31.157485+0000","mapping_epoch":16,"log_start":"0'0","ondisk_log_start":"0'0","created":16,"last_epoch_clean":17,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-08-01T19:54:04.040663+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-08-01T19:54:04.040663+0000","last_clean_scrub_stamp":"2023-08-01T19:54:04.040663+0000","objects_scrubbed":0,"log_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-08-03T02:24:19.067602+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[2,0],"acting":[2,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":2,"acting_primary":2,"purged_snaps":[]},{"pgid":"5.2","version":"25'2353","reported_seq":2366,"reported_epoch":25,"state":"active+clean","last_fresh":"2023-08-01T19:54:34.915739+0000","last_change":"2023-08-01T19:54:23.138339+0000","last_active":"2023-08-01T19:54:34.915739+0000","last_peered":"2023-08-01T19:54:34.915739+0000","last_clean":"2023-08-01T19:54:34.915739+0000","last_became_active":"2023-08-01T19:54:23.137962+0000","last_became_peered":"2023-08-01T19:54:23.137962+0000","last_unstale":"2023-08-01T19:54:34.915739+0000","last_undegraded":"2023-08-01T19:54:34.915739+0000","last_fullsized":"2023-08-01T19:54:34.915739+0000","mapping_epoch":19,"log_start":"0'0","ondisk_log_start":"0'0","created":19,"last_epoch_clean":20,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-08-01T19:54:22.116710+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-08-01T19:54:22.116710+0000","last_clean_scrub_stamp":"2023-08-01T19:54:22.116710+0000","objects_scrubbed":0,"log_size":2353,"ondisk_log_size":2353,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-08-03T01:46:33.457242+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":154206208,"num_objects":2353,"num_object_clones":0,"num_object_copies":4706,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":2353,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":2353,"num_write_kb":150592,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[1,0],"acting":[1,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":1,"acting_primary":1,"purged_snaps":[]},{"pgid":"2.5","version":"0'0","reported_seq":20,"reported_epoch":24,"state":"active+clean","last_fresh":"2023-08-01T19:54:31.156991+0000","last_change":"2023-08-01T19:53:58.970683+0000","last_active":"2023-08-01T19:54:31.156991+0000","last_peered":"2023-08-01T19:54:31.156991+0000","last_clean":"2023-08-01T19:54:31.156991+0000","last_became_active":"2023-08-01T19:53:58.970437+0000","last_became_peered":"2023-08-01T19:53:58.970437+0000","last_unstale":"2023-08-01T19:54:31.156991+0000","last_undegraded":"2023-08-01T19:54:31.156991+0000","last_fullsized":"2023-08-01T19:54:31.156991+0000","mapping_epoch":12,"log_start":"0'0","ondisk_log_start":"0'0","created":12,"last_epoch_clean":13,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-08-01T19:53:57.959448+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-08-01T19:53:57.959448+0000","last_clean_scrub_stamp":"2023-08-01T19:53:57.959448+0000","objects_scrubbed":0,"log_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-08-02T23:54:08.273426+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[2,0],"acting":[2,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":2,"acting_primary":2,"purged_snaps":[]},{"pgid":"3.4","version":"0'0","reported_seq":17,"reported_epoch":24,"state":"active+clean","last_fresh":"2023-08-01T19:54:31.157322+0000","last_change":"2023-08-01T19:54:04.062283+0000","last_active":"2023-08-01T19:54:31.157322+0000","last_peered":"2023-08-01T19:54:31.157322+0000","last_clean":"2023-08-01T19:54:31.157322+0000","last_became_active":"2023-08-01T19:54:04.061796+0000","last_became_peered":"2023-08-01T19:54:04.061796+0000","last_unstale":"2023-08-01T19:54:31.157322+0000","last_undegraded":"2023-08-01T19:54:31.157322+0000","last_fullsized":"2023-08-01T19:54:31.157322+0000","mapping_epoch":15,"log_start":"0'0","ondisk_log_start":"0'0","created":15,"last_epoch_clean":16,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-08-01T19:54:03.032665+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-08-01T19:54:03.032665+0000","last_clean_scrub_stamp":"2023-08-01T19:54:03.032665+0000","objects_scrubbed":0,"log_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-08-02T19:54:08.401797+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[0,2],"acting":[0,2],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":0,"acting_primary":0,"purged_snaps":[]},{"pgid":"4.3","version":"0'0","reported_seq":16,"reported_epoch":24,"state":"active+clean","last_fresh":"2023-08-01T19:54:31.157491+0000","last_change":"2023-08-01T19:54:04.473088+0000","last_active":"2023-08-01T19:54:31.157491+0000","last_peered":"2023-08-01T19:54:31.157491+0000","last_clean":"2023-08-01T19:54:31.157491+0000","last_became_active":"2023-08-01T19:54:04.472611+0000","last_became_peered":"2023-08-01T19:54:04.472611+0000","last_unstale":"2023-08-01T19:54:31.157491+0000","last_undegraded":"2023-08-01T19:54:31.157491+0000","last_fullsized":"2023-08-01T19:54:31.157491+0000","mapping_epoch":16,"log_start":"0'0","ondisk_log_start":"0'0","created":16,"last_epoch_clean":17,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-08-01T19:54:04.040663+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-08-01T19:54:04.040663+0000","last_clean_scrub_stamp":"2023-08-01T19:54:04.040663+0000","objects_scrubbed":0,"log_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-08-03T07:27:26.537518+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[2,1],"acting":[2,1],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":2,"acting_primary":2,"purged_snaps":[]},{"pgid":"5.1","version":"25'2299","reported_seq":2312,"reported_epoch":25,"state":"active+clean","last_fresh":"2023-08-01T19:54:34.913881+0000","last_change":"2023-08-01T19:54:23.138225+0000","last_active":"2023-08-01T19:54:34.913881+0000","last_peered":"2023-08-01T19:54:34.913881+0000","last_clean":"2023-08-01T19:54:34.913881+0000","last_became_active":"2023-08-01T19:54:23.137955+0000","last_became_peered":"2023-08-01T19:54:23.137955+0000","last_unstale":"2023-08-01T19:54:34.913881+0000","last_undegraded":"2023-08-01T19:54:34.913881+0000","last_fullsized":"2023-08-01T19:54:34.913881+0000","mapping_epoch":19,"log_start":"0'0","ondisk_log_start":"0'0","created":19,"last_epoch_clean":20,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-08-01T19:54:22.116710+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-08-01T19:54:22.116710+0000","last_clean_scrub_stamp":"2023-08-01T19:54:22.116710+0000","objects_scrubbed":0,"log_size":2299,"ondisk_log_size":2299,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-08-03T03:58:00.471919+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":150667264,"num_objects":2299,"num_object_clones":0,"num_object_copies":4598,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":2299,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":2299,"num_write_kb":147136,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[1,0],"acting":[1,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":1,"acting_primary":1,"purged_snaps":[]},{"pgid":"3.7","version":"17'2","reported_seq":19,"reported_epoch":24,"state":"active+clean","last_fresh":"2023-08-01T19:54:31.157120+0000","last_change":"2023-08-01T19:54:04.065147+0000","last_active":"2023-08-01T19:54:31.157120+0000","last_peered":"2023-08-01T19:54:31.157120+0000","last_clean":"2023-08-01T19:54:31.157120+0000","last_became_active":"2023-08-01T19:54:04.064779+0000","last_became_peered":"2023-08-01T19:54:04.064779+0000","last_unstale":"2023-08-01T19:54:31.157120+0000","last_undegraded":"2023-08-01T19:54:31.157120+0000","last_fullsized":"2023-08-01T19:54:31.157120+0000","mapping_epoch":15,"log_start":"0'0","ondisk_log_start":"0'0","created":15,"last_epoch_clean":16,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-08-01T19:54:03.032665+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-08-01T19:54:03.032665+0000","last_clean_scrub_stamp":"2023-08-01T19:54:03.032665+0000","objects_scrubbed":0,"log_size":2,"ondisk_log_size":2,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-08-03T03:43:45.667663+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":1,"num_object_clones":0,"num_object_copies":2,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":1,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":3,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":1,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[0,2],"acting":[0,2],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":0,"acting_primary":0,"purged_snaps":[]},{"pgid":"2.6","version":"0'0","reported_seq":20,"reported_epoch":24,"state":"active+clean","last_fresh":"2023-08-01T19:54:31.157832+0000","last_change":"2023-08-01T19:53:58.974077+0000","last_active":"2023-08-01T19:54:31.157832+0000","last_peered":"2023-08-01T19:54:31.157832+0000","last_clean":"2023-08-01T19:54:31.157832+0000","last_became_active":"2023-08-01T19:53:58.973396+0000","last_became_peered":"2023-08-01T19:53:58.973396+0000","last_unstale":"2023-08-01T19:54:31.157832+0000","last_undegraded":"2023-08-01T19:54:31.157832+0000","last_fullsized":"2023-08-01T19:54:31.157832+0000","mapping_epoch":12,"log_start":"0'0","ondisk_log_start":"0'0","created":12,"last_epoch_clean":13,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-08-01T19:53:57.959448+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-08-01T19:53:57.959448+0000","last_clean_scrub_stamp":"2023-08-01T19:53:57.959448+0000","objects_scrubbed":0,"log_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-08-02T22:13:50.940864+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[0,2],"acting":[0,2],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":0,"acting_primary":0,"purged_snaps":[]},{"pgid":"4.0","version":"0'0","reported_seq":16,"reported_epoch":24,"state":"active+clean","last_fresh":"2023-08-01T19:54:31.156489+0000","last_change":"2023-08-01T19:54:04.476807+0000","last_active":"2023-08-01T19:54:31.156489+0000","last_peered":"2023-08-01T19:54:31.156489+0000","last_clean":"2023-08-01T19:54:31.156489+0000","last_became_active":"2023-08-01T19:54:04.476453+0000","last_became_peered":"2023-08-01T19:54:04.476453+0000","last_unstale":"2023-08-01T19:54:31.156489+0000","last_undegraded":"2023-08-01T19:54:31.156489+0000","last_fullsized":"2023-08-01T19:54:31.156489+0000","mapping_epoch":16,"log_start":"0'0","ondisk_log_start":"0'0","created":16,"last_epoch_clean":17,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-08-01T19:54:04.040663+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-08-01T19:54:04.040663+0000","last_clean_scrub_stamp":"2023-08-01T19:54:04.040663+0000","objects_scrubbed":0,"log_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-08-02T20:20:59.989030+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[0,1],"acting":[0,1],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":0,"acting_primary":0,"purged_snaps":[]},{"pgid":"5.0","version":"25'2521","reported_seq":2532,"reported_epoch":25,"state":"active+clean","last_fresh":"2023-08-01T19:54:36.047459+0000","last_change":"2023-08-01T19:54:23.138369+0000","last_active":"2023-08-01T19:54:36.047459+0000","last_peered":"2023-08-01T19:54:36.047459+0000","last_clean":"2023-08-01T19:54:36.047459+0000","last_became_active":"2023-08-01T19:54:23.137857+0000","last_became_peered":"2023-08-01T19:54:23.137857+0000","last_unstale":"2023-08-01T19:54:36.047459+0000","last_undegraded":"2023-08-01T19:54:36.047459+0000","last_fullsized":"2023-08-01T19:54:36.047459+0000","mapping_epoch":19,"log_start":"0'0","ondisk_log_start":"0'0","created":19,"last_epoch_clean":20,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-08-01T19:54:22.116710+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-08-01T19:54:22.116710+0000","last_clean_scrub_stamp":"2023-08-01T19:54:22.116710+0000","objects_scrubbed":0,"log_size":2521,"ondisk_log_size":2521,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-08-03T06:02:44.391298+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":165216256,"num_objects":2521,"num_object_clones":0,"num_object_copies":5042,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":2521,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":2521,"num_write_kb":161344,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[2,0],"acting":[2,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":2,"acting_primary":2,"purged_snaps":[]},{"pgid":"2.7","version":"0'0","reported_seq":20,"reported_epoch":24,"state":"active+clean","last_fresh":"2023-08-01T19:54:31.164888+0000","last_change":"2023-08-01T19:53:58.975936+0000","last_active":"2023-08-01T19:54:31.164888+0000","last_peered":"2023-08-01T19:54:31.164888+0000","last_clean":"2023-08-01T19:54:31.164888+0000","last_became_active":"2023-08-01T19:53:58.975680+0000","last_became_peered":"2023-08-01T19:53:58.975680+0000","last_unstale":"2023-08-01T19:54:31.164888+0000","last_undegraded":"2023-08-01T19:54:31.164888+0000","last_fullsized":"2023-08-01T19:54:31.164888+0000","mapping_epoch":12,"log_start":"0'0","ondisk_log_start":"0'0","created":12,"last_epoch_clean":13,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-08-01T19:53:57.959448+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-08-01T19:53:57.959448+0000","last_clean_scrub_stamp":"2023-08-01T19:53:57.959448+0000","objects_scrubbed":0,"log_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-08-03T05:17:03.508898+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[1,2],"acting":[1,2],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":1,"acting_primary":1,"purged_snaps":[]},{"pgid":"3.6","version":"18'1","reported_seq":18,"reported_epoch":24,"state":"active+clean","last_fresh":"2023-08-01T19:54:31.157491+0000","last_change":"2023-08-01T19:54:04.068041+0000","last_active":"2023-08-01T19:54:31.157491+0000","last_peered":"2023-08-01T19:54:31.157491+0000","last_clean":"2023-08-01T19:54:31.157491+0000","last_became_active":"2023-08-01T19:54:04.067613+0000","last_became_peered":"2023-08-01T19:54:04.067613+0000","last_unstale":"2023-08-01T19:54:31.157491+0000","last_undegraded":"2023-08-01T19:54:31.157491+0000","last_fullsized":"2023-08-01T19:54:31.157491+0000","mapping_epoch":15,"log_start":"0'0","ondisk_log_start":"0'0","created":15,"last_epoch_clean":16,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-08-01T19:54:03.032665+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-08-01T19:54:03.032665+0000","last_clean_scrub_stamp":"2023-08-01T19:54:03.032665+0000","objects_scrubbed":0,"log_size":1,"ondisk_log_size":1,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-08-02T21:35:44.874727+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":1,"num_object_clones":0,"num_object_copies":2,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":1,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":1,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":1,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[0,1],"acting":[0,1],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":0,"acting_primary":0,"purged_snaps":[]},{"pgid":"4.1","version":"0'0","reported_seq":16,"reported_epoch":24,"state":"active+clean","last_fresh":"2023-08-01T19:54:31.156989+0000","last_change":"2023-08-01T19:54:04.469243+0000","last_active":"2023-08-01T19:54:31.156989+0000","last_peered":"2023-08-01T19:54:31.156989+0000","last_clean":"2023-08-01T19:54:31.156989+0000","last_became_active":"2023-08-01T19:54:04.468835+0000","last_became_peered":"2023-08-01T19:54:04.468835+0000","last_unstale":"2023-08-01T19:54:31.156989+0000","last_undegraded":"2023-08-01T19:54:31.156989+0000","last_fullsized":"2023-08-01T19:54:31.156989+0000","mapping_epoch":16,"log_start":"0'0","ondisk_log_start":"0'0","created":16,"last_epoch_clean":17,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-08-01T19:54:04.040663+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-08-01T19:54:04.040663+0000","last_clean_scrub_stamp":"2023-08-01T19:54:04.040663+0000","objects_scrubbed":0,"log_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-08-03T04:43:58.358628+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[2,1],"acting":[2,1],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":2,"acting_primary":2,"purged_snaps":[]},{"pgid":"3.1b","version":"17'1","reported_seq":18,"reported_epoch":24,"state":"active+clean","last_fresh":"2023-08-01T19:54:31.157511+0000","last_change":"2023-08-01T19:54:04.066748+0000","last_active":"2023-08-01T19:54:31.157511+0000","last_peered":"2023-08-01T19:54:31.157511+0000","last_clean":"2023-08-01T19:54:31.157511+0000","last_became_active":"2023-08-01T19:54:04.066483+0000","last_became_peered":"2023-08-01T19:54:04.066483+0000","last_unstale":"2023-08-01T19:54:31.157511+0000","last_undegraded":"2023-08-01T19:54:31.157511+0000","last_fullsized":"2023-08-01T19:54:31.157511+0000","mapping_epoch":15,"log_start":"0'0","ondisk_log_start":"0'0","created":15,"last_epoch_clean":16,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-08-01T19:54:03.032665+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-08-01T19:54:03.032665+0000","last_clean_scrub_stamp":"2023-08-01T19:54:03.032665+0000","objects_scrubbed":0,"log_size":1,"ondisk_log_size":1,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-08-03T03:08:26.880362+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[2,1],"acting":[2,1],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":2,"acting_primary":2,"purged_snaps":[]},{"pgid":"4.1c","version":"0'0","reported_seq":16,"reported_epoch":24,"state":"active+clean","last_fresh":"2023-08-01T19:54:31.157362+0000","last_change":"2023-08-01T19:54:04.466766+0000","last_active":"2023-08-01T19:54:31.157362+0000","last_peered":"2023-08-01T19:54:31.157362+0000","last_clean":"2023-08-01T19:54:31.157362+0000","last_became_active":"2023-08-01T19:54:04.466417+0000","last_became_peered":"2023-08-01T19:54:04.466417+0000","last_unstale":"2023-08-01T19:54:31.157362+0000","last_undegraded":"2023-08-01T19:54:31.157362+0000","last_fullsized":"2023-08-01T19:54:31.157362+0000","mapping_epoch":16,"log_start":"0'0","ondisk_log_start":"0'0","created":16,"last_epoch_clean":17,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-08-01T19:54:04.040663+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-08-01T19:54:04.040663+0000","last_clean_scrub_stamp":"2023-08-01T19:54:04.040663+0000","objects_scrubbed":0,"log_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-08-02T22:01:53.643825+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[2,0],"acting":[2,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":2,"acting_primary":2,"purged_snaps":[]},{"pgid":"3.1c","version":"17'2","reported_seq":19,"reported_epoch":24,"state":"active+clean","last_fresh":"2023-08-01T19:54:31.164203+0000","last_change":"2023-08-01T19:54:04.065706+0000","last_active":"2023-08-01T19:54:31.164203+0000","last_peered":"2023-08-01T19:54:31.164203+0000","last_clean":"2023-08-01T19:54:31.164203+0000","last_became_active":"2023-08-01T19:54:04.064796+0000","last_became_peered":"2023-08-01T19:54:04.064796+0000","last_unstale":"2023-08-01T19:54:31.164203+0000","last_undegraded":"2023-08-01T19:54:31.164203+0000","last_fullsized":"2023-08-01T19:54:31.164203+0000","mapping_epoch":15,"log_start":"0'0","ondisk_log_start":"0'0","created":15,"last_epoch_clean":16,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-08-01T19:54:03.032665+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-08-01T19:54:03.032665+0000","last_clean_scrub_stamp":"2023-08-01T19:54:03.032665+0000","objects_scrubbed":0,"log_size":2,"ondisk_log_size":2,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-08-02T21:40:43.596301+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":1,"num_object_clones":0,"num_object_copies":2,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":1,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":3,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":1,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[1,0],"acting":[1,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":1,"acting_primary":1,"purged_snaps":[]},{"pgid":"4.1b","version":"0'0","reported_seq":16,"reported_epoch":24,"state":"active+clean","last_fresh":"2023-08-01T19:54:31.163745+0000","last_change":"2023-08-01T19:54:04.474971+0000","last_active":"2023-08-01T19:54:31.163745+0000","last_peered":"2023-08-01T19:54:31.163745+0000","last_clean":"2023-08-01T19:54:31.163745+0000","last_became_active":"2023-08-01T19:54:04.473957+0000","last_became_peered":"2023-08-01T19:54:04.473957+0000","last_unstale":"2023-08-01T19:54:31.163745+0000","last_undegraded":"2023-08-01T19:54:31.163745+0000","last_fullsized":"2023-08-01T19:54:31.163745+0000","mapping_epoch":16,"log_start":"0'0","ondisk_log_start":"0'0","created":16,"last_epoch_clean":17,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-08-01T19:54:04.040663+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-08-01T19:54:04.040663+0000","last_clean_scrub_stamp":"2023-08-01T19:54:04.040663+0000","objects_scrubbed":0,"log_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-08-02T21:59:19.682560+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[1,0],"acting":[1,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":1,"acting_primary":1,"purged_snaps":[]},{"pgid":"3.1d","version":"17'2","reported_seq":19,"reported_epoch":24,"state":"active+clean","last_fresh":"2023-08-01T19:54:31.157170+0000","last_change":"2023-08-01T19:54:04.065591+0000","last_active":"2023-08-01T19:54:31.157170+0000","last_peered":"2023-08-01T19:54:31.157170+0000","last_clean":"2023-08-01T19:54:31.157170+0000","last_became_active":"2023-08-01T19:54:04.065306+0000","last_became_peered":"2023-08-01T19:54:04.065306+0000","last_unstale":"2023-08-01T19:54:31.157170+0000","last_undegraded":"2023-08-01T19:54:31.157170+0000","last_fullsized":"2023-08-01T19:54:31.157170+0000","mapping_epoch":15,"log_start":"0'0","ondisk_log_start":"0'0","created":15,"last_epoch_clean":16,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-08-01T19:54:03.032665+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-08-01T19:54:03.032665+0000","last_clean_scrub_stamp":"2023-08-01T19:54:03.032665+0000","objects_scrubbed":0,"log_size":2,"ondisk_log_size":2,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-08-02T21:32:10.389227+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":1,"num_object_clones":0,"num_object_copies":2,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":1,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":3,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":1,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[2,1],"acting":[2,1],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":2,"acting_primary":2,"purged_snaps":[]},{"pgid":"4.1a","version":"0'0","reported_seq":16,"reported_epoch":24,"state":"active+clean","last_fresh":"2023-08-01T19:54:31.163662+0000","last_change":"2023-08-01T19:54:04.473302+0000","last_active":"2023-08-01T19:54:31.163662+0000","last_peered":"2023-08-01T19:54:31.163662+0000","last_clean":"2023-08-01T19:54:31.163662+0000","last_became_active":"2023-08-01T19:54:04.472452+0000","last_became_peered":"2023-08-01T19:54:04.472452+0000","last_unstale":"2023-08-01T19:54:31.163662+0000","last_undegraded":"2023-08-01T19:54:31.163662+0000","last_fullsized":"2023-08-01T19:54:31.163662+0000","mapping_epoch":16,"log_start":"0'0","ondisk_log_start":"0'0","created":16,"last_epoch_clean":17,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-08-01T19:54:04.040663+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-08-01T19:54:04.040663+0000","last_clean_scrub_stamp":"2023-08-01T19:54:04.040663+0000","objects_scrubbed":0,"log_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-08-02T21:02:39.542019+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[1,0],"acting":[1,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":1,"acting_primary":1,"purged_snaps":[]},{"pgid":"3.1e","version":"17'1","reported_seq":18,"reported_epoch":24,"state":"active+clean","last_fresh":"2023-08-01T19:54:31.157859+0000","last_change":"2023-08-01T19:54:04.064378+0000","last_active":"2023-08-01T19:54:31.157859+0000","last_peered":"2023-08-01T19:54:31.157859+0000","last_clean":"2023-08-01T19:54:31.157859+0000","last_became_active":"2023-08-01T19:54:04.063988+0000","last_became_peered":"2023-08-01T19:54:04.063988+0000","last_unstale":"2023-08-01T19:54:31.157859+0000","last_undegraded":"2023-08-01T19:54:31.157859+0000","last_fullsized":"2023-08-01T19:54:31.157859+0000","mapping_epoch":15,"log_start":"0'0","ondisk_log_start":"0'0","created":15,"last_epoch_clean":16,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-08-01T19:54:03.032665+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-08-01T19:54:03.032665+0000","last_clean_scrub_stamp":"2023-08-01T19:54:03.032665+0000","objects_scrubbed":0,"log_size":1,"ondisk_log_size":1,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-08-02T22:28:51.936138+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[0,2],"acting":[0,2],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":0,"acting_primary":0,"purged_snaps":[]},{"pgid":"4.19","version":"0'0","reported_seq":16,"reported_epoch":24,"state":"active+clean","last_fresh":"2023-08-01T19:54:31.157266+0000","last_change":"2023-08-01T19:54:04.467017+0000","last_active":"2023-08-01T19:54:31.157266+0000","last_peered":"2023-08-01T19:54:31.157266+0000","last_clean":"2023-08-01T19:54:31.157266+0000","last_became_active":"2023-08-01T19:54:04.466339+0000","last_became_peered":"2023-08-01T19:54:04.466339+0000","last_unstale":"2023-08-01T19:54:31.157266+0000","last_undegraded":"2023-08-01T19:54:31.157266+0000","last_fullsized":"2023-08-01T19:54:31.157266+0000","mapping_epoch":16,"log_start":"0'0","ondisk_log_start":"0'0","created":16,"last_epoch_clean":17,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-08-01T19:54:04.040663+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-08-01T19:54:04.040663+0000","last_clean_scrub_stamp":"2023-08-01T19:54:04.040663+0000","objects_scrubbed":0,"log_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-08-03T04:07:57.222873+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[2,0],"acting":[2,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":2,"acting_primary":2,"purged_snaps":[]},{"pgid":"3.1f","version":"17'4","reported_seq":21,"reported_epoch":24,"state":"active+clean","last_fresh":"2023-08-01T19:54:31.157242+0000","last_change":"2023-08-01T19:54:04.067767+0000","last_active":"2023-08-01T19:54:31.157242+0000","last_peered":"2023-08-01T19:54:31.157242+0000","last_clean":"2023-08-01T19:54:31.157242+0000","last_became_active":"2023-08-01T19:54:04.067414+0000","last_became_peered":"2023-08-01T19:54:04.067414+0000","last_unstale":"2023-08-01T19:54:31.157242+0000","last_undegraded":"2023-08-01T19:54:31.157242+0000","last_fullsized":"2023-08-01T19:54:31.157242+0000","mapping_epoch":15,"log_start":"0'0","ondisk_log_start":"0'0","created":15,"last_epoch_clean":16,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-08-01T19:54:03.032665+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-08-01T19:54:03.032665+0000","last_clean_scrub_stamp":"2023-08-01T19:54:03.032665+0000","objects_scrubbed":0,"log_size":4,"ondisk_log_size":4,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-08-02T21:33:27.007118+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":554,"num_objects":2,"num_object_clones":0,"num_object_copies":4,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":2,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":4,"num_write_kb":1,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":1,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[0,1],"acting":[0,1],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":0,"acting_primary":0,"purged_snaps":[]},{"pgid":"4.18","version":"0'0","reported_seq":16,"reported_epoch":24,"state":"active+clean","last_fresh":"2023-08-01T19:54:31.163665+0000","last_change":"2023-08-01T19:54:04.477588+0000","last_active":"2023-08-01T19:54:31.163665+0000","last_peered":"2023-08-01T19:54:31.163665+0000","last_clean":"2023-08-01T19:54:31.163665+0000","last_became_active":"2023-08-01T19:54:04.476194+0000","last_became_peered":"2023-08-01T19:54:04.476194+0000","last_unstale":"2023-08-01T19:54:31.163665+0000","last_undegraded":"2023-08-01T19:54:31.163665+0000","last_fullsized":"2023-08-01T19:54:31.163665+0000","mapping_epoch":16,"log_start":"0'0","ondisk_log_start":"0'0","created":16,"last_epoch_clean":17,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-08-01T19:54:04.040663+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-08-01T19:54:04.040663+0000","last_clean_scrub_stamp":"2023-08-01T19:54:04.040663+0000","objects_scrubbed":0,"log_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-08-03T03:58:06.360840+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[1,0],"acting":[1,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":1,"acting_primary":1,"purged_snaps":[]},{"pgid":"4.20","version":"0'0","reported_seq":16,"reported_epoch":24,"state":"active+clean","last_fresh":"2023-08-01T19:54:31.163500+0000","last_change":"2023-08-01T19:54:04.477904+0000","last_active":"2023-08-01T19:54:31.163500+0000","last_peered":"2023-08-01T19:54:31.163500+0000","last_clean":"2023-08-01T19:54:31.163500+0000","last_became_active":"2023-08-01T19:54:04.476564+0000","last_became_peered":"2023-08-01T19:54:04.476564+0000","last_unstale":"2023-08-01T19:54:31.163500+0000","last_undegraded":"2023-08-01T19:54:31.163500+0000","last_fullsized":"2023-08-01T19:54:31.163500+0000","mapping_epoch":16,"log_start":"0'0","ondisk_log_start":"0'0","created":16,"last_epoch_clean":17,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-08-01T19:54:04.040663+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-08-01T19:54:04.040663+0000","last_clean_scrub_stamp":"2023-08-01T19:54:04.040663+0000","objects_scrubbed":0,"log_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-08-03T02:21:47.656072+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[1,0],"acting":[1,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":1,"acting_primary":1,"purged_snaps":[]},{"pgid":"4.21","version":"0'0","reported_seq":16,"reported_epoch":24,"state":"active+clean","last_fresh":"2023-08-01T19:54:31.156592+0000","last_change":"2023-08-01T19:54:04.466899+0000","last_active":"2023-08-01T19:54:31.156592+0000","last_peered":"2023-08-01T19:54:31.156592+0000","last_clean":"2023-08-01T19:54:31.156592+0000","last_became_active":"2023-08-01T19:54:04.466500+0000","last_became_peered":"2023-08-01T19:54:04.466500+0000","last_unstale":"2023-08-01T19:54:31.156592+0000","last_undegraded":"2023-08-01T19:54:31.156592+0000","last_fullsized":"2023-08-01T19:54:31.156592+0000","mapping_epoch":16,"log_start":"0'0","ondisk_log_start":"0'0","created":16,"last_epoch_clean":17,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-08-01T19:54:04.040663+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-08-01T19:54:04.040663+0000","last_clean_scrub_stamp":"2023-08-01T19:54:04.040663+0000","objects_scrubbed":0,"log_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-08-03T07:36:38.654701+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[0,2],"acting":[0,2],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":0,"acting_primary":0,"purged_snaps":[]},{"pgid":"4.22","version":"0'0","reported_seq":16,"reported_epoch":24,"state":"active+clean","last_fresh":"2023-08-01T19:54:31.156862+0000","last_change":"2023-08-01T19:54:04.471945+0000","last_active":"2023-08-01T19:54:31.156862+0000","last_peered":"2023-08-01T19:54:31.156862+0000","last_clean":"2023-08-01T19:54:31.156862+0000","last_became_active":"2023-08-01T19:54:04.471371+0000","last_became_peered":"2023-08-01T19:54:04.471371+0000","last_unstale":"2023-08-01T19:54:31.156862+0000","last_undegraded":"2023-08-01T19:54:31.156862+0000","last_fullsized":"2023-08-01T19:54:31.156862+0000","mapping_epoch":16,"log_start":"0'0","ondisk_log_start":"0'0","created":16,"last_epoch_clean":17,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-08-01T19:54:04.040663+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-08-01T19:54:04.040663+0000","last_clean_scrub_stamp":"2023-08-01T19:54:04.040663+0000","objects_scrubbed":0,"log_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-08-02T22:17:59.847819+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[2,1],"acting":[2,1],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":2,"acting_primary":2,"purged_snaps":[]},{"pgid":"4.23","version":"0'0","reported_seq":16,"reported_epoch":24,"state":"active+clean","last_fresh":"2023-08-01T19:54:31.157156+0000","last_change":"2023-08-01T19:54:04.467847+0000","last_active":"2023-08-01T19:54:31.157156+0000","last_peered":"2023-08-01T19:54:31.157156+0000","last_clean":"2023-08-01T19:54:31.157156+0000","last_became_active":"2023-08-01T19:54:04.467111+0000","last_became_peered":"2023-08-01T19:54:04.467111+0000","last_unstale":"2023-08-01T19:54:31.157156+0000","last_undegraded":"2023-08-01T19:54:31.157156+0000","last_fullsized":"2023-08-01T19:54:31.157156+0000","mapping_epoch":16,"log_start":"0'0","ondisk_log_start":"0'0","created":16,"last_epoch_clean":17,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-08-01T19:54:04.040663+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-08-01T19:54:04.040663+0000","last_clean_scrub_stamp":"2023-08-01T19:54:04.040663+0000","objects_scrubbed":0,"log_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-08-03T00:42:19.379348+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[0,2],"acting":[0,2],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":0,"acting_primary":0,"purged_snaps":[]},{"pgid":"4.24","version":"0'0","reported_seq":16,"reported_epoch":24,"state":"active+clean","last_fresh":"2023-08-01T19:54:31.157441+0000","last_change":"2023-08-01T19:54:04.477128+0000","last_active":"2023-08-01T19:54:31.157441+0000","last_peered":"2023-08-01T19:54:31.157441+0000","last_clean":"2023-08-01T19:54:31.157441+0000","last_became_active":"2023-08-01T19:54:04.476819+0000","last_became_peered":"2023-08-01T19:54:04.476819+0000","last_unstale":"2023-08-01T19:54:31.157441+0000","last_undegraded":"2023-08-01T19:54:31.157441+0000","last_fullsized":"2023-08-01T19:54:31.157441+0000","mapping_epoch":16,"log_start":"0'0","ondisk_log_start":"0'0","created":16,"last_epoch_clean":17,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-08-01T19:54:04.040663+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-08-01T19:54:04.040663+0000","last_clean_scrub_stamp":"2023-08-01T19:54:04.040663+0000","objects_scrubbed":0,"log_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-08-03T02:20:23.354054+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[2,1],"acting":[2,1],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":2,"acting_primary":2,"purged_snaps":[]}],"pool_stats":[{"poolid":5,"num_pg":16,"stat_sum":{"num_bytes":2465923072,"num_objects":37627,"num_object_clones":0,"num_object_copies":75254,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":37627,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":37627,"num_write_kb":2408128,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"store_stats":{"total":0,"available":0,"internally_reserved":0,"allocated":305922048,"data_stored":4894752768,"data_compressed":23429812,"data_compressed_allocated":305922048,"data_compressed_original":4894752768,"omap_allocated":0,"internal_metadata":0},"log_size":37627,"ondisk_log_size":37627,"up":32,"acting":32,"num_store_stats":3},{"poolid":4,"num_pg":64,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"store_stats":{"total":0,"available":0,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},"log_size":0,"ondisk_log_size":0,"up":128,"acting":128,"num_store_stats":3},{"poolid":3,"num_pg":32,"stat_sum":{"num_bytes":2306,"num_objects":22,"num_object_clones":0,"num_object_copies":44,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":22,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":45,"num_write_kb":13,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":14,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"store_stats":{"total":0,"available":0,"internally_reserved":0,"allocated":65536,"data_stored":4612,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},"log_size":39,"ondisk_log_size":39,"up":64,"acting":64,"num_store_stats":3},{"poolid":1,"num_pg":1,"stat_sum":{"num_bytes":590368,"num_objects":2,"num_object_clones":0,"num_object_copies":4,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":2,"num_whiteouts":0,"num_read":136,"num_read_kb":118,"num_write":203,"num_write_kb":3460,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"store_stats":{"total":0,"available":0,"internally_reserved":0,"allocated":114688,"data_stored":1180736,"data_compressed":20662,"data_compressed_allocated":73728,"data_compressed_original":1146880,"omap_allocated":0,"internal_metadata":0},"log_size":157,"ondisk_log_size":157,"up":2,"acting":2,"num_store_stats":2},{"poolid":2,"num_pg":8,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"store_stats":{"total":0,"available":0,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},"log_size":0,"ondisk_log_size":0,"up":16,"acting":16,"num_store_stats":3}],"osd_stats":[{"osd":2,"up_from":9,"seq":38654705677,"num_pgs":76,"num_osds":1,"num_per_pool_osds":1,"num_per_pool_omap_osds":1,"kb":94371840,"kb_used":117960,"kb_used_data":84224,"kb_used_omap":0,"kb_used_meta":33728,"kb_avail":94253880,"statfs":{"total":96636764160,"available":96515973120,"internally_reserved":0,"allocated":86245376,"data_stored":1375428921,"data_compressed":6590814,"data_compressed_allocated":85958656,"data_compressed_original":1375322112,"omap_allocated":0,"internal_metadata":34537472},"hb_peers":[0,1],"snap_trim_queue_len":0,"num_snap_trimming":0,"num_shards_repaired":0,"op_queue_age_hist":{"histogram":[2,1,4,2],"upper_bound":16},"perf_stat":{"commit_latency_ms":2,"apply_latency_ms":2,"commit_latency_ns":2000000,"apply_latency_ns":2000000},"alerts":[],"network_ping_times":[{"osd":0,"last update":"Thu Jan 1 00:00:00 1970","interfaces":[{"interface":"back","average":{"1min":0,"5min":0,"15min":0},"min":{"1min":0,"5min":0,"15min":0},"max":{"1min":0,"5min":0,"15min":0},"last":0.33400000000000002}]},{"osd":1,"last update":"Thu Jan 1 00:00:00 1970","interfaces":[{"interface":"back","average":{"1min":0,"5min":0,"15min":0},"min":{"1min":0,"5min":0,"15min":0},"max":{"1min":0,"5min":0,"15min":0},"last":0.22500000000000001}]}]},{"osd":0,"up_from":8,"seq":34359738380,"num_pgs":85,"num_osds":1,"num_per_pool_osds":1,"num_per_pool_omap_osds":1,"kb":94371840,"kb_used":146984,"kb_used_data":111328,"kb_used_omap":0,"kb_used_meta":35648,"kb_avail":94224856,"statfs":{"total":96636764160,"available":96486252544,"internally_reserved":0,"allocated":113999872,"data_stored":1820281050,"data_compressed":8711981,"data_compressed_allocated":113762304,"data_compressed_original":1820196864,"omap_allocated":0,"internal_metadata":36503552},"hb_peers":[1,2],"snap_trim_queue_len":0,"num_snap_trimming":0,"num_shards_repaired":0,"op_queue_age_hist":{"histogram":[],"upper_bound":1},"perf_stat":{"commit_latency_ms":2,"apply_latency_ms":2,"commit_latency_ns":2000000,"apply_latency_ns":2000000},"alerts":[],"network_ping_times":[{"osd":1,"last update":"Thu Jan 1 00:00:00 1970","interfaces":[{"interface":"back","average":{"1min":0,"5min":0,"15min":0},"min":{"1min":0,"5min":0,"15min":0},"max":{"1min":0,"5min":0,"15min":0},"last":0.45100000000000001}]},{"osd":2,"last update":"Thu Jan 1 00:00:00 1970","interfaces":[{"interface":"back","average":{"1min":0,"5min":0,"15min":0},"min":{"1min":0,"5min":0,"15min":0},"max":{"1min":0,"5min":0,"15min":0},"last":0.26800000000000002}]}]},{"osd":1,"up_from":8,"seq":34359738379,"num_pgs":81,"num_osds":1,"num_per_pool_osds":1,"num_per_pool_omap_osds":1,"kb":94371840,"kb_used":119828,"kb_used_data":85708,"kb_used_omap":0,"kb_used_meta":34112,"kb_avail":94252012,"statfs":{"total":96636764160,"available":96514060288,"internally_reserved":0,"allocated":87764992,"data_stored":1399804336,"data_compressed":6707047,"data_compressed_allocated":87482368,"data_compressed_original":1399701504,"omap_allocated":0,"internal_metadata":34930688},"hb_peers":[0,2],"snap_trim_queue_len":0,"num_snap_trimming":0,"num_shards_repaired":0,"op_queue_age_hist":{"histogram":[3,1,4,1],"upper_bound":16},"perf_stat":{"commit_latency_ms":2,"apply_latency_ms":2,"commit_latency_ns":2000000,"apply_latency_ns":2000000},"alerts":[],"network_ping_times":[{"osd":0,"last update":"Thu Jan 1 00:00:00 1970","interfaces":[{"interface":"back","average":{"1min":0,"5min":0,"15min":0},"min":{"1min":0,"5min":0,"15min":0},"max":{"1min":0,"5min":0,"15min":0},"last":0.313}]},{"osd":2,"last update":"Thu Jan 1 00:00:00 1970","interfaces":[{"interface":"back","average":{"1min":0,"5min":0,"15min":0},"min":{"1min":0,"5min":0,"15min":0},"max":{"1min":0,"5min":0,"15min":0},"last":0.28100000000000003}]}]}],"pool_statfs":[{"poolid":1,"osd":1,"total":0,"available":0,"internally_reserved":0,"allocated":57344,"data_stored":590368,"data_compressed":10331,"data_compressed_allocated":36864,"data_compressed_original":573440,"omap_allocated":0,"internal_metadata":0},{"poolid":1,"osd":2,"total":0,"available":0,"internally_reserved":0,"allocated":57344,"data_stored":590368,"data_compressed":10331,"data_compressed_allocated":36864,"data_compressed_original":573440,"omap_allocated":0,"internal_metadata":0},{"poolid":2,"osd":0,"total":0,"available":0,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":2,"osd":1,"total":0,"available":0,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":2,"osd":2,"total":0,"available":0,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":3,"osd":0,"total":0,"available":0,"internally_reserved":0,"allocated":8192,"data_stored":588,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":3,"osd":1,"total":0,"available":0,"internally_reserved":0,"allocated":32768,"data_stored":2306,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":3,"osd":2,"total":0,"available":0,"internally_reserved":0,"allocated":24576,"data_stored":1718,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":4,"osd":0,"total":0,"available":0,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":4,"osd":1,"total":0,"available":0,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":4,"osd":2,"total":0,"available":0,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":5,"osd":0,"total":0,"available":0,"internally_reserved":0,"allocated":121630720,"data_stored":1946091520,"data_compressed":9315175,"data_compressed_allocated":121630720,"data_compressed_original":1946091520,"omap_allocated":0,"internal_metadata":0},{"poolid":5,"osd":1,"total":0,"available":0,"internally_reserved":0,"allocated":93265920,"data_stored":1492254720,"data_compressed":7142910,"data_compressed_allocated":93265920,"data_compressed_original":1492254720,"omap_allocated":0,"internal_metadata":0},{"poolid":5,"osd":2,"total":0,"available":0,"internally_reserved":0,"allocated":91025408,"data_stored":1456406528,"data_compressed":6971727,"data_compressed_allocated":91025408,"data_compressed_original":1456406528,"omap_allocated":0,"internal_metadata":0}]}} 2023-08-01T19:54:39.334 INFO:tasks.thrashosds.thrasher:Setting 4.32 to [1, 2, 0] 2023-08-01T19:54:39.334 INFO:tasks.thrashosds.thrasher:cmd ['osd', 'pg-upmap-items', '4.32', '1', '2', '0'] 2023-08-01T19:54:39.335 DEBUG:teuthology.orchestra.run.smithi006:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 120 ceph --cluster ceph osd pg-upmap-items 4.32 1 2 0 2023-08-01T19:54:39.342 DEBUG:teuthology.orchestra.run.smithi008:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 30 ceph --cluster ceph --admin-daemon /var/run/ceph/ceph-osd.0.asok dump_historic_ops 2023-08-01T19:54:39.426 INFO:tasks.ceph.osd.0.smithi008.stderr:2023-08-01T19:54:39.426+0000 7f16a58f4700 -1 received signal: Hangup from /usr/bin/python3 /bin/daemon-helper kill ceph-osd -f --cluster ceph -i 0 (PID: 111179) UID: 0 2023-08-01T19:54:39.524 INFO:tasks.ceph.osd.0.smithi008.stderr:2023-08-01T19:54:39.523+0000 7f16a58f4700 -1 received signal: Hangup from /usr/bin/python3 /bin/daemon-helper kill ceph-osd -f --cluster ceph -i 0 (PID: 111179) UID: 0 2023-08-01T19:54:39.576 INFO:teuthology.orchestra.run.smithi008.stdout:ERROR: (22) Invalid argument 2023-08-01T19:54:39.576 INFO:teuthology.orchestra.run.smithi008.stdout:op_tracker tracking is not enabled now, so no ops are tracked currently, even those get stuck. Please enable "osd_enable_op_tracker", and the tracker will start to track new ops received afterwards. 2023-08-01T19:54:39.591 DEBUG:teuthology.orchestra.run.smithi101:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 30 ceph --cluster ceph --admin-daemon /var/run/ceph/ceph-osd.1.asok dump_ops_in_flight 2023-08-01T19:54:39.634 INFO:tasks.ceph.osd.1.smithi101.stderr:2023-08-01T19:54:39.633+0000 7fb0cb7f6700 -1 received signal: Hangup from /usr/bin/python3 /bin/daemon-helper kill ceph-osd -f --cluster ceph -i 1 (PID: 111141) UID: 0 2023-08-01T19:54:39.725 INFO:tasks.ceph.osd.0.smithi008.stderr:2023-08-01T19:54:39.725+0000 7f16a58f4700 -1 received signal: Hangup from /usr/bin/python3 /bin/daemon-helper kill ceph-osd -f --cluster ceph -i 0 (PID: 111179) UID: 0 2023-08-01T19:54:39.734 INFO:teuthology.orchestra.run.smithi006.stderr:Error EINVAL: you must specify pairs of osd ids to be remapped 2023-08-01T19:54:39.737 DEBUG:teuthology.orchestra.run:got remote process result: 22 2023-08-01T19:54:39.737 INFO:tasks.thrashosds.thrasher:Failed to rm-pg-upmap-items, ignoring 2023-08-01T19:54:39.768 INFO:teuthology.orchestra.run.smithi101.stdout:ERROR: (22) Invalid argument 2023-08-01T19:54:39.768 INFO:teuthology.orchestra.run.smithi101.stdout:op_tracker tracking is not enabled now, so no ops are tracked currently, even those get stuck. Please enable "osd_enable_op_tracker", and the tracker will start to track new ops received afterwards. 2023-08-01T19:54:39.781 DEBUG:teuthology.orchestra.run.smithi101:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 30 ceph --cluster ceph --admin-daemon /var/run/ceph/ceph-osd.1.asok dump_blocked_ops 2023-08-01T19:54:39.864 INFO:tasks.ceph.osd.1.smithi101.stderr:2023-08-01T19:54:39.863+0000 7fb0cb7f6700 -1 received signal: Hangup from /usr/bin/python3 /bin/daemon-helper kill ceph-osd -f --cluster ceph -i 1 (PID: 111141) UID: 0 2023-08-01T19:54:39.927 INFO:tasks.ceph.osd.1.smithi101.stderr:2023-08-01T19:54:39.926+0000 7fb0cb7f6700 -1 received signal: Hangup from /usr/bin/python3 /bin/daemon-helper kill ceph-osd -f --cluster ceph -i 1 (PID: 111141) UID: 0 2023-08-01T19:54:39.993 INFO:teuthology.orchestra.run.smithi101.stdout:ERROR: (22) Invalid argument 2023-08-01T19:54:39.993 INFO:teuthology.orchestra.run.smithi101.stdout:op_tracker tracking is not enabled now, so no ops are tracked currently, even those get stuck. Please enable "osd_enable_op_tracker", and the tracker will start to track new ops received afterwards. 2023-08-01T19:54:40.007 DEBUG:teuthology.orchestra.run.smithi101:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 30 ceph --cluster ceph --admin-daemon /var/run/ceph/ceph-osd.1.asok dump_historic_ops 2023-08-01T19:54:40.028 INFO:tasks.ceph.osd.2.smithi155.stderr:2023-08-01T19:54:40.026+0000 7faa5c6ac700 -1 received signal: Hangup from /usr/bin/python3 /bin/daemon-helper kill ceph-osd -f --cluster ceph -i 2 (PID: 111337) UID: 0 2023-08-01T19:54:40.129 INFO:tasks.ceph.osd.1.smithi101.stderr:2023-08-01T19:54:40.128+0000 7fb0cb7f6700 -1 received signal: Hangup from /usr/bin/python3 /bin/daemon-helper kill ceph-osd -f --cluster ceph -i 1 (PID: 111141) UID: 0 2023-08-01T19:54:40.204 INFO:teuthology.orchestra.run.smithi006.stderr:noscrub is unset 2023-08-01T19:54:40.226 INFO:teuthology.orchestra.run.smithi101.stdout:ERROR: (22) Invalid argument 2023-08-01T19:54:40.227 INFO:teuthology.orchestra.run.smithi101.stdout:op_tracker tracking is not enabled now, so no ops are tracked currently, even those get stuck. Please enable "osd_enable_op_tracker", and the tracker will start to track new ops received afterwards. 2023-08-01T19:54:40.229 INFO:tasks.ceph.osd.2.smithi155.stderr:2023-08-01T19:54:40.228+0000 7faa5c6ac700 -1 received signal: Hangup from /usr/bin/python3 /bin/daemon-helper kill ceph-osd -f --cluster ceph -i 2 (PID: 111337) UID: 0 2023-08-01T19:54:40.242 DEBUG:teuthology.orchestra.run.smithi155:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 30 ceph --cluster ceph --admin-daemon /var/run/ceph/ceph-osd.2.asok dump_ops_in_flight 2023-08-01T19:54:40.313 INFO:tasks.radosbench.radosbench.0.smithi006.stdout: 16 16 50034 50018 195.368 146.188 0.00719728 0.00511549 2023-08-01T19:54:40.330 INFO:tasks.ceph.osd.2.smithi155.stderr:2023-08-01T19:54:40.329+0000 7faa5c6ac700 -1 received signal: Hangup from /usr/bin/python3 /bin/daemon-helper kill ceph-osd -f --cluster ceph -i 2 (PID: 111337) UID: 0 2023-08-01T19:54:40.410 INFO:teuthology.orchestra.run.smithi155.stdout:ERROR: (22) Invalid argument 2023-08-01T19:54:40.411 INFO:teuthology.orchestra.run.smithi155.stdout:op_tracker tracking is not enabled now, so no ops are tracked currently, even those get stuck. Please enable "osd_enable_op_tracker", and the tracker will start to track new ops received afterwards. 2023-08-01T19:54:40.423 DEBUG:teuthology.orchestra.run.smithi155:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 30 ceph --cluster ceph --admin-daemon /var/run/ceph/ceph-osd.2.asok dump_blocked_ops 2023-08-01T19:54:40.465 INFO:tasks.ceph.osd.2.smithi155.stderr:2023-08-01T19:54:40.463+0000 7faa5c6ac700 -1 received signal: Hangup from /usr/bin/python3 /bin/daemon-helper kill ceph-osd -f --cluster ceph -i 2 (PID: 111337) UID: 0 2023-08-01T19:54:40.532 INFO:tasks.ceph.osd.1.smithi101.stderr:2023-08-01T19:54:40.531+0000 7fb0cb7f6700 -1 received signal: Hangup from /usr/bin/python3 /bin/daemon-helper kill ceph-osd -f --cluster ceph -i 1 (PID: 111141) UID: 0 2023-08-01T19:54:40.633 INFO:tasks.ceph.osd.2.smithi155.stderr:2023-08-01T19:54:40.631+0000 7faa5c6ac700 -1 received signal: Hangup from /usr/bin/python3 /bin/daemon-helper kill ceph-osd -f --cluster ceph -i 2 (PID: 111337) UID: 0 2023-08-01T19:54:40.635 INFO:teuthology.orchestra.run.smithi155.stdout:ERROR: (22) Invalid argument 2023-08-01T19:54:40.635 INFO:teuthology.orchestra.run.smithi155.stdout:op_tracker tracking is not enabled now, so no ops are tracked currently, even those get stuck. Please enable "osd_enable_op_tracker", and the tracker will start to track new ops received afterwards. 2023-08-01T19:54:40.649 DEBUG:teuthology.orchestra.run.smithi155:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 30 ceph --cluster ceph --admin-daemon /var/run/ceph/ceph-osd.2.asok dump_historic_ops 2023-08-01T19:54:40.734 INFO:tasks.ceph.osd.1.smithi101.stderr:2023-08-01T19:54:40.732+0000 7fb0cb7f6700 -1 received signal: Hangup from /usr/bin/python3 /bin/daemon-helper kill ceph-osd -f --cluster ceph -i 1 (PID: 111141) UID: 0 2023-08-01T19:54:40.834 INFO:tasks.ceph.osd.2.smithi155.stderr:2023-08-01T19:54:40.833+0000 7faa5c6ac700 -1 received signal: Hangup from /usr/bin/python3 /bin/daemon-helper kill ceph-osd -f --cluster ceph -i 2 (PID: 111337) UID: 0 2023-08-01T19:54:40.859 INFO:teuthology.orchestra.run.smithi155.stdout:ERROR: (22) Invalid argument 2023-08-01T19:54:40.860 INFO:teuthology.orchestra.run.smithi155.stdout:op_tracker tracking is not enabled now, so no ops are tracked currently, even those get stuck. Please enable "osd_enable_op_tracker", and the tracker will start to track new ops received afterwards. 2023-08-01T19:54:40.873 DEBUG:teuthology.orchestra.run.smithi008:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 30 ceph --cluster ceph --admin-daemon /var/run/ceph/ceph-osd.0.asok dump_ops_in_flight 2023-08-01T19:54:40.924 DEBUG:teuthology.orchestra.run.smithi006:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 120 ceph --cluster ceph -- tell 'osd.*' injectargs --osd_enable_op_tracker=true 2023-08-01T19:54:40.935 INFO:tasks.ceph.osd.2.smithi155.stderr:2023-08-01T19:54:40.934+0000 7faa5c6ac700 -1 received signal: Hangup from /usr/bin/python3 /bin/daemon-helper kill ceph-osd -f --cluster ceph -i 2 (PID: 111337) UID: 0 2023-08-01T19:54:41.036 INFO:tasks.ceph.osd.2.smithi155.stderr:2023-08-01T19:54:41.034+0000 7faa5c6ac700 -1 received signal: Hangup from /usr/bin/python3 /bin/daemon-helper kill ceph-osd -f --cluster ceph -i 2 (PID: 111337) UID: 0 2023-08-01T19:54:41.070 INFO:teuthology.orchestra.run.smithi008.stdout:ERROR: (22) Invalid argument 2023-08-01T19:54:41.070 INFO:teuthology.orchestra.run.smithi008.stdout:op_tracker tracking is not enabled now, so no ops are tracked currently, even those get stuck. Please enable "osd_enable_op_tracker", and the tracker will start to track new ops received afterwards. 2023-08-01T19:54:41.078 INFO:teuthology.orchestra.run.smithi006.stdout:osd.0: {} 2023-08-01T19:54:41.086 DEBUG:teuthology.orchestra.run.smithi008:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 30 ceph --cluster ceph --admin-daemon /var/run/ceph/ceph-osd.0.asok dump_blocked_ops 2023-08-01T19:54:41.098 INFO:teuthology.orchestra.run.smithi006.stdout:osd.1: {} 2023-08-01T19:54:41.118 INFO:teuthology.orchestra.run.smithi006.stdout:osd.2: {} 2023-08-01T19:54:41.119 INFO:teuthology.orchestra.run.smithi006.stderr:osd.0: osd_enable_op_tracker = 'true' 2023-08-01T19:54:41.119 INFO:teuthology.orchestra.run.smithi006.stderr:osd.1: osd_enable_op_tracker = 'true' 2023-08-01T19:54:41.119 INFO:teuthology.orchestra.run.smithi006.stderr:osd.2: osd_enable_op_tracker = 'true' 2023-08-01T19:54:41.137 INFO:tasks.ceph.osd.2.smithi155.stderr:2023-08-01T19:54:41.135+0000 7faa5c6ac700 -1 received signal: Hangup from /usr/bin/python3 /bin/daemon-helper kill ceph-osd -f --cluster ceph -i 2 (PID: 111337) UID: 0 2023-08-01T19:54:41.237 INFO:tasks.ceph.osd.1.smithi101.stderr:2023-08-01T19:54:41.236+0000 7fb0cb7f6700 -1 received signal: Hangup from /usr/bin/python3 /bin/daemon-helper kill ceph-osd -f --cluster ceph -i 1 (PID: 111141) UID: 0 2023-08-01T19:54:41.280 INFO:teuthology.orchestra.run.smithi008.stdout:{ 2023-08-01T19:54:41.281 INFO:teuthology.orchestra.run.smithi008.stdout: "ops": [], 2023-08-01T19:54:41.281 INFO:teuthology.orchestra.run.smithi008.stdout: "complaint_time": 30, 2023-08-01T19:54:41.281 INFO:teuthology.orchestra.run.smithi008.stdout: "num_blocked_ops": 0 2023-08-01T19:54:41.281 INFO:teuthology.orchestra.run.smithi008.stdout:} 2023-08-01T19:54:41.295 DEBUG:teuthology.orchestra.run.smithi008:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 30 ceph --cluster ceph --admin-daemon /var/run/ceph/ceph-osd.0.asok dump_historic_ops 2023-08-01T19:54:41.313 INFO:tasks.radosbench.radosbench.0.smithi006.stdout: 17 16 52303 52287 192.217 141.812 0.00888925 0.00519943 2023-08-01T19:54:41.338 INFO:tasks.ceph.osd.2.smithi155.stderr:2023-08-01T19:54:41.337+0000 7faa5c6ac700 -1 received signal: Hangup from /usr/bin/python3 /bin/daemon-helper kill ceph-osd -f --cluster ceph -i 2 (PID: 111337) UID: 0 2023-08-01T19:54:41.439 INFO:tasks.ceph.osd.0.smithi008.stderr:2023-08-01T19:54:41.438+0000 7f16a58f4700 -1 received signal: Hangup from /usr/bin/python3 /bin/daemon-helper kill ceph-osd -f --cluster ceph -i 0 (PID: 111179) UID: 0 2023-08-01T19:54:41.493 INFO:teuthology.orchestra.run.smithi008.stdout:{ 2023-08-01T19:54:41.493 INFO:teuthology.orchestra.run.smithi008.stdout: "size": 20, 2023-08-01T19:54:41.493 INFO:teuthology.orchestra.run.smithi008.stdout: "duration": 600, 2023-08-01T19:54:41.493 INFO:teuthology.orchestra.run.smithi008.stdout: "ops": [ 2023-08-01T19:54:41.494 INFO:teuthology.orchestra.run.smithi008.stdout: { 2023-08-01T19:54:41.494 INFO:teuthology.orchestra.run.smithi008.stdout: "description": "osd_op(mds.0.3:5 3.1f 3:ff5b34d6:::1.00000000:head [create,setxattr parent (30) in=6b,setxattr layout (30) in=6b] snapc 0=[] ondisk+write+known_if_redirected+full_force+supports_pool_eio e17)", 2023-08-01T19:54:41.494 INFO:teuthology.orchestra.run.smithi008.stdout: "initiated_at": "2023-08-01T19:54:04.459120+0000", 2023-08-01T19:54:41.494 INFO:teuthology.orchestra.run.smithi008.stdout: "age": 37.030816741999999, 2023-08-01T19:54:41.494 INFO:teuthology.orchestra.run.smithi008.stdout: "duration": 0.012982585, 2023-08-01T19:54:41.494 INFO:teuthology.orchestra.run.smithi008.stdout: "type_data": { 2023-08-01T19:54:41.494 INFO:teuthology.orchestra.run.smithi008.stdout: "flag_point": "commit sent; apply or cleanup", 2023-08-01T19:54:41.495 INFO:teuthology.orchestra.run.smithi008.stdout: "events": [ 2023-08-01T19:54:41.495 INFO:teuthology.orchestra.run.smithi008.stdout: { 2023-08-01T19:54:41.495 INFO:teuthology.orchestra.run.smithi008.stdout: "event": "initiated", 2023-08-01T19:54:41.495 INFO:teuthology.orchestra.run.smithi008.stdout: "time": "2023-08-01T19:54:04.459120+0000", 2023-08-01T19:54:41.495 INFO:teuthology.orchestra.run.smithi008.stdout: "duration": 0 2023-08-01T19:54:41.495 INFO:teuthology.orchestra.run.smithi008.stdout: }, 2023-08-01T19:54:41.495 INFO:teuthology.orchestra.run.smithi008.stdout: { 2023-08-01T19:54:41.495 INFO:teuthology.orchestra.run.smithi008.stdout: "event": "throttled", 2023-08-01T19:54:41.496 INFO:teuthology.orchestra.run.smithi008.stdout: "time": "2023-08-01T19:54:04.459120+0000", 2023-08-01T19:54:41.496 INFO:teuthology.orchestra.run.smithi008.stdout: "duration": 0 2023-08-01T19:54:41.496 INFO:teuthology.orchestra.run.smithi008.stdout: }, 2023-08-01T19:54:41.496 INFO:teuthology.orchestra.run.smithi008.stdout: { 2023-08-01T19:54:41.496 INFO:teuthology.orchestra.run.smithi008.stdout: "event": "header_read", 2023-08-01T19:54:41.496 INFO:teuthology.orchestra.run.smithi008.stdout: "time": "2023-08-01T19:54:04.459119+0000", 2023-08-01T19:54:41.496 INFO:teuthology.orchestra.run.smithi008.stdout: "duration": 4294967295.999999 2023-08-01T19:54:41.497 INFO:teuthology.orchestra.run.smithi008.stdout: }, 2023-08-01T19:54:41.497 INFO:teuthology.orchestra.run.smithi008.stdout: { 2023-08-01T19:54:41.497 INFO:teuthology.orchestra.run.smithi008.stdout: "event": "all_read", 2023-08-01T19:54:41.497 INFO:teuthology.orchestra.run.smithi008.stdout: "time": "2023-08-01T19:54:04.459137+0000", 2023-08-01T19:54:41.497 INFO:teuthology.orchestra.run.smithi008.stdout: "duration": 1.7554000000000002e-05 2023-08-01T19:54:41.497 INFO:teuthology.orchestra.run.smithi008.stdout: }, 2023-08-01T19:54:41.497 INFO:teuthology.orchestra.run.smithi008.stdout: { 2023-08-01T19:54:41.497 INFO:teuthology.orchestra.run.smithi008.stdout: "event": "dispatched", 2023-08-01T19:54:41.498 INFO:teuthology.orchestra.run.smithi008.stdout: "time": "2023-08-01T19:54:04.459148+0000", 2023-08-01T19:54:41.498 INFO:teuthology.orchestra.run.smithi008.stdout: "duration": 1.1248e-05 2023-08-01T19:54:41.498 INFO:teuthology.orchestra.run.smithi008.stdout: }, 2023-08-01T19:54:41.498 INFO:teuthology.orchestra.run.smithi008.stdout: { 2023-08-01T19:54:41.498 INFO:teuthology.orchestra.run.smithi008.stdout: "event": "queued_for_pg", 2023-08-01T19:54:41.498 INFO:teuthology.orchestra.run.smithi008.stdout: "time": "2023-08-01T19:54:04.459167+0000", 2023-08-01T19:54:41.498 INFO:teuthology.orchestra.run.smithi008.stdout: "duration": 1.9457999999999999e-05 2023-08-01T19:54:41.498 INFO:teuthology.orchestra.run.smithi008.stdout: }, 2023-08-01T19:54:41.499 INFO:teuthology.orchestra.run.smithi008.stdout: { 2023-08-01T19:54:41.499 INFO:teuthology.orchestra.run.smithi008.stdout: "event": "reached_pg", 2023-08-01T19:54:41.499 INFO:teuthology.orchestra.run.smithi008.stdout: "time": "2023-08-01T19:54:04.459863+0000", 2023-08-01T19:54:41.499 INFO:teuthology.orchestra.run.smithi008.stdout: "duration": 0.000695325 2023-08-01T19:54:41.499 INFO:teuthology.orchestra.run.smithi008.stdout: }, 2023-08-01T19:54:41.499 INFO:teuthology.orchestra.run.smithi008.stdout: { 2023-08-01T19:54:41.499 INFO:teuthology.orchestra.run.smithi008.stdout: "event": "waiting_for_map not empty", 2023-08-01T19:54:41.500 INFO:teuthology.orchestra.run.smithi008.stdout: "time": "2023-08-01T19:54:04.459866+0000", 2023-08-01T19:54:41.500 INFO:teuthology.orchestra.run.smithi008.stdout: "duration": 3.1540000000000002e-06 2023-08-01T19:54:41.500 INFO:teuthology.orchestra.run.smithi008.stdout: }, 2023-08-01T19:54:41.500 INFO:teuthology.orchestra.run.smithi008.stdout: { 2023-08-01T19:54:41.500 INFO:teuthology.orchestra.run.smithi008.stdout: "event": "reached_pg", 2023-08-01T19:54:41.500 INFO:teuthology.orchestra.run.smithi008.stdout: "time": "2023-08-01T19:54:04.462285+0000", 2023-08-01T19:54:41.500 INFO:teuthology.orchestra.run.smithi008.stdout: "duration": 0.0024190560000000002 2023-08-01T19:54:41.500 INFO:teuthology.orchestra.run.smithi008.stdout: }, 2023-08-01T19:54:41.501 INFO:teuthology.orchestra.run.smithi008.stdout: { 2023-08-01T19:54:41.501 INFO:teuthology.orchestra.run.smithi008.stdout: "event": "started", 2023-08-01T19:54:41.501 INFO:teuthology.orchestra.run.smithi008.stdout: "time": "2023-08-01T19:54:04.462365+0000", 2023-08-01T19:54:41.501 INFO:teuthology.orchestra.run.smithi008.stdout: "duration": 8.0488999999999995e-05 2023-08-01T19:54:41.501 INFO:teuthology.orchestra.run.smithi008.stdout: }, 2023-08-01T19:54:41.501 INFO:teuthology.orchestra.run.smithi008.stdout: { 2023-08-01T19:54:41.501 INFO:teuthology.orchestra.run.smithi008.stdout: "event": "waiting for subops from 1", 2023-08-01T19:54:41.501 INFO:teuthology.orchestra.run.smithi008.stdout: "time": "2023-08-01T19:54:04.462560+0000", 2023-08-01T19:54:41.502 INFO:teuthology.orchestra.run.smithi008.stdout: "duration": 0.00019412300000000001 2023-08-01T19:54:41.502 INFO:teuthology.orchestra.run.smithi008.stdout: }, 2023-08-01T19:54:41.502 INFO:teuthology.orchestra.run.smithi008.stdout: { 2023-08-01T19:54:41.502 INFO:teuthology.orchestra.run.smithi008.stdout: "event": "op_commit", 2023-08-01T19:54:41.502 INFO:teuthology.orchestra.run.smithi008.stdout: "time": "2023-08-01T19:54:04.467069+0000", 2023-08-01T19:54:41.502 INFO:teuthology.orchestra.run.smithi008.stdout: "duration": 0.0045089709999999996 2023-08-01T19:54:41.502 INFO:teuthology.orchestra.run.smithi008.stdout: }, 2023-08-01T19:54:41.502 INFO:teuthology.orchestra.run.smithi008.stdout: { 2023-08-01T19:54:41.503 INFO:teuthology.orchestra.run.smithi008.stdout: "event": "sub_op_commit_rec", 2023-08-01T19:54:41.503 INFO:teuthology.orchestra.run.smithi008.stdout: "time": "2023-08-01T19:54:04.471986+0000", 2023-08-01T19:54:41.503 INFO:teuthology.orchestra.run.smithi008.stdout: "duration": 0.0049178499999999997 2023-08-01T19:54:41.503 INFO:teuthology.orchestra.run.smithi008.stdout: }, 2023-08-01T19:54:41.503 INFO:teuthology.orchestra.run.smithi008.stdout: { 2023-08-01T19:54:41.503 INFO:teuthology.orchestra.run.smithi008.stdout: "event": "commit_sent", 2023-08-01T19:54:41.503 INFO:teuthology.orchestra.run.smithi008.stdout: "time": "2023-08-01T19:54:04.472060+0000", 2023-08-01T19:54:41.504 INFO:teuthology.orchestra.run.smithi008.stdout: "duration": 7.4049999999999997e-05 2023-08-01T19:54:41.504 INFO:teuthology.orchestra.run.smithi008.stdout: }, 2023-08-01T19:54:41.504 INFO:teuthology.orchestra.run.smithi008.stdout: { 2023-08-01T19:54:41.504 INFO:teuthology.orchestra.run.smithi008.stdout: "event": "done", 2023-08-01T19:54:41.504 INFO:teuthology.orchestra.run.smithi008.stdout: "time": "2023-08-01T19:54:04.472102+0000", 2023-08-01T19:54:41.504 INFO:teuthology.orchestra.run.smithi008.stdout: "duration": 4.206e-05 2023-08-01T19:54:41.504 INFO:teuthology.orchestra.run.smithi008.stdout: } 2023-08-01T19:54:41.504 INFO:teuthology.orchestra.run.smithi008.stdout: ] 2023-08-01T19:54:41.505 INFO:teuthology.orchestra.run.smithi008.stdout: } 2023-08-01T19:54:41.505 INFO:teuthology.orchestra.run.smithi008.stdout: }, 2023-08-01T19:54:41.505 INFO:teuthology.orchestra.run.smithi008.stdout: { 2023-08-01T19:54:41.505 INFO:teuthology.orchestra.run.smithi008.stdout: "description": "osd_op(mds.0.3:26 3.1f 3:fe07bba1:::100.00000000.inode:head [writefull 0~554] snapc 0=[] ondisk+write+known_if_redirected+full_force+supports_pool_eio e17)", 2023-08-01T19:54:41.505 INFO:teuthology.orchestra.run.smithi008.stdout: "initiated_at": "2023-08-01T19:54:04.459230+0000", 2023-08-01T19:54:41.505 INFO:teuthology.orchestra.run.smithi008.stdout: "age": 37.030706875, 2023-08-01T19:54:41.505 INFO:teuthology.orchestra.run.smithi008.stdout: "duration": 0.013017103, 2023-08-01T19:54:41.505 INFO:teuthology.orchestra.run.smithi008.stdout: "type_data": { 2023-08-01T19:54:41.506 INFO:teuthology.orchestra.run.smithi008.stdout: "flag_point": "commit sent; apply or cleanup", 2023-08-01T19:54:41.506 INFO:teuthology.orchestra.run.smithi008.stdout: "events": [ 2023-08-01T19:54:41.506 INFO:teuthology.orchestra.run.smithi008.stdout: { 2023-08-01T19:54:41.506 INFO:teuthology.orchestra.run.smithi008.stdout: "event": "initiated", 2023-08-01T19:54:41.506 INFO:teuthology.orchestra.run.smithi008.stdout: "time": "2023-08-01T19:54:04.459230+0000", 2023-08-01T19:54:41.506 INFO:teuthology.orchestra.run.smithi008.stdout: "duration": 0 2023-08-01T19:54:41.506 INFO:teuthology.orchestra.run.smithi008.stdout: }, 2023-08-01T19:54:41.506 INFO:teuthology.orchestra.run.smithi008.stdout: { 2023-08-01T19:54:41.507 INFO:teuthology.orchestra.run.smithi008.stdout: "event": "throttled", 2023-08-01T19:54:41.507 INFO:teuthology.orchestra.run.smithi008.stdout: "time": "2023-08-01T19:54:04.459230+0000", 2023-08-01T19:54:41.507 INFO:teuthology.orchestra.run.smithi008.stdout: "duration": 0 2023-08-01T19:54:41.507 INFO:teuthology.orchestra.run.smithi008.stdout: }, 2023-08-01T19:54:41.507 INFO:teuthology.orchestra.run.smithi008.stdout: { 2023-08-01T19:54:41.507 INFO:teuthology.orchestra.run.smithi008.stdout: "event": "header_read", 2023-08-01T19:54:41.507 INFO:teuthology.orchestra.run.smithi008.stdout: "time": "2023-08-01T19:54:04.459229+0000", 2023-08-01T19:54:41.507 INFO:teuthology.orchestra.run.smithi008.stdout: "duration": 4294967295.9999995 2023-08-01T19:54:41.508 INFO:teuthology.orchestra.run.smithi008.stdout: }, 2023-08-01T19:54:41.508 INFO:teuthology.orchestra.run.smithi008.stdout: { 2023-08-01T19:54:41.508 INFO:teuthology.orchestra.run.smithi008.stdout: "event": "all_read", 2023-08-01T19:54:41.508 INFO:teuthology.orchestra.run.smithi008.stdout: "time": "2023-08-01T19:54:04.459233+0000", 2023-08-01T19:54:41.508 INFO:teuthology.orchestra.run.smithi008.stdout: "duration": 3.7400000000000002e-06 2023-08-01T19:54:41.508 INFO:teuthology.orchestra.run.smithi008.stdout: }, 2023-08-01T19:54:41.508 INFO:teuthology.orchestra.run.smithi008.stdout: { 2023-08-01T19:54:41.508 INFO:teuthology.orchestra.run.smithi008.stdout: "event": "dispatched", 2023-08-01T19:54:41.509 INFO:teuthology.orchestra.run.smithi008.stdout: "time": "2023-08-01T19:54:04.459240+0000", 2023-08-01T19:54:41.509 INFO:teuthology.orchestra.run.smithi008.stdout: "duration": 6.9059999999999996e-06 2023-08-01T19:54:41.509 INFO:teuthology.orchestra.run.smithi008.stdout: }, 2023-08-01T19:54:41.509 INFO:teuthology.orchestra.run.smithi008.stdout: { 2023-08-01T19:54:41.509 INFO:teuthology.orchestra.run.smithi008.stdout: "event": "queued_for_pg", 2023-08-01T19:54:41.509 INFO:teuthology.orchestra.run.smithi008.stdout: "time": "2023-08-01T19:54:04.459245+0000", 2023-08-01T19:54:41.509 INFO:teuthology.orchestra.run.smithi008.stdout: "duration": 4.8890000000000001e-06 2023-08-01T19:54:41.509 INFO:teuthology.orchestra.run.smithi008.stdout: }, 2023-08-01T19:54:41.510 INFO:teuthology.orchestra.run.smithi008.stdout: { 2023-08-01T19:54:41.510 INFO:teuthology.orchestra.run.smithi008.stdout: "event": "reached_pg", 2023-08-01T19:54:41.510 INFO:teuthology.orchestra.run.smithi008.stdout: "time": "2023-08-01T19:54:04.459954+0000", 2023-08-01T19:54:41.510 INFO:teuthology.orchestra.run.smithi008.stdout: "duration": 0.00070883100000000004 2023-08-01T19:54:41.510 INFO:teuthology.orchestra.run.smithi008.stdout: }, 2023-08-01T19:54:41.510 INFO:teuthology.orchestra.run.smithi008.stdout: { 2023-08-01T19:54:41.510 INFO:teuthology.orchestra.run.smithi008.stdout: "event": "waiting_for_map not empty", 2023-08-01T19:54:41.510 INFO:teuthology.orchestra.run.smithi008.stdout: "time": "2023-08-01T19:54:04.459959+0000", 2023-08-01T19:54:41.511 INFO:teuthology.orchestra.run.smithi008.stdout: "duration": 5.1340000000000003e-06 2023-08-01T19:54:41.511 INFO:teuthology.orchestra.run.smithi008.stdout: }, 2023-08-01T19:54:41.511 INFO:teuthology.orchestra.run.smithi008.stdout: { 2023-08-01T19:54:41.511 INFO:teuthology.orchestra.run.smithi008.stdout: "event": "reached_pg", 2023-08-01T19:54:41.511 INFO:teuthology.orchestra.run.smithi008.stdout: "time": "2023-08-01T19:54:04.462796+0000", 2023-08-01T19:54:41.511 INFO:teuthology.orchestra.run.smithi008.stdout: "duration": 0.0028374070000000001 2023-08-01T19:54:41.511 INFO:teuthology.orchestra.run.smithi008.stdout: }, 2023-08-01T19:54:41.511 INFO:teuthology.orchestra.run.smithi008.stdout: { 2023-08-01T19:54:41.512 INFO:teuthology.orchestra.run.smithi008.stdout: "event": "started", 2023-08-01T19:54:41.512 INFO:teuthology.orchestra.run.smithi008.stdout: "time": "2023-08-01T19:54:04.463137+0000", 2023-08-01T19:54:41.512 INFO:teuthology.orchestra.run.smithi008.stdout: "duration": 0.00034093699999999998 2023-08-01T19:54:41.512 INFO:teuthology.orchestra.run.smithi008.stdout: }, 2023-08-01T19:54:41.512 INFO:teuthology.orchestra.run.smithi008.stdout: { 2023-08-01T19:54:41.512 INFO:teuthology.orchestra.run.smithi008.stdout: "event": "waiting for subops from 1", 2023-08-01T19:54:41.512 INFO:teuthology.orchestra.run.smithi008.stdout: "time": "2023-08-01T19:54:04.463290+0000", 2023-08-01T19:54:41.513 INFO:teuthology.orchestra.run.smithi008.stdout: "duration": 0.00015267899999999999 2023-08-01T19:54:41.513 INFO:teuthology.orchestra.run.smithi008.stdout: }, 2023-08-01T19:54:41.513 INFO:teuthology.orchestra.run.smithi008.stdout: { 2023-08-01T19:54:41.513 INFO:teuthology.orchestra.run.smithi008.stdout: "event": "op_commit", 2023-08-01T19:54:41.513 INFO:teuthology.orchestra.run.smithi008.stdout: "time": "2023-08-01T19:54:04.470442+0000", 2023-08-01T19:54:41.513 INFO:teuthology.orchestra.run.smithi008.stdout: "duration": 0.0071526230000000003 2023-08-01T19:54:41.513 INFO:teuthology.orchestra.run.smithi008.stdout: }, 2023-08-01T19:54:41.513 INFO:teuthology.orchestra.run.smithi008.stdout: { 2023-08-01T19:54:41.514 INFO:teuthology.orchestra.run.smithi008.stdout: "event": "sub_op_commit_rec", 2023-08-01T19:54:41.514 INFO:teuthology.orchestra.run.smithi008.stdout: "time": "2023-08-01T19:54:04.472154+0000", 2023-08-01T19:54:41.514 INFO:teuthology.orchestra.run.smithi008.stdout: "duration": 0.0017111450000000001 2023-08-01T19:54:41.514 INFO:teuthology.orchestra.run.smithi008.stdout: }, 2023-08-01T19:54:41.514 INFO:teuthology.orchestra.run.smithi008.stdout: { 2023-08-01T19:54:41.514 INFO:teuthology.orchestra.run.smithi008.stdout: "event": "commit_sent", 2023-08-01T19:54:41.514 INFO:teuthology.orchestra.run.smithi008.stdout: "time": "2023-08-01T19:54:04.472207+0000", 2023-08-01T19:54:41.514 INFO:teuthology.orchestra.run.smithi008.stdout: "duration": 5.3059999999999997e-05 2023-08-01T19:54:41.515 INFO:teuthology.orchestra.run.smithi008.stdout: }, 2023-08-01T19:54:41.515 INFO:teuthology.orchestra.run.smithi008.stdout: { 2023-08-01T19:54:41.515 INFO:teuthology.orchestra.run.smithi008.stdout: "event": "done", 2023-08-01T19:54:41.515 INFO:teuthology.orchestra.run.smithi008.stdout: "time": "2023-08-01T19:54:04.472247+0000", 2023-08-01T19:54:41.515 INFO:teuthology.orchestra.run.smithi008.stdout: "duration": 4.0213999999999998e-05 2023-08-01T19:54:41.515 INFO:teuthology.orchestra.run.smithi008.stdout: } 2023-08-01T19:54:41.515 INFO:teuthology.orchestra.run.smithi008.stdout: ] 2023-08-01T19:54:41.515 INFO:teuthology.orchestra.run.smithi008.stdout: } 2023-08-01T19:54:41.516 INFO:teuthology.orchestra.run.smithi008.stdout: }, 2023-08-01T19:54:41.516 INFO:teuthology.orchestra.run.smithi008.stdout: { 2023-08-01T19:54:41.516 INFO:teuthology.orchestra.run.smithi008.stdout: "description": "osd_op(mds.0.3:28 3.b 3:d0630e4c:::mds0_sessionmap:head [omap-set-header] snapc 0=[] ondisk+write+known_if_redirected+full_force+supports_pool_eio e17)", 2023-08-01T19:54:41.516 INFO:teuthology.orchestra.run.smithi008.stdout: "initiated_at": "2023-08-01T19:54:04.459251+0000", 2023-08-01T19:54:41.516 INFO:teuthology.orchestra.run.smithi008.stdout: "age": 37.030685671999997, 2023-08-01T19:54:41.516 INFO:teuthology.orchestra.run.smithi008.stdout: "duration": 0.01361938, 2023-08-01T19:54:41.516 INFO:teuthology.orchestra.run.smithi008.stdout: "type_data": { 2023-08-01T19:54:41.516 INFO:teuthology.orchestra.run.smithi008.stdout: "flag_point": "commit sent; apply or cleanup", 2023-08-01T19:54:41.517 INFO:teuthology.orchestra.run.smithi008.stdout: "events": [ 2023-08-01T19:54:41.517 INFO:teuthology.orchestra.run.smithi008.stdout: { 2023-08-01T19:54:41.517 INFO:teuthology.orchestra.run.smithi008.stdout: "event": "initiated", 2023-08-01T19:54:41.517 INFO:teuthology.orchestra.run.smithi008.stdout: "time": "2023-08-01T19:54:04.459251+0000", 2023-08-01T19:54:41.517 INFO:teuthology.orchestra.run.smithi008.stdout: "duration": 0 2023-08-01T19:54:41.517 INFO:teuthology.orchestra.run.smithi008.stdout: }, 2023-08-01T19:54:41.517 INFO:teuthology.orchestra.run.smithi008.stdout: { 2023-08-01T19:54:41.518 INFO:teuthology.orchestra.run.smithi008.stdout: "event": "throttled", 2023-08-01T19:54:41.518 INFO:teuthology.orchestra.run.smithi008.stdout: "time": "2023-08-01T19:54:04.459251+0000", 2023-08-01T19:54:41.518 INFO:teuthology.orchestra.run.smithi008.stdout: "duration": 0 2023-08-01T19:54:41.518 INFO:teuthology.orchestra.run.smithi008.stdout: }, 2023-08-01T19:54:41.518 INFO:teuthology.orchestra.run.smithi008.stdout: { 2023-08-01T19:54:41.518 INFO:teuthology.orchestra.run.smithi008.stdout: "event": "header_read", 2023-08-01T19:54:41.518 INFO:teuthology.orchestra.run.smithi008.stdout: "time": "2023-08-01T19:54:04.459251+0000", 2023-08-01T19:54:41.518 INFO:teuthology.orchestra.run.smithi008.stdout: "duration": 4294967295.9999995 2023-08-01T19:54:41.519 INFO:teuthology.orchestra.run.smithi008.stdout: }, 2023-08-01T19:54:41.519 INFO:teuthology.orchestra.run.smithi008.stdout: { 2023-08-01T19:54:41.519 INFO:teuthology.orchestra.run.smithi008.stdout: "event": "all_read", 2023-08-01T19:54:41.519 INFO:teuthology.orchestra.run.smithi008.stdout: "time": "2023-08-01T19:54:04.459258+0000", 2023-08-01T19:54:41.519 INFO:teuthology.orchestra.run.smithi008.stdout: "duration": 7.0029999999999997e-06 2023-08-01T19:54:41.519 INFO:teuthology.orchestra.run.smithi008.stdout: }, 2023-08-01T19:54:41.519 INFO:teuthology.orchestra.run.smithi008.stdout: { 2023-08-01T19:54:41.519 INFO:teuthology.orchestra.run.smithi008.stdout: "event": "dispatched", 2023-08-01T19:54:41.520 INFO:teuthology.orchestra.run.smithi008.stdout: "time": "2023-08-01T19:54:04.459267+0000", 2023-08-01T19:54:41.520 INFO:teuthology.orchestra.run.smithi008.stdout: "duration": 8.8810000000000002e-06 2023-08-01T19:54:41.520 INFO:teuthology.orchestra.run.smithi008.stdout: }, 2023-08-01T19:54:41.520 INFO:teuthology.orchestra.run.smithi008.stdout: { 2023-08-01T19:54:41.520 INFO:teuthology.orchestra.run.smithi008.stdout: "event": "queued_for_pg", 2023-08-01T19:54:41.520 INFO:teuthology.orchestra.run.smithi008.stdout: "time": "2023-08-01T19:54:04.459273+0000", 2023-08-01T19:54:41.520 INFO:teuthology.orchestra.run.smithi008.stdout: "duration": 5.9279999999999998e-06 2023-08-01T19:54:41.520 INFO:teuthology.orchestra.run.smithi008.stdout: }, 2023-08-01T19:54:41.521 INFO:teuthology.orchestra.run.smithi008.stdout: { 2023-08-01T19:54:41.521 INFO:teuthology.orchestra.run.smithi008.stdout: "event": "reached_pg", 2023-08-01T19:54:41.521 INFO:teuthology.orchestra.run.smithi008.stdout: "time": "2023-08-01T19:54:04.460798+0000", 2023-08-01T19:54:41.521 INFO:teuthology.orchestra.run.smithi008.stdout: "duration": 0.001525039 2023-08-01T19:54:41.521 INFO:teuthology.orchestra.run.smithi008.stdout: }, 2023-08-01T19:54:41.521 INFO:teuthology.orchestra.run.smithi008.stdout: { 2023-08-01T19:54:41.521 INFO:teuthology.orchestra.run.smithi008.stdout: "event": "started", 2023-08-01T19:54:41.521 INFO:teuthology.orchestra.run.smithi008.stdout: "time": "2023-08-01T19:54:04.460951+0000", 2023-08-01T19:54:41.522 INFO:teuthology.orchestra.run.smithi008.stdout: "duration": 0.000153024 2023-08-01T19:54:41.522 INFO:teuthology.orchestra.run.smithi008.stdout: }, 2023-08-01T19:54:41.522 INFO:teuthology.orchestra.run.smithi008.stdout: { 2023-08-01T19:54:41.522 INFO:teuthology.orchestra.run.smithi008.stdout: "event": "waiting for subops from 1", 2023-08-01T19:54:41.522 INFO:teuthology.orchestra.run.smithi008.stdout: "time": "2023-08-01T19:54:04.461116+0000", 2023-08-01T19:54:41.522 INFO:teuthology.orchestra.run.smithi008.stdout: "duration": 0.00016551000000000001 2023-08-01T19:54:41.522 INFO:teuthology.orchestra.run.smithi008.stdout: }, 2023-08-01T19:54:41.522 INFO:teuthology.orchestra.run.smithi008.stdout: { 2023-08-01T19:54:41.523 INFO:teuthology.orchestra.run.smithi008.stdout: "event": "op_commit", 2023-08-01T19:54:41.523 INFO:teuthology.orchestra.run.smithi008.stdout: "time": "2023-08-01T19:54:04.463448+0000", 2023-08-01T19:54:41.523 INFO:teuthology.orchestra.run.smithi008.stdout: "duration": 0.0023321689999999998 2023-08-01T19:54:41.523 INFO:teuthology.orchestra.run.smithi008.stdout: }, 2023-08-01T19:54:41.523 INFO:teuthology.orchestra.run.smithi008.stdout: { 2023-08-01T19:54:41.523 INFO:teuthology.orchestra.run.smithi008.stdout: "event": "sub_op_commit_rec", 2023-08-01T19:54:41.523 INFO:teuthology.orchestra.run.smithi008.stdout: "time": "2023-08-01T19:54:04.472778+0000", 2023-08-01T19:54:41.523 INFO:teuthology.orchestra.run.smithi008.stdout: "duration": 0.0093293779999999993 2023-08-01T19:54:41.524 INFO:teuthology.orchestra.run.smithi008.stdout: }, 2023-08-01T19:54:41.524 INFO:teuthology.orchestra.run.smithi008.stdout: { 2023-08-01T19:54:41.524 INFO:teuthology.orchestra.run.smithi008.stdout: "event": "commit_sent", 2023-08-01T19:54:41.524 INFO:teuthology.orchestra.run.smithi008.stdout: "time": "2023-08-01T19:54:04.472821+0000", 2023-08-01T19:54:41.524 INFO:teuthology.orchestra.run.smithi008.stdout: "duration": 4.3253000000000001e-05 2023-08-01T19:54:41.524 INFO:teuthology.orchestra.run.smithi008.stdout: }, 2023-08-01T19:54:41.524 INFO:teuthology.orchestra.run.smithi008.stdout: { 2023-08-01T19:54:41.525 INFO:teuthology.orchestra.run.smithi008.stdout: "event": "done", 2023-08-01T19:54:41.525 INFO:teuthology.orchestra.run.smithi008.stdout: "time": "2023-08-01T19:54:04.472870+0000", 2023-08-01T19:54:41.525 INFO:teuthology.orchestra.run.smithi008.stdout: "duration": 4.9478999999999998e-05 2023-08-01T19:54:41.525 INFO:teuthology.orchestra.run.smithi008.stdout: } 2023-08-01T19:54:41.525 INFO:teuthology.orchestra.run.smithi008.stdout: ] 2023-08-01T19:54:41.525 INFO:teuthology.orchestra.run.smithi008.stdout: } 2023-08-01T19:54:41.525 INFO:teuthology.orchestra.run.smithi008.stdout: }, 2023-08-01T19:54:41.525 INFO:teuthology.orchestra.run.smithi008.stdout: { 2023-08-01T19:54:41.526 INFO:teuthology.orchestra.run.smithi008.stdout: "description": "osd_op(mds.0.3:34 3.b 3:d5c7a900:::200.00000003:head [delete] snapc 0=[] ondisk+write+known_if_redirected+full_force+supports_pool_eio e17)", 2023-08-01T19:54:41.526 INFO:teuthology.orchestra.run.smithi008.stdout: "initiated_at": "2023-08-01T19:54:04.459662+0000", 2023-08-01T19:54:41.526 INFO:teuthology.orchestra.run.smithi008.stdout: "age": 37.030274968000001, 2023-08-01T19:54:41.526 INFO:teuthology.orchestra.run.smithi008.stdout: "duration": 0.013345101999999999, 2023-08-01T19:54:41.526 INFO:teuthology.orchestra.run.smithi008.stdout: "type_data": { 2023-08-01T19:54:41.526 INFO:teuthology.orchestra.run.smithi008.stdout: "flag_point": "started", 2023-08-01T19:54:41.526 INFO:teuthology.orchestra.run.smithi008.stdout: "events": [ 2023-08-01T19:54:41.526 INFO:teuthology.orchestra.run.smithi008.stdout: { 2023-08-01T19:54:41.527 INFO:teuthology.orchestra.run.smithi008.stdout: "event": "initiated", 2023-08-01T19:54:41.527 INFO:teuthology.orchestra.run.smithi008.stdout: "time": "2023-08-01T19:54:04.459662+0000", 2023-08-01T19:54:41.527 INFO:teuthology.orchestra.run.smithi008.stdout: "duration": 0 2023-08-01T19:54:41.527 INFO:teuthology.orchestra.run.smithi008.stdout: }, 2023-08-01T19:54:41.527 INFO:teuthology.orchestra.run.smithi008.stdout: { 2023-08-01T19:54:41.527 INFO:teuthology.orchestra.run.smithi008.stdout: "event": "throttled", 2023-08-01T19:54:41.527 INFO:teuthology.orchestra.run.smithi008.stdout: "time": "2023-08-01T19:54:04.459662+0000", 2023-08-01T19:54:41.527 INFO:teuthology.orchestra.run.smithi008.stdout: "duration": 0 2023-08-01T19:54:41.528 INFO:teuthology.orchestra.run.smithi008.stdout: }, 2023-08-01T19:54:41.528 INFO:teuthology.orchestra.run.smithi008.stdout: { 2023-08-01T19:54:41.528 INFO:teuthology.orchestra.run.smithi008.stdout: "event": "header_read", 2023-08-01T19:54:41.528 INFO:teuthology.orchestra.run.smithi008.stdout: "time": "2023-08-01T19:54:04.459661+0000", 2023-08-01T19:54:41.528 INFO:teuthology.orchestra.run.smithi008.stdout: "duration": 4294967295.999999 2023-08-01T19:54:41.528 INFO:teuthology.orchestra.run.smithi008.stdout: }, 2023-08-01T19:54:41.528 INFO:teuthology.orchestra.run.smithi008.stdout: { 2023-08-01T19:54:41.528 INFO:teuthology.orchestra.run.smithi008.stdout: "event": "all_read", 2023-08-01T19:54:41.529 INFO:teuthology.orchestra.run.smithi008.stdout: "time": "2023-08-01T19:54:04.459668+0000", 2023-08-01T19:54:41.529 INFO:teuthology.orchestra.run.smithi008.stdout: "duration": 7.0219999999999999e-06 2023-08-01T19:54:41.529 INFO:teuthology.orchestra.run.smithi008.stdout: }, 2023-08-01T19:54:41.529 INFO:teuthology.orchestra.run.smithi008.stdout: { 2023-08-01T19:54:41.529 INFO:teuthology.orchestra.run.smithi008.stdout: "event": "dispatched", 2023-08-01T19:54:41.529 INFO:teuthology.orchestra.run.smithi008.stdout: "time": "2023-08-01T19:54:04.459681+0000", 2023-08-01T19:54:41.529 INFO:teuthology.orchestra.run.smithi008.stdout: "duration": 1.2999999999999999e-05 2023-08-01T19:54:41.529 INFO:teuthology.orchestra.run.smithi008.stdout: }, 2023-08-01T19:54:41.530 INFO:teuthology.orchestra.run.smithi008.stdout: { 2023-08-01T19:54:41.530 INFO:teuthology.orchestra.run.smithi008.stdout: "event": "queued_for_pg", 2023-08-01T19:54:41.530 INFO:teuthology.orchestra.run.smithi008.stdout: "time": "2023-08-01T19:54:04.459690+0000", 2023-08-01T19:54:41.530 INFO:teuthology.orchestra.run.smithi008.stdout: "duration": 9.2529999999999993e-06 2023-08-01T19:54:41.530 INFO:teuthology.orchestra.run.smithi008.stdout: }, 2023-08-01T19:54:41.530 INFO:teuthology.orchestra.run.smithi008.stdout: { 2023-08-01T19:54:41.530 INFO:teuthology.orchestra.run.smithi008.stdout: "event": "reached_pg", 2023-08-01T19:54:41.530 INFO:teuthology.orchestra.run.smithi008.stdout: "time": "2023-08-01T19:54:04.461862+0000", 2023-08-01T19:54:41.531 INFO:teuthology.orchestra.run.smithi008.stdout: "duration": 0.002172345 2023-08-01T19:54:41.531 INFO:teuthology.orchestra.run.smithi008.stdout: }, 2023-08-01T19:54:41.531 INFO:teuthology.orchestra.run.smithi008.stdout: { 2023-08-01T19:54:41.531 INFO:teuthology.orchestra.run.smithi008.stdout: "event": "started", 2023-08-01T19:54:41.531 INFO:teuthology.orchestra.run.smithi008.stdout: "time": "2023-08-01T19:54:04.462013+0000", 2023-08-01T19:54:41.531 INFO:teuthology.orchestra.run.smithi008.stdout: "duration": 0.00015044200000000001 2023-08-01T19:54:41.531 INFO:teuthology.orchestra.run.smithi008.stdout: }, 2023-08-01T19:54:41.532 INFO:teuthology.orchestra.run.smithi008.stdout: { 2023-08-01T19:54:41.532 INFO:teuthology.orchestra.run.smithi008.stdout: "event": "done", 2023-08-01T19:54:41.532 INFO:teuthology.orchestra.run.smithi008.stdout: "time": "2023-08-01T19:54:04.473007+0000", 2023-08-01T19:54:41.532 INFO:teuthology.orchestra.run.smithi008.stdout: "duration": 0.010994141000000001 2023-08-01T19:54:41.532 INFO:teuthology.orchestra.run.smithi008.stdout: } 2023-08-01T19:54:41.532 INFO:teuthology.orchestra.run.smithi008.stdout: ] 2023-08-01T19:54:41.532 INFO:teuthology.orchestra.run.smithi008.stdout: } 2023-08-01T19:54:41.532 INFO:teuthology.orchestra.run.smithi008.stdout: }, 2023-08-01T19:54:41.533 INFO:teuthology.orchestra.run.smithi008.stdout: { 2023-08-01T19:54:41.533 INFO:teuthology.orchestra.run.smithi008.stdout: "description": "osd_op(client.4668.0:18360 5.6 5:65d8e237:::benchmark_data_smithi006_114134_object18359:head [set-alloc-hint object_size 65536 write_size 65536,write 0~65536] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e23)", 2023-08-01T19:54:41.533 INFO:teuthology.orchestra.run.smithi008.stdout: "initiated_at": "2023-08-01T19:54:28.994296+0000", 2023-08-01T19:54:41.533 INFO:teuthology.orchestra.run.smithi008.stdout: "age": 12.495640735, 2023-08-01T19:54:41.533 INFO:teuthology.orchestra.run.smithi008.stdout: "duration": 0.017459669000000001, 2023-08-01T19:54:41.533 INFO:teuthology.orchestra.run.smithi008.stdout: "type_data": { 2023-08-01T19:54:41.533 INFO:teuthology.orchestra.run.smithi008.stdout: "flag_point": "commit sent; apply or cleanup", 2023-08-01T19:54:41.533 INFO:teuthology.orchestra.run.smithi008.stdout: "client_info": { 2023-08-01T19:54:41.534 INFO:teuthology.orchestra.run.smithi008.stdout: "client": "client.4668", 2023-08-01T19:54:41.534 INFO:teuthology.orchestra.run.smithi008.stdout: "client_addr": "172.21.15.6:0/1709472247", 2023-08-01T19:54:41.534 INFO:teuthology.orchestra.run.smithi008.stdout: "tid": 18360 2023-08-01T19:54:41.534 INFO:teuthology.orchestra.run.smithi008.stdout: }, 2023-08-01T19:54:41.534 INFO:teuthology.orchestra.run.smithi008.stdout: "events": [ 2023-08-01T19:54:41.534 INFO:teuthology.orchestra.run.smithi008.stdout: { 2023-08-01T19:54:41.534 INFO:teuthology.orchestra.run.smithi008.stdout: "event": "initiated", 2023-08-01T19:54:41.534 INFO:teuthology.orchestra.run.smithi008.stdout: "time": "2023-08-01T19:54:28.994296+0000", 2023-08-01T19:54:41.535 INFO:teuthology.orchestra.run.smithi008.stdout: "duration": 0 2023-08-01T19:54:41.535 INFO:teuthology.orchestra.run.smithi008.stdout: }, 2023-08-01T19:54:41.535 INFO:teuthology.orchestra.run.smithi008.stdout: { 2023-08-01T19:54:41.535 INFO:teuthology.orchestra.run.smithi008.stdout: "event": "throttled", 2023-08-01T19:54:41.535 INFO:teuthology.orchestra.run.smithi008.stdout: "time": "2023-08-01T19:54:28.994296+0000", 2023-08-01T19:54:41.535 INFO:teuthology.orchestra.run.smithi008.stdout: "duration": 0 2023-08-01T19:54:41.535 INFO:teuthology.orchestra.run.smithi008.stdout: }, 2023-08-01T19:54:41.535 INFO:teuthology.orchestra.run.smithi008.stdout: { 2023-08-01T19:54:41.536 INFO:teuthology.orchestra.run.smithi008.stdout: "event": "header_read", 2023-08-01T19:54:41.536 INFO:teuthology.orchestra.run.smithi008.stdout: "time": "2023-08-01T19:54:28.994295+0000", 2023-08-01T19:54:41.536 INFO:teuthology.orchestra.run.smithi008.stdout: "duration": 4294967295.9999995 2023-08-01T19:54:41.536 INFO:teuthology.orchestra.run.smithi008.stdout: }, 2023-08-01T19:54:41.536 INFO:teuthology.orchestra.run.smithi008.stdout: { 2023-08-01T19:54:41.536 INFO:teuthology.orchestra.run.smithi008.stdout: "event": "all_read", 2023-08-01T19:54:41.536 INFO:teuthology.orchestra.run.smithi008.stdout: "time": "2023-08-01T19:54:28.994381+0000", 2023-08-01T19:54:41.536 INFO:teuthology.orchestra.run.smithi008.stdout: "duration": 8.6055000000000002e-05 2023-08-01T19:54:41.537 INFO:teuthology.orchestra.run.smithi008.stdout: }, 2023-08-01T19:54:41.537 INFO:teuthology.orchestra.run.smithi008.stdout: { 2023-08-01T19:54:41.537 INFO:teuthology.orchestra.run.smithi008.stdout: "event": "dispatched", 2023-08-01T19:54:41.537 INFO:teuthology.orchestra.run.smithi008.stdout: "time": "2023-08-01T19:54:28.994390+0000", 2023-08-01T19:54:41.537 INFO:teuthology.orchestra.run.smithi008.stdout: "duration": 8.7530000000000007e-06 2023-08-01T19:54:41.537 INFO:teuthology.orchestra.run.smithi008.stdout: }, 2023-08-01T19:54:41.537 INFO:teuthology.orchestra.run.smithi008.stdout: { 2023-08-01T19:54:41.537 INFO:teuthology.orchestra.run.smithi008.stdout: "event": "queued_for_pg", 2023-08-01T19:54:41.538 INFO:teuthology.orchestra.run.smithi008.stdout: "time": "2023-08-01T19:54:28.994394+0000", 2023-08-01T19:54:41.538 INFO:teuthology.orchestra.run.smithi008.stdout: "duration": 3.4929999999999998e-06 2023-08-01T19:54:41.538 INFO:teuthology.orchestra.run.smithi008.stdout: }, 2023-08-01T19:54:41.538 INFO:teuthology.orchestra.run.smithi008.stdout: { 2023-08-01T19:54:41.538 INFO:teuthology.orchestra.run.smithi008.stdout: "event": "reached_pg", 2023-08-01T19:54:41.538 INFO:teuthology.orchestra.run.smithi008.stdout: "time": "2023-08-01T19:54:28.995799+0000", 2023-08-01T19:54:41.538 INFO:teuthology.orchestra.run.smithi008.stdout: "duration": 0.001405779 2023-08-01T19:54:41.538 INFO:teuthology.orchestra.run.smithi008.stdout: }, 2023-08-01T19:54:41.539 INFO:teuthology.orchestra.run.smithi008.stdout: { 2023-08-01T19:54:41.539 INFO:teuthology.orchestra.run.smithi008.stdout: "event": "started", 2023-08-01T19:54:41.539 INFO:teuthology.orchestra.run.smithi008.stdout: "time": "2023-08-01T19:54:28.995896+0000", 2023-08-01T19:54:41.539 INFO:teuthology.orchestra.run.smithi008.stdout: "duration": 9.6597999999999999e-05 2023-08-01T19:54:41.539 INFO:teuthology.orchestra.run.smithi008.stdout: }, 2023-08-01T19:54:41.539 INFO:teuthology.orchestra.run.smithi008.stdout: { 2023-08-01T19:54:41.539 INFO:teuthology.orchestra.run.smithi008.stdout: "event": "waiting for subops from 1", 2023-08-01T19:54:41.539 INFO:teuthology.orchestra.run.smithi008.stdout: "time": "2023-08-01T19:54:28.995985+0000", 2023-08-01T19:54:41.540 INFO:teuthology.orchestra.run.smithi008.stdout: "duration": 8.8479000000000004e-05 2023-08-01T19:54:41.540 INFO:teuthology.orchestra.run.smithi008.stdout: }, 2023-08-01T19:54:41.540 INFO:teuthology.orchestra.run.smithi008.stdout: { 2023-08-01T19:54:41.540 INFO:teuthology.orchestra.run.smithi008.stdout: "event": "op_commit", 2023-08-01T19:54:41.540 INFO:teuthology.orchestra.run.smithi008.stdout: "time": "2023-08-01T19:54:28.997700+0000", 2023-08-01T19:54:41.540 INFO:teuthology.orchestra.run.smithi008.stdout: "duration": 0.001714997 2023-08-01T19:54:41.540 INFO:teuthology.orchestra.run.smithi008.stdout: }, 2023-08-01T19:54:41.541 INFO:teuthology.orchestra.run.smithi008.stdout: { 2023-08-01T19:54:41.541 INFO:teuthology.orchestra.run.smithi008.stdout: "event": "sub_op_commit_rec", 2023-08-01T19:54:41.541 INFO:teuthology.orchestra.run.smithi008.stdout: "time": "2023-08-01T19:54:29.011671+0000", 2023-08-01T19:54:41.541 INFO:teuthology.orchestra.run.smithi008.stdout: "duration": 0.0139712 2023-08-01T19:54:41.541 INFO:teuthology.orchestra.run.smithi008.stdout: }, 2023-08-01T19:54:41.541 INFO:teuthology.orchestra.run.smithi008.stdout: { 2023-08-01T19:54:41.541 INFO:teuthology.orchestra.run.smithi008.stdout: "event": "commit_sent", 2023-08-01T19:54:41.541 INFO:teuthology.orchestra.run.smithi008.stdout: "time": "2023-08-01T19:54:29.011719+0000", 2023-08-01T19:54:41.542 INFO:teuthology.orchestra.run.smithi008.stdout: "duration": 4.8025000000000002e-05 2023-08-01T19:54:41.542 INFO:teuthology.orchestra.run.smithi008.stdout: }, 2023-08-01T19:54:41.542 INFO:teuthology.orchestra.run.smithi008.stdout: { 2023-08-01T19:54:41.542 INFO:teuthology.orchestra.run.smithi008.stdout: "event": "done", 2023-08-01T19:54:41.542 INFO:teuthology.orchestra.run.smithi008.stdout: "time": "2023-08-01T19:54:29.011756+0000", 2023-08-01T19:54:41.542 INFO:teuthology.orchestra.run.smithi008.stdout: "duration": 3.6825000000000001e-05 2023-08-01T19:54:41.542 INFO:teuthology.orchestra.run.smithi008.stdout: } 2023-08-01T19:54:41.542 INFO:teuthology.orchestra.run.smithi008.stdout: ] 2023-08-01T19:54:41.543 INFO:teuthology.orchestra.run.smithi008.stdout: } 2023-08-01T19:54:41.543 INFO:teuthology.orchestra.run.smithi008.stdout: }, 2023-08-01T19:54:41.543 INFO:teuthology.orchestra.run.smithi008.stdout: { 2023-08-01T19:54:41.543 INFO:teuthology.orchestra.run.smithi008.stdout: "description": "osd_op(client.4668.0:18361 5.6 5:65a8a093:::benchmark_data_smithi006_114134_object18360:head [set-alloc-hint object_size 65536 write_size 65536,write 0~65536] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e23)", 2023-08-01T19:54:41.543 INFO:teuthology.orchestra.run.smithi008.stdout: "initiated_at": "2023-08-01T19:54:28.994398+0000", 2023-08-01T19:54:41.543 INFO:teuthology.orchestra.run.smithi008.stdout: "age": 12.495538875999999, 2023-08-01T19:54:41.543 INFO:teuthology.orchestra.run.smithi008.stdout: "duration": 0.017435484000000001, 2023-08-01T19:54:41.543 INFO:teuthology.orchestra.run.smithi008.stdout: "type_data": { 2023-08-01T19:54:41.544 INFO:teuthology.orchestra.run.smithi008.stdout: "flag_point": "commit sent; apply or cleanup", 2023-08-01T19:54:41.544 INFO:teuthology.orchestra.run.smithi008.stdout: "client_info": { 2023-08-01T19:54:41.544 INFO:teuthology.orchestra.run.smithi008.stdout: "client": "client.4668", 2023-08-01T19:54:41.544 INFO:teuthology.orchestra.run.smithi008.stdout: "client_addr": "172.21.15.6:0/1709472247", 2023-08-01T19:54:41.544 INFO:teuthology.orchestra.run.smithi008.stdout: "tid": 18361 2023-08-01T19:54:41.544 INFO:teuthology.orchestra.run.smithi008.stdout: }, 2023-08-01T19:54:41.544 INFO:teuthology.orchestra.run.smithi008.stdout: "events": [ 2023-08-01T19:54:41.544 INFO:teuthology.orchestra.run.smithi008.stdout: { 2023-08-01T19:54:41.545 INFO:teuthology.orchestra.run.smithi008.stdout: "event": "initiated", 2023-08-01T19:54:41.545 INFO:teuthology.orchestra.run.smithi008.stdout: "time": "2023-08-01T19:54:28.994398+0000", 2023-08-01T19:54:41.545 INFO:teuthology.orchestra.run.smithi008.stdout: "duration": 0 2023-08-01T19:54:41.545 INFO:teuthology.orchestra.run.smithi008.stdout: }, 2023-08-01T19:54:41.545 INFO:teuthology.orchestra.run.smithi008.stdout: { 2023-08-01T19:54:41.545 INFO:teuthology.orchestra.run.smithi008.stdout: "event": "throttled", 2023-08-01T19:54:41.545 INFO:teuthology.orchestra.run.smithi008.stdout: "time": "2023-08-01T19:54:28.994398+0000", 2023-08-01T19:54:41.545 INFO:teuthology.orchestra.run.smithi008.stdout: "duration": 0 2023-08-01T19:54:41.546 INFO:teuthology.orchestra.run.smithi008.stdout: }, 2023-08-01T19:54:41.546 INFO:teuthology.orchestra.run.smithi008.stdout: { 2023-08-01T19:54:41.546 INFO:teuthology.orchestra.run.smithi008.stdout: "event": "header_read", 2023-08-01T19:54:41.546 INFO:teuthology.orchestra.run.smithi008.stdout: "time": "2023-08-01T19:54:28.994397+0000", 2023-08-01T19:54:41.546 INFO:teuthology.orchestra.run.smithi008.stdout: "duration": 4294967295.9999995 2023-08-01T19:54:41.546 INFO:teuthology.orchestra.run.smithi008.stdout: }, 2023-08-01T19:54:41.546 INFO:teuthology.orchestra.run.smithi008.stdout: { 2023-08-01T19:54:41.546 INFO:teuthology.orchestra.run.smithi008.stdout: "event": "all_read", 2023-08-01T19:54:41.547 INFO:teuthology.orchestra.run.smithi008.stdout: "time": "2023-08-01T19:54:28.994475+0000", 2023-08-01T19:54:41.547 INFO:teuthology.orchestra.run.smithi008.stdout: "duration": 7.7408000000000002e-05 2023-08-01T19:54:41.547 INFO:teuthology.orchestra.run.smithi008.stdout: }, 2023-08-01T19:54:41.547 INFO:teuthology.orchestra.run.smithi008.stdout: { 2023-08-01T19:54:41.547 INFO:teuthology.orchestra.run.smithi008.stdout: "event": "dispatched", 2023-08-01T19:54:41.547 INFO:teuthology.orchestra.run.smithi008.stdout: "time": "2023-08-01T19:54:28.994480+0000", 2023-08-01T19:54:41.547 INFO:teuthology.orchestra.run.smithi008.stdout: "duration": 5.3589999999999999e-06 2023-08-01T19:54:41.547 INFO:teuthology.orchestra.run.smithi008.stdout: }, 2023-08-01T19:54:41.548 INFO:teuthology.orchestra.run.smithi008.stdout: { 2023-08-01T19:54:41.548 INFO:teuthology.orchestra.run.smithi008.stdout: "event": "queued_for_pg", 2023-08-01T19:54:41.548 INFO:teuthology.orchestra.run.smithi008.stdout: "time": "2023-08-01T19:54:28.994484+0000", 2023-08-01T19:54:41.548 INFO:teuthology.orchestra.run.smithi008.stdout: "duration": 3.9750000000000001e-06 2023-08-01T19:54:41.548 INFO:teuthology.orchestra.run.smithi008.stdout: }, 2023-08-01T19:54:41.548 INFO:teuthology.orchestra.run.smithi008.stdout: { 2023-08-01T19:54:41.548 INFO:teuthology.orchestra.run.smithi008.stdout: "event": "reached_pg", 2023-08-01T19:54:41.549 INFO:teuthology.orchestra.run.smithi008.stdout: "time": "2023-08-01T19:54:28.996504+0000", 2023-08-01T19:54:41.549 INFO:teuthology.orchestra.run.smithi008.stdout: "duration": 0.0020198550000000001 2023-08-01T19:54:41.549 INFO:teuthology.orchestra.run.smithi008.stdout: }, 2023-08-01T19:54:41.549 INFO:teuthology.orchestra.run.smithi008.stdout: { 2023-08-01T19:54:41.549 INFO:teuthology.orchestra.run.smithi008.stdout: "event": "started", 2023-08-01T19:54:41.549 INFO:teuthology.orchestra.run.smithi008.stdout: "time": "2023-08-01T19:54:28.996624+0000", 2023-08-01T19:54:41.549 INFO:teuthology.orchestra.run.smithi008.stdout: "duration": 0.000120118 2023-08-01T19:54:41.549 INFO:teuthology.orchestra.run.smithi008.stdout: }, 2023-08-01T19:54:41.550 INFO:teuthology.orchestra.run.smithi008.stdout: { 2023-08-01T19:54:41.550 INFO:teuthology.orchestra.run.smithi008.stdout: "event": "waiting for subops from 1", 2023-08-01T19:54:41.550 INFO:teuthology.orchestra.run.smithi008.stdout: "time": "2023-08-01T19:54:28.996790+0000", 2023-08-01T19:54:41.550 INFO:teuthology.orchestra.run.smithi008.stdout: "duration": 0.000165398 2023-08-01T19:54:41.550 INFO:teuthology.orchestra.run.smithi008.stdout: }, 2023-08-01T19:54:41.550 INFO:teuthology.orchestra.run.smithi008.stdout: { 2023-08-01T19:54:41.550 INFO:teuthology.orchestra.run.smithi008.stdout: "event": "op_commit", 2023-08-01T19:54:41.550 INFO:teuthology.orchestra.run.smithi008.stdout: "time": "2023-08-01T19:54:28.999061+0000", 2023-08-01T19:54:41.551 INFO:teuthology.orchestra.run.smithi008.stdout: "duration": 0.0022714800000000002 2023-08-01T19:54:41.551 INFO:teuthology.orchestra.run.smithi008.stdout: }, 2023-08-01T19:54:41.551 INFO:teuthology.orchestra.run.smithi008.stdout: { 2023-08-01T19:54:41.551 INFO:teuthology.orchestra.run.smithi008.stdout: "event": "sub_op_commit_rec", 2023-08-01T19:54:41.551 INFO:teuthology.orchestra.run.smithi008.stdout: "time": "2023-08-01T19:54:29.011788+0000", 2023-08-01T19:54:41.551 INFO:teuthology.orchestra.run.smithi008.stdout: "duration": 0.012726774999999999 2023-08-01T19:54:41.551 INFO:teuthology.orchestra.run.smithi008.stdout: }, 2023-08-01T19:54:41.551 INFO:teuthology.orchestra.run.smithi008.stdout: { 2023-08-01T19:54:41.552 INFO:teuthology.orchestra.run.smithi008.stdout: "event": "commit_sent", 2023-08-01T19:54:41.552 INFO:teuthology.orchestra.run.smithi008.stdout: "time": "2023-08-01T19:54:29.011815+0000", 2023-08-01T19:54:41.552 INFO:teuthology.orchestra.run.smithi008.stdout: "duration": 2.7032000000000001e-05 2023-08-01T19:54:41.552 INFO:teuthology.orchestra.run.smithi008.stdout: }, 2023-08-01T19:54:41.552 INFO:teuthology.orchestra.run.smithi008.stdout: { 2023-08-01T19:54:41.552 INFO:teuthology.orchestra.run.smithi008.stdout: "event": "done", 2023-08-01T19:54:41.552 INFO:teuthology.orchestra.run.smithi008.stdout: "time": "2023-08-01T19:54:29.011833+0000", 2023-08-01T19:54:41.552 INFO:teuthology.orchestra.run.smithi008.stdout: "duration": 1.8437e-05 2023-08-01T19:54:41.553 INFO:teuthology.orchestra.run.smithi008.stdout: } 2023-08-01T19:54:41.553 INFO:teuthology.orchestra.run.smithi008.stdout: ] 2023-08-01T19:54:41.553 INFO:teuthology.orchestra.run.smithi008.stdout: } 2023-08-01T19:54:41.553 INFO:teuthology.orchestra.run.smithi008.stdout: }, 2023-08-01T19:54:41.553 INFO:teuthology.orchestra.run.smithi008.stdout: { 2023-08-01T19:54:41.553 INFO:teuthology.orchestra.run.smithi008.stdout: "description": "osd_op(client.4668.0:18363 5.5 5:ab48299e:::benchmark_data_smithi006_114134_object18362:head [set-alloc-hint object_size 65536 write_size 65536,write 0~65536] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e23)", 2023-08-01T19:54:41.553 INFO:teuthology.orchestra.run.smithi008.stdout: "initiated_at": "2023-08-01T19:54:28.996467+0000", 2023-08-01T19:54:41.553 INFO:teuthology.orchestra.run.smithi008.stdout: "age": 12.493469435, 2023-08-01T19:54:41.554 INFO:teuthology.orchestra.run.smithi008.stdout: "duration": 0.015287689, 2023-08-01T19:54:41.554 INFO:teuthology.orchestra.run.smithi008.stdout: "type_data": { 2023-08-01T19:54:41.554 INFO:teuthology.orchestra.run.smithi008.stdout: "flag_point": "commit sent; apply or cleanup", 2023-08-01T19:54:41.554 INFO:teuthology.orchestra.run.smithi008.stdout: "client_info": { 2023-08-01T19:54:41.554 INFO:teuthology.orchestra.run.smithi008.stdout: "client": "client.4668", 2023-08-01T19:54:41.554 INFO:teuthology.orchestra.run.smithi008.stdout: "client_addr": "172.21.15.6:0/1709472247", 2023-08-01T19:54:41.554 INFO:teuthology.orchestra.run.smithi008.stdout: "tid": 18363 2023-08-01T19:54:41.554 INFO:teuthology.orchestra.run.smithi008.stdout: }, 2023-08-01T19:54:41.555 INFO:teuthology.orchestra.run.smithi008.stdout: "events": [ 2023-08-01T19:54:41.555 INFO:teuthology.orchestra.run.smithi008.stdout: { 2023-08-01T19:54:41.555 INFO:teuthology.orchestra.run.smithi008.stdout: "event": "initiated", 2023-08-01T19:54:41.555 INFO:teuthology.orchestra.run.smithi008.stdout: "time": "2023-08-01T19:54:28.996467+0000", 2023-08-01T19:54:41.555 INFO:teuthology.orchestra.run.smithi008.stdout: "duration": 0 2023-08-01T19:54:41.555 INFO:teuthology.orchestra.run.smithi008.stdout: }, 2023-08-01T19:54:41.555 INFO:teuthology.orchestra.run.smithi008.stdout: { 2023-08-01T19:54:41.555 INFO:teuthology.orchestra.run.smithi008.stdout: "event": "throttled", 2023-08-01T19:54:41.556 INFO:teuthology.orchestra.run.smithi008.stdout: "time": "2023-08-01T19:54:28.996467+0000", 2023-08-01T19:54:41.556 INFO:teuthology.orchestra.run.smithi008.stdout: "duration": 0 2023-08-01T19:54:41.556 INFO:teuthology.orchestra.run.smithi008.stdout: }, 2023-08-01T19:54:41.556 INFO:teuthology.orchestra.run.smithi008.stdout: { 2023-08-01T19:54:41.556 INFO:teuthology.orchestra.run.smithi008.stdout: "event": "header_read", 2023-08-01T19:54:41.556 INFO:teuthology.orchestra.run.smithi008.stdout: "time": "2023-08-01T19:54:28.996466+0000", 2023-08-01T19:54:41.556 INFO:teuthology.orchestra.run.smithi008.stdout: "duration": 4294967295.999999 2023-08-01T19:54:41.557 INFO:teuthology.orchestra.run.smithi008.stdout: }, 2023-08-01T19:54:41.557 INFO:teuthology.orchestra.run.smithi008.stdout: { 2023-08-01T19:54:41.557 INFO:teuthology.orchestra.run.smithi008.stdout: "event": "all_read", 2023-08-01T19:54:41.557 INFO:teuthology.orchestra.run.smithi008.stdout: "time": "2023-08-01T19:54:28.996519+0000", 2023-08-01T19:54:41.557 INFO:teuthology.orchestra.run.smithi008.stdout: "duration": 5.3075000000000003e-05 2023-08-01T19:54:41.557 INFO:teuthology.orchestra.run.smithi008.stdout: }, 2023-08-01T19:54:41.557 INFO:teuthology.orchestra.run.smithi008.stdout: { 2023-08-01T19:54:41.557 INFO:teuthology.orchestra.run.smithi008.stdout: "event": "dispatched", 2023-08-01T19:54:41.558 INFO:teuthology.orchestra.run.smithi008.stdout: "time": "2023-08-01T19:54:28.996529+0000", 2023-08-01T19:54:41.558 INFO:teuthology.orchestra.run.smithi008.stdout: "duration": 9.2499999999999995e-06 2023-08-01T19:54:41.558 INFO:teuthology.orchestra.run.smithi008.stdout: }, 2023-08-01T19:54:41.558 INFO:teuthology.orchestra.run.smithi008.stdout: { 2023-08-01T19:54:41.558 INFO:teuthology.orchestra.run.smithi008.stdout: "event": "queued_for_pg", 2023-08-01T19:54:41.558 INFO:teuthology.orchestra.run.smithi008.stdout: "time": "2023-08-01T19:54:28.996537+0000", 2023-08-01T19:54:41.558 INFO:teuthology.orchestra.run.smithi008.stdout: "duration": 8.4239999999999993e-06 2023-08-01T19:54:41.558 INFO:teuthology.orchestra.run.smithi008.stdout: }, 2023-08-01T19:54:41.559 INFO:teuthology.orchestra.run.smithi008.stdout: { 2023-08-01T19:54:41.559 INFO:teuthology.orchestra.run.smithi008.stdout: "event": "reached_pg", 2023-08-01T19:54:41.559 INFO:teuthology.orchestra.run.smithi008.stdout: "time": "2023-08-01T19:54:28.996590+0000", 2023-08-01T19:54:41.559 INFO:teuthology.orchestra.run.smithi008.stdout: "duration": 5.3047999999999998e-05 2023-08-01T19:54:41.559 INFO:teuthology.orchestra.run.smithi008.stdout: }, 2023-08-01T19:54:41.559 INFO:teuthology.orchestra.run.smithi008.stdout: { 2023-08-01T19:54:41.559 INFO:teuthology.orchestra.run.smithi008.stdout: "event": "started", 2023-08-01T19:54:41.559 INFO:teuthology.orchestra.run.smithi008.stdout: "time": "2023-08-01T19:54:28.996707+0000", 2023-08-01T19:54:41.560 INFO:teuthology.orchestra.run.smithi008.stdout: "duration": 0.000117005 2023-08-01T19:54:41.560 INFO:teuthology.orchestra.run.smithi008.stdout: }, 2023-08-01T19:54:41.560 INFO:teuthology.orchestra.run.smithi008.stdout: { 2023-08-01T19:54:41.560 INFO:teuthology.orchestra.run.smithi008.stdout: "event": "waiting for subops from 1", 2023-08-01T19:54:41.560 INFO:teuthology.orchestra.run.smithi008.stdout: "time": "2023-08-01T19:54:28.996807+0000", 2023-08-01T19:54:41.560 INFO:teuthology.orchestra.run.smithi008.stdout: "duration": 0.0001003 2023-08-01T19:54:41.560 INFO:teuthology.orchestra.run.smithi008.stdout: }, 2023-08-01T19:54:41.560 INFO:teuthology.orchestra.run.smithi008.stdout: { 2023-08-01T19:54:41.561 INFO:teuthology.orchestra.run.smithi008.stdout: "event": "op_commit", 2023-08-01T19:54:41.561 INFO:teuthology.orchestra.run.smithi008.stdout: "time": "2023-08-01T19:54:28.998511+0000", 2023-08-01T19:54:41.561 INFO:teuthology.orchestra.run.smithi008.stdout: "duration": 0.00170397 2023-08-01T19:54:41.561 INFO:teuthology.orchestra.run.smithi008.stdout: }, 2023-08-01T19:54:41.561 INFO:teuthology.orchestra.run.smithi008.stdout: { 2023-08-01T19:54:41.561 INFO:teuthology.orchestra.run.smithi008.stdout: "event": "sub_op_commit_rec", 2023-08-01T19:54:41.561 INFO:teuthology.orchestra.run.smithi008.stdout: "time": "2023-08-01T19:54:29.011698+0000", 2023-08-01T19:54:41.561 INFO:teuthology.orchestra.run.smithi008.stdout: "duration": 0.013186959 2023-08-01T19:54:41.562 INFO:teuthology.orchestra.run.smithi008.stdout: }, 2023-08-01T19:54:41.562 INFO:teuthology.orchestra.run.smithi008.stdout: { 2023-08-01T19:54:41.562 INFO:teuthology.orchestra.run.smithi008.stdout: "event": "commit_sent", 2023-08-01T19:54:41.562 INFO:teuthology.orchestra.run.smithi008.stdout: "time": "2023-08-01T19:54:29.011729+0000", 2023-08-01T19:54:41.562 INFO:teuthology.orchestra.run.smithi008.stdout: "duration": 3.044e-05 2023-08-01T19:54:41.562 INFO:teuthology.orchestra.run.smithi008.stdout: }, 2023-08-01T19:54:41.562 INFO:teuthology.orchestra.run.smithi008.stdout: { 2023-08-01T19:54:41.562 INFO:teuthology.orchestra.run.smithi008.stdout: "event": "done", 2023-08-01T19:54:41.563 INFO:teuthology.orchestra.run.smithi008.stdout: "time": "2023-08-01T19:54:29.011755+0000", 2023-08-01T19:54:41.563 INFO:teuthology.orchestra.run.smithi008.stdout: "duration": 2.6165000000000001e-05 2023-08-01T19:54:41.563 INFO:teuthology.orchestra.run.smithi008.stdout: } 2023-08-01T19:54:41.563 INFO:teuthology.orchestra.run.smithi008.stdout: ] 2023-08-01T19:54:41.563 INFO:teuthology.orchestra.run.smithi008.stdout: } 2023-08-01T19:54:41.563 INFO:teuthology.orchestra.run.smithi008.stdout: }, 2023-08-01T19:54:41.563 INFO:teuthology.orchestra.run.smithi008.stdout: { 2023-08-01T19:54:41.563 INFO:teuthology.orchestra.run.smithi008.stdout: "description": "osd_op(client.4668.0:18368 5.5 5:ac90765d:::benchmark_data_smithi006_114134_object18367:head [set-alloc-hint object_size 65536 write_size 65536,write 0~65536] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e23)", 2023-08-01T19:54:41.564 INFO:teuthology.orchestra.run.smithi008.stdout: "initiated_at": "2023-08-01T19:54:28.996987+0000", 2023-08-01T19:54:41.564 INFO:teuthology.orchestra.run.smithi008.stdout: "age": 12.492949588, 2023-08-01T19:54:41.564 INFO:teuthology.orchestra.run.smithi008.stdout: "duration": 0.014851731999999999, 2023-08-01T19:54:41.564 INFO:teuthology.orchestra.run.smithi008.stdout: "type_data": { 2023-08-01T19:54:41.564 INFO:teuthology.orchestra.run.smithi008.stdout: "flag_point": "commit sent; apply or cleanup", 2023-08-01T19:54:41.564 INFO:teuthology.orchestra.run.smithi008.stdout: "client_info": { 2023-08-01T19:54:41.564 INFO:teuthology.orchestra.run.smithi008.stdout: "client": "client.4668", 2023-08-01T19:54:41.564 INFO:teuthology.orchestra.run.smithi008.stdout: "client_addr": "172.21.15.6:0/1709472247", 2023-08-01T19:54:41.565 INFO:teuthology.orchestra.run.smithi008.stdout: "tid": 18368 2023-08-01T19:54:41.565 INFO:teuthology.orchestra.run.smithi008.stdout: }, 2023-08-01T19:54:41.565 INFO:teuthology.orchestra.run.smithi008.stdout: "events": [ 2023-08-01T19:54:41.565 INFO:teuthology.orchestra.run.smithi008.stdout: { 2023-08-01T19:54:41.565 INFO:teuthology.orchestra.run.smithi008.stdout: "event": "initiated", 2023-08-01T19:54:41.565 INFO:teuthology.orchestra.run.smithi008.stdout: "time": "2023-08-01T19:54:28.996987+0000", 2023-08-01T19:54:41.565 INFO:teuthology.orchestra.run.smithi008.stdout: "duration": 0 2023-08-01T19:54:41.565 INFO:teuthology.orchestra.run.smithi008.stdout: }, 2023-08-01T19:54:41.566 INFO:teuthology.orchestra.run.smithi008.stdout: { 2023-08-01T19:54:41.566 INFO:teuthology.orchestra.run.smithi008.stdout: "event": "throttled", 2023-08-01T19:54:41.566 INFO:teuthology.orchestra.run.smithi008.stdout: "time": "2023-08-01T19:54:28.996987+0000", 2023-08-01T19:54:41.566 INFO:teuthology.orchestra.run.smithi008.stdout: "duration": 0 2023-08-01T19:54:41.566 INFO:teuthology.orchestra.run.smithi008.stdout: }, 2023-08-01T19:54:41.566 INFO:teuthology.orchestra.run.smithi008.stdout: { 2023-08-01T19:54:41.566 INFO:teuthology.orchestra.run.smithi008.stdout: "event": "header_read", 2023-08-01T19:54:41.567 INFO:teuthology.orchestra.run.smithi008.stdout: "time": "2023-08-01T19:54:28.996986+0000", 2023-08-01T19:54:41.567 INFO:teuthology.orchestra.run.smithi008.stdout: "duration": 4294967295.999999 2023-08-01T19:54:41.567 INFO:teuthology.orchestra.run.smithi008.stdout: }, 2023-08-01T19:54:41.567 INFO:teuthology.orchestra.run.smithi008.stdout: { 2023-08-01T19:54:41.567 INFO:teuthology.orchestra.run.smithi008.stdout: "event": "all_read", 2023-08-01T19:54:41.567 INFO:teuthology.orchestra.run.smithi008.stdout: "time": "2023-08-01T19:54:28.997061+0000", 2023-08-01T19:54:41.567 INFO:teuthology.orchestra.run.smithi008.stdout: "duration": 7.4849000000000001e-05 2023-08-01T19:54:41.567 INFO:teuthology.orchestra.run.smithi008.stdout: }, 2023-08-01T19:54:41.568 INFO:teuthology.orchestra.run.smithi008.stdout: { 2023-08-01T19:54:41.568 INFO:teuthology.orchestra.run.smithi008.stdout: "event": "dispatched", 2023-08-01T19:54:41.568 INFO:teuthology.orchestra.run.smithi008.stdout: "time": "2023-08-01T19:54:28.997070+0000", 2023-08-01T19:54:41.568 INFO:teuthology.orchestra.run.smithi008.stdout: "duration": 8.7499999999999992e-06 2023-08-01T19:54:41.568 INFO:teuthology.orchestra.run.smithi008.stdout: }, 2023-08-01T19:54:41.568 INFO:teuthology.orchestra.run.smithi008.stdout: { 2023-08-01T19:54:41.568 INFO:teuthology.orchestra.run.smithi008.stdout: "event": "queued_for_pg", 2023-08-01T19:54:41.568 INFO:teuthology.orchestra.run.smithi008.stdout: "time": "2023-08-01T19:54:28.997076+0000", 2023-08-01T19:54:41.569 INFO:teuthology.orchestra.run.smithi008.stdout: "duration": 6.0510000000000002e-06 2023-08-01T19:54:41.569 INFO:teuthology.orchestra.run.smithi008.stdout: }, 2023-08-01T19:54:41.569 INFO:teuthology.orchestra.run.smithi008.stdout: { 2023-08-01T19:54:41.569 INFO:teuthology.orchestra.run.smithi008.stdout: "event": "reached_pg", 2023-08-01T19:54:41.569 INFO:teuthology.orchestra.run.smithi008.stdout: "time": "2023-08-01T19:54:28.997512+0000", 2023-08-01T19:54:41.569 INFO:teuthology.orchestra.run.smithi008.stdout: "duration": 0.00043637299999999999 2023-08-01T19:54:41.569 INFO:teuthology.orchestra.run.smithi008.stdout: }, 2023-08-01T19:54:41.569 INFO:teuthology.orchestra.run.smithi008.stdout: { 2023-08-01T19:54:41.570 INFO:teuthology.orchestra.run.smithi008.stdout: "event": "started", 2023-08-01T19:54:41.570 INFO:teuthology.orchestra.run.smithi008.stdout: "time": "2023-08-01T19:54:28.997634+0000", 2023-08-01T19:54:41.570 INFO:teuthology.orchestra.run.smithi008.stdout: "duration": 0.00012162100000000001 2023-08-01T19:54:41.570 INFO:teuthology.orchestra.run.smithi008.stdout: }, 2023-08-01T19:54:41.570 INFO:teuthology.orchestra.run.smithi008.stdout: { 2023-08-01T19:54:41.570 INFO:teuthology.orchestra.run.smithi008.stdout: "event": "waiting for subops from 1", 2023-08-01T19:54:41.570 INFO:teuthology.orchestra.run.smithi008.stdout: "time": "2023-08-01T19:54:28.997792+0000", 2023-08-01T19:54:41.570 INFO:teuthology.orchestra.run.smithi008.stdout: "duration": 0.00015851600000000001 2023-08-01T19:54:41.571 INFO:teuthology.orchestra.run.smithi008.stdout: }, 2023-08-01T19:54:41.571 INFO:teuthology.orchestra.run.smithi008.stdout: { 2023-08-01T19:54:41.571 INFO:teuthology.orchestra.run.smithi008.stdout: "event": "op_commit", 2023-08-01T19:54:41.571 INFO:teuthology.orchestra.run.smithi008.stdout: "time": "2023-08-01T19:54:28.999634+0000", 2023-08-01T19:54:41.571 INFO:teuthology.orchestra.run.smithi008.stdout: "duration": 0.001841046 2023-08-01T19:54:41.571 INFO:teuthology.orchestra.run.smithi008.stdout: }, 2023-08-01T19:54:41.571 INFO:teuthology.orchestra.run.smithi008.stdout: { 2023-08-01T19:54:41.571 INFO:teuthology.orchestra.run.smithi008.stdout: "event": "sub_op_commit_rec", 2023-08-01T19:54:41.572 INFO:teuthology.orchestra.run.smithi008.stdout: "time": "2023-08-01T19:54:29.011789+0000", 2023-08-01T19:54:41.572 INFO:teuthology.orchestra.run.smithi008.stdout: "duration": 0.012155011 2023-08-01T19:54:41.572 INFO:teuthology.orchestra.run.smithi008.stdout: }, 2023-08-01T19:54:41.572 INFO:teuthology.orchestra.run.smithi008.stdout: { 2023-08-01T19:54:41.572 INFO:teuthology.orchestra.run.smithi008.stdout: "event": "commit_sent", 2023-08-01T19:54:41.572 INFO:teuthology.orchestra.run.smithi008.stdout: "time": "2023-08-01T19:54:29.011818+0000", 2023-08-01T19:54:41.572 INFO:teuthology.orchestra.run.smithi008.stdout: "duration": 2.9152000000000001e-05 2023-08-01T19:54:41.572 INFO:teuthology.orchestra.run.smithi008.stdout: }, 2023-08-01T19:54:41.573 INFO:teuthology.orchestra.run.smithi008.stdout: { 2023-08-01T19:54:41.573 INFO:teuthology.orchestra.run.smithi008.stdout: "event": "done", 2023-08-01T19:54:41.573 INFO:teuthology.orchestra.run.smithi008.stdout: "time": "2023-08-01T19:54:29.011839+0000", 2023-08-01T19:54:41.573 INFO:teuthology.orchestra.run.smithi008.stdout: "duration": 2.1132999999999999e-05 2023-08-01T19:54:41.573 INFO:teuthology.orchestra.run.smithi008.stdout: } 2023-08-01T19:54:41.573 INFO:teuthology.orchestra.run.smithi008.stdout: ] 2023-08-01T19:54:41.573 INFO:teuthology.orchestra.run.smithi008.stdout: } 2023-08-01T19:54:41.574 INFO:teuthology.orchestra.run.smithi008.stdout: }, 2023-08-01T19:54:41.574 INFO:teuthology.orchestra.run.smithi008.stdout: { 2023-08-01T19:54:41.574 INFO:teuthology.orchestra.run.smithi008.stdout: "description": "osd_op(client.4668.0:18369 5.3 5:c557c7d0:::benchmark_data_smithi006_114134_object18368:head [set-alloc-hint object_size 65536 write_size 65536,write 0~65536] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e23)", 2023-08-01T19:54:41.574 INFO:teuthology.orchestra.run.smithi008.stdout: "initiated_at": "2023-08-01T19:54:28.997782+0000", 2023-08-01T19:54:41.574 INFO:teuthology.orchestra.run.smithi008.stdout: "age": 12.492154614, 2023-08-01T19:54:41.574 INFO:teuthology.orchestra.run.smithi008.stdout: "duration": 0.013982608000000001, 2023-08-01T19:54:41.574 INFO:teuthology.orchestra.run.smithi008.stdout: "type_data": { 2023-08-01T19:54:41.574 INFO:teuthology.orchestra.run.smithi008.stdout: "flag_point": "commit sent; apply or cleanup", 2023-08-01T19:54:41.575 INFO:teuthology.orchestra.run.smithi008.stdout: "client_info": { 2023-08-01T19:54:41.575 INFO:teuthology.orchestra.run.smithi008.stdout: "client": "client.4668", 2023-08-01T19:54:41.575 INFO:teuthology.orchestra.run.smithi008.stdout: "client_addr": "172.21.15.6:0/1709472247", 2023-08-01T19:54:41.575 INFO:teuthology.orchestra.run.smithi008.stdout: "tid": 18369 2023-08-01T19:54:41.575 INFO:teuthology.orchestra.run.smithi008.stdout: }, 2023-08-01T19:54:41.575 INFO:teuthology.orchestra.run.smithi008.stdout: "events": [ 2023-08-01T19:54:41.575 INFO:teuthology.orchestra.run.smithi008.stdout: { 2023-08-01T19:54:41.575 INFO:teuthology.orchestra.run.smithi008.stdout: "event": "initiated", 2023-08-01T19:54:41.576 INFO:teuthology.orchestra.run.smithi008.stdout: "time": "2023-08-01T19:54:28.997782+0000", 2023-08-01T19:54:41.576 INFO:teuthology.orchestra.run.smithi008.stdout: "duration": 0 2023-08-01T19:54:41.576 INFO:teuthology.orchestra.run.smithi008.stdout: }, 2023-08-01T19:54:41.576 INFO:teuthology.orchestra.run.smithi008.stdout: { 2023-08-01T19:54:41.576 INFO:teuthology.orchestra.run.smithi008.stdout: "event": "throttled", 2023-08-01T19:54:41.576 INFO:teuthology.orchestra.run.smithi008.stdout: "time": "2023-08-01T19:54:28.997782+0000", 2023-08-01T19:54:41.576 INFO:teuthology.orchestra.run.smithi008.stdout: "duration": 0 2023-08-01T19:54:41.576 INFO:teuthology.orchestra.run.smithi008.stdout: }, 2023-08-01T19:54:41.577 INFO:teuthology.orchestra.run.smithi008.stdout: { 2023-08-01T19:54:41.577 INFO:teuthology.orchestra.run.smithi008.stdout: "event": "header_read", 2023-08-01T19:54:41.577 INFO:teuthology.orchestra.run.smithi008.stdout: "time": "2023-08-01T19:54:28.997781+0000", 2023-08-01T19:54:41.577 INFO:teuthology.orchestra.run.smithi008.stdout: "duration": 4294967295.9999995 2023-08-01T19:54:41.577 INFO:teuthology.orchestra.run.smithi008.stdout: }, 2023-08-01T19:54:41.577 INFO:teuthology.orchestra.run.smithi008.stdout: { 2023-08-01T19:54:41.577 INFO:teuthology.orchestra.run.smithi008.stdout: "event": "all_read", 2023-08-01T19:54:41.577 INFO:teuthology.orchestra.run.smithi008.stdout: "time": "2023-08-01T19:54:28.997859+0000", 2023-08-01T19:54:41.578 INFO:teuthology.orchestra.run.smithi008.stdout: "duration": 7.7420000000000001e-05 2023-08-01T19:54:41.578 INFO:teuthology.orchestra.run.smithi008.stdout: }, 2023-08-01T19:54:41.578 INFO:teuthology.orchestra.run.smithi008.stdout: { 2023-08-01T19:54:41.578 INFO:teuthology.orchestra.run.smithi008.stdout: "event": "dispatched", 2023-08-01T19:54:41.578 INFO:teuthology.orchestra.run.smithi008.stdout: "time": "2023-08-01T19:54:28.997866+0000", 2023-08-01T19:54:41.578 INFO:teuthology.orchestra.run.smithi008.stdout: "duration": 7.2910000000000002e-06 2023-08-01T19:54:41.578 INFO:teuthology.orchestra.run.smithi008.stdout: }, 2023-08-01T19:54:41.578 INFO:teuthology.orchestra.run.smithi008.stdout: { 2023-08-01T19:54:41.579 INFO:teuthology.orchestra.run.smithi008.stdout: "event": "queued_for_pg", 2023-08-01T19:54:41.579 INFO:teuthology.orchestra.run.smithi008.stdout: "time": "2023-08-01T19:54:28.997872+0000", 2023-08-01T19:54:41.579 INFO:teuthology.orchestra.run.smithi008.stdout: "duration": 6.0460000000000002e-06 2023-08-01T19:54:41.579 INFO:teuthology.orchestra.run.smithi008.stdout: }, 2023-08-01T19:54:41.579 INFO:teuthology.orchestra.run.smithi008.stdout: { 2023-08-01T19:54:41.579 INFO:teuthology.orchestra.run.smithi008.stdout: "event": "reached_pg", 2023-08-01T19:54:41.579 INFO:teuthology.orchestra.run.smithi008.stdout: "time": "2023-08-01T19:54:28.997931+0000", 2023-08-01T19:54:41.579 INFO:teuthology.orchestra.run.smithi008.stdout: "duration": 5.8692e-05 2023-08-01T19:54:41.580 INFO:teuthology.orchestra.run.smithi008.stdout: }, 2023-08-01T19:54:41.580 INFO:teuthology.orchestra.run.smithi008.stdout: { 2023-08-01T19:54:41.580 INFO:teuthology.orchestra.run.smithi008.stdout: "event": "started", 2023-08-01T19:54:41.580 INFO:teuthology.orchestra.run.smithi008.stdout: "time": "2023-08-01T19:54:28.998082+0000", 2023-08-01T19:54:41.580 INFO:teuthology.orchestra.run.smithi008.stdout: "duration": 0.000151438 2023-08-01T19:54:41.580 INFO:teuthology.orchestra.run.smithi008.stdout: }, 2023-08-01T19:54:41.580 INFO:teuthology.orchestra.run.smithi008.stdout: { 2023-08-01T19:54:41.580 INFO:teuthology.orchestra.run.smithi008.stdout: "event": "waiting for subops from 1", 2023-08-01T19:54:41.581 INFO:teuthology.orchestra.run.smithi008.stdout: "time": "2023-08-01T19:54:28.998216+0000", 2023-08-01T19:54:41.581 INFO:teuthology.orchestra.run.smithi008.stdout: "duration": 0.00013328099999999999 2023-08-01T19:54:41.581 INFO:teuthology.orchestra.run.smithi008.stdout: }, 2023-08-01T19:54:41.581 INFO:teuthology.orchestra.run.smithi008.stdout: { 2023-08-01T19:54:41.581 INFO:teuthology.orchestra.run.smithi008.stdout: "event": "op_commit", 2023-08-01T19:54:41.581 INFO:teuthology.orchestra.run.smithi008.stdout: "time": "2023-08-01T19:54:29.000045+0000", 2023-08-01T19:54:41.581 INFO:teuthology.orchestra.run.smithi008.stdout: "duration": 0.001829231 2023-08-01T19:54:41.581 INFO:teuthology.orchestra.run.smithi008.stdout: }, 2023-08-01T19:54:41.582 INFO:teuthology.orchestra.run.smithi008.stdout: { 2023-08-01T19:54:41.582 INFO:teuthology.orchestra.run.smithi008.stdout: "event": "sub_op_commit_rec", 2023-08-01T19:54:41.582 INFO:teuthology.orchestra.run.smithi008.stdout: "time": "2023-08-01T19:54:29.011719+0000", 2023-08-01T19:54:41.582 INFO:teuthology.orchestra.run.smithi008.stdout: "duration": 0.011673817 2023-08-01T19:54:41.582 INFO:teuthology.orchestra.run.smithi008.stdout: }, 2023-08-01T19:54:41.582 INFO:teuthology.orchestra.run.smithi008.stdout: { 2023-08-01T19:54:41.582 INFO:teuthology.orchestra.run.smithi008.stdout: "event": "commit_sent", 2023-08-01T19:54:41.582 INFO:teuthology.orchestra.run.smithi008.stdout: "time": "2023-08-01T19:54:29.011743+0000", 2023-08-01T19:54:41.583 INFO:teuthology.orchestra.run.smithi008.stdout: "duration": 2.4663000000000001e-05 2023-08-01T19:54:41.583 INFO:teuthology.orchestra.run.smithi008.stdout: }, 2023-08-01T19:54:41.583 INFO:teuthology.orchestra.run.smithi008.stdout: { 2023-08-01T19:54:41.583 INFO:teuthology.orchestra.run.smithi008.stdout: "event": "done", 2023-08-01T19:54:41.583 INFO:teuthology.orchestra.run.smithi008.stdout: "time": "2023-08-01T19:54:29.011765+0000", 2023-08-01T19:54:41.583 INFO:teuthology.orchestra.run.smithi008.stdout: "duration": 2.1410999999999999e-05 2023-08-01T19:54:41.583 INFO:teuthology.orchestra.run.smithi008.stdout: } 2023-08-01T19:54:41.583 INFO:teuthology.orchestra.run.smithi008.stdout: ] 2023-08-01T19:54:41.584 INFO:teuthology.orchestra.run.smithi008.stdout: } 2023-08-01T19:54:41.584 INFO:teuthology.orchestra.run.smithi008.stdout: }, 2023-08-01T19:54:41.584 INFO:teuthology.orchestra.run.smithi008.stdout: { 2023-08-01T19:54:41.584 INFO:teuthology.orchestra.run.smithi008.stdout: "description": "osd_op(client.4668.0:20544 5.a 5:52fb262b:::benchmark_data_smithi006_114134_object20543:head [set-alloc-hint object_size 65536 write_size 65536,write 0~65536] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e23)", 2023-08-01T19:54:41.584 INFO:teuthology.orchestra.run.smithi008.stdout: "initiated_at": "2023-08-01T19:54:29.655369+0000", 2023-08-01T19:54:41.584 INFO:teuthology.orchestra.run.smithi008.stdout: "age": 11.834567944, 2023-08-01T19:54:41.584 INFO:teuthology.orchestra.run.smithi008.stdout: "duration": 0.013074334999999999, 2023-08-01T19:54:41.585 INFO:teuthology.orchestra.run.smithi008.stdout: "type_data": { 2023-08-01T19:54:41.585 INFO:teuthology.orchestra.run.smithi008.stdout: "flag_point": "commit sent; apply or cleanup", 2023-08-01T19:54:41.585 INFO:teuthology.orchestra.run.smithi008.stdout: "client_info": { 2023-08-01T19:54:41.585 INFO:teuthology.orchestra.run.smithi008.stdout: "client": "client.4668", 2023-08-01T19:54:41.585 INFO:teuthology.orchestra.run.smithi008.stdout: "client_addr": "172.21.15.6:0/1709472247", 2023-08-01T19:54:41.585 INFO:teuthology.orchestra.run.smithi008.stdout: "tid": 20544 2023-08-01T19:54:41.585 INFO:teuthology.orchestra.run.smithi008.stdout: }, 2023-08-01T19:54:41.585 INFO:teuthology.orchestra.run.smithi008.stdout: "events": [ 2023-08-01T19:54:41.586 INFO:teuthology.orchestra.run.smithi008.stdout: { 2023-08-01T19:54:41.586 INFO:teuthology.orchestra.run.smithi008.stdout: "event": "initiated", 2023-08-01T19:54:41.586 INFO:teuthology.orchestra.run.smithi008.stdout: "time": "2023-08-01T19:54:29.655369+0000", 2023-08-01T19:54:41.586 INFO:teuthology.orchestra.run.smithi008.stdout: "duration": 0 2023-08-01T19:54:41.586 INFO:teuthology.orchestra.run.smithi008.stdout: }, 2023-08-01T19:54:41.586 INFO:teuthology.orchestra.run.smithi008.stdout: { 2023-08-01T19:54:41.586 INFO:teuthology.orchestra.run.smithi008.stdout: "event": "throttled", 2023-08-01T19:54:41.586 INFO:teuthology.orchestra.run.smithi008.stdout: "time": "2023-08-01T19:54:29.655369+0000", 2023-08-01T19:54:41.587 INFO:teuthology.orchestra.run.smithi008.stdout: "duration": 0 2023-08-01T19:54:41.587 INFO:teuthology.orchestra.run.smithi008.stdout: }, 2023-08-01T19:54:41.587 INFO:teuthology.orchestra.run.smithi008.stdout: { 2023-08-01T19:54:41.587 INFO:teuthology.orchestra.run.smithi008.stdout: "event": "header_read", 2023-08-01T19:54:41.587 INFO:teuthology.orchestra.run.smithi008.stdout: "time": "2023-08-01T19:54:29.655368+0000", 2023-08-01T19:54:41.587 INFO:teuthology.orchestra.run.smithi008.stdout: "duration": 4294967295.9999995 2023-08-01T19:54:41.587 INFO:teuthology.orchestra.run.smithi008.stdout: }, 2023-08-01T19:54:41.587 INFO:teuthology.orchestra.run.smithi008.stdout: { 2023-08-01T19:54:41.588 INFO:teuthology.orchestra.run.smithi008.stdout: "event": "all_read", 2023-08-01T19:54:41.588 INFO:teuthology.orchestra.run.smithi008.stdout: "time": "2023-08-01T19:54:29.655405+0000", 2023-08-01T19:54:41.588 INFO:teuthology.orchestra.run.smithi008.stdout: "duration": 3.7316e-05 2023-08-01T19:54:41.588 INFO:teuthology.orchestra.run.smithi008.stdout: }, 2023-08-01T19:54:41.588 INFO:teuthology.orchestra.run.smithi008.stdout: { 2023-08-01T19:54:41.588 INFO:teuthology.orchestra.run.smithi008.stdout: "event": "dispatched", 2023-08-01T19:54:41.588 INFO:teuthology.orchestra.run.smithi008.stdout: "time": "2023-08-01T19:54:29.655416+0000", 2023-08-01T19:54:41.588 INFO:teuthology.orchestra.run.smithi008.stdout: "duration": 1.1102e-05 2023-08-01T19:54:41.589 INFO:teuthology.orchestra.run.smithi008.stdout: }, 2023-08-01T19:54:41.589 INFO:teuthology.orchestra.run.smithi008.stdout: { 2023-08-01T19:54:41.589 INFO:teuthology.orchestra.run.smithi008.stdout: "event": "queued_for_pg", 2023-08-01T19:54:41.589 INFO:teuthology.orchestra.run.smithi008.stdout: "time": "2023-08-01T19:54:29.655422+0000", 2023-08-01T19:54:41.589 INFO:teuthology.orchestra.run.smithi008.stdout: "duration": 5.9120000000000003e-06 2023-08-01T19:54:41.589 INFO:teuthology.orchestra.run.smithi008.stdout: }, 2023-08-01T19:54:41.589 INFO:teuthology.orchestra.run.smithi008.stdout: { 2023-08-01T19:54:41.589 INFO:teuthology.orchestra.run.smithi008.stdout: "event": "reached_pg", 2023-08-01T19:54:41.590 INFO:teuthology.orchestra.run.smithi008.stdout: "time": "2023-08-01T19:54:29.656834+0000", 2023-08-01T19:54:41.590 INFO:teuthology.orchestra.run.smithi008.stdout: "duration": 0.0014116829999999999 2023-08-01T19:54:41.590 INFO:teuthology.orchestra.run.smithi008.stdout: }, 2023-08-01T19:54:41.590 INFO:teuthology.orchestra.run.smithi008.stdout: { 2023-08-01T19:54:41.590 INFO:teuthology.orchestra.run.smithi008.stdout: "event": "started", 2023-08-01T19:54:41.590 INFO:teuthology.orchestra.run.smithi008.stdout: "time": "2023-08-01T19:54:29.656953+0000", 2023-08-01T19:54:41.590 INFO:teuthology.orchestra.run.smithi008.stdout: "duration": 0.00011851200000000001 2023-08-01T19:54:41.590 INFO:teuthology.orchestra.run.smithi008.stdout: }, 2023-08-01T19:54:41.591 INFO:teuthology.orchestra.run.smithi008.stdout: { 2023-08-01T19:54:41.591 INFO:teuthology.orchestra.run.smithi008.stdout: "event": "waiting for subops from 2", 2023-08-01T19:54:41.591 INFO:teuthology.orchestra.run.smithi008.stdout: "time": "2023-08-01T19:54:29.657099+0000", 2023-08-01T19:54:41.591 INFO:teuthology.orchestra.run.smithi008.stdout: "duration": 0.000146241 2023-08-01T19:54:41.591 INFO:teuthology.orchestra.run.smithi008.stdout: }, 2023-08-01T19:54:41.591 INFO:teuthology.orchestra.run.smithi008.stdout: { 2023-08-01T19:54:41.591 INFO:teuthology.orchestra.run.smithi008.stdout: "event": "op_commit", 2023-08-01T19:54:41.592 INFO:teuthology.orchestra.run.smithi008.stdout: "time": "2023-08-01T19:54:29.659538+0000", 2023-08-01T19:54:41.592 INFO:teuthology.orchestra.run.smithi008.stdout: "duration": 0.0024387549999999999 2023-08-01T19:54:41.592 INFO:teuthology.orchestra.run.smithi008.stdout: }, 2023-08-01T19:54:41.592 INFO:teuthology.orchestra.run.smithi008.stdout: { 2023-08-01T19:54:41.592 INFO:teuthology.orchestra.run.smithi008.stdout: "event": "sub_op_commit_rec", 2023-08-01T19:54:41.592 INFO:teuthology.orchestra.run.smithi008.stdout: "time": "2023-08-01T19:54:29.668362+0000", 2023-08-01T19:54:41.592 INFO:teuthology.orchestra.run.smithi008.stdout: "duration": 0.0088243590000000004 2023-08-01T19:54:41.592 INFO:teuthology.orchestra.run.smithi008.stdout: }, 2023-08-01T19:54:41.593 INFO:teuthology.orchestra.run.smithi008.stdout: { 2023-08-01T19:54:41.593 INFO:teuthology.orchestra.run.smithi008.stdout: "event": "commit_sent", 2023-08-01T19:54:41.593 INFO:teuthology.orchestra.run.smithi008.stdout: "time": "2023-08-01T19:54:29.668409+0000", 2023-08-01T19:54:41.593 INFO:teuthology.orchestra.run.smithi008.stdout: "duration": 4.7246000000000001e-05 2023-08-01T19:54:41.593 INFO:teuthology.orchestra.run.smithi008.stdout: }, 2023-08-01T19:54:41.593 INFO:teuthology.orchestra.run.smithi008.stdout: { 2023-08-01T19:54:41.593 INFO:teuthology.orchestra.run.smithi008.stdout: "event": "done", 2023-08-01T19:54:41.593 INFO:teuthology.orchestra.run.smithi008.stdout: "time": "2023-08-01T19:54:29.668443+0000", 2023-08-01T19:54:41.594 INFO:teuthology.orchestra.run.smithi008.stdout: "duration": 3.3844999999999999e-05 2023-08-01T19:54:41.594 INFO:teuthology.orchestra.run.smithi008.stdout: } 2023-08-01T19:54:41.594 INFO:teuthology.orchestra.run.smithi008.stdout: ] 2023-08-01T19:54:41.594 INFO:teuthology.orchestra.run.smithi008.stdout: } 2023-08-01T19:54:41.594 INFO:teuthology.orchestra.run.smithi008.stdout: }, 2023-08-01T19:54:41.594 INFO:teuthology.orchestra.run.smithi008.stdout: { 2023-08-01T19:54:41.594 INFO:teuthology.orchestra.run.smithi008.stdout: "description": "osd_op(client.4668.0:20547 5.a 5:54001317:::benchmark_data_smithi006_114134_object20546:head [set-alloc-hint object_size 65536 write_size 65536,write 0~65536] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e23)", 2023-08-01T19:54:41.594 INFO:teuthology.orchestra.run.smithi008.stdout: "initiated_at": "2023-08-01T19:54:29.655560+0000", 2023-08-01T19:54:41.595 INFO:teuthology.orchestra.run.smithi008.stdout: "age": 11.834376401, 2023-08-01T19:54:41.595 INFO:teuthology.orchestra.run.smithi008.stdout: "duration": 0.014929586999999999, 2023-08-01T19:54:41.595 INFO:teuthology.orchestra.run.smithi008.stdout: "type_data": { 2023-08-01T19:54:41.595 INFO:teuthology.orchestra.run.smithi008.stdout: "flag_point": "commit sent; apply or cleanup", 2023-08-01T19:54:41.595 INFO:teuthology.orchestra.run.smithi008.stdout: "client_info": { 2023-08-01T19:54:41.595 INFO:teuthology.orchestra.run.smithi008.stdout: "client": "client.4668", 2023-08-01T19:54:41.595 INFO:teuthology.orchestra.run.smithi008.stdout: "client_addr": "172.21.15.6:0/1709472247", 2023-08-01T19:54:41.595 INFO:teuthology.orchestra.run.smithi008.stdout: "tid": 20547 2023-08-01T19:54:41.596 INFO:teuthology.orchestra.run.smithi008.stdout: }, 2023-08-01T19:54:41.596 INFO:teuthology.orchestra.run.smithi008.stdout: "events": [ 2023-08-01T19:54:41.596 INFO:teuthology.orchestra.run.smithi008.stdout: { 2023-08-01T19:54:41.596 INFO:teuthology.orchestra.run.smithi008.stdout: "event": "initiated", 2023-08-01T19:54:41.596 INFO:teuthology.orchestra.run.smithi008.stdout: "time": "2023-08-01T19:54:29.655560+0000", 2023-08-01T19:54:41.596 INFO:teuthology.orchestra.run.smithi008.stdout: "duration": 0 2023-08-01T19:54:41.596 INFO:teuthology.orchestra.run.smithi008.stdout: }, 2023-08-01T19:54:41.596 INFO:teuthology.orchestra.run.smithi008.stdout: { 2023-08-01T19:54:41.597 INFO:teuthology.orchestra.run.smithi008.stdout: "event": "throttled", 2023-08-01T19:54:41.597 INFO:teuthology.orchestra.run.smithi008.stdout: "time": "2023-08-01T19:54:29.655560+0000", 2023-08-01T19:54:41.597 INFO:teuthology.orchestra.run.smithi008.stdout: "duration": 0 2023-08-01T19:54:41.597 INFO:teuthology.orchestra.run.smithi008.stdout: }, 2023-08-01T19:54:41.597 INFO:teuthology.orchestra.run.smithi008.stdout: { 2023-08-01T19:54:41.597 INFO:teuthology.orchestra.run.smithi008.stdout: "event": "header_read", 2023-08-01T19:54:41.597 INFO:teuthology.orchestra.run.smithi008.stdout: "time": "2023-08-01T19:54:29.655560+0000", 2023-08-01T19:54:41.597 INFO:teuthology.orchestra.run.smithi008.stdout: "duration": 4294967295.9999995 2023-08-01T19:54:41.598 INFO:teuthology.orchestra.run.smithi008.stdout: }, 2023-08-01T19:54:41.598 INFO:teuthology.orchestra.run.smithi008.stdout: { 2023-08-01T19:54:41.598 INFO:teuthology.orchestra.run.smithi008.stdout: "event": "all_read", 2023-08-01T19:54:41.598 INFO:teuthology.orchestra.run.smithi008.stdout: "time": "2023-08-01T19:54:29.655590+0000", 2023-08-01T19:54:41.598 INFO:teuthology.orchestra.run.smithi008.stdout: "duration": 3.0467000000000002e-05 2023-08-01T19:54:41.598 INFO:teuthology.orchestra.run.smithi008.stdout: }, 2023-08-01T19:54:41.598 INFO:teuthology.orchestra.run.smithi008.stdout: { 2023-08-01T19:54:41.598 INFO:teuthology.orchestra.run.smithi008.stdout: "event": "dispatched", 2023-08-01T19:54:41.599 INFO:teuthology.orchestra.run.smithi008.stdout: "time": "2023-08-01T19:54:29.655600+0000", 2023-08-01T19:54:41.599 INFO:teuthology.orchestra.run.smithi008.stdout: "duration": 1.0103e-05 2023-08-01T19:54:41.599 INFO:teuthology.orchestra.run.smithi008.stdout: }, 2023-08-01T19:54:41.599 INFO:teuthology.orchestra.run.smithi008.stdout: { 2023-08-01T19:54:41.599 INFO:teuthology.orchestra.run.smithi008.stdout: "event": "queued_for_pg", 2023-08-01T19:54:41.599 INFO:teuthology.orchestra.run.smithi008.stdout: "time": "2023-08-01T19:54:29.655605+0000", 2023-08-01T19:54:41.599 INFO:teuthology.orchestra.run.smithi008.stdout: "duration": 4.1860000000000002e-06 2023-08-01T19:54:41.600 INFO:teuthology.orchestra.run.smithi008.stdout: }, 2023-08-01T19:54:41.600 INFO:teuthology.orchestra.run.smithi008.stdout: { 2023-08-01T19:54:41.600 INFO:teuthology.orchestra.run.smithi008.stdout: "event": "reached_pg", 2023-08-01T19:54:41.600 INFO:teuthology.orchestra.run.smithi008.stdout: "time": "2023-08-01T19:54:29.657832+0000", 2023-08-01T19:54:41.600 INFO:teuthology.orchestra.run.smithi008.stdout: "duration": 0.0022275630000000001 2023-08-01T19:54:41.600 INFO:teuthology.orchestra.run.smithi008.stdout: }, 2023-08-01T19:54:41.600 INFO:teuthology.orchestra.run.smithi008.stdout: { 2023-08-01T19:54:41.600 INFO:teuthology.orchestra.run.smithi008.stdout: "event": "started", 2023-08-01T19:54:41.601 INFO:teuthology.orchestra.run.smithi008.stdout: "time": "2023-08-01T19:54:29.657927+0000", 2023-08-01T19:54:41.601 INFO:teuthology.orchestra.run.smithi008.stdout: "duration": 9.5390000000000007e-05 2023-08-01T19:54:41.601 INFO:teuthology.orchestra.run.smithi008.stdout: }, 2023-08-01T19:54:41.601 INFO:teuthology.orchestra.run.smithi008.stdout: { 2023-08-01T19:54:41.601 INFO:teuthology.orchestra.run.smithi008.stdout: "event": "waiting for subops from 2", 2023-08-01T19:54:41.601 INFO:teuthology.orchestra.run.smithi008.stdout: "time": "2023-08-01T19:54:29.658008+0000", 2023-08-01T19:54:41.601 INFO:teuthology.orchestra.run.smithi008.stdout: "duration": 8.0671000000000001e-05 2023-08-01T19:54:41.601 INFO:teuthology.orchestra.run.smithi008.stdout: }, 2023-08-01T19:54:41.602 INFO:teuthology.orchestra.run.smithi008.stdout: { 2023-08-01T19:54:41.602 INFO:teuthology.orchestra.run.smithi008.stdout: "event": "op_commit", 2023-08-01T19:54:41.602 INFO:teuthology.orchestra.run.smithi008.stdout: "time": "2023-08-01T19:54:29.659542+0000", 2023-08-01T19:54:41.602 INFO:teuthology.orchestra.run.smithi008.stdout: "duration": 0.0015343220000000001 2023-08-01T19:54:41.602 INFO:teuthology.orchestra.run.smithi008.stdout: }, 2023-08-01T19:54:41.602 INFO:teuthology.orchestra.run.smithi008.stdout: { 2023-08-01T19:54:41.602 INFO:teuthology.orchestra.run.smithi008.stdout: "event": "sub_op_commit_rec", 2023-08-01T19:54:41.602 INFO:teuthology.orchestra.run.smithi008.stdout: "time": "2023-08-01T19:54:29.670439+0000", 2023-08-01T19:54:41.603 INFO:teuthology.orchestra.run.smithi008.stdout: "duration": 0.010896874000000001 2023-08-01T19:54:41.603 INFO:teuthology.orchestra.run.smithi008.stdout: }, 2023-08-01T19:54:41.603 INFO:teuthology.orchestra.run.smithi008.stdout: { 2023-08-01T19:54:41.603 INFO:teuthology.orchestra.run.smithi008.stdout: "event": "commit_sent", 2023-08-01T19:54:41.603 INFO:teuthology.orchestra.run.smithi008.stdout: "time": "2023-08-01T19:54:29.670467+0000", 2023-08-01T19:54:41.603 INFO:teuthology.orchestra.run.smithi008.stdout: "duration": 2.7433999999999999e-05 2023-08-01T19:54:41.603 INFO:teuthology.orchestra.run.smithi008.stdout: }, 2023-08-01T19:54:41.603 INFO:teuthology.orchestra.run.smithi008.stdout: { 2023-08-01T19:54:41.604 INFO:teuthology.orchestra.run.smithi008.stdout: "event": "done", 2023-08-01T19:54:41.604 INFO:teuthology.orchestra.run.smithi008.stdout: "time": "2023-08-01T19:54:29.670490+0000", 2023-08-01T19:54:41.604 INFO:teuthology.orchestra.run.smithi008.stdout: "duration": 2.3076000000000001e-05 2023-08-01T19:54:41.604 INFO:teuthology.orchestra.run.smithi008.stdout: } 2023-08-01T19:54:41.604 INFO:teuthology.orchestra.run.smithi008.stdout: ] 2023-08-01T19:54:41.604 INFO:teuthology.orchestra.run.smithi008.stdout: } 2023-08-01T19:54:41.604 INFO:teuthology.orchestra.run.smithi008.stdout: }, 2023-08-01T19:54:41.604 INFO:teuthology.orchestra.run.smithi008.stdout: { 2023-08-01T19:54:41.605 INFO:teuthology.orchestra.run.smithi008.stdout: "description": "osd_op(client.4668.0:31686 5.c 5:3d4453fd:::benchmark_data_smithi006_114134_object31685:head [set-alloc-hint object_size 65536 write_size 65536,write 0~65536] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e24)", 2023-08-01T19:54:41.605 INFO:teuthology.orchestra.run.smithi008.stdout: "initiated_at": "2023-08-01T19:54:33.230374+0000", 2023-08-01T19:54:41.605 INFO:teuthology.orchestra.run.smithi008.stdout: "age": 8.2595625530000003, 2023-08-01T19:54:41.605 INFO:teuthology.orchestra.run.smithi008.stdout: "duration": 0.014786407, 2023-08-01T19:54:41.605 INFO:teuthology.orchestra.run.smithi008.stdout: "type_data": { 2023-08-01T19:54:41.605 INFO:teuthology.orchestra.run.smithi008.stdout: "flag_point": "commit sent; apply or cleanup", 2023-08-01T19:54:41.605 INFO:teuthology.orchestra.run.smithi008.stdout: "client_info": { 2023-08-01T19:54:41.605 INFO:teuthology.orchestra.run.smithi008.stdout: "client": "client.4668", 2023-08-01T19:54:41.606 INFO:teuthology.orchestra.run.smithi008.stdout: "client_addr": "172.21.15.6:0/1709472247", 2023-08-01T19:54:41.606 INFO:teuthology.orchestra.run.smithi008.stdout: "tid": 31686 2023-08-01T19:54:41.606 INFO:teuthology.orchestra.run.smithi008.stdout: }, 2023-08-01T19:54:41.606 INFO:teuthology.orchestra.run.smithi008.stdout: "events": [ 2023-08-01T19:54:41.606 INFO:teuthology.orchestra.run.smithi008.stdout: { 2023-08-01T19:54:41.606 INFO:teuthology.orchestra.run.smithi008.stdout: "event": "initiated", 2023-08-01T19:54:41.606 INFO:teuthology.orchestra.run.smithi008.stdout: "time": "2023-08-01T19:54:33.230374+0000", 2023-08-01T19:54:41.606 INFO:teuthology.orchestra.run.smithi008.stdout: "duration": 0 2023-08-01T19:54:41.607 INFO:teuthology.orchestra.run.smithi008.stdout: }, 2023-08-01T19:54:41.607 INFO:teuthology.orchestra.run.smithi008.stdout: { 2023-08-01T19:54:41.607 INFO:teuthology.orchestra.run.smithi008.stdout: "event": "throttled", 2023-08-01T19:54:41.607 INFO:teuthology.orchestra.run.smithi008.stdout: "time": "2023-08-01T19:54:33.230374+0000", 2023-08-01T19:54:41.607 INFO:teuthology.orchestra.run.smithi008.stdout: "duration": 0 2023-08-01T19:54:41.607 INFO:teuthology.orchestra.run.smithi008.stdout: }, 2023-08-01T19:54:41.607 INFO:teuthology.orchestra.run.smithi008.stdout: { 2023-08-01T19:54:41.607 INFO:teuthology.orchestra.run.smithi008.stdout: "event": "header_read", 2023-08-01T19:54:41.608 INFO:teuthology.orchestra.run.smithi008.stdout: "time": "2023-08-01T19:54:33.230373+0000", 2023-08-01T19:54:41.608 INFO:teuthology.orchestra.run.smithi008.stdout: "duration": 4294967295.999999 2023-08-01T19:54:41.608 INFO:teuthology.orchestra.run.smithi008.stdout: }, 2023-08-01T19:54:41.608 INFO:teuthology.orchestra.run.smithi008.stdout: { 2023-08-01T19:54:41.608 INFO:teuthology.orchestra.run.smithi008.stdout: "event": "all_read", 2023-08-01T19:54:41.608 INFO:teuthology.orchestra.run.smithi008.stdout: "time": "2023-08-01T19:54:33.230444+0000", 2023-08-01T19:54:41.608 INFO:teuthology.orchestra.run.smithi008.stdout: "duration": 7.0624999999999996e-05 2023-08-01T19:54:41.609 INFO:teuthology.orchestra.run.smithi008.stdout: }, 2023-08-01T19:54:41.609 INFO:teuthology.orchestra.run.smithi008.stdout: { 2023-08-01T19:54:41.609 INFO:teuthology.orchestra.run.smithi008.stdout: "event": "dispatched", 2023-08-01T19:54:41.609 INFO:teuthology.orchestra.run.smithi008.stdout: "time": "2023-08-01T19:54:33.230455+0000", 2023-08-01T19:54:41.609 INFO:teuthology.orchestra.run.smithi008.stdout: "duration": 1.0669000000000001e-05 2023-08-01T19:54:41.609 INFO:teuthology.orchestra.run.smithi008.stdout: }, 2023-08-01T19:54:41.609 INFO:teuthology.orchestra.run.smithi008.stdout: { 2023-08-01T19:54:41.609 INFO:teuthology.orchestra.run.smithi008.stdout: "event": "queued_for_pg", 2023-08-01T19:54:41.610 INFO:teuthology.orchestra.run.smithi008.stdout: "time": "2023-08-01T19:54:33.230461+0000", 2023-08-01T19:54:41.610 INFO:teuthology.orchestra.run.smithi008.stdout: "duration": 6.3099999999999997e-06 2023-08-01T19:54:41.610 INFO:teuthology.orchestra.run.smithi008.stdout: }, 2023-08-01T19:54:41.610 INFO:teuthology.orchestra.run.smithi008.stdout: { 2023-08-01T19:54:41.610 INFO:teuthology.orchestra.run.smithi008.stdout: "event": "reached_pg", 2023-08-01T19:54:41.610 INFO:teuthology.orchestra.run.smithi008.stdout: "time": "2023-08-01T19:54:33.230816+0000", 2023-08-01T19:54:41.610 INFO:teuthology.orchestra.run.smithi008.stdout: "duration": 0.000355161 2023-08-01T19:54:41.610 INFO:teuthology.orchestra.run.smithi008.stdout: }, 2023-08-01T19:54:41.611 INFO:teuthology.orchestra.run.smithi008.stdout: { 2023-08-01T19:54:41.611 INFO:teuthology.orchestra.run.smithi008.stdout: "event": "started", 2023-08-01T19:54:41.611 INFO:teuthology.orchestra.run.smithi008.stdout: "time": "2023-08-01T19:54:33.230925+0000", 2023-08-01T19:54:41.611 INFO:teuthology.orchestra.run.smithi008.stdout: "duration": 0.0001091 2023-08-01T19:54:41.611 INFO:teuthology.orchestra.run.smithi008.stdout: }, 2023-08-01T19:54:41.611 INFO:teuthology.orchestra.run.smithi008.stdout: { 2023-08-01T19:54:41.611 INFO:teuthology.orchestra.run.smithi008.stdout: "event": "waiting for subops from 1", 2023-08-01T19:54:41.611 INFO:teuthology.orchestra.run.smithi008.stdout: "time": "2023-08-01T19:54:33.231057+0000", 2023-08-01T19:54:41.612 INFO:teuthology.orchestra.run.smithi008.stdout: "duration": 0.000131932 2023-08-01T19:54:41.612 INFO:teuthology.orchestra.run.smithi008.stdout: }, 2023-08-01T19:54:41.612 INFO:teuthology.orchestra.run.smithi008.stdout: { 2023-08-01T19:54:41.612 INFO:teuthology.orchestra.run.smithi008.stdout: "event": "op_commit", 2023-08-01T19:54:41.612 INFO:teuthology.orchestra.run.smithi008.stdout: "time": "2023-08-01T19:54:33.234362+0000", 2023-08-01T19:54:41.612 INFO:teuthology.orchestra.run.smithi008.stdout: "duration": 0.0033053370000000002 2023-08-01T19:54:41.612 INFO:teuthology.orchestra.run.smithi008.stdout: }, 2023-08-01T19:54:41.612 INFO:teuthology.orchestra.run.smithi008.stdout: { 2023-08-01T19:54:41.613 INFO:teuthology.orchestra.run.smithi008.stdout: "event": "sub_op_commit_rec", 2023-08-01T19:54:41.613 INFO:teuthology.orchestra.run.smithi008.stdout: "time": "2023-08-01T19:54:33.245059+0000", 2023-08-01T19:54:41.613 INFO:teuthology.orchestra.run.smithi008.stdout: "duration": 0.010696463999999999 2023-08-01T19:54:41.613 INFO:teuthology.orchestra.run.smithi008.stdout: }, 2023-08-01T19:54:41.613 INFO:teuthology.orchestra.run.smithi008.stdout: { 2023-08-01T19:54:41.613 INFO:teuthology.orchestra.run.smithi008.stdout: "event": "commit_sent", 2023-08-01T19:54:41.613 INFO:teuthology.orchestra.run.smithi008.stdout: "time": "2023-08-01T19:54:33.245116+0000", 2023-08-01T19:54:41.613 INFO:teuthology.orchestra.run.smithi008.stdout: "duration": 5.6990000000000002e-05 2023-08-01T19:54:41.614 INFO:teuthology.orchestra.run.smithi008.stdout: }, 2023-08-01T19:54:41.614 INFO:teuthology.orchestra.run.smithi008.stdout: { 2023-08-01T19:54:41.614 INFO:teuthology.orchestra.run.smithi008.stdout: "event": "done", 2023-08-01T19:54:41.614 INFO:teuthology.orchestra.run.smithi008.stdout: "time": "2023-08-01T19:54:33.245161+0000", 2023-08-01T19:54:41.614 INFO:teuthology.orchestra.run.smithi008.stdout: "duration": 4.4625e-05 2023-08-01T19:54:41.614 INFO:teuthology.orchestra.run.smithi008.stdout: } 2023-08-01T19:54:41.614 INFO:teuthology.orchestra.run.smithi008.stdout: ] 2023-08-01T19:54:41.614 INFO:teuthology.orchestra.run.smithi008.stdout: } 2023-08-01T19:54:41.615 INFO:teuthology.orchestra.run.smithi008.stdout: }, 2023-08-01T19:54:41.615 INFO:teuthology.orchestra.run.smithi008.stdout: { 2023-08-01T19:54:41.615 INFO:teuthology.orchestra.run.smithi008.stdout: "description": "osd_op(client.4668.0:31690 5.3 5:ca8c6108:::benchmark_data_smithi006_114134_object31689:head [set-alloc-hint object_size 65536 write_size 65536,write 0~65536] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e24)", 2023-08-01T19:54:41.615 INFO:teuthology.orchestra.run.smithi008.stdout: "initiated_at": "2023-08-01T19:54:33.232204+0000", 2023-08-01T19:54:41.615 INFO:teuthology.orchestra.run.smithi008.stdout: "age": 8.2577325479999999, 2023-08-01T19:54:41.615 INFO:teuthology.orchestra.run.smithi008.stdout: "duration": 0.013756551000000001, 2023-08-01T19:54:41.615 INFO:teuthology.orchestra.run.smithi008.stdout: "type_data": { 2023-08-01T19:54:41.616 INFO:teuthology.orchestra.run.smithi008.stdout: "flag_point": "commit sent; apply or cleanup", 2023-08-01T19:54:41.616 INFO:teuthology.orchestra.run.smithi008.stdout: "client_info": { 2023-08-01T19:54:41.616 INFO:teuthology.orchestra.run.smithi008.stdout: "client": "client.4668", 2023-08-01T19:54:41.616 INFO:teuthology.orchestra.run.smithi008.stdout: "client_addr": "172.21.15.6:0/1709472247", 2023-08-01T19:54:41.616 INFO:teuthology.orchestra.run.smithi008.stdout: "tid": 31690 2023-08-01T19:54:41.616 INFO:teuthology.orchestra.run.smithi008.stdout: }, 2023-08-01T19:54:41.616 INFO:teuthology.orchestra.run.smithi008.stdout: "events": [ 2023-08-01T19:54:41.616 INFO:teuthology.orchestra.run.smithi008.stdout: { 2023-08-01T19:54:41.617 INFO:teuthology.orchestra.run.smithi008.stdout: "event": "initiated", 2023-08-01T19:54:41.617 INFO:teuthology.orchestra.run.smithi008.stdout: "time": "2023-08-01T19:54:33.232204+0000", 2023-08-01T19:54:41.617 INFO:teuthology.orchestra.run.smithi008.stdout: "duration": 0 2023-08-01T19:54:41.617 INFO:teuthology.orchestra.run.smithi008.stdout: }, 2023-08-01T19:54:41.617 INFO:teuthology.orchestra.run.smithi008.stdout: { 2023-08-01T19:54:41.617 INFO:teuthology.orchestra.run.smithi008.stdout: "event": "throttled", 2023-08-01T19:54:41.617 INFO:teuthology.orchestra.run.smithi008.stdout: "time": "2023-08-01T19:54:33.232204+0000", 2023-08-01T19:54:41.617 INFO:teuthology.orchestra.run.smithi008.stdout: "duration": 0 2023-08-01T19:54:41.618 INFO:teuthology.orchestra.run.smithi008.stdout: }, 2023-08-01T19:54:41.618 INFO:teuthology.orchestra.run.smithi008.stdout: { 2023-08-01T19:54:41.618 INFO:teuthology.orchestra.run.smithi008.stdout: "event": "header_read", 2023-08-01T19:54:41.618 INFO:teuthology.orchestra.run.smithi008.stdout: "time": "2023-08-01T19:54:33.232203+0000", 2023-08-01T19:54:41.618 INFO:teuthology.orchestra.run.smithi008.stdout: "duration": 4294967295.999999 2023-08-01T19:54:41.618 INFO:teuthology.orchestra.run.smithi008.stdout: }, 2023-08-01T19:54:41.618 INFO:teuthology.orchestra.run.smithi008.stdout: { 2023-08-01T19:54:41.618 INFO:teuthology.orchestra.run.smithi008.stdout: "event": "all_read", 2023-08-01T19:54:41.619 INFO:teuthology.orchestra.run.smithi008.stdout: "time": "2023-08-01T19:54:33.232289+0000", 2023-08-01T19:54:41.619 INFO:teuthology.orchestra.run.smithi008.stdout: "duration": 8.6006000000000003e-05 2023-08-01T19:54:41.619 INFO:teuthology.orchestra.run.smithi008.stdout: }, 2023-08-01T19:54:41.619 INFO:teuthology.orchestra.run.smithi008.stdout: { 2023-08-01T19:54:41.619 INFO:teuthology.orchestra.run.smithi008.stdout: "event": "dispatched", 2023-08-01T19:54:41.619 INFO:teuthology.orchestra.run.smithi008.stdout: "time": "2023-08-01T19:54:33.232299+0000", 2023-08-01T19:54:41.619 INFO:teuthology.orchestra.run.smithi008.stdout: "duration": 9.4520000000000003e-06 2023-08-01T19:54:41.619 INFO:teuthology.orchestra.run.smithi008.stdout: }, 2023-08-01T19:54:41.620 INFO:teuthology.orchestra.run.smithi008.stdout: { 2023-08-01T19:54:41.620 INFO:teuthology.orchestra.run.smithi008.stdout: "event": "queued_for_pg", 2023-08-01T19:54:41.620 INFO:teuthology.orchestra.run.smithi008.stdout: "time": "2023-08-01T19:54:33.232303+0000", 2023-08-01T19:54:41.620 INFO:teuthology.orchestra.run.smithi008.stdout: "duration": 4.16e-06 2023-08-01T19:54:41.620 INFO:teuthology.orchestra.run.smithi008.stdout: }, 2023-08-01T19:54:41.620 INFO:teuthology.orchestra.run.smithi008.stdout: { 2023-08-01T19:54:41.620 INFO:teuthology.orchestra.run.smithi008.stdout: "event": "reached_pg", 2023-08-01T19:54:41.620 INFO:teuthology.orchestra.run.smithi008.stdout: "time": "2023-08-01T19:54:33.232353+0000", 2023-08-01T19:54:41.621 INFO:teuthology.orchestra.run.smithi008.stdout: "duration": 5.0463000000000001e-05 2023-08-01T19:54:41.621 INFO:teuthology.orchestra.run.smithi008.stdout: }, 2023-08-01T19:54:41.621 INFO:teuthology.orchestra.run.smithi008.stdout: { 2023-08-01T19:54:41.621 INFO:teuthology.orchestra.run.smithi008.stdout: "event": "started", 2023-08-01T19:54:41.621 INFO:teuthology.orchestra.run.smithi008.stdout: "time": "2023-08-01T19:54:33.232488+0000", 2023-08-01T19:54:41.621 INFO:teuthology.orchestra.run.smithi008.stdout: "duration": 0.00013489400000000001 2023-08-01T19:54:41.621 INFO:teuthology.orchestra.run.smithi008.stdout: }, 2023-08-01T19:54:41.622 INFO:teuthology.orchestra.run.smithi008.stdout: { 2023-08-01T19:54:41.622 INFO:teuthology.orchestra.run.smithi008.stdout: "event": "waiting for subops from 1", 2023-08-01T19:54:41.622 INFO:teuthology.orchestra.run.smithi008.stdout: "time": "2023-08-01T19:54:33.232648+0000", 2023-08-01T19:54:41.622 INFO:teuthology.orchestra.run.smithi008.stdout: "duration": 0.000160311 2023-08-01T19:54:41.622 INFO:teuthology.orchestra.run.smithi008.stdout: }, 2023-08-01T19:54:41.622 INFO:teuthology.orchestra.run.smithi008.stdout: { 2023-08-01T19:54:41.622 INFO:teuthology.orchestra.run.smithi008.stdout: "event": "op_commit", 2023-08-01T19:54:41.622 INFO:teuthology.orchestra.run.smithi008.stdout: "time": "2023-08-01T19:54:33.234740+0000", 2023-08-01T19:54:41.623 INFO:teuthology.orchestra.run.smithi008.stdout: "duration": 0.0020919110000000001 2023-08-01T19:54:41.623 INFO:teuthology.orchestra.run.smithi008.stdout: }, 2023-08-01T19:54:41.623 INFO:teuthology.orchestra.run.smithi008.stdout: { 2023-08-01T19:54:41.623 INFO:teuthology.orchestra.run.smithi008.stdout: "event": "sub_op_commit_rec", 2023-08-01T19:54:41.623 INFO:teuthology.orchestra.run.smithi008.stdout: "time": "2023-08-01T19:54:33.245903+0000", 2023-08-01T19:54:41.623 INFO:teuthology.orchestra.run.smithi008.stdout: "duration": 0.011162208 2023-08-01T19:54:41.623 INFO:teuthology.orchestra.run.smithi008.stdout: }, 2023-08-01T19:54:41.623 INFO:teuthology.orchestra.run.smithi008.stdout: { 2023-08-01T19:54:41.624 INFO:teuthology.orchestra.run.smithi008.stdout: "event": "commit_sent", 2023-08-01T19:54:41.624 INFO:teuthology.orchestra.run.smithi008.stdout: "time": "2023-08-01T19:54:33.245939+0000", 2023-08-01T19:54:41.624 INFO:teuthology.orchestra.run.smithi008.stdout: "duration": 3.6179e-05 2023-08-01T19:54:41.624 INFO:teuthology.orchestra.run.smithi008.stdout: }, 2023-08-01T19:54:41.624 INFO:teuthology.orchestra.run.smithi008.stdout: { 2023-08-01T19:54:41.624 INFO:teuthology.orchestra.run.smithi008.stdout: "event": "done", 2023-08-01T19:54:41.624 INFO:teuthology.orchestra.run.smithi008.stdout: "time": "2023-08-01T19:54:33.245961+0000", 2023-08-01T19:54:41.625 INFO:teuthology.orchestra.run.smithi008.stdout: "duration": 2.1945000000000001e-05 2023-08-01T19:54:41.625 INFO:teuthology.orchestra.run.smithi008.stdout: } 2023-08-01T19:54:41.625 INFO:teuthology.orchestra.run.smithi008.stdout: ] 2023-08-01T19:54:41.625 INFO:teuthology.orchestra.run.smithi008.stdout: } 2023-08-01T19:54:41.625 INFO:teuthology.orchestra.run.smithi008.stdout: }, 2023-08-01T19:54:41.625 INFO:teuthology.orchestra.run.smithi008.stdout: { 2023-08-01T19:54:41.625 INFO:teuthology.orchestra.run.smithi008.stdout: "description": "osd_op(client.4668.0:33955 5.a 5:5d940260:::benchmark_data_smithi006_114134_object33954:head [set-alloc-hint object_size 65536 write_size 65536,write 0~65536] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e24)", 2023-08-01T19:54:41.625 INFO:teuthology.orchestra.run.smithi008.stdout: "initiated_at": "2023-08-01T19:54:34.009597+0000", 2023-08-01T19:54:41.626 INFO:teuthology.orchestra.run.smithi008.stdout: "age": 7.4803394020000002, 2023-08-01T19:54:41.626 INFO:teuthology.orchestra.run.smithi008.stdout: "duration": 0.012985946999999999, 2023-08-01T19:54:41.626 INFO:teuthology.orchestra.run.smithi008.stdout: "type_data": { 2023-08-01T19:54:41.626 INFO:teuthology.orchestra.run.smithi008.stdout: "flag_point": "commit sent; apply or cleanup", 2023-08-01T19:54:41.626 INFO:teuthology.orchestra.run.smithi008.stdout: "client_info": { 2023-08-01T19:54:41.626 INFO:teuthology.orchestra.run.smithi008.stdout: "client": "client.4668", 2023-08-01T19:54:41.626 INFO:teuthology.orchestra.run.smithi008.stdout: "client_addr": "172.21.15.6:0/1709472247", 2023-08-01T19:54:41.626 INFO:teuthology.orchestra.run.smithi008.stdout: "tid": 33955 2023-08-01T19:54:41.627 INFO:teuthology.orchestra.run.smithi008.stdout: }, 2023-08-01T19:54:41.627 INFO:teuthology.orchestra.run.smithi008.stdout: "events": [ 2023-08-01T19:54:41.627 INFO:teuthology.orchestra.run.smithi008.stdout: { 2023-08-01T19:54:41.627 INFO:teuthology.orchestra.run.smithi008.stdout: "event": "initiated", 2023-08-01T19:54:41.627 INFO:teuthology.orchestra.run.smithi008.stdout: "time": "2023-08-01T19:54:34.009597+0000", 2023-08-01T19:54:41.627 INFO:teuthology.orchestra.run.smithi008.stdout: "duration": 0 2023-08-01T19:54:41.627 INFO:teuthology.orchestra.run.smithi008.stdout: }, 2023-08-01T19:54:41.627 INFO:teuthology.orchestra.run.smithi008.stdout: { 2023-08-01T19:54:41.628 INFO:teuthology.orchestra.run.smithi008.stdout: "event": "throttled", 2023-08-01T19:54:41.628 INFO:teuthology.orchestra.run.smithi008.stdout: "time": "2023-08-01T19:54:34.009597+0000", 2023-08-01T19:54:41.628 INFO:teuthology.orchestra.run.smithi008.stdout: "duration": 0 2023-08-01T19:54:41.628 INFO:teuthology.orchestra.run.smithi008.stdout: }, 2023-08-01T19:54:41.628 INFO:teuthology.orchestra.run.smithi008.stdout: { 2023-08-01T19:54:41.628 INFO:teuthology.orchestra.run.smithi008.stdout: "event": "header_read", 2023-08-01T19:54:41.628 INFO:teuthology.orchestra.run.smithi008.stdout: "time": "2023-08-01T19:54:34.009596+0000", 2023-08-01T19:54:41.628 INFO:teuthology.orchestra.run.smithi008.stdout: "duration": 4294967295.999999 2023-08-01T19:54:41.629 INFO:teuthology.orchestra.run.smithi008.stdout: }, 2023-08-01T19:54:41.629 INFO:teuthology.orchestra.run.smithi008.stdout: { 2023-08-01T19:54:41.629 INFO:teuthology.orchestra.run.smithi008.stdout: "event": "all_read", 2023-08-01T19:54:41.629 INFO:teuthology.orchestra.run.smithi008.stdout: "time": "2023-08-01T19:54:34.009708+0000", 2023-08-01T19:54:41.629 INFO:teuthology.orchestra.run.smithi008.stdout: "duration": 0.000111709 2023-08-01T19:54:41.629 INFO:teuthology.orchestra.run.smithi008.stdout: }, 2023-08-01T19:54:41.629 INFO:teuthology.orchestra.run.smithi008.stdout: { 2023-08-01T19:54:41.629 INFO:teuthology.orchestra.run.smithi008.stdout: "event": "dispatched", 2023-08-01T19:54:41.630 INFO:teuthology.orchestra.run.smithi008.stdout: "time": "2023-08-01T19:54:34.009719+0000", 2023-08-01T19:54:41.630 INFO:teuthology.orchestra.run.smithi008.stdout: "duration": 1.0705e-05 2023-08-01T19:54:41.630 INFO:teuthology.orchestra.run.smithi008.stdout: }, 2023-08-01T19:54:41.630 INFO:teuthology.orchestra.run.smithi008.stdout: { 2023-08-01T19:54:41.630 INFO:teuthology.orchestra.run.smithi008.stdout: "event": "queued_for_pg", 2023-08-01T19:54:41.630 INFO:teuthology.orchestra.run.smithi008.stdout: "time": "2023-08-01T19:54:34.009724+0000", 2023-08-01T19:54:41.630 INFO:teuthology.orchestra.run.smithi008.stdout: "duration": 5.0150000000000003e-06 2023-08-01T19:54:41.631 INFO:teuthology.orchestra.run.smithi008.stdout: }, 2023-08-01T19:54:41.631 INFO:teuthology.orchestra.run.smithi008.stdout: { 2023-08-01T19:54:41.631 INFO:teuthology.orchestra.run.smithi008.stdout: "event": "reached_pg", 2023-08-01T19:54:41.631 INFO:teuthology.orchestra.run.smithi008.stdout: "time": "2023-08-01T19:54:34.009761+0000", 2023-08-01T19:54:41.631 INFO:teuthology.orchestra.run.smithi008.stdout: "duration": 3.7378e-05 2023-08-01T19:54:41.631 INFO:teuthology.orchestra.run.smithi008.stdout: }, 2023-08-01T19:54:41.631 INFO:teuthology.orchestra.run.smithi008.stdout: { 2023-08-01T19:54:41.631 INFO:teuthology.orchestra.run.smithi008.stdout: "event": "started", 2023-08-01T19:54:41.632 INFO:teuthology.orchestra.run.smithi008.stdout: "time": "2023-08-01T19:54:34.009844+0000", 2023-08-01T19:54:41.632 INFO:teuthology.orchestra.run.smithi008.stdout: "duration": 8.3164999999999994e-05 2023-08-01T19:54:41.632 INFO:teuthology.orchestra.run.smithi008.stdout: }, 2023-08-01T19:54:41.632 INFO:teuthology.orchestra.run.smithi008.stdout: { 2023-08-01T19:54:41.632 INFO:teuthology.orchestra.run.smithi008.stdout: "event": "waiting for subops from 2", 2023-08-01T19:54:41.632 INFO:teuthology.orchestra.run.smithi008.stdout: "time": "2023-08-01T19:54:34.009958+0000", 2023-08-01T19:54:41.632 INFO:teuthology.orchestra.run.smithi008.stdout: "duration": 0.000113985 2023-08-01T19:54:41.632 INFO:teuthology.orchestra.run.smithi008.stdout: }, 2023-08-01T19:54:41.633 INFO:teuthology.orchestra.run.smithi008.stdout: { 2023-08-01T19:54:41.633 INFO:teuthology.orchestra.run.smithi008.stdout: "event": "op_commit", 2023-08-01T19:54:41.633 INFO:teuthology.orchestra.run.smithi008.stdout: "time": "2023-08-01T19:54:34.012149+0000", 2023-08-01T19:54:41.633 INFO:teuthology.orchestra.run.smithi008.stdout: "duration": 0.0021906590000000002 2023-08-01T19:54:41.633 INFO:teuthology.orchestra.run.smithi008.stdout: }, 2023-08-01T19:54:41.633 INFO:teuthology.orchestra.run.smithi008.stdout: { 2023-08-01T19:54:41.633 INFO:teuthology.orchestra.run.smithi008.stdout: "event": "sub_op_commit_rec", 2023-08-01T19:54:41.633 INFO:teuthology.orchestra.run.smithi008.stdout: "time": "2023-08-01T19:54:34.022492+0000", 2023-08-01T19:54:41.634 INFO:teuthology.orchestra.run.smithi008.stdout: "duration": 0.01034263 2023-08-01T19:54:41.634 INFO:teuthology.orchestra.run.smithi008.stdout: }, 2023-08-01T19:54:41.634 INFO:teuthology.orchestra.run.smithi008.stdout: { 2023-08-01T19:54:41.634 INFO:teuthology.orchestra.run.smithi008.stdout: "event": "commit_sent", 2023-08-01T19:54:41.634 INFO:teuthology.orchestra.run.smithi008.stdout: "time": "2023-08-01T19:54:34.022545+0000", 2023-08-01T19:54:41.634 INFO:teuthology.orchestra.run.smithi008.stdout: "duration": 5.3084000000000002e-05 2023-08-01T19:54:41.634 INFO:teuthology.orchestra.run.smithi008.stdout: }, 2023-08-01T19:54:41.634 INFO:teuthology.orchestra.run.smithi008.stdout: { 2023-08-01T19:54:41.635 INFO:teuthology.orchestra.run.smithi008.stdout: "event": "done", 2023-08-01T19:54:41.635 INFO:teuthology.orchestra.run.smithi008.stdout: "time": "2023-08-01T19:54:34.022583+0000", 2023-08-01T19:54:41.635 INFO:teuthology.orchestra.run.smithi008.stdout: "duration": 3.8384999999999999e-05 2023-08-01T19:54:41.635 INFO:teuthology.orchestra.run.smithi008.stdout: } 2023-08-01T19:54:41.635 INFO:teuthology.orchestra.run.smithi008.stdout: ] 2023-08-01T19:54:41.635 INFO:teuthology.orchestra.run.smithi008.stdout: } 2023-08-01T19:54:41.635 INFO:teuthology.orchestra.run.smithi008.stdout: }, 2023-08-01T19:54:41.635 INFO:teuthology.orchestra.run.smithi008.stdout: { 2023-08-01T19:54:41.636 INFO:teuthology.orchestra.run.smithi008.stdout: "description": "osd_op(client.4668.0:42456 5.5 5:a63cfb95:::benchmark_data_smithi006_114134_object42455:head [set-alloc-hint object_size 65536 write_size 65536,write 0~65536] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e26)", 2023-08-01T19:54:41.636 INFO:teuthology.orchestra.run.smithi008.stdout: "initiated_at": "2023-08-01T19:54:37.199768+0000", 2023-08-01T19:54:41.636 INFO:teuthology.orchestra.run.smithi008.stdout: "age": 4.2901685880000002, 2023-08-01T19:54:41.636 INFO:teuthology.orchestra.run.smithi008.stdout: "duration": 0.015069397999999999, 2023-08-01T19:54:41.636 INFO:teuthology.orchestra.run.smithi008.stdout: "type_data": { 2023-08-01T19:54:41.636 INFO:teuthology.orchestra.run.smithi008.stdout: "flag_point": "commit sent; apply or cleanup", 2023-08-01T19:54:41.636 INFO:teuthology.orchestra.run.smithi008.stdout: "client_info": { 2023-08-01T19:54:41.636 INFO:teuthology.orchestra.run.smithi008.stdout: "client": "client.4668", 2023-08-01T19:54:41.637 INFO:teuthology.orchestra.run.smithi008.stdout: "client_addr": "172.21.15.6:0/1709472247", 2023-08-01T19:54:41.637 INFO:teuthology.orchestra.run.smithi008.stdout: "tid": 42456 2023-08-01T19:54:41.637 INFO:teuthology.orchestra.run.smithi008.stdout: }, 2023-08-01T19:54:41.637 INFO:teuthology.orchestra.run.smithi008.stdout: "events": [ 2023-08-01T19:54:41.637 INFO:teuthology.orchestra.run.smithi008.stdout: { 2023-08-01T19:54:41.637 INFO:teuthology.orchestra.run.smithi008.stdout: "event": "initiated", 2023-08-01T19:54:41.637 INFO:teuthology.orchestra.run.smithi008.stdout: "time": "2023-08-01T19:54:37.199768+0000", 2023-08-01T19:54:41.637 INFO:teuthology.orchestra.run.smithi008.stdout: "duration": 0 2023-08-01T19:54:41.638 INFO:teuthology.orchestra.run.smithi008.stdout: }, 2023-08-01T19:54:41.638 INFO:teuthology.orchestra.run.smithi008.stdout: { 2023-08-01T19:54:41.638 INFO:teuthology.orchestra.run.smithi008.stdout: "event": "throttled", 2023-08-01T19:54:41.638 INFO:teuthology.orchestra.run.smithi008.stdout: "time": "2023-08-01T19:54:37.199768+0000", 2023-08-01T19:54:41.638 INFO:teuthology.orchestra.run.smithi008.stdout: "duration": 0 2023-08-01T19:54:41.638 INFO:teuthology.orchestra.run.smithi008.stdout: }, 2023-08-01T19:54:41.638 INFO:teuthology.orchestra.run.smithi008.stdout: { 2023-08-01T19:54:41.639 INFO:teuthology.orchestra.run.smithi008.stdout: "event": "header_read", 2023-08-01T19:54:41.639 INFO:teuthology.orchestra.run.smithi008.stdout: "time": "2023-08-01T19:54:37.199767+0000", 2023-08-01T19:54:41.639 INFO:teuthology.orchestra.run.smithi008.stdout: "duration": 4294967295.9999995 2023-08-01T19:54:41.639 INFO:teuthology.orchestra.run.smithi008.stdout: }, 2023-08-01T19:54:41.639 INFO:teuthology.orchestra.run.smithi008.stdout: { 2023-08-01T19:54:41.639 INFO:teuthology.orchestra.run.smithi008.stdout: "event": "all_read", 2023-08-01T19:54:41.639 INFO:teuthology.orchestra.run.smithi008.stdout: "time": "2023-08-01T19:54:37.199798+0000", 2023-08-01T19:54:41.639 INFO:teuthology.orchestra.run.smithi008.stdout: "duration": 3.0443999999999999e-05 2023-08-01T19:54:41.640 INFO:teuthology.orchestra.run.smithi008.stdout: }, 2023-08-01T19:54:41.640 INFO:teuthology.orchestra.run.smithi008.stdout: { 2023-08-01T19:54:41.640 INFO:teuthology.orchestra.run.smithi008.stdout: "event": "dispatched", 2023-08-01T19:54:41.640 INFO:teuthology.orchestra.run.smithi008.stdout: "time": "2023-08-01T19:54:37.199806+0000", 2023-08-01T19:54:41.640 INFO:teuthology.orchestra.run.smithi008.stdout: "duration": 8.2300000000000008e-06 2023-08-01T19:54:41.640 INFO:teuthology.orchestra.run.smithi008.stdout: }, 2023-08-01T19:54:41.640 INFO:teuthology.orchestra.run.smithi008.stdout: { 2023-08-01T19:54:41.640 INFO:teuthology.orchestra.run.smithi008.stdout: "event": "queued_for_pg", 2023-08-01T19:54:41.641 INFO:teuthology.orchestra.run.smithi008.stdout: "time": "2023-08-01T19:54:37.199811+0000", 2023-08-01T19:54:41.641 INFO:teuthology.orchestra.run.smithi008.stdout: "duration": 5.2730000000000002e-06 2023-08-01T19:54:41.641 INFO:teuthology.orchestra.run.smithi008.stdout: }, 2023-08-01T19:54:41.641 INFO:teuthology.orchestra.run.smithi008.stdout: { 2023-08-01T19:54:41.641 INFO:teuthology.orchestra.run.smithi008.stdout: "event": "reached_pg", 2023-08-01T19:54:41.641 INFO:teuthology.orchestra.run.smithi008.stdout: "time": "2023-08-01T19:54:37.200406+0000", 2023-08-01T19:54:41.641 INFO:teuthology.orchestra.run.smithi008.stdout: "duration": 0.00059457599999999998 2023-08-01T19:54:41.641 INFO:teuthology.orchestra.run.smithi008.stdout: }, 2023-08-01T19:54:41.642 INFO:teuthology.orchestra.run.smithi008.stdout: { 2023-08-01T19:54:41.642 INFO:teuthology.orchestra.run.smithi008.stdout: "event": "started", 2023-08-01T19:54:41.642 INFO:teuthology.orchestra.run.smithi008.stdout: "time": "2023-08-01T19:54:37.200532+0000", 2023-08-01T19:54:41.642 INFO:teuthology.orchestra.run.smithi008.stdout: "duration": 0.000126129 2023-08-01T19:54:41.642 INFO:teuthology.orchestra.run.smithi008.stdout: }, 2023-08-01T19:54:41.642 INFO:teuthology.orchestra.run.smithi008.stdout: { 2023-08-01T19:54:41.642 INFO:teuthology.orchestra.run.smithi008.stdout: "event": "waiting for subops from 1", 2023-08-01T19:54:41.642 INFO:teuthology.orchestra.run.smithi008.stdout: "time": "2023-08-01T19:54:37.200644+0000", 2023-08-01T19:54:41.643 INFO:teuthology.orchestra.run.smithi008.stdout: "duration": 0.000111736 2023-08-01T19:54:41.643 INFO:teuthology.orchestra.run.smithi008.stdout: }, 2023-08-01T19:54:41.643 INFO:teuthology.orchestra.run.smithi008.stdout: { 2023-08-01T19:54:41.643 INFO:teuthology.orchestra.run.smithi008.stdout: "event": "sub_op_commit_rec", 2023-08-01T19:54:41.643 INFO:teuthology.orchestra.run.smithi008.stdout: "time": "2023-08-01T19:54:37.203384+0000", 2023-08-01T19:54:41.643 INFO:teuthology.orchestra.run.smithi008.stdout: "duration": 0.0027397039999999999 2023-08-01T19:54:41.643 INFO:teuthology.orchestra.run.smithi008.stdout: }, 2023-08-01T19:54:41.643 INFO:teuthology.orchestra.run.smithi008.stdout: { 2023-08-01T19:54:41.644 INFO:teuthology.orchestra.run.smithi008.stdout: "event": "op_commit", 2023-08-01T19:54:41.644 INFO:teuthology.orchestra.run.smithi008.stdout: "time": "2023-08-01T19:54:37.214746+0000", 2023-08-01T19:54:41.644 INFO:teuthology.orchestra.run.smithi008.stdout: "duration": 0.011362766 2023-08-01T19:54:41.644 INFO:teuthology.orchestra.run.smithi008.stdout: }, 2023-08-01T19:54:41.644 INFO:teuthology.orchestra.run.smithi008.stdout: { 2023-08-01T19:54:41.644 INFO:teuthology.orchestra.run.smithi008.stdout: "event": "commit_sent", 2023-08-01T19:54:41.644 INFO:teuthology.orchestra.run.smithi008.stdout: "time": "2023-08-01T19:54:37.214795+0000", 2023-08-01T19:54:41.644 INFO:teuthology.orchestra.run.smithi008.stdout: "duration": 4.8449000000000003e-05 2023-08-01T19:54:41.645 INFO:teuthology.orchestra.run.smithi008.stdout: }, 2023-08-01T19:54:41.645 INFO:teuthology.orchestra.run.smithi008.stdout: { 2023-08-01T19:54:41.645 INFO:teuthology.orchestra.run.smithi008.stdout: "event": "done", 2023-08-01T19:54:41.645 INFO:teuthology.orchestra.run.smithi008.stdout: "time": "2023-08-01T19:54:37.214837+0000", 2023-08-01T19:54:41.645 INFO:teuthology.orchestra.run.smithi008.stdout: "duration": 4.2661999999999999e-05 2023-08-01T19:54:41.645 INFO:teuthology.orchestra.run.smithi008.stdout: } 2023-08-01T19:54:41.645 INFO:teuthology.orchestra.run.smithi008.stdout: ] 2023-08-01T19:54:41.646 INFO:teuthology.orchestra.run.smithi008.stdout: } 2023-08-01T19:54:41.646 INFO:teuthology.orchestra.run.smithi008.stdout: }, 2023-08-01T19:54:41.646 INFO:teuthology.orchestra.run.smithi008.stdout: { 2023-08-01T19:54:41.646 INFO:teuthology.orchestra.run.smithi008.stdout: "description": "osd_op(client.4668.0:44617 5.c 5:34011d01:::benchmark_data_smithi006_114134_object44616:head [set-alloc-hint object_size 65536 write_size 65536,write 0~65536] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e26)", 2023-08-01T19:54:41.646 INFO:teuthology.orchestra.run.smithi008.stdout: "initiated_at": "2023-08-01T19:54:38.039696+0000", 2023-08-01T19:54:41.646 INFO:teuthology.orchestra.run.smithi008.stdout: "age": 3.450240456, 2023-08-01T19:54:41.646 INFO:teuthology.orchestra.run.smithi008.stdout: "duration": 0.013247856000000001, 2023-08-01T19:54:41.646 INFO:teuthology.orchestra.run.smithi008.stdout: "type_data": { 2023-08-01T19:54:41.647 INFO:teuthology.orchestra.run.smithi008.stdout: "flag_point": "commit sent; apply or cleanup", 2023-08-01T19:54:41.647 INFO:teuthology.orchestra.run.smithi008.stdout: "client_info": { 2023-08-01T19:54:41.647 INFO:teuthology.orchestra.run.smithi008.stdout: "client": "client.4668", 2023-08-01T19:54:41.647 INFO:teuthology.orchestra.run.smithi008.stdout: "client_addr": "172.21.15.6:0/1709472247", 2023-08-01T19:54:41.647 INFO:teuthology.orchestra.run.smithi008.stdout: "tid": 44617 2023-08-01T19:54:41.647 INFO:teuthology.orchestra.run.smithi008.stdout: }, 2023-08-01T19:54:41.647 INFO:teuthology.orchestra.run.smithi008.stdout: "events": [ 2023-08-01T19:54:41.647 INFO:teuthology.orchestra.run.smithi008.stdout: { 2023-08-01T19:54:41.648 INFO:teuthology.orchestra.run.smithi008.stdout: "event": "initiated", 2023-08-01T19:54:41.648 INFO:teuthology.orchestra.run.smithi008.stdout: "time": "2023-08-01T19:54:38.039696+0000", 2023-08-01T19:54:41.648 INFO:teuthology.orchestra.run.smithi008.stdout: "duration": 0 2023-08-01T19:54:41.648 INFO:teuthology.orchestra.run.smithi008.stdout: }, 2023-08-01T19:54:41.648 INFO:teuthology.orchestra.run.smithi008.stdout: { 2023-08-01T19:54:41.648 INFO:teuthology.orchestra.run.smithi008.stdout: "event": "throttled", 2023-08-01T19:54:41.648 INFO:teuthology.orchestra.run.smithi008.stdout: "time": "2023-08-01T19:54:38.039696+0000", 2023-08-01T19:54:41.648 INFO:teuthology.orchestra.run.smithi008.stdout: "duration": 0 2023-08-01T19:54:41.649 INFO:teuthology.orchestra.run.smithi008.stdout: }, 2023-08-01T19:54:41.649 INFO:teuthology.orchestra.run.smithi008.stdout: { 2023-08-01T19:54:41.649 INFO:teuthology.orchestra.run.smithi008.stdout: "event": "header_read", 2023-08-01T19:54:41.649 INFO:teuthology.orchestra.run.smithi008.stdout: "time": "2023-08-01T19:54:38.039695+0000", 2023-08-01T19:54:41.649 INFO:teuthology.orchestra.run.smithi008.stdout: "duration": 4294967295.999999 2023-08-01T19:54:41.649 INFO:teuthology.orchestra.run.smithi008.stdout: }, 2023-08-01T19:54:41.649 INFO:teuthology.orchestra.run.smithi008.stdout: { 2023-08-01T19:54:41.649 INFO:teuthology.orchestra.run.smithi008.stdout: "event": "all_read", 2023-08-01T19:54:41.650 INFO:teuthology.orchestra.run.smithi008.stdout: "time": "2023-08-01T19:54:38.039788+0000", 2023-08-01T19:54:41.650 INFO:teuthology.orchestra.run.smithi008.stdout: "duration": 9.2497999999999994e-05 2023-08-01T19:54:41.650 INFO:teuthology.orchestra.run.smithi008.stdout: }, 2023-08-01T19:54:41.650 INFO:teuthology.orchestra.run.smithi008.stdout: { 2023-08-01T19:54:41.650 INFO:teuthology.orchestra.run.smithi008.stdout: "event": "dispatched", 2023-08-01T19:54:41.650 INFO:teuthology.orchestra.run.smithi008.stdout: "time": "2023-08-01T19:54:38.039797+0000", 2023-08-01T19:54:41.650 INFO:teuthology.orchestra.run.smithi008.stdout: "duration": 8.9940000000000006e-06 2023-08-01T19:54:41.650 INFO:teuthology.orchestra.run.smithi008.stdout: }, 2023-08-01T19:54:41.651 INFO:teuthology.orchestra.run.smithi008.stdout: { 2023-08-01T19:54:41.651 INFO:teuthology.orchestra.run.smithi008.stdout: "event": "queued_for_pg", 2023-08-01T19:54:41.651 INFO:teuthology.orchestra.run.smithi008.stdout: "time": "2023-08-01T19:54:38.039802+0000", 2023-08-01T19:54:41.651 INFO:teuthology.orchestra.run.smithi008.stdout: "duration": 4.9320000000000004e-06 2023-08-01T19:54:41.651 INFO:teuthology.orchestra.run.smithi008.stdout: }, 2023-08-01T19:54:41.651 INFO:teuthology.orchestra.run.smithi008.stdout: { 2023-08-01T19:54:41.651 INFO:teuthology.orchestra.run.smithi008.stdout: "event": "reached_pg", 2023-08-01T19:54:41.651 INFO:teuthology.orchestra.run.smithi008.stdout: "time": "2023-08-01T19:54:38.042629+0000", 2023-08-01T19:54:41.652 INFO:teuthology.orchestra.run.smithi008.stdout: "duration": 0.0028275829999999998 2023-08-01T19:54:41.652 INFO:teuthology.orchestra.run.smithi008.stdout: }, 2023-08-01T19:54:41.652 INFO:teuthology.orchestra.run.smithi008.stdout: { 2023-08-01T19:54:41.652 INFO:teuthology.orchestra.run.smithi008.stdout: "event": "started", 2023-08-01T19:54:41.652 INFO:teuthology.orchestra.run.smithi008.stdout: "time": "2023-08-01T19:54:38.042726+0000", 2023-08-01T19:54:41.652 INFO:teuthology.orchestra.run.smithi008.stdout: "duration": 9.6521999999999995e-05 2023-08-01T19:54:41.652 INFO:teuthology.orchestra.run.smithi008.stdout: }, 2023-08-01T19:54:41.653 INFO:teuthology.orchestra.run.smithi008.stdout: { 2023-08-01T19:54:41.653 INFO:teuthology.orchestra.run.smithi008.stdout: "event": "waiting for subops from 1", 2023-08-01T19:54:41.653 INFO:teuthology.orchestra.run.smithi008.stdout: "time": "2023-08-01T19:54:38.042826+0000", 2023-08-01T19:54:41.653 INFO:teuthology.orchestra.run.smithi008.stdout: "duration": 9.9599000000000006e-05 2023-08-01T19:54:41.653 INFO:teuthology.orchestra.run.smithi008.stdout: }, 2023-08-01T19:54:41.653 INFO:teuthology.orchestra.run.smithi008.stdout: { 2023-08-01T19:54:41.653 INFO:teuthology.orchestra.run.smithi008.stdout: "event": "op_commit", 2023-08-01T19:54:41.653 INFO:teuthology.orchestra.run.smithi008.stdout: "time": "2023-08-01T19:54:38.046226+0000", 2023-08-01T19:54:41.654 INFO:teuthology.orchestra.run.smithi008.stdout: "duration": 0.0034001629999999999 2023-08-01T19:54:41.654 INFO:teuthology.orchestra.run.smithi008.stdout: }, 2023-08-01T19:54:41.654 INFO:teuthology.orchestra.run.smithi008.stdout: { 2023-08-01T19:54:41.654 INFO:teuthology.orchestra.run.smithi008.stdout: "event": "sub_op_commit_rec", 2023-08-01T19:54:41.654 INFO:teuthology.orchestra.run.smithi008.stdout: "time": "2023-08-01T19:54:38.052858+0000", 2023-08-01T19:54:41.654 INFO:teuthology.orchestra.run.smithi008.stdout: "duration": 0.0066322559999999996 2023-08-01T19:54:41.654 INFO:teuthology.orchestra.run.smithi008.stdout: }, 2023-08-01T19:54:41.654 INFO:teuthology.orchestra.run.smithi008.stdout: { 2023-08-01T19:54:41.655 INFO:teuthology.orchestra.run.smithi008.stdout: "event": "commit_sent", 2023-08-01T19:54:41.655 INFO:teuthology.orchestra.run.smithi008.stdout: "time": "2023-08-01T19:54:38.052907+0000", 2023-08-01T19:54:41.655 INFO:teuthology.orchestra.run.smithi008.stdout: "duration": 4.8952000000000002e-05 2023-08-01T19:54:41.655 INFO:teuthology.orchestra.run.smithi008.stdout: }, 2023-08-01T19:54:41.655 INFO:teuthology.orchestra.run.smithi008.stdout: { 2023-08-01T19:54:41.655 INFO:teuthology.orchestra.run.smithi008.stdout: "event": "done", 2023-08-01T19:54:41.655 INFO:teuthology.orchestra.run.smithi008.stdout: "time": "2023-08-01T19:54:38.052944+0000", 2023-08-01T19:54:41.655 INFO:teuthology.orchestra.run.smithi008.stdout: "duration": 3.7172999999999998e-05 2023-08-01T19:54:41.656 INFO:teuthology.orchestra.run.smithi008.stdout: } 2023-08-01T19:54:41.656 INFO:teuthology.orchestra.run.smithi008.stdout: ] 2023-08-01T19:54:41.656 INFO:teuthology.orchestra.run.smithi008.stdout: } 2023-08-01T19:54:41.656 INFO:teuthology.orchestra.run.smithi008.stdout: }, 2023-08-01T19:54:41.656 INFO:teuthology.orchestra.run.smithi008.stdout: { 2023-08-01T19:54:41.656 INFO:teuthology.orchestra.run.smithi008.stdout: "description": "osd_op(client.4668.0:52189 5.a 5:5868cda2:::benchmark_data_smithi006_114134_object52188:head [set-alloc-hint object_size 65536 write_size 65536,write 0~65536] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e27)", 2023-08-01T19:54:41.656 INFO:teuthology.orchestra.run.smithi008.stdout: "initiated_at": "2023-08-01T19:54:41.259379+0000", 2023-08-01T19:54:41.656 INFO:teuthology.orchestra.run.smithi008.stdout: "age": 0.23055716000000001, 2023-08-01T19:54:41.657 INFO:teuthology.orchestra.run.smithi008.stdout: "duration": 0.014704129999999999, 2023-08-01T19:54:41.657 INFO:teuthology.orchestra.run.smithi008.stdout: "type_data": { 2023-08-01T19:54:41.657 INFO:teuthology.orchestra.run.smithi008.stdout: "flag_point": "commit sent; apply or cleanup", 2023-08-01T19:54:41.657 INFO:teuthology.orchestra.run.smithi008.stdout: "client_info": { 2023-08-01T19:54:41.657 INFO:teuthology.orchestra.run.smithi008.stdout: "client": "client.4668", 2023-08-01T19:54:41.657 INFO:teuthology.orchestra.run.smithi008.stdout: "client_addr": "172.21.15.6:0/1709472247", 2023-08-01T19:54:41.657 INFO:teuthology.orchestra.run.smithi008.stdout: "tid": 52189 2023-08-01T19:54:41.657 INFO:teuthology.orchestra.run.smithi008.stdout: }, 2023-08-01T19:54:41.658 INFO:teuthology.orchestra.run.smithi008.stdout: "events": [ 2023-08-01T19:54:41.658 INFO:teuthology.orchestra.run.smithi008.stdout: { 2023-08-01T19:54:41.658 INFO:teuthology.orchestra.run.smithi008.stdout: "event": "initiated", 2023-08-01T19:54:41.658 INFO:teuthology.orchestra.run.smithi008.stdout: "time": "2023-08-01T19:54:41.259379+0000", 2023-08-01T19:54:41.658 INFO:teuthology.orchestra.run.smithi008.stdout: "duration": 0 2023-08-01T19:54:41.658 INFO:teuthology.orchestra.run.smithi008.stdout: }, 2023-08-01T19:54:41.658 INFO:teuthology.orchestra.run.smithi008.stdout: { 2023-08-01T19:54:41.658 INFO:teuthology.orchestra.run.smithi008.stdout: "event": "throttled", 2023-08-01T19:54:41.659 INFO:teuthology.orchestra.run.smithi008.stdout: "time": "2023-08-01T19:54:41.259379+0000", 2023-08-01T19:54:41.659 INFO:teuthology.orchestra.run.smithi008.stdout: "duration": 0 2023-08-01T19:54:41.659 INFO:teuthology.orchestra.run.smithi008.stdout: }, 2023-08-01T19:54:41.659 INFO:teuthology.orchestra.run.smithi008.stdout: { 2023-08-01T19:54:41.659 INFO:teuthology.orchestra.run.smithi008.stdout: "event": "header_read", 2023-08-01T19:54:41.659 INFO:teuthology.orchestra.run.smithi008.stdout: "time": "2023-08-01T19:54:41.259379+0000", 2023-08-01T19:54:41.659 INFO:teuthology.orchestra.run.smithi008.stdout: "duration": 4294967295.9999995 2023-08-01T19:54:41.659 INFO:teuthology.orchestra.run.smithi008.stdout: }, 2023-08-01T19:54:41.660 INFO:teuthology.orchestra.run.smithi008.stdout: { 2023-08-01T19:54:41.660 INFO:teuthology.orchestra.run.smithi008.stdout: "event": "all_read", 2023-08-01T19:54:41.660 INFO:teuthology.orchestra.run.smithi008.stdout: "time": "2023-08-01T19:54:41.259417+0000", 2023-08-01T19:54:41.660 INFO:teuthology.orchestra.run.smithi008.stdout: "duration": 3.7667999999999999e-05 2023-08-01T19:54:41.660 INFO:teuthology.orchestra.run.smithi008.stdout: }, 2023-08-01T19:54:41.660 INFO:teuthology.orchestra.run.smithi008.stdout: { 2023-08-01T19:54:41.660 INFO:teuthology.orchestra.run.smithi008.stdout: "event": "dispatched", 2023-08-01T19:54:41.661 INFO:teuthology.orchestra.run.smithi008.stdout: "time": "2023-08-01T19:54:41.259427+0000", 2023-08-01T19:54:41.661 INFO:teuthology.orchestra.run.smithi008.stdout: "duration": 9.9289999999999993e-06 2023-08-01T19:54:41.661 INFO:teuthology.orchestra.run.smithi008.stdout: }, 2023-08-01T19:54:41.661 INFO:teuthology.orchestra.run.smithi008.stdout: { 2023-08-01T19:54:41.661 INFO:teuthology.orchestra.run.smithi008.stdout: "event": "queued_for_pg", 2023-08-01T19:54:41.661 INFO:teuthology.orchestra.run.smithi008.stdout: "time": "2023-08-01T19:54:41.259432+0000", 2023-08-01T19:54:41.661 INFO:teuthology.orchestra.run.smithi008.stdout: "duration": 5.0509999999999996e-06 2023-08-01T19:54:41.661 INFO:teuthology.orchestra.run.smithi008.stdout: }, 2023-08-01T19:54:41.662 INFO:teuthology.orchestra.run.smithi008.stdout: { 2023-08-01T19:54:41.662 INFO:teuthology.orchestra.run.smithi008.stdout: "event": "reached_pg", 2023-08-01T19:54:41.662 INFO:teuthology.orchestra.run.smithi008.stdout: "time": "2023-08-01T19:54:41.261308+0000", 2023-08-01T19:54:41.662 INFO:teuthology.orchestra.run.smithi008.stdout: "duration": 0.0018767619999999999 2023-08-01T19:54:41.662 INFO:teuthology.orchestra.run.smithi008.stdout: }, 2023-08-01T19:54:41.662 INFO:teuthology.orchestra.run.smithi008.stdout: { 2023-08-01T19:54:41.662 INFO:teuthology.orchestra.run.smithi008.stdout: "event": "started", 2023-08-01T19:54:41.662 INFO:teuthology.orchestra.run.smithi008.stdout: "time": "2023-08-01T19:54:41.261462+0000", 2023-08-01T19:54:41.663 INFO:teuthology.orchestra.run.smithi008.stdout: "duration": 0.00015356300000000001 2023-08-01T19:54:41.663 INFO:teuthology.orchestra.run.smithi008.stdout: }, 2023-08-01T19:54:41.663 INFO:teuthology.orchestra.run.smithi008.stdout: { 2023-08-01T19:54:41.663 INFO:teuthology.orchestra.run.smithi008.stdout: "event": "waiting for subops from 2", 2023-08-01T19:54:41.663 INFO:teuthology.orchestra.run.smithi008.stdout: "time": "2023-08-01T19:54:41.261598+0000", 2023-08-01T19:54:41.663 INFO:teuthology.orchestra.run.smithi008.stdout: "duration": 0.000136487 2023-08-01T19:54:41.663 INFO:teuthology.orchestra.run.smithi008.stdout: }, 2023-08-01T19:54:41.663 INFO:teuthology.orchestra.run.smithi008.stdout: { 2023-08-01T19:54:41.664 INFO:teuthology.orchestra.run.smithi008.stdout: "event": "op_commit", 2023-08-01T19:54:41.664 INFO:teuthology.orchestra.run.smithi008.stdout: "time": "2023-08-01T19:54:41.268183+0000", 2023-08-01T19:54:41.664 INFO:teuthology.orchestra.run.smithi008.stdout: "duration": 0.0065849929999999999 2023-08-01T19:54:41.664 INFO:teuthology.orchestra.run.smithi008.stdout: }, 2023-08-01T19:54:41.664 INFO:teuthology.orchestra.run.smithi008.stdout: { 2023-08-01T19:54:41.664 INFO:teuthology.orchestra.run.smithi008.stdout: "event": "sub_op_commit_rec", 2023-08-01T19:54:41.664 INFO:teuthology.orchestra.run.smithi008.stdout: "time": "2023-08-01T19:54:41.273975+0000", 2023-08-01T19:54:41.664 INFO:teuthology.orchestra.run.smithi008.stdout: "duration": 0.0057916449999999998 2023-08-01T19:54:41.665 INFO:teuthology.orchestra.run.smithi008.stdout: }, 2023-08-01T19:54:41.665 INFO:teuthology.orchestra.run.smithi008.stdout: { 2023-08-01T19:54:41.665 INFO:teuthology.orchestra.run.smithi008.stdout: "event": "commit_sent", 2023-08-01T19:54:41.665 INFO:teuthology.orchestra.run.smithi008.stdout: "time": "2023-08-01T19:54:41.274042+0000", 2023-08-01T19:54:41.665 INFO:teuthology.orchestra.run.smithi008.stdout: "duration": 6.6531000000000004e-05 2023-08-01T19:54:41.665 INFO:teuthology.orchestra.run.smithi008.stdout: }, 2023-08-01T19:54:41.665 INFO:teuthology.orchestra.run.smithi008.stdout: { 2023-08-01T19:54:41.665 INFO:teuthology.orchestra.run.smithi008.stdout: "event": "done", 2023-08-01T19:54:41.666 INFO:teuthology.orchestra.run.smithi008.stdout: "time": "2023-08-01T19:54:41.274084+0000", 2023-08-01T19:54:41.666 INFO:teuthology.orchestra.run.smithi008.stdout: "duration": 4.2021999999999998e-05 2023-08-01T19:54:41.666 INFO:teuthology.orchestra.run.smithi008.stdout: } 2023-08-01T19:54:41.666 INFO:teuthology.orchestra.run.smithi008.stdout: ] 2023-08-01T19:54:41.666 INFO:teuthology.orchestra.run.smithi008.stdout: } 2023-08-01T19:54:41.666 INFO:teuthology.orchestra.run.smithi008.stdout: }, 2023-08-01T19:54:41.666 INFO:teuthology.orchestra.run.smithi008.stdout: { 2023-08-01T19:54:41.667 INFO:teuthology.orchestra.run.smithi008.stdout: "description": "osd_op(client.4668.0:52275 5.a 5:56383264:::benchmark_data_smithi006_114134_object52274:head [set-alloc-hint object_size 65536 write_size 65536,write 0~65536] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e27)", 2023-08-01T19:54:41.667 INFO:teuthology.orchestra.run.smithi008.stdout: "initiated_at": "2023-08-01T19:54:41.299219+0000", 2023-08-01T19:54:41.667 INFO:teuthology.orchestra.run.smithi008.stdout: "age": 0.190717844, 2023-08-01T19:54:41.667 INFO:teuthology.orchestra.run.smithi008.stdout: "duration": 0.013777899, 2023-08-01T19:54:41.667 INFO:teuthology.orchestra.run.smithi008.stdout: "type_data": { 2023-08-01T19:54:41.667 INFO:teuthology.orchestra.run.smithi008.stdout: "flag_point": "commit sent; apply or cleanup", 2023-08-01T19:54:41.667 INFO:teuthology.orchestra.run.smithi008.stdout: "client_info": { 2023-08-01T19:54:41.667 INFO:teuthology.orchestra.run.smithi008.stdout: "client": "client.4668", 2023-08-01T19:54:41.668 INFO:teuthology.orchestra.run.smithi008.stdout: "client_addr": "172.21.15.6:0/1709472247", 2023-08-01T19:54:41.668 INFO:teuthology.orchestra.run.smithi008.stdout: "tid": 52275 2023-08-01T19:54:41.668 INFO:teuthology.orchestra.run.smithi008.stdout: }, 2023-08-01T19:54:41.668 INFO:teuthology.orchestra.run.smithi008.stdout: "events": [ 2023-08-01T19:54:41.668 INFO:teuthology.orchestra.run.smithi008.stdout: { 2023-08-01T19:54:41.668 INFO:teuthology.orchestra.run.smithi008.stdout: "event": "initiated", 2023-08-01T19:54:41.668 INFO:teuthology.orchestra.run.smithi008.stdout: "time": "2023-08-01T19:54:41.299219+0000", 2023-08-01T19:54:41.668 INFO:teuthology.orchestra.run.smithi008.stdout: "duration": 0 2023-08-01T19:54:41.669 INFO:teuthology.orchestra.run.smithi008.stdout: }, 2023-08-01T19:54:41.669 INFO:teuthology.orchestra.run.smithi008.stdout: { 2023-08-01T19:54:41.669 INFO:teuthology.orchestra.run.smithi008.stdout: "event": "throttled", 2023-08-01T19:54:41.669 INFO:teuthology.orchestra.run.smithi008.stdout: "time": "2023-08-01T19:54:41.299219+0000", 2023-08-01T19:54:41.669 INFO:teuthology.orchestra.run.smithi008.stdout: "duration": 0 2023-08-01T19:54:41.669 INFO:teuthology.orchestra.run.smithi008.stdout: }, 2023-08-01T19:54:41.669 INFO:teuthology.orchestra.run.smithi008.stdout: { 2023-08-01T19:54:41.669 INFO:teuthology.orchestra.run.smithi008.stdout: "event": "header_read", 2023-08-01T19:54:41.670 INFO:teuthology.orchestra.run.smithi008.stdout: "time": "2023-08-01T19:54:41.299218+0000", 2023-08-01T19:54:41.670 INFO:teuthology.orchestra.run.smithi008.stdout: "duration": 4294967295.999999 2023-08-01T19:54:41.670 INFO:teuthology.orchestra.run.smithi008.stdout: }, 2023-08-01T19:54:41.670 INFO:teuthology.orchestra.run.smithi008.stdout: { 2023-08-01T19:54:41.670 INFO:teuthology.orchestra.run.smithi008.stdout: "event": "all_read", 2023-08-01T19:54:41.670 INFO:teuthology.orchestra.run.smithi008.stdout: "time": "2023-08-01T19:54:41.299278+0000", 2023-08-01T19:54:41.670 INFO:teuthology.orchestra.run.smithi008.stdout: "duration": 6.0229000000000002e-05 2023-08-01T19:54:41.670 INFO:teuthology.orchestra.run.smithi008.stdout: }, 2023-08-01T19:54:41.671 INFO:teuthology.orchestra.run.smithi008.stdout: { 2023-08-01T19:54:41.671 INFO:teuthology.orchestra.run.smithi008.stdout: "event": "dispatched", 2023-08-01T19:54:41.671 INFO:teuthology.orchestra.run.smithi008.stdout: "time": "2023-08-01T19:54:41.299290+0000", 2023-08-01T19:54:41.671 INFO:teuthology.orchestra.run.smithi008.stdout: "duration": 1.1567e-05 2023-08-01T19:54:41.671 INFO:teuthology.orchestra.run.smithi008.stdout: }, 2023-08-01T19:54:41.671 INFO:teuthology.orchestra.run.smithi008.stdout: { 2023-08-01T19:54:41.671 INFO:teuthology.orchestra.run.smithi008.stdout: "event": "queued_for_pg", 2023-08-01T19:54:41.671 INFO:teuthology.orchestra.run.smithi008.stdout: "time": "2023-08-01T19:54:41.299295+0000", 2023-08-01T19:54:41.672 INFO:teuthology.orchestra.run.smithi008.stdout: "duration": 5.4389999999999999e-06 2023-08-01T19:54:41.672 INFO:teuthology.orchestra.run.smithi008.stdout: }, 2023-08-01T19:54:41.672 INFO:teuthology.orchestra.run.smithi008.stdout: { 2023-08-01T19:54:41.672 INFO:teuthology.orchestra.run.smithi008.stdout: "event": "reached_pg", 2023-08-01T19:54:41.672 INFO:teuthology.orchestra.run.smithi008.stdout: "time": "2023-08-01T19:54:41.306435+0000", 2023-08-01T19:54:41.672 INFO:teuthology.orchestra.run.smithi008.stdout: "duration": 0.0071394249999999996 2023-08-01T19:54:41.672 INFO:teuthology.orchestra.run.smithi008.stdout: }, 2023-08-01T19:54:41.672 INFO:teuthology.orchestra.run.smithi008.stdout: { 2023-08-01T19:54:41.673 INFO:teuthology.orchestra.run.smithi008.stdout: "event": "started", 2023-08-01T19:54:41.673 INFO:teuthology.orchestra.run.smithi008.stdout: "time": "2023-08-01T19:54:41.306579+0000", 2023-08-01T19:54:41.673 INFO:teuthology.orchestra.run.smithi008.stdout: "duration": 0.00014404199999999999 2023-08-01T19:54:41.673 INFO:teuthology.orchestra.run.smithi008.stdout: }, 2023-08-01T19:54:41.673 INFO:teuthology.orchestra.run.smithi008.stdout: { 2023-08-01T19:54:41.673 INFO:teuthology.orchestra.run.smithi008.stdout: "event": "waiting for subops from 2", 2023-08-01T19:54:41.673 INFO:teuthology.orchestra.run.smithi008.stdout: "time": "2023-08-01T19:54:41.306719+0000", 2023-08-01T19:54:41.674 INFO:teuthology.orchestra.run.smithi008.stdout: "duration": 0.000140192 2023-08-01T19:54:41.674 INFO:teuthology.orchestra.run.smithi008.stdout: }, 2023-08-01T19:54:41.674 INFO:teuthology.orchestra.run.smithi008.stdout: { 2023-08-01T19:54:41.674 INFO:teuthology.orchestra.run.smithi008.stdout: "event": "sub_op_commit_rec", 2023-08-01T19:54:41.674 INFO:teuthology.orchestra.run.smithi008.stdout: "time": "2023-08-01T19:54:41.312464+0000", 2023-08-01T19:54:41.674 INFO:teuthology.orchestra.run.smithi008.stdout: "duration": 0.0057454580000000002 2023-08-01T19:54:41.674 INFO:teuthology.orchestra.run.smithi008.stdout: }, 2023-08-01T19:54:41.674 INFO:teuthology.orchestra.run.smithi008.stdout: { 2023-08-01T19:54:41.675 INFO:teuthology.orchestra.run.smithi008.stdout: "event": "op_commit", 2023-08-01T19:54:41.675 INFO:teuthology.orchestra.run.smithi008.stdout: "time": "2023-08-01T19:54:41.312917+0000", 2023-08-01T19:54:41.675 INFO:teuthology.orchestra.run.smithi008.stdout: "duration": 0.00045283200000000002 2023-08-01T19:54:41.675 INFO:teuthology.orchestra.run.smithi008.stdout: }, 2023-08-01T19:54:41.675 INFO:teuthology.orchestra.run.smithi008.stdout: { 2023-08-01T19:54:41.675 INFO:teuthology.orchestra.run.smithi008.stdout: "event": "commit_sent", 2023-08-01T19:54:41.675 INFO:teuthology.orchestra.run.smithi008.stdout: "time": "2023-08-01T19:54:41.312959+0000", 2023-08-01T19:54:41.675 INFO:teuthology.orchestra.run.smithi008.stdout: "duration": 4.2314999999999997e-05 2023-08-01T19:54:41.676 INFO:teuthology.orchestra.run.smithi008.stdout: }, 2023-08-01T19:54:41.676 INFO:teuthology.orchestra.run.smithi008.stdout: { 2023-08-01T19:54:41.676 INFO:teuthology.orchestra.run.smithi008.stdout: "event": "done", 2023-08-01T19:54:41.676 INFO:teuthology.orchestra.run.smithi008.stdout: "time": "2023-08-01T19:54:41.312997+0000", 2023-08-01T19:54:41.676 INFO:teuthology.orchestra.run.smithi008.stdout: "duration": 3.7270000000000001e-05 2023-08-01T19:54:41.676 INFO:teuthology.orchestra.run.smithi008.stdout: } 2023-08-01T19:54:41.676 INFO:teuthology.orchestra.run.smithi008.stdout: ] 2023-08-01T19:54:41.677 INFO:teuthology.orchestra.run.smithi008.stdout: } 2023-08-01T19:54:41.677 INFO:teuthology.orchestra.run.smithi008.stdout: }, 2023-08-01T19:54:41.677 INFO:teuthology.orchestra.run.smithi008.stdout: { 2023-08-01T19:54:41.677 INFO:teuthology.orchestra.run.smithi008.stdout: "description": "osd_op(client.4668.0:52279 5.a 5:5a05bb19:::benchmark_data_smithi006_114134_object52278:head [set-alloc-hint object_size 65536 write_size 65536,write 0~65536] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e27)", 2023-08-01T19:54:41.677 INFO:teuthology.orchestra.run.smithi008.stdout: "initiated_at": "2023-08-01T19:54:41.301770+0000", 2023-08-01T19:54:41.677 INFO:teuthology.orchestra.run.smithi008.stdout: "age": 0.188166366, 2023-08-01T19:54:41.677 INFO:teuthology.orchestra.run.smithi008.stdout: "duration": 0.01372922, 2023-08-01T19:54:41.677 INFO:teuthology.orchestra.run.smithi008.stdout: "type_data": { 2023-08-01T19:54:41.678 INFO:teuthology.orchestra.run.smithi008.stdout: "flag_point": "commit sent; apply or cleanup", 2023-08-01T19:54:41.678 INFO:teuthology.orchestra.run.smithi008.stdout: "client_info": { 2023-08-01T19:54:41.678 INFO:teuthology.orchestra.run.smithi008.stdout: "client": "client.4668", 2023-08-01T19:54:41.678 INFO:teuthology.orchestra.run.smithi008.stdout: "client_addr": "172.21.15.6:0/1709472247", 2023-08-01T19:54:41.678 INFO:teuthology.orchestra.run.smithi008.stdout: "tid": 52279 2023-08-01T19:54:41.678 INFO:teuthology.orchestra.run.smithi008.stdout: }, 2023-08-01T19:54:41.678 INFO:teuthology.orchestra.run.smithi008.stdout: "events": [ 2023-08-01T19:54:41.678 INFO:teuthology.orchestra.run.smithi008.stdout: { 2023-08-01T19:54:41.679 INFO:teuthology.orchestra.run.smithi008.stdout: "event": "initiated", 2023-08-01T19:54:41.679 INFO:teuthology.orchestra.run.smithi008.stdout: "time": "2023-08-01T19:54:41.301770+0000", 2023-08-01T19:54:41.679 INFO:teuthology.orchestra.run.smithi008.stdout: "duration": 0 2023-08-01T19:54:41.679 INFO:teuthology.orchestra.run.smithi008.stdout: }, 2023-08-01T19:54:41.679 INFO:teuthology.orchestra.run.smithi008.stdout: { 2023-08-01T19:54:41.679 INFO:teuthology.orchestra.run.smithi008.stdout: "event": "throttled", 2023-08-01T19:54:41.679 INFO:teuthology.orchestra.run.smithi008.stdout: "time": "2023-08-01T19:54:41.301770+0000", 2023-08-01T19:54:41.679 INFO:teuthology.orchestra.run.smithi008.stdout: "duration": 0 2023-08-01T19:54:41.680 INFO:teuthology.orchestra.run.smithi008.stdout: }, 2023-08-01T19:54:41.680 INFO:teuthology.orchestra.run.smithi008.stdout: { 2023-08-01T19:54:41.680 INFO:teuthology.orchestra.run.smithi008.stdout: "event": "header_read", 2023-08-01T19:54:41.680 INFO:teuthology.orchestra.run.smithi008.stdout: "time": "2023-08-01T19:54:41.301769+0000", 2023-08-01T19:54:41.680 INFO:teuthology.orchestra.run.smithi008.stdout: "duration": 4294967295.999999 2023-08-01T19:54:41.680 INFO:teuthology.orchestra.run.smithi008.stdout: }, 2023-08-01T19:54:41.680 INFO:teuthology.orchestra.run.smithi008.stdout: { 2023-08-01T19:54:41.680 INFO:teuthology.orchestra.run.smithi008.stdout: "event": "all_read", 2023-08-01T19:54:41.681 INFO:teuthology.orchestra.run.smithi008.stdout: "time": "2023-08-01T19:54:41.301848+0000", 2023-08-01T19:54:41.681 INFO:teuthology.orchestra.run.smithi008.stdout: "duration": 7.8523999999999996e-05 2023-08-01T19:54:41.681 INFO:teuthology.orchestra.run.smithi008.stdout: }, 2023-08-01T19:54:41.681 INFO:teuthology.orchestra.run.smithi008.stdout: { 2023-08-01T19:54:41.681 INFO:teuthology.orchestra.run.smithi008.stdout: "event": "dispatched", 2023-08-01T19:54:41.681 INFO:teuthology.orchestra.run.smithi008.stdout: "time": "2023-08-01T19:54:41.301859+0000", 2023-08-01T19:54:41.681 INFO:teuthology.orchestra.run.smithi008.stdout: "duration": 1.1287000000000001e-05 2023-08-01T19:54:41.681 INFO:teuthology.orchestra.run.smithi008.stdout: }, 2023-08-01T19:54:41.682 INFO:teuthology.orchestra.run.smithi008.stdout: { 2023-08-01T19:54:41.682 INFO:teuthology.orchestra.run.smithi008.stdout: "event": "queued_for_pg", 2023-08-01T19:54:41.682 INFO:teuthology.orchestra.run.smithi008.stdout: "time": "2023-08-01T19:54:41.301865+0000", 2023-08-01T19:54:41.682 INFO:teuthology.orchestra.run.smithi008.stdout: "duration": 6.472e-06 2023-08-01T19:54:41.682 INFO:teuthology.orchestra.run.smithi008.stdout: }, 2023-08-01T19:54:41.682 INFO:teuthology.orchestra.run.smithi008.stdout: { 2023-08-01T19:54:41.682 INFO:teuthology.orchestra.run.smithi008.stdout: "event": "reached_pg", 2023-08-01T19:54:41.682 INFO:teuthology.orchestra.run.smithi008.stdout: "time": "2023-08-01T19:54:41.308524+0000", 2023-08-01T19:54:41.683 INFO:teuthology.orchestra.run.smithi008.stdout: "duration": 0.0066583570000000002 2023-08-01T19:54:41.683 INFO:teuthology.orchestra.run.smithi008.stdout: }, 2023-08-01T19:54:41.683 INFO:teuthology.orchestra.run.smithi008.stdout: { 2023-08-01T19:54:41.683 INFO:teuthology.orchestra.run.smithi008.stdout: "event": "started", 2023-08-01T19:54:41.683 INFO:teuthology.orchestra.run.smithi008.stdout: "time": "2023-08-01T19:54:41.308617+0000", 2023-08-01T19:54:41.683 INFO:teuthology.orchestra.run.smithi008.stdout: "duration": 9.2938999999999999e-05 2023-08-01T19:54:41.683 INFO:teuthology.orchestra.run.smithi008.stdout: }, 2023-08-01T19:54:41.683 INFO:teuthology.orchestra.run.smithi008.stdout: { 2023-08-01T19:54:41.684 INFO:teuthology.orchestra.run.smithi008.stdout: "event": "waiting for subops from 2", 2023-08-01T19:54:41.684 INFO:teuthology.orchestra.run.smithi008.stdout: "time": "2023-08-01T19:54:41.308721+0000", 2023-08-01T19:54:41.684 INFO:teuthology.orchestra.run.smithi008.stdout: "duration": 0.00010466 2023-08-01T19:54:41.684 INFO:teuthology.orchestra.run.smithi008.stdout: }, 2023-08-01T19:54:41.684 INFO:teuthology.orchestra.run.smithi008.stdout: { 2023-08-01T19:54:41.684 INFO:teuthology.orchestra.run.smithi008.stdout: "event": "sub_op_commit_rec", 2023-08-01T19:54:41.684 INFO:teuthology.orchestra.run.smithi008.stdout: "time": "2023-08-01T19:54:41.312767+0000", 2023-08-01T19:54:41.685 INFO:teuthology.orchestra.run.smithi008.stdout: "duration": 0.0040453970000000001 2023-08-01T19:54:41.685 INFO:teuthology.orchestra.run.smithi008.stdout: }, 2023-08-01T19:54:41.685 INFO:teuthology.orchestra.run.smithi008.stdout: { 2023-08-01T19:54:41.685 INFO:teuthology.orchestra.run.smithi008.stdout: "event": "op_commit", 2023-08-01T19:54:41.685 INFO:teuthology.orchestra.run.smithi008.stdout: "time": "2023-08-01T19:54:41.315399+0000", 2023-08-01T19:54:41.685 INFO:teuthology.orchestra.run.smithi008.stdout: "duration": 0.0026318549999999998 2023-08-01T19:54:41.685 INFO:teuthology.orchestra.run.smithi008.stdout: }, 2023-08-01T19:54:41.685 INFO:teuthology.orchestra.run.smithi008.stdout: { 2023-08-01T19:54:41.686 INFO:teuthology.orchestra.run.smithi008.stdout: "event": "commit_sent", 2023-08-01T19:54:41.686 INFO:teuthology.orchestra.run.smithi008.stdout: "time": "2023-08-01T19:54:41.315462+0000", 2023-08-01T19:54:41.686 INFO:teuthology.orchestra.run.smithi008.stdout: "duration": 6.3028999999999996e-05 2023-08-01T19:54:41.686 INFO:teuthology.orchestra.run.smithi008.stdout: }, 2023-08-01T19:54:41.686 INFO:teuthology.orchestra.run.smithi008.stdout: { 2023-08-01T19:54:41.686 INFO:teuthology.orchestra.run.smithi008.stdout: "event": "done", 2023-08-01T19:54:41.686 INFO:teuthology.orchestra.run.smithi008.stdout: "time": "2023-08-01T19:54:41.315500+0000", 2023-08-01T19:54:41.686 INFO:teuthology.orchestra.run.smithi008.stdout: "duration": 3.7774000000000001e-05 2023-08-01T19:54:41.687 INFO:teuthology.orchestra.run.smithi008.stdout: } 2023-08-01T19:54:41.687 INFO:teuthology.orchestra.run.smithi008.stdout: ] 2023-08-01T19:54:41.687 INFO:teuthology.orchestra.run.smithi008.stdout: } 2023-08-01T19:54:41.687 INFO:teuthology.orchestra.run.smithi008.stdout: }, 2023-08-01T19:54:41.687 INFO:teuthology.orchestra.run.smithi008.stdout: { 2023-08-01T19:54:41.687 INFO:teuthology.orchestra.run.smithi008.stdout: "description": "osd_op(client.4668.0:52311 5.3 5:c5923d66:::benchmark_data_smithi006_114134_object52310:head [set-alloc-hint object_size 65536 write_size 65536,write 0~65536] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e27)", 2023-08-01T19:54:41.687 INFO:teuthology.orchestra.run.smithi008.stdout: "initiated_at": "2023-08-01T19:54:41.317314+0000", 2023-08-01T19:54:41.687 INFO:teuthology.orchestra.run.smithi008.stdout: "age": 0.172623112, 2023-08-01T19:54:41.688 INFO:teuthology.orchestra.run.smithi008.stdout: "duration": 0.013482193, 2023-08-01T19:54:41.688 INFO:teuthology.orchestra.run.smithi008.stdout: "type_data": { 2023-08-01T19:54:41.688 INFO:teuthology.orchestra.run.smithi008.stdout: "flag_point": "commit sent; apply or cleanup", 2023-08-01T19:54:41.688 INFO:teuthology.orchestra.run.smithi008.stdout: "client_info": { 2023-08-01T19:54:41.688 INFO:teuthology.orchestra.run.smithi008.stdout: "client": "client.4668", 2023-08-01T19:54:41.688 INFO:teuthology.orchestra.run.smithi008.stdout: "client_addr": "172.21.15.6:0/1709472247", 2023-08-01T19:54:41.688 INFO:teuthology.orchestra.run.smithi008.stdout: "tid": 52311 2023-08-01T19:54:41.688 INFO:teuthology.orchestra.run.smithi008.stdout: }, 2023-08-01T19:54:41.689 INFO:teuthology.orchestra.run.smithi008.stdout: "events": [ 2023-08-01T19:54:41.689 INFO:teuthology.orchestra.run.smithi008.stdout: { 2023-08-01T19:54:41.689 INFO:teuthology.orchestra.run.smithi008.stdout: "event": "initiated", 2023-08-01T19:54:41.689 INFO:teuthology.orchestra.run.smithi008.stdout: "time": "2023-08-01T19:54:41.317314+0000", 2023-08-01T19:54:41.689 INFO:teuthology.orchestra.run.smithi008.stdout: "duration": 0 2023-08-01T19:54:41.689 INFO:teuthology.orchestra.run.smithi008.stdout: }, 2023-08-01T19:54:41.689 INFO:teuthology.orchestra.run.smithi008.stdout: { 2023-08-01T19:54:41.689 INFO:teuthology.orchestra.run.smithi008.stdout: "event": "throttled", 2023-08-01T19:54:41.690 INFO:teuthology.orchestra.run.smithi008.stdout: "time": "2023-08-01T19:54:41.317314+0000", 2023-08-01T19:54:41.690 INFO:teuthology.orchestra.run.smithi008.stdout: "duration": 0 2023-08-01T19:54:41.690 INFO:teuthology.orchestra.run.smithi008.stdout: }, 2023-08-01T19:54:41.690 INFO:teuthology.orchestra.run.smithi008.stdout: { 2023-08-01T19:54:41.690 INFO:teuthology.orchestra.run.smithi008.stdout: "event": "header_read", 2023-08-01T19:54:41.690 INFO:teuthology.orchestra.run.smithi008.stdout: "time": "2023-08-01T19:54:41.317313+0000", 2023-08-01T19:54:41.690 INFO:teuthology.orchestra.run.smithi008.stdout: "duration": 4294967295.9999995 2023-08-01T19:54:41.691 INFO:teuthology.orchestra.run.smithi008.stdout: }, 2023-08-01T19:54:41.691 INFO:teuthology.orchestra.run.smithi008.stdout: { 2023-08-01T19:54:41.691 INFO:teuthology.orchestra.run.smithi008.stdout: "event": "all_read", 2023-08-01T19:54:41.691 INFO:teuthology.orchestra.run.smithi008.stdout: "time": "2023-08-01T19:54:41.317341+0000", 2023-08-01T19:54:41.691 INFO:teuthology.orchestra.run.smithi008.stdout: "duration": 2.8129000000000001e-05 2023-08-01T19:54:41.691 INFO:teuthology.orchestra.run.smithi008.stdout: }, 2023-08-01T19:54:41.691 INFO:teuthology.orchestra.run.smithi008.stdout: { 2023-08-01T19:54:41.691 INFO:teuthology.orchestra.run.smithi008.stdout: "event": "dispatched", 2023-08-01T19:54:41.692 INFO:teuthology.orchestra.run.smithi008.stdout: "time": "2023-08-01T19:54:41.317353+0000", 2023-08-01T19:54:41.692 INFO:teuthology.orchestra.run.smithi008.stdout: "duration": 1.2224e-05 2023-08-01T19:54:41.692 INFO:teuthology.orchestra.run.smithi008.stdout: }, 2023-08-01T19:54:41.692 INFO:teuthology.orchestra.run.smithi008.stdout: { 2023-08-01T19:54:41.692 INFO:teuthology.orchestra.run.smithi008.stdout: "event": "queued_for_pg", 2023-08-01T19:54:41.692 INFO:teuthology.orchestra.run.smithi008.stdout: "time": "2023-08-01T19:54:41.317358+0000", 2023-08-01T19:54:41.692 INFO:teuthology.orchestra.run.smithi008.stdout: "duration": 4.5310000000000003e-06 2023-08-01T19:54:41.692 INFO:teuthology.orchestra.run.smithi008.stdout: }, 2023-08-01T19:54:41.693 INFO:teuthology.orchestra.run.smithi008.stdout: { 2023-08-01T19:54:41.693 INFO:teuthology.orchestra.run.smithi008.stdout: "event": "reached_pg", 2023-08-01T19:54:41.693 INFO:teuthology.orchestra.run.smithi008.stdout: "time": "2023-08-01T19:54:41.321331+0000", 2023-08-01T19:54:41.693 INFO:teuthology.orchestra.run.smithi008.stdout: "duration": 0.0039731640000000004 2023-08-01T19:54:41.693 INFO:teuthology.orchestra.run.smithi008.stdout: }, 2023-08-01T19:54:41.693 INFO:teuthology.orchestra.run.smithi008.stdout: { 2023-08-01T19:54:41.693 INFO:teuthology.orchestra.run.smithi008.stdout: "event": "started", 2023-08-01T19:54:41.693 INFO:teuthology.orchestra.run.smithi008.stdout: "time": "2023-08-01T19:54:41.321460+0000", 2023-08-01T19:54:41.694 INFO:teuthology.orchestra.run.smithi008.stdout: "duration": 0.000129362 2023-08-01T19:54:41.694 INFO:teuthology.orchestra.run.smithi008.stdout: }, 2023-08-01T19:54:41.694 INFO:teuthology.orchestra.run.smithi008.stdout: { 2023-08-01T19:54:41.694 INFO:teuthology.orchestra.run.smithi008.stdout: "event": "waiting for subops from 1", 2023-08-01T19:54:41.694 INFO:teuthology.orchestra.run.smithi008.stdout: "time": "2023-08-01T19:54:41.321608+0000", 2023-08-01T19:54:41.694 INFO:teuthology.orchestra.run.smithi008.stdout: "duration": 0.000147961 2023-08-01T19:54:41.694 INFO:teuthology.orchestra.run.smithi008.stdout: }, 2023-08-01T19:54:41.694 INFO:teuthology.orchestra.run.smithi008.stdout: { 2023-08-01T19:54:41.695 INFO:teuthology.orchestra.run.smithi008.stdout: "event": "op_commit", 2023-08-01T19:54:41.695 INFO:teuthology.orchestra.run.smithi008.stdout: "time": "2023-08-01T19:54:41.327594+0000", 2023-08-01T19:54:41.695 INFO:teuthology.orchestra.run.smithi008.stdout: "duration": 0.0059854749999999996 2023-08-01T19:54:41.695 INFO:teuthology.orchestra.run.smithi008.stdout: }, 2023-08-01T19:54:41.695 INFO:teuthology.orchestra.run.smithi008.stdout: { 2023-08-01T19:54:41.695 INFO:teuthology.orchestra.run.smithi008.stdout: "event": "sub_op_commit_rec", 2023-08-01T19:54:41.695 INFO:teuthology.orchestra.run.smithi008.stdout: "time": "2023-08-01T19:54:41.330716+0000", 2023-08-01T19:54:41.695 INFO:teuthology.orchestra.run.smithi008.stdout: "duration": 0.0031220369999999998 2023-08-01T19:54:41.696 INFO:teuthology.orchestra.run.smithi008.stdout: }, 2023-08-01T19:54:41.696 INFO:teuthology.orchestra.run.smithi008.stdout: { 2023-08-01T19:54:41.696 INFO:teuthology.orchestra.run.smithi008.stdout: "event": "commit_sent", 2023-08-01T19:54:41.696 INFO:teuthology.orchestra.run.smithi008.stdout: "time": "2023-08-01T19:54:41.330762+0000", 2023-08-01T19:54:41.696 INFO:teuthology.orchestra.run.smithi008.stdout: "duration": 4.5744000000000001e-05 2023-08-01T19:54:41.696 INFO:teuthology.orchestra.run.smithi008.stdout: }, 2023-08-01T19:54:41.696 INFO:teuthology.orchestra.run.smithi008.stdout: { 2023-08-01T19:54:41.696 INFO:teuthology.orchestra.run.smithi008.stdout: "event": "done", 2023-08-01T19:54:41.697 INFO:teuthology.orchestra.run.smithi008.stdout: "time": "2023-08-01T19:54:41.330796+0000", 2023-08-01T19:54:41.697 INFO:teuthology.orchestra.run.smithi008.stdout: "duration": 3.4229e-05 2023-08-01T19:54:41.697 INFO:teuthology.orchestra.run.smithi008.stdout: } 2023-08-01T19:54:41.697 INFO:teuthology.orchestra.run.smithi008.stdout: ] 2023-08-01T19:54:41.697 INFO:teuthology.orchestra.run.smithi008.stdout: } 2023-08-01T19:54:41.697 INFO:teuthology.orchestra.run.smithi008.stdout: } 2023-08-01T19:54:41.697 INFO:teuthology.orchestra.run.smithi008.stdout: ] 2023-08-01T19:54:41.697 INFO:teuthology.orchestra.run.smithi008.stdout:} 2023-08-01T19:54:41.699 DEBUG:teuthology.orchestra.run.smithi101:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 30 ceph --cluster ceph --admin-daemon /var/run/ceph/ceph-osd.1.asok dump_ops_in_flight 2023-08-01T19:54:41.699 INFO:tasks.ceph.osd.0.smithi008.stderr:2023-08-01T19:54:41.698+0000 7f16a58f4700 -1 received signal: Hangup from /usr/bin/python3 /bin/daemon-helper kill ceph-osd -f --cluster ceph -i 0 (PID: 111179) UID: 0 2023-08-01T19:54:41.799 INFO:tasks.ceph.osd.2.smithi155.stderr:2023-08-01T19:54:41.797+0000 7faa5c6ac700 -1 received signal: Hangup from /usr/bin/python3 /bin/daemon-helper kill ceph-osd -f --cluster ceph -i 2 (PID: 111337) UID: 0 2023-08-01T19:54:41.872 INFO:teuthology.orchestra.run.smithi101.stdout:{ 2023-08-01T19:54:41.872 INFO:teuthology.orchestra.run.smithi101.stdout: "ops": [ 2023-08-01T19:54:41.872 INFO:teuthology.orchestra.run.smithi101.stdout: { 2023-08-01T19:54:41.872 INFO:teuthology.orchestra.run.smithi101.stdout: "description": "osd_op(client.4668.0:53534 5.2 5:40f11f23:::benchmark_data_smithi006_114134_object53533:head [set-alloc-hint object_size 65536 write_size 65536,write 0~65536 in=65536b] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e27)", 2023-08-01T19:54:41.872 INFO:teuthology.orchestra.run.smithi101.stdout: "initiated_at": "2023-08-01T19:54:41.863209+0000", 2023-08-01T19:54:41.873 INFO:teuthology.orchestra.run.smithi101.stdout: "age": 0.0073107149999999997, 2023-08-01T19:54:41.873 INFO:teuthology.orchestra.run.smithi101.stdout: "duration": 0.007331616, 2023-08-01T19:54:41.873 INFO:teuthology.orchestra.run.smithi101.stdout: "type_data": { 2023-08-01T19:54:41.873 INFO:teuthology.orchestra.run.smithi101.stdout: "flag_point": "waiting for sub ops", 2023-08-01T19:54:41.873 INFO:teuthology.orchestra.run.smithi101.stdout: "client_info": { 2023-08-01T19:54:41.873 INFO:teuthology.orchestra.run.smithi101.stdout: "client": "client.4668", 2023-08-01T19:54:41.873 INFO:teuthology.orchestra.run.smithi101.stdout: "client_addr": "172.21.15.6:0/1709472247", 2023-08-01T19:54:41.873 INFO:teuthology.orchestra.run.smithi101.stdout: "tid": 53534 2023-08-01T19:54:41.874 INFO:teuthology.orchestra.run.smithi101.stdout: }, 2023-08-01T19:54:41.874 INFO:teuthology.orchestra.run.smithi101.stdout: "events": [ 2023-08-01T19:54:41.874 INFO:teuthology.orchestra.run.smithi101.stdout: { 2023-08-01T19:54:41.874 INFO:teuthology.orchestra.run.smithi101.stdout: "event": "initiated", 2023-08-01T19:54:41.874 INFO:teuthology.orchestra.run.smithi101.stdout: "time": "2023-08-01T19:54:41.863209+0000", 2023-08-01T19:54:41.874 INFO:teuthology.orchestra.run.smithi101.stdout: "duration": 0 2023-08-01T19:54:41.874 INFO:teuthology.orchestra.run.smithi101.stdout: }, 2023-08-01T19:54:41.875 INFO:teuthology.orchestra.run.smithi101.stdout: { 2023-08-01T19:54:41.875 INFO:teuthology.orchestra.run.smithi101.stdout: "event": "throttled", 2023-08-01T19:54:41.875 INFO:teuthology.orchestra.run.smithi101.stdout: "time": "2023-08-01T19:54:41.863209+0000", 2023-08-01T19:54:41.875 INFO:teuthology.orchestra.run.smithi101.stdout: "duration": 0 2023-08-01T19:54:41.875 INFO:teuthology.orchestra.run.smithi101.stdout: }, 2023-08-01T19:54:41.875 INFO:teuthology.orchestra.run.smithi101.stdout: { 2023-08-01T19:54:41.875 INFO:teuthology.orchestra.run.smithi101.stdout: "event": "header_read", 2023-08-01T19:54:41.875 INFO:teuthology.orchestra.run.smithi101.stdout: "time": "2023-08-01T19:54:41.863208+0000", 2023-08-01T19:54:41.876 INFO:teuthology.orchestra.run.smithi101.stdout: "duration": 4294967295.999999 2023-08-01T19:54:41.876 INFO:teuthology.orchestra.run.smithi101.stdout: }, 2023-08-01T19:54:41.876 INFO:teuthology.orchestra.run.smithi101.stdout: { 2023-08-01T19:54:41.876 INFO:teuthology.orchestra.run.smithi101.stdout: "event": "all_read", 2023-08-01T19:54:41.876 INFO:teuthology.orchestra.run.smithi101.stdout: "time": "2023-08-01T19:54:41.863383+0000", 2023-08-01T19:54:41.876 INFO:teuthology.orchestra.run.smithi101.stdout: "duration": 0.00017501499999999999 2023-08-01T19:54:41.876 INFO:teuthology.orchestra.run.smithi101.stdout: }, 2023-08-01T19:54:41.876 INFO:teuthology.orchestra.run.smithi101.stdout: { 2023-08-01T19:54:41.877 INFO:teuthology.orchestra.run.smithi101.stdout: "event": "dispatched", 2023-08-01T19:54:41.877 INFO:teuthology.orchestra.run.smithi101.stdout: "time": "2023-08-01T19:54:41.863397+0000", 2023-08-01T19:54:41.877 INFO:teuthology.orchestra.run.smithi101.stdout: "duration": 1.4137e-05 2023-08-01T19:54:41.877 INFO:teuthology.orchestra.run.smithi101.stdout: }, 2023-08-01T19:54:41.877 INFO:teuthology.orchestra.run.smithi101.stdout: { 2023-08-01T19:54:41.877 INFO:teuthology.orchestra.run.smithi101.stdout: "event": "queued_for_pg", 2023-08-01T19:54:41.877 INFO:teuthology.orchestra.run.smithi101.stdout: "time": "2023-08-01T19:54:41.863405+0000", 2023-08-01T19:54:41.877 INFO:teuthology.orchestra.run.smithi101.stdout: "duration": 7.4630000000000004e-06 2023-08-01T19:54:41.878 INFO:teuthology.orchestra.run.smithi101.stdout: }, 2023-08-01T19:54:41.878 INFO:teuthology.orchestra.run.smithi101.stdout: { 2023-08-01T19:54:41.878 INFO:teuthology.orchestra.run.smithi101.stdout: "event": "reached_pg", 2023-08-01T19:54:41.878 INFO:teuthology.orchestra.run.smithi101.stdout: "time": "2023-08-01T19:54:41.863526+0000", 2023-08-01T19:54:41.878 INFO:teuthology.orchestra.run.smithi101.stdout: "duration": 0.000121495 2023-08-01T19:54:41.878 INFO:teuthology.orchestra.run.smithi101.stdout: }, 2023-08-01T19:54:41.878 INFO:teuthology.orchestra.run.smithi101.stdout: { 2023-08-01T19:54:41.878 INFO:teuthology.orchestra.run.smithi101.stdout: "event": "started", 2023-08-01T19:54:41.879 INFO:teuthology.orchestra.run.smithi101.stdout: "time": "2023-08-01T19:54:41.863614+0000", 2023-08-01T19:54:41.879 INFO:teuthology.orchestra.run.smithi101.stdout: "duration": 8.7579999999999998e-05 2023-08-01T19:54:41.879 INFO:teuthology.orchestra.run.smithi101.stdout: }, 2023-08-01T19:54:41.879 INFO:teuthology.orchestra.run.smithi101.stdout: { 2023-08-01T19:54:41.879 INFO:teuthology.orchestra.run.smithi101.stdout: "event": "waiting for subops from 0", 2023-08-01T19:54:41.879 INFO:teuthology.orchestra.run.smithi101.stdout: "time": "2023-08-01T19:54:41.863688+0000", 2023-08-01T19:54:41.879 INFO:teuthology.orchestra.run.smithi101.stdout: "duration": 7.4590000000000002e-05 2023-08-01T19:54:41.879 INFO:teuthology.orchestra.run.smithi101.stdout: }, 2023-08-01T19:54:41.880 INFO:teuthology.orchestra.run.smithi101.stdout: { 2023-08-01T19:54:41.880 INFO:teuthology.orchestra.run.smithi101.stdout: "event": "op_commit", 2023-08-01T19:54:41.880 INFO:teuthology.orchestra.run.smithi101.stdout: "time": "2023-08-01T19:54:41.868337+0000", 2023-08-01T19:54:41.880 INFO:teuthology.orchestra.run.smithi101.stdout: "duration": 0.0046486039999999998 2023-08-01T19:54:41.880 INFO:teuthology.orchestra.run.smithi101.stdout: } 2023-08-01T19:54:41.880 INFO:teuthology.orchestra.run.smithi101.stdout: ] 2023-08-01T19:54:41.880 INFO:teuthology.orchestra.run.smithi101.stdout: } 2023-08-01T19:54:41.881 INFO:teuthology.orchestra.run.smithi101.stdout: }, 2023-08-01T19:54:41.881 INFO:teuthology.orchestra.run.smithi101.stdout: { 2023-08-01T19:54:41.881 INFO:teuthology.orchestra.run.smithi101.stdout: "description": "osd_op(client.4668.0:53540 5.f 5:f28e87d0:::benchmark_data_smithi006_114134_object53539:head [set-alloc-hint object_size 65536 write_size 65536,write 0~65536 in=65536b] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e27)", 2023-08-01T19:54:41.881 INFO:teuthology.orchestra.run.smithi101.stdout: "initiated_at": "2023-08-01T19:54:41.865990+0000", 2023-08-01T19:54:41.881 INFO:teuthology.orchestra.run.smithi101.stdout: "age": 0.0045293290000000003, 2023-08-01T19:54:41.881 INFO:teuthology.orchestra.run.smithi101.stdout: "duration": 0.0046107869999999999, 2023-08-01T19:54:41.881 INFO:teuthology.orchestra.run.smithi101.stdout: "type_data": { 2023-08-01T19:54:41.881 INFO:teuthology.orchestra.run.smithi101.stdout: "flag_point": "waiting for sub ops", 2023-08-01T19:54:41.882 INFO:teuthology.orchestra.run.smithi101.stdout: "client_info": { 2023-08-01T19:54:41.882 INFO:teuthology.orchestra.run.smithi101.stdout: "client": "client.4668", 2023-08-01T19:54:41.882 INFO:teuthology.orchestra.run.smithi101.stdout: "client_addr": "172.21.15.6:0/1709472247", 2023-08-01T19:54:41.882 INFO:teuthology.orchestra.run.smithi101.stdout: "tid": 53540 2023-08-01T19:54:41.882 INFO:teuthology.orchestra.run.smithi101.stdout: }, 2023-08-01T19:54:41.882 INFO:teuthology.orchestra.run.smithi101.stdout: "events": [ 2023-08-01T19:54:41.882 INFO:teuthology.orchestra.run.smithi101.stdout: { 2023-08-01T19:54:41.882 INFO:teuthology.orchestra.run.smithi101.stdout: "event": "initiated", 2023-08-01T19:54:41.883 INFO:teuthology.orchestra.run.smithi101.stdout: "time": "2023-08-01T19:54:41.865990+0000", 2023-08-01T19:54:41.883 INFO:teuthology.orchestra.run.smithi101.stdout: "duration": 0 2023-08-01T19:54:41.883 INFO:teuthology.orchestra.run.smithi101.stdout: }, 2023-08-01T19:54:41.883 INFO:teuthology.orchestra.run.smithi101.stdout: { 2023-08-01T19:54:41.883 INFO:teuthology.orchestra.run.smithi101.stdout: "event": "throttled", 2023-08-01T19:54:41.883 INFO:teuthology.orchestra.run.smithi101.stdout: "time": "2023-08-01T19:54:41.865990+0000", 2023-08-01T19:54:41.883 INFO:teuthology.orchestra.run.smithi101.stdout: "duration": 0 2023-08-01T19:54:41.883 INFO:teuthology.orchestra.run.smithi101.stdout: }, 2023-08-01T19:54:41.884 INFO:teuthology.orchestra.run.smithi101.stdout: { 2023-08-01T19:54:41.884 INFO:teuthology.orchestra.run.smithi101.stdout: "event": "header_read", 2023-08-01T19:54:41.884 INFO:teuthology.orchestra.run.smithi101.stdout: "time": "2023-08-01T19:54:41.865989+0000", 2023-08-01T19:54:41.884 INFO:teuthology.orchestra.run.smithi101.stdout: "duration": 4294967295.999999 2023-08-01T19:54:41.884 INFO:teuthology.orchestra.run.smithi101.stdout: }, 2023-08-01T19:54:41.884 INFO:teuthology.orchestra.run.smithi101.stdout: { 2023-08-01T19:54:41.884 INFO:teuthology.orchestra.run.smithi101.stdout: "event": "all_read", 2023-08-01T19:54:41.884 INFO:teuthology.orchestra.run.smithi101.stdout: "time": "2023-08-01T19:54:41.866053+0000", 2023-08-01T19:54:41.885 INFO:teuthology.orchestra.run.smithi101.stdout: "duration": 6.3548999999999998e-05 2023-08-01T19:54:41.885 INFO:teuthology.orchestra.run.smithi101.stdout: }, 2023-08-01T19:54:41.885 INFO:teuthology.orchestra.run.smithi101.stdout: { 2023-08-01T19:54:41.885 INFO:teuthology.orchestra.run.smithi101.stdout: "event": "dispatched", 2023-08-01T19:54:41.885 INFO:teuthology.orchestra.run.smithi101.stdout: "time": "2023-08-01T19:54:41.866066+0000", 2023-08-01T19:54:41.885 INFO:teuthology.orchestra.run.smithi101.stdout: "duration": 1.3577000000000001e-05 2023-08-01T19:54:41.885 INFO:teuthology.orchestra.run.smithi101.stdout: }, 2023-08-01T19:54:41.885 INFO:teuthology.orchestra.run.smithi101.stdout: { 2023-08-01T19:54:41.886 INFO:teuthology.orchestra.run.smithi101.stdout: "event": "queued_for_pg", 2023-08-01T19:54:41.886 INFO:teuthology.orchestra.run.smithi101.stdout: "time": "2023-08-01T19:54:41.866073+0000", 2023-08-01T19:54:41.886 INFO:teuthology.orchestra.run.smithi101.stdout: "duration": 6.7859999999999999e-06 2023-08-01T19:54:41.886 INFO:teuthology.orchestra.run.smithi101.stdout: }, 2023-08-01T19:54:41.886 INFO:teuthology.orchestra.run.smithi101.stdout: { 2023-08-01T19:54:41.886 INFO:teuthology.orchestra.run.smithi101.stdout: "event": "reached_pg", 2023-08-01T19:54:41.886 INFO:teuthology.orchestra.run.smithi101.stdout: "time": "2023-08-01T19:54:41.866101+0000", 2023-08-01T19:54:41.887 INFO:teuthology.orchestra.run.smithi101.stdout: "duration": 2.7977999999999999e-05 2023-08-01T19:54:41.887 INFO:teuthology.orchestra.run.smithi101.stdout: }, 2023-08-01T19:54:41.887 INFO:teuthology.orchestra.run.smithi101.stdout: { 2023-08-01T19:54:41.887 INFO:teuthology.orchestra.run.smithi101.stdout: "event": "started", 2023-08-01T19:54:41.887 INFO:teuthology.orchestra.run.smithi101.stdout: "time": "2023-08-01T19:54:41.866193+0000", 2023-08-01T19:54:41.887 INFO:teuthology.orchestra.run.smithi101.stdout: "duration": 9.2274000000000005e-05 2023-08-01T19:54:41.887 INFO:teuthology.orchestra.run.smithi101.stdout: }, 2023-08-01T19:54:41.887 INFO:teuthology.orchestra.run.smithi101.stdout: { 2023-08-01T19:54:41.888 INFO:teuthology.orchestra.run.smithi101.stdout: "event": "waiting for subops from 2", 2023-08-01T19:54:41.888 INFO:teuthology.orchestra.run.smithi101.stdout: "time": "2023-08-01T19:54:41.866315+0000", 2023-08-01T19:54:41.888 INFO:teuthology.orchestra.run.smithi101.stdout: "duration": 0.00012181299999999999 2023-08-01T19:54:41.888 INFO:teuthology.orchestra.run.smithi101.stdout: }, 2023-08-01T19:54:41.888 INFO:teuthology.orchestra.run.smithi101.stdout: { 2023-08-01T19:54:41.888 INFO:teuthology.orchestra.run.smithi101.stdout: "event": "op_commit", 2023-08-01T19:54:41.888 INFO:teuthology.orchestra.run.smithi101.stdout: "time": "2023-08-01T19:54:41.869544+0000", 2023-08-01T19:54:41.888 INFO:teuthology.orchestra.run.smithi101.stdout: "duration": 0.003228851 2023-08-01T19:54:41.889 INFO:teuthology.orchestra.run.smithi101.stdout: } 2023-08-01T19:54:41.889 INFO:teuthology.orchestra.run.smithi101.stdout: ] 2023-08-01T19:54:41.889 INFO:teuthology.orchestra.run.smithi101.stdout: } 2023-08-01T19:54:41.889 INFO:teuthology.orchestra.run.smithi101.stdout: }, 2023-08-01T19:54:41.889 INFO:teuthology.orchestra.run.smithi101.stdout: { 2023-08-01T19:54:41.889 INFO:teuthology.orchestra.run.smithi101.stdout: "description": "osd_op(client.4668.0:53542 5.2 5:43ab41a5:::benchmark_data_smithi006_114134_object53541:head [set-alloc-hint object_size 65536 write_size 65536,write 0~65536 in=65536b] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e27)", 2023-08-01T19:54:41.889 INFO:teuthology.orchestra.run.smithi101.stdout: "initiated_at": "2023-08-01T19:54:41.866083+0000", 2023-08-01T19:54:41.889 INFO:teuthology.orchestra.run.smithi101.stdout: "age": 0.0044366429999999997, 2023-08-01T19:54:41.890 INFO:teuthology.orchestra.run.smithi101.stdout: "duration": 0.0045655210000000003, 2023-08-01T19:54:41.890 INFO:teuthology.orchestra.run.smithi101.stdout: "type_data": { 2023-08-01T19:54:41.890 INFO:teuthology.orchestra.run.smithi101.stdout: "flag_point": "waiting for sub ops", 2023-08-01T19:54:41.890 INFO:teuthology.orchestra.run.smithi101.stdout: "client_info": { 2023-08-01T19:54:41.890 INFO:teuthology.orchestra.run.smithi101.stdout: "client": "client.4668", 2023-08-01T19:54:41.890 INFO:teuthology.orchestra.run.smithi101.stdout: "client_addr": "172.21.15.6:0/1709472247", 2023-08-01T19:54:41.890 INFO:teuthology.orchestra.run.smithi101.stdout: "tid": 53542 2023-08-01T19:54:41.890 INFO:teuthology.orchestra.run.smithi101.stdout: }, 2023-08-01T19:54:41.891 INFO:teuthology.orchestra.run.smithi101.stdout: "events": [ 2023-08-01T19:54:41.891 INFO:teuthology.orchestra.run.smithi101.stdout: { 2023-08-01T19:54:41.891 INFO:teuthology.orchestra.run.smithi101.stdout: "event": "initiated", 2023-08-01T19:54:41.891 INFO:teuthology.orchestra.run.smithi101.stdout: "time": "2023-08-01T19:54:41.866083+0000", 2023-08-01T19:54:41.891 INFO:teuthology.orchestra.run.smithi101.stdout: "duration": 0 2023-08-01T19:54:41.891 INFO:teuthology.orchestra.run.smithi101.stdout: }, 2023-08-01T19:54:41.891 INFO:teuthology.orchestra.run.smithi101.stdout: { 2023-08-01T19:54:41.891 INFO:teuthology.orchestra.run.smithi101.stdout: "event": "throttled", 2023-08-01T19:54:41.892 INFO:teuthology.orchestra.run.smithi101.stdout: "time": "2023-08-01T19:54:41.866083+0000", 2023-08-01T19:54:41.892 INFO:teuthology.orchestra.run.smithi101.stdout: "duration": 0 2023-08-01T19:54:41.892 INFO:teuthology.orchestra.run.smithi101.stdout: }, 2023-08-01T19:54:41.892 INFO:teuthology.orchestra.run.smithi101.stdout: { 2023-08-01T19:54:41.892 INFO:teuthology.orchestra.run.smithi101.stdout: "event": "header_read", 2023-08-01T19:54:41.892 INFO:teuthology.orchestra.run.smithi101.stdout: "time": "2023-08-01T19:54:41.866082+0000", 2023-08-01T19:54:41.892 INFO:teuthology.orchestra.run.smithi101.stdout: "duration": 4294967295.9999995 2023-08-01T19:54:41.892 INFO:teuthology.orchestra.run.smithi101.stdout: }, 2023-08-01T19:54:41.893 INFO:teuthology.orchestra.run.smithi101.stdout: { 2023-08-01T19:54:41.893 INFO:teuthology.orchestra.run.smithi101.stdout: "event": "all_read", 2023-08-01T19:54:41.893 INFO:teuthology.orchestra.run.smithi101.stdout: "time": "2023-08-01T19:54:41.866176+0000", 2023-08-01T19:54:41.893 INFO:teuthology.orchestra.run.smithi101.stdout: "duration": 9.3388999999999996e-05 2023-08-01T19:54:41.893 INFO:teuthology.orchestra.run.smithi101.stdout: }, 2023-08-01T19:54:41.893 INFO:teuthology.orchestra.run.smithi101.stdout: { 2023-08-01T19:54:41.893 INFO:teuthology.orchestra.run.smithi101.stdout: "event": "dispatched", 2023-08-01T19:54:41.893 INFO:teuthology.orchestra.run.smithi101.stdout: "time": "2023-08-01T19:54:41.866186+0000", 2023-08-01T19:54:41.894 INFO:teuthology.orchestra.run.smithi101.stdout: "duration": 1.0603e-05 2023-08-01T19:54:41.894 INFO:teuthology.orchestra.run.smithi101.stdout: }, 2023-08-01T19:54:41.894 INFO:teuthology.orchestra.run.smithi101.stdout: { 2023-08-01T19:54:41.894 INFO:teuthology.orchestra.run.smithi101.stdout: "event": "queued_for_pg", 2023-08-01T19:54:41.894 INFO:teuthology.orchestra.run.smithi101.stdout: "time": "2023-08-01T19:54:41.866192+0000", 2023-08-01T19:54:41.894 INFO:teuthology.orchestra.run.smithi101.stdout: "duration": 5.2859999999999999e-06 2023-08-01T19:54:41.894 INFO:teuthology.orchestra.run.smithi101.stdout: }, 2023-08-01T19:54:41.894 INFO:teuthology.orchestra.run.smithi101.stdout: { 2023-08-01T19:54:41.895 INFO:teuthology.orchestra.run.smithi101.stdout: "event": "reached_pg", 2023-08-01T19:54:41.895 INFO:teuthology.orchestra.run.smithi101.stdout: "time": "2023-08-01T19:54:41.866228+0000", 2023-08-01T19:54:41.895 INFO:teuthology.orchestra.run.smithi101.stdout: "duration": 3.6690000000000003e-05 2023-08-01T19:54:41.895 INFO:teuthology.orchestra.run.smithi101.stdout: }, 2023-08-01T19:54:41.895 INFO:teuthology.orchestra.run.smithi101.stdout: { 2023-08-01T19:54:41.895 INFO:teuthology.orchestra.run.smithi101.stdout: "event": "started", 2023-08-01T19:54:41.895 INFO:teuthology.orchestra.run.smithi101.stdout: "time": "2023-08-01T19:54:41.866339+0000", 2023-08-01T19:54:41.895 INFO:teuthology.orchestra.run.smithi101.stdout: "duration": 0.00011055 2023-08-01T19:54:41.896 INFO:teuthology.orchestra.run.smithi101.stdout: }, 2023-08-01T19:54:41.896 INFO:teuthology.orchestra.run.smithi101.stdout: { 2023-08-01T19:54:41.896 INFO:teuthology.orchestra.run.smithi101.stdout: "event": "waiting for subops from 0", 2023-08-01T19:54:41.896 INFO:teuthology.orchestra.run.smithi101.stdout: "time": "2023-08-01T19:54:41.866474+0000", 2023-08-01T19:54:41.896 INFO:teuthology.orchestra.run.smithi101.stdout: "duration": 0.000135043 2023-08-01T19:54:41.896 INFO:teuthology.orchestra.run.smithi101.stdout: }, 2023-08-01T19:54:41.896 INFO:teuthology.orchestra.run.smithi101.stdout: { 2023-08-01T19:54:41.897 INFO:teuthology.orchestra.run.smithi101.stdout: "event": "op_commit", 2023-08-01T19:54:41.897 INFO:teuthology.orchestra.run.smithi101.stdout: "time": "2023-08-01T19:54:41.869572+0000", 2023-08-01T19:54:41.897 INFO:teuthology.orchestra.run.smithi101.stdout: "duration": 0.0030984509999999999 2023-08-01T19:54:41.897 INFO:teuthology.orchestra.run.smithi101.stdout: } 2023-08-01T19:54:41.897 INFO:teuthology.orchestra.run.smithi101.stdout: ] 2023-08-01T19:54:41.897 INFO:teuthology.orchestra.run.smithi101.stdout: } 2023-08-01T19:54:41.897 INFO:teuthology.orchestra.run.smithi101.stdout: }, 2023-08-01T19:54:41.897 INFO:teuthology.orchestra.run.smithi101.stdout: { 2023-08-01T19:54:41.898 INFO:teuthology.orchestra.run.smithi101.stdout: "description": "osd_op(client.4668.0:53543 5.9 5:93ec029f:::benchmark_data_smithi006_114134_object53542:head [set-alloc-hint object_size 65536 write_size 65536,write 0~65536 in=65536b] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e27)", 2023-08-01T19:54:41.898 INFO:teuthology.orchestra.run.smithi101.stdout: "initiated_at": "2023-08-01T19:54:41.866206+0000", 2023-08-01T19:54:41.898 INFO:teuthology.orchestra.run.smithi101.stdout: "age": 0.004313211, 2023-08-01T19:54:41.898 INFO:teuthology.orchestra.run.smithi101.stdout: "duration": 0.0044884540000000002, 2023-08-01T19:54:41.898 INFO:teuthology.orchestra.run.smithi101.stdout: "type_data": { 2023-08-01T19:54:41.898 INFO:teuthology.orchestra.run.smithi101.stdout: "flag_point": "waiting for sub ops", 2023-08-01T19:54:41.898 INFO:teuthology.orchestra.run.smithi101.stdout: "client_info": { 2023-08-01T19:54:41.898 INFO:teuthology.orchestra.run.smithi101.stdout: "client": "client.4668", 2023-08-01T19:54:41.899 INFO:teuthology.orchestra.run.smithi101.stdout: "client_addr": "172.21.15.6:0/1709472247", 2023-08-01T19:54:41.899 INFO:teuthology.orchestra.run.smithi101.stdout: "tid": 53543 2023-08-01T19:54:41.899 INFO:teuthology.orchestra.run.smithi101.stdout: }, 2023-08-01T19:54:41.899 INFO:teuthology.orchestra.run.smithi101.stdout: "events": [ 2023-08-01T19:54:41.899 INFO:teuthology.orchestra.run.smithi101.stdout: { 2023-08-01T19:54:41.899 INFO:teuthology.orchestra.run.smithi101.stdout: "event": "initiated", 2023-08-01T19:54:41.899 INFO:teuthology.orchestra.run.smithi101.stdout: "time": "2023-08-01T19:54:41.866206+0000", 2023-08-01T19:54:41.899 INFO:teuthology.orchestra.run.smithi101.stdout: "duration": 0 2023-08-01T19:54:41.900 INFO:teuthology.orchestra.run.smithi101.stdout: }, 2023-08-01T19:54:41.900 INFO:teuthology.orchestra.run.smithi101.stdout: { 2023-08-01T19:54:41.900 INFO:teuthology.orchestra.run.smithi101.stdout: "event": "throttled", 2023-08-01T19:54:41.900 INFO:teuthology.orchestra.run.smithi101.stdout: "time": "2023-08-01T19:54:41.866206+0000", 2023-08-01T19:54:41.900 INFO:teuthology.orchestra.run.smithi101.stdout: "duration": 0 2023-08-01T19:54:41.900 INFO:teuthology.orchestra.run.smithi101.stdout: }, 2023-08-01T19:54:41.900 INFO:teuthology.orchestra.run.smithi101.stdout: { 2023-08-01T19:54:41.900 INFO:teuthology.orchestra.run.smithi101.stdout: "event": "header_read", 2023-08-01T19:54:41.901 INFO:teuthology.orchestra.run.smithi101.stdout: "time": "2023-08-01T19:54:41.866206+0000", 2023-08-01T19:54:41.901 INFO:teuthology.orchestra.run.smithi101.stdout: "duration": 4294967295.9999995 2023-08-01T19:54:41.901 INFO:teuthology.orchestra.run.smithi101.stdout: }, 2023-08-01T19:54:41.901 INFO:teuthology.orchestra.run.smithi101.stdout: { 2023-08-01T19:54:41.901 INFO:teuthology.orchestra.run.smithi101.stdout: "event": "all_read", 2023-08-01T19:54:41.901 INFO:teuthology.orchestra.run.smithi101.stdout: "time": "2023-08-01T19:54:41.866233+0000", 2023-08-01T19:54:41.901 INFO:teuthology.orchestra.run.smithi101.stdout: "duration": 2.7387000000000001e-05 2023-08-01T19:54:41.901 INFO:teuthology.orchestra.run.smithi101.stdout: }, 2023-08-01T19:54:41.902 INFO:teuthology.orchestra.run.smithi101.stdout: { 2023-08-01T19:54:41.902 INFO:teuthology.orchestra.run.smithi101.stdout: "event": "dispatched", 2023-08-01T19:54:41.902 INFO:teuthology.orchestra.run.smithi101.stdout: "time": "2023-08-01T19:54:41.866243+0000", 2023-08-01T19:54:41.902 INFO:teuthology.orchestra.run.smithi101.stdout: "duration": 9.6409999999999997e-06 2023-08-01T19:54:41.902 INFO:teuthology.orchestra.run.smithi101.stdout: }, 2023-08-01T19:54:41.902 INFO:teuthology.orchestra.run.smithi101.stdout: { 2023-08-01T19:54:41.902 INFO:teuthology.orchestra.run.smithi101.stdout: "event": "queued_for_pg", 2023-08-01T19:54:41.902 INFO:teuthology.orchestra.run.smithi101.stdout: "time": "2023-08-01T19:54:41.866248+0000", 2023-08-01T19:54:41.903 INFO:teuthology.orchestra.run.smithi101.stdout: "duration": 5.0359999999999997e-06 2023-08-01T19:54:41.903 INFO:teuthology.orchestra.run.smithi101.stdout: }, 2023-08-01T19:54:41.903 INFO:teuthology.orchestra.run.smithi101.stdout: { 2023-08-01T19:54:41.903 INFO:teuthology.orchestra.run.smithi101.stdout: "event": "reached_pg", 2023-08-01T19:54:41.903 INFO:teuthology.orchestra.run.smithi101.stdout: "time": "2023-08-01T19:54:41.866621+0000", 2023-08-01T19:54:41.903 INFO:teuthology.orchestra.run.smithi101.stdout: "duration": 0.00037351700000000002 2023-08-01T19:54:41.903 INFO:teuthology.orchestra.run.smithi101.stdout: }, 2023-08-01T19:54:41.903 INFO:teuthology.orchestra.run.smithi101.stdout: { 2023-08-01T19:54:41.904 INFO:teuthology.orchestra.run.smithi101.stdout: "event": "started", 2023-08-01T19:54:41.904 INFO:teuthology.orchestra.run.smithi101.stdout: "time": "2023-08-01T19:54:41.866756+0000", 2023-08-01T19:54:41.904 INFO:teuthology.orchestra.run.smithi101.stdout: "duration": 0.00013475499999999999 2023-08-01T19:54:41.904 INFO:teuthology.orchestra.run.smithi101.stdout: }, 2023-08-01T19:54:41.904 INFO:teuthology.orchestra.run.smithi101.stdout: { 2023-08-01T19:54:41.904 INFO:teuthology.orchestra.run.smithi101.stdout: "event": "waiting for subops from 2", 2023-08-01T19:54:41.904 INFO:teuthology.orchestra.run.smithi101.stdout: "time": "2023-08-01T19:54:41.866888+0000", 2023-08-01T19:54:41.905 INFO:teuthology.orchestra.run.smithi101.stdout: "duration": 0.00013148500000000001 2023-08-01T19:54:41.905 INFO:teuthology.orchestra.run.smithi101.stdout: }, 2023-08-01T19:54:41.905 INFO:teuthology.orchestra.run.smithi101.stdout: { 2023-08-01T19:54:41.905 INFO:teuthology.orchestra.run.smithi101.stdout: "event": "op_commit", 2023-08-01T19:54:41.905 INFO:teuthology.orchestra.run.smithi101.stdout: "time": "2023-08-01T19:54:41.870404+0000", 2023-08-01T19:54:41.905 INFO:teuthology.orchestra.run.smithi101.stdout: "duration": 0.0035163299999999998 2023-08-01T19:54:41.905 INFO:teuthology.orchestra.run.smithi101.stdout: } 2023-08-01T19:54:41.905 INFO:teuthology.orchestra.run.smithi101.stdout: ] 2023-08-01T19:54:41.906 INFO:teuthology.orchestra.run.smithi101.stdout: } 2023-08-01T19:54:41.906 INFO:teuthology.orchestra.run.smithi101.stdout: }, 2023-08-01T19:54:41.906 INFO:teuthology.orchestra.run.smithi101.stdout: { 2023-08-01T19:54:41.906 INFO:teuthology.orchestra.run.smithi101.stdout: "description": "osd_op(client.4668.0:53544 5.7 5:e9acd3fc:::benchmark_data_smithi006_114134_object53543:head [set-alloc-hint object_size 65536 write_size 65536,write 0~65536 in=65536b] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e27)", 2023-08-01T19:54:41.906 INFO:teuthology.orchestra.run.smithi101.stdout: "initiated_at": "2023-08-01T19:54:41.866255+0000", 2023-08-01T19:54:41.906 INFO:teuthology.orchestra.run.smithi101.stdout: "age": 0.0042647350000000004, 2023-08-01T19:54:41.906 INFO:teuthology.orchestra.run.smithi101.stdout: "duration": 0.0044852679999999997, 2023-08-01T19:54:41.906 INFO:teuthology.orchestra.run.smithi101.stdout: "type_data": { 2023-08-01T19:54:41.907 INFO:teuthology.orchestra.run.smithi101.stdout: "flag_point": "waiting for sub ops", 2023-08-01T19:54:41.907 INFO:teuthology.orchestra.run.smithi101.stdout: "client_info": { 2023-08-01T19:54:41.907 INFO:teuthology.orchestra.run.smithi101.stdout: "client": "client.4668", 2023-08-01T19:54:41.907 INFO:teuthology.orchestra.run.smithi101.stdout: "client_addr": "172.21.15.6:0/1709472247", 2023-08-01T19:54:41.907 INFO:teuthology.orchestra.run.smithi101.stdout: "tid": 53544 2023-08-01T19:54:41.907 INFO:teuthology.orchestra.run.smithi101.stdout: }, 2023-08-01T19:54:41.907 INFO:teuthology.orchestra.run.smithi101.stdout: "events": [ 2023-08-01T19:54:41.907 INFO:teuthology.orchestra.run.smithi101.stdout: { 2023-08-01T19:54:41.908 INFO:teuthology.orchestra.run.smithi101.stdout: "event": "initiated", 2023-08-01T19:54:41.908 INFO:teuthology.orchestra.run.smithi101.stdout: "time": "2023-08-01T19:54:41.866255+0000", 2023-08-01T19:54:41.908 INFO:teuthology.orchestra.run.smithi101.stdout: "duration": 0 2023-08-01T19:54:41.908 INFO:teuthology.orchestra.run.smithi101.stdout: }, 2023-08-01T19:54:41.908 INFO:teuthology.orchestra.run.smithi101.stdout: { 2023-08-01T19:54:41.908 INFO:teuthology.orchestra.run.smithi101.stdout: "event": "throttled", 2023-08-01T19:54:41.908 INFO:teuthology.orchestra.run.smithi101.stdout: "time": "2023-08-01T19:54:41.866255+0000", 2023-08-01T19:54:41.908 INFO:teuthology.orchestra.run.smithi101.stdout: "duration": 0 2023-08-01T19:54:41.909 INFO:teuthology.orchestra.run.smithi101.stdout: }, 2023-08-01T19:54:41.909 INFO:teuthology.orchestra.run.smithi101.stdout: { 2023-08-01T19:54:41.909 INFO:teuthology.orchestra.run.smithi101.stdout: "event": "header_read", 2023-08-01T19:54:41.909 INFO:teuthology.orchestra.run.smithi101.stdout: "time": "2023-08-01T19:54:41.866254+0000", 2023-08-01T19:54:41.909 INFO:teuthology.orchestra.run.smithi101.stdout: "duration": 4294967295.9999995 2023-08-01T19:54:41.909 INFO:teuthology.orchestra.run.smithi101.stdout: }, 2023-08-01T19:54:41.909 INFO:teuthology.orchestra.run.smithi101.stdout: { 2023-08-01T19:54:41.909 INFO:teuthology.orchestra.run.smithi101.stdout: "event": "all_read", 2023-08-01T19:54:41.910 INFO:teuthology.orchestra.run.smithi101.stdout: "time": "2023-08-01T19:54:41.866288+0000", 2023-08-01T19:54:41.910 INFO:teuthology.orchestra.run.smithi101.stdout: "duration": 3.3522999999999997e-05 2023-08-01T19:54:41.910 INFO:teuthology.orchestra.run.smithi101.stdout: }, 2023-08-01T19:54:41.910 INFO:teuthology.orchestra.run.smithi101.stdout: { 2023-08-01T19:54:41.910 INFO:teuthology.orchestra.run.smithi101.stdout: "event": "dispatched", 2023-08-01T19:54:41.910 INFO:teuthology.orchestra.run.smithi101.stdout: "time": "2023-08-01T19:54:41.866296+0000", 2023-08-01T19:54:41.910 INFO:teuthology.orchestra.run.smithi101.stdout: "duration": 7.7829999999999999e-06 2023-08-01T19:54:41.910 INFO:teuthology.orchestra.run.smithi101.stdout: }, 2023-08-01T19:54:41.911 INFO:teuthology.orchestra.run.smithi101.stdout: { 2023-08-01T19:54:41.911 INFO:teuthology.orchestra.run.smithi101.stdout: "event": "queued_for_pg", 2023-08-01T19:54:41.911 INFO:teuthology.orchestra.run.smithi101.stdout: "time": "2023-08-01T19:54:41.866300+0000", 2023-08-01T19:54:41.911 INFO:teuthology.orchestra.run.smithi101.stdout: "duration": 4.4340000000000002e-06 2023-08-01T19:54:41.911 INFO:teuthology.orchestra.run.smithi101.stdout: }, 2023-08-01T19:54:41.911 INFO:teuthology.orchestra.run.smithi101.stdout: { 2023-08-01T19:54:41.911 INFO:teuthology.orchestra.run.smithi101.stdout: "event": "reached_pg", 2023-08-01T19:54:41.911 INFO:teuthology.orchestra.run.smithi101.stdout: "time": "2023-08-01T19:54:41.866332+0000", 2023-08-01T19:54:41.912 INFO:teuthology.orchestra.run.smithi101.stdout: "duration": 3.2002000000000003e-05 2023-08-01T19:54:41.912 INFO:teuthology.orchestra.run.smithi101.stdout: }, 2023-08-01T19:54:41.912 INFO:teuthology.orchestra.run.smithi101.stdout: { 2023-08-01T19:54:41.912 INFO:teuthology.orchestra.run.smithi101.stdout: "event": "started", 2023-08-01T19:54:41.912 INFO:teuthology.orchestra.run.smithi101.stdout: "time": "2023-08-01T19:54:41.866444+0000", 2023-08-01T19:54:41.912 INFO:teuthology.orchestra.run.smithi101.stdout: "duration": 0.000111933 2023-08-01T19:54:41.912 INFO:teuthology.orchestra.run.smithi101.stdout: }, 2023-08-01T19:54:41.912 INFO:teuthology.orchestra.run.smithi101.stdout: { 2023-08-01T19:54:41.913 INFO:teuthology.orchestra.run.smithi101.stdout: "event": "waiting for subops from 0", 2023-08-01T19:54:41.913 INFO:teuthology.orchestra.run.smithi101.stdout: "time": "2023-08-01T19:54:41.866568+0000", 2023-08-01T19:54:41.913 INFO:teuthology.orchestra.run.smithi101.stdout: "duration": 0.00012405399999999999 2023-08-01T19:54:41.913 INFO:teuthology.orchestra.run.smithi101.stdout: }, 2023-08-01T19:54:41.913 INFO:teuthology.orchestra.run.smithi101.stdout: { 2023-08-01T19:54:41.913 INFO:teuthology.orchestra.run.smithi101.stdout: "event": "op_commit", 2023-08-01T19:54:41.913 INFO:teuthology.orchestra.run.smithi101.stdout: "time": "2023-08-01T19:54:41.869584+0000", 2023-08-01T19:54:41.914 INFO:teuthology.orchestra.run.smithi101.stdout: "duration": 0.0030157930000000001 2023-08-01T19:54:41.914 INFO:teuthology.orchestra.run.smithi101.stdout: } 2023-08-01T19:54:41.914 INFO:teuthology.orchestra.run.smithi101.stdout: ] 2023-08-01T19:54:41.914 INFO:teuthology.orchestra.run.smithi101.stdout: } 2023-08-01T19:54:41.914 INFO:teuthology.orchestra.run.smithi101.stdout: }, 2023-08-01T19:54:41.914 INFO:teuthology.orchestra.run.smithi101.stdout: { 2023-08-01T19:54:41.914 INFO:teuthology.orchestra.run.smithi101.stdout: "description": "osd_repop(client.4668.0:53548 5.3 e27/19 5:c94c1663:::benchmark_data_smithi006_114134_object53547:head v 27'3363, mlcod=27'3361)", 2023-08-01T19:54:41.914 INFO:teuthology.orchestra.run.smithi101.stdout: "initiated_at": "2023-08-01T19:54:41.869383+0000", 2023-08-01T19:54:41.915 INFO:teuthology.orchestra.run.smithi101.stdout: "age": 0.0011370359999999999, 2023-08-01T19:54:41.915 INFO:teuthology.orchestra.run.smithi101.stdout: "duration": 0.001401458, 2023-08-01T19:54:41.915 INFO:teuthology.orchestra.run.smithi101.stdout: "type_data": { 2023-08-01T19:54:41.915 INFO:teuthology.orchestra.run.smithi101.stdout: "flag_point": "started", 2023-08-01T19:54:41.915 INFO:teuthology.orchestra.run.smithi101.stdout: "events": [ 2023-08-01T19:54:41.915 INFO:teuthology.orchestra.run.smithi101.stdout: { 2023-08-01T19:54:41.915 INFO:teuthology.orchestra.run.smithi101.stdout: "event": "initiated", 2023-08-01T19:54:41.915 INFO:teuthology.orchestra.run.smithi101.stdout: "time": "2023-08-01T19:54:41.869383+0000", 2023-08-01T19:54:41.916 INFO:teuthology.orchestra.run.smithi101.stdout: "duration": 0 2023-08-01T19:54:41.916 INFO:teuthology.orchestra.run.smithi101.stdout: }, 2023-08-01T19:54:41.916 INFO:teuthology.orchestra.run.smithi101.stdout: { 2023-08-01T19:54:41.916 INFO:teuthology.orchestra.run.smithi101.stdout: "event": "throttled", 2023-08-01T19:54:41.916 INFO:teuthology.orchestra.run.smithi101.stdout: "time": "2023-08-01T19:54:41.869383+0000", 2023-08-01T19:54:41.916 INFO:teuthology.orchestra.run.smithi101.stdout: "duration": 0 2023-08-01T19:54:41.916 INFO:teuthology.orchestra.run.smithi101.stdout: }, 2023-08-01T19:54:41.916 INFO:teuthology.orchestra.run.smithi101.stdout: { 2023-08-01T19:54:41.917 INFO:teuthology.orchestra.run.smithi101.stdout: "event": "header_read", 2023-08-01T19:54:41.917 INFO:teuthology.orchestra.run.smithi101.stdout: "time": "2023-08-01T19:54:41.869382+0000", 2023-08-01T19:54:41.917 INFO:teuthology.orchestra.run.smithi101.stdout: "duration": 4294967295.9999995 2023-08-01T19:54:41.917 INFO:teuthology.orchestra.run.smithi101.stdout: }, 2023-08-01T19:54:41.917 INFO:teuthology.orchestra.run.smithi101.stdout: { 2023-08-01T19:54:41.917 INFO:teuthology.orchestra.run.smithi101.stdout: "event": "all_read", 2023-08-01T19:54:41.917 INFO:teuthology.orchestra.run.smithi101.stdout: "time": "2023-08-01T19:54:41.869422+0000", 2023-08-01T19:54:41.917 INFO:teuthology.orchestra.run.smithi101.stdout: "duration": 3.9437000000000002e-05 2023-08-01T19:54:41.918 INFO:teuthology.orchestra.run.smithi101.stdout: }, 2023-08-01T19:54:41.918 INFO:teuthology.orchestra.run.smithi101.stdout: { 2023-08-01T19:54:41.918 INFO:teuthology.orchestra.run.smithi101.stdout: "event": "dispatched", 2023-08-01T19:54:41.918 INFO:teuthology.orchestra.run.smithi101.stdout: "time": "2023-08-01T19:54:41.869430+0000", 2023-08-01T19:54:41.918 INFO:teuthology.orchestra.run.smithi101.stdout: "duration": 8.2879999999999993e-06 2023-08-01T19:54:41.918 INFO:teuthology.orchestra.run.smithi101.stdout: }, 2023-08-01T19:54:41.918 INFO:teuthology.orchestra.run.smithi101.stdout: { 2023-08-01T19:54:41.918 INFO:teuthology.orchestra.run.smithi101.stdout: "event": "queued_for_pg", 2023-08-01T19:54:41.919 INFO:teuthology.orchestra.run.smithi101.stdout: "time": "2023-08-01T19:54:41.869434+0000", 2023-08-01T19:54:41.919 INFO:teuthology.orchestra.run.smithi101.stdout: "duration": 4.0500000000000002e-06 2023-08-01T19:54:41.919 INFO:teuthology.orchestra.run.smithi101.stdout: }, 2023-08-01T19:54:41.919 INFO:teuthology.orchestra.run.smithi101.stdout: { 2023-08-01T19:54:41.919 INFO:teuthology.orchestra.run.smithi101.stdout: "event": "reached_pg", 2023-08-01T19:54:41.919 INFO:teuthology.orchestra.run.smithi101.stdout: "time": "2023-08-01T19:54:41.869466+0000", 2023-08-01T19:54:41.919 INFO:teuthology.orchestra.run.smithi101.stdout: "duration": 3.1814999999999999e-05 2023-08-01T19:54:41.919 INFO:teuthology.orchestra.run.smithi101.stdout: }, 2023-08-01T19:54:41.920 INFO:teuthology.orchestra.run.smithi101.stdout: { 2023-08-01T19:54:41.920 INFO:teuthology.orchestra.run.smithi101.stdout: "event": "started", 2023-08-01T19:54:41.920 INFO:teuthology.orchestra.run.smithi101.stdout: "time": "2023-08-01T19:54:41.869479+0000", 2023-08-01T19:54:41.920 INFO:teuthology.orchestra.run.smithi101.stdout: "duration": 1.3304e-05 2023-08-01T19:54:41.920 INFO:teuthology.orchestra.run.smithi101.stdout: } 2023-08-01T19:54:41.920 INFO:teuthology.orchestra.run.smithi101.stdout: ] 2023-08-01T19:54:41.920 INFO:teuthology.orchestra.run.smithi101.stdout: } 2023-08-01T19:54:41.920 INFO:teuthology.orchestra.run.smithi101.stdout: }, 2023-08-01T19:54:41.921 INFO:teuthology.orchestra.run.smithi101.stdout: { 2023-08-01T19:54:41.921 INFO:teuthology.orchestra.run.smithi101.stdout: "description": "osd_op(client.4668.0:53550 5.2 5:4d14991f:::benchmark_data_smithi006_114134_object53549:head [set-alloc-hint object_size 65536 write_size 65536,write 0~65536 in=65536b] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e27)", 2023-08-01T19:54:41.921 INFO:teuthology.orchestra.run.smithi101.stdout: "initiated_at": "2023-08-01T19:54:41.869543+0000", 2023-08-01T19:54:41.921 INFO:teuthology.orchestra.run.smithi101.stdout: "age": 0.00097651900000000002, 2023-08-01T19:54:41.921 INFO:teuthology.orchestra.run.smithi101.stdout: "duration": 0.001300729, 2023-08-01T19:54:41.921 INFO:teuthology.orchestra.run.smithi101.stdout: "type_data": { 2023-08-01T19:54:41.921 INFO:teuthology.orchestra.run.smithi101.stdout: "flag_point": "waiting for sub ops", 2023-08-01T19:54:41.921 INFO:teuthology.orchestra.run.smithi101.stdout: "client_info": { 2023-08-01T19:54:41.922 INFO:teuthology.orchestra.run.smithi101.stdout: "client": "client.4668", 2023-08-01T19:54:41.922 INFO:teuthology.orchestra.run.smithi101.stdout: "client_addr": "172.21.15.6:0/1709472247", 2023-08-01T19:54:41.922 INFO:teuthology.orchestra.run.smithi101.stdout: "tid": 53550 2023-08-01T19:54:41.922 INFO:teuthology.orchestra.run.smithi101.stdout: }, 2023-08-01T19:54:41.922 INFO:teuthology.orchestra.run.smithi101.stdout: "events": [ 2023-08-01T19:54:41.922 INFO:teuthology.orchestra.run.smithi101.stdout: { 2023-08-01T19:54:41.922 INFO:teuthology.orchestra.run.smithi101.stdout: "event": "initiated", 2023-08-01T19:54:41.922 INFO:teuthology.orchestra.run.smithi101.stdout: "time": "2023-08-01T19:54:41.869543+0000", 2023-08-01T19:54:41.923 INFO:teuthology.orchestra.run.smithi101.stdout: "duration": 0 2023-08-01T19:54:41.923 INFO:teuthology.orchestra.run.smithi101.stdout: }, 2023-08-01T19:54:41.923 INFO:teuthology.orchestra.run.smithi101.stdout: { 2023-08-01T19:54:41.923 INFO:teuthology.orchestra.run.smithi101.stdout: "event": "throttled", 2023-08-01T19:54:41.923 INFO:teuthology.orchestra.run.smithi101.stdout: "time": "2023-08-01T19:54:41.869543+0000", 2023-08-01T19:54:41.923 INFO:teuthology.orchestra.run.smithi101.stdout: "duration": 0 2023-08-01T19:54:41.923 INFO:teuthology.orchestra.run.smithi101.stdout: }, 2023-08-01T19:54:41.923 INFO:teuthology.orchestra.run.smithi101.stdout: { 2023-08-01T19:54:41.924 INFO:teuthology.orchestra.run.smithi101.stdout: "event": "header_read", 2023-08-01T19:54:41.924 INFO:teuthology.orchestra.run.smithi101.stdout: "time": "2023-08-01T19:54:41.869542+0000", 2023-08-01T19:54:41.924 INFO:teuthology.orchestra.run.smithi101.stdout: "duration": 4294967295.999999 2023-08-01T19:54:41.924 INFO:teuthology.orchestra.run.smithi101.stdout: }, 2023-08-01T19:54:41.924 INFO:teuthology.orchestra.run.smithi101.stdout: { 2023-08-01T19:54:41.924 INFO:teuthology.orchestra.run.smithi101.stdout: "event": "all_read", 2023-08-01T19:54:41.924 INFO:teuthology.orchestra.run.smithi101.stdout: "time": "2023-08-01T19:54:41.869588+0000", 2023-08-01T19:54:41.925 INFO:teuthology.orchestra.run.smithi101.stdout: "duration": 4.5952000000000003e-05 2023-08-01T19:54:41.925 INFO:teuthology.orchestra.run.smithi101.stdout: }, 2023-08-01T19:54:41.925 INFO:teuthology.orchestra.run.smithi101.stdout: { 2023-08-01T19:54:41.925 INFO:teuthology.orchestra.run.smithi101.stdout: "event": "dispatched", 2023-08-01T19:54:41.925 INFO:teuthology.orchestra.run.smithi101.stdout: "time": "2023-08-01T19:54:41.869599+0000", 2023-08-01T19:54:41.925 INFO:teuthology.orchestra.run.smithi101.stdout: "duration": 1.0750999999999999e-05 2023-08-01T19:54:41.925 INFO:teuthology.orchestra.run.smithi101.stdout: }, 2023-08-01T19:54:41.925 INFO:teuthology.orchestra.run.smithi101.stdout: { 2023-08-01T19:54:41.926 INFO:teuthology.orchestra.run.smithi101.stdout: "event": "queued_for_pg", 2023-08-01T19:54:41.926 INFO:teuthology.orchestra.run.smithi101.stdout: "time": "2023-08-01T19:54:41.869607+0000", 2023-08-01T19:54:41.926 INFO:teuthology.orchestra.run.smithi101.stdout: "duration": 8.1159999999999999e-06 2023-08-01T19:54:41.926 INFO:teuthology.orchestra.run.smithi101.stdout: }, 2023-08-01T19:54:41.926 INFO:teuthology.orchestra.run.smithi101.stdout: { 2023-08-01T19:54:41.926 INFO:teuthology.orchestra.run.smithi101.stdout: "event": "reached_pg", 2023-08-01T19:54:41.926 INFO:teuthology.orchestra.run.smithi101.stdout: "time": "2023-08-01T19:54:41.869640+0000", 2023-08-01T19:54:41.926 INFO:teuthology.orchestra.run.smithi101.stdout: "duration": 3.2829e-05 2023-08-01T19:54:41.927 INFO:teuthology.orchestra.run.smithi101.stdout: }, 2023-08-01T19:54:41.927 INFO:teuthology.orchestra.run.smithi101.stdout: { 2023-08-01T19:54:41.927 INFO:teuthology.orchestra.run.smithi101.stdout: "event": "started", 2023-08-01T19:54:41.927 INFO:teuthology.orchestra.run.smithi101.stdout: "time": "2023-08-01T19:54:41.869770+0000", 2023-08-01T19:54:41.927 INFO:teuthology.orchestra.run.smithi101.stdout: "duration": 0.00013072100000000001 2023-08-01T19:54:41.927 INFO:teuthology.orchestra.run.smithi101.stdout: }, 2023-08-01T19:54:41.927 INFO:teuthology.orchestra.run.smithi101.stdout: { 2023-08-01T19:54:41.927 INFO:teuthology.orchestra.run.smithi101.stdout: "event": "waiting for subops from 0", 2023-08-01T19:54:41.928 INFO:teuthology.orchestra.run.smithi101.stdout: "time": "2023-08-01T19:54:41.869911+0000", 2023-08-01T19:54:41.928 INFO:teuthology.orchestra.run.smithi101.stdout: "duration": 0.00014041100000000001 2023-08-01T19:54:41.928 INFO:teuthology.orchestra.run.smithi101.stdout: } 2023-08-01T19:54:41.928 INFO:teuthology.orchestra.run.smithi101.stdout: ] 2023-08-01T19:54:41.928 INFO:teuthology.orchestra.run.smithi101.stdout: } 2023-08-01T19:54:41.928 INFO:teuthology.orchestra.run.smithi101.stdout: }, 2023-08-01T19:54:41.928 INFO:teuthology.orchestra.run.smithi101.stdout: { 2023-08-01T19:54:41.928 INFO:teuthology.orchestra.run.smithi101.stdout: "description": "osd_repop_reply(client.4668.0:53540 5.f e27/19)", 2023-08-01T19:54:41.929 INFO:teuthology.orchestra.run.smithi101.stdout: "initiated_at": "2023-08-01T19:54:41.870872+0000", 2023-08-01T19:54:41.929 INFO:teuthology.orchestra.run.smithi101.stdout: "age": 4294967295.9996476, 2023-08-01T19:54:41.929 INFO:teuthology.orchestra.run.smithi101.stdout: "duration": 5.3492999999999998e-05, 2023-08-01T19:54:41.929 INFO:teuthology.orchestra.run.smithi101.stdout: "type_data": { 2023-08-01T19:54:41.929 INFO:teuthology.orchestra.run.smithi101.stdout: "flag_point": "started", 2023-08-01T19:54:41.929 INFO:teuthology.orchestra.run.smithi101.stdout: "events": [ 2023-08-01T19:54:41.929 INFO:teuthology.orchestra.run.smithi101.stdout: { 2023-08-01T19:54:41.929 INFO:teuthology.orchestra.run.smithi101.stdout: "event": "initiated", 2023-08-01T19:54:41.930 INFO:teuthology.orchestra.run.smithi101.stdout: "time": "2023-08-01T19:54:41.870872+0000", 2023-08-01T19:54:41.930 INFO:teuthology.orchestra.run.smithi101.stdout: "duration": 0 2023-08-01T19:54:41.930 INFO:teuthology.orchestra.run.smithi101.stdout: }, 2023-08-01T19:54:41.930 INFO:teuthology.orchestra.run.smithi101.stdout: { 2023-08-01T19:54:41.930 INFO:teuthology.orchestra.run.smithi101.stdout: "event": "throttled", 2023-08-01T19:54:41.930 INFO:teuthology.orchestra.run.smithi101.stdout: "time": "2023-08-01T19:54:41.870872+0000", 2023-08-01T19:54:41.930 INFO:teuthology.orchestra.run.smithi101.stdout: "duration": 0 2023-08-01T19:54:41.930 INFO:teuthology.orchestra.run.smithi101.stdout: }, 2023-08-01T19:54:41.931 INFO:teuthology.orchestra.run.smithi101.stdout: { 2023-08-01T19:54:41.931 INFO:teuthology.orchestra.run.smithi101.stdout: "event": "header_read", 2023-08-01T19:54:41.931 INFO:teuthology.orchestra.run.smithi101.stdout: "time": "2023-08-01T19:54:41.870871+0000", 2023-08-01T19:54:41.931 INFO:teuthology.orchestra.run.smithi101.stdout: "duration": 4294967295.9999995 2023-08-01T19:54:41.931 INFO:teuthology.orchestra.run.smithi101.stdout: }, 2023-08-01T19:54:41.931 INFO:teuthology.orchestra.run.smithi101.stdout: { 2023-08-01T19:54:41.931 INFO:teuthology.orchestra.run.smithi101.stdout: "event": "all_read", 2023-08-01T19:54:41.931 INFO:teuthology.orchestra.run.smithi101.stdout: "time": "2023-08-01T19:54:41.870875+0000", 2023-08-01T19:54:41.932 INFO:teuthology.orchestra.run.smithi101.stdout: "duration": 3.7129999999999999e-06 2023-08-01T19:54:41.932 INFO:teuthology.orchestra.run.smithi101.stdout: }, 2023-08-01T19:54:41.932 INFO:teuthology.orchestra.run.smithi101.stdout: { 2023-08-01T19:54:41.932 INFO:teuthology.orchestra.run.smithi101.stdout: "event": "dispatched", 2023-08-01T19:54:41.932 INFO:teuthology.orchestra.run.smithi101.stdout: "time": "2023-08-01T19:54:41.870881+0000", 2023-08-01T19:54:41.932 INFO:teuthology.orchestra.run.smithi101.stdout: "duration": 6.0419999999999999e-06 2023-08-01T19:54:41.932 INFO:teuthology.orchestra.run.smithi101.stdout: }, 2023-08-01T19:54:41.932 INFO:teuthology.orchestra.run.smithi101.stdout: { 2023-08-01T19:54:41.933 INFO:teuthology.orchestra.run.smithi101.stdout: "event": "queued_for_pg", 2023-08-01T19:54:41.933 INFO:teuthology.orchestra.run.smithi101.stdout: "time": "2023-08-01T19:54:41.870885+0000", 2023-08-01T19:54:41.933 INFO:teuthology.orchestra.run.smithi101.stdout: "duration": 3.4120000000000001e-06 2023-08-01T19:54:41.933 INFO:teuthology.orchestra.run.smithi101.stdout: }, 2023-08-01T19:54:41.933 INFO:teuthology.orchestra.run.smithi101.stdout: { 2023-08-01T19:54:41.933 INFO:teuthology.orchestra.run.smithi101.stdout: "event": "reached_pg", 2023-08-01T19:54:41.933 INFO:teuthology.orchestra.run.smithi101.stdout: "time": "2023-08-01T19:54:41.870913+0000", 2023-08-01T19:54:41.933 INFO:teuthology.orchestra.run.smithi101.stdout: "duration": 2.8736999999999999e-05 2023-08-01T19:54:41.934 INFO:teuthology.orchestra.run.smithi101.stdout: }, 2023-08-01T19:54:41.934 INFO:teuthology.orchestra.run.smithi101.stdout: { 2023-08-01T19:54:41.934 INFO:teuthology.orchestra.run.smithi101.stdout: "event": "started", 2023-08-01T19:54:41.934 INFO:teuthology.orchestra.run.smithi101.stdout: "time": "2023-08-01T19:54:41.870925+0000", 2023-08-01T19:54:41.934 INFO:teuthology.orchestra.run.smithi101.stdout: "duration": 1.1578e-05 2023-08-01T19:54:41.934 INFO:teuthology.orchestra.run.smithi101.stdout: } 2023-08-01T19:54:41.934 INFO:teuthology.orchestra.run.smithi101.stdout: ] 2023-08-01T19:54:41.934 INFO:teuthology.orchestra.run.smithi101.stdout: } 2023-08-01T19:54:41.935 INFO:teuthology.orchestra.run.smithi101.stdout: }, 2023-08-01T19:54:41.935 INFO:teuthology.orchestra.run.smithi101.stdout: { 2023-08-01T19:54:41.935 INFO:teuthology.orchestra.run.smithi101.stdout: "description": "osd_repop(client.4668.0:53551 5.c e27/19 5:39bba243:::benchmark_data_smithi006_114134_object53550:head v 27'3416, mlcod=27'3414)", 2023-08-01T19:54:41.935 INFO:teuthology.orchestra.run.smithi101.stdout: "initiated_at": "2023-08-01T19:54:41.870809+0000", 2023-08-01T19:54:41.935 INFO:teuthology.orchestra.run.smithi101.stdout: "age": 4294967295.9997106, 2023-08-01T19:54:41.935 INFO:teuthology.orchestra.run.smithi101.stdout: "duration": 0.000188412, 2023-08-01T19:54:41.935 INFO:teuthology.orchestra.run.smithi101.stdout: "type_data": { 2023-08-01T19:54:41.936 INFO:teuthology.orchestra.run.smithi101.stdout: "flag_point": "started", 2023-08-01T19:54:41.936 INFO:teuthology.orchestra.run.smithi101.stdout: "events": [ 2023-08-01T19:54:41.936 INFO:teuthology.orchestra.run.smithi101.stdout: { 2023-08-01T19:54:41.936 INFO:teuthology.orchestra.run.smithi101.stdout: "event": "initiated", 2023-08-01T19:54:41.936 INFO:teuthology.orchestra.run.smithi101.stdout: "time": "2023-08-01T19:54:41.870809+0000", 2023-08-01T19:54:41.936 INFO:teuthology.orchestra.run.smithi101.stdout: "duration": 0 2023-08-01T19:54:41.936 INFO:teuthology.orchestra.run.smithi101.stdout: }, 2023-08-01T19:54:41.936 INFO:teuthology.orchestra.run.smithi101.stdout: { 2023-08-01T19:54:41.937 INFO:teuthology.orchestra.run.smithi101.stdout: "event": "throttled", 2023-08-01T19:54:41.937 INFO:teuthology.orchestra.run.smithi101.stdout: "time": "2023-08-01T19:54:41.870809+0000", 2023-08-01T19:54:41.937 INFO:teuthology.orchestra.run.smithi101.stdout: "duration": 0 2023-08-01T19:54:41.937 INFO:teuthology.orchestra.run.smithi101.stdout: }, 2023-08-01T19:54:41.937 INFO:teuthology.orchestra.run.smithi101.stdout: { 2023-08-01T19:54:41.937 INFO:teuthology.orchestra.run.smithi101.stdout: "event": "header_read", 2023-08-01T19:54:41.937 INFO:teuthology.orchestra.run.smithi101.stdout: "time": "2023-08-01T19:54:41.870809+0000", 2023-08-01T19:54:41.937 INFO:teuthology.orchestra.run.smithi101.stdout: "duration": 4294967295.9999995 2023-08-01T19:54:41.938 INFO:teuthology.orchestra.run.smithi101.stdout: }, 2023-08-01T19:54:41.938 INFO:teuthology.orchestra.run.smithi101.stdout: { 2023-08-01T19:54:41.938 INFO:teuthology.orchestra.run.smithi101.stdout: "event": "all_read", 2023-08-01T19:54:41.938 INFO:teuthology.orchestra.run.smithi101.stdout: "time": "2023-08-01T19:54:41.870879+0000", 2023-08-01T19:54:41.938 INFO:teuthology.orchestra.run.smithi101.stdout: "duration": 7.0748999999999996e-05 2023-08-01T19:54:41.938 INFO:teuthology.orchestra.run.smithi101.stdout: }, 2023-08-01T19:54:41.938 INFO:teuthology.orchestra.run.smithi101.stdout: { 2023-08-01T19:54:41.938 INFO:teuthology.orchestra.run.smithi101.stdout: "event": "dispatched", 2023-08-01T19:54:41.939 INFO:teuthology.orchestra.run.smithi101.stdout: "time": "2023-08-01T19:54:41.870889+0000", 2023-08-01T19:54:41.939 INFO:teuthology.orchestra.run.smithi101.stdout: "duration": 9.679e-06 2023-08-01T19:54:41.939 INFO:teuthology.orchestra.run.smithi101.stdout: }, 2023-08-01T19:54:41.939 INFO:teuthology.orchestra.run.smithi101.stdout: { 2023-08-01T19:54:41.939 INFO:teuthology.orchestra.run.smithi101.stdout: "event": "queued_for_pg", 2023-08-01T19:54:41.939 INFO:teuthology.orchestra.run.smithi101.stdout: "time": "2023-08-01T19:54:41.870895+0000", 2023-08-01T19:54:41.939 INFO:teuthology.orchestra.run.smithi101.stdout: "duration": 5.5289999999999999e-06 2023-08-01T19:54:41.939 INFO:teuthology.orchestra.run.smithi101.stdout: }, 2023-08-01T19:54:41.940 INFO:teuthology.orchestra.run.smithi101.stdout: { 2023-08-01T19:54:41.940 INFO:teuthology.orchestra.run.smithi101.stdout: "event": "reached_pg", 2023-08-01T19:54:41.940 INFO:teuthology.orchestra.run.smithi101.stdout: "time": "2023-08-01T19:54:41.870926+0000", 2023-08-01T19:54:41.940 INFO:teuthology.orchestra.run.smithi101.stdout: "duration": 3.1631999999999998e-05 2023-08-01T19:54:41.940 INFO:teuthology.orchestra.run.smithi101.stdout: }, 2023-08-01T19:54:41.940 INFO:teuthology.orchestra.run.smithi101.stdout: { 2023-08-01T19:54:41.940 INFO:teuthology.orchestra.run.smithi101.stdout: "event": "started", 2023-08-01T19:54:41.940 INFO:teuthology.orchestra.run.smithi101.stdout: "time": "2023-08-01T19:54:41.870946+0000", 2023-08-01T19:54:41.941 INFO:teuthology.orchestra.run.smithi101.stdout: "duration": 1.9324999999999999e-05 2023-08-01T19:54:41.941 INFO:teuthology.orchestra.run.smithi101.stdout: } 2023-08-01T19:54:41.941 INFO:teuthology.orchestra.run.smithi101.stdout: ] 2023-08-01T19:54:41.941 INFO:teuthology.orchestra.run.smithi101.stdout: } 2023-08-01T19:54:41.941 INFO:teuthology.orchestra.run.smithi101.stdout: } 2023-08-01T19:54:41.941 INFO:teuthology.orchestra.run.smithi101.stdout: ], 2023-08-01T19:54:41.941 INFO:teuthology.orchestra.run.smithi101.stdout: "num_ops": 9 2023-08-01T19:54:41.941 INFO:teuthology.orchestra.run.smithi101.stdout:} 2023-08-01T19:54:41.943 DEBUG:teuthology.orchestra.run.smithi101:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 30 ceph --cluster ceph --admin-daemon /var/run/ceph/ceph-osd.1.asok dump_blocked_ops 2023-08-01T19:54:41.943 INFO:tasks.ceph.osd.0.smithi008.stderr:2023-08-01T19:54:41.942+0000 7f16a58f4700 -1 received signal: Hangup from /usr/bin/python3 /bin/daemon-helper kill ceph-osd -f --cluster ceph -i 0 (PID: 111179) UID: 0 2023-08-01T19:54:42.043 INFO:tasks.ceph.osd.2.smithi155.stderr:2023-08-01T19:54:42.041+0000 7faa5c6ac700 -1 received signal: Hangup from /usr/bin/python3 /bin/daemon-helper kill ceph-osd -f --cluster ceph -i 2 (PID: 111337) UID: 0 2023-08-01T19:54:42.109 INFO:teuthology.orchestra.run.smithi101.stdout:{ 2023-08-01T19:54:42.109 INFO:teuthology.orchestra.run.smithi101.stdout: "ops": [], 2023-08-01T19:54:42.109 INFO:teuthology.orchestra.run.smithi101.stdout: "complaint_time": 30, 2023-08-01T19:54:42.109 INFO:teuthology.orchestra.run.smithi101.stdout: "num_blocked_ops": 0 2023-08-01T19:54:42.109 INFO:teuthology.orchestra.run.smithi101.stdout:} 2023-08-01T19:54:42.122 DEBUG:teuthology.orchestra.run.smithi101:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 30 ceph --cluster ceph --admin-daemon /var/run/ceph/ceph-osd.1.asok dump_historic_ops 2023-08-01T19:54:42.143 INFO:tasks.ceph.osd.0.smithi008.stderr:2023-08-01T19:54:42.143+0000 7f16a58f4700 -1 received signal: Hangup from /usr/bin/python3 /bin/daemon-helper kill ceph-osd -f --cluster ceph -i 0 (PID: 111179) UID: 0 2023-08-01T19:54:42.216 DEBUG:teuthology.orchestra.run.smithi006:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 120 ceph --cluster ceph osd unset nodeep-scrub 2023-08-01T19:54:42.244 INFO:tasks.ceph.osd.0.smithi008.stderr:2023-08-01T19:54:42.243+0000 7f16a58f4700 -1 received signal: Hangup from /usr/bin/python3 /bin/daemon-helper kill ceph-osd -f --cluster ceph -i 0 (PID: 111179) UID: 0 2023-08-01T19:54:42.290 INFO:teuthology.orchestra.run.smithi101.stdout:{ 2023-08-01T19:54:42.290 INFO:teuthology.orchestra.run.smithi101.stdout: "size": 20, 2023-08-01T19:54:42.291 INFO:teuthology.orchestra.run.smithi101.stdout: "duration": 600, 2023-08-01T19:54:42.291 INFO:teuthology.orchestra.run.smithi101.stdout: "ops": [ 2023-08-01T19:54:42.291 INFO:teuthology.orchestra.run.smithi101.stdout: { 2023-08-01T19:54:42.291 INFO:teuthology.orchestra.run.smithi101.stdout: "description": "osd_op(mds.0.3:6 3.10 3:0d82a743:::600.00000000:head [omap-set-header] snapc 0=[] ondisk+write+known_if_redirected+full_force+supports_pool_eio e17)", 2023-08-01T19:54:42.291 INFO:teuthology.orchestra.run.smithi101.stdout: "initiated_at": "2023-08-01T19:54:04.458774+0000", 2023-08-01T19:54:42.291 INFO:teuthology.orchestra.run.smithi101.stdout: "age": 37.828797133999998, 2023-08-01T19:54:42.291 INFO:teuthology.orchestra.run.smithi101.stdout: "duration": 0.017582611000000001, 2023-08-01T19:54:42.291 INFO:teuthology.orchestra.run.smithi101.stdout: "type_data": { 2023-08-01T19:54:42.292 INFO:teuthology.orchestra.run.smithi101.stdout: "flag_point": "commit sent; apply or cleanup", 2023-08-01T19:54:42.292 INFO:teuthology.orchestra.run.smithi101.stdout: "events": [ 2023-08-01T19:54:42.292 INFO:teuthology.orchestra.run.smithi101.stdout: { 2023-08-01T19:54:42.292 INFO:teuthology.orchestra.run.smithi101.stdout: "event": "initiated", 2023-08-01T19:54:42.292 INFO:teuthology.orchestra.run.smithi101.stdout: "time": "2023-08-01T19:54:04.458774+0000", 2023-08-01T19:54:42.292 INFO:teuthology.orchestra.run.smithi101.stdout: "duration": 0 2023-08-01T19:54:42.292 INFO:teuthology.orchestra.run.smithi101.stdout: }, 2023-08-01T19:54:42.293 INFO:teuthology.orchestra.run.smithi101.stdout: { 2023-08-01T19:54:42.293 INFO:teuthology.orchestra.run.smithi101.stdout: "event": "throttled", 2023-08-01T19:54:42.293 INFO:teuthology.orchestra.run.smithi101.stdout: "time": "2023-08-01T19:54:04.458774+0000", 2023-08-01T19:54:42.293 INFO:teuthology.orchestra.run.smithi101.stdout: "duration": 0 2023-08-01T19:54:42.293 INFO:teuthology.orchestra.run.smithi101.stdout: }, 2023-08-01T19:54:42.293 INFO:teuthology.orchestra.run.smithi101.stdout: { 2023-08-01T19:54:42.293 INFO:teuthology.orchestra.run.smithi101.stdout: "event": "header_read", 2023-08-01T19:54:42.294 INFO:teuthology.orchestra.run.smithi101.stdout: "time": "2023-08-01T19:54:04.458772+0000", 2023-08-01T19:54:42.294 INFO:teuthology.orchestra.run.smithi101.stdout: "duration": 4294967295.9999981 2023-08-01T19:54:42.294 INFO:teuthology.orchestra.run.smithi101.stdout: }, 2023-08-01T19:54:42.294 INFO:teuthology.orchestra.run.smithi101.stdout: { 2023-08-01T19:54:42.294 INFO:teuthology.orchestra.run.smithi101.stdout: "event": "all_read", 2023-08-01T19:54:42.294 INFO:teuthology.orchestra.run.smithi101.stdout: "time": "2023-08-01T19:54:04.458781+0000", 2023-08-01T19:54:42.294 INFO:teuthology.orchestra.run.smithi101.stdout: "duration": 8.6670000000000002e-06 2023-08-01T19:54:42.294 INFO:teuthology.orchestra.run.smithi101.stdout: }, 2023-08-01T19:54:42.295 INFO:teuthology.orchestra.run.smithi101.stdout: { 2023-08-01T19:54:42.295 INFO:teuthology.orchestra.run.smithi101.stdout: "event": "dispatched", 2023-08-01T19:54:42.295 INFO:teuthology.orchestra.run.smithi101.stdout: "time": "2023-08-01T19:54:04.458797+0000", 2023-08-01T19:54:42.295 INFO:teuthology.orchestra.run.smithi101.stdout: "duration": 1.6463000000000001e-05 2023-08-01T19:54:42.295 INFO:teuthology.orchestra.run.smithi101.stdout: }, 2023-08-01T19:54:42.295 INFO:teuthology.orchestra.run.smithi101.stdout: { 2023-08-01T19:54:42.295 INFO:teuthology.orchestra.run.smithi101.stdout: "event": "queued_for_pg", 2023-08-01T19:54:42.296 INFO:teuthology.orchestra.run.smithi101.stdout: "time": "2023-08-01T19:54:04.458810+0000", 2023-08-01T19:54:42.296 INFO:teuthology.orchestra.run.smithi101.stdout: "duration": 1.2753e-05 2023-08-01T19:54:42.296 INFO:teuthology.orchestra.run.smithi101.stdout: }, 2023-08-01T19:54:42.296 INFO:teuthology.orchestra.run.smithi101.stdout: { 2023-08-01T19:54:42.296 INFO:teuthology.orchestra.run.smithi101.stdout: "event": "reached_pg", 2023-08-01T19:54:42.296 INFO:teuthology.orchestra.run.smithi101.stdout: "time": "2023-08-01T19:54:04.458866+0000", 2023-08-01T19:54:42.296 INFO:teuthology.orchestra.run.smithi101.stdout: "duration": 5.6625000000000001e-05 2023-08-01T19:54:42.296 INFO:teuthology.orchestra.run.smithi101.stdout: }, 2023-08-01T19:54:42.297 INFO:teuthology.orchestra.run.smithi101.stdout: { 2023-08-01T19:54:42.297 INFO:teuthology.orchestra.run.smithi101.stdout: "event": "op must wait for map", 2023-08-01T19:54:42.297 INFO:teuthology.orchestra.run.smithi101.stdout: "time": "2023-08-01T19:54:04.458873+0000", 2023-08-01T19:54:42.297 INFO:teuthology.orchestra.run.smithi101.stdout: "duration": 6.9110000000000004e-06 2023-08-01T19:54:42.297 INFO:teuthology.orchestra.run.smithi101.stdout: }, 2023-08-01T19:54:42.297 INFO:teuthology.orchestra.run.smithi101.stdout: { 2023-08-01T19:54:42.297 INFO:teuthology.orchestra.run.smithi101.stdout: "event": "reached_pg", 2023-08-01T19:54:42.297 INFO:teuthology.orchestra.run.smithi101.stdout: "time": "2023-08-01T19:54:04.466999+0000", 2023-08-01T19:54:42.298 INFO:teuthology.orchestra.run.smithi101.stdout: "duration": 0.0081256550000000007 2023-08-01T19:54:42.298 INFO:teuthology.orchestra.run.smithi101.stdout: }, 2023-08-01T19:54:42.298 INFO:teuthology.orchestra.run.smithi101.stdout: { 2023-08-01T19:54:42.298 INFO:teuthology.orchestra.run.smithi101.stdout: "event": "started", 2023-08-01T19:54:42.298 INFO:teuthology.orchestra.run.smithi101.stdout: "time": "2023-08-01T19:54:04.467201+0000", 2023-08-01T19:54:42.298 INFO:teuthology.orchestra.run.smithi101.stdout: "duration": 0.00020166199999999999 2023-08-01T19:54:42.298 INFO:teuthology.orchestra.run.smithi101.stdout: }, 2023-08-01T19:54:42.298 INFO:teuthology.orchestra.run.smithi101.stdout: { 2023-08-01T19:54:42.299 INFO:teuthology.orchestra.run.smithi101.stdout: "event": "waiting for subops from 2", 2023-08-01T19:54:42.299 INFO:teuthology.orchestra.run.smithi101.stdout: "time": "2023-08-01T19:54:04.467350+0000", 2023-08-01T19:54:42.299 INFO:teuthology.orchestra.run.smithi101.stdout: "duration": 0.000149173 2023-08-01T19:54:42.299 INFO:teuthology.orchestra.run.smithi101.stdout: }, 2023-08-01T19:54:42.299 INFO:teuthology.orchestra.run.smithi101.stdout: { 2023-08-01T19:54:42.299 INFO:teuthology.orchestra.run.smithi101.stdout: "event": "op_commit", 2023-08-01T19:54:42.299 INFO:teuthology.orchestra.run.smithi101.stdout: "time": "2023-08-01T19:54:04.476168+0000", 2023-08-01T19:54:42.299 INFO:teuthology.orchestra.run.smithi101.stdout: "duration": 0.0088183250000000001 2023-08-01T19:54:42.300 INFO:teuthology.orchestra.run.smithi101.stdout: }, 2023-08-01T19:54:42.300 INFO:teuthology.orchestra.run.smithi101.stdout: { 2023-08-01T19:54:42.300 INFO:teuthology.orchestra.run.smithi101.stdout: "event": "sub_op_commit_rec", 2023-08-01T19:54:42.300 INFO:teuthology.orchestra.run.smithi101.stdout: "time": "2023-08-01T19:54:04.476239+0000", 2023-08-01T19:54:42.300 INFO:teuthology.orchestra.run.smithi101.stdout: "duration": 7.1296000000000003e-05 2023-08-01T19:54:42.300 INFO:teuthology.orchestra.run.smithi101.stdout: }, 2023-08-01T19:54:42.300 INFO:teuthology.orchestra.run.smithi101.stdout: { 2023-08-01T19:54:42.301 INFO:teuthology.orchestra.run.smithi101.stdout: "event": "commit_sent", 2023-08-01T19:54:42.301 INFO:teuthology.orchestra.run.smithi101.stdout: "time": "2023-08-01T19:54:04.476290+0000", 2023-08-01T19:54:42.301 INFO:teuthology.orchestra.run.smithi101.stdout: "duration": 5.0423999999999997e-05 2023-08-01T19:54:42.301 INFO:teuthology.orchestra.run.smithi101.stdout: }, 2023-08-01T19:54:42.301 INFO:teuthology.orchestra.run.smithi101.stdout: { 2023-08-01T19:54:42.301 INFO:teuthology.orchestra.run.smithi101.stdout: "event": "done", 2023-08-01T19:54:42.301 INFO:teuthology.orchestra.run.smithi101.stdout: "time": "2023-08-01T19:54:04.476356+0000", 2023-08-01T19:54:42.301 INFO:teuthology.orchestra.run.smithi101.stdout: "duration": 6.6439000000000005e-05 2023-08-01T19:54:42.302 INFO:teuthology.orchestra.run.smithi101.stdout: } 2023-08-01T19:54:42.302 INFO:teuthology.orchestra.run.smithi101.stdout: ] 2023-08-01T19:54:42.302 INFO:teuthology.orchestra.run.smithi101.stdout: } 2023-08-01T19:54:42.302 INFO:teuthology.orchestra.run.smithi101.stdout: }, 2023-08-01T19:54:42.302 INFO:teuthology.orchestra.run.smithi101.stdout: { 2023-08-01T19:54:42.302 INFO:teuthology.orchestra.run.smithi101.stdout: "description": "osd_op(mds.0.3:7 3.10 3:0d82a743:::600.00000000:head [create,setxattr parent (62) in=6b,setxattr layout (30) in=6b] snapc 0=[] ondisk+write+known_if_redirected+full_force+supports_pool_eio e17)", 2023-08-01T19:54:42.302 INFO:teuthology.orchestra.run.smithi101.stdout: "initiated_at": "2023-08-01T19:54:04.458830+0000", 2023-08-01T19:54:42.302 INFO:teuthology.orchestra.run.smithi101.stdout: "age": 37.828740746999998, 2023-08-01T19:54:42.303 INFO:teuthology.orchestra.run.smithi101.stdout: "duration": 0.018463726, 2023-08-01T19:54:42.303 INFO:teuthology.orchestra.run.smithi101.stdout: "type_data": { 2023-08-01T19:54:42.303 INFO:teuthology.orchestra.run.smithi101.stdout: "flag_point": "commit sent; apply or cleanup", 2023-08-01T19:54:42.303 INFO:teuthology.orchestra.run.smithi101.stdout: "events": [ 2023-08-01T19:54:42.303 INFO:teuthology.orchestra.run.smithi101.stdout: { 2023-08-01T19:54:42.303 INFO:teuthology.orchestra.run.smithi101.stdout: "event": "initiated", 2023-08-01T19:54:42.303 INFO:teuthology.orchestra.run.smithi101.stdout: "time": "2023-08-01T19:54:04.458830+0000", 2023-08-01T19:54:42.303 INFO:teuthology.orchestra.run.smithi101.stdout: "duration": 0 2023-08-01T19:54:42.304 INFO:teuthology.orchestra.run.smithi101.stdout: }, 2023-08-01T19:54:42.304 INFO:teuthology.orchestra.run.smithi101.stdout: { 2023-08-01T19:54:42.304 INFO:teuthology.orchestra.run.smithi101.stdout: "event": "throttled", 2023-08-01T19:54:42.304 INFO:teuthology.orchestra.run.smithi101.stdout: "time": "2023-08-01T19:54:04.458830+0000", 2023-08-01T19:54:42.304 INFO:teuthology.orchestra.run.smithi101.stdout: "duration": 0 2023-08-01T19:54:42.304 INFO:teuthology.orchestra.run.smithi101.stdout: }, 2023-08-01T19:54:42.304 INFO:teuthology.orchestra.run.smithi101.stdout: { 2023-08-01T19:54:42.304 INFO:teuthology.orchestra.run.smithi101.stdout: "event": "header_read", 2023-08-01T19:54:42.305 INFO:teuthology.orchestra.run.smithi101.stdout: "time": "2023-08-01T19:54:04.458829+0000", 2023-08-01T19:54:42.305 INFO:teuthology.orchestra.run.smithi101.stdout: "duration": 4294967295.999999 2023-08-01T19:54:42.305 INFO:teuthology.orchestra.run.smithi101.stdout: }, 2023-08-01T19:54:42.305 INFO:teuthology.orchestra.run.smithi101.stdout: { 2023-08-01T19:54:42.305 INFO:teuthology.orchestra.run.smithi101.stdout: "event": "all_read", 2023-08-01T19:54:42.305 INFO:teuthology.orchestra.run.smithi101.stdout: "time": "2023-08-01T19:54:04.458838+0000", 2023-08-01T19:54:42.305 INFO:teuthology.orchestra.run.smithi101.stdout: "duration": 8.5369999999999997e-06 2023-08-01T19:54:42.305 INFO:teuthology.orchestra.run.smithi101.stdout: }, 2023-08-01T19:54:42.306 INFO:teuthology.orchestra.run.smithi101.stdout: { 2023-08-01T19:54:42.306 INFO:teuthology.orchestra.run.smithi101.stdout: "event": "dispatched", 2023-08-01T19:54:42.306 INFO:teuthology.orchestra.run.smithi101.stdout: "time": "2023-08-01T19:54:04.458850+0000", 2023-08-01T19:54:42.306 INFO:teuthology.orchestra.run.smithi101.stdout: "duration": 1.203e-05 2023-08-01T19:54:42.306 INFO:teuthology.orchestra.run.smithi101.stdout: }, 2023-08-01T19:54:42.306 INFO:teuthology.orchestra.run.smithi101.stdout: { 2023-08-01T19:54:42.306 INFO:teuthology.orchestra.run.smithi101.stdout: "event": "queued_for_pg", 2023-08-01T19:54:42.306 INFO:teuthology.orchestra.run.smithi101.stdout: "time": "2023-08-01T19:54:04.458859+0000", 2023-08-01T19:54:42.307 INFO:teuthology.orchestra.run.smithi101.stdout: "duration": 8.9889999999999998e-06 2023-08-01T19:54:42.307 INFO:teuthology.orchestra.run.smithi101.stdout: }, 2023-08-01T19:54:42.307 INFO:teuthology.orchestra.run.smithi101.stdout: { 2023-08-01T19:54:42.307 INFO:teuthology.orchestra.run.smithi101.stdout: "event": "reached_pg", 2023-08-01T19:54:42.307 INFO:teuthology.orchestra.run.smithi101.stdout: "time": "2023-08-01T19:54:04.458926+0000", 2023-08-01T19:54:42.307 INFO:teuthology.orchestra.run.smithi101.stdout: "duration": 6.6741000000000004e-05 2023-08-01T19:54:42.307 INFO:teuthology.orchestra.run.smithi101.stdout: }, 2023-08-01T19:54:42.307 INFO:teuthology.orchestra.run.smithi101.stdout: { 2023-08-01T19:54:42.308 INFO:teuthology.orchestra.run.smithi101.stdout: "event": "waiting_for_map not empty", 2023-08-01T19:54:42.308 INFO:teuthology.orchestra.run.smithi101.stdout: "time": "2023-08-01T19:54:04.458929+0000", 2023-08-01T19:54:42.308 INFO:teuthology.orchestra.run.smithi101.stdout: "duration": 3.303e-06 2023-08-01T19:54:42.308 INFO:teuthology.orchestra.run.smithi101.stdout: }, 2023-08-01T19:54:42.308 INFO:teuthology.orchestra.run.smithi101.stdout: { 2023-08-01T19:54:42.308 INFO:teuthology.orchestra.run.smithi101.stdout: "event": "reached_pg", 2023-08-01T19:54:42.308 INFO:teuthology.orchestra.run.smithi101.stdout: "time": "2023-08-01T19:54:04.468692+0000", 2023-08-01T19:54:42.309 INFO:teuthology.orchestra.run.smithi101.stdout: "duration": 0.0097635910000000003 2023-08-01T19:54:42.309 INFO:teuthology.orchestra.run.smithi101.stdout: }, 2023-08-01T19:54:42.309 INFO:teuthology.orchestra.run.smithi101.stdout: { 2023-08-01T19:54:42.309 INFO:teuthology.orchestra.run.smithi101.stdout: "event": "started", 2023-08-01T19:54:42.309 INFO:teuthology.orchestra.run.smithi101.stdout: "time": "2023-08-01T19:54:04.468774+0000", 2023-08-01T19:54:42.309 INFO:teuthology.orchestra.run.smithi101.stdout: "duration": 8.1092000000000002e-05 2023-08-01T19:54:42.309 INFO:teuthology.orchestra.run.smithi101.stdout: }, 2023-08-01T19:54:42.309 INFO:teuthology.orchestra.run.smithi101.stdout: { 2023-08-01T19:54:42.310 INFO:teuthology.orchestra.run.smithi101.stdout: "event": "waiting for subops from 2", 2023-08-01T19:54:42.310 INFO:teuthology.orchestra.run.smithi101.stdout: "time": "2023-08-01T19:54:04.468934+0000", 2023-08-01T19:54:42.310 INFO:teuthology.orchestra.run.smithi101.stdout: "duration": 0.000160027 2023-08-01T19:54:42.310 INFO:teuthology.orchestra.run.smithi101.stdout: }, 2023-08-01T19:54:42.310 INFO:teuthology.orchestra.run.smithi101.stdout: { 2023-08-01T19:54:42.310 INFO:teuthology.orchestra.run.smithi101.stdout: "event": "op_commit", 2023-08-01T19:54:42.310 INFO:teuthology.orchestra.run.smithi101.stdout: "time": "2023-08-01T19:54:04.476174+0000", 2023-08-01T19:54:42.310 INFO:teuthology.orchestra.run.smithi101.stdout: "duration": 0.0072400479999999998 2023-08-01T19:54:42.311 INFO:teuthology.orchestra.run.smithi101.stdout: }, 2023-08-01T19:54:42.311 INFO:teuthology.orchestra.run.smithi101.stdout: { 2023-08-01T19:54:42.311 INFO:teuthology.orchestra.run.smithi101.stdout: "event": "sub_op_commit_rec", 2023-08-01T19:54:42.311 INFO:teuthology.orchestra.run.smithi101.stdout: "time": "2023-08-01T19:54:04.477206+0000", 2023-08-01T19:54:42.311 INFO:teuthology.orchestra.run.smithi101.stdout: "duration": 0.0010318969999999999 2023-08-01T19:54:42.311 INFO:teuthology.orchestra.run.smithi101.stdout: }, 2023-08-01T19:54:42.311 INFO:teuthology.orchestra.run.smithi101.stdout: { 2023-08-01T19:54:42.311 INFO:teuthology.orchestra.run.smithi101.stdout: "event": "commit_sent", 2023-08-01T19:54:42.312 INFO:teuthology.orchestra.run.smithi101.stdout: "time": "2023-08-01T19:54:04.477257+0000", 2023-08-01T19:54:42.312 INFO:teuthology.orchestra.run.smithi101.stdout: "duration": 5.1156000000000003e-05 2023-08-01T19:54:42.312 INFO:teuthology.orchestra.run.smithi101.stdout: }, 2023-08-01T19:54:42.312 INFO:teuthology.orchestra.run.smithi101.stdout: { 2023-08-01T19:54:42.312 INFO:teuthology.orchestra.run.smithi101.stdout: "event": "done", 2023-08-01T19:54:42.312 INFO:teuthology.orchestra.run.smithi101.stdout: "time": "2023-08-01T19:54:04.477294+0000", 2023-08-01T19:54:42.312 INFO:teuthology.orchestra.run.smithi101.stdout: "duration": 3.7150000000000002e-05 2023-08-01T19:54:42.312 INFO:teuthology.orchestra.run.smithi101.stdout: } 2023-08-01T19:54:42.313 INFO:teuthology.orchestra.run.smithi101.stdout: ] 2023-08-01T19:54:42.313 INFO:teuthology.orchestra.run.smithi101.stdout: } 2023-08-01T19:54:42.313 INFO:teuthology.orchestra.run.smithi101.stdout: }, 2023-08-01T19:54:42.313 INFO:teuthology.orchestra.run.smithi101.stdout: { 2023-08-01T19:54:42.313 INFO:teuthology.orchestra.run.smithi101.stdout: "description": "osd_op(mds.0.3:8 3.10 3:09401a81:::601.00000000:head [omap-set-header] snapc 0=[] ondisk+write+known_if_redirected+full_force+supports_pool_eio e17)", 2023-08-01T19:54:42.313 INFO:teuthology.orchestra.run.smithi101.stdout: "initiated_at": "2023-08-01T19:54:04.458869+0000", 2023-08-01T19:54:42.313 INFO:teuthology.orchestra.run.smithi101.stdout: "age": 37.828701611, 2023-08-01T19:54:42.313 INFO:teuthology.orchestra.run.smithi101.stdout: "duration": 0.018528932000000001, 2023-08-01T19:54:42.314 INFO:teuthology.orchestra.run.smithi101.stdout: "type_data": { 2023-08-01T19:54:42.314 INFO:teuthology.orchestra.run.smithi101.stdout: "flag_point": "commit sent; apply or cleanup", 2023-08-01T19:54:42.314 INFO:teuthology.orchestra.run.smithi101.stdout: "events": [ 2023-08-01T19:54:42.314 INFO:teuthology.orchestra.run.smithi101.stdout: { 2023-08-01T19:54:42.314 INFO:teuthology.orchestra.run.smithi101.stdout: "event": "initiated", 2023-08-01T19:54:42.314 INFO:teuthology.orchestra.run.smithi101.stdout: "time": "2023-08-01T19:54:04.458869+0000", 2023-08-01T19:54:42.314 INFO:teuthology.orchestra.run.smithi101.stdout: "duration": 0 2023-08-01T19:54:42.314 INFO:teuthology.orchestra.run.smithi101.stdout: }, 2023-08-01T19:54:42.315 INFO:teuthology.orchestra.run.smithi101.stdout: { 2023-08-01T19:54:42.315 INFO:teuthology.orchestra.run.smithi101.stdout: "event": "throttled", 2023-08-01T19:54:42.315 INFO:teuthology.orchestra.run.smithi101.stdout: "time": "2023-08-01T19:54:04.458869+0000", 2023-08-01T19:54:42.315 INFO:teuthology.orchestra.run.smithi101.stdout: "duration": 0 2023-08-01T19:54:42.315 INFO:teuthology.orchestra.run.smithi101.stdout: }, 2023-08-01T19:54:42.315 INFO:teuthology.orchestra.run.smithi101.stdout: { 2023-08-01T19:54:42.315 INFO:teuthology.orchestra.run.smithi101.stdout: "event": "header_read", 2023-08-01T19:54:42.315 INFO:teuthology.orchestra.run.smithi101.stdout: "time": "2023-08-01T19:54:04.458869+0000", 2023-08-01T19:54:42.316 INFO:teuthology.orchestra.run.smithi101.stdout: "duration": 4294967295.9999995 2023-08-01T19:54:42.316 INFO:teuthology.orchestra.run.smithi101.stdout: }, 2023-08-01T19:54:42.316 INFO:teuthology.orchestra.run.smithi101.stdout: { 2023-08-01T19:54:42.316 INFO:teuthology.orchestra.run.smithi101.stdout: "event": "all_read", 2023-08-01T19:54:42.316 INFO:teuthology.orchestra.run.smithi101.stdout: "time": "2023-08-01T19:54:04.458878+0000", 2023-08-01T19:54:42.316 INFO:teuthology.orchestra.run.smithi101.stdout: "duration": 9.4110000000000002e-06 2023-08-01T19:54:42.316 INFO:teuthology.orchestra.run.smithi101.stdout: }, 2023-08-01T19:54:42.317 INFO:teuthology.orchestra.run.smithi101.stdout: { 2023-08-01T19:54:42.317 INFO:teuthology.orchestra.run.smithi101.stdout: "event": "dispatched", 2023-08-01T19:54:42.317 INFO:teuthology.orchestra.run.smithi101.stdout: "time": "2023-08-01T19:54:04.458886+0000", 2023-08-01T19:54:42.317 INFO:teuthology.orchestra.run.smithi101.stdout: "duration": 7.6090000000000003e-06 2023-08-01T19:54:42.317 INFO:teuthology.orchestra.run.smithi101.stdout: }, 2023-08-01T19:54:42.317 INFO:teuthology.orchestra.run.smithi101.stdout: { 2023-08-01T19:54:42.317 INFO:teuthology.orchestra.run.smithi101.stdout: "event": "queued_for_pg", 2023-08-01T19:54:42.317 INFO:teuthology.orchestra.run.smithi101.stdout: "time": "2023-08-01T19:54:04.458890+0000", 2023-08-01T19:54:42.318 INFO:teuthology.orchestra.run.smithi101.stdout: "duration": 4.8470000000000003e-06 2023-08-01T19:54:42.318 INFO:teuthology.orchestra.run.smithi101.stdout: }, 2023-08-01T19:54:42.318 INFO:teuthology.orchestra.run.smithi101.stdout: { 2023-08-01T19:54:42.318 INFO:teuthology.orchestra.run.smithi101.stdout: "event": "reached_pg", 2023-08-01T19:54:42.318 INFO:teuthology.orchestra.run.smithi101.stdout: "time": "2023-08-01T19:54:04.458957+0000", 2023-08-01T19:54:42.318 INFO:teuthology.orchestra.run.smithi101.stdout: "duration": 6.6502999999999997e-05 2023-08-01T19:54:42.318 INFO:teuthology.orchestra.run.smithi101.stdout: }, 2023-08-01T19:54:42.318 INFO:teuthology.orchestra.run.smithi101.stdout: { 2023-08-01T19:54:42.319 INFO:teuthology.orchestra.run.smithi101.stdout: "event": "waiting_for_map not empty", 2023-08-01T19:54:42.319 INFO:teuthology.orchestra.run.smithi101.stdout: "time": "2023-08-01T19:54:04.458959+0000", 2023-08-01T19:54:42.319 INFO:teuthology.orchestra.run.smithi101.stdout: "duration": 2.3989999999999998e-06 2023-08-01T19:54:42.319 INFO:teuthology.orchestra.run.smithi101.stdout: }, 2023-08-01T19:54:42.319 INFO:teuthology.orchestra.run.smithi101.stdout: { 2023-08-01T19:54:42.319 INFO:teuthology.orchestra.run.smithi101.stdout: "event": "reached_pg", 2023-08-01T19:54:42.319 INFO:teuthology.orchestra.run.smithi101.stdout: "time": "2023-08-01T19:54:04.469554+0000", 2023-08-01T19:54:42.319 INFO:teuthology.orchestra.run.smithi101.stdout: "duration": 0.010594404 2023-08-01T19:54:42.320 INFO:teuthology.orchestra.run.smithi101.stdout: }, 2023-08-01T19:54:42.320 INFO:teuthology.orchestra.run.smithi101.stdout: { 2023-08-01T19:54:42.320 INFO:teuthology.orchestra.run.smithi101.stdout: "event": "started", 2023-08-01T19:54:42.320 INFO:teuthology.orchestra.run.smithi101.stdout: "time": "2023-08-01T19:54:04.469694+0000", 2023-08-01T19:54:42.320 INFO:teuthology.orchestra.run.smithi101.stdout: "duration": 0.00014006899999999999 2023-08-01T19:54:42.320 INFO:teuthology.orchestra.run.smithi101.stdout: }, 2023-08-01T19:54:42.320 INFO:teuthology.orchestra.run.smithi101.stdout: { 2023-08-01T19:54:42.320 INFO:teuthology.orchestra.run.smithi101.stdout: "event": "waiting for subops from 2", 2023-08-01T19:54:42.321 INFO:teuthology.orchestra.run.smithi101.stdout: "time": "2023-08-01T19:54:04.469826+0000", 2023-08-01T19:54:42.321 INFO:teuthology.orchestra.run.smithi101.stdout: "duration": 0.000132285 2023-08-01T19:54:42.321 INFO:teuthology.orchestra.run.smithi101.stdout: }, 2023-08-01T19:54:42.321 INFO:teuthology.orchestra.run.smithi101.stdout: { 2023-08-01T19:54:42.321 INFO:teuthology.orchestra.run.smithi101.stdout: "event": "op_commit", 2023-08-01T19:54:42.321 INFO:teuthology.orchestra.run.smithi101.stdout: "time": "2023-08-01T19:54:04.476179+0000", 2023-08-01T19:54:42.321 INFO:teuthology.orchestra.run.smithi101.stdout: "duration": 0.0063524289999999997 2023-08-01T19:54:42.321 INFO:teuthology.orchestra.run.smithi101.stdout: }, 2023-08-01T19:54:42.322 INFO:teuthology.orchestra.run.smithi101.stdout: { 2023-08-01T19:54:42.322 INFO:teuthology.orchestra.run.smithi101.stdout: "event": "sub_op_commit_rec", 2023-08-01T19:54:42.322 INFO:teuthology.orchestra.run.smithi101.stdout: "time": "2023-08-01T19:54:04.477334+0000", 2023-08-01T19:54:42.322 INFO:teuthology.orchestra.run.smithi101.stdout: "duration": 0.0011551070000000001 2023-08-01T19:54:42.322 INFO:teuthology.orchestra.run.smithi101.stdout: }, 2023-08-01T19:54:42.322 INFO:teuthology.orchestra.run.smithi101.stdout: { 2023-08-01T19:54:42.322 INFO:teuthology.orchestra.run.smithi101.stdout: "event": "commit_sent", 2023-08-01T19:54:42.323 INFO:teuthology.orchestra.run.smithi101.stdout: "time": "2023-08-01T19:54:04.477371+0000", 2023-08-01T19:54:42.323 INFO:teuthology.orchestra.run.smithi101.stdout: "duration": 3.7425000000000002e-05 2023-08-01T19:54:42.323 INFO:teuthology.orchestra.run.smithi101.stdout: }, 2023-08-01T19:54:42.323 INFO:teuthology.orchestra.run.smithi101.stdout: { 2023-08-01T19:54:42.323 INFO:teuthology.orchestra.run.smithi101.stdout: "event": "done", 2023-08-01T19:54:42.323 INFO:teuthology.orchestra.run.smithi101.stdout: "time": "2023-08-01T19:54:04.477398+0000", 2023-08-01T19:54:42.323 INFO:teuthology.orchestra.run.smithi101.stdout: "duration": 2.7078000000000001e-05 2023-08-01T19:54:42.323 INFO:teuthology.orchestra.run.smithi101.stdout: } 2023-08-01T19:54:42.324 INFO:teuthology.orchestra.run.smithi101.stdout: ] 2023-08-01T19:54:42.324 INFO:teuthology.orchestra.run.smithi101.stdout: } 2023-08-01T19:54:42.324 INFO:teuthology.orchestra.run.smithi101.stdout: }, 2023-08-01T19:54:42.324 INFO:teuthology.orchestra.run.smithi101.stdout: { 2023-08-01T19:54:42.324 INFO:teuthology.orchestra.run.smithi101.stdout: "description": "osd_op(mds.0.3:9 3.10 3:09401a81:::601.00000000:head [create,setxattr parent (62) in=6b,setxattr layout (30) in=6b] snapc 0=[] ondisk+write+known_if_redirected+full_force+supports_pool_eio e17)", 2023-08-01T19:54:42.324 INFO:teuthology.orchestra.run.smithi101.stdout: "initiated_at": "2023-08-01T19:54:04.458896+0000", 2023-08-01T19:54:42.324 INFO:teuthology.orchestra.run.smithi101.stdout: "age": 37.828674444000001, 2023-08-01T19:54:42.324 INFO:teuthology.orchestra.run.smithi101.stdout: "duration": 0.018577215000000001, 2023-08-01T19:54:42.325 INFO:teuthology.orchestra.run.smithi101.stdout: "type_data": { 2023-08-01T19:54:42.325 INFO:teuthology.orchestra.run.smithi101.stdout: "flag_point": "commit sent; apply or cleanup", 2023-08-01T19:54:42.325 INFO:teuthology.orchestra.run.smithi101.stdout: "events": [ 2023-08-01T19:54:42.325 INFO:teuthology.orchestra.run.smithi101.stdout: { 2023-08-01T19:54:42.325 INFO:teuthology.orchestra.run.smithi101.stdout: "event": "initiated", 2023-08-01T19:54:42.325 INFO:teuthology.orchestra.run.smithi101.stdout: "time": "2023-08-01T19:54:04.458896+0000", 2023-08-01T19:54:42.325 INFO:teuthology.orchestra.run.smithi101.stdout: "duration": 0 2023-08-01T19:54:42.325 INFO:teuthology.orchestra.run.smithi101.stdout: }, 2023-08-01T19:54:42.326 INFO:teuthology.orchestra.run.smithi101.stdout: { 2023-08-01T19:54:42.326 INFO:teuthology.orchestra.run.smithi101.stdout: "event": "throttled", 2023-08-01T19:54:42.326 INFO:teuthology.orchestra.run.smithi101.stdout: "time": "2023-08-01T19:54:04.458896+0000", 2023-08-01T19:54:42.326 INFO:teuthology.orchestra.run.smithi101.stdout: "duration": 0 2023-08-01T19:54:42.326 INFO:teuthology.orchestra.run.smithi101.stdout: }, 2023-08-01T19:54:42.326 INFO:teuthology.orchestra.run.smithi101.stdout: { 2023-08-01T19:54:42.326 INFO:teuthology.orchestra.run.smithi101.stdout: "event": "header_read", 2023-08-01T19:54:42.326 INFO:teuthology.orchestra.run.smithi101.stdout: "time": "2023-08-01T19:54:04.458896+0000", 2023-08-01T19:54:42.327 INFO:teuthology.orchestra.run.smithi101.stdout: "duration": 4294967295.9999995 2023-08-01T19:54:42.327 INFO:teuthology.orchestra.run.smithi101.stdout: }, 2023-08-01T19:54:42.327 INFO:teuthology.orchestra.run.smithi101.stdout: { 2023-08-01T19:54:42.327 INFO:teuthology.orchestra.run.smithi101.stdout: "event": "all_read", 2023-08-01T19:54:42.327 INFO:teuthology.orchestra.run.smithi101.stdout: "time": "2023-08-01T19:54:04.458900+0000", 2023-08-01T19:54:42.327 INFO:teuthology.orchestra.run.smithi101.stdout: "duration": 4.0829999999999997e-06 2023-08-01T19:54:42.327 INFO:teuthology.orchestra.run.smithi101.stdout: }, 2023-08-01T19:54:42.327 INFO:teuthology.orchestra.run.smithi101.stdout: { 2023-08-01T19:54:42.328 INFO:teuthology.orchestra.run.smithi101.stdout: "event": "dispatched", 2023-08-01T19:54:42.328 INFO:teuthology.orchestra.run.smithi101.stdout: "time": "2023-08-01T19:54:04.458906+0000", 2023-08-01T19:54:42.328 INFO:teuthology.orchestra.run.smithi101.stdout: "duration": 6.4099999999999996e-06 2023-08-01T19:54:42.328 INFO:teuthology.orchestra.run.smithi101.stdout: }, 2023-08-01T19:54:42.328 INFO:teuthology.orchestra.run.smithi101.stdout: { 2023-08-01T19:54:42.328 INFO:teuthology.orchestra.run.smithi101.stdout: "event": "queued_for_pg", 2023-08-01T19:54:42.328 INFO:teuthology.orchestra.run.smithi101.stdout: "time": "2023-08-01T19:54:04.458911+0000", 2023-08-01T19:54:42.328 INFO:teuthology.orchestra.run.smithi101.stdout: "duration": 4.0500000000000002e-06 2023-08-01T19:54:42.329 INFO:teuthology.orchestra.run.smithi101.stdout: }, 2023-08-01T19:54:42.329 INFO:teuthology.orchestra.run.smithi101.stdout: { 2023-08-01T19:54:42.329 INFO:teuthology.orchestra.run.smithi101.stdout: "event": "reached_pg", 2023-08-01T19:54:42.329 INFO:teuthology.orchestra.run.smithi101.stdout: "time": "2023-08-01T19:54:04.458981+0000", 2023-08-01T19:54:42.329 INFO:teuthology.orchestra.run.smithi101.stdout: "duration": 7.0121000000000002e-05 2023-08-01T19:54:42.329 INFO:teuthology.orchestra.run.smithi101.stdout: }, 2023-08-01T19:54:42.329 INFO:teuthology.orchestra.run.smithi101.stdout: { 2023-08-01T19:54:42.330 INFO:teuthology.orchestra.run.smithi101.stdout: "event": "waiting_for_map not empty", 2023-08-01T19:54:42.330 INFO:teuthology.orchestra.run.smithi101.stdout: "time": "2023-08-01T19:54:04.458983+0000", 2023-08-01T19:54:42.330 INFO:teuthology.orchestra.run.smithi101.stdout: "duration": 2.2299999999999998e-06 2023-08-01T19:54:42.330 INFO:teuthology.orchestra.run.smithi101.stdout: }, 2023-08-01T19:54:42.330 INFO:teuthology.orchestra.run.smithi101.stdout: { 2023-08-01T19:54:42.330 INFO:teuthology.orchestra.run.smithi101.stdout: "event": "reached_pg", 2023-08-01T19:54:42.330 INFO:teuthology.orchestra.run.smithi101.stdout: "time": "2023-08-01T19:54:04.470122+0000", 2023-08-01T19:54:42.330 INFO:teuthology.orchestra.run.smithi101.stdout: "duration": 0.011139593999999999 2023-08-01T19:54:42.331 INFO:teuthology.orchestra.run.smithi101.stdout: }, 2023-08-01T19:54:42.331 INFO:teuthology.orchestra.run.smithi101.stdout: { 2023-08-01T19:54:42.331 INFO:teuthology.orchestra.run.smithi101.stdout: "event": "started", 2023-08-01T19:54:42.331 INFO:teuthology.orchestra.run.smithi101.stdout: "time": "2023-08-01T19:54:04.470217+0000", 2023-08-01T19:54:42.331 INFO:teuthology.orchestra.run.smithi101.stdout: "duration": 9.4388000000000005e-05 2023-08-01T19:54:42.331 INFO:teuthology.orchestra.run.smithi101.stdout: }, 2023-08-01T19:54:42.331 INFO:teuthology.orchestra.run.smithi101.stdout: { 2023-08-01T19:54:42.331 INFO:teuthology.orchestra.run.smithi101.stdout: "event": "waiting for subops from 2", 2023-08-01T19:54:42.332 INFO:teuthology.orchestra.run.smithi101.stdout: "time": "2023-08-01T19:54:04.470714+0000", 2023-08-01T19:54:42.332 INFO:teuthology.orchestra.run.smithi101.stdout: "duration": 0.00049680999999999998 2023-08-01T19:54:42.332 INFO:teuthology.orchestra.run.smithi101.stdout: }, 2023-08-01T19:54:42.332 INFO:teuthology.orchestra.run.smithi101.stdout: { 2023-08-01T19:54:42.332 INFO:teuthology.orchestra.run.smithi101.stdout: "event": "op_commit", 2023-08-01T19:54:42.332 INFO:teuthology.orchestra.run.smithi101.stdout: "time": "2023-08-01T19:54:04.476183+0000", 2023-08-01T19:54:42.332 INFO:teuthology.orchestra.run.smithi101.stdout: "duration": 0.0054695880000000001 2023-08-01T19:54:42.332 INFO:teuthology.orchestra.run.smithi101.stdout: }, 2023-08-01T19:54:42.333 INFO:teuthology.orchestra.run.smithi101.stdout: { 2023-08-01T19:54:42.333 INFO:teuthology.orchestra.run.smithi101.stdout: "event": "sub_op_commit_rec", 2023-08-01T19:54:42.333 INFO:teuthology.orchestra.run.smithi101.stdout: "time": "2023-08-01T19:54:04.477428+0000", 2023-08-01T19:54:42.333 INFO:teuthology.orchestra.run.smithi101.stdout: "duration": 0.001244843 2023-08-01T19:54:42.333 INFO:teuthology.orchestra.run.smithi101.stdout: }, 2023-08-01T19:54:42.333 INFO:teuthology.orchestra.run.smithi101.stdout: { 2023-08-01T19:54:42.333 INFO:teuthology.orchestra.run.smithi101.stdout: "event": "commit_sent", 2023-08-01T19:54:42.333 INFO:teuthology.orchestra.run.smithi101.stdout: "time": "2023-08-01T19:54:04.477456+0000", 2023-08-01T19:54:42.334 INFO:teuthology.orchestra.run.smithi101.stdout: "duration": 2.7538e-05 2023-08-01T19:54:42.334 INFO:teuthology.orchestra.run.smithi101.stdout: }, 2023-08-01T19:54:42.334 INFO:teuthology.orchestra.run.smithi101.stdout: { 2023-08-01T19:54:42.334 INFO:teuthology.orchestra.run.smithi101.stdout: "event": "done", 2023-08-01T19:54:42.334 INFO:teuthology.orchestra.run.smithi101.stdout: "time": "2023-08-01T19:54:04.477474+0000", 2023-08-01T19:54:42.334 INFO:teuthology.orchestra.run.smithi101.stdout: "duration": 1.7974000000000001e-05 2023-08-01T19:54:42.334 INFO:teuthology.orchestra.run.smithi101.stdout: } 2023-08-01T19:54:42.334 INFO:teuthology.orchestra.run.smithi101.stdout: ] 2023-08-01T19:54:42.335 INFO:teuthology.orchestra.run.smithi101.stdout: } 2023-08-01T19:54:42.335 INFO:teuthology.orchestra.run.smithi101.stdout: }, 2023-08-01T19:54:42.335 INFO:teuthology.orchestra.run.smithi101.stdout: { 2023-08-01T19:54:42.335 INFO:teuthology.orchestra.run.smithi101.stdout: "description": "osd_op(mds.0.3:10 3.10 3:0bd6d154:::602.00000000:head [omap-set-header] snapc 0=[] ondisk+write+known_if_redirected+full_force+supports_pool_eio e17)", 2023-08-01T19:54:42.335 INFO:teuthology.orchestra.run.smithi101.stdout: "initiated_at": "2023-08-01T19:54:04.458927+0000", 2023-08-01T19:54:42.335 INFO:teuthology.orchestra.run.smithi101.stdout: "age": 37.828643466000003, 2023-08-01T19:54:42.335 INFO:teuthology.orchestra.run.smithi101.stdout: "duration": 0.019574352, 2023-08-01T19:54:42.335 INFO:teuthology.orchestra.run.smithi101.stdout: "type_data": { 2023-08-01T19:54:42.336 INFO:teuthology.orchestra.run.smithi101.stdout: "flag_point": "commit sent; apply or cleanup", 2023-08-01T19:54:42.336 INFO:teuthology.orchestra.run.smithi101.stdout: "events": [ 2023-08-01T19:54:42.336 INFO:teuthology.orchestra.run.smithi101.stdout: { 2023-08-01T19:54:42.336 INFO:teuthology.orchestra.run.smithi101.stdout: "event": "initiated", 2023-08-01T19:54:42.336 INFO:teuthology.orchestra.run.smithi101.stdout: "time": "2023-08-01T19:54:04.458927+0000", 2023-08-01T19:54:42.336 INFO:teuthology.orchestra.run.smithi101.stdout: "duration": 0 2023-08-01T19:54:42.336 INFO:teuthology.orchestra.run.smithi101.stdout: }, 2023-08-01T19:54:42.336 INFO:teuthology.orchestra.run.smithi101.stdout: { 2023-08-01T19:54:42.337 INFO:teuthology.orchestra.run.smithi101.stdout: "event": "throttled", 2023-08-01T19:54:42.337 INFO:teuthology.orchestra.run.smithi101.stdout: "time": "2023-08-01T19:54:04.458927+0000", 2023-08-01T19:54:42.337 INFO:teuthology.orchestra.run.smithi101.stdout: "duration": 0 2023-08-01T19:54:42.337 INFO:teuthology.orchestra.run.smithi101.stdout: }, 2023-08-01T19:54:42.337 INFO:teuthology.orchestra.run.smithi101.stdout: { 2023-08-01T19:54:42.337 INFO:teuthology.orchestra.run.smithi101.stdout: "event": "header_read", 2023-08-01T19:54:42.337 INFO:teuthology.orchestra.run.smithi101.stdout: "time": "2023-08-01T19:54:04.458927+0000", 2023-08-01T19:54:42.337 INFO:teuthology.orchestra.run.smithi101.stdout: "duration": 4294967295.9999995 2023-08-01T19:54:42.338 INFO:teuthology.orchestra.run.smithi101.stdout: }, 2023-08-01T19:54:42.338 INFO:teuthology.orchestra.run.smithi101.stdout: { 2023-08-01T19:54:42.338 INFO:teuthology.orchestra.run.smithi101.stdout: "event": "all_read", 2023-08-01T19:54:42.338 INFO:teuthology.orchestra.run.smithi101.stdout: "time": "2023-08-01T19:54:04.458931+0000", 2023-08-01T19:54:42.338 INFO:teuthology.orchestra.run.smithi101.stdout: "duration": 4.3000000000000003e-06 2023-08-01T19:54:42.338 INFO:teuthology.orchestra.run.smithi101.stdout: }, 2023-08-01T19:54:42.338 INFO:teuthology.orchestra.run.smithi101.stdout: { 2023-08-01T19:54:42.338 INFO:teuthology.orchestra.run.smithi101.stdout: "event": "dispatched", 2023-08-01T19:54:42.339 INFO:teuthology.orchestra.run.smithi101.stdout: "time": "2023-08-01T19:54:04.458938+0000", 2023-08-01T19:54:42.339 INFO:teuthology.orchestra.run.smithi101.stdout: "duration": 7.3220000000000004e-06 2023-08-01T19:54:42.339 INFO:teuthology.orchestra.run.smithi101.stdout: }, 2023-08-01T19:54:42.339 INFO:teuthology.orchestra.run.smithi101.stdout: { 2023-08-01T19:54:42.339 INFO:teuthology.orchestra.run.smithi101.stdout: "event": "queued_for_pg", 2023-08-01T19:54:42.339 INFO:teuthology.orchestra.run.smithi101.stdout: "time": "2023-08-01T19:54:04.458944+0000", 2023-08-01T19:54:42.339 INFO:teuthology.orchestra.run.smithi101.stdout: "duration": 5.3040000000000004e-06 2023-08-01T19:54:42.340 INFO:teuthology.orchestra.run.smithi101.stdout: }, 2023-08-01T19:54:42.340 INFO:teuthology.orchestra.run.smithi101.stdout: { 2023-08-01T19:54:42.340 INFO:teuthology.orchestra.run.smithi101.stdout: "event": "reached_pg", 2023-08-01T19:54:42.340 INFO:teuthology.orchestra.run.smithi101.stdout: "time": "2023-08-01T19:54:04.459006+0000", 2023-08-01T19:54:42.340 INFO:teuthology.orchestra.run.smithi101.stdout: "duration": 6.2081000000000004e-05 2023-08-01T19:54:42.340 INFO:teuthology.orchestra.run.smithi101.stdout: }, 2023-08-01T19:54:42.340 INFO:teuthology.orchestra.run.smithi101.stdout: { 2023-08-01T19:54:42.340 INFO:teuthology.orchestra.run.smithi101.stdout: "event": "waiting_for_map not empty", 2023-08-01T19:54:42.341 INFO:teuthology.orchestra.run.smithi101.stdout: "time": "2023-08-01T19:54:04.459008+0000", 2023-08-01T19:54:42.341 INFO:teuthology.orchestra.run.smithi101.stdout: "duration": 2.2500000000000001e-06 2023-08-01T19:54:42.341 INFO:teuthology.orchestra.run.smithi101.stdout: }, 2023-08-01T19:54:42.341 INFO:teuthology.orchestra.run.smithi101.stdout: { 2023-08-01T19:54:42.341 INFO:teuthology.orchestra.run.smithi101.stdout: "event": "reached_pg", 2023-08-01T19:54:42.341 INFO:teuthology.orchestra.run.smithi101.stdout: "time": "2023-08-01T19:54:04.470946+0000", 2023-08-01T19:54:42.341 INFO:teuthology.orchestra.run.smithi101.stdout: "duration": 0.011938347 2023-08-01T19:54:42.341 INFO:teuthology.orchestra.run.smithi101.stdout: }, 2023-08-01T19:54:42.342 INFO:teuthology.orchestra.run.smithi101.stdout: { 2023-08-01T19:54:42.342 INFO:teuthology.orchestra.run.smithi101.stdout: "event": "started", 2023-08-01T19:54:42.342 INFO:teuthology.orchestra.run.smithi101.stdout: "time": "2023-08-01T19:54:04.471071+0000", 2023-08-01T19:54:42.342 INFO:teuthology.orchestra.run.smithi101.stdout: "duration": 0.00012470299999999999 2023-08-01T19:54:42.342 INFO:teuthology.orchestra.run.smithi101.stdout: }, 2023-08-01T19:54:42.342 INFO:teuthology.orchestra.run.smithi101.stdout: { 2023-08-01T19:54:42.342 INFO:teuthology.orchestra.run.smithi101.stdout: "event": "waiting for subops from 2", 2023-08-01T19:54:42.342 INFO:teuthology.orchestra.run.smithi101.stdout: "time": "2023-08-01T19:54:04.471205+0000", 2023-08-01T19:54:42.343 INFO:teuthology.orchestra.run.smithi101.stdout: "duration": 0.000133891 2023-08-01T19:54:42.343 INFO:teuthology.orchestra.run.smithi101.stdout: }, 2023-08-01T19:54:42.343 INFO:teuthology.orchestra.run.smithi101.stdout: { 2023-08-01T19:54:42.343 INFO:teuthology.orchestra.run.smithi101.stdout: "event": "op_commit", 2023-08-01T19:54:42.343 INFO:teuthology.orchestra.run.smithi101.stdout: "time": "2023-08-01T19:54:04.477042+0000", 2023-08-01T19:54:42.343 INFO:teuthology.orchestra.run.smithi101.stdout: "duration": 0.0058374849999999999 2023-08-01T19:54:42.343 INFO:teuthology.orchestra.run.smithi101.stdout: }, 2023-08-01T19:54:42.343 INFO:teuthology.orchestra.run.smithi101.stdout: { 2023-08-01T19:54:42.344 INFO:teuthology.orchestra.run.smithi101.stdout: "event": "sub_op_commit_rec", 2023-08-01T19:54:42.344 INFO:teuthology.orchestra.run.smithi101.stdout: "time": "2023-08-01T19:54:04.478445+0000", 2023-08-01T19:54:42.344 INFO:teuthology.orchestra.run.smithi101.stdout: "duration": 0.0014023239999999999 2023-08-01T19:54:42.344 INFO:teuthology.orchestra.run.smithi101.stdout: }, 2023-08-01T19:54:42.344 INFO:teuthology.orchestra.run.smithi101.stdout: { 2023-08-01T19:54:42.344 INFO:teuthology.orchestra.run.smithi101.stdout: "event": "commit_sent", 2023-08-01T19:54:42.344 INFO:teuthology.orchestra.run.smithi101.stdout: "time": "2023-08-01T19:54:04.478478+0000", 2023-08-01T19:54:42.345 INFO:teuthology.orchestra.run.smithi101.stdout: "duration": 3.3503000000000001e-05 2023-08-01T19:54:42.345 INFO:teuthology.orchestra.run.smithi101.stdout: }, 2023-08-01T19:54:42.345 INFO:teuthology.orchestra.run.smithi101.stdout: { 2023-08-01T19:54:42.345 INFO:teuthology.orchestra.run.smithi101.stdout: "event": "done", 2023-08-01T19:54:42.345 INFO:teuthology.orchestra.run.smithi101.stdout: "time": "2023-08-01T19:54:04.478502+0000", 2023-08-01T19:54:42.345 INFO:teuthology.orchestra.run.smithi101.stdout: "duration": 2.3402000000000001e-05 2023-08-01T19:54:42.345 INFO:teuthology.orchestra.run.smithi101.stdout: } 2023-08-01T19:54:42.345 INFO:teuthology.orchestra.run.smithi101.stdout: ] 2023-08-01T19:54:42.346 INFO:teuthology.orchestra.run.smithi101.stdout: } 2023-08-01T19:54:42.346 INFO:teuthology.orchestra.run.smithi101.stdout: }, 2023-08-01T19:54:42.346 INFO:teuthology.orchestra.run.smithi101.stdout: { 2023-08-01T19:54:42.346 INFO:teuthology.orchestra.run.smithi101.stdout: "description": "osd_op(mds.0.3:11 3.10 3:0bd6d154:::602.00000000:head [create,setxattr parent (62) in=6b,setxattr layout (30) in=6b] snapc 0=[] ondisk+write+known_if_redirected+full_force+supports_pool_eio e17)", 2023-08-01T19:54:42.346 INFO:teuthology.orchestra.run.smithi101.stdout: "initiated_at": "2023-08-01T19:54:04.458960+0000", 2023-08-01T19:54:42.346 INFO:teuthology.orchestra.run.smithi101.stdout: "age": 37.828611017999997, 2023-08-01T19:54:42.346 INFO:teuthology.orchestra.run.smithi101.stdout: "duration": 0.019645459000000001, 2023-08-01T19:54:42.346 INFO:teuthology.orchestra.run.smithi101.stdout: "type_data": { 2023-08-01T19:54:42.347 INFO:teuthology.orchestra.run.smithi101.stdout: "flag_point": "commit sent; apply or cleanup", 2023-08-01T19:54:42.347 INFO:teuthology.orchestra.run.smithi101.stdout: "events": [ 2023-08-01T19:54:42.347 INFO:teuthology.orchestra.run.smithi101.stdout: { 2023-08-01T19:54:42.347 INFO:teuthology.orchestra.run.smithi101.stdout: "event": "initiated", 2023-08-01T19:54:42.347 INFO:teuthology.orchestra.run.smithi101.stdout: "time": "2023-08-01T19:54:04.458960+0000", 2023-08-01T19:54:42.347 INFO:teuthology.orchestra.run.smithi101.stdout: "duration": 0 2023-08-01T19:54:42.347 INFO:teuthology.orchestra.run.smithi101.stdout: }, 2023-08-01T19:54:42.347 INFO:teuthology.orchestra.run.smithi101.stdout: { 2023-08-01T19:54:42.348 INFO:teuthology.orchestra.run.smithi101.stdout: "event": "throttled", 2023-08-01T19:54:42.348 INFO:teuthology.orchestra.run.smithi101.stdout: "time": "2023-08-01T19:54:04.458960+0000", 2023-08-01T19:54:42.348 INFO:teuthology.orchestra.run.smithi101.stdout: "duration": 0 2023-08-01T19:54:42.348 INFO:teuthology.orchestra.run.smithi101.stdout: }, 2023-08-01T19:54:42.348 INFO:teuthology.orchestra.run.smithi101.stdout: { 2023-08-01T19:54:42.348 INFO:teuthology.orchestra.run.smithi101.stdout: "event": "header_read", 2023-08-01T19:54:42.348 INFO:teuthology.orchestra.run.smithi101.stdout: "time": "2023-08-01T19:54:04.458959+0000", 2023-08-01T19:54:42.348 INFO:teuthology.orchestra.run.smithi101.stdout: "duration": 4294967295.9999995 2023-08-01T19:54:42.349 INFO:teuthology.orchestra.run.smithi101.stdout: }, 2023-08-01T19:54:42.349 INFO:teuthology.orchestra.run.smithi101.stdout: { 2023-08-01T19:54:42.349 INFO:teuthology.orchestra.run.smithi101.stdout: "event": "all_read", 2023-08-01T19:54:42.349 INFO:teuthology.orchestra.run.smithi101.stdout: "time": "2023-08-01T19:54:04.458963+0000", 2023-08-01T19:54:42.349 INFO:teuthology.orchestra.run.smithi101.stdout: "duration": 3.9199999999999997e-06 2023-08-01T19:54:42.349 INFO:teuthology.orchestra.run.smithi101.stdout: }, 2023-08-01T19:54:42.349 INFO:teuthology.orchestra.run.smithi101.stdout: { 2023-08-01T19:54:42.349 INFO:teuthology.orchestra.run.smithi101.stdout: "event": "dispatched", 2023-08-01T19:54:42.350 INFO:teuthology.orchestra.run.smithi101.stdout: "time": "2023-08-01T19:54:04.458970+0000", 2023-08-01T19:54:42.350 INFO:teuthology.orchestra.run.smithi101.stdout: "duration": 7.0439999999999998e-06 2023-08-01T19:54:42.350 INFO:teuthology.orchestra.run.smithi101.stdout: }, 2023-08-01T19:54:42.350 INFO:teuthology.orchestra.run.smithi101.stdout: { 2023-08-01T19:54:42.350 INFO:teuthology.orchestra.run.smithi101.stdout: "event": "queued_for_pg", 2023-08-01T19:54:42.350 INFO:teuthology.orchestra.run.smithi101.stdout: "time": "2023-08-01T19:54:04.458976+0000", 2023-08-01T19:54:42.350 INFO:teuthology.orchestra.run.smithi101.stdout: "duration": 5.9540000000000001e-06 2023-08-01T19:54:42.350 INFO:teuthology.orchestra.run.smithi101.stdout: }, 2023-08-01T19:54:42.351 INFO:teuthology.orchestra.run.smithi101.stdout: { 2023-08-01T19:54:42.351 INFO:teuthology.orchestra.run.smithi101.stdout: "event": "reached_pg", 2023-08-01T19:54:42.351 INFO:teuthology.orchestra.run.smithi101.stdout: "time": "2023-08-01T19:54:04.459035+0000", 2023-08-01T19:54:42.351 INFO:teuthology.orchestra.run.smithi101.stdout: "duration": 5.8924e-05 2023-08-01T19:54:42.351 INFO:teuthology.orchestra.run.smithi101.stdout: }, 2023-08-01T19:54:42.351 INFO:teuthology.orchestra.run.smithi101.stdout: { 2023-08-01T19:54:42.351 INFO:teuthology.orchestra.run.smithi101.stdout: "event": "waiting_for_map not empty", 2023-08-01T19:54:42.351 INFO:teuthology.orchestra.run.smithi101.stdout: "time": "2023-08-01T19:54:04.459038+0000", 2023-08-01T19:54:42.352 INFO:teuthology.orchestra.run.smithi101.stdout: "duration": 3.2760000000000001e-06 2023-08-01T19:54:42.352 INFO:teuthology.orchestra.run.smithi101.stdout: }, 2023-08-01T19:54:42.352 INFO:teuthology.orchestra.run.smithi101.stdout: { 2023-08-01T19:54:42.352 INFO:teuthology.orchestra.run.smithi101.stdout: "event": "reached_pg", 2023-08-01T19:54:42.352 INFO:teuthology.orchestra.run.smithi101.stdout: "time": "2023-08-01T19:54:04.471511+0000", 2023-08-01T19:54:42.352 INFO:teuthology.orchestra.run.smithi101.stdout: "duration": 0.012473039999999999 2023-08-01T19:54:42.352 INFO:teuthology.orchestra.run.smithi101.stdout: }, 2023-08-01T19:54:42.353 INFO:teuthology.orchestra.run.smithi101.stdout: { 2023-08-01T19:54:42.353 INFO:teuthology.orchestra.run.smithi101.stdout: "event": "started", 2023-08-01T19:54:42.353 INFO:teuthology.orchestra.run.smithi101.stdout: "time": "2023-08-01T19:54:04.472086+0000", 2023-08-01T19:54:42.353 INFO:teuthology.orchestra.run.smithi101.stdout: "duration": 0.00057491699999999998 2023-08-01T19:54:42.353 INFO:teuthology.orchestra.run.smithi101.stdout: }, 2023-08-01T19:54:42.353 INFO:teuthology.orchestra.run.smithi101.stdout: { 2023-08-01T19:54:42.353 INFO:teuthology.orchestra.run.smithi101.stdout: "event": "waiting for subops from 2", 2023-08-01T19:54:42.353 INFO:teuthology.orchestra.run.smithi101.stdout: "time": "2023-08-01T19:54:04.472310+0000", 2023-08-01T19:54:42.354 INFO:teuthology.orchestra.run.smithi101.stdout: "duration": 0.00022396499999999999 2023-08-01T19:54:42.354 INFO:teuthology.orchestra.run.smithi101.stdout: }, 2023-08-01T19:54:42.354 INFO:teuthology.orchestra.run.smithi101.stdout: { 2023-08-01T19:54:42.354 INFO:teuthology.orchestra.run.smithi101.stdout: "event": "op_commit", 2023-08-01T19:54:42.354 INFO:teuthology.orchestra.run.smithi101.stdout: "time": "2023-08-01T19:54:04.478141+0000", 2023-08-01T19:54:42.354 INFO:teuthology.orchestra.run.smithi101.stdout: "duration": 0.0058312320000000004 2023-08-01T19:54:42.354 INFO:teuthology.orchestra.run.smithi101.stdout: }, 2023-08-01T19:54:42.354 INFO:teuthology.orchestra.run.smithi101.stdout: { 2023-08-01T19:54:42.355 INFO:teuthology.orchestra.run.smithi101.stdout: "event": "sub_op_commit_rec", 2023-08-01T19:54:42.355 INFO:teuthology.orchestra.run.smithi101.stdout: "time": "2023-08-01T19:54:04.478543+0000", 2023-08-01T19:54:42.355 INFO:teuthology.orchestra.run.smithi101.stdout: "duration": 0.00040160800000000002 2023-08-01T19:54:42.355 INFO:teuthology.orchestra.run.smithi101.stdout: }, 2023-08-01T19:54:42.355 INFO:teuthology.orchestra.run.smithi101.stdout: { 2023-08-01T19:54:42.355 INFO:teuthology.orchestra.run.smithi101.stdout: "event": "commit_sent", 2023-08-01T19:54:42.355 INFO:teuthology.orchestra.run.smithi101.stdout: "time": "2023-08-01T19:54:04.478584+0000", 2023-08-01T19:54:42.355 INFO:teuthology.orchestra.run.smithi101.stdout: "duration": 4.0989999999999999e-05 2023-08-01T19:54:42.356 INFO:teuthology.orchestra.run.smithi101.stdout: }, 2023-08-01T19:54:42.356 INFO:teuthology.orchestra.run.smithi101.stdout: { 2023-08-01T19:54:42.356 INFO:teuthology.orchestra.run.smithi101.stdout: "event": "done", 2023-08-01T19:54:42.356 INFO:teuthology.orchestra.run.smithi101.stdout: "time": "2023-08-01T19:54:04.478605+0000", 2023-08-01T19:54:42.356 INFO:teuthology.orchestra.run.smithi101.stdout: "duration": 2.1178e-05 2023-08-01T19:54:42.356 INFO:teuthology.orchestra.run.smithi101.stdout: } 2023-08-01T19:54:42.356 INFO:teuthology.orchestra.run.smithi101.stdout: ] 2023-08-01T19:54:42.356 INFO:teuthology.orchestra.run.smithi101.stdout: } 2023-08-01T19:54:42.357 INFO:teuthology.orchestra.run.smithi101.stdout: }, 2023-08-01T19:54:42.357 INFO:teuthology.orchestra.run.smithi101.stdout: { 2023-08-01T19:54:42.357 INFO:teuthology.orchestra.run.smithi101.stdout: "description": "osd_op(mds.0.3:12 3.10 3:0d89b25e:::603.00000000:head [omap-set-header] snapc 0=[] ondisk+write+known_if_redirected+full_force+supports_pool_eio e17)", 2023-08-01T19:54:42.357 INFO:teuthology.orchestra.run.smithi101.stdout: "initiated_at": "2023-08-01T19:54:04.458982+0000", 2023-08-01T19:54:42.357 INFO:teuthology.orchestra.run.smithi101.stdout: "age": 37.828588789999998, 2023-08-01T19:54:42.357 INFO:teuthology.orchestra.run.smithi101.stdout: "duration": 0.021266334000000001, 2023-08-01T19:54:42.357 INFO:teuthology.orchestra.run.smithi101.stdout: "type_data": { 2023-08-01T19:54:42.357 INFO:teuthology.orchestra.run.smithi101.stdout: "flag_point": "commit sent; apply or cleanup", 2023-08-01T19:54:42.358 INFO:teuthology.orchestra.run.smithi101.stdout: "events": [ 2023-08-01T19:54:42.358 INFO:teuthology.orchestra.run.smithi101.stdout: { 2023-08-01T19:54:42.358 INFO:teuthology.orchestra.run.smithi101.stdout: "event": "initiated", 2023-08-01T19:54:42.358 INFO:teuthology.orchestra.run.smithi101.stdout: "time": "2023-08-01T19:54:04.458982+0000", 2023-08-01T19:54:42.358 INFO:teuthology.orchestra.run.smithi101.stdout: "duration": 0 2023-08-01T19:54:42.358 INFO:teuthology.orchestra.run.smithi101.stdout: }, 2023-08-01T19:54:42.358 INFO:teuthology.orchestra.run.smithi101.stdout: { 2023-08-01T19:54:42.358 INFO:teuthology.orchestra.run.smithi101.stdout: "event": "throttled", 2023-08-01T19:54:42.359 INFO:teuthology.orchestra.run.smithi101.stdout: "time": "2023-08-01T19:54:04.458982+0000", 2023-08-01T19:54:42.359 INFO:teuthology.orchestra.run.smithi101.stdout: "duration": 0 2023-08-01T19:54:42.359 INFO:teuthology.orchestra.run.smithi101.stdout: }, 2023-08-01T19:54:42.359 INFO:teuthology.orchestra.run.smithi101.stdout: { 2023-08-01T19:54:42.359 INFO:teuthology.orchestra.run.smithi101.stdout: "event": "header_read", 2023-08-01T19:54:42.359 INFO:teuthology.orchestra.run.smithi101.stdout: "time": "2023-08-01T19:54:04.458982+0000", 2023-08-01T19:54:42.359 INFO:teuthology.orchestra.run.smithi101.stdout: "duration": 4294967295.9999995 2023-08-01T19:54:42.359 INFO:teuthology.orchestra.run.smithi101.stdout: }, 2023-08-01T19:54:42.360 INFO:teuthology.orchestra.run.smithi101.stdout: { 2023-08-01T19:54:42.360 INFO:teuthology.orchestra.run.smithi101.stdout: "event": "all_read", 2023-08-01T19:54:42.360 INFO:teuthology.orchestra.run.smithi101.stdout: "time": "2023-08-01T19:54:04.458985+0000", 2023-08-01T19:54:42.360 INFO:teuthology.orchestra.run.smithi101.stdout: "duration": 3.4800000000000001e-06 2023-08-01T19:54:42.360 INFO:teuthology.orchestra.run.smithi101.stdout: }, 2023-08-01T19:54:42.360 INFO:teuthology.orchestra.run.smithi101.stdout: { 2023-08-01T19:54:42.360 INFO:teuthology.orchestra.run.smithi101.stdout: "event": "dispatched", 2023-08-01T19:54:42.361 INFO:teuthology.orchestra.run.smithi101.stdout: "time": "2023-08-01T19:54:04.458992+0000", 2023-08-01T19:54:42.361 INFO:teuthology.orchestra.run.smithi101.stdout: "duration": 7.306e-06 2023-08-01T19:54:42.361 INFO:teuthology.orchestra.run.smithi101.stdout: }, 2023-08-01T19:54:42.361 INFO:teuthology.orchestra.run.smithi101.stdout: { 2023-08-01T19:54:42.361 INFO:teuthology.orchestra.run.smithi101.stdout: "event": "queued_for_pg", 2023-08-01T19:54:42.361 INFO:teuthology.orchestra.run.smithi101.stdout: "time": "2023-08-01T19:54:04.458997+0000", 2023-08-01T19:54:42.361 INFO:teuthology.orchestra.run.smithi101.stdout: "duration": 4.4530000000000004e-06 2023-08-01T19:54:42.361 INFO:teuthology.orchestra.run.smithi101.stdout: }, 2023-08-01T19:54:42.362 INFO:teuthology.orchestra.run.smithi101.stdout: { 2023-08-01T19:54:42.362 INFO:teuthology.orchestra.run.smithi101.stdout: "event": "reached_pg", 2023-08-01T19:54:42.362 INFO:teuthology.orchestra.run.smithi101.stdout: "time": "2023-08-01T19:54:04.459060+0000", 2023-08-01T19:54:42.362 INFO:teuthology.orchestra.run.smithi101.stdout: "duration": 6.3249000000000004e-05 2023-08-01T19:54:42.362 INFO:teuthology.orchestra.run.smithi101.stdout: }, 2023-08-01T19:54:42.362 INFO:teuthology.orchestra.run.smithi101.stdout: { 2023-08-01T19:54:42.362 INFO:teuthology.orchestra.run.smithi101.stdout: "event": "waiting_for_map not empty", 2023-08-01T19:54:42.362 INFO:teuthology.orchestra.run.smithi101.stdout: "time": "2023-08-01T19:54:04.459063+0000", 2023-08-01T19:54:42.363 INFO:teuthology.orchestra.run.smithi101.stdout: "duration": 2.717e-06 2023-08-01T19:54:42.363 INFO:teuthology.orchestra.run.smithi101.stdout: }, 2023-08-01T19:54:42.363 INFO:teuthology.orchestra.run.smithi101.stdout: { 2023-08-01T19:54:42.363 INFO:teuthology.orchestra.run.smithi101.stdout: "event": "reached_pg", 2023-08-01T19:54:42.363 INFO:teuthology.orchestra.run.smithi101.stdout: "time": "2023-08-01T19:54:04.473625+0000", 2023-08-01T19:54:42.363 INFO:teuthology.orchestra.run.smithi101.stdout: "duration": 0.014562007 2023-08-01T19:54:42.363 INFO:teuthology.orchestra.run.smithi101.stdout: }, 2023-08-01T19:54:42.363 INFO:teuthology.orchestra.run.smithi101.stdout: { 2023-08-01T19:54:42.364 INFO:teuthology.orchestra.run.smithi101.stdout: "event": "started", 2023-08-01T19:54:42.364 INFO:teuthology.orchestra.run.smithi101.stdout: "time": "2023-08-01T19:54:04.473757+0000", 2023-08-01T19:54:42.364 INFO:teuthology.orchestra.run.smithi101.stdout: "duration": 0.00013238599999999999 2023-08-01T19:54:42.364 INFO:teuthology.orchestra.run.smithi101.stdout: }, 2023-08-01T19:54:42.364 INFO:teuthology.orchestra.run.smithi101.stdout: { 2023-08-01T19:54:42.364 INFO:teuthology.orchestra.run.smithi101.stdout: "event": "waiting for subops from 2", 2023-08-01T19:54:42.364 INFO:teuthology.orchestra.run.smithi101.stdout: "time": "2023-08-01T19:54:04.473898+0000", 2023-08-01T19:54:42.364 INFO:teuthology.orchestra.run.smithi101.stdout: "duration": 0.00014039 2023-08-01T19:54:42.365 INFO:teuthology.orchestra.run.smithi101.stdout: }, 2023-08-01T19:54:42.365 INFO:teuthology.orchestra.run.smithi101.stdout: { 2023-08-01T19:54:42.365 INFO:teuthology.orchestra.run.smithi101.stdout: "event": "op_commit", 2023-08-01T19:54:42.365 INFO:teuthology.orchestra.run.smithi101.stdout: "time": "2023-08-01T19:54:04.478380+0000", 2023-08-01T19:54:42.365 INFO:teuthology.orchestra.run.smithi101.stdout: "duration": 0.0044827449999999998 2023-08-01T19:54:42.365 INFO:teuthology.orchestra.run.smithi101.stdout: }, 2023-08-01T19:54:42.365 INFO:teuthology.orchestra.run.smithi101.stdout: { 2023-08-01T19:54:42.365 INFO:teuthology.orchestra.run.smithi101.stdout: "event": "sub_op_commit_rec", 2023-08-01T19:54:42.366 INFO:teuthology.orchestra.run.smithi101.stdout: "time": "2023-08-01T19:54:04.480169+0000", 2023-08-01T19:54:42.366 INFO:teuthology.orchestra.run.smithi101.stdout: "duration": 0.0017886040000000001 2023-08-01T19:54:42.366 INFO:teuthology.orchestra.run.smithi101.stdout: }, 2023-08-01T19:54:42.366 INFO:teuthology.orchestra.run.smithi101.stdout: { 2023-08-01T19:54:42.366 INFO:teuthology.orchestra.run.smithi101.stdout: "event": "commit_sent", 2023-08-01T19:54:42.366 INFO:teuthology.orchestra.run.smithi101.stdout: "time": "2023-08-01T19:54:04.480212+0000", 2023-08-01T19:54:42.366 INFO:teuthology.orchestra.run.smithi101.stdout: "duration": 4.2687e-05 2023-08-01T19:54:42.366 INFO:teuthology.orchestra.run.smithi101.stdout: }, 2023-08-01T19:54:42.367 INFO:teuthology.orchestra.run.smithi101.stdout: { 2023-08-01T19:54:42.367 INFO:teuthology.orchestra.run.smithi101.stdout: "event": "done", 2023-08-01T19:54:42.367 INFO:teuthology.orchestra.run.smithi101.stdout: "time": "2023-08-01T19:54:04.480248+0000", 2023-08-01T19:54:42.367 INFO:teuthology.orchestra.run.smithi101.stdout: "duration": 3.6743999999999999e-05 2023-08-01T19:54:42.367 INFO:teuthology.orchestra.run.smithi101.stdout: } 2023-08-01T19:54:42.367 INFO:teuthology.orchestra.run.smithi101.stdout: ] 2023-08-01T19:54:42.367 INFO:teuthology.orchestra.run.smithi101.stdout: } 2023-08-01T19:54:42.368 INFO:teuthology.orchestra.run.smithi101.stdout: }, 2023-08-01T19:54:42.368 INFO:teuthology.orchestra.run.smithi101.stdout: { 2023-08-01T19:54:42.368 INFO:teuthology.orchestra.run.smithi101.stdout: "description": "osd_op(mds.0.3:13 3.10 3:0d89b25e:::603.00000000:head [create,setxattr parent (62) in=6b,setxattr layout (30) in=6b] snapc 0=[] ondisk+write+known_if_redirected+full_force+supports_pool_eio e17)", 2023-08-01T19:54:42.368 INFO:teuthology.orchestra.run.smithi101.stdout: "initiated_at": "2023-08-01T19:54:04.459010+0000", 2023-08-01T19:54:42.368 INFO:teuthology.orchestra.run.smithi101.stdout: "age": 37.828561069999999, 2023-08-01T19:54:42.368 INFO:teuthology.orchestra.run.smithi101.stdout: "duration": 0.021327220000000001, 2023-08-01T19:54:42.368 INFO:teuthology.orchestra.run.smithi101.stdout: "type_data": { 2023-08-01T19:54:42.368 INFO:teuthology.orchestra.run.smithi101.stdout: "flag_point": "commit sent; apply or cleanup", 2023-08-01T19:54:42.369 INFO:teuthology.orchestra.run.smithi101.stdout: "events": [ 2023-08-01T19:54:42.369 INFO:teuthology.orchestra.run.smithi101.stdout: { 2023-08-01T19:54:42.369 INFO:teuthology.orchestra.run.smithi101.stdout: "event": "initiated", 2023-08-01T19:54:42.369 INFO:teuthology.orchestra.run.smithi101.stdout: "time": "2023-08-01T19:54:04.459010+0000", 2023-08-01T19:54:42.369 INFO:teuthology.orchestra.run.smithi101.stdout: "duration": 0 2023-08-01T19:54:42.369 INFO:teuthology.orchestra.run.smithi101.stdout: }, 2023-08-01T19:54:42.369 INFO:teuthology.orchestra.run.smithi101.stdout: { 2023-08-01T19:54:42.369 INFO:teuthology.orchestra.run.smithi101.stdout: "event": "throttled", 2023-08-01T19:54:42.370 INFO:teuthology.orchestra.run.smithi101.stdout: "time": "2023-08-01T19:54:04.459010+0000", 2023-08-01T19:54:42.370 INFO:teuthology.orchestra.run.smithi101.stdout: "duration": 0 2023-08-01T19:54:42.370 INFO:teuthology.orchestra.run.smithi101.stdout: }, 2023-08-01T19:54:42.370 INFO:teuthology.orchestra.run.smithi101.stdout: { 2023-08-01T19:54:42.370 INFO:teuthology.orchestra.run.smithi101.stdout: "event": "header_read", 2023-08-01T19:54:42.370 INFO:teuthology.orchestra.run.smithi101.stdout: "time": "2023-08-01T19:54:04.459009+0000", 2023-08-01T19:54:42.370 INFO:teuthology.orchestra.run.smithi101.stdout: "duration": 4294967295.9999995 2023-08-01T19:54:42.370 INFO:teuthology.orchestra.run.smithi101.stdout: }, 2023-08-01T19:54:42.371 INFO:teuthology.orchestra.run.smithi101.stdout: { 2023-08-01T19:54:42.371 INFO:teuthology.orchestra.run.smithi101.stdout: "event": "all_read", 2023-08-01T19:54:42.371 INFO:teuthology.orchestra.run.smithi101.stdout: "time": "2023-08-01T19:54:04.459013+0000", 2023-08-01T19:54:42.371 INFO:teuthology.orchestra.run.smithi101.stdout: "duration": 3.8929999999999998e-06 2023-08-01T19:54:42.371 INFO:teuthology.orchestra.run.smithi101.stdout: }, 2023-08-01T19:54:42.371 INFO:teuthology.orchestra.run.smithi101.stdout: { 2023-08-01T19:54:42.371 INFO:teuthology.orchestra.run.smithi101.stdout: "event": "dispatched", 2023-08-01T19:54:42.371 INFO:teuthology.orchestra.run.smithi101.stdout: "time": "2023-08-01T19:54:04.459027+0000", 2023-08-01T19:54:42.372 INFO:teuthology.orchestra.run.smithi101.stdout: "duration": 1.3416e-05 2023-08-01T19:54:42.372 INFO:teuthology.orchestra.run.smithi101.stdout: }, 2023-08-01T19:54:42.372 INFO:teuthology.orchestra.run.smithi101.stdout: { 2023-08-01T19:54:42.372 INFO:teuthology.orchestra.run.smithi101.stdout: "event": "queued_for_pg", 2023-08-01T19:54:42.372 INFO:teuthology.orchestra.run.smithi101.stdout: "time": "2023-08-01T19:54:04.459033+0000", 2023-08-01T19:54:42.372 INFO:teuthology.orchestra.run.smithi101.stdout: "duration": 5.9800000000000003e-06 2023-08-01T19:54:42.372 INFO:teuthology.orchestra.run.smithi101.stdout: }, 2023-08-01T19:54:42.372 INFO:teuthology.orchestra.run.smithi101.stdout: { 2023-08-01T19:54:42.373 INFO:teuthology.orchestra.run.smithi101.stdout: "event": "reached_pg", 2023-08-01T19:54:42.373 INFO:teuthology.orchestra.run.smithi101.stdout: "time": "2023-08-01T19:54:04.459099+0000", 2023-08-01T19:54:42.373 INFO:teuthology.orchestra.run.smithi101.stdout: "duration": 6.6192999999999995e-05 2023-08-01T19:54:42.373 INFO:teuthology.orchestra.run.smithi101.stdout: }, 2023-08-01T19:54:42.373 INFO:teuthology.orchestra.run.smithi101.stdout: { 2023-08-01T19:54:42.373 INFO:teuthology.orchestra.run.smithi101.stdout: "event": "waiting_for_map not empty", 2023-08-01T19:54:42.373 INFO:teuthology.orchestra.run.smithi101.stdout: "time": "2023-08-01T19:54:04.459106+0000", 2023-08-01T19:54:42.373 INFO:teuthology.orchestra.run.smithi101.stdout: "duration": 6.8619999999999997e-06 2023-08-01T19:54:42.374 INFO:teuthology.orchestra.run.smithi101.stdout: }, 2023-08-01T19:54:42.374 INFO:teuthology.orchestra.run.smithi101.stdout: { 2023-08-01T19:54:42.374 INFO:teuthology.orchestra.run.smithi101.stdout: "event": "reached_pg", 2023-08-01T19:54:42.374 INFO:teuthology.orchestra.run.smithi101.stdout: "time": "2023-08-01T19:54:04.475182+0000", 2023-08-01T19:54:42.374 INFO:teuthology.orchestra.run.smithi101.stdout: "duration": 0.016076333000000002 2023-08-01T19:54:42.374 INFO:teuthology.orchestra.run.smithi101.stdout: }, 2023-08-01T19:54:42.374 INFO:teuthology.orchestra.run.smithi101.stdout: { 2023-08-01T19:54:42.374 INFO:teuthology.orchestra.run.smithi101.stdout: "event": "started", 2023-08-01T19:54:42.375 INFO:teuthology.orchestra.run.smithi101.stdout: "time": "2023-08-01T19:54:04.475353+0000", 2023-08-01T19:54:42.375 INFO:teuthology.orchestra.run.smithi101.stdout: "duration": 0.000171378 2023-08-01T19:54:42.375 INFO:teuthology.orchestra.run.smithi101.stdout: }, 2023-08-01T19:54:42.375 INFO:teuthology.orchestra.run.smithi101.stdout: { 2023-08-01T19:54:42.375 INFO:teuthology.orchestra.run.smithi101.stdout: "event": "waiting for subops from 2", 2023-08-01T19:54:42.375 INFO:teuthology.orchestra.run.smithi101.stdout: "time": "2023-08-01T19:54:04.475793+0000", 2023-08-01T19:54:42.375 INFO:teuthology.orchestra.run.smithi101.stdout: "duration": 0.000440123 2023-08-01T19:54:42.376 INFO:teuthology.orchestra.run.smithi101.stdout: }, 2023-08-01T19:54:42.376 INFO:teuthology.orchestra.run.smithi101.stdout: { 2023-08-01T19:54:42.376 INFO:teuthology.orchestra.run.smithi101.stdout: "event": "op_commit", 2023-08-01T19:54:42.376 INFO:teuthology.orchestra.run.smithi101.stdout: "time": "2023-08-01T19:54:04.478624+0000", 2023-08-01T19:54:42.376 INFO:teuthology.orchestra.run.smithi101.stdout: "duration": 0.0028305000000000001 2023-08-01T19:54:42.376 INFO:teuthology.orchestra.run.smithi101.stdout: }, 2023-08-01T19:54:42.376 INFO:teuthology.orchestra.run.smithi101.stdout: { 2023-08-01T19:54:42.376 INFO:teuthology.orchestra.run.smithi101.stdout: "event": "sub_op_commit_rec", 2023-08-01T19:54:42.377 INFO:teuthology.orchestra.run.smithi101.stdout: "time": "2023-08-01T19:54:04.480291+0000", 2023-08-01T19:54:42.377 INFO:teuthology.orchestra.run.smithi101.stdout: "duration": 0.0016670000000000001 2023-08-01T19:54:42.377 INFO:teuthology.orchestra.run.smithi101.stdout: }, 2023-08-01T19:54:42.377 INFO:teuthology.orchestra.run.smithi101.stdout: { 2023-08-01T19:54:42.377 INFO:teuthology.orchestra.run.smithi101.stdout: "event": "commit_sent", 2023-08-01T19:54:42.377 INFO:teuthology.orchestra.run.smithi101.stdout: "time": "2023-08-01T19:54:04.480318+0000", 2023-08-01T19:54:42.377 INFO:teuthology.orchestra.run.smithi101.stdout: "duration": 2.6815e-05 2023-08-01T19:54:42.377 INFO:teuthology.orchestra.run.smithi101.stdout: }, 2023-08-01T19:54:42.378 INFO:teuthology.orchestra.run.smithi101.stdout: { 2023-08-01T19:54:42.378 INFO:teuthology.orchestra.run.smithi101.stdout: "event": "done", 2023-08-01T19:54:42.378 INFO:teuthology.orchestra.run.smithi101.stdout: "time": "2023-08-01T19:54:04.480337+0000", 2023-08-01T19:54:42.378 INFO:teuthology.orchestra.run.smithi101.stdout: "duration": 1.9241000000000001e-05 2023-08-01T19:54:42.378 INFO:teuthology.orchestra.run.smithi101.stdout: } 2023-08-01T19:54:42.378 INFO:teuthology.orchestra.run.smithi101.stdout: ] 2023-08-01T19:54:42.378 INFO:teuthology.orchestra.run.smithi101.stdout: } 2023-08-01T19:54:42.378 INFO:teuthology.orchestra.run.smithi101.stdout: }, 2023-08-01T19:54:42.379 INFO:teuthology.orchestra.run.smithi101.stdout: { 2023-08-01T19:54:42.379 INFO:teuthology.orchestra.run.smithi101.stdout: "description": "osd_op(mds.0.3:18 3.14 3:2f55791f:::606.00000000:head [omap-set-header] snapc 0=[] ondisk+write+known_if_redirected+full_force+supports_pool_eio e17)", 2023-08-01T19:54:42.379 INFO:teuthology.orchestra.run.smithi101.stdout: "initiated_at": "2023-08-01T19:54:04.459039+0000", 2023-08-01T19:54:42.379 INFO:teuthology.orchestra.run.smithi101.stdout: "age": 37.828531775999998, 2023-08-01T19:54:42.379 INFO:teuthology.orchestra.run.smithi101.stdout: "duration": 0.018756419, 2023-08-01T19:54:42.379 INFO:teuthology.orchestra.run.smithi101.stdout: "type_data": { 2023-08-01T19:54:42.379 INFO:teuthology.orchestra.run.smithi101.stdout: "flag_point": "commit sent; apply or cleanup", 2023-08-01T19:54:42.379 INFO:teuthology.orchestra.run.smithi101.stdout: "events": [ 2023-08-01T19:54:42.380 INFO:teuthology.orchestra.run.smithi101.stdout: { 2023-08-01T19:54:42.380 INFO:teuthology.orchestra.run.smithi101.stdout: "event": "initiated", 2023-08-01T19:54:42.380 INFO:teuthology.orchestra.run.smithi101.stdout: "time": "2023-08-01T19:54:04.459039+0000", 2023-08-01T19:54:42.380 INFO:teuthology.orchestra.run.smithi101.stdout: "duration": 0 2023-08-01T19:54:42.380 INFO:teuthology.orchestra.run.smithi101.stdout: }, 2023-08-01T19:54:42.380 INFO:teuthology.orchestra.run.smithi101.stdout: { 2023-08-01T19:54:42.380 INFO:teuthology.orchestra.run.smithi101.stdout: "event": "throttled", 2023-08-01T19:54:42.380 INFO:teuthology.orchestra.run.smithi101.stdout: "time": "2023-08-01T19:54:04.459039+0000", 2023-08-01T19:54:42.381 INFO:teuthology.orchestra.run.smithi101.stdout: "duration": 0 2023-08-01T19:54:42.381 INFO:teuthology.orchestra.run.smithi101.stdout: }, 2023-08-01T19:54:42.381 INFO:teuthology.orchestra.run.smithi101.stdout: { 2023-08-01T19:54:42.381 INFO:teuthology.orchestra.run.smithi101.stdout: "event": "header_read", 2023-08-01T19:54:42.381 INFO:teuthology.orchestra.run.smithi101.stdout: "time": "2023-08-01T19:54:04.459039+0000", 2023-08-01T19:54:42.381 INFO:teuthology.orchestra.run.smithi101.stdout: "duration": 4294967295.9999995 2023-08-01T19:54:42.381 INFO:teuthology.orchestra.run.smithi101.stdout: }, 2023-08-01T19:54:42.381 INFO:teuthology.orchestra.run.smithi101.stdout: { 2023-08-01T19:54:42.382 INFO:teuthology.orchestra.run.smithi101.stdout: "event": "all_read", 2023-08-01T19:54:42.382 INFO:teuthology.orchestra.run.smithi101.stdout: "time": "2023-08-01T19:54:04.459043+0000", 2023-08-01T19:54:42.382 INFO:teuthology.orchestra.run.smithi101.stdout: "duration": 4.1500000000000001e-06 2023-08-01T19:54:42.382 INFO:teuthology.orchestra.run.smithi101.stdout: }, 2023-08-01T19:54:42.382 INFO:teuthology.orchestra.run.smithi101.stdout: { 2023-08-01T19:54:42.382 INFO:teuthology.orchestra.run.smithi101.stdout: "event": "dispatched", 2023-08-01T19:54:42.382 INFO:teuthology.orchestra.run.smithi101.stdout: "time": "2023-08-01T19:54:04.459051+0000", 2023-08-01T19:54:42.382 INFO:teuthology.orchestra.run.smithi101.stdout: "duration": 8.4190000000000002e-06 2023-08-01T19:54:42.383 INFO:teuthology.orchestra.run.smithi101.stdout: }, 2023-08-01T19:54:42.383 INFO:teuthology.orchestra.run.smithi101.stdout: { 2023-08-01T19:54:42.383 INFO:teuthology.orchestra.run.smithi101.stdout: "event": "queued_for_pg", 2023-08-01T19:54:42.383 INFO:teuthology.orchestra.run.smithi101.stdout: "time": "2023-08-01T19:54:04.459056+0000", 2023-08-01T19:54:42.383 INFO:teuthology.orchestra.run.smithi101.stdout: "duration": 5.339e-06 2023-08-01T19:54:42.383 INFO:teuthology.orchestra.run.smithi101.stdout: }, 2023-08-01T19:54:42.383 INFO:teuthology.orchestra.run.smithi101.stdout: { 2023-08-01T19:54:42.383 INFO:teuthology.orchestra.run.smithi101.stdout: "event": "reached_pg", 2023-08-01T19:54:42.384 INFO:teuthology.orchestra.run.smithi101.stdout: "time": "2023-08-01T19:54:04.459091+0000", 2023-08-01T19:54:42.384 INFO:teuthology.orchestra.run.smithi101.stdout: "duration": 3.4090000000000001e-05 2023-08-01T19:54:42.384 INFO:teuthology.orchestra.run.smithi101.stdout: }, 2023-08-01T19:54:42.384 INFO:teuthology.orchestra.run.smithi101.stdout: { 2023-08-01T19:54:42.384 INFO:teuthology.orchestra.run.smithi101.stdout: "event": "op must wait for map", 2023-08-01T19:54:42.384 INFO:teuthology.orchestra.run.smithi101.stdout: "time": "2023-08-01T19:54:04.459094+0000", 2023-08-01T19:54:42.384 INFO:teuthology.orchestra.run.smithi101.stdout: "duration": 3.303e-06 2023-08-01T19:54:42.385 INFO:teuthology.orchestra.run.smithi101.stdout: }, 2023-08-01T19:54:42.385 INFO:teuthology.orchestra.run.smithi101.stdout: { 2023-08-01T19:54:42.385 INFO:teuthology.orchestra.run.smithi101.stdout: "event": "reached_pg", 2023-08-01T19:54:42.385 INFO:teuthology.orchestra.run.smithi101.stdout: "time": "2023-08-01T19:54:04.469860+0000", 2023-08-01T19:54:42.385 INFO:teuthology.orchestra.run.smithi101.stdout: "duration": 0.010765749 2023-08-01T19:54:42.385 INFO:teuthology.orchestra.run.smithi101.stdout: }, 2023-08-01T19:54:42.385 INFO:teuthology.orchestra.run.smithi101.stdout: { 2023-08-01T19:54:42.385 INFO:teuthology.orchestra.run.smithi101.stdout: "event": "started", 2023-08-01T19:54:42.386 INFO:teuthology.orchestra.run.smithi101.stdout: "time": "2023-08-01T19:54:04.470008+0000", 2023-08-01T19:54:42.386 INFO:teuthology.orchestra.run.smithi101.stdout: "duration": 0.000148367 2023-08-01T19:54:42.386 INFO:teuthology.orchestra.run.smithi101.stdout: }, 2023-08-01T19:54:42.386 INFO:teuthology.orchestra.run.smithi101.stdout: { 2023-08-01T19:54:42.386 INFO:teuthology.orchestra.run.smithi101.stdout: "event": "waiting for subops from 2", 2023-08-01T19:54:42.386 INFO:teuthology.orchestra.run.smithi101.stdout: "time": "2023-08-01T19:54:04.470136+0000", 2023-08-01T19:54:42.386 INFO:teuthology.orchestra.run.smithi101.stdout: "duration": 0.000128329 2023-08-01T19:54:42.386 INFO:teuthology.orchestra.run.smithi101.stdout: }, 2023-08-01T19:54:42.387 INFO:teuthology.orchestra.run.smithi101.stdout: { 2023-08-01T19:54:42.387 INFO:teuthology.orchestra.run.smithi101.stdout: "event": "op_commit", 2023-08-01T19:54:42.387 INFO:teuthology.orchestra.run.smithi101.stdout: "time": "2023-08-01T19:54:04.476399+0000", 2023-08-01T19:54:42.387 INFO:teuthology.orchestra.run.smithi101.stdout: "duration": 0.0062627259999999997 2023-08-01T19:54:42.387 INFO:teuthology.orchestra.run.smithi101.stdout: }, 2023-08-01T19:54:42.387 INFO:teuthology.orchestra.run.smithi101.stdout: { 2023-08-01T19:54:42.387 INFO:teuthology.orchestra.run.smithi101.stdout: "event": "sub_op_commit_rec", 2023-08-01T19:54:42.387 INFO:teuthology.orchestra.run.smithi101.stdout: "time": "2023-08-01T19:54:04.477726+0000", 2023-08-01T19:54:42.388 INFO:teuthology.orchestra.run.smithi101.stdout: "duration": 0.001327103 2023-08-01T19:54:42.388 INFO:teuthology.orchestra.run.smithi101.stdout: }, 2023-08-01T19:54:42.388 INFO:teuthology.orchestra.run.smithi101.stdout: { 2023-08-01T19:54:42.388 INFO:teuthology.orchestra.run.smithi101.stdout: "event": "commit_sent", 2023-08-01T19:54:42.388 INFO:teuthology.orchestra.run.smithi101.stdout: "time": "2023-08-01T19:54:04.477771+0000", 2023-08-01T19:54:42.388 INFO:teuthology.orchestra.run.smithi101.stdout: "duration": 4.5232000000000003e-05 2023-08-01T19:54:42.388 INFO:teuthology.orchestra.run.smithi101.stdout: }, 2023-08-01T19:54:42.388 INFO:teuthology.orchestra.run.smithi101.stdout: { 2023-08-01T19:54:42.389 INFO:teuthology.orchestra.run.smithi101.stdout: "event": "done", 2023-08-01T19:54:42.389 INFO:teuthology.orchestra.run.smithi101.stdout: "time": "2023-08-01T19:54:04.477795+0000", 2023-08-01T19:54:42.389 INFO:teuthology.orchestra.run.smithi101.stdout: "duration": 2.4134999999999998e-05 2023-08-01T19:54:42.389 INFO:teuthology.orchestra.run.smithi101.stdout: } 2023-08-01T19:54:42.389 INFO:teuthology.orchestra.run.smithi101.stdout: ] 2023-08-01T19:54:42.389 INFO:teuthology.orchestra.run.smithi101.stdout: } 2023-08-01T19:54:42.389 INFO:teuthology.orchestra.run.smithi101.stdout: }, 2023-08-01T19:54:42.389 INFO:teuthology.orchestra.run.smithi101.stdout: { 2023-08-01T19:54:42.390 INFO:teuthology.orchestra.run.smithi101.stdout: "description": "osd_op(mds.0.3:19 3.14 3:2f55791f:::606.00000000:head [create,setxattr parent (62) in=6b,setxattr layout (30) in=6b] snapc 0=[] ondisk+write+known_if_redirected+full_force+supports_pool_eio e17)", 2023-08-01T19:54:42.390 INFO:teuthology.orchestra.run.smithi101.stdout: "initiated_at": "2023-08-01T19:54:04.459069+0000", 2023-08-01T19:54:42.390 INFO:teuthology.orchestra.run.smithi101.stdout: "age": 37.828501740999997, 2023-08-01T19:54:42.390 INFO:teuthology.orchestra.run.smithi101.stdout: "duration": 0.019523045999999999, 2023-08-01T19:54:42.390 INFO:teuthology.orchestra.run.smithi101.stdout: "type_data": { 2023-08-01T19:54:42.390 INFO:teuthology.orchestra.run.smithi101.stdout: "flag_point": "commit sent; apply or cleanup", 2023-08-01T19:54:42.390 INFO:teuthology.orchestra.run.smithi101.stdout: "events": [ 2023-08-01T19:54:42.390 INFO:teuthology.orchestra.run.smithi101.stdout: { 2023-08-01T19:54:42.391 INFO:teuthology.orchestra.run.smithi101.stdout: "event": "initiated", 2023-08-01T19:54:42.391 INFO:teuthology.orchestra.run.smithi101.stdout: "time": "2023-08-01T19:54:04.459069+0000", 2023-08-01T19:54:42.391 INFO:teuthology.orchestra.run.smithi101.stdout: "duration": 0 2023-08-01T19:54:42.391 INFO:teuthology.orchestra.run.smithi101.stdout: }, 2023-08-01T19:54:42.391 INFO:teuthology.orchestra.run.smithi101.stdout: { 2023-08-01T19:54:42.391 INFO:teuthology.orchestra.run.smithi101.stdout: "event": "throttled", 2023-08-01T19:54:42.391 INFO:teuthology.orchestra.run.smithi101.stdout: "time": "2023-08-01T19:54:04.459069+0000", 2023-08-01T19:54:42.392 INFO:teuthology.orchestra.run.smithi101.stdout: "duration": 0 2023-08-01T19:54:42.392 INFO:teuthology.orchestra.run.smithi101.stdout: }, 2023-08-01T19:54:42.392 INFO:teuthology.orchestra.run.smithi101.stdout: { 2023-08-01T19:54:42.392 INFO:teuthology.orchestra.run.smithi101.stdout: "event": "header_read", 2023-08-01T19:54:42.392 INFO:teuthology.orchestra.run.smithi101.stdout: "time": "2023-08-01T19:54:04.459069+0000", 2023-08-01T19:54:42.392 INFO:teuthology.orchestra.run.smithi101.stdout: "duration": 4294967295.9999995 2023-08-01T19:54:42.392 INFO:teuthology.orchestra.run.smithi101.stdout: }, 2023-08-01T19:54:42.392 INFO:teuthology.orchestra.run.smithi101.stdout: { 2023-08-01T19:54:42.393 INFO:teuthology.orchestra.run.smithi101.stdout: "event": "all_read", 2023-08-01T19:54:42.393 INFO:teuthology.orchestra.run.smithi101.stdout: "time": "2023-08-01T19:54:04.459072+0000", 2023-08-01T19:54:42.393 INFO:teuthology.orchestra.run.smithi101.stdout: "duration": 3.4570000000000001e-06 2023-08-01T19:54:42.393 INFO:teuthology.orchestra.run.smithi101.stdout: }, 2023-08-01T19:54:42.393 INFO:teuthology.orchestra.run.smithi101.stdout: { 2023-08-01T19:54:42.393 INFO:teuthology.orchestra.run.smithi101.stdout: "event": "dispatched", 2023-08-01T19:54:42.393 INFO:teuthology.orchestra.run.smithi101.stdout: "time": "2023-08-01T19:54:04.459080+0000", 2023-08-01T19:54:42.393 INFO:teuthology.orchestra.run.smithi101.stdout: "duration": 7.6009999999999997e-06 2023-08-01T19:54:42.394 INFO:teuthology.orchestra.run.smithi101.stdout: }, 2023-08-01T19:54:42.394 INFO:teuthology.orchestra.run.smithi101.stdout: { 2023-08-01T19:54:42.394 INFO:teuthology.orchestra.run.smithi101.stdout: "event": "queued_for_pg", 2023-08-01T19:54:42.394 INFO:teuthology.orchestra.run.smithi101.stdout: "time": "2023-08-01T19:54:04.459088+0000", 2023-08-01T19:54:42.394 INFO:teuthology.orchestra.run.smithi101.stdout: "duration": 8.0509999999999997e-06 2023-08-01T19:54:42.394 INFO:teuthology.orchestra.run.smithi101.stdout: }, 2023-08-01T19:54:42.394 INFO:teuthology.orchestra.run.smithi101.stdout: { 2023-08-01T19:54:42.394 INFO:teuthology.orchestra.run.smithi101.stdout: "event": "reached_pg", 2023-08-01T19:54:42.395 INFO:teuthology.orchestra.run.smithi101.stdout: "time": "2023-08-01T19:54:04.459120+0000", 2023-08-01T19:54:42.395 INFO:teuthology.orchestra.run.smithi101.stdout: "duration": 3.2078e-05 2023-08-01T19:54:42.395 INFO:teuthology.orchestra.run.smithi101.stdout: }, 2023-08-01T19:54:42.395 INFO:teuthology.orchestra.run.smithi101.stdout: { 2023-08-01T19:54:42.395 INFO:teuthology.orchestra.run.smithi101.stdout: "event": "waiting_for_map not empty", 2023-08-01T19:54:42.395 INFO:teuthology.orchestra.run.smithi101.stdout: "time": "2023-08-01T19:54:04.459123+0000", 2023-08-01T19:54:42.395 INFO:teuthology.orchestra.run.smithi101.stdout: "duration": 3.4699999999999998e-06 2023-08-01T19:54:42.395 INFO:teuthology.orchestra.run.smithi101.stdout: }, 2023-08-01T19:54:42.396 INFO:teuthology.orchestra.run.smithi101.stdout: { 2023-08-01T19:54:42.396 INFO:teuthology.orchestra.run.smithi101.stdout: "event": "reached_pg", 2023-08-01T19:54:42.396 INFO:teuthology.orchestra.run.smithi101.stdout: "time": "2023-08-01T19:54:04.471352+0000", 2023-08-01T19:54:42.396 INFO:teuthology.orchestra.run.smithi101.stdout: "duration": 0.01222926 2023-08-01T19:54:42.396 INFO:teuthology.orchestra.run.smithi101.stdout: }, 2023-08-01T19:54:42.396 INFO:teuthology.orchestra.run.smithi101.stdout: { 2023-08-01T19:54:42.396 INFO:teuthology.orchestra.run.smithi101.stdout: "event": "started", 2023-08-01T19:54:42.396 INFO:teuthology.orchestra.run.smithi101.stdout: "time": "2023-08-01T19:54:04.471495+0000", 2023-08-01T19:54:42.397 INFO:teuthology.orchestra.run.smithi101.stdout: "duration": 0.00014263899999999999 2023-08-01T19:54:42.397 INFO:teuthology.orchestra.run.smithi101.stdout: }, 2023-08-01T19:54:42.397 INFO:teuthology.orchestra.run.smithi101.stdout: { 2023-08-01T19:54:42.397 INFO:teuthology.orchestra.run.smithi101.stdout: "event": "waiting for subops from 2", 2023-08-01T19:54:42.397 INFO:teuthology.orchestra.run.smithi101.stdout: "time": "2023-08-01T19:54:04.472368+0000", 2023-08-01T19:54:42.397 INFO:teuthology.orchestra.run.smithi101.stdout: "duration": 0.00087245300000000003 2023-08-01T19:54:42.397 INFO:teuthology.orchestra.run.smithi101.stdout: }, 2023-08-01T19:54:42.397 INFO:teuthology.orchestra.run.smithi101.stdout: { 2023-08-01T19:54:42.398 INFO:teuthology.orchestra.run.smithi101.stdout: "event": "op_commit", 2023-08-01T19:54:42.398 INFO:teuthology.orchestra.run.smithi101.stdout: "time": "2023-08-01T19:54:04.477612+0000", 2023-08-01T19:54:42.398 INFO:teuthology.orchestra.run.smithi101.stdout: "duration": 0.0052442809999999999 2023-08-01T19:54:42.398 INFO:teuthology.orchestra.run.smithi101.stdout: }, 2023-08-01T19:54:42.398 INFO:teuthology.orchestra.run.smithi101.stdout: { 2023-08-01T19:54:42.398 INFO:teuthology.orchestra.run.smithi101.stdout: "event": "sub_op_commit_rec", 2023-08-01T19:54:42.398 INFO:teuthology.orchestra.run.smithi101.stdout: "time": "2023-08-01T19:54:04.478516+0000", 2023-08-01T19:54:42.398 INFO:teuthology.orchestra.run.smithi101.stdout: "duration": 0.00090399800000000004 2023-08-01T19:54:42.399 INFO:teuthology.orchestra.run.smithi101.stdout: }, 2023-08-01T19:54:42.399 INFO:teuthology.orchestra.run.smithi101.stdout: { 2023-08-01T19:54:42.399 INFO:teuthology.orchestra.run.smithi101.stdout: "event": "commit_sent", 2023-08-01T19:54:42.399 INFO:teuthology.orchestra.run.smithi101.stdout: "time": "2023-08-01T19:54:04.478555+0000", 2023-08-01T19:54:42.399 INFO:teuthology.orchestra.run.smithi101.stdout: "duration": 3.8977000000000003e-05 2023-08-01T19:54:42.399 INFO:teuthology.orchestra.run.smithi101.stdout: }, 2023-08-01T19:54:42.399 INFO:teuthology.orchestra.run.smithi101.stdout: { 2023-08-01T19:54:42.400 INFO:teuthology.orchestra.run.smithi101.stdout: "event": "done", 2023-08-01T19:54:42.400 INFO:teuthology.orchestra.run.smithi101.stdout: "time": "2023-08-01T19:54:04.478592+0000", 2023-08-01T19:54:42.400 INFO:teuthology.orchestra.run.smithi101.stdout: "duration": 3.7287999999999999e-05 2023-08-01T19:54:42.400 INFO:teuthology.orchestra.run.smithi101.stdout: } 2023-08-01T19:54:42.400 INFO:teuthology.orchestra.run.smithi101.stdout: ] 2023-08-01T19:54:42.400 INFO:teuthology.orchestra.run.smithi101.stdout: } 2023-08-01T19:54:42.400 INFO:teuthology.orchestra.run.smithi101.stdout: }, 2023-08-01T19:54:42.400 INFO:teuthology.orchestra.run.smithi101.stdout: { 2023-08-01T19:54:42.401 INFO:teuthology.orchestra.run.smithi101.stdout: "description": "osd_op(mds.0.3:20 3.1c 3:3ed09add:::607.00000000:head [omap-set-header] snapc 0=[] ondisk+write+known_if_redirected+full_force+supports_pool_eio e17)", 2023-08-01T19:54:42.401 INFO:teuthology.orchestra.run.smithi101.stdout: "initiated_at": "2023-08-01T19:54:04.459097+0000", 2023-08-01T19:54:42.401 INFO:teuthology.orchestra.run.smithi101.stdout: "age": 37.828474036999999, 2023-08-01T19:54:42.401 INFO:teuthology.orchestra.run.smithi101.stdout: "duration": 0.018578978999999999, 2023-08-01T19:54:42.401 INFO:teuthology.orchestra.run.smithi101.stdout: "type_data": { 2023-08-01T19:54:42.401 INFO:teuthology.orchestra.run.smithi101.stdout: "flag_point": "commit sent; apply or cleanup", 2023-08-01T19:54:42.401 INFO:teuthology.orchestra.run.smithi101.stdout: "events": [ 2023-08-01T19:54:42.401 INFO:teuthology.orchestra.run.smithi101.stdout: { 2023-08-01T19:54:42.402 INFO:teuthology.orchestra.run.smithi101.stdout: "event": "initiated", 2023-08-01T19:54:42.402 INFO:teuthology.orchestra.run.smithi101.stdout: "time": "2023-08-01T19:54:04.459097+0000", 2023-08-01T19:54:42.402 INFO:teuthology.orchestra.run.smithi101.stdout: "duration": 0 2023-08-01T19:54:42.402 INFO:teuthology.orchestra.run.smithi101.stdout: }, 2023-08-01T19:54:42.402 INFO:teuthology.orchestra.run.smithi101.stdout: { 2023-08-01T19:54:42.402 INFO:teuthology.orchestra.run.smithi101.stdout: "event": "throttled", 2023-08-01T19:54:42.402 INFO:teuthology.orchestra.run.smithi101.stdout: "time": "2023-08-01T19:54:04.459097+0000", 2023-08-01T19:54:42.402 INFO:teuthology.orchestra.run.smithi101.stdout: "duration": 0 2023-08-01T19:54:42.403 INFO:teuthology.orchestra.run.smithi101.stdout: }, 2023-08-01T19:54:42.403 INFO:teuthology.orchestra.run.smithi101.stdout: { 2023-08-01T19:54:42.403 INFO:teuthology.orchestra.run.smithi101.stdout: "event": "header_read", 2023-08-01T19:54:42.403 INFO:teuthology.orchestra.run.smithi101.stdout: "time": "2023-08-01T19:54:04.459096+0000", 2023-08-01T19:54:42.403 INFO:teuthology.orchestra.run.smithi101.stdout: "duration": 4294967295.9999995 2023-08-01T19:54:42.403 INFO:teuthology.orchestra.run.smithi101.stdout: }, 2023-08-01T19:54:42.403 INFO:teuthology.orchestra.run.smithi101.stdout: { 2023-08-01T19:54:42.403 INFO:teuthology.orchestra.run.smithi101.stdout: "event": "all_read", 2023-08-01T19:54:42.404 INFO:teuthology.orchestra.run.smithi101.stdout: "time": "2023-08-01T19:54:04.459105+0000", 2023-08-01T19:54:42.404 INFO:teuthology.orchestra.run.smithi101.stdout: "duration": 8.8259999999999999e-06 2023-08-01T19:54:42.404 INFO:teuthology.orchestra.run.smithi101.stdout: }, 2023-08-01T19:54:42.404 INFO:teuthology.orchestra.run.smithi101.stdout: { 2023-08-01T19:54:42.404 INFO:teuthology.orchestra.run.smithi101.stdout: "event": "dispatched", 2023-08-01T19:54:42.404 INFO:teuthology.orchestra.run.smithi101.stdout: "time": "2023-08-01T19:54:04.459112+0000", 2023-08-01T19:54:42.404 INFO:teuthology.orchestra.run.smithi101.stdout: "duration": 6.6660000000000002e-06 2023-08-01T19:54:42.404 INFO:teuthology.orchestra.run.smithi101.stdout: }, 2023-08-01T19:54:42.405 INFO:teuthology.orchestra.run.smithi101.stdout: { 2023-08-01T19:54:42.405 INFO:teuthology.orchestra.run.smithi101.stdout: "event": "queued_for_pg", 2023-08-01T19:54:42.405 INFO:teuthology.orchestra.run.smithi101.stdout: "time": "2023-08-01T19:54:04.459116+0000", 2023-08-01T19:54:42.405 INFO:teuthology.orchestra.run.smithi101.stdout: "duration": 4.2209999999999999e-06 2023-08-01T19:54:42.405 INFO:teuthology.orchestra.run.smithi101.stdout: }, 2023-08-01T19:54:42.405 INFO:teuthology.orchestra.run.smithi101.stdout: { 2023-08-01T19:54:42.405 INFO:teuthology.orchestra.run.smithi101.stdout: "event": "reached_pg", 2023-08-01T19:54:42.405 INFO:teuthology.orchestra.run.smithi101.stdout: "time": "2023-08-01T19:54:04.459141+0000", 2023-08-01T19:54:42.406 INFO:teuthology.orchestra.run.smithi101.stdout: "duration": 2.4627e-05 2023-08-01T19:54:42.406 INFO:teuthology.orchestra.run.smithi101.stdout: }, 2023-08-01T19:54:42.406 INFO:teuthology.orchestra.run.smithi101.stdout: { 2023-08-01T19:54:42.406 INFO:teuthology.orchestra.run.smithi101.stdout: "event": "op must wait for map", 2023-08-01T19:54:42.406 INFO:teuthology.orchestra.run.smithi101.stdout: "time": "2023-08-01T19:54:04.459144+0000", 2023-08-01T19:54:42.406 INFO:teuthology.orchestra.run.smithi101.stdout: "duration": 3.6559999999999998e-06 2023-08-01T19:54:42.406 INFO:teuthology.orchestra.run.smithi101.stdout: }, 2023-08-01T19:54:42.406 INFO:teuthology.orchestra.run.smithi101.stdout: { 2023-08-01T19:54:42.407 INFO:teuthology.orchestra.run.smithi101.stdout: "event": "reached_pg", 2023-08-01T19:54:42.407 INFO:teuthology.orchestra.run.smithi101.stdout: "time": "2023-08-01T19:54:04.468086+0000", 2023-08-01T19:54:42.407 INFO:teuthology.orchestra.run.smithi101.stdout: "duration": 0.0089415569999999993 2023-08-01T19:54:42.407 INFO:teuthology.orchestra.run.smithi101.stdout: }, 2023-08-01T19:54:42.407 INFO:teuthology.orchestra.run.smithi101.stdout: { 2023-08-01T19:54:42.407 INFO:teuthology.orchestra.run.smithi101.stdout: "event": "started", 2023-08-01T19:54:42.407 INFO:teuthology.orchestra.run.smithi101.stdout: "time": "2023-08-01T19:54:04.468204+0000", 2023-08-01T19:54:42.408 INFO:teuthology.orchestra.run.smithi101.stdout: "duration": 0.00011806700000000001 2023-08-01T19:54:42.408 INFO:teuthology.orchestra.run.smithi101.stdout: }, 2023-08-01T19:54:42.408 INFO:teuthology.orchestra.run.smithi101.stdout: { 2023-08-01T19:54:42.408 INFO:teuthology.orchestra.run.smithi101.stdout: "event": "waiting for subops from 0", 2023-08-01T19:54:42.408 INFO:teuthology.orchestra.run.smithi101.stdout: "time": "2023-08-01T19:54:04.468342+0000", 2023-08-01T19:54:42.408 INFO:teuthology.orchestra.run.smithi101.stdout: "duration": 0.000138269 2023-08-01T19:54:42.408 INFO:teuthology.orchestra.run.smithi101.stdout: }, 2023-08-01T19:54:42.408 INFO:teuthology.orchestra.run.smithi101.stdout: { 2023-08-01T19:54:42.409 INFO:teuthology.orchestra.run.smithi101.stdout: "event": "op_commit", 2023-08-01T19:54:42.409 INFO:teuthology.orchestra.run.smithi101.stdout: "time": "2023-08-01T19:54:04.474028+0000", 2023-08-01T19:54:42.409 INFO:teuthology.orchestra.run.smithi101.stdout: "duration": 0.005685458 2023-08-01T19:54:42.409 INFO:teuthology.orchestra.run.smithi101.stdout: }, 2023-08-01T19:54:42.409 INFO:teuthology.orchestra.run.smithi101.stdout: { 2023-08-01T19:54:42.409 INFO:teuthology.orchestra.run.smithi101.stdout: "event": "sub_op_commit_rec", 2023-08-01T19:54:42.409 INFO:teuthology.orchestra.run.smithi101.stdout: "time": "2023-08-01T19:54:04.477581+0000", 2023-08-01T19:54:42.409 INFO:teuthology.orchestra.run.smithi101.stdout: "duration": 0.0035531109999999999 2023-08-01T19:54:42.410 INFO:teuthology.orchestra.run.smithi101.stdout: }, 2023-08-01T19:54:42.410 INFO:teuthology.orchestra.run.smithi101.stdout: { 2023-08-01T19:54:42.410 INFO:teuthology.orchestra.run.smithi101.stdout: "event": "commit_sent", 2023-08-01T19:54:42.410 INFO:teuthology.orchestra.run.smithi101.stdout: "time": "2023-08-01T19:54:04.477635+0000", 2023-08-01T19:54:42.410 INFO:teuthology.orchestra.run.smithi101.stdout: "duration": 5.3769e-05 2023-08-01T19:54:42.410 INFO:teuthology.orchestra.run.smithi101.stdout: }, 2023-08-01T19:54:42.410 INFO:teuthology.orchestra.run.smithi101.stdout: { 2023-08-01T19:54:42.410 INFO:teuthology.orchestra.run.smithi101.stdout: "event": "done", 2023-08-01T19:54:42.411 INFO:teuthology.orchestra.run.smithi101.stdout: "time": "2023-08-01T19:54:04.477676+0000", 2023-08-01T19:54:42.411 INFO:teuthology.orchestra.run.smithi101.stdout: "duration": 4.1148e-05 2023-08-01T19:54:42.411 INFO:teuthology.orchestra.run.smithi101.stdout: } 2023-08-01T19:54:42.411 INFO:teuthology.orchestra.run.smithi101.stdout: ] 2023-08-01T19:54:42.411 INFO:teuthology.orchestra.run.smithi101.stdout: } 2023-08-01T19:54:42.411 INFO:teuthology.orchestra.run.smithi101.stdout: }, 2023-08-01T19:54:42.411 INFO:teuthology.orchestra.run.smithi101.stdout: { 2023-08-01T19:54:42.411 INFO:teuthology.orchestra.run.smithi101.stdout: "description": "osd_op(mds.0.3:21 3.1c 3:3ed09add:::607.00000000:head [create,setxattr parent (62) in=6b,setxattr layout (30) in=6b] snapc 0=[] ondisk+write+known_if_redirected+full_force+supports_pool_eio e17)", 2023-08-01T19:54:42.412 INFO:teuthology.orchestra.run.smithi101.stdout: "initiated_at": "2023-08-01T19:54:04.459123+0000", 2023-08-01T19:54:42.412 INFO:teuthology.orchestra.run.smithi101.stdout: "age": 37.828447879999999, 2023-08-01T19:54:42.412 INFO:teuthology.orchestra.run.smithi101.stdout: "duration": 0.018736452000000001, 2023-08-01T19:54:42.412 INFO:teuthology.orchestra.run.smithi101.stdout: "type_data": { 2023-08-01T19:54:42.412 INFO:teuthology.orchestra.run.smithi101.stdout: "flag_point": "commit sent; apply or cleanup", 2023-08-01T19:54:42.412 INFO:teuthology.orchestra.run.smithi101.stdout: "events": [ 2023-08-01T19:54:42.412 INFO:teuthology.orchestra.run.smithi101.stdout: { 2023-08-01T19:54:42.412 INFO:teuthology.orchestra.run.smithi101.stdout: "event": "initiated", 2023-08-01T19:54:42.413 INFO:teuthology.orchestra.run.smithi101.stdout: "time": "2023-08-01T19:54:04.459123+0000", 2023-08-01T19:54:42.413 INFO:teuthology.orchestra.run.smithi101.stdout: "duration": 0 2023-08-01T19:54:42.413 INFO:teuthology.orchestra.run.smithi101.stdout: }, 2023-08-01T19:54:42.413 INFO:teuthology.orchestra.run.smithi101.stdout: { 2023-08-01T19:54:42.413 INFO:teuthology.orchestra.run.smithi101.stdout: "event": "throttled", 2023-08-01T19:54:42.413 INFO:teuthology.orchestra.run.smithi101.stdout: "time": "2023-08-01T19:54:04.459123+0000", 2023-08-01T19:54:42.413 INFO:teuthology.orchestra.run.smithi101.stdout: "duration": 0 2023-08-01T19:54:42.413 INFO:teuthology.orchestra.run.smithi101.stdout: }, 2023-08-01T19:54:42.414 INFO:teuthology.orchestra.run.smithi101.stdout: { 2023-08-01T19:54:42.414 INFO:teuthology.orchestra.run.smithi101.stdout: "event": "header_read", 2023-08-01T19:54:42.414 INFO:teuthology.orchestra.run.smithi101.stdout: "time": "2023-08-01T19:54:04.459123+0000", 2023-08-01T19:54:42.414 INFO:teuthology.orchestra.run.smithi101.stdout: "duration": 4294967295.9999995 2023-08-01T19:54:42.414 INFO:teuthology.orchestra.run.smithi101.stdout: }, 2023-08-01T19:54:42.414 INFO:teuthology.orchestra.run.smithi101.stdout: { 2023-08-01T19:54:42.414 INFO:teuthology.orchestra.run.smithi101.stdout: "event": "all_read", 2023-08-01T19:54:42.414 INFO:teuthology.orchestra.run.smithi101.stdout: "time": "2023-08-01T19:54:04.459127+0000", 2023-08-01T19:54:42.415 INFO:teuthology.orchestra.run.smithi101.stdout: "duration": 4.5770000000000004e-06 2023-08-01T19:54:42.415 INFO:teuthology.orchestra.run.smithi101.stdout: }, 2023-08-01T19:54:42.415 INFO:teuthology.orchestra.run.smithi101.stdout: { 2023-08-01T19:54:42.415 INFO:teuthology.orchestra.run.smithi101.stdout: "event": "dispatched", 2023-08-01T19:54:42.415 INFO:teuthology.orchestra.run.smithi101.stdout: "time": "2023-08-01T19:54:04.459134+0000", 2023-08-01T19:54:42.415 INFO:teuthology.orchestra.run.smithi101.stdout: "duration": 6.5080000000000002e-06 2023-08-01T19:54:42.415 INFO:teuthology.orchestra.run.smithi101.stdout: }, 2023-08-01T19:54:42.416 INFO:teuthology.orchestra.run.smithi101.stdout: { 2023-08-01T19:54:42.416 INFO:teuthology.orchestra.run.smithi101.stdout: "event": "queued_for_pg", 2023-08-01T19:54:42.416 INFO:teuthology.orchestra.run.smithi101.stdout: "time": "2023-08-01T19:54:04.459138+0000", 2023-08-01T19:54:42.416 INFO:teuthology.orchestra.run.smithi101.stdout: "duration": 4.6249999999999998e-06 2023-08-01T19:54:42.416 INFO:teuthology.orchestra.run.smithi101.stdout: }, 2023-08-01T19:54:42.416 INFO:teuthology.orchestra.run.smithi101.stdout: { 2023-08-01T19:54:42.416 INFO:teuthology.orchestra.run.smithi101.stdout: "event": "reached_pg", 2023-08-01T19:54:42.416 INFO:teuthology.orchestra.run.smithi101.stdout: "time": "2023-08-01T19:54:04.459158+0000", 2023-08-01T19:54:42.417 INFO:teuthology.orchestra.run.smithi101.stdout: "duration": 1.9354000000000001e-05 2023-08-01T19:54:42.417 INFO:teuthology.orchestra.run.smithi101.stdout: }, 2023-08-01T19:54:42.417 INFO:teuthology.orchestra.run.smithi101.stdout: { 2023-08-01T19:54:42.417 INFO:teuthology.orchestra.run.smithi101.stdout: "event": "waiting_for_map not empty", 2023-08-01T19:54:42.417 INFO:teuthology.orchestra.run.smithi101.stdout: "time": "2023-08-01T19:54:04.459160+0000", 2023-08-01T19:54:42.417 INFO:teuthology.orchestra.run.smithi101.stdout: "duration": 2.2740000000000002e-06 2023-08-01T19:54:42.417 INFO:teuthology.orchestra.run.smithi101.stdout: }, 2023-08-01T19:54:42.417 INFO:teuthology.orchestra.run.smithi101.stdout: { 2023-08-01T19:54:42.418 INFO:teuthology.orchestra.run.smithi101.stdout: "event": "reached_pg", 2023-08-01T19:54:42.418 INFO:teuthology.orchestra.run.smithi101.stdout: "time": "2023-08-01T19:54:04.468839+0000", 2023-08-01T19:54:42.418 INFO:teuthology.orchestra.run.smithi101.stdout: "duration": 0.0096787109999999996 2023-08-01T19:54:42.418 INFO:teuthology.orchestra.run.smithi101.stdout: }, 2023-08-01T19:54:42.418 INFO:teuthology.orchestra.run.smithi101.stdout: { 2023-08-01T19:54:42.418 INFO:teuthology.orchestra.run.smithi101.stdout: "event": "started", 2023-08-01T19:54:42.418 INFO:teuthology.orchestra.run.smithi101.stdout: "time": "2023-08-01T19:54:04.469446+0000", 2023-08-01T19:54:42.418 INFO:teuthology.orchestra.run.smithi101.stdout: "duration": 0.00060714899999999997 2023-08-01T19:54:42.419 INFO:teuthology.orchestra.run.smithi101.stdout: }, 2023-08-01T19:54:42.419 INFO:teuthology.orchestra.run.smithi101.stdout: { 2023-08-01T19:54:42.419 INFO:teuthology.orchestra.run.smithi101.stdout: "event": "waiting for subops from 0", 2023-08-01T19:54:42.419 INFO:teuthology.orchestra.run.smithi101.stdout: "time": "2023-08-01T19:54:04.470133+0000", 2023-08-01T19:54:42.419 INFO:teuthology.orchestra.run.smithi101.stdout: "duration": 0.00068691900000000003 2023-08-01T19:54:42.419 INFO:teuthology.orchestra.run.smithi101.stdout: }, 2023-08-01T19:54:42.419 INFO:teuthology.orchestra.run.smithi101.stdout: { 2023-08-01T19:54:42.419 INFO:teuthology.orchestra.run.smithi101.stdout: "event": "op_commit", 2023-08-01T19:54:42.420 INFO:teuthology.orchestra.run.smithi101.stdout: "time": "2023-08-01T19:54:04.475933+0000", 2023-08-01T19:54:42.420 INFO:teuthology.orchestra.run.smithi101.stdout: "duration": 0.0058002560000000002 2023-08-01T19:54:42.420 INFO:teuthology.orchestra.run.smithi101.stdout: }, 2023-08-01T19:54:42.420 INFO:teuthology.orchestra.run.smithi101.stdout: { 2023-08-01T19:54:42.420 INFO:teuthology.orchestra.run.smithi101.stdout: "event": "sub_op_commit_rec", 2023-08-01T19:54:42.420 INFO:teuthology.orchestra.run.smithi101.stdout: "time": "2023-08-01T19:54:04.477749+0000", 2023-08-01T19:54:42.420 INFO:teuthology.orchestra.run.smithi101.stdout: "duration": 0.00181584 2023-08-01T19:54:42.420 INFO:teuthology.orchestra.run.smithi101.stdout: }, 2023-08-01T19:54:42.421 INFO:teuthology.orchestra.run.smithi101.stdout: { 2023-08-01T19:54:42.421 INFO:teuthology.orchestra.run.smithi101.stdout: "event": "commit_sent", 2023-08-01T19:54:42.421 INFO:teuthology.orchestra.run.smithi101.stdout: "time": "2023-08-01T19:54:04.477823+0000", 2023-08-01T19:54:42.421 INFO:teuthology.orchestra.run.smithi101.stdout: "duration": 7.4405000000000003e-05 2023-08-01T19:54:42.421 INFO:teuthology.orchestra.run.smithi101.stdout: }, 2023-08-01T19:54:42.421 INFO:teuthology.orchestra.run.smithi101.stdout: { 2023-08-01T19:54:42.421 INFO:teuthology.orchestra.run.smithi101.stdout: "event": "done", 2023-08-01T19:54:42.422 INFO:teuthology.orchestra.run.smithi101.stdout: "time": "2023-08-01T19:54:04.477859+0000", 2023-08-01T19:54:42.422 INFO:teuthology.orchestra.run.smithi101.stdout: "duration": 3.6211000000000003e-05 2023-08-01T19:54:42.422 INFO:teuthology.orchestra.run.smithi101.stdout: } 2023-08-01T19:54:42.422 INFO:teuthology.orchestra.run.smithi101.stdout: ] 2023-08-01T19:54:42.422 INFO:teuthology.orchestra.run.smithi101.stdout: } 2023-08-01T19:54:42.422 INFO:teuthology.orchestra.run.smithi101.stdout: }, 2023-08-01T19:54:42.422 INFO:teuthology.orchestra.run.smithi101.stdout: { 2023-08-01T19:54:42.422 INFO:teuthology.orchestra.run.smithi101.stdout: "description": "osd_op(mds.0.3:29 3.13 3:cd5a64a3:::100.00000000:head [omap-set-header,omap-set-vals] snapc 0=[] ondisk+write+known_if_redirected+full_force+supports_pool_eio e17)", 2023-08-01T19:54:42.423 INFO:teuthology.orchestra.run.smithi101.stdout: "initiated_at": "2023-08-01T19:54:04.459146+0000", 2023-08-01T19:54:42.423 INFO:teuthology.orchestra.run.smithi101.stdout: "age": 37.828424679000001, 2023-08-01T19:54:42.423 INFO:teuthology.orchestra.run.smithi101.stdout: "duration": 0.015668519999999998, 2023-08-01T19:54:42.423 INFO:teuthology.orchestra.run.smithi101.stdout: "type_data": { 2023-08-01T19:54:42.423 INFO:teuthology.orchestra.run.smithi101.stdout: "flag_point": "commit sent; apply or cleanup", 2023-08-01T19:54:42.423 INFO:teuthology.orchestra.run.smithi101.stdout: "events": [ 2023-08-01T19:54:42.423 INFO:teuthology.orchestra.run.smithi101.stdout: { 2023-08-01T19:54:42.423 INFO:teuthology.orchestra.run.smithi101.stdout: "event": "initiated", 2023-08-01T19:54:42.424 INFO:teuthology.orchestra.run.smithi101.stdout: "time": "2023-08-01T19:54:04.459146+0000", 2023-08-01T19:54:42.424 INFO:teuthology.orchestra.run.smithi101.stdout: "duration": 0 2023-08-01T19:54:42.424 INFO:teuthology.orchestra.run.smithi101.stdout: }, 2023-08-01T19:54:42.424 INFO:teuthology.orchestra.run.smithi101.stdout: { 2023-08-01T19:54:42.424 INFO:teuthology.orchestra.run.smithi101.stdout: "event": "throttled", 2023-08-01T19:54:42.424 INFO:teuthology.orchestra.run.smithi101.stdout: "time": "2023-08-01T19:54:04.459146+0000", 2023-08-01T19:54:42.424 INFO:teuthology.orchestra.run.smithi101.stdout: "duration": 0 2023-08-01T19:54:42.424 INFO:teuthology.orchestra.run.smithi101.stdout: }, 2023-08-01T19:54:42.425 INFO:teuthology.orchestra.run.smithi101.stdout: { 2023-08-01T19:54:42.425 INFO:teuthology.orchestra.run.smithi101.stdout: "event": "header_read", 2023-08-01T19:54:42.425 INFO:teuthology.orchestra.run.smithi101.stdout: "time": "2023-08-01T19:54:04.459146+0000", 2023-08-01T19:54:42.425 INFO:teuthology.orchestra.run.smithi101.stdout: "duration": 4294967295.9999995 2023-08-01T19:54:42.425 INFO:teuthology.orchestra.run.smithi101.stdout: }, 2023-08-01T19:54:42.425 INFO:teuthology.orchestra.run.smithi101.stdout: { 2023-08-01T19:54:42.425 INFO:teuthology.orchestra.run.smithi101.stdout: "event": "all_read", 2023-08-01T19:54:42.425 INFO:teuthology.orchestra.run.smithi101.stdout: "time": "2023-08-01T19:54:04.459155+0000", 2023-08-01T19:54:42.426 INFO:teuthology.orchestra.run.smithi101.stdout: "duration": 9.6020000000000006e-06 2023-08-01T19:54:42.426 INFO:teuthology.orchestra.run.smithi101.stdout: }, 2023-08-01T19:54:42.426 INFO:teuthology.orchestra.run.smithi101.stdout: { 2023-08-01T19:54:42.426 INFO:teuthology.orchestra.run.smithi101.stdout: "event": "dispatched", 2023-08-01T19:54:42.426 INFO:teuthology.orchestra.run.smithi101.stdout: "time": "2023-08-01T19:54:04.459162+0000", 2023-08-01T19:54:42.426 INFO:teuthology.orchestra.run.smithi101.stdout: "duration": 7.0439999999999998e-06 2023-08-01T19:54:42.426 INFO:teuthology.orchestra.run.smithi101.stdout: }, 2023-08-01T19:54:42.426 INFO:teuthology.orchestra.run.smithi101.stdout: { 2023-08-01T19:54:42.427 INFO:teuthology.orchestra.run.smithi101.stdout: "event": "queued_for_pg", 2023-08-01T19:54:42.427 INFO:teuthology.orchestra.run.smithi101.stdout: "time": "2023-08-01T19:54:04.459167+0000", 2023-08-01T19:54:42.427 INFO:teuthology.orchestra.run.smithi101.stdout: "duration": 4.3989999999999997e-06 2023-08-01T19:54:42.427 INFO:teuthology.orchestra.run.smithi101.stdout: }, 2023-08-01T19:54:42.427 INFO:teuthology.orchestra.run.smithi101.stdout: { 2023-08-01T19:54:42.427 INFO:teuthology.orchestra.run.smithi101.stdout: "event": "reached_pg", 2023-08-01T19:54:42.427 INFO:teuthology.orchestra.run.smithi101.stdout: "time": "2023-08-01T19:54:04.459201+0000", 2023-08-01T19:54:42.427 INFO:teuthology.orchestra.run.smithi101.stdout: "duration": 3.4406000000000002e-05 2023-08-01T19:54:42.428 INFO:teuthology.orchestra.run.smithi101.stdout: }, 2023-08-01T19:54:42.428 INFO:teuthology.orchestra.run.smithi101.stdout: { 2023-08-01T19:54:42.428 INFO:teuthology.orchestra.run.smithi101.stdout: "event": "op must wait for map", 2023-08-01T19:54:42.428 INFO:teuthology.orchestra.run.smithi101.stdout: "time": "2023-08-01T19:54:04.459206+0000", 2023-08-01T19:54:42.428 INFO:teuthology.orchestra.run.smithi101.stdout: "duration": 5.04e-06 2023-08-01T19:54:42.428 INFO:teuthology.orchestra.run.smithi101.stdout: }, 2023-08-01T19:54:42.428 INFO:teuthology.orchestra.run.smithi101.stdout: { 2023-08-01T19:54:42.428 INFO:teuthology.orchestra.run.smithi101.stdout: "event": "reached_pg", 2023-08-01T19:54:42.429 INFO:teuthology.orchestra.run.smithi101.stdout: "time": "2023-08-01T19:54:04.468278+0000", 2023-08-01T19:54:42.429 INFO:teuthology.orchestra.run.smithi101.stdout: "duration": 0.0090714899999999998 2023-08-01T19:54:42.429 INFO:teuthology.orchestra.run.smithi101.stdout: }, 2023-08-01T19:54:42.429 INFO:teuthology.orchestra.run.smithi101.stdout: { 2023-08-01T19:54:42.429 INFO:teuthology.orchestra.run.smithi101.stdout: "event": "started", 2023-08-01T19:54:42.429 INFO:teuthology.orchestra.run.smithi101.stdout: "time": "2023-08-01T19:54:04.468419+0000", 2023-08-01T19:54:42.429 INFO:teuthology.orchestra.run.smithi101.stdout: "duration": 0.00014119100000000001 2023-08-01T19:54:42.429 INFO:teuthology.orchestra.run.smithi101.stdout: }, 2023-08-01T19:54:42.430 INFO:teuthology.orchestra.run.smithi101.stdout: { 2023-08-01T19:54:42.430 INFO:teuthology.orchestra.run.smithi101.stdout: "event": "waiting for subops from 0", 2023-08-01T19:54:42.430 INFO:teuthology.orchestra.run.smithi101.stdout: "time": "2023-08-01T19:54:04.468598+0000", 2023-08-01T19:54:42.430 INFO:teuthology.orchestra.run.smithi101.stdout: "duration": 0.00017872799999999999 2023-08-01T19:54:42.430 INFO:teuthology.orchestra.run.smithi101.stdout: }, 2023-08-01T19:54:42.430 INFO:teuthology.orchestra.run.smithi101.stdout: { 2023-08-01T19:54:42.430 INFO:teuthology.orchestra.run.smithi101.stdout: "event": "op_commit", 2023-08-01T19:54:42.430 INFO:teuthology.orchestra.run.smithi101.stdout: "time": "2023-08-01T19:54:04.472625+0000", 2023-08-01T19:54:42.431 INFO:teuthology.orchestra.run.smithi101.stdout: "duration": 0.0040273729999999999 2023-08-01T19:54:42.431 INFO:teuthology.orchestra.run.smithi101.stdout: }, 2023-08-01T19:54:42.431 INFO:teuthology.orchestra.run.smithi101.stdout: { 2023-08-01T19:54:42.431 INFO:teuthology.orchestra.run.smithi101.stdout: "event": "sub_op_commit_rec", 2023-08-01T19:54:42.431 INFO:teuthology.orchestra.run.smithi101.stdout: "time": "2023-08-01T19:54:04.474719+0000", 2023-08-01T19:54:42.431 INFO:teuthology.orchestra.run.smithi101.stdout: "duration": 0.0020941509999999998 2023-08-01T19:54:42.431 INFO:teuthology.orchestra.run.smithi101.stdout: }, 2023-08-01T19:54:42.431 INFO:teuthology.orchestra.run.smithi101.stdout: { 2023-08-01T19:54:42.432 INFO:teuthology.orchestra.run.smithi101.stdout: "event": "commit_sent", 2023-08-01T19:54:42.432 INFO:teuthology.orchestra.run.smithi101.stdout: "time": "2023-08-01T19:54:04.474776+0000", 2023-08-01T19:54:42.432 INFO:teuthology.orchestra.run.smithi101.stdout: "duration": 5.6368e-05 2023-08-01T19:54:42.432 INFO:teuthology.orchestra.run.smithi101.stdout: }, 2023-08-01T19:54:42.432 INFO:teuthology.orchestra.run.smithi101.stdout: { 2023-08-01T19:54:42.432 INFO:teuthology.orchestra.run.smithi101.stdout: "event": "done", 2023-08-01T19:54:42.432 INFO:teuthology.orchestra.run.smithi101.stdout: "time": "2023-08-01T19:54:04.474815+0000", 2023-08-01T19:54:42.433 INFO:teuthology.orchestra.run.smithi101.stdout: "duration": 3.9112000000000001e-05 2023-08-01T19:54:42.433 INFO:teuthology.orchestra.run.smithi101.stdout: } 2023-08-01T19:54:42.433 INFO:teuthology.orchestra.run.smithi101.stdout: ] 2023-08-01T19:54:42.433 INFO:teuthology.orchestra.run.smithi101.stdout: } 2023-08-01T19:54:42.433 INFO:teuthology.orchestra.run.smithi101.stdout: }, 2023-08-01T19:54:42.433 INFO:teuthology.orchestra.run.smithi101.stdout: { 2023-08-01T19:54:42.433 INFO:teuthology.orchestra.run.smithi101.stdout: "description": "osd_op(mds.0.3:1 3.14 3:292cf221:::200.00000000:head [writefull 0~90] snapc 0=[] ondisk+write+known_if_redirected+full_force+supports_pool_eio e17)", 2023-08-01T19:54:42.433 INFO:teuthology.orchestra.run.smithi101.stdout: "initiated_at": "2023-08-01T19:54:04.459177+0000", 2023-08-01T19:54:42.434 INFO:teuthology.orchestra.run.smithi101.stdout: "age": 37.828394170999999, 2023-08-01T19:54:42.434 INFO:teuthology.orchestra.run.smithi101.stdout: "duration": 0.021067196, 2023-08-01T19:54:42.434 INFO:teuthology.orchestra.run.smithi101.stdout: "type_data": { 2023-08-01T19:54:42.434 INFO:teuthology.orchestra.run.smithi101.stdout: "flag_point": "commit sent; apply or cleanup", 2023-08-01T19:54:42.434 INFO:teuthology.orchestra.run.smithi101.stdout: "events": [ 2023-08-01T19:54:42.434 INFO:teuthology.orchestra.run.smithi101.stdout: { 2023-08-01T19:54:42.434 INFO:teuthology.orchestra.run.smithi101.stdout: "event": "initiated", 2023-08-01T19:54:42.434 INFO:teuthology.orchestra.run.smithi101.stdout: "time": "2023-08-01T19:54:04.459177+0000", 2023-08-01T19:54:42.435 INFO:teuthology.orchestra.run.smithi101.stdout: "duration": 0 2023-08-01T19:54:42.435 INFO:teuthology.orchestra.run.smithi101.stdout: }, 2023-08-01T19:54:42.435 INFO:teuthology.orchestra.run.smithi101.stdout: { 2023-08-01T19:54:42.435 INFO:teuthology.orchestra.run.smithi101.stdout: "event": "throttled", 2023-08-01T19:54:42.435 INFO:teuthology.orchestra.run.smithi101.stdout: "time": "2023-08-01T19:54:04.459177+0000", 2023-08-01T19:54:42.435 INFO:teuthology.orchestra.run.smithi101.stdout: "duration": 0 2023-08-01T19:54:42.435 INFO:teuthology.orchestra.run.smithi101.stdout: }, 2023-08-01T19:54:42.435 INFO:teuthology.orchestra.run.smithi101.stdout: { 2023-08-01T19:54:42.436 INFO:teuthology.orchestra.run.smithi101.stdout: "event": "header_read", 2023-08-01T19:54:42.436 INFO:teuthology.orchestra.run.smithi101.stdout: "time": "2023-08-01T19:54:04.459176+0000", 2023-08-01T19:54:42.436 INFO:teuthology.orchestra.run.smithi101.stdout: "duration": 4294967295.9999995 2023-08-01T19:54:42.436 INFO:teuthology.orchestra.run.smithi101.stdout: }, 2023-08-01T19:54:42.436 INFO:teuthology.orchestra.run.smithi101.stdout: { 2023-08-01T19:54:42.436 INFO:teuthology.orchestra.run.smithi101.stdout: "event": "all_read", 2023-08-01T19:54:42.436 INFO:teuthology.orchestra.run.smithi101.stdout: "time": "2023-08-01T19:54:04.459181+0000", 2023-08-01T19:54:42.436 INFO:teuthology.orchestra.run.smithi101.stdout: "duration": 5.2109999999999997e-06 2023-08-01T19:54:42.437 INFO:teuthology.orchestra.run.smithi101.stdout: }, 2023-08-01T19:54:42.437 INFO:teuthology.orchestra.run.smithi101.stdout: { 2023-08-01T19:54:42.437 INFO:teuthology.orchestra.run.smithi101.stdout: "event": "dispatched", 2023-08-01T19:54:42.437 INFO:teuthology.orchestra.run.smithi101.stdout: "time": "2023-08-01T19:54:04.459188+0000", 2023-08-01T19:54:42.437 INFO:teuthology.orchestra.run.smithi101.stdout: "duration": 6.6680000000000004e-06 2023-08-01T19:54:42.437 INFO:teuthology.orchestra.run.smithi101.stdout: }, 2023-08-01T19:54:42.437 INFO:teuthology.orchestra.run.smithi101.stdout: { 2023-08-01T19:54:42.437 INFO:teuthology.orchestra.run.smithi101.stdout: "event": "queued_for_pg", 2023-08-01T19:54:42.438 INFO:teuthology.orchestra.run.smithi101.stdout: "time": "2023-08-01T19:54:04.459192+0000", 2023-08-01T19:54:42.438 INFO:teuthology.orchestra.run.smithi101.stdout: "duration": 4.228e-06 2023-08-01T19:54:42.438 INFO:teuthology.orchestra.run.smithi101.stdout: }, 2023-08-01T19:54:42.438 INFO:teuthology.orchestra.run.smithi101.stdout: { 2023-08-01T19:54:42.438 INFO:teuthology.orchestra.run.smithi101.stdout: "event": "reached_pg", 2023-08-01T19:54:42.438 INFO:teuthology.orchestra.run.smithi101.stdout: "time": "2023-08-01T19:54:04.459219+0000", 2023-08-01T19:54:42.438 INFO:teuthology.orchestra.run.smithi101.stdout: "duration": 2.6930000000000001e-05 2023-08-01T19:54:42.438 INFO:teuthology.orchestra.run.smithi101.stdout: }, 2023-08-01T19:54:42.439 INFO:teuthology.orchestra.run.smithi101.stdout: { 2023-08-01T19:54:42.439 INFO:teuthology.orchestra.run.smithi101.stdout: "event": "waiting_for_map not empty", 2023-08-01T19:54:42.439 INFO:teuthology.orchestra.run.smithi101.stdout: "time": "2023-08-01T19:54:04.459223+0000", 2023-08-01T19:54:42.439 INFO:teuthology.orchestra.run.smithi101.stdout: "duration": 3.8469999999999998e-06 2023-08-01T19:54:42.439 INFO:teuthology.orchestra.run.smithi101.stdout: }, 2023-08-01T19:54:42.439 INFO:teuthology.orchestra.run.smithi101.stdout: { 2023-08-01T19:54:42.439 INFO:teuthology.orchestra.run.smithi101.stdout: "event": "reached_pg", 2023-08-01T19:54:42.439 INFO:teuthology.orchestra.run.smithi101.stdout: "time": "2023-08-01T19:54:04.473347+0000", 2023-08-01T19:54:42.440 INFO:teuthology.orchestra.run.smithi101.stdout: "duration": 0.014124319 2023-08-01T19:54:42.440 INFO:teuthology.orchestra.run.smithi101.stdout: }, 2023-08-01T19:54:42.440 INFO:teuthology.orchestra.run.smithi101.stdout: { 2023-08-01T19:54:42.440 INFO:teuthology.orchestra.run.smithi101.stdout: "event": "started", 2023-08-01T19:54:42.440 INFO:teuthology.orchestra.run.smithi101.stdout: "time": "2023-08-01T19:54:04.473480+0000", 2023-08-01T19:54:42.440 INFO:teuthology.orchestra.run.smithi101.stdout: "duration": 0.00013276799999999999 2023-08-01T19:54:42.440 INFO:teuthology.orchestra.run.smithi101.stdout: }, 2023-08-01T19:54:42.441 INFO:teuthology.orchestra.run.smithi101.stdout: { 2023-08-01T19:54:42.441 INFO:teuthology.orchestra.run.smithi101.stdout: "event": "waiting for subops from 2", 2023-08-01T19:54:42.441 INFO:teuthology.orchestra.run.smithi101.stdout: "time": "2023-08-01T19:54:04.473622+0000", 2023-08-01T19:54:42.441 INFO:teuthology.orchestra.run.smithi101.stdout: "duration": 0.00014154799999999999 2023-08-01T19:54:42.441 INFO:teuthology.orchestra.run.smithi101.stdout: }, 2023-08-01T19:54:42.441 INFO:teuthology.orchestra.run.smithi101.stdout: { 2023-08-01T19:54:42.441 INFO:teuthology.orchestra.run.smithi101.stdout: "event": "op_commit", 2023-08-01T19:54:42.441 INFO:teuthology.orchestra.run.smithi101.stdout: "time": "2023-08-01T19:54:04.478281+0000", 2023-08-01T19:54:42.442 INFO:teuthology.orchestra.run.smithi101.stdout: "duration": 0.004659252 2023-08-01T19:54:42.442 INFO:teuthology.orchestra.run.smithi101.stdout: }, 2023-08-01T19:54:42.442 INFO:teuthology.orchestra.run.smithi101.stdout: { 2023-08-01T19:54:42.442 INFO:teuthology.orchestra.run.smithi101.stdout: "event": "sub_op_commit_rec", 2023-08-01T19:54:42.442 INFO:teuthology.orchestra.run.smithi101.stdout: "time": "2023-08-01T19:54:04.480180+0000", 2023-08-01T19:54:42.442 INFO:teuthology.orchestra.run.smithi101.stdout: "duration": 0.0018986859999999999 2023-08-01T19:54:42.442 INFO:teuthology.orchestra.run.smithi101.stdout: }, 2023-08-01T19:54:42.442 INFO:teuthology.orchestra.run.smithi101.stdout: { 2023-08-01T19:54:42.443 INFO:teuthology.orchestra.run.smithi101.stdout: "event": "commit_sent", 2023-08-01T19:54:42.443 INFO:teuthology.orchestra.run.smithi101.stdout: "time": "2023-08-01T19:54:04.480209+0000", 2023-08-01T19:54:42.443 INFO:teuthology.orchestra.run.smithi101.stdout: "duration": 2.9244999999999999e-05 2023-08-01T19:54:42.443 INFO:teuthology.orchestra.run.smithi101.stdout: }, 2023-08-01T19:54:42.443 INFO:teuthology.orchestra.run.smithi101.stdout: { 2023-08-01T19:54:42.443 INFO:teuthology.orchestra.run.smithi101.stdout: "event": "done", 2023-08-01T19:54:42.443 INFO:teuthology.orchestra.run.smithi101.stdout: "time": "2023-08-01T19:54:04.480244+0000", 2023-08-01T19:54:42.443 INFO:teuthology.orchestra.run.smithi101.stdout: "duration": 3.4875000000000001e-05 2023-08-01T19:54:42.444 INFO:teuthology.orchestra.run.smithi101.stdout: } 2023-08-01T19:54:42.444 INFO:teuthology.orchestra.run.smithi101.stdout: ] 2023-08-01T19:54:42.444 INFO:teuthology.orchestra.run.smithi101.stdout: } 2023-08-01T19:54:42.444 INFO:teuthology.orchestra.run.smithi101.stdout: }, 2023-08-01T19:54:42.444 INFO:teuthology.orchestra.run.smithi101.stdout: { 2023-08-01T19:54:42.444 INFO:teuthology.orchestra.run.smithi101.stdout: "description": "osd_op(mds.0.3:2 3.f 3:f1f69726:::400.00000000:head [writefull 0~22] snapc 0=[] ondisk+write+known_if_redirected+full_force+supports_pool_eio e17)", 2023-08-01T19:54:42.444 INFO:teuthology.orchestra.run.smithi101.stdout: "initiated_at": "2023-08-01T19:54:04.459201+0000", 2023-08-01T19:54:42.444 INFO:teuthology.orchestra.run.smithi101.stdout: "age": 37.828369915000003, 2023-08-01T19:54:42.445 INFO:teuthology.orchestra.run.smithi101.stdout: "duration": 0.016952979, 2023-08-01T19:54:42.445 INFO:teuthology.orchestra.run.smithi101.stdout: "type_data": { 2023-08-01T19:54:42.445 INFO:teuthology.orchestra.run.smithi101.stdout: "flag_point": "commit sent; apply or cleanup", 2023-08-01T19:54:42.445 INFO:teuthology.orchestra.run.smithi101.stdout: "events": [ 2023-08-01T19:54:42.445 INFO:teuthology.orchestra.run.smithi101.stdout: { 2023-08-01T19:54:42.445 INFO:teuthology.orchestra.run.smithi101.stdout: "event": "initiated", 2023-08-01T19:54:42.445 INFO:teuthology.orchestra.run.smithi101.stdout: "time": "2023-08-01T19:54:04.459201+0000", 2023-08-01T19:54:42.445 INFO:teuthology.orchestra.run.smithi101.stdout: "duration": 0 2023-08-01T19:54:42.446 INFO:teuthology.orchestra.run.smithi101.stdout: }, 2023-08-01T19:54:42.446 INFO:teuthology.orchestra.run.smithi101.stdout: { 2023-08-01T19:54:42.446 INFO:teuthology.orchestra.run.smithi101.stdout: "event": "throttled", 2023-08-01T19:54:42.446 INFO:teuthology.orchestra.run.smithi101.stdout: "time": "2023-08-01T19:54:04.459201+0000", 2023-08-01T19:54:42.446 INFO:teuthology.orchestra.run.smithi101.stdout: "duration": 0 2023-08-01T19:54:42.446 INFO:teuthology.orchestra.run.smithi101.stdout: }, 2023-08-01T19:54:42.446 INFO:teuthology.orchestra.run.smithi101.stdout: { 2023-08-01T19:54:42.446 INFO:teuthology.orchestra.run.smithi101.stdout: "event": "header_read", 2023-08-01T19:54:42.447 INFO:teuthology.orchestra.run.smithi101.stdout: "time": "2023-08-01T19:54:04.459201+0000", 2023-08-01T19:54:42.447 INFO:teuthology.orchestra.run.smithi101.stdout: "duration": 4294967295.9999995 2023-08-01T19:54:42.447 INFO:teuthology.orchestra.run.smithi101.stdout: }, 2023-08-01T19:54:42.447 INFO:teuthology.orchestra.run.smithi101.stdout: { 2023-08-01T19:54:42.447 INFO:teuthology.orchestra.run.smithi101.stdout: "event": "all_read", 2023-08-01T19:54:42.447 INFO:teuthology.orchestra.run.smithi101.stdout: "time": "2023-08-01T19:54:04.459204+0000", 2023-08-01T19:54:42.447 INFO:teuthology.orchestra.run.smithi101.stdout: "duration": 3.5599999999999998e-06 2023-08-01T19:54:42.447 INFO:teuthology.orchestra.run.smithi101.stdout: }, 2023-08-01T19:54:42.448 INFO:teuthology.orchestra.run.smithi101.stdout: { 2023-08-01T19:54:42.448 INFO:teuthology.orchestra.run.smithi101.stdout: "event": "dispatched", 2023-08-01T19:54:42.448 INFO:teuthology.orchestra.run.smithi101.stdout: "time": "2023-08-01T19:54:04.459211+0000", 2023-08-01T19:54:42.448 INFO:teuthology.orchestra.run.smithi101.stdout: "duration": 6.9299999999999997e-06 2023-08-01T19:54:42.448 INFO:teuthology.orchestra.run.smithi101.stdout: }, 2023-08-01T19:54:42.448 INFO:teuthology.orchestra.run.smithi101.stdout: { 2023-08-01T19:54:42.448 INFO:teuthology.orchestra.run.smithi101.stdout: "event": "queued_for_pg", 2023-08-01T19:54:42.448 INFO:teuthology.orchestra.run.smithi101.stdout: "time": "2023-08-01T19:54:04.459216+0000", 2023-08-01T19:54:42.449 INFO:teuthology.orchestra.run.smithi101.stdout: "duration": 4.5050000000000001e-06 2023-08-01T19:54:42.449 INFO:teuthology.orchestra.run.smithi101.stdout: }, 2023-08-01T19:54:42.449 INFO:teuthology.orchestra.run.smithi101.stdout: { 2023-08-01T19:54:42.449 INFO:teuthology.orchestra.run.smithi101.stdout: "event": "reached_pg", 2023-08-01T19:54:42.449 INFO:teuthology.orchestra.run.smithi101.stdout: "time": "2023-08-01T19:54:04.459246+0000", 2023-08-01T19:54:42.449 INFO:teuthology.orchestra.run.smithi101.stdout: "duration": 3.0369999999999999e-05 2023-08-01T19:54:42.449 INFO:teuthology.orchestra.run.smithi101.stdout: }, 2023-08-01T19:54:42.449 INFO:teuthology.orchestra.run.smithi101.stdout: { 2023-08-01T19:54:42.450 INFO:teuthology.orchestra.run.smithi101.stdout: "event": "op must wait for map", 2023-08-01T19:54:42.450 INFO:teuthology.orchestra.run.smithi101.stdout: "time": "2023-08-01T19:54:04.459250+0000", 2023-08-01T19:54:42.450 INFO:teuthology.orchestra.run.smithi101.stdout: "duration": 3.6880000000000001e-06 2023-08-01T19:54:42.450 INFO:teuthology.orchestra.run.smithi101.stdout: }, 2023-08-01T19:54:42.450 INFO:teuthology.orchestra.run.smithi101.stdout: { 2023-08-01T19:54:42.450 INFO:teuthology.orchestra.run.smithi101.stdout: "event": "reached_pg", 2023-08-01T19:54:42.450 INFO:teuthology.orchestra.run.smithi101.stdout: "time": "2023-08-01T19:54:04.469499+0000", 2023-08-01T19:54:42.450 INFO:teuthology.orchestra.run.smithi101.stdout: "duration": 0.010249052 2023-08-01T19:54:42.451 INFO:teuthology.orchestra.run.smithi101.stdout: }, 2023-08-01T19:54:42.451 INFO:teuthology.orchestra.run.smithi101.stdout: { 2023-08-01T19:54:42.451 INFO:teuthology.orchestra.run.smithi101.stdout: "event": "started", 2023-08-01T19:54:42.451 INFO:teuthology.orchestra.run.smithi101.stdout: "time": "2023-08-01T19:54:04.469619+0000", 2023-08-01T19:54:42.451 INFO:teuthology.orchestra.run.smithi101.stdout: "duration": 0.000120061 2023-08-01T19:54:42.451 INFO:teuthology.orchestra.run.smithi101.stdout: }, 2023-08-01T19:54:42.451 INFO:teuthology.orchestra.run.smithi101.stdout: { 2023-08-01T19:54:42.451 INFO:teuthology.orchestra.run.smithi101.stdout: "event": "waiting for subops from 2", 2023-08-01T19:54:42.452 INFO:teuthology.orchestra.run.smithi101.stdout: "time": "2023-08-01T19:54:04.469903+0000", 2023-08-01T19:54:42.452 INFO:teuthology.orchestra.run.smithi101.stdout: "duration": 0.00028409799999999999 2023-08-01T19:54:42.452 INFO:teuthology.orchestra.run.smithi101.stdout: }, 2023-08-01T19:54:42.452 INFO:teuthology.orchestra.run.smithi101.stdout: { 2023-08-01T19:54:42.452 INFO:teuthology.orchestra.run.smithi101.stdout: "event": "sub_op_commit_rec", 2023-08-01T19:54:42.452 INFO:teuthology.orchestra.run.smithi101.stdout: "time": "2023-08-01T19:54:04.475166+0000", 2023-08-01T19:54:42.452 INFO:teuthology.orchestra.run.smithi101.stdout: "duration": 0.0052632460000000001 2023-08-01T19:54:42.453 INFO:teuthology.orchestra.run.smithi101.stdout: }, 2023-08-01T19:54:42.453 INFO:teuthology.orchestra.run.smithi101.stdout: { 2023-08-01T19:54:42.453 INFO:teuthology.orchestra.run.smithi101.stdout: "event": "op_commit", 2023-08-01T19:54:42.453 INFO:teuthology.orchestra.run.smithi101.stdout: "time": "2023-08-01T19:54:04.476056+0000", 2023-08-01T19:54:42.453 INFO:teuthology.orchestra.run.smithi101.stdout: "duration": 0.00089017499999999999 2023-08-01T19:54:42.453 INFO:teuthology.orchestra.run.smithi101.stdout: }, 2023-08-01T19:54:42.453 INFO:teuthology.orchestra.run.smithi101.stdout: { 2023-08-01T19:54:42.453 INFO:teuthology.orchestra.run.smithi101.stdout: "event": "commit_sent", 2023-08-01T19:54:42.454 INFO:teuthology.orchestra.run.smithi101.stdout: "time": "2023-08-01T19:54:04.476115+0000", 2023-08-01T19:54:42.454 INFO:teuthology.orchestra.run.smithi101.stdout: "duration": 5.8464999999999997e-05 2023-08-01T19:54:42.454 INFO:teuthology.orchestra.run.smithi101.stdout: }, 2023-08-01T19:54:42.454 INFO:teuthology.orchestra.run.smithi101.stdout: { 2023-08-01T19:54:42.454 INFO:teuthology.orchestra.run.smithi101.stdout: "event": "done", 2023-08-01T19:54:42.454 INFO:teuthology.orchestra.run.smithi101.stdout: "time": "2023-08-01T19:54:04.476154+0000", 2023-08-01T19:54:42.454 INFO:teuthology.orchestra.run.smithi101.stdout: "duration": 3.9229e-05 2023-08-01T19:54:42.454 INFO:teuthology.orchestra.run.smithi101.stdout: } 2023-08-01T19:54:42.455 INFO:teuthology.orchestra.run.smithi101.stdout: ] 2023-08-01T19:54:42.455 INFO:teuthology.orchestra.run.smithi101.stdout: } 2023-08-01T19:54:42.455 INFO:teuthology.orchestra.run.smithi101.stdout: }, 2023-08-01T19:54:42.455 INFO:teuthology.orchestra.run.smithi101.stdout: { 2023-08-01T19:54:42.455 INFO:teuthology.orchestra.run.smithi101.stdout: "description": "osd_op(mds.0.3:3 3.14 3:287034c4:::1.00000000.inode:head [writefull 0~554] snapc 0=[] ondisk+write+known_if_redirected+full_force+supports_pool_eio e17)", 2023-08-01T19:54:42.455 INFO:teuthology.orchestra.run.smithi101.stdout: "initiated_at": "2023-08-01T19:54:04.459226+0000", 2023-08-01T19:54:42.455 INFO:teuthology.orchestra.run.smithi101.stdout: "age": 37.828345091999999, 2023-08-01T19:54:42.455 INFO:teuthology.orchestra.run.smithi101.stdout: "duration": 0.021104531999999999, 2023-08-01T19:54:42.456 INFO:teuthology.orchestra.run.smithi101.stdout: "type_data": { 2023-08-01T19:54:42.456 INFO:teuthology.orchestra.run.smithi101.stdout: "flag_point": "commit sent; apply or cleanup", 2023-08-01T19:54:42.456 INFO:teuthology.orchestra.run.smithi101.stdout: "events": [ 2023-08-01T19:54:42.456 INFO:teuthology.orchestra.run.smithi101.stdout: { 2023-08-01T19:54:42.456 INFO:teuthology.orchestra.run.smithi101.stdout: "event": "initiated", 2023-08-01T19:54:42.456 INFO:teuthology.orchestra.run.smithi101.stdout: "time": "2023-08-01T19:54:04.459226+0000", 2023-08-01T19:54:42.456 INFO:teuthology.orchestra.run.smithi101.stdout: "duration": 0 2023-08-01T19:54:42.456 INFO:teuthology.orchestra.run.smithi101.stdout: }, 2023-08-01T19:54:42.457 INFO:teuthology.orchestra.run.smithi101.stdout: { 2023-08-01T19:54:42.457 INFO:teuthology.orchestra.run.smithi101.stdout: "event": "throttled", 2023-08-01T19:54:42.457 INFO:teuthology.orchestra.run.smithi101.stdout: "time": "2023-08-01T19:54:04.459226+0000", 2023-08-01T19:54:42.457 INFO:teuthology.orchestra.run.smithi101.stdout: "duration": 0 2023-08-01T19:54:42.457 INFO:teuthology.orchestra.run.smithi101.stdout: }, 2023-08-01T19:54:42.457 INFO:teuthology.orchestra.run.smithi101.stdout: { 2023-08-01T19:54:42.457 INFO:teuthology.orchestra.run.smithi101.stdout: "event": "header_read", 2023-08-01T19:54:42.457 INFO:teuthology.orchestra.run.smithi101.stdout: "time": "2023-08-01T19:54:04.459225+0000", 2023-08-01T19:54:42.458 INFO:teuthology.orchestra.run.smithi101.stdout: "duration": 4294967295.9999995 2023-08-01T19:54:42.458 INFO:teuthology.orchestra.run.smithi101.stdout: }, 2023-08-01T19:54:42.458 INFO:teuthology.orchestra.run.smithi101.stdout: { 2023-08-01T19:54:42.458 INFO:teuthology.orchestra.run.smithi101.stdout: "event": "all_read", 2023-08-01T19:54:42.458 INFO:teuthology.orchestra.run.smithi101.stdout: "time": "2023-08-01T19:54:04.459238+0000", 2023-08-01T19:54:42.458 INFO:teuthology.orchestra.run.smithi101.stdout: "duration": 1.2809000000000001e-05 2023-08-01T19:54:42.458 INFO:teuthology.orchestra.run.smithi101.stdout: }, 2023-08-01T19:54:42.458 INFO:teuthology.orchestra.run.smithi101.stdout: { 2023-08-01T19:54:42.459 INFO:teuthology.orchestra.run.smithi101.stdout: "event": "dispatched", 2023-08-01T19:54:42.459 INFO:teuthology.orchestra.run.smithi101.stdout: "time": "2023-08-01T19:54:04.459245+0000", 2023-08-01T19:54:42.459 INFO:teuthology.orchestra.run.smithi101.stdout: "duration": 6.6540000000000002e-06 2023-08-01T19:54:42.459 INFO:teuthology.orchestra.run.smithi101.stdout: }, 2023-08-01T19:54:42.459 INFO:teuthology.orchestra.run.smithi101.stdout: { 2023-08-01T19:54:42.459 INFO:teuthology.orchestra.run.smithi101.stdout: "event": "queued_for_pg", 2023-08-01T19:54:42.459 INFO:teuthology.orchestra.run.smithi101.stdout: "time": "2023-08-01T19:54:04.459249+0000", 2023-08-01T19:54:42.459 INFO:teuthology.orchestra.run.smithi101.stdout: "duration": 4.6e-06 2023-08-01T19:54:42.460 INFO:teuthology.orchestra.run.smithi101.stdout: }, 2023-08-01T19:54:42.460 INFO:teuthology.orchestra.run.smithi101.stdout: { 2023-08-01T19:54:42.460 INFO:teuthology.orchestra.run.smithi101.stdout: "event": "reached_pg", 2023-08-01T19:54:42.460 INFO:teuthology.orchestra.run.smithi101.stdout: "time": "2023-08-01T19:54:04.459276+0000", 2023-08-01T19:54:42.460 INFO:teuthology.orchestra.run.smithi101.stdout: "duration": 2.6373999999999999e-05 2023-08-01T19:54:42.460 INFO:teuthology.orchestra.run.smithi101.stdout: }, 2023-08-01T19:54:42.460 INFO:teuthology.orchestra.run.smithi101.stdout: { 2023-08-01T19:54:42.461 INFO:teuthology.orchestra.run.smithi101.stdout: "event": "waiting_for_map not empty", 2023-08-01T19:54:42.461 INFO:teuthology.orchestra.run.smithi101.stdout: "time": "2023-08-01T19:54:04.459278+0000", 2023-08-01T19:54:42.461 INFO:teuthology.orchestra.run.smithi101.stdout: "duration": 2.4980000000000001e-06 2023-08-01T19:54:42.461 INFO:teuthology.orchestra.run.smithi101.stdout: }, 2023-08-01T19:54:42.461 INFO:teuthology.orchestra.run.smithi101.stdout: { 2023-08-01T19:54:42.461 INFO:teuthology.orchestra.run.smithi101.stdout: "event": "reached_pg", 2023-08-01T19:54:42.461 INFO:teuthology.orchestra.run.smithi101.stdout: "time": "2023-08-01T19:54:04.474058+0000", 2023-08-01T19:54:42.461 INFO:teuthology.orchestra.run.smithi101.stdout: "duration": 0.014779979 2023-08-01T19:54:42.462 INFO:teuthology.orchestra.run.smithi101.stdout: }, 2023-08-01T19:54:42.462 INFO:teuthology.orchestra.run.smithi101.stdout: { 2023-08-01T19:54:42.462 INFO:teuthology.orchestra.run.smithi101.stdout: "event": "started", 2023-08-01T19:54:42.462 INFO:teuthology.orchestra.run.smithi101.stdout: "time": "2023-08-01T19:54:04.474614+0000", 2023-08-01T19:54:42.462 INFO:teuthology.orchestra.run.smithi101.stdout: "duration": 0.00055546899999999995 2023-08-01T19:54:42.462 INFO:teuthology.orchestra.run.smithi101.stdout: }, 2023-08-01T19:54:42.462 INFO:teuthology.orchestra.run.smithi101.stdout: { 2023-08-01T19:54:42.462 INFO:teuthology.orchestra.run.smithi101.stdout: "event": "waiting for subops from 2", 2023-08-01T19:54:42.463 INFO:teuthology.orchestra.run.smithi101.stdout: "time": "2023-08-01T19:54:04.474720+0000", 2023-08-01T19:54:42.463 INFO:teuthology.orchestra.run.smithi101.stdout: "duration": 0.00010645300000000001 2023-08-01T19:54:42.463 INFO:teuthology.orchestra.run.smithi101.stdout: }, 2023-08-01T19:54:42.463 INFO:teuthology.orchestra.run.smithi101.stdout: { 2023-08-01T19:54:42.463 INFO:teuthology.orchestra.run.smithi101.stdout: "event": "op_commit", 2023-08-01T19:54:42.463 INFO:teuthology.orchestra.run.smithi101.stdout: "time": "2023-08-01T19:54:04.478480+0000", 2023-08-01T19:54:42.463 INFO:teuthology.orchestra.run.smithi101.stdout: "duration": 0.0037600279999999999 2023-08-01T19:54:42.463 INFO:teuthology.orchestra.run.smithi101.stdout: }, 2023-08-01T19:54:42.464 INFO:teuthology.orchestra.run.smithi101.stdout: { 2023-08-01T19:54:42.464 INFO:teuthology.orchestra.run.smithi101.stdout: "event": "sub_op_commit_rec", 2023-08-01T19:54:42.464 INFO:teuthology.orchestra.run.smithi101.stdout: "time": "2023-08-01T19:54:04.480273+0000", 2023-08-01T19:54:42.464 INFO:teuthology.orchestra.run.smithi101.stdout: "duration": 0.001792465 2023-08-01T19:54:42.464 INFO:teuthology.orchestra.run.smithi101.stdout: }, 2023-08-01T19:54:42.464 INFO:teuthology.orchestra.run.smithi101.stdout: { 2023-08-01T19:54:42.464 INFO:teuthology.orchestra.run.smithi101.stdout: "event": "commit_sent", 2023-08-01T19:54:42.464 INFO:teuthology.orchestra.run.smithi101.stdout: "time": "2023-08-01T19:54:04.480304+0000", 2023-08-01T19:54:42.465 INFO:teuthology.orchestra.run.smithi101.stdout: "duration": 3.1708999999999997e-05 2023-08-01T19:54:42.465 INFO:teuthology.orchestra.run.smithi101.stdout: }, 2023-08-01T19:54:42.465 INFO:teuthology.orchestra.run.smithi101.stdout: { 2023-08-01T19:54:42.465 INFO:teuthology.orchestra.run.smithi101.stdout: "event": "done", 2023-08-01T19:54:42.465 INFO:teuthology.orchestra.run.smithi101.stdout: "time": "2023-08-01T19:54:04.480330+0000", 2023-08-01T19:54:42.465 INFO:teuthology.orchestra.run.smithi101.stdout: "duration": 2.5860999999999999e-05 2023-08-01T19:54:42.465 INFO:teuthology.orchestra.run.smithi101.stdout: } 2023-08-01T19:54:42.465 INFO:teuthology.orchestra.run.smithi101.stdout: ] 2023-08-01T19:54:42.466 INFO:teuthology.orchestra.run.smithi101.stdout: } 2023-08-01T19:54:42.466 INFO:teuthology.orchestra.run.smithi101.stdout: }, 2023-08-01T19:54:42.466 INFO:teuthology.orchestra.run.smithi101.stdout: { 2023-08-01T19:54:42.466 INFO:teuthology.orchestra.run.smithi101.stdout: "description": "osd_op(mds.0.3:27 3.13 3:c91d4a1d:::mds0_inotable:head [writefull 0~34] snapc 0=[] ondisk+write+known_if_redirected+full_force+supports_pool_eio e17)", 2023-08-01T19:54:42.466 INFO:teuthology.orchestra.run.smithi101.stdout: "initiated_at": "2023-08-01T19:54:04.459260+0000", 2023-08-01T19:54:42.466 INFO:teuthology.orchestra.run.smithi101.stdout: "age": 37.828311200999998, 2023-08-01T19:54:42.466 INFO:teuthology.orchestra.run.smithi101.stdout: "duration": 0.016792715999999999, 2023-08-01T19:54:42.466 INFO:teuthology.orchestra.run.smithi101.stdout: "type_data": { 2023-08-01T19:54:42.467 INFO:teuthology.orchestra.run.smithi101.stdout: "flag_point": "commit sent; apply or cleanup", 2023-08-01T19:54:42.467 INFO:teuthology.orchestra.run.smithi101.stdout: "events": [ 2023-08-01T19:54:42.467 INFO:teuthology.orchestra.run.smithi101.stdout: { 2023-08-01T19:54:42.467 INFO:teuthology.orchestra.run.smithi101.stdout: "event": "initiated", 2023-08-01T19:54:42.467 INFO:teuthology.orchestra.run.smithi101.stdout: "time": "2023-08-01T19:54:04.459260+0000", 2023-08-01T19:54:42.467 INFO:teuthology.orchestra.run.smithi101.stdout: "duration": 0 2023-08-01T19:54:42.467 INFO:teuthology.orchestra.run.smithi101.stdout: }, 2023-08-01T19:54:42.467 INFO:teuthology.orchestra.run.smithi101.stdout: { 2023-08-01T19:54:42.468 INFO:teuthology.orchestra.run.smithi101.stdout: "event": "throttled", 2023-08-01T19:54:42.468 INFO:teuthology.orchestra.run.smithi101.stdout: "time": "2023-08-01T19:54:04.459260+0000", 2023-08-01T19:54:42.468 INFO:teuthology.orchestra.run.smithi101.stdout: "duration": 0 2023-08-01T19:54:42.468 INFO:teuthology.orchestra.run.smithi101.stdout: }, 2023-08-01T19:54:42.468 INFO:teuthology.orchestra.run.smithi101.stdout: { 2023-08-01T19:54:42.468 INFO:teuthology.orchestra.run.smithi101.stdout: "event": "header_read", 2023-08-01T19:54:42.468 INFO:teuthology.orchestra.run.smithi101.stdout: "time": "2023-08-01T19:54:04.459259+0000", 2023-08-01T19:54:42.469 INFO:teuthology.orchestra.run.smithi101.stdout: "duration": 4294967295.9999995 2023-08-01T19:54:42.469 INFO:teuthology.orchestra.run.smithi101.stdout: }, 2023-08-01T19:54:42.469 INFO:teuthology.orchestra.run.smithi101.stdout: { 2023-08-01T19:54:42.469 INFO:teuthology.orchestra.run.smithi101.stdout: "event": "all_read", 2023-08-01T19:54:42.469 INFO:teuthology.orchestra.run.smithi101.stdout: "time": "2023-08-01T19:54:04.459263+0000", 2023-08-01T19:54:42.469 INFO:teuthology.orchestra.run.smithi101.stdout: "duration": 3.9249999999999997e-06 2023-08-01T19:54:42.469 INFO:teuthology.orchestra.run.smithi101.stdout: }, 2023-08-01T19:54:42.469 INFO:teuthology.orchestra.run.smithi101.stdout: { 2023-08-01T19:54:42.470 INFO:teuthology.orchestra.run.smithi101.stdout: "event": "dispatched", 2023-08-01T19:54:42.470 INFO:teuthology.orchestra.run.smithi101.stdout: "time": "2023-08-01T19:54:04.459270+0000", 2023-08-01T19:54:42.470 INFO:teuthology.orchestra.run.smithi101.stdout: "duration": 7.0180000000000004e-06 2023-08-01T19:54:42.470 INFO:teuthology.orchestra.run.smithi101.stdout: }, 2023-08-01T19:54:42.470 INFO:teuthology.orchestra.run.smithi101.stdout: { 2023-08-01T19:54:42.470 INFO:teuthology.orchestra.run.smithi101.stdout: "event": "queued_for_pg", 2023-08-01T19:54:42.470 INFO:teuthology.orchestra.run.smithi101.stdout: "time": "2023-08-01T19:54:04.459275+0000", 2023-08-01T19:54:42.470 INFO:teuthology.orchestra.run.smithi101.stdout: "duration": 4.763e-06 2023-08-01T19:54:42.471 INFO:teuthology.orchestra.run.smithi101.stdout: }, 2023-08-01T19:54:42.471 INFO:teuthology.orchestra.run.smithi101.stdout: { 2023-08-01T19:54:42.471 INFO:teuthology.orchestra.run.smithi101.stdout: "event": "reached_pg", 2023-08-01T19:54:42.471 INFO:teuthology.orchestra.run.smithi101.stdout: "time": "2023-08-01T19:54:04.459298+0000", 2023-08-01T19:54:42.471 INFO:teuthology.orchestra.run.smithi101.stdout: "duration": 2.3193e-05 2023-08-01T19:54:42.471 INFO:teuthology.orchestra.run.smithi101.stdout: }, 2023-08-01T19:54:42.471 INFO:teuthology.orchestra.run.smithi101.stdout: { 2023-08-01T19:54:42.471 INFO:teuthology.orchestra.run.smithi101.stdout: "event": "waiting_for_map not empty", 2023-08-01T19:54:42.472 INFO:teuthology.orchestra.run.smithi101.stdout: "time": "2023-08-01T19:54:04.459301+0000", 2023-08-01T19:54:42.472 INFO:teuthology.orchestra.run.smithi101.stdout: "duration": 3.0539999999999999e-06 2023-08-01T19:54:42.472 INFO:teuthology.orchestra.run.smithi101.stdout: }, 2023-08-01T19:54:42.472 INFO:teuthology.orchestra.run.smithi101.stdout: { 2023-08-01T19:54:42.472 INFO:teuthology.orchestra.run.smithi101.stdout: "event": "reached_pg", 2023-08-01T19:54:42.472 INFO:teuthology.orchestra.run.smithi101.stdout: "time": "2023-08-01T19:54:04.469447+0000", 2023-08-01T19:54:42.472 INFO:teuthology.orchestra.run.smithi101.stdout: "duration": 0.010145573999999999 2023-08-01T19:54:42.472 INFO:teuthology.orchestra.run.smithi101.stdout: }, 2023-08-01T19:54:42.473 INFO:teuthology.orchestra.run.smithi101.stdout: { 2023-08-01T19:54:42.473 INFO:teuthology.orchestra.run.smithi101.stdout: "event": "started", 2023-08-01T19:54:42.473 INFO:teuthology.orchestra.run.smithi101.stdout: "time": "2023-08-01T19:54:04.469559+0000", 2023-08-01T19:54:42.473 INFO:teuthology.orchestra.run.smithi101.stdout: "duration": 0.000112068 2023-08-01T19:54:42.473 INFO:teuthology.orchestra.run.smithi101.stdout: }, 2023-08-01T19:54:42.473 INFO:teuthology.orchestra.run.smithi101.stdout: { 2023-08-01T19:54:42.473 INFO:teuthology.orchestra.run.smithi101.stdout: "event": "waiting for subops from 0", 2023-08-01T19:54:42.473 INFO:teuthology.orchestra.run.smithi101.stdout: "time": "2023-08-01T19:54:04.469895+0000", 2023-08-01T19:54:42.474 INFO:teuthology.orchestra.run.smithi101.stdout: "duration": 0.000336604 2023-08-01T19:54:42.474 INFO:teuthology.orchestra.run.smithi101.stdout: }, 2023-08-01T19:54:42.474 INFO:teuthology.orchestra.run.smithi101.stdout: { 2023-08-01T19:54:42.474 INFO:teuthology.orchestra.run.smithi101.stdout: "event": "sub_op_commit_rec", 2023-08-01T19:54:42.474 INFO:teuthology.orchestra.run.smithi101.stdout: "time": "2023-08-01T19:54:04.475096+0000", 2023-08-01T19:54:42.474 INFO:teuthology.orchestra.run.smithi101.stdout: "duration": 0.0052010540000000001 2023-08-01T19:54:42.474 INFO:teuthology.orchestra.run.smithi101.stdout: }, 2023-08-01T19:54:42.474 INFO:teuthology.orchestra.run.smithi101.stdout: { 2023-08-01T19:54:42.475 INFO:teuthology.orchestra.run.smithi101.stdout: "event": "op_commit", 2023-08-01T19:54:42.475 INFO:teuthology.orchestra.run.smithi101.stdout: "time": "2023-08-01T19:54:04.475965+0000", 2023-08-01T19:54:42.475 INFO:teuthology.orchestra.run.smithi101.stdout: "duration": 0.00086860500000000005 2023-08-01T19:54:42.475 INFO:teuthology.orchestra.run.smithi101.stdout: }, 2023-08-01T19:54:42.475 INFO:teuthology.orchestra.run.smithi101.stdout: { 2023-08-01T19:54:42.475 INFO:teuthology.orchestra.run.smithi101.stdout: "event": "commit_sent", 2023-08-01T19:54:42.475 INFO:teuthology.orchestra.run.smithi101.stdout: "time": "2023-08-01T19:54:04.476007+0000", 2023-08-01T19:54:42.475 INFO:teuthology.orchestra.run.smithi101.stdout: "duration": 4.2228000000000003e-05 2023-08-01T19:54:42.476 INFO:teuthology.orchestra.run.smithi101.stdout: }, 2023-08-01T19:54:42.476 INFO:teuthology.orchestra.run.smithi101.stdout: { 2023-08-01T19:54:42.476 INFO:teuthology.orchestra.run.smithi101.stdout: "event": "done", 2023-08-01T19:54:42.476 INFO:teuthology.orchestra.run.smithi101.stdout: "time": "2023-08-01T19:54:04.476052+0000", 2023-08-01T19:54:42.476 INFO:teuthology.orchestra.run.smithi101.stdout: "duration": 4.5188000000000002e-05 2023-08-01T19:54:42.476 INFO:teuthology.orchestra.run.smithi101.stdout: } 2023-08-01T19:54:42.476 INFO:teuthology.orchestra.run.smithi101.stdout: ] 2023-08-01T19:54:42.476 INFO:teuthology.orchestra.run.smithi101.stdout: } 2023-08-01T19:54:42.477 INFO:teuthology.orchestra.run.smithi101.stdout: }, 2023-08-01T19:54:42.477 INFO:teuthology.orchestra.run.smithi101.stdout: { 2023-08-01T19:54:42.477 INFO:teuthology.orchestra.run.smithi101.stdout: "description": "osd_op(mds.0.3:31 3.d 3:b50e409b:::mds_snaptable:head [writefull 0~70] snapc 0=[] ondisk+write+known_if_redirected+full_force+supports_pool_eio e17)", 2023-08-01T19:54:42.477 INFO:teuthology.orchestra.run.smithi101.stdout: "initiated_at": "2023-08-01T19:54:04.459283+0000", 2023-08-01T19:54:42.477 INFO:teuthology.orchestra.run.smithi101.stdout: "age": 37.828288264000001, 2023-08-01T19:54:42.477 INFO:teuthology.orchestra.run.smithi101.stdout: "duration": 0.01676277, 2023-08-01T19:54:42.477 INFO:teuthology.orchestra.run.smithi101.stdout: "type_data": { 2023-08-01T19:54:42.477 INFO:teuthology.orchestra.run.smithi101.stdout: "flag_point": "commit sent; apply or cleanup", 2023-08-01T19:54:42.478 INFO:teuthology.orchestra.run.smithi101.stdout: "events": [ 2023-08-01T19:54:42.478 INFO:teuthology.orchestra.run.smithi101.stdout: { 2023-08-01T19:54:42.478 INFO:teuthology.orchestra.run.smithi101.stdout: "event": "initiated", 2023-08-01T19:54:42.478 INFO:teuthology.orchestra.run.smithi101.stdout: "time": "2023-08-01T19:54:04.459283+0000", 2023-08-01T19:54:42.478 INFO:teuthology.orchestra.run.smithi101.stdout: "duration": 0 2023-08-01T19:54:42.478 INFO:teuthology.orchestra.run.smithi101.stdout: }, 2023-08-01T19:54:42.478 INFO:teuthology.orchestra.run.smithi101.stdout: { 2023-08-01T19:54:42.478 INFO:teuthology.orchestra.run.smithi101.stdout: "event": "throttled", 2023-08-01T19:54:42.479 INFO:teuthology.orchestra.run.smithi101.stdout: "time": "2023-08-01T19:54:04.459283+0000", 2023-08-01T19:54:42.479 INFO:teuthology.orchestra.run.smithi101.stdout: "duration": 0 2023-08-01T19:54:42.479 INFO:teuthology.orchestra.run.smithi101.stdout: }, 2023-08-01T19:54:42.479 INFO:teuthology.orchestra.run.smithi101.stdout: { 2023-08-01T19:54:42.479 INFO:teuthology.orchestra.run.smithi101.stdout: "event": "header_read", 2023-08-01T19:54:42.479 INFO:teuthology.orchestra.run.smithi101.stdout: "time": "2023-08-01T19:54:04.459282+0000", 2023-08-01T19:54:42.479 INFO:teuthology.orchestra.run.smithi101.stdout: "duration": 4294967295.9999995 2023-08-01T19:54:42.479 INFO:teuthology.orchestra.run.smithi101.stdout: }, 2023-08-01T19:54:42.480 INFO:teuthology.orchestra.run.smithi101.stdout: { 2023-08-01T19:54:42.480 INFO:teuthology.orchestra.run.smithi101.stdout: "event": "all_read", 2023-08-01T19:54:42.480 INFO:teuthology.orchestra.run.smithi101.stdout: "time": "2023-08-01T19:54:04.459285+0000", 2023-08-01T19:54:42.480 INFO:teuthology.orchestra.run.smithi101.stdout: "duration": 3.2590000000000001e-06 2023-08-01T19:54:42.480 INFO:teuthology.orchestra.run.smithi101.stdout: }, 2023-08-01T19:54:42.480 INFO:teuthology.orchestra.run.smithi101.stdout: { 2023-08-01T19:54:42.480 INFO:teuthology.orchestra.run.smithi101.stdout: "event": "dispatched", 2023-08-01T19:54:42.481 INFO:teuthology.orchestra.run.smithi101.stdout: "time": "2023-08-01T19:54:04.459291+0000", 2023-08-01T19:54:42.481 INFO:teuthology.orchestra.run.smithi101.stdout: "duration": 6.0750000000000003e-06 2023-08-01T19:54:42.481 INFO:teuthology.orchestra.run.smithi101.stdout: }, 2023-08-01T19:54:42.481 INFO:teuthology.orchestra.run.smithi101.stdout: { 2023-08-01T19:54:42.481 INFO:teuthology.orchestra.run.smithi101.stdout: "event": "queued_for_pg", 2023-08-01T19:54:42.481 INFO:teuthology.orchestra.run.smithi101.stdout: "time": "2023-08-01T19:54:04.459295+0000", 2023-08-01T19:54:42.481 INFO:teuthology.orchestra.run.smithi101.stdout: "duration": 3.7500000000000001e-06 2023-08-01T19:54:42.481 INFO:teuthology.orchestra.run.smithi101.stdout: }, 2023-08-01T19:54:42.482 INFO:teuthology.orchestra.run.smithi101.stdout: { 2023-08-01T19:54:42.482 INFO:teuthology.orchestra.run.smithi101.stdout: "event": "reached_pg", 2023-08-01T19:54:42.482 INFO:teuthology.orchestra.run.smithi101.stdout: "time": "2023-08-01T19:54:04.459323+0000", 2023-08-01T19:54:42.482 INFO:teuthology.orchestra.run.smithi101.stdout: "duration": 2.7351e-05 2023-08-01T19:54:42.482 INFO:teuthology.orchestra.run.smithi101.stdout: }, 2023-08-01T19:54:42.482 INFO:teuthology.orchestra.run.smithi101.stdout: { 2023-08-01T19:54:42.482 INFO:teuthology.orchestra.run.smithi101.stdout: "event": "op must wait for map", 2023-08-01T19:54:42.482 INFO:teuthology.orchestra.run.smithi101.stdout: "time": "2023-08-01T19:54:04.459327+0000", 2023-08-01T19:54:42.483 INFO:teuthology.orchestra.run.smithi101.stdout: "duration": 4.1849999999999997e-06 2023-08-01T19:54:42.483 INFO:teuthology.orchestra.run.smithi101.stdout: }, 2023-08-01T19:54:42.483 INFO:teuthology.orchestra.run.smithi101.stdout: { 2023-08-01T19:54:42.483 INFO:teuthology.orchestra.run.smithi101.stdout: "event": "reached_pg", 2023-08-01T19:54:42.483 INFO:teuthology.orchestra.run.smithi101.stdout: "time": "2023-08-01T19:54:04.468708+0000", 2023-08-01T19:54:42.483 INFO:teuthology.orchestra.run.smithi101.stdout: "duration": 0.0093817420000000002 2023-08-01T19:54:42.483 INFO:teuthology.orchestra.run.smithi101.stdout: }, 2023-08-01T19:54:42.483 INFO:teuthology.orchestra.run.smithi101.stdout: { 2023-08-01T19:54:42.484 INFO:teuthology.orchestra.run.smithi101.stdout: "event": "started", 2023-08-01T19:54:42.484 INFO:teuthology.orchestra.run.smithi101.stdout: "time": "2023-08-01T19:54:04.468830+0000", 2023-08-01T19:54:42.484 INFO:teuthology.orchestra.run.smithi101.stdout: "duration": 0.000121339 2023-08-01T19:54:42.484 INFO:teuthology.orchestra.run.smithi101.stdout: }, 2023-08-01T19:54:42.484 INFO:teuthology.orchestra.run.smithi101.stdout: { 2023-08-01T19:54:42.484 INFO:teuthology.orchestra.run.smithi101.stdout: "event": "waiting for subops from 2", 2023-08-01T19:54:42.484 INFO:teuthology.orchestra.run.smithi101.stdout: "time": "2023-08-01T19:54:04.469611+0000", 2023-08-01T19:54:42.485 INFO:teuthology.orchestra.run.smithi101.stdout: "duration": 0.00078162900000000005 2023-08-01T19:54:42.485 INFO:teuthology.orchestra.run.smithi101.stdout: }, 2023-08-01T19:54:42.485 INFO:teuthology.orchestra.run.smithi101.stdout: { 2023-08-01T19:54:42.485 INFO:teuthology.orchestra.run.smithi101.stdout: "event": "sub_op_commit_rec", 2023-08-01T19:54:42.485 INFO:teuthology.orchestra.run.smithi101.stdout: "time": "2023-08-01T19:54:04.475478+0000", 2023-08-01T19:54:42.485 INFO:teuthology.orchestra.run.smithi101.stdout: "duration": 0.005866586 2023-08-01T19:54:42.485 INFO:teuthology.orchestra.run.smithi101.stdout: }, 2023-08-01T19:54:42.485 INFO:teuthology.orchestra.run.smithi101.stdout: { 2023-08-01T19:54:42.486 INFO:teuthology.orchestra.run.smithi101.stdout: "event": "op_commit", 2023-08-01T19:54:42.486 INFO:teuthology.orchestra.run.smithi101.stdout: "time": "2023-08-01T19:54:04.475941+0000", 2023-08-01T19:54:42.486 INFO:teuthology.orchestra.run.smithi101.stdout: "duration": 0.000462526 2023-08-01T19:54:42.486 INFO:teuthology.orchestra.run.smithi101.stdout: }, 2023-08-01T19:54:42.486 INFO:teuthology.orchestra.run.smithi101.stdout: { 2023-08-01T19:54:42.486 INFO:teuthology.orchestra.run.smithi101.stdout: "event": "commit_sent", 2023-08-01T19:54:42.486 INFO:teuthology.orchestra.run.smithi101.stdout: "time": "2023-08-01T19:54:04.475995+0000", 2023-08-01T19:54:42.486 INFO:teuthology.orchestra.run.smithi101.stdout: "duration": 5.4401000000000003e-05 2023-08-01T19:54:42.487 INFO:teuthology.orchestra.run.smithi101.stdout: }, 2023-08-01T19:54:42.487 INFO:teuthology.orchestra.run.smithi101.stdout: { 2023-08-01T19:54:42.487 INFO:teuthology.orchestra.run.smithi101.stdout: "event": "done", 2023-08-01T19:54:42.487 INFO:teuthology.orchestra.run.smithi101.stdout: "time": "2023-08-01T19:54:04.476045+0000", 2023-08-01T19:54:42.487 INFO:teuthology.orchestra.run.smithi101.stdout: "duration": 5.0389000000000002e-05 2023-08-01T19:54:42.487 INFO:teuthology.orchestra.run.smithi101.stdout: } 2023-08-01T19:54:42.487 INFO:teuthology.orchestra.run.smithi101.stdout: ] 2023-08-01T19:54:42.487 INFO:teuthology.orchestra.run.smithi101.stdout: } 2023-08-01T19:54:42.488 INFO:teuthology.orchestra.run.smithi101.stdout: }, 2023-08-01T19:54:42.488 INFO:teuthology.orchestra.run.smithi101.stdout: { 2023-08-01T19:54:42.488 INFO:teuthology.orchestra.run.smithi101.stdout: "description": "osd_op(mds.0.3:32 3.14 3:2e2fa760:::200.00000001:head [delete] snapc 0=[] ondisk+write+known_if_redirected+full_force+supports_pool_eio e17)", 2023-08-01T19:54:42.488 INFO:teuthology.orchestra.run.smithi101.stdout: "initiated_at": "2023-08-01T19:54:04.459304+0000", 2023-08-01T19:54:42.488 INFO:teuthology.orchestra.run.smithi101.stdout: "age": 37.828266431000003, 2023-08-01T19:54:42.488 INFO:teuthology.orchestra.run.smithi101.stdout: "duration": 0.021110606000000001, 2023-08-01T19:54:42.488 INFO:teuthology.orchestra.run.smithi101.stdout: "type_data": { 2023-08-01T19:54:42.488 INFO:teuthology.orchestra.run.smithi101.stdout: "flag_point": "started", 2023-08-01T19:54:42.489 INFO:teuthology.orchestra.run.smithi101.stdout: "events": [ 2023-08-01T19:54:42.489 INFO:teuthology.orchestra.run.smithi101.stdout: { 2023-08-01T19:54:42.489 INFO:teuthology.orchestra.run.smithi101.stdout: "event": "initiated", 2023-08-01T19:54:42.489 INFO:teuthology.orchestra.run.smithi101.stdout: "time": "2023-08-01T19:54:04.459304+0000", 2023-08-01T19:54:42.489 INFO:teuthology.orchestra.run.smithi101.stdout: "duration": 0 2023-08-01T19:54:42.489 INFO:teuthology.orchestra.run.smithi101.stdout: }, 2023-08-01T19:54:42.489 INFO:teuthology.orchestra.run.smithi101.stdout: { 2023-08-01T19:54:42.489 INFO:teuthology.orchestra.run.smithi101.stdout: "event": "throttled", 2023-08-01T19:54:42.490 INFO:teuthology.orchestra.run.smithi101.stdout: "time": "2023-08-01T19:54:04.459304+0000", 2023-08-01T19:54:42.490 INFO:teuthology.orchestra.run.smithi101.stdout: "duration": 0 2023-08-01T19:54:42.490 INFO:teuthology.orchestra.run.smithi101.stdout: }, 2023-08-01T19:54:42.490 INFO:teuthology.orchestra.run.smithi101.stdout: { 2023-08-01T19:54:42.490 INFO:teuthology.orchestra.run.smithi101.stdout: "event": "header_read", 2023-08-01T19:54:42.490 INFO:teuthology.orchestra.run.smithi101.stdout: "time": "2023-08-01T19:54:04.459304+0000", 2023-08-01T19:54:42.490 INFO:teuthology.orchestra.run.smithi101.stdout: "duration": 4294967295.9999995 2023-08-01T19:54:42.490 INFO:teuthology.orchestra.run.smithi101.stdout: }, 2023-08-01T19:54:42.491 INFO:teuthology.orchestra.run.smithi101.stdout: { 2023-08-01T19:54:42.491 INFO:teuthology.orchestra.run.smithi101.stdout: "event": "all_read", 2023-08-01T19:54:42.491 INFO:teuthology.orchestra.run.smithi101.stdout: "time": "2023-08-01T19:54:04.459306+0000", 2023-08-01T19:54:42.491 INFO:teuthology.orchestra.run.smithi101.stdout: "duration": 2.3889999999999999e-06 2023-08-01T19:54:42.491 INFO:teuthology.orchestra.run.smithi101.stdout: }, 2023-08-01T19:54:42.491 INFO:teuthology.orchestra.run.smithi101.stdout: { 2023-08-01T19:54:42.491 INFO:teuthology.orchestra.run.smithi101.stdout: "event": "dispatched", 2023-08-01T19:54:42.491 INFO:teuthology.orchestra.run.smithi101.stdout: "time": "2023-08-01T19:54:04.459314+0000", 2023-08-01T19:54:42.492 INFO:teuthology.orchestra.run.smithi101.stdout: "duration": 7.1180000000000003e-06 2023-08-01T19:54:42.492 INFO:teuthology.orchestra.run.smithi101.stdout: }, 2023-08-01T19:54:42.492 INFO:teuthology.orchestra.run.smithi101.stdout: { 2023-08-01T19:54:42.492 INFO:teuthology.orchestra.run.smithi101.stdout: "event": "queued_for_pg", 2023-08-01T19:54:42.492 INFO:teuthology.orchestra.run.smithi101.stdout: "time": "2023-08-01T19:54:04.459318+0000", 2023-08-01T19:54:42.492 INFO:teuthology.orchestra.run.smithi101.stdout: "duration": 4.0239999999999999e-06 2023-08-01T19:54:42.492 INFO:teuthology.orchestra.run.smithi101.stdout: }, 2023-08-01T19:54:42.492 INFO:teuthology.orchestra.run.smithi101.stdout: { 2023-08-01T19:54:42.493 INFO:teuthology.orchestra.run.smithi101.stdout: "event": "reached_pg", 2023-08-01T19:54:42.493 INFO:teuthology.orchestra.run.smithi101.stdout: "time": "2023-08-01T19:54:04.459340+0000", 2023-08-01T19:54:42.493 INFO:teuthology.orchestra.run.smithi101.stdout: "duration": 2.2476e-05 2023-08-01T19:54:42.493 INFO:teuthology.orchestra.run.smithi101.stdout: }, 2023-08-01T19:54:42.493 INFO:teuthology.orchestra.run.smithi101.stdout: { 2023-08-01T19:54:42.493 INFO:teuthology.orchestra.run.smithi101.stdout: "event": "waiting_for_map not empty", 2023-08-01T19:54:42.493 INFO:teuthology.orchestra.run.smithi101.stdout: "time": "2023-08-01T19:54:04.459342+0000", 2023-08-01T19:54:42.493 INFO:teuthology.orchestra.run.smithi101.stdout: "duration": 2.272e-06 2023-08-01T19:54:42.494 INFO:teuthology.orchestra.run.smithi101.stdout: }, 2023-08-01T19:54:42.494 INFO:teuthology.orchestra.run.smithi101.stdout: { 2023-08-01T19:54:42.494 INFO:teuthology.orchestra.run.smithi101.stdout: "event": "reached_pg", 2023-08-01T19:54:42.494 INFO:teuthology.orchestra.run.smithi101.stdout: "time": "2023-08-01T19:54:04.475922+0000", 2023-08-01T19:54:42.494 INFO:teuthology.orchestra.run.smithi101.stdout: "duration": 0.016579388 2023-08-01T19:54:42.494 INFO:teuthology.orchestra.run.smithi101.stdout: }, 2023-08-01T19:54:42.494 INFO:teuthology.orchestra.run.smithi101.stdout: { 2023-08-01T19:54:42.494 INFO:teuthology.orchestra.run.smithi101.stdout: "event": "started", 2023-08-01T19:54:42.495 INFO:teuthology.orchestra.run.smithi101.stdout: "time": "2023-08-01T19:54:04.476107+0000", 2023-08-01T19:54:42.495 INFO:teuthology.orchestra.run.smithi101.stdout: "duration": 0.00018486300000000001 2023-08-01T19:54:42.495 INFO:teuthology.orchestra.run.smithi101.stdout: }, 2023-08-01T19:54:42.495 INFO:teuthology.orchestra.run.smithi101.stdout: { 2023-08-01T19:54:42.495 INFO:teuthology.orchestra.run.smithi101.stdout: "event": "done", 2023-08-01T19:54:42.495 INFO:teuthology.orchestra.run.smithi101.stdout: "time": "2023-08-01T19:54:04.480415+0000", 2023-08-01T19:54:42.495 INFO:teuthology.orchestra.run.smithi101.stdout: "duration": 0.0043084589999999997 2023-08-01T19:54:42.496 INFO:teuthology.orchestra.run.smithi101.stdout: } 2023-08-01T19:54:42.496 INFO:teuthology.orchestra.run.smithi101.stdout: ] 2023-08-01T19:54:42.496 INFO:teuthology.orchestra.run.smithi101.stdout: } 2023-08-01T19:54:42.496 INFO:teuthology.orchestra.run.smithi101.stdout: }, 2023-08-01T19:54:42.496 INFO:teuthology.orchestra.run.smithi101.stdout: { 2023-08-01T19:54:42.496 INFO:teuthology.orchestra.run.smithi101.stdout: "description": "osd_op(client.4668.0:33938 5.f 5:f86a7015:::benchmark_data_smithi006_114134_object33937:head [set-alloc-hint object_size 65536 write_size 65536,write 0~65536] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e24)", 2023-08-01T19:54:42.496 INFO:teuthology.orchestra.run.smithi101.stdout: "initiated_at": "2023-08-01T19:54:34.001821+0000", 2023-08-01T19:54:42.496 INFO:teuthology.orchestra.run.smithi101.stdout: "age": 8.2857501950000003, 2023-08-01T19:54:42.497 INFO:teuthology.orchestra.run.smithi101.stdout: "duration": 0.015845003, 2023-08-01T19:54:42.497 INFO:teuthology.orchestra.run.smithi101.stdout: "type_data": { 2023-08-01T19:54:42.497 INFO:teuthology.orchestra.run.smithi101.stdout: "flag_point": "commit sent; apply or cleanup", 2023-08-01T19:54:42.497 INFO:teuthology.orchestra.run.smithi101.stdout: "client_info": { 2023-08-01T19:54:42.497 INFO:teuthology.orchestra.run.smithi101.stdout: "client": "client.4668", 2023-08-01T19:54:42.497 INFO:teuthology.orchestra.run.smithi101.stdout: "client_addr": "172.21.15.6:0/1709472247", 2023-08-01T19:54:42.497 INFO:teuthology.orchestra.run.smithi101.stdout: "tid": 33938 2023-08-01T19:54:42.497 INFO:teuthology.orchestra.run.smithi101.stdout: }, 2023-08-01T19:54:42.498 INFO:teuthology.orchestra.run.smithi101.stdout: "events": [ 2023-08-01T19:54:42.498 INFO:teuthology.orchestra.run.smithi101.stdout: { 2023-08-01T19:54:42.498 INFO:teuthology.orchestra.run.smithi101.stdout: "event": "initiated", 2023-08-01T19:54:42.498 INFO:teuthology.orchestra.run.smithi101.stdout: "time": "2023-08-01T19:54:34.001821+0000", 2023-08-01T19:54:42.498 INFO:teuthology.orchestra.run.smithi101.stdout: "duration": 0 2023-08-01T19:54:42.498 INFO:teuthology.orchestra.run.smithi101.stdout: }, 2023-08-01T19:54:42.498 INFO:teuthology.orchestra.run.smithi101.stdout: { 2023-08-01T19:54:42.498 INFO:teuthology.orchestra.run.smithi101.stdout: "event": "throttled", 2023-08-01T19:54:42.499 INFO:teuthology.orchestra.run.smithi101.stdout: "time": "2023-08-01T19:54:34.001821+0000", 2023-08-01T19:54:42.499 INFO:teuthology.orchestra.run.smithi101.stdout: "duration": 0 2023-08-01T19:54:42.499 INFO:teuthology.orchestra.run.smithi101.stdout: }, 2023-08-01T19:54:42.499 INFO:teuthology.orchestra.run.smithi101.stdout: { 2023-08-01T19:54:42.499 INFO:teuthology.orchestra.run.smithi101.stdout: "event": "header_read", 2023-08-01T19:54:42.499 INFO:teuthology.orchestra.run.smithi101.stdout: "time": "2023-08-01T19:54:34.001820+0000", 2023-08-01T19:54:42.499 INFO:teuthology.orchestra.run.smithi101.stdout: "duration": 4294967295.9999995 2023-08-01T19:54:42.499 INFO:teuthology.orchestra.run.smithi101.stdout: }, 2023-08-01T19:54:42.500 INFO:teuthology.orchestra.run.smithi101.stdout: { 2023-08-01T19:54:42.500 INFO:teuthology.orchestra.run.smithi101.stdout: "event": "all_read", 2023-08-01T19:54:42.500 INFO:teuthology.orchestra.run.smithi101.stdout: "time": "2023-08-01T19:54:34.001901+0000", 2023-08-01T19:54:42.500 INFO:teuthology.orchestra.run.smithi101.stdout: "duration": 8.0606999999999996e-05 2023-08-01T19:54:42.500 INFO:teuthology.orchestra.run.smithi101.stdout: }, 2023-08-01T19:54:42.500 INFO:teuthology.orchestra.run.smithi101.stdout: { 2023-08-01T19:54:42.500 INFO:teuthology.orchestra.run.smithi101.stdout: "event": "dispatched", 2023-08-01T19:54:42.500 INFO:teuthology.orchestra.run.smithi101.stdout: "time": "2023-08-01T19:54:34.001913+0000", 2023-08-01T19:54:42.501 INFO:teuthology.orchestra.run.smithi101.stdout: "duration": 1.2627e-05 2023-08-01T19:54:42.501 INFO:teuthology.orchestra.run.smithi101.stdout: }, 2023-08-01T19:54:42.501 INFO:teuthology.orchestra.run.smithi101.stdout: { 2023-08-01T19:54:42.501 INFO:teuthology.orchestra.run.smithi101.stdout: "event": "queued_for_pg", 2023-08-01T19:54:42.501 INFO:teuthology.orchestra.run.smithi101.stdout: "time": "2023-08-01T19:54:34.001917+0000", 2023-08-01T19:54:42.501 INFO:teuthology.orchestra.run.smithi101.stdout: "duration": 3.6940000000000001e-06 2023-08-01T19:54:42.501 INFO:teuthology.orchestra.run.smithi101.stdout: }, 2023-08-01T19:54:42.501 INFO:teuthology.orchestra.run.smithi101.stdout: { 2023-08-01T19:54:42.502 INFO:teuthology.orchestra.run.smithi101.stdout: "event": "reached_pg", 2023-08-01T19:54:42.502 INFO:teuthology.orchestra.run.smithi101.stdout: "time": "2023-08-01T19:54:34.001939+0000", 2023-08-01T19:54:42.502 INFO:teuthology.orchestra.run.smithi101.stdout: "duration": 2.243e-05 2023-08-01T19:54:42.502 INFO:teuthology.orchestra.run.smithi101.stdout: }, 2023-08-01T19:54:42.502 INFO:teuthology.orchestra.run.smithi101.stdout: { 2023-08-01T19:54:42.502 INFO:teuthology.orchestra.run.smithi101.stdout: "event": "started", 2023-08-01T19:54:42.502 INFO:teuthology.orchestra.run.smithi101.stdout: "time": "2023-08-01T19:54:34.002032+0000", 2023-08-01T19:54:42.502 INFO:teuthology.orchestra.run.smithi101.stdout: "duration": 9.2053999999999997e-05 2023-08-01T19:54:42.503 INFO:teuthology.orchestra.run.smithi101.stdout: }, 2023-08-01T19:54:42.503 INFO:teuthology.orchestra.run.smithi101.stdout: { 2023-08-01T19:54:42.503 INFO:teuthology.orchestra.run.smithi101.stdout: "event": "waiting for subops from 2", 2023-08-01T19:54:42.503 INFO:teuthology.orchestra.run.smithi101.stdout: "time": "2023-08-01T19:54:34.002107+0000", 2023-08-01T19:54:42.503 INFO:teuthology.orchestra.run.smithi101.stdout: "duration": 7.5160999999999994e-05 2023-08-01T19:54:42.503 INFO:teuthology.orchestra.run.smithi101.stdout: }, 2023-08-01T19:54:42.503 INFO:teuthology.orchestra.run.smithi101.stdout: { 2023-08-01T19:54:42.503 INFO:teuthology.orchestra.run.smithi101.stdout: "event": "op_commit", 2023-08-01T19:54:42.504 INFO:teuthology.orchestra.run.smithi101.stdout: "time": "2023-08-01T19:54:34.008660+0000", 2023-08-01T19:54:42.504 INFO:teuthology.orchestra.run.smithi101.stdout: "duration": 0.0065528950000000004 2023-08-01T19:54:42.504 INFO:teuthology.orchestra.run.smithi101.stdout: }, 2023-08-01T19:54:42.504 INFO:teuthology.orchestra.run.smithi101.stdout: { 2023-08-01T19:54:42.504 INFO:teuthology.orchestra.run.smithi101.stdout: "event": "sub_op_commit_rec", 2023-08-01T19:54:42.504 INFO:teuthology.orchestra.run.smithi101.stdout: "time": "2023-08-01T19:54:34.017612+0000", 2023-08-01T19:54:42.504 INFO:teuthology.orchestra.run.smithi101.stdout: "duration": 0.0089521489999999995 2023-08-01T19:54:42.504 INFO:teuthology.orchestra.run.smithi101.stdout: }, 2023-08-01T19:54:42.505 INFO:teuthology.orchestra.run.smithi101.stdout: { 2023-08-01T19:54:42.505 INFO:teuthology.orchestra.run.smithi101.stdout: "event": "commit_sent", 2023-08-01T19:54:42.505 INFO:teuthology.orchestra.run.smithi101.stdout: "time": "2023-08-01T19:54:34.017643+0000", 2023-08-01T19:54:42.505 INFO:teuthology.orchestra.run.smithi101.stdout: "duration": 3.0988000000000002e-05 2023-08-01T19:54:42.505 INFO:teuthology.orchestra.run.smithi101.stdout: }, 2023-08-01T19:54:42.505 INFO:teuthology.orchestra.run.smithi101.stdout: { 2023-08-01T19:54:42.505 INFO:teuthology.orchestra.run.smithi101.stdout: "event": "done", 2023-08-01T19:54:42.505 INFO:teuthology.orchestra.run.smithi101.stdout: "time": "2023-08-01T19:54:34.017666+0000", 2023-08-01T19:54:42.506 INFO:teuthology.orchestra.run.smithi101.stdout: "duration": 2.2898999999999999e-05 2023-08-01T19:54:42.506 INFO:teuthology.orchestra.run.smithi101.stdout: } 2023-08-01T19:54:42.506 INFO:teuthology.orchestra.run.smithi101.stdout: ] 2023-08-01T19:54:42.506 INFO:teuthology.orchestra.run.smithi101.stdout: } 2023-08-01T19:54:42.506 INFO:teuthology.orchestra.run.smithi101.stdout: } 2023-08-01T19:54:42.506 INFO:teuthology.orchestra.run.smithi101.stdout: ] 2023-08-01T19:54:42.506 INFO:teuthology.orchestra.run.smithi101.stdout:} 2023-08-01T19:54:42.507 INFO:tasks.radosbench.radosbench.0.smithi006.stdout: 18 16 54542 54526 189.312 139.938 0.00790045 0.00527876 2023-08-01T19:54:42.508 DEBUG:teuthology.orchestra.run.smithi155:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 30 ceph --cluster ceph --admin-daemon /var/run/ceph/ceph-osd.2.asok dump_ops_in_flight 2023-08-01T19:54:42.509 INFO:tasks.ceph.osd.2.smithi155.stderr:2023-08-01T19:54:42.506+0000 7faa5c6ac700 -1 received signal: Hangup from /usr/bin/python3 /bin/daemon-helper kill ceph-osd -f --cluster ceph -i 2 (PID: 111337) UID: 0 2023-08-01T19:54:42.608 INFO:tasks.ceph.osd.0.smithi008.stderr:2023-08-01T19:54:42.607+0000 7f16a58f4700 -1 received signal: Hangup from /usr/bin/python3 /bin/daemon-helper kill ceph-osd -f --cluster ceph -i 0 (PID: 111179) UID: 0 2023-08-01T19:54:42.675 INFO:teuthology.orchestra.run.smithi155.stdout:{ 2023-08-01T19:54:42.676 INFO:teuthology.orchestra.run.smithi155.stdout: "ops": [ 2023-08-01T19:54:42.676 INFO:teuthology.orchestra.run.smithi155.stdout: { 2023-08-01T19:54:42.676 INFO:teuthology.orchestra.run.smithi155.stdout: "description": "osd_op(client.4668.0:55374 5.8 5:189fb760:::benchmark_data_smithi006_114134_object55373:head [set-alloc-hint object_size 65536 write_size 65536,write 0~65536 in=65536b] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e27)", 2023-08-01T19:54:42.676 INFO:teuthology.orchestra.run.smithi155.stdout: "initiated_at": "2023-08-01T19:54:42.672825+0000", 2023-08-01T19:54:42.676 INFO:teuthology.orchestra.run.smithi155.stdout: "age": 0.0010538699999999999, 2023-08-01T19:54:42.676 INFO:teuthology.orchestra.run.smithi155.stdout: "duration": 0.0010820669999999999, 2023-08-01T19:54:42.677 INFO:teuthology.orchestra.run.smithi155.stdout: "type_data": { 2023-08-01T19:54:42.677 INFO:teuthology.orchestra.run.smithi155.stdout: "flag_point": "waiting for sub ops", 2023-08-01T19:54:42.677 INFO:teuthology.orchestra.run.smithi155.stdout: "client_info": { 2023-08-01T19:54:42.677 INFO:teuthology.orchestra.run.smithi155.stdout: "client": "client.4668", 2023-08-01T19:54:42.677 INFO:teuthology.orchestra.run.smithi155.stdout: "client_addr": "172.21.15.6:0/1709472247", 2023-08-01T19:54:42.677 INFO:teuthology.orchestra.run.smithi155.stdout: "tid": 55374 2023-08-01T19:54:42.677 INFO:teuthology.orchestra.run.smithi155.stdout: }, 2023-08-01T19:54:42.678 INFO:teuthology.orchestra.run.smithi155.stdout: "events": [ 2023-08-01T19:54:42.678 INFO:teuthology.orchestra.run.smithi155.stdout: { 2023-08-01T19:54:42.678 INFO:teuthology.orchestra.run.smithi155.stdout: "event": "initiated", 2023-08-01T19:54:42.678 INFO:teuthology.orchestra.run.smithi155.stdout: "time": "2023-08-01T19:54:42.672825+0000", 2023-08-01T19:54:42.678 INFO:teuthology.orchestra.run.smithi155.stdout: "duration": 0 2023-08-01T19:54:42.678 INFO:teuthology.orchestra.run.smithi155.stdout: }, 2023-08-01T19:54:42.678 INFO:teuthology.orchestra.run.smithi155.stdout: { 2023-08-01T19:54:42.678 INFO:teuthology.orchestra.run.smithi155.stdout: "event": "throttled", 2023-08-01T19:54:42.679 INFO:teuthology.orchestra.run.smithi155.stdout: "time": "2023-08-01T19:54:42.672825+0000", 2023-08-01T19:54:42.679 INFO:teuthology.orchestra.run.smithi155.stdout: "duration": 0 2023-08-01T19:54:42.679 INFO:teuthology.orchestra.run.smithi155.stdout: }, 2023-08-01T19:54:42.679 INFO:teuthology.orchestra.run.smithi155.stdout: { 2023-08-01T19:54:42.679 INFO:teuthology.orchestra.run.smithi155.stdout: "event": "header_read", 2023-08-01T19:54:42.679 INFO:teuthology.orchestra.run.smithi155.stdout: "time": "2023-08-01T19:54:42.672825+0000", 2023-08-01T19:54:42.679 INFO:teuthology.orchestra.run.smithi155.stdout: "duration": 4294967295.999999 2023-08-01T19:54:42.679 INFO:teuthology.orchestra.run.smithi155.stdout: }, 2023-08-01T19:54:42.680 INFO:teuthology.orchestra.run.smithi155.stdout: { 2023-08-01T19:54:42.680 INFO:teuthology.orchestra.run.smithi155.stdout: "event": "all_read", 2023-08-01T19:54:42.680 INFO:teuthology.orchestra.run.smithi155.stdout: "time": "2023-08-01T19:54:42.672947+0000", 2023-08-01T19:54:42.680 INFO:teuthology.orchestra.run.smithi155.stdout: "duration": 0.000122223 2023-08-01T19:54:42.680 INFO:teuthology.orchestra.run.smithi155.stdout: }, 2023-08-01T19:54:42.680 INFO:teuthology.orchestra.run.smithi155.stdout: { 2023-08-01T19:54:42.680 INFO:teuthology.orchestra.run.smithi155.stdout: "event": "dispatched", 2023-08-01T19:54:42.681 INFO:teuthology.orchestra.run.smithi155.stdout: "time": "2023-08-01T19:54:42.672959+0000", 2023-08-01T19:54:42.681 INFO:teuthology.orchestra.run.smithi155.stdout: "duration": 1.2595000000000001e-05 2023-08-01T19:54:42.681 INFO:teuthology.orchestra.run.smithi155.stdout: }, 2023-08-01T19:54:42.681 INFO:teuthology.orchestra.run.smithi155.stdout: { 2023-08-01T19:54:42.681 INFO:teuthology.orchestra.run.smithi155.stdout: "event": "queued_for_pg", 2023-08-01T19:54:42.681 INFO:teuthology.orchestra.run.smithi155.stdout: "time": "2023-08-01T19:54:42.672965+0000", 2023-08-01T19:54:42.681 INFO:teuthology.orchestra.run.smithi155.stdout: "duration": 5.8769999999999998e-06 2023-08-01T19:54:42.681 INFO:teuthology.orchestra.run.smithi155.stdout: }, 2023-08-01T19:54:42.682 INFO:teuthology.orchestra.run.smithi155.stdout: { 2023-08-01T19:54:42.682 INFO:teuthology.orchestra.run.smithi155.stdout: "event": "reached_pg", 2023-08-01T19:54:42.682 INFO:teuthology.orchestra.run.smithi155.stdout: "time": "2023-08-01T19:54:42.673667+0000", 2023-08-01T19:54:42.682 INFO:teuthology.orchestra.run.smithi155.stdout: "duration": 0.000701412 2023-08-01T19:54:42.682 INFO:teuthology.orchestra.run.smithi155.stdout: }, 2023-08-01T19:54:42.682 INFO:teuthology.orchestra.run.smithi155.stdout: { 2023-08-01T19:54:42.682 INFO:teuthology.orchestra.run.smithi155.stdout: "event": "started", 2023-08-01T19:54:42.682 INFO:teuthology.orchestra.run.smithi155.stdout: "time": "2023-08-01T19:54:42.673807+0000", 2023-08-01T19:54:42.683 INFO:teuthology.orchestra.run.smithi155.stdout: "duration": 0.00014062499999999999 2023-08-01T19:54:42.683 INFO:teuthology.orchestra.run.smithi155.stdout: }, 2023-08-01T19:54:42.683 INFO:teuthology.orchestra.run.smithi155.stdout: { 2023-08-01T19:54:42.683 INFO:teuthology.orchestra.run.smithi155.stdout: "event": "waiting for subops from 0", 2023-08-01T19:54:42.683 INFO:teuthology.orchestra.run.smithi155.stdout: "time": "2023-08-01T19:54:42.673892+0000", 2023-08-01T19:54:42.683 INFO:teuthology.orchestra.run.smithi155.stdout: "duration": 8.4878999999999998e-05 2023-08-01T19:54:42.683 INFO:teuthology.orchestra.run.smithi155.stdout: } 2023-08-01T19:54:42.683 INFO:teuthology.orchestra.run.smithi155.stdout: ] 2023-08-01T19:54:42.684 INFO:teuthology.orchestra.run.smithi155.stdout: } 2023-08-01T19:54:42.684 INFO:teuthology.orchestra.run.smithi155.stdout: }, 2023-08-01T19:54:42.684 INFO:teuthology.orchestra.run.smithi155.stdout: { 2023-08-01T19:54:42.684 INFO:teuthology.orchestra.run.smithi155.stdout: "description": "osd_repop(client.4668.0:55373 5.a e27/19 5:55c525da:::benchmark_data_smithi006_114134_object55372:head v 27'3445, mlcod=27'3442)", 2023-08-01T19:54:42.684 INFO:teuthology.orchestra.run.smithi155.stdout: "initiated_at": "2023-08-01T19:54:42.673537+0000", 2023-08-01T19:54:42.684 INFO:teuthology.orchestra.run.smithi155.stdout: "age": 0.00034187399999999999, 2023-08-01T19:54:42.684 INFO:teuthology.orchestra.run.smithi155.stdout: "duration": 0.00046326700000000001, 2023-08-01T19:54:42.685 INFO:teuthology.orchestra.run.smithi155.stdout: "type_data": { 2023-08-01T19:54:42.685 INFO:teuthology.orchestra.run.smithi155.stdout: "flag_point": "started", 2023-08-01T19:54:42.685 INFO:teuthology.orchestra.run.smithi155.stdout: "events": [ 2023-08-01T19:54:42.685 INFO:teuthology.orchestra.run.smithi155.stdout: { 2023-08-01T19:54:42.685 INFO:teuthology.orchestra.run.smithi155.stdout: "event": "initiated", 2023-08-01T19:54:42.685 INFO:teuthology.orchestra.run.smithi155.stdout: "time": "2023-08-01T19:54:42.673537+0000", 2023-08-01T19:54:42.685 INFO:teuthology.orchestra.run.smithi155.stdout: "duration": 0 2023-08-01T19:54:42.685 INFO:teuthology.orchestra.run.smithi155.stdout: }, 2023-08-01T19:54:42.686 INFO:teuthology.orchestra.run.smithi155.stdout: { 2023-08-01T19:54:42.686 INFO:teuthology.orchestra.run.smithi155.stdout: "event": "throttled", 2023-08-01T19:54:42.686 INFO:teuthology.orchestra.run.smithi155.stdout: "time": "2023-08-01T19:54:42.673537+0000", 2023-08-01T19:54:42.686 INFO:teuthology.orchestra.run.smithi155.stdout: "duration": 0 2023-08-01T19:54:42.686 INFO:teuthology.orchestra.run.smithi155.stdout: }, 2023-08-01T19:54:42.686 INFO:teuthology.orchestra.run.smithi155.stdout: { 2023-08-01T19:54:42.686 INFO:teuthology.orchestra.run.smithi155.stdout: "event": "header_read", 2023-08-01T19:54:42.686 INFO:teuthology.orchestra.run.smithi155.stdout: "time": "2023-08-01T19:54:42.673537+0000", 2023-08-01T19:54:42.687 INFO:teuthology.orchestra.run.smithi155.stdout: "duration": 4294967295.9999995 2023-08-01T19:54:42.687 INFO:teuthology.orchestra.run.smithi155.stdout: }, 2023-08-01T19:54:42.687 INFO:teuthology.orchestra.run.smithi155.stdout: { 2023-08-01T19:54:42.687 INFO:teuthology.orchestra.run.smithi155.stdout: "event": "all_read", 2023-08-01T19:54:42.687 INFO:teuthology.orchestra.run.smithi155.stdout: "time": "2023-08-01T19:54:42.673574+0000", 2023-08-01T19:54:42.687 INFO:teuthology.orchestra.run.smithi155.stdout: "duration": 3.6582999999999999e-05 2023-08-01T19:54:42.687 INFO:teuthology.orchestra.run.smithi155.stdout: }, 2023-08-01T19:54:42.687 INFO:teuthology.orchestra.run.smithi155.stdout: { 2023-08-01T19:54:42.688 INFO:teuthology.orchestra.run.smithi155.stdout: "event": "dispatched", 2023-08-01T19:54:42.688 INFO:teuthology.orchestra.run.smithi155.stdout: "time": "2023-08-01T19:54:42.673581+0000", 2023-08-01T19:54:42.688 INFO:teuthology.orchestra.run.smithi155.stdout: "duration": 7.5399999999999998e-06 2023-08-01T19:54:42.688 INFO:teuthology.orchestra.run.smithi155.stdout: }, 2023-08-01T19:54:42.688 INFO:teuthology.orchestra.run.smithi155.stdout: { 2023-08-01T19:54:42.688 INFO:teuthology.orchestra.run.smithi155.stdout: "event": "queued_for_pg", 2023-08-01T19:54:42.688 INFO:teuthology.orchestra.run.smithi155.stdout: "time": "2023-08-01T19:54:42.673586+0000", 2023-08-01T19:54:42.688 INFO:teuthology.orchestra.run.smithi155.stdout: "duration": 4.5279999999999997e-06 2023-08-01T19:54:42.689 INFO:teuthology.orchestra.run.smithi155.stdout: }, 2023-08-01T19:54:42.689 INFO:teuthology.orchestra.run.smithi155.stdout: { 2023-08-01T19:54:42.689 INFO:teuthology.orchestra.run.smithi155.stdout: "event": "reached_pg", 2023-08-01T19:54:42.689 INFO:teuthology.orchestra.run.smithi155.stdout: "time": "2023-08-01T19:54:42.673630+0000", 2023-08-01T19:54:42.689 INFO:teuthology.orchestra.run.smithi155.stdout: "duration": 4.3996999999999999e-05 2023-08-01T19:54:42.689 INFO:teuthology.orchestra.run.smithi155.stdout: }, 2023-08-01T19:54:42.689 INFO:teuthology.orchestra.run.smithi155.stdout: { 2023-08-01T19:54:42.689 INFO:teuthology.orchestra.run.smithi155.stdout: "event": "started", 2023-08-01T19:54:42.690 INFO:teuthology.orchestra.run.smithi155.stdout: "time": "2023-08-01T19:54:42.673653+0000", 2023-08-01T19:54:42.690 INFO:teuthology.orchestra.run.smithi155.stdout: "duration": 2.2821000000000001e-05 2023-08-01T19:54:42.690 INFO:teuthology.orchestra.run.smithi155.stdout: } 2023-08-01T19:54:42.690 INFO:teuthology.orchestra.run.smithi155.stdout: ] 2023-08-01T19:54:42.690 INFO:teuthology.orchestra.run.smithi155.stdout: } 2023-08-01T19:54:42.690 INFO:teuthology.orchestra.run.smithi155.stdout: }, 2023-08-01T19:54:42.690 INFO:teuthology.orchestra.run.smithi155.stdout: { 2023-08-01T19:54:42.691 INFO:teuthology.orchestra.run.smithi155.stdout: "description": "osd_op(client.4668.0:55361 5.d 5:b37715de:::benchmark_data_smithi006_114134_object55360:head [set-alloc-hint object_size 65536 write_size 65536,write 0~65536 in=65536b] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e27)", 2023-08-01T19:54:42.691 INFO:teuthology.orchestra.run.smithi155.stdout: "initiated_at": "2023-08-01T19:54:42.667912+0000", 2023-08-01T19:54:42.691 INFO:teuthology.orchestra.run.smithi155.stdout: "age": 0.0059674009999999998, 2023-08-01T19:54:42.691 INFO:teuthology.orchestra.run.smithi155.stdout: "duration": 0.0061519820000000003, 2023-08-01T19:54:42.691 INFO:teuthology.orchestra.run.smithi155.stdout: "type_data": { 2023-08-01T19:54:42.691 INFO:teuthology.orchestra.run.smithi155.stdout: "flag_point": "waiting for sub ops", 2023-08-01T19:54:42.691 INFO:teuthology.orchestra.run.smithi155.stdout: "client_info": { 2023-08-01T19:54:42.691 INFO:teuthology.orchestra.run.smithi155.stdout: "client": "client.4668", 2023-08-01T19:54:42.692 INFO:teuthology.orchestra.run.smithi155.stdout: "client_addr": "172.21.15.6:0/1709472247", 2023-08-01T19:54:42.692 INFO:teuthology.orchestra.run.smithi155.stdout: "tid": 55361 2023-08-01T19:54:42.692 INFO:teuthology.orchestra.run.smithi155.stdout: }, 2023-08-01T19:54:42.692 INFO:teuthology.orchestra.run.smithi155.stdout: "events": [ 2023-08-01T19:54:42.692 INFO:teuthology.orchestra.run.smithi155.stdout: { 2023-08-01T19:54:42.692 INFO:teuthology.orchestra.run.smithi155.stdout: "event": "initiated", 2023-08-01T19:54:42.692 INFO:teuthology.orchestra.run.smithi155.stdout: "time": "2023-08-01T19:54:42.667912+0000", 2023-08-01T19:54:42.692 INFO:teuthology.orchestra.run.smithi155.stdout: "duration": 0 2023-08-01T19:54:42.693 INFO:teuthology.orchestra.run.smithi155.stdout: }, 2023-08-01T19:54:42.693 INFO:teuthology.orchestra.run.smithi155.stdout: { 2023-08-01T19:54:42.693 INFO:teuthology.orchestra.run.smithi155.stdout: "event": "throttled", 2023-08-01T19:54:42.693 INFO:teuthology.orchestra.run.smithi155.stdout: "time": "2023-08-01T19:54:42.667912+0000", 2023-08-01T19:54:42.693 INFO:teuthology.orchestra.run.smithi155.stdout: "duration": 0 2023-08-01T19:54:42.693 INFO:teuthology.orchestra.run.smithi155.stdout: }, 2023-08-01T19:54:42.693 INFO:teuthology.orchestra.run.smithi155.stdout: { 2023-08-01T19:54:42.693 INFO:teuthology.orchestra.run.smithi155.stdout: "event": "header_read", 2023-08-01T19:54:42.694 INFO:teuthology.orchestra.run.smithi155.stdout: "time": "2023-08-01T19:54:42.667911+0000", 2023-08-01T19:54:42.694 INFO:teuthology.orchestra.run.smithi155.stdout: "duration": 4294967295.9999995 2023-08-01T19:54:42.694 INFO:teuthology.orchestra.run.smithi155.stdout: }, 2023-08-01T19:54:42.694 INFO:teuthology.orchestra.run.smithi155.stdout: { 2023-08-01T19:54:42.694 INFO:teuthology.orchestra.run.smithi155.stdout: "event": "all_read", 2023-08-01T19:54:42.694 INFO:teuthology.orchestra.run.smithi155.stdout: "time": "2023-08-01T19:54:42.668030+0000", 2023-08-01T19:54:42.694 INFO:teuthology.orchestra.run.smithi155.stdout: "duration": 0.00011908699999999999 2023-08-01T19:54:42.694 INFO:teuthology.orchestra.run.smithi155.stdout: }, 2023-08-01T19:54:42.695 INFO:teuthology.orchestra.run.smithi155.stdout: { 2023-08-01T19:54:42.695 INFO:teuthology.orchestra.run.smithi155.stdout: "event": "dispatched", 2023-08-01T19:54:42.695 INFO:teuthology.orchestra.run.smithi155.stdout: "time": "2023-08-01T19:54:42.668039+0000", 2023-08-01T19:54:42.695 INFO:teuthology.orchestra.run.smithi155.stdout: "duration": 9.0329999999999997e-06 2023-08-01T19:54:42.695 INFO:teuthology.orchestra.run.smithi155.stdout: }, 2023-08-01T19:54:42.695 INFO:teuthology.orchestra.run.smithi155.stdout: { 2023-08-01T19:54:42.695 INFO:teuthology.orchestra.run.smithi155.stdout: "event": "queued_for_pg", 2023-08-01T19:54:42.695 INFO:teuthology.orchestra.run.smithi155.stdout: "time": "2023-08-01T19:54:42.668043+0000", 2023-08-01T19:54:42.696 INFO:teuthology.orchestra.run.smithi155.stdout: "duration": 4.0690000000000003e-06 2023-08-01T19:54:42.696 INFO:teuthology.orchestra.run.smithi155.stdout: }, 2023-08-01T19:54:42.696 INFO:teuthology.orchestra.run.smithi155.stdout: { 2023-08-01T19:54:42.696 INFO:teuthology.orchestra.run.smithi155.stdout: "event": "reached_pg", 2023-08-01T19:54:42.696 INFO:teuthology.orchestra.run.smithi155.stdout: "time": "2023-08-01T19:54:42.668098+0000", 2023-08-01T19:54:42.696 INFO:teuthology.orchestra.run.smithi155.stdout: "duration": 5.4719999999999998e-05 2023-08-01T19:54:42.696 INFO:teuthology.orchestra.run.smithi155.stdout: }, 2023-08-01T19:54:42.696 INFO:teuthology.orchestra.run.smithi155.stdout: { 2023-08-01T19:54:42.697 INFO:teuthology.orchestra.run.smithi155.stdout: "event": "started", 2023-08-01T19:54:42.697 INFO:teuthology.orchestra.run.smithi155.stdout: "time": "2023-08-01T19:54:42.668207+0000", 2023-08-01T19:54:42.697 INFO:teuthology.orchestra.run.smithi155.stdout: "duration": 0.00010864799999999999 2023-08-01T19:54:42.697 INFO:teuthology.orchestra.run.smithi155.stdout: }, 2023-08-01T19:54:42.697 INFO:teuthology.orchestra.run.smithi155.stdout: { 2023-08-01T19:54:42.697 INFO:teuthology.orchestra.run.smithi155.stdout: "event": "waiting for subops from 1", 2023-08-01T19:54:42.697 INFO:teuthology.orchestra.run.smithi155.stdout: "time": "2023-08-01T19:54:42.668289+0000", 2023-08-01T19:54:42.697 INFO:teuthology.orchestra.run.smithi155.stdout: "duration": 8.2317000000000005e-05 2023-08-01T19:54:42.698 INFO:teuthology.orchestra.run.smithi155.stdout: }, 2023-08-01T19:54:42.698 INFO:teuthology.orchestra.run.smithi155.stdout: { 2023-08-01T19:54:42.698 INFO:teuthology.orchestra.run.smithi155.stdout: "event": "op_commit", 2023-08-01T19:54:42.698 INFO:teuthology.orchestra.run.smithi155.stdout: "time": "2023-08-01T19:54:42.674026+0000", 2023-08-01T19:54:42.698 INFO:teuthology.orchestra.run.smithi155.stdout: "duration": 0.0057372129999999997 2023-08-01T19:54:42.698 INFO:teuthology.orchestra.run.smithi155.stdout: } 2023-08-01T19:54:42.698 INFO:teuthology.orchestra.run.smithi155.stdout: ] 2023-08-01T19:54:42.699 INFO:teuthology.orchestra.run.smithi155.stdout: } 2023-08-01T19:54:42.699 INFO:teuthology.orchestra.run.smithi155.stdout: }, 2023-08-01T19:54:42.699 INFO:teuthology.orchestra.run.smithi155.stdout: { 2023-08-01T19:54:42.699 INFO:teuthology.orchestra.run.smithi155.stdout: "description": "osd_repop(client.4668.0:55360 5.a e27/19 5:5a26f6d9:::benchmark_data_smithi006_114134_object55359:head v 27'3444, mlcod=27'3442)", 2023-08-01T19:54:42.699 INFO:teuthology.orchestra.run.smithi155.stdout: "initiated_at": "2023-08-01T19:54:42.668400+0000", 2023-08-01T19:54:42.699 INFO:teuthology.orchestra.run.smithi155.stdout: "age": 0.0054787109999999998, 2023-08-01T19:54:42.699 INFO:teuthology.orchestra.run.smithi155.stdout: "duration": 0.0057169070000000002, 2023-08-01T19:54:42.699 INFO:teuthology.orchestra.run.smithi155.stdout: "type_data": { 2023-08-01T19:54:42.700 INFO:teuthology.orchestra.run.smithi155.stdout: "flag_point": "started", 2023-08-01T19:54:42.700 INFO:teuthology.orchestra.run.smithi155.stdout: "events": [ 2023-08-01T19:54:42.700 INFO:teuthology.orchestra.run.smithi155.stdout: { 2023-08-01T19:54:42.700 INFO:teuthology.orchestra.run.smithi155.stdout: "event": "initiated", 2023-08-01T19:54:42.700 INFO:teuthology.orchestra.run.smithi155.stdout: "time": "2023-08-01T19:54:42.668400+0000", 2023-08-01T19:54:42.700 INFO:teuthology.orchestra.run.smithi155.stdout: "duration": 0 2023-08-01T19:54:42.700 INFO:teuthology.orchestra.run.smithi155.stdout: }, 2023-08-01T19:54:42.700 INFO:teuthology.orchestra.run.smithi155.stdout: { 2023-08-01T19:54:42.701 INFO:teuthology.orchestra.run.smithi155.stdout: "event": "throttled", 2023-08-01T19:54:42.701 INFO:teuthology.orchestra.run.smithi155.stdout: "time": "2023-08-01T19:54:42.668400+0000", 2023-08-01T19:54:42.701 INFO:teuthology.orchestra.run.smithi155.stdout: "duration": 0 2023-08-01T19:54:42.701 INFO:teuthology.orchestra.run.smithi155.stdout: }, 2023-08-01T19:54:42.701 INFO:teuthology.orchestra.run.smithi155.stdout: { 2023-08-01T19:54:42.701 INFO:teuthology.orchestra.run.smithi155.stdout: "event": "header_read", 2023-08-01T19:54:42.701 INFO:teuthology.orchestra.run.smithi155.stdout: "time": "2023-08-01T19:54:42.668400+0000", 2023-08-01T19:54:42.701 INFO:teuthology.orchestra.run.smithi155.stdout: "duration": 4294967295.9999995 2023-08-01T19:54:42.702 INFO:teuthology.orchestra.run.smithi155.stdout: }, 2023-08-01T19:54:42.702 INFO:teuthology.orchestra.run.smithi155.stdout: { 2023-08-01T19:54:42.702 INFO:teuthology.orchestra.run.smithi155.stdout: "event": "all_read", 2023-08-01T19:54:42.702 INFO:teuthology.orchestra.run.smithi155.stdout: "time": "2023-08-01T19:54:42.668471+0000", 2023-08-01T19:54:42.702 INFO:teuthology.orchestra.run.smithi155.stdout: "duration": 7.1668999999999994e-05 2023-08-01T19:54:42.702 INFO:teuthology.orchestra.run.smithi155.stdout: }, 2023-08-01T19:54:42.702 INFO:teuthology.orchestra.run.smithi155.stdout: { 2023-08-01T19:54:42.702 INFO:teuthology.orchestra.run.smithi155.stdout: "event": "dispatched", 2023-08-01T19:54:42.703 INFO:teuthology.orchestra.run.smithi155.stdout: "time": "2023-08-01T19:54:42.668483+0000", 2023-08-01T19:54:42.703 INFO:teuthology.orchestra.run.smithi155.stdout: "duration": 1.1787000000000001e-05 2023-08-01T19:54:42.703 INFO:teuthology.orchestra.run.smithi155.stdout: }, 2023-08-01T19:54:42.703 INFO:teuthology.orchestra.run.smithi155.stdout: { 2023-08-01T19:54:42.703 INFO:teuthology.orchestra.run.smithi155.stdout: "event": "queued_for_pg", 2023-08-01T19:54:42.703 INFO:teuthology.orchestra.run.smithi155.stdout: "time": "2023-08-01T19:54:42.668490+0000", 2023-08-01T19:54:42.703 INFO:teuthology.orchestra.run.smithi155.stdout: "duration": 6.9120000000000001e-06 2023-08-01T19:54:42.703 INFO:teuthology.orchestra.run.smithi155.stdout: }, 2023-08-01T19:54:42.704 INFO:teuthology.orchestra.run.smithi155.stdout: { 2023-08-01T19:54:42.704 INFO:teuthology.orchestra.run.smithi155.stdout: "event": "reached_pg", 2023-08-01T19:54:42.704 INFO:teuthology.orchestra.run.smithi155.stdout: "time": "2023-08-01T19:54:42.668526+0000", 2023-08-01T19:54:42.704 INFO:teuthology.orchestra.run.smithi155.stdout: "duration": 3.5917000000000002e-05 2023-08-01T19:54:42.704 INFO:teuthology.orchestra.run.smithi155.stdout: }, 2023-08-01T19:54:42.704 INFO:teuthology.orchestra.run.smithi155.stdout: { 2023-08-01T19:54:42.704 INFO:teuthology.orchestra.run.smithi155.stdout: "event": "started", 2023-08-01T19:54:42.705 INFO:teuthology.orchestra.run.smithi155.stdout: "time": "2023-08-01T19:54:42.668546+0000", 2023-08-01T19:54:42.705 INFO:teuthology.orchestra.run.smithi155.stdout: "duration": 1.9721999999999999e-05 2023-08-01T19:54:42.705 INFO:teuthology.orchestra.run.smithi155.stdout: } 2023-08-01T19:54:42.705 INFO:teuthology.orchestra.run.smithi155.stdout: ] 2023-08-01T19:54:42.705 INFO:teuthology.orchestra.run.smithi155.stdout: } 2023-08-01T19:54:42.705 INFO:teuthology.orchestra.run.smithi155.stdout: }, 2023-08-01T19:54:42.705 INFO:teuthology.orchestra.run.smithi155.stdout: { 2023-08-01T19:54:42.705 INFO:teuthology.orchestra.run.smithi155.stdout: "description": "osd_op(client.4668.0:55363 5.e 5:7610100e:::benchmark_data_smithi006_114134_object55362:head [set-alloc-hint object_size 65536 write_size 65536,write 0~65536 in=65536b] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e27)", 2023-08-01T19:54:42.706 INFO:teuthology.orchestra.run.smithi155.stdout: "initiated_at": "2023-08-01T19:54:42.668581+0000", 2023-08-01T19:54:42.706 INFO:teuthology.orchestra.run.smithi155.stdout: "age": 0.0052978330000000001, 2023-08-01T19:54:42.706 INFO:teuthology.orchestra.run.smithi155.stdout: "duration": 0.0056075780000000002, 2023-08-01T19:54:42.706 INFO:teuthology.orchestra.run.smithi155.stdout: "type_data": { 2023-08-01T19:54:42.706 INFO:teuthology.orchestra.run.smithi155.stdout: "flag_point": "waiting for sub ops", 2023-08-01T19:54:42.706 INFO:teuthology.orchestra.run.smithi155.stdout: "client_info": { 2023-08-01T19:54:42.706 INFO:teuthology.orchestra.run.smithi155.stdout: "client": "client.4668", 2023-08-01T19:54:42.706 INFO:teuthology.orchestra.run.smithi155.stdout: "client_addr": "172.21.15.6:0/1709472247", 2023-08-01T19:54:42.707 INFO:teuthology.orchestra.run.smithi155.stdout: "tid": 55363 2023-08-01T19:54:42.707 INFO:teuthology.orchestra.run.smithi155.stdout: }, 2023-08-01T19:54:42.707 INFO:teuthology.orchestra.run.smithi155.stdout: "events": [ 2023-08-01T19:54:42.707 INFO:teuthology.orchestra.run.smithi155.stdout: { 2023-08-01T19:54:42.707 INFO:teuthology.orchestra.run.smithi155.stdout: "event": "initiated", 2023-08-01T19:54:42.707 INFO:teuthology.orchestra.run.smithi155.stdout: "time": "2023-08-01T19:54:42.668581+0000", 2023-08-01T19:54:42.707 INFO:teuthology.orchestra.run.smithi155.stdout: "duration": 0 2023-08-01T19:54:42.707 INFO:teuthology.orchestra.run.smithi155.stdout: }, 2023-08-01T19:54:42.708 INFO:teuthology.orchestra.run.smithi155.stdout: { 2023-08-01T19:54:42.708 INFO:teuthology.orchestra.run.smithi155.stdout: "event": "throttled", 2023-08-01T19:54:42.708 INFO:teuthology.orchestra.run.smithi155.stdout: "time": "2023-08-01T19:54:42.668581+0000", 2023-08-01T19:54:42.708 INFO:teuthology.orchestra.run.smithi155.stdout: "duration": 0 2023-08-01T19:54:42.708 INFO:teuthology.orchestra.run.smithi155.stdout: }, 2023-08-01T19:54:42.708 INFO:teuthology.orchestra.run.smithi155.stdout: { 2023-08-01T19:54:42.708 INFO:teuthology.orchestra.run.smithi155.stdout: "event": "header_read", 2023-08-01T19:54:42.708 INFO:teuthology.orchestra.run.smithi155.stdout: "time": "2023-08-01T19:54:42.668581+0000", 2023-08-01T19:54:42.709 INFO:teuthology.orchestra.run.smithi155.stdout: "duration": 4294967295.999999 2023-08-01T19:54:42.709 INFO:teuthology.orchestra.run.smithi155.stdout: }, 2023-08-01T19:54:42.709 INFO:teuthology.orchestra.run.smithi155.stdout: { 2023-08-01T19:54:42.709 INFO:teuthology.orchestra.run.smithi155.stdout: "event": "all_read", 2023-08-01T19:54:42.709 INFO:teuthology.orchestra.run.smithi155.stdout: "time": "2023-08-01T19:54:42.668650+0000", 2023-08-01T19:54:42.709 INFO:teuthology.orchestra.run.smithi155.stdout: "duration": 6.9583000000000001e-05 2023-08-01T19:54:42.709 INFO:teuthology.orchestra.run.smithi155.stdout: }, 2023-08-01T19:54:42.709 INFO:teuthology.orchestra.run.smithi155.stdout: { 2023-08-01T19:54:42.710 INFO:teuthology.orchestra.run.smithi155.stdout: "event": "dispatched", 2023-08-01T19:54:42.710 INFO:teuthology.orchestra.run.smithi155.stdout: "time": "2023-08-01T19:54:42.668662+0000", 2023-08-01T19:54:42.710 INFO:teuthology.orchestra.run.smithi155.stdout: "duration": 1.1508999999999999e-05 2023-08-01T19:54:42.710 INFO:teuthology.orchestra.run.smithi155.stdout: }, 2023-08-01T19:54:42.710 INFO:teuthology.orchestra.run.smithi155.stdout: { 2023-08-01T19:54:42.710 INFO:teuthology.orchestra.run.smithi155.stdout: "event": "queued_for_pg", 2023-08-01T19:54:42.710 INFO:teuthology.orchestra.run.smithi155.stdout: "time": "2023-08-01T19:54:42.668667+0000", 2023-08-01T19:54:42.711 INFO:teuthology.orchestra.run.smithi155.stdout: "duration": 5.4709999999999998e-06 2023-08-01T19:54:42.711 INFO:teuthology.orchestra.run.smithi155.stdout: }, 2023-08-01T19:54:42.711 INFO:teuthology.orchestra.run.smithi155.stdout: { 2023-08-01T19:54:42.711 INFO:teuthology.orchestra.run.smithi155.stdout: "event": "reached_pg", 2023-08-01T19:54:42.711 INFO:teuthology.orchestra.run.smithi155.stdout: "time": "2023-08-01T19:54:42.668722+0000", 2023-08-01T19:54:42.711 INFO:teuthology.orchestra.run.smithi155.stdout: "duration": 5.4797999999999999e-05 2023-08-01T19:54:42.711 INFO:teuthology.orchestra.run.smithi155.stdout: }, 2023-08-01T19:54:42.711 INFO:teuthology.orchestra.run.smithi155.stdout: { 2023-08-01T19:54:42.712 INFO:teuthology.orchestra.run.smithi155.stdout: "event": "started", 2023-08-01T19:54:42.712 INFO:teuthology.orchestra.run.smithi155.stdout: "time": "2023-08-01T19:54:42.668841+0000", 2023-08-01T19:54:42.712 INFO:teuthology.orchestra.run.smithi155.stdout: "duration": 0.000119399 2023-08-01T19:54:42.712 INFO:teuthology.orchestra.run.smithi155.stdout: }, 2023-08-01T19:54:42.712 INFO:teuthology.orchestra.run.smithi155.stdout: { 2023-08-01T19:54:42.712 INFO:teuthology.orchestra.run.smithi155.stdout: "event": "waiting for subops from 0", 2023-08-01T19:54:42.712 INFO:teuthology.orchestra.run.smithi155.stdout: "time": "2023-08-01T19:54:42.668969+0000", 2023-08-01T19:54:42.712 INFO:teuthology.orchestra.run.smithi155.stdout: "duration": 0.00012791199999999999 2023-08-01T19:54:42.713 INFO:teuthology.orchestra.run.smithi155.stdout: }, 2023-08-01T19:54:42.713 INFO:teuthology.orchestra.run.smithi155.stdout: { 2023-08-01T19:54:42.713 INFO:teuthology.orchestra.run.smithi155.stdout: "event": "sub_op_commit_rec", 2023-08-01T19:54:42.713 INFO:teuthology.orchestra.run.smithi155.stdout: "time": "2023-08-01T19:54:42.673588+0000", 2023-08-01T19:54:42.713 INFO:teuthology.orchestra.run.smithi155.stdout: "duration": 0.0046189830000000001 2023-08-01T19:54:42.713 INFO:teuthology.orchestra.run.smithi155.stdout: } 2023-08-01T19:54:42.713 INFO:teuthology.orchestra.run.smithi155.stdout: ] 2023-08-01T19:54:42.713 INFO:teuthology.orchestra.run.smithi155.stdout: } 2023-08-01T19:54:42.714 INFO:teuthology.orchestra.run.smithi155.stdout: }, 2023-08-01T19:54:42.714 INFO:teuthology.orchestra.run.smithi155.stdout: { 2023-08-01T19:54:42.714 INFO:teuthology.orchestra.run.smithi155.stdout: "description": "osd_op(client.4668.0:55364 5.e 5:72ed77c3:::benchmark_data_smithi006_114134_object55363:head [set-alloc-hint object_size 65536 write_size 65536,write 0~65536 in=65536b] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e27)", 2023-08-01T19:54:42.714 INFO:teuthology.orchestra.run.smithi155.stdout: "initiated_at": "2023-08-01T19:54:42.668683+0000", 2023-08-01T19:54:42.714 INFO:teuthology.orchestra.run.smithi155.stdout: "age": 0.0051966440000000003, 2023-08-01T19:54:42.714 INFO:teuthology.orchestra.run.smithi155.stdout: "duration": 0.0056150089999999998, 2023-08-01T19:54:42.714 INFO:teuthology.orchestra.run.smithi155.stdout: "type_data": { 2023-08-01T19:54:42.714 INFO:teuthology.orchestra.run.smithi155.stdout: "flag_point": "waiting for sub ops", 2023-08-01T19:54:42.715 INFO:teuthology.orchestra.run.smithi155.stdout: "client_info": { 2023-08-01T19:54:42.715 INFO:teuthology.orchestra.run.smithi155.stdout: "client": "client.4668", 2023-08-01T19:54:42.715 INFO:teuthology.orchestra.run.smithi155.stdout: "client_addr": "172.21.15.6:0/1709472247", 2023-08-01T19:54:42.715 INFO:teuthology.orchestra.run.smithi155.stdout: "tid": 55364 2023-08-01T19:54:42.715 INFO:teuthology.orchestra.run.smithi155.stdout: }, 2023-08-01T19:54:42.715 INFO:teuthology.orchestra.run.smithi155.stdout: "events": [ 2023-08-01T19:54:42.715 INFO:teuthology.orchestra.run.smithi155.stdout: { 2023-08-01T19:54:42.715 INFO:teuthology.orchestra.run.smithi155.stdout: "event": "initiated", 2023-08-01T19:54:42.716 INFO:teuthology.orchestra.run.smithi155.stdout: "time": "2023-08-01T19:54:42.668683+0000", 2023-08-01T19:54:42.716 INFO:teuthology.orchestra.run.smithi155.stdout: "duration": 0 2023-08-01T19:54:42.716 INFO:teuthology.orchestra.run.smithi155.stdout: }, 2023-08-01T19:54:42.716 INFO:teuthology.orchestra.run.smithi155.stdout: { 2023-08-01T19:54:42.716 INFO:teuthology.orchestra.run.smithi155.stdout: "event": "throttled", 2023-08-01T19:54:42.716 INFO:teuthology.orchestra.run.smithi155.stdout: "time": "2023-08-01T19:54:42.668683+0000", 2023-08-01T19:54:42.716 INFO:teuthology.orchestra.run.smithi155.stdout: "duration": 0 2023-08-01T19:54:42.716 INFO:teuthology.orchestra.run.smithi155.stdout: }, 2023-08-01T19:54:42.717 INFO:teuthology.orchestra.run.smithi155.stdout: { 2023-08-01T19:54:42.717 INFO:teuthology.orchestra.run.smithi155.stdout: "event": "header_read", 2023-08-01T19:54:42.717 INFO:teuthology.orchestra.run.smithi155.stdout: "time": "2023-08-01T19:54:42.668682+0000", 2023-08-01T19:54:42.717 INFO:teuthology.orchestra.run.smithi155.stdout: "duration": 4294967295.9999995 2023-08-01T19:54:42.717 INFO:teuthology.orchestra.run.smithi155.stdout: }, 2023-08-01T19:54:42.717 INFO:teuthology.orchestra.run.smithi155.stdout: { 2023-08-01T19:54:42.717 INFO:teuthology.orchestra.run.smithi155.stdout: "event": "all_read", 2023-08-01T19:54:42.718 INFO:teuthology.orchestra.run.smithi155.stdout: "time": "2023-08-01T19:54:42.668767+0000", 2023-08-01T19:54:42.718 INFO:teuthology.orchestra.run.smithi155.stdout: "duration": 8.5438000000000004e-05 2023-08-01T19:54:42.718 INFO:teuthology.orchestra.run.smithi155.stdout: }, 2023-08-01T19:54:42.718 INFO:teuthology.orchestra.run.smithi155.stdout: { 2023-08-01T19:54:42.718 INFO:teuthology.orchestra.run.smithi155.stdout: "event": "dispatched", 2023-08-01T19:54:42.718 INFO:teuthology.orchestra.run.smithi155.stdout: "time": "2023-08-01T19:54:42.668783+0000", 2023-08-01T19:54:42.718 INFO:teuthology.orchestra.run.smithi155.stdout: "duration": 1.5224e-05 2023-08-01T19:54:42.718 INFO:teuthology.orchestra.run.smithi155.stdout: }, 2023-08-01T19:54:42.719 INFO:teuthology.orchestra.run.smithi155.stdout: { 2023-08-01T19:54:42.719 INFO:teuthology.orchestra.run.smithi155.stdout: "event": "queued_for_pg", 2023-08-01T19:54:42.719 INFO:teuthology.orchestra.run.smithi155.stdout: "time": "2023-08-01T19:54:42.668789+0000", 2023-08-01T19:54:42.719 INFO:teuthology.orchestra.run.smithi155.stdout: "duration": 5.9719999999999997e-06 2023-08-01T19:54:42.719 INFO:teuthology.orchestra.run.smithi155.stdout: }, 2023-08-01T19:54:42.719 INFO:teuthology.orchestra.run.smithi155.stdout: { 2023-08-01T19:54:42.719 INFO:teuthology.orchestra.run.smithi155.stdout: "event": "reached_pg", 2023-08-01T19:54:42.719 INFO:teuthology.orchestra.run.smithi155.stdout: "time": "2023-08-01T19:54:42.670573+0000", 2023-08-01T19:54:42.720 INFO:teuthology.orchestra.run.smithi155.stdout: "duration": 0.001784917 2023-08-01T19:54:42.720 INFO:teuthology.orchestra.run.smithi155.stdout: }, 2023-08-01T19:54:42.720 INFO:teuthology.orchestra.run.smithi155.stdout: { 2023-08-01T19:54:42.720 INFO:teuthology.orchestra.run.smithi155.stdout: "event": "started", 2023-08-01T19:54:42.720 INFO:teuthology.orchestra.run.smithi155.stdout: "time": "2023-08-01T19:54:42.670655+0000", 2023-08-01T19:54:42.720 INFO:teuthology.orchestra.run.smithi155.stdout: "duration": 8.1428999999999996e-05 2023-08-01T19:54:42.720 INFO:teuthology.orchestra.run.smithi155.stdout: }, 2023-08-01T19:54:42.720 INFO:teuthology.orchestra.run.smithi155.stdout: { 2023-08-01T19:54:42.721 INFO:teuthology.orchestra.run.smithi155.stdout: "event": "waiting for subops from 0", 2023-08-01T19:54:42.721 INFO:teuthology.orchestra.run.smithi155.stdout: "time": "2023-08-01T19:54:42.670775+0000", 2023-08-01T19:54:42.721 INFO:teuthology.orchestra.run.smithi155.stdout: "duration": 0.00011979100000000001 2023-08-01T19:54:42.721 INFO:teuthology.orchestra.run.smithi155.stdout: } 2023-08-01T19:54:42.721 INFO:teuthology.orchestra.run.smithi155.stdout: ] 2023-08-01T19:54:42.721 INFO:teuthology.orchestra.run.smithi155.stdout: } 2023-08-01T19:54:42.721 INFO:teuthology.orchestra.run.smithi155.stdout: }, 2023-08-01T19:54:42.721 INFO:teuthology.orchestra.run.smithi155.stdout: { 2023-08-01T19:54:42.722 INFO:teuthology.orchestra.run.smithi155.stdout: "description": "osd_op(client.4668.0:55367 5.8 5:1207186a:::benchmark_data_smithi006_114134_object55366:head [set-alloc-hint object_size 65536 write_size 65536,write 0~65536 in=65536b] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e27)", 2023-08-01T19:54:42.722 INFO:teuthology.orchestra.run.smithi155.stdout: "initiated_at": "2023-08-01T19:54:42.670257+0000", 2023-08-01T19:54:42.722 INFO:teuthology.orchestra.run.smithi155.stdout: "age": 0.0036224500000000001, 2023-08-01T19:54:42.722 INFO:teuthology.orchestra.run.smithi155.stdout: "duration": 0.0041237720000000004, 2023-08-01T19:54:42.722 INFO:teuthology.orchestra.run.smithi155.stdout: "type_data": { 2023-08-01T19:54:42.722 INFO:teuthology.orchestra.run.smithi155.stdout: "flag_point": "waiting for sub ops", 2023-08-01T19:54:42.722 INFO:teuthology.orchestra.run.smithi155.stdout: "client_info": { 2023-08-01T19:54:42.722 INFO:teuthology.orchestra.run.smithi155.stdout: "client": "client.4668", 2023-08-01T19:54:42.723 INFO:teuthology.orchestra.run.smithi155.stdout: "client_addr": "172.21.15.6:0/1709472247", 2023-08-01T19:54:42.723 INFO:teuthology.orchestra.run.smithi155.stdout: "tid": 55367 2023-08-01T19:54:42.723 INFO:teuthology.orchestra.run.smithi155.stdout: }, 2023-08-01T19:54:42.723 INFO:teuthology.orchestra.run.smithi155.stdout: "events": [ 2023-08-01T19:54:42.723 INFO:teuthology.orchestra.run.smithi155.stdout: { 2023-08-01T19:54:42.723 INFO:teuthology.orchestra.run.smithi155.stdout: "event": "initiated", 2023-08-01T19:54:42.723 INFO:teuthology.orchestra.run.smithi155.stdout: "time": "2023-08-01T19:54:42.670257+0000", 2023-08-01T19:54:42.723 INFO:teuthology.orchestra.run.smithi155.stdout: "duration": 0 2023-08-01T19:54:42.724 INFO:teuthology.orchestra.run.smithi155.stdout: }, 2023-08-01T19:54:42.724 INFO:teuthology.orchestra.run.smithi155.stdout: { 2023-08-01T19:54:42.724 INFO:teuthology.orchestra.run.smithi155.stdout: "event": "throttled", 2023-08-01T19:54:42.724 INFO:teuthology.orchestra.run.smithi155.stdout: "time": "2023-08-01T19:54:42.670257+0000", 2023-08-01T19:54:42.724 INFO:teuthology.orchestra.run.smithi155.stdout: "duration": 0 2023-08-01T19:54:42.724 INFO:teuthology.orchestra.run.smithi155.stdout: }, 2023-08-01T19:54:42.724 INFO:teuthology.orchestra.run.smithi155.stdout: { 2023-08-01T19:54:42.725 INFO:teuthology.orchestra.run.smithi155.stdout: "event": "header_read", 2023-08-01T19:54:42.725 INFO:teuthology.orchestra.run.smithi155.stdout: "time": "2023-08-01T19:54:42.670256+0000", 2023-08-01T19:54:42.725 INFO:teuthology.orchestra.run.smithi155.stdout: "duration": 4294967295.999999 2023-08-01T19:54:42.725 INFO:teuthology.orchestra.run.smithi155.stdout: }, 2023-08-01T19:54:42.725 INFO:teuthology.orchestra.run.smithi155.stdout: { 2023-08-01T19:54:42.725 INFO:teuthology.orchestra.run.smithi155.stdout: "event": "all_read", 2023-08-01T19:54:42.725 INFO:teuthology.orchestra.run.smithi155.stdout: "time": "2023-08-01T19:54:42.670307+0000", 2023-08-01T19:54:42.725 INFO:teuthology.orchestra.run.smithi155.stdout: "duration": 5.1418000000000001e-05 2023-08-01T19:54:42.726 INFO:teuthology.orchestra.run.smithi155.stdout: }, 2023-08-01T19:54:42.726 INFO:teuthology.orchestra.run.smithi155.stdout: { 2023-08-01T19:54:42.726 INFO:teuthology.orchestra.run.smithi155.stdout: "event": "dispatched", 2023-08-01T19:54:42.726 INFO:teuthology.orchestra.run.smithi155.stdout: "time": "2023-08-01T19:54:42.670320+0000", 2023-08-01T19:54:42.726 INFO:teuthology.orchestra.run.smithi155.stdout: "duration": 1.3151e-05 2023-08-01T19:54:42.726 INFO:teuthology.orchestra.run.smithi155.stdout: }, 2023-08-01T19:54:42.726 INFO:teuthology.orchestra.run.smithi155.stdout: { 2023-08-01T19:54:42.726 INFO:teuthology.orchestra.run.smithi155.stdout: "event": "queued_for_pg", 2023-08-01T19:54:42.727 INFO:teuthology.orchestra.run.smithi155.stdout: "time": "2023-08-01T19:54:42.670327+0000", 2023-08-01T19:54:42.727 INFO:teuthology.orchestra.run.smithi155.stdout: "duration": 6.7950000000000002e-06 2023-08-01T19:54:42.727 INFO:teuthology.orchestra.run.smithi155.stdout: }, 2023-08-01T19:54:42.727 INFO:teuthology.orchestra.run.smithi155.stdout: { 2023-08-01T19:54:42.727 INFO:teuthology.orchestra.run.smithi155.stdout: "event": "reached_pg", 2023-08-01T19:54:42.727 INFO:teuthology.orchestra.run.smithi155.stdout: "time": "2023-08-01T19:54:42.670367+0000", 2023-08-01T19:54:42.727 INFO:teuthology.orchestra.run.smithi155.stdout: "duration": 3.9357000000000003e-05 2023-08-01T19:54:42.727 INFO:teuthology.orchestra.run.smithi155.stdout: }, 2023-08-01T19:54:42.728 INFO:teuthology.orchestra.run.smithi155.stdout: { 2023-08-01T19:54:42.728 INFO:teuthology.orchestra.run.smithi155.stdout: "event": "started", 2023-08-01T19:54:42.728 INFO:teuthology.orchestra.run.smithi155.stdout: "time": "2023-08-01T19:54:42.670491+0000", 2023-08-01T19:54:42.728 INFO:teuthology.orchestra.run.smithi155.stdout: "duration": 0.000124728 2023-08-01T19:54:42.728 INFO:teuthology.orchestra.run.smithi155.stdout: }, 2023-08-01T19:54:42.728 INFO:teuthology.orchestra.run.smithi155.stdout: { 2023-08-01T19:54:42.728 INFO:teuthology.orchestra.run.smithi155.stdout: "event": "waiting for subops from 0", 2023-08-01T19:54:42.728 INFO:teuthology.orchestra.run.smithi155.stdout: "time": "2023-08-01T19:54:42.670615+0000", 2023-08-01T19:54:42.729 INFO:teuthology.orchestra.run.smithi155.stdout: "duration": 0.00012326700000000001 2023-08-01T19:54:42.729 INFO:teuthology.orchestra.run.smithi155.stdout: } 2023-08-01T19:54:42.729 INFO:teuthology.orchestra.run.smithi155.stdout: ] 2023-08-01T19:54:42.729 INFO:teuthology.orchestra.run.smithi155.stdout: } 2023-08-01T19:54:42.729 INFO:teuthology.orchestra.run.smithi155.stdout: }, 2023-08-01T19:54:42.729 INFO:teuthology.orchestra.run.smithi155.stdout: { 2023-08-01T19:54:42.729 INFO:teuthology.orchestra.run.smithi155.stdout: "description": "osd_op(client.4668.0:55368 5.4 5:203d1069:::benchmark_data_smithi006_114134_object55367:head [set-alloc-hint object_size 65536 write_size 65536,write 0~65536 in=65536b] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e27)", 2023-08-01T19:54:42.729 INFO:teuthology.orchestra.run.smithi155.stdout: "initiated_at": "2023-08-01T19:54:42.670337+0000", 2023-08-01T19:54:42.730 INFO:teuthology.orchestra.run.smithi155.stdout: "age": 0.003541967, 2023-08-01T19:54:42.730 INFO:teuthology.orchestra.run.smithi155.stdout: "duration": 0.0041624239999999996, 2023-08-01T19:54:42.730 INFO:teuthology.orchestra.run.smithi155.stdout: "type_data": { 2023-08-01T19:54:42.730 INFO:teuthology.orchestra.run.smithi155.stdout: "flag_point": "waiting for sub ops", 2023-08-01T19:54:42.730 INFO:teuthology.orchestra.run.smithi155.stdout: "client_info": { 2023-08-01T19:54:42.730 INFO:teuthology.orchestra.run.smithi155.stdout: "client": "client.4668", 2023-08-01T19:54:42.730 INFO:teuthology.orchestra.run.smithi155.stdout: "client_addr": "172.21.15.6:0/1709472247", 2023-08-01T19:54:42.731 INFO:teuthology.orchestra.run.smithi155.stdout: "tid": 55368 2023-08-01T19:54:42.731 INFO:teuthology.orchestra.run.smithi155.stdout: }, 2023-08-01T19:54:42.731 INFO:teuthology.orchestra.run.smithi155.stdout: "events": [ 2023-08-01T19:54:42.731 INFO:teuthology.orchestra.run.smithi155.stdout: { 2023-08-01T19:54:42.731 INFO:teuthology.orchestra.run.smithi155.stdout: "event": "initiated", 2023-08-01T19:54:42.731 INFO:teuthology.orchestra.run.smithi155.stdout: "time": "2023-08-01T19:54:42.670337+0000", 2023-08-01T19:54:42.731 INFO:teuthology.orchestra.run.smithi155.stdout: "duration": 0 2023-08-01T19:54:42.731 INFO:teuthology.orchestra.run.smithi155.stdout: }, 2023-08-01T19:54:42.732 INFO:teuthology.orchestra.run.smithi155.stdout: { 2023-08-01T19:54:42.732 INFO:teuthology.orchestra.run.smithi155.stdout: "event": "throttled", 2023-08-01T19:54:42.732 INFO:teuthology.orchestra.run.smithi155.stdout: "time": "2023-08-01T19:54:42.670337+0000", 2023-08-01T19:54:42.732 INFO:teuthology.orchestra.run.smithi155.stdout: "duration": 0 2023-08-01T19:54:42.732 INFO:teuthology.orchestra.run.smithi155.stdout: }, 2023-08-01T19:54:42.732 INFO:teuthology.orchestra.run.smithi155.stdout: { 2023-08-01T19:54:42.732 INFO:teuthology.orchestra.run.smithi155.stdout: "event": "header_read", 2023-08-01T19:54:42.732 INFO:teuthology.orchestra.run.smithi155.stdout: "time": "2023-08-01T19:54:42.670337+0000", 2023-08-01T19:54:42.733 INFO:teuthology.orchestra.run.smithi155.stdout: "duration": 4294967295.9999995 2023-08-01T19:54:42.733 INFO:teuthology.orchestra.run.smithi155.stdout: }, 2023-08-01T19:54:42.733 INFO:teuthology.orchestra.run.smithi155.stdout: { 2023-08-01T19:54:42.733 INFO:teuthology.orchestra.run.smithi155.stdout: "event": "all_read", 2023-08-01T19:54:42.733 INFO:teuthology.orchestra.run.smithi155.stdout: "time": "2023-08-01T19:54:42.670371+0000", 2023-08-01T19:54:42.733 INFO:teuthology.orchestra.run.smithi155.stdout: "duration": 3.4173e-05 2023-08-01T19:54:42.733 INFO:teuthology.orchestra.run.smithi155.stdout: }, 2023-08-01T19:54:42.733 INFO:teuthology.orchestra.run.smithi155.stdout: { 2023-08-01T19:54:42.734 INFO:teuthology.orchestra.run.smithi155.stdout: "event": "dispatched", 2023-08-01T19:54:42.734 INFO:teuthology.orchestra.run.smithi155.stdout: "time": "2023-08-01T19:54:42.670378+0000", 2023-08-01T19:54:42.734 INFO:teuthology.orchestra.run.smithi155.stdout: "duration": 7.396e-06 2023-08-01T19:54:42.734 INFO:teuthology.orchestra.run.smithi155.stdout: }, 2023-08-01T19:54:42.734 INFO:teuthology.orchestra.run.smithi155.stdout: { 2023-08-01T19:54:42.734 INFO:teuthology.orchestra.run.smithi155.stdout: "event": "queued_for_pg", 2023-08-01T19:54:42.734 INFO:teuthology.orchestra.run.smithi155.stdout: "time": "2023-08-01T19:54:42.670384+0000", 2023-08-01T19:54:42.734 INFO:teuthology.orchestra.run.smithi155.stdout: "duration": 5.682e-06 2023-08-01T19:54:42.735 INFO:teuthology.orchestra.run.smithi155.stdout: }, 2023-08-01T19:54:42.735 INFO:teuthology.orchestra.run.smithi155.stdout: { 2023-08-01T19:54:42.735 INFO:teuthology.orchestra.run.smithi155.stdout: "event": "reached_pg", 2023-08-01T19:54:42.735 INFO:teuthology.orchestra.run.smithi155.stdout: "time": "2023-08-01T19:54:42.670424+0000", 2023-08-01T19:54:42.735 INFO:teuthology.orchestra.run.smithi155.stdout: "duration": 4.0357e-05 2023-08-01T19:54:42.735 INFO:teuthology.orchestra.run.smithi155.stdout: }, 2023-08-01T19:54:42.735 INFO:teuthology.orchestra.run.smithi155.stdout: { 2023-08-01T19:54:42.735 INFO:teuthology.orchestra.run.smithi155.stdout: "event": "started", 2023-08-01T19:54:42.736 INFO:teuthology.orchestra.run.smithi155.stdout: "time": "2023-08-01T19:54:42.670563+0000", 2023-08-01T19:54:42.736 INFO:teuthology.orchestra.run.smithi155.stdout: "duration": 0.000138913 2023-08-01T19:54:42.736 INFO:teuthology.orchestra.run.smithi155.stdout: }, 2023-08-01T19:54:42.736 INFO:teuthology.orchestra.run.smithi155.stdout: { 2023-08-01T19:54:42.736 INFO:teuthology.orchestra.run.smithi155.stdout: "event": "waiting for subops from 0", 2023-08-01T19:54:42.736 INFO:teuthology.orchestra.run.smithi155.stdout: "time": "2023-08-01T19:54:42.670697+0000", 2023-08-01T19:54:42.736 INFO:teuthology.orchestra.run.smithi155.stdout: "duration": 0.00013425700000000001 2023-08-01T19:54:42.736 INFO:teuthology.orchestra.run.smithi155.stdout: }, 2023-08-01T19:54:42.737 INFO:teuthology.orchestra.run.smithi155.stdout: { 2023-08-01T19:54:42.737 INFO:teuthology.orchestra.run.smithi155.stdout: "event": "op_commit", 2023-08-01T19:54:42.737 INFO:teuthology.orchestra.run.smithi155.stdout: "time": "2023-08-01T19:54:42.674236+0000", 2023-08-01T19:54:42.737 INFO:teuthology.orchestra.run.smithi155.stdout: "duration": 0.0035387309999999998 2023-08-01T19:54:42.737 INFO:teuthology.orchestra.run.smithi155.stdout: } 2023-08-01T19:54:42.737 INFO:teuthology.orchestra.run.smithi155.stdout: ] 2023-08-01T19:54:42.737 INFO:teuthology.orchestra.run.smithi155.stdout: } 2023-08-01T19:54:42.737 INFO:teuthology.orchestra.run.smithi155.stdout: }, 2023-08-01T19:54:42.738 INFO:teuthology.orchestra.run.smithi155.stdout: { 2023-08-01T19:54:42.738 INFO:teuthology.orchestra.run.smithi155.stdout: "description": "osd_op(client.4668.0:55370 5.8 5:112974c7:::benchmark_data_smithi006_114134_object55369:head [set-alloc-hint object_size 65536 write_size 65536,write 0~65536 in=65536b] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e27)", 2023-08-01T19:54:42.738 INFO:teuthology.orchestra.run.smithi155.stdout: "initiated_at": "2023-08-01T19:54:42.671384+0000", 2023-08-01T19:54:42.738 INFO:teuthology.orchestra.run.smithi155.stdout: "age": 0.0024955540000000001, 2023-08-01T19:54:42.738 INFO:teuthology.orchestra.run.smithi155.stdout: "duration": 0.0032000119999999999, 2023-08-01T19:54:42.738 INFO:teuthology.orchestra.run.smithi155.stdout: "type_data": { 2023-08-01T19:54:42.738 INFO:teuthology.orchestra.run.smithi155.stdout: "flag_point": "waiting for sub ops", 2023-08-01T19:54:42.739 INFO:teuthology.orchestra.run.smithi155.stdout: "client_info": { 2023-08-01T19:54:42.739 INFO:teuthology.orchestra.run.smithi155.stdout: "client": "client.4668", 2023-08-01T19:54:42.739 INFO:teuthology.orchestra.run.smithi155.stdout: "client_addr": "172.21.15.6:0/1709472247", 2023-08-01T19:54:42.739 INFO:teuthology.orchestra.run.smithi155.stdout: "tid": 55370 2023-08-01T19:54:42.739 INFO:teuthology.orchestra.run.smithi155.stdout: }, 2023-08-01T19:54:42.739 INFO:teuthology.orchestra.run.smithi155.stdout: "events": [ 2023-08-01T19:54:42.739 INFO:teuthology.orchestra.run.smithi155.stdout: { 2023-08-01T19:54:42.739 INFO:teuthology.orchestra.run.smithi155.stdout: "event": "initiated", 2023-08-01T19:54:42.740 INFO:teuthology.orchestra.run.smithi155.stdout: "time": "2023-08-01T19:54:42.671384+0000", 2023-08-01T19:54:42.740 INFO:teuthology.orchestra.run.smithi155.stdout: "duration": 0 2023-08-01T19:54:42.740 INFO:teuthology.orchestra.run.smithi155.stdout: }, 2023-08-01T19:54:42.740 INFO:teuthology.orchestra.run.smithi155.stdout: { 2023-08-01T19:54:42.740 INFO:teuthology.orchestra.run.smithi155.stdout: "event": "throttled", 2023-08-01T19:54:42.740 INFO:teuthology.orchestra.run.smithi155.stdout: "time": "2023-08-01T19:54:42.671384+0000", 2023-08-01T19:54:42.740 INFO:teuthology.orchestra.run.smithi155.stdout: "duration": 0 2023-08-01T19:54:42.740 INFO:teuthology.orchestra.run.smithi155.stdout: }, 2023-08-01T19:54:42.741 INFO:teuthology.orchestra.run.smithi155.stdout: { 2023-08-01T19:54:42.741 INFO:teuthology.orchestra.run.smithi155.stdout: "event": "header_read", 2023-08-01T19:54:42.741 INFO:teuthology.orchestra.run.smithi155.stdout: "time": "2023-08-01T19:54:42.671383+0000", 2023-08-01T19:54:42.741 INFO:teuthology.orchestra.run.smithi155.stdout: "duration": 4294967295.999999 2023-08-01T19:54:42.741 INFO:teuthology.orchestra.run.smithi155.stdout: }, 2023-08-01T19:54:42.741 INFO:teuthology.orchestra.run.smithi155.stdout: { 2023-08-01T19:54:42.741 INFO:teuthology.orchestra.run.smithi155.stdout: "event": "all_read", 2023-08-01T19:54:42.741 INFO:teuthology.orchestra.run.smithi155.stdout: "time": "2023-08-01T19:54:42.671474+0000", 2023-08-01T19:54:42.742 INFO:teuthology.orchestra.run.smithi155.stdout: "duration": 9.1124000000000004e-05 2023-08-01T19:54:42.742 INFO:teuthology.orchestra.run.smithi155.stdout: }, 2023-08-01T19:54:42.742 INFO:teuthology.orchestra.run.smithi155.stdout: { 2023-08-01T19:54:42.742 INFO:teuthology.orchestra.run.smithi155.stdout: "event": "dispatched", 2023-08-01T19:54:42.742 INFO:teuthology.orchestra.run.smithi155.stdout: "time": "2023-08-01T19:54:42.671487+0000", 2023-08-01T19:54:42.742 INFO:teuthology.orchestra.run.smithi155.stdout: "duration": 1.3071000000000001e-05 2023-08-01T19:54:42.742 INFO:teuthology.orchestra.run.smithi155.stdout: }, 2023-08-01T19:54:42.742 INFO:teuthology.orchestra.run.smithi155.stdout: { 2023-08-01T19:54:42.743 INFO:teuthology.orchestra.run.smithi155.stdout: "event": "queued_for_pg", 2023-08-01T19:54:42.743 INFO:teuthology.orchestra.run.smithi155.stdout: "time": "2023-08-01T19:54:42.671493+0000", 2023-08-01T19:54:42.743 INFO:teuthology.orchestra.run.smithi155.stdout: "duration": 6.0929999999999999e-06 2023-08-01T19:54:42.743 INFO:teuthology.orchestra.run.smithi155.stdout: }, 2023-08-01T19:54:42.743 INFO:teuthology.orchestra.run.smithi155.stdout: { 2023-08-01T19:54:42.743 INFO:teuthology.orchestra.run.smithi155.stdout: "event": "reached_pg", 2023-08-01T19:54:42.743 INFO:teuthology.orchestra.run.smithi155.stdout: "time": "2023-08-01T19:54:42.672214+0000", 2023-08-01T19:54:42.743 INFO:teuthology.orchestra.run.smithi155.stdout: "duration": 0.00072056300000000002 2023-08-01T19:54:42.744 INFO:teuthology.orchestra.run.smithi155.stdout: }, 2023-08-01T19:54:42.744 INFO:teuthology.orchestra.run.smithi155.stdout: { 2023-08-01T19:54:42.744 INFO:teuthology.orchestra.run.smithi155.stdout: "event": "started", 2023-08-01T19:54:42.744 INFO:teuthology.orchestra.run.smithi155.stdout: "time": "2023-08-01T19:54:42.672307+0000", 2023-08-01T19:54:42.744 INFO:teuthology.orchestra.run.smithi155.stdout: "duration": 9.3418999999999994e-05 2023-08-01T19:54:42.744 INFO:teuthology.orchestra.run.smithi155.stdout: }, 2023-08-01T19:54:42.744 INFO:teuthology.orchestra.run.smithi155.stdout: { 2023-08-01T19:54:42.744 INFO:teuthology.orchestra.run.smithi155.stdout: "event": "waiting for subops from 0", 2023-08-01T19:54:42.745 INFO:teuthology.orchestra.run.smithi155.stdout: "time": "2023-08-01T19:54:42.672399+0000", 2023-08-01T19:54:42.745 INFO:teuthology.orchestra.run.smithi155.stdout: "duration": 9.2323000000000004e-05 2023-08-01T19:54:42.745 INFO:teuthology.orchestra.run.smithi155.stdout: } 2023-08-01T19:54:42.745 INFO:teuthology.orchestra.run.smithi155.stdout: ] 2023-08-01T19:54:42.745 INFO:teuthology.orchestra.run.smithi155.stdout: } 2023-08-01T19:54:42.745 INFO:teuthology.orchestra.run.smithi155.stdout: }, 2023-08-01T19:54:42.745 INFO:teuthology.orchestra.run.smithi155.stdout: { 2023-08-01T19:54:42.745 INFO:teuthology.orchestra.run.smithi155.stdout: "description": "osd_op(client.4668.0:55372 5.0 5:0864e6f5:::benchmark_data_smithi006_114134_object55371:head [set-alloc-hint object_size 65536 write_size 65536,write 0~65536 in=65536b] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e27)", 2023-08-01T19:54:42.746 INFO:teuthology.orchestra.run.smithi155.stdout: "initiated_at": "2023-08-01T19:54:42.671503+0000", 2023-08-01T19:54:42.746 INFO:teuthology.orchestra.run.smithi155.stdout: "age": 0.0023765650000000002, 2023-08-01T19:54:42.746 INFO:teuthology.orchestra.run.smithi155.stdout: "duration": 0.0031631620000000002, 2023-08-01T19:54:42.746 INFO:teuthology.orchestra.run.smithi155.stdout: "type_data": { 2023-08-01T19:54:42.746 INFO:teuthology.orchestra.run.smithi155.stdout: "flag_point": "waiting for sub ops", 2023-08-01T19:54:42.746 INFO:teuthology.orchestra.run.smithi155.stdout: "client_info": { 2023-08-01T19:54:42.746 INFO:teuthology.orchestra.run.smithi155.stdout: "client": "client.4668", 2023-08-01T19:54:42.747 INFO:teuthology.orchestra.run.smithi155.stdout: "client_addr": "172.21.15.6:0/1709472247", 2023-08-01T19:54:42.747 INFO:teuthology.orchestra.run.smithi155.stdout: "tid": 55372 2023-08-01T19:54:42.747 INFO:teuthology.orchestra.run.smithi155.stdout: }, 2023-08-01T19:54:42.747 INFO:teuthology.orchestra.run.smithi155.stdout: "events": [ 2023-08-01T19:54:42.747 INFO:teuthology.orchestra.run.smithi155.stdout: { 2023-08-01T19:54:42.747 INFO:teuthology.orchestra.run.smithi155.stdout: "event": "initiated", 2023-08-01T19:54:42.747 INFO:teuthology.orchestra.run.smithi155.stdout: "time": "2023-08-01T19:54:42.671503+0000", 2023-08-01T19:54:42.747 INFO:teuthology.orchestra.run.smithi155.stdout: "duration": 0 2023-08-01T19:54:42.748 INFO:teuthology.orchestra.run.smithi155.stdout: }, 2023-08-01T19:54:42.748 INFO:teuthology.orchestra.run.smithi155.stdout: { 2023-08-01T19:54:42.748 INFO:teuthology.orchestra.run.smithi155.stdout: "event": "throttled", 2023-08-01T19:54:42.748 INFO:teuthology.orchestra.run.smithi155.stdout: "time": "2023-08-01T19:54:42.671503+0000", 2023-08-01T19:54:42.748 INFO:teuthology.orchestra.run.smithi155.stdout: "duration": 0 2023-08-01T19:54:42.748 INFO:teuthology.orchestra.run.smithi155.stdout: }, 2023-08-01T19:54:42.748 INFO:teuthology.orchestra.run.smithi155.stdout: { 2023-08-01T19:54:42.748 INFO:teuthology.orchestra.run.smithi155.stdout: "event": "header_read", 2023-08-01T19:54:42.749 INFO:teuthology.orchestra.run.smithi155.stdout: "time": "2023-08-01T19:54:42.671502+0000", 2023-08-01T19:54:42.749 INFO:teuthology.orchestra.run.smithi155.stdout: "duration": 4294967295.9999995 2023-08-01T19:54:42.749 INFO:teuthology.orchestra.run.smithi155.stdout: }, 2023-08-01T19:54:42.749 INFO:teuthology.orchestra.run.smithi155.stdout: { 2023-08-01T19:54:42.749 INFO:teuthology.orchestra.run.smithi155.stdout: "event": "all_read", 2023-08-01T19:54:42.749 INFO:teuthology.orchestra.run.smithi155.stdout: "time": "2023-08-01T19:54:42.671580+0000", 2023-08-01T19:54:42.749 INFO:teuthology.orchestra.run.smithi155.stdout: "duration": 7.7731999999999994e-05 2023-08-01T19:54:42.749 INFO:teuthology.orchestra.run.smithi155.stdout: }, 2023-08-01T19:54:42.750 INFO:teuthology.orchestra.run.smithi155.stdout: { 2023-08-01T19:54:42.750 INFO:teuthology.orchestra.run.smithi155.stdout: "event": "dispatched", 2023-08-01T19:54:42.750 INFO:teuthology.orchestra.run.smithi155.stdout: "time": "2023-08-01T19:54:42.671590+0000", 2023-08-01T19:54:42.750 INFO:teuthology.orchestra.run.smithi155.stdout: "duration": 1.0409e-05 2023-08-01T19:54:42.750 INFO:teuthology.orchestra.run.smithi155.stdout: }, 2023-08-01T19:54:42.750 INFO:teuthology.orchestra.run.smithi155.stdout: { 2023-08-01T19:54:42.750 INFO:teuthology.orchestra.run.smithi155.stdout: "event": "queued_for_pg", 2023-08-01T19:54:42.750 INFO:teuthology.orchestra.run.smithi155.stdout: "time": "2023-08-01T19:54:42.671596+0000", 2023-08-01T19:54:42.751 INFO:teuthology.orchestra.run.smithi155.stdout: "duration": 5.4219999999999999e-06 2023-08-01T19:54:42.751 INFO:teuthology.orchestra.run.smithi155.stdout: }, 2023-08-01T19:54:42.751 INFO:teuthology.orchestra.run.smithi155.stdout: { 2023-08-01T19:54:42.751 INFO:teuthology.orchestra.run.smithi155.stdout: "event": "reached_pg", 2023-08-01T19:54:42.751 INFO:teuthology.orchestra.run.smithi155.stdout: "time": "2023-08-01T19:54:42.672195+0000", 2023-08-01T19:54:42.751 INFO:teuthology.orchestra.run.smithi155.stdout: "duration": 0.00059945599999999995 2023-08-01T19:54:42.751 INFO:teuthology.orchestra.run.smithi155.stdout: }, 2023-08-01T19:54:42.751 INFO:teuthology.orchestra.run.smithi155.stdout: { 2023-08-01T19:54:42.752 INFO:teuthology.orchestra.run.smithi155.stdout: "event": "started", 2023-08-01T19:54:42.752 INFO:teuthology.orchestra.run.smithi155.stdout: "time": "2023-08-01T19:54:42.672330+0000", 2023-08-01T19:54:42.752 INFO:teuthology.orchestra.run.smithi155.stdout: "duration": 0.00013475800000000001 2023-08-01T19:54:42.752 INFO:teuthology.orchestra.run.smithi155.stdout: }, 2023-08-01T19:54:42.752 INFO:teuthology.orchestra.run.smithi155.stdout: { 2023-08-01T19:54:42.752 INFO:teuthology.orchestra.run.smithi155.stdout: "event": "waiting for subops from 0", 2023-08-01T19:54:42.752 INFO:teuthology.orchestra.run.smithi155.stdout: "time": "2023-08-01T19:54:42.672466+0000", 2023-08-01T19:54:42.752 INFO:teuthology.orchestra.run.smithi155.stdout: "duration": 0.00013654199999999999 2023-08-01T19:54:42.753 INFO:teuthology.orchestra.run.smithi155.stdout: } 2023-08-01T19:54:42.753 INFO:teuthology.orchestra.run.smithi155.stdout: ] 2023-08-01T19:54:42.753 INFO:teuthology.orchestra.run.smithi155.stdout: } 2023-08-01T19:54:42.753 INFO:teuthology.orchestra.run.smithi155.stdout: } 2023-08-01T19:54:42.753 INFO:teuthology.orchestra.run.smithi155.stdout: ], 2023-08-01T19:54:42.753 INFO:teuthology.orchestra.run.smithi155.stdout: "num_ops": 10 2023-08-01T19:54:42.753 INFO:teuthology.orchestra.run.smithi155.stdout:} 2023-08-01T19:54:42.755 DEBUG:teuthology.orchestra.run.smithi155:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 30 ceph --cluster ceph --admin-daemon /var/run/ceph/ceph-osd.2.asok dump_blocked_ops 2023-08-01T19:54:42.756 INFO:tasks.ceph.osd.0.smithi008.stderr:2023-08-01T19:54:42.755+0000 7f16a58f4700 -1 received signal: Hangup from /usr/bin/python3 /bin/daemon-helper kill ceph-osd -f --cluster ceph -i 0 (PID: 111179) UID: 0 2023-08-01T19:54:42.855 INFO:tasks.ceph.osd.1.smithi101.stderr:2023-08-01T19:54:42.854+0000 7fb0cb7f6700 -1 received signal: Hangup from /usr/bin/python3 /bin/daemon-helper kill ceph-osd -f --cluster ceph -i 1 (PID: 111141) UID: 0 2023-08-01T19:54:42.919 INFO:teuthology.orchestra.run.smithi155.stdout:{ 2023-08-01T19:54:42.919 INFO:teuthology.orchestra.run.smithi155.stdout: "ops": [], 2023-08-01T19:54:42.920 INFO:teuthology.orchestra.run.smithi155.stdout: "complaint_time": 30, 2023-08-01T19:54:42.920 INFO:teuthology.orchestra.run.smithi155.stdout: "num_blocked_ops": 0 2023-08-01T19:54:42.920 INFO:teuthology.orchestra.run.smithi155.stdout:} 2023-08-01T19:54:42.933 DEBUG:teuthology.orchestra.run.smithi155:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 30 ceph --cluster ceph --admin-daemon /var/run/ceph/ceph-osd.2.asok dump_historic_ops 2023-08-01T19:54:42.957 INFO:tasks.ceph.osd.0.smithi008.stderr:2023-08-01T19:54:42.957+0000 7f16a58f4700 -1 received signal: Hangup from /usr/bin/python3 /bin/daemon-helper kill ceph-osd -f --cluster ceph -i 0 (PID: 111179) UID: 0 2023-08-01T19:54:43.057 INFO:tasks.ceph.osd.0.smithi008.stderr:2023-08-01T19:54:43.056+0000 7f16a58f4700 -1 received signal: Hangup from /usr/bin/python3 /bin/daemon-helper kill ceph-osd -f --cluster ceph -i 0 (PID: 111179) UID: 0 2023-08-01T19:54:43.106 INFO:teuthology.orchestra.run.smithi155.stdout:{ 2023-08-01T19:54:43.107 INFO:teuthology.orchestra.run.smithi155.stdout: "size": 20, 2023-08-01T19:54:43.107 INFO:teuthology.orchestra.run.smithi155.stdout: "duration": 600, 2023-08-01T19:54:43.107 INFO:teuthology.orchestra.run.smithi155.stdout: "ops": [ 2023-08-01T19:54:43.107 INFO:teuthology.orchestra.run.smithi155.stdout: { 2023-08-01T19:54:43.107 INFO:teuthology.orchestra.run.smithi155.stdout: "description": "osd_op(client.4668.0:18365 5.d 5:bbdb2097:::benchmark_data_smithi006_114134_object18364:head [set-alloc-hint object_size 65536 write_size 65536,write 0~65536] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e23)", 2023-08-01T19:54:43.107 INFO:teuthology.orchestra.run.smithi155.stdout: "initiated_at": "2023-08-01T19:54:28.996732+0000", 2023-08-01T19:54:43.108 INFO:teuthology.orchestra.run.smithi155.stdout: "age": 14.106545815, 2023-08-01T19:54:43.108 INFO:teuthology.orchestra.run.smithi155.stdout: "duration": 0.014874775999999999, 2023-08-01T19:54:43.108 INFO:teuthology.orchestra.run.smithi155.stdout: "type_data": { 2023-08-01T19:54:43.108 INFO:teuthology.orchestra.run.smithi155.stdout: "flag_point": "commit sent; apply or cleanup", 2023-08-01T19:54:43.108 INFO:teuthology.orchestra.run.smithi155.stdout: "client_info": { 2023-08-01T19:54:43.108 INFO:teuthology.orchestra.run.smithi155.stdout: "client": "client.4668", 2023-08-01T19:54:43.108 INFO:teuthology.orchestra.run.smithi155.stdout: "client_addr": "172.21.15.6:0/1709472247", 2023-08-01T19:54:43.108 INFO:teuthology.orchestra.run.smithi155.stdout: "tid": 18365 2023-08-01T19:54:43.109 INFO:teuthology.orchestra.run.smithi155.stdout: }, 2023-08-01T19:54:43.109 INFO:teuthology.orchestra.run.smithi155.stdout: "events": [ 2023-08-01T19:54:43.109 INFO:teuthology.orchestra.run.smithi155.stdout: { 2023-08-01T19:54:43.109 INFO:teuthology.orchestra.run.smithi155.stdout: "event": "initiated", 2023-08-01T19:54:43.109 INFO:teuthology.orchestra.run.smithi155.stdout: "time": "2023-08-01T19:54:28.996732+0000", 2023-08-01T19:54:43.109 INFO:teuthology.orchestra.run.smithi155.stdout: "duration": 0 2023-08-01T19:54:43.109 INFO:teuthology.orchestra.run.smithi155.stdout: }, 2023-08-01T19:54:43.110 INFO:teuthology.orchestra.run.smithi155.stdout: { 2023-08-01T19:54:43.110 INFO:teuthology.orchestra.run.smithi155.stdout: "event": "throttled", 2023-08-01T19:54:43.110 INFO:teuthology.orchestra.run.smithi155.stdout: "time": "2023-08-01T19:54:28.996732+0000", 2023-08-01T19:54:43.110 INFO:teuthology.orchestra.run.smithi155.stdout: "duration": 0 2023-08-01T19:54:43.110 INFO:teuthology.orchestra.run.smithi155.stdout: }, 2023-08-01T19:54:43.110 INFO:teuthology.orchestra.run.smithi155.stdout: { 2023-08-01T19:54:43.110 INFO:teuthology.orchestra.run.smithi155.stdout: "event": "header_read", 2023-08-01T19:54:43.110 INFO:teuthology.orchestra.run.smithi155.stdout: "time": "2023-08-01T19:54:28.996731+0000", 2023-08-01T19:54:43.111 INFO:teuthology.orchestra.run.smithi155.stdout: "duration": 4294967295.999999 2023-08-01T19:54:43.111 INFO:teuthology.orchestra.run.smithi155.stdout: }, 2023-08-01T19:54:43.111 INFO:teuthology.orchestra.run.smithi155.stdout: { 2023-08-01T19:54:43.111 INFO:teuthology.orchestra.run.smithi155.stdout: "event": "all_read", 2023-08-01T19:54:43.111 INFO:teuthology.orchestra.run.smithi155.stdout: "time": "2023-08-01T19:54:28.996931+0000", 2023-08-01T19:54:43.111 INFO:teuthology.orchestra.run.smithi155.stdout: "duration": 0.000200206 2023-08-01T19:54:43.111 INFO:teuthology.orchestra.run.smithi155.stdout: }, 2023-08-01T19:54:43.111 INFO:teuthology.orchestra.run.smithi155.stdout: { 2023-08-01T19:54:43.112 INFO:teuthology.orchestra.run.smithi155.stdout: "event": "dispatched", 2023-08-01T19:54:43.112 INFO:teuthology.orchestra.run.smithi155.stdout: "time": "2023-08-01T19:54:28.996939+0000", 2023-08-01T19:54:43.112 INFO:teuthology.orchestra.run.smithi155.stdout: "duration": 8.1939999999999998e-06 2023-08-01T19:54:43.112 INFO:teuthology.orchestra.run.smithi155.stdout: }, 2023-08-01T19:54:43.112 INFO:teuthology.orchestra.run.smithi155.stdout: { 2023-08-01T19:54:43.112 INFO:teuthology.orchestra.run.smithi155.stdout: "event": "queued_for_pg", 2023-08-01T19:54:43.112 INFO:teuthology.orchestra.run.smithi155.stdout: "time": "2023-08-01T19:54:28.996943+0000", 2023-08-01T19:54:43.113 INFO:teuthology.orchestra.run.smithi155.stdout: "duration": 3.7019999999999999e-06 2023-08-01T19:54:43.113 INFO:teuthology.orchestra.run.smithi155.stdout: }, 2023-08-01T19:54:43.113 INFO:teuthology.orchestra.run.smithi155.stdout: { 2023-08-01T19:54:43.113 INFO:teuthology.orchestra.run.smithi155.stdout: "event": "reached_pg", 2023-08-01T19:54:43.113 INFO:teuthology.orchestra.run.smithi155.stdout: "time": "2023-08-01T19:54:28.996975+0000", 2023-08-01T19:54:43.113 INFO:teuthology.orchestra.run.smithi155.stdout: "duration": 3.1609999999999997e-05 2023-08-01T19:54:43.113 INFO:teuthology.orchestra.run.smithi155.stdout: }, 2023-08-01T19:54:43.113 INFO:teuthology.orchestra.run.smithi155.stdout: { 2023-08-01T19:54:43.114 INFO:teuthology.orchestra.run.smithi155.stdout: "event": "started", 2023-08-01T19:54:43.114 INFO:teuthology.orchestra.run.smithi155.stdout: "time": "2023-08-01T19:54:28.997086+0000", 2023-08-01T19:54:43.114 INFO:teuthology.orchestra.run.smithi155.stdout: "duration": 0.000111329 2023-08-01T19:54:43.114 INFO:teuthology.orchestra.run.smithi155.stdout: }, 2023-08-01T19:54:43.114 INFO:teuthology.orchestra.run.smithi155.stdout: { 2023-08-01T19:54:43.114 INFO:teuthology.orchestra.run.smithi155.stdout: "event": "waiting for subops from 1", 2023-08-01T19:54:43.114 INFO:teuthology.orchestra.run.smithi155.stdout: "time": "2023-08-01T19:54:28.997220+0000", 2023-08-01T19:54:43.114 INFO:teuthology.orchestra.run.smithi155.stdout: "duration": 0.000134296 2023-08-01T19:54:43.115 INFO:teuthology.orchestra.run.smithi155.stdout: }, 2023-08-01T19:54:43.115 INFO:teuthology.orchestra.run.smithi155.stdout: { 2023-08-01T19:54:43.115 INFO:teuthology.orchestra.run.smithi155.stdout: "event": "op_commit", 2023-08-01T19:54:43.115 INFO:teuthology.orchestra.run.smithi155.stdout: "time": "2023-08-01T19:54:28.998580+0000", 2023-08-01T19:54:43.115 INFO:teuthology.orchestra.run.smithi155.stdout: "duration": 0.001359493 2023-08-01T19:54:43.115 INFO:teuthology.orchestra.run.smithi155.stdout: }, 2023-08-01T19:54:43.115 INFO:teuthology.orchestra.run.smithi155.stdout: { 2023-08-01T19:54:43.115 INFO:teuthology.orchestra.run.smithi155.stdout: "event": "sub_op_commit_rec", 2023-08-01T19:54:43.116 INFO:teuthology.orchestra.run.smithi155.stdout: "time": "2023-08-01T19:54:29.011542+0000", 2023-08-01T19:54:43.116 INFO:teuthology.orchestra.run.smithi155.stdout: "duration": 0.012962815000000001 2023-08-01T19:54:43.116 INFO:teuthology.orchestra.run.smithi155.stdout: }, 2023-08-01T19:54:43.116 INFO:teuthology.orchestra.run.smithi155.stdout: { 2023-08-01T19:54:43.116 INFO:teuthology.orchestra.run.smithi155.stdout: "event": "commit_sent", 2023-08-01T19:54:43.116 INFO:teuthology.orchestra.run.smithi155.stdout: "time": "2023-08-01T19:54:29.011572+0000", 2023-08-01T19:54:43.116 INFO:teuthology.orchestra.run.smithi155.stdout: "duration": 2.9451999999999999e-05 2023-08-01T19:54:43.116 INFO:teuthology.orchestra.run.smithi155.stdout: }, 2023-08-01T19:54:43.117 INFO:teuthology.orchestra.run.smithi155.stdout: { 2023-08-01T19:54:43.117 INFO:teuthology.orchestra.run.smithi155.stdout: "event": "done", 2023-08-01T19:54:43.117 INFO:teuthology.orchestra.run.smithi155.stdout: "time": "2023-08-01T19:54:29.011607+0000", 2023-08-01T19:54:43.117 INFO:teuthology.orchestra.run.smithi155.stdout: "duration": 3.4628000000000001e-05 2023-08-01T19:54:43.117 INFO:teuthology.orchestra.run.smithi155.stdout: } 2023-08-01T19:54:43.117 INFO:teuthology.orchestra.run.smithi155.stdout: ] 2023-08-01T19:54:43.117 INFO:teuthology.orchestra.run.smithi155.stdout: } 2023-08-01T19:54:43.117 INFO:teuthology.orchestra.run.smithi155.stdout: }, 2023-08-01T19:54:43.118 INFO:teuthology.orchestra.run.smithi155.stdout: { 2023-08-01T19:54:43.118 INFO:teuthology.orchestra.run.smithi155.stdout: "description": "osd_op(client.4668.0:31683 5.d 5:be764a02:::benchmark_data_smithi006_114134_object31682:head [set-alloc-hint object_size 65536 write_size 65536,write 0~65536] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e24)", 2023-08-01T19:54:43.118 INFO:teuthology.orchestra.run.smithi155.stdout: "initiated_at": "2023-08-01T19:54:33.229635+0000", 2023-08-01T19:54:43.118 INFO:teuthology.orchestra.run.smithi155.stdout: "age": 9.8736422230000009, 2023-08-01T19:54:43.118 INFO:teuthology.orchestra.run.smithi155.stdout: "duration": 0.015494648, 2023-08-01T19:54:43.118 INFO:teuthology.orchestra.run.smithi155.stdout: "type_data": { 2023-08-01T19:54:43.118 INFO:teuthology.orchestra.run.smithi155.stdout: "flag_point": "commit sent; apply or cleanup", 2023-08-01T19:54:43.119 INFO:teuthology.orchestra.run.smithi155.stdout: "client_info": { 2023-08-01T19:54:43.119 INFO:teuthology.orchestra.run.smithi155.stdout: "client": "client.4668", 2023-08-01T19:54:43.119 INFO:teuthology.orchestra.run.smithi155.stdout: "client_addr": "172.21.15.6:0/1709472247", 2023-08-01T19:54:43.119 INFO:teuthology.orchestra.run.smithi155.stdout: "tid": 31683 2023-08-01T19:54:43.119 INFO:teuthology.orchestra.run.smithi155.stdout: }, 2023-08-01T19:54:43.119 INFO:teuthology.orchestra.run.smithi155.stdout: "events": [ 2023-08-01T19:54:43.119 INFO:teuthology.orchestra.run.smithi155.stdout: { 2023-08-01T19:54:43.119 INFO:teuthology.orchestra.run.smithi155.stdout: "event": "initiated", 2023-08-01T19:54:43.120 INFO:teuthology.orchestra.run.smithi155.stdout: "time": "2023-08-01T19:54:33.229635+0000", 2023-08-01T19:54:43.120 INFO:teuthology.orchestra.run.smithi155.stdout: "duration": 0 2023-08-01T19:54:43.120 INFO:teuthology.orchestra.run.smithi155.stdout: }, 2023-08-01T19:54:43.120 INFO:teuthology.orchestra.run.smithi155.stdout: { 2023-08-01T19:54:43.120 INFO:teuthology.orchestra.run.smithi155.stdout: "event": "throttled", 2023-08-01T19:54:43.120 INFO:teuthology.orchestra.run.smithi155.stdout: "time": "2023-08-01T19:54:33.229635+0000", 2023-08-01T19:54:43.120 INFO:teuthology.orchestra.run.smithi155.stdout: "duration": 0 2023-08-01T19:54:43.120 INFO:teuthology.orchestra.run.smithi155.stdout: }, 2023-08-01T19:54:43.121 INFO:teuthology.orchestra.run.smithi155.stdout: { 2023-08-01T19:54:43.121 INFO:teuthology.orchestra.run.smithi155.stdout: "event": "header_read", 2023-08-01T19:54:43.121 INFO:teuthology.orchestra.run.smithi155.stdout: "time": "2023-08-01T19:54:33.229635+0000", 2023-08-01T19:54:43.121 INFO:teuthology.orchestra.run.smithi155.stdout: "duration": 4294967295.9999995 2023-08-01T19:54:43.121 INFO:teuthology.orchestra.run.smithi155.stdout: }, 2023-08-01T19:54:43.121 INFO:teuthology.orchestra.run.smithi155.stdout: { 2023-08-01T19:54:43.121 INFO:teuthology.orchestra.run.smithi155.stdout: "event": "all_read", 2023-08-01T19:54:43.121 INFO:teuthology.orchestra.run.smithi155.stdout: "time": "2023-08-01T19:54:33.229723+0000", 2023-08-01T19:54:43.122 INFO:teuthology.orchestra.run.smithi155.stdout: "duration": 8.7983000000000001e-05 2023-08-01T19:54:43.122 INFO:teuthology.orchestra.run.smithi155.stdout: }, 2023-08-01T19:54:43.122 INFO:teuthology.orchestra.run.smithi155.stdout: { 2023-08-01T19:54:43.122 INFO:teuthology.orchestra.run.smithi155.stdout: "event": "dispatched", 2023-08-01T19:54:43.122 INFO:teuthology.orchestra.run.smithi155.stdout: "time": "2023-08-01T19:54:33.229728+0000", 2023-08-01T19:54:43.122 INFO:teuthology.orchestra.run.smithi155.stdout: "duration": 5.2830000000000001e-06 2023-08-01T19:54:43.122 INFO:teuthology.orchestra.run.smithi155.stdout: }, 2023-08-01T19:54:43.122 INFO:teuthology.orchestra.run.smithi155.stdout: { 2023-08-01T19:54:43.123 INFO:teuthology.orchestra.run.smithi155.stdout: "event": "queued_for_pg", 2023-08-01T19:54:43.123 INFO:teuthology.orchestra.run.smithi155.stdout: "time": "2023-08-01T19:54:33.229732+0000", 2023-08-01T19:54:43.123 INFO:teuthology.orchestra.run.smithi155.stdout: "duration": 4.0990000000000001e-06 2023-08-01T19:54:43.123 INFO:teuthology.orchestra.run.smithi155.stdout: }, 2023-08-01T19:54:43.123 INFO:teuthology.orchestra.run.smithi155.stdout: { 2023-08-01T19:54:43.123 INFO:teuthology.orchestra.run.smithi155.stdout: "event": "reached_pg", 2023-08-01T19:54:43.123 INFO:teuthology.orchestra.run.smithi155.stdout: "time": "2023-08-01T19:54:33.229762+0000", 2023-08-01T19:54:43.123 INFO:teuthology.orchestra.run.smithi155.stdout: "duration": 3.0161000000000001e-05 2023-08-01T19:54:43.124 INFO:teuthology.orchestra.run.smithi155.stdout: }, 2023-08-01T19:54:43.124 INFO:teuthology.orchestra.run.smithi155.stdout: { 2023-08-01T19:54:43.124 INFO:teuthology.orchestra.run.smithi155.stdout: "event": "started", 2023-08-01T19:54:43.124 INFO:teuthology.orchestra.run.smithi155.stdout: "time": "2023-08-01T19:54:33.229840+0000", 2023-08-01T19:54:43.124 INFO:teuthology.orchestra.run.smithi155.stdout: "duration": 7.8059000000000006e-05 2023-08-01T19:54:43.124 INFO:teuthology.orchestra.run.smithi155.stdout: }, 2023-08-01T19:54:43.124 INFO:teuthology.orchestra.run.smithi155.stdout: { 2023-08-01T19:54:43.125 INFO:teuthology.orchestra.run.smithi155.stdout: "event": "waiting for subops from 1", 2023-08-01T19:54:43.125 INFO:teuthology.orchestra.run.smithi155.stdout: "time": "2023-08-01T19:54:33.229924+0000", 2023-08-01T19:54:43.125 INFO:teuthology.orchestra.run.smithi155.stdout: "duration": 8.3444999999999998e-05 2023-08-01T19:54:43.125 INFO:teuthology.orchestra.run.smithi155.stdout: }, 2023-08-01T19:54:43.125 INFO:teuthology.orchestra.run.smithi155.stdout: { 2023-08-01T19:54:43.125 INFO:teuthology.orchestra.run.smithi155.stdout: "event": "op_commit", 2023-08-01T19:54:43.125 INFO:teuthology.orchestra.run.smithi155.stdout: "time": "2023-08-01T19:54:33.234514+0000", 2023-08-01T19:54:43.125 INFO:teuthology.orchestra.run.smithi155.stdout: "duration": 0.0045896890000000001 2023-08-01T19:54:43.126 INFO:teuthology.orchestra.run.smithi155.stdout: }, 2023-08-01T19:54:43.126 INFO:teuthology.orchestra.run.smithi155.stdout: { 2023-08-01T19:54:43.126 INFO:teuthology.orchestra.run.smithi155.stdout: "event": "sub_op_commit_rec", 2023-08-01T19:54:43.126 INFO:teuthology.orchestra.run.smithi155.stdout: "time": "2023-08-01T19:54:33.245069+0000", 2023-08-01T19:54:43.126 INFO:teuthology.orchestra.run.smithi155.stdout: "duration": 0.01055566 2023-08-01T19:54:43.126 INFO:teuthology.orchestra.run.smithi155.stdout: }, 2023-08-01T19:54:43.126 INFO:teuthology.orchestra.run.smithi155.stdout: { 2023-08-01T19:54:43.126 INFO:teuthology.orchestra.run.smithi155.stdout: "event": "commit_sent", 2023-08-01T19:54:43.127 INFO:teuthology.orchestra.run.smithi155.stdout: "time": "2023-08-01T19:54:33.245102+0000", 2023-08-01T19:54:43.127 INFO:teuthology.orchestra.run.smithi155.stdout: "duration": 3.3025999999999999e-05 2023-08-01T19:54:43.127 INFO:teuthology.orchestra.run.smithi155.stdout: }, 2023-08-01T19:54:43.127 INFO:teuthology.orchestra.run.smithi155.stdout: { 2023-08-01T19:54:43.127 INFO:teuthology.orchestra.run.smithi155.stdout: "event": "done", 2023-08-01T19:54:43.127 INFO:teuthology.orchestra.run.smithi155.stdout: "time": "2023-08-01T19:54:33.245130+0000", 2023-08-01T19:54:43.127 INFO:teuthology.orchestra.run.smithi155.stdout: "duration": 2.7818e-05 2023-08-01T19:54:43.128 INFO:teuthology.orchestra.run.smithi155.stdout: } 2023-08-01T19:54:43.128 INFO:teuthology.orchestra.run.smithi155.stdout: ] 2023-08-01T19:54:43.128 INFO:teuthology.orchestra.run.smithi155.stdout: } 2023-08-01T19:54:43.128 INFO:teuthology.orchestra.run.smithi155.stdout: }, 2023-08-01T19:54:43.128 INFO:teuthology.orchestra.run.smithi155.stdout: { 2023-08-01T19:54:43.128 INFO:teuthology.orchestra.run.smithi155.stdout: "description": "osd_op(client.4668.0:33935 5.e 5:71b9621b:::benchmark_data_smithi006_114134_object33934:head [set-alloc-hint object_size 65536 write_size 65536,write 0~65536] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e24)", 2023-08-01T19:54:43.128 INFO:teuthology.orchestra.run.smithi155.stdout: "initiated_at": "2023-08-01T19:54:34.001558+0000", 2023-08-01T19:54:43.128 INFO:teuthology.orchestra.run.smithi155.stdout: "age": 9.1017197979999995, 2023-08-01T19:54:43.129 INFO:teuthology.orchestra.run.smithi155.stdout: "duration": 0.015838234, 2023-08-01T19:54:43.129 INFO:teuthology.orchestra.run.smithi155.stdout: "type_data": { 2023-08-01T19:54:43.129 INFO:teuthology.orchestra.run.smithi155.stdout: "flag_point": "commit sent; apply or cleanup", 2023-08-01T19:54:43.129 INFO:teuthology.orchestra.run.smithi155.stdout: "client_info": { 2023-08-01T19:54:43.129 INFO:teuthology.orchestra.run.smithi155.stdout: "client": "client.4668", 2023-08-01T19:54:43.129 INFO:teuthology.orchestra.run.smithi155.stdout: "client_addr": "172.21.15.6:0/1709472247", 2023-08-01T19:54:43.129 INFO:teuthology.orchestra.run.smithi155.stdout: "tid": 33935 2023-08-01T19:54:43.129 INFO:teuthology.orchestra.run.smithi155.stdout: }, 2023-08-01T19:54:43.130 INFO:teuthology.orchestra.run.smithi155.stdout: "events": [ 2023-08-01T19:54:43.130 INFO:teuthology.orchestra.run.smithi155.stdout: { 2023-08-01T19:54:43.130 INFO:teuthology.orchestra.run.smithi155.stdout: "event": "initiated", 2023-08-01T19:54:43.130 INFO:teuthology.orchestra.run.smithi155.stdout: "time": "2023-08-01T19:54:34.001558+0000", 2023-08-01T19:54:43.130 INFO:teuthology.orchestra.run.smithi155.stdout: "duration": 0 2023-08-01T19:54:43.130 INFO:teuthology.orchestra.run.smithi155.stdout: }, 2023-08-01T19:54:43.130 INFO:teuthology.orchestra.run.smithi155.stdout: { 2023-08-01T19:54:43.130 INFO:teuthology.orchestra.run.smithi155.stdout: "event": "throttled", 2023-08-01T19:54:43.131 INFO:teuthology.orchestra.run.smithi155.stdout: "time": "2023-08-01T19:54:34.001558+0000", 2023-08-01T19:54:43.131 INFO:teuthology.orchestra.run.smithi155.stdout: "duration": 0 2023-08-01T19:54:43.131 INFO:teuthology.orchestra.run.smithi155.stdout: }, 2023-08-01T19:54:43.131 INFO:teuthology.orchestra.run.smithi155.stdout: { 2023-08-01T19:54:43.131 INFO:teuthology.orchestra.run.smithi155.stdout: "event": "header_read", 2023-08-01T19:54:43.131 INFO:teuthology.orchestra.run.smithi155.stdout: "time": "2023-08-01T19:54:34.001557+0000", 2023-08-01T19:54:43.131 INFO:teuthology.orchestra.run.smithi155.stdout: "duration": 4294967295.9999995 2023-08-01T19:54:43.132 INFO:teuthology.orchestra.run.smithi155.stdout: }, 2023-08-01T19:54:43.132 INFO:teuthology.orchestra.run.smithi155.stdout: { 2023-08-01T19:54:43.132 INFO:teuthology.orchestra.run.smithi155.stdout: "event": "all_read", 2023-08-01T19:54:43.132 INFO:teuthology.orchestra.run.smithi155.stdout: "time": "2023-08-01T19:54:34.001620+0000", 2023-08-01T19:54:43.132 INFO:teuthology.orchestra.run.smithi155.stdout: "duration": 6.2751999999999998e-05 2023-08-01T19:54:43.132 INFO:teuthology.orchestra.run.smithi155.stdout: }, 2023-08-01T19:54:43.132 INFO:teuthology.orchestra.run.smithi155.stdout: { 2023-08-01T19:54:43.132 INFO:teuthology.orchestra.run.smithi155.stdout: "event": "dispatched", 2023-08-01T19:54:43.133 INFO:teuthology.orchestra.run.smithi155.stdout: "time": "2023-08-01T19:54:34.001632+0000", 2023-08-01T19:54:43.133 INFO:teuthology.orchestra.run.smithi155.stdout: "duration": 1.1731e-05 2023-08-01T19:54:43.133 INFO:teuthology.orchestra.run.smithi155.stdout: }, 2023-08-01T19:54:43.133 INFO:teuthology.orchestra.run.smithi155.stdout: { 2023-08-01T19:54:43.133 INFO:teuthology.orchestra.run.smithi155.stdout: "event": "queued_for_pg", 2023-08-01T19:54:43.133 INFO:teuthology.orchestra.run.smithi155.stdout: "time": "2023-08-01T19:54:34.001635+0000", 2023-08-01T19:54:43.133 INFO:teuthology.orchestra.run.smithi155.stdout: "duration": 3.7859999999999998e-06 2023-08-01T19:54:43.133 INFO:teuthology.orchestra.run.smithi155.stdout: }, 2023-08-01T19:54:43.134 INFO:teuthology.orchestra.run.smithi155.stdout: { 2023-08-01T19:54:43.134 INFO:teuthology.orchestra.run.smithi155.stdout: "event": "reached_pg", 2023-08-01T19:54:43.134 INFO:teuthology.orchestra.run.smithi155.stdout: "time": "2023-08-01T19:54:34.001688+0000", 2023-08-01T19:54:43.134 INFO:teuthology.orchestra.run.smithi155.stdout: "duration": 5.2899000000000003e-05 2023-08-01T19:54:43.134 INFO:teuthology.orchestra.run.smithi155.stdout: }, 2023-08-01T19:54:43.134 INFO:teuthology.orchestra.run.smithi155.stdout: { 2023-08-01T19:54:43.134 INFO:teuthology.orchestra.run.smithi155.stdout: "event": "started", 2023-08-01T19:54:43.135 INFO:teuthology.orchestra.run.smithi155.stdout: "time": "2023-08-01T19:54:34.001838+0000", 2023-08-01T19:54:43.135 INFO:teuthology.orchestra.run.smithi155.stdout: "duration": 0.00015003999999999999 2023-08-01T19:54:43.135 INFO:teuthology.orchestra.run.smithi155.stdout: }, 2023-08-01T19:54:43.135 INFO:teuthology.orchestra.run.smithi155.stdout: { 2023-08-01T19:54:43.135 INFO:teuthology.orchestra.run.smithi155.stdout: "event": "waiting for subops from 0", 2023-08-01T19:54:43.135 INFO:teuthology.orchestra.run.smithi155.stdout: "time": "2023-08-01T19:54:34.001972+0000", 2023-08-01T19:54:43.135 INFO:teuthology.orchestra.run.smithi155.stdout: "duration": 0.00013333799999999999 2023-08-01T19:54:43.136 INFO:teuthology.orchestra.run.smithi155.stdout: }, 2023-08-01T19:54:43.136 INFO:teuthology.orchestra.run.smithi155.stdout: { 2023-08-01T19:54:43.136 INFO:teuthology.orchestra.run.smithi155.stdout: "event": "sub_op_commit_rec", 2023-08-01T19:54:43.136 INFO:teuthology.orchestra.run.smithi155.stdout: "time": "2023-08-01T19:54:34.005385+0000", 2023-08-01T19:54:43.136 INFO:teuthology.orchestra.run.smithi155.stdout: "duration": 0.003413611 2023-08-01T19:54:43.136 INFO:teuthology.orchestra.run.smithi155.stdout: }, 2023-08-01T19:54:43.136 INFO:teuthology.orchestra.run.smithi155.stdout: { 2023-08-01T19:54:43.136 INFO:teuthology.orchestra.run.smithi155.stdout: "event": "op_commit", 2023-08-01T19:54:43.137 INFO:teuthology.orchestra.run.smithi155.stdout: "time": "2023-08-01T19:54:34.017300+0000", 2023-08-01T19:54:43.137 INFO:teuthology.orchestra.run.smithi155.stdout: "duration": 0.011914645 2023-08-01T19:54:43.137 INFO:teuthology.orchestra.run.smithi155.stdout: }, 2023-08-01T19:54:43.137 INFO:teuthology.orchestra.run.smithi155.stdout: { 2023-08-01T19:54:43.137 INFO:teuthology.orchestra.run.smithi155.stdout: "event": "commit_sent", 2023-08-01T19:54:43.137 INFO:teuthology.orchestra.run.smithi155.stdout: "time": "2023-08-01T19:54:34.017355+0000", 2023-08-01T19:54:43.137 INFO:teuthology.orchestra.run.smithi155.stdout: "duration": 5.5084999999999999e-05 2023-08-01T19:54:43.137 INFO:teuthology.orchestra.run.smithi155.stdout: }, 2023-08-01T19:54:43.138 INFO:teuthology.orchestra.run.smithi155.stdout: { 2023-08-01T19:54:43.138 INFO:teuthology.orchestra.run.smithi155.stdout: "event": "done", 2023-08-01T19:54:43.138 INFO:teuthology.orchestra.run.smithi155.stdout: "time": "2023-08-01T19:54:34.017396+0000", 2023-08-01T19:54:43.138 INFO:teuthology.orchestra.run.smithi155.stdout: "duration": 4.1004999999999998e-05 2023-08-01T19:54:43.138 INFO:teuthology.orchestra.run.smithi155.stdout: } 2023-08-01T19:54:43.138 INFO:teuthology.orchestra.run.smithi155.stdout: ] 2023-08-01T19:54:43.138 INFO:teuthology.orchestra.run.smithi155.stdout: } 2023-08-01T19:54:43.138 INFO:teuthology.orchestra.run.smithi155.stdout: }, 2023-08-01T19:54:43.139 INFO:teuthology.orchestra.run.smithi155.stdout: { 2023-08-01T19:54:43.139 INFO:teuthology.orchestra.run.smithi155.stdout: "description": "osd_op(client.4668.0:33937 5.4 5:20710eb3:::benchmark_data_smithi006_114134_object33936:head [set-alloc-hint object_size 65536 write_size 65536,write 0~65536] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e24)", 2023-08-01T19:54:43.139 INFO:teuthology.orchestra.run.smithi155.stdout: "initiated_at": "2023-08-01T19:54:34.001682+0000", 2023-08-01T19:54:43.139 INFO:teuthology.orchestra.run.smithi155.stdout: "age": 9.1015958870000002, 2023-08-01T19:54:43.139 INFO:teuthology.orchestra.run.smithi155.stdout: "duration": 0.015739876, 2023-08-01T19:54:43.139 INFO:teuthology.orchestra.run.smithi155.stdout: "type_data": { 2023-08-01T19:54:43.139 INFO:teuthology.orchestra.run.smithi155.stdout: "flag_point": "commit sent; apply or cleanup", 2023-08-01T19:54:43.139 INFO:teuthology.orchestra.run.smithi155.stdout: "client_info": { 2023-08-01T19:54:43.140 INFO:teuthology.orchestra.run.smithi155.stdout: "client": "client.4668", 2023-08-01T19:54:43.140 INFO:teuthology.orchestra.run.smithi155.stdout: "client_addr": "172.21.15.6:0/1709472247", 2023-08-01T19:54:43.140 INFO:teuthology.orchestra.run.smithi155.stdout: "tid": 33937 2023-08-01T19:54:43.140 INFO:teuthology.orchestra.run.smithi155.stdout: }, 2023-08-01T19:54:43.140 INFO:teuthology.orchestra.run.smithi155.stdout: "events": [ 2023-08-01T19:54:43.140 INFO:teuthology.orchestra.run.smithi155.stdout: { 2023-08-01T19:54:43.140 INFO:teuthology.orchestra.run.smithi155.stdout: "event": "initiated", 2023-08-01T19:54:43.141 INFO:teuthology.orchestra.run.smithi155.stdout: "time": "2023-08-01T19:54:34.001682+0000", 2023-08-01T19:54:43.141 INFO:teuthology.orchestra.run.smithi155.stdout: "duration": 0 2023-08-01T19:54:43.141 INFO:teuthology.orchestra.run.smithi155.stdout: }, 2023-08-01T19:54:43.141 INFO:teuthology.orchestra.run.smithi155.stdout: { 2023-08-01T19:54:43.141 INFO:teuthology.orchestra.run.smithi155.stdout: "event": "throttled", 2023-08-01T19:54:43.141 INFO:teuthology.orchestra.run.smithi155.stdout: "time": "2023-08-01T19:54:34.001682+0000", 2023-08-01T19:54:43.141 INFO:teuthology.orchestra.run.smithi155.stdout: "duration": 0 2023-08-01T19:54:43.141 INFO:teuthology.orchestra.run.smithi155.stdout: }, 2023-08-01T19:54:43.142 INFO:teuthology.orchestra.run.smithi155.stdout: { 2023-08-01T19:54:43.142 INFO:teuthology.orchestra.run.smithi155.stdout: "event": "header_read", 2023-08-01T19:54:43.142 INFO:teuthology.orchestra.run.smithi155.stdout: "time": "2023-08-01T19:54:34.001681+0000", 2023-08-01T19:54:43.142 INFO:teuthology.orchestra.run.smithi155.stdout: "duration": 4294967295.999999 2023-08-01T19:54:43.142 INFO:teuthology.orchestra.run.smithi155.stdout: }, 2023-08-01T19:54:43.142 INFO:teuthology.orchestra.run.smithi155.stdout: { 2023-08-01T19:54:43.142 INFO:teuthology.orchestra.run.smithi155.stdout: "event": "all_read", 2023-08-01T19:54:43.142 INFO:teuthology.orchestra.run.smithi155.stdout: "time": "2023-08-01T19:54:34.001750+0000", 2023-08-01T19:54:43.143 INFO:teuthology.orchestra.run.smithi155.stdout: "duration": 6.9484000000000001e-05 2023-08-01T19:54:43.143 INFO:teuthology.orchestra.run.smithi155.stdout: }, 2023-08-01T19:54:43.143 INFO:teuthology.orchestra.run.smithi155.stdout: { 2023-08-01T19:54:43.143 INFO:teuthology.orchestra.run.smithi155.stdout: "event": "dispatched", 2023-08-01T19:54:43.143 INFO:teuthology.orchestra.run.smithi155.stdout: "time": "2023-08-01T19:54:34.001759+0000", 2023-08-01T19:54:43.143 INFO:teuthology.orchestra.run.smithi155.stdout: "duration": 8.7260000000000008e-06 2023-08-01T19:54:43.143 INFO:teuthology.orchestra.run.smithi155.stdout: }, 2023-08-01T19:54:43.143 INFO:teuthology.orchestra.run.smithi155.stdout: { 2023-08-01T19:54:43.144 INFO:teuthology.orchestra.run.smithi155.stdout: "event": "queued_for_pg", 2023-08-01T19:54:43.144 INFO:teuthology.orchestra.run.smithi155.stdout: "time": "2023-08-01T19:54:34.001765+0000", 2023-08-01T19:54:43.144 INFO:teuthology.orchestra.run.smithi155.stdout: "duration": 5.5879999999999997e-06 2023-08-01T19:54:43.144 INFO:teuthology.orchestra.run.smithi155.stdout: }, 2023-08-01T19:54:43.144 INFO:teuthology.orchestra.run.smithi155.stdout: { 2023-08-01T19:54:43.144 INFO:teuthology.orchestra.run.smithi155.stdout: "event": "reached_pg", 2023-08-01T19:54:43.144 INFO:teuthology.orchestra.run.smithi155.stdout: "time": "2023-08-01T19:54:34.001809+0000", 2023-08-01T19:54:43.144 INFO:teuthology.orchestra.run.smithi155.stdout: "duration": 4.4818999999999999e-05 2023-08-01T19:54:43.145 INFO:teuthology.orchestra.run.smithi155.stdout: }, 2023-08-01T19:54:43.145 INFO:teuthology.orchestra.run.smithi155.stdout: { 2023-08-01T19:54:43.145 INFO:teuthology.orchestra.run.smithi155.stdout: "event": "started", 2023-08-01T19:54:43.145 INFO:teuthology.orchestra.run.smithi155.stdout: "time": "2023-08-01T19:54:34.001925+0000", 2023-08-01T19:54:43.145 INFO:teuthology.orchestra.run.smithi155.stdout: "duration": 0.000116112 2023-08-01T19:54:43.145 INFO:teuthology.orchestra.run.smithi155.stdout: }, 2023-08-01T19:54:43.145 INFO:teuthology.orchestra.run.smithi155.stdout: { 2023-08-01T19:54:43.145 INFO:teuthology.orchestra.run.smithi155.stdout: "event": "waiting for subops from 0", 2023-08-01T19:54:43.146 INFO:teuthology.orchestra.run.smithi155.stdout: "time": "2023-08-01T19:54:34.002046+0000", 2023-08-01T19:54:43.146 INFO:teuthology.orchestra.run.smithi155.stdout: "duration": 0.000120926 2023-08-01T19:54:43.146 INFO:teuthology.orchestra.run.smithi155.stdout: }, 2023-08-01T19:54:43.146 INFO:teuthology.orchestra.run.smithi155.stdout: { 2023-08-01T19:54:43.146 INFO:teuthology.orchestra.run.smithi155.stdout: "event": "sub_op_commit_rec", 2023-08-01T19:54:43.146 INFO:teuthology.orchestra.run.smithi155.stdout: "time": "2023-08-01T19:54:34.007612+0000", 2023-08-01T19:54:43.146 INFO:teuthology.orchestra.run.smithi155.stdout: "duration": 0.0055658679999999999 2023-08-01T19:54:43.146 INFO:teuthology.orchestra.run.smithi155.stdout: }, 2023-08-01T19:54:43.147 INFO:teuthology.orchestra.run.smithi155.stdout: { 2023-08-01T19:54:43.147 INFO:teuthology.orchestra.run.smithi155.stdout: "event": "op_commit", 2023-08-01T19:54:43.147 INFO:teuthology.orchestra.run.smithi155.stdout: "time": "2023-08-01T19:54:34.017331+0000", 2023-08-01T19:54:43.147 INFO:teuthology.orchestra.run.smithi155.stdout: "duration": 0.0097192330000000007 2023-08-01T19:54:43.147 INFO:teuthology.orchestra.run.smithi155.stdout: }, 2023-08-01T19:54:43.147 INFO:teuthology.orchestra.run.smithi155.stdout: { 2023-08-01T19:54:43.147 INFO:teuthology.orchestra.run.smithi155.stdout: "event": "commit_sent", 2023-08-01T19:54:43.148 INFO:teuthology.orchestra.run.smithi155.stdout: "time": "2023-08-01T19:54:34.017381+0000", 2023-08-01T19:54:43.148 INFO:teuthology.orchestra.run.smithi155.stdout: "duration": 4.9768999999999997e-05 2023-08-01T19:54:43.148 INFO:teuthology.orchestra.run.smithi155.stdout: }, 2023-08-01T19:54:43.148 INFO:teuthology.orchestra.run.smithi155.stdout: { 2023-08-01T19:54:43.148 INFO:teuthology.orchestra.run.smithi155.stdout: "event": "done", 2023-08-01T19:54:43.148 INFO:teuthology.orchestra.run.smithi155.stdout: "time": "2023-08-01T19:54:34.017422+0000", 2023-08-01T19:54:43.148 INFO:teuthology.orchestra.run.smithi155.stdout: "duration": 4.0333000000000002e-05 2023-08-01T19:54:43.148 INFO:teuthology.orchestra.run.smithi155.stdout: } 2023-08-01T19:54:43.149 INFO:teuthology.orchestra.run.smithi155.stdout: ] 2023-08-01T19:54:43.149 INFO:teuthology.orchestra.run.smithi155.stdout: } 2023-08-01T19:54:43.149 INFO:teuthology.orchestra.run.smithi155.stdout: }, 2023-08-01T19:54:43.149 INFO:teuthology.orchestra.run.smithi155.stdout: { 2023-08-01T19:54:43.149 INFO:teuthology.orchestra.run.smithi155.stdout: "description": "osd_repop(client.4668.0:33938 5.f e24/19 5:f86a7015:::benchmark_data_smithi006_114134_object33937:head v 24'2136, mlcod=24'2134)", 2023-08-01T19:54:43.149 INFO:teuthology.orchestra.run.smithi155.stdout: "initiated_at": "2023-08-01T19:54:34.002124+0000", 2023-08-01T19:54:43.149 INFO:teuthology.orchestra.run.smithi155.stdout: "age": 9.1011536589999995, 2023-08-01T19:54:43.149 INFO:teuthology.orchestra.run.smithi155.stdout: "duration": 0.015255919, 2023-08-01T19:54:43.150 INFO:teuthology.orchestra.run.smithi155.stdout: "type_data": { 2023-08-01T19:54:43.150 INFO:teuthology.orchestra.run.smithi155.stdout: "flag_point": "commit sent; apply or cleanup", 2023-08-01T19:54:43.150 INFO:teuthology.orchestra.run.smithi155.stdout: "events": [ 2023-08-01T19:54:43.150 INFO:teuthology.orchestra.run.smithi155.stdout: { 2023-08-01T19:54:43.150 INFO:teuthology.orchestra.run.smithi155.stdout: "event": "initiated", 2023-08-01T19:54:43.150 INFO:teuthology.orchestra.run.smithi155.stdout: "time": "2023-08-01T19:54:34.002124+0000", 2023-08-01T19:54:43.150 INFO:teuthology.orchestra.run.smithi155.stdout: "duration": 0 2023-08-01T19:54:43.150 INFO:teuthology.orchestra.run.smithi155.stdout: }, 2023-08-01T19:54:43.151 INFO:teuthology.orchestra.run.smithi155.stdout: { 2023-08-01T19:54:43.151 INFO:teuthology.orchestra.run.smithi155.stdout: "event": "throttled", 2023-08-01T19:54:43.151 INFO:teuthology.orchestra.run.smithi155.stdout: "time": "2023-08-01T19:54:34.002124+0000", 2023-08-01T19:54:43.151 INFO:teuthology.orchestra.run.smithi155.stdout: "duration": 0 2023-08-01T19:54:43.151 INFO:teuthology.orchestra.run.smithi155.stdout: }, 2023-08-01T19:54:43.151 INFO:teuthology.orchestra.run.smithi155.stdout: { 2023-08-01T19:54:43.151 INFO:teuthology.orchestra.run.smithi155.stdout: "event": "header_read", 2023-08-01T19:54:43.152 INFO:teuthology.orchestra.run.smithi155.stdout: "time": "2023-08-01T19:54:34.002123+0000", 2023-08-01T19:54:43.152 INFO:teuthology.orchestra.run.smithi155.stdout: "duration": 4294967295.9999995 2023-08-01T19:54:43.152 INFO:teuthology.orchestra.run.smithi155.stdout: }, 2023-08-01T19:54:43.152 INFO:teuthology.orchestra.run.smithi155.stdout: { 2023-08-01T19:54:43.152 INFO:teuthology.orchestra.run.smithi155.stdout: "event": "all_read", 2023-08-01T19:54:43.152 INFO:teuthology.orchestra.run.smithi155.stdout: "time": "2023-08-01T19:54:34.002192+0000", 2023-08-01T19:54:43.152 INFO:teuthology.orchestra.run.smithi155.stdout: "duration": 6.8330000000000005e-05 2023-08-01T19:54:43.152 INFO:teuthology.orchestra.run.smithi155.stdout: }, 2023-08-01T19:54:43.153 INFO:teuthology.orchestra.run.smithi155.stdout: { 2023-08-01T19:54:43.153 INFO:teuthology.orchestra.run.smithi155.stdout: "event": "dispatched", 2023-08-01T19:54:43.153 INFO:teuthology.orchestra.run.smithi155.stdout: "time": "2023-08-01T19:54:34.002203+0000", 2023-08-01T19:54:43.153 INFO:teuthology.orchestra.run.smithi155.stdout: "duration": 1.152e-05 2023-08-01T19:54:43.153 INFO:teuthology.orchestra.run.smithi155.stdout: }, 2023-08-01T19:54:43.153 INFO:teuthology.orchestra.run.smithi155.stdout: { 2023-08-01T19:54:43.153 INFO:teuthology.orchestra.run.smithi155.stdout: "event": "queued_for_pg", 2023-08-01T19:54:43.153 INFO:teuthology.orchestra.run.smithi155.stdout: "time": "2023-08-01T19:54:34.002208+0000", 2023-08-01T19:54:43.154 INFO:teuthology.orchestra.run.smithi155.stdout: "duration": 5.2129999999999999e-06 2023-08-01T19:54:43.154 INFO:teuthology.orchestra.run.smithi155.stdout: }, 2023-08-01T19:54:43.154 INFO:teuthology.orchestra.run.smithi155.stdout: { 2023-08-01T19:54:43.154 INFO:teuthology.orchestra.run.smithi155.stdout: "event": "reached_pg", 2023-08-01T19:54:43.154 INFO:teuthology.orchestra.run.smithi155.stdout: "time": "2023-08-01T19:54:34.002256+0000", 2023-08-01T19:54:43.154 INFO:teuthology.orchestra.run.smithi155.stdout: "duration": 4.7939999999999998e-05 2023-08-01T19:54:43.154 INFO:teuthology.orchestra.run.smithi155.stdout: }, 2023-08-01T19:54:43.154 INFO:teuthology.orchestra.run.smithi155.stdout: { 2023-08-01T19:54:43.155 INFO:teuthology.orchestra.run.smithi155.stdout: "event": "started", 2023-08-01T19:54:43.155 INFO:teuthology.orchestra.run.smithi155.stdout: "time": "2023-08-01T19:54:34.002275+0000", 2023-08-01T19:54:43.155 INFO:teuthology.orchestra.run.smithi155.stdout: "duration": 1.8238999999999999e-05 2023-08-01T19:54:43.155 INFO:teuthology.orchestra.run.smithi155.stdout: }, 2023-08-01T19:54:43.155 INFO:teuthology.orchestra.run.smithi155.stdout: { 2023-08-01T19:54:43.155 INFO:teuthology.orchestra.run.smithi155.stdout: "event": "commit_sent", 2023-08-01T19:54:43.155 INFO:teuthology.orchestra.run.smithi155.stdout: "time": "2023-08-01T19:54:34.017345+0000", 2023-08-01T19:54:43.156 INFO:teuthology.orchestra.run.smithi155.stdout: "duration": 0.015070238 2023-08-01T19:54:43.156 INFO:teuthology.orchestra.run.smithi155.stdout: }, 2023-08-01T19:54:43.156 INFO:teuthology.orchestra.run.smithi155.stdout: { 2023-08-01T19:54:43.156 INFO:teuthology.orchestra.run.smithi155.stdout: "event": "done", 2023-08-01T19:54:43.156 INFO:teuthology.orchestra.run.smithi155.stdout: "time": "2023-08-01T19:54:34.017380+0000", 2023-08-01T19:54:43.156 INFO:teuthology.orchestra.run.smithi155.stdout: "duration": 3.5077999999999999e-05 2023-08-01T19:54:43.156 INFO:teuthology.orchestra.run.smithi155.stdout: } 2023-08-01T19:54:43.156 INFO:teuthology.orchestra.run.smithi155.stdout: ] 2023-08-01T19:54:43.157 INFO:teuthology.orchestra.run.smithi155.stdout: } 2023-08-01T19:54:43.157 INFO:teuthology.orchestra.run.smithi155.stdout: }, 2023-08-01T19:54:43.157 INFO:teuthology.orchestra.run.smithi155.stdout: { 2023-08-01T19:54:43.157 INFO:teuthology.orchestra.run.smithi155.stdout: "description": "osd_op(client.4668.0:33939 5.4 5:23f1a7ee:::benchmark_data_smithi006_114134_object33938:head [set-alloc-hint object_size 65536 write_size 65536,write 0~65536] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e24)", 2023-08-01T19:54:43.157 INFO:teuthology.orchestra.run.smithi155.stdout: "initiated_at": "2023-08-01T19:54:34.003553+0000", 2023-08-01T19:54:43.157 INFO:teuthology.orchestra.run.smithi155.stdout: "age": 9.0997249740000008, 2023-08-01T19:54:43.157 INFO:teuthology.orchestra.run.smithi155.stdout: "duration": 0.014610414, 2023-08-01T19:54:43.157 INFO:teuthology.orchestra.run.smithi155.stdout: "type_data": { 2023-08-01T19:54:43.158 INFO:teuthology.orchestra.run.smithi155.stdout: "flag_point": "commit sent; apply or cleanup", 2023-08-01T19:54:43.158 INFO:teuthology.orchestra.run.smithi155.stdout: "client_info": { 2023-08-01T19:54:43.158 INFO:teuthology.orchestra.run.smithi155.stdout: "client": "client.4668", 2023-08-01T19:54:43.158 INFO:teuthology.orchestra.run.smithi155.stdout: "client_addr": "172.21.15.6:0/1709472247", 2023-08-01T19:54:43.158 INFO:teuthology.orchestra.run.smithi155.stdout: "tid": 33939 2023-08-01T19:54:43.158 INFO:teuthology.orchestra.run.smithi155.stdout: }, 2023-08-01T19:54:43.158 INFO:teuthology.orchestra.run.smithi155.stdout: "events": [ 2023-08-01T19:54:43.158 INFO:teuthology.orchestra.run.smithi155.stdout: { 2023-08-01T19:54:43.159 INFO:teuthology.orchestra.run.smithi155.stdout: "event": "initiated", 2023-08-01T19:54:43.159 INFO:teuthology.orchestra.run.smithi155.stdout: "time": "2023-08-01T19:54:34.003553+0000", 2023-08-01T19:54:43.159 INFO:teuthology.orchestra.run.smithi155.stdout: "duration": 0 2023-08-01T19:54:43.159 INFO:teuthology.orchestra.run.smithi155.stdout: }, 2023-08-01T19:54:43.159 INFO:teuthology.orchestra.run.smithi155.stdout: { 2023-08-01T19:54:43.159 INFO:teuthology.orchestra.run.smithi155.stdout: "event": "throttled", 2023-08-01T19:54:43.159 INFO:teuthology.orchestra.run.smithi155.stdout: "time": "2023-08-01T19:54:34.003553+0000", 2023-08-01T19:54:43.160 INFO:teuthology.orchestra.run.smithi155.stdout: "duration": 0 2023-08-01T19:54:43.160 INFO:teuthology.orchestra.run.smithi155.stdout: }, 2023-08-01T19:54:43.160 INFO:teuthology.orchestra.run.smithi155.stdout: { 2023-08-01T19:54:43.160 INFO:teuthology.orchestra.run.smithi155.stdout: "event": "header_read", 2023-08-01T19:54:43.160 INFO:teuthology.orchestra.run.smithi155.stdout: "time": "2023-08-01T19:54:34.003552+0000", 2023-08-01T19:54:43.160 INFO:teuthology.orchestra.run.smithi155.stdout: "duration": 4294967295.999999 2023-08-01T19:54:43.160 INFO:teuthology.orchestra.run.smithi155.stdout: }, 2023-08-01T19:54:43.160 INFO:teuthology.orchestra.run.smithi155.stdout: { 2023-08-01T19:54:43.161 INFO:teuthology.orchestra.run.smithi155.stdout: "event": "all_read", 2023-08-01T19:54:43.161 INFO:teuthology.orchestra.run.smithi155.stdout: "time": "2023-08-01T19:54:34.003577+0000", 2023-08-01T19:54:43.161 INFO:teuthology.orchestra.run.smithi155.stdout: "duration": 2.5179000000000001e-05 2023-08-01T19:54:43.161 INFO:teuthology.orchestra.run.smithi155.stdout: }, 2023-08-01T19:54:43.161 INFO:teuthology.orchestra.run.smithi155.stdout: { 2023-08-01T19:54:43.161 INFO:teuthology.orchestra.run.smithi155.stdout: "event": "dispatched", 2023-08-01T19:54:43.161 INFO:teuthology.orchestra.run.smithi155.stdout: "time": "2023-08-01T19:54:34.003586+0000", 2023-08-01T19:54:43.161 INFO:teuthology.orchestra.run.smithi155.stdout: "duration": 9.1139999999999995e-06 2023-08-01T19:54:43.162 INFO:teuthology.orchestra.run.smithi155.stdout: }, 2023-08-01T19:54:43.162 INFO:teuthology.orchestra.run.smithi155.stdout: { 2023-08-01T19:54:43.162 INFO:teuthology.orchestra.run.smithi155.stdout: "event": "queued_for_pg", 2023-08-01T19:54:43.162 INFO:teuthology.orchestra.run.smithi155.stdout: "time": "2023-08-01T19:54:34.003590+0000", 2023-08-01T19:54:43.162 INFO:teuthology.orchestra.run.smithi155.stdout: "duration": 4.4859999999999999e-06 2023-08-01T19:54:43.162 INFO:teuthology.orchestra.run.smithi155.stdout: }, 2023-08-01T19:54:43.162 INFO:teuthology.orchestra.run.smithi155.stdout: { 2023-08-01T19:54:43.162 INFO:teuthology.orchestra.run.smithi155.stdout: "event": "reached_pg", 2023-08-01T19:54:43.163 INFO:teuthology.orchestra.run.smithi155.stdout: "time": "2023-08-01T19:54:34.003629+0000", 2023-08-01T19:54:43.163 INFO:teuthology.orchestra.run.smithi155.stdout: "duration": 3.8643999999999998e-05 2023-08-01T19:54:43.163 INFO:teuthology.orchestra.run.smithi155.stdout: }, 2023-08-01T19:54:43.163 INFO:teuthology.orchestra.run.smithi155.stdout: { 2023-08-01T19:54:43.163 INFO:teuthology.orchestra.run.smithi155.stdout: "event": "started", 2023-08-01T19:54:43.163 INFO:teuthology.orchestra.run.smithi155.stdout: "time": "2023-08-01T19:54:34.003836+0000", 2023-08-01T19:54:43.163 INFO:teuthology.orchestra.run.smithi155.stdout: "duration": 0.00020656 2023-08-01T19:54:43.163 INFO:teuthology.orchestra.run.smithi155.stdout: }, 2023-08-01T19:54:43.164 INFO:teuthology.orchestra.run.smithi155.stdout: { 2023-08-01T19:54:43.164 INFO:teuthology.orchestra.run.smithi155.stdout: "event": "waiting for subops from 0", 2023-08-01T19:54:43.164 INFO:teuthology.orchestra.run.smithi155.stdout: "time": "2023-08-01T19:54:34.003944+0000", 2023-08-01T19:54:43.164 INFO:teuthology.orchestra.run.smithi155.stdout: "duration": 0.000108674 2023-08-01T19:54:43.164 INFO:teuthology.orchestra.run.smithi155.stdout: }, 2023-08-01T19:54:43.164 INFO:teuthology.orchestra.run.smithi155.stdout: { 2023-08-01T19:54:43.164 INFO:teuthology.orchestra.run.smithi155.stdout: "event": "sub_op_commit_rec", 2023-08-01T19:54:43.165 INFO:teuthology.orchestra.run.smithi155.stdout: "time": "2023-08-01T19:54:34.007654+0000", 2023-08-01T19:54:43.165 INFO:teuthology.orchestra.run.smithi155.stdout: "duration": 0.0037100879999999998 2023-08-01T19:54:43.165 INFO:teuthology.orchestra.run.smithi155.stdout: }, 2023-08-01T19:54:43.165 INFO:teuthology.orchestra.run.smithi155.stdout: { 2023-08-01T19:54:43.165 INFO:teuthology.orchestra.run.smithi155.stdout: "event": "op_commit", 2023-08-01T19:54:43.165 INFO:teuthology.orchestra.run.smithi155.stdout: "time": "2023-08-01T19:54:34.018092+0000", 2023-08-01T19:54:43.165 INFO:teuthology.orchestra.run.smithi155.stdout: "duration": 0.010437366999999999 2023-08-01T19:54:43.165 INFO:teuthology.orchestra.run.smithi155.stdout: }, 2023-08-01T19:54:43.166 INFO:teuthology.orchestra.run.smithi155.stdout: { 2023-08-01T19:54:43.166 INFO:teuthology.orchestra.run.smithi155.stdout: "event": "commit_sent", 2023-08-01T19:54:43.166 INFO:teuthology.orchestra.run.smithi155.stdout: "time": "2023-08-01T19:54:34.018130+0000", 2023-08-01T19:54:43.166 INFO:teuthology.orchestra.run.smithi155.stdout: "duration": 3.8770999999999999e-05 2023-08-01T19:54:43.166 INFO:teuthology.orchestra.run.smithi155.stdout: }, 2023-08-01T19:54:43.166 INFO:teuthology.orchestra.run.smithi155.stdout: { 2023-08-01T19:54:43.166 INFO:teuthology.orchestra.run.smithi155.stdout: "event": "done", 2023-08-01T19:54:43.166 INFO:teuthology.orchestra.run.smithi155.stdout: "time": "2023-08-01T19:54:34.018163+0000", 2023-08-01T19:54:43.167 INFO:teuthology.orchestra.run.smithi155.stdout: "duration": 3.256e-05 2023-08-01T19:54:43.167 INFO:teuthology.orchestra.run.smithi155.stdout: } 2023-08-01T19:54:43.167 INFO:teuthology.orchestra.run.smithi155.stdout: ] 2023-08-01T19:54:43.167 INFO:teuthology.orchestra.run.smithi155.stdout: } 2023-08-01T19:54:43.167 INFO:teuthology.orchestra.run.smithi155.stdout: }, 2023-08-01T19:54:43.167 INFO:teuthology.orchestra.run.smithi155.stdout: { 2023-08-01T19:54:43.167 INFO:teuthology.orchestra.run.smithi155.stdout: "description": "osd_op(client.4668.0:33940 5.d 5:bd606fc2:::benchmark_data_smithi006_114134_object33939:head [set-alloc-hint object_size 65536 write_size 65536,write 0~65536] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e24)", 2023-08-01T19:54:43.167 INFO:teuthology.orchestra.run.smithi155.stdout: "initiated_at": "2023-08-01T19:54:34.003597+0000", 2023-08-01T19:54:43.168 INFO:teuthology.orchestra.run.smithi155.stdout: "age": 9.0996801539999996, 2023-08-01T19:54:43.168 INFO:teuthology.orchestra.run.smithi155.stdout: "duration": 0.014545786999999999, 2023-08-01T19:54:43.168 INFO:teuthology.orchestra.run.smithi155.stdout: "type_data": { 2023-08-01T19:54:43.168 INFO:teuthology.orchestra.run.smithi155.stdout: "flag_point": "commit sent; apply or cleanup", 2023-08-01T19:54:43.168 INFO:teuthology.orchestra.run.smithi155.stdout: "client_info": { 2023-08-01T19:54:43.168 INFO:teuthology.orchestra.run.smithi155.stdout: "client": "client.4668", 2023-08-01T19:54:43.168 INFO:teuthology.orchestra.run.smithi155.stdout: "client_addr": "172.21.15.6:0/1709472247", 2023-08-01T19:54:43.169 INFO:teuthology.orchestra.run.smithi155.stdout: "tid": 33940 2023-08-01T19:54:43.169 INFO:teuthology.orchestra.run.smithi155.stdout: }, 2023-08-01T19:54:43.169 INFO:teuthology.orchestra.run.smithi155.stdout: "events": [ 2023-08-01T19:54:43.169 INFO:teuthology.orchestra.run.smithi155.stdout: { 2023-08-01T19:54:43.169 INFO:teuthology.orchestra.run.smithi155.stdout: "event": "initiated", 2023-08-01T19:54:43.169 INFO:teuthology.orchestra.run.smithi155.stdout: "time": "2023-08-01T19:54:34.003597+0000", 2023-08-01T19:54:43.169 INFO:teuthology.orchestra.run.smithi155.stdout: "duration": 0 2023-08-01T19:54:43.169 INFO:teuthology.orchestra.run.smithi155.stdout: }, 2023-08-01T19:54:43.170 INFO:teuthology.orchestra.run.smithi155.stdout: { 2023-08-01T19:54:43.170 INFO:teuthology.orchestra.run.smithi155.stdout: "event": "throttled", 2023-08-01T19:54:43.170 INFO:teuthology.orchestra.run.smithi155.stdout: "time": "2023-08-01T19:54:34.003597+0000", 2023-08-01T19:54:43.170 INFO:teuthology.orchestra.run.smithi155.stdout: "duration": 0 2023-08-01T19:54:43.170 INFO:teuthology.orchestra.run.smithi155.stdout: }, 2023-08-01T19:54:43.170 INFO:teuthology.orchestra.run.smithi155.stdout: { 2023-08-01T19:54:43.170 INFO:teuthology.orchestra.run.smithi155.stdout: "event": "header_read", 2023-08-01T19:54:43.170 INFO:teuthology.orchestra.run.smithi155.stdout: "time": "2023-08-01T19:54:34.003597+0000", 2023-08-01T19:54:43.171 INFO:teuthology.orchestra.run.smithi155.stdout: "duration": 4294967295.9999995 2023-08-01T19:54:43.171 INFO:teuthology.orchestra.run.smithi155.stdout: }, 2023-08-01T19:54:43.171 INFO:teuthology.orchestra.run.smithi155.stdout: { 2023-08-01T19:54:43.171 INFO:teuthology.orchestra.run.smithi155.stdout: "event": "all_read", 2023-08-01T19:54:43.171 INFO:teuthology.orchestra.run.smithi155.stdout: "time": "2023-08-01T19:54:34.003623+0000", 2023-08-01T19:54:43.171 INFO:teuthology.orchestra.run.smithi155.stdout: "duration": 2.6033e-05 2023-08-01T19:54:43.171 INFO:teuthology.orchestra.run.smithi155.stdout: }, 2023-08-01T19:54:43.171 INFO:teuthology.orchestra.run.smithi155.stdout: { 2023-08-01T19:54:43.172 INFO:teuthology.orchestra.run.smithi155.stdout: "event": "dispatched", 2023-08-01T19:54:43.172 INFO:teuthology.orchestra.run.smithi155.stdout: "time": "2023-08-01T19:54:34.003630+0000", 2023-08-01T19:54:43.172 INFO:teuthology.orchestra.run.smithi155.stdout: "duration": 6.6749999999999996e-06 2023-08-01T19:54:43.172 INFO:teuthology.orchestra.run.smithi155.stdout: }, 2023-08-01T19:54:43.172 INFO:teuthology.orchestra.run.smithi155.stdout: { 2023-08-01T19:54:43.172 INFO:teuthology.orchestra.run.smithi155.stdout: "event": "queued_for_pg", 2023-08-01T19:54:43.172 INFO:teuthology.orchestra.run.smithi155.stdout: "time": "2023-08-01T19:54:34.003635+0000", 2023-08-01T19:54:43.172 INFO:teuthology.orchestra.run.smithi155.stdout: "duration": 5.0239999999999997e-06 2023-08-01T19:54:43.173 INFO:teuthology.orchestra.run.smithi155.stdout: }, 2023-08-01T19:54:43.173 INFO:teuthology.orchestra.run.smithi155.stdout: { 2023-08-01T19:54:43.173 INFO:teuthology.orchestra.run.smithi155.stdout: "event": "reached_pg", 2023-08-01T19:54:43.173 INFO:teuthology.orchestra.run.smithi155.stdout: "time": "2023-08-01T19:54:34.003670+0000", 2023-08-01T19:54:43.173 INFO:teuthology.orchestra.run.smithi155.stdout: "duration": 3.5057e-05 2023-08-01T19:54:43.173 INFO:teuthology.orchestra.run.smithi155.stdout: }, 2023-08-01T19:54:43.173 INFO:teuthology.orchestra.run.smithi155.stdout: { 2023-08-01T19:54:43.174 INFO:teuthology.orchestra.run.smithi155.stdout: "event": "started", 2023-08-01T19:54:43.174 INFO:teuthology.orchestra.run.smithi155.stdout: "time": "2023-08-01T19:54:34.003782+0000", 2023-08-01T19:54:43.174 INFO:teuthology.orchestra.run.smithi155.stdout: "duration": 0.000111851 2023-08-01T19:54:43.174 INFO:teuthology.orchestra.run.smithi155.stdout: }, 2023-08-01T19:54:43.174 INFO:teuthology.orchestra.run.smithi155.stdout: { 2023-08-01T19:54:43.174 INFO:teuthology.orchestra.run.smithi155.stdout: "event": "waiting for subops from 1", 2023-08-01T19:54:43.174 INFO:teuthology.orchestra.run.smithi155.stdout: "time": "2023-08-01T19:54:34.003915+0000", 2023-08-01T19:54:43.174 INFO:teuthology.orchestra.run.smithi155.stdout: "duration": 0.00013387100000000001 2023-08-01T19:54:43.175 INFO:teuthology.orchestra.run.smithi155.stdout: }, 2023-08-01T19:54:43.175 INFO:teuthology.orchestra.run.smithi155.stdout: { 2023-08-01T19:54:43.175 INFO:teuthology.orchestra.run.smithi155.stdout: "event": "sub_op_commit_rec", 2023-08-01T19:54:43.175 INFO:teuthology.orchestra.run.smithi155.stdout: "time": "2023-08-01T19:54:34.008763+0000", 2023-08-01T19:54:43.175 INFO:teuthology.orchestra.run.smithi155.stdout: "duration": 0.0048478389999999996 2023-08-01T19:54:43.175 INFO:teuthology.orchestra.run.smithi155.stdout: }, 2023-08-01T19:54:43.175 INFO:teuthology.orchestra.run.smithi155.stdout: { 2023-08-01T19:54:43.175 INFO:teuthology.orchestra.run.smithi155.stdout: "event": "op_commit", 2023-08-01T19:54:43.176 INFO:teuthology.orchestra.run.smithi155.stdout: "time": "2023-08-01T19:54:34.018067+0000", 2023-08-01T19:54:43.176 INFO:teuthology.orchestra.run.smithi155.stdout: "duration": 0.0093033460000000005 2023-08-01T19:54:43.176 INFO:teuthology.orchestra.run.smithi155.stdout: }, 2023-08-01T19:54:43.176 INFO:teuthology.orchestra.run.smithi155.stdout: { 2023-08-01T19:54:43.176 INFO:teuthology.orchestra.run.smithi155.stdout: "event": "commit_sent", 2023-08-01T19:54:43.176 INFO:teuthology.orchestra.run.smithi155.stdout: "time": "2023-08-01T19:54:34.018107+0000", 2023-08-01T19:54:43.176 INFO:teuthology.orchestra.run.smithi155.stdout: "duration": 3.9901999999999998e-05 2023-08-01T19:54:43.176 INFO:teuthology.orchestra.run.smithi155.stdout: }, 2023-08-01T19:54:43.177 INFO:teuthology.orchestra.run.smithi155.stdout: { 2023-08-01T19:54:43.177 INFO:teuthology.orchestra.run.smithi155.stdout: "event": "done", 2023-08-01T19:54:43.177 INFO:teuthology.orchestra.run.smithi155.stdout: "time": "2023-08-01T19:54:34.018143+0000", 2023-08-01T19:54:43.177 INFO:teuthology.orchestra.run.smithi155.stdout: "duration": 3.6704e-05 2023-08-01T19:54:43.177 INFO:teuthology.orchestra.run.smithi155.stdout: } 2023-08-01T19:54:43.177 INFO:teuthology.orchestra.run.smithi155.stdout: ] 2023-08-01T19:54:43.177 INFO:teuthology.orchestra.run.smithi155.stdout: } 2023-08-01T19:54:43.177 INFO:teuthology.orchestra.run.smithi155.stdout: }, 2023-08-01T19:54:43.178 INFO:teuthology.orchestra.run.smithi155.stdout: { 2023-08-01T19:54:43.178 INFO:teuthology.orchestra.run.smithi155.stdout: "description": "osd_op(client.4668.0:33941 5.4 5:2f172f24:::benchmark_data_smithi006_114134_object33940:head [set-alloc-hint object_size 65536 write_size 65536,write 0~65536] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e24)", 2023-08-01T19:54:43.178 INFO:teuthology.orchestra.run.smithi155.stdout: "initiated_at": "2023-08-01T19:54:34.003680+0000", 2023-08-01T19:54:43.178 INFO:teuthology.orchestra.run.smithi155.stdout: "age": 9.0995973610000007, 2023-08-01T19:54:43.178 INFO:teuthology.orchestra.run.smithi155.stdout: "duration": 0.014562969, 2023-08-01T19:54:43.178 INFO:teuthology.orchestra.run.smithi155.stdout: "type_data": { 2023-08-01T19:54:43.178 INFO:teuthology.orchestra.run.smithi155.stdout: "flag_point": "commit sent; apply or cleanup", 2023-08-01T19:54:43.178 INFO:teuthology.orchestra.run.smithi155.stdout: "client_info": { 2023-08-01T19:54:43.179 INFO:teuthology.orchestra.run.smithi155.stdout: "client": "client.4668", 2023-08-01T19:54:43.179 INFO:teuthology.orchestra.run.smithi155.stdout: "client_addr": "172.21.15.6:0/1709472247", 2023-08-01T19:54:43.179 INFO:teuthology.orchestra.run.smithi155.stdout: "tid": 33941 2023-08-01T19:54:43.179 INFO:teuthology.orchestra.run.smithi155.stdout: }, 2023-08-01T19:54:43.179 INFO:teuthology.orchestra.run.smithi155.stdout: "events": [ 2023-08-01T19:54:43.179 INFO:teuthology.orchestra.run.smithi155.stdout: { 2023-08-01T19:54:43.179 INFO:teuthology.orchestra.run.smithi155.stdout: "event": "initiated", 2023-08-01T19:54:43.180 INFO:teuthology.orchestra.run.smithi155.stdout: "time": "2023-08-01T19:54:34.003680+0000", 2023-08-01T19:54:43.180 INFO:teuthology.orchestra.run.smithi155.stdout: "duration": 0 2023-08-01T19:54:43.180 INFO:teuthology.orchestra.run.smithi155.stdout: }, 2023-08-01T19:54:43.180 INFO:teuthology.orchestra.run.smithi155.stdout: { 2023-08-01T19:54:43.180 INFO:teuthology.orchestra.run.smithi155.stdout: "event": "throttled", 2023-08-01T19:54:43.180 INFO:teuthology.orchestra.run.smithi155.stdout: "time": "2023-08-01T19:54:34.003680+0000", 2023-08-01T19:54:43.180 INFO:teuthology.orchestra.run.smithi155.stdout: "duration": 0 2023-08-01T19:54:43.180 INFO:teuthology.orchestra.run.smithi155.stdout: }, 2023-08-01T19:54:43.181 INFO:teuthology.orchestra.run.smithi155.stdout: { 2023-08-01T19:54:43.181 INFO:teuthology.orchestra.run.smithi155.stdout: "event": "header_read", 2023-08-01T19:54:43.181 INFO:teuthology.orchestra.run.smithi155.stdout: "time": "2023-08-01T19:54:34.003680+0000", 2023-08-01T19:54:43.181 INFO:teuthology.orchestra.run.smithi155.stdout: "duration": 4294967295.999999 2023-08-01T19:54:43.181 INFO:teuthology.orchestra.run.smithi155.stdout: }, 2023-08-01T19:54:43.181 INFO:teuthology.orchestra.run.smithi155.stdout: { 2023-08-01T19:54:43.181 INFO:teuthology.orchestra.run.smithi155.stdout: "event": "all_read", 2023-08-01T19:54:43.181 INFO:teuthology.orchestra.run.smithi155.stdout: "time": "2023-08-01T19:54:34.003767+0000", 2023-08-01T19:54:43.182 INFO:teuthology.orchestra.run.smithi155.stdout: "duration": 8.7289999999999999e-05 2023-08-01T19:54:43.182 INFO:teuthology.orchestra.run.smithi155.stdout: }, 2023-08-01T19:54:43.182 INFO:teuthology.orchestra.run.smithi155.stdout: { 2023-08-01T19:54:43.182 INFO:teuthology.orchestra.run.smithi155.stdout: "event": "dispatched", 2023-08-01T19:54:43.182 INFO:teuthology.orchestra.run.smithi155.stdout: "time": "2023-08-01T19:54:34.003775+0000", 2023-08-01T19:54:43.182 INFO:teuthology.orchestra.run.smithi155.stdout: "duration": 8.6079999999999996e-06 2023-08-01T19:54:43.182 INFO:teuthology.orchestra.run.smithi155.stdout: }, 2023-08-01T19:54:43.183 INFO:teuthology.orchestra.run.smithi155.stdout: { 2023-08-01T19:54:43.183 INFO:teuthology.orchestra.run.smithi155.stdout: "event": "queued_for_pg", 2023-08-01T19:54:43.183 INFO:teuthology.orchestra.run.smithi155.stdout: "time": "2023-08-01T19:54:34.003782+0000", 2023-08-01T19:54:43.183 INFO:teuthology.orchestra.run.smithi155.stdout: "duration": 6.8029999999999999e-06 2023-08-01T19:54:43.183 INFO:teuthology.orchestra.run.smithi155.stdout: }, 2023-08-01T19:54:43.183 INFO:teuthology.orchestra.run.smithi155.stdout: { 2023-08-01T19:54:43.183 INFO:teuthology.orchestra.run.smithi155.stdout: "event": "reached_pg", 2023-08-01T19:54:43.183 INFO:teuthology.orchestra.run.smithi155.stdout: "time": "2023-08-01T19:54:34.005052+0000", 2023-08-01T19:54:43.184 INFO:teuthology.orchestra.run.smithi155.stdout: "duration": 0.0012697170000000001 2023-08-01T19:54:43.184 INFO:teuthology.orchestra.run.smithi155.stdout: }, 2023-08-01T19:54:43.184 INFO:teuthology.orchestra.run.smithi155.stdout: { 2023-08-01T19:54:43.184 INFO:teuthology.orchestra.run.smithi155.stdout: "event": "started", 2023-08-01T19:54:43.184 INFO:teuthology.orchestra.run.smithi155.stdout: "time": "2023-08-01T19:54:34.005188+0000", 2023-08-01T19:54:43.184 INFO:teuthology.orchestra.run.smithi155.stdout: "duration": 0.00013654199999999999 2023-08-01T19:54:43.184 INFO:teuthology.orchestra.run.smithi155.stdout: }, 2023-08-01T19:54:43.184 INFO:teuthology.orchestra.run.smithi155.stdout: { 2023-08-01T19:54:43.185 INFO:teuthology.orchestra.run.smithi155.stdout: "event": "waiting for subops from 0", 2023-08-01T19:54:43.185 INFO:teuthology.orchestra.run.smithi155.stdout: "time": "2023-08-01T19:54:34.005319+0000", 2023-08-01T19:54:43.185 INFO:teuthology.orchestra.run.smithi155.stdout: "duration": 0.000130951 2023-08-01T19:54:43.185 INFO:teuthology.orchestra.run.smithi155.stdout: }, 2023-08-01T19:54:43.185 INFO:teuthology.orchestra.run.smithi155.stdout: { 2023-08-01T19:54:43.185 INFO:teuthology.orchestra.run.smithi155.stdout: "event": "sub_op_commit_rec", 2023-08-01T19:54:43.185 INFO:teuthology.orchestra.run.smithi155.stdout: "time": "2023-08-01T19:54:34.008698+0000", 2023-08-01T19:54:43.186 INFO:teuthology.orchestra.run.smithi155.stdout: "duration": 0.0033787259999999999 2023-08-01T19:54:43.186 INFO:teuthology.orchestra.run.smithi155.stdout: }, 2023-08-01T19:54:43.186 INFO:teuthology.orchestra.run.smithi155.stdout: { 2023-08-01T19:54:43.186 INFO:teuthology.orchestra.run.smithi155.stdout: "event": "op_commit", 2023-08-01T19:54:43.186 INFO:teuthology.orchestra.run.smithi155.stdout: "time": "2023-08-01T19:54:34.018169+0000", 2023-08-01T19:54:43.186 INFO:teuthology.orchestra.run.smithi155.stdout: "duration": 0.0094712749999999995 2023-08-01T19:54:43.186 INFO:teuthology.orchestra.run.smithi155.stdout: }, 2023-08-01T19:54:43.186 INFO:teuthology.orchestra.run.smithi155.stdout: { 2023-08-01T19:54:43.187 INFO:teuthology.orchestra.run.smithi155.stdout: "event": "commit_sent", 2023-08-01T19:54:43.187 INFO:teuthology.orchestra.run.smithi155.stdout: "time": "2023-08-01T19:54:34.018212+0000", 2023-08-01T19:54:43.187 INFO:teuthology.orchestra.run.smithi155.stdout: "duration": 4.2573e-05 2023-08-01T19:54:43.187 INFO:teuthology.orchestra.run.smithi155.stdout: }, 2023-08-01T19:54:43.187 INFO:teuthology.orchestra.run.smithi155.stdout: { 2023-08-01T19:54:43.187 INFO:teuthology.orchestra.run.smithi155.stdout: "event": "done", 2023-08-01T19:54:43.187 INFO:teuthology.orchestra.run.smithi155.stdout: "time": "2023-08-01T19:54:34.018243+0000", 2023-08-01T19:54:43.187 INFO:teuthology.orchestra.run.smithi155.stdout: "duration": 3.1207000000000001e-05 2023-08-01T19:54:43.188 INFO:teuthology.orchestra.run.smithi155.stdout: } 2023-08-01T19:54:43.188 INFO:teuthology.orchestra.run.smithi155.stdout: ] 2023-08-01T19:54:43.188 INFO:teuthology.orchestra.run.smithi155.stdout: } 2023-08-01T19:54:43.188 INFO:teuthology.orchestra.run.smithi155.stdout: }, 2023-08-01T19:54:43.188 INFO:teuthology.orchestra.run.smithi155.stdout: { 2023-08-01T19:54:43.188 INFO:teuthology.orchestra.run.smithi155.stdout: "description": "osd_op(client.4668.0:33943 5.4 5:238a0abd:::benchmark_data_smithi006_114134_object33942:head [set-alloc-hint object_size 65536 write_size 65536,write 0~65536] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e24)", 2023-08-01T19:54:43.188 INFO:teuthology.orchestra.run.smithi155.stdout: "initiated_at": "2023-08-01T19:54:34.003807+0000", 2023-08-01T19:54:43.188 INFO:teuthology.orchestra.run.smithi155.stdout: "age": 9.0994710179999991, 2023-08-01T19:54:43.189 INFO:teuthology.orchestra.run.smithi155.stdout: "duration": 0.014504958, 2023-08-01T19:54:43.189 INFO:teuthology.orchestra.run.smithi155.stdout: "type_data": { 2023-08-01T19:54:43.189 INFO:teuthology.orchestra.run.smithi155.stdout: "flag_point": "commit sent; apply or cleanup", 2023-08-01T19:54:43.189 INFO:teuthology.orchestra.run.smithi155.stdout: "client_info": { 2023-08-01T19:54:43.189 INFO:teuthology.orchestra.run.smithi155.stdout: "client": "client.4668", 2023-08-01T19:54:43.189 INFO:teuthology.orchestra.run.smithi155.stdout: "client_addr": "172.21.15.6:0/1709472247", 2023-08-01T19:54:43.189 INFO:teuthology.orchestra.run.smithi155.stdout: "tid": 33943 2023-08-01T19:54:43.190 INFO:teuthology.orchestra.run.smithi155.stdout: }, 2023-08-01T19:54:43.190 INFO:teuthology.orchestra.run.smithi155.stdout: "events": [ 2023-08-01T19:54:43.190 INFO:teuthology.orchestra.run.smithi155.stdout: { 2023-08-01T19:54:43.190 INFO:teuthology.orchestra.run.smithi155.stdout: "event": "initiated", 2023-08-01T19:54:43.190 INFO:teuthology.orchestra.run.smithi155.stdout: "time": "2023-08-01T19:54:34.003807+0000", 2023-08-01T19:54:43.190 INFO:teuthology.orchestra.run.smithi155.stdout: "duration": 0 2023-08-01T19:54:43.190 INFO:teuthology.orchestra.run.smithi155.stdout: }, 2023-08-01T19:54:43.190 INFO:teuthology.orchestra.run.smithi155.stdout: { 2023-08-01T19:54:43.191 INFO:teuthology.orchestra.run.smithi155.stdout: "event": "throttled", 2023-08-01T19:54:43.191 INFO:teuthology.orchestra.run.smithi155.stdout: "time": "2023-08-01T19:54:34.003807+0000", 2023-08-01T19:54:43.191 INFO:teuthology.orchestra.run.smithi155.stdout: "duration": 0 2023-08-01T19:54:43.191 INFO:teuthology.orchestra.run.smithi155.stdout: }, 2023-08-01T19:54:43.191 INFO:teuthology.orchestra.run.smithi155.stdout: { 2023-08-01T19:54:43.191 INFO:teuthology.orchestra.run.smithi155.stdout: "event": "header_read", 2023-08-01T19:54:43.191 INFO:teuthology.orchestra.run.smithi155.stdout: "time": "2023-08-01T19:54:34.003806+0000", 2023-08-01T19:54:43.191 INFO:teuthology.orchestra.run.smithi155.stdout: "duration": 4294967295.999999 2023-08-01T19:54:43.192 INFO:teuthology.orchestra.run.smithi155.stdout: }, 2023-08-01T19:54:43.192 INFO:teuthology.orchestra.run.smithi155.stdout: { 2023-08-01T19:54:43.192 INFO:teuthology.orchestra.run.smithi155.stdout: "event": "all_read", 2023-08-01T19:54:43.192 INFO:teuthology.orchestra.run.smithi155.stdout: "time": "2023-08-01T19:54:34.003878+0000", 2023-08-01T19:54:43.192 INFO:teuthology.orchestra.run.smithi155.stdout: "duration": 7.2021999999999996e-05 2023-08-01T19:54:43.192 INFO:teuthology.orchestra.run.smithi155.stdout: }, 2023-08-01T19:54:43.192 INFO:teuthology.orchestra.run.smithi155.stdout: { 2023-08-01T19:54:43.193 INFO:teuthology.orchestra.run.smithi155.stdout: "event": "dispatched", 2023-08-01T19:54:43.193 INFO:teuthology.orchestra.run.smithi155.stdout: "time": "2023-08-01T19:54:34.003886+0000", 2023-08-01T19:54:43.193 INFO:teuthology.orchestra.run.smithi155.stdout: "duration": 8.1659999999999994e-06 2023-08-01T19:54:43.193 INFO:teuthology.orchestra.run.smithi155.stdout: }, 2023-08-01T19:54:43.193 INFO:teuthology.orchestra.run.smithi155.stdout: { 2023-08-01T19:54:43.193 INFO:teuthology.orchestra.run.smithi155.stdout: "event": "queued_for_pg", 2023-08-01T19:54:43.193 INFO:teuthology.orchestra.run.smithi155.stdout: "time": "2023-08-01T19:54:34.003892+0000", 2023-08-01T19:54:43.193 INFO:teuthology.orchestra.run.smithi155.stdout: "duration": 5.4609999999999999e-06 2023-08-01T19:54:43.194 INFO:teuthology.orchestra.run.smithi155.stdout: }, 2023-08-01T19:54:43.194 INFO:teuthology.orchestra.run.smithi155.stdout: { 2023-08-01T19:54:43.194 INFO:teuthology.orchestra.run.smithi155.stdout: "event": "reached_pg", 2023-08-01T19:54:43.194 INFO:teuthology.orchestra.run.smithi155.stdout: "time": "2023-08-01T19:54:34.006547+0000", 2023-08-01T19:54:43.194 INFO:teuthology.orchestra.run.smithi155.stdout: "duration": 0.0026551999999999999 2023-08-01T19:54:43.194 INFO:teuthology.orchestra.run.smithi155.stdout: }, 2023-08-01T19:54:43.194 INFO:teuthology.orchestra.run.smithi155.stdout: { 2023-08-01T19:54:43.194 INFO:teuthology.orchestra.run.smithi155.stdout: "event": "started", 2023-08-01T19:54:43.195 INFO:teuthology.orchestra.run.smithi155.stdout: "time": "2023-08-01T19:54:34.006625+0000", 2023-08-01T19:54:43.195 INFO:teuthology.orchestra.run.smithi155.stdout: "duration": 7.8189000000000006e-05 2023-08-01T19:54:43.195 INFO:teuthology.orchestra.run.smithi155.stdout: }, 2023-08-01T19:54:43.195 INFO:teuthology.orchestra.run.smithi155.stdout: { 2023-08-01T19:54:43.195 INFO:teuthology.orchestra.run.smithi155.stdout: "event": "waiting for subops from 0", 2023-08-01T19:54:43.195 INFO:teuthology.orchestra.run.smithi155.stdout: "time": "2023-08-01T19:54:34.006703+0000", 2023-08-01T19:54:43.195 INFO:teuthology.orchestra.run.smithi155.stdout: "duration": 7.8218000000000002e-05 2023-08-01T19:54:43.195 INFO:teuthology.orchestra.run.smithi155.stdout: }, 2023-08-01T19:54:43.196 INFO:teuthology.orchestra.run.smithi155.stdout: { 2023-08-01T19:54:43.196 INFO:teuthology.orchestra.run.smithi155.stdout: "event": "sub_op_commit_rec", 2023-08-01T19:54:43.196 INFO:teuthology.orchestra.run.smithi155.stdout: "time": "2023-08-01T19:54:34.009001+0000", 2023-08-01T19:54:43.196 INFO:teuthology.orchestra.run.smithi155.stdout: "duration": 0.0022976450000000001 2023-08-01T19:54:43.196 INFO:teuthology.orchestra.run.smithi155.stdout: }, 2023-08-01T19:54:43.196 INFO:teuthology.orchestra.run.smithi155.stdout: { 2023-08-01T19:54:43.196 INFO:teuthology.orchestra.run.smithi155.stdout: "event": "op_commit", 2023-08-01T19:54:43.196 INFO:teuthology.orchestra.run.smithi155.stdout: "time": "2023-08-01T19:54:34.018250+0000", 2023-08-01T19:54:43.197 INFO:teuthology.orchestra.run.smithi155.stdout: "duration": 0.0092490539999999996 2023-08-01T19:54:43.197 INFO:teuthology.orchestra.run.smithi155.stdout: }, 2023-08-01T19:54:43.197 INFO:teuthology.orchestra.run.smithi155.stdout: { 2023-08-01T19:54:43.197 INFO:teuthology.orchestra.run.smithi155.stdout: "event": "commit_sent", 2023-08-01T19:54:43.197 INFO:teuthology.orchestra.run.smithi155.stdout: "time": "2023-08-01T19:54:34.018283+0000", 2023-08-01T19:54:43.197 INFO:teuthology.orchestra.run.smithi155.stdout: "duration": 3.3420000000000002e-05 2023-08-01T19:54:43.197 INFO:teuthology.orchestra.run.smithi155.stdout: }, 2023-08-01T19:54:43.198 INFO:teuthology.orchestra.run.smithi155.stdout: { 2023-08-01T19:54:43.198 INFO:teuthology.orchestra.run.smithi155.stdout: "event": "done", 2023-08-01T19:54:43.198 INFO:teuthology.orchestra.run.smithi155.stdout: "time": "2023-08-01T19:54:34.018312+0000", 2023-08-01T19:54:43.198 INFO:teuthology.orchestra.run.smithi155.stdout: "duration": 2.8311e-05 2023-08-01T19:54:43.198 INFO:teuthology.orchestra.run.smithi155.stdout: } 2023-08-01T19:54:43.198 INFO:teuthology.orchestra.run.smithi155.stdout: ] 2023-08-01T19:54:43.198 INFO:teuthology.orchestra.run.smithi155.stdout: } 2023-08-01T19:54:43.198 INFO:teuthology.orchestra.run.smithi155.stdout: }, 2023-08-01T19:54:43.199 INFO:teuthology.orchestra.run.smithi155.stdout: { 2023-08-01T19:54:43.199 INFO:teuthology.orchestra.run.smithi155.stdout: "description": "osd_repop(client.4668.0:33942 5.f e24/19 5:f8c58476:::benchmark_data_smithi006_114134_object33941:head v 24'2137, mlcod=24'2134)", 2023-08-01T19:54:43.199 INFO:teuthology.orchestra.run.smithi155.stdout: "initiated_at": "2023-08-01T19:54:34.004098+0000", 2023-08-01T19:54:43.199 INFO:teuthology.orchestra.run.smithi155.stdout: "age": 9.0991796189999992, 2023-08-01T19:54:43.199 INFO:teuthology.orchestra.run.smithi155.stdout: "duration": 0.01403224, 2023-08-01T19:54:43.199 INFO:teuthology.orchestra.run.smithi155.stdout: "type_data": { 2023-08-01T19:54:43.199 INFO:teuthology.orchestra.run.smithi155.stdout: "flag_point": "commit sent; apply or cleanup", 2023-08-01T19:54:43.199 INFO:teuthology.orchestra.run.smithi155.stdout: "events": [ 2023-08-01T19:54:43.200 INFO:teuthology.orchestra.run.smithi155.stdout: { 2023-08-01T19:54:43.200 INFO:teuthology.orchestra.run.smithi155.stdout: "event": "initiated", 2023-08-01T19:54:43.200 INFO:teuthology.orchestra.run.smithi155.stdout: "time": "2023-08-01T19:54:34.004098+0000", 2023-08-01T19:54:43.200 INFO:teuthology.orchestra.run.smithi155.stdout: "duration": 0 2023-08-01T19:54:43.200 INFO:teuthology.orchestra.run.smithi155.stdout: }, 2023-08-01T19:54:43.200 INFO:teuthology.orchestra.run.smithi155.stdout: { 2023-08-01T19:54:43.200 INFO:teuthology.orchestra.run.smithi155.stdout: "event": "throttled", 2023-08-01T19:54:43.200 INFO:teuthology.orchestra.run.smithi155.stdout: "time": "2023-08-01T19:54:34.004098+0000", 2023-08-01T19:54:43.201 INFO:teuthology.orchestra.run.smithi155.stdout: "duration": 0 2023-08-01T19:54:43.201 INFO:teuthology.orchestra.run.smithi155.stdout: }, 2023-08-01T19:54:43.201 INFO:teuthology.orchestra.run.smithi155.stdout: { 2023-08-01T19:54:43.201 INFO:teuthology.orchestra.run.smithi155.stdout: "event": "header_read", 2023-08-01T19:54:43.201 INFO:teuthology.orchestra.run.smithi155.stdout: "time": "2023-08-01T19:54:34.004097+0000", 2023-08-01T19:54:43.201 INFO:teuthology.orchestra.run.smithi155.stdout: "duration": 4294967295.9999995 2023-08-01T19:54:43.201 INFO:teuthology.orchestra.run.smithi155.stdout: }, 2023-08-01T19:54:43.201 INFO:teuthology.orchestra.run.smithi155.stdout: { 2023-08-01T19:54:43.202 INFO:teuthology.orchestra.run.smithi155.stdout: "event": "all_read", 2023-08-01T19:54:43.202 INFO:teuthology.orchestra.run.smithi155.stdout: "time": "2023-08-01T19:54:34.004151+0000", 2023-08-01T19:54:43.202 INFO:teuthology.orchestra.run.smithi155.stdout: "duration": 5.3934999999999998e-05 2023-08-01T19:54:43.202 INFO:teuthology.orchestra.run.smithi155.stdout: }, 2023-08-01T19:54:43.202 INFO:teuthology.orchestra.run.smithi155.stdout: { 2023-08-01T19:54:43.202 INFO:teuthology.orchestra.run.smithi155.stdout: "event": "dispatched", 2023-08-01T19:54:43.202 INFO:teuthology.orchestra.run.smithi155.stdout: "time": "2023-08-01T19:54:34.004163+0000", 2023-08-01T19:54:43.202 INFO:teuthology.orchestra.run.smithi155.stdout: "duration": 1.1844999999999999e-05 2023-08-01T19:54:43.203 INFO:teuthology.orchestra.run.smithi155.stdout: }, 2023-08-01T19:54:43.203 INFO:teuthology.orchestra.run.smithi155.stdout: { 2023-08-01T19:54:43.203 INFO:teuthology.orchestra.run.smithi155.stdout: "event": "queued_for_pg", 2023-08-01T19:54:43.203 INFO:teuthology.orchestra.run.smithi155.stdout: "time": "2023-08-01T19:54:34.004168+0000", 2023-08-01T19:54:43.203 INFO:teuthology.orchestra.run.smithi155.stdout: "duration": 4.8489999999999997e-06 2023-08-01T19:54:43.203 INFO:teuthology.orchestra.run.smithi155.stdout: }, 2023-08-01T19:54:43.203 INFO:teuthology.orchestra.run.smithi155.stdout: { 2023-08-01T19:54:43.204 INFO:teuthology.orchestra.run.smithi155.stdout: "event": "reached_pg", 2023-08-01T19:54:43.204 INFO:teuthology.orchestra.run.smithi155.stdout: "time": "2023-08-01T19:54:34.004213+0000", 2023-08-01T19:54:43.204 INFO:teuthology.orchestra.run.smithi155.stdout: "duration": 4.5037000000000003e-05 2023-08-01T19:54:43.204 INFO:teuthology.orchestra.run.smithi155.stdout: }, 2023-08-01T19:54:43.204 INFO:teuthology.orchestra.run.smithi155.stdout: { 2023-08-01T19:54:43.204 INFO:teuthology.orchestra.run.smithi155.stdout: "event": "started", 2023-08-01T19:54:43.204 INFO:teuthology.orchestra.run.smithi155.stdout: "time": "2023-08-01T19:54:34.004235+0000", 2023-08-01T19:54:43.204 INFO:teuthology.orchestra.run.smithi155.stdout: "duration": 2.2342999999999999e-05 2023-08-01T19:54:43.205 INFO:teuthology.orchestra.run.smithi155.stdout: }, 2023-08-01T19:54:43.205 INFO:teuthology.orchestra.run.smithi155.stdout: { 2023-08-01T19:54:43.205 INFO:teuthology.orchestra.run.smithi155.stdout: "event": "commit_sent", 2023-08-01T19:54:43.205 INFO:teuthology.orchestra.run.smithi155.stdout: "time": "2023-08-01T19:54:34.018100+0000", 2023-08-01T19:54:43.205 INFO:teuthology.orchestra.run.smithi155.stdout: "duration": 0.013864359 2023-08-01T19:54:43.205 INFO:teuthology.orchestra.run.smithi155.stdout: }, 2023-08-01T19:54:43.205 INFO:teuthology.orchestra.run.smithi155.stdout: { 2023-08-01T19:54:43.205 INFO:teuthology.orchestra.run.smithi155.stdout: "event": "done", 2023-08-01T19:54:43.206 INFO:teuthology.orchestra.run.smithi155.stdout: "time": "2023-08-01T19:54:34.018130+0000", 2023-08-01T19:54:43.206 INFO:teuthology.orchestra.run.smithi155.stdout: "duration": 3.0514e-05 2023-08-01T19:54:43.206 INFO:teuthology.orchestra.run.smithi155.stdout: } 2023-08-01T19:54:43.206 INFO:teuthology.orchestra.run.smithi155.stdout: ] 2023-08-01T19:54:43.206 INFO:teuthology.orchestra.run.smithi155.stdout: } 2023-08-01T19:54:43.206 INFO:teuthology.orchestra.run.smithi155.stdout: }, 2023-08-01T19:54:43.206 INFO:teuthology.orchestra.run.smithi155.stdout: { 2023-08-01T19:54:43.206 INFO:teuthology.orchestra.run.smithi155.stdout: "description": "osd_op(client.4668.0:41366 5.b 5:d8db1792:::benchmark_data_smithi006_114134_object41365:head [set-alloc-hint object_size 65536 write_size 65536,write 0~65536] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e25)", 2023-08-01T19:54:43.207 INFO:teuthology.orchestra.run.smithi155.stdout: "initiated_at": "2023-08-01T19:54:36.749152+0000", 2023-08-01T19:54:43.207 INFO:teuthology.orchestra.run.smithi155.stdout: "age": 6.3541258110000003, 2023-08-01T19:54:43.207 INFO:teuthology.orchestra.run.smithi155.stdout: "duration": 0.014481499, 2023-08-01T19:54:43.207 INFO:teuthology.orchestra.run.smithi155.stdout: "type_data": { 2023-08-01T19:54:43.207 INFO:teuthology.orchestra.run.smithi155.stdout: "flag_point": "commit sent; apply or cleanup", 2023-08-01T19:54:43.207 INFO:teuthology.orchestra.run.smithi155.stdout: "client_info": { 2023-08-01T19:54:43.208 INFO:teuthology.orchestra.run.smithi155.stdout: "client": "client.4668", 2023-08-01T19:54:43.208 INFO:teuthology.orchestra.run.smithi155.stdout: "client_addr": "172.21.15.6:0/1709472247", 2023-08-01T19:54:43.208 INFO:teuthology.orchestra.run.smithi155.stdout: "tid": 41366 2023-08-01T19:54:43.208 INFO:teuthology.orchestra.run.smithi155.stdout: }, 2023-08-01T19:54:43.208 INFO:teuthology.orchestra.run.smithi155.stdout: "events": [ 2023-08-01T19:54:43.208 INFO:teuthology.orchestra.run.smithi155.stdout: { 2023-08-01T19:54:43.208 INFO:teuthology.orchestra.run.smithi155.stdout: "event": "initiated", 2023-08-01T19:54:43.208 INFO:teuthology.orchestra.run.smithi155.stdout: "time": "2023-08-01T19:54:36.749152+0000", 2023-08-01T19:54:43.209 INFO:teuthology.orchestra.run.smithi155.stdout: "duration": 0 2023-08-01T19:54:43.209 INFO:teuthology.orchestra.run.smithi155.stdout: }, 2023-08-01T19:54:43.209 INFO:teuthology.orchestra.run.smithi155.stdout: { 2023-08-01T19:54:43.209 INFO:teuthology.orchestra.run.smithi155.stdout: "event": "throttled", 2023-08-01T19:54:43.209 INFO:teuthology.orchestra.run.smithi155.stdout: "time": "2023-08-01T19:54:36.749152+0000", 2023-08-01T19:54:43.209 INFO:teuthology.orchestra.run.smithi155.stdout: "duration": 0 2023-08-01T19:54:43.209 INFO:teuthology.orchestra.run.smithi155.stdout: }, 2023-08-01T19:54:43.209 INFO:teuthology.orchestra.run.smithi155.stdout: { 2023-08-01T19:54:43.210 INFO:teuthology.orchestra.run.smithi155.stdout: "event": "header_read", 2023-08-01T19:54:43.210 INFO:teuthology.orchestra.run.smithi155.stdout: "time": "2023-08-01T19:54:36.749151+0000", 2023-08-01T19:54:43.210 INFO:teuthology.orchestra.run.smithi155.stdout: "duration": 4294967295.9999995 2023-08-01T19:54:43.210 INFO:teuthology.orchestra.run.smithi155.stdout: }, 2023-08-01T19:54:43.210 INFO:teuthology.orchestra.run.smithi155.stdout: { 2023-08-01T19:54:43.210 INFO:teuthology.orchestra.run.smithi155.stdout: "event": "all_read", 2023-08-01T19:54:43.210 INFO:teuthology.orchestra.run.smithi155.stdout: "time": "2023-08-01T19:54:36.749216+0000", 2023-08-01T19:54:43.210 INFO:teuthology.orchestra.run.smithi155.stdout: "duration": 6.4838000000000005e-05 2023-08-01T19:54:43.211 INFO:teuthology.orchestra.run.smithi155.stdout: }, 2023-08-01T19:54:43.211 INFO:teuthology.orchestra.run.smithi155.stdout: { 2023-08-01T19:54:43.211 INFO:teuthology.orchestra.run.smithi155.stdout: "event": "dispatched", 2023-08-01T19:54:43.211 INFO:teuthology.orchestra.run.smithi155.stdout: "time": "2023-08-01T19:54:36.749225+0000", 2023-08-01T19:54:43.211 INFO:teuthology.orchestra.run.smithi155.stdout: "duration": 8.8079999999999994e-06 2023-08-01T19:54:43.211 INFO:teuthology.orchestra.run.smithi155.stdout: }, 2023-08-01T19:54:43.211 INFO:teuthology.orchestra.run.smithi155.stdout: { 2023-08-01T19:54:43.212 INFO:teuthology.orchestra.run.smithi155.stdout: "event": "queued_for_pg", 2023-08-01T19:54:43.212 INFO:teuthology.orchestra.run.smithi155.stdout: "time": "2023-08-01T19:54:36.749231+0000", 2023-08-01T19:54:43.212 INFO:teuthology.orchestra.run.smithi155.stdout: "duration": 6.443e-06 2023-08-01T19:54:43.212 INFO:teuthology.orchestra.run.smithi155.stdout: }, 2023-08-01T19:54:43.212 INFO:teuthology.orchestra.run.smithi155.stdout: { 2023-08-01T19:54:43.212 INFO:teuthology.orchestra.run.smithi155.stdout: "event": "reached_pg", 2023-08-01T19:54:43.212 INFO:teuthology.orchestra.run.smithi155.stdout: "time": "2023-08-01T19:54:36.750813+0000", 2023-08-01T19:54:43.212 INFO:teuthology.orchestra.run.smithi155.stdout: "duration": 0.0015817590000000001 2023-08-01T19:54:43.213 INFO:teuthology.orchestra.run.smithi155.stdout: }, 2023-08-01T19:54:43.213 INFO:teuthology.orchestra.run.smithi155.stdout: { 2023-08-01T19:54:43.213 INFO:teuthology.orchestra.run.smithi155.stdout: "event": "started", 2023-08-01T19:54:43.213 INFO:teuthology.orchestra.run.smithi155.stdout: "time": "2023-08-01T19:54:36.750961+0000", 2023-08-01T19:54:43.213 INFO:teuthology.orchestra.run.smithi155.stdout: "duration": 0.00014760399999999999 2023-08-01T19:54:43.213 INFO:teuthology.orchestra.run.smithi155.stdout: }, 2023-08-01T19:54:43.213 INFO:teuthology.orchestra.run.smithi155.stdout: { 2023-08-01T19:54:43.213 INFO:teuthology.orchestra.run.smithi155.stdout: "event": "waiting for subops from 0", 2023-08-01T19:54:43.214 INFO:teuthology.orchestra.run.smithi155.stdout: "time": "2023-08-01T19:54:36.751098+0000", 2023-08-01T19:54:43.214 INFO:teuthology.orchestra.run.smithi155.stdout: "duration": 0.00013760000000000001 2023-08-01T19:54:43.214 INFO:teuthology.orchestra.run.smithi155.stdout: }, 2023-08-01T19:54:43.214 INFO:teuthology.orchestra.run.smithi155.stdout: { 2023-08-01T19:54:43.214 INFO:teuthology.orchestra.run.smithi155.stdout: "event": "sub_op_commit_rec", 2023-08-01T19:54:43.214 INFO:teuthology.orchestra.run.smithi155.stdout: "time": "2023-08-01T19:54:36.757464+0000", 2023-08-01T19:54:43.214 INFO:teuthology.orchestra.run.smithi155.stdout: "duration": 0.0063655830000000002 2023-08-01T19:54:43.214 INFO:teuthology.orchestra.run.smithi155.stdout: }, 2023-08-01T19:54:43.215 INFO:teuthology.orchestra.run.smithi155.stdout: { 2023-08-01T19:54:43.215 INFO:teuthology.orchestra.run.smithi155.stdout: "event": "op_commit", 2023-08-01T19:54:43.215 INFO:teuthology.orchestra.run.smithi155.stdout: "time": "2023-08-01T19:54:36.763551+0000", 2023-08-01T19:54:43.215 INFO:teuthology.orchestra.run.smithi155.stdout: "duration": 0.0060876200000000002 2023-08-01T19:54:43.215 INFO:teuthology.orchestra.run.smithi155.stdout: }, 2023-08-01T19:54:43.215 INFO:teuthology.orchestra.run.smithi155.stdout: { 2023-08-01T19:54:43.215 INFO:teuthology.orchestra.run.smithi155.stdout: "event": "commit_sent", 2023-08-01T19:54:43.215 INFO:teuthology.orchestra.run.smithi155.stdout: "time": "2023-08-01T19:54:36.763597+0000", 2023-08-01T19:54:43.216 INFO:teuthology.orchestra.run.smithi155.stdout: "duration": 4.5445000000000003e-05 2023-08-01T19:54:43.216 INFO:teuthology.orchestra.run.smithi155.stdout: }, 2023-08-01T19:54:43.216 INFO:teuthology.orchestra.run.smithi155.stdout: { 2023-08-01T19:54:43.216 INFO:teuthology.orchestra.run.smithi155.stdout: "event": "done", 2023-08-01T19:54:43.216 INFO:teuthology.orchestra.run.smithi155.stdout: "time": "2023-08-01T19:54:36.763633+0000", 2023-08-01T19:54:43.216 INFO:teuthology.orchestra.run.smithi155.stdout: "duration": 3.6375999999999999e-05 2023-08-01T19:54:43.216 INFO:teuthology.orchestra.run.smithi155.stdout: } 2023-08-01T19:54:43.217 INFO:teuthology.orchestra.run.smithi155.stdout: ] 2023-08-01T19:54:43.217 INFO:teuthology.orchestra.run.smithi155.stdout: } 2023-08-01T19:54:43.217 INFO:teuthology.orchestra.run.smithi155.stdout: }, 2023-08-01T19:54:43.217 INFO:teuthology.orchestra.run.smithi155.stdout: { 2023-08-01T19:54:43.217 INFO:teuthology.orchestra.run.smithi155.stdout: "description": "osd_op(client.4668.0:41367 5.b 5:da1e8556:::benchmark_data_smithi006_114134_object41366:head [set-alloc-hint object_size 65536 write_size 65536,write 0~65536] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e25)", 2023-08-01T19:54:43.217 INFO:teuthology.orchestra.run.smithi155.stdout: "initiated_at": "2023-08-01T19:54:36.750163+0000", 2023-08-01T19:54:43.217 INFO:teuthology.orchestra.run.smithi155.stdout: "age": 6.3531143569999999, 2023-08-01T19:54:43.217 INFO:teuthology.orchestra.run.smithi155.stdout: "duration": 0.013558926000000001, 2023-08-01T19:54:43.218 INFO:teuthology.orchestra.run.smithi155.stdout: "type_data": { 2023-08-01T19:54:43.218 INFO:teuthology.orchestra.run.smithi155.stdout: "flag_point": "commit sent; apply or cleanup", 2023-08-01T19:54:43.218 INFO:teuthology.orchestra.run.smithi155.stdout: "client_info": { 2023-08-01T19:54:43.218 INFO:teuthology.orchestra.run.smithi155.stdout: "client": "client.4668", 2023-08-01T19:54:43.218 INFO:teuthology.orchestra.run.smithi155.stdout: "client_addr": "172.21.15.6:0/1709472247", 2023-08-01T19:54:43.218 INFO:teuthology.orchestra.run.smithi155.stdout: "tid": 41367 2023-08-01T19:54:43.218 INFO:teuthology.orchestra.run.smithi155.stdout: }, 2023-08-01T19:54:43.218 INFO:teuthology.orchestra.run.smithi155.stdout: "events": [ 2023-08-01T19:54:43.219 INFO:teuthology.orchestra.run.smithi155.stdout: { 2023-08-01T19:54:43.219 INFO:teuthology.orchestra.run.smithi155.stdout: "event": "initiated", 2023-08-01T19:54:43.219 INFO:teuthology.orchestra.run.smithi155.stdout: "time": "2023-08-01T19:54:36.750163+0000", 2023-08-01T19:54:43.219 INFO:teuthology.orchestra.run.smithi155.stdout: "duration": 0 2023-08-01T19:54:43.219 INFO:teuthology.orchestra.run.smithi155.stdout: }, 2023-08-01T19:54:43.219 INFO:teuthology.orchestra.run.smithi155.stdout: { 2023-08-01T19:54:43.219 INFO:teuthology.orchestra.run.smithi155.stdout: "event": "throttled", 2023-08-01T19:54:43.219 INFO:teuthology.orchestra.run.smithi155.stdout: "time": "2023-08-01T19:54:36.750163+0000", 2023-08-01T19:54:43.220 INFO:teuthology.orchestra.run.smithi155.stdout: "duration": 0 2023-08-01T19:54:43.220 INFO:teuthology.orchestra.run.smithi155.stdout: }, 2023-08-01T19:54:43.220 INFO:teuthology.orchestra.run.smithi155.stdout: { 2023-08-01T19:54:43.220 INFO:teuthology.orchestra.run.smithi155.stdout: "event": "header_read", 2023-08-01T19:54:43.220 INFO:teuthology.orchestra.run.smithi155.stdout: "time": "2023-08-01T19:54:36.750162+0000", 2023-08-01T19:54:43.220 INFO:teuthology.orchestra.run.smithi155.stdout: "duration": 4294967295.9999986 2023-08-01T19:54:43.220 INFO:teuthology.orchestra.run.smithi155.stdout: }, 2023-08-01T19:54:43.221 INFO:teuthology.orchestra.run.smithi155.stdout: { 2023-08-01T19:54:43.221 INFO:teuthology.orchestra.run.smithi155.stdout: "event": "all_read", 2023-08-01T19:54:43.221 INFO:teuthology.orchestra.run.smithi155.stdout: "time": "2023-08-01T19:54:36.750250+0000", 2023-08-01T19:54:43.221 INFO:teuthology.orchestra.run.smithi155.stdout: "duration": 8.7874000000000006e-05 2023-08-01T19:54:43.221 INFO:teuthology.orchestra.run.smithi155.stdout: }, 2023-08-01T19:54:43.221 INFO:teuthology.orchestra.run.smithi155.stdout: { 2023-08-01T19:54:43.221 INFO:teuthology.orchestra.run.smithi155.stdout: "event": "dispatched", 2023-08-01T19:54:43.221 INFO:teuthology.orchestra.run.smithi155.stdout: "time": "2023-08-01T19:54:36.750272+0000", 2023-08-01T19:54:43.222 INFO:teuthology.orchestra.run.smithi155.stdout: "duration": 2.2504e-05 2023-08-01T19:54:43.222 INFO:teuthology.orchestra.run.smithi155.stdout: }, 2023-08-01T19:54:43.222 INFO:teuthology.orchestra.run.smithi155.stdout: { 2023-08-01T19:54:43.222 INFO:teuthology.orchestra.run.smithi155.stdout: "event": "queued_for_pg", 2023-08-01T19:54:43.222 INFO:teuthology.orchestra.run.smithi155.stdout: "time": "2023-08-01T19:54:36.750281+0000", 2023-08-01T19:54:43.222 INFO:teuthology.orchestra.run.smithi155.stdout: "duration": 8.6130000000000004e-06 2023-08-01T19:54:43.222 INFO:teuthology.orchestra.run.smithi155.stdout: }, 2023-08-01T19:54:43.222 INFO:teuthology.orchestra.run.smithi155.stdout: { 2023-08-01T19:54:43.223 INFO:teuthology.orchestra.run.smithi155.stdout: "event": "reached_pg", 2023-08-01T19:54:43.223 INFO:teuthology.orchestra.run.smithi155.stdout: "time": "2023-08-01T19:54:36.754166+0000", 2023-08-01T19:54:43.223 INFO:teuthology.orchestra.run.smithi155.stdout: "duration": 0.0038847560000000001 2023-08-01T19:54:43.223 INFO:teuthology.orchestra.run.smithi155.stdout: }, 2023-08-01T19:54:43.223 INFO:teuthology.orchestra.run.smithi155.stdout: { 2023-08-01T19:54:43.223 INFO:teuthology.orchestra.run.smithi155.stdout: "event": "started", 2023-08-01T19:54:43.223 INFO:teuthology.orchestra.run.smithi155.stdout: "time": "2023-08-01T19:54:36.754291+0000", 2023-08-01T19:54:43.223 INFO:teuthology.orchestra.run.smithi155.stdout: "duration": 0.00012498199999999999 2023-08-01T19:54:43.224 INFO:teuthology.orchestra.run.smithi155.stdout: }, 2023-08-01T19:54:43.224 INFO:teuthology.orchestra.run.smithi155.stdout: { 2023-08-01T19:54:43.224 INFO:teuthology.orchestra.run.smithi155.stdout: "event": "waiting for subops from 0", 2023-08-01T19:54:43.224 INFO:teuthology.orchestra.run.smithi155.stdout: "time": "2023-08-01T19:54:36.754423+0000", 2023-08-01T19:54:43.224 INFO:teuthology.orchestra.run.smithi155.stdout: "duration": 0.00013278399999999999 2023-08-01T19:54:43.224 INFO:teuthology.orchestra.run.smithi155.stdout: }, 2023-08-01T19:54:43.224 INFO:teuthology.orchestra.run.smithi155.stdout: { 2023-08-01T19:54:43.224 INFO:teuthology.orchestra.run.smithi155.stdout: "event": "sub_op_commit_rec", 2023-08-01T19:54:43.225 INFO:teuthology.orchestra.run.smithi155.stdout: "time": "2023-08-01T19:54:36.757586+0000", 2023-08-01T19:54:43.225 INFO:teuthology.orchestra.run.smithi155.stdout: "duration": 0.0031625640000000001 2023-08-01T19:54:43.225 INFO:teuthology.orchestra.run.smithi155.stdout: }, 2023-08-01T19:54:43.225 INFO:teuthology.orchestra.run.smithi155.stdout: { 2023-08-01T19:54:43.225 INFO:teuthology.orchestra.run.smithi155.stdout: "event": "op_commit", 2023-08-01T19:54:43.225 INFO:teuthology.orchestra.run.smithi155.stdout: "time": "2023-08-01T19:54:36.763642+0000", 2023-08-01T19:54:43.225 INFO:teuthology.orchestra.run.smithi155.stdout: "duration": 0.0060560709999999997 2023-08-01T19:54:43.225 INFO:teuthology.orchestra.run.smithi155.stdout: }, 2023-08-01T19:54:43.226 INFO:teuthology.orchestra.run.smithi155.stdout: { 2023-08-01T19:54:43.226 INFO:teuthology.orchestra.run.smithi155.stdout: "event": "commit_sent", 2023-08-01T19:54:43.226 INFO:teuthology.orchestra.run.smithi155.stdout: "time": "2023-08-01T19:54:36.763684+0000", 2023-08-01T19:54:43.226 INFO:teuthology.orchestra.run.smithi155.stdout: "duration": 4.2234999999999998e-05 2023-08-01T19:54:43.226 INFO:teuthology.orchestra.run.smithi155.stdout: }, 2023-08-01T19:54:43.226 INFO:teuthology.orchestra.run.smithi155.stdout: { 2023-08-01T19:54:43.226 INFO:teuthology.orchestra.run.smithi155.stdout: "event": "done", 2023-08-01T19:54:43.226 INFO:teuthology.orchestra.run.smithi155.stdout: "time": "2023-08-01T19:54:36.763722+0000", 2023-08-01T19:54:43.227 INFO:teuthology.orchestra.run.smithi155.stdout: "duration": 3.7895999999999998e-05 2023-08-01T19:54:43.227 INFO:teuthology.orchestra.run.smithi155.stdout: } 2023-08-01T19:54:43.227 INFO:teuthology.orchestra.run.smithi155.stdout: ] 2023-08-01T19:54:43.227 INFO:teuthology.orchestra.run.smithi155.stdout: } 2023-08-01T19:54:43.227 INFO:teuthology.orchestra.run.smithi155.stdout: }, 2023-08-01T19:54:43.227 INFO:teuthology.orchestra.run.smithi155.stdout: { 2023-08-01T19:54:43.227 INFO:teuthology.orchestra.run.smithi155.stdout: "description": "osd_op(client.4668.0:41593 5.e 5:7fec635f:::benchmark_data_smithi006_114134_object41592:head [set-alloc-hint object_size 65536 write_size 65536,write 0~65536] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e25)", 2023-08-01T19:54:43.228 INFO:teuthology.orchestra.run.smithi155.stdout: "initiated_at": "2023-08-01T19:54:36.845425+0000", 2023-08-01T19:54:43.228 INFO:teuthology.orchestra.run.smithi155.stdout: "age": 6.2578527919999996, 2023-08-01T19:54:43.228 INFO:teuthology.orchestra.run.smithi155.stdout: "duration": 0.013011441, 2023-08-01T19:54:43.228 INFO:teuthology.orchestra.run.smithi155.stdout: "type_data": { 2023-08-01T19:54:43.228 INFO:teuthology.orchestra.run.smithi155.stdout: "flag_point": "commit sent; apply or cleanup", 2023-08-01T19:54:43.228 INFO:teuthology.orchestra.run.smithi155.stdout: "client_info": { 2023-08-01T19:54:43.228 INFO:teuthology.orchestra.run.smithi155.stdout: "client": "client.4668", 2023-08-01T19:54:43.228 INFO:teuthology.orchestra.run.smithi155.stdout: "client_addr": "172.21.15.6:0/1709472247", 2023-08-01T19:54:43.229 INFO:teuthology.orchestra.run.smithi155.stdout: "tid": 41593 2023-08-01T19:54:43.229 INFO:teuthology.orchestra.run.smithi155.stdout: }, 2023-08-01T19:54:43.229 INFO:teuthology.orchestra.run.smithi155.stdout: "events": [ 2023-08-01T19:54:43.229 INFO:teuthology.orchestra.run.smithi155.stdout: { 2023-08-01T19:54:43.229 INFO:teuthology.orchestra.run.smithi155.stdout: "event": "initiated", 2023-08-01T19:54:43.229 INFO:teuthology.orchestra.run.smithi155.stdout: "time": "2023-08-01T19:54:36.845425+0000", 2023-08-01T19:54:43.229 INFO:teuthology.orchestra.run.smithi155.stdout: "duration": 0 2023-08-01T19:54:43.229 INFO:teuthology.orchestra.run.smithi155.stdout: }, 2023-08-01T19:54:43.230 INFO:teuthology.orchestra.run.smithi155.stdout: { 2023-08-01T19:54:43.230 INFO:teuthology.orchestra.run.smithi155.stdout: "event": "throttled", 2023-08-01T19:54:43.230 INFO:teuthology.orchestra.run.smithi155.stdout: "time": "2023-08-01T19:54:36.845425+0000", 2023-08-01T19:54:43.230 INFO:teuthology.orchestra.run.smithi155.stdout: "duration": 0 2023-08-01T19:54:43.230 INFO:teuthology.orchestra.run.smithi155.stdout: }, 2023-08-01T19:54:43.230 INFO:teuthology.orchestra.run.smithi155.stdout: { 2023-08-01T19:54:43.230 INFO:teuthology.orchestra.run.smithi155.stdout: "event": "header_read", 2023-08-01T19:54:43.230 INFO:teuthology.orchestra.run.smithi155.stdout: "time": "2023-08-01T19:54:36.845424+0000", 2023-08-01T19:54:43.231 INFO:teuthology.orchestra.run.smithi155.stdout: "duration": 4294967295.9999995 2023-08-01T19:54:43.231 INFO:teuthology.orchestra.run.smithi155.stdout: }, 2023-08-01T19:54:43.231 INFO:teuthology.orchestra.run.smithi155.stdout: { 2023-08-01T19:54:43.231 INFO:teuthology.orchestra.run.smithi155.stdout: "event": "all_read", 2023-08-01T19:54:43.231 INFO:teuthology.orchestra.run.smithi155.stdout: "time": "2023-08-01T19:54:36.845465+0000", 2023-08-01T19:54:43.231 INFO:teuthology.orchestra.run.smithi155.stdout: "duration": 4.0633999999999998e-05 2023-08-01T19:54:43.231 INFO:teuthology.orchestra.run.smithi155.stdout: }, 2023-08-01T19:54:43.231 INFO:teuthology.orchestra.run.smithi155.stdout: { 2023-08-01T19:54:43.232 INFO:teuthology.orchestra.run.smithi155.stdout: "event": "dispatched", 2023-08-01T19:54:43.232 INFO:teuthology.orchestra.run.smithi155.stdout: "time": "2023-08-01T19:54:36.845470+0000", 2023-08-01T19:54:43.232 INFO:teuthology.orchestra.run.smithi155.stdout: "duration": 5.186e-06 2023-08-01T19:54:43.232 INFO:teuthology.orchestra.run.smithi155.stdout: }, 2023-08-01T19:54:43.232 INFO:teuthology.orchestra.run.smithi155.stdout: { 2023-08-01T19:54:43.232 INFO:teuthology.orchestra.run.smithi155.stdout: "event": "queued_for_pg", 2023-08-01T19:54:43.232 INFO:teuthology.orchestra.run.smithi155.stdout: "time": "2023-08-01T19:54:36.845475+0000", 2023-08-01T19:54:43.233 INFO:teuthology.orchestra.run.smithi155.stdout: "duration": 4.2209999999999999e-06 2023-08-01T19:54:43.233 INFO:teuthology.orchestra.run.smithi155.stdout: }, 2023-08-01T19:54:43.233 INFO:teuthology.orchestra.run.smithi155.stdout: { 2023-08-01T19:54:43.233 INFO:teuthology.orchestra.run.smithi155.stdout: "event": "reached_pg", 2023-08-01T19:54:43.233 INFO:teuthology.orchestra.run.smithi155.stdout: "time": "2023-08-01T19:54:36.847116+0000", 2023-08-01T19:54:43.233 INFO:teuthology.orchestra.run.smithi155.stdout: "duration": 0.0016419449999999999 2023-08-01T19:54:43.233 INFO:teuthology.orchestra.run.smithi155.stdout: }, 2023-08-01T19:54:43.233 INFO:teuthology.orchestra.run.smithi155.stdout: { 2023-08-01T19:54:43.234 INFO:teuthology.orchestra.run.smithi155.stdout: "event": "started", 2023-08-01T19:54:43.234 INFO:teuthology.orchestra.run.smithi155.stdout: "time": "2023-08-01T19:54:36.847233+0000", 2023-08-01T19:54:43.234 INFO:teuthology.orchestra.run.smithi155.stdout: "duration": 0.000116063 2023-08-01T19:54:43.234 INFO:teuthology.orchestra.run.smithi155.stdout: }, 2023-08-01T19:54:43.234 INFO:teuthology.orchestra.run.smithi155.stdout: { 2023-08-01T19:54:43.234 INFO:teuthology.orchestra.run.smithi155.stdout: "event": "waiting for subops from 0", 2023-08-01T19:54:43.234 INFO:teuthology.orchestra.run.smithi155.stdout: "time": "2023-08-01T19:54:36.847365+0000", 2023-08-01T19:54:43.234 INFO:teuthology.orchestra.run.smithi155.stdout: "duration": 0.00013231000000000001 2023-08-01T19:54:43.235 INFO:teuthology.orchestra.run.smithi155.stdout: }, 2023-08-01T19:54:43.235 INFO:teuthology.orchestra.run.smithi155.stdout: { 2023-08-01T19:54:43.235 INFO:teuthology.orchestra.run.smithi155.stdout: "event": "op_commit", 2023-08-01T19:54:43.235 INFO:teuthology.orchestra.run.smithi155.stdout: "time": "2023-08-01T19:54:36.851727+0000", 2023-08-01T19:54:43.235 INFO:teuthology.orchestra.run.smithi155.stdout: "duration": 0.004362561 2023-08-01T19:54:43.235 INFO:teuthology.orchestra.run.smithi155.stdout: }, 2023-08-01T19:54:43.235 INFO:teuthology.orchestra.run.smithi155.stdout: { 2023-08-01T19:54:43.235 INFO:teuthology.orchestra.run.smithi155.stdout: "event": "sub_op_commit_rec", 2023-08-01T19:54:43.236 INFO:teuthology.orchestra.run.smithi155.stdout: "time": "2023-08-01T19:54:36.858372+0000", 2023-08-01T19:54:43.236 INFO:teuthology.orchestra.run.smithi155.stdout: "duration": 0.0066449990000000004 2023-08-01T19:54:43.236 INFO:teuthology.orchestra.run.smithi155.stdout: }, 2023-08-01T19:54:43.236 INFO:teuthology.orchestra.run.smithi155.stdout: { 2023-08-01T19:54:43.236 INFO:teuthology.orchestra.run.smithi155.stdout: "event": "commit_sent", 2023-08-01T19:54:43.236 INFO:teuthology.orchestra.run.smithi155.stdout: "time": "2023-08-01T19:54:36.858403+0000", 2023-08-01T19:54:43.236 INFO:teuthology.orchestra.run.smithi155.stdout: "duration": 3.0642000000000002e-05 2023-08-01T19:54:43.236 INFO:teuthology.orchestra.run.smithi155.stdout: }, 2023-08-01T19:54:43.237 INFO:teuthology.orchestra.run.smithi155.stdout: { 2023-08-01T19:54:43.237 INFO:teuthology.orchestra.run.smithi155.stdout: "event": "done", 2023-08-01T19:54:43.237 INFO:teuthology.orchestra.run.smithi155.stdout: "time": "2023-08-01T19:54:36.858436+0000", 2023-08-01T19:54:43.237 INFO:teuthology.orchestra.run.smithi155.stdout: "duration": 3.3238000000000003e-05 2023-08-01T19:54:43.237 INFO:teuthology.orchestra.run.smithi155.stdout: } 2023-08-01T19:54:43.237 INFO:teuthology.orchestra.run.smithi155.stdout: ] 2023-08-01T19:54:43.237 INFO:teuthology.orchestra.run.smithi155.stdout: } 2023-08-01T19:54:43.238 INFO:teuthology.orchestra.run.smithi155.stdout: }, 2023-08-01T19:54:43.238 INFO:teuthology.orchestra.run.smithi155.stdout: { 2023-08-01T19:54:43.238 INFO:teuthology.orchestra.run.smithi155.stdout: "description": "osd_op(client.4668.0:44265 5.d 5:b8c137fb:::benchmark_data_smithi006_114134_object44264:head [set-alloc-hint object_size 65536 write_size 65536,write 0~65536] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e26)", 2023-08-01T19:54:43.238 INFO:teuthology.orchestra.run.smithi155.stdout: "initiated_at": "2023-08-01T19:54:37.900791+0000", 2023-08-01T19:54:43.238 INFO:teuthology.orchestra.run.smithi155.stdout: "age": 5.2024862220000001, 2023-08-01T19:54:43.238 INFO:teuthology.orchestra.run.smithi155.stdout: "duration": 0.013495806000000001, 2023-08-01T19:54:43.238 INFO:teuthology.orchestra.run.smithi155.stdout: "type_data": { 2023-08-01T19:54:43.238 INFO:teuthology.orchestra.run.smithi155.stdout: "flag_point": "commit sent; apply or cleanup", 2023-08-01T19:54:43.239 INFO:teuthology.orchestra.run.smithi155.stdout: "client_info": { 2023-08-01T19:54:43.239 INFO:teuthology.orchestra.run.smithi155.stdout: "client": "client.4668", 2023-08-01T19:54:43.239 INFO:teuthology.orchestra.run.smithi155.stdout: "client_addr": "172.21.15.6:0/1709472247", 2023-08-01T19:54:43.239 INFO:teuthology.orchestra.run.smithi155.stdout: "tid": 44265 2023-08-01T19:54:43.239 INFO:teuthology.orchestra.run.smithi155.stdout: }, 2023-08-01T19:54:43.239 INFO:teuthology.orchestra.run.smithi155.stdout: "events": [ 2023-08-01T19:54:43.239 INFO:teuthology.orchestra.run.smithi155.stdout: { 2023-08-01T19:54:43.239 INFO:teuthology.orchestra.run.smithi155.stdout: "event": "initiated", 2023-08-01T19:54:43.240 INFO:teuthology.orchestra.run.smithi155.stdout: "time": "2023-08-01T19:54:37.900791+0000", 2023-08-01T19:54:43.240 INFO:teuthology.orchestra.run.smithi155.stdout: "duration": 0 2023-08-01T19:54:43.240 INFO:teuthology.orchestra.run.smithi155.stdout: }, 2023-08-01T19:54:43.240 INFO:teuthology.orchestra.run.smithi155.stdout: { 2023-08-01T19:54:43.240 INFO:teuthology.orchestra.run.smithi155.stdout: "event": "throttled", 2023-08-01T19:54:43.240 INFO:teuthology.orchestra.run.smithi155.stdout: "time": "2023-08-01T19:54:37.900791+0000", 2023-08-01T19:54:43.240 INFO:teuthology.orchestra.run.smithi155.stdout: "duration": 0 2023-08-01T19:54:43.240 INFO:teuthology.orchestra.run.smithi155.stdout: }, 2023-08-01T19:54:43.241 INFO:teuthology.orchestra.run.smithi155.stdout: { 2023-08-01T19:54:43.241 INFO:teuthology.orchestra.run.smithi155.stdout: "event": "header_read", 2023-08-01T19:54:43.241 INFO:teuthology.orchestra.run.smithi155.stdout: "time": "2023-08-01T19:54:37.900791+0000", 2023-08-01T19:54:43.241 INFO:teuthology.orchestra.run.smithi155.stdout: "duration": 4294967295.9999995 2023-08-01T19:54:43.241 INFO:teuthology.orchestra.run.smithi155.stdout: }, 2023-08-01T19:54:43.241 INFO:teuthology.orchestra.run.smithi155.stdout: { 2023-08-01T19:54:43.241 INFO:teuthology.orchestra.run.smithi155.stdout: "event": "all_read", 2023-08-01T19:54:43.242 INFO:teuthology.orchestra.run.smithi155.stdout: "time": "2023-08-01T19:54:37.900922+0000", 2023-08-01T19:54:43.242 INFO:teuthology.orchestra.run.smithi155.stdout: "duration": 0.000131285 2023-08-01T19:54:43.242 INFO:teuthology.orchestra.run.smithi155.stdout: }, 2023-08-01T19:54:43.242 INFO:teuthology.orchestra.run.smithi155.stdout: { 2023-08-01T19:54:43.242 INFO:teuthology.orchestra.run.smithi155.stdout: "event": "dispatched", 2023-08-01T19:54:43.242 INFO:teuthology.orchestra.run.smithi155.stdout: "time": "2023-08-01T19:54:37.900930+0000", 2023-08-01T19:54:43.242 INFO:teuthology.orchestra.run.smithi155.stdout: "duration": 8.2740000000000007e-06 2023-08-01T19:54:43.242 INFO:teuthology.orchestra.run.smithi155.stdout: }, 2023-08-01T19:54:43.243 INFO:teuthology.orchestra.run.smithi155.stdout: { 2023-08-01T19:54:43.243 INFO:teuthology.orchestra.run.smithi155.stdout: "event": "queued_for_pg", 2023-08-01T19:54:43.243 INFO:teuthology.orchestra.run.smithi155.stdout: "time": "2023-08-01T19:54:37.900937+0000", 2023-08-01T19:54:43.243 INFO:teuthology.orchestra.run.smithi155.stdout: "duration": 6.4799999999999998e-06 2023-08-01T19:54:43.243 INFO:teuthology.orchestra.run.smithi155.stdout: }, 2023-08-01T19:54:43.243 INFO:teuthology.orchestra.run.smithi155.stdout: { 2023-08-01T19:54:43.243 INFO:teuthology.orchestra.run.smithi155.stdout: "event": "reached_pg", 2023-08-01T19:54:43.243 INFO:teuthology.orchestra.run.smithi155.stdout: "time": "2023-08-01T19:54:37.900972+0000", 2023-08-01T19:54:43.244 INFO:teuthology.orchestra.run.smithi155.stdout: "duration": 3.5383000000000003e-05 2023-08-01T19:54:43.244 INFO:teuthology.orchestra.run.smithi155.stdout: }, 2023-08-01T19:54:43.244 INFO:teuthology.orchestra.run.smithi155.stdout: { 2023-08-01T19:54:43.244 INFO:teuthology.orchestra.run.smithi155.stdout: "event": "started", 2023-08-01T19:54:43.244 INFO:teuthology.orchestra.run.smithi155.stdout: "time": "2023-08-01T19:54:37.901095+0000", 2023-08-01T19:54:43.244 INFO:teuthology.orchestra.run.smithi155.stdout: "duration": 0.00012262199999999999 2023-08-01T19:54:43.244 INFO:teuthology.orchestra.run.smithi155.stdout: }, 2023-08-01T19:54:43.244 INFO:teuthology.orchestra.run.smithi155.stdout: { 2023-08-01T19:54:43.245 INFO:teuthology.orchestra.run.smithi155.stdout: "event": "waiting for subops from 1", 2023-08-01T19:54:43.245 INFO:teuthology.orchestra.run.smithi155.stdout: "time": "2023-08-01T19:54:37.901233+0000", 2023-08-01T19:54:43.245 INFO:teuthology.orchestra.run.smithi155.stdout: "duration": 0.00013827800000000001 2023-08-01T19:54:43.245 INFO:teuthology.orchestra.run.smithi155.stdout: }, 2023-08-01T19:54:43.245 INFO:teuthology.orchestra.run.smithi155.stdout: { 2023-08-01T19:54:43.245 INFO:teuthology.orchestra.run.smithi155.stdout: "event": "op_commit", 2023-08-01T19:54:43.245 INFO:teuthology.orchestra.run.smithi155.stdout: "time": "2023-08-01T19:54:37.905936+0000", 2023-08-01T19:54:43.245 INFO:teuthology.orchestra.run.smithi155.stdout: "duration": 0.0047026289999999998 2023-08-01T19:54:43.246 INFO:teuthology.orchestra.run.smithi155.stdout: }, 2023-08-01T19:54:43.246 INFO:teuthology.orchestra.run.smithi155.stdout: { 2023-08-01T19:54:43.246 INFO:teuthology.orchestra.run.smithi155.stdout: "event": "sub_op_commit_rec", 2023-08-01T19:54:43.246 INFO:teuthology.orchestra.run.smithi155.stdout: "time": "2023-08-01T19:54:37.914221+0000", 2023-08-01T19:54:43.246 INFO:teuthology.orchestra.run.smithi155.stdout: "duration": 0.0082853679999999996 2023-08-01T19:54:43.246 INFO:teuthology.orchestra.run.smithi155.stdout: }, 2023-08-01T19:54:43.246 INFO:teuthology.orchestra.run.smithi155.stdout: { 2023-08-01T19:54:43.246 INFO:teuthology.orchestra.run.smithi155.stdout: "event": "commit_sent", 2023-08-01T19:54:43.247 INFO:teuthology.orchestra.run.smithi155.stdout: "time": "2023-08-01T19:54:37.914252+0000", 2023-08-01T19:54:43.247 INFO:teuthology.orchestra.run.smithi155.stdout: "duration": 3.0682999999999997e-05 2023-08-01T19:54:43.247 INFO:teuthology.orchestra.run.smithi155.stdout: }, 2023-08-01T19:54:43.247 INFO:teuthology.orchestra.run.smithi155.stdout: { 2023-08-01T19:54:43.247 INFO:teuthology.orchestra.run.smithi155.stdout: "event": "done", 2023-08-01T19:54:43.247 INFO:teuthology.orchestra.run.smithi155.stdout: "time": "2023-08-01T19:54:37.914287+0000", 2023-08-01T19:54:43.247 INFO:teuthology.orchestra.run.smithi155.stdout: "duration": 3.5445999999999999e-05 2023-08-01T19:54:43.247 INFO:teuthology.orchestra.run.smithi155.stdout: } 2023-08-01T19:54:43.248 INFO:teuthology.orchestra.run.smithi155.stdout: ] 2023-08-01T19:54:43.248 INFO:teuthology.orchestra.run.smithi155.stdout: } 2023-08-01T19:54:43.248 INFO:teuthology.orchestra.run.smithi155.stdout: }, 2023-08-01T19:54:43.248 INFO:teuthology.orchestra.run.smithi155.stdout: { 2023-08-01T19:54:43.248 INFO:teuthology.orchestra.run.smithi155.stdout: "description": "osd_op(client.4668.0:52241 5.0 5:046bb241:::benchmark_data_smithi006_114134_object52240:head [set-alloc-hint object_size 65536 write_size 65536,write 0~65536] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e27)", 2023-08-01T19:54:43.248 INFO:teuthology.orchestra.run.smithi155.stdout: "initiated_at": "2023-08-01T19:54:41.282783+0000", 2023-08-01T19:54:43.248 INFO:teuthology.orchestra.run.smithi155.stdout: "age": 1.8204948480000001, 2023-08-01T19:54:43.249 INFO:teuthology.orchestra.run.smithi155.stdout: "duration": 0.015571013, 2023-08-01T19:54:43.249 INFO:teuthology.orchestra.run.smithi155.stdout: "type_data": { 2023-08-01T19:54:43.249 INFO:teuthology.orchestra.run.smithi155.stdout: "flag_point": "commit sent; apply or cleanup", 2023-08-01T19:54:43.249 INFO:teuthology.orchestra.run.smithi155.stdout: "client_info": { 2023-08-01T19:54:43.249 INFO:teuthology.orchestra.run.smithi155.stdout: "client": "client.4668", 2023-08-01T19:54:43.249 INFO:teuthology.orchestra.run.smithi155.stdout: "client_addr": "172.21.15.6:0/1709472247", 2023-08-01T19:54:43.249 INFO:teuthology.orchestra.run.smithi155.stdout: "tid": 52241 2023-08-01T19:54:43.249 INFO:teuthology.orchestra.run.smithi155.stdout: }, 2023-08-01T19:54:43.250 INFO:teuthology.orchestra.run.smithi155.stdout: "events": [ 2023-08-01T19:54:43.250 INFO:teuthology.orchestra.run.smithi155.stdout: { 2023-08-01T19:54:43.250 INFO:teuthology.orchestra.run.smithi155.stdout: "event": "initiated", 2023-08-01T19:54:43.250 INFO:teuthology.orchestra.run.smithi155.stdout: "time": "2023-08-01T19:54:41.282783+0000", 2023-08-01T19:54:43.250 INFO:teuthology.orchestra.run.smithi155.stdout: "duration": 0 2023-08-01T19:54:43.250 INFO:teuthology.orchestra.run.smithi155.stdout: }, 2023-08-01T19:54:43.250 INFO:teuthology.orchestra.run.smithi155.stdout: { 2023-08-01T19:54:43.250 INFO:teuthology.orchestra.run.smithi155.stdout: "event": "throttled", 2023-08-01T19:54:43.251 INFO:teuthology.orchestra.run.smithi155.stdout: "time": "2023-08-01T19:54:41.282783+0000", 2023-08-01T19:54:43.251 INFO:teuthology.orchestra.run.smithi155.stdout: "duration": 0 2023-08-01T19:54:43.251 INFO:teuthology.orchestra.run.smithi155.stdout: }, 2023-08-01T19:54:43.251 INFO:teuthology.orchestra.run.smithi155.stdout: { 2023-08-01T19:54:43.251 INFO:teuthology.orchestra.run.smithi155.stdout: "event": "header_read", 2023-08-01T19:54:43.251 INFO:teuthology.orchestra.run.smithi155.stdout: "time": "2023-08-01T19:54:41.282782+0000", 2023-08-01T19:54:43.251 INFO:teuthology.orchestra.run.smithi155.stdout: "duration": 4294967295.9999995 2023-08-01T19:54:43.251 INFO:teuthology.orchestra.run.smithi155.stdout: }, 2023-08-01T19:54:43.252 INFO:teuthology.orchestra.run.smithi155.stdout: { 2023-08-01T19:54:43.252 INFO:teuthology.orchestra.run.smithi155.stdout: "event": "all_read", 2023-08-01T19:54:43.252 INFO:teuthology.orchestra.run.smithi155.stdout: "time": "2023-08-01T19:54:41.282859+0000", 2023-08-01T19:54:43.252 INFO:teuthology.orchestra.run.smithi155.stdout: "duration": 7.7089999999999995e-05 2023-08-01T19:54:43.252 INFO:teuthology.orchestra.run.smithi155.stdout: }, 2023-08-01T19:54:43.252 INFO:teuthology.orchestra.run.smithi155.stdout: { 2023-08-01T19:54:43.252 INFO:teuthology.orchestra.run.smithi155.stdout: "event": "dispatched", 2023-08-01T19:54:43.252 INFO:teuthology.orchestra.run.smithi155.stdout: "time": "2023-08-01T19:54:41.282865+0000", 2023-08-01T19:54:43.253 INFO:teuthology.orchestra.run.smithi155.stdout: "duration": 5.3129999999999998e-06 2023-08-01T19:54:43.253 INFO:teuthology.orchestra.run.smithi155.stdout: }, 2023-08-01T19:54:43.253 INFO:teuthology.orchestra.run.smithi155.stdout: { 2023-08-01T19:54:43.253 INFO:teuthology.orchestra.run.smithi155.stdout: "event": "queued_for_pg", 2023-08-01T19:54:43.253 INFO:teuthology.orchestra.run.smithi155.stdout: "time": "2023-08-01T19:54:41.282868+0000", 2023-08-01T19:54:43.253 INFO:teuthology.orchestra.run.smithi155.stdout: "duration": 3.0139999999999999e-06 2023-08-01T19:54:43.253 INFO:teuthology.orchestra.run.smithi155.stdout: }, 2023-08-01T19:54:43.254 INFO:teuthology.orchestra.run.smithi155.stdout: { 2023-08-01T19:54:43.254 INFO:teuthology.orchestra.run.smithi155.stdout: "event": "reached_pg", 2023-08-01T19:54:43.254 INFO:teuthology.orchestra.run.smithi155.stdout: "time": "2023-08-01T19:54:41.284581+0000", 2023-08-01T19:54:43.254 INFO:teuthology.orchestra.run.smithi155.stdout: "duration": 0.0017131959999999999 2023-08-01T19:54:43.254 INFO:teuthology.orchestra.run.smithi155.stdout: }, 2023-08-01T19:54:43.254 INFO:teuthology.orchestra.run.smithi155.stdout: { 2023-08-01T19:54:43.254 INFO:teuthology.orchestra.run.smithi155.stdout: "event": "started", 2023-08-01T19:54:43.254 INFO:teuthology.orchestra.run.smithi155.stdout: "time": "2023-08-01T19:54:41.284684+0000", 2023-08-01T19:54:43.255 INFO:teuthology.orchestra.run.smithi155.stdout: "duration": 0.000102642 2023-08-01T19:54:43.255 INFO:teuthology.orchestra.run.smithi155.stdout: }, 2023-08-01T19:54:43.255 INFO:teuthology.orchestra.run.smithi155.stdout: { 2023-08-01T19:54:43.255 INFO:teuthology.orchestra.run.smithi155.stdout: "event": "waiting for subops from 0", 2023-08-01T19:54:43.255 INFO:teuthology.orchestra.run.smithi155.stdout: "time": "2023-08-01T19:54:41.284771+0000", 2023-08-01T19:54:43.255 INFO:teuthology.orchestra.run.smithi155.stdout: "duration": 8.7153999999999999e-05 2023-08-01T19:54:43.255 INFO:teuthology.orchestra.run.smithi155.stdout: }, 2023-08-01T19:54:43.255 INFO:teuthology.orchestra.run.smithi155.stdout: { 2023-08-01T19:54:43.256 INFO:teuthology.orchestra.run.smithi155.stdout: "event": "op_commit", 2023-08-01T19:54:43.256 INFO:teuthology.orchestra.run.smithi155.stdout: "time": "2023-08-01T19:54:41.289784+0000", 2023-08-01T19:54:43.256 INFO:teuthology.orchestra.run.smithi155.stdout: "duration": 0.0050127879999999998 2023-08-01T19:54:43.256 INFO:teuthology.orchestra.run.smithi155.stdout: }, 2023-08-01T19:54:43.256 INFO:teuthology.orchestra.run.smithi155.stdout: { 2023-08-01T19:54:43.256 INFO:teuthology.orchestra.run.smithi155.stdout: "event": "sub_op_commit_rec", 2023-08-01T19:54:43.256 INFO:teuthology.orchestra.run.smithi155.stdout: "time": "2023-08-01T19:54:41.298271+0000", 2023-08-01T19:54:43.256 INFO:teuthology.orchestra.run.smithi155.stdout: "duration": 0.0084877730000000005 2023-08-01T19:54:43.257 INFO:teuthology.orchestra.run.smithi155.stdout: }, 2023-08-01T19:54:43.257 INFO:teuthology.orchestra.run.smithi155.stdout: { 2023-08-01T19:54:43.257 INFO:teuthology.orchestra.run.smithi155.stdout: "event": "commit_sent", 2023-08-01T19:54:43.257 INFO:teuthology.orchestra.run.smithi155.stdout: "time": "2023-08-01T19:54:41.298322+0000", 2023-08-01T19:54:43.257 INFO:teuthology.orchestra.run.smithi155.stdout: "duration": 5.0500000000000001e-05 2023-08-01T19:54:43.257 INFO:teuthology.orchestra.run.smithi155.stdout: }, 2023-08-01T19:54:43.257 INFO:teuthology.orchestra.run.smithi155.stdout: { 2023-08-01T19:54:43.257 INFO:teuthology.orchestra.run.smithi155.stdout: "event": "done", 2023-08-01T19:54:43.258 INFO:teuthology.orchestra.run.smithi155.stdout: "time": "2023-08-01T19:54:41.298354+0000", 2023-08-01T19:54:43.258 INFO:teuthology.orchestra.run.smithi155.stdout: "duration": 3.1943000000000002e-05 2023-08-01T19:54:43.258 INFO:teuthology.orchestra.run.smithi155.stdout: } 2023-08-01T19:54:43.258 INFO:teuthology.orchestra.run.smithi155.stdout: ] 2023-08-01T19:54:43.258 INFO:teuthology.orchestra.run.smithi155.stdout: } 2023-08-01T19:54:43.258 INFO:teuthology.orchestra.run.smithi155.stdout: }, 2023-08-01T19:54:43.258 INFO:teuthology.orchestra.run.smithi155.stdout: { 2023-08-01T19:54:43.258 INFO:teuthology.orchestra.run.smithi155.stdout: "description": "osd_op(client.4668.0:52243 5.8 5:1a9a8a8b:::benchmark_data_smithi006_114134_object52242:head [set-alloc-hint object_size 65536 write_size 65536,write 0~65536] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e27)", 2023-08-01T19:54:43.259 INFO:teuthology.orchestra.run.smithi155.stdout: "initiated_at": "2023-08-01T19:54:41.284113+0000", 2023-08-01T19:54:43.259 INFO:teuthology.orchestra.run.smithi155.stdout: "age": 1.8191642959999998, 2023-08-01T19:54:43.259 INFO:teuthology.orchestra.run.smithi155.stdout: "duration": 0.014317038000000001, 2023-08-01T19:54:43.259 INFO:teuthology.orchestra.run.smithi155.stdout: "type_data": { 2023-08-01T19:54:43.259 INFO:teuthology.orchestra.run.smithi155.stdout: "flag_point": "commit sent; apply or cleanup", 2023-08-01T19:54:43.259 INFO:teuthology.orchestra.run.smithi155.stdout: "client_info": { 2023-08-01T19:54:43.259 INFO:teuthology.orchestra.run.smithi155.stdout: "client": "client.4668", 2023-08-01T19:54:43.259 INFO:teuthology.orchestra.run.smithi155.stdout: "client_addr": "172.21.15.6:0/1709472247", 2023-08-01T19:54:43.260 INFO:teuthology.orchestra.run.smithi155.stdout: "tid": 52243 2023-08-01T19:54:43.260 INFO:teuthology.orchestra.run.smithi155.stdout: }, 2023-08-01T19:54:43.260 INFO:teuthology.orchestra.run.smithi155.stdout: "events": [ 2023-08-01T19:54:43.260 INFO:teuthology.orchestra.run.smithi155.stdout: { 2023-08-01T19:54:43.260 INFO:teuthology.orchestra.run.smithi155.stdout: "event": "initiated", 2023-08-01T19:54:43.260 INFO:teuthology.orchestra.run.smithi155.stdout: "time": "2023-08-01T19:54:41.284113+0000", 2023-08-01T19:54:43.260 INFO:teuthology.orchestra.run.smithi155.stdout: "duration": 0 2023-08-01T19:54:43.261 INFO:teuthology.orchestra.run.smithi155.stdout: }, 2023-08-01T19:54:43.261 INFO:teuthology.orchestra.run.smithi155.stdout: { 2023-08-01T19:54:43.261 INFO:teuthology.orchestra.run.smithi155.stdout: "event": "throttled", 2023-08-01T19:54:43.261 INFO:teuthology.orchestra.run.smithi155.stdout: "time": "2023-08-01T19:54:41.284113+0000", 2023-08-01T19:54:43.261 INFO:teuthology.orchestra.run.smithi155.stdout: "duration": 0 2023-08-01T19:54:43.261 INFO:teuthology.orchestra.run.smithi155.stdout: }, 2023-08-01T19:54:43.261 INFO:teuthology.orchestra.run.smithi155.stdout: { 2023-08-01T19:54:43.261 INFO:teuthology.orchestra.run.smithi155.stdout: "event": "header_read", 2023-08-01T19:54:43.262 INFO:teuthology.orchestra.run.smithi155.stdout: "time": "2023-08-01T19:54:41.284113+0000", 2023-08-01T19:54:43.262 INFO:teuthology.orchestra.run.smithi155.stdout: "duration": 4294967295.9999995 2023-08-01T19:54:43.262 INFO:teuthology.orchestra.run.smithi155.stdout: }, 2023-08-01T19:54:43.262 INFO:teuthology.orchestra.run.smithi155.stdout: { 2023-08-01T19:54:43.262 INFO:teuthology.orchestra.run.smithi155.stdout: "event": "all_read", 2023-08-01T19:54:43.262 INFO:teuthology.orchestra.run.smithi155.stdout: "time": "2023-08-01T19:54:41.284170+0000", 2023-08-01T19:54:43.262 INFO:teuthology.orchestra.run.smithi155.stdout: "duration": 5.7287000000000002e-05 2023-08-01T19:54:43.262 INFO:teuthology.orchestra.run.smithi155.stdout: }, 2023-08-01T19:54:43.263 INFO:teuthology.orchestra.run.smithi155.stdout: { 2023-08-01T19:54:43.263 INFO:teuthology.orchestra.run.smithi155.stdout: "event": "dispatched", 2023-08-01T19:54:43.263 INFO:teuthology.orchestra.run.smithi155.stdout: "time": "2023-08-01T19:54:41.284185+0000", 2023-08-01T19:54:43.263 INFO:teuthology.orchestra.run.smithi155.stdout: "duration": 1.4747e-05 2023-08-01T19:54:43.263 INFO:teuthology.orchestra.run.smithi155.stdout: }, 2023-08-01T19:54:43.263 INFO:teuthology.orchestra.run.smithi155.stdout: { 2023-08-01T19:54:43.263 INFO:teuthology.orchestra.run.smithi155.stdout: "event": "queued_for_pg", 2023-08-01T19:54:43.263 INFO:teuthology.orchestra.run.smithi155.stdout: "time": "2023-08-01T19:54:41.284189+0000", 2023-08-01T19:54:43.264 INFO:teuthology.orchestra.run.smithi155.stdout: "duration": 4.4349999999999999e-06 2023-08-01T19:54:43.264 INFO:teuthology.orchestra.run.smithi155.stdout: }, 2023-08-01T19:54:43.264 INFO:teuthology.orchestra.run.smithi155.stdout: { 2023-08-01T19:54:43.264 INFO:teuthology.orchestra.run.smithi155.stdout: "event": "reached_pg", 2023-08-01T19:54:43.264 INFO:teuthology.orchestra.run.smithi155.stdout: "time": "2023-08-01T19:54:41.286026+0000", 2023-08-01T19:54:43.264 INFO:teuthology.orchestra.run.smithi155.stdout: "duration": 0.0018371710000000001 2023-08-01T19:54:43.264 INFO:teuthology.orchestra.run.smithi155.stdout: }, 2023-08-01T19:54:43.264 INFO:teuthology.orchestra.run.smithi155.stdout: { 2023-08-01T19:54:43.265 INFO:teuthology.orchestra.run.smithi155.stdout: "event": "started", 2023-08-01T19:54:43.265 INFO:teuthology.orchestra.run.smithi155.stdout: "time": "2023-08-01T19:54:41.286136+0000", 2023-08-01T19:54:43.265 INFO:teuthology.orchestra.run.smithi155.stdout: "duration": 0.000109304 2023-08-01T19:54:43.265 INFO:teuthology.orchestra.run.smithi155.stdout: }, 2023-08-01T19:54:43.265 INFO:teuthology.orchestra.run.smithi155.stdout: { 2023-08-01T19:54:43.265 INFO:teuthology.orchestra.run.smithi155.stdout: "event": "waiting for subops from 0", 2023-08-01T19:54:43.265 INFO:teuthology.orchestra.run.smithi155.stdout: "time": "2023-08-01T19:54:41.286238+0000", 2023-08-01T19:54:43.265 INFO:teuthology.orchestra.run.smithi155.stdout: "duration": 0.000102674 2023-08-01T19:54:43.266 INFO:teuthology.orchestra.run.smithi155.stdout: }, 2023-08-01T19:54:43.266 INFO:teuthology.orchestra.run.smithi155.stdout: { 2023-08-01T19:54:43.266 INFO:teuthology.orchestra.run.smithi155.stdout: "event": "op_commit", 2023-08-01T19:54:43.266 INFO:teuthology.orchestra.run.smithi155.stdout: "time": "2023-08-01T19:54:41.289787+0000", 2023-08-01T19:54:43.266 INFO:teuthology.orchestra.run.smithi155.stdout: "duration": 0.0035490669999999999 2023-08-01T19:54:43.266 INFO:teuthology.orchestra.run.smithi155.stdout: }, 2023-08-01T19:54:43.266 INFO:teuthology.orchestra.run.smithi155.stdout: { 2023-08-01T19:54:43.266 INFO:teuthology.orchestra.run.smithi155.stdout: "event": "sub_op_commit_rec", 2023-08-01T19:54:43.267 INFO:teuthology.orchestra.run.smithi155.stdout: "time": "2023-08-01T19:54:41.298383+0000", 2023-08-01T19:54:43.267 INFO:teuthology.orchestra.run.smithi155.stdout: "duration": 0.0085955400000000005 2023-08-01T19:54:43.267 INFO:teuthology.orchestra.run.smithi155.stdout: }, 2023-08-01T19:54:43.267 INFO:teuthology.orchestra.run.smithi155.stdout: { 2023-08-01T19:54:43.267 INFO:teuthology.orchestra.run.smithi155.stdout: "event": "commit_sent", 2023-08-01T19:54:43.267 INFO:teuthology.orchestra.run.smithi155.stdout: "time": "2023-08-01T19:54:41.298411+0000", 2023-08-01T19:54:43.267 INFO:teuthology.orchestra.run.smithi155.stdout: "duration": 2.8147e-05 2023-08-01T19:54:43.267 INFO:teuthology.orchestra.run.smithi155.stdout: }, 2023-08-01T19:54:43.268 INFO:teuthology.orchestra.run.smithi155.stdout: { 2023-08-01T19:54:43.268 INFO:teuthology.orchestra.run.smithi155.stdout: "event": "done", 2023-08-01T19:54:43.268 INFO:teuthology.orchestra.run.smithi155.stdout: "time": "2023-08-01T19:54:41.298430+0000", 2023-08-01T19:54:43.268 INFO:teuthology.orchestra.run.smithi155.stdout: "duration": 1.9283000000000002e-05 2023-08-01T19:54:43.268 INFO:teuthology.orchestra.run.smithi155.stdout: } 2023-08-01T19:54:43.268 INFO:teuthology.orchestra.run.smithi155.stdout: ] 2023-08-01T19:54:43.268 INFO:teuthology.orchestra.run.smithi155.stdout: } 2023-08-01T19:54:43.269 INFO:teuthology.orchestra.run.smithi155.stdout: }, 2023-08-01T19:54:43.269 INFO:teuthology.orchestra.run.smithi155.stdout: { 2023-08-01T19:54:43.269 INFO:teuthology.orchestra.run.smithi155.stdout: "description": "osd_op(client.4668.0:52370 5.4 5:265bc04c:::benchmark_data_smithi006_114134_object52369:head [set-alloc-hint object_size 65536 write_size 65536,write 0~65536] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e27)", 2023-08-01T19:54:43.269 INFO:teuthology.orchestra.run.smithi155.stdout: "initiated_at": "2023-08-01T19:54:41.345935+0000", 2023-08-01T19:54:43.269 INFO:teuthology.orchestra.run.smithi155.stdout: "age": 1.757343061, 2023-08-01T19:54:43.269 INFO:teuthology.orchestra.run.smithi155.stdout: "duration": 0.013376034, 2023-08-01T19:54:43.269 INFO:teuthology.orchestra.run.smithi155.stdout: "type_data": { 2023-08-01T19:54:43.269 INFO:teuthology.orchestra.run.smithi155.stdout: "flag_point": "commit sent; apply or cleanup", 2023-08-01T19:54:43.270 INFO:teuthology.orchestra.run.smithi155.stdout: "client_info": { 2023-08-01T19:54:43.270 INFO:teuthology.orchestra.run.smithi155.stdout: "client": "client.4668", 2023-08-01T19:54:43.270 INFO:teuthology.orchestra.run.smithi155.stdout: "client_addr": "172.21.15.6:0/1709472247", 2023-08-01T19:54:43.270 INFO:teuthology.orchestra.run.smithi155.stdout: "tid": 52370 2023-08-01T19:54:43.270 INFO:teuthology.orchestra.run.smithi155.stdout: }, 2023-08-01T19:54:43.270 INFO:teuthology.orchestra.run.smithi155.stdout: "events": [ 2023-08-01T19:54:43.270 INFO:teuthology.orchestra.run.smithi155.stdout: { 2023-08-01T19:54:43.270 INFO:teuthology.orchestra.run.smithi155.stdout: "event": "initiated", 2023-08-01T19:54:43.271 INFO:teuthology.orchestra.run.smithi155.stdout: "time": "2023-08-01T19:54:41.345935+0000", 2023-08-01T19:54:43.271 INFO:teuthology.orchestra.run.smithi155.stdout: "duration": 0 2023-08-01T19:54:43.271 INFO:teuthology.orchestra.run.smithi155.stdout: }, 2023-08-01T19:54:43.271 INFO:teuthology.orchestra.run.smithi155.stdout: { 2023-08-01T19:54:43.271 INFO:teuthology.orchestra.run.smithi155.stdout: "event": "throttled", 2023-08-01T19:54:43.271 INFO:teuthology.orchestra.run.smithi155.stdout: "time": "2023-08-01T19:54:41.345935+0000", 2023-08-01T19:54:43.271 INFO:teuthology.orchestra.run.smithi155.stdout: "duration": 0 2023-08-01T19:54:43.271 INFO:teuthology.orchestra.run.smithi155.stdout: }, 2023-08-01T19:54:43.272 INFO:teuthology.orchestra.run.smithi155.stdout: { 2023-08-01T19:54:43.272 INFO:teuthology.orchestra.run.smithi155.stdout: "event": "header_read", 2023-08-01T19:54:43.272 INFO:teuthology.orchestra.run.smithi155.stdout: "time": "2023-08-01T19:54:41.345934+0000", 2023-08-01T19:54:43.272 INFO:teuthology.orchestra.run.smithi155.stdout: "duration": 4294967295.9999995 2023-08-01T19:54:43.272 INFO:teuthology.orchestra.run.smithi155.stdout: }, 2023-08-01T19:54:43.272 INFO:teuthology.orchestra.run.smithi155.stdout: { 2023-08-01T19:54:43.272 INFO:teuthology.orchestra.run.smithi155.stdout: "event": "all_read", 2023-08-01T19:54:43.272 INFO:teuthology.orchestra.run.smithi155.stdout: "time": "2023-08-01T19:54:41.345996+0000", 2023-08-01T19:54:43.273 INFO:teuthology.orchestra.run.smithi155.stdout: "duration": 6.2119999999999995e-05 2023-08-01T19:54:43.273 INFO:teuthology.orchestra.run.smithi155.stdout: }, 2023-08-01T19:54:43.273 INFO:teuthology.orchestra.run.smithi155.stdout: { 2023-08-01T19:54:43.273 INFO:teuthology.orchestra.run.smithi155.stdout: "event": "dispatched", 2023-08-01T19:54:43.273 INFO:teuthology.orchestra.run.smithi155.stdout: "time": "2023-08-01T19:54:41.346004+0000", 2023-08-01T19:54:43.273 INFO:teuthology.orchestra.run.smithi155.stdout: "duration": 8.2959999999999999e-06 2023-08-01T19:54:43.273 INFO:teuthology.orchestra.run.smithi155.stdout: }, 2023-08-01T19:54:43.273 INFO:teuthology.orchestra.run.smithi155.stdout: { 2023-08-01T19:54:43.274 INFO:teuthology.orchestra.run.smithi155.stdout: "event": "queued_for_pg", 2023-08-01T19:54:43.274 INFO:teuthology.orchestra.run.smithi155.stdout: "time": "2023-08-01T19:54:41.346009+0000", 2023-08-01T19:54:43.274 INFO:teuthology.orchestra.run.smithi155.stdout: "duration": 4.7419999999999997e-06 2023-08-01T19:54:43.274 INFO:teuthology.orchestra.run.smithi155.stdout: }, 2023-08-01T19:54:43.274 INFO:teuthology.orchestra.run.smithi155.stdout: { 2023-08-01T19:54:43.274 INFO:teuthology.orchestra.run.smithi155.stdout: "event": "reached_pg", 2023-08-01T19:54:43.274 INFO:teuthology.orchestra.run.smithi155.stdout: "time": "2023-08-01T19:54:41.347514+0000", 2023-08-01T19:54:43.274 INFO:teuthology.orchestra.run.smithi155.stdout: "duration": 0.0015048290000000001 2023-08-01T19:54:43.275 INFO:teuthology.orchestra.run.smithi155.stdout: }, 2023-08-01T19:54:43.275 INFO:teuthology.orchestra.run.smithi155.stdout: { 2023-08-01T19:54:43.275 INFO:teuthology.orchestra.run.smithi155.stdout: "event": "started", 2023-08-01T19:54:43.275 INFO:teuthology.orchestra.run.smithi155.stdout: "time": "2023-08-01T19:54:41.347634+0000", 2023-08-01T19:54:43.275 INFO:teuthology.orchestra.run.smithi155.stdout: "duration": 0.00012032999999999999 2023-08-01T19:54:43.275 INFO:teuthology.orchestra.run.smithi155.stdout: }, 2023-08-01T19:54:43.275 INFO:teuthology.orchestra.run.smithi155.stdout: { 2023-08-01T19:54:43.276 INFO:teuthology.orchestra.run.smithi155.stdout: "event": "waiting for subops from 0", 2023-08-01T19:54:43.276 INFO:teuthology.orchestra.run.smithi155.stdout: "time": "2023-08-01T19:54:41.347779+0000", 2023-08-01T19:54:43.276 INFO:teuthology.orchestra.run.smithi155.stdout: "duration": 0.00014514899999999999 2023-08-01T19:54:43.276 INFO:teuthology.orchestra.run.smithi155.stdout: }, 2023-08-01T19:54:43.276 INFO:teuthology.orchestra.run.smithi155.stdout: { 2023-08-01T19:54:43.276 INFO:teuthology.orchestra.run.smithi155.stdout: "event": "op_commit", 2023-08-01T19:54:43.276 INFO:teuthology.orchestra.run.smithi155.stdout: "time": "2023-08-01T19:54:41.353921+0000", 2023-08-01T19:54:43.277 INFO:teuthology.orchestra.run.smithi155.stdout: "duration": 0.0061420340000000002 2023-08-01T19:54:43.277 INFO:teuthology.orchestra.run.smithi155.stdout: }, 2023-08-01T19:54:43.277 INFO:teuthology.orchestra.run.smithi155.stdout: { 2023-08-01T19:54:43.277 INFO:teuthology.orchestra.run.smithi155.stdout: "event": "sub_op_commit_rec", 2023-08-01T19:54:43.277 INFO:teuthology.orchestra.run.smithi155.stdout: "time": "2023-08-01T19:54:41.359240+0000", 2023-08-01T19:54:43.277 INFO:teuthology.orchestra.run.smithi155.stdout: "duration": 0.0053188539999999996 2023-08-01T19:54:43.277 INFO:teuthology.orchestra.run.smithi155.stdout: }, 2023-08-01T19:54:43.277 INFO:teuthology.orchestra.run.smithi155.stdout: { 2023-08-01T19:54:43.278 INFO:teuthology.orchestra.run.smithi155.stdout: "event": "commit_sent", 2023-08-01T19:54:43.278 INFO:teuthology.orchestra.run.smithi155.stdout: "time": "2023-08-01T19:54:41.359286+0000", 2023-08-01T19:54:43.278 INFO:teuthology.orchestra.run.smithi155.stdout: "duration": 4.5915999999999999e-05 2023-08-01T19:54:43.278 INFO:teuthology.orchestra.run.smithi155.stdout: }, 2023-08-01T19:54:43.278 INFO:teuthology.orchestra.run.smithi155.stdout: { 2023-08-01T19:54:43.278 INFO:teuthology.orchestra.run.smithi155.stdout: "event": "done", 2023-08-01T19:54:43.278 INFO:teuthology.orchestra.run.smithi155.stdout: "time": "2023-08-01T19:54:41.359311+0000", 2023-08-01T19:54:43.278 INFO:teuthology.orchestra.run.smithi155.stdout: "duration": 2.4434e-05 2023-08-01T19:54:43.279 INFO:teuthology.orchestra.run.smithi155.stdout: } 2023-08-01T19:54:43.279 INFO:teuthology.orchestra.run.smithi155.stdout: ] 2023-08-01T19:54:43.279 INFO:teuthology.orchestra.run.smithi155.stdout: } 2023-08-01T19:54:43.279 INFO:teuthology.orchestra.run.smithi155.stdout: }, 2023-08-01T19:54:43.279 INFO:teuthology.orchestra.run.smithi155.stdout: { 2023-08-01T19:54:43.279 INFO:teuthology.orchestra.run.smithi155.stdout: "description": "osd_op(client.4668.0:54238 5.0 5:0033d896:::benchmark_data_smithi006_114134_object54237:head [set-alloc-hint object_size 65536 write_size 65536,write 0~65536] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e27)", 2023-08-01T19:54:43.279 INFO:teuthology.orchestra.run.smithi155.stdout: "initiated_at": "2023-08-01T19:54:42.174210+0000", 2023-08-01T19:54:43.280 INFO:teuthology.orchestra.run.smithi155.stdout: "age": 0.92906715299999998, 2023-08-01T19:54:43.280 INFO:teuthology.orchestra.run.smithi155.stdout: "duration": 0.014057537, 2023-08-01T19:54:43.280 INFO:teuthology.orchestra.run.smithi155.stdout: "type_data": { 2023-08-01T19:54:43.280 INFO:teuthology.orchestra.run.smithi155.stdout: "flag_point": "commit sent; apply or cleanup", 2023-08-01T19:54:43.280 INFO:teuthology.orchestra.run.smithi155.stdout: "client_info": { 2023-08-01T19:54:43.280 INFO:teuthology.orchestra.run.smithi155.stdout: "client": "client.4668", 2023-08-01T19:54:43.280 INFO:teuthology.orchestra.run.smithi155.stdout: "client_addr": "172.21.15.6:0/1709472247", 2023-08-01T19:54:43.280 INFO:teuthology.orchestra.run.smithi155.stdout: "tid": 54238 2023-08-01T19:54:43.281 INFO:teuthology.orchestra.run.smithi155.stdout: }, 2023-08-01T19:54:43.281 INFO:teuthology.orchestra.run.smithi155.stdout: "events": [ 2023-08-01T19:54:43.281 INFO:teuthology.orchestra.run.smithi155.stdout: { 2023-08-01T19:54:43.281 INFO:teuthology.orchestra.run.smithi155.stdout: "event": "initiated", 2023-08-01T19:54:43.281 INFO:teuthology.orchestra.run.smithi155.stdout: "time": "2023-08-01T19:54:42.174210+0000", 2023-08-01T19:54:43.281 INFO:teuthology.orchestra.run.smithi155.stdout: "duration": 0 2023-08-01T19:54:43.281 INFO:teuthology.orchestra.run.smithi155.stdout: }, 2023-08-01T19:54:43.281 INFO:teuthology.orchestra.run.smithi155.stdout: { 2023-08-01T19:54:43.282 INFO:teuthology.orchestra.run.smithi155.stdout: "event": "throttled", 2023-08-01T19:54:43.282 INFO:teuthology.orchestra.run.smithi155.stdout: "time": "2023-08-01T19:54:42.174210+0000", 2023-08-01T19:54:43.282 INFO:teuthology.orchestra.run.smithi155.stdout: "duration": 0 2023-08-01T19:54:43.282 INFO:teuthology.orchestra.run.smithi155.stdout: }, 2023-08-01T19:54:43.282 INFO:teuthology.orchestra.run.smithi155.stdout: { 2023-08-01T19:54:43.282 INFO:teuthology.orchestra.run.smithi155.stdout: "event": "header_read", 2023-08-01T19:54:43.282 INFO:teuthology.orchestra.run.smithi155.stdout: "time": "2023-08-01T19:54:42.174210+0000", 2023-08-01T19:54:43.282 INFO:teuthology.orchestra.run.smithi155.stdout: "duration": 4294967295.9999995 2023-08-01T19:54:43.283 INFO:teuthology.orchestra.run.smithi155.stdout: }, 2023-08-01T19:54:43.283 INFO:teuthology.orchestra.run.smithi155.stdout: { 2023-08-01T19:54:43.283 INFO:teuthology.orchestra.run.smithi155.stdout: "event": "all_read", 2023-08-01T19:54:43.283 INFO:teuthology.orchestra.run.smithi155.stdout: "time": "2023-08-01T19:54:42.174272+0000", 2023-08-01T19:54:43.283 INFO:teuthology.orchestra.run.smithi155.stdout: "duration": 6.2415999999999993e-05 2023-08-01T19:54:43.283 INFO:teuthology.orchestra.run.smithi155.stdout: }, 2023-08-01T19:54:43.283 INFO:teuthology.orchestra.run.smithi155.stdout: { 2023-08-01T19:54:43.283 INFO:teuthology.orchestra.run.smithi155.stdout: "event": "dispatched", 2023-08-01T19:54:43.284 INFO:teuthology.orchestra.run.smithi155.stdout: "time": "2023-08-01T19:54:42.174281+0000", 2023-08-01T19:54:43.284 INFO:teuthology.orchestra.run.smithi155.stdout: "duration": 8.918e-06 2023-08-01T19:54:43.284 INFO:teuthology.orchestra.run.smithi155.stdout: }, 2023-08-01T19:54:43.284 INFO:teuthology.orchestra.run.smithi155.stdout: { 2023-08-01T19:54:43.284 INFO:teuthology.orchestra.run.smithi155.stdout: "event": "queued_for_pg", 2023-08-01T19:54:43.284 INFO:teuthology.orchestra.run.smithi155.stdout: "time": "2023-08-01T19:54:42.174287+0000", 2023-08-01T19:54:43.284 INFO:teuthology.orchestra.run.smithi155.stdout: "duration": 5.3680000000000001e-06 2023-08-01T19:54:43.285 INFO:teuthology.orchestra.run.smithi155.stdout: }, 2023-08-01T19:54:43.285 INFO:teuthology.orchestra.run.smithi155.stdout: { 2023-08-01T19:54:43.285 INFO:teuthology.orchestra.run.smithi155.stdout: "event": "reached_pg", 2023-08-01T19:54:43.285 INFO:teuthology.orchestra.run.smithi155.stdout: "time": "2023-08-01T19:54:42.175900+0000", 2023-08-01T19:54:43.285 INFO:teuthology.orchestra.run.smithi155.stdout: "duration": 0.0016131120000000001 2023-08-01T19:54:43.285 INFO:teuthology.orchestra.run.smithi155.stdout: }, 2023-08-01T19:54:43.285 INFO:teuthology.orchestra.run.smithi155.stdout: { 2023-08-01T19:54:43.285 INFO:teuthology.orchestra.run.smithi155.stdout: "event": "started", 2023-08-01T19:54:43.286 INFO:teuthology.orchestra.run.smithi155.stdout: "time": "2023-08-01T19:54:42.176023+0000", 2023-08-01T19:54:43.286 INFO:teuthology.orchestra.run.smithi155.stdout: "duration": 0.00012335499999999999 2023-08-01T19:54:43.286 INFO:teuthology.orchestra.run.smithi155.stdout: }, 2023-08-01T19:54:43.286 INFO:teuthology.orchestra.run.smithi155.stdout: { 2023-08-01T19:54:43.286 INFO:teuthology.orchestra.run.smithi155.stdout: "event": "waiting for subops from 0", 2023-08-01T19:54:43.286 INFO:teuthology.orchestra.run.smithi155.stdout: "time": "2023-08-01T19:54:42.176154+0000", 2023-08-01T19:54:43.286 INFO:teuthology.orchestra.run.smithi155.stdout: "duration": 0.000130729 2023-08-01T19:54:43.286 INFO:teuthology.orchestra.run.smithi155.stdout: }, 2023-08-01T19:54:43.287 INFO:teuthology.orchestra.run.smithi155.stdout: { 2023-08-01T19:54:43.287 INFO:teuthology.orchestra.run.smithi155.stdout: "event": "sub_op_commit_rec", 2023-08-01T19:54:43.287 INFO:teuthology.orchestra.run.smithi155.stdout: "time": "2023-08-01T19:54:42.183652+0000", 2023-08-01T19:54:43.287 INFO:teuthology.orchestra.run.smithi155.stdout: "duration": 0.0074976870000000003 2023-08-01T19:54:43.287 INFO:teuthology.orchestra.run.smithi155.stdout: }, 2023-08-01T19:54:43.287 INFO:teuthology.orchestra.run.smithi155.stdout: { 2023-08-01T19:54:43.287 INFO:teuthology.orchestra.run.smithi155.stdout: "event": "op_commit", 2023-08-01T19:54:43.287 INFO:teuthology.orchestra.run.smithi155.stdout: "time": "2023-08-01T19:54:42.188214+0000", 2023-08-01T19:54:43.288 INFO:teuthology.orchestra.run.smithi155.stdout: "duration": 0.0045620410000000002 2023-08-01T19:54:43.288 INFO:teuthology.orchestra.run.smithi155.stdout: }, 2023-08-01T19:54:43.288 INFO:teuthology.orchestra.run.smithi155.stdout: { 2023-08-01T19:54:43.288 INFO:teuthology.orchestra.run.smithi155.stdout: "event": "commit_sent", 2023-08-01T19:54:43.288 INFO:teuthology.orchestra.run.smithi155.stdout: "time": "2023-08-01T19:54:42.188240+0000", 2023-08-01T19:54:43.288 INFO:teuthology.orchestra.run.smithi155.stdout: "duration": 2.5978000000000001e-05 2023-08-01T19:54:43.288 INFO:teuthology.orchestra.run.smithi155.stdout: }, 2023-08-01T19:54:43.288 INFO:teuthology.orchestra.run.smithi155.stdout: { 2023-08-01T19:54:43.289 INFO:teuthology.orchestra.run.smithi155.stdout: "event": "done", 2023-08-01T19:54:43.289 INFO:teuthology.orchestra.run.smithi155.stdout: "time": "2023-08-01T19:54:42.188268+0000", 2023-08-01T19:54:43.289 INFO:teuthology.orchestra.run.smithi155.stdout: "duration": 2.8441000000000001e-05 2023-08-01T19:54:43.289 INFO:teuthology.orchestra.run.smithi155.stdout: } 2023-08-01T19:54:43.289 INFO:teuthology.orchestra.run.smithi155.stdout: ] 2023-08-01T19:54:43.289 INFO:teuthology.orchestra.run.smithi155.stdout: } 2023-08-01T19:54:43.289 INFO:teuthology.orchestra.run.smithi155.stdout: }, 2023-08-01T19:54:43.289 INFO:teuthology.orchestra.run.smithi155.stdout: { 2023-08-01T19:54:43.290 INFO:teuthology.orchestra.run.smithi155.stdout: "description": "osd_op(client.4668.0:54758 5.b 5:dc4e6e77:::benchmark_data_smithi006_114134_object54757:head [set-alloc-hint object_size 65536 write_size 65536,write 0~65536] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e27)", 2023-08-01T19:54:43.290 INFO:teuthology.orchestra.run.smithi155.stdout: "initiated_at": "2023-08-01T19:54:42.402927+0000", 2023-08-01T19:54:43.290 INFO:teuthology.orchestra.run.smithi155.stdout: "age": 0.700350158, 2023-08-01T19:54:43.290 INFO:teuthology.orchestra.run.smithi155.stdout: "duration": 0.013025415, 2023-08-01T19:54:43.290 INFO:teuthology.orchestra.run.smithi155.stdout: "type_data": { 2023-08-01T19:54:43.290 INFO:teuthology.orchestra.run.smithi155.stdout: "flag_point": "commit sent; apply or cleanup", 2023-08-01T19:54:43.290 INFO:teuthology.orchestra.run.smithi155.stdout: "client_info": { 2023-08-01T19:54:43.290 INFO:teuthology.orchestra.run.smithi155.stdout: "client": "client.4668", 2023-08-01T19:54:43.291 INFO:teuthology.orchestra.run.smithi155.stdout: "client_addr": "172.21.15.6:0/1709472247", 2023-08-01T19:54:43.291 INFO:teuthology.orchestra.run.smithi155.stdout: "tid": 54758 2023-08-01T19:54:43.291 INFO:teuthology.orchestra.run.smithi155.stdout: }, 2023-08-01T19:54:43.291 INFO:teuthology.orchestra.run.smithi155.stdout: "events": [ 2023-08-01T19:54:43.291 INFO:teuthology.orchestra.run.smithi155.stdout: { 2023-08-01T19:54:43.291 INFO:teuthology.orchestra.run.smithi155.stdout: "event": "initiated", 2023-08-01T19:54:43.291 INFO:teuthology.orchestra.run.smithi155.stdout: "time": "2023-08-01T19:54:42.402927+0000", 2023-08-01T19:54:43.291 INFO:teuthology.orchestra.run.smithi155.stdout: "duration": 0 2023-08-01T19:54:43.292 INFO:teuthology.orchestra.run.smithi155.stdout: }, 2023-08-01T19:54:43.292 INFO:teuthology.orchestra.run.smithi155.stdout: { 2023-08-01T19:54:43.292 INFO:teuthology.orchestra.run.smithi155.stdout: "event": "throttled", 2023-08-01T19:54:43.292 INFO:teuthology.orchestra.run.smithi155.stdout: "time": "2023-08-01T19:54:42.402927+0000", 2023-08-01T19:54:43.292 INFO:teuthology.orchestra.run.smithi155.stdout: "duration": 0 2023-08-01T19:54:43.292 INFO:teuthology.orchestra.run.smithi155.stdout: }, 2023-08-01T19:54:43.292 INFO:teuthology.orchestra.run.smithi155.stdout: { 2023-08-01T19:54:43.293 INFO:teuthology.orchestra.run.smithi155.stdout: "event": "header_read", 2023-08-01T19:54:43.293 INFO:teuthology.orchestra.run.smithi155.stdout: "time": "2023-08-01T19:54:42.402927+0000", 2023-08-01T19:54:43.293 INFO:teuthology.orchestra.run.smithi155.stdout: "duration": 4294967295.9999995 2023-08-01T19:54:43.293 INFO:teuthology.orchestra.run.smithi155.stdout: }, 2023-08-01T19:54:43.293 INFO:teuthology.orchestra.run.smithi155.stdout: { 2023-08-01T19:54:43.293 INFO:teuthology.orchestra.run.smithi155.stdout: "event": "all_read", 2023-08-01T19:54:43.293 INFO:teuthology.orchestra.run.smithi155.stdout: "time": "2023-08-01T19:54:42.402993+0000", 2023-08-01T19:54:43.293 INFO:teuthology.orchestra.run.smithi155.stdout: "duration": 6.5665000000000002e-05 2023-08-01T19:54:43.294 INFO:teuthology.orchestra.run.smithi155.stdout: }, 2023-08-01T19:54:43.294 INFO:teuthology.orchestra.run.smithi155.stdout: { 2023-08-01T19:54:43.294 INFO:teuthology.orchestra.run.smithi155.stdout: "event": "dispatched", 2023-08-01T19:54:43.294 INFO:teuthology.orchestra.run.smithi155.stdout: "time": "2023-08-01T19:54:42.402998+0000", 2023-08-01T19:54:43.294 INFO:teuthology.orchestra.run.smithi155.stdout: "duration": 5.3619999999999997e-06 2023-08-01T19:54:43.294 INFO:teuthology.orchestra.run.smithi155.stdout: }, 2023-08-01T19:54:43.294 INFO:teuthology.orchestra.run.smithi155.stdout: { 2023-08-01T19:54:43.294 INFO:teuthology.orchestra.run.smithi155.stdout: "event": "queued_for_pg", 2023-08-01T19:54:43.295 INFO:teuthology.orchestra.run.smithi155.stdout: "time": "2023-08-01T19:54:42.403001+0000", 2023-08-01T19:54:43.295 INFO:teuthology.orchestra.run.smithi155.stdout: "duration": 2.892e-06 2023-08-01T19:54:43.295 INFO:teuthology.orchestra.run.smithi155.stdout: }, 2023-08-01T19:54:43.295 INFO:teuthology.orchestra.run.smithi155.stdout: { 2023-08-01T19:54:43.295 INFO:teuthology.orchestra.run.smithi155.stdout: "event": "reached_pg", 2023-08-01T19:54:43.295 INFO:teuthology.orchestra.run.smithi155.stdout: "time": "2023-08-01T19:54:42.404892+0000", 2023-08-01T19:54:43.295 INFO:teuthology.orchestra.run.smithi155.stdout: "duration": 0.0018906070000000001 2023-08-01T19:54:43.295 INFO:teuthology.orchestra.run.smithi155.stdout: }, 2023-08-01T19:54:43.296 INFO:teuthology.orchestra.run.smithi155.stdout: { 2023-08-01T19:54:43.296 INFO:teuthology.orchestra.run.smithi155.stdout: "event": "started", 2023-08-01T19:54:43.296 INFO:teuthology.orchestra.run.smithi155.stdout: "time": "2023-08-01T19:54:42.404984+0000", 2023-08-01T19:54:43.296 INFO:teuthology.orchestra.run.smithi155.stdout: "duration": 9.1897000000000005e-05 2023-08-01T19:54:43.296 INFO:teuthology.orchestra.run.smithi155.stdout: }, 2023-08-01T19:54:43.296 INFO:teuthology.orchestra.run.smithi155.stdout: { 2023-08-01T19:54:43.296 INFO:teuthology.orchestra.run.smithi155.stdout: "event": "waiting for subops from 0", 2023-08-01T19:54:43.297 INFO:teuthology.orchestra.run.smithi155.stdout: "time": "2023-08-01T19:54:42.405123+0000", 2023-08-01T19:54:43.297 INFO:teuthology.orchestra.run.smithi155.stdout: "duration": 0.000139407 2023-08-01T19:54:43.297 INFO:teuthology.orchestra.run.smithi155.stdout: }, 2023-08-01T19:54:43.297 INFO:teuthology.orchestra.run.smithi155.stdout: { 2023-08-01T19:54:43.297 INFO:teuthology.orchestra.run.smithi155.stdout: "event": "op_commit", 2023-08-01T19:54:43.297 INFO:teuthology.orchestra.run.smithi155.stdout: "time": "2023-08-01T19:54:42.408174+0000", 2023-08-01T19:54:43.297 INFO:teuthology.orchestra.run.smithi155.stdout: "duration": 0.0030514190000000001 2023-08-01T19:54:43.297 INFO:teuthology.orchestra.run.smithi155.stdout: }, 2023-08-01T19:54:43.298 INFO:teuthology.orchestra.run.smithi155.stdout: { 2023-08-01T19:54:43.298 INFO:teuthology.orchestra.run.smithi155.stdout: "event": "sub_op_commit_rec", 2023-08-01T19:54:43.298 INFO:teuthology.orchestra.run.smithi155.stdout: "time": "2023-08-01T19:54:42.415899+0000", 2023-08-01T19:54:43.298 INFO:teuthology.orchestra.run.smithi155.stdout: "duration": 0.0077246809999999997 2023-08-01T19:54:43.298 INFO:teuthology.orchestra.run.smithi155.stdout: }, 2023-08-01T19:54:43.298 INFO:teuthology.orchestra.run.smithi155.stdout: { 2023-08-01T19:54:43.298 INFO:teuthology.orchestra.run.smithi155.stdout: "event": "commit_sent", 2023-08-01T19:54:43.298 INFO:teuthology.orchestra.run.smithi155.stdout: "time": "2023-08-01T19:54:42.415931+0000", 2023-08-01T19:54:43.299 INFO:teuthology.orchestra.run.smithi155.stdout: "duration": 3.2452e-05 2023-08-01T19:54:43.299 INFO:teuthology.orchestra.run.smithi155.stdout: }, 2023-08-01T19:54:43.299 INFO:teuthology.orchestra.run.smithi155.stdout: { 2023-08-01T19:54:43.299 INFO:teuthology.orchestra.run.smithi155.stdout: "event": "done", 2023-08-01T19:54:43.299 INFO:teuthology.orchestra.run.smithi155.stdout: "time": "2023-08-01T19:54:42.415953+0000", 2023-08-01T19:54:43.299 INFO:teuthology.orchestra.run.smithi155.stdout: "duration": 2.141e-05 2023-08-01T19:54:43.299 INFO:teuthology.orchestra.run.smithi155.stdout: } 2023-08-01T19:54:43.299 INFO:teuthology.orchestra.run.smithi155.stdout: ] 2023-08-01T19:54:43.300 INFO:teuthology.orchestra.run.smithi155.stdout: } 2023-08-01T19:54:43.300 INFO:teuthology.orchestra.run.smithi155.stdout: }, 2023-08-01T19:54:43.300 INFO:teuthology.orchestra.run.smithi155.stdout: { 2023-08-01T19:54:43.300 INFO:teuthology.orchestra.run.smithi155.stdout: "description": "osd_op(client.4668.0:55816 5.4 5:25bbd012:::benchmark_data_smithi006_114134_object55815:head [set-alloc-hint object_size 65536 write_size 65536,write 0~65536] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e27)", 2023-08-01T19:54:43.300 INFO:teuthology.orchestra.run.smithi155.stdout: "initiated_at": "2023-08-01T19:54:42.869802+0000", 2023-08-01T19:54:43.300 INFO:teuthology.orchestra.run.smithi155.stdout: "age": 0.23347526199999999, 2023-08-01T19:54:43.300 INFO:teuthology.orchestra.run.smithi155.stdout: "duration": 0.013154546, 2023-08-01T19:54:43.300 INFO:teuthology.orchestra.run.smithi155.stdout: "type_data": { 2023-08-01T19:54:43.301 INFO:teuthology.orchestra.run.smithi155.stdout: "flag_point": "commit sent; apply or cleanup", 2023-08-01T19:54:43.301 INFO:teuthology.orchestra.run.smithi155.stdout: "client_info": { 2023-08-01T19:54:43.301 INFO:teuthology.orchestra.run.smithi155.stdout: "client": "client.4668", 2023-08-01T19:54:43.301 INFO:teuthology.orchestra.run.smithi155.stdout: "client_addr": "172.21.15.6:0/1709472247", 2023-08-01T19:54:43.301 INFO:teuthology.orchestra.run.smithi155.stdout: "tid": 55816 2023-08-01T19:54:43.301 INFO:teuthology.orchestra.run.smithi155.stdout: }, 2023-08-01T19:54:43.301 INFO:teuthology.orchestra.run.smithi155.stdout: "events": [ 2023-08-01T19:54:43.302 INFO:teuthology.orchestra.run.smithi155.stdout: { 2023-08-01T19:54:43.302 INFO:teuthology.orchestra.run.smithi155.stdout: "event": "initiated", 2023-08-01T19:54:43.302 INFO:teuthology.orchestra.run.smithi155.stdout: "time": "2023-08-01T19:54:42.869802+0000", 2023-08-01T19:54:43.302 INFO:teuthology.orchestra.run.smithi155.stdout: "duration": 0 2023-08-01T19:54:43.302 INFO:teuthology.orchestra.run.smithi155.stdout: }, 2023-08-01T19:54:43.302 INFO:teuthology.orchestra.run.smithi155.stdout: { 2023-08-01T19:54:43.302 INFO:teuthology.orchestra.run.smithi155.stdout: "event": "throttled", 2023-08-01T19:54:43.302 INFO:teuthology.orchestra.run.smithi155.stdout: "time": "2023-08-01T19:54:42.869802+0000", 2023-08-01T19:54:43.303 INFO:teuthology.orchestra.run.smithi155.stdout: "duration": 0 2023-08-01T19:54:43.303 INFO:teuthology.orchestra.run.smithi155.stdout: }, 2023-08-01T19:54:43.303 INFO:teuthology.orchestra.run.smithi155.stdout: { 2023-08-01T19:54:43.303 INFO:teuthology.orchestra.run.smithi155.stdout: "event": "header_read", 2023-08-01T19:54:43.303 INFO:teuthology.orchestra.run.smithi155.stdout: "time": "2023-08-01T19:54:42.869802+0000", 2023-08-01T19:54:43.303 INFO:teuthology.orchestra.run.smithi155.stdout: "duration": 4294967295.9999995 2023-08-01T19:54:43.303 INFO:teuthology.orchestra.run.smithi155.stdout: }, 2023-08-01T19:54:43.303 INFO:teuthology.orchestra.run.smithi155.stdout: { 2023-08-01T19:54:43.304 INFO:teuthology.orchestra.run.smithi155.stdout: "event": "all_read", 2023-08-01T19:54:43.304 INFO:teuthology.orchestra.run.smithi155.stdout: "time": "2023-08-01T19:54:42.869833+0000", 2023-08-01T19:54:43.304 INFO:teuthology.orchestra.run.smithi155.stdout: "duration": 3.1409999999999999e-05 2023-08-01T19:54:43.304 INFO:teuthology.orchestra.run.smithi155.stdout: }, 2023-08-01T19:54:43.304 INFO:teuthology.orchestra.run.smithi155.stdout: { 2023-08-01T19:54:43.304 INFO:teuthology.orchestra.run.smithi155.stdout: "event": "dispatched", 2023-08-01T19:54:43.304 INFO:teuthology.orchestra.run.smithi155.stdout: "time": "2023-08-01T19:54:42.869842+0000", 2023-08-01T19:54:43.305 INFO:teuthology.orchestra.run.smithi155.stdout: "duration": 9.0350000000000007e-06 2023-08-01T19:54:43.305 INFO:teuthology.orchestra.run.smithi155.stdout: }, 2023-08-01T19:54:43.305 INFO:teuthology.orchestra.run.smithi155.stdout: { 2023-08-01T19:54:43.305 INFO:teuthology.orchestra.run.smithi155.stdout: "event": "queued_for_pg", 2023-08-01T19:54:43.305 INFO:teuthology.orchestra.run.smithi155.stdout: "time": "2023-08-01T19:54:42.869847+0000", 2023-08-01T19:54:43.305 INFO:teuthology.orchestra.run.smithi155.stdout: "duration": 4.3080000000000001e-06 2023-08-01T19:54:43.305 INFO:teuthology.orchestra.run.smithi155.stdout: }, 2023-08-01T19:54:43.305 INFO:teuthology.orchestra.run.smithi155.stdout: { 2023-08-01T19:54:43.306 INFO:teuthology.orchestra.run.smithi155.stdout: "event": "reached_pg", 2023-08-01T19:54:43.306 INFO:teuthology.orchestra.run.smithi155.stdout: "time": "2023-08-01T19:54:42.871795+0000", 2023-08-01T19:54:43.306 INFO:teuthology.orchestra.run.smithi155.stdout: "duration": 0.001948226 2023-08-01T19:54:43.306 INFO:teuthology.orchestra.run.smithi155.stdout: }, 2023-08-01T19:54:43.306 INFO:teuthology.orchestra.run.smithi155.stdout: { 2023-08-01T19:54:43.306 INFO:teuthology.orchestra.run.smithi155.stdout: "event": "started", 2023-08-01T19:54:43.306 INFO:teuthology.orchestra.run.smithi155.stdout: "time": "2023-08-01T19:54:42.871922+0000", 2023-08-01T19:54:43.306 INFO:teuthology.orchestra.run.smithi155.stdout: "duration": 0.00012715099999999999 2023-08-01T19:54:43.307 INFO:teuthology.orchestra.run.smithi155.stdout: }, 2023-08-01T19:54:43.307 INFO:teuthology.orchestra.run.smithi155.stdout: { 2023-08-01T19:54:43.307 INFO:teuthology.orchestra.run.smithi155.stdout: "event": "waiting for subops from 0", 2023-08-01T19:54:43.307 INFO:teuthology.orchestra.run.smithi155.stdout: "time": "2023-08-01T19:54:42.872068+0000", 2023-08-01T19:54:43.307 INFO:teuthology.orchestra.run.smithi155.stdout: "duration": 0.00014586199999999999 2023-08-01T19:54:43.307 INFO:teuthology.orchestra.run.smithi155.stdout: }, 2023-08-01T19:54:43.307 INFO:teuthology.orchestra.run.smithi155.stdout: { 2023-08-01T19:54:43.307 INFO:teuthology.orchestra.run.smithi155.stdout: "event": "op_commit", 2023-08-01T19:54:43.308 INFO:teuthology.orchestra.run.smithi155.stdout: "time": "2023-08-01T19:54:42.876302+0000", 2023-08-01T19:54:43.308 INFO:teuthology.orchestra.run.smithi155.stdout: "duration": 0.0042342619999999999 2023-08-01T19:54:43.308 INFO:teuthology.orchestra.run.smithi155.stdout: }, 2023-08-01T19:54:43.308 INFO:teuthology.orchestra.run.smithi155.stdout: { 2023-08-01T19:54:43.308 INFO:teuthology.orchestra.run.smithi155.stdout: "event": "sub_op_commit_rec", 2023-08-01T19:54:43.308 INFO:teuthology.orchestra.run.smithi155.stdout: "time": "2023-08-01T19:54:42.882869+0000", 2023-08-01T19:54:43.308 INFO:teuthology.orchestra.run.smithi155.stdout: "duration": 0.0065671449999999999 2023-08-01T19:54:43.308 INFO:teuthology.orchestra.run.smithi155.stdout: }, 2023-08-01T19:54:43.309 INFO:teuthology.orchestra.run.smithi155.stdout: { 2023-08-01T19:54:43.309 INFO:teuthology.orchestra.run.smithi155.stdout: "event": "commit_sent", 2023-08-01T19:54:43.309 INFO:teuthology.orchestra.run.smithi155.stdout: "time": "2023-08-01T19:54:42.882916+0000", 2023-08-01T19:54:43.309 INFO:teuthology.orchestra.run.smithi155.stdout: "duration": 4.6921e-05 2023-08-01T19:54:43.309 INFO:teuthology.orchestra.run.smithi155.stdout: }, 2023-08-01T19:54:43.309 INFO:teuthology.orchestra.run.smithi155.stdout: { 2023-08-01T19:54:43.309 INFO:teuthology.orchestra.run.smithi155.stdout: "event": "done", 2023-08-01T19:54:43.309 INFO:teuthology.orchestra.run.smithi155.stdout: "time": "2023-08-01T19:54:42.882957+0000", 2023-08-01T19:54:43.310 INFO:teuthology.orchestra.run.smithi155.stdout: "duration": 4.074e-05 2023-08-01T19:54:43.310 INFO:teuthology.orchestra.run.smithi155.stdout: } 2023-08-01T19:54:43.310 INFO:teuthology.orchestra.run.smithi155.stdout: ] 2023-08-01T19:54:43.310 INFO:teuthology.orchestra.run.smithi155.stdout: } 2023-08-01T19:54:43.310 INFO:teuthology.orchestra.run.smithi155.stdout: } 2023-08-01T19:54:43.310 INFO:teuthology.orchestra.run.smithi155.stdout: ] 2023-08-01T19:54:43.310 INFO:teuthology.orchestra.run.smithi155.stdout:} 2023-08-01T19:54:43.311 DEBUG:teuthology.orchestra.run.smithi006:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 120 ceph --cluster ceph -- tell 'osd.*' injectargs --osd_enable_op_tracker=false 2023-08-01T19:54:43.312 INFO:teuthology.orchestra.run.smithi006.stderr:nodeep-scrub is unset 2023-08-01T19:54:43.313 DEBUG:teuthology.orchestra.run.smithi008:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 30 ceph --cluster ceph --admin-daemon /var/run/ceph/ceph-osd.0.asok dump_ops_in_flight 2023-08-01T19:54:43.313 INFO:tasks.ceph.osd.1.smithi101.stderr:2023-08-01T19:54:43.310+0000 7fb0cb7f6700 -1 received signal: Hangup from /usr/bin/python3 /bin/daemon-helper kill ceph-osd -f --cluster ceph -i 1 (PID: 111141) UID: 0 2023-08-01T19:54:43.314 INFO:tasks.radosbench.radosbench.0.smithi006.stdout: 19 16 56798 56782 186.769 141 0.00496428 0.00535125 2023-08-01T19:54:43.412 INFO:tasks.ceph.osd.2.smithi155.stderr:2023-08-01T19:54:43.411+0000 7faa5c6ac700 -1 received signal: Hangup from /usr/bin/python3 /bin/daemon-helper kill ceph-osd -f --cluster ceph -i 2 (PID: 111337) UID: 0 2023-08-01T19:54:43.460 INFO:teuthology.orchestra.run.smithi006.stdout:osd.0: {} 2023-08-01T19:54:43.481 INFO:teuthology.orchestra.run.smithi006.stdout:osd.1: {} 2023-08-01T19:54:43.500 INFO:teuthology.orchestra.run.smithi006.stdout:osd.2: {} 2023-08-01T19:54:43.501 INFO:teuthology.orchestra.run.smithi006.stderr:osd.0: osd_enable_op_tracker = 'false' 2023-08-01T19:54:43.501 INFO:teuthology.orchestra.run.smithi006.stderr:osd.1: osd_enable_op_tracker = 'false' 2023-08-01T19:54:43.501 INFO:teuthology.orchestra.run.smithi006.stderr:osd.2: osd_enable_op_tracker = 'false' 2023-08-01T19:54:43.505 INFO:teuthology.orchestra.run.smithi008.stdout:ERROR: (22) Invalid argument 2023-08-01T19:54:43.506 INFO:teuthology.orchestra.run.smithi008.stdout:op_tracker tracking is not enabled now, so no ops are tracked currently, even those get stuck. Please enable "osd_enable_op_tracker", and the tracker will start to track new ops received afterwards. 2023-08-01T19:54:43.513 INFO:tasks.ceph.osd.1.smithi101.stderr:2023-08-01T19:54:43.511+0000 7fb0cb7f6700 -1 received signal: Hangup from /usr/bin/python3 /bin/daemon-helper kill ceph-osd -f --cluster ceph -i 1 (PID: 111141) UID: 0 2023-08-01T19:54:43.520 DEBUG:teuthology.orchestra.run.smithi008:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 30 ceph --cluster ceph --admin-daemon /var/run/ceph/ceph-osd.0.asok dump_blocked_ops 2023-08-01T19:54:43.613 INFO:tasks.ceph.osd.1.smithi101.stderr:2023-08-01T19:54:43.612+0000 7fb0cb7f6700 -1 received signal: Hangup from /usr/bin/python3 /bin/daemon-helper kill ceph-osd -f --cluster ceph -i 1 (PID: 111141) UID: 0 2023-08-01T19:54:43.710 INFO:teuthology.orchestra.run.smithi008.stdout:ERROR: (22) Invalid argument 2023-08-01T19:54:43.711 INFO:teuthology.orchestra.run.smithi008.stdout:op_tracker tracking is not enabled now, so no ops are tracked currently, even those get stuck. Please enable "osd_enable_op_tracker", and the tracker will start to track new ops received afterwards. 2023-08-01T19:54:43.714 INFO:tasks.ceph.osd.0.smithi008.stderr:2023-08-01T19:54:43.713+0000 7f16a58f4700 -1 received signal: Hangup from /usr/bin/python3 /bin/daemon-helper kill ceph-osd -f --cluster ceph -i 0 (PID: 111179) UID: 0 2023-08-01T19:54:43.719 DEBUG:teuthology.orchestra.run.smithi008:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 30 ceph --cluster ceph --admin-daemon /var/run/ceph/ceph-osd.0.asok dump_historic_ops 2023-08-01T19:54:43.815 INFO:tasks.ceph.osd.0.smithi008.stderr:2023-08-01T19:54:43.814+0000 7f16a58f4700 -1 received signal: Hangup from /usr/bin/python3 /bin/daemon-helper kill ceph-osd -f --cluster ceph -i 0 (PID: 111179) UID: 0 2023-08-01T19:54:43.916 INFO:tasks.ceph.osd.2.smithi155.stderr:2023-08-01T19:54:43.915+0000 7faa5c6ac700 -1 received signal: Hangup from /usr/bin/python3 /bin/daemon-helper kill ceph-osd -f --cluster ceph -i 2 (PID: 111337) UID: 0 2023-08-01T19:54:43.951 INFO:teuthology.orchestra.run.smithi008.stdout:ERROR: (22) Invalid argument 2023-08-01T19:54:43.951 INFO:teuthology.orchestra.run.smithi008.stdout:op_tracker tracking is not enabled now, so no ops are tracked currently, even those get stuck. Please enable "osd_enable_op_tracker", and the tracker will start to track new ops received afterwards. 2023-08-01T19:54:43.966 DEBUG:teuthology.orchestra.run.smithi101:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 30 ceph --cluster ceph --admin-daemon /var/run/ceph/ceph-osd.1.asok dump_ops_in_flight 2023-08-01T19:54:44.017 INFO:tasks.ceph.osd.0.smithi008.stderr:2023-08-01T19:54:44.016+0000 7f16a58f4700 -1 received signal: Hangup from /usr/bin/python3 /bin/daemon-helper kill ceph-osd -f --cluster ceph -i 0 (PID: 111179) UID: 0 2023-08-01T19:54:44.118 INFO:tasks.ceph.osd.0.smithi008.stderr:2023-08-01T19:54:44.117+0000 7f16a58f4700 -1 received signal: Hangup from /usr/bin/python3 /bin/daemon-helper kill ceph-osd -f --cluster ceph -i 0 (PID: 111179) UID: 0 2023-08-01T19:54:44.134 INFO:teuthology.orchestra.run.smithi101.stdout:ERROR: (22) Invalid argument 2023-08-01T19:54:44.134 INFO:teuthology.orchestra.run.smithi101.stdout:op_tracker tracking is not enabled now, so no ops are tracked currently, even those get stuck. Please enable "osd_enable_op_tracker", and the tracker will start to track new ops received afterwards. 2023-08-01T19:54:44.148 DEBUG:teuthology.orchestra.run.smithi101:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 30 ceph --cluster ceph --admin-daemon /var/run/ceph/ceph-osd.1.asok dump_blocked_ops 2023-08-01T19:54:44.218 INFO:tasks.ceph.osd.1.smithi101.stderr:2023-08-01T19:54:44.217+0000 7fb0cb7f6700 -1 received signal: Hangup from /usr/bin/python3 /bin/daemon-helper kill ceph-osd -f --cluster ceph -i 1 (PID: 111141) UID: 0 2023-08-01T19:54:44.314 INFO:tasks.radosbench.radosbench.0.smithi006.stdout:2023-08-01T19:54:44.313515+0000 min lat: 0.00127316 max lat: 0.0177539 avg lat: 0.00543703 2023-08-01T19:54:44.314 INFO:tasks.radosbench.radosbench.0.smithi006.stdout: sec Cur ops started finished avg MB/s cur MB/s last lat(s) avg lat(s) 2023-08-01T19:54:44.314 INFO:tasks.radosbench.radosbench.0.smithi006.stdout: 20 15 58843 58828 183.824 127.875 0.0105705 0.00543703 2023-08-01T19:54:44.319 INFO:tasks.ceph.osd.1.smithi101.stderr:2023-08-01T19:54:44.318+0000 7fb0cb7f6700 -1 received signal: Hangup from /usr/bin/python3 /bin/daemon-helper kill ceph-osd -f --cluster ceph -i 1 (PID: 111141) UID: 0 2023-08-01T19:54:44.320 INFO:teuthology.orchestra.run.smithi101.stdout:ERROR: (22) Invalid argument 2023-08-01T19:54:44.320 INFO:teuthology.orchestra.run.smithi101.stdout:op_tracker tracking is not enabled now, so no ops are tracked currently, even those get stuck. Please enable "osd_enable_op_tracker", and the tracker will start to track new ops received afterwards. 2023-08-01T19:54:44.336 DEBUG:teuthology.orchestra.run.smithi101:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 30 ceph --cluster ceph --admin-daemon /var/run/ceph/ceph-osd.1.asok dump_historic_ops 2023-08-01T19:54:44.420 INFO:tasks.ceph.osd.0.smithi008.stderr:2023-08-01T19:54:44.420+0000 7f16a58f4700 -1 received signal: Hangup from /usr/bin/python3 /bin/daemon-helper kill ceph-osd -f --cluster ceph -i 0 (PID: 111179) UID: 0 2023-08-01T19:54:44.521 INFO:tasks.ceph.osd.2.smithi155.stderr:2023-08-01T19:54:44.519+0000 7faa5c6ac700 -1 received signal: Hangup from /usr/bin/python3 /bin/daemon-helper kill ceph-osd -f --cluster ceph -i 2 (PID: 111337) UID: 0 2023-08-01T19:54:44.552 INFO:teuthology.orchestra.run.smithi101.stdout:ERROR: (22) Invalid argument 2023-08-01T19:54:44.552 INFO:teuthology.orchestra.run.smithi101.stdout:op_tracker tracking is not enabled now, so no ops are tracked currently, even those get stuck. Please enable "osd_enable_op_tracker", and the tracker will start to track new ops received afterwards. 2023-08-01T19:54:44.566 DEBUG:teuthology.orchestra.run.smithi155:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 30 ceph --cluster ceph --admin-daemon /var/run/ceph/ceph-osd.2.asok dump_ops_in_flight 2023-08-01T19:54:44.622 INFO:tasks.ceph.osd.1.smithi101.stderr:2023-08-01T19:54:44.620+0000 7fb0cb7f6700 -1 received signal: Hangup from /usr/bin/python3 /bin/daemon-helper kill ceph-osd -f --cluster ceph -i 1 (PID: 111141) UID: 0 2023-08-01T19:54:44.722 INFO:tasks.ceph.osd.1.smithi101.stderr:2023-08-01T19:54:44.721+0000 7fb0cb7f6700 -1 received signal: Hangup from /usr/bin/python3 /bin/daemon-helper kill ceph-osd -f --cluster ceph -i 1 (PID: 111141) UID: 0 2023-08-01T19:54:44.738 INFO:tasks.thrashosds.thrasher:in_osds: [0, 1, 2] out_osds: [] dead_osds: [] live_osds: [0, 1, 2] 2023-08-01T19:54:44.738 INFO:tasks.thrashosds.thrasher:choose_action: min_in 4 min_out 0 min_live 2 min_dead 0 chance_down 1.00 2023-08-01T19:54:44.738 DEBUG:teuthology.orchestra.run.smithi006:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 120 ceph --cluster ceph pg dump --format=json 2023-08-01T19:54:44.740 INFO:teuthology.orchestra.run.smithi155.stdout:ERROR: (22) Invalid argument 2023-08-01T19:54:44.741 INFO:teuthology.orchestra.run.smithi155.stdout:op_tracker tracking is not enabled now, so no ops are tracked currently, even those get stuck. Please enable "osd_enable_op_tracker", and the tracker will start to track new ops received afterwards. 2023-08-01T19:54:44.755 DEBUG:teuthology.orchestra.run.smithi155:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 30 ceph --cluster ceph --admin-daemon /var/run/ceph/ceph-osd.2.asok dump_blocked_ops 2023-08-01T19:54:44.824 INFO:tasks.ceph.osd.0.smithi008.stderr:2023-08-01T19:54:44.823+0000 7f16a58f4700 -1 received signal: Hangup from /usr/bin/python3 /bin/daemon-helper kill ceph-osd -f --cluster ceph -i 0 (PID: 111179) UID: 0 2023-08-01T19:54:44.917 INFO:teuthology.orchestra.run.smithi155.stdout:ERROR: (22) Invalid argument 2023-08-01T19:54:44.918 INFO:teuthology.orchestra.run.smithi155.stdout:op_tracker tracking is not enabled now, so no ops are tracked currently, even those get stuck. Please enable "osd_enable_op_tracker", and the tracker will start to track new ops received afterwards. 2023-08-01T19:54:44.924 INFO:tasks.ceph.osd.2.smithi155.stderr:2023-08-01T19:54:44.922+0000 7faa5c6ac700 -1 received signal: Hangup from /usr/bin/python3 /bin/daemon-helper kill ceph-osd -f --cluster ceph -i 2 (PID: 111337) UID: 0 2023-08-01T19:54:44.930 DEBUG:teuthology.orchestra.run.smithi155:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 30 ceph --cluster ceph --admin-daemon /var/run/ceph/ceph-osd.2.asok dump_historic_ops 2023-08-01T19:54:45.024 INFO:tasks.ceph.osd.2.smithi155.stderr:2023-08-01T19:54:45.023+0000 7faa5c6ac700 -1 received signal: Hangup from /usr/bin/python3 /bin/daemon-helper kill ceph-osd -f --cluster ceph -i 2 (PID: 111337) UID: 0 2023-08-01T19:54:45.090 INFO:teuthology.orchestra.run.smithi006.stdout: 2023-08-01T19:54:45.091 INFO:teuthology.orchestra.run.smithi006.stderr:dumped all 2023-08-01T19:54:45.102 INFO:teuthology.orchestra.run.smithi006.stdout:{"pg_ready":true,"pg_map":{"version":52,"stamp":"2023-08-01T19:54:43.915406+0000","last_osdmap_epoch":0,"last_pg_scan":0,"pg_stats_sum":{"stat_sum":{"num_bytes":3284667170,"num_objects":50135,"num_object_clones":0,"num_object_copies":100270,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":50135,"num_whiteouts":0,"num_read":136,"num_read_kb":118,"num_write":50359,"num_write_kb":3210577,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":14,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"store_stats":{"total":0,"available":0,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},"log_size":50307,"ondisk_log_size":50307,"up":242,"acting":242,"num_store_stats":0},"osd_stats_sum":{"up_from":0,"seq":0,"num_pgs":242,"num_osds":3,"num_per_pool_osds":3,"num_per_pool_omap_osds":3,"kb":283115520,"kb_used":526432,"kb_used_data":385160,"kb_used_omap":0,"kb_used_meta":141248,"kb_avail":282589088,"statfs":{"total":289910292480,"available":289371226112,"internally_reserved":0,"allocated":394403840,"data_stored":6296659649,"data_compressed":30160340,"data_compressed_allocated":393523200,"data_compressed_original":6296338432,"omap_allocated":0,"internal_metadata":144637952},"hb_peers":[],"snap_trim_queue_len":0,"num_snap_trimming":0,"num_shards_repaired":0,"op_queue_age_hist":{"histogram":[2,3,3,3],"upper_bound":16},"perf_stat":{"commit_latency_ms":6,"apply_latency_ms":6,"commit_latency_ns":6000000,"apply_latency_ns":6000000},"alerts":[],"network_ping_times":[]},"pg_stats_delta":{"stat_sum":{"num_bytes":818151424,"num_objects":12484,"num_object_clones":0,"num_object_copies":24968,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":12484,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":12484,"num_write_kb":798976,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"store_stats":{"total":0,"available":0,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},"log_size":0,"ondisk_log_size":0,"up":0,"acting":0,"num_store_stats":0,"stamp_delta":"6.741682"},"pg_stats":[{"pgid":"4.3f","version":"0'0","reported_seq":18,"reported_epoch":26,"state":"active+clean","last_fresh":"2023-08-01T19:54:37.177454+0000","last_change":"2023-08-01T19:54:04.473430+0000","last_active":"2023-08-01T19:54:37.177454+0000","last_peered":"2023-08-01T19:54:37.177454+0000","last_clean":"2023-08-01T19:54:37.177454+0000","last_became_active":"2023-08-01T19:54:04.472887+0000","last_became_peered":"2023-08-01T19:54:04.472887+0000","last_unstale":"2023-08-01T19:54:37.177454+0000","last_undegraded":"2023-08-01T19:54:37.177454+0000","last_fullsized":"2023-08-01T19:54:37.177454+0000","mapping_epoch":16,"log_start":"0'0","ondisk_log_start":"0'0","created":16,"last_epoch_clean":17,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-08-01T19:54:04.040663+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-08-01T19:54:04.040663+0000","last_clean_scrub_stamp":"2023-08-01T19:54:04.040663+0000","objects_scrubbed":0,"log_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-08-03T06:38:54.196605+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[2,0],"acting":[2,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":2,"acting_primary":2,"purged_snaps":[]},{"pgid":"4.3e","version":"0'0","reported_seq":18,"reported_epoch":26,"state":"active+clean","last_fresh":"2023-08-01T19:54:37.176801+0000","last_change":"2023-08-01T19:54:04.470501+0000","last_active":"2023-08-01T19:54:37.176801+0000","last_peered":"2023-08-01T19:54:37.176801+0000","last_clean":"2023-08-01T19:54:37.176801+0000","last_became_active":"2023-08-01T19:54:04.469692+0000","last_became_peered":"2023-08-01T19:54:04.469692+0000","last_unstale":"2023-08-01T19:54:37.176801+0000","last_undegraded":"2023-08-01T19:54:37.176801+0000","last_fullsized":"2023-08-01T19:54:37.176801+0000","mapping_epoch":16,"log_start":"0'0","ondisk_log_start":"0'0","created":16,"last_epoch_clean":17,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-08-01T19:54:04.040663+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-08-01T19:54:04.040663+0000","last_clean_scrub_stamp":"2023-08-01T19:54:04.040663+0000","objects_scrubbed":0,"log_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-08-03T02:19:35.201107+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[2,0],"acting":[2,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":2,"acting_primary":2,"purged_snaps":[]},{"pgid":"4.3d","version":"0'0","reported_seq":17,"reported_epoch":25,"state":"active+clean","last_fresh":"2023-08-01T19:54:34.171343+0000","last_change":"2023-08-01T19:54:04.472579+0000","last_active":"2023-08-01T19:54:34.171343+0000","last_peered":"2023-08-01T19:54:34.171343+0000","last_clean":"2023-08-01T19:54:34.171343+0000","last_became_active":"2023-08-01T19:54:04.471128+0000","last_became_peered":"2023-08-01T19:54:04.471128+0000","last_unstale":"2023-08-01T19:54:34.171343+0000","last_undegraded":"2023-08-01T19:54:34.171343+0000","last_fullsized":"2023-08-01T19:54:34.171343+0000","mapping_epoch":16,"log_start":"0'0","ondisk_log_start":"0'0","created":16,"last_epoch_clean":17,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-08-01T19:54:04.040663+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-08-01T19:54:04.040663+0000","last_clean_scrub_stamp":"2023-08-01T19:54:04.040663+0000","objects_scrubbed":0,"log_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-08-03T03:04:06.137335+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[1,2],"acting":[1,2],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":1,"acting_primary":1,"purged_snaps":[]},{"pgid":"4.3c","version":"0'0","reported_seq":17,"reported_epoch":25,"state":"active+clean","last_fresh":"2023-08-01T19:54:34.170765+0000","last_change":"2023-08-01T19:54:04.477908+0000","last_active":"2023-08-01T19:54:34.170765+0000","last_peered":"2023-08-01T19:54:34.170765+0000","last_clean":"2023-08-01T19:54:34.170765+0000","last_became_active":"2023-08-01T19:54:04.476684+0000","last_became_peered":"2023-08-01T19:54:04.476684+0000","last_unstale":"2023-08-01T19:54:34.170765+0000","last_undegraded":"2023-08-01T19:54:34.170765+0000","last_fullsized":"2023-08-01T19:54:34.170765+0000","mapping_epoch":16,"log_start":"0'0","ondisk_log_start":"0'0","created":16,"last_epoch_clean":17,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-08-01T19:54:04.040663+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-08-01T19:54:04.040663+0000","last_clean_scrub_stamp":"2023-08-01T19:54:04.040663+0000","objects_scrubbed":0,"log_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-08-03T03:56:55.336461+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[1,0],"acting":[1,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":1,"acting_primary":1,"purged_snaps":[]},{"pgid":"4.3b","version":"0'0","reported_seq":18,"reported_epoch":26,"state":"active+clean","last_fresh":"2023-08-01T19:54:37.176321+0000","last_change":"2023-08-01T19:54:04.467197+0000","last_active":"2023-08-01T19:54:37.176321+0000","last_peered":"2023-08-01T19:54:37.176321+0000","last_clean":"2023-08-01T19:54:37.176321+0000","last_became_active":"2023-08-01T19:54:04.466526+0000","last_became_peered":"2023-08-01T19:54:04.466526+0000","last_unstale":"2023-08-01T19:54:37.176321+0000","last_undegraded":"2023-08-01T19:54:37.176321+0000","last_fullsized":"2023-08-01T19:54:37.176321+0000","mapping_epoch":16,"log_start":"0'0","ondisk_log_start":"0'0","created":16,"last_epoch_clean":17,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-08-01T19:54:04.040663+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-08-01T19:54:04.040663+0000","last_clean_scrub_stamp":"2023-08-01T19:54:04.040663+0000","objects_scrubbed":0,"log_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-08-03T06:54:18.982174+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[2,0],"acting":[2,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":2,"acting_primary":2,"purged_snaps":[]},{"pgid":"4.3a","version":"0'0","reported_seq":17,"reported_epoch":25,"state":"active+clean","last_fresh":"2023-08-01T19:54:34.170356+0000","last_change":"2023-08-01T19:54:04.473296+0000","last_active":"2023-08-01T19:54:34.170356+0000","last_peered":"2023-08-01T19:54:34.170356+0000","last_clean":"2023-08-01T19:54:34.170356+0000","last_became_active":"2023-08-01T19:54:04.472324+0000","last_became_peered":"2023-08-01T19:54:04.472324+0000","last_unstale":"2023-08-01T19:54:34.170356+0000","last_undegraded":"2023-08-01T19:54:34.170356+0000","last_fullsized":"2023-08-01T19:54:34.170356+0000","mapping_epoch":16,"log_start":"0'0","ondisk_log_start":"0'0","created":16,"last_epoch_clean":17,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-08-01T19:54:04.040663+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-08-01T19:54:04.040663+0000","last_clean_scrub_stamp":"2023-08-01T19:54:04.040663+0000","objects_scrubbed":0,"log_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-08-02T23:15:11.148662+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[1,0],"acting":[1,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":1,"acting_primary":1,"purged_snaps":[]},{"pgid":"4.39","version":"0'0","reported_seq":17,"reported_epoch":25,"state":"active+clean","last_fresh":"2023-08-01T19:54:34.170589+0000","last_change":"2023-08-01T19:54:04.475322+0000","last_active":"2023-08-01T19:54:34.170589+0000","last_peered":"2023-08-01T19:54:34.170589+0000","last_clean":"2023-08-01T19:54:34.170589+0000","last_became_active":"2023-08-01T19:54:04.474591+0000","last_became_peered":"2023-08-01T19:54:04.474591+0000","last_unstale":"2023-08-01T19:54:34.170589+0000","last_undegraded":"2023-08-01T19:54:34.170589+0000","last_fullsized":"2023-08-01T19:54:34.170589+0000","mapping_epoch":16,"log_start":"0'0","ondisk_log_start":"0'0","created":16,"last_epoch_clean":17,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-08-01T19:54:04.040663+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-08-01T19:54:04.040663+0000","last_clean_scrub_stamp":"2023-08-01T19:54:04.040663+0000","objects_scrubbed":0,"log_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-08-03T00:29:53.554989+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[1,0],"acting":[1,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":1,"acting_primary":1,"purged_snaps":[]},{"pgid":"4.38","version":"0'0","reported_seq":17,"reported_epoch":25,"state":"active+clean","last_fresh":"2023-08-01T19:54:34.169868+0000","last_change":"2023-08-01T19:54:04.478505+0000","last_active":"2023-08-01T19:54:34.169868+0000","last_peered":"2023-08-01T19:54:34.169868+0000","last_clean":"2023-08-01T19:54:34.169868+0000","last_became_active":"2023-08-01T19:54:04.477325+0000","last_became_peered":"2023-08-01T19:54:04.477325+0000","last_unstale":"2023-08-01T19:54:34.169868+0000","last_undegraded":"2023-08-01T19:54:34.169868+0000","last_fullsized":"2023-08-01T19:54:34.169868+0000","mapping_epoch":16,"log_start":"0'0","ondisk_log_start":"0'0","created":16,"last_epoch_clean":17,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-08-01T19:54:04.040663+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-08-01T19:54:04.040663+0000","last_clean_scrub_stamp":"2023-08-01T19:54:04.040663+0000","objects_scrubbed":0,"log_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-08-03T01:38:12.939736+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[1,0],"acting":[1,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":1,"acting_primary":1,"purged_snaps":[]},{"pgid":"4.37","version":"0'0","reported_seq":17,"reported_epoch":25,"state":"active+clean","last_fresh":"2023-08-01T19:54:34.166541+0000","last_change":"2023-08-01T19:54:04.470971+0000","last_active":"2023-08-01T19:54:34.166541+0000","last_peered":"2023-08-01T19:54:34.166541+0000","last_clean":"2023-08-01T19:54:34.166541+0000","last_became_active":"2023-08-01T19:54:04.469011+0000","last_became_peered":"2023-08-01T19:54:04.469011+0000","last_unstale":"2023-08-01T19:54:34.166541+0000","last_undegraded":"2023-08-01T19:54:34.166541+0000","last_fullsized":"2023-08-01T19:54:34.166541+0000","mapping_epoch":16,"log_start":"0'0","ondisk_log_start":"0'0","created":16,"last_epoch_clean":17,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-08-01T19:54:04.040663+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-08-01T19:54:04.040663+0000","last_clean_scrub_stamp":"2023-08-01T19:54:04.040663+0000","objects_scrubbed":0,"log_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-08-03T06:50:03.420334+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[0,2],"acting":[0,2],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":0,"acting_primary":0,"purged_snaps":[]},{"pgid":"4.36","version":"0'0","reported_seq":18,"reported_epoch":26,"state":"active+clean","last_fresh":"2023-08-01T19:54:37.177019+0000","last_change":"2023-08-01T19:54:04.473523+0000","last_active":"2023-08-01T19:54:37.177019+0000","last_peered":"2023-08-01T19:54:37.177019+0000","last_clean":"2023-08-01T19:54:37.177019+0000","last_became_active":"2023-08-01T19:54:04.473084+0000","last_became_peered":"2023-08-01T19:54:04.473084+0000","last_unstale":"2023-08-01T19:54:37.177019+0000","last_undegraded":"2023-08-01T19:54:37.177019+0000","last_fullsized":"2023-08-01T19:54:37.177019+0000","mapping_epoch":16,"log_start":"0'0","ondisk_log_start":"0'0","created":16,"last_epoch_clean":17,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-08-01T19:54:04.040663+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-08-01T19:54:04.040663+0000","last_clean_scrub_stamp":"2023-08-01T19:54:04.040663+0000","objects_scrubbed":0,"log_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-08-03T04:28:59.042443+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[2,0],"acting":[2,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":2,"acting_primary":2,"purged_snaps":[]},{"pgid":"4.35","version":"0'0","reported_seq":17,"reported_epoch":25,"state":"active+clean","last_fresh":"2023-08-01T19:54:34.171190+0000","last_change":"2023-08-01T19:54:04.475816+0000","last_active":"2023-08-01T19:54:34.171190+0000","last_peered":"2023-08-01T19:54:34.171190+0000","last_clean":"2023-08-01T19:54:34.171190+0000","last_became_active":"2023-08-01T19:54:04.475061+0000","last_became_peered":"2023-08-01T19:54:04.475061+0000","last_unstale":"2023-08-01T19:54:34.171190+0000","last_undegraded":"2023-08-01T19:54:34.171190+0000","last_fullsized":"2023-08-01T19:54:34.171190+0000","mapping_epoch":16,"log_start":"0'0","ondisk_log_start":"0'0","created":16,"last_epoch_clean":17,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-08-01T19:54:04.040663+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-08-01T19:54:04.040663+0000","last_clean_scrub_stamp":"2023-08-01T19:54:04.040663+0000","objects_scrubbed":0,"log_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-08-02T22:07:41.305488+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[1,0],"acting":[1,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":1,"acting_primary":1,"purged_snaps":[]},{"pgid":"4.34","version":"0'0","reported_seq":18,"reported_epoch":26,"state":"active+clean","last_fresh":"2023-08-01T19:54:37.176659+0000","last_change":"2023-08-01T19:54:04.468009+0000","last_active":"2023-08-01T19:54:37.176659+0000","last_peered":"2023-08-01T19:54:37.176659+0000","last_clean":"2023-08-01T19:54:37.176659+0000","last_became_active":"2023-08-01T19:54:04.467568+0000","last_became_peered":"2023-08-01T19:54:04.467568+0000","last_unstale":"2023-08-01T19:54:37.176659+0000","last_undegraded":"2023-08-01T19:54:37.176659+0000","last_fullsized":"2023-08-01T19:54:37.176659+0000","mapping_epoch":16,"log_start":"0'0","ondisk_log_start":"0'0","created":16,"last_epoch_clean":17,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-08-01T19:54:04.040663+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-08-01T19:54:04.040663+0000","last_clean_scrub_stamp":"2023-08-01T19:54:04.040663+0000","objects_scrubbed":0,"log_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-08-03T04:53:44.017572+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[2,1],"acting":[2,1],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":2,"acting_primary":2,"purged_snaps":[]},{"pgid":"4.33","version":"0'0","reported_seq":18,"reported_epoch":26,"state":"active+clean","last_fresh":"2023-08-01T19:54:37.176560+0000","last_change":"2023-08-01T19:54:04.466770+0000","last_active":"2023-08-01T19:54:37.176560+0000","last_peered":"2023-08-01T19:54:37.176560+0000","last_clean":"2023-08-01T19:54:37.176560+0000","last_became_active":"2023-08-01T19:54:04.466460+0000","last_became_peered":"2023-08-01T19:54:04.466460+0000","last_unstale":"2023-08-01T19:54:37.176560+0000","last_undegraded":"2023-08-01T19:54:37.176560+0000","last_fullsized":"2023-08-01T19:54:37.176560+0000","mapping_epoch":16,"log_start":"0'0","ondisk_log_start":"0'0","created":16,"last_epoch_clean":17,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-08-01T19:54:04.040663+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-08-01T19:54:04.040663+0000","last_clean_scrub_stamp":"2023-08-01T19:54:04.040663+0000","objects_scrubbed":0,"log_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-08-03T06:04:11.595951+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[2,0],"acting":[2,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":2,"acting_primary":2,"purged_snaps":[]},{"pgid":"4.32","version":"0'0","reported_seq":17,"reported_epoch":25,"state":"active+clean","last_fresh":"2023-08-01T19:54:34.170791+0000","last_change":"2023-08-01T19:54:04.466634+0000","last_active":"2023-08-01T19:54:34.170791+0000","last_peered":"2023-08-01T19:54:34.170791+0000","last_clean":"2023-08-01T19:54:34.170791+0000","last_became_active":"2023-08-01T19:54:04.466302+0000","last_became_peered":"2023-08-01T19:54:04.466302+0000","last_unstale":"2023-08-01T19:54:34.170791+0000","last_undegraded":"2023-08-01T19:54:34.170791+0000","last_fullsized":"2023-08-01T19:54:34.170791+0000","mapping_epoch":16,"log_start":"0'0","ondisk_log_start":"0'0","created":16,"last_epoch_clean":17,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-08-01T19:54:04.040663+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-08-01T19:54:04.040663+0000","last_clean_scrub_stamp":"2023-08-01T19:54:04.040663+0000","objects_scrubbed":0,"log_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-08-03T05:46:11.085577+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[1,2],"acting":[1,2],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":1,"acting_primary":1,"purged_snaps":[]},{"pgid":"4.31","version":"0'0","reported_seq":17,"reported_epoch":25,"state":"active+clean","last_fresh":"2023-08-01T19:54:34.170371+0000","last_change":"2023-08-01T19:54:04.472407+0000","last_active":"2023-08-01T19:54:34.170371+0000","last_peered":"2023-08-01T19:54:34.170371+0000","last_clean":"2023-08-01T19:54:34.170371+0000","last_became_active":"2023-08-01T19:54:04.472008+0000","last_became_peered":"2023-08-01T19:54:04.472008+0000","last_unstale":"2023-08-01T19:54:34.170371+0000","last_undegraded":"2023-08-01T19:54:34.170371+0000","last_fullsized":"2023-08-01T19:54:34.170371+0000","mapping_epoch":16,"log_start":"0'0","ondisk_log_start":"0'0","created":16,"last_epoch_clean":17,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-08-01T19:54:04.040663+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-08-01T19:54:04.040663+0000","last_clean_scrub_stamp":"2023-08-01T19:54:04.040663+0000","objects_scrubbed":0,"log_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-08-02T22:42:25.293502+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[1,2],"acting":[1,2],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":1,"acting_primary":1,"purged_snaps":[]},{"pgid":"4.30","version":"0'0","reported_seq":17,"reported_epoch":25,"state":"active+clean","last_fresh":"2023-08-01T19:54:34.169921+0000","last_change":"2023-08-01T19:54:04.478283+0000","last_active":"2023-08-01T19:54:34.169921+0000","last_peered":"2023-08-01T19:54:34.169921+0000","last_clean":"2023-08-01T19:54:34.169921+0000","last_became_active":"2023-08-01T19:54:04.476620+0000","last_became_peered":"2023-08-01T19:54:04.476620+0000","last_unstale":"2023-08-01T19:54:34.169921+0000","last_undegraded":"2023-08-01T19:54:34.169921+0000","last_fullsized":"2023-08-01T19:54:34.169921+0000","mapping_epoch":16,"log_start":"0'0","ondisk_log_start":"0'0","created":16,"last_epoch_clean":17,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-08-01T19:54:04.040663+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-08-01T19:54:04.040663+0000","last_clean_scrub_stamp":"2023-08-01T19:54:04.040663+0000","objects_scrubbed":0,"log_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-08-03T02:27:17.063518+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[1,0],"acting":[1,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":1,"acting_primary":1,"purged_snaps":[]},{"pgid":"4.2f","version":"0'0","reported_seq":17,"reported_epoch":25,"state":"active+clean","last_fresh":"2023-08-01T19:54:34.166628+0000","last_change":"2023-08-01T19:54:04.470302+0000","last_active":"2023-08-01T19:54:34.166628+0000","last_peered":"2023-08-01T19:54:34.166628+0000","last_clean":"2023-08-01T19:54:34.166628+0000","last_became_active":"2023-08-01T19:54:04.468919+0000","last_became_peered":"2023-08-01T19:54:04.468919+0000","last_unstale":"2023-08-01T19:54:34.166628+0000","last_undegraded":"2023-08-01T19:54:34.166628+0000","last_fullsized":"2023-08-01T19:54:34.166628+0000","mapping_epoch":16,"log_start":"0'0","ondisk_log_start":"0'0","created":16,"last_epoch_clean":17,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-08-01T19:54:04.040663+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-08-01T19:54:04.040663+0000","last_clean_scrub_stamp":"2023-08-01T19:54:04.040663+0000","objects_scrubbed":0,"log_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-08-02T22:42:25.293502+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[0,2],"acting":[0,2],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":0,"acting_primary":0,"purged_snaps":[]},{"pgid":"4.2e","version":"0'0","reported_seq":18,"reported_epoch":26,"state":"active+clean","last_fresh":"2023-08-01T19:54:37.177124+0000","last_change":"2023-08-01T19:54:04.474058+0000","last_active":"2023-08-01T19:54:37.177124+0000","last_peered":"2023-08-01T19:54:37.177124+0000","last_clean":"2023-08-01T19:54:37.177124+0000","last_became_active":"2023-08-01T19:54:04.473355+0000","last_became_peered":"2023-08-01T19:54:04.473355+0000","last_unstale":"2023-08-01T19:54:37.177124+0000","last_undegraded":"2023-08-01T19:54:37.177124+0000","last_fullsized":"2023-08-01T19:54:37.177124+0000","mapping_epoch":16,"log_start":"0'0","ondisk_log_start":"0'0","created":16,"last_epoch_clean":17,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-08-01T19:54:04.040663+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-08-01T19:54:04.040663+0000","last_clean_scrub_stamp":"2023-08-01T19:54:04.040663+0000","objects_scrubbed":0,"log_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-08-03T04:55:54.197252+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[2,0],"acting":[2,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":2,"acting_primary":2,"purged_snaps":[]},{"pgid":"4.2d","version":"0'0","reported_seq":17,"reported_epoch":25,"state":"active+clean","last_fresh":"2023-08-01T19:54:34.166967+0000","last_change":"2023-08-01T19:54:04.468775+0000","last_active":"2023-08-01T19:54:34.166967+0000","last_peered":"2023-08-01T19:54:34.166967+0000","last_clean":"2023-08-01T19:54:34.166967+0000","last_became_active":"2023-08-01T19:54:04.467274+0000","last_became_peered":"2023-08-01T19:54:04.467274+0000","last_unstale":"2023-08-01T19:54:34.166967+0000","last_undegraded":"2023-08-01T19:54:34.166967+0000","last_fullsized":"2023-08-01T19:54:34.166967+0000","mapping_epoch":16,"log_start":"0'0","ondisk_log_start":"0'0","created":16,"last_epoch_clean":17,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-08-01T19:54:04.040663+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-08-01T19:54:04.040663+0000","last_clean_scrub_stamp":"2023-08-01T19:54:04.040663+0000","objects_scrubbed":0,"log_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-08-02T23:00:37.537286+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[0,2],"acting":[0,2],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":0,"acting_primary":0,"purged_snaps":[]},{"pgid":"4.2c","version":"0'0","reported_seq":17,"reported_epoch":25,"state":"active+clean","last_fresh":"2023-08-01T19:54:34.170687+0000","last_change":"2023-08-01T19:54:04.478409+0000","last_active":"2023-08-01T19:54:34.170687+0000","last_peered":"2023-08-01T19:54:34.170687+0000","last_clean":"2023-08-01T19:54:34.170687+0000","last_became_active":"2023-08-01T19:54:04.477133+0000","last_became_peered":"2023-08-01T19:54:04.477133+0000","last_unstale":"2023-08-01T19:54:34.170687+0000","last_undegraded":"2023-08-01T19:54:34.170687+0000","last_fullsized":"2023-08-01T19:54:34.170687+0000","mapping_epoch":16,"log_start":"0'0","ondisk_log_start":"0'0","created":16,"last_epoch_clean":17,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-08-01T19:54:04.040663+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-08-01T19:54:04.040663+0000","last_clean_scrub_stamp":"2023-08-01T19:54:04.040663+0000","objects_scrubbed":0,"log_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-08-02T22:15:19.744281+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[1,0],"acting":[1,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":1,"acting_primary":1,"purged_snaps":[]},{"pgid":"4.2b","version":"0'0","reported_seq":17,"reported_epoch":25,"state":"active+clean","last_fresh":"2023-08-01T19:54:34.170156+0000","last_change":"2023-08-01T19:54:04.474047+0000","last_active":"2023-08-01T19:54:34.170156+0000","last_peered":"2023-08-01T19:54:34.170156+0000","last_clean":"2023-08-01T19:54:34.170156+0000","last_became_active":"2023-08-01T19:54:04.473578+0000","last_became_peered":"2023-08-01T19:54:04.473578+0000","last_unstale":"2023-08-01T19:54:34.170156+0000","last_undegraded":"2023-08-01T19:54:34.170156+0000","last_fullsized":"2023-08-01T19:54:34.170156+0000","mapping_epoch":16,"log_start":"0'0","ondisk_log_start":"0'0","created":16,"last_epoch_clean":17,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-08-01T19:54:04.040663+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-08-01T19:54:04.040663+0000","last_clean_scrub_stamp":"2023-08-01T19:54:04.040663+0000","objects_scrubbed":0,"log_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-08-03T05:39:29.199142+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[1,0],"acting":[1,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":1,"acting_primary":1,"purged_snaps":[]},{"pgid":"4.2a","version":"0'0","reported_seq":18,"reported_epoch":26,"state":"active+clean","last_fresh":"2023-08-01T19:54:37.177488+0000","last_change":"2023-08-01T19:54:04.469281+0000","last_active":"2023-08-01T19:54:37.177488+0000","last_peered":"2023-08-01T19:54:37.177488+0000","last_clean":"2023-08-01T19:54:37.177488+0000","last_became_active":"2023-08-01T19:54:04.468771+0000","last_became_peered":"2023-08-01T19:54:04.468771+0000","last_unstale":"2023-08-01T19:54:37.177488+0000","last_undegraded":"2023-08-01T19:54:37.177488+0000","last_fullsized":"2023-08-01T19:54:37.177488+0000","mapping_epoch":16,"log_start":"0'0","ondisk_log_start":"0'0","created":16,"last_epoch_clean":17,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-08-01T19:54:04.040663+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-08-01T19:54:04.040663+0000","last_clean_scrub_stamp":"2023-08-01T19:54:04.040663+0000","objects_scrubbed":0,"log_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-08-03T01:15:27.748810+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[2,1],"acting":[2,1],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":2,"acting_primary":2,"purged_snaps":[]},{"pgid":"4.29","version":"0'0","reported_seq":17,"reported_epoch":25,"state":"active+clean","last_fresh":"2023-08-01T19:54:34.165350+0000","last_change":"2023-08-01T19:54:04.466694+0000","last_active":"2023-08-01T19:54:34.165350+0000","last_peered":"2023-08-01T19:54:34.165350+0000","last_clean":"2023-08-01T19:54:34.165350+0000","last_became_active":"2023-08-01T19:54:04.466250+0000","last_became_peered":"2023-08-01T19:54:04.466250+0000","last_unstale":"2023-08-01T19:54:34.165350+0000","last_undegraded":"2023-08-01T19:54:34.165350+0000","last_fullsized":"2023-08-01T19:54:34.165350+0000","mapping_epoch":16,"log_start":"0'0","ondisk_log_start":"0'0","created":16,"last_epoch_clean":17,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-08-01T19:54:04.040663+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-08-01T19:54:04.040663+0000","last_clean_scrub_stamp":"2023-08-01T19:54:04.040663+0000","objects_scrubbed":0,"log_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-08-03T01:00:18.725898+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[0,1],"acting":[0,1],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":0,"acting_primary":0,"purged_snaps":[]},{"pgid":"4.28","version":"0'0","reported_seq":18,"reported_epoch":26,"state":"active+clean","last_fresh":"2023-08-01T19:54:37.176548+0000","last_change":"2023-08-01T19:54:04.468160+0000","last_active":"2023-08-01T19:54:37.176548+0000","last_peered":"2023-08-01T19:54:37.176548+0000","last_clean":"2023-08-01T19:54:37.176548+0000","last_became_active":"2023-08-01T19:54:04.467625+0000","last_became_peered":"2023-08-01T19:54:04.467625+0000","last_unstale":"2023-08-01T19:54:37.176548+0000","last_undegraded":"2023-08-01T19:54:37.176548+0000","last_fullsized":"2023-08-01T19:54:37.176548+0000","mapping_epoch":16,"log_start":"0'0","ondisk_log_start":"0'0","created":16,"last_epoch_clean":17,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-08-01T19:54:04.040663+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-08-01T19:54:04.040663+0000","last_clean_scrub_stamp":"2023-08-01T19:54:04.040663+0000","objects_scrubbed":0,"log_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-08-02T21:27:52.506153+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[2,0],"acting":[2,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":2,"acting_primary":2,"purged_snaps":[]},{"pgid":"4.27","version":"0'0","reported_seq":18,"reported_epoch":26,"state":"active+clean","last_fresh":"2023-08-01T19:54:37.177422+0000","last_change":"2023-08-01T19:54:04.469187+0000","last_active":"2023-08-01T19:54:37.177422+0000","last_peered":"2023-08-01T19:54:37.177422+0000","last_clean":"2023-08-01T19:54:37.177422+0000","last_became_active":"2023-08-01T19:54:04.468628+0000","last_became_peered":"2023-08-01T19:54:04.468628+0000","last_unstale":"2023-08-01T19:54:37.177422+0000","last_undegraded":"2023-08-01T19:54:37.177422+0000","last_fullsized":"2023-08-01T19:54:37.177422+0000","mapping_epoch":16,"log_start":"0'0","ondisk_log_start":"0'0","created":16,"last_epoch_clean":17,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-08-01T19:54:04.040663+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-08-01T19:54:04.040663+0000","last_clean_scrub_stamp":"2023-08-01T19:54:04.040663+0000","objects_scrubbed":0,"log_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-08-03T00:07:29.565677+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[2,1],"acting":[2,1],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":2,"acting_primary":2,"purged_snaps":[]},{"pgid":"4.26","version":"0'0","reported_seq":17,"reported_epoch":25,"state":"active+clean","last_fresh":"2023-08-01T19:54:34.166499+0000","last_change":"2023-08-01T19:54:04.470942+0000","last_active":"2023-08-01T19:54:34.166499+0000","last_peered":"2023-08-01T19:54:34.166499+0000","last_clean":"2023-08-01T19:54:34.166499+0000","last_became_active":"2023-08-01T19:54:04.470564+0000","last_became_peered":"2023-08-01T19:54:04.470564+0000","last_unstale":"2023-08-01T19:54:34.166499+0000","last_undegraded":"2023-08-01T19:54:34.166499+0000","last_fullsized":"2023-08-01T19:54:34.166499+0000","mapping_epoch":16,"log_start":"0'0","ondisk_log_start":"0'0","created":16,"last_epoch_clean":17,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-08-01T19:54:04.040663+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-08-01T19:54:04.040663+0000","last_clean_scrub_stamp":"2023-08-01T19:54:04.040663+0000","objects_scrubbed":0,"log_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-08-03T04:43:21.408174+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[0,1],"acting":[0,1],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":0,"acting_primary":0,"purged_snaps":[]},{"pgid":"4.25","version":"0'0","reported_seq":17,"reported_epoch":25,"state":"active+clean","last_fresh":"2023-08-01T19:54:34.171260+0000","last_change":"2023-08-01T19:54:04.474813+0000","last_active":"2023-08-01T19:54:34.171260+0000","last_peered":"2023-08-01T19:54:34.171260+0000","last_clean":"2023-08-01T19:54:34.171260+0000","last_became_active":"2023-08-01T19:54:04.472530+0000","last_became_peered":"2023-08-01T19:54:04.472530+0000","last_unstale":"2023-08-01T19:54:34.171260+0000","last_undegraded":"2023-08-01T19:54:34.171260+0000","last_fullsized":"2023-08-01T19:54:34.171260+0000","mapping_epoch":16,"log_start":"0'0","ondisk_log_start":"0'0","created":16,"last_epoch_clean":17,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-08-01T19:54:04.040663+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-08-01T19:54:04.040663+0000","last_clean_scrub_stamp":"2023-08-01T19:54:04.040663+0000","objects_scrubbed":0,"log_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-08-03T01:00:18.725898+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[1,2],"acting":[1,2],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":1,"acting_primary":1,"purged_snaps":[]},{"pgid":"3.1a","version":"17'1","reported_seq":20,"reported_epoch":26,"state":"active+clean","last_fresh":"2023-08-01T19:54:37.177456+0000","last_change":"2023-08-01T19:54:04.063936+0000","last_active":"2023-08-01T19:54:37.177456+0000","last_peered":"2023-08-01T19:54:37.177456+0000","last_clean":"2023-08-01T19:54:37.177456+0000","last_became_active":"2023-08-01T19:54:04.063674+0000","last_became_peered":"2023-08-01T19:54:04.063674+0000","last_unstale":"2023-08-01T19:54:37.177456+0000","last_undegraded":"2023-08-01T19:54:37.177456+0000","last_fullsized":"2023-08-01T19:54:37.177456+0000","mapping_epoch":15,"log_start":"0'0","ondisk_log_start":"0'0","created":15,"last_epoch_clean":16,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-08-01T19:54:03.032665+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-08-01T19:54:03.032665+0000","last_clean_scrub_stamp":"2023-08-01T19:54:03.032665+0000","objects_scrubbed":0,"log_size":1,"ondisk_log_size":1,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-08-03T00:06:00.058200+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[2,0],"acting":[2,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":2,"acting_primary":2,"purged_snaps":[]},{"pgid":"4.1d","version":"0'0","reported_seq":18,"reported_epoch":26,"state":"active+clean","last_fresh":"2023-08-01T19:54:37.177483+0000","last_change":"2023-08-01T19:54:04.471916+0000","last_active":"2023-08-01T19:54:37.177483+0000","last_peered":"2023-08-01T19:54:37.177483+0000","last_clean":"2023-08-01T19:54:37.177483+0000","last_became_active":"2023-08-01T19:54:04.471480+0000","last_became_peered":"2023-08-01T19:54:04.471480+0000","last_unstale":"2023-08-01T19:54:37.177483+0000","last_undegraded":"2023-08-01T19:54:37.177483+0000","last_fullsized":"2023-08-01T19:54:37.177483+0000","mapping_epoch":16,"log_start":"0'0","ondisk_log_start":"0'0","created":16,"last_epoch_clean":17,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-08-01T19:54:04.040663+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-08-01T19:54:04.040663+0000","last_clean_scrub_stamp":"2023-08-01T19:54:04.040663+0000","objects_scrubbed":0,"log_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-08-02T21:19:17.547590+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[2,1],"acting":[2,1],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":2,"acting_primary":2,"purged_snaps":[]},{"pgid":"3.19","version":"0'0","reported_seq":18,"reported_epoch":25,"state":"active+clean","last_fresh":"2023-08-01T19:54:34.165461+0000","last_change":"2023-08-01T19:54:04.067837+0000","last_active":"2023-08-01T19:54:34.165461+0000","last_peered":"2023-08-01T19:54:34.165461+0000","last_clean":"2023-08-01T19:54:34.165461+0000","last_became_active":"2023-08-01T19:54:04.067535+0000","last_became_peered":"2023-08-01T19:54:04.067535+0000","last_unstale":"2023-08-01T19:54:34.165461+0000","last_undegraded":"2023-08-01T19:54:34.165461+0000","last_fullsized":"2023-08-01T19:54:34.165461+0000","mapping_epoch":15,"log_start":"0'0","ondisk_log_start":"0'0","created":15,"last_epoch_clean":16,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-08-01T19:54:03.032665+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-08-01T19:54:03.032665+0000","last_clean_scrub_stamp":"2023-08-01T19:54:03.032665+0000","objects_scrubbed":0,"log_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-08-02T20:56:47.324761+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[0,1],"acting":[0,1],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":0,"acting_primary":0,"purged_snaps":[]},{"pgid":"4.1e","version":"0'0","reported_seq":17,"reported_epoch":25,"state":"active+clean","last_fresh":"2023-08-01T19:54:34.166553+0000","last_change":"2023-08-01T19:54:04.470544+0000","last_active":"2023-08-01T19:54:34.166553+0000","last_peered":"2023-08-01T19:54:34.166553+0000","last_clean":"2023-08-01T19:54:34.166553+0000","last_became_active":"2023-08-01T19:54:04.469657+0000","last_became_peered":"2023-08-01T19:54:04.469657+0000","last_unstale":"2023-08-01T19:54:34.166553+0000","last_undegraded":"2023-08-01T19:54:34.166553+0000","last_fullsized":"2023-08-01T19:54:34.166553+0000","mapping_epoch":16,"log_start":"0'0","ondisk_log_start":"0'0","created":16,"last_epoch_clean":17,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-08-01T19:54:04.040663+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-08-01T19:54:04.040663+0000","last_clean_scrub_stamp":"2023-08-01T19:54:04.040663+0000","objects_scrubbed":0,"log_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-08-02T23:12:30.830199+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[0,1],"acting":[0,1],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":0,"acting_primary":0,"purged_snaps":[]},{"pgid":"3.18","version":"0'0","reported_seq":18,"reported_epoch":25,"state":"active+clean","last_fresh":"2023-08-01T19:54:34.165020+0000","last_change":"2023-08-01T19:54:04.064289+0000","last_active":"2023-08-01T19:54:34.165020+0000","last_peered":"2023-08-01T19:54:34.165020+0000","last_clean":"2023-08-01T19:54:34.165020+0000","last_became_active":"2023-08-01T19:54:04.063971+0000","last_became_peered":"2023-08-01T19:54:04.063971+0000","last_unstale":"2023-08-01T19:54:34.165020+0000","last_undegraded":"2023-08-01T19:54:34.165020+0000","last_fullsized":"2023-08-01T19:54:34.165020+0000","mapping_epoch":15,"log_start":"0'0","ondisk_log_start":"0'0","created":15,"last_epoch_clean":16,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-08-01T19:54:03.032665+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-08-01T19:54:03.032665+0000","last_clean_scrub_stamp":"2023-08-01T19:54:03.032665+0000","objects_scrubbed":0,"log_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-08-03T04:09:30.496098+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[0,2],"acting":[0,2],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":0,"acting_primary":0,"purged_snaps":[]},{"pgid":"4.1f","version":"0'0","reported_seq":18,"reported_epoch":26,"state":"active+clean","last_fresh":"2023-08-01T19:54:37.177365+0000","last_change":"2023-08-01T19:54:04.472227+0000","last_active":"2023-08-01T19:54:37.177365+0000","last_peered":"2023-08-01T19:54:37.177365+0000","last_clean":"2023-08-01T19:54:37.177365+0000","last_became_active":"2023-08-01T19:54:04.471767+0000","last_became_peered":"2023-08-01T19:54:04.471767+0000","last_unstale":"2023-08-01T19:54:37.177365+0000","last_undegraded":"2023-08-01T19:54:37.177365+0000","last_fullsized":"2023-08-01T19:54:37.177365+0000","mapping_epoch":16,"log_start":"0'0","ondisk_log_start":"0'0","created":16,"last_epoch_clean":17,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-08-01T19:54:04.040663+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-08-01T19:54:04.040663+0000","last_clean_scrub_stamp":"2023-08-01T19:54:04.040663+0000","objects_scrubbed":0,"log_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-08-02T20:25:25.280329+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[2,1],"acting":[2,1],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":2,"acting_primary":2,"purged_snaps":[]},{"pgid":"3.17","version":"0'0","reported_seq":18,"reported_epoch":25,"state":"active+clean","last_fresh":"2023-08-01T19:54:34.166837+0000","last_change":"2023-08-01T19:54:04.067975+0000","last_active":"2023-08-01T19:54:34.166837+0000","last_peered":"2023-08-01T19:54:34.166837+0000","last_clean":"2023-08-01T19:54:34.166837+0000","last_became_active":"2023-08-01T19:54:04.067577+0000","last_became_peered":"2023-08-01T19:54:04.067577+0000","last_unstale":"2023-08-01T19:54:34.166837+0000","last_undegraded":"2023-08-01T19:54:34.166837+0000","last_fullsized":"2023-08-01T19:54:34.166837+0000","mapping_epoch":15,"log_start":"0'0","ondisk_log_start":"0'0","created":15,"last_epoch_clean":16,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-08-01T19:54:03.032665+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-08-01T19:54:03.032665+0000","last_clean_scrub_stamp":"2023-08-01T19:54:03.032665+0000","objects_scrubbed":0,"log_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-08-03T07:13:34.025722+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[0,1],"acting":[0,1],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":0,"acting_primary":0,"purged_snaps":[]},{"pgid":"4.10","version":"0'0","reported_seq":17,"reported_epoch":25,"state":"active+clean","last_fresh":"2023-08-01T19:54:34.165041+0000","last_change":"2023-08-01T19:54:04.467146+0000","last_active":"2023-08-01T19:54:34.165041+0000","last_peered":"2023-08-01T19:54:34.165041+0000","last_clean":"2023-08-01T19:54:34.165041+0000","last_became_active":"2023-08-01T19:54:04.466627+0000","last_became_peered":"2023-08-01T19:54:04.466627+0000","last_unstale":"2023-08-01T19:54:34.165041+0000","last_undegraded":"2023-08-01T19:54:34.165041+0000","last_fullsized":"2023-08-01T19:54:34.165041+0000","mapping_epoch":16,"log_start":"0'0","ondisk_log_start":"0'0","created":16,"last_epoch_clean":17,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-08-01T19:54:04.040663+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-08-01T19:54:04.040663+0000","last_clean_scrub_stamp":"2023-08-01T19:54:04.040663+0000","objects_scrubbed":0,"log_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-08-03T04:43:26.793480+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[0,2],"acting":[0,2],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":0,"acting_primary":0,"purged_snaps":[]},{"pgid":"3.16","version":"0'0","reported_seq":18,"reported_epoch":25,"state":"active+clean","last_fresh":"2023-08-01T19:54:34.170770+0000","last_change":"2023-08-01T19:54:04.065042+0000","last_active":"2023-08-01T19:54:34.170770+0000","last_peered":"2023-08-01T19:54:34.170770+0000","last_clean":"2023-08-01T19:54:34.170770+0000","last_became_active":"2023-08-01T19:54:04.064040+0000","last_became_peered":"2023-08-01T19:54:04.064040+0000","last_unstale":"2023-08-01T19:54:34.170770+0000","last_undegraded":"2023-08-01T19:54:34.170770+0000","last_fullsized":"2023-08-01T19:54:34.170770+0000","mapping_epoch":15,"log_start":"0'0","ondisk_log_start":"0'0","created":15,"last_epoch_clean":16,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-08-01T19:54:03.032665+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-08-01T19:54:03.032665+0000","last_clean_scrub_stamp":"2023-08-01T19:54:03.032665+0000","objects_scrubbed":0,"log_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-08-03T03:40:43.460182+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[1,0],"acting":[1,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":1,"acting_primary":1,"purged_snaps":[]},{"pgid":"4.11","version":"0'0","reported_seq":17,"reported_epoch":25,"state":"active+clean","last_fresh":"2023-08-01T19:54:34.165550+0000","last_change":"2023-08-01T19:54:04.470401+0000","last_active":"2023-08-01T19:54:34.165550+0000","last_peered":"2023-08-01T19:54:34.165550+0000","last_clean":"2023-08-01T19:54:34.165550+0000","last_became_active":"2023-08-01T19:54:04.469680+0000","last_became_peered":"2023-08-01T19:54:04.469680+0000","last_unstale":"2023-08-01T19:54:34.165550+0000","last_undegraded":"2023-08-01T19:54:34.165550+0000","last_fullsized":"2023-08-01T19:54:34.165550+0000","mapping_epoch":16,"log_start":"0'0","ondisk_log_start":"0'0","created":16,"last_epoch_clean":17,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-08-01T19:54:04.040663+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-08-01T19:54:04.040663+0000","last_clean_scrub_stamp":"2023-08-01T19:54:04.040663+0000","objects_scrubbed":0,"log_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-08-03T03:58:06.360840+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[0,1],"acting":[0,1],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":0,"acting_primary":0,"purged_snaps":[]},{"pgid":"3.15","version":"17'3","reported_seq":22,"reported_epoch":26,"state":"active+clean","last_fresh":"2023-08-01T19:54:37.176862+0000","last_change":"2023-08-01T19:54:04.065443+0000","last_active":"2023-08-01T19:54:37.176862+0000","last_peered":"2023-08-01T19:54:37.176862+0000","last_clean":"2023-08-01T19:54:37.176862+0000","last_became_active":"2023-08-01T19:54:04.065112+0000","last_became_peered":"2023-08-01T19:54:04.065112+0000","last_unstale":"2023-08-01T19:54:37.176862+0000","last_undegraded":"2023-08-01T19:54:37.176862+0000","last_fullsized":"2023-08-01T19:54:37.176862+0000","mapping_epoch":15,"log_start":"0'0","ondisk_log_start":"0'0","created":15,"last_epoch_clean":16,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-08-01T19:54:03.032665+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-08-01T19:54:03.032665+0000","last_clean_scrub_stamp":"2023-08-01T19:54:03.032665+0000","objects_scrubbed":0,"log_size":3,"ondisk_log_size":3,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-08-03T03:27:50.887004+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":90,"num_objects":2,"num_object_clones":0,"num_object_copies":4,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":2,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":4,"num_write_kb":1,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":1,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[2,1],"acting":[2,1],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":2,"acting_primary":2,"purged_snaps":[]},{"pgid":"4.12","version":"0'0","reported_seq":17,"reported_epoch":25,"state":"active+clean","last_fresh":"2023-08-01T19:54:34.165496+0000","last_change":"2023-08-01T19:54:04.467822+0000","last_active":"2023-08-01T19:54:34.165496+0000","last_peered":"2023-08-01T19:54:34.165496+0000","last_clean":"2023-08-01T19:54:34.165496+0000","last_became_active":"2023-08-01T19:54:04.466667+0000","last_became_peered":"2023-08-01T19:54:04.466667+0000","last_unstale":"2023-08-01T19:54:34.165496+0000","last_undegraded":"2023-08-01T19:54:34.165496+0000","last_fullsized":"2023-08-01T19:54:34.165496+0000","mapping_epoch":16,"log_start":"0'0","ondisk_log_start":"0'0","created":16,"last_epoch_clean":17,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-08-01T19:54:04.040663+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-08-01T19:54:04.040663+0000","last_clean_scrub_stamp":"2023-08-01T19:54:04.040663+0000","objects_scrubbed":0,"log_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-08-03T02:57:18.148077+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[0,2],"acting":[0,2],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":0,"acting_primary":0,"purged_snaps":[]},{"pgid":"3.14","version":"17'6","reported_seq":24,"reported_epoch":25,"state":"active+clean","last_fresh":"2023-08-01T19:54:34.170612+0000","last_change":"2023-08-01T19:54:04.061419+0000","last_active":"2023-08-01T19:54:34.170612+0000","last_peered":"2023-08-01T19:54:34.170612+0000","last_clean":"2023-08-01T19:54:34.170612+0000","last_became_active":"2023-08-01T19:54:04.061078+0000","last_became_peered":"2023-08-01T19:54:04.061078+0000","last_unstale":"2023-08-01T19:54:34.170612+0000","last_undegraded":"2023-08-01T19:54:34.170612+0000","last_fullsized":"2023-08-01T19:54:34.170612+0000","mapping_epoch":15,"log_start":"0'0","ondisk_log_start":"0'0","created":15,"last_epoch_clean":16,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-08-01T19:54:03.032665+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-08-01T19:54:03.032665+0000","last_clean_scrub_stamp":"2023-08-01T19:54:03.032665+0000","objects_scrubbed":0,"log_size":6,"ondisk_log_size":6,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-08-02T21:35:44.874727+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":1536,"num_objects":4,"num_object_clones":0,"num_object_copies":8,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":4,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":6,"num_write_kb":3,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":1,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[1,2],"acting":[1,2],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":1,"acting_primary":1,"purged_snaps":[]},{"pgid":"4.13","version":"0'0","reported_seq":17,"reported_epoch":25,"state":"active+clean","last_fresh":"2023-08-01T19:54:34.170551+0000","last_change":"2023-08-01T19:54:04.466400+0000","last_active":"2023-08-01T19:54:34.170551+0000","last_peered":"2023-08-01T19:54:34.170551+0000","last_clean":"2023-08-01T19:54:34.170551+0000","last_became_active":"2023-08-01T19:54:04.465979+0000","last_became_peered":"2023-08-01T19:54:04.465979+0000","last_unstale":"2023-08-01T19:54:34.170551+0000","last_undegraded":"2023-08-01T19:54:34.170551+0000","last_fullsized":"2023-08-01T19:54:34.170551+0000","mapping_epoch":16,"log_start":"0'0","ondisk_log_start":"0'0","created":16,"last_epoch_clean":17,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-08-01T19:54:04.040663+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-08-01T19:54:04.040663+0000","last_clean_scrub_stamp":"2023-08-01T19:54:04.040663+0000","objects_scrubbed":0,"log_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-08-02T20:20:59.989030+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[1,2],"acting":[1,2],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":1,"acting_primary":1,"purged_snaps":[]},{"pgid":"3.13","version":"17'2","reported_seq":20,"reported_epoch":25,"state":"active+clean","last_fresh":"2023-08-01T19:54:34.170408+0000","last_change":"2023-08-01T19:54:04.065212+0000","last_active":"2023-08-01T19:54:34.170408+0000","last_peered":"2023-08-01T19:54:34.170408+0000","last_clean":"2023-08-01T19:54:34.170408+0000","last_became_active":"2023-08-01T19:54:04.064375+0000","last_became_peered":"2023-08-01T19:54:04.064375+0000","last_unstale":"2023-08-01T19:54:34.170408+0000","last_undegraded":"2023-08-01T19:54:34.170408+0000","last_fullsized":"2023-08-01T19:54:34.170408+0000","mapping_epoch":15,"log_start":"0'0","ondisk_log_start":"0'0","created":15,"last_epoch_clean":16,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-08-01T19:54:03.032665+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-08-01T19:54:03.032665+0000","last_clean_scrub_stamp":"2023-08-01T19:54:03.032665+0000","objects_scrubbed":0,"log_size":2,"ondisk_log_size":2,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-08-03T06:17:37.910752+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":34,"num_objects":2,"num_object_clones":0,"num_object_copies":4,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":2,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":3,"num_write_kb":6,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":1,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[1,0],"acting":[1,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":1,"acting_primary":1,"purged_snaps":[]},{"pgid":"4.14","version":"0'0","reported_seq":18,"reported_epoch":26,"state":"active+clean","last_fresh":"2023-08-01T19:54:37.176730+0000","last_change":"2023-08-01T19:54:04.464446+0000","last_active":"2023-08-01T19:54:37.176730+0000","last_peered":"2023-08-01T19:54:37.176730+0000","last_clean":"2023-08-01T19:54:37.176730+0000","last_became_active":"2023-08-01T19:54:04.464021+0000","last_became_peered":"2023-08-01T19:54:04.464021+0000","last_unstale":"2023-08-01T19:54:37.176730+0000","last_undegraded":"2023-08-01T19:54:37.176730+0000","last_fullsized":"2023-08-01T19:54:37.176730+0000","mapping_epoch":16,"log_start":"0'0","ondisk_log_start":"0'0","created":16,"last_epoch_clean":17,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-08-01T19:54:04.040663+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-08-01T19:54:04.040663+0000","last_clean_scrub_stamp":"2023-08-01T19:54:04.040663+0000","objects_scrubbed":0,"log_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-08-02T20:26:51.080849+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[2,0],"acting":[2,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":2,"acting_primary":2,"purged_snaps":[]},{"pgid":"3.12","version":"0'0","reported_seq":18,"reported_epoch":25,"state":"active+clean","last_fresh":"2023-08-01T19:54:34.165656+0000","last_change":"2023-08-01T19:54:04.066566+0000","last_active":"2023-08-01T19:54:34.165656+0000","last_peered":"2023-08-01T19:54:34.165656+0000","last_clean":"2023-08-01T19:54:34.165656+0000","last_became_active":"2023-08-01T19:54:04.066190+0000","last_became_peered":"2023-08-01T19:54:04.066190+0000","last_unstale":"2023-08-01T19:54:34.165656+0000","last_undegraded":"2023-08-01T19:54:34.165656+0000","last_fullsized":"2023-08-01T19:54:34.165656+0000","mapping_epoch":15,"log_start":"0'0","ondisk_log_start":"0'0","created":15,"last_epoch_clean":16,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-08-01T19:54:03.032665+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-08-01T19:54:03.032665+0000","last_clean_scrub_stamp":"2023-08-01T19:54:03.032665+0000","objects_scrubbed":0,"log_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-08-03T02:01:47.073630+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[0,1],"acting":[0,1],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":0,"acting_primary":0,"purged_snaps":[]},{"pgid":"4.15","version":"0'0","reported_seq":18,"reported_epoch":26,"state":"active+clean","last_fresh":"2023-08-01T19:54:37.177137+0000","last_change":"2023-08-01T19:54:04.468791+0000","last_active":"2023-08-01T19:54:37.177137+0000","last_peered":"2023-08-01T19:54:37.177137+0000","last_clean":"2023-08-01T19:54:37.177137+0000","last_became_active":"2023-08-01T19:54:04.468214+0000","last_became_peered":"2023-08-01T19:54:04.468214+0000","last_unstale":"2023-08-01T19:54:37.177137+0000","last_undegraded":"2023-08-01T19:54:37.177137+0000","last_fullsized":"2023-08-01T19:54:37.177137+0000","mapping_epoch":16,"log_start":"0'0","ondisk_log_start":"0'0","created":16,"last_epoch_clean":17,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-08-01T19:54:04.040663+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-08-01T19:54:04.040663+0000","last_clean_scrub_stamp":"2023-08-01T19:54:04.040663+0000","objects_scrubbed":0,"log_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-08-03T04:10:44.729287+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[2,0],"acting":[2,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":2,"acting_primary":2,"purged_snaps":[]},{"pgid":"3.11","version":"0'0","reported_seq":19,"reported_epoch":26,"state":"active+clean","last_fresh":"2023-08-01T19:54:37.176342+0000","last_change":"2023-08-01T19:54:04.064280+0000","last_active":"2023-08-01T19:54:37.176342+0000","last_peered":"2023-08-01T19:54:37.176342+0000","last_clean":"2023-08-01T19:54:37.176342+0000","last_became_active":"2023-08-01T19:54:04.064064+0000","last_became_peered":"2023-08-01T19:54:04.064064+0000","last_unstale":"2023-08-01T19:54:37.176342+0000","last_undegraded":"2023-08-01T19:54:37.176342+0000","last_fullsized":"2023-08-01T19:54:37.176342+0000","mapping_epoch":15,"log_start":"0'0","ondisk_log_start":"0'0","created":15,"last_epoch_clean":16,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-08-01T19:54:03.032665+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-08-01T19:54:03.032665+0000","last_clean_scrub_stamp":"2023-08-01T19:54:03.032665+0000","objects_scrubbed":0,"log_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-08-03T06:13:51.475710+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[2,1],"acting":[2,1],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":2,"acting_primary":2,"purged_snaps":[]},{"pgid":"4.16","version":"0'0","reported_seq":17,"reported_epoch":25,"state":"active+clean","last_fresh":"2023-08-01T19:54:34.166629+0000","last_change":"2023-08-01T19:54:04.469724+0000","last_active":"2023-08-01T19:54:34.166629+0000","last_peered":"2023-08-01T19:54:34.166629+0000","last_clean":"2023-08-01T19:54:34.166629+0000","last_became_active":"2023-08-01T19:54:04.469275+0000","last_became_peered":"2023-08-01T19:54:04.469275+0000","last_unstale":"2023-08-01T19:54:34.166629+0000","last_undegraded":"2023-08-01T19:54:34.166629+0000","last_fullsized":"2023-08-01T19:54:34.166629+0000","mapping_epoch":16,"log_start":"0'0","ondisk_log_start":"0'0","created":16,"last_epoch_clean":17,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-08-01T19:54:04.040663+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-08-01T19:54:04.040663+0000","last_clean_scrub_stamp":"2023-08-01T19:54:04.040663+0000","objects_scrubbed":0,"log_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-08-03T03:04:06.137335+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[0,1],"acting":[0,1],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":0,"acting_primary":0,"purged_snaps":[]},{"pgid":"3.10","version":"17'8","reported_seq":26,"reported_epoch":25,"state":"active+clean","last_fresh":"2023-08-01T19:54:34.170726+0000","last_change":"2023-08-01T19:54:04.060962+0000","last_active":"2023-08-01T19:54:34.170726+0000","last_peered":"2023-08-01T19:54:34.170726+0000","last_clean":"2023-08-01T19:54:34.170726+0000","last_became_active":"2023-08-01T19:54:04.060576+0000","last_became_peered":"2023-08-01T19:54:04.060576+0000","last_unstale":"2023-08-01T19:54:34.170726+0000","last_undegraded":"2023-08-01T19:54:34.170726+0000","last_fullsized":"2023-08-01T19:54:34.170726+0000","mapping_epoch":15,"log_start":"0'0","ondisk_log_start":"0'0","created":15,"last_epoch_clean":16,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-08-01T19:54:03.032665+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-08-01T19:54:03.032665+0000","last_clean_scrub_stamp":"2023-08-01T19:54:03.032665+0000","objects_scrubbed":0,"log_size":8,"ondisk_log_size":8,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-08-03T05:00:51.171444+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":4,"num_object_clones":0,"num_object_copies":8,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":4,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":12,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":4,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[1,2],"acting":[1,2],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":1,"acting_primary":1,"purged_snaps":[]},{"pgid":"4.17","version":"0'0","reported_seq":17,"reported_epoch":25,"state":"active+clean","last_fresh":"2023-08-01T19:54:34.167009+0000","last_change":"2023-08-01T19:54:04.472721+0000","last_active":"2023-08-01T19:54:34.167009+0000","last_peered":"2023-08-01T19:54:34.167009+0000","last_clean":"2023-08-01T19:54:34.167009+0000","last_became_active":"2023-08-01T19:54:04.472126+0000","last_became_peered":"2023-08-01T19:54:04.472126+0000","last_unstale":"2023-08-01T19:54:34.167009+0000","last_undegraded":"2023-08-01T19:54:34.167009+0000","last_fullsized":"2023-08-01T19:54:34.167009+0000","mapping_epoch":16,"log_start":"0'0","ondisk_log_start":"0'0","created":16,"last_epoch_clean":17,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-08-01T19:54:04.040663+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-08-01T19:54:04.040663+0000","last_clean_scrub_stamp":"2023-08-01T19:54:04.040663+0000","objects_scrubbed":0,"log_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-08-03T00:29:05.857138+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[0,1],"acting":[0,1],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":0,"acting_primary":0,"purged_snaps":[]},{"pgid":"5.9","version":"26'3116","reported_seq":3130,"reported_epoch":26,"state":"active+clean","last_fresh":"2023-08-01T19:54:39.919220+0000","last_change":"2023-08-01T19:54:23.134838+0000","last_active":"2023-08-01T19:54:39.919220+0000","last_peered":"2023-08-01T19:54:39.919220+0000","last_clean":"2023-08-01T19:54:39.919220+0000","last_became_active":"2023-08-01T19:54:23.134628+0000","last_became_peered":"2023-08-01T19:54:23.134628+0000","last_unstale":"2023-08-01T19:54:39.919220+0000","last_undegraded":"2023-08-01T19:54:39.919220+0000","last_fullsized":"2023-08-01T19:54:39.919220+0000","mapping_epoch":19,"log_start":"0'0","ondisk_log_start":"0'0","created":19,"last_epoch_clean":20,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-08-01T19:54:22.116710+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-08-01T19:54:22.116710+0000","last_clean_scrub_stamp":"2023-08-01T19:54:22.116710+0000","objects_scrubbed":0,"log_size":3116,"ondisk_log_size":3116,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-08-03T05:57:20.085794+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":204210176,"num_objects":3116,"num_object_clones":0,"num_object_copies":6232,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":3116,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":3116,"num_write_kb":199424,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[1,2],"acting":[1,2],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":1,"acting_primary":1,"purged_snaps":[]},{"pgid":"3.f","version":"17'1","reported_seq":19,"reported_epoch":25,"state":"active+clean","last_fresh":"2023-08-01T19:54:34.171924+0000","last_change":"2023-08-01T19:54:04.060797+0000","last_active":"2023-08-01T19:54:34.171924+0000","last_peered":"2023-08-01T19:54:34.171924+0000","last_clean":"2023-08-01T19:54:34.171924+0000","last_became_active":"2023-08-01T19:54:04.060444+0000","last_became_peered":"2023-08-01T19:54:04.060444+0000","last_unstale":"2023-08-01T19:54:34.171924+0000","last_undegraded":"2023-08-01T19:54:34.171924+0000","last_fullsized":"2023-08-01T19:54:34.171924+0000","mapping_epoch":15,"log_start":"0'0","ondisk_log_start":"0'0","created":15,"last_epoch_clean":16,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-08-01T19:54:03.032665+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-08-01T19:54:03.032665+0000","last_clean_scrub_stamp":"2023-08-01T19:54:03.032665+0000","objects_scrubbed":0,"log_size":1,"ondisk_log_size":1,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-08-03T07:13:34.025722+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":22,"num_objects":1,"num_object_clones":0,"num_object_copies":2,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":1,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":1,"num_write_kb":1,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[1,2],"acting":[1,2],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":1,"acting_primary":1,"purged_snaps":[]},{"pgid":"4.8","version":"0'0","reported_seq":18,"reported_epoch":26,"state":"active+clean","last_fresh":"2023-08-01T19:54:37.176201+0000","last_change":"2023-08-01T19:54:04.467671+0000","last_active":"2023-08-01T19:54:37.176201+0000","last_peered":"2023-08-01T19:54:37.176201+0000","last_clean":"2023-08-01T19:54:37.176201+0000","last_became_active":"2023-08-01T19:54:04.467300+0000","last_became_peered":"2023-08-01T19:54:04.467300+0000","last_unstale":"2023-08-01T19:54:37.176201+0000","last_undegraded":"2023-08-01T19:54:37.176201+0000","last_fullsized":"2023-08-01T19:54:37.176201+0000","mapping_epoch":16,"log_start":"0'0","ondisk_log_start":"0'0","created":16,"last_epoch_clean":17,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-08-01T19:54:04.040663+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-08-01T19:54:04.040663+0000","last_clean_scrub_stamp":"2023-08-01T19:54:04.040663+0000","objects_scrubbed":0,"log_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-08-03T05:27:24.774345+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[2,1],"acting":[2,1],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":2,"acting_primary":2,"purged_snaps":[]},{"pgid":"5.8","version":"27'3248","reported_seq":3262,"reported_epoch":27,"state":"active+clean","last_fresh":"2023-08-01T19:54:41.048524+0000","last_change":"2023-08-01T19:54:23.139383+0000","last_active":"2023-08-01T19:54:41.048524+0000","last_peered":"2023-08-01T19:54:41.048524+0000","last_clean":"2023-08-01T19:54:41.048524+0000","last_became_active":"2023-08-01T19:54:23.139198+0000","last_became_peered":"2023-08-01T19:54:23.139198+0000","last_unstale":"2023-08-01T19:54:41.048524+0000","last_undegraded":"2023-08-01T19:54:41.048524+0000","last_fullsized":"2023-08-01T19:54:41.048524+0000","mapping_epoch":19,"log_start":"0'0","ondisk_log_start":"0'0","created":19,"last_epoch_clean":20,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-08-01T19:54:22.116710+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-08-01T19:54:22.116710+0000","last_clean_scrub_stamp":"2023-08-01T19:54:22.116710+0000","objects_scrubbed":0,"log_size":3248,"ondisk_log_size":3248,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-08-03T05:20:31.724064+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":212860928,"num_objects":3248,"num_object_clones":0,"num_object_copies":6496,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":3248,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":3248,"num_write_kb":207872,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[2,0],"acting":[2,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":2,"acting_primary":2,"purged_snaps":[]},{"pgid":"3.e","version":"17'2","reported_seq":21,"reported_epoch":26,"state":"active+clean","last_fresh":"2023-08-01T19:54:37.176883+0000","last_change":"2023-08-01T19:54:04.065595+0000","last_active":"2023-08-01T19:54:37.176883+0000","last_peered":"2023-08-01T19:54:37.176883+0000","last_clean":"2023-08-01T19:54:37.176883+0000","last_became_active":"2023-08-01T19:54:04.065303+0000","last_became_peered":"2023-08-01T19:54:04.065303+0000","last_unstale":"2023-08-01T19:54:37.176883+0000","last_undegraded":"2023-08-01T19:54:37.176883+0000","last_fullsized":"2023-08-01T19:54:37.176883+0000","mapping_epoch":15,"log_start":"0'0","ondisk_log_start":"0'0","created":15,"last_epoch_clean":16,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-08-01T19:54:03.032665+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-08-01T19:54:03.032665+0000","last_clean_scrub_stamp":"2023-08-01T19:54:03.032665+0000","objects_scrubbed":0,"log_size":2,"ondisk_log_size":2,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-08-02T22:40:38.782053+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":1,"num_object_clones":0,"num_object_copies":2,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":1,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":3,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":1,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[2,1],"acting":[2,1],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":2,"acting_primary":2,"purged_snaps":[]},{"pgid":"4.9","version":"0'0","reported_seq":18,"reported_epoch":26,"state":"active+clean","last_fresh":"2023-08-01T19:54:37.176596+0000","last_change":"2023-08-01T19:54:04.468007+0000","last_active":"2023-08-01T19:54:37.176596+0000","last_peered":"2023-08-01T19:54:37.176596+0000","last_clean":"2023-08-01T19:54:37.176596+0000","last_became_active":"2023-08-01T19:54:04.467509+0000","last_became_peered":"2023-08-01T19:54:04.467509+0000","last_unstale":"2023-08-01T19:54:37.176596+0000","last_undegraded":"2023-08-01T19:54:37.176596+0000","last_fullsized":"2023-08-01T19:54:37.176596+0000","mapping_epoch":16,"log_start":"0'0","ondisk_log_start":"0'0","created":16,"last_epoch_clean":17,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-08-01T19:54:04.040663+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-08-01T19:54:04.040663+0000","last_clean_scrub_stamp":"2023-08-01T19:54:04.040663+0000","objects_scrubbed":0,"log_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-08-03T06:04:50.963711+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[2,0],"acting":[2,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":2,"acting_primary":2,"purged_snaps":[]},{"pgid":"5.b","version":"27'3219","reported_seq":3234,"reported_epoch":27,"state":"active+clean","last_fresh":"2023-08-01T19:54:41.049320+0000","last_change":"2023-08-01T19:54:23.138143+0000","last_active":"2023-08-01T19:54:41.049320+0000","last_peered":"2023-08-01T19:54:41.049320+0000","last_clean":"2023-08-01T19:54:41.049320+0000","last_became_active":"2023-08-01T19:54:23.137922+0000","last_became_peered":"2023-08-01T19:54:23.137922+0000","last_unstale":"2023-08-01T19:54:41.049320+0000","last_undegraded":"2023-08-01T19:54:41.049320+0000","last_fullsized":"2023-08-01T19:54:41.049320+0000","mapping_epoch":19,"log_start":"0'0","ondisk_log_start":"0'0","created":19,"last_epoch_clean":20,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-08-01T19:54:22.116710+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-08-01T19:54:22.116710+0000","last_clean_scrub_stamp":"2023-08-01T19:54:22.116710+0000","objects_scrubbed":0,"log_size":3219,"ondisk_log_size":3219,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-08-02T23:27:13.080055+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":210960384,"num_objects":3219,"num_object_clones":0,"num_object_copies":6438,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":3219,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":3219,"num_write_kb":206016,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[2,0],"acting":[2,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":2,"acting_primary":2,"purged_snaps":[]},{"pgid":"3.d","version":"17'1","reported_seq":19,"reported_epoch":25,"state":"active+clean","last_fresh":"2023-08-01T19:54:34.171263+0000","last_change":"2023-08-01T19:54:04.062853+0000","last_active":"2023-08-01T19:54:34.171263+0000","last_peered":"2023-08-01T19:54:34.171263+0000","last_clean":"2023-08-01T19:54:34.171263+0000","last_became_active":"2023-08-01T19:54:04.062598+0000","last_became_peered":"2023-08-01T19:54:04.062598+0000","last_unstale":"2023-08-01T19:54:34.171263+0000","last_undegraded":"2023-08-01T19:54:34.171263+0000","last_fullsized":"2023-08-01T19:54:34.171263+0000","mapping_epoch":15,"log_start":"0'0","ondisk_log_start":"0'0","created":15,"last_epoch_clean":16,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-08-01T19:54:03.032665+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-08-01T19:54:03.032665+0000","last_clean_scrub_stamp":"2023-08-01T19:54:03.032665+0000","objects_scrubbed":0,"log_size":1,"ondisk_log_size":1,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-08-02T20:56:47.324761+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":70,"num_objects":1,"num_object_clones":0,"num_object_copies":2,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":1,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":1,"num_write_kb":1,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[1,2],"acting":[1,2],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":1,"acting_primary":1,"purged_snaps":[]},{"pgid":"4.a","version":"0'0","reported_seq":17,"reported_epoch":25,"state":"active+clean","last_fresh":"2023-08-01T19:54:34.170599+0000","last_change":"2023-08-01T19:54:04.471997+0000","last_active":"2023-08-01T19:54:34.170599+0000","last_peered":"2023-08-01T19:54:34.170599+0000","last_clean":"2023-08-01T19:54:34.170599+0000","last_became_active":"2023-08-01T19:54:04.471204+0000","last_became_peered":"2023-08-01T19:54:04.471204+0000","last_unstale":"2023-08-01T19:54:34.170599+0000","last_undegraded":"2023-08-01T19:54:34.170599+0000","last_fullsized":"2023-08-01T19:54:34.170599+0000","mapping_epoch":16,"log_start":"0'0","ondisk_log_start":"0'0","created":16,"last_epoch_clean":17,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-08-01T19:54:04.040663+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-08-01T19:54:04.040663+0000","last_clean_scrub_stamp":"2023-08-01T19:54:04.040663+0000","objects_scrubbed":0,"log_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-08-02T23:12:30.830199+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[1,0],"acting":[1,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":1,"acting_primary":1,"purged_snaps":[]},{"pgid":"5.a","version":"26'3055","reported_seq":3067,"reported_epoch":26,"state":"active+clean","last_fresh":"2023-08-01T19:54:39.920349+0000","last_change":"2023-08-01T19:54:23.138147+0000","last_active":"2023-08-01T19:54:39.920349+0000","last_peered":"2023-08-01T19:54:39.920349+0000","last_clean":"2023-08-01T19:54:39.920349+0000","last_became_active":"2023-08-01T19:54:23.137827+0000","last_became_peered":"2023-08-01T19:54:23.137827+0000","last_unstale":"2023-08-01T19:54:39.920349+0000","last_undegraded":"2023-08-01T19:54:39.920349+0000","last_fullsized":"2023-08-01T19:54:39.920349+0000","mapping_epoch":19,"log_start":"0'0","ondisk_log_start":"0'0","created":19,"last_epoch_clean":20,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-08-01T19:54:22.116710+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-08-01T19:54:22.116710+0000","last_clean_scrub_stamp":"2023-08-01T19:54:22.116710+0000","objects_scrubbed":0,"log_size":3055,"ondisk_log_size":3055,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-08-03T05:22:32.106433+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":200212480,"num_objects":3055,"num_object_clones":0,"num_object_copies":6110,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":3055,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":3055,"num_write_kb":195520,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[0,2],"acting":[0,2],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":0,"acting_primary":0,"purged_snaps":[]},{"pgid":"3.c","version":"0'0","reported_seq":18,"reported_epoch":25,"state":"active+clean","last_fresh":"2023-08-01T19:54:34.170226+0000","last_change":"2023-08-01T19:54:04.063532+0000","last_active":"2023-08-01T19:54:34.170226+0000","last_peered":"2023-08-01T19:54:34.170226+0000","last_clean":"2023-08-01T19:54:34.170226+0000","last_became_active":"2023-08-01T19:54:04.063116+0000","last_became_peered":"2023-08-01T19:54:04.063116+0000","last_unstale":"2023-08-01T19:54:34.170226+0000","last_undegraded":"2023-08-01T19:54:34.170226+0000","last_fullsized":"2023-08-01T19:54:34.170226+0000","mapping_epoch":15,"log_start":"0'0","ondisk_log_start":"0'0","created":15,"last_epoch_clean":16,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-08-01T19:54:03.032665+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-08-01T19:54:03.032665+0000","last_clean_scrub_stamp":"2023-08-01T19:54:03.032665+0000","objects_scrubbed":0,"log_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-08-02T22:28:51.936138+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[1,0],"acting":[1,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":1,"acting_primary":1,"purged_snaps":[]},{"pgid":"4.b","version":"0'0","reported_seq":17,"reported_epoch":25,"state":"active+clean","last_fresh":"2023-08-01T19:54:34.166752+0000","last_change":"2023-08-01T19:54:04.470787+0000","last_active":"2023-08-01T19:54:34.166752+0000","last_peered":"2023-08-01T19:54:34.166752+0000","last_clean":"2023-08-01T19:54:34.166752+0000","last_became_active":"2023-08-01T19:54:04.470332+0000","last_became_peered":"2023-08-01T19:54:04.470332+0000","last_unstale":"2023-08-01T19:54:34.166752+0000","last_undegraded":"2023-08-01T19:54:34.166752+0000","last_fullsized":"2023-08-01T19:54:34.166752+0000","mapping_epoch":16,"log_start":"0'0","ondisk_log_start":"0'0","created":16,"last_epoch_clean":17,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-08-01T19:54:04.040663+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-08-01T19:54:04.040663+0000","last_clean_scrub_stamp":"2023-08-01T19:54:04.040663+0000","objects_scrubbed":0,"log_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-08-03T05:13:38.298401+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[0,1],"acting":[0,1],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":0,"acting_primary":0,"purged_snaps":[]},{"pgid":"5.d","version":"27'3086","reported_seq":3101,"reported_epoch":27,"state":"active+clean","last_fresh":"2023-08-01T19:54:41.044831+0000","last_change":"2023-08-01T19:54:23.134380+0000","last_active":"2023-08-01T19:54:41.044831+0000","last_peered":"2023-08-01T19:54:41.044831+0000","last_clean":"2023-08-01T19:54:41.044831+0000","last_became_active":"2023-08-01T19:54:23.134100+0000","last_became_peered":"2023-08-01T19:54:23.134100+0000","last_unstale":"2023-08-01T19:54:41.044831+0000","last_undegraded":"2023-08-01T19:54:41.044831+0000","last_fullsized":"2023-08-01T19:54:41.044831+0000","mapping_epoch":19,"log_start":"0'0","ondisk_log_start":"0'0","created":19,"last_epoch_clean":20,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-08-01T19:54:22.116710+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-08-01T19:54:22.116710+0000","last_clean_scrub_stamp":"2023-08-01T19:54:22.116710+0000","objects_scrubbed":0,"log_size":3086,"ondisk_log_size":3086,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-08-02T22:07:43.756233+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":202244096,"num_objects":3086,"num_object_clones":0,"num_object_copies":6172,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":3086,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":3086,"num_write_kb":197504,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[2,1],"acting":[2,1],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":2,"acting_primary":2,"purged_snaps":[]},{"pgid":"3.b","version":"17'2","reported_seq":20,"reported_epoch":25,"state":"active+clean","last_fresh":"2023-08-01T19:54:34.165405+0000","last_change":"2023-08-01T19:54:04.066839+0000","last_active":"2023-08-01T19:54:34.165405+0000","last_peered":"2023-08-01T19:54:34.165405+0000","last_clean":"2023-08-01T19:54:34.165405+0000","last_became_active":"2023-08-01T19:54:04.065535+0000","last_became_peered":"2023-08-01T19:54:04.065535+0000","last_unstale":"2023-08-01T19:54:34.165405+0000","last_undegraded":"2023-08-01T19:54:34.165405+0000","last_fullsized":"2023-08-01T19:54:34.165405+0000","mapping_epoch":15,"log_start":"0'0","ondisk_log_start":"0'0","created":15,"last_epoch_clean":16,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-08-01T19:54:03.032665+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-08-01T19:54:03.032665+0000","last_clean_scrub_stamp":"2023-08-01T19:54:03.032665+0000","objects_scrubbed":0,"log_size":2,"ondisk_log_size":2,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-08-03T05:00:51.171444+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":1,"num_object_clones":0,"num_object_copies":2,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":1,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":1,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":1,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[0,1],"acting":[0,1],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":0,"acting_primary":0,"purged_snaps":[]},{"pgid":"4.c","version":"0'0","reported_seq":17,"reported_epoch":25,"state":"active+clean","last_fresh":"2023-08-01T19:54:34.170307+0000","last_change":"2023-08-01T19:54:04.478715+0000","last_active":"2023-08-01T19:54:34.170307+0000","last_peered":"2023-08-01T19:54:34.170307+0000","last_clean":"2023-08-01T19:54:34.170307+0000","last_became_active":"2023-08-01T19:54:04.477435+0000","last_became_peered":"2023-08-01T19:54:04.477435+0000","last_unstale":"2023-08-01T19:54:34.170307+0000","last_undegraded":"2023-08-01T19:54:34.170307+0000","last_fullsized":"2023-08-01T19:54:34.170307+0000","mapping_epoch":16,"log_start":"0'0","ondisk_log_start":"0'0","created":16,"last_epoch_clean":17,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-08-01T19:54:04.040663+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-08-01T19:54:04.040663+0000","last_clean_scrub_stamp":"2023-08-01T19:54:04.040663+0000","objects_scrubbed":0,"log_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-08-03T04:43:21.408174+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[1,0],"acting":[1,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":1,"acting_primary":1,"purged_snaps":[]},{"pgid":"5.c","version":"26'3142","reported_seq":3156,"reported_epoch":26,"state":"active+clean","last_fresh":"2023-08-01T19:54:39.921610+0000","last_change":"2023-08-01T19:54:23.138439+0000","last_active":"2023-08-01T19:54:39.921610+0000","last_peered":"2023-08-01T19:54:39.921610+0000","last_clean":"2023-08-01T19:54:39.921610+0000","last_became_active":"2023-08-01T19:54:23.138051+0000","last_became_peered":"2023-08-01T19:54:23.138051+0000","last_unstale":"2023-08-01T19:54:39.921610+0000","last_undegraded":"2023-08-01T19:54:39.921610+0000","last_fullsized":"2023-08-01T19:54:39.921610+0000","mapping_epoch":19,"log_start":"0'0","ondisk_log_start":"0'0","created":19,"last_epoch_clean":20,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-08-01T19:54:22.116710+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-08-01T19:54:22.116710+0000","last_clean_scrub_stamp":"2023-08-01T19:54:22.116710+0000","objects_scrubbed":0,"log_size":3142,"ondisk_log_size":3142,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-08-03T03:01:16.402814+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":205914112,"num_objects":3142,"num_object_clones":0,"num_object_copies":6284,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":3142,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":3142,"num_write_kb":201088,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[0,1],"acting":[0,1],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":0,"acting_primary":0,"purged_snaps":[]},{"pgid":"3.a","version":"0'0","reported_seq":18,"reported_epoch":25,"state":"active+clean","last_fresh":"2023-08-01T19:54:34.170432+0000","last_change":"2023-08-01T19:54:04.065267+0000","last_active":"2023-08-01T19:54:34.170432+0000","last_peered":"2023-08-01T19:54:34.170432+0000","last_clean":"2023-08-01T19:54:34.170432+0000","last_became_active":"2023-08-01T19:54:04.064912+0000","last_became_peered":"2023-08-01T19:54:04.064912+0000","last_unstale":"2023-08-01T19:54:34.170432+0000","last_undegraded":"2023-08-01T19:54:34.170432+0000","last_fullsized":"2023-08-01T19:54:34.170432+0000","mapping_epoch":15,"log_start":"0'0","ondisk_log_start":"0'0","created":15,"last_epoch_clean":16,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-08-01T19:54:03.032665+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-08-01T19:54:03.032665+0000","last_clean_scrub_stamp":"2023-08-01T19:54:03.032665+0000","objects_scrubbed":0,"log_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-08-03T02:37:09.180970+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[1,0],"acting":[1,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":1,"acting_primary":1,"purged_snaps":[]},{"pgid":"4.d","version":"0'0","reported_seq":17,"reported_epoch":25,"state":"active+clean","last_fresh":"2023-08-01T19:54:34.171428+0000","last_change":"2023-08-01T19:54:04.474755+0000","last_active":"2023-08-01T19:54:34.171428+0000","last_peered":"2023-08-01T19:54:34.171428+0000","last_clean":"2023-08-01T19:54:34.171428+0000","last_became_active":"2023-08-01T19:54:04.471526+0000","last_became_peered":"2023-08-01T19:54:04.471526+0000","last_unstale":"2023-08-01T19:54:34.171428+0000","last_undegraded":"2023-08-01T19:54:34.171428+0000","last_fullsized":"2023-08-01T19:54:34.171428+0000","mapping_epoch":16,"log_start":"0'0","ondisk_log_start":"0'0","created":16,"last_epoch_clean":17,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-08-01T19:54:04.040663+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-08-01T19:54:04.040663+0000","last_clean_scrub_stamp":"2023-08-01T19:54:04.040663+0000","objects_scrubbed":0,"log_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-08-03T06:50:03.420334+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[1,2],"acting":[1,2],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":1,"acting_primary":1,"purged_snaps":[]},{"pgid":"5.f","version":"26'3098","reported_seq":3110,"reported_epoch":26,"state":"active+clean","last_fresh":"2023-08-01T19:54:39.916091+0000","last_change":"2023-08-01T19:54:23.134608+0000","last_active":"2023-08-01T19:54:39.916091+0000","last_peered":"2023-08-01T19:54:39.916091+0000","last_clean":"2023-08-01T19:54:39.916091+0000","last_became_active":"2023-08-01T19:54:23.134360+0000","last_became_peered":"2023-08-01T19:54:23.134360+0000","last_unstale":"2023-08-01T19:54:39.916091+0000","last_undegraded":"2023-08-01T19:54:39.916091+0000","last_fullsized":"2023-08-01T19:54:39.916091+0000","mapping_epoch":19,"log_start":"0'0","ondisk_log_start":"0'0","created":19,"last_epoch_clean":20,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-08-01T19:54:22.116710+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-08-01T19:54:22.116710+0000","last_clean_scrub_stamp":"2023-08-01T19:54:22.116710+0000","objects_scrubbed":0,"log_size":3098,"ondisk_log_size":3098,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-08-03T06:01:12.916557+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":203030528,"num_objects":3098,"num_object_clones":0,"num_object_copies":6196,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":3098,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":3098,"num_write_kb":198272,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[1,2],"acting":[1,2],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":1,"acting_primary":1,"purged_snaps":[]},{"pgid":"3.9","version":"0'0","reported_seq":19,"reported_epoch":26,"state":"active+clean","last_fresh":"2023-08-01T19:54:37.176239+0000","last_change":"2023-08-01T19:54:04.065519+0000","last_active":"2023-08-01T19:54:37.176239+0000","last_peered":"2023-08-01T19:54:37.176239+0000","last_clean":"2023-08-01T19:54:37.176239+0000","last_became_active":"2023-08-01T19:54:04.065211+0000","last_became_peered":"2023-08-01T19:54:04.065211+0000","last_unstale":"2023-08-01T19:54:37.176239+0000","last_undegraded":"2023-08-01T19:54:37.176239+0000","last_fullsized":"2023-08-01T19:54:37.176239+0000","mapping_epoch":15,"log_start":"0'0","ondisk_log_start":"0'0","created":15,"last_epoch_clean":16,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-08-01T19:54:03.032665+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-08-01T19:54:03.032665+0000","last_clean_scrub_stamp":"2023-08-01T19:54:03.032665+0000","objects_scrubbed":0,"log_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-08-03T05:46:27.672957+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[2,1],"acting":[2,1],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":2,"acting_primary":2,"purged_snaps":[]},{"pgid":"4.e","version":"0'0","reported_seq":17,"reported_epoch":25,"state":"active+clean","last_fresh":"2023-08-01T19:54:34.170841+0000","last_change":"2023-08-01T19:54:04.473750+0000","last_active":"2023-08-01T19:54:34.170841+0000","last_peered":"2023-08-01T19:54:34.170841+0000","last_clean":"2023-08-01T19:54:34.170841+0000","last_became_active":"2023-08-01T19:54:04.471512+0000","last_became_peered":"2023-08-01T19:54:04.471512+0000","last_unstale":"2023-08-01T19:54:34.170841+0000","last_undegraded":"2023-08-01T19:54:34.170841+0000","last_fullsized":"2023-08-01T19:54:34.170841+0000","mapping_epoch":16,"log_start":"0'0","ondisk_log_start":"0'0","created":16,"last_epoch_clean":17,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-08-01T19:54:04.040663+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-08-01T19:54:04.040663+0000","last_clean_scrub_stamp":"2023-08-01T19:54:04.040663+0000","objects_scrubbed":0,"log_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-08-03T05:13:38.298401+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[1,2],"acting":[1,2],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":1,"acting_primary":1,"purged_snaps":[]},{"pgid":"5.e","version":"27'3269","reported_seq":3284,"reported_epoch":27,"state":"active+clean","last_fresh":"2023-08-01T19:54:41.018683+0000","last_change":"2023-08-01T19:54:23.138341+0000","last_active":"2023-08-01T19:54:41.018683+0000","last_peered":"2023-08-01T19:54:41.018683+0000","last_clean":"2023-08-01T19:54:41.018683+0000","last_became_active":"2023-08-01T19:54:23.138119+0000","last_became_peered":"2023-08-01T19:54:23.138119+0000","last_unstale":"2023-08-01T19:54:41.018683+0000","last_undegraded":"2023-08-01T19:54:41.018683+0000","last_fullsized":"2023-08-01T19:54:41.018683+0000","mapping_epoch":19,"log_start":"0'0","ondisk_log_start":"0'0","created":19,"last_epoch_clean":20,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-08-01T19:54:22.116710+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-08-01T19:54:22.116710+0000","last_clean_scrub_stamp":"2023-08-01T19:54:22.116710+0000","objects_scrubbed":0,"log_size":3269,"ondisk_log_size":3269,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-08-03T07:48:27.709982+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":214237184,"num_objects":3269,"num_object_clones":0,"num_object_copies":6538,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":3269,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":3269,"num_write_kb":209216,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[2,0],"acting":[2,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":2,"acting_primary":2,"purged_snaps":[]},{"pgid":"3.8","version":"0'0","reported_seq":19,"reported_epoch":26,"state":"active+clean","last_fresh":"2023-08-01T19:54:37.176324+0000","last_change":"2023-08-01T19:54:04.063990+0000","last_active":"2023-08-01T19:54:37.176324+0000","last_peered":"2023-08-01T19:54:37.176324+0000","last_clean":"2023-08-01T19:54:37.176324+0000","last_became_active":"2023-08-01T19:54:04.063652+0000","last_became_peered":"2023-08-01T19:54:04.063652+0000","last_unstale":"2023-08-01T19:54:37.176324+0000","last_undegraded":"2023-08-01T19:54:37.176324+0000","last_fullsized":"2023-08-01T19:54:37.176324+0000","mapping_epoch":15,"log_start":"0'0","ondisk_log_start":"0'0","created":15,"last_epoch_clean":16,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-08-01T19:54:03.032665+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-08-01T19:54:03.032665+0000","last_clean_scrub_stamp":"2023-08-01T19:54:03.032665+0000","objects_scrubbed":0,"log_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-08-03T05:30:28.028091+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[2,0],"acting":[2,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":2,"acting_primary":2,"purged_snaps":[]},{"pgid":"4.f","version":"0'0","reported_seq":17,"reported_epoch":25,"state":"active+clean","last_fresh":"2023-08-01T19:54:34.166866+0000","last_change":"2023-08-01T19:54:04.469648+0000","last_active":"2023-08-01T19:54:34.166866+0000","last_peered":"2023-08-01T19:54:34.166866+0000","last_clean":"2023-08-01T19:54:34.166866+0000","last_became_active":"2023-08-01T19:54:04.468445+0000","last_became_peered":"2023-08-01T19:54:04.468445+0000","last_unstale":"2023-08-01T19:54:34.166866+0000","last_undegraded":"2023-08-01T19:54:34.166866+0000","last_fullsized":"2023-08-01T19:54:34.166866+0000","mapping_epoch":16,"log_start":"0'0","ondisk_log_start":"0'0","created":16,"last_epoch_clean":17,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-08-01T19:54:04.040663+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-08-01T19:54:04.040663+0000","last_clean_scrub_stamp":"2023-08-01T19:54:04.040663+0000","objects_scrubbed":0,"log_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-08-03T05:46:11.085577+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[0,2],"acting":[0,2],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":0,"acting_primary":0,"purged_snaps":[]},{"pgid":"5.3","version":"26'3075","reported_seq":3089,"reported_epoch":26,"state":"active+clean","last_fresh":"2023-08-01T19:54:39.900193+0000","last_change":"2023-08-01T19:54:23.138357+0000","last_active":"2023-08-01T19:54:39.900193+0000","last_peered":"2023-08-01T19:54:39.900193+0000","last_clean":"2023-08-01T19:54:39.900193+0000","last_became_active":"2023-08-01T19:54:23.137942+0000","last_became_peered":"2023-08-01T19:54:23.137942+0000","last_unstale":"2023-08-01T19:54:39.900193+0000","last_undegraded":"2023-08-01T19:54:39.900193+0000","last_fullsized":"2023-08-01T19:54:39.900193+0000","mapping_epoch":19,"log_start":"0'0","ondisk_log_start":"0'0","created":19,"last_epoch_clean":20,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-08-01T19:54:22.116710+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-08-01T19:54:22.116710+0000","last_clean_scrub_stamp":"2023-08-01T19:54:22.116710+0000","objects_scrubbed":0,"log_size":3075,"ondisk_log_size":3075,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-08-03T01:44:47.434321+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":201523200,"num_objects":3075,"num_object_clones":0,"num_object_copies":6150,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":3075,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":3075,"num_write_kb":196800,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[0,1],"acting":[0,1],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":0,"acting_primary":0,"purged_snaps":[]},{"pgid":"2.4","version":"0'0","reported_seq":21,"reported_epoch":25,"state":"active+clean","last_fresh":"2023-08-01T19:54:34.165744+0000","last_change":"2023-08-01T19:53:58.973838+0000","last_active":"2023-08-01T19:54:34.165744+0000","last_peered":"2023-08-01T19:54:34.165744+0000","last_clean":"2023-08-01T19:54:34.165744+0000","last_became_active":"2023-08-01T19:53:58.973242+0000","last_became_peered":"2023-08-01T19:53:58.973242+0000","last_unstale":"2023-08-01T19:54:34.165744+0000","last_undegraded":"2023-08-01T19:54:34.165744+0000","last_fullsized":"2023-08-01T19:54:34.165744+0000","mapping_epoch":12,"log_start":"0'0","ondisk_log_start":"0'0","created":12,"last_epoch_clean":13,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-08-01T19:53:57.959448+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-08-01T19:53:57.959448+0000","last_clean_scrub_stamp":"2023-08-01T19:53:57.959448+0000","objects_scrubbed":0,"log_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-08-03T00:09:48.796549+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[0,2],"acting":[0,2],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":0,"acting_primary":0,"purged_snaps":[]},{"pgid":"3.5","version":"0'0","reported_seq":18,"reported_epoch":25,"state":"active+clean","last_fresh":"2023-08-01T19:54:34.171355+0000","last_change":"2023-08-01T19:54:04.065255+0000","last_active":"2023-08-01T19:54:34.171355+0000","last_peered":"2023-08-01T19:54:34.171355+0000","last_clean":"2023-08-01T19:54:34.171355+0000","last_became_active":"2023-08-01T19:54:04.064814+0000","last_became_peered":"2023-08-01T19:54:04.064814+0000","last_unstale":"2023-08-01T19:54:34.171355+0000","last_undegraded":"2023-08-01T19:54:34.171355+0000","last_fullsized":"2023-08-01T19:54:34.171355+0000","mapping_epoch":15,"log_start":"0'0","ondisk_log_start":"0'0","created":15,"last_epoch_clean":16,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-08-01T19:54:03.032665+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-08-01T19:54:03.032665+0000","last_clean_scrub_stamp":"2023-08-01T19:54:03.032665+0000","objects_scrubbed":0,"log_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-08-03T02:01:47.073630+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[1,0],"acting":[1,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":1,"acting_primary":1,"purged_snaps":[]},{"pgid":"4.2","version":"0'0","reported_seq":18,"reported_epoch":26,"state":"active+clean","last_fresh":"2023-08-01T19:54:37.177539+0000","last_change":"2023-08-01T19:54:04.471715+0000","last_active":"2023-08-01T19:54:37.177539+0000","last_peered":"2023-08-01T19:54:37.177539+0000","last_clean":"2023-08-01T19:54:37.177539+0000","last_became_active":"2023-08-01T19:54:04.471300+0000","last_became_peered":"2023-08-01T19:54:04.471300+0000","last_unstale":"2023-08-01T19:54:37.177539+0000","last_undegraded":"2023-08-01T19:54:37.177539+0000","last_fullsized":"2023-08-01T19:54:37.177539+0000","mapping_epoch":16,"log_start":"0'0","ondisk_log_start":"0'0","created":16,"last_epoch_clean":17,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-08-01T19:54:04.040663+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-08-01T19:54:04.040663+0000","last_clean_scrub_stamp":"2023-08-01T19:54:04.040663+0000","objects_scrubbed":0,"log_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-08-02T23:00:24.980203+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[2,1],"acting":[2,1],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":2,"acting_primary":2,"purged_snaps":[]},{"pgid":"5.5","version":"26'3012","reported_seq":3025,"reported_epoch":26,"state":"active+clean","last_fresh":"2023-08-01T19:54:39.910852+0000","last_change":"2023-08-01T19:54:23.137678+0000","last_active":"2023-08-01T19:54:39.910852+0000","last_peered":"2023-08-01T19:54:39.910852+0000","last_clean":"2023-08-01T19:54:39.910852+0000","last_became_active":"2023-08-01T19:54:23.136756+0000","last_became_peered":"2023-08-01T19:54:23.136756+0000","last_unstale":"2023-08-01T19:54:39.910852+0000","last_undegraded":"2023-08-01T19:54:39.910852+0000","last_fullsized":"2023-08-01T19:54:39.910852+0000","mapping_epoch":19,"log_start":"0'0","ondisk_log_start":"0'0","created":19,"last_epoch_clean":20,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-08-01T19:54:22.116710+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-08-01T19:54:22.116710+0000","last_clean_scrub_stamp":"2023-08-01T19:54:22.116710+0000","objects_scrubbed":0,"log_size":3012,"ondisk_log_size":3012,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-08-03T03:50:03.076219+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":197394432,"num_objects":3012,"num_object_clones":0,"num_object_copies":6024,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":3012,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":3012,"num_write_kb":192768,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[0,1],"acting":[0,1],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":0,"acting_primary":0,"purged_snaps":[]},{"pgid":"2.2","version":"0'0","reported_seq":21,"reported_epoch":25,"state":"active+clean","last_fresh":"2023-08-01T19:54:34.170716+0000","last_change":"2023-08-01T19:53:58.973665+0000","last_active":"2023-08-01T19:54:34.170716+0000","last_peered":"2023-08-01T19:54:34.170716+0000","last_clean":"2023-08-01T19:54:34.170716+0000","last_became_active":"2023-08-01T19:53:58.973463+0000","last_became_peered":"2023-08-01T19:53:58.973463+0000","last_unstale":"2023-08-01T19:54:34.170716+0000","last_undegraded":"2023-08-01T19:54:34.170716+0000","last_fullsized":"2023-08-01T19:54:34.170716+0000","mapping_epoch":12,"log_start":"0'0","ondisk_log_start":"0'0","created":12,"last_epoch_clean":13,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-08-01T19:53:57.959448+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-08-01T19:53:57.959448+0000","last_clean_scrub_stamp":"2023-08-01T19:53:57.959448+0000","objects_scrubbed":0,"log_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-08-03T04:50:42.368892+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[1,0],"acting":[1,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":1,"acting_primary":1,"purged_snaps":[]},{"pgid":"3.3","version":"0'0","reported_seq":18,"reported_epoch":25,"state":"active+clean","last_fresh":"2023-08-01T19:54:34.170252+0000","last_change":"2023-08-01T19:54:04.065415+0000","last_active":"2023-08-01T19:54:34.170252+0000","last_peered":"2023-08-01T19:54:34.170252+0000","last_clean":"2023-08-01T19:54:34.170252+0000","last_became_active":"2023-08-01T19:54:04.065030+0000","last_became_peered":"2023-08-01T19:54:04.065030+0000","last_unstale":"2023-08-01T19:54:34.170252+0000","last_undegraded":"2023-08-01T19:54:34.170252+0000","last_fullsized":"2023-08-01T19:54:34.170252+0000","mapping_epoch":15,"log_start":"0'0","ondisk_log_start":"0'0","created":15,"last_epoch_clean":16,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-08-01T19:54:03.032665+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-08-01T19:54:03.032665+0000","last_clean_scrub_stamp":"2023-08-01T19:54:03.032665+0000","objects_scrubbed":0,"log_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-08-02T21:33:27.007118+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[1,0],"acting":[1,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":1,"acting_primary":1,"purged_snaps":[]},{"pgid":"4.4","version":"0'0","reported_seq":17,"reported_epoch":25,"state":"active+clean","last_fresh":"2023-08-01T19:54:34.165661+0000","last_change":"2023-08-01T19:54:04.468101+0000","last_active":"2023-08-01T19:54:34.165661+0000","last_peered":"2023-08-01T19:54:34.165661+0000","last_clean":"2023-08-01T19:54:34.165661+0000","last_became_active":"2023-08-01T19:54:04.467409+0000","last_became_peered":"2023-08-01T19:54:04.467409+0000","last_unstale":"2023-08-01T19:54:34.165661+0000","last_undegraded":"2023-08-01T19:54:34.165661+0000","last_fullsized":"2023-08-01T19:54:34.165661+0000","mapping_epoch":16,"log_start":"0'0","ondisk_log_start":"0'0","created":16,"last_epoch_clean":17,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-08-01T19:54:04.040663+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-08-01T19:54:04.040663+0000","last_clean_scrub_stamp":"2023-08-01T19:54:04.040663+0000","objects_scrubbed":0,"log_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-08-02T21:43:30.325991+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[0,2],"acting":[0,2],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":0,"acting_primary":0,"purged_snaps":[]},{"pgid":"5.6","version":"26'3039","reported_seq":3053,"reported_epoch":26,"state":"active+clean","last_fresh":"2023-08-01T19:54:39.909745+0000","last_change":"2023-08-01T19:54:23.138275+0000","last_active":"2023-08-01T19:54:39.909745+0000","last_peered":"2023-08-01T19:54:39.909745+0000","last_clean":"2023-08-01T19:54:39.909745+0000","last_became_active":"2023-08-01T19:54:23.137973+0000","last_became_peered":"2023-08-01T19:54:23.137973+0000","last_unstale":"2023-08-01T19:54:39.909745+0000","last_undegraded":"2023-08-01T19:54:39.909745+0000","last_fullsized":"2023-08-01T19:54:39.909745+0000","mapping_epoch":19,"log_start":"0'0","ondisk_log_start":"0'0","created":19,"last_epoch_clean":20,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-08-01T19:54:22.116710+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-08-01T19:54:22.116710+0000","last_clean_scrub_stamp":"2023-08-01T19:54:22.116710+0000","objects_scrubbed":0,"log_size":3039,"ondisk_log_size":3039,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-08-03T01:19:10.526905+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":199163904,"num_objects":3039,"num_object_clones":0,"num_object_copies":6078,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":3039,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":3039,"num_write_kb":194496,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[0,1],"acting":[0,1],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":0,"acting_primary":0,"purged_snaps":[]},{"pgid":"2.1","version":"0'0","reported_seq":21,"reported_epoch":25,"state":"active+clean","last_fresh":"2023-08-01T19:54:34.165301+0000","last_change":"2023-08-01T19:53:58.973700+0000","last_active":"2023-08-01T19:54:34.165301+0000","last_peered":"2023-08-01T19:54:34.165301+0000","last_clean":"2023-08-01T19:54:34.165301+0000","last_became_active":"2023-08-01T19:53:58.973285+0000","last_became_peered":"2023-08-01T19:53:58.973285+0000","last_unstale":"2023-08-01T19:54:34.165301+0000","last_undegraded":"2023-08-01T19:54:34.165301+0000","last_fullsized":"2023-08-01T19:54:34.165301+0000","mapping_epoch":12,"log_start":"0'0","ondisk_log_start":"0'0","created":12,"last_epoch_clean":13,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-08-01T19:53:57.959448+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-08-01T19:53:57.959448+0000","last_clean_scrub_stamp":"2023-08-01T19:53:57.959448+0000","objects_scrubbed":0,"log_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-08-02T21:26:02.570824+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[0,2],"acting":[0,2],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":0,"acting_primary":0,"purged_snaps":[]},{"pgid":"3.0","version":"0'0","reported_seq":19,"reported_epoch":26,"state":"active+clean","last_fresh":"2023-08-01T19:54:37.176821+0000","last_change":"2023-08-01T19:54:04.064407+0000","last_active":"2023-08-01T19:54:37.176821+0000","last_peered":"2023-08-01T19:54:37.176821+0000","last_clean":"2023-08-01T19:54:37.176821+0000","last_became_active":"2023-08-01T19:54:04.064122+0000","last_became_peered":"2023-08-01T19:54:04.064122+0000","last_unstale":"2023-08-01T19:54:37.176821+0000","last_undegraded":"2023-08-01T19:54:37.176821+0000","last_fullsized":"2023-08-01T19:54:37.176821+0000","mapping_epoch":15,"log_start":"0'0","ondisk_log_start":"0'0","created":15,"last_epoch_clean":16,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-08-01T19:54:03.032665+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-08-01T19:54:03.032665+0000","last_clean_scrub_stamp":"2023-08-01T19:54:03.032665+0000","objects_scrubbed":0,"log_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-08-03T07:08:17.318689+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[2,1],"acting":[2,1],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":2,"acting_primary":2,"purged_snaps":[]},{"pgid":"4.7","version":"0'0","reported_seq":17,"reported_epoch":25,"state":"active+clean","last_fresh":"2023-08-01T19:54:34.166916+0000","last_change":"2023-08-01T19:54:04.469739+0000","last_active":"2023-08-01T19:54:34.166916+0000","last_peered":"2023-08-01T19:54:34.166916+0000","last_clean":"2023-08-01T19:54:34.166916+0000","last_became_active":"2023-08-01T19:54:04.468021+0000","last_became_peered":"2023-08-01T19:54:04.468021+0000","last_unstale":"2023-08-01T19:54:34.166916+0000","last_undegraded":"2023-08-01T19:54:34.166916+0000","last_fullsized":"2023-08-01T19:54:34.166916+0000","mapping_epoch":16,"log_start":"0'0","ondisk_log_start":"0'0","created":16,"last_epoch_clean":17,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-08-01T19:54:04.040663+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-08-01T19:54:04.040663+0000","last_clean_scrub_stamp":"2023-08-01T19:54:04.040663+0000","objects_scrubbed":0,"log_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-08-02T21:03:01.319028+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[0,2],"acting":[0,2],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":0,"acting_primary":0,"purged_snaps":[]},{"pgid":"5.4","version":"27'3181","reported_seq":3196,"reported_epoch":27,"state":"active+clean","last_fresh":"2023-08-01T19:54:41.044284+0000","last_change":"2023-08-01T19:54:23.138253+0000","last_active":"2023-08-01T19:54:41.044284+0000","last_peered":"2023-08-01T19:54:41.044284+0000","last_clean":"2023-08-01T19:54:41.044284+0000","last_became_active":"2023-08-01T19:54:23.137915+0000","last_became_peered":"2023-08-01T19:54:23.137915+0000","last_unstale":"2023-08-01T19:54:41.044284+0000","last_undegraded":"2023-08-01T19:54:41.044284+0000","last_fullsized":"2023-08-01T19:54:41.044284+0000","mapping_epoch":19,"log_start":"0'0","ondisk_log_start":"0'0","created":19,"last_epoch_clean":20,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-08-01T19:54:22.116710+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-08-01T19:54:22.116710+0000","last_clean_scrub_stamp":"2023-08-01T19:54:22.116710+0000","objects_scrubbed":0,"log_size":3181,"ondisk_log_size":3181,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-08-03T07:20:04.946515+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":208470016,"num_objects":3181,"num_object_clones":0,"num_object_copies":6362,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":3181,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":3181,"num_write_kb":203584,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[2,0],"acting":[2,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":2,"acting_primary":2,"purged_snaps":[]},{"pgid":"2.3","version":"0'0","reported_seq":21,"reported_epoch":25,"state":"active+clean","last_fresh":"2023-08-01T19:54:34.170324+0000","last_change":"2023-08-01T19:53:58.973768+0000","last_active":"2023-08-01T19:54:34.170324+0000","last_peered":"2023-08-01T19:54:34.170324+0000","last_clean":"2023-08-01T19:54:34.170324+0000","last_became_active":"2023-08-01T19:53:58.973492+0000","last_became_peered":"2023-08-01T19:53:58.973492+0000","last_unstale":"2023-08-01T19:54:34.170324+0000","last_undegraded":"2023-08-01T19:54:34.170324+0000","last_fullsized":"2023-08-01T19:54:34.170324+0000","mapping_epoch":12,"log_start":"0'0","ondisk_log_start":"0'0","created":12,"last_epoch_clean":13,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-08-01T19:53:57.959448+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-08-01T19:53:57.959448+0000","last_clean_scrub_stamp":"2023-08-01T19:53:57.959448+0000","objects_scrubbed":0,"log_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-08-03T02:04:52.034667+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[1,0],"acting":[1,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":1,"acting_primary":1,"purged_snaps":[]},{"pgid":"1.0","version":"10'157","reported_seq":220,"reported_epoch":25,"state":"active+clean","last_fresh":"2023-08-01T19:54:34.169968+0000","last_change":"2023-08-01T19:53:51.746910+0000","last_active":"2023-08-01T19:54:34.169968+0000","last_peered":"2023-08-01T19:54:34.169968+0000","last_clean":"2023-08-01T19:54:34.169968+0000","last_became_active":"2023-08-01T19:53:51.746590+0000","last_became_peered":"2023-08-01T19:53:51.746590+0000","last_unstale":"2023-08-01T19:54:34.169968+0000","last_undegraded":"2023-08-01T19:54:34.169968+0000","last_fullsized":"2023-08-01T19:54:34.169968+0000","mapping_epoch":9,"log_start":"0'0","ondisk_log_start":"0'0","created":9,"last_epoch_clean":10,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-08-01T19:53:50.735626+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-08-01T19:53:50.735626+0000","last_clean_scrub_stamp":"2023-08-01T19:53:50.735626+0000","objects_scrubbed":0,"log_size":157,"ondisk_log_size":157,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-08-03T02:56:50.228294+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":590368,"num_objects":2,"num_object_clones":0,"num_object_copies":4,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":2,"num_whiteouts":0,"num_read":136,"num_read_kb":118,"num_write":203,"num_write_kb":3460,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[1,2],"acting":[1,2],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":1,"acting_primary":1,"purged_snaps":[]},{"pgid":"3.2","version":"0'0","reported_seq":18,"reported_epoch":25,"state":"active+clean","last_fresh":"2023-08-01T19:54:34.165391+0000","last_change":"2023-08-01T19:54:04.064009+0000","last_active":"2023-08-01T19:54:34.165391+0000","last_peered":"2023-08-01T19:54:34.165391+0000","last_clean":"2023-08-01T19:54:34.165391+0000","last_became_active":"2023-08-01T19:54:04.063665+0000","last_became_peered":"2023-08-01T19:54:04.063665+0000","last_unstale":"2023-08-01T19:54:34.165391+0000","last_undegraded":"2023-08-01T19:54:34.165391+0000","last_fullsized":"2023-08-01T19:54:34.165391+0000","mapping_epoch":15,"log_start":"0'0","ondisk_log_start":"0'0","created":15,"last_epoch_clean":16,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-08-01T19:54:03.032665+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-08-01T19:54:03.032665+0000","last_clean_scrub_stamp":"2023-08-01T19:54:03.032665+0000","objects_scrubbed":0,"log_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-08-03T04:04:46.983253+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[0,2],"acting":[0,2],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":0,"acting_primary":0,"purged_snaps":[]},{"pgid":"4.5","version":"0'0","reported_seq":17,"reported_epoch":25,"state":"active+clean","last_fresh":"2023-08-01T19:54:34.171428+0000","last_change":"2023-08-01T19:54:04.474061+0000","last_active":"2023-08-01T19:54:34.171428+0000","last_peered":"2023-08-01T19:54:34.171428+0000","last_clean":"2023-08-01T19:54:34.171428+0000","last_became_active":"2023-08-01T19:54:04.472128+0000","last_became_peered":"2023-08-01T19:54:04.472128+0000","last_unstale":"2023-08-01T19:54:34.171428+0000","last_undegraded":"2023-08-01T19:54:34.171428+0000","last_fullsized":"2023-08-01T19:54:34.171428+0000","mapping_epoch":16,"log_start":"0'0","ondisk_log_start":"0'0","created":16,"last_epoch_clean":17,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-08-01T19:54:04.040663+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-08-01T19:54:04.040663+0000","last_clean_scrub_stamp":"2023-08-01T19:54:04.040663+0000","objects_scrubbed":0,"log_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-08-03T00:29:05.857138+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[1,2],"acting":[1,2],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":1,"acting_primary":1,"purged_snaps":[]},{"pgid":"5.7","version":"26'3064","reported_seq":3078,"reported_epoch":26,"state":"active+clean","last_fresh":"2023-08-01T19:54:39.911197+0000","last_change":"2023-08-01T19:54:23.138337+0000","last_active":"2023-08-01T19:54:39.911197+0000","last_peered":"2023-08-01T19:54:39.911197+0000","last_clean":"2023-08-01T19:54:39.911197+0000","last_became_active":"2023-08-01T19:54:23.138056+0000","last_became_peered":"2023-08-01T19:54:23.138056+0000","last_unstale":"2023-08-01T19:54:39.911197+0000","last_undegraded":"2023-08-01T19:54:39.911197+0000","last_fullsized":"2023-08-01T19:54:39.911197+0000","mapping_epoch":19,"log_start":"0'0","ondisk_log_start":"0'0","created":19,"last_epoch_clean":20,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-08-01T19:54:22.116710+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-08-01T19:54:22.116710+0000","last_clean_scrub_stamp":"2023-08-01T19:54:22.116710+0000","objects_scrubbed":0,"log_size":3064,"ondisk_log_size":3064,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-08-03T06:58:19.846492+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":200802304,"num_objects":3064,"num_object_clones":0,"num_object_copies":6128,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":3064,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":3064,"num_write_kb":196096,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[1,0],"acting":[1,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":1,"acting_primary":1,"purged_snaps":[]},{"pgid":"2.0","version":"0'0","reported_seq":21,"reported_epoch":25,"state":"active+clean","last_fresh":"2023-08-01T19:54:34.171041+0000","last_change":"2023-08-01T19:53:58.975968+0000","last_active":"2023-08-01T19:54:34.171041+0000","last_peered":"2023-08-01T19:54:34.171041+0000","last_clean":"2023-08-01T19:54:34.171041+0000","last_became_active":"2023-08-01T19:53:58.975706+0000","last_became_peered":"2023-08-01T19:53:58.975706+0000","last_unstale":"2023-08-01T19:54:34.171041+0000","last_undegraded":"2023-08-01T19:54:34.171041+0000","last_fullsized":"2023-08-01T19:54:34.171041+0000","mapping_epoch":12,"log_start":"0'0","ondisk_log_start":"0'0","created":12,"last_epoch_clean":13,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-08-01T19:53:57.959448+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-08-01T19:53:57.959448+0000","last_clean_scrub_stamp":"2023-08-01T19:53:57.959448+0000","objects_scrubbed":0,"log_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-08-03T00:02:15.204280+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[1,2],"acting":[1,2],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":1,"acting_primary":1,"purged_snaps":[]},{"pgid":"3.1","version":"0'0","reported_seq":18,"reported_epoch":25,"state":"active+clean","last_fresh":"2023-08-01T19:54:34.164992+0000","last_change":"2023-08-01T19:54:04.066707+0000","last_active":"2023-08-01T19:54:34.164992+0000","last_peered":"2023-08-01T19:54:34.164992+0000","last_clean":"2023-08-01T19:54:34.164992+0000","last_became_active":"2023-08-01T19:54:04.066334+0000","last_became_peered":"2023-08-01T19:54:04.066334+0000","last_unstale":"2023-08-01T19:54:34.164992+0000","last_undegraded":"2023-08-01T19:54:34.164992+0000","last_fullsized":"2023-08-01T19:54:34.164992+0000","mapping_epoch":15,"log_start":"0'0","ondisk_log_start":"0'0","created":15,"last_epoch_clean":16,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-08-01T19:54:03.032665+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-08-01T19:54:03.032665+0000","last_clean_scrub_stamp":"2023-08-01T19:54:03.032665+0000","objects_scrubbed":0,"log_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-08-03T02:40:15.210599+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[0,1],"acting":[0,1],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":0,"acting_primary":0,"purged_snaps":[]},{"pgid":"4.6","version":"0'0","reported_seq":18,"reported_epoch":26,"state":"active+clean","last_fresh":"2023-08-01T19:54:37.177084+0000","last_change":"2023-08-01T19:54:04.469877+0000","last_active":"2023-08-01T19:54:37.177084+0000","last_peered":"2023-08-01T19:54:37.177084+0000","last_clean":"2023-08-01T19:54:37.177084+0000","last_became_active":"2023-08-01T19:54:04.469528+0000","last_became_peered":"2023-08-01T19:54:04.469528+0000","last_unstale":"2023-08-01T19:54:37.177084+0000","last_undegraded":"2023-08-01T19:54:37.177084+0000","last_fullsized":"2023-08-01T19:54:37.177084+0000","mapping_epoch":16,"log_start":"0'0","ondisk_log_start":"0'0","created":16,"last_epoch_clean":17,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-08-01T19:54:04.040663+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-08-01T19:54:04.040663+0000","last_clean_scrub_stamp":"2023-08-01T19:54:04.040663+0000","objects_scrubbed":0,"log_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-08-03T02:24:19.067602+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[2,0],"acting":[2,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":2,"acting_primary":2,"purged_snaps":[]},{"pgid":"5.2","version":"26'3165","reported_seq":3179,"reported_epoch":26,"state":"active+clean","last_fresh":"2023-08-01T19:54:39.917066+0000","last_change":"2023-08-01T19:54:23.138339+0000","last_active":"2023-08-01T19:54:39.917066+0000","last_peered":"2023-08-01T19:54:39.917066+0000","last_clean":"2023-08-01T19:54:39.917066+0000","last_became_active":"2023-08-01T19:54:23.137962+0000","last_became_peered":"2023-08-01T19:54:23.137962+0000","last_unstale":"2023-08-01T19:54:39.917066+0000","last_undegraded":"2023-08-01T19:54:39.917066+0000","last_fullsized":"2023-08-01T19:54:39.917066+0000","mapping_epoch":19,"log_start":"0'0","ondisk_log_start":"0'0","created":19,"last_epoch_clean":20,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-08-01T19:54:22.116710+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-08-01T19:54:22.116710+0000","last_clean_scrub_stamp":"2023-08-01T19:54:22.116710+0000","objects_scrubbed":0,"log_size":3165,"ondisk_log_size":3165,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-08-03T01:46:33.457242+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":207421440,"num_objects":3165,"num_object_clones":0,"num_object_copies":6330,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":3165,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":3165,"num_write_kb":202560,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[1,0],"acting":[1,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":1,"acting_primary":1,"purged_snaps":[]},{"pgid":"2.5","version":"0'0","reported_seq":22,"reported_epoch":26,"state":"active+clean","last_fresh":"2023-08-01T19:54:37.177014+0000","last_change":"2023-08-01T19:53:58.970683+0000","last_active":"2023-08-01T19:54:37.177014+0000","last_peered":"2023-08-01T19:54:37.177014+0000","last_clean":"2023-08-01T19:54:37.177014+0000","last_became_active":"2023-08-01T19:53:58.970437+0000","last_became_peered":"2023-08-01T19:53:58.970437+0000","last_unstale":"2023-08-01T19:54:37.177014+0000","last_undegraded":"2023-08-01T19:54:37.177014+0000","last_fullsized":"2023-08-01T19:54:37.177014+0000","mapping_epoch":12,"log_start":"0'0","ondisk_log_start":"0'0","created":12,"last_epoch_clean":13,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-08-01T19:53:57.959448+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-08-01T19:53:57.959448+0000","last_clean_scrub_stamp":"2023-08-01T19:53:57.959448+0000","objects_scrubbed":0,"log_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-08-02T23:54:08.273426+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[2,0],"acting":[2,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":2,"acting_primary":2,"purged_snaps":[]},{"pgid":"3.4","version":"0'0","reported_seq":18,"reported_epoch":25,"state":"active+clean","last_fresh":"2023-08-01T19:54:34.165614+0000","last_change":"2023-08-01T19:54:04.062283+0000","last_active":"2023-08-01T19:54:34.165614+0000","last_peered":"2023-08-01T19:54:34.165614+0000","last_clean":"2023-08-01T19:54:34.165614+0000","last_became_active":"2023-08-01T19:54:04.061796+0000","last_became_peered":"2023-08-01T19:54:04.061796+0000","last_unstale":"2023-08-01T19:54:34.165614+0000","last_undegraded":"2023-08-01T19:54:34.165614+0000","last_fullsized":"2023-08-01T19:54:34.165614+0000","mapping_epoch":15,"log_start":"0'0","ondisk_log_start":"0'0","created":15,"last_epoch_clean":16,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-08-01T19:54:03.032665+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-08-01T19:54:03.032665+0000","last_clean_scrub_stamp":"2023-08-01T19:54:03.032665+0000","objects_scrubbed":0,"log_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-08-02T19:54:08.401797+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[0,2],"acting":[0,2],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":0,"acting_primary":0,"purged_snaps":[]},{"pgid":"4.3","version":"0'0","reported_seq":18,"reported_epoch":26,"state":"active+clean","last_fresh":"2023-08-01T19:54:37.176400+0000","last_change":"2023-08-01T19:54:04.473088+0000","last_active":"2023-08-01T19:54:37.176400+0000","last_peered":"2023-08-01T19:54:37.176400+0000","last_clean":"2023-08-01T19:54:37.176400+0000","last_became_active":"2023-08-01T19:54:04.472611+0000","last_became_peered":"2023-08-01T19:54:04.472611+0000","last_unstale":"2023-08-01T19:54:37.176400+0000","last_undegraded":"2023-08-01T19:54:37.176400+0000","last_fullsized":"2023-08-01T19:54:37.176400+0000","mapping_epoch":16,"log_start":"0'0","ondisk_log_start":"0'0","created":16,"last_epoch_clean":17,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-08-01T19:54:04.040663+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-08-01T19:54:04.040663+0000","last_clean_scrub_stamp":"2023-08-01T19:54:04.040663+0000","objects_scrubbed":0,"log_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-08-03T07:27:26.537518+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[2,1],"acting":[2,1],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":2,"acting_primary":2,"purged_snaps":[]},{"pgid":"5.1","version":"26'3070","reported_seq":3084,"reported_epoch":26,"state":"active+clean","last_fresh":"2023-08-01T19:54:39.915762+0000","last_change":"2023-08-01T19:54:23.138225+0000","last_active":"2023-08-01T19:54:39.915762+0000","last_peered":"2023-08-01T19:54:39.915762+0000","last_clean":"2023-08-01T19:54:39.915762+0000","last_became_active":"2023-08-01T19:54:23.137955+0000","last_became_peered":"2023-08-01T19:54:23.137955+0000","last_unstale":"2023-08-01T19:54:39.915762+0000","last_undegraded":"2023-08-01T19:54:39.915762+0000","last_fullsized":"2023-08-01T19:54:39.915762+0000","mapping_epoch":19,"log_start":"0'0","ondisk_log_start":"0'0","created":19,"last_epoch_clean":20,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-08-01T19:54:22.116710+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-08-01T19:54:22.116710+0000","last_clean_scrub_stamp":"2023-08-01T19:54:22.116710+0000","objects_scrubbed":0,"log_size":3070,"ondisk_log_size":3070,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-08-03T03:58:00.471919+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":201195520,"num_objects":3070,"num_object_clones":0,"num_object_copies":6140,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":3070,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":3070,"num_write_kb":196480,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[1,0],"acting":[1,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":1,"acting_primary":1,"purged_snaps":[]},{"pgid":"3.7","version":"17'2","reported_seq":20,"reported_epoch":25,"state":"active+clean","last_fresh":"2023-08-01T19:54:34.166659+0000","last_change":"2023-08-01T19:54:04.065147+0000","last_active":"2023-08-01T19:54:34.166659+0000","last_peered":"2023-08-01T19:54:34.166659+0000","last_clean":"2023-08-01T19:54:34.166659+0000","last_became_active":"2023-08-01T19:54:04.064779+0000","last_became_peered":"2023-08-01T19:54:04.064779+0000","last_unstale":"2023-08-01T19:54:34.166659+0000","last_undegraded":"2023-08-01T19:54:34.166659+0000","last_fullsized":"2023-08-01T19:54:34.166659+0000","mapping_epoch":15,"log_start":"0'0","ondisk_log_start":"0'0","created":15,"last_epoch_clean":16,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-08-01T19:54:03.032665+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-08-01T19:54:03.032665+0000","last_clean_scrub_stamp":"2023-08-01T19:54:03.032665+0000","objects_scrubbed":0,"log_size":2,"ondisk_log_size":2,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-08-03T03:43:45.667663+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":1,"num_object_clones":0,"num_object_copies":2,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":1,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":3,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":1,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[0,2],"acting":[0,2],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":0,"acting_primary":0,"purged_snaps":[]},{"pgid":"2.6","version":"0'0","reported_seq":21,"reported_epoch":25,"state":"active+clean","last_fresh":"2023-08-01T19:54:34.166710+0000","last_change":"2023-08-01T19:53:58.974077+0000","last_active":"2023-08-01T19:54:34.166710+0000","last_peered":"2023-08-01T19:54:34.166710+0000","last_clean":"2023-08-01T19:54:34.166710+0000","last_became_active":"2023-08-01T19:53:58.973396+0000","last_became_peered":"2023-08-01T19:53:58.973396+0000","last_unstale":"2023-08-01T19:54:34.166710+0000","last_undegraded":"2023-08-01T19:54:34.166710+0000","last_fullsized":"2023-08-01T19:54:34.166710+0000","mapping_epoch":12,"log_start":"0'0","ondisk_log_start":"0'0","created":12,"last_epoch_clean":13,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-08-01T19:53:57.959448+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-08-01T19:53:57.959448+0000","last_clean_scrub_stamp":"2023-08-01T19:53:57.959448+0000","objects_scrubbed":0,"log_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-08-02T22:13:50.940864+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[0,2],"acting":[0,2],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":0,"acting_primary":0,"purged_snaps":[]},{"pgid":"4.0","version":"0'0","reported_seq":17,"reported_epoch":25,"state":"active+clean","last_fresh":"2023-08-01T19:54:34.164860+0000","last_change":"2023-08-01T19:54:04.476807+0000","last_active":"2023-08-01T19:54:34.164860+0000","last_peered":"2023-08-01T19:54:34.164860+0000","last_clean":"2023-08-01T19:54:34.164860+0000","last_became_active":"2023-08-01T19:54:04.476453+0000","last_became_peered":"2023-08-01T19:54:04.476453+0000","last_unstale":"2023-08-01T19:54:34.164860+0000","last_undegraded":"2023-08-01T19:54:34.164860+0000","last_fullsized":"2023-08-01T19:54:34.164860+0000","mapping_epoch":16,"log_start":"0'0","ondisk_log_start":"0'0","created":16,"last_epoch_clean":17,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-08-01T19:54:04.040663+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-08-01T19:54:04.040663+0000","last_clean_scrub_stamp":"2023-08-01T19:54:04.040663+0000","objects_scrubbed":0,"log_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-08-02T20:20:59.989030+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[0,1],"acting":[0,1],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":0,"acting_primary":0,"purged_snaps":[]},{"pgid":"5.0","version":"27'3272","reported_seq":3287,"reported_epoch":27,"state":"active+clean","last_fresh":"2023-08-01T19:54:41.038462+0000","last_change":"2023-08-01T19:54:23.138369+0000","last_active":"2023-08-01T19:54:41.038462+0000","last_peered":"2023-08-01T19:54:41.038462+0000","last_clean":"2023-08-01T19:54:41.038462+0000","last_became_active":"2023-08-01T19:54:23.137857+0000","last_became_peered":"2023-08-01T19:54:23.137857+0000","last_unstale":"2023-08-01T19:54:41.038462+0000","last_undegraded":"2023-08-01T19:54:41.038462+0000","last_fullsized":"2023-08-01T19:54:41.038462+0000","mapping_epoch":19,"log_start":"0'0","ondisk_log_start":"0'0","created":19,"last_epoch_clean":20,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-08-01T19:54:22.116710+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-08-01T19:54:22.116710+0000","last_clean_scrub_stamp":"2023-08-01T19:54:22.116710+0000","objects_scrubbed":0,"log_size":3272,"ondisk_log_size":3272,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-08-03T06:02:44.391298+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":214433792,"num_objects":3272,"num_object_clones":0,"num_object_copies":6544,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":3272,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":3272,"num_write_kb":209408,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[2,0],"acting":[2,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":2,"acting_primary":2,"purged_snaps":[]},{"pgid":"2.7","version":"0'0","reported_seq":21,"reported_epoch":25,"state":"active+clean","last_fresh":"2023-08-01T19:54:34.171982+0000","last_change":"2023-08-01T19:53:58.975936+0000","last_active":"2023-08-01T19:54:34.171982+0000","last_peered":"2023-08-01T19:54:34.171982+0000","last_clean":"2023-08-01T19:54:34.171982+0000","last_became_active":"2023-08-01T19:53:58.975680+0000","last_became_peered":"2023-08-01T19:53:58.975680+0000","last_unstale":"2023-08-01T19:54:34.171982+0000","last_undegraded":"2023-08-01T19:54:34.171982+0000","last_fullsized":"2023-08-01T19:54:34.171982+0000","mapping_epoch":12,"log_start":"0'0","ondisk_log_start":"0'0","created":12,"last_epoch_clean":13,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-08-01T19:53:57.959448+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-08-01T19:53:57.959448+0000","last_clean_scrub_stamp":"2023-08-01T19:53:57.959448+0000","objects_scrubbed":0,"log_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-08-03T05:17:03.508898+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[1,2],"acting":[1,2],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":1,"acting_primary":1,"purged_snaps":[]},{"pgid":"3.6","version":"18'1","reported_seq":19,"reported_epoch":25,"state":"active+clean","last_fresh":"2023-08-01T19:54:34.166519+0000","last_change":"2023-08-01T19:54:04.068041+0000","last_active":"2023-08-01T19:54:34.166519+0000","last_peered":"2023-08-01T19:54:34.166519+0000","last_clean":"2023-08-01T19:54:34.166519+0000","last_became_active":"2023-08-01T19:54:04.067613+0000","last_became_peered":"2023-08-01T19:54:04.067613+0000","last_unstale":"2023-08-01T19:54:34.166519+0000","last_undegraded":"2023-08-01T19:54:34.166519+0000","last_fullsized":"2023-08-01T19:54:34.166519+0000","mapping_epoch":15,"log_start":"0'0","ondisk_log_start":"0'0","created":15,"last_epoch_clean":16,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-08-01T19:54:03.032665+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-08-01T19:54:03.032665+0000","last_clean_scrub_stamp":"2023-08-01T19:54:03.032665+0000","objects_scrubbed":0,"log_size":1,"ondisk_log_size":1,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-08-02T21:35:44.874727+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":1,"num_object_clones":0,"num_object_copies":2,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":1,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":1,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":1,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[0,1],"acting":[0,1],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":0,"acting_primary":0,"purged_snaps":[]},{"pgid":"4.1","version":"0'0","reported_seq":18,"reported_epoch":26,"state":"active+clean","last_fresh":"2023-08-01T19:54:37.176341+0000","last_change":"2023-08-01T19:54:04.469243+0000","last_active":"2023-08-01T19:54:37.176341+0000","last_peered":"2023-08-01T19:54:37.176341+0000","last_clean":"2023-08-01T19:54:37.176341+0000","last_became_active":"2023-08-01T19:54:04.468835+0000","last_became_peered":"2023-08-01T19:54:04.468835+0000","last_unstale":"2023-08-01T19:54:37.176341+0000","last_undegraded":"2023-08-01T19:54:37.176341+0000","last_fullsized":"2023-08-01T19:54:37.176341+0000","mapping_epoch":16,"log_start":"0'0","ondisk_log_start":"0'0","created":16,"last_epoch_clean":17,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-08-01T19:54:04.040663+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-08-01T19:54:04.040663+0000","last_clean_scrub_stamp":"2023-08-01T19:54:04.040663+0000","objects_scrubbed":0,"log_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-08-03T04:43:58.358628+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[2,1],"acting":[2,1],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":2,"acting_primary":2,"purged_snaps":[]},{"pgid":"3.1b","version":"17'1","reported_seq":20,"reported_epoch":26,"state":"active+clean","last_fresh":"2023-08-01T19:54:37.176417+0000","last_change":"2023-08-01T19:54:04.066748+0000","last_active":"2023-08-01T19:54:37.176417+0000","last_peered":"2023-08-01T19:54:37.176417+0000","last_clean":"2023-08-01T19:54:37.176417+0000","last_became_active":"2023-08-01T19:54:04.066483+0000","last_became_peered":"2023-08-01T19:54:04.066483+0000","last_unstale":"2023-08-01T19:54:37.176417+0000","last_undegraded":"2023-08-01T19:54:37.176417+0000","last_fullsized":"2023-08-01T19:54:37.176417+0000","mapping_epoch":15,"log_start":"0'0","ondisk_log_start":"0'0","created":15,"last_epoch_clean":16,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-08-01T19:54:03.032665+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-08-01T19:54:03.032665+0000","last_clean_scrub_stamp":"2023-08-01T19:54:03.032665+0000","objects_scrubbed":0,"log_size":1,"ondisk_log_size":1,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-08-03T03:08:26.880362+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[2,1],"acting":[2,1],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":2,"acting_primary":2,"purged_snaps":[]},{"pgid":"4.1c","version":"0'0","reported_seq":18,"reported_epoch":26,"state":"active+clean","last_fresh":"2023-08-01T19:54:37.176973+0000","last_change":"2023-08-01T19:54:04.466766+0000","last_active":"2023-08-01T19:54:37.176973+0000","last_peered":"2023-08-01T19:54:37.176973+0000","last_clean":"2023-08-01T19:54:37.176973+0000","last_became_active":"2023-08-01T19:54:04.466417+0000","last_became_peered":"2023-08-01T19:54:04.466417+0000","last_unstale":"2023-08-01T19:54:37.176973+0000","last_undegraded":"2023-08-01T19:54:37.176973+0000","last_fullsized":"2023-08-01T19:54:37.176973+0000","mapping_epoch":16,"log_start":"0'0","ondisk_log_start":"0'0","created":16,"last_epoch_clean":17,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-08-01T19:54:04.040663+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-08-01T19:54:04.040663+0000","last_clean_scrub_stamp":"2023-08-01T19:54:04.040663+0000","objects_scrubbed":0,"log_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-08-02T22:01:53.643825+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[2,0],"acting":[2,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":2,"acting_primary":2,"purged_snaps":[]},{"pgid":"3.1c","version":"17'2","reported_seq":20,"reported_epoch":25,"state":"active+clean","last_fresh":"2023-08-01T19:54:34.170451+0000","last_change":"2023-08-01T19:54:04.065706+0000","last_active":"2023-08-01T19:54:34.170451+0000","last_peered":"2023-08-01T19:54:34.170451+0000","last_clean":"2023-08-01T19:54:34.170451+0000","last_became_active":"2023-08-01T19:54:04.064796+0000","last_became_peered":"2023-08-01T19:54:04.064796+0000","last_unstale":"2023-08-01T19:54:34.170451+0000","last_undegraded":"2023-08-01T19:54:34.170451+0000","last_fullsized":"2023-08-01T19:54:34.170451+0000","mapping_epoch":15,"log_start":"0'0","ondisk_log_start":"0'0","created":15,"last_epoch_clean":16,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-08-01T19:54:03.032665+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-08-01T19:54:03.032665+0000","last_clean_scrub_stamp":"2023-08-01T19:54:03.032665+0000","objects_scrubbed":0,"log_size":2,"ondisk_log_size":2,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-08-02T21:40:43.596301+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":1,"num_object_clones":0,"num_object_copies":2,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":1,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":3,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":1,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[1,0],"acting":[1,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":1,"acting_primary":1,"purged_snaps":[]},{"pgid":"4.1b","version":"0'0","reported_seq":17,"reported_epoch":25,"state":"active+clean","last_fresh":"2023-08-01T19:54:34.170756+0000","last_change":"2023-08-01T19:54:04.474971+0000","last_active":"2023-08-01T19:54:34.170756+0000","last_peered":"2023-08-01T19:54:34.170756+0000","last_clean":"2023-08-01T19:54:34.170756+0000","last_became_active":"2023-08-01T19:54:04.473957+0000","last_became_peered":"2023-08-01T19:54:04.473957+0000","last_unstale":"2023-08-01T19:54:34.170756+0000","last_undegraded":"2023-08-01T19:54:34.170756+0000","last_fullsized":"2023-08-01T19:54:34.170756+0000","mapping_epoch":16,"log_start":"0'0","ondisk_log_start":"0'0","created":16,"last_epoch_clean":17,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-08-01T19:54:04.040663+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-08-01T19:54:04.040663+0000","last_clean_scrub_stamp":"2023-08-01T19:54:04.040663+0000","objects_scrubbed":0,"log_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-08-02T21:59:19.682560+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[1,0],"acting":[1,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":1,"acting_primary":1,"purged_snaps":[]},{"pgid":"3.1d","version":"17'2","reported_seq":21,"reported_epoch":26,"state":"active+clean","last_fresh":"2023-08-01T19:54:37.177090+0000","last_change":"2023-08-01T19:54:04.065591+0000","last_active":"2023-08-01T19:54:37.177090+0000","last_peered":"2023-08-01T19:54:37.177090+0000","last_clean":"2023-08-01T19:54:37.177090+0000","last_became_active":"2023-08-01T19:54:04.065306+0000","last_became_peered":"2023-08-01T19:54:04.065306+0000","last_unstale":"2023-08-01T19:54:37.177090+0000","last_undegraded":"2023-08-01T19:54:37.177090+0000","last_fullsized":"2023-08-01T19:54:37.177090+0000","mapping_epoch":15,"log_start":"0'0","ondisk_log_start":"0'0","created":15,"last_epoch_clean":16,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-08-01T19:54:03.032665+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-08-01T19:54:03.032665+0000","last_clean_scrub_stamp":"2023-08-01T19:54:03.032665+0000","objects_scrubbed":0,"log_size":2,"ondisk_log_size":2,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-08-02T21:32:10.389227+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":1,"num_object_clones":0,"num_object_copies":2,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":1,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":3,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":1,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[2,1],"acting":[2,1],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":2,"acting_primary":2,"purged_snaps":[]},{"pgid":"4.1a","version":"0'0","reported_seq":17,"reported_epoch":25,"state":"active+clean","last_fresh":"2023-08-01T19:54:34.170526+0000","last_change":"2023-08-01T19:54:04.473302+0000","last_active":"2023-08-01T19:54:34.170526+0000","last_peered":"2023-08-01T19:54:34.170526+0000","last_clean":"2023-08-01T19:54:34.170526+0000","last_became_active":"2023-08-01T19:54:04.472452+0000","last_became_peered":"2023-08-01T19:54:04.472452+0000","last_unstale":"2023-08-01T19:54:34.170526+0000","last_undegraded":"2023-08-01T19:54:34.170526+0000","last_fullsized":"2023-08-01T19:54:34.170526+0000","mapping_epoch":16,"log_start":"0'0","ondisk_log_start":"0'0","created":16,"last_epoch_clean":17,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-08-01T19:54:04.040663+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-08-01T19:54:04.040663+0000","last_clean_scrub_stamp":"2023-08-01T19:54:04.040663+0000","objects_scrubbed":0,"log_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-08-02T21:02:39.542019+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[1,0],"acting":[1,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":1,"acting_primary":1,"purged_snaps":[]},{"pgid":"3.1e","version":"17'1","reported_seq":19,"reported_epoch":25,"state":"active+clean","last_fresh":"2023-08-01T19:54:34.166604+0000","last_change":"2023-08-01T19:54:04.064378+0000","last_active":"2023-08-01T19:54:34.166604+0000","last_peered":"2023-08-01T19:54:34.166604+0000","last_clean":"2023-08-01T19:54:34.166604+0000","last_became_active":"2023-08-01T19:54:04.063988+0000","last_became_peered":"2023-08-01T19:54:04.063988+0000","last_unstale":"2023-08-01T19:54:34.166604+0000","last_undegraded":"2023-08-01T19:54:34.166604+0000","last_fullsized":"2023-08-01T19:54:34.166604+0000","mapping_epoch":15,"log_start":"0'0","ondisk_log_start":"0'0","created":15,"last_epoch_clean":16,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-08-01T19:54:03.032665+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-08-01T19:54:03.032665+0000","last_clean_scrub_stamp":"2023-08-01T19:54:03.032665+0000","objects_scrubbed":0,"log_size":1,"ondisk_log_size":1,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-08-02T22:28:51.936138+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[0,2],"acting":[0,2],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":0,"acting_primary":0,"purged_snaps":[]},{"pgid":"4.19","version":"0'0","reported_seq":18,"reported_epoch":26,"state":"active+clean","last_fresh":"2023-08-01T19:54:37.176499+0000","last_change":"2023-08-01T19:54:04.467017+0000","last_active":"2023-08-01T19:54:37.176499+0000","last_peered":"2023-08-01T19:54:37.176499+0000","last_clean":"2023-08-01T19:54:37.176499+0000","last_became_active":"2023-08-01T19:54:04.466339+0000","last_became_peered":"2023-08-01T19:54:04.466339+0000","last_unstale":"2023-08-01T19:54:37.176499+0000","last_undegraded":"2023-08-01T19:54:37.176499+0000","last_fullsized":"2023-08-01T19:54:37.176499+0000","mapping_epoch":16,"log_start":"0'0","ondisk_log_start":"0'0","created":16,"last_epoch_clean":17,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-08-01T19:54:04.040663+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-08-01T19:54:04.040663+0000","last_clean_scrub_stamp":"2023-08-01T19:54:04.040663+0000","objects_scrubbed":0,"log_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-08-03T04:07:57.222873+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[2,0],"acting":[2,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":2,"acting_primary":2,"purged_snaps":[]},{"pgid":"3.1f","version":"17'4","reported_seq":22,"reported_epoch":25,"state":"active+clean","last_fresh":"2023-08-01T19:54:34.166754+0000","last_change":"2023-08-01T19:54:04.067767+0000","last_active":"2023-08-01T19:54:34.166754+0000","last_peered":"2023-08-01T19:54:34.166754+0000","last_clean":"2023-08-01T19:54:34.166754+0000","last_became_active":"2023-08-01T19:54:04.067414+0000","last_became_peered":"2023-08-01T19:54:04.067414+0000","last_unstale":"2023-08-01T19:54:34.166754+0000","last_undegraded":"2023-08-01T19:54:34.166754+0000","last_fullsized":"2023-08-01T19:54:34.166754+0000","mapping_epoch":15,"log_start":"0'0","ondisk_log_start":"0'0","created":15,"last_epoch_clean":16,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-08-01T19:54:03.032665+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-08-01T19:54:03.032665+0000","last_clean_scrub_stamp":"2023-08-01T19:54:03.032665+0000","objects_scrubbed":0,"log_size":4,"ondisk_log_size":4,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-08-02T21:33:27.007118+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":554,"num_objects":2,"num_object_clones":0,"num_object_copies":4,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":2,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":4,"num_write_kb":1,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":1,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[0,1],"acting":[0,1],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":0,"acting_primary":0,"purged_snaps":[]},{"pgid":"4.18","version":"0'0","reported_seq":17,"reported_epoch":25,"state":"active+clean","last_fresh":"2023-08-01T19:54:34.170802+0000","last_change":"2023-08-01T19:54:04.477588+0000","last_active":"2023-08-01T19:54:34.170802+0000","last_peered":"2023-08-01T19:54:34.170802+0000","last_clean":"2023-08-01T19:54:34.170802+0000","last_became_active":"2023-08-01T19:54:04.476194+0000","last_became_peered":"2023-08-01T19:54:04.476194+0000","last_unstale":"2023-08-01T19:54:34.170802+0000","last_undegraded":"2023-08-01T19:54:34.170802+0000","last_fullsized":"2023-08-01T19:54:34.170802+0000","mapping_epoch":16,"log_start":"0'0","ondisk_log_start":"0'0","created":16,"last_epoch_clean":17,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-08-01T19:54:04.040663+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-08-01T19:54:04.040663+0000","last_clean_scrub_stamp":"2023-08-01T19:54:04.040663+0000","objects_scrubbed":0,"log_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-08-03T03:58:06.360840+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[1,0],"acting":[1,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":1,"acting_primary":1,"purged_snaps":[]},{"pgid":"4.20","version":"0'0","reported_seq":17,"reported_epoch":25,"state":"active+clean","last_fresh":"2023-08-01T19:54:34.170647+0000","last_change":"2023-08-01T19:54:04.477904+0000","last_active":"2023-08-01T19:54:34.170647+0000","last_peered":"2023-08-01T19:54:34.170647+0000","last_clean":"2023-08-01T19:54:34.170647+0000","last_became_active":"2023-08-01T19:54:04.476564+0000","last_became_peered":"2023-08-01T19:54:04.476564+0000","last_unstale":"2023-08-01T19:54:34.170647+0000","last_undegraded":"2023-08-01T19:54:34.170647+0000","last_fullsized":"2023-08-01T19:54:34.170647+0000","mapping_epoch":16,"log_start":"0'0","ondisk_log_start":"0'0","created":16,"last_epoch_clean":17,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-08-01T19:54:04.040663+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-08-01T19:54:04.040663+0000","last_clean_scrub_stamp":"2023-08-01T19:54:04.040663+0000","objects_scrubbed":0,"log_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-08-03T02:21:47.656072+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[1,0],"acting":[1,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":1,"acting_primary":1,"purged_snaps":[]},{"pgid":"4.21","version":"0'0","reported_seq":17,"reported_epoch":25,"state":"active+clean","last_fresh":"2023-08-01T19:54:34.165075+0000","last_change":"2023-08-01T19:54:04.466899+0000","last_active":"2023-08-01T19:54:34.165075+0000","last_peered":"2023-08-01T19:54:34.165075+0000","last_clean":"2023-08-01T19:54:34.165075+0000","last_became_active":"2023-08-01T19:54:04.466500+0000","last_became_peered":"2023-08-01T19:54:04.466500+0000","last_unstale":"2023-08-01T19:54:34.165075+0000","last_undegraded":"2023-08-01T19:54:34.165075+0000","last_fullsized":"2023-08-01T19:54:34.165075+0000","mapping_epoch":16,"log_start":"0'0","ondisk_log_start":"0'0","created":16,"last_epoch_clean":17,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-08-01T19:54:04.040663+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-08-01T19:54:04.040663+0000","last_clean_scrub_stamp":"2023-08-01T19:54:04.040663+0000","objects_scrubbed":0,"log_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-08-03T07:36:38.654701+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[0,2],"acting":[0,2],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":0,"acting_primary":0,"purged_snaps":[]},{"pgid":"4.22","version":"0'0","reported_seq":18,"reported_epoch":26,"state":"active+clean","last_fresh":"2023-08-01T19:54:37.177584+0000","last_change":"2023-08-01T19:54:04.471945+0000","last_active":"2023-08-01T19:54:37.177584+0000","last_peered":"2023-08-01T19:54:37.177584+0000","last_clean":"2023-08-01T19:54:37.177584+0000","last_became_active":"2023-08-01T19:54:04.471371+0000","last_became_peered":"2023-08-01T19:54:04.471371+0000","last_unstale":"2023-08-01T19:54:37.177584+0000","last_undegraded":"2023-08-01T19:54:37.177584+0000","last_fullsized":"2023-08-01T19:54:37.177584+0000","mapping_epoch":16,"log_start":"0'0","ondisk_log_start":"0'0","created":16,"last_epoch_clean":17,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-08-01T19:54:04.040663+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-08-01T19:54:04.040663+0000","last_clean_scrub_stamp":"2023-08-01T19:54:04.040663+0000","objects_scrubbed":0,"log_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-08-02T22:17:59.847819+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[2,1],"acting":[2,1],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":2,"acting_primary":2,"purged_snaps":[]},{"pgid":"4.23","version":"0'0","reported_seq":17,"reported_epoch":25,"state":"active+clean","last_fresh":"2023-08-01T19:54:34.166835+0000","last_change":"2023-08-01T19:54:04.467847+0000","last_active":"2023-08-01T19:54:34.166835+0000","last_peered":"2023-08-01T19:54:34.166835+0000","last_clean":"2023-08-01T19:54:34.166835+0000","last_became_active":"2023-08-01T19:54:04.467111+0000","last_became_peered":"2023-08-01T19:54:04.467111+0000","last_unstale":"2023-08-01T19:54:34.166835+0000","last_undegraded":"2023-08-01T19:54:34.166835+0000","last_fullsized":"2023-08-01T19:54:34.166835+0000","mapping_epoch":16,"log_start":"0'0","ondisk_log_start":"0'0","created":16,"last_epoch_clean":17,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-08-01T19:54:04.040663+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-08-01T19:54:04.040663+0000","last_clean_scrub_stamp":"2023-08-01T19:54:04.040663+0000","objects_scrubbed":0,"log_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-08-03T00:42:19.379348+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[0,2],"acting":[0,2],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":0,"acting_primary":0,"purged_snaps":[]},{"pgid":"4.24","version":"0'0","reported_seq":18,"reported_epoch":26,"state":"active+clean","last_fresh":"2023-08-01T19:54:37.177047+0000","last_change":"2023-08-01T19:54:04.477128+0000","last_active":"2023-08-01T19:54:37.177047+0000","last_peered":"2023-08-01T19:54:37.177047+0000","last_clean":"2023-08-01T19:54:37.177047+0000","last_became_active":"2023-08-01T19:54:04.476819+0000","last_became_peered":"2023-08-01T19:54:04.476819+0000","last_unstale":"2023-08-01T19:54:37.177047+0000","last_undegraded":"2023-08-01T19:54:37.177047+0000","last_fullsized":"2023-08-01T19:54:37.177047+0000","mapping_epoch":16,"log_start":"0'0","ondisk_log_start":"0'0","created":16,"last_epoch_clean":17,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-08-01T19:54:04.040663+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-08-01T19:54:04.040663+0000","last_clean_scrub_stamp":"2023-08-01T19:54:04.040663+0000","objects_scrubbed":0,"log_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-08-03T02:20:23.354054+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[2,1],"acting":[2,1],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":2,"acting_primary":2,"purged_snaps":[]}],"pool_stats":[{"poolid":5,"num_pg":16,"stat_sum":{"num_bytes":3284074496,"num_objects":50111,"num_object_clones":0,"num_object_copies":100222,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":50111,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":50111,"num_write_kb":3207104,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"store_stats":{"total":0,"available":0,"internally_reserved":0,"allocated":408506368,"data_stored":6536101888,"data_compressed":31293942,"data_compressed_allocated":408506368,"data_compressed_original":6536101888,"omap_allocated":0,"internal_metadata":0},"log_size":50111,"ondisk_log_size":50111,"up":32,"acting":32,"num_store_stats":3},{"poolid":4,"num_pg":64,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"store_stats":{"total":0,"available":0,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},"log_size":0,"ondisk_log_size":0,"up":128,"acting":128,"num_store_stats":3},{"poolid":3,"num_pg":32,"stat_sum":{"num_bytes":2306,"num_objects":22,"num_object_clones":0,"num_object_copies":44,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":22,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":45,"num_write_kb":13,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":14,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"store_stats":{"total":0,"available":0,"internally_reserved":0,"allocated":65536,"data_stored":4612,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},"log_size":39,"ondisk_log_size":39,"up":64,"acting":64,"num_store_stats":3},{"poolid":1,"num_pg":1,"stat_sum":{"num_bytes":590368,"num_objects":2,"num_object_clones":0,"num_object_copies":4,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":2,"num_whiteouts":0,"num_read":136,"num_read_kb":118,"num_write":203,"num_write_kb":3460,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"store_stats":{"total":0,"available":0,"internally_reserved":0,"allocated":114688,"data_stored":1180736,"data_compressed":20662,"data_compressed_allocated":73728,"data_compressed_original":1146880,"omap_allocated":0,"internal_metadata":0},"log_size":157,"ondisk_log_size":157,"up":2,"acting":2,"num_store_stats":2},{"poolid":2,"num_pg":8,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"store_stats":{"total":0,"available":0,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},"log_size":0,"ondisk_log_size":0,"up":16,"acting":16,"num_store_stats":3}],"osd_stats":[{"osd":2,"up_from":9,"seq":38654705678,"num_pgs":76,"num_osds":1,"num_per_pool_osds":1,"num_per_pool_omap_osds":1,"kb":94371840,"kb_used":152704,"kb_used_data":112120,"kb_used_omap":0,"kb_used_meta":40576,"kb_avail":94219136,"statfs":{"total":96636764160,"available":96480395264,"internally_reserved":0,"allocated":114810880,"data_stored":1832092899,"data_compressed":8778766,"data_compressed_allocated":114499584,"data_compressed_original":1831976960,"omap_allocated":0,"internal_metadata":41549824},"hb_peers":[0,1],"snap_trim_queue_len":0,"num_snap_trimming":0,"num_shards_repaired":0,"op_queue_age_hist":{"histogram":[2,3,3,3],"upper_bound":16},"perf_stat":{"commit_latency_ms":2,"apply_latency_ms":2,"commit_latency_ns":2000000,"apply_latency_ns":2000000},"alerts":[],"network_ping_times":[{"osd":0,"last update":"Thu Jan 1 00:00:00 1970","interfaces":[{"interface":"back","average":{"1min":0,"5min":0,"15min":0},"min":{"1min":0,"5min":0,"15min":0},"max":{"1min":0,"5min":0,"15min":0},"last":0.223}]},{"osd":1,"last update":"Thu Jan 1 00:00:00 1970","interfaces":[{"interface":"back","average":{"1min":0,"5min":0,"15min":0},"min":{"1min":0,"5min":0,"15min":0},"max":{"1min":0,"5min":0,"15min":0},"last":0.54500000000000004}]}]},{"osd":0,"up_from":8,"seq":34359738381,"num_pgs":85,"num_osds":1,"num_per_pool_osds":1,"num_per_pool_omap_osds":1,"kb":94371840,"kb_used":217176,"kb_used_data":154576,"kb_used_omap":0,"kb_used_meta":62592,"kb_avail":94154664,"statfs":{"total":96636764160,"available":96414375936,"internally_reserved":0,"allocated":158285824,"data_stored":2528472196,"data_compressed":12105065,"data_compressed_allocated":158023680,"data_compressed_original":2528378880,"omap_allocated":0,"internal_metadata":64094208},"hb_peers":[1,2],"snap_trim_queue_len":0,"num_snap_trimming":0,"num_shards_repaired":0,"op_queue_age_hist":{"histogram":[],"upper_bound":1},"perf_stat":{"commit_latency_ms":2,"apply_latency_ms":2,"commit_latency_ns":2000000,"apply_latency_ns":2000000},"alerts":[],"network_ping_times":[{"osd":1,"last update":"Thu Jan 1 00:00:00 1970","interfaces":[{"interface":"back","average":{"1min":0,"5min":0,"15min":0},"min":{"1min":0,"5min":0,"15min":0},"max":{"1min":0,"5min":0,"15min":0},"last":0.17699999999999999}]},{"osd":2,"last update":"Thu Jan 1 00:00:00 1970","interfaces":[{"interface":"back","average":{"1min":0,"5min":0,"15min":0},"min":{"1min":0,"5min":0,"15min":0},"max":{"1min":0,"5min":0,"15min":0},"last":0.28699999999999998}]}]},{"osd":1,"up_from":8,"seq":34359738380,"num_pgs":81,"num_osds":1,"num_per_pool_osds":1,"num_per_pool_omap_osds":1,"kb":94371840,"kb_used":156552,"kb_used_data":118464,"kb_used_omap":0,"kb_used_meta":38080,"kb_avail":94215288,"statfs":{"total":96636764160,"available":96476454912,"internally_reserved":0,"allocated":121307136,"data_stored":1936094554,"data_compressed":9276509,"data_compressed_allocated":120999936,"data_compressed_original":1935982592,"omap_allocated":0,"internal_metadata":38993920},"hb_peers":[0,2],"snap_trim_queue_len":0,"num_snap_trimming":0,"num_shards_repaired":0,"op_queue_age_hist":{"histogram":[],"upper_bound":1},"perf_stat":{"commit_latency_ms":2,"apply_latency_ms":2,"commit_latency_ns":2000000,"apply_latency_ns":2000000},"alerts":[],"network_ping_times":[{"osd":0,"last update":"Thu Jan 1 00:00:00 1970","interfaces":[{"interface":"back","average":{"1min":0,"5min":0,"15min":0},"min":{"1min":0,"5min":0,"15min":0},"max":{"1min":0,"5min":0,"15min":0},"last":0.17299999999999999}]},{"osd":2,"last update":"Thu Jan 1 00:00:00 1970","interfaces":[{"interface":"back","average":{"1min":0,"5min":0,"15min":0},"min":{"1min":0,"5min":0,"15min":0},"max":{"1min":0,"5min":0,"15min":0},"last":0.26300000000000001}]}]}],"pool_statfs":[{"poolid":1,"osd":1,"total":0,"available":0,"internally_reserved":0,"allocated":57344,"data_stored":590368,"data_compressed":10331,"data_compressed_allocated":36864,"data_compressed_original":573440,"omap_allocated":0,"internal_metadata":0},{"poolid":1,"osd":2,"total":0,"available":0,"internally_reserved":0,"allocated":57344,"data_stored":590368,"data_compressed":10331,"data_compressed_allocated":36864,"data_compressed_original":573440,"omap_allocated":0,"internal_metadata":0},{"poolid":2,"osd":0,"total":0,"available":0,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":2,"osd":1,"total":0,"available":0,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":2,"osd":2,"total":0,"available":0,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":3,"osd":0,"total":0,"available":0,"internally_reserved":0,"allocated":8192,"data_stored":588,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":3,"osd":1,"total":0,"available":0,"internally_reserved":0,"allocated":32768,"data_stored":2306,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":3,"osd":2,"total":0,"available":0,"internally_reserved":0,"allocated":24576,"data_stored":1718,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":4,"osd":0,"total":0,"available":0,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":4,"osd":1,"total":0,"available":0,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":4,"osd":2,"total":0,"available":0,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":5,"osd":0,"total":0,"available":0,"internally_reserved":0,"allocated":163823616,"data_stored":2621177856,"data_compressed":12549689,"data_compressed_allocated":163823616,"data_compressed_original":2621177856,"omap_allocated":0,"internal_metadata":0},{"poolid":5,"osd":1,"total":0,"available":0,"internally_reserved":0,"allocated":125726720,"data_stored":2011627520,"data_compressed":9631360,"data_compressed_allocated":125726720,"data_compressed_original":2011627520,"omap_allocated":0,"internal_metadata":0},{"poolid":5,"osd":2,"total":0,"available":0,"internally_reserved":0,"allocated":118956032,"data_stored":1903296512,"data_compressed":9112893,"data_compressed_allocated":118956032,"data_compressed_original":1903296512,"omap_allocated":0,"internal_metadata":0}]}} 2023-08-01T19:54:45.125 INFO:tasks.ceph.osd.0.smithi008.stderr:2023-08-01T19:54:45.124+0000 7f16a58f4700 -1 received signal: Hangup from /usr/bin/python3 /bin/daemon-helper kill ceph-osd -f --cluster ceph -i 0 (PID: 111179) UID: 0 2023-08-01T19:54:45.142 INFO:teuthology.orchestra.run.smithi155.stdout:ERROR: (22) Invalid argument 2023-08-01T19:54:45.143 INFO:teuthology.orchestra.run.smithi155.stdout:op_tracker tracking is not enabled now, so no ops are tracked currently, even those get stuck. Please enable "osd_enable_op_tracker", and the tracker will start to track new ops received afterwards. 2023-08-01T19:54:45.156 DEBUG:teuthology.orchestra.run.smithi008:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 30 ceph --cluster ceph --admin-daemon /var/run/ceph/ceph-osd.0.asok dump_ops_in_flight 2023-08-01T19:54:45.226 INFO:tasks.ceph.osd.1.smithi101.stderr:2023-08-01T19:54:45.225+0000 7fb0cb7f6700 -1 received signal: Hangup from /usr/bin/python3 /bin/daemon-helper kill ceph-osd -f --cluster ceph -i 1 (PID: 111141) UID: 0 2023-08-01T19:54:45.313 DEBUG:teuthology.orchestra.run.smithi006:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 120 ceph --cluster ceph osd set noscrub 2023-08-01T19:54:45.314 INFO:tasks.radosbench.radosbench.0.smithi006.stdout: 21 16 60966 60950 181.385 132.625 0.0161501 0.00551007 2023-08-01T19:54:45.327 INFO:tasks.ceph.osd.2.smithi155.stderr:2023-08-01T19:54:45.325+0000 7faa5c6ac700 -1 received signal: Hangup from /usr/bin/python3 /bin/daemon-helper kill ceph-osd -f --cluster ceph -i 2 (PID: 111337) UID: 0 2023-08-01T19:54:45.342 INFO:teuthology.orchestra.run.smithi008.stdout:ERROR: (22) Invalid argument 2023-08-01T19:54:45.342 INFO:teuthology.orchestra.run.smithi008.stdout:op_tracker tracking is not enabled now, so no ops are tracked currently, even those get stuck. Please enable "osd_enable_op_tracker", and the tracker will start to track new ops received afterwards. 2023-08-01T19:54:45.359 DEBUG:teuthology.orchestra.run.smithi008:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 30 ceph --cluster ceph --admin-daemon /var/run/ceph/ceph-osd.0.asok dump_blocked_ops 2023-08-01T19:54:45.428 INFO:tasks.ceph.osd.2.smithi155.stderr:2023-08-01T19:54:45.426+0000 7faa5c6ac700 -1 received signal: Hangup from /usr/bin/python3 /bin/daemon-helper kill ceph-osd -f --cluster ceph -i 2 (PID: 111337) UID: 0 2023-08-01T19:54:45.513 DEBUG:teuthology.orchestra.run.smithi006:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 120 ceph --cluster ceph -- tell 'osd.*' injectargs --osd_enable_op_tracker=true 2023-08-01T19:54:45.529 INFO:tasks.ceph.osd.2.smithi155.stderr:2023-08-01T19:54:45.527+0000 7faa5c6ac700 -1 received signal: Hangup from /usr/bin/python3 /bin/daemon-helper kill ceph-osd -f --cluster ceph -i 2 (PID: 111337) UID: 0 2023-08-01T19:54:45.548 INFO:teuthology.orchestra.run.smithi008.stdout:ERROR: (22) Invalid argument 2023-08-01T19:54:45.548 INFO:teuthology.orchestra.run.smithi008.stdout:op_tracker tracking is not enabled now, so no ops are tracked currently, even those get stuck. Please enable "osd_enable_op_tracker", and the tracker will start to track new ops received afterwards. 2023-08-01T19:54:45.563 DEBUG:teuthology.orchestra.run.smithi008:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 30 ceph --cluster ceph --admin-daemon /var/run/ceph/ceph-osd.0.asok dump_historic_ops 2023-08-01T19:54:45.629 INFO:tasks.ceph.osd.2.smithi155.stderr:2023-08-01T19:54:45.628+0000 7faa5c6ac700 -1 received signal: Hangup from /usr/bin/python3 /bin/daemon-helper kill ceph-osd -f --cluster ceph -i 2 (PID: 111337) UID: 0 2023-08-01T19:54:45.683 INFO:teuthology.orchestra.run.smithi006.stdout:osd.0: {} 2023-08-01T19:54:45.703 INFO:teuthology.orchestra.run.smithi006.stdout:osd.1: {} 2023-08-01T19:54:45.722 INFO:teuthology.orchestra.run.smithi006.stdout:osd.2: {} 2023-08-01T19:54:45.723 INFO:teuthology.orchestra.run.smithi006.stderr:osd.0: osd_enable_op_tracker = 'true' 2023-08-01T19:54:45.724 INFO:teuthology.orchestra.run.smithi006.stderr:osd.1: osd_enable_op_tracker = 'true' 2023-08-01T19:54:45.724 INFO:teuthology.orchestra.run.smithi006.stderr:osd.2: osd_enable_op_tracker = 'true' 2023-08-01T19:54:45.730 INFO:tasks.ceph.osd.1.smithi101.stderr:2023-08-01T19:54:45.728+0000 7fb0cb7f6700 -1 received signal: Hangup from /usr/bin/python3 /bin/daemon-helper kill ceph-osd -f --cluster ceph -i 1 (PID: 111141) UID: 0 2023-08-01T19:54:45.738 INFO:teuthology.orchestra.run.smithi006.stderr:noscrub is set 2023-08-01T19:54:45.758 INFO:teuthology.orchestra.run.smithi008.stdout:{ 2023-08-01T19:54:45.758 INFO:teuthology.orchestra.run.smithi008.stdout: "size": 20, 2023-08-01T19:54:45.758 INFO:teuthology.orchestra.run.smithi008.stdout: "duration": 600, 2023-08-01T19:54:45.759 INFO:teuthology.orchestra.run.smithi008.stdout: "ops": [ 2023-08-01T19:54:45.759 INFO:teuthology.orchestra.run.smithi008.stdout: { 2023-08-01T19:54:45.759 INFO:teuthology.orchestra.run.smithi008.stdout: "description": "osd_op(mds.0.3:28 3.b 3:d0630e4c:::mds0_sessionmap:head [omap-set-header] snapc 0=[] ondisk+write+known_if_redirected+full_force+supports_pool_eio e17)", 2023-08-01T19:54:45.759 INFO:teuthology.orchestra.run.smithi008.stdout: "initiated_at": "2023-08-01T19:54:04.459251+0000", 2023-08-01T19:54:45.759 INFO:teuthology.orchestra.run.smithi008.stdout: "age": 41.295363862999999, 2023-08-01T19:54:45.759 INFO:teuthology.orchestra.run.smithi008.stdout: "duration": 0.01361938, 2023-08-01T19:54:45.759 INFO:teuthology.orchestra.run.smithi008.stdout: "type_data": { 2023-08-01T19:54:45.760 INFO:teuthology.orchestra.run.smithi008.stdout: "flag_point": "commit sent; apply or cleanup", 2023-08-01T19:54:45.760 INFO:teuthology.orchestra.run.smithi008.stdout: "events": [ 2023-08-01T19:54:45.760 INFO:teuthology.orchestra.run.smithi008.stdout: { 2023-08-01T19:54:45.760 INFO:teuthology.orchestra.run.smithi008.stdout: "event": "initiated", 2023-08-01T19:54:45.760 INFO:teuthology.orchestra.run.smithi008.stdout: "time": "2023-08-01T19:54:04.459251+0000", 2023-08-01T19:54:45.760 INFO:teuthology.orchestra.run.smithi008.stdout: "duration": 0 2023-08-01T19:54:45.760 INFO:teuthology.orchestra.run.smithi008.stdout: }, 2023-08-01T19:54:45.760 INFO:teuthology.orchestra.run.smithi008.stdout: { 2023-08-01T19:54:45.761 INFO:teuthology.orchestra.run.smithi008.stdout: "event": "throttled", 2023-08-01T19:54:45.761 INFO:teuthology.orchestra.run.smithi008.stdout: "time": "2023-08-01T19:54:04.459251+0000", 2023-08-01T19:54:45.761 INFO:teuthology.orchestra.run.smithi008.stdout: "duration": 0 2023-08-01T19:54:45.761 INFO:teuthology.orchestra.run.smithi008.stdout: }, 2023-08-01T19:54:45.761 INFO:teuthology.orchestra.run.smithi008.stdout: { 2023-08-01T19:54:45.761 INFO:teuthology.orchestra.run.smithi008.stdout: "event": "header_read", 2023-08-01T19:54:45.761 INFO:teuthology.orchestra.run.smithi008.stdout: "time": "2023-08-01T19:54:04.459251+0000", 2023-08-01T19:54:45.761 INFO:teuthology.orchestra.run.smithi008.stdout: "duration": 4294967295.9999995 2023-08-01T19:54:45.762 INFO:teuthology.orchestra.run.smithi008.stdout: }, 2023-08-01T19:54:45.762 INFO:teuthology.orchestra.run.smithi008.stdout: { 2023-08-01T19:54:45.762 INFO:teuthology.orchestra.run.smithi008.stdout: "event": "all_read", 2023-08-01T19:54:45.762 INFO:teuthology.orchestra.run.smithi008.stdout: "time": "2023-08-01T19:54:04.459258+0000", 2023-08-01T19:54:45.762 INFO:teuthology.orchestra.run.smithi008.stdout: "duration": 7.0029999999999997e-06 2023-08-01T19:54:45.762 INFO:teuthology.orchestra.run.smithi008.stdout: }, 2023-08-01T19:54:45.762 INFO:teuthology.orchestra.run.smithi008.stdout: { 2023-08-01T19:54:45.762 INFO:teuthology.orchestra.run.smithi008.stdout: "event": "dispatched", 2023-08-01T19:54:45.763 INFO:teuthology.orchestra.run.smithi008.stdout: "time": "2023-08-01T19:54:04.459267+0000", 2023-08-01T19:54:45.763 INFO:teuthology.orchestra.run.smithi008.stdout: "duration": 8.8810000000000002e-06 2023-08-01T19:54:45.763 INFO:teuthology.orchestra.run.smithi008.stdout: }, 2023-08-01T19:54:45.763 INFO:teuthology.orchestra.run.smithi008.stdout: { 2023-08-01T19:54:45.763 INFO:teuthology.orchestra.run.smithi008.stdout: "event": "queued_for_pg", 2023-08-01T19:54:45.763 INFO:teuthology.orchestra.run.smithi008.stdout: "time": "2023-08-01T19:54:04.459273+0000", 2023-08-01T19:54:45.763 INFO:teuthology.orchestra.run.smithi008.stdout: "duration": 5.9279999999999998e-06 2023-08-01T19:54:45.763 INFO:teuthology.orchestra.run.smithi008.stdout: }, 2023-08-01T19:54:45.764 INFO:teuthology.orchestra.run.smithi008.stdout: { 2023-08-01T19:54:45.764 INFO:teuthology.orchestra.run.smithi008.stdout: "event": "reached_pg", 2023-08-01T19:54:45.764 INFO:teuthology.orchestra.run.smithi008.stdout: "time": "2023-08-01T19:54:04.460798+0000", 2023-08-01T19:54:45.764 INFO:teuthology.orchestra.run.smithi008.stdout: "duration": 0.001525039 2023-08-01T19:54:45.764 INFO:teuthology.orchestra.run.smithi008.stdout: }, 2023-08-01T19:54:45.764 INFO:teuthology.orchestra.run.smithi008.stdout: { 2023-08-01T19:54:45.764 INFO:teuthology.orchestra.run.smithi008.stdout: "event": "started", 2023-08-01T19:54:45.765 INFO:teuthology.orchestra.run.smithi008.stdout: "time": "2023-08-01T19:54:04.460951+0000", 2023-08-01T19:54:45.765 INFO:teuthology.orchestra.run.smithi008.stdout: "duration": 0.000153024 2023-08-01T19:54:45.765 INFO:teuthology.orchestra.run.smithi008.stdout: }, 2023-08-01T19:54:45.765 INFO:teuthology.orchestra.run.smithi008.stdout: { 2023-08-01T19:54:45.765 INFO:teuthology.orchestra.run.smithi008.stdout: "event": "waiting for subops from 1", 2023-08-01T19:54:45.765 INFO:teuthology.orchestra.run.smithi008.stdout: "time": "2023-08-01T19:54:04.461116+0000", 2023-08-01T19:54:45.765 INFO:teuthology.orchestra.run.smithi008.stdout: "duration": 0.00016551000000000001 2023-08-01T19:54:45.765 INFO:teuthology.orchestra.run.smithi008.stdout: }, 2023-08-01T19:54:45.766 INFO:teuthology.orchestra.run.smithi008.stdout: { 2023-08-01T19:54:45.766 INFO:teuthology.orchestra.run.smithi008.stdout: "event": "op_commit", 2023-08-01T19:54:45.766 INFO:teuthology.orchestra.run.smithi008.stdout: "time": "2023-08-01T19:54:04.463448+0000", 2023-08-01T19:54:45.766 INFO:teuthology.orchestra.run.smithi008.stdout: "duration": 0.0023321689999999998 2023-08-01T19:54:45.766 INFO:teuthology.orchestra.run.smithi008.stdout: }, 2023-08-01T19:54:45.766 INFO:teuthology.orchestra.run.smithi008.stdout: { 2023-08-01T19:54:45.766 INFO:teuthology.orchestra.run.smithi008.stdout: "event": "sub_op_commit_rec", 2023-08-01T19:54:45.766 INFO:teuthology.orchestra.run.smithi008.stdout: "time": "2023-08-01T19:54:04.472778+0000", 2023-08-01T19:54:45.767 INFO:teuthology.orchestra.run.smithi008.stdout: "duration": 0.0093293779999999993 2023-08-01T19:54:45.767 INFO:teuthology.orchestra.run.smithi008.stdout: }, 2023-08-01T19:54:45.767 INFO:teuthology.orchestra.run.smithi008.stdout: { 2023-08-01T19:54:45.767 INFO:teuthology.orchestra.run.smithi008.stdout: "event": "commit_sent", 2023-08-01T19:54:45.767 INFO:teuthology.orchestra.run.smithi008.stdout: "time": "2023-08-01T19:54:04.472821+0000", 2023-08-01T19:54:45.767 INFO:teuthology.orchestra.run.smithi008.stdout: "duration": 4.3253000000000001e-05 2023-08-01T19:54:45.767 INFO:teuthology.orchestra.run.smithi008.stdout: }, 2023-08-01T19:54:45.767 INFO:teuthology.orchestra.run.smithi008.stdout: { 2023-08-01T19:54:45.768 INFO:teuthology.orchestra.run.smithi008.stdout: "event": "done", 2023-08-01T19:54:45.768 INFO:teuthology.orchestra.run.smithi008.stdout: "time": "2023-08-01T19:54:04.472870+0000", 2023-08-01T19:54:45.768 INFO:teuthology.orchestra.run.smithi008.stdout: "duration": 4.9478999999999998e-05 2023-08-01T19:54:45.768 INFO:teuthology.orchestra.run.smithi008.stdout: } 2023-08-01T19:54:45.768 INFO:teuthology.orchestra.run.smithi008.stdout: ] 2023-08-01T19:54:45.768 INFO:teuthology.orchestra.run.smithi008.stdout: } 2023-08-01T19:54:45.768 INFO:teuthology.orchestra.run.smithi008.stdout: }, 2023-08-01T19:54:45.768 INFO:teuthology.orchestra.run.smithi008.stdout: { 2023-08-01T19:54:45.769 INFO:teuthology.orchestra.run.smithi008.stdout: "description": "osd_op(mds.0.3:34 3.b 3:d5c7a900:::200.00000003:head [delete] snapc 0=[] ondisk+write+known_if_redirected+full_force+supports_pool_eio e17)", 2023-08-01T19:54:45.769 INFO:teuthology.orchestra.run.smithi008.stdout: "initiated_at": "2023-08-01T19:54:04.459662+0000", 2023-08-01T19:54:45.769 INFO:teuthology.orchestra.run.smithi008.stdout: "age": 41.294953159000002, 2023-08-01T19:54:45.769 INFO:teuthology.orchestra.run.smithi008.stdout: "duration": 0.013345101999999999, 2023-08-01T19:54:45.769 INFO:teuthology.orchestra.run.smithi008.stdout: "type_data": { 2023-08-01T19:54:45.769 INFO:teuthology.orchestra.run.smithi008.stdout: "flag_point": "started", 2023-08-01T19:54:45.769 INFO:teuthology.orchestra.run.smithi008.stdout: "events": [ 2023-08-01T19:54:45.769 INFO:teuthology.orchestra.run.smithi008.stdout: { 2023-08-01T19:54:45.770 INFO:teuthology.orchestra.run.smithi008.stdout: "event": "initiated", 2023-08-01T19:54:45.770 INFO:teuthology.orchestra.run.smithi008.stdout: "time": "2023-08-01T19:54:04.459662+0000", 2023-08-01T19:54:45.770 INFO:teuthology.orchestra.run.smithi008.stdout: "duration": 0 2023-08-01T19:54:45.770 INFO:teuthology.orchestra.run.smithi008.stdout: }, 2023-08-01T19:54:45.770 INFO:teuthology.orchestra.run.smithi008.stdout: { 2023-08-01T19:54:45.770 INFO:teuthology.orchestra.run.smithi008.stdout: "event": "throttled", 2023-08-01T19:54:45.770 INFO:teuthology.orchestra.run.smithi008.stdout: "time": "2023-08-01T19:54:04.459662+0000", 2023-08-01T19:54:45.770 INFO:teuthology.orchestra.run.smithi008.stdout: "duration": 0 2023-08-01T19:54:45.771 INFO:teuthology.orchestra.run.smithi008.stdout: }, 2023-08-01T19:54:45.771 INFO:teuthology.orchestra.run.smithi008.stdout: { 2023-08-01T19:54:45.771 INFO:teuthology.orchestra.run.smithi008.stdout: "event": "header_read", 2023-08-01T19:54:45.771 INFO:teuthology.orchestra.run.smithi008.stdout: "time": "2023-08-01T19:54:04.459661+0000", 2023-08-01T19:54:45.771 INFO:teuthology.orchestra.run.smithi008.stdout: "duration": 4294967295.999999 2023-08-01T19:54:45.771 INFO:teuthology.orchestra.run.smithi008.stdout: }, 2023-08-01T19:54:45.771 INFO:teuthology.orchestra.run.smithi008.stdout: { 2023-08-01T19:54:45.771 INFO:teuthology.orchestra.run.smithi008.stdout: "event": "all_read", 2023-08-01T19:54:45.772 INFO:teuthology.orchestra.run.smithi008.stdout: "time": "2023-08-01T19:54:04.459668+0000", 2023-08-01T19:54:45.772 INFO:teuthology.orchestra.run.smithi008.stdout: "duration": 7.0219999999999999e-06 2023-08-01T19:54:45.772 INFO:teuthology.orchestra.run.smithi008.stdout: }, 2023-08-01T19:54:45.772 INFO:teuthology.orchestra.run.smithi008.stdout: { 2023-08-01T19:54:45.772 INFO:teuthology.orchestra.run.smithi008.stdout: "event": "dispatched", 2023-08-01T19:54:45.772 INFO:teuthology.orchestra.run.smithi008.stdout: "time": "2023-08-01T19:54:04.459681+0000", 2023-08-01T19:54:45.772 INFO:teuthology.orchestra.run.smithi008.stdout: "duration": 1.2999999999999999e-05 2023-08-01T19:54:45.772 INFO:teuthology.orchestra.run.smithi008.stdout: }, 2023-08-01T19:54:45.773 INFO:teuthology.orchestra.run.smithi008.stdout: { 2023-08-01T19:54:45.773 INFO:teuthology.orchestra.run.smithi008.stdout: "event": "queued_for_pg", 2023-08-01T19:54:45.773 INFO:teuthology.orchestra.run.smithi008.stdout: "time": "2023-08-01T19:54:04.459690+0000", 2023-08-01T19:54:45.773 INFO:teuthology.orchestra.run.smithi008.stdout: "duration": 9.2529999999999993e-06 2023-08-01T19:54:45.773 INFO:teuthology.orchestra.run.smithi008.stdout: }, 2023-08-01T19:54:45.773 INFO:teuthology.orchestra.run.smithi008.stdout: { 2023-08-01T19:54:45.773 INFO:teuthology.orchestra.run.smithi008.stdout: "event": "reached_pg", 2023-08-01T19:54:45.773 INFO:teuthology.orchestra.run.smithi008.stdout: "time": "2023-08-01T19:54:04.461862+0000", 2023-08-01T19:54:45.774 INFO:teuthology.orchestra.run.smithi008.stdout: "duration": 0.002172345 2023-08-01T19:54:45.774 INFO:teuthology.orchestra.run.smithi008.stdout: }, 2023-08-01T19:54:45.774 INFO:teuthology.orchestra.run.smithi008.stdout: { 2023-08-01T19:54:45.774 INFO:teuthology.orchestra.run.smithi008.stdout: "event": "started", 2023-08-01T19:54:45.774 INFO:teuthology.orchestra.run.smithi008.stdout: "time": "2023-08-01T19:54:04.462013+0000", 2023-08-01T19:54:45.774 INFO:teuthology.orchestra.run.smithi008.stdout: "duration": 0.00015044200000000001 2023-08-01T19:54:45.774 INFO:teuthology.orchestra.run.smithi008.stdout: }, 2023-08-01T19:54:45.774 INFO:teuthology.orchestra.run.smithi008.stdout: { 2023-08-01T19:54:45.775 INFO:teuthology.orchestra.run.smithi008.stdout: "event": "done", 2023-08-01T19:54:45.775 INFO:teuthology.orchestra.run.smithi008.stdout: "time": "2023-08-01T19:54:04.473007+0000", 2023-08-01T19:54:45.775 INFO:teuthology.orchestra.run.smithi008.stdout: "duration": 0.010994141000000001 2023-08-01T19:54:45.775 INFO:teuthology.orchestra.run.smithi008.stdout: } 2023-08-01T19:54:45.775 INFO:teuthology.orchestra.run.smithi008.stdout: ] 2023-08-01T19:54:45.775 INFO:teuthology.orchestra.run.smithi008.stdout: } 2023-08-01T19:54:45.775 INFO:teuthology.orchestra.run.smithi008.stdout: }, 2023-08-01T19:54:45.775 INFO:teuthology.orchestra.run.smithi008.stdout: { 2023-08-01T19:54:45.776 INFO:teuthology.orchestra.run.smithi008.stdout: "description": "osd_op(client.4668.0:18360 5.6 5:65d8e237:::benchmark_data_smithi006_114134_object18359:head [set-alloc-hint object_size 65536 write_size 65536,write 0~65536] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e23)", 2023-08-01T19:54:45.776 INFO:teuthology.orchestra.run.smithi008.stdout: "initiated_at": "2023-08-01T19:54:28.994296+0000", 2023-08-01T19:54:45.776 INFO:teuthology.orchestra.run.smithi008.stdout: "age": 16.760318926, 2023-08-01T19:54:45.776 INFO:teuthology.orchestra.run.smithi008.stdout: "duration": 0.017459669000000001, 2023-08-01T19:54:45.776 INFO:teuthology.orchestra.run.smithi008.stdout: "type_data": { 2023-08-01T19:54:45.776 INFO:teuthology.orchestra.run.smithi008.stdout: "flag_point": "commit sent; apply or cleanup", 2023-08-01T19:54:45.776 INFO:teuthology.orchestra.run.smithi008.stdout: "client_info": { 2023-08-01T19:54:45.777 INFO:teuthology.orchestra.run.smithi008.stdout: "client": "client.4668", 2023-08-01T19:54:45.777 INFO:teuthology.orchestra.run.smithi008.stdout: "client_addr": "172.21.15.6:0/1709472247", 2023-08-01T19:54:45.777 INFO:teuthology.orchestra.run.smithi008.stdout: "tid": 18360 2023-08-01T19:54:45.777 INFO:teuthology.orchestra.run.smithi008.stdout: }, 2023-08-01T19:54:45.777 INFO:teuthology.orchestra.run.smithi008.stdout: "events": [ 2023-08-01T19:54:45.777 INFO:teuthology.orchestra.run.smithi008.stdout: { 2023-08-01T19:54:45.777 INFO:teuthology.orchestra.run.smithi008.stdout: "event": "initiated", 2023-08-01T19:54:45.777 INFO:teuthology.orchestra.run.smithi008.stdout: "time": "2023-08-01T19:54:28.994296+0000", 2023-08-01T19:54:45.778 INFO:teuthology.orchestra.run.smithi008.stdout: "duration": 0 2023-08-01T19:54:45.778 INFO:teuthology.orchestra.run.smithi008.stdout: }, 2023-08-01T19:54:45.778 INFO:teuthology.orchestra.run.smithi008.stdout: { 2023-08-01T19:54:45.778 INFO:teuthology.orchestra.run.smithi008.stdout: "event": "throttled", 2023-08-01T19:54:45.778 INFO:teuthology.orchestra.run.smithi008.stdout: "time": "2023-08-01T19:54:28.994296+0000", 2023-08-01T19:54:45.778 INFO:teuthology.orchestra.run.smithi008.stdout: "duration": 0 2023-08-01T19:54:45.778 INFO:teuthology.orchestra.run.smithi008.stdout: }, 2023-08-01T19:54:45.778 INFO:teuthology.orchestra.run.smithi008.stdout: { 2023-08-01T19:54:45.779 INFO:teuthology.orchestra.run.smithi008.stdout: "event": "header_read", 2023-08-01T19:54:45.779 INFO:teuthology.orchestra.run.smithi008.stdout: "time": "2023-08-01T19:54:28.994295+0000", 2023-08-01T19:54:45.779 INFO:teuthology.orchestra.run.smithi008.stdout: "duration": 4294967295.9999995 2023-08-01T19:54:45.779 INFO:teuthology.orchestra.run.smithi008.stdout: }, 2023-08-01T19:54:45.779 INFO:teuthology.orchestra.run.smithi008.stdout: { 2023-08-01T19:54:45.779 INFO:teuthology.orchestra.run.smithi008.stdout: "event": "all_read", 2023-08-01T19:54:45.779 INFO:teuthology.orchestra.run.smithi008.stdout: "time": "2023-08-01T19:54:28.994381+0000", 2023-08-01T19:54:45.779 INFO:teuthology.orchestra.run.smithi008.stdout: "duration": 8.6055000000000002e-05 2023-08-01T19:54:45.780 INFO:teuthology.orchestra.run.smithi008.stdout: }, 2023-08-01T19:54:45.780 INFO:teuthology.orchestra.run.smithi008.stdout: { 2023-08-01T19:54:45.780 INFO:teuthology.orchestra.run.smithi008.stdout: "event": "dispatched", 2023-08-01T19:54:45.780 INFO:teuthology.orchestra.run.smithi008.stdout: "time": "2023-08-01T19:54:28.994390+0000", 2023-08-01T19:54:45.780 INFO:teuthology.orchestra.run.smithi008.stdout: "duration": 8.7530000000000007e-06 2023-08-01T19:54:45.780 INFO:teuthology.orchestra.run.smithi008.stdout: }, 2023-08-01T19:54:45.780 INFO:teuthology.orchestra.run.smithi008.stdout: { 2023-08-01T19:54:45.780 INFO:teuthology.orchestra.run.smithi008.stdout: "event": "queued_for_pg", 2023-08-01T19:54:45.781 INFO:teuthology.orchestra.run.smithi008.stdout: "time": "2023-08-01T19:54:28.994394+0000", 2023-08-01T19:54:45.781 INFO:teuthology.orchestra.run.smithi008.stdout: "duration": 3.4929999999999998e-06 2023-08-01T19:54:45.781 INFO:teuthology.orchestra.run.smithi008.stdout: }, 2023-08-01T19:54:45.781 INFO:teuthology.orchestra.run.smithi008.stdout: { 2023-08-01T19:54:45.781 INFO:teuthology.orchestra.run.smithi008.stdout: "event": "reached_pg", 2023-08-01T19:54:45.781 INFO:teuthology.orchestra.run.smithi008.stdout: "time": "2023-08-01T19:54:28.995799+0000", 2023-08-01T19:54:45.781 INFO:teuthology.orchestra.run.smithi008.stdout: "duration": 0.001405779 2023-08-01T19:54:45.781 INFO:teuthology.orchestra.run.smithi008.stdout: }, 2023-08-01T19:54:45.782 INFO:teuthology.orchestra.run.smithi008.stdout: { 2023-08-01T19:54:45.782 INFO:teuthology.orchestra.run.smithi008.stdout: "event": "started", 2023-08-01T19:54:45.782 INFO:teuthology.orchestra.run.smithi008.stdout: "time": "2023-08-01T19:54:28.995896+0000", 2023-08-01T19:54:45.782 INFO:teuthology.orchestra.run.smithi008.stdout: "duration": 9.6597999999999999e-05 2023-08-01T19:54:45.782 INFO:teuthology.orchestra.run.smithi008.stdout: }, 2023-08-01T19:54:45.782 INFO:teuthology.orchestra.run.smithi008.stdout: { 2023-08-01T19:54:45.782 INFO:teuthology.orchestra.run.smithi008.stdout: "event": "waiting for subops from 1", 2023-08-01T19:54:45.782 INFO:teuthology.orchestra.run.smithi008.stdout: "time": "2023-08-01T19:54:28.995985+0000", 2023-08-01T19:54:45.783 INFO:teuthology.orchestra.run.smithi008.stdout: "duration": 8.8479000000000004e-05 2023-08-01T19:54:45.783 INFO:teuthology.orchestra.run.smithi008.stdout: }, 2023-08-01T19:54:45.783 INFO:teuthology.orchestra.run.smithi008.stdout: { 2023-08-01T19:54:45.783 INFO:teuthology.orchestra.run.smithi008.stdout: "event": "op_commit", 2023-08-01T19:54:45.783 INFO:teuthology.orchestra.run.smithi008.stdout: "time": "2023-08-01T19:54:28.997700+0000", 2023-08-01T19:54:45.783 INFO:teuthology.orchestra.run.smithi008.stdout: "duration": 0.001714997 2023-08-01T19:54:45.783 INFO:teuthology.orchestra.run.smithi008.stdout: }, 2023-08-01T19:54:45.783 INFO:teuthology.orchestra.run.smithi008.stdout: { 2023-08-01T19:54:45.784 INFO:teuthology.orchestra.run.smithi008.stdout: "event": "sub_op_commit_rec", 2023-08-01T19:54:45.784 INFO:teuthology.orchestra.run.smithi008.stdout: "time": "2023-08-01T19:54:29.011671+0000", 2023-08-01T19:54:45.784 INFO:teuthology.orchestra.run.smithi008.stdout: "duration": 0.0139712 2023-08-01T19:54:45.784 INFO:teuthology.orchestra.run.smithi008.stdout: }, 2023-08-01T19:54:45.784 INFO:teuthology.orchestra.run.smithi008.stdout: { 2023-08-01T19:54:45.784 INFO:teuthology.orchestra.run.smithi008.stdout: "event": "commit_sent", 2023-08-01T19:54:45.784 INFO:teuthology.orchestra.run.smithi008.stdout: "time": "2023-08-01T19:54:29.011719+0000", 2023-08-01T19:54:45.785 INFO:teuthology.orchestra.run.smithi008.stdout: "duration": 4.8025000000000002e-05 2023-08-01T19:54:45.785 INFO:teuthology.orchestra.run.smithi008.stdout: }, 2023-08-01T19:54:45.785 INFO:teuthology.orchestra.run.smithi008.stdout: { 2023-08-01T19:54:45.785 INFO:teuthology.orchestra.run.smithi008.stdout: "event": "done", 2023-08-01T19:54:45.785 INFO:teuthology.orchestra.run.smithi008.stdout: "time": "2023-08-01T19:54:29.011756+0000", 2023-08-01T19:54:45.785 INFO:teuthology.orchestra.run.smithi008.stdout: "duration": 3.6825000000000001e-05 2023-08-01T19:54:45.785 INFO:teuthology.orchestra.run.smithi008.stdout: } 2023-08-01T19:54:45.785 INFO:teuthology.orchestra.run.smithi008.stdout: ] 2023-08-01T19:54:45.786 INFO:teuthology.orchestra.run.smithi008.stdout: } 2023-08-01T19:54:45.786 INFO:teuthology.orchestra.run.smithi008.stdout: }, 2023-08-01T19:54:45.786 INFO:teuthology.orchestra.run.smithi008.stdout: { 2023-08-01T19:54:45.786 INFO:teuthology.orchestra.run.smithi008.stdout: "description": "osd_op(client.4668.0:18361 5.6 5:65a8a093:::benchmark_data_smithi006_114134_object18360:head [set-alloc-hint object_size 65536 write_size 65536,write 0~65536] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e23)", 2023-08-01T19:54:45.786 INFO:teuthology.orchestra.run.smithi008.stdout: "initiated_at": "2023-08-01T19:54:28.994398+0000", 2023-08-01T19:54:45.786 INFO:teuthology.orchestra.run.smithi008.stdout: "age": 16.760217066999999, 2023-08-01T19:54:45.786 INFO:teuthology.orchestra.run.smithi008.stdout: "duration": 0.017435484000000001, 2023-08-01T19:54:45.786 INFO:teuthology.orchestra.run.smithi008.stdout: "type_data": { 2023-08-01T19:54:45.787 INFO:teuthology.orchestra.run.smithi008.stdout: "flag_point": "commit sent; apply or cleanup", 2023-08-01T19:54:45.787 INFO:teuthology.orchestra.run.smithi008.stdout: "client_info": { 2023-08-01T19:54:45.787 INFO:teuthology.orchestra.run.smithi008.stdout: "client": "client.4668", 2023-08-01T19:54:45.787 INFO:teuthology.orchestra.run.smithi008.stdout: "client_addr": "172.21.15.6:0/1709472247", 2023-08-01T19:54:45.787 INFO:teuthology.orchestra.run.smithi008.stdout: "tid": 18361 2023-08-01T19:54:45.787 INFO:teuthology.orchestra.run.smithi008.stdout: }, 2023-08-01T19:54:45.787 INFO:teuthology.orchestra.run.smithi008.stdout: "events": [ 2023-08-01T19:54:45.787 INFO:teuthology.orchestra.run.smithi008.stdout: { 2023-08-01T19:54:45.788 INFO:teuthology.orchestra.run.smithi008.stdout: "event": "initiated", 2023-08-01T19:54:45.788 INFO:teuthology.orchestra.run.smithi008.stdout: "time": "2023-08-01T19:54:28.994398+0000", 2023-08-01T19:54:45.788 INFO:teuthology.orchestra.run.smithi008.stdout: "duration": 0 2023-08-01T19:54:45.788 INFO:teuthology.orchestra.run.smithi008.stdout: }, 2023-08-01T19:54:45.788 INFO:teuthology.orchestra.run.smithi008.stdout: { 2023-08-01T19:54:45.788 INFO:teuthology.orchestra.run.smithi008.stdout: "event": "throttled", 2023-08-01T19:54:45.788 INFO:teuthology.orchestra.run.smithi008.stdout: "time": "2023-08-01T19:54:28.994398+0000", 2023-08-01T19:54:45.788 INFO:teuthology.orchestra.run.smithi008.stdout: "duration": 0 2023-08-01T19:54:45.789 INFO:teuthology.orchestra.run.smithi008.stdout: }, 2023-08-01T19:54:45.789 INFO:teuthology.orchestra.run.smithi008.stdout: { 2023-08-01T19:54:45.789 INFO:teuthology.orchestra.run.smithi008.stdout: "event": "header_read", 2023-08-01T19:54:45.789 INFO:teuthology.orchestra.run.smithi008.stdout: "time": "2023-08-01T19:54:28.994397+0000", 2023-08-01T19:54:45.789 INFO:teuthology.orchestra.run.smithi008.stdout: "duration": 4294967295.9999995 2023-08-01T19:54:45.789 INFO:teuthology.orchestra.run.smithi008.stdout: }, 2023-08-01T19:54:45.789 INFO:teuthology.orchestra.run.smithi008.stdout: { 2023-08-01T19:54:45.789 INFO:teuthology.orchestra.run.smithi008.stdout: "event": "all_read", 2023-08-01T19:54:45.790 INFO:teuthology.orchestra.run.smithi008.stdout: "time": "2023-08-01T19:54:28.994475+0000", 2023-08-01T19:54:45.790 INFO:teuthology.orchestra.run.smithi008.stdout: "duration": 7.7408000000000002e-05 2023-08-01T19:54:45.790 INFO:teuthology.orchestra.run.smithi008.stdout: }, 2023-08-01T19:54:45.790 INFO:teuthology.orchestra.run.smithi008.stdout: { 2023-08-01T19:54:45.790 INFO:teuthology.orchestra.run.smithi008.stdout: "event": "dispatched", 2023-08-01T19:54:45.790 INFO:teuthology.orchestra.run.smithi008.stdout: "time": "2023-08-01T19:54:28.994480+0000", 2023-08-01T19:54:45.790 INFO:teuthology.orchestra.run.smithi008.stdout: "duration": 5.3589999999999999e-06 2023-08-01T19:54:45.790 INFO:teuthology.orchestra.run.smithi008.stdout: }, 2023-08-01T19:54:45.791 INFO:teuthology.orchestra.run.smithi008.stdout: { 2023-08-01T19:54:45.791 INFO:teuthology.orchestra.run.smithi008.stdout: "event": "queued_for_pg", 2023-08-01T19:54:45.791 INFO:teuthology.orchestra.run.smithi008.stdout: "time": "2023-08-01T19:54:28.994484+0000", 2023-08-01T19:54:45.791 INFO:teuthology.orchestra.run.smithi008.stdout: "duration": 3.9750000000000001e-06 2023-08-01T19:54:45.791 INFO:teuthology.orchestra.run.smithi008.stdout: }, 2023-08-01T19:54:45.791 INFO:teuthology.orchestra.run.smithi008.stdout: { 2023-08-01T19:54:45.791 INFO:teuthology.orchestra.run.smithi008.stdout: "event": "reached_pg", 2023-08-01T19:54:45.791 INFO:teuthology.orchestra.run.smithi008.stdout: "time": "2023-08-01T19:54:28.996504+0000", 2023-08-01T19:54:45.792 INFO:teuthology.orchestra.run.smithi008.stdout: "duration": 0.0020198550000000001 2023-08-01T19:54:45.792 INFO:teuthology.orchestra.run.smithi008.stdout: }, 2023-08-01T19:54:45.792 INFO:teuthology.orchestra.run.smithi008.stdout: { 2023-08-01T19:54:45.792 INFO:teuthology.orchestra.run.smithi008.stdout: "event": "started", 2023-08-01T19:54:45.792 INFO:teuthology.orchestra.run.smithi008.stdout: "time": "2023-08-01T19:54:28.996624+0000", 2023-08-01T19:54:45.792 INFO:teuthology.orchestra.run.smithi008.stdout: "duration": 0.000120118 2023-08-01T19:54:45.792 INFO:teuthology.orchestra.run.smithi008.stdout: }, 2023-08-01T19:54:45.793 INFO:teuthology.orchestra.run.smithi008.stdout: { 2023-08-01T19:54:45.793 INFO:teuthology.orchestra.run.smithi008.stdout: "event": "waiting for subops from 1", 2023-08-01T19:54:45.793 INFO:teuthology.orchestra.run.smithi008.stdout: "time": "2023-08-01T19:54:28.996790+0000", 2023-08-01T19:54:45.793 INFO:teuthology.orchestra.run.smithi008.stdout: "duration": 0.000165398 2023-08-01T19:54:45.793 INFO:teuthology.orchestra.run.smithi008.stdout: }, 2023-08-01T19:54:45.793 INFO:teuthology.orchestra.run.smithi008.stdout: { 2023-08-01T19:54:45.793 INFO:teuthology.orchestra.run.smithi008.stdout: "event": "op_commit", 2023-08-01T19:54:45.793 INFO:teuthology.orchestra.run.smithi008.stdout: "time": "2023-08-01T19:54:28.999061+0000", 2023-08-01T19:54:45.794 INFO:teuthology.orchestra.run.smithi008.stdout: "duration": 0.0022714800000000002 2023-08-01T19:54:45.794 INFO:teuthology.orchestra.run.smithi008.stdout: }, 2023-08-01T19:54:45.794 INFO:teuthology.orchestra.run.smithi008.stdout: { 2023-08-01T19:54:45.794 INFO:teuthology.orchestra.run.smithi008.stdout: "event": "sub_op_commit_rec", 2023-08-01T19:54:45.794 INFO:teuthology.orchestra.run.smithi008.stdout: "time": "2023-08-01T19:54:29.011788+0000", 2023-08-01T19:54:45.794 INFO:teuthology.orchestra.run.smithi008.stdout: "duration": 0.012726774999999999 2023-08-01T19:54:45.794 INFO:teuthology.orchestra.run.smithi008.stdout: }, 2023-08-01T19:54:45.795 INFO:teuthology.orchestra.run.smithi008.stdout: { 2023-08-01T19:54:45.795 INFO:teuthology.orchestra.run.smithi008.stdout: "event": "commit_sent", 2023-08-01T19:54:45.795 INFO:teuthology.orchestra.run.smithi008.stdout: "time": "2023-08-01T19:54:29.011815+0000", 2023-08-01T19:54:45.795 INFO:teuthology.orchestra.run.smithi008.stdout: "duration": 2.7032000000000001e-05 2023-08-01T19:54:45.795 INFO:teuthology.orchestra.run.smithi008.stdout: }, 2023-08-01T19:54:45.795 INFO:teuthology.orchestra.run.smithi008.stdout: { 2023-08-01T19:54:45.795 INFO:teuthology.orchestra.run.smithi008.stdout: "event": "done", 2023-08-01T19:54:45.795 INFO:teuthology.orchestra.run.smithi008.stdout: "time": "2023-08-01T19:54:29.011833+0000", 2023-08-01T19:54:45.796 INFO:teuthology.orchestra.run.smithi008.stdout: "duration": 1.8437e-05 2023-08-01T19:54:45.796 INFO:teuthology.orchestra.run.smithi008.stdout: } 2023-08-01T19:54:45.796 INFO:teuthology.orchestra.run.smithi008.stdout: ] 2023-08-01T19:54:45.796 INFO:teuthology.orchestra.run.smithi008.stdout: } 2023-08-01T19:54:45.796 INFO:teuthology.orchestra.run.smithi008.stdout: }, 2023-08-01T19:54:45.796 INFO:teuthology.orchestra.run.smithi008.stdout: { 2023-08-01T19:54:45.796 INFO:teuthology.orchestra.run.smithi008.stdout: "description": "osd_op(client.4668.0:18363 5.5 5:ab48299e:::benchmark_data_smithi006_114134_object18362:head [set-alloc-hint object_size 65536 write_size 65536,write 0~65536] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e23)", 2023-08-01T19:54:45.797 INFO:teuthology.orchestra.run.smithi008.stdout: "initiated_at": "2023-08-01T19:54:28.996467+0000", 2023-08-01T19:54:45.797 INFO:teuthology.orchestra.run.smithi008.stdout: "age": 16.758147626, 2023-08-01T19:54:45.797 INFO:teuthology.orchestra.run.smithi008.stdout: "duration": 0.015287689, 2023-08-01T19:54:45.797 INFO:teuthology.orchestra.run.smithi008.stdout: "type_data": { 2023-08-01T19:54:45.797 INFO:teuthology.orchestra.run.smithi008.stdout: "flag_point": "commit sent; apply or cleanup", 2023-08-01T19:54:45.797 INFO:teuthology.orchestra.run.smithi008.stdout: "client_info": { 2023-08-01T19:54:45.797 INFO:teuthology.orchestra.run.smithi008.stdout: "client": "client.4668", 2023-08-01T19:54:45.797 INFO:teuthology.orchestra.run.smithi008.stdout: "client_addr": "172.21.15.6:0/1709472247", 2023-08-01T19:54:45.798 INFO:teuthology.orchestra.run.smithi008.stdout: "tid": 18363 2023-08-01T19:54:45.798 INFO:teuthology.orchestra.run.smithi008.stdout: }, 2023-08-01T19:54:45.798 INFO:teuthology.orchestra.run.smithi008.stdout: "events": [ 2023-08-01T19:54:45.798 INFO:teuthology.orchestra.run.smithi008.stdout: { 2023-08-01T19:54:45.798 INFO:teuthology.orchestra.run.smithi008.stdout: "event": "initiated", 2023-08-01T19:54:45.798 INFO:teuthology.orchestra.run.smithi008.stdout: "time": "2023-08-01T19:54:28.996467+0000", 2023-08-01T19:54:45.798 INFO:teuthology.orchestra.run.smithi008.stdout: "duration": 0 2023-08-01T19:54:45.798 INFO:teuthology.orchestra.run.smithi008.stdout: }, 2023-08-01T19:54:45.799 INFO:teuthology.orchestra.run.smithi008.stdout: { 2023-08-01T19:54:45.799 INFO:teuthology.orchestra.run.smithi008.stdout: "event": "throttled", 2023-08-01T19:54:45.799 INFO:teuthology.orchestra.run.smithi008.stdout: "time": "2023-08-01T19:54:28.996467+0000", 2023-08-01T19:54:45.799 INFO:teuthology.orchestra.run.smithi008.stdout: "duration": 0 2023-08-01T19:54:45.799 INFO:teuthology.orchestra.run.smithi008.stdout: }, 2023-08-01T19:54:45.799 INFO:teuthology.orchestra.run.smithi008.stdout: { 2023-08-01T19:54:45.799 INFO:teuthology.orchestra.run.smithi008.stdout: "event": "header_read", 2023-08-01T19:54:45.799 INFO:teuthology.orchestra.run.smithi008.stdout: "time": "2023-08-01T19:54:28.996466+0000", 2023-08-01T19:54:45.800 INFO:teuthology.orchestra.run.smithi008.stdout: "duration": 4294967295.999999 2023-08-01T19:54:45.800 INFO:teuthology.orchestra.run.smithi008.stdout: }, 2023-08-01T19:54:45.800 INFO:teuthology.orchestra.run.smithi008.stdout: { 2023-08-01T19:54:45.800 INFO:teuthology.orchestra.run.smithi008.stdout: "event": "all_read", 2023-08-01T19:54:45.800 INFO:teuthology.orchestra.run.smithi008.stdout: "time": "2023-08-01T19:54:28.996519+0000", 2023-08-01T19:54:45.800 INFO:teuthology.orchestra.run.smithi008.stdout: "duration": 5.3075000000000003e-05 2023-08-01T19:54:45.800 INFO:teuthology.orchestra.run.smithi008.stdout: }, 2023-08-01T19:54:45.800 INFO:teuthology.orchestra.run.smithi008.stdout: { 2023-08-01T19:54:45.801 INFO:teuthology.orchestra.run.smithi008.stdout: "event": "dispatched", 2023-08-01T19:54:45.801 INFO:teuthology.orchestra.run.smithi008.stdout: "time": "2023-08-01T19:54:28.996529+0000", 2023-08-01T19:54:45.801 INFO:teuthology.orchestra.run.smithi008.stdout: "duration": 9.2499999999999995e-06 2023-08-01T19:54:45.801 INFO:teuthology.orchestra.run.smithi008.stdout: }, 2023-08-01T19:54:45.801 INFO:teuthology.orchestra.run.smithi008.stdout: { 2023-08-01T19:54:45.801 INFO:teuthology.orchestra.run.smithi008.stdout: "event": "queued_for_pg", 2023-08-01T19:54:45.801 INFO:teuthology.orchestra.run.smithi008.stdout: "time": "2023-08-01T19:54:28.996537+0000", 2023-08-01T19:54:45.802 INFO:teuthology.orchestra.run.smithi008.stdout: "duration": 8.4239999999999993e-06 2023-08-01T19:54:45.802 INFO:teuthology.orchestra.run.smithi008.stdout: }, 2023-08-01T19:54:45.802 INFO:teuthology.orchestra.run.smithi008.stdout: { 2023-08-01T19:54:45.802 INFO:teuthology.orchestra.run.smithi008.stdout: "event": "reached_pg", 2023-08-01T19:54:45.802 INFO:teuthology.orchestra.run.smithi008.stdout: "time": "2023-08-01T19:54:28.996590+0000", 2023-08-01T19:54:45.802 INFO:teuthology.orchestra.run.smithi008.stdout: "duration": 5.3047999999999998e-05 2023-08-01T19:54:45.802 INFO:teuthology.orchestra.run.smithi008.stdout: }, 2023-08-01T19:54:45.802 INFO:teuthology.orchestra.run.smithi008.stdout: { 2023-08-01T19:54:45.803 INFO:teuthology.orchestra.run.smithi008.stdout: "event": "started", 2023-08-01T19:54:45.803 INFO:teuthology.orchestra.run.smithi008.stdout: "time": "2023-08-01T19:54:28.996707+0000", 2023-08-01T19:54:45.803 INFO:teuthology.orchestra.run.smithi008.stdout: "duration": 0.000117005 2023-08-01T19:54:45.803 INFO:teuthology.orchestra.run.smithi008.stdout: }, 2023-08-01T19:54:45.803 INFO:teuthology.orchestra.run.smithi008.stdout: { 2023-08-01T19:54:45.803 INFO:teuthology.orchestra.run.smithi008.stdout: "event": "waiting for subops from 1", 2023-08-01T19:54:45.803 INFO:teuthology.orchestra.run.smithi008.stdout: "time": "2023-08-01T19:54:28.996807+0000", 2023-08-01T19:54:45.803 INFO:teuthology.orchestra.run.smithi008.stdout: "duration": 0.0001003 2023-08-01T19:54:45.804 INFO:teuthology.orchestra.run.smithi008.stdout: }, 2023-08-01T19:54:45.804 INFO:teuthology.orchestra.run.smithi008.stdout: { 2023-08-01T19:54:45.804 INFO:teuthology.orchestra.run.smithi008.stdout: "event": "op_commit", 2023-08-01T19:54:45.804 INFO:teuthology.orchestra.run.smithi008.stdout: "time": "2023-08-01T19:54:28.998511+0000", 2023-08-01T19:54:45.804 INFO:teuthology.orchestra.run.smithi008.stdout: "duration": 0.00170397 2023-08-01T19:54:45.804 INFO:teuthology.orchestra.run.smithi008.stdout: }, 2023-08-01T19:54:45.804 INFO:teuthology.orchestra.run.smithi008.stdout: { 2023-08-01T19:54:45.804 INFO:teuthology.orchestra.run.smithi008.stdout: "event": "sub_op_commit_rec", 2023-08-01T19:54:45.805 INFO:teuthology.orchestra.run.smithi008.stdout: "time": "2023-08-01T19:54:29.011698+0000", 2023-08-01T19:54:45.805 INFO:teuthology.orchestra.run.smithi008.stdout: "duration": 0.013186959 2023-08-01T19:54:45.805 INFO:teuthology.orchestra.run.smithi008.stdout: }, 2023-08-01T19:54:45.805 INFO:teuthology.orchestra.run.smithi008.stdout: { 2023-08-01T19:54:45.805 INFO:teuthology.orchestra.run.smithi008.stdout: "event": "commit_sent", 2023-08-01T19:54:45.805 INFO:teuthology.orchestra.run.smithi008.stdout: "time": "2023-08-01T19:54:29.011729+0000", 2023-08-01T19:54:45.805 INFO:teuthology.orchestra.run.smithi008.stdout: "duration": 3.044e-05 2023-08-01T19:54:45.805 INFO:teuthology.orchestra.run.smithi008.stdout: }, 2023-08-01T19:54:45.806 INFO:teuthology.orchestra.run.smithi008.stdout: { 2023-08-01T19:54:45.806 INFO:teuthology.orchestra.run.smithi008.stdout: "event": "done", 2023-08-01T19:54:45.806 INFO:teuthology.orchestra.run.smithi008.stdout: "time": "2023-08-01T19:54:29.011755+0000", 2023-08-01T19:54:45.806 INFO:teuthology.orchestra.run.smithi008.stdout: "duration": 2.6165000000000001e-05 2023-08-01T19:54:45.806 INFO:teuthology.orchestra.run.smithi008.stdout: } 2023-08-01T19:54:45.806 INFO:teuthology.orchestra.run.smithi008.stdout: ] 2023-08-01T19:54:45.806 INFO:teuthology.orchestra.run.smithi008.stdout: } 2023-08-01T19:54:45.806 INFO:teuthology.orchestra.run.smithi008.stdout: }, 2023-08-01T19:54:45.807 INFO:teuthology.orchestra.run.smithi008.stdout: { 2023-08-01T19:54:45.807 INFO:teuthology.orchestra.run.smithi008.stdout: "description": "osd_op(client.4668.0:18368 5.5 5:ac90765d:::benchmark_data_smithi006_114134_object18367:head [set-alloc-hint object_size 65536 write_size 65536,write 0~65536] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e23)", 2023-08-01T19:54:45.807 INFO:teuthology.orchestra.run.smithi008.stdout: "initiated_at": "2023-08-01T19:54:28.996987+0000", 2023-08-01T19:54:45.807 INFO:teuthology.orchestra.run.smithi008.stdout: "age": 16.757627779, 2023-08-01T19:54:45.807 INFO:teuthology.orchestra.run.smithi008.stdout: "duration": 0.014851731999999999, 2023-08-01T19:54:45.807 INFO:teuthology.orchestra.run.smithi008.stdout: "type_data": { 2023-08-01T19:54:45.807 INFO:teuthology.orchestra.run.smithi008.stdout: "flag_point": "commit sent; apply or cleanup", 2023-08-01T19:54:45.808 INFO:teuthology.orchestra.run.smithi008.stdout: "client_info": { 2023-08-01T19:54:45.808 INFO:teuthology.orchestra.run.smithi008.stdout: "client": "client.4668", 2023-08-01T19:54:45.808 INFO:teuthology.orchestra.run.smithi008.stdout: "client_addr": "172.21.15.6:0/1709472247", 2023-08-01T19:54:45.808 INFO:teuthology.orchestra.run.smithi008.stdout: "tid": 18368 2023-08-01T19:54:45.808 INFO:teuthology.orchestra.run.smithi008.stdout: }, 2023-08-01T19:54:45.808 INFO:teuthology.orchestra.run.smithi008.stdout: "events": [ 2023-08-01T19:54:45.808 INFO:teuthology.orchestra.run.smithi008.stdout: { 2023-08-01T19:54:45.808 INFO:teuthology.orchestra.run.smithi008.stdout: "event": "initiated", 2023-08-01T19:54:45.809 INFO:teuthology.orchestra.run.smithi008.stdout: "time": "2023-08-01T19:54:28.996987+0000", 2023-08-01T19:54:45.809 INFO:teuthology.orchestra.run.smithi008.stdout: "duration": 0 2023-08-01T19:54:45.809 INFO:teuthology.orchestra.run.smithi008.stdout: }, 2023-08-01T19:54:45.809 INFO:teuthology.orchestra.run.smithi008.stdout: { 2023-08-01T19:54:45.809 INFO:teuthology.orchestra.run.smithi008.stdout: "event": "throttled", 2023-08-01T19:54:45.809 INFO:teuthology.orchestra.run.smithi008.stdout: "time": "2023-08-01T19:54:28.996987+0000", 2023-08-01T19:54:45.809 INFO:teuthology.orchestra.run.smithi008.stdout: "duration": 0 2023-08-01T19:54:45.809 INFO:teuthology.orchestra.run.smithi008.stdout: }, 2023-08-01T19:54:45.810 INFO:teuthology.orchestra.run.smithi008.stdout: { 2023-08-01T19:54:45.810 INFO:teuthology.orchestra.run.smithi008.stdout: "event": "header_read", 2023-08-01T19:54:45.810 INFO:teuthology.orchestra.run.smithi008.stdout: "time": "2023-08-01T19:54:28.996986+0000", 2023-08-01T19:54:45.810 INFO:teuthology.orchestra.run.smithi008.stdout: "duration": 4294967295.999999 2023-08-01T19:54:45.810 INFO:teuthology.orchestra.run.smithi008.stdout: }, 2023-08-01T19:54:45.810 INFO:teuthology.orchestra.run.smithi008.stdout: { 2023-08-01T19:54:45.810 INFO:teuthology.orchestra.run.smithi008.stdout: "event": "all_read", 2023-08-01T19:54:45.810 INFO:teuthology.orchestra.run.smithi008.stdout: "time": "2023-08-01T19:54:28.997061+0000", 2023-08-01T19:54:45.811 INFO:teuthology.orchestra.run.smithi008.stdout: "duration": 7.4849000000000001e-05 2023-08-01T19:54:45.811 INFO:teuthology.orchestra.run.smithi008.stdout: }, 2023-08-01T19:54:45.811 INFO:teuthology.orchestra.run.smithi008.stdout: { 2023-08-01T19:54:45.811 INFO:teuthology.orchestra.run.smithi008.stdout: "event": "dispatched", 2023-08-01T19:54:45.811 INFO:teuthology.orchestra.run.smithi008.stdout: "time": "2023-08-01T19:54:28.997070+0000", 2023-08-01T19:54:45.811 INFO:teuthology.orchestra.run.smithi008.stdout: "duration": 8.7499999999999992e-06 2023-08-01T19:54:45.811 INFO:teuthology.orchestra.run.smithi008.stdout: }, 2023-08-01T19:54:45.811 INFO:teuthology.orchestra.run.smithi008.stdout: { 2023-08-01T19:54:45.812 INFO:teuthology.orchestra.run.smithi008.stdout: "event": "queued_for_pg", 2023-08-01T19:54:45.812 INFO:teuthology.orchestra.run.smithi008.stdout: "time": "2023-08-01T19:54:28.997076+0000", 2023-08-01T19:54:45.812 INFO:teuthology.orchestra.run.smithi008.stdout: "duration": 6.0510000000000002e-06 2023-08-01T19:54:45.812 INFO:teuthology.orchestra.run.smithi008.stdout: }, 2023-08-01T19:54:45.812 INFO:teuthology.orchestra.run.smithi008.stdout: { 2023-08-01T19:54:45.812 INFO:teuthology.orchestra.run.smithi008.stdout: "event": "reached_pg", 2023-08-01T19:54:45.812 INFO:teuthology.orchestra.run.smithi008.stdout: "time": "2023-08-01T19:54:28.997512+0000", 2023-08-01T19:54:45.813 INFO:teuthology.orchestra.run.smithi008.stdout: "duration": 0.00043637299999999999 2023-08-01T19:54:45.813 INFO:teuthology.orchestra.run.smithi008.stdout: }, 2023-08-01T19:54:45.813 INFO:teuthology.orchestra.run.smithi008.stdout: { 2023-08-01T19:54:45.813 INFO:teuthology.orchestra.run.smithi008.stdout: "event": "started", 2023-08-01T19:54:45.813 INFO:teuthology.orchestra.run.smithi008.stdout: "time": "2023-08-01T19:54:28.997634+0000", 2023-08-01T19:54:45.813 INFO:teuthology.orchestra.run.smithi008.stdout: "duration": 0.00012162100000000001 2023-08-01T19:54:45.813 INFO:teuthology.orchestra.run.smithi008.stdout: }, 2023-08-01T19:54:45.813 INFO:teuthology.orchestra.run.smithi008.stdout: { 2023-08-01T19:54:45.814 INFO:teuthology.orchestra.run.smithi008.stdout: "event": "waiting for subops from 1", 2023-08-01T19:54:45.814 INFO:teuthology.orchestra.run.smithi008.stdout: "time": "2023-08-01T19:54:28.997792+0000", 2023-08-01T19:54:45.814 INFO:teuthology.orchestra.run.smithi008.stdout: "duration": 0.00015851600000000001 2023-08-01T19:54:45.814 INFO:teuthology.orchestra.run.smithi008.stdout: }, 2023-08-01T19:54:45.814 INFO:teuthology.orchestra.run.smithi008.stdout: { 2023-08-01T19:54:45.814 INFO:teuthology.orchestra.run.smithi008.stdout: "event": "op_commit", 2023-08-01T19:54:45.814 INFO:teuthology.orchestra.run.smithi008.stdout: "time": "2023-08-01T19:54:28.999634+0000", 2023-08-01T19:54:45.815 INFO:teuthology.orchestra.run.smithi008.stdout: "duration": 0.001841046 2023-08-01T19:54:45.815 INFO:teuthology.orchestra.run.smithi008.stdout: }, 2023-08-01T19:54:45.815 INFO:teuthology.orchestra.run.smithi008.stdout: { 2023-08-01T19:54:45.815 INFO:teuthology.orchestra.run.smithi008.stdout: "event": "sub_op_commit_rec", 2023-08-01T19:54:45.815 INFO:teuthology.orchestra.run.smithi008.stdout: "time": "2023-08-01T19:54:29.011789+0000", 2023-08-01T19:54:45.815 INFO:teuthology.orchestra.run.smithi008.stdout: "duration": 0.012155011 2023-08-01T19:54:45.815 INFO:teuthology.orchestra.run.smithi008.stdout: }, 2023-08-01T19:54:45.815 INFO:teuthology.orchestra.run.smithi008.stdout: { 2023-08-01T19:54:45.816 INFO:teuthology.orchestra.run.smithi008.stdout: "event": "commit_sent", 2023-08-01T19:54:45.816 INFO:teuthology.orchestra.run.smithi008.stdout: "time": "2023-08-01T19:54:29.011818+0000", 2023-08-01T19:54:45.816 INFO:teuthology.orchestra.run.smithi008.stdout: "duration": 2.9152000000000001e-05 2023-08-01T19:54:45.816 INFO:teuthology.orchestra.run.smithi008.stdout: }, 2023-08-01T19:54:45.816 INFO:teuthology.orchestra.run.smithi008.stdout: { 2023-08-01T19:54:45.816 INFO:teuthology.orchestra.run.smithi008.stdout: "event": "done", 2023-08-01T19:54:45.816 INFO:teuthology.orchestra.run.smithi008.stdout: "time": "2023-08-01T19:54:29.011839+0000", 2023-08-01T19:54:45.817 INFO:teuthology.orchestra.run.smithi008.stdout: "duration": 2.1132999999999999e-05 2023-08-01T19:54:45.817 INFO:teuthology.orchestra.run.smithi008.stdout: } 2023-08-01T19:54:45.817 INFO:teuthology.orchestra.run.smithi008.stdout: ] 2023-08-01T19:54:45.817 INFO:teuthology.orchestra.run.smithi008.stdout: } 2023-08-01T19:54:45.817 INFO:teuthology.orchestra.run.smithi008.stdout: }, 2023-08-01T19:54:45.817 INFO:teuthology.orchestra.run.smithi008.stdout: { 2023-08-01T19:54:45.817 INFO:teuthology.orchestra.run.smithi008.stdout: "description": "osd_op(client.4668.0:18369 5.3 5:c557c7d0:::benchmark_data_smithi006_114134_object18368:head [set-alloc-hint object_size 65536 write_size 65536,write 0~65536] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e23)", 2023-08-01T19:54:45.817 INFO:teuthology.orchestra.run.smithi008.stdout: "initiated_at": "2023-08-01T19:54:28.997782+0000", 2023-08-01T19:54:45.818 INFO:teuthology.orchestra.run.smithi008.stdout: "age": 16.756832804999998, 2023-08-01T19:54:45.818 INFO:teuthology.orchestra.run.smithi008.stdout: "duration": 0.013982608000000001, 2023-08-01T19:54:45.818 INFO:teuthology.orchestra.run.smithi008.stdout: "type_data": { 2023-08-01T19:54:45.818 INFO:teuthology.orchestra.run.smithi008.stdout: "flag_point": "commit sent; apply or cleanup", 2023-08-01T19:54:45.818 INFO:teuthology.orchestra.run.smithi008.stdout: "client_info": { 2023-08-01T19:54:45.818 INFO:teuthology.orchestra.run.smithi008.stdout: "client": "client.4668", 2023-08-01T19:54:45.818 INFO:teuthology.orchestra.run.smithi008.stdout: "client_addr": "172.21.15.6:0/1709472247", 2023-08-01T19:54:45.818 INFO:teuthology.orchestra.run.smithi008.stdout: "tid": 18369 2023-08-01T19:54:45.819 INFO:teuthology.orchestra.run.smithi008.stdout: }, 2023-08-01T19:54:45.819 INFO:teuthology.orchestra.run.smithi008.stdout: "events": [ 2023-08-01T19:54:45.819 INFO:teuthology.orchestra.run.smithi008.stdout: { 2023-08-01T19:54:45.819 INFO:teuthology.orchestra.run.smithi008.stdout: "event": "initiated", 2023-08-01T19:54:45.819 INFO:teuthology.orchestra.run.smithi008.stdout: "time": "2023-08-01T19:54:28.997782+0000", 2023-08-01T19:54:45.819 INFO:teuthology.orchestra.run.smithi008.stdout: "duration": 0 2023-08-01T19:54:45.819 INFO:teuthology.orchestra.run.smithi008.stdout: }, 2023-08-01T19:54:45.819 INFO:teuthology.orchestra.run.smithi008.stdout: { 2023-08-01T19:54:45.820 INFO:teuthology.orchestra.run.smithi008.stdout: "event": "throttled", 2023-08-01T19:54:45.820 INFO:teuthology.orchestra.run.smithi008.stdout: "time": "2023-08-01T19:54:28.997782+0000", 2023-08-01T19:54:45.820 INFO:teuthology.orchestra.run.smithi008.stdout: "duration": 0 2023-08-01T19:54:45.820 INFO:teuthology.orchestra.run.smithi008.stdout: }, 2023-08-01T19:54:45.820 INFO:teuthology.orchestra.run.smithi008.stdout: { 2023-08-01T19:54:45.820 INFO:teuthology.orchestra.run.smithi008.stdout: "event": "header_read", 2023-08-01T19:54:45.820 INFO:teuthology.orchestra.run.smithi008.stdout: "time": "2023-08-01T19:54:28.997781+0000", 2023-08-01T19:54:45.820 INFO:teuthology.orchestra.run.smithi008.stdout: "duration": 4294967295.9999995 2023-08-01T19:54:45.821 INFO:teuthology.orchestra.run.smithi008.stdout: }, 2023-08-01T19:54:45.821 INFO:teuthology.orchestra.run.smithi008.stdout: { 2023-08-01T19:54:45.821 INFO:teuthology.orchestra.run.smithi008.stdout: "event": "all_read", 2023-08-01T19:54:45.821 INFO:teuthology.orchestra.run.smithi008.stdout: "time": "2023-08-01T19:54:28.997859+0000", 2023-08-01T19:54:45.821 INFO:teuthology.orchestra.run.smithi008.stdout: "duration": 7.7420000000000001e-05 2023-08-01T19:54:45.821 INFO:teuthology.orchestra.run.smithi008.stdout: }, 2023-08-01T19:54:45.821 INFO:teuthology.orchestra.run.smithi008.stdout: { 2023-08-01T19:54:45.821 INFO:teuthology.orchestra.run.smithi008.stdout: "event": "dispatched", 2023-08-01T19:54:45.822 INFO:teuthology.orchestra.run.smithi008.stdout: "time": "2023-08-01T19:54:28.997866+0000", 2023-08-01T19:54:45.822 INFO:teuthology.orchestra.run.smithi008.stdout: "duration": 7.2910000000000002e-06 2023-08-01T19:54:45.822 INFO:teuthology.orchestra.run.smithi008.stdout: }, 2023-08-01T19:54:45.822 INFO:teuthology.orchestra.run.smithi008.stdout: { 2023-08-01T19:54:45.822 INFO:teuthology.orchestra.run.smithi008.stdout: "event": "queued_for_pg", 2023-08-01T19:54:45.822 INFO:teuthology.orchestra.run.smithi008.stdout: "time": "2023-08-01T19:54:28.997872+0000", 2023-08-01T19:54:45.822 INFO:teuthology.orchestra.run.smithi008.stdout: "duration": 6.0460000000000002e-06 2023-08-01T19:54:45.823 INFO:teuthology.orchestra.run.smithi008.stdout: }, 2023-08-01T19:54:45.823 INFO:teuthology.orchestra.run.smithi008.stdout: { 2023-08-01T19:54:45.823 INFO:teuthology.orchestra.run.smithi008.stdout: "event": "reached_pg", 2023-08-01T19:54:45.823 INFO:teuthology.orchestra.run.smithi008.stdout: "time": "2023-08-01T19:54:28.997931+0000", 2023-08-01T19:54:45.823 INFO:teuthology.orchestra.run.smithi008.stdout: "duration": 5.8692e-05 2023-08-01T19:54:45.823 INFO:teuthology.orchestra.run.smithi008.stdout: }, 2023-08-01T19:54:45.823 INFO:teuthology.orchestra.run.smithi008.stdout: { 2023-08-01T19:54:45.823 INFO:teuthology.orchestra.run.smithi008.stdout: "event": "started", 2023-08-01T19:54:45.824 INFO:teuthology.orchestra.run.smithi008.stdout: "time": "2023-08-01T19:54:28.998082+0000", 2023-08-01T19:54:45.824 INFO:teuthology.orchestra.run.smithi008.stdout: "duration": 0.000151438 2023-08-01T19:54:45.824 INFO:teuthology.orchestra.run.smithi008.stdout: }, 2023-08-01T19:54:45.824 INFO:teuthology.orchestra.run.smithi008.stdout: { 2023-08-01T19:54:45.824 INFO:teuthology.orchestra.run.smithi008.stdout: "event": "waiting for subops from 1", 2023-08-01T19:54:45.824 INFO:teuthology.orchestra.run.smithi008.stdout: "time": "2023-08-01T19:54:28.998216+0000", 2023-08-01T19:54:45.824 INFO:teuthology.orchestra.run.smithi008.stdout: "duration": 0.00013328099999999999 2023-08-01T19:54:45.824 INFO:teuthology.orchestra.run.smithi008.stdout: }, 2023-08-01T19:54:45.825 INFO:teuthology.orchestra.run.smithi008.stdout: { 2023-08-01T19:54:45.825 INFO:teuthology.orchestra.run.smithi008.stdout: "event": "op_commit", 2023-08-01T19:54:45.825 INFO:teuthology.orchestra.run.smithi008.stdout: "time": "2023-08-01T19:54:29.000045+0000", 2023-08-01T19:54:45.825 INFO:teuthology.orchestra.run.smithi008.stdout: "duration": 0.001829231 2023-08-01T19:54:45.825 INFO:teuthology.orchestra.run.smithi008.stdout: }, 2023-08-01T19:54:45.825 INFO:teuthology.orchestra.run.smithi008.stdout: { 2023-08-01T19:54:45.825 INFO:teuthology.orchestra.run.smithi008.stdout: "event": "sub_op_commit_rec", 2023-08-01T19:54:45.825 INFO:teuthology.orchestra.run.smithi008.stdout: "time": "2023-08-01T19:54:29.011719+0000", 2023-08-01T19:54:45.826 INFO:teuthology.orchestra.run.smithi008.stdout: "duration": 0.011673817 2023-08-01T19:54:45.826 INFO:teuthology.orchestra.run.smithi008.stdout: }, 2023-08-01T19:54:45.826 INFO:teuthology.orchestra.run.smithi008.stdout: { 2023-08-01T19:54:45.826 INFO:teuthology.orchestra.run.smithi008.stdout: "event": "commit_sent", 2023-08-01T19:54:45.826 INFO:teuthology.orchestra.run.smithi008.stdout: "time": "2023-08-01T19:54:29.011743+0000", 2023-08-01T19:54:45.826 INFO:teuthology.orchestra.run.smithi008.stdout: "duration": 2.4663000000000001e-05 2023-08-01T19:54:45.826 INFO:teuthology.orchestra.run.smithi008.stdout: }, 2023-08-01T19:54:45.826 INFO:teuthology.orchestra.run.smithi008.stdout: { 2023-08-01T19:54:45.827 INFO:teuthology.orchestra.run.smithi008.stdout: "event": "done", 2023-08-01T19:54:45.827 INFO:teuthology.orchestra.run.smithi008.stdout: "time": "2023-08-01T19:54:29.011765+0000", 2023-08-01T19:54:45.827 INFO:teuthology.orchestra.run.smithi008.stdout: "duration": 2.1410999999999999e-05 2023-08-01T19:54:45.827 INFO:teuthology.orchestra.run.smithi008.stdout: } 2023-08-01T19:54:45.827 INFO:teuthology.orchestra.run.smithi008.stdout: ] 2023-08-01T19:54:45.827 INFO:teuthology.orchestra.run.smithi008.stdout: } 2023-08-01T19:54:45.827 INFO:teuthology.orchestra.run.smithi008.stdout: }, 2023-08-01T19:54:45.827 INFO:teuthology.orchestra.run.smithi008.stdout: { 2023-08-01T19:54:45.828 INFO:teuthology.orchestra.run.smithi008.stdout: "description": "osd_op(client.4668.0:20544 5.a 5:52fb262b:::benchmark_data_smithi006_114134_object20543:head [set-alloc-hint object_size 65536 write_size 65536,write 0~65536] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e23)", 2023-08-01T19:54:45.828 INFO:teuthology.orchestra.run.smithi008.stdout: "initiated_at": "2023-08-01T19:54:29.655369+0000", 2023-08-01T19:54:45.828 INFO:teuthology.orchestra.run.smithi008.stdout: "age": 16.099246135000001, 2023-08-01T19:54:45.828 INFO:teuthology.orchestra.run.smithi008.stdout: "duration": 0.013074334999999999, 2023-08-01T19:54:45.828 INFO:teuthology.orchestra.run.smithi008.stdout: "type_data": { 2023-08-01T19:54:45.828 INFO:teuthology.orchestra.run.smithi008.stdout: "flag_point": "commit sent; apply or cleanup", 2023-08-01T19:54:45.828 INFO:teuthology.orchestra.run.smithi008.stdout: "client_info": { 2023-08-01T19:54:45.828 INFO:teuthology.orchestra.run.smithi008.stdout: "client": "client.4668", 2023-08-01T19:54:45.829 INFO:teuthology.orchestra.run.smithi008.stdout: "client_addr": "172.21.15.6:0/1709472247", 2023-08-01T19:54:45.829 INFO:teuthology.orchestra.run.smithi008.stdout: "tid": 20544 2023-08-01T19:54:45.829 INFO:teuthology.orchestra.run.smithi008.stdout: }, 2023-08-01T19:54:45.829 INFO:teuthology.orchestra.run.smithi008.stdout: "events": [ 2023-08-01T19:54:45.829 INFO:teuthology.orchestra.run.smithi008.stdout: { 2023-08-01T19:54:45.829 INFO:teuthology.orchestra.run.smithi008.stdout: "event": "initiated", 2023-08-01T19:54:45.829 INFO:teuthology.orchestra.run.smithi008.stdout: "time": "2023-08-01T19:54:29.655369+0000", 2023-08-01T19:54:45.829 INFO:teuthology.orchestra.run.smithi008.stdout: "duration": 0 2023-08-01T19:54:45.830 INFO:teuthology.orchestra.run.smithi008.stdout: }, 2023-08-01T19:54:45.830 INFO:teuthology.orchestra.run.smithi008.stdout: { 2023-08-01T19:54:45.830 INFO:teuthology.orchestra.run.smithi008.stdout: "event": "throttled", 2023-08-01T19:54:45.830 INFO:teuthology.orchestra.run.smithi008.stdout: "time": "2023-08-01T19:54:29.655369+0000", 2023-08-01T19:54:45.830 INFO:teuthology.orchestra.run.smithi008.stdout: "duration": 0 2023-08-01T19:54:45.830 INFO:teuthology.orchestra.run.smithi008.stdout: }, 2023-08-01T19:54:45.830 INFO:teuthology.orchestra.run.smithi008.stdout: { 2023-08-01T19:54:45.830 INFO:teuthology.orchestra.run.smithi008.stdout: "event": "header_read", 2023-08-01T19:54:45.831 INFO:teuthology.orchestra.run.smithi008.stdout: "time": "2023-08-01T19:54:29.655368+0000", 2023-08-01T19:54:45.831 INFO:teuthology.orchestra.run.smithi008.stdout: "duration": 4294967295.9999995 2023-08-01T19:54:45.831 INFO:teuthology.orchestra.run.smithi008.stdout: }, 2023-08-01T19:54:45.831 INFO:teuthology.orchestra.run.smithi008.stdout: { 2023-08-01T19:54:45.831 INFO:teuthology.orchestra.run.smithi008.stdout: "event": "all_read", 2023-08-01T19:54:45.831 INFO:teuthology.orchestra.run.smithi008.stdout: "time": "2023-08-01T19:54:29.655405+0000", 2023-08-01T19:54:45.831 INFO:teuthology.orchestra.run.smithi008.stdout: "duration": 3.7316e-05 2023-08-01T19:54:45.832 INFO:teuthology.orchestra.run.smithi008.stdout: }, 2023-08-01T19:54:45.832 INFO:teuthology.orchestra.run.smithi008.stdout: { 2023-08-01T19:54:45.832 INFO:teuthology.orchestra.run.smithi008.stdout: "event": "dispatched", 2023-08-01T19:54:45.832 INFO:teuthology.orchestra.run.smithi008.stdout: "time": "2023-08-01T19:54:29.655416+0000", 2023-08-01T19:54:45.832 INFO:teuthology.orchestra.run.smithi008.stdout: "duration": 1.1102e-05 2023-08-01T19:54:45.832 INFO:teuthology.orchestra.run.smithi008.stdout: }, 2023-08-01T19:54:45.832 INFO:teuthology.orchestra.run.smithi008.stdout: { 2023-08-01T19:54:45.832 INFO:teuthology.orchestra.run.smithi008.stdout: "event": "queued_for_pg", 2023-08-01T19:54:45.833 INFO:teuthology.orchestra.run.smithi008.stdout: "time": "2023-08-01T19:54:29.655422+0000", 2023-08-01T19:54:45.833 INFO:teuthology.orchestra.run.smithi008.stdout: "duration": 5.9120000000000003e-06 2023-08-01T19:54:45.833 INFO:teuthology.orchestra.run.smithi008.stdout: }, 2023-08-01T19:54:45.833 INFO:teuthology.orchestra.run.smithi008.stdout: { 2023-08-01T19:54:45.833 INFO:teuthology.orchestra.run.smithi008.stdout: "event": "reached_pg", 2023-08-01T19:54:45.833 INFO:teuthology.orchestra.run.smithi008.stdout: "time": "2023-08-01T19:54:29.656834+0000", 2023-08-01T19:54:45.833 INFO:teuthology.orchestra.run.smithi008.stdout: "duration": 0.0014116829999999999 2023-08-01T19:54:45.833 INFO:teuthology.orchestra.run.smithi008.stdout: }, 2023-08-01T19:54:45.834 INFO:teuthology.orchestra.run.smithi008.stdout: { 2023-08-01T19:54:45.834 INFO:teuthology.orchestra.run.smithi008.stdout: "event": "started", 2023-08-01T19:54:45.834 INFO:teuthology.orchestra.run.smithi008.stdout: "time": "2023-08-01T19:54:29.656953+0000", 2023-08-01T19:54:45.834 INFO:teuthology.orchestra.run.smithi008.stdout: "duration": 0.00011851200000000001 2023-08-01T19:54:45.834 INFO:teuthology.orchestra.run.smithi008.stdout: }, 2023-08-01T19:54:45.834 INFO:teuthology.orchestra.run.smithi008.stdout: { 2023-08-01T19:54:45.834 INFO:teuthology.orchestra.run.smithi008.stdout: "event": "waiting for subops from 2", 2023-08-01T19:54:45.834 INFO:teuthology.orchestra.run.smithi008.stdout: "time": "2023-08-01T19:54:29.657099+0000", 2023-08-01T19:54:45.835 INFO:teuthology.orchestra.run.smithi008.stdout: "duration": 0.000146241 2023-08-01T19:54:45.835 INFO:teuthology.orchestra.run.smithi008.stdout: }, 2023-08-01T19:54:45.835 INFO:teuthology.orchestra.run.smithi008.stdout: { 2023-08-01T19:54:45.835 INFO:teuthology.orchestra.run.smithi008.stdout: "event": "op_commit", 2023-08-01T19:54:45.835 INFO:teuthology.orchestra.run.smithi008.stdout: "time": "2023-08-01T19:54:29.659538+0000", 2023-08-01T19:54:45.835 INFO:teuthology.orchestra.run.smithi008.stdout: "duration": 0.0024387549999999999 2023-08-01T19:54:45.835 INFO:teuthology.orchestra.run.smithi008.stdout: }, 2023-08-01T19:54:45.835 INFO:teuthology.orchestra.run.smithi008.stdout: { 2023-08-01T19:54:45.836 INFO:teuthology.orchestra.run.smithi008.stdout: "event": "sub_op_commit_rec", 2023-08-01T19:54:45.836 INFO:teuthology.orchestra.run.smithi008.stdout: "time": "2023-08-01T19:54:29.668362+0000", 2023-08-01T19:54:45.836 INFO:teuthology.orchestra.run.smithi008.stdout: "duration": 0.0088243590000000004 2023-08-01T19:54:45.836 INFO:teuthology.orchestra.run.smithi008.stdout: }, 2023-08-01T19:54:45.836 INFO:teuthology.orchestra.run.smithi008.stdout: { 2023-08-01T19:54:45.836 INFO:teuthology.orchestra.run.smithi008.stdout: "event": "commit_sent", 2023-08-01T19:54:45.836 INFO:teuthology.orchestra.run.smithi008.stdout: "time": "2023-08-01T19:54:29.668409+0000", 2023-08-01T19:54:45.836 INFO:teuthology.orchestra.run.smithi008.stdout: "duration": 4.7246000000000001e-05 2023-08-01T19:54:45.837 INFO:teuthology.orchestra.run.smithi008.stdout: }, 2023-08-01T19:54:45.837 INFO:teuthology.orchestra.run.smithi008.stdout: { 2023-08-01T19:54:45.837 INFO:teuthology.orchestra.run.smithi008.stdout: "event": "done", 2023-08-01T19:54:45.837 INFO:teuthology.orchestra.run.smithi008.stdout: "time": "2023-08-01T19:54:29.668443+0000", 2023-08-01T19:54:45.837 INFO:teuthology.orchestra.run.smithi008.stdout: "duration": 3.3844999999999999e-05 2023-08-01T19:54:45.837 INFO:teuthology.orchestra.run.smithi008.stdout: } 2023-08-01T19:54:45.837 INFO:teuthology.orchestra.run.smithi008.stdout: ] 2023-08-01T19:54:45.837 INFO:teuthology.orchestra.run.smithi008.stdout: } 2023-08-01T19:54:45.838 INFO:teuthology.orchestra.run.smithi008.stdout: }, 2023-08-01T19:54:45.838 INFO:teuthology.orchestra.run.smithi008.stdout: { 2023-08-01T19:54:45.838 INFO:teuthology.orchestra.run.smithi008.stdout: "description": "osd_op(client.4668.0:20547 5.a 5:54001317:::benchmark_data_smithi006_114134_object20546:head [set-alloc-hint object_size 65536 write_size 65536,write 0~65536] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e23)", 2023-08-01T19:54:45.838 INFO:teuthology.orchestra.run.smithi008.stdout: "initiated_at": "2023-08-01T19:54:29.655560+0000", 2023-08-01T19:54:45.838 INFO:teuthology.orchestra.run.smithi008.stdout: "age": 16.099054592000002, 2023-08-01T19:54:45.838 INFO:teuthology.orchestra.run.smithi008.stdout: "duration": 0.014929586999999999, 2023-08-01T19:54:45.838 INFO:teuthology.orchestra.run.smithi008.stdout: "type_data": { 2023-08-01T19:54:45.838 INFO:teuthology.orchestra.run.smithi008.stdout: "flag_point": "commit sent; apply or cleanup", 2023-08-01T19:54:45.839 INFO:teuthology.orchestra.run.smithi008.stdout: "client_info": { 2023-08-01T19:54:45.839 INFO:teuthology.orchestra.run.smithi008.stdout: "client": "client.4668", 2023-08-01T19:54:45.839 INFO:teuthology.orchestra.run.smithi008.stdout: "client_addr": "172.21.15.6:0/1709472247", 2023-08-01T19:54:45.839 INFO:teuthology.orchestra.run.smithi008.stdout: "tid": 20547 2023-08-01T19:54:45.839 INFO:teuthology.orchestra.run.smithi008.stdout: }, 2023-08-01T19:54:45.839 INFO:teuthology.orchestra.run.smithi008.stdout: "events": [ 2023-08-01T19:54:45.839 INFO:teuthology.orchestra.run.smithi008.stdout: { 2023-08-01T19:54:45.839 INFO:teuthology.orchestra.run.smithi008.stdout: "event": "initiated", 2023-08-01T19:54:45.840 INFO:teuthology.orchestra.run.smithi008.stdout: "time": "2023-08-01T19:54:29.655560+0000", 2023-08-01T19:54:45.840 INFO:teuthology.orchestra.run.smithi008.stdout: "duration": 0 2023-08-01T19:54:45.840 INFO:teuthology.orchestra.run.smithi008.stdout: }, 2023-08-01T19:54:45.840 INFO:teuthology.orchestra.run.smithi008.stdout: { 2023-08-01T19:54:45.840 INFO:teuthology.orchestra.run.smithi008.stdout: "event": "throttled", 2023-08-01T19:54:45.840 INFO:teuthology.orchestra.run.smithi008.stdout: "time": "2023-08-01T19:54:29.655560+0000", 2023-08-01T19:54:45.840 INFO:teuthology.orchestra.run.smithi008.stdout: "duration": 0 2023-08-01T19:54:45.841 INFO:teuthology.orchestra.run.smithi008.stdout: }, 2023-08-01T19:54:45.841 INFO:teuthology.orchestra.run.smithi008.stdout: { 2023-08-01T19:54:45.841 INFO:teuthology.orchestra.run.smithi008.stdout: "event": "header_read", 2023-08-01T19:54:45.841 INFO:teuthology.orchestra.run.smithi008.stdout: "time": "2023-08-01T19:54:29.655560+0000", 2023-08-01T19:54:45.841 INFO:teuthology.orchestra.run.smithi008.stdout: "duration": 4294967295.9999995 2023-08-01T19:54:45.841 INFO:teuthology.orchestra.run.smithi008.stdout: }, 2023-08-01T19:54:45.841 INFO:teuthology.orchestra.run.smithi008.stdout: { 2023-08-01T19:54:45.841 INFO:teuthology.orchestra.run.smithi008.stdout: "event": "all_read", 2023-08-01T19:54:45.842 INFO:teuthology.orchestra.run.smithi008.stdout: "time": "2023-08-01T19:54:29.655590+0000", 2023-08-01T19:54:45.842 INFO:teuthology.orchestra.run.smithi008.stdout: "duration": 3.0467000000000002e-05 2023-08-01T19:54:45.842 INFO:teuthology.orchestra.run.smithi008.stdout: }, 2023-08-01T19:54:45.842 INFO:teuthology.orchestra.run.smithi008.stdout: { 2023-08-01T19:54:45.842 INFO:teuthology.orchestra.run.smithi008.stdout: "event": "dispatched", 2023-08-01T19:54:45.842 INFO:teuthology.orchestra.run.smithi008.stdout: "time": "2023-08-01T19:54:29.655600+0000", 2023-08-01T19:54:45.842 INFO:teuthology.orchestra.run.smithi008.stdout: "duration": 1.0103e-05 2023-08-01T19:54:45.842 INFO:teuthology.orchestra.run.smithi008.stdout: }, 2023-08-01T19:54:45.843 INFO:teuthology.orchestra.run.smithi008.stdout: { 2023-08-01T19:54:45.843 INFO:teuthology.orchestra.run.smithi008.stdout: "event": "queued_for_pg", 2023-08-01T19:54:45.843 INFO:teuthology.orchestra.run.smithi008.stdout: "time": "2023-08-01T19:54:29.655605+0000", 2023-08-01T19:54:45.843 INFO:teuthology.orchestra.run.smithi008.stdout: "duration": 4.1860000000000002e-06 2023-08-01T19:54:45.843 INFO:teuthology.orchestra.run.smithi008.stdout: }, 2023-08-01T19:54:45.843 INFO:teuthology.orchestra.run.smithi008.stdout: { 2023-08-01T19:54:45.843 INFO:teuthology.orchestra.run.smithi008.stdout: "event": "reached_pg", 2023-08-01T19:54:45.843 INFO:teuthology.orchestra.run.smithi008.stdout: "time": "2023-08-01T19:54:29.657832+0000", 2023-08-01T19:54:45.844 INFO:teuthology.orchestra.run.smithi008.stdout: "duration": 0.0022275630000000001 2023-08-01T19:54:45.844 INFO:teuthology.orchestra.run.smithi008.stdout: }, 2023-08-01T19:54:45.844 INFO:teuthology.orchestra.run.smithi008.stdout: { 2023-08-01T19:54:45.844 INFO:teuthology.orchestra.run.smithi008.stdout: "event": "started", 2023-08-01T19:54:45.844 INFO:teuthology.orchestra.run.smithi008.stdout: "time": "2023-08-01T19:54:29.657927+0000", 2023-08-01T19:54:45.844 INFO:teuthology.orchestra.run.smithi008.stdout: "duration": 9.5390000000000007e-05 2023-08-01T19:54:45.844 INFO:teuthology.orchestra.run.smithi008.stdout: }, 2023-08-01T19:54:45.845 INFO:teuthology.orchestra.run.smithi008.stdout: { 2023-08-01T19:54:45.845 INFO:teuthology.orchestra.run.smithi008.stdout: "event": "waiting for subops from 2", 2023-08-01T19:54:45.845 INFO:teuthology.orchestra.run.smithi008.stdout: "time": "2023-08-01T19:54:29.658008+0000", 2023-08-01T19:54:45.845 INFO:teuthology.orchestra.run.smithi008.stdout: "duration": 8.0671000000000001e-05 2023-08-01T19:54:45.845 INFO:teuthology.orchestra.run.smithi008.stdout: }, 2023-08-01T19:54:45.845 INFO:teuthology.orchestra.run.smithi008.stdout: { 2023-08-01T19:54:45.845 INFO:teuthology.orchestra.run.smithi008.stdout: "event": "op_commit", 2023-08-01T19:54:45.845 INFO:teuthology.orchestra.run.smithi008.stdout: "time": "2023-08-01T19:54:29.659542+0000", 2023-08-01T19:54:45.846 INFO:teuthology.orchestra.run.smithi008.stdout: "duration": 0.0015343220000000001 2023-08-01T19:54:45.846 INFO:teuthology.orchestra.run.smithi008.stdout: }, 2023-08-01T19:54:45.846 INFO:teuthology.orchestra.run.smithi008.stdout: { 2023-08-01T19:54:45.846 INFO:teuthology.orchestra.run.smithi008.stdout: "event": "sub_op_commit_rec", 2023-08-01T19:54:45.846 INFO:teuthology.orchestra.run.smithi008.stdout: "time": "2023-08-01T19:54:29.670439+0000", 2023-08-01T19:54:45.846 INFO:teuthology.orchestra.run.smithi008.stdout: "duration": 0.010896874000000001 2023-08-01T19:54:45.846 INFO:teuthology.orchestra.run.smithi008.stdout: }, 2023-08-01T19:54:45.846 INFO:teuthology.orchestra.run.smithi008.stdout: { 2023-08-01T19:54:45.847 INFO:teuthology.orchestra.run.smithi008.stdout: "event": "commit_sent", 2023-08-01T19:54:45.847 INFO:teuthology.orchestra.run.smithi008.stdout: "time": "2023-08-01T19:54:29.670467+0000", 2023-08-01T19:54:45.847 INFO:teuthology.orchestra.run.smithi008.stdout: "duration": 2.7433999999999999e-05 2023-08-01T19:54:45.847 INFO:teuthology.orchestra.run.smithi008.stdout: }, 2023-08-01T19:54:45.847 INFO:teuthology.orchestra.run.smithi008.stdout: { 2023-08-01T19:54:45.847 INFO:teuthology.orchestra.run.smithi008.stdout: "event": "done", 2023-08-01T19:54:45.847 INFO:teuthology.orchestra.run.smithi008.stdout: "time": "2023-08-01T19:54:29.670490+0000", 2023-08-01T19:54:45.847 INFO:teuthology.orchestra.run.smithi008.stdout: "duration": 2.3076000000000001e-05 2023-08-01T19:54:45.848 INFO:teuthology.orchestra.run.smithi008.stdout: } 2023-08-01T19:54:45.848 INFO:teuthology.orchestra.run.smithi008.stdout: ] 2023-08-01T19:54:45.848 INFO:teuthology.orchestra.run.smithi008.stdout: } 2023-08-01T19:54:45.848 INFO:teuthology.orchestra.run.smithi008.stdout: }, 2023-08-01T19:54:45.848 INFO:teuthology.orchestra.run.smithi008.stdout: { 2023-08-01T19:54:45.848 INFO:teuthology.orchestra.run.smithi008.stdout: "description": "osd_op(client.4668.0:31686 5.c 5:3d4453fd:::benchmark_data_smithi006_114134_object31685:head [set-alloc-hint object_size 65536 write_size 65536,write 0~65536] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e24)", 2023-08-01T19:54:45.848 INFO:teuthology.orchestra.run.smithi008.stdout: "initiated_at": "2023-08-01T19:54:33.230374+0000", 2023-08-01T19:54:45.849 INFO:teuthology.orchestra.run.smithi008.stdout: "age": 12.524240744, 2023-08-01T19:54:45.849 INFO:teuthology.orchestra.run.smithi008.stdout: "duration": 0.014786407, 2023-08-01T19:54:45.849 INFO:teuthology.orchestra.run.smithi008.stdout: "type_data": { 2023-08-01T19:54:45.849 INFO:teuthology.orchestra.run.smithi008.stdout: "flag_point": "commit sent; apply or cleanup", 2023-08-01T19:54:45.849 INFO:teuthology.orchestra.run.smithi008.stdout: "client_info": { 2023-08-01T19:54:45.849 INFO:teuthology.orchestra.run.smithi008.stdout: "client": "client.4668", 2023-08-01T19:54:45.849 INFO:teuthology.orchestra.run.smithi008.stdout: "client_addr": "172.21.15.6:0/1709472247", 2023-08-01T19:54:45.849 INFO:teuthology.orchestra.run.smithi008.stdout: "tid": 31686 2023-08-01T19:54:45.850 INFO:teuthology.orchestra.run.smithi008.stdout: }, 2023-08-01T19:54:45.850 INFO:teuthology.orchestra.run.smithi008.stdout: "events": [ 2023-08-01T19:54:45.850 INFO:teuthology.orchestra.run.smithi008.stdout: { 2023-08-01T19:54:45.850 INFO:teuthology.orchestra.run.smithi008.stdout: "event": "initiated", 2023-08-01T19:54:45.850 INFO:teuthology.orchestra.run.smithi008.stdout: "time": "2023-08-01T19:54:33.230374+0000", 2023-08-01T19:54:45.850 INFO:teuthology.orchestra.run.smithi008.stdout: "duration": 0 2023-08-01T19:54:45.850 INFO:teuthology.orchestra.run.smithi008.stdout: }, 2023-08-01T19:54:45.850 INFO:teuthology.orchestra.run.smithi008.stdout: { 2023-08-01T19:54:45.851 INFO:teuthology.orchestra.run.smithi008.stdout: "event": "throttled", 2023-08-01T19:54:45.851 INFO:teuthology.orchestra.run.smithi008.stdout: "time": "2023-08-01T19:54:33.230374+0000", 2023-08-01T19:54:45.851 INFO:teuthology.orchestra.run.smithi008.stdout: "duration": 0 2023-08-01T19:54:45.851 INFO:teuthology.orchestra.run.smithi008.stdout: }, 2023-08-01T19:54:45.851 INFO:teuthology.orchestra.run.smithi008.stdout: { 2023-08-01T19:54:45.851 INFO:teuthology.orchestra.run.smithi008.stdout: "event": "header_read", 2023-08-01T19:54:45.851 INFO:teuthology.orchestra.run.smithi008.stdout: "time": "2023-08-01T19:54:33.230373+0000", 2023-08-01T19:54:45.851 INFO:teuthology.orchestra.run.smithi008.stdout: "duration": 4294967295.999999 2023-08-01T19:54:45.852 INFO:teuthology.orchestra.run.smithi008.stdout: }, 2023-08-01T19:54:45.852 INFO:teuthology.orchestra.run.smithi008.stdout: { 2023-08-01T19:54:45.852 INFO:teuthology.orchestra.run.smithi008.stdout: "event": "all_read", 2023-08-01T19:54:45.852 INFO:teuthology.orchestra.run.smithi008.stdout: "time": "2023-08-01T19:54:33.230444+0000", 2023-08-01T19:54:45.852 INFO:teuthology.orchestra.run.smithi008.stdout: "duration": 7.0624999999999996e-05 2023-08-01T19:54:45.852 INFO:teuthology.orchestra.run.smithi008.stdout: }, 2023-08-01T19:54:45.852 INFO:teuthology.orchestra.run.smithi008.stdout: { 2023-08-01T19:54:45.852 INFO:teuthology.orchestra.run.smithi008.stdout: "event": "dispatched", 2023-08-01T19:54:45.853 INFO:teuthology.orchestra.run.smithi008.stdout: "time": "2023-08-01T19:54:33.230455+0000", 2023-08-01T19:54:45.853 INFO:teuthology.orchestra.run.smithi008.stdout: "duration": 1.0669000000000001e-05 2023-08-01T19:54:45.853 INFO:teuthology.orchestra.run.smithi008.stdout: }, 2023-08-01T19:54:45.853 INFO:teuthology.orchestra.run.smithi008.stdout: { 2023-08-01T19:54:45.853 INFO:teuthology.orchestra.run.smithi008.stdout: "event": "queued_for_pg", 2023-08-01T19:54:45.853 INFO:teuthology.orchestra.run.smithi008.stdout: "time": "2023-08-01T19:54:33.230461+0000", 2023-08-01T19:54:45.853 INFO:teuthology.orchestra.run.smithi008.stdout: "duration": 6.3099999999999997e-06 2023-08-01T19:54:45.853 INFO:teuthology.orchestra.run.smithi008.stdout: }, 2023-08-01T19:54:45.854 INFO:teuthology.orchestra.run.smithi008.stdout: { 2023-08-01T19:54:45.854 INFO:teuthology.orchestra.run.smithi008.stdout: "event": "reached_pg", 2023-08-01T19:54:45.854 INFO:teuthology.orchestra.run.smithi008.stdout: "time": "2023-08-01T19:54:33.230816+0000", 2023-08-01T19:54:45.854 INFO:teuthology.orchestra.run.smithi008.stdout: "duration": 0.000355161 2023-08-01T19:54:45.854 INFO:teuthology.orchestra.run.smithi008.stdout: }, 2023-08-01T19:54:45.854 INFO:teuthology.orchestra.run.smithi008.stdout: { 2023-08-01T19:54:45.854 INFO:teuthology.orchestra.run.smithi008.stdout: "event": "started", 2023-08-01T19:54:45.855 INFO:teuthology.orchestra.run.smithi008.stdout: "time": "2023-08-01T19:54:33.230925+0000", 2023-08-01T19:54:45.855 INFO:teuthology.orchestra.run.smithi008.stdout: "duration": 0.0001091 2023-08-01T19:54:45.855 INFO:teuthology.orchestra.run.smithi008.stdout: }, 2023-08-01T19:54:45.855 INFO:teuthology.orchestra.run.smithi008.stdout: { 2023-08-01T19:54:45.855 INFO:teuthology.orchestra.run.smithi008.stdout: "event": "waiting for subops from 1", 2023-08-01T19:54:45.855 INFO:teuthology.orchestra.run.smithi008.stdout: "time": "2023-08-01T19:54:33.231057+0000", 2023-08-01T19:54:45.855 INFO:teuthology.orchestra.run.smithi008.stdout: "duration": 0.000131932 2023-08-01T19:54:45.855 INFO:teuthology.orchestra.run.smithi008.stdout: }, 2023-08-01T19:54:45.856 INFO:teuthology.orchestra.run.smithi008.stdout: { 2023-08-01T19:54:45.856 INFO:teuthology.orchestra.run.smithi008.stdout: "event": "op_commit", 2023-08-01T19:54:45.856 INFO:teuthology.orchestra.run.smithi008.stdout: "time": "2023-08-01T19:54:33.234362+0000", 2023-08-01T19:54:45.856 INFO:teuthology.orchestra.run.smithi008.stdout: "duration": 0.0033053370000000002 2023-08-01T19:54:45.856 INFO:teuthology.orchestra.run.smithi008.stdout: }, 2023-08-01T19:54:45.856 INFO:teuthology.orchestra.run.smithi008.stdout: { 2023-08-01T19:54:45.856 INFO:teuthology.orchestra.run.smithi008.stdout: "event": "sub_op_commit_rec", 2023-08-01T19:54:45.857 INFO:teuthology.orchestra.run.smithi008.stdout: "time": "2023-08-01T19:54:33.245059+0000", 2023-08-01T19:54:45.857 INFO:teuthology.orchestra.run.smithi008.stdout: "duration": 0.010696463999999999 2023-08-01T19:54:45.857 INFO:teuthology.orchestra.run.smithi008.stdout: }, 2023-08-01T19:54:45.857 INFO:teuthology.orchestra.run.smithi008.stdout: { 2023-08-01T19:54:45.857 INFO:teuthology.orchestra.run.smithi008.stdout: "event": "commit_sent", 2023-08-01T19:54:45.857 INFO:teuthology.orchestra.run.smithi008.stdout: "time": "2023-08-01T19:54:33.245116+0000", 2023-08-01T19:54:45.857 INFO:teuthology.orchestra.run.smithi008.stdout: "duration": 5.6990000000000002e-05 2023-08-01T19:54:45.857 INFO:teuthology.orchestra.run.smithi008.stdout: }, 2023-08-01T19:54:45.858 INFO:teuthology.orchestra.run.smithi008.stdout: { 2023-08-01T19:54:45.858 INFO:teuthology.orchestra.run.smithi008.stdout: "event": "done", 2023-08-01T19:54:45.858 INFO:teuthology.orchestra.run.smithi008.stdout: "time": "2023-08-01T19:54:33.245161+0000", 2023-08-01T19:54:45.858 INFO:teuthology.orchestra.run.smithi008.stdout: "duration": 4.4625e-05 2023-08-01T19:54:45.858 INFO:teuthology.orchestra.run.smithi008.stdout: } 2023-08-01T19:54:45.858 INFO:teuthology.orchestra.run.smithi008.stdout: ] 2023-08-01T19:54:45.858 INFO:teuthology.orchestra.run.smithi008.stdout: } 2023-08-01T19:54:45.858 INFO:teuthology.orchestra.run.smithi008.stdout: }, 2023-08-01T19:54:45.859 INFO:teuthology.orchestra.run.smithi008.stdout: { 2023-08-01T19:54:45.859 INFO:teuthology.orchestra.run.smithi008.stdout: "description": "osd_op(client.4668.0:31690 5.3 5:ca8c6108:::benchmark_data_smithi006_114134_object31689:head [set-alloc-hint object_size 65536 write_size 65536,write 0~65536] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e24)", 2023-08-01T19:54:45.859 INFO:teuthology.orchestra.run.smithi008.stdout: "initiated_at": "2023-08-01T19:54:33.232204+0000", 2023-08-01T19:54:45.859 INFO:teuthology.orchestra.run.smithi008.stdout: "age": 12.522410739, 2023-08-01T19:54:45.859 INFO:teuthology.orchestra.run.smithi008.stdout: "duration": 0.013756551000000001, 2023-08-01T19:54:45.859 INFO:teuthology.orchestra.run.smithi008.stdout: "type_data": { 2023-08-01T19:54:45.859 INFO:teuthology.orchestra.run.smithi008.stdout: "flag_point": "commit sent; apply or cleanup", 2023-08-01T19:54:45.859 INFO:teuthology.orchestra.run.smithi008.stdout: "client_info": { 2023-08-01T19:54:45.860 INFO:teuthology.orchestra.run.smithi008.stdout: "client": "client.4668", 2023-08-01T19:54:45.860 INFO:teuthology.orchestra.run.smithi008.stdout: "client_addr": "172.21.15.6:0/1709472247", 2023-08-01T19:54:45.860 INFO:teuthology.orchestra.run.smithi008.stdout: "tid": 31690 2023-08-01T19:54:45.860 INFO:teuthology.orchestra.run.smithi008.stdout: }, 2023-08-01T19:54:45.860 INFO:teuthology.orchestra.run.smithi008.stdout: "events": [ 2023-08-01T19:54:45.860 INFO:teuthology.orchestra.run.smithi008.stdout: { 2023-08-01T19:54:45.860 INFO:teuthology.orchestra.run.smithi008.stdout: "event": "initiated", 2023-08-01T19:54:45.861 INFO:teuthology.orchestra.run.smithi008.stdout: "time": "2023-08-01T19:54:33.232204+0000", 2023-08-01T19:54:45.861 INFO:teuthology.orchestra.run.smithi008.stdout: "duration": 0 2023-08-01T19:54:45.861 INFO:teuthology.orchestra.run.smithi008.stdout: }, 2023-08-01T19:54:45.861 INFO:teuthology.orchestra.run.smithi008.stdout: { 2023-08-01T19:54:45.861 INFO:teuthology.orchestra.run.smithi008.stdout: "event": "throttled", 2023-08-01T19:54:45.861 INFO:teuthology.orchestra.run.smithi008.stdout: "time": "2023-08-01T19:54:33.232204+0000", 2023-08-01T19:54:45.861 INFO:teuthology.orchestra.run.smithi008.stdout: "duration": 0 2023-08-01T19:54:45.861 INFO:teuthology.orchestra.run.smithi008.stdout: }, 2023-08-01T19:54:45.862 INFO:teuthology.orchestra.run.smithi008.stdout: { 2023-08-01T19:54:45.862 INFO:teuthology.orchestra.run.smithi008.stdout: "event": "header_read", 2023-08-01T19:54:45.862 INFO:teuthology.orchestra.run.smithi008.stdout: "time": "2023-08-01T19:54:33.232203+0000", 2023-08-01T19:54:45.862 INFO:teuthology.orchestra.run.smithi008.stdout: "duration": 4294967295.999999 2023-08-01T19:54:45.862 INFO:teuthology.orchestra.run.smithi008.stdout: }, 2023-08-01T19:54:45.862 INFO:teuthology.orchestra.run.smithi008.stdout: { 2023-08-01T19:54:45.862 INFO:teuthology.orchestra.run.smithi008.stdout: "event": "all_read", 2023-08-01T19:54:45.862 INFO:teuthology.orchestra.run.smithi008.stdout: "time": "2023-08-01T19:54:33.232289+0000", 2023-08-01T19:54:45.863 INFO:teuthology.orchestra.run.smithi008.stdout: "duration": 8.6006000000000003e-05 2023-08-01T19:54:45.863 INFO:teuthology.orchestra.run.smithi008.stdout: }, 2023-08-01T19:54:45.863 INFO:teuthology.orchestra.run.smithi008.stdout: { 2023-08-01T19:54:45.863 INFO:teuthology.orchestra.run.smithi008.stdout: "event": "dispatched", 2023-08-01T19:54:45.863 INFO:teuthology.orchestra.run.smithi008.stdout: "time": "2023-08-01T19:54:33.232299+0000", 2023-08-01T19:54:45.863 INFO:teuthology.orchestra.run.smithi008.stdout: "duration": 9.4520000000000003e-06 2023-08-01T19:54:45.863 INFO:teuthology.orchestra.run.smithi008.stdout: }, 2023-08-01T19:54:45.863 INFO:teuthology.orchestra.run.smithi008.stdout: { 2023-08-01T19:54:45.864 INFO:teuthology.orchestra.run.smithi008.stdout: "event": "queued_for_pg", 2023-08-01T19:54:45.864 INFO:teuthology.orchestra.run.smithi008.stdout: "time": "2023-08-01T19:54:33.232303+0000", 2023-08-01T19:54:45.864 INFO:teuthology.orchestra.run.smithi008.stdout: "duration": 4.16e-06 2023-08-01T19:54:45.864 INFO:teuthology.orchestra.run.smithi008.stdout: }, 2023-08-01T19:54:45.864 INFO:teuthology.orchestra.run.smithi008.stdout: { 2023-08-01T19:54:45.864 INFO:teuthology.orchestra.run.smithi008.stdout: "event": "reached_pg", 2023-08-01T19:54:45.864 INFO:teuthology.orchestra.run.smithi008.stdout: "time": "2023-08-01T19:54:33.232353+0000", 2023-08-01T19:54:45.865 INFO:teuthology.orchestra.run.smithi008.stdout: "duration": 5.0463000000000001e-05 2023-08-01T19:54:45.865 INFO:teuthology.orchestra.run.smithi008.stdout: }, 2023-08-01T19:54:45.865 INFO:teuthology.orchestra.run.smithi008.stdout: { 2023-08-01T19:54:45.865 INFO:teuthology.orchestra.run.smithi008.stdout: "event": "started", 2023-08-01T19:54:45.865 INFO:teuthology.orchestra.run.smithi008.stdout: "time": "2023-08-01T19:54:33.232488+0000", 2023-08-01T19:54:45.865 INFO:teuthology.orchestra.run.smithi008.stdout: "duration": 0.00013489400000000001 2023-08-01T19:54:45.865 INFO:teuthology.orchestra.run.smithi008.stdout: }, 2023-08-01T19:54:45.865 INFO:teuthology.orchestra.run.smithi008.stdout: { 2023-08-01T19:54:45.866 INFO:teuthology.orchestra.run.smithi008.stdout: "event": "waiting for subops from 1", 2023-08-01T19:54:45.866 INFO:teuthology.orchestra.run.smithi008.stdout: "time": "2023-08-01T19:54:33.232648+0000", 2023-08-01T19:54:45.866 INFO:teuthology.orchestra.run.smithi008.stdout: "duration": 0.000160311 2023-08-01T19:54:45.866 INFO:teuthology.orchestra.run.smithi008.stdout: }, 2023-08-01T19:54:45.866 INFO:teuthology.orchestra.run.smithi008.stdout: { 2023-08-01T19:54:45.866 INFO:teuthology.orchestra.run.smithi008.stdout: "event": "op_commit", 2023-08-01T19:54:45.866 INFO:teuthology.orchestra.run.smithi008.stdout: "time": "2023-08-01T19:54:33.234740+0000", 2023-08-01T19:54:45.866 INFO:teuthology.orchestra.run.smithi008.stdout: "duration": 0.0020919110000000001 2023-08-01T19:54:45.867 INFO:teuthology.orchestra.run.smithi008.stdout: }, 2023-08-01T19:54:45.867 INFO:teuthology.orchestra.run.smithi008.stdout: { 2023-08-01T19:54:45.867 INFO:teuthology.orchestra.run.smithi008.stdout: "event": "sub_op_commit_rec", 2023-08-01T19:54:45.867 INFO:teuthology.orchestra.run.smithi008.stdout: "time": "2023-08-01T19:54:33.245903+0000", 2023-08-01T19:54:45.867 INFO:teuthology.orchestra.run.smithi008.stdout: "duration": 0.011162208 2023-08-01T19:54:45.867 INFO:teuthology.orchestra.run.smithi008.stdout: }, 2023-08-01T19:54:45.867 INFO:teuthology.orchestra.run.smithi008.stdout: { 2023-08-01T19:54:45.867 INFO:teuthology.orchestra.run.smithi008.stdout: "event": "commit_sent", 2023-08-01T19:54:45.868 INFO:teuthology.orchestra.run.smithi008.stdout: "time": "2023-08-01T19:54:33.245939+0000", 2023-08-01T19:54:45.868 INFO:teuthology.orchestra.run.smithi008.stdout: "duration": 3.6179e-05 2023-08-01T19:54:45.868 INFO:teuthology.orchestra.run.smithi008.stdout: }, 2023-08-01T19:54:45.868 INFO:teuthology.orchestra.run.smithi008.stdout: { 2023-08-01T19:54:45.868 INFO:teuthology.orchestra.run.smithi008.stdout: "event": "done", 2023-08-01T19:54:45.868 INFO:teuthology.orchestra.run.smithi008.stdout: "time": "2023-08-01T19:54:33.245961+0000", 2023-08-01T19:54:45.868 INFO:teuthology.orchestra.run.smithi008.stdout: "duration": 2.1945000000000001e-05 2023-08-01T19:54:45.869 INFO:teuthology.orchestra.run.smithi008.stdout: } 2023-08-01T19:54:45.869 INFO:teuthology.orchestra.run.smithi008.stdout: ] 2023-08-01T19:54:45.869 INFO:teuthology.orchestra.run.smithi008.stdout: } 2023-08-01T19:54:45.869 INFO:teuthology.orchestra.run.smithi008.stdout: }, 2023-08-01T19:54:45.869 INFO:teuthology.orchestra.run.smithi008.stdout: { 2023-08-01T19:54:45.869 INFO:teuthology.orchestra.run.smithi008.stdout: "description": "osd_op(client.4668.0:42456 5.5 5:a63cfb95:::benchmark_data_smithi006_114134_object42455:head [set-alloc-hint object_size 65536 write_size 65536,write 0~65536] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e26)", 2023-08-01T19:54:45.869 INFO:teuthology.orchestra.run.smithi008.stdout: "initiated_at": "2023-08-01T19:54:37.199768+0000", 2023-08-01T19:54:45.869 INFO:teuthology.orchestra.run.smithi008.stdout: "age": 8.554846779, 2023-08-01T19:54:45.870 INFO:teuthology.orchestra.run.smithi008.stdout: "duration": 0.015069397999999999, 2023-08-01T19:54:45.870 INFO:teuthology.orchestra.run.smithi008.stdout: "type_data": { 2023-08-01T19:54:45.870 INFO:teuthology.orchestra.run.smithi008.stdout: "flag_point": "commit sent; apply or cleanup", 2023-08-01T19:54:45.870 INFO:teuthology.orchestra.run.smithi008.stdout: "client_info": { 2023-08-01T19:54:45.870 INFO:teuthology.orchestra.run.smithi008.stdout: "client": "client.4668", 2023-08-01T19:54:45.870 INFO:teuthology.orchestra.run.smithi008.stdout: "client_addr": "172.21.15.6:0/1709472247", 2023-08-01T19:54:45.870 INFO:teuthology.orchestra.run.smithi008.stdout: "tid": 42456 2023-08-01T19:54:45.870 INFO:teuthology.orchestra.run.smithi008.stdout: }, 2023-08-01T19:54:45.871 INFO:teuthology.orchestra.run.smithi008.stdout: "events": [ 2023-08-01T19:54:45.871 INFO:teuthology.orchestra.run.smithi008.stdout: { 2023-08-01T19:54:45.871 INFO:teuthology.orchestra.run.smithi008.stdout: "event": "initiated", 2023-08-01T19:54:45.871 INFO:teuthology.orchestra.run.smithi008.stdout: "time": "2023-08-01T19:54:37.199768+0000", 2023-08-01T19:54:45.871 INFO:teuthology.orchestra.run.smithi008.stdout: "duration": 0 2023-08-01T19:54:45.871 INFO:teuthology.orchestra.run.smithi008.stdout: }, 2023-08-01T19:54:45.871 INFO:teuthology.orchestra.run.smithi008.stdout: { 2023-08-01T19:54:45.871 INFO:teuthology.orchestra.run.smithi008.stdout: "event": "throttled", 2023-08-01T19:54:45.872 INFO:teuthology.orchestra.run.smithi008.stdout: "time": "2023-08-01T19:54:37.199768+0000", 2023-08-01T19:54:45.872 INFO:teuthology.orchestra.run.smithi008.stdout: "duration": 0 2023-08-01T19:54:45.872 INFO:teuthology.orchestra.run.smithi008.stdout: }, 2023-08-01T19:54:45.872 INFO:teuthology.orchestra.run.smithi008.stdout: { 2023-08-01T19:54:45.872 INFO:teuthology.orchestra.run.smithi008.stdout: "event": "header_read", 2023-08-01T19:54:45.872 INFO:teuthology.orchestra.run.smithi008.stdout: "time": "2023-08-01T19:54:37.199767+0000", 2023-08-01T19:54:45.872 INFO:teuthology.orchestra.run.smithi008.stdout: "duration": 4294967295.9999995 2023-08-01T19:54:45.872 INFO:teuthology.orchestra.run.smithi008.stdout: }, 2023-08-01T19:54:45.873 INFO:teuthology.orchestra.run.smithi008.stdout: { 2023-08-01T19:54:45.873 INFO:teuthology.orchestra.run.smithi008.stdout: "event": "all_read", 2023-08-01T19:54:45.873 INFO:teuthology.orchestra.run.smithi008.stdout: "time": "2023-08-01T19:54:37.199798+0000", 2023-08-01T19:54:45.873 INFO:teuthology.orchestra.run.smithi008.stdout: "duration": 3.0443999999999999e-05 2023-08-01T19:54:45.873 INFO:teuthology.orchestra.run.smithi008.stdout: }, 2023-08-01T19:54:45.873 INFO:teuthology.orchestra.run.smithi008.stdout: { 2023-08-01T19:54:45.873 INFO:teuthology.orchestra.run.smithi008.stdout: "event": "dispatched", 2023-08-01T19:54:45.873 INFO:teuthology.orchestra.run.smithi008.stdout: "time": "2023-08-01T19:54:37.199806+0000", 2023-08-01T19:54:45.874 INFO:teuthology.orchestra.run.smithi008.stdout: "duration": 8.2300000000000008e-06 2023-08-01T19:54:45.874 INFO:teuthology.orchestra.run.smithi008.stdout: }, 2023-08-01T19:54:45.874 INFO:teuthology.orchestra.run.smithi008.stdout: { 2023-08-01T19:54:45.874 INFO:teuthology.orchestra.run.smithi008.stdout: "event": "queued_for_pg", 2023-08-01T19:54:45.874 INFO:teuthology.orchestra.run.smithi008.stdout: "time": "2023-08-01T19:54:37.199811+0000", 2023-08-01T19:54:45.874 INFO:teuthology.orchestra.run.smithi008.stdout: "duration": 5.2730000000000002e-06 2023-08-01T19:54:45.874 INFO:teuthology.orchestra.run.smithi008.stdout: }, 2023-08-01T19:54:45.874 INFO:teuthology.orchestra.run.smithi008.stdout: { 2023-08-01T19:54:45.875 INFO:teuthology.orchestra.run.smithi008.stdout: "event": "reached_pg", 2023-08-01T19:54:45.875 INFO:teuthology.orchestra.run.smithi008.stdout: "time": "2023-08-01T19:54:37.200406+0000", 2023-08-01T19:54:45.875 INFO:teuthology.orchestra.run.smithi008.stdout: "duration": 0.00059457599999999998 2023-08-01T19:54:45.875 INFO:teuthology.orchestra.run.smithi008.stdout: }, 2023-08-01T19:54:45.875 INFO:teuthology.orchestra.run.smithi008.stdout: { 2023-08-01T19:54:45.875 INFO:teuthology.orchestra.run.smithi008.stdout: "event": "started", 2023-08-01T19:54:45.875 INFO:teuthology.orchestra.run.smithi008.stdout: "time": "2023-08-01T19:54:37.200532+0000", 2023-08-01T19:54:45.875 INFO:teuthology.orchestra.run.smithi008.stdout: "duration": 0.000126129 2023-08-01T19:54:45.876 INFO:teuthology.orchestra.run.smithi008.stdout: }, 2023-08-01T19:54:45.876 INFO:teuthology.orchestra.run.smithi008.stdout: { 2023-08-01T19:54:45.876 INFO:teuthology.orchestra.run.smithi008.stdout: "event": "waiting for subops from 1", 2023-08-01T19:54:45.876 INFO:teuthology.orchestra.run.smithi008.stdout: "time": "2023-08-01T19:54:37.200644+0000", 2023-08-01T19:54:45.876 INFO:teuthology.orchestra.run.smithi008.stdout: "duration": 0.000111736 2023-08-01T19:54:45.876 INFO:teuthology.orchestra.run.smithi008.stdout: }, 2023-08-01T19:54:45.876 INFO:teuthology.orchestra.run.smithi008.stdout: { 2023-08-01T19:54:45.876 INFO:teuthology.orchestra.run.smithi008.stdout: "event": "sub_op_commit_rec", 2023-08-01T19:54:45.877 INFO:teuthology.orchestra.run.smithi008.stdout: "time": "2023-08-01T19:54:37.203384+0000", 2023-08-01T19:54:45.877 INFO:teuthology.orchestra.run.smithi008.stdout: "duration": 0.0027397039999999999 2023-08-01T19:54:45.877 INFO:teuthology.orchestra.run.smithi008.stdout: }, 2023-08-01T19:54:45.877 INFO:teuthology.orchestra.run.smithi008.stdout: { 2023-08-01T19:54:45.877 INFO:teuthology.orchestra.run.smithi008.stdout: "event": "op_commit", 2023-08-01T19:54:45.877 INFO:teuthology.orchestra.run.smithi008.stdout: "time": "2023-08-01T19:54:37.214746+0000", 2023-08-01T19:54:45.877 INFO:teuthology.orchestra.run.smithi008.stdout: "duration": 0.011362766 2023-08-01T19:54:45.878 INFO:teuthology.orchestra.run.smithi008.stdout: }, 2023-08-01T19:54:45.878 INFO:teuthology.orchestra.run.smithi008.stdout: { 2023-08-01T19:54:45.878 INFO:teuthology.orchestra.run.smithi008.stdout: "event": "commit_sent", 2023-08-01T19:54:45.878 INFO:teuthology.orchestra.run.smithi008.stdout: "time": "2023-08-01T19:54:37.214795+0000", 2023-08-01T19:54:45.878 INFO:teuthology.orchestra.run.smithi008.stdout: "duration": 4.8449000000000003e-05 2023-08-01T19:54:45.878 INFO:teuthology.orchestra.run.smithi008.stdout: }, 2023-08-01T19:54:45.878 INFO:teuthology.orchestra.run.smithi008.stdout: { 2023-08-01T19:54:45.879 INFO:teuthology.orchestra.run.smithi008.stdout: "event": "done", 2023-08-01T19:54:45.879 INFO:teuthology.orchestra.run.smithi008.stdout: "time": "2023-08-01T19:54:37.214837+0000", 2023-08-01T19:54:45.879 INFO:teuthology.orchestra.run.smithi008.stdout: "duration": 4.2661999999999999e-05 2023-08-01T19:54:45.879 INFO:teuthology.orchestra.run.smithi008.stdout: } 2023-08-01T19:54:45.879 INFO:teuthology.orchestra.run.smithi008.stdout: ] 2023-08-01T19:54:45.879 INFO:teuthology.orchestra.run.smithi008.stdout: } 2023-08-01T19:54:45.879 INFO:teuthology.orchestra.run.smithi008.stdout: }, 2023-08-01T19:54:45.879 INFO:teuthology.orchestra.run.smithi008.stdout: { 2023-08-01T19:54:45.880 INFO:teuthology.orchestra.run.smithi008.stdout: "description": "osd_op(client.4668.0:44617 5.c 5:34011d01:::benchmark_data_smithi006_114134_object44616:head [set-alloc-hint object_size 65536 write_size 65536,write 0~65536] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e26)", 2023-08-01T19:54:45.880 INFO:teuthology.orchestra.run.smithi008.stdout: "initiated_at": "2023-08-01T19:54:38.039696+0000", 2023-08-01T19:54:45.880 INFO:teuthology.orchestra.run.smithi008.stdout: "age": 7.7149186470000002, 2023-08-01T19:54:45.880 INFO:teuthology.orchestra.run.smithi008.stdout: "duration": 0.013247856000000001, 2023-08-01T19:54:45.880 INFO:teuthology.orchestra.run.smithi008.stdout: "type_data": { 2023-08-01T19:54:45.880 INFO:teuthology.orchestra.run.smithi008.stdout: "flag_point": "commit sent; apply or cleanup", 2023-08-01T19:54:45.880 INFO:teuthology.orchestra.run.smithi008.stdout: "client_info": { 2023-08-01T19:54:45.880 INFO:teuthology.orchestra.run.smithi008.stdout: "client": "client.4668", 2023-08-01T19:54:45.881 INFO:teuthology.orchestra.run.smithi008.stdout: "client_addr": "172.21.15.6:0/1709472247", 2023-08-01T19:54:45.881 INFO:teuthology.orchestra.run.smithi008.stdout: "tid": 44617 2023-08-01T19:54:45.881 INFO:teuthology.orchestra.run.smithi008.stdout: }, 2023-08-01T19:54:45.881 INFO:teuthology.orchestra.run.smithi008.stdout: "events": [ 2023-08-01T19:54:45.881 INFO:teuthology.orchestra.run.smithi008.stdout: { 2023-08-01T19:54:45.881 INFO:teuthology.orchestra.run.smithi008.stdout: "event": "initiated", 2023-08-01T19:54:45.881 INFO:teuthology.orchestra.run.smithi008.stdout: "time": "2023-08-01T19:54:38.039696+0000", 2023-08-01T19:54:45.881 INFO:teuthology.orchestra.run.smithi008.stdout: "duration": 0 2023-08-01T19:54:45.882 INFO:teuthology.orchestra.run.smithi008.stdout: }, 2023-08-01T19:54:45.882 INFO:teuthology.orchestra.run.smithi008.stdout: { 2023-08-01T19:54:45.882 INFO:teuthology.orchestra.run.smithi008.stdout: "event": "throttled", 2023-08-01T19:54:45.882 INFO:teuthology.orchestra.run.smithi008.stdout: "time": "2023-08-01T19:54:38.039696+0000", 2023-08-01T19:54:45.882 INFO:teuthology.orchestra.run.smithi008.stdout: "duration": 0 2023-08-01T19:54:45.882 INFO:teuthology.orchestra.run.smithi008.stdout: }, 2023-08-01T19:54:45.882 INFO:teuthology.orchestra.run.smithi008.stdout: { 2023-08-01T19:54:45.882 INFO:teuthology.orchestra.run.smithi008.stdout: "event": "header_read", 2023-08-01T19:54:45.883 INFO:teuthology.orchestra.run.smithi008.stdout: "time": "2023-08-01T19:54:38.039695+0000", 2023-08-01T19:54:45.883 INFO:teuthology.orchestra.run.smithi008.stdout: "duration": 4294967295.999999 2023-08-01T19:54:45.883 INFO:teuthology.orchestra.run.smithi008.stdout: }, 2023-08-01T19:54:45.883 INFO:teuthology.orchestra.run.smithi008.stdout: { 2023-08-01T19:54:45.883 INFO:teuthology.orchestra.run.smithi008.stdout: "event": "all_read", 2023-08-01T19:54:45.883 INFO:teuthology.orchestra.run.smithi008.stdout: "time": "2023-08-01T19:54:38.039788+0000", 2023-08-01T19:54:45.883 INFO:teuthology.orchestra.run.smithi008.stdout: "duration": 9.2497999999999994e-05 2023-08-01T19:54:45.883 INFO:teuthology.orchestra.run.smithi008.stdout: }, 2023-08-01T19:54:45.884 INFO:teuthology.orchestra.run.smithi008.stdout: { 2023-08-01T19:54:45.884 INFO:teuthology.orchestra.run.smithi008.stdout: "event": "dispatched", 2023-08-01T19:54:45.884 INFO:teuthology.orchestra.run.smithi008.stdout: "time": "2023-08-01T19:54:38.039797+0000", 2023-08-01T19:54:45.884 INFO:teuthology.orchestra.run.smithi008.stdout: "duration": 8.9940000000000006e-06 2023-08-01T19:54:45.884 INFO:teuthology.orchestra.run.smithi008.stdout: }, 2023-08-01T19:54:45.884 INFO:teuthology.orchestra.run.smithi008.stdout: { 2023-08-01T19:54:45.884 INFO:teuthology.orchestra.run.smithi008.stdout: "event": "queued_for_pg", 2023-08-01T19:54:45.884 INFO:teuthology.orchestra.run.smithi008.stdout: "time": "2023-08-01T19:54:38.039802+0000", 2023-08-01T19:54:45.885 INFO:teuthology.orchestra.run.smithi008.stdout: "duration": 4.9320000000000004e-06 2023-08-01T19:54:45.885 INFO:teuthology.orchestra.run.smithi008.stdout: }, 2023-08-01T19:54:45.885 INFO:teuthology.orchestra.run.smithi008.stdout: { 2023-08-01T19:54:45.885 INFO:teuthology.orchestra.run.smithi008.stdout: "event": "reached_pg", 2023-08-01T19:54:45.885 INFO:teuthology.orchestra.run.smithi008.stdout: "time": "2023-08-01T19:54:38.042629+0000", 2023-08-01T19:54:45.885 INFO:teuthology.orchestra.run.smithi008.stdout: "duration": 0.0028275829999999998 2023-08-01T19:54:45.885 INFO:teuthology.orchestra.run.smithi008.stdout: }, 2023-08-01T19:54:45.885 INFO:teuthology.orchestra.run.smithi008.stdout: { 2023-08-01T19:54:45.886 INFO:teuthology.orchestra.run.smithi008.stdout: "event": "started", 2023-08-01T19:54:45.886 INFO:teuthology.orchestra.run.smithi008.stdout: "time": "2023-08-01T19:54:38.042726+0000", 2023-08-01T19:54:45.886 INFO:teuthology.orchestra.run.smithi008.stdout: "duration": 9.6521999999999995e-05 2023-08-01T19:54:45.886 INFO:teuthology.orchestra.run.smithi008.stdout: }, 2023-08-01T19:54:45.886 INFO:teuthology.orchestra.run.smithi008.stdout: { 2023-08-01T19:54:45.886 INFO:teuthology.orchestra.run.smithi008.stdout: "event": "waiting for subops from 1", 2023-08-01T19:54:45.886 INFO:teuthology.orchestra.run.smithi008.stdout: "time": "2023-08-01T19:54:38.042826+0000", 2023-08-01T19:54:45.887 INFO:teuthology.orchestra.run.smithi008.stdout: "duration": 9.9599000000000006e-05 2023-08-01T19:54:45.887 INFO:teuthology.orchestra.run.smithi008.stdout: }, 2023-08-01T19:54:45.887 INFO:teuthology.orchestra.run.smithi008.stdout: { 2023-08-01T19:54:45.887 INFO:teuthology.orchestra.run.smithi008.stdout: "event": "op_commit", 2023-08-01T19:54:45.887 INFO:teuthology.orchestra.run.smithi008.stdout: "time": "2023-08-01T19:54:38.046226+0000", 2023-08-01T19:54:45.887 INFO:teuthology.orchestra.run.smithi008.stdout: "duration": 0.0034001629999999999 2023-08-01T19:54:45.887 INFO:teuthology.orchestra.run.smithi008.stdout: }, 2023-08-01T19:54:45.887 INFO:teuthology.orchestra.run.smithi008.stdout: { 2023-08-01T19:54:45.888 INFO:teuthology.orchestra.run.smithi008.stdout: "event": "sub_op_commit_rec", 2023-08-01T19:54:45.888 INFO:teuthology.orchestra.run.smithi008.stdout: "time": "2023-08-01T19:54:38.052858+0000", 2023-08-01T19:54:45.888 INFO:teuthology.orchestra.run.smithi008.stdout: "duration": 0.0066322559999999996 2023-08-01T19:54:45.888 INFO:teuthology.orchestra.run.smithi008.stdout: }, 2023-08-01T19:54:45.888 INFO:teuthology.orchestra.run.smithi008.stdout: { 2023-08-01T19:54:45.888 INFO:teuthology.orchestra.run.smithi008.stdout: "event": "commit_sent", 2023-08-01T19:54:45.888 INFO:teuthology.orchestra.run.smithi008.stdout: "time": "2023-08-01T19:54:38.052907+0000", 2023-08-01T19:54:45.888 INFO:teuthology.orchestra.run.smithi008.stdout: "duration": 4.8952000000000002e-05 2023-08-01T19:54:45.889 INFO:teuthology.orchestra.run.smithi008.stdout: }, 2023-08-01T19:54:45.889 INFO:teuthology.orchestra.run.smithi008.stdout: { 2023-08-01T19:54:45.889 INFO:teuthology.orchestra.run.smithi008.stdout: "event": "done", 2023-08-01T19:54:45.889 INFO:teuthology.orchestra.run.smithi008.stdout: "time": "2023-08-01T19:54:38.052944+0000", 2023-08-01T19:54:45.889 INFO:teuthology.orchestra.run.smithi008.stdout: "duration": 3.7172999999999998e-05 2023-08-01T19:54:45.889 INFO:teuthology.orchestra.run.smithi008.stdout: } 2023-08-01T19:54:45.889 INFO:teuthology.orchestra.run.smithi008.stdout: ] 2023-08-01T19:54:45.889 INFO:teuthology.orchestra.run.smithi008.stdout: } 2023-08-01T19:54:45.890 INFO:teuthology.orchestra.run.smithi008.stdout: }, 2023-08-01T19:54:45.890 INFO:teuthology.orchestra.run.smithi008.stdout: { 2023-08-01T19:54:45.890 INFO:teuthology.orchestra.run.smithi008.stdout: "description": "osd_op(client.4668.0:52189 5.a 5:5868cda2:::benchmark_data_smithi006_114134_object52188:head [set-alloc-hint object_size 65536 write_size 65536,write 0~65536] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e27)", 2023-08-01T19:54:45.890 INFO:teuthology.orchestra.run.smithi008.stdout: "initiated_at": "2023-08-01T19:54:41.259379+0000", 2023-08-01T19:54:45.890 INFO:teuthology.orchestra.run.smithi008.stdout: "age": 4.4952353509999998, 2023-08-01T19:54:45.890 INFO:teuthology.orchestra.run.smithi008.stdout: "duration": 0.014704129999999999, 2023-08-01T19:54:45.890 INFO:teuthology.orchestra.run.smithi008.stdout: "type_data": { 2023-08-01T19:54:45.890 INFO:teuthology.orchestra.run.smithi008.stdout: "flag_point": "commit sent; apply or cleanup", 2023-08-01T19:54:45.891 INFO:teuthology.orchestra.run.smithi008.stdout: "client_info": { 2023-08-01T19:54:45.891 INFO:teuthology.orchestra.run.smithi008.stdout: "client": "client.4668", 2023-08-01T19:54:45.891 INFO:teuthology.orchestra.run.smithi008.stdout: "client_addr": "172.21.15.6:0/1709472247", 2023-08-01T19:54:45.891 INFO:teuthology.orchestra.run.smithi008.stdout: "tid": 52189 2023-08-01T19:54:45.891 INFO:teuthology.orchestra.run.smithi008.stdout: }, 2023-08-01T19:54:45.891 INFO:teuthology.orchestra.run.smithi008.stdout: "events": [ 2023-08-01T19:54:45.891 INFO:teuthology.orchestra.run.smithi008.stdout: { 2023-08-01T19:54:45.891 INFO:teuthology.orchestra.run.smithi008.stdout: "event": "initiated", 2023-08-01T19:54:45.892 INFO:teuthology.orchestra.run.smithi008.stdout: "time": "2023-08-01T19:54:41.259379+0000", 2023-08-01T19:54:45.892 INFO:teuthology.orchestra.run.smithi008.stdout: "duration": 0 2023-08-01T19:54:45.892 INFO:teuthology.orchestra.run.smithi008.stdout: }, 2023-08-01T19:54:45.892 INFO:teuthology.orchestra.run.smithi008.stdout: { 2023-08-01T19:54:45.892 INFO:teuthology.orchestra.run.smithi008.stdout: "event": "throttled", 2023-08-01T19:54:45.892 INFO:teuthology.orchestra.run.smithi008.stdout: "time": "2023-08-01T19:54:41.259379+0000", 2023-08-01T19:54:45.892 INFO:teuthology.orchestra.run.smithi008.stdout: "duration": 0 2023-08-01T19:54:45.892 INFO:teuthology.orchestra.run.smithi008.stdout: }, 2023-08-01T19:54:45.893 INFO:teuthology.orchestra.run.smithi008.stdout: { 2023-08-01T19:54:45.893 INFO:teuthology.orchestra.run.smithi008.stdout: "event": "header_read", 2023-08-01T19:54:45.893 INFO:teuthology.orchestra.run.smithi008.stdout: "time": "2023-08-01T19:54:41.259379+0000", 2023-08-01T19:54:45.893 INFO:teuthology.orchestra.run.smithi008.stdout: "duration": 4294967295.9999995 2023-08-01T19:54:45.893 INFO:teuthology.orchestra.run.smithi008.stdout: }, 2023-08-01T19:54:45.893 INFO:teuthology.orchestra.run.smithi008.stdout: { 2023-08-01T19:54:45.893 INFO:teuthology.orchestra.run.smithi008.stdout: "event": "all_read", 2023-08-01T19:54:45.893 INFO:teuthology.orchestra.run.smithi008.stdout: "time": "2023-08-01T19:54:41.259417+0000", 2023-08-01T19:54:45.894 INFO:teuthology.orchestra.run.smithi008.stdout: "duration": 3.7667999999999999e-05 2023-08-01T19:54:45.894 INFO:teuthology.orchestra.run.smithi008.stdout: }, 2023-08-01T19:54:45.894 INFO:teuthology.orchestra.run.smithi008.stdout: { 2023-08-01T19:54:45.894 INFO:teuthology.orchestra.run.smithi008.stdout: "event": "dispatched", 2023-08-01T19:54:45.894 INFO:teuthology.orchestra.run.smithi008.stdout: "time": "2023-08-01T19:54:41.259427+0000", 2023-08-01T19:54:45.894 INFO:teuthology.orchestra.run.smithi008.stdout: "duration": 9.9289999999999993e-06 2023-08-01T19:54:45.894 INFO:teuthology.orchestra.run.smithi008.stdout: }, 2023-08-01T19:54:45.894 INFO:teuthology.orchestra.run.smithi008.stdout: { 2023-08-01T19:54:45.895 INFO:teuthology.orchestra.run.smithi008.stdout: "event": "queued_for_pg", 2023-08-01T19:54:45.895 INFO:teuthology.orchestra.run.smithi008.stdout: "time": "2023-08-01T19:54:41.259432+0000", 2023-08-01T19:54:45.895 INFO:teuthology.orchestra.run.smithi008.stdout: "duration": 5.0509999999999996e-06 2023-08-01T19:54:45.895 INFO:teuthology.orchestra.run.smithi008.stdout: }, 2023-08-01T19:54:45.895 INFO:teuthology.orchestra.run.smithi008.stdout: { 2023-08-01T19:54:45.895 INFO:teuthology.orchestra.run.smithi008.stdout: "event": "reached_pg", 2023-08-01T19:54:45.895 INFO:teuthology.orchestra.run.smithi008.stdout: "time": "2023-08-01T19:54:41.261308+0000", 2023-08-01T19:54:45.895 INFO:teuthology.orchestra.run.smithi008.stdout: "duration": 0.0018767619999999999 2023-08-01T19:54:45.896 INFO:teuthology.orchestra.run.smithi008.stdout: }, 2023-08-01T19:54:45.896 INFO:teuthology.orchestra.run.smithi008.stdout: { 2023-08-01T19:54:45.896 INFO:teuthology.orchestra.run.smithi008.stdout: "event": "started", 2023-08-01T19:54:45.896 INFO:teuthology.orchestra.run.smithi008.stdout: "time": "2023-08-01T19:54:41.261462+0000", 2023-08-01T19:54:45.896 INFO:teuthology.orchestra.run.smithi008.stdout: "duration": 0.00015356300000000001 2023-08-01T19:54:45.896 INFO:teuthology.orchestra.run.smithi008.stdout: }, 2023-08-01T19:54:45.896 INFO:teuthology.orchestra.run.smithi008.stdout: { 2023-08-01T19:54:45.897 INFO:teuthology.orchestra.run.smithi008.stdout: "event": "waiting for subops from 2", 2023-08-01T19:54:45.897 INFO:teuthology.orchestra.run.smithi008.stdout: "time": "2023-08-01T19:54:41.261598+0000", 2023-08-01T19:54:45.897 INFO:teuthology.orchestra.run.smithi008.stdout: "duration": 0.000136487 2023-08-01T19:54:45.897 INFO:teuthology.orchestra.run.smithi008.stdout: }, 2023-08-01T19:54:45.897 INFO:teuthology.orchestra.run.smithi008.stdout: { 2023-08-01T19:54:45.897 INFO:teuthology.orchestra.run.smithi008.stdout: "event": "op_commit", 2023-08-01T19:54:45.897 INFO:teuthology.orchestra.run.smithi008.stdout: "time": "2023-08-01T19:54:41.268183+0000", 2023-08-01T19:54:45.897 INFO:teuthology.orchestra.run.smithi008.stdout: "duration": 0.0065849929999999999 2023-08-01T19:54:45.898 INFO:teuthology.orchestra.run.smithi008.stdout: }, 2023-08-01T19:54:45.898 INFO:teuthology.orchestra.run.smithi008.stdout: { 2023-08-01T19:54:45.898 INFO:teuthology.orchestra.run.smithi008.stdout: "event": "sub_op_commit_rec", 2023-08-01T19:54:45.898 INFO:teuthology.orchestra.run.smithi008.stdout: "time": "2023-08-01T19:54:41.273975+0000", 2023-08-01T19:54:45.898 INFO:teuthology.orchestra.run.smithi008.stdout: "duration": 0.0057916449999999998 2023-08-01T19:54:45.898 INFO:teuthology.orchestra.run.smithi008.stdout: }, 2023-08-01T19:54:45.898 INFO:teuthology.orchestra.run.smithi008.stdout: { 2023-08-01T19:54:45.898 INFO:teuthology.orchestra.run.smithi008.stdout: "event": "commit_sent", 2023-08-01T19:54:45.899 INFO:teuthology.orchestra.run.smithi008.stdout: "time": "2023-08-01T19:54:41.274042+0000", 2023-08-01T19:54:45.899 INFO:teuthology.orchestra.run.smithi008.stdout: "duration": 6.6531000000000004e-05 2023-08-01T19:54:45.899 INFO:teuthology.orchestra.run.smithi008.stdout: }, 2023-08-01T19:54:45.899 INFO:teuthology.orchestra.run.smithi008.stdout: { 2023-08-01T19:54:45.899 INFO:teuthology.orchestra.run.smithi008.stdout: "event": "done", 2023-08-01T19:54:45.899 INFO:teuthology.orchestra.run.smithi008.stdout: "time": "2023-08-01T19:54:41.274084+0000", 2023-08-01T19:54:45.899 INFO:teuthology.orchestra.run.smithi008.stdout: "duration": 4.2021999999999998e-05 2023-08-01T19:54:45.899 INFO:teuthology.orchestra.run.smithi008.stdout: } 2023-08-01T19:54:45.900 INFO:teuthology.orchestra.run.smithi008.stdout: ] 2023-08-01T19:54:45.900 INFO:teuthology.orchestra.run.smithi008.stdout: } 2023-08-01T19:54:45.900 INFO:teuthology.orchestra.run.smithi008.stdout: }, 2023-08-01T19:54:45.900 INFO:teuthology.orchestra.run.smithi008.stdout: { 2023-08-01T19:54:45.900 INFO:teuthology.orchestra.run.smithi008.stdout: "description": "osd_op(client.4668.0:52275 5.a 5:56383264:::benchmark_data_smithi006_114134_object52274:head [set-alloc-hint object_size 65536 write_size 65536,write 0~65536] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e27)", 2023-08-01T19:54:45.900 INFO:teuthology.orchestra.run.smithi008.stdout: "initiated_at": "2023-08-01T19:54:41.299219+0000", 2023-08-01T19:54:45.900 INFO:teuthology.orchestra.run.smithi008.stdout: "age": 4.4553960349999997, 2023-08-01T19:54:45.900 INFO:teuthology.orchestra.run.smithi008.stdout: "duration": 0.013777899, 2023-08-01T19:54:45.901 INFO:teuthology.orchestra.run.smithi008.stdout: "type_data": { 2023-08-01T19:54:45.901 INFO:teuthology.orchestra.run.smithi008.stdout: "flag_point": "commit sent; apply or cleanup", 2023-08-01T19:54:45.901 INFO:teuthology.orchestra.run.smithi008.stdout: "client_info": { 2023-08-01T19:54:45.901 INFO:teuthology.orchestra.run.smithi008.stdout: "client": "client.4668", 2023-08-01T19:54:45.901 INFO:teuthology.orchestra.run.smithi008.stdout: "client_addr": "172.21.15.6:0/1709472247", 2023-08-01T19:54:45.901 INFO:teuthology.orchestra.run.smithi008.stdout: "tid": 52275 2023-08-01T19:54:45.901 INFO:teuthology.orchestra.run.smithi008.stdout: }, 2023-08-01T19:54:45.901 INFO:teuthology.orchestra.run.smithi008.stdout: "events": [ 2023-08-01T19:54:45.902 INFO:teuthology.orchestra.run.smithi008.stdout: { 2023-08-01T19:54:45.902 INFO:teuthology.orchestra.run.smithi008.stdout: "event": "initiated", 2023-08-01T19:54:45.902 INFO:teuthology.orchestra.run.smithi008.stdout: "time": "2023-08-01T19:54:41.299219+0000", 2023-08-01T19:54:45.902 INFO:teuthology.orchestra.run.smithi008.stdout: "duration": 0 2023-08-01T19:54:45.902 INFO:teuthology.orchestra.run.smithi008.stdout: }, 2023-08-01T19:54:45.902 INFO:teuthology.orchestra.run.smithi008.stdout: { 2023-08-01T19:54:45.902 INFO:teuthology.orchestra.run.smithi008.stdout: "event": "throttled", 2023-08-01T19:54:45.902 INFO:teuthology.orchestra.run.smithi008.stdout: "time": "2023-08-01T19:54:41.299219+0000", 2023-08-01T19:54:45.903 INFO:teuthology.orchestra.run.smithi008.stdout: "duration": 0 2023-08-01T19:54:45.903 INFO:teuthology.orchestra.run.smithi008.stdout: }, 2023-08-01T19:54:45.903 INFO:teuthology.orchestra.run.smithi008.stdout: { 2023-08-01T19:54:45.903 INFO:teuthology.orchestra.run.smithi008.stdout: "event": "header_read", 2023-08-01T19:54:45.903 INFO:teuthology.orchestra.run.smithi008.stdout: "time": "2023-08-01T19:54:41.299218+0000", 2023-08-01T19:54:45.903 INFO:teuthology.orchestra.run.smithi008.stdout: "duration": 4294967295.999999 2023-08-01T19:54:45.903 INFO:teuthology.orchestra.run.smithi008.stdout: }, 2023-08-01T19:54:45.904 INFO:teuthology.orchestra.run.smithi008.stdout: { 2023-08-01T19:54:45.904 INFO:teuthology.orchestra.run.smithi008.stdout: "event": "all_read", 2023-08-01T19:54:45.904 INFO:teuthology.orchestra.run.smithi008.stdout: "time": "2023-08-01T19:54:41.299278+0000", 2023-08-01T19:54:45.904 INFO:teuthology.orchestra.run.smithi008.stdout: "duration": 6.0229000000000002e-05 2023-08-01T19:54:45.904 INFO:teuthology.orchestra.run.smithi008.stdout: }, 2023-08-01T19:54:45.904 INFO:teuthology.orchestra.run.smithi008.stdout: { 2023-08-01T19:54:45.904 INFO:teuthology.orchestra.run.smithi008.stdout: "event": "dispatched", 2023-08-01T19:54:45.904 INFO:teuthology.orchestra.run.smithi008.stdout: "time": "2023-08-01T19:54:41.299290+0000", 2023-08-01T19:54:45.905 INFO:teuthology.orchestra.run.smithi008.stdout: "duration": 1.1567e-05 2023-08-01T19:54:45.905 INFO:teuthology.orchestra.run.smithi008.stdout: }, 2023-08-01T19:54:45.905 INFO:teuthology.orchestra.run.smithi008.stdout: { 2023-08-01T19:54:45.905 INFO:teuthology.orchestra.run.smithi008.stdout: "event": "queued_for_pg", 2023-08-01T19:54:45.905 INFO:teuthology.orchestra.run.smithi008.stdout: "time": "2023-08-01T19:54:41.299295+0000", 2023-08-01T19:54:45.905 INFO:teuthology.orchestra.run.smithi008.stdout: "duration": 5.4389999999999999e-06 2023-08-01T19:54:45.905 INFO:teuthology.orchestra.run.smithi008.stdout: }, 2023-08-01T19:54:45.905 INFO:teuthology.orchestra.run.smithi008.stdout: { 2023-08-01T19:54:45.906 INFO:teuthology.orchestra.run.smithi008.stdout: "event": "reached_pg", 2023-08-01T19:54:45.906 INFO:teuthology.orchestra.run.smithi008.stdout: "time": "2023-08-01T19:54:41.306435+0000", 2023-08-01T19:54:45.906 INFO:teuthology.orchestra.run.smithi008.stdout: "duration": 0.0071394249999999996 2023-08-01T19:54:45.906 INFO:teuthology.orchestra.run.smithi008.stdout: }, 2023-08-01T19:54:45.906 INFO:teuthology.orchestra.run.smithi008.stdout: { 2023-08-01T19:54:45.906 INFO:teuthology.orchestra.run.smithi008.stdout: "event": "started", 2023-08-01T19:54:45.906 INFO:teuthology.orchestra.run.smithi008.stdout: "time": "2023-08-01T19:54:41.306579+0000", 2023-08-01T19:54:45.906 INFO:teuthology.orchestra.run.smithi008.stdout: "duration": 0.00014404199999999999 2023-08-01T19:54:45.907 INFO:teuthology.orchestra.run.smithi008.stdout: }, 2023-08-01T19:54:45.907 INFO:teuthology.orchestra.run.smithi008.stdout: { 2023-08-01T19:54:45.907 INFO:teuthology.orchestra.run.smithi008.stdout: "event": "waiting for subops from 2", 2023-08-01T19:54:45.907 INFO:teuthology.orchestra.run.smithi008.stdout: "time": "2023-08-01T19:54:41.306719+0000", 2023-08-01T19:54:45.907 INFO:teuthology.orchestra.run.smithi008.stdout: "duration": 0.000140192 2023-08-01T19:54:45.907 INFO:teuthology.orchestra.run.smithi008.stdout: }, 2023-08-01T19:54:45.907 INFO:teuthology.orchestra.run.smithi008.stdout: { 2023-08-01T19:54:45.907 INFO:teuthology.orchestra.run.smithi008.stdout: "event": "sub_op_commit_rec", 2023-08-01T19:54:45.908 INFO:teuthology.orchestra.run.smithi008.stdout: "time": "2023-08-01T19:54:41.312464+0000", 2023-08-01T19:54:45.908 INFO:teuthology.orchestra.run.smithi008.stdout: "duration": 0.0057454580000000002 2023-08-01T19:54:45.908 INFO:teuthology.orchestra.run.smithi008.stdout: }, 2023-08-01T19:54:45.908 INFO:teuthology.orchestra.run.smithi008.stdout: { 2023-08-01T19:54:45.908 INFO:teuthology.orchestra.run.smithi008.stdout: "event": "op_commit", 2023-08-01T19:54:45.908 INFO:teuthology.orchestra.run.smithi008.stdout: "time": "2023-08-01T19:54:41.312917+0000", 2023-08-01T19:54:45.908 INFO:teuthology.orchestra.run.smithi008.stdout: "duration": 0.00045283200000000002 2023-08-01T19:54:45.909 INFO:teuthology.orchestra.run.smithi008.stdout: }, 2023-08-01T19:54:45.909 INFO:teuthology.orchestra.run.smithi008.stdout: { 2023-08-01T19:54:45.909 INFO:teuthology.orchestra.run.smithi008.stdout: "event": "commit_sent", 2023-08-01T19:54:45.909 INFO:teuthology.orchestra.run.smithi008.stdout: "time": "2023-08-01T19:54:41.312959+0000", 2023-08-01T19:54:45.909 INFO:teuthology.orchestra.run.smithi008.stdout: "duration": 4.2314999999999997e-05 2023-08-01T19:54:45.909 INFO:teuthology.orchestra.run.smithi008.stdout: }, 2023-08-01T19:54:45.909 INFO:teuthology.orchestra.run.smithi008.stdout: { 2023-08-01T19:54:45.909 INFO:teuthology.orchestra.run.smithi008.stdout: "event": "done", 2023-08-01T19:54:45.910 INFO:teuthology.orchestra.run.smithi008.stdout: "time": "2023-08-01T19:54:41.312997+0000", 2023-08-01T19:54:45.910 INFO:teuthology.orchestra.run.smithi008.stdout: "duration": 3.7270000000000001e-05 2023-08-01T19:54:45.910 INFO:teuthology.orchestra.run.smithi008.stdout: } 2023-08-01T19:54:45.910 INFO:teuthology.orchestra.run.smithi008.stdout: ] 2023-08-01T19:54:45.910 INFO:teuthology.orchestra.run.smithi008.stdout: } 2023-08-01T19:54:45.910 INFO:teuthology.orchestra.run.smithi008.stdout: }, 2023-08-01T19:54:45.910 INFO:teuthology.orchestra.run.smithi008.stdout: { 2023-08-01T19:54:45.910 INFO:teuthology.orchestra.run.smithi008.stdout: "description": "osd_op(client.4668.0:52279 5.a 5:5a05bb19:::benchmark_data_smithi006_114134_object52278:head [set-alloc-hint object_size 65536 write_size 65536,write 0~65536] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e27)", 2023-08-01T19:54:45.911 INFO:teuthology.orchestra.run.smithi008.stdout: "initiated_at": "2023-08-01T19:54:41.301770+0000", 2023-08-01T19:54:45.911 INFO:teuthology.orchestra.run.smithi008.stdout: "age": 4.4528445569999997, 2023-08-01T19:54:45.911 INFO:teuthology.orchestra.run.smithi008.stdout: "duration": 0.01372922, 2023-08-01T19:54:45.911 INFO:teuthology.orchestra.run.smithi008.stdout: "type_data": { 2023-08-01T19:54:45.911 INFO:teuthology.orchestra.run.smithi008.stdout: "flag_point": "commit sent; apply or cleanup", 2023-08-01T19:54:45.911 INFO:teuthology.orchestra.run.smithi008.stdout: "client_info": { 2023-08-01T19:54:45.911 INFO:teuthology.orchestra.run.smithi008.stdout: "client": "client.4668", 2023-08-01T19:54:45.911 INFO:teuthology.orchestra.run.smithi008.stdout: "client_addr": "172.21.15.6:0/1709472247", 2023-08-01T19:54:45.912 INFO:teuthology.orchestra.run.smithi008.stdout: "tid": 52279 2023-08-01T19:54:45.912 INFO:teuthology.orchestra.run.smithi008.stdout: }, 2023-08-01T19:54:45.912 INFO:teuthology.orchestra.run.smithi008.stdout: "events": [ 2023-08-01T19:54:45.912 INFO:teuthology.orchestra.run.smithi008.stdout: { 2023-08-01T19:54:45.912 INFO:teuthology.orchestra.run.smithi008.stdout: "event": "initiated", 2023-08-01T19:54:45.912 INFO:teuthology.orchestra.run.smithi008.stdout: "time": "2023-08-01T19:54:41.301770+0000", 2023-08-01T19:54:45.912 INFO:teuthology.orchestra.run.smithi008.stdout: "duration": 0 2023-08-01T19:54:45.912 INFO:teuthology.orchestra.run.smithi008.stdout: }, 2023-08-01T19:54:45.913 INFO:teuthology.orchestra.run.smithi008.stdout: { 2023-08-01T19:54:45.913 INFO:teuthology.orchestra.run.smithi008.stdout: "event": "throttled", 2023-08-01T19:54:45.913 INFO:teuthology.orchestra.run.smithi008.stdout: "time": "2023-08-01T19:54:41.301770+0000", 2023-08-01T19:54:45.913 INFO:teuthology.orchestra.run.smithi008.stdout: "duration": 0 2023-08-01T19:54:45.913 INFO:teuthology.orchestra.run.smithi008.stdout: }, 2023-08-01T19:54:45.913 INFO:teuthology.orchestra.run.smithi008.stdout: { 2023-08-01T19:54:45.913 INFO:teuthology.orchestra.run.smithi008.stdout: "event": "header_read", 2023-08-01T19:54:45.913 INFO:teuthology.orchestra.run.smithi008.stdout: "time": "2023-08-01T19:54:41.301769+0000", 2023-08-01T19:54:45.914 INFO:teuthology.orchestra.run.smithi008.stdout: "duration": 4294967295.999999 2023-08-01T19:54:45.914 INFO:teuthology.orchestra.run.smithi008.stdout: }, 2023-08-01T19:54:45.914 INFO:teuthology.orchestra.run.smithi008.stdout: { 2023-08-01T19:54:45.914 INFO:teuthology.orchestra.run.smithi008.stdout: "event": "all_read", 2023-08-01T19:54:45.914 INFO:teuthology.orchestra.run.smithi008.stdout: "time": "2023-08-01T19:54:41.301848+0000", 2023-08-01T19:54:45.914 INFO:teuthology.orchestra.run.smithi008.stdout: "duration": 7.8523999999999996e-05 2023-08-01T19:54:45.914 INFO:teuthology.orchestra.run.smithi008.stdout: }, 2023-08-01T19:54:45.914 INFO:teuthology.orchestra.run.smithi008.stdout: { 2023-08-01T19:54:45.915 INFO:teuthology.orchestra.run.smithi008.stdout: "event": "dispatched", 2023-08-01T19:54:45.915 INFO:teuthology.orchestra.run.smithi008.stdout: "time": "2023-08-01T19:54:41.301859+0000", 2023-08-01T19:54:45.915 INFO:teuthology.orchestra.run.smithi008.stdout: "duration": 1.1287000000000001e-05 2023-08-01T19:54:45.915 INFO:teuthology.orchestra.run.smithi008.stdout: }, 2023-08-01T19:54:45.915 INFO:teuthology.orchestra.run.smithi008.stdout: { 2023-08-01T19:54:45.915 INFO:teuthology.orchestra.run.smithi008.stdout: "event": "queued_for_pg", 2023-08-01T19:54:45.915 INFO:teuthology.orchestra.run.smithi008.stdout: "time": "2023-08-01T19:54:41.301865+0000", 2023-08-01T19:54:45.916 INFO:teuthology.orchestra.run.smithi008.stdout: "duration": 6.472e-06 2023-08-01T19:54:45.916 INFO:teuthology.orchestra.run.smithi008.stdout: }, 2023-08-01T19:54:45.916 INFO:teuthology.orchestra.run.smithi008.stdout: { 2023-08-01T19:54:45.916 INFO:teuthology.orchestra.run.smithi008.stdout: "event": "reached_pg", 2023-08-01T19:54:45.916 INFO:teuthology.orchestra.run.smithi008.stdout: "time": "2023-08-01T19:54:41.308524+0000", 2023-08-01T19:54:45.916 INFO:teuthology.orchestra.run.smithi008.stdout: "duration": 0.0066583570000000002 2023-08-01T19:54:45.916 INFO:teuthology.orchestra.run.smithi008.stdout: }, 2023-08-01T19:54:45.916 INFO:teuthology.orchestra.run.smithi008.stdout: { 2023-08-01T19:54:45.917 INFO:teuthology.orchestra.run.smithi008.stdout: "event": "started", 2023-08-01T19:54:45.917 INFO:teuthology.orchestra.run.smithi008.stdout: "time": "2023-08-01T19:54:41.308617+0000", 2023-08-01T19:54:45.917 INFO:teuthology.orchestra.run.smithi008.stdout: "duration": 9.2938999999999999e-05 2023-08-01T19:54:45.917 INFO:teuthology.orchestra.run.smithi008.stdout: }, 2023-08-01T19:54:45.917 INFO:teuthology.orchestra.run.smithi008.stdout: { 2023-08-01T19:54:45.917 INFO:teuthology.orchestra.run.smithi008.stdout: "event": "waiting for subops from 2", 2023-08-01T19:54:45.917 INFO:teuthology.orchestra.run.smithi008.stdout: "time": "2023-08-01T19:54:41.308721+0000", 2023-08-01T19:54:45.917 INFO:teuthology.orchestra.run.smithi008.stdout: "duration": 0.00010466 2023-08-01T19:54:45.918 INFO:teuthology.orchestra.run.smithi008.stdout: }, 2023-08-01T19:54:45.918 INFO:teuthology.orchestra.run.smithi008.stdout: { 2023-08-01T19:54:45.918 INFO:teuthology.orchestra.run.smithi008.stdout: "event": "sub_op_commit_rec", 2023-08-01T19:54:45.918 INFO:teuthology.orchestra.run.smithi008.stdout: "time": "2023-08-01T19:54:41.312767+0000", 2023-08-01T19:54:45.918 INFO:teuthology.orchestra.run.smithi008.stdout: "duration": 0.0040453970000000001 2023-08-01T19:54:45.918 INFO:teuthology.orchestra.run.smithi008.stdout: }, 2023-08-01T19:54:45.918 INFO:teuthology.orchestra.run.smithi008.stdout: { 2023-08-01T19:54:45.918 INFO:teuthology.orchestra.run.smithi008.stdout: "event": "op_commit", 2023-08-01T19:54:45.919 INFO:teuthology.orchestra.run.smithi008.stdout: "time": "2023-08-01T19:54:41.315399+0000", 2023-08-01T19:54:45.919 INFO:teuthology.orchestra.run.smithi008.stdout: "duration": 0.0026318549999999998 2023-08-01T19:54:45.919 INFO:teuthology.orchestra.run.smithi008.stdout: }, 2023-08-01T19:54:45.919 INFO:teuthology.orchestra.run.smithi008.stdout: { 2023-08-01T19:54:45.919 INFO:teuthology.orchestra.run.smithi008.stdout: "event": "commit_sent", 2023-08-01T19:54:45.919 INFO:teuthology.orchestra.run.smithi008.stdout: "time": "2023-08-01T19:54:41.315462+0000", 2023-08-01T19:54:45.919 INFO:teuthology.orchestra.run.smithi008.stdout: "duration": 6.3028999999999996e-05 2023-08-01T19:54:45.919 INFO:teuthology.orchestra.run.smithi008.stdout: }, 2023-08-01T19:54:45.920 INFO:teuthology.orchestra.run.smithi008.stdout: { 2023-08-01T19:54:45.920 INFO:teuthology.orchestra.run.smithi008.stdout: "event": "done", 2023-08-01T19:54:45.920 INFO:teuthology.orchestra.run.smithi008.stdout: "time": "2023-08-01T19:54:41.315500+0000", 2023-08-01T19:54:45.920 INFO:teuthology.orchestra.run.smithi008.stdout: "duration": 3.7774000000000001e-05 2023-08-01T19:54:45.920 INFO:teuthology.orchestra.run.smithi008.stdout: } 2023-08-01T19:54:45.920 INFO:teuthology.orchestra.run.smithi008.stdout: ] 2023-08-01T19:54:45.920 INFO:teuthology.orchestra.run.smithi008.stdout: } 2023-08-01T19:54:45.921 INFO:teuthology.orchestra.run.smithi008.stdout: }, 2023-08-01T19:54:45.921 INFO:teuthology.orchestra.run.smithi008.stdout: { 2023-08-01T19:54:45.921 INFO:teuthology.orchestra.run.smithi008.stdout: "description": "osd_op(client.4668.0:52311 5.3 5:c5923d66:::benchmark_data_smithi006_114134_object52310:head [set-alloc-hint object_size 65536 write_size 65536,write 0~65536] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e27)", 2023-08-01T19:54:45.921 INFO:teuthology.orchestra.run.smithi008.stdout: "initiated_at": "2023-08-01T19:54:41.317314+0000", 2023-08-01T19:54:45.921 INFO:teuthology.orchestra.run.smithi008.stdout: "age": 4.4373013029999999, 2023-08-01T19:54:45.921 INFO:teuthology.orchestra.run.smithi008.stdout: "duration": 0.013482193, 2023-08-01T19:54:45.921 INFO:teuthology.orchestra.run.smithi008.stdout: "type_data": { 2023-08-01T19:54:45.921 INFO:teuthology.orchestra.run.smithi008.stdout: "flag_point": "commit sent; apply or cleanup", 2023-08-01T19:54:45.922 INFO:teuthology.orchestra.run.smithi008.stdout: "client_info": { 2023-08-01T19:54:45.922 INFO:teuthology.orchestra.run.smithi008.stdout: "client": "client.4668", 2023-08-01T19:54:45.922 INFO:teuthology.orchestra.run.smithi008.stdout: "client_addr": "172.21.15.6:0/1709472247", 2023-08-01T19:54:45.922 INFO:teuthology.orchestra.run.smithi008.stdout: "tid": 52311 2023-08-01T19:54:45.922 INFO:teuthology.orchestra.run.smithi008.stdout: }, 2023-08-01T19:54:45.922 INFO:teuthology.orchestra.run.smithi008.stdout: "events": [ 2023-08-01T19:54:45.922 INFO:teuthology.orchestra.run.smithi008.stdout: { 2023-08-01T19:54:45.922 INFO:teuthology.orchestra.run.smithi008.stdout: "event": "initiated", 2023-08-01T19:54:45.923 INFO:teuthology.orchestra.run.smithi008.stdout: "time": "2023-08-01T19:54:41.317314+0000", 2023-08-01T19:54:45.923 INFO:teuthology.orchestra.run.smithi008.stdout: "duration": 0 2023-08-01T19:54:45.923 INFO:teuthology.orchestra.run.smithi008.stdout: }, 2023-08-01T19:54:45.923 INFO:teuthology.orchestra.run.smithi008.stdout: { 2023-08-01T19:54:45.923 INFO:teuthology.orchestra.run.smithi008.stdout: "event": "throttled", 2023-08-01T19:54:45.923 INFO:teuthology.orchestra.run.smithi008.stdout: "time": "2023-08-01T19:54:41.317314+0000", 2023-08-01T19:54:45.923 INFO:teuthology.orchestra.run.smithi008.stdout: "duration": 0 2023-08-01T19:54:45.923 INFO:teuthology.orchestra.run.smithi008.stdout: }, 2023-08-01T19:54:45.924 INFO:teuthology.orchestra.run.smithi008.stdout: { 2023-08-01T19:54:45.924 INFO:teuthology.orchestra.run.smithi008.stdout: "event": "header_read", 2023-08-01T19:54:45.924 INFO:teuthology.orchestra.run.smithi008.stdout: "time": "2023-08-01T19:54:41.317313+0000", 2023-08-01T19:54:45.924 INFO:teuthology.orchestra.run.smithi008.stdout: "duration": 4294967295.9999995 2023-08-01T19:54:45.924 INFO:teuthology.orchestra.run.smithi008.stdout: }, 2023-08-01T19:54:45.924 INFO:teuthology.orchestra.run.smithi008.stdout: { 2023-08-01T19:54:45.924 INFO:teuthology.orchestra.run.smithi008.stdout: "event": "all_read", 2023-08-01T19:54:45.924 INFO:teuthology.orchestra.run.smithi008.stdout: "time": "2023-08-01T19:54:41.317341+0000", 2023-08-01T19:54:45.925 INFO:teuthology.orchestra.run.smithi008.stdout: "duration": 2.8129000000000001e-05 2023-08-01T19:54:45.925 INFO:teuthology.orchestra.run.smithi008.stdout: }, 2023-08-01T19:54:45.925 INFO:teuthology.orchestra.run.smithi008.stdout: { 2023-08-01T19:54:45.925 INFO:teuthology.orchestra.run.smithi008.stdout: "event": "dispatched", 2023-08-01T19:54:45.925 INFO:teuthology.orchestra.run.smithi008.stdout: "time": "2023-08-01T19:54:41.317353+0000", 2023-08-01T19:54:45.925 INFO:teuthology.orchestra.run.smithi008.stdout: "duration": 1.2224e-05 2023-08-01T19:54:45.925 INFO:teuthology.orchestra.run.smithi008.stdout: }, 2023-08-01T19:54:45.925 INFO:teuthology.orchestra.run.smithi008.stdout: { 2023-08-01T19:54:45.926 INFO:teuthology.orchestra.run.smithi008.stdout: "event": "queued_for_pg", 2023-08-01T19:54:45.926 INFO:teuthology.orchestra.run.smithi008.stdout: "time": "2023-08-01T19:54:41.317358+0000", 2023-08-01T19:54:45.926 INFO:teuthology.orchestra.run.smithi008.stdout: "duration": 4.5310000000000003e-06 2023-08-01T19:54:45.926 INFO:teuthology.orchestra.run.smithi008.stdout: }, 2023-08-01T19:54:45.926 INFO:teuthology.orchestra.run.smithi008.stdout: { 2023-08-01T19:54:45.926 INFO:teuthology.orchestra.run.smithi008.stdout: "event": "reached_pg", 2023-08-01T19:54:45.926 INFO:teuthology.orchestra.run.smithi008.stdout: "time": "2023-08-01T19:54:41.321331+0000", 2023-08-01T19:54:45.926 INFO:teuthology.orchestra.run.smithi008.stdout: "duration": 0.0039731640000000004 2023-08-01T19:54:45.927 INFO:teuthology.orchestra.run.smithi008.stdout: }, 2023-08-01T19:54:45.927 INFO:teuthology.orchestra.run.smithi008.stdout: { 2023-08-01T19:54:45.927 INFO:teuthology.orchestra.run.smithi008.stdout: "event": "started", 2023-08-01T19:54:45.927 INFO:teuthology.orchestra.run.smithi008.stdout: "time": "2023-08-01T19:54:41.321460+0000", 2023-08-01T19:54:45.927 INFO:teuthology.orchestra.run.smithi008.stdout: "duration": 0.000129362 2023-08-01T19:54:45.927 INFO:teuthology.orchestra.run.smithi008.stdout: }, 2023-08-01T19:54:45.927 INFO:teuthology.orchestra.run.smithi008.stdout: { 2023-08-01T19:54:45.928 INFO:teuthology.orchestra.run.smithi008.stdout: "event": "waiting for subops from 1", 2023-08-01T19:54:45.928 INFO:teuthology.orchestra.run.smithi008.stdout: "time": "2023-08-01T19:54:41.321608+0000", 2023-08-01T19:54:45.928 INFO:teuthology.orchestra.run.smithi008.stdout: "duration": 0.000147961 2023-08-01T19:54:45.928 INFO:teuthology.orchestra.run.smithi008.stdout: }, 2023-08-01T19:54:45.928 INFO:teuthology.orchestra.run.smithi008.stdout: { 2023-08-01T19:54:45.928 INFO:teuthology.orchestra.run.smithi008.stdout: "event": "op_commit", 2023-08-01T19:54:45.928 INFO:teuthology.orchestra.run.smithi008.stdout: "time": "2023-08-01T19:54:41.327594+0000", 2023-08-01T19:54:45.928 INFO:teuthology.orchestra.run.smithi008.stdout: "duration": 0.0059854749999999996 2023-08-01T19:54:45.929 INFO:teuthology.orchestra.run.smithi008.stdout: }, 2023-08-01T19:54:45.929 INFO:teuthology.orchestra.run.smithi008.stdout: { 2023-08-01T19:54:45.929 INFO:teuthology.orchestra.run.smithi008.stdout: "event": "sub_op_commit_rec", 2023-08-01T19:54:45.929 INFO:teuthology.orchestra.run.smithi008.stdout: "time": "2023-08-01T19:54:41.330716+0000", 2023-08-01T19:54:45.929 INFO:teuthology.orchestra.run.smithi008.stdout: "duration": 0.0031220369999999998 2023-08-01T19:54:45.929 INFO:teuthology.orchestra.run.smithi008.stdout: }, 2023-08-01T19:54:45.929 INFO:teuthology.orchestra.run.smithi008.stdout: { 2023-08-01T19:54:45.929 INFO:teuthology.orchestra.run.smithi008.stdout: "event": "commit_sent", 2023-08-01T19:54:45.930 INFO:teuthology.orchestra.run.smithi008.stdout: "time": "2023-08-01T19:54:41.330762+0000", 2023-08-01T19:54:45.930 INFO:teuthology.orchestra.run.smithi008.stdout: "duration": 4.5744000000000001e-05 2023-08-01T19:54:45.930 INFO:teuthology.orchestra.run.smithi008.stdout: }, 2023-08-01T19:54:45.930 INFO:teuthology.orchestra.run.smithi008.stdout: { 2023-08-01T19:54:45.930 INFO:teuthology.orchestra.run.smithi008.stdout: "event": "done", 2023-08-01T19:54:45.930 INFO:teuthology.orchestra.run.smithi008.stdout: "time": "2023-08-01T19:54:41.330796+0000", 2023-08-01T19:54:45.930 INFO:teuthology.orchestra.run.smithi008.stdout: "duration": 3.4229e-05 2023-08-01T19:54:45.930 INFO:teuthology.orchestra.run.smithi008.stdout: } 2023-08-01T19:54:45.931 INFO:teuthology.orchestra.run.smithi008.stdout: ] 2023-08-01T19:54:45.931 INFO:teuthology.orchestra.run.smithi008.stdout: } 2023-08-01T19:54:45.931 INFO:teuthology.orchestra.run.smithi008.stdout: }, 2023-08-01T19:54:45.931 INFO:teuthology.orchestra.run.smithi008.stdout: { 2023-08-01T19:54:45.931 INFO:teuthology.orchestra.run.smithi008.stdout: "description": "osd_op(client.4668.0:54277 5.3 5:c10b53a7:::benchmark_data_smithi006_114134_object54276:head [set-alloc-hint object_size 65536 write_size 65536,write 0~65536] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e27)", 2023-08-01T19:54:45.931 INFO:teuthology.orchestra.run.smithi008.stdout: "initiated_at": "2023-08-01T19:54:42.191670+0000", 2023-08-01T19:54:45.931 INFO:teuthology.orchestra.run.smithi008.stdout: "age": 3.5629447829999998, 2023-08-01T19:54:45.932 INFO:teuthology.orchestra.run.smithi008.stdout: "duration": 0.013932544999999999, 2023-08-01T19:54:45.932 INFO:teuthology.orchestra.run.smithi008.stdout: "type_data": { 2023-08-01T19:54:45.932 INFO:teuthology.orchestra.run.smithi008.stdout: "flag_point": "commit sent; apply or cleanup", 2023-08-01T19:54:45.932 INFO:teuthology.orchestra.run.smithi008.stdout: "client_info": { 2023-08-01T19:54:45.932 INFO:teuthology.orchestra.run.smithi008.stdout: "client": "client.4668", 2023-08-01T19:54:45.932 INFO:teuthology.orchestra.run.smithi008.stdout: "client_addr": "172.21.15.6:0/1709472247", 2023-08-01T19:54:45.932 INFO:teuthology.orchestra.run.smithi008.stdout: "tid": 54277 2023-08-01T19:54:45.932 INFO:teuthology.orchestra.run.smithi008.stdout: }, 2023-08-01T19:54:45.933 INFO:teuthology.orchestra.run.smithi008.stdout: "events": [ 2023-08-01T19:54:45.933 INFO:teuthology.orchestra.run.smithi008.stdout: { 2023-08-01T19:54:45.933 INFO:teuthology.orchestra.run.smithi008.stdout: "event": "initiated", 2023-08-01T19:54:45.933 INFO:teuthology.orchestra.run.smithi008.stdout: "time": "2023-08-01T19:54:42.191670+0000", 2023-08-01T19:54:45.933 INFO:teuthology.orchestra.run.smithi008.stdout: "duration": 0 2023-08-01T19:54:45.933 INFO:teuthology.orchestra.run.smithi008.stdout: }, 2023-08-01T19:54:45.933 INFO:teuthology.orchestra.run.smithi008.stdout: { 2023-08-01T19:54:45.933 INFO:teuthology.orchestra.run.smithi008.stdout: "event": "throttled", 2023-08-01T19:54:45.934 INFO:teuthology.orchestra.run.smithi008.stdout: "time": "2023-08-01T19:54:42.191670+0000", 2023-08-01T19:54:45.934 INFO:teuthology.orchestra.run.smithi008.stdout: "duration": 0 2023-08-01T19:54:45.934 INFO:teuthology.orchestra.run.smithi008.stdout: }, 2023-08-01T19:54:45.934 INFO:teuthology.orchestra.run.smithi008.stdout: { 2023-08-01T19:54:45.934 INFO:teuthology.orchestra.run.smithi008.stdout: "event": "header_read", 2023-08-01T19:54:45.934 INFO:teuthology.orchestra.run.smithi008.stdout: "time": "2023-08-01T19:54:42.191669+0000", 2023-08-01T19:54:45.934 INFO:teuthology.orchestra.run.smithi008.stdout: "duration": 4294967295.999999 2023-08-01T19:54:45.934 INFO:teuthology.orchestra.run.smithi008.stdout: }, 2023-08-01T19:54:45.935 INFO:teuthology.orchestra.run.smithi008.stdout: { 2023-08-01T19:54:45.935 INFO:teuthology.orchestra.run.smithi008.stdout: "event": "all_read", 2023-08-01T19:54:45.935 INFO:teuthology.orchestra.run.smithi008.stdout: "time": "2023-08-01T19:54:42.191755+0000", 2023-08-01T19:54:45.935 INFO:teuthology.orchestra.run.smithi008.stdout: "duration": 8.5817999999999997e-05 2023-08-01T19:54:45.935 INFO:teuthology.orchestra.run.smithi008.stdout: }, 2023-08-01T19:54:45.935 INFO:teuthology.orchestra.run.smithi008.stdout: { 2023-08-01T19:54:45.935 INFO:teuthology.orchestra.run.smithi008.stdout: "event": "dispatched", 2023-08-01T19:54:45.935 INFO:teuthology.orchestra.run.smithi008.stdout: "time": "2023-08-01T19:54:42.191767+0000", 2023-08-01T19:54:45.936 INFO:teuthology.orchestra.run.smithi008.stdout: "duration": 1.2104e-05 2023-08-01T19:54:45.936 INFO:teuthology.orchestra.run.smithi008.stdout: }, 2023-08-01T19:54:45.936 INFO:teuthology.orchestra.run.smithi008.stdout: { 2023-08-01T19:54:45.936 INFO:teuthology.orchestra.run.smithi008.stdout: "event": "queued_for_pg", 2023-08-01T19:54:45.936 INFO:teuthology.orchestra.run.smithi008.stdout: "time": "2023-08-01T19:54:42.191774+0000", 2023-08-01T19:54:45.936 INFO:teuthology.orchestra.run.smithi008.stdout: "duration": 6.9600000000000003e-06 2023-08-01T19:54:45.936 INFO:teuthology.orchestra.run.smithi008.stdout: }, 2023-08-01T19:54:45.937 INFO:teuthology.orchestra.run.smithi008.stdout: { 2023-08-01T19:54:45.937 INFO:teuthology.orchestra.run.smithi008.stdout: "event": "reached_pg", 2023-08-01T19:54:45.937 INFO:teuthology.orchestra.run.smithi008.stdout: "time": "2023-08-01T19:54:42.195268+0000", 2023-08-01T19:54:45.937 INFO:teuthology.orchestra.run.smithi008.stdout: "duration": 0.0034934480000000001 2023-08-01T19:54:45.937 INFO:teuthology.orchestra.run.smithi008.stdout: }, 2023-08-01T19:54:45.937 INFO:teuthology.orchestra.run.smithi008.stdout: { 2023-08-01T19:54:45.937 INFO:teuthology.orchestra.run.smithi008.stdout: "event": "started", 2023-08-01T19:54:45.937 INFO:teuthology.orchestra.run.smithi008.stdout: "time": "2023-08-01T19:54:42.195405+0000", 2023-08-01T19:54:45.938 INFO:teuthology.orchestra.run.smithi008.stdout: "duration": 0.00013794600000000001 2023-08-01T19:54:45.938 INFO:teuthology.orchestra.run.smithi008.stdout: }, 2023-08-01T19:54:45.938 INFO:teuthology.orchestra.run.smithi008.stdout: { 2023-08-01T19:54:45.938 INFO:teuthology.orchestra.run.smithi008.stdout: "event": "waiting for subops from 1", 2023-08-01T19:54:45.938 INFO:teuthology.orchestra.run.smithi008.stdout: "time": "2023-08-01T19:54:42.195530+0000", 2023-08-01T19:54:45.938 INFO:teuthology.orchestra.run.smithi008.stdout: "duration": 0.00012451199999999999 2023-08-01T19:54:45.938 INFO:teuthology.orchestra.run.smithi008.stdout: }, 2023-08-01T19:54:45.938 INFO:teuthology.orchestra.run.smithi008.stdout: { 2023-08-01T19:54:45.939 INFO:teuthology.orchestra.run.smithi008.stdout: "event": "op_commit", 2023-08-01T19:54:45.939 INFO:teuthology.orchestra.run.smithi008.stdout: "time": "2023-08-01T19:54:42.200137+0000", 2023-08-01T19:54:45.939 INFO:teuthology.orchestra.run.smithi008.stdout: "duration": 0.0046066379999999997 2023-08-01T19:54:45.939 INFO:teuthology.orchestra.run.smithi008.stdout: }, 2023-08-01T19:54:45.939 INFO:teuthology.orchestra.run.smithi008.stdout: { 2023-08-01T19:54:45.939 INFO:teuthology.orchestra.run.smithi008.stdout: "event": "sub_op_commit_rec", 2023-08-01T19:54:45.939 INFO:teuthology.orchestra.run.smithi008.stdout: "time": "2023-08-01T19:54:42.205552+0000", 2023-08-01T19:54:45.939 INFO:teuthology.orchestra.run.smithi008.stdout: "duration": 0.0054150140000000001 2023-08-01T19:54:45.940 INFO:teuthology.orchestra.run.smithi008.stdout: }, 2023-08-01T19:54:45.940 INFO:teuthology.orchestra.run.smithi008.stdout: { 2023-08-01T19:54:45.940 INFO:teuthology.orchestra.run.smithi008.stdout: "event": "commit_sent", 2023-08-01T19:54:45.940 INFO:teuthology.orchestra.run.smithi008.stdout: "time": "2023-08-01T19:54:42.205580+0000", 2023-08-01T19:54:45.940 INFO:teuthology.orchestra.run.smithi008.stdout: "duration": 2.8123000000000002e-05 2023-08-01T19:54:45.940 INFO:teuthology.orchestra.run.smithi008.stdout: }, 2023-08-01T19:54:45.940 INFO:teuthology.orchestra.run.smithi008.stdout: { 2023-08-01T19:54:45.940 INFO:teuthology.orchestra.run.smithi008.stdout: "event": "done", 2023-08-01T19:54:45.941 INFO:teuthology.orchestra.run.smithi008.stdout: "time": "2023-08-01T19:54:42.205603+0000", 2023-08-01T19:54:45.941 INFO:teuthology.orchestra.run.smithi008.stdout: "duration": 2.2846000000000001e-05 2023-08-01T19:54:45.941 INFO:teuthology.orchestra.run.smithi008.stdout: } 2023-08-01T19:54:45.941 INFO:teuthology.orchestra.run.smithi008.stdout: ] 2023-08-01T19:54:45.941 INFO:teuthology.orchestra.run.smithi008.stdout: } 2023-08-01T19:54:45.941 INFO:teuthology.orchestra.run.smithi008.stdout: }, 2023-08-01T19:54:45.941 INFO:teuthology.orchestra.run.smithi008.stdout: { 2023-08-01T19:54:45.941 INFO:teuthology.orchestra.run.smithi008.stdout: "description": "osd_op(client.4668.0:54419 5.5 5:a2250ff0:::benchmark_data_smithi006_114134_object54418:head [set-alloc-hint object_size 65536 write_size 65536,write 0~65536] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e27)", 2023-08-01T19:54:45.942 INFO:teuthology.orchestra.run.smithi008.stdout: "initiated_at": "2023-08-01T19:54:42.256492+0000", 2023-08-01T19:54:45.942 INFO:teuthology.orchestra.run.smithi008.stdout: "age": 3.4981224900000001, 2023-08-01T19:54:45.942 INFO:teuthology.orchestra.run.smithi008.stdout: "duration": 0.013101863, 2023-08-01T19:54:45.942 INFO:teuthology.orchestra.run.smithi008.stdout: "type_data": { 2023-08-01T19:54:45.942 INFO:teuthology.orchestra.run.smithi008.stdout: "flag_point": "commit sent; apply or cleanup", 2023-08-01T19:54:45.942 INFO:teuthology.orchestra.run.smithi008.stdout: "client_info": { 2023-08-01T19:54:45.942 INFO:teuthology.orchestra.run.smithi008.stdout: "client": "client.4668", 2023-08-01T19:54:45.942 INFO:teuthology.orchestra.run.smithi008.stdout: "client_addr": "172.21.15.6:0/1709472247", 2023-08-01T19:54:45.943 INFO:teuthology.orchestra.run.smithi008.stdout: "tid": 54419 2023-08-01T19:54:45.943 INFO:teuthology.orchestra.run.smithi008.stdout: }, 2023-08-01T19:54:45.943 INFO:teuthology.orchestra.run.smithi008.stdout: "events": [ 2023-08-01T19:54:45.943 INFO:teuthology.orchestra.run.smithi008.stdout: { 2023-08-01T19:54:45.943 INFO:teuthology.orchestra.run.smithi008.stdout: "event": "initiated", 2023-08-01T19:54:45.943 INFO:teuthology.orchestra.run.smithi008.stdout: "time": "2023-08-01T19:54:42.256492+0000", 2023-08-01T19:54:45.943 INFO:teuthology.orchestra.run.smithi008.stdout: "duration": 0 2023-08-01T19:54:45.943 INFO:teuthology.orchestra.run.smithi008.stdout: }, 2023-08-01T19:54:45.944 INFO:teuthology.orchestra.run.smithi008.stdout: { 2023-08-01T19:54:45.944 INFO:teuthology.orchestra.run.smithi008.stdout: "event": "throttled", 2023-08-01T19:54:45.944 INFO:teuthology.orchestra.run.smithi008.stdout: "time": "2023-08-01T19:54:42.256492+0000", 2023-08-01T19:54:45.944 INFO:teuthology.orchestra.run.smithi008.stdout: "duration": 0 2023-08-01T19:54:45.944 INFO:teuthology.orchestra.run.smithi008.stdout: }, 2023-08-01T19:54:45.944 INFO:teuthology.orchestra.run.smithi008.stdout: { 2023-08-01T19:54:45.944 INFO:teuthology.orchestra.run.smithi008.stdout: "event": "header_read", 2023-08-01T19:54:45.944 INFO:teuthology.orchestra.run.smithi008.stdout: "time": "2023-08-01T19:54:42.256492+0000", 2023-08-01T19:54:45.945 INFO:teuthology.orchestra.run.smithi008.stdout: "duration": 4294967295.9999995 2023-08-01T19:54:45.945 INFO:teuthology.orchestra.run.smithi008.stdout: }, 2023-08-01T19:54:45.945 INFO:teuthology.orchestra.run.smithi008.stdout: { 2023-08-01T19:54:45.945 INFO:teuthology.orchestra.run.smithi008.stdout: "event": "all_read", 2023-08-01T19:54:45.945 INFO:teuthology.orchestra.run.smithi008.stdout: "time": "2023-08-01T19:54:42.256583+0000", 2023-08-01T19:54:45.945 INFO:teuthology.orchestra.run.smithi008.stdout: "duration": 9.1217000000000004e-05 2023-08-01T19:54:45.945 INFO:teuthology.orchestra.run.smithi008.stdout: }, 2023-08-01T19:54:45.946 INFO:teuthology.orchestra.run.smithi008.stdout: { 2023-08-01T19:54:45.946 INFO:teuthology.orchestra.run.smithi008.stdout: "event": "dispatched", 2023-08-01T19:54:45.946 INFO:teuthology.orchestra.run.smithi008.stdout: "time": "2023-08-01T19:54:42.256593+0000", 2023-08-01T19:54:45.946 INFO:teuthology.orchestra.run.smithi008.stdout: "duration": 1.0293e-05 2023-08-01T19:54:45.946 INFO:teuthology.orchestra.run.smithi008.stdout: }, 2023-08-01T19:54:45.946 INFO:teuthology.orchestra.run.smithi008.stdout: { 2023-08-01T19:54:45.946 INFO:teuthology.orchestra.run.smithi008.stdout: "event": "queued_for_pg", 2023-08-01T19:54:45.946 INFO:teuthology.orchestra.run.smithi008.stdout: "time": "2023-08-01T19:54:42.256600+0000", 2023-08-01T19:54:45.947 INFO:teuthology.orchestra.run.smithi008.stdout: "duration": 6.4690000000000002e-06 2023-08-01T19:54:45.947 INFO:teuthology.orchestra.run.smithi008.stdout: }, 2023-08-01T19:54:45.947 INFO:teuthology.orchestra.run.smithi008.stdout: { 2023-08-01T19:54:45.947 INFO:teuthology.orchestra.run.smithi008.stdout: "event": "reached_pg", 2023-08-01T19:54:45.947 INFO:teuthology.orchestra.run.smithi008.stdout: "time": "2023-08-01T19:54:42.260624+0000", 2023-08-01T19:54:45.947 INFO:teuthology.orchestra.run.smithi008.stdout: "duration": 0.0040246509999999997 2023-08-01T19:54:45.947 INFO:teuthology.orchestra.run.smithi008.stdout: }, 2023-08-01T19:54:45.947 INFO:teuthology.orchestra.run.smithi008.stdout: { 2023-08-01T19:54:45.948 INFO:teuthology.orchestra.run.smithi008.stdout: "event": "started", 2023-08-01T19:54:45.948 INFO:teuthology.orchestra.run.smithi008.stdout: "time": "2023-08-01T19:54:42.260754+0000", 2023-08-01T19:54:45.948 INFO:teuthology.orchestra.run.smithi008.stdout: "duration": 0.00012953899999999999 2023-08-01T19:54:45.948 INFO:teuthology.orchestra.run.smithi008.stdout: }, 2023-08-01T19:54:45.948 INFO:teuthology.orchestra.run.smithi008.stdout: { 2023-08-01T19:54:45.948 INFO:teuthology.orchestra.run.smithi008.stdout: "event": "waiting for subops from 1", 2023-08-01T19:54:45.948 INFO:teuthology.orchestra.run.smithi008.stdout: "time": "2023-08-01T19:54:42.260848+0000", 2023-08-01T19:54:45.948 INFO:teuthology.orchestra.run.smithi008.stdout: "duration": 9.4658000000000001e-05 2023-08-01T19:54:45.949 INFO:teuthology.orchestra.run.smithi008.stdout: }, 2023-08-01T19:54:45.949 INFO:teuthology.orchestra.run.smithi008.stdout: { 2023-08-01T19:54:45.949 INFO:teuthology.orchestra.run.smithi008.stdout: "event": "op_commit", 2023-08-01T19:54:45.949 INFO:teuthology.orchestra.run.smithi008.stdout: "time": "2023-08-01T19:54:42.265173+0000", 2023-08-01T19:54:45.949 INFO:teuthology.orchestra.run.smithi008.stdout: "duration": 0.0043244420000000004 2023-08-01T19:54:45.949 INFO:teuthology.orchestra.run.smithi008.stdout: }, 2023-08-01T19:54:45.949 INFO:teuthology.orchestra.run.smithi008.stdout: { 2023-08-01T19:54:45.949 INFO:teuthology.orchestra.run.smithi008.stdout: "event": "sub_op_commit_rec", 2023-08-01T19:54:45.950 INFO:teuthology.orchestra.run.smithi008.stdout: "time": "2023-08-01T19:54:42.269530+0000", 2023-08-01T19:54:45.950 INFO:teuthology.orchestra.run.smithi008.stdout: "duration": 0.0043572960000000001 2023-08-01T19:54:45.950 INFO:teuthology.orchestra.run.smithi008.stdout: }, 2023-08-01T19:54:45.950 INFO:teuthology.orchestra.run.smithi008.stdout: { 2023-08-01T19:54:45.950 INFO:teuthology.orchestra.run.smithi008.stdout: "event": "commit_sent", 2023-08-01T19:54:45.950 INFO:teuthology.orchestra.run.smithi008.stdout: "time": "2023-08-01T19:54:42.269571+0000", 2023-08-01T19:54:45.950 INFO:teuthology.orchestra.run.smithi008.stdout: "duration": 4.0856999999999999e-05 2023-08-01T19:54:45.951 INFO:teuthology.orchestra.run.smithi008.stdout: }, 2023-08-01T19:54:45.951 INFO:teuthology.orchestra.run.smithi008.stdout: { 2023-08-01T19:54:45.951 INFO:teuthology.orchestra.run.smithi008.stdout: "event": "done", 2023-08-01T19:54:45.951 INFO:teuthology.orchestra.run.smithi008.stdout: "time": "2023-08-01T19:54:42.269594+0000", 2023-08-01T19:54:45.951 INFO:teuthology.orchestra.run.smithi008.stdout: "duration": 2.3130999999999999e-05 2023-08-01T19:54:45.951 INFO:teuthology.orchestra.run.smithi008.stdout: } 2023-08-01T19:54:45.951 INFO:teuthology.orchestra.run.smithi008.stdout: ] 2023-08-01T19:54:45.951 INFO:teuthology.orchestra.run.smithi008.stdout: } 2023-08-01T19:54:45.952 INFO:teuthology.orchestra.run.smithi008.stdout: }, 2023-08-01T19:54:45.952 INFO:teuthology.orchestra.run.smithi008.stdout: { 2023-08-01T19:54:45.952 INFO:teuthology.orchestra.run.smithi008.stdout: "description": "osd_op(client.4668.0:55411 5.a 5:52098115:::benchmark_data_smithi006_114134_object55410:head [set-alloc-hint object_size 65536 write_size 65536,write 0~65536] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e27)", 2023-08-01T19:54:45.952 INFO:teuthology.orchestra.run.smithi008.stdout: "initiated_at": "2023-08-01T19:54:42.689404+0000", 2023-08-01T19:54:45.952 INFO:teuthology.orchestra.run.smithi008.stdout: "age": 3.0652105650000001, 2023-08-01T19:54:45.952 INFO:teuthology.orchestra.run.smithi008.stdout: "duration": 0.014643121, 2023-08-01T19:54:45.952 INFO:teuthology.orchestra.run.smithi008.stdout: "type_data": { 2023-08-01T19:54:45.953 INFO:teuthology.orchestra.run.smithi008.stdout: "flag_point": "commit sent; apply or cleanup", 2023-08-01T19:54:45.953 INFO:teuthology.orchestra.run.smithi008.stdout: "client_info": { 2023-08-01T19:54:45.953 INFO:teuthology.orchestra.run.smithi008.stdout: "client": "client.4668", 2023-08-01T19:54:45.953 INFO:teuthology.orchestra.run.smithi008.stdout: "client_addr": "172.21.15.6:0/1709472247", 2023-08-01T19:54:45.953 INFO:teuthology.orchestra.run.smithi008.stdout: "tid": 55411 2023-08-01T19:54:45.953 INFO:teuthology.orchestra.run.smithi008.stdout: }, 2023-08-01T19:54:45.953 INFO:teuthology.orchestra.run.smithi008.stdout: "events": [ 2023-08-01T19:54:45.953 INFO:teuthology.orchestra.run.smithi008.stdout: { 2023-08-01T19:54:45.954 INFO:teuthology.orchestra.run.smithi008.stdout: "event": "initiated", 2023-08-01T19:54:45.954 INFO:teuthology.orchestra.run.smithi008.stdout: "time": "2023-08-01T19:54:42.689404+0000", 2023-08-01T19:54:45.954 INFO:teuthology.orchestra.run.smithi008.stdout: "duration": 0 2023-08-01T19:54:45.954 INFO:teuthology.orchestra.run.smithi008.stdout: }, 2023-08-01T19:54:45.954 INFO:teuthology.orchestra.run.smithi008.stdout: { 2023-08-01T19:54:45.954 INFO:teuthology.orchestra.run.smithi008.stdout: "event": "throttled", 2023-08-01T19:54:45.954 INFO:teuthology.orchestra.run.smithi008.stdout: "time": "2023-08-01T19:54:42.689404+0000", 2023-08-01T19:54:45.954 INFO:teuthology.orchestra.run.smithi008.stdout: "duration": 0 2023-08-01T19:54:45.955 INFO:teuthology.orchestra.run.smithi008.stdout: }, 2023-08-01T19:54:45.955 INFO:teuthology.orchestra.run.smithi008.stdout: { 2023-08-01T19:54:45.955 INFO:teuthology.orchestra.run.smithi008.stdout: "event": "header_read", 2023-08-01T19:54:45.955 INFO:teuthology.orchestra.run.smithi008.stdout: "time": "2023-08-01T19:54:42.689404+0000", 2023-08-01T19:54:45.955 INFO:teuthology.orchestra.run.smithi008.stdout: "duration": 4294967295.9999995 2023-08-01T19:54:45.955 INFO:teuthology.orchestra.run.smithi008.stdout: }, 2023-08-01T19:54:45.955 INFO:teuthology.orchestra.run.smithi008.stdout: { 2023-08-01T19:54:45.955 INFO:teuthology.orchestra.run.smithi008.stdout: "event": "all_read", 2023-08-01T19:54:45.956 INFO:teuthology.orchestra.run.smithi008.stdout: "time": "2023-08-01T19:54:42.689428+0000", 2023-08-01T19:54:45.956 INFO:teuthology.orchestra.run.smithi008.stdout: "duration": 2.3779999999999999e-05 2023-08-01T19:54:45.956 INFO:teuthology.orchestra.run.smithi008.stdout: }, 2023-08-01T19:54:45.956 INFO:teuthology.orchestra.run.smithi008.stdout: { 2023-08-01T19:54:45.956 INFO:teuthology.orchestra.run.smithi008.stdout: "event": "dispatched", 2023-08-01T19:54:45.956 INFO:teuthology.orchestra.run.smithi008.stdout: "time": "2023-08-01T19:54:42.689434+0000", 2023-08-01T19:54:45.956 INFO:teuthology.orchestra.run.smithi008.stdout: "duration": 6.195e-06 2023-08-01T19:54:45.957 INFO:teuthology.orchestra.run.smithi008.stdout: }, 2023-08-01T19:54:45.957 INFO:teuthology.orchestra.run.smithi008.stdout: { 2023-08-01T19:54:45.957 INFO:teuthology.orchestra.run.smithi008.stdout: "event": "queued_for_pg", 2023-08-01T19:54:45.957 INFO:teuthology.orchestra.run.smithi008.stdout: "time": "2023-08-01T19:54:42.689438+0000", 2023-08-01T19:54:45.957 INFO:teuthology.orchestra.run.smithi008.stdout: "duration": 4.194e-06 2023-08-01T19:54:45.957 INFO:teuthology.orchestra.run.smithi008.stdout: }, 2023-08-01T19:54:45.957 INFO:teuthology.orchestra.run.smithi008.stdout: { 2023-08-01T19:54:45.957 INFO:teuthology.orchestra.run.smithi008.stdout: "event": "reached_pg", 2023-08-01T19:54:45.958 INFO:teuthology.orchestra.run.smithi008.stdout: "time": "2023-08-01T19:54:42.694888+0000", 2023-08-01T19:54:45.958 INFO:teuthology.orchestra.run.smithi008.stdout: "duration": 0.0054501690000000004 2023-08-01T19:54:45.958 INFO:teuthology.orchestra.run.smithi008.stdout: }, 2023-08-01T19:54:45.958 INFO:teuthology.orchestra.run.smithi008.stdout: { 2023-08-01T19:54:45.958 INFO:teuthology.orchestra.run.smithi008.stdout: "event": "started", 2023-08-01T19:54:45.958 INFO:teuthology.orchestra.run.smithi008.stdout: "time": "2023-08-01T19:54:42.695032+0000", 2023-08-01T19:54:45.958 INFO:teuthology.orchestra.run.smithi008.stdout: "duration": 0.00014387699999999999 2023-08-01T19:54:45.958 INFO:teuthology.orchestra.run.smithi008.stdout: }, 2023-08-01T19:54:45.959 INFO:teuthology.orchestra.run.smithi008.stdout: { 2023-08-01T19:54:45.959 INFO:teuthology.orchestra.run.smithi008.stdout: "event": "waiting for subops from 2", 2023-08-01T19:54:45.959 INFO:teuthology.orchestra.run.smithi008.stdout: "time": "2023-08-01T19:54:42.695205+0000", 2023-08-01T19:54:45.959 INFO:teuthology.orchestra.run.smithi008.stdout: "duration": 0.00017243 2023-08-01T19:54:45.959 INFO:teuthology.orchestra.run.smithi008.stdout: }, 2023-08-01T19:54:45.959 INFO:teuthology.orchestra.run.smithi008.stdout: { 2023-08-01T19:54:45.959 INFO:teuthology.orchestra.run.smithi008.stdout: "event": "sub_op_commit_rec", 2023-08-01T19:54:45.959 INFO:teuthology.orchestra.run.smithi008.stdout: "time": "2023-08-01T19:54:42.699618+0000", 2023-08-01T19:54:45.960 INFO:teuthology.orchestra.run.smithi008.stdout: "duration": 0.0044136399999999999 2023-08-01T19:54:45.960 INFO:teuthology.orchestra.run.smithi008.stdout: }, 2023-08-01T19:54:45.960 INFO:teuthology.orchestra.run.smithi008.stdout: { 2023-08-01T19:54:45.960 INFO:teuthology.orchestra.run.smithi008.stdout: "event": "op_commit", 2023-08-01T19:54:45.960 INFO:teuthology.orchestra.run.smithi008.stdout: "time": "2023-08-01T19:54:42.703957+0000", 2023-08-01T19:54:45.960 INFO:teuthology.orchestra.run.smithi008.stdout: "duration": 0.0043392020000000003 2023-08-01T19:54:45.960 INFO:teuthology.orchestra.run.smithi008.stdout: }, 2023-08-01T19:54:45.961 INFO:teuthology.orchestra.run.smithi008.stdout: { 2023-08-01T19:54:45.961 INFO:teuthology.orchestra.run.smithi008.stdout: "event": "commit_sent", 2023-08-01T19:54:45.961 INFO:teuthology.orchestra.run.smithi008.stdout: "time": "2023-08-01T19:54:42.704012+0000", 2023-08-01T19:54:45.961 INFO:teuthology.orchestra.run.smithi008.stdout: "duration": 5.4719999999999998e-05 2023-08-01T19:54:45.961 INFO:teuthology.orchestra.run.smithi008.stdout: }, 2023-08-01T19:54:45.961 INFO:teuthology.orchestra.run.smithi008.stdout: { 2023-08-01T19:54:45.961 INFO:teuthology.orchestra.run.smithi008.stdout: "event": "done", 2023-08-01T19:54:45.961 INFO:teuthology.orchestra.run.smithi008.stdout: "time": "2023-08-01T19:54:42.704047+0000", 2023-08-01T19:54:45.962 INFO:teuthology.orchestra.run.smithi008.stdout: "duration": 3.5336000000000002e-05 2023-08-01T19:54:45.962 INFO:teuthology.orchestra.run.smithi008.stdout: } 2023-08-01T19:54:45.962 INFO:teuthology.orchestra.run.smithi008.stdout: ] 2023-08-01T19:54:45.962 INFO:teuthology.orchestra.run.smithi008.stdout: } 2023-08-01T19:54:45.962 INFO:teuthology.orchestra.run.smithi008.stdout: } 2023-08-01T19:54:45.962 INFO:teuthology.orchestra.run.smithi008.stdout: ] 2023-08-01T19:54:45.962 INFO:teuthology.orchestra.run.smithi008.stdout:} 2023-08-01T19:54:45.963 INFO:tasks.ceph.osd.1.smithi101.stderr:2023-08-01T19:54:45.962+0000 7fb0cb7f6700 -1 received signal: Hangup from /usr/bin/python3 /bin/daemon-helper kill ceph-osd -f --cluster ceph -i 1 (PID: 111141) UID: 0 2023-08-01T19:54:45.964 DEBUG:teuthology.orchestra.run.smithi101:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 30 ceph --cluster ceph --admin-daemon /var/run/ceph/ceph-osd.1.asok dump_ops_in_flight 2023-08-01T19:54:46.064 INFO:tasks.ceph.osd.2.smithi155.stderr:2023-08-01T19:54:46.062+0000 7faa5c6ac700 -1 received signal: Hangup from /usr/bin/python3 /bin/daemon-helper kill ceph-osd -f --cluster ceph -i 2 (PID: 111337) UID: 0 2023-08-01T19:54:46.138 INFO:teuthology.orchestra.run.smithi101.stdout:{ 2023-08-01T19:54:46.138 INFO:teuthology.orchestra.run.smithi101.stdout: "ops": [ 2023-08-01T19:54:46.139 INFO:teuthology.orchestra.run.smithi101.stdout: { 2023-08-01T19:54:46.139 INFO:teuthology.orchestra.run.smithi101.stdout: "description": "osd_op(client.4668.0:62631 5.f 5:f4cc30f8:::benchmark_data_smithi006_114134_object62630:head [set-alloc-hint object_size 65536 write_size 65536,write 0~65536 in=65536b] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e29)", 2023-08-01T19:54:46.139 INFO:teuthology.orchestra.run.smithi101.stdout: "initiated_at": "2023-08-01T19:54:46.133457+0000", 2023-08-01T19:54:46.139 INFO:teuthology.orchestra.run.smithi101.stdout: "age": 0.0035859580000000002, 2023-08-01T19:54:46.139 INFO:teuthology.orchestra.run.smithi101.stdout: "duration": 0.0036127339999999998, 2023-08-01T19:54:46.139 INFO:teuthology.orchestra.run.smithi101.stdout: "type_data": { 2023-08-01T19:54:46.139 INFO:teuthology.orchestra.run.smithi101.stdout: "flag_point": "waiting for sub ops", 2023-08-01T19:54:46.140 INFO:teuthology.orchestra.run.smithi101.stdout: "client_info": { 2023-08-01T19:54:46.140 INFO:teuthology.orchestra.run.smithi101.stdout: "client": "client.4668", 2023-08-01T19:54:46.140 INFO:teuthology.orchestra.run.smithi101.stdout: "client_addr": "172.21.15.6:0/1709472247", 2023-08-01T19:54:46.140 INFO:teuthology.orchestra.run.smithi101.stdout: "tid": 62631 2023-08-01T19:54:46.140 INFO:teuthology.orchestra.run.smithi101.stdout: }, 2023-08-01T19:54:46.140 INFO:teuthology.orchestra.run.smithi101.stdout: "events": [ 2023-08-01T19:54:46.140 INFO:teuthology.orchestra.run.smithi101.stdout: { 2023-08-01T19:54:46.140 INFO:teuthology.orchestra.run.smithi101.stdout: "event": "initiated", 2023-08-01T19:54:46.141 INFO:teuthology.orchestra.run.smithi101.stdout: "time": "2023-08-01T19:54:46.133457+0000", 2023-08-01T19:54:46.141 INFO:teuthology.orchestra.run.smithi101.stdout: "duration": 0 2023-08-01T19:54:46.141 INFO:teuthology.orchestra.run.smithi101.stdout: }, 2023-08-01T19:54:46.141 INFO:teuthology.orchestra.run.smithi101.stdout: { 2023-08-01T19:54:46.141 INFO:teuthology.orchestra.run.smithi101.stdout: "event": "throttled", 2023-08-01T19:54:46.141 INFO:teuthology.orchestra.run.smithi101.stdout: "time": "2023-08-01T19:54:46.133457+0000", 2023-08-01T19:54:46.141 INFO:teuthology.orchestra.run.smithi101.stdout: "duration": 0 2023-08-01T19:54:46.142 INFO:teuthology.orchestra.run.smithi101.stdout: }, 2023-08-01T19:54:46.142 INFO:teuthology.orchestra.run.smithi101.stdout: { 2023-08-01T19:54:46.142 INFO:teuthology.orchestra.run.smithi101.stdout: "event": "header_read", 2023-08-01T19:54:46.142 INFO:teuthology.orchestra.run.smithi101.stdout: "time": "2023-08-01T19:54:46.133456+0000", 2023-08-01T19:54:46.142 INFO:teuthology.orchestra.run.smithi101.stdout: "duration": 4294967295.999999 2023-08-01T19:54:46.142 INFO:teuthology.orchestra.run.smithi101.stdout: }, 2023-08-01T19:54:46.142 INFO:teuthology.orchestra.run.smithi101.stdout: { 2023-08-01T19:54:46.142 INFO:teuthology.orchestra.run.smithi101.stdout: "event": "all_read", 2023-08-01T19:54:46.143 INFO:teuthology.orchestra.run.smithi101.stdout: "time": "2023-08-01T19:54:46.133518+0000", 2023-08-01T19:54:46.143 INFO:teuthology.orchestra.run.smithi101.stdout: "duration": 6.2483000000000005e-05 2023-08-01T19:54:46.143 INFO:teuthology.orchestra.run.smithi101.stdout: }, 2023-08-01T19:54:46.143 INFO:teuthology.orchestra.run.smithi101.stdout: { 2023-08-01T19:54:46.143 INFO:teuthology.orchestra.run.smithi101.stdout: "event": "dispatched", 2023-08-01T19:54:46.143 INFO:teuthology.orchestra.run.smithi101.stdout: "time": "2023-08-01T19:54:46.133532+0000", 2023-08-01T19:54:46.143 INFO:teuthology.orchestra.run.smithi101.stdout: "duration": 1.3932e-05 2023-08-01T19:54:46.144 INFO:teuthology.orchestra.run.smithi101.stdout: }, 2023-08-01T19:54:46.144 INFO:teuthology.orchestra.run.smithi101.stdout: { 2023-08-01T19:54:46.144 INFO:teuthology.orchestra.run.smithi101.stdout: "event": "queued_for_pg", 2023-08-01T19:54:46.144 INFO:teuthology.orchestra.run.smithi101.stdout: "time": "2023-08-01T19:54:46.133539+0000", 2023-08-01T19:54:46.144 INFO:teuthology.orchestra.run.smithi101.stdout: "duration": 6.798e-06 2023-08-01T19:54:46.144 INFO:teuthology.orchestra.run.smithi101.stdout: }, 2023-08-01T19:54:46.144 INFO:teuthology.orchestra.run.smithi101.stdout: { 2023-08-01T19:54:46.144 INFO:teuthology.orchestra.run.smithi101.stdout: "event": "reached_pg", 2023-08-01T19:54:46.145 INFO:teuthology.orchestra.run.smithi101.stdout: "time": "2023-08-01T19:54:46.133566+0000", 2023-08-01T19:54:46.145 INFO:teuthology.orchestra.run.smithi101.stdout: "duration": 2.7209999999999999e-05 2023-08-01T19:54:46.145 INFO:teuthology.orchestra.run.smithi101.stdout: }, 2023-08-01T19:54:46.145 INFO:teuthology.orchestra.run.smithi101.stdout: { 2023-08-01T19:54:46.145 INFO:teuthology.orchestra.run.smithi101.stdout: "event": "started", 2023-08-01T19:54:46.145 INFO:teuthology.orchestra.run.smithi101.stdout: "time": "2023-08-01T19:54:46.133648+0000", 2023-08-01T19:54:46.145 INFO:teuthology.orchestra.run.smithi101.stdout: "duration": 8.1512000000000002e-05 2023-08-01T19:54:46.145 INFO:teuthology.orchestra.run.smithi101.stdout: }, 2023-08-01T19:54:46.146 INFO:teuthology.orchestra.run.smithi101.stdout: { 2023-08-01T19:54:46.146 INFO:teuthology.orchestra.run.smithi101.stdout: "event": "waiting for subops from 2", 2023-08-01T19:54:46.146 INFO:teuthology.orchestra.run.smithi101.stdout: "time": "2023-08-01T19:54:46.133730+0000", 2023-08-01T19:54:46.146 INFO:teuthology.orchestra.run.smithi101.stdout: "duration": 8.2688999999999994e-05 2023-08-01T19:54:46.146 INFO:teuthology.orchestra.run.smithi101.stdout: }, 2023-08-01T19:54:46.146 INFO:teuthology.orchestra.run.smithi101.stdout: { 2023-08-01T19:54:46.146 INFO:teuthology.orchestra.run.smithi101.stdout: "event": "op_commit", 2023-08-01T19:54:46.147 INFO:teuthology.orchestra.run.smithi101.stdout: "time": "2023-08-01T19:54:46.136982+0000", 2023-08-01T19:54:46.147 INFO:teuthology.orchestra.run.smithi101.stdout: "duration": 0.0032517929999999998 2023-08-01T19:54:46.147 INFO:teuthology.orchestra.run.smithi101.stdout: } 2023-08-01T19:54:46.147 INFO:teuthology.orchestra.run.smithi101.stdout: ] 2023-08-01T19:54:46.147 INFO:teuthology.orchestra.run.smithi101.stdout: } 2023-08-01T19:54:46.147 INFO:teuthology.orchestra.run.smithi101.stdout: }, 2023-08-01T19:54:46.147 INFO:teuthology.orchestra.run.smithi101.stdout: { 2023-08-01T19:54:46.147 INFO:teuthology.orchestra.run.smithi101.stdout: "description": "osd_repop(client.4668.0:62632 5.5 e29/19 5:a85ad3e1:::benchmark_data_smithi006_114134_object62631:head v 29'3881, mlcod=29'3878)", 2023-08-01T19:54:46.148 INFO:teuthology.orchestra.run.smithi101.stdout: "initiated_at": "2023-08-01T19:54:46.133957+0000", 2023-08-01T19:54:46.148 INFO:teuthology.orchestra.run.smithi101.stdout: "age": 0.00308633, 2023-08-01T19:54:46.148 INFO:teuthology.orchestra.run.smithi101.stdout: "duration": 0.0032017180000000001, 2023-08-01T19:54:46.148 INFO:teuthology.orchestra.run.smithi101.stdout: "type_data": { 2023-08-01T19:54:46.148 INFO:teuthology.orchestra.run.smithi101.stdout: "flag_point": "started", 2023-08-01T19:54:46.148 INFO:teuthology.orchestra.run.smithi101.stdout: "events": [ 2023-08-01T19:54:46.148 INFO:teuthology.orchestra.run.smithi101.stdout: { 2023-08-01T19:54:46.148 INFO:teuthology.orchestra.run.smithi101.stdout: "event": "initiated", 2023-08-01T19:54:46.149 INFO:teuthology.orchestra.run.smithi101.stdout: "time": "2023-08-01T19:54:46.133957+0000", 2023-08-01T19:54:46.149 INFO:teuthology.orchestra.run.smithi101.stdout: "duration": 0 2023-08-01T19:54:46.149 INFO:teuthology.orchestra.run.smithi101.stdout: }, 2023-08-01T19:54:46.149 INFO:teuthology.orchestra.run.smithi101.stdout: { 2023-08-01T19:54:46.149 INFO:teuthology.orchestra.run.smithi101.stdout: "event": "throttled", 2023-08-01T19:54:46.149 INFO:teuthology.orchestra.run.smithi101.stdout: "time": "2023-08-01T19:54:46.133957+0000", 2023-08-01T19:54:46.149 INFO:teuthology.orchestra.run.smithi101.stdout: "duration": 0 2023-08-01T19:54:46.150 INFO:teuthology.orchestra.run.smithi101.stdout: }, 2023-08-01T19:54:46.150 INFO:teuthology.orchestra.run.smithi101.stdout: { 2023-08-01T19:54:46.150 INFO:teuthology.orchestra.run.smithi101.stdout: "event": "header_read", 2023-08-01T19:54:46.150 INFO:teuthology.orchestra.run.smithi101.stdout: "time": "2023-08-01T19:54:46.133956+0000", 2023-08-01T19:54:46.150 INFO:teuthology.orchestra.run.smithi101.stdout: "duration": 4294967295.9999995 2023-08-01T19:54:46.150 INFO:teuthology.orchestra.run.smithi101.stdout: }, 2023-08-01T19:54:46.150 INFO:teuthology.orchestra.run.smithi101.stdout: { 2023-08-01T19:54:46.150 INFO:teuthology.orchestra.run.smithi101.stdout: "event": "all_read", 2023-08-01T19:54:46.151 INFO:teuthology.orchestra.run.smithi101.stdout: "time": "2023-08-01T19:54:46.134001+0000", 2023-08-01T19:54:46.151 INFO:teuthology.orchestra.run.smithi101.stdout: "duration": 4.4496000000000002e-05 2023-08-01T19:54:46.151 INFO:teuthology.orchestra.run.smithi101.stdout: }, 2023-08-01T19:54:46.151 INFO:teuthology.orchestra.run.smithi101.stdout: { 2023-08-01T19:54:46.151 INFO:teuthology.orchestra.run.smithi101.stdout: "event": "dispatched", 2023-08-01T19:54:46.151 INFO:teuthology.orchestra.run.smithi101.stdout: "time": "2023-08-01T19:54:46.134007+0000", 2023-08-01T19:54:46.151 INFO:teuthology.orchestra.run.smithi101.stdout: "duration": 6.7989999999999996e-06 2023-08-01T19:54:46.151 INFO:teuthology.orchestra.run.smithi101.stdout: }, 2023-08-01T19:54:46.152 INFO:teuthology.orchestra.run.smithi101.stdout: { 2023-08-01T19:54:46.152 INFO:teuthology.orchestra.run.smithi101.stdout: "event": "queued_for_pg", 2023-08-01T19:54:46.152 INFO:teuthology.orchestra.run.smithi101.stdout: "time": "2023-08-01T19:54:46.134011+0000", 2023-08-01T19:54:46.152 INFO:teuthology.orchestra.run.smithi101.stdout: "duration": 3.721e-06 2023-08-01T19:54:46.152 INFO:teuthology.orchestra.run.smithi101.stdout: }, 2023-08-01T19:54:46.152 INFO:teuthology.orchestra.run.smithi101.stdout: { 2023-08-01T19:54:46.152 INFO:teuthology.orchestra.run.smithi101.stdout: "event": "reached_pg", 2023-08-01T19:54:46.152 INFO:teuthology.orchestra.run.smithi101.stdout: "time": "2023-08-01T19:54:46.134042+0000", 2023-08-01T19:54:46.153 INFO:teuthology.orchestra.run.smithi101.stdout: "duration": 3.1068999999999997e-05 2023-08-01T19:54:46.153 INFO:teuthology.orchestra.run.smithi101.stdout: }, 2023-08-01T19:54:46.153 INFO:teuthology.orchestra.run.smithi101.stdout: { 2023-08-01T19:54:46.153 INFO:teuthology.orchestra.run.smithi101.stdout: "event": "started", 2023-08-01T19:54:46.153 INFO:teuthology.orchestra.run.smithi101.stdout: "time": "2023-08-01T19:54:46.134054+0000", 2023-08-01T19:54:46.153 INFO:teuthology.orchestra.run.smithi101.stdout: "duration": 1.1430000000000001e-05 2023-08-01T19:54:46.153 INFO:teuthology.orchestra.run.smithi101.stdout: } 2023-08-01T19:54:46.153 INFO:teuthology.orchestra.run.smithi101.stdout: ] 2023-08-01T19:54:46.154 INFO:teuthology.orchestra.run.smithi101.stdout: } 2023-08-01T19:54:46.154 INFO:teuthology.orchestra.run.smithi101.stdout: }, 2023-08-01T19:54:46.154 INFO:teuthology.orchestra.run.smithi101.stdout: { 2023-08-01T19:54:46.154 INFO:teuthology.orchestra.run.smithi101.stdout: "description": "osd_repop(client.4668.0:62635 5.5 e29/19 5:a136c27a:::benchmark_data_smithi006_114134_object62634:head v 29'3882, mlcod=29'3878)", 2023-08-01T19:54:46.154 INFO:teuthology.orchestra.run.smithi101.stdout: "initiated_at": "2023-08-01T19:54:46.135863+0000", 2023-08-01T19:54:46.154 INFO:teuthology.orchestra.run.smithi101.stdout: "age": 0.0011797559999999999, 2023-08-01T19:54:46.154 INFO:teuthology.orchestra.run.smithi101.stdout: "duration": 0.001356229, 2023-08-01T19:54:46.154 INFO:teuthology.orchestra.run.smithi101.stdout: "type_data": { 2023-08-01T19:54:46.155 INFO:teuthology.orchestra.run.smithi101.stdout: "flag_point": "started", 2023-08-01T19:54:46.155 INFO:teuthology.orchestra.run.smithi101.stdout: "events": [ 2023-08-01T19:54:46.155 INFO:teuthology.orchestra.run.smithi101.stdout: { 2023-08-01T19:54:46.155 INFO:teuthology.orchestra.run.smithi101.stdout: "event": "initiated", 2023-08-01T19:54:46.155 INFO:teuthology.orchestra.run.smithi101.stdout: "time": "2023-08-01T19:54:46.135863+0000", 2023-08-01T19:54:46.155 INFO:teuthology.orchestra.run.smithi101.stdout: "duration": 0 2023-08-01T19:54:46.155 INFO:teuthology.orchestra.run.smithi101.stdout: }, 2023-08-01T19:54:46.156 INFO:teuthology.orchestra.run.smithi101.stdout: { 2023-08-01T19:54:46.156 INFO:teuthology.orchestra.run.smithi101.stdout: "event": "throttled", 2023-08-01T19:54:46.156 INFO:teuthology.orchestra.run.smithi101.stdout: "time": "2023-08-01T19:54:46.135863+0000", 2023-08-01T19:54:46.156 INFO:teuthology.orchestra.run.smithi101.stdout: "duration": 0 2023-08-01T19:54:46.156 INFO:teuthology.orchestra.run.smithi101.stdout: }, 2023-08-01T19:54:46.156 INFO:teuthology.orchestra.run.smithi101.stdout: { 2023-08-01T19:54:46.156 INFO:teuthology.orchestra.run.smithi101.stdout: "event": "header_read", 2023-08-01T19:54:46.156 INFO:teuthology.orchestra.run.smithi101.stdout: "time": "2023-08-01T19:54:46.135863+0000", 2023-08-01T19:54:46.157 INFO:teuthology.orchestra.run.smithi101.stdout: "duration": 4294967295.9999995 2023-08-01T19:54:46.157 INFO:teuthology.orchestra.run.smithi101.stdout: }, 2023-08-01T19:54:46.157 INFO:teuthology.orchestra.run.smithi101.stdout: { 2023-08-01T19:54:46.157 INFO:teuthology.orchestra.run.smithi101.stdout: "event": "all_read", 2023-08-01T19:54:46.157 INFO:teuthology.orchestra.run.smithi101.stdout: "time": "2023-08-01T19:54:46.135918+0000", 2023-08-01T19:54:46.157 INFO:teuthology.orchestra.run.smithi101.stdout: "duration": 5.5223000000000003e-05 2023-08-01T19:54:46.157 INFO:teuthology.orchestra.run.smithi101.stdout: }, 2023-08-01T19:54:46.157 INFO:teuthology.orchestra.run.smithi101.stdout: { 2023-08-01T19:54:46.158 INFO:teuthology.orchestra.run.smithi101.stdout: "event": "dispatched", 2023-08-01T19:54:46.158 INFO:teuthology.orchestra.run.smithi101.stdout: "time": "2023-08-01T19:54:46.135926+0000", 2023-08-01T19:54:46.158 INFO:teuthology.orchestra.run.smithi101.stdout: "duration": 8.1599999999999998e-06 2023-08-01T19:54:46.158 INFO:teuthology.orchestra.run.smithi101.stdout: }, 2023-08-01T19:54:46.158 INFO:teuthology.orchestra.run.smithi101.stdout: { 2023-08-01T19:54:46.158 INFO:teuthology.orchestra.run.smithi101.stdout: "event": "queued_for_pg", 2023-08-01T19:54:46.158 INFO:teuthology.orchestra.run.smithi101.stdout: "time": "2023-08-01T19:54:46.135930+0000", 2023-08-01T19:54:46.158 INFO:teuthology.orchestra.run.smithi101.stdout: "duration": 3.9380000000000002e-06 2023-08-01T19:54:46.159 INFO:teuthology.orchestra.run.smithi101.stdout: }, 2023-08-01T19:54:46.159 INFO:teuthology.orchestra.run.smithi101.stdout: { 2023-08-01T19:54:46.159 INFO:teuthology.orchestra.run.smithi101.stdout: "event": "reached_pg", 2023-08-01T19:54:46.159 INFO:teuthology.orchestra.run.smithi101.stdout: "time": "2023-08-01T19:54:46.135950+0000", 2023-08-01T19:54:46.159 INFO:teuthology.orchestra.run.smithi101.stdout: "duration": 2.0550000000000001e-05 2023-08-01T19:54:46.159 INFO:teuthology.orchestra.run.smithi101.stdout: }, 2023-08-01T19:54:46.159 INFO:teuthology.orchestra.run.smithi101.stdout: { 2023-08-01T19:54:46.159 INFO:teuthology.orchestra.run.smithi101.stdout: "event": "started", 2023-08-01T19:54:46.160 INFO:teuthology.orchestra.run.smithi101.stdout: "time": "2023-08-01T19:54:46.135967+0000", 2023-08-01T19:54:46.160 INFO:teuthology.orchestra.run.smithi101.stdout: "duration": 1.6699000000000001e-05 2023-08-01T19:54:46.160 INFO:teuthology.orchestra.run.smithi101.stdout: } 2023-08-01T19:54:46.160 INFO:teuthology.orchestra.run.smithi101.stdout: ] 2023-08-01T19:54:46.160 INFO:teuthology.orchestra.run.smithi101.stdout: } 2023-08-01T19:54:46.160 INFO:teuthology.orchestra.run.smithi101.stdout: }, 2023-08-01T19:54:46.160 INFO:teuthology.orchestra.run.smithi101.stdout: { 2023-08-01T19:54:46.161 INFO:teuthology.orchestra.run.smithi101.stdout: "description": "osd_op(client.4668.0:62638 5.7 5:e48c17a7:::benchmark_data_smithi006_114134_object62637:head [set-alloc-hint object_size 65536 write_size 65536,write 0~65536 in=65536b] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e29)", 2023-08-01T19:54:46.161 INFO:teuthology.orchestra.run.smithi101.stdout: "initiated_at": "2023-08-01T19:54:46.136166+0000", 2023-08-01T19:54:46.161 INFO:teuthology.orchestra.run.smithi101.stdout: "age": 0.00087736800000000001, 2023-08-01T19:54:46.161 INFO:teuthology.orchestra.run.smithi101.stdout: "duration": 0.001120612, 2023-08-01T19:54:46.161 INFO:teuthology.orchestra.run.smithi101.stdout: "type_data": { 2023-08-01T19:54:46.161 INFO:teuthology.orchestra.run.smithi101.stdout: "flag_point": "waiting for sub ops", 2023-08-01T19:54:46.161 INFO:teuthology.orchestra.run.smithi101.stdout: "client_info": { 2023-08-01T19:54:46.161 INFO:teuthology.orchestra.run.smithi101.stdout: "client": "client.4668", 2023-08-01T19:54:46.162 INFO:teuthology.orchestra.run.smithi101.stdout: "client_addr": "172.21.15.6:0/1709472247", 2023-08-01T19:54:46.162 INFO:teuthology.orchestra.run.smithi101.stdout: "tid": 62638 2023-08-01T19:54:46.162 INFO:teuthology.orchestra.run.smithi101.stdout: }, 2023-08-01T19:54:46.162 INFO:teuthology.orchestra.run.smithi101.stdout: "events": [ 2023-08-01T19:54:46.162 INFO:teuthology.orchestra.run.smithi101.stdout: { 2023-08-01T19:54:46.162 INFO:teuthology.orchestra.run.smithi101.stdout: "event": "initiated", 2023-08-01T19:54:46.162 INFO:teuthology.orchestra.run.smithi101.stdout: "time": "2023-08-01T19:54:46.136166+0000", 2023-08-01T19:54:46.162 INFO:teuthology.orchestra.run.smithi101.stdout: "duration": 0 2023-08-01T19:54:46.163 INFO:teuthology.orchestra.run.smithi101.stdout: }, 2023-08-01T19:54:46.163 INFO:teuthology.orchestra.run.smithi101.stdout: { 2023-08-01T19:54:46.163 INFO:teuthology.orchestra.run.smithi101.stdout: "event": "throttled", 2023-08-01T19:54:46.163 INFO:teuthology.orchestra.run.smithi101.stdout: "time": "2023-08-01T19:54:46.136166+0000", 2023-08-01T19:54:46.163 INFO:teuthology.orchestra.run.smithi101.stdout: "duration": 0 2023-08-01T19:54:46.163 INFO:teuthology.orchestra.run.smithi101.stdout: }, 2023-08-01T19:54:46.163 INFO:teuthology.orchestra.run.smithi101.stdout: { 2023-08-01T19:54:46.163 INFO:teuthology.orchestra.run.smithi101.stdout: "event": "header_read", 2023-08-01T19:54:46.164 INFO:teuthology.orchestra.run.smithi101.stdout: "time": "2023-08-01T19:54:46.136165+0000", 2023-08-01T19:54:46.164 INFO:teuthology.orchestra.run.smithi101.stdout: "duration": 4294967295.999999 2023-08-01T19:54:46.164 INFO:teuthology.orchestra.run.smithi101.stdout: }, 2023-08-01T19:54:46.164 INFO:teuthology.orchestra.run.smithi101.stdout: { 2023-08-01T19:54:46.164 INFO:teuthology.orchestra.run.smithi101.stdout: "event": "all_read", 2023-08-01T19:54:46.164 INFO:teuthology.orchestra.run.smithi101.stdout: "time": "2023-08-01T19:54:46.136264+0000", 2023-08-01T19:54:46.164 INFO:teuthology.orchestra.run.smithi101.stdout: "duration": 9.9494000000000007e-05 2023-08-01T19:54:46.164 INFO:teuthology.orchestra.run.smithi101.stdout: }, 2023-08-01T19:54:46.165 INFO:teuthology.orchestra.run.smithi101.stdout: { 2023-08-01T19:54:46.165 INFO:teuthology.orchestra.run.smithi101.stdout: "event": "dispatched", 2023-08-01T19:54:46.165 INFO:teuthology.orchestra.run.smithi101.stdout: "time": "2023-08-01T19:54:46.136276+0000", 2023-08-01T19:54:46.165 INFO:teuthology.orchestra.run.smithi101.stdout: "duration": 1.147e-05 2023-08-01T19:54:46.165 INFO:teuthology.orchestra.run.smithi101.stdout: }, 2023-08-01T19:54:46.165 INFO:teuthology.orchestra.run.smithi101.stdout: { 2023-08-01T19:54:46.165 INFO:teuthology.orchestra.run.smithi101.stdout: "event": "queued_for_pg", 2023-08-01T19:54:46.165 INFO:teuthology.orchestra.run.smithi101.stdout: "time": "2023-08-01T19:54:46.136282+0000", 2023-08-01T19:54:46.166 INFO:teuthology.orchestra.run.smithi101.stdout: "duration": 5.9959999999999999e-06 2023-08-01T19:54:46.166 INFO:teuthology.orchestra.run.smithi101.stdout: }, 2023-08-01T19:54:46.166 INFO:teuthology.orchestra.run.smithi101.stdout: { 2023-08-01T19:54:46.166 INFO:teuthology.orchestra.run.smithi101.stdout: "event": "reached_pg", 2023-08-01T19:54:46.166 INFO:teuthology.orchestra.run.smithi101.stdout: "time": "2023-08-01T19:54:46.136345+0000", 2023-08-01T19:54:46.166 INFO:teuthology.orchestra.run.smithi101.stdout: "duration": 6.3013000000000001e-05 2023-08-01T19:54:46.166 INFO:teuthology.orchestra.run.smithi101.stdout: }, 2023-08-01T19:54:46.167 INFO:teuthology.orchestra.run.smithi101.stdout: { 2023-08-01T19:54:46.167 INFO:teuthology.orchestra.run.smithi101.stdout: "event": "started", 2023-08-01T19:54:46.167 INFO:teuthology.orchestra.run.smithi101.stdout: "time": "2023-08-01T19:54:46.136426+0000", 2023-08-01T19:54:46.167 INFO:teuthology.orchestra.run.smithi101.stdout: "duration": 8.1165e-05 2023-08-01T19:54:46.167 INFO:teuthology.orchestra.run.smithi101.stdout: }, 2023-08-01T19:54:46.167 INFO:teuthology.orchestra.run.smithi101.stdout: { 2023-08-01T19:54:46.167 INFO:teuthology.orchestra.run.smithi101.stdout: "event": "waiting for subops from 0", 2023-08-01T19:54:46.167 INFO:teuthology.orchestra.run.smithi101.stdout: "time": "2023-08-01T19:54:46.136508+0000", 2023-08-01T19:54:46.168 INFO:teuthology.orchestra.run.smithi101.stdout: "duration": 8.2072999999999998e-05 2023-08-01T19:54:46.168 INFO:teuthology.orchestra.run.smithi101.stdout: } 2023-08-01T19:54:46.168 INFO:teuthology.orchestra.run.smithi101.stdout: ] 2023-08-01T19:54:46.168 INFO:teuthology.orchestra.run.smithi101.stdout: } 2023-08-01T19:54:46.168 INFO:teuthology.orchestra.run.smithi101.stdout: }, 2023-08-01T19:54:46.168 INFO:teuthology.orchestra.run.smithi101.stdout: { 2023-08-01T19:54:46.168 INFO:teuthology.orchestra.run.smithi101.stdout: "description": "osd_op(client.4668.0:62640 5.f 5:f3fe9121:::benchmark_data_smithi006_114134_object62639:head [set-alloc-hint object_size 65536 write_size 65536,write 0~65536 in=65536b] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e29)", 2023-08-01T19:54:46.168 INFO:teuthology.orchestra.run.smithi101.stdout: "initiated_at": "2023-08-01T19:54:46.137010+0000", 2023-08-01T19:54:46.169 INFO:teuthology.orchestra.run.smithi101.stdout: "age": 3.3158999999999999e-05, 2023-08-01T19:54:46.169 INFO:teuthology.orchestra.run.smithi101.stdout: "duration": 0.000416191, 2023-08-01T19:54:46.169 INFO:teuthology.orchestra.run.smithi101.stdout: "type_data": { 2023-08-01T19:54:46.169 INFO:teuthology.orchestra.run.smithi101.stdout: "flag_point": "waiting for sub ops", 2023-08-01T19:54:46.169 INFO:teuthology.orchestra.run.smithi101.stdout: "client_info": { 2023-08-01T19:54:46.169 INFO:teuthology.orchestra.run.smithi101.stdout: "client": "client.4668", 2023-08-01T19:54:46.169 INFO:teuthology.orchestra.run.smithi101.stdout: "client_addr": "172.21.15.6:0/1709472247", 2023-08-01T19:54:46.169 INFO:teuthology.orchestra.run.smithi101.stdout: "tid": 62640 2023-08-01T19:54:46.170 INFO:teuthology.orchestra.run.smithi101.stdout: }, 2023-08-01T19:54:46.170 INFO:teuthology.orchestra.run.smithi101.stdout: "events": [ 2023-08-01T19:54:46.170 INFO:teuthology.orchestra.run.smithi101.stdout: { 2023-08-01T19:54:46.170 INFO:teuthology.orchestra.run.smithi101.stdout: "event": "initiated", 2023-08-01T19:54:46.170 INFO:teuthology.orchestra.run.smithi101.stdout: "time": "2023-08-01T19:54:46.137010+0000", 2023-08-01T19:54:46.170 INFO:teuthology.orchestra.run.smithi101.stdout: "duration": 0 2023-08-01T19:54:46.170 INFO:teuthology.orchestra.run.smithi101.stdout: }, 2023-08-01T19:54:46.171 INFO:teuthology.orchestra.run.smithi101.stdout: { 2023-08-01T19:54:46.171 INFO:teuthology.orchestra.run.smithi101.stdout: "event": "throttled", 2023-08-01T19:54:46.171 INFO:teuthology.orchestra.run.smithi101.stdout: "time": "2023-08-01T19:54:46.137010+0000", 2023-08-01T19:54:46.171 INFO:teuthology.orchestra.run.smithi101.stdout: "duration": 0 2023-08-01T19:54:46.171 INFO:teuthology.orchestra.run.smithi101.stdout: }, 2023-08-01T19:54:46.171 INFO:teuthology.orchestra.run.smithi101.stdout: { 2023-08-01T19:54:46.171 INFO:teuthology.orchestra.run.smithi101.stdout: "event": "header_read", 2023-08-01T19:54:46.171 INFO:teuthology.orchestra.run.smithi101.stdout: "time": "2023-08-01T19:54:46.137009+0000", 2023-08-01T19:54:46.172 INFO:teuthology.orchestra.run.smithi101.stdout: "duration": 4294967295.9999995 2023-08-01T19:54:46.172 INFO:teuthology.orchestra.run.smithi101.stdout: }, 2023-08-01T19:54:46.172 INFO:teuthology.orchestra.run.smithi101.stdout: { 2023-08-01T19:54:46.172 INFO:teuthology.orchestra.run.smithi101.stdout: "event": "all_read", 2023-08-01T19:54:46.172 INFO:teuthology.orchestra.run.smithi101.stdout: "time": "2023-08-01T19:54:46.137073+0000", 2023-08-01T19:54:46.172 INFO:teuthology.orchestra.run.smithi101.stdout: "duration": 6.3587e-05 2023-08-01T19:54:46.172 INFO:teuthology.orchestra.run.smithi101.stdout: }, 2023-08-01T19:54:46.172 INFO:teuthology.orchestra.run.smithi101.stdout: { 2023-08-01T19:54:46.173 INFO:teuthology.orchestra.run.smithi101.stdout: "event": "dispatched", 2023-08-01T19:54:46.173 INFO:teuthology.orchestra.run.smithi101.stdout: "time": "2023-08-01T19:54:46.137082+0000", 2023-08-01T19:54:46.173 INFO:teuthology.orchestra.run.smithi101.stdout: "duration": 9.448e-06 2023-08-01T19:54:46.173 INFO:teuthology.orchestra.run.smithi101.stdout: }, 2023-08-01T19:54:46.173 INFO:teuthology.orchestra.run.smithi101.stdout: { 2023-08-01T19:54:46.173 INFO:teuthology.orchestra.run.smithi101.stdout: "event": "queued_for_pg", 2023-08-01T19:54:46.173 INFO:teuthology.orchestra.run.smithi101.stdout: "time": "2023-08-01T19:54:46.137086+0000", 2023-08-01T19:54:46.173 INFO:teuthology.orchestra.run.smithi101.stdout: "duration": 4.1860000000000002e-06 2023-08-01T19:54:46.174 INFO:teuthology.orchestra.run.smithi101.stdout: }, 2023-08-01T19:54:46.174 INFO:teuthology.orchestra.run.smithi101.stdout: { 2023-08-01T19:54:46.174 INFO:teuthology.orchestra.run.smithi101.stdout: "event": "reached_pg", 2023-08-01T19:54:46.174 INFO:teuthology.orchestra.run.smithi101.stdout: "time": "2023-08-01T19:54:46.137119+0000", 2023-08-01T19:54:46.174 INFO:teuthology.orchestra.run.smithi101.stdout: "duration": 3.2320999999999998e-05 2023-08-01T19:54:46.174 INFO:teuthology.orchestra.run.smithi101.stdout: }, 2023-08-01T19:54:46.174 INFO:teuthology.orchestra.run.smithi101.stdout: { 2023-08-01T19:54:46.174 INFO:teuthology.orchestra.run.smithi101.stdout: "event": "started", 2023-08-01T19:54:46.175 INFO:teuthology.orchestra.run.smithi101.stdout: "time": "2023-08-01T19:54:46.137242+0000", 2023-08-01T19:54:46.175 INFO:teuthology.orchestra.run.smithi101.stdout: "duration": 0.000123819 2023-08-01T19:54:46.175 INFO:teuthology.orchestra.run.smithi101.stdout: }, 2023-08-01T19:54:46.175 INFO:teuthology.orchestra.run.smithi101.stdout: { 2023-08-01T19:54:46.175 INFO:teuthology.orchestra.run.smithi101.stdout: "event": "waiting for subops from 2", 2023-08-01T19:54:46.175 INFO:teuthology.orchestra.run.smithi101.stdout: "time": "2023-08-01T19:54:46.137394+0000", 2023-08-01T19:54:46.175 INFO:teuthology.orchestra.run.smithi101.stdout: "duration": 0.00015195000000000001 2023-08-01T19:54:46.175 INFO:teuthology.orchestra.run.smithi101.stdout: } 2023-08-01T19:54:46.176 INFO:teuthology.orchestra.run.smithi101.stdout: ] 2023-08-01T19:54:46.176 INFO:teuthology.orchestra.run.smithi101.stdout: } 2023-08-01T19:54:46.176 INFO:teuthology.orchestra.run.smithi101.stdout: }, 2023-08-01T19:54:46.176 INFO:teuthology.orchestra.run.smithi101.stdout: { 2023-08-01T19:54:46.176 INFO:teuthology.orchestra.run.smithi101.stdout: "description": "osd_op(client.4668.0:62641 5.7 5.4cee6777 (undecoded) ondisk+write+known_if_redirected+supports_pool_eio e29)", 2023-08-01T19:54:46.176 INFO:teuthology.orchestra.run.smithi101.stdout: "initiated_at": "2023-08-01T19:54:46.137092+0000", 2023-08-01T19:54:46.176 INFO:teuthology.orchestra.run.smithi101.stdout: "age": 4294967295.9999509, 2023-08-01T19:54:46.176 INFO:teuthology.orchestra.run.smithi101.stdout: "duration": 0.00043987900000000001, 2023-08-01T19:54:46.177 INFO:teuthology.orchestra.run.smithi101.stdout: "type_data": { 2023-08-01T19:54:46.177 INFO:teuthology.orchestra.run.smithi101.stdout: "flag_point": "queued for pg", 2023-08-01T19:54:46.177 INFO:teuthology.orchestra.run.smithi101.stdout: "client_info": { 2023-08-01T19:54:46.177 INFO:teuthology.orchestra.run.smithi101.stdout: "client": "client.4668", 2023-08-01T19:54:46.177 INFO:teuthology.orchestra.run.smithi101.stdout: "client_addr": "172.21.15.6:0/1709472247", 2023-08-01T19:54:46.177 INFO:teuthology.orchestra.run.smithi101.stdout: "tid": 62641 2023-08-01T19:54:46.177 INFO:teuthology.orchestra.run.smithi101.stdout: }, 2023-08-01T19:54:46.177 INFO:teuthology.orchestra.run.smithi101.stdout: "events": [ 2023-08-01T19:54:46.178 INFO:teuthology.orchestra.run.smithi101.stdout: { 2023-08-01T19:54:46.178 INFO:teuthology.orchestra.run.smithi101.stdout: "event": "initiated", 2023-08-01T19:54:46.178 INFO:teuthology.orchestra.run.smithi101.stdout: "time": "2023-08-01T19:54:46.137092+0000", 2023-08-01T19:54:46.178 INFO:teuthology.orchestra.run.smithi101.stdout: "duration": 0 2023-08-01T19:54:46.178 INFO:teuthology.orchestra.run.smithi101.stdout: }, 2023-08-01T19:54:46.178 INFO:teuthology.orchestra.run.smithi101.stdout: { 2023-08-01T19:54:46.178 INFO:teuthology.orchestra.run.smithi101.stdout: "event": "throttled", 2023-08-01T19:54:46.179 INFO:teuthology.orchestra.run.smithi101.stdout: "time": "2023-08-01T19:54:46.137092+0000", 2023-08-01T19:54:46.179 INFO:teuthology.orchestra.run.smithi101.stdout: "duration": 0 2023-08-01T19:54:46.179 INFO:teuthology.orchestra.run.smithi101.stdout: }, 2023-08-01T19:54:46.179 INFO:teuthology.orchestra.run.smithi101.stdout: { 2023-08-01T19:54:46.179 INFO:teuthology.orchestra.run.smithi101.stdout: "event": "header_read", 2023-08-01T19:54:46.179 INFO:teuthology.orchestra.run.smithi101.stdout: "time": "2023-08-01T19:54:46.137092+0000", 2023-08-01T19:54:46.179 INFO:teuthology.orchestra.run.smithi101.stdout: "duration": 4294967295.9999995 2023-08-01T19:54:46.179 INFO:teuthology.orchestra.run.smithi101.stdout: }, 2023-08-01T19:54:46.180 INFO:teuthology.orchestra.run.smithi101.stdout: { 2023-08-01T19:54:46.180 INFO:teuthology.orchestra.run.smithi101.stdout: "event": "all_read", 2023-08-01T19:54:46.180 INFO:teuthology.orchestra.run.smithi101.stdout: "time": "2023-08-01T19:54:46.137128+0000", 2023-08-01T19:54:46.180 INFO:teuthology.orchestra.run.smithi101.stdout: "duration": 3.6455999999999998e-05 2023-08-01T19:54:46.180 INFO:teuthology.orchestra.run.smithi101.stdout: }, 2023-08-01T19:54:46.180 INFO:teuthology.orchestra.run.smithi101.stdout: { 2023-08-01T19:54:46.180 INFO:teuthology.orchestra.run.smithi101.stdout: "event": "dispatched", 2023-08-01T19:54:46.180 INFO:teuthology.orchestra.run.smithi101.stdout: "time": "2023-08-01T19:54:46.137134+0000", 2023-08-01T19:54:46.181 INFO:teuthology.orchestra.run.smithi101.stdout: "duration": 5.7209999999999999e-06 2023-08-01T19:54:46.181 INFO:teuthology.orchestra.run.smithi101.stdout: }, 2023-08-01T19:54:46.181 INFO:teuthology.orchestra.run.smithi101.stdout: { 2023-08-01T19:54:46.181 INFO:teuthology.orchestra.run.smithi101.stdout: "event": "queued_for_pg", 2023-08-01T19:54:46.181 INFO:teuthology.orchestra.run.smithi101.stdout: "time": "2023-08-01T19:54:46.137137+0000", 2023-08-01T19:54:46.181 INFO:teuthology.orchestra.run.smithi101.stdout: "duration": 2.9229999999999998e-06 2023-08-01T19:54:46.181 INFO:teuthology.orchestra.run.smithi101.stdout: } 2023-08-01T19:54:46.181 INFO:teuthology.orchestra.run.smithi101.stdout: ] 2023-08-01T19:54:46.182 INFO:teuthology.orchestra.run.smithi101.stdout: } 2023-08-01T19:54:46.182 INFO:teuthology.orchestra.run.smithi101.stdout: }, 2023-08-01T19:54:46.182 INFO:teuthology.orchestra.run.smithi101.stdout: { 2023-08-01T19:54:46.182 INFO:teuthology.orchestra.run.smithi101.stdout: "description": "osd_op(client.4668.0:62643 5.f 5.acaef37f (undecoded) ondisk+write+known_if_redirected+supports_pool_eio e29)", 2023-08-01T19:54:46.182 INFO:teuthology.orchestra.run.smithi101.stdout: "initiated_at": "2023-08-01T19:54:46.137362+0000", 2023-08-01T19:54:46.182 INFO:teuthology.orchestra.run.smithi101.stdout: "age": 4294967295.999681, 2023-08-01T19:54:46.182 INFO:teuthology.orchestra.run.smithi101.stdout: "duration": 0.000234155, 2023-08-01T19:54:46.183 INFO:teuthology.orchestra.run.smithi101.stdout: "type_data": { 2023-08-01T19:54:46.183 INFO:teuthology.orchestra.run.smithi101.stdout: "flag_point": "queued for pg", 2023-08-01T19:54:46.183 INFO:teuthology.orchestra.run.smithi101.stdout: "client_info": { 2023-08-01T19:54:46.183 INFO:teuthology.orchestra.run.smithi101.stdout: "client": "client.4668", 2023-08-01T19:54:46.183 INFO:teuthology.orchestra.run.smithi101.stdout: "client_addr": "172.21.15.6:0/1709472247", 2023-08-01T19:54:46.183 INFO:teuthology.orchestra.run.smithi101.stdout: "tid": 62643 2023-08-01T19:54:46.183 INFO:teuthology.orchestra.run.smithi101.stdout: }, 2023-08-01T19:54:46.183 INFO:teuthology.orchestra.run.smithi101.stdout: "events": [ 2023-08-01T19:54:46.184 INFO:teuthology.orchestra.run.smithi101.stdout: { 2023-08-01T19:54:46.184 INFO:teuthology.orchestra.run.smithi101.stdout: "event": "initiated", 2023-08-01T19:54:46.184 INFO:teuthology.orchestra.run.smithi101.stdout: "time": "2023-08-01T19:54:46.137362+0000", 2023-08-01T19:54:46.184 INFO:teuthology.orchestra.run.smithi101.stdout: "duration": 0 2023-08-01T19:54:46.184 INFO:teuthology.orchestra.run.smithi101.stdout: }, 2023-08-01T19:54:46.184 INFO:teuthology.orchestra.run.smithi101.stdout: { 2023-08-01T19:54:46.184 INFO:teuthology.orchestra.run.smithi101.stdout: "event": "throttled", 2023-08-01T19:54:46.185 INFO:teuthology.orchestra.run.smithi101.stdout: "time": "2023-08-01T19:54:46.137362+0000", 2023-08-01T19:54:46.185 INFO:teuthology.orchestra.run.smithi101.stdout: "duration": 0 2023-08-01T19:54:46.185 INFO:teuthology.orchestra.run.smithi101.stdout: }, 2023-08-01T19:54:46.185 INFO:teuthology.orchestra.run.smithi101.stdout: { 2023-08-01T19:54:46.185 INFO:teuthology.orchestra.run.smithi101.stdout: "event": "header_read", 2023-08-01T19:54:46.185 INFO:teuthology.orchestra.run.smithi101.stdout: "time": "2023-08-01T19:54:46.137362+0000", 2023-08-01T19:54:46.185 INFO:teuthology.orchestra.run.smithi101.stdout: "duration": 4294967295.9999995 2023-08-01T19:54:46.185 INFO:teuthology.orchestra.run.smithi101.stdout: }, 2023-08-01T19:54:46.186 INFO:teuthology.orchestra.run.smithi101.stdout: { 2023-08-01T19:54:46.186 INFO:teuthology.orchestra.run.smithi101.stdout: "event": "all_read", 2023-08-01T19:54:46.186 INFO:teuthology.orchestra.run.smithi101.stdout: "time": "2023-08-01T19:54:46.137476+0000", 2023-08-01T19:54:46.186 INFO:teuthology.orchestra.run.smithi101.stdout: "duration": 0.000114184 2023-08-01T19:54:46.186 INFO:teuthology.orchestra.run.smithi101.stdout: }, 2023-08-01T19:54:46.186 INFO:teuthology.orchestra.run.smithi101.stdout: { 2023-08-01T19:54:46.186 INFO:teuthology.orchestra.run.smithi101.stdout: "event": "dispatched", 2023-08-01T19:54:46.186 INFO:teuthology.orchestra.run.smithi101.stdout: "time": "2023-08-01T19:54:46.137483+0000", 2023-08-01T19:54:46.187 INFO:teuthology.orchestra.run.smithi101.stdout: "duration": 7.2679999999999997e-06 2023-08-01T19:54:46.187 INFO:teuthology.orchestra.run.smithi101.stdout: }, 2023-08-01T19:54:46.187 INFO:teuthology.orchestra.run.smithi101.stdout: { 2023-08-01T19:54:46.187 INFO:teuthology.orchestra.run.smithi101.stdout: "event": "queued_for_pg", 2023-08-01T19:54:46.187 INFO:teuthology.orchestra.run.smithi101.stdout: "time": "2023-08-01T19:54:46.137488+0000", 2023-08-01T19:54:46.187 INFO:teuthology.orchestra.run.smithi101.stdout: "duration": 5.0209999999999999e-06 2023-08-01T19:54:46.187 INFO:teuthology.orchestra.run.smithi101.stdout: } 2023-08-01T19:54:46.187 INFO:teuthology.orchestra.run.smithi101.stdout: ] 2023-08-01T19:54:46.188 INFO:teuthology.orchestra.run.smithi101.stdout: } 2023-08-01T19:54:46.188 INFO:teuthology.orchestra.run.smithi101.stdout: } 2023-08-01T19:54:46.188 INFO:teuthology.orchestra.run.smithi101.stdout: ], 2023-08-01T19:54:46.188 INFO:teuthology.orchestra.run.smithi101.stdout: "num_ops": 7 2023-08-01T19:54:46.188 INFO:teuthology.orchestra.run.smithi101.stdout:} 2023-08-01T19:54:46.189 DEBUG:teuthology.orchestra.run.smithi101:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 30 ceph --cluster ceph --admin-daemon /var/run/ceph/ceph-osd.1.asok dump_blocked_ops 2023-08-01T19:54:46.190 INFO:tasks.ceph.osd.2.smithi155.stderr:2023-08-01T19:54:46.187+0000 7faa5c6ac700 -1 received signal: Hangup from /usr/bin/python3 /bin/daemon-helper kill ceph-osd -f --cluster ceph -i 2 (PID: 111337) UID: 0 2023-08-01T19:54:46.291 INFO:tasks.ceph.osd.0.smithi008.stderr:2023-08-01T19:54:46.290+0000 7f16a58f4700 -1 received signal: Hangup from /usr/bin/python3 /bin/daemon-helper kill ceph-osd -f --cluster ceph -i 0 (PID: 111179) UID: 0 2023-08-01T19:54:46.314 INFO:tasks.radosbench.radosbench.0.smithi006.stdout: 22 16 63014 62998 178.957 128 0.0057441 0.00558465 2023-08-01T19:54:46.361 INFO:teuthology.orchestra.run.smithi101.stdout:{ 2023-08-01T19:54:46.362 INFO:teuthology.orchestra.run.smithi101.stdout: "ops": [], 2023-08-01T19:54:46.362 INFO:teuthology.orchestra.run.smithi101.stdout: "complaint_time": 30, 2023-08-01T19:54:46.362 INFO:teuthology.orchestra.run.smithi101.stdout: "num_blocked_ops": 0 2023-08-01T19:54:46.362 INFO:teuthology.orchestra.run.smithi101.stdout:} 2023-08-01T19:54:46.377 DEBUG:teuthology.orchestra.run.smithi101:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 30 ceph --cluster ceph --admin-daemon /var/run/ceph/ceph-osd.1.asok dump_historic_ops 2023-08-01T19:54:46.390 INFO:tasks.ceph.osd.0.smithi008.stderr:2023-08-01T19:54:46.390+0000 7f16a58f4700 -1 received signal: Hangup from /usr/bin/python3 /bin/daemon-helper kill ceph-osd -f --cluster ceph -i 0 (PID: 111179) UID: 0 2023-08-01T19:54:46.491 INFO:tasks.ceph.osd.2.smithi155.stderr:2023-08-01T19:54:46.489+0000 7faa5c6ac700 -1 received signal: Hangup from /usr/bin/python3 /bin/daemon-helper kill ceph-osd -f --cluster ceph -i 2 (PID: 111337) UID: 0 2023-08-01T19:54:46.552 INFO:teuthology.orchestra.run.smithi101.stdout:{ 2023-08-01T19:54:46.552 INFO:teuthology.orchestra.run.smithi101.stdout: "size": 20, 2023-08-01T19:54:46.552 INFO:teuthology.orchestra.run.smithi101.stdout: "duration": 600, 2023-08-01T19:54:46.552 INFO:teuthology.orchestra.run.smithi101.stdout: "ops": [ 2023-08-01T19:54:46.552 INFO:teuthology.orchestra.run.smithi101.stdout: { 2023-08-01T19:54:46.552 INFO:teuthology.orchestra.run.smithi101.stdout: "description": "osd_op(mds.0.3:6 3.10 3:0d82a743:::600.00000000:head [omap-set-header] snapc 0=[] ondisk+write+known_if_redirected+full_force+supports_pool_eio e17)", 2023-08-01T19:54:46.553 INFO:teuthology.orchestra.run.smithi101.stdout: "initiated_at": "2023-08-01T19:54:04.458774+0000", 2023-08-01T19:54:46.553 INFO:teuthology.orchestra.run.smithi101.stdout: "age": 42.090302528000002, 2023-08-01T19:54:46.553 INFO:teuthology.orchestra.run.smithi101.stdout: "duration": 0.017582611000000001, 2023-08-01T19:54:46.553 INFO:teuthology.orchestra.run.smithi101.stdout: "type_data": { 2023-08-01T19:54:46.553 INFO:teuthology.orchestra.run.smithi101.stdout: "flag_point": "commit sent; apply or cleanup", 2023-08-01T19:54:46.553 INFO:teuthology.orchestra.run.smithi101.stdout: "events": [ 2023-08-01T19:54:46.553 INFO:teuthology.orchestra.run.smithi101.stdout: { 2023-08-01T19:54:46.554 INFO:teuthology.orchestra.run.smithi101.stdout: "event": "initiated", 2023-08-01T19:54:46.554 INFO:teuthology.orchestra.run.smithi101.stdout: "time": "2023-08-01T19:54:04.458774+0000", 2023-08-01T19:54:46.554 INFO:teuthology.orchestra.run.smithi101.stdout: "duration": 0 2023-08-01T19:54:46.554 INFO:teuthology.orchestra.run.smithi101.stdout: }, 2023-08-01T19:54:46.554 INFO:teuthology.orchestra.run.smithi101.stdout: { 2023-08-01T19:54:46.554 INFO:teuthology.orchestra.run.smithi101.stdout: "event": "throttled", 2023-08-01T19:54:46.554 INFO:teuthology.orchestra.run.smithi101.stdout: "time": "2023-08-01T19:54:04.458774+0000", 2023-08-01T19:54:46.554 INFO:teuthology.orchestra.run.smithi101.stdout: "duration": 0 2023-08-01T19:54:46.555 INFO:teuthology.orchestra.run.smithi101.stdout: }, 2023-08-01T19:54:46.555 INFO:teuthology.orchestra.run.smithi101.stdout: { 2023-08-01T19:54:46.555 INFO:teuthology.orchestra.run.smithi101.stdout: "event": "header_read", 2023-08-01T19:54:46.555 INFO:teuthology.orchestra.run.smithi101.stdout: "time": "2023-08-01T19:54:04.458772+0000", 2023-08-01T19:54:46.555 INFO:teuthology.orchestra.run.smithi101.stdout: "duration": 4294967295.9999981 2023-08-01T19:54:46.555 INFO:teuthology.orchestra.run.smithi101.stdout: }, 2023-08-01T19:54:46.555 INFO:teuthology.orchestra.run.smithi101.stdout: { 2023-08-01T19:54:46.555 INFO:teuthology.orchestra.run.smithi101.stdout: "event": "all_read", 2023-08-01T19:54:46.556 INFO:teuthology.orchestra.run.smithi101.stdout: "time": "2023-08-01T19:54:04.458781+0000", 2023-08-01T19:54:46.556 INFO:teuthology.orchestra.run.smithi101.stdout: "duration": 8.6670000000000002e-06 2023-08-01T19:54:46.556 INFO:teuthology.orchestra.run.smithi101.stdout: }, 2023-08-01T19:54:46.556 INFO:teuthology.orchestra.run.smithi101.stdout: { 2023-08-01T19:54:46.556 INFO:teuthology.orchestra.run.smithi101.stdout: "event": "dispatched", 2023-08-01T19:54:46.556 INFO:teuthology.orchestra.run.smithi101.stdout: "time": "2023-08-01T19:54:04.458797+0000", 2023-08-01T19:54:46.556 INFO:teuthology.orchestra.run.smithi101.stdout: "duration": 1.6463000000000001e-05 2023-08-01T19:54:46.556 INFO:teuthology.orchestra.run.smithi101.stdout: }, 2023-08-01T19:54:46.557 INFO:teuthology.orchestra.run.smithi101.stdout: { 2023-08-01T19:54:46.557 INFO:teuthology.orchestra.run.smithi101.stdout: "event": "queued_for_pg", 2023-08-01T19:54:46.557 INFO:teuthology.orchestra.run.smithi101.stdout: "time": "2023-08-01T19:54:04.458810+0000", 2023-08-01T19:54:46.557 INFO:teuthology.orchestra.run.smithi101.stdout: "duration": 1.2753e-05 2023-08-01T19:54:46.557 INFO:teuthology.orchestra.run.smithi101.stdout: }, 2023-08-01T19:54:46.557 INFO:teuthology.orchestra.run.smithi101.stdout: { 2023-08-01T19:54:46.557 INFO:teuthology.orchestra.run.smithi101.stdout: "event": "reached_pg", 2023-08-01T19:54:46.557 INFO:teuthology.orchestra.run.smithi101.stdout: "time": "2023-08-01T19:54:04.458866+0000", 2023-08-01T19:54:46.558 INFO:teuthology.orchestra.run.smithi101.stdout: "duration": 5.6625000000000001e-05 2023-08-01T19:54:46.558 INFO:teuthology.orchestra.run.smithi101.stdout: }, 2023-08-01T19:54:46.558 INFO:teuthology.orchestra.run.smithi101.stdout: { 2023-08-01T19:54:46.558 INFO:teuthology.orchestra.run.smithi101.stdout: "event": "op must wait for map", 2023-08-01T19:54:46.558 INFO:teuthology.orchestra.run.smithi101.stdout: "time": "2023-08-01T19:54:04.458873+0000", 2023-08-01T19:54:46.558 INFO:teuthology.orchestra.run.smithi101.stdout: "duration": 6.9110000000000004e-06 2023-08-01T19:54:46.558 INFO:teuthology.orchestra.run.smithi101.stdout: }, 2023-08-01T19:54:46.559 INFO:teuthology.orchestra.run.smithi101.stdout: { 2023-08-01T19:54:46.559 INFO:teuthology.orchestra.run.smithi101.stdout: "event": "reached_pg", 2023-08-01T19:54:46.559 INFO:teuthology.orchestra.run.smithi101.stdout: "time": "2023-08-01T19:54:04.466999+0000", 2023-08-01T19:54:46.559 INFO:teuthology.orchestra.run.smithi101.stdout: "duration": 0.0081256550000000007 2023-08-01T19:54:46.559 INFO:teuthology.orchestra.run.smithi101.stdout: }, 2023-08-01T19:54:46.559 INFO:teuthology.orchestra.run.smithi101.stdout: { 2023-08-01T19:54:46.559 INFO:teuthology.orchestra.run.smithi101.stdout: "event": "started", 2023-08-01T19:54:46.559 INFO:teuthology.orchestra.run.smithi101.stdout: "time": "2023-08-01T19:54:04.467201+0000", 2023-08-01T19:54:46.560 INFO:teuthology.orchestra.run.smithi101.stdout: "duration": 0.00020166199999999999 2023-08-01T19:54:46.560 INFO:teuthology.orchestra.run.smithi101.stdout: }, 2023-08-01T19:54:46.560 INFO:teuthology.orchestra.run.smithi101.stdout: { 2023-08-01T19:54:46.560 INFO:teuthology.orchestra.run.smithi101.stdout: "event": "waiting for subops from 2", 2023-08-01T19:54:46.560 INFO:teuthology.orchestra.run.smithi101.stdout: "time": "2023-08-01T19:54:04.467350+0000", 2023-08-01T19:54:46.560 INFO:teuthology.orchestra.run.smithi101.stdout: "duration": 0.000149173 2023-08-01T19:54:46.560 INFO:teuthology.orchestra.run.smithi101.stdout: }, 2023-08-01T19:54:46.560 INFO:teuthology.orchestra.run.smithi101.stdout: { 2023-08-01T19:54:46.561 INFO:teuthology.orchestra.run.smithi101.stdout: "event": "op_commit", 2023-08-01T19:54:46.561 INFO:teuthology.orchestra.run.smithi101.stdout: "time": "2023-08-01T19:54:04.476168+0000", 2023-08-01T19:54:46.561 INFO:teuthology.orchestra.run.smithi101.stdout: "duration": 0.0088183250000000001 2023-08-01T19:54:46.561 INFO:teuthology.orchestra.run.smithi101.stdout: }, 2023-08-01T19:54:46.561 INFO:teuthology.orchestra.run.smithi101.stdout: { 2023-08-01T19:54:46.561 INFO:teuthology.orchestra.run.smithi101.stdout: "event": "sub_op_commit_rec", 2023-08-01T19:54:46.561 INFO:teuthology.orchestra.run.smithi101.stdout: "time": "2023-08-01T19:54:04.476239+0000", 2023-08-01T19:54:46.561 INFO:teuthology.orchestra.run.smithi101.stdout: "duration": 7.1296000000000003e-05 2023-08-01T19:54:46.562 INFO:teuthology.orchestra.run.smithi101.stdout: }, 2023-08-01T19:54:46.562 INFO:teuthology.orchestra.run.smithi101.stdout: { 2023-08-01T19:54:46.562 INFO:teuthology.orchestra.run.smithi101.stdout: "event": "commit_sent", 2023-08-01T19:54:46.562 INFO:teuthology.orchestra.run.smithi101.stdout: "time": "2023-08-01T19:54:04.476290+0000", 2023-08-01T19:54:46.562 INFO:teuthology.orchestra.run.smithi101.stdout: "duration": 5.0423999999999997e-05 2023-08-01T19:54:46.562 INFO:teuthology.orchestra.run.smithi101.stdout: }, 2023-08-01T19:54:46.562 INFO:teuthology.orchestra.run.smithi101.stdout: { 2023-08-01T19:54:46.562 INFO:teuthology.orchestra.run.smithi101.stdout: "event": "done", 2023-08-01T19:54:46.563 INFO:teuthology.orchestra.run.smithi101.stdout: "time": "2023-08-01T19:54:04.476356+0000", 2023-08-01T19:54:46.563 INFO:teuthology.orchestra.run.smithi101.stdout: "duration": 6.6439000000000005e-05 2023-08-01T19:54:46.563 INFO:teuthology.orchestra.run.smithi101.stdout: } 2023-08-01T19:54:46.563 INFO:teuthology.orchestra.run.smithi101.stdout: ] 2023-08-01T19:54:46.563 INFO:teuthology.orchestra.run.smithi101.stdout: } 2023-08-01T19:54:46.563 INFO:teuthology.orchestra.run.smithi101.stdout: }, 2023-08-01T19:54:46.563 INFO:teuthology.orchestra.run.smithi101.stdout: { 2023-08-01T19:54:46.563 INFO:teuthology.orchestra.run.smithi101.stdout: "description": "osd_op(mds.0.3:7 3.10 3:0d82a743:::600.00000000:head [create,setxattr parent (62) in=6b,setxattr layout (30) in=6b] snapc 0=[] ondisk+write+known_if_redirected+full_force+supports_pool_eio e17)", 2023-08-01T19:54:46.564 INFO:teuthology.orchestra.run.smithi101.stdout: "initiated_at": "2023-08-01T19:54:04.458830+0000", 2023-08-01T19:54:46.564 INFO:teuthology.orchestra.run.smithi101.stdout: "age": 42.090246141000002, 2023-08-01T19:54:46.564 INFO:teuthology.orchestra.run.smithi101.stdout: "duration": 0.018463726, 2023-08-01T19:54:46.564 INFO:teuthology.orchestra.run.smithi101.stdout: "type_data": { 2023-08-01T19:54:46.564 INFO:teuthology.orchestra.run.smithi101.stdout: "flag_point": "commit sent; apply or cleanup", 2023-08-01T19:54:46.564 INFO:teuthology.orchestra.run.smithi101.stdout: "events": [ 2023-08-01T19:54:46.564 INFO:teuthology.orchestra.run.smithi101.stdout: { 2023-08-01T19:54:46.565 INFO:teuthology.orchestra.run.smithi101.stdout: "event": "initiated", 2023-08-01T19:54:46.565 INFO:teuthology.orchestra.run.smithi101.stdout: "time": "2023-08-01T19:54:04.458830+0000", 2023-08-01T19:54:46.565 INFO:teuthology.orchestra.run.smithi101.stdout: "duration": 0 2023-08-01T19:54:46.565 INFO:teuthology.orchestra.run.smithi101.stdout: }, 2023-08-01T19:54:46.565 INFO:teuthology.orchestra.run.smithi101.stdout: { 2023-08-01T19:54:46.565 INFO:teuthology.orchestra.run.smithi101.stdout: "event": "throttled", 2023-08-01T19:54:46.565 INFO:teuthology.orchestra.run.smithi101.stdout: "time": "2023-08-01T19:54:04.458830+0000", 2023-08-01T19:54:46.565 INFO:teuthology.orchestra.run.smithi101.stdout: "duration": 0 2023-08-01T19:54:46.566 INFO:teuthology.orchestra.run.smithi101.stdout: }, 2023-08-01T19:54:46.566 INFO:teuthology.orchestra.run.smithi101.stdout: { 2023-08-01T19:54:46.566 INFO:teuthology.orchestra.run.smithi101.stdout: "event": "header_read", 2023-08-01T19:54:46.566 INFO:teuthology.orchestra.run.smithi101.stdout: "time": "2023-08-01T19:54:04.458829+0000", 2023-08-01T19:54:46.566 INFO:teuthology.orchestra.run.smithi101.stdout: "duration": 4294967295.999999 2023-08-01T19:54:46.566 INFO:teuthology.orchestra.run.smithi101.stdout: }, 2023-08-01T19:54:46.566 INFO:teuthology.orchestra.run.smithi101.stdout: { 2023-08-01T19:54:46.566 INFO:teuthology.orchestra.run.smithi101.stdout: "event": "all_read", 2023-08-01T19:54:46.567 INFO:teuthology.orchestra.run.smithi101.stdout: "time": "2023-08-01T19:54:04.458838+0000", 2023-08-01T19:54:46.567 INFO:teuthology.orchestra.run.smithi101.stdout: "duration": 8.5369999999999997e-06 2023-08-01T19:54:46.567 INFO:teuthology.orchestra.run.smithi101.stdout: }, 2023-08-01T19:54:46.567 INFO:teuthology.orchestra.run.smithi101.stdout: { 2023-08-01T19:54:46.567 INFO:teuthology.orchestra.run.smithi101.stdout: "event": "dispatched", 2023-08-01T19:54:46.567 INFO:teuthology.orchestra.run.smithi101.stdout: "time": "2023-08-01T19:54:04.458850+0000", 2023-08-01T19:54:46.567 INFO:teuthology.orchestra.run.smithi101.stdout: "duration": 1.203e-05 2023-08-01T19:54:46.567 INFO:teuthology.orchestra.run.smithi101.stdout: }, 2023-08-01T19:54:46.568 INFO:teuthology.orchestra.run.smithi101.stdout: { 2023-08-01T19:54:46.568 INFO:teuthology.orchestra.run.smithi101.stdout: "event": "queued_for_pg", 2023-08-01T19:54:46.568 INFO:teuthology.orchestra.run.smithi101.stdout: "time": "2023-08-01T19:54:04.458859+0000", 2023-08-01T19:54:46.568 INFO:teuthology.orchestra.run.smithi101.stdout: "duration": 8.9889999999999998e-06 2023-08-01T19:54:46.568 INFO:teuthology.orchestra.run.smithi101.stdout: }, 2023-08-01T19:54:46.568 INFO:teuthology.orchestra.run.smithi101.stdout: { 2023-08-01T19:54:46.568 INFO:teuthology.orchestra.run.smithi101.stdout: "event": "reached_pg", 2023-08-01T19:54:46.568 INFO:teuthology.orchestra.run.smithi101.stdout: "time": "2023-08-01T19:54:04.458926+0000", 2023-08-01T19:54:46.569 INFO:teuthology.orchestra.run.smithi101.stdout: "duration": 6.6741000000000004e-05 2023-08-01T19:54:46.569 INFO:teuthology.orchestra.run.smithi101.stdout: }, 2023-08-01T19:54:46.569 INFO:teuthology.orchestra.run.smithi101.stdout: { 2023-08-01T19:54:46.569 INFO:teuthology.orchestra.run.smithi101.stdout: "event": "waiting_for_map not empty", 2023-08-01T19:54:46.569 INFO:teuthology.orchestra.run.smithi101.stdout: "time": "2023-08-01T19:54:04.458929+0000", 2023-08-01T19:54:46.569 INFO:teuthology.orchestra.run.smithi101.stdout: "duration": 3.303e-06 2023-08-01T19:54:46.569 INFO:teuthology.orchestra.run.smithi101.stdout: }, 2023-08-01T19:54:46.569 INFO:teuthology.orchestra.run.smithi101.stdout: { 2023-08-01T19:54:46.570 INFO:teuthology.orchestra.run.smithi101.stdout: "event": "reached_pg", 2023-08-01T19:54:46.570 INFO:teuthology.orchestra.run.smithi101.stdout: "time": "2023-08-01T19:54:04.468692+0000", 2023-08-01T19:54:46.570 INFO:teuthology.orchestra.run.smithi101.stdout: "duration": 0.0097635910000000003 2023-08-01T19:54:46.570 INFO:teuthology.orchestra.run.smithi101.stdout: }, 2023-08-01T19:54:46.570 INFO:teuthology.orchestra.run.smithi101.stdout: { 2023-08-01T19:54:46.570 INFO:teuthology.orchestra.run.smithi101.stdout: "event": "started", 2023-08-01T19:54:46.570 INFO:teuthology.orchestra.run.smithi101.stdout: "time": "2023-08-01T19:54:04.468774+0000", 2023-08-01T19:54:46.570 INFO:teuthology.orchestra.run.smithi101.stdout: "duration": 8.1092000000000002e-05 2023-08-01T19:54:46.571 INFO:teuthology.orchestra.run.smithi101.stdout: }, 2023-08-01T19:54:46.571 INFO:teuthology.orchestra.run.smithi101.stdout: { 2023-08-01T19:54:46.571 INFO:teuthology.orchestra.run.smithi101.stdout: "event": "waiting for subops from 2", 2023-08-01T19:54:46.571 INFO:teuthology.orchestra.run.smithi101.stdout: "time": "2023-08-01T19:54:04.468934+0000", 2023-08-01T19:54:46.571 INFO:teuthology.orchestra.run.smithi101.stdout: "duration": 0.000160027 2023-08-01T19:54:46.571 INFO:teuthology.orchestra.run.smithi101.stdout: }, 2023-08-01T19:54:46.571 INFO:teuthology.orchestra.run.smithi101.stdout: { 2023-08-01T19:54:46.571 INFO:teuthology.orchestra.run.smithi101.stdout: "event": "op_commit", 2023-08-01T19:54:46.572 INFO:teuthology.orchestra.run.smithi101.stdout: "time": "2023-08-01T19:54:04.476174+0000", 2023-08-01T19:54:46.572 INFO:teuthology.orchestra.run.smithi101.stdout: "duration": 0.0072400479999999998 2023-08-01T19:54:46.572 INFO:teuthology.orchestra.run.smithi101.stdout: }, 2023-08-01T19:54:46.572 INFO:teuthology.orchestra.run.smithi101.stdout: { 2023-08-01T19:54:46.572 INFO:teuthology.orchestra.run.smithi101.stdout: "event": "sub_op_commit_rec", 2023-08-01T19:54:46.572 INFO:teuthology.orchestra.run.smithi101.stdout: "time": "2023-08-01T19:54:04.477206+0000", 2023-08-01T19:54:46.572 INFO:teuthology.orchestra.run.smithi101.stdout: "duration": 0.0010318969999999999 2023-08-01T19:54:46.572 INFO:teuthology.orchestra.run.smithi101.stdout: }, 2023-08-01T19:54:46.573 INFO:teuthology.orchestra.run.smithi101.stdout: { 2023-08-01T19:54:46.573 INFO:teuthology.orchestra.run.smithi101.stdout: "event": "commit_sent", 2023-08-01T19:54:46.573 INFO:teuthology.orchestra.run.smithi101.stdout: "time": "2023-08-01T19:54:04.477257+0000", 2023-08-01T19:54:46.573 INFO:teuthology.orchestra.run.smithi101.stdout: "duration": 5.1156000000000003e-05 2023-08-01T19:54:46.573 INFO:teuthology.orchestra.run.smithi101.stdout: }, 2023-08-01T19:54:46.573 INFO:teuthology.orchestra.run.smithi101.stdout: { 2023-08-01T19:54:46.573 INFO:teuthology.orchestra.run.smithi101.stdout: "event": "done", 2023-08-01T19:54:46.573 INFO:teuthology.orchestra.run.smithi101.stdout: "time": "2023-08-01T19:54:04.477294+0000", 2023-08-01T19:54:46.574 INFO:teuthology.orchestra.run.smithi101.stdout: "duration": 3.7150000000000002e-05 2023-08-01T19:54:46.574 INFO:teuthology.orchestra.run.smithi101.stdout: } 2023-08-01T19:54:46.574 INFO:teuthology.orchestra.run.smithi101.stdout: ] 2023-08-01T19:54:46.574 INFO:teuthology.orchestra.run.smithi101.stdout: } 2023-08-01T19:54:46.574 INFO:teuthology.orchestra.run.smithi101.stdout: }, 2023-08-01T19:54:46.574 INFO:teuthology.orchestra.run.smithi101.stdout: { 2023-08-01T19:54:46.574 INFO:teuthology.orchestra.run.smithi101.stdout: "description": "osd_op(mds.0.3:8 3.10 3:09401a81:::601.00000000:head [omap-set-header] snapc 0=[] ondisk+write+known_if_redirected+full_force+supports_pool_eio e17)", 2023-08-01T19:54:46.574 INFO:teuthology.orchestra.run.smithi101.stdout: "initiated_at": "2023-08-01T19:54:04.458869+0000", 2023-08-01T19:54:46.575 INFO:teuthology.orchestra.run.smithi101.stdout: "age": 42.090207005000003, 2023-08-01T19:54:46.575 INFO:teuthology.orchestra.run.smithi101.stdout: "duration": 0.018528932000000001, 2023-08-01T19:54:46.575 INFO:teuthology.orchestra.run.smithi101.stdout: "type_data": { 2023-08-01T19:54:46.575 INFO:teuthology.orchestra.run.smithi101.stdout: "flag_point": "commit sent; apply or cleanup", 2023-08-01T19:54:46.575 INFO:teuthology.orchestra.run.smithi101.stdout: "events": [ 2023-08-01T19:54:46.575 INFO:teuthology.orchestra.run.smithi101.stdout: { 2023-08-01T19:54:46.575 INFO:teuthology.orchestra.run.smithi101.stdout: "event": "initiated", 2023-08-01T19:54:46.575 INFO:teuthology.orchestra.run.smithi101.stdout: "time": "2023-08-01T19:54:04.458869+0000", 2023-08-01T19:54:46.576 INFO:teuthology.orchestra.run.smithi101.stdout: "duration": 0 2023-08-01T19:54:46.576 INFO:teuthology.orchestra.run.smithi101.stdout: }, 2023-08-01T19:54:46.576 INFO:teuthology.orchestra.run.smithi101.stdout: { 2023-08-01T19:54:46.576 INFO:teuthology.orchestra.run.smithi101.stdout: "event": "throttled", 2023-08-01T19:54:46.576 INFO:teuthology.orchestra.run.smithi101.stdout: "time": "2023-08-01T19:54:04.458869+0000", 2023-08-01T19:54:46.576 INFO:teuthology.orchestra.run.smithi101.stdout: "duration": 0 2023-08-01T19:54:46.576 INFO:teuthology.orchestra.run.smithi101.stdout: }, 2023-08-01T19:54:46.577 INFO:teuthology.orchestra.run.smithi101.stdout: { 2023-08-01T19:54:46.577 INFO:teuthology.orchestra.run.smithi101.stdout: "event": "header_read", 2023-08-01T19:54:46.577 INFO:teuthology.orchestra.run.smithi101.stdout: "time": "2023-08-01T19:54:04.458869+0000", 2023-08-01T19:54:46.577 INFO:teuthology.orchestra.run.smithi101.stdout: "duration": 4294967295.9999995 2023-08-01T19:54:46.577 INFO:teuthology.orchestra.run.smithi101.stdout: }, 2023-08-01T19:54:46.577 INFO:teuthology.orchestra.run.smithi101.stdout: { 2023-08-01T19:54:46.577 INFO:teuthology.orchestra.run.smithi101.stdout: "event": "all_read", 2023-08-01T19:54:46.577 INFO:teuthology.orchestra.run.smithi101.stdout: "time": "2023-08-01T19:54:04.458878+0000", 2023-08-01T19:54:46.578 INFO:teuthology.orchestra.run.smithi101.stdout: "duration": 9.4110000000000002e-06 2023-08-01T19:54:46.578 INFO:teuthology.orchestra.run.smithi101.stdout: }, 2023-08-01T19:54:46.578 INFO:teuthology.orchestra.run.smithi101.stdout: { 2023-08-01T19:54:46.578 INFO:teuthology.orchestra.run.smithi101.stdout: "event": "dispatched", 2023-08-01T19:54:46.578 INFO:teuthology.orchestra.run.smithi101.stdout: "time": "2023-08-01T19:54:04.458886+0000", 2023-08-01T19:54:46.578 INFO:teuthology.orchestra.run.smithi101.stdout: "duration": 7.6090000000000003e-06 2023-08-01T19:54:46.578 INFO:teuthology.orchestra.run.smithi101.stdout: }, 2023-08-01T19:54:46.578 INFO:teuthology.orchestra.run.smithi101.stdout: { 2023-08-01T19:54:46.579 INFO:teuthology.orchestra.run.smithi101.stdout: "event": "queued_for_pg", 2023-08-01T19:54:46.579 INFO:teuthology.orchestra.run.smithi101.stdout: "time": "2023-08-01T19:54:04.458890+0000", 2023-08-01T19:54:46.579 INFO:teuthology.orchestra.run.smithi101.stdout: "duration": 4.8470000000000003e-06 2023-08-01T19:54:46.579 INFO:teuthology.orchestra.run.smithi101.stdout: }, 2023-08-01T19:54:46.579 INFO:teuthology.orchestra.run.smithi101.stdout: { 2023-08-01T19:54:46.579 INFO:teuthology.orchestra.run.smithi101.stdout: "event": "reached_pg", 2023-08-01T19:54:46.579 INFO:teuthology.orchestra.run.smithi101.stdout: "time": "2023-08-01T19:54:04.458957+0000", 2023-08-01T19:54:46.579 INFO:teuthology.orchestra.run.smithi101.stdout: "duration": 6.6502999999999997e-05 2023-08-01T19:54:46.580 INFO:teuthology.orchestra.run.smithi101.stdout: }, 2023-08-01T19:54:46.580 INFO:teuthology.orchestra.run.smithi101.stdout: { 2023-08-01T19:54:46.580 INFO:teuthology.orchestra.run.smithi101.stdout: "event": "waiting_for_map not empty", 2023-08-01T19:54:46.580 INFO:teuthology.orchestra.run.smithi101.stdout: "time": "2023-08-01T19:54:04.458959+0000", 2023-08-01T19:54:46.580 INFO:teuthology.orchestra.run.smithi101.stdout: "duration": 2.3989999999999998e-06 2023-08-01T19:54:46.580 INFO:teuthology.orchestra.run.smithi101.stdout: }, 2023-08-01T19:54:46.580 INFO:teuthology.orchestra.run.smithi101.stdout: { 2023-08-01T19:54:46.580 INFO:teuthology.orchestra.run.smithi101.stdout: "event": "reached_pg", 2023-08-01T19:54:46.581 INFO:teuthology.orchestra.run.smithi101.stdout: "time": "2023-08-01T19:54:04.469554+0000", 2023-08-01T19:54:46.581 INFO:teuthology.orchestra.run.smithi101.stdout: "duration": 0.010594404 2023-08-01T19:54:46.581 INFO:teuthology.orchestra.run.smithi101.stdout: }, 2023-08-01T19:54:46.581 INFO:teuthology.orchestra.run.smithi101.stdout: { 2023-08-01T19:54:46.581 INFO:teuthology.orchestra.run.smithi101.stdout: "event": "started", 2023-08-01T19:54:46.581 INFO:teuthology.orchestra.run.smithi101.stdout: "time": "2023-08-01T19:54:04.469694+0000", 2023-08-01T19:54:46.581 INFO:teuthology.orchestra.run.smithi101.stdout: "duration": 0.00014006899999999999 2023-08-01T19:54:46.581 INFO:teuthology.orchestra.run.smithi101.stdout: }, 2023-08-01T19:54:46.582 INFO:teuthology.orchestra.run.smithi101.stdout: { 2023-08-01T19:54:46.582 INFO:teuthology.orchestra.run.smithi101.stdout: "event": "waiting for subops from 2", 2023-08-01T19:54:46.582 INFO:teuthology.orchestra.run.smithi101.stdout: "time": "2023-08-01T19:54:04.469826+0000", 2023-08-01T19:54:46.582 INFO:teuthology.orchestra.run.smithi101.stdout: "duration": 0.000132285 2023-08-01T19:54:46.582 INFO:teuthology.orchestra.run.smithi101.stdout: }, 2023-08-01T19:54:46.582 INFO:teuthology.orchestra.run.smithi101.stdout: { 2023-08-01T19:54:46.582 INFO:teuthology.orchestra.run.smithi101.stdout: "event": "op_commit", 2023-08-01T19:54:46.582 INFO:teuthology.orchestra.run.smithi101.stdout: "time": "2023-08-01T19:54:04.476179+0000", 2023-08-01T19:54:46.583 INFO:teuthology.orchestra.run.smithi101.stdout: "duration": 0.0063524289999999997 2023-08-01T19:54:46.583 INFO:teuthology.orchestra.run.smithi101.stdout: }, 2023-08-01T19:54:46.583 INFO:teuthology.orchestra.run.smithi101.stdout: { 2023-08-01T19:54:46.583 INFO:teuthology.orchestra.run.smithi101.stdout: "event": "sub_op_commit_rec", 2023-08-01T19:54:46.583 INFO:teuthology.orchestra.run.smithi101.stdout: "time": "2023-08-01T19:54:04.477334+0000", 2023-08-01T19:54:46.583 INFO:teuthology.orchestra.run.smithi101.stdout: "duration": 0.0011551070000000001 2023-08-01T19:54:46.583 INFO:teuthology.orchestra.run.smithi101.stdout: }, 2023-08-01T19:54:46.583 INFO:teuthology.orchestra.run.smithi101.stdout: { 2023-08-01T19:54:46.584 INFO:teuthology.orchestra.run.smithi101.stdout: "event": "commit_sent", 2023-08-01T19:54:46.584 INFO:teuthology.orchestra.run.smithi101.stdout: "time": "2023-08-01T19:54:04.477371+0000", 2023-08-01T19:54:46.584 INFO:teuthology.orchestra.run.smithi101.stdout: "duration": 3.7425000000000002e-05 2023-08-01T19:54:46.584 INFO:teuthology.orchestra.run.smithi101.stdout: }, 2023-08-01T19:54:46.584 INFO:teuthology.orchestra.run.smithi101.stdout: { 2023-08-01T19:54:46.584 INFO:teuthology.orchestra.run.smithi101.stdout: "event": "done", 2023-08-01T19:54:46.584 INFO:teuthology.orchestra.run.smithi101.stdout: "time": "2023-08-01T19:54:04.477398+0000", 2023-08-01T19:54:46.585 INFO:teuthology.orchestra.run.smithi101.stdout: "duration": 2.7078000000000001e-05 2023-08-01T19:54:46.585 INFO:teuthology.orchestra.run.smithi101.stdout: } 2023-08-01T19:54:46.585 INFO:teuthology.orchestra.run.smithi101.stdout: ] 2023-08-01T19:54:46.585 INFO:teuthology.orchestra.run.smithi101.stdout: } 2023-08-01T19:54:46.585 INFO:teuthology.orchestra.run.smithi101.stdout: }, 2023-08-01T19:54:46.585 INFO:teuthology.orchestra.run.smithi101.stdout: { 2023-08-01T19:54:46.585 INFO:teuthology.orchestra.run.smithi101.stdout: "description": "osd_op(mds.0.3:9 3.10 3:09401a81:::601.00000000:head [create,setxattr parent (62) in=6b,setxattr layout (30) in=6b] snapc 0=[] ondisk+write+known_if_redirected+full_force+supports_pool_eio e17)", 2023-08-01T19:54:46.585 INFO:teuthology.orchestra.run.smithi101.stdout: "initiated_at": "2023-08-01T19:54:04.458896+0000", 2023-08-01T19:54:46.586 INFO:teuthology.orchestra.run.smithi101.stdout: "age": 42.090179837999997, 2023-08-01T19:54:46.586 INFO:teuthology.orchestra.run.smithi101.stdout: "duration": 0.018577215000000001, 2023-08-01T19:54:46.586 INFO:teuthology.orchestra.run.smithi101.stdout: "type_data": { 2023-08-01T19:54:46.586 INFO:teuthology.orchestra.run.smithi101.stdout: "flag_point": "commit sent; apply or cleanup", 2023-08-01T19:54:46.586 INFO:teuthology.orchestra.run.smithi101.stdout: "events": [ 2023-08-01T19:54:46.586 INFO:teuthology.orchestra.run.smithi101.stdout: { 2023-08-01T19:54:46.586 INFO:teuthology.orchestra.run.smithi101.stdout: "event": "initiated", 2023-08-01T19:54:46.586 INFO:teuthology.orchestra.run.smithi101.stdout: "time": "2023-08-01T19:54:04.458896+0000", 2023-08-01T19:54:46.587 INFO:teuthology.orchestra.run.smithi101.stdout: "duration": 0 2023-08-01T19:54:46.587 INFO:teuthology.orchestra.run.smithi101.stdout: }, 2023-08-01T19:54:46.587 INFO:teuthology.orchestra.run.smithi101.stdout: { 2023-08-01T19:54:46.587 INFO:teuthology.orchestra.run.smithi101.stdout: "event": "throttled", 2023-08-01T19:54:46.587 INFO:teuthology.orchestra.run.smithi101.stdout: "time": "2023-08-01T19:54:04.458896+0000", 2023-08-01T19:54:46.587 INFO:teuthology.orchestra.run.smithi101.stdout: "duration": 0 2023-08-01T19:54:46.587 INFO:teuthology.orchestra.run.smithi101.stdout: }, 2023-08-01T19:54:46.587 INFO:teuthology.orchestra.run.smithi101.stdout: { 2023-08-01T19:54:46.588 INFO:teuthology.orchestra.run.smithi101.stdout: "event": "header_read", 2023-08-01T19:54:46.588 INFO:teuthology.orchestra.run.smithi101.stdout: "time": "2023-08-01T19:54:04.458896+0000", 2023-08-01T19:54:46.588 INFO:teuthology.orchestra.run.smithi101.stdout: "duration": 4294967295.9999995 2023-08-01T19:54:46.588 INFO:teuthology.orchestra.run.smithi101.stdout: }, 2023-08-01T19:54:46.588 INFO:teuthology.orchestra.run.smithi101.stdout: { 2023-08-01T19:54:46.588 INFO:teuthology.orchestra.run.smithi101.stdout: "event": "all_read", 2023-08-01T19:54:46.588 INFO:teuthology.orchestra.run.smithi101.stdout: "time": "2023-08-01T19:54:04.458900+0000", 2023-08-01T19:54:46.588 INFO:teuthology.orchestra.run.smithi101.stdout: "duration": 4.0829999999999997e-06 2023-08-01T19:54:46.589 INFO:teuthology.orchestra.run.smithi101.stdout: }, 2023-08-01T19:54:46.589 INFO:teuthology.orchestra.run.smithi101.stdout: { 2023-08-01T19:54:46.589 INFO:teuthology.orchestra.run.smithi101.stdout: "event": "dispatched", 2023-08-01T19:54:46.589 INFO:teuthology.orchestra.run.smithi101.stdout: "time": "2023-08-01T19:54:04.458906+0000", 2023-08-01T19:54:46.589 INFO:teuthology.orchestra.run.smithi101.stdout: "duration": 6.4099999999999996e-06 2023-08-01T19:54:46.589 INFO:teuthology.orchestra.run.smithi101.stdout: }, 2023-08-01T19:54:46.589 INFO:teuthology.orchestra.run.smithi101.stdout: { 2023-08-01T19:54:46.589 INFO:teuthology.orchestra.run.smithi101.stdout: "event": "queued_for_pg", 2023-08-01T19:54:46.590 INFO:teuthology.orchestra.run.smithi101.stdout: "time": "2023-08-01T19:54:04.458911+0000", 2023-08-01T19:54:46.590 INFO:teuthology.orchestra.run.smithi101.stdout: "duration": 4.0500000000000002e-06 2023-08-01T19:54:46.590 INFO:teuthology.orchestra.run.smithi101.stdout: }, 2023-08-01T19:54:46.590 INFO:teuthology.orchestra.run.smithi101.stdout: { 2023-08-01T19:54:46.590 INFO:teuthology.orchestra.run.smithi101.stdout: "event": "reached_pg", 2023-08-01T19:54:46.590 INFO:teuthology.orchestra.run.smithi101.stdout: "time": "2023-08-01T19:54:04.458981+0000", 2023-08-01T19:54:46.590 INFO:teuthology.orchestra.run.smithi101.stdout: "duration": 7.0121000000000002e-05 2023-08-01T19:54:46.590 INFO:teuthology.orchestra.run.smithi101.stdout: }, 2023-08-01T19:54:46.591 INFO:teuthology.orchestra.run.smithi101.stdout: { 2023-08-01T19:54:46.591 INFO:teuthology.orchestra.run.smithi101.stdout: "event": "waiting_for_map not empty", 2023-08-01T19:54:46.591 INFO:teuthology.orchestra.run.smithi101.stdout: "time": "2023-08-01T19:54:04.458983+0000", 2023-08-01T19:54:46.591 INFO:teuthology.orchestra.run.smithi101.stdout: "duration": 2.2299999999999998e-06 2023-08-01T19:54:46.591 INFO:teuthology.orchestra.run.smithi101.stdout: }, 2023-08-01T19:54:46.591 INFO:teuthology.orchestra.run.smithi101.stdout: { 2023-08-01T19:54:46.591 INFO:teuthology.orchestra.run.smithi101.stdout: "event": "reached_pg", 2023-08-01T19:54:46.591 INFO:teuthology.orchestra.run.smithi101.stdout: "time": "2023-08-01T19:54:04.470122+0000", 2023-08-01T19:54:46.592 INFO:teuthology.orchestra.run.smithi101.stdout: "duration": 0.011139593999999999 2023-08-01T19:54:46.592 INFO:teuthology.orchestra.run.smithi101.stdout: }, 2023-08-01T19:54:46.592 INFO:teuthology.orchestra.run.smithi101.stdout: { 2023-08-01T19:54:46.592 INFO:teuthology.orchestra.run.smithi101.stdout: "event": "started", 2023-08-01T19:54:46.592 INFO:teuthology.orchestra.run.smithi101.stdout: "time": "2023-08-01T19:54:04.470217+0000", 2023-08-01T19:54:46.592 INFO:teuthology.orchestra.run.smithi101.stdout: "duration": 9.4388000000000005e-05 2023-08-01T19:54:46.592 INFO:teuthology.orchestra.run.smithi101.stdout: }, 2023-08-01T19:54:46.592 INFO:teuthology.orchestra.run.smithi101.stdout: { 2023-08-01T19:54:46.593 INFO:teuthology.orchestra.run.smithi101.stdout: "event": "waiting for subops from 2", 2023-08-01T19:54:46.593 INFO:teuthology.orchestra.run.smithi101.stdout: "time": "2023-08-01T19:54:04.470714+0000", 2023-08-01T19:54:46.593 INFO:teuthology.orchestra.run.smithi101.stdout: "duration": 0.00049680999999999998 2023-08-01T19:54:46.593 INFO:teuthology.orchestra.run.smithi101.stdout: }, 2023-08-01T19:54:46.593 INFO:teuthology.orchestra.run.smithi101.stdout: { 2023-08-01T19:54:46.593 INFO:teuthology.orchestra.run.smithi101.stdout: "event": "op_commit", 2023-08-01T19:54:46.593 INFO:teuthology.orchestra.run.smithi101.stdout: "time": "2023-08-01T19:54:04.476183+0000", 2023-08-01T19:54:46.593 INFO:teuthology.orchestra.run.smithi101.stdout: "duration": 0.0054695880000000001 2023-08-01T19:54:46.594 INFO:teuthology.orchestra.run.smithi101.stdout: }, 2023-08-01T19:54:46.594 INFO:teuthology.orchestra.run.smithi101.stdout: { 2023-08-01T19:54:46.594 INFO:teuthology.orchestra.run.smithi101.stdout: "event": "sub_op_commit_rec", 2023-08-01T19:54:46.594 INFO:teuthology.orchestra.run.smithi101.stdout: "time": "2023-08-01T19:54:04.477428+0000", 2023-08-01T19:54:46.594 INFO:teuthology.orchestra.run.smithi101.stdout: "duration": 0.001244843 2023-08-01T19:54:46.594 INFO:teuthology.orchestra.run.smithi101.stdout: }, 2023-08-01T19:54:46.594 INFO:teuthology.orchestra.run.smithi101.stdout: { 2023-08-01T19:54:46.594 INFO:teuthology.orchestra.run.smithi101.stdout: "event": "commit_sent", 2023-08-01T19:54:46.595 INFO:teuthology.orchestra.run.smithi101.stdout: "time": "2023-08-01T19:54:04.477456+0000", 2023-08-01T19:54:46.595 INFO:teuthology.orchestra.run.smithi101.stdout: "duration": 2.7538e-05 2023-08-01T19:54:46.595 INFO:teuthology.orchestra.run.smithi101.stdout: }, 2023-08-01T19:54:46.595 INFO:teuthology.orchestra.run.smithi101.stdout: { 2023-08-01T19:54:46.595 INFO:teuthology.orchestra.run.smithi101.stdout: "event": "done", 2023-08-01T19:54:46.595 INFO:teuthology.orchestra.run.smithi101.stdout: "time": "2023-08-01T19:54:04.477474+0000", 2023-08-01T19:54:46.595 INFO:teuthology.orchestra.run.smithi101.stdout: "duration": 1.7974000000000001e-05 2023-08-01T19:54:46.595 INFO:teuthology.orchestra.run.smithi101.stdout: } 2023-08-01T19:54:46.596 INFO:teuthology.orchestra.run.smithi101.stdout: ] 2023-08-01T19:54:46.596 INFO:teuthology.orchestra.run.smithi101.stdout: } 2023-08-01T19:54:46.596 INFO:teuthology.orchestra.run.smithi101.stdout: }, 2023-08-01T19:54:46.596 INFO:teuthology.orchestra.run.smithi101.stdout: { 2023-08-01T19:54:46.596 INFO:teuthology.orchestra.run.smithi101.stdout: "description": "osd_op(mds.0.3:10 3.10 3:0bd6d154:::602.00000000:head [omap-set-header] snapc 0=[] ondisk+write+known_if_redirected+full_force+supports_pool_eio e17)", 2023-08-01T19:54:46.596 INFO:teuthology.orchestra.run.smithi101.stdout: "initiated_at": "2023-08-01T19:54:04.458927+0000", 2023-08-01T19:54:46.596 INFO:teuthology.orchestra.run.smithi101.stdout: "age": 42.090148859999999, 2023-08-01T19:54:46.596 INFO:teuthology.orchestra.run.smithi101.stdout: "duration": 0.019574352, 2023-08-01T19:54:46.597 INFO:teuthology.orchestra.run.smithi101.stdout: "type_data": { 2023-08-01T19:54:46.597 INFO:teuthology.orchestra.run.smithi101.stdout: "flag_point": "commit sent; apply or cleanup", 2023-08-01T19:54:46.597 INFO:teuthology.orchestra.run.smithi101.stdout: "events": [ 2023-08-01T19:54:46.597 INFO:teuthology.orchestra.run.smithi101.stdout: { 2023-08-01T19:54:46.597 INFO:teuthology.orchestra.run.smithi101.stdout: "event": "initiated", 2023-08-01T19:54:46.597 INFO:teuthology.orchestra.run.smithi101.stdout: "time": "2023-08-01T19:54:04.458927+0000", 2023-08-01T19:54:46.597 INFO:teuthology.orchestra.run.smithi101.stdout: "duration": 0 2023-08-01T19:54:46.598 INFO:teuthology.orchestra.run.smithi101.stdout: }, 2023-08-01T19:54:46.598 INFO:teuthology.orchestra.run.smithi101.stdout: { 2023-08-01T19:54:46.598 INFO:teuthology.orchestra.run.smithi101.stdout: "event": "throttled", 2023-08-01T19:54:46.598 INFO:teuthology.orchestra.run.smithi101.stdout: "time": "2023-08-01T19:54:04.458927+0000", 2023-08-01T19:54:46.598 INFO:teuthology.orchestra.run.smithi101.stdout: "duration": 0 2023-08-01T19:54:46.598 INFO:teuthology.orchestra.run.smithi101.stdout: }, 2023-08-01T19:54:46.598 INFO:teuthology.orchestra.run.smithi101.stdout: { 2023-08-01T19:54:46.598 INFO:teuthology.orchestra.run.smithi101.stdout: "event": "header_read", 2023-08-01T19:54:46.599 INFO:teuthology.orchestra.run.smithi101.stdout: "time": "2023-08-01T19:54:04.458927+0000", 2023-08-01T19:54:46.599 INFO:teuthology.orchestra.run.smithi101.stdout: "duration": 4294967295.9999995 2023-08-01T19:54:46.599 INFO:teuthology.orchestra.run.smithi101.stdout: }, 2023-08-01T19:54:46.599 INFO:teuthology.orchestra.run.smithi101.stdout: { 2023-08-01T19:54:46.599 INFO:teuthology.orchestra.run.smithi101.stdout: "event": "all_read", 2023-08-01T19:54:46.599 INFO:teuthology.orchestra.run.smithi101.stdout: "time": "2023-08-01T19:54:04.458931+0000", 2023-08-01T19:54:46.599 INFO:teuthology.orchestra.run.smithi101.stdout: "duration": 4.3000000000000003e-06 2023-08-01T19:54:46.599 INFO:teuthology.orchestra.run.smithi101.stdout: }, 2023-08-01T19:54:46.600 INFO:teuthology.orchestra.run.smithi101.stdout: { 2023-08-01T19:54:46.600 INFO:teuthology.orchestra.run.smithi101.stdout: "event": "dispatched", 2023-08-01T19:54:46.600 INFO:teuthology.orchestra.run.smithi101.stdout: "time": "2023-08-01T19:54:04.458938+0000", 2023-08-01T19:54:46.600 INFO:teuthology.orchestra.run.smithi101.stdout: "duration": 7.3220000000000004e-06 2023-08-01T19:54:46.600 INFO:teuthology.orchestra.run.smithi101.stdout: }, 2023-08-01T19:54:46.600 INFO:teuthology.orchestra.run.smithi101.stdout: { 2023-08-01T19:54:46.600 INFO:teuthology.orchestra.run.smithi101.stdout: "event": "queued_for_pg", 2023-08-01T19:54:46.600 INFO:teuthology.orchestra.run.smithi101.stdout: "time": "2023-08-01T19:54:04.458944+0000", 2023-08-01T19:54:46.601 INFO:teuthology.orchestra.run.smithi101.stdout: "duration": 5.3040000000000004e-06 2023-08-01T19:54:46.601 INFO:teuthology.orchestra.run.smithi101.stdout: }, 2023-08-01T19:54:46.601 INFO:teuthology.orchestra.run.smithi101.stdout: { 2023-08-01T19:54:46.601 INFO:teuthology.orchestra.run.smithi101.stdout: "event": "reached_pg", 2023-08-01T19:54:46.601 INFO:teuthology.orchestra.run.smithi101.stdout: "time": "2023-08-01T19:54:04.459006+0000", 2023-08-01T19:54:46.601 INFO:teuthology.orchestra.run.smithi101.stdout: "duration": 6.2081000000000004e-05 2023-08-01T19:54:46.601 INFO:teuthology.orchestra.run.smithi101.stdout: }, 2023-08-01T19:54:46.601 INFO:teuthology.orchestra.run.smithi101.stdout: { 2023-08-01T19:54:46.602 INFO:teuthology.orchestra.run.smithi101.stdout: "event": "waiting_for_map not empty", 2023-08-01T19:54:46.602 INFO:teuthology.orchestra.run.smithi101.stdout: "time": "2023-08-01T19:54:04.459008+0000", 2023-08-01T19:54:46.602 INFO:teuthology.orchestra.run.smithi101.stdout: "duration": 2.2500000000000001e-06 2023-08-01T19:54:46.602 INFO:teuthology.orchestra.run.smithi101.stdout: }, 2023-08-01T19:54:46.602 INFO:teuthology.orchestra.run.smithi101.stdout: { 2023-08-01T19:54:46.602 INFO:teuthology.orchestra.run.smithi101.stdout: "event": "reached_pg", 2023-08-01T19:54:46.602 INFO:teuthology.orchestra.run.smithi101.stdout: "time": "2023-08-01T19:54:04.470946+0000", 2023-08-01T19:54:46.603 INFO:teuthology.orchestra.run.smithi101.stdout: "duration": 0.011938347 2023-08-01T19:54:46.603 INFO:teuthology.orchestra.run.smithi101.stdout: }, 2023-08-01T19:54:46.603 INFO:teuthology.orchestra.run.smithi101.stdout: { 2023-08-01T19:54:46.603 INFO:teuthology.orchestra.run.smithi101.stdout: "event": "started", 2023-08-01T19:54:46.603 INFO:teuthology.orchestra.run.smithi101.stdout: "time": "2023-08-01T19:54:04.471071+0000", 2023-08-01T19:54:46.603 INFO:teuthology.orchestra.run.smithi101.stdout: "duration": 0.00012470299999999999 2023-08-01T19:54:46.603 INFO:teuthology.orchestra.run.smithi101.stdout: }, 2023-08-01T19:54:46.603 INFO:teuthology.orchestra.run.smithi101.stdout: { 2023-08-01T19:54:46.604 INFO:teuthology.orchestra.run.smithi101.stdout: "event": "waiting for subops from 2", 2023-08-01T19:54:46.604 INFO:teuthology.orchestra.run.smithi101.stdout: "time": "2023-08-01T19:54:04.471205+0000", 2023-08-01T19:54:46.604 INFO:teuthology.orchestra.run.smithi101.stdout: "duration": 0.000133891 2023-08-01T19:54:46.604 INFO:teuthology.orchestra.run.smithi101.stdout: }, 2023-08-01T19:54:46.604 INFO:teuthology.orchestra.run.smithi101.stdout: { 2023-08-01T19:54:46.604 INFO:teuthology.orchestra.run.smithi101.stdout: "event": "op_commit", 2023-08-01T19:54:46.604 INFO:teuthology.orchestra.run.smithi101.stdout: "time": "2023-08-01T19:54:04.477042+0000", 2023-08-01T19:54:46.604 INFO:teuthology.orchestra.run.smithi101.stdout: "duration": 0.0058374849999999999 2023-08-01T19:54:46.605 INFO:teuthology.orchestra.run.smithi101.stdout: }, 2023-08-01T19:54:46.605 INFO:teuthology.orchestra.run.smithi101.stdout: { 2023-08-01T19:54:46.605 INFO:teuthology.orchestra.run.smithi101.stdout: "event": "sub_op_commit_rec", 2023-08-01T19:54:46.605 INFO:teuthology.orchestra.run.smithi101.stdout: "time": "2023-08-01T19:54:04.478445+0000", 2023-08-01T19:54:46.605 INFO:teuthology.orchestra.run.smithi101.stdout: "duration": 0.0014023239999999999 2023-08-01T19:54:46.605 INFO:teuthology.orchestra.run.smithi101.stdout: }, 2023-08-01T19:54:46.605 INFO:teuthology.orchestra.run.smithi101.stdout: { 2023-08-01T19:54:46.605 INFO:teuthology.orchestra.run.smithi101.stdout: "event": "commit_sent", 2023-08-01T19:54:46.606 INFO:teuthology.orchestra.run.smithi101.stdout: "time": "2023-08-01T19:54:04.478478+0000", 2023-08-01T19:54:46.606 INFO:teuthology.orchestra.run.smithi101.stdout: "duration": 3.3503000000000001e-05 2023-08-01T19:54:46.606 INFO:teuthology.orchestra.run.smithi101.stdout: }, 2023-08-01T19:54:46.606 INFO:teuthology.orchestra.run.smithi101.stdout: { 2023-08-01T19:54:46.606 INFO:teuthology.orchestra.run.smithi101.stdout: "event": "done", 2023-08-01T19:54:46.606 INFO:teuthology.orchestra.run.smithi101.stdout: "time": "2023-08-01T19:54:04.478502+0000", 2023-08-01T19:54:46.606 INFO:teuthology.orchestra.run.smithi101.stdout: "duration": 2.3402000000000001e-05 2023-08-01T19:54:46.606 INFO:teuthology.orchestra.run.smithi101.stdout: } 2023-08-01T19:54:46.607 INFO:teuthology.orchestra.run.smithi101.stdout: ] 2023-08-01T19:54:46.607 INFO:teuthology.orchestra.run.smithi101.stdout: } 2023-08-01T19:54:46.607 INFO:teuthology.orchestra.run.smithi101.stdout: }, 2023-08-01T19:54:46.607 INFO:teuthology.orchestra.run.smithi101.stdout: { 2023-08-01T19:54:46.607 INFO:teuthology.orchestra.run.smithi101.stdout: "description": "osd_op(mds.0.3:11 3.10 3:0bd6d154:::602.00000000:head [create,setxattr parent (62) in=6b,setxattr layout (30) in=6b] snapc 0=[] ondisk+write+known_if_redirected+full_force+supports_pool_eio e17)", 2023-08-01T19:54:46.607 INFO:teuthology.orchestra.run.smithi101.stdout: "initiated_at": "2023-08-01T19:54:04.458960+0000", 2023-08-01T19:54:46.607 INFO:teuthology.orchestra.run.smithi101.stdout: "age": 42.090116412, 2023-08-01T19:54:46.607 INFO:teuthology.orchestra.run.smithi101.stdout: "duration": 0.019645459000000001, 2023-08-01T19:54:46.608 INFO:teuthology.orchestra.run.smithi101.stdout: "type_data": { 2023-08-01T19:54:46.608 INFO:teuthology.orchestra.run.smithi101.stdout: "flag_point": "commit sent; apply or cleanup", 2023-08-01T19:54:46.608 INFO:teuthology.orchestra.run.smithi101.stdout: "events": [ 2023-08-01T19:54:46.608 INFO:teuthology.orchestra.run.smithi101.stdout: { 2023-08-01T19:54:46.608 INFO:teuthology.orchestra.run.smithi101.stdout: "event": "initiated", 2023-08-01T19:54:46.608 INFO:teuthology.orchestra.run.smithi101.stdout: "time": "2023-08-01T19:54:04.458960+0000", 2023-08-01T19:54:46.608 INFO:teuthology.orchestra.run.smithi101.stdout: "duration": 0 2023-08-01T19:54:46.609 INFO:teuthology.orchestra.run.smithi101.stdout: }, 2023-08-01T19:54:46.609 INFO:teuthology.orchestra.run.smithi101.stdout: { 2023-08-01T19:54:46.609 INFO:teuthology.orchestra.run.smithi101.stdout: "event": "throttled", 2023-08-01T19:54:46.609 INFO:teuthology.orchestra.run.smithi101.stdout: "time": "2023-08-01T19:54:04.458960+0000", 2023-08-01T19:54:46.609 INFO:teuthology.orchestra.run.smithi101.stdout: "duration": 0 2023-08-01T19:54:46.609 INFO:teuthology.orchestra.run.smithi101.stdout: }, 2023-08-01T19:54:46.609 INFO:teuthology.orchestra.run.smithi101.stdout: { 2023-08-01T19:54:46.609 INFO:teuthology.orchestra.run.smithi101.stdout: "event": "header_read", 2023-08-01T19:54:46.610 INFO:teuthology.orchestra.run.smithi101.stdout: "time": "2023-08-01T19:54:04.458959+0000", 2023-08-01T19:54:46.610 INFO:teuthology.orchestra.run.smithi101.stdout: "duration": 4294967295.9999995 2023-08-01T19:54:46.610 INFO:teuthology.orchestra.run.smithi101.stdout: }, 2023-08-01T19:54:46.610 INFO:teuthology.orchestra.run.smithi101.stdout: { 2023-08-01T19:54:46.610 INFO:teuthology.orchestra.run.smithi101.stdout: "event": "all_read", 2023-08-01T19:54:46.610 INFO:teuthology.orchestra.run.smithi101.stdout: "time": "2023-08-01T19:54:04.458963+0000", 2023-08-01T19:54:46.610 INFO:teuthology.orchestra.run.smithi101.stdout: "duration": 3.9199999999999997e-06 2023-08-01T19:54:46.610 INFO:teuthology.orchestra.run.smithi101.stdout: }, 2023-08-01T19:54:46.611 INFO:teuthology.orchestra.run.smithi101.stdout: { 2023-08-01T19:54:46.611 INFO:teuthology.orchestra.run.smithi101.stdout: "event": "dispatched", 2023-08-01T19:54:46.611 INFO:teuthology.orchestra.run.smithi101.stdout: "time": "2023-08-01T19:54:04.458970+0000", 2023-08-01T19:54:46.611 INFO:teuthology.orchestra.run.smithi101.stdout: "duration": 7.0439999999999998e-06 2023-08-01T19:54:46.611 INFO:teuthology.orchestra.run.smithi101.stdout: }, 2023-08-01T19:54:46.611 INFO:teuthology.orchestra.run.smithi101.stdout: { 2023-08-01T19:54:46.611 INFO:teuthology.orchestra.run.smithi101.stdout: "event": "queued_for_pg", 2023-08-01T19:54:46.611 INFO:teuthology.orchestra.run.smithi101.stdout: "time": "2023-08-01T19:54:04.458976+0000", 2023-08-01T19:54:46.612 INFO:teuthology.orchestra.run.smithi101.stdout: "duration": 5.9540000000000001e-06 2023-08-01T19:54:46.612 INFO:teuthology.orchestra.run.smithi101.stdout: }, 2023-08-01T19:54:46.612 INFO:teuthology.orchestra.run.smithi101.stdout: { 2023-08-01T19:54:46.612 INFO:teuthology.orchestra.run.smithi101.stdout: "event": "reached_pg", 2023-08-01T19:54:46.612 INFO:teuthology.orchestra.run.smithi101.stdout: "time": "2023-08-01T19:54:04.459035+0000", 2023-08-01T19:54:46.612 INFO:teuthology.orchestra.run.smithi101.stdout: "duration": 5.8924e-05 2023-08-01T19:54:46.612 INFO:teuthology.orchestra.run.smithi101.stdout: }, 2023-08-01T19:54:46.612 INFO:teuthology.orchestra.run.smithi101.stdout: { 2023-08-01T19:54:46.613 INFO:teuthology.orchestra.run.smithi101.stdout: "event": "waiting_for_map not empty", 2023-08-01T19:54:46.613 INFO:teuthology.orchestra.run.smithi101.stdout: "time": "2023-08-01T19:54:04.459038+0000", 2023-08-01T19:54:46.613 INFO:teuthology.orchestra.run.smithi101.stdout: "duration": 3.2760000000000001e-06 2023-08-01T19:54:46.613 INFO:teuthology.orchestra.run.smithi101.stdout: }, 2023-08-01T19:54:46.613 INFO:teuthology.orchestra.run.smithi101.stdout: { 2023-08-01T19:54:46.613 INFO:teuthology.orchestra.run.smithi101.stdout: "event": "reached_pg", 2023-08-01T19:54:46.613 INFO:teuthology.orchestra.run.smithi101.stdout: "time": "2023-08-01T19:54:04.471511+0000", 2023-08-01T19:54:46.613 INFO:teuthology.orchestra.run.smithi101.stdout: "duration": 0.012473039999999999 2023-08-01T19:54:46.614 INFO:teuthology.orchestra.run.smithi101.stdout: }, 2023-08-01T19:54:46.614 INFO:teuthology.orchestra.run.smithi101.stdout: { 2023-08-01T19:54:46.614 INFO:teuthology.orchestra.run.smithi101.stdout: "event": "started", 2023-08-01T19:54:46.614 INFO:teuthology.orchestra.run.smithi101.stdout: "time": "2023-08-01T19:54:04.472086+0000", 2023-08-01T19:54:46.614 INFO:teuthology.orchestra.run.smithi101.stdout: "duration": 0.00057491699999999998 2023-08-01T19:54:46.614 INFO:teuthology.orchestra.run.smithi101.stdout: }, 2023-08-01T19:54:46.614 INFO:teuthology.orchestra.run.smithi101.stdout: { 2023-08-01T19:54:46.614 INFO:teuthology.orchestra.run.smithi101.stdout: "event": "waiting for subops from 2", 2023-08-01T19:54:46.615 INFO:teuthology.orchestra.run.smithi101.stdout: "time": "2023-08-01T19:54:04.472310+0000", 2023-08-01T19:54:46.615 INFO:teuthology.orchestra.run.smithi101.stdout: "duration": 0.00022396499999999999 2023-08-01T19:54:46.615 INFO:teuthology.orchestra.run.smithi101.stdout: }, 2023-08-01T19:54:46.615 INFO:teuthology.orchestra.run.smithi101.stdout: { 2023-08-01T19:54:46.615 INFO:teuthology.orchestra.run.smithi101.stdout: "event": "op_commit", 2023-08-01T19:54:46.615 INFO:teuthology.orchestra.run.smithi101.stdout: "time": "2023-08-01T19:54:04.478141+0000", 2023-08-01T19:54:46.615 INFO:teuthology.orchestra.run.smithi101.stdout: "duration": 0.0058312320000000004 2023-08-01T19:54:46.615 INFO:teuthology.orchestra.run.smithi101.stdout: }, 2023-08-01T19:54:46.616 INFO:teuthology.orchestra.run.smithi101.stdout: { 2023-08-01T19:54:46.616 INFO:teuthology.orchestra.run.smithi101.stdout: "event": "sub_op_commit_rec", 2023-08-01T19:54:46.616 INFO:teuthology.orchestra.run.smithi101.stdout: "time": "2023-08-01T19:54:04.478543+0000", 2023-08-01T19:54:46.616 INFO:teuthology.orchestra.run.smithi101.stdout: "duration": 0.00040160800000000002 2023-08-01T19:54:46.616 INFO:teuthology.orchestra.run.smithi101.stdout: }, 2023-08-01T19:54:46.616 INFO:teuthology.orchestra.run.smithi101.stdout: { 2023-08-01T19:54:46.616 INFO:teuthology.orchestra.run.smithi101.stdout: "event": "commit_sent", 2023-08-01T19:54:46.616 INFO:teuthology.orchestra.run.smithi101.stdout: "time": "2023-08-01T19:54:04.478584+0000", 2023-08-01T19:54:46.617 INFO:teuthology.orchestra.run.smithi101.stdout: "duration": 4.0989999999999999e-05 2023-08-01T19:54:46.617 INFO:teuthology.orchestra.run.smithi101.stdout: }, 2023-08-01T19:54:46.617 INFO:teuthology.orchestra.run.smithi101.stdout: { 2023-08-01T19:54:46.617 INFO:teuthology.orchestra.run.smithi101.stdout: "event": "done", 2023-08-01T19:54:46.617 INFO:teuthology.orchestra.run.smithi101.stdout: "time": "2023-08-01T19:54:04.478605+0000", 2023-08-01T19:54:46.617 INFO:teuthology.orchestra.run.smithi101.stdout: "duration": 2.1178e-05 2023-08-01T19:54:46.617 INFO:teuthology.orchestra.run.smithi101.stdout: } 2023-08-01T19:54:46.617 INFO:teuthology.orchestra.run.smithi101.stdout: ] 2023-08-01T19:54:46.618 INFO:teuthology.orchestra.run.smithi101.stdout: } 2023-08-01T19:54:46.618 INFO:teuthology.orchestra.run.smithi101.stdout: }, 2023-08-01T19:54:46.618 INFO:teuthology.orchestra.run.smithi101.stdout: { 2023-08-01T19:54:46.618 INFO:teuthology.orchestra.run.smithi101.stdout: "description": "osd_op(mds.0.3:12 3.10 3:0d89b25e:::603.00000000:head [omap-set-header] snapc 0=[] ondisk+write+known_if_redirected+full_force+supports_pool_eio e17)", 2023-08-01T19:54:46.618 INFO:teuthology.orchestra.run.smithi101.stdout: "initiated_at": "2023-08-01T19:54:04.458982+0000", 2023-08-01T19:54:46.618 INFO:teuthology.orchestra.run.smithi101.stdout: "age": 42.090094184000002, 2023-08-01T19:54:46.618 INFO:teuthology.orchestra.run.smithi101.stdout: "duration": 0.021266334000000001, 2023-08-01T19:54:46.619 INFO:teuthology.orchestra.run.smithi101.stdout: "type_data": { 2023-08-01T19:54:46.619 INFO:teuthology.orchestra.run.smithi101.stdout: "flag_point": "commit sent; apply or cleanup", 2023-08-01T19:54:46.619 INFO:teuthology.orchestra.run.smithi101.stdout: "events": [ 2023-08-01T19:54:46.619 INFO:teuthology.orchestra.run.smithi101.stdout: { 2023-08-01T19:54:46.619 INFO:teuthology.orchestra.run.smithi101.stdout: "event": "initiated", 2023-08-01T19:54:46.619 INFO:teuthology.orchestra.run.smithi101.stdout: "time": "2023-08-01T19:54:04.458982+0000", 2023-08-01T19:54:46.619 INFO:teuthology.orchestra.run.smithi101.stdout: "duration": 0 2023-08-01T19:54:46.619 INFO:teuthology.orchestra.run.smithi101.stdout: }, 2023-08-01T19:54:46.620 INFO:teuthology.orchestra.run.smithi101.stdout: { 2023-08-01T19:54:46.620 INFO:teuthology.orchestra.run.smithi101.stdout: "event": "throttled", 2023-08-01T19:54:46.620 INFO:teuthology.orchestra.run.smithi101.stdout: "time": "2023-08-01T19:54:04.458982+0000", 2023-08-01T19:54:46.620 INFO:teuthology.orchestra.run.smithi101.stdout: "duration": 0 2023-08-01T19:54:46.620 INFO:teuthology.orchestra.run.smithi101.stdout: }, 2023-08-01T19:54:46.620 INFO:teuthology.orchestra.run.smithi101.stdout: { 2023-08-01T19:54:46.620 INFO:teuthology.orchestra.run.smithi101.stdout: "event": "header_read", 2023-08-01T19:54:46.620 INFO:teuthology.orchestra.run.smithi101.stdout: "time": "2023-08-01T19:54:04.458982+0000", 2023-08-01T19:54:46.621 INFO:teuthology.orchestra.run.smithi101.stdout: "duration": 4294967295.9999995 2023-08-01T19:54:46.621 INFO:teuthology.orchestra.run.smithi101.stdout: }, 2023-08-01T19:54:46.621 INFO:teuthology.orchestra.run.smithi101.stdout: { 2023-08-01T19:54:46.621 INFO:teuthology.orchestra.run.smithi101.stdout: "event": "all_read", 2023-08-01T19:54:46.621 INFO:teuthology.orchestra.run.smithi101.stdout: "time": "2023-08-01T19:54:04.458985+0000", 2023-08-01T19:54:46.621 INFO:teuthology.orchestra.run.smithi101.stdout: "duration": 3.4800000000000001e-06 2023-08-01T19:54:46.621 INFO:teuthology.orchestra.run.smithi101.stdout: }, 2023-08-01T19:54:46.621 INFO:teuthology.orchestra.run.smithi101.stdout: { 2023-08-01T19:54:46.622 INFO:teuthology.orchestra.run.smithi101.stdout: "event": "dispatched", 2023-08-01T19:54:46.622 INFO:teuthology.orchestra.run.smithi101.stdout: "time": "2023-08-01T19:54:04.458992+0000", 2023-08-01T19:54:46.622 INFO:teuthology.orchestra.run.smithi101.stdout: "duration": 7.306e-06 2023-08-01T19:54:46.622 INFO:teuthology.orchestra.run.smithi101.stdout: }, 2023-08-01T19:54:46.622 INFO:teuthology.orchestra.run.smithi101.stdout: { 2023-08-01T19:54:46.622 INFO:teuthology.orchestra.run.smithi101.stdout: "event": "queued_for_pg", 2023-08-01T19:54:46.622 INFO:teuthology.orchestra.run.smithi101.stdout: "time": "2023-08-01T19:54:04.458997+0000", 2023-08-01T19:54:46.622 INFO:teuthology.orchestra.run.smithi101.stdout: "duration": 4.4530000000000004e-06 2023-08-01T19:54:46.623 INFO:teuthology.orchestra.run.smithi101.stdout: }, 2023-08-01T19:54:46.623 INFO:teuthology.orchestra.run.smithi101.stdout: { 2023-08-01T19:54:46.623 INFO:teuthology.orchestra.run.smithi101.stdout: "event": "reached_pg", 2023-08-01T19:54:46.623 INFO:teuthology.orchestra.run.smithi101.stdout: "time": "2023-08-01T19:54:04.459060+0000", 2023-08-01T19:54:46.623 INFO:teuthology.orchestra.run.smithi101.stdout: "duration": 6.3249000000000004e-05 2023-08-01T19:54:46.623 INFO:teuthology.orchestra.run.smithi101.stdout: }, 2023-08-01T19:54:46.623 INFO:teuthology.orchestra.run.smithi101.stdout: { 2023-08-01T19:54:46.623 INFO:teuthology.orchestra.run.smithi101.stdout: "event": "waiting_for_map not empty", 2023-08-01T19:54:46.624 INFO:teuthology.orchestra.run.smithi101.stdout: "time": "2023-08-01T19:54:04.459063+0000", 2023-08-01T19:54:46.624 INFO:teuthology.orchestra.run.smithi101.stdout: "duration": 2.717e-06 2023-08-01T19:54:46.624 INFO:teuthology.orchestra.run.smithi101.stdout: }, 2023-08-01T19:54:46.624 INFO:teuthology.orchestra.run.smithi101.stdout: { 2023-08-01T19:54:46.624 INFO:teuthology.orchestra.run.smithi101.stdout: "event": "reached_pg", 2023-08-01T19:54:46.624 INFO:teuthology.orchestra.run.smithi101.stdout: "time": "2023-08-01T19:54:04.473625+0000", 2023-08-01T19:54:46.624 INFO:teuthology.orchestra.run.smithi101.stdout: "duration": 0.014562007 2023-08-01T19:54:46.625 INFO:teuthology.orchestra.run.smithi101.stdout: }, 2023-08-01T19:54:46.625 INFO:teuthology.orchestra.run.smithi101.stdout: { 2023-08-01T19:54:46.625 INFO:teuthology.orchestra.run.smithi101.stdout: "event": "started", 2023-08-01T19:54:46.625 INFO:teuthology.orchestra.run.smithi101.stdout: "time": "2023-08-01T19:54:04.473757+0000", 2023-08-01T19:54:46.625 INFO:teuthology.orchestra.run.smithi101.stdout: "duration": 0.00013238599999999999 2023-08-01T19:54:46.625 INFO:teuthology.orchestra.run.smithi101.stdout: }, 2023-08-01T19:54:46.625 INFO:teuthology.orchestra.run.smithi101.stdout: { 2023-08-01T19:54:46.625 INFO:teuthology.orchestra.run.smithi101.stdout: "event": "waiting for subops from 2", 2023-08-01T19:54:46.626 INFO:teuthology.orchestra.run.smithi101.stdout: "time": "2023-08-01T19:54:04.473898+0000", 2023-08-01T19:54:46.626 INFO:teuthology.orchestra.run.smithi101.stdout: "duration": 0.00014039 2023-08-01T19:54:46.626 INFO:teuthology.orchestra.run.smithi101.stdout: }, 2023-08-01T19:54:46.626 INFO:teuthology.orchestra.run.smithi101.stdout: { 2023-08-01T19:54:46.626 INFO:teuthology.orchestra.run.smithi101.stdout: "event": "op_commit", 2023-08-01T19:54:46.626 INFO:teuthology.orchestra.run.smithi101.stdout: "time": "2023-08-01T19:54:04.478380+0000", 2023-08-01T19:54:46.626 INFO:teuthology.orchestra.run.smithi101.stdout: "duration": 0.0044827449999999998 2023-08-01T19:54:46.627 INFO:teuthology.orchestra.run.smithi101.stdout: }, 2023-08-01T19:54:46.627 INFO:teuthology.orchestra.run.smithi101.stdout: { 2023-08-01T19:54:46.627 INFO:teuthology.orchestra.run.smithi101.stdout: "event": "sub_op_commit_rec", 2023-08-01T19:54:46.627 INFO:teuthology.orchestra.run.smithi101.stdout: "time": "2023-08-01T19:54:04.480169+0000", 2023-08-01T19:54:46.627 INFO:teuthology.orchestra.run.smithi101.stdout: "duration": 0.0017886040000000001 2023-08-01T19:54:46.627 INFO:teuthology.orchestra.run.smithi101.stdout: }, 2023-08-01T19:54:46.627 INFO:teuthology.orchestra.run.smithi101.stdout: { 2023-08-01T19:54:46.627 INFO:teuthology.orchestra.run.smithi101.stdout: "event": "commit_sent", 2023-08-01T19:54:46.628 INFO:teuthology.orchestra.run.smithi101.stdout: "time": "2023-08-01T19:54:04.480212+0000", 2023-08-01T19:54:46.628 INFO:teuthology.orchestra.run.smithi101.stdout: "duration": 4.2687e-05 2023-08-01T19:54:46.628 INFO:teuthology.orchestra.run.smithi101.stdout: }, 2023-08-01T19:54:46.628 INFO:teuthology.orchestra.run.smithi101.stdout: { 2023-08-01T19:54:46.628 INFO:teuthology.orchestra.run.smithi101.stdout: "event": "done", 2023-08-01T19:54:46.628 INFO:teuthology.orchestra.run.smithi101.stdout: "time": "2023-08-01T19:54:04.480248+0000", 2023-08-01T19:54:46.628 INFO:teuthology.orchestra.run.smithi101.stdout: "duration": 3.6743999999999999e-05 2023-08-01T19:54:46.628 INFO:teuthology.orchestra.run.smithi101.stdout: } 2023-08-01T19:54:46.629 INFO:teuthology.orchestra.run.smithi101.stdout: ] 2023-08-01T19:54:46.629 INFO:teuthology.orchestra.run.smithi101.stdout: } 2023-08-01T19:54:46.629 INFO:teuthology.orchestra.run.smithi101.stdout: }, 2023-08-01T19:54:46.629 INFO:teuthology.orchestra.run.smithi101.stdout: { 2023-08-01T19:54:46.629 INFO:teuthology.orchestra.run.smithi101.stdout: "description": "osd_op(mds.0.3:13 3.10 3:0d89b25e:::603.00000000:head [create,setxattr parent (62) in=6b,setxattr layout (30) in=6b] snapc 0=[] ondisk+write+known_if_redirected+full_force+supports_pool_eio e17)", 2023-08-01T19:54:46.629 INFO:teuthology.orchestra.run.smithi101.stdout: "initiated_at": "2023-08-01T19:54:04.459010+0000", 2023-08-01T19:54:46.629 INFO:teuthology.orchestra.run.smithi101.stdout: "age": 42.090066464000003, 2023-08-01T19:54:46.629 INFO:teuthology.orchestra.run.smithi101.stdout: "duration": 0.021327220000000001, 2023-08-01T19:54:46.630 INFO:teuthology.orchestra.run.smithi101.stdout: "type_data": { 2023-08-01T19:54:46.630 INFO:teuthology.orchestra.run.smithi101.stdout: "flag_point": "commit sent; apply or cleanup", 2023-08-01T19:54:46.630 INFO:teuthology.orchestra.run.smithi101.stdout: "events": [ 2023-08-01T19:54:46.630 INFO:teuthology.orchestra.run.smithi101.stdout: { 2023-08-01T19:54:46.630 INFO:teuthology.orchestra.run.smithi101.stdout: "event": "initiated", 2023-08-01T19:54:46.630 INFO:teuthology.orchestra.run.smithi101.stdout: "time": "2023-08-01T19:54:04.459010+0000", 2023-08-01T19:54:46.630 INFO:teuthology.orchestra.run.smithi101.stdout: "duration": 0 2023-08-01T19:54:46.630 INFO:teuthology.orchestra.run.smithi101.stdout: }, 2023-08-01T19:54:46.631 INFO:teuthology.orchestra.run.smithi101.stdout: { 2023-08-01T19:54:46.631 INFO:teuthology.orchestra.run.smithi101.stdout: "event": "throttled", 2023-08-01T19:54:46.631 INFO:teuthology.orchestra.run.smithi101.stdout: "time": "2023-08-01T19:54:04.459010+0000", 2023-08-01T19:54:46.631 INFO:teuthology.orchestra.run.smithi101.stdout: "duration": 0 2023-08-01T19:54:46.631 INFO:teuthology.orchestra.run.smithi101.stdout: }, 2023-08-01T19:54:46.631 INFO:teuthology.orchestra.run.smithi101.stdout: { 2023-08-01T19:54:46.631 INFO:teuthology.orchestra.run.smithi101.stdout: "event": "header_read", 2023-08-01T19:54:46.631 INFO:teuthology.orchestra.run.smithi101.stdout: "time": "2023-08-01T19:54:04.459009+0000", 2023-08-01T19:54:46.632 INFO:teuthology.orchestra.run.smithi101.stdout: "duration": 4294967295.9999995 2023-08-01T19:54:46.632 INFO:teuthology.orchestra.run.smithi101.stdout: }, 2023-08-01T19:54:46.632 INFO:teuthology.orchestra.run.smithi101.stdout: { 2023-08-01T19:54:46.632 INFO:teuthology.orchestra.run.smithi101.stdout: "event": "all_read", 2023-08-01T19:54:46.632 INFO:teuthology.orchestra.run.smithi101.stdout: "time": "2023-08-01T19:54:04.459013+0000", 2023-08-01T19:54:46.632 INFO:teuthology.orchestra.run.smithi101.stdout: "duration": 3.8929999999999998e-06 2023-08-01T19:54:46.632 INFO:teuthology.orchestra.run.smithi101.stdout: }, 2023-08-01T19:54:46.632 INFO:teuthology.orchestra.run.smithi101.stdout: { 2023-08-01T19:54:46.633 INFO:teuthology.orchestra.run.smithi101.stdout: "event": "dispatched", 2023-08-01T19:54:46.633 INFO:teuthology.orchestra.run.smithi101.stdout: "time": "2023-08-01T19:54:04.459027+0000", 2023-08-01T19:54:46.633 INFO:teuthology.orchestra.run.smithi101.stdout: "duration": 1.3416e-05 2023-08-01T19:54:46.633 INFO:teuthology.orchestra.run.smithi101.stdout: }, 2023-08-01T19:54:46.633 INFO:teuthology.orchestra.run.smithi101.stdout: { 2023-08-01T19:54:46.633 INFO:teuthology.orchestra.run.smithi101.stdout: "event": "queued_for_pg", 2023-08-01T19:54:46.633 INFO:teuthology.orchestra.run.smithi101.stdout: "time": "2023-08-01T19:54:04.459033+0000", 2023-08-01T19:54:46.633 INFO:teuthology.orchestra.run.smithi101.stdout: "duration": 5.9800000000000003e-06 2023-08-01T19:54:46.634 INFO:teuthology.orchestra.run.smithi101.stdout: }, 2023-08-01T19:54:46.634 INFO:teuthology.orchestra.run.smithi101.stdout: { 2023-08-01T19:54:46.634 INFO:teuthology.orchestra.run.smithi101.stdout: "event": "reached_pg", 2023-08-01T19:54:46.634 INFO:teuthology.orchestra.run.smithi101.stdout: "time": "2023-08-01T19:54:04.459099+0000", 2023-08-01T19:54:46.634 INFO:teuthology.orchestra.run.smithi101.stdout: "duration": 6.6192999999999995e-05 2023-08-01T19:54:46.634 INFO:teuthology.orchestra.run.smithi101.stdout: }, 2023-08-01T19:54:46.634 INFO:teuthology.orchestra.run.smithi101.stdout: { 2023-08-01T19:54:46.634 INFO:teuthology.orchestra.run.smithi101.stdout: "event": "waiting_for_map not empty", 2023-08-01T19:54:46.635 INFO:teuthology.orchestra.run.smithi101.stdout: "time": "2023-08-01T19:54:04.459106+0000", 2023-08-01T19:54:46.635 INFO:teuthology.orchestra.run.smithi101.stdout: "duration": 6.8619999999999997e-06 2023-08-01T19:54:46.635 INFO:teuthology.orchestra.run.smithi101.stdout: }, 2023-08-01T19:54:46.635 INFO:teuthology.orchestra.run.smithi101.stdout: { 2023-08-01T19:54:46.635 INFO:teuthology.orchestra.run.smithi101.stdout: "event": "reached_pg", 2023-08-01T19:54:46.635 INFO:teuthology.orchestra.run.smithi101.stdout: "time": "2023-08-01T19:54:04.475182+0000", 2023-08-01T19:54:46.635 INFO:teuthology.orchestra.run.smithi101.stdout: "duration": 0.016076333000000002 2023-08-01T19:54:46.635 INFO:teuthology.orchestra.run.smithi101.stdout: }, 2023-08-01T19:54:46.636 INFO:teuthology.orchestra.run.smithi101.stdout: { 2023-08-01T19:54:46.636 INFO:teuthology.orchestra.run.smithi101.stdout: "event": "started", 2023-08-01T19:54:46.636 INFO:teuthology.orchestra.run.smithi101.stdout: "time": "2023-08-01T19:54:04.475353+0000", 2023-08-01T19:54:46.636 INFO:teuthology.orchestra.run.smithi101.stdout: "duration": 0.000171378 2023-08-01T19:54:46.636 INFO:teuthology.orchestra.run.smithi101.stdout: }, 2023-08-01T19:54:46.636 INFO:teuthology.orchestra.run.smithi101.stdout: { 2023-08-01T19:54:46.636 INFO:teuthology.orchestra.run.smithi101.stdout: "event": "waiting for subops from 2", 2023-08-01T19:54:46.637 INFO:teuthology.orchestra.run.smithi101.stdout: "time": "2023-08-01T19:54:04.475793+0000", 2023-08-01T19:54:46.637 INFO:teuthology.orchestra.run.smithi101.stdout: "duration": 0.000440123 2023-08-01T19:54:46.637 INFO:teuthology.orchestra.run.smithi101.stdout: }, 2023-08-01T19:54:46.637 INFO:teuthology.orchestra.run.smithi101.stdout: { 2023-08-01T19:54:46.637 INFO:teuthology.orchestra.run.smithi101.stdout: "event": "op_commit", 2023-08-01T19:54:46.637 INFO:teuthology.orchestra.run.smithi101.stdout: "time": "2023-08-01T19:54:04.478624+0000", 2023-08-01T19:54:46.637 INFO:teuthology.orchestra.run.smithi101.stdout: "duration": 0.0028305000000000001 2023-08-01T19:54:46.637 INFO:teuthology.orchestra.run.smithi101.stdout: }, 2023-08-01T19:54:46.638 INFO:teuthology.orchestra.run.smithi101.stdout: { 2023-08-01T19:54:46.638 INFO:teuthology.orchestra.run.smithi101.stdout: "event": "sub_op_commit_rec", 2023-08-01T19:54:46.638 INFO:teuthology.orchestra.run.smithi101.stdout: "time": "2023-08-01T19:54:04.480291+0000", 2023-08-01T19:54:46.638 INFO:teuthology.orchestra.run.smithi101.stdout: "duration": 0.0016670000000000001 2023-08-01T19:54:46.638 INFO:teuthology.orchestra.run.smithi101.stdout: }, 2023-08-01T19:54:46.638 INFO:teuthology.orchestra.run.smithi101.stdout: { 2023-08-01T19:54:46.638 INFO:teuthology.orchestra.run.smithi101.stdout: "event": "commit_sent", 2023-08-01T19:54:46.639 INFO:teuthology.orchestra.run.smithi101.stdout: "time": "2023-08-01T19:54:04.480318+0000", 2023-08-01T19:54:46.639 INFO:teuthology.orchestra.run.smithi101.stdout: "duration": 2.6815e-05 2023-08-01T19:54:46.639 INFO:teuthology.orchestra.run.smithi101.stdout: }, 2023-08-01T19:54:46.639 INFO:teuthology.orchestra.run.smithi101.stdout: { 2023-08-01T19:54:46.639 INFO:teuthology.orchestra.run.smithi101.stdout: "event": "done", 2023-08-01T19:54:46.639 INFO:teuthology.orchestra.run.smithi101.stdout: "time": "2023-08-01T19:54:04.480337+0000", 2023-08-01T19:54:46.639 INFO:teuthology.orchestra.run.smithi101.stdout: "duration": 1.9241000000000001e-05 2023-08-01T19:54:46.639 INFO:teuthology.orchestra.run.smithi101.stdout: } 2023-08-01T19:54:46.640 INFO:teuthology.orchestra.run.smithi101.stdout: ] 2023-08-01T19:54:46.640 INFO:teuthology.orchestra.run.smithi101.stdout: } 2023-08-01T19:54:46.640 INFO:teuthology.orchestra.run.smithi101.stdout: }, 2023-08-01T19:54:46.640 INFO:teuthology.orchestra.run.smithi101.stdout: { 2023-08-01T19:54:46.640 INFO:teuthology.orchestra.run.smithi101.stdout: "description": "osd_op(mds.0.3:18 3.14 3:2f55791f:::606.00000000:head [omap-set-header] snapc 0=[] ondisk+write+known_if_redirected+full_force+supports_pool_eio e17)", 2023-08-01T19:54:46.640 INFO:teuthology.orchestra.run.smithi101.stdout: "initiated_at": "2023-08-01T19:54:04.459039+0000", 2023-08-01T19:54:46.640 INFO:teuthology.orchestra.run.smithi101.stdout: "age": 42.090037170000002, 2023-08-01T19:54:46.640 INFO:teuthology.orchestra.run.smithi101.stdout: "duration": 0.018756419, 2023-08-01T19:54:46.641 INFO:teuthology.orchestra.run.smithi101.stdout: "type_data": { 2023-08-01T19:54:46.641 INFO:teuthology.orchestra.run.smithi101.stdout: "flag_point": "commit sent; apply or cleanup", 2023-08-01T19:54:46.641 INFO:teuthology.orchestra.run.smithi101.stdout: "events": [ 2023-08-01T19:54:46.641 INFO:teuthology.orchestra.run.smithi101.stdout: { 2023-08-01T19:54:46.641 INFO:teuthology.orchestra.run.smithi101.stdout: "event": "initiated", 2023-08-01T19:54:46.641 INFO:teuthology.orchestra.run.smithi101.stdout: "time": "2023-08-01T19:54:04.459039+0000", 2023-08-01T19:54:46.641 INFO:teuthology.orchestra.run.smithi101.stdout: "duration": 0 2023-08-01T19:54:46.641 INFO:teuthology.orchestra.run.smithi101.stdout: }, 2023-08-01T19:54:46.642 INFO:teuthology.orchestra.run.smithi101.stdout: { 2023-08-01T19:54:46.642 INFO:teuthology.orchestra.run.smithi101.stdout: "event": "throttled", 2023-08-01T19:54:46.642 INFO:teuthology.orchestra.run.smithi101.stdout: "time": "2023-08-01T19:54:04.459039+0000", 2023-08-01T19:54:46.642 INFO:teuthology.orchestra.run.smithi101.stdout: "duration": 0 2023-08-01T19:54:46.642 INFO:teuthology.orchestra.run.smithi101.stdout: }, 2023-08-01T19:54:46.642 INFO:teuthology.orchestra.run.smithi101.stdout: { 2023-08-01T19:54:46.642 INFO:teuthology.orchestra.run.smithi101.stdout: "event": "header_read", 2023-08-01T19:54:46.642 INFO:teuthology.orchestra.run.smithi101.stdout: "time": "2023-08-01T19:54:04.459039+0000", 2023-08-01T19:54:46.643 INFO:teuthology.orchestra.run.smithi101.stdout: "duration": 4294967295.9999995 2023-08-01T19:54:46.643 INFO:teuthology.orchestra.run.smithi101.stdout: }, 2023-08-01T19:54:46.643 INFO:teuthology.orchestra.run.smithi101.stdout: { 2023-08-01T19:54:46.643 INFO:teuthology.orchestra.run.smithi101.stdout: "event": "all_read", 2023-08-01T19:54:46.643 INFO:teuthology.orchestra.run.smithi101.stdout: "time": "2023-08-01T19:54:04.459043+0000", 2023-08-01T19:54:46.643 INFO:teuthology.orchestra.run.smithi101.stdout: "duration": 4.1500000000000001e-06 2023-08-01T19:54:46.643 INFO:teuthology.orchestra.run.smithi101.stdout: }, 2023-08-01T19:54:46.643 INFO:teuthology.orchestra.run.smithi101.stdout: { 2023-08-01T19:54:46.644 INFO:teuthology.orchestra.run.smithi101.stdout: "event": "dispatched", 2023-08-01T19:54:46.644 INFO:teuthology.orchestra.run.smithi101.stdout: "time": "2023-08-01T19:54:04.459051+0000", 2023-08-01T19:54:46.644 INFO:teuthology.orchestra.run.smithi101.stdout: "duration": 8.4190000000000002e-06 2023-08-01T19:54:46.644 INFO:teuthology.orchestra.run.smithi101.stdout: }, 2023-08-01T19:54:46.644 INFO:teuthology.orchestra.run.smithi101.stdout: { 2023-08-01T19:54:46.644 INFO:teuthology.orchestra.run.smithi101.stdout: "event": "queued_for_pg", 2023-08-01T19:54:46.644 INFO:teuthology.orchestra.run.smithi101.stdout: "time": "2023-08-01T19:54:04.459056+0000", 2023-08-01T19:54:46.644 INFO:teuthology.orchestra.run.smithi101.stdout: "duration": 5.339e-06 2023-08-01T19:54:46.645 INFO:teuthology.orchestra.run.smithi101.stdout: }, 2023-08-01T19:54:46.645 INFO:teuthology.orchestra.run.smithi101.stdout: { 2023-08-01T19:54:46.645 INFO:teuthology.orchestra.run.smithi101.stdout: "event": "reached_pg", 2023-08-01T19:54:46.645 INFO:teuthology.orchestra.run.smithi101.stdout: "time": "2023-08-01T19:54:04.459091+0000", 2023-08-01T19:54:46.645 INFO:teuthology.orchestra.run.smithi101.stdout: "duration": 3.4090000000000001e-05 2023-08-01T19:54:46.645 INFO:teuthology.orchestra.run.smithi101.stdout: }, 2023-08-01T19:54:46.645 INFO:teuthology.orchestra.run.smithi101.stdout: { 2023-08-01T19:54:46.645 INFO:teuthology.orchestra.run.smithi101.stdout: "event": "op must wait for map", 2023-08-01T19:54:46.646 INFO:teuthology.orchestra.run.smithi101.stdout: "time": "2023-08-01T19:54:04.459094+0000", 2023-08-01T19:54:46.646 INFO:teuthology.orchestra.run.smithi101.stdout: "duration": 3.303e-06 2023-08-01T19:54:46.646 INFO:teuthology.orchestra.run.smithi101.stdout: }, 2023-08-01T19:54:46.646 INFO:teuthology.orchestra.run.smithi101.stdout: { 2023-08-01T19:54:46.646 INFO:teuthology.orchestra.run.smithi101.stdout: "event": "reached_pg", 2023-08-01T19:54:46.646 INFO:teuthology.orchestra.run.smithi101.stdout: "time": "2023-08-01T19:54:04.469860+0000", 2023-08-01T19:54:46.646 INFO:teuthology.orchestra.run.smithi101.stdout: "duration": 0.010765749 2023-08-01T19:54:46.646 INFO:teuthology.orchestra.run.smithi101.stdout: }, 2023-08-01T19:54:46.647 INFO:teuthology.orchestra.run.smithi101.stdout: { 2023-08-01T19:54:46.647 INFO:teuthology.orchestra.run.smithi101.stdout: "event": "started", 2023-08-01T19:54:46.647 INFO:teuthology.orchestra.run.smithi101.stdout: "time": "2023-08-01T19:54:04.470008+0000", 2023-08-01T19:54:46.647 INFO:teuthology.orchestra.run.smithi101.stdout: "duration": 0.000148367 2023-08-01T19:54:46.647 INFO:teuthology.orchestra.run.smithi101.stdout: }, 2023-08-01T19:54:46.647 INFO:teuthology.orchestra.run.smithi101.stdout: { 2023-08-01T19:54:46.647 INFO:teuthology.orchestra.run.smithi101.stdout: "event": "waiting for subops from 2", 2023-08-01T19:54:46.647 INFO:teuthology.orchestra.run.smithi101.stdout: "time": "2023-08-01T19:54:04.470136+0000", 2023-08-01T19:54:46.648 INFO:teuthology.orchestra.run.smithi101.stdout: "duration": 0.000128329 2023-08-01T19:54:46.648 INFO:teuthology.orchestra.run.smithi101.stdout: }, 2023-08-01T19:54:46.648 INFO:teuthology.orchestra.run.smithi101.stdout: { 2023-08-01T19:54:46.648 INFO:teuthology.orchestra.run.smithi101.stdout: "event": "op_commit", 2023-08-01T19:54:46.648 INFO:teuthology.orchestra.run.smithi101.stdout: "time": "2023-08-01T19:54:04.476399+0000", 2023-08-01T19:54:46.648 INFO:teuthology.orchestra.run.smithi101.stdout: "duration": 0.0062627259999999997 2023-08-01T19:54:46.648 INFO:teuthology.orchestra.run.smithi101.stdout: }, 2023-08-01T19:54:46.648 INFO:teuthology.orchestra.run.smithi101.stdout: { 2023-08-01T19:54:46.649 INFO:teuthology.orchestra.run.smithi101.stdout: "event": "sub_op_commit_rec", 2023-08-01T19:54:46.649 INFO:teuthology.orchestra.run.smithi101.stdout: "time": "2023-08-01T19:54:04.477726+0000", 2023-08-01T19:54:46.649 INFO:teuthology.orchestra.run.smithi101.stdout: "duration": 0.001327103 2023-08-01T19:54:46.649 INFO:teuthology.orchestra.run.smithi101.stdout: }, 2023-08-01T19:54:46.649 INFO:teuthology.orchestra.run.smithi101.stdout: { 2023-08-01T19:54:46.649 INFO:teuthology.orchestra.run.smithi101.stdout: "event": "commit_sent", 2023-08-01T19:54:46.649 INFO:teuthology.orchestra.run.smithi101.stdout: "time": "2023-08-01T19:54:04.477771+0000", 2023-08-01T19:54:46.649 INFO:teuthology.orchestra.run.smithi101.stdout: "duration": 4.5232000000000003e-05 2023-08-01T19:54:46.650 INFO:teuthology.orchestra.run.smithi101.stdout: }, 2023-08-01T19:54:46.650 INFO:teuthology.orchestra.run.smithi101.stdout: { 2023-08-01T19:54:46.650 INFO:teuthology.orchestra.run.smithi101.stdout: "event": "done", 2023-08-01T19:54:46.650 INFO:teuthology.orchestra.run.smithi101.stdout: "time": "2023-08-01T19:54:04.477795+0000", 2023-08-01T19:54:46.650 INFO:teuthology.orchestra.run.smithi101.stdout: "duration": 2.4134999999999998e-05 2023-08-01T19:54:46.650 INFO:teuthology.orchestra.run.smithi101.stdout: } 2023-08-01T19:54:46.650 INFO:teuthology.orchestra.run.smithi101.stdout: ] 2023-08-01T19:54:46.651 INFO:teuthology.orchestra.run.smithi101.stdout: } 2023-08-01T19:54:46.651 INFO:teuthology.orchestra.run.smithi101.stdout: }, 2023-08-01T19:54:46.651 INFO:teuthology.orchestra.run.smithi101.stdout: { 2023-08-01T19:54:46.651 INFO:teuthology.orchestra.run.smithi101.stdout: "description": "osd_op(mds.0.3:19 3.14 3:2f55791f:::606.00000000:head [create,setxattr parent (62) in=6b,setxattr layout (30) in=6b] snapc 0=[] ondisk+write+known_if_redirected+full_force+supports_pool_eio e17)", 2023-08-01T19:54:46.651 INFO:teuthology.orchestra.run.smithi101.stdout: "initiated_at": "2023-08-01T19:54:04.459069+0000", 2023-08-01T19:54:46.651 INFO:teuthology.orchestra.run.smithi101.stdout: "age": 42.090007135, 2023-08-01T19:54:46.651 INFO:teuthology.orchestra.run.smithi101.stdout: "duration": 0.019523045999999999, 2023-08-01T19:54:46.651 INFO:teuthology.orchestra.run.smithi101.stdout: "type_data": { 2023-08-01T19:54:46.652 INFO:teuthology.orchestra.run.smithi101.stdout: "flag_point": "commit sent; apply or cleanup", 2023-08-01T19:54:46.652 INFO:teuthology.orchestra.run.smithi101.stdout: "events": [ 2023-08-01T19:54:46.652 INFO:teuthology.orchestra.run.smithi101.stdout: { 2023-08-01T19:54:46.652 INFO:teuthology.orchestra.run.smithi101.stdout: "event": "initiated", 2023-08-01T19:54:46.652 INFO:teuthology.orchestra.run.smithi101.stdout: "time": "2023-08-01T19:54:04.459069+0000", 2023-08-01T19:54:46.652 INFO:teuthology.orchestra.run.smithi101.stdout: "duration": 0 2023-08-01T19:54:46.652 INFO:teuthology.orchestra.run.smithi101.stdout: }, 2023-08-01T19:54:46.653 INFO:teuthology.orchestra.run.smithi101.stdout: { 2023-08-01T19:54:46.653 INFO:teuthology.orchestra.run.smithi101.stdout: "event": "throttled", 2023-08-01T19:54:46.653 INFO:teuthology.orchestra.run.smithi101.stdout: "time": "2023-08-01T19:54:04.459069+0000", 2023-08-01T19:54:46.653 INFO:teuthology.orchestra.run.smithi101.stdout: "duration": 0 2023-08-01T19:54:46.653 INFO:teuthology.orchestra.run.smithi101.stdout: }, 2023-08-01T19:54:46.653 INFO:teuthology.orchestra.run.smithi101.stdout: { 2023-08-01T19:54:46.653 INFO:teuthology.orchestra.run.smithi101.stdout: "event": "header_read", 2023-08-01T19:54:46.653 INFO:teuthology.orchestra.run.smithi101.stdout: "time": "2023-08-01T19:54:04.459069+0000", 2023-08-01T19:54:46.654 INFO:teuthology.orchestra.run.smithi101.stdout: "duration": 4294967295.9999995 2023-08-01T19:54:46.654 INFO:teuthology.orchestra.run.smithi101.stdout: }, 2023-08-01T19:54:46.654 INFO:teuthology.orchestra.run.smithi101.stdout: { 2023-08-01T19:54:46.654 INFO:teuthology.orchestra.run.smithi101.stdout: "event": "all_read", 2023-08-01T19:54:46.654 INFO:teuthology.orchestra.run.smithi101.stdout: "time": "2023-08-01T19:54:04.459072+0000", 2023-08-01T19:54:46.654 INFO:teuthology.orchestra.run.smithi101.stdout: "duration": 3.4570000000000001e-06 2023-08-01T19:54:46.654 INFO:teuthology.orchestra.run.smithi101.stdout: }, 2023-08-01T19:54:46.654 INFO:teuthology.orchestra.run.smithi101.stdout: { 2023-08-01T19:54:46.655 INFO:teuthology.orchestra.run.smithi101.stdout: "event": "dispatched", 2023-08-01T19:54:46.655 INFO:teuthology.orchestra.run.smithi101.stdout: "time": "2023-08-01T19:54:04.459080+0000", 2023-08-01T19:54:46.655 INFO:teuthology.orchestra.run.smithi101.stdout: "duration": 7.6009999999999997e-06 2023-08-01T19:54:46.655 INFO:teuthology.orchestra.run.smithi101.stdout: }, 2023-08-01T19:54:46.655 INFO:teuthology.orchestra.run.smithi101.stdout: { 2023-08-01T19:54:46.655 INFO:teuthology.orchestra.run.smithi101.stdout: "event": "queued_for_pg", 2023-08-01T19:54:46.655 INFO:teuthology.orchestra.run.smithi101.stdout: "time": "2023-08-01T19:54:04.459088+0000", 2023-08-01T19:54:46.655 INFO:teuthology.orchestra.run.smithi101.stdout: "duration": 8.0509999999999997e-06 2023-08-01T19:54:46.656 INFO:teuthology.orchestra.run.smithi101.stdout: }, 2023-08-01T19:54:46.656 INFO:teuthology.orchestra.run.smithi101.stdout: { 2023-08-01T19:54:46.656 INFO:teuthology.orchestra.run.smithi101.stdout: "event": "reached_pg", 2023-08-01T19:54:46.656 INFO:teuthology.orchestra.run.smithi101.stdout: "time": "2023-08-01T19:54:04.459120+0000", 2023-08-01T19:54:46.656 INFO:teuthology.orchestra.run.smithi101.stdout: "duration": 3.2078e-05 2023-08-01T19:54:46.656 INFO:teuthology.orchestra.run.smithi101.stdout: }, 2023-08-01T19:54:46.656 INFO:teuthology.orchestra.run.smithi101.stdout: { 2023-08-01T19:54:46.656 INFO:teuthology.orchestra.run.smithi101.stdout: "event": "waiting_for_map not empty", 2023-08-01T19:54:46.657 INFO:teuthology.orchestra.run.smithi101.stdout: "time": "2023-08-01T19:54:04.459123+0000", 2023-08-01T19:54:46.657 INFO:teuthology.orchestra.run.smithi101.stdout: "duration": 3.4699999999999998e-06 2023-08-01T19:54:46.657 INFO:teuthology.orchestra.run.smithi101.stdout: }, 2023-08-01T19:54:46.657 INFO:teuthology.orchestra.run.smithi101.stdout: { 2023-08-01T19:54:46.657 INFO:teuthology.orchestra.run.smithi101.stdout: "event": "reached_pg", 2023-08-01T19:54:46.657 INFO:teuthology.orchestra.run.smithi101.stdout: "time": "2023-08-01T19:54:04.471352+0000", 2023-08-01T19:54:46.657 INFO:teuthology.orchestra.run.smithi101.stdout: "duration": 0.01222926 2023-08-01T19:54:46.657 INFO:teuthology.orchestra.run.smithi101.stdout: }, 2023-08-01T19:54:46.658 INFO:teuthology.orchestra.run.smithi101.stdout: { 2023-08-01T19:54:46.658 INFO:teuthology.orchestra.run.smithi101.stdout: "event": "started", 2023-08-01T19:54:46.658 INFO:teuthology.orchestra.run.smithi101.stdout: "time": "2023-08-01T19:54:04.471495+0000", 2023-08-01T19:54:46.658 INFO:teuthology.orchestra.run.smithi101.stdout: "duration": 0.00014263899999999999 2023-08-01T19:54:46.658 INFO:teuthology.orchestra.run.smithi101.stdout: }, 2023-08-01T19:54:46.658 INFO:teuthology.orchestra.run.smithi101.stdout: { 2023-08-01T19:54:46.658 INFO:teuthology.orchestra.run.smithi101.stdout: "event": "waiting for subops from 2", 2023-08-01T19:54:46.658 INFO:teuthology.orchestra.run.smithi101.stdout: "time": "2023-08-01T19:54:04.472368+0000", 2023-08-01T19:54:46.659 INFO:teuthology.orchestra.run.smithi101.stdout: "duration": 0.00087245300000000003 2023-08-01T19:54:46.659 INFO:teuthology.orchestra.run.smithi101.stdout: }, 2023-08-01T19:54:46.659 INFO:teuthology.orchestra.run.smithi101.stdout: { 2023-08-01T19:54:46.659 INFO:teuthology.orchestra.run.smithi101.stdout: "event": "op_commit", 2023-08-01T19:54:46.659 INFO:teuthology.orchestra.run.smithi101.stdout: "time": "2023-08-01T19:54:04.477612+0000", 2023-08-01T19:54:46.659 INFO:teuthology.orchestra.run.smithi101.stdout: "duration": 0.0052442809999999999 2023-08-01T19:54:46.659 INFO:teuthology.orchestra.run.smithi101.stdout: }, 2023-08-01T19:54:46.659 INFO:teuthology.orchestra.run.smithi101.stdout: { 2023-08-01T19:54:46.660 INFO:teuthology.orchestra.run.smithi101.stdout: "event": "sub_op_commit_rec", 2023-08-01T19:54:46.660 INFO:teuthology.orchestra.run.smithi101.stdout: "time": "2023-08-01T19:54:04.478516+0000", 2023-08-01T19:54:46.660 INFO:teuthology.orchestra.run.smithi101.stdout: "duration": 0.00090399800000000004 2023-08-01T19:54:46.660 INFO:teuthology.orchestra.run.smithi101.stdout: }, 2023-08-01T19:54:46.660 INFO:teuthology.orchestra.run.smithi101.stdout: { 2023-08-01T19:54:46.660 INFO:teuthology.orchestra.run.smithi101.stdout: "event": "commit_sent", 2023-08-01T19:54:46.660 INFO:teuthology.orchestra.run.smithi101.stdout: "time": "2023-08-01T19:54:04.478555+0000", 2023-08-01T19:54:46.660 INFO:teuthology.orchestra.run.smithi101.stdout: "duration": 3.8977000000000003e-05 2023-08-01T19:54:46.661 INFO:teuthology.orchestra.run.smithi101.stdout: }, 2023-08-01T19:54:46.661 INFO:teuthology.orchestra.run.smithi101.stdout: { 2023-08-01T19:54:46.661 INFO:teuthology.orchestra.run.smithi101.stdout: "event": "done", 2023-08-01T19:54:46.661 INFO:teuthology.orchestra.run.smithi101.stdout: "time": "2023-08-01T19:54:04.478592+0000", 2023-08-01T19:54:46.661 INFO:teuthology.orchestra.run.smithi101.stdout: "duration": 3.7287999999999999e-05 2023-08-01T19:54:46.661 INFO:teuthology.orchestra.run.smithi101.stdout: } 2023-08-01T19:54:46.661 INFO:teuthology.orchestra.run.smithi101.stdout: ] 2023-08-01T19:54:46.662 INFO:teuthology.orchestra.run.smithi101.stdout: } 2023-08-01T19:54:46.662 INFO:teuthology.orchestra.run.smithi101.stdout: }, 2023-08-01T19:54:46.662 INFO:teuthology.orchestra.run.smithi101.stdout: { 2023-08-01T19:54:46.662 INFO:teuthology.orchestra.run.smithi101.stdout: "description": "osd_op(mds.0.3:20 3.1c 3:3ed09add:::607.00000000:head [omap-set-header] snapc 0=[] ondisk+write+known_if_redirected+full_force+supports_pool_eio e17)", 2023-08-01T19:54:46.662 INFO:teuthology.orchestra.run.smithi101.stdout: "initiated_at": "2023-08-01T19:54:04.459097+0000", 2023-08-01T19:54:46.662 INFO:teuthology.orchestra.run.smithi101.stdout: "age": 42.089979431000003, 2023-08-01T19:54:46.662 INFO:teuthology.orchestra.run.smithi101.stdout: "duration": 0.018578978999999999, 2023-08-01T19:54:46.662 INFO:teuthology.orchestra.run.smithi101.stdout: "type_data": { 2023-08-01T19:54:46.663 INFO:teuthology.orchestra.run.smithi101.stdout: "flag_point": "commit sent; apply or cleanup", 2023-08-01T19:54:46.663 INFO:teuthology.orchestra.run.smithi101.stdout: "events": [ 2023-08-01T19:54:46.663 INFO:teuthology.orchestra.run.smithi101.stdout: { 2023-08-01T19:54:46.663 INFO:teuthology.orchestra.run.smithi101.stdout: "event": "initiated", 2023-08-01T19:54:46.663 INFO:teuthology.orchestra.run.smithi101.stdout: "time": "2023-08-01T19:54:04.459097+0000", 2023-08-01T19:54:46.663 INFO:teuthology.orchestra.run.smithi101.stdout: "duration": 0 2023-08-01T19:54:46.663 INFO:teuthology.orchestra.run.smithi101.stdout: }, 2023-08-01T19:54:46.663 INFO:teuthology.orchestra.run.smithi101.stdout: { 2023-08-01T19:54:46.664 INFO:teuthology.orchestra.run.smithi101.stdout: "event": "throttled", 2023-08-01T19:54:46.664 INFO:teuthology.orchestra.run.smithi101.stdout: "time": "2023-08-01T19:54:04.459097+0000", 2023-08-01T19:54:46.664 INFO:teuthology.orchestra.run.smithi101.stdout: "duration": 0 2023-08-01T19:54:46.664 INFO:teuthology.orchestra.run.smithi101.stdout: }, 2023-08-01T19:54:46.664 INFO:teuthology.orchestra.run.smithi101.stdout: { 2023-08-01T19:54:46.664 INFO:teuthology.orchestra.run.smithi101.stdout: "event": "header_read", 2023-08-01T19:54:46.664 INFO:teuthology.orchestra.run.smithi101.stdout: "time": "2023-08-01T19:54:04.459096+0000", 2023-08-01T19:54:46.664 INFO:teuthology.orchestra.run.smithi101.stdout: "duration": 4294967295.9999995 2023-08-01T19:54:46.665 INFO:teuthology.orchestra.run.smithi101.stdout: }, 2023-08-01T19:54:46.665 INFO:teuthology.orchestra.run.smithi101.stdout: { 2023-08-01T19:54:46.665 INFO:teuthology.orchestra.run.smithi101.stdout: "event": "all_read", 2023-08-01T19:54:46.665 INFO:teuthology.orchestra.run.smithi101.stdout: "time": "2023-08-01T19:54:04.459105+0000", 2023-08-01T19:54:46.665 INFO:teuthology.orchestra.run.smithi101.stdout: "duration": 8.8259999999999999e-06 2023-08-01T19:54:46.665 INFO:teuthology.orchestra.run.smithi101.stdout: }, 2023-08-01T19:54:46.665 INFO:teuthology.orchestra.run.smithi101.stdout: { 2023-08-01T19:54:46.665 INFO:teuthology.orchestra.run.smithi101.stdout: "event": "dispatched", 2023-08-01T19:54:46.666 INFO:teuthology.orchestra.run.smithi101.stdout: "time": "2023-08-01T19:54:04.459112+0000", 2023-08-01T19:54:46.666 INFO:teuthology.orchestra.run.smithi101.stdout: "duration": 6.6660000000000002e-06 2023-08-01T19:54:46.666 INFO:teuthology.orchestra.run.smithi101.stdout: }, 2023-08-01T19:54:46.666 INFO:teuthology.orchestra.run.smithi101.stdout: { 2023-08-01T19:54:46.666 INFO:teuthology.orchestra.run.smithi101.stdout: "event": "queued_for_pg", 2023-08-01T19:54:46.666 INFO:teuthology.orchestra.run.smithi101.stdout: "time": "2023-08-01T19:54:04.459116+0000", 2023-08-01T19:54:46.666 INFO:teuthology.orchestra.run.smithi101.stdout: "duration": 4.2209999999999999e-06 2023-08-01T19:54:46.666 INFO:teuthology.orchestra.run.smithi101.stdout: }, 2023-08-01T19:54:46.667 INFO:teuthology.orchestra.run.smithi101.stdout: { 2023-08-01T19:54:46.667 INFO:teuthology.orchestra.run.smithi101.stdout: "event": "reached_pg", 2023-08-01T19:54:46.667 INFO:teuthology.orchestra.run.smithi101.stdout: "time": "2023-08-01T19:54:04.459141+0000", 2023-08-01T19:54:46.667 INFO:teuthology.orchestra.run.smithi101.stdout: "duration": 2.4627e-05 2023-08-01T19:54:46.667 INFO:teuthology.orchestra.run.smithi101.stdout: }, 2023-08-01T19:54:46.667 INFO:teuthology.orchestra.run.smithi101.stdout: { 2023-08-01T19:54:46.667 INFO:teuthology.orchestra.run.smithi101.stdout: "event": "op must wait for map", 2023-08-01T19:54:46.667 INFO:teuthology.orchestra.run.smithi101.stdout: "time": "2023-08-01T19:54:04.459144+0000", 2023-08-01T19:54:46.668 INFO:teuthology.orchestra.run.smithi101.stdout: "duration": 3.6559999999999998e-06 2023-08-01T19:54:46.668 INFO:teuthology.orchestra.run.smithi101.stdout: }, 2023-08-01T19:54:46.668 INFO:teuthology.orchestra.run.smithi101.stdout: { 2023-08-01T19:54:46.668 INFO:teuthology.orchestra.run.smithi101.stdout: "event": "reached_pg", 2023-08-01T19:54:46.668 INFO:teuthology.orchestra.run.smithi101.stdout: "time": "2023-08-01T19:54:04.468086+0000", 2023-08-01T19:54:46.668 INFO:teuthology.orchestra.run.smithi101.stdout: "duration": 0.0089415569999999993 2023-08-01T19:54:46.668 INFO:teuthology.orchestra.run.smithi101.stdout: }, 2023-08-01T19:54:46.668 INFO:teuthology.orchestra.run.smithi101.stdout: { 2023-08-01T19:54:46.669 INFO:teuthology.orchestra.run.smithi101.stdout: "event": "started", 2023-08-01T19:54:46.669 INFO:teuthology.orchestra.run.smithi101.stdout: "time": "2023-08-01T19:54:04.468204+0000", 2023-08-01T19:54:46.669 INFO:teuthology.orchestra.run.smithi101.stdout: "duration": 0.00011806700000000001 2023-08-01T19:54:46.669 INFO:teuthology.orchestra.run.smithi101.stdout: }, 2023-08-01T19:54:46.669 INFO:teuthology.orchestra.run.smithi101.stdout: { 2023-08-01T19:54:46.669 INFO:teuthology.orchestra.run.smithi101.stdout: "event": "waiting for subops from 0", 2023-08-01T19:54:46.669 INFO:teuthology.orchestra.run.smithi101.stdout: "time": "2023-08-01T19:54:04.468342+0000", 2023-08-01T19:54:46.669 INFO:teuthology.orchestra.run.smithi101.stdout: "duration": 0.000138269 2023-08-01T19:54:46.670 INFO:teuthology.orchestra.run.smithi101.stdout: }, 2023-08-01T19:54:46.670 INFO:teuthology.orchestra.run.smithi101.stdout: { 2023-08-01T19:54:46.670 INFO:teuthology.orchestra.run.smithi101.stdout: "event": "op_commit", 2023-08-01T19:54:46.670 INFO:teuthology.orchestra.run.smithi101.stdout: "time": "2023-08-01T19:54:04.474028+0000", 2023-08-01T19:54:46.670 INFO:teuthology.orchestra.run.smithi101.stdout: "duration": 0.005685458 2023-08-01T19:54:46.670 INFO:teuthology.orchestra.run.smithi101.stdout: }, 2023-08-01T19:54:46.670 INFO:teuthology.orchestra.run.smithi101.stdout: { 2023-08-01T19:54:46.670 INFO:teuthology.orchestra.run.smithi101.stdout: "event": "sub_op_commit_rec", 2023-08-01T19:54:46.671 INFO:teuthology.orchestra.run.smithi101.stdout: "time": "2023-08-01T19:54:04.477581+0000", 2023-08-01T19:54:46.671 INFO:teuthology.orchestra.run.smithi101.stdout: "duration": 0.0035531109999999999 2023-08-01T19:54:46.671 INFO:teuthology.orchestra.run.smithi101.stdout: }, 2023-08-01T19:54:46.671 INFO:teuthology.orchestra.run.smithi101.stdout: { 2023-08-01T19:54:46.671 INFO:teuthology.orchestra.run.smithi101.stdout: "event": "commit_sent", 2023-08-01T19:54:46.671 INFO:teuthology.orchestra.run.smithi101.stdout: "time": "2023-08-01T19:54:04.477635+0000", 2023-08-01T19:54:46.671 INFO:teuthology.orchestra.run.smithi101.stdout: "duration": 5.3769e-05 2023-08-01T19:54:46.671 INFO:teuthology.orchestra.run.smithi101.stdout: }, 2023-08-01T19:54:46.672 INFO:teuthology.orchestra.run.smithi101.stdout: { 2023-08-01T19:54:46.672 INFO:teuthology.orchestra.run.smithi101.stdout: "event": "done", 2023-08-01T19:54:46.672 INFO:teuthology.orchestra.run.smithi101.stdout: "time": "2023-08-01T19:54:04.477676+0000", 2023-08-01T19:54:46.672 INFO:teuthology.orchestra.run.smithi101.stdout: "duration": 4.1148e-05 2023-08-01T19:54:46.672 INFO:teuthology.orchestra.run.smithi101.stdout: } 2023-08-01T19:54:46.672 INFO:teuthology.orchestra.run.smithi101.stdout: ] 2023-08-01T19:54:46.672 INFO:teuthology.orchestra.run.smithi101.stdout: } 2023-08-01T19:54:46.673 INFO:teuthology.orchestra.run.smithi101.stdout: }, 2023-08-01T19:54:46.673 INFO:teuthology.orchestra.run.smithi101.stdout: { 2023-08-01T19:54:46.673 INFO:teuthology.orchestra.run.smithi101.stdout: "description": "osd_op(mds.0.3:21 3.1c 3:3ed09add:::607.00000000:head [create,setxattr parent (62) in=6b,setxattr layout (30) in=6b] snapc 0=[] ondisk+write+known_if_redirected+full_force+supports_pool_eio e17)", 2023-08-01T19:54:46.673 INFO:teuthology.orchestra.run.smithi101.stdout: "initiated_at": "2023-08-01T19:54:04.459123+0000", 2023-08-01T19:54:46.673 INFO:teuthology.orchestra.run.smithi101.stdout: "age": 42.089953274000003, 2023-08-01T19:54:46.673 INFO:teuthology.orchestra.run.smithi101.stdout: "duration": 0.018736452000000001, 2023-08-01T19:54:46.673 INFO:teuthology.orchestra.run.smithi101.stdout: "type_data": { 2023-08-01T19:54:46.673 INFO:teuthology.orchestra.run.smithi101.stdout: "flag_point": "commit sent; apply or cleanup", 2023-08-01T19:54:46.674 INFO:teuthology.orchestra.run.smithi101.stdout: "events": [ 2023-08-01T19:54:46.674 INFO:teuthology.orchestra.run.smithi101.stdout: { 2023-08-01T19:54:46.674 INFO:teuthology.orchestra.run.smithi101.stdout: "event": "initiated", 2023-08-01T19:54:46.674 INFO:teuthology.orchestra.run.smithi101.stdout: "time": "2023-08-01T19:54:04.459123+0000", 2023-08-01T19:54:46.674 INFO:teuthology.orchestra.run.smithi101.stdout: "duration": 0 2023-08-01T19:54:46.674 INFO:teuthology.orchestra.run.smithi101.stdout: }, 2023-08-01T19:54:46.674 INFO:teuthology.orchestra.run.smithi101.stdout: { 2023-08-01T19:54:46.674 INFO:teuthology.orchestra.run.smithi101.stdout: "event": "throttled", 2023-08-01T19:54:46.675 INFO:teuthology.orchestra.run.smithi101.stdout: "time": "2023-08-01T19:54:04.459123+0000", 2023-08-01T19:54:46.675 INFO:teuthology.orchestra.run.smithi101.stdout: "duration": 0 2023-08-01T19:54:46.675 INFO:teuthology.orchestra.run.smithi101.stdout: }, 2023-08-01T19:54:46.675 INFO:teuthology.orchestra.run.smithi101.stdout: { 2023-08-01T19:54:46.675 INFO:teuthology.orchestra.run.smithi101.stdout: "event": "header_read", 2023-08-01T19:54:46.675 INFO:teuthology.orchestra.run.smithi101.stdout: "time": "2023-08-01T19:54:04.459123+0000", 2023-08-01T19:54:46.675 INFO:teuthology.orchestra.run.smithi101.stdout: "duration": 4294967295.9999995 2023-08-01T19:54:46.675 INFO:teuthology.orchestra.run.smithi101.stdout: }, 2023-08-01T19:54:46.676 INFO:teuthology.orchestra.run.smithi101.stdout: { 2023-08-01T19:54:46.676 INFO:teuthology.orchestra.run.smithi101.stdout: "event": "all_read", 2023-08-01T19:54:46.676 INFO:teuthology.orchestra.run.smithi101.stdout: "time": "2023-08-01T19:54:04.459127+0000", 2023-08-01T19:54:46.676 INFO:teuthology.orchestra.run.smithi101.stdout: "duration": 4.5770000000000004e-06 2023-08-01T19:54:46.676 INFO:teuthology.orchestra.run.smithi101.stdout: }, 2023-08-01T19:54:46.676 INFO:teuthology.orchestra.run.smithi101.stdout: { 2023-08-01T19:54:46.676 INFO:teuthology.orchestra.run.smithi101.stdout: "event": "dispatched", 2023-08-01T19:54:46.676 INFO:teuthology.orchestra.run.smithi101.stdout: "time": "2023-08-01T19:54:04.459134+0000", 2023-08-01T19:54:46.677 INFO:teuthology.orchestra.run.smithi101.stdout: "duration": 6.5080000000000002e-06 2023-08-01T19:54:46.677 INFO:teuthology.orchestra.run.smithi101.stdout: }, 2023-08-01T19:54:46.677 INFO:teuthology.orchestra.run.smithi101.stdout: { 2023-08-01T19:54:46.677 INFO:teuthology.orchestra.run.smithi101.stdout: "event": "queued_for_pg", 2023-08-01T19:54:46.677 INFO:teuthology.orchestra.run.smithi101.stdout: "time": "2023-08-01T19:54:04.459138+0000", 2023-08-01T19:54:46.677 INFO:teuthology.orchestra.run.smithi101.stdout: "duration": 4.6249999999999998e-06 2023-08-01T19:54:46.677 INFO:teuthology.orchestra.run.smithi101.stdout: }, 2023-08-01T19:54:46.677 INFO:teuthology.orchestra.run.smithi101.stdout: { 2023-08-01T19:54:46.678 INFO:teuthology.orchestra.run.smithi101.stdout: "event": "reached_pg", 2023-08-01T19:54:46.678 INFO:teuthology.orchestra.run.smithi101.stdout: "time": "2023-08-01T19:54:04.459158+0000", 2023-08-01T19:54:46.678 INFO:teuthology.orchestra.run.smithi101.stdout: "duration": 1.9354000000000001e-05 2023-08-01T19:54:46.678 INFO:teuthology.orchestra.run.smithi101.stdout: }, 2023-08-01T19:54:46.678 INFO:teuthology.orchestra.run.smithi101.stdout: { 2023-08-01T19:54:46.678 INFO:teuthology.orchestra.run.smithi101.stdout: "event": "waiting_for_map not empty", 2023-08-01T19:54:46.678 INFO:teuthology.orchestra.run.smithi101.stdout: "time": "2023-08-01T19:54:04.459160+0000", 2023-08-01T19:54:46.678 INFO:teuthology.orchestra.run.smithi101.stdout: "duration": 2.2740000000000002e-06 2023-08-01T19:54:46.679 INFO:teuthology.orchestra.run.smithi101.stdout: }, 2023-08-01T19:54:46.679 INFO:teuthology.orchestra.run.smithi101.stdout: { 2023-08-01T19:54:46.679 INFO:teuthology.orchestra.run.smithi101.stdout: "event": "reached_pg", 2023-08-01T19:54:46.679 INFO:teuthology.orchestra.run.smithi101.stdout: "time": "2023-08-01T19:54:04.468839+0000", 2023-08-01T19:54:46.679 INFO:teuthology.orchestra.run.smithi101.stdout: "duration": 0.0096787109999999996 2023-08-01T19:54:46.679 INFO:teuthology.orchestra.run.smithi101.stdout: }, 2023-08-01T19:54:46.679 INFO:teuthology.orchestra.run.smithi101.stdout: { 2023-08-01T19:54:46.679 INFO:teuthology.orchestra.run.smithi101.stdout: "event": "started", 2023-08-01T19:54:46.680 INFO:teuthology.orchestra.run.smithi101.stdout: "time": "2023-08-01T19:54:04.469446+0000", 2023-08-01T19:54:46.680 INFO:teuthology.orchestra.run.smithi101.stdout: "duration": 0.00060714899999999997 2023-08-01T19:54:46.680 INFO:teuthology.orchestra.run.smithi101.stdout: }, 2023-08-01T19:54:46.680 INFO:teuthology.orchestra.run.smithi101.stdout: { 2023-08-01T19:54:46.680 INFO:teuthology.orchestra.run.smithi101.stdout: "event": "waiting for subops from 0", 2023-08-01T19:54:46.680 INFO:teuthology.orchestra.run.smithi101.stdout: "time": "2023-08-01T19:54:04.470133+0000", 2023-08-01T19:54:46.680 INFO:teuthology.orchestra.run.smithi101.stdout: "duration": 0.00068691900000000003 2023-08-01T19:54:46.680 INFO:teuthology.orchestra.run.smithi101.stdout: }, 2023-08-01T19:54:46.681 INFO:teuthology.orchestra.run.smithi101.stdout: { 2023-08-01T19:54:46.681 INFO:teuthology.orchestra.run.smithi101.stdout: "event": "op_commit", 2023-08-01T19:54:46.681 INFO:teuthology.orchestra.run.smithi101.stdout: "time": "2023-08-01T19:54:04.475933+0000", 2023-08-01T19:54:46.681 INFO:teuthology.orchestra.run.smithi101.stdout: "duration": 0.0058002560000000002 2023-08-01T19:54:46.681 INFO:teuthology.orchestra.run.smithi101.stdout: }, 2023-08-01T19:54:46.681 INFO:teuthology.orchestra.run.smithi101.stdout: { 2023-08-01T19:54:46.681 INFO:teuthology.orchestra.run.smithi101.stdout: "event": "sub_op_commit_rec", 2023-08-01T19:54:46.681 INFO:teuthology.orchestra.run.smithi101.stdout: "time": "2023-08-01T19:54:04.477749+0000", 2023-08-01T19:54:46.682 INFO:teuthology.orchestra.run.smithi101.stdout: "duration": 0.00181584 2023-08-01T19:54:46.682 INFO:teuthology.orchestra.run.smithi101.stdout: }, 2023-08-01T19:54:46.682 INFO:teuthology.orchestra.run.smithi101.stdout: { 2023-08-01T19:54:46.682 INFO:teuthology.orchestra.run.smithi101.stdout: "event": "commit_sent", 2023-08-01T19:54:46.682 INFO:teuthology.orchestra.run.smithi101.stdout: "time": "2023-08-01T19:54:04.477823+0000", 2023-08-01T19:54:46.682 INFO:teuthology.orchestra.run.smithi101.stdout: "duration": 7.4405000000000003e-05 2023-08-01T19:54:46.682 INFO:teuthology.orchestra.run.smithi101.stdout: }, 2023-08-01T19:54:46.682 INFO:teuthology.orchestra.run.smithi101.stdout: { 2023-08-01T19:54:46.683 INFO:teuthology.orchestra.run.smithi101.stdout: "event": "done", 2023-08-01T19:54:46.683 INFO:teuthology.orchestra.run.smithi101.stdout: "time": "2023-08-01T19:54:04.477859+0000", 2023-08-01T19:54:46.683 INFO:teuthology.orchestra.run.smithi101.stdout: "duration": 3.6211000000000003e-05 2023-08-01T19:54:46.683 INFO:teuthology.orchestra.run.smithi101.stdout: } 2023-08-01T19:54:46.683 INFO:teuthology.orchestra.run.smithi101.stdout: ] 2023-08-01T19:54:46.683 INFO:teuthology.orchestra.run.smithi101.stdout: } 2023-08-01T19:54:46.683 INFO:teuthology.orchestra.run.smithi101.stdout: }, 2023-08-01T19:54:46.683 INFO:teuthology.orchestra.run.smithi101.stdout: { 2023-08-01T19:54:46.684 INFO:teuthology.orchestra.run.smithi101.stdout: "description": "osd_op(mds.0.3:1 3.14 3:292cf221:::200.00000000:head [writefull 0~90] snapc 0=[] ondisk+write+known_if_redirected+full_force+supports_pool_eio e17)", 2023-08-01T19:54:46.684 INFO:teuthology.orchestra.run.smithi101.stdout: "initiated_at": "2023-08-01T19:54:04.459177+0000", 2023-08-01T19:54:46.684 INFO:teuthology.orchestra.run.smithi101.stdout: "age": 42.089899565000003, 2023-08-01T19:54:46.684 INFO:teuthology.orchestra.run.smithi101.stdout: "duration": 0.021067196, 2023-08-01T19:54:46.684 INFO:teuthology.orchestra.run.smithi101.stdout: "type_data": { 2023-08-01T19:54:46.684 INFO:teuthology.orchestra.run.smithi101.stdout: "flag_point": "commit sent; apply or cleanup", 2023-08-01T19:54:46.684 INFO:teuthology.orchestra.run.smithi101.stdout: "events": [ 2023-08-01T19:54:46.684 INFO:teuthology.orchestra.run.smithi101.stdout: { 2023-08-01T19:54:46.685 INFO:teuthology.orchestra.run.smithi101.stdout: "event": "initiated", 2023-08-01T19:54:46.685 INFO:teuthology.orchestra.run.smithi101.stdout: "time": "2023-08-01T19:54:04.459177+0000", 2023-08-01T19:54:46.685 INFO:teuthology.orchestra.run.smithi101.stdout: "duration": 0 2023-08-01T19:54:46.685 INFO:teuthology.orchestra.run.smithi101.stdout: }, 2023-08-01T19:54:46.685 INFO:teuthology.orchestra.run.smithi101.stdout: { 2023-08-01T19:54:46.685 INFO:teuthology.orchestra.run.smithi101.stdout: "event": "throttled", 2023-08-01T19:54:46.685 INFO:teuthology.orchestra.run.smithi101.stdout: "time": "2023-08-01T19:54:04.459177+0000", 2023-08-01T19:54:46.685 INFO:teuthology.orchestra.run.smithi101.stdout: "duration": 0 2023-08-01T19:54:46.686 INFO:teuthology.orchestra.run.smithi101.stdout: }, 2023-08-01T19:54:46.686 INFO:teuthology.orchestra.run.smithi101.stdout: { 2023-08-01T19:54:46.686 INFO:teuthology.orchestra.run.smithi101.stdout: "event": "header_read", 2023-08-01T19:54:46.686 INFO:teuthology.orchestra.run.smithi101.stdout: "time": "2023-08-01T19:54:04.459176+0000", 2023-08-01T19:54:46.686 INFO:teuthology.orchestra.run.smithi101.stdout: "duration": 4294967295.9999995 2023-08-01T19:54:46.686 INFO:teuthology.orchestra.run.smithi101.stdout: }, 2023-08-01T19:54:46.686 INFO:teuthology.orchestra.run.smithi101.stdout: { 2023-08-01T19:54:46.686 INFO:teuthology.orchestra.run.smithi101.stdout: "event": "all_read", 2023-08-01T19:54:46.687 INFO:teuthology.orchestra.run.smithi101.stdout: "time": "2023-08-01T19:54:04.459181+0000", 2023-08-01T19:54:46.687 INFO:teuthology.orchestra.run.smithi101.stdout: "duration": 5.2109999999999997e-06 2023-08-01T19:54:46.687 INFO:teuthology.orchestra.run.smithi101.stdout: }, 2023-08-01T19:54:46.687 INFO:teuthology.orchestra.run.smithi101.stdout: { 2023-08-01T19:54:46.687 INFO:teuthology.orchestra.run.smithi101.stdout: "event": "dispatched", 2023-08-01T19:54:46.687 INFO:teuthology.orchestra.run.smithi101.stdout: "time": "2023-08-01T19:54:04.459188+0000", 2023-08-01T19:54:46.687 INFO:teuthology.orchestra.run.smithi101.stdout: "duration": 6.6680000000000004e-06 2023-08-01T19:54:46.687 INFO:teuthology.orchestra.run.smithi101.stdout: }, 2023-08-01T19:54:46.688 INFO:teuthology.orchestra.run.smithi101.stdout: { 2023-08-01T19:54:46.688 INFO:teuthology.orchestra.run.smithi101.stdout: "event": "queued_for_pg", 2023-08-01T19:54:46.688 INFO:teuthology.orchestra.run.smithi101.stdout: "time": "2023-08-01T19:54:04.459192+0000", 2023-08-01T19:54:46.688 INFO:teuthology.orchestra.run.smithi101.stdout: "duration": 4.228e-06 2023-08-01T19:54:46.688 INFO:teuthology.orchestra.run.smithi101.stdout: }, 2023-08-01T19:54:46.688 INFO:teuthology.orchestra.run.smithi101.stdout: { 2023-08-01T19:54:46.688 INFO:teuthology.orchestra.run.smithi101.stdout: "event": "reached_pg", 2023-08-01T19:54:46.688 INFO:teuthology.orchestra.run.smithi101.stdout: "time": "2023-08-01T19:54:04.459219+0000", 2023-08-01T19:54:46.689 INFO:teuthology.orchestra.run.smithi101.stdout: "duration": 2.6930000000000001e-05 2023-08-01T19:54:46.689 INFO:teuthology.orchestra.run.smithi101.stdout: }, 2023-08-01T19:54:46.689 INFO:teuthology.orchestra.run.smithi101.stdout: { 2023-08-01T19:54:46.689 INFO:teuthology.orchestra.run.smithi101.stdout: "event": "waiting_for_map not empty", 2023-08-01T19:54:46.689 INFO:teuthology.orchestra.run.smithi101.stdout: "time": "2023-08-01T19:54:04.459223+0000", 2023-08-01T19:54:46.689 INFO:teuthology.orchestra.run.smithi101.stdout: "duration": 3.8469999999999998e-06 2023-08-01T19:54:46.689 INFO:teuthology.orchestra.run.smithi101.stdout: }, 2023-08-01T19:54:46.689 INFO:teuthology.orchestra.run.smithi101.stdout: { 2023-08-01T19:54:46.690 INFO:teuthology.orchestra.run.smithi101.stdout: "event": "reached_pg", 2023-08-01T19:54:46.690 INFO:teuthology.orchestra.run.smithi101.stdout: "time": "2023-08-01T19:54:04.473347+0000", 2023-08-01T19:54:46.690 INFO:teuthology.orchestra.run.smithi101.stdout: "duration": 0.014124319 2023-08-01T19:54:46.690 INFO:teuthology.orchestra.run.smithi101.stdout: }, 2023-08-01T19:54:46.690 INFO:teuthology.orchestra.run.smithi101.stdout: { 2023-08-01T19:54:46.690 INFO:teuthology.orchestra.run.smithi101.stdout: "event": "started", 2023-08-01T19:54:46.690 INFO:teuthology.orchestra.run.smithi101.stdout: "time": "2023-08-01T19:54:04.473480+0000", 2023-08-01T19:54:46.690 INFO:teuthology.orchestra.run.smithi101.stdout: "duration": 0.00013276799999999999 2023-08-01T19:54:46.691 INFO:teuthology.orchestra.run.smithi101.stdout: }, 2023-08-01T19:54:46.691 INFO:teuthology.orchestra.run.smithi101.stdout: { 2023-08-01T19:54:46.691 INFO:teuthology.orchestra.run.smithi101.stdout: "event": "waiting for subops from 2", 2023-08-01T19:54:46.691 INFO:teuthology.orchestra.run.smithi101.stdout: "time": "2023-08-01T19:54:04.473622+0000", 2023-08-01T19:54:46.691 INFO:teuthology.orchestra.run.smithi101.stdout: "duration": 0.00014154799999999999 2023-08-01T19:54:46.691 INFO:teuthology.orchestra.run.smithi101.stdout: }, 2023-08-01T19:54:46.691 INFO:teuthology.orchestra.run.smithi101.stdout: { 2023-08-01T19:54:46.691 INFO:teuthology.orchestra.run.smithi101.stdout: "event": "op_commit", 2023-08-01T19:54:46.692 INFO:teuthology.orchestra.run.smithi101.stdout: "time": "2023-08-01T19:54:04.478281+0000", 2023-08-01T19:54:46.692 INFO:teuthology.orchestra.run.smithi101.stdout: "duration": 0.004659252 2023-08-01T19:54:46.692 INFO:teuthology.orchestra.run.smithi101.stdout: }, 2023-08-01T19:54:46.692 INFO:teuthology.orchestra.run.smithi101.stdout: { 2023-08-01T19:54:46.692 INFO:teuthology.orchestra.run.smithi101.stdout: "event": "sub_op_commit_rec", 2023-08-01T19:54:46.692 INFO:teuthology.orchestra.run.smithi101.stdout: "time": "2023-08-01T19:54:04.480180+0000", 2023-08-01T19:54:46.692 INFO:teuthology.orchestra.run.smithi101.stdout: "duration": 0.0018986859999999999 2023-08-01T19:54:46.692 INFO:teuthology.orchestra.run.smithi101.stdout: }, 2023-08-01T19:54:46.693 INFO:teuthology.orchestra.run.smithi101.stdout: { 2023-08-01T19:54:46.693 INFO:teuthology.orchestra.run.smithi101.stdout: "event": "commit_sent", 2023-08-01T19:54:46.693 INFO:teuthology.orchestra.run.smithi101.stdout: "time": "2023-08-01T19:54:04.480209+0000", 2023-08-01T19:54:46.693 INFO:teuthology.orchestra.run.smithi101.stdout: "duration": 2.9244999999999999e-05 2023-08-01T19:54:46.693 INFO:teuthology.orchestra.run.smithi101.stdout: }, 2023-08-01T19:54:46.693 INFO:teuthology.orchestra.run.smithi101.stdout: { 2023-08-01T19:54:46.693 INFO:teuthology.orchestra.run.smithi101.stdout: "event": "done", 2023-08-01T19:54:46.693 INFO:teuthology.orchestra.run.smithi101.stdout: "time": "2023-08-01T19:54:04.480244+0000", 2023-08-01T19:54:46.694 INFO:teuthology.orchestra.run.smithi101.stdout: "duration": 3.4875000000000001e-05 2023-08-01T19:54:46.694 INFO:teuthology.orchestra.run.smithi101.stdout: } 2023-08-01T19:54:46.694 INFO:teuthology.orchestra.run.smithi101.stdout: ] 2023-08-01T19:54:46.694 INFO:teuthology.orchestra.run.smithi101.stdout: } 2023-08-01T19:54:46.694 INFO:teuthology.orchestra.run.smithi101.stdout: }, 2023-08-01T19:54:46.694 INFO:teuthology.orchestra.run.smithi101.stdout: { 2023-08-01T19:54:46.694 INFO:teuthology.orchestra.run.smithi101.stdout: "description": "osd_op(mds.0.3:2 3.f 3:f1f69726:::400.00000000:head [writefull 0~22] snapc 0=[] ondisk+write+known_if_redirected+full_force+supports_pool_eio e17)", 2023-08-01T19:54:46.695 INFO:teuthology.orchestra.run.smithi101.stdout: "initiated_at": "2023-08-01T19:54:04.459201+0000", 2023-08-01T19:54:46.695 INFO:teuthology.orchestra.run.smithi101.stdout: "age": 42.089875309, 2023-08-01T19:54:46.695 INFO:teuthology.orchestra.run.smithi101.stdout: "duration": 0.016952979, 2023-08-01T19:54:46.695 INFO:teuthology.orchestra.run.smithi101.stdout: "type_data": { 2023-08-01T19:54:46.695 INFO:teuthology.orchestra.run.smithi101.stdout: "flag_point": "commit sent; apply or cleanup", 2023-08-01T19:54:46.695 INFO:teuthology.orchestra.run.smithi101.stdout: "events": [ 2023-08-01T19:54:46.695 INFO:teuthology.orchestra.run.smithi101.stdout: { 2023-08-01T19:54:46.695 INFO:teuthology.orchestra.run.smithi101.stdout: "event": "initiated", 2023-08-01T19:54:46.696 INFO:teuthology.orchestra.run.smithi101.stdout: "time": "2023-08-01T19:54:04.459201+0000", 2023-08-01T19:54:46.696 INFO:teuthology.orchestra.run.smithi101.stdout: "duration": 0 2023-08-01T19:54:46.696 INFO:teuthology.orchestra.run.smithi101.stdout: }, 2023-08-01T19:54:46.696 INFO:teuthology.orchestra.run.smithi101.stdout: { 2023-08-01T19:54:46.696 INFO:teuthology.orchestra.run.smithi101.stdout: "event": "throttled", 2023-08-01T19:54:46.696 INFO:teuthology.orchestra.run.smithi101.stdout: "time": "2023-08-01T19:54:04.459201+0000", 2023-08-01T19:54:46.696 INFO:teuthology.orchestra.run.smithi101.stdout: "duration": 0 2023-08-01T19:54:46.696 INFO:teuthology.orchestra.run.smithi101.stdout: }, 2023-08-01T19:54:46.697 INFO:teuthology.orchestra.run.smithi101.stdout: { 2023-08-01T19:54:46.697 INFO:teuthology.orchestra.run.smithi101.stdout: "event": "header_read", 2023-08-01T19:54:46.697 INFO:teuthology.orchestra.run.smithi101.stdout: "time": "2023-08-01T19:54:04.459201+0000", 2023-08-01T19:54:46.697 INFO:teuthology.orchestra.run.smithi101.stdout: "duration": 4294967295.9999995 2023-08-01T19:54:46.697 INFO:teuthology.orchestra.run.smithi101.stdout: }, 2023-08-01T19:54:46.697 INFO:teuthology.orchestra.run.smithi101.stdout: { 2023-08-01T19:54:46.697 INFO:teuthology.orchestra.run.smithi101.stdout: "event": "all_read", 2023-08-01T19:54:46.698 INFO:teuthology.orchestra.run.smithi101.stdout: "time": "2023-08-01T19:54:04.459204+0000", 2023-08-01T19:54:46.698 INFO:teuthology.orchestra.run.smithi101.stdout: "duration": 3.5599999999999998e-06 2023-08-01T19:54:46.698 INFO:teuthology.orchestra.run.smithi101.stdout: }, 2023-08-01T19:54:46.698 INFO:teuthology.orchestra.run.smithi101.stdout: { 2023-08-01T19:54:46.698 INFO:teuthology.orchestra.run.smithi101.stdout: "event": "dispatched", 2023-08-01T19:54:46.698 INFO:teuthology.orchestra.run.smithi101.stdout: "time": "2023-08-01T19:54:04.459211+0000", 2023-08-01T19:54:46.698 INFO:teuthology.orchestra.run.smithi101.stdout: "duration": 6.9299999999999997e-06 2023-08-01T19:54:46.698 INFO:teuthology.orchestra.run.smithi101.stdout: }, 2023-08-01T19:54:46.699 INFO:teuthology.orchestra.run.smithi101.stdout: { 2023-08-01T19:54:46.699 INFO:teuthology.orchestra.run.smithi101.stdout: "event": "queued_for_pg", 2023-08-01T19:54:46.699 INFO:teuthology.orchestra.run.smithi101.stdout: "time": "2023-08-01T19:54:04.459216+0000", 2023-08-01T19:54:46.699 INFO:teuthology.orchestra.run.smithi101.stdout: "duration": 4.5050000000000001e-06 2023-08-01T19:54:46.699 INFO:teuthology.orchestra.run.smithi101.stdout: }, 2023-08-01T19:54:46.699 INFO:teuthology.orchestra.run.smithi101.stdout: { 2023-08-01T19:54:46.699 INFO:teuthology.orchestra.run.smithi101.stdout: "event": "reached_pg", 2023-08-01T19:54:46.699 INFO:teuthology.orchestra.run.smithi101.stdout: "time": "2023-08-01T19:54:04.459246+0000", 2023-08-01T19:54:46.700 INFO:teuthology.orchestra.run.smithi101.stdout: "duration": 3.0369999999999999e-05 2023-08-01T19:54:46.700 INFO:teuthology.orchestra.run.smithi101.stdout: }, 2023-08-01T19:54:46.700 INFO:teuthology.orchestra.run.smithi101.stdout: { 2023-08-01T19:54:46.700 INFO:teuthology.orchestra.run.smithi101.stdout: "event": "op must wait for map", 2023-08-01T19:54:46.700 INFO:teuthology.orchestra.run.smithi101.stdout: "time": "2023-08-01T19:54:04.459250+0000", 2023-08-01T19:54:46.700 INFO:teuthology.orchestra.run.smithi101.stdout: "duration": 3.6880000000000001e-06 2023-08-01T19:54:46.700 INFO:teuthology.orchestra.run.smithi101.stdout: }, 2023-08-01T19:54:46.700 INFO:teuthology.orchestra.run.smithi101.stdout: { 2023-08-01T19:54:46.701 INFO:teuthology.orchestra.run.smithi101.stdout: "event": "reached_pg", 2023-08-01T19:54:46.701 INFO:teuthology.orchestra.run.smithi101.stdout: "time": "2023-08-01T19:54:04.469499+0000", 2023-08-01T19:54:46.701 INFO:teuthology.orchestra.run.smithi101.stdout: "duration": 0.010249052 2023-08-01T19:54:46.701 INFO:teuthology.orchestra.run.smithi101.stdout: }, 2023-08-01T19:54:46.701 INFO:teuthology.orchestra.run.smithi101.stdout: { 2023-08-01T19:54:46.701 INFO:teuthology.orchestra.run.smithi101.stdout: "event": "started", 2023-08-01T19:54:46.701 INFO:teuthology.orchestra.run.smithi101.stdout: "time": "2023-08-01T19:54:04.469619+0000", 2023-08-01T19:54:46.702 INFO:teuthology.orchestra.run.smithi101.stdout: "duration": 0.000120061 2023-08-01T19:54:46.702 INFO:teuthology.orchestra.run.smithi101.stdout: }, 2023-08-01T19:54:46.702 INFO:teuthology.orchestra.run.smithi101.stdout: { 2023-08-01T19:54:46.702 INFO:teuthology.orchestra.run.smithi101.stdout: "event": "waiting for subops from 2", 2023-08-01T19:54:46.702 INFO:teuthology.orchestra.run.smithi101.stdout: "time": "2023-08-01T19:54:04.469903+0000", 2023-08-01T19:54:46.702 INFO:teuthology.orchestra.run.smithi101.stdout: "duration": 0.00028409799999999999 2023-08-01T19:54:46.702 INFO:teuthology.orchestra.run.smithi101.stdout: }, 2023-08-01T19:54:46.702 INFO:teuthology.orchestra.run.smithi101.stdout: { 2023-08-01T19:54:46.703 INFO:teuthology.orchestra.run.smithi101.stdout: "event": "sub_op_commit_rec", 2023-08-01T19:54:46.703 INFO:teuthology.orchestra.run.smithi101.stdout: "time": "2023-08-01T19:54:04.475166+0000", 2023-08-01T19:54:46.703 INFO:teuthology.orchestra.run.smithi101.stdout: "duration": 0.0052632460000000001 2023-08-01T19:54:46.703 INFO:teuthology.orchestra.run.smithi101.stdout: }, 2023-08-01T19:54:46.703 INFO:teuthology.orchestra.run.smithi101.stdout: { 2023-08-01T19:54:46.703 INFO:teuthology.orchestra.run.smithi101.stdout: "event": "op_commit", 2023-08-01T19:54:46.703 INFO:teuthology.orchestra.run.smithi101.stdout: "time": "2023-08-01T19:54:04.476056+0000", 2023-08-01T19:54:46.703 INFO:teuthology.orchestra.run.smithi101.stdout: "duration": 0.00089017499999999999 2023-08-01T19:54:46.704 INFO:teuthology.orchestra.run.smithi101.stdout: }, 2023-08-01T19:54:46.704 INFO:teuthology.orchestra.run.smithi101.stdout: { 2023-08-01T19:54:46.704 INFO:teuthology.orchestra.run.smithi101.stdout: "event": "commit_sent", 2023-08-01T19:54:46.704 INFO:teuthology.orchestra.run.smithi101.stdout: "time": "2023-08-01T19:54:04.476115+0000", 2023-08-01T19:54:46.704 INFO:teuthology.orchestra.run.smithi101.stdout: "duration": 5.8464999999999997e-05 2023-08-01T19:54:46.704 INFO:teuthology.orchestra.run.smithi101.stdout: }, 2023-08-01T19:54:46.704 INFO:teuthology.orchestra.run.smithi101.stdout: { 2023-08-01T19:54:46.704 INFO:teuthology.orchestra.run.smithi101.stdout: "event": "done", 2023-08-01T19:54:46.705 INFO:teuthology.orchestra.run.smithi101.stdout: "time": "2023-08-01T19:54:04.476154+0000", 2023-08-01T19:54:46.705 INFO:teuthology.orchestra.run.smithi101.stdout: "duration": 3.9229e-05 2023-08-01T19:54:46.705 INFO:teuthology.orchestra.run.smithi101.stdout: } 2023-08-01T19:54:46.705 INFO:teuthology.orchestra.run.smithi101.stdout: ] 2023-08-01T19:54:46.705 INFO:teuthology.orchestra.run.smithi101.stdout: } 2023-08-01T19:54:46.705 INFO:teuthology.orchestra.run.smithi101.stdout: }, 2023-08-01T19:54:46.705 INFO:teuthology.orchestra.run.smithi101.stdout: { 2023-08-01T19:54:46.705 INFO:teuthology.orchestra.run.smithi101.stdout: "description": "osd_op(mds.0.3:3 3.14 3:287034c4:::1.00000000.inode:head [writefull 0~554] snapc 0=[] ondisk+write+known_if_redirected+full_force+supports_pool_eio e17)", 2023-08-01T19:54:46.706 INFO:teuthology.orchestra.run.smithi101.stdout: "initiated_at": "2023-08-01T19:54:04.459226+0000", 2023-08-01T19:54:46.706 INFO:teuthology.orchestra.run.smithi101.stdout: "age": 42.089850486000003, 2023-08-01T19:54:46.706 INFO:teuthology.orchestra.run.smithi101.stdout: "duration": 0.021104531999999999, 2023-08-01T19:54:46.706 INFO:teuthology.orchestra.run.smithi101.stdout: "type_data": { 2023-08-01T19:54:46.706 INFO:teuthology.orchestra.run.smithi101.stdout: "flag_point": "commit sent; apply or cleanup", 2023-08-01T19:54:46.706 INFO:teuthology.orchestra.run.smithi101.stdout: "events": [ 2023-08-01T19:54:46.706 INFO:teuthology.orchestra.run.smithi101.stdout: { 2023-08-01T19:54:46.707 INFO:teuthology.orchestra.run.smithi101.stdout: "event": "initiated", 2023-08-01T19:54:46.707 INFO:teuthology.orchestra.run.smithi101.stdout: "time": "2023-08-01T19:54:04.459226+0000", 2023-08-01T19:54:46.707 INFO:teuthology.orchestra.run.smithi101.stdout: "duration": 0 2023-08-01T19:54:46.707 INFO:teuthology.orchestra.run.smithi101.stdout: }, 2023-08-01T19:54:46.707 INFO:teuthology.orchestra.run.smithi101.stdout: { 2023-08-01T19:54:46.707 INFO:teuthology.orchestra.run.smithi101.stdout: "event": "throttled", 2023-08-01T19:54:46.707 INFO:teuthology.orchestra.run.smithi101.stdout: "time": "2023-08-01T19:54:04.459226+0000", 2023-08-01T19:54:46.707 INFO:teuthology.orchestra.run.smithi101.stdout: "duration": 0 2023-08-01T19:54:46.708 INFO:teuthology.orchestra.run.smithi101.stdout: }, 2023-08-01T19:54:46.708 INFO:teuthology.orchestra.run.smithi101.stdout: { 2023-08-01T19:54:46.708 INFO:teuthology.orchestra.run.smithi101.stdout: "event": "header_read", 2023-08-01T19:54:46.708 INFO:teuthology.orchestra.run.smithi101.stdout: "time": "2023-08-01T19:54:04.459225+0000", 2023-08-01T19:54:46.708 INFO:teuthology.orchestra.run.smithi101.stdout: "duration": 4294967295.9999995 2023-08-01T19:54:46.708 INFO:teuthology.orchestra.run.smithi101.stdout: }, 2023-08-01T19:54:46.708 INFO:teuthology.orchestra.run.smithi101.stdout: { 2023-08-01T19:54:46.708 INFO:teuthology.orchestra.run.smithi101.stdout: "event": "all_read", 2023-08-01T19:54:46.709 INFO:teuthology.orchestra.run.smithi101.stdout: "time": "2023-08-01T19:54:04.459238+0000", 2023-08-01T19:54:46.709 INFO:teuthology.orchestra.run.smithi101.stdout: "duration": 1.2809000000000001e-05 2023-08-01T19:54:46.709 INFO:teuthology.orchestra.run.smithi101.stdout: }, 2023-08-01T19:54:46.709 INFO:teuthology.orchestra.run.smithi101.stdout: { 2023-08-01T19:54:46.709 INFO:teuthology.orchestra.run.smithi101.stdout: "event": "dispatched", 2023-08-01T19:54:46.709 INFO:teuthology.orchestra.run.smithi101.stdout: "time": "2023-08-01T19:54:04.459245+0000", 2023-08-01T19:54:46.709 INFO:teuthology.orchestra.run.smithi101.stdout: "duration": 6.6540000000000002e-06 2023-08-01T19:54:46.709 INFO:teuthology.orchestra.run.smithi101.stdout: }, 2023-08-01T19:54:46.710 INFO:teuthology.orchestra.run.smithi101.stdout: { 2023-08-01T19:54:46.710 INFO:teuthology.orchestra.run.smithi101.stdout: "event": "queued_for_pg", 2023-08-01T19:54:46.710 INFO:teuthology.orchestra.run.smithi101.stdout: "time": "2023-08-01T19:54:04.459249+0000", 2023-08-01T19:54:46.710 INFO:teuthology.orchestra.run.smithi101.stdout: "duration": 4.6e-06 2023-08-01T19:54:46.710 INFO:teuthology.orchestra.run.smithi101.stdout: }, 2023-08-01T19:54:46.710 INFO:teuthology.orchestra.run.smithi101.stdout: { 2023-08-01T19:54:46.710 INFO:teuthology.orchestra.run.smithi101.stdout: "event": "reached_pg", 2023-08-01T19:54:46.710 INFO:teuthology.orchestra.run.smithi101.stdout: "time": "2023-08-01T19:54:04.459276+0000", 2023-08-01T19:54:46.711 INFO:teuthology.orchestra.run.smithi101.stdout: "duration": 2.6373999999999999e-05 2023-08-01T19:54:46.711 INFO:teuthology.orchestra.run.smithi101.stdout: }, 2023-08-01T19:54:46.711 INFO:teuthology.orchestra.run.smithi101.stdout: { 2023-08-01T19:54:46.711 INFO:teuthology.orchestra.run.smithi101.stdout: "event": "waiting_for_map not empty", 2023-08-01T19:54:46.711 INFO:teuthology.orchestra.run.smithi101.stdout: "time": "2023-08-01T19:54:04.459278+0000", 2023-08-01T19:54:46.711 INFO:teuthology.orchestra.run.smithi101.stdout: "duration": 2.4980000000000001e-06 2023-08-01T19:54:46.711 INFO:teuthology.orchestra.run.smithi101.stdout: }, 2023-08-01T19:54:46.711 INFO:teuthology.orchestra.run.smithi101.stdout: { 2023-08-01T19:54:46.712 INFO:teuthology.orchestra.run.smithi101.stdout: "event": "reached_pg", 2023-08-01T19:54:46.712 INFO:teuthology.orchestra.run.smithi101.stdout: "time": "2023-08-01T19:54:04.474058+0000", 2023-08-01T19:54:46.712 INFO:teuthology.orchestra.run.smithi101.stdout: "duration": 0.014779979 2023-08-01T19:54:46.712 INFO:teuthology.orchestra.run.smithi101.stdout: }, 2023-08-01T19:54:46.712 INFO:teuthology.orchestra.run.smithi101.stdout: { 2023-08-01T19:54:46.712 INFO:teuthology.orchestra.run.smithi101.stdout: "event": "started", 2023-08-01T19:54:46.712 INFO:teuthology.orchestra.run.smithi101.stdout: "time": "2023-08-01T19:54:04.474614+0000", 2023-08-01T19:54:46.712 INFO:teuthology.orchestra.run.smithi101.stdout: "duration": 0.00055546899999999995 2023-08-01T19:54:46.713 INFO:teuthology.orchestra.run.smithi101.stdout: }, 2023-08-01T19:54:46.713 INFO:teuthology.orchestra.run.smithi101.stdout: { 2023-08-01T19:54:46.713 INFO:teuthology.orchestra.run.smithi101.stdout: "event": "waiting for subops from 2", 2023-08-01T19:54:46.713 INFO:teuthology.orchestra.run.smithi101.stdout: "time": "2023-08-01T19:54:04.474720+0000", 2023-08-01T19:54:46.713 INFO:teuthology.orchestra.run.smithi101.stdout: "duration": 0.00010645300000000001 2023-08-01T19:54:46.713 INFO:teuthology.orchestra.run.smithi101.stdout: }, 2023-08-01T19:54:46.713 INFO:teuthology.orchestra.run.smithi101.stdout: { 2023-08-01T19:54:46.714 INFO:teuthology.orchestra.run.smithi101.stdout: "event": "op_commit", 2023-08-01T19:54:46.714 INFO:teuthology.orchestra.run.smithi101.stdout: "time": "2023-08-01T19:54:04.478480+0000", 2023-08-01T19:54:46.714 INFO:teuthology.orchestra.run.smithi101.stdout: "duration": 0.0037600279999999999 2023-08-01T19:54:46.714 INFO:teuthology.orchestra.run.smithi101.stdout: }, 2023-08-01T19:54:46.714 INFO:teuthology.orchestra.run.smithi101.stdout: { 2023-08-01T19:54:46.714 INFO:teuthology.orchestra.run.smithi101.stdout: "event": "sub_op_commit_rec", 2023-08-01T19:54:46.714 INFO:teuthology.orchestra.run.smithi101.stdout: "time": "2023-08-01T19:54:04.480273+0000", 2023-08-01T19:54:46.714 INFO:teuthology.orchestra.run.smithi101.stdout: "duration": 0.001792465 2023-08-01T19:54:46.715 INFO:teuthology.orchestra.run.smithi101.stdout: }, 2023-08-01T19:54:46.715 INFO:teuthology.orchestra.run.smithi101.stdout: { 2023-08-01T19:54:46.715 INFO:teuthology.orchestra.run.smithi101.stdout: "event": "commit_sent", 2023-08-01T19:54:46.715 INFO:teuthology.orchestra.run.smithi101.stdout: "time": "2023-08-01T19:54:04.480304+0000", 2023-08-01T19:54:46.715 INFO:teuthology.orchestra.run.smithi101.stdout: "duration": 3.1708999999999997e-05 2023-08-01T19:54:46.715 INFO:teuthology.orchestra.run.smithi101.stdout: }, 2023-08-01T19:54:46.715 INFO:teuthology.orchestra.run.smithi101.stdout: { 2023-08-01T19:54:46.715 INFO:teuthology.orchestra.run.smithi101.stdout: "event": "done", 2023-08-01T19:54:46.716 INFO:teuthology.orchestra.run.smithi101.stdout: "time": "2023-08-01T19:54:04.480330+0000", 2023-08-01T19:54:46.716 INFO:teuthology.orchestra.run.smithi101.stdout: "duration": 2.5860999999999999e-05 2023-08-01T19:54:46.716 INFO:teuthology.orchestra.run.smithi101.stdout: } 2023-08-01T19:54:46.716 INFO:teuthology.orchestra.run.smithi101.stdout: ] 2023-08-01T19:54:46.716 INFO:teuthology.orchestra.run.smithi101.stdout: } 2023-08-01T19:54:46.716 INFO:teuthology.orchestra.run.smithi101.stdout: }, 2023-08-01T19:54:46.716 INFO:teuthology.orchestra.run.smithi101.stdout: { 2023-08-01T19:54:46.716 INFO:teuthology.orchestra.run.smithi101.stdout: "description": "osd_op(mds.0.3:27 3.13 3:c91d4a1d:::mds0_inotable:head [writefull 0~34] snapc 0=[] ondisk+write+known_if_redirected+full_force+supports_pool_eio e17)", 2023-08-01T19:54:46.717 INFO:teuthology.orchestra.run.smithi101.stdout: "initiated_at": "2023-08-01T19:54:04.459260+0000", 2023-08-01T19:54:46.717 INFO:teuthology.orchestra.run.smithi101.stdout: "age": 42.089816595000002, 2023-08-01T19:54:46.717 INFO:teuthology.orchestra.run.smithi101.stdout: "duration": 0.016792715999999999, 2023-08-01T19:54:46.717 INFO:teuthology.orchestra.run.smithi101.stdout: "type_data": { 2023-08-01T19:54:46.717 INFO:teuthology.orchestra.run.smithi101.stdout: "flag_point": "commit sent; apply or cleanup", 2023-08-01T19:54:46.717 INFO:teuthology.orchestra.run.smithi101.stdout: "events": [ 2023-08-01T19:54:46.717 INFO:teuthology.orchestra.run.smithi101.stdout: { 2023-08-01T19:54:46.717 INFO:teuthology.orchestra.run.smithi101.stdout: "event": "initiated", 2023-08-01T19:54:46.718 INFO:teuthology.orchestra.run.smithi101.stdout: "time": "2023-08-01T19:54:04.459260+0000", 2023-08-01T19:54:46.718 INFO:teuthology.orchestra.run.smithi101.stdout: "duration": 0 2023-08-01T19:54:46.718 INFO:teuthology.orchestra.run.smithi101.stdout: }, 2023-08-01T19:54:46.718 INFO:teuthology.orchestra.run.smithi101.stdout: { 2023-08-01T19:54:46.718 INFO:teuthology.orchestra.run.smithi101.stdout: "event": "throttled", 2023-08-01T19:54:46.718 INFO:teuthology.orchestra.run.smithi101.stdout: "time": "2023-08-01T19:54:04.459260+0000", 2023-08-01T19:54:46.718 INFO:teuthology.orchestra.run.smithi101.stdout: "duration": 0 2023-08-01T19:54:46.718 INFO:teuthology.orchestra.run.smithi101.stdout: }, 2023-08-01T19:54:46.719 INFO:teuthology.orchestra.run.smithi101.stdout: { 2023-08-01T19:54:46.719 INFO:teuthology.orchestra.run.smithi101.stdout: "event": "header_read", 2023-08-01T19:54:46.719 INFO:teuthology.orchestra.run.smithi101.stdout: "time": "2023-08-01T19:54:04.459259+0000", 2023-08-01T19:54:46.719 INFO:teuthology.orchestra.run.smithi101.stdout: "duration": 4294967295.9999995 2023-08-01T19:54:46.719 INFO:teuthology.orchestra.run.smithi101.stdout: }, 2023-08-01T19:54:46.719 INFO:teuthology.orchestra.run.smithi101.stdout: { 2023-08-01T19:54:46.719 INFO:teuthology.orchestra.run.smithi101.stdout: "event": "all_read", 2023-08-01T19:54:46.720 INFO:teuthology.orchestra.run.smithi101.stdout: "time": "2023-08-01T19:54:04.459263+0000", 2023-08-01T19:54:46.720 INFO:teuthology.orchestra.run.smithi101.stdout: "duration": 3.9249999999999997e-06 2023-08-01T19:54:46.720 INFO:teuthology.orchestra.run.smithi101.stdout: }, 2023-08-01T19:54:46.720 INFO:teuthology.orchestra.run.smithi101.stdout: { 2023-08-01T19:54:46.720 INFO:teuthology.orchestra.run.smithi101.stdout: "event": "dispatched", 2023-08-01T19:54:46.720 INFO:teuthology.orchestra.run.smithi101.stdout: "time": "2023-08-01T19:54:04.459270+0000", 2023-08-01T19:54:46.720 INFO:teuthology.orchestra.run.smithi101.stdout: "duration": 7.0180000000000004e-06 2023-08-01T19:54:46.721 INFO:teuthology.orchestra.run.smithi101.stdout: }, 2023-08-01T19:54:46.721 INFO:teuthology.orchestra.run.smithi101.stdout: { 2023-08-01T19:54:46.721 INFO:teuthology.orchestra.run.smithi101.stdout: "event": "queued_for_pg", 2023-08-01T19:54:46.721 INFO:teuthology.orchestra.run.smithi101.stdout: "time": "2023-08-01T19:54:04.459275+0000", 2023-08-01T19:54:46.721 INFO:teuthology.orchestra.run.smithi101.stdout: "duration": 4.763e-06 2023-08-01T19:54:46.721 INFO:teuthology.orchestra.run.smithi101.stdout: }, 2023-08-01T19:54:46.721 INFO:teuthology.orchestra.run.smithi101.stdout: { 2023-08-01T19:54:46.721 INFO:teuthology.orchestra.run.smithi101.stdout: "event": "reached_pg", 2023-08-01T19:54:46.722 INFO:teuthology.orchestra.run.smithi101.stdout: "time": "2023-08-01T19:54:04.459298+0000", 2023-08-01T19:54:46.722 INFO:teuthology.orchestra.run.smithi101.stdout: "duration": 2.3193e-05 2023-08-01T19:54:46.722 INFO:teuthology.orchestra.run.smithi101.stdout: }, 2023-08-01T19:54:46.722 INFO:teuthology.orchestra.run.smithi101.stdout: { 2023-08-01T19:54:46.722 INFO:teuthology.orchestra.run.smithi101.stdout: "event": "waiting_for_map not empty", 2023-08-01T19:54:46.722 INFO:teuthology.orchestra.run.smithi101.stdout: "time": "2023-08-01T19:54:04.459301+0000", 2023-08-01T19:54:46.722 INFO:teuthology.orchestra.run.smithi101.stdout: "duration": 3.0539999999999999e-06 2023-08-01T19:54:46.722 INFO:teuthology.orchestra.run.smithi101.stdout: }, 2023-08-01T19:54:46.723 INFO:teuthology.orchestra.run.smithi101.stdout: { 2023-08-01T19:54:46.723 INFO:teuthology.orchestra.run.smithi101.stdout: "event": "reached_pg", 2023-08-01T19:54:46.723 INFO:teuthology.orchestra.run.smithi101.stdout: "time": "2023-08-01T19:54:04.469447+0000", 2023-08-01T19:54:46.723 INFO:teuthology.orchestra.run.smithi101.stdout: "duration": 0.010145573999999999 2023-08-01T19:54:46.723 INFO:teuthology.orchestra.run.smithi101.stdout: }, 2023-08-01T19:54:46.723 INFO:teuthology.orchestra.run.smithi101.stdout: { 2023-08-01T19:54:46.723 INFO:teuthology.orchestra.run.smithi101.stdout: "event": "started", 2023-08-01T19:54:46.723 INFO:teuthology.orchestra.run.smithi101.stdout: "time": "2023-08-01T19:54:04.469559+0000", 2023-08-01T19:54:46.724 INFO:teuthology.orchestra.run.smithi101.stdout: "duration": 0.000112068 2023-08-01T19:54:46.724 INFO:teuthology.orchestra.run.smithi101.stdout: }, 2023-08-01T19:54:46.724 INFO:teuthology.orchestra.run.smithi101.stdout: { 2023-08-01T19:54:46.724 INFO:teuthology.orchestra.run.smithi101.stdout: "event": "waiting for subops from 0", 2023-08-01T19:54:46.724 INFO:teuthology.orchestra.run.smithi101.stdout: "time": "2023-08-01T19:54:04.469895+0000", 2023-08-01T19:54:46.724 INFO:teuthology.orchestra.run.smithi101.stdout: "duration": 0.000336604 2023-08-01T19:54:46.724 INFO:teuthology.orchestra.run.smithi101.stdout: }, 2023-08-01T19:54:46.724 INFO:teuthology.orchestra.run.smithi101.stdout: { 2023-08-01T19:54:46.725 INFO:teuthology.orchestra.run.smithi101.stdout: "event": "sub_op_commit_rec", 2023-08-01T19:54:46.725 INFO:teuthology.orchestra.run.smithi101.stdout: "time": "2023-08-01T19:54:04.475096+0000", 2023-08-01T19:54:46.725 INFO:teuthology.orchestra.run.smithi101.stdout: "duration": 0.0052010540000000001 2023-08-01T19:54:46.725 INFO:teuthology.orchestra.run.smithi101.stdout: }, 2023-08-01T19:54:46.725 INFO:teuthology.orchestra.run.smithi101.stdout: { 2023-08-01T19:54:46.725 INFO:teuthology.orchestra.run.smithi101.stdout: "event": "op_commit", 2023-08-01T19:54:46.725 INFO:teuthology.orchestra.run.smithi101.stdout: "time": "2023-08-01T19:54:04.475965+0000", 2023-08-01T19:54:46.725 INFO:teuthology.orchestra.run.smithi101.stdout: "duration": 0.00086860500000000005 2023-08-01T19:54:46.726 INFO:teuthology.orchestra.run.smithi101.stdout: }, 2023-08-01T19:54:46.726 INFO:teuthology.orchestra.run.smithi101.stdout: { 2023-08-01T19:54:46.726 INFO:teuthology.orchestra.run.smithi101.stdout: "event": "commit_sent", 2023-08-01T19:54:46.726 INFO:teuthology.orchestra.run.smithi101.stdout: "time": "2023-08-01T19:54:04.476007+0000", 2023-08-01T19:54:46.726 INFO:teuthology.orchestra.run.smithi101.stdout: "duration": 4.2228000000000003e-05 2023-08-01T19:54:46.726 INFO:teuthology.orchestra.run.smithi101.stdout: }, 2023-08-01T19:54:46.726 INFO:teuthology.orchestra.run.smithi101.stdout: { 2023-08-01T19:54:46.726 INFO:teuthology.orchestra.run.smithi101.stdout: "event": "done", 2023-08-01T19:54:46.727 INFO:teuthology.orchestra.run.smithi101.stdout: "time": "2023-08-01T19:54:04.476052+0000", 2023-08-01T19:54:46.727 INFO:teuthology.orchestra.run.smithi101.stdout: "duration": 4.5188000000000002e-05 2023-08-01T19:54:46.727 INFO:teuthology.orchestra.run.smithi101.stdout: } 2023-08-01T19:54:46.727 INFO:teuthology.orchestra.run.smithi101.stdout: ] 2023-08-01T19:54:46.727 INFO:teuthology.orchestra.run.smithi101.stdout: } 2023-08-01T19:54:46.727 INFO:teuthology.orchestra.run.smithi101.stdout: }, 2023-08-01T19:54:46.727 INFO:teuthology.orchestra.run.smithi101.stdout: { 2023-08-01T19:54:46.727 INFO:teuthology.orchestra.run.smithi101.stdout: "description": "osd_op(mds.0.3:31 3.d 3:b50e409b:::mds_snaptable:head [writefull 0~70] snapc 0=[] ondisk+write+known_if_redirected+full_force+supports_pool_eio e17)", 2023-08-01T19:54:46.728 INFO:teuthology.orchestra.run.smithi101.stdout: "initiated_at": "2023-08-01T19:54:04.459283+0000", 2023-08-01T19:54:46.728 INFO:teuthology.orchestra.run.smithi101.stdout: "age": 42.089793657999998, 2023-08-01T19:54:46.728 INFO:teuthology.orchestra.run.smithi101.stdout: "duration": 0.01676277, 2023-08-01T19:54:46.728 INFO:teuthology.orchestra.run.smithi101.stdout: "type_data": { 2023-08-01T19:54:46.728 INFO:teuthology.orchestra.run.smithi101.stdout: "flag_point": "commit sent; apply or cleanup", 2023-08-01T19:54:46.728 INFO:teuthology.orchestra.run.smithi101.stdout: "events": [ 2023-08-01T19:54:46.728 INFO:teuthology.orchestra.run.smithi101.stdout: { 2023-08-01T19:54:46.728 INFO:teuthology.orchestra.run.smithi101.stdout: "event": "initiated", 2023-08-01T19:54:46.729 INFO:teuthology.orchestra.run.smithi101.stdout: "time": "2023-08-01T19:54:04.459283+0000", 2023-08-01T19:54:46.729 INFO:teuthology.orchestra.run.smithi101.stdout: "duration": 0 2023-08-01T19:54:46.729 INFO:teuthology.orchestra.run.smithi101.stdout: }, 2023-08-01T19:54:46.729 INFO:teuthology.orchestra.run.smithi101.stdout: { 2023-08-01T19:54:46.729 INFO:teuthology.orchestra.run.smithi101.stdout: "event": "throttled", 2023-08-01T19:54:46.729 INFO:teuthology.orchestra.run.smithi101.stdout: "time": "2023-08-01T19:54:04.459283+0000", 2023-08-01T19:54:46.729 INFO:teuthology.orchestra.run.smithi101.stdout: "duration": 0 2023-08-01T19:54:46.730 INFO:teuthology.orchestra.run.smithi101.stdout: }, 2023-08-01T19:54:46.730 INFO:teuthology.orchestra.run.smithi101.stdout: { 2023-08-01T19:54:46.730 INFO:teuthology.orchestra.run.smithi101.stdout: "event": "header_read", 2023-08-01T19:54:46.730 INFO:teuthology.orchestra.run.smithi101.stdout: "time": "2023-08-01T19:54:04.459282+0000", 2023-08-01T19:54:46.730 INFO:teuthology.orchestra.run.smithi101.stdout: "duration": 4294967295.9999995 2023-08-01T19:54:46.730 INFO:teuthology.orchestra.run.smithi101.stdout: }, 2023-08-01T19:54:46.730 INFO:teuthology.orchestra.run.smithi101.stdout: { 2023-08-01T19:54:46.730 INFO:teuthology.orchestra.run.smithi101.stdout: "event": "all_read", 2023-08-01T19:54:46.731 INFO:teuthology.orchestra.run.smithi101.stdout: "time": "2023-08-01T19:54:04.459285+0000", 2023-08-01T19:54:46.731 INFO:teuthology.orchestra.run.smithi101.stdout: "duration": 3.2590000000000001e-06 2023-08-01T19:54:46.731 INFO:teuthology.orchestra.run.smithi101.stdout: }, 2023-08-01T19:54:46.731 INFO:teuthology.orchestra.run.smithi101.stdout: { 2023-08-01T19:54:46.731 INFO:teuthology.orchestra.run.smithi101.stdout: "event": "dispatched", 2023-08-01T19:54:46.731 INFO:teuthology.orchestra.run.smithi101.stdout: "time": "2023-08-01T19:54:04.459291+0000", 2023-08-01T19:54:46.731 INFO:teuthology.orchestra.run.smithi101.stdout: "duration": 6.0750000000000003e-06 2023-08-01T19:54:46.731 INFO:teuthology.orchestra.run.smithi101.stdout: }, 2023-08-01T19:54:46.732 INFO:teuthology.orchestra.run.smithi101.stdout: { 2023-08-01T19:54:46.732 INFO:teuthology.orchestra.run.smithi101.stdout: "event": "queued_for_pg", 2023-08-01T19:54:46.732 INFO:teuthology.orchestra.run.smithi101.stdout: "time": "2023-08-01T19:54:04.459295+0000", 2023-08-01T19:54:46.732 INFO:teuthology.orchestra.run.smithi101.stdout: "duration": 3.7500000000000001e-06 2023-08-01T19:54:46.732 INFO:teuthology.orchestra.run.smithi101.stdout: }, 2023-08-01T19:54:46.732 INFO:teuthology.orchestra.run.smithi101.stdout: { 2023-08-01T19:54:46.732 INFO:teuthology.orchestra.run.smithi101.stdout: "event": "reached_pg", 2023-08-01T19:54:46.732 INFO:teuthology.orchestra.run.smithi101.stdout: "time": "2023-08-01T19:54:04.459323+0000", 2023-08-01T19:54:46.733 INFO:teuthology.orchestra.run.smithi101.stdout: "duration": 2.7351e-05 2023-08-01T19:54:46.733 INFO:teuthology.orchestra.run.smithi101.stdout: }, 2023-08-01T19:54:46.733 INFO:teuthology.orchestra.run.smithi101.stdout: { 2023-08-01T19:54:46.733 INFO:teuthology.orchestra.run.smithi101.stdout: "event": "op must wait for map", 2023-08-01T19:54:46.733 INFO:teuthology.orchestra.run.smithi101.stdout: "time": "2023-08-01T19:54:04.459327+0000", 2023-08-01T19:54:46.733 INFO:teuthology.orchestra.run.smithi101.stdout: "duration": 4.1849999999999997e-06 2023-08-01T19:54:46.733 INFO:teuthology.orchestra.run.smithi101.stdout: }, 2023-08-01T19:54:46.733 INFO:teuthology.orchestra.run.smithi101.stdout: { 2023-08-01T19:54:46.734 INFO:teuthology.orchestra.run.smithi101.stdout: "event": "reached_pg", 2023-08-01T19:54:46.734 INFO:teuthology.orchestra.run.smithi101.stdout: "time": "2023-08-01T19:54:04.468708+0000", 2023-08-01T19:54:46.734 INFO:teuthology.orchestra.run.smithi101.stdout: "duration": 0.0093817420000000002 2023-08-01T19:54:46.734 INFO:teuthology.orchestra.run.smithi101.stdout: }, 2023-08-01T19:54:46.734 INFO:teuthology.orchestra.run.smithi101.stdout: { 2023-08-01T19:54:46.734 INFO:teuthology.orchestra.run.smithi101.stdout: "event": "started", 2023-08-01T19:54:46.734 INFO:teuthology.orchestra.run.smithi101.stdout: "time": "2023-08-01T19:54:04.468830+0000", 2023-08-01T19:54:46.734 INFO:teuthology.orchestra.run.smithi101.stdout: "duration": 0.000121339 2023-08-01T19:54:46.735 INFO:teuthology.orchestra.run.smithi101.stdout: }, 2023-08-01T19:54:46.735 INFO:teuthology.orchestra.run.smithi101.stdout: { 2023-08-01T19:54:46.735 INFO:teuthology.orchestra.run.smithi101.stdout: "event": "waiting for subops from 2", 2023-08-01T19:54:46.735 INFO:teuthology.orchestra.run.smithi101.stdout: "time": "2023-08-01T19:54:04.469611+0000", 2023-08-01T19:54:46.735 INFO:teuthology.orchestra.run.smithi101.stdout: "duration": 0.00078162900000000005 2023-08-01T19:54:46.735 INFO:teuthology.orchestra.run.smithi101.stdout: }, 2023-08-01T19:54:46.735 INFO:teuthology.orchestra.run.smithi101.stdout: { 2023-08-01T19:54:46.735 INFO:teuthology.orchestra.run.smithi101.stdout: "event": "sub_op_commit_rec", 2023-08-01T19:54:46.736 INFO:teuthology.orchestra.run.smithi101.stdout: "time": "2023-08-01T19:54:04.475478+0000", 2023-08-01T19:54:46.736 INFO:teuthology.orchestra.run.smithi101.stdout: "duration": 0.005866586 2023-08-01T19:54:46.736 INFO:teuthology.orchestra.run.smithi101.stdout: }, 2023-08-01T19:54:46.736 INFO:teuthology.orchestra.run.smithi101.stdout: { 2023-08-01T19:54:46.736 INFO:teuthology.orchestra.run.smithi101.stdout: "event": "op_commit", 2023-08-01T19:54:46.736 INFO:teuthology.orchestra.run.smithi101.stdout: "time": "2023-08-01T19:54:04.475941+0000", 2023-08-01T19:54:46.736 INFO:teuthology.orchestra.run.smithi101.stdout: "duration": 0.000462526 2023-08-01T19:54:46.737 INFO:teuthology.orchestra.run.smithi101.stdout: }, 2023-08-01T19:54:46.737 INFO:teuthology.orchestra.run.smithi101.stdout: { 2023-08-01T19:54:46.737 INFO:teuthology.orchestra.run.smithi101.stdout: "event": "commit_sent", 2023-08-01T19:54:46.737 INFO:teuthology.orchestra.run.smithi101.stdout: "time": "2023-08-01T19:54:04.475995+0000", 2023-08-01T19:54:46.737 INFO:teuthology.orchestra.run.smithi101.stdout: "duration": 5.4401000000000003e-05 2023-08-01T19:54:46.737 INFO:teuthology.orchestra.run.smithi101.stdout: }, 2023-08-01T19:54:46.737 INFO:teuthology.orchestra.run.smithi101.stdout: { 2023-08-01T19:54:46.737 INFO:teuthology.orchestra.run.smithi101.stdout: "event": "done", 2023-08-01T19:54:46.738 INFO:teuthology.orchestra.run.smithi101.stdout: "time": "2023-08-01T19:54:04.476045+0000", 2023-08-01T19:54:46.738 INFO:teuthology.orchestra.run.smithi101.stdout: "duration": 5.0389000000000002e-05 2023-08-01T19:54:46.738 INFO:teuthology.orchestra.run.smithi101.stdout: } 2023-08-01T19:54:46.738 INFO:teuthology.orchestra.run.smithi101.stdout: ] 2023-08-01T19:54:46.738 INFO:teuthology.orchestra.run.smithi101.stdout: } 2023-08-01T19:54:46.738 INFO:teuthology.orchestra.run.smithi101.stdout: }, 2023-08-01T19:54:46.738 INFO:teuthology.orchestra.run.smithi101.stdout: { 2023-08-01T19:54:46.738 INFO:teuthology.orchestra.run.smithi101.stdout: "description": "osd_op(mds.0.3:32 3.14 3:2e2fa760:::200.00000001:head [delete] snapc 0=[] ondisk+write+known_if_redirected+full_force+supports_pool_eio e17)", 2023-08-01T19:54:46.739 INFO:teuthology.orchestra.run.smithi101.stdout: "initiated_at": "2023-08-01T19:54:04.459304+0000", 2023-08-01T19:54:46.739 INFO:teuthology.orchestra.run.smithi101.stdout: "age": 42.089771825, 2023-08-01T19:54:46.739 INFO:teuthology.orchestra.run.smithi101.stdout: "duration": 0.021110606000000001, 2023-08-01T19:54:46.739 INFO:teuthology.orchestra.run.smithi101.stdout: "type_data": { 2023-08-01T19:54:46.739 INFO:teuthology.orchestra.run.smithi101.stdout: "flag_point": "started", 2023-08-01T19:54:46.739 INFO:teuthology.orchestra.run.smithi101.stdout: "events": [ 2023-08-01T19:54:46.739 INFO:teuthology.orchestra.run.smithi101.stdout: { 2023-08-01T19:54:46.739 INFO:teuthology.orchestra.run.smithi101.stdout: "event": "initiated", 2023-08-01T19:54:46.740 INFO:teuthology.orchestra.run.smithi101.stdout: "time": "2023-08-01T19:54:04.459304+0000", 2023-08-01T19:54:46.740 INFO:teuthology.orchestra.run.smithi101.stdout: "duration": 0 2023-08-01T19:54:46.740 INFO:teuthology.orchestra.run.smithi101.stdout: }, 2023-08-01T19:54:46.740 INFO:teuthology.orchestra.run.smithi101.stdout: { 2023-08-01T19:54:46.740 INFO:teuthology.orchestra.run.smithi101.stdout: "event": "throttled", 2023-08-01T19:54:46.740 INFO:teuthology.orchestra.run.smithi101.stdout: "time": "2023-08-01T19:54:04.459304+0000", 2023-08-01T19:54:46.740 INFO:teuthology.orchestra.run.smithi101.stdout: "duration": 0 2023-08-01T19:54:46.740 INFO:teuthology.orchestra.run.smithi101.stdout: }, 2023-08-01T19:54:46.741 INFO:teuthology.orchestra.run.smithi101.stdout: { 2023-08-01T19:54:46.741 INFO:teuthology.orchestra.run.smithi101.stdout: "event": "header_read", 2023-08-01T19:54:46.741 INFO:teuthology.orchestra.run.smithi101.stdout: "time": "2023-08-01T19:54:04.459304+0000", 2023-08-01T19:54:46.741 INFO:teuthology.orchestra.run.smithi101.stdout: "duration": 4294967295.9999995 2023-08-01T19:54:46.741 INFO:teuthology.orchestra.run.smithi101.stdout: }, 2023-08-01T19:54:46.741 INFO:teuthology.orchestra.run.smithi101.stdout: { 2023-08-01T19:54:46.741 INFO:teuthology.orchestra.run.smithi101.stdout: "event": "all_read", 2023-08-01T19:54:46.741 INFO:teuthology.orchestra.run.smithi101.stdout: "time": "2023-08-01T19:54:04.459306+0000", 2023-08-01T19:54:46.742 INFO:teuthology.orchestra.run.smithi101.stdout: "duration": 2.3889999999999999e-06 2023-08-01T19:54:46.742 INFO:teuthology.orchestra.run.smithi101.stdout: }, 2023-08-01T19:54:46.742 INFO:teuthology.orchestra.run.smithi101.stdout: { 2023-08-01T19:54:46.742 INFO:teuthology.orchestra.run.smithi101.stdout: "event": "dispatched", 2023-08-01T19:54:46.742 INFO:teuthology.orchestra.run.smithi101.stdout: "time": "2023-08-01T19:54:04.459314+0000", 2023-08-01T19:54:46.742 INFO:teuthology.orchestra.run.smithi101.stdout: "duration": 7.1180000000000003e-06 2023-08-01T19:54:46.742 INFO:teuthology.orchestra.run.smithi101.stdout: }, 2023-08-01T19:54:46.742 INFO:teuthology.orchestra.run.smithi101.stdout: { 2023-08-01T19:54:46.743 INFO:teuthology.orchestra.run.smithi101.stdout: "event": "queued_for_pg", 2023-08-01T19:54:46.743 INFO:teuthology.orchestra.run.smithi101.stdout: "time": "2023-08-01T19:54:04.459318+0000", 2023-08-01T19:54:46.743 INFO:teuthology.orchestra.run.smithi101.stdout: "duration": 4.0239999999999999e-06 2023-08-01T19:54:46.743 INFO:teuthology.orchestra.run.smithi101.stdout: }, 2023-08-01T19:54:46.743 INFO:teuthology.orchestra.run.smithi101.stdout: { 2023-08-01T19:54:46.743 INFO:teuthology.orchestra.run.smithi101.stdout: "event": "reached_pg", 2023-08-01T19:54:46.743 INFO:teuthology.orchestra.run.smithi101.stdout: "time": "2023-08-01T19:54:04.459340+0000", 2023-08-01T19:54:46.743 INFO:teuthology.orchestra.run.smithi101.stdout: "duration": 2.2476e-05 2023-08-01T19:54:46.744 INFO:teuthology.orchestra.run.smithi101.stdout: }, 2023-08-01T19:54:46.744 INFO:teuthology.orchestra.run.smithi101.stdout: { 2023-08-01T19:54:46.744 INFO:teuthology.orchestra.run.smithi101.stdout: "event": "waiting_for_map not empty", 2023-08-01T19:54:46.744 INFO:teuthology.orchestra.run.smithi101.stdout: "time": "2023-08-01T19:54:04.459342+0000", 2023-08-01T19:54:46.744 INFO:teuthology.orchestra.run.smithi101.stdout: "duration": 2.272e-06 2023-08-01T19:54:46.744 INFO:teuthology.orchestra.run.smithi101.stdout: }, 2023-08-01T19:54:46.744 INFO:teuthology.orchestra.run.smithi101.stdout: { 2023-08-01T19:54:46.744 INFO:teuthology.orchestra.run.smithi101.stdout: "event": "reached_pg", 2023-08-01T19:54:46.745 INFO:teuthology.orchestra.run.smithi101.stdout: "time": "2023-08-01T19:54:04.475922+0000", 2023-08-01T19:54:46.745 INFO:teuthology.orchestra.run.smithi101.stdout: "duration": 0.016579388 2023-08-01T19:54:46.745 INFO:teuthology.orchestra.run.smithi101.stdout: }, 2023-08-01T19:54:46.745 INFO:teuthology.orchestra.run.smithi101.stdout: { 2023-08-01T19:54:46.745 INFO:teuthology.orchestra.run.smithi101.stdout: "event": "started", 2023-08-01T19:54:46.745 INFO:teuthology.orchestra.run.smithi101.stdout: "time": "2023-08-01T19:54:04.476107+0000", 2023-08-01T19:54:46.745 INFO:teuthology.orchestra.run.smithi101.stdout: "duration": 0.00018486300000000001 2023-08-01T19:54:46.746 INFO:teuthology.orchestra.run.smithi101.stdout: }, 2023-08-01T19:54:46.746 INFO:teuthology.orchestra.run.smithi101.stdout: { 2023-08-01T19:54:46.746 INFO:teuthology.orchestra.run.smithi101.stdout: "event": "done", 2023-08-01T19:54:46.746 INFO:teuthology.orchestra.run.smithi101.stdout: "time": "2023-08-01T19:54:04.480415+0000", 2023-08-01T19:54:46.746 INFO:teuthology.orchestra.run.smithi101.stdout: "duration": 0.0043084589999999997 2023-08-01T19:54:46.746 INFO:teuthology.orchestra.run.smithi101.stdout: } 2023-08-01T19:54:46.746 INFO:teuthology.orchestra.run.smithi101.stdout: ] 2023-08-01T19:54:46.746 INFO:teuthology.orchestra.run.smithi101.stdout: } 2023-08-01T19:54:46.747 INFO:teuthology.orchestra.run.smithi101.stdout: }, 2023-08-01T19:54:46.747 INFO:teuthology.orchestra.run.smithi101.stdout: { 2023-08-01T19:54:46.747 INFO:teuthology.orchestra.run.smithi101.stdout: "description": "osd_op(client.4668.0:62896 5.f 5:f59d90d6:::benchmark_data_smithi006_114134_object62895:head [set-alloc-hint object_size 65536 write_size 65536,write 0~65536] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e29)", 2023-08-01T19:54:46.747 INFO:teuthology.orchestra.run.smithi101.stdout: "initiated_at": "2023-08-01T19:54:46.254123+0000", 2023-08-01T19:54:46.747 INFO:teuthology.orchestra.run.smithi101.stdout: "age": 0.29495293099999997, 2023-08-01T19:54:46.747 INFO:teuthology.orchestra.run.smithi101.stdout: "duration": 0.018097106000000002, 2023-08-01T19:54:46.747 INFO:teuthology.orchestra.run.smithi101.stdout: "type_data": { 2023-08-01T19:54:46.748 INFO:teuthology.orchestra.run.smithi101.stdout: "flag_point": "commit sent; apply or cleanup", 2023-08-01T19:54:46.748 INFO:teuthology.orchestra.run.smithi101.stdout: "client_info": { 2023-08-01T19:54:46.748 INFO:teuthology.orchestra.run.smithi101.stdout: "client": "client.4668", 2023-08-01T19:54:46.748 INFO:teuthology.orchestra.run.smithi101.stdout: "client_addr": "172.21.15.6:0/1709472247", 2023-08-01T19:54:46.748 INFO:teuthology.orchestra.run.smithi101.stdout: "tid": 62896 2023-08-01T19:54:46.748 INFO:teuthology.orchestra.run.smithi101.stdout: }, 2023-08-01T19:54:46.748 INFO:teuthology.orchestra.run.smithi101.stdout: "events": [ 2023-08-01T19:54:46.748 INFO:teuthology.orchestra.run.smithi101.stdout: { 2023-08-01T19:54:46.749 INFO:teuthology.orchestra.run.smithi101.stdout: "event": "initiated", 2023-08-01T19:54:46.749 INFO:teuthology.orchestra.run.smithi101.stdout: "time": "2023-08-01T19:54:46.254123+0000", 2023-08-01T19:54:46.749 INFO:teuthology.orchestra.run.smithi101.stdout: "duration": 0 2023-08-01T19:54:46.749 INFO:teuthology.orchestra.run.smithi101.stdout: }, 2023-08-01T19:54:46.749 INFO:teuthology.orchestra.run.smithi101.stdout: { 2023-08-01T19:54:46.749 INFO:teuthology.orchestra.run.smithi101.stdout: "event": "throttled", 2023-08-01T19:54:46.749 INFO:teuthology.orchestra.run.smithi101.stdout: "time": "2023-08-01T19:54:46.254123+0000", 2023-08-01T19:54:46.749 INFO:teuthology.orchestra.run.smithi101.stdout: "duration": 0 2023-08-01T19:54:46.750 INFO:teuthology.orchestra.run.smithi101.stdout: }, 2023-08-01T19:54:46.750 INFO:teuthology.orchestra.run.smithi101.stdout: { 2023-08-01T19:54:46.750 INFO:teuthology.orchestra.run.smithi101.stdout: "event": "header_read", 2023-08-01T19:54:46.750 INFO:teuthology.orchestra.run.smithi101.stdout: "time": "2023-08-01T19:54:46.254122+0000", 2023-08-01T19:54:46.750 INFO:teuthology.orchestra.run.smithi101.stdout: "duration": 4294967295.999999 2023-08-01T19:54:46.750 INFO:teuthology.orchestra.run.smithi101.stdout: }, 2023-08-01T19:54:46.750 INFO:teuthology.orchestra.run.smithi101.stdout: { 2023-08-01T19:54:46.750 INFO:teuthology.orchestra.run.smithi101.stdout: "event": "all_read", 2023-08-01T19:54:46.751 INFO:teuthology.orchestra.run.smithi101.stdout: "time": "2023-08-01T19:54:46.254214+0000", 2023-08-01T19:54:46.751 INFO:teuthology.orchestra.run.smithi101.stdout: "duration": 9.1421000000000004e-05 2023-08-01T19:54:46.751 INFO:teuthology.orchestra.run.smithi101.stdout: }, 2023-08-01T19:54:46.751 INFO:teuthology.orchestra.run.smithi101.stdout: { 2023-08-01T19:54:46.751 INFO:teuthology.orchestra.run.smithi101.stdout: "event": "dispatched", 2023-08-01T19:54:46.751 INFO:teuthology.orchestra.run.smithi101.stdout: "time": "2023-08-01T19:54:46.254222+0000", 2023-08-01T19:54:46.751 INFO:teuthology.orchestra.run.smithi101.stdout: "duration": 8.6100000000000006e-06 2023-08-01T19:54:46.751 INFO:teuthology.orchestra.run.smithi101.stdout: }, 2023-08-01T19:54:46.752 INFO:teuthology.orchestra.run.smithi101.stdout: { 2023-08-01T19:54:46.752 INFO:teuthology.orchestra.run.smithi101.stdout: "event": "queued_for_pg", 2023-08-01T19:54:46.752 INFO:teuthology.orchestra.run.smithi101.stdout: "time": "2023-08-01T19:54:46.254228+0000", 2023-08-01T19:54:46.752 INFO:teuthology.orchestra.run.smithi101.stdout: "duration": 5.5840000000000002e-06 2023-08-01T19:54:46.752 INFO:teuthology.orchestra.run.smithi101.stdout: }, 2023-08-01T19:54:46.752 INFO:teuthology.orchestra.run.smithi101.stdout: { 2023-08-01T19:54:46.752 INFO:teuthology.orchestra.run.smithi101.stdout: "event": "reached_pg", 2023-08-01T19:54:46.753 INFO:teuthology.orchestra.run.smithi101.stdout: "time": "2023-08-01T19:54:46.254259+0000", 2023-08-01T19:54:46.753 INFO:teuthology.orchestra.run.smithi101.stdout: "duration": 3.0580999999999997e-05 2023-08-01T19:54:46.753 INFO:teuthology.orchestra.run.smithi101.stdout: }, 2023-08-01T19:54:46.753 INFO:teuthology.orchestra.run.smithi101.stdout: { 2023-08-01T19:54:46.753 INFO:teuthology.orchestra.run.smithi101.stdout: "event": "started", 2023-08-01T19:54:46.753 INFO:teuthology.orchestra.run.smithi101.stdout: "time": "2023-08-01T19:54:46.254342+0000", 2023-08-01T19:54:46.753 INFO:teuthology.orchestra.run.smithi101.stdout: "duration": 8.3183999999999995e-05 2023-08-01T19:54:46.753 INFO:teuthology.orchestra.run.smithi101.stdout: }, 2023-08-01T19:54:46.754 INFO:teuthology.orchestra.run.smithi101.stdout: { 2023-08-01T19:54:46.754 INFO:teuthology.orchestra.run.smithi101.stdout: "event": "waiting for subops from 2", 2023-08-01T19:54:46.754 INFO:teuthology.orchestra.run.smithi101.stdout: "time": "2023-08-01T19:54:46.254422+0000", 2023-08-01T19:54:46.754 INFO:teuthology.orchestra.run.smithi101.stdout: "duration": 7.9703000000000006e-05 2023-08-01T19:54:46.754 INFO:teuthology.orchestra.run.smithi101.stdout: }, 2023-08-01T19:54:46.754 INFO:teuthology.orchestra.run.smithi101.stdout: { 2023-08-01T19:54:46.754 INFO:teuthology.orchestra.run.smithi101.stdout: "event": "sub_op_commit_rec", 2023-08-01T19:54:46.754 INFO:teuthology.orchestra.run.smithi101.stdout: "time": "2023-08-01T19:54:46.259940+0000", 2023-08-01T19:54:46.755 INFO:teuthology.orchestra.run.smithi101.stdout: "duration": 0.0055188650000000004 2023-08-01T19:54:46.755 INFO:teuthology.orchestra.run.smithi101.stdout: }, 2023-08-01T19:54:46.755 INFO:teuthology.orchestra.run.smithi101.stdout: { 2023-08-01T19:54:46.755 INFO:teuthology.orchestra.run.smithi101.stdout: "event": "op_commit", 2023-08-01T19:54:46.755 INFO:teuthology.orchestra.run.smithi101.stdout: "time": "2023-08-01T19:54:46.272127+0000", 2023-08-01T19:54:46.755 INFO:teuthology.orchestra.run.smithi101.stdout: "duration": 0.012186463 2023-08-01T19:54:46.755 INFO:teuthology.orchestra.run.smithi101.stdout: }, 2023-08-01T19:54:46.755 INFO:teuthology.orchestra.run.smithi101.stdout: { 2023-08-01T19:54:46.756 INFO:teuthology.orchestra.run.smithi101.stdout: "event": "commit_sent", 2023-08-01T19:54:46.756 INFO:teuthology.orchestra.run.smithi101.stdout: "time": "2023-08-01T19:54:46.272178+0000", 2023-08-01T19:54:46.756 INFO:teuthology.orchestra.run.smithi101.stdout: "duration": 5.1332000000000003e-05 2023-08-01T19:54:46.756 INFO:teuthology.orchestra.run.smithi101.stdout: }, 2023-08-01T19:54:46.756 INFO:teuthology.orchestra.run.smithi101.stdout: { 2023-08-01T19:54:46.756 INFO:teuthology.orchestra.run.smithi101.stdout: "event": "done", 2023-08-01T19:54:46.756 INFO:teuthology.orchestra.run.smithi101.stdout: "time": "2023-08-01T19:54:46.272220+0000", 2023-08-01T19:54:46.756 INFO:teuthology.orchestra.run.smithi101.stdout: "duration": 4.2227000000000001e-05 2023-08-01T19:54:46.757 INFO:teuthology.orchestra.run.smithi101.stdout: } 2023-08-01T19:54:46.757 INFO:teuthology.orchestra.run.smithi101.stdout: ] 2023-08-01T19:54:46.757 INFO:teuthology.orchestra.run.smithi101.stdout: } 2023-08-01T19:54:46.757 INFO:teuthology.orchestra.run.smithi101.stdout: }, 2023-08-01T19:54:46.757 INFO:teuthology.orchestra.run.smithi101.stdout: { 2023-08-01T19:54:46.757 INFO:teuthology.orchestra.run.smithi101.stdout: "description": "osd_op(client.4668.0:62898 5.f 5:fa45093a:::benchmark_data_smithi006_114134_object62897:head [set-alloc-hint object_size 65536 write_size 65536,write 0~65536] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e29)", 2023-08-01T19:54:46.757 INFO:teuthology.orchestra.run.smithi101.stdout: "initiated_at": "2023-08-01T19:54:46.254356+0000", 2023-08-01T19:54:46.757 INFO:teuthology.orchestra.run.smithi101.stdout: "age": 0.29472010599999998, 2023-08-01T19:54:46.758 INFO:teuthology.orchestra.run.smithi101.stdout: "duration": 0.017950870000000001, 2023-08-01T19:54:46.758 INFO:teuthology.orchestra.run.smithi101.stdout: "type_data": { 2023-08-01T19:54:46.758 INFO:teuthology.orchestra.run.smithi101.stdout: "flag_point": "commit sent; apply or cleanup", 2023-08-01T19:54:46.758 INFO:teuthology.orchestra.run.smithi101.stdout: "client_info": { 2023-08-01T19:54:46.758 INFO:teuthology.orchestra.run.smithi101.stdout: "client": "client.4668", 2023-08-01T19:54:46.758 INFO:teuthology.orchestra.run.smithi101.stdout: "client_addr": "172.21.15.6:0/1709472247", 2023-08-01T19:54:46.758 INFO:teuthology.orchestra.run.smithi101.stdout: "tid": 62898 2023-08-01T19:54:46.758 INFO:teuthology.orchestra.run.smithi101.stdout: }, 2023-08-01T19:54:46.759 INFO:teuthology.orchestra.run.smithi101.stdout: "events": [ 2023-08-01T19:54:46.759 INFO:teuthology.orchestra.run.smithi101.stdout: { 2023-08-01T19:54:46.759 INFO:teuthology.orchestra.run.smithi101.stdout: "event": "initiated", 2023-08-01T19:54:46.759 INFO:teuthology.orchestra.run.smithi101.stdout: "time": "2023-08-01T19:54:46.254356+0000", 2023-08-01T19:54:46.759 INFO:teuthology.orchestra.run.smithi101.stdout: "duration": 0 2023-08-01T19:54:46.759 INFO:teuthology.orchestra.run.smithi101.stdout: }, 2023-08-01T19:54:46.759 INFO:teuthology.orchestra.run.smithi101.stdout: { 2023-08-01T19:54:46.759 INFO:teuthology.orchestra.run.smithi101.stdout: "event": "throttled", 2023-08-01T19:54:46.760 INFO:teuthology.orchestra.run.smithi101.stdout: "time": "2023-08-01T19:54:46.254356+0000", 2023-08-01T19:54:46.760 INFO:teuthology.orchestra.run.smithi101.stdout: "duration": 0 2023-08-01T19:54:46.760 INFO:teuthology.orchestra.run.smithi101.stdout: }, 2023-08-01T19:54:46.760 INFO:teuthology.orchestra.run.smithi101.stdout: { 2023-08-01T19:54:46.760 INFO:teuthology.orchestra.run.smithi101.stdout: "event": "header_read", 2023-08-01T19:54:46.760 INFO:teuthology.orchestra.run.smithi101.stdout: "time": "2023-08-01T19:54:46.254355+0000", 2023-08-01T19:54:46.760 INFO:teuthology.orchestra.run.smithi101.stdout: "duration": 4294967295.9999995 2023-08-01T19:54:46.760 INFO:teuthology.orchestra.run.smithi101.stdout: }, 2023-08-01T19:54:46.761 INFO:teuthology.orchestra.run.smithi101.stdout: { 2023-08-01T19:54:46.761 INFO:teuthology.orchestra.run.smithi101.stdout: "event": "all_read", 2023-08-01T19:54:46.761 INFO:teuthology.orchestra.run.smithi101.stdout: "time": "2023-08-01T19:54:46.254415+0000", 2023-08-01T19:54:46.761 INFO:teuthology.orchestra.run.smithi101.stdout: "duration": 5.9713999999999998e-05 2023-08-01T19:54:46.761 INFO:teuthology.orchestra.run.smithi101.stdout: }, 2023-08-01T19:54:46.761 INFO:teuthology.orchestra.run.smithi101.stdout: { 2023-08-01T19:54:46.761 INFO:teuthology.orchestra.run.smithi101.stdout: "event": "dispatched", 2023-08-01T19:54:46.761 INFO:teuthology.orchestra.run.smithi101.stdout: "time": "2023-08-01T19:54:46.254423+0000", 2023-08-01T19:54:46.762 INFO:teuthology.orchestra.run.smithi101.stdout: "duration": 7.8399999999999995e-06 2023-08-01T19:54:46.762 INFO:teuthology.orchestra.run.smithi101.stdout: }, 2023-08-01T19:54:46.762 INFO:teuthology.orchestra.run.smithi101.stdout: { 2023-08-01T19:54:46.762 INFO:teuthology.orchestra.run.smithi101.stdout: "event": "queued_for_pg", 2023-08-01T19:54:46.762 INFO:teuthology.orchestra.run.smithi101.stdout: "time": "2023-08-01T19:54:46.254428+0000", 2023-08-01T19:54:46.762 INFO:teuthology.orchestra.run.smithi101.stdout: "duration": 4.5040000000000004e-06 2023-08-01T19:54:46.762 INFO:teuthology.orchestra.run.smithi101.stdout: }, 2023-08-01T19:54:46.762 INFO:teuthology.orchestra.run.smithi101.stdout: { 2023-08-01T19:54:46.763 INFO:teuthology.orchestra.run.smithi101.stdout: "event": "reached_pg", 2023-08-01T19:54:46.763 INFO:teuthology.orchestra.run.smithi101.stdout: "time": "2023-08-01T19:54:46.255926+0000", 2023-08-01T19:54:46.763 INFO:teuthology.orchestra.run.smithi101.stdout: "duration": 0.001498741 2023-08-01T19:54:46.763 INFO:teuthology.orchestra.run.smithi101.stdout: }, 2023-08-01T19:54:46.763 INFO:teuthology.orchestra.run.smithi101.stdout: { 2023-08-01T19:54:46.763 INFO:teuthology.orchestra.run.smithi101.stdout: "event": "started", 2023-08-01T19:54:46.763 INFO:teuthology.orchestra.run.smithi101.stdout: "time": "2023-08-01T19:54:46.256006+0000", 2023-08-01T19:54:46.763 INFO:teuthology.orchestra.run.smithi101.stdout: "duration": 8.0185000000000006e-05 2023-08-01T19:54:46.764 INFO:teuthology.orchestra.run.smithi101.stdout: }, 2023-08-01T19:54:46.764 INFO:teuthology.orchestra.run.smithi101.stdout: { 2023-08-01T19:54:46.764 INFO:teuthology.orchestra.run.smithi101.stdout: "event": "waiting for subops from 2", 2023-08-01T19:54:46.764 INFO:teuthology.orchestra.run.smithi101.stdout: "time": "2023-08-01T19:54:46.256158+0000", 2023-08-01T19:54:46.764 INFO:teuthology.orchestra.run.smithi101.stdout: "duration": 0.00015124 2023-08-01T19:54:46.764 INFO:teuthology.orchestra.run.smithi101.stdout: }, 2023-08-01T19:54:46.764 INFO:teuthology.orchestra.run.smithi101.stdout: { 2023-08-01T19:54:46.764 INFO:teuthology.orchestra.run.smithi101.stdout: "event": "sub_op_commit_rec", 2023-08-01T19:54:46.765 INFO:teuthology.orchestra.run.smithi101.stdout: "time": "2023-08-01T19:54:46.260449+0000", 2023-08-01T19:54:46.765 INFO:teuthology.orchestra.run.smithi101.stdout: "duration": 0.0042917179999999999 2023-08-01T19:54:46.765 INFO:teuthology.orchestra.run.smithi101.stdout: }, 2023-08-01T19:54:46.765 INFO:teuthology.orchestra.run.smithi101.stdout: { 2023-08-01T19:54:46.765 INFO:teuthology.orchestra.run.smithi101.stdout: "event": "op_commit", 2023-08-01T19:54:46.765 INFO:teuthology.orchestra.run.smithi101.stdout: "time": "2023-08-01T19:54:46.272229+0000", 2023-08-01T19:54:46.765 INFO:teuthology.orchestra.run.smithi101.stdout: "duration": 0.011779243999999999 2023-08-01T19:54:46.765 INFO:teuthology.orchestra.run.smithi101.stdout: }, 2023-08-01T19:54:46.766 INFO:teuthology.orchestra.run.smithi101.stdout: { 2023-08-01T19:54:46.766 INFO:teuthology.orchestra.run.smithi101.stdout: "event": "commit_sent", 2023-08-01T19:54:46.766 INFO:teuthology.orchestra.run.smithi101.stdout: "time": "2023-08-01T19:54:46.272270+0000", 2023-08-01T19:54:46.766 INFO:teuthology.orchestra.run.smithi101.stdout: "duration": 4.1516e-05 2023-08-01T19:54:46.766 INFO:teuthology.orchestra.run.smithi101.stdout: }, 2023-08-01T19:54:46.766 INFO:teuthology.orchestra.run.smithi101.stdout: { 2023-08-01T19:54:46.766 INFO:teuthology.orchestra.run.smithi101.stdout: "event": "done", 2023-08-01T19:54:46.766 INFO:teuthology.orchestra.run.smithi101.stdout: "time": "2023-08-01T19:54:46.272307+0000", 2023-08-01T19:54:46.767 INFO:teuthology.orchestra.run.smithi101.stdout: "duration": 3.6813000000000001e-05 2023-08-01T19:54:46.767 INFO:teuthology.orchestra.run.smithi101.stdout: } 2023-08-01T19:54:46.767 INFO:teuthology.orchestra.run.smithi101.stdout: ] 2023-08-01T19:54:46.767 INFO:teuthology.orchestra.run.smithi101.stdout: } 2023-08-01T19:54:46.767 INFO:teuthology.orchestra.run.smithi101.stdout: } 2023-08-01T19:54:46.767 INFO:teuthology.orchestra.run.smithi101.stdout: ] 2023-08-01T19:54:46.767 INFO:teuthology.orchestra.run.smithi101.stdout:} 2023-08-01T19:54:46.769 DEBUG:teuthology.orchestra.run.smithi155:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 30 ceph --cluster ceph --admin-daemon /var/run/ceph/ceph-osd.2.asok dump_ops_in_flight 2023-08-01T19:54:46.769 INFO:tasks.ceph.osd.0.smithi008.stderr:2023-08-01T19:54:46.767+0000 7f16a58f4700 -1 received signal: Hangup from /usr/bin/python3 /bin/daemon-helper kill ceph-osd -f --cluster ceph -i 0 (PID: 111179) UID: 0 2023-08-01T19:54:46.869 INFO:tasks.ceph.osd.2.smithi155.stderr:2023-08-01T19:54:46.867+0000 7faa5c6ac700 -1 received signal: Hangup from /usr/bin/python3 /bin/daemon-helper kill ceph-osd -f --cluster ceph -i 2 (PID: 111337) UID: 0 2023-08-01T19:54:46.944 INFO:teuthology.orchestra.run.smithi155.stdout:{ 2023-08-01T19:54:46.945 INFO:teuthology.orchestra.run.smithi155.stdout: "ops": [ 2023-08-01T19:54:46.945 INFO:teuthology.orchestra.run.smithi155.stdout: { 2023-08-01T19:54:46.945 INFO:teuthology.orchestra.run.smithi155.stdout: "description": "osd_op(client.4668.0:64361 5.0 5:0502f263:::benchmark_data_smithi006_114134_object64360:head [set-alloc-hint object_size 65536 write_size 65536,write 0~65536 in=65536b] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e29)", 2023-08-01T19:54:46.945 INFO:teuthology.orchestra.run.smithi155.stdout: "initiated_at": "2023-08-01T19:54:46.938067+0000", 2023-08-01T19:54:46.945 INFO:teuthology.orchestra.run.smithi155.stdout: "age": 0.0037918349999999999, 2023-08-01T19:54:46.945 INFO:teuthology.orchestra.run.smithi155.stdout: "duration": 0.003819879, 2023-08-01T19:54:46.946 INFO:teuthology.orchestra.run.smithi155.stdout: "type_data": { 2023-08-01T19:54:46.946 INFO:teuthology.orchestra.run.smithi155.stdout: "flag_point": "waiting for sub ops", 2023-08-01T19:54:46.946 INFO:teuthology.orchestra.run.smithi155.stdout: "client_info": { 2023-08-01T19:54:46.946 INFO:teuthology.orchestra.run.smithi155.stdout: "client": "client.4668", 2023-08-01T19:54:46.946 INFO:teuthology.orchestra.run.smithi155.stdout: "client_addr": "172.21.15.6:0/1709472247", 2023-08-01T19:54:46.946 INFO:teuthology.orchestra.run.smithi155.stdout: "tid": 64361 2023-08-01T19:54:46.946 INFO:teuthology.orchestra.run.smithi155.stdout: }, 2023-08-01T19:54:46.946 INFO:teuthology.orchestra.run.smithi155.stdout: "events": [ 2023-08-01T19:54:46.947 INFO:teuthology.orchestra.run.smithi155.stdout: { 2023-08-01T19:54:46.947 INFO:teuthology.orchestra.run.smithi155.stdout: "event": "initiated", 2023-08-01T19:54:46.947 INFO:teuthology.orchestra.run.smithi155.stdout: "time": "2023-08-01T19:54:46.938067+0000", 2023-08-01T19:54:46.947 INFO:teuthology.orchestra.run.smithi155.stdout: "duration": 0 2023-08-01T19:54:46.947 INFO:teuthology.orchestra.run.smithi155.stdout: }, 2023-08-01T19:54:46.947 INFO:teuthology.orchestra.run.smithi155.stdout: { 2023-08-01T19:54:46.947 INFO:teuthology.orchestra.run.smithi155.stdout: "event": "throttled", 2023-08-01T19:54:46.947 INFO:teuthology.orchestra.run.smithi155.stdout: "time": "2023-08-01T19:54:46.938067+0000", 2023-08-01T19:54:46.948 INFO:teuthology.orchestra.run.smithi155.stdout: "duration": 0 2023-08-01T19:54:46.948 INFO:teuthology.orchestra.run.smithi155.stdout: }, 2023-08-01T19:54:46.948 INFO:teuthology.orchestra.run.smithi155.stdout: { 2023-08-01T19:54:46.948 INFO:teuthology.orchestra.run.smithi155.stdout: "event": "header_read", 2023-08-01T19:54:46.948 INFO:teuthology.orchestra.run.smithi155.stdout: "time": "2023-08-01T19:54:46.938066+0000", 2023-08-01T19:54:46.948 INFO:teuthology.orchestra.run.smithi155.stdout: "duration": 4294967295.999999 2023-08-01T19:54:46.948 INFO:teuthology.orchestra.run.smithi155.stdout: }, 2023-08-01T19:54:46.949 INFO:teuthology.orchestra.run.smithi155.stdout: { 2023-08-01T19:54:46.949 INFO:teuthology.orchestra.run.smithi155.stdout: "event": "all_read", 2023-08-01T19:54:46.949 INFO:teuthology.orchestra.run.smithi155.stdout: "time": "2023-08-01T19:54:46.938130+0000", 2023-08-01T19:54:46.949 INFO:teuthology.orchestra.run.smithi155.stdout: "duration": 6.4442000000000004e-05 2023-08-01T19:54:46.949 INFO:teuthology.orchestra.run.smithi155.stdout: }, 2023-08-01T19:54:46.949 INFO:teuthology.orchestra.run.smithi155.stdout: { 2023-08-01T19:54:46.949 INFO:teuthology.orchestra.run.smithi155.stdout: "event": "dispatched", 2023-08-01T19:54:46.949 INFO:teuthology.orchestra.run.smithi155.stdout: "time": "2023-08-01T19:54:46.938142+0000", 2023-08-01T19:54:46.950 INFO:teuthology.orchestra.run.smithi155.stdout: "duration": 1.2092999999999999e-05 2023-08-01T19:54:46.950 INFO:teuthology.orchestra.run.smithi155.stdout: }, 2023-08-01T19:54:46.950 INFO:teuthology.orchestra.run.smithi155.stdout: { 2023-08-01T19:54:46.950 INFO:teuthology.orchestra.run.smithi155.stdout: "event": "queued_for_pg", 2023-08-01T19:54:46.950 INFO:teuthology.orchestra.run.smithi155.stdout: "time": "2023-08-01T19:54:46.938149+0000", 2023-08-01T19:54:46.950 INFO:teuthology.orchestra.run.smithi155.stdout: "duration": 6.6189999999999996e-06 2023-08-01T19:54:46.950 INFO:teuthology.orchestra.run.smithi155.stdout: }, 2023-08-01T19:54:46.950 INFO:teuthology.orchestra.run.smithi155.stdout: { 2023-08-01T19:54:46.951 INFO:teuthology.orchestra.run.smithi155.stdout: "event": "reached_pg", 2023-08-01T19:54:46.951 INFO:teuthology.orchestra.run.smithi155.stdout: "time": "2023-08-01T19:54:46.938182+0000", 2023-08-01T19:54:46.951 INFO:teuthology.orchestra.run.smithi155.stdout: "duration": 3.3009999999999997e-05 2023-08-01T19:54:46.951 INFO:teuthology.orchestra.run.smithi155.stdout: }, 2023-08-01T19:54:46.951 INFO:teuthology.orchestra.run.smithi155.stdout: { 2023-08-01T19:54:46.951 INFO:teuthology.orchestra.run.smithi155.stdout: "event": "started", 2023-08-01T19:54:46.951 INFO:teuthology.orchestra.run.smithi155.stdout: "time": "2023-08-01T19:54:46.938260+0000", 2023-08-01T19:54:46.952 INFO:teuthology.orchestra.run.smithi155.stdout: "duration": 7.8417999999999994e-05 2023-08-01T19:54:46.952 INFO:teuthology.orchestra.run.smithi155.stdout: }, 2023-08-01T19:54:46.952 INFO:teuthology.orchestra.run.smithi155.stdout: { 2023-08-01T19:54:46.952 INFO:teuthology.orchestra.run.smithi155.stdout: "event": "waiting for subops from 0", 2023-08-01T19:54:46.952 INFO:teuthology.orchestra.run.smithi155.stdout: "time": "2023-08-01T19:54:46.938345+0000", 2023-08-01T19:54:46.952 INFO:teuthology.orchestra.run.smithi155.stdout: "duration": 8.4886e-05 2023-08-01T19:54:46.952 INFO:teuthology.orchestra.run.smithi155.stdout: } 2023-08-01T19:54:46.952 INFO:teuthology.orchestra.run.smithi155.stdout: ] 2023-08-01T19:54:46.953 INFO:teuthology.orchestra.run.smithi155.stdout: } 2023-08-01T19:54:46.953 INFO:teuthology.orchestra.run.smithi155.stdout: }, 2023-08-01T19:54:46.953 INFO:teuthology.orchestra.run.smithi155.stdout: { 2023-08-01T19:54:46.953 INFO:teuthology.orchestra.run.smithi155.stdout: "description": "osd_op(client.4668.0:64363 5.e 5:7b6808bb:::benchmark_data_smithi006_114134_object64362:head [set-alloc-hint object_size 65536 write_size 65536,write 0~65536 in=65536b] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e29)", 2023-08-01T19:54:46.953 INFO:teuthology.orchestra.run.smithi155.stdout: "initiated_at": "2023-08-01T19:54:46.938615+0000", 2023-08-01T19:54:46.953 INFO:teuthology.orchestra.run.smithi155.stdout: "age": 0.0032432509999999999, 2023-08-01T19:54:46.953 INFO:teuthology.orchestra.run.smithi155.stdout: "duration": 0.0033701080000000001, 2023-08-01T19:54:46.954 INFO:teuthology.orchestra.run.smithi155.stdout: "type_data": { 2023-08-01T19:54:46.954 INFO:teuthology.orchestra.run.smithi155.stdout: "flag_point": "waiting for sub ops", 2023-08-01T19:54:46.954 INFO:teuthology.orchestra.run.smithi155.stdout: "client_info": { 2023-08-01T19:54:46.954 INFO:teuthology.orchestra.run.smithi155.stdout: "client": "client.4668", 2023-08-01T19:54:46.954 INFO:teuthology.orchestra.run.smithi155.stdout: "client_addr": "172.21.15.6:0/1709472247", 2023-08-01T19:54:46.954 INFO:teuthology.orchestra.run.smithi155.stdout: "tid": 64363 2023-08-01T19:54:46.954 INFO:teuthology.orchestra.run.smithi155.stdout: }, 2023-08-01T19:54:46.954 INFO:teuthology.orchestra.run.smithi155.stdout: "events": [ 2023-08-01T19:54:46.955 INFO:teuthology.orchestra.run.smithi155.stdout: { 2023-08-01T19:54:46.955 INFO:teuthology.orchestra.run.smithi155.stdout: "event": "initiated", 2023-08-01T19:54:46.955 INFO:teuthology.orchestra.run.smithi155.stdout: "time": "2023-08-01T19:54:46.938615+0000", 2023-08-01T19:54:46.955 INFO:teuthology.orchestra.run.smithi155.stdout: "duration": 0 2023-08-01T19:54:46.955 INFO:teuthology.orchestra.run.smithi155.stdout: }, 2023-08-01T19:54:46.955 INFO:teuthology.orchestra.run.smithi155.stdout: { 2023-08-01T19:54:46.955 INFO:teuthology.orchestra.run.smithi155.stdout: "event": "throttled", 2023-08-01T19:54:46.955 INFO:teuthology.orchestra.run.smithi155.stdout: "time": "2023-08-01T19:54:46.938615+0000", 2023-08-01T19:54:46.956 INFO:teuthology.orchestra.run.smithi155.stdout: "duration": 0 2023-08-01T19:54:46.956 INFO:teuthology.orchestra.run.smithi155.stdout: }, 2023-08-01T19:54:46.956 INFO:teuthology.orchestra.run.smithi155.stdout: { 2023-08-01T19:54:46.956 INFO:teuthology.orchestra.run.smithi155.stdout: "event": "header_read", 2023-08-01T19:54:46.956 INFO:teuthology.orchestra.run.smithi155.stdout: "time": "2023-08-01T19:54:46.938615+0000", 2023-08-01T19:54:46.956 INFO:teuthology.orchestra.run.smithi155.stdout: "duration": 4294967295.999999 2023-08-01T19:54:46.956 INFO:teuthology.orchestra.run.smithi155.stdout: }, 2023-08-01T19:54:46.957 INFO:teuthology.orchestra.run.smithi155.stdout: { 2023-08-01T19:54:46.957 INFO:teuthology.orchestra.run.smithi155.stdout: "event": "all_read", 2023-08-01T19:54:46.957 INFO:teuthology.orchestra.run.smithi155.stdout: "time": "2023-08-01T19:54:46.938694+0000", 2023-08-01T19:54:46.957 INFO:teuthology.orchestra.run.smithi155.stdout: "duration": 7.8994999999999998e-05 2023-08-01T19:54:46.957 INFO:teuthology.orchestra.run.smithi155.stdout: }, 2023-08-01T19:54:46.957 INFO:teuthology.orchestra.run.smithi155.stdout: { 2023-08-01T19:54:46.957 INFO:teuthology.orchestra.run.smithi155.stdout: "event": "dispatched", 2023-08-01T19:54:46.957 INFO:teuthology.orchestra.run.smithi155.stdout: "time": "2023-08-01T19:54:46.938704+0000", 2023-08-01T19:54:46.958 INFO:teuthology.orchestra.run.smithi155.stdout: "duration": 1.0539e-05 2023-08-01T19:54:46.958 INFO:teuthology.orchestra.run.smithi155.stdout: }, 2023-08-01T19:54:46.958 INFO:teuthology.orchestra.run.smithi155.stdout: { 2023-08-01T19:54:46.958 INFO:teuthology.orchestra.run.smithi155.stdout: "event": "queued_for_pg", 2023-08-01T19:54:46.958 INFO:teuthology.orchestra.run.smithi155.stdout: "time": "2023-08-01T19:54:46.938710+0000", 2023-08-01T19:54:46.958 INFO:teuthology.orchestra.run.smithi155.stdout: "duration": 6.161e-06 2023-08-01T19:54:46.958 INFO:teuthology.orchestra.run.smithi155.stdout: }, 2023-08-01T19:54:46.958 INFO:teuthology.orchestra.run.smithi155.stdout: { 2023-08-01T19:54:46.959 INFO:teuthology.orchestra.run.smithi155.stdout: "event": "reached_pg", 2023-08-01T19:54:46.959 INFO:teuthology.orchestra.run.smithi155.stdout: "time": "2023-08-01T19:54:46.938755+0000", 2023-08-01T19:54:46.959 INFO:teuthology.orchestra.run.smithi155.stdout: "duration": 4.5025999999999999e-05 2023-08-01T19:54:46.959 INFO:teuthology.orchestra.run.smithi155.stdout: }, 2023-08-01T19:54:46.959 INFO:teuthology.orchestra.run.smithi155.stdout: { 2023-08-01T19:54:46.959 INFO:teuthology.orchestra.run.smithi155.stdout: "event": "started", 2023-08-01T19:54:46.959 INFO:teuthology.orchestra.run.smithi155.stdout: "time": "2023-08-01T19:54:46.938878+0000", 2023-08-01T19:54:46.959 INFO:teuthology.orchestra.run.smithi155.stdout: "duration": 0.00012281 2023-08-01T19:54:46.960 INFO:teuthology.orchestra.run.smithi155.stdout: }, 2023-08-01T19:54:46.960 INFO:teuthology.orchestra.run.smithi155.stdout: { 2023-08-01T19:54:46.960 INFO:teuthology.orchestra.run.smithi155.stdout: "event": "waiting for subops from 0", 2023-08-01T19:54:46.960 INFO:teuthology.orchestra.run.smithi155.stdout: "time": "2023-08-01T19:54:46.939026+0000", 2023-08-01T19:54:46.960 INFO:teuthology.orchestra.run.smithi155.stdout: "duration": 0.00014759800000000001 2023-08-01T19:54:46.960 INFO:teuthology.orchestra.run.smithi155.stdout: } 2023-08-01T19:54:46.960 INFO:teuthology.orchestra.run.smithi155.stdout: ] 2023-08-01T19:54:46.961 INFO:teuthology.orchestra.run.smithi155.stdout: } 2023-08-01T19:54:46.961 INFO:teuthology.orchestra.run.smithi155.stdout: }, 2023-08-01T19:54:46.961 INFO:teuthology.orchestra.run.smithi155.stdout: { 2023-08-01T19:54:46.961 INFO:teuthology.orchestra.run.smithi155.stdout: "description": "osd_op(client.4668.0:64364 5.d 5:b6f413cf:::benchmark_data_smithi006_114134_object64363:head [set-alloc-hint object_size 65536 write_size 65536,write 0~65536 in=65536b] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e29)", 2023-08-01T19:54:46.961 INFO:teuthology.orchestra.run.smithi155.stdout: "initiated_at": "2023-08-01T19:54:46.939402+0000", 2023-08-01T19:54:46.961 INFO:teuthology.orchestra.run.smithi155.stdout: "age": 0.0024566280000000002, 2023-08-01T19:54:46.961 INFO:teuthology.orchestra.run.smithi155.stdout: "duration": 0.002661498, 2023-08-01T19:54:46.961 INFO:teuthology.orchestra.run.smithi155.stdout: "type_data": { 2023-08-01T19:54:46.962 INFO:teuthology.orchestra.run.smithi155.stdout: "flag_point": "waiting for sub ops", 2023-08-01T19:54:46.962 INFO:teuthology.orchestra.run.smithi155.stdout: "client_info": { 2023-08-01T19:54:46.962 INFO:teuthology.orchestra.run.smithi155.stdout: "client": "client.4668", 2023-08-01T19:54:46.962 INFO:teuthology.orchestra.run.smithi155.stdout: "client_addr": "172.21.15.6:0/1709472247", 2023-08-01T19:54:46.962 INFO:teuthology.orchestra.run.smithi155.stdout: "tid": 64364 2023-08-01T19:54:46.962 INFO:teuthology.orchestra.run.smithi155.stdout: }, 2023-08-01T19:54:46.962 INFO:teuthology.orchestra.run.smithi155.stdout: "events": [ 2023-08-01T19:54:46.962 INFO:teuthology.orchestra.run.smithi155.stdout: { 2023-08-01T19:54:46.963 INFO:teuthology.orchestra.run.smithi155.stdout: "event": "initiated", 2023-08-01T19:54:46.963 INFO:teuthology.orchestra.run.smithi155.stdout: "time": "2023-08-01T19:54:46.939402+0000", 2023-08-01T19:54:46.963 INFO:teuthology.orchestra.run.smithi155.stdout: "duration": 0 2023-08-01T19:54:46.963 INFO:teuthology.orchestra.run.smithi155.stdout: }, 2023-08-01T19:54:46.963 INFO:teuthology.orchestra.run.smithi155.stdout: { 2023-08-01T19:54:46.963 INFO:teuthology.orchestra.run.smithi155.stdout: "event": "throttled", 2023-08-01T19:54:46.963 INFO:teuthology.orchestra.run.smithi155.stdout: "time": "2023-08-01T19:54:46.939402+0000", 2023-08-01T19:54:46.964 INFO:teuthology.orchestra.run.smithi155.stdout: "duration": 0 2023-08-01T19:54:46.964 INFO:teuthology.orchestra.run.smithi155.stdout: }, 2023-08-01T19:54:46.964 INFO:teuthology.orchestra.run.smithi155.stdout: { 2023-08-01T19:54:46.964 INFO:teuthology.orchestra.run.smithi155.stdout: "event": "header_read", 2023-08-01T19:54:46.964 INFO:teuthology.orchestra.run.smithi155.stdout: "time": "2023-08-01T19:54:46.939401+0000", 2023-08-01T19:54:46.964 INFO:teuthology.orchestra.run.smithi155.stdout: "duration": 4294967295.999999 2023-08-01T19:54:46.964 INFO:teuthology.orchestra.run.smithi155.stdout: }, 2023-08-01T19:54:46.965 INFO:teuthology.orchestra.run.smithi155.stdout: { 2023-08-01T19:54:46.965 INFO:teuthology.orchestra.run.smithi155.stdout: "event": "all_read", 2023-08-01T19:54:46.965 INFO:teuthology.orchestra.run.smithi155.stdout: "time": "2023-08-01T19:54:46.939440+0000", 2023-08-01T19:54:46.965 INFO:teuthology.orchestra.run.smithi155.stdout: "duration": 3.8809000000000001e-05 2023-08-01T19:54:46.965 INFO:teuthology.orchestra.run.smithi155.stdout: }, 2023-08-01T19:54:46.965 INFO:teuthology.orchestra.run.smithi155.stdout: { 2023-08-01T19:54:46.965 INFO:teuthology.orchestra.run.smithi155.stdout: "event": "dispatched", 2023-08-01T19:54:46.965 INFO:teuthology.orchestra.run.smithi155.stdout: "time": "2023-08-01T19:54:46.939448+0000", 2023-08-01T19:54:46.966 INFO:teuthology.orchestra.run.smithi155.stdout: "duration": 8.2320000000000001e-06 2023-08-01T19:54:46.966 INFO:teuthology.orchestra.run.smithi155.stdout: }, 2023-08-01T19:54:46.966 INFO:teuthology.orchestra.run.smithi155.stdout: { 2023-08-01T19:54:46.966 INFO:teuthology.orchestra.run.smithi155.stdout: "event": "queued_for_pg", 2023-08-01T19:54:46.966 INFO:teuthology.orchestra.run.smithi155.stdout: "time": "2023-08-01T19:54:46.939453+0000", 2023-08-01T19:54:46.966 INFO:teuthology.orchestra.run.smithi155.stdout: "duration": 5.1150000000000002e-06 2023-08-01T19:54:46.966 INFO:teuthology.orchestra.run.smithi155.stdout: }, 2023-08-01T19:54:46.966 INFO:teuthology.orchestra.run.smithi155.stdout: { 2023-08-01T19:54:46.967 INFO:teuthology.orchestra.run.smithi155.stdout: "event": "reached_pg", 2023-08-01T19:54:46.967 INFO:teuthology.orchestra.run.smithi155.stdout: "time": "2023-08-01T19:54:46.939538+0000", 2023-08-01T19:54:46.967 INFO:teuthology.orchestra.run.smithi155.stdout: "duration": 8.4946999999999998e-05 2023-08-01T19:54:46.967 INFO:teuthology.orchestra.run.smithi155.stdout: }, 2023-08-01T19:54:46.967 INFO:teuthology.orchestra.run.smithi155.stdout: { 2023-08-01T19:54:46.967 INFO:teuthology.orchestra.run.smithi155.stdout: "event": "started", 2023-08-01T19:54:46.967 INFO:teuthology.orchestra.run.smithi155.stdout: "time": "2023-08-01T19:54:46.939692+0000", 2023-08-01T19:54:46.967 INFO:teuthology.orchestra.run.smithi155.stdout: "duration": 0.000154098 2023-08-01T19:54:46.968 INFO:teuthology.orchestra.run.smithi155.stdout: }, 2023-08-01T19:54:46.968 INFO:teuthology.orchestra.run.smithi155.stdout: { 2023-08-01T19:54:46.968 INFO:teuthology.orchestra.run.smithi155.stdout: "event": "waiting for subops from 1", 2023-08-01T19:54:46.968 INFO:teuthology.orchestra.run.smithi155.stdout: "time": "2023-08-01T19:54:46.939829+0000", 2023-08-01T19:54:46.968 INFO:teuthology.orchestra.run.smithi155.stdout: "duration": 0.000136122 2023-08-01T19:54:46.968 INFO:teuthology.orchestra.run.smithi155.stdout: } 2023-08-01T19:54:46.968 INFO:teuthology.orchestra.run.smithi155.stdout: ] 2023-08-01T19:54:46.968 INFO:teuthology.orchestra.run.smithi155.stdout: } 2023-08-01T19:54:46.969 INFO:teuthology.orchestra.run.smithi155.stdout: }, 2023-08-01T19:54:46.969 INFO:teuthology.orchestra.run.smithi155.stdout: { 2023-08-01T19:54:46.969 INFO:teuthology.orchestra.run.smithi155.stdout: "description": "osd_op(client.4668.0:64365 5.0 5:080bdb5e:::benchmark_data_smithi006_114134_object64364:head [set-alloc-hint object_size 65536 write_size 65536,write 0~65536 in=65536b] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e29)", 2023-08-01T19:54:46.969 INFO:teuthology.orchestra.run.smithi155.stdout: "initiated_at": "2023-08-01T19:54:46.939462+0000", 2023-08-01T19:54:46.969 INFO:teuthology.orchestra.run.smithi155.stdout: "age": 0.0023967810000000002, 2023-08-01T19:54:46.969 INFO:teuthology.orchestra.run.smithi155.stdout: "duration": 0.0026793329999999999, 2023-08-01T19:54:46.969 INFO:teuthology.orchestra.run.smithi155.stdout: "type_data": { 2023-08-01T19:54:46.970 INFO:teuthology.orchestra.run.smithi155.stdout: "flag_point": "waiting for sub ops", 2023-08-01T19:54:46.970 INFO:teuthology.orchestra.run.smithi155.stdout: "client_info": { 2023-08-01T19:54:46.970 INFO:teuthology.orchestra.run.smithi155.stdout: "client": "client.4668", 2023-08-01T19:54:46.970 INFO:teuthology.orchestra.run.smithi155.stdout: "client_addr": "172.21.15.6:0/1709472247", 2023-08-01T19:54:46.970 INFO:teuthology.orchestra.run.smithi155.stdout: "tid": 64365 2023-08-01T19:54:46.970 INFO:teuthology.orchestra.run.smithi155.stdout: }, 2023-08-01T19:54:46.970 INFO:teuthology.orchestra.run.smithi155.stdout: "events": [ 2023-08-01T19:54:46.970 INFO:teuthology.orchestra.run.smithi155.stdout: { 2023-08-01T19:54:46.971 INFO:teuthology.orchestra.run.smithi155.stdout: "event": "initiated", 2023-08-01T19:54:46.971 INFO:teuthology.orchestra.run.smithi155.stdout: "time": "2023-08-01T19:54:46.939462+0000", 2023-08-01T19:54:46.971 INFO:teuthology.orchestra.run.smithi155.stdout: "duration": 0 2023-08-01T19:54:46.971 INFO:teuthology.orchestra.run.smithi155.stdout: }, 2023-08-01T19:54:46.971 INFO:teuthology.orchestra.run.smithi155.stdout: { 2023-08-01T19:54:46.971 INFO:teuthology.orchestra.run.smithi155.stdout: "event": "throttled", 2023-08-01T19:54:46.971 INFO:teuthology.orchestra.run.smithi155.stdout: "time": "2023-08-01T19:54:46.939462+0000", 2023-08-01T19:54:46.971 INFO:teuthology.orchestra.run.smithi155.stdout: "duration": 0 2023-08-01T19:54:46.972 INFO:teuthology.orchestra.run.smithi155.stdout: }, 2023-08-01T19:54:46.972 INFO:teuthology.orchestra.run.smithi155.stdout: { 2023-08-01T19:54:46.972 INFO:teuthology.orchestra.run.smithi155.stdout: "event": "header_read", 2023-08-01T19:54:46.972 INFO:teuthology.orchestra.run.smithi155.stdout: "time": "2023-08-01T19:54:46.939461+0000", 2023-08-01T19:54:46.972 INFO:teuthology.orchestra.run.smithi155.stdout: "duration": 4294967295.9999995 2023-08-01T19:54:46.972 INFO:teuthology.orchestra.run.smithi155.stdout: }, 2023-08-01T19:54:46.972 INFO:teuthology.orchestra.run.smithi155.stdout: { 2023-08-01T19:54:46.972 INFO:teuthology.orchestra.run.smithi155.stdout: "event": "all_read", 2023-08-01T19:54:46.973 INFO:teuthology.orchestra.run.smithi155.stdout: "time": "2023-08-01T19:54:46.939544+0000", 2023-08-01T19:54:46.973 INFO:teuthology.orchestra.run.smithi155.stdout: "duration": 8.2818000000000006e-05 2023-08-01T19:54:46.973 INFO:teuthology.orchestra.run.smithi155.stdout: }, 2023-08-01T19:54:46.973 INFO:teuthology.orchestra.run.smithi155.stdout: { 2023-08-01T19:54:46.973 INFO:teuthology.orchestra.run.smithi155.stdout: "event": "dispatched", 2023-08-01T19:54:46.973 INFO:teuthology.orchestra.run.smithi155.stdout: "time": "2023-08-01T19:54:46.939553+0000", 2023-08-01T19:54:46.973 INFO:teuthology.orchestra.run.smithi155.stdout: "duration": 9.2259999999999994e-06 2023-08-01T19:54:46.973 INFO:teuthology.orchestra.run.smithi155.stdout: }, 2023-08-01T19:54:46.974 INFO:teuthology.orchestra.run.smithi155.stdout: { 2023-08-01T19:54:46.974 INFO:teuthology.orchestra.run.smithi155.stdout: "event": "queued_for_pg", 2023-08-01T19:54:46.974 INFO:teuthology.orchestra.run.smithi155.stdout: "time": "2023-08-01T19:54:46.939559+0000", 2023-08-01T19:54:46.974 INFO:teuthology.orchestra.run.smithi155.stdout: "duration": 5.5430000000000001e-06 2023-08-01T19:54:46.974 INFO:teuthology.orchestra.run.smithi155.stdout: }, 2023-08-01T19:54:46.974 INFO:teuthology.orchestra.run.smithi155.stdout: { 2023-08-01T19:54:46.974 INFO:teuthology.orchestra.run.smithi155.stdout: "event": "reached_pg", 2023-08-01T19:54:46.974 INFO:teuthology.orchestra.run.smithi155.stdout: "time": "2023-08-01T19:54:46.940333+0000", 2023-08-01T19:54:46.975 INFO:teuthology.orchestra.run.smithi155.stdout: "duration": 0.00077432599999999999 2023-08-01T19:54:46.975 INFO:teuthology.orchestra.run.smithi155.stdout: }, 2023-08-01T19:54:46.975 INFO:teuthology.orchestra.run.smithi155.stdout: { 2023-08-01T19:54:46.975 INFO:teuthology.orchestra.run.smithi155.stdout: "event": "started", 2023-08-01T19:54:46.975 INFO:teuthology.orchestra.run.smithi155.stdout: "time": "2023-08-01T19:54:46.940451+0000", 2023-08-01T19:54:46.975 INFO:teuthology.orchestra.run.smithi155.stdout: "duration": 0.0001177 2023-08-01T19:54:46.975 INFO:teuthology.orchestra.run.smithi155.stdout: }, 2023-08-01T19:54:46.976 INFO:teuthology.orchestra.run.smithi155.stdout: { 2023-08-01T19:54:46.976 INFO:teuthology.orchestra.run.smithi155.stdout: "event": "waiting for subops from 0", 2023-08-01T19:54:46.976 INFO:teuthology.orchestra.run.smithi155.stdout: "time": "2023-08-01T19:54:46.940580+0000", 2023-08-01T19:54:46.976 INFO:teuthology.orchestra.run.smithi155.stdout: "duration": 0.000129147 2023-08-01T19:54:46.976 INFO:teuthology.orchestra.run.smithi155.stdout: } 2023-08-01T19:54:46.976 INFO:teuthology.orchestra.run.smithi155.stdout: ] 2023-08-01T19:54:46.976 INFO:teuthology.orchestra.run.smithi155.stdout: } 2023-08-01T19:54:46.976 INFO:teuthology.orchestra.run.smithi155.stdout: }, 2023-08-01T19:54:46.977 INFO:teuthology.orchestra.run.smithi155.stdout: { 2023-08-01T19:54:46.977 INFO:teuthology.orchestra.run.smithi155.stdout: "description": "osd_repop(client.4668.0:64360 5.f e29/19 5:f8d09949:::benchmark_data_smithi006_114134_object64359:head v 29'4059, mlcod=29'4056)", 2023-08-01T19:54:46.977 INFO:teuthology.orchestra.run.smithi155.stdout: "initiated_at": "2023-08-01T19:54:46.939500+0000", 2023-08-01T19:54:46.977 INFO:teuthology.orchestra.run.smithi155.stdout: "age": 0.002358597, 2023-08-01T19:54:46.977 INFO:teuthology.orchestra.run.smithi155.stdout: "duration": 0.002725487, 2023-08-01T19:54:46.977 INFO:teuthology.orchestra.run.smithi155.stdout: "type_data": { 2023-08-01T19:54:46.977 INFO:teuthology.orchestra.run.smithi155.stdout: "flag_point": "started", 2023-08-01T19:54:46.977 INFO:teuthology.orchestra.run.smithi155.stdout: "events": [ 2023-08-01T19:54:46.978 INFO:teuthology.orchestra.run.smithi155.stdout: { 2023-08-01T19:54:46.978 INFO:teuthology.orchestra.run.smithi155.stdout: "event": "initiated", 2023-08-01T19:54:46.978 INFO:teuthology.orchestra.run.smithi155.stdout: "time": "2023-08-01T19:54:46.939500+0000", 2023-08-01T19:54:46.978 INFO:teuthology.orchestra.run.smithi155.stdout: "duration": 0 2023-08-01T19:54:46.978 INFO:teuthology.orchestra.run.smithi155.stdout: }, 2023-08-01T19:54:46.978 INFO:teuthology.orchestra.run.smithi155.stdout: { 2023-08-01T19:54:46.978 INFO:teuthology.orchestra.run.smithi155.stdout: "event": "throttled", 2023-08-01T19:54:46.978 INFO:teuthology.orchestra.run.smithi155.stdout: "time": "2023-08-01T19:54:46.939500+0000", 2023-08-01T19:54:46.979 INFO:teuthology.orchestra.run.smithi155.stdout: "duration": 0 2023-08-01T19:54:46.979 INFO:teuthology.orchestra.run.smithi155.stdout: }, 2023-08-01T19:54:46.979 INFO:teuthology.orchestra.run.smithi155.stdout: { 2023-08-01T19:54:46.979 INFO:teuthology.orchestra.run.smithi155.stdout: "event": "header_read", 2023-08-01T19:54:46.979 INFO:teuthology.orchestra.run.smithi155.stdout: "time": "2023-08-01T19:54:46.939500+0000", 2023-08-01T19:54:46.979 INFO:teuthology.orchestra.run.smithi155.stdout: "duration": 4294967295.9999995 2023-08-01T19:54:46.979 INFO:teuthology.orchestra.run.smithi155.stdout: }, 2023-08-01T19:54:46.979 INFO:teuthology.orchestra.run.smithi155.stdout: { 2023-08-01T19:54:46.980 INFO:teuthology.orchestra.run.smithi155.stdout: "event": "all_read", 2023-08-01T19:54:46.980 INFO:teuthology.orchestra.run.smithi155.stdout: "time": "2023-08-01T19:54:46.939584+0000", 2023-08-01T19:54:46.980 INFO:teuthology.orchestra.run.smithi155.stdout: "duration": 8.4568999999999996e-05 2023-08-01T19:54:46.980 INFO:teuthology.orchestra.run.smithi155.stdout: }, 2023-08-01T19:54:46.980 INFO:teuthology.orchestra.run.smithi155.stdout: { 2023-08-01T19:54:46.980 INFO:teuthology.orchestra.run.smithi155.stdout: "event": "dispatched", 2023-08-01T19:54:46.980 INFO:teuthology.orchestra.run.smithi155.stdout: "time": "2023-08-01T19:54:46.939592+0000", 2023-08-01T19:54:46.980 INFO:teuthology.orchestra.run.smithi155.stdout: "duration": 8.0860000000000002e-06 2023-08-01T19:54:46.981 INFO:teuthology.orchestra.run.smithi155.stdout: }, 2023-08-01T19:54:46.981 INFO:teuthology.orchestra.run.smithi155.stdout: { 2023-08-01T19:54:46.981 INFO:teuthology.orchestra.run.smithi155.stdout: "event": "queued_for_pg", 2023-08-01T19:54:46.981 INFO:teuthology.orchestra.run.smithi155.stdout: "time": "2023-08-01T19:54:46.939596+0000", 2023-08-01T19:54:46.981 INFO:teuthology.orchestra.run.smithi155.stdout: "duration": 4.284e-06 2023-08-01T19:54:46.981 INFO:teuthology.orchestra.run.smithi155.stdout: }, 2023-08-01T19:54:46.981 INFO:teuthology.orchestra.run.smithi155.stdout: { 2023-08-01T19:54:46.982 INFO:teuthology.orchestra.run.smithi155.stdout: "event": "reached_pg", 2023-08-01T19:54:46.982 INFO:teuthology.orchestra.run.smithi155.stdout: "time": "2023-08-01T19:54:46.939624+0000", 2023-08-01T19:54:46.982 INFO:teuthology.orchestra.run.smithi155.stdout: "duration": 2.7892999999999999e-05 2023-08-01T19:54:46.982 INFO:teuthology.orchestra.run.smithi155.stdout: }, 2023-08-01T19:54:46.982 INFO:teuthology.orchestra.run.smithi155.stdout: { 2023-08-01T19:54:46.982 INFO:teuthology.orchestra.run.smithi155.stdout: "event": "started", 2023-08-01T19:54:46.982 INFO:teuthology.orchestra.run.smithi155.stdout: "time": "2023-08-01T19:54:46.939643+0000", 2023-08-01T19:54:46.982 INFO:teuthology.orchestra.run.smithi155.stdout: "duration": 1.8352e-05 2023-08-01T19:54:46.983 INFO:teuthology.orchestra.run.smithi155.stdout: } 2023-08-01T19:54:46.983 INFO:teuthology.orchestra.run.smithi155.stdout: ] 2023-08-01T19:54:46.983 INFO:teuthology.orchestra.run.smithi155.stdout: } 2023-08-01T19:54:46.983 INFO:teuthology.orchestra.run.smithi155.stdout: }, 2023-08-01T19:54:46.983 INFO:teuthology.orchestra.run.smithi155.stdout: { 2023-08-01T19:54:46.983 INFO:teuthology.orchestra.run.smithi155.stdout: "description": "osd_op(client.4668.0:64366 5.0 5.15f34560 (undecoded) ondisk+write+known_if_redirected+supports_pool_eio e29)", 2023-08-01T19:54:46.983 INFO:teuthology.orchestra.run.smithi155.stdout: "initiated_at": "2023-08-01T19:54:46.939623+0000", 2023-08-01T19:54:46.983 INFO:teuthology.orchestra.run.smithi155.stdout: "age": 0.0022357509999999998, 2023-08-01T19:54:46.984 INFO:teuthology.orchestra.run.smithi155.stdout: "duration": 0.0026605800000000001, 2023-08-01T19:54:46.984 INFO:teuthology.orchestra.run.smithi155.stdout: "type_data": { 2023-08-01T19:54:46.984 INFO:teuthology.orchestra.run.smithi155.stdout: "flag_point": "queued for pg", 2023-08-01T19:54:46.984 INFO:teuthology.orchestra.run.smithi155.stdout: "client_info": { 2023-08-01T19:54:46.984 INFO:teuthology.orchestra.run.smithi155.stdout: "client": "client.4668", 2023-08-01T19:54:46.984 INFO:teuthology.orchestra.run.smithi155.stdout: "client_addr": "172.21.15.6:0/1709472247", 2023-08-01T19:54:46.984 INFO:teuthology.orchestra.run.smithi155.stdout: "tid": 64366 2023-08-01T19:54:46.984 INFO:teuthology.orchestra.run.smithi155.stdout: }, 2023-08-01T19:54:46.985 INFO:teuthology.orchestra.run.smithi155.stdout: "events": [ 2023-08-01T19:54:46.985 INFO:teuthology.orchestra.run.smithi155.stdout: { 2023-08-01T19:54:46.985 INFO:teuthology.orchestra.run.smithi155.stdout: "event": "initiated", 2023-08-01T19:54:46.985 INFO:teuthology.orchestra.run.smithi155.stdout: "time": "2023-08-01T19:54:46.939623+0000", 2023-08-01T19:54:46.985 INFO:teuthology.orchestra.run.smithi155.stdout: "duration": 0 2023-08-01T19:54:46.985 INFO:teuthology.orchestra.run.smithi155.stdout: }, 2023-08-01T19:54:46.985 INFO:teuthology.orchestra.run.smithi155.stdout: { 2023-08-01T19:54:46.985 INFO:teuthology.orchestra.run.smithi155.stdout: "event": "throttled", 2023-08-01T19:54:46.986 INFO:teuthology.orchestra.run.smithi155.stdout: "time": "2023-08-01T19:54:46.939623+0000", 2023-08-01T19:54:46.986 INFO:teuthology.orchestra.run.smithi155.stdout: "duration": 0 2023-08-01T19:54:46.986 INFO:teuthology.orchestra.run.smithi155.stdout: }, 2023-08-01T19:54:46.986 INFO:teuthology.orchestra.run.smithi155.stdout: { 2023-08-01T19:54:46.986 INFO:teuthology.orchestra.run.smithi155.stdout: "event": "header_read", 2023-08-01T19:54:46.986 INFO:teuthology.orchestra.run.smithi155.stdout: "time": "2023-08-01T19:54:46.939622+0000", 2023-08-01T19:54:46.986 INFO:teuthology.orchestra.run.smithi155.stdout: "duration": 4294967295.9999995 2023-08-01T19:54:46.986 INFO:teuthology.orchestra.run.smithi155.stdout: }, 2023-08-01T19:54:46.987 INFO:teuthology.orchestra.run.smithi155.stdout: { 2023-08-01T19:54:46.987 INFO:teuthology.orchestra.run.smithi155.stdout: "event": "all_read", 2023-08-01T19:54:46.987 INFO:teuthology.orchestra.run.smithi155.stdout: "time": "2023-08-01T19:54:46.939676+0000", 2023-08-01T19:54:46.987 INFO:teuthology.orchestra.run.smithi155.stdout: "duration": 5.3517999999999998e-05 2023-08-01T19:54:46.987 INFO:teuthology.orchestra.run.smithi155.stdout: }, 2023-08-01T19:54:46.987 INFO:teuthology.orchestra.run.smithi155.stdout: { 2023-08-01T19:54:46.987 INFO:teuthology.orchestra.run.smithi155.stdout: "event": "dispatched", 2023-08-01T19:54:46.988 INFO:teuthology.orchestra.run.smithi155.stdout: "time": "2023-08-01T19:54:46.939684+0000", 2023-08-01T19:54:46.988 INFO:teuthology.orchestra.run.smithi155.stdout: "duration": 8.0800000000000006e-06 2023-08-01T19:54:46.988 INFO:teuthology.orchestra.run.smithi155.stdout: }, 2023-08-01T19:54:46.988 INFO:teuthology.orchestra.run.smithi155.stdout: { 2023-08-01T19:54:46.988 INFO:teuthology.orchestra.run.smithi155.stdout: "event": "queued_for_pg", 2023-08-01T19:54:46.988 INFO:teuthology.orchestra.run.smithi155.stdout: "time": "2023-08-01T19:54:46.939689+0000", 2023-08-01T19:54:46.988 INFO:teuthology.orchestra.run.smithi155.stdout: "duration": 4.8130000000000003e-06 2023-08-01T19:54:46.988 INFO:teuthology.orchestra.run.smithi155.stdout: } 2023-08-01T19:54:46.989 INFO:teuthology.orchestra.run.smithi155.stdout: ] 2023-08-01T19:54:46.989 INFO:teuthology.orchestra.run.smithi155.stdout: } 2023-08-01T19:54:46.989 INFO:teuthology.orchestra.run.smithi155.stdout: }, 2023-08-01T19:54:46.989 INFO:teuthology.orchestra.run.smithi155.stdout: { 2023-08-01T19:54:46.989 INFO:teuthology.orchestra.run.smithi155.stdout: "description": "osd_op(client.4668.0:64367 5.8 5.f115b6a8 (undecoded) ondisk+write+known_if_redirected+supports_pool_eio e29)", 2023-08-01T19:54:46.989 INFO:teuthology.orchestra.run.smithi155.stdout: "initiated_at": "2023-08-01T19:54:46.939766+0000", 2023-08-01T19:54:46.989 INFO:teuthology.orchestra.run.smithi155.stdout: "age": 0.0020924229999999999, 2023-08-01T19:54:46.989 INFO:teuthology.orchestra.run.smithi155.stdout: "duration": 0.0025690969999999998, 2023-08-01T19:54:46.990 INFO:teuthology.orchestra.run.smithi155.stdout: "type_data": { 2023-08-01T19:54:46.990 INFO:teuthology.orchestra.run.smithi155.stdout: "flag_point": "queued for pg", 2023-08-01T19:54:46.990 INFO:teuthology.orchestra.run.smithi155.stdout: "client_info": { 2023-08-01T19:54:46.990 INFO:teuthology.orchestra.run.smithi155.stdout: "client": "client.4668", 2023-08-01T19:54:46.990 INFO:teuthology.orchestra.run.smithi155.stdout: "client_addr": "172.21.15.6:0/1709472247", 2023-08-01T19:54:46.990 INFO:teuthology.orchestra.run.smithi155.stdout: "tid": 64367 2023-08-01T19:54:46.990 INFO:teuthology.orchestra.run.smithi155.stdout: }, 2023-08-01T19:54:46.990 INFO:teuthology.orchestra.run.smithi155.stdout: "events": [ 2023-08-01T19:54:46.991 INFO:teuthology.orchestra.run.smithi155.stdout: { 2023-08-01T19:54:46.991 INFO:teuthology.orchestra.run.smithi155.stdout: "event": "initiated", 2023-08-01T19:54:46.991 INFO:teuthology.orchestra.run.smithi155.stdout: "time": "2023-08-01T19:54:46.939766+0000", 2023-08-01T19:54:46.991 INFO:teuthology.orchestra.run.smithi155.stdout: "duration": 0 2023-08-01T19:54:46.991 INFO:teuthology.orchestra.run.smithi155.stdout: }, 2023-08-01T19:54:46.991 INFO:teuthology.orchestra.run.smithi155.stdout: { 2023-08-01T19:54:46.991 INFO:teuthology.orchestra.run.smithi155.stdout: "event": "throttled", 2023-08-01T19:54:46.991 INFO:teuthology.orchestra.run.smithi155.stdout: "time": "2023-08-01T19:54:46.939766+0000", 2023-08-01T19:54:46.992 INFO:teuthology.orchestra.run.smithi155.stdout: "duration": 0 2023-08-01T19:54:46.992 INFO:teuthology.orchestra.run.smithi155.stdout: }, 2023-08-01T19:54:46.992 INFO:teuthology.orchestra.run.smithi155.stdout: { 2023-08-01T19:54:46.992 INFO:teuthology.orchestra.run.smithi155.stdout: "event": "header_read", 2023-08-01T19:54:46.992 INFO:teuthology.orchestra.run.smithi155.stdout: "time": "2023-08-01T19:54:46.939765+0000", 2023-08-01T19:54:46.992 INFO:teuthology.orchestra.run.smithi155.stdout: "duration": 4294967295.999999 2023-08-01T19:54:46.992 INFO:teuthology.orchestra.run.smithi155.stdout: }, 2023-08-01T19:54:46.992 INFO:teuthology.orchestra.run.smithi155.stdout: { 2023-08-01T19:54:46.993 INFO:teuthology.orchestra.run.smithi155.stdout: "event": "all_read", 2023-08-01T19:54:46.993 INFO:teuthology.orchestra.run.smithi155.stdout: "time": "2023-08-01T19:54:46.939830+0000", 2023-08-01T19:54:46.993 INFO:teuthology.orchestra.run.smithi155.stdout: "duration": 6.4382999999999997e-05 2023-08-01T19:54:46.993 INFO:teuthology.orchestra.run.smithi155.stdout: }, 2023-08-01T19:54:46.993 INFO:teuthology.orchestra.run.smithi155.stdout: { 2023-08-01T19:54:46.993 INFO:teuthology.orchestra.run.smithi155.stdout: "event": "dispatched", 2023-08-01T19:54:46.993 INFO:teuthology.orchestra.run.smithi155.stdout: "time": "2023-08-01T19:54:46.939842+0000", 2023-08-01T19:54:46.994 INFO:teuthology.orchestra.run.smithi155.stdout: "duration": 1.2525e-05 2023-08-01T19:54:46.994 INFO:teuthology.orchestra.run.smithi155.stdout: }, 2023-08-01T19:54:46.994 INFO:teuthology.orchestra.run.smithi155.stdout: { 2023-08-01T19:54:46.994 INFO:teuthology.orchestra.run.smithi155.stdout: "event": "queued_for_pg", 2023-08-01T19:54:46.994 INFO:teuthology.orchestra.run.smithi155.stdout: "time": "2023-08-01T19:54:46.939848+0000", 2023-08-01T19:54:46.994 INFO:teuthology.orchestra.run.smithi155.stdout: "duration": 5.276e-06 2023-08-01T19:54:46.994 INFO:teuthology.orchestra.run.smithi155.stdout: } 2023-08-01T19:54:46.994 INFO:teuthology.orchestra.run.smithi155.stdout: ] 2023-08-01T19:54:46.995 INFO:teuthology.orchestra.run.smithi155.stdout: } 2023-08-01T19:54:46.995 INFO:teuthology.orchestra.run.smithi155.stdout: }, 2023-08-01T19:54:46.995 INFO:teuthology.orchestra.run.smithi155.stdout: { 2023-08-01T19:54:46.995 INFO:teuthology.orchestra.run.smithi155.stdout: "description": "osd_repop_reply(client.4668.0:64346 5.8 e29/19)", 2023-08-01T19:54:46.995 INFO:teuthology.orchestra.run.smithi155.stdout: "initiated_at": "2023-08-01T19:54:46.940795+0000", 2023-08-01T19:54:46.995 INFO:teuthology.orchestra.run.smithi155.stdout: "age": 0.001063605, 2023-08-01T19:54:46.995 INFO:teuthology.orchestra.run.smithi155.stdout: "duration": 0.001592712, 2023-08-01T19:54:46.995 INFO:teuthology.orchestra.run.smithi155.stdout: "type_data": { 2023-08-01T19:54:46.996 INFO:teuthology.orchestra.run.smithi155.stdout: "flag_point": "queued for pg", 2023-08-01T19:54:46.996 INFO:teuthology.orchestra.run.smithi155.stdout: "events": [ 2023-08-01T19:54:46.996 INFO:teuthology.orchestra.run.smithi155.stdout: { 2023-08-01T19:54:46.996 INFO:teuthology.orchestra.run.smithi155.stdout: "event": "initiated", 2023-08-01T19:54:46.996 INFO:teuthology.orchestra.run.smithi155.stdout: "time": "2023-08-01T19:54:46.940795+0000", 2023-08-01T19:54:46.996 INFO:teuthology.orchestra.run.smithi155.stdout: "duration": 0 2023-08-01T19:54:46.996 INFO:teuthology.orchestra.run.smithi155.stdout: }, 2023-08-01T19:54:46.997 INFO:teuthology.orchestra.run.smithi155.stdout: { 2023-08-01T19:54:46.997 INFO:teuthology.orchestra.run.smithi155.stdout: "event": "throttled", 2023-08-01T19:54:46.997 INFO:teuthology.orchestra.run.smithi155.stdout: "time": "2023-08-01T19:54:46.940795+0000", 2023-08-01T19:54:46.997 INFO:teuthology.orchestra.run.smithi155.stdout: "duration": 0 2023-08-01T19:54:46.997 INFO:teuthology.orchestra.run.smithi155.stdout: }, 2023-08-01T19:54:46.997 INFO:teuthology.orchestra.run.smithi155.stdout: { 2023-08-01T19:54:46.997 INFO:teuthology.orchestra.run.smithi155.stdout: "event": "header_read", 2023-08-01T19:54:46.997 INFO:teuthology.orchestra.run.smithi155.stdout: "time": "2023-08-01T19:54:46.940794+0000", 2023-08-01T19:54:46.998 INFO:teuthology.orchestra.run.smithi155.stdout: "duration": 4294967295.9999995 2023-08-01T19:54:46.998 INFO:teuthology.orchestra.run.smithi155.stdout: }, 2023-08-01T19:54:46.998 INFO:teuthology.orchestra.run.smithi155.stdout: { 2023-08-01T19:54:46.998 INFO:teuthology.orchestra.run.smithi155.stdout: "event": "all_read", 2023-08-01T19:54:46.998 INFO:teuthology.orchestra.run.smithi155.stdout: "time": "2023-08-01T19:54:46.940798+0000", 2023-08-01T19:54:46.998 INFO:teuthology.orchestra.run.smithi155.stdout: "duration": 4.0149999999999997e-06 2023-08-01T19:54:46.998 INFO:teuthology.orchestra.run.smithi155.stdout: }, 2023-08-01T19:54:46.998 INFO:teuthology.orchestra.run.smithi155.stdout: { 2023-08-01T19:54:46.999 INFO:teuthology.orchestra.run.smithi155.stdout: "event": "dispatched", 2023-08-01T19:54:46.999 INFO:teuthology.orchestra.run.smithi155.stdout: "time": "2023-08-01T19:54:46.940809+0000", 2023-08-01T19:54:46.999 INFO:teuthology.orchestra.run.smithi155.stdout: "duration": 1.0309000000000001e-05 2023-08-01T19:54:46.999 INFO:teuthology.orchestra.run.smithi155.stdout: }, 2023-08-01T19:54:46.999 INFO:teuthology.orchestra.run.smithi155.stdout: { 2023-08-01T19:54:46.999 INFO:teuthology.orchestra.run.smithi155.stdout: "event": "queued_for_pg", 2023-08-01T19:54:46.999 INFO:teuthology.orchestra.run.smithi155.stdout: "time": "2023-08-01T19:54:46.940814+0000", 2023-08-01T19:54:46.999 INFO:teuthology.orchestra.run.smithi155.stdout: "duration": 4.9960000000000001e-06 2023-08-01T19:54:47.000 INFO:teuthology.orchestra.run.smithi155.stdout: } 2023-08-01T19:54:47.000 INFO:teuthology.orchestra.run.smithi155.stdout: ] 2023-08-01T19:54:47.000 INFO:teuthology.orchestra.run.smithi155.stdout: } 2023-08-01T19:54:47.000 INFO:teuthology.orchestra.run.smithi155.stdout: }, 2023-08-01T19:54:47.000 INFO:teuthology.orchestra.run.smithi155.stdout: { 2023-08-01T19:54:47.000 INFO:teuthology.orchestra.run.smithi155.stdout: "description": "osd_op(client.4668.0:64369 5.4 5:28aa7700:::benchmark_data_smithi006_114134_object64368:head [set-alloc-hint object_size 65536 write_size 65536,write 0~65536 in=65536b] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e29)", 2023-08-01T19:54:47.000 INFO:teuthology.orchestra.run.smithi155.stdout: "initiated_at": "2023-08-01T19:54:46.941345+0000", 2023-08-01T19:54:47.001 INFO:teuthology.orchestra.run.smithi155.stdout: "age": 0.00051369800000000004, 2023-08-01T19:54:47.001 INFO:teuthology.orchestra.run.smithi155.stdout: "duration": 0.00109593, 2023-08-01T19:54:47.001 INFO:teuthology.orchestra.run.smithi155.stdout: "type_data": { 2023-08-01T19:54:47.001 INFO:teuthology.orchestra.run.smithi155.stdout: "flag_point": "waiting for sub ops", 2023-08-01T19:54:47.001 INFO:teuthology.orchestra.run.smithi155.stdout: "client_info": { 2023-08-01T19:54:47.001 INFO:teuthology.orchestra.run.smithi155.stdout: "client": "client.4668", 2023-08-01T19:54:47.001 INFO:teuthology.orchestra.run.smithi155.stdout: "client_addr": "172.21.15.6:0/1709472247", 2023-08-01T19:54:47.001 INFO:teuthology.orchestra.run.smithi155.stdout: "tid": 64369 2023-08-01T19:54:47.002 INFO:teuthology.orchestra.run.smithi155.stdout: }, 2023-08-01T19:54:47.002 INFO:teuthology.orchestra.run.smithi155.stdout: "events": [ 2023-08-01T19:54:47.002 INFO:teuthology.orchestra.run.smithi155.stdout: { 2023-08-01T19:54:47.002 INFO:teuthology.orchestra.run.smithi155.stdout: "event": "initiated", 2023-08-01T19:54:47.002 INFO:teuthology.orchestra.run.smithi155.stdout: "time": "2023-08-01T19:54:46.941345+0000", 2023-08-01T19:54:47.002 INFO:teuthology.orchestra.run.smithi155.stdout: "duration": 0 2023-08-01T19:54:47.002 INFO:teuthology.orchestra.run.smithi155.stdout: }, 2023-08-01T19:54:47.002 INFO:teuthology.orchestra.run.smithi155.stdout: { 2023-08-01T19:54:47.003 INFO:teuthology.orchestra.run.smithi155.stdout: "event": "throttled", 2023-08-01T19:54:47.003 INFO:teuthology.orchestra.run.smithi155.stdout: "time": "2023-08-01T19:54:46.941345+0000", 2023-08-01T19:54:47.003 INFO:teuthology.orchestra.run.smithi155.stdout: "duration": 0 2023-08-01T19:54:47.003 INFO:teuthology.orchestra.run.smithi155.stdout: }, 2023-08-01T19:54:47.003 INFO:teuthology.orchestra.run.smithi155.stdout: { 2023-08-01T19:54:47.003 INFO:teuthology.orchestra.run.smithi155.stdout: "event": "header_read", 2023-08-01T19:54:47.003 INFO:teuthology.orchestra.run.smithi155.stdout: "time": "2023-08-01T19:54:46.941344+0000", 2023-08-01T19:54:47.003 INFO:teuthology.orchestra.run.smithi155.stdout: "duration": 4294967295.999999 2023-08-01T19:54:47.004 INFO:teuthology.orchestra.run.smithi155.stdout: }, 2023-08-01T19:54:47.004 INFO:teuthology.orchestra.run.smithi155.stdout: { 2023-08-01T19:54:47.004 INFO:teuthology.orchestra.run.smithi155.stdout: "event": "all_read", 2023-08-01T19:54:47.004 INFO:teuthology.orchestra.run.smithi155.stdout: "time": "2023-08-01T19:54:46.941384+0000", 2023-08-01T19:54:47.004 INFO:teuthology.orchestra.run.smithi155.stdout: "duration": 4.0002000000000001e-05 2023-08-01T19:54:47.004 INFO:teuthology.orchestra.run.smithi155.stdout: }, 2023-08-01T19:54:47.004 INFO:teuthology.orchestra.run.smithi155.stdout: { 2023-08-01T19:54:47.005 INFO:teuthology.orchestra.run.smithi155.stdout: "event": "dispatched", 2023-08-01T19:54:47.005 INFO:teuthology.orchestra.run.smithi155.stdout: "time": "2023-08-01T19:54:46.941393+0000", 2023-08-01T19:54:47.005 INFO:teuthology.orchestra.run.smithi155.stdout: "duration": 8.816e-06 2023-08-01T19:54:47.005 INFO:teuthology.orchestra.run.smithi155.stdout: }, 2023-08-01T19:54:47.005 INFO:teuthology.orchestra.run.smithi155.stdout: { 2023-08-01T19:54:47.005 INFO:teuthology.orchestra.run.smithi155.stdout: "event": "queued_for_pg", 2023-08-01T19:54:47.005 INFO:teuthology.orchestra.run.smithi155.stdout: "time": "2023-08-01T19:54:46.941397+0000", 2023-08-01T19:54:47.005 INFO:teuthology.orchestra.run.smithi155.stdout: "duration": 4.4519999999999999e-06 2023-08-01T19:54:47.006 INFO:teuthology.orchestra.run.smithi155.stdout: }, 2023-08-01T19:54:47.006 INFO:teuthology.orchestra.run.smithi155.stdout: { 2023-08-01T19:54:47.006 INFO:teuthology.orchestra.run.smithi155.stdout: "event": "reached_pg", 2023-08-01T19:54:47.006 INFO:teuthology.orchestra.run.smithi155.stdout: "time": "2023-08-01T19:54:46.941432+0000", 2023-08-01T19:54:47.006 INFO:teuthology.orchestra.run.smithi155.stdout: "duration": 3.4650000000000002e-05 2023-08-01T19:54:47.006 INFO:teuthology.orchestra.run.smithi155.stdout: }, 2023-08-01T19:54:47.006 INFO:teuthology.orchestra.run.smithi155.stdout: { 2023-08-01T19:54:47.006 INFO:teuthology.orchestra.run.smithi155.stdout: "event": "started", 2023-08-01T19:54:47.007 INFO:teuthology.orchestra.run.smithi155.stdout: "time": "2023-08-01T19:54:46.941540+0000", 2023-08-01T19:54:47.007 INFO:teuthology.orchestra.run.smithi155.stdout: "duration": 0.000108415 2023-08-01T19:54:47.007 INFO:teuthology.orchestra.run.smithi155.stdout: }, 2023-08-01T19:54:47.007 INFO:teuthology.orchestra.run.smithi155.stdout: { 2023-08-01T19:54:47.007 INFO:teuthology.orchestra.run.smithi155.stdout: "event": "waiting for subops from 0", 2023-08-01T19:54:47.007 INFO:teuthology.orchestra.run.smithi155.stdout: "time": "2023-08-01T19:54:46.941661+0000", 2023-08-01T19:54:47.007 INFO:teuthology.orchestra.run.smithi155.stdout: "duration": 0.00012065000000000001 2023-08-01T19:54:47.007 INFO:teuthology.orchestra.run.smithi155.stdout: } 2023-08-01T19:54:47.008 INFO:teuthology.orchestra.run.smithi155.stdout: ] 2023-08-01T19:54:47.008 INFO:teuthology.orchestra.run.smithi155.stdout: } 2023-08-01T19:54:47.008 INFO:teuthology.orchestra.run.smithi155.stdout: }, 2023-08-01T19:54:47.008 INFO:teuthology.orchestra.run.smithi155.stdout: { 2023-08-01T19:54:47.008 INFO:teuthology.orchestra.run.smithi155.stdout: "description": "osd_op(client.4668.0:64371 5.e 5:73164af2:::benchmark_data_smithi006_114134_object64370:head [set-alloc-hint object_size 65536 write_size 65536,write 0~65536 in=65536b] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e29)", 2023-08-01T19:54:47.008 INFO:teuthology.orchestra.run.smithi155.stdout: "initiated_at": "2023-08-01T19:54:46.941406+0000", 2023-08-01T19:54:47.008 INFO:teuthology.orchestra.run.smithi155.stdout: "age": 0.00045224399999999998, 2023-08-01T19:54:47.008 INFO:teuthology.orchestra.run.smithi155.stdout: "duration": 0.0011163499999999999, 2023-08-01T19:54:47.009 INFO:teuthology.orchestra.run.smithi155.stdout: "type_data": { 2023-08-01T19:54:47.009 INFO:teuthology.orchestra.run.smithi155.stdout: "flag_point": "waiting for sub ops", 2023-08-01T19:54:47.009 INFO:teuthology.orchestra.run.smithi155.stdout: "client_info": { 2023-08-01T19:54:47.009 INFO:teuthology.orchestra.run.smithi155.stdout: "client": "client.4668", 2023-08-01T19:54:47.009 INFO:teuthology.orchestra.run.smithi155.stdout: "client_addr": "172.21.15.6:0/1709472247", 2023-08-01T19:54:47.009 INFO:teuthology.orchestra.run.smithi155.stdout: "tid": 64371 2023-08-01T19:54:47.009 INFO:teuthology.orchestra.run.smithi155.stdout: }, 2023-08-01T19:54:47.009 INFO:teuthology.orchestra.run.smithi155.stdout: "events": [ 2023-08-01T19:54:47.010 INFO:teuthology.orchestra.run.smithi155.stdout: { 2023-08-01T19:54:47.010 INFO:teuthology.orchestra.run.smithi155.stdout: "event": "initiated", 2023-08-01T19:54:47.010 INFO:teuthology.orchestra.run.smithi155.stdout: "time": "2023-08-01T19:54:46.941406+0000", 2023-08-01T19:54:47.010 INFO:teuthology.orchestra.run.smithi155.stdout: "duration": 0 2023-08-01T19:54:47.010 INFO:teuthology.orchestra.run.smithi155.stdout: }, 2023-08-01T19:54:47.010 INFO:teuthology.orchestra.run.smithi155.stdout: { 2023-08-01T19:54:47.010 INFO:teuthology.orchestra.run.smithi155.stdout: "event": "throttled", 2023-08-01T19:54:47.010 INFO:teuthology.orchestra.run.smithi155.stdout: "time": "2023-08-01T19:54:46.941406+0000", 2023-08-01T19:54:47.011 INFO:teuthology.orchestra.run.smithi155.stdout: "duration": 0 2023-08-01T19:54:47.011 INFO:teuthology.orchestra.run.smithi155.stdout: }, 2023-08-01T19:54:47.011 INFO:teuthology.orchestra.run.smithi155.stdout: { 2023-08-01T19:54:47.011 INFO:teuthology.orchestra.run.smithi155.stdout: "event": "header_read", 2023-08-01T19:54:47.011 INFO:teuthology.orchestra.run.smithi155.stdout: "time": "2023-08-01T19:54:46.941406+0000", 2023-08-01T19:54:47.011 INFO:teuthology.orchestra.run.smithi155.stdout: "duration": 4294967295.9999995 2023-08-01T19:54:47.011 INFO:teuthology.orchestra.run.smithi155.stdout: }, 2023-08-01T19:54:47.012 INFO:teuthology.orchestra.run.smithi155.stdout: { 2023-08-01T19:54:47.012 INFO:teuthology.orchestra.run.smithi155.stdout: "event": "all_read", 2023-08-01T19:54:47.012 INFO:teuthology.orchestra.run.smithi155.stdout: "time": "2023-08-01T19:54:46.941428+0000", 2023-08-01T19:54:47.012 INFO:teuthology.orchestra.run.smithi155.stdout: "duration": 2.1756e-05 2023-08-01T19:54:47.012 INFO:teuthology.orchestra.run.smithi155.stdout: }, 2023-08-01T19:54:47.012 INFO:teuthology.orchestra.run.smithi155.stdout: { 2023-08-01T19:54:47.012 INFO:teuthology.orchestra.run.smithi155.stdout: "event": "dispatched", 2023-08-01T19:54:47.012 INFO:teuthology.orchestra.run.smithi155.stdout: "time": "2023-08-01T19:54:46.941433+0000", 2023-08-01T19:54:47.013 INFO:teuthology.orchestra.run.smithi155.stdout: "duration": 5.8889999999999999e-06 2023-08-01T19:54:47.013 INFO:teuthology.orchestra.run.smithi155.stdout: }, 2023-08-01T19:54:47.013 INFO:teuthology.orchestra.run.smithi155.stdout: { 2023-08-01T19:54:47.013 INFO:teuthology.orchestra.run.smithi155.stdout: "event": "queued_for_pg", 2023-08-01T19:54:47.013 INFO:teuthology.orchestra.run.smithi155.stdout: "time": "2023-08-01T19:54:46.941437+0000", 2023-08-01T19:54:47.013 INFO:teuthology.orchestra.run.smithi155.stdout: "duration": 3.6600000000000001e-06 2023-08-01T19:54:47.013 INFO:teuthology.orchestra.run.smithi155.stdout: }, 2023-08-01T19:54:47.013 INFO:teuthology.orchestra.run.smithi155.stdout: { 2023-08-01T19:54:47.014 INFO:teuthology.orchestra.run.smithi155.stdout: "event": "reached_pg", 2023-08-01T19:54:47.014 INFO:teuthology.orchestra.run.smithi155.stdout: "time": "2023-08-01T19:54:46.941465+0000", 2023-08-01T19:54:47.014 INFO:teuthology.orchestra.run.smithi155.stdout: "duration": 2.7665e-05 2023-08-01T19:54:47.014 INFO:teuthology.orchestra.run.smithi155.stdout: }, 2023-08-01T19:54:47.014 INFO:teuthology.orchestra.run.smithi155.stdout: { 2023-08-01T19:54:47.014 INFO:teuthology.orchestra.run.smithi155.stdout: "event": "started", 2023-08-01T19:54:47.014 INFO:teuthology.orchestra.run.smithi155.stdout: "time": "2023-08-01T19:54:46.941561+0000", 2023-08-01T19:54:47.014 INFO:teuthology.orchestra.run.smithi155.stdout: "duration": 9.6446999999999993e-05 2023-08-01T19:54:47.015 INFO:teuthology.orchestra.run.smithi155.stdout: }, 2023-08-01T19:54:47.015 INFO:teuthology.orchestra.run.smithi155.stdout: { 2023-08-01T19:54:47.015 INFO:teuthology.orchestra.run.smithi155.stdout: "event": "waiting for subops from 0", 2023-08-01T19:54:47.015 INFO:teuthology.orchestra.run.smithi155.stdout: "time": "2023-08-01T19:54:46.941705+0000", 2023-08-01T19:54:47.015 INFO:teuthology.orchestra.run.smithi155.stdout: "duration": 0.000143769 2023-08-01T19:54:47.015 INFO:teuthology.orchestra.run.smithi155.stdout: } 2023-08-01T19:54:47.015 INFO:teuthology.orchestra.run.smithi155.stdout: ] 2023-08-01T19:54:47.015 INFO:teuthology.orchestra.run.smithi155.stdout: } 2023-08-01T19:54:47.016 INFO:teuthology.orchestra.run.smithi155.stdout: }, 2023-08-01T19:54:47.016 INFO:teuthology.orchestra.run.smithi155.stdout: { 2023-08-01T19:54:47.016 INFO:teuthology.orchestra.run.smithi155.stdout: "description": "osd_op(client.4668.0:64373 5.0 5.87bc6720 (undecoded) ondisk+write+known_if_redirected+supports_pool_eio e29)", 2023-08-01T19:54:47.016 INFO:teuthology.orchestra.run.smithi155.stdout: "initiated_at": "2023-08-01T19:54:46.941634+0000", 2023-08-01T19:54:47.016 INFO:teuthology.orchestra.run.smithi155.stdout: "age": 0.00022459300000000001, 2023-08-01T19:54:47.016 INFO:teuthology.orchestra.run.smithi155.stdout: "duration": 0.00097139899999999996, 2023-08-01T19:54:47.016 INFO:teuthology.orchestra.run.smithi155.stdout: "type_data": { 2023-08-01T19:54:47.016 INFO:teuthology.orchestra.run.smithi155.stdout: "flag_point": "queued for pg", 2023-08-01T19:54:47.017 INFO:teuthology.orchestra.run.smithi155.stdout: "client_info": { 2023-08-01T19:54:47.017 INFO:teuthology.orchestra.run.smithi155.stdout: "client": "client.4668", 2023-08-01T19:54:47.017 INFO:teuthology.orchestra.run.smithi155.stdout: "client_addr": "172.21.15.6:0/1709472247", 2023-08-01T19:54:47.017 INFO:teuthology.orchestra.run.smithi155.stdout: "tid": 64373 2023-08-01T19:54:47.017 INFO:teuthology.orchestra.run.smithi155.stdout: }, 2023-08-01T19:54:47.017 INFO:teuthology.orchestra.run.smithi155.stdout: "events": [ 2023-08-01T19:54:47.017 INFO:teuthology.orchestra.run.smithi155.stdout: { 2023-08-01T19:54:47.018 INFO:teuthology.orchestra.run.smithi155.stdout: "event": "initiated", 2023-08-01T19:54:47.018 INFO:teuthology.orchestra.run.smithi155.stdout: "time": "2023-08-01T19:54:46.941634+0000", 2023-08-01T19:54:47.018 INFO:teuthology.orchestra.run.smithi155.stdout: "duration": 0 2023-08-01T19:54:47.018 INFO:teuthology.orchestra.run.smithi155.stdout: }, 2023-08-01T19:54:47.018 INFO:teuthology.orchestra.run.smithi155.stdout: { 2023-08-01T19:54:47.018 INFO:teuthology.orchestra.run.smithi155.stdout: "event": "throttled", 2023-08-01T19:54:47.018 INFO:teuthology.orchestra.run.smithi155.stdout: "time": "2023-08-01T19:54:46.941634+0000", 2023-08-01T19:54:47.018 INFO:teuthology.orchestra.run.smithi155.stdout: "duration": 0 2023-08-01T19:54:47.019 INFO:teuthology.orchestra.run.smithi155.stdout: }, 2023-08-01T19:54:47.019 INFO:teuthology.orchestra.run.smithi155.stdout: { 2023-08-01T19:54:47.019 INFO:teuthology.orchestra.run.smithi155.stdout: "event": "header_read", 2023-08-01T19:54:47.019 INFO:teuthology.orchestra.run.smithi155.stdout: "time": "2023-08-01T19:54:46.941633+0000", 2023-08-01T19:54:47.019 INFO:teuthology.orchestra.run.smithi155.stdout: "duration": 4294967295.999999 2023-08-01T19:54:47.019 INFO:teuthology.orchestra.run.smithi155.stdout: }, 2023-08-01T19:54:47.019 INFO:teuthology.orchestra.run.smithi155.stdout: { 2023-08-01T19:54:47.019 INFO:teuthology.orchestra.run.smithi155.stdout: "event": "all_read", 2023-08-01T19:54:47.020 INFO:teuthology.orchestra.run.smithi155.stdout: "time": "2023-08-01T19:54:46.941724+0000", 2023-08-01T19:54:47.020 INFO:teuthology.orchestra.run.smithi155.stdout: "duration": 9.0702e-05 2023-08-01T19:54:47.020 INFO:teuthology.orchestra.run.smithi155.stdout: }, 2023-08-01T19:54:47.020 INFO:teuthology.orchestra.run.smithi155.stdout: { 2023-08-01T19:54:47.020 INFO:teuthology.orchestra.run.smithi155.stdout: "event": "dispatched", 2023-08-01T19:54:47.020 INFO:teuthology.orchestra.run.smithi155.stdout: "time": "2023-08-01T19:54:46.941732+0000", 2023-08-01T19:54:47.020 INFO:teuthology.orchestra.run.smithi155.stdout: "duration": 8.0260000000000007e-06 2023-08-01T19:54:47.020 INFO:teuthology.orchestra.run.smithi155.stdout: }, 2023-08-01T19:54:47.021 INFO:teuthology.orchestra.run.smithi155.stdout: { 2023-08-01T19:54:47.021 INFO:teuthology.orchestra.run.smithi155.stdout: "event": "queued_for_pg", 2023-08-01T19:54:47.021 INFO:teuthology.orchestra.run.smithi155.stdout: "time": "2023-08-01T19:54:46.941737+0000", 2023-08-01T19:54:47.021 INFO:teuthology.orchestra.run.smithi155.stdout: "duration": 5.4349999999999996e-06 2023-08-01T19:54:47.021 INFO:teuthology.orchestra.run.smithi155.stdout: } 2023-08-01T19:54:47.021 INFO:teuthology.orchestra.run.smithi155.stdout: ] 2023-08-01T19:54:47.021 INFO:teuthology.orchestra.run.smithi155.stdout: } 2023-08-01T19:54:47.021 INFO:teuthology.orchestra.run.smithi155.stdout: }, 2023-08-01T19:54:47.022 INFO:teuthology.orchestra.run.smithi155.stdout: { 2023-08-01T19:54:47.022 INFO:teuthology.orchestra.run.smithi155.stdout: "description": "osd_repop(client.4668.0:64370 5.a e29/19 5:52a28e9f:::benchmark_data_smithi006_114134_object64369:head v 29'3999, mlcod=29'3997)", 2023-08-01T19:54:47.022 INFO:teuthology.orchestra.run.smithi155.stdout: "initiated_at": "2023-08-01T19:54:46.941779+0000", 2023-08-01T19:54:47.022 INFO:teuthology.orchestra.run.smithi155.stdout: "age": 7.9499000000000006e-05, 2023-08-01T19:54:47.022 INFO:teuthology.orchestra.run.smithi155.stdout: "duration": 0.00088453200000000005, 2023-08-01T19:54:47.022 INFO:teuthology.orchestra.run.smithi155.stdout: "type_data": { 2023-08-01T19:54:47.022 INFO:teuthology.orchestra.run.smithi155.stdout: "flag_point": "started", 2023-08-01T19:54:47.022 INFO:teuthology.orchestra.run.smithi155.stdout: "events": [ 2023-08-01T19:54:47.023 INFO:teuthology.orchestra.run.smithi155.stdout: { 2023-08-01T19:54:47.023 INFO:teuthology.orchestra.run.smithi155.stdout: "event": "initiated", 2023-08-01T19:54:47.023 INFO:teuthology.orchestra.run.smithi155.stdout: "time": "2023-08-01T19:54:46.941779+0000", 2023-08-01T19:54:47.023 INFO:teuthology.orchestra.run.smithi155.stdout: "duration": 0 2023-08-01T19:54:47.023 INFO:teuthology.orchestra.run.smithi155.stdout: }, 2023-08-01T19:54:47.023 INFO:teuthology.orchestra.run.smithi155.stdout: { 2023-08-01T19:54:47.023 INFO:teuthology.orchestra.run.smithi155.stdout: "event": "throttled", 2023-08-01T19:54:47.023 INFO:teuthology.orchestra.run.smithi155.stdout: "time": "2023-08-01T19:54:46.941779+0000", 2023-08-01T19:54:47.024 INFO:teuthology.orchestra.run.smithi155.stdout: "duration": 0 2023-08-01T19:54:47.024 INFO:teuthology.orchestra.run.smithi155.stdout: }, 2023-08-01T19:54:47.024 INFO:teuthology.orchestra.run.smithi155.stdout: { 2023-08-01T19:54:47.024 INFO:teuthology.orchestra.run.smithi155.stdout: "event": "header_read", 2023-08-01T19:54:47.024 INFO:teuthology.orchestra.run.smithi155.stdout: "time": "2023-08-01T19:54:46.941779+0000", 2023-08-01T19:54:47.024 INFO:teuthology.orchestra.run.smithi155.stdout: "duration": 4294967295.9999995 2023-08-01T19:54:47.024 INFO:teuthology.orchestra.run.smithi155.stdout: }, 2023-08-01T19:54:47.025 INFO:teuthology.orchestra.run.smithi155.stdout: { 2023-08-01T19:54:47.025 INFO:teuthology.orchestra.run.smithi155.stdout: "event": "all_read", 2023-08-01T19:54:47.025 INFO:teuthology.orchestra.run.smithi155.stdout: "time": "2023-08-01T19:54:46.941842+0000", 2023-08-01T19:54:47.025 INFO:teuthology.orchestra.run.smithi155.stdout: "duration": 6.3161000000000001e-05 2023-08-01T19:54:47.025 INFO:teuthology.orchestra.run.smithi155.stdout: }, 2023-08-01T19:54:47.025 INFO:teuthology.orchestra.run.smithi155.stdout: { 2023-08-01T19:54:47.025 INFO:teuthology.orchestra.run.smithi155.stdout: "event": "dispatched", 2023-08-01T19:54:47.025 INFO:teuthology.orchestra.run.smithi155.stdout: "time": "2023-08-01T19:54:46.941855+0000", 2023-08-01T19:54:47.026 INFO:teuthology.orchestra.run.smithi155.stdout: "duration": 1.2996000000000001e-05 2023-08-01T19:54:47.026 INFO:teuthology.orchestra.run.smithi155.stdout: }, 2023-08-01T19:54:47.026 INFO:teuthology.orchestra.run.smithi155.stdout: { 2023-08-01T19:54:47.026 INFO:teuthology.orchestra.run.smithi155.stdout: "event": "queued_for_pg", 2023-08-01T19:54:47.026 INFO:teuthology.orchestra.run.smithi155.stdout: "time": "2023-08-01T19:54:46.941860+0000", 2023-08-01T19:54:47.026 INFO:teuthology.orchestra.run.smithi155.stdout: "duration": 5.2399999999999998e-06 2023-08-01T19:54:47.026 INFO:teuthology.orchestra.run.smithi155.stdout: }, 2023-08-01T19:54:47.026 INFO:teuthology.orchestra.run.smithi155.stdout: { 2023-08-01T19:54:47.027 INFO:teuthology.orchestra.run.smithi155.stdout: "event": "reached_pg", 2023-08-01T19:54:47.027 INFO:teuthology.orchestra.run.smithi155.stdout: "time": "2023-08-01T19:54:46.941902+0000", 2023-08-01T19:54:47.027 INFO:teuthology.orchestra.run.smithi155.stdout: "duration": 4.2302000000000003e-05 2023-08-01T19:54:47.027 INFO:teuthology.orchestra.run.smithi155.stdout: }, 2023-08-01T19:54:47.027 INFO:teuthology.orchestra.run.smithi155.stdout: { 2023-08-01T19:54:47.027 INFO:teuthology.orchestra.run.smithi155.stdout: "event": "started", 2023-08-01T19:54:47.027 INFO:teuthology.orchestra.run.smithi155.stdout: "time": "2023-08-01T19:54:46.941923+0000", 2023-08-01T19:54:47.027 INFO:teuthology.orchestra.run.smithi155.stdout: "duration": 2.1146999999999999e-05 2023-08-01T19:54:47.028 INFO:teuthology.orchestra.run.smithi155.stdout: } 2023-08-01T19:54:47.028 INFO:teuthology.orchestra.run.smithi155.stdout: ] 2023-08-01T19:54:47.028 INFO:teuthology.orchestra.run.smithi155.stdout: } 2023-08-01T19:54:47.028 INFO:teuthology.orchestra.run.smithi155.stdout: } 2023-08-01T19:54:47.028 INFO:teuthology.orchestra.run.smithi155.stdout: ], 2023-08-01T19:54:47.028 INFO:teuthology.orchestra.run.smithi155.stdout: "num_ops": 12 2023-08-01T19:54:47.028 INFO:teuthology.orchestra.run.smithi155.stdout:} 2023-08-01T19:54:47.029 DEBUG:teuthology.orchestra.run.smithi155:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 30 ceph --cluster ceph --admin-daemon /var/run/ceph/ceph-osd.2.asok dump_blocked_ops 2023-08-01T19:54:47.030 INFO:tasks.ceph.osd.2.smithi155.stderr:2023-08-01T19:54:47.028+0000 7faa5c6ac700 -1 received signal: Hangup from /usr/bin/python3 /bin/daemon-helper kill ceph-osd -f --cluster ceph -i 2 (PID: 111337) UID: 0 2023-08-01T19:54:47.130 INFO:tasks.ceph.osd.0.smithi008.stderr:2023-08-01T19:54:47.129+0000 7f16a58f4700 -1 received signal: Hangup from /usr/bin/python3 /bin/daemon-helper kill ceph-osd -f --cluster ceph -i 0 (PID: 111179) UID: 0 2023-08-01T19:54:47.231 INFO:tasks.ceph.osd.0.smithi008.stderr:2023-08-01T19:54:47.230+0000 7f16a58f4700 -1 received signal: Hangup from /usr/bin/python3 /bin/daemon-helper kill ceph-osd -f --cluster ceph -i 0 (PID: 111179) UID: 0 2023-08-01T19:54:47.235 INFO:teuthology.orchestra.run.smithi155.stdout:{ 2023-08-01T19:54:47.236 INFO:teuthology.orchestra.run.smithi155.stdout: "ops": [], 2023-08-01T19:54:47.236 INFO:teuthology.orchestra.run.smithi155.stdout: "complaint_time": 30, 2023-08-01T19:54:47.236 INFO:teuthology.orchestra.run.smithi155.stdout: "num_blocked_ops": 0 2023-08-01T19:54:47.236 INFO:teuthology.orchestra.run.smithi155.stdout:} 2023-08-01T19:54:47.249 DEBUG:teuthology.orchestra.run.smithi155:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 30 ceph --cluster ceph --admin-daemon /var/run/ceph/ceph-osd.2.asok dump_historic_ops 2023-08-01T19:54:47.314 INFO:tasks.radosbench.radosbench.0.smithi006.stdout: 23 16 65144 65128 176.964 133.125 0.00903155 0.00564787 2023-08-01T19:54:47.332 INFO:tasks.ceph.osd.1.smithi101.stderr:2023-08-01T19:54:47.331+0000 7fb0cb7f6700 -1 received signal: Hangup from /usr/bin/python3 /bin/daemon-helper kill ceph-osd -f --cluster ceph -i 1 (PID: 111141) UID: 0 2023-08-01T19:54:47.415 INFO:teuthology.orchestra.run.smithi155.stdout:{ 2023-08-01T19:54:47.416 INFO:teuthology.orchestra.run.smithi155.stdout: "size": 20, 2023-08-01T19:54:47.416 INFO:teuthology.orchestra.run.smithi155.stdout: "duration": 600, 2023-08-01T19:54:47.416 INFO:teuthology.orchestra.run.smithi155.stdout: "ops": [ 2023-08-01T19:54:47.416 INFO:teuthology.orchestra.run.smithi155.stdout: { 2023-08-01T19:54:47.416 INFO:teuthology.orchestra.run.smithi155.stdout: "description": "osd_op(client.4668.0:18365 5.d 5:bbdb2097:::benchmark_data_smithi006_114134_object18364:head [set-alloc-hint object_size 65536 write_size 65536,write 0~65536] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e23)", 2023-08-01T19:54:47.416 INFO:teuthology.orchestra.run.smithi155.stdout: "initiated_at": "2023-08-01T19:54:28.996732+0000", 2023-08-01T19:54:47.417 INFO:teuthology.orchestra.run.smithi155.stdout: "age": 18.415757169999999, 2023-08-01T19:54:47.417 INFO:teuthology.orchestra.run.smithi155.stdout: "duration": 0.014874775999999999, 2023-08-01T19:54:47.417 INFO:teuthology.orchestra.run.smithi155.stdout: "type_data": { 2023-08-01T19:54:47.417 INFO:teuthology.orchestra.run.smithi155.stdout: "flag_point": "commit sent; apply or cleanup", 2023-08-01T19:54:47.417 INFO:teuthology.orchestra.run.smithi155.stdout: "client_info": { 2023-08-01T19:54:47.417 INFO:teuthology.orchestra.run.smithi155.stdout: "client": "client.4668", 2023-08-01T19:54:47.417 INFO:teuthology.orchestra.run.smithi155.stdout: "client_addr": "172.21.15.6:0/1709472247", 2023-08-01T19:54:47.418 INFO:teuthology.orchestra.run.smithi155.stdout: "tid": 18365 2023-08-01T19:54:47.418 INFO:teuthology.orchestra.run.smithi155.stdout: }, 2023-08-01T19:54:47.418 INFO:teuthology.orchestra.run.smithi155.stdout: "events": [ 2023-08-01T19:54:47.418 INFO:teuthology.orchestra.run.smithi155.stdout: { 2023-08-01T19:54:47.418 INFO:teuthology.orchestra.run.smithi155.stdout: "event": "initiated", 2023-08-01T19:54:47.418 INFO:teuthology.orchestra.run.smithi155.stdout: "time": "2023-08-01T19:54:28.996732+0000", 2023-08-01T19:54:47.418 INFO:teuthology.orchestra.run.smithi155.stdout: "duration": 0 2023-08-01T19:54:47.418 INFO:teuthology.orchestra.run.smithi155.stdout: }, 2023-08-01T19:54:47.419 INFO:teuthology.orchestra.run.smithi155.stdout: { 2023-08-01T19:54:47.419 INFO:teuthology.orchestra.run.smithi155.stdout: "event": "throttled", 2023-08-01T19:54:47.419 INFO:teuthology.orchestra.run.smithi155.stdout: "time": "2023-08-01T19:54:28.996732+0000", 2023-08-01T19:54:47.419 INFO:teuthology.orchestra.run.smithi155.stdout: "duration": 0 2023-08-01T19:54:47.419 INFO:teuthology.orchestra.run.smithi155.stdout: }, 2023-08-01T19:54:47.419 INFO:teuthology.orchestra.run.smithi155.stdout: { 2023-08-01T19:54:47.419 INFO:teuthology.orchestra.run.smithi155.stdout: "event": "header_read", 2023-08-01T19:54:47.420 INFO:teuthology.orchestra.run.smithi155.stdout: "time": "2023-08-01T19:54:28.996731+0000", 2023-08-01T19:54:47.420 INFO:teuthology.orchestra.run.smithi155.stdout: "duration": 4294967295.999999 2023-08-01T19:54:47.420 INFO:teuthology.orchestra.run.smithi155.stdout: }, 2023-08-01T19:54:47.420 INFO:teuthology.orchestra.run.smithi155.stdout: { 2023-08-01T19:54:47.420 INFO:teuthology.orchestra.run.smithi155.stdout: "event": "all_read", 2023-08-01T19:54:47.420 INFO:teuthology.orchestra.run.smithi155.stdout: "time": "2023-08-01T19:54:28.996931+0000", 2023-08-01T19:54:47.420 INFO:teuthology.orchestra.run.smithi155.stdout: "duration": 0.000200206 2023-08-01T19:54:47.420 INFO:teuthology.orchestra.run.smithi155.stdout: }, 2023-08-01T19:54:47.421 INFO:teuthology.orchestra.run.smithi155.stdout: { 2023-08-01T19:54:47.421 INFO:teuthology.orchestra.run.smithi155.stdout: "event": "dispatched", 2023-08-01T19:54:47.421 INFO:teuthology.orchestra.run.smithi155.stdout: "time": "2023-08-01T19:54:28.996939+0000", 2023-08-01T19:54:47.421 INFO:teuthology.orchestra.run.smithi155.stdout: "duration": 8.1939999999999998e-06 2023-08-01T19:54:47.421 INFO:teuthology.orchestra.run.smithi155.stdout: }, 2023-08-01T19:54:47.421 INFO:teuthology.orchestra.run.smithi155.stdout: { 2023-08-01T19:54:47.421 INFO:teuthology.orchestra.run.smithi155.stdout: "event": "queued_for_pg", 2023-08-01T19:54:47.422 INFO:teuthology.orchestra.run.smithi155.stdout: "time": "2023-08-01T19:54:28.996943+0000", 2023-08-01T19:54:47.422 INFO:teuthology.orchestra.run.smithi155.stdout: "duration": 3.7019999999999999e-06 2023-08-01T19:54:47.422 INFO:teuthology.orchestra.run.smithi155.stdout: }, 2023-08-01T19:54:47.422 INFO:teuthology.orchestra.run.smithi155.stdout: { 2023-08-01T19:54:47.422 INFO:teuthology.orchestra.run.smithi155.stdout: "event": "reached_pg", 2023-08-01T19:54:47.422 INFO:teuthology.orchestra.run.smithi155.stdout: "time": "2023-08-01T19:54:28.996975+0000", 2023-08-01T19:54:47.422 INFO:teuthology.orchestra.run.smithi155.stdout: "duration": 3.1609999999999997e-05 2023-08-01T19:54:47.422 INFO:teuthology.orchestra.run.smithi155.stdout: }, 2023-08-01T19:54:47.423 INFO:teuthology.orchestra.run.smithi155.stdout: { 2023-08-01T19:54:47.423 INFO:teuthology.orchestra.run.smithi155.stdout: "event": "started", 2023-08-01T19:54:47.423 INFO:teuthology.orchestra.run.smithi155.stdout: "time": "2023-08-01T19:54:28.997086+0000", 2023-08-01T19:54:47.423 INFO:teuthology.orchestra.run.smithi155.stdout: "duration": 0.000111329 2023-08-01T19:54:47.423 INFO:teuthology.orchestra.run.smithi155.stdout: }, 2023-08-01T19:54:47.423 INFO:teuthology.orchestra.run.smithi155.stdout: { 2023-08-01T19:54:47.423 INFO:teuthology.orchestra.run.smithi155.stdout: "event": "waiting for subops from 1", 2023-08-01T19:54:47.423 INFO:teuthology.orchestra.run.smithi155.stdout: "time": "2023-08-01T19:54:28.997220+0000", 2023-08-01T19:54:47.424 INFO:teuthology.orchestra.run.smithi155.stdout: "duration": 0.000134296 2023-08-01T19:54:47.424 INFO:teuthology.orchestra.run.smithi155.stdout: }, 2023-08-01T19:54:47.424 INFO:teuthology.orchestra.run.smithi155.stdout: { 2023-08-01T19:54:47.424 INFO:teuthology.orchestra.run.smithi155.stdout: "event": "op_commit", 2023-08-01T19:54:47.424 INFO:teuthology.orchestra.run.smithi155.stdout: "time": "2023-08-01T19:54:28.998580+0000", 2023-08-01T19:54:47.424 INFO:teuthology.orchestra.run.smithi155.stdout: "duration": 0.001359493 2023-08-01T19:54:47.424 INFO:teuthology.orchestra.run.smithi155.stdout: }, 2023-08-01T19:54:47.425 INFO:teuthology.orchestra.run.smithi155.stdout: { 2023-08-01T19:54:47.425 INFO:teuthology.orchestra.run.smithi155.stdout: "event": "sub_op_commit_rec", 2023-08-01T19:54:47.425 INFO:teuthology.orchestra.run.smithi155.stdout: "time": "2023-08-01T19:54:29.011542+0000", 2023-08-01T19:54:47.425 INFO:teuthology.orchestra.run.smithi155.stdout: "duration": 0.012962815000000001 2023-08-01T19:54:47.425 INFO:teuthology.orchestra.run.smithi155.stdout: }, 2023-08-01T19:54:47.425 INFO:teuthology.orchestra.run.smithi155.stdout: { 2023-08-01T19:54:47.425 INFO:teuthology.orchestra.run.smithi155.stdout: "event": "commit_sent", 2023-08-01T19:54:47.425 INFO:teuthology.orchestra.run.smithi155.stdout: "time": "2023-08-01T19:54:29.011572+0000", 2023-08-01T19:54:47.426 INFO:teuthology.orchestra.run.smithi155.stdout: "duration": 2.9451999999999999e-05 2023-08-01T19:54:47.426 INFO:teuthology.orchestra.run.smithi155.stdout: }, 2023-08-01T19:54:47.426 INFO:teuthology.orchestra.run.smithi155.stdout: { 2023-08-01T19:54:47.426 INFO:teuthology.orchestra.run.smithi155.stdout: "event": "done", 2023-08-01T19:54:47.426 INFO:teuthology.orchestra.run.smithi155.stdout: "time": "2023-08-01T19:54:29.011607+0000", 2023-08-01T19:54:47.426 INFO:teuthology.orchestra.run.smithi155.stdout: "duration": 3.4628000000000001e-05 2023-08-01T19:54:47.426 INFO:teuthology.orchestra.run.smithi155.stdout: } 2023-08-01T19:54:47.426 INFO:teuthology.orchestra.run.smithi155.stdout: ] 2023-08-01T19:54:47.427 INFO:teuthology.orchestra.run.smithi155.stdout: } 2023-08-01T19:54:47.427 INFO:teuthology.orchestra.run.smithi155.stdout: }, 2023-08-01T19:54:47.427 INFO:teuthology.orchestra.run.smithi155.stdout: { 2023-08-01T19:54:47.427 INFO:teuthology.orchestra.run.smithi155.stdout: "description": "osd_op(client.4668.0:31683 5.d 5:be764a02:::benchmark_data_smithi006_114134_object31682:head [set-alloc-hint object_size 65536 write_size 65536,write 0~65536] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e24)", 2023-08-01T19:54:47.427 INFO:teuthology.orchestra.run.smithi155.stdout: "initiated_at": "2023-08-01T19:54:33.229635+0000", 2023-08-01T19:54:47.427 INFO:teuthology.orchestra.run.smithi155.stdout: "age": 14.182853578, 2023-08-01T19:54:47.427 INFO:teuthology.orchestra.run.smithi155.stdout: "duration": 0.015494648, 2023-08-01T19:54:47.427 INFO:teuthology.orchestra.run.smithi155.stdout: "type_data": { 2023-08-01T19:54:47.428 INFO:teuthology.orchestra.run.smithi155.stdout: "flag_point": "commit sent; apply or cleanup", 2023-08-01T19:54:47.428 INFO:teuthology.orchestra.run.smithi155.stdout: "client_info": { 2023-08-01T19:54:47.428 INFO:teuthology.orchestra.run.smithi155.stdout: "client": "client.4668", 2023-08-01T19:54:47.428 INFO:teuthology.orchestra.run.smithi155.stdout: "client_addr": "172.21.15.6:0/1709472247", 2023-08-01T19:54:47.428 INFO:teuthology.orchestra.run.smithi155.stdout: "tid": 31683 2023-08-01T19:54:47.428 INFO:teuthology.orchestra.run.smithi155.stdout: }, 2023-08-01T19:54:47.428 INFO:teuthology.orchestra.run.smithi155.stdout: "events": [ 2023-08-01T19:54:47.428 INFO:teuthology.orchestra.run.smithi155.stdout: { 2023-08-01T19:54:47.429 INFO:teuthology.orchestra.run.smithi155.stdout: "event": "initiated", 2023-08-01T19:54:47.429 INFO:teuthology.orchestra.run.smithi155.stdout: "time": "2023-08-01T19:54:33.229635+0000", 2023-08-01T19:54:47.429 INFO:teuthology.orchestra.run.smithi155.stdout: "duration": 0 2023-08-01T19:54:47.429 INFO:teuthology.orchestra.run.smithi155.stdout: }, 2023-08-01T19:54:47.429 INFO:teuthology.orchestra.run.smithi155.stdout: { 2023-08-01T19:54:47.429 INFO:teuthology.orchestra.run.smithi155.stdout: "event": "throttled", 2023-08-01T19:54:47.429 INFO:teuthology.orchestra.run.smithi155.stdout: "time": "2023-08-01T19:54:33.229635+0000", 2023-08-01T19:54:47.430 INFO:teuthology.orchestra.run.smithi155.stdout: "duration": 0 2023-08-01T19:54:47.430 INFO:teuthology.orchestra.run.smithi155.stdout: }, 2023-08-01T19:54:47.430 INFO:teuthology.orchestra.run.smithi155.stdout: { 2023-08-01T19:54:47.430 INFO:teuthology.orchestra.run.smithi155.stdout: "event": "header_read", 2023-08-01T19:54:47.430 INFO:teuthology.orchestra.run.smithi155.stdout: "time": "2023-08-01T19:54:33.229635+0000", 2023-08-01T19:54:47.430 INFO:teuthology.orchestra.run.smithi155.stdout: "duration": 4294967295.9999995 2023-08-01T19:54:47.430 INFO:teuthology.orchestra.run.smithi155.stdout: }, 2023-08-01T19:54:47.430 INFO:teuthology.orchestra.run.smithi155.stdout: { 2023-08-01T19:54:47.431 INFO:teuthology.orchestra.run.smithi155.stdout: "event": "all_read", 2023-08-01T19:54:47.431 INFO:teuthology.orchestra.run.smithi155.stdout: "time": "2023-08-01T19:54:33.229723+0000", 2023-08-01T19:54:47.431 INFO:teuthology.orchestra.run.smithi155.stdout: "duration": 8.7983000000000001e-05 2023-08-01T19:54:47.431 INFO:teuthology.orchestra.run.smithi155.stdout: }, 2023-08-01T19:54:47.431 INFO:teuthology.orchestra.run.smithi155.stdout: { 2023-08-01T19:54:47.431 INFO:teuthology.orchestra.run.smithi155.stdout: "event": "dispatched", 2023-08-01T19:54:47.431 INFO:teuthology.orchestra.run.smithi155.stdout: "time": "2023-08-01T19:54:33.229728+0000", 2023-08-01T19:54:47.431 INFO:teuthology.orchestra.run.smithi155.stdout: "duration": 5.2830000000000001e-06 2023-08-01T19:54:47.432 INFO:teuthology.orchestra.run.smithi155.stdout: }, 2023-08-01T19:54:47.432 INFO:teuthology.orchestra.run.smithi155.stdout: { 2023-08-01T19:54:47.432 INFO:teuthology.orchestra.run.smithi155.stdout: "event": "queued_for_pg", 2023-08-01T19:54:47.432 INFO:teuthology.orchestra.run.smithi155.stdout: "time": "2023-08-01T19:54:33.229732+0000", 2023-08-01T19:54:47.432 INFO:teuthology.orchestra.run.smithi155.stdout: "duration": 4.0990000000000001e-06 2023-08-01T19:54:47.432 INFO:teuthology.orchestra.run.smithi155.stdout: }, 2023-08-01T19:54:47.432 INFO:teuthology.orchestra.run.smithi155.stdout: { 2023-08-01T19:54:47.432 INFO:teuthology.orchestra.run.smithi155.stdout: "event": "reached_pg", 2023-08-01T19:54:47.433 INFO:teuthology.orchestra.run.smithi155.stdout: "time": "2023-08-01T19:54:33.229762+0000", 2023-08-01T19:54:47.433 INFO:teuthology.orchestra.run.smithi155.stdout: "duration": 3.0161000000000001e-05 2023-08-01T19:54:47.433 INFO:teuthology.orchestra.run.smithi155.stdout: }, 2023-08-01T19:54:47.433 INFO:teuthology.orchestra.run.smithi155.stdout: { 2023-08-01T19:54:47.433 INFO:teuthology.orchestra.run.smithi155.stdout: "event": "started", 2023-08-01T19:54:47.433 INFO:teuthology.orchestra.run.smithi155.stdout: "time": "2023-08-01T19:54:33.229840+0000", 2023-08-01T19:54:47.433 INFO:teuthology.orchestra.run.smithi155.stdout: "duration": 7.8059000000000006e-05 2023-08-01T19:54:47.433 INFO:teuthology.orchestra.run.smithi155.stdout: }, 2023-08-01T19:54:47.434 INFO:teuthology.orchestra.run.smithi155.stdout: { 2023-08-01T19:54:47.434 INFO:teuthology.orchestra.run.smithi155.stdout: "event": "waiting for subops from 1", 2023-08-01T19:54:47.434 INFO:teuthology.orchestra.run.smithi155.stdout: "time": "2023-08-01T19:54:33.229924+0000", 2023-08-01T19:54:47.434 INFO:teuthology.orchestra.run.smithi155.stdout: "duration": 8.3444999999999998e-05 2023-08-01T19:54:47.434 INFO:teuthology.orchestra.run.smithi155.stdout: }, 2023-08-01T19:54:47.434 INFO:teuthology.orchestra.run.smithi155.stdout: { 2023-08-01T19:54:47.434 INFO:teuthology.orchestra.run.smithi155.stdout: "event": "op_commit", 2023-08-01T19:54:47.434 INFO:teuthology.orchestra.run.smithi155.stdout: "time": "2023-08-01T19:54:33.234514+0000", 2023-08-01T19:54:47.435 INFO:teuthology.orchestra.run.smithi155.stdout: "duration": 0.0045896890000000001 2023-08-01T19:54:47.435 INFO:teuthology.orchestra.run.smithi155.stdout: }, 2023-08-01T19:54:47.435 INFO:teuthology.orchestra.run.smithi155.stdout: { 2023-08-01T19:54:47.435 INFO:teuthology.orchestra.run.smithi155.stdout: "event": "sub_op_commit_rec", 2023-08-01T19:54:47.435 INFO:teuthology.orchestra.run.smithi155.stdout: "time": "2023-08-01T19:54:33.245069+0000", 2023-08-01T19:54:47.435 INFO:teuthology.orchestra.run.smithi155.stdout: "duration": 0.01055566 2023-08-01T19:54:47.435 INFO:teuthology.orchestra.run.smithi155.stdout: }, 2023-08-01T19:54:47.435 INFO:teuthology.orchestra.run.smithi155.stdout: { 2023-08-01T19:54:47.436 INFO:teuthology.orchestra.run.smithi155.stdout: "event": "commit_sent", 2023-08-01T19:54:47.436 INFO:teuthology.orchestra.run.smithi155.stdout: "time": "2023-08-01T19:54:33.245102+0000", 2023-08-01T19:54:47.436 INFO:teuthology.orchestra.run.smithi155.stdout: "duration": 3.3025999999999999e-05 2023-08-01T19:54:47.436 INFO:teuthology.orchestra.run.smithi155.stdout: }, 2023-08-01T19:54:47.436 INFO:teuthology.orchestra.run.smithi155.stdout: { 2023-08-01T19:54:47.436 INFO:teuthology.orchestra.run.smithi155.stdout: "event": "done", 2023-08-01T19:54:47.436 INFO:teuthology.orchestra.run.smithi155.stdout: "time": "2023-08-01T19:54:33.245130+0000", 2023-08-01T19:54:47.437 INFO:teuthology.orchestra.run.smithi155.stdout: "duration": 2.7818e-05 2023-08-01T19:54:47.437 INFO:teuthology.orchestra.run.smithi155.stdout: } 2023-08-01T19:54:47.437 INFO:teuthology.orchestra.run.smithi155.stdout: ] 2023-08-01T19:54:47.437 INFO:teuthology.orchestra.run.smithi155.stdout: } 2023-08-01T19:54:47.437 INFO:teuthology.orchestra.run.smithi155.stdout: }, 2023-08-01T19:54:47.437 INFO:teuthology.orchestra.run.smithi155.stdout: { 2023-08-01T19:54:47.437 INFO:teuthology.orchestra.run.smithi155.stdout: "description": "osd_op(client.4668.0:33935 5.e 5:71b9621b:::benchmark_data_smithi006_114134_object33934:head [set-alloc-hint object_size 65536 write_size 65536,write 0~65536] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e24)", 2023-08-01T19:54:47.437 INFO:teuthology.orchestra.run.smithi155.stdout: "initiated_at": "2023-08-01T19:54:34.001558+0000", 2023-08-01T19:54:47.438 INFO:teuthology.orchestra.run.smithi155.stdout: "age": 13.410931153, 2023-08-01T19:54:47.438 INFO:teuthology.orchestra.run.smithi155.stdout: "duration": 0.015838234, 2023-08-01T19:54:47.438 INFO:teuthology.orchestra.run.smithi155.stdout: "type_data": { 2023-08-01T19:54:47.438 INFO:teuthology.orchestra.run.smithi155.stdout: "flag_point": "commit sent; apply or cleanup", 2023-08-01T19:54:47.438 INFO:teuthology.orchestra.run.smithi155.stdout: "client_info": { 2023-08-01T19:54:47.438 INFO:teuthology.orchestra.run.smithi155.stdout: "client": "client.4668", 2023-08-01T19:54:47.438 INFO:teuthology.orchestra.run.smithi155.stdout: "client_addr": "172.21.15.6:0/1709472247", 2023-08-01T19:54:47.438 INFO:teuthology.orchestra.run.smithi155.stdout: "tid": 33935 2023-08-01T19:54:47.439 INFO:teuthology.orchestra.run.smithi155.stdout: }, 2023-08-01T19:54:47.439 INFO:teuthology.orchestra.run.smithi155.stdout: "events": [ 2023-08-01T19:54:47.439 INFO:teuthology.orchestra.run.smithi155.stdout: { 2023-08-01T19:54:47.439 INFO:teuthology.orchestra.run.smithi155.stdout: "event": "initiated", 2023-08-01T19:54:47.439 INFO:teuthology.orchestra.run.smithi155.stdout: "time": "2023-08-01T19:54:34.001558+0000", 2023-08-01T19:54:47.439 INFO:teuthology.orchestra.run.smithi155.stdout: "duration": 0 2023-08-01T19:54:47.439 INFO:teuthology.orchestra.run.smithi155.stdout: }, 2023-08-01T19:54:47.439 INFO:teuthology.orchestra.run.smithi155.stdout: { 2023-08-01T19:54:47.440 INFO:teuthology.orchestra.run.smithi155.stdout: "event": "throttled", 2023-08-01T19:54:47.440 INFO:teuthology.orchestra.run.smithi155.stdout: "time": "2023-08-01T19:54:34.001558+0000", 2023-08-01T19:54:47.440 INFO:teuthology.orchestra.run.smithi155.stdout: "duration": 0 2023-08-01T19:54:47.440 INFO:teuthology.orchestra.run.smithi155.stdout: }, 2023-08-01T19:54:47.440 INFO:teuthology.orchestra.run.smithi155.stdout: { 2023-08-01T19:54:47.440 INFO:teuthology.orchestra.run.smithi155.stdout: "event": "header_read", 2023-08-01T19:54:47.440 INFO:teuthology.orchestra.run.smithi155.stdout: "time": "2023-08-01T19:54:34.001557+0000", 2023-08-01T19:54:47.441 INFO:teuthology.orchestra.run.smithi155.stdout: "duration": 4294967295.9999995 2023-08-01T19:54:47.441 INFO:teuthology.orchestra.run.smithi155.stdout: }, 2023-08-01T19:54:47.441 INFO:teuthology.orchestra.run.smithi155.stdout: { 2023-08-01T19:54:47.441 INFO:teuthology.orchestra.run.smithi155.stdout: "event": "all_read", 2023-08-01T19:54:47.441 INFO:teuthology.orchestra.run.smithi155.stdout: "time": "2023-08-01T19:54:34.001620+0000", 2023-08-01T19:54:47.441 INFO:teuthology.orchestra.run.smithi155.stdout: "duration": 6.2751999999999998e-05 2023-08-01T19:54:47.441 INFO:teuthology.orchestra.run.smithi155.stdout: }, 2023-08-01T19:54:47.441 INFO:teuthology.orchestra.run.smithi155.stdout: { 2023-08-01T19:54:47.442 INFO:teuthology.orchestra.run.smithi155.stdout: "event": "dispatched", 2023-08-01T19:54:47.442 INFO:teuthology.orchestra.run.smithi155.stdout: "time": "2023-08-01T19:54:34.001632+0000", 2023-08-01T19:54:47.442 INFO:teuthology.orchestra.run.smithi155.stdout: "duration": 1.1731e-05 2023-08-01T19:54:47.442 INFO:teuthology.orchestra.run.smithi155.stdout: }, 2023-08-01T19:54:47.442 INFO:teuthology.orchestra.run.smithi155.stdout: { 2023-08-01T19:54:47.442 INFO:teuthology.orchestra.run.smithi155.stdout: "event": "queued_for_pg", 2023-08-01T19:54:47.442 INFO:teuthology.orchestra.run.smithi155.stdout: "time": "2023-08-01T19:54:34.001635+0000", 2023-08-01T19:54:47.442 INFO:teuthology.orchestra.run.smithi155.stdout: "duration": 3.7859999999999998e-06 2023-08-01T19:54:47.443 INFO:teuthology.orchestra.run.smithi155.stdout: }, 2023-08-01T19:54:47.443 INFO:teuthology.orchestra.run.smithi155.stdout: { 2023-08-01T19:54:47.443 INFO:teuthology.orchestra.run.smithi155.stdout: "event": "reached_pg", 2023-08-01T19:54:47.443 INFO:teuthology.orchestra.run.smithi155.stdout: "time": "2023-08-01T19:54:34.001688+0000", 2023-08-01T19:54:47.443 INFO:teuthology.orchestra.run.smithi155.stdout: "duration": 5.2899000000000003e-05 2023-08-01T19:54:47.443 INFO:teuthology.orchestra.run.smithi155.stdout: }, 2023-08-01T19:54:47.443 INFO:teuthology.orchestra.run.smithi155.stdout: { 2023-08-01T19:54:47.443 INFO:teuthology.orchestra.run.smithi155.stdout: "event": "started", 2023-08-01T19:54:47.444 INFO:teuthology.orchestra.run.smithi155.stdout: "time": "2023-08-01T19:54:34.001838+0000", 2023-08-01T19:54:47.444 INFO:teuthology.orchestra.run.smithi155.stdout: "duration": 0.00015003999999999999 2023-08-01T19:54:47.444 INFO:teuthology.orchestra.run.smithi155.stdout: }, 2023-08-01T19:54:47.444 INFO:teuthology.orchestra.run.smithi155.stdout: { 2023-08-01T19:54:47.444 INFO:teuthology.orchestra.run.smithi155.stdout: "event": "waiting for subops from 0", 2023-08-01T19:54:47.444 INFO:teuthology.orchestra.run.smithi155.stdout: "time": "2023-08-01T19:54:34.001972+0000", 2023-08-01T19:54:47.444 INFO:teuthology.orchestra.run.smithi155.stdout: "duration": 0.00013333799999999999 2023-08-01T19:54:47.444 INFO:teuthology.orchestra.run.smithi155.stdout: }, 2023-08-01T19:54:47.445 INFO:teuthology.orchestra.run.smithi155.stdout: { 2023-08-01T19:54:47.445 INFO:teuthology.orchestra.run.smithi155.stdout: "event": "sub_op_commit_rec", 2023-08-01T19:54:47.445 INFO:teuthology.orchestra.run.smithi155.stdout: "time": "2023-08-01T19:54:34.005385+0000", 2023-08-01T19:54:47.445 INFO:teuthology.orchestra.run.smithi155.stdout: "duration": 0.003413611 2023-08-01T19:54:47.445 INFO:teuthology.orchestra.run.smithi155.stdout: }, 2023-08-01T19:54:47.445 INFO:teuthology.orchestra.run.smithi155.stdout: { 2023-08-01T19:54:47.445 INFO:teuthology.orchestra.run.smithi155.stdout: "event": "op_commit", 2023-08-01T19:54:47.445 INFO:teuthology.orchestra.run.smithi155.stdout: "time": "2023-08-01T19:54:34.017300+0000", 2023-08-01T19:54:47.446 INFO:teuthology.orchestra.run.smithi155.stdout: "duration": 0.011914645 2023-08-01T19:54:47.446 INFO:teuthology.orchestra.run.smithi155.stdout: }, 2023-08-01T19:54:47.446 INFO:teuthology.orchestra.run.smithi155.stdout: { 2023-08-01T19:54:47.446 INFO:teuthology.orchestra.run.smithi155.stdout: "event": "commit_sent", 2023-08-01T19:54:47.446 INFO:teuthology.orchestra.run.smithi155.stdout: "time": "2023-08-01T19:54:34.017355+0000", 2023-08-01T19:54:47.446 INFO:teuthology.orchestra.run.smithi155.stdout: "duration": 5.5084999999999999e-05 2023-08-01T19:54:47.446 INFO:teuthology.orchestra.run.smithi155.stdout: }, 2023-08-01T19:54:47.447 INFO:teuthology.orchestra.run.smithi155.stdout: { 2023-08-01T19:54:47.447 INFO:teuthology.orchestra.run.smithi155.stdout: "event": "done", 2023-08-01T19:54:47.447 INFO:teuthology.orchestra.run.smithi155.stdout: "time": "2023-08-01T19:54:34.017396+0000", 2023-08-01T19:54:47.447 INFO:teuthology.orchestra.run.smithi155.stdout: "duration": 4.1004999999999998e-05 2023-08-01T19:54:47.447 INFO:teuthology.orchestra.run.smithi155.stdout: } 2023-08-01T19:54:47.447 INFO:teuthology.orchestra.run.smithi155.stdout: ] 2023-08-01T19:54:47.447 INFO:teuthology.orchestra.run.smithi155.stdout: } 2023-08-01T19:54:47.447 INFO:teuthology.orchestra.run.smithi155.stdout: }, 2023-08-01T19:54:47.448 INFO:teuthology.orchestra.run.smithi155.stdout: { 2023-08-01T19:54:47.448 INFO:teuthology.orchestra.run.smithi155.stdout: "description": "osd_op(client.4668.0:33937 5.4 5:20710eb3:::benchmark_data_smithi006_114134_object33936:head [set-alloc-hint object_size 65536 write_size 65536,write 0~65536] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e24)", 2023-08-01T19:54:47.448 INFO:teuthology.orchestra.run.smithi155.stdout: "initiated_at": "2023-08-01T19:54:34.001682+0000", 2023-08-01T19:54:47.448 INFO:teuthology.orchestra.run.smithi155.stdout: "age": 13.410807242000001, 2023-08-01T19:54:47.448 INFO:teuthology.orchestra.run.smithi155.stdout: "duration": 0.015739876, 2023-08-01T19:54:47.448 INFO:teuthology.orchestra.run.smithi155.stdout: "type_data": { 2023-08-01T19:54:47.448 INFO:teuthology.orchestra.run.smithi155.stdout: "flag_point": "commit sent; apply or cleanup", 2023-08-01T19:54:47.448 INFO:teuthology.orchestra.run.smithi155.stdout: "client_info": { 2023-08-01T19:54:47.449 INFO:teuthology.orchestra.run.smithi155.stdout: "client": "client.4668", 2023-08-01T19:54:47.449 INFO:teuthology.orchestra.run.smithi155.stdout: "client_addr": "172.21.15.6:0/1709472247", 2023-08-01T19:54:47.449 INFO:teuthology.orchestra.run.smithi155.stdout: "tid": 33937 2023-08-01T19:54:47.449 INFO:teuthology.orchestra.run.smithi155.stdout: }, 2023-08-01T19:54:47.449 INFO:teuthology.orchestra.run.smithi155.stdout: "events": [ 2023-08-01T19:54:47.449 INFO:teuthology.orchestra.run.smithi155.stdout: { 2023-08-01T19:54:47.449 INFO:teuthology.orchestra.run.smithi155.stdout: "event": "initiated", 2023-08-01T19:54:47.449 INFO:teuthology.orchestra.run.smithi155.stdout: "time": "2023-08-01T19:54:34.001682+0000", 2023-08-01T19:54:47.450 INFO:teuthology.orchestra.run.smithi155.stdout: "duration": 0 2023-08-01T19:54:47.450 INFO:teuthology.orchestra.run.smithi155.stdout: }, 2023-08-01T19:54:47.450 INFO:teuthology.orchestra.run.smithi155.stdout: { 2023-08-01T19:54:47.450 INFO:teuthology.orchestra.run.smithi155.stdout: "event": "throttled", 2023-08-01T19:54:47.450 INFO:teuthology.orchestra.run.smithi155.stdout: "time": "2023-08-01T19:54:34.001682+0000", 2023-08-01T19:54:47.450 INFO:teuthology.orchestra.run.smithi155.stdout: "duration": 0 2023-08-01T19:54:47.450 INFO:teuthology.orchestra.run.smithi155.stdout: }, 2023-08-01T19:54:47.450 INFO:teuthology.orchestra.run.smithi155.stdout: { 2023-08-01T19:54:47.451 INFO:teuthology.orchestra.run.smithi155.stdout: "event": "header_read", 2023-08-01T19:54:47.451 INFO:teuthology.orchestra.run.smithi155.stdout: "time": "2023-08-01T19:54:34.001681+0000", 2023-08-01T19:54:47.451 INFO:teuthology.orchestra.run.smithi155.stdout: "duration": 4294967295.999999 2023-08-01T19:54:47.451 INFO:teuthology.orchestra.run.smithi155.stdout: }, 2023-08-01T19:54:47.451 INFO:teuthology.orchestra.run.smithi155.stdout: { 2023-08-01T19:54:47.451 INFO:teuthology.orchestra.run.smithi155.stdout: "event": "all_read", 2023-08-01T19:54:47.451 INFO:teuthology.orchestra.run.smithi155.stdout: "time": "2023-08-01T19:54:34.001750+0000", 2023-08-01T19:54:47.451 INFO:teuthology.orchestra.run.smithi155.stdout: "duration": 6.9484000000000001e-05 2023-08-01T19:54:47.452 INFO:teuthology.orchestra.run.smithi155.stdout: }, 2023-08-01T19:54:47.452 INFO:teuthology.orchestra.run.smithi155.stdout: { 2023-08-01T19:54:47.452 INFO:teuthology.orchestra.run.smithi155.stdout: "event": "dispatched", 2023-08-01T19:54:47.452 INFO:teuthology.orchestra.run.smithi155.stdout: "time": "2023-08-01T19:54:34.001759+0000", 2023-08-01T19:54:47.452 INFO:teuthology.orchestra.run.smithi155.stdout: "duration": 8.7260000000000008e-06 2023-08-01T19:54:47.452 INFO:teuthology.orchestra.run.smithi155.stdout: }, 2023-08-01T19:54:47.452 INFO:teuthology.orchestra.run.smithi155.stdout: { 2023-08-01T19:54:47.453 INFO:teuthology.orchestra.run.smithi155.stdout: "event": "queued_for_pg", 2023-08-01T19:54:47.453 INFO:teuthology.orchestra.run.smithi155.stdout: "time": "2023-08-01T19:54:34.001765+0000", 2023-08-01T19:54:47.453 INFO:teuthology.orchestra.run.smithi155.stdout: "duration": 5.5879999999999997e-06 2023-08-01T19:54:47.453 INFO:teuthology.orchestra.run.smithi155.stdout: }, 2023-08-01T19:54:47.453 INFO:teuthology.orchestra.run.smithi155.stdout: { 2023-08-01T19:54:47.453 INFO:teuthology.orchestra.run.smithi155.stdout: "event": "reached_pg", 2023-08-01T19:54:47.453 INFO:teuthology.orchestra.run.smithi155.stdout: "time": "2023-08-01T19:54:34.001809+0000", 2023-08-01T19:54:47.453 INFO:teuthology.orchestra.run.smithi155.stdout: "duration": 4.4818999999999999e-05 2023-08-01T19:54:47.454 INFO:teuthology.orchestra.run.smithi155.stdout: }, 2023-08-01T19:54:47.454 INFO:teuthology.orchestra.run.smithi155.stdout: { 2023-08-01T19:54:47.454 INFO:teuthology.orchestra.run.smithi155.stdout: "event": "started", 2023-08-01T19:54:47.454 INFO:teuthology.orchestra.run.smithi155.stdout: "time": "2023-08-01T19:54:34.001925+0000", 2023-08-01T19:54:47.454 INFO:teuthology.orchestra.run.smithi155.stdout: "duration": 0.000116112 2023-08-01T19:54:47.454 INFO:teuthology.orchestra.run.smithi155.stdout: }, 2023-08-01T19:54:47.454 INFO:teuthology.orchestra.run.smithi155.stdout: { 2023-08-01T19:54:47.454 INFO:teuthology.orchestra.run.smithi155.stdout: "event": "waiting for subops from 0", 2023-08-01T19:54:47.455 INFO:teuthology.orchestra.run.smithi155.stdout: "time": "2023-08-01T19:54:34.002046+0000", 2023-08-01T19:54:47.455 INFO:teuthology.orchestra.run.smithi155.stdout: "duration": 0.000120926 2023-08-01T19:54:47.455 INFO:teuthology.orchestra.run.smithi155.stdout: }, 2023-08-01T19:54:47.455 INFO:teuthology.orchestra.run.smithi155.stdout: { 2023-08-01T19:54:47.455 INFO:teuthology.orchestra.run.smithi155.stdout: "event": "sub_op_commit_rec", 2023-08-01T19:54:47.455 INFO:teuthology.orchestra.run.smithi155.stdout: "time": "2023-08-01T19:54:34.007612+0000", 2023-08-01T19:54:47.455 INFO:teuthology.orchestra.run.smithi155.stdout: "duration": 0.0055658679999999999 2023-08-01T19:54:47.455 INFO:teuthology.orchestra.run.smithi155.stdout: }, 2023-08-01T19:54:47.456 INFO:teuthology.orchestra.run.smithi155.stdout: { 2023-08-01T19:54:47.456 INFO:teuthology.orchestra.run.smithi155.stdout: "event": "op_commit", 2023-08-01T19:54:47.456 INFO:teuthology.orchestra.run.smithi155.stdout: "time": "2023-08-01T19:54:34.017331+0000", 2023-08-01T19:54:47.456 INFO:teuthology.orchestra.run.smithi155.stdout: "duration": 0.0097192330000000007 2023-08-01T19:54:47.456 INFO:teuthology.orchestra.run.smithi155.stdout: }, 2023-08-01T19:54:47.456 INFO:teuthology.orchestra.run.smithi155.stdout: { 2023-08-01T19:54:47.456 INFO:teuthology.orchestra.run.smithi155.stdout: "event": "commit_sent", 2023-08-01T19:54:47.457 INFO:teuthology.orchestra.run.smithi155.stdout: "time": "2023-08-01T19:54:34.017381+0000", 2023-08-01T19:54:47.457 INFO:teuthology.orchestra.run.smithi155.stdout: "duration": 4.9768999999999997e-05 2023-08-01T19:54:47.457 INFO:teuthology.orchestra.run.smithi155.stdout: }, 2023-08-01T19:54:47.457 INFO:teuthology.orchestra.run.smithi155.stdout: { 2023-08-01T19:54:47.457 INFO:teuthology.orchestra.run.smithi155.stdout: "event": "done", 2023-08-01T19:54:47.457 INFO:teuthology.orchestra.run.smithi155.stdout: "time": "2023-08-01T19:54:34.017422+0000", 2023-08-01T19:54:47.457 INFO:teuthology.orchestra.run.smithi155.stdout: "duration": 4.0333000000000002e-05 2023-08-01T19:54:47.457 INFO:teuthology.orchestra.run.smithi155.stdout: } 2023-08-01T19:54:47.458 INFO:teuthology.orchestra.run.smithi155.stdout: ] 2023-08-01T19:54:47.458 INFO:teuthology.orchestra.run.smithi155.stdout: } 2023-08-01T19:54:47.458 INFO:teuthology.orchestra.run.smithi155.stdout: }, 2023-08-01T19:54:47.458 INFO:teuthology.orchestra.run.smithi155.stdout: { 2023-08-01T19:54:47.458 INFO:teuthology.orchestra.run.smithi155.stdout: "description": "osd_repop(client.4668.0:33938 5.f e24/19 5:f86a7015:::benchmark_data_smithi006_114134_object33937:head v 24'2136, mlcod=24'2134)", 2023-08-01T19:54:47.458 INFO:teuthology.orchestra.run.smithi155.stdout: "initiated_at": "2023-08-01T19:54:34.002124+0000", 2023-08-01T19:54:47.458 INFO:teuthology.orchestra.run.smithi155.stdout: "age": 13.410365014, 2023-08-01T19:54:47.458 INFO:teuthology.orchestra.run.smithi155.stdout: "duration": 0.015255919, 2023-08-01T19:54:47.459 INFO:teuthology.orchestra.run.smithi155.stdout: "type_data": { 2023-08-01T19:54:47.459 INFO:teuthology.orchestra.run.smithi155.stdout: "flag_point": "commit sent; apply or cleanup", 2023-08-01T19:54:47.459 INFO:teuthology.orchestra.run.smithi155.stdout: "events": [ 2023-08-01T19:54:47.459 INFO:teuthology.orchestra.run.smithi155.stdout: { 2023-08-01T19:54:47.459 INFO:teuthology.orchestra.run.smithi155.stdout: "event": "initiated", 2023-08-01T19:54:47.459 INFO:teuthology.orchestra.run.smithi155.stdout: "time": "2023-08-01T19:54:34.002124+0000", 2023-08-01T19:54:47.459 INFO:teuthology.orchestra.run.smithi155.stdout: "duration": 0 2023-08-01T19:54:47.460 INFO:teuthology.orchestra.run.smithi155.stdout: }, 2023-08-01T19:54:47.460 INFO:teuthology.orchestra.run.smithi155.stdout: { 2023-08-01T19:54:47.460 INFO:teuthology.orchestra.run.smithi155.stdout: "event": "throttled", 2023-08-01T19:54:47.460 INFO:teuthology.orchestra.run.smithi155.stdout: "time": "2023-08-01T19:54:34.002124+0000", 2023-08-01T19:54:47.460 INFO:teuthology.orchestra.run.smithi155.stdout: "duration": 0 2023-08-01T19:54:47.460 INFO:teuthology.orchestra.run.smithi155.stdout: }, 2023-08-01T19:54:47.460 INFO:teuthology.orchestra.run.smithi155.stdout: { 2023-08-01T19:54:47.460 INFO:teuthology.orchestra.run.smithi155.stdout: "event": "header_read", 2023-08-01T19:54:47.461 INFO:teuthology.orchestra.run.smithi155.stdout: "time": "2023-08-01T19:54:34.002123+0000", 2023-08-01T19:54:47.461 INFO:teuthology.orchestra.run.smithi155.stdout: "duration": 4294967295.9999995 2023-08-01T19:54:47.461 INFO:teuthology.orchestra.run.smithi155.stdout: }, 2023-08-01T19:54:47.461 INFO:teuthology.orchestra.run.smithi155.stdout: { 2023-08-01T19:54:47.461 INFO:teuthology.orchestra.run.smithi155.stdout: "event": "all_read", 2023-08-01T19:54:47.461 INFO:teuthology.orchestra.run.smithi155.stdout: "time": "2023-08-01T19:54:34.002192+0000", 2023-08-01T19:54:47.461 INFO:teuthology.orchestra.run.smithi155.stdout: "duration": 6.8330000000000005e-05 2023-08-01T19:54:47.461 INFO:teuthology.orchestra.run.smithi155.stdout: }, 2023-08-01T19:54:47.462 INFO:teuthology.orchestra.run.smithi155.stdout: { 2023-08-01T19:54:47.462 INFO:teuthology.orchestra.run.smithi155.stdout: "event": "dispatched", 2023-08-01T19:54:47.462 INFO:teuthology.orchestra.run.smithi155.stdout: "time": "2023-08-01T19:54:34.002203+0000", 2023-08-01T19:54:47.462 INFO:teuthology.orchestra.run.smithi155.stdout: "duration": 1.152e-05 2023-08-01T19:54:47.462 INFO:teuthology.orchestra.run.smithi155.stdout: }, 2023-08-01T19:54:47.462 INFO:teuthology.orchestra.run.smithi155.stdout: { 2023-08-01T19:54:47.462 INFO:teuthology.orchestra.run.smithi155.stdout: "event": "queued_for_pg", 2023-08-01T19:54:47.462 INFO:teuthology.orchestra.run.smithi155.stdout: "time": "2023-08-01T19:54:34.002208+0000", 2023-08-01T19:54:47.463 INFO:teuthology.orchestra.run.smithi155.stdout: "duration": 5.2129999999999999e-06 2023-08-01T19:54:47.463 INFO:teuthology.orchestra.run.smithi155.stdout: }, 2023-08-01T19:54:47.463 INFO:teuthology.orchestra.run.smithi155.stdout: { 2023-08-01T19:54:47.463 INFO:teuthology.orchestra.run.smithi155.stdout: "event": "reached_pg", 2023-08-01T19:54:47.463 INFO:teuthology.orchestra.run.smithi155.stdout: "time": "2023-08-01T19:54:34.002256+0000", 2023-08-01T19:54:47.463 INFO:teuthology.orchestra.run.smithi155.stdout: "duration": 4.7939999999999998e-05 2023-08-01T19:54:47.463 INFO:teuthology.orchestra.run.smithi155.stdout: }, 2023-08-01T19:54:47.463 INFO:teuthology.orchestra.run.smithi155.stdout: { 2023-08-01T19:54:47.464 INFO:teuthology.orchestra.run.smithi155.stdout: "event": "started", 2023-08-01T19:54:47.464 INFO:teuthology.orchestra.run.smithi155.stdout: "time": "2023-08-01T19:54:34.002275+0000", 2023-08-01T19:54:47.464 INFO:teuthology.orchestra.run.smithi155.stdout: "duration": 1.8238999999999999e-05 2023-08-01T19:54:47.464 INFO:teuthology.orchestra.run.smithi155.stdout: }, 2023-08-01T19:54:47.464 INFO:teuthology.orchestra.run.smithi155.stdout: { 2023-08-01T19:54:47.464 INFO:teuthology.orchestra.run.smithi155.stdout: "event": "commit_sent", 2023-08-01T19:54:47.464 INFO:teuthology.orchestra.run.smithi155.stdout: "time": "2023-08-01T19:54:34.017345+0000", 2023-08-01T19:54:47.464 INFO:teuthology.orchestra.run.smithi155.stdout: "duration": 0.015070238 2023-08-01T19:54:47.465 INFO:teuthology.orchestra.run.smithi155.stdout: }, 2023-08-01T19:54:47.465 INFO:teuthology.orchestra.run.smithi155.stdout: { 2023-08-01T19:54:47.465 INFO:teuthology.orchestra.run.smithi155.stdout: "event": "done", 2023-08-01T19:54:47.465 INFO:teuthology.orchestra.run.smithi155.stdout: "time": "2023-08-01T19:54:34.017380+0000", 2023-08-01T19:54:47.465 INFO:teuthology.orchestra.run.smithi155.stdout: "duration": 3.5077999999999999e-05 2023-08-01T19:54:47.465 INFO:teuthology.orchestra.run.smithi155.stdout: } 2023-08-01T19:54:47.465 INFO:teuthology.orchestra.run.smithi155.stdout: ] 2023-08-01T19:54:47.466 INFO:teuthology.orchestra.run.smithi155.stdout: } 2023-08-01T19:54:47.466 INFO:teuthology.orchestra.run.smithi155.stdout: }, 2023-08-01T19:54:47.466 INFO:teuthology.orchestra.run.smithi155.stdout: { 2023-08-01T19:54:47.466 INFO:teuthology.orchestra.run.smithi155.stdout: "description": "osd_op(client.4668.0:33939 5.4 5:23f1a7ee:::benchmark_data_smithi006_114134_object33938:head [set-alloc-hint object_size 65536 write_size 65536,write 0~65536] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e24)", 2023-08-01T19:54:47.466 INFO:teuthology.orchestra.run.smithi155.stdout: "initiated_at": "2023-08-01T19:54:34.003553+0000", 2023-08-01T19:54:47.466 INFO:teuthology.orchestra.run.smithi155.stdout: "age": 13.408936328999999, 2023-08-01T19:54:47.466 INFO:teuthology.orchestra.run.smithi155.stdout: "duration": 0.014610414, 2023-08-01T19:54:47.466 INFO:teuthology.orchestra.run.smithi155.stdout: "type_data": { 2023-08-01T19:54:47.467 INFO:teuthology.orchestra.run.smithi155.stdout: "flag_point": "commit sent; apply or cleanup", 2023-08-01T19:54:47.467 INFO:teuthology.orchestra.run.smithi155.stdout: "client_info": { 2023-08-01T19:54:47.467 INFO:teuthology.orchestra.run.smithi155.stdout: "client": "client.4668", 2023-08-01T19:54:47.467 INFO:teuthology.orchestra.run.smithi155.stdout: "client_addr": "172.21.15.6:0/1709472247", 2023-08-01T19:54:47.467 INFO:teuthology.orchestra.run.smithi155.stdout: "tid": 33939 2023-08-01T19:54:47.467 INFO:teuthology.orchestra.run.smithi155.stdout: }, 2023-08-01T19:54:47.467 INFO:teuthology.orchestra.run.smithi155.stdout: "events": [ 2023-08-01T19:54:47.467 INFO:teuthology.orchestra.run.smithi155.stdout: { 2023-08-01T19:54:47.468 INFO:teuthology.orchestra.run.smithi155.stdout: "event": "initiated", 2023-08-01T19:54:47.468 INFO:teuthology.orchestra.run.smithi155.stdout: "time": "2023-08-01T19:54:34.003553+0000", 2023-08-01T19:54:47.468 INFO:teuthology.orchestra.run.smithi155.stdout: "duration": 0 2023-08-01T19:54:47.468 INFO:teuthology.orchestra.run.smithi155.stdout: }, 2023-08-01T19:54:47.468 INFO:teuthology.orchestra.run.smithi155.stdout: { 2023-08-01T19:54:47.468 INFO:teuthology.orchestra.run.smithi155.stdout: "event": "throttled", 2023-08-01T19:54:47.468 INFO:teuthology.orchestra.run.smithi155.stdout: "time": "2023-08-01T19:54:34.003553+0000", 2023-08-01T19:54:47.468 INFO:teuthology.orchestra.run.smithi155.stdout: "duration": 0 2023-08-01T19:54:47.469 INFO:teuthology.orchestra.run.smithi155.stdout: }, 2023-08-01T19:54:47.469 INFO:teuthology.orchestra.run.smithi155.stdout: { 2023-08-01T19:54:47.469 INFO:teuthology.orchestra.run.smithi155.stdout: "event": "header_read", 2023-08-01T19:54:47.469 INFO:teuthology.orchestra.run.smithi155.stdout: "time": "2023-08-01T19:54:34.003552+0000", 2023-08-01T19:54:47.469 INFO:teuthology.orchestra.run.smithi155.stdout: "duration": 4294967295.999999 2023-08-01T19:54:47.469 INFO:teuthology.orchestra.run.smithi155.stdout: }, 2023-08-01T19:54:47.469 INFO:teuthology.orchestra.run.smithi155.stdout: { 2023-08-01T19:54:47.469 INFO:teuthology.orchestra.run.smithi155.stdout: "event": "all_read", 2023-08-01T19:54:47.470 INFO:teuthology.orchestra.run.smithi155.stdout: "time": "2023-08-01T19:54:34.003577+0000", 2023-08-01T19:54:47.470 INFO:teuthology.orchestra.run.smithi155.stdout: "duration": 2.5179000000000001e-05 2023-08-01T19:54:47.470 INFO:teuthology.orchestra.run.smithi155.stdout: }, 2023-08-01T19:54:47.470 INFO:teuthology.orchestra.run.smithi155.stdout: { 2023-08-01T19:54:47.470 INFO:teuthology.orchestra.run.smithi155.stdout: "event": "dispatched", 2023-08-01T19:54:47.470 INFO:teuthology.orchestra.run.smithi155.stdout: "time": "2023-08-01T19:54:34.003586+0000", 2023-08-01T19:54:47.470 INFO:teuthology.orchestra.run.smithi155.stdout: "duration": 9.1139999999999995e-06 2023-08-01T19:54:47.470 INFO:teuthology.orchestra.run.smithi155.stdout: }, 2023-08-01T19:54:47.471 INFO:teuthology.orchestra.run.smithi155.stdout: { 2023-08-01T19:54:47.471 INFO:teuthology.orchestra.run.smithi155.stdout: "event": "queued_for_pg", 2023-08-01T19:54:47.471 INFO:teuthology.orchestra.run.smithi155.stdout: "time": "2023-08-01T19:54:34.003590+0000", 2023-08-01T19:54:47.471 INFO:teuthology.orchestra.run.smithi155.stdout: "duration": 4.4859999999999999e-06 2023-08-01T19:54:47.471 INFO:teuthology.orchestra.run.smithi155.stdout: }, 2023-08-01T19:54:47.471 INFO:teuthology.orchestra.run.smithi155.stdout: { 2023-08-01T19:54:47.471 INFO:teuthology.orchestra.run.smithi155.stdout: "event": "reached_pg", 2023-08-01T19:54:47.471 INFO:teuthology.orchestra.run.smithi155.stdout: "time": "2023-08-01T19:54:34.003629+0000", 2023-08-01T19:54:47.472 INFO:teuthology.orchestra.run.smithi155.stdout: "duration": 3.8643999999999998e-05 2023-08-01T19:54:47.472 INFO:teuthology.orchestra.run.smithi155.stdout: }, 2023-08-01T19:54:47.472 INFO:teuthology.orchestra.run.smithi155.stdout: { 2023-08-01T19:54:47.472 INFO:teuthology.orchestra.run.smithi155.stdout: "event": "started", 2023-08-01T19:54:47.472 INFO:teuthology.orchestra.run.smithi155.stdout: "time": "2023-08-01T19:54:34.003836+0000", 2023-08-01T19:54:47.472 INFO:teuthology.orchestra.run.smithi155.stdout: "duration": 0.00020656 2023-08-01T19:54:47.472 INFO:teuthology.orchestra.run.smithi155.stdout: }, 2023-08-01T19:54:47.473 INFO:teuthology.orchestra.run.smithi155.stdout: { 2023-08-01T19:54:47.473 INFO:teuthology.orchestra.run.smithi155.stdout: "event": "waiting for subops from 0", 2023-08-01T19:54:47.473 INFO:teuthology.orchestra.run.smithi155.stdout: "time": "2023-08-01T19:54:34.003944+0000", 2023-08-01T19:54:47.473 INFO:teuthology.orchestra.run.smithi155.stdout: "duration": 0.000108674 2023-08-01T19:54:47.473 INFO:teuthology.orchestra.run.smithi155.stdout: }, 2023-08-01T19:54:47.473 INFO:teuthology.orchestra.run.smithi155.stdout: { 2023-08-01T19:54:47.473 INFO:teuthology.orchestra.run.smithi155.stdout: "event": "sub_op_commit_rec", 2023-08-01T19:54:47.473 INFO:teuthology.orchestra.run.smithi155.stdout: "time": "2023-08-01T19:54:34.007654+0000", 2023-08-01T19:54:47.474 INFO:teuthology.orchestra.run.smithi155.stdout: "duration": 0.0037100879999999998 2023-08-01T19:54:47.474 INFO:teuthology.orchestra.run.smithi155.stdout: }, 2023-08-01T19:54:47.474 INFO:teuthology.orchestra.run.smithi155.stdout: { 2023-08-01T19:54:47.474 INFO:teuthology.orchestra.run.smithi155.stdout: "event": "op_commit", 2023-08-01T19:54:47.474 INFO:teuthology.orchestra.run.smithi155.stdout: "time": "2023-08-01T19:54:34.018092+0000", 2023-08-01T19:54:47.474 INFO:teuthology.orchestra.run.smithi155.stdout: "duration": 0.010437366999999999 2023-08-01T19:54:47.474 INFO:teuthology.orchestra.run.smithi155.stdout: }, 2023-08-01T19:54:47.474 INFO:teuthology.orchestra.run.smithi155.stdout: { 2023-08-01T19:54:47.475 INFO:teuthology.orchestra.run.smithi155.stdout: "event": "commit_sent", 2023-08-01T19:54:47.475 INFO:teuthology.orchestra.run.smithi155.stdout: "time": "2023-08-01T19:54:34.018130+0000", 2023-08-01T19:54:47.475 INFO:teuthology.orchestra.run.smithi155.stdout: "duration": 3.8770999999999999e-05 2023-08-01T19:54:47.475 INFO:teuthology.orchestra.run.smithi155.stdout: }, 2023-08-01T19:54:47.475 INFO:teuthology.orchestra.run.smithi155.stdout: { 2023-08-01T19:54:47.475 INFO:teuthology.orchestra.run.smithi155.stdout: "event": "done", 2023-08-01T19:54:47.475 INFO:teuthology.orchestra.run.smithi155.stdout: "time": "2023-08-01T19:54:34.018163+0000", 2023-08-01T19:54:47.475 INFO:teuthology.orchestra.run.smithi155.stdout: "duration": 3.256e-05 2023-08-01T19:54:47.476 INFO:teuthology.orchestra.run.smithi155.stdout: } 2023-08-01T19:54:47.476 INFO:teuthology.orchestra.run.smithi155.stdout: ] 2023-08-01T19:54:47.476 INFO:teuthology.orchestra.run.smithi155.stdout: } 2023-08-01T19:54:47.476 INFO:teuthology.orchestra.run.smithi155.stdout: }, 2023-08-01T19:54:47.476 INFO:teuthology.orchestra.run.smithi155.stdout: { 2023-08-01T19:54:47.476 INFO:teuthology.orchestra.run.smithi155.stdout: "description": "osd_op(client.4668.0:33940 5.d 5:bd606fc2:::benchmark_data_smithi006_114134_object33939:head [set-alloc-hint object_size 65536 write_size 65536,write 0~65536] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e24)", 2023-08-01T19:54:47.476 INFO:teuthology.orchestra.run.smithi155.stdout: "initiated_at": "2023-08-01T19:54:34.003597+0000", 2023-08-01T19:54:47.476 INFO:teuthology.orchestra.run.smithi155.stdout: "age": 13.408891509, 2023-08-01T19:54:47.477 INFO:teuthology.orchestra.run.smithi155.stdout: "duration": 0.014545786999999999, 2023-08-01T19:54:47.477 INFO:teuthology.orchestra.run.smithi155.stdout: "type_data": { 2023-08-01T19:54:47.477 INFO:teuthology.orchestra.run.smithi155.stdout: "flag_point": "commit sent; apply or cleanup", 2023-08-01T19:54:47.477 INFO:teuthology.orchestra.run.smithi155.stdout: "client_info": { 2023-08-01T19:54:47.477 INFO:teuthology.orchestra.run.smithi155.stdout: "client": "client.4668", 2023-08-01T19:54:47.477 INFO:teuthology.orchestra.run.smithi155.stdout: "client_addr": "172.21.15.6:0/1709472247", 2023-08-01T19:54:47.477 INFO:teuthology.orchestra.run.smithi155.stdout: "tid": 33940 2023-08-01T19:54:47.477 INFO:teuthology.orchestra.run.smithi155.stdout: }, 2023-08-01T19:54:47.478 INFO:teuthology.orchestra.run.smithi155.stdout: "events": [ 2023-08-01T19:54:47.478 INFO:teuthology.orchestra.run.smithi155.stdout: { 2023-08-01T19:54:47.478 INFO:teuthology.orchestra.run.smithi155.stdout: "event": "initiated", 2023-08-01T19:54:47.478 INFO:teuthology.orchestra.run.smithi155.stdout: "time": "2023-08-01T19:54:34.003597+0000", 2023-08-01T19:54:47.478 INFO:teuthology.orchestra.run.smithi155.stdout: "duration": 0 2023-08-01T19:54:47.478 INFO:teuthology.orchestra.run.smithi155.stdout: }, 2023-08-01T19:54:47.478 INFO:teuthology.orchestra.run.smithi155.stdout: { 2023-08-01T19:54:47.478 INFO:teuthology.orchestra.run.smithi155.stdout: "event": "throttled", 2023-08-01T19:54:47.479 INFO:teuthology.orchestra.run.smithi155.stdout: "time": "2023-08-01T19:54:34.003597+0000", 2023-08-01T19:54:47.479 INFO:teuthology.orchestra.run.smithi155.stdout: "duration": 0 2023-08-01T19:54:47.479 INFO:teuthology.orchestra.run.smithi155.stdout: }, 2023-08-01T19:54:47.479 INFO:teuthology.orchestra.run.smithi155.stdout: { 2023-08-01T19:54:47.479 INFO:teuthology.orchestra.run.smithi155.stdout: "event": "header_read", 2023-08-01T19:54:47.479 INFO:teuthology.orchestra.run.smithi155.stdout: "time": "2023-08-01T19:54:34.003597+0000", 2023-08-01T19:54:47.479 INFO:teuthology.orchestra.run.smithi155.stdout: "duration": 4294967295.9999995 2023-08-01T19:54:47.479 INFO:teuthology.orchestra.run.smithi155.stdout: }, 2023-08-01T19:54:47.480 INFO:teuthology.orchestra.run.smithi155.stdout: { 2023-08-01T19:54:47.480 INFO:teuthology.orchestra.run.smithi155.stdout: "event": "all_read", 2023-08-01T19:54:47.480 INFO:teuthology.orchestra.run.smithi155.stdout: "time": "2023-08-01T19:54:34.003623+0000", 2023-08-01T19:54:47.480 INFO:teuthology.orchestra.run.smithi155.stdout: "duration": 2.6033e-05 2023-08-01T19:54:47.480 INFO:teuthology.orchestra.run.smithi155.stdout: }, 2023-08-01T19:54:47.480 INFO:teuthology.orchestra.run.smithi155.stdout: { 2023-08-01T19:54:47.480 INFO:teuthology.orchestra.run.smithi155.stdout: "event": "dispatched", 2023-08-01T19:54:47.481 INFO:teuthology.orchestra.run.smithi155.stdout: "time": "2023-08-01T19:54:34.003630+0000", 2023-08-01T19:54:47.481 INFO:teuthology.orchestra.run.smithi155.stdout: "duration": 6.6749999999999996e-06 2023-08-01T19:54:47.481 INFO:teuthology.orchestra.run.smithi155.stdout: }, 2023-08-01T19:54:47.481 INFO:teuthology.orchestra.run.smithi155.stdout: { 2023-08-01T19:54:47.481 INFO:teuthology.orchestra.run.smithi155.stdout: "event": "queued_for_pg", 2023-08-01T19:54:47.481 INFO:teuthology.orchestra.run.smithi155.stdout: "time": "2023-08-01T19:54:34.003635+0000", 2023-08-01T19:54:47.481 INFO:teuthology.orchestra.run.smithi155.stdout: "duration": 5.0239999999999997e-06 2023-08-01T19:54:47.481 INFO:teuthology.orchestra.run.smithi155.stdout: }, 2023-08-01T19:54:47.482 INFO:teuthology.orchestra.run.smithi155.stdout: { 2023-08-01T19:54:47.482 INFO:teuthology.orchestra.run.smithi155.stdout: "event": "reached_pg", 2023-08-01T19:54:47.482 INFO:teuthology.orchestra.run.smithi155.stdout: "time": "2023-08-01T19:54:34.003670+0000", 2023-08-01T19:54:47.482 INFO:teuthology.orchestra.run.smithi155.stdout: "duration": 3.5057e-05 2023-08-01T19:54:47.482 INFO:teuthology.orchestra.run.smithi155.stdout: }, 2023-08-01T19:54:47.482 INFO:teuthology.orchestra.run.smithi155.stdout: { 2023-08-01T19:54:47.482 INFO:teuthology.orchestra.run.smithi155.stdout: "event": "started", 2023-08-01T19:54:47.482 INFO:teuthology.orchestra.run.smithi155.stdout: "time": "2023-08-01T19:54:34.003782+0000", 2023-08-01T19:54:47.483 INFO:teuthology.orchestra.run.smithi155.stdout: "duration": 0.000111851 2023-08-01T19:54:47.483 INFO:teuthology.orchestra.run.smithi155.stdout: }, 2023-08-01T19:54:47.483 INFO:teuthology.orchestra.run.smithi155.stdout: { 2023-08-01T19:54:47.483 INFO:teuthology.orchestra.run.smithi155.stdout: "event": "waiting for subops from 1", 2023-08-01T19:54:47.483 INFO:teuthology.orchestra.run.smithi155.stdout: "time": "2023-08-01T19:54:34.003915+0000", 2023-08-01T19:54:47.483 INFO:teuthology.orchestra.run.smithi155.stdout: "duration": 0.00013387100000000001 2023-08-01T19:54:47.483 INFO:teuthology.orchestra.run.smithi155.stdout: }, 2023-08-01T19:54:47.483 INFO:teuthology.orchestra.run.smithi155.stdout: { 2023-08-01T19:54:47.484 INFO:teuthology.orchestra.run.smithi155.stdout: "event": "sub_op_commit_rec", 2023-08-01T19:54:47.484 INFO:teuthology.orchestra.run.smithi155.stdout: "time": "2023-08-01T19:54:34.008763+0000", 2023-08-01T19:54:47.484 INFO:teuthology.orchestra.run.smithi155.stdout: "duration": 0.0048478389999999996 2023-08-01T19:54:47.484 INFO:teuthology.orchestra.run.smithi155.stdout: }, 2023-08-01T19:54:47.484 INFO:teuthology.orchestra.run.smithi155.stdout: { 2023-08-01T19:54:47.484 INFO:teuthology.orchestra.run.smithi155.stdout: "event": "op_commit", 2023-08-01T19:54:47.484 INFO:teuthology.orchestra.run.smithi155.stdout: "time": "2023-08-01T19:54:34.018067+0000", 2023-08-01T19:54:47.484 INFO:teuthology.orchestra.run.smithi155.stdout: "duration": 0.0093033460000000005 2023-08-01T19:54:47.485 INFO:teuthology.orchestra.run.smithi155.stdout: }, 2023-08-01T19:54:47.485 INFO:teuthology.orchestra.run.smithi155.stdout: { 2023-08-01T19:54:47.485 INFO:teuthology.orchestra.run.smithi155.stdout: "event": "commit_sent", 2023-08-01T19:54:47.485 INFO:teuthology.orchestra.run.smithi155.stdout: "time": "2023-08-01T19:54:34.018107+0000", 2023-08-01T19:54:47.485 INFO:teuthology.orchestra.run.smithi155.stdout: "duration": 3.9901999999999998e-05 2023-08-01T19:54:47.485 INFO:teuthology.orchestra.run.smithi155.stdout: }, 2023-08-01T19:54:47.485 INFO:teuthology.orchestra.run.smithi155.stdout: { 2023-08-01T19:54:47.485 INFO:teuthology.orchestra.run.smithi155.stdout: "event": "done", 2023-08-01T19:54:47.486 INFO:teuthology.orchestra.run.smithi155.stdout: "time": "2023-08-01T19:54:34.018143+0000", 2023-08-01T19:54:47.486 INFO:teuthology.orchestra.run.smithi155.stdout: "duration": 3.6704e-05 2023-08-01T19:54:47.486 INFO:teuthology.orchestra.run.smithi155.stdout: } 2023-08-01T19:54:47.486 INFO:teuthology.orchestra.run.smithi155.stdout: ] 2023-08-01T19:54:47.486 INFO:teuthology.orchestra.run.smithi155.stdout: } 2023-08-01T19:54:47.486 INFO:teuthology.orchestra.run.smithi155.stdout: }, 2023-08-01T19:54:47.486 INFO:teuthology.orchestra.run.smithi155.stdout: { 2023-08-01T19:54:47.486 INFO:teuthology.orchestra.run.smithi155.stdout: "description": "osd_op(client.4668.0:33941 5.4 5:2f172f24:::benchmark_data_smithi006_114134_object33940:head [set-alloc-hint object_size 65536 write_size 65536,write 0~65536] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e24)", 2023-08-01T19:54:47.487 INFO:teuthology.orchestra.run.smithi155.stdout: "initiated_at": "2023-08-01T19:54:34.003680+0000", 2023-08-01T19:54:47.487 INFO:teuthology.orchestra.run.smithi155.stdout: "age": 13.408808715999999, 2023-08-01T19:54:47.487 INFO:teuthology.orchestra.run.smithi155.stdout: "duration": 0.014562969, 2023-08-01T19:54:47.487 INFO:teuthology.orchestra.run.smithi155.stdout: "type_data": { 2023-08-01T19:54:47.487 INFO:teuthology.orchestra.run.smithi155.stdout: "flag_point": "commit sent; apply or cleanup", 2023-08-01T19:54:47.487 INFO:teuthology.orchestra.run.smithi155.stdout: "client_info": { 2023-08-01T19:54:47.487 INFO:teuthology.orchestra.run.smithi155.stdout: "client": "client.4668", 2023-08-01T19:54:47.487 INFO:teuthology.orchestra.run.smithi155.stdout: "client_addr": "172.21.15.6:0/1709472247", 2023-08-01T19:54:47.488 INFO:teuthology.orchestra.run.smithi155.stdout: "tid": 33941 2023-08-01T19:54:47.488 INFO:teuthology.orchestra.run.smithi155.stdout: }, 2023-08-01T19:54:47.488 INFO:teuthology.orchestra.run.smithi155.stdout: "events": [ 2023-08-01T19:54:47.488 INFO:teuthology.orchestra.run.smithi155.stdout: { 2023-08-01T19:54:47.488 INFO:teuthology.orchestra.run.smithi155.stdout: "event": "initiated", 2023-08-01T19:54:47.488 INFO:teuthology.orchestra.run.smithi155.stdout: "time": "2023-08-01T19:54:34.003680+0000", 2023-08-01T19:54:47.488 INFO:teuthology.orchestra.run.smithi155.stdout: "duration": 0 2023-08-01T19:54:47.489 INFO:teuthology.orchestra.run.smithi155.stdout: }, 2023-08-01T19:54:47.489 INFO:teuthology.orchestra.run.smithi155.stdout: { 2023-08-01T19:54:47.489 INFO:teuthology.orchestra.run.smithi155.stdout: "event": "throttled", 2023-08-01T19:54:47.489 INFO:teuthology.orchestra.run.smithi155.stdout: "time": "2023-08-01T19:54:34.003680+0000", 2023-08-01T19:54:47.489 INFO:teuthology.orchestra.run.smithi155.stdout: "duration": 0 2023-08-01T19:54:47.489 INFO:teuthology.orchestra.run.smithi155.stdout: }, 2023-08-01T19:54:47.489 INFO:teuthology.orchestra.run.smithi155.stdout: { 2023-08-01T19:54:47.489 INFO:teuthology.orchestra.run.smithi155.stdout: "event": "header_read", 2023-08-01T19:54:47.490 INFO:teuthology.orchestra.run.smithi155.stdout: "time": "2023-08-01T19:54:34.003680+0000", 2023-08-01T19:54:47.490 INFO:teuthology.orchestra.run.smithi155.stdout: "duration": 4294967295.999999 2023-08-01T19:54:47.490 INFO:teuthology.orchestra.run.smithi155.stdout: }, 2023-08-01T19:54:47.490 INFO:teuthology.orchestra.run.smithi155.stdout: { 2023-08-01T19:54:47.490 INFO:teuthology.orchestra.run.smithi155.stdout: "event": "all_read", 2023-08-01T19:54:47.490 INFO:teuthology.orchestra.run.smithi155.stdout: "time": "2023-08-01T19:54:34.003767+0000", 2023-08-01T19:54:47.490 INFO:teuthology.orchestra.run.smithi155.stdout: "duration": 8.7289999999999999e-05 2023-08-01T19:54:47.491 INFO:teuthology.orchestra.run.smithi155.stdout: }, 2023-08-01T19:54:47.491 INFO:teuthology.orchestra.run.smithi155.stdout: { 2023-08-01T19:54:47.491 INFO:teuthology.orchestra.run.smithi155.stdout: "event": "dispatched", 2023-08-01T19:54:47.491 INFO:teuthology.orchestra.run.smithi155.stdout: "time": "2023-08-01T19:54:34.003775+0000", 2023-08-01T19:54:47.491 INFO:teuthology.orchestra.run.smithi155.stdout: "duration": 8.6079999999999996e-06 2023-08-01T19:54:47.491 INFO:teuthology.orchestra.run.smithi155.stdout: }, 2023-08-01T19:54:47.491 INFO:teuthology.orchestra.run.smithi155.stdout: { 2023-08-01T19:54:47.491 INFO:teuthology.orchestra.run.smithi155.stdout: "event": "queued_for_pg", 2023-08-01T19:54:47.492 INFO:teuthology.orchestra.run.smithi155.stdout: "time": "2023-08-01T19:54:34.003782+0000", 2023-08-01T19:54:47.492 INFO:teuthology.orchestra.run.smithi155.stdout: "duration": 6.8029999999999999e-06 2023-08-01T19:54:47.492 INFO:teuthology.orchestra.run.smithi155.stdout: }, 2023-08-01T19:54:47.492 INFO:teuthology.orchestra.run.smithi155.stdout: { 2023-08-01T19:54:47.492 INFO:teuthology.orchestra.run.smithi155.stdout: "event": "reached_pg", 2023-08-01T19:54:47.492 INFO:teuthology.orchestra.run.smithi155.stdout: "time": "2023-08-01T19:54:34.005052+0000", 2023-08-01T19:54:47.492 INFO:teuthology.orchestra.run.smithi155.stdout: "duration": 0.0012697170000000001 2023-08-01T19:54:47.492 INFO:teuthology.orchestra.run.smithi155.stdout: }, 2023-08-01T19:54:47.493 INFO:teuthology.orchestra.run.smithi155.stdout: { 2023-08-01T19:54:47.493 INFO:teuthology.orchestra.run.smithi155.stdout: "event": "started", 2023-08-01T19:54:47.493 INFO:teuthology.orchestra.run.smithi155.stdout: "time": "2023-08-01T19:54:34.005188+0000", 2023-08-01T19:54:47.493 INFO:teuthology.orchestra.run.smithi155.stdout: "duration": 0.00013654199999999999 2023-08-01T19:54:47.493 INFO:teuthology.orchestra.run.smithi155.stdout: }, 2023-08-01T19:54:47.493 INFO:teuthology.orchestra.run.smithi155.stdout: { 2023-08-01T19:54:47.493 INFO:teuthology.orchestra.run.smithi155.stdout: "event": "waiting for subops from 0", 2023-08-01T19:54:47.493 INFO:teuthology.orchestra.run.smithi155.stdout: "time": "2023-08-01T19:54:34.005319+0000", 2023-08-01T19:54:47.494 INFO:teuthology.orchestra.run.smithi155.stdout: "duration": 0.000130951 2023-08-01T19:54:47.494 INFO:teuthology.orchestra.run.smithi155.stdout: }, 2023-08-01T19:54:47.494 INFO:teuthology.orchestra.run.smithi155.stdout: { 2023-08-01T19:54:47.494 INFO:teuthology.orchestra.run.smithi155.stdout: "event": "sub_op_commit_rec", 2023-08-01T19:54:47.494 INFO:teuthology.orchestra.run.smithi155.stdout: "time": "2023-08-01T19:54:34.008698+0000", 2023-08-01T19:54:47.494 INFO:teuthology.orchestra.run.smithi155.stdout: "duration": 0.0033787259999999999 2023-08-01T19:54:47.494 INFO:teuthology.orchestra.run.smithi155.stdout: }, 2023-08-01T19:54:47.494 INFO:teuthology.orchestra.run.smithi155.stdout: { 2023-08-01T19:54:47.495 INFO:teuthology.orchestra.run.smithi155.stdout: "event": "op_commit", 2023-08-01T19:54:47.495 INFO:teuthology.orchestra.run.smithi155.stdout: "time": "2023-08-01T19:54:34.018169+0000", 2023-08-01T19:54:47.495 INFO:teuthology.orchestra.run.smithi155.stdout: "duration": 0.0094712749999999995 2023-08-01T19:54:47.495 INFO:teuthology.orchestra.run.smithi155.stdout: }, 2023-08-01T19:54:47.495 INFO:teuthology.orchestra.run.smithi155.stdout: { 2023-08-01T19:54:47.495 INFO:teuthology.orchestra.run.smithi155.stdout: "event": "commit_sent", 2023-08-01T19:54:47.495 INFO:teuthology.orchestra.run.smithi155.stdout: "time": "2023-08-01T19:54:34.018212+0000", 2023-08-01T19:54:47.495 INFO:teuthology.orchestra.run.smithi155.stdout: "duration": 4.2573e-05 2023-08-01T19:54:47.496 INFO:teuthology.orchestra.run.smithi155.stdout: }, 2023-08-01T19:54:47.496 INFO:teuthology.orchestra.run.smithi155.stdout: { 2023-08-01T19:54:47.496 INFO:teuthology.orchestra.run.smithi155.stdout: "event": "done", 2023-08-01T19:54:47.496 INFO:teuthology.orchestra.run.smithi155.stdout: "time": "2023-08-01T19:54:34.018243+0000", 2023-08-01T19:54:47.496 INFO:teuthology.orchestra.run.smithi155.stdout: "duration": 3.1207000000000001e-05 2023-08-01T19:54:47.496 INFO:teuthology.orchestra.run.smithi155.stdout: } 2023-08-01T19:54:47.496 INFO:teuthology.orchestra.run.smithi155.stdout: ] 2023-08-01T19:54:47.497 INFO:teuthology.orchestra.run.smithi155.stdout: } 2023-08-01T19:54:47.497 INFO:teuthology.orchestra.run.smithi155.stdout: }, 2023-08-01T19:54:47.497 INFO:teuthology.orchestra.run.smithi155.stdout: { 2023-08-01T19:54:47.497 INFO:teuthology.orchestra.run.smithi155.stdout: "description": "osd_op(client.4668.0:33943 5.4 5:238a0abd:::benchmark_data_smithi006_114134_object33942:head [set-alloc-hint object_size 65536 write_size 65536,write 0~65536] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e24)", 2023-08-01T19:54:47.497 INFO:teuthology.orchestra.run.smithi155.stdout: "initiated_at": "2023-08-01T19:54:34.003807+0000", 2023-08-01T19:54:47.497 INFO:teuthology.orchestra.run.smithi155.stdout: "age": 13.408682373, 2023-08-01T19:54:47.497 INFO:teuthology.orchestra.run.smithi155.stdout: "duration": 0.014504958, 2023-08-01T19:54:47.497 INFO:teuthology.orchestra.run.smithi155.stdout: "type_data": { 2023-08-01T19:54:47.498 INFO:teuthology.orchestra.run.smithi155.stdout: "flag_point": "commit sent; apply or cleanup", 2023-08-01T19:54:47.498 INFO:teuthology.orchestra.run.smithi155.stdout: "client_info": { 2023-08-01T19:54:47.498 INFO:teuthology.orchestra.run.smithi155.stdout: "client": "client.4668", 2023-08-01T19:54:47.498 INFO:teuthology.orchestra.run.smithi155.stdout: "client_addr": "172.21.15.6:0/1709472247", 2023-08-01T19:54:47.498 INFO:teuthology.orchestra.run.smithi155.stdout: "tid": 33943 2023-08-01T19:54:47.498 INFO:teuthology.orchestra.run.smithi155.stdout: }, 2023-08-01T19:54:47.498 INFO:teuthology.orchestra.run.smithi155.stdout: "events": [ 2023-08-01T19:54:47.498 INFO:teuthology.orchestra.run.smithi155.stdout: { 2023-08-01T19:54:47.499 INFO:teuthology.orchestra.run.smithi155.stdout: "event": "initiated", 2023-08-01T19:54:47.499 INFO:teuthology.orchestra.run.smithi155.stdout: "time": "2023-08-01T19:54:34.003807+0000", 2023-08-01T19:54:47.499 INFO:teuthology.orchestra.run.smithi155.stdout: "duration": 0 2023-08-01T19:54:47.499 INFO:teuthology.orchestra.run.smithi155.stdout: }, 2023-08-01T19:54:47.499 INFO:teuthology.orchestra.run.smithi155.stdout: { 2023-08-01T19:54:47.499 INFO:teuthology.orchestra.run.smithi155.stdout: "event": "throttled", 2023-08-01T19:54:47.499 INFO:teuthology.orchestra.run.smithi155.stdout: "time": "2023-08-01T19:54:34.003807+0000", 2023-08-01T19:54:47.499 INFO:teuthology.orchestra.run.smithi155.stdout: "duration": 0 2023-08-01T19:54:47.500 INFO:teuthology.orchestra.run.smithi155.stdout: }, 2023-08-01T19:54:47.500 INFO:teuthology.orchestra.run.smithi155.stdout: { 2023-08-01T19:54:47.500 INFO:teuthology.orchestra.run.smithi155.stdout: "event": "header_read", 2023-08-01T19:54:47.500 INFO:teuthology.orchestra.run.smithi155.stdout: "time": "2023-08-01T19:54:34.003806+0000", 2023-08-01T19:54:47.500 INFO:teuthology.orchestra.run.smithi155.stdout: "duration": 4294967295.999999 2023-08-01T19:54:47.500 INFO:teuthology.orchestra.run.smithi155.stdout: }, 2023-08-01T19:54:47.500 INFO:teuthology.orchestra.run.smithi155.stdout: { 2023-08-01T19:54:47.501 INFO:teuthology.orchestra.run.smithi155.stdout: "event": "all_read", 2023-08-01T19:54:47.501 INFO:teuthology.orchestra.run.smithi155.stdout: "time": "2023-08-01T19:54:34.003878+0000", 2023-08-01T19:54:47.501 INFO:teuthology.orchestra.run.smithi155.stdout: "duration": 7.2021999999999996e-05 2023-08-01T19:54:47.501 INFO:teuthology.orchestra.run.smithi155.stdout: }, 2023-08-01T19:54:47.501 INFO:teuthology.orchestra.run.smithi155.stdout: { 2023-08-01T19:54:47.501 INFO:teuthology.orchestra.run.smithi155.stdout: "event": "dispatched", 2023-08-01T19:54:47.501 INFO:teuthology.orchestra.run.smithi155.stdout: "time": "2023-08-01T19:54:34.003886+0000", 2023-08-01T19:54:47.501 INFO:teuthology.orchestra.run.smithi155.stdout: "duration": 8.1659999999999994e-06 2023-08-01T19:54:47.502 INFO:teuthology.orchestra.run.smithi155.stdout: }, 2023-08-01T19:54:47.502 INFO:teuthology.orchestra.run.smithi155.stdout: { 2023-08-01T19:54:47.502 INFO:teuthology.orchestra.run.smithi155.stdout: "event": "queued_for_pg", 2023-08-01T19:54:47.502 INFO:teuthology.orchestra.run.smithi155.stdout: "time": "2023-08-01T19:54:34.003892+0000", 2023-08-01T19:54:47.502 INFO:teuthology.orchestra.run.smithi155.stdout: "duration": 5.4609999999999999e-06 2023-08-01T19:54:47.502 INFO:teuthology.orchestra.run.smithi155.stdout: }, 2023-08-01T19:54:47.502 INFO:teuthology.orchestra.run.smithi155.stdout: { 2023-08-01T19:54:47.502 INFO:teuthology.orchestra.run.smithi155.stdout: "event": "reached_pg", 2023-08-01T19:54:47.503 INFO:teuthology.orchestra.run.smithi155.stdout: "time": "2023-08-01T19:54:34.006547+0000", 2023-08-01T19:54:47.503 INFO:teuthology.orchestra.run.smithi155.stdout: "duration": 0.0026551999999999999 2023-08-01T19:54:47.503 INFO:teuthology.orchestra.run.smithi155.stdout: }, 2023-08-01T19:54:47.503 INFO:teuthology.orchestra.run.smithi155.stdout: { 2023-08-01T19:54:47.503 INFO:teuthology.orchestra.run.smithi155.stdout: "event": "started", 2023-08-01T19:54:47.503 INFO:teuthology.orchestra.run.smithi155.stdout: "time": "2023-08-01T19:54:34.006625+0000", 2023-08-01T19:54:47.503 INFO:teuthology.orchestra.run.smithi155.stdout: "duration": 7.8189000000000006e-05 2023-08-01T19:54:47.503 INFO:teuthology.orchestra.run.smithi155.stdout: }, 2023-08-01T19:54:47.504 INFO:teuthology.orchestra.run.smithi155.stdout: { 2023-08-01T19:54:47.504 INFO:teuthology.orchestra.run.smithi155.stdout: "event": "waiting for subops from 0", 2023-08-01T19:54:47.504 INFO:teuthology.orchestra.run.smithi155.stdout: "time": "2023-08-01T19:54:34.006703+0000", 2023-08-01T19:54:47.504 INFO:teuthology.orchestra.run.smithi155.stdout: "duration": 7.8218000000000002e-05 2023-08-01T19:54:47.504 INFO:teuthology.orchestra.run.smithi155.stdout: }, 2023-08-01T19:54:47.504 INFO:teuthology.orchestra.run.smithi155.stdout: { 2023-08-01T19:54:47.504 INFO:teuthology.orchestra.run.smithi155.stdout: "event": "sub_op_commit_rec", 2023-08-01T19:54:47.505 INFO:teuthology.orchestra.run.smithi155.stdout: "time": "2023-08-01T19:54:34.009001+0000", 2023-08-01T19:54:47.505 INFO:teuthology.orchestra.run.smithi155.stdout: "duration": 0.0022976450000000001 2023-08-01T19:54:47.505 INFO:teuthology.orchestra.run.smithi155.stdout: }, 2023-08-01T19:54:47.505 INFO:teuthology.orchestra.run.smithi155.stdout: { 2023-08-01T19:54:47.505 INFO:teuthology.orchestra.run.smithi155.stdout: "event": "op_commit", 2023-08-01T19:54:47.505 INFO:teuthology.orchestra.run.smithi155.stdout: "time": "2023-08-01T19:54:34.018250+0000", 2023-08-01T19:54:47.505 INFO:teuthology.orchestra.run.smithi155.stdout: "duration": 0.0092490539999999996 2023-08-01T19:54:47.505 INFO:teuthology.orchestra.run.smithi155.stdout: }, 2023-08-01T19:54:47.506 INFO:teuthology.orchestra.run.smithi155.stdout: { 2023-08-01T19:54:47.506 INFO:teuthology.orchestra.run.smithi155.stdout: "event": "commit_sent", 2023-08-01T19:54:47.506 INFO:teuthology.orchestra.run.smithi155.stdout: "time": "2023-08-01T19:54:34.018283+0000", 2023-08-01T19:54:47.506 INFO:teuthology.orchestra.run.smithi155.stdout: "duration": 3.3420000000000002e-05 2023-08-01T19:54:47.506 INFO:teuthology.orchestra.run.smithi155.stdout: }, 2023-08-01T19:54:47.507 INFO:teuthology.orchestra.run.smithi155.stdout: { 2023-08-01T19:54:47.507 INFO:teuthology.orchestra.run.smithi155.stdout: "event": "done", 2023-08-01T19:54:47.507 INFO:teuthology.orchestra.run.smithi155.stdout: "time": "2023-08-01T19:54:34.018312+0000", 2023-08-01T19:54:47.507 INFO:teuthology.orchestra.run.smithi155.stdout: "duration": 2.8311e-05 2023-08-01T19:54:47.507 INFO:teuthology.orchestra.run.smithi155.stdout: } 2023-08-01T19:54:47.507 INFO:teuthology.orchestra.run.smithi155.stdout: ] 2023-08-01T19:54:47.507 INFO:teuthology.orchestra.run.smithi155.stdout: } 2023-08-01T19:54:47.508 INFO:teuthology.orchestra.run.smithi155.stdout: }, 2023-08-01T19:54:47.508 INFO:teuthology.orchestra.run.smithi155.stdout: { 2023-08-01T19:54:47.508 INFO:teuthology.orchestra.run.smithi155.stdout: "description": "osd_op(client.4668.0:41366 5.b 5:d8db1792:::benchmark_data_smithi006_114134_object41365:head [set-alloc-hint object_size 65536 write_size 65536,write 0~65536] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e25)", 2023-08-01T19:54:47.508 INFO:teuthology.orchestra.run.smithi155.stdout: "initiated_at": "2023-08-01T19:54:36.749152+0000", 2023-08-01T19:54:47.508 INFO:teuthology.orchestra.run.smithi155.stdout: "age": 10.663337166, 2023-08-01T19:54:47.508 INFO:teuthology.orchestra.run.smithi155.stdout: "duration": 0.014481499, 2023-08-01T19:54:47.508 INFO:teuthology.orchestra.run.smithi155.stdout: "type_data": { 2023-08-01T19:54:47.508 INFO:teuthology.orchestra.run.smithi155.stdout: "flag_point": "commit sent; apply or cleanup", 2023-08-01T19:54:47.509 INFO:teuthology.orchestra.run.smithi155.stdout: "client_info": { 2023-08-01T19:54:47.509 INFO:teuthology.orchestra.run.smithi155.stdout: "client": "client.4668", 2023-08-01T19:54:47.509 INFO:teuthology.orchestra.run.smithi155.stdout: "client_addr": "172.21.15.6:0/1709472247", 2023-08-01T19:54:47.509 INFO:teuthology.orchestra.run.smithi155.stdout: "tid": 41366 2023-08-01T19:54:47.509 INFO:teuthology.orchestra.run.smithi155.stdout: }, 2023-08-01T19:54:47.509 INFO:teuthology.orchestra.run.smithi155.stdout: "events": [ 2023-08-01T19:54:47.509 INFO:teuthology.orchestra.run.smithi155.stdout: { 2023-08-01T19:54:47.509 INFO:teuthology.orchestra.run.smithi155.stdout: "event": "initiated", 2023-08-01T19:54:47.510 INFO:teuthology.orchestra.run.smithi155.stdout: "time": "2023-08-01T19:54:36.749152+0000", 2023-08-01T19:54:47.510 INFO:teuthology.orchestra.run.smithi155.stdout: "duration": 0 2023-08-01T19:54:47.510 INFO:teuthology.orchestra.run.smithi155.stdout: }, 2023-08-01T19:54:47.510 INFO:teuthology.orchestra.run.smithi155.stdout: { 2023-08-01T19:54:47.510 INFO:teuthology.orchestra.run.smithi155.stdout: "event": "throttled", 2023-08-01T19:54:47.510 INFO:teuthology.orchestra.run.smithi155.stdout: "time": "2023-08-01T19:54:36.749152+0000", 2023-08-01T19:54:47.510 INFO:teuthology.orchestra.run.smithi155.stdout: "duration": 0 2023-08-01T19:54:47.511 INFO:teuthology.orchestra.run.smithi155.stdout: }, 2023-08-01T19:54:47.511 INFO:teuthology.orchestra.run.smithi155.stdout: { 2023-08-01T19:54:47.511 INFO:teuthology.orchestra.run.smithi155.stdout: "event": "header_read", 2023-08-01T19:54:47.511 INFO:teuthology.orchestra.run.smithi155.stdout: "time": "2023-08-01T19:54:36.749151+0000", 2023-08-01T19:54:47.511 INFO:teuthology.orchestra.run.smithi155.stdout: "duration": 4294967295.9999995 2023-08-01T19:54:47.511 INFO:teuthology.orchestra.run.smithi155.stdout: }, 2023-08-01T19:54:47.511 INFO:teuthology.orchestra.run.smithi155.stdout: { 2023-08-01T19:54:47.511 INFO:teuthology.orchestra.run.smithi155.stdout: "event": "all_read", 2023-08-01T19:54:47.512 INFO:teuthology.orchestra.run.smithi155.stdout: "time": "2023-08-01T19:54:36.749216+0000", 2023-08-01T19:54:47.512 INFO:teuthology.orchestra.run.smithi155.stdout: "duration": 6.4838000000000005e-05 2023-08-01T19:54:47.512 INFO:teuthology.orchestra.run.smithi155.stdout: }, 2023-08-01T19:54:47.512 INFO:teuthology.orchestra.run.smithi155.stdout: { 2023-08-01T19:54:47.512 INFO:teuthology.orchestra.run.smithi155.stdout: "event": "dispatched", 2023-08-01T19:54:47.512 INFO:teuthology.orchestra.run.smithi155.stdout: "time": "2023-08-01T19:54:36.749225+0000", 2023-08-01T19:54:47.512 INFO:teuthology.orchestra.run.smithi155.stdout: "duration": 8.8079999999999994e-06 2023-08-01T19:54:47.512 INFO:teuthology.orchestra.run.smithi155.stdout: }, 2023-08-01T19:54:47.513 INFO:teuthology.orchestra.run.smithi155.stdout: { 2023-08-01T19:54:47.513 INFO:teuthology.orchestra.run.smithi155.stdout: "event": "queued_for_pg", 2023-08-01T19:54:47.513 INFO:teuthology.orchestra.run.smithi155.stdout: "time": "2023-08-01T19:54:36.749231+0000", 2023-08-01T19:54:47.513 INFO:teuthology.orchestra.run.smithi155.stdout: "duration": 6.443e-06 2023-08-01T19:54:47.513 INFO:teuthology.orchestra.run.smithi155.stdout: }, 2023-08-01T19:54:47.513 INFO:teuthology.orchestra.run.smithi155.stdout: { 2023-08-01T19:54:47.513 INFO:teuthology.orchestra.run.smithi155.stdout: "event": "reached_pg", 2023-08-01T19:54:47.514 INFO:teuthology.orchestra.run.smithi155.stdout: "time": "2023-08-01T19:54:36.750813+0000", 2023-08-01T19:54:47.514 INFO:teuthology.orchestra.run.smithi155.stdout: "duration": 0.0015817590000000001 2023-08-01T19:54:47.514 INFO:teuthology.orchestra.run.smithi155.stdout: }, 2023-08-01T19:54:47.514 INFO:teuthology.orchestra.run.smithi155.stdout: { 2023-08-01T19:54:47.514 INFO:teuthology.orchestra.run.smithi155.stdout: "event": "started", 2023-08-01T19:54:47.514 INFO:teuthology.orchestra.run.smithi155.stdout: "time": "2023-08-01T19:54:36.750961+0000", 2023-08-01T19:54:47.514 INFO:teuthology.orchestra.run.smithi155.stdout: "duration": 0.00014760399999999999 2023-08-01T19:54:47.514 INFO:teuthology.orchestra.run.smithi155.stdout: }, 2023-08-01T19:54:47.515 INFO:teuthology.orchestra.run.smithi155.stdout: { 2023-08-01T19:54:47.515 INFO:teuthology.orchestra.run.smithi155.stdout: "event": "waiting for subops from 0", 2023-08-01T19:54:47.515 INFO:teuthology.orchestra.run.smithi155.stdout: "time": "2023-08-01T19:54:36.751098+0000", 2023-08-01T19:54:47.515 INFO:teuthology.orchestra.run.smithi155.stdout: "duration": 0.00013760000000000001 2023-08-01T19:54:47.515 INFO:teuthology.orchestra.run.smithi155.stdout: }, 2023-08-01T19:54:47.515 INFO:teuthology.orchestra.run.smithi155.stdout: { 2023-08-01T19:54:47.515 INFO:teuthology.orchestra.run.smithi155.stdout: "event": "sub_op_commit_rec", 2023-08-01T19:54:47.515 INFO:teuthology.orchestra.run.smithi155.stdout: "time": "2023-08-01T19:54:36.757464+0000", 2023-08-01T19:54:47.516 INFO:teuthology.orchestra.run.smithi155.stdout: "duration": 0.0063655830000000002 2023-08-01T19:54:47.516 INFO:teuthology.orchestra.run.smithi155.stdout: }, 2023-08-01T19:54:47.516 INFO:teuthology.orchestra.run.smithi155.stdout: { 2023-08-01T19:54:47.516 INFO:teuthology.orchestra.run.smithi155.stdout: "event": "op_commit", 2023-08-01T19:54:47.516 INFO:teuthology.orchestra.run.smithi155.stdout: "time": "2023-08-01T19:54:36.763551+0000", 2023-08-01T19:54:47.516 INFO:teuthology.orchestra.run.smithi155.stdout: "duration": 0.0060876200000000002 2023-08-01T19:54:47.516 INFO:teuthology.orchestra.run.smithi155.stdout: }, 2023-08-01T19:54:47.517 INFO:teuthology.orchestra.run.smithi155.stdout: { 2023-08-01T19:54:47.517 INFO:teuthology.orchestra.run.smithi155.stdout: "event": "commit_sent", 2023-08-01T19:54:47.517 INFO:teuthology.orchestra.run.smithi155.stdout: "time": "2023-08-01T19:54:36.763597+0000", 2023-08-01T19:54:47.517 INFO:teuthology.orchestra.run.smithi155.stdout: "duration": 4.5445000000000003e-05 2023-08-01T19:54:47.517 INFO:teuthology.orchestra.run.smithi155.stdout: }, 2023-08-01T19:54:47.517 INFO:teuthology.orchestra.run.smithi155.stdout: { 2023-08-01T19:54:47.517 INFO:teuthology.orchestra.run.smithi155.stdout: "event": "done", 2023-08-01T19:54:47.517 INFO:teuthology.orchestra.run.smithi155.stdout: "time": "2023-08-01T19:54:36.763633+0000", 2023-08-01T19:54:47.518 INFO:teuthology.orchestra.run.smithi155.stdout: "duration": 3.6375999999999999e-05 2023-08-01T19:54:47.518 INFO:teuthology.orchestra.run.smithi155.stdout: } 2023-08-01T19:54:47.518 INFO:teuthology.orchestra.run.smithi155.stdout: ] 2023-08-01T19:54:47.518 INFO:teuthology.orchestra.run.smithi155.stdout: } 2023-08-01T19:54:47.518 INFO:teuthology.orchestra.run.smithi155.stdout: }, 2023-08-01T19:54:47.518 INFO:teuthology.orchestra.run.smithi155.stdout: { 2023-08-01T19:54:47.518 INFO:teuthology.orchestra.run.smithi155.stdout: "description": "osd_op(client.4668.0:52241 5.0 5:046bb241:::benchmark_data_smithi006_114134_object52240:head [set-alloc-hint object_size 65536 write_size 65536,write 0~65536] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e27)", 2023-08-01T19:54:47.518 INFO:teuthology.orchestra.run.smithi155.stdout: "initiated_at": "2023-08-01T19:54:41.282783+0000", 2023-08-01T19:54:47.519 INFO:teuthology.orchestra.run.smithi155.stdout: "age": 6.1297062029999996, 2023-08-01T19:54:47.519 INFO:teuthology.orchestra.run.smithi155.stdout: "duration": 0.015571013, 2023-08-01T19:54:47.519 INFO:teuthology.orchestra.run.smithi155.stdout: "type_data": { 2023-08-01T19:54:47.519 INFO:teuthology.orchestra.run.smithi155.stdout: "flag_point": "commit sent; apply or cleanup", 2023-08-01T19:54:47.519 INFO:teuthology.orchestra.run.smithi155.stdout: "client_info": { 2023-08-01T19:54:47.519 INFO:teuthology.orchestra.run.smithi155.stdout: "client": "client.4668", 2023-08-01T19:54:47.519 INFO:teuthology.orchestra.run.smithi155.stdout: "client_addr": "172.21.15.6:0/1709472247", 2023-08-01T19:54:47.519 INFO:teuthology.orchestra.run.smithi155.stdout: "tid": 52241 2023-08-01T19:54:47.520 INFO:teuthology.orchestra.run.smithi155.stdout: }, 2023-08-01T19:54:47.520 INFO:teuthology.orchestra.run.smithi155.stdout: "events": [ 2023-08-01T19:54:47.520 INFO:teuthology.orchestra.run.smithi155.stdout: { 2023-08-01T19:54:47.520 INFO:teuthology.orchestra.run.smithi155.stdout: "event": "initiated", 2023-08-01T19:54:47.520 INFO:teuthology.orchestra.run.smithi155.stdout: "time": "2023-08-01T19:54:41.282783+0000", 2023-08-01T19:54:47.520 INFO:teuthology.orchestra.run.smithi155.stdout: "duration": 0 2023-08-01T19:54:47.520 INFO:teuthology.orchestra.run.smithi155.stdout: }, 2023-08-01T19:54:47.521 INFO:teuthology.orchestra.run.smithi155.stdout: { 2023-08-01T19:54:47.521 INFO:teuthology.orchestra.run.smithi155.stdout: "event": "throttled", 2023-08-01T19:54:47.521 INFO:teuthology.orchestra.run.smithi155.stdout: "time": "2023-08-01T19:54:41.282783+0000", 2023-08-01T19:54:47.521 INFO:teuthology.orchestra.run.smithi155.stdout: "duration": 0 2023-08-01T19:54:47.521 INFO:teuthology.orchestra.run.smithi155.stdout: }, 2023-08-01T19:54:47.521 INFO:teuthology.orchestra.run.smithi155.stdout: { 2023-08-01T19:54:47.521 INFO:teuthology.orchestra.run.smithi155.stdout: "event": "header_read", 2023-08-01T19:54:47.521 INFO:teuthology.orchestra.run.smithi155.stdout: "time": "2023-08-01T19:54:41.282782+0000", 2023-08-01T19:54:47.522 INFO:teuthology.orchestra.run.smithi155.stdout: "duration": 4294967295.9999995 2023-08-01T19:54:47.522 INFO:teuthology.orchestra.run.smithi155.stdout: }, 2023-08-01T19:54:47.522 INFO:teuthology.orchestra.run.smithi155.stdout: { 2023-08-01T19:54:47.522 INFO:teuthology.orchestra.run.smithi155.stdout: "event": "all_read", 2023-08-01T19:54:47.522 INFO:teuthology.orchestra.run.smithi155.stdout: "time": "2023-08-01T19:54:41.282859+0000", 2023-08-01T19:54:47.522 INFO:teuthology.orchestra.run.smithi155.stdout: "duration": 7.7089999999999995e-05 2023-08-01T19:54:47.522 INFO:teuthology.orchestra.run.smithi155.stdout: }, 2023-08-01T19:54:47.522 INFO:teuthology.orchestra.run.smithi155.stdout: { 2023-08-01T19:54:47.523 INFO:teuthology.orchestra.run.smithi155.stdout: "event": "dispatched", 2023-08-01T19:54:47.523 INFO:teuthology.orchestra.run.smithi155.stdout: "time": "2023-08-01T19:54:41.282865+0000", 2023-08-01T19:54:47.523 INFO:teuthology.orchestra.run.smithi155.stdout: "duration": 5.3129999999999998e-06 2023-08-01T19:54:47.523 INFO:teuthology.orchestra.run.smithi155.stdout: }, 2023-08-01T19:54:47.523 INFO:teuthology.orchestra.run.smithi155.stdout: { 2023-08-01T19:54:47.523 INFO:teuthology.orchestra.run.smithi155.stdout: "event": "queued_for_pg", 2023-08-01T19:54:47.523 INFO:teuthology.orchestra.run.smithi155.stdout: "time": "2023-08-01T19:54:41.282868+0000", 2023-08-01T19:54:47.523 INFO:teuthology.orchestra.run.smithi155.stdout: "duration": 3.0139999999999999e-06 2023-08-01T19:54:47.524 INFO:teuthology.orchestra.run.smithi155.stdout: }, 2023-08-01T19:54:47.524 INFO:teuthology.orchestra.run.smithi155.stdout: { 2023-08-01T19:54:47.524 INFO:teuthology.orchestra.run.smithi155.stdout: "event": "reached_pg", 2023-08-01T19:54:47.524 INFO:teuthology.orchestra.run.smithi155.stdout: "time": "2023-08-01T19:54:41.284581+0000", 2023-08-01T19:54:47.524 INFO:teuthology.orchestra.run.smithi155.stdout: "duration": 0.0017131959999999999 2023-08-01T19:54:47.524 INFO:teuthology.orchestra.run.smithi155.stdout: }, 2023-08-01T19:54:47.524 INFO:teuthology.orchestra.run.smithi155.stdout: { 2023-08-01T19:54:47.524 INFO:teuthology.orchestra.run.smithi155.stdout: "event": "started", 2023-08-01T19:54:47.525 INFO:teuthology.orchestra.run.smithi155.stdout: "time": "2023-08-01T19:54:41.284684+0000", 2023-08-01T19:54:47.525 INFO:teuthology.orchestra.run.smithi155.stdout: "duration": 0.000102642 2023-08-01T19:54:47.525 INFO:teuthology.orchestra.run.smithi155.stdout: }, 2023-08-01T19:54:47.525 INFO:teuthology.orchestra.run.smithi155.stdout: { 2023-08-01T19:54:47.525 INFO:teuthology.orchestra.run.smithi155.stdout: "event": "waiting for subops from 0", 2023-08-01T19:54:47.525 INFO:teuthology.orchestra.run.smithi155.stdout: "time": "2023-08-01T19:54:41.284771+0000", 2023-08-01T19:54:47.525 INFO:teuthology.orchestra.run.smithi155.stdout: "duration": 8.7153999999999999e-05 2023-08-01T19:54:47.526 INFO:teuthology.orchestra.run.smithi155.stdout: }, 2023-08-01T19:54:47.526 INFO:teuthology.orchestra.run.smithi155.stdout: { 2023-08-01T19:54:47.526 INFO:teuthology.orchestra.run.smithi155.stdout: "event": "op_commit", 2023-08-01T19:54:47.526 INFO:teuthology.orchestra.run.smithi155.stdout: "time": "2023-08-01T19:54:41.289784+0000", 2023-08-01T19:54:47.526 INFO:teuthology.orchestra.run.smithi155.stdout: "duration": 0.0050127879999999998 2023-08-01T19:54:47.526 INFO:teuthology.orchestra.run.smithi155.stdout: }, 2023-08-01T19:54:47.526 INFO:teuthology.orchestra.run.smithi155.stdout: { 2023-08-01T19:54:47.526 INFO:teuthology.orchestra.run.smithi155.stdout: "event": "sub_op_commit_rec", 2023-08-01T19:54:47.527 INFO:teuthology.orchestra.run.smithi155.stdout: "time": "2023-08-01T19:54:41.298271+0000", 2023-08-01T19:54:47.527 INFO:teuthology.orchestra.run.smithi155.stdout: "duration": 0.0084877730000000005 2023-08-01T19:54:47.527 INFO:teuthology.orchestra.run.smithi155.stdout: }, 2023-08-01T19:54:47.527 INFO:teuthology.orchestra.run.smithi155.stdout: { 2023-08-01T19:54:47.527 INFO:teuthology.orchestra.run.smithi155.stdout: "event": "commit_sent", 2023-08-01T19:54:47.527 INFO:teuthology.orchestra.run.smithi155.stdout: "time": "2023-08-01T19:54:41.298322+0000", 2023-08-01T19:54:47.527 INFO:teuthology.orchestra.run.smithi155.stdout: "duration": 5.0500000000000001e-05 2023-08-01T19:54:47.528 INFO:teuthology.orchestra.run.smithi155.stdout: }, 2023-08-01T19:54:47.528 INFO:teuthology.orchestra.run.smithi155.stdout: { 2023-08-01T19:54:47.528 INFO:teuthology.orchestra.run.smithi155.stdout: "event": "done", 2023-08-01T19:54:47.528 INFO:teuthology.orchestra.run.smithi155.stdout: "time": "2023-08-01T19:54:41.298354+0000", 2023-08-01T19:54:47.528 INFO:teuthology.orchestra.run.smithi155.stdout: "duration": 3.1943000000000002e-05 2023-08-01T19:54:47.528 INFO:teuthology.orchestra.run.smithi155.stdout: } 2023-08-01T19:54:47.528 INFO:teuthology.orchestra.run.smithi155.stdout: ] 2023-08-01T19:54:47.529 INFO:teuthology.orchestra.run.smithi155.stdout: } 2023-08-01T19:54:47.529 INFO:teuthology.orchestra.run.smithi155.stdout: }, 2023-08-01T19:54:47.529 INFO:teuthology.orchestra.run.smithi155.stdout: { 2023-08-01T19:54:47.529 INFO:teuthology.orchestra.run.smithi155.stdout: "description": "osd_op(client.4668.0:52243 5.8 5:1a9a8a8b:::benchmark_data_smithi006_114134_object52242:head [set-alloc-hint object_size 65536 write_size 65536,write 0~65536] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e27)", 2023-08-01T19:54:47.529 INFO:teuthology.orchestra.run.smithi155.stdout: "initiated_at": "2023-08-01T19:54:41.284113+0000", 2023-08-01T19:54:47.529 INFO:teuthology.orchestra.run.smithi155.stdout: "age": 6.1283756509999998, 2023-08-01T19:54:47.529 INFO:teuthology.orchestra.run.smithi155.stdout: "duration": 0.014317038000000001, 2023-08-01T19:54:47.530 INFO:teuthology.orchestra.run.smithi155.stdout: "type_data": { 2023-08-01T19:54:47.530 INFO:teuthology.orchestra.run.smithi155.stdout: "flag_point": "commit sent; apply or cleanup", 2023-08-01T19:54:47.530 INFO:teuthology.orchestra.run.smithi155.stdout: "client_info": { 2023-08-01T19:54:47.530 INFO:teuthology.orchestra.run.smithi155.stdout: "client": "client.4668", 2023-08-01T19:54:47.530 INFO:teuthology.orchestra.run.smithi155.stdout: "client_addr": "172.21.15.6:0/1709472247", 2023-08-01T19:54:47.530 INFO:teuthology.orchestra.run.smithi155.stdout: "tid": 52243 2023-08-01T19:54:47.530 INFO:teuthology.orchestra.run.smithi155.stdout: }, 2023-08-01T19:54:47.530 INFO:teuthology.orchestra.run.smithi155.stdout: "events": [ 2023-08-01T19:54:47.531 INFO:teuthology.orchestra.run.smithi155.stdout: { 2023-08-01T19:54:47.531 INFO:teuthology.orchestra.run.smithi155.stdout: "event": "initiated", 2023-08-01T19:54:47.531 INFO:teuthology.orchestra.run.smithi155.stdout: "time": "2023-08-01T19:54:41.284113+0000", 2023-08-01T19:54:47.531 INFO:teuthology.orchestra.run.smithi155.stdout: "duration": 0 2023-08-01T19:54:47.531 INFO:teuthology.orchestra.run.smithi155.stdout: }, 2023-08-01T19:54:47.531 INFO:teuthology.orchestra.run.smithi155.stdout: { 2023-08-01T19:54:47.531 INFO:teuthology.orchestra.run.smithi155.stdout: "event": "throttled", 2023-08-01T19:54:47.531 INFO:teuthology.orchestra.run.smithi155.stdout: "time": "2023-08-01T19:54:41.284113+0000", 2023-08-01T19:54:47.532 INFO:teuthology.orchestra.run.smithi155.stdout: "duration": 0 2023-08-01T19:54:47.532 INFO:teuthology.orchestra.run.smithi155.stdout: }, 2023-08-01T19:54:47.532 INFO:teuthology.orchestra.run.smithi155.stdout: { 2023-08-01T19:54:47.532 INFO:teuthology.orchestra.run.smithi155.stdout: "event": "header_read", 2023-08-01T19:54:47.532 INFO:teuthology.orchestra.run.smithi155.stdout: "time": "2023-08-01T19:54:41.284113+0000", 2023-08-01T19:54:47.532 INFO:teuthology.orchestra.run.smithi155.stdout: "duration": 4294967295.9999995 2023-08-01T19:54:47.532 INFO:teuthology.orchestra.run.smithi155.stdout: }, 2023-08-01T19:54:47.533 INFO:teuthology.orchestra.run.smithi155.stdout: { 2023-08-01T19:54:47.533 INFO:teuthology.orchestra.run.smithi155.stdout: "event": "all_read", 2023-08-01T19:54:47.533 INFO:teuthology.orchestra.run.smithi155.stdout: "time": "2023-08-01T19:54:41.284170+0000", 2023-08-01T19:54:47.533 INFO:teuthology.orchestra.run.smithi155.stdout: "duration": 5.7287000000000002e-05 2023-08-01T19:54:47.533 INFO:teuthology.orchestra.run.smithi155.stdout: }, 2023-08-01T19:54:47.533 INFO:teuthology.orchestra.run.smithi155.stdout: { 2023-08-01T19:54:47.533 INFO:teuthology.orchestra.run.smithi155.stdout: "event": "dispatched", 2023-08-01T19:54:47.533 INFO:teuthology.orchestra.run.smithi155.stdout: "time": "2023-08-01T19:54:41.284185+0000", 2023-08-01T19:54:47.534 INFO:teuthology.orchestra.run.smithi155.stdout: "duration": 1.4747e-05 2023-08-01T19:54:47.534 INFO:teuthology.orchestra.run.smithi155.stdout: }, 2023-08-01T19:54:47.534 INFO:teuthology.orchestra.run.smithi155.stdout: { 2023-08-01T19:54:47.534 INFO:teuthology.orchestra.run.smithi155.stdout: "event": "queued_for_pg", 2023-08-01T19:54:47.534 INFO:teuthology.orchestra.run.smithi155.stdout: "time": "2023-08-01T19:54:41.284189+0000", 2023-08-01T19:54:47.534 INFO:teuthology.orchestra.run.smithi155.stdout: "duration": 4.4349999999999999e-06 2023-08-01T19:54:47.534 INFO:teuthology.orchestra.run.smithi155.stdout: }, 2023-08-01T19:54:47.534 INFO:teuthology.orchestra.run.smithi155.stdout: { 2023-08-01T19:54:47.535 INFO:teuthology.orchestra.run.smithi155.stdout: "event": "reached_pg", 2023-08-01T19:54:47.535 INFO:teuthology.orchestra.run.smithi155.stdout: "time": "2023-08-01T19:54:41.286026+0000", 2023-08-01T19:54:47.535 INFO:teuthology.orchestra.run.smithi155.stdout: "duration": 0.0018371710000000001 2023-08-01T19:54:47.535 INFO:teuthology.orchestra.run.smithi155.stdout: }, 2023-08-01T19:54:47.535 INFO:teuthology.orchestra.run.smithi155.stdout: { 2023-08-01T19:54:47.535 INFO:teuthology.orchestra.run.smithi155.stdout: "event": "started", 2023-08-01T19:54:47.535 INFO:teuthology.orchestra.run.smithi155.stdout: "time": "2023-08-01T19:54:41.286136+0000", 2023-08-01T19:54:47.535 INFO:teuthology.orchestra.run.smithi155.stdout: "duration": 0.000109304 2023-08-01T19:54:47.536 INFO:teuthology.orchestra.run.smithi155.stdout: }, 2023-08-01T19:54:47.536 INFO:teuthology.orchestra.run.smithi155.stdout: { 2023-08-01T19:54:47.536 INFO:teuthology.orchestra.run.smithi155.stdout: "event": "waiting for subops from 0", 2023-08-01T19:54:47.536 INFO:teuthology.orchestra.run.smithi155.stdout: "time": "2023-08-01T19:54:41.286238+0000", 2023-08-01T19:54:47.536 INFO:teuthology.orchestra.run.smithi155.stdout: "duration": 0.000102674 2023-08-01T19:54:47.536 INFO:teuthology.orchestra.run.smithi155.stdout: }, 2023-08-01T19:54:47.536 INFO:teuthology.orchestra.run.smithi155.stdout: { 2023-08-01T19:54:47.537 INFO:teuthology.orchestra.run.smithi155.stdout: "event": "op_commit", 2023-08-01T19:54:47.537 INFO:teuthology.orchestra.run.smithi155.stdout: "time": "2023-08-01T19:54:41.289787+0000", 2023-08-01T19:54:47.537 INFO:teuthology.orchestra.run.smithi155.stdout: "duration": 0.0035490669999999999 2023-08-01T19:54:47.537 INFO:teuthology.orchestra.run.smithi155.stdout: }, 2023-08-01T19:54:47.537 INFO:teuthology.orchestra.run.smithi155.stdout: { 2023-08-01T19:54:47.537 INFO:teuthology.orchestra.run.smithi155.stdout: "event": "sub_op_commit_rec", 2023-08-01T19:54:47.537 INFO:teuthology.orchestra.run.smithi155.stdout: "time": "2023-08-01T19:54:41.298383+0000", 2023-08-01T19:54:47.537 INFO:teuthology.orchestra.run.smithi155.stdout: "duration": 0.0085955400000000005 2023-08-01T19:54:47.538 INFO:teuthology.orchestra.run.smithi155.stdout: }, 2023-08-01T19:54:47.538 INFO:teuthology.orchestra.run.smithi155.stdout: { 2023-08-01T19:54:47.538 INFO:teuthology.orchestra.run.smithi155.stdout: "event": "commit_sent", 2023-08-01T19:54:47.538 INFO:teuthology.orchestra.run.smithi155.stdout: "time": "2023-08-01T19:54:41.298411+0000", 2023-08-01T19:54:47.538 INFO:teuthology.orchestra.run.smithi155.stdout: "duration": 2.8147e-05 2023-08-01T19:54:47.538 INFO:teuthology.orchestra.run.smithi155.stdout: }, 2023-08-01T19:54:47.538 INFO:teuthology.orchestra.run.smithi155.stdout: { 2023-08-01T19:54:47.538 INFO:teuthology.orchestra.run.smithi155.stdout: "event": "done", 2023-08-01T19:54:47.539 INFO:teuthology.orchestra.run.smithi155.stdout: "time": "2023-08-01T19:54:41.298430+0000", 2023-08-01T19:54:47.539 INFO:teuthology.orchestra.run.smithi155.stdout: "duration": 1.9283000000000002e-05 2023-08-01T19:54:47.539 INFO:teuthology.orchestra.run.smithi155.stdout: } 2023-08-01T19:54:47.539 INFO:teuthology.orchestra.run.smithi155.stdout: ] 2023-08-01T19:54:47.539 INFO:teuthology.orchestra.run.smithi155.stdout: } 2023-08-01T19:54:47.539 INFO:teuthology.orchestra.run.smithi155.stdout: }, 2023-08-01T19:54:47.539 INFO:teuthology.orchestra.run.smithi155.stdout: { 2023-08-01T19:54:47.539 INFO:teuthology.orchestra.run.smithi155.stdout: "description": "osd_op(client.4668.0:54238 5.0 5:0033d896:::benchmark_data_smithi006_114134_object54237:head [set-alloc-hint object_size 65536 write_size 65536,write 0~65536] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e27)", 2023-08-01T19:54:47.540 INFO:teuthology.orchestra.run.smithi155.stdout: "initiated_at": "2023-08-01T19:54:42.174210+0000", 2023-08-01T19:54:47.540 INFO:teuthology.orchestra.run.smithi155.stdout: "age": 5.2382785079999996, 2023-08-01T19:54:47.540 INFO:teuthology.orchestra.run.smithi155.stdout: "duration": 0.014057537, 2023-08-01T19:54:47.540 INFO:teuthology.orchestra.run.smithi155.stdout: "type_data": { 2023-08-01T19:54:47.540 INFO:teuthology.orchestra.run.smithi155.stdout: "flag_point": "commit sent; apply or cleanup", 2023-08-01T19:54:47.540 INFO:teuthology.orchestra.run.smithi155.stdout: "client_info": { 2023-08-01T19:54:47.540 INFO:teuthology.orchestra.run.smithi155.stdout: "client": "client.4668", 2023-08-01T19:54:47.541 INFO:teuthology.orchestra.run.smithi155.stdout: "client_addr": "172.21.15.6:0/1709472247", 2023-08-01T19:54:47.541 INFO:teuthology.orchestra.run.smithi155.stdout: "tid": 54238 2023-08-01T19:54:47.541 INFO:teuthology.orchestra.run.smithi155.stdout: }, 2023-08-01T19:54:47.541 INFO:teuthology.orchestra.run.smithi155.stdout: "events": [ 2023-08-01T19:54:47.541 INFO:teuthology.orchestra.run.smithi155.stdout: { 2023-08-01T19:54:47.541 INFO:teuthology.orchestra.run.smithi155.stdout: "event": "initiated", 2023-08-01T19:54:47.541 INFO:teuthology.orchestra.run.smithi155.stdout: "time": "2023-08-01T19:54:42.174210+0000", 2023-08-01T19:54:47.541 INFO:teuthology.orchestra.run.smithi155.stdout: "duration": 0 2023-08-01T19:54:47.542 INFO:teuthology.orchestra.run.smithi155.stdout: }, 2023-08-01T19:54:47.542 INFO:teuthology.orchestra.run.smithi155.stdout: { 2023-08-01T19:54:47.542 INFO:teuthology.orchestra.run.smithi155.stdout: "event": "throttled", 2023-08-01T19:54:47.542 INFO:teuthology.orchestra.run.smithi155.stdout: "time": "2023-08-01T19:54:42.174210+0000", 2023-08-01T19:54:47.542 INFO:teuthology.orchestra.run.smithi155.stdout: "duration": 0 2023-08-01T19:54:47.542 INFO:teuthology.orchestra.run.smithi155.stdout: }, 2023-08-01T19:54:47.542 INFO:teuthology.orchestra.run.smithi155.stdout: { 2023-08-01T19:54:47.542 INFO:teuthology.orchestra.run.smithi155.stdout: "event": "header_read", 2023-08-01T19:54:47.543 INFO:teuthology.orchestra.run.smithi155.stdout: "time": "2023-08-01T19:54:42.174210+0000", 2023-08-01T19:54:47.543 INFO:teuthology.orchestra.run.smithi155.stdout: "duration": 4294967295.9999995 2023-08-01T19:54:47.543 INFO:teuthology.orchestra.run.smithi155.stdout: }, 2023-08-01T19:54:47.543 INFO:teuthology.orchestra.run.smithi155.stdout: { 2023-08-01T19:54:47.543 INFO:teuthology.orchestra.run.smithi155.stdout: "event": "all_read", 2023-08-01T19:54:47.543 INFO:teuthology.orchestra.run.smithi155.stdout: "time": "2023-08-01T19:54:42.174272+0000", 2023-08-01T19:54:47.543 INFO:teuthology.orchestra.run.smithi155.stdout: "duration": 6.2415999999999993e-05 2023-08-01T19:54:47.543 INFO:teuthology.orchestra.run.smithi155.stdout: }, 2023-08-01T19:54:47.544 INFO:teuthology.orchestra.run.smithi155.stdout: { 2023-08-01T19:54:47.544 INFO:teuthology.orchestra.run.smithi155.stdout: "event": "dispatched", 2023-08-01T19:54:47.544 INFO:teuthology.orchestra.run.smithi155.stdout: "time": "2023-08-01T19:54:42.174281+0000", 2023-08-01T19:54:47.544 INFO:teuthology.orchestra.run.smithi155.stdout: "duration": 8.918e-06 2023-08-01T19:54:47.544 INFO:teuthology.orchestra.run.smithi155.stdout: }, 2023-08-01T19:54:47.544 INFO:teuthology.orchestra.run.smithi155.stdout: { 2023-08-01T19:54:47.544 INFO:teuthology.orchestra.run.smithi155.stdout: "event": "queued_for_pg", 2023-08-01T19:54:47.545 INFO:teuthology.orchestra.run.smithi155.stdout: "time": "2023-08-01T19:54:42.174287+0000", 2023-08-01T19:54:47.545 INFO:teuthology.orchestra.run.smithi155.stdout: "duration": 5.3680000000000001e-06 2023-08-01T19:54:47.545 INFO:teuthology.orchestra.run.smithi155.stdout: }, 2023-08-01T19:54:47.545 INFO:teuthology.orchestra.run.smithi155.stdout: { 2023-08-01T19:54:47.545 INFO:teuthology.orchestra.run.smithi155.stdout: "event": "reached_pg", 2023-08-01T19:54:47.545 INFO:teuthology.orchestra.run.smithi155.stdout: "time": "2023-08-01T19:54:42.175900+0000", 2023-08-01T19:54:47.545 INFO:teuthology.orchestra.run.smithi155.stdout: "duration": 0.0016131120000000001 2023-08-01T19:54:47.545 INFO:teuthology.orchestra.run.smithi155.stdout: }, 2023-08-01T19:54:47.546 INFO:teuthology.orchestra.run.smithi155.stdout: { 2023-08-01T19:54:47.546 INFO:teuthology.orchestra.run.smithi155.stdout: "event": "started", 2023-08-01T19:54:47.546 INFO:teuthology.orchestra.run.smithi155.stdout: "time": "2023-08-01T19:54:42.176023+0000", 2023-08-01T19:54:47.546 INFO:teuthology.orchestra.run.smithi155.stdout: "duration": 0.00012335499999999999 2023-08-01T19:54:47.546 INFO:teuthology.orchestra.run.smithi155.stdout: }, 2023-08-01T19:54:47.546 INFO:teuthology.orchestra.run.smithi155.stdout: { 2023-08-01T19:54:47.546 INFO:teuthology.orchestra.run.smithi155.stdout: "event": "waiting for subops from 0", 2023-08-01T19:54:47.546 INFO:teuthology.orchestra.run.smithi155.stdout: "time": "2023-08-01T19:54:42.176154+0000", 2023-08-01T19:54:47.547 INFO:teuthology.orchestra.run.smithi155.stdout: "duration": 0.000130729 2023-08-01T19:54:47.547 INFO:teuthology.orchestra.run.smithi155.stdout: }, 2023-08-01T19:54:47.547 INFO:teuthology.orchestra.run.smithi155.stdout: { 2023-08-01T19:54:47.547 INFO:teuthology.orchestra.run.smithi155.stdout: "event": "sub_op_commit_rec", 2023-08-01T19:54:47.547 INFO:teuthology.orchestra.run.smithi155.stdout: "time": "2023-08-01T19:54:42.183652+0000", 2023-08-01T19:54:47.547 INFO:teuthology.orchestra.run.smithi155.stdout: "duration": 0.0074976870000000003 2023-08-01T19:54:47.547 INFO:teuthology.orchestra.run.smithi155.stdout: }, 2023-08-01T19:54:47.547 INFO:teuthology.orchestra.run.smithi155.stdout: { 2023-08-01T19:54:47.548 INFO:teuthology.orchestra.run.smithi155.stdout: "event": "op_commit", 2023-08-01T19:54:47.548 INFO:teuthology.orchestra.run.smithi155.stdout: "time": "2023-08-01T19:54:42.188214+0000", 2023-08-01T19:54:47.548 INFO:teuthology.orchestra.run.smithi155.stdout: "duration": 0.0045620410000000002 2023-08-01T19:54:47.548 INFO:teuthology.orchestra.run.smithi155.stdout: }, 2023-08-01T19:54:47.548 INFO:teuthology.orchestra.run.smithi155.stdout: { 2023-08-01T19:54:47.548 INFO:teuthology.orchestra.run.smithi155.stdout: "event": "commit_sent", 2023-08-01T19:54:47.548 INFO:teuthology.orchestra.run.smithi155.stdout: "time": "2023-08-01T19:54:42.188240+0000", 2023-08-01T19:54:47.548 INFO:teuthology.orchestra.run.smithi155.stdout: "duration": 2.5978000000000001e-05 2023-08-01T19:54:47.549 INFO:teuthology.orchestra.run.smithi155.stdout: }, 2023-08-01T19:54:47.549 INFO:teuthology.orchestra.run.smithi155.stdout: { 2023-08-01T19:54:47.549 INFO:teuthology.orchestra.run.smithi155.stdout: "event": "done", 2023-08-01T19:54:47.549 INFO:teuthology.orchestra.run.smithi155.stdout: "time": "2023-08-01T19:54:42.188268+0000", 2023-08-01T19:54:47.549 INFO:teuthology.orchestra.run.smithi155.stdout: "duration": 2.8441000000000001e-05 2023-08-01T19:54:47.549 INFO:teuthology.orchestra.run.smithi155.stdout: } 2023-08-01T19:54:47.549 INFO:teuthology.orchestra.run.smithi155.stdout: ] 2023-08-01T19:54:47.549 INFO:teuthology.orchestra.run.smithi155.stdout: } 2023-08-01T19:54:47.550 INFO:teuthology.orchestra.run.smithi155.stdout: }, 2023-08-01T19:54:47.550 INFO:teuthology.orchestra.run.smithi155.stdout: { 2023-08-01T19:54:47.550 INFO:teuthology.orchestra.run.smithi155.stdout: "description": "osd_op(client.4668.0:56482 5.8 5:1f71b25d:::benchmark_data_smithi006_114134_object56481:head [set-alloc-hint object_size 65536 write_size 65536,write 0~65536] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e27)", 2023-08-01T19:54:47.550 INFO:teuthology.orchestra.run.smithi155.stdout: "initiated_at": "2023-08-01T19:54:43.174466+0000", 2023-08-01T19:54:47.550 INFO:teuthology.orchestra.run.smithi155.stdout: "age": 4.2380231970000004, 2023-08-01T19:54:47.550 INFO:teuthology.orchestra.run.smithi155.stdout: "duration": 0.014276967, 2023-08-01T19:54:47.550 INFO:teuthology.orchestra.run.smithi155.stdout: "type_data": { 2023-08-01T19:54:47.550 INFO:teuthology.orchestra.run.smithi155.stdout: "flag_point": "commit sent; apply or cleanup", 2023-08-01T19:54:47.551 INFO:teuthology.orchestra.run.smithi155.stdout: "client_info": { 2023-08-01T19:54:47.551 INFO:teuthology.orchestra.run.smithi155.stdout: "client": "client.4668", 2023-08-01T19:54:47.551 INFO:teuthology.orchestra.run.smithi155.stdout: "client_addr": "172.21.15.6:0/1709472247", 2023-08-01T19:54:47.551 INFO:teuthology.orchestra.run.smithi155.stdout: "tid": 56482 2023-08-01T19:54:47.551 INFO:teuthology.orchestra.run.smithi155.stdout: }, 2023-08-01T19:54:47.551 INFO:teuthology.orchestra.run.smithi155.stdout: "events": [ 2023-08-01T19:54:47.551 INFO:teuthology.orchestra.run.smithi155.stdout: { 2023-08-01T19:54:47.551 INFO:teuthology.orchestra.run.smithi155.stdout: "event": "initiated", 2023-08-01T19:54:47.552 INFO:teuthology.orchestra.run.smithi155.stdout: "time": "2023-08-01T19:54:43.174466+0000", 2023-08-01T19:54:47.552 INFO:teuthology.orchestra.run.smithi155.stdout: "duration": 0 2023-08-01T19:54:47.552 INFO:teuthology.orchestra.run.smithi155.stdout: }, 2023-08-01T19:54:47.552 INFO:teuthology.orchestra.run.smithi155.stdout: { 2023-08-01T19:54:47.552 INFO:teuthology.orchestra.run.smithi155.stdout: "event": "throttled", 2023-08-01T19:54:47.552 INFO:teuthology.orchestra.run.smithi155.stdout: "time": "2023-08-01T19:54:43.174466+0000", 2023-08-01T19:54:47.552 INFO:teuthology.orchestra.run.smithi155.stdout: "duration": 0 2023-08-01T19:54:47.552 INFO:teuthology.orchestra.run.smithi155.stdout: }, 2023-08-01T19:54:47.553 INFO:teuthology.orchestra.run.smithi155.stdout: { 2023-08-01T19:54:47.553 INFO:teuthology.orchestra.run.smithi155.stdout: "event": "header_read", 2023-08-01T19:54:47.553 INFO:teuthology.orchestra.run.smithi155.stdout: "time": "2023-08-01T19:54:43.174465+0000", 2023-08-01T19:54:47.553 INFO:teuthology.orchestra.run.smithi155.stdout: "duration": 4294967295.999999 2023-08-01T19:54:47.553 INFO:teuthology.orchestra.run.smithi155.stdout: }, 2023-08-01T19:54:47.553 INFO:teuthology.orchestra.run.smithi155.stdout: { 2023-08-01T19:54:47.553 INFO:teuthology.orchestra.run.smithi155.stdout: "event": "all_read", 2023-08-01T19:54:47.553 INFO:teuthology.orchestra.run.smithi155.stdout: "time": "2023-08-01T19:54:43.174528+0000", 2023-08-01T19:54:47.554 INFO:teuthology.orchestra.run.smithi155.stdout: "duration": 6.2507000000000003e-05 2023-08-01T19:54:47.554 INFO:teuthology.orchestra.run.smithi155.stdout: }, 2023-08-01T19:54:47.554 INFO:teuthology.orchestra.run.smithi155.stdout: { 2023-08-01T19:54:47.554 INFO:teuthology.orchestra.run.smithi155.stdout: "event": "dispatched", 2023-08-01T19:54:47.554 INFO:teuthology.orchestra.run.smithi155.stdout: "time": "2023-08-01T19:54:43.174534+0000", 2023-08-01T19:54:47.554 INFO:teuthology.orchestra.run.smithi155.stdout: "duration": 6.3829999999999997e-06 2023-08-01T19:54:47.554 INFO:teuthology.orchestra.run.smithi155.stdout: }, 2023-08-01T19:54:47.554 INFO:teuthology.orchestra.run.smithi155.stdout: { 2023-08-01T19:54:47.555 INFO:teuthology.orchestra.run.smithi155.stdout: "event": "queued_for_pg", 2023-08-01T19:54:47.555 INFO:teuthology.orchestra.run.smithi155.stdout: "time": "2023-08-01T19:54:43.174539+0000", 2023-08-01T19:54:47.555 INFO:teuthology.orchestra.run.smithi155.stdout: "duration": 4.809e-06 2023-08-01T19:54:47.555 INFO:teuthology.orchestra.run.smithi155.stdout: }, 2023-08-01T19:54:47.555 INFO:teuthology.orchestra.run.smithi155.stdout: { 2023-08-01T19:54:47.555 INFO:teuthology.orchestra.run.smithi155.stdout: "event": "reached_pg", 2023-08-01T19:54:47.555 INFO:teuthology.orchestra.run.smithi155.stdout: "time": "2023-08-01T19:54:43.174574+0000", 2023-08-01T19:54:47.556 INFO:teuthology.orchestra.run.smithi155.stdout: "duration": 3.5732000000000003e-05 2023-08-01T19:54:47.556 INFO:teuthology.orchestra.run.smithi155.stdout: }, 2023-08-01T19:54:47.556 INFO:teuthology.orchestra.run.smithi155.stdout: { 2023-08-01T19:54:47.556 INFO:teuthology.orchestra.run.smithi155.stdout: "event": "started", 2023-08-01T19:54:47.556 INFO:teuthology.orchestra.run.smithi155.stdout: "time": "2023-08-01T19:54:43.174691+0000", 2023-08-01T19:54:47.556 INFO:teuthology.orchestra.run.smithi155.stdout: "duration": 0.000116585 2023-08-01T19:54:47.556 INFO:teuthology.orchestra.run.smithi155.stdout: }, 2023-08-01T19:54:47.556 INFO:teuthology.orchestra.run.smithi155.stdout: { 2023-08-01T19:54:47.557 INFO:teuthology.orchestra.run.smithi155.stdout: "event": "waiting for subops from 0", 2023-08-01T19:54:47.557 INFO:teuthology.orchestra.run.smithi155.stdout: "time": "2023-08-01T19:54:43.174825+0000", 2023-08-01T19:54:47.557 INFO:teuthology.orchestra.run.smithi155.stdout: "duration": 0.00013434100000000001 2023-08-01T19:54:47.557 INFO:teuthology.orchestra.run.smithi155.stdout: }, 2023-08-01T19:54:47.557 INFO:teuthology.orchestra.run.smithi155.stdout: { 2023-08-01T19:54:47.557 INFO:teuthology.orchestra.run.smithi155.stdout: "event": "op_commit", 2023-08-01T19:54:47.557 INFO:teuthology.orchestra.run.smithi155.stdout: "time": "2023-08-01T19:54:43.179602+0000", 2023-08-01T19:54:47.558 INFO:teuthology.orchestra.run.smithi155.stdout: "duration": 0.0047766329999999997 2023-08-01T19:54:47.558 INFO:teuthology.orchestra.run.smithi155.stdout: }, 2023-08-01T19:54:47.558 INFO:teuthology.orchestra.run.smithi155.stdout: { 2023-08-01T19:54:47.558 INFO:teuthology.orchestra.run.smithi155.stdout: "event": "sub_op_commit_rec", 2023-08-01T19:54:47.558 INFO:teuthology.orchestra.run.smithi155.stdout: "time": "2023-08-01T19:54:43.188690+0000", 2023-08-01T19:54:47.558 INFO:teuthology.orchestra.run.smithi155.stdout: "duration": 0.0090876120000000001 2023-08-01T19:54:47.558 INFO:teuthology.orchestra.run.smithi155.stdout: }, 2023-08-01T19:54:47.558 INFO:teuthology.orchestra.run.smithi155.stdout: { 2023-08-01T19:54:47.559 INFO:teuthology.orchestra.run.smithi155.stdout: "event": "commit_sent", 2023-08-01T19:54:47.559 INFO:teuthology.orchestra.run.smithi155.stdout: "time": "2023-08-01T19:54:43.188714+0000", 2023-08-01T19:54:47.559 INFO:teuthology.orchestra.run.smithi155.stdout: "duration": 2.3913999999999998e-05 2023-08-01T19:54:47.559 INFO:teuthology.orchestra.run.smithi155.stdout: }, 2023-08-01T19:54:47.559 INFO:teuthology.orchestra.run.smithi155.stdout: { 2023-08-01T19:54:47.559 INFO:teuthology.orchestra.run.smithi155.stdout: "event": "done", 2023-08-01T19:54:47.559 INFO:teuthology.orchestra.run.smithi155.stdout: "time": "2023-08-01T19:54:43.188743+0000", 2023-08-01T19:54:47.559 INFO:teuthology.orchestra.run.smithi155.stdout: "duration": 2.9213999999999998e-05 2023-08-01T19:54:47.560 INFO:teuthology.orchestra.run.smithi155.stdout: } 2023-08-01T19:54:47.560 INFO:teuthology.orchestra.run.smithi155.stdout: ] 2023-08-01T19:54:47.560 INFO:teuthology.orchestra.run.smithi155.stdout: } 2023-08-01T19:54:47.560 INFO:teuthology.orchestra.run.smithi155.stdout: }, 2023-08-01T19:54:47.560 INFO:teuthology.orchestra.run.smithi155.stdout: { 2023-08-01T19:54:47.560 INFO:teuthology.orchestra.run.smithi155.stdout: "description": "osd_op(client.4668.0:56485 5.8 5:13ef8b6b:::benchmark_data_smithi006_114134_object56484:head [set-alloc-hint object_size 65536 write_size 65536,write 0~65536] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e27)", 2023-08-01T19:54:47.560 INFO:teuthology.orchestra.run.smithi155.stdout: "initiated_at": "2023-08-01T19:54:43.174569+0000", 2023-08-01T19:54:47.561 INFO:teuthology.orchestra.run.smithi155.stdout: "age": 4.237920431, 2023-08-01T19:54:47.561 INFO:teuthology.orchestra.run.smithi155.stdout: "duration": 0.014309451000000001, 2023-08-01T19:54:47.561 INFO:teuthology.orchestra.run.smithi155.stdout: "type_data": { 2023-08-01T19:54:47.561 INFO:teuthology.orchestra.run.smithi155.stdout: "flag_point": "commit sent; apply or cleanup", 2023-08-01T19:54:47.561 INFO:teuthology.orchestra.run.smithi155.stdout: "client_info": { 2023-08-01T19:54:47.561 INFO:teuthology.orchestra.run.smithi155.stdout: "client": "client.4668", 2023-08-01T19:54:47.561 INFO:teuthology.orchestra.run.smithi155.stdout: "client_addr": "172.21.15.6:0/1709472247", 2023-08-01T19:54:47.561 INFO:teuthology.orchestra.run.smithi155.stdout: "tid": 56485 2023-08-01T19:54:47.562 INFO:teuthology.orchestra.run.smithi155.stdout: }, 2023-08-01T19:54:47.562 INFO:teuthology.orchestra.run.smithi155.stdout: "events": [ 2023-08-01T19:54:47.562 INFO:teuthology.orchestra.run.smithi155.stdout: { 2023-08-01T19:54:47.562 INFO:teuthology.orchestra.run.smithi155.stdout: "event": "initiated", 2023-08-01T19:54:47.562 INFO:teuthology.orchestra.run.smithi155.stdout: "time": "2023-08-01T19:54:43.174569+0000", 2023-08-01T19:54:47.562 INFO:teuthology.orchestra.run.smithi155.stdout: "duration": 0 2023-08-01T19:54:47.562 INFO:teuthology.orchestra.run.smithi155.stdout: }, 2023-08-01T19:54:47.563 INFO:teuthology.orchestra.run.smithi155.stdout: { 2023-08-01T19:54:47.563 INFO:teuthology.orchestra.run.smithi155.stdout: "event": "throttled", 2023-08-01T19:54:47.563 INFO:teuthology.orchestra.run.smithi155.stdout: "time": "2023-08-01T19:54:43.174569+0000", 2023-08-01T19:54:47.563 INFO:teuthology.orchestra.run.smithi155.stdout: "duration": 0 2023-08-01T19:54:47.563 INFO:teuthology.orchestra.run.smithi155.stdout: }, 2023-08-01T19:54:47.563 INFO:teuthology.orchestra.run.smithi155.stdout: { 2023-08-01T19:54:47.563 INFO:teuthology.orchestra.run.smithi155.stdout: "event": "header_read", 2023-08-01T19:54:47.563 INFO:teuthology.orchestra.run.smithi155.stdout: "time": "2023-08-01T19:54:43.174568+0000", 2023-08-01T19:54:47.564 INFO:teuthology.orchestra.run.smithi155.stdout: "duration": 4294967295.9999995 2023-08-01T19:54:47.564 INFO:teuthology.orchestra.run.smithi155.stdout: }, 2023-08-01T19:54:47.564 INFO:teuthology.orchestra.run.smithi155.stdout: { 2023-08-01T19:54:47.564 INFO:teuthology.orchestra.run.smithi155.stdout: "event": "all_read", 2023-08-01T19:54:47.564 INFO:teuthology.orchestra.run.smithi155.stdout: "time": "2023-08-01T19:54:43.174695+0000", 2023-08-01T19:54:47.564 INFO:teuthology.orchestra.run.smithi155.stdout: "duration": 0.00012672700000000001 2023-08-01T19:54:47.564 INFO:teuthology.orchestra.run.smithi155.stdout: }, 2023-08-01T19:54:47.564 INFO:teuthology.orchestra.run.smithi155.stdout: { 2023-08-01T19:54:47.565 INFO:teuthology.orchestra.run.smithi155.stdout: "event": "dispatched", 2023-08-01T19:54:47.565 INFO:teuthology.orchestra.run.smithi155.stdout: "time": "2023-08-01T19:54:43.174700+0000", 2023-08-01T19:54:47.565 INFO:teuthology.orchestra.run.smithi155.stdout: "duration": 5.3059999999999997e-06 2023-08-01T19:54:47.565 INFO:teuthology.orchestra.run.smithi155.stdout: }, 2023-08-01T19:54:47.565 INFO:teuthology.orchestra.run.smithi155.stdout: { 2023-08-01T19:54:47.565 INFO:teuthology.orchestra.run.smithi155.stdout: "event": "queued_for_pg", 2023-08-01T19:54:47.565 INFO:teuthology.orchestra.run.smithi155.stdout: "time": "2023-08-01T19:54:43.174703+0000", 2023-08-01T19:54:47.565 INFO:teuthology.orchestra.run.smithi155.stdout: "duration": 3.1700000000000001e-06 2023-08-01T19:54:47.566 INFO:teuthology.orchestra.run.smithi155.stdout: }, 2023-08-01T19:54:47.566 INFO:teuthology.orchestra.run.smithi155.stdout: { 2023-08-01T19:54:47.566 INFO:teuthology.orchestra.run.smithi155.stdout: "event": "reached_pg", 2023-08-01T19:54:47.566 INFO:teuthology.orchestra.run.smithi155.stdout: "time": "2023-08-01T19:54:43.176678+0000", 2023-08-01T19:54:47.566 INFO:teuthology.orchestra.run.smithi155.stdout: "duration": 0.0019748169999999998 2023-08-01T19:54:47.566 INFO:teuthology.orchestra.run.smithi155.stdout: }, 2023-08-01T19:54:47.566 INFO:teuthology.orchestra.run.smithi155.stdout: { 2023-08-01T19:54:47.566 INFO:teuthology.orchestra.run.smithi155.stdout: "event": "started", 2023-08-01T19:54:47.567 INFO:teuthology.orchestra.run.smithi155.stdout: "time": "2023-08-01T19:54:43.176800+0000", 2023-08-01T19:54:47.567 INFO:teuthology.orchestra.run.smithi155.stdout: "duration": 0.000122244 2023-08-01T19:54:47.567 INFO:teuthology.orchestra.run.smithi155.stdout: }, 2023-08-01T19:54:47.567 INFO:teuthology.orchestra.run.smithi155.stdout: { 2023-08-01T19:54:47.567 INFO:teuthology.orchestra.run.smithi155.stdout: "event": "waiting for subops from 0", 2023-08-01T19:54:47.567 INFO:teuthology.orchestra.run.smithi155.stdout: "time": "2023-08-01T19:54:43.176936+0000", 2023-08-01T19:54:47.567 INFO:teuthology.orchestra.run.smithi155.stdout: "duration": 0.00013610900000000001 2023-08-01T19:54:47.567 INFO:teuthology.orchestra.run.smithi155.stdout: }, 2023-08-01T19:54:47.568 INFO:teuthology.orchestra.run.smithi155.stdout: { 2023-08-01T19:54:47.568 INFO:teuthology.orchestra.run.smithi155.stdout: "event": "op_commit", 2023-08-01T19:54:47.568 INFO:teuthology.orchestra.run.smithi155.stdout: "time": "2023-08-01T19:54:43.179608+0000", 2023-08-01T19:54:47.568 INFO:teuthology.orchestra.run.smithi155.stdout: "duration": 0.0026718979999999998 2023-08-01T19:54:47.568 INFO:teuthology.orchestra.run.smithi155.stdout: }, 2023-08-01T19:54:47.568 INFO:teuthology.orchestra.run.smithi155.stdout: { 2023-08-01T19:54:47.568 INFO:teuthology.orchestra.run.smithi155.stdout: "event": "sub_op_commit_rec", 2023-08-01T19:54:47.569 INFO:teuthology.orchestra.run.smithi155.stdout: "time": "2023-08-01T19:54:43.188787+0000", 2023-08-01T19:54:47.569 INFO:teuthology.orchestra.run.smithi155.stdout: "duration": 0.0091784220000000003 2023-08-01T19:54:47.569 INFO:teuthology.orchestra.run.smithi155.stdout: }, 2023-08-01T19:54:47.569 INFO:teuthology.orchestra.run.smithi155.stdout: { 2023-08-01T19:54:47.569 INFO:teuthology.orchestra.run.smithi155.stdout: "event": "commit_sent", 2023-08-01T19:54:47.569 INFO:teuthology.orchestra.run.smithi155.stdout: "time": "2023-08-01T19:54:43.188836+0000", 2023-08-01T19:54:47.569 INFO:teuthology.orchestra.run.smithi155.stdout: "duration": 4.9434000000000001e-05 2023-08-01T19:54:47.569 INFO:teuthology.orchestra.run.smithi155.stdout: }, 2023-08-01T19:54:47.570 INFO:teuthology.orchestra.run.smithi155.stdout: { 2023-08-01T19:54:47.570 INFO:teuthology.orchestra.run.smithi155.stdout: "event": "done", 2023-08-01T19:54:47.570 INFO:teuthology.orchestra.run.smithi155.stdout: "time": "2023-08-01T19:54:43.188878+0000", 2023-08-01T19:54:47.570 INFO:teuthology.orchestra.run.smithi155.stdout: "duration": 4.1940000000000002e-05 2023-08-01T19:54:47.570 INFO:teuthology.orchestra.run.smithi155.stdout: } 2023-08-01T19:54:47.570 INFO:teuthology.orchestra.run.smithi155.stdout: ] 2023-08-01T19:54:47.570 INFO:teuthology.orchestra.run.smithi155.stdout: } 2023-08-01T19:54:47.570 INFO:teuthology.orchestra.run.smithi155.stdout: }, 2023-08-01T19:54:47.571 INFO:teuthology.orchestra.run.smithi155.stdout: { 2023-08-01T19:54:47.571 INFO:teuthology.orchestra.run.smithi155.stdout: "description": "osd_op(client.4668.0:61802 5.b 5:dcfcf99c:::benchmark_data_smithi006_114134_object61801:head [set-alloc-hint object_size 65536 write_size 65536,write 0~65536] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e29)", 2023-08-01T19:54:47.571 INFO:teuthology.orchestra.run.smithi155.stdout: "initiated_at": "2023-08-01T19:54:45.742720+0000", 2023-08-01T19:54:47.571 INFO:teuthology.orchestra.run.smithi155.stdout: "age": 1.6697688390000001, 2023-08-01T19:54:47.571 INFO:teuthology.orchestra.run.smithi155.stdout: "duration": 0.017797548999999999, 2023-08-01T19:54:47.571 INFO:teuthology.orchestra.run.smithi155.stdout: "type_data": { 2023-08-01T19:54:47.571 INFO:teuthology.orchestra.run.smithi155.stdout: "flag_point": "commit sent; apply or cleanup", 2023-08-01T19:54:47.571 INFO:teuthology.orchestra.run.smithi155.stdout: "client_info": { 2023-08-01T19:54:47.572 INFO:teuthology.orchestra.run.smithi155.stdout: "client": "client.4668", 2023-08-01T19:54:47.572 INFO:teuthology.orchestra.run.smithi155.stdout: "client_addr": "172.21.15.6:0/1709472247", 2023-08-01T19:54:47.572 INFO:teuthology.orchestra.run.smithi155.stdout: "tid": 61802 2023-08-01T19:54:47.572 INFO:teuthology.orchestra.run.smithi155.stdout: }, 2023-08-01T19:54:47.572 INFO:teuthology.orchestra.run.smithi155.stdout: "events": [ 2023-08-01T19:54:47.572 INFO:teuthology.orchestra.run.smithi155.stdout: { 2023-08-01T19:54:47.572 INFO:teuthology.orchestra.run.smithi155.stdout: "event": "initiated", 2023-08-01T19:54:47.572 INFO:teuthology.orchestra.run.smithi155.stdout: "time": "2023-08-01T19:54:45.742720+0000", 2023-08-01T19:54:47.573 INFO:teuthology.orchestra.run.smithi155.stdout: "duration": 0 2023-08-01T19:54:47.573 INFO:teuthology.orchestra.run.smithi155.stdout: }, 2023-08-01T19:54:47.573 INFO:teuthology.orchestra.run.smithi155.stdout: { 2023-08-01T19:54:47.573 INFO:teuthology.orchestra.run.smithi155.stdout: "event": "throttled", 2023-08-01T19:54:47.573 INFO:teuthology.orchestra.run.smithi155.stdout: "time": "2023-08-01T19:54:45.742720+0000", 2023-08-01T19:54:47.573 INFO:teuthology.orchestra.run.smithi155.stdout: "duration": 0 2023-08-01T19:54:47.573 INFO:teuthology.orchestra.run.smithi155.stdout: }, 2023-08-01T19:54:47.573 INFO:teuthology.orchestra.run.smithi155.stdout: { 2023-08-01T19:54:47.574 INFO:teuthology.orchestra.run.smithi155.stdout: "event": "header_read", 2023-08-01T19:54:47.574 INFO:teuthology.orchestra.run.smithi155.stdout: "time": "2023-08-01T19:54:45.742720+0000", 2023-08-01T19:54:47.574 INFO:teuthology.orchestra.run.smithi155.stdout: "duration": 4294967295.9999995 2023-08-01T19:54:47.574 INFO:teuthology.orchestra.run.smithi155.stdout: }, 2023-08-01T19:54:47.574 INFO:teuthology.orchestra.run.smithi155.stdout: { 2023-08-01T19:54:47.574 INFO:teuthology.orchestra.run.smithi155.stdout: "event": "all_read", 2023-08-01T19:54:47.574 INFO:teuthology.orchestra.run.smithi155.stdout: "time": "2023-08-01T19:54:45.742747+0000", 2023-08-01T19:54:47.574 INFO:teuthology.orchestra.run.smithi155.stdout: "duration": 2.7713e-05 2023-08-01T19:54:47.575 INFO:teuthology.orchestra.run.smithi155.stdout: }, 2023-08-01T19:54:47.575 INFO:teuthology.orchestra.run.smithi155.stdout: { 2023-08-01T19:54:47.575 INFO:teuthology.orchestra.run.smithi155.stdout: "event": "dispatched", 2023-08-01T19:54:47.575 INFO:teuthology.orchestra.run.smithi155.stdout: "time": "2023-08-01T19:54:45.742752+0000", 2023-08-01T19:54:47.575 INFO:teuthology.orchestra.run.smithi155.stdout: "duration": 4.8080000000000004e-06 2023-08-01T19:54:47.575 INFO:teuthology.orchestra.run.smithi155.stdout: }, 2023-08-01T19:54:47.575 INFO:teuthology.orchestra.run.smithi155.stdout: { 2023-08-01T19:54:47.575 INFO:teuthology.orchestra.run.smithi155.stdout: "event": "queued_for_pg", 2023-08-01T19:54:47.576 INFO:teuthology.orchestra.run.smithi155.stdout: "time": "2023-08-01T19:54:45.742757+0000", 2023-08-01T19:54:47.576 INFO:teuthology.orchestra.run.smithi155.stdout: "duration": 4.5220000000000001e-06 2023-08-01T19:54:47.576 INFO:teuthology.orchestra.run.smithi155.stdout: }, 2023-08-01T19:54:47.576 INFO:teuthology.orchestra.run.smithi155.stdout: { 2023-08-01T19:54:47.576 INFO:teuthology.orchestra.run.smithi155.stdout: "event": "reached_pg", 2023-08-01T19:54:47.576 INFO:teuthology.orchestra.run.smithi155.stdout: "time": "2023-08-01T19:54:45.744448+0000", 2023-08-01T19:54:47.576 INFO:teuthology.orchestra.run.smithi155.stdout: "duration": 0.0016914600000000001 2023-08-01T19:54:47.577 INFO:teuthology.orchestra.run.smithi155.stdout: }, 2023-08-01T19:54:47.577 INFO:teuthology.orchestra.run.smithi155.stdout: { 2023-08-01T19:54:47.577 INFO:teuthology.orchestra.run.smithi155.stdout: "event": "started", 2023-08-01T19:54:47.577 INFO:teuthology.orchestra.run.smithi155.stdout: "time": "2023-08-01T19:54:45.744538+0000", 2023-08-01T19:54:47.577 INFO:teuthology.orchestra.run.smithi155.stdout: "duration": 8.9615000000000002e-05 2023-08-01T19:54:47.577 INFO:teuthology.orchestra.run.smithi155.stdout: }, 2023-08-01T19:54:47.577 INFO:teuthology.orchestra.run.smithi155.stdout: { 2023-08-01T19:54:47.577 INFO:teuthology.orchestra.run.smithi155.stdout: "event": "waiting for subops from 0", 2023-08-01T19:54:47.578 INFO:teuthology.orchestra.run.smithi155.stdout: "time": "2023-08-01T19:54:45.744620+0000", 2023-08-01T19:54:47.578 INFO:teuthology.orchestra.run.smithi155.stdout: "duration": 8.1681000000000006e-05 2023-08-01T19:54:47.578 INFO:teuthology.orchestra.run.smithi155.stdout: }, 2023-08-01T19:54:47.578 INFO:teuthology.orchestra.run.smithi155.stdout: { 2023-08-01T19:54:47.578 INFO:teuthology.orchestra.run.smithi155.stdout: "event": "op_commit", 2023-08-01T19:54:47.578 INFO:teuthology.orchestra.run.smithi155.stdout: "time": "2023-08-01T19:54:45.746954+0000", 2023-08-01T19:54:47.578 INFO:teuthology.orchestra.run.smithi155.stdout: "duration": 0.0023339490000000001 2023-08-01T19:54:47.578 INFO:teuthology.orchestra.run.smithi155.stdout: }, 2023-08-01T19:54:47.579 INFO:teuthology.orchestra.run.smithi155.stdout: { 2023-08-01T19:54:47.579 INFO:teuthology.orchestra.run.smithi155.stdout: "event": "sub_op_commit_rec", 2023-08-01T19:54:47.579 INFO:teuthology.orchestra.run.smithi155.stdout: "time": "2023-08-01T19:54:45.760465+0000", 2023-08-01T19:54:47.579 INFO:teuthology.orchestra.run.smithi155.stdout: "duration": 0.013511861 2023-08-01T19:54:47.579 INFO:teuthology.orchestra.run.smithi155.stdout: }, 2023-08-01T19:54:47.579 INFO:teuthology.orchestra.run.smithi155.stdout: { 2023-08-01T19:54:47.579 INFO:teuthology.orchestra.run.smithi155.stdout: "event": "commit_sent", 2023-08-01T19:54:47.579 INFO:teuthology.orchestra.run.smithi155.stdout: "time": "2023-08-01T19:54:45.760494+0000", 2023-08-01T19:54:47.580 INFO:teuthology.orchestra.run.smithi155.stdout: "duration": 2.9025000000000001e-05 2023-08-01T19:54:47.580 INFO:teuthology.orchestra.run.smithi155.stdout: }, 2023-08-01T19:54:47.580 INFO:teuthology.orchestra.run.smithi155.stdout: { 2023-08-01T19:54:47.580 INFO:teuthology.orchestra.run.smithi155.stdout: "event": "done", 2023-08-01T19:54:47.580 INFO:teuthology.orchestra.run.smithi155.stdout: "time": "2023-08-01T19:54:45.760518+0000", 2023-08-01T19:54:47.580 INFO:teuthology.orchestra.run.smithi155.stdout: "duration": 2.3269e-05 2023-08-01T19:54:47.580 INFO:teuthology.orchestra.run.smithi155.stdout: } 2023-08-01T19:54:47.580 INFO:teuthology.orchestra.run.smithi155.stdout: ] 2023-08-01T19:54:47.581 INFO:teuthology.orchestra.run.smithi155.stdout: } 2023-08-01T19:54:47.581 INFO:teuthology.orchestra.run.smithi155.stdout: }, 2023-08-01T19:54:47.581 INFO:teuthology.orchestra.run.smithi155.stdout: { 2023-08-01T19:54:47.581 INFO:teuthology.orchestra.run.smithi155.stdout: "description": "osd_op(client.4668.0:64943 5.0 5:0954dd11:::benchmark_data_smithi006_114134_object64942:head [set-alloc-hint object_size 65536 write_size 65536,write 0~65536] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e29)", 2023-08-01T19:54:47.581 INFO:teuthology.orchestra.run.smithi155.stdout: "initiated_at": "2023-08-01T19:54:47.215584+0000", 2023-08-01T19:54:47.581 INFO:teuthology.orchestra.run.smithi155.stdout: "age": 0.196905204, 2023-08-01T19:54:47.581 INFO:teuthology.orchestra.run.smithi155.stdout: "duration": 0.014094531, 2023-08-01T19:54:47.581 INFO:teuthology.orchestra.run.smithi155.stdout: "type_data": { 2023-08-01T19:54:47.582 INFO:teuthology.orchestra.run.smithi155.stdout: "flag_point": "commit sent; apply or cleanup", 2023-08-01T19:54:47.582 INFO:teuthology.orchestra.run.smithi155.stdout: "client_info": { 2023-08-01T19:54:47.582 INFO:teuthology.orchestra.run.smithi155.stdout: "client": "client.4668", 2023-08-01T19:54:47.582 INFO:teuthology.orchestra.run.smithi155.stdout: "client_addr": "172.21.15.6:0/1709472247", 2023-08-01T19:54:47.582 INFO:teuthology.orchestra.run.smithi155.stdout: "tid": 64943 2023-08-01T19:54:47.582 INFO:teuthology.orchestra.run.smithi155.stdout: }, 2023-08-01T19:54:47.582 INFO:teuthology.orchestra.run.smithi155.stdout: "events": [ 2023-08-01T19:54:47.583 INFO:teuthology.orchestra.run.smithi155.stdout: { 2023-08-01T19:54:47.583 INFO:teuthology.orchestra.run.smithi155.stdout: "event": "initiated", 2023-08-01T19:54:47.583 INFO:teuthology.orchestra.run.smithi155.stdout: "time": "2023-08-01T19:54:47.215584+0000", 2023-08-01T19:54:47.583 INFO:teuthology.orchestra.run.smithi155.stdout: "duration": 0 2023-08-01T19:54:47.583 INFO:teuthology.orchestra.run.smithi155.stdout: }, 2023-08-01T19:54:47.583 INFO:teuthology.orchestra.run.smithi155.stdout: { 2023-08-01T19:54:47.583 INFO:teuthology.orchestra.run.smithi155.stdout: "event": "throttled", 2023-08-01T19:54:47.583 INFO:teuthology.orchestra.run.smithi155.stdout: "time": "2023-08-01T19:54:47.215584+0000", 2023-08-01T19:54:47.584 INFO:teuthology.orchestra.run.smithi155.stdout: "duration": 0 2023-08-01T19:54:47.584 INFO:teuthology.orchestra.run.smithi155.stdout: }, 2023-08-01T19:54:47.584 INFO:teuthology.orchestra.run.smithi155.stdout: { 2023-08-01T19:54:47.584 INFO:teuthology.orchestra.run.smithi155.stdout: "event": "header_read", 2023-08-01T19:54:47.584 INFO:teuthology.orchestra.run.smithi155.stdout: "time": "2023-08-01T19:54:47.215583+0000", 2023-08-01T19:54:47.584 INFO:teuthology.orchestra.run.smithi155.stdout: "duration": 4294967295.999999 2023-08-01T19:54:47.584 INFO:teuthology.orchestra.run.smithi155.stdout: }, 2023-08-01T19:54:47.584 INFO:teuthology.orchestra.run.smithi155.stdout: { 2023-08-01T19:54:47.585 INFO:teuthology.orchestra.run.smithi155.stdout: "event": "all_read", 2023-08-01T19:54:47.585 INFO:teuthology.orchestra.run.smithi155.stdout: "time": "2023-08-01T19:54:47.215697+0000", 2023-08-01T19:54:47.585 INFO:teuthology.orchestra.run.smithi155.stdout: "duration": 0.000114342 2023-08-01T19:54:47.585 INFO:teuthology.orchestra.run.smithi155.stdout: }, 2023-08-01T19:54:47.585 INFO:teuthology.orchestra.run.smithi155.stdout: { 2023-08-01T19:54:47.585 INFO:teuthology.orchestra.run.smithi155.stdout: "event": "dispatched", 2023-08-01T19:54:47.585 INFO:teuthology.orchestra.run.smithi155.stdout: "time": "2023-08-01T19:54:47.215708+0000", 2023-08-01T19:54:47.585 INFO:teuthology.orchestra.run.smithi155.stdout: "duration": 1.0788000000000001e-05 2023-08-01T19:54:47.586 INFO:teuthology.orchestra.run.smithi155.stdout: }, 2023-08-01T19:54:47.586 INFO:teuthology.orchestra.run.smithi155.stdout: { 2023-08-01T19:54:47.586 INFO:teuthology.orchestra.run.smithi155.stdout: "event": "queued_for_pg", 2023-08-01T19:54:47.586 INFO:teuthology.orchestra.run.smithi155.stdout: "time": "2023-08-01T19:54:47.215713+0000", 2023-08-01T19:54:47.586 INFO:teuthology.orchestra.run.smithi155.stdout: "duration": 5.4870000000000002e-06 2023-08-01T19:54:47.586 INFO:teuthology.orchestra.run.smithi155.stdout: }, 2023-08-01T19:54:47.586 INFO:teuthology.orchestra.run.smithi155.stdout: { 2023-08-01T19:54:47.586 INFO:teuthology.orchestra.run.smithi155.stdout: "event": "reached_pg", 2023-08-01T19:54:47.587 INFO:teuthology.orchestra.run.smithi155.stdout: "time": "2023-08-01T19:54:47.219583+0000", 2023-08-01T19:54:47.587 INFO:teuthology.orchestra.run.smithi155.stdout: "duration": 0.003869323 2023-08-01T19:54:47.587 INFO:teuthology.orchestra.run.smithi155.stdout: }, 2023-08-01T19:54:47.587 INFO:teuthology.orchestra.run.smithi155.stdout: { 2023-08-01T19:54:47.587 INFO:teuthology.orchestra.run.smithi155.stdout: "event": "started", 2023-08-01T19:54:47.587 INFO:teuthology.orchestra.run.smithi155.stdout: "time": "2023-08-01T19:54:47.219684+0000", 2023-08-01T19:54:47.587 INFO:teuthology.orchestra.run.smithi155.stdout: "duration": 0.000100853 2023-08-01T19:54:47.588 INFO:teuthology.orchestra.run.smithi155.stdout: }, 2023-08-01T19:54:47.588 INFO:teuthology.orchestra.run.smithi155.stdout: { 2023-08-01T19:54:47.588 INFO:teuthology.orchestra.run.smithi155.stdout: "event": "waiting for subops from 0", 2023-08-01T19:54:47.588 INFO:teuthology.orchestra.run.smithi155.stdout: "time": "2023-08-01T19:54:47.219834+0000", 2023-08-01T19:54:47.588 INFO:teuthology.orchestra.run.smithi155.stdout: "duration": 0.00015051299999999999 2023-08-01T19:54:47.588 INFO:teuthology.orchestra.run.smithi155.stdout: }, 2023-08-01T19:54:47.588 INFO:teuthology.orchestra.run.smithi155.stdout: { 2023-08-01T19:54:47.588 INFO:teuthology.orchestra.run.smithi155.stdout: "event": "sub_op_commit_rec", 2023-08-01T19:54:47.589 INFO:teuthology.orchestra.run.smithi155.stdout: "time": "2023-08-01T19:54:47.223643+0000", 2023-08-01T19:54:47.589 INFO:teuthology.orchestra.run.smithi155.stdout: "duration": 0.0038090590000000001 2023-08-01T19:54:47.589 INFO:teuthology.orchestra.run.smithi155.stdout: }, 2023-08-01T19:54:47.589 INFO:teuthology.orchestra.run.smithi155.stdout: { 2023-08-01T19:54:47.589 INFO:teuthology.orchestra.run.smithi155.stdout: "event": "op_commit", 2023-08-01T19:54:47.589 INFO:teuthology.orchestra.run.smithi155.stdout: "time": "2023-08-01T19:54:47.229590+0000", 2023-08-01T19:54:47.589 INFO:teuthology.orchestra.run.smithi155.stdout: "duration": 0.0059465569999999999 2023-08-01T19:54:47.589 INFO:teuthology.orchestra.run.smithi155.stdout: }, 2023-08-01T19:54:47.590 INFO:teuthology.orchestra.run.smithi155.stdout: { 2023-08-01T19:54:47.590 INFO:teuthology.orchestra.run.smithi155.stdout: "event": "commit_sent", 2023-08-01T19:54:47.590 INFO:teuthology.orchestra.run.smithi155.stdout: "time": "2023-08-01T19:54:47.229641+0000", 2023-08-01T19:54:47.590 INFO:teuthology.orchestra.run.smithi155.stdout: "duration": 5.1199000000000002e-05 2023-08-01T19:54:47.590 INFO:teuthology.orchestra.run.smithi155.stdout: }, 2023-08-01T19:54:47.590 INFO:teuthology.orchestra.run.smithi155.stdout: { 2023-08-01T19:54:47.590 INFO:teuthology.orchestra.run.smithi155.stdout: "event": "done", 2023-08-01T19:54:47.590 INFO:teuthology.orchestra.run.smithi155.stdout: "time": "2023-08-01T19:54:47.229678+0000", 2023-08-01T19:54:47.591 INFO:teuthology.orchestra.run.smithi155.stdout: "duration": 3.7388999999999997e-05 2023-08-01T19:54:47.591 INFO:teuthology.orchestra.run.smithi155.stdout: } 2023-08-01T19:54:47.591 INFO:teuthology.orchestra.run.smithi155.stdout: ] 2023-08-01T19:54:47.591 INFO:teuthology.orchestra.run.smithi155.stdout: } 2023-08-01T19:54:47.591 INFO:teuthology.orchestra.run.smithi155.stdout: }, 2023-08-01T19:54:47.591 INFO:teuthology.orchestra.run.smithi155.stdout: { 2023-08-01T19:54:47.591 INFO:teuthology.orchestra.run.smithi155.stdout: "description": "osd_op(client.4668.0:65176 5.8 5:1dfd1999:::benchmark_data_smithi006_114134_object65175:head [set-alloc-hint object_size 65536 write_size 65536,write 0~65536] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e29)", 2023-08-01T19:54:47.591 INFO:teuthology.orchestra.run.smithi155.stdout: "initiated_at": "2023-08-01T19:54:47.327635+0000", 2023-08-01T19:54:47.592 INFO:teuthology.orchestra.run.smithi155.stdout: "age": 0.084854036999999993, 2023-08-01T19:54:47.592 INFO:teuthology.orchestra.run.smithi155.stdout: "duration": 0.014471546, 2023-08-01T19:54:47.592 INFO:teuthology.orchestra.run.smithi155.stdout: "type_data": { 2023-08-01T19:54:47.592 INFO:teuthology.orchestra.run.smithi155.stdout: "flag_point": "commit sent; apply or cleanup", 2023-08-01T19:54:47.592 INFO:teuthology.orchestra.run.smithi155.stdout: "client_info": { 2023-08-01T19:54:47.592 INFO:teuthology.orchestra.run.smithi155.stdout: "client": "client.4668", 2023-08-01T19:54:47.592 INFO:teuthology.orchestra.run.smithi155.stdout: "client_addr": "172.21.15.6:0/1709472247", 2023-08-01T19:54:47.593 INFO:teuthology.orchestra.run.smithi155.stdout: "tid": 65176 2023-08-01T19:54:47.593 INFO:teuthology.orchestra.run.smithi155.stdout: }, 2023-08-01T19:54:47.593 INFO:teuthology.orchestra.run.smithi155.stdout: "events": [ 2023-08-01T19:54:47.593 INFO:teuthology.orchestra.run.smithi155.stdout: { 2023-08-01T19:54:47.593 INFO:teuthology.orchestra.run.smithi155.stdout: "event": "initiated", 2023-08-01T19:54:47.593 INFO:teuthology.orchestra.run.smithi155.stdout: "time": "2023-08-01T19:54:47.327635+0000", 2023-08-01T19:54:47.593 INFO:teuthology.orchestra.run.smithi155.stdout: "duration": 0 2023-08-01T19:54:47.593 INFO:teuthology.orchestra.run.smithi155.stdout: }, 2023-08-01T19:54:47.594 INFO:teuthology.orchestra.run.smithi155.stdout: { 2023-08-01T19:54:47.594 INFO:teuthology.orchestra.run.smithi155.stdout: "event": "throttled", 2023-08-01T19:54:47.594 INFO:teuthology.orchestra.run.smithi155.stdout: "time": "2023-08-01T19:54:47.327635+0000", 2023-08-01T19:54:47.594 INFO:teuthology.orchestra.run.smithi155.stdout: "duration": 0 2023-08-01T19:54:47.594 INFO:teuthology.orchestra.run.smithi155.stdout: }, 2023-08-01T19:54:47.594 INFO:teuthology.orchestra.run.smithi155.stdout: { 2023-08-01T19:54:47.594 INFO:teuthology.orchestra.run.smithi155.stdout: "event": "header_read", 2023-08-01T19:54:47.594 INFO:teuthology.orchestra.run.smithi155.stdout: "time": "2023-08-01T19:54:47.327634+0000", 2023-08-01T19:54:47.595 INFO:teuthology.orchestra.run.smithi155.stdout: "duration": 4294967295.999999 2023-08-01T19:54:47.595 INFO:teuthology.orchestra.run.smithi155.stdout: }, 2023-08-01T19:54:47.595 INFO:teuthology.orchestra.run.smithi155.stdout: { 2023-08-01T19:54:47.595 INFO:teuthology.orchestra.run.smithi155.stdout: "event": "all_read", 2023-08-01T19:54:47.595 INFO:teuthology.orchestra.run.smithi155.stdout: "time": "2023-08-01T19:54:47.327689+0000", 2023-08-01T19:54:47.595 INFO:teuthology.orchestra.run.smithi155.stdout: "duration": 5.4481000000000002e-05 2023-08-01T19:54:47.595 INFO:teuthology.orchestra.run.smithi155.stdout: }, 2023-08-01T19:54:47.595 INFO:teuthology.orchestra.run.smithi155.stdout: { 2023-08-01T19:54:47.596 INFO:teuthology.orchestra.run.smithi155.stdout: "event": "dispatched", 2023-08-01T19:54:47.596 INFO:teuthology.orchestra.run.smithi155.stdout: "time": "2023-08-01T19:54:47.327697+0000", 2023-08-01T19:54:47.596 INFO:teuthology.orchestra.run.smithi155.stdout: "duration": 8.0039999999999999e-06 2023-08-01T19:54:47.596 INFO:teuthology.orchestra.run.smithi155.stdout: }, 2023-08-01T19:54:47.596 INFO:teuthology.orchestra.run.smithi155.stdout: { 2023-08-01T19:54:47.596 INFO:teuthology.orchestra.run.smithi155.stdout: "event": "queued_for_pg", 2023-08-01T19:54:47.596 INFO:teuthology.orchestra.run.smithi155.stdout: "time": "2023-08-01T19:54:47.327702+0000", 2023-08-01T19:54:47.596 INFO:teuthology.orchestra.run.smithi155.stdout: "duration": 5.2460000000000003e-06 2023-08-01T19:54:47.597 INFO:teuthology.orchestra.run.smithi155.stdout: }, 2023-08-01T19:54:47.597 INFO:teuthology.orchestra.run.smithi155.stdout: { 2023-08-01T19:54:47.597 INFO:teuthology.orchestra.run.smithi155.stdout: "event": "reached_pg", 2023-08-01T19:54:47.597 INFO:teuthology.orchestra.run.smithi155.stdout: "time": "2023-08-01T19:54:47.328310+0000", 2023-08-01T19:54:47.597 INFO:teuthology.orchestra.run.smithi155.stdout: "duration": 0.00060806100000000002 2023-08-01T19:54:47.597 INFO:teuthology.orchestra.run.smithi155.stdout: }, 2023-08-01T19:54:47.597 INFO:teuthology.orchestra.run.smithi155.stdout: { 2023-08-01T19:54:47.598 INFO:teuthology.orchestra.run.smithi155.stdout: "event": "started", 2023-08-01T19:54:47.598 INFO:teuthology.orchestra.run.smithi155.stdout: "time": "2023-08-01T19:54:47.328447+0000", 2023-08-01T19:54:47.598 INFO:teuthology.orchestra.run.smithi155.stdout: "duration": 0.00013653999999999999 2023-08-01T19:54:47.598 INFO:teuthology.orchestra.run.smithi155.stdout: }, 2023-08-01T19:54:47.598 INFO:teuthology.orchestra.run.smithi155.stdout: { 2023-08-01T19:54:47.598 INFO:teuthology.orchestra.run.smithi155.stdout: "event": "waiting for subops from 0", 2023-08-01T19:54:47.598 INFO:teuthology.orchestra.run.smithi155.stdout: "time": "2023-08-01T19:54:47.328574+0000", 2023-08-01T19:54:47.598 INFO:teuthology.orchestra.run.smithi155.stdout: "duration": 0.00012770699999999999 2023-08-01T19:54:47.599 INFO:teuthology.orchestra.run.smithi155.stdout: }, 2023-08-01T19:54:47.599 INFO:teuthology.orchestra.run.smithi155.stdout: { 2023-08-01T19:54:47.599 INFO:teuthology.orchestra.run.smithi155.stdout: "event": "sub_op_commit_rec", 2023-08-01T19:54:47.599 INFO:teuthology.orchestra.run.smithi155.stdout: "time": "2023-08-01T19:54:47.334693+0000", 2023-08-01T19:54:47.599 INFO:teuthology.orchestra.run.smithi155.stdout: "duration": 0.0061191980000000002 2023-08-01T19:54:47.599 INFO:teuthology.orchestra.run.smithi155.stdout: }, 2023-08-01T19:54:47.599 INFO:teuthology.orchestra.run.smithi155.stdout: { 2023-08-01T19:54:47.599 INFO:teuthology.orchestra.run.smithi155.stdout: "event": "op_commit", 2023-08-01T19:54:47.600 INFO:teuthology.orchestra.run.smithi155.stdout: "time": "2023-08-01T19:54:47.342021+0000", 2023-08-01T19:54:47.600 INFO:teuthology.orchestra.run.smithi155.stdout: "duration": 0.0073274289999999999 2023-08-01T19:54:47.600 INFO:teuthology.orchestra.run.smithi155.stdout: }, 2023-08-01T19:54:47.600 INFO:teuthology.orchestra.run.smithi155.stdout: { 2023-08-01T19:54:47.600 INFO:teuthology.orchestra.run.smithi155.stdout: "event": "commit_sent", 2023-08-01T19:54:47.600 INFO:teuthology.orchestra.run.smithi155.stdout: "time": "2023-08-01T19:54:47.342070+0000", 2023-08-01T19:54:47.600 INFO:teuthology.orchestra.run.smithi155.stdout: "duration": 4.8656000000000003e-05 2023-08-01T19:54:47.601 INFO:teuthology.orchestra.run.smithi155.stdout: }, 2023-08-01T19:54:47.601 INFO:teuthology.orchestra.run.smithi155.stdout: { 2023-08-01T19:54:47.601 INFO:teuthology.orchestra.run.smithi155.stdout: "event": "done", 2023-08-01T19:54:47.601 INFO:teuthology.orchestra.run.smithi155.stdout: "time": "2023-08-01T19:54:47.342106+0000", 2023-08-01T19:54:47.601 INFO:teuthology.orchestra.run.smithi155.stdout: "duration": 3.6944999999999999e-05 2023-08-01T19:54:47.601 INFO:teuthology.orchestra.run.smithi155.stdout: } 2023-08-01T19:54:47.601 INFO:teuthology.orchestra.run.smithi155.stdout: ] 2023-08-01T19:54:47.601 INFO:teuthology.orchestra.run.smithi155.stdout: } 2023-08-01T19:54:47.602 INFO:teuthology.orchestra.run.smithi155.stdout: }, 2023-08-01T19:54:47.602 INFO:teuthology.orchestra.run.smithi155.stdout: { 2023-08-01T19:54:47.602 INFO:teuthology.orchestra.run.smithi155.stdout: "description": "osd_op(client.4668.0:65177 5.d 5:b33a24d4:::benchmark_data_smithi006_114134_object65176:head [set-alloc-hint object_size 65536 write_size 65536,write 0~65536] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e29)", 2023-08-01T19:54:47.602 INFO:teuthology.orchestra.run.smithi155.stdout: "initiated_at": "2023-08-01T19:54:47.328082+0000", 2023-08-01T19:54:47.602 INFO:teuthology.orchestra.run.smithi155.stdout: "age": 0.084407080999999995, 2023-08-01T19:54:47.602 INFO:teuthology.orchestra.run.smithi155.stdout: "duration": 0.01494611, 2023-08-01T19:54:47.602 INFO:teuthology.orchestra.run.smithi155.stdout: "type_data": { 2023-08-01T19:54:47.602 INFO:teuthology.orchestra.run.smithi155.stdout: "flag_point": "commit sent; apply or cleanup", 2023-08-01T19:54:47.603 INFO:teuthology.orchestra.run.smithi155.stdout: "client_info": { 2023-08-01T19:54:47.603 INFO:teuthology.orchestra.run.smithi155.stdout: "client": "client.4668", 2023-08-01T19:54:47.603 INFO:teuthology.orchestra.run.smithi155.stdout: "client_addr": "172.21.15.6:0/1709472247", 2023-08-01T19:54:47.603 INFO:teuthology.orchestra.run.smithi155.stdout: "tid": 65177 2023-08-01T19:54:47.603 INFO:teuthology.orchestra.run.smithi155.stdout: }, 2023-08-01T19:54:47.603 INFO:teuthology.orchestra.run.smithi155.stdout: "events": [ 2023-08-01T19:54:47.603 INFO:teuthology.orchestra.run.smithi155.stdout: { 2023-08-01T19:54:47.603 INFO:teuthology.orchestra.run.smithi155.stdout: "event": "initiated", 2023-08-01T19:54:47.604 INFO:teuthology.orchestra.run.smithi155.stdout: "time": "2023-08-01T19:54:47.328082+0000", 2023-08-01T19:54:47.604 INFO:teuthology.orchestra.run.smithi155.stdout: "duration": 0 2023-08-01T19:54:47.604 INFO:teuthology.orchestra.run.smithi155.stdout: }, 2023-08-01T19:54:47.604 INFO:teuthology.orchestra.run.smithi155.stdout: { 2023-08-01T19:54:47.604 INFO:teuthology.orchestra.run.smithi155.stdout: "event": "throttled", 2023-08-01T19:54:47.604 INFO:teuthology.orchestra.run.smithi155.stdout: "time": "2023-08-01T19:54:47.328082+0000", 2023-08-01T19:54:47.604 INFO:teuthology.orchestra.run.smithi155.stdout: "duration": 0 2023-08-01T19:54:47.605 INFO:teuthology.orchestra.run.smithi155.stdout: }, 2023-08-01T19:54:47.605 INFO:teuthology.orchestra.run.smithi155.stdout: { 2023-08-01T19:54:47.605 INFO:teuthology.orchestra.run.smithi155.stdout: "event": "header_read", 2023-08-01T19:54:47.605 INFO:teuthology.orchestra.run.smithi155.stdout: "time": "2023-08-01T19:54:47.328081+0000", 2023-08-01T19:54:47.605 INFO:teuthology.orchestra.run.smithi155.stdout: "duration": 4294967295.9999995 2023-08-01T19:54:47.605 INFO:teuthology.orchestra.run.smithi155.stdout: }, 2023-08-01T19:54:47.605 INFO:teuthology.orchestra.run.smithi155.stdout: { 2023-08-01T19:54:47.605 INFO:teuthology.orchestra.run.smithi155.stdout: "event": "all_read", 2023-08-01T19:54:47.606 INFO:teuthology.orchestra.run.smithi155.stdout: "time": "2023-08-01T19:54:47.328166+0000", 2023-08-01T19:54:47.606 INFO:teuthology.orchestra.run.smithi155.stdout: "duration": 8.4393000000000003e-05 2023-08-01T19:54:47.606 INFO:teuthology.orchestra.run.smithi155.stdout: }, 2023-08-01T19:54:47.606 INFO:teuthology.orchestra.run.smithi155.stdout: { 2023-08-01T19:54:47.606 INFO:teuthology.orchestra.run.smithi155.stdout: "event": "dispatched", 2023-08-01T19:54:47.606 INFO:teuthology.orchestra.run.smithi155.stdout: "time": "2023-08-01T19:54:47.328175+0000", 2023-08-01T19:54:47.606 INFO:teuthology.orchestra.run.smithi155.stdout: "duration": 9.4979999999999995e-06 2023-08-01T19:54:47.606 INFO:teuthology.orchestra.run.smithi155.stdout: }, 2023-08-01T19:54:47.607 INFO:teuthology.orchestra.run.smithi155.stdout: { 2023-08-01T19:54:47.607 INFO:teuthology.orchestra.run.smithi155.stdout: "event": "queued_for_pg", 2023-08-01T19:54:47.607 INFO:teuthology.orchestra.run.smithi155.stdout: "time": "2023-08-01T19:54:47.328185+0000", 2023-08-01T19:54:47.607 INFO:teuthology.orchestra.run.smithi155.stdout: "duration": 9.5580000000000006e-06 2023-08-01T19:54:47.607 INFO:teuthology.orchestra.run.smithi155.stdout: }, 2023-08-01T19:54:47.607 INFO:teuthology.orchestra.run.smithi155.stdout: { 2023-08-01T19:54:47.607 INFO:teuthology.orchestra.run.smithi155.stdout: "event": "reached_pg", 2023-08-01T19:54:47.607 INFO:teuthology.orchestra.run.smithi155.stdout: "time": "2023-08-01T19:54:47.330325+0000", 2023-08-01T19:54:47.608 INFO:teuthology.orchestra.run.smithi155.stdout: "duration": 0.002140524 2023-08-01T19:54:47.608 INFO:teuthology.orchestra.run.smithi155.stdout: }, 2023-08-01T19:54:47.608 INFO:teuthology.orchestra.run.smithi155.stdout: { 2023-08-01T19:54:47.608 INFO:teuthology.orchestra.run.smithi155.stdout: "event": "started", 2023-08-01T19:54:47.608 INFO:teuthology.orchestra.run.smithi155.stdout: "time": "2023-08-01T19:54:47.330451+0000", 2023-08-01T19:54:47.608 INFO:teuthology.orchestra.run.smithi155.stdout: "duration": 0.00012618800000000001 2023-08-01T19:54:47.608 INFO:teuthology.orchestra.run.smithi155.stdout: }, 2023-08-01T19:54:47.608 INFO:teuthology.orchestra.run.smithi155.stdout: { 2023-08-01T19:54:47.609 INFO:teuthology.orchestra.run.smithi155.stdout: "event": "waiting for subops from 1", 2023-08-01T19:54:47.609 INFO:teuthology.orchestra.run.smithi155.stdout: "time": "2023-08-01T19:54:47.330584+0000", 2023-08-01T19:54:47.609 INFO:teuthology.orchestra.run.smithi155.stdout: "duration": 0.00013225199999999999 2023-08-01T19:54:47.609 INFO:teuthology.orchestra.run.smithi155.stdout: }, 2023-08-01T19:54:47.609 INFO:teuthology.orchestra.run.smithi155.stdout: { 2023-08-01T19:54:47.609 INFO:teuthology.orchestra.run.smithi155.stdout: "event": "sub_op_commit_rec", 2023-08-01T19:54:47.609 INFO:teuthology.orchestra.run.smithi155.stdout: "time": "2023-08-01T19:54:47.337735+0000", 2023-08-01T19:54:47.609 INFO:teuthology.orchestra.run.smithi155.stdout: "duration": 0.0071508889999999997 2023-08-01T19:54:47.610 INFO:teuthology.orchestra.run.smithi155.stdout: }, 2023-08-01T19:54:47.610 INFO:teuthology.orchestra.run.smithi155.stdout: { 2023-08-01T19:54:47.610 INFO:teuthology.orchestra.run.smithi155.stdout: "event": "op_commit", 2023-08-01T19:54:47.610 INFO:teuthology.orchestra.run.smithi155.stdout: "time": "2023-08-01T19:54:47.342942+0000", 2023-08-01T19:54:47.610 INFO:teuthology.orchestra.run.smithi155.stdout: "duration": 0.0052075070000000001 2023-08-01T19:54:47.610 INFO:teuthology.orchestra.run.smithi155.stdout: }, 2023-08-01T19:54:47.610 INFO:teuthology.orchestra.run.smithi155.stdout: { 2023-08-01T19:54:47.610 INFO:teuthology.orchestra.run.smithi155.stdout: "event": "commit_sent", 2023-08-01T19:54:47.611 INFO:teuthology.orchestra.run.smithi155.stdout: "time": "2023-08-01T19:54:47.342989+0000", 2023-08-01T19:54:47.611 INFO:teuthology.orchestra.run.smithi155.stdout: "duration": 4.7345000000000002e-05 2023-08-01T19:54:47.611 INFO:teuthology.orchestra.run.smithi155.stdout: }, 2023-08-01T19:54:47.611 INFO:teuthology.orchestra.run.smithi155.stdout: { 2023-08-01T19:54:47.611 INFO:teuthology.orchestra.run.smithi155.stdout: "event": "done", 2023-08-01T19:54:47.611 INFO:teuthology.orchestra.run.smithi155.stdout: "time": "2023-08-01T19:54:47.343028+0000", 2023-08-01T19:54:47.611 INFO:teuthology.orchestra.run.smithi155.stdout: "duration": 3.8639000000000001e-05 2023-08-01T19:54:47.612 INFO:teuthology.orchestra.run.smithi155.stdout: } 2023-08-01T19:54:47.612 INFO:teuthology.orchestra.run.smithi155.stdout: ] 2023-08-01T19:54:47.612 INFO:teuthology.orchestra.run.smithi155.stdout: } 2023-08-01T19:54:47.612 INFO:teuthology.orchestra.run.smithi155.stdout: }, 2023-08-01T19:54:47.612 INFO:teuthology.orchestra.run.smithi155.stdout: { 2023-08-01T19:54:47.612 INFO:teuthology.orchestra.run.smithi155.stdout: "description": "osd_op(client.4668.0:65178 5.d 5:b0bd6b22:::benchmark_data_smithi006_114134_object65177:head [set-alloc-hint object_size 65536 write_size 65536,write 0~65536] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e29)", 2023-08-01T19:54:47.612 INFO:teuthology.orchestra.run.smithi155.stdout: "initiated_at": "2023-08-01T19:54:47.328191+0000", 2023-08-01T19:54:47.612 INFO:teuthology.orchestra.run.smithi155.stdout: "age": 0.084297504999999995, 2023-08-01T19:54:47.613 INFO:teuthology.orchestra.run.smithi155.stdout: "duration": 0.014888686, 2023-08-01T19:54:47.613 INFO:teuthology.orchestra.run.smithi155.stdout: "type_data": { 2023-08-01T19:54:47.613 INFO:teuthology.orchestra.run.smithi155.stdout: "flag_point": "commit sent; apply or cleanup", 2023-08-01T19:54:47.613 INFO:teuthology.orchestra.run.smithi155.stdout: "client_info": { 2023-08-01T19:54:47.613 INFO:teuthology.orchestra.run.smithi155.stdout: "client": "client.4668", 2023-08-01T19:54:47.613 INFO:teuthology.orchestra.run.smithi155.stdout: "client_addr": "172.21.15.6:0/1709472247", 2023-08-01T19:54:47.613 INFO:teuthology.orchestra.run.smithi155.stdout: "tid": 65178 2023-08-01T19:54:47.613 INFO:teuthology.orchestra.run.smithi155.stdout: }, 2023-08-01T19:54:47.614 INFO:teuthology.orchestra.run.smithi155.stdout: "events": [ 2023-08-01T19:54:47.614 INFO:teuthology.orchestra.run.smithi155.stdout: { 2023-08-01T19:54:47.614 INFO:teuthology.orchestra.run.smithi155.stdout: "event": "initiated", 2023-08-01T19:54:47.614 INFO:teuthology.orchestra.run.smithi155.stdout: "time": "2023-08-01T19:54:47.328191+0000", 2023-08-01T19:54:47.614 INFO:teuthology.orchestra.run.smithi155.stdout: "duration": 0 2023-08-01T19:54:47.614 INFO:teuthology.orchestra.run.smithi155.stdout: }, 2023-08-01T19:54:47.614 INFO:teuthology.orchestra.run.smithi155.stdout: { 2023-08-01T19:54:47.614 INFO:teuthology.orchestra.run.smithi155.stdout: "event": "throttled", 2023-08-01T19:54:47.615 INFO:teuthology.orchestra.run.smithi155.stdout: "time": "2023-08-01T19:54:47.328191+0000", 2023-08-01T19:54:47.615 INFO:teuthology.orchestra.run.smithi155.stdout: "duration": 0 2023-08-01T19:54:47.615 INFO:teuthology.orchestra.run.smithi155.stdout: }, 2023-08-01T19:54:47.615 INFO:teuthology.orchestra.run.smithi155.stdout: { 2023-08-01T19:54:47.615 INFO:teuthology.orchestra.run.smithi155.stdout: "event": "header_read", 2023-08-01T19:54:47.615 INFO:teuthology.orchestra.run.smithi155.stdout: "time": "2023-08-01T19:54:47.328191+0000", 2023-08-01T19:54:47.615 INFO:teuthology.orchestra.run.smithi155.stdout: "duration": 4294967295.9999995 2023-08-01T19:54:47.615 INFO:teuthology.orchestra.run.smithi155.stdout: }, 2023-08-01T19:54:47.616 INFO:teuthology.orchestra.run.smithi155.stdout: { 2023-08-01T19:54:47.616 INFO:teuthology.orchestra.run.smithi155.stdout: "event": "all_read", 2023-08-01T19:54:47.616 INFO:teuthology.orchestra.run.smithi155.stdout: "time": "2023-08-01T19:54:47.328219+0000", 2023-08-01T19:54:47.616 INFO:teuthology.orchestra.run.smithi155.stdout: "duration": 2.7705e-05 2023-08-01T19:54:47.616 INFO:teuthology.orchestra.run.smithi155.stdout: }, 2023-08-01T19:54:47.616 INFO:teuthology.orchestra.run.smithi155.stdout: { 2023-08-01T19:54:47.616 INFO:teuthology.orchestra.run.smithi155.stdout: "event": "dispatched", 2023-08-01T19:54:47.616 INFO:teuthology.orchestra.run.smithi155.stdout: "time": "2023-08-01T19:54:47.328226+0000", 2023-08-01T19:54:47.617 INFO:teuthology.orchestra.run.smithi155.stdout: "duration": 7.294e-06 2023-08-01T19:54:47.617 INFO:teuthology.orchestra.run.smithi155.stdout: }, 2023-08-01T19:54:47.617 INFO:teuthology.orchestra.run.smithi155.stdout: { 2023-08-01T19:54:47.617 INFO:teuthology.orchestra.run.smithi155.stdout: "event": "queued_for_pg", 2023-08-01T19:54:47.617 INFO:teuthology.orchestra.run.smithi155.stdout: "time": "2023-08-01T19:54:47.328230+0000", 2023-08-01T19:54:47.617 INFO:teuthology.orchestra.run.smithi155.stdout: "duration": 4.0600000000000001e-06 2023-08-01T19:54:47.617 INFO:teuthology.orchestra.run.smithi155.stdout: }, 2023-08-01T19:54:47.617 INFO:teuthology.orchestra.run.smithi155.stdout: { 2023-08-01T19:54:47.618 INFO:teuthology.orchestra.run.smithi155.stdout: "event": "reached_pg", 2023-08-01T19:54:47.618 INFO:teuthology.orchestra.run.smithi155.stdout: "time": "2023-08-01T19:54:47.332189+0000", 2023-08-01T19:54:47.618 INFO:teuthology.orchestra.run.smithi155.stdout: "duration": 0.0039594720000000003 2023-08-01T19:54:47.618 INFO:teuthology.orchestra.run.smithi155.stdout: }, 2023-08-01T19:54:47.618 INFO:teuthology.orchestra.run.smithi155.stdout: { 2023-08-01T19:54:47.618 INFO:teuthology.orchestra.run.smithi155.stdout: "event": "started", 2023-08-01T19:54:47.618 INFO:teuthology.orchestra.run.smithi155.stdout: "time": "2023-08-01T19:54:47.332325+0000", 2023-08-01T19:54:47.618 INFO:teuthology.orchestra.run.smithi155.stdout: "duration": 0.00013558900000000001 2023-08-01T19:54:47.619 INFO:teuthology.orchestra.run.smithi155.stdout: }, 2023-08-01T19:54:47.619 INFO:teuthology.orchestra.run.smithi155.stdout: { 2023-08-01T19:54:47.619 INFO:teuthology.orchestra.run.smithi155.stdout: "event": "waiting for subops from 1", 2023-08-01T19:54:47.619 INFO:teuthology.orchestra.run.smithi155.stdout: "time": "2023-08-01T19:54:47.332463+0000", 2023-08-01T19:54:47.619 INFO:teuthology.orchestra.run.smithi155.stdout: "duration": 0.00013809599999999999 2023-08-01T19:54:47.619 INFO:teuthology.orchestra.run.smithi155.stdout: }, 2023-08-01T19:54:47.619 INFO:teuthology.orchestra.run.smithi155.stdout: { 2023-08-01T19:54:47.619 INFO:teuthology.orchestra.run.smithi155.stdout: "event": "sub_op_commit_rec", 2023-08-01T19:54:47.620 INFO:teuthology.orchestra.run.smithi155.stdout: "time": "2023-08-01T19:54:47.337762+0000", 2023-08-01T19:54:47.620 INFO:teuthology.orchestra.run.smithi155.stdout: "duration": 0.0052992890000000004 2023-08-01T19:54:47.620 INFO:teuthology.orchestra.run.smithi155.stdout: }, 2023-08-01T19:54:47.620 INFO:teuthology.orchestra.run.smithi155.stdout: { 2023-08-01T19:54:47.620 INFO:teuthology.orchestra.run.smithi155.stdout: "event": "op_commit", 2023-08-01T19:54:47.620 INFO:teuthology.orchestra.run.smithi155.stdout: "time": "2023-08-01T19:54:47.343038+0000", 2023-08-01T19:54:47.620 INFO:teuthology.orchestra.run.smithi155.stdout: "duration": 0.0052752429999999998 2023-08-01T19:54:47.621 INFO:teuthology.orchestra.run.smithi155.stdout: }, 2023-08-01T19:54:47.621 INFO:teuthology.orchestra.run.smithi155.stdout: { 2023-08-01T19:54:47.621 INFO:teuthology.orchestra.run.smithi155.stdout: "event": "commit_sent", 2023-08-01T19:54:47.621 INFO:teuthology.orchestra.run.smithi155.stdout: "time": "2023-08-01T19:54:47.343062+0000", 2023-08-01T19:54:47.621 INFO:teuthology.orchestra.run.smithi155.stdout: "duration": 2.4102999999999999e-05 2023-08-01T19:54:47.621 INFO:teuthology.orchestra.run.smithi155.stdout: }, 2023-08-01T19:54:47.621 INFO:teuthology.orchestra.run.smithi155.stdout: { 2023-08-01T19:54:47.621 INFO:teuthology.orchestra.run.smithi155.stdout: "event": "done", 2023-08-01T19:54:47.622 INFO:teuthology.orchestra.run.smithi155.stdout: "time": "2023-08-01T19:54:47.343080+0000", 2023-08-01T19:54:47.622 INFO:teuthology.orchestra.run.smithi155.stdout: "duration": 1.8337000000000001e-05 2023-08-01T19:54:47.622 INFO:teuthology.orchestra.run.smithi155.stdout: } 2023-08-01T19:54:47.622 INFO:teuthology.orchestra.run.smithi155.stdout: ] 2023-08-01T19:54:47.622 INFO:teuthology.orchestra.run.smithi155.stdout: } 2023-08-01T19:54:47.622 INFO:teuthology.orchestra.run.smithi155.stdout: } 2023-08-01T19:54:47.622 INFO:teuthology.orchestra.run.smithi155.stdout: ] 2023-08-01T19:54:47.622 INFO:teuthology.orchestra.run.smithi155.stdout:} 2023-08-01T19:54:47.624 INFO:tasks.ceph.osd.2.smithi155.stderr:2023-08-01T19:54:47.622+0000 7faa5c6ac700 -1 received signal: Hangup from /usr/bin/python3 /bin/daemon-helper kill ceph-osd -f --cluster ceph -i 2 (PID: 111337) UID: 0 2023-08-01T19:54:47.624 DEBUG:teuthology.orchestra.run.smithi008:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 30 ceph --cluster ceph --admin-daemon /var/run/ceph/ceph-osd.0.asok dump_ops_in_flight 2023-08-01T19:54:47.724 INFO:tasks.ceph.osd.2.smithi155.stderr:2023-08-01T19:54:47.723+0000 7faa5c6ac700 -1 received signal: Hangup from /usr/bin/python3 /bin/daemon-helper kill ceph-osd -f --cluster ceph -i 2 (PID: 111337) UID: 0 2023-08-01T19:54:47.736 DEBUG:teuthology.orchestra.run.smithi006:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 120 ceph --cluster ceph -- tell 'osd.*' injectargs --osd_enable_op_tracker=false 2023-08-01T19:54:47.749 DEBUG:teuthology.orchestra.run.smithi006:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 120 ceph --cluster ceph osd set nodeep-scrub 2023-08-01T19:54:47.821 INFO:teuthology.orchestra.run.smithi008.stdout:{ 2023-08-01T19:54:47.822 INFO:teuthology.orchestra.run.smithi008.stdout: "ops": [ 2023-08-01T19:54:47.822 INFO:teuthology.orchestra.run.smithi008.stdout: { 2023-08-01T19:54:47.822 INFO:teuthology.orchestra.run.smithi008.stdout: "description": "osd_op(client.4668.0:66149 5.6 5:649de16b:::benchmark_data_smithi006_114134_object66148:head [set-alloc-hint object_size 65536 write_size 65536,write 0~65536 in=65536b] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e29)", 2023-08-01T19:54:47.822 INFO:teuthology.orchestra.run.smithi008.stdout: "initiated_at": "2023-08-01T19:54:47.812723+0000", 2023-08-01T19:54:47.822 INFO:teuthology.orchestra.run.smithi008.stdout: "age": 0.006726676, 2023-08-01T19:54:47.822 INFO:teuthology.orchestra.run.smithi008.stdout: "duration": 0.0067641840000000003, 2023-08-01T19:54:47.822 INFO:teuthology.orchestra.run.smithi008.stdout: "type_data": { 2023-08-01T19:54:47.822 INFO:teuthology.orchestra.run.smithi008.stdout: "flag_point": "waiting for sub ops", 2023-08-01T19:54:47.823 INFO:teuthology.orchestra.run.smithi008.stdout: "client_info": { 2023-08-01T19:54:47.823 INFO:teuthology.orchestra.run.smithi008.stdout: "client": "client.4668", 2023-08-01T19:54:47.823 INFO:teuthology.orchestra.run.smithi008.stdout: "client_addr": "172.21.15.6:0/1709472247", 2023-08-01T19:54:47.823 INFO:teuthology.orchestra.run.smithi008.stdout: "tid": 66149 2023-08-01T19:54:47.823 INFO:teuthology.orchestra.run.smithi008.stdout: }, 2023-08-01T19:54:47.823 INFO:teuthology.orchestra.run.smithi008.stdout: "events": [ 2023-08-01T19:54:47.823 INFO:teuthology.orchestra.run.smithi008.stdout: { 2023-08-01T19:54:47.824 INFO:teuthology.orchestra.run.smithi008.stdout: "event": "initiated", 2023-08-01T19:54:47.824 INFO:teuthology.orchestra.run.smithi008.stdout: "time": "2023-08-01T19:54:47.812723+0000", 2023-08-01T19:54:47.824 INFO:teuthology.orchestra.run.smithi008.stdout: "duration": 0 2023-08-01T19:54:47.824 INFO:teuthology.orchestra.run.smithi008.stdout: }, 2023-08-01T19:54:47.824 INFO:teuthology.orchestra.run.smithi008.stdout: { 2023-08-01T19:54:47.824 INFO:teuthology.orchestra.run.smithi008.stdout: "event": "throttled", 2023-08-01T19:54:47.824 INFO:teuthology.orchestra.run.smithi008.stdout: "time": "2023-08-01T19:54:47.812723+0000", 2023-08-01T19:54:47.824 INFO:teuthology.orchestra.run.smithi008.stdout: "duration": 0 2023-08-01T19:54:47.825 INFO:teuthology.orchestra.run.smithi008.stdout: }, 2023-08-01T19:54:47.825 INFO:teuthology.orchestra.run.smithi008.stdout: { 2023-08-01T19:54:47.825 INFO:teuthology.orchestra.run.smithi008.stdout: "event": "header_read", 2023-08-01T19:54:47.825 INFO:teuthology.orchestra.run.smithi008.stdout: "time": "2023-08-01T19:54:47.812722+0000", 2023-08-01T19:54:47.825 INFO:teuthology.orchestra.run.smithi008.stdout: "duration": 4294967295.999999 2023-08-01T19:54:47.825 INFO:teuthology.orchestra.run.smithi008.stdout: }, 2023-08-01T19:54:47.825 INFO:teuthology.orchestra.run.smithi008.stdout: { 2023-08-01T19:54:47.826 INFO:teuthology.orchestra.run.smithi008.stdout: "event": "all_read", 2023-08-01T19:54:47.826 INFO:teuthology.orchestra.run.smithi008.stdout: "time": "2023-08-01T19:54:47.812768+0000", 2023-08-01T19:54:47.826 INFO:teuthology.orchestra.run.smithi008.stdout: "duration": 4.5725e-05 2023-08-01T19:54:47.826 INFO:teuthology.orchestra.run.smithi008.stdout: }, 2023-08-01T19:54:47.826 INFO:teuthology.orchestra.run.smithi008.stdout: { 2023-08-01T19:54:47.826 INFO:teuthology.orchestra.run.smithi008.stdout: "event": "dispatched", 2023-08-01T19:54:47.826 INFO:teuthology.orchestra.run.smithi008.stdout: "time": "2023-08-01T19:54:47.812780+0000", 2023-08-01T19:54:47.826 INFO:teuthology.orchestra.run.smithi008.stdout: "duration": 1.2325e-05 2023-08-01T19:54:47.827 INFO:teuthology.orchestra.run.smithi008.stdout: }, 2023-08-01T19:54:47.827 INFO:teuthology.orchestra.run.smithi008.stdout: { 2023-08-01T19:54:47.827 INFO:teuthology.orchestra.run.smithi008.stdout: "event": "queued_for_pg", 2023-08-01T19:54:47.827 INFO:teuthology.orchestra.run.smithi008.stdout: "time": "2023-08-01T19:54:47.812786+0000", 2023-08-01T19:54:47.827 INFO:teuthology.orchestra.run.smithi008.stdout: "duration": 6.2489999999999998e-06 2023-08-01T19:54:47.827 INFO:teuthology.orchestra.run.smithi008.stdout: }, 2023-08-01T19:54:47.827 INFO:teuthology.orchestra.run.smithi008.stdout: { 2023-08-01T19:54:47.828 INFO:teuthology.orchestra.run.smithi008.stdout: "event": "reached_pg", 2023-08-01T19:54:47.828 INFO:teuthology.orchestra.run.smithi008.stdout: "time": "2023-08-01T19:54:47.812827+0000", 2023-08-01T19:54:47.828 INFO:teuthology.orchestra.run.smithi008.stdout: "duration": 4.0791000000000003e-05 2023-08-01T19:54:47.828 INFO:teuthology.orchestra.run.smithi008.stdout: }, 2023-08-01T19:54:47.828 INFO:teuthology.orchestra.run.smithi008.stdout: { 2023-08-01T19:54:47.828 INFO:teuthology.orchestra.run.smithi008.stdout: "event": "started", 2023-08-01T19:54:47.828 INFO:teuthology.orchestra.run.smithi008.stdout: "time": "2023-08-01T19:54:47.812963+0000", 2023-08-01T19:54:47.828 INFO:teuthology.orchestra.run.smithi008.stdout: "duration": 0.00013594099999999999 2023-08-01T19:54:47.829 INFO:teuthology.orchestra.run.smithi008.stdout: }, 2023-08-01T19:54:47.829 INFO:teuthology.orchestra.run.smithi008.stdout: { 2023-08-01T19:54:47.829 INFO:teuthology.orchestra.run.smithi008.stdout: "event": "waiting for subops from 1", 2023-08-01T19:54:47.829 INFO:teuthology.orchestra.run.smithi008.stdout: "time": "2023-08-01T19:54:47.813110+0000", 2023-08-01T19:54:47.829 INFO:teuthology.orchestra.run.smithi008.stdout: "duration": 0.000147076 2023-08-01T19:54:47.829 INFO:teuthology.orchestra.run.smithi008.stdout: } 2023-08-01T19:54:47.829 INFO:teuthology.orchestra.run.smithi008.stdout: ] 2023-08-01T19:54:47.830 INFO:teuthology.orchestra.run.smithi008.stdout: } 2023-08-01T19:54:47.830 INFO:teuthology.orchestra.run.smithi008.stdout: }, 2023-08-01T19:54:47.830 INFO:teuthology.orchestra.run.smithi008.stdout: { 2023-08-01T19:54:47.830 INFO:teuthology.orchestra.run.smithi008.stdout: "description": "osd_op(client.4668.0:66154 5.6 5:6a03bb99:::benchmark_data_smithi006_114134_object66153:head [set-alloc-hint object_size 65536 write_size 65536,write 0~65536 in=65536b] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e29)", 2023-08-01T19:54:47.830 INFO:teuthology.orchestra.run.smithi008.stdout: "initiated_at": "2023-08-01T19:54:47.813616+0000", 2023-08-01T19:54:47.830 INFO:teuthology.orchestra.run.smithi008.stdout: "age": 0.0058338699999999997, 2023-08-01T19:54:47.830 INFO:teuthology.orchestra.run.smithi008.stdout: "duration": 0.0060089699999999998, 2023-08-01T19:54:47.831 INFO:teuthology.orchestra.run.smithi008.stdout: "type_data": { 2023-08-01T19:54:47.831 INFO:teuthology.orchestra.run.smithi008.stdout: "flag_point": "waiting for sub ops", 2023-08-01T19:54:47.831 INFO:teuthology.orchestra.run.smithi008.stdout: "client_info": { 2023-08-01T19:54:47.831 INFO:teuthology.orchestra.run.smithi008.stdout: "client": "client.4668", 2023-08-01T19:54:47.831 INFO:teuthology.orchestra.run.smithi008.stdout: "client_addr": "172.21.15.6:0/1709472247", 2023-08-01T19:54:47.831 INFO:teuthology.orchestra.run.smithi008.stdout: "tid": 66154 2023-08-01T19:54:47.831 INFO:teuthology.orchestra.run.smithi008.stdout: }, 2023-08-01T19:54:47.831 INFO:teuthology.orchestra.run.smithi008.stdout: "events": [ 2023-08-01T19:54:47.832 INFO:teuthology.orchestra.run.smithi008.stdout: { 2023-08-01T19:54:47.832 INFO:teuthology.orchestra.run.smithi008.stdout: "event": "initiated", 2023-08-01T19:54:47.832 INFO:teuthology.orchestra.run.smithi008.stdout: "time": "2023-08-01T19:54:47.813616+0000", 2023-08-01T19:54:47.832 INFO:teuthology.orchestra.run.smithi008.stdout: "duration": 0 2023-08-01T19:54:47.832 INFO:teuthology.orchestra.run.smithi008.stdout: }, 2023-08-01T19:54:47.832 INFO:teuthology.orchestra.run.smithi008.stdout: { 2023-08-01T19:54:47.832 INFO:teuthology.orchestra.run.smithi008.stdout: "event": "throttled", 2023-08-01T19:54:47.832 INFO:teuthology.orchestra.run.smithi008.stdout: "time": "2023-08-01T19:54:47.813616+0000", 2023-08-01T19:54:47.833 INFO:teuthology.orchestra.run.smithi008.stdout: "duration": 0 2023-08-01T19:54:47.833 INFO:teuthology.orchestra.run.smithi008.stdout: }, 2023-08-01T19:54:47.833 INFO:teuthology.orchestra.run.smithi008.stdout: { 2023-08-01T19:54:47.833 INFO:teuthology.orchestra.run.smithi008.stdout: "event": "header_read", 2023-08-01T19:54:47.833 INFO:teuthology.orchestra.run.smithi008.stdout: "time": "2023-08-01T19:54:47.813613+0000", 2023-08-01T19:54:47.833 INFO:teuthology.orchestra.run.smithi008.stdout: "duration": 4294967295.9999971 2023-08-01T19:54:47.833 INFO:teuthology.orchestra.run.smithi008.stdout: }, 2023-08-01T19:54:47.833 INFO:teuthology.orchestra.run.smithi008.stdout: { 2023-08-01T19:54:47.834 INFO:teuthology.orchestra.run.smithi008.stdout: "event": "all_read", 2023-08-01T19:54:47.834 INFO:teuthology.orchestra.run.smithi008.stdout: "time": "2023-08-01T19:54:47.813722+0000", 2023-08-01T19:54:47.834 INFO:teuthology.orchestra.run.smithi008.stdout: "duration": 0.00010951300000000001 2023-08-01T19:54:47.834 INFO:teuthology.orchestra.run.smithi008.stdout: }, 2023-08-01T19:54:47.834 INFO:teuthology.orchestra.run.smithi008.stdout: { 2023-08-01T19:54:47.834 INFO:teuthology.orchestra.run.smithi008.stdout: "event": "dispatched", 2023-08-01T19:54:47.834 INFO:teuthology.orchestra.run.smithi008.stdout: "time": "2023-08-01T19:54:47.813732+0000", 2023-08-01T19:54:47.835 INFO:teuthology.orchestra.run.smithi008.stdout: "duration": 9.7860000000000008e-06 2023-08-01T19:54:47.835 INFO:teuthology.orchestra.run.smithi008.stdout: }, 2023-08-01T19:54:47.835 INFO:teuthology.orchestra.run.smithi008.stdout: { 2023-08-01T19:54:47.835 INFO:teuthology.orchestra.run.smithi008.stdout: "event": "queued_for_pg", 2023-08-01T19:54:47.835 INFO:teuthology.orchestra.run.smithi008.stdout: "time": "2023-08-01T19:54:47.813739+0000", 2023-08-01T19:54:47.835 INFO:teuthology.orchestra.run.smithi008.stdout: "duration": 6.37e-06 2023-08-01T19:54:47.835 INFO:teuthology.orchestra.run.smithi008.stdout: }, 2023-08-01T19:54:47.835 INFO:teuthology.orchestra.run.smithi008.stdout: { 2023-08-01T19:54:47.836 INFO:teuthology.orchestra.run.smithi008.stdout: "event": "reached_pg", 2023-08-01T19:54:47.836 INFO:teuthology.orchestra.run.smithi008.stdout: "time": "2023-08-01T19:54:47.815938+0000", 2023-08-01T19:54:47.836 INFO:teuthology.orchestra.run.smithi008.stdout: "duration": 0.0021997190000000002 2023-08-01T19:54:47.836 INFO:teuthology.orchestra.run.smithi008.stdout: }, 2023-08-01T19:54:47.836 INFO:teuthology.orchestra.run.smithi008.stdout: { 2023-08-01T19:54:47.836 INFO:teuthology.orchestra.run.smithi008.stdout: "event": "started", 2023-08-01T19:54:47.836 INFO:teuthology.orchestra.run.smithi008.stdout: "time": "2023-08-01T19:54:47.816073+0000", 2023-08-01T19:54:47.836 INFO:teuthology.orchestra.run.smithi008.stdout: "duration": 0.000134709 2023-08-01T19:54:47.837 INFO:teuthology.orchestra.run.smithi008.stdout: }, 2023-08-01T19:54:47.837 INFO:teuthology.orchestra.run.smithi008.stdout: { 2023-08-01T19:54:47.837 INFO:teuthology.orchestra.run.smithi008.stdout: "event": "waiting for subops from 1", 2023-08-01T19:54:47.837 INFO:teuthology.orchestra.run.smithi008.stdout: "time": "2023-08-01T19:54:47.816267+0000", 2023-08-01T19:54:47.837 INFO:teuthology.orchestra.run.smithi008.stdout: "duration": 0.000193616 2023-08-01T19:54:47.837 INFO:teuthology.orchestra.run.smithi008.stdout: } 2023-08-01T19:54:47.837 INFO:teuthology.orchestra.run.smithi008.stdout: ] 2023-08-01T19:54:47.837 INFO:teuthology.orchestra.run.smithi008.stdout: } 2023-08-01T19:54:47.838 INFO:teuthology.orchestra.run.smithi008.stdout: }, 2023-08-01T19:54:47.838 INFO:teuthology.orchestra.run.smithi008.stdout: { 2023-08-01T19:54:47.838 INFO:teuthology.orchestra.run.smithi008.stdout: "description": "osd_op(client.4668.0:66156 5.c 5:39515a11:::benchmark_data_smithi006_114134_object66155:head [set-alloc-hint object_size 65536 write_size 65536,write 0~65536 in=65536b] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e29)", 2023-08-01T19:54:47.838 INFO:teuthology.orchestra.run.smithi008.stdout: "initiated_at": "2023-08-01T19:54:47.813749+0000", 2023-08-01T19:54:47.838 INFO:teuthology.orchestra.run.smithi008.stdout: "age": 0.0057003100000000001, 2023-08-01T19:54:47.838 INFO:teuthology.orchestra.run.smithi008.stdout: "duration": 0.0059624659999999996, 2023-08-01T19:54:47.838 INFO:teuthology.orchestra.run.smithi008.stdout: "type_data": { 2023-08-01T19:54:47.839 INFO:teuthology.orchestra.run.smithi008.stdout: "flag_point": "waiting for sub ops", 2023-08-01T19:54:47.839 INFO:teuthology.orchestra.run.smithi008.stdout: "client_info": { 2023-08-01T19:54:47.839 INFO:teuthology.orchestra.run.smithi008.stdout: "client": "client.4668", 2023-08-01T19:54:47.839 INFO:teuthology.orchestra.run.smithi008.stdout: "client_addr": "172.21.15.6:0/1709472247", 2023-08-01T19:54:47.839 INFO:teuthology.orchestra.run.smithi008.stdout: "tid": 66156 2023-08-01T19:54:47.839 INFO:teuthology.orchestra.run.smithi008.stdout: }, 2023-08-01T19:54:47.839 INFO:teuthology.orchestra.run.smithi008.stdout: "events": [ 2023-08-01T19:54:47.839 INFO:teuthology.orchestra.run.smithi008.stdout: { 2023-08-01T19:54:47.840 INFO:teuthology.orchestra.run.smithi008.stdout: "event": "initiated", 2023-08-01T19:54:47.840 INFO:teuthology.orchestra.run.smithi008.stdout: "time": "2023-08-01T19:54:47.813749+0000", 2023-08-01T19:54:47.840 INFO:teuthology.orchestra.run.smithi008.stdout: "duration": 0 2023-08-01T19:54:47.840 INFO:teuthology.orchestra.run.smithi008.stdout: }, 2023-08-01T19:54:47.840 INFO:teuthology.orchestra.run.smithi008.stdout: { 2023-08-01T19:54:47.840 INFO:teuthology.orchestra.run.smithi008.stdout: "event": "throttled", 2023-08-01T19:54:47.840 INFO:teuthology.orchestra.run.smithi008.stdout: "time": "2023-08-01T19:54:47.813749+0000", 2023-08-01T19:54:47.840 INFO:teuthology.orchestra.run.smithi008.stdout: "duration": 0 2023-08-01T19:54:47.841 INFO:teuthology.orchestra.run.smithi008.stdout: }, 2023-08-01T19:54:47.841 INFO:teuthology.orchestra.run.smithi008.stdout: { 2023-08-01T19:54:47.841 INFO:teuthology.orchestra.run.smithi008.stdout: "event": "header_read", 2023-08-01T19:54:47.841 INFO:teuthology.orchestra.run.smithi008.stdout: "time": "2023-08-01T19:54:47.813749+0000", 2023-08-01T19:54:47.841 INFO:teuthology.orchestra.run.smithi008.stdout: "duration": 4294967295.9999995 2023-08-01T19:54:47.841 INFO:teuthology.orchestra.run.smithi008.stdout: }, 2023-08-01T19:54:47.841 INFO:teuthology.orchestra.run.smithi008.stdout: { 2023-08-01T19:54:47.841 INFO:teuthology.orchestra.run.smithi008.stdout: "event": "all_read", 2023-08-01T19:54:47.842 INFO:teuthology.orchestra.run.smithi008.stdout: "time": "2023-08-01T19:54:47.813781+0000", 2023-08-01T19:54:47.842 INFO:teuthology.orchestra.run.smithi008.stdout: "duration": 3.1859000000000001e-05 2023-08-01T19:54:47.842 INFO:teuthology.orchestra.run.smithi008.stdout: }, 2023-08-01T19:54:47.842 INFO:teuthology.orchestra.run.smithi008.stdout: { 2023-08-01T19:54:47.842 INFO:teuthology.orchestra.run.smithi008.stdout: "event": "dispatched", 2023-08-01T19:54:47.842 INFO:teuthology.orchestra.run.smithi008.stdout: "time": "2023-08-01T19:54:47.813789+0000", 2023-08-01T19:54:47.842 INFO:teuthology.orchestra.run.smithi008.stdout: "duration": 8.3999999999999992e-06 2023-08-01T19:54:47.842 INFO:teuthology.orchestra.run.smithi008.stdout: }, 2023-08-01T19:54:47.843 INFO:teuthology.orchestra.run.smithi008.stdout: { 2023-08-01T19:54:47.843 INFO:teuthology.orchestra.run.smithi008.stdout: "event": "queued_for_pg", 2023-08-01T19:54:47.843 INFO:teuthology.orchestra.run.smithi008.stdout: "time": "2023-08-01T19:54:47.813796+0000", 2023-08-01T19:54:47.843 INFO:teuthology.orchestra.run.smithi008.stdout: "duration": 7.0620000000000003e-06 2023-08-01T19:54:47.843 INFO:teuthology.orchestra.run.smithi008.stdout: }, 2023-08-01T19:54:47.843 INFO:teuthology.orchestra.run.smithi008.stdout: { 2023-08-01T19:54:47.843 INFO:teuthology.orchestra.run.smithi008.stdout: "event": "reached_pg", 2023-08-01T19:54:47.844 INFO:teuthology.orchestra.run.smithi008.stdout: "time": "2023-08-01T19:54:47.813832+0000", 2023-08-01T19:54:47.844 INFO:teuthology.orchestra.run.smithi008.stdout: "duration": 3.5812000000000002e-05 2023-08-01T19:54:47.844 INFO:teuthology.orchestra.run.smithi008.stdout: }, 2023-08-01T19:54:47.844 INFO:teuthology.orchestra.run.smithi008.stdout: { 2023-08-01T19:54:47.844 INFO:teuthology.orchestra.run.smithi008.stdout: "event": "started", 2023-08-01T19:54:47.844 INFO:teuthology.orchestra.run.smithi008.stdout: "time": "2023-08-01T19:54:47.813948+0000", 2023-08-01T19:54:47.844 INFO:teuthology.orchestra.run.smithi008.stdout: "duration": 0.000115696 2023-08-01T19:54:47.844 INFO:teuthology.orchestra.run.smithi008.stdout: }, 2023-08-01T19:54:47.845 INFO:teuthology.orchestra.run.smithi008.stdout: { 2023-08-01T19:54:47.845 INFO:teuthology.orchestra.run.smithi008.stdout: "event": "waiting for subops from 1", 2023-08-01T19:54:47.845 INFO:teuthology.orchestra.run.smithi008.stdout: "time": "2023-08-01T19:54:47.814082+0000", 2023-08-01T19:54:47.845 INFO:teuthology.orchestra.run.smithi008.stdout: "duration": 0.00013408699999999999 2023-08-01T19:54:47.845 INFO:teuthology.orchestra.run.smithi008.stdout: }, 2023-08-01T19:54:47.845 INFO:teuthology.orchestra.run.smithi008.stdout: { 2023-08-01T19:54:47.845 INFO:teuthology.orchestra.run.smithi008.stdout: "event": "op_commit", 2023-08-01T19:54:47.845 INFO:teuthology.orchestra.run.smithi008.stdout: "time": "2023-08-01T19:54:47.818587+0000", 2023-08-01T19:54:47.846 INFO:teuthology.orchestra.run.smithi008.stdout: "duration": 0.0045055420000000004 2023-08-01T19:54:47.846 INFO:teuthology.orchestra.run.smithi008.stdout: } 2023-08-01T19:54:47.846 INFO:teuthology.orchestra.run.smithi008.stdout: ] 2023-08-01T19:54:47.846 INFO:teuthology.orchestra.run.smithi008.stdout: } 2023-08-01T19:54:47.846 INFO:teuthology.orchestra.run.smithi008.stdout: }, 2023-08-01T19:54:47.846 INFO:teuthology.orchestra.run.smithi008.stdout: { 2023-08-01T19:54:47.846 INFO:teuthology.orchestra.run.smithi008.stdout: "description": "osd_repop(client.4668.0:66152 5.b e29/19 5:d2474088:::benchmark_data_smithi006_114134_object66151:head v 29'4074, mlcod=29'4072)", 2023-08-01T19:54:47.847 INFO:teuthology.orchestra.run.smithi008.stdout: "initiated_at": "2023-08-01T19:54:47.813862+0000", 2023-08-01T19:54:47.847 INFO:teuthology.orchestra.run.smithi008.stdout: "age": 0.0055880440000000003, 2023-08-01T19:54:47.847 INFO:teuthology.orchestra.run.smithi008.stdout: "duration": 0.0059393049999999998, 2023-08-01T19:54:47.847 INFO:teuthology.orchestra.run.smithi008.stdout: "type_data": { 2023-08-01T19:54:47.847 INFO:teuthology.orchestra.run.smithi008.stdout: "flag_point": "started", 2023-08-01T19:54:47.847 INFO:teuthology.orchestra.run.smithi008.stdout: "events": [ 2023-08-01T19:54:47.847 INFO:teuthology.orchestra.run.smithi008.stdout: { 2023-08-01T19:54:47.847 INFO:teuthology.orchestra.run.smithi008.stdout: "event": "initiated", 2023-08-01T19:54:47.848 INFO:teuthology.orchestra.run.smithi008.stdout: "time": "2023-08-01T19:54:47.813862+0000", 2023-08-01T19:54:47.848 INFO:teuthology.orchestra.run.smithi008.stdout: "duration": 0 2023-08-01T19:54:47.848 INFO:teuthology.orchestra.run.smithi008.stdout: }, 2023-08-01T19:54:47.848 INFO:teuthology.orchestra.run.smithi008.stdout: { 2023-08-01T19:54:47.848 INFO:teuthology.orchestra.run.smithi008.stdout: "event": "throttled", 2023-08-01T19:54:47.848 INFO:teuthology.orchestra.run.smithi008.stdout: "time": "2023-08-01T19:54:47.813862+0000", 2023-08-01T19:54:47.848 INFO:teuthology.orchestra.run.smithi008.stdout: "duration": 0 2023-08-01T19:54:47.848 INFO:teuthology.orchestra.run.smithi008.stdout: }, 2023-08-01T19:54:47.849 INFO:teuthology.orchestra.run.smithi008.stdout: { 2023-08-01T19:54:47.849 INFO:teuthology.orchestra.run.smithi008.stdout: "event": "header_read", 2023-08-01T19:54:47.849 INFO:teuthology.orchestra.run.smithi008.stdout: "time": "2023-08-01T19:54:47.813861+0000", 2023-08-01T19:54:47.849 INFO:teuthology.orchestra.run.smithi008.stdout: "duration": 4294967295.9999995 2023-08-01T19:54:47.849 INFO:teuthology.orchestra.run.smithi008.stdout: }, 2023-08-01T19:54:47.849 INFO:teuthology.orchestra.run.smithi008.stdout: { 2023-08-01T19:54:47.849 INFO:teuthology.orchestra.run.smithi008.stdout: "event": "all_read", 2023-08-01T19:54:47.850 INFO:teuthology.orchestra.run.smithi008.stdout: "time": "2023-08-01T19:54:47.813921+0000", 2023-08-01T19:54:47.850 INFO:teuthology.orchestra.run.smithi008.stdout: "duration": 6.0358e-05 2023-08-01T19:54:47.850 INFO:teuthology.orchestra.run.smithi008.stdout: }, 2023-08-01T19:54:47.850 INFO:teuthology.orchestra.run.smithi008.stdout: { 2023-08-01T19:54:47.850 INFO:teuthology.orchestra.run.smithi008.stdout: "event": "dispatched", 2023-08-01T19:54:47.850 INFO:teuthology.orchestra.run.smithi008.stdout: "time": "2023-08-01T19:54:47.813931+0000", 2023-08-01T19:54:47.850 INFO:teuthology.orchestra.run.smithi008.stdout: "duration": 9.4350000000000003e-06 2023-08-01T19:54:47.850 INFO:teuthology.orchestra.run.smithi008.stdout: }, 2023-08-01T19:54:47.851 INFO:teuthology.orchestra.run.smithi008.stdout: { 2023-08-01T19:54:47.851 INFO:teuthology.orchestra.run.smithi008.stdout: "event": "queued_for_pg", 2023-08-01T19:54:47.851 INFO:teuthology.orchestra.run.smithi008.stdout: "time": "2023-08-01T19:54:47.813936+0000", 2023-08-01T19:54:47.851 INFO:teuthology.orchestra.run.smithi008.stdout: "duration": 5.1800000000000004e-06 2023-08-01T19:54:47.851 INFO:teuthology.orchestra.run.smithi008.stdout: }, 2023-08-01T19:54:47.851 INFO:teuthology.orchestra.run.smithi008.stdout: { 2023-08-01T19:54:47.851 INFO:teuthology.orchestra.run.smithi008.stdout: "event": "reached_pg", 2023-08-01T19:54:47.852 INFO:teuthology.orchestra.run.smithi008.stdout: "time": "2023-08-01T19:54:47.815881+0000", 2023-08-01T19:54:47.852 INFO:teuthology.orchestra.run.smithi008.stdout: "duration": 0.001945086 2023-08-01T19:54:47.852 INFO:teuthology.orchestra.run.smithi008.stdout: }, 2023-08-01T19:54:47.852 INFO:teuthology.orchestra.run.smithi008.stdout: { 2023-08-01T19:54:47.852 INFO:teuthology.orchestra.run.smithi008.stdout: "event": "started", 2023-08-01T19:54:47.852 INFO:teuthology.orchestra.run.smithi008.stdout: "time": "2023-08-01T19:54:47.815906+0000", 2023-08-01T19:54:47.852 INFO:teuthology.orchestra.run.smithi008.stdout: "duration": 2.4973e-05 2023-08-01T19:54:47.853 INFO:teuthology.orchestra.run.smithi008.stdout: } 2023-08-01T19:54:47.853 INFO:teuthology.orchestra.run.smithi008.stdout: ] 2023-08-01T19:54:47.853 INFO:teuthology.orchestra.run.smithi008.stdout: } 2023-08-01T19:54:47.853 INFO:teuthology.orchestra.run.smithi008.stdout: }, 2023-08-01T19:54:47.853 INFO:teuthology.orchestra.run.smithi008.stdout: { 2023-08-01T19:54:47.853 INFO:teuthology.orchestra.run.smithi008.stdout: "description": "osd_repop(client.4668.0:66157 5.7 e29/19 5:e27612e7:::benchmark_data_smithi006_114134_object66156:head v 29'4156, mlcod=29'4153)", 2023-08-01T19:54:47.853 INFO:teuthology.orchestra.run.smithi008.stdout: "initiated_at": "2023-08-01T19:54:47.815747+0000", 2023-08-01T19:54:47.853 INFO:teuthology.orchestra.run.smithi008.stdout: "age": 0.003702725, 2023-08-01T19:54:47.854 INFO:teuthology.orchestra.run.smithi008.stdout: "duration": 0.0041189920000000001, 2023-08-01T19:54:47.854 INFO:teuthology.orchestra.run.smithi008.stdout: "type_data": { 2023-08-01T19:54:47.854 INFO:teuthology.orchestra.run.smithi008.stdout: "flag_point": "started", 2023-08-01T19:54:47.854 INFO:teuthology.orchestra.run.smithi008.stdout: "events": [ 2023-08-01T19:54:47.854 INFO:teuthology.orchestra.run.smithi008.stdout: { 2023-08-01T19:54:47.854 INFO:teuthology.orchestra.run.smithi008.stdout: "event": "initiated", 2023-08-01T19:54:47.854 INFO:teuthology.orchestra.run.smithi008.stdout: "time": "2023-08-01T19:54:47.815747+0000", 2023-08-01T19:54:47.855 INFO:teuthology.orchestra.run.smithi008.stdout: "duration": 0 2023-08-01T19:54:47.855 INFO:teuthology.orchestra.run.smithi008.stdout: }, 2023-08-01T19:54:47.855 INFO:teuthology.orchestra.run.smithi008.stdout: { 2023-08-01T19:54:47.855 INFO:teuthology.orchestra.run.smithi008.stdout: "event": "throttled", 2023-08-01T19:54:47.855 INFO:teuthology.orchestra.run.smithi008.stdout: "time": "2023-08-01T19:54:47.815747+0000", 2023-08-01T19:54:47.855 INFO:teuthology.orchestra.run.smithi008.stdout: "duration": 0 2023-08-01T19:54:47.855 INFO:teuthology.orchestra.run.smithi008.stdout: }, 2023-08-01T19:54:47.855 INFO:teuthology.orchestra.run.smithi008.stdout: { 2023-08-01T19:54:47.856 INFO:teuthology.orchestra.run.smithi008.stdout: "event": "header_read", 2023-08-01T19:54:47.856 INFO:teuthology.orchestra.run.smithi008.stdout: "time": "2023-08-01T19:54:47.815746+0000", 2023-08-01T19:54:47.856 INFO:teuthology.orchestra.run.smithi008.stdout: "duration": 4294967295.9999995 2023-08-01T19:54:47.856 INFO:teuthology.orchestra.run.smithi008.stdout: }, 2023-08-01T19:54:47.856 INFO:teuthology.orchestra.run.smithi008.stdout: { 2023-08-01T19:54:47.856 INFO:teuthology.orchestra.run.smithi008.stdout: "event": "all_read", 2023-08-01T19:54:47.856 INFO:teuthology.orchestra.run.smithi008.stdout: "time": "2023-08-01T19:54:47.815790+0000", 2023-08-01T19:54:47.856 INFO:teuthology.orchestra.run.smithi008.stdout: "duration": 4.4109000000000001e-05 2023-08-01T19:54:47.857 INFO:teuthology.orchestra.run.smithi008.stdout: }, 2023-08-01T19:54:47.857 INFO:teuthology.orchestra.run.smithi008.stdout: { 2023-08-01T19:54:47.857 INFO:teuthology.orchestra.run.smithi008.stdout: "event": "dispatched", 2023-08-01T19:54:47.857 INFO:teuthology.orchestra.run.smithi008.stdout: "time": "2023-08-01T19:54:47.815802+0000", 2023-08-01T19:54:47.857 INFO:teuthology.orchestra.run.smithi008.stdout: "duration": 1.1561e-05 2023-08-01T19:54:47.857 INFO:teuthology.orchestra.run.smithi008.stdout: }, 2023-08-01T19:54:47.857 INFO:teuthology.orchestra.run.smithi008.stdout: { 2023-08-01T19:54:47.857 INFO:teuthology.orchestra.run.smithi008.stdout: "event": "queued_for_pg", 2023-08-01T19:54:47.858 INFO:teuthology.orchestra.run.smithi008.stdout: "time": "2023-08-01T19:54:47.815808+0000", 2023-08-01T19:54:47.858 INFO:teuthology.orchestra.run.smithi008.stdout: "duration": 5.767e-06 2023-08-01T19:54:47.858 INFO:teuthology.orchestra.run.smithi008.stdout: }, 2023-08-01T19:54:47.858 INFO:teuthology.orchestra.run.smithi008.stdout: { 2023-08-01T19:54:47.858 INFO:teuthology.orchestra.run.smithi008.stdout: "event": "reached_pg", 2023-08-01T19:54:47.858 INFO:teuthology.orchestra.run.smithi008.stdout: "time": "2023-08-01T19:54:47.815857+0000", 2023-08-01T19:54:47.858 INFO:teuthology.orchestra.run.smithi008.stdout: "duration": 4.8733000000000002e-05 2023-08-01T19:54:47.858 INFO:teuthology.orchestra.run.smithi008.stdout: }, 2023-08-01T19:54:47.859 INFO:teuthology.orchestra.run.smithi008.stdout: { 2023-08-01T19:54:47.859 INFO:teuthology.orchestra.run.smithi008.stdout: "event": "started", 2023-08-01T19:54:47.859 INFO:teuthology.orchestra.run.smithi008.stdout: "time": "2023-08-01T19:54:47.815876+0000", 2023-08-01T19:54:47.859 INFO:teuthology.orchestra.run.smithi008.stdout: "duration": 1.9165e-05 2023-08-01T19:54:47.859 INFO:teuthology.orchestra.run.smithi008.stdout: } 2023-08-01T19:54:47.859 INFO:teuthology.orchestra.run.smithi008.stdout: ] 2023-08-01T19:54:47.859 INFO:teuthology.orchestra.run.smithi008.stdout: } 2023-08-01T19:54:47.859 INFO:teuthology.orchestra.run.smithi008.stdout: }, 2023-08-01T19:54:47.860 INFO:teuthology.orchestra.run.smithi008.stdout: { 2023-08-01T19:54:47.860 INFO:teuthology.orchestra.run.smithi008.stdout: "description": "osd_op(client.4668.0:66158 5.6 5:651ea947:::benchmark_data_smithi006_114134_object66157:head [set-alloc-hint object_size 65536 write_size 65536,write 0~65536 in=65536b] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e29)", 2023-08-01T19:54:47.860 INFO:teuthology.orchestra.run.smithi008.stdout: "initiated_at": "2023-08-01T19:54:47.818084+0000", 2023-08-01T19:54:47.860 INFO:teuthology.orchestra.run.smithi008.stdout: "age": 0.0013652829999999999, 2023-08-01T19:54:47.860 INFO:teuthology.orchestra.run.smithi008.stdout: "duration": 0.001853553, 2023-08-01T19:54:47.860 INFO:teuthology.orchestra.run.smithi008.stdout: "type_data": { 2023-08-01T19:54:47.860 INFO:teuthology.orchestra.run.smithi008.stdout: "flag_point": "waiting for sub ops", 2023-08-01T19:54:47.861 INFO:teuthology.orchestra.run.smithi008.stdout: "client_info": { 2023-08-01T19:54:47.861 INFO:teuthology.orchestra.run.smithi008.stdout: "client": "client.4668", 2023-08-01T19:54:47.861 INFO:teuthology.orchestra.run.smithi008.stdout: "client_addr": "172.21.15.6:0/1709472247", 2023-08-01T19:54:47.861 INFO:teuthology.orchestra.run.smithi008.stdout: "tid": 66158 2023-08-01T19:54:47.861 INFO:teuthology.orchestra.run.smithi008.stdout: }, 2023-08-01T19:54:47.861 INFO:teuthology.orchestra.run.smithi008.stdout: "events": [ 2023-08-01T19:54:47.861 INFO:teuthology.orchestra.run.smithi008.stdout: { 2023-08-01T19:54:47.861 INFO:teuthology.orchestra.run.smithi008.stdout: "event": "initiated", 2023-08-01T19:54:47.862 INFO:teuthology.orchestra.run.smithi008.stdout: "time": "2023-08-01T19:54:47.818084+0000", 2023-08-01T19:54:47.862 INFO:teuthology.orchestra.run.smithi008.stdout: "duration": 0 2023-08-01T19:54:47.862 INFO:teuthology.orchestra.run.smithi008.stdout: }, 2023-08-01T19:54:47.862 INFO:teuthology.orchestra.run.smithi008.stdout: { 2023-08-01T19:54:47.862 INFO:teuthology.orchestra.run.smithi008.stdout: "event": "throttled", 2023-08-01T19:54:47.862 INFO:teuthology.orchestra.run.smithi008.stdout: "time": "2023-08-01T19:54:47.818084+0000", 2023-08-01T19:54:47.862 INFO:teuthology.orchestra.run.smithi008.stdout: "duration": 0 2023-08-01T19:54:47.862 INFO:teuthology.orchestra.run.smithi008.stdout: }, 2023-08-01T19:54:47.863 INFO:teuthology.orchestra.run.smithi008.stdout: { 2023-08-01T19:54:47.863 INFO:teuthology.orchestra.run.smithi008.stdout: "event": "header_read", 2023-08-01T19:54:47.863 INFO:teuthology.orchestra.run.smithi008.stdout: "time": "2023-08-01T19:54:47.818083+0000", 2023-08-01T19:54:47.863 INFO:teuthology.orchestra.run.smithi008.stdout: "duration": 4294967295.9999986 2023-08-01T19:54:47.863 INFO:teuthology.orchestra.run.smithi008.stdout: }, 2023-08-01T19:54:47.863 INFO:teuthology.orchestra.run.smithi008.stdout: { 2023-08-01T19:54:47.863 INFO:teuthology.orchestra.run.smithi008.stdout: "event": "all_read", 2023-08-01T19:54:47.864 INFO:teuthology.orchestra.run.smithi008.stdout: "time": "2023-08-01T19:54:47.818151+0000", 2023-08-01T19:54:47.864 INFO:teuthology.orchestra.run.smithi008.stdout: "duration": 6.8293999999999994e-05 2023-08-01T19:54:47.864 INFO:teuthology.orchestra.run.smithi008.stdout: }, 2023-08-01T19:54:47.864 INFO:teuthology.orchestra.run.smithi008.stdout: { 2023-08-01T19:54:47.864 INFO:teuthology.orchestra.run.smithi008.stdout: "event": "dispatched", 2023-08-01T19:54:47.864 INFO:teuthology.orchestra.run.smithi008.stdout: "time": "2023-08-01T19:54:47.818165+0000", 2023-08-01T19:54:47.864 INFO:teuthology.orchestra.run.smithi008.stdout: "duration": 1.3899e-05 2023-08-01T19:54:47.864 INFO:teuthology.orchestra.run.smithi008.stdout: }, 2023-08-01T19:54:47.865 INFO:teuthology.orchestra.run.smithi008.stdout: { 2023-08-01T19:54:47.865 INFO:teuthology.orchestra.run.smithi008.stdout: "event": "queued_for_pg", 2023-08-01T19:54:47.865 INFO:teuthology.orchestra.run.smithi008.stdout: "time": "2023-08-01T19:54:47.818172+0000", 2023-08-01T19:54:47.865 INFO:teuthology.orchestra.run.smithi008.stdout: "duration": 6.5429999999999999e-06 2023-08-01T19:54:47.865 INFO:teuthology.orchestra.run.smithi008.stdout: }, 2023-08-01T19:54:47.865 INFO:teuthology.orchestra.run.smithi008.stdout: { 2023-08-01T19:54:47.865 INFO:teuthology.orchestra.run.smithi008.stdout: "event": "reached_pg", 2023-08-01T19:54:47.865 INFO:teuthology.orchestra.run.smithi008.stdout: "time": "2023-08-01T19:54:47.818276+0000", 2023-08-01T19:54:47.866 INFO:teuthology.orchestra.run.smithi008.stdout: "duration": 0.000104104 2023-08-01T19:54:47.866 INFO:teuthology.orchestra.run.smithi008.stdout: }, 2023-08-01T19:54:47.866 INFO:teuthology.orchestra.run.smithi008.stdout: { 2023-08-01T19:54:47.866 INFO:teuthology.orchestra.run.smithi008.stdout: "event": "started", 2023-08-01T19:54:47.866 INFO:teuthology.orchestra.run.smithi008.stdout: "time": "2023-08-01T19:54:47.819233+0000", 2023-08-01T19:54:47.866 INFO:teuthology.orchestra.run.smithi008.stdout: "duration": 0.00095754200000000003 2023-08-01T19:54:47.866 INFO:teuthology.orchestra.run.smithi008.stdout: }, 2023-08-01T19:54:47.866 INFO:teuthology.orchestra.run.smithi008.stdout: { 2023-08-01T19:54:47.867 INFO:teuthology.orchestra.run.smithi008.stdout: "event": "waiting for subops from 1", 2023-08-01T19:54:47.867 INFO:teuthology.orchestra.run.smithi008.stdout: "time": "2023-08-01T19:54:47.819351+0000", 2023-08-01T19:54:47.867 INFO:teuthology.orchestra.run.smithi008.stdout: "duration": 0.000118004 2023-08-01T19:54:47.867 INFO:teuthology.orchestra.run.smithi008.stdout: } 2023-08-01T19:54:47.867 INFO:teuthology.orchestra.run.smithi008.stdout: ] 2023-08-01T19:54:47.867 INFO:teuthology.orchestra.run.smithi008.stdout: } 2023-08-01T19:54:47.867 INFO:teuthology.orchestra.run.smithi008.stdout: }, 2023-08-01T19:54:47.867 INFO:teuthology.orchestra.run.smithi008.stdout: { 2023-08-01T19:54:47.868 INFO:teuthology.orchestra.run.smithi008.stdout: "description": "osd_op(client.4668.0:66161 5.5 5:a0fb325a:::benchmark_data_smithi006_114134_object66160:head [set-alloc-hint object_size 65536 write_size 65536,write 0~65536 in=65536b] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e29)", 2023-08-01T19:54:47.868 INFO:teuthology.orchestra.run.smithi008.stdout: "initiated_at": "2023-08-01T19:54:47.818815+0000", 2023-08-01T19:54:47.868 INFO:teuthology.orchestra.run.smithi008.stdout: "age": 0.00063424, 2023-08-01T19:54:47.868 INFO:teuthology.orchestra.run.smithi008.stdout: "duration": 0.0012048110000000001, 2023-08-01T19:54:47.868 INFO:teuthology.orchestra.run.smithi008.stdout: "type_data": { 2023-08-01T19:54:47.868 INFO:teuthology.orchestra.run.smithi008.stdout: "flag_point": "waiting for sub ops", 2023-08-01T19:54:47.868 INFO:teuthology.orchestra.run.smithi008.stdout: "client_info": { 2023-08-01T19:54:47.869 INFO:teuthology.orchestra.run.smithi008.stdout: "client": "client.4668", 2023-08-01T19:54:47.869 INFO:teuthology.orchestra.run.smithi008.stdout: "client_addr": "172.21.15.6:0/1709472247", 2023-08-01T19:54:47.869 INFO:teuthology.orchestra.run.smithi008.stdout: "tid": 66161 2023-08-01T19:54:47.869 INFO:teuthology.orchestra.run.smithi008.stdout: }, 2023-08-01T19:54:47.869 INFO:teuthology.orchestra.run.smithi008.stdout: "events": [ 2023-08-01T19:54:47.869 INFO:teuthology.orchestra.run.smithi008.stdout: { 2023-08-01T19:54:47.869 INFO:teuthology.orchestra.run.smithi008.stdout: "event": "initiated", 2023-08-01T19:54:47.869 INFO:teuthology.orchestra.run.smithi008.stdout: "time": "2023-08-01T19:54:47.818815+0000", 2023-08-01T19:54:47.870 INFO:teuthology.orchestra.run.smithi008.stdout: "duration": 0 2023-08-01T19:54:47.870 INFO:teuthology.orchestra.run.smithi008.stdout: }, 2023-08-01T19:54:47.870 INFO:teuthology.orchestra.run.smithi008.stdout: { 2023-08-01T19:54:47.870 INFO:teuthology.orchestra.run.smithi008.stdout: "event": "throttled", 2023-08-01T19:54:47.870 INFO:teuthology.orchestra.run.smithi008.stdout: "time": "2023-08-01T19:54:47.818815+0000", 2023-08-01T19:54:47.870 INFO:teuthology.orchestra.run.smithi008.stdout: "duration": 0 2023-08-01T19:54:47.870 INFO:teuthology.orchestra.run.smithi008.stdout: }, 2023-08-01T19:54:47.870 INFO:teuthology.orchestra.run.smithi008.stdout: { 2023-08-01T19:54:47.871 INFO:teuthology.orchestra.run.smithi008.stdout: "event": "header_read", 2023-08-01T19:54:47.871 INFO:teuthology.orchestra.run.smithi008.stdout: "time": "2023-08-01T19:54:47.818814+0000", 2023-08-01T19:54:47.871 INFO:teuthology.orchestra.run.smithi008.stdout: "duration": 4294967295.999999 2023-08-01T19:54:47.871 INFO:teuthology.orchestra.run.smithi008.stdout: }, 2023-08-01T19:54:47.871 INFO:teuthology.orchestra.run.smithi008.stdout: { 2023-08-01T19:54:47.871 INFO:teuthology.orchestra.run.smithi008.stdout: "event": "all_read", 2023-08-01T19:54:47.871 INFO:teuthology.orchestra.run.smithi008.stdout: "time": "2023-08-01T19:54:47.818935+0000", 2023-08-01T19:54:47.872 INFO:teuthology.orchestra.run.smithi008.stdout: "duration": 0.00012095999999999999 2023-08-01T19:54:47.872 INFO:teuthology.orchestra.run.smithi008.stdout: }, 2023-08-01T19:54:47.872 INFO:teuthology.orchestra.run.smithi008.stdout: { 2023-08-01T19:54:47.872 INFO:teuthology.orchestra.run.smithi008.stdout: "event": "dispatched", 2023-08-01T19:54:47.872 INFO:teuthology.orchestra.run.smithi008.stdout: "time": "2023-08-01T19:54:47.818947+0000", 2023-08-01T19:54:47.872 INFO:teuthology.orchestra.run.smithi008.stdout: "duration": 1.1685000000000001e-05 2023-08-01T19:54:47.872 INFO:teuthology.orchestra.run.smithi008.stdout: }, 2023-08-01T19:54:47.872 INFO:teuthology.orchestra.run.smithi008.stdout: { 2023-08-01T19:54:47.873 INFO:teuthology.orchestra.run.smithi008.stdout: "event": "queued_for_pg", 2023-08-01T19:54:47.873 INFO:teuthology.orchestra.run.smithi008.stdout: "time": "2023-08-01T19:54:47.818954+0000", 2023-08-01T19:54:47.873 INFO:teuthology.orchestra.run.smithi008.stdout: "duration": 7.3479999999999998e-06 2023-08-01T19:54:47.873 INFO:teuthology.orchestra.run.smithi008.stdout: }, 2023-08-01T19:54:47.873 INFO:teuthology.orchestra.run.smithi008.stdout: { 2023-08-01T19:54:47.873 INFO:teuthology.orchestra.run.smithi008.stdout: "event": "reached_pg", 2023-08-01T19:54:47.873 INFO:teuthology.orchestra.run.smithi008.stdout: "time": "2023-08-01T19:54:47.818991+0000", 2023-08-01T19:54:47.873 INFO:teuthology.orchestra.run.smithi008.stdout: "duration": 3.7119999999999997e-05 2023-08-01T19:54:47.874 INFO:teuthology.orchestra.run.smithi008.stdout: }, 2023-08-01T19:54:47.874 INFO:teuthology.orchestra.run.smithi008.stdout: { 2023-08-01T19:54:47.874 INFO:teuthology.orchestra.run.smithi008.stdout: "event": "started", 2023-08-01T19:54:47.874 INFO:teuthology.orchestra.run.smithi008.stdout: "time": "2023-08-01T19:54:47.819079+0000", 2023-08-01T19:54:47.874 INFO:teuthology.orchestra.run.smithi008.stdout: "duration": 8.7324000000000006e-05 2023-08-01T19:54:47.874 INFO:teuthology.orchestra.run.smithi008.stdout: }, 2023-08-01T19:54:47.874 INFO:teuthology.orchestra.run.smithi008.stdout: { 2023-08-01T19:54:47.874 INFO:teuthology.orchestra.run.smithi008.stdout: "event": "waiting for subops from 1", 2023-08-01T19:54:47.875 INFO:teuthology.orchestra.run.smithi008.stdout: "time": "2023-08-01T19:54:47.819165+0000", 2023-08-01T19:54:47.875 INFO:teuthology.orchestra.run.smithi008.stdout: "duration": 8.6285999999999993e-05 2023-08-01T19:54:47.875 INFO:teuthology.orchestra.run.smithi008.stdout: } 2023-08-01T19:54:47.875 INFO:teuthology.orchestra.run.smithi008.stdout: ] 2023-08-01T19:54:47.875 INFO:teuthology.orchestra.run.smithi008.stdout: } 2023-08-01T19:54:47.875 INFO:teuthology.orchestra.run.smithi008.stdout: }, 2023-08-01T19:54:47.875 INFO:teuthology.orchestra.run.smithi008.stdout: { 2023-08-01T19:54:47.875 INFO:teuthology.orchestra.run.smithi008.stdout: "description": "osd_op(client.4668.0:66165 5.3 5:c382f19d:::benchmark_data_smithi006_114134_object66164:head [set-alloc-hint object_size 65536 write_size 65536,write 0~65536 in=65536b] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e29)", 2023-08-01T19:54:47.876 INFO:teuthology.orchestra.run.smithi008.stdout: "initiated_at": "2023-08-01T19:54:47.819028+0000", 2023-08-01T19:54:47.876 INFO:teuthology.orchestra.run.smithi008.stdout: "age": 0.00042186600000000002, 2023-08-01T19:54:47.876 INFO:teuthology.orchestra.run.smithi008.stdout: "duration": 0.001077104, 2023-08-01T19:54:47.876 INFO:teuthology.orchestra.run.smithi008.stdout: "type_data": { 2023-08-01T19:54:47.876 INFO:teuthology.orchestra.run.smithi008.stdout: "flag_point": "waiting for sub ops", 2023-08-01T19:54:47.876 INFO:teuthology.orchestra.run.smithi008.stdout: "client_info": { 2023-08-01T19:54:47.876 INFO:teuthology.orchestra.run.smithi008.stdout: "client": "client.4668", 2023-08-01T19:54:47.877 INFO:teuthology.orchestra.run.smithi008.stdout: "client_addr": "172.21.15.6:0/1709472247", 2023-08-01T19:54:47.877 INFO:teuthology.orchestra.run.smithi008.stdout: "tid": 66165 2023-08-01T19:54:47.877 INFO:teuthology.orchestra.run.smithi008.stdout: }, 2023-08-01T19:54:47.877 INFO:teuthology.orchestra.run.smithi008.stdout: "events": [ 2023-08-01T19:54:47.877 INFO:teuthology.orchestra.run.smithi008.stdout: { 2023-08-01T19:54:47.877 INFO:teuthology.orchestra.run.smithi008.stdout: "event": "initiated", 2023-08-01T19:54:47.877 INFO:teuthology.orchestra.run.smithi008.stdout: "time": "2023-08-01T19:54:47.819028+0000", 2023-08-01T19:54:47.877 INFO:teuthology.orchestra.run.smithi008.stdout: "duration": 0 2023-08-01T19:54:47.878 INFO:teuthology.orchestra.run.smithi008.stdout: }, 2023-08-01T19:54:47.878 INFO:teuthology.orchestra.run.smithi008.stdout: { 2023-08-01T19:54:47.878 INFO:teuthology.orchestra.run.smithi008.stdout: "event": "throttled", 2023-08-01T19:54:47.878 INFO:teuthology.orchestra.run.smithi008.stdout: "time": "2023-08-01T19:54:47.819028+0000", 2023-08-01T19:54:47.878 INFO:teuthology.orchestra.run.smithi008.stdout: "duration": 0 2023-08-01T19:54:47.878 INFO:teuthology.orchestra.run.smithi008.stdout: }, 2023-08-01T19:54:47.878 INFO:teuthology.orchestra.run.smithi008.stdout: { 2023-08-01T19:54:47.878 INFO:teuthology.orchestra.run.smithi008.stdout: "event": "header_read", 2023-08-01T19:54:47.879 INFO:teuthology.orchestra.run.smithi008.stdout: "time": "2023-08-01T19:54:47.819027+0000", 2023-08-01T19:54:47.879 INFO:teuthology.orchestra.run.smithi008.stdout: "duration": 4294967295.999999 2023-08-01T19:54:47.879 INFO:teuthology.orchestra.run.smithi008.stdout: }, 2023-08-01T19:54:47.879 INFO:teuthology.orchestra.run.smithi008.stdout: { 2023-08-01T19:54:47.879 INFO:teuthology.orchestra.run.smithi008.stdout: "event": "all_read", 2023-08-01T19:54:47.879 INFO:teuthology.orchestra.run.smithi008.stdout: "time": "2023-08-01T19:54:47.819195+0000", 2023-08-01T19:54:47.879 INFO:teuthology.orchestra.run.smithi008.stdout: "duration": 0.00016818099999999999 2023-08-01T19:54:47.879 INFO:teuthology.orchestra.run.smithi008.stdout: }, 2023-08-01T19:54:47.880 INFO:teuthology.orchestra.run.smithi008.stdout: { 2023-08-01T19:54:47.880 INFO:teuthology.orchestra.run.smithi008.stdout: "event": "dispatched", 2023-08-01T19:54:47.880 INFO:teuthology.orchestra.run.smithi008.stdout: "time": "2023-08-01T19:54:47.819205+0000", 2023-08-01T19:54:47.880 INFO:teuthology.orchestra.run.smithi008.stdout: "duration": 9.5740000000000002e-06 2023-08-01T19:54:47.880 INFO:teuthology.orchestra.run.smithi008.stdout: }, 2023-08-01T19:54:47.880 INFO:teuthology.orchestra.run.smithi008.stdout: { 2023-08-01T19:54:47.880 INFO:teuthology.orchestra.run.smithi008.stdout: "event": "queued_for_pg", 2023-08-01T19:54:47.881 INFO:teuthology.orchestra.run.smithi008.stdout: "time": "2023-08-01T19:54:47.819212+0000", 2023-08-01T19:54:47.881 INFO:teuthology.orchestra.run.smithi008.stdout: "duration": 7.0469999999999996e-06 2023-08-01T19:54:47.881 INFO:teuthology.orchestra.run.smithi008.stdout: }, 2023-08-01T19:54:47.881 INFO:teuthology.orchestra.run.smithi008.stdout: { 2023-08-01T19:54:47.881 INFO:teuthology.orchestra.run.smithi008.stdout: "event": "reached_pg", 2023-08-01T19:54:47.881 INFO:teuthology.orchestra.run.smithi008.stdout: "time": "2023-08-01T19:54:47.819256+0000", 2023-08-01T19:54:47.881 INFO:teuthology.orchestra.run.smithi008.stdout: "duration": 4.4471000000000002e-05 2023-08-01T19:54:47.881 INFO:teuthology.orchestra.run.smithi008.stdout: }, 2023-08-01T19:54:47.882 INFO:teuthology.orchestra.run.smithi008.stdout: { 2023-08-01T19:54:47.882 INFO:teuthology.orchestra.run.smithi008.stdout: "event": "started", 2023-08-01T19:54:47.882 INFO:teuthology.orchestra.run.smithi008.stdout: "time": "2023-08-01T19:54:47.819360+0000", 2023-08-01T19:54:47.882 INFO:teuthology.orchestra.run.smithi008.stdout: "duration": 0.000103871 2023-08-01T19:54:47.882 INFO:teuthology.orchestra.run.smithi008.stdout: }, 2023-08-01T19:54:47.882 INFO:teuthology.orchestra.run.smithi008.stdout: { 2023-08-01T19:54:47.882 INFO:teuthology.orchestra.run.smithi008.stdout: "event": "waiting for subops from 1", 2023-08-01T19:54:47.882 INFO:teuthology.orchestra.run.smithi008.stdout: "time": "2023-08-01T19:54:47.819478+0000", 2023-08-01T19:54:47.883 INFO:teuthology.orchestra.run.smithi008.stdout: "duration": 0.000117883 2023-08-01T19:54:47.883 INFO:teuthology.orchestra.run.smithi008.stdout: } 2023-08-01T19:54:47.883 INFO:teuthology.orchestra.run.smithi008.stdout: ] 2023-08-01T19:54:47.883 INFO:teuthology.orchestra.run.smithi008.stdout: } 2023-08-01T19:54:47.883 INFO:teuthology.orchestra.run.smithi008.stdout: }, 2023-08-01T19:54:47.883 INFO:teuthology.orchestra.run.smithi008.stdout: { 2023-08-01T19:54:47.883 INFO:teuthology.orchestra.run.smithi008.stdout: "description": "osd_repop(client.4668.0:66160 5.b e29/19 5:defb7644:::benchmark_data_smithi006_114134_object66159:head v 29'4075, mlcod=29'4072)", 2023-08-01T19:54:47.883 INFO:teuthology.orchestra.run.smithi008.stdout: "initiated_at": "2023-08-01T19:54:47.819288+0000", 2023-08-01T19:54:47.884 INFO:teuthology.orchestra.run.smithi008.stdout: "age": 0.00016144, 2023-08-01T19:54:47.884 INFO:teuthology.orchestra.run.smithi008.stdout: "duration": 0.00089558499999999996, 2023-08-01T19:54:47.884 INFO:teuthology.orchestra.run.smithi008.stdout: "type_data": { 2023-08-01T19:54:47.884 INFO:teuthology.orchestra.run.smithi008.stdout: "flag_point": "started", 2023-08-01T19:54:47.884 INFO:teuthology.orchestra.run.smithi008.stdout: "events": [ 2023-08-01T19:54:47.884 INFO:teuthology.orchestra.run.smithi008.stdout: { 2023-08-01T19:54:47.884 INFO:teuthology.orchestra.run.smithi008.stdout: "event": "initiated", 2023-08-01T19:54:47.884 INFO:teuthology.orchestra.run.smithi008.stdout: "time": "2023-08-01T19:54:47.819288+0000", 2023-08-01T19:54:47.885 INFO:teuthology.orchestra.run.smithi008.stdout: "duration": 0 2023-08-01T19:54:47.885 INFO:teuthology.orchestra.run.smithi008.stdout: }, 2023-08-01T19:54:47.885 INFO:teuthology.orchestra.run.smithi008.stdout: { 2023-08-01T19:54:47.885 INFO:teuthology.orchestra.run.smithi008.stdout: "event": "throttled", 2023-08-01T19:54:47.885 INFO:teuthology.orchestra.run.smithi008.stdout: "time": "2023-08-01T19:54:47.819288+0000", 2023-08-01T19:54:47.885 INFO:teuthology.orchestra.run.smithi008.stdout: "duration": 0 2023-08-01T19:54:47.885 INFO:teuthology.orchestra.run.smithi008.stdout: }, 2023-08-01T19:54:47.885 INFO:teuthology.orchestra.run.smithi008.stdout: { 2023-08-01T19:54:47.886 INFO:teuthology.orchestra.run.smithi008.stdout: "event": "header_read", 2023-08-01T19:54:47.886 INFO:teuthology.orchestra.run.smithi008.stdout: "time": "2023-08-01T19:54:47.819288+0000", 2023-08-01T19:54:47.886 INFO:teuthology.orchestra.run.smithi008.stdout: "duration": 4294967295.9999995 2023-08-01T19:54:47.886 INFO:teuthology.orchestra.run.smithi008.stdout: }, 2023-08-01T19:54:47.886 INFO:teuthology.orchestra.run.smithi008.stdout: { 2023-08-01T19:54:47.886 INFO:teuthology.orchestra.run.smithi008.stdout: "event": "all_read", 2023-08-01T19:54:47.886 INFO:teuthology.orchestra.run.smithi008.stdout: "time": "2023-08-01T19:54:47.819353+0000", 2023-08-01T19:54:47.887 INFO:teuthology.orchestra.run.smithi008.stdout: "duration": 6.5889000000000006e-05 2023-08-01T19:54:47.887 INFO:teuthology.orchestra.run.smithi008.stdout: }, 2023-08-01T19:54:47.887 INFO:teuthology.orchestra.run.smithi008.stdout: { 2023-08-01T19:54:47.887 INFO:teuthology.orchestra.run.smithi008.stdout: "event": "dispatched", 2023-08-01T19:54:47.887 INFO:teuthology.orchestra.run.smithi008.stdout: "time": "2023-08-01T19:54:47.819365+0000", 2023-08-01T19:54:47.887 INFO:teuthology.orchestra.run.smithi008.stdout: "duration": 1.1567e-05 2023-08-01T19:54:47.887 INFO:teuthology.orchestra.run.smithi008.stdout: }, 2023-08-01T19:54:47.887 INFO:teuthology.orchestra.run.smithi008.stdout: { 2023-08-01T19:54:47.888 INFO:teuthology.orchestra.run.smithi008.stdout: "event": "queued_for_pg", 2023-08-01T19:54:47.888 INFO:teuthology.orchestra.run.smithi008.stdout: "time": "2023-08-01T19:54:47.819370+0000", 2023-08-01T19:54:47.888 INFO:teuthology.orchestra.run.smithi008.stdout: "duration": 5.3820000000000003e-06 2023-08-01T19:54:47.888 INFO:teuthology.orchestra.run.smithi008.stdout: }, 2023-08-01T19:54:47.888 INFO:teuthology.orchestra.run.smithi008.stdout: { 2023-08-01T19:54:47.888 INFO:teuthology.orchestra.run.smithi008.stdout: "event": "reached_pg", 2023-08-01T19:54:47.888 INFO:teuthology.orchestra.run.smithi008.stdout: "time": "2023-08-01T19:54:47.819401+0000", 2023-08-01T19:54:47.888 INFO:teuthology.orchestra.run.smithi008.stdout: "duration": 3.0824000000000002e-05 2023-08-01T19:54:47.889 INFO:teuthology.orchestra.run.smithi008.stdout: }, 2023-08-01T19:54:47.889 INFO:teuthology.orchestra.run.smithi008.stdout: { 2023-08-01T19:54:47.889 INFO:teuthology.orchestra.run.smithi008.stdout: "event": "started", 2023-08-01T19:54:47.889 INFO:teuthology.orchestra.run.smithi008.stdout: "time": "2023-08-01T19:54:47.819418+0000", 2023-08-01T19:54:47.889 INFO:teuthology.orchestra.run.smithi008.stdout: "duration": 1.6994999999999999e-05 2023-08-01T19:54:47.889 INFO:teuthology.orchestra.run.smithi008.stdout: } 2023-08-01T19:54:47.889 INFO:teuthology.orchestra.run.smithi008.stdout: ] 2023-08-01T19:54:47.889 INFO:teuthology.orchestra.run.smithi008.stdout: } 2023-08-01T19:54:47.890 INFO:teuthology.orchestra.run.smithi008.stdout: }, 2023-08-01T19:54:47.890 INFO:teuthology.orchestra.run.smithi008.stdout: { 2023-08-01T19:54:47.890 INFO:teuthology.orchestra.run.smithi008.stdout: "description": "osd_repop(client.4668.0:66167 5.7 e29/19 5:e5edeba2:::benchmark_data_smithi006_114134_object66166:head v 29'4157, mlcod=29'4154)", 2023-08-01T19:54:47.890 INFO:teuthology.orchestra.run.smithi008.stdout: "initiated_at": "2023-08-01T19:54:47.819586+0000", 2023-08-01T19:54:47.890 INFO:teuthology.orchestra.run.smithi008.stdout: "age": 4294967295.9998641, 2023-08-01T19:54:47.890 INFO:teuthology.orchestra.run.smithi008.stdout: "duration": 0.00066341200000000005, 2023-08-01T19:54:47.890 INFO:teuthology.orchestra.run.smithi008.stdout: "type_data": { 2023-08-01T19:54:47.890 INFO:teuthology.orchestra.run.smithi008.stdout: "flag_point": "started", 2023-08-01T19:54:47.891 INFO:teuthology.orchestra.run.smithi008.stdout: "events": [ 2023-08-01T19:54:47.891 INFO:teuthology.orchestra.run.smithi008.stdout: { 2023-08-01T19:54:47.891 INFO:teuthology.orchestra.run.smithi008.stdout: "event": "initiated", 2023-08-01T19:54:47.891 INFO:teuthology.orchestra.run.smithi008.stdout: "time": "2023-08-01T19:54:47.819586+0000", 2023-08-01T19:54:47.891 INFO:teuthology.orchestra.run.smithi008.stdout: "duration": 0 2023-08-01T19:54:47.891 INFO:teuthology.orchestra.run.smithi008.stdout: }, 2023-08-01T19:54:47.891 INFO:teuthology.orchestra.run.smithi008.stdout: { 2023-08-01T19:54:47.891 INFO:teuthology.orchestra.run.smithi008.stdout: "event": "throttled", 2023-08-01T19:54:47.892 INFO:teuthology.orchestra.run.smithi008.stdout: "time": "2023-08-01T19:54:47.819586+0000", 2023-08-01T19:54:47.892 INFO:teuthology.orchestra.run.smithi008.stdout: "duration": 0 2023-08-01T19:54:47.892 INFO:teuthology.orchestra.run.smithi008.stdout: }, 2023-08-01T19:54:47.892 INFO:teuthology.orchestra.run.smithi008.stdout: { 2023-08-01T19:54:47.892 INFO:teuthology.orchestra.run.smithi008.stdout: "event": "header_read", 2023-08-01T19:54:47.892 INFO:teuthology.orchestra.run.smithi008.stdout: "time": "2023-08-01T19:54:47.819585+0000", 2023-08-01T19:54:47.892 INFO:teuthology.orchestra.run.smithi008.stdout: "duration": 4294967295.9999995 2023-08-01T19:54:47.893 INFO:teuthology.orchestra.run.smithi008.stdout: }, 2023-08-01T19:54:47.893 INFO:teuthology.orchestra.run.smithi008.stdout: { 2023-08-01T19:54:47.893 INFO:teuthology.orchestra.run.smithi008.stdout: "event": "all_read", 2023-08-01T19:54:47.893 INFO:teuthology.orchestra.run.smithi008.stdout: "time": "2023-08-01T19:54:47.819682+0000", 2023-08-01T19:54:47.893 INFO:teuthology.orchestra.run.smithi008.stdout: "duration": 9.6992999999999998e-05 2023-08-01T19:54:47.893 INFO:teuthology.orchestra.run.smithi008.stdout: }, 2023-08-01T19:54:47.893 INFO:teuthology.orchestra.run.smithi008.stdout: { 2023-08-01T19:54:47.893 INFO:teuthology.orchestra.run.smithi008.stdout: "event": "dispatched", 2023-08-01T19:54:47.894 INFO:teuthology.orchestra.run.smithi008.stdout: "time": "2023-08-01T19:54:47.819691+0000", 2023-08-01T19:54:47.894 INFO:teuthology.orchestra.run.smithi008.stdout: "duration": 8.8929999999999994e-06 2023-08-01T19:54:47.894 INFO:teuthology.orchestra.run.smithi008.stdout: }, 2023-08-01T19:54:47.894 INFO:teuthology.orchestra.run.smithi008.stdout: { 2023-08-01T19:54:47.894 INFO:teuthology.orchestra.run.smithi008.stdout: "event": "queued_for_pg", 2023-08-01T19:54:47.894 INFO:teuthology.orchestra.run.smithi008.stdout: "time": "2023-08-01T19:54:47.819696+0000", 2023-08-01T19:54:47.894 INFO:teuthology.orchestra.run.smithi008.stdout: "duration": 4.8810000000000004e-06 2023-08-01T19:54:47.894 INFO:teuthology.orchestra.run.smithi008.stdout: }, 2023-08-01T19:54:47.895 INFO:teuthology.orchestra.run.smithi008.stdout: { 2023-08-01T19:54:47.895 INFO:teuthology.orchestra.run.smithi008.stdout: "event": "reached_pg", 2023-08-01T19:54:47.895 INFO:teuthology.orchestra.run.smithi008.stdout: "time": "2023-08-01T19:54:47.819734+0000", 2023-08-01T19:54:47.895 INFO:teuthology.orchestra.run.smithi008.stdout: "duration": 3.8387999999999999e-05 2023-08-01T19:54:47.895 INFO:teuthology.orchestra.run.smithi008.stdout: }, 2023-08-01T19:54:47.895 INFO:teuthology.orchestra.run.smithi008.stdout: { 2023-08-01T19:54:47.895 INFO:teuthology.orchestra.run.smithi008.stdout: "event": "started", 2023-08-01T19:54:47.895 INFO:teuthology.orchestra.run.smithi008.stdout: "time": "2023-08-01T19:54:47.819750+0000", 2023-08-01T19:54:47.896 INFO:teuthology.orchestra.run.smithi008.stdout: "duration": 1.6181e-05 2023-08-01T19:54:47.896 INFO:teuthology.orchestra.run.smithi008.stdout: } 2023-08-01T19:54:47.896 INFO:teuthology.orchestra.run.smithi008.stdout: ] 2023-08-01T19:54:47.896 INFO:teuthology.orchestra.run.smithi008.stdout: } 2023-08-01T19:54:47.896 INFO:teuthology.orchestra.run.smithi008.stdout: } 2023-08-01T19:54:47.896 INFO:teuthology.orchestra.run.smithi008.stdout: ], 2023-08-01T19:54:47.896 INFO:teuthology.orchestra.run.smithi008.stdout: "num_ops": 10 2023-08-01T19:54:47.897 INFO:teuthology.orchestra.run.smithi008.stdout:} 2023-08-01T19:54:47.897 INFO:teuthology.orchestra.run.smithi006.stdout:osd.0: {} 2023-08-01T19:54:47.898 DEBUG:teuthology.orchestra.run.smithi008:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 30 ceph --cluster ceph --admin-daemon /var/run/ceph/ceph-osd.0.asok dump_blocked_ops 2023-08-01T19:54:47.899 INFO:tasks.ceph.osd.0.smithi008.stderr:2023-08-01T19:54:47.897+0000 7f16a58f4700 -1 received signal: Hangup from /usr/bin/python3 /bin/daemon-helper kill ceph-osd -f --cluster ceph -i 0 (PID: 111179) UID: 0 2023-08-01T19:54:47.913 INFO:teuthology.orchestra.run.smithi006.stdout:osd.1: {} 2023-08-01T19:54:47.936 INFO:teuthology.orchestra.run.smithi006.stdout:osd.2: {} 2023-08-01T19:54:47.938 INFO:teuthology.orchestra.run.smithi006.stderr:osd.0: osd_enable_op_tracker = 'false' 2023-08-01T19:54:47.938 INFO:teuthology.orchestra.run.smithi006.stderr:osd.1: osd_enable_op_tracker = 'false' 2023-08-01T19:54:47.938 INFO:teuthology.orchestra.run.smithi006.stderr:osd.2: osd_enable_op_tracker = 'false' 2023-08-01T19:54:47.998 INFO:tasks.ceph.osd.2.smithi155.stderr:2023-08-01T19:54:47.997+0000 7faa5c6ac700 -1 received signal: Hangup from /usr/bin/python3 /bin/daemon-helper kill ceph-osd -f --cluster ceph -i 2 (PID: 111337) UID: 0 2023-08-01T19:54:48.100 INFO:tasks.ceph.osd.0.smithi008.stderr:2023-08-01T19:54:48.098+0000 7f16a58f4700 -1 received signal: Hangup from /usr/bin/python3 /bin/daemon-helper kill ceph-osd -f --cluster ceph -i 0 (PID: 111179) UID: 0 2023-08-01T19:54:48.127 INFO:teuthology.orchestra.run.smithi008.stdout:ERROR: (22) Invalid argument 2023-08-01T19:54:48.128 INFO:teuthology.orchestra.run.smithi008.stdout:op_tracker tracking is not enabled now, so no ops are tracked currently, even those get stuck. Please enable "osd_enable_op_tracker", and the tracker will start to track new ops received afterwards. 2023-08-01T19:54:48.144 DEBUG:teuthology.orchestra.run.smithi008:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 30 ceph --cluster ceph --admin-daemon /var/run/ceph/ceph-osd.0.asok dump_historic_ops 2023-08-01T19:54:48.199 INFO:tasks.ceph.osd.2.smithi155.stderr:2023-08-01T19:54:48.198+0000 7faa5c6ac700 -1 received signal: Hangup from /usr/bin/python3 /bin/daemon-helper kill ceph-osd -f --cluster ceph -i 2 (PID: 111337) UID: 0 2023-08-01T19:54:48.301 INFO:tasks.ceph.osd.1.smithi101.stderr:2023-08-01T19:54:48.299+0000 7fb0cb7f6700 -1 received signal: Hangup from /usr/bin/python3 /bin/daemon-helper kill ceph-osd -f --cluster ceph -i 1 (PID: 111141) UID: 0 2023-08-01T19:54:48.314 INFO:tasks.radosbench.radosbench.0.smithi006.stdout: 24 16 67125 67109 174.749 123.812 0.0064376 0.00571942 2023-08-01T19:54:48.378 INFO:teuthology.orchestra.run.smithi008.stdout:ERROR: (22) Invalid argument 2023-08-01T19:54:48.379 INFO:teuthology.orchestra.run.smithi008.stdout:op_tracker tracking is not enabled now, so no ops are tracked currently, even those get stuck. Please enable "osd_enable_op_tracker", and the tracker will start to track new ops received afterwards. 2023-08-01T19:54:48.393 DEBUG:teuthology.orchestra.run.smithi101:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 30 ceph --cluster ceph --admin-daemon /var/run/ceph/ceph-osd.1.asok dump_ops_in_flight 2023-08-01T19:54:48.401 INFO:tasks.ceph.osd.0.smithi008.stderr:2023-08-01T19:54:48.400+0000 7f16a58f4700 -1 received signal: Hangup from /usr/bin/python3 /bin/daemon-helper kill ceph-osd -f --cluster ceph -i 0 (PID: 111179) UID: 0 2023-08-01T19:54:48.505 INFO:tasks.ceph.osd.0.smithi008.stderr:2023-08-01T19:54:48.501+0000 7f16a58f4700 -1 received signal: Hangup from /usr/bin/python3 /bin/daemon-helper kill ceph-osd -f --cluster ceph -i 0 (PID: 111179) UID: 0 2023-08-01T19:54:48.567 INFO:teuthology.orchestra.run.smithi101.stdout:ERROR: (22) Invalid argument 2023-08-01T19:54:48.567 INFO:teuthology.orchestra.run.smithi101.stdout:op_tracker tracking is not enabled now, so no ops are tracked currently, even those get stuck. Please enable "osd_enable_op_tracker", and the tracker will start to track new ops received afterwards. 2023-08-01T19:54:48.580 DEBUG:teuthology.orchestra.run.smithi101:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 30 ceph --cluster ceph --admin-daemon /var/run/ceph/ceph-osd.1.asok dump_blocked_ops 2023-08-01T19:54:48.603 INFO:tasks.ceph.osd.0.smithi008.stderr:2023-08-01T19:54:48.602+0000 7f16a58f4700 -1 received signal: Hangup from /usr/bin/python3 /bin/daemon-helper kill ceph-osd -f --cluster ceph -i 0 (PID: 111179) UID: 0 2023-08-01T19:54:48.703 INFO:tasks.ceph.osd.1.smithi101.stderr:2023-08-01T19:54:48.702+0000 7fb0cb7f6700 -1 received signal: Hangup from /usr/bin/python3 /bin/daemon-helper kill ceph-osd -f --cluster ceph -i 1 (PID: 111141) UID: 0 2023-08-01T19:54:48.760 INFO:teuthology.orchestra.run.smithi101.stdout:ERROR: (22) Invalid argument 2023-08-01T19:54:48.760 INFO:teuthology.orchestra.run.smithi101.stdout:op_tracker tracking is not enabled now, so no ops are tracked currently, even those get stuck. Please enable "osd_enable_op_tracker", and the tracker will start to track new ops received afterwards. 2023-08-01T19:54:48.775 DEBUG:teuthology.orchestra.run.smithi101:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 30 ceph --cluster ceph --admin-daemon /var/run/ceph/ceph-osd.1.asok dump_historic_ops 2023-08-01T19:54:48.804 INFO:tasks.ceph.osd.0.smithi008.stderr:2023-08-01T19:54:48.803+0000 7f16a58f4700 -1 received signal: Hangup from /usr/bin/python3 /bin/daemon-helper kill ceph-osd -f --cluster ceph -i 0 (PID: 111179) UID: 0 2023-08-01T19:54:48.904 INFO:tasks.ceph.osd.0.smithi008.stderr:2023-08-01T19:54:48.904+0000 7f16a58f4700 -1 received signal: Hangup from /usr/bin/python3 /bin/daemon-helper kill ceph-osd -f --cluster ceph -i 0 (PID: 111179) UID: 0 2023-08-01T19:54:48.988 INFO:teuthology.orchestra.run.smithi006.stderr:nodeep-scrub is set 2023-08-01T19:54:48.989 INFO:teuthology.orchestra.run.smithi101.stdout:ERROR: (22) Invalid argument 2023-08-01T19:54:48.989 INFO:teuthology.orchestra.run.smithi101.stdout:op_tracker tracking is not enabled now, so no ops are tracked currently, even those get stuck. Please enable "osd_enable_op_tracker", and the tracker will start to track new ops received afterwards. 2023-08-01T19:54:49.003 DEBUG:teuthology.orchestra.run.smithi155:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 30 ceph --cluster ceph --admin-daemon /var/run/ceph/ceph-osd.2.asok dump_ops_in_flight 2023-08-01T19:54:49.004 INFO:tasks.ceph.osd.0.smithi008.stderr:2023-08-01T19:54:49.004+0000 7f16a58f4700 -1 received signal: Hangup from /usr/bin/python3 /bin/daemon-helper kill ceph-osd -f --cluster ceph -i 0 (PID: 111179) UID: 0 2023-08-01T19:54:49.106 INFO:tasks.ceph.osd.2.smithi155.stderr:2023-08-01T19:54:49.104+0000 7faa5c6ac700 -1 received signal: Hangup from /usr/bin/python3 /bin/daemon-helper kill ceph-osd -f --cluster ceph -i 2 (PID: 111337) UID: 0 2023-08-01T19:54:49.168 INFO:teuthology.orchestra.run.smithi155.stdout:ERROR: (22) Invalid argument 2023-08-01T19:54:49.169 INFO:teuthology.orchestra.run.smithi155.stdout:op_tracker tracking is not enabled now, so no ops are tracked currently, even those get stuck. Please enable "osd_enable_op_tracker", and the tracker will start to track new ops received afterwards. 2023-08-01T19:54:49.183 DEBUG:teuthology.orchestra.run.smithi155:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 30 ceph --cluster ceph --admin-daemon /var/run/ceph/ceph-osd.2.asok dump_blocked_ops 2023-08-01T19:54:49.224 INFO:tasks.ceph.osd.2.smithi155.stderr:2023-08-01T19:54:49.222+0000 7faa5c6ac700 -1 received signal: Hangup from /usr/bin/python3 /bin/daemon-helper kill ceph-osd -f --cluster ceph -i 2 (PID: 111337) UID: 0 2023-08-01T19:54:49.307 INFO:tasks.ceph.osd.0.smithi008.stderr:2023-08-01T19:54:49.306+0000 7f16a58f4700 -1 received signal: Hangup from /usr/bin/python3 /bin/daemon-helper kill ceph-osd -f --cluster ceph -i 0 (PID: 111179) UID: 0 2023-08-01T19:54:49.314 INFO:tasks.radosbench.radosbench.0.smithi006.stdout: 25 16 69135 69119 172.784 125.625 0.00763131 0.00578472 2023-08-01T19:54:49.393 INFO:teuthology.orchestra.run.smithi155.stdout:ERROR: (22) Invalid argument 2023-08-01T19:54:49.394 INFO:teuthology.orchestra.run.smithi155.stdout:op_tracker tracking is not enabled now, so no ops are tracked currently, even those get stuck. Please enable "osd_enable_op_tracker", and the tracker will start to track new ops received afterwards. 2023-08-01T19:54:49.407 DEBUG:teuthology.orchestra.run.smithi155:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 30 ceph --cluster ceph --admin-daemon /var/run/ceph/ceph-osd.2.asok dump_historic_ops 2023-08-01T19:54:49.408 INFO:tasks.ceph.osd.1.smithi101.stderr:2023-08-01T19:54:49.407+0000 7fb0cb7f6700 -1 received signal: Hangup from /usr/bin/python3 /bin/daemon-helper kill ceph-osd -f --cluster ceph -i 1 (PID: 111141) UID: 0 2023-08-01T19:54:49.509 INFO:tasks.ceph.osd.1.smithi101.stderr:2023-08-01T19:54:49.508+0000 7fb0cb7f6700 -1 received signal: Hangup from /usr/bin/python3 /bin/daemon-helper kill ceph-osd -f --cluster ceph -i 1 (PID: 111141) UID: 0 2023-08-01T19:54:49.573 INFO:teuthology.orchestra.run.smithi155.stdout:ERROR: (22) Invalid argument 2023-08-01T19:54:49.573 INFO:teuthology.orchestra.run.smithi155.stdout:op_tracker tracking is not enabled now, so no ops are tracked currently, even those get stuck. Please enable "osd_enable_op_tracker", and the tracker will start to track new ops received afterwards. 2023-08-01T19:54:49.588 DEBUG:teuthology.orchestra.run.smithi008:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 30 ceph --cluster ceph --admin-daemon /var/run/ceph/ceph-osd.0.asok dump_ops_in_flight 2023-08-01T19:54:49.610 INFO:tasks.ceph.osd.1.smithi101.stderr:2023-08-01T19:54:49.608+0000 7fb0cb7f6700 -1 received signal: Hangup from /usr/bin/python3 /bin/daemon-helper kill ceph-osd -f --cluster ceph -i 1 (PID: 111141) UID: 0 2023-08-01T19:54:49.711 INFO:tasks.ceph.osd.2.smithi155.stderr:2023-08-01T19:54:49.709+0000 7faa5c6ac700 -1 received signal: Hangup from /usr/bin/python3 /bin/daemon-helper kill ceph-osd -f --cluster ceph -i 2 (PID: 111337) UID: 0 2023-08-01T19:54:49.779 INFO:teuthology.orchestra.run.smithi008.stdout:ERROR: (22) Invalid argument 2023-08-01T19:54:49.780 INFO:teuthology.orchestra.run.smithi008.stdout:op_tracker tracking is not enabled now, so no ops are tracked currently, even those get stuck. Please enable "osd_enable_op_tracker", and the tracker will start to track new ops received afterwards. 2023-08-01T19:54:49.794 DEBUG:teuthology.orchestra.run.smithi008:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 30 ceph --cluster ceph --admin-daemon /var/run/ceph/ceph-osd.0.asok dump_blocked_ops 2023-08-01T19:54:49.811 INFO:tasks.ceph.osd.2.smithi155.stderr:2023-08-01T19:54:49.809+0000 7faa5c6ac700 -1 received signal: Hangup from /usr/bin/python3 /bin/daemon-helper kill ceph-osd -f --cluster ceph -i 2 (PID: 111337) UID: 0 2023-08-01T19:54:49.911 INFO:tasks.ceph.osd.1.smithi101.stderr:2023-08-01T19:54:49.910+0000 7fb0cb7f6700 -1 received signal: Hangup from /usr/bin/python3 /bin/daemon-helper kill ceph-osd -f --cluster ceph -i 1 (PID: 111141) UID: 0 2023-08-01T19:54:49.950 DEBUG:teuthology.orchestra.run.smithi006:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 120 ceph --cluster ceph -- tell 'osd.*' injectargs --osd_enable_op_tracker=true 2023-08-01T19:54:49.995 INFO:teuthology.orchestra.run.smithi008.stdout:ERROR: (22) Invalid argument 2023-08-01T19:54:49.995 INFO:teuthology.orchestra.run.smithi008.stdout:op_tracker tracking is not enabled now, so no ops are tracked currently, even those get stuck. Please enable "osd_enable_op_tracker", and the tracker will start to track new ops received afterwards. 2023-08-01T19:54:50.011 DEBUG:teuthology.orchestra.run.smithi008:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 30 ceph --cluster ceph --admin-daemon /var/run/ceph/ceph-osd.0.asok dump_historic_ops 2023-08-01T19:54:50.016 INFO:tasks.ceph.osd.0.smithi008.stderr:2023-08-01T19:54:50.012+0000 7f16a58f4700 -1 received signal: Hangup from /usr/bin/python3 /bin/daemon-helper kill ceph-osd -f --cluster ceph -i 0 (PID: 111179) UID: 0 2023-08-01T19:54:50.102 INFO:teuthology.orchestra.run.smithi006.stdout:osd.0: {} 2023-08-01T19:54:50.109 INFO:tasks.thrashosds.thrasher:in_osds: [0, 1, 2] out_osds: [] dead_osds: [] live_osds: [0, 1, 2] 2023-08-01T19:54:50.109 DEBUG:teuthology.orchestra.run.smithi006:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 120 ceph --cluster ceph osd reweight 0 1 2023-08-01T19:54:50.112 INFO:tasks.ceph.osd.0.smithi008.stderr:2023-08-01T19:54:50.111+0000 7f16a58f4700 -1 received signal: Hangup from /usr/bin/python3 /bin/daemon-helper kill ceph-osd -f --cluster ceph -i 0 (PID: 111179) UID: 0 2023-08-01T19:54:50.122 INFO:teuthology.orchestra.run.smithi006.stdout:osd.1: {} 2023-08-01T19:54:50.142 INFO:teuthology.orchestra.run.smithi006.stdout:osd.2: {} 2023-08-01T19:54:50.144 INFO:teuthology.orchestra.run.smithi006.stderr:osd.0: osd_enable_op_tracker = 'true' 2023-08-01T19:54:50.144 INFO:teuthology.orchestra.run.smithi006.stderr:osd.1: osd_enable_op_tracker = 'true' 2023-08-01T19:54:50.144 INFO:teuthology.orchestra.run.smithi006.stderr:osd.2: osd_enable_op_tracker = 'true' 2023-08-01T19:54:50.210 INFO:teuthology.orchestra.run.smithi008.stdout:{ 2023-08-01T19:54:50.210 INFO:teuthology.orchestra.run.smithi008.stdout: "size": 20, 2023-08-01T19:54:50.210 INFO:teuthology.orchestra.run.smithi008.stdout: "duration": 600, 2023-08-01T19:54:50.210 INFO:teuthology.orchestra.run.smithi008.stdout: "ops": [ 2023-08-01T19:54:50.210 INFO:teuthology.orchestra.run.smithi008.stdout: { 2023-08-01T19:54:50.210 INFO:teuthology.orchestra.run.smithi008.stdout: "description": "osd_op(client.4668.0:18360 5.6 5:65d8e237:::benchmark_data_smithi006_114134_object18359:head [set-alloc-hint object_size 65536 write_size 65536,write 0~65536] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e23)", 2023-08-01T19:54:50.211 INFO:teuthology.orchestra.run.smithi008.stdout: "initiated_at": "2023-08-01T19:54:28.994296+0000", 2023-08-01T19:54:50.211 INFO:teuthology.orchestra.run.smithi008.stdout: "age": 21.211880746999999, 2023-08-01T19:54:50.211 INFO:teuthology.orchestra.run.smithi008.stdout: "duration": 0.017459669000000001, 2023-08-01T19:54:50.211 INFO:teuthology.orchestra.run.smithi008.stdout: "type_data": { 2023-08-01T19:54:50.211 INFO:teuthology.orchestra.run.smithi008.stdout: "flag_point": "commit sent; apply or cleanup", 2023-08-01T19:54:50.211 INFO:teuthology.orchestra.run.smithi008.stdout: "client_info": { 2023-08-01T19:54:50.211 INFO:teuthology.orchestra.run.smithi008.stdout: "client": "client.4668", 2023-08-01T19:54:50.212 INFO:teuthology.orchestra.run.smithi008.stdout: "client_addr": "172.21.15.6:0/1709472247", 2023-08-01T19:54:50.212 INFO:teuthology.orchestra.run.smithi008.stdout: "tid": 18360 2023-08-01T19:54:50.212 INFO:teuthology.orchestra.run.smithi008.stdout: }, 2023-08-01T19:54:50.212 INFO:teuthology.orchestra.run.smithi008.stdout: "events": [ 2023-08-01T19:54:50.212 INFO:teuthology.orchestra.run.smithi008.stdout: { 2023-08-01T19:54:50.212 INFO:teuthology.orchestra.run.smithi008.stdout: "event": "initiated", 2023-08-01T19:54:50.212 INFO:teuthology.orchestra.run.smithi008.stdout: "time": "2023-08-01T19:54:28.994296+0000", 2023-08-01T19:54:50.213 INFO:teuthology.orchestra.run.smithi008.stdout: "duration": 0 2023-08-01T19:54:50.213 INFO:teuthology.orchestra.run.smithi008.stdout: }, 2023-08-01T19:54:50.213 INFO:teuthology.orchestra.run.smithi008.stdout: { 2023-08-01T19:54:50.213 INFO:teuthology.orchestra.run.smithi008.stdout: "event": "throttled", 2023-08-01T19:54:50.213 INFO:teuthology.orchestra.run.smithi008.stdout: "time": "2023-08-01T19:54:28.994296+0000", 2023-08-01T19:54:50.213 INFO:teuthology.orchestra.run.smithi008.stdout: "duration": 0 2023-08-01T19:54:50.213 INFO:teuthology.orchestra.run.smithi008.stdout: }, 2023-08-01T19:54:50.213 INFO:teuthology.orchestra.run.smithi008.stdout: { 2023-08-01T19:54:50.214 INFO:teuthology.orchestra.run.smithi008.stdout: "event": "header_read", 2023-08-01T19:54:50.214 INFO:teuthology.orchestra.run.smithi008.stdout: "time": "2023-08-01T19:54:28.994295+0000", 2023-08-01T19:54:50.214 INFO:teuthology.orchestra.run.smithi008.stdout: "duration": 4294967295.9999995 2023-08-01T19:54:50.214 INFO:teuthology.orchestra.run.smithi008.stdout: }, 2023-08-01T19:54:50.214 INFO:teuthology.orchestra.run.smithi008.stdout: { 2023-08-01T19:54:50.214 INFO:teuthology.orchestra.run.smithi008.stdout: "event": "all_read", 2023-08-01T19:54:50.214 INFO:teuthology.orchestra.run.smithi008.stdout: "time": "2023-08-01T19:54:28.994381+0000", 2023-08-01T19:54:50.214 INFO:teuthology.orchestra.run.smithi008.stdout: "duration": 8.6055000000000002e-05 2023-08-01T19:54:50.215 INFO:teuthology.orchestra.run.smithi008.stdout: }, 2023-08-01T19:54:50.215 INFO:teuthology.orchestra.run.smithi008.stdout: { 2023-08-01T19:54:50.215 INFO:teuthology.orchestra.run.smithi008.stdout: "event": "dispatched", 2023-08-01T19:54:50.215 INFO:teuthology.orchestra.run.smithi008.stdout: "time": "2023-08-01T19:54:28.994390+0000", 2023-08-01T19:54:50.215 INFO:teuthology.orchestra.run.smithi008.stdout: "duration": 8.7530000000000007e-06 2023-08-01T19:54:50.215 INFO:teuthology.orchestra.run.smithi008.stdout: }, 2023-08-01T19:54:50.215 INFO:teuthology.orchestra.run.smithi008.stdout: { 2023-08-01T19:54:50.216 INFO:teuthology.orchestra.run.smithi008.stdout: "event": "queued_for_pg", 2023-08-01T19:54:50.216 INFO:teuthology.orchestra.run.smithi008.stdout: "time": "2023-08-01T19:54:28.994394+0000", 2023-08-01T19:54:50.216 INFO:teuthology.orchestra.run.smithi008.stdout: "duration": 3.4929999999999998e-06 2023-08-01T19:54:50.216 INFO:teuthology.orchestra.run.smithi008.stdout: }, 2023-08-01T19:54:50.216 INFO:teuthology.orchestra.run.smithi008.stdout: { 2023-08-01T19:54:50.216 INFO:teuthology.orchestra.run.smithi008.stdout: "event": "reached_pg", 2023-08-01T19:54:50.216 INFO:teuthology.orchestra.run.smithi008.stdout: "time": "2023-08-01T19:54:28.995799+0000", 2023-08-01T19:54:50.216 INFO:teuthology.orchestra.run.smithi008.stdout: "duration": 0.001405779 2023-08-01T19:54:50.217 INFO:teuthology.orchestra.run.smithi008.stdout: }, 2023-08-01T19:54:50.217 INFO:teuthology.orchestra.run.smithi008.stdout: { 2023-08-01T19:54:50.217 INFO:teuthology.orchestra.run.smithi008.stdout: "event": "started", 2023-08-01T19:54:50.217 INFO:teuthology.orchestra.run.smithi008.stdout: "time": "2023-08-01T19:54:28.995896+0000", 2023-08-01T19:54:50.217 INFO:teuthology.orchestra.run.smithi008.stdout: "duration": 9.6597999999999999e-05 2023-08-01T19:54:50.217 INFO:teuthology.orchestra.run.smithi008.stdout: }, 2023-08-01T19:54:50.217 INFO:teuthology.orchestra.run.smithi008.stdout: { 2023-08-01T19:54:50.217 INFO:teuthology.orchestra.run.smithi008.stdout: "event": "waiting for subops from 1", 2023-08-01T19:54:50.218 INFO:teuthology.orchestra.run.smithi008.stdout: "time": "2023-08-01T19:54:28.995985+0000", 2023-08-01T19:54:50.218 INFO:teuthology.orchestra.run.smithi008.stdout: "duration": 8.8479000000000004e-05 2023-08-01T19:54:50.218 INFO:teuthology.orchestra.run.smithi008.stdout: }, 2023-08-01T19:54:50.218 INFO:teuthology.orchestra.run.smithi008.stdout: { 2023-08-01T19:54:50.218 INFO:teuthology.orchestra.run.smithi008.stdout: "event": "op_commit", 2023-08-01T19:54:50.218 INFO:teuthology.orchestra.run.smithi008.stdout: "time": "2023-08-01T19:54:28.997700+0000", 2023-08-01T19:54:50.218 INFO:teuthology.orchestra.run.smithi008.stdout: "duration": 0.001714997 2023-08-01T19:54:50.218 INFO:teuthology.orchestra.run.smithi008.stdout: }, 2023-08-01T19:54:50.219 INFO:teuthology.orchestra.run.smithi008.stdout: { 2023-08-01T19:54:50.219 INFO:teuthology.orchestra.run.smithi008.stdout: "event": "sub_op_commit_rec", 2023-08-01T19:54:50.219 INFO:teuthology.orchestra.run.smithi008.stdout: "time": "2023-08-01T19:54:29.011671+0000", 2023-08-01T19:54:50.219 INFO:teuthology.orchestra.run.smithi008.stdout: "duration": 0.0139712 2023-08-01T19:54:50.219 INFO:teuthology.orchestra.run.smithi008.stdout: }, 2023-08-01T19:54:50.219 INFO:teuthology.orchestra.run.smithi008.stdout: { 2023-08-01T19:54:50.219 INFO:teuthology.orchestra.run.smithi008.stdout: "event": "commit_sent", 2023-08-01T19:54:50.220 INFO:teuthology.orchestra.run.smithi008.stdout: "time": "2023-08-01T19:54:29.011719+0000", 2023-08-01T19:54:50.220 INFO:teuthology.orchestra.run.smithi008.stdout: "duration": 4.8025000000000002e-05 2023-08-01T19:54:50.220 INFO:teuthology.orchestra.run.smithi008.stdout: }, 2023-08-01T19:54:50.220 INFO:teuthology.orchestra.run.smithi008.stdout: { 2023-08-01T19:54:50.220 INFO:teuthology.orchestra.run.smithi008.stdout: "event": "done", 2023-08-01T19:54:50.220 INFO:teuthology.orchestra.run.smithi008.stdout: "time": "2023-08-01T19:54:29.011756+0000", 2023-08-01T19:54:50.220 INFO:teuthology.orchestra.run.smithi008.stdout: "duration": 3.6825000000000001e-05 2023-08-01T19:54:50.220 INFO:teuthology.orchestra.run.smithi008.stdout: } 2023-08-01T19:54:50.221 INFO:teuthology.orchestra.run.smithi008.stdout: ] 2023-08-01T19:54:50.221 INFO:teuthology.orchestra.run.smithi008.stdout: } 2023-08-01T19:54:50.221 INFO:teuthology.orchestra.run.smithi008.stdout: }, 2023-08-01T19:54:50.221 INFO:teuthology.orchestra.run.smithi008.stdout: { 2023-08-01T19:54:50.221 INFO:teuthology.orchestra.run.smithi008.stdout: "description": "osd_op(client.4668.0:18361 5.6 5:65a8a093:::benchmark_data_smithi006_114134_object18360:head [set-alloc-hint object_size 65536 write_size 65536,write 0~65536] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e23)", 2023-08-01T19:54:50.221 INFO:teuthology.orchestra.run.smithi008.stdout: "initiated_at": "2023-08-01T19:54:28.994398+0000", 2023-08-01T19:54:50.221 INFO:teuthology.orchestra.run.smithi008.stdout: "age": 21.211778888000001, 2023-08-01T19:54:50.222 INFO:teuthology.orchestra.run.smithi008.stdout: "duration": 0.017435484000000001, 2023-08-01T19:54:50.222 INFO:teuthology.orchestra.run.smithi008.stdout: "type_data": { 2023-08-01T19:54:50.222 INFO:teuthology.orchestra.run.smithi008.stdout: "flag_point": "commit sent; apply or cleanup", 2023-08-01T19:54:50.222 INFO:teuthology.orchestra.run.smithi008.stdout: "client_info": { 2023-08-01T19:54:50.222 INFO:teuthology.orchestra.run.smithi008.stdout: "client": "client.4668", 2023-08-01T19:54:50.222 INFO:teuthology.orchestra.run.smithi008.stdout: "client_addr": "172.21.15.6:0/1709472247", 2023-08-01T19:54:50.222 INFO:teuthology.orchestra.run.smithi008.stdout: "tid": 18361 2023-08-01T19:54:50.222 INFO:teuthology.orchestra.run.smithi008.stdout: }, 2023-08-01T19:54:50.223 INFO:teuthology.orchestra.run.smithi008.stdout: "events": [ 2023-08-01T19:54:50.223 INFO:teuthology.orchestra.run.smithi008.stdout: { 2023-08-01T19:54:50.223 INFO:teuthology.orchestra.run.smithi008.stdout: "event": "initiated", 2023-08-01T19:54:50.223 INFO:teuthology.orchestra.run.smithi008.stdout: "time": "2023-08-01T19:54:28.994398+0000", 2023-08-01T19:54:50.223 INFO:teuthology.orchestra.run.smithi008.stdout: "duration": 0 2023-08-01T19:54:50.223 INFO:teuthology.orchestra.run.smithi008.stdout: }, 2023-08-01T19:54:50.223 INFO:teuthology.orchestra.run.smithi008.stdout: { 2023-08-01T19:54:50.223 INFO:teuthology.orchestra.run.smithi008.stdout: "event": "throttled", 2023-08-01T19:54:50.224 INFO:teuthology.orchestra.run.smithi008.stdout: "time": "2023-08-01T19:54:28.994398+0000", 2023-08-01T19:54:50.224 INFO:teuthology.orchestra.run.smithi008.stdout: "duration": 0 2023-08-01T19:54:50.224 INFO:teuthology.orchestra.run.smithi008.stdout: }, 2023-08-01T19:54:50.224 INFO:teuthology.orchestra.run.smithi008.stdout: { 2023-08-01T19:54:50.224 INFO:teuthology.orchestra.run.smithi008.stdout: "event": "header_read", 2023-08-01T19:54:50.224 INFO:teuthology.orchestra.run.smithi008.stdout: "time": "2023-08-01T19:54:28.994397+0000", 2023-08-01T19:54:50.224 INFO:teuthology.orchestra.run.smithi008.stdout: "duration": 4294967295.9999995 2023-08-01T19:54:50.225 INFO:teuthology.orchestra.run.smithi008.stdout: }, 2023-08-01T19:54:50.225 INFO:teuthology.orchestra.run.smithi008.stdout: { 2023-08-01T19:54:50.225 INFO:teuthology.orchestra.run.smithi008.stdout: "event": "all_read", 2023-08-01T19:54:50.225 INFO:teuthology.orchestra.run.smithi008.stdout: "time": "2023-08-01T19:54:28.994475+0000", 2023-08-01T19:54:50.225 INFO:teuthology.orchestra.run.smithi008.stdout: "duration": 7.7408000000000002e-05 2023-08-01T19:54:50.225 INFO:teuthology.orchestra.run.smithi008.stdout: }, 2023-08-01T19:54:50.225 INFO:teuthology.orchestra.run.smithi008.stdout: { 2023-08-01T19:54:50.225 INFO:teuthology.orchestra.run.smithi008.stdout: "event": "dispatched", 2023-08-01T19:54:50.226 INFO:teuthology.orchestra.run.smithi008.stdout: "time": "2023-08-01T19:54:28.994480+0000", 2023-08-01T19:54:50.226 INFO:teuthology.orchestra.run.smithi008.stdout: "duration": 5.3589999999999999e-06 2023-08-01T19:54:50.226 INFO:teuthology.orchestra.run.smithi008.stdout: }, 2023-08-01T19:54:50.226 INFO:teuthology.orchestra.run.smithi008.stdout: { 2023-08-01T19:54:50.226 INFO:teuthology.orchestra.run.smithi008.stdout: "event": "queued_for_pg", 2023-08-01T19:54:50.226 INFO:teuthology.orchestra.run.smithi008.stdout: "time": "2023-08-01T19:54:28.994484+0000", 2023-08-01T19:54:50.226 INFO:teuthology.orchestra.run.smithi008.stdout: "duration": 3.9750000000000001e-06 2023-08-01T19:54:50.226 INFO:teuthology.orchestra.run.smithi008.stdout: }, 2023-08-01T19:54:50.227 INFO:teuthology.orchestra.run.smithi008.stdout: { 2023-08-01T19:54:50.227 INFO:teuthology.orchestra.run.smithi008.stdout: "event": "reached_pg", 2023-08-01T19:54:50.227 INFO:teuthology.orchestra.run.smithi008.stdout: "time": "2023-08-01T19:54:28.996504+0000", 2023-08-01T19:54:50.227 INFO:teuthology.orchestra.run.smithi008.stdout: "duration": 0.0020198550000000001 2023-08-01T19:54:50.227 INFO:teuthology.orchestra.run.smithi008.stdout: }, 2023-08-01T19:54:50.227 INFO:teuthology.orchestra.run.smithi008.stdout: { 2023-08-01T19:54:50.227 INFO:teuthology.orchestra.run.smithi008.stdout: "event": "started", 2023-08-01T19:54:50.227 INFO:teuthology.orchestra.run.smithi008.stdout: "time": "2023-08-01T19:54:28.996624+0000", 2023-08-01T19:54:50.228 INFO:teuthology.orchestra.run.smithi008.stdout: "duration": 0.000120118 2023-08-01T19:54:50.228 INFO:teuthology.orchestra.run.smithi008.stdout: }, 2023-08-01T19:54:50.228 INFO:teuthology.orchestra.run.smithi008.stdout: { 2023-08-01T19:54:50.228 INFO:teuthology.orchestra.run.smithi008.stdout: "event": "waiting for subops from 1", 2023-08-01T19:54:50.228 INFO:teuthology.orchestra.run.smithi008.stdout: "time": "2023-08-01T19:54:28.996790+0000", 2023-08-01T19:54:50.228 INFO:teuthology.orchestra.run.smithi008.stdout: "duration": 0.000165398 2023-08-01T19:54:50.228 INFO:teuthology.orchestra.run.smithi008.stdout: }, 2023-08-01T19:54:50.229 INFO:teuthology.orchestra.run.smithi008.stdout: { 2023-08-01T19:54:50.229 INFO:teuthology.orchestra.run.smithi008.stdout: "event": "op_commit", 2023-08-01T19:54:50.229 INFO:teuthology.orchestra.run.smithi008.stdout: "time": "2023-08-01T19:54:28.999061+0000", 2023-08-01T19:54:50.229 INFO:teuthology.orchestra.run.smithi008.stdout: "duration": 0.0022714800000000002 2023-08-01T19:54:50.229 INFO:teuthology.orchestra.run.smithi008.stdout: }, 2023-08-01T19:54:50.229 INFO:teuthology.orchestra.run.smithi008.stdout: { 2023-08-01T19:54:50.229 INFO:teuthology.orchestra.run.smithi008.stdout: "event": "sub_op_commit_rec", 2023-08-01T19:54:50.229 INFO:teuthology.orchestra.run.smithi008.stdout: "time": "2023-08-01T19:54:29.011788+0000", 2023-08-01T19:54:50.230 INFO:teuthology.orchestra.run.smithi008.stdout: "duration": 0.012726774999999999 2023-08-01T19:54:50.230 INFO:teuthology.orchestra.run.smithi008.stdout: }, 2023-08-01T19:54:50.230 INFO:teuthology.orchestra.run.smithi008.stdout: { 2023-08-01T19:54:50.230 INFO:teuthology.orchestra.run.smithi008.stdout: "event": "commit_sent", 2023-08-01T19:54:50.230 INFO:teuthology.orchestra.run.smithi008.stdout: "time": "2023-08-01T19:54:29.011815+0000", 2023-08-01T19:54:50.230 INFO:teuthology.orchestra.run.smithi008.stdout: "duration": 2.7032000000000001e-05 2023-08-01T19:54:50.230 INFO:teuthology.orchestra.run.smithi008.stdout: }, 2023-08-01T19:54:50.230 INFO:teuthology.orchestra.run.smithi008.stdout: { 2023-08-01T19:54:50.231 INFO:teuthology.orchestra.run.smithi008.stdout: "event": "done", 2023-08-01T19:54:50.231 INFO:teuthology.orchestra.run.smithi008.stdout: "time": "2023-08-01T19:54:29.011833+0000", 2023-08-01T19:54:50.231 INFO:teuthology.orchestra.run.smithi008.stdout: "duration": 1.8437e-05 2023-08-01T19:54:50.231 INFO:teuthology.orchestra.run.smithi008.stdout: } 2023-08-01T19:54:50.231 INFO:teuthology.orchestra.run.smithi008.stdout: ] 2023-08-01T19:54:50.231 INFO:teuthology.orchestra.run.smithi008.stdout: } 2023-08-01T19:54:50.231 INFO:teuthology.orchestra.run.smithi008.stdout: }, 2023-08-01T19:54:50.232 INFO:teuthology.orchestra.run.smithi008.stdout: { 2023-08-01T19:54:50.232 INFO:teuthology.orchestra.run.smithi008.stdout: "description": "osd_op(client.4668.0:18363 5.5 5:ab48299e:::benchmark_data_smithi006_114134_object18362:head [set-alloc-hint object_size 65536 write_size 65536,write 0~65536] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e23)", 2023-08-01T19:54:50.232 INFO:teuthology.orchestra.run.smithi008.stdout: "initiated_at": "2023-08-01T19:54:28.996467+0000", 2023-08-01T19:54:50.232 INFO:teuthology.orchestra.run.smithi008.stdout: "age": 21.209709447000002, 2023-08-01T19:54:50.232 INFO:teuthology.orchestra.run.smithi008.stdout: "duration": 0.015287689, 2023-08-01T19:54:50.232 INFO:teuthology.orchestra.run.smithi008.stdout: "type_data": { 2023-08-01T19:54:50.232 INFO:teuthology.orchestra.run.smithi008.stdout: "flag_point": "commit sent; apply or cleanup", 2023-08-01T19:54:50.232 INFO:teuthology.orchestra.run.smithi008.stdout: "client_info": { 2023-08-01T19:54:50.233 INFO:teuthology.orchestra.run.smithi008.stdout: "client": "client.4668", 2023-08-01T19:54:50.233 INFO:teuthology.orchestra.run.smithi008.stdout: "client_addr": "172.21.15.6:0/1709472247", 2023-08-01T19:54:50.233 INFO:teuthology.orchestra.run.smithi008.stdout: "tid": 18363 2023-08-01T19:54:50.233 INFO:teuthology.orchestra.run.smithi008.stdout: }, 2023-08-01T19:54:50.233 INFO:teuthology.orchestra.run.smithi008.stdout: "events": [ 2023-08-01T19:54:50.233 INFO:teuthology.orchestra.run.smithi008.stdout: { 2023-08-01T19:54:50.233 INFO:teuthology.orchestra.run.smithi008.stdout: "event": "initiated", 2023-08-01T19:54:50.234 INFO:teuthology.orchestra.run.smithi008.stdout: "time": "2023-08-01T19:54:28.996467+0000", 2023-08-01T19:54:50.234 INFO:teuthology.orchestra.run.smithi008.stdout: "duration": 0 2023-08-01T19:54:50.234 INFO:teuthology.orchestra.run.smithi008.stdout: }, 2023-08-01T19:54:50.234 INFO:teuthology.orchestra.run.smithi008.stdout: { 2023-08-01T19:54:50.234 INFO:teuthology.orchestra.run.smithi008.stdout: "event": "throttled", 2023-08-01T19:54:50.234 INFO:teuthology.orchestra.run.smithi008.stdout: "time": "2023-08-01T19:54:28.996467+0000", 2023-08-01T19:54:50.234 INFO:teuthology.orchestra.run.smithi008.stdout: "duration": 0 2023-08-01T19:54:50.234 INFO:teuthology.orchestra.run.smithi008.stdout: }, 2023-08-01T19:54:50.235 INFO:teuthology.orchestra.run.smithi008.stdout: { 2023-08-01T19:54:50.235 INFO:teuthology.orchestra.run.smithi008.stdout: "event": "header_read", 2023-08-01T19:54:50.235 INFO:teuthology.orchestra.run.smithi008.stdout: "time": "2023-08-01T19:54:28.996466+0000", 2023-08-01T19:54:50.235 INFO:teuthology.orchestra.run.smithi008.stdout: "duration": 4294967295.999999 2023-08-01T19:54:50.235 INFO:teuthology.orchestra.run.smithi008.stdout: }, 2023-08-01T19:54:50.235 INFO:teuthology.orchestra.run.smithi008.stdout: { 2023-08-01T19:54:50.235 INFO:teuthology.orchestra.run.smithi008.stdout: "event": "all_read", 2023-08-01T19:54:50.236 INFO:teuthology.orchestra.run.smithi008.stdout: "time": "2023-08-01T19:54:28.996519+0000", 2023-08-01T19:54:50.236 INFO:teuthology.orchestra.run.smithi008.stdout: "duration": 5.3075000000000003e-05 2023-08-01T19:54:50.236 INFO:teuthology.orchestra.run.smithi008.stdout: }, 2023-08-01T19:54:50.236 INFO:teuthology.orchestra.run.smithi008.stdout: { 2023-08-01T19:54:50.236 INFO:teuthology.orchestra.run.smithi008.stdout: "event": "dispatched", 2023-08-01T19:54:50.236 INFO:teuthology.orchestra.run.smithi008.stdout: "time": "2023-08-01T19:54:28.996529+0000", 2023-08-01T19:54:50.236 INFO:teuthology.orchestra.run.smithi008.stdout: "duration": 9.2499999999999995e-06 2023-08-01T19:54:50.236 INFO:teuthology.orchestra.run.smithi008.stdout: }, 2023-08-01T19:54:50.237 INFO:teuthology.orchestra.run.smithi008.stdout: { 2023-08-01T19:54:50.237 INFO:teuthology.orchestra.run.smithi008.stdout: "event": "queued_for_pg", 2023-08-01T19:54:50.237 INFO:teuthology.orchestra.run.smithi008.stdout: "time": "2023-08-01T19:54:28.996537+0000", 2023-08-01T19:54:50.237 INFO:teuthology.orchestra.run.smithi008.stdout: "duration": 8.4239999999999993e-06 2023-08-01T19:54:50.237 INFO:teuthology.orchestra.run.smithi008.stdout: }, 2023-08-01T19:54:50.237 INFO:teuthology.orchestra.run.smithi008.stdout: { 2023-08-01T19:54:50.237 INFO:teuthology.orchestra.run.smithi008.stdout: "event": "reached_pg", 2023-08-01T19:54:50.237 INFO:teuthology.orchestra.run.smithi008.stdout: "time": "2023-08-01T19:54:28.996590+0000", 2023-08-01T19:54:50.238 INFO:teuthology.orchestra.run.smithi008.stdout: "duration": 5.3047999999999998e-05 2023-08-01T19:54:50.238 INFO:teuthology.orchestra.run.smithi008.stdout: }, 2023-08-01T19:54:50.238 INFO:teuthology.orchestra.run.smithi008.stdout: { 2023-08-01T19:54:50.238 INFO:teuthology.orchestra.run.smithi008.stdout: "event": "started", 2023-08-01T19:54:50.238 INFO:teuthology.orchestra.run.smithi008.stdout: "time": "2023-08-01T19:54:28.996707+0000", 2023-08-01T19:54:50.238 INFO:teuthology.orchestra.run.smithi008.stdout: "duration": 0.000117005 2023-08-01T19:54:50.238 INFO:teuthology.orchestra.run.smithi008.stdout: }, 2023-08-01T19:54:50.238 INFO:teuthology.orchestra.run.smithi008.stdout: { 2023-08-01T19:54:50.239 INFO:teuthology.orchestra.run.smithi008.stdout: "event": "waiting for subops from 1", 2023-08-01T19:54:50.239 INFO:teuthology.orchestra.run.smithi008.stdout: "time": "2023-08-01T19:54:28.996807+0000", 2023-08-01T19:54:50.239 INFO:teuthology.orchestra.run.smithi008.stdout: "duration": 0.0001003 2023-08-01T19:54:50.239 INFO:teuthology.orchestra.run.smithi008.stdout: }, 2023-08-01T19:54:50.239 INFO:teuthology.orchestra.run.smithi008.stdout: { 2023-08-01T19:54:50.239 INFO:teuthology.orchestra.run.smithi008.stdout: "event": "op_commit", 2023-08-01T19:54:50.239 INFO:teuthology.orchestra.run.smithi008.stdout: "time": "2023-08-01T19:54:28.998511+0000", 2023-08-01T19:54:50.240 INFO:teuthology.orchestra.run.smithi008.stdout: "duration": 0.00170397 2023-08-01T19:54:50.240 INFO:teuthology.orchestra.run.smithi008.stdout: }, 2023-08-01T19:54:50.240 INFO:teuthology.orchestra.run.smithi008.stdout: { 2023-08-01T19:54:50.240 INFO:teuthology.orchestra.run.smithi008.stdout: "event": "sub_op_commit_rec", 2023-08-01T19:54:50.240 INFO:teuthology.orchestra.run.smithi008.stdout: "time": "2023-08-01T19:54:29.011698+0000", 2023-08-01T19:54:50.240 INFO:teuthology.orchestra.run.smithi008.stdout: "duration": 0.013186959 2023-08-01T19:54:50.240 INFO:teuthology.orchestra.run.smithi008.stdout: }, 2023-08-01T19:54:50.240 INFO:teuthology.orchestra.run.smithi008.stdout: { 2023-08-01T19:54:50.241 INFO:teuthology.orchestra.run.smithi008.stdout: "event": "commit_sent", 2023-08-01T19:54:50.241 INFO:teuthology.orchestra.run.smithi008.stdout: "time": "2023-08-01T19:54:29.011729+0000", 2023-08-01T19:54:50.241 INFO:teuthology.orchestra.run.smithi008.stdout: "duration": 3.044e-05 2023-08-01T19:54:50.241 INFO:teuthology.orchestra.run.smithi008.stdout: }, 2023-08-01T19:54:50.241 INFO:teuthology.orchestra.run.smithi008.stdout: { 2023-08-01T19:54:50.241 INFO:teuthology.orchestra.run.smithi008.stdout: "event": "done", 2023-08-01T19:54:50.241 INFO:teuthology.orchestra.run.smithi008.stdout: "time": "2023-08-01T19:54:29.011755+0000", 2023-08-01T19:54:50.241 INFO:teuthology.orchestra.run.smithi008.stdout: "duration": 2.6165000000000001e-05 2023-08-01T19:54:50.242 INFO:teuthology.orchestra.run.smithi008.stdout: } 2023-08-01T19:54:50.242 INFO:teuthology.orchestra.run.smithi008.stdout: ] 2023-08-01T19:54:50.242 INFO:teuthology.orchestra.run.smithi008.stdout: } 2023-08-01T19:54:50.242 INFO:teuthology.orchestra.run.smithi008.stdout: }, 2023-08-01T19:54:50.242 INFO:teuthology.orchestra.run.smithi008.stdout: { 2023-08-01T19:54:50.242 INFO:teuthology.orchestra.run.smithi008.stdout: "description": "osd_op(client.4668.0:18368 5.5 5:ac90765d:::benchmark_data_smithi006_114134_object18367:head [set-alloc-hint object_size 65536 write_size 65536,write 0~65536] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e23)", 2023-08-01T19:54:50.242 INFO:teuthology.orchestra.run.smithi008.stdout: "initiated_at": "2023-08-01T19:54:28.996987+0000", 2023-08-01T19:54:50.242 INFO:teuthology.orchestra.run.smithi008.stdout: "age": 21.209189599999998, 2023-08-01T19:54:50.243 INFO:teuthology.orchestra.run.smithi008.stdout: "duration": 0.014851731999999999, 2023-08-01T19:54:50.243 INFO:teuthology.orchestra.run.smithi008.stdout: "type_data": { 2023-08-01T19:54:50.243 INFO:teuthology.orchestra.run.smithi008.stdout: "flag_point": "commit sent; apply or cleanup", 2023-08-01T19:54:50.243 INFO:teuthology.orchestra.run.smithi008.stdout: "client_info": { 2023-08-01T19:54:50.243 INFO:teuthology.orchestra.run.smithi008.stdout: "client": "client.4668", 2023-08-01T19:54:50.243 INFO:teuthology.orchestra.run.smithi008.stdout: "client_addr": "172.21.15.6:0/1709472247", 2023-08-01T19:54:50.243 INFO:teuthology.orchestra.run.smithi008.stdout: "tid": 18368 2023-08-01T19:54:50.244 INFO:teuthology.orchestra.run.smithi008.stdout: }, 2023-08-01T19:54:50.244 INFO:teuthology.orchestra.run.smithi008.stdout: "events": [ 2023-08-01T19:54:50.244 INFO:teuthology.orchestra.run.smithi008.stdout: { 2023-08-01T19:54:50.244 INFO:teuthology.orchestra.run.smithi008.stdout: "event": "initiated", 2023-08-01T19:54:50.244 INFO:teuthology.orchestra.run.smithi008.stdout: "time": "2023-08-01T19:54:28.996987+0000", 2023-08-01T19:54:50.244 INFO:teuthology.orchestra.run.smithi008.stdout: "duration": 0 2023-08-01T19:54:50.244 INFO:teuthology.orchestra.run.smithi008.stdout: }, 2023-08-01T19:54:50.244 INFO:teuthology.orchestra.run.smithi008.stdout: { 2023-08-01T19:54:50.245 INFO:teuthology.orchestra.run.smithi008.stdout: "event": "throttled", 2023-08-01T19:54:50.245 INFO:teuthology.orchestra.run.smithi008.stdout: "time": "2023-08-01T19:54:28.996987+0000", 2023-08-01T19:54:50.245 INFO:teuthology.orchestra.run.smithi008.stdout: "duration": 0 2023-08-01T19:54:50.245 INFO:teuthology.orchestra.run.smithi008.stdout: }, 2023-08-01T19:54:50.245 INFO:teuthology.orchestra.run.smithi008.stdout: { 2023-08-01T19:54:50.245 INFO:teuthology.orchestra.run.smithi008.stdout: "event": "header_read", 2023-08-01T19:54:50.245 INFO:teuthology.orchestra.run.smithi008.stdout: "time": "2023-08-01T19:54:28.996986+0000", 2023-08-01T19:54:50.245 INFO:teuthology.orchestra.run.smithi008.stdout: "duration": 4294967295.999999 2023-08-01T19:54:50.246 INFO:teuthology.orchestra.run.smithi008.stdout: }, 2023-08-01T19:54:50.246 INFO:teuthology.orchestra.run.smithi008.stdout: { 2023-08-01T19:54:50.246 INFO:teuthology.orchestra.run.smithi008.stdout: "event": "all_read", 2023-08-01T19:54:50.246 INFO:teuthology.orchestra.run.smithi008.stdout: "time": "2023-08-01T19:54:28.997061+0000", 2023-08-01T19:54:50.246 INFO:teuthology.orchestra.run.smithi008.stdout: "duration": 7.4849000000000001e-05 2023-08-01T19:54:50.246 INFO:teuthology.orchestra.run.smithi008.stdout: }, 2023-08-01T19:54:50.246 INFO:teuthology.orchestra.run.smithi008.stdout: { 2023-08-01T19:54:50.246 INFO:teuthology.orchestra.run.smithi008.stdout: "event": "dispatched", 2023-08-01T19:54:50.247 INFO:teuthology.orchestra.run.smithi008.stdout: "time": "2023-08-01T19:54:28.997070+0000", 2023-08-01T19:54:50.247 INFO:teuthology.orchestra.run.smithi008.stdout: "duration": 8.7499999999999992e-06 2023-08-01T19:54:50.247 INFO:teuthology.orchestra.run.smithi008.stdout: }, 2023-08-01T19:54:50.247 INFO:teuthology.orchestra.run.smithi008.stdout: { 2023-08-01T19:54:50.247 INFO:teuthology.orchestra.run.smithi008.stdout: "event": "queued_for_pg", 2023-08-01T19:54:50.247 INFO:teuthology.orchestra.run.smithi008.stdout: "time": "2023-08-01T19:54:28.997076+0000", 2023-08-01T19:54:50.247 INFO:teuthology.orchestra.run.smithi008.stdout: "duration": 6.0510000000000002e-06 2023-08-01T19:54:50.248 INFO:teuthology.orchestra.run.smithi008.stdout: }, 2023-08-01T19:54:50.248 INFO:teuthology.orchestra.run.smithi008.stdout: { 2023-08-01T19:54:50.248 INFO:teuthology.orchestra.run.smithi008.stdout: "event": "reached_pg", 2023-08-01T19:54:50.248 INFO:teuthology.orchestra.run.smithi008.stdout: "time": "2023-08-01T19:54:28.997512+0000", 2023-08-01T19:54:50.248 INFO:teuthology.orchestra.run.smithi008.stdout: "duration": 0.00043637299999999999 2023-08-01T19:54:50.248 INFO:teuthology.orchestra.run.smithi008.stdout: }, 2023-08-01T19:54:50.248 INFO:teuthology.orchestra.run.smithi008.stdout: { 2023-08-01T19:54:50.248 INFO:teuthology.orchestra.run.smithi008.stdout: "event": "started", 2023-08-01T19:54:50.249 INFO:teuthology.orchestra.run.smithi008.stdout: "time": "2023-08-01T19:54:28.997634+0000", 2023-08-01T19:54:50.249 INFO:teuthology.orchestra.run.smithi008.stdout: "duration": 0.00012162100000000001 2023-08-01T19:54:50.249 INFO:teuthology.orchestra.run.smithi008.stdout: }, 2023-08-01T19:54:50.249 INFO:teuthology.orchestra.run.smithi008.stdout: { 2023-08-01T19:54:50.249 INFO:teuthology.orchestra.run.smithi008.stdout: "event": "waiting for subops from 1", 2023-08-01T19:54:50.249 INFO:teuthology.orchestra.run.smithi008.stdout: "time": "2023-08-01T19:54:28.997792+0000", 2023-08-01T19:54:50.249 INFO:teuthology.orchestra.run.smithi008.stdout: "duration": 0.00015851600000000001 2023-08-01T19:54:50.249 INFO:teuthology.orchestra.run.smithi008.stdout: }, 2023-08-01T19:54:50.250 INFO:teuthology.orchestra.run.smithi008.stdout: { 2023-08-01T19:54:50.250 INFO:teuthology.orchestra.run.smithi008.stdout: "event": "op_commit", 2023-08-01T19:54:50.250 INFO:teuthology.orchestra.run.smithi008.stdout: "time": "2023-08-01T19:54:28.999634+0000", 2023-08-01T19:54:50.250 INFO:teuthology.orchestra.run.smithi008.stdout: "duration": 0.001841046 2023-08-01T19:54:50.250 INFO:teuthology.orchestra.run.smithi008.stdout: }, 2023-08-01T19:54:50.250 INFO:teuthology.orchestra.run.smithi008.stdout: { 2023-08-01T19:54:50.250 INFO:teuthology.orchestra.run.smithi008.stdout: "event": "sub_op_commit_rec", 2023-08-01T19:54:50.251 INFO:teuthology.orchestra.run.smithi008.stdout: "time": "2023-08-01T19:54:29.011789+0000", 2023-08-01T19:54:50.251 INFO:teuthology.orchestra.run.smithi008.stdout: "duration": 0.012155011 2023-08-01T19:54:50.251 INFO:teuthology.orchestra.run.smithi008.stdout: }, 2023-08-01T19:54:50.251 INFO:teuthology.orchestra.run.smithi008.stdout: { 2023-08-01T19:54:50.251 INFO:teuthology.orchestra.run.smithi008.stdout: "event": "commit_sent", 2023-08-01T19:54:50.251 INFO:teuthology.orchestra.run.smithi008.stdout: "time": "2023-08-01T19:54:29.011818+0000", 2023-08-01T19:54:50.251 INFO:teuthology.orchestra.run.smithi008.stdout: "duration": 2.9152000000000001e-05 2023-08-01T19:54:50.251 INFO:teuthology.orchestra.run.smithi008.stdout: }, 2023-08-01T19:54:50.252 INFO:teuthology.orchestra.run.smithi008.stdout: { 2023-08-01T19:54:50.252 INFO:teuthology.orchestra.run.smithi008.stdout: "event": "done", 2023-08-01T19:54:50.252 INFO:teuthology.orchestra.run.smithi008.stdout: "time": "2023-08-01T19:54:29.011839+0000", 2023-08-01T19:54:50.252 INFO:teuthology.orchestra.run.smithi008.stdout: "duration": 2.1132999999999999e-05 2023-08-01T19:54:50.252 INFO:teuthology.orchestra.run.smithi008.stdout: } 2023-08-01T19:54:50.252 INFO:teuthology.orchestra.run.smithi008.stdout: ] 2023-08-01T19:54:50.252 INFO:teuthology.orchestra.run.smithi008.stdout: } 2023-08-01T19:54:50.252 INFO:teuthology.orchestra.run.smithi008.stdout: }, 2023-08-01T19:54:50.253 INFO:teuthology.orchestra.run.smithi008.stdout: { 2023-08-01T19:54:50.253 INFO:teuthology.orchestra.run.smithi008.stdout: "description": "osd_op(client.4668.0:18369 5.3 5:c557c7d0:::benchmark_data_smithi006_114134_object18368:head [set-alloc-hint object_size 65536 write_size 65536,write 0~65536] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e23)", 2023-08-01T19:54:50.253 INFO:teuthology.orchestra.run.smithi008.stdout: "initiated_at": "2023-08-01T19:54:28.997782+0000", 2023-08-01T19:54:50.253 INFO:teuthology.orchestra.run.smithi008.stdout: "age": 21.208394626, 2023-08-01T19:54:50.253 INFO:teuthology.orchestra.run.smithi008.stdout: "duration": 0.013982608000000001, 2023-08-01T19:54:50.253 INFO:teuthology.orchestra.run.smithi008.stdout: "type_data": { 2023-08-01T19:54:50.253 INFO:teuthology.orchestra.run.smithi008.stdout: "flag_point": "commit sent; apply or cleanup", 2023-08-01T19:54:50.254 INFO:teuthology.orchestra.run.smithi008.stdout: "client_info": { 2023-08-01T19:54:50.254 INFO:teuthology.orchestra.run.smithi008.stdout: "client": "client.4668", 2023-08-01T19:54:50.254 INFO:teuthology.orchestra.run.smithi008.stdout: "client_addr": "172.21.15.6:0/1709472247", 2023-08-01T19:54:50.254 INFO:teuthology.orchestra.run.smithi008.stdout: "tid": 18369 2023-08-01T19:54:50.254 INFO:teuthology.orchestra.run.smithi008.stdout: }, 2023-08-01T19:54:50.254 INFO:teuthology.orchestra.run.smithi008.stdout: "events": [ 2023-08-01T19:54:50.254 INFO:teuthology.orchestra.run.smithi008.stdout: { 2023-08-01T19:54:50.254 INFO:teuthology.orchestra.run.smithi008.stdout: "event": "initiated", 2023-08-01T19:54:50.255 INFO:teuthology.orchestra.run.smithi008.stdout: "time": "2023-08-01T19:54:28.997782+0000", 2023-08-01T19:54:50.255 INFO:teuthology.orchestra.run.smithi008.stdout: "duration": 0 2023-08-01T19:54:50.255 INFO:teuthology.orchestra.run.smithi008.stdout: }, 2023-08-01T19:54:50.255 INFO:teuthology.orchestra.run.smithi008.stdout: { 2023-08-01T19:54:50.255 INFO:teuthology.orchestra.run.smithi008.stdout: "event": "throttled", 2023-08-01T19:54:50.255 INFO:teuthology.orchestra.run.smithi008.stdout: "time": "2023-08-01T19:54:28.997782+0000", 2023-08-01T19:54:50.255 INFO:teuthology.orchestra.run.smithi008.stdout: "duration": 0 2023-08-01T19:54:50.255 INFO:teuthology.orchestra.run.smithi008.stdout: }, 2023-08-01T19:54:50.256 INFO:teuthology.orchestra.run.smithi008.stdout: { 2023-08-01T19:54:50.256 INFO:teuthology.orchestra.run.smithi008.stdout: "event": "header_read", 2023-08-01T19:54:50.256 INFO:teuthology.orchestra.run.smithi008.stdout: "time": "2023-08-01T19:54:28.997781+0000", 2023-08-01T19:54:50.256 INFO:teuthology.orchestra.run.smithi008.stdout: "duration": 4294967295.9999995 2023-08-01T19:54:50.256 INFO:teuthology.orchestra.run.smithi008.stdout: }, 2023-08-01T19:54:50.256 INFO:teuthology.orchestra.run.smithi008.stdout: { 2023-08-01T19:54:50.256 INFO:teuthology.orchestra.run.smithi008.stdout: "event": "all_read", 2023-08-01T19:54:50.256 INFO:teuthology.orchestra.run.smithi008.stdout: "time": "2023-08-01T19:54:28.997859+0000", 2023-08-01T19:54:50.257 INFO:teuthology.orchestra.run.smithi008.stdout: "duration": 7.7420000000000001e-05 2023-08-01T19:54:50.257 INFO:teuthology.orchestra.run.smithi008.stdout: }, 2023-08-01T19:54:50.257 INFO:teuthology.orchestra.run.smithi008.stdout: { 2023-08-01T19:54:50.257 INFO:teuthology.orchestra.run.smithi008.stdout: "event": "dispatched", 2023-08-01T19:54:50.257 INFO:teuthology.orchestra.run.smithi008.stdout: "time": "2023-08-01T19:54:28.997866+0000", 2023-08-01T19:54:50.257 INFO:teuthology.orchestra.run.smithi008.stdout: "duration": 7.2910000000000002e-06 2023-08-01T19:54:50.257 INFO:teuthology.orchestra.run.smithi008.stdout: }, 2023-08-01T19:54:50.257 INFO:teuthology.orchestra.run.smithi008.stdout: { 2023-08-01T19:54:50.258 INFO:teuthology.orchestra.run.smithi008.stdout: "event": "queued_for_pg", 2023-08-01T19:54:50.258 INFO:teuthology.orchestra.run.smithi008.stdout: "time": "2023-08-01T19:54:28.997872+0000", 2023-08-01T19:54:50.258 INFO:teuthology.orchestra.run.smithi008.stdout: "duration": 6.0460000000000002e-06 2023-08-01T19:54:50.258 INFO:teuthology.orchestra.run.smithi008.stdout: }, 2023-08-01T19:54:50.258 INFO:teuthology.orchestra.run.smithi008.stdout: { 2023-08-01T19:54:50.258 INFO:teuthology.orchestra.run.smithi008.stdout: "event": "reached_pg", 2023-08-01T19:54:50.258 INFO:teuthology.orchestra.run.smithi008.stdout: "time": "2023-08-01T19:54:28.997931+0000", 2023-08-01T19:54:50.259 INFO:teuthology.orchestra.run.smithi008.stdout: "duration": 5.8692e-05 2023-08-01T19:54:50.259 INFO:teuthology.orchestra.run.smithi008.stdout: }, 2023-08-01T19:54:50.259 INFO:teuthology.orchestra.run.smithi008.stdout: { 2023-08-01T19:54:50.259 INFO:teuthology.orchestra.run.smithi008.stdout: "event": "started", 2023-08-01T19:54:50.259 INFO:teuthology.orchestra.run.smithi008.stdout: "time": "2023-08-01T19:54:28.998082+0000", 2023-08-01T19:54:50.259 INFO:teuthology.orchestra.run.smithi008.stdout: "duration": 0.000151438 2023-08-01T19:54:50.259 INFO:teuthology.orchestra.run.smithi008.stdout: }, 2023-08-01T19:54:50.259 INFO:teuthology.orchestra.run.smithi008.stdout: { 2023-08-01T19:54:50.260 INFO:teuthology.orchestra.run.smithi008.stdout: "event": "waiting for subops from 1", 2023-08-01T19:54:50.260 INFO:teuthology.orchestra.run.smithi008.stdout: "time": "2023-08-01T19:54:28.998216+0000", 2023-08-01T19:54:50.260 INFO:teuthology.orchestra.run.smithi008.stdout: "duration": 0.00013328099999999999 2023-08-01T19:54:50.260 INFO:teuthology.orchestra.run.smithi008.stdout: }, 2023-08-01T19:54:50.260 INFO:teuthology.orchestra.run.smithi008.stdout: { 2023-08-01T19:54:50.260 INFO:teuthology.orchestra.run.smithi008.stdout: "event": "op_commit", 2023-08-01T19:54:50.260 INFO:teuthology.orchestra.run.smithi008.stdout: "time": "2023-08-01T19:54:29.000045+0000", 2023-08-01T19:54:50.261 INFO:teuthology.orchestra.run.smithi008.stdout: "duration": 0.001829231 2023-08-01T19:54:50.261 INFO:teuthology.orchestra.run.smithi008.stdout: }, 2023-08-01T19:54:50.261 INFO:teuthology.orchestra.run.smithi008.stdout: { 2023-08-01T19:54:50.261 INFO:teuthology.orchestra.run.smithi008.stdout: "event": "sub_op_commit_rec", 2023-08-01T19:54:50.261 INFO:teuthology.orchestra.run.smithi008.stdout: "time": "2023-08-01T19:54:29.011719+0000", 2023-08-01T19:54:50.261 INFO:teuthology.orchestra.run.smithi008.stdout: "duration": 0.011673817 2023-08-01T19:54:50.261 INFO:teuthology.orchestra.run.smithi008.stdout: }, 2023-08-01T19:54:50.261 INFO:teuthology.orchestra.run.smithi008.stdout: { 2023-08-01T19:54:50.262 INFO:teuthology.orchestra.run.smithi008.stdout: "event": "commit_sent", 2023-08-01T19:54:50.262 INFO:teuthology.orchestra.run.smithi008.stdout: "time": "2023-08-01T19:54:29.011743+0000", 2023-08-01T19:54:50.262 INFO:teuthology.orchestra.run.smithi008.stdout: "duration": 2.4663000000000001e-05 2023-08-01T19:54:50.262 INFO:teuthology.orchestra.run.smithi008.stdout: }, 2023-08-01T19:54:50.262 INFO:teuthology.orchestra.run.smithi008.stdout: { 2023-08-01T19:54:50.262 INFO:teuthology.orchestra.run.smithi008.stdout: "event": "done", 2023-08-01T19:54:50.262 INFO:teuthology.orchestra.run.smithi008.stdout: "time": "2023-08-01T19:54:29.011765+0000", 2023-08-01T19:54:50.262 INFO:teuthology.orchestra.run.smithi008.stdout: "duration": 2.1410999999999999e-05 2023-08-01T19:54:50.263 INFO:teuthology.orchestra.run.smithi008.stdout: } 2023-08-01T19:54:50.263 INFO:teuthology.orchestra.run.smithi008.stdout: ] 2023-08-01T19:54:50.263 INFO:teuthology.orchestra.run.smithi008.stdout: } 2023-08-01T19:54:50.263 INFO:teuthology.orchestra.run.smithi008.stdout: }, 2023-08-01T19:54:50.263 INFO:teuthology.orchestra.run.smithi008.stdout: { 2023-08-01T19:54:50.263 INFO:teuthology.orchestra.run.smithi008.stdout: "description": "osd_op(client.4668.0:20547 5.a 5:54001317:::benchmark_data_smithi006_114134_object20546:head [set-alloc-hint object_size 65536 write_size 65536,write 0~65536] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e23)", 2023-08-01T19:54:50.263 INFO:teuthology.orchestra.run.smithi008.stdout: "initiated_at": "2023-08-01T19:54:29.655560+0000", 2023-08-01T19:54:50.263 INFO:teuthology.orchestra.run.smithi008.stdout: "age": 20.550616413, 2023-08-01T19:54:50.264 INFO:teuthology.orchestra.run.smithi008.stdout: "duration": 0.014929586999999999, 2023-08-01T19:54:50.264 INFO:teuthology.orchestra.run.smithi008.stdout: "type_data": { 2023-08-01T19:54:50.264 INFO:teuthology.orchestra.run.smithi008.stdout: "flag_point": "commit sent; apply or cleanup", 2023-08-01T19:54:50.264 INFO:teuthology.orchestra.run.smithi008.stdout: "client_info": { 2023-08-01T19:54:50.264 INFO:teuthology.orchestra.run.smithi008.stdout: "client": "client.4668", 2023-08-01T19:54:50.264 INFO:teuthology.orchestra.run.smithi008.stdout: "client_addr": "172.21.15.6:0/1709472247", 2023-08-01T19:54:50.264 INFO:teuthology.orchestra.run.smithi008.stdout: "tid": 20547 2023-08-01T19:54:50.264 INFO:teuthology.orchestra.run.smithi008.stdout: }, 2023-08-01T19:54:50.265 INFO:teuthology.orchestra.run.smithi008.stdout: "events": [ 2023-08-01T19:54:50.265 INFO:teuthology.orchestra.run.smithi008.stdout: { 2023-08-01T19:54:50.265 INFO:teuthology.orchestra.run.smithi008.stdout: "event": "initiated", 2023-08-01T19:54:50.265 INFO:teuthology.orchestra.run.smithi008.stdout: "time": "2023-08-01T19:54:29.655560+0000", 2023-08-01T19:54:50.265 INFO:teuthology.orchestra.run.smithi008.stdout: "duration": 0 2023-08-01T19:54:50.265 INFO:teuthology.orchestra.run.smithi008.stdout: }, 2023-08-01T19:54:50.265 INFO:teuthology.orchestra.run.smithi008.stdout: { 2023-08-01T19:54:50.266 INFO:teuthology.orchestra.run.smithi008.stdout: "event": "throttled", 2023-08-01T19:54:50.266 INFO:teuthology.orchestra.run.smithi008.stdout: "time": "2023-08-01T19:54:29.655560+0000", 2023-08-01T19:54:50.266 INFO:teuthology.orchestra.run.smithi008.stdout: "duration": 0 2023-08-01T19:54:50.266 INFO:teuthology.orchestra.run.smithi008.stdout: }, 2023-08-01T19:54:50.266 INFO:teuthology.orchestra.run.smithi008.stdout: { 2023-08-01T19:54:50.266 INFO:teuthology.orchestra.run.smithi008.stdout: "event": "header_read", 2023-08-01T19:54:50.266 INFO:teuthology.orchestra.run.smithi008.stdout: "time": "2023-08-01T19:54:29.655560+0000", 2023-08-01T19:54:50.266 INFO:teuthology.orchestra.run.smithi008.stdout: "duration": 4294967295.9999995 2023-08-01T19:54:50.267 INFO:teuthology.orchestra.run.smithi008.stdout: }, 2023-08-01T19:54:50.267 INFO:teuthology.orchestra.run.smithi008.stdout: { 2023-08-01T19:54:50.267 INFO:teuthology.orchestra.run.smithi008.stdout: "event": "all_read", 2023-08-01T19:54:50.267 INFO:teuthology.orchestra.run.smithi008.stdout: "time": "2023-08-01T19:54:29.655590+0000", 2023-08-01T19:54:50.267 INFO:teuthology.orchestra.run.smithi008.stdout: "duration": 3.0467000000000002e-05 2023-08-01T19:54:50.267 INFO:teuthology.orchestra.run.smithi008.stdout: }, 2023-08-01T19:54:50.267 INFO:teuthology.orchestra.run.smithi008.stdout: { 2023-08-01T19:54:50.267 INFO:teuthology.orchestra.run.smithi008.stdout: "event": "dispatched", 2023-08-01T19:54:50.268 INFO:teuthology.orchestra.run.smithi008.stdout: "time": "2023-08-01T19:54:29.655600+0000", 2023-08-01T19:54:50.268 INFO:teuthology.orchestra.run.smithi008.stdout: "duration": 1.0103e-05 2023-08-01T19:54:50.268 INFO:teuthology.orchestra.run.smithi008.stdout: }, 2023-08-01T19:54:50.268 INFO:teuthology.orchestra.run.smithi008.stdout: { 2023-08-01T19:54:50.268 INFO:teuthology.orchestra.run.smithi008.stdout: "event": "queued_for_pg", 2023-08-01T19:54:50.268 INFO:teuthology.orchestra.run.smithi008.stdout: "time": "2023-08-01T19:54:29.655605+0000", 2023-08-01T19:54:50.268 INFO:teuthology.orchestra.run.smithi008.stdout: "duration": 4.1860000000000002e-06 2023-08-01T19:54:50.268 INFO:teuthology.orchestra.run.smithi008.stdout: }, 2023-08-01T19:54:50.269 INFO:teuthology.orchestra.run.smithi008.stdout: { 2023-08-01T19:54:50.269 INFO:teuthology.orchestra.run.smithi008.stdout: "event": "reached_pg", 2023-08-01T19:54:50.269 INFO:teuthology.orchestra.run.smithi008.stdout: "time": "2023-08-01T19:54:29.657832+0000", 2023-08-01T19:54:50.269 INFO:teuthology.orchestra.run.smithi008.stdout: "duration": 0.0022275630000000001 2023-08-01T19:54:50.269 INFO:teuthology.orchestra.run.smithi008.stdout: }, 2023-08-01T19:54:50.269 INFO:teuthology.orchestra.run.smithi008.stdout: { 2023-08-01T19:54:50.269 INFO:teuthology.orchestra.run.smithi008.stdout: "event": "started", 2023-08-01T19:54:50.270 INFO:teuthology.orchestra.run.smithi008.stdout: "time": "2023-08-01T19:54:29.657927+0000", 2023-08-01T19:54:50.270 INFO:teuthology.orchestra.run.smithi008.stdout: "duration": 9.5390000000000007e-05 2023-08-01T19:54:50.270 INFO:teuthology.orchestra.run.smithi008.stdout: }, 2023-08-01T19:54:50.270 INFO:teuthology.orchestra.run.smithi008.stdout: { 2023-08-01T19:54:50.270 INFO:teuthology.orchestra.run.smithi008.stdout: "event": "waiting for subops from 2", 2023-08-01T19:54:50.270 INFO:teuthology.orchestra.run.smithi008.stdout: "time": "2023-08-01T19:54:29.658008+0000", 2023-08-01T19:54:50.270 INFO:teuthology.orchestra.run.smithi008.stdout: "duration": 8.0671000000000001e-05 2023-08-01T19:54:50.270 INFO:teuthology.orchestra.run.smithi008.stdout: }, 2023-08-01T19:54:50.271 INFO:teuthology.orchestra.run.smithi008.stdout: { 2023-08-01T19:54:50.271 INFO:teuthology.orchestra.run.smithi008.stdout: "event": "op_commit", 2023-08-01T19:54:50.271 INFO:teuthology.orchestra.run.smithi008.stdout: "time": "2023-08-01T19:54:29.659542+0000", 2023-08-01T19:54:50.271 INFO:teuthology.orchestra.run.smithi008.stdout: "duration": 0.0015343220000000001 2023-08-01T19:54:50.271 INFO:teuthology.orchestra.run.smithi008.stdout: }, 2023-08-01T19:54:50.271 INFO:teuthology.orchestra.run.smithi008.stdout: { 2023-08-01T19:54:50.271 INFO:teuthology.orchestra.run.smithi008.stdout: "event": "sub_op_commit_rec", 2023-08-01T19:54:50.271 INFO:teuthology.orchestra.run.smithi008.stdout: "time": "2023-08-01T19:54:29.670439+0000", 2023-08-01T19:54:50.272 INFO:teuthology.orchestra.run.smithi008.stdout: "duration": 0.010896874000000001 2023-08-01T19:54:50.272 INFO:teuthology.orchestra.run.smithi008.stdout: }, 2023-08-01T19:54:50.272 INFO:teuthology.orchestra.run.smithi008.stdout: { 2023-08-01T19:54:50.272 INFO:teuthology.orchestra.run.smithi008.stdout: "event": "commit_sent", 2023-08-01T19:54:50.272 INFO:teuthology.orchestra.run.smithi008.stdout: "time": "2023-08-01T19:54:29.670467+0000", 2023-08-01T19:54:50.272 INFO:teuthology.orchestra.run.smithi008.stdout: "duration": 2.7433999999999999e-05 2023-08-01T19:54:50.272 INFO:teuthology.orchestra.run.smithi008.stdout: }, 2023-08-01T19:54:50.272 INFO:teuthology.orchestra.run.smithi008.stdout: { 2023-08-01T19:54:50.273 INFO:teuthology.orchestra.run.smithi008.stdout: "event": "done", 2023-08-01T19:54:50.273 INFO:teuthology.orchestra.run.smithi008.stdout: "time": "2023-08-01T19:54:29.670490+0000", 2023-08-01T19:54:50.273 INFO:teuthology.orchestra.run.smithi008.stdout: "duration": 2.3076000000000001e-05 2023-08-01T19:54:50.273 INFO:teuthology.orchestra.run.smithi008.stdout: } 2023-08-01T19:54:50.273 INFO:teuthology.orchestra.run.smithi008.stdout: ] 2023-08-01T19:54:50.273 INFO:teuthology.orchestra.run.smithi008.stdout: } 2023-08-01T19:54:50.273 INFO:teuthology.orchestra.run.smithi008.stdout: }, 2023-08-01T19:54:50.274 INFO:teuthology.orchestra.run.smithi008.stdout: { 2023-08-01T19:54:50.274 INFO:teuthology.orchestra.run.smithi008.stdout: "description": "osd_op(client.4668.0:31686 5.c 5:3d4453fd:::benchmark_data_smithi006_114134_object31685:head [set-alloc-hint object_size 65536 write_size 65536,write 0~65536] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e24)", 2023-08-01T19:54:50.274 INFO:teuthology.orchestra.run.smithi008.stdout: "initiated_at": "2023-08-01T19:54:33.230374+0000", 2023-08-01T19:54:50.274 INFO:teuthology.orchestra.run.smithi008.stdout: "age": 16.975802564999999, 2023-08-01T19:54:50.274 INFO:teuthology.orchestra.run.smithi008.stdout: "duration": 0.014786407, 2023-08-01T19:54:50.274 INFO:teuthology.orchestra.run.smithi008.stdout: "type_data": { 2023-08-01T19:54:50.274 INFO:teuthology.orchestra.run.smithi008.stdout: "flag_point": "commit sent; apply or cleanup", 2023-08-01T19:54:50.274 INFO:teuthology.orchestra.run.smithi008.stdout: "client_info": { 2023-08-01T19:54:50.275 INFO:teuthology.orchestra.run.smithi008.stdout: "client": "client.4668", 2023-08-01T19:54:50.275 INFO:teuthology.orchestra.run.smithi008.stdout: "client_addr": "172.21.15.6:0/1709472247", 2023-08-01T19:54:50.275 INFO:teuthology.orchestra.run.smithi008.stdout: "tid": 31686 2023-08-01T19:54:50.275 INFO:teuthology.orchestra.run.smithi008.stdout: }, 2023-08-01T19:54:50.275 INFO:teuthology.orchestra.run.smithi008.stdout: "events": [ 2023-08-01T19:54:50.275 INFO:teuthology.orchestra.run.smithi008.stdout: { 2023-08-01T19:54:50.275 INFO:teuthology.orchestra.run.smithi008.stdout: "event": "initiated", 2023-08-01T19:54:50.275 INFO:teuthology.orchestra.run.smithi008.stdout: "time": "2023-08-01T19:54:33.230374+0000", 2023-08-01T19:54:50.276 INFO:teuthology.orchestra.run.smithi008.stdout: "duration": 0 2023-08-01T19:54:50.276 INFO:teuthology.orchestra.run.smithi008.stdout: }, 2023-08-01T19:54:50.276 INFO:teuthology.orchestra.run.smithi008.stdout: { 2023-08-01T19:54:50.276 INFO:teuthology.orchestra.run.smithi008.stdout: "event": "throttled", 2023-08-01T19:54:50.276 INFO:teuthology.orchestra.run.smithi008.stdout: "time": "2023-08-01T19:54:33.230374+0000", 2023-08-01T19:54:50.276 INFO:teuthology.orchestra.run.smithi008.stdout: "duration": 0 2023-08-01T19:54:50.276 INFO:teuthology.orchestra.run.smithi008.stdout: }, 2023-08-01T19:54:50.276 INFO:teuthology.orchestra.run.smithi008.stdout: { 2023-08-01T19:54:50.277 INFO:teuthology.orchestra.run.smithi008.stdout: "event": "header_read", 2023-08-01T19:54:50.277 INFO:teuthology.orchestra.run.smithi008.stdout: "time": "2023-08-01T19:54:33.230373+0000", 2023-08-01T19:54:50.277 INFO:teuthology.orchestra.run.smithi008.stdout: "duration": 4294967295.999999 2023-08-01T19:54:50.277 INFO:teuthology.orchestra.run.smithi008.stdout: }, 2023-08-01T19:54:50.277 INFO:teuthology.orchestra.run.smithi008.stdout: { 2023-08-01T19:54:50.277 INFO:teuthology.orchestra.run.smithi008.stdout: "event": "all_read", 2023-08-01T19:54:50.277 INFO:teuthology.orchestra.run.smithi008.stdout: "time": "2023-08-01T19:54:33.230444+0000", 2023-08-01T19:54:50.278 INFO:teuthology.orchestra.run.smithi008.stdout: "duration": 7.0624999999999996e-05 2023-08-01T19:54:50.278 INFO:teuthology.orchestra.run.smithi008.stdout: }, 2023-08-01T19:54:50.278 INFO:teuthology.orchestra.run.smithi008.stdout: { 2023-08-01T19:54:50.278 INFO:teuthology.orchestra.run.smithi008.stdout: "event": "dispatched", 2023-08-01T19:54:50.278 INFO:teuthology.orchestra.run.smithi008.stdout: "time": "2023-08-01T19:54:33.230455+0000", 2023-08-01T19:54:50.278 INFO:teuthology.orchestra.run.smithi008.stdout: "duration": 1.0669000000000001e-05 2023-08-01T19:54:50.278 INFO:teuthology.orchestra.run.smithi008.stdout: }, 2023-08-01T19:54:50.279 INFO:teuthology.orchestra.run.smithi008.stdout: { 2023-08-01T19:54:50.279 INFO:teuthology.orchestra.run.smithi008.stdout: "event": "queued_for_pg", 2023-08-01T19:54:50.279 INFO:teuthology.orchestra.run.smithi008.stdout: "time": "2023-08-01T19:54:33.230461+0000", 2023-08-01T19:54:50.279 INFO:teuthology.orchestra.run.smithi008.stdout: "duration": 6.3099999999999997e-06 2023-08-01T19:54:50.279 INFO:teuthology.orchestra.run.smithi008.stdout: }, 2023-08-01T19:54:50.279 INFO:teuthology.orchestra.run.smithi008.stdout: { 2023-08-01T19:54:50.279 INFO:teuthology.orchestra.run.smithi008.stdout: "event": "reached_pg", 2023-08-01T19:54:50.279 INFO:teuthology.orchestra.run.smithi008.stdout: "time": "2023-08-01T19:54:33.230816+0000", 2023-08-01T19:54:50.280 INFO:teuthology.orchestra.run.smithi008.stdout: "duration": 0.000355161 2023-08-01T19:54:50.280 INFO:teuthology.orchestra.run.smithi008.stdout: }, 2023-08-01T19:54:50.280 INFO:teuthology.orchestra.run.smithi008.stdout: { 2023-08-01T19:54:50.280 INFO:teuthology.orchestra.run.smithi008.stdout: "event": "started", 2023-08-01T19:54:50.280 INFO:teuthology.orchestra.run.smithi008.stdout: "time": "2023-08-01T19:54:33.230925+0000", 2023-08-01T19:54:50.280 INFO:teuthology.orchestra.run.smithi008.stdout: "duration": 0.0001091 2023-08-01T19:54:50.280 INFO:teuthology.orchestra.run.smithi008.stdout: }, 2023-08-01T19:54:50.280 INFO:teuthology.orchestra.run.smithi008.stdout: { 2023-08-01T19:54:50.281 INFO:teuthology.orchestra.run.smithi008.stdout: "event": "waiting for subops from 1", 2023-08-01T19:54:50.281 INFO:teuthology.orchestra.run.smithi008.stdout: "time": "2023-08-01T19:54:33.231057+0000", 2023-08-01T19:54:50.281 INFO:teuthology.orchestra.run.smithi008.stdout: "duration": 0.000131932 2023-08-01T19:54:50.281 INFO:teuthology.orchestra.run.smithi008.stdout: }, 2023-08-01T19:54:50.281 INFO:teuthology.orchestra.run.smithi008.stdout: { 2023-08-01T19:54:50.281 INFO:teuthology.orchestra.run.smithi008.stdout: "event": "op_commit", 2023-08-01T19:54:50.281 INFO:teuthology.orchestra.run.smithi008.stdout: "time": "2023-08-01T19:54:33.234362+0000", 2023-08-01T19:54:50.282 INFO:teuthology.orchestra.run.smithi008.stdout: "duration": 0.0033053370000000002 2023-08-01T19:54:50.282 INFO:teuthology.orchestra.run.smithi008.stdout: }, 2023-08-01T19:54:50.282 INFO:teuthology.orchestra.run.smithi008.stdout: { 2023-08-01T19:54:50.282 INFO:teuthology.orchestra.run.smithi008.stdout: "event": "sub_op_commit_rec", 2023-08-01T19:54:50.282 INFO:teuthology.orchestra.run.smithi008.stdout: "time": "2023-08-01T19:54:33.245059+0000", 2023-08-01T19:54:50.282 INFO:teuthology.orchestra.run.smithi008.stdout: "duration": 0.010696463999999999 2023-08-01T19:54:50.282 INFO:teuthology.orchestra.run.smithi008.stdout: }, 2023-08-01T19:54:50.282 INFO:teuthology.orchestra.run.smithi008.stdout: { 2023-08-01T19:54:50.283 INFO:teuthology.orchestra.run.smithi008.stdout: "event": "commit_sent", 2023-08-01T19:54:50.283 INFO:teuthology.orchestra.run.smithi008.stdout: "time": "2023-08-01T19:54:33.245116+0000", 2023-08-01T19:54:50.283 INFO:teuthology.orchestra.run.smithi008.stdout: "duration": 5.6990000000000002e-05 2023-08-01T19:54:50.283 INFO:teuthology.orchestra.run.smithi008.stdout: }, 2023-08-01T19:54:50.283 INFO:teuthology.orchestra.run.smithi008.stdout: { 2023-08-01T19:54:50.283 INFO:teuthology.orchestra.run.smithi008.stdout: "event": "done", 2023-08-01T19:54:50.283 INFO:teuthology.orchestra.run.smithi008.stdout: "time": "2023-08-01T19:54:33.245161+0000", 2023-08-01T19:54:50.284 INFO:teuthology.orchestra.run.smithi008.stdout: "duration": 4.4625e-05 2023-08-01T19:54:50.284 INFO:teuthology.orchestra.run.smithi008.stdout: } 2023-08-01T19:54:50.284 INFO:teuthology.orchestra.run.smithi008.stdout: ] 2023-08-01T19:54:50.284 INFO:teuthology.orchestra.run.smithi008.stdout: } 2023-08-01T19:54:50.284 INFO:teuthology.orchestra.run.smithi008.stdout: }, 2023-08-01T19:54:50.284 INFO:teuthology.orchestra.run.smithi008.stdout: { 2023-08-01T19:54:50.284 INFO:teuthology.orchestra.run.smithi008.stdout: "description": "osd_op(client.4668.0:42456 5.5 5:a63cfb95:::benchmark_data_smithi006_114134_object42455:head [set-alloc-hint object_size 65536 write_size 65536,write 0~65536] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e26)", 2023-08-01T19:54:50.284 INFO:teuthology.orchestra.run.smithi008.stdout: "initiated_at": "2023-08-01T19:54:37.199768+0000", 2023-08-01T19:54:50.285 INFO:teuthology.orchestra.run.smithi008.stdout: "age": 13.0064086, 2023-08-01T19:54:50.285 INFO:teuthology.orchestra.run.smithi008.stdout: "duration": 0.015069397999999999, 2023-08-01T19:54:50.285 INFO:teuthology.orchestra.run.smithi008.stdout: "type_data": { 2023-08-01T19:54:50.285 INFO:teuthology.orchestra.run.smithi008.stdout: "flag_point": "commit sent; apply or cleanup", 2023-08-01T19:54:50.285 INFO:teuthology.orchestra.run.smithi008.stdout: "client_info": { 2023-08-01T19:54:50.285 INFO:teuthology.orchestra.run.smithi008.stdout: "client": "client.4668", 2023-08-01T19:54:50.285 INFO:teuthology.orchestra.run.smithi008.stdout: "client_addr": "172.21.15.6:0/1709472247", 2023-08-01T19:54:50.286 INFO:teuthology.orchestra.run.smithi008.stdout: "tid": 42456 2023-08-01T19:54:50.286 INFO:teuthology.orchestra.run.smithi008.stdout: }, 2023-08-01T19:54:50.286 INFO:teuthology.orchestra.run.smithi008.stdout: "events": [ 2023-08-01T19:54:50.286 INFO:teuthology.orchestra.run.smithi008.stdout: { 2023-08-01T19:54:50.286 INFO:teuthology.orchestra.run.smithi008.stdout: "event": "initiated", 2023-08-01T19:54:50.286 INFO:teuthology.orchestra.run.smithi008.stdout: "time": "2023-08-01T19:54:37.199768+0000", 2023-08-01T19:54:50.286 INFO:teuthology.orchestra.run.smithi008.stdout: "duration": 0 2023-08-01T19:54:50.287 INFO:teuthology.orchestra.run.smithi008.stdout: }, 2023-08-01T19:54:50.287 INFO:teuthology.orchestra.run.smithi008.stdout: { 2023-08-01T19:54:50.287 INFO:teuthology.orchestra.run.smithi008.stdout: "event": "throttled", 2023-08-01T19:54:50.287 INFO:teuthology.orchestra.run.smithi008.stdout: "time": "2023-08-01T19:54:37.199768+0000", 2023-08-01T19:54:50.287 INFO:teuthology.orchestra.run.smithi008.stdout: "duration": 0 2023-08-01T19:54:50.287 INFO:teuthology.orchestra.run.smithi008.stdout: }, 2023-08-01T19:54:50.287 INFO:teuthology.orchestra.run.smithi008.stdout: { 2023-08-01T19:54:50.287 INFO:teuthology.orchestra.run.smithi008.stdout: "event": "header_read", 2023-08-01T19:54:50.288 INFO:teuthology.orchestra.run.smithi008.stdout: "time": "2023-08-01T19:54:37.199767+0000", 2023-08-01T19:54:50.288 INFO:teuthology.orchestra.run.smithi008.stdout: "duration": 4294967295.9999995 2023-08-01T19:54:50.288 INFO:teuthology.orchestra.run.smithi008.stdout: }, 2023-08-01T19:54:50.288 INFO:teuthology.orchestra.run.smithi008.stdout: { 2023-08-01T19:54:50.288 INFO:teuthology.orchestra.run.smithi008.stdout: "event": "all_read", 2023-08-01T19:54:50.288 INFO:teuthology.orchestra.run.smithi008.stdout: "time": "2023-08-01T19:54:37.199798+0000", 2023-08-01T19:54:50.288 INFO:teuthology.orchestra.run.smithi008.stdout: "duration": 3.0443999999999999e-05 2023-08-01T19:54:50.289 INFO:teuthology.orchestra.run.smithi008.stdout: }, 2023-08-01T19:54:50.289 INFO:teuthology.orchestra.run.smithi008.stdout: { 2023-08-01T19:54:50.289 INFO:teuthology.orchestra.run.smithi008.stdout: "event": "dispatched", 2023-08-01T19:54:50.289 INFO:teuthology.orchestra.run.smithi008.stdout: "time": "2023-08-01T19:54:37.199806+0000", 2023-08-01T19:54:50.289 INFO:teuthology.orchestra.run.smithi008.stdout: "duration": 8.2300000000000008e-06 2023-08-01T19:54:50.289 INFO:teuthology.orchestra.run.smithi008.stdout: }, 2023-08-01T19:54:50.289 INFO:teuthology.orchestra.run.smithi008.stdout: { 2023-08-01T19:54:50.290 INFO:teuthology.orchestra.run.smithi008.stdout: "event": "queued_for_pg", 2023-08-01T19:54:50.290 INFO:teuthology.orchestra.run.smithi008.stdout: "time": "2023-08-01T19:54:37.199811+0000", 2023-08-01T19:54:50.290 INFO:teuthology.orchestra.run.smithi008.stdout: "duration": 5.2730000000000002e-06 2023-08-01T19:54:50.290 INFO:teuthology.orchestra.run.smithi008.stdout: }, 2023-08-01T19:54:50.290 INFO:teuthology.orchestra.run.smithi008.stdout: { 2023-08-01T19:54:50.290 INFO:teuthology.orchestra.run.smithi008.stdout: "event": "reached_pg", 2023-08-01T19:54:50.290 INFO:teuthology.orchestra.run.smithi008.stdout: "time": "2023-08-01T19:54:37.200406+0000", 2023-08-01T19:54:50.290 INFO:teuthology.orchestra.run.smithi008.stdout: "duration": 0.00059457599999999998 2023-08-01T19:54:50.291 INFO:teuthology.orchestra.run.smithi008.stdout: }, 2023-08-01T19:54:50.291 INFO:teuthology.orchestra.run.smithi008.stdout: { 2023-08-01T19:54:50.291 INFO:teuthology.orchestra.run.smithi008.stdout: "event": "started", 2023-08-01T19:54:50.291 INFO:teuthology.orchestra.run.smithi008.stdout: "time": "2023-08-01T19:54:37.200532+0000", 2023-08-01T19:54:50.291 INFO:teuthology.orchestra.run.smithi008.stdout: "duration": 0.000126129 2023-08-01T19:54:50.291 INFO:teuthology.orchestra.run.smithi008.stdout: }, 2023-08-01T19:54:50.291 INFO:teuthology.orchestra.run.smithi008.stdout: { 2023-08-01T19:54:50.291 INFO:teuthology.orchestra.run.smithi008.stdout: "event": "waiting for subops from 1", 2023-08-01T19:54:50.292 INFO:teuthology.orchestra.run.smithi008.stdout: "time": "2023-08-01T19:54:37.200644+0000", 2023-08-01T19:54:50.292 INFO:teuthology.orchestra.run.smithi008.stdout: "duration": 0.000111736 2023-08-01T19:54:50.292 INFO:teuthology.orchestra.run.smithi008.stdout: }, 2023-08-01T19:54:50.292 INFO:teuthology.orchestra.run.smithi008.stdout: { 2023-08-01T19:54:50.292 INFO:teuthology.orchestra.run.smithi008.stdout: "event": "sub_op_commit_rec", 2023-08-01T19:54:50.292 INFO:teuthology.orchestra.run.smithi008.stdout: "time": "2023-08-01T19:54:37.203384+0000", 2023-08-01T19:54:50.292 INFO:teuthology.orchestra.run.smithi008.stdout: "duration": 0.0027397039999999999 2023-08-01T19:54:50.293 INFO:teuthology.orchestra.run.smithi008.stdout: }, 2023-08-01T19:54:50.293 INFO:teuthology.orchestra.run.smithi008.stdout: { 2023-08-01T19:54:50.293 INFO:teuthology.orchestra.run.smithi008.stdout: "event": "op_commit", 2023-08-01T19:54:50.293 INFO:teuthology.orchestra.run.smithi008.stdout: "time": "2023-08-01T19:54:37.214746+0000", 2023-08-01T19:54:50.293 INFO:teuthology.orchestra.run.smithi008.stdout: "duration": 0.011362766 2023-08-01T19:54:50.293 INFO:teuthology.orchestra.run.smithi008.stdout: }, 2023-08-01T19:54:50.293 INFO:teuthology.orchestra.run.smithi008.stdout: { 2023-08-01T19:54:50.293 INFO:teuthology.orchestra.run.smithi008.stdout: "event": "commit_sent", 2023-08-01T19:54:50.294 INFO:teuthology.orchestra.run.smithi008.stdout: "time": "2023-08-01T19:54:37.214795+0000", 2023-08-01T19:54:50.294 INFO:teuthology.orchestra.run.smithi008.stdout: "duration": 4.8449000000000003e-05 2023-08-01T19:54:50.294 INFO:teuthology.orchestra.run.smithi008.stdout: }, 2023-08-01T19:54:50.294 INFO:teuthology.orchestra.run.smithi008.stdout: { 2023-08-01T19:54:50.294 INFO:teuthology.orchestra.run.smithi008.stdout: "event": "done", 2023-08-01T19:54:50.294 INFO:teuthology.orchestra.run.smithi008.stdout: "time": "2023-08-01T19:54:37.214837+0000", 2023-08-01T19:54:50.294 INFO:teuthology.orchestra.run.smithi008.stdout: "duration": 4.2661999999999999e-05 2023-08-01T19:54:50.295 INFO:teuthology.orchestra.run.smithi008.stdout: } 2023-08-01T19:54:50.295 INFO:teuthology.orchestra.run.smithi008.stdout: ] 2023-08-01T19:54:50.295 INFO:teuthology.orchestra.run.smithi008.stdout: } 2023-08-01T19:54:50.295 INFO:teuthology.orchestra.run.smithi008.stdout: }, 2023-08-01T19:54:50.295 INFO:teuthology.orchestra.run.smithi008.stdout: { 2023-08-01T19:54:50.295 INFO:teuthology.orchestra.run.smithi008.stdout: "description": "osd_op(client.4668.0:52189 5.a 5:5868cda2:::benchmark_data_smithi006_114134_object52188:head [set-alloc-hint object_size 65536 write_size 65536,write 0~65536] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e27)", 2023-08-01T19:54:50.295 INFO:teuthology.orchestra.run.smithi008.stdout: "initiated_at": "2023-08-01T19:54:41.259379+0000", 2023-08-01T19:54:50.296 INFO:teuthology.orchestra.run.smithi008.stdout: "age": 8.9467971720000001, 2023-08-01T19:54:50.296 INFO:teuthology.orchestra.run.smithi008.stdout: "duration": 0.014704129999999999, 2023-08-01T19:54:50.296 INFO:teuthology.orchestra.run.smithi008.stdout: "type_data": { 2023-08-01T19:54:50.296 INFO:teuthology.orchestra.run.smithi008.stdout: "flag_point": "commit sent; apply or cleanup", 2023-08-01T19:54:50.296 INFO:teuthology.orchestra.run.smithi008.stdout: "client_info": { 2023-08-01T19:54:50.296 INFO:teuthology.orchestra.run.smithi008.stdout: "client": "client.4668", 2023-08-01T19:54:50.296 INFO:teuthology.orchestra.run.smithi008.stdout: "client_addr": "172.21.15.6:0/1709472247", 2023-08-01T19:54:50.296 INFO:teuthology.orchestra.run.smithi008.stdout: "tid": 52189 2023-08-01T19:54:50.297 INFO:teuthology.orchestra.run.smithi008.stdout: }, 2023-08-01T19:54:50.297 INFO:teuthology.orchestra.run.smithi008.stdout: "events": [ 2023-08-01T19:54:50.297 INFO:teuthology.orchestra.run.smithi008.stdout: { 2023-08-01T19:54:50.297 INFO:teuthology.orchestra.run.smithi008.stdout: "event": "initiated", 2023-08-01T19:54:50.297 INFO:teuthology.orchestra.run.smithi008.stdout: "time": "2023-08-01T19:54:41.259379+0000", 2023-08-01T19:54:50.297 INFO:teuthology.orchestra.run.smithi008.stdout: "duration": 0 2023-08-01T19:54:50.297 INFO:teuthology.orchestra.run.smithi008.stdout: }, 2023-08-01T19:54:50.298 INFO:teuthology.orchestra.run.smithi008.stdout: { 2023-08-01T19:54:50.298 INFO:teuthology.orchestra.run.smithi008.stdout: "event": "throttled", 2023-08-01T19:54:50.298 INFO:teuthology.orchestra.run.smithi008.stdout: "time": "2023-08-01T19:54:41.259379+0000", 2023-08-01T19:54:50.298 INFO:teuthology.orchestra.run.smithi008.stdout: "duration": 0 2023-08-01T19:54:50.298 INFO:teuthology.orchestra.run.smithi008.stdout: }, 2023-08-01T19:54:50.298 INFO:teuthology.orchestra.run.smithi008.stdout: { 2023-08-01T19:54:50.298 INFO:teuthology.orchestra.run.smithi008.stdout: "event": "header_read", 2023-08-01T19:54:50.298 INFO:teuthology.orchestra.run.smithi008.stdout: "time": "2023-08-01T19:54:41.259379+0000", 2023-08-01T19:54:50.299 INFO:teuthology.orchestra.run.smithi008.stdout: "duration": 4294967295.9999995 2023-08-01T19:54:50.299 INFO:teuthology.orchestra.run.smithi008.stdout: }, 2023-08-01T19:54:50.299 INFO:teuthology.orchestra.run.smithi008.stdout: { 2023-08-01T19:54:50.299 INFO:teuthology.orchestra.run.smithi008.stdout: "event": "all_read", 2023-08-01T19:54:50.299 INFO:teuthology.orchestra.run.smithi008.stdout: "time": "2023-08-01T19:54:41.259417+0000", 2023-08-01T19:54:50.299 INFO:teuthology.orchestra.run.smithi008.stdout: "duration": 3.7667999999999999e-05 2023-08-01T19:54:50.299 INFO:teuthology.orchestra.run.smithi008.stdout: }, 2023-08-01T19:54:50.299 INFO:teuthology.orchestra.run.smithi008.stdout: { 2023-08-01T19:54:50.300 INFO:teuthology.orchestra.run.smithi008.stdout: "event": "dispatched", 2023-08-01T19:54:50.300 INFO:teuthology.orchestra.run.smithi008.stdout: "time": "2023-08-01T19:54:41.259427+0000", 2023-08-01T19:54:50.300 INFO:teuthology.orchestra.run.smithi008.stdout: "duration": 9.9289999999999993e-06 2023-08-01T19:54:50.300 INFO:teuthology.orchestra.run.smithi008.stdout: }, 2023-08-01T19:54:50.300 INFO:teuthology.orchestra.run.smithi008.stdout: { 2023-08-01T19:54:50.300 INFO:teuthology.orchestra.run.smithi008.stdout: "event": "queued_for_pg", 2023-08-01T19:54:50.300 INFO:teuthology.orchestra.run.smithi008.stdout: "time": "2023-08-01T19:54:41.259432+0000", 2023-08-01T19:54:50.300 INFO:teuthology.orchestra.run.smithi008.stdout: "duration": 5.0509999999999996e-06 2023-08-01T19:54:50.301 INFO:teuthology.orchestra.run.smithi008.stdout: }, 2023-08-01T19:54:50.301 INFO:teuthology.orchestra.run.smithi008.stdout: { 2023-08-01T19:54:50.301 INFO:teuthology.orchestra.run.smithi008.stdout: "event": "reached_pg", 2023-08-01T19:54:50.301 INFO:teuthology.orchestra.run.smithi008.stdout: "time": "2023-08-01T19:54:41.261308+0000", 2023-08-01T19:54:50.301 INFO:teuthology.orchestra.run.smithi008.stdout: "duration": 0.0018767619999999999 2023-08-01T19:54:50.301 INFO:teuthology.orchestra.run.smithi008.stdout: }, 2023-08-01T19:54:50.301 INFO:teuthology.orchestra.run.smithi008.stdout: { 2023-08-01T19:54:50.302 INFO:teuthology.orchestra.run.smithi008.stdout: "event": "started", 2023-08-01T19:54:50.302 INFO:teuthology.orchestra.run.smithi008.stdout: "time": "2023-08-01T19:54:41.261462+0000", 2023-08-01T19:54:50.302 INFO:teuthology.orchestra.run.smithi008.stdout: "duration": 0.00015356300000000001 2023-08-01T19:54:50.302 INFO:teuthology.orchestra.run.smithi008.stdout: }, 2023-08-01T19:54:50.302 INFO:teuthology.orchestra.run.smithi008.stdout: { 2023-08-01T19:54:50.302 INFO:teuthology.orchestra.run.smithi008.stdout: "event": "waiting for subops from 2", 2023-08-01T19:54:50.302 INFO:teuthology.orchestra.run.smithi008.stdout: "time": "2023-08-01T19:54:41.261598+0000", 2023-08-01T19:54:50.302 INFO:teuthology.orchestra.run.smithi008.stdout: "duration": 0.000136487 2023-08-01T19:54:50.303 INFO:teuthology.orchestra.run.smithi008.stdout: }, 2023-08-01T19:54:50.303 INFO:teuthology.orchestra.run.smithi008.stdout: { 2023-08-01T19:54:50.303 INFO:teuthology.orchestra.run.smithi008.stdout: "event": "op_commit", 2023-08-01T19:54:50.303 INFO:teuthology.orchestra.run.smithi008.stdout: "time": "2023-08-01T19:54:41.268183+0000", 2023-08-01T19:54:50.303 INFO:teuthology.orchestra.run.smithi008.stdout: "duration": 0.0065849929999999999 2023-08-01T19:54:50.303 INFO:teuthology.orchestra.run.smithi008.stdout: }, 2023-08-01T19:54:50.303 INFO:teuthology.orchestra.run.smithi008.stdout: { 2023-08-01T19:54:50.304 INFO:teuthology.orchestra.run.smithi008.stdout: "event": "sub_op_commit_rec", 2023-08-01T19:54:50.304 INFO:teuthology.orchestra.run.smithi008.stdout: "time": "2023-08-01T19:54:41.273975+0000", 2023-08-01T19:54:50.304 INFO:teuthology.orchestra.run.smithi008.stdout: "duration": 0.0057916449999999998 2023-08-01T19:54:50.304 INFO:teuthology.orchestra.run.smithi008.stdout: }, 2023-08-01T19:54:50.304 INFO:teuthology.orchestra.run.smithi008.stdout: { 2023-08-01T19:54:50.304 INFO:teuthology.orchestra.run.smithi008.stdout: "event": "commit_sent", 2023-08-01T19:54:50.304 INFO:teuthology.orchestra.run.smithi008.stdout: "time": "2023-08-01T19:54:41.274042+0000", 2023-08-01T19:54:50.304 INFO:teuthology.orchestra.run.smithi008.stdout: "duration": 6.6531000000000004e-05 2023-08-01T19:54:50.305 INFO:teuthology.orchestra.run.smithi008.stdout: }, 2023-08-01T19:54:50.305 INFO:teuthology.orchestra.run.smithi008.stdout: { 2023-08-01T19:54:50.305 INFO:teuthology.orchestra.run.smithi008.stdout: "event": "done", 2023-08-01T19:54:50.305 INFO:teuthology.orchestra.run.smithi008.stdout: "time": "2023-08-01T19:54:41.274084+0000", 2023-08-01T19:54:50.305 INFO:teuthology.orchestra.run.smithi008.stdout: "duration": 4.2021999999999998e-05 2023-08-01T19:54:50.305 INFO:teuthology.orchestra.run.smithi008.stdout: } 2023-08-01T19:54:50.305 INFO:teuthology.orchestra.run.smithi008.stdout: ] 2023-08-01T19:54:50.305 INFO:teuthology.orchestra.run.smithi008.stdout: } 2023-08-01T19:54:50.306 INFO:teuthology.orchestra.run.smithi008.stdout: }, 2023-08-01T19:54:50.306 INFO:teuthology.orchestra.run.smithi008.stdout: { 2023-08-01T19:54:50.306 INFO:teuthology.orchestra.run.smithi008.stdout: "description": "osd_op(client.4668.0:52275 5.a 5:56383264:::benchmark_data_smithi006_114134_object52274:head [set-alloc-hint object_size 65536 write_size 65536,write 0~65536] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e27)", 2023-08-01T19:54:50.306 INFO:teuthology.orchestra.run.smithi008.stdout: "initiated_at": "2023-08-01T19:54:41.299219+0000", 2023-08-01T19:54:50.306 INFO:teuthology.orchestra.run.smithi008.stdout: "age": 8.906957856, 2023-08-01T19:54:50.306 INFO:teuthology.orchestra.run.smithi008.stdout: "duration": 0.013777899, 2023-08-01T19:54:50.306 INFO:teuthology.orchestra.run.smithi008.stdout: "type_data": { 2023-08-01T19:54:50.306 INFO:teuthology.orchestra.run.smithi008.stdout: "flag_point": "commit sent; apply or cleanup", 2023-08-01T19:54:50.307 INFO:teuthology.orchestra.run.smithi008.stdout: "client_info": { 2023-08-01T19:54:50.307 INFO:teuthology.orchestra.run.smithi008.stdout: "client": "client.4668", 2023-08-01T19:54:50.307 INFO:teuthology.orchestra.run.smithi008.stdout: "client_addr": "172.21.15.6:0/1709472247", 2023-08-01T19:54:50.307 INFO:teuthology.orchestra.run.smithi008.stdout: "tid": 52275 2023-08-01T19:54:50.307 INFO:teuthology.orchestra.run.smithi008.stdout: }, 2023-08-01T19:54:50.307 INFO:teuthology.orchestra.run.smithi008.stdout: "events": [ 2023-08-01T19:54:50.307 INFO:teuthology.orchestra.run.smithi008.stdout: { 2023-08-01T19:54:50.308 INFO:teuthology.orchestra.run.smithi008.stdout: "event": "initiated", 2023-08-01T19:54:50.308 INFO:teuthology.orchestra.run.smithi008.stdout: "time": "2023-08-01T19:54:41.299219+0000", 2023-08-01T19:54:50.308 INFO:teuthology.orchestra.run.smithi008.stdout: "duration": 0 2023-08-01T19:54:50.308 INFO:teuthology.orchestra.run.smithi008.stdout: }, 2023-08-01T19:54:50.308 INFO:teuthology.orchestra.run.smithi008.stdout: { 2023-08-01T19:54:50.308 INFO:teuthology.orchestra.run.smithi008.stdout: "event": "throttled", 2023-08-01T19:54:50.308 INFO:teuthology.orchestra.run.smithi008.stdout: "time": "2023-08-01T19:54:41.299219+0000", 2023-08-01T19:54:50.309 INFO:teuthology.orchestra.run.smithi008.stdout: "duration": 0 2023-08-01T19:54:50.309 INFO:teuthology.orchestra.run.smithi008.stdout: }, 2023-08-01T19:54:50.309 INFO:teuthology.orchestra.run.smithi008.stdout: { 2023-08-01T19:54:50.309 INFO:teuthology.orchestra.run.smithi008.stdout: "event": "header_read", 2023-08-01T19:54:50.309 INFO:teuthology.orchestra.run.smithi008.stdout: "time": "2023-08-01T19:54:41.299218+0000", 2023-08-01T19:54:50.309 INFO:teuthology.orchestra.run.smithi008.stdout: "duration": 4294967295.999999 2023-08-01T19:54:50.309 INFO:teuthology.orchestra.run.smithi008.stdout: }, 2023-08-01T19:54:50.309 INFO:teuthology.orchestra.run.smithi008.stdout: { 2023-08-01T19:54:50.310 INFO:teuthology.orchestra.run.smithi008.stdout: "event": "all_read", 2023-08-01T19:54:50.310 INFO:teuthology.orchestra.run.smithi008.stdout: "time": "2023-08-01T19:54:41.299278+0000", 2023-08-01T19:54:50.310 INFO:teuthology.orchestra.run.smithi008.stdout: "duration": 6.0229000000000002e-05 2023-08-01T19:54:50.310 INFO:teuthology.orchestra.run.smithi008.stdout: }, 2023-08-01T19:54:50.310 INFO:teuthology.orchestra.run.smithi008.stdout: { 2023-08-01T19:54:50.310 INFO:teuthology.orchestra.run.smithi008.stdout: "event": "dispatched", 2023-08-01T19:54:50.310 INFO:teuthology.orchestra.run.smithi008.stdout: "time": "2023-08-01T19:54:41.299290+0000", 2023-08-01T19:54:50.310 INFO:teuthology.orchestra.run.smithi008.stdout: "duration": 1.1567e-05 2023-08-01T19:54:50.311 INFO:teuthology.orchestra.run.smithi008.stdout: }, 2023-08-01T19:54:50.311 INFO:teuthology.orchestra.run.smithi008.stdout: { 2023-08-01T19:54:50.311 INFO:teuthology.orchestra.run.smithi008.stdout: "event": "queued_for_pg", 2023-08-01T19:54:50.311 INFO:teuthology.orchestra.run.smithi008.stdout: "time": "2023-08-01T19:54:41.299295+0000", 2023-08-01T19:54:50.311 INFO:teuthology.orchestra.run.smithi008.stdout: "duration": 5.4389999999999999e-06 2023-08-01T19:54:50.311 INFO:teuthology.orchestra.run.smithi008.stdout: }, 2023-08-01T19:54:50.311 INFO:teuthology.orchestra.run.smithi008.stdout: { 2023-08-01T19:54:50.311 INFO:teuthology.orchestra.run.smithi008.stdout: "event": "reached_pg", 2023-08-01T19:54:50.312 INFO:teuthology.orchestra.run.smithi008.stdout: "time": "2023-08-01T19:54:41.306435+0000", 2023-08-01T19:54:50.312 INFO:teuthology.orchestra.run.smithi008.stdout: "duration": 0.0071394249999999996 2023-08-01T19:54:50.312 INFO:teuthology.orchestra.run.smithi008.stdout: }, 2023-08-01T19:54:50.312 INFO:teuthology.orchestra.run.smithi008.stdout: { 2023-08-01T19:54:50.312 INFO:teuthology.orchestra.run.smithi008.stdout: "event": "started", 2023-08-01T19:54:50.312 INFO:teuthology.orchestra.run.smithi008.stdout: "time": "2023-08-01T19:54:41.306579+0000", 2023-08-01T19:54:50.312 INFO:teuthology.orchestra.run.smithi008.stdout: "duration": 0.00014404199999999999 2023-08-01T19:54:50.312 INFO:teuthology.orchestra.run.smithi008.stdout: }, 2023-08-01T19:54:50.313 INFO:teuthology.orchestra.run.smithi008.stdout: { 2023-08-01T19:54:50.313 INFO:teuthology.orchestra.run.smithi008.stdout: "event": "waiting for subops from 2", 2023-08-01T19:54:50.313 INFO:teuthology.orchestra.run.smithi008.stdout: "time": "2023-08-01T19:54:41.306719+0000", 2023-08-01T19:54:50.313 INFO:teuthology.orchestra.run.smithi008.stdout: "duration": 0.000140192 2023-08-01T19:54:50.313 INFO:teuthology.orchestra.run.smithi008.stdout: }, 2023-08-01T19:54:50.313 INFO:teuthology.orchestra.run.smithi008.stdout: { 2023-08-01T19:54:50.313 INFO:teuthology.orchestra.run.smithi008.stdout: "event": "sub_op_commit_rec", 2023-08-01T19:54:50.314 INFO:teuthology.orchestra.run.smithi008.stdout: "time": "2023-08-01T19:54:41.312464+0000", 2023-08-01T19:54:50.314 INFO:teuthology.orchestra.run.smithi008.stdout: "duration": 0.0057454580000000002 2023-08-01T19:54:50.314 INFO:teuthology.orchestra.run.smithi008.stdout: }, 2023-08-01T19:54:50.314 INFO:teuthology.orchestra.run.smithi008.stdout: { 2023-08-01T19:54:50.314 INFO:teuthology.orchestra.run.smithi008.stdout: "event": "op_commit", 2023-08-01T19:54:50.314 INFO:teuthology.orchestra.run.smithi008.stdout: "time": "2023-08-01T19:54:41.312917+0000", 2023-08-01T19:54:50.314 INFO:teuthology.orchestra.run.smithi008.stdout: "duration": 0.00045283200000000002 2023-08-01T19:54:50.314 INFO:teuthology.orchestra.run.smithi008.stdout: }, 2023-08-01T19:54:50.315 INFO:teuthology.orchestra.run.smithi008.stdout: { 2023-08-01T19:54:50.315 INFO:teuthology.orchestra.run.smithi008.stdout: "event": "commit_sent", 2023-08-01T19:54:50.315 INFO:teuthology.orchestra.run.smithi008.stdout: "time": "2023-08-01T19:54:41.312959+0000", 2023-08-01T19:54:50.315 INFO:teuthology.orchestra.run.smithi008.stdout: "duration": 4.2314999999999997e-05 2023-08-01T19:54:50.315 INFO:teuthology.orchestra.run.smithi008.stdout: }, 2023-08-01T19:54:50.315 INFO:teuthology.orchestra.run.smithi008.stdout: { 2023-08-01T19:54:50.315 INFO:teuthology.orchestra.run.smithi008.stdout: "event": "done", 2023-08-01T19:54:50.315 INFO:teuthology.orchestra.run.smithi008.stdout: "time": "2023-08-01T19:54:41.312997+0000", 2023-08-01T19:54:50.316 INFO:teuthology.orchestra.run.smithi008.stdout: "duration": 3.7270000000000001e-05 2023-08-01T19:54:50.316 INFO:teuthology.orchestra.run.smithi008.stdout: } 2023-08-01T19:54:50.316 INFO:teuthology.orchestra.run.smithi008.stdout: ] 2023-08-01T19:54:50.316 INFO:teuthology.orchestra.run.smithi008.stdout: } 2023-08-01T19:54:50.316 INFO:teuthology.orchestra.run.smithi008.stdout: }, 2023-08-01T19:54:50.316 INFO:teuthology.orchestra.run.smithi008.stdout: { 2023-08-01T19:54:50.316 INFO:teuthology.orchestra.run.smithi008.stdout: "description": "osd_op(client.4668.0:54277 5.3 5:c10b53a7:::benchmark_data_smithi006_114134_object54276:head [set-alloc-hint object_size 65536 write_size 65536,write 0~65536] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e27)", 2023-08-01T19:54:50.317 INFO:teuthology.orchestra.run.smithi008.stdout: "initiated_at": "2023-08-01T19:54:42.191670+0000", 2023-08-01T19:54:50.317 INFO:teuthology.orchestra.run.smithi008.stdout: "age": 8.0145066039999993, 2023-08-01T19:54:50.317 INFO:teuthology.orchestra.run.smithi008.stdout: "duration": 0.013932544999999999, 2023-08-01T19:54:50.317 INFO:teuthology.orchestra.run.smithi008.stdout: "type_data": { 2023-08-01T19:54:50.317 INFO:teuthology.orchestra.run.smithi008.stdout: "flag_point": "commit sent; apply or cleanup", 2023-08-01T19:54:50.317 INFO:teuthology.orchestra.run.smithi008.stdout: "client_info": { 2023-08-01T19:54:50.317 INFO:teuthology.orchestra.run.smithi008.stdout: "client": "client.4668", 2023-08-01T19:54:50.317 INFO:teuthology.orchestra.run.smithi008.stdout: "client_addr": "172.21.15.6:0/1709472247", 2023-08-01T19:54:50.318 INFO:teuthology.orchestra.run.smithi008.stdout: "tid": 54277 2023-08-01T19:54:50.318 INFO:teuthology.orchestra.run.smithi008.stdout: }, 2023-08-01T19:54:50.318 INFO:teuthology.orchestra.run.smithi008.stdout: "events": [ 2023-08-01T19:54:50.318 INFO:teuthology.orchestra.run.smithi008.stdout: { 2023-08-01T19:54:50.318 INFO:teuthology.orchestra.run.smithi008.stdout: "event": "initiated", 2023-08-01T19:54:50.318 INFO:teuthology.orchestra.run.smithi008.stdout: "time": "2023-08-01T19:54:42.191670+0000", 2023-08-01T19:54:50.318 INFO:teuthology.orchestra.run.smithi008.stdout: "duration": 0 2023-08-01T19:54:50.318 INFO:teuthology.orchestra.run.smithi008.stdout: }, 2023-08-01T19:54:50.319 INFO:teuthology.orchestra.run.smithi008.stdout: { 2023-08-01T19:54:50.319 INFO:teuthology.orchestra.run.smithi008.stdout: "event": "throttled", 2023-08-01T19:54:50.319 INFO:teuthology.orchestra.run.smithi008.stdout: "time": "2023-08-01T19:54:42.191670+0000", 2023-08-01T19:54:50.319 INFO:teuthology.orchestra.run.smithi008.stdout: "duration": 0 2023-08-01T19:54:50.319 INFO:teuthology.orchestra.run.smithi008.stdout: }, 2023-08-01T19:54:50.319 INFO:teuthology.orchestra.run.smithi008.stdout: { 2023-08-01T19:54:50.319 INFO:teuthology.orchestra.run.smithi008.stdout: "event": "header_read", 2023-08-01T19:54:50.319 INFO:teuthology.orchestra.run.smithi008.stdout: "time": "2023-08-01T19:54:42.191669+0000", 2023-08-01T19:54:50.320 INFO:teuthology.orchestra.run.smithi008.stdout: "duration": 4294967295.999999 2023-08-01T19:54:50.320 INFO:teuthology.orchestra.run.smithi008.stdout: }, 2023-08-01T19:54:50.320 INFO:teuthology.orchestra.run.smithi008.stdout: { 2023-08-01T19:54:50.320 INFO:teuthology.orchestra.run.smithi008.stdout: "event": "all_read", 2023-08-01T19:54:50.320 INFO:teuthology.orchestra.run.smithi008.stdout: "time": "2023-08-01T19:54:42.191755+0000", 2023-08-01T19:54:50.320 INFO:teuthology.orchestra.run.smithi008.stdout: "duration": 8.5817999999999997e-05 2023-08-01T19:54:50.320 INFO:teuthology.orchestra.run.smithi008.stdout: }, 2023-08-01T19:54:50.321 INFO:teuthology.orchestra.run.smithi008.stdout: { 2023-08-01T19:54:50.321 INFO:teuthology.orchestra.run.smithi008.stdout: "event": "dispatched", 2023-08-01T19:54:50.321 INFO:teuthology.orchestra.run.smithi008.stdout: "time": "2023-08-01T19:54:42.191767+0000", 2023-08-01T19:54:50.321 INFO:teuthology.orchestra.run.smithi008.stdout: "duration": 1.2104e-05 2023-08-01T19:54:50.321 INFO:teuthology.orchestra.run.smithi008.stdout: }, 2023-08-01T19:54:50.321 INFO:teuthology.orchestra.run.smithi008.stdout: { 2023-08-01T19:54:50.321 INFO:teuthology.orchestra.run.smithi008.stdout: "event": "queued_for_pg", 2023-08-01T19:54:50.321 INFO:teuthology.orchestra.run.smithi008.stdout: "time": "2023-08-01T19:54:42.191774+0000", 2023-08-01T19:54:50.322 INFO:teuthology.orchestra.run.smithi008.stdout: "duration": 6.9600000000000003e-06 2023-08-01T19:54:50.322 INFO:teuthology.orchestra.run.smithi008.stdout: }, 2023-08-01T19:54:50.322 INFO:teuthology.orchestra.run.smithi008.stdout: { 2023-08-01T19:54:50.322 INFO:teuthology.orchestra.run.smithi008.stdout: "event": "reached_pg", 2023-08-01T19:54:50.322 INFO:teuthology.orchestra.run.smithi008.stdout: "time": "2023-08-01T19:54:42.195268+0000", 2023-08-01T19:54:50.322 INFO:teuthology.orchestra.run.smithi008.stdout: "duration": 0.0034934480000000001 2023-08-01T19:54:50.322 INFO:teuthology.orchestra.run.smithi008.stdout: }, 2023-08-01T19:54:50.322 INFO:teuthology.orchestra.run.smithi008.stdout: { 2023-08-01T19:54:50.323 INFO:teuthology.orchestra.run.smithi008.stdout: "event": "started", 2023-08-01T19:54:50.323 INFO:teuthology.orchestra.run.smithi008.stdout: "time": "2023-08-01T19:54:42.195405+0000", 2023-08-01T19:54:50.323 INFO:teuthology.orchestra.run.smithi008.stdout: "duration": 0.00013794600000000001 2023-08-01T19:54:50.323 INFO:teuthology.orchestra.run.smithi008.stdout: }, 2023-08-01T19:54:50.323 INFO:teuthology.orchestra.run.smithi008.stdout: { 2023-08-01T19:54:50.323 INFO:teuthology.orchestra.run.smithi008.stdout: "event": "waiting for subops from 1", 2023-08-01T19:54:50.323 INFO:teuthology.orchestra.run.smithi008.stdout: "time": "2023-08-01T19:54:42.195530+0000", 2023-08-01T19:54:50.323 INFO:teuthology.orchestra.run.smithi008.stdout: "duration": 0.00012451199999999999 2023-08-01T19:54:50.324 INFO:teuthology.orchestra.run.smithi008.stdout: }, 2023-08-01T19:54:50.324 INFO:teuthology.orchestra.run.smithi008.stdout: { 2023-08-01T19:54:50.324 INFO:teuthology.orchestra.run.smithi008.stdout: "event": "op_commit", 2023-08-01T19:54:50.324 INFO:teuthology.orchestra.run.smithi008.stdout: "time": "2023-08-01T19:54:42.200137+0000", 2023-08-01T19:54:50.324 INFO:teuthology.orchestra.run.smithi008.stdout: "duration": 0.0046066379999999997 2023-08-01T19:54:50.324 INFO:teuthology.orchestra.run.smithi008.stdout: }, 2023-08-01T19:54:50.324 INFO:teuthology.orchestra.run.smithi008.stdout: { 2023-08-01T19:54:50.324 INFO:teuthology.orchestra.run.smithi008.stdout: "event": "sub_op_commit_rec", 2023-08-01T19:54:50.325 INFO:teuthology.orchestra.run.smithi008.stdout: "time": "2023-08-01T19:54:42.205552+0000", 2023-08-01T19:54:50.325 INFO:teuthology.orchestra.run.smithi008.stdout: "duration": 0.0054150140000000001 2023-08-01T19:54:50.325 INFO:teuthology.orchestra.run.smithi008.stdout: }, 2023-08-01T19:54:50.325 INFO:teuthology.orchestra.run.smithi008.stdout: { 2023-08-01T19:54:50.325 INFO:teuthology.orchestra.run.smithi008.stdout: "event": "commit_sent", 2023-08-01T19:54:50.325 INFO:teuthology.orchestra.run.smithi008.stdout: "time": "2023-08-01T19:54:42.205580+0000", 2023-08-01T19:54:50.325 INFO:teuthology.orchestra.run.smithi008.stdout: "duration": 2.8123000000000002e-05 2023-08-01T19:54:50.325 INFO:teuthology.orchestra.run.smithi008.stdout: }, 2023-08-01T19:54:50.326 INFO:teuthology.orchestra.run.smithi008.stdout: { 2023-08-01T19:54:50.326 INFO:teuthology.orchestra.run.smithi008.stdout: "event": "done", 2023-08-01T19:54:50.326 INFO:teuthology.orchestra.run.smithi008.stdout: "time": "2023-08-01T19:54:42.205603+0000", 2023-08-01T19:54:50.326 INFO:teuthology.orchestra.run.smithi008.stdout: "duration": 2.2846000000000001e-05 2023-08-01T19:54:50.326 INFO:teuthology.orchestra.run.smithi008.stdout: } 2023-08-01T19:54:50.326 INFO:teuthology.orchestra.run.smithi008.stdout: ] 2023-08-01T19:54:50.326 INFO:teuthology.orchestra.run.smithi008.stdout: } 2023-08-01T19:54:50.327 INFO:teuthology.orchestra.run.smithi008.stdout: }, 2023-08-01T19:54:50.327 INFO:teuthology.orchestra.run.smithi008.stdout: { 2023-08-01T19:54:50.327 INFO:teuthology.orchestra.run.smithi008.stdout: "description": "osd_op(client.4668.0:55411 5.a 5:52098115:::benchmark_data_smithi006_114134_object55410:head [set-alloc-hint object_size 65536 write_size 65536,write 0~65536] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e27)", 2023-08-01T19:54:50.327 INFO:teuthology.orchestra.run.smithi008.stdout: "initiated_at": "2023-08-01T19:54:42.689404+0000", 2023-08-01T19:54:50.327 INFO:teuthology.orchestra.run.smithi008.stdout: "age": 7.5167723859999995, 2023-08-01T19:54:50.327 INFO:teuthology.orchestra.run.smithi008.stdout: "duration": 0.014643121, 2023-08-01T19:54:50.327 INFO:teuthology.orchestra.run.smithi008.stdout: "type_data": { 2023-08-01T19:54:50.327 INFO:teuthology.orchestra.run.smithi008.stdout: "flag_point": "commit sent; apply or cleanup", 2023-08-01T19:54:50.328 INFO:teuthology.orchestra.run.smithi008.stdout: "client_info": { 2023-08-01T19:54:50.328 INFO:teuthology.orchestra.run.smithi008.stdout: "client": "client.4668", 2023-08-01T19:54:50.328 INFO:teuthology.orchestra.run.smithi008.stdout: "client_addr": "172.21.15.6:0/1709472247", 2023-08-01T19:54:50.328 INFO:teuthology.orchestra.run.smithi008.stdout: "tid": 55411 2023-08-01T19:54:50.328 INFO:teuthology.orchestra.run.smithi008.stdout: }, 2023-08-01T19:54:50.328 INFO:teuthology.orchestra.run.smithi008.stdout: "events": [ 2023-08-01T19:54:50.328 INFO:teuthology.orchestra.run.smithi008.stdout: { 2023-08-01T19:54:50.329 INFO:teuthology.orchestra.run.smithi008.stdout: "event": "initiated", 2023-08-01T19:54:50.329 INFO:teuthology.orchestra.run.smithi008.stdout: "time": "2023-08-01T19:54:42.689404+0000", 2023-08-01T19:54:50.329 INFO:teuthology.orchestra.run.smithi008.stdout: "duration": 0 2023-08-01T19:54:50.329 INFO:teuthology.orchestra.run.smithi008.stdout: }, 2023-08-01T19:54:50.329 INFO:teuthology.orchestra.run.smithi008.stdout: { 2023-08-01T19:54:50.330 INFO:teuthology.orchestra.run.smithi008.stdout: "event": "throttled", 2023-08-01T19:54:50.330 INFO:teuthology.orchestra.run.smithi008.stdout: "time": "2023-08-01T19:54:42.689404+0000", 2023-08-01T19:54:50.330 INFO:teuthology.orchestra.run.smithi008.stdout: "duration": 0 2023-08-01T19:54:50.330 INFO:teuthology.orchestra.run.smithi008.stdout: }, 2023-08-01T19:54:50.330 INFO:teuthology.orchestra.run.smithi008.stdout: { 2023-08-01T19:54:50.330 INFO:teuthology.orchestra.run.smithi008.stdout: "event": "header_read", 2023-08-01T19:54:50.330 INFO:teuthology.orchestra.run.smithi008.stdout: "time": "2023-08-01T19:54:42.689404+0000", 2023-08-01T19:54:50.331 INFO:teuthology.orchestra.run.smithi008.stdout: "duration": 4294967295.9999995 2023-08-01T19:54:50.331 INFO:teuthology.orchestra.run.smithi008.stdout: }, 2023-08-01T19:54:50.331 INFO:teuthology.orchestra.run.smithi008.stdout: { 2023-08-01T19:54:50.331 INFO:teuthology.orchestra.run.smithi008.stdout: "event": "all_read", 2023-08-01T19:54:50.331 INFO:teuthology.orchestra.run.smithi008.stdout: "time": "2023-08-01T19:54:42.689428+0000", 2023-08-01T19:54:50.331 INFO:teuthology.orchestra.run.smithi008.stdout: "duration": 2.3779999999999999e-05 2023-08-01T19:54:50.331 INFO:teuthology.orchestra.run.smithi008.stdout: }, 2023-08-01T19:54:50.331 INFO:teuthology.orchestra.run.smithi008.stdout: { 2023-08-01T19:54:50.332 INFO:teuthology.orchestra.run.smithi008.stdout: "event": "dispatched", 2023-08-01T19:54:50.332 INFO:teuthology.orchestra.run.smithi008.stdout: "time": "2023-08-01T19:54:42.689434+0000", 2023-08-01T19:54:50.332 INFO:teuthology.orchestra.run.smithi008.stdout: "duration": 6.195e-06 2023-08-01T19:54:50.332 INFO:teuthology.orchestra.run.smithi008.stdout: }, 2023-08-01T19:54:50.332 INFO:teuthology.orchestra.run.smithi008.stdout: { 2023-08-01T19:54:50.332 INFO:teuthology.orchestra.run.smithi008.stdout: "event": "queued_for_pg", 2023-08-01T19:54:50.332 INFO:teuthology.orchestra.run.smithi008.stdout: "time": "2023-08-01T19:54:42.689438+0000", 2023-08-01T19:54:50.333 INFO:teuthology.orchestra.run.smithi008.stdout: "duration": 4.194e-06 2023-08-01T19:54:50.333 INFO:teuthology.orchestra.run.smithi008.stdout: }, 2023-08-01T19:54:50.333 INFO:teuthology.orchestra.run.smithi008.stdout: { 2023-08-01T19:54:50.333 INFO:teuthology.orchestra.run.smithi008.stdout: "event": "reached_pg", 2023-08-01T19:54:50.333 INFO:teuthology.orchestra.run.smithi008.stdout: "time": "2023-08-01T19:54:42.694888+0000", 2023-08-01T19:54:50.333 INFO:teuthology.orchestra.run.smithi008.stdout: "duration": 0.0054501690000000004 2023-08-01T19:54:50.333 INFO:teuthology.orchestra.run.smithi008.stdout: }, 2023-08-01T19:54:50.333 INFO:teuthology.orchestra.run.smithi008.stdout: { 2023-08-01T19:54:50.334 INFO:teuthology.orchestra.run.smithi008.stdout: "event": "started", 2023-08-01T19:54:50.334 INFO:teuthology.orchestra.run.smithi008.stdout: "time": "2023-08-01T19:54:42.695032+0000", 2023-08-01T19:54:50.334 INFO:teuthology.orchestra.run.smithi008.stdout: "duration": 0.00014387699999999999 2023-08-01T19:54:50.334 INFO:teuthology.orchestra.run.smithi008.stdout: }, 2023-08-01T19:54:50.334 INFO:teuthology.orchestra.run.smithi008.stdout: { 2023-08-01T19:54:50.334 INFO:teuthology.orchestra.run.smithi008.stdout: "event": "waiting for subops from 2", 2023-08-01T19:54:50.334 INFO:teuthology.orchestra.run.smithi008.stdout: "time": "2023-08-01T19:54:42.695205+0000", 2023-08-01T19:54:50.335 INFO:teuthology.orchestra.run.smithi008.stdout: "duration": 0.00017243 2023-08-01T19:54:50.335 INFO:teuthology.orchestra.run.smithi008.stdout: }, 2023-08-01T19:54:50.335 INFO:teuthology.orchestra.run.smithi008.stdout: { 2023-08-01T19:54:50.335 INFO:teuthology.orchestra.run.smithi008.stdout: "event": "sub_op_commit_rec", 2023-08-01T19:54:50.335 INFO:teuthology.orchestra.run.smithi008.stdout: "time": "2023-08-01T19:54:42.699618+0000", 2023-08-01T19:54:50.335 INFO:teuthology.orchestra.run.smithi008.stdout: "duration": 0.0044136399999999999 2023-08-01T19:54:50.335 INFO:teuthology.orchestra.run.smithi008.stdout: }, 2023-08-01T19:54:50.336 INFO:teuthology.orchestra.run.smithi008.stdout: { 2023-08-01T19:54:50.336 INFO:teuthology.orchestra.run.smithi008.stdout: "event": "op_commit", 2023-08-01T19:54:50.336 INFO:teuthology.orchestra.run.smithi008.stdout: "time": "2023-08-01T19:54:42.703957+0000", 2023-08-01T19:54:50.336 INFO:teuthology.orchestra.run.smithi008.stdout: "duration": 0.0043392020000000003 2023-08-01T19:54:50.336 INFO:teuthology.orchestra.run.smithi008.stdout: }, 2023-08-01T19:54:50.336 INFO:teuthology.orchestra.run.smithi008.stdout: { 2023-08-01T19:54:50.336 INFO:teuthology.orchestra.run.smithi008.stdout: "event": "commit_sent", 2023-08-01T19:54:50.337 INFO:teuthology.orchestra.run.smithi008.stdout: "time": "2023-08-01T19:54:42.704012+0000", 2023-08-01T19:54:50.337 INFO:teuthology.orchestra.run.smithi008.stdout: "duration": 5.4719999999999998e-05 2023-08-01T19:54:50.337 INFO:teuthology.orchestra.run.smithi008.stdout: }, 2023-08-01T19:54:50.337 INFO:teuthology.orchestra.run.smithi008.stdout: { 2023-08-01T19:54:50.337 INFO:teuthology.orchestra.run.smithi008.stdout: "event": "done", 2023-08-01T19:54:50.337 INFO:teuthology.orchestra.run.smithi008.stdout: "time": "2023-08-01T19:54:42.704047+0000", 2023-08-01T19:54:50.337 INFO:teuthology.orchestra.run.smithi008.stdout: "duration": 3.5336000000000002e-05 2023-08-01T19:54:50.337 INFO:teuthology.orchestra.run.smithi008.stdout: } 2023-08-01T19:54:50.338 INFO:teuthology.orchestra.run.smithi008.stdout: ] 2023-08-01T19:54:50.338 INFO:teuthology.orchestra.run.smithi008.stdout: } 2023-08-01T19:54:50.338 INFO:teuthology.orchestra.run.smithi008.stdout: }, 2023-08-01T19:54:50.338 INFO:teuthology.orchestra.run.smithi008.stdout: { 2023-08-01T19:54:50.338 INFO:teuthology.orchestra.run.smithi008.stdout: "description": "osd_repop(client.4668.0:61802 5.b e29/19 5:dcfcf99c:::benchmark_data_smithi006_114134_object61801:head v 29'3819, mlcod=28'3815)", 2023-08-01T19:54:50.338 INFO:teuthology.orchestra.run.smithi008.stdout: "initiated_at": "2023-08-01T19:54:45.744751+0000", 2023-08-01T19:54:50.338 INFO:teuthology.orchestra.run.smithi008.stdout: "age": 4.4614257290000001, 2023-08-01T19:54:50.339 INFO:teuthology.orchestra.run.smithi008.stdout: "duration": 0.015484753, 2023-08-01T19:54:50.339 INFO:teuthology.orchestra.run.smithi008.stdout: "type_data": { 2023-08-01T19:54:50.339 INFO:teuthology.orchestra.run.smithi008.stdout: "flag_point": "commit sent; apply or cleanup", 2023-08-01T19:54:50.339 INFO:teuthology.orchestra.run.smithi008.stdout: "events": [ 2023-08-01T19:54:50.339 INFO:teuthology.orchestra.run.smithi008.stdout: { 2023-08-01T19:54:50.339 INFO:teuthology.orchestra.run.smithi008.stdout: "event": "initiated", 2023-08-01T19:54:50.339 INFO:teuthology.orchestra.run.smithi008.stdout: "time": "2023-08-01T19:54:45.744751+0000", 2023-08-01T19:54:50.339 INFO:teuthology.orchestra.run.smithi008.stdout: "duration": 0 2023-08-01T19:54:50.340 INFO:teuthology.orchestra.run.smithi008.stdout: }, 2023-08-01T19:54:50.340 INFO:teuthology.orchestra.run.smithi008.stdout: { 2023-08-01T19:54:50.340 INFO:teuthology.orchestra.run.smithi008.stdout: "event": "throttled", 2023-08-01T19:54:50.340 INFO:teuthology.orchestra.run.smithi008.stdout: "time": "2023-08-01T19:54:45.744751+0000", 2023-08-01T19:54:50.340 INFO:teuthology.orchestra.run.smithi008.stdout: "duration": 0 2023-08-01T19:54:50.340 INFO:teuthology.orchestra.run.smithi008.stdout: }, 2023-08-01T19:54:50.340 INFO:teuthology.orchestra.run.smithi008.stdout: { 2023-08-01T19:54:50.341 INFO:teuthology.orchestra.run.smithi008.stdout: "event": "header_read", 2023-08-01T19:54:50.341 INFO:teuthology.orchestra.run.smithi008.stdout: "time": "2023-08-01T19:54:45.744750+0000", 2023-08-01T19:54:50.341 INFO:teuthology.orchestra.run.smithi008.stdout: "duration": 4294967295.9999995 2023-08-01T19:54:50.341 INFO:teuthology.orchestra.run.smithi008.stdout: }, 2023-08-01T19:54:50.341 INFO:teuthology.orchestra.run.smithi008.stdout: { 2023-08-01T19:54:50.341 INFO:teuthology.orchestra.run.smithi008.stdout: "event": "all_read", 2023-08-01T19:54:50.341 INFO:teuthology.orchestra.run.smithi008.stdout: "time": "2023-08-01T19:54:45.744820+0000", 2023-08-01T19:54:50.341 INFO:teuthology.orchestra.run.smithi008.stdout: "duration": 6.9839999999999995e-05 2023-08-01T19:54:50.342 INFO:teuthology.orchestra.run.smithi008.stdout: }, 2023-08-01T19:54:50.342 INFO:teuthology.orchestra.run.smithi008.stdout: { 2023-08-01T19:54:50.342 INFO:teuthology.orchestra.run.smithi008.stdout: "event": "dispatched", 2023-08-01T19:54:50.342 INFO:teuthology.orchestra.run.smithi008.stdout: "time": "2023-08-01T19:54:45.744829+0000", 2023-08-01T19:54:50.342 INFO:teuthology.orchestra.run.smithi008.stdout: "duration": 8.7499999999999992e-06 2023-08-01T19:54:50.342 INFO:teuthology.orchestra.run.smithi008.stdout: }, 2023-08-01T19:54:50.342 INFO:teuthology.orchestra.run.smithi008.stdout: { 2023-08-01T19:54:50.342 INFO:teuthology.orchestra.run.smithi008.stdout: "event": "queued_for_pg", 2023-08-01T19:54:50.343 INFO:teuthology.orchestra.run.smithi008.stdout: "time": "2023-08-01T19:54:45.744835+0000", 2023-08-01T19:54:50.343 INFO:teuthology.orchestra.run.smithi008.stdout: "duration": 5.6609999999999997e-06 2023-08-01T19:54:50.343 INFO:teuthology.orchestra.run.smithi008.stdout: }, 2023-08-01T19:54:50.343 INFO:teuthology.orchestra.run.smithi008.stdout: { 2023-08-01T19:54:50.343 INFO:teuthology.orchestra.run.smithi008.stdout: "event": "reached_pg", 2023-08-01T19:54:50.343 INFO:teuthology.orchestra.run.smithi008.stdout: "time": "2023-08-01T19:54:45.746369+0000", 2023-08-01T19:54:50.343 INFO:teuthology.orchestra.run.smithi008.stdout: "duration": 0.001534512 2023-08-01T19:54:50.344 INFO:teuthology.orchestra.run.smithi008.stdout: }, 2023-08-01T19:54:50.344 INFO:teuthology.orchestra.run.smithi008.stdout: { 2023-08-01T19:54:50.344 INFO:teuthology.orchestra.run.smithi008.stdout: "event": "started", 2023-08-01T19:54:50.344 INFO:teuthology.orchestra.run.smithi008.stdout: "time": "2023-08-01T19:54:45.746389+0000", 2023-08-01T19:54:50.344 INFO:teuthology.orchestra.run.smithi008.stdout: "duration": 2.0271999999999998e-05 2023-08-01T19:54:50.344 INFO:teuthology.orchestra.run.smithi008.stdout: }, 2023-08-01T19:54:50.344 INFO:teuthology.orchestra.run.smithi008.stdout: { 2023-08-01T19:54:50.344 INFO:teuthology.orchestra.run.smithi008.stdout: "event": "commit_sent", 2023-08-01T19:54:50.345 INFO:teuthology.orchestra.run.smithi008.stdout: "time": "2023-08-01T19:54:45.760207+0000", 2023-08-01T19:54:50.345 INFO:teuthology.orchestra.run.smithi008.stdout: "duration": 0.013817378 2023-08-01T19:54:50.345 INFO:teuthology.orchestra.run.smithi008.stdout: }, 2023-08-01T19:54:50.345 INFO:teuthology.orchestra.run.smithi008.stdout: { 2023-08-01T19:54:50.345 INFO:teuthology.orchestra.run.smithi008.stdout: "event": "done", 2023-08-01T19:54:50.345 INFO:teuthology.orchestra.run.smithi008.stdout: "time": "2023-08-01T19:54:45.760236+0000", 2023-08-01T19:54:50.345 INFO:teuthology.orchestra.run.smithi008.stdout: "duration": 2.8929999999999999e-05 2023-08-01T19:54:50.345 INFO:teuthology.orchestra.run.smithi008.stdout: } 2023-08-01T19:54:50.346 INFO:teuthology.orchestra.run.smithi008.stdout: ] 2023-08-01T19:54:50.346 INFO:teuthology.orchestra.run.smithi008.stdout: } 2023-08-01T19:54:50.346 INFO:teuthology.orchestra.run.smithi008.stdout: }, 2023-08-01T19:54:50.346 INFO:teuthology.orchestra.run.smithi008.stdout: { 2023-08-01T19:54:50.346 INFO:teuthology.orchestra.run.smithi008.stdout: "description": "osd_op(client.4668.0:64224 5.3 5:cc45bd53:::benchmark_data_smithi006_114134_object64223:head [set-alloc-hint object_size 65536 write_size 65536,write 0~65536] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e29)", 2023-08-01T19:54:50.346 INFO:teuthology.orchestra.run.smithi008.stdout: "initiated_at": "2023-08-01T19:54:46.873962+0000", 2023-08-01T19:54:50.346 INFO:teuthology.orchestra.run.smithi008.stdout: "age": 3.3322148240000002, 2023-08-01T19:54:50.346 INFO:teuthology.orchestra.run.smithi008.stdout: "duration": 0.014381737, 2023-08-01T19:54:50.347 INFO:teuthology.orchestra.run.smithi008.stdout: "type_data": { 2023-08-01T19:54:50.347 INFO:teuthology.orchestra.run.smithi008.stdout: "flag_point": "commit sent; apply or cleanup", 2023-08-01T19:54:50.347 INFO:teuthology.orchestra.run.smithi008.stdout: "client_info": { 2023-08-01T19:54:50.347 INFO:teuthology.orchestra.run.smithi008.stdout: "client": "client.4668", 2023-08-01T19:54:50.347 INFO:teuthology.orchestra.run.smithi008.stdout: "client_addr": "172.21.15.6:0/1709472247", 2023-08-01T19:54:50.347 INFO:teuthology.orchestra.run.smithi008.stdout: "tid": 64224 2023-08-01T19:54:50.347 INFO:teuthology.orchestra.run.smithi008.stdout: }, 2023-08-01T19:54:50.348 INFO:teuthology.orchestra.run.smithi008.stdout: "events": [ 2023-08-01T19:54:50.348 INFO:teuthology.orchestra.run.smithi008.stdout: { 2023-08-01T19:54:50.348 INFO:teuthology.orchestra.run.smithi008.stdout: "event": "initiated", 2023-08-01T19:54:50.348 INFO:teuthology.orchestra.run.smithi008.stdout: "time": "2023-08-01T19:54:46.873962+0000", 2023-08-01T19:54:50.348 INFO:teuthology.orchestra.run.smithi008.stdout: "duration": 0 2023-08-01T19:54:50.348 INFO:teuthology.orchestra.run.smithi008.stdout: }, 2023-08-01T19:54:50.348 INFO:teuthology.orchestra.run.smithi008.stdout: { 2023-08-01T19:54:50.348 INFO:teuthology.orchestra.run.smithi008.stdout: "event": "throttled", 2023-08-01T19:54:50.349 INFO:teuthology.orchestra.run.smithi008.stdout: "time": "2023-08-01T19:54:46.873962+0000", 2023-08-01T19:54:50.349 INFO:teuthology.orchestra.run.smithi008.stdout: "duration": 0 2023-08-01T19:54:50.349 INFO:teuthology.orchestra.run.smithi008.stdout: }, 2023-08-01T19:54:50.349 INFO:teuthology.orchestra.run.smithi008.stdout: { 2023-08-01T19:54:50.349 INFO:teuthology.orchestra.run.smithi008.stdout: "event": "header_read", 2023-08-01T19:54:50.349 INFO:teuthology.orchestra.run.smithi008.stdout: "time": "2023-08-01T19:54:46.873961+0000", 2023-08-01T19:54:50.349 INFO:teuthology.orchestra.run.smithi008.stdout: "duration": 4294967295.999999 2023-08-01T19:54:50.350 INFO:teuthology.orchestra.run.smithi008.stdout: }, 2023-08-01T19:54:50.350 INFO:teuthology.orchestra.run.smithi008.stdout: { 2023-08-01T19:54:50.350 INFO:teuthology.orchestra.run.smithi008.stdout: "event": "all_read", 2023-08-01T19:54:50.350 INFO:teuthology.orchestra.run.smithi008.stdout: "time": "2023-08-01T19:54:46.873989+0000", 2023-08-01T19:54:50.350 INFO:teuthology.orchestra.run.smithi008.stdout: "duration": 2.777e-05 2023-08-01T19:54:50.350 INFO:teuthology.orchestra.run.smithi008.stdout: }, 2023-08-01T19:54:50.350 INFO:teuthology.orchestra.run.smithi008.stdout: { 2023-08-01T19:54:50.350 INFO:teuthology.orchestra.run.smithi008.stdout: "event": "dispatched", 2023-08-01T19:54:50.351 INFO:teuthology.orchestra.run.smithi008.stdout: "time": "2023-08-01T19:54:46.874005+0000", 2023-08-01T19:54:50.351 INFO:teuthology.orchestra.run.smithi008.stdout: "duration": 1.5909999999999998e-05 2023-08-01T19:54:50.351 INFO:teuthology.orchestra.run.smithi008.stdout: }, 2023-08-01T19:54:50.351 INFO:teuthology.orchestra.run.smithi008.stdout: { 2023-08-01T19:54:50.351 INFO:teuthology.orchestra.run.smithi008.stdout: "event": "queued_for_pg", 2023-08-01T19:54:50.351 INFO:teuthology.orchestra.run.smithi008.stdout: "time": "2023-08-01T19:54:46.874011+0000", 2023-08-01T19:54:50.351 INFO:teuthology.orchestra.run.smithi008.stdout: "duration": 5.9989999999999997e-06 2023-08-01T19:54:50.351 INFO:teuthology.orchestra.run.smithi008.stdout: }, 2023-08-01T19:54:50.352 INFO:teuthology.orchestra.run.smithi008.stdout: { 2023-08-01T19:54:50.352 INFO:teuthology.orchestra.run.smithi008.stdout: "event": "reached_pg", 2023-08-01T19:54:50.352 INFO:teuthology.orchestra.run.smithi008.stdout: "time": "2023-08-01T19:54:46.876165+0000", 2023-08-01T19:54:50.352 INFO:teuthology.orchestra.run.smithi008.stdout: "duration": 0.0021544340000000002 2023-08-01T19:54:50.352 INFO:teuthology.orchestra.run.smithi008.stdout: }, 2023-08-01T19:54:50.352 INFO:teuthology.orchestra.run.smithi008.stdout: { 2023-08-01T19:54:50.352 INFO:teuthology.orchestra.run.smithi008.stdout: "event": "started", 2023-08-01T19:54:50.352 INFO:teuthology.orchestra.run.smithi008.stdout: "time": "2023-08-01T19:54:46.876278+0000", 2023-08-01T19:54:50.353 INFO:teuthology.orchestra.run.smithi008.stdout: "duration": 0.000112416 2023-08-01T19:54:50.353 INFO:teuthology.orchestra.run.smithi008.stdout: }, 2023-08-01T19:54:50.353 INFO:teuthology.orchestra.run.smithi008.stdout: { 2023-08-01T19:54:50.353 INFO:teuthology.orchestra.run.smithi008.stdout: "event": "waiting for subops from 1", 2023-08-01T19:54:50.353 INFO:teuthology.orchestra.run.smithi008.stdout: "time": "2023-08-01T19:54:46.876418+0000", 2023-08-01T19:54:50.353 INFO:teuthology.orchestra.run.smithi008.stdout: "duration": 0.00014080200000000001 2023-08-01T19:54:50.353 INFO:teuthology.orchestra.run.smithi008.stdout: }, 2023-08-01T19:54:50.354 INFO:teuthology.orchestra.run.smithi008.stdout: { 2023-08-01T19:54:50.354 INFO:teuthology.orchestra.run.smithi008.stdout: "event": "op_commit", 2023-08-01T19:54:50.354 INFO:teuthology.orchestra.run.smithi008.stdout: "time": "2023-08-01T19:54:46.882767+0000", 2023-08-01T19:54:50.354 INFO:teuthology.orchestra.run.smithi008.stdout: "duration": 0.0063485649999999996 2023-08-01T19:54:50.354 INFO:teuthology.orchestra.run.smithi008.stdout: }, 2023-08-01T19:54:50.354 INFO:teuthology.orchestra.run.smithi008.stdout: { 2023-08-01T19:54:50.354 INFO:teuthology.orchestra.run.smithi008.stdout: "event": "sub_op_commit_rec", 2023-08-01T19:54:50.354 INFO:teuthology.orchestra.run.smithi008.stdout: "time": "2023-08-01T19:54:46.888279+0000", 2023-08-01T19:54:50.355 INFO:teuthology.orchestra.run.smithi008.stdout: "duration": 0.0055120489999999998 2023-08-01T19:54:50.355 INFO:teuthology.orchestra.run.smithi008.stdout: }, 2023-08-01T19:54:50.355 INFO:teuthology.orchestra.run.smithi008.stdout: { 2023-08-01T19:54:50.355 INFO:teuthology.orchestra.run.smithi008.stdout: "event": "commit_sent", 2023-08-01T19:54:50.355 INFO:teuthology.orchestra.run.smithi008.stdout: "time": "2023-08-01T19:54:46.888313+0000", 2023-08-01T19:54:50.355 INFO:teuthology.orchestra.run.smithi008.stdout: "duration": 3.4306e-05 2023-08-01T19:54:50.355 INFO:teuthology.orchestra.run.smithi008.stdout: }, 2023-08-01T19:54:50.356 INFO:teuthology.orchestra.run.smithi008.stdout: { 2023-08-01T19:54:50.356 INFO:teuthology.orchestra.run.smithi008.stdout: "event": "done", 2023-08-01T19:54:50.356 INFO:teuthology.orchestra.run.smithi008.stdout: "time": "2023-08-01T19:54:46.888344+0000", 2023-08-01T19:54:50.356 INFO:teuthology.orchestra.run.smithi008.stdout: "duration": 3.0244e-05 2023-08-01T19:54:50.356 INFO:teuthology.orchestra.run.smithi008.stdout: } 2023-08-01T19:54:50.356 INFO:teuthology.orchestra.run.smithi008.stdout: ] 2023-08-01T19:54:50.356 INFO:teuthology.orchestra.run.smithi008.stdout: } 2023-08-01T19:54:50.356 INFO:teuthology.orchestra.run.smithi008.stdout: }, 2023-08-01T19:54:50.357 INFO:teuthology.orchestra.run.smithi008.stdout: { 2023-08-01T19:54:50.357 INFO:teuthology.orchestra.run.smithi008.stdout: "description": "osd_op(client.4668.0:64227 5.3 5:cc2345d5:::benchmark_data_smithi006_114134_object64226:head [set-alloc-hint object_size 65536 write_size 65536,write 0~65536] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e29)", 2023-08-01T19:54:50.357 INFO:teuthology.orchestra.run.smithi008.stdout: "initiated_at": "2023-08-01T19:54:46.874607+0000", 2023-08-01T19:54:50.357 INFO:teuthology.orchestra.run.smithi008.stdout: "age": 3.3315695280000002, 2023-08-01T19:54:50.357 INFO:teuthology.orchestra.run.smithi008.stdout: "duration": 0.013853552999999999, 2023-08-01T19:54:50.357 INFO:teuthology.orchestra.run.smithi008.stdout: "type_data": { 2023-08-01T19:54:50.357 INFO:teuthology.orchestra.run.smithi008.stdout: "flag_point": "commit sent; apply or cleanup", 2023-08-01T19:54:50.357 INFO:teuthology.orchestra.run.smithi008.stdout: "client_info": { 2023-08-01T19:54:50.358 INFO:teuthology.orchestra.run.smithi008.stdout: "client": "client.4668", 2023-08-01T19:54:50.358 INFO:teuthology.orchestra.run.smithi008.stdout: "client_addr": "172.21.15.6:0/1709472247", 2023-08-01T19:54:50.358 INFO:teuthology.orchestra.run.smithi008.stdout: "tid": 64227 2023-08-01T19:54:50.358 INFO:teuthology.orchestra.run.smithi008.stdout: }, 2023-08-01T19:54:50.358 INFO:teuthology.orchestra.run.smithi008.stdout: "events": [ 2023-08-01T19:54:50.358 INFO:teuthology.orchestra.run.smithi008.stdout: { 2023-08-01T19:54:50.358 INFO:teuthology.orchestra.run.smithi008.stdout: "event": "initiated", 2023-08-01T19:54:50.359 INFO:teuthology.orchestra.run.smithi008.stdout: "time": "2023-08-01T19:54:46.874607+0000", 2023-08-01T19:54:50.359 INFO:teuthology.orchestra.run.smithi008.stdout: "duration": 0 2023-08-01T19:54:50.359 INFO:teuthology.orchestra.run.smithi008.stdout: }, 2023-08-01T19:54:50.359 INFO:teuthology.orchestra.run.smithi008.stdout: { 2023-08-01T19:54:50.359 INFO:teuthology.orchestra.run.smithi008.stdout: "event": "throttled", 2023-08-01T19:54:50.359 INFO:teuthology.orchestra.run.smithi008.stdout: "time": "2023-08-01T19:54:46.874607+0000", 2023-08-01T19:54:50.359 INFO:teuthology.orchestra.run.smithi008.stdout: "duration": 0 2023-08-01T19:54:50.359 INFO:teuthology.orchestra.run.smithi008.stdout: }, 2023-08-01T19:54:50.360 INFO:teuthology.orchestra.run.smithi008.stdout: { 2023-08-01T19:54:50.360 INFO:teuthology.orchestra.run.smithi008.stdout: "event": "header_read", 2023-08-01T19:54:50.360 INFO:teuthology.orchestra.run.smithi008.stdout: "time": "2023-08-01T19:54:46.874606+0000", 2023-08-01T19:54:50.360 INFO:teuthology.orchestra.run.smithi008.stdout: "duration": 4294967295.999999 2023-08-01T19:54:50.360 INFO:teuthology.orchestra.run.smithi008.stdout: }, 2023-08-01T19:54:50.360 INFO:teuthology.orchestra.run.smithi008.stdout: { 2023-08-01T19:54:50.360 INFO:teuthology.orchestra.run.smithi008.stdout: "event": "all_read", 2023-08-01T19:54:50.361 INFO:teuthology.orchestra.run.smithi008.stdout: "time": "2023-08-01T19:54:46.874673+0000", 2023-08-01T19:54:50.361 INFO:teuthology.orchestra.run.smithi008.stdout: "duration": 6.6675999999999997e-05 2023-08-01T19:54:50.361 INFO:teuthology.orchestra.run.smithi008.stdout: }, 2023-08-01T19:54:50.361 INFO:teuthology.orchestra.run.smithi008.stdout: { 2023-08-01T19:54:50.361 INFO:teuthology.orchestra.run.smithi008.stdout: "event": "dispatched", 2023-08-01T19:54:50.361 INFO:teuthology.orchestra.run.smithi008.stdout: "time": "2023-08-01T19:54:46.874684+0000", 2023-08-01T19:54:50.361 INFO:teuthology.orchestra.run.smithi008.stdout: "duration": 1.0773e-05 2023-08-01T19:54:50.361 INFO:teuthology.orchestra.run.smithi008.stdout: }, 2023-08-01T19:54:50.362 INFO:teuthology.orchestra.run.smithi008.stdout: { 2023-08-01T19:54:50.362 INFO:teuthology.orchestra.run.smithi008.stdout: "event": "queued_for_pg", 2023-08-01T19:54:50.362 INFO:teuthology.orchestra.run.smithi008.stdout: "time": "2023-08-01T19:54:46.874690+0000", 2023-08-01T19:54:50.362 INFO:teuthology.orchestra.run.smithi008.stdout: "duration": 6.2770000000000002e-06 2023-08-01T19:54:50.362 INFO:teuthology.orchestra.run.smithi008.stdout: }, 2023-08-01T19:54:50.362 INFO:teuthology.orchestra.run.smithi008.stdout: { 2023-08-01T19:54:50.362 INFO:teuthology.orchestra.run.smithi008.stdout: "event": "reached_pg", 2023-08-01T19:54:50.362 INFO:teuthology.orchestra.run.smithi008.stdout: "time": "2023-08-01T19:54:46.878012+0000", 2023-08-01T19:54:50.363 INFO:teuthology.orchestra.run.smithi008.stdout: "duration": 0.0033218990000000001 2023-08-01T19:54:50.363 INFO:teuthology.orchestra.run.smithi008.stdout: }, 2023-08-01T19:54:50.363 INFO:teuthology.orchestra.run.smithi008.stdout: { 2023-08-01T19:54:50.363 INFO:teuthology.orchestra.run.smithi008.stdout: "event": "started", 2023-08-01T19:54:50.363 INFO:teuthology.orchestra.run.smithi008.stdout: "time": "2023-08-01T19:54:46.878105+0000", 2023-08-01T19:54:50.363 INFO:teuthology.orchestra.run.smithi008.stdout: "duration": 9.2845999999999998e-05 2023-08-01T19:54:50.363 INFO:teuthology.orchestra.run.smithi008.stdout: }, 2023-08-01T19:54:50.363 INFO:teuthology.orchestra.run.smithi008.stdout: { 2023-08-01T19:54:50.364 INFO:teuthology.orchestra.run.smithi008.stdout: "event": "waiting for subops from 1", 2023-08-01T19:54:50.364 INFO:teuthology.orchestra.run.smithi008.stdout: "time": "2023-08-01T19:54:46.878196+0000", 2023-08-01T19:54:50.364 INFO:teuthology.orchestra.run.smithi008.stdout: "duration": 9.0928999999999996e-05 2023-08-01T19:54:50.364 INFO:teuthology.orchestra.run.smithi008.stdout: }, 2023-08-01T19:54:50.364 INFO:teuthology.orchestra.run.smithi008.stdout: { 2023-08-01T19:54:50.364 INFO:teuthology.orchestra.run.smithi008.stdout: "event": "op_commit", 2023-08-01T19:54:50.364 INFO:teuthology.orchestra.run.smithi008.stdout: "time": "2023-08-01T19:54:46.882770+0000", 2023-08-01T19:54:50.364 INFO:teuthology.orchestra.run.smithi008.stdout: "duration": 0.004574013 2023-08-01T19:54:50.365 INFO:teuthology.orchestra.run.smithi008.stdout: }, 2023-08-01T19:54:50.365 INFO:teuthology.orchestra.run.smithi008.stdout: { 2023-08-01T19:54:50.365 INFO:teuthology.orchestra.run.smithi008.stdout: "event": "sub_op_commit_rec", 2023-08-01T19:54:50.365 INFO:teuthology.orchestra.run.smithi008.stdout: "time": "2023-08-01T19:54:46.888382+0000", 2023-08-01T19:54:50.365 INFO:teuthology.orchestra.run.smithi008.stdout: "duration": 0.005612471 2023-08-01T19:54:50.365 INFO:teuthology.orchestra.run.smithi008.stdout: }, 2023-08-01T19:54:50.365 INFO:teuthology.orchestra.run.smithi008.stdout: { 2023-08-01T19:54:50.366 INFO:teuthology.orchestra.run.smithi008.stdout: "event": "commit_sent", 2023-08-01T19:54:50.366 INFO:teuthology.orchestra.run.smithi008.stdout: "time": "2023-08-01T19:54:46.888427+0000", 2023-08-01T19:54:50.366 INFO:teuthology.orchestra.run.smithi008.stdout: "duration": 4.5015999999999997e-05 2023-08-01T19:54:50.366 INFO:teuthology.orchestra.run.smithi008.stdout: }, 2023-08-01T19:54:50.366 INFO:teuthology.orchestra.run.smithi008.stdout: { 2023-08-01T19:54:50.366 INFO:teuthology.orchestra.run.smithi008.stdout: "event": "done", 2023-08-01T19:54:50.366 INFO:teuthology.orchestra.run.smithi008.stdout: "time": "2023-08-01T19:54:46.888461+0000", 2023-08-01T19:54:50.366 INFO:teuthology.orchestra.run.smithi008.stdout: "duration": 3.3583e-05 2023-08-01T19:54:50.367 INFO:teuthology.orchestra.run.smithi008.stdout: } 2023-08-01T19:54:50.367 INFO:teuthology.orchestra.run.smithi008.stdout: ] 2023-08-01T19:54:50.367 INFO:teuthology.orchestra.run.smithi008.stdout: } 2023-08-01T19:54:50.367 INFO:teuthology.orchestra.run.smithi008.stdout: }, 2023-08-01T19:54:50.367 INFO:teuthology.orchestra.run.smithi008.stdout: { 2023-08-01T19:54:50.367 INFO:teuthology.orchestra.run.smithi008.stdout: "description": "osd_op(client.4668.0:64711 5.6 5:6a1ab3ed:::benchmark_data_smithi006_114134_object64710:head [set-alloc-hint object_size 65536 write_size 65536,write 0~65536] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e29)", 2023-08-01T19:54:50.367 INFO:teuthology.orchestra.run.smithi008.stdout: "initiated_at": "2023-08-01T19:54:47.100895+0000", 2023-08-01T19:54:50.367 INFO:teuthology.orchestra.run.smithi008.stdout: "age": 3.1052821310000001, 2023-08-01T19:54:50.368 INFO:teuthology.orchestra.run.smithi008.stdout: "duration": 0.014698718, 2023-08-01T19:54:50.368 INFO:teuthology.orchestra.run.smithi008.stdout: "type_data": { 2023-08-01T19:54:50.368 INFO:teuthology.orchestra.run.smithi008.stdout: "flag_point": "commit sent; apply or cleanup", 2023-08-01T19:54:50.368 INFO:teuthology.orchestra.run.smithi008.stdout: "client_info": { 2023-08-01T19:54:50.368 INFO:teuthology.orchestra.run.smithi008.stdout: "client": "client.4668", 2023-08-01T19:54:50.368 INFO:teuthology.orchestra.run.smithi008.stdout: "client_addr": "172.21.15.6:0/1709472247", 2023-08-01T19:54:50.368 INFO:teuthology.orchestra.run.smithi008.stdout: "tid": 64711 2023-08-01T19:54:50.369 INFO:teuthology.orchestra.run.smithi008.stdout: }, 2023-08-01T19:54:50.369 INFO:teuthology.orchestra.run.smithi008.stdout: "events": [ 2023-08-01T19:54:50.369 INFO:teuthology.orchestra.run.smithi008.stdout: { 2023-08-01T19:54:50.369 INFO:teuthology.orchestra.run.smithi008.stdout: "event": "initiated", 2023-08-01T19:54:50.369 INFO:teuthology.orchestra.run.smithi008.stdout: "time": "2023-08-01T19:54:47.100895+0000", 2023-08-01T19:54:50.369 INFO:teuthology.orchestra.run.smithi008.stdout: "duration": 0 2023-08-01T19:54:50.369 INFO:teuthology.orchestra.run.smithi008.stdout: }, 2023-08-01T19:54:50.369 INFO:teuthology.orchestra.run.smithi008.stdout: { 2023-08-01T19:54:50.370 INFO:teuthology.orchestra.run.smithi008.stdout: "event": "throttled", 2023-08-01T19:54:50.370 INFO:teuthology.orchestra.run.smithi008.stdout: "time": "2023-08-01T19:54:47.100895+0000", 2023-08-01T19:54:50.370 INFO:teuthology.orchestra.run.smithi008.stdout: "duration": 0 2023-08-01T19:54:50.370 INFO:teuthology.orchestra.run.smithi008.stdout: }, 2023-08-01T19:54:50.370 INFO:teuthology.orchestra.run.smithi008.stdout: { 2023-08-01T19:54:50.370 INFO:teuthology.orchestra.run.smithi008.stdout: "event": "header_read", 2023-08-01T19:54:50.370 INFO:teuthology.orchestra.run.smithi008.stdout: "time": "2023-08-01T19:54:47.100894+0000", 2023-08-01T19:54:50.370 INFO:teuthology.orchestra.run.smithi008.stdout: "duration": 4294967295.9999995 2023-08-01T19:54:50.371 INFO:teuthology.orchestra.run.smithi008.stdout: }, 2023-08-01T19:54:50.371 INFO:teuthology.orchestra.run.smithi008.stdout: { 2023-08-01T19:54:50.371 INFO:teuthology.orchestra.run.smithi008.stdout: "event": "all_read", 2023-08-01T19:54:50.371 INFO:teuthology.orchestra.run.smithi008.stdout: "time": "2023-08-01T19:54:47.100936+0000", 2023-08-01T19:54:50.371 INFO:teuthology.orchestra.run.smithi008.stdout: "duration": 4.1496999999999999e-05 2023-08-01T19:54:50.371 INFO:teuthology.orchestra.run.smithi008.stdout: }, 2023-08-01T19:54:50.371 INFO:teuthology.orchestra.run.smithi008.stdout: { 2023-08-01T19:54:50.371 INFO:teuthology.orchestra.run.smithi008.stdout: "event": "dispatched", 2023-08-01T19:54:50.372 INFO:teuthology.orchestra.run.smithi008.stdout: "time": "2023-08-01T19:54:47.100943+0000", 2023-08-01T19:54:50.372 INFO:teuthology.orchestra.run.smithi008.stdout: "duration": 7.4680000000000003e-06 2023-08-01T19:54:50.372 INFO:teuthology.orchestra.run.smithi008.stdout: }, 2023-08-01T19:54:50.372 INFO:teuthology.orchestra.run.smithi008.stdout: { 2023-08-01T19:54:50.372 INFO:teuthology.orchestra.run.smithi008.stdout: "event": "queued_for_pg", 2023-08-01T19:54:50.372 INFO:teuthology.orchestra.run.smithi008.stdout: "time": "2023-08-01T19:54:47.100948+0000", 2023-08-01T19:54:50.372 INFO:teuthology.orchestra.run.smithi008.stdout: "duration": 5.3920000000000002e-06 2023-08-01T19:54:50.372 INFO:teuthology.orchestra.run.smithi008.stdout: }, 2023-08-01T19:54:50.373 INFO:teuthology.orchestra.run.smithi008.stdout: { 2023-08-01T19:54:50.373 INFO:teuthology.orchestra.run.smithi008.stdout: "event": "reached_pg", 2023-08-01T19:54:50.373 INFO:teuthology.orchestra.run.smithi008.stdout: "time": "2023-08-01T19:54:47.104338+0000", 2023-08-01T19:54:50.373 INFO:teuthology.orchestra.run.smithi008.stdout: "duration": 0.003389071 2023-08-01T19:54:50.373 INFO:teuthology.orchestra.run.smithi008.stdout: }, 2023-08-01T19:54:50.373 INFO:teuthology.orchestra.run.smithi008.stdout: { 2023-08-01T19:54:50.373 INFO:teuthology.orchestra.run.smithi008.stdout: "event": "started", 2023-08-01T19:54:50.374 INFO:teuthology.orchestra.run.smithi008.stdout: "time": "2023-08-01T19:54:47.104460+0000", 2023-08-01T19:54:50.374 INFO:teuthology.orchestra.run.smithi008.stdout: "duration": 0.00012271299999999999 2023-08-01T19:54:50.374 INFO:teuthology.orchestra.run.smithi008.stdout: }, 2023-08-01T19:54:50.374 INFO:teuthology.orchestra.run.smithi008.stdout: { 2023-08-01T19:54:50.374 INFO:teuthology.orchestra.run.smithi008.stdout: "event": "waiting for subops from 1", 2023-08-01T19:54:50.374 INFO:teuthology.orchestra.run.smithi008.stdout: "time": "2023-08-01T19:54:47.104613+0000", 2023-08-01T19:54:50.374 INFO:teuthology.orchestra.run.smithi008.stdout: "duration": 0.00015293199999999999 2023-08-01T19:54:50.374 INFO:teuthology.orchestra.run.smithi008.stdout: }, 2023-08-01T19:54:50.375 INFO:teuthology.orchestra.run.smithi008.stdout: { 2023-08-01T19:54:50.375 INFO:teuthology.orchestra.run.smithi008.stdout: "event": "op_commit", 2023-08-01T19:54:50.375 INFO:teuthology.orchestra.run.smithi008.stdout: "time": "2023-08-01T19:54:47.107979+0000", 2023-08-01T19:54:50.375 INFO:teuthology.orchestra.run.smithi008.stdout: "duration": 0.0033657790000000002 2023-08-01T19:54:50.375 INFO:teuthology.orchestra.run.smithi008.stdout: }, 2023-08-01T19:54:50.375 INFO:teuthology.orchestra.run.smithi008.stdout: { 2023-08-01T19:54:50.375 INFO:teuthology.orchestra.run.smithi008.stdout: "event": "sub_op_commit_rec", 2023-08-01T19:54:50.375 INFO:teuthology.orchestra.run.smithi008.stdout: "time": "2023-08-01T19:54:47.115513+0000", 2023-08-01T19:54:50.376 INFO:teuthology.orchestra.run.smithi008.stdout: "duration": 0.0075338949999999997 2023-08-01T19:54:50.376 INFO:teuthology.orchestra.run.smithi008.stdout: }, 2023-08-01T19:54:50.376 INFO:teuthology.orchestra.run.smithi008.stdout: { 2023-08-01T19:54:50.376 INFO:teuthology.orchestra.run.smithi008.stdout: "event": "commit_sent", 2023-08-01T19:54:50.376 INFO:teuthology.orchestra.run.smithi008.stdout: "time": "2023-08-01T19:54:47.115557+0000", 2023-08-01T19:54:50.376 INFO:teuthology.orchestra.run.smithi008.stdout: "duration": 4.4589999999999998e-05 2023-08-01T19:54:50.376 INFO:teuthology.orchestra.run.smithi008.stdout: }, 2023-08-01T19:54:50.377 INFO:teuthology.orchestra.run.smithi008.stdout: { 2023-08-01T19:54:50.377 INFO:teuthology.orchestra.run.smithi008.stdout: "event": "done", 2023-08-01T19:54:50.377 INFO:teuthology.orchestra.run.smithi008.stdout: "time": "2023-08-01T19:54:47.115593+0000", 2023-08-01T19:54:50.377 INFO:teuthology.orchestra.run.smithi008.stdout: "duration": 3.5797999999999998e-05 2023-08-01T19:54:50.377 INFO:teuthology.orchestra.run.smithi008.stdout: } 2023-08-01T19:54:50.377 INFO:teuthology.orchestra.run.smithi008.stdout: ] 2023-08-01T19:54:50.377 INFO:teuthology.orchestra.run.smithi008.stdout: } 2023-08-01T19:54:50.377 INFO:teuthology.orchestra.run.smithi008.stdout: }, 2023-08-01T19:54:50.378 INFO:teuthology.orchestra.run.smithi008.stdout: { 2023-08-01T19:54:50.378 INFO:teuthology.orchestra.run.smithi008.stdout: "description": "osd_op(client.4668.0:65870 5.c 5:33dffb88:::benchmark_data_smithi006_114134_object65869:head [set-alloc-hint object_size 65536 write_size 65536,write 0~65536] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e29)", 2023-08-01T19:54:50.378 INFO:teuthology.orchestra.run.smithi008.stdout: "initiated_at": "2023-08-01T19:54:47.659854+0000", 2023-08-01T19:54:50.378 INFO:teuthology.orchestra.run.smithi008.stdout: "age": 2.5463228390000001, 2023-08-01T19:54:50.378 INFO:teuthology.orchestra.run.smithi008.stdout: "duration": 0.018513103999999999, 2023-08-01T19:54:50.378 INFO:teuthology.orchestra.run.smithi008.stdout: "type_data": { 2023-08-01T19:54:50.378 INFO:teuthology.orchestra.run.smithi008.stdout: "flag_point": "commit sent; apply or cleanup", 2023-08-01T19:54:50.378 INFO:teuthology.orchestra.run.smithi008.stdout: "client_info": { 2023-08-01T19:54:50.379 INFO:teuthology.orchestra.run.smithi008.stdout: "client": "client.4668", 2023-08-01T19:54:50.379 INFO:teuthology.orchestra.run.smithi008.stdout: "client_addr": "172.21.15.6:0/1709472247", 2023-08-01T19:54:50.379 INFO:teuthology.orchestra.run.smithi008.stdout: "tid": 65870 2023-08-01T19:54:50.379 INFO:teuthology.orchestra.run.smithi008.stdout: }, 2023-08-01T19:54:50.379 INFO:teuthology.orchestra.run.smithi008.stdout: "events": [ 2023-08-01T19:54:50.379 INFO:teuthology.orchestra.run.smithi008.stdout: { 2023-08-01T19:54:50.379 INFO:teuthology.orchestra.run.smithi008.stdout: "event": "initiated", 2023-08-01T19:54:50.380 INFO:teuthology.orchestra.run.smithi008.stdout: "time": "2023-08-01T19:54:47.659854+0000", 2023-08-01T19:54:50.380 INFO:teuthology.orchestra.run.smithi008.stdout: "duration": 0 2023-08-01T19:54:50.380 INFO:teuthology.orchestra.run.smithi008.stdout: }, 2023-08-01T19:54:50.380 INFO:teuthology.orchestra.run.smithi008.stdout: { 2023-08-01T19:54:50.380 INFO:teuthology.orchestra.run.smithi008.stdout: "event": "throttled", 2023-08-01T19:54:50.380 INFO:teuthology.orchestra.run.smithi008.stdout: "time": "2023-08-01T19:54:47.659854+0000", 2023-08-01T19:54:50.380 INFO:teuthology.orchestra.run.smithi008.stdout: "duration": 0 2023-08-01T19:54:50.380 INFO:teuthology.orchestra.run.smithi008.stdout: }, 2023-08-01T19:54:50.381 INFO:teuthology.orchestra.run.smithi008.stdout: { 2023-08-01T19:54:50.381 INFO:teuthology.orchestra.run.smithi008.stdout: "event": "header_read", 2023-08-01T19:54:50.381 INFO:teuthology.orchestra.run.smithi008.stdout: "time": "2023-08-01T19:54:47.659853+0000", 2023-08-01T19:54:50.381 INFO:teuthology.orchestra.run.smithi008.stdout: "duration": 4294967295.999999 2023-08-01T19:54:50.381 INFO:teuthology.orchestra.run.smithi008.stdout: }, 2023-08-01T19:54:50.381 INFO:teuthology.orchestra.run.smithi008.stdout: { 2023-08-01T19:54:50.381 INFO:teuthology.orchestra.run.smithi008.stdout: "event": "all_read", 2023-08-01T19:54:50.381 INFO:teuthology.orchestra.run.smithi008.stdout: "time": "2023-08-01T19:54:47.660013+0000", 2023-08-01T19:54:50.382 INFO:teuthology.orchestra.run.smithi008.stdout: "duration": 0.00015954900000000001 2023-08-01T19:54:50.382 INFO:teuthology.orchestra.run.smithi008.stdout: }, 2023-08-01T19:54:50.382 INFO:teuthology.orchestra.run.smithi008.stdout: { 2023-08-01T19:54:50.382 INFO:teuthology.orchestra.run.smithi008.stdout: "event": "dispatched", 2023-08-01T19:54:50.382 INFO:teuthology.orchestra.run.smithi008.stdout: "time": "2023-08-01T19:54:47.660023+0000", 2023-08-01T19:54:50.382 INFO:teuthology.orchestra.run.smithi008.stdout: "duration": 1.0327e-05 2023-08-01T19:54:50.382 INFO:teuthology.orchestra.run.smithi008.stdout: }, 2023-08-01T19:54:50.383 INFO:teuthology.orchestra.run.smithi008.stdout: { 2023-08-01T19:54:50.383 INFO:teuthology.orchestra.run.smithi008.stdout: "event": "queued_for_pg", 2023-08-01T19:54:50.383 INFO:teuthology.orchestra.run.smithi008.stdout: "time": "2023-08-01T19:54:47.660039+0000", 2023-08-01T19:54:50.383 INFO:teuthology.orchestra.run.smithi008.stdout: "duration": 1.5829999999999999e-05 2023-08-01T19:54:50.383 INFO:teuthology.orchestra.run.smithi008.stdout: }, 2023-08-01T19:54:50.383 INFO:teuthology.orchestra.run.smithi008.stdout: { 2023-08-01T19:54:50.383 INFO:teuthology.orchestra.run.smithi008.stdout: "event": "reached_pg", 2023-08-01T19:54:50.383 INFO:teuthology.orchestra.run.smithi008.stdout: "time": "2023-08-01T19:54:47.662611+0000", 2023-08-01T19:54:50.384 INFO:teuthology.orchestra.run.smithi008.stdout: "duration": 0.002572319 2023-08-01T19:54:50.384 INFO:teuthology.orchestra.run.smithi008.stdout: }, 2023-08-01T19:54:50.384 INFO:teuthology.orchestra.run.smithi008.stdout: { 2023-08-01T19:54:50.384 INFO:teuthology.orchestra.run.smithi008.stdout: "event": "started", 2023-08-01T19:54:50.384 INFO:teuthology.orchestra.run.smithi008.stdout: "time": "2023-08-01T19:54:47.662767+0000", 2023-08-01T19:54:50.384 INFO:teuthology.orchestra.run.smithi008.stdout: "duration": 0.00015598200000000001 2023-08-01T19:54:50.384 INFO:teuthology.orchestra.run.smithi008.stdout: }, 2023-08-01T19:54:50.385 INFO:teuthology.orchestra.run.smithi008.stdout: { 2023-08-01T19:54:50.385 INFO:teuthology.orchestra.run.smithi008.stdout: "event": "waiting for subops from 1", 2023-08-01T19:54:50.385 INFO:teuthology.orchestra.run.smithi008.stdout: "time": "2023-08-01T19:54:47.662930+0000", 2023-08-01T19:54:50.385 INFO:teuthology.orchestra.run.smithi008.stdout: "duration": 0.000163086 2023-08-01T19:54:50.385 INFO:teuthology.orchestra.run.smithi008.stdout: }, 2023-08-01T19:54:50.385 INFO:teuthology.orchestra.run.smithi008.stdout: { 2023-08-01T19:54:50.385 INFO:teuthology.orchestra.run.smithi008.stdout: "event": "sub_op_commit_rec", 2023-08-01T19:54:50.385 INFO:teuthology.orchestra.run.smithi008.stdout: "time": "2023-08-01T19:54:47.667336+0000", 2023-08-01T19:54:50.386 INFO:teuthology.orchestra.run.smithi008.stdout: "duration": 0.0044062839999999999 2023-08-01T19:54:50.386 INFO:teuthology.orchestra.run.smithi008.stdout: }, 2023-08-01T19:54:50.386 INFO:teuthology.orchestra.run.smithi008.stdout: { 2023-08-01T19:54:50.386 INFO:teuthology.orchestra.run.smithi008.stdout: "event": "op_commit", 2023-08-01T19:54:50.386 INFO:teuthology.orchestra.run.smithi008.stdout: "time": "2023-08-01T19:54:47.678278+0000", 2023-08-01T19:54:50.386 INFO:teuthology.orchestra.run.smithi008.stdout: "duration": 0.010941912999999999 2023-08-01T19:54:50.386 INFO:teuthology.orchestra.run.smithi008.stdout: }, 2023-08-01T19:54:50.386 INFO:teuthology.orchestra.run.smithi008.stdout: { 2023-08-01T19:54:50.387 INFO:teuthology.orchestra.run.smithi008.stdout: "event": "commit_sent", 2023-08-01T19:54:50.387 INFO:teuthology.orchestra.run.smithi008.stdout: "time": "2023-08-01T19:54:47.678325+0000", 2023-08-01T19:54:50.387 INFO:teuthology.orchestra.run.smithi008.stdout: "duration": 4.6449999999999997e-05 2023-08-01T19:54:50.387 INFO:teuthology.orchestra.run.smithi008.stdout: }, 2023-08-01T19:54:50.387 INFO:teuthology.orchestra.run.smithi008.stdout: { 2023-08-01T19:54:50.387 INFO:teuthology.orchestra.run.smithi008.stdout: "event": "done", 2023-08-01T19:54:50.387 INFO:teuthology.orchestra.run.smithi008.stdout: "time": "2023-08-01T19:54:47.678367+0000", 2023-08-01T19:54:50.388 INFO:teuthology.orchestra.run.smithi008.stdout: "duration": 4.2222999999999999e-05 2023-08-01T19:54:50.388 INFO:teuthology.orchestra.run.smithi008.stdout: } 2023-08-01T19:54:50.388 INFO:teuthology.orchestra.run.smithi008.stdout: ] 2023-08-01T19:54:50.388 INFO:teuthology.orchestra.run.smithi008.stdout: } 2023-08-01T19:54:50.388 INFO:teuthology.orchestra.run.smithi008.stdout: }, 2023-08-01T19:54:50.388 INFO:teuthology.orchestra.run.smithi008.stdout: { 2023-08-01T19:54:50.388 INFO:teuthology.orchestra.run.smithi008.stdout: "description": "osd_op(client.4668.0:66149 5.6 5:649de16b:::benchmark_data_smithi006_114134_object66148:head [set-alloc-hint object_size 65536 write_size 65536,write 0~65536 in=65536b] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e29)", 2023-08-01T19:54:50.389 INFO:teuthology.orchestra.run.smithi008.stdout: "initiated_at": "2023-08-01T19:54:47.812723+0000", 2023-08-01T19:54:50.389 INFO:teuthology.orchestra.run.smithi008.stdout: "age": 2.3934537389999999, 2023-08-01T19:54:50.389 INFO:teuthology.orchestra.run.smithi008.stdout: "duration": 0.014949960999999999, 2023-08-01T19:54:50.389 INFO:teuthology.orchestra.run.smithi008.stdout: "type_data": { 2023-08-01T19:54:50.389 INFO:teuthology.orchestra.run.smithi008.stdout: "flag_point": "commit sent; apply or cleanup", 2023-08-01T19:54:50.389 INFO:teuthology.orchestra.run.smithi008.stdout: "client_info": { 2023-08-01T19:54:50.389 INFO:teuthology.orchestra.run.smithi008.stdout: "client": "client.4668", 2023-08-01T19:54:50.389 INFO:teuthology.orchestra.run.smithi008.stdout: "client_addr": "172.21.15.6:0/1709472247", 2023-08-01T19:54:50.390 INFO:teuthology.orchestra.run.smithi008.stdout: "tid": 66149 2023-08-01T19:54:50.390 INFO:teuthology.orchestra.run.smithi008.stdout: }, 2023-08-01T19:54:50.390 INFO:teuthology.orchestra.run.smithi008.stdout: "events": [ 2023-08-01T19:54:50.390 INFO:teuthology.orchestra.run.smithi008.stdout: { 2023-08-01T19:54:50.390 INFO:teuthology.orchestra.run.smithi008.stdout: "event": "initiated", 2023-08-01T19:54:50.390 INFO:teuthology.orchestra.run.smithi008.stdout: "time": "2023-08-01T19:54:47.812723+0000", 2023-08-01T19:54:50.390 INFO:teuthology.orchestra.run.smithi008.stdout: "duration": 0 2023-08-01T19:54:50.391 INFO:teuthology.orchestra.run.smithi008.stdout: }, 2023-08-01T19:54:50.391 INFO:teuthology.orchestra.run.smithi008.stdout: { 2023-08-01T19:54:50.391 INFO:teuthology.orchestra.run.smithi008.stdout: "event": "throttled", 2023-08-01T19:54:50.391 INFO:teuthology.orchestra.run.smithi008.stdout: "time": "2023-08-01T19:54:47.812723+0000", 2023-08-01T19:54:50.391 INFO:teuthology.orchestra.run.smithi008.stdout: "duration": 0 2023-08-01T19:54:50.391 INFO:teuthology.orchestra.run.smithi008.stdout: }, 2023-08-01T19:54:50.391 INFO:teuthology.orchestra.run.smithi008.stdout: { 2023-08-01T19:54:50.391 INFO:teuthology.orchestra.run.smithi008.stdout: "event": "header_read", 2023-08-01T19:54:50.392 INFO:teuthology.orchestra.run.smithi008.stdout: "time": "2023-08-01T19:54:47.812722+0000", 2023-08-01T19:54:50.392 INFO:teuthology.orchestra.run.smithi008.stdout: "duration": 4294967295.999999 2023-08-01T19:54:50.392 INFO:teuthology.orchestra.run.smithi008.stdout: }, 2023-08-01T19:54:50.392 INFO:teuthology.orchestra.run.smithi008.stdout: { 2023-08-01T19:54:50.392 INFO:teuthology.orchestra.run.smithi008.stdout: "event": "all_read", 2023-08-01T19:54:50.392 INFO:teuthology.orchestra.run.smithi008.stdout: "time": "2023-08-01T19:54:47.812768+0000", 2023-08-01T19:54:50.392 INFO:teuthology.orchestra.run.smithi008.stdout: "duration": 4.5725e-05 2023-08-01T19:54:50.393 INFO:teuthology.orchestra.run.smithi008.stdout: }, 2023-08-01T19:54:50.393 INFO:teuthology.orchestra.run.smithi008.stdout: { 2023-08-01T19:54:50.393 INFO:teuthology.orchestra.run.smithi008.stdout: "event": "dispatched", 2023-08-01T19:54:50.393 INFO:teuthology.orchestra.run.smithi008.stdout: "time": "2023-08-01T19:54:47.812780+0000", 2023-08-01T19:54:50.393 INFO:teuthology.orchestra.run.smithi008.stdout: "duration": 1.2325e-05 2023-08-01T19:54:50.393 INFO:teuthology.orchestra.run.smithi008.stdout: }, 2023-08-01T19:54:50.393 INFO:teuthology.orchestra.run.smithi008.stdout: { 2023-08-01T19:54:50.393 INFO:teuthology.orchestra.run.smithi008.stdout: "event": "queued_for_pg", 2023-08-01T19:54:50.394 INFO:teuthology.orchestra.run.smithi008.stdout: "time": "2023-08-01T19:54:47.812786+0000", 2023-08-01T19:54:50.394 INFO:teuthology.orchestra.run.smithi008.stdout: "duration": 6.2489999999999998e-06 2023-08-01T19:54:50.394 INFO:teuthology.orchestra.run.smithi008.stdout: }, 2023-08-01T19:54:50.394 INFO:teuthology.orchestra.run.smithi008.stdout: { 2023-08-01T19:54:50.394 INFO:teuthology.orchestra.run.smithi008.stdout: "event": "reached_pg", 2023-08-01T19:54:50.394 INFO:teuthology.orchestra.run.smithi008.stdout: "time": "2023-08-01T19:54:47.812827+0000", 2023-08-01T19:54:50.394 INFO:teuthology.orchestra.run.smithi008.stdout: "duration": 4.0791000000000003e-05 2023-08-01T19:54:50.394 INFO:teuthology.orchestra.run.smithi008.stdout: }, 2023-08-01T19:54:50.395 INFO:teuthology.orchestra.run.smithi008.stdout: { 2023-08-01T19:54:50.395 INFO:teuthology.orchestra.run.smithi008.stdout: "event": "started", 2023-08-01T19:54:50.395 INFO:teuthology.orchestra.run.smithi008.stdout: "time": "2023-08-01T19:54:47.812963+0000", 2023-08-01T19:54:50.395 INFO:teuthology.orchestra.run.smithi008.stdout: "duration": 0.00013594099999999999 2023-08-01T19:54:50.395 INFO:teuthology.orchestra.run.smithi008.stdout: }, 2023-08-01T19:54:50.395 INFO:teuthology.orchestra.run.smithi008.stdout: { 2023-08-01T19:54:50.395 INFO:teuthology.orchestra.run.smithi008.stdout: "event": "waiting for subops from 1", 2023-08-01T19:54:50.396 INFO:teuthology.orchestra.run.smithi008.stdout: "time": "2023-08-01T19:54:47.813110+0000", 2023-08-01T19:54:50.396 INFO:teuthology.orchestra.run.smithi008.stdout: "duration": 0.000147076 2023-08-01T19:54:50.396 INFO:teuthology.orchestra.run.smithi008.stdout: }, 2023-08-01T19:54:50.396 INFO:teuthology.orchestra.run.smithi008.stdout: { 2023-08-01T19:54:50.396 INFO:teuthology.orchestra.run.smithi008.stdout: "event": "op_commit", 2023-08-01T19:54:50.396 INFO:teuthology.orchestra.run.smithi008.stdout: "time": "2023-08-01T19:54:47.821372+0000", 2023-08-01T19:54:50.396 INFO:teuthology.orchestra.run.smithi008.stdout: "duration": 0.0082623560000000002 2023-08-01T19:54:50.396 INFO:teuthology.orchestra.run.smithi008.stdout: }, 2023-08-01T19:54:50.397 INFO:teuthology.orchestra.run.smithi008.stdout: { 2023-08-01T19:54:50.397 INFO:teuthology.orchestra.run.smithi008.stdout: "event": "sub_op_commit_rec", 2023-08-01T19:54:50.397 INFO:teuthology.orchestra.run.smithi008.stdout: "time": "2023-08-01T19:54:47.827579+0000", 2023-08-01T19:54:50.397 INFO:teuthology.orchestra.run.smithi008.stdout: "duration": 0.006206619 2023-08-01T19:54:50.397 INFO:teuthology.orchestra.run.smithi008.stdout: }, 2023-08-01T19:54:50.397 INFO:teuthology.orchestra.run.smithi008.stdout: { 2023-08-01T19:54:50.397 INFO:teuthology.orchestra.run.smithi008.stdout: "event": "commit_sent", 2023-08-01T19:54:50.397 INFO:teuthology.orchestra.run.smithi008.stdout: "time": "2023-08-01T19:54:47.827635+0000", 2023-08-01T19:54:50.398 INFO:teuthology.orchestra.run.smithi008.stdout: "duration": 5.6437000000000002e-05 2023-08-01T19:54:50.398 INFO:teuthology.orchestra.run.smithi008.stdout: }, 2023-08-01T19:54:50.398 INFO:teuthology.orchestra.run.smithi008.stdout: { 2023-08-01T19:54:50.398 INFO:teuthology.orchestra.run.smithi008.stdout: "event": "done", 2023-08-01T19:54:50.398 INFO:teuthology.orchestra.run.smithi008.stdout: "time": "2023-08-01T19:54:47.827673+0000", 2023-08-01T19:54:50.398 INFO:teuthology.orchestra.run.smithi008.stdout: "duration": 3.7561000000000002e-05 2023-08-01T19:54:50.398 INFO:teuthology.orchestra.run.smithi008.stdout: } 2023-08-01T19:54:50.399 INFO:teuthology.orchestra.run.smithi008.stdout: ] 2023-08-01T19:54:50.399 INFO:teuthology.orchestra.run.smithi008.stdout: } 2023-08-01T19:54:50.399 INFO:teuthology.orchestra.run.smithi008.stdout: }, 2023-08-01T19:54:50.399 INFO:teuthology.orchestra.run.smithi008.stdout: { 2023-08-01T19:54:50.399 INFO:teuthology.orchestra.run.smithi008.stdout: "description": "osd_op(client.4668.0:66154 5.6 5:6a03bb99:::benchmark_data_smithi006_114134_object66153:head [set-alloc-hint object_size 65536 write_size 65536,write 0~65536 in=65536b] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e29)", 2023-08-01T19:54:50.399 INFO:teuthology.orchestra.run.smithi008.stdout: "initiated_at": "2023-08-01T19:54:47.813616+0000", 2023-08-01T19:54:50.399 INFO:teuthology.orchestra.run.smithi008.stdout: "age": 2.3925609329999999, 2023-08-01T19:54:50.399 INFO:teuthology.orchestra.run.smithi008.stdout: "duration": 0.014171201, 2023-08-01T19:54:50.400 INFO:teuthology.orchestra.run.smithi008.stdout: "type_data": { 2023-08-01T19:54:50.400 INFO:teuthology.orchestra.run.smithi008.stdout: "flag_point": "commit sent; apply or cleanup", 2023-08-01T19:54:50.400 INFO:teuthology.orchestra.run.smithi008.stdout: "client_info": { 2023-08-01T19:54:50.400 INFO:teuthology.orchestra.run.smithi008.stdout: "client": "client.4668", 2023-08-01T19:54:50.400 INFO:teuthology.orchestra.run.smithi008.stdout: "client_addr": "172.21.15.6:0/1709472247", 2023-08-01T19:54:50.400 INFO:teuthology.orchestra.run.smithi008.stdout: "tid": 66154 2023-08-01T19:54:50.400 INFO:teuthology.orchestra.run.smithi008.stdout: }, 2023-08-01T19:54:50.400 INFO:teuthology.orchestra.run.smithi008.stdout: "events": [ 2023-08-01T19:54:50.401 INFO:teuthology.orchestra.run.smithi008.stdout: { 2023-08-01T19:54:50.401 INFO:teuthology.orchestra.run.smithi008.stdout: "event": "initiated", 2023-08-01T19:54:50.401 INFO:teuthology.orchestra.run.smithi008.stdout: "time": "2023-08-01T19:54:47.813616+0000", 2023-08-01T19:54:50.401 INFO:teuthology.orchestra.run.smithi008.stdout: "duration": 0 2023-08-01T19:54:50.401 INFO:teuthology.orchestra.run.smithi008.stdout: }, 2023-08-01T19:54:50.401 INFO:teuthology.orchestra.run.smithi008.stdout: { 2023-08-01T19:54:50.401 INFO:teuthology.orchestra.run.smithi008.stdout: "event": "throttled", 2023-08-01T19:54:50.401 INFO:teuthology.orchestra.run.smithi008.stdout: "time": "2023-08-01T19:54:47.813616+0000", 2023-08-01T19:54:50.402 INFO:teuthology.orchestra.run.smithi008.stdout: "duration": 0 2023-08-01T19:54:50.402 INFO:teuthology.orchestra.run.smithi008.stdout: }, 2023-08-01T19:54:50.402 INFO:teuthology.orchestra.run.smithi008.stdout: { 2023-08-01T19:54:50.402 INFO:teuthology.orchestra.run.smithi008.stdout: "event": "header_read", 2023-08-01T19:54:50.402 INFO:teuthology.orchestra.run.smithi008.stdout: "time": "2023-08-01T19:54:47.813613+0000", 2023-08-01T19:54:50.402 INFO:teuthology.orchestra.run.smithi008.stdout: "duration": 4294967295.9999971 2023-08-01T19:54:50.402 INFO:teuthology.orchestra.run.smithi008.stdout: }, 2023-08-01T19:54:50.403 INFO:teuthology.orchestra.run.smithi008.stdout: { 2023-08-01T19:54:50.403 INFO:teuthology.orchestra.run.smithi008.stdout: "event": "all_read", 2023-08-01T19:54:50.403 INFO:teuthology.orchestra.run.smithi008.stdout: "time": "2023-08-01T19:54:47.813722+0000", 2023-08-01T19:54:50.403 INFO:teuthology.orchestra.run.smithi008.stdout: "duration": 0.00010951300000000001 2023-08-01T19:54:50.403 INFO:teuthology.orchestra.run.smithi008.stdout: }, 2023-08-01T19:54:50.403 INFO:teuthology.orchestra.run.smithi008.stdout: { 2023-08-01T19:54:50.403 INFO:teuthology.orchestra.run.smithi008.stdout: "event": "dispatched", 2023-08-01T19:54:50.403 INFO:teuthology.orchestra.run.smithi008.stdout: "time": "2023-08-01T19:54:47.813732+0000", 2023-08-01T19:54:50.404 INFO:teuthology.orchestra.run.smithi008.stdout: "duration": 9.7860000000000008e-06 2023-08-01T19:54:50.404 INFO:teuthology.orchestra.run.smithi008.stdout: }, 2023-08-01T19:54:50.404 INFO:teuthology.orchestra.run.smithi008.stdout: { 2023-08-01T19:54:50.404 INFO:teuthology.orchestra.run.smithi008.stdout: "event": "queued_for_pg", 2023-08-01T19:54:50.404 INFO:teuthology.orchestra.run.smithi008.stdout: "time": "2023-08-01T19:54:47.813739+0000", 2023-08-01T19:54:50.404 INFO:teuthology.orchestra.run.smithi008.stdout: "duration": 6.37e-06 2023-08-01T19:54:50.404 INFO:teuthology.orchestra.run.smithi008.stdout: }, 2023-08-01T19:54:50.404 INFO:teuthology.orchestra.run.smithi008.stdout: { 2023-08-01T19:54:50.405 INFO:teuthology.orchestra.run.smithi008.stdout: "event": "reached_pg", 2023-08-01T19:54:50.405 INFO:teuthology.orchestra.run.smithi008.stdout: "time": "2023-08-01T19:54:47.815938+0000", 2023-08-01T19:54:50.405 INFO:teuthology.orchestra.run.smithi008.stdout: "duration": 0.0021997190000000002 2023-08-01T19:54:50.405 INFO:teuthology.orchestra.run.smithi008.stdout: }, 2023-08-01T19:54:50.405 INFO:teuthology.orchestra.run.smithi008.stdout: { 2023-08-01T19:54:50.405 INFO:teuthology.orchestra.run.smithi008.stdout: "event": "started", 2023-08-01T19:54:50.405 INFO:teuthology.orchestra.run.smithi008.stdout: "time": "2023-08-01T19:54:47.816073+0000", 2023-08-01T19:54:50.405 INFO:teuthology.orchestra.run.smithi008.stdout: "duration": 0.000134709 2023-08-01T19:54:50.406 INFO:teuthology.orchestra.run.smithi008.stdout: }, 2023-08-01T19:54:50.406 INFO:teuthology.orchestra.run.smithi008.stdout: { 2023-08-01T19:54:50.406 INFO:teuthology.orchestra.run.smithi008.stdout: "event": "waiting for subops from 1", 2023-08-01T19:54:50.406 INFO:teuthology.orchestra.run.smithi008.stdout: "time": "2023-08-01T19:54:47.816267+0000", 2023-08-01T19:54:50.406 INFO:teuthology.orchestra.run.smithi008.stdout: "duration": 0.000193616 2023-08-01T19:54:50.406 INFO:teuthology.orchestra.run.smithi008.stdout: }, 2023-08-01T19:54:50.406 INFO:teuthology.orchestra.run.smithi008.stdout: { 2023-08-01T19:54:50.406 INFO:teuthology.orchestra.run.smithi008.stdout: "event": "op_commit", 2023-08-01T19:54:50.407 INFO:teuthology.orchestra.run.smithi008.stdout: "time": "2023-08-01T19:54:47.821379+0000", 2023-08-01T19:54:50.407 INFO:teuthology.orchestra.run.smithi008.stdout: "duration": 0.0051123779999999999 2023-08-01T19:54:50.407 INFO:teuthology.orchestra.run.smithi008.stdout: }, 2023-08-01T19:54:50.407 INFO:teuthology.orchestra.run.smithi008.stdout: { 2023-08-01T19:54:50.407 INFO:teuthology.orchestra.run.smithi008.stdout: "event": "sub_op_commit_rec", 2023-08-01T19:54:50.407 INFO:teuthology.orchestra.run.smithi008.stdout: "time": "2023-08-01T19:54:47.827707+0000", 2023-08-01T19:54:50.407 INFO:teuthology.orchestra.run.smithi008.stdout: "duration": 0.0063280890000000003 2023-08-01T19:54:50.408 INFO:teuthology.orchestra.run.smithi008.stdout: }, 2023-08-01T19:54:50.408 INFO:teuthology.orchestra.run.smithi008.stdout: { 2023-08-01T19:54:50.408 INFO:teuthology.orchestra.run.smithi008.stdout: "event": "commit_sent", 2023-08-01T19:54:50.408 INFO:teuthology.orchestra.run.smithi008.stdout: "time": "2023-08-01T19:54:47.827747+0000", 2023-08-01T19:54:50.408 INFO:teuthology.orchestra.run.smithi008.stdout: "duration": 3.9870000000000003e-05 2023-08-01T19:54:50.408 INFO:teuthology.orchestra.run.smithi008.stdout: }, 2023-08-01T19:54:50.408 INFO:teuthology.orchestra.run.smithi008.stdout: { 2023-08-01T19:54:50.408 INFO:teuthology.orchestra.run.smithi008.stdout: "event": "done", 2023-08-01T19:54:50.409 INFO:teuthology.orchestra.run.smithi008.stdout: "time": "2023-08-01T19:54:47.827787+0000", 2023-08-01T19:54:50.409 INFO:teuthology.orchestra.run.smithi008.stdout: "duration": 3.9928999999999997e-05 2023-08-01T19:54:50.409 INFO:teuthology.orchestra.run.smithi008.stdout: } 2023-08-01T19:54:50.409 INFO:teuthology.orchestra.run.smithi008.stdout: ] 2023-08-01T19:54:50.409 INFO:teuthology.orchestra.run.smithi008.stdout: } 2023-08-01T19:54:50.409 INFO:teuthology.orchestra.run.smithi008.stdout: }, 2023-08-01T19:54:50.409 INFO:teuthology.orchestra.run.smithi008.stdout: { 2023-08-01T19:54:50.410 INFO:teuthology.orchestra.run.smithi008.stdout: "description": "osd_op(client.4668.0:66156 5.c 5:39515a11:::benchmark_data_smithi006_114134_object66155:head [set-alloc-hint object_size 65536 write_size 65536,write 0~65536 in=65536b] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e29)", 2023-08-01T19:54:50.410 INFO:teuthology.orchestra.run.smithi008.stdout: "initiated_at": "2023-08-01T19:54:47.813749+0000", 2023-08-01T19:54:50.410 INFO:teuthology.orchestra.run.smithi008.stdout: "age": 2.3924273729999999, 2023-08-01T19:54:50.410 INFO:teuthology.orchestra.run.smithi008.stdout: "duration": 0.013902446000000001, 2023-08-01T19:54:50.410 INFO:teuthology.orchestra.run.smithi008.stdout: "type_data": { 2023-08-01T19:54:50.410 INFO:teuthology.orchestra.run.smithi008.stdout: "flag_point": "commit sent; apply or cleanup", 2023-08-01T19:54:50.410 INFO:teuthology.orchestra.run.smithi008.stdout: "client_info": { 2023-08-01T19:54:50.411 INFO:teuthology.orchestra.run.smithi008.stdout: "client": "client.4668", 2023-08-01T19:54:50.411 INFO:teuthology.orchestra.run.smithi008.stdout: "client_addr": "172.21.15.6:0/1709472247", 2023-08-01T19:54:50.411 INFO:teuthology.orchestra.run.smithi008.stdout: "tid": 66156 2023-08-01T19:54:50.411 INFO:teuthology.orchestra.run.smithi008.stdout: }, 2023-08-01T19:54:50.411 INFO:teuthology.orchestra.run.smithi008.stdout: "events": [ 2023-08-01T19:54:50.411 INFO:teuthology.orchestra.run.smithi008.stdout: { 2023-08-01T19:54:50.411 INFO:teuthology.orchestra.run.smithi008.stdout: "event": "initiated", 2023-08-01T19:54:50.411 INFO:teuthology.orchestra.run.smithi008.stdout: "time": "2023-08-01T19:54:47.813749+0000", 2023-08-01T19:54:50.412 INFO:teuthology.orchestra.run.smithi008.stdout: "duration": 0 2023-08-01T19:54:50.412 INFO:teuthology.orchestra.run.smithi008.stdout: }, 2023-08-01T19:54:50.412 INFO:teuthology.orchestra.run.smithi008.stdout: { 2023-08-01T19:54:50.412 INFO:teuthology.orchestra.run.smithi008.stdout: "event": "throttled", 2023-08-01T19:54:50.412 INFO:teuthology.orchestra.run.smithi008.stdout: "time": "2023-08-01T19:54:47.813749+0000", 2023-08-01T19:54:50.412 INFO:teuthology.orchestra.run.smithi008.stdout: "duration": 0 2023-08-01T19:54:50.412 INFO:teuthology.orchestra.run.smithi008.stdout: }, 2023-08-01T19:54:50.412 INFO:teuthology.orchestra.run.smithi008.stdout: { 2023-08-01T19:54:50.413 INFO:teuthology.orchestra.run.smithi008.stdout: "event": "header_read", 2023-08-01T19:54:50.413 INFO:teuthology.orchestra.run.smithi008.stdout: "time": "2023-08-01T19:54:47.813749+0000", 2023-08-01T19:54:50.413 INFO:teuthology.orchestra.run.smithi008.stdout: "duration": 4294967295.9999995 2023-08-01T19:54:50.413 INFO:teuthology.orchestra.run.smithi008.stdout: }, 2023-08-01T19:54:50.413 INFO:teuthology.orchestra.run.smithi008.stdout: { 2023-08-01T19:54:50.413 INFO:teuthology.orchestra.run.smithi008.stdout: "event": "all_read", 2023-08-01T19:54:50.413 INFO:teuthology.orchestra.run.smithi008.stdout: "time": "2023-08-01T19:54:47.813781+0000", 2023-08-01T19:54:50.413 INFO:teuthology.orchestra.run.smithi008.stdout: "duration": 3.1859000000000001e-05 2023-08-01T19:54:50.414 INFO:teuthology.orchestra.run.smithi008.stdout: }, 2023-08-01T19:54:50.414 INFO:teuthology.orchestra.run.smithi008.stdout: { 2023-08-01T19:54:50.414 INFO:teuthology.orchestra.run.smithi008.stdout: "event": "dispatched", 2023-08-01T19:54:50.414 INFO:teuthology.orchestra.run.smithi008.stdout: "time": "2023-08-01T19:54:47.813789+0000", 2023-08-01T19:54:50.414 INFO:teuthology.orchestra.run.smithi008.stdout: "duration": 8.3999999999999992e-06 2023-08-01T19:54:50.414 INFO:teuthology.orchestra.run.smithi008.stdout: }, 2023-08-01T19:54:50.414 INFO:teuthology.orchestra.run.smithi008.stdout: { 2023-08-01T19:54:50.414 INFO:teuthology.orchestra.run.smithi008.stdout: "event": "queued_for_pg", 2023-08-01T19:54:50.415 INFO:teuthology.orchestra.run.smithi008.stdout: "time": "2023-08-01T19:54:47.813796+0000", 2023-08-01T19:54:50.415 INFO:teuthology.orchestra.run.smithi008.stdout: "duration": 7.0620000000000003e-06 2023-08-01T19:54:50.415 INFO:teuthology.orchestra.run.smithi008.stdout: }, 2023-08-01T19:54:50.415 INFO:teuthology.orchestra.run.smithi008.stdout: { 2023-08-01T19:54:50.415 INFO:teuthology.orchestra.run.smithi008.stdout: "event": "reached_pg", 2023-08-01T19:54:50.415 INFO:teuthology.orchestra.run.smithi008.stdout: "time": "2023-08-01T19:54:47.813832+0000", 2023-08-01T19:54:50.415 INFO:teuthology.orchestra.run.smithi008.stdout: "duration": 3.5812000000000002e-05 2023-08-01T19:54:50.416 INFO:teuthology.orchestra.run.smithi008.stdout: }, 2023-08-01T19:54:50.416 INFO:teuthology.orchestra.run.smithi008.stdout: { 2023-08-01T19:54:50.416 INFO:teuthology.orchestra.run.smithi008.stdout: "event": "started", 2023-08-01T19:54:50.416 INFO:teuthology.orchestra.run.smithi008.stdout: "time": "2023-08-01T19:54:47.813948+0000", 2023-08-01T19:54:50.416 INFO:teuthology.orchestra.run.smithi008.stdout: "duration": 0.000115696 2023-08-01T19:54:50.416 INFO:teuthology.orchestra.run.smithi008.stdout: }, 2023-08-01T19:54:50.416 INFO:teuthology.orchestra.run.smithi008.stdout: { 2023-08-01T19:54:50.416 INFO:teuthology.orchestra.run.smithi008.stdout: "event": "waiting for subops from 1", 2023-08-01T19:54:50.417 INFO:teuthology.orchestra.run.smithi008.stdout: "time": "2023-08-01T19:54:47.814082+0000", 2023-08-01T19:54:50.417 INFO:teuthology.orchestra.run.smithi008.stdout: "duration": 0.00013408699999999999 2023-08-01T19:54:50.417 INFO:teuthology.orchestra.run.smithi008.stdout: }, 2023-08-01T19:54:50.417 INFO:teuthology.orchestra.run.smithi008.stdout: { 2023-08-01T19:54:50.417 INFO:teuthology.orchestra.run.smithi008.stdout: "event": "op_commit", 2023-08-01T19:54:50.417 INFO:teuthology.orchestra.run.smithi008.stdout: "time": "2023-08-01T19:54:47.818587+0000", 2023-08-01T19:54:50.417 INFO:teuthology.orchestra.run.smithi008.stdout: "duration": 0.0045055420000000004 2023-08-01T19:54:50.418 INFO:teuthology.orchestra.run.smithi008.stdout: }, 2023-08-01T19:54:50.418 INFO:teuthology.orchestra.run.smithi008.stdout: { 2023-08-01T19:54:50.418 INFO:teuthology.orchestra.run.smithi008.stdout: "event": "sub_op_commit_rec", 2023-08-01T19:54:50.418 INFO:teuthology.orchestra.run.smithi008.stdout: "time": "2023-08-01T19:54:47.827546+0000", 2023-08-01T19:54:50.418 INFO:teuthology.orchestra.run.smithi008.stdout: "duration": 0.0089584499999999997 2023-08-01T19:54:50.418 INFO:teuthology.orchestra.run.smithi008.stdout: }, 2023-08-01T19:54:50.418 INFO:teuthology.orchestra.run.smithi008.stdout: { 2023-08-01T19:54:50.418 INFO:teuthology.orchestra.run.smithi008.stdout: "event": "commit_sent", 2023-08-01T19:54:50.419 INFO:teuthology.orchestra.run.smithi008.stdout: "time": "2023-08-01T19:54:47.827607+0000", 2023-08-01T19:54:50.419 INFO:teuthology.orchestra.run.smithi008.stdout: "duration": 6.0919999999999999e-05 2023-08-01T19:54:50.419 INFO:teuthology.orchestra.run.smithi008.stdout: }, 2023-08-01T19:54:50.419 INFO:teuthology.orchestra.run.smithi008.stdout: { 2023-08-01T19:54:50.419 INFO:teuthology.orchestra.run.smithi008.stdout: "event": "done", 2023-08-01T19:54:50.419 INFO:teuthology.orchestra.run.smithi008.stdout: "time": "2023-08-01T19:54:47.827652+0000", 2023-08-01T19:54:50.419 INFO:teuthology.orchestra.run.smithi008.stdout: "duration": 4.5179999999999998e-05 2023-08-01T19:54:50.419 INFO:teuthology.orchestra.run.smithi008.stdout: } 2023-08-01T19:54:50.420 INFO:teuthology.orchestra.run.smithi008.stdout: ] 2023-08-01T19:54:50.420 INFO:teuthology.orchestra.run.smithi008.stdout: } 2023-08-01T19:54:50.420 INFO:teuthology.orchestra.run.smithi008.stdout: } 2023-08-01T19:54:50.420 INFO:teuthology.orchestra.run.smithi008.stdout: ] 2023-08-01T19:54:50.420 INFO:teuthology.orchestra.run.smithi008.stdout:} 2023-08-01T19:54:50.421 INFO:tasks.radosbench.radosbench.0.smithi006.stdout: 26 16 71092 71076 170.842 122.312 0.00659165 0.00585046 2023-08-01T19:54:50.422 INFO:tasks.ceph.osd.2.smithi155.stderr:2023-08-01T19:54:50.420+0000 7faa5c6ac700 -1 received signal: Hangup from /usr/bin/python3 /bin/daemon-helper kill ceph-osd -f --cluster ceph -i 2 (PID: 111337) UID: 0 2023-08-01T19:54:50.422 DEBUG:teuthology.orchestra.run.smithi101:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 30 ceph --cluster ceph --admin-daemon /var/run/ceph/ceph-osd.1.asok dump_ops_in_flight 2023-08-01T19:54:50.522 INFO:tasks.ceph.osd.0.smithi008.stderr:2023-08-01T19:54:50.522+0000 7f16a58f4700 -1 received signal: Hangup from /usr/bin/python3 /bin/daemon-helper kill ceph-osd -f --cluster ceph -i 0 (PID: 111179) UID: 0 2023-08-01T19:54:50.582 INFO:teuthology.orchestra.run.smithi101.stdout:{ 2023-08-01T19:54:50.582 INFO:teuthology.orchestra.run.smithi101.stdout: "ops": [ 2023-08-01T19:54:50.582 INFO:teuthology.orchestra.run.smithi101.stdout: { 2023-08-01T19:54:50.583 INFO:teuthology.orchestra.run.smithi101.stdout: "description": "osd_op(client.4668.0:71630 5.f 5:f52657c4:::benchmark_data_smithi006_114134_object71629:head [set-alloc-hint object_size 65536 write_size 65536,write 0~65536 in=65536b] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e30)", 2023-08-01T19:54:50.583 INFO:teuthology.orchestra.run.smithi101.stdout: "initiated_at": "2023-08-01T19:54:50.577691+0000", 2023-08-01T19:54:50.583 INFO:teuthology.orchestra.run.smithi101.stdout: "age": 0.0032777750000000001, 2023-08-01T19:54:50.583 INFO:teuthology.orchestra.run.smithi101.stdout: "duration": 0.0032969689999999999, 2023-08-01T19:54:50.583 INFO:teuthology.orchestra.run.smithi101.stdout: "type_data": { 2023-08-01T19:54:50.583 INFO:teuthology.orchestra.run.smithi101.stdout: "flag_point": "waiting for sub ops", 2023-08-01T19:54:50.584 INFO:teuthology.orchestra.run.smithi101.stdout: "client_info": { 2023-08-01T19:54:50.584 INFO:teuthology.orchestra.run.smithi101.stdout: "client": "client.4668", 2023-08-01T19:54:50.584 INFO:teuthology.orchestra.run.smithi101.stdout: "client_addr": "172.21.15.6:0/1709472247", 2023-08-01T19:54:50.584 INFO:teuthology.orchestra.run.smithi101.stdout: "tid": 71630 2023-08-01T19:54:50.584 INFO:teuthology.orchestra.run.smithi101.stdout: }, 2023-08-01T19:54:50.584 INFO:teuthology.orchestra.run.smithi101.stdout: "events": [ 2023-08-01T19:54:50.584 INFO:teuthology.orchestra.run.smithi101.stdout: { 2023-08-01T19:54:50.585 INFO:teuthology.orchestra.run.smithi101.stdout: "event": "initiated", 2023-08-01T19:54:50.585 INFO:teuthology.orchestra.run.smithi101.stdout: "time": "2023-08-01T19:54:50.577691+0000", 2023-08-01T19:54:50.585 INFO:teuthology.orchestra.run.smithi101.stdout: "duration": 0 2023-08-01T19:54:50.585 INFO:teuthology.orchestra.run.smithi101.stdout: }, 2023-08-01T19:54:50.585 INFO:teuthology.orchestra.run.smithi101.stdout: { 2023-08-01T19:54:50.585 INFO:teuthology.orchestra.run.smithi101.stdout: "event": "throttled", 2023-08-01T19:54:50.585 INFO:teuthology.orchestra.run.smithi101.stdout: "time": "2023-08-01T19:54:50.577691+0000", 2023-08-01T19:54:50.585 INFO:teuthology.orchestra.run.smithi101.stdout: "duration": 0 2023-08-01T19:54:50.586 INFO:teuthology.orchestra.run.smithi101.stdout: }, 2023-08-01T19:54:50.586 INFO:teuthology.orchestra.run.smithi101.stdout: { 2023-08-01T19:54:50.586 INFO:teuthology.orchestra.run.smithi101.stdout: "event": "header_read", 2023-08-01T19:54:50.586 INFO:teuthology.orchestra.run.smithi101.stdout: "time": "2023-08-01T19:54:50.577691+0000", 2023-08-01T19:54:50.586 INFO:teuthology.orchestra.run.smithi101.stdout: "duration": 4294967295.9999995 2023-08-01T19:54:50.586 INFO:teuthology.orchestra.run.smithi101.stdout: }, 2023-08-01T19:54:50.586 INFO:teuthology.orchestra.run.smithi101.stdout: { 2023-08-01T19:54:50.587 INFO:teuthology.orchestra.run.smithi101.stdout: "event": "all_read", 2023-08-01T19:54:50.587 INFO:teuthology.orchestra.run.smithi101.stdout: "time": "2023-08-01T19:54:50.577735+0000", 2023-08-01T19:54:50.587 INFO:teuthology.orchestra.run.smithi101.stdout: "duration": 4.4239000000000001e-05 2023-08-01T19:54:50.587 INFO:teuthology.orchestra.run.smithi101.stdout: }, 2023-08-01T19:54:50.587 INFO:teuthology.orchestra.run.smithi101.stdout: { 2023-08-01T19:54:50.587 INFO:teuthology.orchestra.run.smithi101.stdout: "event": "dispatched", 2023-08-01T19:54:50.587 INFO:teuthology.orchestra.run.smithi101.stdout: "time": "2023-08-01T19:54:50.577742+0000", 2023-08-01T19:54:50.587 INFO:teuthology.orchestra.run.smithi101.stdout: "duration": 7.2250000000000003e-06 2023-08-01T19:54:50.588 INFO:teuthology.orchestra.run.smithi101.stdout: }, 2023-08-01T19:54:50.588 INFO:teuthology.orchestra.run.smithi101.stdout: { 2023-08-01T19:54:50.588 INFO:teuthology.orchestra.run.smithi101.stdout: "event": "queued_for_pg", 2023-08-01T19:54:50.588 INFO:teuthology.orchestra.run.smithi101.stdout: "time": "2023-08-01T19:54:50.577747+0000", 2023-08-01T19:54:50.588 INFO:teuthology.orchestra.run.smithi101.stdout: "duration": 4.2359999999999998e-06 2023-08-01T19:54:50.588 INFO:teuthology.orchestra.run.smithi101.stdout: }, 2023-08-01T19:54:50.588 INFO:teuthology.orchestra.run.smithi101.stdout: { 2023-08-01T19:54:50.588 INFO:teuthology.orchestra.run.smithi101.stdout: "event": "reached_pg", 2023-08-01T19:54:50.589 INFO:teuthology.orchestra.run.smithi101.stdout: "time": "2023-08-01T19:54:50.577782+0000", 2023-08-01T19:54:50.589 INFO:teuthology.orchestra.run.smithi101.stdout: "duration": 3.5713999999999997e-05 2023-08-01T19:54:50.589 INFO:teuthology.orchestra.run.smithi101.stdout: }, 2023-08-01T19:54:50.589 INFO:teuthology.orchestra.run.smithi101.stdout: { 2023-08-01T19:54:50.589 INFO:teuthology.orchestra.run.smithi101.stdout: "event": "started", 2023-08-01T19:54:50.589 INFO:teuthology.orchestra.run.smithi101.stdout: "time": "2023-08-01T19:54:50.577892+0000", 2023-08-01T19:54:50.589 INFO:teuthology.orchestra.run.smithi101.stdout: "duration": 0.000109471 2023-08-01T19:54:50.590 INFO:teuthology.orchestra.run.smithi101.stdout: }, 2023-08-01T19:54:50.590 INFO:teuthology.orchestra.run.smithi101.stdout: { 2023-08-01T19:54:50.590 INFO:teuthology.orchestra.run.smithi101.stdout: "event": "waiting for subops from 2", 2023-08-01T19:54:50.590 INFO:teuthology.orchestra.run.smithi101.stdout: "time": "2023-08-01T19:54:50.578017+0000", 2023-08-01T19:54:50.590 INFO:teuthology.orchestra.run.smithi101.stdout: "duration": 0.00012531599999999999 2023-08-01T19:54:50.590 INFO:teuthology.orchestra.run.smithi101.stdout: } 2023-08-01T19:54:50.590 INFO:teuthology.orchestra.run.smithi101.stdout: ] 2023-08-01T19:54:50.590 INFO:teuthology.orchestra.run.smithi101.stdout: } 2023-08-01T19:54:50.591 INFO:teuthology.orchestra.run.smithi101.stdout: }, 2023-08-01T19:54:50.591 INFO:teuthology.orchestra.run.smithi101.stdout: { 2023-08-01T19:54:50.591 INFO:teuthology.orchestra.run.smithi101.stdout: "description": "osd_repop(client.4668.0:71631 5.6 e30/19 5:63028f6c:::benchmark_data_smithi006_114134_object71630:head v 30'4435, mlcod=30'4433)", 2023-08-01T19:54:50.591 INFO:teuthology.orchestra.run.smithi101.stdout: "initiated_at": "2023-08-01T19:54:50.579335+0000", 2023-08-01T19:54:50.591 INFO:teuthology.orchestra.run.smithi101.stdout: "age": 0.0016345330000000001, 2023-08-01T19:54:50.591 INFO:teuthology.orchestra.run.smithi101.stdout: "duration": 0.0017099820000000001, 2023-08-01T19:54:50.591 INFO:teuthology.orchestra.run.smithi101.stdout: "type_data": { 2023-08-01T19:54:50.591 INFO:teuthology.orchestra.run.smithi101.stdout: "flag_point": "started", 2023-08-01T19:54:50.592 INFO:teuthology.orchestra.run.smithi101.stdout: "events": [ 2023-08-01T19:54:50.592 INFO:teuthology.orchestra.run.smithi101.stdout: { 2023-08-01T19:54:50.592 INFO:teuthology.orchestra.run.smithi101.stdout: "event": "initiated", 2023-08-01T19:54:50.592 INFO:teuthology.orchestra.run.smithi101.stdout: "time": "2023-08-01T19:54:50.579335+0000", 2023-08-01T19:54:50.592 INFO:teuthology.orchestra.run.smithi101.stdout: "duration": 0 2023-08-01T19:54:50.592 INFO:teuthology.orchestra.run.smithi101.stdout: }, 2023-08-01T19:54:50.592 INFO:teuthology.orchestra.run.smithi101.stdout: { 2023-08-01T19:54:50.593 INFO:teuthology.orchestra.run.smithi101.stdout: "event": "throttled", 2023-08-01T19:54:50.593 INFO:teuthology.orchestra.run.smithi101.stdout: "time": "2023-08-01T19:54:50.579335+0000", 2023-08-01T19:54:50.593 INFO:teuthology.orchestra.run.smithi101.stdout: "duration": 0 2023-08-01T19:54:50.593 INFO:teuthology.orchestra.run.smithi101.stdout: }, 2023-08-01T19:54:50.593 INFO:teuthology.orchestra.run.smithi101.stdout: { 2023-08-01T19:54:50.593 INFO:teuthology.orchestra.run.smithi101.stdout: "event": "header_read", 2023-08-01T19:54:50.593 INFO:teuthology.orchestra.run.smithi101.stdout: "time": "2023-08-01T19:54:50.579334+0000", 2023-08-01T19:54:50.593 INFO:teuthology.orchestra.run.smithi101.stdout: "duration": 4294967295.9999995 2023-08-01T19:54:50.594 INFO:teuthology.orchestra.run.smithi101.stdout: }, 2023-08-01T19:54:50.594 INFO:teuthology.orchestra.run.smithi101.stdout: { 2023-08-01T19:54:50.594 INFO:teuthology.orchestra.run.smithi101.stdout: "event": "all_read", 2023-08-01T19:54:50.594 INFO:teuthology.orchestra.run.smithi101.stdout: "time": "2023-08-01T19:54:50.579397+0000", 2023-08-01T19:54:50.594 INFO:teuthology.orchestra.run.smithi101.stdout: "duration": 6.3204e-05 2023-08-01T19:54:50.594 INFO:teuthology.orchestra.run.smithi101.stdout: }, 2023-08-01T19:54:50.594 INFO:teuthology.orchestra.run.smithi101.stdout: { 2023-08-01T19:54:50.594 INFO:teuthology.orchestra.run.smithi101.stdout: "event": "dispatched", 2023-08-01T19:54:50.595 INFO:teuthology.orchestra.run.smithi101.stdout: "time": "2023-08-01T19:54:50.579408+0000", 2023-08-01T19:54:50.595 INFO:teuthology.orchestra.run.smithi101.stdout: "duration": 1.0978000000000001e-05 2023-08-01T19:54:50.595 INFO:teuthology.orchestra.run.smithi101.stdout: }, 2023-08-01T19:54:50.595 INFO:teuthology.orchestra.run.smithi101.stdout: { 2023-08-01T19:54:50.595 INFO:teuthology.orchestra.run.smithi101.stdout: "event": "queued_for_pg", 2023-08-01T19:54:50.595 INFO:teuthology.orchestra.run.smithi101.stdout: "time": "2023-08-01T19:54:50.579414+0000", 2023-08-01T19:54:50.595 INFO:teuthology.orchestra.run.smithi101.stdout: "duration": 5.8109999999999999e-06 2023-08-01T19:54:50.595 INFO:teuthology.orchestra.run.smithi101.stdout: }, 2023-08-01T19:54:50.596 INFO:teuthology.orchestra.run.smithi101.stdout: { 2023-08-01T19:54:50.596 INFO:teuthology.orchestra.run.smithi101.stdout: "event": "reached_pg", 2023-08-01T19:54:50.596 INFO:teuthology.orchestra.run.smithi101.stdout: "time": "2023-08-01T19:54:50.579452+0000", 2023-08-01T19:54:50.596 INFO:teuthology.orchestra.run.smithi101.stdout: "duration": 3.7963999999999998e-05 2023-08-01T19:54:50.596 INFO:teuthology.orchestra.run.smithi101.stdout: }, 2023-08-01T19:54:50.596 INFO:teuthology.orchestra.run.smithi101.stdout: { 2023-08-01T19:54:50.596 INFO:teuthology.orchestra.run.smithi101.stdout: "event": "started", 2023-08-01T19:54:50.597 INFO:teuthology.orchestra.run.smithi101.stdout: "time": "2023-08-01T19:54:50.579472+0000", 2023-08-01T19:54:50.597 INFO:teuthology.orchestra.run.smithi101.stdout: "duration": 2.0200999999999999e-05 2023-08-01T19:54:50.597 INFO:teuthology.orchestra.run.smithi101.stdout: } 2023-08-01T19:54:50.597 INFO:teuthology.orchestra.run.smithi101.stdout: ] 2023-08-01T19:54:50.597 INFO:teuthology.orchestra.run.smithi101.stdout: } 2023-08-01T19:54:50.597 INFO:teuthology.orchestra.run.smithi101.stdout: }, 2023-08-01T19:54:50.597 INFO:teuthology.orchestra.run.smithi101.stdout: { 2023-08-01T19:54:50.597 INFO:teuthology.orchestra.run.smithi101.stdout: "description": "osd_op(client.4668.0:71633 5.1 5:8ba9e3cd:::benchmark_data_smithi006_114134_object71632:head [set-alloc-hint object_size 65536 write_size 65536,write 0~65536 in=65536b] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e30)", 2023-08-01T19:54:50.598 INFO:teuthology.orchestra.run.smithi101.stdout: "initiated_at": "2023-08-01T19:54:50.579964+0000", 2023-08-01T19:54:50.598 INFO:teuthology.orchestra.run.smithi101.stdout: "age": 0.0010048920000000001, 2023-08-01T19:54:50.598 INFO:teuthology.orchestra.run.smithi101.stdout: "duration": 0.0011270989999999999, 2023-08-01T19:54:50.598 INFO:teuthology.orchestra.run.smithi101.stdout: "type_data": { 2023-08-01T19:54:50.598 INFO:teuthology.orchestra.run.smithi101.stdout: "flag_point": "waiting for sub ops", 2023-08-01T19:54:50.598 INFO:teuthology.orchestra.run.smithi101.stdout: "client_info": { 2023-08-01T19:54:50.598 INFO:teuthology.orchestra.run.smithi101.stdout: "client": "client.4668", 2023-08-01T19:54:50.598 INFO:teuthology.orchestra.run.smithi101.stdout: "client_addr": "172.21.15.6:0/1709472247", 2023-08-01T19:54:50.599 INFO:teuthology.orchestra.run.smithi101.stdout: "tid": 71633 2023-08-01T19:54:50.599 INFO:teuthology.orchestra.run.smithi101.stdout: }, 2023-08-01T19:54:50.599 INFO:teuthology.orchestra.run.smithi101.stdout: "events": [ 2023-08-01T19:54:50.599 INFO:teuthology.orchestra.run.smithi101.stdout: { 2023-08-01T19:54:50.599 INFO:teuthology.orchestra.run.smithi101.stdout: "event": "initiated", 2023-08-01T19:54:50.599 INFO:teuthology.orchestra.run.smithi101.stdout: "time": "2023-08-01T19:54:50.579964+0000", 2023-08-01T19:54:50.599 INFO:teuthology.orchestra.run.smithi101.stdout: "duration": 0 2023-08-01T19:54:50.600 INFO:teuthology.orchestra.run.smithi101.stdout: }, 2023-08-01T19:54:50.600 INFO:teuthology.orchestra.run.smithi101.stdout: { 2023-08-01T19:54:50.600 INFO:teuthology.orchestra.run.smithi101.stdout: "event": "throttled", 2023-08-01T19:54:50.600 INFO:teuthology.orchestra.run.smithi101.stdout: "time": "2023-08-01T19:54:50.579964+0000", 2023-08-01T19:54:50.600 INFO:teuthology.orchestra.run.smithi101.stdout: "duration": 0 2023-08-01T19:54:50.600 INFO:teuthology.orchestra.run.smithi101.stdout: }, 2023-08-01T19:54:50.600 INFO:teuthology.orchestra.run.smithi101.stdout: { 2023-08-01T19:54:50.600 INFO:teuthology.orchestra.run.smithi101.stdout: "event": "header_read", 2023-08-01T19:54:50.601 INFO:teuthology.orchestra.run.smithi101.stdout: "time": "2023-08-01T19:54:50.579963+0000", 2023-08-01T19:54:50.601 INFO:teuthology.orchestra.run.smithi101.stdout: "duration": 4294967295.999999 2023-08-01T19:54:50.601 INFO:teuthology.orchestra.run.smithi101.stdout: }, 2023-08-01T19:54:50.601 INFO:teuthology.orchestra.run.smithi101.stdout: { 2023-08-01T19:54:50.601 INFO:teuthology.orchestra.run.smithi101.stdout: "event": "all_read", 2023-08-01T19:54:50.601 INFO:teuthology.orchestra.run.smithi101.stdout: "time": "2023-08-01T19:54:50.580033+0000", 2023-08-01T19:54:50.601 INFO:teuthology.orchestra.run.smithi101.stdout: "duration": 6.9596000000000002e-05 2023-08-01T19:54:50.602 INFO:teuthology.orchestra.run.smithi101.stdout: }, 2023-08-01T19:54:50.602 INFO:teuthology.orchestra.run.smithi101.stdout: { 2023-08-01T19:54:50.602 INFO:teuthology.orchestra.run.smithi101.stdout: "event": "dispatched", 2023-08-01T19:54:50.602 INFO:teuthology.orchestra.run.smithi101.stdout: "time": "2023-08-01T19:54:50.580042+0000", 2023-08-01T19:54:50.602 INFO:teuthology.orchestra.run.smithi101.stdout: "duration": 8.85e-06 2023-08-01T19:54:50.602 INFO:teuthology.orchestra.run.smithi101.stdout: }, 2023-08-01T19:54:50.602 INFO:teuthology.orchestra.run.smithi101.stdout: { 2023-08-01T19:54:50.602 INFO:teuthology.orchestra.run.smithi101.stdout: "event": "queued_for_pg", 2023-08-01T19:54:50.603 INFO:teuthology.orchestra.run.smithi101.stdout: "time": "2023-08-01T19:54:50.580046+0000", 2023-08-01T19:54:50.603 INFO:teuthology.orchestra.run.smithi101.stdout: "duration": 4.1679999999999997e-06 2023-08-01T19:54:50.603 INFO:teuthology.orchestra.run.smithi101.stdout: }, 2023-08-01T19:54:50.603 INFO:teuthology.orchestra.run.smithi101.stdout: { 2023-08-01T19:54:50.603 INFO:teuthology.orchestra.run.smithi101.stdout: "event": "reached_pg", 2023-08-01T19:54:50.603 INFO:teuthology.orchestra.run.smithi101.stdout: "time": "2023-08-01T19:54:50.580071+0000", 2023-08-01T19:54:50.603 INFO:teuthology.orchestra.run.smithi101.stdout: "duration": 2.5462000000000001e-05 2023-08-01T19:54:50.603 INFO:teuthology.orchestra.run.smithi101.stdout: }, 2023-08-01T19:54:50.604 INFO:teuthology.orchestra.run.smithi101.stdout: { 2023-08-01T19:54:50.604 INFO:teuthology.orchestra.run.smithi101.stdout: "event": "started", 2023-08-01T19:54:50.604 INFO:teuthology.orchestra.run.smithi101.stdout: "time": "2023-08-01T19:54:50.580150+0000", 2023-08-01T19:54:50.604 INFO:teuthology.orchestra.run.smithi101.stdout: "duration": 7.8443999999999996e-05 2023-08-01T19:54:50.604 INFO:teuthology.orchestra.run.smithi101.stdout: }, 2023-08-01T19:54:50.604 INFO:teuthology.orchestra.run.smithi101.stdout: { 2023-08-01T19:54:50.604 INFO:teuthology.orchestra.run.smithi101.stdout: "event": "waiting for subops from 0", 2023-08-01T19:54:50.604 INFO:teuthology.orchestra.run.smithi101.stdout: "time": "2023-08-01T19:54:50.580229+0000", 2023-08-01T19:54:50.605 INFO:teuthology.orchestra.run.smithi101.stdout: "duration": 7.9244000000000002e-05 2023-08-01T19:54:50.605 INFO:teuthology.orchestra.run.smithi101.stdout: } 2023-08-01T19:54:50.605 INFO:teuthology.orchestra.run.smithi101.stdout: ] 2023-08-01T19:54:50.605 INFO:teuthology.orchestra.run.smithi101.stdout: } 2023-08-01T19:54:50.605 INFO:teuthology.orchestra.run.smithi101.stdout: }, 2023-08-01T19:54:50.605 INFO:teuthology.orchestra.run.smithi101.stdout: { 2023-08-01T19:54:50.605 INFO:teuthology.orchestra.run.smithi101.stdout: "description": "osd_op(client.4668.0:71622 5.1 5:83d2ee39:::benchmark_data_smithi006_114134_object71621:head [set-alloc-hint object_size 65536 write_size 65536,write 0~65536 in=65536b] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e30)", 2023-08-01T19:54:50.605 INFO:teuthology.orchestra.run.smithi101.stdout: "initiated_at": "2023-08-01T19:54:50.574219+0000", 2023-08-01T19:54:50.606 INFO:teuthology.orchestra.run.smithi101.stdout: "age": 0.0067499999999999999, 2023-08-01T19:54:50.606 INFO:teuthology.orchestra.run.smithi101.stdout: "duration": 0.0069217269999999999, 2023-08-01T19:54:50.606 INFO:teuthology.orchestra.run.smithi101.stdout: "type_data": { 2023-08-01T19:54:50.606 INFO:teuthology.orchestra.run.smithi101.stdout: "flag_point": "waiting for sub ops", 2023-08-01T19:54:50.606 INFO:teuthology.orchestra.run.smithi101.stdout: "client_info": { 2023-08-01T19:54:50.606 INFO:teuthology.orchestra.run.smithi101.stdout: "client": "client.4668", 2023-08-01T19:54:50.606 INFO:teuthology.orchestra.run.smithi101.stdout: "client_addr": "172.21.15.6:0/1709472247", 2023-08-01T19:54:50.606 INFO:teuthology.orchestra.run.smithi101.stdout: "tid": 71622 2023-08-01T19:54:50.607 INFO:teuthology.orchestra.run.smithi101.stdout: }, 2023-08-01T19:54:50.607 INFO:teuthology.orchestra.run.smithi101.stdout: "events": [ 2023-08-01T19:54:50.607 INFO:teuthology.orchestra.run.smithi101.stdout: { 2023-08-01T19:54:50.607 INFO:teuthology.orchestra.run.smithi101.stdout: "event": "initiated", 2023-08-01T19:54:50.607 INFO:teuthology.orchestra.run.smithi101.stdout: "time": "2023-08-01T19:54:50.574219+0000", 2023-08-01T19:54:50.607 INFO:teuthology.orchestra.run.smithi101.stdout: "duration": 0 2023-08-01T19:54:50.607 INFO:teuthology.orchestra.run.smithi101.stdout: }, 2023-08-01T19:54:50.608 INFO:teuthology.orchestra.run.smithi101.stdout: { 2023-08-01T19:54:50.608 INFO:teuthology.orchestra.run.smithi101.stdout: "event": "throttled", 2023-08-01T19:54:50.608 INFO:teuthology.orchestra.run.smithi101.stdout: "time": "2023-08-01T19:54:50.574219+0000", 2023-08-01T19:54:50.608 INFO:teuthology.orchestra.run.smithi101.stdout: "duration": 0 2023-08-01T19:54:50.608 INFO:teuthology.orchestra.run.smithi101.stdout: }, 2023-08-01T19:54:50.608 INFO:teuthology.orchestra.run.smithi101.stdout: { 2023-08-01T19:54:50.608 INFO:teuthology.orchestra.run.smithi101.stdout: "event": "header_read", 2023-08-01T19:54:50.608 INFO:teuthology.orchestra.run.smithi101.stdout: "time": "2023-08-01T19:54:50.574216+0000", 2023-08-01T19:54:50.609 INFO:teuthology.orchestra.run.smithi101.stdout: "duration": 4294967295.9999967 2023-08-01T19:54:50.609 INFO:teuthology.orchestra.run.smithi101.stdout: }, 2023-08-01T19:54:50.609 INFO:teuthology.orchestra.run.smithi101.stdout: { 2023-08-01T19:54:50.609 INFO:teuthology.orchestra.run.smithi101.stdout: "event": "all_read", 2023-08-01T19:54:50.609 INFO:teuthology.orchestra.run.smithi101.stdout: "time": "2023-08-01T19:54:50.574326+0000", 2023-08-01T19:54:50.609 INFO:teuthology.orchestra.run.smithi101.stdout: "duration": 0.00011032200000000001 2023-08-01T19:54:50.609 INFO:teuthology.orchestra.run.smithi101.stdout: }, 2023-08-01T19:54:50.610 INFO:teuthology.orchestra.run.smithi101.stdout: { 2023-08-01T19:54:50.610 INFO:teuthology.orchestra.run.smithi101.stdout: "event": "dispatched", 2023-08-01T19:54:50.610 INFO:teuthology.orchestra.run.smithi101.stdout: "time": "2023-08-01T19:54:50.574335+0000", 2023-08-01T19:54:50.610 INFO:teuthology.orchestra.run.smithi101.stdout: "duration": 9.3079999999999997e-06 2023-08-01T19:54:50.610 INFO:teuthology.orchestra.run.smithi101.stdout: }, 2023-08-01T19:54:50.610 INFO:teuthology.orchestra.run.smithi101.stdout: { 2023-08-01T19:54:50.610 INFO:teuthology.orchestra.run.smithi101.stdout: "event": "queued_for_pg", 2023-08-01T19:54:50.610 INFO:teuthology.orchestra.run.smithi101.stdout: "time": "2023-08-01T19:54:50.574340+0000", 2023-08-01T19:54:50.611 INFO:teuthology.orchestra.run.smithi101.stdout: "duration": 4.3209999999999998e-06 2023-08-01T19:54:50.611 INFO:teuthology.orchestra.run.smithi101.stdout: }, 2023-08-01T19:54:50.611 INFO:teuthology.orchestra.run.smithi101.stdout: { 2023-08-01T19:54:50.611 INFO:teuthology.orchestra.run.smithi101.stdout: "event": "reached_pg", 2023-08-01T19:54:50.611 INFO:teuthology.orchestra.run.smithi101.stdout: "time": "2023-08-01T19:54:50.574381+0000", 2023-08-01T19:54:50.611 INFO:teuthology.orchestra.run.smithi101.stdout: "duration": 4.0858000000000001e-05 2023-08-01T19:54:50.611 INFO:teuthology.orchestra.run.smithi101.stdout: }, 2023-08-01T19:54:50.611 INFO:teuthology.orchestra.run.smithi101.stdout: { 2023-08-01T19:54:50.612 INFO:teuthology.orchestra.run.smithi101.stdout: "event": "started", 2023-08-01T19:54:50.612 INFO:teuthology.orchestra.run.smithi101.stdout: "time": "2023-08-01T19:54:50.574488+0000", 2023-08-01T19:54:50.612 INFO:teuthology.orchestra.run.smithi101.stdout: "duration": 0.00010776399999999999 2023-08-01T19:54:50.612 INFO:teuthology.orchestra.run.smithi101.stdout: }, 2023-08-01T19:54:50.612 INFO:teuthology.orchestra.run.smithi101.stdout: { 2023-08-01T19:54:50.612 INFO:teuthology.orchestra.run.smithi101.stdout: "event": "waiting for subops from 0", 2023-08-01T19:54:50.612 INFO:teuthology.orchestra.run.smithi101.stdout: "time": "2023-08-01T19:54:50.574572+0000", 2023-08-01T19:54:50.612 INFO:teuthology.orchestra.run.smithi101.stdout: "duration": 8.3437999999999996e-05 2023-08-01T19:54:50.613 INFO:teuthology.orchestra.run.smithi101.stdout: }, 2023-08-01T19:54:50.613 INFO:teuthology.orchestra.run.smithi101.stdout: { 2023-08-01T19:54:50.613 INFO:teuthology.orchestra.run.smithi101.stdout: "event": "sub_op_commit_rec", 2023-08-01T19:54:50.613 INFO:teuthology.orchestra.run.smithi101.stdout: "time": "2023-08-01T19:54:50.579798+0000", 2023-08-01T19:54:50.613 INFO:teuthology.orchestra.run.smithi101.stdout: "duration": 0.0052262630000000001 2023-08-01T19:54:50.613 INFO:teuthology.orchestra.run.smithi101.stdout: } 2023-08-01T19:54:50.613 INFO:teuthology.orchestra.run.smithi101.stdout: ] 2023-08-01T19:54:50.614 INFO:teuthology.orchestra.run.smithi101.stdout: } 2023-08-01T19:54:50.614 INFO:teuthology.orchestra.run.smithi101.stdout: }, 2023-08-01T19:54:50.614 INFO:teuthology.orchestra.run.smithi101.stdout: { 2023-08-01T19:54:50.614 INFO:teuthology.orchestra.run.smithi101.stdout: "description": "osd_repop(client.4668.0:71619 5.d e30/19 5:b06ad993:::benchmark_data_smithi006_114134_object71618:head v 30'4357, mlcod=30'4355)", 2023-08-01T19:54:50.614 INFO:teuthology.orchestra.run.smithi101.stdout: "initiated_at": "2023-08-01T19:54:50.574309+0000", 2023-08-01T19:54:50.614 INFO:teuthology.orchestra.run.smithi101.stdout: "age": 0.0066597699999999998, 2023-08-01T19:54:50.614 INFO:teuthology.orchestra.run.smithi101.stdout: "duration": 0.0068801799999999996, 2023-08-01T19:54:50.614 INFO:teuthology.orchestra.run.smithi101.stdout: "type_data": { 2023-08-01T19:54:50.615 INFO:teuthology.orchestra.run.smithi101.stdout: "flag_point": "started", 2023-08-01T19:54:50.615 INFO:teuthology.orchestra.run.smithi101.stdout: "events": [ 2023-08-01T19:54:50.615 INFO:teuthology.orchestra.run.smithi101.stdout: { 2023-08-01T19:54:50.615 INFO:teuthology.orchestra.run.smithi101.stdout: "event": "initiated", 2023-08-01T19:54:50.615 INFO:teuthology.orchestra.run.smithi101.stdout: "time": "2023-08-01T19:54:50.574309+0000", 2023-08-01T19:54:50.615 INFO:teuthology.orchestra.run.smithi101.stdout: "duration": 0 2023-08-01T19:54:50.615 INFO:teuthology.orchestra.run.smithi101.stdout: }, 2023-08-01T19:54:50.615 INFO:teuthology.orchestra.run.smithi101.stdout: { 2023-08-01T19:54:50.616 INFO:teuthology.orchestra.run.smithi101.stdout: "event": "throttled", 2023-08-01T19:54:50.616 INFO:teuthology.orchestra.run.smithi101.stdout: "time": "2023-08-01T19:54:50.574309+0000", 2023-08-01T19:54:50.616 INFO:teuthology.orchestra.run.smithi101.stdout: "duration": 0 2023-08-01T19:54:50.616 INFO:teuthology.orchestra.run.smithi101.stdout: }, 2023-08-01T19:54:50.616 INFO:teuthology.orchestra.run.smithi101.stdout: { 2023-08-01T19:54:50.616 INFO:teuthology.orchestra.run.smithi101.stdout: "event": "header_read", 2023-08-01T19:54:50.616 INFO:teuthology.orchestra.run.smithi101.stdout: "time": "2023-08-01T19:54:50.574309+0000", 2023-08-01T19:54:50.617 INFO:teuthology.orchestra.run.smithi101.stdout: "duration": 4294967295.9999995 2023-08-01T19:54:50.617 INFO:teuthology.orchestra.run.smithi101.stdout: }, 2023-08-01T19:54:50.617 INFO:teuthology.orchestra.run.smithi101.stdout: { 2023-08-01T19:54:50.617 INFO:teuthology.orchestra.run.smithi101.stdout: "event": "all_read", 2023-08-01T19:54:50.617 INFO:teuthology.orchestra.run.smithi101.stdout: "time": "2023-08-01T19:54:50.574431+0000", 2023-08-01T19:54:50.617 INFO:teuthology.orchestra.run.smithi101.stdout: "duration": 0.00012186 2023-08-01T19:54:50.617 INFO:teuthology.orchestra.run.smithi101.stdout: }, 2023-08-01T19:54:50.617 INFO:teuthology.orchestra.run.smithi101.stdout: { 2023-08-01T19:54:50.618 INFO:teuthology.orchestra.run.smithi101.stdout: "event": "dispatched", 2023-08-01T19:54:50.618 INFO:teuthology.orchestra.run.smithi101.stdout: "time": "2023-08-01T19:54:50.574437+0000", 2023-08-01T19:54:50.618 INFO:teuthology.orchestra.run.smithi101.stdout: "duration": 6.4509999999999997e-06 2023-08-01T19:54:50.618 INFO:teuthology.orchestra.run.smithi101.stdout: }, 2023-08-01T19:54:50.618 INFO:teuthology.orchestra.run.smithi101.stdout: { 2023-08-01T19:54:50.618 INFO:teuthology.orchestra.run.smithi101.stdout: "event": "queued_for_pg", 2023-08-01T19:54:50.618 INFO:teuthology.orchestra.run.smithi101.stdout: "time": "2023-08-01T19:54:50.574441+0000", 2023-08-01T19:54:50.618 INFO:teuthology.orchestra.run.smithi101.stdout: "duration": 3.4709999999999999e-06 2023-08-01T19:54:50.619 INFO:teuthology.orchestra.run.smithi101.stdout: }, 2023-08-01T19:54:50.619 INFO:teuthology.orchestra.run.smithi101.stdout: { 2023-08-01T19:54:50.619 INFO:teuthology.orchestra.run.smithi101.stdout: "event": "reached_pg", 2023-08-01T19:54:50.619 INFO:teuthology.orchestra.run.smithi101.stdout: "time": "2023-08-01T19:54:50.574470+0000", 2023-08-01T19:54:50.619 INFO:teuthology.orchestra.run.smithi101.stdout: "duration": 2.9176e-05 2023-08-01T19:54:50.619 INFO:teuthology.orchestra.run.smithi101.stdout: }, 2023-08-01T19:54:50.619 INFO:teuthology.orchestra.run.smithi101.stdout: { 2023-08-01T19:54:50.620 INFO:teuthology.orchestra.run.smithi101.stdout: "event": "started", 2023-08-01T19:54:50.620 INFO:teuthology.orchestra.run.smithi101.stdout: "time": "2023-08-01T19:54:50.574482+0000", 2023-08-01T19:54:50.620 INFO:teuthology.orchestra.run.smithi101.stdout: "duration": 1.2048999999999999e-05 2023-08-01T19:54:50.620 INFO:teuthology.orchestra.run.smithi101.stdout: } 2023-08-01T19:54:50.620 INFO:teuthology.orchestra.run.smithi101.stdout: ] 2023-08-01T19:54:50.620 INFO:teuthology.orchestra.run.smithi101.stdout: } 2023-08-01T19:54:50.620 INFO:teuthology.orchestra.run.smithi101.stdout: }, 2023-08-01T19:54:50.621 INFO:teuthology.orchestra.run.smithi101.stdout: { 2023-08-01T19:54:50.621 INFO:teuthology.orchestra.run.smithi101.stdout: "description": "osd_repop(client.4668.0:71623 5.3 e30/19 5:ca9114e1:::benchmark_data_smithi006_114134_object71622:head v 30'4537, mlcod=30'4535)", 2023-08-01T19:54:50.621 INFO:teuthology.orchestra.run.smithi101.stdout: "initiated_at": "2023-08-01T19:54:50.574816+0000", 2023-08-01T19:54:50.621 INFO:teuthology.orchestra.run.smithi101.stdout: "age": 0.0061531800000000003, 2023-08-01T19:54:50.621 INFO:teuthology.orchestra.run.smithi101.stdout: "duration": 0.0064146890000000003, 2023-08-01T19:54:50.621 INFO:teuthology.orchestra.run.smithi101.stdout: "type_data": { 2023-08-01T19:54:50.621 INFO:teuthology.orchestra.run.smithi101.stdout: "flag_point": "started", 2023-08-01T19:54:50.621 INFO:teuthology.orchestra.run.smithi101.stdout: "events": [ 2023-08-01T19:54:50.622 INFO:teuthology.orchestra.run.smithi101.stdout: { 2023-08-01T19:54:50.622 INFO:teuthology.orchestra.run.smithi101.stdout: "event": "initiated", 2023-08-01T19:54:50.622 INFO:teuthology.orchestra.run.smithi101.stdout: "time": "2023-08-01T19:54:50.574816+0000", 2023-08-01T19:54:50.622 INFO:teuthology.orchestra.run.smithi101.stdout: "duration": 0 2023-08-01T19:54:50.622 INFO:teuthology.orchestra.run.smithi101.stdout: }, 2023-08-01T19:54:50.622 INFO:teuthology.orchestra.run.smithi101.stdout: { 2023-08-01T19:54:50.622 INFO:teuthology.orchestra.run.smithi101.stdout: "event": "throttled", 2023-08-01T19:54:50.622 INFO:teuthology.orchestra.run.smithi101.stdout: "time": "2023-08-01T19:54:50.574816+0000", 2023-08-01T19:54:50.623 INFO:teuthology.orchestra.run.smithi101.stdout: "duration": 0 2023-08-01T19:54:50.623 INFO:teuthology.orchestra.run.smithi101.stdout: }, 2023-08-01T19:54:50.623 INFO:teuthology.orchestra.run.smithi101.stdout: { 2023-08-01T19:54:50.623 INFO:teuthology.orchestra.run.smithi101.stdout: "event": "header_read", 2023-08-01T19:54:50.623 INFO:teuthology.orchestra.run.smithi101.stdout: "time": "2023-08-01T19:54:50.574815+0000", 2023-08-01T19:54:50.623 INFO:teuthology.orchestra.run.smithi101.stdout: "duration": 4294967295.9999995 2023-08-01T19:54:50.623 INFO:teuthology.orchestra.run.smithi101.stdout: }, 2023-08-01T19:54:50.623 INFO:teuthology.orchestra.run.smithi101.stdout: { 2023-08-01T19:54:50.624 INFO:teuthology.orchestra.run.smithi101.stdout: "event": "all_read", 2023-08-01T19:54:50.624 INFO:teuthology.orchestra.run.smithi101.stdout: "time": "2023-08-01T19:54:50.574869+0000", 2023-08-01T19:54:50.624 INFO:teuthology.orchestra.run.smithi101.stdout: "duration": 5.3890000000000001e-05 2023-08-01T19:54:50.624 INFO:teuthology.orchestra.run.smithi101.stdout: }, 2023-08-01T19:54:50.624 INFO:teuthology.orchestra.run.smithi101.stdout: { 2023-08-01T19:54:50.624 INFO:teuthology.orchestra.run.smithi101.stdout: "event": "dispatched", 2023-08-01T19:54:50.624 INFO:teuthology.orchestra.run.smithi101.stdout: "time": "2023-08-01T19:54:50.574878+0000", 2023-08-01T19:54:50.625 INFO:teuthology.orchestra.run.smithi101.stdout: "duration": 8.6349999999999995e-06 2023-08-01T19:54:50.625 INFO:teuthology.orchestra.run.smithi101.stdout: }, 2023-08-01T19:54:50.625 INFO:teuthology.orchestra.run.smithi101.stdout: { 2023-08-01T19:54:50.625 INFO:teuthology.orchestra.run.smithi101.stdout: "event": "queued_for_pg", 2023-08-01T19:54:50.625 INFO:teuthology.orchestra.run.smithi101.stdout: "time": "2023-08-01T19:54:50.574883+0000", 2023-08-01T19:54:50.625 INFO:teuthology.orchestra.run.smithi101.stdout: "duration": 5.4249999999999997e-06 2023-08-01T19:54:50.625 INFO:teuthology.orchestra.run.smithi101.stdout: }, 2023-08-01T19:54:50.625 INFO:teuthology.orchestra.run.smithi101.stdout: { 2023-08-01T19:54:50.626 INFO:teuthology.orchestra.run.smithi101.stdout: "event": "reached_pg", 2023-08-01T19:54:50.626 INFO:teuthology.orchestra.run.smithi101.stdout: "time": "2023-08-01T19:54:50.574922+0000", 2023-08-01T19:54:50.626 INFO:teuthology.orchestra.run.smithi101.stdout: "duration": 3.8387999999999999e-05 2023-08-01T19:54:50.626 INFO:teuthology.orchestra.run.smithi101.stdout: }, 2023-08-01T19:54:50.626 INFO:teuthology.orchestra.run.smithi101.stdout: { 2023-08-01T19:54:50.626 INFO:teuthology.orchestra.run.smithi101.stdout: "event": "started", 2023-08-01T19:54:50.626 INFO:teuthology.orchestra.run.smithi101.stdout: "time": "2023-08-01T19:54:50.574941+0000", 2023-08-01T19:54:50.626 INFO:teuthology.orchestra.run.smithi101.stdout: "duration": 1.9009999999999999e-05 2023-08-01T19:54:50.627 INFO:teuthology.orchestra.run.smithi101.stdout: } 2023-08-01T19:54:50.627 INFO:teuthology.orchestra.run.smithi101.stdout: ] 2023-08-01T19:54:50.627 INFO:teuthology.orchestra.run.smithi101.stdout: } 2023-08-01T19:54:50.627 INFO:teuthology.orchestra.run.smithi101.stdout: }, 2023-08-01T19:54:50.627 INFO:teuthology.orchestra.run.smithi101.stdout: { 2023-08-01T19:54:50.627 INFO:teuthology.orchestra.run.smithi101.stdout: "description": "osd_repop(client.4668.0:71621 5.d e30/19 5:b7621e75:::benchmark_data_smithi006_114134_object71620:head v 30'4358, mlcod=30'4355)", 2023-08-01T19:54:50.627 INFO:teuthology.orchestra.run.smithi101.stdout: "initiated_at": "2023-08-01T19:54:50.576589+0000", 2023-08-01T19:54:50.628 INFO:teuthology.orchestra.run.smithi101.stdout: "age": 0.0043800469999999998, 2023-08-01T19:54:50.628 INFO:teuthology.orchestra.run.smithi101.stdout: "duration": 0.0046778000000000002, 2023-08-01T19:54:50.628 INFO:teuthology.orchestra.run.smithi101.stdout: "type_data": { 2023-08-01T19:54:50.628 INFO:teuthology.orchestra.run.smithi101.stdout: "flag_point": "started", 2023-08-01T19:54:50.628 INFO:teuthology.orchestra.run.smithi101.stdout: "events": [ 2023-08-01T19:54:50.628 INFO:teuthology.orchestra.run.smithi101.stdout: { 2023-08-01T19:54:50.628 INFO:teuthology.orchestra.run.smithi101.stdout: "event": "initiated", 2023-08-01T19:54:50.628 INFO:teuthology.orchestra.run.smithi101.stdout: "time": "2023-08-01T19:54:50.576589+0000", 2023-08-01T19:54:50.629 INFO:teuthology.orchestra.run.smithi101.stdout: "duration": 0 2023-08-01T19:54:50.629 INFO:teuthology.orchestra.run.smithi101.stdout: }, 2023-08-01T19:54:50.629 INFO:teuthology.orchestra.run.smithi101.stdout: { 2023-08-01T19:54:50.629 INFO:teuthology.orchestra.run.smithi101.stdout: "event": "throttled", 2023-08-01T19:54:50.629 INFO:teuthology.orchestra.run.smithi101.stdout: "time": "2023-08-01T19:54:50.576589+0000", 2023-08-01T19:54:50.629 INFO:teuthology.orchestra.run.smithi101.stdout: "duration": 0 2023-08-01T19:54:50.629 INFO:teuthology.orchestra.run.smithi101.stdout: }, 2023-08-01T19:54:50.629 INFO:teuthology.orchestra.run.smithi101.stdout: { 2023-08-01T19:54:50.630 INFO:teuthology.orchestra.run.smithi101.stdout: "event": "header_read", 2023-08-01T19:54:50.630 INFO:teuthology.orchestra.run.smithi101.stdout: "time": "2023-08-01T19:54:50.576589+0000", 2023-08-01T19:54:50.630 INFO:teuthology.orchestra.run.smithi101.stdout: "duration": 4294967295.9999995 2023-08-01T19:54:50.630 INFO:teuthology.orchestra.run.smithi101.stdout: }, 2023-08-01T19:54:50.630 INFO:teuthology.orchestra.run.smithi101.stdout: { 2023-08-01T19:54:50.630 INFO:teuthology.orchestra.run.smithi101.stdout: "event": "all_read", 2023-08-01T19:54:50.630 INFO:teuthology.orchestra.run.smithi101.stdout: "time": "2023-08-01T19:54:50.576643+0000", 2023-08-01T19:54:50.630 INFO:teuthology.orchestra.run.smithi101.stdout: "duration": 5.4218000000000002e-05 2023-08-01T19:54:50.631 INFO:teuthology.orchestra.run.smithi101.stdout: }, 2023-08-01T19:54:50.631 INFO:teuthology.orchestra.run.smithi101.stdout: { 2023-08-01T19:54:50.631 INFO:teuthology.orchestra.run.smithi101.stdout: "event": "dispatched", 2023-08-01T19:54:50.631 INFO:teuthology.orchestra.run.smithi101.stdout: "time": "2023-08-01T19:54:50.576650+0000", 2023-08-01T19:54:50.631 INFO:teuthology.orchestra.run.smithi101.stdout: "duration": 6.849e-06 2023-08-01T19:54:50.631 INFO:teuthology.orchestra.run.smithi101.stdout: }, 2023-08-01T19:54:50.631 INFO:teuthology.orchestra.run.smithi101.stdout: { 2023-08-01T19:54:50.631 INFO:teuthology.orchestra.run.smithi101.stdout: "event": "queued_for_pg", 2023-08-01T19:54:50.632 INFO:teuthology.orchestra.run.smithi101.stdout: "time": "2023-08-01T19:54:50.576655+0000", 2023-08-01T19:54:50.632 INFO:teuthology.orchestra.run.smithi101.stdout: "duration": 4.9910000000000002e-06 2023-08-01T19:54:50.632 INFO:teuthology.orchestra.run.smithi101.stdout: }, 2023-08-01T19:54:50.632 INFO:teuthology.orchestra.run.smithi101.stdout: { 2023-08-01T19:54:50.632 INFO:teuthology.orchestra.run.smithi101.stdout: "event": "reached_pg", 2023-08-01T19:54:50.632 INFO:teuthology.orchestra.run.smithi101.stdout: "time": "2023-08-01T19:54:50.576693+0000", 2023-08-01T19:54:50.632 INFO:teuthology.orchestra.run.smithi101.stdout: "duration": 3.8469e-05 2023-08-01T19:54:50.633 INFO:teuthology.orchestra.run.smithi101.stdout: }, 2023-08-01T19:54:50.633 INFO:teuthology.orchestra.run.smithi101.stdout: { 2023-08-01T19:54:50.633 INFO:teuthology.orchestra.run.smithi101.stdout: "event": "started", 2023-08-01T19:54:50.633 INFO:teuthology.orchestra.run.smithi101.stdout: "time": "2023-08-01T19:54:50.576712+0000", 2023-08-01T19:54:50.633 INFO:teuthology.orchestra.run.smithi101.stdout: "duration": 1.8488e-05 2023-08-01T19:54:50.633 INFO:teuthology.orchestra.run.smithi101.stdout: } 2023-08-01T19:54:50.633 INFO:teuthology.orchestra.run.smithi101.stdout: ] 2023-08-01T19:54:50.633 INFO:teuthology.orchestra.run.smithi101.stdout: } 2023-08-01T19:54:50.634 INFO:teuthology.orchestra.run.smithi101.stdout: }, 2023-08-01T19:54:50.634 INFO:teuthology.orchestra.run.smithi101.stdout: { 2023-08-01T19:54:50.634 INFO:teuthology.orchestra.run.smithi101.stdout: "description": "osd_op(client.4668.0:71627 5.9 5:94ef1fd8:::benchmark_data_smithi006_114134_object71626:head [set-alloc-hint object_size 65536 write_size 65536,write 0~65536 in=65536b] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e30)", 2023-08-01T19:54:50.634 INFO:teuthology.orchestra.run.smithi101.stdout: "initiated_at": "2023-08-01T19:54:50.576898+0000", 2023-08-01T19:54:50.634 INFO:teuthology.orchestra.run.smithi101.stdout: "age": 0.0040714469999999997, 2023-08-01T19:54:50.634 INFO:teuthology.orchestra.run.smithi101.stdout: "duration": 0.004409222, 2023-08-01T19:54:50.634 INFO:teuthology.orchestra.run.smithi101.stdout: "type_data": { 2023-08-01T19:54:50.635 INFO:teuthology.orchestra.run.smithi101.stdout: "flag_point": "waiting for sub ops", 2023-08-01T19:54:50.635 INFO:teuthology.orchestra.run.smithi101.stdout: "client_info": { 2023-08-01T19:54:50.635 INFO:teuthology.orchestra.run.smithi101.stdout: "client": "client.4668", 2023-08-01T19:54:50.635 INFO:teuthology.orchestra.run.smithi101.stdout: "client_addr": "172.21.15.6:0/1709472247", 2023-08-01T19:54:50.635 INFO:teuthology.orchestra.run.smithi101.stdout: "tid": 71627 2023-08-01T19:54:50.635 INFO:teuthology.orchestra.run.smithi101.stdout: }, 2023-08-01T19:54:50.635 INFO:teuthology.orchestra.run.smithi101.stdout: "events": [ 2023-08-01T19:54:50.635 INFO:teuthology.orchestra.run.smithi101.stdout: { 2023-08-01T19:54:50.636 INFO:teuthology.orchestra.run.smithi101.stdout: "event": "initiated", 2023-08-01T19:54:50.636 INFO:teuthology.orchestra.run.smithi101.stdout: "time": "2023-08-01T19:54:50.576898+0000", 2023-08-01T19:54:50.636 INFO:teuthology.orchestra.run.smithi101.stdout: "duration": 0 2023-08-01T19:54:50.636 INFO:teuthology.orchestra.run.smithi101.stdout: }, 2023-08-01T19:54:50.636 INFO:teuthology.orchestra.run.smithi101.stdout: { 2023-08-01T19:54:50.636 INFO:teuthology.orchestra.run.smithi101.stdout: "event": "throttled", 2023-08-01T19:54:50.636 INFO:teuthology.orchestra.run.smithi101.stdout: "time": "2023-08-01T19:54:50.576898+0000", 2023-08-01T19:54:50.636 INFO:teuthology.orchestra.run.smithi101.stdout: "duration": 0 2023-08-01T19:54:50.637 INFO:teuthology.orchestra.run.smithi101.stdout: }, 2023-08-01T19:54:50.637 INFO:teuthology.orchestra.run.smithi101.stdout: { 2023-08-01T19:54:50.637 INFO:teuthology.orchestra.run.smithi101.stdout: "event": "header_read", 2023-08-01T19:54:50.637 INFO:teuthology.orchestra.run.smithi101.stdout: "time": "2023-08-01T19:54:50.576897+0000", 2023-08-01T19:54:50.637 INFO:teuthology.orchestra.run.smithi101.stdout: "duration": 4294967295.999999 2023-08-01T19:54:50.637 INFO:teuthology.orchestra.run.smithi101.stdout: }, 2023-08-01T19:54:50.637 INFO:teuthology.orchestra.run.smithi101.stdout: { 2023-08-01T19:54:50.638 INFO:teuthology.orchestra.run.smithi101.stdout: "event": "all_read", 2023-08-01T19:54:50.638 INFO:teuthology.orchestra.run.smithi101.stdout: "time": "2023-08-01T19:54:50.577007+0000", 2023-08-01T19:54:50.638 INFO:teuthology.orchestra.run.smithi101.stdout: "duration": 0.000110349 2023-08-01T19:54:50.638 INFO:teuthology.orchestra.run.smithi101.stdout: }, 2023-08-01T19:54:50.638 INFO:teuthology.orchestra.run.smithi101.stdout: { 2023-08-01T19:54:50.638 INFO:teuthology.orchestra.run.smithi101.stdout: "event": "dispatched", 2023-08-01T19:54:50.638 INFO:teuthology.orchestra.run.smithi101.stdout: "time": "2023-08-01T19:54:50.577024+0000", 2023-08-01T19:54:50.638 INFO:teuthology.orchestra.run.smithi101.stdout: "duration": 1.6500000000000001e-05 2023-08-01T19:54:50.639 INFO:teuthology.orchestra.run.smithi101.stdout: }, 2023-08-01T19:54:50.639 INFO:teuthology.orchestra.run.smithi101.stdout: { 2023-08-01T19:54:50.639 INFO:teuthology.orchestra.run.smithi101.stdout: "event": "queued_for_pg", 2023-08-01T19:54:50.639 INFO:teuthology.orchestra.run.smithi101.stdout: "time": "2023-08-01T19:54:50.577030+0000", 2023-08-01T19:54:50.639 INFO:teuthology.orchestra.run.smithi101.stdout: "duration": 6.8809999999999998e-06 2023-08-01T19:54:50.639 INFO:teuthology.orchestra.run.smithi101.stdout: }, 2023-08-01T19:54:50.639 INFO:teuthology.orchestra.run.smithi101.stdout: { 2023-08-01T19:54:50.639 INFO:teuthology.orchestra.run.smithi101.stdout: "event": "reached_pg", 2023-08-01T19:54:50.640 INFO:teuthology.orchestra.run.smithi101.stdout: "time": "2023-08-01T19:54:50.577057+0000", 2023-08-01T19:54:50.640 INFO:teuthology.orchestra.run.smithi101.stdout: "duration": 2.6812e-05 2023-08-01T19:54:50.640 INFO:teuthology.orchestra.run.smithi101.stdout: }, 2023-08-01T19:54:50.640 INFO:teuthology.orchestra.run.smithi101.stdout: { 2023-08-01T19:54:50.640 INFO:teuthology.orchestra.run.smithi101.stdout: "event": "started", 2023-08-01T19:54:50.640 INFO:teuthology.orchestra.run.smithi101.stdout: "time": "2023-08-01T19:54:50.577136+0000", 2023-08-01T19:54:50.640 INFO:teuthology.orchestra.run.smithi101.stdout: "duration": 7.9043999999999997e-05 2023-08-01T19:54:50.641 INFO:teuthology.orchestra.run.smithi101.stdout: }, 2023-08-01T19:54:50.641 INFO:teuthology.orchestra.run.smithi101.stdout: { 2023-08-01T19:54:50.641 INFO:teuthology.orchestra.run.smithi101.stdout: "event": "waiting for subops from 2", 2023-08-01T19:54:50.641 INFO:teuthology.orchestra.run.smithi101.stdout: "time": "2023-08-01T19:54:50.577230+0000", 2023-08-01T19:54:50.641 INFO:teuthology.orchestra.run.smithi101.stdout: "duration": 9.3488999999999999e-05 2023-08-01T19:54:50.641 INFO:teuthology.orchestra.run.smithi101.stdout: }, 2023-08-01T19:54:50.641 INFO:teuthology.orchestra.run.smithi101.stdout: { 2023-08-01T19:54:50.641 INFO:teuthology.orchestra.run.smithi101.stdout: "event": "sub_op_commit_rec", 2023-08-01T19:54:50.642 INFO:teuthology.orchestra.run.smithi101.stdout: "time": "2023-08-01T19:54:50.580671+0000", 2023-08-01T19:54:50.642 INFO:teuthology.orchestra.run.smithi101.stdout: "duration": 0.0034415600000000002 2023-08-01T19:54:50.642 INFO:teuthology.orchestra.run.smithi101.stdout: } 2023-08-01T19:54:50.642 INFO:teuthology.orchestra.run.smithi101.stdout: ] 2023-08-01T19:54:50.642 INFO:teuthology.orchestra.run.smithi101.stdout: } 2023-08-01T19:54:50.642 INFO:teuthology.orchestra.run.smithi101.stdout: }, 2023-08-01T19:54:50.642 INFO:teuthology.orchestra.run.smithi101.stdout: { 2023-08-01T19:54:50.642 INFO:teuthology.orchestra.run.smithi101.stdout: "description": "osd_op(client.4668.0:71629 5.1 5:8f57b842:::benchmark_data_smithi006_114134_object71628:head [set-alloc-hint object_size 65536 write_size 65536,write 0~65536 in=65536b] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e30)", 2023-08-01T19:54:50.643 INFO:teuthology.orchestra.run.smithi101.stdout: "initiated_at": "2023-08-01T19:54:50.577593+0000", 2023-08-01T19:54:50.643 INFO:teuthology.orchestra.run.smithi101.stdout: "age": 0.0033757029999999999, 2023-08-01T19:54:50.643 INFO:teuthology.orchestra.run.smithi101.stdout: "duration": 0.0037886560000000001, 2023-08-01T19:54:50.643 INFO:teuthology.orchestra.run.smithi101.stdout: "type_data": { 2023-08-01T19:54:50.643 INFO:teuthology.orchestra.run.smithi101.stdout: "flag_point": "waiting for sub ops", 2023-08-01T19:54:50.643 INFO:teuthology.orchestra.run.smithi101.stdout: "client_info": { 2023-08-01T19:54:50.643 INFO:teuthology.orchestra.run.smithi101.stdout: "client": "client.4668", 2023-08-01T19:54:50.644 INFO:teuthology.orchestra.run.smithi101.stdout: "client_addr": "172.21.15.6:0/1709472247", 2023-08-01T19:54:50.644 INFO:teuthology.orchestra.run.smithi101.stdout: "tid": 71629 2023-08-01T19:54:50.644 INFO:teuthology.orchestra.run.smithi101.stdout: }, 2023-08-01T19:54:50.644 INFO:teuthology.orchestra.run.smithi101.stdout: "events": [ 2023-08-01T19:54:50.644 INFO:teuthology.orchestra.run.smithi101.stdout: { 2023-08-01T19:54:50.644 INFO:teuthology.orchestra.run.smithi101.stdout: "event": "initiated", 2023-08-01T19:54:50.644 INFO:teuthology.orchestra.run.smithi101.stdout: "time": "2023-08-01T19:54:50.577593+0000", 2023-08-01T19:54:50.644 INFO:teuthology.orchestra.run.smithi101.stdout: "duration": 0 2023-08-01T19:54:50.645 INFO:teuthology.orchestra.run.smithi101.stdout: }, 2023-08-01T19:54:50.645 INFO:teuthology.orchestra.run.smithi101.stdout: { 2023-08-01T19:54:50.645 INFO:teuthology.orchestra.run.smithi101.stdout: "event": "throttled", 2023-08-01T19:54:50.645 INFO:teuthology.orchestra.run.smithi101.stdout: "time": "2023-08-01T19:54:50.577593+0000", 2023-08-01T19:54:50.645 INFO:teuthology.orchestra.run.smithi101.stdout: "duration": 0 2023-08-01T19:54:50.645 INFO:teuthology.orchestra.run.smithi101.stdout: }, 2023-08-01T19:54:50.645 INFO:teuthology.orchestra.run.smithi101.stdout: { 2023-08-01T19:54:50.646 INFO:teuthology.orchestra.run.smithi101.stdout: "event": "header_read", 2023-08-01T19:54:50.646 INFO:teuthology.orchestra.run.smithi101.stdout: "time": "2023-08-01T19:54:50.577593+0000", 2023-08-01T19:54:50.646 INFO:teuthology.orchestra.run.smithi101.stdout: "duration": 4294967295.999999 2023-08-01T19:54:50.646 INFO:teuthology.orchestra.run.smithi101.stdout: }, 2023-08-01T19:54:50.646 INFO:teuthology.orchestra.run.smithi101.stdout: { 2023-08-01T19:54:50.646 INFO:teuthology.orchestra.run.smithi101.stdout: "event": "all_read", 2023-08-01T19:54:50.646 INFO:teuthology.orchestra.run.smithi101.stdout: "time": "2023-08-01T19:54:50.577666+0000", 2023-08-01T19:54:50.646 INFO:teuthology.orchestra.run.smithi101.stdout: "duration": 7.3578000000000006e-05 2023-08-01T19:54:50.647 INFO:teuthology.orchestra.run.smithi101.stdout: }, 2023-08-01T19:54:50.647 INFO:teuthology.orchestra.run.smithi101.stdout: { 2023-08-01T19:54:50.647 INFO:teuthology.orchestra.run.smithi101.stdout: "event": "dispatched", 2023-08-01T19:54:50.647 INFO:teuthology.orchestra.run.smithi101.stdout: "time": "2023-08-01T19:54:50.577678+0000", 2023-08-01T19:54:50.647 INFO:teuthology.orchestra.run.smithi101.stdout: "duration": 1.1432e-05 2023-08-01T19:54:50.647 INFO:teuthology.orchestra.run.smithi101.stdout: }, 2023-08-01T19:54:50.647 INFO:teuthology.orchestra.run.smithi101.stdout: { 2023-08-01T19:54:50.648 INFO:teuthology.orchestra.run.smithi101.stdout: "event": "queued_for_pg", 2023-08-01T19:54:50.648 INFO:teuthology.orchestra.run.smithi101.stdout: "time": "2023-08-01T19:54:50.577683+0000", 2023-08-01T19:54:50.648 INFO:teuthology.orchestra.run.smithi101.stdout: "duration": 5.4739999999999996e-06 2023-08-01T19:54:50.648 INFO:teuthology.orchestra.run.smithi101.stdout: }, 2023-08-01T19:54:50.648 INFO:teuthology.orchestra.run.smithi101.stdout: { 2023-08-01T19:54:50.648 INFO:teuthology.orchestra.run.smithi101.stdout: "event": "reached_pg", 2023-08-01T19:54:50.648 INFO:teuthology.orchestra.run.smithi101.stdout: "time": "2023-08-01T19:54:50.577719+0000", 2023-08-01T19:54:50.648 INFO:teuthology.orchestra.run.smithi101.stdout: "duration": 3.5485000000000003e-05 2023-08-01T19:54:50.649 INFO:teuthology.orchestra.run.smithi101.stdout: }, 2023-08-01T19:54:50.649 INFO:teuthology.orchestra.run.smithi101.stdout: { 2023-08-01T19:54:50.649 INFO:teuthology.orchestra.run.smithi101.stdout: "event": "started", 2023-08-01T19:54:50.649 INFO:teuthology.orchestra.run.smithi101.stdout: "time": "2023-08-01T19:54:50.577847+0000", 2023-08-01T19:54:50.649 INFO:teuthology.orchestra.run.smithi101.stdout: "duration": 0.00012877099999999999 2023-08-01T19:54:50.649 INFO:teuthology.orchestra.run.smithi101.stdout: }, 2023-08-01T19:54:50.649 INFO:teuthology.orchestra.run.smithi101.stdout: { 2023-08-01T19:54:50.649 INFO:teuthology.orchestra.run.smithi101.stdout: "event": "waiting for subops from 0", 2023-08-01T19:54:50.650 INFO:teuthology.orchestra.run.smithi101.stdout: "time": "2023-08-01T19:54:50.577990+0000", 2023-08-01T19:54:50.650 INFO:teuthology.orchestra.run.smithi101.stdout: "duration": 0.00014253200000000001 2023-08-01T19:54:50.650 INFO:teuthology.orchestra.run.smithi101.stdout: } 2023-08-01T19:54:50.650 INFO:teuthology.orchestra.run.smithi101.stdout: ] 2023-08-01T19:54:50.650 INFO:teuthology.orchestra.run.smithi101.stdout: } 2023-08-01T19:54:50.650 INFO:teuthology.orchestra.run.smithi101.stdout: } 2023-08-01T19:54:50.650 INFO:teuthology.orchestra.run.smithi101.stdout: ], 2023-08-01T19:54:50.651 INFO:teuthology.orchestra.run.smithi101.stdout: "num_ops": 9 2023-08-01T19:54:50.651 INFO:teuthology.orchestra.run.smithi101.stdout:} 2023-08-01T19:54:50.652 DEBUG:teuthology.orchestra.run.smithi101:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 30 ceph --cluster ceph --admin-daemon /var/run/ceph/ceph-osd.1.asok dump_blocked_ops 2023-08-01T19:54:50.653 INFO:tasks.ceph.osd.1.smithi101.stderr:2023-08-01T19:54:50.650+0000 7fb0cb7f6700 -1 received signal: Hangup from /usr/bin/python3 /bin/daemon-helper kill ceph-osd -f --cluster ceph -i 1 (PID: 111141) UID: 0 2023-08-01T19:54:50.752 INFO:tasks.ceph.osd.2.smithi155.stderr:2023-08-01T19:54:50.751+0000 7faa5c6ac700 -1 received signal: Hangup from /usr/bin/python3 /bin/daemon-helper kill ceph-osd -f --cluster ceph -i 2 (PID: 111337) UID: 0 2023-08-01T19:54:50.853 INFO:tasks.ceph.osd.1.smithi101.stderr:2023-08-01T19:54:50.852+0000 7fb0cb7f6700 -1 received signal: Hangup from /usr/bin/python3 /bin/daemon-helper kill ceph-osd -f --cluster ceph -i 1 (PID: 111141) UID: 0 2023-08-01T19:54:50.864 INFO:teuthology.orchestra.run.smithi101.stdout:{ 2023-08-01T19:54:50.864 INFO:teuthology.orchestra.run.smithi101.stdout: "ops": [], 2023-08-01T19:54:50.865 INFO:teuthology.orchestra.run.smithi101.stdout: "complaint_time": 30, 2023-08-01T19:54:50.865 INFO:teuthology.orchestra.run.smithi101.stdout: "num_blocked_ops": 0 2023-08-01T19:54:50.865 INFO:teuthology.orchestra.run.smithi101.stdout:} 2023-08-01T19:54:50.877 DEBUG:teuthology.orchestra.run.smithi101:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 30 ceph --cluster ceph --admin-daemon /var/run/ceph/ceph-osd.1.asok dump_historic_ops 2023-08-01T19:54:50.954 INFO:tasks.ceph.osd.2.smithi155.stderr:2023-08-01T19:54:50.952+0000 7faa5c6ac700 -1 received signal: Hangup from /usr/bin/python3 /bin/daemon-helper kill ceph-osd -f --cluster ceph -i 2 (PID: 111337) UID: 0 2023-08-01T19:54:50.994 INFO:teuthology.orchestra.run.smithi006.stderr:reweighted osd.0 to 1 (10000) 2023-08-01T19:54:50.999 DEBUG:teuthology.orchestra.run.smithi006:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 120 ceph --cluster ceph osd unset noscrub 2023-08-01T19:54:51.006 DEBUG:teuthology.orchestra.run.smithi006:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 120 ceph --cluster ceph osd reweight 1 1 2023-08-01T19:54:51.055 INFO:tasks.ceph.osd.0.smithi008.stderr:2023-08-01T19:54:51.054+0000 7f16a58f4700 -1 received signal: Hangup from /usr/bin/python3 /bin/daemon-helper kill ceph-osd -f --cluster ceph -i 0 (PID: 111179) UID: 0 2023-08-01T19:54:51.087 INFO:teuthology.orchestra.run.smithi101.stdout:{ 2023-08-01T19:54:51.088 INFO:teuthology.orchestra.run.smithi101.stdout: "size": 20, 2023-08-01T19:54:51.088 INFO:teuthology.orchestra.run.smithi101.stdout: "duration": 600, 2023-08-01T19:54:51.088 INFO:teuthology.orchestra.run.smithi101.stdout: "ops": [ 2023-08-01T19:54:51.093 INFO:teuthology.orchestra.run.smithi101.stdout: { 2023-08-01T19:54:51.093 INFO:teuthology.orchestra.run.smithi101.stdout: "description": "osd_op(mds.0.3:6 3.10 3:0d82a743:::600.00000000:head [omap-set-header] snapc 0=[] ondisk+write+known_if_redirected+full_force+supports_pool_eio e17)", 2023-08-01T19:54:51.093 INFO:teuthology.orchestra.run.smithi101.stdout: "initiated_at": "2023-08-01T19:54:04.458774+0000", 2023-08-01T19:54:51.093 INFO:teuthology.orchestra.run.smithi101.stdout: "age": 46.625681831000001, 2023-08-01T19:54:51.093 INFO:teuthology.orchestra.run.smithi101.stdout: "duration": 0.017582611000000001, 2023-08-01T19:54:51.094 INFO:teuthology.orchestra.run.smithi101.stdout: "type_data": { 2023-08-01T19:54:51.094 INFO:teuthology.orchestra.run.smithi101.stdout: "flag_point": "commit sent; apply or cleanup", 2023-08-01T19:54:51.094 INFO:teuthology.orchestra.run.smithi101.stdout: "events": [ 2023-08-01T19:54:51.094 INFO:teuthology.orchestra.run.smithi101.stdout: { 2023-08-01T19:54:51.094 INFO:teuthology.orchestra.run.smithi101.stdout: "event": "initiated", 2023-08-01T19:54:51.094 INFO:teuthology.orchestra.run.smithi101.stdout: "time": "2023-08-01T19:54:04.458774+0000", 2023-08-01T19:54:51.095 INFO:teuthology.orchestra.run.smithi101.stdout: "duration": 0 2023-08-01T19:54:51.095 INFO:teuthology.orchestra.run.smithi101.stdout: }, 2023-08-01T19:54:51.095 INFO:teuthology.orchestra.run.smithi101.stdout: { 2023-08-01T19:54:51.095 INFO:teuthology.orchestra.run.smithi101.stdout: "event": "throttled", 2023-08-01T19:54:51.095 INFO:teuthology.orchestra.run.smithi101.stdout: "time": "2023-08-01T19:54:04.458774+0000", 2023-08-01T19:54:51.095 INFO:teuthology.orchestra.run.smithi101.stdout: "duration": 0 2023-08-01T19:54:51.095 INFO:teuthology.orchestra.run.smithi101.stdout: }, 2023-08-01T19:54:51.095 INFO:teuthology.orchestra.run.smithi101.stdout: { 2023-08-01T19:54:51.096 INFO:teuthology.orchestra.run.smithi101.stdout: "event": "header_read", 2023-08-01T19:54:51.096 INFO:teuthology.orchestra.run.smithi101.stdout: "time": "2023-08-01T19:54:04.458772+0000", 2023-08-01T19:54:51.096 INFO:teuthology.orchestra.run.smithi101.stdout: "duration": 4294967295.9999981 2023-08-01T19:54:51.096 INFO:teuthology.orchestra.run.smithi101.stdout: }, 2023-08-01T19:54:51.096 INFO:teuthology.orchestra.run.smithi101.stdout: { 2023-08-01T19:54:51.096 INFO:teuthology.orchestra.run.smithi101.stdout: "event": "all_read", 2023-08-01T19:54:51.096 INFO:teuthology.orchestra.run.smithi101.stdout: "time": "2023-08-01T19:54:04.458781+0000", 2023-08-01T19:54:51.097 INFO:teuthology.orchestra.run.smithi101.stdout: "duration": 8.6670000000000002e-06 2023-08-01T19:54:51.097 INFO:teuthology.orchestra.run.smithi101.stdout: }, 2023-08-01T19:54:51.097 INFO:teuthology.orchestra.run.smithi101.stdout: { 2023-08-01T19:54:51.097 INFO:teuthology.orchestra.run.smithi101.stdout: "event": "dispatched", 2023-08-01T19:54:51.097 INFO:teuthology.orchestra.run.smithi101.stdout: "time": "2023-08-01T19:54:04.458797+0000", 2023-08-01T19:54:51.097 INFO:teuthology.orchestra.run.smithi101.stdout: "duration": 1.6463000000000001e-05 2023-08-01T19:54:51.097 INFO:teuthology.orchestra.run.smithi101.stdout: }, 2023-08-01T19:54:51.097 INFO:teuthology.orchestra.run.smithi101.stdout: { 2023-08-01T19:54:51.098 INFO:teuthology.orchestra.run.smithi101.stdout: "event": "queued_for_pg", 2023-08-01T19:54:51.098 INFO:teuthology.orchestra.run.smithi101.stdout: "time": "2023-08-01T19:54:04.458810+0000", 2023-08-01T19:54:51.098 INFO:teuthology.orchestra.run.smithi101.stdout: "duration": 1.2753e-05 2023-08-01T19:54:51.098 INFO:teuthology.orchestra.run.smithi101.stdout: }, 2023-08-01T19:54:51.098 INFO:teuthology.orchestra.run.smithi101.stdout: { 2023-08-01T19:54:51.098 INFO:teuthology.orchestra.run.smithi101.stdout: "event": "reached_pg", 2023-08-01T19:54:51.098 INFO:teuthology.orchestra.run.smithi101.stdout: "time": "2023-08-01T19:54:04.458866+0000", 2023-08-01T19:54:51.099 INFO:teuthology.orchestra.run.smithi101.stdout: "duration": 5.6625000000000001e-05 2023-08-01T19:54:51.099 INFO:teuthology.orchestra.run.smithi101.stdout: }, 2023-08-01T19:54:51.099 INFO:teuthology.orchestra.run.smithi101.stdout: { 2023-08-01T19:54:51.099 INFO:teuthology.orchestra.run.smithi101.stdout: "event": "op must wait for map", 2023-08-01T19:54:51.099 INFO:teuthology.orchestra.run.smithi101.stdout: "time": "2023-08-01T19:54:04.458873+0000", 2023-08-01T19:54:51.099 INFO:teuthology.orchestra.run.smithi101.stdout: "duration": 6.9110000000000004e-06 2023-08-01T19:54:51.099 INFO:teuthology.orchestra.run.smithi101.stdout: }, 2023-08-01T19:54:51.100 INFO:teuthology.orchestra.run.smithi101.stdout: { 2023-08-01T19:54:51.100 INFO:teuthology.orchestra.run.smithi101.stdout: "event": "reached_pg", 2023-08-01T19:54:51.100 INFO:teuthology.orchestra.run.smithi101.stdout: "time": "2023-08-01T19:54:04.466999+0000", 2023-08-01T19:54:51.100 INFO:teuthology.orchestra.run.smithi101.stdout: "duration": 0.0081256550000000007 2023-08-01T19:54:51.100 INFO:teuthology.orchestra.run.smithi101.stdout: }, 2023-08-01T19:54:51.100 INFO:teuthology.orchestra.run.smithi101.stdout: { 2023-08-01T19:54:51.100 INFO:teuthology.orchestra.run.smithi101.stdout: "event": "started", 2023-08-01T19:54:51.100 INFO:teuthology.orchestra.run.smithi101.stdout: "time": "2023-08-01T19:54:04.467201+0000", 2023-08-01T19:54:51.101 INFO:teuthology.orchestra.run.smithi101.stdout: "duration": 0.00020166199999999999 2023-08-01T19:54:51.101 INFO:teuthology.orchestra.run.smithi101.stdout: }, 2023-08-01T19:54:51.101 INFO:teuthology.orchestra.run.smithi101.stdout: { 2023-08-01T19:54:51.101 INFO:teuthology.orchestra.run.smithi101.stdout: "event": "waiting for subops from 2", 2023-08-01T19:54:51.101 INFO:teuthology.orchestra.run.smithi101.stdout: "time": "2023-08-01T19:54:04.467350+0000", 2023-08-01T19:54:51.101 INFO:teuthology.orchestra.run.smithi101.stdout: "duration": 0.000149173 2023-08-01T19:54:51.101 INFO:teuthology.orchestra.run.smithi101.stdout: }, 2023-08-01T19:54:51.102 INFO:teuthology.orchestra.run.smithi101.stdout: { 2023-08-01T19:54:51.102 INFO:teuthology.orchestra.run.smithi101.stdout: "event": "op_commit", 2023-08-01T19:54:51.102 INFO:teuthology.orchestra.run.smithi101.stdout: "time": "2023-08-01T19:54:04.476168+0000", 2023-08-01T19:54:51.102 INFO:teuthology.orchestra.run.smithi101.stdout: "duration": 0.0088183250000000001 2023-08-01T19:54:51.102 INFO:teuthology.orchestra.run.smithi101.stdout: }, 2023-08-01T19:54:51.102 INFO:teuthology.orchestra.run.smithi101.stdout: { 2023-08-01T19:54:51.102 INFO:teuthology.orchestra.run.smithi101.stdout: "event": "sub_op_commit_rec", 2023-08-01T19:54:51.102 INFO:teuthology.orchestra.run.smithi101.stdout: "time": "2023-08-01T19:54:04.476239+0000", 2023-08-01T19:54:51.103 INFO:teuthology.orchestra.run.smithi101.stdout: "duration": 7.1296000000000003e-05 2023-08-01T19:54:51.103 INFO:teuthology.orchestra.run.smithi101.stdout: }, 2023-08-01T19:54:51.103 INFO:teuthology.orchestra.run.smithi101.stdout: { 2023-08-01T19:54:51.103 INFO:teuthology.orchestra.run.smithi101.stdout: "event": "commit_sent", 2023-08-01T19:54:51.103 INFO:teuthology.orchestra.run.smithi101.stdout: "time": "2023-08-01T19:54:04.476290+0000", 2023-08-01T19:54:51.103 INFO:teuthology.orchestra.run.smithi101.stdout: "duration": 5.0423999999999997e-05 2023-08-01T19:54:51.103 INFO:teuthology.orchestra.run.smithi101.stdout: }, 2023-08-01T19:54:51.103 INFO:teuthology.orchestra.run.smithi101.stdout: { 2023-08-01T19:54:51.104 INFO:teuthology.orchestra.run.smithi101.stdout: "event": "done", 2023-08-01T19:54:51.104 INFO:teuthology.orchestra.run.smithi101.stdout: "time": "2023-08-01T19:54:04.476356+0000", 2023-08-01T19:54:51.104 INFO:teuthology.orchestra.run.smithi101.stdout: "duration": 6.6439000000000005e-05 2023-08-01T19:54:51.104 INFO:teuthology.orchestra.run.smithi101.stdout: } 2023-08-01T19:54:51.104 INFO:teuthology.orchestra.run.smithi101.stdout: ] 2023-08-01T19:54:51.104 INFO:teuthology.orchestra.run.smithi101.stdout: } 2023-08-01T19:54:51.104 INFO:teuthology.orchestra.run.smithi101.stdout: }, 2023-08-01T19:54:51.104 INFO:teuthology.orchestra.run.smithi101.stdout: { 2023-08-01T19:54:51.105 INFO:teuthology.orchestra.run.smithi101.stdout: "description": "osd_op(mds.0.3:7 3.10 3:0d82a743:::600.00000000:head [create,setxattr parent (62) in=6b,setxattr layout (30) in=6b] snapc 0=[] ondisk+write+known_if_redirected+full_force+supports_pool_eio e17)", 2023-08-01T19:54:51.105 INFO:teuthology.orchestra.run.smithi101.stdout: "initiated_at": "2023-08-01T19:54:04.458830+0000", 2023-08-01T19:54:51.105 INFO:teuthology.orchestra.run.smithi101.stdout: "age": 46.625625444000001, 2023-08-01T19:54:51.105 INFO:teuthology.orchestra.run.smithi101.stdout: "duration": 0.018463726, 2023-08-01T19:54:51.106 INFO:teuthology.orchestra.run.smithi101.stdout: "type_data": { 2023-08-01T19:54:51.106 INFO:teuthology.orchestra.run.smithi101.stdout: "flag_point": "commit sent; apply or cleanup", 2023-08-01T19:54:51.106 INFO:teuthology.orchestra.run.smithi101.stdout: "events": [ 2023-08-01T19:54:51.106 INFO:teuthology.orchestra.run.smithi101.stdout: { 2023-08-01T19:54:51.107 INFO:teuthology.orchestra.run.smithi101.stdout: "event": "initiated", 2023-08-01T19:54:51.107 INFO:teuthology.orchestra.run.smithi101.stdout: "time": "2023-08-01T19:54:04.458830+0000", 2023-08-01T19:54:51.107 INFO:teuthology.orchestra.run.smithi101.stdout: "duration": 0 2023-08-01T19:54:51.107 INFO:teuthology.orchestra.run.smithi101.stdout: }, 2023-08-01T19:54:51.107 INFO:teuthology.orchestra.run.smithi101.stdout: { 2023-08-01T19:54:51.107 INFO:teuthology.orchestra.run.smithi101.stdout: "event": "throttled", 2023-08-01T19:54:51.108 INFO:teuthology.orchestra.run.smithi101.stdout: "time": "2023-08-01T19:54:04.458830+0000", 2023-08-01T19:54:51.108 INFO:teuthology.orchestra.run.smithi101.stdout: "duration": 0 2023-08-01T19:54:51.108 INFO:teuthology.orchestra.run.smithi101.stdout: }, 2023-08-01T19:54:51.108 INFO:teuthology.orchestra.run.smithi101.stdout: { 2023-08-01T19:54:51.108 INFO:teuthology.orchestra.run.smithi101.stdout: "event": "header_read", 2023-08-01T19:54:51.108 INFO:teuthology.orchestra.run.smithi101.stdout: "time": "2023-08-01T19:54:04.458829+0000", 2023-08-01T19:54:51.108 INFO:teuthology.orchestra.run.smithi101.stdout: "duration": 4294967295.999999 2023-08-01T19:54:51.108 INFO:teuthology.orchestra.run.smithi101.stdout: }, 2023-08-01T19:54:51.109 INFO:teuthology.orchestra.run.smithi101.stdout: { 2023-08-01T19:54:51.109 INFO:teuthology.orchestra.run.smithi101.stdout: "event": "all_read", 2023-08-01T19:54:51.109 INFO:teuthology.orchestra.run.smithi101.stdout: "time": "2023-08-01T19:54:04.458838+0000", 2023-08-01T19:54:51.109 INFO:teuthology.orchestra.run.smithi101.stdout: "duration": 8.5369999999999997e-06 2023-08-01T19:54:51.109 INFO:teuthology.orchestra.run.smithi101.stdout: }, 2023-08-01T19:54:51.109 INFO:teuthology.orchestra.run.smithi101.stdout: { 2023-08-01T19:54:51.110 INFO:teuthology.orchestra.run.smithi101.stdout: "event": "dispatched", 2023-08-01T19:54:51.110 INFO:teuthology.orchestra.run.smithi101.stdout: "time": "2023-08-01T19:54:04.458850+0000", 2023-08-01T19:54:51.110 INFO:teuthology.orchestra.run.smithi101.stdout: "duration": 1.203e-05 2023-08-01T19:54:51.110 INFO:teuthology.orchestra.run.smithi101.stdout: }, 2023-08-01T19:54:51.110 INFO:teuthology.orchestra.run.smithi101.stdout: { 2023-08-01T19:54:51.110 INFO:teuthology.orchestra.run.smithi101.stdout: "event": "queued_for_pg", 2023-08-01T19:54:51.110 INFO:teuthology.orchestra.run.smithi101.stdout: "time": "2023-08-01T19:54:04.458859+0000", 2023-08-01T19:54:51.110 INFO:teuthology.orchestra.run.smithi101.stdout: "duration": 8.9889999999999998e-06 2023-08-01T19:54:51.111 INFO:teuthology.orchestra.run.smithi101.stdout: }, 2023-08-01T19:54:51.111 INFO:teuthology.orchestra.run.smithi101.stdout: { 2023-08-01T19:54:51.111 INFO:teuthology.orchestra.run.smithi101.stdout: "event": "reached_pg", 2023-08-01T19:54:51.111 INFO:teuthology.orchestra.run.smithi101.stdout: "time": "2023-08-01T19:54:04.458926+0000", 2023-08-01T19:54:51.111 INFO:teuthology.orchestra.run.smithi101.stdout: "duration": 6.6741000000000004e-05 2023-08-01T19:54:51.111 INFO:teuthology.orchestra.run.smithi101.stdout: }, 2023-08-01T19:54:51.111 INFO:teuthology.orchestra.run.smithi101.stdout: { 2023-08-01T19:54:51.111 INFO:teuthology.orchestra.run.smithi101.stdout: "event": "waiting_for_map not empty", 2023-08-01T19:54:51.112 INFO:teuthology.orchestra.run.smithi101.stdout: "time": "2023-08-01T19:54:04.458929+0000", 2023-08-01T19:54:51.112 INFO:teuthology.orchestra.run.smithi101.stdout: "duration": 3.303e-06 2023-08-01T19:54:51.112 INFO:teuthology.orchestra.run.smithi101.stdout: }, 2023-08-01T19:54:51.112 INFO:teuthology.orchestra.run.smithi101.stdout: { 2023-08-01T19:54:51.112 INFO:teuthology.orchestra.run.smithi101.stdout: "event": "reached_pg", 2023-08-01T19:54:51.112 INFO:teuthology.orchestra.run.smithi101.stdout: "time": "2023-08-01T19:54:04.468692+0000", 2023-08-01T19:54:51.112 INFO:teuthology.orchestra.run.smithi101.stdout: "duration": 0.0097635910000000003 2023-08-01T19:54:51.113 INFO:teuthology.orchestra.run.smithi101.stdout: }, 2023-08-01T19:54:51.113 INFO:teuthology.orchestra.run.smithi101.stdout: { 2023-08-01T19:54:51.113 INFO:teuthology.orchestra.run.smithi101.stdout: "event": "started", 2023-08-01T19:54:51.113 INFO:teuthology.orchestra.run.smithi101.stdout: "time": "2023-08-01T19:54:04.468774+0000", 2023-08-01T19:54:51.113 INFO:teuthology.orchestra.run.smithi101.stdout: "duration": 8.1092000000000002e-05 2023-08-01T19:54:51.113 INFO:teuthology.orchestra.run.smithi101.stdout: }, 2023-08-01T19:54:51.113 INFO:teuthology.orchestra.run.smithi101.stdout: { 2023-08-01T19:54:51.113 INFO:teuthology.orchestra.run.smithi101.stdout: "event": "waiting for subops from 2", 2023-08-01T19:54:51.114 INFO:teuthology.orchestra.run.smithi101.stdout: "time": "2023-08-01T19:54:04.468934+0000", 2023-08-01T19:54:51.114 INFO:teuthology.orchestra.run.smithi101.stdout: "duration": 0.000160027 2023-08-01T19:54:51.114 INFO:teuthology.orchestra.run.smithi101.stdout: }, 2023-08-01T19:54:51.114 INFO:teuthology.orchestra.run.smithi101.stdout: { 2023-08-01T19:54:51.114 INFO:teuthology.orchestra.run.smithi101.stdout: "event": "op_commit", 2023-08-01T19:54:51.114 INFO:teuthology.orchestra.run.smithi101.stdout: "time": "2023-08-01T19:54:04.476174+0000", 2023-08-01T19:54:51.114 INFO:teuthology.orchestra.run.smithi101.stdout: "duration": 0.0072400479999999998 2023-08-01T19:54:51.114 INFO:teuthology.orchestra.run.smithi101.stdout: }, 2023-08-01T19:54:51.115 INFO:teuthology.orchestra.run.smithi101.stdout: { 2023-08-01T19:54:51.115 INFO:teuthology.orchestra.run.smithi101.stdout: "event": "sub_op_commit_rec", 2023-08-01T19:54:51.115 INFO:teuthology.orchestra.run.smithi101.stdout: "time": "2023-08-01T19:54:04.477206+0000", 2023-08-01T19:54:51.115 INFO:teuthology.orchestra.run.smithi101.stdout: "duration": 0.0010318969999999999 2023-08-01T19:54:51.115 INFO:teuthology.orchestra.run.smithi101.stdout: }, 2023-08-01T19:54:51.115 INFO:teuthology.orchestra.run.smithi101.stdout: { 2023-08-01T19:54:51.115 INFO:teuthology.orchestra.run.smithi101.stdout: "event": "commit_sent", 2023-08-01T19:54:51.115 INFO:teuthology.orchestra.run.smithi101.stdout: "time": "2023-08-01T19:54:04.477257+0000", 2023-08-01T19:54:51.116 INFO:teuthology.orchestra.run.smithi101.stdout: "duration": 5.1156000000000003e-05 2023-08-01T19:54:51.116 INFO:teuthology.orchestra.run.smithi101.stdout: }, 2023-08-01T19:54:51.116 INFO:teuthology.orchestra.run.smithi101.stdout: { 2023-08-01T19:54:51.116 INFO:teuthology.orchestra.run.smithi101.stdout: "event": "done", 2023-08-01T19:54:51.116 INFO:teuthology.orchestra.run.smithi101.stdout: "time": "2023-08-01T19:54:04.477294+0000", 2023-08-01T19:54:51.116 INFO:teuthology.orchestra.run.smithi101.stdout: "duration": 3.7150000000000002e-05 2023-08-01T19:54:51.116 INFO:teuthology.orchestra.run.smithi101.stdout: } 2023-08-01T19:54:51.116 INFO:teuthology.orchestra.run.smithi101.stdout: ] 2023-08-01T19:54:51.117 INFO:teuthology.orchestra.run.smithi101.stdout: } 2023-08-01T19:54:51.117 INFO:teuthology.orchestra.run.smithi101.stdout: }, 2023-08-01T19:54:51.117 INFO:teuthology.orchestra.run.smithi101.stdout: { 2023-08-01T19:54:51.117 INFO:teuthology.orchestra.run.smithi101.stdout: "description": "osd_op(mds.0.3:8 3.10 3:09401a81:::601.00000000:head [omap-set-header] snapc 0=[] ondisk+write+known_if_redirected+full_force+supports_pool_eio e17)", 2023-08-01T19:54:51.117 INFO:teuthology.orchestra.run.smithi101.stdout: "initiated_at": "2023-08-01T19:54:04.458869+0000", 2023-08-01T19:54:51.117 INFO:teuthology.orchestra.run.smithi101.stdout: "age": 46.625586308000003, 2023-08-01T19:54:51.117 INFO:teuthology.orchestra.run.smithi101.stdout: "duration": 0.018528932000000001, 2023-08-01T19:54:51.117 INFO:teuthology.orchestra.run.smithi101.stdout: "type_data": { 2023-08-01T19:54:51.118 INFO:teuthology.orchestra.run.smithi101.stdout: "flag_point": "commit sent; apply or cleanup", 2023-08-01T19:54:51.118 INFO:teuthology.orchestra.run.smithi101.stdout: "events": [ 2023-08-01T19:54:51.118 INFO:teuthology.orchestra.run.smithi101.stdout: { 2023-08-01T19:54:51.118 INFO:teuthology.orchestra.run.smithi101.stdout: "event": "initiated", 2023-08-01T19:54:51.118 INFO:teuthology.orchestra.run.smithi101.stdout: "time": "2023-08-01T19:54:04.458869+0000", 2023-08-01T19:54:51.119 INFO:teuthology.orchestra.run.smithi101.stdout: "duration": 0 2023-08-01T19:54:51.119 INFO:teuthology.orchestra.run.smithi101.stdout: }, 2023-08-01T19:54:51.119 INFO:teuthology.orchestra.run.smithi101.stdout: { 2023-08-01T19:54:51.119 INFO:teuthology.orchestra.run.smithi101.stdout: "event": "throttled", 2023-08-01T19:54:51.119 INFO:teuthology.orchestra.run.smithi101.stdout: "time": "2023-08-01T19:54:04.458869+0000", 2023-08-01T19:54:51.119 INFO:teuthology.orchestra.run.smithi101.stdout: "duration": 0 2023-08-01T19:54:51.119 INFO:teuthology.orchestra.run.smithi101.stdout: }, 2023-08-01T19:54:51.120 INFO:teuthology.orchestra.run.smithi101.stdout: { 2023-08-01T19:54:51.120 INFO:teuthology.orchestra.run.smithi101.stdout: "event": "header_read", 2023-08-01T19:54:51.120 INFO:teuthology.orchestra.run.smithi101.stdout: "time": "2023-08-01T19:54:04.458869+0000", 2023-08-01T19:54:51.120 INFO:teuthology.orchestra.run.smithi101.stdout: "duration": 4294967295.9999995 2023-08-01T19:54:51.120 INFO:teuthology.orchestra.run.smithi101.stdout: }, 2023-08-01T19:54:51.120 INFO:teuthology.orchestra.run.smithi101.stdout: { 2023-08-01T19:54:51.120 INFO:teuthology.orchestra.run.smithi101.stdout: "event": "all_read", 2023-08-01T19:54:51.121 INFO:teuthology.orchestra.run.smithi101.stdout: "time": "2023-08-01T19:54:04.458878+0000", 2023-08-01T19:54:51.121 INFO:teuthology.orchestra.run.smithi101.stdout: "duration": 9.4110000000000002e-06 2023-08-01T19:54:51.121 INFO:teuthology.orchestra.run.smithi101.stdout: }, 2023-08-01T19:54:51.121 INFO:teuthology.orchestra.run.smithi101.stdout: { 2023-08-01T19:54:51.121 INFO:teuthology.orchestra.run.smithi101.stdout: "event": "dispatched", 2023-08-01T19:54:51.121 INFO:teuthology.orchestra.run.smithi101.stdout: "time": "2023-08-01T19:54:04.458886+0000", 2023-08-01T19:54:51.121 INFO:teuthology.orchestra.run.smithi101.stdout: "duration": 7.6090000000000003e-06 2023-08-01T19:54:51.121 INFO:teuthology.orchestra.run.smithi101.stdout: }, 2023-08-01T19:54:51.122 INFO:teuthology.orchestra.run.smithi101.stdout: { 2023-08-01T19:54:51.122 INFO:teuthology.orchestra.run.smithi101.stdout: "event": "queued_for_pg", 2023-08-01T19:54:51.122 INFO:teuthology.orchestra.run.smithi101.stdout: "time": "2023-08-01T19:54:04.458890+0000", 2023-08-01T19:54:51.122 INFO:teuthology.orchestra.run.smithi101.stdout: "duration": 4.8470000000000003e-06 2023-08-01T19:54:51.122 INFO:teuthology.orchestra.run.smithi101.stdout: }, 2023-08-01T19:54:51.122 INFO:teuthology.orchestra.run.smithi101.stdout: { 2023-08-01T19:54:51.122 INFO:teuthology.orchestra.run.smithi101.stdout: "event": "reached_pg", 2023-08-01T19:54:51.123 INFO:teuthology.orchestra.run.smithi101.stdout: "time": "2023-08-01T19:54:04.458957+0000", 2023-08-01T19:54:51.123 INFO:teuthology.orchestra.run.smithi101.stdout: "duration": 6.6502999999999997e-05 2023-08-01T19:54:51.123 INFO:teuthology.orchestra.run.smithi101.stdout: }, 2023-08-01T19:54:51.123 INFO:teuthology.orchestra.run.smithi101.stdout: { 2023-08-01T19:54:51.123 INFO:teuthology.orchestra.run.smithi101.stdout: "event": "waiting_for_map not empty", 2023-08-01T19:54:51.123 INFO:teuthology.orchestra.run.smithi101.stdout: "time": "2023-08-01T19:54:04.458959+0000", 2023-08-01T19:54:51.123 INFO:teuthology.orchestra.run.smithi101.stdout: "duration": 2.3989999999999998e-06 2023-08-01T19:54:51.123 INFO:teuthology.orchestra.run.smithi101.stdout: }, 2023-08-01T19:54:51.124 INFO:teuthology.orchestra.run.smithi101.stdout: { 2023-08-01T19:54:51.124 INFO:teuthology.orchestra.run.smithi101.stdout: "event": "reached_pg", 2023-08-01T19:54:51.124 INFO:teuthology.orchestra.run.smithi101.stdout: "time": "2023-08-01T19:54:04.469554+0000", 2023-08-01T19:54:51.124 INFO:teuthology.orchestra.run.smithi101.stdout: "duration": 0.010594404 2023-08-01T19:54:51.124 INFO:teuthology.orchestra.run.smithi101.stdout: }, 2023-08-01T19:54:51.124 INFO:teuthology.orchestra.run.smithi101.stdout: { 2023-08-01T19:54:51.124 INFO:teuthology.orchestra.run.smithi101.stdout: "event": "started", 2023-08-01T19:54:51.125 INFO:teuthology.orchestra.run.smithi101.stdout: "time": "2023-08-01T19:54:04.469694+0000", 2023-08-01T19:54:51.125 INFO:teuthology.orchestra.run.smithi101.stdout: "duration": 0.00014006899999999999 2023-08-01T19:54:51.125 INFO:teuthology.orchestra.run.smithi101.stdout: }, 2023-08-01T19:54:51.125 INFO:teuthology.orchestra.run.smithi101.stdout: { 2023-08-01T19:54:51.125 INFO:teuthology.orchestra.run.smithi101.stdout: "event": "waiting for subops from 2", 2023-08-01T19:54:51.125 INFO:teuthology.orchestra.run.smithi101.stdout: "time": "2023-08-01T19:54:04.469826+0000", 2023-08-01T19:54:51.125 INFO:teuthology.orchestra.run.smithi101.stdout: "duration": 0.000132285 2023-08-01T19:54:51.125 INFO:teuthology.orchestra.run.smithi101.stdout: }, 2023-08-01T19:54:51.126 INFO:teuthology.orchestra.run.smithi101.stdout: { 2023-08-01T19:54:51.126 INFO:teuthology.orchestra.run.smithi101.stdout: "event": "op_commit", 2023-08-01T19:54:51.126 INFO:teuthology.orchestra.run.smithi101.stdout: "time": "2023-08-01T19:54:04.476179+0000", 2023-08-01T19:54:51.126 INFO:teuthology.orchestra.run.smithi101.stdout: "duration": 0.0063524289999999997 2023-08-01T19:54:51.126 INFO:teuthology.orchestra.run.smithi101.stdout: }, 2023-08-01T19:54:51.126 INFO:teuthology.orchestra.run.smithi101.stdout: { 2023-08-01T19:54:51.126 INFO:teuthology.orchestra.run.smithi101.stdout: "event": "sub_op_commit_rec", 2023-08-01T19:54:51.127 INFO:teuthology.orchestra.run.smithi101.stdout: "time": "2023-08-01T19:54:04.477334+0000", 2023-08-01T19:54:51.127 INFO:teuthology.orchestra.run.smithi101.stdout: "duration": 0.0011551070000000001 2023-08-01T19:54:51.127 INFO:teuthology.orchestra.run.smithi101.stdout: }, 2023-08-01T19:54:51.127 INFO:teuthology.orchestra.run.smithi101.stdout: { 2023-08-01T19:54:51.127 INFO:teuthology.orchestra.run.smithi101.stdout: "event": "commit_sent", 2023-08-01T19:54:51.127 INFO:teuthology.orchestra.run.smithi101.stdout: "time": "2023-08-01T19:54:04.477371+0000", 2023-08-01T19:54:51.127 INFO:teuthology.orchestra.run.smithi101.stdout: "duration": 3.7425000000000002e-05 2023-08-01T19:54:51.127 INFO:teuthology.orchestra.run.smithi101.stdout: }, 2023-08-01T19:54:51.128 INFO:teuthology.orchestra.run.smithi101.stdout: { 2023-08-01T19:54:51.128 INFO:teuthology.orchestra.run.smithi101.stdout: "event": "done", 2023-08-01T19:54:51.128 INFO:teuthology.orchestra.run.smithi101.stdout: "time": "2023-08-01T19:54:04.477398+0000", 2023-08-01T19:54:51.128 INFO:teuthology.orchestra.run.smithi101.stdout: "duration": 2.7078000000000001e-05 2023-08-01T19:54:51.128 INFO:teuthology.orchestra.run.smithi101.stdout: } 2023-08-01T19:54:51.128 INFO:teuthology.orchestra.run.smithi101.stdout: ] 2023-08-01T19:54:51.128 INFO:teuthology.orchestra.run.smithi101.stdout: } 2023-08-01T19:54:51.129 INFO:teuthology.orchestra.run.smithi101.stdout: }, 2023-08-01T19:54:51.129 INFO:teuthology.orchestra.run.smithi101.stdout: { 2023-08-01T19:54:51.129 INFO:teuthology.orchestra.run.smithi101.stdout: "description": "osd_op(mds.0.3:9 3.10 3:09401a81:::601.00000000:head [create,setxattr parent (62) in=6b,setxattr layout (30) in=6b] snapc 0=[] ondisk+write+known_if_redirected+full_force+supports_pool_eio e17)", 2023-08-01T19:54:51.129 INFO:teuthology.orchestra.run.smithi101.stdout: "initiated_at": "2023-08-01T19:54:04.458896+0000", 2023-08-01T19:54:51.129 INFO:teuthology.orchestra.run.smithi101.stdout: "age": 46.625559140999997, 2023-08-01T19:54:51.129 INFO:teuthology.orchestra.run.smithi101.stdout: "duration": 0.018577215000000001, 2023-08-01T19:54:51.129 INFO:teuthology.orchestra.run.smithi101.stdout: "type_data": { 2023-08-01T19:54:51.129 INFO:teuthology.orchestra.run.smithi101.stdout: "flag_point": "commit sent; apply or cleanup", 2023-08-01T19:54:51.130 INFO:teuthology.orchestra.run.smithi101.stdout: "events": [ 2023-08-01T19:54:51.130 INFO:teuthology.orchestra.run.smithi101.stdout: { 2023-08-01T19:54:51.130 INFO:teuthology.orchestra.run.smithi101.stdout: "event": "initiated", 2023-08-01T19:54:51.130 INFO:teuthology.orchestra.run.smithi101.stdout: "time": "2023-08-01T19:54:04.458896+0000", 2023-08-01T19:54:51.130 INFO:teuthology.orchestra.run.smithi101.stdout: "duration": 0 2023-08-01T19:54:51.130 INFO:teuthology.orchestra.run.smithi101.stdout: }, 2023-08-01T19:54:51.130 INFO:teuthology.orchestra.run.smithi101.stdout: { 2023-08-01T19:54:51.130 INFO:teuthology.orchestra.run.smithi101.stdout: "event": "throttled", 2023-08-01T19:54:51.131 INFO:teuthology.orchestra.run.smithi101.stdout: "time": "2023-08-01T19:54:04.458896+0000", 2023-08-01T19:54:51.131 INFO:teuthology.orchestra.run.smithi101.stdout: "duration": 0 2023-08-01T19:54:51.131 INFO:teuthology.orchestra.run.smithi101.stdout: }, 2023-08-01T19:54:51.131 INFO:teuthology.orchestra.run.smithi101.stdout: { 2023-08-01T19:54:51.131 INFO:teuthology.orchestra.run.smithi101.stdout: "event": "header_read", 2023-08-01T19:54:51.131 INFO:teuthology.orchestra.run.smithi101.stdout: "time": "2023-08-01T19:54:04.458896+0000", 2023-08-01T19:54:51.131 INFO:teuthology.orchestra.run.smithi101.stdout: "duration": 4294967295.9999995 2023-08-01T19:54:51.132 INFO:teuthology.orchestra.run.smithi101.stdout: }, 2023-08-01T19:54:51.132 INFO:teuthology.orchestra.run.smithi101.stdout: { 2023-08-01T19:54:51.132 INFO:teuthology.orchestra.run.smithi101.stdout: "event": "all_read", 2023-08-01T19:54:51.132 INFO:teuthology.orchestra.run.smithi101.stdout: "time": "2023-08-01T19:54:04.458900+0000", 2023-08-01T19:54:51.132 INFO:teuthology.orchestra.run.smithi101.stdout: "duration": 4.0829999999999997e-06 2023-08-01T19:54:51.132 INFO:teuthology.orchestra.run.smithi101.stdout: }, 2023-08-01T19:54:51.132 INFO:teuthology.orchestra.run.smithi101.stdout: { 2023-08-01T19:54:51.133 INFO:teuthology.orchestra.run.smithi101.stdout: "event": "dispatched", 2023-08-01T19:54:51.133 INFO:teuthology.orchestra.run.smithi101.stdout: "time": "2023-08-01T19:54:04.458906+0000", 2023-08-01T19:54:51.133 INFO:teuthology.orchestra.run.smithi101.stdout: "duration": 6.4099999999999996e-06 2023-08-01T19:54:51.133 INFO:teuthology.orchestra.run.smithi101.stdout: }, 2023-08-01T19:54:51.133 INFO:teuthology.orchestra.run.smithi101.stdout: { 2023-08-01T19:54:51.133 INFO:teuthology.orchestra.run.smithi101.stdout: "event": "queued_for_pg", 2023-08-01T19:54:51.133 INFO:teuthology.orchestra.run.smithi101.stdout: "time": "2023-08-01T19:54:04.458911+0000", 2023-08-01T19:54:51.133 INFO:teuthology.orchestra.run.smithi101.stdout: "duration": 4.0500000000000002e-06 2023-08-01T19:54:51.134 INFO:teuthology.orchestra.run.smithi101.stdout: }, 2023-08-01T19:54:51.134 INFO:teuthology.orchestra.run.smithi101.stdout: { 2023-08-01T19:54:51.134 INFO:teuthology.orchestra.run.smithi101.stdout: "event": "reached_pg", 2023-08-01T19:54:51.134 INFO:teuthology.orchestra.run.smithi101.stdout: "time": "2023-08-01T19:54:04.458981+0000", 2023-08-01T19:54:51.134 INFO:teuthology.orchestra.run.smithi101.stdout: "duration": 7.0121000000000002e-05 2023-08-01T19:54:51.134 INFO:teuthology.orchestra.run.smithi101.stdout: }, 2023-08-01T19:54:51.134 INFO:teuthology.orchestra.run.smithi101.stdout: { 2023-08-01T19:54:51.134 INFO:teuthology.orchestra.run.smithi101.stdout: "event": "waiting_for_map not empty", 2023-08-01T19:54:51.135 INFO:teuthology.orchestra.run.smithi101.stdout: "time": "2023-08-01T19:54:04.458983+0000", 2023-08-01T19:54:51.135 INFO:teuthology.orchestra.run.smithi101.stdout: "duration": 2.2299999999999998e-06 2023-08-01T19:54:51.135 INFO:teuthology.orchestra.run.smithi101.stdout: }, 2023-08-01T19:54:51.135 INFO:teuthology.orchestra.run.smithi101.stdout: { 2023-08-01T19:54:51.135 INFO:teuthology.orchestra.run.smithi101.stdout: "event": "reached_pg", 2023-08-01T19:54:51.135 INFO:teuthology.orchestra.run.smithi101.stdout: "time": "2023-08-01T19:54:04.470122+0000", 2023-08-01T19:54:51.135 INFO:teuthology.orchestra.run.smithi101.stdout: "duration": 0.011139593999999999 2023-08-01T19:54:51.135 INFO:teuthology.orchestra.run.smithi101.stdout: }, 2023-08-01T19:54:51.136 INFO:teuthology.orchestra.run.smithi101.stdout: { 2023-08-01T19:54:51.136 INFO:teuthology.orchestra.run.smithi101.stdout: "event": "started", 2023-08-01T19:54:51.136 INFO:teuthology.orchestra.run.smithi101.stdout: "time": "2023-08-01T19:54:04.470217+0000", 2023-08-01T19:54:51.136 INFO:teuthology.orchestra.run.smithi101.stdout: "duration": 9.4388000000000005e-05 2023-08-01T19:54:51.136 INFO:teuthology.orchestra.run.smithi101.stdout: }, 2023-08-01T19:54:51.136 INFO:teuthology.orchestra.run.smithi101.stdout: { 2023-08-01T19:54:51.136 INFO:teuthology.orchestra.run.smithi101.stdout: "event": "waiting for subops from 2", 2023-08-01T19:54:51.137 INFO:teuthology.orchestra.run.smithi101.stdout: "time": "2023-08-01T19:54:04.470714+0000", 2023-08-01T19:54:51.137 INFO:teuthology.orchestra.run.smithi101.stdout: "duration": 0.00049680999999999998 2023-08-01T19:54:51.137 INFO:teuthology.orchestra.run.smithi101.stdout: }, 2023-08-01T19:54:51.137 INFO:teuthology.orchestra.run.smithi101.stdout: { 2023-08-01T19:54:51.137 INFO:teuthology.orchestra.run.smithi101.stdout: "event": "op_commit", 2023-08-01T19:54:51.137 INFO:teuthology.orchestra.run.smithi101.stdout: "time": "2023-08-01T19:54:04.476183+0000", 2023-08-01T19:54:51.137 INFO:teuthology.orchestra.run.smithi101.stdout: "duration": 0.0054695880000000001 2023-08-01T19:54:51.137 INFO:teuthology.orchestra.run.smithi101.stdout: }, 2023-08-01T19:54:51.138 INFO:teuthology.orchestra.run.smithi101.stdout: { 2023-08-01T19:54:51.138 INFO:teuthology.orchestra.run.smithi101.stdout: "event": "sub_op_commit_rec", 2023-08-01T19:54:51.138 INFO:teuthology.orchestra.run.smithi101.stdout: "time": "2023-08-01T19:54:04.477428+0000", 2023-08-01T19:54:51.138 INFO:teuthology.orchestra.run.smithi101.stdout: "duration": 0.001244843 2023-08-01T19:54:51.138 INFO:teuthology.orchestra.run.smithi101.stdout: }, 2023-08-01T19:54:51.138 INFO:teuthology.orchestra.run.smithi101.stdout: { 2023-08-01T19:54:51.138 INFO:teuthology.orchestra.run.smithi101.stdout: "event": "commit_sent", 2023-08-01T19:54:51.138 INFO:teuthology.orchestra.run.smithi101.stdout: "time": "2023-08-01T19:54:04.477456+0000", 2023-08-01T19:54:51.139 INFO:teuthology.orchestra.run.smithi101.stdout: "duration": 2.7538e-05 2023-08-01T19:54:51.139 INFO:teuthology.orchestra.run.smithi101.stdout: }, 2023-08-01T19:54:51.139 INFO:teuthology.orchestra.run.smithi101.stdout: { 2023-08-01T19:54:51.139 INFO:teuthology.orchestra.run.smithi101.stdout: "event": "done", 2023-08-01T19:54:51.139 INFO:teuthology.orchestra.run.smithi101.stdout: "time": "2023-08-01T19:54:04.477474+0000", 2023-08-01T19:54:51.139 INFO:teuthology.orchestra.run.smithi101.stdout: "duration": 1.7974000000000001e-05 2023-08-01T19:54:51.139 INFO:teuthology.orchestra.run.smithi101.stdout: } 2023-08-01T19:54:51.139 INFO:teuthology.orchestra.run.smithi101.stdout: ] 2023-08-01T19:54:51.140 INFO:teuthology.orchestra.run.smithi101.stdout: } 2023-08-01T19:54:51.140 INFO:teuthology.orchestra.run.smithi101.stdout: }, 2023-08-01T19:54:51.140 INFO:teuthology.orchestra.run.smithi101.stdout: { 2023-08-01T19:54:51.140 INFO:teuthology.orchestra.run.smithi101.stdout: "description": "osd_op(mds.0.3:10 3.10 3:0bd6d154:::602.00000000:head [omap-set-header] snapc 0=[] ondisk+write+known_if_redirected+full_force+supports_pool_eio e17)", 2023-08-01T19:54:51.140 INFO:teuthology.orchestra.run.smithi101.stdout: "initiated_at": "2023-08-01T19:54:04.458927+0000", 2023-08-01T19:54:51.140 INFO:teuthology.orchestra.run.smithi101.stdout: "age": 46.625528162999998, 2023-08-01T19:54:51.140 INFO:teuthology.orchestra.run.smithi101.stdout: "duration": 0.019574352, 2023-08-01T19:54:51.141 INFO:teuthology.orchestra.run.smithi101.stdout: "type_data": { 2023-08-01T19:54:51.141 INFO:teuthology.orchestra.run.smithi101.stdout: "flag_point": "commit sent; apply or cleanup", 2023-08-01T19:54:51.141 INFO:teuthology.orchestra.run.smithi101.stdout: "events": [ 2023-08-01T19:54:51.141 INFO:teuthology.orchestra.run.smithi101.stdout: { 2023-08-01T19:54:51.141 INFO:teuthology.orchestra.run.smithi101.stdout: "event": "initiated", 2023-08-01T19:54:51.141 INFO:teuthology.orchestra.run.smithi101.stdout: "time": "2023-08-01T19:54:04.458927+0000", 2023-08-01T19:54:51.141 INFO:teuthology.orchestra.run.smithi101.stdout: "duration": 0 2023-08-01T19:54:51.141 INFO:teuthology.orchestra.run.smithi101.stdout: }, 2023-08-01T19:54:51.142 INFO:teuthology.orchestra.run.smithi101.stdout: { 2023-08-01T19:54:51.142 INFO:teuthology.orchestra.run.smithi101.stdout: "event": "throttled", 2023-08-01T19:54:51.142 INFO:teuthology.orchestra.run.smithi101.stdout: "time": "2023-08-01T19:54:04.458927+0000", 2023-08-01T19:54:51.142 INFO:teuthology.orchestra.run.smithi101.stdout: "duration": 0 2023-08-01T19:54:51.142 INFO:teuthology.orchestra.run.smithi101.stdout: }, 2023-08-01T19:54:51.142 INFO:teuthology.orchestra.run.smithi101.stdout: { 2023-08-01T19:54:51.142 INFO:teuthology.orchestra.run.smithi101.stdout: "event": "header_read", 2023-08-01T19:54:51.142 INFO:teuthology.orchestra.run.smithi101.stdout: "time": "2023-08-01T19:54:04.458927+0000", 2023-08-01T19:54:51.143 INFO:teuthology.orchestra.run.smithi101.stdout: "duration": 4294967295.9999995 2023-08-01T19:54:51.143 INFO:teuthology.orchestra.run.smithi101.stdout: }, 2023-08-01T19:54:51.143 INFO:teuthology.orchestra.run.smithi101.stdout: { 2023-08-01T19:54:51.143 INFO:teuthology.orchestra.run.smithi101.stdout: "event": "all_read", 2023-08-01T19:54:51.143 INFO:teuthology.orchestra.run.smithi101.stdout: "time": "2023-08-01T19:54:04.458931+0000", 2023-08-01T19:54:51.143 INFO:teuthology.orchestra.run.smithi101.stdout: "duration": 4.3000000000000003e-06 2023-08-01T19:54:51.143 INFO:teuthology.orchestra.run.smithi101.stdout: }, 2023-08-01T19:54:51.144 INFO:teuthology.orchestra.run.smithi101.stdout: { 2023-08-01T19:54:51.144 INFO:teuthology.orchestra.run.smithi101.stdout: "event": "dispatched", 2023-08-01T19:54:51.144 INFO:teuthology.orchestra.run.smithi101.stdout: "time": "2023-08-01T19:54:04.458938+0000", 2023-08-01T19:54:51.144 INFO:teuthology.orchestra.run.smithi101.stdout: "duration": 7.3220000000000004e-06 2023-08-01T19:54:51.144 INFO:teuthology.orchestra.run.smithi101.stdout: }, 2023-08-01T19:54:51.144 INFO:teuthology.orchestra.run.smithi101.stdout: { 2023-08-01T19:54:51.144 INFO:teuthology.orchestra.run.smithi101.stdout: "event": "queued_for_pg", 2023-08-01T19:54:51.145 INFO:teuthology.orchestra.run.smithi101.stdout: "time": "2023-08-01T19:54:04.458944+0000", 2023-08-01T19:54:51.145 INFO:teuthology.orchestra.run.smithi101.stdout: "duration": 5.3040000000000004e-06 2023-08-01T19:54:51.145 INFO:teuthology.orchestra.run.smithi101.stdout: }, 2023-08-01T19:54:51.145 INFO:teuthology.orchestra.run.smithi101.stdout: { 2023-08-01T19:54:51.145 INFO:teuthology.orchestra.run.smithi101.stdout: "event": "reached_pg", 2023-08-01T19:54:51.145 INFO:teuthology.orchestra.run.smithi101.stdout: "time": "2023-08-01T19:54:04.459006+0000", 2023-08-01T19:54:51.145 INFO:teuthology.orchestra.run.smithi101.stdout: "duration": 6.2081000000000004e-05 2023-08-01T19:54:51.145 INFO:teuthology.orchestra.run.smithi101.stdout: }, 2023-08-01T19:54:51.146 INFO:teuthology.orchestra.run.smithi101.stdout: { 2023-08-01T19:54:51.146 INFO:teuthology.orchestra.run.smithi101.stdout: "event": "waiting_for_map not empty", 2023-08-01T19:54:51.146 INFO:teuthology.orchestra.run.smithi101.stdout: "time": "2023-08-01T19:54:04.459008+0000", 2023-08-01T19:54:51.146 INFO:teuthology.orchestra.run.smithi101.stdout: "duration": 2.2500000000000001e-06 2023-08-01T19:54:51.146 INFO:teuthology.orchestra.run.smithi101.stdout: }, 2023-08-01T19:54:51.146 INFO:teuthology.orchestra.run.smithi101.stdout: { 2023-08-01T19:54:51.146 INFO:teuthology.orchestra.run.smithi101.stdout: "event": "reached_pg", 2023-08-01T19:54:51.146 INFO:teuthology.orchestra.run.smithi101.stdout: "time": "2023-08-01T19:54:04.470946+0000", 2023-08-01T19:54:51.147 INFO:teuthology.orchestra.run.smithi101.stdout: "duration": 0.011938347 2023-08-01T19:54:51.147 INFO:teuthology.orchestra.run.smithi101.stdout: }, 2023-08-01T19:54:51.147 INFO:teuthology.orchestra.run.smithi101.stdout: { 2023-08-01T19:54:51.147 INFO:teuthology.orchestra.run.smithi101.stdout: "event": "started", 2023-08-01T19:54:51.147 INFO:teuthology.orchestra.run.smithi101.stdout: "time": "2023-08-01T19:54:04.471071+0000", 2023-08-01T19:54:51.147 INFO:teuthology.orchestra.run.smithi101.stdout: "duration": 0.00012470299999999999 2023-08-01T19:54:51.147 INFO:teuthology.orchestra.run.smithi101.stdout: }, 2023-08-01T19:54:51.148 INFO:teuthology.orchestra.run.smithi101.stdout: { 2023-08-01T19:54:51.148 INFO:teuthology.orchestra.run.smithi101.stdout: "event": "waiting for subops from 2", 2023-08-01T19:54:51.148 INFO:teuthology.orchestra.run.smithi101.stdout: "time": "2023-08-01T19:54:04.471205+0000", 2023-08-01T19:54:51.148 INFO:teuthology.orchestra.run.smithi101.stdout: "duration": 0.000133891 2023-08-01T19:54:51.148 INFO:teuthology.orchestra.run.smithi101.stdout: }, 2023-08-01T19:54:51.148 INFO:teuthology.orchestra.run.smithi101.stdout: { 2023-08-01T19:54:51.148 INFO:teuthology.orchestra.run.smithi101.stdout: "event": "op_commit", 2023-08-01T19:54:51.148 INFO:teuthology.orchestra.run.smithi101.stdout: "time": "2023-08-01T19:54:04.477042+0000", 2023-08-01T19:54:51.149 INFO:teuthology.orchestra.run.smithi101.stdout: "duration": 0.0058374849999999999 2023-08-01T19:54:51.149 INFO:teuthology.orchestra.run.smithi101.stdout: }, 2023-08-01T19:54:51.149 INFO:teuthology.orchestra.run.smithi101.stdout: { 2023-08-01T19:54:51.149 INFO:teuthology.orchestra.run.smithi101.stdout: "event": "sub_op_commit_rec", 2023-08-01T19:54:51.149 INFO:teuthology.orchestra.run.smithi101.stdout: "time": "2023-08-01T19:54:04.478445+0000", 2023-08-01T19:54:51.149 INFO:teuthology.orchestra.run.smithi101.stdout: "duration": 0.0014023239999999999 2023-08-01T19:54:51.149 INFO:teuthology.orchestra.run.smithi101.stdout: }, 2023-08-01T19:54:51.149 INFO:teuthology.orchestra.run.smithi101.stdout: { 2023-08-01T19:54:51.150 INFO:teuthology.orchestra.run.smithi101.stdout: "event": "commit_sent", 2023-08-01T19:54:51.150 INFO:teuthology.orchestra.run.smithi101.stdout: "time": "2023-08-01T19:54:04.478478+0000", 2023-08-01T19:54:51.150 INFO:teuthology.orchestra.run.smithi101.stdout: "duration": 3.3503000000000001e-05 2023-08-01T19:54:51.150 INFO:teuthology.orchestra.run.smithi101.stdout: }, 2023-08-01T19:54:51.150 INFO:teuthology.orchestra.run.smithi101.stdout: { 2023-08-01T19:54:51.150 INFO:teuthology.orchestra.run.smithi101.stdout: "event": "done", 2023-08-01T19:54:51.150 INFO:teuthology.orchestra.run.smithi101.stdout: "time": "2023-08-01T19:54:04.478502+0000", 2023-08-01T19:54:51.150 INFO:teuthology.orchestra.run.smithi101.stdout: "duration": 2.3402000000000001e-05 2023-08-01T19:54:51.151 INFO:teuthology.orchestra.run.smithi101.stdout: } 2023-08-01T19:54:51.151 INFO:teuthology.orchestra.run.smithi101.stdout: ] 2023-08-01T19:54:51.151 INFO:teuthology.orchestra.run.smithi101.stdout: } 2023-08-01T19:54:51.151 INFO:teuthology.orchestra.run.smithi101.stdout: }, 2023-08-01T19:54:51.151 INFO:teuthology.orchestra.run.smithi101.stdout: { 2023-08-01T19:54:51.151 INFO:teuthology.orchestra.run.smithi101.stdout: "description": "osd_op(mds.0.3:11 3.10 3:0bd6d154:::602.00000000:head [create,setxattr parent (62) in=6b,setxattr layout (30) in=6b] snapc 0=[] ondisk+write+known_if_redirected+full_force+supports_pool_eio e17)", 2023-08-01T19:54:51.151 INFO:teuthology.orchestra.run.smithi101.stdout: "initiated_at": "2023-08-01T19:54:04.458960+0000", 2023-08-01T19:54:51.151 INFO:teuthology.orchestra.run.smithi101.stdout: "age": 46.625495715, 2023-08-01T19:54:51.152 INFO:teuthology.orchestra.run.smithi101.stdout: "duration": 0.019645459000000001, 2023-08-01T19:54:51.152 INFO:teuthology.orchestra.run.smithi101.stdout: "type_data": { 2023-08-01T19:54:51.152 INFO:teuthology.orchestra.run.smithi101.stdout: "flag_point": "commit sent; apply or cleanup", 2023-08-01T19:54:51.152 INFO:teuthology.orchestra.run.smithi101.stdout: "events": [ 2023-08-01T19:54:51.152 INFO:teuthology.orchestra.run.smithi101.stdout: { 2023-08-01T19:54:51.152 INFO:teuthology.orchestra.run.smithi101.stdout: "event": "initiated", 2023-08-01T19:54:51.152 INFO:teuthology.orchestra.run.smithi101.stdout: "time": "2023-08-01T19:54:04.458960+0000", 2023-08-01T19:54:51.153 INFO:teuthology.orchestra.run.smithi101.stdout: "duration": 0 2023-08-01T19:54:51.153 INFO:teuthology.orchestra.run.smithi101.stdout: }, 2023-08-01T19:54:51.153 INFO:teuthology.orchestra.run.smithi101.stdout: { 2023-08-01T19:54:51.153 INFO:teuthology.orchestra.run.smithi101.stdout: "event": "throttled", 2023-08-01T19:54:51.153 INFO:teuthology.orchestra.run.smithi101.stdout: "time": "2023-08-01T19:54:04.458960+0000", 2023-08-01T19:54:51.153 INFO:teuthology.orchestra.run.smithi101.stdout: "duration": 0 2023-08-01T19:54:51.153 INFO:teuthology.orchestra.run.smithi101.stdout: }, 2023-08-01T19:54:51.154 INFO:teuthology.orchestra.run.smithi101.stdout: { 2023-08-01T19:54:51.154 INFO:teuthology.orchestra.run.smithi101.stdout: "event": "header_read", 2023-08-01T19:54:51.154 INFO:teuthology.orchestra.run.smithi101.stdout: "time": "2023-08-01T19:54:04.458959+0000", 2023-08-01T19:54:51.154 INFO:teuthology.orchestra.run.smithi101.stdout: "duration": 4294967295.9999995 2023-08-01T19:54:51.154 INFO:teuthology.orchestra.run.smithi101.stdout: }, 2023-08-01T19:54:51.154 INFO:teuthology.orchestra.run.smithi101.stdout: { 2023-08-01T19:54:51.154 INFO:teuthology.orchestra.run.smithi101.stdout: "event": "all_read", 2023-08-01T19:54:51.154 INFO:teuthology.orchestra.run.smithi101.stdout: "time": "2023-08-01T19:54:04.458963+0000", 2023-08-01T19:54:51.155 INFO:teuthology.orchestra.run.smithi101.stdout: "duration": 3.9199999999999997e-06 2023-08-01T19:54:51.155 INFO:teuthology.orchestra.run.smithi101.stdout: }, 2023-08-01T19:54:51.155 INFO:teuthology.orchestra.run.smithi101.stdout: { 2023-08-01T19:54:51.155 INFO:teuthology.orchestra.run.smithi101.stdout: "event": "dispatched", 2023-08-01T19:54:51.155 INFO:teuthology.orchestra.run.smithi101.stdout: "time": "2023-08-01T19:54:04.458970+0000", 2023-08-01T19:54:51.155 INFO:teuthology.orchestra.run.smithi101.stdout: "duration": 7.0439999999999998e-06 2023-08-01T19:54:51.155 INFO:teuthology.orchestra.run.smithi101.stdout: }, 2023-08-01T19:54:51.156 INFO:teuthology.orchestra.run.smithi101.stdout: { 2023-08-01T19:54:51.156 INFO:teuthology.orchestra.run.smithi101.stdout: "event": "queued_for_pg", 2023-08-01T19:54:51.156 INFO:teuthology.orchestra.run.smithi101.stdout: "time": "2023-08-01T19:54:04.458976+0000", 2023-08-01T19:54:51.156 INFO:teuthology.orchestra.run.smithi101.stdout: "duration": 5.9540000000000001e-06 2023-08-01T19:54:51.156 INFO:teuthology.orchestra.run.smithi101.stdout: }, 2023-08-01T19:54:51.156 INFO:teuthology.orchestra.run.smithi101.stdout: { 2023-08-01T19:54:51.156 INFO:teuthology.orchestra.run.smithi101.stdout: "event": "reached_pg", 2023-08-01T19:54:51.156 INFO:teuthology.orchestra.run.smithi101.stdout: "time": "2023-08-01T19:54:04.459035+0000", 2023-08-01T19:54:51.157 INFO:teuthology.orchestra.run.smithi101.stdout: "duration": 5.8924e-05 2023-08-01T19:54:51.157 INFO:teuthology.orchestra.run.smithi101.stdout: }, 2023-08-01T19:54:51.157 INFO:teuthology.orchestra.run.smithi101.stdout: { 2023-08-01T19:54:51.157 INFO:teuthology.orchestra.run.smithi101.stdout: "event": "waiting_for_map not empty", 2023-08-01T19:54:51.157 INFO:teuthology.orchestra.run.smithi101.stdout: "time": "2023-08-01T19:54:04.459038+0000", 2023-08-01T19:54:51.157 INFO:teuthology.orchestra.run.smithi101.stdout: "duration": 3.2760000000000001e-06 2023-08-01T19:54:51.157 INFO:teuthology.orchestra.run.smithi101.stdout: }, 2023-08-01T19:54:51.157 INFO:teuthology.orchestra.run.smithi101.stdout: { 2023-08-01T19:54:51.158 INFO:teuthology.orchestra.run.smithi101.stdout: "event": "reached_pg", 2023-08-01T19:54:51.158 INFO:teuthology.orchestra.run.smithi101.stdout: "time": "2023-08-01T19:54:04.471511+0000", 2023-08-01T19:54:51.158 INFO:teuthology.orchestra.run.smithi101.stdout: "duration": 0.012473039999999999 2023-08-01T19:54:51.158 INFO:teuthology.orchestra.run.smithi101.stdout: }, 2023-08-01T19:54:51.158 INFO:teuthology.orchestra.run.smithi101.stdout: { 2023-08-01T19:54:51.158 INFO:teuthology.orchestra.run.smithi101.stdout: "event": "started", 2023-08-01T19:54:51.158 INFO:teuthology.orchestra.run.smithi101.stdout: "time": "2023-08-01T19:54:04.472086+0000", 2023-08-01T19:54:51.159 INFO:teuthology.orchestra.run.smithi101.stdout: "duration": 0.00057491699999999998 2023-08-01T19:54:51.159 INFO:teuthology.orchestra.run.smithi101.stdout: }, 2023-08-01T19:54:51.159 INFO:teuthology.orchestra.run.smithi101.stdout: { 2023-08-01T19:54:51.159 INFO:teuthology.orchestra.run.smithi101.stdout: "event": "waiting for subops from 2", 2023-08-01T19:54:51.159 INFO:teuthology.orchestra.run.smithi101.stdout: "time": "2023-08-01T19:54:04.472310+0000", 2023-08-01T19:54:51.159 INFO:teuthology.orchestra.run.smithi101.stdout: "duration": 0.00022396499999999999 2023-08-01T19:54:51.159 INFO:teuthology.orchestra.run.smithi101.stdout: }, 2023-08-01T19:54:51.159 INFO:teuthology.orchestra.run.smithi101.stdout: { 2023-08-01T19:54:51.160 INFO:teuthology.orchestra.run.smithi101.stdout: "event": "op_commit", 2023-08-01T19:54:51.160 INFO:teuthology.orchestra.run.smithi101.stdout: "time": "2023-08-01T19:54:04.478141+0000", 2023-08-01T19:54:51.160 INFO:teuthology.orchestra.run.smithi101.stdout: "duration": 0.0058312320000000004 2023-08-01T19:54:51.160 INFO:teuthology.orchestra.run.smithi101.stdout: }, 2023-08-01T19:54:51.160 INFO:teuthology.orchestra.run.smithi101.stdout: { 2023-08-01T19:54:51.160 INFO:teuthology.orchestra.run.smithi101.stdout: "event": "sub_op_commit_rec", 2023-08-01T19:54:51.160 INFO:teuthology.orchestra.run.smithi101.stdout: "time": "2023-08-01T19:54:04.478543+0000", 2023-08-01T19:54:51.161 INFO:teuthology.orchestra.run.smithi101.stdout: "duration": 0.00040160800000000002 2023-08-01T19:54:51.161 INFO:teuthology.orchestra.run.smithi101.stdout: }, 2023-08-01T19:54:51.161 INFO:teuthology.orchestra.run.smithi101.stdout: { 2023-08-01T19:54:51.161 INFO:teuthology.orchestra.run.smithi101.stdout: "event": "commit_sent", 2023-08-01T19:54:51.161 INFO:teuthology.orchestra.run.smithi101.stdout: "time": "2023-08-01T19:54:04.478584+0000", 2023-08-01T19:54:51.161 INFO:teuthology.orchestra.run.smithi101.stdout: "duration": 4.0989999999999999e-05 2023-08-01T19:54:51.161 INFO:teuthology.orchestra.run.smithi101.stdout: }, 2023-08-01T19:54:51.162 INFO:teuthology.orchestra.run.smithi101.stdout: { 2023-08-01T19:54:51.162 INFO:teuthology.orchestra.run.smithi101.stdout: "event": "done", 2023-08-01T19:54:51.162 INFO:teuthology.orchestra.run.smithi101.stdout: "time": "2023-08-01T19:54:04.478605+0000", 2023-08-01T19:54:51.162 INFO:teuthology.orchestra.run.smithi101.stdout: "duration": 2.1178e-05 2023-08-01T19:54:51.162 INFO:teuthology.orchestra.run.smithi101.stdout: } 2023-08-01T19:54:51.162 INFO:teuthology.orchestra.run.smithi101.stdout: ] 2023-08-01T19:54:51.162 INFO:teuthology.orchestra.run.smithi101.stdout: } 2023-08-01T19:54:51.162 INFO:teuthology.orchestra.run.smithi101.stdout: }, 2023-08-01T19:54:51.163 INFO:teuthology.orchestra.run.smithi101.stdout: { 2023-08-01T19:54:51.163 INFO:teuthology.orchestra.run.smithi101.stdout: "description": "osd_op(mds.0.3:12 3.10 3:0d89b25e:::603.00000000:head [omap-set-header] snapc 0=[] ondisk+write+known_if_redirected+full_force+supports_pool_eio e17)", 2023-08-01T19:54:51.163 INFO:teuthology.orchestra.run.smithi101.stdout: "initiated_at": "2023-08-01T19:54:04.458982+0000", 2023-08-01T19:54:51.163 INFO:teuthology.orchestra.run.smithi101.stdout: "age": 46.625473487000001, 2023-08-01T19:54:51.163 INFO:teuthology.orchestra.run.smithi101.stdout: "duration": 0.021266334000000001, 2023-08-01T19:54:51.163 INFO:teuthology.orchestra.run.smithi101.stdout: "type_data": { 2023-08-01T19:54:51.163 INFO:teuthology.orchestra.run.smithi101.stdout: "flag_point": "commit sent; apply or cleanup", 2023-08-01T19:54:51.164 INFO:teuthology.orchestra.run.smithi101.stdout: "events": [ 2023-08-01T19:54:51.164 INFO:teuthology.orchestra.run.smithi101.stdout: { 2023-08-01T19:54:51.164 INFO:teuthology.orchestra.run.smithi101.stdout: "event": "initiated", 2023-08-01T19:54:51.164 INFO:teuthology.orchestra.run.smithi101.stdout: "time": "2023-08-01T19:54:04.458982+0000", 2023-08-01T19:54:51.164 INFO:teuthology.orchestra.run.smithi101.stdout: "duration": 0 2023-08-01T19:54:51.164 INFO:teuthology.orchestra.run.smithi101.stdout: }, 2023-08-01T19:54:51.164 INFO:teuthology.orchestra.run.smithi101.stdout: { 2023-08-01T19:54:51.165 INFO:teuthology.orchestra.run.smithi101.stdout: "event": "throttled", 2023-08-01T19:54:51.165 INFO:teuthology.orchestra.run.smithi101.stdout: "time": "2023-08-01T19:54:04.458982+0000", 2023-08-01T19:54:51.165 INFO:teuthology.orchestra.run.smithi101.stdout: "duration": 0 2023-08-01T19:54:51.165 INFO:teuthology.orchestra.run.smithi101.stdout: }, 2023-08-01T19:54:51.165 INFO:teuthology.orchestra.run.smithi101.stdout: { 2023-08-01T19:54:51.165 INFO:teuthology.orchestra.run.smithi101.stdout: "event": "header_read", 2023-08-01T19:54:51.165 INFO:teuthology.orchestra.run.smithi101.stdout: "time": "2023-08-01T19:54:04.458982+0000", 2023-08-01T19:54:51.165 INFO:teuthology.orchestra.run.smithi101.stdout: "duration": 4294967295.9999995 2023-08-01T19:54:51.166 INFO:teuthology.orchestra.run.smithi101.stdout: }, 2023-08-01T19:54:51.166 INFO:teuthology.orchestra.run.smithi101.stdout: { 2023-08-01T19:54:51.166 INFO:teuthology.orchestra.run.smithi101.stdout: "event": "all_read", 2023-08-01T19:54:51.166 INFO:teuthology.orchestra.run.smithi101.stdout: "time": "2023-08-01T19:54:04.458985+0000", 2023-08-01T19:54:51.166 INFO:teuthology.orchestra.run.smithi101.stdout: "duration": 3.4800000000000001e-06 2023-08-01T19:54:51.166 INFO:teuthology.orchestra.run.smithi101.stdout: }, 2023-08-01T19:54:51.166 INFO:teuthology.orchestra.run.smithi101.stdout: { 2023-08-01T19:54:51.166 INFO:teuthology.orchestra.run.smithi101.stdout: "event": "dispatched", 2023-08-01T19:54:51.167 INFO:teuthology.orchestra.run.smithi101.stdout: "time": "2023-08-01T19:54:04.458992+0000", 2023-08-01T19:54:51.167 INFO:teuthology.orchestra.run.smithi101.stdout: "duration": 7.306e-06 2023-08-01T19:54:51.167 INFO:teuthology.orchestra.run.smithi101.stdout: }, 2023-08-01T19:54:51.167 INFO:teuthology.orchestra.run.smithi101.stdout: { 2023-08-01T19:54:51.167 INFO:teuthology.orchestra.run.smithi101.stdout: "event": "queued_for_pg", 2023-08-01T19:54:51.167 INFO:teuthology.orchestra.run.smithi101.stdout: "time": "2023-08-01T19:54:04.458997+0000", 2023-08-01T19:54:51.167 INFO:teuthology.orchestra.run.smithi101.stdout: "duration": 4.4530000000000004e-06 2023-08-01T19:54:51.167 INFO:teuthology.orchestra.run.smithi101.stdout: }, 2023-08-01T19:54:51.168 INFO:teuthology.orchestra.run.smithi101.stdout: { 2023-08-01T19:54:51.168 INFO:teuthology.orchestra.run.smithi101.stdout: "event": "reached_pg", 2023-08-01T19:54:51.168 INFO:teuthology.orchestra.run.smithi101.stdout: "time": "2023-08-01T19:54:04.459060+0000", 2023-08-01T19:54:51.168 INFO:teuthology.orchestra.run.smithi101.stdout: "duration": 6.3249000000000004e-05 2023-08-01T19:54:51.168 INFO:teuthology.orchestra.run.smithi101.stdout: }, 2023-08-01T19:54:51.168 INFO:teuthology.orchestra.run.smithi101.stdout: { 2023-08-01T19:54:51.168 INFO:teuthology.orchestra.run.smithi101.stdout: "event": "waiting_for_map not empty", 2023-08-01T19:54:51.168 INFO:teuthology.orchestra.run.smithi101.stdout: "time": "2023-08-01T19:54:04.459063+0000", 2023-08-01T19:54:51.169 INFO:teuthology.orchestra.run.smithi101.stdout: "duration": 2.717e-06 2023-08-01T19:54:51.169 INFO:teuthology.orchestra.run.smithi101.stdout: }, 2023-08-01T19:54:51.169 INFO:teuthology.orchestra.run.smithi101.stdout: { 2023-08-01T19:54:51.169 INFO:teuthology.orchestra.run.smithi101.stdout: "event": "reached_pg", 2023-08-01T19:54:51.169 INFO:teuthology.orchestra.run.smithi101.stdout: "time": "2023-08-01T19:54:04.473625+0000", 2023-08-01T19:54:51.169 INFO:teuthology.orchestra.run.smithi101.stdout: "duration": 0.014562007 2023-08-01T19:54:51.169 INFO:teuthology.orchestra.run.smithi101.stdout: }, 2023-08-01T19:54:51.170 INFO:teuthology.orchestra.run.smithi101.stdout: { 2023-08-01T19:54:51.170 INFO:teuthology.orchestra.run.smithi101.stdout: "event": "started", 2023-08-01T19:54:51.170 INFO:teuthology.orchestra.run.smithi101.stdout: "time": "2023-08-01T19:54:04.473757+0000", 2023-08-01T19:54:51.170 INFO:teuthology.orchestra.run.smithi101.stdout: "duration": 0.00013238599999999999 2023-08-01T19:54:51.170 INFO:teuthology.orchestra.run.smithi101.stdout: }, 2023-08-01T19:54:51.170 INFO:teuthology.orchestra.run.smithi101.stdout: { 2023-08-01T19:54:51.170 INFO:teuthology.orchestra.run.smithi101.stdout: "event": "waiting for subops from 2", 2023-08-01T19:54:51.170 INFO:teuthology.orchestra.run.smithi101.stdout: "time": "2023-08-01T19:54:04.473898+0000", 2023-08-01T19:54:51.171 INFO:teuthology.orchestra.run.smithi101.stdout: "duration": 0.00014039 2023-08-01T19:54:51.171 INFO:teuthology.orchestra.run.smithi101.stdout: }, 2023-08-01T19:54:51.171 INFO:teuthology.orchestra.run.smithi101.stdout: { 2023-08-01T19:54:51.171 INFO:teuthology.orchestra.run.smithi101.stdout: "event": "op_commit", 2023-08-01T19:54:51.171 INFO:teuthology.orchestra.run.smithi101.stdout: "time": "2023-08-01T19:54:04.478380+0000", 2023-08-01T19:54:51.171 INFO:teuthology.orchestra.run.smithi101.stdout: "duration": 0.0044827449999999998 2023-08-01T19:54:51.171 INFO:teuthology.orchestra.run.smithi101.stdout: }, 2023-08-01T19:54:51.171 INFO:teuthology.orchestra.run.smithi101.stdout: { 2023-08-01T19:54:51.172 INFO:teuthology.orchestra.run.smithi101.stdout: "event": "sub_op_commit_rec", 2023-08-01T19:54:51.172 INFO:teuthology.orchestra.run.smithi101.stdout: "time": "2023-08-01T19:54:04.480169+0000", 2023-08-01T19:54:51.172 INFO:teuthology.orchestra.run.smithi101.stdout: "duration": 0.0017886040000000001 2023-08-01T19:54:51.172 INFO:teuthology.orchestra.run.smithi101.stdout: }, 2023-08-01T19:54:51.172 INFO:teuthology.orchestra.run.smithi101.stdout: { 2023-08-01T19:54:51.172 INFO:teuthology.orchestra.run.smithi101.stdout: "event": "commit_sent", 2023-08-01T19:54:51.172 INFO:teuthology.orchestra.run.smithi101.stdout: "time": "2023-08-01T19:54:04.480212+0000", 2023-08-01T19:54:51.172 INFO:teuthology.orchestra.run.smithi101.stdout: "duration": 4.2687e-05 2023-08-01T19:54:51.173 INFO:teuthology.orchestra.run.smithi101.stdout: }, 2023-08-01T19:54:51.173 INFO:teuthology.orchestra.run.smithi101.stdout: { 2023-08-01T19:54:51.173 INFO:teuthology.orchestra.run.smithi101.stdout: "event": "done", 2023-08-01T19:54:51.173 INFO:teuthology.orchestra.run.smithi101.stdout: "time": "2023-08-01T19:54:04.480248+0000", 2023-08-01T19:54:51.173 INFO:teuthology.orchestra.run.smithi101.stdout: "duration": 3.6743999999999999e-05 2023-08-01T19:54:51.173 INFO:teuthology.orchestra.run.smithi101.stdout: } 2023-08-01T19:54:51.173 INFO:teuthology.orchestra.run.smithi101.stdout: ] 2023-08-01T19:54:51.174 INFO:teuthology.orchestra.run.smithi101.stdout: } 2023-08-01T19:54:51.174 INFO:teuthology.orchestra.run.smithi101.stdout: }, 2023-08-01T19:54:51.174 INFO:teuthology.orchestra.run.smithi101.stdout: { 2023-08-01T19:54:51.174 INFO:teuthology.orchestra.run.smithi101.stdout: "description": "osd_op(mds.0.3:13 3.10 3:0d89b25e:::603.00000000:head [create,setxattr parent (62) in=6b,setxattr layout (30) in=6b] snapc 0=[] ondisk+write+known_if_redirected+full_force+supports_pool_eio e17)", 2023-08-01T19:54:51.174 INFO:teuthology.orchestra.run.smithi101.stdout: "initiated_at": "2023-08-01T19:54:04.459010+0000", 2023-08-01T19:54:51.174 INFO:teuthology.orchestra.run.smithi101.stdout: "age": 46.625445767000002, 2023-08-01T19:54:51.174 INFO:teuthology.orchestra.run.smithi101.stdout: "duration": 0.021327220000000001, 2023-08-01T19:54:51.174 INFO:teuthology.orchestra.run.smithi101.stdout: "type_data": { 2023-08-01T19:54:51.175 INFO:teuthology.orchestra.run.smithi101.stdout: "flag_point": "commit sent; apply or cleanup", 2023-08-01T19:54:51.175 INFO:teuthology.orchestra.run.smithi101.stdout: "events": [ 2023-08-01T19:54:51.175 INFO:teuthology.orchestra.run.smithi101.stdout: { 2023-08-01T19:54:51.175 INFO:teuthology.orchestra.run.smithi101.stdout: "event": "initiated", 2023-08-01T19:54:51.175 INFO:teuthology.orchestra.run.smithi101.stdout: "time": "2023-08-01T19:54:04.459010+0000", 2023-08-01T19:54:51.175 INFO:teuthology.orchestra.run.smithi101.stdout: "duration": 0 2023-08-01T19:54:51.175 INFO:teuthology.orchestra.run.smithi101.stdout: }, 2023-08-01T19:54:51.175 INFO:teuthology.orchestra.run.smithi101.stdout: { 2023-08-01T19:54:51.176 INFO:teuthology.orchestra.run.smithi101.stdout: "event": "throttled", 2023-08-01T19:54:51.176 INFO:teuthology.orchestra.run.smithi101.stdout: "time": "2023-08-01T19:54:04.459010+0000", 2023-08-01T19:54:51.176 INFO:teuthology.orchestra.run.smithi101.stdout: "duration": 0 2023-08-01T19:54:51.176 INFO:teuthology.orchestra.run.smithi101.stdout: }, 2023-08-01T19:54:51.176 INFO:teuthology.orchestra.run.smithi101.stdout: { 2023-08-01T19:54:51.176 INFO:teuthology.orchestra.run.smithi101.stdout: "event": "header_read", 2023-08-01T19:54:51.176 INFO:teuthology.orchestra.run.smithi101.stdout: "time": "2023-08-01T19:54:04.459009+0000", 2023-08-01T19:54:51.176 INFO:teuthology.orchestra.run.smithi101.stdout: "duration": 4294967295.9999995 2023-08-01T19:54:51.177 INFO:teuthology.orchestra.run.smithi101.stdout: }, 2023-08-01T19:54:51.177 INFO:teuthology.orchestra.run.smithi101.stdout: { 2023-08-01T19:54:51.177 INFO:teuthology.orchestra.run.smithi101.stdout: "event": "all_read", 2023-08-01T19:54:51.177 INFO:teuthology.orchestra.run.smithi101.stdout: "time": "2023-08-01T19:54:04.459013+0000", 2023-08-01T19:54:51.177 INFO:teuthology.orchestra.run.smithi101.stdout: "duration": 3.8929999999999998e-06 2023-08-01T19:54:51.177 INFO:teuthology.orchestra.run.smithi101.stdout: }, 2023-08-01T19:54:51.177 INFO:teuthology.orchestra.run.smithi101.stdout: { 2023-08-01T19:54:51.178 INFO:teuthology.orchestra.run.smithi101.stdout: "event": "dispatched", 2023-08-01T19:54:51.178 INFO:teuthology.orchestra.run.smithi101.stdout: "time": "2023-08-01T19:54:04.459027+0000", 2023-08-01T19:54:51.178 INFO:teuthology.orchestra.run.smithi101.stdout: "duration": 1.3416e-05 2023-08-01T19:54:51.178 INFO:teuthology.orchestra.run.smithi101.stdout: }, 2023-08-01T19:54:51.178 INFO:teuthology.orchestra.run.smithi101.stdout: { 2023-08-01T19:54:51.178 INFO:teuthology.orchestra.run.smithi101.stdout: "event": "queued_for_pg", 2023-08-01T19:54:51.178 INFO:teuthology.orchestra.run.smithi101.stdout: "time": "2023-08-01T19:54:04.459033+0000", 2023-08-01T19:54:51.178 INFO:teuthology.orchestra.run.smithi101.stdout: "duration": 5.9800000000000003e-06 2023-08-01T19:54:51.179 INFO:teuthology.orchestra.run.smithi101.stdout: }, 2023-08-01T19:54:51.179 INFO:teuthology.orchestra.run.smithi101.stdout: { 2023-08-01T19:54:51.179 INFO:teuthology.orchestra.run.smithi101.stdout: "event": "reached_pg", 2023-08-01T19:54:51.179 INFO:teuthology.orchestra.run.smithi101.stdout: "time": "2023-08-01T19:54:04.459099+0000", 2023-08-01T19:54:51.179 INFO:teuthology.orchestra.run.smithi101.stdout: "duration": 6.6192999999999995e-05 2023-08-01T19:54:51.179 INFO:teuthology.orchestra.run.smithi101.stdout: }, 2023-08-01T19:54:51.179 INFO:teuthology.orchestra.run.smithi101.stdout: { 2023-08-01T19:54:51.179 INFO:teuthology.orchestra.run.smithi101.stdout: "event": "waiting_for_map not empty", 2023-08-01T19:54:51.180 INFO:teuthology.orchestra.run.smithi101.stdout: "time": "2023-08-01T19:54:04.459106+0000", 2023-08-01T19:54:51.180 INFO:teuthology.orchestra.run.smithi101.stdout: "duration": 6.8619999999999997e-06 2023-08-01T19:54:51.180 INFO:teuthology.orchestra.run.smithi101.stdout: }, 2023-08-01T19:54:51.180 INFO:teuthology.orchestra.run.smithi101.stdout: { 2023-08-01T19:54:51.180 INFO:teuthology.orchestra.run.smithi101.stdout: "event": "reached_pg", 2023-08-01T19:54:51.180 INFO:teuthology.orchestra.run.smithi101.stdout: "time": "2023-08-01T19:54:04.475182+0000", 2023-08-01T19:54:51.180 INFO:teuthology.orchestra.run.smithi101.stdout: "duration": 0.016076333000000002 2023-08-01T19:54:51.180 INFO:teuthology.orchestra.run.smithi101.stdout: }, 2023-08-01T19:54:51.181 INFO:teuthology.orchestra.run.smithi101.stdout: { 2023-08-01T19:54:51.181 INFO:teuthology.orchestra.run.smithi101.stdout: "event": "started", 2023-08-01T19:54:51.181 INFO:teuthology.orchestra.run.smithi101.stdout: "time": "2023-08-01T19:54:04.475353+0000", 2023-08-01T19:54:51.181 INFO:teuthology.orchestra.run.smithi101.stdout: "duration": 0.000171378 2023-08-01T19:54:51.181 INFO:teuthology.orchestra.run.smithi101.stdout: }, 2023-08-01T19:54:51.181 INFO:teuthology.orchestra.run.smithi101.stdout: { 2023-08-01T19:54:51.181 INFO:teuthology.orchestra.run.smithi101.stdout: "event": "waiting for subops from 2", 2023-08-01T19:54:51.181 INFO:teuthology.orchestra.run.smithi101.stdout: "time": "2023-08-01T19:54:04.475793+0000", 2023-08-01T19:54:51.182 INFO:teuthology.orchestra.run.smithi101.stdout: "duration": 0.000440123 2023-08-01T19:54:51.182 INFO:teuthology.orchestra.run.smithi101.stdout: }, 2023-08-01T19:54:51.182 INFO:teuthology.orchestra.run.smithi101.stdout: { 2023-08-01T19:54:51.182 INFO:teuthology.orchestra.run.smithi101.stdout: "event": "op_commit", 2023-08-01T19:54:51.182 INFO:teuthology.orchestra.run.smithi101.stdout: "time": "2023-08-01T19:54:04.478624+0000", 2023-08-01T19:54:51.182 INFO:teuthology.orchestra.run.smithi101.stdout: "duration": 0.0028305000000000001 2023-08-01T19:54:51.182 INFO:teuthology.orchestra.run.smithi101.stdout: }, 2023-08-01T19:54:51.183 INFO:teuthology.orchestra.run.smithi101.stdout: { 2023-08-01T19:54:51.183 INFO:teuthology.orchestra.run.smithi101.stdout: "event": "sub_op_commit_rec", 2023-08-01T19:54:51.183 INFO:teuthology.orchestra.run.smithi101.stdout: "time": "2023-08-01T19:54:04.480291+0000", 2023-08-01T19:54:51.183 INFO:teuthology.orchestra.run.smithi101.stdout: "duration": 0.0016670000000000001 2023-08-01T19:54:51.183 INFO:teuthology.orchestra.run.smithi101.stdout: }, 2023-08-01T19:54:51.183 INFO:teuthology.orchestra.run.smithi101.stdout: { 2023-08-01T19:54:51.183 INFO:teuthology.orchestra.run.smithi101.stdout: "event": "commit_sent", 2023-08-01T19:54:51.183 INFO:teuthology.orchestra.run.smithi101.stdout: "time": "2023-08-01T19:54:04.480318+0000", 2023-08-01T19:54:51.184 INFO:teuthology.orchestra.run.smithi101.stdout: "duration": 2.6815e-05 2023-08-01T19:54:51.184 INFO:teuthology.orchestra.run.smithi101.stdout: }, 2023-08-01T19:54:51.184 INFO:teuthology.orchestra.run.smithi101.stdout: { 2023-08-01T19:54:51.184 INFO:teuthology.orchestra.run.smithi101.stdout: "event": "done", 2023-08-01T19:54:51.184 INFO:teuthology.orchestra.run.smithi101.stdout: "time": "2023-08-01T19:54:04.480337+0000", 2023-08-01T19:54:51.184 INFO:teuthology.orchestra.run.smithi101.stdout: "duration": 1.9241000000000001e-05 2023-08-01T19:54:51.184 INFO:teuthology.orchestra.run.smithi101.stdout: } 2023-08-01T19:54:51.184 INFO:teuthology.orchestra.run.smithi101.stdout: ] 2023-08-01T19:54:51.185 INFO:teuthology.orchestra.run.smithi101.stdout: } 2023-08-01T19:54:51.185 INFO:teuthology.orchestra.run.smithi101.stdout: }, 2023-08-01T19:54:51.185 INFO:teuthology.orchestra.run.smithi101.stdout: { 2023-08-01T19:54:51.185 INFO:teuthology.orchestra.run.smithi101.stdout: "description": "osd_op(mds.0.3:18 3.14 3:2f55791f:::606.00000000:head [omap-set-header] snapc 0=[] ondisk+write+known_if_redirected+full_force+supports_pool_eio e17)", 2023-08-01T19:54:51.185 INFO:teuthology.orchestra.run.smithi101.stdout: "initiated_at": "2023-08-01T19:54:04.459039+0000", 2023-08-01T19:54:51.185 INFO:teuthology.orchestra.run.smithi101.stdout: "age": 46.625416473000001, 2023-08-01T19:54:51.185 INFO:teuthology.orchestra.run.smithi101.stdout: "duration": 0.018756419, 2023-08-01T19:54:51.185 INFO:teuthology.orchestra.run.smithi101.stdout: "type_data": { 2023-08-01T19:54:51.186 INFO:teuthology.orchestra.run.smithi101.stdout: "flag_point": "commit sent; apply or cleanup", 2023-08-01T19:54:51.186 INFO:teuthology.orchestra.run.smithi101.stdout: "events": [ 2023-08-01T19:54:51.186 INFO:teuthology.orchestra.run.smithi101.stdout: { 2023-08-01T19:54:51.186 INFO:teuthology.orchestra.run.smithi101.stdout: "event": "initiated", 2023-08-01T19:54:51.186 INFO:teuthology.orchestra.run.smithi101.stdout: "time": "2023-08-01T19:54:04.459039+0000", 2023-08-01T19:54:51.186 INFO:teuthology.orchestra.run.smithi101.stdout: "duration": 0 2023-08-01T19:54:51.186 INFO:teuthology.orchestra.run.smithi101.stdout: }, 2023-08-01T19:54:51.186 INFO:teuthology.orchestra.run.smithi101.stdout: { 2023-08-01T19:54:51.187 INFO:teuthology.orchestra.run.smithi101.stdout: "event": "throttled", 2023-08-01T19:54:51.187 INFO:teuthology.orchestra.run.smithi101.stdout: "time": "2023-08-01T19:54:04.459039+0000", 2023-08-01T19:54:51.187 INFO:teuthology.orchestra.run.smithi101.stdout: "duration": 0 2023-08-01T19:54:51.187 INFO:teuthology.orchestra.run.smithi101.stdout: }, 2023-08-01T19:54:51.187 INFO:teuthology.orchestra.run.smithi101.stdout: { 2023-08-01T19:54:51.187 INFO:teuthology.orchestra.run.smithi101.stdout: "event": "header_read", 2023-08-01T19:54:51.187 INFO:teuthology.orchestra.run.smithi101.stdout: "time": "2023-08-01T19:54:04.459039+0000", 2023-08-01T19:54:51.187 INFO:teuthology.orchestra.run.smithi101.stdout: "duration": 4294967295.9999995 2023-08-01T19:54:51.188 INFO:teuthology.orchestra.run.smithi101.stdout: }, 2023-08-01T19:54:51.188 INFO:teuthology.orchestra.run.smithi101.stdout: { 2023-08-01T19:54:51.188 INFO:teuthology.orchestra.run.smithi101.stdout: "event": "all_read", 2023-08-01T19:54:51.188 INFO:teuthology.orchestra.run.smithi101.stdout: "time": "2023-08-01T19:54:04.459043+0000", 2023-08-01T19:54:51.188 INFO:teuthology.orchestra.run.smithi101.stdout: "duration": 4.1500000000000001e-06 2023-08-01T19:54:51.188 INFO:teuthology.orchestra.run.smithi101.stdout: }, 2023-08-01T19:54:51.188 INFO:teuthology.orchestra.run.smithi101.stdout: { 2023-08-01T19:54:51.189 INFO:teuthology.orchestra.run.smithi101.stdout: "event": "dispatched", 2023-08-01T19:54:51.189 INFO:teuthology.orchestra.run.smithi101.stdout: "time": "2023-08-01T19:54:04.459051+0000", 2023-08-01T19:54:51.189 INFO:teuthology.orchestra.run.smithi101.stdout: "duration": 8.4190000000000002e-06 2023-08-01T19:54:51.189 INFO:teuthology.orchestra.run.smithi101.stdout: }, 2023-08-01T19:54:51.189 INFO:teuthology.orchestra.run.smithi101.stdout: { 2023-08-01T19:54:51.189 INFO:teuthology.orchestra.run.smithi101.stdout: "event": "queued_for_pg", 2023-08-01T19:54:51.189 INFO:teuthology.orchestra.run.smithi101.stdout: "time": "2023-08-01T19:54:04.459056+0000", 2023-08-01T19:54:51.189 INFO:teuthology.orchestra.run.smithi101.stdout: "duration": 5.339e-06 2023-08-01T19:54:51.190 INFO:teuthology.orchestra.run.smithi101.stdout: }, 2023-08-01T19:54:51.190 INFO:teuthology.orchestra.run.smithi101.stdout: { 2023-08-01T19:54:51.190 INFO:teuthology.orchestra.run.smithi101.stdout: "event": "reached_pg", 2023-08-01T19:54:51.190 INFO:teuthology.orchestra.run.smithi101.stdout: "time": "2023-08-01T19:54:04.459091+0000", 2023-08-01T19:54:51.190 INFO:teuthology.orchestra.run.smithi101.stdout: "duration": 3.4090000000000001e-05 2023-08-01T19:54:51.190 INFO:teuthology.orchestra.run.smithi101.stdout: }, 2023-08-01T19:54:51.190 INFO:teuthology.orchestra.run.smithi101.stdout: { 2023-08-01T19:54:51.190 INFO:teuthology.orchestra.run.smithi101.stdout: "event": "op must wait for map", 2023-08-01T19:54:51.191 INFO:teuthology.orchestra.run.smithi101.stdout: "time": "2023-08-01T19:54:04.459094+0000", 2023-08-01T19:54:51.191 INFO:teuthology.orchestra.run.smithi101.stdout: "duration": 3.303e-06 2023-08-01T19:54:51.191 INFO:teuthology.orchestra.run.smithi101.stdout: }, 2023-08-01T19:54:51.191 INFO:teuthology.orchestra.run.smithi101.stdout: { 2023-08-01T19:54:51.191 INFO:teuthology.orchestra.run.smithi101.stdout: "event": "reached_pg", 2023-08-01T19:54:51.191 INFO:teuthology.orchestra.run.smithi101.stdout: "time": "2023-08-01T19:54:04.469860+0000", 2023-08-01T19:54:51.191 INFO:teuthology.orchestra.run.smithi101.stdout: "duration": 0.010765749 2023-08-01T19:54:51.191 INFO:teuthology.orchestra.run.smithi101.stdout: }, 2023-08-01T19:54:51.192 INFO:teuthology.orchestra.run.smithi101.stdout: { 2023-08-01T19:54:51.192 INFO:teuthology.orchestra.run.smithi101.stdout: "event": "started", 2023-08-01T19:54:51.192 INFO:teuthology.orchestra.run.smithi101.stdout: "time": "2023-08-01T19:54:04.470008+0000", 2023-08-01T19:54:51.192 INFO:teuthology.orchestra.run.smithi101.stdout: "duration": 0.000148367 2023-08-01T19:54:51.192 INFO:teuthology.orchestra.run.smithi101.stdout: }, 2023-08-01T19:54:51.192 INFO:teuthology.orchestra.run.smithi101.stdout: { 2023-08-01T19:54:51.192 INFO:teuthology.orchestra.run.smithi101.stdout: "event": "waiting for subops from 2", 2023-08-01T19:54:51.193 INFO:teuthology.orchestra.run.smithi101.stdout: "time": "2023-08-01T19:54:04.470136+0000", 2023-08-01T19:54:51.193 INFO:teuthology.orchestra.run.smithi101.stdout: "duration": 0.000128329 2023-08-01T19:54:51.193 INFO:teuthology.orchestra.run.smithi101.stdout: }, 2023-08-01T19:54:51.193 INFO:teuthology.orchestra.run.smithi101.stdout: { 2023-08-01T19:54:51.193 INFO:teuthology.orchestra.run.smithi101.stdout: "event": "op_commit", 2023-08-01T19:54:51.193 INFO:teuthology.orchestra.run.smithi101.stdout: "time": "2023-08-01T19:54:04.476399+0000", 2023-08-01T19:54:51.193 INFO:teuthology.orchestra.run.smithi101.stdout: "duration": 0.0062627259999999997 2023-08-01T19:54:51.193 INFO:teuthology.orchestra.run.smithi101.stdout: }, 2023-08-01T19:54:51.194 INFO:teuthology.orchestra.run.smithi101.stdout: { 2023-08-01T19:54:51.194 INFO:teuthology.orchestra.run.smithi101.stdout: "event": "sub_op_commit_rec", 2023-08-01T19:54:51.194 INFO:teuthology.orchestra.run.smithi101.stdout: "time": "2023-08-01T19:54:04.477726+0000", 2023-08-01T19:54:51.194 INFO:teuthology.orchestra.run.smithi101.stdout: "duration": 0.001327103 2023-08-01T19:54:51.194 INFO:teuthology.orchestra.run.smithi101.stdout: }, 2023-08-01T19:54:51.194 INFO:teuthology.orchestra.run.smithi101.stdout: { 2023-08-01T19:54:51.194 INFO:teuthology.orchestra.run.smithi101.stdout: "event": "commit_sent", 2023-08-01T19:54:51.194 INFO:teuthology.orchestra.run.smithi101.stdout: "time": "2023-08-01T19:54:04.477771+0000", 2023-08-01T19:54:51.195 INFO:teuthology.orchestra.run.smithi101.stdout: "duration": 4.5232000000000003e-05 2023-08-01T19:54:51.195 INFO:teuthology.orchestra.run.smithi101.stdout: }, 2023-08-01T19:54:51.195 INFO:teuthology.orchestra.run.smithi101.stdout: { 2023-08-01T19:54:51.195 INFO:teuthology.orchestra.run.smithi101.stdout: "event": "done", 2023-08-01T19:54:51.195 INFO:teuthology.orchestra.run.smithi101.stdout: "time": "2023-08-01T19:54:04.477795+0000", 2023-08-01T19:54:51.195 INFO:teuthology.orchestra.run.smithi101.stdout: "duration": 2.4134999999999998e-05 2023-08-01T19:54:51.195 INFO:teuthology.orchestra.run.smithi101.stdout: } 2023-08-01T19:54:51.196 INFO:teuthology.orchestra.run.smithi101.stdout: ] 2023-08-01T19:54:51.196 INFO:teuthology.orchestra.run.smithi101.stdout: } 2023-08-01T19:54:51.196 INFO:teuthology.orchestra.run.smithi101.stdout: }, 2023-08-01T19:54:51.196 INFO:teuthology.orchestra.run.smithi101.stdout: { 2023-08-01T19:54:51.196 INFO:teuthology.orchestra.run.smithi101.stdout: "description": "osd_op(mds.0.3:19 3.14 3:2f55791f:::606.00000000:head [create,setxattr parent (62) in=6b,setxattr layout (30) in=6b] snapc 0=[] ondisk+write+known_if_redirected+full_force+supports_pool_eio e17)", 2023-08-01T19:54:51.196 INFO:teuthology.orchestra.run.smithi101.stdout: "initiated_at": "2023-08-01T19:54:04.459069+0000", 2023-08-01T19:54:51.196 INFO:teuthology.orchestra.run.smithi101.stdout: "age": 46.625386438, 2023-08-01T19:54:51.196 INFO:teuthology.orchestra.run.smithi101.stdout: "duration": 0.019523045999999999, 2023-08-01T19:54:51.197 INFO:teuthology.orchestra.run.smithi101.stdout: "type_data": { 2023-08-01T19:54:51.197 INFO:teuthology.orchestra.run.smithi101.stdout: "flag_point": "commit sent; apply or cleanup", 2023-08-01T19:54:51.197 INFO:teuthology.orchestra.run.smithi101.stdout: "events": [ 2023-08-01T19:54:51.197 INFO:teuthology.orchestra.run.smithi101.stdout: { 2023-08-01T19:54:51.197 INFO:teuthology.orchestra.run.smithi101.stdout: "event": "initiated", 2023-08-01T19:54:51.197 INFO:teuthology.orchestra.run.smithi101.stdout: "time": "2023-08-01T19:54:04.459069+0000", 2023-08-01T19:54:51.197 INFO:teuthology.orchestra.run.smithi101.stdout: "duration": 0 2023-08-01T19:54:51.197 INFO:teuthology.orchestra.run.smithi101.stdout: }, 2023-08-01T19:54:51.198 INFO:teuthology.orchestra.run.smithi101.stdout: { 2023-08-01T19:54:51.198 INFO:teuthology.orchestra.run.smithi101.stdout: "event": "throttled", 2023-08-01T19:54:51.198 INFO:teuthology.orchestra.run.smithi101.stdout: "time": "2023-08-01T19:54:04.459069+0000", 2023-08-01T19:54:51.198 INFO:teuthology.orchestra.run.smithi101.stdout: "duration": 0 2023-08-01T19:54:51.198 INFO:teuthology.orchestra.run.smithi101.stdout: }, 2023-08-01T19:54:51.198 INFO:teuthology.orchestra.run.smithi101.stdout: { 2023-08-01T19:54:51.198 INFO:teuthology.orchestra.run.smithi101.stdout: "event": "header_read", 2023-08-01T19:54:51.199 INFO:teuthology.orchestra.run.smithi101.stdout: "time": "2023-08-01T19:54:04.459069+0000", 2023-08-01T19:54:51.199 INFO:teuthology.orchestra.run.smithi101.stdout: "duration": 4294967295.9999995 2023-08-01T19:54:51.199 INFO:teuthology.orchestra.run.smithi101.stdout: }, 2023-08-01T19:54:51.199 INFO:teuthology.orchestra.run.smithi101.stdout: { 2023-08-01T19:54:51.199 INFO:teuthology.orchestra.run.smithi101.stdout: "event": "all_read", 2023-08-01T19:54:51.199 INFO:teuthology.orchestra.run.smithi101.stdout: "time": "2023-08-01T19:54:04.459072+0000", 2023-08-01T19:54:51.199 INFO:teuthology.orchestra.run.smithi101.stdout: "duration": 3.4570000000000001e-06 2023-08-01T19:54:51.199 INFO:teuthology.orchestra.run.smithi101.stdout: }, 2023-08-01T19:54:51.200 INFO:teuthology.orchestra.run.smithi101.stdout: { 2023-08-01T19:54:51.200 INFO:teuthology.orchestra.run.smithi101.stdout: "event": "dispatched", 2023-08-01T19:54:51.200 INFO:teuthology.orchestra.run.smithi101.stdout: "time": "2023-08-01T19:54:04.459080+0000", 2023-08-01T19:54:51.200 INFO:teuthology.orchestra.run.smithi101.stdout: "duration": 7.6009999999999997e-06 2023-08-01T19:54:51.200 INFO:teuthology.orchestra.run.smithi101.stdout: }, 2023-08-01T19:54:51.200 INFO:teuthology.orchestra.run.smithi101.stdout: { 2023-08-01T19:54:51.200 INFO:teuthology.orchestra.run.smithi101.stdout: "event": "queued_for_pg", 2023-08-01T19:54:51.200 INFO:teuthology.orchestra.run.smithi101.stdout: "time": "2023-08-01T19:54:04.459088+0000", 2023-08-01T19:54:51.201 INFO:teuthology.orchestra.run.smithi101.stdout: "duration": 8.0509999999999997e-06 2023-08-01T19:54:51.201 INFO:teuthology.orchestra.run.smithi101.stdout: }, 2023-08-01T19:54:51.201 INFO:teuthology.orchestra.run.smithi101.stdout: { 2023-08-01T19:54:51.201 INFO:teuthology.orchestra.run.smithi101.stdout: "event": "reached_pg", 2023-08-01T19:54:51.201 INFO:teuthology.orchestra.run.smithi101.stdout: "time": "2023-08-01T19:54:04.459120+0000", 2023-08-01T19:54:51.201 INFO:teuthology.orchestra.run.smithi101.stdout: "duration": 3.2078e-05 2023-08-01T19:54:51.201 INFO:teuthology.orchestra.run.smithi101.stdout: }, 2023-08-01T19:54:51.201 INFO:teuthology.orchestra.run.smithi101.stdout: { 2023-08-01T19:54:51.202 INFO:teuthology.orchestra.run.smithi101.stdout: "event": "waiting_for_map not empty", 2023-08-01T19:54:51.202 INFO:teuthology.orchestra.run.smithi101.stdout: "time": "2023-08-01T19:54:04.459123+0000", 2023-08-01T19:54:51.202 INFO:teuthology.orchestra.run.smithi101.stdout: "duration": 3.4699999999999998e-06 2023-08-01T19:54:51.202 INFO:teuthology.orchestra.run.smithi101.stdout: }, 2023-08-01T19:54:51.202 INFO:teuthology.orchestra.run.smithi101.stdout: { 2023-08-01T19:54:51.202 INFO:teuthology.orchestra.run.smithi101.stdout: "event": "reached_pg", 2023-08-01T19:54:51.202 INFO:teuthology.orchestra.run.smithi101.stdout: "time": "2023-08-01T19:54:04.471352+0000", 2023-08-01T19:54:51.203 INFO:teuthology.orchestra.run.smithi101.stdout: "duration": 0.01222926 2023-08-01T19:54:51.203 INFO:teuthology.orchestra.run.smithi101.stdout: }, 2023-08-01T19:54:51.203 INFO:teuthology.orchestra.run.smithi101.stdout: { 2023-08-01T19:54:51.203 INFO:teuthology.orchestra.run.smithi101.stdout: "event": "started", 2023-08-01T19:54:51.203 INFO:teuthology.orchestra.run.smithi101.stdout: "time": "2023-08-01T19:54:04.471495+0000", 2023-08-01T19:54:51.203 INFO:teuthology.orchestra.run.smithi101.stdout: "duration": 0.00014263899999999999 2023-08-01T19:54:51.203 INFO:teuthology.orchestra.run.smithi101.stdout: }, 2023-08-01T19:54:51.203 INFO:teuthology.orchestra.run.smithi101.stdout: { 2023-08-01T19:54:51.204 INFO:teuthology.orchestra.run.smithi101.stdout: "event": "waiting for subops from 2", 2023-08-01T19:54:51.204 INFO:teuthology.orchestra.run.smithi101.stdout: "time": "2023-08-01T19:54:04.472368+0000", 2023-08-01T19:54:51.204 INFO:teuthology.orchestra.run.smithi101.stdout: "duration": 0.00087245300000000003 2023-08-01T19:54:51.204 INFO:teuthology.orchestra.run.smithi101.stdout: }, 2023-08-01T19:54:51.204 INFO:teuthology.orchestra.run.smithi101.stdout: { 2023-08-01T19:54:51.204 INFO:teuthology.orchestra.run.smithi101.stdout: "event": "op_commit", 2023-08-01T19:54:51.204 INFO:teuthology.orchestra.run.smithi101.stdout: "time": "2023-08-01T19:54:04.477612+0000", 2023-08-01T19:54:51.204 INFO:teuthology.orchestra.run.smithi101.stdout: "duration": 0.0052442809999999999 2023-08-01T19:54:51.205 INFO:teuthology.orchestra.run.smithi101.stdout: }, 2023-08-01T19:54:51.205 INFO:teuthology.orchestra.run.smithi101.stdout: { 2023-08-01T19:54:51.205 INFO:teuthology.orchestra.run.smithi101.stdout: "event": "sub_op_commit_rec", 2023-08-01T19:54:51.205 INFO:teuthology.orchestra.run.smithi101.stdout: "time": "2023-08-01T19:54:04.478516+0000", 2023-08-01T19:54:51.205 INFO:teuthology.orchestra.run.smithi101.stdout: "duration": 0.00090399800000000004 2023-08-01T19:54:51.205 INFO:teuthology.orchestra.run.smithi101.stdout: }, 2023-08-01T19:54:51.205 INFO:teuthology.orchestra.run.smithi101.stdout: { 2023-08-01T19:54:51.206 INFO:teuthology.orchestra.run.smithi101.stdout: "event": "commit_sent", 2023-08-01T19:54:51.206 INFO:teuthology.orchestra.run.smithi101.stdout: "time": "2023-08-01T19:54:04.478555+0000", 2023-08-01T19:54:51.206 INFO:teuthology.orchestra.run.smithi101.stdout: "duration": 3.8977000000000003e-05 2023-08-01T19:54:51.206 INFO:teuthology.orchestra.run.smithi101.stdout: }, 2023-08-01T19:54:51.206 INFO:teuthology.orchestra.run.smithi101.stdout: { 2023-08-01T19:54:51.206 INFO:teuthology.orchestra.run.smithi101.stdout: "event": "done", 2023-08-01T19:54:51.206 INFO:teuthology.orchestra.run.smithi101.stdout: "time": "2023-08-01T19:54:04.478592+0000", 2023-08-01T19:54:51.206 INFO:teuthology.orchestra.run.smithi101.stdout: "duration": 3.7287999999999999e-05 2023-08-01T19:54:51.207 INFO:teuthology.orchestra.run.smithi101.stdout: } 2023-08-01T19:54:51.207 INFO:teuthology.orchestra.run.smithi101.stdout: ] 2023-08-01T19:54:51.207 INFO:teuthology.orchestra.run.smithi101.stdout: } 2023-08-01T19:54:51.207 INFO:teuthology.orchestra.run.smithi101.stdout: }, 2023-08-01T19:54:51.207 INFO:teuthology.orchestra.run.smithi101.stdout: { 2023-08-01T19:54:51.207 INFO:teuthology.orchestra.run.smithi101.stdout: "description": "osd_op(mds.0.3:20 3.1c 3:3ed09add:::607.00000000:head [omap-set-header] snapc 0=[] ondisk+write+known_if_redirected+full_force+supports_pool_eio e17)", 2023-08-01T19:54:51.207 INFO:teuthology.orchestra.run.smithi101.stdout: "initiated_at": "2023-08-01T19:54:04.459097+0000", 2023-08-01T19:54:51.207 INFO:teuthology.orchestra.run.smithi101.stdout: "age": 46.625358734000002, 2023-08-01T19:54:51.208 INFO:teuthology.orchestra.run.smithi101.stdout: "duration": 0.018578978999999999, 2023-08-01T19:54:51.208 INFO:teuthology.orchestra.run.smithi101.stdout: "type_data": { 2023-08-01T19:54:51.208 INFO:teuthology.orchestra.run.smithi101.stdout: "flag_point": "commit sent; apply or cleanup", 2023-08-01T19:54:51.208 INFO:teuthology.orchestra.run.smithi101.stdout: "events": [ 2023-08-01T19:54:51.208 INFO:teuthology.orchestra.run.smithi101.stdout: { 2023-08-01T19:54:51.208 INFO:teuthology.orchestra.run.smithi101.stdout: "event": "initiated", 2023-08-01T19:54:51.208 INFO:teuthology.orchestra.run.smithi101.stdout: "time": "2023-08-01T19:54:04.459097+0000", 2023-08-01T19:54:51.209 INFO:teuthology.orchestra.run.smithi101.stdout: "duration": 0 2023-08-01T19:54:51.209 INFO:teuthology.orchestra.run.smithi101.stdout: }, 2023-08-01T19:54:51.209 INFO:teuthology.orchestra.run.smithi101.stdout: { 2023-08-01T19:54:51.209 INFO:teuthology.orchestra.run.smithi101.stdout: "event": "throttled", 2023-08-01T19:54:51.209 INFO:teuthology.orchestra.run.smithi101.stdout: "time": "2023-08-01T19:54:04.459097+0000", 2023-08-01T19:54:51.209 INFO:teuthology.orchestra.run.smithi101.stdout: "duration": 0 2023-08-01T19:54:51.209 INFO:teuthology.orchestra.run.smithi101.stdout: }, 2023-08-01T19:54:51.209 INFO:teuthology.orchestra.run.smithi101.stdout: { 2023-08-01T19:54:51.210 INFO:teuthology.orchestra.run.smithi101.stdout: "event": "header_read", 2023-08-01T19:54:51.210 INFO:teuthology.orchestra.run.smithi101.stdout: "time": "2023-08-01T19:54:04.459096+0000", 2023-08-01T19:54:51.210 INFO:teuthology.orchestra.run.smithi101.stdout: "duration": 4294967295.9999995 2023-08-01T19:54:51.210 INFO:teuthology.orchestra.run.smithi101.stdout: }, 2023-08-01T19:54:51.210 INFO:teuthology.orchestra.run.smithi101.stdout: { 2023-08-01T19:54:51.210 INFO:teuthology.orchestra.run.smithi101.stdout: "event": "all_read", 2023-08-01T19:54:51.210 INFO:teuthology.orchestra.run.smithi101.stdout: "time": "2023-08-01T19:54:04.459105+0000", 2023-08-01T19:54:51.211 INFO:teuthology.orchestra.run.smithi101.stdout: "duration": 8.8259999999999999e-06 2023-08-01T19:54:51.211 INFO:teuthology.orchestra.run.smithi101.stdout: }, 2023-08-01T19:54:51.211 INFO:teuthology.orchestra.run.smithi101.stdout: { 2023-08-01T19:54:51.211 INFO:teuthology.orchestra.run.smithi101.stdout: "event": "dispatched", 2023-08-01T19:54:51.211 INFO:teuthology.orchestra.run.smithi101.stdout: "time": "2023-08-01T19:54:04.459112+0000", 2023-08-01T19:54:51.211 INFO:teuthology.orchestra.run.smithi101.stdout: "duration": 6.6660000000000002e-06 2023-08-01T19:54:51.211 INFO:teuthology.orchestra.run.smithi101.stdout: }, 2023-08-01T19:54:51.211 INFO:teuthology.orchestra.run.smithi101.stdout: { 2023-08-01T19:54:51.212 INFO:teuthology.orchestra.run.smithi101.stdout: "event": "queued_for_pg", 2023-08-01T19:54:51.212 INFO:teuthology.orchestra.run.smithi101.stdout: "time": "2023-08-01T19:54:04.459116+0000", 2023-08-01T19:54:51.212 INFO:teuthology.orchestra.run.smithi101.stdout: "duration": 4.2209999999999999e-06 2023-08-01T19:54:51.212 INFO:teuthology.orchestra.run.smithi101.stdout: }, 2023-08-01T19:54:51.212 INFO:teuthology.orchestra.run.smithi101.stdout: { 2023-08-01T19:54:51.212 INFO:teuthology.orchestra.run.smithi101.stdout: "event": "reached_pg", 2023-08-01T19:54:51.212 INFO:teuthology.orchestra.run.smithi101.stdout: "time": "2023-08-01T19:54:04.459141+0000", 2023-08-01T19:54:51.213 INFO:teuthology.orchestra.run.smithi101.stdout: "duration": 2.4627e-05 2023-08-01T19:54:51.213 INFO:teuthology.orchestra.run.smithi101.stdout: }, 2023-08-01T19:54:51.213 INFO:teuthology.orchestra.run.smithi101.stdout: { 2023-08-01T19:54:51.213 INFO:teuthology.orchestra.run.smithi101.stdout: "event": "op must wait for map", 2023-08-01T19:54:51.213 INFO:teuthology.orchestra.run.smithi101.stdout: "time": "2023-08-01T19:54:04.459144+0000", 2023-08-01T19:54:51.213 INFO:teuthology.orchestra.run.smithi101.stdout: "duration": 3.6559999999999998e-06 2023-08-01T19:54:51.213 INFO:teuthology.orchestra.run.smithi101.stdout: }, 2023-08-01T19:54:51.213 INFO:teuthology.orchestra.run.smithi101.stdout: { 2023-08-01T19:54:51.214 INFO:teuthology.orchestra.run.smithi101.stdout: "event": "reached_pg", 2023-08-01T19:54:51.214 INFO:teuthology.orchestra.run.smithi101.stdout: "time": "2023-08-01T19:54:04.468086+0000", 2023-08-01T19:54:51.214 INFO:teuthology.orchestra.run.smithi101.stdout: "duration": 0.0089415569999999993 2023-08-01T19:54:51.214 INFO:teuthology.orchestra.run.smithi101.stdout: }, 2023-08-01T19:54:51.214 INFO:teuthology.orchestra.run.smithi101.stdout: { 2023-08-01T19:54:51.214 INFO:teuthology.orchestra.run.smithi101.stdout: "event": "started", 2023-08-01T19:54:51.214 INFO:teuthology.orchestra.run.smithi101.stdout: "time": "2023-08-01T19:54:04.468204+0000", 2023-08-01T19:54:51.214 INFO:teuthology.orchestra.run.smithi101.stdout: "duration": 0.00011806700000000001 2023-08-01T19:54:51.215 INFO:teuthology.orchestra.run.smithi101.stdout: }, 2023-08-01T19:54:51.215 INFO:teuthology.orchestra.run.smithi101.stdout: { 2023-08-01T19:54:51.215 INFO:teuthology.orchestra.run.smithi101.stdout: "event": "waiting for subops from 0", 2023-08-01T19:54:51.215 INFO:teuthology.orchestra.run.smithi101.stdout: "time": "2023-08-01T19:54:04.468342+0000", 2023-08-01T19:54:51.215 INFO:teuthology.orchestra.run.smithi101.stdout: "duration": 0.000138269 2023-08-01T19:54:51.215 INFO:teuthology.orchestra.run.smithi101.stdout: }, 2023-08-01T19:54:51.215 INFO:teuthology.orchestra.run.smithi101.stdout: { 2023-08-01T19:54:51.216 INFO:teuthology.orchestra.run.smithi101.stdout: "event": "op_commit", 2023-08-01T19:54:51.216 INFO:teuthology.orchestra.run.smithi101.stdout: "time": "2023-08-01T19:54:04.474028+0000", 2023-08-01T19:54:51.216 INFO:teuthology.orchestra.run.smithi101.stdout: "duration": 0.005685458 2023-08-01T19:54:51.216 INFO:teuthology.orchestra.run.smithi101.stdout: }, 2023-08-01T19:54:51.216 INFO:teuthology.orchestra.run.smithi101.stdout: { 2023-08-01T19:54:51.216 INFO:teuthology.orchestra.run.smithi101.stdout: "event": "sub_op_commit_rec", 2023-08-01T19:54:51.216 INFO:teuthology.orchestra.run.smithi101.stdout: "time": "2023-08-01T19:54:04.477581+0000", 2023-08-01T19:54:51.217 INFO:teuthology.orchestra.run.smithi101.stdout: "duration": 0.0035531109999999999 2023-08-01T19:54:51.217 INFO:teuthology.orchestra.run.smithi101.stdout: }, 2023-08-01T19:54:51.217 INFO:teuthology.orchestra.run.smithi101.stdout: { 2023-08-01T19:54:51.217 INFO:teuthology.orchestra.run.smithi101.stdout: "event": "commit_sent", 2023-08-01T19:54:51.217 INFO:teuthology.orchestra.run.smithi101.stdout: "time": "2023-08-01T19:54:04.477635+0000", 2023-08-01T19:54:51.217 INFO:teuthology.orchestra.run.smithi101.stdout: "duration": 5.3769e-05 2023-08-01T19:54:51.217 INFO:teuthology.orchestra.run.smithi101.stdout: }, 2023-08-01T19:54:51.217 INFO:teuthology.orchestra.run.smithi101.stdout: { 2023-08-01T19:54:51.218 INFO:teuthology.orchestra.run.smithi101.stdout: "event": "done", 2023-08-01T19:54:51.218 INFO:teuthology.orchestra.run.smithi101.stdout: "time": "2023-08-01T19:54:04.477676+0000", 2023-08-01T19:54:51.218 INFO:teuthology.orchestra.run.smithi101.stdout: "duration": 4.1148e-05 2023-08-01T19:54:51.218 INFO:teuthology.orchestra.run.smithi101.stdout: } 2023-08-01T19:54:51.218 INFO:teuthology.orchestra.run.smithi101.stdout: ] 2023-08-01T19:54:51.218 INFO:teuthology.orchestra.run.smithi101.stdout: } 2023-08-01T19:54:51.218 INFO:teuthology.orchestra.run.smithi101.stdout: }, 2023-08-01T19:54:51.218 INFO:teuthology.orchestra.run.smithi101.stdout: { 2023-08-01T19:54:51.219 INFO:teuthology.orchestra.run.smithi101.stdout: "description": "osd_op(mds.0.3:21 3.1c 3:3ed09add:::607.00000000:head [create,setxattr parent (62) in=6b,setxattr layout (30) in=6b] snapc 0=[] ondisk+write+known_if_redirected+full_force+supports_pool_eio e17)", 2023-08-01T19:54:51.219 INFO:teuthology.orchestra.run.smithi101.stdout: "initiated_at": "2023-08-01T19:54:04.459123+0000", 2023-08-01T19:54:51.219 INFO:teuthology.orchestra.run.smithi101.stdout: "age": 46.625332577000002, 2023-08-01T19:54:51.219 INFO:teuthology.orchestra.run.smithi101.stdout: "duration": 0.018736452000000001, 2023-08-01T19:54:51.219 INFO:teuthology.orchestra.run.smithi101.stdout: "type_data": { 2023-08-01T19:54:51.219 INFO:teuthology.orchestra.run.smithi101.stdout: "flag_point": "commit sent; apply or cleanup", 2023-08-01T19:54:51.219 INFO:teuthology.orchestra.run.smithi101.stdout: "events": [ 2023-08-01T19:54:51.219 INFO:teuthology.orchestra.run.smithi101.stdout: { 2023-08-01T19:54:51.220 INFO:teuthology.orchestra.run.smithi101.stdout: "event": "initiated", 2023-08-01T19:54:51.220 INFO:teuthology.orchestra.run.smithi101.stdout: "time": "2023-08-01T19:54:04.459123+0000", 2023-08-01T19:54:51.220 INFO:teuthology.orchestra.run.smithi101.stdout: "duration": 0 2023-08-01T19:54:51.220 INFO:teuthology.orchestra.run.smithi101.stdout: }, 2023-08-01T19:54:51.220 INFO:teuthology.orchestra.run.smithi101.stdout: { 2023-08-01T19:54:51.220 INFO:teuthology.orchestra.run.smithi101.stdout: "event": "throttled", 2023-08-01T19:54:51.220 INFO:teuthology.orchestra.run.smithi101.stdout: "time": "2023-08-01T19:54:04.459123+0000", 2023-08-01T19:54:51.221 INFO:teuthology.orchestra.run.smithi101.stdout: "duration": 0 2023-08-01T19:54:51.221 INFO:teuthology.orchestra.run.smithi101.stdout: }, 2023-08-01T19:54:51.221 INFO:teuthology.orchestra.run.smithi101.stdout: { 2023-08-01T19:54:51.221 INFO:teuthology.orchestra.run.smithi101.stdout: "event": "header_read", 2023-08-01T19:54:51.221 INFO:teuthology.orchestra.run.smithi101.stdout: "time": "2023-08-01T19:54:04.459123+0000", 2023-08-01T19:54:51.221 INFO:teuthology.orchestra.run.smithi101.stdout: "duration": 4294967295.9999995 2023-08-01T19:54:51.221 INFO:teuthology.orchestra.run.smithi101.stdout: }, 2023-08-01T19:54:51.221 INFO:teuthology.orchestra.run.smithi101.stdout: { 2023-08-01T19:54:51.222 INFO:teuthology.orchestra.run.smithi101.stdout: "event": "all_read", 2023-08-01T19:54:51.222 INFO:teuthology.orchestra.run.smithi101.stdout: "time": "2023-08-01T19:54:04.459127+0000", 2023-08-01T19:54:51.222 INFO:teuthology.orchestra.run.smithi101.stdout: "duration": 4.5770000000000004e-06 2023-08-01T19:54:51.222 INFO:teuthology.orchestra.run.smithi101.stdout: }, 2023-08-01T19:54:51.222 INFO:teuthology.orchestra.run.smithi101.stdout: { 2023-08-01T19:54:51.222 INFO:teuthology.orchestra.run.smithi101.stdout: "event": "dispatched", 2023-08-01T19:54:51.222 INFO:teuthology.orchestra.run.smithi101.stdout: "time": "2023-08-01T19:54:04.459134+0000", 2023-08-01T19:54:51.222 INFO:teuthology.orchestra.run.smithi101.stdout: "duration": 6.5080000000000002e-06 2023-08-01T19:54:51.223 INFO:teuthology.orchestra.run.smithi101.stdout: }, 2023-08-01T19:54:51.223 INFO:teuthology.orchestra.run.smithi101.stdout: { 2023-08-01T19:54:51.223 INFO:teuthology.orchestra.run.smithi101.stdout: "event": "queued_for_pg", 2023-08-01T19:54:51.223 INFO:teuthology.orchestra.run.smithi101.stdout: "time": "2023-08-01T19:54:04.459138+0000", 2023-08-01T19:54:51.223 INFO:teuthology.orchestra.run.smithi101.stdout: "duration": 4.6249999999999998e-06 2023-08-01T19:54:51.223 INFO:teuthology.orchestra.run.smithi101.stdout: }, 2023-08-01T19:54:51.223 INFO:teuthology.orchestra.run.smithi101.stdout: { 2023-08-01T19:54:51.223 INFO:teuthology.orchestra.run.smithi101.stdout: "event": "reached_pg", 2023-08-01T19:54:51.224 INFO:teuthology.orchestra.run.smithi101.stdout: "time": "2023-08-01T19:54:04.459158+0000", 2023-08-01T19:54:51.224 INFO:teuthology.orchestra.run.smithi101.stdout: "duration": 1.9354000000000001e-05 2023-08-01T19:54:51.224 INFO:teuthology.orchestra.run.smithi101.stdout: }, 2023-08-01T19:54:51.224 INFO:teuthology.orchestra.run.smithi101.stdout: { 2023-08-01T19:54:51.224 INFO:teuthology.orchestra.run.smithi101.stdout: "event": "waiting_for_map not empty", 2023-08-01T19:54:51.224 INFO:teuthology.orchestra.run.smithi101.stdout: "time": "2023-08-01T19:54:04.459160+0000", 2023-08-01T19:54:51.224 INFO:teuthology.orchestra.run.smithi101.stdout: "duration": 2.2740000000000002e-06 2023-08-01T19:54:51.225 INFO:teuthology.orchestra.run.smithi101.stdout: }, 2023-08-01T19:54:51.225 INFO:teuthology.orchestra.run.smithi101.stdout: { 2023-08-01T19:54:51.225 INFO:teuthology.orchestra.run.smithi101.stdout: "event": "reached_pg", 2023-08-01T19:54:51.225 INFO:teuthology.orchestra.run.smithi101.stdout: "time": "2023-08-01T19:54:04.468839+0000", 2023-08-01T19:54:51.225 INFO:teuthology.orchestra.run.smithi101.stdout: "duration": 0.0096787109999999996 2023-08-01T19:54:51.225 INFO:teuthology.orchestra.run.smithi101.stdout: }, 2023-08-01T19:54:51.225 INFO:teuthology.orchestra.run.smithi101.stdout: { 2023-08-01T19:54:51.225 INFO:teuthology.orchestra.run.smithi101.stdout: "event": "started", 2023-08-01T19:54:51.226 INFO:teuthology.orchestra.run.smithi101.stdout: "time": "2023-08-01T19:54:04.469446+0000", 2023-08-01T19:54:51.226 INFO:teuthology.orchestra.run.smithi101.stdout: "duration": 0.00060714899999999997 2023-08-01T19:54:51.226 INFO:teuthology.orchestra.run.smithi101.stdout: }, 2023-08-01T19:54:51.226 INFO:teuthology.orchestra.run.smithi101.stdout: { 2023-08-01T19:54:51.226 INFO:teuthology.orchestra.run.smithi101.stdout: "event": "waiting for subops from 0", 2023-08-01T19:54:51.226 INFO:teuthology.orchestra.run.smithi101.stdout: "time": "2023-08-01T19:54:04.470133+0000", 2023-08-01T19:54:51.226 INFO:teuthology.orchestra.run.smithi101.stdout: "duration": 0.00068691900000000003 2023-08-01T19:54:51.226 INFO:teuthology.orchestra.run.smithi101.stdout: }, 2023-08-01T19:54:51.227 INFO:teuthology.orchestra.run.smithi101.stdout: { 2023-08-01T19:54:51.227 INFO:teuthology.orchestra.run.smithi101.stdout: "event": "op_commit", 2023-08-01T19:54:51.227 INFO:teuthology.orchestra.run.smithi101.stdout: "time": "2023-08-01T19:54:04.475933+0000", 2023-08-01T19:54:51.227 INFO:teuthology.orchestra.run.smithi101.stdout: "duration": 0.0058002560000000002 2023-08-01T19:54:51.227 INFO:teuthology.orchestra.run.smithi101.stdout: }, 2023-08-01T19:54:51.227 INFO:teuthology.orchestra.run.smithi101.stdout: { 2023-08-01T19:54:51.227 INFO:teuthology.orchestra.run.smithi101.stdout: "event": "sub_op_commit_rec", 2023-08-01T19:54:51.227 INFO:teuthology.orchestra.run.smithi101.stdout: "time": "2023-08-01T19:54:04.477749+0000", 2023-08-01T19:54:51.228 INFO:teuthology.orchestra.run.smithi101.stdout: "duration": 0.00181584 2023-08-01T19:54:51.228 INFO:teuthology.orchestra.run.smithi101.stdout: }, 2023-08-01T19:54:51.228 INFO:teuthology.orchestra.run.smithi101.stdout: { 2023-08-01T19:54:51.228 INFO:teuthology.orchestra.run.smithi101.stdout: "event": "commit_sent", 2023-08-01T19:54:51.228 INFO:teuthology.orchestra.run.smithi101.stdout: "time": "2023-08-01T19:54:04.477823+0000", 2023-08-01T19:54:51.228 INFO:teuthology.orchestra.run.smithi101.stdout: "duration": 7.4405000000000003e-05 2023-08-01T19:54:51.228 INFO:teuthology.orchestra.run.smithi101.stdout: }, 2023-08-01T19:54:51.229 INFO:teuthology.orchestra.run.smithi101.stdout: { 2023-08-01T19:54:51.229 INFO:teuthology.orchestra.run.smithi101.stdout: "event": "done", 2023-08-01T19:54:51.229 INFO:teuthology.orchestra.run.smithi101.stdout: "time": "2023-08-01T19:54:04.477859+0000", 2023-08-01T19:54:51.229 INFO:teuthology.orchestra.run.smithi101.stdout: "duration": 3.6211000000000003e-05 2023-08-01T19:54:51.229 INFO:teuthology.orchestra.run.smithi101.stdout: } 2023-08-01T19:54:51.229 INFO:teuthology.orchestra.run.smithi101.stdout: ] 2023-08-01T19:54:51.229 INFO:teuthology.orchestra.run.smithi101.stdout: } 2023-08-01T19:54:51.229 INFO:teuthology.orchestra.run.smithi101.stdout: }, 2023-08-01T19:54:51.230 INFO:teuthology.orchestra.run.smithi101.stdout: { 2023-08-01T19:54:51.230 INFO:teuthology.orchestra.run.smithi101.stdout: "description": "osd_op(mds.0.3:1 3.14 3:292cf221:::200.00000000:head [writefull 0~90] snapc 0=[] ondisk+write+known_if_redirected+full_force+supports_pool_eio e17)", 2023-08-01T19:54:51.230 INFO:teuthology.orchestra.run.smithi101.stdout: "initiated_at": "2023-08-01T19:54:04.459177+0000", 2023-08-01T19:54:51.230 INFO:teuthology.orchestra.run.smithi101.stdout: "age": 46.625278868000002, 2023-08-01T19:54:51.230 INFO:teuthology.orchestra.run.smithi101.stdout: "duration": 0.021067196, 2023-08-01T19:54:51.230 INFO:teuthology.orchestra.run.smithi101.stdout: "type_data": { 2023-08-01T19:54:51.230 INFO:teuthology.orchestra.run.smithi101.stdout: "flag_point": "commit sent; apply or cleanup", 2023-08-01T19:54:51.230 INFO:teuthology.orchestra.run.smithi101.stdout: "events": [ 2023-08-01T19:54:51.231 INFO:teuthology.orchestra.run.smithi101.stdout: { 2023-08-01T19:54:51.231 INFO:teuthology.orchestra.run.smithi101.stdout: "event": "initiated", 2023-08-01T19:54:51.231 INFO:teuthology.orchestra.run.smithi101.stdout: "time": "2023-08-01T19:54:04.459177+0000", 2023-08-01T19:54:51.231 INFO:teuthology.orchestra.run.smithi101.stdout: "duration": 0 2023-08-01T19:54:51.231 INFO:teuthology.orchestra.run.smithi101.stdout: }, 2023-08-01T19:54:51.231 INFO:teuthology.orchestra.run.smithi101.stdout: { 2023-08-01T19:54:51.231 INFO:teuthology.orchestra.run.smithi101.stdout: "event": "throttled", 2023-08-01T19:54:51.231 INFO:teuthology.orchestra.run.smithi101.stdout: "time": "2023-08-01T19:54:04.459177+0000", 2023-08-01T19:54:51.232 INFO:teuthology.orchestra.run.smithi101.stdout: "duration": 0 2023-08-01T19:54:51.232 INFO:teuthology.orchestra.run.smithi101.stdout: }, 2023-08-01T19:54:51.232 INFO:teuthology.orchestra.run.smithi101.stdout: { 2023-08-01T19:54:51.232 INFO:teuthology.orchestra.run.smithi101.stdout: "event": "header_read", 2023-08-01T19:54:51.232 INFO:teuthology.orchestra.run.smithi101.stdout: "time": "2023-08-01T19:54:04.459176+0000", 2023-08-01T19:54:51.232 INFO:teuthology.orchestra.run.smithi101.stdout: "duration": 4294967295.9999995 2023-08-01T19:54:51.232 INFO:teuthology.orchestra.run.smithi101.stdout: }, 2023-08-01T19:54:51.233 INFO:teuthology.orchestra.run.smithi101.stdout: { 2023-08-01T19:54:51.233 INFO:teuthology.orchestra.run.smithi101.stdout: "event": "all_read", 2023-08-01T19:54:51.233 INFO:teuthology.orchestra.run.smithi101.stdout: "time": "2023-08-01T19:54:04.459181+0000", 2023-08-01T19:54:51.233 INFO:teuthology.orchestra.run.smithi101.stdout: "duration": 5.2109999999999997e-06 2023-08-01T19:54:51.233 INFO:teuthology.orchestra.run.smithi101.stdout: }, 2023-08-01T19:54:51.233 INFO:teuthology.orchestra.run.smithi101.stdout: { 2023-08-01T19:54:51.233 INFO:teuthology.orchestra.run.smithi101.stdout: "event": "dispatched", 2023-08-01T19:54:51.233 INFO:teuthology.orchestra.run.smithi101.stdout: "time": "2023-08-01T19:54:04.459188+0000", 2023-08-01T19:54:51.234 INFO:teuthology.orchestra.run.smithi101.stdout: "duration": 6.6680000000000004e-06 2023-08-01T19:54:51.234 INFO:teuthology.orchestra.run.smithi101.stdout: }, 2023-08-01T19:54:51.234 INFO:teuthology.orchestra.run.smithi101.stdout: { 2023-08-01T19:54:51.234 INFO:teuthology.orchestra.run.smithi101.stdout: "event": "queued_for_pg", 2023-08-01T19:54:51.234 INFO:teuthology.orchestra.run.smithi101.stdout: "time": "2023-08-01T19:54:04.459192+0000", 2023-08-01T19:54:51.234 INFO:teuthology.orchestra.run.smithi101.stdout: "duration": 4.228e-06 2023-08-01T19:54:51.234 INFO:teuthology.orchestra.run.smithi101.stdout: }, 2023-08-01T19:54:51.234 INFO:teuthology.orchestra.run.smithi101.stdout: { 2023-08-01T19:54:51.235 INFO:teuthology.orchestra.run.smithi101.stdout: "event": "reached_pg", 2023-08-01T19:54:51.235 INFO:teuthology.orchestra.run.smithi101.stdout: "time": "2023-08-01T19:54:04.459219+0000", 2023-08-01T19:54:51.235 INFO:teuthology.orchestra.run.smithi101.stdout: "duration": 2.6930000000000001e-05 2023-08-01T19:54:51.235 INFO:teuthology.orchestra.run.smithi101.stdout: }, 2023-08-01T19:54:51.235 INFO:teuthology.orchestra.run.smithi101.stdout: { 2023-08-01T19:54:51.235 INFO:teuthology.orchestra.run.smithi101.stdout: "event": "waiting_for_map not empty", 2023-08-01T19:54:51.235 INFO:teuthology.orchestra.run.smithi101.stdout: "time": "2023-08-01T19:54:04.459223+0000", 2023-08-01T19:54:51.235 INFO:teuthology.orchestra.run.smithi101.stdout: "duration": 3.8469999999999998e-06 2023-08-01T19:54:51.236 INFO:teuthology.orchestra.run.smithi101.stdout: }, 2023-08-01T19:54:51.236 INFO:teuthology.orchestra.run.smithi101.stdout: { 2023-08-01T19:54:51.236 INFO:teuthology.orchestra.run.smithi101.stdout: "event": "reached_pg", 2023-08-01T19:54:51.236 INFO:teuthology.orchestra.run.smithi101.stdout: "time": "2023-08-01T19:54:04.473347+0000", 2023-08-01T19:54:51.236 INFO:teuthology.orchestra.run.smithi101.stdout: "duration": 0.014124319 2023-08-01T19:54:51.236 INFO:teuthology.orchestra.run.smithi101.stdout: }, 2023-08-01T19:54:51.236 INFO:teuthology.orchestra.run.smithi101.stdout: { 2023-08-01T19:54:51.237 INFO:teuthology.orchestra.run.smithi101.stdout: "event": "started", 2023-08-01T19:54:51.237 INFO:teuthology.orchestra.run.smithi101.stdout: "time": "2023-08-01T19:54:04.473480+0000", 2023-08-01T19:54:51.237 INFO:teuthology.orchestra.run.smithi101.stdout: "duration": 0.00013276799999999999 2023-08-01T19:54:51.237 INFO:teuthology.orchestra.run.smithi101.stdout: }, 2023-08-01T19:54:51.237 INFO:teuthology.orchestra.run.smithi101.stdout: { 2023-08-01T19:54:51.237 INFO:teuthology.orchestra.run.smithi101.stdout: "event": "waiting for subops from 2", 2023-08-01T19:54:51.237 INFO:teuthology.orchestra.run.smithi101.stdout: "time": "2023-08-01T19:54:04.473622+0000", 2023-08-01T19:54:51.237 INFO:teuthology.orchestra.run.smithi101.stdout: "duration": 0.00014154799999999999 2023-08-01T19:54:51.238 INFO:teuthology.orchestra.run.smithi101.stdout: }, 2023-08-01T19:54:51.238 INFO:teuthology.orchestra.run.smithi101.stdout: { 2023-08-01T19:54:51.238 INFO:teuthology.orchestra.run.smithi101.stdout: "event": "op_commit", 2023-08-01T19:54:51.238 INFO:teuthology.orchestra.run.smithi101.stdout: "time": "2023-08-01T19:54:04.478281+0000", 2023-08-01T19:54:51.238 INFO:teuthology.orchestra.run.smithi101.stdout: "duration": 0.004659252 2023-08-01T19:54:51.238 INFO:teuthology.orchestra.run.smithi101.stdout: }, 2023-08-01T19:54:51.238 INFO:teuthology.orchestra.run.smithi101.stdout: { 2023-08-01T19:54:51.238 INFO:teuthology.orchestra.run.smithi101.stdout: "event": "sub_op_commit_rec", 2023-08-01T19:54:51.239 INFO:teuthology.orchestra.run.smithi101.stdout: "time": "2023-08-01T19:54:04.480180+0000", 2023-08-01T19:54:51.239 INFO:teuthology.orchestra.run.smithi101.stdout: "duration": 0.0018986859999999999 2023-08-01T19:54:51.239 INFO:teuthology.orchestra.run.smithi101.stdout: }, 2023-08-01T19:54:51.239 INFO:teuthology.orchestra.run.smithi101.stdout: { 2023-08-01T19:54:51.239 INFO:teuthology.orchestra.run.smithi101.stdout: "event": "commit_sent", 2023-08-01T19:54:51.239 INFO:teuthology.orchestra.run.smithi101.stdout: "time": "2023-08-01T19:54:04.480209+0000", 2023-08-01T19:54:51.239 INFO:teuthology.orchestra.run.smithi101.stdout: "duration": 2.9244999999999999e-05 2023-08-01T19:54:51.239 INFO:teuthology.orchestra.run.smithi101.stdout: }, 2023-08-01T19:54:51.240 INFO:teuthology.orchestra.run.smithi101.stdout: { 2023-08-01T19:54:51.240 INFO:teuthology.orchestra.run.smithi101.stdout: "event": "done", 2023-08-01T19:54:51.240 INFO:teuthology.orchestra.run.smithi101.stdout: "time": "2023-08-01T19:54:04.480244+0000", 2023-08-01T19:54:51.240 INFO:teuthology.orchestra.run.smithi101.stdout: "duration": 3.4875000000000001e-05 2023-08-01T19:54:51.240 INFO:teuthology.orchestra.run.smithi101.stdout: } 2023-08-01T19:54:51.240 INFO:teuthology.orchestra.run.smithi101.stdout: ] 2023-08-01T19:54:51.240 INFO:teuthology.orchestra.run.smithi101.stdout: } 2023-08-01T19:54:51.240 INFO:teuthology.orchestra.run.smithi101.stdout: }, 2023-08-01T19:54:51.241 INFO:teuthology.orchestra.run.smithi101.stdout: { 2023-08-01T19:54:51.241 INFO:teuthology.orchestra.run.smithi101.stdout: "description": "osd_op(mds.0.3:2 3.f 3:f1f69726:::400.00000000:head [writefull 0~22] snapc 0=[] ondisk+write+known_if_redirected+full_force+supports_pool_eio e17)", 2023-08-01T19:54:51.241 INFO:teuthology.orchestra.run.smithi101.stdout: "initiated_at": "2023-08-01T19:54:04.459201+0000", 2023-08-01T19:54:51.241 INFO:teuthology.orchestra.run.smithi101.stdout: "age": 46.625254611999999, 2023-08-01T19:54:51.241 INFO:teuthology.orchestra.run.smithi101.stdout: "duration": 0.016952979, 2023-08-01T19:54:51.241 INFO:teuthology.orchestra.run.smithi101.stdout: "type_data": { 2023-08-01T19:54:51.241 INFO:teuthology.orchestra.run.smithi101.stdout: "flag_point": "commit sent; apply or cleanup", 2023-08-01T19:54:51.241 INFO:teuthology.orchestra.run.smithi101.stdout: "events": [ 2023-08-01T19:54:51.242 INFO:teuthology.orchestra.run.smithi101.stdout: { 2023-08-01T19:54:51.242 INFO:teuthology.orchestra.run.smithi101.stdout: "event": "initiated", 2023-08-01T19:54:51.242 INFO:teuthology.orchestra.run.smithi101.stdout: "time": "2023-08-01T19:54:04.459201+0000", 2023-08-01T19:54:51.242 INFO:teuthology.orchestra.run.smithi101.stdout: "duration": 0 2023-08-01T19:54:51.242 INFO:teuthology.orchestra.run.smithi101.stdout: }, 2023-08-01T19:54:51.242 INFO:teuthology.orchestra.run.smithi101.stdout: { 2023-08-01T19:54:51.242 INFO:teuthology.orchestra.run.smithi101.stdout: "event": "throttled", 2023-08-01T19:54:51.243 INFO:teuthology.orchestra.run.smithi101.stdout: "time": "2023-08-01T19:54:04.459201+0000", 2023-08-01T19:54:51.243 INFO:teuthology.orchestra.run.smithi101.stdout: "duration": 0 2023-08-01T19:54:51.243 INFO:teuthology.orchestra.run.smithi101.stdout: }, 2023-08-01T19:54:51.243 INFO:teuthology.orchestra.run.smithi101.stdout: { 2023-08-01T19:54:51.243 INFO:teuthology.orchestra.run.smithi101.stdout: "event": "header_read", 2023-08-01T19:54:51.243 INFO:teuthology.orchestra.run.smithi101.stdout: "time": "2023-08-01T19:54:04.459201+0000", 2023-08-01T19:54:51.243 INFO:teuthology.orchestra.run.smithi101.stdout: "duration": 4294967295.9999995 2023-08-01T19:54:51.243 INFO:teuthology.orchestra.run.smithi101.stdout: }, 2023-08-01T19:54:51.244 INFO:teuthology.orchestra.run.smithi101.stdout: { 2023-08-01T19:54:51.244 INFO:teuthology.orchestra.run.smithi101.stdout: "event": "all_read", 2023-08-01T19:54:51.244 INFO:teuthology.orchestra.run.smithi101.stdout: "time": "2023-08-01T19:54:04.459204+0000", 2023-08-01T19:54:51.244 INFO:teuthology.orchestra.run.smithi101.stdout: "duration": 3.5599999999999998e-06 2023-08-01T19:54:51.244 INFO:teuthology.orchestra.run.smithi101.stdout: }, 2023-08-01T19:54:51.244 INFO:teuthology.orchestra.run.smithi101.stdout: { 2023-08-01T19:54:51.244 INFO:teuthology.orchestra.run.smithi101.stdout: "event": "dispatched", 2023-08-01T19:54:51.245 INFO:teuthology.orchestra.run.smithi101.stdout: "time": "2023-08-01T19:54:04.459211+0000", 2023-08-01T19:54:51.245 INFO:teuthology.orchestra.run.smithi101.stdout: "duration": 6.9299999999999997e-06 2023-08-01T19:54:51.245 INFO:teuthology.orchestra.run.smithi101.stdout: }, 2023-08-01T19:54:51.245 INFO:teuthology.orchestra.run.smithi101.stdout: { 2023-08-01T19:54:51.245 INFO:teuthology.orchestra.run.smithi101.stdout: "event": "queued_for_pg", 2023-08-01T19:54:51.245 INFO:teuthology.orchestra.run.smithi101.stdout: "time": "2023-08-01T19:54:04.459216+0000", 2023-08-01T19:54:51.245 INFO:teuthology.orchestra.run.smithi101.stdout: "duration": 4.5050000000000001e-06 2023-08-01T19:54:51.245 INFO:teuthology.orchestra.run.smithi101.stdout: }, 2023-08-01T19:54:51.246 INFO:teuthology.orchestra.run.smithi101.stdout: { 2023-08-01T19:54:51.246 INFO:teuthology.orchestra.run.smithi101.stdout: "event": "reached_pg", 2023-08-01T19:54:51.246 INFO:teuthology.orchestra.run.smithi101.stdout: "time": "2023-08-01T19:54:04.459246+0000", 2023-08-01T19:54:51.246 INFO:teuthology.orchestra.run.smithi101.stdout: "duration": 3.0369999999999999e-05 2023-08-01T19:54:51.246 INFO:teuthology.orchestra.run.smithi101.stdout: }, 2023-08-01T19:54:51.246 INFO:teuthology.orchestra.run.smithi101.stdout: { 2023-08-01T19:54:51.246 INFO:teuthology.orchestra.run.smithi101.stdout: "event": "op must wait for map", 2023-08-01T19:54:51.246 INFO:teuthology.orchestra.run.smithi101.stdout: "time": "2023-08-01T19:54:04.459250+0000", 2023-08-01T19:54:51.247 INFO:teuthology.orchestra.run.smithi101.stdout: "duration": 3.6880000000000001e-06 2023-08-01T19:54:51.247 INFO:teuthology.orchestra.run.smithi101.stdout: }, 2023-08-01T19:54:51.247 INFO:teuthology.orchestra.run.smithi101.stdout: { 2023-08-01T19:54:51.247 INFO:teuthology.orchestra.run.smithi101.stdout: "event": "reached_pg", 2023-08-01T19:54:51.247 INFO:teuthology.orchestra.run.smithi101.stdout: "time": "2023-08-01T19:54:04.469499+0000", 2023-08-01T19:54:51.247 INFO:teuthology.orchestra.run.smithi101.stdout: "duration": 0.010249052 2023-08-01T19:54:51.247 INFO:teuthology.orchestra.run.smithi101.stdout: }, 2023-08-01T19:54:51.247 INFO:teuthology.orchestra.run.smithi101.stdout: { 2023-08-01T19:54:51.248 INFO:teuthology.orchestra.run.smithi101.stdout: "event": "started", 2023-08-01T19:54:51.248 INFO:teuthology.orchestra.run.smithi101.stdout: "time": "2023-08-01T19:54:04.469619+0000", 2023-08-01T19:54:51.248 INFO:teuthology.orchestra.run.smithi101.stdout: "duration": 0.000120061 2023-08-01T19:54:51.248 INFO:teuthology.orchestra.run.smithi101.stdout: }, 2023-08-01T19:54:51.248 INFO:teuthology.orchestra.run.smithi101.stdout: { 2023-08-01T19:54:51.248 INFO:teuthology.orchestra.run.smithi101.stdout: "event": "waiting for subops from 2", 2023-08-01T19:54:51.248 INFO:teuthology.orchestra.run.smithi101.stdout: "time": "2023-08-01T19:54:04.469903+0000", 2023-08-01T19:54:51.249 INFO:teuthology.orchestra.run.smithi101.stdout: "duration": 0.00028409799999999999 2023-08-01T19:54:51.249 INFO:teuthology.orchestra.run.smithi101.stdout: }, 2023-08-01T19:54:51.249 INFO:teuthology.orchestra.run.smithi101.stdout: { 2023-08-01T19:54:51.249 INFO:teuthology.orchestra.run.smithi101.stdout: "event": "sub_op_commit_rec", 2023-08-01T19:54:51.249 INFO:teuthology.orchestra.run.smithi101.stdout: "time": "2023-08-01T19:54:04.475166+0000", 2023-08-01T19:54:51.249 INFO:teuthology.orchestra.run.smithi101.stdout: "duration": 0.0052632460000000001 2023-08-01T19:54:51.249 INFO:teuthology.orchestra.run.smithi101.stdout: }, 2023-08-01T19:54:51.250 INFO:teuthology.orchestra.run.smithi101.stdout: { 2023-08-01T19:54:51.250 INFO:teuthology.orchestra.run.smithi101.stdout: "event": "op_commit", 2023-08-01T19:54:51.250 INFO:teuthology.orchestra.run.smithi101.stdout: "time": "2023-08-01T19:54:04.476056+0000", 2023-08-01T19:54:51.250 INFO:teuthology.orchestra.run.smithi101.stdout: "duration": 0.00089017499999999999 2023-08-01T19:54:51.250 INFO:teuthology.orchestra.run.smithi101.stdout: }, 2023-08-01T19:54:51.250 INFO:teuthology.orchestra.run.smithi101.stdout: { 2023-08-01T19:54:51.250 INFO:teuthology.orchestra.run.smithi101.stdout: "event": "commit_sent", 2023-08-01T19:54:51.250 INFO:teuthology.orchestra.run.smithi101.stdout: "time": "2023-08-01T19:54:04.476115+0000", 2023-08-01T19:54:51.251 INFO:teuthology.orchestra.run.smithi101.stdout: "duration": 5.8464999999999997e-05 2023-08-01T19:54:51.251 INFO:teuthology.orchestra.run.smithi101.stdout: }, 2023-08-01T19:54:51.251 INFO:teuthology.orchestra.run.smithi101.stdout: { 2023-08-01T19:54:51.251 INFO:teuthology.orchestra.run.smithi101.stdout: "event": "done", 2023-08-01T19:54:51.251 INFO:teuthology.orchestra.run.smithi101.stdout: "time": "2023-08-01T19:54:04.476154+0000", 2023-08-01T19:54:51.251 INFO:teuthology.orchestra.run.smithi101.stdout: "duration": 3.9229e-05 2023-08-01T19:54:51.251 INFO:teuthology.orchestra.run.smithi101.stdout: } 2023-08-01T19:54:51.251 INFO:teuthology.orchestra.run.smithi101.stdout: ] 2023-08-01T19:54:51.252 INFO:teuthology.orchestra.run.smithi101.stdout: } 2023-08-01T19:54:51.252 INFO:teuthology.orchestra.run.smithi101.stdout: }, 2023-08-01T19:54:51.252 INFO:teuthology.orchestra.run.smithi101.stdout: { 2023-08-01T19:54:51.252 INFO:teuthology.orchestra.run.smithi101.stdout: "description": "osd_op(mds.0.3:3 3.14 3:287034c4:::1.00000000.inode:head [writefull 0~554] snapc 0=[] ondisk+write+known_if_redirected+full_force+supports_pool_eio e17)", 2023-08-01T19:54:51.252 INFO:teuthology.orchestra.run.smithi101.stdout: "initiated_at": "2023-08-01T19:54:04.459226+0000", 2023-08-01T19:54:51.252 INFO:teuthology.orchestra.run.smithi101.stdout: "age": 46.625229789000002, 2023-08-01T19:54:51.252 INFO:teuthology.orchestra.run.smithi101.stdout: "duration": 0.021104531999999999, 2023-08-01T19:54:51.252 INFO:teuthology.orchestra.run.smithi101.stdout: "type_data": { 2023-08-01T19:54:51.253 INFO:teuthology.orchestra.run.smithi101.stdout: "flag_point": "commit sent; apply or cleanup", 2023-08-01T19:54:51.253 INFO:teuthology.orchestra.run.smithi101.stdout: "events": [ 2023-08-01T19:54:51.253 INFO:teuthology.orchestra.run.smithi101.stdout: { 2023-08-01T19:54:51.253 INFO:teuthology.orchestra.run.smithi101.stdout: "event": "initiated", 2023-08-01T19:54:51.253 INFO:teuthology.orchestra.run.smithi101.stdout: "time": "2023-08-01T19:54:04.459226+0000", 2023-08-01T19:54:51.253 INFO:teuthology.orchestra.run.smithi101.stdout: "duration": 0 2023-08-01T19:54:51.253 INFO:teuthology.orchestra.run.smithi101.stdout: }, 2023-08-01T19:54:51.254 INFO:teuthology.orchestra.run.smithi101.stdout: { 2023-08-01T19:54:51.254 INFO:teuthology.orchestra.run.smithi101.stdout: "event": "throttled", 2023-08-01T19:54:51.254 INFO:teuthology.orchestra.run.smithi101.stdout: "time": "2023-08-01T19:54:04.459226+0000", 2023-08-01T19:54:51.254 INFO:teuthology.orchestra.run.smithi101.stdout: "duration": 0 2023-08-01T19:54:51.254 INFO:teuthology.orchestra.run.smithi101.stdout: }, 2023-08-01T19:54:51.254 INFO:teuthology.orchestra.run.smithi101.stdout: { 2023-08-01T19:54:51.254 INFO:teuthology.orchestra.run.smithi101.stdout: "event": "header_read", 2023-08-01T19:54:51.254 INFO:teuthology.orchestra.run.smithi101.stdout: "time": "2023-08-01T19:54:04.459225+0000", 2023-08-01T19:54:51.255 INFO:teuthology.orchestra.run.smithi101.stdout: "duration": 4294967295.9999995 2023-08-01T19:54:51.255 INFO:teuthology.orchestra.run.smithi101.stdout: }, 2023-08-01T19:54:51.255 INFO:teuthology.orchestra.run.smithi101.stdout: { 2023-08-01T19:54:51.255 INFO:teuthology.orchestra.run.smithi101.stdout: "event": "all_read", 2023-08-01T19:54:51.255 INFO:teuthology.orchestra.run.smithi101.stdout: "time": "2023-08-01T19:54:04.459238+0000", 2023-08-01T19:54:51.255 INFO:teuthology.orchestra.run.smithi101.stdout: "duration": 1.2809000000000001e-05 2023-08-01T19:54:51.255 INFO:teuthology.orchestra.run.smithi101.stdout: }, 2023-08-01T19:54:51.255 INFO:teuthology.orchestra.run.smithi101.stdout: { 2023-08-01T19:54:51.256 INFO:teuthology.orchestra.run.smithi101.stdout: "event": "dispatched", 2023-08-01T19:54:51.256 INFO:teuthology.orchestra.run.smithi101.stdout: "time": "2023-08-01T19:54:04.459245+0000", 2023-08-01T19:54:51.256 INFO:teuthology.orchestra.run.smithi101.stdout: "duration": 6.6540000000000002e-06 2023-08-01T19:54:51.256 INFO:teuthology.orchestra.run.smithi101.stdout: }, 2023-08-01T19:54:51.256 INFO:teuthology.orchestra.run.smithi101.stdout: { 2023-08-01T19:54:51.256 INFO:teuthology.orchestra.run.smithi101.stdout: "event": "queued_for_pg", 2023-08-01T19:54:51.256 INFO:teuthology.orchestra.run.smithi101.stdout: "time": "2023-08-01T19:54:04.459249+0000", 2023-08-01T19:54:51.256 INFO:teuthology.orchestra.run.smithi101.stdout: "duration": 4.6e-06 2023-08-01T19:54:51.257 INFO:teuthology.orchestra.run.smithi101.stdout: }, 2023-08-01T19:54:51.257 INFO:teuthology.orchestra.run.smithi101.stdout: { 2023-08-01T19:54:51.257 INFO:teuthology.orchestra.run.smithi101.stdout: "event": "reached_pg", 2023-08-01T19:54:51.257 INFO:teuthology.orchestra.run.smithi101.stdout: "time": "2023-08-01T19:54:04.459276+0000", 2023-08-01T19:54:51.257 INFO:teuthology.orchestra.run.smithi101.stdout: "duration": 2.6373999999999999e-05 2023-08-01T19:54:51.257 INFO:teuthology.orchestra.run.smithi101.stdout: }, 2023-08-01T19:54:51.257 INFO:teuthology.orchestra.run.smithi101.stdout: { 2023-08-01T19:54:51.258 INFO:teuthology.orchestra.run.smithi101.stdout: "event": "waiting_for_map not empty", 2023-08-01T19:54:51.258 INFO:teuthology.orchestra.run.smithi101.stdout: "time": "2023-08-01T19:54:04.459278+0000", 2023-08-01T19:54:51.258 INFO:teuthology.orchestra.run.smithi101.stdout: "duration": 2.4980000000000001e-06 2023-08-01T19:54:51.258 INFO:teuthology.orchestra.run.smithi101.stdout: }, 2023-08-01T19:54:51.258 INFO:teuthology.orchestra.run.smithi101.stdout: { 2023-08-01T19:54:51.258 INFO:teuthology.orchestra.run.smithi101.stdout: "event": "reached_pg", 2023-08-01T19:54:51.258 INFO:teuthology.orchestra.run.smithi101.stdout: "time": "2023-08-01T19:54:04.474058+0000", 2023-08-01T19:54:51.258 INFO:teuthology.orchestra.run.smithi101.stdout: "duration": 0.014779979 2023-08-01T19:54:51.259 INFO:teuthology.orchestra.run.smithi101.stdout: }, 2023-08-01T19:54:51.259 INFO:teuthology.orchestra.run.smithi101.stdout: { 2023-08-01T19:54:51.259 INFO:teuthology.orchestra.run.smithi101.stdout: "event": "started", 2023-08-01T19:54:51.259 INFO:teuthology.orchestra.run.smithi101.stdout: "time": "2023-08-01T19:54:04.474614+0000", 2023-08-01T19:54:51.259 INFO:teuthology.orchestra.run.smithi101.stdout: "duration": 0.00055546899999999995 2023-08-01T19:54:51.259 INFO:teuthology.orchestra.run.smithi101.stdout: }, 2023-08-01T19:54:51.259 INFO:teuthology.orchestra.run.smithi101.stdout: { 2023-08-01T19:54:51.260 INFO:teuthology.orchestra.run.smithi101.stdout: "event": "waiting for subops from 2", 2023-08-01T19:54:51.260 INFO:teuthology.orchestra.run.smithi101.stdout: "time": "2023-08-01T19:54:04.474720+0000", 2023-08-01T19:54:51.260 INFO:teuthology.orchestra.run.smithi101.stdout: "duration": 0.00010645300000000001 2023-08-01T19:54:51.260 INFO:teuthology.orchestra.run.smithi101.stdout: }, 2023-08-01T19:54:51.260 INFO:teuthology.orchestra.run.smithi101.stdout: { 2023-08-01T19:54:51.260 INFO:teuthology.orchestra.run.smithi101.stdout: "event": "op_commit", 2023-08-01T19:54:51.260 INFO:teuthology.orchestra.run.smithi101.stdout: "time": "2023-08-01T19:54:04.478480+0000", 2023-08-01T19:54:51.261 INFO:teuthology.orchestra.run.smithi101.stdout: "duration": 0.0037600279999999999 2023-08-01T19:54:51.261 INFO:teuthology.orchestra.run.smithi101.stdout: }, 2023-08-01T19:54:51.261 INFO:teuthology.orchestra.run.smithi101.stdout: { 2023-08-01T19:54:51.261 INFO:teuthology.orchestra.run.smithi101.stdout: "event": "sub_op_commit_rec", 2023-08-01T19:54:51.261 INFO:teuthology.orchestra.run.smithi101.stdout: "time": "2023-08-01T19:54:04.480273+0000", 2023-08-01T19:54:51.261 INFO:teuthology.orchestra.run.smithi101.stdout: "duration": 0.001792465 2023-08-01T19:54:51.261 INFO:teuthology.orchestra.run.smithi101.stdout: }, 2023-08-01T19:54:51.261 INFO:teuthology.orchestra.run.smithi101.stdout: { 2023-08-01T19:54:51.262 INFO:teuthology.orchestra.run.smithi101.stdout: "event": "commit_sent", 2023-08-01T19:54:51.262 INFO:teuthology.orchestra.run.smithi101.stdout: "time": "2023-08-01T19:54:04.480304+0000", 2023-08-01T19:54:51.262 INFO:teuthology.orchestra.run.smithi101.stdout: "duration": 3.1708999999999997e-05 2023-08-01T19:54:51.262 INFO:teuthology.orchestra.run.smithi101.stdout: }, 2023-08-01T19:54:51.262 INFO:teuthology.orchestra.run.smithi101.stdout: { 2023-08-01T19:54:51.262 INFO:teuthology.orchestra.run.smithi101.stdout: "event": "done", 2023-08-01T19:54:51.262 INFO:teuthology.orchestra.run.smithi101.stdout: "time": "2023-08-01T19:54:04.480330+0000", 2023-08-01T19:54:51.262 INFO:teuthology.orchestra.run.smithi101.stdout: "duration": 2.5860999999999999e-05 2023-08-01T19:54:51.263 INFO:teuthology.orchestra.run.smithi101.stdout: } 2023-08-01T19:54:51.263 INFO:teuthology.orchestra.run.smithi101.stdout: ] 2023-08-01T19:54:51.263 INFO:teuthology.orchestra.run.smithi101.stdout: } 2023-08-01T19:54:51.263 INFO:teuthology.orchestra.run.smithi101.stdout: }, 2023-08-01T19:54:51.263 INFO:teuthology.orchestra.run.smithi101.stdout: { 2023-08-01T19:54:51.263 INFO:teuthology.orchestra.run.smithi101.stdout: "description": "osd_op(mds.0.3:27 3.13 3:c91d4a1d:::mds0_inotable:head [writefull 0~34] snapc 0=[] ondisk+write+known_if_redirected+full_force+supports_pool_eio e17)", 2023-08-01T19:54:51.263 INFO:teuthology.orchestra.run.smithi101.stdout: "initiated_at": "2023-08-01T19:54:04.459260+0000", 2023-08-01T19:54:51.264 INFO:teuthology.orchestra.run.smithi101.stdout: "age": 46.625195898000001, 2023-08-01T19:54:51.264 INFO:teuthology.orchestra.run.smithi101.stdout: "duration": 0.016792715999999999, 2023-08-01T19:54:51.264 INFO:teuthology.orchestra.run.smithi101.stdout: "type_data": { 2023-08-01T19:54:51.264 INFO:teuthology.orchestra.run.smithi101.stdout: "flag_point": "commit sent; apply or cleanup", 2023-08-01T19:54:51.264 INFO:teuthology.orchestra.run.smithi101.stdout: "events": [ 2023-08-01T19:54:51.264 INFO:teuthology.orchestra.run.smithi101.stdout: { 2023-08-01T19:54:51.264 INFO:teuthology.orchestra.run.smithi101.stdout: "event": "initiated", 2023-08-01T19:54:51.264 INFO:teuthology.orchestra.run.smithi101.stdout: "time": "2023-08-01T19:54:04.459260+0000", 2023-08-01T19:54:51.265 INFO:teuthology.orchestra.run.smithi101.stdout: "duration": 0 2023-08-01T19:54:51.265 INFO:teuthology.orchestra.run.smithi101.stdout: }, 2023-08-01T19:54:51.265 INFO:teuthology.orchestra.run.smithi101.stdout: { 2023-08-01T19:54:51.265 INFO:teuthology.orchestra.run.smithi101.stdout: "event": "throttled", 2023-08-01T19:54:51.265 INFO:teuthology.orchestra.run.smithi101.stdout: "time": "2023-08-01T19:54:04.459260+0000", 2023-08-01T19:54:51.265 INFO:teuthology.orchestra.run.smithi101.stdout: "duration": 0 2023-08-01T19:54:51.265 INFO:teuthology.orchestra.run.smithi101.stdout: }, 2023-08-01T19:54:51.265 INFO:teuthology.orchestra.run.smithi101.stdout: { 2023-08-01T19:54:51.266 INFO:teuthology.orchestra.run.smithi101.stdout: "event": "header_read", 2023-08-01T19:54:51.266 INFO:teuthology.orchestra.run.smithi101.stdout: "time": "2023-08-01T19:54:04.459259+0000", 2023-08-01T19:54:51.266 INFO:teuthology.orchestra.run.smithi101.stdout: "duration": 4294967295.9999995 2023-08-01T19:54:51.266 INFO:teuthology.orchestra.run.smithi101.stdout: }, 2023-08-01T19:54:51.266 INFO:teuthology.orchestra.run.smithi101.stdout: { 2023-08-01T19:54:51.266 INFO:teuthology.orchestra.run.smithi101.stdout: "event": "all_read", 2023-08-01T19:54:51.266 INFO:teuthology.orchestra.run.smithi101.stdout: "time": "2023-08-01T19:54:04.459263+0000", 2023-08-01T19:54:51.266 INFO:teuthology.orchestra.run.smithi101.stdout: "duration": 3.9249999999999997e-06 2023-08-01T19:54:51.267 INFO:teuthology.orchestra.run.smithi101.stdout: }, 2023-08-01T19:54:51.267 INFO:teuthology.orchestra.run.smithi101.stdout: { 2023-08-01T19:54:51.267 INFO:teuthology.orchestra.run.smithi101.stdout: "event": "dispatched", 2023-08-01T19:54:51.267 INFO:teuthology.orchestra.run.smithi101.stdout: "time": "2023-08-01T19:54:04.459270+0000", 2023-08-01T19:54:51.267 INFO:teuthology.orchestra.run.smithi101.stdout: "duration": 7.0180000000000004e-06 2023-08-01T19:54:51.267 INFO:teuthology.orchestra.run.smithi101.stdout: }, 2023-08-01T19:54:51.267 INFO:teuthology.orchestra.run.smithi101.stdout: { 2023-08-01T19:54:51.267 INFO:teuthology.orchestra.run.smithi101.stdout: "event": "queued_for_pg", 2023-08-01T19:54:51.268 INFO:teuthology.orchestra.run.smithi101.stdout: "time": "2023-08-01T19:54:04.459275+0000", 2023-08-01T19:54:51.268 INFO:teuthology.orchestra.run.smithi101.stdout: "duration": 4.763e-06 2023-08-01T19:54:51.268 INFO:teuthology.orchestra.run.smithi101.stdout: }, 2023-08-01T19:54:51.268 INFO:teuthology.orchestra.run.smithi101.stdout: { 2023-08-01T19:54:51.268 INFO:teuthology.orchestra.run.smithi101.stdout: "event": "reached_pg", 2023-08-01T19:54:51.268 INFO:teuthology.orchestra.run.smithi101.stdout: "time": "2023-08-01T19:54:04.459298+0000", 2023-08-01T19:54:51.268 INFO:teuthology.orchestra.run.smithi101.stdout: "duration": 2.3193e-05 2023-08-01T19:54:51.269 INFO:teuthology.orchestra.run.smithi101.stdout: }, 2023-08-01T19:54:51.269 INFO:teuthology.orchestra.run.smithi101.stdout: { 2023-08-01T19:54:51.269 INFO:teuthology.orchestra.run.smithi101.stdout: "event": "waiting_for_map not empty", 2023-08-01T19:54:51.269 INFO:teuthology.orchestra.run.smithi101.stdout: "time": "2023-08-01T19:54:04.459301+0000", 2023-08-01T19:54:51.269 INFO:teuthology.orchestra.run.smithi101.stdout: "duration": 3.0539999999999999e-06 2023-08-01T19:54:51.269 INFO:teuthology.orchestra.run.smithi101.stdout: }, 2023-08-01T19:54:51.269 INFO:teuthology.orchestra.run.smithi101.stdout: { 2023-08-01T19:54:51.270 INFO:teuthology.orchestra.run.smithi101.stdout: "event": "reached_pg", 2023-08-01T19:54:51.270 INFO:teuthology.orchestra.run.smithi101.stdout: "time": "2023-08-01T19:54:04.469447+0000", 2023-08-01T19:54:51.270 INFO:teuthology.orchestra.run.smithi101.stdout: "duration": 0.010145573999999999 2023-08-01T19:54:51.270 INFO:teuthology.orchestra.run.smithi101.stdout: }, 2023-08-01T19:54:51.270 INFO:teuthology.orchestra.run.smithi101.stdout: { 2023-08-01T19:54:51.270 INFO:teuthology.orchestra.run.smithi101.stdout: "event": "started", 2023-08-01T19:54:51.270 INFO:teuthology.orchestra.run.smithi101.stdout: "time": "2023-08-01T19:54:04.469559+0000", 2023-08-01T19:54:51.270 INFO:teuthology.orchestra.run.smithi101.stdout: "duration": 0.000112068 2023-08-01T19:54:51.271 INFO:teuthology.orchestra.run.smithi101.stdout: }, 2023-08-01T19:54:51.271 INFO:teuthology.orchestra.run.smithi101.stdout: { 2023-08-01T19:54:51.271 INFO:teuthology.orchestra.run.smithi101.stdout: "event": "waiting for subops from 0", 2023-08-01T19:54:51.271 INFO:teuthology.orchestra.run.smithi101.stdout: "time": "2023-08-01T19:54:04.469895+0000", 2023-08-01T19:54:51.271 INFO:teuthology.orchestra.run.smithi101.stdout: "duration": 0.000336604 2023-08-01T19:54:51.271 INFO:teuthology.orchestra.run.smithi101.stdout: }, 2023-08-01T19:54:51.271 INFO:teuthology.orchestra.run.smithi101.stdout: { 2023-08-01T19:54:51.271 INFO:teuthology.orchestra.run.smithi101.stdout: "event": "sub_op_commit_rec", 2023-08-01T19:54:51.272 INFO:teuthology.orchestra.run.smithi101.stdout: "time": "2023-08-01T19:54:04.475096+0000", 2023-08-01T19:54:51.272 INFO:teuthology.orchestra.run.smithi101.stdout: "duration": 0.0052010540000000001 2023-08-01T19:54:51.272 INFO:teuthology.orchestra.run.smithi101.stdout: }, 2023-08-01T19:54:51.272 INFO:teuthology.orchestra.run.smithi101.stdout: { 2023-08-01T19:54:51.272 INFO:teuthology.orchestra.run.smithi101.stdout: "event": "op_commit", 2023-08-01T19:54:51.272 INFO:teuthology.orchestra.run.smithi101.stdout: "time": "2023-08-01T19:54:04.475965+0000", 2023-08-01T19:54:51.272 INFO:teuthology.orchestra.run.smithi101.stdout: "duration": 0.00086860500000000005 2023-08-01T19:54:51.272 INFO:teuthology.orchestra.run.smithi101.stdout: }, 2023-08-01T19:54:51.273 INFO:teuthology.orchestra.run.smithi101.stdout: { 2023-08-01T19:54:51.273 INFO:teuthology.orchestra.run.smithi101.stdout: "event": "commit_sent", 2023-08-01T19:54:51.273 INFO:teuthology.orchestra.run.smithi101.stdout: "time": "2023-08-01T19:54:04.476007+0000", 2023-08-01T19:54:51.273 INFO:teuthology.orchestra.run.smithi101.stdout: "duration": 4.2228000000000003e-05 2023-08-01T19:54:51.273 INFO:teuthology.orchestra.run.smithi101.stdout: }, 2023-08-01T19:54:51.273 INFO:teuthology.orchestra.run.smithi101.stdout: { 2023-08-01T19:54:51.273 INFO:teuthology.orchestra.run.smithi101.stdout: "event": "done", 2023-08-01T19:54:51.273 INFO:teuthology.orchestra.run.smithi101.stdout: "time": "2023-08-01T19:54:04.476052+0000", 2023-08-01T19:54:51.274 INFO:teuthology.orchestra.run.smithi101.stdout: "duration": 4.5188000000000002e-05 2023-08-01T19:54:51.274 INFO:teuthology.orchestra.run.smithi101.stdout: } 2023-08-01T19:54:51.274 INFO:teuthology.orchestra.run.smithi101.stdout: ] 2023-08-01T19:54:51.274 INFO:teuthology.orchestra.run.smithi101.stdout: } 2023-08-01T19:54:51.274 INFO:teuthology.orchestra.run.smithi101.stdout: }, 2023-08-01T19:54:51.274 INFO:teuthology.orchestra.run.smithi101.stdout: { 2023-08-01T19:54:51.274 INFO:teuthology.orchestra.run.smithi101.stdout: "description": "osd_op(mds.0.3:32 3.14 3:2e2fa760:::200.00000001:head [delete] snapc 0=[] ondisk+write+known_if_redirected+full_force+supports_pool_eio e17)", 2023-08-01T19:54:51.275 INFO:teuthology.orchestra.run.smithi101.stdout: "initiated_at": "2023-08-01T19:54:04.459304+0000", 2023-08-01T19:54:51.275 INFO:teuthology.orchestra.run.smithi101.stdout: "age": 46.625151127999999, 2023-08-01T19:54:51.275 INFO:teuthology.orchestra.run.smithi101.stdout: "duration": 0.021110606000000001, 2023-08-01T19:54:51.275 INFO:teuthology.orchestra.run.smithi101.stdout: "type_data": { 2023-08-01T19:54:51.275 INFO:teuthology.orchestra.run.smithi101.stdout: "flag_point": "started", 2023-08-01T19:54:51.275 INFO:teuthology.orchestra.run.smithi101.stdout: "events": [ 2023-08-01T19:54:51.275 INFO:teuthology.orchestra.run.smithi101.stdout: { 2023-08-01T19:54:51.275 INFO:teuthology.orchestra.run.smithi101.stdout: "event": "initiated", 2023-08-01T19:54:51.276 INFO:teuthology.orchestra.run.smithi101.stdout: "time": "2023-08-01T19:54:04.459304+0000", 2023-08-01T19:54:51.276 INFO:teuthology.orchestra.run.smithi101.stdout: "duration": 0 2023-08-01T19:54:51.276 INFO:teuthology.orchestra.run.smithi101.stdout: }, 2023-08-01T19:54:51.276 INFO:teuthology.orchestra.run.smithi101.stdout: { 2023-08-01T19:54:51.276 INFO:teuthology.orchestra.run.smithi101.stdout: "event": "throttled", 2023-08-01T19:54:51.276 INFO:teuthology.orchestra.run.smithi101.stdout: "time": "2023-08-01T19:54:04.459304+0000", 2023-08-01T19:54:51.276 INFO:teuthology.orchestra.run.smithi101.stdout: "duration": 0 2023-08-01T19:54:51.277 INFO:teuthology.orchestra.run.smithi101.stdout: }, 2023-08-01T19:54:51.277 INFO:teuthology.orchestra.run.smithi101.stdout: { 2023-08-01T19:54:51.277 INFO:teuthology.orchestra.run.smithi101.stdout: "event": "header_read", 2023-08-01T19:54:51.277 INFO:teuthology.orchestra.run.smithi101.stdout: "time": "2023-08-01T19:54:04.459304+0000", 2023-08-01T19:54:51.277 INFO:teuthology.orchestra.run.smithi101.stdout: "duration": 4294967295.9999995 2023-08-01T19:54:51.277 INFO:teuthology.orchestra.run.smithi101.stdout: }, 2023-08-01T19:54:51.277 INFO:teuthology.orchestra.run.smithi101.stdout: { 2023-08-01T19:54:51.277 INFO:teuthology.orchestra.run.smithi101.stdout: "event": "all_read", 2023-08-01T19:54:51.278 INFO:teuthology.orchestra.run.smithi101.stdout: "time": "2023-08-01T19:54:04.459306+0000", 2023-08-01T19:54:51.278 INFO:teuthology.orchestra.run.smithi101.stdout: "duration": 2.3889999999999999e-06 2023-08-01T19:54:51.278 INFO:teuthology.orchestra.run.smithi101.stdout: }, 2023-08-01T19:54:51.278 INFO:teuthology.orchestra.run.smithi101.stdout: { 2023-08-01T19:54:51.278 INFO:teuthology.orchestra.run.smithi101.stdout: "event": "dispatched", 2023-08-01T19:54:51.278 INFO:teuthology.orchestra.run.smithi101.stdout: "time": "2023-08-01T19:54:04.459314+0000", 2023-08-01T19:54:51.278 INFO:teuthology.orchestra.run.smithi101.stdout: "duration": 7.1180000000000003e-06 2023-08-01T19:54:51.279 INFO:teuthology.orchestra.run.smithi101.stdout: }, 2023-08-01T19:54:51.279 INFO:teuthology.orchestra.run.smithi101.stdout: { 2023-08-01T19:54:51.279 INFO:teuthology.orchestra.run.smithi101.stdout: "event": "queued_for_pg", 2023-08-01T19:54:51.279 INFO:teuthology.orchestra.run.smithi101.stdout: "time": "2023-08-01T19:54:04.459318+0000", 2023-08-01T19:54:51.279 INFO:teuthology.orchestra.run.smithi101.stdout: "duration": 4.0239999999999999e-06 2023-08-01T19:54:51.279 INFO:teuthology.orchestra.run.smithi101.stdout: }, 2023-08-01T19:54:51.279 INFO:teuthology.orchestra.run.smithi101.stdout: { 2023-08-01T19:54:51.279 INFO:teuthology.orchestra.run.smithi101.stdout: "event": "reached_pg", 2023-08-01T19:54:51.280 INFO:teuthology.orchestra.run.smithi101.stdout: "time": "2023-08-01T19:54:04.459340+0000", 2023-08-01T19:54:51.280 INFO:teuthology.orchestra.run.smithi101.stdout: "duration": 2.2476e-05 2023-08-01T19:54:51.280 INFO:teuthology.orchestra.run.smithi101.stdout: }, 2023-08-01T19:54:51.280 INFO:teuthology.orchestra.run.smithi101.stdout: { 2023-08-01T19:54:51.280 INFO:teuthology.orchestra.run.smithi101.stdout: "event": "waiting_for_map not empty", 2023-08-01T19:54:51.280 INFO:teuthology.orchestra.run.smithi101.stdout: "time": "2023-08-01T19:54:04.459342+0000", 2023-08-01T19:54:51.280 INFO:teuthology.orchestra.run.smithi101.stdout: "duration": 2.272e-06 2023-08-01T19:54:51.280 INFO:teuthology.orchestra.run.smithi101.stdout: }, 2023-08-01T19:54:51.281 INFO:teuthology.orchestra.run.smithi101.stdout: { 2023-08-01T19:54:51.281 INFO:teuthology.orchestra.run.smithi101.stdout: "event": "reached_pg", 2023-08-01T19:54:51.281 INFO:teuthology.orchestra.run.smithi101.stdout: "time": "2023-08-01T19:54:04.475922+0000", 2023-08-01T19:54:51.281 INFO:teuthology.orchestra.run.smithi101.stdout: "duration": 0.016579388 2023-08-01T19:54:51.281 INFO:teuthology.orchestra.run.smithi101.stdout: }, 2023-08-01T19:54:51.281 INFO:teuthology.orchestra.run.smithi101.stdout: { 2023-08-01T19:54:51.281 INFO:teuthology.orchestra.run.smithi101.stdout: "event": "started", 2023-08-01T19:54:51.281 INFO:teuthology.orchestra.run.smithi101.stdout: "time": "2023-08-01T19:54:04.476107+0000", 2023-08-01T19:54:51.282 INFO:teuthology.orchestra.run.smithi101.stdout: "duration": 0.00018486300000000001 2023-08-01T19:54:51.282 INFO:teuthology.orchestra.run.smithi101.stdout: }, 2023-08-01T19:54:51.282 INFO:teuthology.orchestra.run.smithi101.stdout: { 2023-08-01T19:54:51.282 INFO:teuthology.orchestra.run.smithi101.stdout: "event": "done", 2023-08-01T19:54:51.282 INFO:teuthology.orchestra.run.smithi101.stdout: "time": "2023-08-01T19:54:04.480415+0000", 2023-08-01T19:54:51.282 INFO:teuthology.orchestra.run.smithi101.stdout: "duration": 0.0043084589999999997 2023-08-01T19:54:51.282 INFO:teuthology.orchestra.run.smithi101.stdout: } 2023-08-01T19:54:51.282 INFO:teuthology.orchestra.run.smithi101.stdout: ] 2023-08-01T19:54:51.283 INFO:teuthology.orchestra.run.smithi101.stdout: } 2023-08-01T19:54:51.283 INFO:teuthology.orchestra.run.smithi101.stdout: }, 2023-08-01T19:54:51.283 INFO:teuthology.orchestra.run.smithi101.stdout: { 2023-08-01T19:54:51.283 INFO:teuthology.orchestra.run.smithi101.stdout: "description": "osd_op(client.4668.0:62896 5.f 5:f59d90d6:::benchmark_data_smithi006_114134_object62895:head [set-alloc-hint object_size 65536 write_size 65536,write 0~65536] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e29)", 2023-08-01T19:54:51.283 INFO:teuthology.orchestra.run.smithi101.stdout: "initiated_at": "2023-08-01T19:54:46.254123+0000", 2023-08-01T19:54:51.283 INFO:teuthology.orchestra.run.smithi101.stdout: "age": 4.8303322340000001, 2023-08-01T19:54:51.283 INFO:teuthology.orchestra.run.smithi101.stdout: "duration": 0.018097106000000002, 2023-08-01T19:54:51.284 INFO:teuthology.orchestra.run.smithi101.stdout: "type_data": { 2023-08-01T19:54:51.284 INFO:teuthology.orchestra.run.smithi101.stdout: "flag_point": "commit sent; apply or cleanup", 2023-08-01T19:54:51.284 INFO:teuthology.orchestra.run.smithi101.stdout: "client_info": { 2023-08-01T19:54:51.284 INFO:teuthology.orchestra.run.smithi101.stdout: "client": "client.4668", 2023-08-01T19:54:51.284 INFO:teuthology.orchestra.run.smithi101.stdout: "client_addr": "172.21.15.6:0/1709472247", 2023-08-01T19:54:51.284 INFO:teuthology.orchestra.run.smithi101.stdout: "tid": 62896 2023-08-01T19:54:51.284 INFO:teuthology.orchestra.run.smithi101.stdout: }, 2023-08-01T19:54:51.284 INFO:teuthology.orchestra.run.smithi101.stdout: "events": [ 2023-08-01T19:54:51.285 INFO:teuthology.orchestra.run.smithi101.stdout: { 2023-08-01T19:54:51.285 INFO:teuthology.orchestra.run.smithi101.stdout: "event": "initiated", 2023-08-01T19:54:51.285 INFO:teuthology.orchestra.run.smithi101.stdout: "time": "2023-08-01T19:54:46.254123+0000", 2023-08-01T19:54:51.285 INFO:teuthology.orchestra.run.smithi101.stdout: "duration": 0 2023-08-01T19:54:51.285 INFO:teuthology.orchestra.run.smithi101.stdout: }, 2023-08-01T19:54:51.285 INFO:teuthology.orchestra.run.smithi101.stdout: { 2023-08-01T19:54:51.285 INFO:teuthology.orchestra.run.smithi101.stdout: "event": "throttled", 2023-08-01T19:54:51.285 INFO:teuthology.orchestra.run.smithi101.stdout: "time": "2023-08-01T19:54:46.254123+0000", 2023-08-01T19:54:51.286 INFO:teuthology.orchestra.run.smithi101.stdout: "duration": 0 2023-08-01T19:54:51.286 INFO:teuthology.orchestra.run.smithi101.stdout: }, 2023-08-01T19:54:51.286 INFO:teuthology.orchestra.run.smithi101.stdout: { 2023-08-01T19:54:51.286 INFO:teuthology.orchestra.run.smithi101.stdout: "event": "header_read", 2023-08-01T19:54:51.286 INFO:teuthology.orchestra.run.smithi101.stdout: "time": "2023-08-01T19:54:46.254122+0000", 2023-08-01T19:54:51.286 INFO:teuthology.orchestra.run.smithi101.stdout: "duration": 4294967295.999999 2023-08-01T19:54:51.286 INFO:teuthology.orchestra.run.smithi101.stdout: }, 2023-08-01T19:54:51.286 INFO:teuthology.orchestra.run.smithi101.stdout: { 2023-08-01T19:54:51.287 INFO:teuthology.orchestra.run.smithi101.stdout: "event": "all_read", 2023-08-01T19:54:51.287 INFO:teuthology.orchestra.run.smithi101.stdout: "time": "2023-08-01T19:54:46.254214+0000", 2023-08-01T19:54:51.287 INFO:teuthology.orchestra.run.smithi101.stdout: "duration": 9.1421000000000004e-05 2023-08-01T19:54:51.287 INFO:teuthology.orchestra.run.smithi101.stdout: }, 2023-08-01T19:54:51.287 INFO:teuthology.orchestra.run.smithi101.stdout: { 2023-08-01T19:54:51.287 INFO:teuthology.orchestra.run.smithi101.stdout: "event": "dispatched", 2023-08-01T19:54:51.287 INFO:teuthology.orchestra.run.smithi101.stdout: "time": "2023-08-01T19:54:46.254222+0000", 2023-08-01T19:54:51.287 INFO:teuthology.orchestra.run.smithi101.stdout: "duration": 8.6100000000000006e-06 2023-08-01T19:54:51.288 INFO:teuthology.orchestra.run.smithi101.stdout: }, 2023-08-01T19:54:51.288 INFO:teuthology.orchestra.run.smithi101.stdout: { 2023-08-01T19:54:51.288 INFO:teuthology.orchestra.run.smithi101.stdout: "event": "queued_for_pg", 2023-08-01T19:54:51.288 INFO:teuthology.orchestra.run.smithi101.stdout: "time": "2023-08-01T19:54:46.254228+0000", 2023-08-01T19:54:51.288 INFO:teuthology.orchestra.run.smithi101.stdout: "duration": 5.5840000000000002e-06 2023-08-01T19:54:51.288 INFO:teuthology.orchestra.run.smithi101.stdout: }, 2023-08-01T19:54:51.289 INFO:teuthology.orchestra.run.smithi101.stdout: { 2023-08-01T19:54:51.289 INFO:teuthology.orchestra.run.smithi101.stdout: "event": "reached_pg", 2023-08-01T19:54:51.289 INFO:teuthology.orchestra.run.smithi101.stdout: "time": "2023-08-01T19:54:46.254259+0000", 2023-08-01T19:54:51.289 INFO:teuthology.orchestra.run.smithi101.stdout: "duration": 3.0580999999999997e-05 2023-08-01T19:54:51.289 INFO:teuthology.orchestra.run.smithi101.stdout: }, 2023-08-01T19:54:51.289 INFO:teuthology.orchestra.run.smithi101.stdout: { 2023-08-01T19:54:51.289 INFO:teuthology.orchestra.run.smithi101.stdout: "event": "started", 2023-08-01T19:54:51.289 INFO:teuthology.orchestra.run.smithi101.stdout: "time": "2023-08-01T19:54:46.254342+0000", 2023-08-01T19:54:51.290 INFO:teuthology.orchestra.run.smithi101.stdout: "duration": 8.3183999999999995e-05 2023-08-01T19:54:51.290 INFO:teuthology.orchestra.run.smithi101.stdout: }, 2023-08-01T19:54:51.290 INFO:teuthology.orchestra.run.smithi101.stdout: { 2023-08-01T19:54:51.290 INFO:teuthology.orchestra.run.smithi101.stdout: "event": "waiting for subops from 2", 2023-08-01T19:54:51.290 INFO:teuthology.orchestra.run.smithi101.stdout: "time": "2023-08-01T19:54:46.254422+0000", 2023-08-01T19:54:51.290 INFO:teuthology.orchestra.run.smithi101.stdout: "duration": 7.9703000000000006e-05 2023-08-01T19:54:51.290 INFO:teuthology.orchestra.run.smithi101.stdout: }, 2023-08-01T19:54:51.290 INFO:teuthology.orchestra.run.smithi101.stdout: { 2023-08-01T19:54:51.291 INFO:teuthology.orchestra.run.smithi101.stdout: "event": "sub_op_commit_rec", 2023-08-01T19:54:51.291 INFO:teuthology.orchestra.run.smithi101.stdout: "time": "2023-08-01T19:54:46.259940+0000", 2023-08-01T19:54:51.291 INFO:teuthology.orchestra.run.smithi101.stdout: "duration": 0.0055188650000000004 2023-08-01T19:54:51.291 INFO:teuthology.orchestra.run.smithi101.stdout: }, 2023-08-01T19:54:51.291 INFO:teuthology.orchestra.run.smithi101.stdout: { 2023-08-01T19:54:51.291 INFO:teuthology.orchestra.run.smithi101.stdout: "event": "op_commit", 2023-08-01T19:54:51.291 INFO:teuthology.orchestra.run.smithi101.stdout: "time": "2023-08-01T19:54:46.272127+0000", 2023-08-01T19:54:51.291 INFO:teuthology.orchestra.run.smithi101.stdout: "duration": 0.012186463 2023-08-01T19:54:51.292 INFO:teuthology.orchestra.run.smithi101.stdout: }, 2023-08-01T19:54:51.292 INFO:teuthology.orchestra.run.smithi101.stdout: { 2023-08-01T19:54:51.292 INFO:teuthology.orchestra.run.smithi101.stdout: "event": "commit_sent", 2023-08-01T19:54:51.292 INFO:teuthology.orchestra.run.smithi101.stdout: "time": "2023-08-01T19:54:46.272178+0000", 2023-08-01T19:54:51.292 INFO:teuthology.orchestra.run.smithi101.stdout: "duration": 5.1332000000000003e-05 2023-08-01T19:54:51.292 INFO:teuthology.orchestra.run.smithi101.stdout: }, 2023-08-01T19:54:51.292 INFO:teuthology.orchestra.run.smithi101.stdout: { 2023-08-01T19:54:51.293 INFO:teuthology.orchestra.run.smithi101.stdout: "event": "done", 2023-08-01T19:54:51.293 INFO:teuthology.orchestra.run.smithi101.stdout: "time": "2023-08-01T19:54:46.272220+0000", 2023-08-01T19:54:51.293 INFO:teuthology.orchestra.run.smithi101.stdout: "duration": 4.2227000000000001e-05 2023-08-01T19:54:51.293 INFO:teuthology.orchestra.run.smithi101.stdout: } 2023-08-01T19:54:51.293 INFO:teuthology.orchestra.run.smithi101.stdout: ] 2023-08-01T19:54:51.293 INFO:teuthology.orchestra.run.smithi101.stdout: } 2023-08-01T19:54:51.293 INFO:teuthology.orchestra.run.smithi101.stdout: }, 2023-08-01T19:54:51.293 INFO:teuthology.orchestra.run.smithi101.stdout: { 2023-08-01T19:54:51.294 INFO:teuthology.orchestra.run.smithi101.stdout: "description": "osd_op(client.4668.0:62898 5.f 5:fa45093a:::benchmark_data_smithi006_114134_object62897:head [set-alloc-hint object_size 65536 write_size 65536,write 0~65536] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e29)", 2023-08-01T19:54:51.294 INFO:teuthology.orchestra.run.smithi101.stdout: "initiated_at": "2023-08-01T19:54:46.254356+0000", 2023-08-01T19:54:51.294 INFO:teuthology.orchestra.run.smithi101.stdout: "age": 4.8300994089999998, 2023-08-01T19:54:51.294 INFO:teuthology.orchestra.run.smithi101.stdout: "duration": 0.017950870000000001, 2023-08-01T19:54:51.294 INFO:teuthology.orchestra.run.smithi101.stdout: "type_data": { 2023-08-01T19:54:51.294 INFO:teuthology.orchestra.run.smithi101.stdout: "flag_point": "commit sent; apply or cleanup", 2023-08-01T19:54:51.294 INFO:teuthology.orchestra.run.smithi101.stdout: "client_info": { 2023-08-01T19:54:51.294 INFO:teuthology.orchestra.run.smithi101.stdout: "client": "client.4668", 2023-08-01T19:54:51.295 INFO:teuthology.orchestra.run.smithi101.stdout: "client_addr": "172.21.15.6:0/1709472247", 2023-08-01T19:54:51.295 INFO:teuthology.orchestra.run.smithi101.stdout: "tid": 62898 2023-08-01T19:54:51.295 INFO:teuthology.orchestra.run.smithi101.stdout: }, 2023-08-01T19:54:51.295 INFO:teuthology.orchestra.run.smithi101.stdout: "events": [ 2023-08-01T19:54:51.295 INFO:teuthology.orchestra.run.smithi101.stdout: { 2023-08-01T19:54:51.295 INFO:teuthology.orchestra.run.smithi101.stdout: "event": "initiated", 2023-08-01T19:54:51.295 INFO:teuthology.orchestra.run.smithi101.stdout: "time": "2023-08-01T19:54:46.254356+0000", 2023-08-01T19:54:51.295 INFO:teuthology.orchestra.run.smithi101.stdout: "duration": 0 2023-08-01T19:54:51.296 INFO:teuthology.orchestra.run.smithi101.stdout: }, 2023-08-01T19:54:51.296 INFO:teuthology.orchestra.run.smithi101.stdout: { 2023-08-01T19:54:51.296 INFO:teuthology.orchestra.run.smithi101.stdout: "event": "throttled", 2023-08-01T19:54:51.296 INFO:teuthology.orchestra.run.smithi101.stdout: "time": "2023-08-01T19:54:46.254356+0000", 2023-08-01T19:54:51.296 INFO:teuthology.orchestra.run.smithi101.stdout: "duration": 0 2023-08-01T19:54:51.296 INFO:teuthology.orchestra.run.smithi101.stdout: }, 2023-08-01T19:54:51.296 INFO:teuthology.orchestra.run.smithi101.stdout: { 2023-08-01T19:54:51.297 INFO:teuthology.orchestra.run.smithi101.stdout: "event": "header_read", 2023-08-01T19:54:51.297 INFO:teuthology.orchestra.run.smithi101.stdout: "time": "2023-08-01T19:54:46.254355+0000", 2023-08-01T19:54:51.297 INFO:teuthology.orchestra.run.smithi101.stdout: "duration": 4294967295.9999995 2023-08-01T19:54:51.297 INFO:teuthology.orchestra.run.smithi101.stdout: }, 2023-08-01T19:54:51.297 INFO:teuthology.orchestra.run.smithi101.stdout: { 2023-08-01T19:54:51.297 INFO:teuthology.orchestra.run.smithi101.stdout: "event": "all_read", 2023-08-01T19:54:51.297 INFO:teuthology.orchestra.run.smithi101.stdout: "time": "2023-08-01T19:54:46.254415+0000", 2023-08-01T19:54:51.297 INFO:teuthology.orchestra.run.smithi101.stdout: "duration": 5.9713999999999998e-05 2023-08-01T19:54:51.298 INFO:teuthology.orchestra.run.smithi101.stdout: }, 2023-08-01T19:54:51.298 INFO:teuthology.orchestra.run.smithi101.stdout: { 2023-08-01T19:54:51.298 INFO:teuthology.orchestra.run.smithi101.stdout: "event": "dispatched", 2023-08-01T19:54:51.298 INFO:teuthology.orchestra.run.smithi101.stdout: "time": "2023-08-01T19:54:46.254423+0000", 2023-08-01T19:54:51.298 INFO:teuthology.orchestra.run.smithi101.stdout: "duration": 7.8399999999999995e-06 2023-08-01T19:54:51.298 INFO:teuthology.orchestra.run.smithi101.stdout: }, 2023-08-01T19:54:51.298 INFO:teuthology.orchestra.run.smithi101.stdout: { 2023-08-01T19:54:51.298 INFO:teuthology.orchestra.run.smithi101.stdout: "event": "queued_for_pg", 2023-08-01T19:54:51.299 INFO:teuthology.orchestra.run.smithi101.stdout: "time": "2023-08-01T19:54:46.254428+0000", 2023-08-01T19:54:51.299 INFO:teuthology.orchestra.run.smithi101.stdout: "duration": 4.5040000000000004e-06 2023-08-01T19:54:51.299 INFO:teuthology.orchestra.run.smithi101.stdout: }, 2023-08-01T19:54:51.299 INFO:teuthology.orchestra.run.smithi101.stdout: { 2023-08-01T19:54:51.299 INFO:teuthology.orchestra.run.smithi101.stdout: "event": "reached_pg", 2023-08-01T19:54:51.299 INFO:teuthology.orchestra.run.smithi101.stdout: "time": "2023-08-01T19:54:46.255926+0000", 2023-08-01T19:54:51.299 INFO:teuthology.orchestra.run.smithi101.stdout: "duration": 0.001498741 2023-08-01T19:54:51.300 INFO:teuthology.orchestra.run.smithi101.stdout: }, 2023-08-01T19:54:51.300 INFO:teuthology.orchestra.run.smithi101.stdout: { 2023-08-01T19:54:51.300 INFO:teuthology.orchestra.run.smithi101.stdout: "event": "started", 2023-08-01T19:54:51.300 INFO:teuthology.orchestra.run.smithi101.stdout: "time": "2023-08-01T19:54:46.256006+0000", 2023-08-01T19:54:51.300 INFO:teuthology.orchestra.run.smithi101.stdout: "duration": 8.0185000000000006e-05 2023-08-01T19:54:51.300 INFO:teuthology.orchestra.run.smithi101.stdout: }, 2023-08-01T19:54:51.300 INFO:teuthology.orchestra.run.smithi101.stdout: { 2023-08-01T19:54:51.300 INFO:teuthology.orchestra.run.smithi101.stdout: "event": "waiting for subops from 2", 2023-08-01T19:54:51.301 INFO:teuthology.orchestra.run.smithi101.stdout: "time": "2023-08-01T19:54:46.256158+0000", 2023-08-01T19:54:51.301 INFO:teuthology.orchestra.run.smithi101.stdout: "duration": 0.00015124 2023-08-01T19:54:51.301 INFO:teuthology.orchestra.run.smithi101.stdout: }, 2023-08-01T19:54:51.301 INFO:teuthology.orchestra.run.smithi101.stdout: { 2023-08-01T19:54:51.301 INFO:teuthology.orchestra.run.smithi101.stdout: "event": "sub_op_commit_rec", 2023-08-01T19:54:51.301 INFO:teuthology.orchestra.run.smithi101.stdout: "time": "2023-08-01T19:54:46.260449+0000", 2023-08-01T19:54:51.301 INFO:teuthology.orchestra.run.smithi101.stdout: "duration": 0.0042917179999999999 2023-08-01T19:54:51.301 INFO:teuthology.orchestra.run.smithi101.stdout: }, 2023-08-01T19:54:51.302 INFO:teuthology.orchestra.run.smithi101.stdout: { 2023-08-01T19:54:51.302 INFO:teuthology.orchestra.run.smithi101.stdout: "event": "op_commit", 2023-08-01T19:54:51.302 INFO:teuthology.orchestra.run.smithi101.stdout: "time": "2023-08-01T19:54:46.272229+0000", 2023-08-01T19:54:51.302 INFO:teuthology.orchestra.run.smithi101.stdout: "duration": 0.011779243999999999 2023-08-01T19:54:51.302 INFO:teuthology.orchestra.run.smithi101.stdout: }, 2023-08-01T19:54:51.302 INFO:teuthology.orchestra.run.smithi101.stdout: { 2023-08-01T19:54:51.302 INFO:teuthology.orchestra.run.smithi101.stdout: "event": "commit_sent", 2023-08-01T19:54:51.302 INFO:teuthology.orchestra.run.smithi101.stdout: "time": "2023-08-01T19:54:46.272270+0000", 2023-08-01T19:54:51.303 INFO:teuthology.orchestra.run.smithi101.stdout: "duration": 4.1516e-05 2023-08-01T19:54:51.303 INFO:teuthology.orchestra.run.smithi101.stdout: }, 2023-08-01T19:54:51.303 INFO:teuthology.orchestra.run.smithi101.stdout: { 2023-08-01T19:54:51.303 INFO:teuthology.orchestra.run.smithi101.stdout: "event": "done", 2023-08-01T19:54:51.303 INFO:teuthology.orchestra.run.smithi101.stdout: "time": "2023-08-01T19:54:46.272307+0000", 2023-08-01T19:54:51.303 INFO:teuthology.orchestra.run.smithi101.stdout: "duration": 3.6813000000000001e-05 2023-08-01T19:54:51.303 INFO:teuthology.orchestra.run.smithi101.stdout: } 2023-08-01T19:54:51.304 INFO:teuthology.orchestra.run.smithi101.stdout: ] 2023-08-01T19:54:51.304 INFO:teuthology.orchestra.run.smithi101.stdout: } 2023-08-01T19:54:51.304 INFO:teuthology.orchestra.run.smithi101.stdout: }, 2023-08-01T19:54:51.304 INFO:teuthology.orchestra.run.smithi101.stdout: { 2023-08-01T19:54:51.304 INFO:teuthology.orchestra.run.smithi101.stdout: "description": "osd_op(client.4668.0:70878 5.2 5:49b7d2be:::benchmark_data_smithi006_114134_object70877:head [set-alloc-hint object_size 65536 write_size 65536,write 0~65536] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e30)", 2023-08-01T19:54:51.304 INFO:teuthology.orchestra.run.smithi101.stdout: "initiated_at": "2023-08-01T19:54:50.210223+0000", 2023-08-01T19:54:51.304 INFO:teuthology.orchestra.run.smithi101.stdout: "age": 0.87423255799999999, 2023-08-01T19:54:51.304 INFO:teuthology.orchestra.run.smithi101.stdout: "duration": 0.019884895, 2023-08-01T19:54:51.305 INFO:teuthology.orchestra.run.smithi101.stdout: "type_data": { 2023-08-01T19:54:51.305 INFO:teuthology.orchestra.run.smithi101.stdout: "flag_point": "commit sent; apply or cleanup", 2023-08-01T19:54:51.305 INFO:teuthology.orchestra.run.smithi101.stdout: "client_info": { 2023-08-01T19:54:51.305 INFO:teuthology.orchestra.run.smithi101.stdout: "client": "client.4668", 2023-08-01T19:54:51.305 INFO:teuthology.orchestra.run.smithi101.stdout: "client_addr": "172.21.15.6:0/1709472247", 2023-08-01T19:54:51.305 INFO:teuthology.orchestra.run.smithi101.stdout: "tid": 70878 2023-08-01T19:54:51.305 INFO:teuthology.orchestra.run.smithi101.stdout: }, 2023-08-01T19:54:51.306 INFO:teuthology.orchestra.run.smithi101.stdout: "events": [ 2023-08-01T19:54:51.306 INFO:teuthology.orchestra.run.smithi101.stdout: { 2023-08-01T19:54:51.306 INFO:teuthology.orchestra.run.smithi101.stdout: "event": "initiated", 2023-08-01T19:54:51.306 INFO:teuthology.orchestra.run.smithi101.stdout: "time": "2023-08-01T19:54:50.210223+0000", 2023-08-01T19:54:51.306 INFO:teuthology.orchestra.run.smithi101.stdout: "duration": 0 2023-08-01T19:54:51.306 INFO:teuthology.orchestra.run.smithi101.stdout: }, 2023-08-01T19:54:51.306 INFO:teuthology.orchestra.run.smithi101.stdout: { 2023-08-01T19:54:51.306 INFO:teuthology.orchestra.run.smithi101.stdout: "event": "throttled", 2023-08-01T19:54:51.307 INFO:teuthology.orchestra.run.smithi101.stdout: "time": "2023-08-01T19:54:50.210223+0000", 2023-08-01T19:54:51.307 INFO:teuthology.orchestra.run.smithi101.stdout: "duration": 0 2023-08-01T19:54:51.307 INFO:teuthology.orchestra.run.smithi101.stdout: }, 2023-08-01T19:54:51.307 INFO:teuthology.orchestra.run.smithi101.stdout: { 2023-08-01T19:54:51.307 INFO:teuthology.orchestra.run.smithi101.stdout: "event": "header_read", 2023-08-01T19:54:51.307 INFO:teuthology.orchestra.run.smithi101.stdout: "time": "2023-08-01T19:54:50.210222+0000", 2023-08-01T19:54:51.307 INFO:teuthology.orchestra.run.smithi101.stdout: "duration": 4294967295.999999 2023-08-01T19:54:51.307 INFO:teuthology.orchestra.run.smithi101.stdout: }, 2023-08-01T19:54:51.308 INFO:teuthology.orchestra.run.smithi101.stdout: { 2023-08-01T19:54:51.308 INFO:teuthology.orchestra.run.smithi101.stdout: "event": "all_read", 2023-08-01T19:54:51.308 INFO:teuthology.orchestra.run.smithi101.stdout: "time": "2023-08-01T19:54:50.210315+0000", 2023-08-01T19:54:51.308 INFO:teuthology.orchestra.run.smithi101.stdout: "duration": 9.2567999999999999e-05 2023-08-01T19:54:51.308 INFO:teuthology.orchestra.run.smithi101.stdout: }, 2023-08-01T19:54:51.308 INFO:teuthology.orchestra.run.smithi101.stdout: { 2023-08-01T19:54:51.308 INFO:teuthology.orchestra.run.smithi101.stdout: "event": "dispatched", 2023-08-01T19:54:51.308 INFO:teuthology.orchestra.run.smithi101.stdout: "time": "2023-08-01T19:54:50.210326+0000", 2023-08-01T19:54:51.309 INFO:teuthology.orchestra.run.smithi101.stdout: "duration": 1.1430000000000001e-05 2023-08-01T19:54:51.309 INFO:teuthology.orchestra.run.smithi101.stdout: }, 2023-08-01T19:54:51.309 INFO:teuthology.orchestra.run.smithi101.stdout: { 2023-08-01T19:54:51.309 INFO:teuthology.orchestra.run.smithi101.stdout: "event": "queued_for_pg", 2023-08-01T19:54:51.309 INFO:teuthology.orchestra.run.smithi101.stdout: "time": "2023-08-01T19:54:50.210332+0000", 2023-08-01T19:54:51.309 INFO:teuthology.orchestra.run.smithi101.stdout: "duration": 5.8479999999999997e-06 2023-08-01T19:54:51.309 INFO:teuthology.orchestra.run.smithi101.stdout: }, 2023-08-01T19:54:51.309 INFO:teuthology.orchestra.run.smithi101.stdout: { 2023-08-01T19:54:51.310 INFO:teuthology.orchestra.run.smithi101.stdout: "event": "reached_pg", 2023-08-01T19:54:51.310 INFO:teuthology.orchestra.run.smithi101.stdout: "time": "2023-08-01T19:54:50.214259+0000", 2023-08-01T19:54:51.310 INFO:teuthology.orchestra.run.smithi101.stdout: "duration": 0.003926789 2023-08-01T19:54:51.310 INFO:teuthology.orchestra.run.smithi101.stdout: }, 2023-08-01T19:54:51.310 INFO:teuthology.orchestra.run.smithi101.stdout: { 2023-08-01T19:54:51.310 INFO:teuthology.orchestra.run.smithi101.stdout: "event": "started", 2023-08-01T19:54:51.310 INFO:teuthology.orchestra.run.smithi101.stdout: "time": "2023-08-01T19:54:50.214387+0000", 2023-08-01T19:54:51.311 INFO:teuthology.orchestra.run.smithi101.stdout: "duration": 0.00012787599999999999 2023-08-01T19:54:51.311 INFO:teuthology.orchestra.run.smithi101.stdout: }, 2023-08-01T19:54:51.311 INFO:teuthology.orchestra.run.smithi101.stdout: { 2023-08-01T19:54:51.311 INFO:teuthology.orchestra.run.smithi101.stdout: "event": "waiting for subops from 0", 2023-08-01T19:54:51.311 INFO:teuthology.orchestra.run.smithi101.stdout: "time": "2023-08-01T19:54:50.214536+0000", 2023-08-01T19:54:51.311 INFO:teuthology.orchestra.run.smithi101.stdout: "duration": 0.00014935299999999999 2023-08-01T19:54:51.311 INFO:teuthology.orchestra.run.smithi101.stdout: }, 2023-08-01T19:54:51.311 INFO:teuthology.orchestra.run.smithi101.stdout: { 2023-08-01T19:54:51.312 INFO:teuthology.orchestra.run.smithi101.stdout: "event": "op_commit", 2023-08-01T19:54:51.312 INFO:teuthology.orchestra.run.smithi101.stdout: "time": "2023-08-01T19:54:50.217739+0000", 2023-08-01T19:54:51.312 INFO:teuthology.orchestra.run.smithi101.stdout: "duration": 0.0032034619999999998 2023-08-01T19:54:51.312 INFO:teuthology.orchestra.run.smithi101.stdout: }, 2023-08-01T19:54:51.312 INFO:teuthology.orchestra.run.smithi101.stdout: { 2023-08-01T19:54:51.312 INFO:teuthology.orchestra.run.smithi101.stdout: "event": "sub_op_commit_rec", 2023-08-01T19:54:51.312 INFO:teuthology.orchestra.run.smithi101.stdout: "time": "2023-08-01T19:54:50.230032+0000", 2023-08-01T19:54:51.312 INFO:teuthology.orchestra.run.smithi101.stdout: "duration": 0.012293068000000001 2023-08-01T19:54:51.313 INFO:teuthology.orchestra.run.smithi101.stdout: }, 2023-08-01T19:54:51.313 INFO:teuthology.orchestra.run.smithi101.stdout: { 2023-08-01T19:54:51.313 INFO:teuthology.orchestra.run.smithi101.stdout: "event": "commit_sent", 2023-08-01T19:54:51.313 INFO:teuthology.orchestra.run.smithi101.stdout: "time": "2023-08-01T19:54:50.230075+0000", 2023-08-01T19:54:51.313 INFO:teuthology.orchestra.run.smithi101.stdout: "duration": 4.3062999999999997e-05 2023-08-01T19:54:51.313 INFO:teuthology.orchestra.run.smithi101.stdout: }, 2023-08-01T19:54:51.313 INFO:teuthology.orchestra.run.smithi101.stdout: { 2023-08-01T19:54:51.314 INFO:teuthology.orchestra.run.smithi101.stdout: "event": "done", 2023-08-01T19:54:51.314 INFO:teuthology.orchestra.run.smithi101.stdout: "time": "2023-08-01T19:54:50.230108+0000", 2023-08-01T19:54:51.314 INFO:teuthology.orchestra.run.smithi101.stdout: "duration": 3.2366999999999997e-05 2023-08-01T19:54:51.314 INFO:teuthology.orchestra.run.smithi101.stdout: } 2023-08-01T19:54:51.314 INFO:teuthology.orchestra.run.smithi101.stdout: ] 2023-08-01T19:54:51.314 INFO:teuthology.orchestra.run.smithi101.stdout: } 2023-08-01T19:54:51.314 INFO:teuthology.orchestra.run.smithi101.stdout: } 2023-08-01T19:54:51.314 INFO:teuthology.orchestra.run.smithi101.stdout: ] 2023-08-01T19:54:51.315 INFO:teuthology.orchestra.run.smithi101.stdout:} 2023-08-01T19:54:51.316 INFO:tasks.radosbench.radosbench.0.smithi006.stdout: 27 16 73151 73135 169.28 128.688 0.00881352 0.00590479 2023-08-01T19:54:51.316 INFO:tasks.ceph.osd.2.smithi155.stderr:2023-08-01T19:54:51.314+0000 7faa5c6ac700 -1 received signal: Hangup from /usr/bin/python3 /bin/daemon-helper kill ceph-osd -f --cluster ceph -i 2 (PID: 111337) UID: 0 2023-08-01T19:54:51.317 DEBUG:teuthology.orchestra.run.smithi155:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 30 ceph --cluster ceph --admin-daemon /var/run/ceph/ceph-osd.2.asok dump_ops_in_flight 2023-08-01T19:54:51.417 INFO:tasks.ceph.osd.2.smithi155.stderr:2023-08-01T19:54:51.415+0000 7faa5c6ac700 -1 received signal: Hangup from /usr/bin/python3 /bin/daemon-helper kill ceph-osd -f --cluster ceph -i 2 (PID: 111337) UID: 0 2023-08-01T19:54:51.488 INFO:teuthology.orchestra.run.smithi155.stdout:{ 2023-08-01T19:54:51.488 INFO:teuthology.orchestra.run.smithi155.stdout: "ops": [ 2023-08-01T19:54:51.488 INFO:teuthology.orchestra.run.smithi155.stdout: { 2023-08-01T19:54:51.488 INFO:teuthology.orchestra.run.smithi155.stdout: "description": "osd_repop_reply(client.4668.0:73475 5.8 e31/19)", 2023-08-01T19:54:51.489 INFO:teuthology.orchestra.run.smithi155.stdout: "initiated_at": "2023-08-01T19:54:51.485904+0000", 2023-08-01T19:54:51.489 INFO:teuthology.orchestra.run.smithi155.stdout: "age": 0.00025619899999999998, 2023-08-01T19:54:51.489 INFO:teuthology.orchestra.run.smithi155.stdout: "duration": 0.00028023700000000002, 2023-08-01T19:54:51.489 INFO:teuthology.orchestra.run.smithi155.stdout: "type_data": { 2023-08-01T19:54:51.489 INFO:teuthology.orchestra.run.smithi155.stdout: "flag_point": "queued for pg", 2023-08-01T19:54:51.489 INFO:teuthology.orchestra.run.smithi155.stdout: "events": [ 2023-08-01T19:54:51.489 INFO:teuthology.orchestra.run.smithi155.stdout: { 2023-08-01T19:54:51.490 INFO:teuthology.orchestra.run.smithi155.stdout: "event": "initiated", 2023-08-01T19:54:51.490 INFO:teuthology.orchestra.run.smithi155.stdout: "time": "2023-08-01T19:54:51.485904+0000", 2023-08-01T19:54:51.490 INFO:teuthology.orchestra.run.smithi155.stdout: "duration": 0 2023-08-01T19:54:51.490 INFO:teuthology.orchestra.run.smithi155.stdout: }, 2023-08-01T19:54:51.490 INFO:teuthology.orchestra.run.smithi155.stdout: { 2023-08-01T19:54:51.490 INFO:teuthology.orchestra.run.smithi155.stdout: "event": "throttled", 2023-08-01T19:54:51.490 INFO:teuthology.orchestra.run.smithi155.stdout: "time": "2023-08-01T19:54:51.485904+0000", 2023-08-01T19:54:51.491 INFO:teuthology.orchestra.run.smithi155.stdout: "duration": 0 2023-08-01T19:54:51.491 INFO:teuthology.orchestra.run.smithi155.stdout: }, 2023-08-01T19:54:51.491 INFO:teuthology.orchestra.run.smithi155.stdout: { 2023-08-01T19:54:51.491 INFO:teuthology.orchestra.run.smithi155.stdout: "event": "header_read", 2023-08-01T19:54:51.491 INFO:teuthology.orchestra.run.smithi155.stdout: "time": "2023-08-01T19:54:51.485903+0000", 2023-08-01T19:54:51.491 INFO:teuthology.orchestra.run.smithi155.stdout: "duration": 4294967295.9999995 2023-08-01T19:54:51.491 INFO:teuthology.orchestra.run.smithi155.stdout: }, 2023-08-01T19:54:51.492 INFO:teuthology.orchestra.run.smithi155.stdout: { 2023-08-01T19:54:51.492 INFO:teuthology.orchestra.run.smithi155.stdout: "event": "all_read", 2023-08-01T19:54:51.492 INFO:teuthology.orchestra.run.smithi155.stdout: "time": "2023-08-01T19:54:51.485907+0000", 2023-08-01T19:54:51.492 INFO:teuthology.orchestra.run.smithi155.stdout: "duration": 4.2769999999999999e-06 2023-08-01T19:54:51.492 INFO:teuthology.orchestra.run.smithi155.stdout: }, 2023-08-01T19:54:51.492 INFO:teuthology.orchestra.run.smithi155.stdout: { 2023-08-01T19:54:51.492 INFO:teuthology.orchestra.run.smithi155.stdout: "event": "dispatched", 2023-08-01T19:54:51.493 INFO:teuthology.orchestra.run.smithi155.stdout: "time": "2023-08-01T19:54:51.485916+0000", 2023-08-01T19:54:51.493 INFO:teuthology.orchestra.run.smithi155.stdout: "duration": 8.7739999999999993e-06 2023-08-01T19:54:51.493 INFO:teuthology.orchestra.run.smithi155.stdout: }, 2023-08-01T19:54:51.493 INFO:teuthology.orchestra.run.smithi155.stdout: { 2023-08-01T19:54:51.493 INFO:teuthology.orchestra.run.smithi155.stdout: "event": "queued_for_pg", 2023-08-01T19:54:51.493 INFO:teuthology.orchestra.run.smithi155.stdout: "time": "2023-08-01T19:54:51.485922+0000", 2023-08-01T19:54:51.493 INFO:teuthology.orchestra.run.smithi155.stdout: "duration": 5.4790000000000004e-06 2023-08-01T19:54:51.494 INFO:teuthology.orchestra.run.smithi155.stdout: } 2023-08-01T19:54:51.494 INFO:teuthology.orchestra.run.smithi155.stdout: ] 2023-08-01T19:54:51.494 INFO:teuthology.orchestra.run.smithi155.stdout: } 2023-08-01T19:54:51.494 INFO:teuthology.orchestra.run.smithi155.stdout: }, 2023-08-01T19:54:51.494 INFO:teuthology.orchestra.run.smithi155.stdout: { 2023-08-01T19:54:51.494 INFO:teuthology.orchestra.run.smithi155.stdout: "description": "osd_op(client.4668.0:73492 5.4 5:247b6219:::benchmark_data_smithi006_114134_object73491:head [set-alloc-hint object_size 65536 write_size 65536,write 0~65536 in=65536b] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e31)", 2023-08-01T19:54:51.494 INFO:teuthology.orchestra.run.smithi155.stdout: "initiated_at": "2023-08-01T19:54:51.485817+0000", 2023-08-01T19:54:51.495 INFO:teuthology.orchestra.run.smithi155.stdout: "age": 0.00034258699999999999, 2023-08-01T19:54:51.495 INFO:teuthology.orchestra.run.smithi155.stdout: "duration": 0.000421524, 2023-08-01T19:54:51.495 INFO:teuthology.orchestra.run.smithi155.stdout: "type_data": { 2023-08-01T19:54:51.495 INFO:teuthology.orchestra.run.smithi155.stdout: "flag_point": "waiting for sub ops", 2023-08-01T19:54:51.495 INFO:teuthology.orchestra.run.smithi155.stdout: "client_info": { 2023-08-01T19:54:51.495 INFO:teuthology.orchestra.run.smithi155.stdout: "client": "client.4668", 2023-08-01T19:54:51.495 INFO:teuthology.orchestra.run.smithi155.stdout: "client_addr": "172.21.15.6:0/1709472247", 2023-08-01T19:54:51.496 INFO:teuthology.orchestra.run.smithi155.stdout: "tid": 73492 2023-08-01T19:54:51.496 INFO:teuthology.orchestra.run.smithi155.stdout: }, 2023-08-01T19:54:51.496 INFO:teuthology.orchestra.run.smithi155.stdout: "events": [ 2023-08-01T19:54:51.496 INFO:teuthology.orchestra.run.smithi155.stdout: { 2023-08-01T19:54:51.496 INFO:teuthology.orchestra.run.smithi155.stdout: "event": "initiated", 2023-08-01T19:54:51.496 INFO:teuthology.orchestra.run.smithi155.stdout: "time": "2023-08-01T19:54:51.485817+0000", 2023-08-01T19:54:51.496 INFO:teuthology.orchestra.run.smithi155.stdout: "duration": 0 2023-08-01T19:54:51.496 INFO:teuthology.orchestra.run.smithi155.stdout: }, 2023-08-01T19:54:51.497 INFO:teuthology.orchestra.run.smithi155.stdout: { 2023-08-01T19:54:51.497 INFO:teuthology.orchestra.run.smithi155.stdout: "event": "throttled", 2023-08-01T19:54:51.497 INFO:teuthology.orchestra.run.smithi155.stdout: "time": "2023-08-01T19:54:51.485817+0000", 2023-08-01T19:54:51.497 INFO:teuthology.orchestra.run.smithi155.stdout: "duration": 0 2023-08-01T19:54:51.497 INFO:teuthology.orchestra.run.smithi155.stdout: }, 2023-08-01T19:54:51.497 INFO:teuthology.orchestra.run.smithi155.stdout: { 2023-08-01T19:54:51.497 INFO:teuthology.orchestra.run.smithi155.stdout: "event": "header_read", 2023-08-01T19:54:51.498 INFO:teuthology.orchestra.run.smithi155.stdout: "time": "2023-08-01T19:54:51.485817+0000", 2023-08-01T19:54:51.498 INFO:teuthology.orchestra.run.smithi155.stdout: "duration": 4294967295.999999 2023-08-01T19:54:51.498 INFO:teuthology.orchestra.run.smithi155.stdout: }, 2023-08-01T19:54:51.498 INFO:teuthology.orchestra.run.smithi155.stdout: { 2023-08-01T19:54:51.498 INFO:teuthology.orchestra.run.smithi155.stdout: "event": "all_read", 2023-08-01T19:54:51.498 INFO:teuthology.orchestra.run.smithi155.stdout: "time": "2023-08-01T19:54:51.485931+0000", 2023-08-01T19:54:51.498 INFO:teuthology.orchestra.run.smithi155.stdout: "duration": 0.000114059 2023-08-01T19:54:51.498 INFO:teuthology.orchestra.run.smithi155.stdout: }, 2023-08-01T19:54:51.499 INFO:teuthology.orchestra.run.smithi155.stdout: { 2023-08-01T19:54:51.499 INFO:teuthology.orchestra.run.smithi155.stdout: "event": "dispatched", 2023-08-01T19:54:51.499 INFO:teuthology.orchestra.run.smithi155.stdout: "time": "2023-08-01T19:54:51.485939+0000", 2023-08-01T19:54:51.499 INFO:teuthology.orchestra.run.smithi155.stdout: "duration": 8.8279999999999992e-06 2023-08-01T19:54:51.499 INFO:teuthology.orchestra.run.smithi155.stdout: }, 2023-08-01T19:54:51.499 INFO:teuthology.orchestra.run.smithi155.stdout: { 2023-08-01T19:54:51.499 INFO:teuthology.orchestra.run.smithi155.stdout: "event": "queued_for_pg", 2023-08-01T19:54:51.499 INFO:teuthology.orchestra.run.smithi155.stdout: "time": "2023-08-01T19:54:51.485946+0000", 2023-08-01T19:54:51.500 INFO:teuthology.orchestra.run.smithi155.stdout: "duration": 6.2230000000000004e-06 2023-08-01T19:54:51.500 INFO:teuthology.orchestra.run.smithi155.stdout: }, 2023-08-01T19:54:51.500 INFO:teuthology.orchestra.run.smithi155.stdout: { 2023-08-01T19:54:51.500 INFO:teuthology.orchestra.run.smithi155.stdout: "event": "reached_pg", 2023-08-01T19:54:51.500 INFO:teuthology.orchestra.run.smithi155.stdout: "time": "2023-08-01T19:54:51.485979+0000", 2023-08-01T19:54:51.500 INFO:teuthology.orchestra.run.smithi155.stdout: "duration": 3.3216000000000002e-05 2023-08-01T19:54:51.500 INFO:teuthology.orchestra.run.smithi155.stdout: }, 2023-08-01T19:54:51.501 INFO:teuthology.orchestra.run.smithi155.stdout: { 2023-08-01T19:54:51.501 INFO:teuthology.orchestra.run.smithi155.stdout: "event": "started", 2023-08-01T19:54:51.501 INFO:teuthology.orchestra.run.smithi155.stdout: "time": "2023-08-01T19:54:51.486089+0000", 2023-08-01T19:54:51.501 INFO:teuthology.orchestra.run.smithi155.stdout: "duration": 0.000110433 2023-08-01T19:54:51.501 INFO:teuthology.orchestra.run.smithi155.stdout: }, 2023-08-01T19:54:51.501 INFO:teuthology.orchestra.run.smithi155.stdout: { 2023-08-01T19:54:51.501 INFO:teuthology.orchestra.run.smithi155.stdout: "event": "waiting for subops from 0", 2023-08-01T19:54:51.501 INFO:teuthology.orchestra.run.smithi155.stdout: "time": "2023-08-01T19:54:51.486226+0000", 2023-08-01T19:54:51.502 INFO:teuthology.orchestra.run.smithi155.stdout: "duration": 0.000136172 2023-08-01T19:54:51.502 INFO:teuthology.orchestra.run.smithi155.stdout: } 2023-08-01T19:54:51.502 INFO:teuthology.orchestra.run.smithi155.stdout: ] 2023-08-01T19:54:51.502 INFO:teuthology.orchestra.run.smithi155.stdout: } 2023-08-01T19:54:51.502 INFO:teuthology.orchestra.run.smithi155.stdout: }, 2023-08-01T19:54:51.502 INFO:teuthology.orchestra.run.smithi155.stdout: { 2023-08-01T19:54:51.502 INFO:teuthology.orchestra.run.smithi155.stdout: "description": "osd_repop(client.4668.0:73483 5.f e31/19 5:f9628224:::benchmark_data_smithi006_114134_object73482:head v 31'4634, mlcod=31'4631)", 2023-08-01T19:54:51.502 INFO:teuthology.orchestra.run.smithi155.stdout: "initiated_at": "2023-08-01T19:54:51.485847+0000", 2023-08-01T19:54:51.503 INFO:teuthology.orchestra.run.smithi155.stdout: "age": 0.00031301199999999999, 2023-08-01T19:54:51.503 INFO:teuthology.orchestra.run.smithi155.stdout: "duration": 0.00046363900000000001, 2023-08-01T19:54:51.503 INFO:teuthology.orchestra.run.smithi155.stdout: "type_data": { 2023-08-01T19:54:51.503 INFO:teuthology.orchestra.run.smithi155.stdout: "flag_point": "started", 2023-08-01T19:54:51.503 INFO:teuthology.orchestra.run.smithi155.stdout: "events": [ 2023-08-01T19:54:51.503 INFO:teuthology.orchestra.run.smithi155.stdout: { 2023-08-01T19:54:51.504 INFO:teuthology.orchestra.run.smithi155.stdout: "event": "initiated", 2023-08-01T19:54:51.504 INFO:teuthology.orchestra.run.smithi155.stdout: "time": "2023-08-01T19:54:51.485847+0000", 2023-08-01T19:54:51.504 INFO:teuthology.orchestra.run.smithi155.stdout: "duration": 0 2023-08-01T19:54:51.504 INFO:teuthology.orchestra.run.smithi155.stdout: }, 2023-08-01T19:54:51.504 INFO:teuthology.orchestra.run.smithi155.stdout: { 2023-08-01T19:54:51.504 INFO:teuthology.orchestra.run.smithi155.stdout: "event": "throttled", 2023-08-01T19:54:51.504 INFO:teuthology.orchestra.run.smithi155.stdout: "time": "2023-08-01T19:54:51.485847+0000", 2023-08-01T19:54:51.504 INFO:teuthology.orchestra.run.smithi155.stdout: "duration": 0 2023-08-01T19:54:51.505 INFO:teuthology.orchestra.run.smithi155.stdout: }, 2023-08-01T19:54:51.505 INFO:teuthology.orchestra.run.smithi155.stdout: { 2023-08-01T19:54:51.505 INFO:teuthology.orchestra.run.smithi155.stdout: "event": "header_read", 2023-08-01T19:54:51.505 INFO:teuthology.orchestra.run.smithi155.stdout: "time": "2023-08-01T19:54:51.485846+0000", 2023-08-01T19:54:51.505 INFO:teuthology.orchestra.run.smithi155.stdout: "duration": 4294967295.9999995 2023-08-01T19:54:51.505 INFO:teuthology.orchestra.run.smithi155.stdout: }, 2023-08-01T19:54:51.505 INFO:teuthology.orchestra.run.smithi155.stdout: { 2023-08-01T19:54:51.505 INFO:teuthology.orchestra.run.smithi155.stdout: "event": "all_read", 2023-08-01T19:54:51.506 INFO:teuthology.orchestra.run.smithi155.stdout: "time": "2023-08-01T19:54:51.485976+0000", 2023-08-01T19:54:51.506 INFO:teuthology.orchestra.run.smithi155.stdout: "duration": 0.000129383 2023-08-01T19:54:51.506 INFO:teuthology.orchestra.run.smithi155.stdout: }, 2023-08-01T19:54:51.506 INFO:teuthology.orchestra.run.smithi155.stdout: { 2023-08-01T19:54:51.506 INFO:teuthology.orchestra.run.smithi155.stdout: "event": "dispatched", 2023-08-01T19:54:51.506 INFO:teuthology.orchestra.run.smithi155.stdout: "time": "2023-08-01T19:54:51.485984+0000", 2023-08-01T19:54:51.506 INFO:teuthology.orchestra.run.smithi155.stdout: "duration": 7.9160000000000001e-06 2023-08-01T19:54:51.507 INFO:teuthology.orchestra.run.smithi155.stdout: }, 2023-08-01T19:54:51.507 INFO:teuthology.orchestra.run.smithi155.stdout: { 2023-08-01T19:54:51.507 INFO:teuthology.orchestra.run.smithi155.stdout: "event": "queued_for_pg", 2023-08-01T19:54:51.507 INFO:teuthology.orchestra.run.smithi155.stdout: "time": "2023-08-01T19:54:51.485988+0000", 2023-08-01T19:54:51.507 INFO:teuthology.orchestra.run.smithi155.stdout: "duration": 4.5639999999999998e-06 2023-08-01T19:54:51.507 INFO:teuthology.orchestra.run.smithi155.stdout: }, 2023-08-01T19:54:51.507 INFO:teuthology.orchestra.run.smithi155.stdout: { 2023-08-01T19:54:51.507 INFO:teuthology.orchestra.run.smithi155.stdout: "event": "reached_pg", 2023-08-01T19:54:51.508 INFO:teuthology.orchestra.run.smithi155.stdout: "time": "2023-08-01T19:54:51.486036+0000", 2023-08-01T19:54:51.508 INFO:teuthology.orchestra.run.smithi155.stdout: "duration": 4.7681e-05 2023-08-01T19:54:51.508 INFO:teuthology.orchestra.run.smithi155.stdout: }, 2023-08-01T19:54:51.508 INFO:teuthology.orchestra.run.smithi155.stdout: { 2023-08-01T19:54:51.508 INFO:teuthology.orchestra.run.smithi155.stdout: "event": "started", 2023-08-01T19:54:51.508 INFO:teuthology.orchestra.run.smithi155.stdout: "time": "2023-08-01T19:54:51.486064+0000", 2023-08-01T19:54:51.508 INFO:teuthology.orchestra.run.smithi155.stdout: "duration": 2.8442e-05 2023-08-01T19:54:51.509 INFO:teuthology.orchestra.run.smithi155.stdout: } 2023-08-01T19:54:51.509 INFO:teuthology.orchestra.run.smithi155.stdout: ] 2023-08-01T19:54:51.509 INFO:teuthology.orchestra.run.smithi155.stdout: } 2023-08-01T19:54:51.509 INFO:teuthology.orchestra.run.smithi155.stdout: }, 2023-08-01T19:54:51.509 INFO:teuthology.orchestra.run.smithi155.stdout: { 2023-08-01T19:54:51.509 INFO:teuthology.orchestra.run.smithi155.stdout: "description": "osd_repop(client.4668.0:73490 5.a e31/19 5:5adf4d00:::benchmark_data_smithi006_114134_object73489:head v 31'4542, mlcod=31'4540)", 2023-08-01T19:54:51.509 INFO:teuthology.orchestra.run.smithi155.stdout: "initiated_at": "2023-08-01T19:54:51.486068+0000", 2023-08-01T19:54:51.509 INFO:teuthology.orchestra.run.smithi155.stdout: "age": 9.1929999999999996e-05, 2023-08-01T19:54:51.510 INFO:teuthology.orchestra.run.smithi155.stdout: "duration": 0.00028387300000000002, 2023-08-01T19:54:51.510 INFO:teuthology.orchestra.run.smithi155.stdout: "type_data": { 2023-08-01T19:54:51.510 INFO:teuthology.orchestra.run.smithi155.stdout: "flag_point": "started", 2023-08-01T19:54:51.510 INFO:teuthology.orchestra.run.smithi155.stdout: "events": [ 2023-08-01T19:54:51.510 INFO:teuthology.orchestra.run.smithi155.stdout: { 2023-08-01T19:54:51.510 INFO:teuthology.orchestra.run.smithi155.stdout: "event": "initiated", 2023-08-01T19:54:51.510 INFO:teuthology.orchestra.run.smithi155.stdout: "time": "2023-08-01T19:54:51.486068+0000", 2023-08-01T19:54:51.510 INFO:teuthology.orchestra.run.smithi155.stdout: "duration": 0 2023-08-01T19:54:51.511 INFO:teuthology.orchestra.run.smithi155.stdout: }, 2023-08-01T19:54:51.511 INFO:teuthology.orchestra.run.smithi155.stdout: { 2023-08-01T19:54:51.511 INFO:teuthology.orchestra.run.smithi155.stdout: "event": "throttled", 2023-08-01T19:54:51.511 INFO:teuthology.orchestra.run.smithi155.stdout: "time": "2023-08-01T19:54:51.486068+0000", 2023-08-01T19:54:51.511 INFO:teuthology.orchestra.run.smithi155.stdout: "duration": 0 2023-08-01T19:54:51.511 INFO:teuthology.orchestra.run.smithi155.stdout: }, 2023-08-01T19:54:51.511 INFO:teuthology.orchestra.run.smithi155.stdout: { 2023-08-01T19:54:51.512 INFO:teuthology.orchestra.run.smithi155.stdout: "event": "header_read", 2023-08-01T19:54:51.512 INFO:teuthology.orchestra.run.smithi155.stdout: "time": "2023-08-01T19:54:51.486068+0000", 2023-08-01T19:54:51.512 INFO:teuthology.orchestra.run.smithi155.stdout: "duration": 4294967295.9999995 2023-08-01T19:54:51.512 INFO:teuthology.orchestra.run.smithi155.stdout: }, 2023-08-01T19:54:51.512 INFO:teuthology.orchestra.run.smithi155.stdout: { 2023-08-01T19:54:51.512 INFO:teuthology.orchestra.run.smithi155.stdout: "event": "all_read", 2023-08-01T19:54:51.512 INFO:teuthology.orchestra.run.smithi155.stdout: "time": "2023-08-01T19:54:51.486147+0000", 2023-08-01T19:54:51.512 INFO:teuthology.orchestra.run.smithi155.stdout: "duration": 7.9802000000000006e-05 2023-08-01T19:54:51.513 INFO:teuthology.orchestra.run.smithi155.stdout: }, 2023-08-01T19:54:51.513 INFO:teuthology.orchestra.run.smithi155.stdout: { 2023-08-01T19:54:51.513 INFO:teuthology.orchestra.run.smithi155.stdout: "event": "dispatched", 2023-08-01T19:54:51.513 INFO:teuthology.orchestra.run.smithi155.stdout: "time": "2023-08-01T19:54:51.486157+0000", 2023-08-01T19:54:51.513 INFO:teuthology.orchestra.run.smithi155.stdout: "duration": 9.8030000000000008e-06 2023-08-01T19:54:51.513 INFO:teuthology.orchestra.run.smithi155.stdout: }, 2023-08-01T19:54:51.513 INFO:teuthology.orchestra.run.smithi155.stdout: { 2023-08-01T19:54:51.513 INFO:teuthology.orchestra.run.smithi155.stdout: "event": "queued_for_pg", 2023-08-01T19:54:51.514 INFO:teuthology.orchestra.run.smithi155.stdout: "time": "2023-08-01T19:54:51.486162+0000", 2023-08-01T19:54:51.514 INFO:teuthology.orchestra.run.smithi155.stdout: "duration": 5.3199999999999999e-06 2023-08-01T19:54:51.514 INFO:teuthology.orchestra.run.smithi155.stdout: }, 2023-08-01T19:54:51.514 INFO:teuthology.orchestra.run.smithi155.stdout: { 2023-08-01T19:54:51.514 INFO:teuthology.orchestra.run.smithi155.stdout: "event": "reached_pg", 2023-08-01T19:54:51.514 INFO:teuthology.orchestra.run.smithi155.stdout: "time": "2023-08-01T19:54:51.486203+0000", 2023-08-01T19:54:51.514 INFO:teuthology.orchestra.run.smithi155.stdout: "duration": 4.0203000000000001e-05 2023-08-01T19:54:51.515 INFO:teuthology.orchestra.run.smithi155.stdout: }, 2023-08-01T19:54:51.515 INFO:teuthology.orchestra.run.smithi155.stdout: { 2023-08-01T19:54:51.515 INFO:teuthology.orchestra.run.smithi155.stdout: "event": "started", 2023-08-01T19:54:51.515 INFO:teuthology.orchestra.run.smithi155.stdout: "time": "2023-08-01T19:54:51.486220+0000", 2023-08-01T19:54:51.515 INFO:teuthology.orchestra.run.smithi155.stdout: "duration": 1.7819e-05 2023-08-01T19:54:51.515 INFO:teuthology.orchestra.run.smithi155.stdout: } 2023-08-01T19:54:51.515 INFO:teuthology.orchestra.run.smithi155.stdout: ] 2023-08-01T19:54:51.515 INFO:teuthology.orchestra.run.smithi155.stdout: } 2023-08-01T19:54:51.516 INFO:teuthology.orchestra.run.smithi155.stdout: }, 2023-08-01T19:54:51.516 INFO:teuthology.orchestra.run.smithi155.stdout: { 2023-08-01T19:54:51.516 INFO:teuthology.orchestra.run.smithi155.stdout: "description": "osd_op(client.4668.0:73475 5.8 5:128a44ce:::benchmark_data_smithi006_114134_object73474:head [set-alloc-hint object_size 65536 write_size 65536,write 0~65536 in=65536b] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e31)", 2023-08-01T19:54:51.516 INFO:teuthology.orchestra.run.smithi155.stdout: "initiated_at": "2023-08-01T19:54:51.476076+0000", 2023-08-01T19:54:51.516 INFO:teuthology.orchestra.run.smithi155.stdout: "age": 0.010083846, 2023-08-01T19:54:51.516 INFO:teuthology.orchestra.run.smithi155.stdout: "duration": 0.010314222, 2023-08-01T19:54:51.516 INFO:teuthology.orchestra.run.smithi155.stdout: "type_data": { 2023-08-01T19:54:51.517 INFO:teuthology.orchestra.run.smithi155.stdout: "flag_point": "waiting for sub ops", 2023-08-01T19:54:51.517 INFO:teuthology.orchestra.run.smithi155.stdout: "client_info": { 2023-08-01T19:54:51.517 INFO:teuthology.orchestra.run.smithi155.stdout: "client": "client.4668", 2023-08-01T19:54:51.517 INFO:teuthology.orchestra.run.smithi155.stdout: "client_addr": "172.21.15.6:0/1709472247", 2023-08-01T19:54:51.517 INFO:teuthology.orchestra.run.smithi155.stdout: "tid": 73475 2023-08-01T19:54:51.517 INFO:teuthology.orchestra.run.smithi155.stdout: }, 2023-08-01T19:54:51.517 INFO:teuthology.orchestra.run.smithi155.stdout: "events": [ 2023-08-01T19:54:51.518 INFO:teuthology.orchestra.run.smithi155.stdout: { 2023-08-01T19:54:51.518 INFO:teuthology.orchestra.run.smithi155.stdout: "event": "initiated", 2023-08-01T19:54:51.518 INFO:teuthology.orchestra.run.smithi155.stdout: "time": "2023-08-01T19:54:51.476076+0000", 2023-08-01T19:54:51.518 INFO:teuthology.orchestra.run.smithi155.stdout: "duration": 0 2023-08-01T19:54:51.518 INFO:teuthology.orchestra.run.smithi155.stdout: }, 2023-08-01T19:54:51.518 INFO:teuthology.orchestra.run.smithi155.stdout: { 2023-08-01T19:54:51.519 INFO:teuthology.orchestra.run.smithi155.stdout: "event": "throttled", 2023-08-01T19:54:51.519 INFO:teuthology.orchestra.run.smithi155.stdout: "time": "2023-08-01T19:54:51.476076+0000", 2023-08-01T19:54:51.519 INFO:teuthology.orchestra.run.smithi155.stdout: "duration": 0 2023-08-01T19:54:51.519 INFO:teuthology.orchestra.run.smithi155.stdout: }, 2023-08-01T19:54:51.519 INFO:teuthology.orchestra.run.smithi155.stdout: { 2023-08-01T19:54:51.519 INFO:teuthology.orchestra.run.smithi155.stdout: "event": "header_read", 2023-08-01T19:54:51.519 INFO:teuthology.orchestra.run.smithi155.stdout: "time": "2023-08-01T19:54:51.476075+0000", 2023-08-01T19:54:51.520 INFO:teuthology.orchestra.run.smithi155.stdout: "duration": 4294967295.999999 2023-08-01T19:54:51.520 INFO:teuthology.orchestra.run.smithi155.stdout: }, 2023-08-01T19:54:51.520 INFO:teuthology.orchestra.run.smithi155.stdout: { 2023-08-01T19:54:51.520 INFO:teuthology.orchestra.run.smithi155.stdout: "event": "all_read", 2023-08-01T19:54:51.520 INFO:teuthology.orchestra.run.smithi155.stdout: "time": "2023-08-01T19:54:51.476122+0000", 2023-08-01T19:54:51.520 INFO:teuthology.orchestra.run.smithi155.stdout: "duration": 4.7015999999999998e-05 2023-08-01T19:54:51.521 INFO:teuthology.orchestra.run.smithi155.stdout: }, 2023-08-01T19:54:51.521 INFO:teuthology.orchestra.run.smithi155.stdout: { 2023-08-01T19:54:51.521 INFO:teuthology.orchestra.run.smithi155.stdout: "event": "dispatched", 2023-08-01T19:54:51.521 INFO:teuthology.orchestra.run.smithi155.stdout: "time": "2023-08-01T19:54:51.476149+0000", 2023-08-01T19:54:51.521 INFO:teuthology.orchestra.run.smithi155.stdout: "duration": 2.7021000000000001e-05 2023-08-01T19:54:51.521 INFO:teuthology.orchestra.run.smithi155.stdout: }, 2023-08-01T19:54:51.522 INFO:teuthology.orchestra.run.smithi155.stdout: { 2023-08-01T19:54:51.522 INFO:teuthology.orchestra.run.smithi155.stdout: "event": "queued_for_pg", 2023-08-01T19:54:51.522 INFO:teuthology.orchestra.run.smithi155.stdout: "time": "2023-08-01T19:54:51.476156+0000", 2023-08-01T19:54:51.522 INFO:teuthology.orchestra.run.smithi155.stdout: "duration": 7.3309999999999998e-06 2023-08-01T19:54:51.522 INFO:teuthology.orchestra.run.smithi155.stdout: }, 2023-08-01T19:54:51.522 INFO:teuthology.orchestra.run.smithi155.stdout: { 2023-08-01T19:54:51.522 INFO:teuthology.orchestra.run.smithi155.stdout: "event": "reached_pg", 2023-08-01T19:54:51.522 INFO:teuthology.orchestra.run.smithi155.stdout: "time": "2023-08-01T19:54:51.480486+0000", 2023-08-01T19:54:51.523 INFO:teuthology.orchestra.run.smithi155.stdout: "duration": 0.0043295139999999996 2023-08-01T19:54:51.523 INFO:teuthology.orchestra.run.smithi155.stdout: }, 2023-08-01T19:54:51.523 INFO:teuthology.orchestra.run.smithi155.stdout: { 2023-08-01T19:54:51.523 INFO:teuthology.orchestra.run.smithi155.stdout: "event": "started", 2023-08-01T19:54:51.523 INFO:teuthology.orchestra.run.smithi155.stdout: "time": "2023-08-01T19:54:51.480618+0000", 2023-08-01T19:54:51.523 INFO:teuthology.orchestra.run.smithi155.stdout: "duration": 0.00013223999999999999 2023-08-01T19:54:51.523 INFO:teuthology.orchestra.run.smithi155.stdout: }, 2023-08-01T19:54:51.523 INFO:teuthology.orchestra.run.smithi155.stdout: { 2023-08-01T19:54:51.524 INFO:teuthology.orchestra.run.smithi155.stdout: "event": "waiting for subops from 0", 2023-08-01T19:54:51.524 INFO:teuthology.orchestra.run.smithi155.stdout: "time": "2023-08-01T19:54:51.480763+0000", 2023-08-01T19:54:51.524 INFO:teuthology.orchestra.run.smithi155.stdout: "duration": 0.00014507499999999999 2023-08-01T19:54:51.524 INFO:teuthology.orchestra.run.smithi155.stdout: } 2023-08-01T19:54:51.524 INFO:teuthology.orchestra.run.smithi155.stdout: ] 2023-08-01T19:54:51.524 INFO:teuthology.orchestra.run.smithi155.stdout: } 2023-08-01T19:54:51.524 INFO:teuthology.orchestra.run.smithi155.stdout: }, 2023-08-01T19:54:51.524 INFO:teuthology.orchestra.run.smithi155.stdout: { 2023-08-01T19:54:51.525 INFO:teuthology.orchestra.run.smithi155.stdout: "description": "osd_op(client.4668.0:73476 5.8 5:1bb44406:::benchmark_data_smithi006_114134_object73475:head [set-alloc-hint object_size 65536 write_size 65536,write 0~65536 in=65536b] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e31)", 2023-08-01T19:54:51.525 INFO:teuthology.orchestra.run.smithi155.stdout: "initiated_at": "2023-08-01T19:54:51.476170+0000", 2023-08-01T19:54:51.525 INFO:teuthology.orchestra.run.smithi155.stdout: "age": 0.0099900660000000006, 2023-08-01T19:54:51.525 INFO:teuthology.orchestra.run.smithi155.stdout: "duration": 0.010274342000000001, 2023-08-01T19:54:51.525 INFO:teuthology.orchestra.run.smithi155.stdout: "type_data": { 2023-08-01T19:54:51.525 INFO:teuthology.orchestra.run.smithi155.stdout: "flag_point": "waiting for sub ops", 2023-08-01T19:54:51.525 INFO:teuthology.orchestra.run.smithi155.stdout: "client_info": { 2023-08-01T19:54:51.526 INFO:teuthology.orchestra.run.smithi155.stdout: "client": "client.4668", 2023-08-01T19:54:51.526 INFO:teuthology.orchestra.run.smithi155.stdout: "client_addr": "172.21.15.6:0/1709472247", 2023-08-01T19:54:51.526 INFO:teuthology.orchestra.run.smithi155.stdout: "tid": 73476 2023-08-01T19:54:51.526 INFO:teuthology.orchestra.run.smithi155.stdout: }, 2023-08-01T19:54:51.526 INFO:teuthology.orchestra.run.smithi155.stdout: "events": [ 2023-08-01T19:54:51.526 INFO:teuthology.orchestra.run.smithi155.stdout: { 2023-08-01T19:54:51.526 INFO:teuthology.orchestra.run.smithi155.stdout: "event": "initiated", 2023-08-01T19:54:51.526 INFO:teuthology.orchestra.run.smithi155.stdout: "time": "2023-08-01T19:54:51.476170+0000", 2023-08-01T19:54:51.527 INFO:teuthology.orchestra.run.smithi155.stdout: "duration": 0 2023-08-01T19:54:51.527 INFO:teuthology.orchestra.run.smithi155.stdout: }, 2023-08-01T19:54:51.527 INFO:teuthology.orchestra.run.smithi155.stdout: { 2023-08-01T19:54:51.527 INFO:teuthology.orchestra.run.smithi155.stdout: "event": "throttled", 2023-08-01T19:54:51.527 INFO:teuthology.orchestra.run.smithi155.stdout: "time": "2023-08-01T19:54:51.476170+0000", 2023-08-01T19:54:51.527 INFO:teuthology.orchestra.run.smithi155.stdout: "duration": 0 2023-08-01T19:54:51.527 INFO:teuthology.orchestra.run.smithi155.stdout: }, 2023-08-01T19:54:51.528 INFO:teuthology.orchestra.run.smithi155.stdout: { 2023-08-01T19:54:51.528 INFO:teuthology.orchestra.run.smithi155.stdout: "event": "header_read", 2023-08-01T19:54:51.528 INFO:teuthology.orchestra.run.smithi155.stdout: "time": "2023-08-01T19:54:51.476169+0000", 2023-08-01T19:54:51.528 INFO:teuthology.orchestra.run.smithi155.stdout: "duration": 4294967295.999999 2023-08-01T19:54:51.528 INFO:teuthology.orchestra.run.smithi155.stdout: }, 2023-08-01T19:54:51.528 INFO:teuthology.orchestra.run.smithi155.stdout: { 2023-08-01T19:54:51.528 INFO:teuthology.orchestra.run.smithi155.stdout: "event": "all_read", 2023-08-01T19:54:51.528 INFO:teuthology.orchestra.run.smithi155.stdout: "time": "2023-08-01T19:54:51.476225+0000", 2023-08-01T19:54:51.529 INFO:teuthology.orchestra.run.smithi155.stdout: "duration": 5.5856000000000002e-05 2023-08-01T19:54:51.529 INFO:teuthology.orchestra.run.smithi155.stdout: }, 2023-08-01T19:54:51.529 INFO:teuthology.orchestra.run.smithi155.stdout: { 2023-08-01T19:54:51.529 INFO:teuthology.orchestra.run.smithi155.stdout: "event": "dispatched", 2023-08-01T19:54:51.529 INFO:teuthology.orchestra.run.smithi155.stdout: "time": "2023-08-01T19:54:51.476236+0000", 2023-08-01T19:54:51.529 INFO:teuthology.orchestra.run.smithi155.stdout: "duration": 1.1051e-05 2023-08-01T19:54:51.529 INFO:teuthology.orchestra.run.smithi155.stdout: }, 2023-08-01T19:54:51.529 INFO:teuthology.orchestra.run.smithi155.stdout: { 2023-08-01T19:54:51.530 INFO:teuthology.orchestra.run.smithi155.stdout: "event": "queued_for_pg", 2023-08-01T19:54:51.530 INFO:teuthology.orchestra.run.smithi155.stdout: "time": "2023-08-01T19:54:51.476242+0000", 2023-08-01T19:54:51.530 INFO:teuthology.orchestra.run.smithi155.stdout: "duration": 6.161e-06 2023-08-01T19:54:51.530 INFO:teuthology.orchestra.run.smithi155.stdout: }, 2023-08-01T19:54:51.530 INFO:teuthology.orchestra.run.smithi155.stdout: { 2023-08-01T19:54:51.530 INFO:teuthology.orchestra.run.smithi155.stdout: "event": "reached_pg", 2023-08-01T19:54:51.530 INFO:teuthology.orchestra.run.smithi155.stdout: "time": "2023-08-01T19:54:51.482945+0000", 2023-08-01T19:54:51.530 INFO:teuthology.orchestra.run.smithi155.stdout: "duration": 0.0067027370000000003 2023-08-01T19:54:51.531 INFO:teuthology.orchestra.run.smithi155.stdout: }, 2023-08-01T19:54:51.531 INFO:teuthology.orchestra.run.smithi155.stdout: { 2023-08-01T19:54:51.531 INFO:teuthology.orchestra.run.smithi155.stdout: "event": "started", 2023-08-01T19:54:51.531 INFO:teuthology.orchestra.run.smithi155.stdout: "time": "2023-08-01T19:54:51.483028+0000", 2023-08-01T19:54:51.531 INFO:teuthology.orchestra.run.smithi155.stdout: "duration": 8.3218000000000002e-05 2023-08-01T19:54:51.531 INFO:teuthology.orchestra.run.smithi155.stdout: }, 2023-08-01T19:54:51.531 INFO:teuthology.orchestra.run.smithi155.stdout: { 2023-08-01T19:54:51.532 INFO:teuthology.orchestra.run.smithi155.stdout: "event": "waiting for subops from 0", 2023-08-01T19:54:51.532 INFO:teuthology.orchestra.run.smithi155.stdout: "time": "2023-08-01T19:54:51.483118+0000", 2023-08-01T19:54:51.532 INFO:teuthology.orchestra.run.smithi155.stdout: "duration": 9.0348999999999998e-05 2023-08-01T19:54:51.532 INFO:teuthology.orchestra.run.smithi155.stdout: } 2023-08-01T19:54:51.532 INFO:teuthology.orchestra.run.smithi155.stdout: ] 2023-08-01T19:54:51.532 INFO:teuthology.orchestra.run.smithi155.stdout: } 2023-08-01T19:54:51.532 INFO:teuthology.orchestra.run.smithi155.stdout: }, 2023-08-01T19:54:51.533 INFO:teuthology.orchestra.run.smithi155.stdout: { 2023-08-01T19:54:51.533 INFO:teuthology.orchestra.run.smithi155.stdout: "description": "osd_op(client.4668.0:73478 5.0 5:0c2b72dd:::benchmark_data_smithi006_114134_object73477:head [set-alloc-hint object_size 65536 write_size 65536,write 0~65536 in=65536b] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e31)", 2023-08-01T19:54:51.533 INFO:teuthology.orchestra.run.smithi155.stdout: "initiated_at": "2023-08-01T19:54:51.479242+0000", 2023-08-01T19:54:51.533 INFO:teuthology.orchestra.run.smithi155.stdout: "age": 0.0069183869999999998, 2023-08-01T19:54:51.533 INFO:teuthology.orchestra.run.smithi155.stdout: "duration": 0.0072683169999999998, 2023-08-01T19:54:51.533 INFO:teuthology.orchestra.run.smithi155.stdout: "type_data": { 2023-08-01T19:54:51.533 INFO:teuthology.orchestra.run.smithi155.stdout: "flag_point": "waiting for sub ops", 2023-08-01T19:54:51.534 INFO:teuthology.orchestra.run.smithi155.stdout: "client_info": { 2023-08-01T19:54:51.534 INFO:teuthology.orchestra.run.smithi155.stdout: "client": "client.4668", 2023-08-01T19:54:51.534 INFO:teuthology.orchestra.run.smithi155.stdout: "client_addr": "172.21.15.6:0/1709472247", 2023-08-01T19:54:51.534 INFO:teuthology.orchestra.run.smithi155.stdout: "tid": 73478 2023-08-01T19:54:51.534 INFO:teuthology.orchestra.run.smithi155.stdout: }, 2023-08-01T19:54:51.534 INFO:teuthology.orchestra.run.smithi155.stdout: "events": [ 2023-08-01T19:54:51.534 INFO:teuthology.orchestra.run.smithi155.stdout: { 2023-08-01T19:54:51.534 INFO:teuthology.orchestra.run.smithi155.stdout: "event": "initiated", 2023-08-01T19:54:51.535 INFO:teuthology.orchestra.run.smithi155.stdout: "time": "2023-08-01T19:54:51.479242+0000", 2023-08-01T19:54:51.535 INFO:teuthology.orchestra.run.smithi155.stdout: "duration": 0 2023-08-01T19:54:51.535 INFO:teuthology.orchestra.run.smithi155.stdout: }, 2023-08-01T19:54:51.535 INFO:teuthology.orchestra.run.smithi155.stdout: { 2023-08-01T19:54:51.535 INFO:teuthology.orchestra.run.smithi155.stdout: "event": "throttled", 2023-08-01T19:54:51.535 INFO:teuthology.orchestra.run.smithi155.stdout: "time": "2023-08-01T19:54:51.479242+0000", 2023-08-01T19:54:51.535 INFO:teuthology.orchestra.run.smithi155.stdout: "duration": 0 2023-08-01T19:54:51.535 INFO:teuthology.orchestra.run.smithi155.stdout: }, 2023-08-01T19:54:51.536 INFO:teuthology.orchestra.run.smithi155.stdout: { 2023-08-01T19:54:51.536 INFO:teuthology.orchestra.run.smithi155.stdout: "event": "header_read", 2023-08-01T19:54:51.536 INFO:teuthology.orchestra.run.smithi155.stdout: "time": "2023-08-01T19:54:51.479241+0000", 2023-08-01T19:54:51.536 INFO:teuthology.orchestra.run.smithi155.stdout: "duration": 4294967295.999999 2023-08-01T19:54:51.536 INFO:teuthology.orchestra.run.smithi155.stdout: }, 2023-08-01T19:54:51.536 INFO:teuthology.orchestra.run.smithi155.stdout: { 2023-08-01T19:54:51.536 INFO:teuthology.orchestra.run.smithi155.stdout: "event": "all_read", 2023-08-01T19:54:51.537 INFO:teuthology.orchestra.run.smithi155.stdout: "time": "2023-08-01T19:54:51.479296+0000", 2023-08-01T19:54:51.537 INFO:teuthology.orchestra.run.smithi155.stdout: "duration": 5.5458999999999999e-05 2023-08-01T19:54:51.537 INFO:teuthology.orchestra.run.smithi155.stdout: }, 2023-08-01T19:54:51.537 INFO:teuthology.orchestra.run.smithi155.stdout: { 2023-08-01T19:54:51.537 INFO:teuthology.orchestra.run.smithi155.stdout: "event": "dispatched", 2023-08-01T19:54:51.537 INFO:teuthology.orchestra.run.smithi155.stdout: "time": "2023-08-01T19:54:51.479309+0000", 2023-08-01T19:54:51.537 INFO:teuthology.orchestra.run.smithi155.stdout: "duration": 1.2821e-05 2023-08-01T19:54:51.537 INFO:teuthology.orchestra.run.smithi155.stdout: }, 2023-08-01T19:54:51.538 INFO:teuthology.orchestra.run.smithi155.stdout: { 2023-08-01T19:54:51.538 INFO:teuthology.orchestra.run.smithi155.stdout: "event": "queued_for_pg", 2023-08-01T19:54:51.538 INFO:teuthology.orchestra.run.smithi155.stdout: "time": "2023-08-01T19:54:51.479315+0000", 2023-08-01T19:54:51.538 INFO:teuthology.orchestra.run.smithi155.stdout: "duration": 5.9599999999999997e-06 2023-08-01T19:54:51.538 INFO:teuthology.orchestra.run.smithi155.stdout: }, 2023-08-01T19:54:51.538 INFO:teuthology.orchestra.run.smithi155.stdout: { 2023-08-01T19:54:51.538 INFO:teuthology.orchestra.run.smithi155.stdout: "event": "reached_pg", 2023-08-01T19:54:51.538 INFO:teuthology.orchestra.run.smithi155.stdout: "time": "2023-08-01T19:54:51.482940+0000", 2023-08-01T19:54:51.539 INFO:teuthology.orchestra.run.smithi155.stdout: "duration": 0.0036255300000000001 2023-08-01T19:54:51.539 INFO:teuthology.orchestra.run.smithi155.stdout: }, 2023-08-01T19:54:51.539 INFO:teuthology.orchestra.run.smithi155.stdout: { 2023-08-01T19:54:51.539 INFO:teuthology.orchestra.run.smithi155.stdout: "event": "started", 2023-08-01T19:54:51.539 INFO:teuthology.orchestra.run.smithi155.stdout: "time": "2023-08-01T19:54:51.483062+0000", 2023-08-01T19:54:51.539 INFO:teuthology.orchestra.run.smithi155.stdout: "duration": 0.000121548 2023-08-01T19:54:51.539 INFO:teuthology.orchestra.run.smithi155.stdout: }, 2023-08-01T19:54:51.540 INFO:teuthology.orchestra.run.smithi155.stdout: { 2023-08-01T19:54:51.540 INFO:teuthology.orchestra.run.smithi155.stdout: "event": "waiting for subops from 0", 2023-08-01T19:54:51.540 INFO:teuthology.orchestra.run.smithi155.stdout: "time": "2023-08-01T19:54:51.483218+0000", 2023-08-01T19:54:51.540 INFO:teuthology.orchestra.run.smithi155.stdout: "duration": 0.00015595299999999999 2023-08-01T19:54:51.540 INFO:teuthology.orchestra.run.smithi155.stdout: } 2023-08-01T19:54:51.540 INFO:teuthology.orchestra.run.smithi155.stdout: ] 2023-08-01T19:54:51.540 INFO:teuthology.orchestra.run.smithi155.stdout: } 2023-08-01T19:54:51.540 INFO:teuthology.orchestra.run.smithi155.stdout: }, 2023-08-01T19:54:51.541 INFO:teuthology.orchestra.run.smithi155.stdout: { 2023-08-01T19:54:51.541 INFO:teuthology.orchestra.run.smithi155.stdout: "description": "osd_op(client.4668.0:73481 5.d 5:bf659322:::benchmark_data_smithi006_114134_object73480:head [set-alloc-hint object_size 65536 write_size 65536,write 0~65536 in=65536b] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e31)", 2023-08-01T19:54:51.541 INFO:teuthology.orchestra.run.smithi155.stdout: "initiated_at": "2023-08-01T19:54:51.480533+0000", 2023-08-01T19:54:51.541 INFO:teuthology.orchestra.run.smithi155.stdout: "age": 0.0056269149999999997, 2023-08-01T19:54:51.541 INFO:teuthology.orchestra.run.smithi155.stdout: "duration": 0.0060248189999999998, 2023-08-01T19:54:51.541 INFO:teuthology.orchestra.run.smithi155.stdout: "type_data": { 2023-08-01T19:54:51.541 INFO:teuthology.orchestra.run.smithi155.stdout: "flag_point": "waiting for sub ops", 2023-08-01T19:54:51.542 INFO:teuthology.orchestra.run.smithi155.stdout: "client_info": { 2023-08-01T19:54:51.542 INFO:teuthology.orchestra.run.smithi155.stdout: "client": "client.4668", 2023-08-01T19:54:51.542 INFO:teuthology.orchestra.run.smithi155.stdout: "client_addr": "172.21.15.6:0/1709472247", 2023-08-01T19:54:51.542 INFO:teuthology.orchestra.run.smithi155.stdout: "tid": 73481 2023-08-01T19:54:51.542 INFO:teuthology.orchestra.run.smithi155.stdout: }, 2023-08-01T19:54:51.542 INFO:teuthology.orchestra.run.smithi155.stdout: "events": [ 2023-08-01T19:54:51.542 INFO:teuthology.orchestra.run.smithi155.stdout: { 2023-08-01T19:54:51.542 INFO:teuthology.orchestra.run.smithi155.stdout: "event": "initiated", 2023-08-01T19:54:51.543 INFO:teuthology.orchestra.run.smithi155.stdout: "time": "2023-08-01T19:54:51.480533+0000", 2023-08-01T19:54:51.543 INFO:teuthology.orchestra.run.smithi155.stdout: "duration": 0 2023-08-01T19:54:51.543 INFO:teuthology.orchestra.run.smithi155.stdout: }, 2023-08-01T19:54:51.543 INFO:teuthology.orchestra.run.smithi155.stdout: { 2023-08-01T19:54:51.543 INFO:teuthology.orchestra.run.smithi155.stdout: "event": "throttled", 2023-08-01T19:54:51.543 INFO:teuthology.orchestra.run.smithi155.stdout: "time": "2023-08-01T19:54:51.480533+0000", 2023-08-01T19:54:51.543 INFO:teuthology.orchestra.run.smithi155.stdout: "duration": 0 2023-08-01T19:54:51.544 INFO:teuthology.orchestra.run.smithi155.stdout: }, 2023-08-01T19:54:51.544 INFO:teuthology.orchestra.run.smithi155.stdout: { 2023-08-01T19:54:51.544 INFO:teuthology.orchestra.run.smithi155.stdout: "event": "header_read", 2023-08-01T19:54:51.544 INFO:teuthology.orchestra.run.smithi155.stdout: "time": "2023-08-01T19:54:51.480532+0000", 2023-08-01T19:54:51.544 INFO:teuthology.orchestra.run.smithi155.stdout: "duration": 4294967295.9999995 2023-08-01T19:54:51.544 INFO:teuthology.orchestra.run.smithi155.stdout: }, 2023-08-01T19:54:51.544 INFO:teuthology.orchestra.run.smithi155.stdout: { 2023-08-01T19:54:51.544 INFO:teuthology.orchestra.run.smithi155.stdout: "event": "all_read", 2023-08-01T19:54:51.545 INFO:teuthology.orchestra.run.smithi155.stdout: "time": "2023-08-01T19:54:51.480574+0000", 2023-08-01T19:54:51.545 INFO:teuthology.orchestra.run.smithi155.stdout: "duration": 4.1269000000000001e-05 2023-08-01T19:54:51.545 INFO:teuthology.orchestra.run.smithi155.stdout: }, 2023-08-01T19:54:51.545 INFO:teuthology.orchestra.run.smithi155.stdout: { 2023-08-01T19:54:51.545 INFO:teuthology.orchestra.run.smithi155.stdout: "event": "dispatched", 2023-08-01T19:54:51.545 INFO:teuthology.orchestra.run.smithi155.stdout: "time": "2023-08-01T19:54:51.480581+0000", 2023-08-01T19:54:51.545 INFO:teuthology.orchestra.run.smithi155.stdout: "duration": 7.7719999999999994e-06 2023-08-01T19:54:51.545 INFO:teuthology.orchestra.run.smithi155.stdout: }, 2023-08-01T19:54:51.546 INFO:teuthology.orchestra.run.smithi155.stdout: { 2023-08-01T19:54:51.546 INFO:teuthology.orchestra.run.smithi155.stdout: "event": "queued_for_pg", 2023-08-01T19:54:51.546 INFO:teuthology.orchestra.run.smithi155.stdout: "time": "2023-08-01T19:54:51.480586+0000", 2023-08-01T19:54:51.546 INFO:teuthology.orchestra.run.smithi155.stdout: "duration": 4.8840000000000002e-06 2023-08-01T19:54:51.546 INFO:teuthology.orchestra.run.smithi155.stdout: }, 2023-08-01T19:54:51.546 INFO:teuthology.orchestra.run.smithi155.stdout: { 2023-08-01T19:54:51.546 INFO:teuthology.orchestra.run.smithi155.stdout: "event": "reached_pg", 2023-08-01T19:54:51.546 INFO:teuthology.orchestra.run.smithi155.stdout: "time": "2023-08-01T19:54:51.480625+0000", 2023-08-01T19:54:51.547 INFO:teuthology.orchestra.run.smithi155.stdout: "duration": 3.9005999999999999e-05 2023-08-01T19:54:51.547 INFO:teuthology.orchestra.run.smithi155.stdout: }, 2023-08-01T19:54:51.547 INFO:teuthology.orchestra.run.smithi155.stdout: { 2023-08-01T19:54:51.547 INFO:teuthology.orchestra.run.smithi155.stdout: "event": "started", 2023-08-01T19:54:51.547 INFO:teuthology.orchestra.run.smithi155.stdout: "time": "2023-08-01T19:54:51.480749+0000", 2023-08-01T19:54:51.547 INFO:teuthology.orchestra.run.smithi155.stdout: "duration": 0.00012383699999999999 2023-08-01T19:54:51.547 INFO:teuthology.orchestra.run.smithi155.stdout: }, 2023-08-01T19:54:51.547 INFO:teuthology.orchestra.run.smithi155.stdout: { 2023-08-01T19:54:51.548 INFO:teuthology.orchestra.run.smithi155.stdout: "event": "waiting for subops from 1", 2023-08-01T19:54:51.548 INFO:teuthology.orchestra.run.smithi155.stdout: "time": "2023-08-01T19:54:51.480891+0000", 2023-08-01T19:54:51.548 INFO:teuthology.orchestra.run.smithi155.stdout: "duration": 0.00014228099999999999 2023-08-01T19:54:51.548 INFO:teuthology.orchestra.run.smithi155.stdout: }, 2023-08-01T19:54:51.548 INFO:teuthology.orchestra.run.smithi155.stdout: { 2023-08-01T19:54:51.549 INFO:teuthology.orchestra.run.smithi155.stdout: "event": "op_commit", 2023-08-01T19:54:51.549 INFO:teuthology.orchestra.run.smithi155.stdout: "time": "2023-08-01T19:54:51.485473+0000", 2023-08-01T19:54:51.549 INFO:teuthology.orchestra.run.smithi155.stdout: "duration": 0.0045812700000000001 2023-08-01T19:54:51.549 INFO:teuthology.orchestra.run.smithi155.stdout: } 2023-08-01T19:54:51.549 INFO:teuthology.orchestra.run.smithi155.stdout: ] 2023-08-01T19:54:51.549 INFO:teuthology.orchestra.run.smithi155.stdout: } 2023-08-01T19:54:51.549 INFO:teuthology.orchestra.run.smithi155.stdout: }, 2023-08-01T19:54:51.549 INFO:teuthology.orchestra.run.smithi155.stdout: { 2023-08-01T19:54:51.550 INFO:teuthology.orchestra.run.smithi155.stdout: "description": "osd_op(client.4668.0:73484 5.4 5:2147db39:::benchmark_data_smithi006_114134_object73483:head [set-alloc-hint object_size 65536 write_size 65536,write 0~65536 in=65536b] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e31)", 2023-08-01T19:54:51.550 INFO:teuthology.orchestra.run.smithi155.stdout: "initiated_at": "2023-08-01T19:54:51.483227+0000", 2023-08-01T19:54:51.550 INFO:teuthology.orchestra.run.smithi155.stdout: "age": 0.0029329389999999999, 2023-08-01T19:54:51.550 INFO:teuthology.orchestra.run.smithi155.stdout: "duration": 0.003379754, 2023-08-01T19:54:51.550 INFO:teuthology.orchestra.run.smithi155.stdout: "type_data": { 2023-08-01T19:54:51.550 INFO:teuthology.orchestra.run.smithi155.stdout: "flag_point": "waiting for sub ops", 2023-08-01T19:54:51.550 INFO:teuthology.orchestra.run.smithi155.stdout: "client_info": { 2023-08-01T19:54:51.550 INFO:teuthology.orchestra.run.smithi155.stdout: "client": "client.4668", 2023-08-01T19:54:51.551 INFO:teuthology.orchestra.run.smithi155.stdout: "client_addr": "172.21.15.6:0/1709472247", 2023-08-01T19:54:51.551 INFO:teuthology.orchestra.run.smithi155.stdout: "tid": 73484 2023-08-01T19:54:51.551 INFO:teuthology.orchestra.run.smithi155.stdout: }, 2023-08-01T19:54:51.551 INFO:teuthology.orchestra.run.smithi155.stdout: "events": [ 2023-08-01T19:54:51.551 INFO:teuthology.orchestra.run.smithi155.stdout: { 2023-08-01T19:54:51.551 INFO:teuthology.orchestra.run.smithi155.stdout: "event": "initiated", 2023-08-01T19:54:51.551 INFO:teuthology.orchestra.run.smithi155.stdout: "time": "2023-08-01T19:54:51.483227+0000", 2023-08-01T19:54:51.552 INFO:teuthology.orchestra.run.smithi155.stdout: "duration": 0 2023-08-01T19:54:51.552 INFO:teuthology.orchestra.run.smithi155.stdout: }, 2023-08-01T19:54:51.552 INFO:teuthology.orchestra.run.smithi155.stdout: { 2023-08-01T19:54:51.552 INFO:teuthology.orchestra.run.smithi155.stdout: "event": "throttled", 2023-08-01T19:54:51.552 INFO:teuthology.orchestra.run.smithi155.stdout: "time": "2023-08-01T19:54:51.483227+0000", 2023-08-01T19:54:51.552 INFO:teuthology.orchestra.run.smithi155.stdout: "duration": 0 2023-08-01T19:54:51.552 INFO:teuthology.orchestra.run.smithi155.stdout: }, 2023-08-01T19:54:51.552 INFO:teuthology.orchestra.run.smithi155.stdout: { 2023-08-01T19:54:51.553 INFO:teuthology.orchestra.run.smithi155.stdout: "event": "header_read", 2023-08-01T19:54:51.553 INFO:teuthology.orchestra.run.smithi155.stdout: "time": "2023-08-01T19:54:51.483226+0000", 2023-08-01T19:54:51.553 INFO:teuthology.orchestra.run.smithi155.stdout: "duration": 4294967295.999999 2023-08-01T19:54:51.553 INFO:teuthology.orchestra.run.smithi155.stdout: }, 2023-08-01T19:54:51.553 INFO:teuthology.orchestra.run.smithi155.stdout: { 2023-08-01T19:54:51.553 INFO:teuthology.orchestra.run.smithi155.stdout: "event": "all_read", 2023-08-01T19:54:51.553 INFO:teuthology.orchestra.run.smithi155.stdout: "time": "2023-08-01T19:54:51.483323+0000", 2023-08-01T19:54:51.553 INFO:teuthology.orchestra.run.smithi155.stdout: "duration": 9.7201999999999995e-05 2023-08-01T19:54:51.554 INFO:teuthology.orchestra.run.smithi155.stdout: }, 2023-08-01T19:54:51.554 INFO:teuthology.orchestra.run.smithi155.stdout: { 2023-08-01T19:54:51.554 INFO:teuthology.orchestra.run.smithi155.stdout: "event": "dispatched", 2023-08-01T19:54:51.554 INFO:teuthology.orchestra.run.smithi155.stdout: "time": "2023-08-01T19:54:51.483345+0000", 2023-08-01T19:54:51.554 INFO:teuthology.orchestra.run.smithi155.stdout: "duration": 2.2373000000000001e-05 2023-08-01T19:54:51.554 INFO:teuthology.orchestra.run.smithi155.stdout: }, 2023-08-01T19:54:51.554 INFO:teuthology.orchestra.run.smithi155.stdout: { 2023-08-01T19:54:51.555 INFO:teuthology.orchestra.run.smithi155.stdout: "event": "queued_for_pg", 2023-08-01T19:54:51.555 INFO:teuthology.orchestra.run.smithi155.stdout: "time": "2023-08-01T19:54:51.483354+0000", 2023-08-01T19:54:51.555 INFO:teuthology.orchestra.run.smithi155.stdout: "duration": 8.1519999999999992e-06 2023-08-01T19:54:51.555 INFO:teuthology.orchestra.run.smithi155.stdout: }, 2023-08-01T19:54:51.555 INFO:teuthology.orchestra.run.smithi155.stdout: { 2023-08-01T19:54:51.555 INFO:teuthology.orchestra.run.smithi155.stdout: "event": "reached_pg", 2023-08-01T19:54:51.555 INFO:teuthology.orchestra.run.smithi155.stdout: "time": "2023-08-01T19:54:51.483409+0000", 2023-08-01T19:54:51.555 INFO:teuthology.orchestra.run.smithi155.stdout: "duration": 5.5707e-05 2023-08-01T19:54:51.556 INFO:teuthology.orchestra.run.smithi155.stdout: }, 2023-08-01T19:54:51.556 INFO:teuthology.orchestra.run.smithi155.stdout: { 2023-08-01T19:54:51.556 INFO:teuthology.orchestra.run.smithi155.stdout: "event": "started", 2023-08-01T19:54:51.556 INFO:teuthology.orchestra.run.smithi155.stdout: "time": "2023-08-01T19:54:51.483539+0000", 2023-08-01T19:54:51.556 INFO:teuthology.orchestra.run.smithi155.stdout: "duration": 0.000129758 2023-08-01T19:54:51.556 INFO:teuthology.orchestra.run.smithi155.stdout: }, 2023-08-01T19:54:51.556 INFO:teuthology.orchestra.run.smithi155.stdout: { 2023-08-01T19:54:51.557 INFO:teuthology.orchestra.run.smithi155.stdout: "event": "waiting for subops from 0", 2023-08-01T19:54:51.557 INFO:teuthology.orchestra.run.smithi155.stdout: "time": "2023-08-01T19:54:51.483712+0000", 2023-08-01T19:54:51.557 INFO:teuthology.orchestra.run.smithi155.stdout: "duration": 0.000172917 2023-08-01T19:54:51.557 INFO:teuthology.orchestra.run.smithi155.stdout: } 2023-08-01T19:54:51.557 INFO:teuthology.orchestra.run.smithi155.stdout: ] 2023-08-01T19:54:51.557 INFO:teuthology.orchestra.run.smithi155.stdout: } 2023-08-01T19:54:51.557 INFO:teuthology.orchestra.run.smithi155.stdout: }, 2023-08-01T19:54:51.558 INFO:teuthology.orchestra.run.smithi155.stdout: { 2023-08-01T19:54:51.558 INFO:teuthology.orchestra.run.smithi155.stdout: "description": "osd_op(client.4668.0:73485 5.0 5:0884a8d1:::benchmark_data_smithi006_114134_object73484:head [set-alloc-hint object_size 65536 write_size 65536,write 0~65536 in=65536b] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e31)", 2023-08-01T19:54:51.558 INFO:teuthology.orchestra.run.smithi155.stdout: "initiated_at": "2023-08-01T19:54:51.483373+0000", 2023-08-01T19:54:51.558 INFO:teuthology.orchestra.run.smithi155.stdout: "age": 0.0027873030000000001, 2023-08-01T19:54:51.558 INFO:teuthology.orchestra.run.smithi155.stdout: "duration": 0.0032789120000000001, 2023-08-01T19:54:51.558 INFO:teuthology.orchestra.run.smithi155.stdout: "type_data": { 2023-08-01T19:54:51.558 INFO:teuthology.orchestra.run.smithi155.stdout: "flag_point": "waiting for sub ops", 2023-08-01T19:54:51.558 INFO:teuthology.orchestra.run.smithi155.stdout: "client_info": { 2023-08-01T19:54:51.559 INFO:teuthology.orchestra.run.smithi155.stdout: "client": "client.4668", 2023-08-01T19:54:51.559 INFO:teuthology.orchestra.run.smithi155.stdout: "client_addr": "172.21.15.6:0/1709472247", 2023-08-01T19:54:51.559 INFO:teuthology.orchestra.run.smithi155.stdout: "tid": 73485 2023-08-01T19:54:51.559 INFO:teuthology.orchestra.run.smithi155.stdout: }, 2023-08-01T19:54:51.559 INFO:teuthology.orchestra.run.smithi155.stdout: "events": [ 2023-08-01T19:54:51.559 INFO:teuthology.orchestra.run.smithi155.stdout: { 2023-08-01T19:54:51.559 INFO:teuthology.orchestra.run.smithi155.stdout: "event": "initiated", 2023-08-01T19:54:51.560 INFO:teuthology.orchestra.run.smithi155.stdout: "time": "2023-08-01T19:54:51.483373+0000", 2023-08-01T19:54:51.560 INFO:teuthology.orchestra.run.smithi155.stdout: "duration": 0 2023-08-01T19:54:51.560 INFO:teuthology.orchestra.run.smithi155.stdout: }, 2023-08-01T19:54:51.560 INFO:teuthology.orchestra.run.smithi155.stdout: { 2023-08-01T19:54:51.560 INFO:teuthology.orchestra.run.smithi155.stdout: "event": "throttled", 2023-08-01T19:54:51.560 INFO:teuthology.orchestra.run.smithi155.stdout: "time": "2023-08-01T19:54:51.483373+0000", 2023-08-01T19:54:51.560 INFO:teuthology.orchestra.run.smithi155.stdout: "duration": 0 2023-08-01T19:54:51.561 INFO:teuthology.orchestra.run.smithi155.stdout: }, 2023-08-01T19:54:51.561 INFO:teuthology.orchestra.run.smithi155.stdout: { 2023-08-01T19:54:51.561 INFO:teuthology.orchestra.run.smithi155.stdout: "event": "header_read", 2023-08-01T19:54:51.561 INFO:teuthology.orchestra.run.smithi155.stdout: "time": "2023-08-01T19:54:51.483372+0000", 2023-08-01T19:54:51.561 INFO:teuthology.orchestra.run.smithi155.stdout: "duration": 4294967295.9999995 2023-08-01T19:54:51.561 INFO:teuthology.orchestra.run.smithi155.stdout: }, 2023-08-01T19:54:51.561 INFO:teuthology.orchestra.run.smithi155.stdout: { 2023-08-01T19:54:51.562 INFO:teuthology.orchestra.run.smithi155.stdout: "event": "all_read", 2023-08-01T19:54:51.562 INFO:teuthology.orchestra.run.smithi155.stdout: "time": "2023-08-01T19:54:51.483413+0000", 2023-08-01T19:54:51.562 INFO:teuthology.orchestra.run.smithi155.stdout: "duration": 4.0868000000000002e-05 2023-08-01T19:54:51.562 INFO:teuthology.orchestra.run.smithi155.stdout: }, 2023-08-01T19:54:51.562 INFO:teuthology.orchestra.run.smithi155.stdout: { 2023-08-01T19:54:51.562 INFO:teuthology.orchestra.run.smithi155.stdout: "event": "dispatched", 2023-08-01T19:54:51.562 INFO:teuthology.orchestra.run.smithi155.stdout: "time": "2023-08-01T19:54:51.483428+0000", 2023-08-01T19:54:51.562 INFO:teuthology.orchestra.run.smithi155.stdout: "duration": 1.5568000000000001e-05 2023-08-01T19:54:51.563 INFO:teuthology.orchestra.run.smithi155.stdout: }, 2023-08-01T19:54:51.563 INFO:teuthology.orchestra.run.smithi155.stdout: { 2023-08-01T19:54:51.563 INFO:teuthology.orchestra.run.smithi155.stdout: "event": "queued_for_pg", 2023-08-01T19:54:51.563 INFO:teuthology.orchestra.run.smithi155.stdout: "time": "2023-08-01T19:54:51.483435+0000", 2023-08-01T19:54:51.563 INFO:teuthology.orchestra.run.smithi155.stdout: "duration": 6.8399999999999997e-06 2023-08-01T19:54:51.563 INFO:teuthology.orchestra.run.smithi155.stdout: }, 2023-08-01T19:54:51.563 INFO:teuthology.orchestra.run.smithi155.stdout: { 2023-08-01T19:54:51.564 INFO:teuthology.orchestra.run.smithi155.stdout: "event": "reached_pg", 2023-08-01T19:54:51.564 INFO:teuthology.orchestra.run.smithi155.stdout: "time": "2023-08-01T19:54:51.485543+0000", 2023-08-01T19:54:51.564 INFO:teuthology.orchestra.run.smithi155.stdout: "duration": 0.002107477 2023-08-01T19:54:51.564 INFO:teuthology.orchestra.run.smithi155.stdout: }, 2023-08-01T19:54:51.564 INFO:teuthology.orchestra.run.smithi155.stdout: { 2023-08-01T19:54:51.564 INFO:teuthology.orchestra.run.smithi155.stdout: "event": "started", 2023-08-01T19:54:51.564 INFO:teuthology.orchestra.run.smithi155.stdout: "time": "2023-08-01T19:54:51.485681+0000", 2023-08-01T19:54:51.565 INFO:teuthology.orchestra.run.smithi155.stdout: "duration": 0.00013835900000000001 2023-08-01T19:54:51.565 INFO:teuthology.orchestra.run.smithi155.stdout: }, 2023-08-01T19:54:51.565 INFO:teuthology.orchestra.run.smithi155.stdout: { 2023-08-01T19:54:51.565 INFO:teuthology.orchestra.run.smithi155.stdout: "event": "waiting for subops from 0", 2023-08-01T19:54:51.565 INFO:teuthology.orchestra.run.smithi155.stdout: "time": "2023-08-01T19:54:51.485833+0000", 2023-08-01T19:54:51.565 INFO:teuthology.orchestra.run.smithi155.stdout: "duration": 0.00015221899999999999 2023-08-01T19:54:51.565 INFO:teuthology.orchestra.run.smithi155.stdout: } 2023-08-01T19:54:51.565 INFO:teuthology.orchestra.run.smithi155.stdout: ] 2023-08-01T19:54:51.566 INFO:teuthology.orchestra.run.smithi155.stdout: } 2023-08-01T19:54:51.566 INFO:teuthology.orchestra.run.smithi155.stdout: }, 2023-08-01T19:54:51.566 INFO:teuthology.orchestra.run.smithi155.stdout: { 2023-08-01T19:54:51.566 INFO:teuthology.orchestra.run.smithi155.stdout: "description": "osd_repop(client.4668.0:73482 5.f e31/19 5:f950e790:::benchmark_data_smithi006_114134_object73481:head v 31'4633, mlcod=31'4631)", 2023-08-01T19:54:51.566 INFO:teuthology.orchestra.run.smithi155.stdout: "initiated_at": "2023-08-01T19:54:51.483582+0000", 2023-08-01T19:54:51.566 INFO:teuthology.orchestra.run.smithi155.stdout: "age": 0.0025776129999999999, 2023-08-01T19:54:51.566 INFO:teuthology.orchestra.run.smithi155.stdout: "duration": 0.0031130530000000002, 2023-08-01T19:54:51.567 INFO:teuthology.orchestra.run.smithi155.stdout: "type_data": { 2023-08-01T19:54:51.567 INFO:teuthology.orchestra.run.smithi155.stdout: "flag_point": "started", 2023-08-01T19:54:51.567 INFO:teuthology.orchestra.run.smithi155.stdout: "events": [ 2023-08-01T19:54:51.567 INFO:teuthology.orchestra.run.smithi155.stdout: { 2023-08-01T19:54:51.567 INFO:teuthology.orchestra.run.smithi155.stdout: "event": "initiated", 2023-08-01T19:54:51.567 INFO:teuthology.orchestra.run.smithi155.stdout: "time": "2023-08-01T19:54:51.483582+0000", 2023-08-01T19:54:51.567 INFO:teuthology.orchestra.run.smithi155.stdout: "duration": 0 2023-08-01T19:54:51.567 INFO:teuthology.orchestra.run.smithi155.stdout: }, 2023-08-01T19:54:51.568 INFO:teuthology.orchestra.run.smithi155.stdout: { 2023-08-01T19:54:51.568 INFO:teuthology.orchestra.run.smithi155.stdout: "event": "throttled", 2023-08-01T19:54:51.568 INFO:teuthology.orchestra.run.smithi155.stdout: "time": "2023-08-01T19:54:51.483582+0000", 2023-08-01T19:54:51.568 INFO:teuthology.orchestra.run.smithi155.stdout: "duration": 0 2023-08-01T19:54:51.568 INFO:teuthology.orchestra.run.smithi155.stdout: }, 2023-08-01T19:54:51.568 INFO:teuthology.orchestra.run.smithi155.stdout: { 2023-08-01T19:54:51.568 INFO:teuthology.orchestra.run.smithi155.stdout: "event": "header_read", 2023-08-01T19:54:51.568 INFO:teuthology.orchestra.run.smithi155.stdout: "time": "2023-08-01T19:54:51.483582+0000", 2023-08-01T19:54:51.569 INFO:teuthology.orchestra.run.smithi155.stdout: "duration": 4294967295.999999 2023-08-01T19:54:51.569 INFO:teuthology.orchestra.run.smithi155.stdout: }, 2023-08-01T19:54:51.569 INFO:teuthology.orchestra.run.smithi155.stdout: { 2023-08-01T19:54:51.569 INFO:teuthology.orchestra.run.smithi155.stdout: "event": "all_read", 2023-08-01T19:54:51.569 INFO:teuthology.orchestra.run.smithi155.stdout: "time": "2023-08-01T19:54:51.483659+0000", 2023-08-01T19:54:51.569 INFO:teuthology.orchestra.run.smithi155.stdout: "duration": 7.7270999999999999e-05 2023-08-01T19:54:51.569 INFO:teuthology.orchestra.run.smithi155.stdout: }, 2023-08-01T19:54:51.569 INFO:teuthology.orchestra.run.smithi155.stdout: { 2023-08-01T19:54:51.570 INFO:teuthology.orchestra.run.smithi155.stdout: "event": "dispatched", 2023-08-01T19:54:51.570 INFO:teuthology.orchestra.run.smithi155.stdout: "time": "2023-08-01T19:54:51.483669+0000", 2023-08-01T19:54:51.570 INFO:teuthology.orchestra.run.smithi155.stdout: "duration": 1.0558e-05 2023-08-01T19:54:51.570 INFO:teuthology.orchestra.run.smithi155.stdout: }, 2023-08-01T19:54:51.570 INFO:teuthology.orchestra.run.smithi155.stdout: { 2023-08-01T19:54:51.570 INFO:teuthology.orchestra.run.smithi155.stdout: "event": "queued_for_pg", 2023-08-01T19:54:51.570 INFO:teuthology.orchestra.run.smithi155.stdout: "time": "2023-08-01T19:54:51.483676+0000", 2023-08-01T19:54:51.570 INFO:teuthology.orchestra.run.smithi155.stdout: "duration": 6.3500000000000002e-06 2023-08-01T19:54:51.571 INFO:teuthology.orchestra.run.smithi155.stdout: }, 2023-08-01T19:54:51.571 INFO:teuthology.orchestra.run.smithi155.stdout: { 2023-08-01T19:54:51.571 INFO:teuthology.orchestra.run.smithi155.stdout: "event": "reached_pg", 2023-08-01T19:54:51.571 INFO:teuthology.orchestra.run.smithi155.stdout: "time": "2023-08-01T19:54:51.483708+0000", 2023-08-01T19:54:51.571 INFO:teuthology.orchestra.run.smithi155.stdout: "duration": 3.2113999999999998e-05 2023-08-01T19:54:51.571 INFO:teuthology.orchestra.run.smithi155.stdout: }, 2023-08-01T19:54:51.571 INFO:teuthology.orchestra.run.smithi155.stdout: { 2023-08-01T19:54:51.572 INFO:teuthology.orchestra.run.smithi155.stdout: "event": "started", 2023-08-01T19:54:51.572 INFO:teuthology.orchestra.run.smithi155.stdout: "time": "2023-08-01T19:54:51.483730+0000", 2023-08-01T19:54:51.572 INFO:teuthology.orchestra.run.smithi155.stdout: "duration": 2.2619000000000001e-05 2023-08-01T19:54:51.572 INFO:teuthology.orchestra.run.smithi155.stdout: } 2023-08-01T19:54:51.572 INFO:teuthology.orchestra.run.smithi155.stdout: ] 2023-08-01T19:54:51.572 INFO:teuthology.orchestra.run.smithi155.stdout: } 2023-08-01T19:54:51.572 INFO:teuthology.orchestra.run.smithi155.stdout: }, 2023-08-01T19:54:51.572 INFO:teuthology.orchestra.run.smithi155.stdout: { 2023-08-01T19:54:51.573 INFO:teuthology.orchestra.run.smithi155.stdout: "description": "osd_op(client.4668.0:73489 5.0 5.feda91e0 (undecoded) ondisk+write+known_if_redirected+supports_pool_eio e31)", 2023-08-01T19:54:51.573 INFO:teuthology.orchestra.run.smithi155.stdout: "initiated_at": "2023-08-01T19:54:51.485618+0000", 2023-08-01T19:54:51.573 INFO:teuthology.orchestra.run.smithi155.stdout: "age": 0.00054223400000000005, 2023-08-01T19:54:51.573 INFO:teuthology.orchestra.run.smithi155.stdout: "duration": 0.0011122009999999999, 2023-08-01T19:54:51.573 INFO:teuthology.orchestra.run.smithi155.stdout: "type_data": { 2023-08-01T19:54:51.573 INFO:teuthology.orchestra.run.smithi155.stdout: "flag_point": "queued for pg", 2023-08-01T19:54:51.573 INFO:teuthology.orchestra.run.smithi155.stdout: "client_info": { 2023-08-01T19:54:51.573 INFO:teuthology.orchestra.run.smithi155.stdout: "client": "client.4668", 2023-08-01T19:54:51.574 INFO:teuthology.orchestra.run.smithi155.stdout: "client_addr": "172.21.15.6:0/1709472247", 2023-08-01T19:54:51.574 INFO:teuthology.orchestra.run.smithi155.stdout: "tid": 73489 2023-08-01T19:54:51.574 INFO:teuthology.orchestra.run.smithi155.stdout: }, 2023-08-01T19:54:51.574 INFO:teuthology.orchestra.run.smithi155.stdout: "events": [ 2023-08-01T19:54:51.574 INFO:teuthology.orchestra.run.smithi155.stdout: { 2023-08-01T19:54:51.574 INFO:teuthology.orchestra.run.smithi155.stdout: "event": "initiated", 2023-08-01T19:54:51.574 INFO:teuthology.orchestra.run.smithi155.stdout: "time": "2023-08-01T19:54:51.485618+0000", 2023-08-01T19:54:51.575 INFO:teuthology.orchestra.run.smithi155.stdout: "duration": 0 2023-08-01T19:54:51.575 INFO:teuthology.orchestra.run.smithi155.stdout: }, 2023-08-01T19:54:51.575 INFO:teuthology.orchestra.run.smithi155.stdout: { 2023-08-01T19:54:51.575 INFO:teuthology.orchestra.run.smithi155.stdout: "event": "throttled", 2023-08-01T19:54:51.575 INFO:teuthology.orchestra.run.smithi155.stdout: "time": "2023-08-01T19:54:51.485618+0000", 2023-08-01T19:54:51.575 INFO:teuthology.orchestra.run.smithi155.stdout: "duration": 0 2023-08-01T19:54:51.575 INFO:teuthology.orchestra.run.smithi155.stdout: }, 2023-08-01T19:54:51.575 INFO:teuthology.orchestra.run.smithi155.stdout: { 2023-08-01T19:54:51.576 INFO:teuthology.orchestra.run.smithi155.stdout: "event": "header_read", 2023-08-01T19:54:51.576 INFO:teuthology.orchestra.run.smithi155.stdout: "time": "2023-08-01T19:54:51.485617+0000", 2023-08-01T19:54:51.576 INFO:teuthology.orchestra.run.smithi155.stdout: "duration": 4294967295.999999 2023-08-01T19:54:51.576 INFO:teuthology.orchestra.run.smithi155.stdout: }, 2023-08-01T19:54:51.576 INFO:teuthology.orchestra.run.smithi155.stdout: { 2023-08-01T19:54:51.576 INFO:teuthology.orchestra.run.smithi155.stdout: "event": "all_read", 2023-08-01T19:54:51.576 INFO:teuthology.orchestra.run.smithi155.stdout: "time": "2023-08-01T19:54:51.485710+0000", 2023-08-01T19:54:51.577 INFO:teuthology.orchestra.run.smithi155.stdout: "duration": 9.2972000000000004e-05 2023-08-01T19:54:51.577 INFO:teuthology.orchestra.run.smithi155.stdout: }, 2023-08-01T19:54:51.577 INFO:teuthology.orchestra.run.smithi155.stdout: { 2023-08-01T19:54:51.577 INFO:teuthology.orchestra.run.smithi155.stdout: "event": "dispatched", 2023-08-01T19:54:51.577 INFO:teuthology.orchestra.run.smithi155.stdout: "time": "2023-08-01T19:54:51.485721+0000", 2023-08-01T19:54:51.577 INFO:teuthology.orchestra.run.smithi155.stdout: "duration": 1.1396000000000001e-05 2023-08-01T19:54:51.577 INFO:teuthology.orchestra.run.smithi155.stdout: }, 2023-08-01T19:54:51.577 INFO:teuthology.orchestra.run.smithi155.stdout: { 2023-08-01T19:54:51.578 INFO:teuthology.orchestra.run.smithi155.stdout: "event": "queued_for_pg", 2023-08-01T19:54:51.578 INFO:teuthology.orchestra.run.smithi155.stdout: "time": "2023-08-01T19:54:51.485728+0000", 2023-08-01T19:54:51.578 INFO:teuthology.orchestra.run.smithi155.stdout: "duration": 6.4949999999999996e-06 2023-08-01T19:54:51.578 INFO:teuthology.orchestra.run.smithi155.stdout: } 2023-08-01T19:54:51.578 INFO:teuthology.orchestra.run.smithi155.stdout: ] 2023-08-01T19:54:51.578 INFO:teuthology.orchestra.run.smithi155.stdout: } 2023-08-01T19:54:51.578 INFO:teuthology.orchestra.run.smithi155.stdout: } 2023-08-01T19:54:51.579 INFO:teuthology.orchestra.run.smithi155.stdout: ], 2023-08-01T19:54:51.579 INFO:teuthology.orchestra.run.smithi155.stdout: "num_ops": 12 2023-08-01T19:54:51.579 INFO:teuthology.orchestra.run.smithi155.stdout:} 2023-08-01T19:54:51.580 INFO:tasks.ceph.osd.1.smithi101.stderr:2023-08-01T19:54:51.579+0000 7fb0cb7f6700 -1 received signal: Hangup from /usr/bin/python3 /bin/daemon-helper kill ceph-osd -f --cluster ceph -i 1 (PID: 111141) UID: 0 2023-08-01T19:54:51.581 DEBUG:teuthology.orchestra.run.smithi155:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 30 ceph --cluster ceph --admin-daemon /var/run/ceph/ceph-osd.2.asok dump_blocked_ops 2023-08-01T19:54:51.681 INFO:tasks.ceph.osd.0.smithi008.stderr:2023-08-01T19:54:51.680+0000 7f16a58f4700 -1 received signal: Hangup from /usr/bin/python3 /bin/daemon-helper kill ceph-osd -f --cluster ceph -i 0 (PID: 111179) UID: 0 2023-08-01T19:54:51.780 INFO:teuthology.orchestra.run.smithi155.stdout:{ 2023-08-01T19:54:51.780 INFO:teuthology.orchestra.run.smithi155.stdout: "ops": [], 2023-08-01T19:54:51.780 INFO:teuthology.orchestra.run.smithi155.stdout: "complaint_time": 30, 2023-08-01T19:54:51.780 INFO:teuthology.orchestra.run.smithi155.stdout: "num_blocked_ops": 0 2023-08-01T19:54:51.780 INFO:teuthology.orchestra.run.smithi155.stdout:} 2023-08-01T19:54:51.781 INFO:tasks.ceph.osd.2.smithi155.stderr:2023-08-01T19:54:51.780+0000 7faa5c6ac700 -1 received signal: Hangup from /usr/bin/python3 /bin/daemon-helper kill ceph-osd -f --cluster ceph -i 2 (PID: 111337) UID: 0 2023-08-01T19:54:51.792 DEBUG:teuthology.orchestra.run.smithi155:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 30 ceph --cluster ceph --admin-daemon /var/run/ceph/ceph-osd.2.asok dump_historic_ops 2023-08-01T19:54:51.882 INFO:tasks.ceph.osd.0.smithi008.stderr:2023-08-01T19:54:51.881+0000 7f16a58f4700 -1 received signal: Hangup from /usr/bin/python3 /bin/daemon-helper kill ceph-osd -f --cluster ceph -i 0 (PID: 111179) UID: 0 2023-08-01T19:54:51.982 INFO:tasks.ceph.osd.2.smithi155.stderr:2023-08-01T19:54:51.981+0000 7faa5c6ac700 -1 received signal: Hangup from /usr/bin/python3 /bin/daemon-helper kill ceph-osd -f --cluster ceph -i 2 (PID: 111337) UID: 0 2023-08-01T19:54:51.995 INFO:teuthology.orchestra.run.smithi155.stdout:{ 2023-08-01T19:54:51.996 INFO:teuthology.orchestra.run.smithi155.stdout: "size": 20, 2023-08-01T19:54:51.996 INFO:teuthology.orchestra.run.smithi155.stdout: "duration": 600, 2023-08-01T19:54:51.996 INFO:teuthology.orchestra.run.smithi155.stdout: "ops": [ 2023-08-01T19:54:51.996 INFO:teuthology.orchestra.run.smithi155.stdout: { 2023-08-01T19:54:51.996 INFO:teuthology.orchestra.run.smithi155.stdout: "description": "osd_op(client.4668.0:31683 5.d 5:be764a02:::benchmark_data_smithi006_114134_object31682:head [set-alloc-hint object_size 65536 write_size 65536,write 0~65536] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e24)", 2023-08-01T19:54:51.996 INFO:teuthology.orchestra.run.smithi155.stdout: "initiated_at": "2023-08-01T19:54:33.229635+0000", 2023-08-01T19:54:51.997 INFO:teuthology.orchestra.run.smithi155.stdout: "age": 18.763026216, 2023-08-01T19:54:51.997 INFO:teuthology.orchestra.run.smithi155.stdout: "duration": 0.015494648, 2023-08-01T19:54:51.997 INFO:teuthology.orchestra.run.smithi155.stdout: "type_data": { 2023-08-01T19:54:51.997 INFO:teuthology.orchestra.run.smithi155.stdout: "flag_point": "commit sent; apply or cleanup", 2023-08-01T19:54:51.997 INFO:teuthology.orchestra.run.smithi155.stdout: "client_info": { 2023-08-01T19:54:51.997 INFO:teuthology.orchestra.run.smithi155.stdout: "client": "client.4668", 2023-08-01T19:54:51.997 INFO:teuthology.orchestra.run.smithi155.stdout: "client_addr": "172.21.15.6:0/1709472247", 2023-08-01T19:54:51.998 INFO:teuthology.orchestra.run.smithi155.stdout: "tid": 31683 2023-08-01T19:54:51.998 INFO:teuthology.orchestra.run.smithi155.stdout: }, 2023-08-01T19:54:51.998 INFO:teuthology.orchestra.run.smithi155.stdout: "events": [ 2023-08-01T19:54:51.998 INFO:teuthology.orchestra.run.smithi155.stdout: { 2023-08-01T19:54:51.998 INFO:teuthology.orchestra.run.smithi155.stdout: "event": "initiated", 2023-08-01T19:54:51.998 INFO:teuthology.orchestra.run.smithi155.stdout: "time": "2023-08-01T19:54:33.229635+0000", 2023-08-01T19:54:51.999 INFO:teuthology.orchestra.run.smithi155.stdout: "duration": 0 2023-08-01T19:54:51.999 INFO:teuthology.orchestra.run.smithi155.stdout: }, 2023-08-01T19:54:51.999 INFO:teuthology.orchestra.run.smithi155.stdout: { 2023-08-01T19:54:51.999 INFO:teuthology.orchestra.run.smithi155.stdout: "event": "throttled", 2023-08-01T19:54:51.999 INFO:teuthology.orchestra.run.smithi155.stdout: "time": "2023-08-01T19:54:33.229635+0000", 2023-08-01T19:54:51.999 INFO:teuthology.orchestra.run.smithi155.stdout: "duration": 0 2023-08-01T19:54:51.999 INFO:teuthology.orchestra.run.smithi155.stdout: }, 2023-08-01T19:54:52.000 INFO:teuthology.orchestra.run.smithi155.stdout: { 2023-08-01T19:54:52.000 INFO:teuthology.orchestra.run.smithi155.stdout: "event": "header_read", 2023-08-01T19:54:52.000 INFO:teuthology.orchestra.run.smithi155.stdout: "time": "2023-08-01T19:54:33.229635+0000", 2023-08-01T19:54:52.000 INFO:teuthology.orchestra.run.smithi155.stdout: "duration": 4294967295.9999995 2023-08-01T19:54:52.000 INFO:teuthology.orchestra.run.smithi155.stdout: }, 2023-08-01T19:54:52.000 INFO:teuthology.orchestra.run.smithi155.stdout: { 2023-08-01T19:54:52.000 INFO:teuthology.orchestra.run.smithi155.stdout: "event": "all_read", 2023-08-01T19:54:52.000 INFO:teuthology.orchestra.run.smithi155.stdout: "time": "2023-08-01T19:54:33.229723+0000", 2023-08-01T19:54:52.001 INFO:teuthology.orchestra.run.smithi155.stdout: "duration": 8.7983000000000001e-05 2023-08-01T19:54:52.001 INFO:teuthology.orchestra.run.smithi155.stdout: }, 2023-08-01T19:54:52.001 INFO:teuthology.orchestra.run.smithi155.stdout: { 2023-08-01T19:54:52.001 INFO:teuthology.orchestra.run.smithi155.stdout: "event": "dispatched", 2023-08-01T19:54:52.001 INFO:teuthology.orchestra.run.smithi155.stdout: "time": "2023-08-01T19:54:33.229728+0000", 2023-08-01T19:54:52.001 INFO:teuthology.orchestra.run.smithi155.stdout: "duration": 5.2830000000000001e-06 2023-08-01T19:54:52.001 INFO:teuthology.orchestra.run.smithi155.stdout: }, 2023-08-01T19:54:52.001 INFO:teuthology.orchestra.run.smithi155.stdout: { 2023-08-01T19:54:52.002 INFO:teuthology.orchestra.run.smithi155.stdout: "event": "queued_for_pg", 2023-08-01T19:54:52.002 INFO:teuthology.orchestra.run.smithi155.stdout: "time": "2023-08-01T19:54:33.229732+0000", 2023-08-01T19:54:52.002 INFO:teuthology.orchestra.run.smithi155.stdout: "duration": 4.0990000000000001e-06 2023-08-01T19:54:52.002 INFO:teuthology.orchestra.run.smithi155.stdout: }, 2023-08-01T19:54:52.002 INFO:teuthology.orchestra.run.smithi155.stdout: { 2023-08-01T19:54:52.002 INFO:teuthology.orchestra.run.smithi155.stdout: "event": "reached_pg", 2023-08-01T19:54:52.002 INFO:teuthology.orchestra.run.smithi155.stdout: "time": "2023-08-01T19:54:33.229762+0000", 2023-08-01T19:54:52.003 INFO:teuthology.orchestra.run.smithi155.stdout: "duration": 3.0161000000000001e-05 2023-08-01T19:54:52.003 INFO:teuthology.orchestra.run.smithi155.stdout: }, 2023-08-01T19:54:52.003 INFO:teuthology.orchestra.run.smithi155.stdout: { 2023-08-01T19:54:52.003 INFO:teuthology.orchestra.run.smithi155.stdout: "event": "started", 2023-08-01T19:54:52.003 INFO:teuthology.orchestra.run.smithi155.stdout: "time": "2023-08-01T19:54:33.229840+0000", 2023-08-01T19:54:52.003 INFO:teuthology.orchestra.run.smithi155.stdout: "duration": 7.8059000000000006e-05 2023-08-01T19:54:52.003 INFO:teuthology.orchestra.run.smithi155.stdout: }, 2023-08-01T19:54:52.004 INFO:teuthology.orchestra.run.smithi155.stdout: { 2023-08-01T19:54:52.004 INFO:teuthology.orchestra.run.smithi155.stdout: "event": "waiting for subops from 1", 2023-08-01T19:54:52.004 INFO:teuthology.orchestra.run.smithi155.stdout: "time": "2023-08-01T19:54:33.229924+0000", 2023-08-01T19:54:52.004 INFO:teuthology.orchestra.run.smithi155.stdout: "duration": 8.3444999999999998e-05 2023-08-01T19:54:52.004 INFO:teuthology.orchestra.run.smithi155.stdout: }, 2023-08-01T19:54:52.004 INFO:teuthology.orchestra.run.smithi155.stdout: { 2023-08-01T19:54:52.004 INFO:teuthology.orchestra.run.smithi155.stdout: "event": "op_commit", 2023-08-01T19:54:52.004 INFO:teuthology.orchestra.run.smithi155.stdout: "time": "2023-08-01T19:54:33.234514+0000", 2023-08-01T19:54:52.005 INFO:teuthology.orchestra.run.smithi155.stdout: "duration": 0.0045896890000000001 2023-08-01T19:54:52.005 INFO:teuthology.orchestra.run.smithi155.stdout: }, 2023-08-01T19:54:52.005 INFO:teuthology.orchestra.run.smithi155.stdout: { 2023-08-01T19:54:52.005 INFO:teuthology.orchestra.run.smithi155.stdout: "event": "sub_op_commit_rec", 2023-08-01T19:54:52.005 INFO:teuthology.orchestra.run.smithi155.stdout: "time": "2023-08-01T19:54:33.245069+0000", 2023-08-01T19:54:52.005 INFO:teuthology.orchestra.run.smithi155.stdout: "duration": 0.01055566 2023-08-01T19:54:52.005 INFO:teuthology.orchestra.run.smithi155.stdout: }, 2023-08-01T19:54:52.006 INFO:teuthology.orchestra.run.smithi155.stdout: { 2023-08-01T19:54:52.006 INFO:teuthology.orchestra.run.smithi155.stdout: "event": "commit_sent", 2023-08-01T19:54:52.006 INFO:teuthology.orchestra.run.smithi155.stdout: "time": "2023-08-01T19:54:33.245102+0000", 2023-08-01T19:54:52.006 INFO:teuthology.orchestra.run.smithi155.stdout: "duration": 3.3025999999999999e-05 2023-08-01T19:54:52.006 INFO:teuthology.orchestra.run.smithi155.stdout: }, 2023-08-01T19:54:52.006 INFO:teuthology.orchestra.run.smithi155.stdout: { 2023-08-01T19:54:52.006 INFO:teuthology.orchestra.run.smithi155.stdout: "event": "done", 2023-08-01T19:54:52.007 INFO:teuthology.orchestra.run.smithi155.stdout: "time": "2023-08-01T19:54:33.245130+0000", 2023-08-01T19:54:52.007 INFO:teuthology.orchestra.run.smithi155.stdout: "duration": 2.7818e-05 2023-08-01T19:54:52.007 INFO:teuthology.orchestra.run.smithi155.stdout: } 2023-08-01T19:54:52.007 INFO:teuthology.orchestra.run.smithi155.stdout: ] 2023-08-01T19:54:52.007 INFO:teuthology.orchestra.run.smithi155.stdout: } 2023-08-01T19:54:52.007 INFO:teuthology.orchestra.run.smithi155.stdout: }, 2023-08-01T19:54:52.007 INFO:teuthology.orchestra.run.smithi155.stdout: { 2023-08-01T19:54:52.007 INFO:teuthology.orchestra.run.smithi155.stdout: "description": "osd_op(client.4668.0:33935 5.e 5:71b9621b:::benchmark_data_smithi006_114134_object33934:head [set-alloc-hint object_size 65536 write_size 65536,write 0~65536] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e24)", 2023-08-01T19:54:52.008 INFO:teuthology.orchestra.run.smithi155.stdout: "initiated_at": "2023-08-01T19:54:34.001558+0000", 2023-08-01T19:54:52.008 INFO:teuthology.orchestra.run.smithi155.stdout: "age": 17.991103791, 2023-08-01T19:54:52.008 INFO:teuthology.orchestra.run.smithi155.stdout: "duration": 0.015838234, 2023-08-01T19:54:52.008 INFO:teuthology.orchestra.run.smithi155.stdout: "type_data": { 2023-08-01T19:54:52.008 INFO:teuthology.orchestra.run.smithi155.stdout: "flag_point": "commit sent; apply or cleanup", 2023-08-01T19:54:52.008 INFO:teuthology.orchestra.run.smithi155.stdout: "client_info": { 2023-08-01T19:54:52.008 INFO:teuthology.orchestra.run.smithi155.stdout: "client": "client.4668", 2023-08-01T19:54:52.009 INFO:teuthology.orchestra.run.smithi155.stdout: "client_addr": "172.21.15.6:0/1709472247", 2023-08-01T19:54:52.009 INFO:teuthology.orchestra.run.smithi155.stdout: "tid": 33935 2023-08-01T19:54:52.009 INFO:teuthology.orchestra.run.smithi155.stdout: }, 2023-08-01T19:54:52.009 INFO:teuthology.orchestra.run.smithi155.stdout: "events": [ 2023-08-01T19:54:52.009 INFO:teuthology.orchestra.run.smithi155.stdout: { 2023-08-01T19:54:52.009 INFO:teuthology.orchestra.run.smithi155.stdout: "event": "initiated", 2023-08-01T19:54:52.009 INFO:teuthology.orchestra.run.smithi155.stdout: "time": "2023-08-01T19:54:34.001558+0000", 2023-08-01T19:54:52.010 INFO:teuthology.orchestra.run.smithi155.stdout: "duration": 0 2023-08-01T19:54:52.010 INFO:teuthology.orchestra.run.smithi155.stdout: }, 2023-08-01T19:54:52.010 INFO:teuthology.orchestra.run.smithi155.stdout: { 2023-08-01T19:54:52.010 INFO:teuthology.orchestra.run.smithi155.stdout: "event": "throttled", 2023-08-01T19:54:52.010 INFO:teuthology.orchestra.run.smithi155.stdout: "time": "2023-08-01T19:54:34.001558+0000", 2023-08-01T19:54:52.010 INFO:teuthology.orchestra.run.smithi155.stdout: "duration": 0 2023-08-01T19:54:52.010 INFO:teuthology.orchestra.run.smithi155.stdout: }, 2023-08-01T19:54:52.011 INFO:teuthology.orchestra.run.smithi155.stdout: { 2023-08-01T19:54:52.011 INFO:teuthology.orchestra.run.smithi155.stdout: "event": "header_read", 2023-08-01T19:54:52.011 INFO:teuthology.orchestra.run.smithi155.stdout: "time": "2023-08-01T19:54:34.001557+0000", 2023-08-01T19:54:52.011 INFO:teuthology.orchestra.run.smithi155.stdout: "duration": 4294967295.9999995 2023-08-01T19:54:52.011 INFO:teuthology.orchestra.run.smithi155.stdout: }, 2023-08-01T19:54:52.011 INFO:teuthology.orchestra.run.smithi155.stdout: { 2023-08-01T19:54:52.011 INFO:teuthology.orchestra.run.smithi155.stdout: "event": "all_read", 2023-08-01T19:54:52.012 INFO:teuthology.orchestra.run.smithi155.stdout: "time": "2023-08-01T19:54:34.001620+0000", 2023-08-01T19:54:52.012 INFO:teuthology.orchestra.run.smithi155.stdout: "duration": 6.2751999999999998e-05 2023-08-01T19:54:52.012 INFO:teuthology.orchestra.run.smithi155.stdout: }, 2023-08-01T19:54:52.012 INFO:teuthology.orchestra.run.smithi155.stdout: { 2023-08-01T19:54:52.012 INFO:teuthology.orchestra.run.smithi155.stdout: "event": "dispatched", 2023-08-01T19:54:52.012 INFO:teuthology.orchestra.run.smithi155.stdout: "time": "2023-08-01T19:54:34.001632+0000", 2023-08-01T19:54:52.013 INFO:teuthology.orchestra.run.smithi155.stdout: "duration": 1.1731e-05 2023-08-01T19:54:52.013 INFO:teuthology.orchestra.run.smithi155.stdout: }, 2023-08-01T19:54:52.013 INFO:teuthology.orchestra.run.smithi155.stdout: { 2023-08-01T19:54:52.013 INFO:teuthology.orchestra.run.smithi155.stdout: "event": "queued_for_pg", 2023-08-01T19:54:52.013 INFO:teuthology.orchestra.run.smithi155.stdout: "time": "2023-08-01T19:54:34.001635+0000", 2023-08-01T19:54:52.013 INFO:teuthology.orchestra.run.smithi155.stdout: "duration": 3.7859999999999998e-06 2023-08-01T19:54:52.013 INFO:teuthology.orchestra.run.smithi155.stdout: }, 2023-08-01T19:54:52.014 INFO:teuthology.orchestra.run.smithi155.stdout: { 2023-08-01T19:54:52.014 INFO:teuthology.orchestra.run.smithi155.stdout: "event": "reached_pg", 2023-08-01T19:54:52.014 INFO:teuthology.orchestra.run.smithi155.stdout: "time": "2023-08-01T19:54:34.001688+0000", 2023-08-01T19:54:52.014 INFO:teuthology.orchestra.run.smithi155.stdout: "duration": 5.2899000000000003e-05 2023-08-01T19:54:52.014 INFO:teuthology.orchestra.run.smithi155.stdout: }, 2023-08-01T19:54:52.014 INFO:teuthology.orchestra.run.smithi155.stdout: { 2023-08-01T19:54:52.014 INFO:teuthology.orchestra.run.smithi155.stdout: "event": "started", 2023-08-01T19:54:52.014 INFO:teuthology.orchestra.run.smithi155.stdout: "time": "2023-08-01T19:54:34.001838+0000", 2023-08-01T19:54:52.015 INFO:teuthology.orchestra.run.smithi155.stdout: "duration": 0.00015003999999999999 2023-08-01T19:54:52.015 INFO:teuthology.orchestra.run.smithi155.stdout: }, 2023-08-01T19:54:52.015 INFO:teuthology.orchestra.run.smithi155.stdout: { 2023-08-01T19:54:52.015 INFO:teuthology.orchestra.run.smithi155.stdout: "event": "waiting for subops from 0", 2023-08-01T19:54:52.015 INFO:teuthology.orchestra.run.smithi155.stdout: "time": "2023-08-01T19:54:34.001972+0000", 2023-08-01T19:54:52.015 INFO:teuthology.orchestra.run.smithi155.stdout: "duration": 0.00013333799999999999 2023-08-01T19:54:52.015 INFO:teuthology.orchestra.run.smithi155.stdout: }, 2023-08-01T19:54:52.015 INFO:teuthology.orchestra.run.smithi155.stdout: { 2023-08-01T19:54:52.016 INFO:teuthology.orchestra.run.smithi155.stdout: "event": "sub_op_commit_rec", 2023-08-01T19:54:52.016 INFO:teuthology.orchestra.run.smithi155.stdout: "time": "2023-08-01T19:54:34.005385+0000", 2023-08-01T19:54:52.016 INFO:teuthology.orchestra.run.smithi155.stdout: "duration": 0.003413611 2023-08-01T19:54:52.016 INFO:teuthology.orchestra.run.smithi155.stdout: }, 2023-08-01T19:54:52.016 INFO:teuthology.orchestra.run.smithi155.stdout: { 2023-08-01T19:54:52.016 INFO:teuthology.orchestra.run.smithi155.stdout: "event": "op_commit", 2023-08-01T19:54:52.017 INFO:teuthology.orchestra.run.smithi155.stdout: "time": "2023-08-01T19:54:34.017300+0000", 2023-08-01T19:54:52.017 INFO:teuthology.orchestra.run.smithi155.stdout: "duration": 0.011914645 2023-08-01T19:54:52.017 INFO:teuthology.orchestra.run.smithi155.stdout: }, 2023-08-01T19:54:52.017 INFO:teuthology.orchestra.run.smithi155.stdout: { 2023-08-01T19:54:52.017 INFO:teuthology.orchestra.run.smithi155.stdout: "event": "commit_sent", 2023-08-01T19:54:52.017 INFO:teuthology.orchestra.run.smithi155.stdout: "time": "2023-08-01T19:54:34.017355+0000", 2023-08-01T19:54:52.017 INFO:teuthology.orchestra.run.smithi155.stdout: "duration": 5.5084999999999999e-05 2023-08-01T19:54:52.017 INFO:teuthology.orchestra.run.smithi155.stdout: }, 2023-08-01T19:54:52.018 INFO:teuthology.orchestra.run.smithi155.stdout: { 2023-08-01T19:54:52.018 INFO:teuthology.orchestra.run.smithi155.stdout: "event": "done", 2023-08-01T19:54:52.018 INFO:teuthology.orchestra.run.smithi155.stdout: "time": "2023-08-01T19:54:34.017396+0000", 2023-08-01T19:54:52.018 INFO:teuthology.orchestra.run.smithi155.stdout: "duration": 4.1004999999999998e-05 2023-08-01T19:54:52.018 INFO:teuthology.orchestra.run.smithi155.stdout: } 2023-08-01T19:54:52.018 INFO:teuthology.orchestra.run.smithi155.stdout: ] 2023-08-01T19:54:52.018 INFO:teuthology.orchestra.run.smithi155.stdout: } 2023-08-01T19:54:52.019 INFO:teuthology.orchestra.run.smithi155.stdout: }, 2023-08-01T19:54:52.019 INFO:teuthology.orchestra.run.smithi155.stdout: { 2023-08-01T19:54:52.019 INFO:teuthology.orchestra.run.smithi155.stdout: "description": "osd_op(client.4668.0:33937 5.4 5:20710eb3:::benchmark_data_smithi006_114134_object33936:head [set-alloc-hint object_size 65536 write_size 65536,write 0~65536] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e24)", 2023-08-01T19:54:52.019 INFO:teuthology.orchestra.run.smithi155.stdout: "initiated_at": "2023-08-01T19:54:34.001682+0000", 2023-08-01T19:54:52.019 INFO:teuthology.orchestra.run.smithi155.stdout: "age": 17.990979880000001, 2023-08-01T19:54:52.019 INFO:teuthology.orchestra.run.smithi155.stdout: "duration": 0.015739876, 2023-08-01T19:54:52.020 INFO:teuthology.orchestra.run.smithi155.stdout: "type_data": { 2023-08-01T19:54:52.020 INFO:teuthology.orchestra.run.smithi155.stdout: "flag_point": "commit sent; apply or cleanup", 2023-08-01T19:54:52.020 INFO:teuthology.orchestra.run.smithi155.stdout: "client_info": { 2023-08-01T19:54:52.020 INFO:teuthology.orchestra.run.smithi155.stdout: "client": "client.4668", 2023-08-01T19:54:52.020 INFO:teuthology.orchestra.run.smithi155.stdout: "client_addr": "172.21.15.6:0/1709472247", 2023-08-01T19:54:52.020 INFO:teuthology.orchestra.run.smithi155.stdout: "tid": 33937 2023-08-01T19:54:52.020 INFO:teuthology.orchestra.run.smithi155.stdout: }, 2023-08-01T19:54:52.020 INFO:teuthology.orchestra.run.smithi155.stdout: "events": [ 2023-08-01T19:54:52.021 INFO:teuthology.orchestra.run.smithi155.stdout: { 2023-08-01T19:54:52.021 INFO:teuthology.orchestra.run.smithi155.stdout: "event": "initiated", 2023-08-01T19:54:52.021 INFO:teuthology.orchestra.run.smithi155.stdout: "time": "2023-08-01T19:54:34.001682+0000", 2023-08-01T19:54:52.021 INFO:teuthology.orchestra.run.smithi155.stdout: "duration": 0 2023-08-01T19:54:52.021 INFO:teuthology.orchestra.run.smithi155.stdout: }, 2023-08-01T19:54:52.021 INFO:teuthology.orchestra.run.smithi155.stdout: { 2023-08-01T19:54:52.021 INFO:teuthology.orchestra.run.smithi155.stdout: "event": "throttled", 2023-08-01T19:54:52.022 INFO:teuthology.orchestra.run.smithi155.stdout: "time": "2023-08-01T19:54:34.001682+0000", 2023-08-01T19:54:52.022 INFO:teuthology.orchestra.run.smithi155.stdout: "duration": 0 2023-08-01T19:54:52.022 INFO:teuthology.orchestra.run.smithi155.stdout: }, 2023-08-01T19:54:52.022 INFO:teuthology.orchestra.run.smithi155.stdout: { 2023-08-01T19:54:52.022 INFO:teuthology.orchestra.run.smithi155.stdout: "event": "header_read", 2023-08-01T19:54:52.022 INFO:teuthology.orchestra.run.smithi155.stdout: "time": "2023-08-01T19:54:34.001681+0000", 2023-08-01T19:54:52.023 INFO:teuthology.orchestra.run.smithi155.stdout: "duration": 4294967295.999999 2023-08-01T19:54:52.023 INFO:teuthology.orchestra.run.smithi155.stdout: }, 2023-08-01T19:54:52.023 INFO:teuthology.orchestra.run.smithi155.stdout: { 2023-08-01T19:54:52.023 INFO:teuthology.orchestra.run.smithi155.stdout: "event": "all_read", 2023-08-01T19:54:52.023 INFO:teuthology.orchestra.run.smithi155.stdout: "time": "2023-08-01T19:54:34.001750+0000", 2023-08-01T19:54:52.023 INFO:teuthology.orchestra.run.smithi155.stdout: "duration": 6.9484000000000001e-05 2023-08-01T19:54:52.023 INFO:teuthology.orchestra.run.smithi155.stdout: }, 2023-08-01T19:54:52.023 INFO:teuthology.orchestra.run.smithi155.stdout: { 2023-08-01T19:54:52.024 INFO:teuthology.orchestra.run.smithi155.stdout: "event": "dispatched", 2023-08-01T19:54:52.024 INFO:teuthology.orchestra.run.smithi155.stdout: "time": "2023-08-01T19:54:34.001759+0000", 2023-08-01T19:54:52.024 INFO:teuthology.orchestra.run.smithi155.stdout: "duration": 8.7260000000000008e-06 2023-08-01T19:54:52.024 INFO:teuthology.orchestra.run.smithi155.stdout: }, 2023-08-01T19:54:52.024 INFO:teuthology.orchestra.run.smithi155.stdout: { 2023-08-01T19:54:52.024 INFO:teuthology.orchestra.run.smithi155.stdout: "event": "queued_for_pg", 2023-08-01T19:54:52.024 INFO:teuthology.orchestra.run.smithi155.stdout: "time": "2023-08-01T19:54:34.001765+0000", 2023-08-01T19:54:52.025 INFO:teuthology.orchestra.run.smithi155.stdout: "duration": 5.5879999999999997e-06 2023-08-01T19:54:52.025 INFO:teuthology.orchestra.run.smithi155.stdout: }, 2023-08-01T19:54:52.025 INFO:teuthology.orchestra.run.smithi155.stdout: { 2023-08-01T19:54:52.025 INFO:teuthology.orchestra.run.smithi155.stdout: "event": "reached_pg", 2023-08-01T19:54:52.025 INFO:teuthology.orchestra.run.smithi155.stdout: "time": "2023-08-01T19:54:34.001809+0000", 2023-08-01T19:54:52.025 INFO:teuthology.orchestra.run.smithi155.stdout: "duration": 4.4818999999999999e-05 2023-08-01T19:54:52.025 INFO:teuthology.orchestra.run.smithi155.stdout: }, 2023-08-01T19:54:52.025 INFO:teuthology.orchestra.run.smithi155.stdout: { 2023-08-01T19:54:52.026 INFO:teuthology.orchestra.run.smithi155.stdout: "event": "started", 2023-08-01T19:54:52.026 INFO:teuthology.orchestra.run.smithi155.stdout: "time": "2023-08-01T19:54:34.001925+0000", 2023-08-01T19:54:52.026 INFO:teuthology.orchestra.run.smithi155.stdout: "duration": 0.000116112 2023-08-01T19:54:52.026 INFO:teuthology.orchestra.run.smithi155.stdout: }, 2023-08-01T19:54:52.026 INFO:teuthology.orchestra.run.smithi155.stdout: { 2023-08-01T19:54:52.026 INFO:teuthology.orchestra.run.smithi155.stdout: "event": "waiting for subops from 0", 2023-08-01T19:54:52.026 INFO:teuthology.orchestra.run.smithi155.stdout: "time": "2023-08-01T19:54:34.002046+0000", 2023-08-01T19:54:52.026 INFO:teuthology.orchestra.run.smithi155.stdout: "duration": 0.000120926 2023-08-01T19:54:52.027 INFO:teuthology.orchestra.run.smithi155.stdout: }, 2023-08-01T19:54:52.027 INFO:teuthology.orchestra.run.smithi155.stdout: { 2023-08-01T19:54:52.027 INFO:teuthology.orchestra.run.smithi155.stdout: "event": "sub_op_commit_rec", 2023-08-01T19:54:52.027 INFO:teuthology.orchestra.run.smithi155.stdout: "time": "2023-08-01T19:54:34.007612+0000", 2023-08-01T19:54:52.027 INFO:teuthology.orchestra.run.smithi155.stdout: "duration": 0.0055658679999999999 2023-08-01T19:54:52.027 INFO:teuthology.orchestra.run.smithi155.stdout: }, 2023-08-01T19:54:52.027 INFO:teuthology.orchestra.run.smithi155.stdout: { 2023-08-01T19:54:52.027 INFO:teuthology.orchestra.run.smithi155.stdout: "event": "op_commit", 2023-08-01T19:54:52.028 INFO:teuthology.orchestra.run.smithi155.stdout: "time": "2023-08-01T19:54:34.017331+0000", 2023-08-01T19:54:52.028 INFO:teuthology.orchestra.run.smithi155.stdout: "duration": 0.0097192330000000007 2023-08-01T19:54:52.028 INFO:teuthology.orchestra.run.smithi155.stdout: }, 2023-08-01T19:54:52.028 INFO:teuthology.orchestra.run.smithi155.stdout: { 2023-08-01T19:54:52.028 INFO:teuthology.orchestra.run.smithi155.stdout: "event": "commit_sent", 2023-08-01T19:54:52.028 INFO:teuthology.orchestra.run.smithi155.stdout: "time": "2023-08-01T19:54:34.017381+0000", 2023-08-01T19:54:52.028 INFO:teuthology.orchestra.run.smithi155.stdout: "duration": 4.9768999999999997e-05 2023-08-01T19:54:52.029 INFO:teuthology.orchestra.run.smithi155.stdout: }, 2023-08-01T19:54:52.029 INFO:teuthology.orchestra.run.smithi155.stdout: { 2023-08-01T19:54:52.029 INFO:teuthology.orchestra.run.smithi155.stdout: "event": "done", 2023-08-01T19:54:52.029 INFO:teuthology.orchestra.run.smithi155.stdout: "time": "2023-08-01T19:54:34.017422+0000", 2023-08-01T19:54:52.029 INFO:teuthology.orchestra.run.smithi155.stdout: "duration": 4.0333000000000002e-05 2023-08-01T19:54:52.029 INFO:teuthology.orchestra.run.smithi155.stdout: } 2023-08-01T19:54:52.029 INFO:teuthology.orchestra.run.smithi155.stdout: ] 2023-08-01T19:54:52.030 INFO:teuthology.orchestra.run.smithi155.stdout: } 2023-08-01T19:54:52.030 INFO:teuthology.orchestra.run.smithi155.stdout: }, 2023-08-01T19:54:52.030 INFO:teuthology.orchestra.run.smithi155.stdout: { 2023-08-01T19:54:52.030 INFO:teuthology.orchestra.run.smithi155.stdout: "description": "osd_op(client.4668.0:52241 5.0 5:046bb241:::benchmark_data_smithi006_114134_object52240:head [set-alloc-hint object_size 65536 write_size 65536,write 0~65536] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e27)", 2023-08-01T19:54:52.030 INFO:teuthology.orchestra.run.smithi155.stdout: "initiated_at": "2023-08-01T19:54:41.282783+0000", 2023-08-01T19:54:52.030 INFO:teuthology.orchestra.run.smithi155.stdout: "age": 10.709878841, 2023-08-01T19:54:52.030 INFO:teuthology.orchestra.run.smithi155.stdout: "duration": 0.015571013, 2023-08-01T19:54:52.030 INFO:teuthology.orchestra.run.smithi155.stdout: "type_data": { 2023-08-01T19:54:52.031 INFO:teuthology.orchestra.run.smithi155.stdout: "flag_point": "commit sent; apply or cleanup", 2023-08-01T19:54:52.031 INFO:teuthology.orchestra.run.smithi155.stdout: "client_info": { 2023-08-01T19:54:52.031 INFO:teuthology.orchestra.run.smithi155.stdout: "client": "client.4668", 2023-08-01T19:54:52.031 INFO:teuthology.orchestra.run.smithi155.stdout: "client_addr": "172.21.15.6:0/1709472247", 2023-08-01T19:54:52.031 INFO:teuthology.orchestra.run.smithi155.stdout: "tid": 52241 2023-08-01T19:54:52.031 INFO:teuthology.orchestra.run.smithi155.stdout: }, 2023-08-01T19:54:52.031 INFO:teuthology.orchestra.run.smithi155.stdout: "events": [ 2023-08-01T19:54:52.031 INFO:teuthology.orchestra.run.smithi155.stdout: { 2023-08-01T19:54:52.032 INFO:teuthology.orchestra.run.smithi155.stdout: "event": "initiated", 2023-08-01T19:54:52.032 INFO:teuthology.orchestra.run.smithi155.stdout: "time": "2023-08-01T19:54:41.282783+0000", 2023-08-01T19:54:52.032 INFO:teuthology.orchestra.run.smithi155.stdout: "duration": 0 2023-08-01T19:54:52.032 INFO:teuthology.orchestra.run.smithi155.stdout: }, 2023-08-01T19:54:52.032 INFO:teuthology.orchestra.run.smithi155.stdout: { 2023-08-01T19:54:52.032 INFO:teuthology.orchestra.run.smithi155.stdout: "event": "throttled", 2023-08-01T19:54:52.032 INFO:teuthology.orchestra.run.smithi155.stdout: "time": "2023-08-01T19:54:41.282783+0000", 2023-08-01T19:54:52.032 INFO:teuthology.orchestra.run.smithi155.stdout: "duration": 0 2023-08-01T19:54:52.033 INFO:teuthology.orchestra.run.smithi155.stdout: }, 2023-08-01T19:54:52.033 INFO:teuthology.orchestra.run.smithi155.stdout: { 2023-08-01T19:54:52.033 INFO:teuthology.orchestra.run.smithi155.stdout: "event": "header_read", 2023-08-01T19:54:52.033 INFO:teuthology.orchestra.run.smithi155.stdout: "time": "2023-08-01T19:54:41.282782+0000", 2023-08-01T19:54:52.033 INFO:teuthology.orchestra.run.smithi155.stdout: "duration": 4294967295.9999995 2023-08-01T19:54:52.033 INFO:teuthology.orchestra.run.smithi155.stdout: }, 2023-08-01T19:54:52.033 INFO:teuthology.orchestra.run.smithi155.stdout: { 2023-08-01T19:54:52.033 INFO:teuthology.orchestra.run.smithi155.stdout: "event": "all_read", 2023-08-01T19:54:52.034 INFO:teuthology.orchestra.run.smithi155.stdout: "time": "2023-08-01T19:54:41.282859+0000", 2023-08-01T19:54:52.034 INFO:teuthology.orchestra.run.smithi155.stdout: "duration": 7.7089999999999995e-05 2023-08-01T19:54:52.034 INFO:teuthology.orchestra.run.smithi155.stdout: }, 2023-08-01T19:54:52.034 INFO:teuthology.orchestra.run.smithi155.stdout: { 2023-08-01T19:54:52.034 INFO:teuthology.orchestra.run.smithi155.stdout: "event": "dispatched", 2023-08-01T19:54:52.034 INFO:teuthology.orchestra.run.smithi155.stdout: "time": "2023-08-01T19:54:41.282865+0000", 2023-08-01T19:54:52.034 INFO:teuthology.orchestra.run.smithi155.stdout: "duration": 5.3129999999999998e-06 2023-08-01T19:54:52.034 INFO:teuthology.orchestra.run.smithi155.stdout: }, 2023-08-01T19:54:52.035 INFO:teuthology.orchestra.run.smithi155.stdout: { 2023-08-01T19:54:52.035 INFO:teuthology.orchestra.run.smithi155.stdout: "event": "queued_for_pg", 2023-08-01T19:54:52.035 INFO:teuthology.orchestra.run.smithi155.stdout: "time": "2023-08-01T19:54:41.282868+0000", 2023-08-01T19:54:52.035 INFO:teuthology.orchestra.run.smithi155.stdout: "duration": 3.0139999999999999e-06 2023-08-01T19:54:52.035 INFO:teuthology.orchestra.run.smithi155.stdout: }, 2023-08-01T19:54:52.035 INFO:teuthology.orchestra.run.smithi155.stdout: { 2023-08-01T19:54:52.036 INFO:teuthology.orchestra.run.smithi155.stdout: "event": "reached_pg", 2023-08-01T19:54:52.036 INFO:teuthology.orchestra.run.smithi155.stdout: "time": "2023-08-01T19:54:41.284581+0000", 2023-08-01T19:54:52.036 INFO:teuthology.orchestra.run.smithi155.stdout: "duration": 0.0017131959999999999 2023-08-01T19:54:52.036 INFO:teuthology.orchestra.run.smithi155.stdout: }, 2023-08-01T19:54:52.036 INFO:teuthology.orchestra.run.smithi155.stdout: { 2023-08-01T19:54:52.036 INFO:teuthology.orchestra.run.smithi155.stdout: "event": "started", 2023-08-01T19:54:52.036 INFO:teuthology.orchestra.run.smithi155.stdout: "time": "2023-08-01T19:54:41.284684+0000", 2023-08-01T19:54:52.036 INFO:teuthology.orchestra.run.smithi155.stdout: "duration": 0.000102642 2023-08-01T19:54:52.037 INFO:teuthology.orchestra.run.smithi155.stdout: }, 2023-08-01T19:54:52.037 INFO:teuthology.orchestra.run.smithi155.stdout: { 2023-08-01T19:54:52.037 INFO:teuthology.orchestra.run.smithi155.stdout: "event": "waiting for subops from 0", 2023-08-01T19:54:52.037 INFO:teuthology.orchestra.run.smithi155.stdout: "time": "2023-08-01T19:54:41.284771+0000", 2023-08-01T19:54:52.037 INFO:teuthology.orchestra.run.smithi155.stdout: "duration": 8.7153999999999999e-05 2023-08-01T19:54:52.037 INFO:teuthology.orchestra.run.smithi155.stdout: }, 2023-08-01T19:54:52.037 INFO:teuthology.orchestra.run.smithi155.stdout: { 2023-08-01T19:54:52.037 INFO:teuthology.orchestra.run.smithi155.stdout: "event": "op_commit", 2023-08-01T19:54:52.038 INFO:teuthology.orchestra.run.smithi155.stdout: "time": "2023-08-01T19:54:41.289784+0000", 2023-08-01T19:54:52.038 INFO:teuthology.orchestra.run.smithi155.stdout: "duration": 0.0050127879999999998 2023-08-01T19:54:52.038 INFO:teuthology.orchestra.run.smithi155.stdout: }, 2023-08-01T19:54:52.038 INFO:teuthology.orchestra.run.smithi155.stdout: { 2023-08-01T19:54:52.038 INFO:teuthology.orchestra.run.smithi155.stdout: "event": "sub_op_commit_rec", 2023-08-01T19:54:52.038 INFO:teuthology.orchestra.run.smithi155.stdout: "time": "2023-08-01T19:54:41.298271+0000", 2023-08-01T19:54:52.038 INFO:teuthology.orchestra.run.smithi155.stdout: "duration": 0.0084877730000000005 2023-08-01T19:54:52.038 INFO:teuthology.orchestra.run.smithi155.stdout: }, 2023-08-01T19:54:52.039 INFO:teuthology.orchestra.run.smithi155.stdout: { 2023-08-01T19:54:52.039 INFO:teuthology.orchestra.run.smithi155.stdout: "event": "commit_sent", 2023-08-01T19:54:52.039 INFO:teuthology.orchestra.run.smithi155.stdout: "time": "2023-08-01T19:54:41.298322+0000", 2023-08-01T19:54:52.039 INFO:teuthology.orchestra.run.smithi155.stdout: "duration": 5.0500000000000001e-05 2023-08-01T19:54:52.039 INFO:teuthology.orchestra.run.smithi155.stdout: }, 2023-08-01T19:54:52.039 INFO:teuthology.orchestra.run.smithi155.stdout: { 2023-08-01T19:54:52.039 INFO:teuthology.orchestra.run.smithi155.stdout: "event": "done", 2023-08-01T19:54:52.040 INFO:teuthology.orchestra.run.smithi155.stdout: "time": "2023-08-01T19:54:41.298354+0000", 2023-08-01T19:54:52.040 INFO:teuthology.orchestra.run.smithi155.stdout: "duration": 3.1943000000000002e-05 2023-08-01T19:54:52.040 INFO:teuthology.orchestra.run.smithi155.stdout: } 2023-08-01T19:54:52.040 INFO:teuthology.orchestra.run.smithi155.stdout: ] 2023-08-01T19:54:52.040 INFO:teuthology.orchestra.run.smithi155.stdout: } 2023-08-01T19:54:52.040 INFO:teuthology.orchestra.run.smithi155.stdout: }, 2023-08-01T19:54:52.040 INFO:teuthology.orchestra.run.smithi155.stdout: { 2023-08-01T19:54:52.040 INFO:teuthology.orchestra.run.smithi155.stdout: "description": "osd_op(client.4668.0:61802 5.b 5:dcfcf99c:::benchmark_data_smithi006_114134_object61801:head [set-alloc-hint object_size 65536 write_size 65536,write 0~65536] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e29)", 2023-08-01T19:54:52.041 INFO:teuthology.orchestra.run.smithi155.stdout: "initiated_at": "2023-08-01T19:54:45.742720+0000", 2023-08-01T19:54:52.041 INFO:teuthology.orchestra.run.smithi155.stdout: "age": 6.2499414770000001, 2023-08-01T19:54:52.041 INFO:teuthology.orchestra.run.smithi155.stdout: "duration": 0.017797548999999999, 2023-08-01T19:54:52.041 INFO:teuthology.orchestra.run.smithi155.stdout: "type_data": { 2023-08-01T19:54:52.041 INFO:teuthology.orchestra.run.smithi155.stdout: "flag_point": "commit sent; apply or cleanup", 2023-08-01T19:54:52.041 INFO:teuthology.orchestra.run.smithi155.stdout: "client_info": { 2023-08-01T19:54:52.041 INFO:teuthology.orchestra.run.smithi155.stdout: "client": "client.4668", 2023-08-01T19:54:52.042 INFO:teuthology.orchestra.run.smithi155.stdout: "client_addr": "172.21.15.6:0/1709472247", 2023-08-01T19:54:52.042 INFO:teuthology.orchestra.run.smithi155.stdout: "tid": 61802 2023-08-01T19:54:52.042 INFO:teuthology.orchestra.run.smithi155.stdout: }, 2023-08-01T19:54:52.042 INFO:teuthology.orchestra.run.smithi155.stdout: "events": [ 2023-08-01T19:54:52.042 INFO:teuthology.orchestra.run.smithi155.stdout: { 2023-08-01T19:54:52.042 INFO:teuthology.orchestra.run.smithi155.stdout: "event": "initiated", 2023-08-01T19:54:52.042 INFO:teuthology.orchestra.run.smithi155.stdout: "time": "2023-08-01T19:54:45.742720+0000", 2023-08-01T19:54:52.042 INFO:teuthology.orchestra.run.smithi155.stdout: "duration": 0 2023-08-01T19:54:52.043 INFO:teuthology.orchestra.run.smithi155.stdout: }, 2023-08-01T19:54:52.043 INFO:teuthology.orchestra.run.smithi155.stdout: { 2023-08-01T19:54:52.043 INFO:teuthology.orchestra.run.smithi155.stdout: "event": "throttled", 2023-08-01T19:54:52.043 INFO:teuthology.orchestra.run.smithi155.stdout: "time": "2023-08-01T19:54:45.742720+0000", 2023-08-01T19:54:52.043 INFO:teuthology.orchestra.run.smithi155.stdout: "duration": 0 2023-08-01T19:54:52.043 INFO:teuthology.orchestra.run.smithi155.stdout: }, 2023-08-01T19:54:52.043 INFO:teuthology.orchestra.run.smithi155.stdout: { 2023-08-01T19:54:52.044 INFO:teuthology.orchestra.run.smithi155.stdout: "event": "header_read", 2023-08-01T19:54:52.044 INFO:teuthology.orchestra.run.smithi155.stdout: "time": "2023-08-01T19:54:45.742720+0000", 2023-08-01T19:54:52.044 INFO:teuthology.orchestra.run.smithi155.stdout: "duration": 4294967295.9999995 2023-08-01T19:54:52.044 INFO:teuthology.orchestra.run.smithi155.stdout: }, 2023-08-01T19:54:52.044 INFO:teuthology.orchestra.run.smithi155.stdout: { 2023-08-01T19:54:52.044 INFO:teuthology.orchestra.run.smithi155.stdout: "event": "all_read", 2023-08-01T19:54:52.044 INFO:teuthology.orchestra.run.smithi155.stdout: "time": "2023-08-01T19:54:45.742747+0000", 2023-08-01T19:54:52.044 INFO:teuthology.orchestra.run.smithi155.stdout: "duration": 2.7713e-05 2023-08-01T19:54:52.045 INFO:teuthology.orchestra.run.smithi155.stdout: }, 2023-08-01T19:54:52.045 INFO:teuthology.orchestra.run.smithi155.stdout: { 2023-08-01T19:54:52.045 INFO:teuthology.orchestra.run.smithi155.stdout: "event": "dispatched", 2023-08-01T19:54:52.045 INFO:teuthology.orchestra.run.smithi155.stdout: "time": "2023-08-01T19:54:45.742752+0000", 2023-08-01T19:54:52.045 INFO:teuthology.orchestra.run.smithi155.stdout: "duration": 4.8080000000000004e-06 2023-08-01T19:54:52.045 INFO:teuthology.orchestra.run.smithi155.stdout: }, 2023-08-01T19:54:52.045 INFO:teuthology.orchestra.run.smithi155.stdout: { 2023-08-01T19:54:52.045 INFO:teuthology.orchestra.run.smithi155.stdout: "event": "queued_for_pg", 2023-08-01T19:54:52.046 INFO:teuthology.orchestra.run.smithi155.stdout: "time": "2023-08-01T19:54:45.742757+0000", 2023-08-01T19:54:52.046 INFO:teuthology.orchestra.run.smithi155.stdout: "duration": 4.5220000000000001e-06 2023-08-01T19:54:52.046 INFO:teuthology.orchestra.run.smithi155.stdout: }, 2023-08-01T19:54:52.046 INFO:teuthology.orchestra.run.smithi155.stdout: { 2023-08-01T19:54:52.046 INFO:teuthology.orchestra.run.smithi155.stdout: "event": "reached_pg", 2023-08-01T19:54:52.046 INFO:teuthology.orchestra.run.smithi155.stdout: "time": "2023-08-01T19:54:45.744448+0000", 2023-08-01T19:54:52.046 INFO:teuthology.orchestra.run.smithi155.stdout: "duration": 0.0016914600000000001 2023-08-01T19:54:52.047 INFO:teuthology.orchestra.run.smithi155.stdout: }, 2023-08-01T19:54:52.047 INFO:teuthology.orchestra.run.smithi155.stdout: { 2023-08-01T19:54:52.047 INFO:teuthology.orchestra.run.smithi155.stdout: "event": "started", 2023-08-01T19:54:52.047 INFO:teuthology.orchestra.run.smithi155.stdout: "time": "2023-08-01T19:54:45.744538+0000", 2023-08-01T19:54:52.047 INFO:teuthology.orchestra.run.smithi155.stdout: "duration": 8.9615000000000002e-05 2023-08-01T19:54:52.047 INFO:teuthology.orchestra.run.smithi155.stdout: }, 2023-08-01T19:54:52.047 INFO:teuthology.orchestra.run.smithi155.stdout: { 2023-08-01T19:54:52.047 INFO:teuthology.orchestra.run.smithi155.stdout: "event": "waiting for subops from 0", 2023-08-01T19:54:52.048 INFO:teuthology.orchestra.run.smithi155.stdout: "time": "2023-08-01T19:54:45.744620+0000", 2023-08-01T19:54:52.048 INFO:teuthology.orchestra.run.smithi155.stdout: "duration": 8.1681000000000006e-05 2023-08-01T19:54:52.048 INFO:teuthology.orchestra.run.smithi155.stdout: }, 2023-08-01T19:54:52.048 INFO:teuthology.orchestra.run.smithi155.stdout: { 2023-08-01T19:54:52.048 INFO:teuthology.orchestra.run.smithi155.stdout: "event": "op_commit", 2023-08-01T19:54:52.048 INFO:teuthology.orchestra.run.smithi155.stdout: "time": "2023-08-01T19:54:45.746954+0000", 2023-08-01T19:54:52.048 INFO:teuthology.orchestra.run.smithi155.stdout: "duration": 0.0023339490000000001 2023-08-01T19:54:52.049 INFO:teuthology.orchestra.run.smithi155.stdout: }, 2023-08-01T19:54:52.049 INFO:teuthology.orchestra.run.smithi155.stdout: { 2023-08-01T19:54:52.049 INFO:teuthology.orchestra.run.smithi155.stdout: "event": "sub_op_commit_rec", 2023-08-01T19:54:52.049 INFO:teuthology.orchestra.run.smithi155.stdout: "time": "2023-08-01T19:54:45.760465+0000", 2023-08-01T19:54:52.049 INFO:teuthology.orchestra.run.smithi155.stdout: "duration": 0.013511861 2023-08-01T19:54:52.049 INFO:teuthology.orchestra.run.smithi155.stdout: }, 2023-08-01T19:54:52.049 INFO:teuthology.orchestra.run.smithi155.stdout: { 2023-08-01T19:54:52.049 INFO:teuthology.orchestra.run.smithi155.stdout: "event": "commit_sent", 2023-08-01T19:54:52.050 INFO:teuthology.orchestra.run.smithi155.stdout: "time": "2023-08-01T19:54:45.760494+0000", 2023-08-01T19:54:52.050 INFO:teuthology.orchestra.run.smithi155.stdout: "duration": 2.9025000000000001e-05 2023-08-01T19:54:52.050 INFO:teuthology.orchestra.run.smithi155.stdout: }, 2023-08-01T19:54:52.050 INFO:teuthology.orchestra.run.smithi155.stdout: { 2023-08-01T19:54:52.050 INFO:teuthology.orchestra.run.smithi155.stdout: "event": "done", 2023-08-01T19:54:52.050 INFO:teuthology.orchestra.run.smithi155.stdout: "time": "2023-08-01T19:54:45.760518+0000", 2023-08-01T19:54:52.050 INFO:teuthology.orchestra.run.smithi155.stdout: "duration": 2.3269e-05 2023-08-01T19:54:52.050 INFO:teuthology.orchestra.run.smithi155.stdout: } 2023-08-01T19:54:52.051 INFO:teuthology.orchestra.run.smithi155.stdout: ] 2023-08-01T19:54:52.051 INFO:teuthology.orchestra.run.smithi155.stdout: } 2023-08-01T19:54:52.051 INFO:teuthology.orchestra.run.smithi155.stdout: }, 2023-08-01T19:54:52.051 INFO:teuthology.orchestra.run.smithi155.stdout: { 2023-08-01T19:54:52.051 INFO:teuthology.orchestra.run.smithi155.stdout: "description": "osd_op(client.4668.0:66162 5.b 5:d2306600:::benchmark_data_smithi006_114134_object66161:head [set-alloc-hint object_size 65536 write_size 65536,write 0~65536] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e29)", 2023-08-01T19:54:52.051 INFO:teuthology.orchestra.run.smithi155.stdout: "initiated_at": "2023-08-01T19:54:47.818865+0000", 2023-08-01T19:54:52.051 INFO:teuthology.orchestra.run.smithi155.stdout: "age": 4.1737970290000002, 2023-08-01T19:54:52.051 INFO:teuthology.orchestra.run.smithi155.stdout: "duration": 0.016254494000000001, 2023-08-01T19:54:52.052 INFO:teuthology.orchestra.run.smithi155.stdout: "type_data": { 2023-08-01T19:54:52.052 INFO:teuthology.orchestra.run.smithi155.stdout: "flag_point": "commit sent; apply or cleanup", 2023-08-01T19:54:52.052 INFO:teuthology.orchestra.run.smithi155.stdout: "client_info": { 2023-08-01T19:54:52.052 INFO:teuthology.orchestra.run.smithi155.stdout: "client": "client.4668", 2023-08-01T19:54:52.052 INFO:teuthology.orchestra.run.smithi155.stdout: "client_addr": "172.21.15.6:0/1709472247", 2023-08-01T19:54:52.052 INFO:teuthology.orchestra.run.smithi155.stdout: "tid": 66162 2023-08-01T19:54:52.052 INFO:teuthology.orchestra.run.smithi155.stdout: }, 2023-08-01T19:54:52.053 INFO:teuthology.orchestra.run.smithi155.stdout: "events": [ 2023-08-01T19:54:52.053 INFO:teuthology.orchestra.run.smithi155.stdout: { 2023-08-01T19:54:52.053 INFO:teuthology.orchestra.run.smithi155.stdout: "event": "initiated", 2023-08-01T19:54:52.053 INFO:teuthology.orchestra.run.smithi155.stdout: "time": "2023-08-01T19:54:47.818865+0000", 2023-08-01T19:54:52.053 INFO:teuthology.orchestra.run.smithi155.stdout: "duration": 0 2023-08-01T19:54:52.053 INFO:teuthology.orchestra.run.smithi155.stdout: }, 2023-08-01T19:54:52.053 INFO:teuthology.orchestra.run.smithi155.stdout: { 2023-08-01T19:54:52.053 INFO:teuthology.orchestra.run.smithi155.stdout: "event": "throttled", 2023-08-01T19:54:52.054 INFO:teuthology.orchestra.run.smithi155.stdout: "time": "2023-08-01T19:54:47.818865+0000", 2023-08-01T19:54:52.054 INFO:teuthology.orchestra.run.smithi155.stdout: "duration": 0 2023-08-01T19:54:52.054 INFO:teuthology.orchestra.run.smithi155.stdout: }, 2023-08-01T19:54:52.054 INFO:teuthology.orchestra.run.smithi155.stdout: { 2023-08-01T19:54:52.054 INFO:teuthology.orchestra.run.smithi155.stdout: "event": "header_read", 2023-08-01T19:54:52.054 INFO:teuthology.orchestra.run.smithi155.stdout: "time": "2023-08-01T19:54:47.818864+0000", 2023-08-01T19:54:52.054 INFO:teuthology.orchestra.run.smithi155.stdout: "duration": 4294967295.9999995 2023-08-01T19:54:52.054 INFO:teuthology.orchestra.run.smithi155.stdout: }, 2023-08-01T19:54:52.055 INFO:teuthology.orchestra.run.smithi155.stdout: { 2023-08-01T19:54:52.055 INFO:teuthology.orchestra.run.smithi155.stdout: "event": "all_read", 2023-08-01T19:54:52.055 INFO:teuthology.orchestra.run.smithi155.stdout: "time": "2023-08-01T19:54:47.818944+0000", 2023-08-01T19:54:52.055 INFO:teuthology.orchestra.run.smithi155.stdout: "duration": 8.0112999999999997e-05 2023-08-01T19:54:52.055 INFO:teuthology.orchestra.run.smithi155.stdout: }, 2023-08-01T19:54:52.055 INFO:teuthology.orchestra.run.smithi155.stdout: { 2023-08-01T19:54:52.055 INFO:teuthology.orchestra.run.smithi155.stdout: "event": "dispatched", 2023-08-01T19:54:52.055 INFO:teuthology.orchestra.run.smithi155.stdout: "time": "2023-08-01T19:54:47.818951+0000", 2023-08-01T19:54:52.056 INFO:teuthology.orchestra.run.smithi155.stdout: "duration": 6.7360000000000004e-06 2023-08-01T19:54:52.056 INFO:teuthology.orchestra.run.smithi155.stdout: }, 2023-08-01T19:54:52.056 INFO:teuthology.orchestra.run.smithi155.stdout: { 2023-08-01T19:54:52.056 INFO:teuthology.orchestra.run.smithi155.stdout: "event": "queued_for_pg", 2023-08-01T19:54:52.056 INFO:teuthology.orchestra.run.smithi155.stdout: "time": "2023-08-01T19:54:47.818954+0000", 2023-08-01T19:54:52.056 INFO:teuthology.orchestra.run.smithi155.stdout: "duration": 2.9550000000000001e-06 2023-08-01T19:54:52.056 INFO:teuthology.orchestra.run.smithi155.stdout: }, 2023-08-01T19:54:52.057 INFO:teuthology.orchestra.run.smithi155.stdout: { 2023-08-01T19:54:52.057 INFO:teuthology.orchestra.run.smithi155.stdout: "event": "reached_pg", 2023-08-01T19:54:52.057 INFO:teuthology.orchestra.run.smithi155.stdout: "time": "2023-08-01T19:54:47.820967+0000", 2023-08-01T19:54:52.057 INFO:teuthology.orchestra.run.smithi155.stdout: "duration": 0.0020131659999999998 2023-08-01T19:54:52.057 INFO:teuthology.orchestra.run.smithi155.stdout: }, 2023-08-01T19:54:52.057 INFO:teuthology.orchestra.run.smithi155.stdout: { 2023-08-01T19:54:52.057 INFO:teuthology.orchestra.run.smithi155.stdout: "event": "started", 2023-08-01T19:54:52.057 INFO:teuthology.orchestra.run.smithi155.stdout: "time": "2023-08-01T19:54:47.821043+0000", 2023-08-01T19:54:52.058 INFO:teuthology.orchestra.run.smithi155.stdout: "duration": 7.5706999999999999e-05 2023-08-01T19:54:52.058 INFO:teuthology.orchestra.run.smithi155.stdout: }, 2023-08-01T19:54:52.058 INFO:teuthology.orchestra.run.smithi155.stdout: { 2023-08-01T19:54:52.058 INFO:teuthology.orchestra.run.smithi155.stdout: "event": "waiting for subops from 0", 2023-08-01T19:54:52.058 INFO:teuthology.orchestra.run.smithi155.stdout: "time": "2023-08-01T19:54:47.821128+0000", 2023-08-01T19:54:52.058 INFO:teuthology.orchestra.run.smithi155.stdout: "duration": 8.5628000000000001e-05 2023-08-01T19:54:52.059 INFO:teuthology.orchestra.run.smithi155.stdout: }, 2023-08-01T19:54:52.059 INFO:teuthology.orchestra.run.smithi155.stdout: { 2023-08-01T19:54:52.059 INFO:teuthology.orchestra.run.smithi155.stdout: "event": "op_commit", 2023-08-01T19:54:52.059 INFO:teuthology.orchestra.run.smithi155.stdout: "time": "2023-08-01T19:54:47.824340+0000", 2023-08-01T19:54:52.059 INFO:teuthology.orchestra.run.smithi155.stdout: "duration": 0.0032116750000000002 2023-08-01T19:54:52.059 INFO:teuthology.orchestra.run.smithi155.stdout: }, 2023-08-01T19:54:52.059 INFO:teuthology.orchestra.run.smithi155.stdout: { 2023-08-01T19:54:52.060 INFO:teuthology.orchestra.run.smithi155.stdout: "event": "sub_op_commit_rec", 2023-08-01T19:54:52.060 INFO:teuthology.orchestra.run.smithi155.stdout: "time": "2023-08-01T19:54:47.835051+0000", 2023-08-01T19:54:52.060 INFO:teuthology.orchestra.run.smithi155.stdout: "duration": 0.010711299000000001 2023-08-01T19:54:52.060 INFO:teuthology.orchestra.run.smithi155.stdout: }, 2023-08-01T19:54:52.060 INFO:teuthology.orchestra.run.smithi155.stdout: { 2023-08-01T19:54:52.060 INFO:teuthology.orchestra.run.smithi155.stdout: "event": "commit_sent", 2023-08-01T19:54:52.060 INFO:teuthology.orchestra.run.smithi155.stdout: "time": "2023-08-01T19:54:47.835094+0000", 2023-08-01T19:54:52.061 INFO:teuthology.orchestra.run.smithi155.stdout: "duration": 4.2410000000000002e-05 2023-08-01T19:54:52.061 INFO:teuthology.orchestra.run.smithi155.stdout: }, 2023-08-01T19:54:52.061 INFO:teuthology.orchestra.run.smithi155.stdout: { 2023-08-01T19:54:52.061 INFO:teuthology.orchestra.run.smithi155.stdout: "event": "done", 2023-08-01T19:54:52.061 INFO:teuthology.orchestra.run.smithi155.stdout: "time": "2023-08-01T19:54:47.835119+0000", 2023-08-01T19:54:52.061 INFO:teuthology.orchestra.run.smithi155.stdout: "duration": 2.5401e-05 2023-08-01T19:54:52.061 INFO:teuthology.orchestra.run.smithi155.stdout: } 2023-08-01T19:54:52.061 INFO:teuthology.orchestra.run.smithi155.stdout: ] 2023-08-01T19:54:52.062 INFO:teuthology.orchestra.run.smithi155.stdout: } 2023-08-01T19:54:52.062 INFO:teuthology.orchestra.run.smithi155.stdout: }, 2023-08-01T19:54:52.062 INFO:teuthology.orchestra.run.smithi155.stdout: { 2023-08-01T19:54:52.062 INFO:teuthology.orchestra.run.smithi155.stdout: "description": "osd_op(client.4668.0:70886 5.4 5:27fcffab:::benchmark_data_smithi006_114134_object70885:head [set-alloc-hint object_size 65536 write_size 65536,write 0~65536] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e30)", 2023-08-01T19:54:52.062 INFO:teuthology.orchestra.run.smithi155.stdout: "initiated_at": "2023-08-01T19:54:50.214727+0000", 2023-08-01T19:54:52.062 INFO:teuthology.orchestra.run.smithi155.stdout: "age": 1.7779347720000001, 2023-08-01T19:54:52.062 INFO:teuthology.orchestra.run.smithi155.stdout: "duration": 0.016804395999999999, 2023-08-01T19:54:52.063 INFO:teuthology.orchestra.run.smithi155.stdout: "type_data": { 2023-08-01T19:54:52.063 INFO:teuthology.orchestra.run.smithi155.stdout: "flag_point": "commit sent; apply or cleanup", 2023-08-01T19:54:52.063 INFO:teuthology.orchestra.run.smithi155.stdout: "client_info": { 2023-08-01T19:54:52.063 INFO:teuthology.orchestra.run.smithi155.stdout: "client": "client.4668", 2023-08-01T19:54:52.063 INFO:teuthology.orchestra.run.smithi155.stdout: "client_addr": "172.21.15.6:0/1709472247", 2023-08-01T19:54:52.063 INFO:teuthology.orchestra.run.smithi155.stdout: "tid": 70886 2023-08-01T19:54:52.063 INFO:teuthology.orchestra.run.smithi155.stdout: }, 2023-08-01T19:54:52.064 INFO:teuthology.orchestra.run.smithi155.stdout: "events": [ 2023-08-01T19:54:52.064 INFO:teuthology.orchestra.run.smithi155.stdout: { 2023-08-01T19:54:52.064 INFO:teuthology.orchestra.run.smithi155.stdout: "event": "initiated", 2023-08-01T19:54:52.064 INFO:teuthology.orchestra.run.smithi155.stdout: "time": "2023-08-01T19:54:50.214727+0000", 2023-08-01T19:54:52.064 INFO:teuthology.orchestra.run.smithi155.stdout: "duration": 0 2023-08-01T19:54:52.064 INFO:teuthology.orchestra.run.smithi155.stdout: }, 2023-08-01T19:54:52.064 INFO:teuthology.orchestra.run.smithi155.stdout: { 2023-08-01T19:54:52.064 INFO:teuthology.orchestra.run.smithi155.stdout: "event": "throttled", 2023-08-01T19:54:52.065 INFO:teuthology.orchestra.run.smithi155.stdout: "time": "2023-08-01T19:54:50.214727+0000", 2023-08-01T19:54:52.065 INFO:teuthology.orchestra.run.smithi155.stdout: "duration": 0 2023-08-01T19:54:52.065 INFO:teuthology.orchestra.run.smithi155.stdout: }, 2023-08-01T19:54:52.065 INFO:teuthology.orchestra.run.smithi155.stdout: { 2023-08-01T19:54:52.065 INFO:teuthology.orchestra.run.smithi155.stdout: "event": "header_read", 2023-08-01T19:54:52.065 INFO:teuthology.orchestra.run.smithi155.stdout: "time": "2023-08-01T19:54:50.214726+0000", 2023-08-01T19:54:52.065 INFO:teuthology.orchestra.run.smithi155.stdout: "duration": 4294967295.9999995 2023-08-01T19:54:52.066 INFO:teuthology.orchestra.run.smithi155.stdout: }, 2023-08-01T19:54:52.066 INFO:teuthology.orchestra.run.smithi155.stdout: { 2023-08-01T19:54:52.066 INFO:teuthology.orchestra.run.smithi155.stdout: "event": "all_read", 2023-08-01T19:54:52.066 INFO:teuthology.orchestra.run.smithi155.stdout: "time": "2023-08-01T19:54:50.214790+0000", 2023-08-01T19:54:52.066 INFO:teuthology.orchestra.run.smithi155.stdout: "duration": 6.3538000000000001e-05 2023-08-01T19:54:52.066 INFO:teuthology.orchestra.run.smithi155.stdout: }, 2023-08-01T19:54:52.066 INFO:teuthology.orchestra.run.smithi155.stdout: { 2023-08-01T19:54:52.066 INFO:teuthology.orchestra.run.smithi155.stdout: "event": "dispatched", 2023-08-01T19:54:52.067 INFO:teuthology.orchestra.run.smithi155.stdout: "time": "2023-08-01T19:54:50.214797+0000", 2023-08-01T19:54:52.067 INFO:teuthology.orchestra.run.smithi155.stdout: "duration": 7.0759999999999997e-06 2023-08-01T19:54:52.067 INFO:teuthology.orchestra.run.smithi155.stdout: }, 2023-08-01T19:54:52.067 INFO:teuthology.orchestra.run.smithi155.stdout: { 2023-08-01T19:54:52.067 INFO:teuthology.orchestra.run.smithi155.stdout: "event": "queued_for_pg", 2023-08-01T19:54:52.067 INFO:teuthology.orchestra.run.smithi155.stdout: "time": "2023-08-01T19:54:50.214800+0000", 2023-08-01T19:54:52.067 INFO:teuthology.orchestra.run.smithi155.stdout: "duration": 3.3230000000000002e-06 2023-08-01T19:54:52.067 INFO:teuthology.orchestra.run.smithi155.stdout: }, 2023-08-01T19:54:52.068 INFO:teuthology.orchestra.run.smithi155.stdout: { 2023-08-01T19:54:52.068 INFO:teuthology.orchestra.run.smithi155.stdout: "event": "reached_pg", 2023-08-01T19:54:52.068 INFO:teuthology.orchestra.run.smithi155.stdout: "time": "2023-08-01T19:54:50.214836+0000", 2023-08-01T19:54:52.068 INFO:teuthology.orchestra.run.smithi155.stdout: "duration": 3.6236999999999999e-05 2023-08-01T19:54:52.068 INFO:teuthology.orchestra.run.smithi155.stdout: }, 2023-08-01T19:54:52.068 INFO:teuthology.orchestra.run.smithi155.stdout: { 2023-08-01T19:54:52.068 INFO:teuthology.orchestra.run.smithi155.stdout: "event": "started", 2023-08-01T19:54:52.069 INFO:teuthology.orchestra.run.smithi155.stdout: "time": "2023-08-01T19:54:50.214960+0000", 2023-08-01T19:54:52.069 INFO:teuthology.orchestra.run.smithi155.stdout: "duration": 0.00012351199999999999 2023-08-01T19:54:52.069 INFO:teuthology.orchestra.run.smithi155.stdout: }, 2023-08-01T19:54:52.069 INFO:teuthology.orchestra.run.smithi155.stdout: { 2023-08-01T19:54:52.069 INFO:teuthology.orchestra.run.smithi155.stdout: "event": "waiting for subops from 0", 2023-08-01T19:54:52.069 INFO:teuthology.orchestra.run.smithi155.stdout: "time": "2023-08-01T19:54:50.215307+0000", 2023-08-01T19:54:52.069 INFO:teuthology.orchestra.run.smithi155.stdout: "duration": 0.00034703400000000003 2023-08-01T19:54:52.069 INFO:teuthology.orchestra.run.smithi155.stdout: }, 2023-08-01T19:54:52.070 INFO:teuthology.orchestra.run.smithi155.stdout: { 2023-08-01T19:54:52.070 INFO:teuthology.orchestra.run.smithi155.stdout: "event": "op_commit", 2023-08-01T19:54:52.070 INFO:teuthology.orchestra.run.smithi155.stdout: "time": "2023-08-01T19:54:50.218915+0000", 2023-08-01T19:54:52.070 INFO:teuthology.orchestra.run.smithi155.stdout: "duration": 0.0036078030000000001 2023-08-01T19:54:52.070 INFO:teuthology.orchestra.run.smithi155.stdout: }, 2023-08-01T19:54:52.070 INFO:teuthology.orchestra.run.smithi155.stdout: { 2023-08-01T19:54:52.070 INFO:teuthology.orchestra.run.smithi155.stdout: "event": "sub_op_commit_rec", 2023-08-01T19:54:52.070 INFO:teuthology.orchestra.run.smithi155.stdout: "time": "2023-08-01T19:54:50.231476+0000", 2023-08-01T19:54:52.071 INFO:teuthology.orchestra.run.smithi155.stdout: "duration": 0.012561113 2023-08-01T19:54:52.071 INFO:teuthology.orchestra.run.smithi155.stdout: }, 2023-08-01T19:54:52.071 INFO:teuthology.orchestra.run.smithi155.stdout: { 2023-08-01T19:54:52.071 INFO:teuthology.orchestra.run.smithi155.stdout: "event": "commit_sent", 2023-08-01T19:54:52.071 INFO:teuthology.orchestra.run.smithi155.stdout: "time": "2023-08-01T19:54:50.231507+0000", 2023-08-01T19:54:52.071 INFO:teuthology.orchestra.run.smithi155.stdout: "duration": 3.1285999999999998e-05 2023-08-01T19:54:52.071 INFO:teuthology.orchestra.run.smithi155.stdout: }, 2023-08-01T19:54:52.072 INFO:teuthology.orchestra.run.smithi155.stdout: { 2023-08-01T19:54:52.072 INFO:teuthology.orchestra.run.smithi155.stdout: "event": "done", 2023-08-01T19:54:52.072 INFO:teuthology.orchestra.run.smithi155.stdout: "time": "2023-08-01T19:54:50.231531+0000", 2023-08-01T19:54:52.072 INFO:teuthology.orchestra.run.smithi155.stdout: "duration": 2.3989999999999999e-05 2023-08-01T19:54:52.072 INFO:teuthology.orchestra.run.smithi155.stdout: } 2023-08-01T19:54:52.072 INFO:teuthology.orchestra.run.smithi155.stdout: ] 2023-08-01T19:54:52.072 INFO:teuthology.orchestra.run.smithi155.stdout: } 2023-08-01T19:54:52.073 INFO:teuthology.orchestra.run.smithi155.stdout: }, 2023-08-01T19:54:52.073 INFO:teuthology.orchestra.run.smithi155.stdout: { 2023-08-01T19:54:52.073 INFO:teuthology.orchestra.run.smithi155.stdout: "description": "osd_op(client.4668.0:70887 5.4 5:297593d5:::benchmark_data_smithi006_114134_object70886:head [set-alloc-hint object_size 65536 write_size 65536,write 0~65536] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e30)", 2023-08-01T19:54:52.073 INFO:teuthology.orchestra.run.smithi155.stdout: "initiated_at": "2023-08-01T19:54:50.216359+0000", 2023-08-01T19:54:52.073 INFO:teuthology.orchestra.run.smithi155.stdout: "age": 1.7763025080000001, 2023-08-01T19:54:52.073 INFO:teuthology.orchestra.run.smithi155.stdout: "duration": 0.018298663, 2023-08-01T19:54:52.073 INFO:teuthology.orchestra.run.smithi155.stdout: "type_data": { 2023-08-01T19:54:52.073 INFO:teuthology.orchestra.run.smithi155.stdout: "flag_point": "commit sent; apply or cleanup", 2023-08-01T19:54:52.074 INFO:teuthology.orchestra.run.smithi155.stdout: "client_info": { 2023-08-01T19:54:52.074 INFO:teuthology.orchestra.run.smithi155.stdout: "client": "client.4668", 2023-08-01T19:54:52.074 INFO:teuthology.orchestra.run.smithi155.stdout: "client_addr": "172.21.15.6:0/1709472247", 2023-08-01T19:54:52.074 INFO:teuthology.orchestra.run.smithi155.stdout: "tid": 70887 2023-08-01T19:54:52.074 INFO:teuthology.orchestra.run.smithi155.stdout: }, 2023-08-01T19:54:52.074 INFO:teuthology.orchestra.run.smithi155.stdout: "events": [ 2023-08-01T19:54:52.075 INFO:teuthology.orchestra.run.smithi155.stdout: { 2023-08-01T19:54:52.075 INFO:teuthology.orchestra.run.smithi155.stdout: "event": "initiated", 2023-08-01T19:54:52.075 INFO:teuthology.orchestra.run.smithi155.stdout: "time": "2023-08-01T19:54:50.216359+0000", 2023-08-01T19:54:52.075 INFO:teuthology.orchestra.run.smithi155.stdout: "duration": 0 2023-08-01T19:54:52.075 INFO:teuthology.orchestra.run.smithi155.stdout: }, 2023-08-01T19:54:52.075 INFO:teuthology.orchestra.run.smithi155.stdout: { 2023-08-01T19:54:52.075 INFO:teuthology.orchestra.run.smithi155.stdout: "event": "throttled", 2023-08-01T19:54:52.076 INFO:teuthology.orchestra.run.smithi155.stdout: "time": "2023-08-01T19:54:50.216359+0000", 2023-08-01T19:54:52.076 INFO:teuthology.orchestra.run.smithi155.stdout: "duration": 0 2023-08-01T19:54:52.076 INFO:teuthology.orchestra.run.smithi155.stdout: }, 2023-08-01T19:54:52.076 INFO:teuthology.orchestra.run.smithi155.stdout: { 2023-08-01T19:54:52.076 INFO:teuthology.orchestra.run.smithi155.stdout: "event": "header_read", 2023-08-01T19:54:52.076 INFO:teuthology.orchestra.run.smithi155.stdout: "time": "2023-08-01T19:54:50.216358+0000", 2023-08-01T19:54:52.076 INFO:teuthology.orchestra.run.smithi155.stdout: "duration": 4294967295.9999995 2023-08-01T19:54:52.077 INFO:teuthology.orchestra.run.smithi155.stdout: }, 2023-08-01T19:54:52.077 INFO:teuthology.orchestra.run.smithi155.stdout: { 2023-08-01T19:54:52.077 INFO:teuthology.orchestra.run.smithi155.stdout: "event": "all_read", 2023-08-01T19:54:52.077 INFO:teuthology.orchestra.run.smithi155.stdout: "time": "2023-08-01T19:54:50.216445+0000", 2023-08-01T19:54:52.077 INFO:teuthology.orchestra.run.smithi155.stdout: "duration": 8.6108999999999998e-05 2023-08-01T19:54:52.077 INFO:teuthology.orchestra.run.smithi155.stdout: }, 2023-08-01T19:54:52.077 INFO:teuthology.orchestra.run.smithi155.stdout: { 2023-08-01T19:54:52.077 INFO:teuthology.orchestra.run.smithi155.stdout: "event": "dispatched", 2023-08-01T19:54:52.078 INFO:teuthology.orchestra.run.smithi155.stdout: "time": "2023-08-01T19:54:50.216454+0000", 2023-08-01T19:54:52.078 INFO:teuthology.orchestra.run.smithi155.stdout: "duration": 9.2869999999999993e-06 2023-08-01T19:54:52.078 INFO:teuthology.orchestra.run.smithi155.stdout: }, 2023-08-01T19:54:52.078 INFO:teuthology.orchestra.run.smithi155.stdout: { 2023-08-01T19:54:52.078 INFO:teuthology.orchestra.run.smithi155.stdout: "event": "queued_for_pg", 2023-08-01T19:54:52.078 INFO:teuthology.orchestra.run.smithi155.stdout: "time": "2023-08-01T19:54:50.216458+0000", 2023-08-01T19:54:52.078 INFO:teuthology.orchestra.run.smithi155.stdout: "duration": 3.6349999999999999e-06 2023-08-01T19:54:52.078 INFO:teuthology.orchestra.run.smithi155.stdout: }, 2023-08-01T19:54:52.079 INFO:teuthology.orchestra.run.smithi155.stdout: { 2023-08-01T19:54:52.079 INFO:teuthology.orchestra.run.smithi155.stdout: "event": "reached_pg", 2023-08-01T19:54:52.079 INFO:teuthology.orchestra.run.smithi155.stdout: "time": "2023-08-01T19:54:50.217512+0000", 2023-08-01T19:54:52.079 INFO:teuthology.orchestra.run.smithi155.stdout: "duration": 0.0010542450000000001 2023-08-01T19:54:52.079 INFO:teuthology.orchestra.run.smithi155.stdout: }, 2023-08-01T19:54:52.079 INFO:teuthology.orchestra.run.smithi155.stdout: { 2023-08-01T19:54:52.080 INFO:teuthology.orchestra.run.smithi155.stdout: "event": "started", 2023-08-01T19:54:52.080 INFO:teuthology.orchestra.run.smithi155.stdout: "time": "2023-08-01T19:54:50.217597+0000", 2023-08-01T19:54:52.080 INFO:teuthology.orchestra.run.smithi155.stdout: "duration": 8.5310999999999997e-05 2023-08-01T19:54:52.080 INFO:teuthology.orchestra.run.smithi155.stdout: }, 2023-08-01T19:54:52.080 INFO:teuthology.orchestra.run.smithi155.stdout: { 2023-08-01T19:54:52.080 INFO:teuthology.orchestra.run.smithi155.stdout: "event": "waiting for subops from 0", 2023-08-01T19:54:52.080 INFO:teuthology.orchestra.run.smithi155.stdout: "time": "2023-08-01T19:54:50.217685+0000", 2023-08-01T19:54:52.081 INFO:teuthology.orchestra.run.smithi155.stdout: "duration": 8.7606000000000001e-05 2023-08-01T19:54:52.081 INFO:teuthology.orchestra.run.smithi155.stdout: }, 2023-08-01T19:54:52.081 INFO:teuthology.orchestra.run.smithi155.stdout: { 2023-08-01T19:54:52.081 INFO:teuthology.orchestra.run.smithi155.stdout: "event": "op_commit", 2023-08-01T19:54:52.081 INFO:teuthology.orchestra.run.smithi155.stdout: "time": "2023-08-01T19:54:50.220467+0000", 2023-08-01T19:54:52.081 INFO:teuthology.orchestra.run.smithi155.stdout: "duration": 0.0027821629999999998 2023-08-01T19:54:52.081 INFO:teuthology.orchestra.run.smithi155.stdout: }, 2023-08-01T19:54:52.081 INFO:teuthology.orchestra.run.smithi155.stdout: { 2023-08-01T19:54:52.082 INFO:teuthology.orchestra.run.smithi155.stdout: "event": "sub_op_commit_rec", 2023-08-01T19:54:52.082 INFO:teuthology.orchestra.run.smithi155.stdout: "time": "2023-08-01T19:54:50.234601+0000", 2023-08-01T19:54:52.082 INFO:teuthology.orchestra.run.smithi155.stdout: "duration": 0.014133949 2023-08-01T19:54:52.082 INFO:teuthology.orchestra.run.smithi155.stdout: }, 2023-08-01T19:54:52.082 INFO:teuthology.orchestra.run.smithi155.stdout: { 2023-08-01T19:54:52.082 INFO:teuthology.orchestra.run.smithi155.stdout: "event": "commit_sent", 2023-08-01T19:54:52.082 INFO:teuthology.orchestra.run.smithi155.stdout: "time": "2023-08-01T19:54:50.234634+0000", 2023-08-01T19:54:52.083 INFO:teuthology.orchestra.run.smithi155.stdout: "duration": 3.3259000000000001e-05 2023-08-01T19:54:52.083 INFO:teuthology.orchestra.run.smithi155.stdout: }, 2023-08-01T19:54:52.083 INFO:teuthology.orchestra.run.smithi155.stdout: { 2023-08-01T19:54:52.083 INFO:teuthology.orchestra.run.smithi155.stdout: "event": "done", 2023-08-01T19:54:52.083 INFO:teuthology.orchestra.run.smithi155.stdout: "time": "2023-08-01T19:54:50.234658+0000", 2023-08-01T19:54:52.083 INFO:teuthology.orchestra.run.smithi155.stdout: "duration": 2.3726999999999998e-05 2023-08-01T19:54:52.083 INFO:teuthology.orchestra.run.smithi155.stdout: } 2023-08-01T19:54:52.084 INFO:teuthology.orchestra.run.smithi155.stdout: ] 2023-08-01T19:54:52.084 INFO:teuthology.orchestra.run.smithi155.stdout: } 2023-08-01T19:54:52.084 INFO:teuthology.orchestra.run.smithi155.stdout: }, 2023-08-01T19:54:52.084 INFO:teuthology.orchestra.run.smithi155.stdout: { 2023-08-01T19:54:52.084 INFO:teuthology.orchestra.run.smithi155.stdout: "description": "osd_op(client.4668.0:71411 5.e 5:7c6c4519:::benchmark_data_smithi006_114134_object71410:head [set-alloc-hint object_size 65536 write_size 65536,write 0~65536] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e30)", 2023-08-01T19:54:52.084 INFO:teuthology.orchestra.run.smithi155.stdout: "initiated_at": "2023-08-01T19:54:50.471084+0000", 2023-08-01T19:54:52.084 INFO:teuthology.orchestra.run.smithi155.stdout: "age": 1.521577462, 2023-08-01T19:54:52.084 INFO:teuthology.orchestra.run.smithi155.stdout: "duration": 0.016135705, 2023-08-01T19:54:52.085 INFO:teuthology.orchestra.run.smithi155.stdout: "type_data": { 2023-08-01T19:54:52.085 INFO:teuthology.orchestra.run.smithi155.stdout: "flag_point": "commit sent; apply or cleanup", 2023-08-01T19:54:52.085 INFO:teuthology.orchestra.run.smithi155.stdout: "client_info": { 2023-08-01T19:54:52.085 INFO:teuthology.orchestra.run.smithi155.stdout: "client": "client.4668", 2023-08-01T19:54:52.085 INFO:teuthology.orchestra.run.smithi155.stdout: "client_addr": "172.21.15.6:0/1709472247", 2023-08-01T19:54:52.085 INFO:teuthology.orchestra.run.smithi155.stdout: "tid": 71411 2023-08-01T19:54:52.085 INFO:teuthology.orchestra.run.smithi155.stdout: }, 2023-08-01T19:54:52.085 INFO:teuthology.orchestra.run.smithi155.stdout: "events": [ 2023-08-01T19:54:52.086 INFO:teuthology.orchestra.run.smithi155.stdout: { 2023-08-01T19:54:52.086 INFO:teuthology.orchestra.run.smithi155.stdout: "event": "initiated", 2023-08-01T19:54:52.086 INFO:teuthology.orchestra.run.smithi155.stdout: "time": "2023-08-01T19:54:50.471084+0000", 2023-08-01T19:54:52.086 INFO:teuthology.orchestra.run.smithi155.stdout: "duration": 0 2023-08-01T19:54:52.086 INFO:teuthology.orchestra.run.smithi155.stdout: }, 2023-08-01T19:54:52.086 INFO:teuthology.orchestra.run.smithi155.stdout: { 2023-08-01T19:54:52.086 INFO:teuthology.orchestra.run.smithi155.stdout: "event": "throttled", 2023-08-01T19:54:52.087 INFO:teuthology.orchestra.run.smithi155.stdout: "time": "2023-08-01T19:54:50.471084+0000", 2023-08-01T19:54:52.087 INFO:teuthology.orchestra.run.smithi155.stdout: "duration": 0 2023-08-01T19:54:52.087 INFO:teuthology.orchestra.run.smithi155.stdout: }, 2023-08-01T19:54:52.087 INFO:teuthology.orchestra.run.smithi155.stdout: { 2023-08-01T19:54:52.087 INFO:teuthology.orchestra.run.smithi155.stdout: "event": "header_read", 2023-08-01T19:54:52.087 INFO:teuthology.orchestra.run.smithi155.stdout: "time": "2023-08-01T19:54:50.471084+0000", 2023-08-01T19:54:52.087 INFO:teuthology.orchestra.run.smithi155.stdout: "duration": 4294967295.9999995 2023-08-01T19:54:52.087 INFO:teuthology.orchestra.run.smithi155.stdout: }, 2023-08-01T19:54:52.088 INFO:teuthology.orchestra.run.smithi155.stdout: { 2023-08-01T19:54:52.088 INFO:teuthology.orchestra.run.smithi155.stdout: "event": "all_read", 2023-08-01T19:54:52.088 INFO:teuthology.orchestra.run.smithi155.stdout: "time": "2023-08-01T19:54:50.471159+0000", 2023-08-01T19:54:52.088 INFO:teuthology.orchestra.run.smithi155.stdout: "duration": 7.5179999999999995e-05 2023-08-01T19:54:52.088 INFO:teuthology.orchestra.run.smithi155.stdout: }, 2023-08-01T19:54:52.088 INFO:teuthology.orchestra.run.smithi155.stdout: { 2023-08-01T19:54:52.088 INFO:teuthology.orchestra.run.smithi155.stdout: "event": "dispatched", 2023-08-01T19:54:52.089 INFO:teuthology.orchestra.run.smithi155.stdout: "time": "2023-08-01T19:54:50.471166+0000", 2023-08-01T19:54:52.089 INFO:teuthology.orchestra.run.smithi155.stdout: "duration": 7.0859999999999996e-06 2023-08-01T19:54:52.089 INFO:teuthology.orchestra.run.smithi155.stdout: }, 2023-08-01T19:54:52.089 INFO:teuthology.orchestra.run.smithi155.stdout: { 2023-08-01T19:54:52.089 INFO:teuthology.orchestra.run.smithi155.stdout: "event": "queued_for_pg", 2023-08-01T19:54:52.089 INFO:teuthology.orchestra.run.smithi155.stdout: "time": "2023-08-01T19:54:50.471169+0000", 2023-08-01T19:54:52.089 INFO:teuthology.orchestra.run.smithi155.stdout: "duration": 2.9239999999999999e-06 2023-08-01T19:54:52.090 INFO:teuthology.orchestra.run.smithi155.stdout: }, 2023-08-01T19:54:52.090 INFO:teuthology.orchestra.run.smithi155.stdout: { 2023-08-01T19:54:52.090 INFO:teuthology.orchestra.run.smithi155.stdout: "event": "reached_pg", 2023-08-01T19:54:52.090 INFO:teuthology.orchestra.run.smithi155.stdout: "time": "2023-08-01T19:54:50.476521+0000", 2023-08-01T19:54:52.090 INFO:teuthology.orchestra.run.smithi155.stdout: "duration": 0.0053523900000000003 2023-08-01T19:54:52.090 INFO:teuthology.orchestra.run.smithi155.stdout: }, 2023-08-01T19:54:52.090 INFO:teuthology.orchestra.run.smithi155.stdout: { 2023-08-01T19:54:52.090 INFO:teuthology.orchestra.run.smithi155.stdout: "event": "started", 2023-08-01T19:54:52.091 INFO:teuthology.orchestra.run.smithi155.stdout: "time": "2023-08-01T19:54:50.476637+0000", 2023-08-01T19:54:52.091 INFO:teuthology.orchestra.run.smithi155.stdout: "duration": 0.000115321 2023-08-01T19:54:52.091 INFO:teuthology.orchestra.run.smithi155.stdout: }, 2023-08-01T19:54:52.091 INFO:teuthology.orchestra.run.smithi155.stdout: { 2023-08-01T19:54:52.091 INFO:teuthology.orchestra.run.smithi155.stdout: "event": "waiting for subops from 0", 2023-08-01T19:54:52.091 INFO:teuthology.orchestra.run.smithi155.stdout: "time": "2023-08-01T19:54:50.476777+0000", 2023-08-01T19:54:52.091 INFO:teuthology.orchestra.run.smithi155.stdout: "duration": 0.000140135 2023-08-01T19:54:52.091 INFO:teuthology.orchestra.run.smithi155.stdout: }, 2023-08-01T19:54:52.092 INFO:teuthology.orchestra.run.smithi155.stdout: { 2023-08-01T19:54:52.092 INFO:teuthology.orchestra.run.smithi155.stdout: "event": "op_commit", 2023-08-01T19:54:52.092 INFO:teuthology.orchestra.run.smithi155.stdout: "time": "2023-08-01T19:54:50.479458+0000", 2023-08-01T19:54:52.092 INFO:teuthology.orchestra.run.smithi155.stdout: "duration": 0.0026815530000000001 2023-08-01T19:54:52.092 INFO:teuthology.orchestra.run.smithi155.stdout: }, 2023-08-01T19:54:52.092 INFO:teuthology.orchestra.run.smithi155.stdout: { 2023-08-01T19:54:52.092 INFO:teuthology.orchestra.run.smithi155.stdout: "event": "sub_op_commit_rec", 2023-08-01T19:54:52.093 INFO:teuthology.orchestra.run.smithi155.stdout: "time": "2023-08-01T19:54:50.487118+0000", 2023-08-01T19:54:52.093 INFO:teuthology.orchestra.run.smithi155.stdout: "duration": 0.007659908 2023-08-01T19:54:52.093 INFO:teuthology.orchestra.run.smithi155.stdout: }, 2023-08-01T19:54:52.093 INFO:teuthology.orchestra.run.smithi155.stdout: { 2023-08-01T19:54:52.093 INFO:teuthology.orchestra.run.smithi155.stdout: "event": "commit_sent", 2023-08-01T19:54:52.093 INFO:teuthology.orchestra.run.smithi155.stdout: "time": "2023-08-01T19:54:50.487171+0000", 2023-08-01T19:54:52.093 INFO:teuthology.orchestra.run.smithi155.stdout: "duration": 5.3029000000000003e-05 2023-08-01T19:54:52.093 INFO:teuthology.orchestra.run.smithi155.stdout: }, 2023-08-01T19:54:52.094 INFO:teuthology.orchestra.run.smithi155.stdout: { 2023-08-01T19:54:52.094 INFO:teuthology.orchestra.run.smithi155.stdout: "event": "done", 2023-08-01T19:54:52.094 INFO:teuthology.orchestra.run.smithi155.stdout: "time": "2023-08-01T19:54:50.487220+0000", 2023-08-01T19:54:52.094 INFO:teuthology.orchestra.run.smithi155.stdout: "duration": 4.8535000000000002e-05 2023-08-01T19:54:52.094 INFO:teuthology.orchestra.run.smithi155.stdout: } 2023-08-01T19:54:52.094 INFO:teuthology.orchestra.run.smithi155.stdout: ] 2023-08-01T19:54:52.094 INFO:teuthology.orchestra.run.smithi155.stdout: } 2023-08-01T19:54:52.094 INFO:teuthology.orchestra.run.smithi155.stdout: }, 2023-08-01T19:54:52.095 INFO:teuthology.orchestra.run.smithi155.stdout: { 2023-08-01T19:54:52.095 INFO:teuthology.orchestra.run.smithi155.stdout: "description": "osd_op(client.4668.0:73454 5.8 5:15596b2f:::benchmark_data_smithi006_114134_object73453:head [set-alloc-hint object_size 65536 write_size 65536,write 0~65536] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e31)", 2023-08-01T19:54:52.095 INFO:teuthology.orchestra.run.smithi155.stdout: "initiated_at": "2023-08-01T19:54:51.460020+0000", 2023-08-01T19:54:52.095 INFO:teuthology.orchestra.run.smithi155.stdout: "age": 0.53264196500000005, 2023-08-01T19:54:52.095 INFO:teuthology.orchestra.run.smithi155.stdout: "duration": 0.022889436999999999, 2023-08-01T19:54:52.095 INFO:teuthology.orchestra.run.smithi155.stdout: "type_data": { 2023-08-01T19:54:52.096 INFO:teuthology.orchestra.run.smithi155.stdout: "flag_point": "commit sent; apply or cleanup", 2023-08-01T19:54:52.096 INFO:teuthology.orchestra.run.smithi155.stdout: "client_info": { 2023-08-01T19:54:52.096 INFO:teuthology.orchestra.run.smithi155.stdout: "client": "client.4668", 2023-08-01T19:54:52.096 INFO:teuthology.orchestra.run.smithi155.stdout: "client_addr": "172.21.15.6:0/1709472247", 2023-08-01T19:54:52.096 INFO:teuthology.orchestra.run.smithi155.stdout: "tid": 73454 2023-08-01T19:54:52.096 INFO:teuthology.orchestra.run.smithi155.stdout: }, 2023-08-01T19:54:52.096 INFO:teuthology.orchestra.run.smithi155.stdout: "events": [ 2023-08-01T19:54:52.097 INFO:teuthology.orchestra.run.smithi155.stdout: { 2023-08-01T19:54:52.097 INFO:teuthology.orchestra.run.smithi155.stdout: "event": "initiated", 2023-08-01T19:54:52.097 INFO:teuthology.orchestra.run.smithi155.stdout: "time": "2023-08-01T19:54:51.460020+0000", 2023-08-01T19:54:52.097 INFO:teuthology.orchestra.run.smithi155.stdout: "duration": 0 2023-08-01T19:54:52.097 INFO:teuthology.orchestra.run.smithi155.stdout: }, 2023-08-01T19:54:52.097 INFO:teuthology.orchestra.run.smithi155.stdout: { 2023-08-01T19:54:52.097 INFO:teuthology.orchestra.run.smithi155.stdout: "event": "throttled", 2023-08-01T19:54:52.097 INFO:teuthology.orchestra.run.smithi155.stdout: "time": "2023-08-01T19:54:51.460020+0000", 2023-08-01T19:54:52.098 INFO:teuthology.orchestra.run.smithi155.stdout: "duration": 0 2023-08-01T19:54:52.098 INFO:teuthology.orchestra.run.smithi155.stdout: }, 2023-08-01T19:54:52.098 INFO:teuthology.orchestra.run.smithi155.stdout: { 2023-08-01T19:54:52.098 INFO:teuthology.orchestra.run.smithi155.stdout: "event": "header_read", 2023-08-01T19:54:52.098 INFO:teuthology.orchestra.run.smithi155.stdout: "time": "2023-08-01T19:54:51.460019+0000", 2023-08-01T19:54:52.098 INFO:teuthology.orchestra.run.smithi155.stdout: "duration": 4294967295.9999995 2023-08-01T19:54:52.098 INFO:teuthology.orchestra.run.smithi155.stdout: }, 2023-08-01T19:54:52.098 INFO:teuthology.orchestra.run.smithi155.stdout: { 2023-08-01T19:54:52.099 INFO:teuthology.orchestra.run.smithi155.stdout: "event": "all_read", 2023-08-01T19:54:52.099 INFO:teuthology.orchestra.run.smithi155.stdout: "time": "2023-08-01T19:54:51.460051+0000", 2023-08-01T19:54:52.099 INFO:teuthology.orchestra.run.smithi155.stdout: "duration": 3.1736000000000002e-05 2023-08-01T19:54:52.099 INFO:teuthology.orchestra.run.smithi155.stdout: }, 2023-08-01T19:54:52.099 INFO:teuthology.orchestra.run.smithi155.stdout: { 2023-08-01T19:54:52.099 INFO:teuthology.orchestra.run.smithi155.stdout: "event": "dispatched", 2023-08-01T19:54:52.099 INFO:teuthology.orchestra.run.smithi155.stdout: "time": "2023-08-01T19:54:51.460058+0000", 2023-08-01T19:54:52.099 INFO:teuthology.orchestra.run.smithi155.stdout: "duration": 7.3869999999999997e-06 2023-08-01T19:54:52.100 INFO:teuthology.orchestra.run.smithi155.stdout: }, 2023-08-01T19:54:52.100 INFO:teuthology.orchestra.run.smithi155.stdout: { 2023-08-01T19:54:52.100 INFO:teuthology.orchestra.run.smithi155.stdout: "event": "queued_for_pg", 2023-08-01T19:54:52.100 INFO:teuthology.orchestra.run.smithi155.stdout: "time": "2023-08-01T19:54:51.460062+0000", 2023-08-01T19:54:52.100 INFO:teuthology.orchestra.run.smithi155.stdout: "duration": 4.352e-06 2023-08-01T19:54:52.100 INFO:teuthology.orchestra.run.smithi155.stdout: }, 2023-08-01T19:54:52.100 INFO:teuthology.orchestra.run.smithi155.stdout: { 2023-08-01T19:54:52.101 INFO:teuthology.orchestra.run.smithi155.stdout: "event": "reached_pg", 2023-08-01T19:54:52.101 INFO:teuthology.orchestra.run.smithi155.stdout: "time": "2023-08-01T19:54:51.460101+0000", 2023-08-01T19:54:52.101 INFO:teuthology.orchestra.run.smithi155.stdout: "duration": 3.8705000000000003e-05 2023-08-01T19:54:52.101 INFO:teuthology.orchestra.run.smithi155.stdout: }, 2023-08-01T19:54:52.101 INFO:teuthology.orchestra.run.smithi155.stdout: { 2023-08-01T19:54:52.101 INFO:teuthology.orchestra.run.smithi155.stdout: "event": "started", 2023-08-01T19:54:52.101 INFO:teuthology.orchestra.run.smithi155.stdout: "time": "2023-08-01T19:54:51.460236+0000", 2023-08-01T19:54:52.101 INFO:teuthology.orchestra.run.smithi155.stdout: "duration": 0.00013463599999999999 2023-08-01T19:54:52.102 INFO:teuthology.orchestra.run.smithi155.stdout: }, 2023-08-01T19:54:52.102 INFO:teuthology.orchestra.run.smithi155.stdout: { 2023-08-01T19:54:52.102 INFO:teuthology.orchestra.run.smithi155.stdout: "event": "waiting for subops from 0", 2023-08-01T19:54:52.102 INFO:teuthology.orchestra.run.smithi155.stdout: "time": "2023-08-01T19:54:51.460391+0000", 2023-08-01T19:54:52.102 INFO:teuthology.orchestra.run.smithi155.stdout: "duration": 0.00015525000000000001 2023-08-01T19:54:52.102 INFO:teuthology.orchestra.run.smithi155.stdout: }, 2023-08-01T19:54:52.102 INFO:teuthology.orchestra.run.smithi155.stdout: { 2023-08-01T19:54:52.102 INFO:teuthology.orchestra.run.smithi155.stdout: "event": "sub_op_commit_rec", 2023-08-01T19:54:52.103 INFO:teuthology.orchestra.run.smithi155.stdout: "time": "2023-08-01T19:54:51.468393+0000", 2023-08-01T19:54:52.103 INFO:teuthology.orchestra.run.smithi155.stdout: "duration": 0.00800208 2023-08-01T19:54:52.103 INFO:teuthology.orchestra.run.smithi155.stdout: }, 2023-08-01T19:54:52.103 INFO:teuthology.orchestra.run.smithi155.stdout: { 2023-08-01T19:54:52.103 INFO:teuthology.orchestra.run.smithi155.stdout: "event": "op_commit", 2023-08-01T19:54:52.103 INFO:teuthology.orchestra.run.smithi155.stdout: "time": "2023-08-01T19:54:51.482815+0000", 2023-08-01T19:54:52.103 INFO:teuthology.orchestra.run.smithi155.stdout: "duration": 0.01442148 2023-08-01T19:54:52.103 INFO:teuthology.orchestra.run.smithi155.stdout: }, 2023-08-01T19:54:52.104 INFO:teuthology.orchestra.run.smithi155.stdout: { 2023-08-01T19:54:52.104 INFO:teuthology.orchestra.run.smithi155.stdout: "event": "commit_sent", 2023-08-01T19:54:52.104 INFO:teuthology.orchestra.run.smithi155.stdout: "time": "2023-08-01T19:54:51.482866+0000", 2023-08-01T19:54:52.104 INFO:teuthology.orchestra.run.smithi155.stdout: "duration": 5.1842999999999998e-05 2023-08-01T19:54:52.104 INFO:teuthology.orchestra.run.smithi155.stdout: }, 2023-08-01T19:54:52.104 INFO:teuthology.orchestra.run.smithi155.stdout: { 2023-08-01T19:54:52.104 INFO:teuthology.orchestra.run.smithi155.stdout: "event": "done", 2023-08-01T19:54:52.105 INFO:teuthology.orchestra.run.smithi155.stdout: "time": "2023-08-01T19:54:51.482909+0000", 2023-08-01T19:54:52.105 INFO:teuthology.orchestra.run.smithi155.stdout: "duration": 4.2663000000000001e-05 2023-08-01T19:54:52.105 INFO:teuthology.orchestra.run.smithi155.stdout: } 2023-08-01T19:54:52.105 INFO:teuthology.orchestra.run.smithi155.stdout: ] 2023-08-01T19:54:52.105 INFO:teuthology.orchestra.run.smithi155.stdout: } 2023-08-01T19:54:52.105 INFO:teuthology.orchestra.run.smithi155.stdout: }, 2023-08-01T19:54:52.105 INFO:teuthology.orchestra.run.smithi155.stdout: { 2023-08-01T19:54:52.105 INFO:teuthology.orchestra.run.smithi155.stdout: "description": "osd_op(client.4668.0:73455 5.b 5:de51121e:::benchmark_data_smithi006_114134_object73454:head [set-alloc-hint object_size 65536 write_size 65536,write 0~65536] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e31)", 2023-08-01T19:54:52.106 INFO:teuthology.orchestra.run.smithi155.stdout: "initiated_at": "2023-08-01T19:54:51.460078+0000", 2023-08-01T19:54:52.106 INFO:teuthology.orchestra.run.smithi155.stdout: "age": 0.53258399099999998, 2023-08-01T19:54:52.106 INFO:teuthology.orchestra.run.smithi155.stdout: "duration": 0.022689121999999999, 2023-08-01T19:54:52.106 INFO:teuthology.orchestra.run.smithi155.stdout: "type_data": { 2023-08-01T19:54:52.106 INFO:teuthology.orchestra.run.smithi155.stdout: "flag_point": "commit sent; apply or cleanup", 2023-08-01T19:54:52.106 INFO:teuthology.orchestra.run.smithi155.stdout: "client_info": { 2023-08-01T19:54:52.106 INFO:teuthology.orchestra.run.smithi155.stdout: "client": "client.4668", 2023-08-01T19:54:52.106 INFO:teuthology.orchestra.run.smithi155.stdout: "client_addr": "172.21.15.6:0/1709472247", 2023-08-01T19:54:52.107 INFO:teuthology.orchestra.run.smithi155.stdout: "tid": 73455 2023-08-01T19:54:52.107 INFO:teuthology.orchestra.run.smithi155.stdout: }, 2023-08-01T19:54:52.107 INFO:teuthology.orchestra.run.smithi155.stdout: "events": [ 2023-08-01T19:54:52.107 INFO:teuthology.orchestra.run.smithi155.stdout: { 2023-08-01T19:54:52.107 INFO:teuthology.orchestra.run.smithi155.stdout: "event": "initiated", 2023-08-01T19:54:52.107 INFO:teuthology.orchestra.run.smithi155.stdout: "time": "2023-08-01T19:54:51.460078+0000", 2023-08-01T19:54:52.107 INFO:teuthology.orchestra.run.smithi155.stdout: "duration": 0 2023-08-01T19:54:52.107 INFO:teuthology.orchestra.run.smithi155.stdout: }, 2023-08-01T19:54:52.108 INFO:teuthology.orchestra.run.smithi155.stdout: { 2023-08-01T19:54:52.108 INFO:teuthology.orchestra.run.smithi155.stdout: "event": "throttled", 2023-08-01T19:54:52.108 INFO:teuthology.orchestra.run.smithi155.stdout: "time": "2023-08-01T19:54:51.460078+0000", 2023-08-01T19:54:52.108 INFO:teuthology.orchestra.run.smithi155.stdout: "duration": 0 2023-08-01T19:54:52.108 INFO:teuthology.orchestra.run.smithi155.stdout: }, 2023-08-01T19:54:52.108 INFO:teuthology.orchestra.run.smithi155.stdout: { 2023-08-01T19:54:52.108 INFO:teuthology.orchestra.run.smithi155.stdout: "event": "header_read", 2023-08-01T19:54:52.109 INFO:teuthology.orchestra.run.smithi155.stdout: "time": "2023-08-01T19:54:51.460077+0000", 2023-08-01T19:54:52.109 INFO:teuthology.orchestra.run.smithi155.stdout: "duration": 4294967295.9999995 2023-08-01T19:54:52.109 INFO:teuthology.orchestra.run.smithi155.stdout: }, 2023-08-01T19:54:52.109 INFO:teuthology.orchestra.run.smithi155.stdout: { 2023-08-01T19:54:52.109 INFO:teuthology.orchestra.run.smithi155.stdout: "event": "all_read", 2023-08-01T19:54:52.109 INFO:teuthology.orchestra.run.smithi155.stdout: "time": "2023-08-01T19:54:51.460102+0000", 2023-08-01T19:54:52.109 INFO:teuthology.orchestra.run.smithi155.stdout: "duration": 2.4933e-05 2023-08-01T19:54:52.110 INFO:teuthology.orchestra.run.smithi155.stdout: }, 2023-08-01T19:54:52.110 INFO:teuthology.orchestra.run.smithi155.stdout: { 2023-08-01T19:54:52.110 INFO:teuthology.orchestra.run.smithi155.stdout: "event": "dispatched", 2023-08-01T19:54:52.110 INFO:teuthology.orchestra.run.smithi155.stdout: "time": "2023-08-01T19:54:51.460109+0000", 2023-08-01T19:54:52.110 INFO:teuthology.orchestra.run.smithi155.stdout: "duration": 7.0720000000000002e-06 2023-08-01T19:54:52.110 INFO:teuthology.orchestra.run.smithi155.stdout: }, 2023-08-01T19:54:52.110 INFO:teuthology.orchestra.run.smithi155.stdout: { 2023-08-01T19:54:52.111 INFO:teuthology.orchestra.run.smithi155.stdout: "event": "queued_for_pg", 2023-08-01T19:54:52.111 INFO:teuthology.orchestra.run.smithi155.stdout: "time": "2023-08-01T19:54:51.460113+0000", 2023-08-01T19:54:52.111 INFO:teuthology.orchestra.run.smithi155.stdout: "duration": 4.3220000000000003e-06 2023-08-01T19:54:52.111 INFO:teuthology.orchestra.run.smithi155.stdout: }, 2023-08-01T19:54:52.111 INFO:teuthology.orchestra.run.smithi155.stdout: { 2023-08-01T19:54:52.111 INFO:teuthology.orchestra.run.smithi155.stdout: "event": "reached_pg", 2023-08-01T19:54:52.111 INFO:teuthology.orchestra.run.smithi155.stdout: "time": "2023-08-01T19:54:51.460955+0000", 2023-08-01T19:54:52.111 INFO:teuthology.orchestra.run.smithi155.stdout: "duration": 0.00084142500000000003 2023-08-01T19:54:52.112 INFO:teuthology.orchestra.run.smithi155.stdout: }, 2023-08-01T19:54:52.112 INFO:teuthology.orchestra.run.smithi155.stdout: { 2023-08-01T19:54:52.112 INFO:teuthology.orchestra.run.smithi155.stdout: "event": "started", 2023-08-01T19:54:52.112 INFO:teuthology.orchestra.run.smithi155.stdout: "time": "2023-08-01T19:54:51.461079+0000", 2023-08-01T19:54:52.112 INFO:teuthology.orchestra.run.smithi155.stdout: "duration": 0.000123826 2023-08-01T19:54:52.112 INFO:teuthology.orchestra.run.smithi155.stdout: }, 2023-08-01T19:54:52.113 INFO:teuthology.orchestra.run.smithi155.stdout: { 2023-08-01T19:54:52.113 INFO:teuthology.orchestra.run.smithi155.stdout: "event": "waiting for subops from 0", 2023-08-01T19:54:52.113 INFO:teuthology.orchestra.run.smithi155.stdout: "time": "2023-08-01T19:54:51.461233+0000", 2023-08-01T19:54:52.113 INFO:teuthology.orchestra.run.smithi155.stdout: "duration": 0.00015431900000000001 2023-08-01T19:54:52.113 INFO:teuthology.orchestra.run.smithi155.stdout: }, 2023-08-01T19:54:52.113 INFO:teuthology.orchestra.run.smithi155.stdout: { 2023-08-01T19:54:52.113 INFO:teuthology.orchestra.run.smithi155.stdout: "event": "sub_op_commit_rec", 2023-08-01T19:54:52.113 INFO:teuthology.orchestra.run.smithi155.stdout: "time": "2023-08-01T19:54:51.468509+0000", 2023-08-01T19:54:52.114 INFO:teuthology.orchestra.run.smithi155.stdout: "duration": 0.0072759859999999999 2023-08-01T19:54:52.114 INFO:teuthology.orchestra.run.smithi155.stdout: }, 2023-08-01T19:54:52.114 INFO:teuthology.orchestra.run.smithi155.stdout: { 2023-08-01T19:54:52.114 INFO:teuthology.orchestra.run.smithi155.stdout: "event": "op_commit", 2023-08-01T19:54:52.114 INFO:teuthology.orchestra.run.smithi155.stdout: "time": "2023-08-01T19:54:51.482704+0000", 2023-08-01T19:54:52.114 INFO:teuthology.orchestra.run.smithi155.stdout: "duration": 0.01419545 2023-08-01T19:54:52.115 INFO:teuthology.orchestra.run.smithi155.stdout: }, 2023-08-01T19:54:52.115 INFO:teuthology.orchestra.run.smithi155.stdout: { 2023-08-01T19:54:52.115 INFO:teuthology.orchestra.run.smithi155.stdout: "event": "commit_sent", 2023-08-01T19:54:52.115 INFO:teuthology.orchestra.run.smithi155.stdout: "time": "2023-08-01T19:54:51.482747+0000", 2023-08-01T19:54:52.115 INFO:teuthology.orchestra.run.smithi155.stdout: "duration": 4.2413999999999997e-05 2023-08-01T19:54:52.115 INFO:teuthology.orchestra.run.smithi155.stdout: }, 2023-08-01T19:54:52.115 INFO:teuthology.orchestra.run.smithi155.stdout: { 2023-08-01T19:54:52.115 INFO:teuthology.orchestra.run.smithi155.stdout: "event": "done", 2023-08-01T19:54:52.116 INFO:teuthology.orchestra.run.smithi155.stdout: "time": "2023-08-01T19:54:51.482767+0000", 2023-08-01T19:54:52.116 INFO:teuthology.orchestra.run.smithi155.stdout: "duration": 1.9908999999999999e-05 2023-08-01T19:54:52.116 INFO:teuthology.orchestra.run.smithi155.stdout: } 2023-08-01T19:54:52.116 INFO:teuthology.orchestra.run.smithi155.stdout: ] 2023-08-01T19:54:52.116 INFO:teuthology.orchestra.run.smithi155.stdout: } 2023-08-01T19:54:52.116 INFO:teuthology.orchestra.run.smithi155.stdout: }, 2023-08-01T19:54:52.116 INFO:teuthology.orchestra.run.smithi155.stdout: { 2023-08-01T19:54:52.116 INFO:teuthology.orchestra.run.smithi155.stdout: "description": "osd_op(client.4668.0:73456 5.0 5:0164baf4:::benchmark_data_smithi006_114134_object73455:head [set-alloc-hint object_size 65536 write_size 65536,write 0~65536] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e31)", 2023-08-01T19:54:52.117 INFO:teuthology.orchestra.run.smithi155.stdout: "initiated_at": "2023-08-01T19:54:51.461520+0000", 2023-08-01T19:54:52.117 INFO:teuthology.orchestra.run.smithi155.stdout: "age": 0.53114200099999997, 2023-08-01T19:54:52.117 INFO:teuthology.orchestra.run.smithi155.stdout: "duration": 0.023899916, 2023-08-01T19:54:52.117 INFO:teuthology.orchestra.run.smithi155.stdout: "type_data": { 2023-08-01T19:54:52.117 INFO:teuthology.orchestra.run.smithi155.stdout: "flag_point": "commit sent; apply or cleanup", 2023-08-01T19:54:52.117 INFO:teuthology.orchestra.run.smithi155.stdout: "client_info": { 2023-08-01T19:54:52.118 INFO:teuthology.orchestra.run.smithi155.stdout: "client": "client.4668", 2023-08-01T19:54:52.118 INFO:teuthology.orchestra.run.smithi155.stdout: "client_addr": "172.21.15.6:0/1709472247", 2023-08-01T19:54:52.118 INFO:teuthology.orchestra.run.smithi155.stdout: "tid": 73456 2023-08-01T19:54:52.118 INFO:teuthology.orchestra.run.smithi155.stdout: }, 2023-08-01T19:54:52.118 INFO:teuthology.orchestra.run.smithi155.stdout: "events": [ 2023-08-01T19:54:52.118 INFO:teuthology.orchestra.run.smithi155.stdout: { 2023-08-01T19:54:52.118 INFO:teuthology.orchestra.run.smithi155.stdout: "event": "initiated", 2023-08-01T19:54:52.119 INFO:teuthology.orchestra.run.smithi155.stdout: "time": "2023-08-01T19:54:51.461520+0000", 2023-08-01T19:54:52.119 INFO:teuthology.orchestra.run.smithi155.stdout: "duration": 0 2023-08-01T19:54:52.119 INFO:teuthology.orchestra.run.smithi155.stdout: }, 2023-08-01T19:54:52.119 INFO:teuthology.orchestra.run.smithi155.stdout: { 2023-08-01T19:54:52.119 INFO:teuthology.orchestra.run.smithi155.stdout: "event": "throttled", 2023-08-01T19:54:52.119 INFO:teuthology.orchestra.run.smithi155.stdout: "time": "2023-08-01T19:54:51.461520+0000", 2023-08-01T19:54:52.119 INFO:teuthology.orchestra.run.smithi155.stdout: "duration": 0 2023-08-01T19:54:52.120 INFO:teuthology.orchestra.run.smithi155.stdout: }, 2023-08-01T19:54:52.120 INFO:teuthology.orchestra.run.smithi155.stdout: { 2023-08-01T19:54:52.120 INFO:teuthology.orchestra.run.smithi155.stdout: "event": "header_read", 2023-08-01T19:54:52.120 INFO:teuthology.orchestra.run.smithi155.stdout: "time": "2023-08-01T19:54:51.461519+0000", 2023-08-01T19:54:52.120 INFO:teuthology.orchestra.run.smithi155.stdout: "duration": 4294967295.999999 2023-08-01T19:54:52.120 INFO:teuthology.orchestra.run.smithi155.stdout: }, 2023-08-01T19:54:52.121 INFO:teuthology.orchestra.run.smithi155.stdout: { 2023-08-01T19:54:52.121 INFO:teuthology.orchestra.run.smithi155.stdout: "event": "all_read", 2023-08-01T19:54:52.121 INFO:teuthology.orchestra.run.smithi155.stdout: "time": "2023-08-01T19:54:51.461633+0000", 2023-08-01T19:54:52.121 INFO:teuthology.orchestra.run.smithi155.stdout: "duration": 0.000114015 2023-08-01T19:54:52.121 INFO:teuthology.orchestra.run.smithi155.stdout: }, 2023-08-01T19:54:52.121 INFO:teuthology.orchestra.run.smithi155.stdout: { 2023-08-01T19:54:52.121 INFO:teuthology.orchestra.run.smithi155.stdout: "event": "dispatched", 2023-08-01T19:54:52.122 INFO:teuthology.orchestra.run.smithi155.stdout: "time": "2023-08-01T19:54:51.461643+0000", 2023-08-01T19:54:52.122 INFO:teuthology.orchestra.run.smithi155.stdout: "duration": 1.0217000000000001e-05 2023-08-01T19:54:52.122 INFO:teuthology.orchestra.run.smithi155.stdout: }, 2023-08-01T19:54:52.122 INFO:teuthology.orchestra.run.smithi155.stdout: { 2023-08-01T19:54:52.122 INFO:teuthology.orchestra.run.smithi155.stdout: "event": "queued_for_pg", 2023-08-01T19:54:52.122 INFO:teuthology.orchestra.run.smithi155.stdout: "time": "2023-08-01T19:54:51.461649+0000", 2023-08-01T19:54:52.122 INFO:teuthology.orchestra.run.smithi155.stdout: "duration": 5.8850000000000004e-06 2023-08-01T19:54:52.122 INFO:teuthology.orchestra.run.smithi155.stdout: }, 2023-08-01T19:54:52.123 INFO:teuthology.orchestra.run.smithi155.stdout: { 2023-08-01T19:54:52.123 INFO:teuthology.orchestra.run.smithi155.stdout: "event": "reached_pg", 2023-08-01T19:54:52.123 INFO:teuthology.orchestra.run.smithi155.stdout: "time": "2023-08-01T19:54:51.461686+0000", 2023-08-01T19:54:52.123 INFO:teuthology.orchestra.run.smithi155.stdout: "duration": 3.7319e-05 2023-08-01T19:54:52.123 INFO:teuthology.orchestra.run.smithi155.stdout: }, 2023-08-01T19:54:52.123 INFO:teuthology.orchestra.run.smithi155.stdout: { 2023-08-01T19:54:52.123 INFO:teuthology.orchestra.run.smithi155.stdout: "event": "started", 2023-08-01T19:54:52.124 INFO:teuthology.orchestra.run.smithi155.stdout: "time": "2023-08-01T19:54:51.461802+0000", 2023-08-01T19:54:52.124 INFO:teuthology.orchestra.run.smithi155.stdout: "duration": 0.000115604 2023-08-01T19:54:52.124 INFO:teuthology.orchestra.run.smithi155.stdout: }, 2023-08-01T19:54:52.124 INFO:teuthology.orchestra.run.smithi155.stdout: { 2023-08-01T19:54:52.124 INFO:teuthology.orchestra.run.smithi155.stdout: "event": "waiting for subops from 0", 2023-08-01T19:54:52.124 INFO:teuthology.orchestra.run.smithi155.stdout: "time": "2023-08-01T19:54:51.461933+0000", 2023-08-01T19:54:52.124 INFO:teuthology.orchestra.run.smithi155.stdout: "duration": 0.000131175 2023-08-01T19:54:52.124 INFO:teuthology.orchestra.run.smithi155.stdout: }, 2023-08-01T19:54:52.125 INFO:teuthology.orchestra.run.smithi155.stdout: { 2023-08-01T19:54:52.125 INFO:teuthology.orchestra.run.smithi155.stdout: "event": "sub_op_commit_rec", 2023-08-01T19:54:52.125 INFO:teuthology.orchestra.run.smithi155.stdout: "time": "2023-08-01T19:54:51.468411+0000", 2023-08-01T19:54:52.125 INFO:teuthology.orchestra.run.smithi155.stdout: "duration": 0.0064775850000000001 2023-08-01T19:54:52.125 INFO:teuthology.orchestra.run.smithi155.stdout: }, 2023-08-01T19:54:52.125 INFO:teuthology.orchestra.run.smithi155.stdout: { 2023-08-01T19:54:52.125 INFO:teuthology.orchestra.run.smithi155.stdout: "event": "op_commit", 2023-08-01T19:54:52.126 INFO:teuthology.orchestra.run.smithi155.stdout: "time": "2023-08-01T19:54:51.485340+0000", 2023-08-01T19:54:52.126 INFO:teuthology.orchestra.run.smithi155.stdout: "duration": 0.016928907 2023-08-01T19:54:52.126 INFO:teuthology.orchestra.run.smithi155.stdout: }, 2023-08-01T19:54:52.126 INFO:teuthology.orchestra.run.smithi155.stdout: { 2023-08-01T19:54:52.126 INFO:teuthology.orchestra.run.smithi155.stdout: "event": "commit_sent", 2023-08-01T19:54:52.126 INFO:teuthology.orchestra.run.smithi155.stdout: "time": "2023-08-01T19:54:51.485385+0000", 2023-08-01T19:54:52.126 INFO:teuthology.orchestra.run.smithi155.stdout: "duration": 4.5222000000000002e-05 2023-08-01T19:54:52.127 INFO:teuthology.orchestra.run.smithi155.stdout: }, 2023-08-01T19:54:52.127 INFO:teuthology.orchestra.run.smithi155.stdout: { 2023-08-01T19:54:52.127 INFO:teuthology.orchestra.run.smithi155.stdout: "event": "done", 2023-08-01T19:54:52.127 INFO:teuthology.orchestra.run.smithi155.stdout: "time": "2023-08-01T19:54:51.485420+0000", 2023-08-01T19:54:52.127 INFO:teuthology.orchestra.run.smithi155.stdout: "duration": 3.4717e-05 2023-08-01T19:54:52.127 INFO:teuthology.orchestra.run.smithi155.stdout: } 2023-08-01T19:54:52.127 INFO:teuthology.orchestra.run.smithi155.stdout: ] 2023-08-01T19:54:52.127 INFO:teuthology.orchestra.run.smithi155.stdout: } 2023-08-01T19:54:52.128 INFO:teuthology.orchestra.run.smithi155.stdout: }, 2023-08-01T19:54:52.128 INFO:teuthology.orchestra.run.smithi155.stdout: { 2023-08-01T19:54:52.128 INFO:teuthology.orchestra.run.smithi155.stdout: "description": "osd_op(client.4668.0:73458 5.e 5:7e500c47:::benchmark_data_smithi006_114134_object73457:head [set-alloc-hint object_size 65536 write_size 65536,write 0~65536] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e31)", 2023-08-01T19:54:52.128 INFO:teuthology.orchestra.run.smithi155.stdout: "initiated_at": "2023-08-01T19:54:51.461880+0000", 2023-08-01T19:54:52.128 INFO:teuthology.orchestra.run.smithi155.stdout: "age": 0.53078205300000003, 2023-08-01T19:54:52.128 INFO:teuthology.orchestra.run.smithi155.stdout: "duration": 0.020850289000000001, 2023-08-01T19:54:52.128 INFO:teuthology.orchestra.run.smithi155.stdout: "type_data": { 2023-08-01T19:54:52.129 INFO:teuthology.orchestra.run.smithi155.stdout: "flag_point": "commit sent; apply or cleanup", 2023-08-01T19:54:52.129 INFO:teuthology.orchestra.run.smithi155.stdout: "client_info": { 2023-08-01T19:54:52.129 INFO:teuthology.orchestra.run.smithi155.stdout: "client": "client.4668", 2023-08-01T19:54:52.129 INFO:teuthology.orchestra.run.smithi155.stdout: "client_addr": "172.21.15.6:0/1709472247", 2023-08-01T19:54:52.129 INFO:teuthology.orchestra.run.smithi155.stdout: "tid": 73458 2023-08-01T19:54:52.129 INFO:teuthology.orchestra.run.smithi155.stdout: }, 2023-08-01T19:54:52.129 INFO:teuthology.orchestra.run.smithi155.stdout: "events": [ 2023-08-01T19:54:52.130 INFO:teuthology.orchestra.run.smithi155.stdout: { 2023-08-01T19:54:52.130 INFO:teuthology.orchestra.run.smithi155.stdout: "event": "initiated", 2023-08-01T19:54:52.130 INFO:teuthology.orchestra.run.smithi155.stdout: "time": "2023-08-01T19:54:51.461880+0000", 2023-08-01T19:54:52.130 INFO:teuthology.orchestra.run.smithi155.stdout: "duration": 0 2023-08-01T19:54:52.130 INFO:teuthology.orchestra.run.smithi155.stdout: }, 2023-08-01T19:54:52.130 INFO:teuthology.orchestra.run.smithi155.stdout: { 2023-08-01T19:54:52.130 INFO:teuthology.orchestra.run.smithi155.stdout: "event": "throttled", 2023-08-01T19:54:52.130 INFO:teuthology.orchestra.run.smithi155.stdout: "time": "2023-08-01T19:54:51.461880+0000", 2023-08-01T19:54:52.131 INFO:teuthology.orchestra.run.smithi155.stdout: "duration": 0 2023-08-01T19:54:52.131 INFO:teuthology.orchestra.run.smithi155.stdout: }, 2023-08-01T19:54:52.131 INFO:teuthology.orchestra.run.smithi155.stdout: { 2023-08-01T19:54:52.131 INFO:teuthology.orchestra.run.smithi155.stdout: "event": "header_read", 2023-08-01T19:54:52.131 INFO:teuthology.orchestra.run.smithi155.stdout: "time": "2023-08-01T19:54:51.461879+0000", 2023-08-01T19:54:52.131 INFO:teuthology.orchestra.run.smithi155.stdout: "duration": 4294967295.999999 2023-08-01T19:54:52.132 INFO:teuthology.orchestra.run.smithi155.stdout: }, 2023-08-01T19:54:52.132 INFO:teuthology.orchestra.run.smithi155.stdout: { 2023-08-01T19:54:52.132 INFO:teuthology.orchestra.run.smithi155.stdout: "event": "all_read", 2023-08-01T19:54:52.132 INFO:teuthology.orchestra.run.smithi155.stdout: "time": "2023-08-01T19:54:51.461950+0000", 2023-08-01T19:54:52.132 INFO:teuthology.orchestra.run.smithi155.stdout: "duration": 7.1371999999999994e-05 2023-08-01T19:54:52.132 INFO:teuthology.orchestra.run.smithi155.stdout: }, 2023-08-01T19:54:52.132 INFO:teuthology.orchestra.run.smithi155.stdout: { 2023-08-01T19:54:52.132 INFO:teuthology.orchestra.run.smithi155.stdout: "event": "dispatched", 2023-08-01T19:54:52.133 INFO:teuthology.orchestra.run.smithi155.stdout: "time": "2023-08-01T19:54:51.461962+0000", 2023-08-01T19:54:52.133 INFO:teuthology.orchestra.run.smithi155.stdout: "duration": 1.2193e-05 2023-08-01T19:54:52.133 INFO:teuthology.orchestra.run.smithi155.stdout: }, 2023-08-01T19:54:52.133 INFO:teuthology.orchestra.run.smithi155.stdout: { 2023-08-01T19:54:52.133 INFO:teuthology.orchestra.run.smithi155.stdout: "event": "queued_for_pg", 2023-08-01T19:54:52.133 INFO:teuthology.orchestra.run.smithi155.stdout: "time": "2023-08-01T19:54:51.461969+0000", 2023-08-01T19:54:52.133 INFO:teuthology.orchestra.run.smithi155.stdout: "duration": 6.6880000000000002e-06 2023-08-01T19:54:52.134 INFO:teuthology.orchestra.run.smithi155.stdout: }, 2023-08-01T19:54:52.134 INFO:teuthology.orchestra.run.smithi155.stdout: { 2023-08-01T19:54:52.134 INFO:teuthology.orchestra.run.smithi155.stdout: "event": "reached_pg", 2023-08-01T19:54:52.134 INFO:teuthology.orchestra.run.smithi155.stdout: "time": "2023-08-01T19:54:51.462013+0000", 2023-08-01T19:54:52.134 INFO:teuthology.orchestra.run.smithi155.stdout: "duration": 4.4227999999999997e-05 2023-08-01T19:54:52.134 INFO:teuthology.orchestra.run.smithi155.stdout: }, 2023-08-01T19:54:52.134 INFO:teuthology.orchestra.run.smithi155.stdout: { 2023-08-01T19:54:52.135 INFO:teuthology.orchestra.run.smithi155.stdout: "event": "started", 2023-08-01T19:54:52.135 INFO:teuthology.orchestra.run.smithi155.stdout: "time": "2023-08-01T19:54:51.462144+0000", 2023-08-01T19:54:52.135 INFO:teuthology.orchestra.run.smithi155.stdout: "duration": 0.000130545 2023-08-01T19:54:52.135 INFO:teuthology.orchestra.run.smithi155.stdout: }, 2023-08-01T19:54:52.135 INFO:teuthology.orchestra.run.smithi155.stdout: { 2023-08-01T19:54:52.135 INFO:teuthology.orchestra.run.smithi155.stdout: "event": "waiting for subops from 0", 2023-08-01T19:54:52.135 INFO:teuthology.orchestra.run.smithi155.stdout: "time": "2023-08-01T19:54:51.462334+0000", 2023-08-01T19:54:52.136 INFO:teuthology.orchestra.run.smithi155.stdout: "duration": 0.00019000000000000001 2023-08-01T19:54:52.136 INFO:teuthology.orchestra.run.smithi155.stdout: }, 2023-08-01T19:54:52.136 INFO:teuthology.orchestra.run.smithi155.stdout: { 2023-08-01T19:54:52.136 INFO:teuthology.orchestra.run.smithi155.stdout: "event": "sub_op_commit_rec", 2023-08-01T19:54:52.136 INFO:teuthology.orchestra.run.smithi155.stdout: "time": "2023-08-01T19:54:51.470224+0000", 2023-08-01T19:54:52.136 INFO:teuthology.orchestra.run.smithi155.stdout: "duration": 0.0078904000000000005 2023-08-01T19:54:52.136 INFO:teuthology.orchestra.run.smithi155.stdout: }, 2023-08-01T19:54:52.136 INFO:teuthology.orchestra.run.smithi155.stdout: { 2023-08-01T19:54:52.137 INFO:teuthology.orchestra.run.smithi155.stdout: "event": "op_commit", 2023-08-01T19:54:52.137 INFO:teuthology.orchestra.run.smithi155.stdout: "time": "2023-08-01T19:54:51.482650+0000", 2023-08-01T19:54:52.137 INFO:teuthology.orchestra.run.smithi155.stdout: "duration": 0.012425607 2023-08-01T19:54:52.137 INFO:teuthology.orchestra.run.smithi155.stdout: }, 2023-08-01T19:54:52.137 INFO:teuthology.orchestra.run.smithi155.stdout: { 2023-08-01T19:54:52.137 INFO:teuthology.orchestra.run.smithi155.stdout: "event": "commit_sent", 2023-08-01T19:54:52.137 INFO:teuthology.orchestra.run.smithi155.stdout: "time": "2023-08-01T19:54:51.482692+0000", 2023-08-01T19:54:52.138 INFO:teuthology.orchestra.run.smithi155.stdout: "duration": 4.1844000000000001e-05 2023-08-01T19:54:52.138 INFO:teuthology.orchestra.run.smithi155.stdout: }, 2023-08-01T19:54:52.138 INFO:teuthology.orchestra.run.smithi155.stdout: { 2023-08-01T19:54:52.138 INFO:teuthology.orchestra.run.smithi155.stdout: "event": "done", 2023-08-01T19:54:52.138 INFO:teuthology.orchestra.run.smithi155.stdout: "time": "2023-08-01T19:54:51.482730+0000", 2023-08-01T19:54:52.138 INFO:teuthology.orchestra.run.smithi155.stdout: "duration": 3.8223000000000003e-05 2023-08-01T19:54:52.138 INFO:teuthology.orchestra.run.smithi155.stdout: } 2023-08-01T19:54:52.138 INFO:teuthology.orchestra.run.smithi155.stdout: ] 2023-08-01T19:54:52.139 INFO:teuthology.orchestra.run.smithi155.stdout: } 2023-08-01T19:54:52.139 INFO:teuthology.orchestra.run.smithi155.stdout: }, 2023-08-01T19:54:52.139 INFO:teuthology.orchestra.run.smithi155.stdout: { 2023-08-01T19:54:52.139 INFO:teuthology.orchestra.run.smithi155.stdout: "description": "osd_op(client.4668.0:73461 5.8 5:1836657a:::benchmark_data_smithi006_114134_object73460:head [set-alloc-hint object_size 65536 write_size 65536,write 0~65536] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e31)", 2023-08-01T19:54:52.139 INFO:teuthology.orchestra.run.smithi155.stdout: "initiated_at": "2023-08-01T19:54:51.463336+0000", 2023-08-01T19:54:52.139 INFO:teuthology.orchestra.run.smithi155.stdout: "age": 0.52932577199999997, 2023-08-01T19:54:52.139 INFO:teuthology.orchestra.run.smithi155.stdout: "duration": 0.022268217, 2023-08-01T19:54:52.140 INFO:teuthology.orchestra.run.smithi155.stdout: "type_data": { 2023-08-01T19:54:52.140 INFO:teuthology.orchestra.run.smithi155.stdout: "flag_point": "commit sent; apply or cleanup", 2023-08-01T19:54:52.140 INFO:teuthology.orchestra.run.smithi155.stdout: "client_info": { 2023-08-01T19:54:52.140 INFO:teuthology.orchestra.run.smithi155.stdout: "client": "client.4668", 2023-08-01T19:54:52.140 INFO:teuthology.orchestra.run.smithi155.stdout: "client_addr": "172.21.15.6:0/1709472247", 2023-08-01T19:54:52.140 INFO:teuthology.orchestra.run.smithi155.stdout: "tid": 73461 2023-08-01T19:54:52.140 INFO:teuthology.orchestra.run.smithi155.stdout: }, 2023-08-01T19:54:52.140 INFO:teuthology.orchestra.run.smithi155.stdout: "events": [ 2023-08-01T19:54:52.141 INFO:teuthology.orchestra.run.smithi155.stdout: { 2023-08-01T19:54:52.141 INFO:teuthology.orchestra.run.smithi155.stdout: "event": "initiated", 2023-08-01T19:54:52.141 INFO:teuthology.orchestra.run.smithi155.stdout: "time": "2023-08-01T19:54:51.463336+0000", 2023-08-01T19:54:52.141 INFO:teuthology.orchestra.run.smithi155.stdout: "duration": 0 2023-08-01T19:54:52.141 INFO:teuthology.orchestra.run.smithi155.stdout: }, 2023-08-01T19:54:52.141 INFO:teuthology.orchestra.run.smithi155.stdout: { 2023-08-01T19:54:52.141 INFO:teuthology.orchestra.run.smithi155.stdout: "event": "throttled", 2023-08-01T19:54:52.142 INFO:teuthology.orchestra.run.smithi155.stdout: "time": "2023-08-01T19:54:51.463336+0000", 2023-08-01T19:54:52.142 INFO:teuthology.orchestra.run.smithi155.stdout: "duration": 0 2023-08-01T19:54:52.142 INFO:teuthology.orchestra.run.smithi155.stdout: }, 2023-08-01T19:54:52.142 INFO:teuthology.orchestra.run.smithi155.stdout: { 2023-08-01T19:54:52.142 INFO:teuthology.orchestra.run.smithi155.stdout: "event": "header_read", 2023-08-01T19:54:52.142 INFO:teuthology.orchestra.run.smithi155.stdout: "time": "2023-08-01T19:54:51.463335+0000", 2023-08-01T19:54:52.142 INFO:teuthology.orchestra.run.smithi155.stdout: "duration": 4294967295.999999 2023-08-01T19:54:52.142 INFO:teuthology.orchestra.run.smithi155.stdout: }, 2023-08-01T19:54:52.143 INFO:teuthology.orchestra.run.smithi155.stdout: { 2023-08-01T19:54:52.143 INFO:teuthology.orchestra.run.smithi155.stdout: "event": "all_read", 2023-08-01T19:54:52.143 INFO:teuthology.orchestra.run.smithi155.stdout: "time": "2023-08-01T19:54:51.463437+0000", 2023-08-01T19:54:52.143 INFO:teuthology.orchestra.run.smithi155.stdout: "duration": 0.00010173700000000001 2023-08-01T19:54:52.143 INFO:teuthology.orchestra.run.smithi155.stdout: }, 2023-08-01T19:54:52.143 INFO:teuthology.orchestra.run.smithi155.stdout: { 2023-08-01T19:54:52.143 INFO:teuthology.orchestra.run.smithi155.stdout: "event": "dispatched", 2023-08-01T19:54:52.144 INFO:teuthology.orchestra.run.smithi155.stdout: "time": "2023-08-01T19:54:51.463448+0000", 2023-08-01T19:54:52.144 INFO:teuthology.orchestra.run.smithi155.stdout: "duration": 1.171e-05 2023-08-01T19:54:52.144 INFO:teuthology.orchestra.run.smithi155.stdout: }, 2023-08-01T19:54:52.144 INFO:teuthology.orchestra.run.smithi155.stdout: { 2023-08-01T19:54:52.144 INFO:teuthology.orchestra.run.smithi155.stdout: "event": "queued_for_pg", 2023-08-01T19:54:52.144 INFO:teuthology.orchestra.run.smithi155.stdout: "time": "2023-08-01T19:54:51.463454+0000", 2023-08-01T19:54:52.144 INFO:teuthology.orchestra.run.smithi155.stdout: "duration": 6.0959999999999997e-06 2023-08-01T19:54:52.144 INFO:teuthology.orchestra.run.smithi155.stdout: }, 2023-08-01T19:54:52.145 INFO:teuthology.orchestra.run.smithi155.stdout: { 2023-08-01T19:54:52.145 INFO:teuthology.orchestra.run.smithi155.stdout: "event": "reached_pg", 2023-08-01T19:54:52.145 INFO:teuthology.orchestra.run.smithi155.stdout: "time": "2023-08-01T19:54:51.463491+0000", 2023-08-01T19:54:52.145 INFO:teuthology.orchestra.run.smithi155.stdout: "duration": 3.6365999999999997e-05 2023-08-01T19:54:52.145 INFO:teuthology.orchestra.run.smithi155.stdout: }, 2023-08-01T19:54:52.145 INFO:teuthology.orchestra.run.smithi155.stdout: { 2023-08-01T19:54:52.145 INFO:teuthology.orchestra.run.smithi155.stdout: "event": "started", 2023-08-01T19:54:52.145 INFO:teuthology.orchestra.run.smithi155.stdout: "time": "2023-08-01T19:54:51.463610+0000", 2023-08-01T19:54:52.146 INFO:teuthology.orchestra.run.smithi155.stdout: "duration": 0.000119517 2023-08-01T19:54:52.146 INFO:teuthology.orchestra.run.smithi155.stdout: }, 2023-08-01T19:54:52.146 INFO:teuthology.orchestra.run.smithi155.stdout: { 2023-08-01T19:54:52.146 INFO:teuthology.orchestra.run.smithi155.stdout: "event": "waiting for subops from 0", 2023-08-01T19:54:52.146 INFO:teuthology.orchestra.run.smithi155.stdout: "time": "2023-08-01T19:54:51.463746+0000", 2023-08-01T19:54:52.146 INFO:teuthology.orchestra.run.smithi155.stdout: "duration": 0.000136179 2023-08-01T19:54:52.146 INFO:teuthology.orchestra.run.smithi155.stdout: }, 2023-08-01T19:54:52.146 INFO:teuthology.orchestra.run.smithi155.stdout: { 2023-08-01T19:54:52.147 INFO:teuthology.orchestra.run.smithi155.stdout: "event": "sub_op_commit_rec", 2023-08-01T19:54:52.147 INFO:teuthology.orchestra.run.smithi155.stdout: "time": "2023-08-01T19:54:51.480388+0000", 2023-08-01T19:54:52.147 INFO:teuthology.orchestra.run.smithi155.stdout: "duration": 0.016641810999999999 2023-08-01T19:54:52.147 INFO:teuthology.orchestra.run.smithi155.stdout: }, 2023-08-01T19:54:52.147 INFO:teuthology.orchestra.run.smithi155.stdout: { 2023-08-01T19:54:52.147 INFO:teuthology.orchestra.run.smithi155.stdout: "event": "op_commit", 2023-08-01T19:54:52.147 INFO:teuthology.orchestra.run.smithi155.stdout: "time": "2023-08-01T19:54:51.485526+0000", 2023-08-01T19:54:52.148 INFO:teuthology.orchestra.run.smithi155.stdout: "duration": 0.0051382759999999998 2023-08-01T19:54:52.148 INFO:teuthology.orchestra.run.smithi155.stdout: }, 2023-08-01T19:54:52.148 INFO:teuthology.orchestra.run.smithi155.stdout: { 2023-08-01T19:54:52.148 INFO:teuthology.orchestra.run.smithi155.stdout: "event": "commit_sent", 2023-08-01T19:54:52.148 INFO:teuthology.orchestra.run.smithi155.stdout: "time": "2023-08-01T19:54:51.485569+0000", 2023-08-01T19:54:52.148 INFO:teuthology.orchestra.run.smithi155.stdout: "duration": 4.2840999999999999e-05 2023-08-01T19:54:52.148 INFO:teuthology.orchestra.run.smithi155.stdout: }, 2023-08-01T19:54:52.149 INFO:teuthology.orchestra.run.smithi155.stdout: { 2023-08-01T19:54:52.149 INFO:teuthology.orchestra.run.smithi155.stdout: "event": "done", 2023-08-01T19:54:52.149 INFO:teuthology.orchestra.run.smithi155.stdout: "time": "2023-08-01T19:54:51.485604+0000", 2023-08-01T19:54:52.149 INFO:teuthology.orchestra.run.smithi155.stdout: "duration": 3.4731999999999999e-05 2023-08-01T19:54:52.149 INFO:teuthology.orchestra.run.smithi155.stdout: } 2023-08-01T19:54:52.149 INFO:teuthology.orchestra.run.smithi155.stdout: ] 2023-08-01T19:54:52.149 INFO:teuthology.orchestra.run.smithi155.stdout: } 2023-08-01T19:54:52.150 INFO:teuthology.orchestra.run.smithi155.stdout: }, 2023-08-01T19:54:52.150 INFO:teuthology.orchestra.run.smithi155.stdout: { 2023-08-01T19:54:52.150 INFO:teuthology.orchestra.run.smithi155.stdout: "description": "osd_repop(client.4668.0:73460 5.f e31/19 5:ff4f0704:::benchmark_data_smithi006_114134_object73459:head v 31'4631, mlcod=31'4629)", 2023-08-01T19:54:52.150 INFO:teuthology.orchestra.run.smithi155.stdout: "initiated_at": "2023-08-01T19:54:51.463349+0000", 2023-08-01T19:54:52.150 INFO:teuthology.orchestra.run.smithi155.stdout: "age": 0.52931250699999999, 2023-08-01T19:54:52.150 INFO:teuthology.orchestra.run.smithi155.stdout: "duration": 0.019357510000000001, 2023-08-01T19:54:52.150 INFO:teuthology.orchestra.run.smithi155.stdout: "type_data": { 2023-08-01T19:54:52.150 INFO:teuthology.orchestra.run.smithi155.stdout: "flag_point": "commit sent; apply or cleanup", 2023-08-01T19:54:52.151 INFO:teuthology.orchestra.run.smithi155.stdout: "events": [ 2023-08-01T19:54:52.151 INFO:teuthology.orchestra.run.smithi155.stdout: { 2023-08-01T19:54:52.151 INFO:teuthology.orchestra.run.smithi155.stdout: "event": "initiated", 2023-08-01T19:54:52.151 INFO:teuthology.orchestra.run.smithi155.stdout: "time": "2023-08-01T19:54:51.463349+0000", 2023-08-01T19:54:52.151 INFO:teuthology.orchestra.run.smithi155.stdout: "duration": 0 2023-08-01T19:54:52.151 INFO:teuthology.orchestra.run.smithi155.stdout: }, 2023-08-01T19:54:52.152 INFO:teuthology.orchestra.run.smithi155.stdout: { 2023-08-01T19:54:52.152 INFO:teuthology.orchestra.run.smithi155.stdout: "event": "throttled", 2023-08-01T19:54:52.152 INFO:teuthology.orchestra.run.smithi155.stdout: "time": "2023-08-01T19:54:51.463349+0000", 2023-08-01T19:54:52.152 INFO:teuthology.orchestra.run.smithi155.stdout: "duration": 0 2023-08-01T19:54:52.152 INFO:teuthology.orchestra.run.smithi155.stdout: }, 2023-08-01T19:54:52.152 INFO:teuthology.orchestra.run.smithi155.stdout: { 2023-08-01T19:54:52.152 INFO:teuthology.orchestra.run.smithi155.stdout: "event": "header_read", 2023-08-01T19:54:52.153 INFO:teuthology.orchestra.run.smithi155.stdout: "time": "2023-08-01T19:54:51.463349+0000", 2023-08-01T19:54:52.153 INFO:teuthology.orchestra.run.smithi155.stdout: "duration": 4294967295.9999995 2023-08-01T19:54:52.153 INFO:teuthology.orchestra.run.smithi155.stdout: }, 2023-08-01T19:54:52.153 INFO:teuthology.orchestra.run.smithi155.stdout: { 2023-08-01T19:54:52.153 INFO:teuthology.orchestra.run.smithi155.stdout: "event": "all_read", 2023-08-01T19:54:52.153 INFO:teuthology.orchestra.run.smithi155.stdout: "time": "2023-08-01T19:54:51.463482+0000", 2023-08-01T19:54:52.153 INFO:teuthology.orchestra.run.smithi155.stdout: "duration": 0.00013323 2023-08-01T19:54:52.154 INFO:teuthology.orchestra.run.smithi155.stdout: }, 2023-08-01T19:54:52.154 INFO:teuthology.orchestra.run.smithi155.stdout: { 2023-08-01T19:54:52.154 INFO:teuthology.orchestra.run.smithi155.stdout: "event": "dispatched", 2023-08-01T19:54:52.154 INFO:teuthology.orchestra.run.smithi155.stdout: "time": "2023-08-01T19:54:51.463490+0000", 2023-08-01T19:54:52.154 INFO:teuthology.orchestra.run.smithi155.stdout: "duration": 7.6869999999999994e-06 2023-08-01T19:54:52.154 INFO:teuthology.orchestra.run.smithi155.stdout: }, 2023-08-01T19:54:52.154 INFO:teuthology.orchestra.run.smithi155.stdout: { 2023-08-01T19:54:52.154 INFO:teuthology.orchestra.run.smithi155.stdout: "event": "queued_for_pg", 2023-08-01T19:54:52.155 INFO:teuthology.orchestra.run.smithi155.stdout: "time": "2023-08-01T19:54:51.463494+0000", 2023-08-01T19:54:52.155 INFO:teuthology.orchestra.run.smithi155.stdout: "duration": 4.5220000000000001e-06 2023-08-01T19:54:52.155 INFO:teuthology.orchestra.run.smithi155.stdout: }, 2023-08-01T19:54:52.155 INFO:teuthology.orchestra.run.smithi155.stdout: { 2023-08-01T19:54:52.155 INFO:teuthology.orchestra.run.smithi155.stdout: "event": "reached_pg", 2023-08-01T19:54:52.155 INFO:teuthology.orchestra.run.smithi155.stdout: "time": "2023-08-01T19:54:51.463864+0000", 2023-08-01T19:54:52.155 INFO:teuthology.orchestra.run.smithi155.stdout: "duration": 0.00036956700000000001 2023-08-01T19:54:52.156 INFO:teuthology.orchestra.run.smithi155.stdout: }, 2023-08-01T19:54:52.156 INFO:teuthology.orchestra.run.smithi155.stdout: { 2023-08-01T19:54:52.156 INFO:teuthology.orchestra.run.smithi155.stdout: "event": "started", 2023-08-01T19:54:52.156 INFO:teuthology.orchestra.run.smithi155.stdout: "time": "2023-08-01T19:54:51.463884+0000", 2023-08-01T19:54:52.156 INFO:teuthology.orchestra.run.smithi155.stdout: "duration": 2.0029000000000001e-05 2023-08-01T19:54:52.156 INFO:teuthology.orchestra.run.smithi155.stdout: }, 2023-08-01T19:54:52.156 INFO:teuthology.orchestra.run.smithi155.stdout: { 2023-08-01T19:54:52.157 INFO:teuthology.orchestra.run.smithi155.stdout: "event": "commit_sent", 2023-08-01T19:54:52.157 INFO:teuthology.orchestra.run.smithi155.stdout: "time": "2023-08-01T19:54:51.482669+0000", 2023-08-01T19:54:52.157 INFO:teuthology.orchestra.run.smithi155.stdout: "duration": 0.018784896999999998 2023-08-01T19:54:52.157 INFO:teuthology.orchestra.run.smithi155.stdout: }, 2023-08-01T19:54:52.157 INFO:teuthology.orchestra.run.smithi155.stdout: { 2023-08-01T19:54:52.157 INFO:teuthology.orchestra.run.smithi155.stdout: "event": "done", 2023-08-01T19:54:52.157 INFO:teuthology.orchestra.run.smithi155.stdout: "time": "2023-08-01T19:54:51.482707+0000", 2023-08-01T19:54:52.157 INFO:teuthology.orchestra.run.smithi155.stdout: "duration": 3.7928e-05 2023-08-01T19:54:52.158 INFO:teuthology.orchestra.run.smithi155.stdout: } 2023-08-01T19:54:52.158 INFO:teuthology.orchestra.run.smithi155.stdout: ] 2023-08-01T19:54:52.158 INFO:teuthology.orchestra.run.smithi155.stdout: } 2023-08-01T19:54:52.158 INFO:teuthology.orchestra.run.smithi155.stdout: }, 2023-08-01T19:54:52.158 INFO:teuthology.orchestra.run.smithi155.stdout: { 2023-08-01T19:54:52.158 INFO:teuthology.orchestra.run.smithi155.stdout: "description": "osd_op(client.4668.0:73462 5.0 5:01d74876:::benchmark_data_smithi006_114134_object73461:head [set-alloc-hint object_size 65536 write_size 65536,write 0~65536] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e31)", 2023-08-01T19:54:52.158 INFO:teuthology.orchestra.run.smithi155.stdout: "initiated_at": "2023-08-01T19:54:51.463648+0000", 2023-08-01T19:54:52.159 INFO:teuthology.orchestra.run.smithi155.stdout: "age": 0.529014074, 2023-08-01T19:54:52.159 INFO:teuthology.orchestra.run.smithi155.stdout: "duration": 0.021868533999999999, 2023-08-01T19:54:52.159 INFO:teuthology.orchestra.run.smithi155.stdout: "type_data": { 2023-08-01T19:54:52.159 INFO:teuthology.orchestra.run.smithi155.stdout: "flag_point": "commit sent; apply or cleanup", 2023-08-01T19:54:52.159 INFO:teuthology.orchestra.run.smithi155.stdout: "client_info": { 2023-08-01T19:54:52.159 INFO:teuthology.orchestra.run.smithi155.stdout: "client": "client.4668", 2023-08-01T19:54:52.159 INFO:teuthology.orchestra.run.smithi155.stdout: "client_addr": "172.21.15.6:0/1709472247", 2023-08-01T19:54:52.160 INFO:teuthology.orchestra.run.smithi155.stdout: "tid": 73462 2023-08-01T19:54:52.160 INFO:teuthology.orchestra.run.smithi155.stdout: }, 2023-08-01T19:54:52.160 INFO:teuthology.orchestra.run.smithi155.stdout: "events": [ 2023-08-01T19:54:52.160 INFO:teuthology.orchestra.run.smithi155.stdout: { 2023-08-01T19:54:52.160 INFO:teuthology.orchestra.run.smithi155.stdout: "event": "initiated", 2023-08-01T19:54:52.160 INFO:teuthology.orchestra.run.smithi155.stdout: "time": "2023-08-01T19:54:51.463648+0000", 2023-08-01T19:54:52.160 INFO:teuthology.orchestra.run.smithi155.stdout: "duration": 0 2023-08-01T19:54:52.161 INFO:teuthology.orchestra.run.smithi155.stdout: }, 2023-08-01T19:54:52.161 INFO:teuthology.orchestra.run.smithi155.stdout: { 2023-08-01T19:54:52.161 INFO:teuthology.orchestra.run.smithi155.stdout: "event": "throttled", 2023-08-01T19:54:52.161 INFO:teuthology.orchestra.run.smithi155.stdout: "time": "2023-08-01T19:54:51.463648+0000", 2023-08-01T19:54:52.161 INFO:teuthology.orchestra.run.smithi155.stdout: "duration": 0 2023-08-01T19:54:52.161 INFO:teuthology.orchestra.run.smithi155.stdout: }, 2023-08-01T19:54:52.161 INFO:teuthology.orchestra.run.smithi155.stdout: { 2023-08-01T19:54:52.161 INFO:teuthology.orchestra.run.smithi155.stdout: "event": "header_read", 2023-08-01T19:54:52.162 INFO:teuthology.orchestra.run.smithi155.stdout: "time": "2023-08-01T19:54:51.463646+0000", 2023-08-01T19:54:52.162 INFO:teuthology.orchestra.run.smithi155.stdout: "duration": 4294967295.999999 2023-08-01T19:54:52.162 INFO:teuthology.orchestra.run.smithi155.stdout: }, 2023-08-01T19:54:52.162 INFO:teuthology.orchestra.run.smithi155.stdout: { 2023-08-01T19:54:52.162 INFO:teuthology.orchestra.run.smithi155.stdout: "event": "all_read", 2023-08-01T19:54:52.162 INFO:teuthology.orchestra.run.smithi155.stdout: "time": "2023-08-01T19:54:51.463706+0000", 2023-08-01T19:54:52.162 INFO:teuthology.orchestra.run.smithi155.stdout: "duration": 6.0010000000000003e-05 2023-08-01T19:54:52.163 INFO:teuthology.orchestra.run.smithi155.stdout: }, 2023-08-01T19:54:52.163 INFO:teuthology.orchestra.run.smithi155.stdout: { 2023-08-01T19:54:52.163 INFO:teuthology.orchestra.run.smithi155.stdout: "event": "dispatched", 2023-08-01T19:54:52.163 INFO:teuthology.orchestra.run.smithi155.stdout: "time": "2023-08-01T19:54:51.463715+0000", 2023-08-01T19:54:52.163 INFO:teuthology.orchestra.run.smithi155.stdout: "duration": 8.5089999999999993e-06 2023-08-01T19:54:52.163 INFO:teuthology.orchestra.run.smithi155.stdout: }, 2023-08-01T19:54:52.163 INFO:teuthology.orchestra.run.smithi155.stdout: { 2023-08-01T19:54:52.163 INFO:teuthology.orchestra.run.smithi155.stdout: "event": "queued_for_pg", 2023-08-01T19:54:52.164 INFO:teuthology.orchestra.run.smithi155.stdout: "time": "2023-08-01T19:54:51.463720+0000", 2023-08-01T19:54:52.164 INFO:teuthology.orchestra.run.smithi155.stdout: "duration": 4.95e-06 2023-08-01T19:54:52.164 INFO:teuthology.orchestra.run.smithi155.stdout: }, 2023-08-01T19:54:52.164 INFO:teuthology.orchestra.run.smithi155.stdout: { 2023-08-01T19:54:52.164 INFO:teuthology.orchestra.run.smithi155.stdout: "event": "reached_pg", 2023-08-01T19:54:52.164 INFO:teuthology.orchestra.run.smithi155.stdout: "time": "2023-08-01T19:54:51.468441+0000", 2023-08-01T19:54:52.164 INFO:teuthology.orchestra.run.smithi155.stdout: "duration": 0.0047213819999999997 2023-08-01T19:54:52.165 INFO:teuthology.orchestra.run.smithi155.stdout: }, 2023-08-01T19:54:52.165 INFO:teuthology.orchestra.run.smithi155.stdout: { 2023-08-01T19:54:52.165 INFO:teuthology.orchestra.run.smithi155.stdout: "event": "started", 2023-08-01T19:54:52.165 INFO:teuthology.orchestra.run.smithi155.stdout: "time": "2023-08-01T19:54:51.468553+0000", 2023-08-01T19:54:52.165 INFO:teuthology.orchestra.run.smithi155.stdout: "duration": 0.000111462 2023-08-01T19:54:52.165 INFO:teuthology.orchestra.run.smithi155.stdout: }, 2023-08-01T19:54:52.165 INFO:teuthology.orchestra.run.smithi155.stdout: { 2023-08-01T19:54:52.166 INFO:teuthology.orchestra.run.smithi155.stdout: "event": "waiting for subops from 0", 2023-08-01T19:54:52.166 INFO:teuthology.orchestra.run.smithi155.stdout: "time": "2023-08-01T19:54:51.468697+0000", 2023-08-01T19:54:52.166 INFO:teuthology.orchestra.run.smithi155.stdout: "duration": 0.000144411 2023-08-01T19:54:52.166 INFO:teuthology.orchestra.run.smithi155.stdout: }, 2023-08-01T19:54:52.166 INFO:teuthology.orchestra.run.smithi155.stdout: { 2023-08-01T19:54:52.166 INFO:teuthology.orchestra.run.smithi155.stdout: "event": "sub_op_commit_rec", 2023-08-01T19:54:52.166 INFO:teuthology.orchestra.run.smithi155.stdout: "time": "2023-08-01T19:54:51.480377+0000", 2023-08-01T19:54:52.166 INFO:teuthology.orchestra.run.smithi155.stdout: "duration": 0.011680106000000001 2023-08-01T19:54:52.167 INFO:teuthology.orchestra.run.smithi155.stdout: }, 2023-08-01T19:54:52.167 INFO:teuthology.orchestra.run.smithi155.stdout: { 2023-08-01T19:54:52.167 INFO:teuthology.orchestra.run.smithi155.stdout: "event": "op_commit", 2023-08-01T19:54:52.167 INFO:teuthology.orchestra.run.smithi155.stdout: "time": "2023-08-01T19:54:51.485427+0000", 2023-08-01T19:54:52.167 INFO:teuthology.orchestra.run.smithi155.stdout: "duration": 0.005049998 2023-08-01T19:54:52.167 INFO:teuthology.orchestra.run.smithi155.stdout: }, 2023-08-01T19:54:52.167 INFO:teuthology.orchestra.run.smithi155.stdout: { 2023-08-01T19:54:52.167 INFO:teuthology.orchestra.run.smithi155.stdout: "event": "commit_sent", 2023-08-01T19:54:52.168 INFO:teuthology.orchestra.run.smithi155.stdout: "time": "2023-08-01T19:54:51.485485+0000", 2023-08-01T19:54:52.168 INFO:teuthology.orchestra.run.smithi155.stdout: "duration": 5.8199999999999998e-05 2023-08-01T19:54:52.168 INFO:teuthology.orchestra.run.smithi155.stdout: }, 2023-08-01T19:54:52.168 INFO:teuthology.orchestra.run.smithi155.stdout: { 2023-08-01T19:54:52.168 INFO:teuthology.orchestra.run.smithi155.stdout: "event": "done", 2023-08-01T19:54:52.168 INFO:teuthology.orchestra.run.smithi155.stdout: "time": "2023-08-01T19:54:51.485516+0000", 2023-08-01T19:54:52.168 INFO:teuthology.orchestra.run.smithi155.stdout: "duration": 3.0602999999999998e-05 2023-08-01T19:54:52.168 INFO:teuthology.orchestra.run.smithi155.stdout: } 2023-08-01T19:54:52.169 INFO:teuthology.orchestra.run.smithi155.stdout: ] 2023-08-01T19:54:52.169 INFO:teuthology.orchestra.run.smithi155.stdout: } 2023-08-01T19:54:52.169 INFO:teuthology.orchestra.run.smithi155.stdout: }, 2023-08-01T19:54:52.169 INFO:teuthology.orchestra.run.smithi155.stdout: { 2023-08-01T19:54:52.169 INFO:teuthology.orchestra.run.smithi155.stdout: "description": "osd_op(client.4668.0:73465 5.8 5:1617a69f:::benchmark_data_smithi006_114134_object73464:head [set-alloc-hint object_size 65536 write_size 65536,write 0~65536] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e31)", 2023-08-01T19:54:52.169 INFO:teuthology.orchestra.run.smithi155.stdout: "initiated_at": "2023-08-01T19:54:51.465724+0000", 2023-08-01T19:54:52.169 INFO:teuthology.orchestra.run.smithi155.stdout: "age": 0.52693784200000005, 2023-08-01T19:54:52.169 INFO:teuthology.orchestra.run.smithi155.stdout: "duration": 0.019964584, 2023-08-01T19:54:52.170 INFO:teuthology.orchestra.run.smithi155.stdout: "type_data": { 2023-08-01T19:54:52.170 INFO:teuthology.orchestra.run.smithi155.stdout: "flag_point": "commit sent; apply or cleanup", 2023-08-01T19:54:52.170 INFO:teuthology.orchestra.run.smithi155.stdout: "client_info": { 2023-08-01T19:54:52.170 INFO:teuthology.orchestra.run.smithi155.stdout: "client": "client.4668", 2023-08-01T19:54:52.170 INFO:teuthology.orchestra.run.smithi155.stdout: "client_addr": "172.21.15.6:0/1709472247", 2023-08-01T19:54:52.170 INFO:teuthology.orchestra.run.smithi155.stdout: "tid": 73465 2023-08-01T19:54:52.170 INFO:teuthology.orchestra.run.smithi155.stdout: }, 2023-08-01T19:54:52.170 INFO:teuthology.orchestra.run.smithi155.stdout: "events": [ 2023-08-01T19:54:52.171 INFO:teuthology.orchestra.run.smithi155.stdout: { 2023-08-01T19:54:52.171 INFO:teuthology.orchestra.run.smithi155.stdout: "event": "initiated", 2023-08-01T19:54:52.171 INFO:teuthology.orchestra.run.smithi155.stdout: "time": "2023-08-01T19:54:51.465724+0000", 2023-08-01T19:54:52.171 INFO:teuthology.orchestra.run.smithi155.stdout: "duration": 0 2023-08-01T19:54:52.171 INFO:teuthology.orchestra.run.smithi155.stdout: }, 2023-08-01T19:54:52.171 INFO:teuthology.orchestra.run.smithi155.stdout: { 2023-08-01T19:54:52.171 INFO:teuthology.orchestra.run.smithi155.stdout: "event": "throttled", 2023-08-01T19:54:52.172 INFO:teuthology.orchestra.run.smithi155.stdout: "time": "2023-08-01T19:54:51.465724+0000", 2023-08-01T19:54:52.172 INFO:teuthology.orchestra.run.smithi155.stdout: "duration": 0 2023-08-01T19:54:52.172 INFO:teuthology.orchestra.run.smithi155.stdout: }, 2023-08-01T19:54:52.172 INFO:teuthology.orchestra.run.smithi155.stdout: { 2023-08-01T19:54:52.172 INFO:teuthology.orchestra.run.smithi155.stdout: "event": "header_read", 2023-08-01T19:54:52.172 INFO:teuthology.orchestra.run.smithi155.stdout: "time": "2023-08-01T19:54:51.465723+0000", 2023-08-01T19:54:52.172 INFO:teuthology.orchestra.run.smithi155.stdout: "duration": 4294967295.9999995 2023-08-01T19:54:52.173 INFO:teuthology.orchestra.run.smithi155.stdout: }, 2023-08-01T19:54:52.173 INFO:teuthology.orchestra.run.smithi155.stdout: { 2023-08-01T19:54:52.173 INFO:teuthology.orchestra.run.smithi155.stdout: "event": "all_read", 2023-08-01T19:54:52.173 INFO:teuthology.orchestra.run.smithi155.stdout: "time": "2023-08-01T19:54:51.465868+0000", 2023-08-01T19:54:52.173 INFO:teuthology.orchestra.run.smithi155.stdout: "duration": 0.000145289 2023-08-01T19:54:52.173 INFO:teuthology.orchestra.run.smithi155.stdout: }, 2023-08-01T19:54:52.173 INFO:teuthology.orchestra.run.smithi155.stdout: { 2023-08-01T19:54:52.173 INFO:teuthology.orchestra.run.smithi155.stdout: "event": "dispatched", 2023-08-01T19:54:52.174 INFO:teuthology.orchestra.run.smithi155.stdout: "time": "2023-08-01T19:54:51.465880+0000", 2023-08-01T19:54:52.174 INFO:teuthology.orchestra.run.smithi155.stdout: "duration": 1.1378e-05 2023-08-01T19:54:52.174 INFO:teuthology.orchestra.run.smithi155.stdout: }, 2023-08-01T19:54:52.174 INFO:teuthology.orchestra.run.smithi155.stdout: { 2023-08-01T19:54:52.174 INFO:teuthology.orchestra.run.smithi155.stdout: "event": "queued_for_pg", 2023-08-01T19:54:52.174 INFO:teuthology.orchestra.run.smithi155.stdout: "time": "2023-08-01T19:54:51.465885+0000", 2023-08-01T19:54:52.174 INFO:teuthology.orchestra.run.smithi155.stdout: "duration": 4.7559999999999999e-06 2023-08-01T19:54:52.175 INFO:teuthology.orchestra.run.smithi155.stdout: }, 2023-08-01T19:54:52.175 INFO:teuthology.orchestra.run.smithi155.stdout: { 2023-08-01T19:54:52.175 INFO:teuthology.orchestra.run.smithi155.stdout: "event": "reached_pg", 2023-08-01T19:54:52.175 INFO:teuthology.orchestra.run.smithi155.stdout: "time": "2023-08-01T19:54:51.468434+0000", 2023-08-01T19:54:52.175 INFO:teuthology.orchestra.run.smithi155.stdout: "duration": 0.0025498579999999999 2023-08-01T19:54:52.175 INFO:teuthology.orchestra.run.smithi155.stdout: }, 2023-08-01T19:54:52.175 INFO:teuthology.orchestra.run.smithi155.stdout: { 2023-08-01T19:54:52.175 INFO:teuthology.orchestra.run.smithi155.stdout: "event": "started", 2023-08-01T19:54:52.176 INFO:teuthology.orchestra.run.smithi155.stdout: "time": "2023-08-01T19:54:51.468552+0000", 2023-08-01T19:54:52.176 INFO:teuthology.orchestra.run.smithi155.stdout: "duration": 0.000117992 2023-08-01T19:54:52.176 INFO:teuthology.orchestra.run.smithi155.stdout: }, 2023-08-01T19:54:52.176 INFO:teuthology.orchestra.run.smithi155.stdout: { 2023-08-01T19:54:52.176 INFO:teuthology.orchestra.run.smithi155.stdout: "event": "waiting for subops from 0", 2023-08-01T19:54:52.176 INFO:teuthology.orchestra.run.smithi155.stdout: "time": "2023-08-01T19:54:51.468697+0000", 2023-08-01T19:54:52.176 INFO:teuthology.orchestra.run.smithi155.stdout: "duration": 0.000144769 2023-08-01T19:54:52.176 INFO:teuthology.orchestra.run.smithi155.stdout: }, 2023-08-01T19:54:52.177 INFO:teuthology.orchestra.run.smithi155.stdout: { 2023-08-01T19:54:52.177 INFO:teuthology.orchestra.run.smithi155.stdout: "event": "sub_op_commit_rec", 2023-08-01T19:54:52.177 INFO:teuthology.orchestra.run.smithi155.stdout: "time": "2023-08-01T19:54:51.480446+0000", 2023-08-01T19:54:52.177 INFO:teuthology.orchestra.run.smithi155.stdout: "duration": 0.011749257000000001 2023-08-01T19:54:52.177 INFO:teuthology.orchestra.run.smithi155.stdout: }, 2023-08-01T19:54:52.177 INFO:teuthology.orchestra.run.smithi155.stdout: { 2023-08-01T19:54:52.177 INFO:teuthology.orchestra.run.smithi155.stdout: "event": "op_commit", 2023-08-01T19:54:52.177 INFO:teuthology.orchestra.run.smithi155.stdout: "time": "2023-08-01T19:54:51.485613+0000", 2023-08-01T19:54:52.178 INFO:teuthology.orchestra.run.smithi155.stdout: "duration": 0.0051662269999999998 2023-08-01T19:54:52.178 INFO:teuthology.orchestra.run.smithi155.stdout: }, 2023-08-01T19:54:52.178 INFO:teuthology.orchestra.run.smithi155.stdout: { 2023-08-01T19:54:52.178 INFO:teuthology.orchestra.run.smithi155.stdout: "event": "commit_sent", 2023-08-01T19:54:52.178 INFO:teuthology.orchestra.run.smithi155.stdout: "time": "2023-08-01T19:54:51.485655+0000", 2023-08-01T19:54:52.178 INFO:teuthology.orchestra.run.smithi155.stdout: "duration": 4.1879999999999999e-05 2023-08-01T19:54:52.179 INFO:teuthology.orchestra.run.smithi155.stdout: }, 2023-08-01T19:54:52.179 INFO:teuthology.orchestra.run.smithi155.stdout: { 2023-08-01T19:54:52.179 INFO:teuthology.orchestra.run.smithi155.stdout: "event": "done", 2023-08-01T19:54:52.179 INFO:teuthology.orchestra.run.smithi155.stdout: "time": "2023-08-01T19:54:51.485688+0000", 2023-08-01T19:54:52.179 INFO:teuthology.orchestra.run.smithi155.stdout: "duration": 3.3800999999999997e-05 2023-08-01T19:54:52.179 INFO:teuthology.orchestra.run.smithi155.stdout: } 2023-08-01T19:54:52.179 INFO:teuthology.orchestra.run.smithi155.stdout: ] 2023-08-01T19:54:52.179 INFO:teuthology.orchestra.run.smithi155.stdout: } 2023-08-01T19:54:52.180 INFO:teuthology.orchestra.run.smithi155.stdout: }, 2023-08-01T19:54:52.180 INFO:teuthology.orchestra.run.smithi155.stdout: { 2023-08-01T19:54:52.180 INFO:teuthology.orchestra.run.smithi155.stdout: "description": "osd_repop(client.4668.0:73464 5.f e31/19 5:f261eb35:::benchmark_data_smithi006_114134_object73463:head v 31'4632, mlcod=31'4629)", 2023-08-01T19:54:52.180 INFO:teuthology.orchestra.run.smithi155.stdout: "initiated_at": "2023-08-01T19:54:51.466330+0000", 2023-08-01T19:54:52.180 INFO:teuthology.orchestra.run.smithi155.stdout: "age": 0.52633139200000001, 2023-08-01T19:54:52.180 INFO:teuthology.orchestra.run.smithi155.stdout: "duration": 0.016398626999999999, 2023-08-01T19:54:52.180 INFO:teuthology.orchestra.run.smithi155.stdout: "type_data": { 2023-08-01T19:54:52.180 INFO:teuthology.orchestra.run.smithi155.stdout: "flag_point": "commit sent; apply or cleanup", 2023-08-01T19:54:52.181 INFO:teuthology.orchestra.run.smithi155.stdout: "events": [ 2023-08-01T19:54:52.181 INFO:teuthology.orchestra.run.smithi155.stdout: { 2023-08-01T19:54:52.181 INFO:teuthology.orchestra.run.smithi155.stdout: "event": "initiated", 2023-08-01T19:54:52.181 INFO:teuthology.orchestra.run.smithi155.stdout: "time": "2023-08-01T19:54:51.466330+0000", 2023-08-01T19:54:52.181 INFO:teuthology.orchestra.run.smithi155.stdout: "duration": 0 2023-08-01T19:54:52.181 INFO:teuthology.orchestra.run.smithi155.stdout: }, 2023-08-01T19:54:52.181 INFO:teuthology.orchestra.run.smithi155.stdout: { 2023-08-01T19:54:52.182 INFO:teuthology.orchestra.run.smithi155.stdout: "event": "throttled", 2023-08-01T19:54:52.182 INFO:teuthology.orchestra.run.smithi155.stdout: "time": "2023-08-01T19:54:51.466330+0000", 2023-08-01T19:54:52.182 INFO:teuthology.orchestra.run.smithi155.stdout: "duration": 0 2023-08-01T19:54:52.182 INFO:teuthology.orchestra.run.smithi155.stdout: }, 2023-08-01T19:54:52.182 INFO:teuthology.orchestra.run.smithi155.stdout: { 2023-08-01T19:54:52.182 INFO:teuthology.orchestra.run.smithi155.stdout: "event": "header_read", 2023-08-01T19:54:52.182 INFO:teuthology.orchestra.run.smithi155.stdout: "time": "2023-08-01T19:54:51.466330+0000", 2023-08-01T19:54:52.182 INFO:teuthology.orchestra.run.smithi155.stdout: "duration": 4294967295.9999995 2023-08-01T19:54:52.183 INFO:teuthology.orchestra.run.smithi155.stdout: }, 2023-08-01T19:54:52.183 INFO:teuthology.orchestra.run.smithi155.stdout: { 2023-08-01T19:54:52.183 INFO:teuthology.orchestra.run.smithi155.stdout: "event": "all_read", 2023-08-01T19:54:52.183 INFO:teuthology.orchestra.run.smithi155.stdout: "time": "2023-08-01T19:54:51.466392+0000", 2023-08-01T19:54:52.183 INFO:teuthology.orchestra.run.smithi155.stdout: "duration": 6.2136000000000003e-05 2023-08-01T19:54:52.183 INFO:teuthology.orchestra.run.smithi155.stdout: }, 2023-08-01T19:54:52.183 INFO:teuthology.orchestra.run.smithi155.stdout: { 2023-08-01T19:54:52.183 INFO:teuthology.orchestra.run.smithi155.stdout: "event": "dispatched", 2023-08-01T19:54:52.184 INFO:teuthology.orchestra.run.smithi155.stdout: "time": "2023-08-01T19:54:51.466400+0000", 2023-08-01T19:54:52.184 INFO:teuthology.orchestra.run.smithi155.stdout: "duration": 7.7589999999999997e-06 2023-08-01T19:54:52.184 INFO:teuthology.orchestra.run.smithi155.stdout: }, 2023-08-01T19:54:52.184 INFO:teuthology.orchestra.run.smithi155.stdout: { 2023-08-01T19:54:52.184 INFO:teuthology.orchestra.run.smithi155.stdout: "event": "queued_for_pg", 2023-08-01T19:54:52.184 INFO:teuthology.orchestra.run.smithi155.stdout: "time": "2023-08-01T19:54:51.466404+0000", 2023-08-01T19:54:52.184 INFO:teuthology.orchestra.run.smithi155.stdout: "duration": 4.0810000000000004e-06 2023-08-01T19:54:52.185 INFO:teuthology.orchestra.run.smithi155.stdout: }, 2023-08-01T19:54:52.185 INFO:teuthology.orchestra.run.smithi155.stdout: { 2023-08-01T19:54:52.185 INFO:teuthology.orchestra.run.smithi155.stdout: "event": "reached_pg", 2023-08-01T19:54:52.185 INFO:teuthology.orchestra.run.smithi155.stdout: "time": "2023-08-01T19:54:51.468401+0000", 2023-08-01T19:54:52.185 INFO:teuthology.orchestra.run.smithi155.stdout: "duration": 0.0019972850000000001 2023-08-01T19:54:52.185 INFO:teuthology.orchestra.run.smithi155.stdout: }, 2023-08-01T19:54:52.185 INFO:teuthology.orchestra.run.smithi155.stdout: { 2023-08-01T19:54:52.185 INFO:teuthology.orchestra.run.smithi155.stdout: "event": "started", 2023-08-01T19:54:52.186 INFO:teuthology.orchestra.run.smithi155.stdout: "time": "2023-08-01T19:54:51.468420+0000", 2023-08-01T19:54:52.186 INFO:teuthology.orchestra.run.smithi155.stdout: "duration": 1.8717000000000001e-05 2023-08-01T19:54:52.186 INFO:teuthology.orchestra.run.smithi155.stdout: }, 2023-08-01T19:54:52.186 INFO:teuthology.orchestra.run.smithi155.stdout: { 2023-08-01T19:54:52.186 INFO:teuthology.orchestra.run.smithi155.stdout: "event": "commit_sent", 2023-08-01T19:54:52.186 INFO:teuthology.orchestra.run.smithi155.stdout: "time": "2023-08-01T19:54:51.482709+0000", 2023-08-01T19:54:52.186 INFO:teuthology.orchestra.run.smithi155.stdout: "duration": 0.014289717 2023-08-01T19:54:52.187 INFO:teuthology.orchestra.run.smithi155.stdout: }, 2023-08-01T19:54:52.187 INFO:teuthology.orchestra.run.smithi155.stdout: { 2023-08-01T19:54:52.187 INFO:teuthology.orchestra.run.smithi155.stdout: "event": "done", 2023-08-01T19:54:52.187 INFO:teuthology.orchestra.run.smithi155.stdout: "time": "2023-08-01T19:54:51.482729+0000", 2023-08-01T19:54:52.187 INFO:teuthology.orchestra.run.smithi155.stdout: "duration": 1.944e-05 2023-08-01T19:54:52.187 INFO:teuthology.orchestra.run.smithi155.stdout: } 2023-08-01T19:54:52.187 INFO:teuthology.orchestra.run.smithi155.stdout: ] 2023-08-01T19:54:52.187 INFO:teuthology.orchestra.run.smithi155.stdout: } 2023-08-01T19:54:52.188 INFO:teuthology.orchestra.run.smithi155.stdout: }, 2023-08-01T19:54:52.188 INFO:teuthology.orchestra.run.smithi155.stdout: { 2023-08-01T19:54:52.188 INFO:teuthology.orchestra.run.smithi155.stdout: "description": "osd_op(client.4668.0:73475 5.8 5:128a44ce:::benchmark_data_smithi006_114134_object73474:head [set-alloc-hint object_size 65536 write_size 65536,write 0~65536 in=65536b] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e31)", 2023-08-01T19:54:52.188 INFO:teuthology.orchestra.run.smithi155.stdout: "initiated_at": "2023-08-01T19:54:51.476076+0000", 2023-08-01T19:54:52.188 INFO:teuthology.orchestra.run.smithi155.stdout: "age": 0.51658550400000003, 2023-08-01T19:54:52.188 INFO:teuthology.orchestra.run.smithi155.stdout: "duration": 0.015954255000000001, 2023-08-01T19:54:52.188 INFO:teuthology.orchestra.run.smithi155.stdout: "type_data": { 2023-08-01T19:54:52.189 INFO:teuthology.orchestra.run.smithi155.stdout: "flag_point": "commit sent; apply or cleanup", 2023-08-01T19:54:52.189 INFO:teuthology.orchestra.run.smithi155.stdout: "client_info": { 2023-08-01T19:54:52.189 INFO:teuthology.orchestra.run.smithi155.stdout: "client": "client.4668", 2023-08-01T19:54:52.189 INFO:teuthology.orchestra.run.smithi155.stdout: "client_addr": "172.21.15.6:0/1709472247", 2023-08-01T19:54:52.189 INFO:teuthology.orchestra.run.smithi155.stdout: "tid": 73475 2023-08-01T19:54:52.189 INFO:teuthology.orchestra.run.smithi155.stdout: }, 2023-08-01T19:54:52.189 INFO:teuthology.orchestra.run.smithi155.stdout: "events": [ 2023-08-01T19:54:52.189 INFO:teuthology.orchestra.run.smithi155.stdout: { 2023-08-01T19:54:52.190 INFO:teuthology.orchestra.run.smithi155.stdout: "event": "initiated", 2023-08-01T19:54:52.190 INFO:teuthology.orchestra.run.smithi155.stdout: "time": "2023-08-01T19:54:51.476076+0000", 2023-08-01T19:54:52.190 INFO:teuthology.orchestra.run.smithi155.stdout: "duration": 0 2023-08-01T19:54:52.190 INFO:teuthology.orchestra.run.smithi155.stdout: }, 2023-08-01T19:54:52.190 INFO:teuthology.orchestra.run.smithi155.stdout: { 2023-08-01T19:54:52.190 INFO:teuthology.orchestra.run.smithi155.stdout: "event": "throttled", 2023-08-01T19:54:52.191 INFO:teuthology.orchestra.run.smithi155.stdout: "time": "2023-08-01T19:54:51.476076+0000", 2023-08-01T19:54:52.191 INFO:teuthology.orchestra.run.smithi155.stdout: "duration": 0 2023-08-01T19:54:52.191 INFO:teuthology.orchestra.run.smithi155.stdout: }, 2023-08-01T19:54:52.191 INFO:teuthology.orchestra.run.smithi155.stdout: { 2023-08-01T19:54:52.191 INFO:teuthology.orchestra.run.smithi155.stdout: "event": "header_read", 2023-08-01T19:54:52.191 INFO:teuthology.orchestra.run.smithi155.stdout: "time": "2023-08-01T19:54:51.476075+0000", 2023-08-01T19:54:52.191 INFO:teuthology.orchestra.run.smithi155.stdout: "duration": 4294967295.999999 2023-08-01T19:54:52.192 INFO:teuthology.orchestra.run.smithi155.stdout: }, 2023-08-01T19:54:52.192 INFO:teuthology.orchestra.run.smithi155.stdout: { 2023-08-01T19:54:52.192 INFO:teuthology.orchestra.run.smithi155.stdout: "event": "all_read", 2023-08-01T19:54:52.192 INFO:teuthology.orchestra.run.smithi155.stdout: "time": "2023-08-01T19:54:51.476122+0000", 2023-08-01T19:54:52.192 INFO:teuthology.orchestra.run.smithi155.stdout: "duration": 4.7015999999999998e-05 2023-08-01T19:54:52.192 INFO:teuthology.orchestra.run.smithi155.stdout: }, 2023-08-01T19:54:52.192 INFO:teuthology.orchestra.run.smithi155.stdout: { 2023-08-01T19:54:52.192 INFO:teuthology.orchestra.run.smithi155.stdout: "event": "dispatched", 2023-08-01T19:54:52.193 INFO:teuthology.orchestra.run.smithi155.stdout: "time": "2023-08-01T19:54:51.476149+0000", 2023-08-01T19:54:52.193 INFO:teuthology.orchestra.run.smithi155.stdout: "duration": 2.7021000000000001e-05 2023-08-01T19:54:52.193 INFO:teuthology.orchestra.run.smithi155.stdout: }, 2023-08-01T19:54:52.193 INFO:teuthology.orchestra.run.smithi155.stdout: { 2023-08-01T19:54:52.193 INFO:teuthology.orchestra.run.smithi155.stdout: "event": "queued_for_pg", 2023-08-01T19:54:52.193 INFO:teuthology.orchestra.run.smithi155.stdout: "time": "2023-08-01T19:54:51.476156+0000", 2023-08-01T19:54:52.193 INFO:teuthology.orchestra.run.smithi155.stdout: "duration": 7.3309999999999998e-06 2023-08-01T19:54:52.193 INFO:teuthology.orchestra.run.smithi155.stdout: }, 2023-08-01T19:54:52.194 INFO:teuthology.orchestra.run.smithi155.stdout: { 2023-08-01T19:54:52.194 INFO:teuthology.orchestra.run.smithi155.stdout: "event": "reached_pg", 2023-08-01T19:54:52.194 INFO:teuthology.orchestra.run.smithi155.stdout: "time": "2023-08-01T19:54:51.480486+0000", 2023-08-01T19:54:52.194 INFO:teuthology.orchestra.run.smithi155.stdout: "duration": 0.0043295139999999996 2023-08-01T19:54:52.194 INFO:teuthology.orchestra.run.smithi155.stdout: }, 2023-08-01T19:54:52.194 INFO:teuthology.orchestra.run.smithi155.stdout: { 2023-08-01T19:54:52.194 INFO:teuthology.orchestra.run.smithi155.stdout: "event": "started", 2023-08-01T19:54:52.194 INFO:teuthology.orchestra.run.smithi155.stdout: "time": "2023-08-01T19:54:51.480618+0000", 2023-08-01T19:54:52.195 INFO:teuthology.orchestra.run.smithi155.stdout: "duration": 0.00013223999999999999 2023-08-01T19:54:52.195 INFO:teuthology.orchestra.run.smithi155.stdout: }, 2023-08-01T19:54:52.195 INFO:teuthology.orchestra.run.smithi155.stdout: { 2023-08-01T19:54:52.195 INFO:teuthology.orchestra.run.smithi155.stdout: "event": "waiting for subops from 0", 2023-08-01T19:54:52.195 INFO:teuthology.orchestra.run.smithi155.stdout: "time": "2023-08-01T19:54:51.480763+0000", 2023-08-01T19:54:52.195 INFO:teuthology.orchestra.run.smithi155.stdout: "duration": 0.00014507499999999999 2023-08-01T19:54:52.195 INFO:teuthology.orchestra.run.smithi155.stdout: }, 2023-08-01T19:54:52.196 INFO:teuthology.orchestra.run.smithi155.stdout: { 2023-08-01T19:54:52.196 INFO:teuthology.orchestra.run.smithi155.stdout: "event": "sub_op_commit_rec", 2023-08-01T19:54:52.196 INFO:teuthology.orchestra.run.smithi155.stdout: "time": "2023-08-01T19:54:51.488056+0000", 2023-08-01T19:54:52.196 INFO:teuthology.orchestra.run.smithi155.stdout: "duration": 0.0072928719999999997 2023-08-01T19:54:52.196 INFO:teuthology.orchestra.run.smithi155.stdout: }, 2023-08-01T19:54:52.196 INFO:teuthology.orchestra.run.smithi155.stdout: { 2023-08-01T19:54:52.197 INFO:teuthology.orchestra.run.smithi155.stdout: "event": "op_commit", 2023-08-01T19:54:52.197 INFO:teuthology.orchestra.run.smithi155.stdout: "time": "2023-08-01T19:54:51.491978+0000", 2023-08-01T19:54:52.197 INFO:teuthology.orchestra.run.smithi155.stdout: "duration": 0.003922076 2023-08-01T19:54:52.197 INFO:teuthology.orchestra.run.smithi155.stdout: }, 2023-08-01T19:54:52.197 INFO:teuthology.orchestra.run.smithi155.stdout: { 2023-08-01T19:54:52.197 INFO:teuthology.orchestra.run.smithi155.stdout: "event": "commit_sent", 2023-08-01T19:54:52.197 INFO:teuthology.orchestra.run.smithi155.stdout: "time": "2023-08-01T19:54:51.492009+0000", 2023-08-01T19:54:52.197 INFO:teuthology.orchestra.run.smithi155.stdout: "duration": 3.0830000000000001e-05 2023-08-01T19:54:52.198 INFO:teuthology.orchestra.run.smithi155.stdout: }, 2023-08-01T19:54:52.198 INFO:teuthology.orchestra.run.smithi155.stdout: { 2023-08-01T19:54:52.198 INFO:teuthology.orchestra.run.smithi155.stdout: "event": "done", 2023-08-01T19:54:52.198 INFO:teuthology.orchestra.run.smithi155.stdout: "time": "2023-08-01T19:54:51.492030+0000", 2023-08-01T19:54:52.198 INFO:teuthology.orchestra.run.smithi155.stdout: "duration": 2.1355000000000001e-05 2023-08-01T19:54:52.198 INFO:teuthology.orchestra.run.smithi155.stdout: } 2023-08-01T19:54:52.198 INFO:teuthology.orchestra.run.smithi155.stdout: ] 2023-08-01T19:54:52.198 INFO:teuthology.orchestra.run.smithi155.stdout: } 2023-08-01T19:54:52.199 INFO:teuthology.orchestra.run.smithi155.stdout: }, 2023-08-01T19:54:52.199 INFO:teuthology.orchestra.run.smithi155.stdout: { 2023-08-01T19:54:52.199 INFO:teuthology.orchestra.run.smithi155.stdout: "description": "osd_op(client.4668.0:73476 5.8 5:1bb44406:::benchmark_data_smithi006_114134_object73475:head [set-alloc-hint object_size 65536 write_size 65536,write 0~65536 in=65536b] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e31)", 2023-08-01T19:54:52.199 INFO:teuthology.orchestra.run.smithi155.stdout: "initiated_at": "2023-08-01T19:54:51.476170+0000", 2023-08-01T19:54:52.199 INFO:teuthology.orchestra.run.smithi155.stdout: "age": 0.51649172399999999, 2023-08-01T19:54:52.199 INFO:teuthology.orchestra.run.smithi155.stdout: "duration": 0.015911429000000001, 2023-08-01T19:54:52.199 INFO:teuthology.orchestra.run.smithi155.stdout: "type_data": { 2023-08-01T19:54:52.200 INFO:teuthology.orchestra.run.smithi155.stdout: "flag_point": "commit sent; apply or cleanup", 2023-08-01T19:54:52.200 INFO:teuthology.orchestra.run.smithi155.stdout: "client_info": { 2023-08-01T19:54:52.200 INFO:teuthology.orchestra.run.smithi155.stdout: "client": "client.4668", 2023-08-01T19:54:52.200 INFO:teuthology.orchestra.run.smithi155.stdout: "client_addr": "172.21.15.6:0/1709472247", 2023-08-01T19:54:52.200 INFO:teuthology.orchestra.run.smithi155.stdout: "tid": 73476 2023-08-01T19:54:52.200 INFO:teuthology.orchestra.run.smithi155.stdout: }, 2023-08-01T19:54:52.200 INFO:teuthology.orchestra.run.smithi155.stdout: "events": [ 2023-08-01T19:54:52.200 INFO:teuthology.orchestra.run.smithi155.stdout: { 2023-08-01T19:54:52.201 INFO:teuthology.orchestra.run.smithi155.stdout: "event": "initiated", 2023-08-01T19:54:52.201 INFO:teuthology.orchestra.run.smithi155.stdout: "time": "2023-08-01T19:54:51.476170+0000", 2023-08-01T19:54:52.201 INFO:teuthology.orchestra.run.smithi155.stdout: "duration": 0 2023-08-01T19:54:52.201 INFO:teuthology.orchestra.run.smithi155.stdout: }, 2023-08-01T19:54:52.201 INFO:teuthology.orchestra.run.smithi155.stdout: { 2023-08-01T19:54:52.201 INFO:teuthology.orchestra.run.smithi155.stdout: "event": "throttled", 2023-08-01T19:54:52.201 INFO:teuthology.orchestra.run.smithi155.stdout: "time": "2023-08-01T19:54:51.476170+0000", 2023-08-01T19:54:52.201 INFO:teuthology.orchestra.run.smithi155.stdout: "duration": 0 2023-08-01T19:54:52.202 INFO:teuthology.orchestra.run.smithi155.stdout: }, 2023-08-01T19:54:52.202 INFO:teuthology.orchestra.run.smithi155.stdout: { 2023-08-01T19:54:52.202 INFO:teuthology.orchestra.run.smithi155.stdout: "event": "header_read", 2023-08-01T19:54:52.202 INFO:teuthology.orchestra.run.smithi155.stdout: "time": "2023-08-01T19:54:51.476169+0000", 2023-08-01T19:54:52.202 INFO:teuthology.orchestra.run.smithi155.stdout: "duration": 4294967295.999999 2023-08-01T19:54:52.202 INFO:teuthology.orchestra.run.smithi155.stdout: }, 2023-08-01T19:54:52.202 INFO:teuthology.orchestra.run.smithi155.stdout: { 2023-08-01T19:54:52.203 INFO:teuthology.orchestra.run.smithi155.stdout: "event": "all_read", 2023-08-01T19:54:52.203 INFO:teuthology.orchestra.run.smithi155.stdout: "time": "2023-08-01T19:54:51.476225+0000", 2023-08-01T19:54:52.203 INFO:teuthology.orchestra.run.smithi155.stdout: "duration": 5.5856000000000002e-05 2023-08-01T19:54:52.203 INFO:teuthology.orchestra.run.smithi155.stdout: }, 2023-08-01T19:54:52.203 INFO:teuthology.orchestra.run.smithi155.stdout: { 2023-08-01T19:54:52.203 INFO:teuthology.orchestra.run.smithi155.stdout: "event": "dispatched", 2023-08-01T19:54:52.203 INFO:teuthology.orchestra.run.smithi155.stdout: "time": "2023-08-01T19:54:51.476236+0000", 2023-08-01T19:54:52.203 INFO:teuthology.orchestra.run.smithi155.stdout: "duration": 1.1051e-05 2023-08-01T19:54:52.204 INFO:teuthology.orchestra.run.smithi155.stdout: }, 2023-08-01T19:54:52.204 INFO:teuthology.orchestra.run.smithi155.stdout: { 2023-08-01T19:54:52.204 INFO:teuthology.orchestra.run.smithi155.stdout: "event": "queued_for_pg", 2023-08-01T19:54:52.204 INFO:teuthology.orchestra.run.smithi155.stdout: "time": "2023-08-01T19:54:51.476242+0000", 2023-08-01T19:54:52.204 INFO:teuthology.orchestra.run.smithi155.stdout: "duration": 6.161e-06 2023-08-01T19:54:52.204 INFO:teuthology.orchestra.run.smithi155.stdout: }, 2023-08-01T19:54:52.204 INFO:teuthology.orchestra.run.smithi155.stdout: { 2023-08-01T19:54:52.204 INFO:teuthology.orchestra.run.smithi155.stdout: "event": "reached_pg", 2023-08-01T19:54:52.205 INFO:teuthology.orchestra.run.smithi155.stdout: "time": "2023-08-01T19:54:51.482945+0000", 2023-08-01T19:54:52.205 INFO:teuthology.orchestra.run.smithi155.stdout: "duration": 0.0067027370000000003 2023-08-01T19:54:52.205 INFO:teuthology.orchestra.run.smithi155.stdout: }, 2023-08-01T19:54:52.205 INFO:teuthology.orchestra.run.smithi155.stdout: { 2023-08-01T19:54:52.205 INFO:teuthology.orchestra.run.smithi155.stdout: "event": "started", 2023-08-01T19:54:52.205 INFO:teuthology.orchestra.run.smithi155.stdout: "time": "2023-08-01T19:54:51.483028+0000", 2023-08-01T19:54:52.205 INFO:teuthology.orchestra.run.smithi155.stdout: "duration": 8.3218000000000002e-05 2023-08-01T19:54:52.206 INFO:teuthology.orchestra.run.smithi155.stdout: }, 2023-08-01T19:54:52.206 INFO:teuthology.orchestra.run.smithi155.stdout: { 2023-08-01T19:54:52.206 INFO:teuthology.orchestra.run.smithi155.stdout: "event": "waiting for subops from 0", 2023-08-01T19:54:52.206 INFO:teuthology.orchestra.run.smithi155.stdout: "time": "2023-08-01T19:54:51.483118+0000", 2023-08-01T19:54:52.206 INFO:teuthology.orchestra.run.smithi155.stdout: "duration": 9.0348999999999998e-05 2023-08-01T19:54:52.206 INFO:teuthology.orchestra.run.smithi155.stdout: }, 2023-08-01T19:54:52.206 INFO:teuthology.orchestra.run.smithi155.stdout: { 2023-08-01T19:54:52.206 INFO:teuthology.orchestra.run.smithi155.stdout: "event": "sub_op_commit_rec", 2023-08-01T19:54:52.207 INFO:teuthology.orchestra.run.smithi155.stdout: "time": "2023-08-01T19:54:51.488087+0000", 2023-08-01T19:54:52.207 INFO:teuthology.orchestra.run.smithi155.stdout: "duration": 0.0049684380000000004 2023-08-01T19:54:52.207 INFO:teuthology.orchestra.run.smithi155.stdout: }, 2023-08-01T19:54:52.207 INFO:teuthology.orchestra.run.smithi155.stdout: { 2023-08-01T19:54:52.207 INFO:teuthology.orchestra.run.smithi155.stdout: "event": "op_commit", 2023-08-01T19:54:52.207 INFO:teuthology.orchestra.run.smithi155.stdout: "time": "2023-08-01T19:54:51.492036+0000", 2023-08-01T19:54:52.207 INFO:teuthology.orchestra.run.smithi155.stdout: "duration": 0.0039493619999999997 2023-08-01T19:54:52.207 INFO:teuthology.orchestra.run.smithi155.stdout: }, 2023-08-01T19:54:52.208 INFO:teuthology.orchestra.run.smithi155.stdout: { 2023-08-01T19:54:52.208 INFO:teuthology.orchestra.run.smithi155.stdout: "event": "commit_sent", 2023-08-01T19:54:52.208 INFO:teuthology.orchestra.run.smithi155.stdout: "time": "2023-08-01T19:54:51.492059+0000", 2023-08-01T19:54:52.208 INFO:teuthology.orchestra.run.smithi155.stdout: "duration": 2.2441000000000001e-05 2023-08-01T19:54:52.208 INFO:teuthology.orchestra.run.smithi155.stdout: }, 2023-08-01T19:54:52.208 INFO:teuthology.orchestra.run.smithi155.stdout: { 2023-08-01T19:54:52.208 INFO:teuthology.orchestra.run.smithi155.stdout: "event": "done", 2023-08-01T19:54:52.209 INFO:teuthology.orchestra.run.smithi155.stdout: "time": "2023-08-01T19:54:51.492081+0000", 2023-08-01T19:54:52.209 INFO:teuthology.orchestra.run.smithi155.stdout: "duration": 2.2583999999999999e-05 2023-08-01T19:54:52.209 INFO:teuthology.orchestra.run.smithi155.stdout: } 2023-08-01T19:54:52.209 INFO:teuthology.orchestra.run.smithi155.stdout: ] 2023-08-01T19:54:52.209 INFO:teuthology.orchestra.run.smithi155.stdout: } 2023-08-01T19:54:52.209 INFO:teuthology.orchestra.run.smithi155.stdout: } 2023-08-01T19:54:52.209 INFO:teuthology.orchestra.run.smithi155.stdout: ] 2023-08-01T19:54:52.209 INFO:teuthology.orchestra.run.smithi155.stdout:} 2023-08-01T19:54:52.210 DEBUG:teuthology.orchestra.run.smithi006:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 120 ceph --cluster ceph -- tell 'osd.*' injectargs --osd_enable_op_tracker=false 2023-08-01T19:54:52.211 INFO:teuthology.orchestra.run.smithi006.stderr:reweighted osd.1 to 1 (10000) 2023-08-01T19:54:52.212 INFO:tasks.ceph.osd.1.smithi101.stderr:2023-08-01T19:54:52.210+0000 7fb0cb7f6700 -1 received signal: Hangup from /usr/bin/python3 /bin/daemon-helper kill ceph-osd -f --cluster ceph -i 1 (PID: 111141) UID: 0 2023-08-01T19:54:52.212 INFO:teuthology.orchestra.run.smithi006.stderr:noscrub is unset 2023-08-01T19:54:52.213 DEBUG:teuthology.orchestra.run.smithi008:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 30 ceph --cluster ceph --admin-daemon /var/run/ceph/ceph-osd.0.asok dump_ops_in_flight 2023-08-01T19:54:52.214 DEBUG:teuthology.orchestra.run.smithi006:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 120 ceph --cluster ceph osd reweight 2 1 2023-08-01T19:54:52.311 INFO:tasks.ceph.osd.0.smithi008.stderr:2023-08-01T19:54:52.310+0000 7f16a58f4700 -1 received signal: Hangup from /usr/bin/python3 /bin/daemon-helper kill ceph-osd -f --cluster ceph -i 0 (PID: 111179) UID: 0 2023-08-01T19:54:52.314 INFO:tasks.radosbench.radosbench.0.smithi006.stdout: 28 16 75178 75162 167.759 126.688 0.00643918 0.00595794 2023-08-01T19:54:52.402 INFO:teuthology.orchestra.run.smithi008.stdout:{ 2023-08-01T19:54:52.402 INFO:teuthology.orchestra.run.smithi008.stdout: "ops": [ 2023-08-01T19:54:52.402 INFO:teuthology.orchestra.run.smithi008.stdout: { 2023-08-01T19:54:52.403 INFO:teuthology.orchestra.run.smithi008.stdout: "description": "osd_repop(client.4668.0:75323 5.1 e32/19 5:8571da78:::benchmark_data_smithi006_114134_object75322:head v 32'4699, mlcod=32'4697)", 2023-08-01T19:54:52.403 INFO:teuthology.orchestra.run.smithi008.stdout: "initiated_at": "2023-08-01T19:54:52.393920+0000", 2023-08-01T19:54:52.403 INFO:teuthology.orchestra.run.smithi008.stdout: "age": 0.0065259979999999999, 2023-08-01T19:54:52.403 INFO:teuthology.orchestra.run.smithi008.stdout: "duration": 0.0065492079999999999, 2023-08-01T19:54:52.403 INFO:teuthology.orchestra.run.smithi008.stdout: "type_data": { 2023-08-01T19:54:52.403 INFO:teuthology.orchestra.run.smithi008.stdout: "flag_point": "started", 2023-08-01T19:54:52.403 INFO:teuthology.orchestra.run.smithi008.stdout: "events": [ 2023-08-01T19:54:52.404 INFO:teuthology.orchestra.run.smithi008.stdout: { 2023-08-01T19:54:52.404 INFO:teuthology.orchestra.run.smithi008.stdout: "event": "initiated", 2023-08-01T19:54:52.404 INFO:teuthology.orchestra.run.smithi008.stdout: "time": "2023-08-01T19:54:52.393920+0000", 2023-08-01T19:54:52.404 INFO:teuthology.orchestra.run.smithi008.stdout: "duration": 0 2023-08-01T19:54:52.404 INFO:teuthology.orchestra.run.smithi008.stdout: }, 2023-08-01T19:54:52.404 INFO:teuthology.orchestra.run.smithi008.stdout: { 2023-08-01T19:54:52.404 INFO:teuthology.orchestra.run.smithi008.stdout: "event": "throttled", 2023-08-01T19:54:52.405 INFO:teuthology.orchestra.run.smithi008.stdout: "time": "2023-08-01T19:54:52.393920+0000", 2023-08-01T19:54:52.405 INFO:teuthology.orchestra.run.smithi008.stdout: "duration": 0 2023-08-01T19:54:52.405 INFO:teuthology.orchestra.run.smithi008.stdout: }, 2023-08-01T19:54:52.405 INFO:teuthology.orchestra.run.smithi008.stdout: { 2023-08-01T19:54:52.405 INFO:teuthology.orchestra.run.smithi008.stdout: "event": "header_read", 2023-08-01T19:54:52.405 INFO:teuthology.orchestra.run.smithi008.stdout: "time": "2023-08-01T19:54:52.393919+0000", 2023-08-01T19:54:52.405 INFO:teuthology.orchestra.run.smithi008.stdout: "duration": 4294967295.9999995 2023-08-01T19:54:52.405 INFO:teuthology.orchestra.run.smithi008.stdout: }, 2023-08-01T19:54:52.406 INFO:teuthology.orchestra.run.smithi008.stdout: { 2023-08-01T19:54:52.406 INFO:teuthology.orchestra.run.smithi008.stdout: "event": "all_read", 2023-08-01T19:54:52.406 INFO:teuthology.orchestra.run.smithi008.stdout: "time": "2023-08-01T19:54:52.394071+0000", 2023-08-01T19:54:52.406 INFO:teuthology.orchestra.run.smithi008.stdout: "duration": 0.00015172699999999999 2023-08-01T19:54:52.406 INFO:teuthology.orchestra.run.smithi008.stdout: }, 2023-08-01T19:54:52.406 INFO:teuthology.orchestra.run.smithi008.stdout: { 2023-08-01T19:54:52.406 INFO:teuthology.orchestra.run.smithi008.stdout: "event": "dispatched", 2023-08-01T19:54:52.407 INFO:teuthology.orchestra.run.smithi008.stdout: "time": "2023-08-01T19:54:52.394075+0000", 2023-08-01T19:54:52.407 INFO:teuthology.orchestra.run.smithi008.stdout: "duration": 4.2509999999999996e-06 2023-08-01T19:54:52.407 INFO:teuthology.orchestra.run.smithi008.stdout: }, 2023-08-01T19:54:52.407 INFO:teuthology.orchestra.run.smithi008.stdout: { 2023-08-01T19:54:52.407 INFO:teuthology.orchestra.run.smithi008.stdout: "event": "queued_for_pg", 2023-08-01T19:54:52.407 INFO:teuthology.orchestra.run.smithi008.stdout: "time": "2023-08-01T19:54:52.394078+0000", 2023-08-01T19:54:52.407 INFO:teuthology.orchestra.run.smithi008.stdout: "duration": 2.4439999999999998e-06 2023-08-01T19:54:52.407 INFO:teuthology.orchestra.run.smithi008.stdout: }, 2023-08-01T19:54:52.408 INFO:teuthology.orchestra.run.smithi008.stdout: { 2023-08-01T19:54:52.408 INFO:teuthology.orchestra.run.smithi008.stdout: "event": "reached_pg", 2023-08-01T19:54:52.408 INFO:teuthology.orchestra.run.smithi008.stdout: "time": "2023-08-01T19:54:52.394116+0000", 2023-08-01T19:54:52.408 INFO:teuthology.orchestra.run.smithi008.stdout: "duration": 3.8543e-05 2023-08-01T19:54:52.408 INFO:teuthology.orchestra.run.smithi008.stdout: }, 2023-08-01T19:54:52.408 INFO:teuthology.orchestra.run.smithi008.stdout: { 2023-08-01T19:54:52.408 INFO:teuthology.orchestra.run.smithi008.stdout: "event": "started", 2023-08-01T19:54:52.409 INFO:teuthology.orchestra.run.smithi008.stdout: "time": "2023-08-01T19:54:52.394133+0000", 2023-08-01T19:54:52.409 INFO:teuthology.orchestra.run.smithi008.stdout: "duration": 1.6538e-05 2023-08-01T19:54:52.409 INFO:teuthology.orchestra.run.smithi008.stdout: } 2023-08-01T19:54:52.409 INFO:teuthology.orchestra.run.smithi008.stdout: ] 2023-08-01T19:54:52.409 INFO:teuthology.orchestra.run.smithi008.stdout: } 2023-08-01T19:54:52.409 INFO:teuthology.orchestra.run.smithi008.stdout: }, 2023-08-01T19:54:52.409 INFO:teuthology.orchestra.run.smithi008.stdout: { 2023-08-01T19:54:52.410 INFO:teuthology.orchestra.run.smithi008.stdout: "description": "osd_repop(client.4668.0:75327 5.8 e32/19 5:166877e4:::benchmark_data_smithi006_114134_object75326:head v 32'4677, mlcod=32'4674)", 2023-08-01T19:54:52.410 INFO:teuthology.orchestra.run.smithi008.stdout: "initiated_at": "2023-08-01T19:54:52.394624+0000", 2023-08-01T19:54:52.410 INFO:teuthology.orchestra.run.smithi008.stdout: "age": 0.0058217470000000004, 2023-08-01T19:54:52.410 INFO:teuthology.orchestra.run.smithi008.stdout: "duration": 0.0059146019999999997, 2023-08-01T19:54:52.410 INFO:teuthology.orchestra.run.smithi008.stdout: "type_data": { 2023-08-01T19:54:52.410 INFO:teuthology.orchestra.run.smithi008.stdout: "flag_point": "started", 2023-08-01T19:54:52.410 INFO:teuthology.orchestra.run.smithi008.stdout: "events": [ 2023-08-01T19:54:52.410 INFO:teuthology.orchestra.run.smithi008.stdout: { 2023-08-01T19:54:52.411 INFO:teuthology.orchestra.run.smithi008.stdout: "event": "initiated", 2023-08-01T19:54:52.411 INFO:teuthology.orchestra.run.smithi008.stdout: "time": "2023-08-01T19:54:52.394624+0000", 2023-08-01T19:54:52.411 INFO:teuthology.orchestra.run.smithi008.stdout: "duration": 0 2023-08-01T19:54:52.411 INFO:teuthology.orchestra.run.smithi008.stdout: }, 2023-08-01T19:54:52.411 INFO:teuthology.orchestra.run.smithi008.stdout: { 2023-08-01T19:54:52.411 INFO:teuthology.orchestra.run.smithi008.stdout: "event": "throttled", 2023-08-01T19:54:52.411 INFO:teuthology.orchestra.run.smithi008.stdout: "time": "2023-08-01T19:54:52.394624+0000", 2023-08-01T19:54:52.412 INFO:teuthology.orchestra.run.smithi008.stdout: "duration": 0 2023-08-01T19:54:52.412 INFO:teuthology.orchestra.run.smithi008.stdout: }, 2023-08-01T19:54:52.412 INFO:teuthology.orchestra.run.smithi008.stdout: { 2023-08-01T19:54:52.412 INFO:teuthology.orchestra.run.smithi008.stdout: "event": "header_read", 2023-08-01T19:54:52.412 INFO:teuthology.orchestra.run.smithi008.stdout: "time": "2023-08-01T19:54:52.394624+0000", 2023-08-01T19:54:52.412 INFO:teuthology.orchestra.run.smithi008.stdout: "duration": 4294967295.9999995 2023-08-01T19:54:52.413 INFO:teuthology.orchestra.run.smithi008.stdout: }, 2023-08-01T19:54:52.413 INFO:teuthology.orchestra.run.smithi008.stdout: { 2023-08-01T19:54:52.413 INFO:teuthology.orchestra.run.smithi008.stdout: "event": "all_read", 2023-08-01T19:54:52.413 INFO:teuthology.orchestra.run.smithi008.stdout: "time": "2023-08-01T19:54:52.394697+0000", 2023-08-01T19:54:52.413 INFO:teuthology.orchestra.run.smithi008.stdout: "duration": 7.3603999999999995e-05 2023-08-01T19:54:52.413 INFO:teuthology.orchestra.run.smithi008.stdout: }, 2023-08-01T19:54:52.413 INFO:teuthology.orchestra.run.smithi008.stdout: { 2023-08-01T19:54:52.413 INFO:teuthology.orchestra.run.smithi008.stdout: "event": "dispatched", 2023-08-01T19:54:52.414 INFO:teuthology.orchestra.run.smithi008.stdout: "time": "2023-08-01T19:54:52.394707+0000", 2023-08-01T19:54:52.414 INFO:teuthology.orchestra.run.smithi008.stdout: "duration": 9.2189999999999993e-06 2023-08-01T19:54:52.414 INFO:teuthology.orchestra.run.smithi008.stdout: }, 2023-08-01T19:54:52.414 INFO:teuthology.orchestra.run.smithi008.stdout: { 2023-08-01T19:54:52.414 INFO:teuthology.orchestra.run.smithi008.stdout: "event": "queued_for_pg", 2023-08-01T19:54:52.414 INFO:teuthology.orchestra.run.smithi008.stdout: "time": "2023-08-01T19:54:52.394711+0000", 2023-08-01T19:54:52.414 INFO:teuthology.orchestra.run.smithi008.stdout: "duration": 4.8350000000000003e-06 2023-08-01T19:54:52.415 INFO:teuthology.orchestra.run.smithi008.stdout: }, 2023-08-01T19:54:52.415 INFO:teuthology.orchestra.run.smithi008.stdout: { 2023-08-01T19:54:52.415 INFO:teuthology.orchestra.run.smithi008.stdout: "event": "reached_pg", 2023-08-01T19:54:52.415 INFO:teuthology.orchestra.run.smithi008.stdout: "time": "2023-08-01T19:54:52.394887+0000", 2023-08-01T19:54:52.415 INFO:teuthology.orchestra.run.smithi008.stdout: "duration": 0.00017531900000000001 2023-08-01T19:54:52.415 INFO:teuthology.orchestra.run.smithi008.stdout: }, 2023-08-01T19:54:52.415 INFO:teuthology.orchestra.run.smithi008.stdout: { 2023-08-01T19:54:52.415 INFO:teuthology.orchestra.run.smithi008.stdout: "event": "started", 2023-08-01T19:54:52.416 INFO:teuthology.orchestra.run.smithi008.stdout: "time": "2023-08-01T19:54:52.394912+0000", 2023-08-01T19:54:52.416 INFO:teuthology.orchestra.run.smithi008.stdout: "duration": 2.5554e-05 2023-08-01T19:54:52.416 INFO:teuthology.orchestra.run.smithi008.stdout: } 2023-08-01T19:54:52.416 INFO:teuthology.orchestra.run.smithi008.stdout: ] 2023-08-01T19:54:52.416 INFO:teuthology.orchestra.run.smithi008.stdout: } 2023-08-01T19:54:52.416 INFO:teuthology.orchestra.run.smithi008.stdout: }, 2023-08-01T19:54:52.416 INFO:teuthology.orchestra.run.smithi008.stdout: { 2023-08-01T19:54:52.416 INFO:teuthology.orchestra.run.smithi008.stdout: "description": "osd_repop(client.4668.0:75330 5.7 e32/19 5:e82150bf:::benchmark_data_smithi006_114134_object75329:head v 32'4718, mlcod=32'4715)", 2023-08-01T19:54:52.417 INFO:teuthology.orchestra.run.smithi008.stdout: "initiated_at": "2023-08-01T19:54:52.395512+0000", 2023-08-01T19:54:52.417 INFO:teuthology.orchestra.run.smithi008.stdout: "age": 0.004934267, 2023-08-01T19:54:52.417 INFO:teuthology.orchestra.run.smithi008.stdout: "duration": 0.0050917050000000002, 2023-08-01T19:54:52.417 INFO:teuthology.orchestra.run.smithi008.stdout: "type_data": { 2023-08-01T19:54:52.417 INFO:teuthology.orchestra.run.smithi008.stdout: "flag_point": "started", 2023-08-01T19:54:52.417 INFO:teuthology.orchestra.run.smithi008.stdout: "events": [ 2023-08-01T19:54:52.417 INFO:teuthology.orchestra.run.smithi008.stdout: { 2023-08-01T19:54:52.418 INFO:teuthology.orchestra.run.smithi008.stdout: "event": "initiated", 2023-08-01T19:54:52.418 INFO:teuthology.orchestra.run.smithi008.stdout: "time": "2023-08-01T19:54:52.395512+0000", 2023-08-01T19:54:52.418 INFO:teuthology.orchestra.run.smithi008.stdout: "duration": 0 2023-08-01T19:54:52.418 INFO:teuthology.orchestra.run.smithi008.stdout: }, 2023-08-01T19:54:52.418 INFO:teuthology.orchestra.run.smithi008.stdout: { 2023-08-01T19:54:52.418 INFO:teuthology.orchestra.run.smithi008.stdout: "event": "throttled", 2023-08-01T19:54:52.419 INFO:teuthology.orchestra.run.smithi008.stdout: "time": "2023-08-01T19:54:52.395512+0000", 2023-08-01T19:54:52.419 INFO:teuthology.orchestra.run.smithi008.stdout: "duration": 0 2023-08-01T19:54:52.419 INFO:teuthology.orchestra.run.smithi008.stdout: }, 2023-08-01T19:54:52.419 INFO:teuthology.orchestra.run.smithi008.stdout: { 2023-08-01T19:54:52.419 INFO:teuthology.orchestra.run.smithi008.stdout: "event": "header_read", 2023-08-01T19:54:52.419 INFO:teuthology.orchestra.run.smithi008.stdout: "time": "2023-08-01T19:54:52.395511+0000", 2023-08-01T19:54:52.419 INFO:teuthology.orchestra.run.smithi008.stdout: "duration": 4294967295.9999995 2023-08-01T19:54:52.420 INFO:teuthology.orchestra.run.smithi008.stdout: }, 2023-08-01T19:54:52.420 INFO:teuthology.orchestra.run.smithi008.stdout: { 2023-08-01T19:54:52.420 INFO:teuthology.orchestra.run.smithi008.stdout: "event": "all_read", 2023-08-01T19:54:52.420 INFO:teuthology.orchestra.run.smithi008.stdout: "time": "2023-08-01T19:54:52.395562+0000", 2023-08-01T19:54:52.420 INFO:teuthology.orchestra.run.smithi008.stdout: "duration": 5.0507999999999998e-05 2023-08-01T19:54:52.420 INFO:teuthology.orchestra.run.smithi008.stdout: }, 2023-08-01T19:54:52.420 INFO:teuthology.orchestra.run.smithi008.stdout: { 2023-08-01T19:54:52.421 INFO:teuthology.orchestra.run.smithi008.stdout: "event": "dispatched", 2023-08-01T19:54:52.421 INFO:teuthology.orchestra.run.smithi008.stdout: "time": "2023-08-01T19:54:52.395570+0000", 2023-08-01T19:54:52.421 INFO:teuthology.orchestra.run.smithi008.stdout: "duration": 8.6710000000000005e-06 2023-08-01T19:54:52.421 INFO:teuthology.orchestra.run.smithi008.stdout: }, 2023-08-01T19:54:52.421 INFO:teuthology.orchestra.run.smithi008.stdout: { 2023-08-01T19:54:52.421 INFO:teuthology.orchestra.run.smithi008.stdout: "event": "queued_for_pg", 2023-08-01T19:54:52.422 INFO:teuthology.orchestra.run.smithi008.stdout: "time": "2023-08-01T19:54:52.395577+0000", 2023-08-01T19:54:52.422 INFO:teuthology.orchestra.run.smithi008.stdout: "duration": 6.387e-06 2023-08-01T19:54:52.422 INFO:teuthology.orchestra.run.smithi008.stdout: }, 2023-08-01T19:54:52.422 INFO:teuthology.orchestra.run.smithi008.stdout: { 2023-08-01T19:54:52.422 INFO:teuthology.orchestra.run.smithi008.stdout: "event": "reached_pg", 2023-08-01T19:54:52.422 INFO:teuthology.orchestra.run.smithi008.stdout: "time": "2023-08-01T19:54:52.395636+0000", 2023-08-01T19:54:52.422 INFO:teuthology.orchestra.run.smithi008.stdout: "duration": 5.9483e-05 2023-08-01T19:54:52.422 INFO:teuthology.orchestra.run.smithi008.stdout: }, 2023-08-01T19:54:52.423 INFO:teuthology.orchestra.run.smithi008.stdout: { 2023-08-01T19:54:52.423 INFO:teuthology.orchestra.run.smithi008.stdout: "event": "started", 2023-08-01T19:54:52.423 INFO:teuthology.orchestra.run.smithi008.stdout: "time": "2023-08-01T19:54:52.395653+0000", 2023-08-01T19:54:52.423 INFO:teuthology.orchestra.run.smithi008.stdout: "duration": 1.7098000000000001e-05 2023-08-01T19:54:52.423 INFO:teuthology.orchestra.run.smithi008.stdout: } 2023-08-01T19:54:52.423 INFO:teuthology.orchestra.run.smithi008.stdout: ] 2023-08-01T19:54:52.423 INFO:teuthology.orchestra.run.smithi008.stdout: } 2023-08-01T19:54:52.423 INFO:teuthology.orchestra.run.smithi008.stdout: }, 2023-08-01T19:54:52.424 INFO:teuthology.orchestra.run.smithi008.stdout: { 2023-08-01T19:54:52.424 INFO:teuthology.orchestra.run.smithi008.stdout: "description": "osd_repop(client.4668.0:75326 5.1 e32/19 5:8849ed5b:::benchmark_data_smithi006_114134_object75325:head v 32'4700, mlcod=32'4697)", 2023-08-01T19:54:52.424 INFO:teuthology.orchestra.run.smithi008.stdout: "initiated_at": "2023-08-01T19:54:52.396184+0000", 2023-08-01T19:54:52.424 INFO:teuthology.orchestra.run.smithi008.stdout: "age": 0.0042618530000000003, 2023-08-01T19:54:52.424 INFO:teuthology.orchestra.run.smithi008.stdout: "duration": 0.004482102, 2023-08-01T19:54:52.424 INFO:teuthology.orchestra.run.smithi008.stdout: "type_data": { 2023-08-01T19:54:52.425 INFO:teuthology.orchestra.run.smithi008.stdout: "flag_point": "started", 2023-08-01T19:54:52.425 INFO:teuthology.orchestra.run.smithi008.stdout: "events": [ 2023-08-01T19:54:52.425 INFO:teuthology.orchestra.run.smithi008.stdout: { 2023-08-01T19:54:52.425 INFO:teuthology.orchestra.run.smithi008.stdout: "event": "initiated", 2023-08-01T19:54:52.425 INFO:teuthology.orchestra.run.smithi008.stdout: "time": "2023-08-01T19:54:52.396184+0000", 2023-08-01T19:54:52.425 INFO:teuthology.orchestra.run.smithi008.stdout: "duration": 0 2023-08-01T19:54:52.425 INFO:teuthology.orchestra.run.smithi008.stdout: }, 2023-08-01T19:54:52.425 INFO:teuthology.orchestra.run.smithi008.stdout: { 2023-08-01T19:54:52.426 INFO:teuthology.orchestra.run.smithi008.stdout: "event": "throttled", 2023-08-01T19:54:52.426 INFO:teuthology.orchestra.run.smithi008.stdout: "time": "2023-08-01T19:54:52.396184+0000", 2023-08-01T19:54:52.426 INFO:teuthology.orchestra.run.smithi008.stdout: "duration": 0 2023-08-01T19:54:52.426 INFO:teuthology.orchestra.run.smithi008.stdout: }, 2023-08-01T19:54:52.426 INFO:teuthology.orchestra.run.smithi008.stdout: { 2023-08-01T19:54:52.426 INFO:teuthology.orchestra.run.smithi008.stdout: "event": "header_read", 2023-08-01T19:54:52.426 INFO:teuthology.orchestra.run.smithi008.stdout: "time": "2023-08-01T19:54:52.396184+0000", 2023-08-01T19:54:52.427 INFO:teuthology.orchestra.run.smithi008.stdout: "duration": 4294967295.9999995 2023-08-01T19:54:52.427 INFO:teuthology.orchestra.run.smithi008.stdout: }, 2023-08-01T19:54:52.427 INFO:teuthology.orchestra.run.smithi008.stdout: { 2023-08-01T19:54:52.427 INFO:teuthology.orchestra.run.smithi008.stdout: "event": "all_read", 2023-08-01T19:54:52.427 INFO:teuthology.orchestra.run.smithi008.stdout: "time": "2023-08-01T19:54:52.396253+0000", 2023-08-01T19:54:52.427 INFO:teuthology.orchestra.run.smithi008.stdout: "duration": 6.9698999999999998e-05 2023-08-01T19:54:52.427 INFO:teuthology.orchestra.run.smithi008.stdout: }, 2023-08-01T19:54:52.428 INFO:teuthology.orchestra.run.smithi008.stdout: { 2023-08-01T19:54:52.428 INFO:teuthology.orchestra.run.smithi008.stdout: "event": "dispatched", 2023-08-01T19:54:52.428 INFO:teuthology.orchestra.run.smithi008.stdout: "time": "2023-08-01T19:54:52.396260+0000", 2023-08-01T19:54:52.428 INFO:teuthology.orchestra.run.smithi008.stdout: "duration": 6.6540000000000002e-06 2023-08-01T19:54:52.428 INFO:teuthology.orchestra.run.smithi008.stdout: }, 2023-08-01T19:54:52.428 INFO:teuthology.orchestra.run.smithi008.stdout: { 2023-08-01T19:54:52.428 INFO:teuthology.orchestra.run.smithi008.stdout: "event": "queued_for_pg", 2023-08-01T19:54:52.429 INFO:teuthology.orchestra.run.smithi008.stdout: "time": "2023-08-01T19:54:52.396263+0000", 2023-08-01T19:54:52.429 INFO:teuthology.orchestra.run.smithi008.stdout: "duration": 3.315e-06 2023-08-01T19:54:52.429 INFO:teuthology.orchestra.run.smithi008.stdout: }, 2023-08-01T19:54:52.429 INFO:teuthology.orchestra.run.smithi008.stdout: { 2023-08-01T19:54:52.429 INFO:teuthology.orchestra.run.smithi008.stdout: "event": "reached_pg", 2023-08-01T19:54:52.429 INFO:teuthology.orchestra.run.smithi008.stdout: "time": "2023-08-01T19:54:52.396291+0000", 2023-08-01T19:54:52.429 INFO:teuthology.orchestra.run.smithi008.stdout: "duration": 2.7705e-05 2023-08-01T19:54:52.429 INFO:teuthology.orchestra.run.smithi008.stdout: }, 2023-08-01T19:54:52.430 INFO:teuthology.orchestra.run.smithi008.stdout: { 2023-08-01T19:54:52.430 INFO:teuthology.orchestra.run.smithi008.stdout: "event": "started", 2023-08-01T19:54:52.430 INFO:teuthology.orchestra.run.smithi008.stdout: "time": "2023-08-01T19:54:52.396304+0000", 2023-08-01T19:54:52.430 INFO:teuthology.orchestra.run.smithi008.stdout: "duration": 1.2986000000000001e-05 2023-08-01T19:54:52.430 INFO:teuthology.orchestra.run.smithi008.stdout: } 2023-08-01T19:54:52.430 INFO:teuthology.orchestra.run.smithi008.stdout: ] 2023-08-01T19:54:52.430 INFO:teuthology.orchestra.run.smithi008.stdout: } 2023-08-01T19:54:52.431 INFO:teuthology.orchestra.run.smithi008.stdout: }, 2023-08-01T19:54:52.431 INFO:teuthology.orchestra.run.smithi008.stdout: { 2023-08-01T19:54:52.431 INFO:teuthology.orchestra.run.smithi008.stdout: "description": "osd_repop(client.4668.0:75331 5.8 e32/19 5:13b4c646:::benchmark_data_smithi006_114134_object75330:head v 32'4678, mlcod=32'4674)", 2023-08-01T19:54:52.431 INFO:teuthology.orchestra.run.smithi008.stdout: "initiated_at": "2023-08-01T19:54:52.396549+0000", 2023-08-01T19:54:52.431 INFO:teuthology.orchestra.run.smithi008.stdout: "age": 0.0038974869999999998, 2023-08-01T19:54:52.431 INFO:teuthology.orchestra.run.smithi008.stdout: "duration": 0.0041923689999999996, 2023-08-01T19:54:52.431 INFO:teuthology.orchestra.run.smithi008.stdout: "type_data": { 2023-08-01T19:54:52.431 INFO:teuthology.orchestra.run.smithi008.stdout: "flag_point": "started", 2023-08-01T19:54:52.432 INFO:teuthology.orchestra.run.smithi008.stdout: "events": [ 2023-08-01T19:54:52.432 INFO:teuthology.orchestra.run.smithi008.stdout: { 2023-08-01T19:54:52.432 INFO:teuthology.orchestra.run.smithi008.stdout: "event": "initiated", 2023-08-01T19:54:52.432 INFO:teuthology.orchestra.run.smithi008.stdout: "time": "2023-08-01T19:54:52.396549+0000", 2023-08-01T19:54:52.432 INFO:teuthology.orchestra.run.smithi008.stdout: "duration": 0 2023-08-01T19:54:52.432 INFO:teuthology.orchestra.run.smithi008.stdout: }, 2023-08-01T19:54:52.432 INFO:teuthology.orchestra.run.smithi008.stdout: { 2023-08-01T19:54:52.432 INFO:teuthology.orchestra.run.smithi008.stdout: "event": "throttled", 2023-08-01T19:54:52.433 INFO:teuthology.orchestra.run.smithi008.stdout: "time": "2023-08-01T19:54:52.396549+0000", 2023-08-01T19:54:52.433 INFO:teuthology.orchestra.run.smithi008.stdout: "duration": 0 2023-08-01T19:54:52.433 INFO:teuthology.orchestra.run.smithi008.stdout: }, 2023-08-01T19:54:52.433 INFO:teuthology.orchestra.run.smithi008.stdout: { 2023-08-01T19:54:52.433 INFO:teuthology.orchestra.run.smithi008.stdout: "event": "header_read", 2023-08-01T19:54:52.433 INFO:teuthology.orchestra.run.smithi008.stdout: "time": "2023-08-01T19:54:52.396548+0000", 2023-08-01T19:54:52.433 INFO:teuthology.orchestra.run.smithi008.stdout: "duration": 4294967295.9999995 2023-08-01T19:54:52.434 INFO:teuthology.orchestra.run.smithi008.stdout: }, 2023-08-01T19:54:52.434 INFO:teuthology.orchestra.run.smithi008.stdout: { 2023-08-01T19:54:52.434 INFO:teuthology.orchestra.run.smithi008.stdout: "event": "all_read", 2023-08-01T19:54:52.434 INFO:teuthology.orchestra.run.smithi008.stdout: "time": "2023-08-01T19:54:52.396626+0000", 2023-08-01T19:54:52.434 INFO:teuthology.orchestra.run.smithi008.stdout: "duration": 7.7859000000000001e-05 2023-08-01T19:54:52.434 INFO:teuthology.orchestra.run.smithi008.stdout: }, 2023-08-01T19:54:52.434 INFO:teuthology.orchestra.run.smithi008.stdout: { 2023-08-01T19:54:52.434 INFO:teuthology.orchestra.run.smithi008.stdout: "event": "dispatched", 2023-08-01T19:54:52.435 INFO:teuthology.orchestra.run.smithi008.stdout: "time": "2023-08-01T19:54:52.396635+0000", 2023-08-01T19:54:52.435 INFO:teuthology.orchestra.run.smithi008.stdout: "duration": 9.2010000000000005e-06 2023-08-01T19:54:52.435 INFO:teuthology.orchestra.run.smithi008.stdout: }, 2023-08-01T19:54:52.435 INFO:teuthology.orchestra.run.smithi008.stdout: { 2023-08-01T19:54:52.435 INFO:teuthology.orchestra.run.smithi008.stdout: "event": "queued_for_pg", 2023-08-01T19:54:52.435 INFO:teuthology.orchestra.run.smithi008.stdout: "time": "2023-08-01T19:54:52.396640+0000", 2023-08-01T19:54:52.435 INFO:teuthology.orchestra.run.smithi008.stdout: "duration": 4.9289999999999997e-06 2023-08-01T19:54:52.436 INFO:teuthology.orchestra.run.smithi008.stdout: }, 2023-08-01T19:54:52.436 INFO:teuthology.orchestra.run.smithi008.stdout: { 2023-08-01T19:54:52.436 INFO:teuthology.orchestra.run.smithi008.stdout: "event": "reached_pg", 2023-08-01T19:54:52.436 INFO:teuthology.orchestra.run.smithi008.stdout: "time": "2023-08-01T19:54:52.397086+0000", 2023-08-01T19:54:52.436 INFO:teuthology.orchestra.run.smithi008.stdout: "duration": 0.000446017 2023-08-01T19:54:52.436 INFO:teuthology.orchestra.run.smithi008.stdout: }, 2023-08-01T19:54:52.436 INFO:teuthology.orchestra.run.smithi008.stdout: { 2023-08-01T19:54:52.436 INFO:teuthology.orchestra.run.smithi008.stdout: "event": "started", 2023-08-01T19:54:52.437 INFO:teuthology.orchestra.run.smithi008.stdout: "time": "2023-08-01T19:54:52.397097+0000", 2023-08-01T19:54:52.437 INFO:teuthology.orchestra.run.smithi008.stdout: "duration": 1.0975000000000001e-05 2023-08-01T19:54:52.437 INFO:teuthology.orchestra.run.smithi008.stdout: } 2023-08-01T19:54:52.437 INFO:teuthology.orchestra.run.smithi008.stdout: ] 2023-08-01T19:54:52.437 INFO:teuthology.orchestra.run.smithi008.stdout: } 2023-08-01T19:54:52.437 INFO:teuthology.orchestra.run.smithi008.stdout: }, 2023-08-01T19:54:52.437 INFO:teuthology.orchestra.run.smithi008.stdout: { 2023-08-01T19:54:52.438 INFO:teuthology.orchestra.run.smithi008.stdout: "description": "osd_repop(client.4668.0:75333 5.1 e32/19 5:8c72b042:::benchmark_data_smithi006_114134_object75332:head v 32'4701, mlcod=32'4697)", 2023-08-01T19:54:52.438 INFO:teuthology.orchestra.run.smithi008.stdout: "initiated_at": "2023-08-01T19:54:52.398241+0000", 2023-08-01T19:54:52.438 INFO:teuthology.orchestra.run.smithi008.stdout: "age": 0.0022045820000000001, 2023-08-01T19:54:52.438 INFO:teuthology.orchestra.run.smithi008.stdout: "duration": 0.002562272, 2023-08-01T19:54:52.438 INFO:teuthology.orchestra.run.smithi008.stdout: "type_data": { 2023-08-01T19:54:52.438 INFO:teuthology.orchestra.run.smithi008.stdout: "flag_point": "started", 2023-08-01T19:54:52.438 INFO:teuthology.orchestra.run.smithi008.stdout: "events": [ 2023-08-01T19:54:52.438 INFO:teuthology.orchestra.run.smithi008.stdout: { 2023-08-01T19:54:52.439 INFO:teuthology.orchestra.run.smithi008.stdout: "event": "initiated", 2023-08-01T19:54:52.439 INFO:teuthology.orchestra.run.smithi008.stdout: "time": "2023-08-01T19:54:52.398241+0000", 2023-08-01T19:54:52.439 INFO:teuthology.orchestra.run.smithi008.stdout: "duration": 0 2023-08-01T19:54:52.439 INFO:teuthology.orchestra.run.smithi008.stdout: }, 2023-08-01T19:54:52.439 INFO:teuthology.orchestra.run.smithi008.stdout: { 2023-08-01T19:54:52.439 INFO:teuthology.orchestra.run.smithi008.stdout: "event": "throttled", 2023-08-01T19:54:52.439 INFO:teuthology.orchestra.run.smithi008.stdout: "time": "2023-08-01T19:54:52.398241+0000", 2023-08-01T19:54:52.439 INFO:teuthology.orchestra.run.smithi008.stdout: "duration": 0 2023-08-01T19:54:52.440 INFO:teuthology.orchestra.run.smithi008.stdout: }, 2023-08-01T19:54:52.440 INFO:teuthology.orchestra.run.smithi008.stdout: { 2023-08-01T19:54:52.440 INFO:teuthology.orchestra.run.smithi008.stdout: "event": "header_read", 2023-08-01T19:54:52.440 INFO:teuthology.orchestra.run.smithi008.stdout: "time": "2023-08-01T19:54:52.398241+0000", 2023-08-01T19:54:52.440 INFO:teuthology.orchestra.run.smithi008.stdout: "duration": 4294967295.999999 2023-08-01T19:54:52.440 INFO:teuthology.orchestra.run.smithi008.stdout: }, 2023-08-01T19:54:52.440 INFO:teuthology.orchestra.run.smithi008.stdout: { 2023-08-01T19:54:52.441 INFO:teuthology.orchestra.run.smithi008.stdout: "event": "all_read", 2023-08-01T19:54:52.441 INFO:teuthology.orchestra.run.smithi008.stdout: "time": "2023-08-01T19:54:52.398316+0000", 2023-08-01T19:54:52.441 INFO:teuthology.orchestra.run.smithi008.stdout: "duration": 7.5271999999999994e-05 2023-08-01T19:54:52.441 INFO:teuthology.orchestra.run.smithi008.stdout: }, 2023-08-01T19:54:52.441 INFO:teuthology.orchestra.run.smithi008.stdout: { 2023-08-01T19:54:52.441 INFO:teuthology.orchestra.run.smithi008.stdout: "event": "dispatched", 2023-08-01T19:54:52.441 INFO:teuthology.orchestra.run.smithi008.stdout: "time": "2023-08-01T19:54:52.398327+0000", 2023-08-01T19:54:52.442 INFO:teuthology.orchestra.run.smithi008.stdout: "duration": 1.1224e-05 2023-08-01T19:54:52.442 INFO:teuthology.orchestra.run.smithi008.stdout: }, 2023-08-01T19:54:52.442 INFO:teuthology.orchestra.run.smithi008.stdout: { 2023-08-01T19:54:52.442 INFO:teuthology.orchestra.run.smithi008.stdout: "event": "queued_for_pg", 2023-08-01T19:54:52.442 INFO:teuthology.orchestra.run.smithi008.stdout: "time": "2023-08-01T19:54:52.398333+0000", 2023-08-01T19:54:52.442 INFO:teuthology.orchestra.run.smithi008.stdout: "duration": 5.9050000000000002e-06 2023-08-01T19:54:52.442 INFO:teuthology.orchestra.run.smithi008.stdout: }, 2023-08-01T19:54:52.442 INFO:teuthology.orchestra.run.smithi008.stdout: { 2023-08-01T19:54:52.443 INFO:teuthology.orchestra.run.smithi008.stdout: "event": "reached_pg", 2023-08-01T19:54:52.443 INFO:teuthology.orchestra.run.smithi008.stdout: "time": "2023-08-01T19:54:52.398366+0000", 2023-08-01T19:54:52.443 INFO:teuthology.orchestra.run.smithi008.stdout: "duration": 3.2808000000000002e-05 2023-08-01T19:54:52.443 INFO:teuthology.orchestra.run.smithi008.stdout: }, 2023-08-01T19:54:52.443 INFO:teuthology.orchestra.run.smithi008.stdout: { 2023-08-01T19:54:52.443 INFO:teuthology.orchestra.run.smithi008.stdout: "event": "started", 2023-08-01T19:54:52.444 INFO:teuthology.orchestra.run.smithi008.stdout: "time": "2023-08-01T19:54:52.398377+0000", 2023-08-01T19:54:52.444 INFO:teuthology.orchestra.run.smithi008.stdout: "duration": 1.1195999999999999e-05 2023-08-01T19:54:52.444 INFO:teuthology.orchestra.run.smithi008.stdout: } 2023-08-01T19:54:52.444 INFO:teuthology.orchestra.run.smithi008.stdout: ] 2023-08-01T19:54:52.444 INFO:teuthology.orchestra.run.smithi008.stdout: } 2023-08-01T19:54:52.444 INFO:teuthology.orchestra.run.smithi008.stdout: }, 2023-08-01T19:54:52.444 INFO:teuthology.orchestra.run.smithi008.stdout: { 2023-08-01T19:54:52.445 INFO:teuthology.orchestra.run.smithi008.stdout: "description": "osd_op(client.4668.0:75336 5.c 5:3115a469:::benchmark_data_smithi006_114134_object75335:head [set-alloc-hint object_size 65536 write_size 65536,write 0~65536 in=65536b] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e32)", 2023-08-01T19:54:52.445 INFO:teuthology.orchestra.run.smithi008.stdout: "initiated_at": "2023-08-01T19:54:52.398519+0000", 2023-08-01T19:54:52.445 INFO:teuthology.orchestra.run.smithi008.stdout: "age": 0.001927242, 2023-08-01T19:54:52.445 INFO:teuthology.orchestra.run.smithi008.stdout: "duration": 0.0023512390000000002, 2023-08-01T19:54:52.445 INFO:teuthology.orchestra.run.smithi008.stdout: "type_data": { 2023-08-01T19:54:52.445 INFO:teuthology.orchestra.run.smithi008.stdout: "flag_point": "waiting for sub ops", 2023-08-01T19:54:52.445 INFO:teuthology.orchestra.run.smithi008.stdout: "client_info": { 2023-08-01T19:54:52.446 INFO:teuthology.orchestra.run.smithi008.stdout: "client": "client.4668", 2023-08-01T19:54:52.446 INFO:teuthology.orchestra.run.smithi008.stdout: "client_addr": "172.21.15.6:0/1709472247", 2023-08-01T19:54:52.446 INFO:teuthology.orchestra.run.smithi008.stdout: "tid": 75336 2023-08-01T19:54:52.446 INFO:teuthology.orchestra.run.smithi008.stdout: }, 2023-08-01T19:54:52.446 INFO:teuthology.orchestra.run.smithi008.stdout: "events": [ 2023-08-01T19:54:52.446 INFO:teuthology.orchestra.run.smithi008.stdout: { 2023-08-01T19:54:52.446 INFO:teuthology.orchestra.run.smithi008.stdout: "event": "initiated", 2023-08-01T19:54:52.446 INFO:teuthology.orchestra.run.smithi008.stdout: "time": "2023-08-01T19:54:52.398519+0000", 2023-08-01T19:54:52.447 INFO:teuthology.orchestra.run.smithi008.stdout: "duration": 0 2023-08-01T19:54:52.447 INFO:teuthology.orchestra.run.smithi008.stdout: }, 2023-08-01T19:54:52.447 INFO:teuthology.orchestra.run.smithi008.stdout: { 2023-08-01T19:54:52.447 INFO:teuthology.orchestra.run.smithi008.stdout: "event": "throttled", 2023-08-01T19:54:52.447 INFO:teuthology.orchestra.run.smithi008.stdout: "time": "2023-08-01T19:54:52.398519+0000", 2023-08-01T19:54:52.447 INFO:teuthology.orchestra.run.smithi008.stdout: "duration": 0 2023-08-01T19:54:52.447 INFO:teuthology.orchestra.run.smithi008.stdout: }, 2023-08-01T19:54:52.447 INFO:teuthology.orchestra.run.smithi008.stdout: { 2023-08-01T19:54:52.448 INFO:teuthology.orchestra.run.smithi008.stdout: "event": "header_read", 2023-08-01T19:54:52.448 INFO:teuthology.orchestra.run.smithi008.stdout: "time": "2023-08-01T19:54:52.398517+0000", 2023-08-01T19:54:52.448 INFO:teuthology.orchestra.run.smithi008.stdout: "duration": 4294967295.9999986 2023-08-01T19:54:52.448 INFO:teuthology.orchestra.run.smithi008.stdout: }, 2023-08-01T19:54:52.448 INFO:teuthology.orchestra.run.smithi008.stdout: { 2023-08-01T19:54:52.448 INFO:teuthology.orchestra.run.smithi008.stdout: "event": "all_read", 2023-08-01T19:54:52.448 INFO:teuthology.orchestra.run.smithi008.stdout: "time": "2023-08-01T19:54:52.398569+0000", 2023-08-01T19:54:52.449 INFO:teuthology.orchestra.run.smithi008.stdout: "duration": 5.1224000000000003e-05 2023-08-01T19:54:52.449 INFO:teuthology.orchestra.run.smithi008.stdout: }, 2023-08-01T19:54:52.449 INFO:teuthology.orchestra.run.smithi008.stdout: { 2023-08-01T19:54:52.449 INFO:teuthology.orchestra.run.smithi008.stdout: "event": "dispatched", 2023-08-01T19:54:52.449 INFO:teuthology.orchestra.run.smithi008.stdout: "time": "2023-08-01T19:54:52.398581+0000", 2023-08-01T19:54:52.449 INFO:teuthology.orchestra.run.smithi008.stdout: "duration": 1.2414e-05 2023-08-01T19:54:52.449 INFO:teuthology.orchestra.run.smithi008.stdout: }, 2023-08-01T19:54:52.450 INFO:teuthology.orchestra.run.smithi008.stdout: { 2023-08-01T19:54:52.450 INFO:teuthology.orchestra.run.smithi008.stdout: "event": "queued_for_pg", 2023-08-01T19:54:52.450 INFO:teuthology.orchestra.run.smithi008.stdout: "time": "2023-08-01T19:54:52.398588+0000", 2023-08-01T19:54:52.450 INFO:teuthology.orchestra.run.smithi008.stdout: "duration": 7.3200000000000002e-06 2023-08-01T19:54:52.450 INFO:teuthology.orchestra.run.smithi008.stdout: }, 2023-08-01T19:54:52.450 INFO:teuthology.orchestra.run.smithi008.stdout: { 2023-08-01T19:54:52.450 INFO:teuthology.orchestra.run.smithi008.stdout: "event": "reached_pg", 2023-08-01T19:54:52.451 INFO:teuthology.orchestra.run.smithi008.stdout: "time": "2023-08-01T19:54:52.398632+0000", 2023-08-01T19:54:52.451 INFO:teuthology.orchestra.run.smithi008.stdout: "duration": 4.3980999999999998e-05 2023-08-01T19:54:52.451 INFO:teuthology.orchestra.run.smithi008.stdout: }, 2023-08-01T19:54:52.451 INFO:teuthology.orchestra.run.smithi008.stdout: { 2023-08-01T19:54:52.451 INFO:teuthology.orchestra.run.smithi008.stdout: "event": "started", 2023-08-01T19:54:52.451 INFO:teuthology.orchestra.run.smithi008.stdout: "time": "2023-08-01T19:54:52.398769+0000", 2023-08-01T19:54:52.451 INFO:teuthology.orchestra.run.smithi008.stdout: "duration": 0.00013700600000000001 2023-08-01T19:54:52.452 INFO:teuthology.orchestra.run.smithi008.stdout: }, 2023-08-01T19:54:52.452 INFO:teuthology.orchestra.run.smithi008.stdout: { 2023-08-01T19:54:52.452 INFO:teuthology.orchestra.run.smithi008.stdout: "event": "waiting for subops from 1", 2023-08-01T19:54:52.452 INFO:teuthology.orchestra.run.smithi008.stdout: "time": "2023-08-01T19:54:52.398935+0000", 2023-08-01T19:54:52.452 INFO:teuthology.orchestra.run.smithi008.stdout: "duration": 0.00016527299999999999 2023-08-01T19:54:52.452 INFO:teuthology.orchestra.run.smithi008.stdout: } 2023-08-01T19:54:52.452 INFO:teuthology.orchestra.run.smithi008.stdout: ] 2023-08-01T19:54:52.453 INFO:teuthology.orchestra.run.smithi008.stdout: } 2023-08-01T19:54:52.453 INFO:teuthology.orchestra.run.smithi008.stdout: }, 2023-08-01T19:54:52.453 INFO:teuthology.orchestra.run.smithi008.stdout: { 2023-08-01T19:54:52.453 INFO:teuthology.orchestra.run.smithi008.stdout: "description": "osd_repop(client.4668.0:75335 5.7 e32/19 5:ec88ef5a:::benchmark_data_smithi006_114134_object75334:head v 32'4719, mlcod=32'4716)", 2023-08-01T19:54:52.453 INFO:teuthology.orchestra.run.smithi008.stdout: "initiated_at": "2023-08-01T19:54:52.398656+0000", 2023-08-01T19:54:52.453 INFO:teuthology.orchestra.run.smithi008.stdout: "age": 0.001789632, 2023-08-01T19:54:52.453 INFO:teuthology.orchestra.run.smithi008.stdout: "duration": 0.0022888800000000001, 2023-08-01T19:54:52.454 INFO:teuthology.orchestra.run.smithi008.stdout: "type_data": { 2023-08-01T19:54:52.454 INFO:teuthology.orchestra.run.smithi008.stdout: "flag_point": "started", 2023-08-01T19:54:52.454 INFO:teuthology.orchestra.run.smithi008.stdout: "events": [ 2023-08-01T19:54:52.454 INFO:teuthology.orchestra.run.smithi008.stdout: { 2023-08-01T19:54:52.454 INFO:teuthology.orchestra.run.smithi008.stdout: "event": "initiated", 2023-08-01T19:54:52.454 INFO:teuthology.orchestra.run.smithi008.stdout: "time": "2023-08-01T19:54:52.398656+0000", 2023-08-01T19:54:52.455 INFO:teuthology.orchestra.run.smithi008.stdout: "duration": 0 2023-08-01T19:54:52.455 INFO:teuthology.orchestra.run.smithi008.stdout: }, 2023-08-01T19:54:52.455 INFO:teuthology.orchestra.run.smithi008.stdout: { 2023-08-01T19:54:52.455 INFO:teuthology.orchestra.run.smithi008.stdout: "event": "throttled", 2023-08-01T19:54:52.455 INFO:teuthology.orchestra.run.smithi008.stdout: "time": "2023-08-01T19:54:52.398656+0000", 2023-08-01T19:54:52.455 INFO:teuthology.orchestra.run.smithi008.stdout: "duration": 0 2023-08-01T19:54:52.455 INFO:teuthology.orchestra.run.smithi008.stdout: }, 2023-08-01T19:54:52.456 INFO:teuthology.orchestra.run.smithi008.stdout: { 2023-08-01T19:54:52.456 INFO:teuthology.orchestra.run.smithi008.stdout: "event": "header_read", 2023-08-01T19:54:52.456 INFO:teuthology.orchestra.run.smithi008.stdout: "time": "2023-08-01T19:54:52.398656+0000", 2023-08-01T19:54:52.456 INFO:teuthology.orchestra.run.smithi008.stdout: "duration": 4294967295.9999995 2023-08-01T19:54:52.456 INFO:teuthology.orchestra.run.smithi008.stdout: }, 2023-08-01T19:54:52.456 INFO:teuthology.orchestra.run.smithi008.stdout: { 2023-08-01T19:54:52.456 INFO:teuthology.orchestra.run.smithi008.stdout: "event": "all_read", 2023-08-01T19:54:52.457 INFO:teuthology.orchestra.run.smithi008.stdout: "time": "2023-08-01T19:54:52.398715+0000", 2023-08-01T19:54:52.457 INFO:teuthology.orchestra.run.smithi008.stdout: "duration": 5.906e-05 2023-08-01T19:54:52.457 INFO:teuthology.orchestra.run.smithi008.stdout: }, 2023-08-01T19:54:52.457 INFO:teuthology.orchestra.run.smithi008.stdout: { 2023-08-01T19:54:52.457 INFO:teuthology.orchestra.run.smithi008.stdout: "event": "dispatched", 2023-08-01T19:54:52.457 INFO:teuthology.orchestra.run.smithi008.stdout: "time": "2023-08-01T19:54:52.398724+0000", 2023-08-01T19:54:52.457 INFO:teuthology.orchestra.run.smithi008.stdout: "duration": 8.7839999999999992e-06 2023-08-01T19:54:52.457 INFO:teuthology.orchestra.run.smithi008.stdout: }, 2023-08-01T19:54:52.458 INFO:teuthology.orchestra.run.smithi008.stdout: { 2023-08-01T19:54:52.458 INFO:teuthology.orchestra.run.smithi008.stdout: "event": "queued_for_pg", 2023-08-01T19:54:52.458 INFO:teuthology.orchestra.run.smithi008.stdout: "time": "2023-08-01T19:54:52.398729+0000", 2023-08-01T19:54:52.458 INFO:teuthology.orchestra.run.smithi008.stdout: "duration": 5.2050000000000001e-06 2023-08-01T19:54:52.458 INFO:teuthology.orchestra.run.smithi008.stdout: }, 2023-08-01T19:54:52.458 INFO:teuthology.orchestra.run.smithi008.stdout: { 2023-08-01T19:54:52.458 INFO:teuthology.orchestra.run.smithi008.stdout: "event": "reached_pg", 2023-08-01T19:54:52.459 INFO:teuthology.orchestra.run.smithi008.stdout: "time": "2023-08-01T19:54:52.398767+0000", 2023-08-01T19:54:52.459 INFO:teuthology.orchestra.run.smithi008.stdout: "duration": 3.8216000000000001e-05 2023-08-01T19:54:52.459 INFO:teuthology.orchestra.run.smithi008.stdout: }, 2023-08-01T19:54:52.459 INFO:teuthology.orchestra.run.smithi008.stdout: { 2023-08-01T19:54:52.459 INFO:teuthology.orchestra.run.smithi008.stdout: "event": "started", 2023-08-01T19:54:52.459 INFO:teuthology.orchestra.run.smithi008.stdout: "time": "2023-08-01T19:54:52.398787+0000", 2023-08-01T19:54:52.459 INFO:teuthology.orchestra.run.smithi008.stdout: "duration": 2.0165000000000001e-05 2023-08-01T19:54:52.459 INFO:teuthology.orchestra.run.smithi008.stdout: } 2023-08-01T19:54:52.460 INFO:teuthology.orchestra.run.smithi008.stdout: ] 2023-08-01T19:54:52.460 INFO:teuthology.orchestra.run.smithi008.stdout: } 2023-08-01T19:54:52.460 INFO:teuthology.orchestra.run.smithi008.stdout: }, 2023-08-01T19:54:52.460 INFO:teuthology.orchestra.run.smithi008.stdout: { 2023-08-01T19:54:52.460 INFO:teuthology.orchestra.run.smithi008.stdout: "description": "osd_op(client.4668.0:75337 5.3 5:cde1549b:::benchmark_data_smithi006_114134_object75336:head [set-alloc-hint object_size 65536 write_size 65536,write 0~65536 in=65536b] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e32)", 2023-08-01T19:54:52.460 INFO:teuthology.orchestra.run.smithi008.stdout: "initiated_at": "2023-08-01T19:54:52.399550+0000", 2023-08-01T19:54:52.460 INFO:teuthology.orchestra.run.smithi008.stdout: "age": 0.00089599899999999997, 2023-08-01T19:54:52.461 INFO:teuthology.orchestra.run.smithi008.stdout: "duration": 0.001463376, 2023-08-01T19:54:52.461 INFO:teuthology.orchestra.run.smithi008.stdout: "type_data": { 2023-08-01T19:54:52.461 INFO:teuthology.orchestra.run.smithi008.stdout: "flag_point": "waiting for sub ops", 2023-08-01T19:54:52.461 INFO:teuthology.orchestra.run.smithi008.stdout: "client_info": { 2023-08-01T19:54:52.461 INFO:teuthology.orchestra.run.smithi008.stdout: "client": "client.4668", 2023-08-01T19:54:52.461 INFO:teuthology.orchestra.run.smithi008.stdout: "client_addr": "172.21.15.6:0/1709472247", 2023-08-01T19:54:52.461 INFO:teuthology.orchestra.run.smithi008.stdout: "tid": 75337 2023-08-01T19:54:52.462 INFO:teuthology.orchestra.run.smithi008.stdout: }, 2023-08-01T19:54:52.462 INFO:teuthology.orchestra.run.smithi008.stdout: "events": [ 2023-08-01T19:54:52.462 INFO:teuthology.orchestra.run.smithi008.stdout: { 2023-08-01T19:54:52.462 INFO:teuthology.orchestra.run.smithi008.stdout: "event": "initiated", 2023-08-01T19:54:52.462 INFO:teuthology.orchestra.run.smithi008.stdout: "time": "2023-08-01T19:54:52.399550+0000", 2023-08-01T19:54:52.462 INFO:teuthology.orchestra.run.smithi008.stdout: "duration": 0 2023-08-01T19:54:52.462 INFO:teuthology.orchestra.run.smithi008.stdout: }, 2023-08-01T19:54:52.462 INFO:teuthology.orchestra.run.smithi008.stdout: { 2023-08-01T19:54:52.463 INFO:teuthology.orchestra.run.smithi008.stdout: "event": "throttled", 2023-08-01T19:54:52.463 INFO:teuthology.orchestra.run.smithi008.stdout: "time": "2023-08-01T19:54:52.399550+0000", 2023-08-01T19:54:52.463 INFO:teuthology.orchestra.run.smithi008.stdout: "duration": 0 2023-08-01T19:54:52.463 INFO:teuthology.orchestra.run.smithi008.stdout: }, 2023-08-01T19:54:52.463 INFO:teuthology.orchestra.run.smithi008.stdout: { 2023-08-01T19:54:52.463 INFO:teuthology.orchestra.run.smithi008.stdout: "event": "header_read", 2023-08-01T19:54:52.463 INFO:teuthology.orchestra.run.smithi008.stdout: "time": "2023-08-01T19:54:52.399549+0000", 2023-08-01T19:54:52.463 INFO:teuthology.orchestra.run.smithi008.stdout: "duration": 4294967295.999999 2023-08-01T19:54:52.464 INFO:teuthology.orchestra.run.smithi008.stdout: }, 2023-08-01T19:54:52.464 INFO:teuthology.orchestra.run.smithi008.stdout: { 2023-08-01T19:54:52.464 INFO:teuthology.orchestra.run.smithi008.stdout: "event": "all_read", 2023-08-01T19:54:52.464 INFO:teuthology.orchestra.run.smithi008.stdout: "time": "2023-08-01T19:54:52.399612+0000", 2023-08-01T19:54:52.464 INFO:teuthology.orchestra.run.smithi008.stdout: "duration": 6.2990000000000005e-05 2023-08-01T19:54:52.464 INFO:teuthology.orchestra.run.smithi008.stdout: }, 2023-08-01T19:54:52.464 INFO:teuthology.orchestra.run.smithi008.stdout: { 2023-08-01T19:54:52.465 INFO:teuthology.orchestra.run.smithi008.stdout: "event": "dispatched", 2023-08-01T19:54:52.465 INFO:teuthology.orchestra.run.smithi008.stdout: "time": "2023-08-01T19:54:52.399624+0000", 2023-08-01T19:54:52.465 INFO:teuthology.orchestra.run.smithi008.stdout: "duration": 1.1486e-05 2023-08-01T19:54:52.465 INFO:teuthology.orchestra.run.smithi008.stdout: }, 2023-08-01T19:54:52.465 INFO:teuthology.orchestra.run.smithi008.stdout: { 2023-08-01T19:54:52.465 INFO:teuthology.orchestra.run.smithi008.stdout: "event": "queued_for_pg", 2023-08-01T19:54:52.465 INFO:teuthology.orchestra.run.smithi008.stdout: "time": "2023-08-01T19:54:52.399631+0000", 2023-08-01T19:54:52.466 INFO:teuthology.orchestra.run.smithi008.stdout: "duration": 6.8650000000000003e-06 2023-08-01T19:54:52.466 INFO:teuthology.orchestra.run.smithi008.stdout: }, 2023-08-01T19:54:52.466 INFO:teuthology.orchestra.run.smithi008.stdout: { 2023-08-01T19:54:52.466 INFO:teuthology.orchestra.run.smithi008.stdout: "event": "reached_pg", 2023-08-01T19:54:52.466 INFO:teuthology.orchestra.run.smithi008.stdout: "time": "2023-08-01T19:54:52.399676+0000", 2023-08-01T19:54:52.466 INFO:teuthology.orchestra.run.smithi008.stdout: "duration": 4.5666e-05 2023-08-01T19:54:52.466 INFO:teuthology.orchestra.run.smithi008.stdout: }, 2023-08-01T19:54:52.466 INFO:teuthology.orchestra.run.smithi008.stdout: { 2023-08-01T19:54:52.467 INFO:teuthology.orchestra.run.smithi008.stdout: "event": "started", 2023-08-01T19:54:52.467 INFO:teuthology.orchestra.run.smithi008.stdout: "time": "2023-08-01T19:54:52.399826+0000", 2023-08-01T19:54:52.467 INFO:teuthology.orchestra.run.smithi008.stdout: "duration": 0.000150159 2023-08-01T19:54:52.467 INFO:teuthology.orchestra.run.smithi008.stdout: }, 2023-08-01T19:54:52.467 INFO:teuthology.orchestra.run.smithi008.stdout: { 2023-08-01T19:54:52.467 INFO:teuthology.orchestra.run.smithi008.stdout: "event": "waiting for subops from 1", 2023-08-01T19:54:52.467 INFO:teuthology.orchestra.run.smithi008.stdout: "time": "2023-08-01T19:54:52.399983+0000", 2023-08-01T19:54:52.467 INFO:teuthology.orchestra.run.smithi008.stdout: "duration": 0.000156219 2023-08-01T19:54:52.468 INFO:teuthology.orchestra.run.smithi008.stdout: } 2023-08-01T19:54:52.468 INFO:teuthology.orchestra.run.smithi008.stdout: ] 2023-08-01T19:54:52.468 INFO:teuthology.orchestra.run.smithi008.stdout: } 2023-08-01T19:54:52.468 INFO:teuthology.orchestra.run.smithi008.stdout: }, 2023-08-01T19:54:52.468 INFO:teuthology.orchestra.run.smithi008.stdout: { 2023-08-01T19:54:52.468 INFO:teuthology.orchestra.run.smithi008.stdout: "description": "osd_repop(client.4668.0:75334 5.1 e32/19 5:8b9bd4fc:::benchmark_data_smithi006_114134_object75333:head v 32'4702, mlcod=32'4697)", 2023-08-01T19:54:52.468 INFO:teuthology.orchestra.run.smithi008.stdout: "initiated_at": "2023-08-01T19:54:52.399599+0000", 2023-08-01T19:54:52.469 INFO:teuthology.orchestra.run.smithi008.stdout: "age": 0.000847001, 2023-08-01T19:54:52.469 INFO:teuthology.orchestra.run.smithi008.stdout: "duration": 0.0014899710000000001, 2023-08-01T19:54:52.469 INFO:teuthology.orchestra.run.smithi008.stdout: "type_data": { 2023-08-01T19:54:52.469 INFO:teuthology.orchestra.run.smithi008.stdout: "flag_point": "started", 2023-08-01T19:54:52.469 INFO:teuthology.orchestra.run.smithi008.stdout: "events": [ 2023-08-01T19:54:52.469 INFO:teuthology.orchestra.run.smithi008.stdout: { 2023-08-01T19:54:52.469 INFO:teuthology.orchestra.run.smithi008.stdout: "event": "initiated", 2023-08-01T19:54:52.469 INFO:teuthology.orchestra.run.smithi008.stdout: "time": "2023-08-01T19:54:52.399599+0000", 2023-08-01T19:54:52.470 INFO:teuthology.orchestra.run.smithi008.stdout: "duration": 0 2023-08-01T19:54:52.470 INFO:teuthology.orchestra.run.smithi008.stdout: }, 2023-08-01T19:54:52.470 INFO:teuthology.orchestra.run.smithi008.stdout: { 2023-08-01T19:54:52.470 INFO:teuthology.orchestra.run.smithi008.stdout: "event": "throttled", 2023-08-01T19:54:52.470 INFO:teuthology.orchestra.run.smithi008.stdout: "time": "2023-08-01T19:54:52.399599+0000", 2023-08-01T19:54:52.470 INFO:teuthology.orchestra.run.smithi008.stdout: "duration": 0 2023-08-01T19:54:52.470 INFO:teuthology.orchestra.run.smithi008.stdout: }, 2023-08-01T19:54:52.471 INFO:teuthology.orchestra.run.smithi008.stdout: { 2023-08-01T19:54:52.471 INFO:teuthology.orchestra.run.smithi008.stdout: "event": "header_read", 2023-08-01T19:54:52.471 INFO:teuthology.orchestra.run.smithi008.stdout: "time": "2023-08-01T19:54:52.399598+0000", 2023-08-01T19:54:52.471 INFO:teuthology.orchestra.run.smithi008.stdout: "duration": 4294967295.999999 2023-08-01T19:54:52.471 INFO:teuthology.orchestra.run.smithi008.stdout: }, 2023-08-01T19:54:52.471 INFO:teuthology.orchestra.run.smithi008.stdout: { 2023-08-01T19:54:52.471 INFO:teuthology.orchestra.run.smithi008.stdout: "event": "all_read", 2023-08-01T19:54:52.472 INFO:teuthology.orchestra.run.smithi008.stdout: "time": "2023-08-01T19:54:52.399708+0000", 2023-08-01T19:54:52.472 INFO:teuthology.orchestra.run.smithi008.stdout: "duration": 0.00010993399999999999 2023-08-01T19:54:52.472 INFO:teuthology.orchestra.run.smithi008.stdout: }, 2023-08-01T19:54:52.472 INFO:teuthology.orchestra.run.smithi008.stdout: { 2023-08-01T19:54:52.472 INFO:teuthology.orchestra.run.smithi008.stdout: "event": "dispatched", 2023-08-01T19:54:52.472 INFO:teuthology.orchestra.run.smithi008.stdout: "time": "2023-08-01T19:54:52.399716+0000", 2023-08-01T19:54:52.472 INFO:teuthology.orchestra.run.smithi008.stdout: "duration": 7.4499999999999998e-06 2023-08-01T19:54:52.472 INFO:teuthology.orchestra.run.smithi008.stdout: }, 2023-08-01T19:54:52.473 INFO:teuthology.orchestra.run.smithi008.stdout: { 2023-08-01T19:54:52.473 INFO:teuthology.orchestra.run.smithi008.stdout: "event": "queued_for_pg", 2023-08-01T19:54:52.473 INFO:teuthology.orchestra.run.smithi008.stdout: "time": "2023-08-01T19:54:52.399721+0000", 2023-08-01T19:54:52.473 INFO:teuthology.orchestra.run.smithi008.stdout: "duration": 5.4140000000000002e-06 2023-08-01T19:54:52.473 INFO:teuthology.orchestra.run.smithi008.stdout: }, 2023-08-01T19:54:52.473 INFO:teuthology.orchestra.run.smithi008.stdout: { 2023-08-01T19:54:52.473 INFO:teuthology.orchestra.run.smithi008.stdout: "event": "reached_pg", 2023-08-01T19:54:52.473 INFO:teuthology.orchestra.run.smithi008.stdout: "time": "2023-08-01T19:54:52.400019+0000", 2023-08-01T19:54:52.474 INFO:teuthology.orchestra.run.smithi008.stdout: "duration": 0.00029806800000000002 2023-08-01T19:54:52.474 INFO:teuthology.orchestra.run.smithi008.stdout: }, 2023-08-01T19:54:52.474 INFO:teuthology.orchestra.run.smithi008.stdout: { 2023-08-01T19:54:52.474 INFO:teuthology.orchestra.run.smithi008.stdout: "event": "started", 2023-08-01T19:54:52.474 INFO:teuthology.orchestra.run.smithi008.stdout: "time": "2023-08-01T19:54:52.400035+0000", 2023-08-01T19:54:52.474 INFO:teuthology.orchestra.run.smithi008.stdout: "duration": 1.6356999999999999e-05 2023-08-01T19:54:52.474 INFO:teuthology.orchestra.run.smithi008.stdout: } 2023-08-01T19:54:52.475 INFO:teuthology.orchestra.run.smithi008.stdout: ] 2023-08-01T19:54:52.475 INFO:teuthology.orchestra.run.smithi008.stdout: } 2023-08-01T19:54:52.475 INFO:teuthology.orchestra.run.smithi008.stdout: } 2023-08-01T19:54:52.475 INFO:teuthology.orchestra.run.smithi008.stdout: ], 2023-08-01T19:54:52.475 INFO:teuthology.orchestra.run.smithi008.stdout: "num_ops": 10 2023-08-01T19:54:52.475 INFO:teuthology.orchestra.run.smithi008.stdout:} 2023-08-01T19:54:52.476 INFO:tasks.ceph.osd.1.smithi101.stderr:2023-08-01T19:54:52.475+0000 7fb0cb7f6700 -1 received signal: Hangup from /usr/bin/python3 /bin/daemon-helper kill ceph-osd -f --cluster ceph -i 1 (PID: 111141) UID: 0 2023-08-01T19:54:52.477 INFO:teuthology.orchestra.run.smithi006.stdout:osd.0: {} 2023-08-01T19:54:52.477 INFO:teuthology.orchestra.run.smithi006.stdout:osd.1: {} 2023-08-01T19:54:52.477 INFO:teuthology.orchestra.run.smithi006.stdout:osd.2: {} 2023-08-01T19:54:52.478 DEBUG:teuthology.orchestra.run.smithi008:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 30 ceph --cluster ceph --admin-daemon /var/run/ceph/ceph-osd.0.asok dump_blocked_ops 2023-08-01T19:54:52.479 INFO:teuthology.orchestra.run.smithi006.stderr:osd.0: osd_enable_op_tracker = 'false' 2023-08-01T19:54:52.479 INFO:teuthology.orchestra.run.smithi006.stderr:osd.1: osd_enable_op_tracker = 'false' 2023-08-01T19:54:52.479 INFO:teuthology.orchestra.run.smithi006.stderr:osd.2: osd_enable_op_tracker = 'false' 2023-08-01T19:54:52.578 INFO:tasks.ceph.osd.0.smithi008.stderr:2023-08-01T19:54:52.576+0000 7f16a58f4700 -1 received signal: Hangup from /usr/bin/python3 /bin/daemon-helper kill ceph-osd -f --cluster ceph -i 0 (PID: 111179) UID: 0 2023-08-01T19:54:52.678 INFO:tasks.ceph.osd.1.smithi101.stderr:2023-08-01T19:54:52.676+0000 7fb0cb7f6700 -1 received signal: Hangup from /usr/bin/python3 /bin/daemon-helper kill ceph-osd -f --cluster ceph -i 1 (PID: 111141) UID: 0 2023-08-01T19:54:52.708 INFO:teuthology.orchestra.run.smithi008.stdout:ERROR: (22) Invalid argument 2023-08-01T19:54:52.709 INFO:teuthology.orchestra.run.smithi008.stdout:op_tracker tracking is not enabled now, so no ops are tracked currently, even those get stuck. Please enable "osd_enable_op_tracker", and the tracker will start to track new ops received afterwards. 2023-08-01T19:54:52.718 DEBUG:teuthology.orchestra.run.smithi008:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 30 ceph --cluster ceph --admin-daemon /var/run/ceph/ceph-osd.0.asok dump_historic_ops 2023-08-01T19:54:52.778 INFO:tasks.ceph.osd.1.smithi101.stderr:2023-08-01T19:54:52.777+0000 7fb0cb7f6700 -1 received signal: Hangup from /usr/bin/python3 /bin/daemon-helper kill ceph-osd -f --cluster ceph -i 1 (PID: 111141) UID: 0 2023-08-01T19:54:52.878 INFO:tasks.ceph.osd.0.smithi008.stderr:2023-08-01T19:54:52.878+0000 7f16a58f4700 -1 received signal: Hangup from /usr/bin/python3 /bin/daemon-helper kill ceph-osd -f --cluster ceph -i 0 (PID: 111179) UID: 0 2023-08-01T19:54:52.955 INFO:teuthology.orchestra.run.smithi008.stdout:ERROR: (22) Invalid argument 2023-08-01T19:54:52.955 INFO:teuthology.orchestra.run.smithi008.stdout:op_tracker tracking is not enabled now, so no ops are tracked currently, even those get stuck. Please enable "osd_enable_op_tracker", and the tracker will start to track new ops received afterwards. 2023-08-01T19:54:52.964 DEBUG:teuthology.orchestra.run.smithi101:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 30 ceph --cluster ceph --admin-daemon /var/run/ceph/ceph-osd.1.asok dump_ops_in_flight 2023-08-01T19:54:53.006 INFO:tasks.ceph.osd.0.smithi008.stderr:2023-08-01T19:54:53.005+0000 7f16a58f4700 -1 received signal: Hangup from /usr/bin/python3 /bin/daemon-helper kill ceph-osd -f --cluster ceph -i 0 (PID: 111179) UID: 0 2023-08-01T19:54:53.056 INFO:teuthology.orchestra.run.smithi006.stderr:reweighted osd.2 to 1 (10000) 2023-08-01T19:54:53.067 INFO:tasks.ceph.ceph_manager.ceph:waiting for recovery to complete 2023-08-01T19:54:53.067 DEBUG:teuthology.orchestra.run.smithi006:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 120 ceph --cluster ceph pg dump --format=json 2023-08-01T19:54:53.080 INFO:tasks.ceph.osd.1.smithi101.stderr:2023-08-01T19:54:53.079+0000 7fb0cb7f6700 -1 received signal: Hangup from /usr/bin/python3 /bin/daemon-helper kill ceph-osd -f --cluster ceph -i 1 (PID: 111141) UID: 0 2023-08-01T19:54:53.128 INFO:teuthology.orchestra.run.smithi101.stdout:ERROR: (22) Invalid argument 2023-08-01T19:54:53.129 INFO:teuthology.orchestra.run.smithi101.stdout:op_tracker tracking is not enabled now, so no ops are tracked currently, even those get stuck. Please enable "osd_enable_op_tracker", and the tracker will start to track new ops received afterwards. 2023-08-01T19:54:53.142 DEBUG:teuthology.orchestra.run.smithi101:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 30 ceph --cluster ceph --admin-daemon /var/run/ceph/ceph-osd.1.asok dump_blocked_ops 2023-08-01T19:54:53.181 INFO:tasks.ceph.osd.2.smithi155.stderr:2023-08-01T19:54:53.180+0000 7faa5c6ac700 -1 received signal: Hangup from /usr/bin/python3 /bin/daemon-helper kill ceph-osd -f --cluster ceph -i 2 (PID: 111337) UID: 0 2023-08-01T19:54:53.283 INFO:tasks.ceph.osd.1.smithi101.stderr:2023-08-01T19:54:53.281+0000 7fb0cb7f6700 -1 received signal: Hangup from /usr/bin/python3 /bin/daemon-helper kill ceph-osd -f --cluster ceph -i 1 (PID: 111141) UID: 0 2023-08-01T19:54:53.315 INFO:tasks.radosbench.radosbench.0.smithi006.stdout: 29 16 77125 77109 166.17 121.688 0.00799955 0.00601454 2023-08-01T19:54:53.347 INFO:teuthology.orchestra.run.smithi101.stdout:ERROR: (22) Invalid argument 2023-08-01T19:54:53.347 INFO:teuthology.orchestra.run.smithi101.stdout:op_tracker tracking is not enabled now, so no ops are tracked currently, even those get stuck. Please enable "osd_enable_op_tracker", and the tracker will start to track new ops received afterwards. 2023-08-01T19:54:53.360 DEBUG:teuthology.orchestra.run.smithi101:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 30 ceph --cluster ceph --admin-daemon /var/run/ceph/ceph-osd.1.asok dump_historic_ops 2023-08-01T19:54:53.383 INFO:tasks.ceph.osd.0.smithi008.stderr:2023-08-01T19:54:53.382+0000 7f16a58f4700 -1 received signal: Hangup from /usr/bin/python3 /bin/daemon-helper kill ceph-osd -f --cluster ceph -i 0 (PID: 111179) UID: 0 2023-08-01T19:54:53.415 INFO:teuthology.orchestra.run.smithi006.stdout: 2023-08-01T19:54:53.417 INFO:teuthology.orchestra.run.smithi006.stderr:dumped all 2023-08-01T19:54:53.429 INFO:teuthology.orchestra.run.smithi006.stdout:{"pg_ready":true,"pg_map":{"version":61,"stamp":"2023-08-01T19:54:53.050331+0000","last_osdmap_epoch":0,"last_pg_scan":0,"pg_stats_sum":{"stat_sum":{"num_bytes":4666034978,"num_objects":71213,"num_object_clones":0,"num_object_copies":142426,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":71213,"num_whiteouts":0,"num_read":136,"num_read_kb":118,"num_write":71437,"num_write_kb":4559569,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":14,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"store_stats":{"total":0,"available":0,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},"log_size":60785,"ondisk_log_size":60785,"up":242,"acting":242,"num_store_stats":0},"osd_stats_sum":{"up_from":0,"seq":0,"num_pgs":242,"num_osds":3,"num_per_pool_osds":3,"num_per_pool_omap_osds":3,"kb":283115520,"kb_used":740772,"kb_used_data":556428,"kb_used_omap":0,"kb_used_meta":184320,"kb_avail":282374748,"statfs":{"total":289910292480,"available":289151741952,"internally_reserved":0,"allocated":569782272,"data_stored":9100602088,"data_compressed":43594516,"data_compressed_allocated":568766464,"data_compressed_original":9100230656,"omap_allocated":0,"internal_metadata":188743680},"hb_peers":[],"snap_trim_queue_len":0,"num_snap_trimming":0,"num_shards_repaired":0,"op_queue_age_hist":{"histogram":[0,1,3,4,2],"upper_bound":32},"perf_stat":{"commit_latency_ms":8,"apply_latency_ms":8,"commit_latency_ns":8000000,"apply_latency_ns":8000000},"alerts":[],"network_ping_times":[]},"pg_stats_delta":{"stat_sum":{"num_bytes":667025408,"num_objects":10178,"num_object_clones":0,"num_object_copies":20356,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":10178,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":10178,"num_write_kb":651392,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"store_stats":{"total":0,"available":0,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},"log_size":0,"ondisk_log_size":0,"up":0,"acting":0,"num_store_stats":0,"stamp_delta":"5.134384"},"pg_stats":[{"pgid":"4.3f","version":"0'0","reported_seq":22,"reported_epoch":30,"state":"active+clean","last_fresh":"2023-08-01T19:54:48.985844+0000","last_change":"2023-08-01T19:54:04.473430+0000","last_active":"2023-08-01T19:54:48.985844+0000","last_peered":"2023-08-01T19:54:48.985844+0000","last_clean":"2023-08-01T19:54:48.985844+0000","last_became_active":"2023-08-01T19:54:04.472887+0000","last_became_peered":"2023-08-01T19:54:04.472887+0000","last_unstale":"2023-08-01T19:54:48.985844+0000","last_undegraded":"2023-08-01T19:54:48.985844+0000","last_fullsized":"2023-08-01T19:54:48.985844+0000","mapping_epoch":16,"log_start":"0'0","ondisk_log_start":"0'0","created":16,"last_epoch_clean":17,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-08-01T19:54:04.040663+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-08-01T19:54:04.040663+0000","last_clean_scrub_stamp":"2023-08-01T19:54:04.040663+0000","objects_scrubbed":0,"log_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-08-03T06:38:54.196605+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[2,0],"acting":[2,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":2,"acting_primary":2,"purged_snaps":[]},{"pgid":"4.3e","version":"0'0","reported_seq":22,"reported_epoch":30,"state":"active+clean","last_fresh":"2023-08-01T19:54:48.985372+0000","last_change":"2023-08-01T19:54:04.470501+0000","last_active":"2023-08-01T19:54:48.985372+0000","last_peered":"2023-08-01T19:54:48.985372+0000","last_clean":"2023-08-01T19:54:48.985372+0000","last_became_active":"2023-08-01T19:54:04.469692+0000","last_became_peered":"2023-08-01T19:54:04.469692+0000","last_unstale":"2023-08-01T19:54:48.985372+0000","last_undegraded":"2023-08-01T19:54:48.985372+0000","last_fullsized":"2023-08-01T19:54:48.985372+0000","mapping_epoch":16,"log_start":"0'0","ondisk_log_start":"0'0","created":16,"last_epoch_clean":17,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-08-01T19:54:04.040663+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-08-01T19:54:04.040663+0000","last_clean_scrub_stamp":"2023-08-01T19:54:04.040663+0000","objects_scrubbed":0,"log_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-08-03T02:19:35.201107+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[2,0],"acting":[2,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":2,"acting_primary":2,"purged_snaps":[]},{"pgid":"4.3d","version":"0'0","reported_seq":21,"reported_epoch":29,"state":"active+clean","last_fresh":"2023-08-01T19:54:45.742446+0000","last_change":"2023-08-01T19:54:04.472579+0000","last_active":"2023-08-01T19:54:45.742446+0000","last_peered":"2023-08-01T19:54:45.742446+0000","last_clean":"2023-08-01T19:54:45.742446+0000","last_became_active":"2023-08-01T19:54:04.471128+0000","last_became_peered":"2023-08-01T19:54:04.471128+0000","last_unstale":"2023-08-01T19:54:45.742446+0000","last_undegraded":"2023-08-01T19:54:45.742446+0000","last_fullsized":"2023-08-01T19:54:45.742446+0000","mapping_epoch":16,"log_start":"0'0","ondisk_log_start":"0'0","created":16,"last_epoch_clean":17,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-08-01T19:54:04.040663+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-08-01T19:54:04.040663+0000","last_clean_scrub_stamp":"2023-08-01T19:54:04.040663+0000","objects_scrubbed":0,"log_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-08-03T03:04:06.137335+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[1,2],"acting":[1,2],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":1,"acting_primary":1,"purged_snaps":[]},{"pgid":"4.3c","version":"0'0","reported_seq":21,"reported_epoch":29,"state":"active+clean","last_fresh":"2023-08-01T19:54:45.742426+0000","last_change":"2023-08-01T19:54:04.477908+0000","last_active":"2023-08-01T19:54:45.742426+0000","last_peered":"2023-08-01T19:54:45.742426+0000","last_clean":"2023-08-01T19:54:45.742426+0000","last_became_active":"2023-08-01T19:54:04.476684+0000","last_became_peered":"2023-08-01T19:54:04.476684+0000","last_unstale":"2023-08-01T19:54:45.742426+0000","last_undegraded":"2023-08-01T19:54:45.742426+0000","last_fullsized":"2023-08-01T19:54:45.742426+0000","mapping_epoch":16,"log_start":"0'0","ondisk_log_start":"0'0","created":16,"last_epoch_clean":17,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-08-01T19:54:04.040663+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-08-01T19:54:04.040663+0000","last_clean_scrub_stamp":"2023-08-01T19:54:04.040663+0000","objects_scrubbed":0,"log_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-08-03T03:56:55.336461+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[1,0],"acting":[1,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":1,"acting_primary":1,"purged_snaps":[]},{"pgid":"4.3b","version":"0'0","reported_seq":22,"reported_epoch":30,"state":"active+clean","last_fresh":"2023-08-01T19:54:48.984742+0000","last_change":"2023-08-01T19:54:04.467197+0000","last_active":"2023-08-01T19:54:48.984742+0000","last_peered":"2023-08-01T19:54:48.984742+0000","last_clean":"2023-08-01T19:54:48.984742+0000","last_became_active":"2023-08-01T19:54:04.466526+0000","last_became_peered":"2023-08-01T19:54:04.466526+0000","last_unstale":"2023-08-01T19:54:48.984742+0000","last_undegraded":"2023-08-01T19:54:48.984742+0000","last_fullsized":"2023-08-01T19:54:48.984742+0000","mapping_epoch":16,"log_start":"0'0","ondisk_log_start":"0'0","created":16,"last_epoch_clean":17,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-08-01T19:54:04.040663+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-08-01T19:54:04.040663+0000","last_clean_scrub_stamp":"2023-08-01T19:54:04.040663+0000","objects_scrubbed":0,"log_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-08-03T06:54:18.982174+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[2,0],"acting":[2,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":2,"acting_primary":2,"purged_snaps":[]},{"pgid":"4.3a","version":"0'0","reported_seq":21,"reported_epoch":29,"state":"active+clean","last_fresh":"2023-08-01T19:54:45.741612+0000","last_change":"2023-08-01T19:54:04.473296+0000","last_active":"2023-08-01T19:54:45.741612+0000","last_peered":"2023-08-01T19:54:45.741612+0000","last_clean":"2023-08-01T19:54:45.741612+0000","last_became_active":"2023-08-01T19:54:04.472324+0000","last_became_peered":"2023-08-01T19:54:04.472324+0000","last_unstale":"2023-08-01T19:54:45.741612+0000","last_undegraded":"2023-08-01T19:54:45.741612+0000","last_fullsized":"2023-08-01T19:54:45.741612+0000","mapping_epoch":16,"log_start":"0'0","ondisk_log_start":"0'0","created":16,"last_epoch_clean":17,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-08-01T19:54:04.040663+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-08-01T19:54:04.040663+0000","last_clean_scrub_stamp":"2023-08-01T19:54:04.040663+0000","objects_scrubbed":0,"log_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-08-02T23:15:11.148662+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[1,0],"acting":[1,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":1,"acting_primary":1,"purged_snaps":[]},{"pgid":"4.39","version":"0'0","reported_seq":21,"reported_epoch":29,"state":"active+clean","last_fresh":"2023-08-01T19:54:45.742367+0000","last_change":"2023-08-01T19:54:04.475322+0000","last_active":"2023-08-01T19:54:45.742367+0000","last_peered":"2023-08-01T19:54:45.742367+0000","last_clean":"2023-08-01T19:54:45.742367+0000","last_became_active":"2023-08-01T19:54:04.474591+0000","last_became_peered":"2023-08-01T19:54:04.474591+0000","last_unstale":"2023-08-01T19:54:45.742367+0000","last_undegraded":"2023-08-01T19:54:45.742367+0000","last_fullsized":"2023-08-01T19:54:45.742367+0000","mapping_epoch":16,"log_start":"0'0","ondisk_log_start":"0'0","created":16,"last_epoch_clean":17,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-08-01T19:54:04.040663+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-08-01T19:54:04.040663+0000","last_clean_scrub_stamp":"2023-08-01T19:54:04.040663+0000","objects_scrubbed":0,"log_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-08-03T00:29:53.554989+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[1,0],"acting":[1,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":1,"acting_primary":1,"purged_snaps":[]},{"pgid":"4.38","version":"0'0","reported_seq":21,"reported_epoch":29,"state":"active+clean","last_fresh":"2023-08-01T19:54:45.741377+0000","last_change":"2023-08-01T19:54:04.478505+0000","last_active":"2023-08-01T19:54:45.741377+0000","last_peered":"2023-08-01T19:54:45.741377+0000","last_clean":"2023-08-01T19:54:45.741377+0000","last_became_active":"2023-08-01T19:54:04.477325+0000","last_became_peered":"2023-08-01T19:54:04.477325+0000","last_unstale":"2023-08-01T19:54:45.741377+0000","last_undegraded":"2023-08-01T19:54:45.741377+0000","last_fullsized":"2023-08-01T19:54:45.741377+0000","mapping_epoch":16,"log_start":"0'0","ondisk_log_start":"0'0","created":16,"last_epoch_clean":17,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-08-01T19:54:04.040663+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-08-01T19:54:04.040663+0000","last_clean_scrub_stamp":"2023-08-01T19:54:04.040663+0000","objects_scrubbed":0,"log_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-08-03T01:38:12.939736+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[1,0],"acting":[1,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":1,"acting_primary":1,"purged_snaps":[]},{"pgid":"4.37","version":"0'0","reported_seq":21,"reported_epoch":29,"state":"active+clean","last_fresh":"2023-08-01T19:54:45.740363+0000","last_change":"2023-08-01T19:54:04.470971+0000","last_active":"2023-08-01T19:54:45.740363+0000","last_peered":"2023-08-01T19:54:45.740363+0000","last_clean":"2023-08-01T19:54:45.740363+0000","last_became_active":"2023-08-01T19:54:04.469011+0000","last_became_peered":"2023-08-01T19:54:04.469011+0000","last_unstale":"2023-08-01T19:54:45.740363+0000","last_undegraded":"2023-08-01T19:54:45.740363+0000","last_fullsized":"2023-08-01T19:54:45.740363+0000","mapping_epoch":16,"log_start":"0'0","ondisk_log_start":"0'0","created":16,"last_epoch_clean":17,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-08-01T19:54:04.040663+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-08-01T19:54:04.040663+0000","last_clean_scrub_stamp":"2023-08-01T19:54:04.040663+0000","objects_scrubbed":0,"log_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-08-03T06:50:03.420334+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[0,2],"acting":[0,2],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":0,"acting_primary":0,"purged_snaps":[]},{"pgid":"4.36","version":"0'0","reported_seq":22,"reported_epoch":30,"state":"active+clean","last_fresh":"2023-08-01T19:54:48.985589+0000","last_change":"2023-08-01T19:54:04.473523+0000","last_active":"2023-08-01T19:54:48.985589+0000","last_peered":"2023-08-01T19:54:48.985589+0000","last_clean":"2023-08-01T19:54:48.985589+0000","last_became_active":"2023-08-01T19:54:04.473084+0000","last_became_peered":"2023-08-01T19:54:04.473084+0000","last_unstale":"2023-08-01T19:54:48.985589+0000","last_undegraded":"2023-08-01T19:54:48.985589+0000","last_fullsized":"2023-08-01T19:54:48.985589+0000","mapping_epoch":16,"log_start":"0'0","ondisk_log_start":"0'0","created":16,"last_epoch_clean":17,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-08-01T19:54:04.040663+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-08-01T19:54:04.040663+0000","last_clean_scrub_stamp":"2023-08-01T19:54:04.040663+0000","objects_scrubbed":0,"log_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-08-03T04:28:59.042443+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[2,0],"acting":[2,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":2,"acting_primary":2,"purged_snaps":[]},{"pgid":"4.35","version":"0'0","reported_seq":21,"reported_epoch":29,"state":"active+clean","last_fresh":"2023-08-01T19:54:45.742210+0000","last_change":"2023-08-01T19:54:04.475816+0000","last_active":"2023-08-01T19:54:45.742210+0000","last_peered":"2023-08-01T19:54:45.742210+0000","last_clean":"2023-08-01T19:54:45.742210+0000","last_became_active":"2023-08-01T19:54:04.475061+0000","last_became_peered":"2023-08-01T19:54:04.475061+0000","last_unstale":"2023-08-01T19:54:45.742210+0000","last_undegraded":"2023-08-01T19:54:45.742210+0000","last_fullsized":"2023-08-01T19:54:45.742210+0000","mapping_epoch":16,"log_start":"0'0","ondisk_log_start":"0'0","created":16,"last_epoch_clean":17,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-08-01T19:54:04.040663+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-08-01T19:54:04.040663+0000","last_clean_scrub_stamp":"2023-08-01T19:54:04.040663+0000","objects_scrubbed":0,"log_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-08-02T22:07:41.305488+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[1,0],"acting":[1,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":1,"acting_primary":1,"purged_snaps":[]},{"pgid":"4.34","version":"0'0","reported_seq":22,"reported_epoch":30,"state":"active+clean","last_fresh":"2023-08-01T19:54:48.984829+0000","last_change":"2023-08-01T19:54:04.468009+0000","last_active":"2023-08-01T19:54:48.984829+0000","last_peered":"2023-08-01T19:54:48.984829+0000","last_clean":"2023-08-01T19:54:48.984829+0000","last_became_active":"2023-08-01T19:54:04.467568+0000","last_became_peered":"2023-08-01T19:54:04.467568+0000","last_unstale":"2023-08-01T19:54:48.984829+0000","last_undegraded":"2023-08-01T19:54:48.984829+0000","last_fullsized":"2023-08-01T19:54:48.984829+0000","mapping_epoch":16,"log_start":"0'0","ondisk_log_start":"0'0","created":16,"last_epoch_clean":17,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-08-01T19:54:04.040663+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-08-01T19:54:04.040663+0000","last_clean_scrub_stamp":"2023-08-01T19:54:04.040663+0000","objects_scrubbed":0,"log_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-08-03T04:53:44.017572+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[2,1],"acting":[2,1],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":2,"acting_primary":2,"purged_snaps":[]},{"pgid":"4.33","version":"0'0","reported_seq":22,"reported_epoch":30,"state":"active+clean","last_fresh":"2023-08-01T19:54:48.984982+0000","last_change":"2023-08-01T19:54:04.466770+0000","last_active":"2023-08-01T19:54:48.984982+0000","last_peered":"2023-08-01T19:54:48.984982+0000","last_clean":"2023-08-01T19:54:48.984982+0000","last_became_active":"2023-08-01T19:54:04.466460+0000","last_became_peered":"2023-08-01T19:54:04.466460+0000","last_unstale":"2023-08-01T19:54:48.984982+0000","last_undegraded":"2023-08-01T19:54:48.984982+0000","last_fullsized":"2023-08-01T19:54:48.984982+0000","mapping_epoch":16,"log_start":"0'0","ondisk_log_start":"0'0","created":16,"last_epoch_clean":17,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-08-01T19:54:04.040663+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-08-01T19:54:04.040663+0000","last_clean_scrub_stamp":"2023-08-01T19:54:04.040663+0000","objects_scrubbed":0,"log_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-08-03T06:04:11.595951+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[2,0],"acting":[2,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":2,"acting_primary":2,"purged_snaps":[]},{"pgid":"4.32","version":"0'0","reported_seq":21,"reported_epoch":29,"state":"active+clean","last_fresh":"2023-08-01T19:54:45.741886+0000","last_change":"2023-08-01T19:54:04.466634+0000","last_active":"2023-08-01T19:54:45.741886+0000","last_peered":"2023-08-01T19:54:45.741886+0000","last_clean":"2023-08-01T19:54:45.741886+0000","last_became_active":"2023-08-01T19:54:04.466302+0000","last_became_peered":"2023-08-01T19:54:04.466302+0000","last_unstale":"2023-08-01T19:54:45.741886+0000","last_undegraded":"2023-08-01T19:54:45.741886+0000","last_fullsized":"2023-08-01T19:54:45.741886+0000","mapping_epoch":16,"log_start":"0'0","ondisk_log_start":"0'0","created":16,"last_epoch_clean":17,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-08-01T19:54:04.040663+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-08-01T19:54:04.040663+0000","last_clean_scrub_stamp":"2023-08-01T19:54:04.040663+0000","objects_scrubbed":0,"log_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-08-03T05:46:11.085577+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[1,2],"acting":[1,2],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":1,"acting_primary":1,"purged_snaps":[]},{"pgid":"4.31","version":"0'0","reported_seq":21,"reported_epoch":29,"state":"active+clean","last_fresh":"2023-08-01T19:54:45.741958+0000","last_change":"2023-08-01T19:54:04.472407+0000","last_active":"2023-08-01T19:54:45.741958+0000","last_peered":"2023-08-01T19:54:45.741958+0000","last_clean":"2023-08-01T19:54:45.741958+0000","last_became_active":"2023-08-01T19:54:04.472008+0000","last_became_peered":"2023-08-01T19:54:04.472008+0000","last_unstale":"2023-08-01T19:54:45.741958+0000","last_undegraded":"2023-08-01T19:54:45.741958+0000","last_fullsized":"2023-08-01T19:54:45.741958+0000","mapping_epoch":16,"log_start":"0'0","ondisk_log_start":"0'0","created":16,"last_epoch_clean":17,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-08-01T19:54:04.040663+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-08-01T19:54:04.040663+0000","last_clean_scrub_stamp":"2023-08-01T19:54:04.040663+0000","objects_scrubbed":0,"log_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-08-02T22:42:25.293502+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[1,2],"acting":[1,2],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":1,"acting_primary":1,"purged_snaps":[]},{"pgid":"4.30","version":"0'0","reported_seq":21,"reported_epoch":29,"state":"active+clean","last_fresh":"2023-08-01T19:54:45.741427+0000","last_change":"2023-08-01T19:54:04.478283+0000","last_active":"2023-08-01T19:54:45.741427+0000","last_peered":"2023-08-01T19:54:45.741427+0000","last_clean":"2023-08-01T19:54:45.741427+0000","last_became_active":"2023-08-01T19:54:04.476620+0000","last_became_peered":"2023-08-01T19:54:04.476620+0000","last_unstale":"2023-08-01T19:54:45.741427+0000","last_undegraded":"2023-08-01T19:54:45.741427+0000","last_fullsized":"2023-08-01T19:54:45.741427+0000","mapping_epoch":16,"log_start":"0'0","ondisk_log_start":"0'0","created":16,"last_epoch_clean":17,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-08-01T19:54:04.040663+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-08-01T19:54:04.040663+0000","last_clean_scrub_stamp":"2023-08-01T19:54:04.040663+0000","objects_scrubbed":0,"log_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-08-03T02:27:17.063518+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[1,0],"acting":[1,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":1,"acting_primary":1,"purged_snaps":[]},{"pgid":"4.2f","version":"0'0","reported_seq":21,"reported_epoch":29,"state":"active+clean","last_fresh":"2023-08-01T19:54:45.740446+0000","last_change":"2023-08-01T19:54:04.470302+0000","last_active":"2023-08-01T19:54:45.740446+0000","last_peered":"2023-08-01T19:54:45.740446+0000","last_clean":"2023-08-01T19:54:45.740446+0000","last_became_active":"2023-08-01T19:54:04.468919+0000","last_became_peered":"2023-08-01T19:54:04.468919+0000","last_unstale":"2023-08-01T19:54:45.740446+0000","last_undegraded":"2023-08-01T19:54:45.740446+0000","last_fullsized":"2023-08-01T19:54:45.740446+0000","mapping_epoch":16,"log_start":"0'0","ondisk_log_start":"0'0","created":16,"last_epoch_clean":17,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-08-01T19:54:04.040663+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-08-01T19:54:04.040663+0000","last_clean_scrub_stamp":"2023-08-01T19:54:04.040663+0000","objects_scrubbed":0,"log_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-08-02T22:42:25.293502+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[0,2],"acting":[0,2],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":0,"acting_primary":0,"purged_snaps":[]},{"pgid":"4.2e","version":"0'0","reported_seq":22,"reported_epoch":30,"state":"active+clean","last_fresh":"2023-08-01T19:54:48.985666+0000","last_change":"2023-08-01T19:54:04.474058+0000","last_active":"2023-08-01T19:54:48.985666+0000","last_peered":"2023-08-01T19:54:48.985666+0000","last_clean":"2023-08-01T19:54:48.985666+0000","last_became_active":"2023-08-01T19:54:04.473355+0000","last_became_peered":"2023-08-01T19:54:04.473355+0000","last_unstale":"2023-08-01T19:54:48.985666+0000","last_undegraded":"2023-08-01T19:54:48.985666+0000","last_fullsized":"2023-08-01T19:54:48.985666+0000","mapping_epoch":16,"log_start":"0'0","ondisk_log_start":"0'0","created":16,"last_epoch_clean":17,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-08-01T19:54:04.040663+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-08-01T19:54:04.040663+0000","last_clean_scrub_stamp":"2023-08-01T19:54:04.040663+0000","objects_scrubbed":0,"log_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-08-03T04:55:54.197252+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[2,0],"acting":[2,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":2,"acting_primary":2,"purged_snaps":[]},{"pgid":"4.2d","version":"0'0","reported_seq":21,"reported_epoch":29,"state":"active+clean","last_fresh":"2023-08-01T19:54:45.740463+0000","last_change":"2023-08-01T19:54:04.468775+0000","last_active":"2023-08-01T19:54:45.740463+0000","last_peered":"2023-08-01T19:54:45.740463+0000","last_clean":"2023-08-01T19:54:45.740463+0000","last_became_active":"2023-08-01T19:54:04.467274+0000","last_became_peered":"2023-08-01T19:54:04.467274+0000","last_unstale":"2023-08-01T19:54:45.740463+0000","last_undegraded":"2023-08-01T19:54:45.740463+0000","last_fullsized":"2023-08-01T19:54:45.740463+0000","mapping_epoch":16,"log_start":"0'0","ondisk_log_start":"0'0","created":16,"last_epoch_clean":17,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-08-01T19:54:04.040663+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-08-01T19:54:04.040663+0000","last_clean_scrub_stamp":"2023-08-01T19:54:04.040663+0000","objects_scrubbed":0,"log_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-08-02T23:00:37.537286+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[0,2],"acting":[0,2],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":0,"acting_primary":0,"purged_snaps":[]},{"pgid":"4.2c","version":"0'0","reported_seq":21,"reported_epoch":29,"state":"active+clean","last_fresh":"2023-08-01T19:54:45.742343+0000","last_change":"2023-08-01T19:54:04.478409+0000","last_active":"2023-08-01T19:54:45.742343+0000","last_peered":"2023-08-01T19:54:45.742343+0000","last_clean":"2023-08-01T19:54:45.742343+0000","last_became_active":"2023-08-01T19:54:04.477133+0000","last_became_peered":"2023-08-01T19:54:04.477133+0000","last_unstale":"2023-08-01T19:54:45.742343+0000","last_undegraded":"2023-08-01T19:54:45.742343+0000","last_fullsized":"2023-08-01T19:54:45.742343+0000","mapping_epoch":16,"log_start":"0'0","ondisk_log_start":"0'0","created":16,"last_epoch_clean":17,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-08-01T19:54:04.040663+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-08-01T19:54:04.040663+0000","last_clean_scrub_stamp":"2023-08-01T19:54:04.040663+0000","objects_scrubbed":0,"log_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-08-02T22:15:19.744281+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[1,0],"acting":[1,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":1,"acting_primary":1,"purged_snaps":[]},{"pgid":"4.2b","version":"0'0","reported_seq":21,"reported_epoch":29,"state":"active+clean","last_fresh":"2023-08-01T19:54:45.741666+0000","last_change":"2023-08-01T19:54:04.474047+0000","last_active":"2023-08-01T19:54:45.741666+0000","last_peered":"2023-08-01T19:54:45.741666+0000","last_clean":"2023-08-01T19:54:45.741666+0000","last_became_active":"2023-08-01T19:54:04.473578+0000","last_became_peered":"2023-08-01T19:54:04.473578+0000","last_unstale":"2023-08-01T19:54:45.741666+0000","last_undegraded":"2023-08-01T19:54:45.741666+0000","last_fullsized":"2023-08-01T19:54:45.741666+0000","mapping_epoch":16,"log_start":"0'0","ondisk_log_start":"0'0","created":16,"last_epoch_clean":17,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-08-01T19:54:04.040663+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-08-01T19:54:04.040663+0000","last_clean_scrub_stamp":"2023-08-01T19:54:04.040663+0000","objects_scrubbed":0,"log_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-08-03T05:39:29.199142+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[1,0],"acting":[1,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":1,"acting_primary":1,"purged_snaps":[]},{"pgid":"4.2a","version":"0'0","reported_seq":22,"reported_epoch":30,"state":"active+clean","last_fresh":"2023-08-01T19:54:48.985093+0000","last_change":"2023-08-01T19:54:04.469281+0000","last_active":"2023-08-01T19:54:48.985093+0000","last_peered":"2023-08-01T19:54:48.985093+0000","last_clean":"2023-08-01T19:54:48.985093+0000","last_became_active":"2023-08-01T19:54:04.468771+0000","last_became_peered":"2023-08-01T19:54:04.468771+0000","last_unstale":"2023-08-01T19:54:48.985093+0000","last_undegraded":"2023-08-01T19:54:48.985093+0000","last_fullsized":"2023-08-01T19:54:48.985093+0000","mapping_epoch":16,"log_start":"0'0","ondisk_log_start":"0'0","created":16,"last_epoch_clean":17,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-08-01T19:54:04.040663+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-08-01T19:54:04.040663+0000","last_clean_scrub_stamp":"2023-08-01T19:54:04.040663+0000","objects_scrubbed":0,"log_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-08-03T01:15:27.748810+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[2,1],"acting":[2,1],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":2,"acting_primary":2,"purged_snaps":[]},{"pgid":"4.29","version":"0'0","reported_seq":21,"reported_epoch":29,"state":"active+clean","last_fresh":"2023-08-01T19:54:45.742141+0000","last_change":"2023-08-01T19:54:04.466694+0000","last_active":"2023-08-01T19:54:45.742141+0000","last_peered":"2023-08-01T19:54:45.742141+0000","last_clean":"2023-08-01T19:54:45.742141+0000","last_became_active":"2023-08-01T19:54:04.466250+0000","last_became_peered":"2023-08-01T19:54:04.466250+0000","last_unstale":"2023-08-01T19:54:45.742141+0000","last_undegraded":"2023-08-01T19:54:45.742141+0000","last_fullsized":"2023-08-01T19:54:45.742141+0000","mapping_epoch":16,"log_start":"0'0","ondisk_log_start":"0'0","created":16,"last_epoch_clean":17,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-08-01T19:54:04.040663+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-08-01T19:54:04.040663+0000","last_clean_scrub_stamp":"2023-08-01T19:54:04.040663+0000","objects_scrubbed":0,"log_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-08-03T01:00:18.725898+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[0,1],"acting":[0,1],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":0,"acting_primary":0,"purged_snaps":[]},{"pgid":"4.28","version":"0'0","reported_seq":22,"reported_epoch":30,"state":"active+clean","last_fresh":"2023-08-01T19:54:48.984934+0000","last_change":"2023-08-01T19:54:04.468160+0000","last_active":"2023-08-01T19:54:48.984934+0000","last_peered":"2023-08-01T19:54:48.984934+0000","last_clean":"2023-08-01T19:54:48.984934+0000","last_became_active":"2023-08-01T19:54:04.467625+0000","last_became_peered":"2023-08-01T19:54:04.467625+0000","last_unstale":"2023-08-01T19:54:48.984934+0000","last_undegraded":"2023-08-01T19:54:48.984934+0000","last_fullsized":"2023-08-01T19:54:48.984934+0000","mapping_epoch":16,"log_start":"0'0","ondisk_log_start":"0'0","created":16,"last_epoch_clean":17,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-08-01T19:54:04.040663+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-08-01T19:54:04.040663+0000","last_clean_scrub_stamp":"2023-08-01T19:54:04.040663+0000","objects_scrubbed":0,"log_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-08-02T21:27:52.506153+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[2,0],"acting":[2,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":2,"acting_primary":2,"purged_snaps":[]},{"pgid":"4.27","version":"0'0","reported_seq":22,"reported_epoch":30,"state":"active+clean","last_fresh":"2023-08-01T19:54:48.985772+0000","last_change":"2023-08-01T19:54:04.469187+0000","last_active":"2023-08-01T19:54:48.985772+0000","last_peered":"2023-08-01T19:54:48.985772+0000","last_clean":"2023-08-01T19:54:48.985772+0000","last_became_active":"2023-08-01T19:54:04.468628+0000","last_became_peered":"2023-08-01T19:54:04.468628+0000","last_unstale":"2023-08-01T19:54:48.985772+0000","last_undegraded":"2023-08-01T19:54:48.985772+0000","last_fullsized":"2023-08-01T19:54:48.985772+0000","mapping_epoch":16,"log_start":"0'0","ondisk_log_start":"0'0","created":16,"last_epoch_clean":17,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-08-01T19:54:04.040663+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-08-01T19:54:04.040663+0000","last_clean_scrub_stamp":"2023-08-01T19:54:04.040663+0000","objects_scrubbed":0,"log_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-08-03T00:07:29.565677+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[2,1],"acting":[2,1],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":2,"acting_primary":2,"purged_snaps":[]},{"pgid":"4.26","version":"0'0","reported_seq":21,"reported_epoch":29,"state":"active+clean","last_fresh":"2023-08-01T19:54:45.740576+0000","last_change":"2023-08-01T19:54:04.470942+0000","last_active":"2023-08-01T19:54:45.740576+0000","last_peered":"2023-08-01T19:54:45.740576+0000","last_clean":"2023-08-01T19:54:45.740576+0000","last_became_active":"2023-08-01T19:54:04.470564+0000","last_became_peered":"2023-08-01T19:54:04.470564+0000","last_unstale":"2023-08-01T19:54:45.740576+0000","last_undegraded":"2023-08-01T19:54:45.740576+0000","last_fullsized":"2023-08-01T19:54:45.740576+0000","mapping_epoch":16,"log_start":"0'0","ondisk_log_start":"0'0","created":16,"last_epoch_clean":17,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-08-01T19:54:04.040663+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-08-01T19:54:04.040663+0000","last_clean_scrub_stamp":"2023-08-01T19:54:04.040663+0000","objects_scrubbed":0,"log_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-08-03T04:43:21.408174+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[0,1],"acting":[0,1],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":0,"acting_primary":0,"purged_snaps":[]},{"pgid":"4.25","version":"0'0","reported_seq":21,"reported_epoch":29,"state":"active+clean","last_fresh":"2023-08-01T19:54:45.742367+0000","last_change":"2023-08-01T19:54:04.474813+0000","last_active":"2023-08-01T19:54:45.742367+0000","last_peered":"2023-08-01T19:54:45.742367+0000","last_clean":"2023-08-01T19:54:45.742367+0000","last_became_active":"2023-08-01T19:54:04.472530+0000","last_became_peered":"2023-08-01T19:54:04.472530+0000","last_unstale":"2023-08-01T19:54:45.742367+0000","last_undegraded":"2023-08-01T19:54:45.742367+0000","last_fullsized":"2023-08-01T19:54:45.742367+0000","mapping_epoch":16,"log_start":"0'0","ondisk_log_start":"0'0","created":16,"last_epoch_clean":17,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-08-01T19:54:04.040663+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-08-01T19:54:04.040663+0000","last_clean_scrub_stamp":"2023-08-01T19:54:04.040663+0000","objects_scrubbed":0,"log_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-08-03T01:00:18.725898+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[1,2],"acting":[1,2],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":1,"acting_primary":1,"purged_snaps":[]},{"pgid":"3.1a","version":"17'1","reported_seq":24,"reported_epoch":30,"state":"active+clean","last_fresh":"2023-08-01T19:54:48.985010+0000","last_change":"2023-08-01T19:54:04.063936+0000","last_active":"2023-08-01T19:54:48.985010+0000","last_peered":"2023-08-01T19:54:48.985010+0000","last_clean":"2023-08-01T19:54:48.985010+0000","last_became_active":"2023-08-01T19:54:04.063674+0000","last_became_peered":"2023-08-01T19:54:04.063674+0000","last_unstale":"2023-08-01T19:54:48.985010+0000","last_undegraded":"2023-08-01T19:54:48.985010+0000","last_fullsized":"2023-08-01T19:54:48.985010+0000","mapping_epoch":15,"log_start":"0'0","ondisk_log_start":"0'0","created":15,"last_epoch_clean":16,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-08-01T19:54:03.032665+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-08-01T19:54:03.032665+0000","last_clean_scrub_stamp":"2023-08-01T19:54:03.032665+0000","objects_scrubbed":0,"log_size":1,"ondisk_log_size":1,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-08-03T00:06:00.058200+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[2,0],"acting":[2,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":2,"acting_primary":2,"purged_snaps":[]},{"pgid":"4.1d","version":"0'0","reported_seq":22,"reported_epoch":30,"state":"active+clean","last_fresh":"2023-08-01T19:54:48.985574+0000","last_change":"2023-08-01T19:54:04.471916+0000","last_active":"2023-08-01T19:54:48.985574+0000","last_peered":"2023-08-01T19:54:48.985574+0000","last_clean":"2023-08-01T19:54:48.985574+0000","last_became_active":"2023-08-01T19:54:04.471480+0000","last_became_peered":"2023-08-01T19:54:04.471480+0000","last_unstale":"2023-08-01T19:54:48.985574+0000","last_undegraded":"2023-08-01T19:54:48.985574+0000","last_fullsized":"2023-08-01T19:54:48.985574+0000","mapping_epoch":16,"log_start":"0'0","ondisk_log_start":"0'0","created":16,"last_epoch_clean":17,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-08-01T19:54:04.040663+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-08-01T19:54:04.040663+0000","last_clean_scrub_stamp":"2023-08-01T19:54:04.040663+0000","objects_scrubbed":0,"log_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-08-02T21:19:17.547590+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[2,1],"acting":[2,1],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":2,"acting_primary":2,"purged_snaps":[]},{"pgid":"3.19","version":"0'0","reported_seq":22,"reported_epoch":29,"state":"active+clean","last_fresh":"2023-08-01T19:54:45.742186+0000","last_change":"2023-08-01T19:54:04.067837+0000","last_active":"2023-08-01T19:54:45.742186+0000","last_peered":"2023-08-01T19:54:45.742186+0000","last_clean":"2023-08-01T19:54:45.742186+0000","last_became_active":"2023-08-01T19:54:04.067535+0000","last_became_peered":"2023-08-01T19:54:04.067535+0000","last_unstale":"2023-08-01T19:54:45.742186+0000","last_undegraded":"2023-08-01T19:54:45.742186+0000","last_fullsized":"2023-08-01T19:54:45.742186+0000","mapping_epoch":15,"log_start":"0'0","ondisk_log_start":"0'0","created":15,"last_epoch_clean":16,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-08-01T19:54:03.032665+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-08-01T19:54:03.032665+0000","last_clean_scrub_stamp":"2023-08-01T19:54:03.032665+0000","objects_scrubbed":0,"log_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-08-02T20:56:47.324761+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[0,1],"acting":[0,1],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":0,"acting_primary":0,"purged_snaps":[]},{"pgid":"4.1e","version":"0'0","reported_seq":21,"reported_epoch":29,"state":"active+clean","last_fresh":"2023-08-01T19:54:45.740665+0000","last_change":"2023-08-01T19:54:04.470544+0000","last_active":"2023-08-01T19:54:45.740665+0000","last_peered":"2023-08-01T19:54:45.740665+0000","last_clean":"2023-08-01T19:54:45.740665+0000","last_became_active":"2023-08-01T19:54:04.469657+0000","last_became_peered":"2023-08-01T19:54:04.469657+0000","last_unstale":"2023-08-01T19:54:45.740665+0000","last_undegraded":"2023-08-01T19:54:45.740665+0000","last_fullsized":"2023-08-01T19:54:45.740665+0000","mapping_epoch":16,"log_start":"0'0","ondisk_log_start":"0'0","created":16,"last_epoch_clean":17,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-08-01T19:54:04.040663+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-08-01T19:54:04.040663+0000","last_clean_scrub_stamp":"2023-08-01T19:54:04.040663+0000","objects_scrubbed":0,"log_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-08-02T23:12:30.830199+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[0,1],"acting":[0,1],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":0,"acting_primary":0,"purged_snaps":[]},{"pgid":"3.18","version":"0'0","reported_seq":22,"reported_epoch":29,"state":"active+clean","last_fresh":"2023-08-01T19:54:45.741597+0000","last_change":"2023-08-01T19:54:04.064289+0000","last_active":"2023-08-01T19:54:45.741597+0000","last_peered":"2023-08-01T19:54:45.741597+0000","last_clean":"2023-08-01T19:54:45.741597+0000","last_became_active":"2023-08-01T19:54:04.063971+0000","last_became_peered":"2023-08-01T19:54:04.063971+0000","last_unstale":"2023-08-01T19:54:45.741597+0000","last_undegraded":"2023-08-01T19:54:45.741597+0000","last_fullsized":"2023-08-01T19:54:45.741597+0000","mapping_epoch":15,"log_start":"0'0","ondisk_log_start":"0'0","created":15,"last_epoch_clean":16,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-08-01T19:54:03.032665+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-08-01T19:54:03.032665+0000","last_clean_scrub_stamp":"2023-08-01T19:54:03.032665+0000","objects_scrubbed":0,"log_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-08-03T04:09:30.496098+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[0,2],"acting":[0,2],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":0,"acting_primary":0,"purged_snaps":[]},{"pgid":"4.1f","version":"0'0","reported_seq":22,"reported_epoch":30,"state":"active+clean","last_fresh":"2023-08-01T19:54:48.985767+0000","last_change":"2023-08-01T19:54:04.472227+0000","last_active":"2023-08-01T19:54:48.985767+0000","last_peered":"2023-08-01T19:54:48.985767+0000","last_clean":"2023-08-01T19:54:48.985767+0000","last_became_active":"2023-08-01T19:54:04.471767+0000","last_became_peered":"2023-08-01T19:54:04.471767+0000","last_unstale":"2023-08-01T19:54:48.985767+0000","last_undegraded":"2023-08-01T19:54:48.985767+0000","last_fullsized":"2023-08-01T19:54:48.985767+0000","mapping_epoch":16,"log_start":"0'0","ondisk_log_start":"0'0","created":16,"last_epoch_clean":17,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-08-01T19:54:04.040663+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-08-01T19:54:04.040663+0000","last_clean_scrub_stamp":"2023-08-01T19:54:04.040663+0000","objects_scrubbed":0,"log_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-08-02T20:25:25.280329+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[2,1],"acting":[2,1],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":2,"acting_primary":2,"purged_snaps":[]},{"pgid":"3.17","version":"0'0","reported_seq":22,"reported_epoch":29,"state":"active+clean","last_fresh":"2023-08-01T19:54:45.740787+0000","last_change":"2023-08-01T19:54:04.067975+0000","last_active":"2023-08-01T19:54:45.740787+0000","last_peered":"2023-08-01T19:54:45.740787+0000","last_clean":"2023-08-01T19:54:45.740787+0000","last_became_active":"2023-08-01T19:54:04.067577+0000","last_became_peered":"2023-08-01T19:54:04.067577+0000","last_unstale":"2023-08-01T19:54:45.740787+0000","last_undegraded":"2023-08-01T19:54:45.740787+0000","last_fullsized":"2023-08-01T19:54:45.740787+0000","mapping_epoch":15,"log_start":"0'0","ondisk_log_start":"0'0","created":15,"last_epoch_clean":16,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-08-01T19:54:03.032665+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-08-01T19:54:03.032665+0000","last_clean_scrub_stamp":"2023-08-01T19:54:03.032665+0000","objects_scrubbed":0,"log_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-08-03T07:13:34.025722+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[0,1],"acting":[0,1],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":0,"acting_primary":0,"purged_snaps":[]},{"pgid":"4.10","version":"0'0","reported_seq":21,"reported_epoch":29,"state":"active+clean","last_fresh":"2023-08-01T19:54:45.741461+0000","last_change":"2023-08-01T19:54:04.467146+0000","last_active":"2023-08-01T19:54:45.741461+0000","last_peered":"2023-08-01T19:54:45.741461+0000","last_clean":"2023-08-01T19:54:45.741461+0000","last_became_active":"2023-08-01T19:54:04.466627+0000","last_became_peered":"2023-08-01T19:54:04.466627+0000","last_unstale":"2023-08-01T19:54:45.741461+0000","last_undegraded":"2023-08-01T19:54:45.741461+0000","last_fullsized":"2023-08-01T19:54:45.741461+0000","mapping_epoch":16,"log_start":"0'0","ondisk_log_start":"0'0","created":16,"last_epoch_clean":17,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-08-01T19:54:04.040663+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-08-01T19:54:04.040663+0000","last_clean_scrub_stamp":"2023-08-01T19:54:04.040663+0000","objects_scrubbed":0,"log_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-08-03T04:43:26.793480+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[0,2],"acting":[0,2],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":0,"acting_primary":0,"purged_snaps":[]},{"pgid":"3.16","version":"0'0","reported_seq":22,"reported_epoch":29,"state":"active+clean","last_fresh":"2023-08-01T19:54:45.742084+0000","last_change":"2023-08-01T19:54:04.065042+0000","last_active":"2023-08-01T19:54:45.742084+0000","last_peered":"2023-08-01T19:54:45.742084+0000","last_clean":"2023-08-01T19:54:45.742084+0000","last_became_active":"2023-08-01T19:54:04.064040+0000","last_became_peered":"2023-08-01T19:54:04.064040+0000","last_unstale":"2023-08-01T19:54:45.742084+0000","last_undegraded":"2023-08-01T19:54:45.742084+0000","last_fullsized":"2023-08-01T19:54:45.742084+0000","mapping_epoch":15,"log_start":"0'0","ondisk_log_start":"0'0","created":15,"last_epoch_clean":16,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-08-01T19:54:03.032665+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-08-01T19:54:03.032665+0000","last_clean_scrub_stamp":"2023-08-01T19:54:03.032665+0000","objects_scrubbed":0,"log_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-08-03T03:40:43.460182+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[1,0],"acting":[1,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":1,"acting_primary":1,"purged_snaps":[]},{"pgid":"4.11","version":"0'0","reported_seq":21,"reported_epoch":29,"state":"active+clean","last_fresh":"2023-08-01T19:54:45.742258+0000","last_change":"2023-08-01T19:54:04.470401+0000","last_active":"2023-08-01T19:54:45.742258+0000","last_peered":"2023-08-01T19:54:45.742258+0000","last_clean":"2023-08-01T19:54:45.742258+0000","last_became_active":"2023-08-01T19:54:04.469680+0000","last_became_peered":"2023-08-01T19:54:04.469680+0000","last_unstale":"2023-08-01T19:54:45.742258+0000","last_undegraded":"2023-08-01T19:54:45.742258+0000","last_fullsized":"2023-08-01T19:54:45.742258+0000","mapping_epoch":16,"log_start":"0'0","ondisk_log_start":"0'0","created":16,"last_epoch_clean":17,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-08-01T19:54:04.040663+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-08-01T19:54:04.040663+0000","last_clean_scrub_stamp":"2023-08-01T19:54:04.040663+0000","objects_scrubbed":0,"log_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-08-03T03:58:06.360840+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[0,1],"acting":[0,1],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":0,"acting_primary":0,"purged_snaps":[]},{"pgid":"3.15","version":"17'3","reported_seq":26,"reported_epoch":30,"state":"active+clean","last_fresh":"2023-08-01T19:54:48.985297+0000","last_change":"2023-08-01T19:54:04.065443+0000","last_active":"2023-08-01T19:54:48.985297+0000","last_peered":"2023-08-01T19:54:48.985297+0000","last_clean":"2023-08-01T19:54:48.985297+0000","last_became_active":"2023-08-01T19:54:04.065112+0000","last_became_peered":"2023-08-01T19:54:04.065112+0000","last_unstale":"2023-08-01T19:54:48.985297+0000","last_undegraded":"2023-08-01T19:54:48.985297+0000","last_fullsized":"2023-08-01T19:54:48.985297+0000","mapping_epoch":15,"log_start":"0'0","ondisk_log_start":"0'0","created":15,"last_epoch_clean":16,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-08-01T19:54:03.032665+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-08-01T19:54:03.032665+0000","last_clean_scrub_stamp":"2023-08-01T19:54:03.032665+0000","objects_scrubbed":0,"log_size":3,"ondisk_log_size":3,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-08-03T03:27:50.887004+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":90,"num_objects":2,"num_object_clones":0,"num_object_copies":4,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":2,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":4,"num_write_kb":1,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":1,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[2,1],"acting":[2,1],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":2,"acting_primary":2,"purged_snaps":[]},{"pgid":"4.12","version":"0'0","reported_seq":21,"reported_epoch":29,"state":"active+clean","last_fresh":"2023-08-01T19:54:45.740203+0000","last_change":"2023-08-01T19:54:04.467822+0000","last_active":"2023-08-01T19:54:45.740203+0000","last_peered":"2023-08-01T19:54:45.740203+0000","last_clean":"2023-08-01T19:54:45.740203+0000","last_became_active":"2023-08-01T19:54:04.466667+0000","last_became_peered":"2023-08-01T19:54:04.466667+0000","last_unstale":"2023-08-01T19:54:45.740203+0000","last_undegraded":"2023-08-01T19:54:45.740203+0000","last_fullsized":"2023-08-01T19:54:45.740203+0000","mapping_epoch":16,"log_start":"0'0","ondisk_log_start":"0'0","created":16,"last_epoch_clean":17,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-08-01T19:54:04.040663+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-08-01T19:54:04.040663+0000","last_clean_scrub_stamp":"2023-08-01T19:54:04.040663+0000","objects_scrubbed":0,"log_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-08-03T02:57:18.148077+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[0,2],"acting":[0,2],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":0,"acting_primary":0,"purged_snaps":[]},{"pgid":"3.14","version":"17'6","reported_seq":28,"reported_epoch":29,"state":"active+clean","last_fresh":"2023-08-01T19:54:45.742216+0000","last_change":"2023-08-01T19:54:04.061419+0000","last_active":"2023-08-01T19:54:45.742216+0000","last_peered":"2023-08-01T19:54:45.742216+0000","last_clean":"2023-08-01T19:54:45.742216+0000","last_became_active":"2023-08-01T19:54:04.061078+0000","last_became_peered":"2023-08-01T19:54:04.061078+0000","last_unstale":"2023-08-01T19:54:45.742216+0000","last_undegraded":"2023-08-01T19:54:45.742216+0000","last_fullsized":"2023-08-01T19:54:45.742216+0000","mapping_epoch":15,"log_start":"0'0","ondisk_log_start":"0'0","created":15,"last_epoch_clean":16,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-08-01T19:54:03.032665+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-08-01T19:54:03.032665+0000","last_clean_scrub_stamp":"2023-08-01T19:54:03.032665+0000","objects_scrubbed":0,"log_size":6,"ondisk_log_size":6,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-08-02T21:35:44.874727+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":1536,"num_objects":4,"num_object_clones":0,"num_object_copies":8,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":4,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":6,"num_write_kb":3,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":1,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[1,2],"acting":[1,2],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":1,"acting_primary":1,"purged_snaps":[]},{"pgid":"4.13","version":"0'0","reported_seq":21,"reported_epoch":29,"state":"active+clean","last_fresh":"2023-08-01T19:54:45.741898+0000","last_change":"2023-08-01T19:54:04.466400+0000","last_active":"2023-08-01T19:54:45.741898+0000","last_peered":"2023-08-01T19:54:45.741898+0000","last_clean":"2023-08-01T19:54:45.741898+0000","last_became_active":"2023-08-01T19:54:04.465979+0000","last_became_peered":"2023-08-01T19:54:04.465979+0000","last_unstale":"2023-08-01T19:54:45.741898+0000","last_undegraded":"2023-08-01T19:54:45.741898+0000","last_fullsized":"2023-08-01T19:54:45.741898+0000","mapping_epoch":16,"log_start":"0'0","ondisk_log_start":"0'0","created":16,"last_epoch_clean":17,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-08-01T19:54:04.040663+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-08-01T19:54:04.040663+0000","last_clean_scrub_stamp":"2023-08-01T19:54:04.040663+0000","objects_scrubbed":0,"log_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-08-02T20:20:59.989030+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[1,2],"acting":[1,2],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":1,"acting_primary":1,"purged_snaps":[]},{"pgid":"3.13","version":"17'2","reported_seq":24,"reported_epoch":29,"state":"active+clean","last_fresh":"2023-08-01T19:54:45.741815+0000","last_change":"2023-08-01T19:54:04.065212+0000","last_active":"2023-08-01T19:54:45.741815+0000","last_peered":"2023-08-01T19:54:45.741815+0000","last_clean":"2023-08-01T19:54:45.741815+0000","last_became_active":"2023-08-01T19:54:04.064375+0000","last_became_peered":"2023-08-01T19:54:04.064375+0000","last_unstale":"2023-08-01T19:54:45.741815+0000","last_undegraded":"2023-08-01T19:54:45.741815+0000","last_fullsized":"2023-08-01T19:54:45.741815+0000","mapping_epoch":15,"log_start":"0'0","ondisk_log_start":"0'0","created":15,"last_epoch_clean":16,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-08-01T19:54:03.032665+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-08-01T19:54:03.032665+0000","last_clean_scrub_stamp":"2023-08-01T19:54:03.032665+0000","objects_scrubbed":0,"log_size":2,"ondisk_log_size":2,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-08-03T06:17:37.910752+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":34,"num_objects":2,"num_object_clones":0,"num_object_copies":4,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":2,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":3,"num_write_kb":6,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":1,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[1,0],"acting":[1,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":1,"acting_primary":1,"purged_snaps":[]},{"pgid":"4.14","version":"0'0","reported_seq":22,"reported_epoch":30,"state":"active+clean","last_fresh":"2023-08-01T19:54:48.984821+0000","last_change":"2023-08-01T19:54:04.464446+0000","last_active":"2023-08-01T19:54:48.984821+0000","last_peered":"2023-08-01T19:54:48.984821+0000","last_clean":"2023-08-01T19:54:48.984821+0000","last_became_active":"2023-08-01T19:54:04.464021+0000","last_became_peered":"2023-08-01T19:54:04.464021+0000","last_unstale":"2023-08-01T19:54:48.984821+0000","last_undegraded":"2023-08-01T19:54:48.984821+0000","last_fullsized":"2023-08-01T19:54:48.984821+0000","mapping_epoch":16,"log_start":"0'0","ondisk_log_start":"0'0","created":16,"last_epoch_clean":17,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-08-01T19:54:04.040663+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-08-01T19:54:04.040663+0000","last_clean_scrub_stamp":"2023-08-01T19:54:04.040663+0000","objects_scrubbed":0,"log_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-08-02T20:26:51.080849+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[2,0],"acting":[2,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":2,"acting_primary":2,"purged_snaps":[]},{"pgid":"3.12","version":"0'0","reported_seq":22,"reported_epoch":29,"state":"active+clean","last_fresh":"2023-08-01T19:54:45.740337+0000","last_change":"2023-08-01T19:54:04.066566+0000","last_active":"2023-08-01T19:54:45.740337+0000","last_peered":"2023-08-01T19:54:45.740337+0000","last_clean":"2023-08-01T19:54:45.740337+0000","last_became_active":"2023-08-01T19:54:04.066190+0000","last_became_peered":"2023-08-01T19:54:04.066190+0000","last_unstale":"2023-08-01T19:54:45.740337+0000","last_undegraded":"2023-08-01T19:54:45.740337+0000","last_fullsized":"2023-08-01T19:54:45.740337+0000","mapping_epoch":15,"log_start":"0'0","ondisk_log_start":"0'0","created":15,"last_epoch_clean":16,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-08-01T19:54:03.032665+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-08-01T19:54:03.032665+0000","last_clean_scrub_stamp":"2023-08-01T19:54:03.032665+0000","objects_scrubbed":0,"log_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-08-03T02:01:47.073630+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[0,1],"acting":[0,1],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":0,"acting_primary":0,"purged_snaps":[]},{"pgid":"4.15","version":"0'0","reported_seq":22,"reported_epoch":30,"state":"active+clean","last_fresh":"2023-08-01T19:54:48.985450+0000","last_change":"2023-08-01T19:54:04.468791+0000","last_active":"2023-08-01T19:54:48.985450+0000","last_peered":"2023-08-01T19:54:48.985450+0000","last_clean":"2023-08-01T19:54:48.985450+0000","last_became_active":"2023-08-01T19:54:04.468214+0000","last_became_peered":"2023-08-01T19:54:04.468214+0000","last_unstale":"2023-08-01T19:54:48.985450+0000","last_undegraded":"2023-08-01T19:54:48.985450+0000","last_fullsized":"2023-08-01T19:54:48.985450+0000","mapping_epoch":16,"log_start":"0'0","ondisk_log_start":"0'0","created":16,"last_epoch_clean":17,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-08-01T19:54:04.040663+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-08-01T19:54:04.040663+0000","last_clean_scrub_stamp":"2023-08-01T19:54:04.040663+0000","objects_scrubbed":0,"log_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-08-03T04:10:44.729287+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[2,0],"acting":[2,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":2,"acting_primary":2,"purged_snaps":[]},{"pgid":"3.11","version":"0'0","reported_seq":23,"reported_epoch":30,"state":"active+clean","last_fresh":"2023-08-01T19:54:48.984651+0000","last_change":"2023-08-01T19:54:04.064280+0000","last_active":"2023-08-01T19:54:48.984651+0000","last_peered":"2023-08-01T19:54:48.984651+0000","last_clean":"2023-08-01T19:54:48.984651+0000","last_became_active":"2023-08-01T19:54:04.064064+0000","last_became_peered":"2023-08-01T19:54:04.064064+0000","last_unstale":"2023-08-01T19:54:48.984651+0000","last_undegraded":"2023-08-01T19:54:48.984651+0000","last_fullsized":"2023-08-01T19:54:48.984651+0000","mapping_epoch":15,"log_start":"0'0","ondisk_log_start":"0'0","created":15,"last_epoch_clean":16,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-08-01T19:54:03.032665+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-08-01T19:54:03.032665+0000","last_clean_scrub_stamp":"2023-08-01T19:54:03.032665+0000","objects_scrubbed":0,"log_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-08-03T06:13:51.475710+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[2,1],"acting":[2,1],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":2,"acting_primary":2,"purged_snaps":[]},{"pgid":"4.16","version":"0'0","reported_seq":21,"reported_epoch":29,"state":"active+clean","last_fresh":"2023-08-01T19:54:45.740711+0000","last_change":"2023-08-01T19:54:04.469724+0000","last_active":"2023-08-01T19:54:45.740711+0000","last_peered":"2023-08-01T19:54:45.740711+0000","last_clean":"2023-08-01T19:54:45.740711+0000","last_became_active":"2023-08-01T19:54:04.469275+0000","last_became_peered":"2023-08-01T19:54:04.469275+0000","last_unstale":"2023-08-01T19:54:45.740711+0000","last_undegraded":"2023-08-01T19:54:45.740711+0000","last_fullsized":"2023-08-01T19:54:45.740711+0000","mapping_epoch":16,"log_start":"0'0","ondisk_log_start":"0'0","created":16,"last_epoch_clean":17,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-08-01T19:54:04.040663+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-08-01T19:54:04.040663+0000","last_clean_scrub_stamp":"2023-08-01T19:54:04.040663+0000","objects_scrubbed":0,"log_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-08-03T03:04:06.137335+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[0,1],"acting":[0,1],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":0,"acting_primary":0,"purged_snaps":[]},{"pgid":"3.10","version":"17'8","reported_seq":30,"reported_epoch":29,"state":"active+clean","last_fresh":"2023-08-01T19:54:45.741608+0000","last_change":"2023-08-01T19:54:04.060962+0000","last_active":"2023-08-01T19:54:45.741608+0000","last_peered":"2023-08-01T19:54:45.741608+0000","last_clean":"2023-08-01T19:54:45.741608+0000","last_became_active":"2023-08-01T19:54:04.060576+0000","last_became_peered":"2023-08-01T19:54:04.060576+0000","last_unstale":"2023-08-01T19:54:45.741608+0000","last_undegraded":"2023-08-01T19:54:45.741608+0000","last_fullsized":"2023-08-01T19:54:45.741608+0000","mapping_epoch":15,"log_start":"0'0","ondisk_log_start":"0'0","created":15,"last_epoch_clean":16,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-08-01T19:54:03.032665+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-08-01T19:54:03.032665+0000","last_clean_scrub_stamp":"2023-08-01T19:54:03.032665+0000","objects_scrubbed":0,"log_size":8,"ondisk_log_size":8,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-08-03T05:00:51.171444+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":4,"num_object_clones":0,"num_object_copies":8,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":4,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":12,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":4,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[1,2],"acting":[1,2],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":1,"acting_primary":1,"purged_snaps":[]},{"pgid":"4.17","version":"0'0","reported_seq":21,"reported_epoch":29,"state":"active+clean","last_fresh":"2023-08-01T19:54:45.740978+0000","last_change":"2023-08-01T19:54:04.472721+0000","last_active":"2023-08-01T19:54:45.740978+0000","last_peered":"2023-08-01T19:54:45.740978+0000","last_clean":"2023-08-01T19:54:45.740978+0000","last_became_active":"2023-08-01T19:54:04.472126+0000","last_became_peered":"2023-08-01T19:54:04.472126+0000","last_unstale":"2023-08-01T19:54:45.740978+0000","last_undegraded":"2023-08-01T19:54:45.740978+0000","last_fullsized":"2023-08-01T19:54:45.740978+0000","mapping_epoch":16,"log_start":"0'0","ondisk_log_start":"0'0","created":16,"last_epoch_clean":17,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-08-01T19:54:04.040663+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-08-01T19:54:04.040663+0000","last_clean_scrub_stamp":"2023-08-01T19:54:04.040663+0000","objects_scrubbed":0,"log_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-08-03T00:29:05.857138+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[0,1],"acting":[0,1],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":0,"acting_primary":0,"purged_snaps":[]},{"pgid":"5.9","version":"30'4478","reported_seq":4496,"reported_epoch":30,"state":"active+clean","last_fresh":"2023-08-01T19:54:49.915246+0000","last_change":"2023-08-01T19:54:23.134838+0000","last_active":"2023-08-01T19:54:49.915246+0000","last_peered":"2023-08-01T19:54:49.915246+0000","last_clean":"2023-08-01T19:54:49.915246+0000","last_became_active":"2023-08-01T19:54:23.134628+0000","last_became_peered":"2023-08-01T19:54:23.134628+0000","last_unstale":"2023-08-01T19:54:49.915246+0000","last_undegraded":"2023-08-01T19:54:49.915246+0000","last_fullsized":"2023-08-01T19:54:49.915246+0000","mapping_epoch":19,"log_start":"22'700","ondisk_log_start":"22'700","created":19,"last_epoch_clean":20,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-08-01T19:54:22.116710+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-08-01T19:54:22.116710+0000","last_clean_scrub_stamp":"2023-08-01T19:54:22.116710+0000","objects_scrubbed":0,"log_size":3778,"ondisk_log_size":3778,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-08-03T05:57:20.085794+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":293470208,"num_objects":4478,"num_object_clones":0,"num_object_copies":8956,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":4478,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":4478,"num_write_kb":286592,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[1,2],"acting":[1,2],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":1,"acting_primary":1,"purged_snaps":[]},{"pgid":"3.f","version":"17'1","reported_seq":23,"reported_epoch":29,"state":"active+clean","last_fresh":"2023-08-01T19:54:45.742110+0000","last_change":"2023-08-01T19:54:04.060797+0000","last_active":"2023-08-01T19:54:45.742110+0000","last_peered":"2023-08-01T19:54:45.742110+0000","last_clean":"2023-08-01T19:54:45.742110+0000","last_became_active":"2023-08-01T19:54:04.060444+0000","last_became_peered":"2023-08-01T19:54:04.060444+0000","last_unstale":"2023-08-01T19:54:45.742110+0000","last_undegraded":"2023-08-01T19:54:45.742110+0000","last_fullsized":"2023-08-01T19:54:45.742110+0000","mapping_epoch":15,"log_start":"0'0","ondisk_log_start":"0'0","created":15,"last_epoch_clean":16,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-08-01T19:54:03.032665+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-08-01T19:54:03.032665+0000","last_clean_scrub_stamp":"2023-08-01T19:54:03.032665+0000","objects_scrubbed":0,"log_size":1,"ondisk_log_size":1,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-08-03T07:13:34.025722+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":22,"num_objects":1,"num_object_clones":0,"num_object_copies":2,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":1,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":1,"num_write_kb":1,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[1,2],"acting":[1,2],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":1,"acting_primary":1,"purged_snaps":[]},{"pgid":"4.8","version":"0'0","reported_seq":22,"reported_epoch":30,"state":"active+clean","last_fresh":"2023-08-01T19:54:48.984556+0000","last_change":"2023-08-01T19:54:04.467671+0000","last_active":"2023-08-01T19:54:48.984556+0000","last_peered":"2023-08-01T19:54:48.984556+0000","last_clean":"2023-08-01T19:54:48.984556+0000","last_became_active":"2023-08-01T19:54:04.467300+0000","last_became_peered":"2023-08-01T19:54:04.467300+0000","last_unstale":"2023-08-01T19:54:48.984556+0000","last_undegraded":"2023-08-01T19:54:48.984556+0000","last_fullsized":"2023-08-01T19:54:48.984556+0000","mapping_epoch":16,"log_start":"0'0","ondisk_log_start":"0'0","created":16,"last_epoch_clean":17,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-08-01T19:54:04.040663+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-08-01T19:54:04.040663+0000","last_clean_scrub_stamp":"2023-08-01T19:54:04.040663+0000","objects_scrubbed":0,"log_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-08-03T05:27:24.774345+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[2,1],"acting":[2,1],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":2,"acting_primary":2,"purged_snaps":[]},{"pgid":"5.8","version":"31'4515","reported_seq":4534,"reported_epoch":31,"state":"active+clean","last_fresh":"2023-08-01T19:54:51.039621+0000","last_change":"2023-08-01T19:54:23.139383+0000","last_active":"2023-08-01T19:54:51.039621+0000","last_peered":"2023-08-01T19:54:51.039621+0000","last_clean":"2023-08-01T19:54:51.039621+0000","last_became_active":"2023-08-01T19:54:23.139198+0000","last_became_peered":"2023-08-01T19:54:23.139198+0000","last_unstale":"2023-08-01T19:54:51.039621+0000","last_undegraded":"2023-08-01T19:54:51.039621+0000","last_fullsized":"2023-08-01T19:54:51.039621+0000","mapping_epoch":19,"log_start":"22'500","ondisk_log_start":"22'500","created":19,"last_epoch_clean":20,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-08-01T19:54:22.116710+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-08-01T19:54:22.116710+0000","last_clean_scrub_stamp":"2023-08-01T19:54:22.116710+0000","objects_scrubbed":0,"log_size":4015,"ondisk_log_size":4015,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-08-03T05:20:31.724064+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":295895040,"num_objects":4515,"num_object_clones":0,"num_object_copies":9030,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":4515,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":4515,"num_write_kb":288960,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[2,0],"acting":[2,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":2,"acting_primary":2,"purged_snaps":[]},{"pgid":"3.e","version":"17'2","reported_seq":25,"reported_epoch":30,"state":"active+clean","last_fresh":"2023-08-01T19:54:48.985462+0000","last_change":"2023-08-01T19:54:04.065595+0000","last_active":"2023-08-01T19:54:48.985462+0000","last_peered":"2023-08-01T19:54:48.985462+0000","last_clean":"2023-08-01T19:54:48.985462+0000","last_became_active":"2023-08-01T19:54:04.065303+0000","last_became_peered":"2023-08-01T19:54:04.065303+0000","last_unstale":"2023-08-01T19:54:48.985462+0000","last_undegraded":"2023-08-01T19:54:48.985462+0000","last_fullsized":"2023-08-01T19:54:48.985462+0000","mapping_epoch":15,"log_start":"0'0","ondisk_log_start":"0'0","created":15,"last_epoch_clean":16,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-08-01T19:54:03.032665+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-08-01T19:54:03.032665+0000","last_clean_scrub_stamp":"2023-08-01T19:54:03.032665+0000","objects_scrubbed":0,"log_size":2,"ondisk_log_size":2,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-08-02T22:40:38.782053+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":1,"num_object_clones":0,"num_object_copies":2,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":1,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":3,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":1,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[2,1],"acting":[2,1],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":2,"acting_primary":2,"purged_snaps":[]},{"pgid":"4.9","version":"0'0","reported_seq":22,"reported_epoch":30,"state":"active+clean","last_fresh":"2023-08-01T19:54:48.984740+0000","last_change":"2023-08-01T19:54:04.468007+0000","last_active":"2023-08-01T19:54:48.984740+0000","last_peered":"2023-08-01T19:54:48.984740+0000","last_clean":"2023-08-01T19:54:48.984740+0000","last_became_active":"2023-08-01T19:54:04.467509+0000","last_became_peered":"2023-08-01T19:54:04.467509+0000","last_unstale":"2023-08-01T19:54:48.984740+0000","last_undegraded":"2023-08-01T19:54:48.984740+0000","last_fullsized":"2023-08-01T19:54:48.984740+0000","mapping_epoch":16,"log_start":"0'0","ondisk_log_start":"0'0","created":16,"last_epoch_clean":17,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-08-01T19:54:04.040663+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-08-01T19:54:04.040663+0000","last_clean_scrub_stamp":"2023-08-01T19:54:04.040663+0000","objects_scrubbed":0,"log_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-08-03T06:04:50.963711+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[2,0],"acting":[2,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":2,"acting_primary":2,"purged_snaps":[]},{"pgid":"5.b","version":"31'4458","reported_seq":4477,"reported_epoch":31,"state":"active+clean","last_fresh":"2023-08-01T19:54:51.044018+0000","last_change":"2023-08-01T19:54:23.138143+0000","last_active":"2023-08-01T19:54:51.044018+0000","last_peered":"2023-08-01T19:54:51.044018+0000","last_clean":"2023-08-01T19:54:51.044018+0000","last_became_active":"2023-08-01T19:54:23.137922+0000","last_became_peered":"2023-08-01T19:54:23.137922+0000","last_unstale":"2023-08-01T19:54:51.044018+0000","last_undegraded":"2023-08-01T19:54:51.044018+0000","last_fullsized":"2023-08-01T19:54:51.044018+0000","mapping_epoch":19,"log_start":"22'500","ondisk_log_start":"22'500","created":19,"last_epoch_clean":20,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-08-01T19:54:22.116710+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-08-01T19:54:22.116710+0000","last_clean_scrub_stamp":"2023-08-01T19:54:22.116710+0000","objects_scrubbed":0,"log_size":3958,"ondisk_log_size":3958,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-08-02T23:27:13.080055+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":292159488,"num_objects":4458,"num_object_clones":0,"num_object_copies":8916,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":4458,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":4458,"num_write_kb":285312,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[2,0],"acting":[2,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":2,"acting_primary":2,"purged_snaps":[]},{"pgid":"3.d","version":"17'1","reported_seq":23,"reported_epoch":29,"state":"active+clean","last_fresh":"2023-08-01T19:54:45.742360+0000","last_change":"2023-08-01T19:54:04.062853+0000","last_active":"2023-08-01T19:54:45.742360+0000","last_peered":"2023-08-01T19:54:45.742360+0000","last_clean":"2023-08-01T19:54:45.742360+0000","last_became_active":"2023-08-01T19:54:04.062598+0000","last_became_peered":"2023-08-01T19:54:04.062598+0000","last_unstale":"2023-08-01T19:54:45.742360+0000","last_undegraded":"2023-08-01T19:54:45.742360+0000","last_fullsized":"2023-08-01T19:54:45.742360+0000","mapping_epoch":15,"log_start":"0'0","ondisk_log_start":"0'0","created":15,"last_epoch_clean":16,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-08-01T19:54:03.032665+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-08-01T19:54:03.032665+0000","last_clean_scrub_stamp":"2023-08-01T19:54:03.032665+0000","objects_scrubbed":0,"log_size":1,"ondisk_log_size":1,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-08-02T20:56:47.324761+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":70,"num_objects":1,"num_object_clones":0,"num_object_copies":2,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":1,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":1,"num_write_kb":1,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[1,2],"acting":[1,2],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":1,"acting_primary":1,"purged_snaps":[]},{"pgid":"4.a","version":"0'0","reported_seq":21,"reported_epoch":29,"state":"active+clean","last_fresh":"2023-08-01T19:54:45.741733+0000","last_change":"2023-08-01T19:54:04.471997+0000","last_active":"2023-08-01T19:54:45.741733+0000","last_peered":"2023-08-01T19:54:45.741733+0000","last_clean":"2023-08-01T19:54:45.741733+0000","last_became_active":"2023-08-01T19:54:04.471204+0000","last_became_peered":"2023-08-01T19:54:04.471204+0000","last_unstale":"2023-08-01T19:54:45.741733+0000","last_undegraded":"2023-08-01T19:54:45.741733+0000","last_fullsized":"2023-08-01T19:54:45.741733+0000","mapping_epoch":16,"log_start":"0'0","ondisk_log_start":"0'0","created":16,"last_epoch_clean":17,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-08-01T19:54:04.040663+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-08-01T19:54:04.040663+0000","last_clean_scrub_stamp":"2023-08-01T19:54:04.040663+0000","objects_scrubbed":0,"log_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-08-02T23:12:30.830199+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[1,0],"acting":[1,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":1,"acting_primary":1,"purged_snaps":[]},{"pgid":"5.a","version":"30'4345","reported_seq":4363,"reported_epoch":30,"state":"active+clean","last_fresh":"2023-08-01T19:54:49.929380+0000","last_change":"2023-08-01T19:54:23.138147+0000","last_active":"2023-08-01T19:54:49.929380+0000","last_peered":"2023-08-01T19:54:49.929380+0000","last_clean":"2023-08-01T19:54:49.929380+0000","last_became_active":"2023-08-01T19:54:23.137827+0000","last_became_peered":"2023-08-01T19:54:23.137827+0000","last_unstale":"2023-08-01T19:54:49.929380+0000","last_undegraded":"2023-08-01T19:54:49.929380+0000","last_fullsized":"2023-08-01T19:54:49.929380+0000","mapping_epoch":19,"log_start":"22'800","ondisk_log_start":"22'800","created":19,"last_epoch_clean":20,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-08-01T19:54:22.116710+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-08-01T19:54:22.116710+0000","last_clean_scrub_stamp":"2023-08-01T19:54:22.116710+0000","objects_scrubbed":0,"log_size":3545,"ondisk_log_size":3545,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-08-03T05:22:32.106433+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":284753920,"num_objects":4345,"num_object_clones":0,"num_object_copies":8690,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":4345,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":4345,"num_write_kb":278080,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[0,2],"acting":[0,2],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":0,"acting_primary":0,"purged_snaps":[]},{"pgid":"3.c","version":"0'0","reported_seq":22,"reported_epoch":29,"state":"active+clean","last_fresh":"2023-08-01T19:54:45.741873+0000","last_change":"2023-08-01T19:54:04.063532+0000","last_active":"2023-08-01T19:54:45.741873+0000","last_peered":"2023-08-01T19:54:45.741873+0000","last_clean":"2023-08-01T19:54:45.741873+0000","last_became_active":"2023-08-01T19:54:04.063116+0000","last_became_peered":"2023-08-01T19:54:04.063116+0000","last_unstale":"2023-08-01T19:54:45.741873+0000","last_undegraded":"2023-08-01T19:54:45.741873+0000","last_fullsized":"2023-08-01T19:54:45.741873+0000","mapping_epoch":15,"log_start":"0'0","ondisk_log_start":"0'0","created":15,"last_epoch_clean":16,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-08-01T19:54:03.032665+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-08-01T19:54:03.032665+0000","last_clean_scrub_stamp":"2023-08-01T19:54:03.032665+0000","objects_scrubbed":0,"log_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-08-02T22:28:51.936138+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[1,0],"acting":[1,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":1,"acting_primary":1,"purged_snaps":[]},{"pgid":"4.b","version":"0'0","reported_seq":21,"reported_epoch":29,"state":"active+clean","last_fresh":"2023-08-01T19:54:45.741445+0000","last_change":"2023-08-01T19:54:04.470787+0000","last_active":"2023-08-01T19:54:45.741445+0000","last_peered":"2023-08-01T19:54:45.741445+0000","last_clean":"2023-08-01T19:54:45.741445+0000","last_became_active":"2023-08-01T19:54:04.470332+0000","last_became_peered":"2023-08-01T19:54:04.470332+0000","last_unstale":"2023-08-01T19:54:45.741445+0000","last_undegraded":"2023-08-01T19:54:45.741445+0000","last_fullsized":"2023-08-01T19:54:45.741445+0000","mapping_epoch":16,"log_start":"0'0","ondisk_log_start":"0'0","created":16,"last_epoch_clean":17,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-08-01T19:54:04.040663+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-08-01T19:54:04.040663+0000","last_clean_scrub_stamp":"2023-08-01T19:54:04.040663+0000","objects_scrubbed":0,"log_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-08-03T05:13:38.298401+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[0,1],"acting":[0,1],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":0,"acting_primary":0,"purged_snaps":[]},{"pgid":"5.d","version":"31'4421","reported_seq":4440,"reported_epoch":31,"state":"active+clean","last_fresh":"2023-08-01T19:54:51.060049+0000","last_change":"2023-08-01T19:54:23.134380+0000","last_active":"2023-08-01T19:54:51.060049+0000","last_peered":"2023-08-01T19:54:51.060049+0000","last_clean":"2023-08-01T19:54:51.060049+0000","last_became_active":"2023-08-01T19:54:23.134100+0000","last_became_peered":"2023-08-01T19:54:23.134100+0000","last_unstale":"2023-08-01T19:54:51.060049+0000","last_undegraded":"2023-08-01T19:54:51.060049+0000","last_fullsized":"2023-08-01T19:54:51.060049+0000","mapping_epoch":19,"log_start":"22'400","ondisk_log_start":"22'400","created":19,"last_epoch_clean":20,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-08-01T19:54:22.116710+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-08-01T19:54:22.116710+0000","last_clean_scrub_stamp":"2023-08-01T19:54:22.116710+0000","objects_scrubbed":0,"log_size":4021,"ondisk_log_size":4021,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-08-02T22:07:43.756233+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":289734656,"num_objects":4421,"num_object_clones":0,"num_object_copies":8842,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":4421,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":4421,"num_write_kb":282944,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[2,1],"acting":[2,1],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":2,"acting_primary":2,"purged_snaps":[]},{"pgid":"3.b","version":"17'2","reported_seq":24,"reported_epoch":29,"state":"active+clean","last_fresh":"2023-08-01T19:54:45.741323+0000","last_change":"2023-08-01T19:54:04.066839+0000","last_active":"2023-08-01T19:54:45.741323+0000","last_peered":"2023-08-01T19:54:45.741323+0000","last_clean":"2023-08-01T19:54:45.741323+0000","last_became_active":"2023-08-01T19:54:04.065535+0000","last_became_peered":"2023-08-01T19:54:04.065535+0000","last_unstale":"2023-08-01T19:54:45.741323+0000","last_undegraded":"2023-08-01T19:54:45.741323+0000","last_fullsized":"2023-08-01T19:54:45.741323+0000","mapping_epoch":15,"log_start":"0'0","ondisk_log_start":"0'0","created":15,"last_epoch_clean":16,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-08-01T19:54:03.032665+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-08-01T19:54:03.032665+0000","last_clean_scrub_stamp":"2023-08-01T19:54:03.032665+0000","objects_scrubbed":0,"log_size":2,"ondisk_log_size":2,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-08-03T05:00:51.171444+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":1,"num_object_clones":0,"num_object_copies":2,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":1,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":1,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":1,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[0,1],"acting":[0,1],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":0,"acting_primary":0,"purged_snaps":[]},{"pgid":"4.c","version":"0'0","reported_seq":21,"reported_epoch":29,"state":"active+clean","last_fresh":"2023-08-01T19:54:45.741958+0000","last_change":"2023-08-01T19:54:04.478715+0000","last_active":"2023-08-01T19:54:45.741958+0000","last_peered":"2023-08-01T19:54:45.741958+0000","last_clean":"2023-08-01T19:54:45.741958+0000","last_became_active":"2023-08-01T19:54:04.477435+0000","last_became_peered":"2023-08-01T19:54:04.477435+0000","last_unstale":"2023-08-01T19:54:45.741958+0000","last_undegraded":"2023-08-01T19:54:45.741958+0000","last_fullsized":"2023-08-01T19:54:45.741958+0000","mapping_epoch":16,"log_start":"0'0","ondisk_log_start":"0'0","created":16,"last_epoch_clean":17,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-08-01T19:54:04.040663+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-08-01T19:54:04.040663+0000","last_clean_scrub_stamp":"2023-08-01T19:54:04.040663+0000","objects_scrubbed":0,"log_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-08-03T04:43:21.408174+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[1,0],"acting":[1,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":1,"acting_primary":1,"purged_snaps":[]},{"pgid":"5.c","version":"30'4436","reported_seq":4454,"reported_epoch":30,"state":"active+clean","last_fresh":"2023-08-01T19:54:49.913223+0000","last_change":"2023-08-01T19:54:23.138439+0000","last_active":"2023-08-01T19:54:49.913223+0000","last_peered":"2023-08-01T19:54:49.913223+0000","last_clean":"2023-08-01T19:54:49.913223+0000","last_became_active":"2023-08-01T19:54:23.138051+0000","last_became_peered":"2023-08-01T19:54:23.138051+0000","last_unstale":"2023-08-01T19:54:49.913223+0000","last_undegraded":"2023-08-01T19:54:49.913223+0000","last_fullsized":"2023-08-01T19:54:49.913223+0000","mapping_epoch":19,"log_start":"22'900","ondisk_log_start":"22'900","created":19,"last_epoch_clean":20,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-08-01T19:54:22.116710+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-08-01T19:54:22.116710+0000","last_clean_scrub_stamp":"2023-08-01T19:54:22.116710+0000","objects_scrubbed":0,"log_size":3536,"ondisk_log_size":3536,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-08-03T03:01:16.402814+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":290717696,"num_objects":4436,"num_object_clones":0,"num_object_copies":8872,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":4436,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":4436,"num_write_kb":283904,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[0,1],"acting":[0,1],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":0,"acting_primary":0,"purged_snaps":[]},{"pgid":"3.a","version":"0'0","reported_seq":22,"reported_epoch":29,"state":"active+clean","last_fresh":"2023-08-01T19:54:45.741651+0000","last_change":"2023-08-01T19:54:04.065267+0000","last_active":"2023-08-01T19:54:45.741651+0000","last_peered":"2023-08-01T19:54:45.741651+0000","last_clean":"2023-08-01T19:54:45.741651+0000","last_became_active":"2023-08-01T19:54:04.064912+0000","last_became_peered":"2023-08-01T19:54:04.064912+0000","last_unstale":"2023-08-01T19:54:45.741651+0000","last_undegraded":"2023-08-01T19:54:45.741651+0000","last_fullsized":"2023-08-01T19:54:45.741651+0000","mapping_epoch":15,"log_start":"0'0","ondisk_log_start":"0'0","created":15,"last_epoch_clean":16,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-08-01T19:54:03.032665+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-08-01T19:54:03.032665+0000","last_clean_scrub_stamp":"2023-08-01T19:54:03.032665+0000","objects_scrubbed":0,"log_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-08-03T02:37:09.180970+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[1,0],"acting":[1,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":1,"acting_primary":1,"purged_snaps":[]},{"pgid":"4.d","version":"0'0","reported_seq":21,"reported_epoch":29,"state":"active+clean","last_fresh":"2023-08-01T19:54:45.742528+0000","last_change":"2023-08-01T19:54:04.474755+0000","last_active":"2023-08-01T19:54:45.742528+0000","last_peered":"2023-08-01T19:54:45.742528+0000","last_clean":"2023-08-01T19:54:45.742528+0000","last_became_active":"2023-08-01T19:54:04.471526+0000","last_became_peered":"2023-08-01T19:54:04.471526+0000","last_unstale":"2023-08-01T19:54:45.742528+0000","last_undegraded":"2023-08-01T19:54:45.742528+0000","last_fullsized":"2023-08-01T19:54:45.742528+0000","mapping_epoch":16,"log_start":"0'0","ondisk_log_start":"0'0","created":16,"last_epoch_clean":17,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-08-01T19:54:04.040663+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-08-01T19:54:04.040663+0000","last_clean_scrub_stamp":"2023-08-01T19:54:04.040663+0000","objects_scrubbed":0,"log_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-08-03T06:50:03.420334+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[1,2],"acting":[1,2],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":1,"acting_primary":1,"purged_snaps":[]},{"pgid":"5.f","version":"30'4432","reported_seq":4450,"reported_epoch":30,"state":"active+clean","last_fresh":"2023-08-01T19:54:49.925683+0000","last_change":"2023-08-01T19:54:23.134608+0000","last_active":"2023-08-01T19:54:49.925683+0000","last_peered":"2023-08-01T19:54:49.925683+0000","last_clean":"2023-08-01T19:54:49.925683+0000","last_became_active":"2023-08-01T19:54:23.134360+0000","last_became_peered":"2023-08-01T19:54:23.134360+0000","last_unstale":"2023-08-01T19:54:49.925683+0000","last_undegraded":"2023-08-01T19:54:49.925683+0000","last_fullsized":"2023-08-01T19:54:49.925683+0000","mapping_epoch":19,"log_start":"22'700","ondisk_log_start":"22'700","created":19,"last_epoch_clean":20,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-08-01T19:54:22.116710+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-08-01T19:54:22.116710+0000","last_clean_scrub_stamp":"2023-08-01T19:54:22.116710+0000","objects_scrubbed":0,"log_size":3732,"ondisk_log_size":3732,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-08-03T06:01:12.916557+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":290455552,"num_objects":4432,"num_object_clones":0,"num_object_copies":8864,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":4432,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":4432,"num_write_kb":283648,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[1,2],"acting":[1,2],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":1,"acting_primary":1,"purged_snaps":[]},{"pgid":"3.9","version":"0'0","reported_seq":23,"reported_epoch":30,"state":"active+clean","last_fresh":"2023-08-01T19:54:48.984524+0000","last_change":"2023-08-01T19:54:04.065519+0000","last_active":"2023-08-01T19:54:48.984524+0000","last_peered":"2023-08-01T19:54:48.984524+0000","last_clean":"2023-08-01T19:54:48.984524+0000","last_became_active":"2023-08-01T19:54:04.065211+0000","last_became_peered":"2023-08-01T19:54:04.065211+0000","last_unstale":"2023-08-01T19:54:48.984524+0000","last_undegraded":"2023-08-01T19:54:48.984524+0000","last_fullsized":"2023-08-01T19:54:48.984524+0000","mapping_epoch":15,"log_start":"0'0","ondisk_log_start":"0'0","created":15,"last_epoch_clean":16,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-08-01T19:54:03.032665+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-08-01T19:54:03.032665+0000","last_clean_scrub_stamp":"2023-08-01T19:54:03.032665+0000","objects_scrubbed":0,"log_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-08-03T05:46:27.672957+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[2,1],"acting":[2,1],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":2,"acting_primary":2,"purged_snaps":[]},{"pgid":"4.e","version":"0'0","reported_seq":21,"reported_epoch":29,"state":"active+clean","last_fresh":"2023-08-01T19:54:45.742141+0000","last_change":"2023-08-01T19:54:04.473750+0000","last_active":"2023-08-01T19:54:45.742141+0000","last_peered":"2023-08-01T19:54:45.742141+0000","last_clean":"2023-08-01T19:54:45.742141+0000","last_became_active":"2023-08-01T19:54:04.471512+0000","last_became_peered":"2023-08-01T19:54:04.471512+0000","last_unstale":"2023-08-01T19:54:45.742141+0000","last_undegraded":"2023-08-01T19:54:45.742141+0000","last_fullsized":"2023-08-01T19:54:45.742141+0000","mapping_epoch":16,"log_start":"0'0","ondisk_log_start":"0'0","created":16,"last_epoch_clean":17,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-08-01T19:54:04.040663+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-08-01T19:54:04.040663+0000","last_clean_scrub_stamp":"2023-08-01T19:54:04.040663+0000","objects_scrubbed":0,"log_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-08-03T05:13:38.298401+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[1,2],"acting":[1,2],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":1,"acting_primary":1,"purged_snaps":[]},{"pgid":"5.e","version":"31'4512","reported_seq":4531,"reported_epoch":31,"state":"active+clean","last_fresh":"2023-08-01T19:54:51.043981+0000","last_change":"2023-08-01T19:54:23.138341+0000","last_active":"2023-08-01T19:54:51.043981+0000","last_peered":"2023-08-01T19:54:51.043981+0000","last_clean":"2023-08-01T19:54:51.043981+0000","last_became_active":"2023-08-01T19:54:23.138119+0000","last_became_peered":"2023-08-01T19:54:23.138119+0000","last_unstale":"2023-08-01T19:54:51.043981+0000","last_undegraded":"2023-08-01T19:54:51.043981+0000","last_fullsized":"2023-08-01T19:54:51.043981+0000","mapping_epoch":19,"log_start":"22'500","ondisk_log_start":"22'500","created":19,"last_epoch_clean":20,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-08-01T19:54:22.116710+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-08-01T19:54:22.116710+0000","last_clean_scrub_stamp":"2023-08-01T19:54:22.116710+0000","objects_scrubbed":0,"log_size":4012,"ondisk_log_size":4012,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-08-03T07:48:27.709982+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":295698432,"num_objects":4512,"num_object_clones":0,"num_object_copies":9024,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":4512,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":4512,"num_write_kb":288768,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[2,0],"acting":[2,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":2,"acting_primary":2,"purged_snaps":[]},{"pgid":"3.8","version":"0'0","reported_seq":23,"reported_epoch":30,"state":"active+clean","last_fresh":"2023-08-01T19:54:48.984700+0000","last_change":"2023-08-01T19:54:04.063990+0000","last_active":"2023-08-01T19:54:48.984700+0000","last_peered":"2023-08-01T19:54:48.984700+0000","last_clean":"2023-08-01T19:54:48.984700+0000","last_became_active":"2023-08-01T19:54:04.063652+0000","last_became_peered":"2023-08-01T19:54:04.063652+0000","last_unstale":"2023-08-01T19:54:48.984700+0000","last_undegraded":"2023-08-01T19:54:48.984700+0000","last_fullsized":"2023-08-01T19:54:48.984700+0000","mapping_epoch":15,"log_start":"0'0","ondisk_log_start":"0'0","created":15,"last_epoch_clean":16,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-08-01T19:54:03.032665+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-08-01T19:54:03.032665+0000","last_clean_scrub_stamp":"2023-08-01T19:54:03.032665+0000","objects_scrubbed":0,"log_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-08-03T05:30:28.028091+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[2,0],"acting":[2,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":2,"acting_primary":2,"purged_snaps":[]},{"pgid":"4.f","version":"0'0","reported_seq":21,"reported_epoch":29,"state":"active+clean","last_fresh":"2023-08-01T19:54:45.740633+0000","last_change":"2023-08-01T19:54:04.469648+0000","last_active":"2023-08-01T19:54:45.740633+0000","last_peered":"2023-08-01T19:54:45.740633+0000","last_clean":"2023-08-01T19:54:45.740633+0000","last_became_active":"2023-08-01T19:54:04.468445+0000","last_became_peered":"2023-08-01T19:54:04.468445+0000","last_unstale":"2023-08-01T19:54:45.740633+0000","last_undegraded":"2023-08-01T19:54:45.740633+0000","last_fullsized":"2023-08-01T19:54:45.740633+0000","mapping_epoch":16,"log_start":"0'0","ondisk_log_start":"0'0","created":16,"last_epoch_clean":17,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-08-01T19:54:04.040663+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-08-01T19:54:04.040663+0000","last_clean_scrub_stamp":"2023-08-01T19:54:04.040663+0000","objects_scrubbed":0,"log_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-08-03T05:46:11.085577+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[0,2],"acting":[0,2],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":0,"acting_primary":0,"purged_snaps":[]},{"pgid":"5.3","version":"30'4465","reported_seq":4483,"reported_epoch":30,"state":"active+clean","last_fresh":"2023-08-01T19:54:49.921435+0000","last_change":"2023-08-01T19:54:23.138357+0000","last_active":"2023-08-01T19:54:49.921435+0000","last_peered":"2023-08-01T19:54:49.921435+0000","last_clean":"2023-08-01T19:54:49.921435+0000","last_became_active":"2023-08-01T19:54:23.137942+0000","last_became_peered":"2023-08-01T19:54:23.137942+0000","last_unstale":"2023-08-01T19:54:49.921435+0000","last_undegraded":"2023-08-01T19:54:49.921435+0000","last_fullsized":"2023-08-01T19:54:49.921435+0000","mapping_epoch":19,"log_start":"22'900","ondisk_log_start":"22'900","created":19,"last_epoch_clean":20,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-08-01T19:54:22.116710+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-08-01T19:54:22.116710+0000","last_clean_scrub_stamp":"2023-08-01T19:54:22.116710+0000","objects_scrubbed":0,"log_size":3565,"ondisk_log_size":3565,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-08-03T01:44:47.434321+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":292618240,"num_objects":4465,"num_object_clones":0,"num_object_copies":8930,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":4465,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":4465,"num_write_kb":285760,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[0,1],"acting":[0,1],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":0,"acting_primary":0,"purged_snaps":[]},{"pgid":"2.4","version":"0'0","reported_seq":25,"reported_epoch":29,"state":"active+clean","last_fresh":"2023-08-01T19:54:45.741450+0000","last_change":"2023-08-01T19:53:58.973838+0000","last_active":"2023-08-01T19:54:45.741450+0000","last_peered":"2023-08-01T19:54:45.741450+0000","last_clean":"2023-08-01T19:54:45.741450+0000","last_became_active":"2023-08-01T19:53:58.973242+0000","last_became_peered":"2023-08-01T19:53:58.973242+0000","last_unstale":"2023-08-01T19:54:45.741450+0000","last_undegraded":"2023-08-01T19:54:45.741450+0000","last_fullsized":"2023-08-01T19:54:45.741450+0000","mapping_epoch":12,"log_start":"0'0","ondisk_log_start":"0'0","created":12,"last_epoch_clean":13,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-08-01T19:53:57.959448+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-08-01T19:53:57.959448+0000","last_clean_scrub_stamp":"2023-08-01T19:53:57.959448+0000","objects_scrubbed":0,"log_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-08-03T00:09:48.796549+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[0,2],"acting":[0,2],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":0,"acting_primary":0,"purged_snaps":[]},{"pgid":"3.5","version":"0'0","reported_seq":22,"reported_epoch":29,"state":"active+clean","last_fresh":"2023-08-01T19:54:45.742447+0000","last_change":"2023-08-01T19:54:04.065255+0000","last_active":"2023-08-01T19:54:45.742447+0000","last_peered":"2023-08-01T19:54:45.742447+0000","last_clean":"2023-08-01T19:54:45.742447+0000","last_became_active":"2023-08-01T19:54:04.064814+0000","last_became_peered":"2023-08-01T19:54:04.064814+0000","last_unstale":"2023-08-01T19:54:45.742447+0000","last_undegraded":"2023-08-01T19:54:45.742447+0000","last_fullsized":"2023-08-01T19:54:45.742447+0000","mapping_epoch":15,"log_start":"0'0","ondisk_log_start":"0'0","created":15,"last_epoch_clean":16,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-08-01T19:54:03.032665+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-08-01T19:54:03.032665+0000","last_clean_scrub_stamp":"2023-08-01T19:54:03.032665+0000","objects_scrubbed":0,"log_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-08-03T02:01:47.073630+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[1,0],"acting":[1,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":1,"acting_primary":1,"purged_snaps":[]},{"pgid":"4.2","version":"0'0","reported_seq":22,"reported_epoch":30,"state":"active+clean","last_fresh":"2023-08-01T19:54:48.985138+0000","last_change":"2023-08-01T19:54:04.471715+0000","last_active":"2023-08-01T19:54:48.985138+0000","last_peered":"2023-08-01T19:54:48.985138+0000","last_clean":"2023-08-01T19:54:48.985138+0000","last_became_active":"2023-08-01T19:54:04.471300+0000","last_became_peered":"2023-08-01T19:54:04.471300+0000","last_unstale":"2023-08-01T19:54:48.985138+0000","last_undegraded":"2023-08-01T19:54:48.985138+0000","last_fullsized":"2023-08-01T19:54:48.985138+0000","mapping_epoch":16,"log_start":"0'0","ondisk_log_start":"0'0","created":16,"last_epoch_clean":17,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-08-01T19:54:04.040663+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-08-01T19:54:04.040663+0000","last_clean_scrub_stamp":"2023-08-01T19:54:04.040663+0000","objects_scrubbed":0,"log_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-08-02T23:00:24.980203+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[2,1],"acting":[2,1],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":2,"acting_primary":2,"purged_snaps":[]},{"pgid":"5.5","version":"30'4352","reported_seq":4370,"reported_epoch":30,"state":"active+clean","last_fresh":"2023-08-01T19:54:49.917034+0000","last_change":"2023-08-01T19:54:23.137678+0000","last_active":"2023-08-01T19:54:49.917034+0000","last_peered":"2023-08-01T19:54:49.917034+0000","last_clean":"2023-08-01T19:54:49.917034+0000","last_became_active":"2023-08-01T19:54:23.136756+0000","last_became_peered":"2023-08-01T19:54:23.136756+0000","last_unstale":"2023-08-01T19:54:49.917034+0000","last_undegraded":"2023-08-01T19:54:49.917034+0000","last_fullsized":"2023-08-01T19:54:49.917034+0000","mapping_epoch":19,"log_start":"22'800","ondisk_log_start":"22'800","created":19,"last_epoch_clean":20,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-08-01T19:54:22.116710+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-08-01T19:54:22.116710+0000","last_clean_scrub_stamp":"2023-08-01T19:54:22.116710+0000","objects_scrubbed":0,"log_size":3552,"ondisk_log_size":3552,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-08-03T03:50:03.076219+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":285212672,"num_objects":4352,"num_object_clones":0,"num_object_copies":8704,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":4352,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":4352,"num_write_kb":278528,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[0,1],"acting":[0,1],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":0,"acting_primary":0,"purged_snaps":[]},{"pgid":"2.2","version":"0'0","reported_seq":25,"reported_epoch":29,"state":"active+clean","last_fresh":"2023-08-01T19:54:45.741995+0000","last_change":"2023-08-01T19:53:58.973665+0000","last_active":"2023-08-01T19:54:45.741995+0000","last_peered":"2023-08-01T19:54:45.741995+0000","last_clean":"2023-08-01T19:54:45.741995+0000","last_became_active":"2023-08-01T19:53:58.973463+0000","last_became_peered":"2023-08-01T19:53:58.973463+0000","last_unstale":"2023-08-01T19:54:45.741995+0000","last_undegraded":"2023-08-01T19:54:45.741995+0000","last_fullsized":"2023-08-01T19:54:45.741995+0000","mapping_epoch":12,"log_start":"0'0","ondisk_log_start":"0'0","created":12,"last_epoch_clean":13,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-08-01T19:53:57.959448+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-08-01T19:53:57.959448+0000","last_clean_scrub_stamp":"2023-08-01T19:53:57.959448+0000","objects_scrubbed":0,"log_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-08-03T04:50:42.368892+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[1,0],"acting":[1,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":1,"acting_primary":1,"purged_snaps":[]},{"pgid":"3.3","version":"0'0","reported_seq":22,"reported_epoch":29,"state":"active+clean","last_fresh":"2023-08-01T19:54:45.741727+0000","last_change":"2023-08-01T19:54:04.065415+0000","last_active":"2023-08-01T19:54:45.741727+0000","last_peered":"2023-08-01T19:54:45.741727+0000","last_clean":"2023-08-01T19:54:45.741727+0000","last_became_active":"2023-08-01T19:54:04.065030+0000","last_became_peered":"2023-08-01T19:54:04.065030+0000","last_unstale":"2023-08-01T19:54:45.741727+0000","last_undegraded":"2023-08-01T19:54:45.741727+0000","last_fullsized":"2023-08-01T19:54:45.741727+0000","mapping_epoch":15,"log_start":"0'0","ondisk_log_start":"0'0","created":15,"last_epoch_clean":16,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-08-01T19:54:03.032665+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-08-01T19:54:03.032665+0000","last_clean_scrub_stamp":"2023-08-01T19:54:03.032665+0000","objects_scrubbed":0,"log_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-08-02T21:33:27.007118+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[1,0],"acting":[1,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":1,"acting_primary":1,"purged_snaps":[]},{"pgid":"4.4","version":"0'0","reported_seq":21,"reported_epoch":29,"state":"active+clean","last_fresh":"2023-08-01T19:54:45.741372+0000","last_change":"2023-08-01T19:54:04.468101+0000","last_active":"2023-08-01T19:54:45.741372+0000","last_peered":"2023-08-01T19:54:45.741372+0000","last_clean":"2023-08-01T19:54:45.741372+0000","last_became_active":"2023-08-01T19:54:04.467409+0000","last_became_peered":"2023-08-01T19:54:04.467409+0000","last_unstale":"2023-08-01T19:54:45.741372+0000","last_undegraded":"2023-08-01T19:54:45.741372+0000","last_fullsized":"2023-08-01T19:54:45.741372+0000","mapping_epoch":16,"log_start":"0'0","ondisk_log_start":"0'0","created":16,"last_epoch_clean":17,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-08-01T19:54:04.040663+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-08-01T19:54:04.040663+0000","last_clean_scrub_stamp":"2023-08-01T19:54:04.040663+0000","objects_scrubbed":0,"log_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-08-02T21:43:30.325991+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[0,2],"acting":[0,2],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":0,"acting_primary":0,"purged_snaps":[]},{"pgid":"5.6","version":"30'4364","reported_seq":4382,"reported_epoch":30,"state":"active+clean","last_fresh":"2023-08-01T19:54:49.935414+0000","last_change":"2023-08-01T19:54:23.138275+0000","last_active":"2023-08-01T19:54:49.935414+0000","last_peered":"2023-08-01T19:54:49.935414+0000","last_clean":"2023-08-01T19:54:49.935414+0000","last_became_active":"2023-08-01T19:54:23.137973+0000","last_became_peered":"2023-08-01T19:54:23.137973+0000","last_unstale":"2023-08-01T19:54:49.935414+0000","last_undegraded":"2023-08-01T19:54:49.935414+0000","last_fullsized":"2023-08-01T19:54:49.935414+0000","mapping_epoch":19,"log_start":"22'800","ondisk_log_start":"22'800","created":19,"last_epoch_clean":20,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-08-01T19:54:22.116710+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-08-01T19:54:22.116710+0000","last_clean_scrub_stamp":"2023-08-01T19:54:22.116710+0000","objects_scrubbed":0,"log_size":3564,"ondisk_log_size":3564,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-08-03T01:19:10.526905+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":285999104,"num_objects":4364,"num_object_clones":0,"num_object_copies":8728,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":4364,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":4364,"num_write_kb":279296,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[0,1],"acting":[0,1],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":0,"acting_primary":0,"purged_snaps":[]},{"pgid":"2.1","version":"0'0","reported_seq":25,"reported_epoch":29,"state":"active+clean","last_fresh":"2023-08-01T19:54:45.740431+0000","last_change":"2023-08-01T19:53:58.973700+0000","last_active":"2023-08-01T19:54:45.740431+0000","last_peered":"2023-08-01T19:54:45.740431+0000","last_clean":"2023-08-01T19:54:45.740431+0000","last_became_active":"2023-08-01T19:53:58.973285+0000","last_became_peered":"2023-08-01T19:53:58.973285+0000","last_unstale":"2023-08-01T19:54:45.740431+0000","last_undegraded":"2023-08-01T19:54:45.740431+0000","last_fullsized":"2023-08-01T19:54:45.740431+0000","mapping_epoch":12,"log_start":"0'0","ondisk_log_start":"0'0","created":12,"last_epoch_clean":13,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-08-01T19:53:57.959448+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-08-01T19:53:57.959448+0000","last_clean_scrub_stamp":"2023-08-01T19:53:57.959448+0000","objects_scrubbed":0,"log_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-08-02T21:26:02.570824+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[0,2],"acting":[0,2],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":0,"acting_primary":0,"purged_snaps":[]},{"pgid":"3.0","version":"0'0","reported_seq":23,"reported_epoch":30,"state":"active+clean","last_fresh":"2023-08-01T19:54:48.984733+0000","last_change":"2023-08-01T19:54:04.064407+0000","last_active":"2023-08-01T19:54:48.984733+0000","last_peered":"2023-08-01T19:54:48.984733+0000","last_clean":"2023-08-01T19:54:48.984733+0000","last_became_active":"2023-08-01T19:54:04.064122+0000","last_became_peered":"2023-08-01T19:54:04.064122+0000","last_unstale":"2023-08-01T19:54:48.984733+0000","last_undegraded":"2023-08-01T19:54:48.984733+0000","last_fullsized":"2023-08-01T19:54:48.984733+0000","mapping_epoch":15,"log_start":"0'0","ondisk_log_start":"0'0","created":15,"last_epoch_clean":16,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-08-01T19:54:03.032665+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-08-01T19:54:03.032665+0000","last_clean_scrub_stamp":"2023-08-01T19:54:03.032665+0000","objects_scrubbed":0,"log_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-08-03T07:08:17.318689+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[2,1],"acting":[2,1],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":2,"acting_primary":2,"purged_snaps":[]},{"pgid":"4.7","version":"0'0","reported_seq":21,"reported_epoch":29,"state":"active+clean","last_fresh":"2023-08-01T19:54:45.740854+0000","last_change":"2023-08-01T19:54:04.469739+0000","last_active":"2023-08-01T19:54:45.740854+0000","last_peered":"2023-08-01T19:54:45.740854+0000","last_clean":"2023-08-01T19:54:45.740854+0000","last_became_active":"2023-08-01T19:54:04.468021+0000","last_became_peered":"2023-08-01T19:54:04.468021+0000","last_unstale":"2023-08-01T19:54:45.740854+0000","last_undegraded":"2023-08-01T19:54:45.740854+0000","last_fullsized":"2023-08-01T19:54:45.740854+0000","mapping_epoch":16,"log_start":"0'0","ondisk_log_start":"0'0","created":16,"last_epoch_clean":17,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-08-01T19:54:04.040663+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-08-01T19:54:04.040663+0000","last_clean_scrub_stamp":"2023-08-01T19:54:04.040663+0000","objects_scrubbed":0,"log_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-08-02T21:03:01.319028+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[0,2],"acting":[0,2],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":0,"acting_primary":0,"purged_snaps":[]},{"pgid":"5.4","version":"31'4467","reported_seq":4485,"reported_epoch":31,"state":"active+clean","last_fresh":"2023-08-01T19:54:51.056606+0000","last_change":"2023-08-01T19:54:23.138253+0000","last_active":"2023-08-01T19:54:51.056606+0000","last_peered":"2023-08-01T19:54:51.056606+0000","last_clean":"2023-08-01T19:54:51.056606+0000","last_became_active":"2023-08-01T19:54:23.137915+0000","last_became_peered":"2023-08-01T19:54:23.137915+0000","last_unstale":"2023-08-01T19:54:51.056606+0000","last_undegraded":"2023-08-01T19:54:51.056606+0000","last_fullsized":"2023-08-01T19:54:51.056606+0000","mapping_epoch":19,"log_start":"22'500","ondisk_log_start":"22'500","created":19,"last_epoch_clean":20,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-08-01T19:54:22.116710+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-08-01T19:54:22.116710+0000","last_clean_scrub_stamp":"2023-08-01T19:54:22.116710+0000","objects_scrubbed":0,"log_size":3967,"ondisk_log_size":3967,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-08-03T07:20:04.946515+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":292749312,"num_objects":4467,"num_object_clones":0,"num_object_copies":8934,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":4467,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":4467,"num_write_kb":285888,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[2,0],"acting":[2,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":2,"acting_primary":2,"purged_snaps":[]},{"pgid":"2.3","version":"0'0","reported_seq":25,"reported_epoch":29,"state":"active+clean","last_fresh":"2023-08-01T19:54:45.741782+0000","last_change":"2023-08-01T19:53:58.973768+0000","last_active":"2023-08-01T19:54:45.741782+0000","last_peered":"2023-08-01T19:54:45.741782+0000","last_clean":"2023-08-01T19:54:45.741782+0000","last_became_active":"2023-08-01T19:53:58.973492+0000","last_became_peered":"2023-08-01T19:53:58.973492+0000","last_unstale":"2023-08-01T19:54:45.741782+0000","last_undegraded":"2023-08-01T19:54:45.741782+0000","last_fullsized":"2023-08-01T19:54:45.741782+0000","mapping_epoch":12,"log_start":"0'0","ondisk_log_start":"0'0","created":12,"last_epoch_clean":13,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-08-01T19:53:57.959448+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-08-01T19:53:57.959448+0000","last_clean_scrub_stamp":"2023-08-01T19:53:57.959448+0000","objects_scrubbed":0,"log_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-08-03T02:04:52.034667+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[1,0],"acting":[1,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":1,"acting_primary":1,"purged_snaps":[]},{"pgid":"1.0","version":"10'157","reported_seq":224,"reported_epoch":29,"state":"active+clean","last_fresh":"2023-08-01T19:54:45.741464+0000","last_change":"2023-08-01T19:53:51.746910+0000","last_active":"2023-08-01T19:54:45.741464+0000","last_peered":"2023-08-01T19:54:45.741464+0000","last_clean":"2023-08-01T19:54:45.741464+0000","last_became_active":"2023-08-01T19:53:51.746590+0000","last_became_peered":"2023-08-01T19:53:51.746590+0000","last_unstale":"2023-08-01T19:54:45.741464+0000","last_undegraded":"2023-08-01T19:54:45.741464+0000","last_fullsized":"2023-08-01T19:54:45.741464+0000","mapping_epoch":9,"log_start":"0'0","ondisk_log_start":"0'0","created":9,"last_epoch_clean":10,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-08-01T19:53:50.735626+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-08-01T19:53:50.735626+0000","last_clean_scrub_stamp":"2023-08-01T19:53:50.735626+0000","objects_scrubbed":0,"log_size":157,"ondisk_log_size":157,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-08-03T02:56:50.228294+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":590368,"num_objects":2,"num_object_clones":0,"num_object_copies":4,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":2,"num_whiteouts":0,"num_read":136,"num_read_kb":118,"num_write":203,"num_write_kb":3460,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[1,2],"acting":[1,2],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":1,"acting_primary":1,"purged_snaps":[]},{"pgid":"3.2","version":"0'0","reported_seq":22,"reported_epoch":29,"state":"active+clean","last_fresh":"2023-08-01T19:54:45.740114+0000","last_change":"2023-08-01T19:54:04.064009+0000","last_active":"2023-08-01T19:54:45.740114+0000","last_peered":"2023-08-01T19:54:45.740114+0000","last_clean":"2023-08-01T19:54:45.740114+0000","last_became_active":"2023-08-01T19:54:04.063665+0000","last_became_peered":"2023-08-01T19:54:04.063665+0000","last_unstale":"2023-08-01T19:54:45.740114+0000","last_undegraded":"2023-08-01T19:54:45.740114+0000","last_fullsized":"2023-08-01T19:54:45.740114+0000","mapping_epoch":15,"log_start":"0'0","ondisk_log_start":"0'0","created":15,"last_epoch_clean":16,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-08-01T19:54:03.032665+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-08-01T19:54:03.032665+0000","last_clean_scrub_stamp":"2023-08-01T19:54:03.032665+0000","objects_scrubbed":0,"log_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-08-03T04:04:46.983253+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[0,2],"acting":[0,2],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":0,"acting_primary":0,"purged_snaps":[]},{"pgid":"4.5","version":"0'0","reported_seq":21,"reported_epoch":29,"state":"active+clean","last_fresh":"2023-08-01T19:54:45.742524+0000","last_change":"2023-08-01T19:54:04.474061+0000","last_active":"2023-08-01T19:54:45.742524+0000","last_peered":"2023-08-01T19:54:45.742524+0000","last_clean":"2023-08-01T19:54:45.742524+0000","last_became_active":"2023-08-01T19:54:04.472128+0000","last_became_peered":"2023-08-01T19:54:04.472128+0000","last_unstale":"2023-08-01T19:54:45.742524+0000","last_undegraded":"2023-08-01T19:54:45.742524+0000","last_fullsized":"2023-08-01T19:54:45.742524+0000","mapping_epoch":16,"log_start":"0'0","ondisk_log_start":"0'0","created":16,"last_epoch_clean":17,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-08-01T19:54:04.040663+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-08-01T19:54:04.040663+0000","last_clean_scrub_stamp":"2023-08-01T19:54:04.040663+0000","objects_scrubbed":0,"log_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-08-03T00:29:05.857138+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[1,2],"acting":[1,2],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":1,"acting_primary":1,"purged_snaps":[]},{"pgid":"5.7","version":"30'4386","reported_seq":4404,"reported_epoch":30,"state":"active+clean","last_fresh":"2023-08-01T19:54:49.918076+0000","last_change":"2023-08-01T19:54:23.138337+0000","last_active":"2023-08-01T19:54:49.918076+0000","last_peered":"2023-08-01T19:54:49.918076+0000","last_clean":"2023-08-01T19:54:49.918076+0000","last_became_active":"2023-08-01T19:54:23.138056+0000","last_became_peered":"2023-08-01T19:54:23.138056+0000","last_unstale":"2023-08-01T19:54:49.918076+0000","last_undegraded":"2023-08-01T19:54:49.918076+0000","last_fullsized":"2023-08-01T19:54:49.918076+0000","mapping_epoch":19,"log_start":"22'600","ondisk_log_start":"22'600","created":19,"last_epoch_clean":20,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-08-01T19:54:22.116710+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-08-01T19:54:22.116710+0000","last_clean_scrub_stamp":"2023-08-01T19:54:22.116710+0000","objects_scrubbed":0,"log_size":3786,"ondisk_log_size":3786,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-08-03T06:58:19.846492+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":287440896,"num_objects":4386,"num_object_clones":0,"num_object_copies":8772,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":4386,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":4386,"num_write_kb":280704,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[1,0],"acting":[1,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":1,"acting_primary":1,"purged_snaps":[]},{"pgid":"2.0","version":"0'0","reported_seq":25,"reported_epoch":29,"state":"active+clean","last_fresh":"2023-08-01T19:54:45.741505+0000","last_change":"2023-08-01T19:53:58.975968+0000","last_active":"2023-08-01T19:54:45.741505+0000","last_peered":"2023-08-01T19:54:45.741505+0000","last_clean":"2023-08-01T19:54:45.741505+0000","last_became_active":"2023-08-01T19:53:58.975706+0000","last_became_peered":"2023-08-01T19:53:58.975706+0000","last_unstale":"2023-08-01T19:54:45.741505+0000","last_undegraded":"2023-08-01T19:54:45.741505+0000","last_fullsized":"2023-08-01T19:54:45.741505+0000","mapping_epoch":12,"log_start":"0'0","ondisk_log_start":"0'0","created":12,"last_epoch_clean":13,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-08-01T19:53:57.959448+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-08-01T19:53:57.959448+0000","last_clean_scrub_stamp":"2023-08-01T19:53:57.959448+0000","objects_scrubbed":0,"log_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-08-03T00:02:15.204280+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[1,2],"acting":[1,2],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":1,"acting_primary":1,"purged_snaps":[]},{"pgid":"3.1","version":"0'0","reported_seq":22,"reported_epoch":29,"state":"active+clean","last_fresh":"2023-08-01T19:54:45.739816+0000","last_change":"2023-08-01T19:54:04.066707+0000","last_active":"2023-08-01T19:54:45.739816+0000","last_peered":"2023-08-01T19:54:45.739816+0000","last_clean":"2023-08-01T19:54:45.739816+0000","last_became_active":"2023-08-01T19:54:04.066334+0000","last_became_peered":"2023-08-01T19:54:04.066334+0000","last_unstale":"2023-08-01T19:54:45.739816+0000","last_undegraded":"2023-08-01T19:54:45.739816+0000","last_fullsized":"2023-08-01T19:54:45.739816+0000","mapping_epoch":15,"log_start":"0'0","ondisk_log_start":"0'0","created":15,"last_epoch_clean":16,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-08-01T19:54:03.032665+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-08-01T19:54:03.032665+0000","last_clean_scrub_stamp":"2023-08-01T19:54:03.032665+0000","objects_scrubbed":0,"log_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-08-03T02:40:15.210599+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[0,1],"acting":[0,1],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":0,"acting_primary":0,"purged_snaps":[]},{"pgid":"4.6","version":"0'0","reported_seq":22,"reported_epoch":30,"state":"active+clean","last_fresh":"2023-08-01T19:54:48.985587+0000","last_change":"2023-08-01T19:54:04.469877+0000","last_active":"2023-08-01T19:54:48.985587+0000","last_peered":"2023-08-01T19:54:48.985587+0000","last_clean":"2023-08-01T19:54:48.985587+0000","last_became_active":"2023-08-01T19:54:04.469528+0000","last_became_peered":"2023-08-01T19:54:04.469528+0000","last_unstale":"2023-08-01T19:54:48.985587+0000","last_undegraded":"2023-08-01T19:54:48.985587+0000","last_fullsized":"2023-08-01T19:54:48.985587+0000","mapping_epoch":16,"log_start":"0'0","ondisk_log_start":"0'0","created":16,"last_epoch_clean":17,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-08-01T19:54:04.040663+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-08-01T19:54:04.040663+0000","last_clean_scrub_stamp":"2023-08-01T19:54:04.040663+0000","objects_scrubbed":0,"log_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-08-03T02:24:19.067602+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[2,0],"acting":[2,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":2,"acting_primary":2,"purged_snaps":[]},{"pgid":"5.2","version":"30'4558","reported_seq":4576,"reported_epoch":30,"state":"active+clean","last_fresh":"2023-08-01T19:54:49.910689+0000","last_change":"2023-08-01T19:54:23.138339+0000","last_active":"2023-08-01T19:54:49.910689+0000","last_peered":"2023-08-01T19:54:49.910689+0000","last_clean":"2023-08-01T19:54:49.910689+0000","last_became_active":"2023-08-01T19:54:23.137962+0000","last_became_peered":"2023-08-01T19:54:23.137962+0000","last_unstale":"2023-08-01T19:54:49.910689+0000","last_undegraded":"2023-08-01T19:54:49.910689+0000","last_fullsized":"2023-08-01T19:54:49.910689+0000","mapping_epoch":19,"log_start":"22'800","ondisk_log_start":"22'800","created":19,"last_epoch_clean":20,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-08-01T19:54:22.116710+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-08-01T19:54:22.116710+0000","last_clean_scrub_stamp":"2023-08-01T19:54:22.116710+0000","objects_scrubbed":0,"log_size":3758,"ondisk_log_size":3758,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-08-03T01:46:33.457242+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":298713088,"num_objects":4558,"num_object_clones":0,"num_object_copies":9116,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":4558,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":4558,"num_write_kb":291712,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[1,0],"acting":[1,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":1,"acting_primary":1,"purged_snaps":[]},{"pgid":"2.5","version":"0'0","reported_seq":26,"reported_epoch":30,"state":"active+clean","last_fresh":"2023-08-01T19:54:48.985374+0000","last_change":"2023-08-01T19:53:58.970683+0000","last_active":"2023-08-01T19:54:48.985374+0000","last_peered":"2023-08-01T19:54:48.985374+0000","last_clean":"2023-08-01T19:54:48.985374+0000","last_became_active":"2023-08-01T19:53:58.970437+0000","last_became_peered":"2023-08-01T19:53:58.970437+0000","last_unstale":"2023-08-01T19:54:48.985374+0000","last_undegraded":"2023-08-01T19:54:48.985374+0000","last_fullsized":"2023-08-01T19:54:48.985374+0000","mapping_epoch":12,"log_start":"0'0","ondisk_log_start":"0'0","created":12,"last_epoch_clean":13,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-08-01T19:53:57.959448+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-08-01T19:53:57.959448+0000","last_clean_scrub_stamp":"2023-08-01T19:53:57.959448+0000","objects_scrubbed":0,"log_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-08-02T23:54:08.273426+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[2,0],"acting":[2,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":2,"acting_primary":2,"purged_snaps":[]},{"pgid":"3.4","version":"0'0","reported_seq":22,"reported_epoch":29,"state":"active+clean","last_fresh":"2023-08-01T19:54:45.741037+0000","last_change":"2023-08-01T19:54:04.062283+0000","last_active":"2023-08-01T19:54:45.741037+0000","last_peered":"2023-08-01T19:54:45.741037+0000","last_clean":"2023-08-01T19:54:45.741037+0000","last_became_active":"2023-08-01T19:54:04.061796+0000","last_became_peered":"2023-08-01T19:54:04.061796+0000","last_unstale":"2023-08-01T19:54:45.741037+0000","last_undegraded":"2023-08-01T19:54:45.741037+0000","last_fullsized":"2023-08-01T19:54:45.741037+0000","mapping_epoch":15,"log_start":"0'0","ondisk_log_start":"0'0","created":15,"last_epoch_clean":16,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-08-01T19:54:03.032665+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-08-01T19:54:03.032665+0000","last_clean_scrub_stamp":"2023-08-01T19:54:03.032665+0000","objects_scrubbed":0,"log_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-08-02T19:54:08.401797+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[0,2],"acting":[0,2],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":0,"acting_primary":0,"purged_snaps":[]},{"pgid":"4.3","version":"0'0","reported_seq":22,"reported_epoch":30,"state":"active+clean","last_fresh":"2023-08-01T19:54:48.984823+0000","last_change":"2023-08-01T19:54:04.473088+0000","last_active":"2023-08-01T19:54:48.984823+0000","last_peered":"2023-08-01T19:54:48.984823+0000","last_clean":"2023-08-01T19:54:48.984823+0000","last_became_active":"2023-08-01T19:54:04.472611+0000","last_became_peered":"2023-08-01T19:54:04.472611+0000","last_unstale":"2023-08-01T19:54:48.984823+0000","last_undegraded":"2023-08-01T19:54:48.984823+0000","last_fullsized":"2023-08-01T19:54:48.984823+0000","mapping_epoch":16,"log_start":"0'0","ondisk_log_start":"0'0","created":16,"last_epoch_clean":17,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-08-01T19:54:04.040663+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-08-01T19:54:04.040663+0000","last_clean_scrub_stamp":"2023-08-01T19:54:04.040663+0000","objects_scrubbed":0,"log_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-08-03T07:27:26.537518+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[2,1],"acting":[2,1],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":2,"acting_primary":2,"purged_snaps":[]},{"pgid":"5.1","version":"30'4382","reported_seq":4400,"reported_epoch":30,"state":"active+clean","last_fresh":"2023-08-01T19:54:49.910321+0000","last_change":"2023-08-01T19:54:23.138225+0000","last_active":"2023-08-01T19:54:49.910321+0000","last_peered":"2023-08-01T19:54:49.910321+0000","last_clean":"2023-08-01T19:54:49.910321+0000","last_became_active":"2023-08-01T19:54:23.137955+0000","last_became_peered":"2023-08-01T19:54:23.137955+0000","last_unstale":"2023-08-01T19:54:49.910321+0000","last_undegraded":"2023-08-01T19:54:49.910321+0000","last_fullsized":"2023-08-01T19:54:49.910321+0000","mapping_epoch":19,"log_start":"22'600","ondisk_log_start":"22'600","created":19,"last_epoch_clean":20,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-08-01T19:54:22.116710+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-08-01T19:54:22.116710+0000","last_clean_scrub_stamp":"2023-08-01T19:54:22.116710+0000","objects_scrubbed":0,"log_size":3782,"ondisk_log_size":3782,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-08-03T03:58:00.471919+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":287178752,"num_objects":4382,"num_object_clones":0,"num_object_copies":8764,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":4382,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":4382,"num_write_kb":280448,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[1,0],"acting":[1,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":1,"acting_primary":1,"purged_snaps":[]},{"pgid":"3.7","version":"17'2","reported_seq":24,"reported_epoch":29,"state":"active+clean","last_fresh":"2023-08-01T19:54:45.740533+0000","last_change":"2023-08-01T19:54:04.065147+0000","last_active":"2023-08-01T19:54:45.740533+0000","last_peered":"2023-08-01T19:54:45.740533+0000","last_clean":"2023-08-01T19:54:45.740533+0000","last_became_active":"2023-08-01T19:54:04.064779+0000","last_became_peered":"2023-08-01T19:54:04.064779+0000","last_unstale":"2023-08-01T19:54:45.740533+0000","last_undegraded":"2023-08-01T19:54:45.740533+0000","last_fullsized":"2023-08-01T19:54:45.740533+0000","mapping_epoch":15,"log_start":"0'0","ondisk_log_start":"0'0","created":15,"last_epoch_clean":16,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-08-01T19:54:03.032665+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-08-01T19:54:03.032665+0000","last_clean_scrub_stamp":"2023-08-01T19:54:03.032665+0000","objects_scrubbed":0,"log_size":2,"ondisk_log_size":2,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-08-03T03:43:45.667663+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":1,"num_object_clones":0,"num_object_copies":2,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":1,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":3,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":1,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[0,2],"acting":[0,2],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":0,"acting_primary":0,"purged_snaps":[]},{"pgid":"2.6","version":"0'0","reported_seq":25,"reported_epoch":29,"state":"active+clean","last_fresh":"2023-08-01T19:54:45.740791+0000","last_change":"2023-08-01T19:53:58.974077+0000","last_active":"2023-08-01T19:54:45.740791+0000","last_peered":"2023-08-01T19:54:45.740791+0000","last_clean":"2023-08-01T19:54:45.740791+0000","last_became_active":"2023-08-01T19:53:58.973396+0000","last_became_peered":"2023-08-01T19:53:58.973396+0000","last_unstale":"2023-08-01T19:54:45.740791+0000","last_undegraded":"2023-08-01T19:54:45.740791+0000","last_fullsized":"2023-08-01T19:54:45.740791+0000","mapping_epoch":12,"log_start":"0'0","ondisk_log_start":"0'0","created":12,"last_epoch_clean":13,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-08-01T19:53:57.959448+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-08-01T19:53:57.959448+0000","last_clean_scrub_stamp":"2023-08-01T19:53:57.959448+0000","objects_scrubbed":0,"log_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-08-02T22:13:50.940864+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[0,2],"acting":[0,2],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":0,"acting_primary":0,"purged_snaps":[]},{"pgid":"4.0","version":"0'0","reported_seq":21,"reported_epoch":29,"state":"active+clean","last_fresh":"2023-08-01T19:54:45.741375+0000","last_change":"2023-08-01T19:54:04.476807+0000","last_active":"2023-08-01T19:54:45.741375+0000","last_peered":"2023-08-01T19:54:45.741375+0000","last_clean":"2023-08-01T19:54:45.741375+0000","last_became_active":"2023-08-01T19:54:04.476453+0000","last_became_peered":"2023-08-01T19:54:04.476453+0000","last_unstale":"2023-08-01T19:54:45.741375+0000","last_undegraded":"2023-08-01T19:54:45.741375+0000","last_fullsized":"2023-08-01T19:54:45.741375+0000","mapping_epoch":16,"log_start":"0'0","ondisk_log_start":"0'0","created":16,"last_epoch_clean":17,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-08-01T19:54:04.040663+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-08-01T19:54:04.040663+0000","last_clean_scrub_stamp":"2023-08-01T19:54:04.040663+0000","objects_scrubbed":0,"log_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-08-02T20:20:59.989030+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[0,1],"acting":[0,1],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":0,"acting_primary":0,"purged_snaps":[]},{"pgid":"5.0","version":"31'4618","reported_seq":4637,"reported_epoch":31,"state":"active+clean","last_fresh":"2023-08-01T19:54:51.027624+0000","last_change":"2023-08-01T19:54:23.138369+0000","last_active":"2023-08-01T19:54:51.027624+0000","last_peered":"2023-08-01T19:54:51.027624+0000","last_clean":"2023-08-01T19:54:51.027624+0000","last_became_active":"2023-08-01T19:54:23.137857+0000","last_became_peered":"2023-08-01T19:54:23.137857+0000","last_unstale":"2023-08-01T19:54:51.027624+0000","last_undegraded":"2023-08-01T19:54:51.027624+0000","last_fullsized":"2023-08-01T19:54:51.027624+0000","mapping_epoch":19,"log_start":"22'600","ondisk_log_start":"22'600","created":19,"last_epoch_clean":20,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-08-01T19:54:22.116710+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-08-01T19:54:22.116710+0000","last_clean_scrub_stamp":"2023-08-01T19:54:22.116710+0000","objects_scrubbed":0,"log_size":4018,"ondisk_log_size":4018,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-08-03T06:02:44.391298+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":302645248,"num_objects":4618,"num_object_clones":0,"num_object_copies":9236,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":4618,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":4618,"num_write_kb":295552,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[2,0],"acting":[2,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":2,"acting_primary":2,"purged_snaps":[]},{"pgid":"2.7","version":"0'0","reported_seq":25,"reported_epoch":29,"state":"active+clean","last_fresh":"2023-08-01T19:54:45.742165+0000","last_change":"2023-08-01T19:53:58.975936+0000","last_active":"2023-08-01T19:54:45.742165+0000","last_peered":"2023-08-01T19:54:45.742165+0000","last_clean":"2023-08-01T19:54:45.742165+0000","last_became_active":"2023-08-01T19:53:58.975680+0000","last_became_peered":"2023-08-01T19:53:58.975680+0000","last_unstale":"2023-08-01T19:54:45.742165+0000","last_undegraded":"2023-08-01T19:54:45.742165+0000","last_fullsized":"2023-08-01T19:54:45.742165+0000","mapping_epoch":12,"log_start":"0'0","ondisk_log_start":"0'0","created":12,"last_epoch_clean":13,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-08-01T19:53:57.959448+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-08-01T19:53:57.959448+0000","last_clean_scrub_stamp":"2023-08-01T19:53:57.959448+0000","objects_scrubbed":0,"log_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-08-03T05:17:03.508898+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[1,2],"acting":[1,2],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":1,"acting_primary":1,"purged_snaps":[]},{"pgid":"3.6","version":"18'1","reported_seq":23,"reported_epoch":29,"state":"active+clean","last_fresh":"2023-08-01T19:54:45.740619+0000","last_change":"2023-08-01T19:54:04.068041+0000","last_active":"2023-08-01T19:54:45.740619+0000","last_peered":"2023-08-01T19:54:45.740619+0000","last_clean":"2023-08-01T19:54:45.740619+0000","last_became_active":"2023-08-01T19:54:04.067613+0000","last_became_peered":"2023-08-01T19:54:04.067613+0000","last_unstale":"2023-08-01T19:54:45.740619+0000","last_undegraded":"2023-08-01T19:54:45.740619+0000","last_fullsized":"2023-08-01T19:54:45.740619+0000","mapping_epoch":15,"log_start":"0'0","ondisk_log_start":"0'0","created":15,"last_epoch_clean":16,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-08-01T19:54:03.032665+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-08-01T19:54:03.032665+0000","last_clean_scrub_stamp":"2023-08-01T19:54:03.032665+0000","objects_scrubbed":0,"log_size":1,"ondisk_log_size":1,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-08-02T21:35:44.874727+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":1,"num_object_clones":0,"num_object_copies":2,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":1,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":1,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":1,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[0,1],"acting":[0,1],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":0,"acting_primary":0,"purged_snaps":[]},{"pgid":"4.1","version":"0'0","reported_seq":22,"reported_epoch":30,"state":"active+clean","last_fresh":"2023-08-01T19:54:48.984677+0000","last_change":"2023-08-01T19:54:04.469243+0000","last_active":"2023-08-01T19:54:48.984677+0000","last_peered":"2023-08-01T19:54:48.984677+0000","last_clean":"2023-08-01T19:54:48.984677+0000","last_became_active":"2023-08-01T19:54:04.468835+0000","last_became_peered":"2023-08-01T19:54:04.468835+0000","last_unstale":"2023-08-01T19:54:48.984677+0000","last_undegraded":"2023-08-01T19:54:48.984677+0000","last_fullsized":"2023-08-01T19:54:48.984677+0000","mapping_epoch":16,"log_start":"0'0","ondisk_log_start":"0'0","created":16,"last_epoch_clean":17,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-08-01T19:54:04.040663+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-08-01T19:54:04.040663+0000","last_clean_scrub_stamp":"2023-08-01T19:54:04.040663+0000","objects_scrubbed":0,"log_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-08-03T04:43:58.358628+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[2,1],"acting":[2,1],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":2,"acting_primary":2,"purged_snaps":[]},{"pgid":"3.1b","version":"17'1","reported_seq":24,"reported_epoch":30,"state":"active+clean","last_fresh":"2023-08-01T19:54:48.984830+0000","last_change":"2023-08-01T19:54:04.066748+0000","last_active":"2023-08-01T19:54:48.984830+0000","last_peered":"2023-08-01T19:54:48.984830+0000","last_clean":"2023-08-01T19:54:48.984830+0000","last_became_active":"2023-08-01T19:54:04.066483+0000","last_became_peered":"2023-08-01T19:54:04.066483+0000","last_unstale":"2023-08-01T19:54:48.984830+0000","last_undegraded":"2023-08-01T19:54:48.984830+0000","last_fullsized":"2023-08-01T19:54:48.984830+0000","mapping_epoch":15,"log_start":"0'0","ondisk_log_start":"0'0","created":15,"last_epoch_clean":16,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-08-01T19:54:03.032665+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-08-01T19:54:03.032665+0000","last_clean_scrub_stamp":"2023-08-01T19:54:03.032665+0000","objects_scrubbed":0,"log_size":1,"ondisk_log_size":1,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-08-03T03:08:26.880362+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[2,1],"acting":[2,1],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":2,"acting_primary":2,"purged_snaps":[]},{"pgid":"4.1c","version":"0'0","reported_seq":22,"reported_epoch":30,"state":"active+clean","last_fresh":"2023-08-01T19:54:48.985040+0000","last_change":"2023-08-01T19:54:04.466766+0000","last_active":"2023-08-01T19:54:48.985040+0000","last_peered":"2023-08-01T19:54:48.985040+0000","last_clean":"2023-08-01T19:54:48.985040+0000","last_became_active":"2023-08-01T19:54:04.466417+0000","last_became_peered":"2023-08-01T19:54:04.466417+0000","last_unstale":"2023-08-01T19:54:48.985040+0000","last_undegraded":"2023-08-01T19:54:48.985040+0000","last_fullsized":"2023-08-01T19:54:48.985040+0000","mapping_epoch":16,"log_start":"0'0","ondisk_log_start":"0'0","created":16,"last_epoch_clean":17,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-08-01T19:54:04.040663+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-08-01T19:54:04.040663+0000","last_clean_scrub_stamp":"2023-08-01T19:54:04.040663+0000","objects_scrubbed":0,"log_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-08-02T22:01:53.643825+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[2,0],"acting":[2,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":2,"acting_primary":2,"purged_snaps":[]},{"pgid":"3.1c","version":"17'2","reported_seq":24,"reported_epoch":29,"state":"active+clean","last_fresh":"2023-08-01T19:54:45.742111+0000","last_change":"2023-08-01T19:54:04.065706+0000","last_active":"2023-08-01T19:54:45.742111+0000","last_peered":"2023-08-01T19:54:45.742111+0000","last_clean":"2023-08-01T19:54:45.742111+0000","last_became_active":"2023-08-01T19:54:04.064796+0000","last_became_peered":"2023-08-01T19:54:04.064796+0000","last_unstale":"2023-08-01T19:54:45.742111+0000","last_undegraded":"2023-08-01T19:54:45.742111+0000","last_fullsized":"2023-08-01T19:54:45.742111+0000","mapping_epoch":15,"log_start":"0'0","ondisk_log_start":"0'0","created":15,"last_epoch_clean":16,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-08-01T19:54:03.032665+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-08-01T19:54:03.032665+0000","last_clean_scrub_stamp":"2023-08-01T19:54:03.032665+0000","objects_scrubbed":0,"log_size":2,"ondisk_log_size":2,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-08-02T21:40:43.596301+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":1,"num_object_clones":0,"num_object_copies":2,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":1,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":3,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":1,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[1,0],"acting":[1,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":1,"acting_primary":1,"purged_snaps":[]},{"pgid":"4.1b","version":"0'0","reported_seq":21,"reported_epoch":29,"state":"active+clean","last_fresh":"2023-08-01T19:54:45.741723+0000","last_change":"2023-08-01T19:54:04.474971+0000","last_active":"2023-08-01T19:54:45.741723+0000","last_peered":"2023-08-01T19:54:45.741723+0000","last_clean":"2023-08-01T19:54:45.741723+0000","last_became_active":"2023-08-01T19:54:04.473957+0000","last_became_peered":"2023-08-01T19:54:04.473957+0000","last_unstale":"2023-08-01T19:54:45.741723+0000","last_undegraded":"2023-08-01T19:54:45.741723+0000","last_fullsized":"2023-08-01T19:54:45.741723+0000","mapping_epoch":16,"log_start":"0'0","ondisk_log_start":"0'0","created":16,"last_epoch_clean":17,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-08-01T19:54:04.040663+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-08-01T19:54:04.040663+0000","last_clean_scrub_stamp":"2023-08-01T19:54:04.040663+0000","objects_scrubbed":0,"log_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-08-02T21:59:19.682560+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[1,0],"acting":[1,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":1,"acting_primary":1,"purged_snaps":[]},{"pgid":"3.1d","version":"17'2","reported_seq":25,"reported_epoch":30,"state":"active+clean","last_fresh":"2023-08-01T19:54:48.985449+0000","last_change":"2023-08-01T19:54:04.065591+0000","last_active":"2023-08-01T19:54:48.985449+0000","last_peered":"2023-08-01T19:54:48.985449+0000","last_clean":"2023-08-01T19:54:48.985449+0000","last_became_active":"2023-08-01T19:54:04.065306+0000","last_became_peered":"2023-08-01T19:54:04.065306+0000","last_unstale":"2023-08-01T19:54:48.985449+0000","last_undegraded":"2023-08-01T19:54:48.985449+0000","last_fullsized":"2023-08-01T19:54:48.985449+0000","mapping_epoch":15,"log_start":"0'0","ondisk_log_start":"0'0","created":15,"last_epoch_clean":16,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-08-01T19:54:03.032665+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-08-01T19:54:03.032665+0000","last_clean_scrub_stamp":"2023-08-01T19:54:03.032665+0000","objects_scrubbed":0,"log_size":2,"ondisk_log_size":2,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-08-02T21:32:10.389227+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":1,"num_object_clones":0,"num_object_copies":2,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":1,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":3,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":1,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[2,1],"acting":[2,1],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":2,"acting_primary":2,"purged_snaps":[]},{"pgid":"4.1a","version":"0'0","reported_seq":21,"reported_epoch":29,"state":"active+clean","last_fresh":"2023-08-01T19:54:45.741686+0000","last_change":"2023-08-01T19:54:04.473302+0000","last_active":"2023-08-01T19:54:45.741686+0000","last_peered":"2023-08-01T19:54:45.741686+0000","last_clean":"2023-08-01T19:54:45.741686+0000","last_became_active":"2023-08-01T19:54:04.472452+0000","last_became_peered":"2023-08-01T19:54:04.472452+0000","last_unstale":"2023-08-01T19:54:45.741686+0000","last_undegraded":"2023-08-01T19:54:45.741686+0000","last_fullsized":"2023-08-01T19:54:45.741686+0000","mapping_epoch":16,"log_start":"0'0","ondisk_log_start":"0'0","created":16,"last_epoch_clean":17,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-08-01T19:54:04.040663+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-08-01T19:54:04.040663+0000","last_clean_scrub_stamp":"2023-08-01T19:54:04.040663+0000","objects_scrubbed":0,"log_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-08-02T21:02:39.542019+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[1,0],"acting":[1,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":1,"acting_primary":1,"purged_snaps":[]},{"pgid":"3.1e","version":"17'1","reported_seq":23,"reported_epoch":29,"state":"active+clean","last_fresh":"2023-08-01T19:54:45.740760+0000","last_change":"2023-08-01T19:54:04.064378+0000","last_active":"2023-08-01T19:54:45.740760+0000","last_peered":"2023-08-01T19:54:45.740760+0000","last_clean":"2023-08-01T19:54:45.740760+0000","last_became_active":"2023-08-01T19:54:04.063988+0000","last_became_peered":"2023-08-01T19:54:04.063988+0000","last_unstale":"2023-08-01T19:54:45.740760+0000","last_undegraded":"2023-08-01T19:54:45.740760+0000","last_fullsized":"2023-08-01T19:54:45.740760+0000","mapping_epoch":15,"log_start":"0'0","ondisk_log_start":"0'0","created":15,"last_epoch_clean":16,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-08-01T19:54:03.032665+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-08-01T19:54:03.032665+0000","last_clean_scrub_stamp":"2023-08-01T19:54:03.032665+0000","objects_scrubbed":0,"log_size":1,"ondisk_log_size":1,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-08-02T22:28:51.936138+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[0,2],"acting":[0,2],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":0,"acting_primary":0,"purged_snaps":[]},{"pgid":"4.19","version":"0'0","reported_seq":22,"reported_epoch":30,"state":"active+clean","last_fresh":"2023-08-01T19:54:48.984831+0000","last_change":"2023-08-01T19:54:04.467017+0000","last_active":"2023-08-01T19:54:48.984831+0000","last_peered":"2023-08-01T19:54:48.984831+0000","last_clean":"2023-08-01T19:54:48.984831+0000","last_became_active":"2023-08-01T19:54:04.466339+0000","last_became_peered":"2023-08-01T19:54:04.466339+0000","last_unstale":"2023-08-01T19:54:48.984831+0000","last_undegraded":"2023-08-01T19:54:48.984831+0000","last_fullsized":"2023-08-01T19:54:48.984831+0000","mapping_epoch":16,"log_start":"0'0","ondisk_log_start":"0'0","created":16,"last_epoch_clean":17,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-08-01T19:54:04.040663+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-08-01T19:54:04.040663+0000","last_clean_scrub_stamp":"2023-08-01T19:54:04.040663+0000","objects_scrubbed":0,"log_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-08-03T04:07:57.222873+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[2,0],"acting":[2,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":2,"acting_primary":2,"purged_snaps":[]},{"pgid":"3.1f","version":"17'4","reported_seq":26,"reported_epoch":29,"state":"active+clean","last_fresh":"2023-08-01T19:54:45.740714+0000","last_change":"2023-08-01T19:54:04.067767+0000","last_active":"2023-08-01T19:54:45.740714+0000","last_peered":"2023-08-01T19:54:45.740714+0000","last_clean":"2023-08-01T19:54:45.740714+0000","last_became_active":"2023-08-01T19:54:04.067414+0000","last_became_peered":"2023-08-01T19:54:04.067414+0000","last_unstale":"2023-08-01T19:54:45.740714+0000","last_undegraded":"2023-08-01T19:54:45.740714+0000","last_fullsized":"2023-08-01T19:54:45.740714+0000","mapping_epoch":15,"log_start":"0'0","ondisk_log_start":"0'0","created":15,"last_epoch_clean":16,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-08-01T19:54:03.032665+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-08-01T19:54:03.032665+0000","last_clean_scrub_stamp":"2023-08-01T19:54:03.032665+0000","objects_scrubbed":0,"log_size":4,"ondisk_log_size":4,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-08-02T21:33:27.007118+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":554,"num_objects":2,"num_object_clones":0,"num_object_copies":4,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":2,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":4,"num_write_kb":1,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":1,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[0,1],"acting":[0,1],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":0,"acting_primary":0,"purged_snaps":[]},{"pgid":"4.18","version":"0'0","reported_seq":21,"reported_epoch":29,"state":"active+clean","last_fresh":"2023-08-01T19:54:45.741634+0000","last_change":"2023-08-01T19:54:04.477588+0000","last_active":"2023-08-01T19:54:45.741634+0000","last_peered":"2023-08-01T19:54:45.741634+0000","last_clean":"2023-08-01T19:54:45.741634+0000","last_became_active":"2023-08-01T19:54:04.476194+0000","last_became_peered":"2023-08-01T19:54:04.476194+0000","last_unstale":"2023-08-01T19:54:45.741634+0000","last_undegraded":"2023-08-01T19:54:45.741634+0000","last_fullsized":"2023-08-01T19:54:45.741634+0000","mapping_epoch":16,"log_start":"0'0","ondisk_log_start":"0'0","created":16,"last_epoch_clean":17,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-08-01T19:54:04.040663+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-08-01T19:54:04.040663+0000","last_clean_scrub_stamp":"2023-08-01T19:54:04.040663+0000","objects_scrubbed":0,"log_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-08-03T03:58:06.360840+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[1,0],"acting":[1,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":1,"acting_primary":1,"purged_snaps":[]},{"pgid":"4.20","version":"0'0","reported_seq":21,"reported_epoch":29,"state":"active+clean","last_fresh":"2023-08-01T19:54:45.741553+0000","last_change":"2023-08-01T19:54:04.477904+0000","last_active":"2023-08-01T19:54:45.741553+0000","last_peered":"2023-08-01T19:54:45.741553+0000","last_clean":"2023-08-01T19:54:45.741553+0000","last_became_active":"2023-08-01T19:54:04.476564+0000","last_became_peered":"2023-08-01T19:54:04.476564+0000","last_unstale":"2023-08-01T19:54:45.741553+0000","last_undegraded":"2023-08-01T19:54:45.741553+0000","last_fullsized":"2023-08-01T19:54:45.741553+0000","mapping_epoch":16,"log_start":"0'0","ondisk_log_start":"0'0","created":16,"last_epoch_clean":17,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-08-01T19:54:04.040663+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-08-01T19:54:04.040663+0000","last_clean_scrub_stamp":"2023-08-01T19:54:04.040663+0000","objects_scrubbed":0,"log_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-08-03T02:21:47.656072+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[1,0],"acting":[1,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":1,"acting_primary":1,"purged_snaps":[]},{"pgid":"4.21","version":"0'0","reported_seq":21,"reported_epoch":29,"state":"active+clean","last_fresh":"2023-08-01T19:54:45.739875+0000","last_change":"2023-08-01T19:54:04.466899+0000","last_active":"2023-08-01T19:54:45.739875+0000","last_peered":"2023-08-01T19:54:45.739875+0000","last_clean":"2023-08-01T19:54:45.739875+0000","last_became_active":"2023-08-01T19:54:04.466500+0000","last_became_peered":"2023-08-01T19:54:04.466500+0000","last_unstale":"2023-08-01T19:54:45.739875+0000","last_undegraded":"2023-08-01T19:54:45.739875+0000","last_fullsized":"2023-08-01T19:54:45.739875+0000","mapping_epoch":16,"log_start":"0'0","ondisk_log_start":"0'0","created":16,"last_epoch_clean":17,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-08-01T19:54:04.040663+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-08-01T19:54:04.040663+0000","last_clean_scrub_stamp":"2023-08-01T19:54:04.040663+0000","objects_scrubbed":0,"log_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-08-03T07:36:38.654701+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[0,2],"acting":[0,2],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":0,"acting_primary":0,"purged_snaps":[]},{"pgid":"4.22","version":"0'0","reported_seq":22,"reported_epoch":30,"state":"active+clean","last_fresh":"2023-08-01T19:54:48.985220+0000","last_change":"2023-08-01T19:54:04.471945+0000","last_active":"2023-08-01T19:54:48.985220+0000","last_peered":"2023-08-01T19:54:48.985220+0000","last_clean":"2023-08-01T19:54:48.985220+0000","last_became_active":"2023-08-01T19:54:04.471371+0000","last_became_peered":"2023-08-01T19:54:04.471371+0000","last_unstale":"2023-08-01T19:54:48.985220+0000","last_undegraded":"2023-08-01T19:54:48.985220+0000","last_fullsized":"2023-08-01T19:54:48.985220+0000","mapping_epoch":16,"log_start":"0'0","ondisk_log_start":"0'0","created":16,"last_epoch_clean":17,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-08-01T19:54:04.040663+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-08-01T19:54:04.040663+0000","last_clean_scrub_stamp":"2023-08-01T19:54:04.040663+0000","objects_scrubbed":0,"log_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-08-02T22:17:59.847819+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[2,1],"acting":[2,1],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":2,"acting_primary":2,"purged_snaps":[]},{"pgid":"4.23","version":"0'0","reported_seq":21,"reported_epoch":29,"state":"active+clean","last_fresh":"2023-08-01T19:54:45.741511+0000","last_change":"2023-08-01T19:54:04.467847+0000","last_active":"2023-08-01T19:54:45.741511+0000","last_peered":"2023-08-01T19:54:45.741511+0000","last_clean":"2023-08-01T19:54:45.741511+0000","last_became_active":"2023-08-01T19:54:04.467111+0000","last_became_peered":"2023-08-01T19:54:04.467111+0000","last_unstale":"2023-08-01T19:54:45.741511+0000","last_undegraded":"2023-08-01T19:54:45.741511+0000","last_fullsized":"2023-08-01T19:54:45.741511+0000","mapping_epoch":16,"log_start":"0'0","ondisk_log_start":"0'0","created":16,"last_epoch_clean":17,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-08-01T19:54:04.040663+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-08-01T19:54:04.040663+0000","last_clean_scrub_stamp":"2023-08-01T19:54:04.040663+0000","objects_scrubbed":0,"log_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-08-03T00:42:19.379348+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[0,2],"acting":[0,2],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":0,"acting_primary":0,"purged_snaps":[]},{"pgid":"4.24","version":"0'0","reported_seq":22,"reported_epoch":30,"state":"active+clean","last_fresh":"2023-08-01T19:54:48.985042+0000","last_change":"2023-08-01T19:54:04.477128+0000","last_active":"2023-08-01T19:54:48.985042+0000","last_peered":"2023-08-01T19:54:48.985042+0000","last_clean":"2023-08-01T19:54:48.985042+0000","last_became_active":"2023-08-01T19:54:04.476819+0000","last_became_peered":"2023-08-01T19:54:04.476819+0000","last_unstale":"2023-08-01T19:54:48.985042+0000","last_undegraded":"2023-08-01T19:54:48.985042+0000","last_fullsized":"2023-08-01T19:54:48.985042+0000","mapping_epoch":16,"log_start":"0'0","ondisk_log_start":"0'0","created":16,"last_epoch_clean":17,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-08-01T19:54:04.040663+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-08-01T19:54:04.040663+0000","last_clean_scrub_stamp":"2023-08-01T19:54:04.040663+0000","objects_scrubbed":0,"log_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-08-03T02:20:23.354054+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[2,1],"acting":[2,1],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":2,"acting_primary":2,"purged_snaps":[]}],"pool_stats":[{"poolid":5,"num_pg":16,"stat_sum":{"num_bytes":4665442304,"num_objects":71189,"num_object_clones":0,"num_object_copies":142378,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":71189,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":71189,"num_write_kb":4556096,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"store_stats":{"total":0,"available":0,"internally_reserved":0,"allocated":581492736,"data_stored":9303883776,"data_compressed":44555104,"data_compressed_allocated":581492736,"data_compressed_original":9303883776,"omap_allocated":0,"internal_metadata":0},"log_size":60589,"ondisk_log_size":60589,"up":32,"acting":32,"num_store_stats":3},{"poolid":4,"num_pg":64,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"store_stats":{"total":0,"available":0,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},"log_size":0,"ondisk_log_size":0,"up":128,"acting":128,"num_store_stats":3},{"poolid":3,"num_pg":32,"stat_sum":{"num_bytes":2306,"num_objects":22,"num_object_clones":0,"num_object_copies":44,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":22,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":45,"num_write_kb":13,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":14,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"store_stats":{"total":0,"available":0,"internally_reserved":0,"allocated":65536,"data_stored":4612,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},"log_size":39,"ondisk_log_size":39,"up":64,"acting":64,"num_store_stats":3},{"poolid":1,"num_pg":1,"stat_sum":{"num_bytes":590368,"num_objects":2,"num_object_clones":0,"num_object_copies":4,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":2,"num_whiteouts":0,"num_read":136,"num_read_kb":118,"num_write":203,"num_write_kb":3460,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"store_stats":{"total":0,"available":0,"internally_reserved":0,"allocated":114688,"data_stored":1180736,"data_compressed":20662,"data_compressed_allocated":73728,"data_compressed_original":1146880,"omap_allocated":0,"internal_metadata":0},"log_size":157,"ondisk_log_size":157,"up":2,"acting":2,"num_store_stats":2},{"poolid":2,"num_pg":8,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"store_stats":{"total":0,"available":0,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},"log_size":0,"ondisk_log_size":0,"up":16,"acting":16,"num_store_stats":3}],"osd_stats":[{"osd":2,"up_from":9,"seq":38654705680,"num_pgs":76,"num_osds":1,"num_per_pool_osds":1,"num_per_pool_omap_osds":1,"kb":94371840,"kb_used":215428,"kb_used_data":158972,"kb_used_omap":0,"kb_used_meta":56448,"kb_avail":94156412,"statfs":{"total":96636764160,"available":96416165888,"internally_reserved":0,"allocated":162787328,"data_stored":2599139938,"data_compressed":12453822,"data_compressed_allocated":162439168,"data_compressed_original":2599010304,"omap_allocated":0,"internal_metadata":57802752},"hb_peers":[0,1],"snap_trim_queue_len":0,"num_snap_trimming":0,"num_shards_repaired":0,"op_queue_age_hist":{"histogram":[0,1,3,4,2],"upper_bound":32},"perf_stat":{"commit_latency_ms":2,"apply_latency_ms":2,"commit_latency_ns":2000000,"apply_latency_ns":2000000},"alerts":[],"network_ping_times":[{"osd":0,"last update":"Thu Jan 1 00:00:00 1970","interfaces":[{"interface":"back","average":{"1min":0,"5min":0,"15min":0},"min":{"1min":0,"5min":0,"15min":0},"max":{"1min":0,"5min":0,"15min":0},"last":0.28399999999999997}]},{"osd":1,"last update":"Thu Jan 1 00:00:00 1970","interfaces":[{"interface":"back","average":{"1min":0,"5min":0,"15min":0},"min":{"1min":0,"5min":0,"15min":0},"max":{"1min":0,"5min":0,"15min":0},"last":0.219}]}]},{"osd":0,"up_from":8,"seq":34359738383,"num_pgs":85,"num_osds":1,"num_per_pool_osds":1,"num_per_pool_omap_osds":1,"kb":94371840,"kb_used":292616,"kb_used_data":224704,"kb_used_omap":0,"kb_used_meta":67904,"kb_avail":94079224,"statfs":{"total":96636764160,"available":96337125376,"internally_reserved":0,"allocated":230096896,"data_stored":3676681176,"data_compressed":17606345,"data_compressed_allocated":229785600,"data_compressed_original":3676569600,"omap_allocated":0,"internal_metadata":69533696},"hb_peers":[1,2],"snap_trim_queue_len":0,"num_snap_trimming":0,"num_shards_repaired":0,"op_queue_age_hist":{"histogram":[],"upper_bound":1},"perf_stat":{"commit_latency_ms":3,"apply_latency_ms":3,"commit_latency_ns":3000000,"apply_latency_ns":3000000},"alerts":[],"network_ping_times":[{"osd":1,"last update":"Tue Aug 1 19:54:49 2023","interfaces":[{"interface":"back","average":{"1min":0.36299999999999999,"5min":0.36299999999999999,"15min":0.36299999999999999},"min":{"1min":0.17699999999999999,"5min":0.17699999999999999,"15min":0.17699999999999999},"max":{"1min":0.63700000000000001,"5min":0.63700000000000001,"15min":0.63700000000000001},"last":0.19900000000000001},{"interface":"front","average":{"1min":0.39600000000000002,"5min":0.39600000000000002,"15min":0.39600000000000002},"min":{"1min":0.215,"5min":0.215,"15min":0.215},"max":{"1min":0.76000000000000001,"5min":0.76000000000000001,"15min":0.76000000000000001},"last":0.27200000000000002}]},{"osd":2,"last update":"Thu Jan 1 00:00:00 1970","interfaces":[{"interface":"back","average":{"1min":0,"5min":0,"15min":0},"min":{"1min":0,"5min":0,"15min":0},"max":{"1min":0,"5min":0,"15min":0},"last":0.31}]}]},{"osd":1,"up_from":8,"seq":34359738382,"num_pgs":81,"num_osds":1,"num_per_pool_osds":1,"num_per_pool_omap_osds":1,"kb":94371840,"kb_used":232728,"kb_used_data":172752,"kb_used_omap":0,"kb_used_meta":59968,"kb_avail":94139112,"statfs":{"total":96636764160,"available":96398450688,"internally_reserved":0,"allocated":176898048,"data_stored":2824780974,"data_compressed":13534349,"data_compressed_allocated":176541696,"data_compressed_original":2824650752,"omap_allocated":0,"internal_metadata":61407232},"hb_peers":[0,2],"snap_trim_queue_len":0,"num_snap_trimming":0,"num_shards_repaired":0,"op_queue_age_hist":{"histogram":[],"upper_bound":1},"perf_stat":{"commit_latency_ms":3,"apply_latency_ms":3,"commit_latency_ns":3000000,"apply_latency_ns":3000000},"alerts":[],"network_ping_times":[{"osd":0,"last update":"Tue Aug 1 19:54:49 2023","interfaces":[{"interface":"back","average":{"1min":0.63900000000000001,"5min":0.63900000000000001,"15min":0.63900000000000001},"min":{"1min":0.17299999999999999,"5min":0.17299999999999999,"15min":0.17299999999999999},"max":{"1min":2.1709999999999998,"5min":2.1709999999999998,"15min":2.1709999999999998},"last":2.1709999999999998},{"interface":"front","average":{"1min":0.36699999999999999,"5min":0.36699999999999999,"15min":0.36699999999999999},"min":{"1min":0.193,"5min":0.193,"15min":0.193},"max":{"1min":0.65600000000000003,"5min":0.65600000000000003,"15min":0.65600000000000003},"last":0.193}]},{"osd":2,"last update":"Thu Jan 1 00:00:00 1970","interfaces":[{"interface":"back","average":{"1min":0,"5min":0,"15min":0},"min":{"1min":0,"5min":0,"15min":0},"max":{"1min":0,"5min":0,"15min":0},"last":0.219}]}]}],"pool_statfs":[{"poolid":1,"osd":1,"total":0,"available":0,"internally_reserved":0,"allocated":57344,"data_stored":590368,"data_compressed":10331,"data_compressed_allocated":36864,"data_compressed_original":573440,"omap_allocated":0,"internal_metadata":0},{"poolid":1,"osd":2,"total":0,"available":0,"internally_reserved":0,"allocated":57344,"data_stored":590368,"data_compressed":10331,"data_compressed_allocated":36864,"data_compressed_original":573440,"omap_allocated":0,"internal_metadata":0},{"poolid":2,"osd":0,"total":0,"available":0,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":2,"osd":1,"total":0,"available":0,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":2,"osd":2,"total":0,"available":0,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":3,"osd":0,"total":0,"available":0,"internally_reserved":0,"allocated":8192,"data_stored":588,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":3,"osd":1,"total":0,"available":0,"internally_reserved":0,"allocated":32768,"data_stored":2306,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":3,"osd":2,"total":0,"available":0,"internally_reserved":0,"allocated":24576,"data_stored":1718,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":4,"osd":0,"total":0,"available":0,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":4,"osd":1,"total":0,"available":0,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":4,"osd":2,"total":0,"available":0,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":5,"osd":0,"total":0,"available":0,"internally_reserved":0,"allocated":234168320,"data_stored":3746693120,"data_compressed":17942325,"data_compressed_allocated":234168320,"data_compressed_original":3746693120,"omap_allocated":0,"internal_metadata":0},{"poolid":5,"osd":1,"total":0,"available":0,"internally_reserved":0,"allocated":180731904,"data_stored":2891710464,"data_compressed":13848066,"data_compressed_allocated":180731904,"data_compressed_original":2891710464,"omap_allocated":0,"internal_metadata":0},{"poolid":5,"osd":2,"total":0,"available":0,"internally_reserved":0,"allocated":166592512,"data_stored":2665480192,"data_compressed":12764713,"data_compressed_allocated":166592512,"data_compressed_original":2665480192,"omap_allocated":0,"internal_metadata":0}]}} 2023-08-01T19:54:53.435 DEBUG:teuthology.orchestra.run.smithi006:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 120 ceph --cluster ceph pg dump --format=json 2023-08-01T19:54:53.484 INFO:tasks.ceph.osd.1.smithi101.stderr:2023-08-01T19:54:53.482+0000 7fb0cb7f6700 -1 received signal: Hangup from /usr/bin/python3 /bin/daemon-helper kill ceph-osd -f --cluster ceph -i 1 (PID: 111141) UID: 0 2023-08-01T19:54:53.565 INFO:teuthology.orchestra.run.smithi101.stdout:ERROR: (22) Invalid argument 2023-08-01T19:54:53.565 INFO:teuthology.orchestra.run.smithi101.stdout:op_tracker tracking is not enabled now, so no ops are tracked currently, even those get stuck. Please enable "osd_enable_op_tracker", and the tracker will start to track new ops received afterwards. 2023-08-01T19:54:53.580 DEBUG:teuthology.orchestra.run.smithi155:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 30 ceph --cluster ceph --admin-daemon /var/run/ceph/ceph-osd.2.asok dump_ops_in_flight 2023-08-01T19:54:53.584 INFO:tasks.ceph.osd.0.smithi008.stderr:2023-08-01T19:54:53.584+0000 7f16a58f4700 -1 received signal: Hangup from /usr/bin/python3 /bin/daemon-helper kill ceph-osd -f --cluster ceph -i 0 (PID: 111179) UID: 0 2023-08-01T19:54:53.685 INFO:tasks.ceph.osd.0.smithi008.stderr:2023-08-01T19:54:53.684+0000 7f16a58f4700 -1 received signal: Hangup from /usr/bin/python3 /bin/daemon-helper kill ceph-osd -f --cluster ceph -i 0 (PID: 111179) UID: 0 2023-08-01T19:54:53.748 INFO:teuthology.orchestra.run.smithi155.stdout:ERROR: (22) Invalid argument 2023-08-01T19:54:53.748 INFO:teuthology.orchestra.run.smithi155.stdout:op_tracker tracking is not enabled now, so no ops are tracked currently, even those get stuck. Please enable "osd_enable_op_tracker", and the tracker will start to track new ops received afterwards. 2023-08-01T19:54:53.763 DEBUG:teuthology.orchestra.run.smithi155:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 30 ceph --cluster ceph --admin-daemon /var/run/ceph/ceph-osd.2.asok dump_blocked_ops 2023-08-01T19:54:53.785 INFO:tasks.ceph.osd.0.smithi008.stderr:2023-08-01T19:54:53.784+0000 7f16a58f4700 -1 received signal: Hangup from /usr/bin/python3 /bin/daemon-helper kill ceph-osd -f --cluster ceph -i 0 (PID: 111179) UID: 0 2023-08-01T19:54:53.805 INFO:teuthology.orchestra.run.smithi006.stdout: 2023-08-01T19:54:53.807 INFO:teuthology.orchestra.run.smithi006.stderr:dumped all 2023-08-01T19:54:53.818 INFO:teuthology.orchestra.run.smithi006.stdout:{"pg_ready":true,"pg_map":{"version":61,"stamp":"2023-08-01T19:54:53.050331+0000","last_osdmap_epoch":0,"last_pg_scan":0,"pg_stats_sum":{"stat_sum":{"num_bytes":4666034978,"num_objects":71213,"num_object_clones":0,"num_object_copies":142426,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":71213,"num_whiteouts":0,"num_read":136,"num_read_kb":118,"num_write":71437,"num_write_kb":4559569,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":14,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"store_stats":{"total":0,"available":0,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},"log_size":60785,"ondisk_log_size":60785,"up":242,"acting":242,"num_store_stats":0},"osd_stats_sum":{"up_from":0,"seq":0,"num_pgs":242,"num_osds":3,"num_per_pool_osds":3,"num_per_pool_omap_osds":3,"kb":283115520,"kb_used":740772,"kb_used_data":556428,"kb_used_omap":0,"kb_used_meta":184320,"kb_avail":282374748,"statfs":{"total":289910292480,"available":289151741952,"internally_reserved":0,"allocated":569782272,"data_stored":9100602088,"data_compressed":43594516,"data_compressed_allocated":568766464,"data_compressed_original":9100230656,"omap_allocated":0,"internal_metadata":188743680},"hb_peers":[],"snap_trim_queue_len":0,"num_snap_trimming":0,"num_shards_repaired":0,"op_queue_age_hist":{"histogram":[0,1,3,4,2],"upper_bound":32},"perf_stat":{"commit_latency_ms":8,"apply_latency_ms":8,"commit_latency_ns":8000000,"apply_latency_ns":8000000},"alerts":[],"network_ping_times":[]},"pg_stats_delta":{"stat_sum":{"num_bytes":667025408,"num_objects":10178,"num_object_clones":0,"num_object_copies":20356,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":10178,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":10178,"num_write_kb":651392,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"store_stats":{"total":0,"available":0,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},"log_size":0,"ondisk_log_size":0,"up":0,"acting":0,"num_store_stats":0,"stamp_delta":"5.134384"},"pg_stats":[{"pgid":"4.3f","version":"0'0","reported_seq":22,"reported_epoch":30,"state":"active+clean","last_fresh":"2023-08-01T19:54:48.985844+0000","last_change":"2023-08-01T19:54:04.473430+0000","last_active":"2023-08-01T19:54:48.985844+0000","last_peered":"2023-08-01T19:54:48.985844+0000","last_clean":"2023-08-01T19:54:48.985844+0000","last_became_active":"2023-08-01T19:54:04.472887+0000","last_became_peered":"2023-08-01T19:54:04.472887+0000","last_unstale":"2023-08-01T19:54:48.985844+0000","last_undegraded":"2023-08-01T19:54:48.985844+0000","last_fullsized":"2023-08-01T19:54:48.985844+0000","mapping_epoch":16,"log_start":"0'0","ondisk_log_start":"0'0","created":16,"last_epoch_clean":17,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-08-01T19:54:04.040663+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-08-01T19:54:04.040663+0000","last_clean_scrub_stamp":"2023-08-01T19:54:04.040663+0000","objects_scrubbed":0,"log_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-08-03T06:38:54.196605+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[2,0],"acting":[2,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":2,"acting_primary":2,"purged_snaps":[]},{"pgid":"4.3e","version":"0'0","reported_seq":22,"reported_epoch":30,"state":"active+clean","last_fresh":"2023-08-01T19:54:48.985372+0000","last_change":"2023-08-01T19:54:04.470501+0000","last_active":"2023-08-01T19:54:48.985372+0000","last_peered":"2023-08-01T19:54:48.985372+0000","last_clean":"2023-08-01T19:54:48.985372+0000","last_became_active":"2023-08-01T19:54:04.469692+0000","last_became_peered":"2023-08-01T19:54:04.469692+0000","last_unstale":"2023-08-01T19:54:48.985372+0000","last_undegraded":"2023-08-01T19:54:48.985372+0000","last_fullsized":"2023-08-01T19:54:48.985372+0000","mapping_epoch":16,"log_start":"0'0","ondisk_log_start":"0'0","created":16,"last_epoch_clean":17,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-08-01T19:54:04.040663+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-08-01T19:54:04.040663+0000","last_clean_scrub_stamp":"2023-08-01T19:54:04.040663+0000","objects_scrubbed":0,"log_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-08-03T02:19:35.201107+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[2,0],"acting":[2,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":2,"acting_primary":2,"purged_snaps":[]},{"pgid":"4.3d","version":"0'0","reported_seq":21,"reported_epoch":29,"state":"active+clean","last_fresh":"2023-08-01T19:54:45.742446+0000","last_change":"2023-08-01T19:54:04.472579+0000","last_active":"2023-08-01T19:54:45.742446+0000","last_peered":"2023-08-01T19:54:45.742446+0000","last_clean":"2023-08-01T19:54:45.742446+0000","last_became_active":"2023-08-01T19:54:04.471128+0000","last_became_peered":"2023-08-01T19:54:04.471128+0000","last_unstale":"2023-08-01T19:54:45.742446+0000","last_undegraded":"2023-08-01T19:54:45.742446+0000","last_fullsized":"2023-08-01T19:54:45.742446+0000","mapping_epoch":16,"log_start":"0'0","ondisk_log_start":"0'0","created":16,"last_epoch_clean":17,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-08-01T19:54:04.040663+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-08-01T19:54:04.040663+0000","last_clean_scrub_stamp":"2023-08-01T19:54:04.040663+0000","objects_scrubbed":0,"log_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-08-03T03:04:06.137335+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[1,2],"acting":[1,2],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":1,"acting_primary":1,"purged_snaps":[]},{"pgid":"4.3c","version":"0'0","reported_seq":21,"reported_epoch":29,"state":"active+clean","last_fresh":"2023-08-01T19:54:45.742426+0000","last_change":"2023-08-01T19:54:04.477908+0000","last_active":"2023-08-01T19:54:45.742426+0000","last_peered":"2023-08-01T19:54:45.742426+0000","last_clean":"2023-08-01T19:54:45.742426+0000","last_became_active":"2023-08-01T19:54:04.476684+0000","last_became_peered":"2023-08-01T19:54:04.476684+0000","last_unstale":"2023-08-01T19:54:45.742426+0000","last_undegraded":"2023-08-01T19:54:45.742426+0000","last_fullsized":"2023-08-01T19:54:45.742426+0000","mapping_epoch":16,"log_start":"0'0","ondisk_log_start":"0'0","created":16,"last_epoch_clean":17,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-08-01T19:54:04.040663+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-08-01T19:54:04.040663+0000","last_clean_scrub_stamp":"2023-08-01T19:54:04.040663+0000","objects_scrubbed":0,"log_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-08-03T03:56:55.336461+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[1,0],"acting":[1,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":1,"acting_primary":1,"purged_snaps":[]},{"pgid":"4.3b","version":"0'0","reported_seq":22,"reported_epoch":30,"state":"active+clean","last_fresh":"2023-08-01T19:54:48.984742+0000","last_change":"2023-08-01T19:54:04.467197+0000","last_active":"2023-08-01T19:54:48.984742+0000","last_peered":"2023-08-01T19:54:48.984742+0000","last_clean":"2023-08-01T19:54:48.984742+0000","last_became_active":"2023-08-01T19:54:04.466526+0000","last_became_peered":"2023-08-01T19:54:04.466526+0000","last_unstale":"2023-08-01T19:54:48.984742+0000","last_undegraded":"2023-08-01T19:54:48.984742+0000","last_fullsized":"2023-08-01T19:54:48.984742+0000","mapping_epoch":16,"log_start":"0'0","ondisk_log_start":"0'0","created":16,"last_epoch_clean":17,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-08-01T19:54:04.040663+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-08-01T19:54:04.040663+0000","last_clean_scrub_stamp":"2023-08-01T19:54:04.040663+0000","objects_scrubbed":0,"log_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-08-03T06:54:18.982174+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[2,0],"acting":[2,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":2,"acting_primary":2,"purged_snaps":[]},{"pgid":"4.3a","version":"0'0","reported_seq":21,"reported_epoch":29,"state":"active+clean","last_fresh":"2023-08-01T19:54:45.741612+0000","last_change":"2023-08-01T19:54:04.473296+0000","last_active":"2023-08-01T19:54:45.741612+0000","last_peered":"2023-08-01T19:54:45.741612+0000","last_clean":"2023-08-01T19:54:45.741612+0000","last_became_active":"2023-08-01T19:54:04.472324+0000","last_became_peered":"2023-08-01T19:54:04.472324+0000","last_unstale":"2023-08-01T19:54:45.741612+0000","last_undegraded":"2023-08-01T19:54:45.741612+0000","last_fullsized":"2023-08-01T19:54:45.741612+0000","mapping_epoch":16,"log_start":"0'0","ondisk_log_start":"0'0","created":16,"last_epoch_clean":17,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-08-01T19:54:04.040663+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-08-01T19:54:04.040663+0000","last_clean_scrub_stamp":"2023-08-01T19:54:04.040663+0000","objects_scrubbed":0,"log_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-08-02T23:15:11.148662+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[1,0],"acting":[1,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":1,"acting_primary":1,"purged_snaps":[]},{"pgid":"4.39","version":"0'0","reported_seq":21,"reported_epoch":29,"state":"active+clean","last_fresh":"2023-08-01T19:54:45.742367+0000","last_change":"2023-08-01T19:54:04.475322+0000","last_active":"2023-08-01T19:54:45.742367+0000","last_peered":"2023-08-01T19:54:45.742367+0000","last_clean":"2023-08-01T19:54:45.742367+0000","last_became_active":"2023-08-01T19:54:04.474591+0000","last_became_peered":"2023-08-01T19:54:04.474591+0000","last_unstale":"2023-08-01T19:54:45.742367+0000","last_undegraded":"2023-08-01T19:54:45.742367+0000","last_fullsized":"2023-08-01T19:54:45.742367+0000","mapping_epoch":16,"log_start":"0'0","ondisk_log_start":"0'0","created":16,"last_epoch_clean":17,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-08-01T19:54:04.040663+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-08-01T19:54:04.040663+0000","last_clean_scrub_stamp":"2023-08-01T19:54:04.040663+0000","objects_scrubbed":0,"log_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-08-03T00:29:53.554989+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[1,0],"acting":[1,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":1,"acting_primary":1,"purged_snaps":[]},{"pgid":"4.38","version":"0'0","reported_seq":21,"reported_epoch":29,"state":"active+clean","last_fresh":"2023-08-01T19:54:45.741377+0000","last_change":"2023-08-01T19:54:04.478505+0000","last_active":"2023-08-01T19:54:45.741377+0000","last_peered":"2023-08-01T19:54:45.741377+0000","last_clean":"2023-08-01T19:54:45.741377+0000","last_became_active":"2023-08-01T19:54:04.477325+0000","last_became_peered":"2023-08-01T19:54:04.477325+0000","last_unstale":"2023-08-01T19:54:45.741377+0000","last_undegraded":"2023-08-01T19:54:45.741377+0000","last_fullsized":"2023-08-01T19:54:45.741377+0000","mapping_epoch":16,"log_start":"0'0","ondisk_log_start":"0'0","created":16,"last_epoch_clean":17,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-08-01T19:54:04.040663+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-08-01T19:54:04.040663+0000","last_clean_scrub_stamp":"2023-08-01T19:54:04.040663+0000","objects_scrubbed":0,"log_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-08-03T01:38:12.939736+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[1,0],"acting":[1,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":1,"acting_primary":1,"purged_snaps":[]},{"pgid":"4.37","version":"0'0","reported_seq":21,"reported_epoch":29,"state":"active+clean","last_fresh":"2023-08-01T19:54:45.740363+0000","last_change":"2023-08-01T19:54:04.470971+0000","last_active":"2023-08-01T19:54:45.740363+0000","last_peered":"2023-08-01T19:54:45.740363+0000","last_clean":"2023-08-01T19:54:45.740363+0000","last_became_active":"2023-08-01T19:54:04.469011+0000","last_became_peered":"2023-08-01T19:54:04.469011+0000","last_unstale":"2023-08-01T19:54:45.740363+0000","last_undegraded":"2023-08-01T19:54:45.740363+0000","last_fullsized":"2023-08-01T19:54:45.740363+0000","mapping_epoch":16,"log_start":"0'0","ondisk_log_start":"0'0","created":16,"last_epoch_clean":17,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-08-01T19:54:04.040663+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-08-01T19:54:04.040663+0000","last_clean_scrub_stamp":"2023-08-01T19:54:04.040663+0000","objects_scrubbed":0,"log_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-08-03T06:50:03.420334+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[0,2],"acting":[0,2],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":0,"acting_primary":0,"purged_snaps":[]},{"pgid":"4.36","version":"0'0","reported_seq":22,"reported_epoch":30,"state":"active+clean","last_fresh":"2023-08-01T19:54:48.985589+0000","last_change":"2023-08-01T19:54:04.473523+0000","last_active":"2023-08-01T19:54:48.985589+0000","last_peered":"2023-08-01T19:54:48.985589+0000","last_clean":"2023-08-01T19:54:48.985589+0000","last_became_active":"2023-08-01T19:54:04.473084+0000","last_became_peered":"2023-08-01T19:54:04.473084+0000","last_unstale":"2023-08-01T19:54:48.985589+0000","last_undegraded":"2023-08-01T19:54:48.985589+0000","last_fullsized":"2023-08-01T19:54:48.985589+0000","mapping_epoch":16,"log_start":"0'0","ondisk_log_start":"0'0","created":16,"last_epoch_clean":17,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-08-01T19:54:04.040663+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-08-01T19:54:04.040663+0000","last_clean_scrub_stamp":"2023-08-01T19:54:04.040663+0000","objects_scrubbed":0,"log_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-08-03T04:28:59.042443+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[2,0],"acting":[2,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":2,"acting_primary":2,"purged_snaps":[]},{"pgid":"4.35","version":"0'0","reported_seq":21,"reported_epoch":29,"state":"active+clean","last_fresh":"2023-08-01T19:54:45.742210+0000","last_change":"2023-08-01T19:54:04.475816+0000","last_active":"2023-08-01T19:54:45.742210+0000","last_peered":"2023-08-01T19:54:45.742210+0000","last_clean":"2023-08-01T19:54:45.742210+0000","last_became_active":"2023-08-01T19:54:04.475061+0000","last_became_peered":"2023-08-01T19:54:04.475061+0000","last_unstale":"2023-08-01T19:54:45.742210+0000","last_undegraded":"2023-08-01T19:54:45.742210+0000","last_fullsized":"2023-08-01T19:54:45.742210+0000","mapping_epoch":16,"log_start":"0'0","ondisk_log_start":"0'0","created":16,"last_epoch_clean":17,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-08-01T19:54:04.040663+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-08-01T19:54:04.040663+0000","last_clean_scrub_stamp":"2023-08-01T19:54:04.040663+0000","objects_scrubbed":0,"log_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-08-02T22:07:41.305488+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[1,0],"acting":[1,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":1,"acting_primary":1,"purged_snaps":[]},{"pgid":"4.34","version":"0'0","reported_seq":22,"reported_epoch":30,"state":"active+clean","last_fresh":"2023-08-01T19:54:48.984829+0000","last_change":"2023-08-01T19:54:04.468009+0000","last_active":"2023-08-01T19:54:48.984829+0000","last_peered":"2023-08-01T19:54:48.984829+0000","last_clean":"2023-08-01T19:54:48.984829+0000","last_became_active":"2023-08-01T19:54:04.467568+0000","last_became_peered":"2023-08-01T19:54:04.467568+0000","last_unstale":"2023-08-01T19:54:48.984829+0000","last_undegraded":"2023-08-01T19:54:48.984829+0000","last_fullsized":"2023-08-01T19:54:48.984829+0000","mapping_epoch":16,"log_start":"0'0","ondisk_log_start":"0'0","created":16,"last_epoch_clean":17,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-08-01T19:54:04.040663+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-08-01T19:54:04.040663+0000","last_clean_scrub_stamp":"2023-08-01T19:54:04.040663+0000","objects_scrubbed":0,"log_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-08-03T04:53:44.017572+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[2,1],"acting":[2,1],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":2,"acting_primary":2,"purged_snaps":[]},{"pgid":"4.33","version":"0'0","reported_seq":22,"reported_epoch":30,"state":"active+clean","last_fresh":"2023-08-01T19:54:48.984982+0000","last_change":"2023-08-01T19:54:04.466770+0000","last_active":"2023-08-01T19:54:48.984982+0000","last_peered":"2023-08-01T19:54:48.984982+0000","last_clean":"2023-08-01T19:54:48.984982+0000","last_became_active":"2023-08-01T19:54:04.466460+0000","last_became_peered":"2023-08-01T19:54:04.466460+0000","last_unstale":"2023-08-01T19:54:48.984982+0000","last_undegraded":"2023-08-01T19:54:48.984982+0000","last_fullsized":"2023-08-01T19:54:48.984982+0000","mapping_epoch":16,"log_start":"0'0","ondisk_log_start":"0'0","created":16,"last_epoch_clean":17,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-08-01T19:54:04.040663+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-08-01T19:54:04.040663+0000","last_clean_scrub_stamp":"2023-08-01T19:54:04.040663+0000","objects_scrubbed":0,"log_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-08-03T06:04:11.595951+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[2,0],"acting":[2,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":2,"acting_primary":2,"purged_snaps":[]},{"pgid":"4.32","version":"0'0","reported_seq":21,"reported_epoch":29,"state":"active+clean","last_fresh":"2023-08-01T19:54:45.741886+0000","last_change":"2023-08-01T19:54:04.466634+0000","last_active":"2023-08-01T19:54:45.741886+0000","last_peered":"2023-08-01T19:54:45.741886+0000","last_clean":"2023-08-01T19:54:45.741886+0000","last_became_active":"2023-08-01T19:54:04.466302+0000","last_became_peered":"2023-08-01T19:54:04.466302+0000","last_unstale":"2023-08-01T19:54:45.741886+0000","last_undegraded":"2023-08-01T19:54:45.741886+0000","last_fullsized":"2023-08-01T19:54:45.741886+0000","mapping_epoch":16,"log_start":"0'0","ondisk_log_start":"0'0","created":16,"last_epoch_clean":17,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-08-01T19:54:04.040663+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-08-01T19:54:04.040663+0000","last_clean_scrub_stamp":"2023-08-01T19:54:04.040663+0000","objects_scrubbed":0,"log_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-08-03T05:46:11.085577+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[1,2],"acting":[1,2],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":1,"acting_primary":1,"purged_snaps":[]},{"pgid":"4.31","version":"0'0","reported_seq":21,"reported_epoch":29,"state":"active+clean","last_fresh":"2023-08-01T19:54:45.741958+0000","last_change":"2023-08-01T19:54:04.472407+0000","last_active":"2023-08-01T19:54:45.741958+0000","last_peered":"2023-08-01T19:54:45.741958+0000","last_clean":"2023-08-01T19:54:45.741958+0000","last_became_active":"2023-08-01T19:54:04.472008+0000","last_became_peered":"2023-08-01T19:54:04.472008+0000","last_unstale":"2023-08-01T19:54:45.741958+0000","last_undegraded":"2023-08-01T19:54:45.741958+0000","last_fullsized":"2023-08-01T19:54:45.741958+0000","mapping_epoch":16,"log_start":"0'0","ondisk_log_start":"0'0","created":16,"last_epoch_clean":17,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-08-01T19:54:04.040663+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-08-01T19:54:04.040663+0000","last_clean_scrub_stamp":"2023-08-01T19:54:04.040663+0000","objects_scrubbed":0,"log_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-08-02T22:42:25.293502+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[1,2],"acting":[1,2],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":1,"acting_primary":1,"purged_snaps":[]},{"pgid":"4.30","version":"0'0","reported_seq":21,"reported_epoch":29,"state":"active+clean","last_fresh":"2023-08-01T19:54:45.741427+0000","last_change":"2023-08-01T19:54:04.478283+0000","last_active":"2023-08-01T19:54:45.741427+0000","last_peered":"2023-08-01T19:54:45.741427+0000","last_clean":"2023-08-01T19:54:45.741427+0000","last_became_active":"2023-08-01T19:54:04.476620+0000","last_became_peered":"2023-08-01T19:54:04.476620+0000","last_unstale":"2023-08-01T19:54:45.741427+0000","last_undegraded":"2023-08-01T19:54:45.741427+0000","last_fullsized":"2023-08-01T19:54:45.741427+0000","mapping_epoch":16,"log_start":"0'0","ondisk_log_start":"0'0","created":16,"last_epoch_clean":17,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-08-01T19:54:04.040663+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-08-01T19:54:04.040663+0000","last_clean_scrub_stamp":"2023-08-01T19:54:04.040663+0000","objects_scrubbed":0,"log_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-08-03T02:27:17.063518+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[1,0],"acting":[1,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":1,"acting_primary":1,"purged_snaps":[]},{"pgid":"4.2f","version":"0'0","reported_seq":21,"reported_epoch":29,"state":"active+clean","last_fresh":"2023-08-01T19:54:45.740446+0000","last_change":"2023-08-01T19:54:04.470302+0000","last_active":"2023-08-01T19:54:45.740446+0000","last_peered":"2023-08-01T19:54:45.740446+0000","last_clean":"2023-08-01T19:54:45.740446+0000","last_became_active":"2023-08-01T19:54:04.468919+0000","last_became_peered":"2023-08-01T19:54:04.468919+0000","last_unstale":"2023-08-01T19:54:45.740446+0000","last_undegraded":"2023-08-01T19:54:45.740446+0000","last_fullsized":"2023-08-01T19:54:45.740446+0000","mapping_epoch":16,"log_start":"0'0","ondisk_log_start":"0'0","created":16,"last_epoch_clean":17,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-08-01T19:54:04.040663+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-08-01T19:54:04.040663+0000","last_clean_scrub_stamp":"2023-08-01T19:54:04.040663+0000","objects_scrubbed":0,"log_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-08-02T22:42:25.293502+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[0,2],"acting":[0,2],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":0,"acting_primary":0,"purged_snaps":[]},{"pgid":"4.2e","version":"0'0","reported_seq":22,"reported_epoch":30,"state":"active+clean","last_fresh":"2023-08-01T19:54:48.985666+0000","last_change":"2023-08-01T19:54:04.474058+0000","last_active":"2023-08-01T19:54:48.985666+0000","last_peered":"2023-08-01T19:54:48.985666+0000","last_clean":"2023-08-01T19:54:48.985666+0000","last_became_active":"2023-08-01T19:54:04.473355+0000","last_became_peered":"2023-08-01T19:54:04.473355+0000","last_unstale":"2023-08-01T19:54:48.985666+0000","last_undegraded":"2023-08-01T19:54:48.985666+0000","last_fullsized":"2023-08-01T19:54:48.985666+0000","mapping_epoch":16,"log_start":"0'0","ondisk_log_start":"0'0","created":16,"last_epoch_clean":17,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-08-01T19:54:04.040663+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-08-01T19:54:04.040663+0000","last_clean_scrub_stamp":"2023-08-01T19:54:04.040663+0000","objects_scrubbed":0,"log_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-08-03T04:55:54.197252+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[2,0],"acting":[2,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":2,"acting_primary":2,"purged_snaps":[]},{"pgid":"4.2d","version":"0'0","reported_seq":21,"reported_epoch":29,"state":"active+clean","last_fresh":"2023-08-01T19:54:45.740463+0000","last_change":"2023-08-01T19:54:04.468775+0000","last_active":"2023-08-01T19:54:45.740463+0000","last_peered":"2023-08-01T19:54:45.740463+0000","last_clean":"2023-08-01T19:54:45.740463+0000","last_became_active":"2023-08-01T19:54:04.467274+0000","last_became_peered":"2023-08-01T19:54:04.467274+0000","last_unstale":"2023-08-01T19:54:45.740463+0000","last_undegraded":"2023-08-01T19:54:45.740463+0000","last_fullsized":"2023-08-01T19:54:45.740463+0000","mapping_epoch":16,"log_start":"0'0","ondisk_log_start":"0'0","created":16,"last_epoch_clean":17,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-08-01T19:54:04.040663+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-08-01T19:54:04.040663+0000","last_clean_scrub_stamp":"2023-08-01T19:54:04.040663+0000","objects_scrubbed":0,"log_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-08-02T23:00:37.537286+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[0,2],"acting":[0,2],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":0,"acting_primary":0,"purged_snaps":[]},{"pgid":"4.2c","version":"0'0","reported_seq":21,"reported_epoch":29,"state":"active+clean","last_fresh":"2023-08-01T19:54:45.742343+0000","last_change":"2023-08-01T19:54:04.478409+0000","last_active":"2023-08-01T19:54:45.742343+0000","last_peered":"2023-08-01T19:54:45.742343+0000","last_clean":"2023-08-01T19:54:45.742343+0000","last_became_active":"2023-08-01T19:54:04.477133+0000","last_became_peered":"2023-08-01T19:54:04.477133+0000","last_unstale":"2023-08-01T19:54:45.742343+0000","last_undegraded":"2023-08-01T19:54:45.742343+0000","last_fullsized":"2023-08-01T19:54:45.742343+0000","mapping_epoch":16,"log_start":"0'0","ondisk_log_start":"0'0","created":16,"last_epoch_clean":17,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-08-01T19:54:04.040663+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-08-01T19:54:04.040663+0000","last_clean_scrub_stamp":"2023-08-01T19:54:04.040663+0000","objects_scrubbed":0,"log_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-08-02T22:15:19.744281+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[1,0],"acting":[1,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":1,"acting_primary":1,"purged_snaps":[]},{"pgid":"4.2b","version":"0'0","reported_seq":21,"reported_epoch":29,"state":"active+clean","last_fresh":"2023-08-01T19:54:45.741666+0000","last_change":"2023-08-01T19:54:04.474047+0000","last_active":"2023-08-01T19:54:45.741666+0000","last_peered":"2023-08-01T19:54:45.741666+0000","last_clean":"2023-08-01T19:54:45.741666+0000","last_became_active":"2023-08-01T19:54:04.473578+0000","last_became_peered":"2023-08-01T19:54:04.473578+0000","last_unstale":"2023-08-01T19:54:45.741666+0000","last_undegraded":"2023-08-01T19:54:45.741666+0000","last_fullsized":"2023-08-01T19:54:45.741666+0000","mapping_epoch":16,"log_start":"0'0","ondisk_log_start":"0'0","created":16,"last_epoch_clean":17,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-08-01T19:54:04.040663+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-08-01T19:54:04.040663+0000","last_clean_scrub_stamp":"2023-08-01T19:54:04.040663+0000","objects_scrubbed":0,"log_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-08-03T05:39:29.199142+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[1,0],"acting":[1,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":1,"acting_primary":1,"purged_snaps":[]},{"pgid":"4.2a","version":"0'0","reported_seq":22,"reported_epoch":30,"state":"active+clean","last_fresh":"2023-08-01T19:54:48.985093+0000","last_change":"2023-08-01T19:54:04.469281+0000","last_active":"2023-08-01T19:54:48.985093+0000","last_peered":"2023-08-01T19:54:48.985093+0000","last_clean":"2023-08-01T19:54:48.985093+0000","last_became_active":"2023-08-01T19:54:04.468771+0000","last_became_peered":"2023-08-01T19:54:04.468771+0000","last_unstale":"2023-08-01T19:54:48.985093+0000","last_undegraded":"2023-08-01T19:54:48.985093+0000","last_fullsized":"2023-08-01T19:54:48.985093+0000","mapping_epoch":16,"log_start":"0'0","ondisk_log_start":"0'0","created":16,"last_epoch_clean":17,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-08-01T19:54:04.040663+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-08-01T19:54:04.040663+0000","last_clean_scrub_stamp":"2023-08-01T19:54:04.040663+0000","objects_scrubbed":0,"log_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-08-03T01:15:27.748810+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[2,1],"acting":[2,1],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":2,"acting_primary":2,"purged_snaps":[]},{"pgid":"4.29","version":"0'0","reported_seq":21,"reported_epoch":29,"state":"active+clean","last_fresh":"2023-08-01T19:54:45.742141+0000","last_change":"2023-08-01T19:54:04.466694+0000","last_active":"2023-08-01T19:54:45.742141+0000","last_peered":"2023-08-01T19:54:45.742141+0000","last_clean":"2023-08-01T19:54:45.742141+0000","last_became_active":"2023-08-01T19:54:04.466250+0000","last_became_peered":"2023-08-01T19:54:04.466250+0000","last_unstale":"2023-08-01T19:54:45.742141+0000","last_undegraded":"2023-08-01T19:54:45.742141+0000","last_fullsized":"2023-08-01T19:54:45.742141+0000","mapping_epoch":16,"log_start":"0'0","ondisk_log_start":"0'0","created":16,"last_epoch_clean":17,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-08-01T19:54:04.040663+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-08-01T19:54:04.040663+0000","last_clean_scrub_stamp":"2023-08-01T19:54:04.040663+0000","objects_scrubbed":0,"log_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-08-03T01:00:18.725898+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[0,1],"acting":[0,1],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":0,"acting_primary":0,"purged_snaps":[]},{"pgid":"4.28","version":"0'0","reported_seq":22,"reported_epoch":30,"state":"active+clean","last_fresh":"2023-08-01T19:54:48.984934+0000","last_change":"2023-08-01T19:54:04.468160+0000","last_active":"2023-08-01T19:54:48.984934+0000","last_peered":"2023-08-01T19:54:48.984934+0000","last_clean":"2023-08-01T19:54:48.984934+0000","last_became_active":"2023-08-01T19:54:04.467625+0000","last_became_peered":"2023-08-01T19:54:04.467625+0000","last_unstale":"2023-08-01T19:54:48.984934+0000","last_undegraded":"2023-08-01T19:54:48.984934+0000","last_fullsized":"2023-08-01T19:54:48.984934+0000","mapping_epoch":16,"log_start":"0'0","ondisk_log_start":"0'0","created":16,"last_epoch_clean":17,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-08-01T19:54:04.040663+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-08-01T19:54:04.040663+0000","last_clean_scrub_stamp":"2023-08-01T19:54:04.040663+0000","objects_scrubbed":0,"log_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-08-02T21:27:52.506153+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[2,0],"acting":[2,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":2,"acting_primary":2,"purged_snaps":[]},{"pgid":"4.27","version":"0'0","reported_seq":22,"reported_epoch":30,"state":"active+clean","last_fresh":"2023-08-01T19:54:48.985772+0000","last_change":"2023-08-01T19:54:04.469187+0000","last_active":"2023-08-01T19:54:48.985772+0000","last_peered":"2023-08-01T19:54:48.985772+0000","last_clean":"2023-08-01T19:54:48.985772+0000","last_became_active":"2023-08-01T19:54:04.468628+0000","last_became_peered":"2023-08-01T19:54:04.468628+0000","last_unstale":"2023-08-01T19:54:48.985772+0000","last_undegraded":"2023-08-01T19:54:48.985772+0000","last_fullsized":"2023-08-01T19:54:48.985772+0000","mapping_epoch":16,"log_start":"0'0","ondisk_log_start":"0'0","created":16,"last_epoch_clean":17,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-08-01T19:54:04.040663+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-08-01T19:54:04.040663+0000","last_clean_scrub_stamp":"2023-08-01T19:54:04.040663+0000","objects_scrubbed":0,"log_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-08-03T00:07:29.565677+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[2,1],"acting":[2,1],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":2,"acting_primary":2,"purged_snaps":[]},{"pgid":"4.26","version":"0'0","reported_seq":21,"reported_epoch":29,"state":"active+clean","last_fresh":"2023-08-01T19:54:45.740576+0000","last_change":"2023-08-01T19:54:04.470942+0000","last_active":"2023-08-01T19:54:45.740576+0000","last_peered":"2023-08-01T19:54:45.740576+0000","last_clean":"2023-08-01T19:54:45.740576+0000","last_became_active":"2023-08-01T19:54:04.470564+0000","last_became_peered":"2023-08-01T19:54:04.470564+0000","last_unstale":"2023-08-01T19:54:45.740576+0000","last_undegraded":"2023-08-01T19:54:45.740576+0000","last_fullsized":"2023-08-01T19:54:45.740576+0000","mapping_epoch":16,"log_start":"0'0","ondisk_log_start":"0'0","created":16,"last_epoch_clean":17,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-08-01T19:54:04.040663+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-08-01T19:54:04.040663+0000","last_clean_scrub_stamp":"2023-08-01T19:54:04.040663+0000","objects_scrubbed":0,"log_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-08-03T04:43:21.408174+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[0,1],"acting":[0,1],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":0,"acting_primary":0,"purged_snaps":[]},{"pgid":"4.25","version":"0'0","reported_seq":21,"reported_epoch":29,"state":"active+clean","last_fresh":"2023-08-01T19:54:45.742367+0000","last_change":"2023-08-01T19:54:04.474813+0000","last_active":"2023-08-01T19:54:45.742367+0000","last_peered":"2023-08-01T19:54:45.742367+0000","last_clean":"2023-08-01T19:54:45.742367+0000","last_became_active":"2023-08-01T19:54:04.472530+0000","last_became_peered":"2023-08-01T19:54:04.472530+0000","last_unstale":"2023-08-01T19:54:45.742367+0000","last_undegraded":"2023-08-01T19:54:45.742367+0000","last_fullsized":"2023-08-01T19:54:45.742367+0000","mapping_epoch":16,"log_start":"0'0","ondisk_log_start":"0'0","created":16,"last_epoch_clean":17,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-08-01T19:54:04.040663+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-08-01T19:54:04.040663+0000","last_clean_scrub_stamp":"2023-08-01T19:54:04.040663+0000","objects_scrubbed":0,"log_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-08-03T01:00:18.725898+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[1,2],"acting":[1,2],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":1,"acting_primary":1,"purged_snaps":[]},{"pgid":"3.1a","version":"17'1","reported_seq":24,"reported_epoch":30,"state":"active+clean","last_fresh":"2023-08-01T19:54:48.985010+0000","last_change":"2023-08-01T19:54:04.063936+0000","last_active":"2023-08-01T19:54:48.985010+0000","last_peered":"2023-08-01T19:54:48.985010+0000","last_clean":"2023-08-01T19:54:48.985010+0000","last_became_active":"2023-08-01T19:54:04.063674+0000","last_became_peered":"2023-08-01T19:54:04.063674+0000","last_unstale":"2023-08-01T19:54:48.985010+0000","last_undegraded":"2023-08-01T19:54:48.985010+0000","last_fullsized":"2023-08-01T19:54:48.985010+0000","mapping_epoch":15,"log_start":"0'0","ondisk_log_start":"0'0","created":15,"last_epoch_clean":16,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-08-01T19:54:03.032665+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-08-01T19:54:03.032665+0000","last_clean_scrub_stamp":"2023-08-01T19:54:03.032665+0000","objects_scrubbed":0,"log_size":1,"ondisk_log_size":1,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-08-03T00:06:00.058200+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[2,0],"acting":[2,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":2,"acting_primary":2,"purged_snaps":[]},{"pgid":"4.1d","version":"0'0","reported_seq":22,"reported_epoch":30,"state":"active+clean","last_fresh":"2023-08-01T19:54:48.985574+0000","last_change":"2023-08-01T19:54:04.471916+0000","last_active":"2023-08-01T19:54:48.985574+0000","last_peered":"2023-08-01T19:54:48.985574+0000","last_clean":"2023-08-01T19:54:48.985574+0000","last_became_active":"2023-08-01T19:54:04.471480+0000","last_became_peered":"2023-08-01T19:54:04.471480+0000","last_unstale":"2023-08-01T19:54:48.985574+0000","last_undegraded":"2023-08-01T19:54:48.985574+0000","last_fullsized":"2023-08-01T19:54:48.985574+0000","mapping_epoch":16,"log_start":"0'0","ondisk_log_start":"0'0","created":16,"last_epoch_clean":17,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-08-01T19:54:04.040663+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-08-01T19:54:04.040663+0000","last_clean_scrub_stamp":"2023-08-01T19:54:04.040663+0000","objects_scrubbed":0,"log_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-08-02T21:19:17.547590+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[2,1],"acting":[2,1],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":2,"acting_primary":2,"purged_snaps":[]},{"pgid":"3.19","version":"0'0","reported_seq":22,"reported_epoch":29,"state":"active+clean","last_fresh":"2023-08-01T19:54:45.742186+0000","last_change":"2023-08-01T19:54:04.067837+0000","last_active":"2023-08-01T19:54:45.742186+0000","last_peered":"2023-08-01T19:54:45.742186+0000","last_clean":"2023-08-01T19:54:45.742186+0000","last_became_active":"2023-08-01T19:54:04.067535+0000","last_became_peered":"2023-08-01T19:54:04.067535+0000","last_unstale":"2023-08-01T19:54:45.742186+0000","last_undegraded":"2023-08-01T19:54:45.742186+0000","last_fullsized":"2023-08-01T19:54:45.742186+0000","mapping_epoch":15,"log_start":"0'0","ondisk_log_start":"0'0","created":15,"last_epoch_clean":16,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-08-01T19:54:03.032665+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-08-01T19:54:03.032665+0000","last_clean_scrub_stamp":"2023-08-01T19:54:03.032665+0000","objects_scrubbed":0,"log_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-08-02T20:56:47.324761+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[0,1],"acting":[0,1],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":0,"acting_primary":0,"purged_snaps":[]},{"pgid":"4.1e","version":"0'0","reported_seq":21,"reported_epoch":29,"state":"active+clean","last_fresh":"2023-08-01T19:54:45.740665+0000","last_change":"2023-08-01T19:54:04.470544+0000","last_active":"2023-08-01T19:54:45.740665+0000","last_peered":"2023-08-01T19:54:45.740665+0000","last_clean":"2023-08-01T19:54:45.740665+0000","last_became_active":"2023-08-01T19:54:04.469657+0000","last_became_peered":"2023-08-01T19:54:04.469657+0000","last_unstale":"2023-08-01T19:54:45.740665+0000","last_undegraded":"2023-08-01T19:54:45.740665+0000","last_fullsized":"2023-08-01T19:54:45.740665+0000","mapping_epoch":16,"log_start":"0'0","ondisk_log_start":"0'0","created":16,"last_epoch_clean":17,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-08-01T19:54:04.040663+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-08-01T19:54:04.040663+0000","last_clean_scrub_stamp":"2023-08-01T19:54:04.040663+0000","objects_scrubbed":0,"log_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-08-02T23:12:30.830199+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[0,1],"acting":[0,1],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":0,"acting_primary":0,"purged_snaps":[]},{"pgid":"3.18","version":"0'0","reported_seq":22,"reported_epoch":29,"state":"active+clean","last_fresh":"2023-08-01T19:54:45.741597+0000","last_change":"2023-08-01T19:54:04.064289+0000","last_active":"2023-08-01T19:54:45.741597+0000","last_peered":"2023-08-01T19:54:45.741597+0000","last_clean":"2023-08-01T19:54:45.741597+0000","last_became_active":"2023-08-01T19:54:04.063971+0000","last_became_peered":"2023-08-01T19:54:04.063971+0000","last_unstale":"2023-08-01T19:54:45.741597+0000","last_undegraded":"2023-08-01T19:54:45.741597+0000","last_fullsized":"2023-08-01T19:54:45.741597+0000","mapping_epoch":15,"log_start":"0'0","ondisk_log_start":"0'0","created":15,"last_epoch_clean":16,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-08-01T19:54:03.032665+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-08-01T19:54:03.032665+0000","last_clean_scrub_stamp":"2023-08-01T19:54:03.032665+0000","objects_scrubbed":0,"log_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-08-03T04:09:30.496098+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[0,2],"acting":[0,2],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":0,"acting_primary":0,"purged_snaps":[]},{"pgid":"4.1f","version":"0'0","reported_seq":22,"reported_epoch":30,"state":"active+clean","last_fresh":"2023-08-01T19:54:48.985767+0000","last_change":"2023-08-01T19:54:04.472227+0000","last_active":"2023-08-01T19:54:48.985767+0000","last_peered":"2023-08-01T19:54:48.985767+0000","last_clean":"2023-08-01T19:54:48.985767+0000","last_became_active":"2023-08-01T19:54:04.471767+0000","last_became_peered":"2023-08-01T19:54:04.471767+0000","last_unstale":"2023-08-01T19:54:48.985767+0000","last_undegraded":"2023-08-01T19:54:48.985767+0000","last_fullsized":"2023-08-01T19:54:48.985767+0000","mapping_epoch":16,"log_start":"0'0","ondisk_log_start":"0'0","created":16,"last_epoch_clean":17,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-08-01T19:54:04.040663+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-08-01T19:54:04.040663+0000","last_clean_scrub_stamp":"2023-08-01T19:54:04.040663+0000","objects_scrubbed":0,"log_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-08-02T20:25:25.280329+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[2,1],"acting":[2,1],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":2,"acting_primary":2,"purged_snaps":[]},{"pgid":"3.17","version":"0'0","reported_seq":22,"reported_epoch":29,"state":"active+clean","last_fresh":"2023-08-01T19:54:45.740787+0000","last_change":"2023-08-01T19:54:04.067975+0000","last_active":"2023-08-01T19:54:45.740787+0000","last_peered":"2023-08-01T19:54:45.740787+0000","last_clean":"2023-08-01T19:54:45.740787+0000","last_became_active":"2023-08-01T19:54:04.067577+0000","last_became_peered":"2023-08-01T19:54:04.067577+0000","last_unstale":"2023-08-01T19:54:45.740787+0000","last_undegraded":"2023-08-01T19:54:45.740787+0000","last_fullsized":"2023-08-01T19:54:45.740787+0000","mapping_epoch":15,"log_start":"0'0","ondisk_log_start":"0'0","created":15,"last_epoch_clean":16,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-08-01T19:54:03.032665+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-08-01T19:54:03.032665+0000","last_clean_scrub_stamp":"2023-08-01T19:54:03.032665+0000","objects_scrubbed":0,"log_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-08-03T07:13:34.025722+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[0,1],"acting":[0,1],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":0,"acting_primary":0,"purged_snaps":[]},{"pgid":"4.10","version":"0'0","reported_seq":21,"reported_epoch":29,"state":"active+clean","last_fresh":"2023-08-01T19:54:45.741461+0000","last_change":"2023-08-01T19:54:04.467146+0000","last_active":"2023-08-01T19:54:45.741461+0000","last_peered":"2023-08-01T19:54:45.741461+0000","last_clean":"2023-08-01T19:54:45.741461+0000","last_became_active":"2023-08-01T19:54:04.466627+0000","last_became_peered":"2023-08-01T19:54:04.466627+0000","last_unstale":"2023-08-01T19:54:45.741461+0000","last_undegraded":"2023-08-01T19:54:45.741461+0000","last_fullsized":"2023-08-01T19:54:45.741461+0000","mapping_epoch":16,"log_start":"0'0","ondisk_log_start":"0'0","created":16,"last_epoch_clean":17,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-08-01T19:54:04.040663+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-08-01T19:54:04.040663+0000","last_clean_scrub_stamp":"2023-08-01T19:54:04.040663+0000","objects_scrubbed":0,"log_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-08-03T04:43:26.793480+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[0,2],"acting":[0,2],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":0,"acting_primary":0,"purged_snaps":[]},{"pgid":"3.16","version":"0'0","reported_seq":22,"reported_epoch":29,"state":"active+clean","last_fresh":"2023-08-01T19:54:45.742084+0000","last_change":"2023-08-01T19:54:04.065042+0000","last_active":"2023-08-01T19:54:45.742084+0000","last_peered":"2023-08-01T19:54:45.742084+0000","last_clean":"2023-08-01T19:54:45.742084+0000","last_became_active":"2023-08-01T19:54:04.064040+0000","last_became_peered":"2023-08-01T19:54:04.064040+0000","last_unstale":"2023-08-01T19:54:45.742084+0000","last_undegraded":"2023-08-01T19:54:45.742084+0000","last_fullsized":"2023-08-01T19:54:45.742084+0000","mapping_epoch":15,"log_start":"0'0","ondisk_log_start":"0'0","created":15,"last_epoch_clean":16,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-08-01T19:54:03.032665+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-08-01T19:54:03.032665+0000","last_clean_scrub_stamp":"2023-08-01T19:54:03.032665+0000","objects_scrubbed":0,"log_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-08-03T03:40:43.460182+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[1,0],"acting":[1,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":1,"acting_primary":1,"purged_snaps":[]},{"pgid":"4.11","version":"0'0","reported_seq":21,"reported_epoch":29,"state":"active+clean","last_fresh":"2023-08-01T19:54:45.742258+0000","last_change":"2023-08-01T19:54:04.470401+0000","last_active":"2023-08-01T19:54:45.742258+0000","last_peered":"2023-08-01T19:54:45.742258+0000","last_clean":"2023-08-01T19:54:45.742258+0000","last_became_active":"2023-08-01T19:54:04.469680+0000","last_became_peered":"2023-08-01T19:54:04.469680+0000","last_unstale":"2023-08-01T19:54:45.742258+0000","last_undegraded":"2023-08-01T19:54:45.742258+0000","last_fullsized":"2023-08-01T19:54:45.742258+0000","mapping_epoch":16,"log_start":"0'0","ondisk_log_start":"0'0","created":16,"last_epoch_clean":17,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-08-01T19:54:04.040663+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-08-01T19:54:04.040663+0000","last_clean_scrub_stamp":"2023-08-01T19:54:04.040663+0000","objects_scrubbed":0,"log_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-08-03T03:58:06.360840+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[0,1],"acting":[0,1],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":0,"acting_primary":0,"purged_snaps":[]},{"pgid":"3.15","version":"17'3","reported_seq":26,"reported_epoch":30,"state":"active+clean","last_fresh":"2023-08-01T19:54:48.985297+0000","last_change":"2023-08-01T19:54:04.065443+0000","last_active":"2023-08-01T19:54:48.985297+0000","last_peered":"2023-08-01T19:54:48.985297+0000","last_clean":"2023-08-01T19:54:48.985297+0000","last_became_active":"2023-08-01T19:54:04.065112+0000","last_became_peered":"2023-08-01T19:54:04.065112+0000","last_unstale":"2023-08-01T19:54:48.985297+0000","last_undegraded":"2023-08-01T19:54:48.985297+0000","last_fullsized":"2023-08-01T19:54:48.985297+0000","mapping_epoch":15,"log_start":"0'0","ondisk_log_start":"0'0","created":15,"last_epoch_clean":16,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-08-01T19:54:03.032665+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-08-01T19:54:03.032665+0000","last_clean_scrub_stamp":"2023-08-01T19:54:03.032665+0000","objects_scrubbed":0,"log_size":3,"ondisk_log_size":3,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-08-03T03:27:50.887004+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":90,"num_objects":2,"num_object_clones":0,"num_object_copies":4,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":2,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":4,"num_write_kb":1,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":1,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[2,1],"acting":[2,1],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":2,"acting_primary":2,"purged_snaps":[]},{"pgid":"4.12","version":"0'0","reported_seq":21,"reported_epoch":29,"state":"active+clean","last_fresh":"2023-08-01T19:54:45.740203+0000","last_change":"2023-08-01T19:54:04.467822+0000","last_active":"2023-08-01T19:54:45.740203+0000","last_peered":"2023-08-01T19:54:45.740203+0000","last_clean":"2023-08-01T19:54:45.740203+0000","last_became_active":"2023-08-01T19:54:04.466667+0000","last_became_peered":"2023-08-01T19:54:04.466667+0000","last_unstale":"2023-08-01T19:54:45.740203+0000","last_undegraded":"2023-08-01T19:54:45.740203+0000","last_fullsized":"2023-08-01T19:54:45.740203+0000","mapping_epoch":16,"log_start":"0'0","ondisk_log_start":"0'0","created":16,"last_epoch_clean":17,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-08-01T19:54:04.040663+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-08-01T19:54:04.040663+0000","last_clean_scrub_stamp":"2023-08-01T19:54:04.040663+0000","objects_scrubbed":0,"log_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-08-03T02:57:18.148077+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[0,2],"acting":[0,2],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":0,"acting_primary":0,"purged_snaps":[]},{"pgid":"3.14","version":"17'6","reported_seq":28,"reported_epoch":29,"state":"active+clean","last_fresh":"2023-08-01T19:54:45.742216+0000","last_change":"2023-08-01T19:54:04.061419+0000","last_active":"2023-08-01T19:54:45.742216+0000","last_peered":"2023-08-01T19:54:45.742216+0000","last_clean":"2023-08-01T19:54:45.742216+0000","last_became_active":"2023-08-01T19:54:04.061078+0000","last_became_peered":"2023-08-01T19:54:04.061078+0000","last_unstale":"2023-08-01T19:54:45.742216+0000","last_undegraded":"2023-08-01T19:54:45.742216+0000","last_fullsized":"2023-08-01T19:54:45.742216+0000","mapping_epoch":15,"log_start":"0'0","ondisk_log_start":"0'0","created":15,"last_epoch_clean":16,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-08-01T19:54:03.032665+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-08-01T19:54:03.032665+0000","last_clean_scrub_stamp":"2023-08-01T19:54:03.032665+0000","objects_scrubbed":0,"log_size":6,"ondisk_log_size":6,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-08-02T21:35:44.874727+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":1536,"num_objects":4,"num_object_clones":0,"num_object_copies":8,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":4,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":6,"num_write_kb":3,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":1,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[1,2],"acting":[1,2],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":1,"acting_primary":1,"purged_snaps":[]},{"pgid":"4.13","version":"0'0","reported_seq":21,"reported_epoch":29,"state":"active+clean","last_fresh":"2023-08-01T19:54:45.741898+0000","last_change":"2023-08-01T19:54:04.466400+0000","last_active":"2023-08-01T19:54:45.741898+0000","last_peered":"2023-08-01T19:54:45.741898+0000","last_clean":"2023-08-01T19:54:45.741898+0000","last_became_active":"2023-08-01T19:54:04.465979+0000","last_became_peered":"2023-08-01T19:54:04.465979+0000","last_unstale":"2023-08-01T19:54:45.741898+0000","last_undegraded":"2023-08-01T19:54:45.741898+0000","last_fullsized":"2023-08-01T19:54:45.741898+0000","mapping_epoch":16,"log_start":"0'0","ondisk_log_start":"0'0","created":16,"last_epoch_clean":17,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-08-01T19:54:04.040663+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-08-01T19:54:04.040663+0000","last_clean_scrub_stamp":"2023-08-01T19:54:04.040663+0000","objects_scrubbed":0,"log_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-08-02T20:20:59.989030+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[1,2],"acting":[1,2],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":1,"acting_primary":1,"purged_snaps":[]},{"pgid":"3.13","version":"17'2","reported_seq":24,"reported_epoch":29,"state":"active+clean","last_fresh":"2023-08-01T19:54:45.741815+0000","last_change":"2023-08-01T19:54:04.065212+0000","last_active":"2023-08-01T19:54:45.741815+0000","last_peered":"2023-08-01T19:54:45.741815+0000","last_clean":"2023-08-01T19:54:45.741815+0000","last_became_active":"2023-08-01T19:54:04.064375+0000","last_became_peered":"2023-08-01T19:54:04.064375+0000","last_unstale":"2023-08-01T19:54:45.741815+0000","last_undegraded":"2023-08-01T19:54:45.741815+0000","last_fullsized":"2023-08-01T19:54:45.741815+0000","mapping_epoch":15,"log_start":"0'0","ondisk_log_start":"0'0","created":15,"last_epoch_clean":16,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-08-01T19:54:03.032665+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-08-01T19:54:03.032665+0000","last_clean_scrub_stamp":"2023-08-01T19:54:03.032665+0000","objects_scrubbed":0,"log_size":2,"ondisk_log_size":2,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-08-03T06:17:37.910752+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":34,"num_objects":2,"num_object_clones":0,"num_object_copies":4,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":2,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":3,"num_write_kb":6,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":1,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[1,0],"acting":[1,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":1,"acting_primary":1,"purged_snaps":[]},{"pgid":"4.14","version":"0'0","reported_seq":22,"reported_epoch":30,"state":"active+clean","last_fresh":"2023-08-01T19:54:48.984821+0000","last_change":"2023-08-01T19:54:04.464446+0000","last_active":"2023-08-01T19:54:48.984821+0000","last_peered":"2023-08-01T19:54:48.984821+0000","last_clean":"2023-08-01T19:54:48.984821+0000","last_became_active":"2023-08-01T19:54:04.464021+0000","last_became_peered":"2023-08-01T19:54:04.464021+0000","last_unstale":"2023-08-01T19:54:48.984821+0000","last_undegraded":"2023-08-01T19:54:48.984821+0000","last_fullsized":"2023-08-01T19:54:48.984821+0000","mapping_epoch":16,"log_start":"0'0","ondisk_log_start":"0'0","created":16,"last_epoch_clean":17,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-08-01T19:54:04.040663+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-08-01T19:54:04.040663+0000","last_clean_scrub_stamp":"2023-08-01T19:54:04.040663+0000","objects_scrubbed":0,"log_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-08-02T20:26:51.080849+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[2,0],"acting":[2,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":2,"acting_primary":2,"purged_snaps":[]},{"pgid":"3.12","version":"0'0","reported_seq":22,"reported_epoch":29,"state":"active+clean","last_fresh":"2023-08-01T19:54:45.740337+0000","last_change":"2023-08-01T19:54:04.066566+0000","last_active":"2023-08-01T19:54:45.740337+0000","last_peered":"2023-08-01T19:54:45.740337+0000","last_clean":"2023-08-01T19:54:45.740337+0000","last_became_active":"2023-08-01T19:54:04.066190+0000","last_became_peered":"2023-08-01T19:54:04.066190+0000","last_unstale":"2023-08-01T19:54:45.740337+0000","last_undegraded":"2023-08-01T19:54:45.740337+0000","last_fullsized":"2023-08-01T19:54:45.740337+0000","mapping_epoch":15,"log_start":"0'0","ondisk_log_start":"0'0","created":15,"last_epoch_clean":16,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-08-01T19:54:03.032665+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-08-01T19:54:03.032665+0000","last_clean_scrub_stamp":"2023-08-01T19:54:03.032665+0000","objects_scrubbed":0,"log_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-08-03T02:01:47.073630+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[0,1],"acting":[0,1],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":0,"acting_primary":0,"purged_snaps":[]},{"pgid":"4.15","version":"0'0","reported_seq":22,"reported_epoch":30,"state":"active+clean","last_fresh":"2023-08-01T19:54:48.985450+0000","last_change":"2023-08-01T19:54:04.468791+0000","last_active":"2023-08-01T19:54:48.985450+0000","last_peered":"2023-08-01T19:54:48.985450+0000","last_clean":"2023-08-01T19:54:48.985450+0000","last_became_active":"2023-08-01T19:54:04.468214+0000","last_became_peered":"2023-08-01T19:54:04.468214+0000","last_unstale":"2023-08-01T19:54:48.985450+0000","last_undegraded":"2023-08-01T19:54:48.985450+0000","last_fullsized":"2023-08-01T19:54:48.985450+0000","mapping_epoch":16,"log_start":"0'0","ondisk_log_start":"0'0","created":16,"last_epoch_clean":17,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-08-01T19:54:04.040663+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-08-01T19:54:04.040663+0000","last_clean_scrub_stamp":"2023-08-01T19:54:04.040663+0000","objects_scrubbed":0,"log_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-08-03T04:10:44.729287+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[2,0],"acting":[2,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":2,"acting_primary":2,"purged_snaps":[]},{"pgid":"3.11","version":"0'0","reported_seq":23,"reported_epoch":30,"state":"active+clean","last_fresh":"2023-08-01T19:54:48.984651+0000","last_change":"2023-08-01T19:54:04.064280+0000","last_active":"2023-08-01T19:54:48.984651+0000","last_peered":"2023-08-01T19:54:48.984651+0000","last_clean":"2023-08-01T19:54:48.984651+0000","last_became_active":"2023-08-01T19:54:04.064064+0000","last_became_peered":"2023-08-01T19:54:04.064064+0000","last_unstale":"2023-08-01T19:54:48.984651+0000","last_undegraded":"2023-08-01T19:54:48.984651+0000","last_fullsized":"2023-08-01T19:54:48.984651+0000","mapping_epoch":15,"log_start":"0'0","ondisk_log_start":"0'0","created":15,"last_epoch_clean":16,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-08-01T19:54:03.032665+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-08-01T19:54:03.032665+0000","last_clean_scrub_stamp":"2023-08-01T19:54:03.032665+0000","objects_scrubbed":0,"log_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-08-03T06:13:51.475710+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[2,1],"acting":[2,1],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":2,"acting_primary":2,"purged_snaps":[]},{"pgid":"4.16","version":"0'0","reported_seq":21,"reported_epoch":29,"state":"active+clean","last_fresh":"2023-08-01T19:54:45.740711+0000","last_change":"2023-08-01T19:54:04.469724+0000","last_active":"2023-08-01T19:54:45.740711+0000","last_peered":"2023-08-01T19:54:45.740711+0000","last_clean":"2023-08-01T19:54:45.740711+0000","last_became_active":"2023-08-01T19:54:04.469275+0000","last_became_peered":"2023-08-01T19:54:04.469275+0000","last_unstale":"2023-08-01T19:54:45.740711+0000","last_undegraded":"2023-08-01T19:54:45.740711+0000","last_fullsized":"2023-08-01T19:54:45.740711+0000","mapping_epoch":16,"log_start":"0'0","ondisk_log_start":"0'0","created":16,"last_epoch_clean":17,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-08-01T19:54:04.040663+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-08-01T19:54:04.040663+0000","last_clean_scrub_stamp":"2023-08-01T19:54:04.040663+0000","objects_scrubbed":0,"log_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-08-03T03:04:06.137335+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[0,1],"acting":[0,1],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":0,"acting_primary":0,"purged_snaps":[]},{"pgid":"3.10","version":"17'8","reported_seq":30,"reported_epoch":29,"state":"active+clean","last_fresh":"2023-08-01T19:54:45.741608+0000","last_change":"2023-08-01T19:54:04.060962+0000","last_active":"2023-08-01T19:54:45.741608+0000","last_peered":"2023-08-01T19:54:45.741608+0000","last_clean":"2023-08-01T19:54:45.741608+0000","last_became_active":"2023-08-01T19:54:04.060576+0000","last_became_peered":"2023-08-01T19:54:04.060576+0000","last_unstale":"2023-08-01T19:54:45.741608+0000","last_undegraded":"2023-08-01T19:54:45.741608+0000","last_fullsized":"2023-08-01T19:54:45.741608+0000","mapping_epoch":15,"log_start":"0'0","ondisk_log_start":"0'0","created":15,"last_epoch_clean":16,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-08-01T19:54:03.032665+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-08-01T19:54:03.032665+0000","last_clean_scrub_stamp":"2023-08-01T19:54:03.032665+0000","objects_scrubbed":0,"log_size":8,"ondisk_log_size":8,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-08-03T05:00:51.171444+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":4,"num_object_clones":0,"num_object_copies":8,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":4,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":12,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":4,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[1,2],"acting":[1,2],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":1,"acting_primary":1,"purged_snaps":[]},{"pgid":"4.17","version":"0'0","reported_seq":21,"reported_epoch":29,"state":"active+clean","last_fresh":"2023-08-01T19:54:45.740978+0000","last_change":"2023-08-01T19:54:04.472721+0000","last_active":"2023-08-01T19:54:45.740978+0000","last_peered":"2023-08-01T19:54:45.740978+0000","last_clean":"2023-08-01T19:54:45.740978+0000","last_became_active":"2023-08-01T19:54:04.472126+0000","last_became_peered":"2023-08-01T19:54:04.472126+0000","last_unstale":"2023-08-01T19:54:45.740978+0000","last_undegraded":"2023-08-01T19:54:45.740978+0000","last_fullsized":"2023-08-01T19:54:45.740978+0000","mapping_epoch":16,"log_start":"0'0","ondisk_log_start":"0'0","created":16,"last_epoch_clean":17,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-08-01T19:54:04.040663+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-08-01T19:54:04.040663+0000","last_clean_scrub_stamp":"2023-08-01T19:54:04.040663+0000","objects_scrubbed":0,"log_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-08-03T00:29:05.857138+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[0,1],"acting":[0,1],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":0,"acting_primary":0,"purged_snaps":[]},{"pgid":"5.9","version":"30'4478","reported_seq":4496,"reported_epoch":30,"state":"active+clean","last_fresh":"2023-08-01T19:54:49.915246+0000","last_change":"2023-08-01T19:54:23.134838+0000","last_active":"2023-08-01T19:54:49.915246+0000","last_peered":"2023-08-01T19:54:49.915246+0000","last_clean":"2023-08-01T19:54:49.915246+0000","last_became_active":"2023-08-01T19:54:23.134628+0000","last_became_peered":"2023-08-01T19:54:23.134628+0000","last_unstale":"2023-08-01T19:54:49.915246+0000","last_undegraded":"2023-08-01T19:54:49.915246+0000","last_fullsized":"2023-08-01T19:54:49.915246+0000","mapping_epoch":19,"log_start":"22'700","ondisk_log_start":"22'700","created":19,"last_epoch_clean":20,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-08-01T19:54:22.116710+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-08-01T19:54:22.116710+0000","last_clean_scrub_stamp":"2023-08-01T19:54:22.116710+0000","objects_scrubbed":0,"log_size":3778,"ondisk_log_size":3778,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-08-03T05:57:20.085794+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":293470208,"num_objects":4478,"num_object_clones":0,"num_object_copies":8956,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":4478,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":4478,"num_write_kb":286592,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[1,2],"acting":[1,2],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":1,"acting_primary":1,"purged_snaps":[]},{"pgid":"3.f","version":"17'1","reported_seq":23,"reported_epoch":29,"state":"active+clean","last_fresh":"2023-08-01T19:54:45.742110+0000","last_change":"2023-08-01T19:54:04.060797+0000","last_active":"2023-08-01T19:54:45.742110+0000","last_peered":"2023-08-01T19:54:45.742110+0000","last_clean":"2023-08-01T19:54:45.742110+0000","last_became_active":"2023-08-01T19:54:04.060444+0000","last_became_peered":"2023-08-01T19:54:04.060444+0000","last_unstale":"2023-08-01T19:54:45.742110+0000","last_undegraded":"2023-08-01T19:54:45.742110+0000","last_fullsized":"2023-08-01T19:54:45.742110+0000","mapping_epoch":15,"log_start":"0'0","ondisk_log_start":"0'0","created":15,"last_epoch_clean":16,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-08-01T19:54:03.032665+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-08-01T19:54:03.032665+0000","last_clean_scrub_stamp":"2023-08-01T19:54:03.032665+0000","objects_scrubbed":0,"log_size":1,"ondisk_log_size":1,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-08-03T07:13:34.025722+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":22,"num_objects":1,"num_object_clones":0,"num_object_copies":2,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":1,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":1,"num_write_kb":1,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[1,2],"acting":[1,2],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":1,"acting_primary":1,"purged_snaps":[]},{"pgid":"4.8","version":"0'0","reported_seq":22,"reported_epoch":30,"state":"active+clean","last_fresh":"2023-08-01T19:54:48.984556+0000","last_change":"2023-08-01T19:54:04.467671+0000","last_active":"2023-08-01T19:54:48.984556+0000","last_peered":"2023-08-01T19:54:48.984556+0000","last_clean":"2023-08-01T19:54:48.984556+0000","last_became_active":"2023-08-01T19:54:04.467300+0000","last_became_peered":"2023-08-01T19:54:04.467300+0000","last_unstale":"2023-08-01T19:54:48.984556+0000","last_undegraded":"2023-08-01T19:54:48.984556+0000","last_fullsized":"2023-08-01T19:54:48.984556+0000","mapping_epoch":16,"log_start":"0'0","ondisk_log_start":"0'0","created":16,"last_epoch_clean":17,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-08-01T19:54:04.040663+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-08-01T19:54:04.040663+0000","last_clean_scrub_stamp":"2023-08-01T19:54:04.040663+0000","objects_scrubbed":0,"log_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-08-03T05:27:24.774345+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[2,1],"acting":[2,1],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":2,"acting_primary":2,"purged_snaps":[]},{"pgid":"5.8","version":"31'4515","reported_seq":4534,"reported_epoch":31,"state":"active+clean","last_fresh":"2023-08-01T19:54:51.039621+0000","last_change":"2023-08-01T19:54:23.139383+0000","last_active":"2023-08-01T19:54:51.039621+0000","last_peered":"2023-08-01T19:54:51.039621+0000","last_clean":"2023-08-01T19:54:51.039621+0000","last_became_active":"2023-08-01T19:54:23.139198+0000","last_became_peered":"2023-08-01T19:54:23.139198+0000","last_unstale":"2023-08-01T19:54:51.039621+0000","last_undegraded":"2023-08-01T19:54:51.039621+0000","last_fullsized":"2023-08-01T19:54:51.039621+0000","mapping_epoch":19,"log_start":"22'500","ondisk_log_start":"22'500","created":19,"last_epoch_clean":20,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-08-01T19:54:22.116710+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-08-01T19:54:22.116710+0000","last_clean_scrub_stamp":"2023-08-01T19:54:22.116710+0000","objects_scrubbed":0,"log_size":4015,"ondisk_log_size":4015,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-08-03T05:20:31.724064+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":295895040,"num_objects":4515,"num_object_clones":0,"num_object_copies":9030,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":4515,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":4515,"num_write_kb":288960,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[2,0],"acting":[2,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":2,"acting_primary":2,"purged_snaps":[]},{"pgid":"3.e","version":"17'2","reported_seq":25,"reported_epoch":30,"state":"active+clean","last_fresh":"2023-08-01T19:54:48.985462+0000","last_change":"2023-08-01T19:54:04.065595+0000","last_active":"2023-08-01T19:54:48.985462+0000","last_peered":"2023-08-01T19:54:48.985462+0000","last_clean":"2023-08-01T19:54:48.985462+0000","last_became_active":"2023-08-01T19:54:04.065303+0000","last_became_peered":"2023-08-01T19:54:04.065303+0000","last_unstale":"2023-08-01T19:54:48.985462+0000","last_undegraded":"2023-08-01T19:54:48.985462+0000","last_fullsized":"2023-08-01T19:54:48.985462+0000","mapping_epoch":15,"log_start":"0'0","ondisk_log_start":"0'0","created":15,"last_epoch_clean":16,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-08-01T19:54:03.032665+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-08-01T19:54:03.032665+0000","last_clean_scrub_stamp":"2023-08-01T19:54:03.032665+0000","objects_scrubbed":0,"log_size":2,"ondisk_log_size":2,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-08-02T22:40:38.782053+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":1,"num_object_clones":0,"num_object_copies":2,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":1,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":3,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":1,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[2,1],"acting":[2,1],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":2,"acting_primary":2,"purged_snaps":[]},{"pgid":"4.9","version":"0'0","reported_seq":22,"reported_epoch":30,"state":"active+clean","last_fresh":"2023-08-01T19:54:48.984740+0000","last_change":"2023-08-01T19:54:04.468007+0000","last_active":"2023-08-01T19:54:48.984740+0000","last_peered":"2023-08-01T19:54:48.984740+0000","last_clean":"2023-08-01T19:54:48.984740+0000","last_became_active":"2023-08-01T19:54:04.467509+0000","last_became_peered":"2023-08-01T19:54:04.467509+0000","last_unstale":"2023-08-01T19:54:48.984740+0000","last_undegraded":"2023-08-01T19:54:48.984740+0000","last_fullsized":"2023-08-01T19:54:48.984740+0000","mapping_epoch":16,"log_start":"0'0","ondisk_log_start":"0'0","created":16,"last_epoch_clean":17,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-08-01T19:54:04.040663+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-08-01T19:54:04.040663+0000","last_clean_scrub_stamp":"2023-08-01T19:54:04.040663+0000","objects_scrubbed":0,"log_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-08-03T06:04:50.963711+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[2,0],"acting":[2,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":2,"acting_primary":2,"purged_snaps":[]},{"pgid":"5.b","version":"31'4458","reported_seq":4477,"reported_epoch":31,"state":"active+clean","last_fresh":"2023-08-01T19:54:51.044018+0000","last_change":"2023-08-01T19:54:23.138143+0000","last_active":"2023-08-01T19:54:51.044018+0000","last_peered":"2023-08-01T19:54:51.044018+0000","last_clean":"2023-08-01T19:54:51.044018+0000","last_became_active":"2023-08-01T19:54:23.137922+0000","last_became_peered":"2023-08-01T19:54:23.137922+0000","last_unstale":"2023-08-01T19:54:51.044018+0000","last_undegraded":"2023-08-01T19:54:51.044018+0000","last_fullsized":"2023-08-01T19:54:51.044018+0000","mapping_epoch":19,"log_start":"22'500","ondisk_log_start":"22'500","created":19,"last_epoch_clean":20,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-08-01T19:54:22.116710+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-08-01T19:54:22.116710+0000","last_clean_scrub_stamp":"2023-08-01T19:54:22.116710+0000","objects_scrubbed":0,"log_size":3958,"ondisk_log_size":3958,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-08-02T23:27:13.080055+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":292159488,"num_objects":4458,"num_object_clones":0,"num_object_copies":8916,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":4458,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":4458,"num_write_kb":285312,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[2,0],"acting":[2,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":2,"acting_primary":2,"purged_snaps":[]},{"pgid":"3.d","version":"17'1","reported_seq":23,"reported_epoch":29,"state":"active+clean","last_fresh":"2023-08-01T19:54:45.742360+0000","last_change":"2023-08-01T19:54:04.062853+0000","last_active":"2023-08-01T19:54:45.742360+0000","last_peered":"2023-08-01T19:54:45.742360+0000","last_clean":"2023-08-01T19:54:45.742360+0000","last_became_active":"2023-08-01T19:54:04.062598+0000","last_became_peered":"2023-08-01T19:54:04.062598+0000","last_unstale":"2023-08-01T19:54:45.742360+0000","last_undegraded":"2023-08-01T19:54:45.742360+0000","last_fullsized":"2023-08-01T19:54:45.742360+0000","mapping_epoch":15,"log_start":"0'0","ondisk_log_start":"0'0","created":15,"last_epoch_clean":16,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-08-01T19:54:03.032665+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-08-01T19:54:03.032665+0000","last_clean_scrub_stamp":"2023-08-01T19:54:03.032665+0000","objects_scrubbed":0,"log_size":1,"ondisk_log_size":1,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-08-02T20:56:47.324761+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":70,"num_objects":1,"num_object_clones":0,"num_object_copies":2,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":1,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":1,"num_write_kb":1,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[1,2],"acting":[1,2],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":1,"acting_primary":1,"purged_snaps":[]},{"pgid":"4.a","version":"0'0","reported_seq":21,"reported_epoch":29,"state":"active+clean","last_fresh":"2023-08-01T19:54:45.741733+0000","last_change":"2023-08-01T19:54:04.471997+0000","last_active":"2023-08-01T19:54:45.741733+0000","last_peered":"2023-08-01T19:54:45.741733+0000","last_clean":"2023-08-01T19:54:45.741733+0000","last_became_active":"2023-08-01T19:54:04.471204+0000","last_became_peered":"2023-08-01T19:54:04.471204+0000","last_unstale":"2023-08-01T19:54:45.741733+0000","last_undegraded":"2023-08-01T19:54:45.741733+0000","last_fullsized":"2023-08-01T19:54:45.741733+0000","mapping_epoch":16,"log_start":"0'0","ondisk_log_start":"0'0","created":16,"last_epoch_clean":17,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-08-01T19:54:04.040663+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-08-01T19:54:04.040663+0000","last_clean_scrub_stamp":"2023-08-01T19:54:04.040663+0000","objects_scrubbed":0,"log_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-08-02T23:12:30.830199+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[1,0],"acting":[1,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":1,"acting_primary":1,"purged_snaps":[]},{"pgid":"5.a","version":"30'4345","reported_seq":4363,"reported_epoch":30,"state":"active+clean","last_fresh":"2023-08-01T19:54:49.929380+0000","last_change":"2023-08-01T19:54:23.138147+0000","last_active":"2023-08-01T19:54:49.929380+0000","last_peered":"2023-08-01T19:54:49.929380+0000","last_clean":"2023-08-01T19:54:49.929380+0000","last_became_active":"2023-08-01T19:54:23.137827+0000","last_became_peered":"2023-08-01T19:54:23.137827+0000","last_unstale":"2023-08-01T19:54:49.929380+0000","last_undegraded":"2023-08-01T19:54:49.929380+0000","last_fullsized":"2023-08-01T19:54:49.929380+0000","mapping_epoch":19,"log_start":"22'800","ondisk_log_start":"22'800","created":19,"last_epoch_clean":20,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-08-01T19:54:22.116710+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-08-01T19:54:22.116710+0000","last_clean_scrub_stamp":"2023-08-01T19:54:22.116710+0000","objects_scrubbed":0,"log_size":3545,"ondisk_log_size":3545,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-08-03T05:22:32.106433+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":284753920,"num_objects":4345,"num_object_clones":0,"num_object_copies":8690,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":4345,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":4345,"num_write_kb":278080,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[0,2],"acting":[0,2],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":0,"acting_primary":0,"purged_snaps":[]},{"pgid":"3.c","version":"0'0","reported_seq":22,"reported_epoch":29,"state":"active+clean","last_fresh":"2023-08-01T19:54:45.741873+0000","last_change":"2023-08-01T19:54:04.063532+0000","last_active":"2023-08-01T19:54:45.741873+0000","last_peered":"2023-08-01T19:54:45.741873+0000","last_clean":"2023-08-01T19:54:45.741873+0000","last_became_active":"2023-08-01T19:54:04.063116+0000","last_became_peered":"2023-08-01T19:54:04.063116+0000","last_unstale":"2023-08-01T19:54:45.741873+0000","last_undegraded":"2023-08-01T19:54:45.741873+0000","last_fullsized":"2023-08-01T19:54:45.741873+0000","mapping_epoch":15,"log_start":"0'0","ondisk_log_start":"0'0","created":15,"last_epoch_clean":16,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-08-01T19:54:03.032665+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-08-01T19:54:03.032665+0000","last_clean_scrub_stamp":"2023-08-01T19:54:03.032665+0000","objects_scrubbed":0,"log_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-08-02T22:28:51.936138+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[1,0],"acting":[1,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":1,"acting_primary":1,"purged_snaps":[]},{"pgid":"4.b","version":"0'0","reported_seq":21,"reported_epoch":29,"state":"active+clean","last_fresh":"2023-08-01T19:54:45.741445+0000","last_change":"2023-08-01T19:54:04.470787+0000","last_active":"2023-08-01T19:54:45.741445+0000","last_peered":"2023-08-01T19:54:45.741445+0000","last_clean":"2023-08-01T19:54:45.741445+0000","last_became_active":"2023-08-01T19:54:04.470332+0000","last_became_peered":"2023-08-01T19:54:04.470332+0000","last_unstale":"2023-08-01T19:54:45.741445+0000","last_undegraded":"2023-08-01T19:54:45.741445+0000","last_fullsized":"2023-08-01T19:54:45.741445+0000","mapping_epoch":16,"log_start":"0'0","ondisk_log_start":"0'0","created":16,"last_epoch_clean":17,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-08-01T19:54:04.040663+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-08-01T19:54:04.040663+0000","last_clean_scrub_stamp":"2023-08-01T19:54:04.040663+0000","objects_scrubbed":0,"log_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-08-03T05:13:38.298401+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[0,1],"acting":[0,1],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":0,"acting_primary":0,"purged_snaps":[]},{"pgid":"5.d","version":"31'4421","reported_seq":4440,"reported_epoch":31,"state":"active+clean","last_fresh":"2023-08-01T19:54:51.060049+0000","last_change":"2023-08-01T19:54:23.134380+0000","last_active":"2023-08-01T19:54:51.060049+0000","last_peered":"2023-08-01T19:54:51.060049+0000","last_clean":"2023-08-01T19:54:51.060049+0000","last_became_active":"2023-08-01T19:54:23.134100+0000","last_became_peered":"2023-08-01T19:54:23.134100+0000","last_unstale":"2023-08-01T19:54:51.060049+0000","last_undegraded":"2023-08-01T19:54:51.060049+0000","last_fullsized":"2023-08-01T19:54:51.060049+0000","mapping_epoch":19,"log_start":"22'400","ondisk_log_start":"22'400","created":19,"last_epoch_clean":20,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-08-01T19:54:22.116710+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-08-01T19:54:22.116710+0000","last_clean_scrub_stamp":"2023-08-01T19:54:22.116710+0000","objects_scrubbed":0,"log_size":4021,"ondisk_log_size":4021,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-08-02T22:07:43.756233+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":289734656,"num_objects":4421,"num_object_clones":0,"num_object_copies":8842,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":4421,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":4421,"num_write_kb":282944,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[2,1],"acting":[2,1],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":2,"acting_primary":2,"purged_snaps":[]},{"pgid":"3.b","version":"17'2","reported_seq":24,"reported_epoch":29,"state":"active+clean","last_fresh":"2023-08-01T19:54:45.741323+0000","last_change":"2023-08-01T19:54:04.066839+0000","last_active":"2023-08-01T19:54:45.741323+0000","last_peered":"2023-08-01T19:54:45.741323+0000","last_clean":"2023-08-01T19:54:45.741323+0000","last_became_active":"2023-08-01T19:54:04.065535+0000","last_became_peered":"2023-08-01T19:54:04.065535+0000","last_unstale":"2023-08-01T19:54:45.741323+0000","last_undegraded":"2023-08-01T19:54:45.741323+0000","last_fullsized":"2023-08-01T19:54:45.741323+0000","mapping_epoch":15,"log_start":"0'0","ondisk_log_start":"0'0","created":15,"last_epoch_clean":16,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-08-01T19:54:03.032665+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-08-01T19:54:03.032665+0000","last_clean_scrub_stamp":"2023-08-01T19:54:03.032665+0000","objects_scrubbed":0,"log_size":2,"ondisk_log_size":2,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-08-03T05:00:51.171444+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":1,"num_object_clones":0,"num_object_copies":2,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":1,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":1,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":1,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[0,1],"acting":[0,1],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":0,"acting_primary":0,"purged_snaps":[]},{"pgid":"4.c","version":"0'0","reported_seq":21,"reported_epoch":29,"state":"active+clean","last_fresh":"2023-08-01T19:54:45.741958+0000","last_change":"2023-08-01T19:54:04.478715+0000","last_active":"2023-08-01T19:54:45.741958+0000","last_peered":"2023-08-01T19:54:45.741958+0000","last_clean":"2023-08-01T19:54:45.741958+0000","last_became_active":"2023-08-01T19:54:04.477435+0000","last_became_peered":"2023-08-01T19:54:04.477435+0000","last_unstale":"2023-08-01T19:54:45.741958+0000","last_undegraded":"2023-08-01T19:54:45.741958+0000","last_fullsized":"2023-08-01T19:54:45.741958+0000","mapping_epoch":16,"log_start":"0'0","ondisk_log_start":"0'0","created":16,"last_epoch_clean":17,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-08-01T19:54:04.040663+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-08-01T19:54:04.040663+0000","last_clean_scrub_stamp":"2023-08-01T19:54:04.040663+0000","objects_scrubbed":0,"log_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-08-03T04:43:21.408174+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[1,0],"acting":[1,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":1,"acting_primary":1,"purged_snaps":[]},{"pgid":"5.c","version":"30'4436","reported_seq":4454,"reported_epoch":30,"state":"active+clean","last_fresh":"2023-08-01T19:54:49.913223+0000","last_change":"2023-08-01T19:54:23.138439+0000","last_active":"2023-08-01T19:54:49.913223+0000","last_peered":"2023-08-01T19:54:49.913223+0000","last_clean":"2023-08-01T19:54:49.913223+0000","last_became_active":"2023-08-01T19:54:23.138051+0000","last_became_peered":"2023-08-01T19:54:23.138051+0000","last_unstale":"2023-08-01T19:54:49.913223+0000","last_undegraded":"2023-08-01T19:54:49.913223+0000","last_fullsized":"2023-08-01T19:54:49.913223+0000","mapping_epoch":19,"log_start":"22'900","ondisk_log_start":"22'900","created":19,"last_epoch_clean":20,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-08-01T19:54:22.116710+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-08-01T19:54:22.116710+0000","last_clean_scrub_stamp":"2023-08-01T19:54:22.116710+0000","objects_scrubbed":0,"log_size":3536,"ondisk_log_size":3536,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-08-03T03:01:16.402814+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":290717696,"num_objects":4436,"num_object_clones":0,"num_object_copies":8872,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":4436,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":4436,"num_write_kb":283904,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[0,1],"acting":[0,1],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":0,"acting_primary":0,"purged_snaps":[]},{"pgid":"3.a","version":"0'0","reported_seq":22,"reported_epoch":29,"state":"active+clean","last_fresh":"2023-08-01T19:54:45.741651+0000","last_change":"2023-08-01T19:54:04.065267+0000","last_active":"2023-08-01T19:54:45.741651+0000","last_peered":"2023-08-01T19:54:45.741651+0000","last_clean":"2023-08-01T19:54:45.741651+0000","last_became_active":"2023-08-01T19:54:04.064912+0000","last_became_peered":"2023-08-01T19:54:04.064912+0000","last_unstale":"2023-08-01T19:54:45.741651+0000","last_undegraded":"2023-08-01T19:54:45.741651+0000","last_fullsized":"2023-08-01T19:54:45.741651+0000","mapping_epoch":15,"log_start":"0'0","ondisk_log_start":"0'0","created":15,"last_epoch_clean":16,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-08-01T19:54:03.032665+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-08-01T19:54:03.032665+0000","last_clean_scrub_stamp":"2023-08-01T19:54:03.032665+0000","objects_scrubbed":0,"log_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-08-03T02:37:09.180970+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[1,0],"acting":[1,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":1,"acting_primary":1,"purged_snaps":[]},{"pgid":"4.d","version":"0'0","reported_seq":21,"reported_epoch":29,"state":"active+clean","last_fresh":"2023-08-01T19:54:45.742528+0000","last_change":"2023-08-01T19:54:04.474755+0000","last_active":"2023-08-01T19:54:45.742528+0000","last_peered":"2023-08-01T19:54:45.742528+0000","last_clean":"2023-08-01T19:54:45.742528+0000","last_became_active":"2023-08-01T19:54:04.471526+0000","last_became_peered":"2023-08-01T19:54:04.471526+0000","last_unstale":"2023-08-01T19:54:45.742528+0000","last_undegraded":"2023-08-01T19:54:45.742528+0000","last_fullsized":"2023-08-01T19:54:45.742528+0000","mapping_epoch":16,"log_start":"0'0","ondisk_log_start":"0'0","created":16,"last_epoch_clean":17,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-08-01T19:54:04.040663+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-08-01T19:54:04.040663+0000","last_clean_scrub_stamp":"2023-08-01T19:54:04.040663+0000","objects_scrubbed":0,"log_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-08-03T06:50:03.420334+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[1,2],"acting":[1,2],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":1,"acting_primary":1,"purged_snaps":[]},{"pgid":"5.f","version":"30'4432","reported_seq":4450,"reported_epoch":30,"state":"active+clean","last_fresh":"2023-08-01T19:54:49.925683+0000","last_change":"2023-08-01T19:54:23.134608+0000","last_active":"2023-08-01T19:54:49.925683+0000","last_peered":"2023-08-01T19:54:49.925683+0000","last_clean":"2023-08-01T19:54:49.925683+0000","last_became_active":"2023-08-01T19:54:23.134360+0000","last_became_peered":"2023-08-01T19:54:23.134360+0000","last_unstale":"2023-08-01T19:54:49.925683+0000","last_undegraded":"2023-08-01T19:54:49.925683+0000","last_fullsized":"2023-08-01T19:54:49.925683+0000","mapping_epoch":19,"log_start":"22'700","ondisk_log_start":"22'700","created":19,"last_epoch_clean":20,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-08-01T19:54:22.116710+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-08-01T19:54:22.116710+0000","last_clean_scrub_stamp":"2023-08-01T19:54:22.116710+0000","objects_scrubbed":0,"log_size":3732,"ondisk_log_size":3732,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-08-03T06:01:12.916557+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":290455552,"num_objects":4432,"num_object_clones":0,"num_object_copies":8864,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":4432,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":4432,"num_write_kb":283648,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[1,2],"acting":[1,2],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":1,"acting_primary":1,"purged_snaps":[]},{"pgid":"3.9","version":"0'0","reported_seq":23,"reported_epoch":30,"state":"active+clean","last_fresh":"2023-08-01T19:54:48.984524+0000","last_change":"2023-08-01T19:54:04.065519+0000","last_active":"2023-08-01T19:54:48.984524+0000","last_peered":"2023-08-01T19:54:48.984524+0000","last_clean":"2023-08-01T19:54:48.984524+0000","last_became_active":"2023-08-01T19:54:04.065211+0000","last_became_peered":"2023-08-01T19:54:04.065211+0000","last_unstale":"2023-08-01T19:54:48.984524+0000","last_undegraded":"2023-08-01T19:54:48.984524+0000","last_fullsized":"2023-08-01T19:54:48.984524+0000","mapping_epoch":15,"log_start":"0'0","ondisk_log_start":"0'0","created":15,"last_epoch_clean":16,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-08-01T19:54:03.032665+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-08-01T19:54:03.032665+0000","last_clean_scrub_stamp":"2023-08-01T19:54:03.032665+0000","objects_scrubbed":0,"log_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-08-03T05:46:27.672957+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[2,1],"acting":[2,1],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":2,"acting_primary":2,"purged_snaps":[]},{"pgid":"4.e","version":"0'0","reported_seq":21,"reported_epoch":29,"state":"active+clean","last_fresh":"2023-08-01T19:54:45.742141+0000","last_change":"2023-08-01T19:54:04.473750+0000","last_active":"2023-08-01T19:54:45.742141+0000","last_peered":"2023-08-01T19:54:45.742141+0000","last_clean":"2023-08-01T19:54:45.742141+0000","last_became_active":"2023-08-01T19:54:04.471512+0000","last_became_peered":"2023-08-01T19:54:04.471512+0000","last_unstale":"2023-08-01T19:54:45.742141+0000","last_undegraded":"2023-08-01T19:54:45.742141+0000","last_fullsized":"2023-08-01T19:54:45.742141+0000","mapping_epoch":16,"log_start":"0'0","ondisk_log_start":"0'0","created":16,"last_epoch_clean":17,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-08-01T19:54:04.040663+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-08-01T19:54:04.040663+0000","last_clean_scrub_stamp":"2023-08-01T19:54:04.040663+0000","objects_scrubbed":0,"log_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-08-03T05:13:38.298401+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[1,2],"acting":[1,2],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":1,"acting_primary":1,"purged_snaps":[]},{"pgid":"5.e","version":"31'4512","reported_seq":4531,"reported_epoch":31,"state":"active+clean","last_fresh":"2023-08-01T19:54:51.043981+0000","last_change":"2023-08-01T19:54:23.138341+0000","last_active":"2023-08-01T19:54:51.043981+0000","last_peered":"2023-08-01T19:54:51.043981+0000","last_clean":"2023-08-01T19:54:51.043981+0000","last_became_active":"2023-08-01T19:54:23.138119+0000","last_became_peered":"2023-08-01T19:54:23.138119+0000","last_unstale":"2023-08-01T19:54:51.043981+0000","last_undegraded":"2023-08-01T19:54:51.043981+0000","last_fullsized":"2023-08-01T19:54:51.043981+0000","mapping_epoch":19,"log_start":"22'500","ondisk_log_start":"22'500","created":19,"last_epoch_clean":20,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-08-01T19:54:22.116710+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-08-01T19:54:22.116710+0000","last_clean_scrub_stamp":"2023-08-01T19:54:22.116710+0000","objects_scrubbed":0,"log_size":4012,"ondisk_log_size":4012,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-08-03T07:48:27.709982+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":295698432,"num_objects":4512,"num_object_clones":0,"num_object_copies":9024,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":4512,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":4512,"num_write_kb":288768,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[2,0],"acting":[2,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":2,"acting_primary":2,"purged_snaps":[]},{"pgid":"3.8","version":"0'0","reported_seq":23,"reported_epoch":30,"state":"active+clean","last_fresh":"2023-08-01T19:54:48.984700+0000","last_change":"2023-08-01T19:54:04.063990+0000","last_active":"2023-08-01T19:54:48.984700+0000","last_peered":"2023-08-01T19:54:48.984700+0000","last_clean":"2023-08-01T19:54:48.984700+0000","last_became_active":"2023-08-01T19:54:04.063652+0000","last_became_peered":"2023-08-01T19:54:04.063652+0000","last_unstale":"2023-08-01T19:54:48.984700+0000","last_undegraded":"2023-08-01T19:54:48.984700+0000","last_fullsized":"2023-08-01T19:54:48.984700+0000","mapping_epoch":15,"log_start":"0'0","ondisk_log_start":"0'0","created":15,"last_epoch_clean":16,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-08-01T19:54:03.032665+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-08-01T19:54:03.032665+0000","last_clean_scrub_stamp":"2023-08-01T19:54:03.032665+0000","objects_scrubbed":0,"log_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-08-03T05:30:28.028091+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[2,0],"acting":[2,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":2,"acting_primary":2,"purged_snaps":[]},{"pgid":"4.f","version":"0'0","reported_seq":21,"reported_epoch":29,"state":"active+clean","last_fresh":"2023-08-01T19:54:45.740633+0000","last_change":"2023-08-01T19:54:04.469648+0000","last_active":"2023-08-01T19:54:45.740633+0000","last_peered":"2023-08-01T19:54:45.740633+0000","last_clean":"2023-08-01T19:54:45.740633+0000","last_became_active":"2023-08-01T19:54:04.468445+0000","last_became_peered":"2023-08-01T19:54:04.468445+0000","last_unstale":"2023-08-01T19:54:45.740633+0000","last_undegraded":"2023-08-01T19:54:45.740633+0000","last_fullsized":"2023-08-01T19:54:45.740633+0000","mapping_epoch":16,"log_start":"0'0","ondisk_log_start":"0'0","created":16,"last_epoch_clean":17,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-08-01T19:54:04.040663+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-08-01T19:54:04.040663+0000","last_clean_scrub_stamp":"2023-08-01T19:54:04.040663+0000","objects_scrubbed":0,"log_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-08-03T05:46:11.085577+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[0,2],"acting":[0,2],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":0,"acting_primary":0,"purged_snaps":[]},{"pgid":"5.3","version":"30'4465","reported_seq":4483,"reported_epoch":30,"state":"active+clean","last_fresh":"2023-08-01T19:54:49.921435+0000","last_change":"2023-08-01T19:54:23.138357+0000","last_active":"2023-08-01T19:54:49.921435+0000","last_peered":"2023-08-01T19:54:49.921435+0000","last_clean":"2023-08-01T19:54:49.921435+0000","last_became_active":"2023-08-01T19:54:23.137942+0000","last_became_peered":"2023-08-01T19:54:23.137942+0000","last_unstale":"2023-08-01T19:54:49.921435+0000","last_undegraded":"2023-08-01T19:54:49.921435+0000","last_fullsized":"2023-08-01T19:54:49.921435+0000","mapping_epoch":19,"log_start":"22'900","ondisk_log_start":"22'900","created":19,"last_epoch_clean":20,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-08-01T19:54:22.116710+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-08-01T19:54:22.116710+0000","last_clean_scrub_stamp":"2023-08-01T19:54:22.116710+0000","objects_scrubbed":0,"log_size":3565,"ondisk_log_size":3565,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-08-03T01:44:47.434321+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":292618240,"num_objects":4465,"num_object_clones":0,"num_object_copies":8930,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":4465,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":4465,"num_write_kb":285760,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[0,1],"acting":[0,1],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":0,"acting_primary":0,"purged_snaps":[]},{"pgid":"2.4","version":"0'0","reported_seq":25,"reported_epoch":29,"state":"active+clean","last_fresh":"2023-08-01T19:54:45.741450+0000","last_change":"2023-08-01T19:53:58.973838+0000","last_active":"2023-08-01T19:54:45.741450+0000","last_peered":"2023-08-01T19:54:45.741450+0000","last_clean":"2023-08-01T19:54:45.741450+0000","last_became_active":"2023-08-01T19:53:58.973242+0000","last_became_peered":"2023-08-01T19:53:58.973242+0000","last_unstale":"2023-08-01T19:54:45.741450+0000","last_undegraded":"2023-08-01T19:54:45.741450+0000","last_fullsized":"2023-08-01T19:54:45.741450+0000","mapping_epoch":12,"log_start":"0'0","ondisk_log_start":"0'0","created":12,"last_epoch_clean":13,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-08-01T19:53:57.959448+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-08-01T19:53:57.959448+0000","last_clean_scrub_stamp":"2023-08-01T19:53:57.959448+0000","objects_scrubbed":0,"log_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-08-03T00:09:48.796549+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[0,2],"acting":[0,2],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":0,"acting_primary":0,"purged_snaps":[]},{"pgid":"3.5","version":"0'0","reported_seq":22,"reported_epoch":29,"state":"active+clean","last_fresh":"2023-08-01T19:54:45.742447+0000","last_change":"2023-08-01T19:54:04.065255+0000","last_active":"2023-08-01T19:54:45.742447+0000","last_peered":"2023-08-01T19:54:45.742447+0000","last_clean":"2023-08-01T19:54:45.742447+0000","last_became_active":"2023-08-01T19:54:04.064814+0000","last_became_peered":"2023-08-01T19:54:04.064814+0000","last_unstale":"2023-08-01T19:54:45.742447+0000","last_undegraded":"2023-08-01T19:54:45.742447+0000","last_fullsized":"2023-08-01T19:54:45.742447+0000","mapping_epoch":15,"log_start":"0'0","ondisk_log_start":"0'0","created":15,"last_epoch_clean":16,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-08-01T19:54:03.032665+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-08-01T19:54:03.032665+0000","last_clean_scrub_stamp":"2023-08-01T19:54:03.032665+0000","objects_scrubbed":0,"log_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-08-03T02:01:47.073630+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[1,0],"acting":[1,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":1,"acting_primary":1,"purged_snaps":[]},{"pgid":"4.2","version":"0'0","reported_seq":22,"reported_epoch":30,"state":"active+clean","last_fresh":"2023-08-01T19:54:48.985138+0000","last_change":"2023-08-01T19:54:04.471715+0000","last_active":"2023-08-01T19:54:48.985138+0000","last_peered":"2023-08-01T19:54:48.985138+0000","last_clean":"2023-08-01T19:54:48.985138+0000","last_became_active":"2023-08-01T19:54:04.471300+0000","last_became_peered":"2023-08-01T19:54:04.471300+0000","last_unstale":"2023-08-01T19:54:48.985138+0000","last_undegraded":"2023-08-01T19:54:48.985138+0000","last_fullsized":"2023-08-01T19:54:48.985138+0000","mapping_epoch":16,"log_start":"0'0","ondisk_log_start":"0'0","created":16,"last_epoch_clean":17,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-08-01T19:54:04.040663+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-08-01T19:54:04.040663+0000","last_clean_scrub_stamp":"2023-08-01T19:54:04.040663+0000","objects_scrubbed":0,"log_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-08-02T23:00:24.980203+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[2,1],"acting":[2,1],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":2,"acting_primary":2,"purged_snaps":[]},{"pgid":"5.5","version":"30'4352","reported_seq":4370,"reported_epoch":30,"state":"active+clean","last_fresh":"2023-08-01T19:54:49.917034+0000","last_change":"2023-08-01T19:54:23.137678+0000","last_active":"2023-08-01T19:54:49.917034+0000","last_peered":"2023-08-01T19:54:49.917034+0000","last_clean":"2023-08-01T19:54:49.917034+0000","last_became_active":"2023-08-01T19:54:23.136756+0000","last_became_peered":"2023-08-01T19:54:23.136756+0000","last_unstale":"2023-08-01T19:54:49.917034+0000","last_undegraded":"2023-08-01T19:54:49.917034+0000","last_fullsized":"2023-08-01T19:54:49.917034+0000","mapping_epoch":19,"log_start":"22'800","ondisk_log_start":"22'800","created":19,"last_epoch_clean":20,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-08-01T19:54:22.116710+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-08-01T19:54:22.116710+0000","last_clean_scrub_stamp":"2023-08-01T19:54:22.116710+0000","objects_scrubbed":0,"log_size":3552,"ondisk_log_size":3552,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-08-03T03:50:03.076219+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":285212672,"num_objects":4352,"num_object_clones":0,"num_object_copies":8704,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":4352,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":4352,"num_write_kb":278528,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[0,1],"acting":[0,1],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":0,"acting_primary":0,"purged_snaps":[]},{"pgid":"2.2","version":"0'0","reported_seq":25,"reported_epoch":29,"state":"active+clean","last_fresh":"2023-08-01T19:54:45.741995+0000","last_change":"2023-08-01T19:53:58.973665+0000","last_active":"2023-08-01T19:54:45.741995+0000","last_peered":"2023-08-01T19:54:45.741995+0000","last_clean":"2023-08-01T19:54:45.741995+0000","last_became_active":"2023-08-01T19:53:58.973463+0000","last_became_peered":"2023-08-01T19:53:58.973463+0000","last_unstale":"2023-08-01T19:54:45.741995+0000","last_undegraded":"2023-08-01T19:54:45.741995+0000","last_fullsized":"2023-08-01T19:54:45.741995+0000","mapping_epoch":12,"log_start":"0'0","ondisk_log_start":"0'0","created":12,"last_epoch_clean":13,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-08-01T19:53:57.959448+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-08-01T19:53:57.959448+0000","last_clean_scrub_stamp":"2023-08-01T19:53:57.959448+0000","objects_scrubbed":0,"log_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-08-03T04:50:42.368892+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[1,0],"acting":[1,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":1,"acting_primary":1,"purged_snaps":[]},{"pgid":"3.3","version":"0'0","reported_seq":22,"reported_epoch":29,"state":"active+clean","last_fresh":"2023-08-01T19:54:45.741727+0000","last_change":"2023-08-01T19:54:04.065415+0000","last_active":"2023-08-01T19:54:45.741727+0000","last_peered":"2023-08-01T19:54:45.741727+0000","last_clean":"2023-08-01T19:54:45.741727+0000","last_became_active":"2023-08-01T19:54:04.065030+0000","last_became_peered":"2023-08-01T19:54:04.065030+0000","last_unstale":"2023-08-01T19:54:45.741727+0000","last_undegraded":"2023-08-01T19:54:45.741727+0000","last_fullsized":"2023-08-01T19:54:45.741727+0000","mapping_epoch":15,"log_start":"0'0","ondisk_log_start":"0'0","created":15,"last_epoch_clean":16,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-08-01T19:54:03.032665+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-08-01T19:54:03.032665+0000","last_clean_scrub_stamp":"2023-08-01T19:54:03.032665+0000","objects_scrubbed":0,"log_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-08-02T21:33:27.007118+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[1,0],"acting":[1,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":1,"acting_primary":1,"purged_snaps":[]},{"pgid":"4.4","version":"0'0","reported_seq":21,"reported_epoch":29,"state":"active+clean","last_fresh":"2023-08-01T19:54:45.741372+0000","last_change":"2023-08-01T19:54:04.468101+0000","last_active":"2023-08-01T19:54:45.741372+0000","last_peered":"2023-08-01T19:54:45.741372+0000","last_clean":"2023-08-01T19:54:45.741372+0000","last_became_active":"2023-08-01T19:54:04.467409+0000","last_became_peered":"2023-08-01T19:54:04.467409+0000","last_unstale":"2023-08-01T19:54:45.741372+0000","last_undegraded":"2023-08-01T19:54:45.741372+0000","last_fullsized":"2023-08-01T19:54:45.741372+0000","mapping_epoch":16,"log_start":"0'0","ondisk_log_start":"0'0","created":16,"last_epoch_clean":17,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-08-01T19:54:04.040663+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-08-01T19:54:04.040663+0000","last_clean_scrub_stamp":"2023-08-01T19:54:04.040663+0000","objects_scrubbed":0,"log_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-08-02T21:43:30.325991+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[0,2],"acting":[0,2],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":0,"acting_primary":0,"purged_snaps":[]},{"pgid":"5.6","version":"30'4364","reported_seq":4382,"reported_epoch":30,"state":"active+clean","last_fresh":"2023-08-01T19:54:49.935414+0000","last_change":"2023-08-01T19:54:23.138275+0000","last_active":"2023-08-01T19:54:49.935414+0000","last_peered":"2023-08-01T19:54:49.935414+0000","last_clean":"2023-08-01T19:54:49.935414+0000","last_became_active":"2023-08-01T19:54:23.137973+0000","last_became_peered":"2023-08-01T19:54:23.137973+0000","last_unstale":"2023-08-01T19:54:49.935414+0000","last_undegraded":"2023-08-01T19:54:49.935414+0000","last_fullsized":"2023-08-01T19:54:49.935414+0000","mapping_epoch":19,"log_start":"22'800","ondisk_log_start":"22'800","created":19,"last_epoch_clean":20,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-08-01T19:54:22.116710+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-08-01T19:54:22.116710+0000","last_clean_scrub_stamp":"2023-08-01T19:54:22.116710+0000","objects_scrubbed":0,"log_size":3564,"ondisk_log_size":3564,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-08-03T01:19:10.526905+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":285999104,"num_objects":4364,"num_object_clones":0,"num_object_copies":8728,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":4364,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":4364,"num_write_kb":279296,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[0,1],"acting":[0,1],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":0,"acting_primary":0,"purged_snaps":[]},{"pgid":"2.1","version":"0'0","reported_seq":25,"reported_epoch":29,"state":"active+clean","last_fresh":"2023-08-01T19:54:45.740431+0000","last_change":"2023-08-01T19:53:58.973700+0000","last_active":"2023-08-01T19:54:45.740431+0000","last_peered":"2023-08-01T19:54:45.740431+0000","last_clean":"2023-08-01T19:54:45.740431+0000","last_became_active":"2023-08-01T19:53:58.973285+0000","last_became_peered":"2023-08-01T19:53:58.973285+0000","last_unstale":"2023-08-01T19:54:45.740431+0000","last_undegraded":"2023-08-01T19:54:45.740431+0000","last_fullsized":"2023-08-01T19:54:45.740431+0000","mapping_epoch":12,"log_start":"0'0","ondisk_log_start":"0'0","created":12,"last_epoch_clean":13,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-08-01T19:53:57.959448+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-08-01T19:53:57.959448+0000","last_clean_scrub_stamp":"2023-08-01T19:53:57.959448+0000","objects_scrubbed":0,"log_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-08-02T21:26:02.570824+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[0,2],"acting":[0,2],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":0,"acting_primary":0,"purged_snaps":[]},{"pgid":"3.0","version":"0'0","reported_seq":23,"reported_epoch":30,"state":"active+clean","last_fresh":"2023-08-01T19:54:48.984733+0000","last_change":"2023-08-01T19:54:04.064407+0000","last_active":"2023-08-01T19:54:48.984733+0000","last_peered":"2023-08-01T19:54:48.984733+0000","last_clean":"2023-08-01T19:54:48.984733+0000","last_became_active":"2023-08-01T19:54:04.064122+0000","last_became_peered":"2023-08-01T19:54:04.064122+0000","last_unstale":"2023-08-01T19:54:48.984733+0000","last_undegraded":"2023-08-01T19:54:48.984733+0000","last_fullsized":"2023-08-01T19:54:48.984733+0000","mapping_epoch":15,"log_start":"0'0","ondisk_log_start":"0'0","created":15,"last_epoch_clean":16,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-08-01T19:54:03.032665+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-08-01T19:54:03.032665+0000","last_clean_scrub_stamp":"2023-08-01T19:54:03.032665+0000","objects_scrubbed":0,"log_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-08-03T07:08:17.318689+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[2,1],"acting":[2,1],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":2,"acting_primary":2,"purged_snaps":[]},{"pgid":"4.7","version":"0'0","reported_seq":21,"reported_epoch":29,"state":"active+clean","last_fresh":"2023-08-01T19:54:45.740854+0000","last_change":"2023-08-01T19:54:04.469739+0000","last_active":"2023-08-01T19:54:45.740854+0000","last_peered":"2023-08-01T19:54:45.740854+0000","last_clean":"2023-08-01T19:54:45.740854+0000","last_became_active":"2023-08-01T19:54:04.468021+0000","last_became_peered":"2023-08-01T19:54:04.468021+0000","last_unstale":"2023-08-01T19:54:45.740854+0000","last_undegraded":"2023-08-01T19:54:45.740854+0000","last_fullsized":"2023-08-01T19:54:45.740854+0000","mapping_epoch":16,"log_start":"0'0","ondisk_log_start":"0'0","created":16,"last_epoch_clean":17,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-08-01T19:54:04.040663+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-08-01T19:54:04.040663+0000","last_clean_scrub_stamp":"2023-08-01T19:54:04.040663+0000","objects_scrubbed":0,"log_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-08-02T21:03:01.319028+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[0,2],"acting":[0,2],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":0,"acting_primary":0,"purged_snaps":[]},{"pgid":"5.4","version":"31'4467","reported_seq":4485,"reported_epoch":31,"state":"active+clean","last_fresh":"2023-08-01T19:54:51.056606+0000","last_change":"2023-08-01T19:54:23.138253+0000","last_active":"2023-08-01T19:54:51.056606+0000","last_peered":"2023-08-01T19:54:51.056606+0000","last_clean":"2023-08-01T19:54:51.056606+0000","last_became_active":"2023-08-01T19:54:23.137915+0000","last_became_peered":"2023-08-01T19:54:23.137915+0000","last_unstale":"2023-08-01T19:54:51.056606+0000","last_undegraded":"2023-08-01T19:54:51.056606+0000","last_fullsized":"2023-08-01T19:54:51.056606+0000","mapping_epoch":19,"log_start":"22'500","ondisk_log_start":"22'500","created":19,"last_epoch_clean":20,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-08-01T19:54:22.116710+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-08-01T19:54:22.116710+0000","last_clean_scrub_stamp":"2023-08-01T19:54:22.116710+0000","objects_scrubbed":0,"log_size":3967,"ondisk_log_size":3967,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-08-03T07:20:04.946515+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":292749312,"num_objects":4467,"num_object_clones":0,"num_object_copies":8934,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":4467,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":4467,"num_write_kb":285888,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[2,0],"acting":[2,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":2,"acting_primary":2,"purged_snaps":[]},{"pgid":"2.3","version":"0'0","reported_seq":25,"reported_epoch":29,"state":"active+clean","last_fresh":"2023-08-01T19:54:45.741782+0000","last_change":"2023-08-01T19:53:58.973768+0000","last_active":"2023-08-01T19:54:45.741782+0000","last_peered":"2023-08-01T19:54:45.741782+0000","last_clean":"2023-08-01T19:54:45.741782+0000","last_became_active":"2023-08-01T19:53:58.973492+0000","last_became_peered":"2023-08-01T19:53:58.973492+0000","last_unstale":"2023-08-01T19:54:45.741782+0000","last_undegraded":"2023-08-01T19:54:45.741782+0000","last_fullsized":"2023-08-01T19:54:45.741782+0000","mapping_epoch":12,"log_start":"0'0","ondisk_log_start":"0'0","created":12,"last_epoch_clean":13,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-08-01T19:53:57.959448+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-08-01T19:53:57.959448+0000","last_clean_scrub_stamp":"2023-08-01T19:53:57.959448+0000","objects_scrubbed":0,"log_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-08-03T02:04:52.034667+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[1,0],"acting":[1,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":1,"acting_primary":1,"purged_snaps":[]},{"pgid":"1.0","version":"10'157","reported_seq":224,"reported_epoch":29,"state":"active+clean","last_fresh":"2023-08-01T19:54:45.741464+0000","last_change":"2023-08-01T19:53:51.746910+0000","last_active":"2023-08-01T19:54:45.741464+0000","last_peered":"2023-08-01T19:54:45.741464+0000","last_clean":"2023-08-01T19:54:45.741464+0000","last_became_active":"2023-08-01T19:53:51.746590+0000","last_became_peered":"2023-08-01T19:53:51.746590+0000","last_unstale":"2023-08-01T19:54:45.741464+0000","last_undegraded":"2023-08-01T19:54:45.741464+0000","last_fullsized":"2023-08-01T19:54:45.741464+0000","mapping_epoch":9,"log_start":"0'0","ondisk_log_start":"0'0","created":9,"last_epoch_clean":10,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-08-01T19:53:50.735626+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-08-01T19:53:50.735626+0000","last_clean_scrub_stamp":"2023-08-01T19:53:50.735626+0000","objects_scrubbed":0,"log_size":157,"ondisk_log_size":157,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-08-03T02:56:50.228294+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":590368,"num_objects":2,"num_object_clones":0,"num_object_copies":4,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":2,"num_whiteouts":0,"num_read":136,"num_read_kb":118,"num_write":203,"num_write_kb":3460,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[1,2],"acting":[1,2],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":1,"acting_primary":1,"purged_snaps":[]},{"pgid":"3.2","version":"0'0","reported_seq":22,"reported_epoch":29,"state":"active+clean","last_fresh":"2023-08-01T19:54:45.740114+0000","last_change":"2023-08-01T19:54:04.064009+0000","last_active":"2023-08-01T19:54:45.740114+0000","last_peered":"2023-08-01T19:54:45.740114+0000","last_clean":"2023-08-01T19:54:45.740114+0000","last_became_active":"2023-08-01T19:54:04.063665+0000","last_became_peered":"2023-08-01T19:54:04.063665+0000","last_unstale":"2023-08-01T19:54:45.740114+0000","last_undegraded":"2023-08-01T19:54:45.740114+0000","last_fullsized":"2023-08-01T19:54:45.740114+0000","mapping_epoch":15,"log_start":"0'0","ondisk_log_start":"0'0","created":15,"last_epoch_clean":16,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-08-01T19:54:03.032665+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-08-01T19:54:03.032665+0000","last_clean_scrub_stamp":"2023-08-01T19:54:03.032665+0000","objects_scrubbed":0,"log_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-08-03T04:04:46.983253+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[0,2],"acting":[0,2],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":0,"acting_primary":0,"purged_snaps":[]},{"pgid":"4.5","version":"0'0","reported_seq":21,"reported_epoch":29,"state":"active+clean","last_fresh":"2023-08-01T19:54:45.742524+0000","last_change":"2023-08-01T19:54:04.474061+0000","last_active":"2023-08-01T19:54:45.742524+0000","last_peered":"2023-08-01T19:54:45.742524+0000","last_clean":"2023-08-01T19:54:45.742524+0000","last_became_active":"2023-08-01T19:54:04.472128+0000","last_became_peered":"2023-08-01T19:54:04.472128+0000","last_unstale":"2023-08-01T19:54:45.742524+0000","last_undegraded":"2023-08-01T19:54:45.742524+0000","last_fullsized":"2023-08-01T19:54:45.742524+0000","mapping_epoch":16,"log_start":"0'0","ondisk_log_start":"0'0","created":16,"last_epoch_clean":17,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-08-01T19:54:04.040663+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-08-01T19:54:04.040663+0000","last_clean_scrub_stamp":"2023-08-01T19:54:04.040663+0000","objects_scrubbed":0,"log_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-08-03T00:29:05.857138+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[1,2],"acting":[1,2],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":1,"acting_primary":1,"purged_snaps":[]},{"pgid":"5.7","version":"30'4386","reported_seq":4404,"reported_epoch":30,"state":"active+clean","last_fresh":"2023-08-01T19:54:49.918076+0000","last_change":"2023-08-01T19:54:23.138337+0000","last_active":"2023-08-01T19:54:49.918076+0000","last_peered":"2023-08-01T19:54:49.918076+0000","last_clean":"2023-08-01T19:54:49.918076+0000","last_became_active":"2023-08-01T19:54:23.138056+0000","last_became_peered":"2023-08-01T19:54:23.138056+0000","last_unstale":"2023-08-01T19:54:49.918076+0000","last_undegraded":"2023-08-01T19:54:49.918076+0000","last_fullsized":"2023-08-01T19:54:49.918076+0000","mapping_epoch":19,"log_start":"22'600","ondisk_log_start":"22'600","created":19,"last_epoch_clean":20,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-08-01T19:54:22.116710+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-08-01T19:54:22.116710+0000","last_clean_scrub_stamp":"2023-08-01T19:54:22.116710+0000","objects_scrubbed":0,"log_size":3786,"ondisk_log_size":3786,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-08-03T06:58:19.846492+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":287440896,"num_objects":4386,"num_object_clones":0,"num_object_copies":8772,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":4386,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":4386,"num_write_kb":280704,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[1,0],"acting":[1,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":1,"acting_primary":1,"purged_snaps":[]},{"pgid":"2.0","version":"0'0","reported_seq":25,"reported_epoch":29,"state":"active+clean","last_fresh":"2023-08-01T19:54:45.741505+0000","last_change":"2023-08-01T19:53:58.975968+0000","last_active":"2023-08-01T19:54:45.741505+0000","last_peered":"2023-08-01T19:54:45.741505+0000","last_clean":"2023-08-01T19:54:45.741505+0000","last_became_active":"2023-08-01T19:53:58.975706+0000","last_became_peered":"2023-08-01T19:53:58.975706+0000","last_unstale":"2023-08-01T19:54:45.741505+0000","last_undegraded":"2023-08-01T19:54:45.741505+0000","last_fullsized":"2023-08-01T19:54:45.741505+0000","mapping_epoch":12,"log_start":"0'0","ondisk_log_start":"0'0","created":12,"last_epoch_clean":13,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-08-01T19:53:57.959448+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-08-01T19:53:57.959448+0000","last_clean_scrub_stamp":"2023-08-01T19:53:57.959448+0000","objects_scrubbed":0,"log_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-08-03T00:02:15.204280+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[1,2],"acting":[1,2],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":1,"acting_primary":1,"purged_snaps":[]},{"pgid":"3.1","version":"0'0","reported_seq":22,"reported_epoch":29,"state":"active+clean","last_fresh":"2023-08-01T19:54:45.739816+0000","last_change":"2023-08-01T19:54:04.066707+0000","last_active":"2023-08-01T19:54:45.739816+0000","last_peered":"2023-08-01T19:54:45.739816+0000","last_clean":"2023-08-01T19:54:45.739816+0000","last_became_active":"2023-08-01T19:54:04.066334+0000","last_became_peered":"2023-08-01T19:54:04.066334+0000","last_unstale":"2023-08-01T19:54:45.739816+0000","last_undegraded":"2023-08-01T19:54:45.739816+0000","last_fullsized":"2023-08-01T19:54:45.739816+0000","mapping_epoch":15,"log_start":"0'0","ondisk_log_start":"0'0","created":15,"last_epoch_clean":16,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-08-01T19:54:03.032665+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-08-01T19:54:03.032665+0000","last_clean_scrub_stamp":"2023-08-01T19:54:03.032665+0000","objects_scrubbed":0,"log_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-08-03T02:40:15.210599+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[0,1],"acting":[0,1],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":0,"acting_primary":0,"purged_snaps":[]},{"pgid":"4.6","version":"0'0","reported_seq":22,"reported_epoch":30,"state":"active+clean","last_fresh":"2023-08-01T19:54:48.985587+0000","last_change":"2023-08-01T19:54:04.469877+0000","last_active":"2023-08-01T19:54:48.985587+0000","last_peered":"2023-08-01T19:54:48.985587+0000","last_clean":"2023-08-01T19:54:48.985587+0000","last_became_active":"2023-08-01T19:54:04.469528+0000","last_became_peered":"2023-08-01T19:54:04.469528+0000","last_unstale":"2023-08-01T19:54:48.985587+0000","last_undegraded":"2023-08-01T19:54:48.985587+0000","last_fullsized":"2023-08-01T19:54:48.985587+0000","mapping_epoch":16,"log_start":"0'0","ondisk_log_start":"0'0","created":16,"last_epoch_clean":17,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-08-01T19:54:04.040663+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-08-01T19:54:04.040663+0000","last_clean_scrub_stamp":"2023-08-01T19:54:04.040663+0000","objects_scrubbed":0,"log_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-08-03T02:24:19.067602+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[2,0],"acting":[2,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":2,"acting_primary":2,"purged_snaps":[]},{"pgid":"5.2","version":"30'4558","reported_seq":4576,"reported_epoch":30,"state":"active+clean","last_fresh":"2023-08-01T19:54:49.910689+0000","last_change":"2023-08-01T19:54:23.138339+0000","last_active":"2023-08-01T19:54:49.910689+0000","last_peered":"2023-08-01T19:54:49.910689+0000","last_clean":"2023-08-01T19:54:49.910689+0000","last_became_active":"2023-08-01T19:54:23.137962+0000","last_became_peered":"2023-08-01T19:54:23.137962+0000","last_unstale":"2023-08-01T19:54:49.910689+0000","last_undegraded":"2023-08-01T19:54:49.910689+0000","last_fullsized":"2023-08-01T19:54:49.910689+0000","mapping_epoch":19,"log_start":"22'800","ondisk_log_start":"22'800","created":19,"last_epoch_clean":20,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-08-01T19:54:22.116710+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-08-01T19:54:22.116710+0000","last_clean_scrub_stamp":"2023-08-01T19:54:22.116710+0000","objects_scrubbed":0,"log_size":3758,"ondisk_log_size":3758,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-08-03T01:46:33.457242+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":298713088,"num_objects":4558,"num_object_clones":0,"num_object_copies":9116,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":4558,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":4558,"num_write_kb":291712,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[1,0],"acting":[1,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":1,"acting_primary":1,"purged_snaps":[]},{"pgid":"2.5","version":"0'0","reported_seq":26,"reported_epoch":30,"state":"active+clean","last_fresh":"2023-08-01T19:54:48.985374+0000","last_change":"2023-08-01T19:53:58.970683+0000","last_active":"2023-08-01T19:54:48.985374+0000","last_peered":"2023-08-01T19:54:48.985374+0000","last_clean":"2023-08-01T19:54:48.985374+0000","last_became_active":"2023-08-01T19:53:58.970437+0000","last_became_peered":"2023-08-01T19:53:58.970437+0000","last_unstale":"2023-08-01T19:54:48.985374+0000","last_undegraded":"2023-08-01T19:54:48.985374+0000","last_fullsized":"2023-08-01T19:54:48.985374+0000","mapping_epoch":12,"log_start":"0'0","ondisk_log_start":"0'0","created":12,"last_epoch_clean":13,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-08-01T19:53:57.959448+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-08-01T19:53:57.959448+0000","last_clean_scrub_stamp":"2023-08-01T19:53:57.959448+0000","objects_scrubbed":0,"log_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-08-02T23:54:08.273426+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[2,0],"acting":[2,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":2,"acting_primary":2,"purged_snaps":[]},{"pgid":"3.4","version":"0'0","reported_seq":22,"reported_epoch":29,"state":"active+clean","last_fresh":"2023-08-01T19:54:45.741037+0000","last_change":"2023-08-01T19:54:04.062283+0000","last_active":"2023-08-01T19:54:45.741037+0000","last_peered":"2023-08-01T19:54:45.741037+0000","last_clean":"2023-08-01T19:54:45.741037+0000","last_became_active":"2023-08-01T19:54:04.061796+0000","last_became_peered":"2023-08-01T19:54:04.061796+0000","last_unstale":"2023-08-01T19:54:45.741037+0000","last_undegraded":"2023-08-01T19:54:45.741037+0000","last_fullsized":"2023-08-01T19:54:45.741037+0000","mapping_epoch":15,"log_start":"0'0","ondisk_log_start":"0'0","created":15,"last_epoch_clean":16,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-08-01T19:54:03.032665+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-08-01T19:54:03.032665+0000","last_clean_scrub_stamp":"2023-08-01T19:54:03.032665+0000","objects_scrubbed":0,"log_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-08-02T19:54:08.401797+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[0,2],"acting":[0,2],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":0,"acting_primary":0,"purged_snaps":[]},{"pgid":"4.3","version":"0'0","reported_seq":22,"reported_epoch":30,"state":"active+clean","last_fresh":"2023-08-01T19:54:48.984823+0000","last_change":"2023-08-01T19:54:04.473088+0000","last_active":"2023-08-01T19:54:48.984823+0000","last_peered":"2023-08-01T19:54:48.984823+0000","last_clean":"2023-08-01T19:54:48.984823+0000","last_became_active":"2023-08-01T19:54:04.472611+0000","last_became_peered":"2023-08-01T19:54:04.472611+0000","last_unstale":"2023-08-01T19:54:48.984823+0000","last_undegraded":"2023-08-01T19:54:48.984823+0000","last_fullsized":"2023-08-01T19:54:48.984823+0000","mapping_epoch":16,"log_start":"0'0","ondisk_log_start":"0'0","created":16,"last_epoch_clean":17,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-08-01T19:54:04.040663+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-08-01T19:54:04.040663+0000","last_clean_scrub_stamp":"2023-08-01T19:54:04.040663+0000","objects_scrubbed":0,"log_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-08-03T07:27:26.537518+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[2,1],"acting":[2,1],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":2,"acting_primary":2,"purged_snaps":[]},{"pgid":"5.1","version":"30'4382","reported_seq":4400,"reported_epoch":30,"state":"active+clean","last_fresh":"2023-08-01T19:54:49.910321+0000","last_change":"2023-08-01T19:54:23.138225+0000","last_active":"2023-08-01T19:54:49.910321+0000","last_peered":"2023-08-01T19:54:49.910321+0000","last_clean":"2023-08-01T19:54:49.910321+0000","last_became_active":"2023-08-01T19:54:23.137955+0000","last_became_peered":"2023-08-01T19:54:23.137955+0000","last_unstale":"2023-08-01T19:54:49.910321+0000","last_undegraded":"2023-08-01T19:54:49.910321+0000","last_fullsized":"2023-08-01T19:54:49.910321+0000","mapping_epoch":19,"log_start":"22'600","ondisk_log_start":"22'600","created":19,"last_epoch_clean":20,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-08-01T19:54:22.116710+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-08-01T19:54:22.116710+0000","last_clean_scrub_stamp":"2023-08-01T19:54:22.116710+0000","objects_scrubbed":0,"log_size":3782,"ondisk_log_size":3782,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-08-03T03:58:00.471919+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":287178752,"num_objects":4382,"num_object_clones":0,"num_object_copies":8764,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":4382,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":4382,"num_write_kb":280448,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[1,0],"acting":[1,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":1,"acting_primary":1,"purged_snaps":[]},{"pgid":"3.7","version":"17'2","reported_seq":24,"reported_epoch":29,"state":"active+clean","last_fresh":"2023-08-01T19:54:45.740533+0000","last_change":"2023-08-01T19:54:04.065147+0000","last_active":"2023-08-01T19:54:45.740533+0000","last_peered":"2023-08-01T19:54:45.740533+0000","last_clean":"2023-08-01T19:54:45.740533+0000","last_became_active":"2023-08-01T19:54:04.064779+0000","last_became_peered":"2023-08-01T19:54:04.064779+0000","last_unstale":"2023-08-01T19:54:45.740533+0000","last_undegraded":"2023-08-01T19:54:45.740533+0000","last_fullsized":"2023-08-01T19:54:45.740533+0000","mapping_epoch":15,"log_start":"0'0","ondisk_log_start":"0'0","created":15,"last_epoch_clean":16,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-08-01T19:54:03.032665+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-08-01T19:54:03.032665+0000","last_clean_scrub_stamp":"2023-08-01T19:54:03.032665+0000","objects_scrubbed":0,"log_size":2,"ondisk_log_size":2,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-08-03T03:43:45.667663+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":1,"num_object_clones":0,"num_object_copies":2,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":1,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":3,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":1,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[0,2],"acting":[0,2],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":0,"acting_primary":0,"purged_snaps":[]},{"pgid":"2.6","version":"0'0","reported_seq":25,"reported_epoch":29,"state":"active+clean","last_fresh":"2023-08-01T19:54:45.740791+0000","last_change":"2023-08-01T19:53:58.974077+0000","last_active":"2023-08-01T19:54:45.740791+0000","last_peered":"2023-08-01T19:54:45.740791+0000","last_clean":"2023-08-01T19:54:45.740791+0000","last_became_active":"2023-08-01T19:53:58.973396+0000","last_became_peered":"2023-08-01T19:53:58.973396+0000","last_unstale":"2023-08-01T19:54:45.740791+0000","last_undegraded":"2023-08-01T19:54:45.740791+0000","last_fullsized":"2023-08-01T19:54:45.740791+0000","mapping_epoch":12,"log_start":"0'0","ondisk_log_start":"0'0","created":12,"last_epoch_clean":13,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-08-01T19:53:57.959448+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-08-01T19:53:57.959448+0000","last_clean_scrub_stamp":"2023-08-01T19:53:57.959448+0000","objects_scrubbed":0,"log_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-08-02T22:13:50.940864+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[0,2],"acting":[0,2],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":0,"acting_primary":0,"purged_snaps":[]},{"pgid":"4.0","version":"0'0","reported_seq":21,"reported_epoch":29,"state":"active+clean","last_fresh":"2023-08-01T19:54:45.741375+0000","last_change":"2023-08-01T19:54:04.476807+0000","last_active":"2023-08-01T19:54:45.741375+0000","last_peered":"2023-08-01T19:54:45.741375+0000","last_clean":"2023-08-01T19:54:45.741375+0000","last_became_active":"2023-08-01T19:54:04.476453+0000","last_became_peered":"2023-08-01T19:54:04.476453+0000","last_unstale":"2023-08-01T19:54:45.741375+0000","last_undegraded":"2023-08-01T19:54:45.741375+0000","last_fullsized":"2023-08-01T19:54:45.741375+0000","mapping_epoch":16,"log_start":"0'0","ondisk_log_start":"0'0","created":16,"last_epoch_clean":17,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-08-01T19:54:04.040663+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-08-01T19:54:04.040663+0000","last_clean_scrub_stamp":"2023-08-01T19:54:04.040663+0000","objects_scrubbed":0,"log_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-08-02T20:20:59.989030+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[0,1],"acting":[0,1],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":0,"acting_primary":0,"purged_snaps":[]},{"pgid":"5.0","version":"31'4618","reported_seq":4637,"reported_epoch":31,"state":"active+clean","last_fresh":"2023-08-01T19:54:51.027624+0000","last_change":"2023-08-01T19:54:23.138369+0000","last_active":"2023-08-01T19:54:51.027624+0000","last_peered":"2023-08-01T19:54:51.027624+0000","last_clean":"2023-08-01T19:54:51.027624+0000","last_became_active":"2023-08-01T19:54:23.137857+0000","last_became_peered":"2023-08-01T19:54:23.137857+0000","last_unstale":"2023-08-01T19:54:51.027624+0000","last_undegraded":"2023-08-01T19:54:51.027624+0000","last_fullsized":"2023-08-01T19:54:51.027624+0000","mapping_epoch":19,"log_start":"22'600","ondisk_log_start":"22'600","created":19,"last_epoch_clean":20,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-08-01T19:54:22.116710+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-08-01T19:54:22.116710+0000","last_clean_scrub_stamp":"2023-08-01T19:54:22.116710+0000","objects_scrubbed":0,"log_size":4018,"ondisk_log_size":4018,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-08-03T06:02:44.391298+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":302645248,"num_objects":4618,"num_object_clones":0,"num_object_copies":9236,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":4618,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":4618,"num_write_kb":295552,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[2,0],"acting":[2,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":2,"acting_primary":2,"purged_snaps":[]},{"pgid":"2.7","version":"0'0","reported_seq":25,"reported_epoch":29,"state":"active+clean","last_fresh":"2023-08-01T19:54:45.742165+0000","last_change":"2023-08-01T19:53:58.975936+0000","last_active":"2023-08-01T19:54:45.742165+0000","last_peered":"2023-08-01T19:54:45.742165+0000","last_clean":"2023-08-01T19:54:45.742165+0000","last_became_active":"2023-08-01T19:53:58.975680+0000","last_became_peered":"2023-08-01T19:53:58.975680+0000","last_unstale":"2023-08-01T19:54:45.742165+0000","last_undegraded":"2023-08-01T19:54:45.742165+0000","last_fullsized":"2023-08-01T19:54:45.742165+0000","mapping_epoch":12,"log_start":"0'0","ondisk_log_start":"0'0","created":12,"last_epoch_clean":13,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-08-01T19:53:57.959448+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-08-01T19:53:57.959448+0000","last_clean_scrub_stamp":"2023-08-01T19:53:57.959448+0000","objects_scrubbed":0,"log_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-08-03T05:17:03.508898+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[1,2],"acting":[1,2],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":1,"acting_primary":1,"purged_snaps":[]},{"pgid":"3.6","version":"18'1","reported_seq":23,"reported_epoch":29,"state":"active+clean","last_fresh":"2023-08-01T19:54:45.740619+0000","last_change":"2023-08-01T19:54:04.068041+0000","last_active":"2023-08-01T19:54:45.740619+0000","last_peered":"2023-08-01T19:54:45.740619+0000","last_clean":"2023-08-01T19:54:45.740619+0000","last_became_active":"2023-08-01T19:54:04.067613+0000","last_became_peered":"2023-08-01T19:54:04.067613+0000","last_unstale":"2023-08-01T19:54:45.740619+0000","last_undegraded":"2023-08-01T19:54:45.740619+0000","last_fullsized":"2023-08-01T19:54:45.740619+0000","mapping_epoch":15,"log_start":"0'0","ondisk_log_start":"0'0","created":15,"last_epoch_clean":16,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-08-01T19:54:03.032665+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-08-01T19:54:03.032665+0000","last_clean_scrub_stamp":"2023-08-01T19:54:03.032665+0000","objects_scrubbed":0,"log_size":1,"ondisk_log_size":1,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-08-02T21:35:44.874727+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":1,"num_object_clones":0,"num_object_copies":2,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":1,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":1,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":1,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[0,1],"acting":[0,1],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":0,"acting_primary":0,"purged_snaps":[]},{"pgid":"4.1","version":"0'0","reported_seq":22,"reported_epoch":30,"state":"active+clean","last_fresh":"2023-08-01T19:54:48.984677+0000","last_change":"2023-08-01T19:54:04.469243+0000","last_active":"2023-08-01T19:54:48.984677+0000","last_peered":"2023-08-01T19:54:48.984677+0000","last_clean":"2023-08-01T19:54:48.984677+0000","last_became_active":"2023-08-01T19:54:04.468835+0000","last_became_peered":"2023-08-01T19:54:04.468835+0000","last_unstale":"2023-08-01T19:54:48.984677+0000","last_undegraded":"2023-08-01T19:54:48.984677+0000","last_fullsized":"2023-08-01T19:54:48.984677+0000","mapping_epoch":16,"log_start":"0'0","ondisk_log_start":"0'0","created":16,"last_epoch_clean":17,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-08-01T19:54:04.040663+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-08-01T19:54:04.040663+0000","last_clean_scrub_stamp":"2023-08-01T19:54:04.040663+0000","objects_scrubbed":0,"log_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-08-03T04:43:58.358628+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[2,1],"acting":[2,1],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":2,"acting_primary":2,"purged_snaps":[]},{"pgid":"3.1b","version":"17'1","reported_seq":24,"reported_epoch":30,"state":"active+clean","last_fresh":"2023-08-01T19:54:48.984830+0000","last_change":"2023-08-01T19:54:04.066748+0000","last_active":"2023-08-01T19:54:48.984830+0000","last_peered":"2023-08-01T19:54:48.984830+0000","last_clean":"2023-08-01T19:54:48.984830+0000","last_became_active":"2023-08-01T19:54:04.066483+0000","last_became_peered":"2023-08-01T19:54:04.066483+0000","last_unstale":"2023-08-01T19:54:48.984830+0000","last_undegraded":"2023-08-01T19:54:48.984830+0000","last_fullsized":"2023-08-01T19:54:48.984830+0000","mapping_epoch":15,"log_start":"0'0","ondisk_log_start":"0'0","created":15,"last_epoch_clean":16,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-08-01T19:54:03.032665+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-08-01T19:54:03.032665+0000","last_clean_scrub_stamp":"2023-08-01T19:54:03.032665+0000","objects_scrubbed":0,"log_size":1,"ondisk_log_size":1,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-08-03T03:08:26.880362+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[2,1],"acting":[2,1],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":2,"acting_primary":2,"purged_snaps":[]},{"pgid":"4.1c","version":"0'0","reported_seq":22,"reported_epoch":30,"state":"active+clean","last_fresh":"2023-08-01T19:54:48.985040+0000","last_change":"2023-08-01T19:54:04.466766+0000","last_active":"2023-08-01T19:54:48.985040+0000","last_peered":"2023-08-01T19:54:48.985040+0000","last_clean":"2023-08-01T19:54:48.985040+0000","last_became_active":"2023-08-01T19:54:04.466417+0000","last_became_peered":"2023-08-01T19:54:04.466417+0000","last_unstale":"2023-08-01T19:54:48.985040+0000","last_undegraded":"2023-08-01T19:54:48.985040+0000","last_fullsized":"2023-08-01T19:54:48.985040+0000","mapping_epoch":16,"log_start":"0'0","ondisk_log_start":"0'0","created":16,"last_epoch_clean":17,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-08-01T19:54:04.040663+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-08-01T19:54:04.040663+0000","last_clean_scrub_stamp":"2023-08-01T19:54:04.040663+0000","objects_scrubbed":0,"log_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-08-02T22:01:53.643825+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[2,0],"acting":[2,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":2,"acting_primary":2,"purged_snaps":[]},{"pgid":"3.1c","version":"17'2","reported_seq":24,"reported_epoch":29,"state":"active+clean","last_fresh":"2023-08-01T19:54:45.742111+0000","last_change":"2023-08-01T19:54:04.065706+0000","last_active":"2023-08-01T19:54:45.742111+0000","last_peered":"2023-08-01T19:54:45.742111+0000","last_clean":"2023-08-01T19:54:45.742111+0000","last_became_active":"2023-08-01T19:54:04.064796+0000","last_became_peered":"2023-08-01T19:54:04.064796+0000","last_unstale":"2023-08-01T19:54:45.742111+0000","last_undegraded":"2023-08-01T19:54:45.742111+0000","last_fullsized":"2023-08-01T19:54:45.742111+0000","mapping_epoch":15,"log_start":"0'0","ondisk_log_start":"0'0","created":15,"last_epoch_clean":16,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-08-01T19:54:03.032665+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-08-01T19:54:03.032665+0000","last_clean_scrub_stamp":"2023-08-01T19:54:03.032665+0000","objects_scrubbed":0,"log_size":2,"ondisk_log_size":2,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-08-02T21:40:43.596301+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":1,"num_object_clones":0,"num_object_copies":2,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":1,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":3,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":1,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[1,0],"acting":[1,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":1,"acting_primary":1,"purged_snaps":[]},{"pgid":"4.1b","version":"0'0","reported_seq":21,"reported_epoch":29,"state":"active+clean","last_fresh":"2023-08-01T19:54:45.741723+0000","last_change":"2023-08-01T19:54:04.474971+0000","last_active":"2023-08-01T19:54:45.741723+0000","last_peered":"2023-08-01T19:54:45.741723+0000","last_clean":"2023-08-01T19:54:45.741723+0000","last_became_active":"2023-08-01T19:54:04.473957+0000","last_became_peered":"2023-08-01T19:54:04.473957+0000","last_unstale":"2023-08-01T19:54:45.741723+0000","last_undegraded":"2023-08-01T19:54:45.741723+0000","last_fullsized":"2023-08-01T19:54:45.741723+0000","mapping_epoch":16,"log_start":"0'0","ondisk_log_start":"0'0","created":16,"last_epoch_clean":17,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-08-01T19:54:04.040663+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-08-01T19:54:04.040663+0000","last_clean_scrub_stamp":"2023-08-01T19:54:04.040663+0000","objects_scrubbed":0,"log_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-08-02T21:59:19.682560+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[1,0],"acting":[1,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":1,"acting_primary":1,"purged_snaps":[]},{"pgid":"3.1d","version":"17'2","reported_seq":25,"reported_epoch":30,"state":"active+clean","last_fresh":"2023-08-01T19:54:48.985449+0000","last_change":"2023-08-01T19:54:04.065591+0000","last_active":"2023-08-01T19:54:48.985449+0000","last_peered":"2023-08-01T19:54:48.985449+0000","last_clean":"2023-08-01T19:54:48.985449+0000","last_became_active":"2023-08-01T19:54:04.065306+0000","last_became_peered":"2023-08-01T19:54:04.065306+0000","last_unstale":"2023-08-01T19:54:48.985449+0000","last_undegraded":"2023-08-01T19:54:48.985449+0000","last_fullsized":"2023-08-01T19:54:48.985449+0000","mapping_epoch":15,"log_start":"0'0","ondisk_log_start":"0'0","created":15,"last_epoch_clean":16,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-08-01T19:54:03.032665+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-08-01T19:54:03.032665+0000","last_clean_scrub_stamp":"2023-08-01T19:54:03.032665+0000","objects_scrubbed":0,"log_size":2,"ondisk_log_size":2,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-08-02T21:32:10.389227+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":1,"num_object_clones":0,"num_object_copies":2,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":1,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":3,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":1,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[2,1],"acting":[2,1],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":2,"acting_primary":2,"purged_snaps":[]},{"pgid":"4.1a","version":"0'0","reported_seq":21,"reported_epoch":29,"state":"active+clean","last_fresh":"2023-08-01T19:54:45.741686+0000","last_change":"2023-08-01T19:54:04.473302+0000","last_active":"2023-08-01T19:54:45.741686+0000","last_peered":"2023-08-01T19:54:45.741686+0000","last_clean":"2023-08-01T19:54:45.741686+0000","last_became_active":"2023-08-01T19:54:04.472452+0000","last_became_peered":"2023-08-01T19:54:04.472452+0000","last_unstale":"2023-08-01T19:54:45.741686+0000","last_undegraded":"2023-08-01T19:54:45.741686+0000","last_fullsized":"2023-08-01T19:54:45.741686+0000","mapping_epoch":16,"log_start":"0'0","ondisk_log_start":"0'0","created":16,"last_epoch_clean":17,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-08-01T19:54:04.040663+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-08-01T19:54:04.040663+0000","last_clean_scrub_stamp":"2023-08-01T19:54:04.040663+0000","objects_scrubbed":0,"log_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-08-02T21:02:39.542019+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[1,0],"acting":[1,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":1,"acting_primary":1,"purged_snaps":[]},{"pgid":"3.1e","version":"17'1","reported_seq":23,"reported_epoch":29,"state":"active+clean","last_fresh":"2023-08-01T19:54:45.740760+0000","last_change":"2023-08-01T19:54:04.064378+0000","last_active":"2023-08-01T19:54:45.740760+0000","last_peered":"2023-08-01T19:54:45.740760+0000","last_clean":"2023-08-01T19:54:45.740760+0000","last_became_active":"2023-08-01T19:54:04.063988+0000","last_became_peered":"2023-08-01T19:54:04.063988+0000","last_unstale":"2023-08-01T19:54:45.740760+0000","last_undegraded":"2023-08-01T19:54:45.740760+0000","last_fullsized":"2023-08-01T19:54:45.740760+0000","mapping_epoch":15,"log_start":"0'0","ondisk_log_start":"0'0","created":15,"last_epoch_clean":16,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-08-01T19:54:03.032665+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-08-01T19:54:03.032665+0000","last_clean_scrub_stamp":"2023-08-01T19:54:03.032665+0000","objects_scrubbed":0,"log_size":1,"ondisk_log_size":1,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-08-02T22:28:51.936138+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[0,2],"acting":[0,2],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":0,"acting_primary":0,"purged_snaps":[]},{"pgid":"4.19","version":"0'0","reported_seq":22,"reported_epoch":30,"state":"active+clean","last_fresh":"2023-08-01T19:54:48.984831+0000","last_change":"2023-08-01T19:54:04.467017+0000","last_active":"2023-08-01T19:54:48.984831+0000","last_peered":"2023-08-01T19:54:48.984831+0000","last_clean":"2023-08-01T19:54:48.984831+0000","last_became_active":"2023-08-01T19:54:04.466339+0000","last_became_peered":"2023-08-01T19:54:04.466339+0000","last_unstale":"2023-08-01T19:54:48.984831+0000","last_undegraded":"2023-08-01T19:54:48.984831+0000","last_fullsized":"2023-08-01T19:54:48.984831+0000","mapping_epoch":16,"log_start":"0'0","ondisk_log_start":"0'0","created":16,"last_epoch_clean":17,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-08-01T19:54:04.040663+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-08-01T19:54:04.040663+0000","last_clean_scrub_stamp":"2023-08-01T19:54:04.040663+0000","objects_scrubbed":0,"log_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-08-03T04:07:57.222873+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[2,0],"acting":[2,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":2,"acting_primary":2,"purged_snaps":[]},{"pgid":"3.1f","version":"17'4","reported_seq":26,"reported_epoch":29,"state":"active+clean","last_fresh":"2023-08-01T19:54:45.740714+0000","last_change":"2023-08-01T19:54:04.067767+0000","last_active":"2023-08-01T19:54:45.740714+0000","last_peered":"2023-08-01T19:54:45.740714+0000","last_clean":"2023-08-01T19:54:45.740714+0000","last_became_active":"2023-08-01T19:54:04.067414+0000","last_became_peered":"2023-08-01T19:54:04.067414+0000","last_unstale":"2023-08-01T19:54:45.740714+0000","last_undegraded":"2023-08-01T19:54:45.740714+0000","last_fullsized":"2023-08-01T19:54:45.740714+0000","mapping_epoch":15,"log_start":"0'0","ondisk_log_start":"0'0","created":15,"last_epoch_clean":16,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-08-01T19:54:03.032665+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-08-01T19:54:03.032665+0000","last_clean_scrub_stamp":"2023-08-01T19:54:03.032665+0000","objects_scrubbed":0,"log_size":4,"ondisk_log_size":4,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-08-02T21:33:27.007118+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":554,"num_objects":2,"num_object_clones":0,"num_object_copies":4,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":2,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":4,"num_write_kb":1,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":1,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[0,1],"acting":[0,1],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":0,"acting_primary":0,"purged_snaps":[]},{"pgid":"4.18","version":"0'0","reported_seq":21,"reported_epoch":29,"state":"active+clean","last_fresh":"2023-08-01T19:54:45.741634+0000","last_change":"2023-08-01T19:54:04.477588+0000","last_active":"2023-08-01T19:54:45.741634+0000","last_peered":"2023-08-01T19:54:45.741634+0000","last_clean":"2023-08-01T19:54:45.741634+0000","last_became_active":"2023-08-01T19:54:04.476194+0000","last_became_peered":"2023-08-01T19:54:04.476194+0000","last_unstale":"2023-08-01T19:54:45.741634+0000","last_undegraded":"2023-08-01T19:54:45.741634+0000","last_fullsized":"2023-08-01T19:54:45.741634+0000","mapping_epoch":16,"log_start":"0'0","ondisk_log_start":"0'0","created":16,"last_epoch_clean":17,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-08-01T19:54:04.040663+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-08-01T19:54:04.040663+0000","last_clean_scrub_stamp":"2023-08-01T19:54:04.040663+0000","objects_scrubbed":0,"log_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-08-03T03:58:06.360840+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[1,0],"acting":[1,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":1,"acting_primary":1,"purged_snaps":[]},{"pgid":"4.20","version":"0'0","reported_seq":21,"reported_epoch":29,"state":"active+clean","last_fresh":"2023-08-01T19:54:45.741553+0000","last_change":"2023-08-01T19:54:04.477904+0000","last_active":"2023-08-01T19:54:45.741553+0000","last_peered":"2023-08-01T19:54:45.741553+0000","last_clean":"2023-08-01T19:54:45.741553+0000","last_became_active":"2023-08-01T19:54:04.476564+0000","last_became_peered":"2023-08-01T19:54:04.476564+0000","last_unstale":"2023-08-01T19:54:45.741553+0000","last_undegraded":"2023-08-01T19:54:45.741553+0000","last_fullsized":"2023-08-01T19:54:45.741553+0000","mapping_epoch":16,"log_start":"0'0","ondisk_log_start":"0'0","created":16,"last_epoch_clean":17,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-08-01T19:54:04.040663+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-08-01T19:54:04.040663+0000","last_clean_scrub_stamp":"2023-08-01T19:54:04.040663+0000","objects_scrubbed":0,"log_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-08-03T02:21:47.656072+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[1,0],"acting":[1,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":1,"acting_primary":1,"purged_snaps":[]},{"pgid":"4.21","version":"0'0","reported_seq":21,"reported_epoch":29,"state":"active+clean","last_fresh":"2023-08-01T19:54:45.739875+0000","last_change":"2023-08-01T19:54:04.466899+0000","last_active":"2023-08-01T19:54:45.739875+0000","last_peered":"2023-08-01T19:54:45.739875+0000","last_clean":"2023-08-01T19:54:45.739875+0000","last_became_active":"2023-08-01T19:54:04.466500+0000","last_became_peered":"2023-08-01T19:54:04.466500+0000","last_unstale":"2023-08-01T19:54:45.739875+0000","last_undegraded":"2023-08-01T19:54:45.739875+0000","last_fullsized":"2023-08-01T19:54:45.739875+0000","mapping_epoch":16,"log_start":"0'0","ondisk_log_start":"0'0","created":16,"last_epoch_clean":17,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-08-01T19:54:04.040663+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-08-01T19:54:04.040663+0000","last_clean_scrub_stamp":"2023-08-01T19:54:04.040663+0000","objects_scrubbed":0,"log_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-08-03T07:36:38.654701+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[0,2],"acting":[0,2],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":0,"acting_primary":0,"purged_snaps":[]},{"pgid":"4.22","version":"0'0","reported_seq":22,"reported_epoch":30,"state":"active+clean","last_fresh":"2023-08-01T19:54:48.985220+0000","last_change":"2023-08-01T19:54:04.471945+0000","last_active":"2023-08-01T19:54:48.985220+0000","last_peered":"2023-08-01T19:54:48.985220+0000","last_clean":"2023-08-01T19:54:48.985220+0000","last_became_active":"2023-08-01T19:54:04.471371+0000","last_became_peered":"2023-08-01T19:54:04.471371+0000","last_unstale":"2023-08-01T19:54:48.985220+0000","last_undegraded":"2023-08-01T19:54:48.985220+0000","last_fullsized":"2023-08-01T19:54:48.985220+0000","mapping_epoch":16,"log_start":"0'0","ondisk_log_start":"0'0","created":16,"last_epoch_clean":17,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-08-01T19:54:04.040663+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-08-01T19:54:04.040663+0000","last_clean_scrub_stamp":"2023-08-01T19:54:04.040663+0000","objects_scrubbed":0,"log_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-08-02T22:17:59.847819+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[2,1],"acting":[2,1],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":2,"acting_primary":2,"purged_snaps":[]},{"pgid":"4.23","version":"0'0","reported_seq":21,"reported_epoch":29,"state":"active+clean","last_fresh":"2023-08-01T19:54:45.741511+0000","last_change":"2023-08-01T19:54:04.467847+0000","last_active":"2023-08-01T19:54:45.741511+0000","last_peered":"2023-08-01T19:54:45.741511+0000","last_clean":"2023-08-01T19:54:45.741511+0000","last_became_active":"2023-08-01T19:54:04.467111+0000","last_became_peered":"2023-08-01T19:54:04.467111+0000","last_unstale":"2023-08-01T19:54:45.741511+0000","last_undegraded":"2023-08-01T19:54:45.741511+0000","last_fullsized":"2023-08-01T19:54:45.741511+0000","mapping_epoch":16,"log_start":"0'0","ondisk_log_start":"0'0","created":16,"last_epoch_clean":17,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-08-01T19:54:04.040663+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-08-01T19:54:04.040663+0000","last_clean_scrub_stamp":"2023-08-01T19:54:04.040663+0000","objects_scrubbed":0,"log_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-08-03T00:42:19.379348+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[0,2],"acting":[0,2],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":0,"acting_primary":0,"purged_snaps":[]},{"pgid":"4.24","version":"0'0","reported_seq":22,"reported_epoch":30,"state":"active+clean","last_fresh":"2023-08-01T19:54:48.985042+0000","last_change":"2023-08-01T19:54:04.477128+0000","last_active":"2023-08-01T19:54:48.985042+0000","last_peered":"2023-08-01T19:54:48.985042+0000","last_clean":"2023-08-01T19:54:48.985042+0000","last_became_active":"2023-08-01T19:54:04.476819+0000","last_became_peered":"2023-08-01T19:54:04.476819+0000","last_unstale":"2023-08-01T19:54:48.985042+0000","last_undegraded":"2023-08-01T19:54:48.985042+0000","last_fullsized":"2023-08-01T19:54:48.985042+0000","mapping_epoch":16,"log_start":"0'0","ondisk_log_start":"0'0","created":16,"last_epoch_clean":17,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-08-01T19:54:04.040663+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-08-01T19:54:04.040663+0000","last_clean_scrub_stamp":"2023-08-01T19:54:04.040663+0000","objects_scrubbed":0,"log_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-08-03T02:20:23.354054+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[2,1],"acting":[2,1],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":2,"acting_primary":2,"purged_snaps":[]}],"pool_stats":[{"poolid":5,"num_pg":16,"stat_sum":{"num_bytes":4665442304,"num_objects":71189,"num_object_clones":0,"num_object_copies":142378,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":71189,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":71189,"num_write_kb":4556096,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"store_stats":{"total":0,"available":0,"internally_reserved":0,"allocated":581492736,"data_stored":9303883776,"data_compressed":44555104,"data_compressed_allocated":581492736,"data_compressed_original":9303883776,"omap_allocated":0,"internal_metadata":0},"log_size":60589,"ondisk_log_size":60589,"up":32,"acting":32,"num_store_stats":3},{"poolid":4,"num_pg":64,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"store_stats":{"total":0,"available":0,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},"log_size":0,"ondisk_log_size":0,"up":128,"acting":128,"num_store_stats":3},{"poolid":3,"num_pg":32,"stat_sum":{"num_bytes":2306,"num_objects":22,"num_object_clones":0,"num_object_copies":44,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":22,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":45,"num_write_kb":13,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":14,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"store_stats":{"total":0,"available":0,"internally_reserved":0,"allocated":65536,"data_stored":4612,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},"log_size":39,"ondisk_log_size":39,"up":64,"acting":64,"num_store_stats":3},{"poolid":1,"num_pg":1,"stat_sum":{"num_bytes":590368,"num_objects":2,"num_object_clones":0,"num_object_copies":4,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":2,"num_whiteouts":0,"num_read":136,"num_read_kb":118,"num_write":203,"num_write_kb":3460,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"store_stats":{"total":0,"available":0,"internally_reserved":0,"allocated":114688,"data_stored":1180736,"data_compressed":20662,"data_compressed_allocated":73728,"data_compressed_original":1146880,"omap_allocated":0,"internal_metadata":0},"log_size":157,"ondisk_log_size":157,"up":2,"acting":2,"num_store_stats":2},{"poolid":2,"num_pg":8,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"store_stats":{"total":0,"available":0,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},"log_size":0,"ondisk_log_size":0,"up":16,"acting":16,"num_store_stats":3}],"osd_stats":[{"osd":2,"up_from":9,"seq":38654705680,"num_pgs":76,"num_osds":1,"num_per_pool_osds":1,"num_per_pool_omap_osds":1,"kb":94371840,"kb_used":215428,"kb_used_data":158972,"kb_used_omap":0,"kb_used_meta":56448,"kb_avail":94156412,"statfs":{"total":96636764160,"available":96416165888,"internally_reserved":0,"allocated":162787328,"data_stored":2599139938,"data_compressed":12453822,"data_compressed_allocated":162439168,"data_compressed_original":2599010304,"omap_allocated":0,"internal_metadata":57802752},"hb_peers":[0,1],"snap_trim_queue_len":0,"num_snap_trimming":0,"num_shards_repaired":0,"op_queue_age_hist":{"histogram":[0,1,3,4,2],"upper_bound":32},"perf_stat":{"commit_latency_ms":2,"apply_latency_ms":2,"commit_latency_ns":2000000,"apply_latency_ns":2000000},"alerts":[],"network_ping_times":[{"osd":0,"last update":"Thu Jan 1 00:00:00 1970","interfaces":[{"interface":"back","average":{"1min":0,"5min":0,"15min":0},"min":{"1min":0,"5min":0,"15min":0},"max":{"1min":0,"5min":0,"15min":0},"last":0.28399999999999997}]},{"osd":1,"last update":"Thu Jan 1 00:00:00 1970","interfaces":[{"interface":"back","average":{"1min":0,"5min":0,"15min":0},"min":{"1min":0,"5min":0,"15min":0},"max":{"1min":0,"5min":0,"15min":0},"last":0.219}]}]},{"osd":0,"up_from":8,"seq":34359738383,"num_pgs":85,"num_osds":1,"num_per_pool_osds":1,"num_per_pool_omap_osds":1,"kb":94371840,"kb_used":292616,"kb_used_data":224704,"kb_used_omap":0,"kb_used_meta":67904,"kb_avail":94079224,"statfs":{"total":96636764160,"available":96337125376,"internally_reserved":0,"allocated":230096896,"data_stored":3676681176,"data_compressed":17606345,"data_compressed_allocated":229785600,"data_compressed_original":3676569600,"omap_allocated":0,"internal_metadata":69533696},"hb_peers":[1,2],"snap_trim_queue_len":0,"num_snap_trimming":0,"num_shards_repaired":0,"op_queue_age_hist":{"histogram":[],"upper_bound":1},"perf_stat":{"commit_latency_ms":3,"apply_latency_ms":3,"commit_latency_ns":3000000,"apply_latency_ns":3000000},"alerts":[],"network_ping_times":[{"osd":1,"last update":"Tue Aug 1 19:54:49 2023","interfaces":[{"interface":"back","average":{"1min":0.36299999999999999,"5min":0.36299999999999999,"15min":0.36299999999999999},"min":{"1min":0.17699999999999999,"5min":0.17699999999999999,"15min":0.17699999999999999},"max":{"1min":0.63700000000000001,"5min":0.63700000000000001,"15min":0.63700000000000001},"last":0.19900000000000001},{"interface":"front","average":{"1min":0.39600000000000002,"5min":0.39600000000000002,"15min":0.39600000000000002},"min":{"1min":0.215,"5min":0.215,"15min":0.215},"max":{"1min":0.76000000000000001,"5min":0.76000000000000001,"15min":0.76000000000000001},"last":0.27200000000000002}]},{"osd":2,"last update":"Thu Jan 1 00:00:00 1970","interfaces":[{"interface":"back","average":{"1min":0,"5min":0,"15min":0},"min":{"1min":0,"5min":0,"15min":0},"max":{"1min":0,"5min":0,"15min":0},"last":0.31}]}]},{"osd":1,"up_from":8,"seq":34359738382,"num_pgs":81,"num_osds":1,"num_per_pool_osds":1,"num_per_pool_omap_osds":1,"kb":94371840,"kb_used":232728,"kb_used_data":172752,"kb_used_omap":0,"kb_used_meta":59968,"kb_avail":94139112,"statfs":{"total":96636764160,"available":96398450688,"internally_reserved":0,"allocated":176898048,"data_stored":2824780974,"data_compressed":13534349,"data_compressed_allocated":176541696,"data_compressed_original":2824650752,"omap_allocated":0,"internal_metadata":61407232},"hb_peers":[0,2],"snap_trim_queue_len":0,"num_snap_trimming":0,"num_shards_repaired":0,"op_queue_age_hist":{"histogram":[],"upper_bound":1},"perf_stat":{"commit_latency_ms":3,"apply_latency_ms":3,"commit_latency_ns":3000000,"apply_latency_ns":3000000},"alerts":[],"network_ping_times":[{"osd":0,"last update":"Tue Aug 1 19:54:49 2023","interfaces":[{"interface":"back","average":{"1min":0.63900000000000001,"5min":0.63900000000000001,"15min":0.63900000000000001},"min":{"1min":0.17299999999999999,"5min":0.17299999999999999,"15min":0.17299999999999999},"max":{"1min":2.1709999999999998,"5min":2.1709999999999998,"15min":2.1709999999999998},"last":2.1709999999999998},{"interface":"front","average":{"1min":0.36699999999999999,"5min":0.36699999999999999,"15min":0.36699999999999999},"min":{"1min":0.193,"5min":0.193,"15min":0.193},"max":{"1min":0.65600000000000003,"5min":0.65600000000000003,"15min":0.65600000000000003},"last":0.193}]},{"osd":2,"last update":"Thu Jan 1 00:00:00 1970","interfaces":[{"interface":"back","average":{"1min":0,"5min":0,"15min":0},"min":{"1min":0,"5min":0,"15min":0},"max":{"1min":0,"5min":0,"15min":0},"last":0.219}]}]}],"pool_statfs":[{"poolid":1,"osd":1,"total":0,"available":0,"internally_reserved":0,"allocated":57344,"data_stored":590368,"data_compressed":10331,"data_compressed_allocated":36864,"data_compressed_original":573440,"omap_allocated":0,"internal_metadata":0},{"poolid":1,"osd":2,"total":0,"available":0,"internally_reserved":0,"allocated":57344,"data_stored":590368,"data_compressed":10331,"data_compressed_allocated":36864,"data_compressed_original":573440,"omap_allocated":0,"internal_metadata":0},{"poolid":2,"osd":0,"total":0,"available":0,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":2,"osd":1,"total":0,"available":0,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":2,"osd":2,"total":0,"available":0,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":3,"osd":0,"total":0,"available":0,"internally_reserved":0,"allocated":8192,"data_stored":588,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":3,"osd":1,"total":0,"available":0,"internally_reserved":0,"allocated":32768,"data_stored":2306,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":3,"osd":2,"total":0,"available":0,"internally_reserved":0,"allocated":24576,"data_stored":1718,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":4,"osd":0,"total":0,"available":0,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":4,"osd":1,"total":0,"available":0,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":4,"osd":2,"total":0,"available":0,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":5,"osd":0,"total":0,"available":0,"internally_reserved":0,"allocated":234168320,"data_stored":3746693120,"data_compressed":17942325,"data_compressed_allocated":234168320,"data_compressed_original":3746693120,"omap_allocated":0,"internal_metadata":0},{"poolid":5,"osd":1,"total":0,"available":0,"internally_reserved":0,"allocated":180731904,"data_stored":2891710464,"data_compressed":13848066,"data_compressed_allocated":180731904,"data_compressed_original":2891710464,"omap_allocated":0,"internal_metadata":0},{"poolid":5,"osd":2,"total":0,"available":0,"internally_reserved":0,"allocated":166592512,"data_stored":2665480192,"data_compressed":12764713,"data_compressed_allocated":166592512,"data_compressed_original":2665480192,"omap_allocated":0,"internal_metadata":0}]}} 2023-08-01T19:54:53.824 INFO:tasks.ceph.ceph_manager.ceph:recovered! 2023-08-01T19:54:53.824 INFO:tasks.thrashosds.thrasher:choose_action: min_in 4 min_out 0 min_live 2 min_dead 0 chance_down 1.00 2023-08-01T19:54:53.825 INFO:tasks.thrashosds.thrasher:inject_pause on osd.0 2023-08-01T19:54:53.825 INFO:tasks.thrashosds.thrasher:Testing filestore_inject_stall pause injection for duration 3 2023-08-01T19:54:53.825 INFO:tasks.thrashosds.thrasher:Checking after 0, should_be_down=False 2023-08-01T19:54:53.825 DEBUG:teuthology.orchestra.run.smithi008:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 0 ceph --cluster ceph --admin-daemon /var/run/ceph/ceph-osd.0.asok config set filestore_inject_stall 3 2023-08-01T19:54:53.886 INFO:tasks.ceph.osd.2.smithi155.stderr:2023-08-01T19:54:53.885+0000 7faa5c6ac700 -1 received signal: Hangup from /usr/bin/python3 /bin/daemon-helper kill ceph-osd -f --cluster ceph -i 2 (PID: 111337) UID: 0 2023-08-01T19:54:53.925 INFO:teuthology.orchestra.run.smithi155.stdout:ERROR: (22) Invalid argument 2023-08-01T19:54:53.926 INFO:teuthology.orchestra.run.smithi155.stdout:op_tracker tracking is not enabled now, so no ops are tracked currently, even those get stuck. Please enable "osd_enable_op_tracker", and the tracker will start to track new ops received afterwards. 2023-08-01T19:54:53.939 DEBUG:teuthology.orchestra.run.smithi155:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 30 ceph --cluster ceph --admin-daemon /var/run/ceph/ceph-osd.2.asok dump_historic_ops 2023-08-01T19:54:54.009 INFO:teuthology.orchestra.run.smithi008.stdout:{ 2023-08-01T19:54:54.009 INFO:teuthology.orchestra.run.smithi008.stdout: "success": "filestore_inject_stall = '3' (not observed, change may require restart) " 2023-08-01T19:54:54.009 INFO:teuthology.orchestra.run.smithi008.stdout:} 2023-08-01T19:54:54.021 INFO:tasks.ceph.osd.2.smithi155.stderr:2023-08-01T19:54:54.020+0000 7faa5c6ac700 -1 received signal: Hangup from /usr/bin/python3 /bin/daemon-helper kill ceph-osd -f --cluster ceph -i 2 (PID: 111337) UID: 0 2023-08-01T19:54:54.088 INFO:tasks.ceph.osd.0.smithi008.stderr:2023-08-01T19:54:54.088+0000 7f16a58f4700 -1 received signal: Hangup from /usr/bin/python3 /bin/daemon-helper kill ceph-osd -f --cluster ceph -i 0 (PID: 111179) UID: 0 2023-08-01T19:54:54.149 INFO:teuthology.orchestra.run.smithi155.stdout:ERROR: (22) Invalid argument 2023-08-01T19:54:54.149 INFO:teuthology.orchestra.run.smithi155.stdout:op_tracker tracking is not enabled now, so no ops are tracked currently, even those get stuck. Please enable "osd_enable_op_tracker", and the tracker will start to track new ops received afterwards. 2023-08-01T19:54:54.162 DEBUG:teuthology.orchestra.run.smithi008:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 30 ceph --cluster ceph --admin-daemon /var/run/ceph/ceph-osd.0.asok dump_ops_in_flight 2023-08-01T19:54:54.202 INFO:tasks.ceph.osd.2.smithi155.stderr:2023-08-01T19:54:54.201+0000 7faa5c6ac700 -1 received signal: Hangup from /usr/bin/python3 /bin/daemon-helper kill ceph-osd -f --cluster ceph -i 2 (PID: 111337) UID: 0 2023-08-01T19:54:54.215 DEBUG:teuthology.orchestra.run.smithi006:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 120 ceph --cluster ceph osd unset nodeep-scrub 2023-08-01T19:54:54.290 INFO:tasks.ceph.osd.0.smithi008.stderr:2023-08-01T19:54:54.289+0000 7f16a58f4700 -1 received signal: Hangup from /usr/bin/python3 /bin/daemon-helper kill ceph-osd -f --cluster ceph -i 0 (PID: 111179) UID: 0 2023-08-01T19:54:54.315 INFO:tasks.radosbench.radosbench.0.smithi006.stdout: 30 16 79087 79071 164.718 122.625 0.00878866 0.00606801 2023-08-01T19:54:54.362 INFO:teuthology.orchestra.run.smithi008.stdout:ERROR: (22) Invalid argument 2023-08-01T19:54:54.362 INFO:teuthology.orchestra.run.smithi008.stdout:op_tracker tracking is not enabled now, so no ops are tracked currently, even those get stuck. Please enable "osd_enable_op_tracker", and the tracker will start to track new ops received afterwards. 2023-08-01T19:54:54.379 DEBUG:teuthology.orchestra.run.smithi008:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 30 ceph --cluster ceph --admin-daemon /var/run/ceph/ceph-osd.0.asok dump_blocked_ops 2023-08-01T19:54:54.391 INFO:tasks.ceph.osd.2.smithi155.stderr:2023-08-01T19:54:54.389+0000 7faa5c6ac700 -1 received signal: Hangup from /usr/bin/python3 /bin/daemon-helper kill ceph-osd -f --cluster ceph -i 2 (PID: 111337) UID: 0 2023-08-01T19:54:54.480 DEBUG:teuthology.orchestra.run.smithi006:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 120 ceph --cluster ceph -- tell 'osd.*' injectargs --osd_enable_op_tracker=true 2023-08-01T19:54:54.491 INFO:tasks.ceph.osd.1.smithi101.stderr:2023-08-01T19:54:54.490+0000 7fb0cb7f6700 -1 received signal: Hangup from /usr/bin/python3 /bin/daemon-helper kill ceph-osd -f --cluster ceph -i 1 (PID: 111141) UID: 0 2023-08-01T19:54:54.592 INFO:tasks.ceph.osd.2.smithi155.stderr:2023-08-01T19:54:54.590+0000 7faa5c6ac700 -1 received signal: Hangup from /usr/bin/python3 /bin/daemon-helper kill ceph-osd -f --cluster ceph -i 2 (PID: 111337) UID: 0 2023-08-01T19:54:54.606 INFO:teuthology.orchestra.run.smithi008.stdout:ERROR: (22) Invalid argument 2023-08-01T19:54:54.606 INFO:teuthology.orchestra.run.smithi008.stdout:op_tracker tracking is not enabled now, so no ops are tracked currently, even those get stuck. Please enable "osd_enable_op_tracker", and the tracker will start to track new ops received afterwards. 2023-08-01T19:54:54.621 DEBUG:teuthology.orchestra.run.smithi008:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 30 ceph --cluster ceph --admin-daemon /var/run/ceph/ceph-osd.0.asok dump_historic_ops 2023-08-01T19:54:54.630 INFO:teuthology.orchestra.run.smithi006.stdout:osd.0: {} 2023-08-01T19:54:54.649 INFO:teuthology.orchestra.run.smithi006.stdout:osd.1: {} 2023-08-01T19:54:54.668 INFO:teuthology.orchestra.run.smithi006.stdout:osd.2: {} 2023-08-01T19:54:54.669 INFO:teuthology.orchestra.run.smithi006.stderr:osd.0: osd_enable_op_tracker = 'true' 2023-08-01T19:54:54.670 INFO:teuthology.orchestra.run.smithi006.stderr:osd.1: osd_enable_op_tracker = 'true' 2023-08-01T19:54:54.670 INFO:teuthology.orchestra.run.smithi006.stderr:osd.2: osd_enable_op_tracker = 'true' 2023-08-01T19:54:54.693 INFO:tasks.ceph.osd.2.smithi155.stderr:2023-08-01T19:54:54.691+0000 7faa5c6ac700 -1 received signal: Hangup from /usr/bin/python3 /bin/daemon-helper kill ceph-osd -f --cluster ceph -i 2 (PID: 111337) UID: 0 2023-08-01T19:54:54.794 INFO:tasks.ceph.osd.0.smithi008.stderr:2023-08-01T19:54:54.793+0000 7f16a58f4700 -1 received signal: Hangup from /usr/bin/python3 /bin/daemon-helper kill ceph-osd -f --cluster ceph -i 0 (PID: 111179) UID: 0 2023-08-01T19:54:54.811 INFO:teuthology.orchestra.run.smithi008.stdout:{ 2023-08-01T19:54:54.811 INFO:teuthology.orchestra.run.smithi008.stdout: "size": 20, 2023-08-01T19:54:54.811 INFO:teuthology.orchestra.run.smithi008.stdout: "duration": 600, 2023-08-01T19:54:54.812 INFO:teuthology.orchestra.run.smithi008.stdout: "ops": [ 2023-08-01T19:54:54.812 INFO:teuthology.orchestra.run.smithi008.stdout: { 2023-08-01T19:54:54.812 INFO:teuthology.orchestra.run.smithi008.stdout: "description": "osd_op(client.4668.0:18360 5.6 5:65d8e237:::benchmark_data_smithi006_114134_object18359:head [set-alloc-hint object_size 65536 write_size 65536,write 0~65536] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e23)", 2023-08-01T19:54:54.812 INFO:teuthology.orchestra.run.smithi008.stdout: "initiated_at": "2023-08-01T19:54:28.994296+0000", 2023-08-01T19:54:54.812 INFO:teuthology.orchestra.run.smithi008.stdout: "age": 25.814077887, 2023-08-01T19:54:54.812 INFO:teuthology.orchestra.run.smithi008.stdout: "duration": 0.017459669000000001, 2023-08-01T19:54:54.812 INFO:teuthology.orchestra.run.smithi008.stdout: "type_data": { 2023-08-01T19:54:54.813 INFO:teuthology.orchestra.run.smithi008.stdout: "flag_point": "commit sent; apply or cleanup", 2023-08-01T19:54:54.813 INFO:teuthology.orchestra.run.smithi008.stdout: "client_info": { 2023-08-01T19:54:54.813 INFO:teuthology.orchestra.run.smithi008.stdout: "client": "client.4668", 2023-08-01T19:54:54.813 INFO:teuthology.orchestra.run.smithi008.stdout: "client_addr": "172.21.15.6:0/1709472247", 2023-08-01T19:54:54.813 INFO:teuthology.orchestra.run.smithi008.stdout: "tid": 18360 2023-08-01T19:54:54.813 INFO:teuthology.orchestra.run.smithi008.stdout: }, 2023-08-01T19:54:54.813 INFO:teuthology.orchestra.run.smithi008.stdout: "events": [ 2023-08-01T19:54:54.814 INFO:teuthology.orchestra.run.smithi008.stdout: { 2023-08-01T19:54:54.814 INFO:teuthology.orchestra.run.smithi008.stdout: "event": "initiated", 2023-08-01T19:54:54.814 INFO:teuthology.orchestra.run.smithi008.stdout: "time": "2023-08-01T19:54:28.994296+0000", 2023-08-01T19:54:54.814 INFO:teuthology.orchestra.run.smithi008.stdout: "duration": 0 2023-08-01T19:54:54.814 INFO:teuthology.orchestra.run.smithi008.stdout: }, 2023-08-01T19:54:54.814 INFO:teuthology.orchestra.run.smithi008.stdout: { 2023-08-01T19:54:54.814 INFO:teuthology.orchestra.run.smithi008.stdout: "event": "throttled", 2023-08-01T19:54:54.814 INFO:teuthology.orchestra.run.smithi008.stdout: "time": "2023-08-01T19:54:28.994296+0000", 2023-08-01T19:54:54.815 INFO:teuthology.orchestra.run.smithi008.stdout: "duration": 0 2023-08-01T19:54:54.815 INFO:teuthology.orchestra.run.smithi008.stdout: }, 2023-08-01T19:54:54.815 INFO:teuthology.orchestra.run.smithi008.stdout: { 2023-08-01T19:54:54.815 INFO:teuthology.orchestra.run.smithi008.stdout: "event": "header_read", 2023-08-01T19:54:54.815 INFO:teuthology.orchestra.run.smithi008.stdout: "time": "2023-08-01T19:54:28.994295+0000", 2023-08-01T19:54:54.815 INFO:teuthology.orchestra.run.smithi008.stdout: "duration": 4294967295.9999995 2023-08-01T19:54:54.815 INFO:teuthology.orchestra.run.smithi008.stdout: }, 2023-08-01T19:54:54.815 INFO:teuthology.orchestra.run.smithi008.stdout: { 2023-08-01T19:54:54.816 INFO:teuthology.orchestra.run.smithi008.stdout: "event": "all_read", 2023-08-01T19:54:54.816 INFO:teuthology.orchestra.run.smithi008.stdout: "time": "2023-08-01T19:54:28.994381+0000", 2023-08-01T19:54:54.816 INFO:teuthology.orchestra.run.smithi008.stdout: "duration": 8.6055000000000002e-05 2023-08-01T19:54:54.816 INFO:teuthology.orchestra.run.smithi008.stdout: }, 2023-08-01T19:54:54.816 INFO:teuthology.orchestra.run.smithi008.stdout: { 2023-08-01T19:54:54.816 INFO:teuthology.orchestra.run.smithi008.stdout: "event": "dispatched", 2023-08-01T19:54:54.816 INFO:teuthology.orchestra.run.smithi008.stdout: "time": "2023-08-01T19:54:28.994390+0000", 2023-08-01T19:54:54.817 INFO:teuthology.orchestra.run.smithi008.stdout: "duration": 8.7530000000000007e-06 2023-08-01T19:54:54.817 INFO:teuthology.orchestra.run.smithi008.stdout: }, 2023-08-01T19:54:54.817 INFO:teuthology.orchestra.run.smithi008.stdout: { 2023-08-01T19:54:54.817 INFO:teuthology.orchestra.run.smithi008.stdout: "event": "queued_for_pg", 2023-08-01T19:54:54.817 INFO:teuthology.orchestra.run.smithi008.stdout: "time": "2023-08-01T19:54:28.994394+0000", 2023-08-01T19:54:54.817 INFO:teuthology.orchestra.run.smithi008.stdout: "duration": 3.4929999999999998e-06 2023-08-01T19:54:54.817 INFO:teuthology.orchestra.run.smithi008.stdout: }, 2023-08-01T19:54:54.817 INFO:teuthology.orchestra.run.smithi008.stdout: { 2023-08-01T19:54:54.818 INFO:teuthology.orchestra.run.smithi008.stdout: "event": "reached_pg", 2023-08-01T19:54:54.818 INFO:teuthology.orchestra.run.smithi008.stdout: "time": "2023-08-01T19:54:28.995799+0000", 2023-08-01T19:54:54.818 INFO:teuthology.orchestra.run.smithi008.stdout: "duration": 0.001405779 2023-08-01T19:54:54.818 INFO:teuthology.orchestra.run.smithi008.stdout: }, 2023-08-01T19:54:54.818 INFO:teuthology.orchestra.run.smithi008.stdout: { 2023-08-01T19:54:54.818 INFO:teuthology.orchestra.run.smithi008.stdout: "event": "started", 2023-08-01T19:54:54.818 INFO:teuthology.orchestra.run.smithi008.stdout: "time": "2023-08-01T19:54:28.995896+0000", 2023-08-01T19:54:54.819 INFO:teuthology.orchestra.run.smithi008.stdout: "duration": 9.6597999999999999e-05 2023-08-01T19:54:54.819 INFO:teuthology.orchestra.run.smithi008.stdout: }, 2023-08-01T19:54:54.819 INFO:teuthology.orchestra.run.smithi008.stdout: { 2023-08-01T19:54:54.819 INFO:teuthology.orchestra.run.smithi008.stdout: "event": "waiting for subops from 1", 2023-08-01T19:54:54.819 INFO:teuthology.orchestra.run.smithi008.stdout: "time": "2023-08-01T19:54:28.995985+0000", 2023-08-01T19:54:54.819 INFO:teuthology.orchestra.run.smithi008.stdout: "duration": 8.8479000000000004e-05 2023-08-01T19:54:54.819 INFO:teuthology.orchestra.run.smithi008.stdout: }, 2023-08-01T19:54:54.819 INFO:teuthology.orchestra.run.smithi008.stdout: { 2023-08-01T19:54:54.820 INFO:teuthology.orchestra.run.smithi008.stdout: "event": "op_commit", 2023-08-01T19:54:54.820 INFO:teuthology.orchestra.run.smithi008.stdout: "time": "2023-08-01T19:54:28.997700+0000", 2023-08-01T19:54:54.820 INFO:teuthology.orchestra.run.smithi008.stdout: "duration": 0.001714997 2023-08-01T19:54:54.820 INFO:teuthology.orchestra.run.smithi008.stdout: }, 2023-08-01T19:54:54.820 INFO:teuthology.orchestra.run.smithi008.stdout: { 2023-08-01T19:54:54.820 INFO:teuthology.orchestra.run.smithi008.stdout: "event": "sub_op_commit_rec", 2023-08-01T19:54:54.820 INFO:teuthology.orchestra.run.smithi008.stdout: "time": "2023-08-01T19:54:29.011671+0000", 2023-08-01T19:54:54.820 INFO:teuthology.orchestra.run.smithi008.stdout: "duration": 0.0139712 2023-08-01T19:54:54.821 INFO:teuthology.orchestra.run.smithi008.stdout: }, 2023-08-01T19:54:54.821 INFO:teuthology.orchestra.run.smithi008.stdout: { 2023-08-01T19:54:54.821 INFO:teuthology.orchestra.run.smithi008.stdout: "event": "commit_sent", 2023-08-01T19:54:54.821 INFO:teuthology.orchestra.run.smithi008.stdout: "time": "2023-08-01T19:54:29.011719+0000", 2023-08-01T19:54:54.821 INFO:teuthology.orchestra.run.smithi008.stdout: "duration": 4.8025000000000002e-05 2023-08-01T19:54:54.821 INFO:teuthology.orchestra.run.smithi008.stdout: }, 2023-08-01T19:54:54.821 INFO:teuthology.orchestra.run.smithi008.stdout: { 2023-08-01T19:54:54.821 INFO:teuthology.orchestra.run.smithi008.stdout: "event": "done", 2023-08-01T19:54:54.822 INFO:teuthology.orchestra.run.smithi008.stdout: "time": "2023-08-01T19:54:29.011756+0000", 2023-08-01T19:54:54.822 INFO:teuthology.orchestra.run.smithi008.stdout: "duration": 3.6825000000000001e-05 2023-08-01T19:54:54.822 INFO:teuthology.orchestra.run.smithi008.stdout: } 2023-08-01T19:54:54.822 INFO:teuthology.orchestra.run.smithi008.stdout: ] 2023-08-01T19:54:54.822 INFO:teuthology.orchestra.run.smithi008.stdout: } 2023-08-01T19:54:54.822 INFO:teuthology.orchestra.run.smithi008.stdout: }, 2023-08-01T19:54:54.822 INFO:teuthology.orchestra.run.smithi008.stdout: { 2023-08-01T19:54:54.823 INFO:teuthology.orchestra.run.smithi008.stdout: "description": "osd_op(client.4668.0:18361 5.6 5:65a8a093:::benchmark_data_smithi006_114134_object18360:head [set-alloc-hint object_size 65536 write_size 65536,write 0~65536] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e23)", 2023-08-01T19:54:54.823 INFO:teuthology.orchestra.run.smithi008.stdout: "initiated_at": "2023-08-01T19:54:28.994398+0000", 2023-08-01T19:54:54.823 INFO:teuthology.orchestra.run.smithi008.stdout: "age": 25.813976027999999, 2023-08-01T19:54:54.823 INFO:teuthology.orchestra.run.smithi008.stdout: "duration": 0.017435484000000001, 2023-08-01T19:54:54.823 INFO:teuthology.orchestra.run.smithi008.stdout: "type_data": { 2023-08-01T19:54:54.823 INFO:teuthology.orchestra.run.smithi008.stdout: "flag_point": "commit sent; apply or cleanup", 2023-08-01T19:54:54.823 INFO:teuthology.orchestra.run.smithi008.stdout: "client_info": { 2023-08-01T19:54:54.823 INFO:teuthology.orchestra.run.smithi008.stdout: "client": "client.4668", 2023-08-01T19:54:54.824 INFO:teuthology.orchestra.run.smithi008.stdout: "client_addr": "172.21.15.6:0/1709472247", 2023-08-01T19:54:54.824 INFO:teuthology.orchestra.run.smithi008.stdout: "tid": 18361 2023-08-01T19:54:54.824 INFO:teuthology.orchestra.run.smithi008.stdout: }, 2023-08-01T19:54:54.824 INFO:teuthology.orchestra.run.smithi008.stdout: "events": [ 2023-08-01T19:54:54.824 INFO:teuthology.orchestra.run.smithi008.stdout: { 2023-08-01T19:54:54.824 INFO:teuthology.orchestra.run.smithi008.stdout: "event": "initiated", 2023-08-01T19:54:54.824 INFO:teuthology.orchestra.run.smithi008.stdout: "time": "2023-08-01T19:54:28.994398+0000", 2023-08-01T19:54:54.825 INFO:teuthology.orchestra.run.smithi008.stdout: "duration": 0 2023-08-01T19:54:54.825 INFO:teuthology.orchestra.run.smithi008.stdout: }, 2023-08-01T19:54:54.825 INFO:teuthology.orchestra.run.smithi008.stdout: { 2023-08-01T19:54:54.825 INFO:teuthology.orchestra.run.smithi008.stdout: "event": "throttled", 2023-08-01T19:54:54.825 INFO:teuthology.orchestra.run.smithi008.stdout: "time": "2023-08-01T19:54:28.994398+0000", 2023-08-01T19:54:54.825 INFO:teuthology.orchestra.run.smithi008.stdout: "duration": 0 2023-08-01T19:54:54.825 INFO:teuthology.orchestra.run.smithi008.stdout: }, 2023-08-01T19:54:54.825 INFO:teuthology.orchestra.run.smithi008.stdout: { 2023-08-01T19:54:54.826 INFO:teuthology.orchestra.run.smithi008.stdout: "event": "header_read", 2023-08-01T19:54:54.826 INFO:teuthology.orchestra.run.smithi008.stdout: "time": "2023-08-01T19:54:28.994397+0000", 2023-08-01T19:54:54.826 INFO:teuthology.orchestra.run.smithi008.stdout: "duration": 4294967295.9999995 2023-08-01T19:54:54.826 INFO:teuthology.orchestra.run.smithi008.stdout: }, 2023-08-01T19:54:54.826 INFO:teuthology.orchestra.run.smithi008.stdout: { 2023-08-01T19:54:54.826 INFO:teuthology.orchestra.run.smithi008.stdout: "event": "all_read", 2023-08-01T19:54:54.826 INFO:teuthology.orchestra.run.smithi008.stdout: "time": "2023-08-01T19:54:28.994475+0000", 2023-08-01T19:54:54.826 INFO:teuthology.orchestra.run.smithi008.stdout: "duration": 7.7408000000000002e-05 2023-08-01T19:54:54.827 INFO:teuthology.orchestra.run.smithi008.stdout: }, 2023-08-01T19:54:54.827 INFO:teuthology.orchestra.run.smithi008.stdout: { 2023-08-01T19:54:54.827 INFO:teuthology.orchestra.run.smithi008.stdout: "event": "dispatched", 2023-08-01T19:54:54.827 INFO:teuthology.orchestra.run.smithi008.stdout: "time": "2023-08-01T19:54:28.994480+0000", 2023-08-01T19:54:54.827 INFO:teuthology.orchestra.run.smithi008.stdout: "duration": 5.3589999999999999e-06 2023-08-01T19:54:54.827 INFO:teuthology.orchestra.run.smithi008.stdout: }, 2023-08-01T19:54:54.827 INFO:teuthology.orchestra.run.smithi008.stdout: { 2023-08-01T19:54:54.827 INFO:teuthology.orchestra.run.smithi008.stdout: "event": "queued_for_pg", 2023-08-01T19:54:54.828 INFO:teuthology.orchestra.run.smithi008.stdout: "time": "2023-08-01T19:54:28.994484+0000", 2023-08-01T19:54:54.828 INFO:teuthology.orchestra.run.smithi008.stdout: "duration": 3.9750000000000001e-06 2023-08-01T19:54:54.828 INFO:teuthology.orchestra.run.smithi008.stdout: }, 2023-08-01T19:54:54.828 INFO:teuthology.orchestra.run.smithi008.stdout: { 2023-08-01T19:54:54.828 INFO:teuthology.orchestra.run.smithi008.stdout: "event": "reached_pg", 2023-08-01T19:54:54.828 INFO:teuthology.orchestra.run.smithi008.stdout: "time": "2023-08-01T19:54:28.996504+0000", 2023-08-01T19:54:54.828 INFO:teuthology.orchestra.run.smithi008.stdout: "duration": 0.0020198550000000001 2023-08-01T19:54:54.829 INFO:teuthology.orchestra.run.smithi008.stdout: }, 2023-08-01T19:54:54.829 INFO:teuthology.orchestra.run.smithi008.stdout: { 2023-08-01T19:54:54.829 INFO:teuthology.orchestra.run.smithi008.stdout: "event": "started", 2023-08-01T19:54:54.829 INFO:teuthology.orchestra.run.smithi008.stdout: "time": "2023-08-01T19:54:28.996624+0000", 2023-08-01T19:54:54.829 INFO:teuthology.orchestra.run.smithi008.stdout: "duration": 0.000120118 2023-08-01T19:54:54.829 INFO:teuthology.orchestra.run.smithi008.stdout: }, 2023-08-01T19:54:54.829 INFO:teuthology.orchestra.run.smithi008.stdout: { 2023-08-01T19:54:54.829 INFO:teuthology.orchestra.run.smithi008.stdout: "event": "waiting for subops from 1", 2023-08-01T19:54:54.830 INFO:teuthology.orchestra.run.smithi008.stdout: "time": "2023-08-01T19:54:28.996790+0000", 2023-08-01T19:54:54.830 INFO:teuthology.orchestra.run.smithi008.stdout: "duration": 0.000165398 2023-08-01T19:54:54.830 INFO:teuthology.orchestra.run.smithi008.stdout: }, 2023-08-01T19:54:54.830 INFO:teuthology.orchestra.run.smithi008.stdout: { 2023-08-01T19:54:54.830 INFO:teuthology.orchestra.run.smithi008.stdout: "event": "op_commit", 2023-08-01T19:54:54.830 INFO:teuthology.orchestra.run.smithi008.stdout: "time": "2023-08-01T19:54:28.999061+0000", 2023-08-01T19:54:54.830 INFO:teuthology.orchestra.run.smithi008.stdout: "duration": 0.0022714800000000002 2023-08-01T19:54:54.830 INFO:teuthology.orchestra.run.smithi008.stdout: }, 2023-08-01T19:54:54.831 INFO:teuthology.orchestra.run.smithi008.stdout: { 2023-08-01T19:54:54.831 INFO:teuthology.orchestra.run.smithi008.stdout: "event": "sub_op_commit_rec", 2023-08-01T19:54:54.831 INFO:teuthology.orchestra.run.smithi008.stdout: "time": "2023-08-01T19:54:29.011788+0000", 2023-08-01T19:54:54.831 INFO:teuthology.orchestra.run.smithi008.stdout: "duration": 0.012726774999999999 2023-08-01T19:54:54.831 INFO:teuthology.orchestra.run.smithi008.stdout: }, 2023-08-01T19:54:54.831 INFO:teuthology.orchestra.run.smithi008.stdout: { 2023-08-01T19:54:54.831 INFO:teuthology.orchestra.run.smithi008.stdout: "event": "commit_sent", 2023-08-01T19:54:54.831 INFO:teuthology.orchestra.run.smithi008.stdout: "time": "2023-08-01T19:54:29.011815+0000", 2023-08-01T19:54:54.832 INFO:teuthology.orchestra.run.smithi008.stdout: "duration": 2.7032000000000001e-05 2023-08-01T19:54:54.832 INFO:teuthology.orchestra.run.smithi008.stdout: }, 2023-08-01T19:54:54.832 INFO:teuthology.orchestra.run.smithi008.stdout: { 2023-08-01T19:54:54.832 INFO:teuthology.orchestra.run.smithi008.stdout: "event": "done", 2023-08-01T19:54:54.832 INFO:teuthology.orchestra.run.smithi008.stdout: "time": "2023-08-01T19:54:29.011833+0000", 2023-08-01T19:54:54.832 INFO:teuthology.orchestra.run.smithi008.stdout: "duration": 1.8437e-05 2023-08-01T19:54:54.832 INFO:teuthology.orchestra.run.smithi008.stdout: } 2023-08-01T19:54:54.833 INFO:teuthology.orchestra.run.smithi008.stdout: ] 2023-08-01T19:54:54.833 INFO:teuthology.orchestra.run.smithi008.stdout: } 2023-08-01T19:54:54.833 INFO:teuthology.orchestra.run.smithi008.stdout: }, 2023-08-01T19:54:54.833 INFO:teuthology.orchestra.run.smithi008.stdout: { 2023-08-01T19:54:54.833 INFO:teuthology.orchestra.run.smithi008.stdout: "description": "osd_op(client.4668.0:18363 5.5 5:ab48299e:::benchmark_data_smithi006_114134_object18362:head [set-alloc-hint object_size 65536 write_size 65536,write 0~65536] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e23)", 2023-08-01T19:54:54.833 INFO:teuthology.orchestra.run.smithi008.stdout: "initiated_at": "2023-08-01T19:54:28.996467+0000", 2023-08-01T19:54:54.833 INFO:teuthology.orchestra.run.smithi008.stdout: "age": 25.811906586999999, 2023-08-01T19:54:54.833 INFO:teuthology.orchestra.run.smithi008.stdout: "duration": 0.015287689, 2023-08-01T19:54:54.834 INFO:teuthology.orchestra.run.smithi008.stdout: "type_data": { 2023-08-01T19:54:54.834 INFO:teuthology.orchestra.run.smithi008.stdout: "flag_point": "commit sent; apply or cleanup", 2023-08-01T19:54:54.834 INFO:teuthology.orchestra.run.smithi008.stdout: "client_info": { 2023-08-01T19:54:54.834 INFO:teuthology.orchestra.run.smithi008.stdout: "client": "client.4668", 2023-08-01T19:54:54.834 INFO:teuthology.orchestra.run.smithi008.stdout: "client_addr": "172.21.15.6:0/1709472247", 2023-08-01T19:54:54.834 INFO:teuthology.orchestra.run.smithi008.stdout: "tid": 18363 2023-08-01T19:54:54.834 INFO:teuthology.orchestra.run.smithi008.stdout: }, 2023-08-01T19:54:54.834 INFO:teuthology.orchestra.run.smithi008.stdout: "events": [ 2023-08-01T19:54:54.835 INFO:teuthology.orchestra.run.smithi008.stdout: { 2023-08-01T19:54:54.835 INFO:teuthology.orchestra.run.smithi008.stdout: "event": "initiated", 2023-08-01T19:54:54.835 INFO:teuthology.orchestra.run.smithi008.stdout: "time": "2023-08-01T19:54:28.996467+0000", 2023-08-01T19:54:54.835 INFO:teuthology.orchestra.run.smithi008.stdout: "duration": 0 2023-08-01T19:54:54.835 INFO:teuthology.orchestra.run.smithi008.stdout: }, 2023-08-01T19:54:54.835 INFO:teuthology.orchestra.run.smithi008.stdout: { 2023-08-01T19:54:54.835 INFO:teuthology.orchestra.run.smithi008.stdout: "event": "throttled", 2023-08-01T19:54:54.835 INFO:teuthology.orchestra.run.smithi008.stdout: "time": "2023-08-01T19:54:28.996467+0000", 2023-08-01T19:54:54.836 INFO:teuthology.orchestra.run.smithi008.stdout: "duration": 0 2023-08-01T19:54:54.836 INFO:teuthology.orchestra.run.smithi008.stdout: }, 2023-08-01T19:54:54.836 INFO:teuthology.orchestra.run.smithi008.stdout: { 2023-08-01T19:54:54.836 INFO:teuthology.orchestra.run.smithi008.stdout: "event": "header_read", 2023-08-01T19:54:54.836 INFO:teuthology.orchestra.run.smithi008.stdout: "time": "2023-08-01T19:54:28.996466+0000", 2023-08-01T19:54:54.836 INFO:teuthology.orchestra.run.smithi008.stdout: "duration": 4294967295.999999 2023-08-01T19:54:54.836 INFO:teuthology.orchestra.run.smithi008.stdout: }, 2023-08-01T19:54:54.837 INFO:teuthology.orchestra.run.smithi008.stdout: { 2023-08-01T19:54:54.837 INFO:teuthology.orchestra.run.smithi008.stdout: "event": "all_read", 2023-08-01T19:54:54.837 INFO:teuthology.orchestra.run.smithi008.stdout: "time": "2023-08-01T19:54:28.996519+0000", 2023-08-01T19:54:54.837 INFO:teuthology.orchestra.run.smithi008.stdout: "duration": 5.3075000000000003e-05 2023-08-01T19:54:54.837 INFO:teuthology.orchestra.run.smithi008.stdout: }, 2023-08-01T19:54:54.837 INFO:teuthology.orchestra.run.smithi008.stdout: { 2023-08-01T19:54:54.837 INFO:teuthology.orchestra.run.smithi008.stdout: "event": "dispatched", 2023-08-01T19:54:54.837 INFO:teuthology.orchestra.run.smithi008.stdout: "time": "2023-08-01T19:54:28.996529+0000", 2023-08-01T19:54:54.838 INFO:teuthology.orchestra.run.smithi008.stdout: "duration": 9.2499999999999995e-06 2023-08-01T19:54:54.838 INFO:teuthology.orchestra.run.smithi008.stdout: }, 2023-08-01T19:54:54.838 INFO:teuthology.orchestra.run.smithi008.stdout: { 2023-08-01T19:54:54.838 INFO:teuthology.orchestra.run.smithi008.stdout: "event": "queued_for_pg", 2023-08-01T19:54:54.838 INFO:teuthology.orchestra.run.smithi008.stdout: "time": "2023-08-01T19:54:28.996537+0000", 2023-08-01T19:54:54.838 INFO:teuthology.orchestra.run.smithi008.stdout: "duration": 8.4239999999999993e-06 2023-08-01T19:54:54.838 INFO:teuthology.orchestra.run.smithi008.stdout: }, 2023-08-01T19:54:54.839 INFO:teuthology.orchestra.run.smithi008.stdout: { 2023-08-01T19:54:54.839 INFO:teuthology.orchestra.run.smithi008.stdout: "event": "reached_pg", 2023-08-01T19:54:54.839 INFO:teuthology.orchestra.run.smithi008.stdout: "time": "2023-08-01T19:54:28.996590+0000", 2023-08-01T19:54:54.839 INFO:teuthology.orchestra.run.smithi008.stdout: "duration": 5.3047999999999998e-05 2023-08-01T19:54:54.839 INFO:teuthology.orchestra.run.smithi008.stdout: }, 2023-08-01T19:54:54.839 INFO:teuthology.orchestra.run.smithi008.stdout: { 2023-08-01T19:54:54.839 INFO:teuthology.orchestra.run.smithi008.stdout: "event": "started", 2023-08-01T19:54:54.839 INFO:teuthology.orchestra.run.smithi008.stdout: "time": "2023-08-01T19:54:28.996707+0000", 2023-08-01T19:54:54.840 INFO:teuthology.orchestra.run.smithi008.stdout: "duration": 0.000117005 2023-08-01T19:54:54.840 INFO:teuthology.orchestra.run.smithi008.stdout: }, 2023-08-01T19:54:54.840 INFO:teuthology.orchestra.run.smithi008.stdout: { 2023-08-01T19:54:54.840 INFO:teuthology.orchestra.run.smithi008.stdout: "event": "waiting for subops from 1", 2023-08-01T19:54:54.840 INFO:teuthology.orchestra.run.smithi008.stdout: "time": "2023-08-01T19:54:28.996807+0000", 2023-08-01T19:54:54.840 INFO:teuthology.orchestra.run.smithi008.stdout: "duration": 0.0001003 2023-08-01T19:54:54.840 INFO:teuthology.orchestra.run.smithi008.stdout: }, 2023-08-01T19:54:54.840 INFO:teuthology.orchestra.run.smithi008.stdout: { 2023-08-01T19:54:54.841 INFO:teuthology.orchestra.run.smithi008.stdout: "event": "op_commit", 2023-08-01T19:54:54.841 INFO:teuthology.orchestra.run.smithi008.stdout: "time": "2023-08-01T19:54:28.998511+0000", 2023-08-01T19:54:54.841 INFO:teuthology.orchestra.run.smithi008.stdout: "duration": 0.00170397 2023-08-01T19:54:54.841 INFO:teuthology.orchestra.run.smithi008.stdout: }, 2023-08-01T19:54:54.841 INFO:teuthology.orchestra.run.smithi008.stdout: { 2023-08-01T19:54:54.841 INFO:teuthology.orchestra.run.smithi008.stdout: "event": "sub_op_commit_rec", 2023-08-01T19:54:54.841 INFO:teuthology.orchestra.run.smithi008.stdout: "time": "2023-08-01T19:54:29.011698+0000", 2023-08-01T19:54:54.842 INFO:teuthology.orchestra.run.smithi008.stdout: "duration": 0.013186959 2023-08-01T19:54:54.842 INFO:teuthology.orchestra.run.smithi008.stdout: }, 2023-08-01T19:54:54.842 INFO:teuthology.orchestra.run.smithi008.stdout: { 2023-08-01T19:54:54.842 INFO:teuthology.orchestra.run.smithi008.stdout: "event": "commit_sent", 2023-08-01T19:54:54.842 INFO:teuthology.orchestra.run.smithi008.stdout: "time": "2023-08-01T19:54:29.011729+0000", 2023-08-01T19:54:54.842 INFO:teuthology.orchestra.run.smithi008.stdout: "duration": 3.044e-05 2023-08-01T19:54:54.842 INFO:teuthology.orchestra.run.smithi008.stdout: }, 2023-08-01T19:54:54.842 INFO:teuthology.orchestra.run.smithi008.stdout: { 2023-08-01T19:54:54.843 INFO:teuthology.orchestra.run.smithi008.stdout: "event": "done", 2023-08-01T19:54:54.843 INFO:teuthology.orchestra.run.smithi008.stdout: "time": "2023-08-01T19:54:29.011755+0000", 2023-08-01T19:54:54.843 INFO:teuthology.orchestra.run.smithi008.stdout: "duration": 2.6165000000000001e-05 2023-08-01T19:54:54.843 INFO:teuthology.orchestra.run.smithi008.stdout: } 2023-08-01T19:54:54.843 INFO:teuthology.orchestra.run.smithi008.stdout: ] 2023-08-01T19:54:54.843 INFO:teuthology.orchestra.run.smithi008.stdout: } 2023-08-01T19:54:54.843 INFO:teuthology.orchestra.run.smithi008.stdout: }, 2023-08-01T19:54:54.843 INFO:teuthology.orchestra.run.smithi008.stdout: { 2023-08-01T19:54:54.844 INFO:teuthology.orchestra.run.smithi008.stdout: "description": "osd_op(client.4668.0:42456 5.5 5:a63cfb95:::benchmark_data_smithi006_114134_object42455:head [set-alloc-hint object_size 65536 write_size 65536,write 0~65536] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e26)", 2023-08-01T19:54:54.844 INFO:teuthology.orchestra.run.smithi008.stdout: "initiated_at": "2023-08-01T19:54:37.199768+0000", 2023-08-01T19:54:54.844 INFO:teuthology.orchestra.run.smithi008.stdout: "age": 17.608605740000002, 2023-08-01T19:54:54.844 INFO:teuthology.orchestra.run.smithi008.stdout: "duration": 0.015069397999999999, 2023-08-01T19:54:54.844 INFO:teuthology.orchestra.run.smithi008.stdout: "type_data": { 2023-08-01T19:54:54.844 INFO:teuthology.orchestra.run.smithi008.stdout: "flag_point": "commit sent; apply or cleanup", 2023-08-01T19:54:54.844 INFO:teuthology.orchestra.run.smithi008.stdout: "client_info": { 2023-08-01T19:54:54.845 INFO:teuthology.orchestra.run.smithi008.stdout: "client": "client.4668", 2023-08-01T19:54:54.845 INFO:teuthology.orchestra.run.smithi008.stdout: "client_addr": "172.21.15.6:0/1709472247", 2023-08-01T19:54:54.845 INFO:teuthology.orchestra.run.smithi008.stdout: "tid": 42456 2023-08-01T19:54:54.845 INFO:teuthology.orchestra.run.smithi008.stdout: }, 2023-08-01T19:54:54.845 INFO:teuthology.orchestra.run.smithi008.stdout: "events": [ 2023-08-01T19:54:54.845 INFO:teuthology.orchestra.run.smithi008.stdout: { 2023-08-01T19:54:54.845 INFO:teuthology.orchestra.run.smithi008.stdout: "event": "initiated", 2023-08-01T19:54:54.845 INFO:teuthology.orchestra.run.smithi008.stdout: "time": "2023-08-01T19:54:37.199768+0000", 2023-08-01T19:54:54.846 INFO:teuthology.orchestra.run.smithi008.stdout: "duration": 0 2023-08-01T19:54:54.846 INFO:teuthology.orchestra.run.smithi008.stdout: }, 2023-08-01T19:54:54.846 INFO:teuthology.orchestra.run.smithi008.stdout: { 2023-08-01T19:54:54.846 INFO:teuthology.orchestra.run.smithi008.stdout: "event": "throttled", 2023-08-01T19:54:54.846 INFO:teuthology.orchestra.run.smithi008.stdout: "time": "2023-08-01T19:54:37.199768+0000", 2023-08-01T19:54:54.846 INFO:teuthology.orchestra.run.smithi008.stdout: "duration": 0 2023-08-01T19:54:54.846 INFO:teuthology.orchestra.run.smithi008.stdout: }, 2023-08-01T19:54:54.847 INFO:teuthology.orchestra.run.smithi008.stdout: { 2023-08-01T19:54:54.847 INFO:teuthology.orchestra.run.smithi008.stdout: "event": "header_read", 2023-08-01T19:54:54.847 INFO:teuthology.orchestra.run.smithi008.stdout: "time": "2023-08-01T19:54:37.199767+0000", 2023-08-01T19:54:54.847 INFO:teuthology.orchestra.run.smithi008.stdout: "duration": 4294967295.9999995 2023-08-01T19:54:54.847 INFO:teuthology.orchestra.run.smithi008.stdout: }, 2023-08-01T19:54:54.847 INFO:teuthology.orchestra.run.smithi008.stdout: { 2023-08-01T19:54:54.848 INFO:teuthology.orchestra.run.smithi008.stdout: "event": "all_read", 2023-08-01T19:54:54.848 INFO:teuthology.orchestra.run.smithi008.stdout: "time": "2023-08-01T19:54:37.199798+0000", 2023-08-01T19:54:54.848 INFO:teuthology.orchestra.run.smithi008.stdout: "duration": 3.0443999999999999e-05 2023-08-01T19:54:54.848 INFO:teuthology.orchestra.run.smithi008.stdout: }, 2023-08-01T19:54:54.848 INFO:teuthology.orchestra.run.smithi008.stdout: { 2023-08-01T19:54:54.848 INFO:teuthology.orchestra.run.smithi008.stdout: "event": "dispatched", 2023-08-01T19:54:54.848 INFO:teuthology.orchestra.run.smithi008.stdout: "time": "2023-08-01T19:54:37.199806+0000", 2023-08-01T19:54:54.849 INFO:teuthology.orchestra.run.smithi008.stdout: "duration": 8.2300000000000008e-06 2023-08-01T19:54:54.849 INFO:teuthology.orchestra.run.smithi008.stdout: }, 2023-08-01T19:54:54.849 INFO:teuthology.orchestra.run.smithi008.stdout: { 2023-08-01T19:54:54.849 INFO:teuthology.orchestra.run.smithi008.stdout: "event": "queued_for_pg", 2023-08-01T19:54:54.849 INFO:teuthology.orchestra.run.smithi008.stdout: "time": "2023-08-01T19:54:37.199811+0000", 2023-08-01T19:54:54.849 INFO:teuthology.orchestra.run.smithi008.stdout: "duration": 5.2730000000000002e-06 2023-08-01T19:54:54.849 INFO:teuthology.orchestra.run.smithi008.stdout: }, 2023-08-01T19:54:54.850 INFO:teuthology.orchestra.run.smithi008.stdout: { 2023-08-01T19:54:54.850 INFO:teuthology.orchestra.run.smithi008.stdout: "event": "reached_pg", 2023-08-01T19:54:54.850 INFO:teuthology.orchestra.run.smithi008.stdout: "time": "2023-08-01T19:54:37.200406+0000", 2023-08-01T19:54:54.850 INFO:teuthology.orchestra.run.smithi008.stdout: "duration": 0.00059457599999999998 2023-08-01T19:54:54.850 INFO:teuthology.orchestra.run.smithi008.stdout: }, 2023-08-01T19:54:54.850 INFO:teuthology.orchestra.run.smithi008.stdout: { 2023-08-01T19:54:54.850 INFO:teuthology.orchestra.run.smithi008.stdout: "event": "started", 2023-08-01T19:54:54.850 INFO:teuthology.orchestra.run.smithi008.stdout: "time": "2023-08-01T19:54:37.200532+0000", 2023-08-01T19:54:54.851 INFO:teuthology.orchestra.run.smithi008.stdout: "duration": 0.000126129 2023-08-01T19:54:54.851 INFO:teuthology.orchestra.run.smithi008.stdout: }, 2023-08-01T19:54:54.851 INFO:teuthology.orchestra.run.smithi008.stdout: { 2023-08-01T19:54:54.851 INFO:teuthology.orchestra.run.smithi008.stdout: "event": "waiting for subops from 1", 2023-08-01T19:54:54.851 INFO:teuthology.orchestra.run.smithi008.stdout: "time": "2023-08-01T19:54:37.200644+0000", 2023-08-01T19:54:54.851 INFO:teuthology.orchestra.run.smithi008.stdout: "duration": 0.000111736 2023-08-01T19:54:54.851 INFO:teuthology.orchestra.run.smithi008.stdout: }, 2023-08-01T19:54:54.852 INFO:teuthology.orchestra.run.smithi008.stdout: { 2023-08-01T19:54:54.852 INFO:teuthology.orchestra.run.smithi008.stdout: "event": "sub_op_commit_rec", 2023-08-01T19:54:54.852 INFO:teuthology.orchestra.run.smithi008.stdout: "time": "2023-08-01T19:54:37.203384+0000", 2023-08-01T19:54:54.852 INFO:teuthology.orchestra.run.smithi008.stdout: "duration": 0.0027397039999999999 2023-08-01T19:54:54.852 INFO:teuthology.orchestra.run.smithi008.stdout: }, 2023-08-01T19:54:54.852 INFO:teuthology.orchestra.run.smithi008.stdout: { 2023-08-01T19:54:54.852 INFO:teuthology.orchestra.run.smithi008.stdout: "event": "op_commit", 2023-08-01T19:54:54.852 INFO:teuthology.orchestra.run.smithi008.stdout: "time": "2023-08-01T19:54:37.214746+0000", 2023-08-01T19:54:54.853 INFO:teuthology.orchestra.run.smithi008.stdout: "duration": 0.011362766 2023-08-01T19:54:54.853 INFO:teuthology.orchestra.run.smithi008.stdout: }, 2023-08-01T19:54:54.853 INFO:teuthology.orchestra.run.smithi008.stdout: { 2023-08-01T19:54:54.853 INFO:teuthology.orchestra.run.smithi008.stdout: "event": "commit_sent", 2023-08-01T19:54:54.853 INFO:teuthology.orchestra.run.smithi008.stdout: "time": "2023-08-01T19:54:37.214795+0000", 2023-08-01T19:54:54.853 INFO:teuthology.orchestra.run.smithi008.stdout: "duration": 4.8449000000000003e-05 2023-08-01T19:54:54.853 INFO:teuthology.orchestra.run.smithi008.stdout: }, 2023-08-01T19:54:54.853 INFO:teuthology.orchestra.run.smithi008.stdout: { 2023-08-01T19:54:54.854 INFO:teuthology.orchestra.run.smithi008.stdout: "event": "done", 2023-08-01T19:54:54.854 INFO:teuthology.orchestra.run.smithi008.stdout: "time": "2023-08-01T19:54:37.214837+0000", 2023-08-01T19:54:54.854 INFO:teuthology.orchestra.run.smithi008.stdout: "duration": 4.2661999999999999e-05 2023-08-01T19:54:54.854 INFO:teuthology.orchestra.run.smithi008.stdout: } 2023-08-01T19:54:54.854 INFO:teuthology.orchestra.run.smithi008.stdout: ] 2023-08-01T19:54:54.854 INFO:teuthology.orchestra.run.smithi008.stdout: } 2023-08-01T19:54:54.854 INFO:teuthology.orchestra.run.smithi008.stdout: }, 2023-08-01T19:54:54.855 INFO:teuthology.orchestra.run.smithi008.stdout: { 2023-08-01T19:54:54.855 INFO:teuthology.orchestra.run.smithi008.stdout: "description": "osd_repop(client.4668.0:61802 5.b e29/19 5:dcfcf99c:::benchmark_data_smithi006_114134_object61801:head v 29'3819, mlcod=28'3815)", 2023-08-01T19:54:54.855 INFO:teuthology.orchestra.run.smithi008.stdout: "initiated_at": "2023-08-01T19:54:45.744751+0000", 2023-08-01T19:54:54.855 INFO:teuthology.orchestra.run.smithi008.stdout: "age": 9.0636228689999996, 2023-08-01T19:54:54.855 INFO:teuthology.orchestra.run.smithi008.stdout: "duration": 0.015484753, 2023-08-01T19:54:54.855 INFO:teuthology.orchestra.run.smithi008.stdout: "type_data": { 2023-08-01T19:54:54.855 INFO:teuthology.orchestra.run.smithi008.stdout: "flag_point": "commit sent; apply or cleanup", 2023-08-01T19:54:54.855 INFO:teuthology.orchestra.run.smithi008.stdout: "events": [ 2023-08-01T19:54:54.856 INFO:teuthology.orchestra.run.smithi008.stdout: { 2023-08-01T19:54:54.856 INFO:teuthology.orchestra.run.smithi008.stdout: "event": "initiated", 2023-08-01T19:54:54.856 INFO:teuthology.orchestra.run.smithi008.stdout: "time": "2023-08-01T19:54:45.744751+0000", 2023-08-01T19:54:54.856 INFO:teuthology.orchestra.run.smithi008.stdout: "duration": 0 2023-08-01T19:54:54.856 INFO:teuthology.orchestra.run.smithi008.stdout: }, 2023-08-01T19:54:54.856 INFO:teuthology.orchestra.run.smithi008.stdout: { 2023-08-01T19:54:54.856 INFO:teuthology.orchestra.run.smithi008.stdout: "event": "throttled", 2023-08-01T19:54:54.857 INFO:teuthology.orchestra.run.smithi008.stdout: "time": "2023-08-01T19:54:45.744751+0000", 2023-08-01T19:54:54.857 INFO:teuthology.orchestra.run.smithi008.stdout: "duration": 0 2023-08-01T19:54:54.857 INFO:teuthology.orchestra.run.smithi008.stdout: }, 2023-08-01T19:54:54.857 INFO:teuthology.orchestra.run.smithi008.stdout: { 2023-08-01T19:54:54.857 INFO:teuthology.orchestra.run.smithi008.stdout: "event": "header_read", 2023-08-01T19:54:54.857 INFO:teuthology.orchestra.run.smithi008.stdout: "time": "2023-08-01T19:54:45.744750+0000", 2023-08-01T19:54:54.857 INFO:teuthology.orchestra.run.smithi008.stdout: "duration": 4294967295.9999995 2023-08-01T19:54:54.857 INFO:teuthology.orchestra.run.smithi008.stdout: }, 2023-08-01T19:54:54.858 INFO:teuthology.orchestra.run.smithi008.stdout: { 2023-08-01T19:54:54.858 INFO:teuthology.orchestra.run.smithi008.stdout: "event": "all_read", 2023-08-01T19:54:54.858 INFO:teuthology.orchestra.run.smithi008.stdout: "time": "2023-08-01T19:54:45.744820+0000", 2023-08-01T19:54:54.858 INFO:teuthology.orchestra.run.smithi008.stdout: "duration": 6.9839999999999995e-05 2023-08-01T19:54:54.858 INFO:teuthology.orchestra.run.smithi008.stdout: }, 2023-08-01T19:54:54.858 INFO:teuthology.orchestra.run.smithi008.stdout: { 2023-08-01T19:54:54.858 INFO:teuthology.orchestra.run.smithi008.stdout: "event": "dispatched", 2023-08-01T19:54:54.858 INFO:teuthology.orchestra.run.smithi008.stdout: "time": "2023-08-01T19:54:45.744829+0000", 2023-08-01T19:54:54.859 INFO:teuthology.orchestra.run.smithi008.stdout: "duration": 8.7499999999999992e-06 2023-08-01T19:54:54.859 INFO:teuthology.orchestra.run.smithi008.stdout: }, 2023-08-01T19:54:54.859 INFO:teuthology.orchestra.run.smithi008.stdout: { 2023-08-01T19:54:54.859 INFO:teuthology.orchestra.run.smithi008.stdout: "event": "queued_for_pg", 2023-08-01T19:54:54.859 INFO:teuthology.orchestra.run.smithi008.stdout: "time": "2023-08-01T19:54:45.744835+0000", 2023-08-01T19:54:54.859 INFO:teuthology.orchestra.run.smithi008.stdout: "duration": 5.6609999999999997e-06 2023-08-01T19:54:54.859 INFO:teuthology.orchestra.run.smithi008.stdout: }, 2023-08-01T19:54:54.860 INFO:teuthology.orchestra.run.smithi008.stdout: { 2023-08-01T19:54:54.860 INFO:teuthology.orchestra.run.smithi008.stdout: "event": "reached_pg", 2023-08-01T19:54:54.860 INFO:teuthology.orchestra.run.smithi008.stdout: "time": "2023-08-01T19:54:45.746369+0000", 2023-08-01T19:54:54.860 INFO:teuthology.orchestra.run.smithi008.stdout: "duration": 0.001534512 2023-08-01T19:54:54.860 INFO:teuthology.orchestra.run.smithi008.stdout: }, 2023-08-01T19:54:54.860 INFO:teuthology.orchestra.run.smithi008.stdout: { 2023-08-01T19:54:54.860 INFO:teuthology.orchestra.run.smithi008.stdout: "event": "started", 2023-08-01T19:54:54.861 INFO:teuthology.orchestra.run.smithi008.stdout: "time": "2023-08-01T19:54:45.746389+0000", 2023-08-01T19:54:54.861 INFO:teuthology.orchestra.run.smithi008.stdout: "duration": 2.0271999999999998e-05 2023-08-01T19:54:54.861 INFO:teuthology.orchestra.run.smithi008.stdout: }, 2023-08-01T19:54:54.861 INFO:teuthology.orchestra.run.smithi008.stdout: { 2023-08-01T19:54:54.861 INFO:teuthology.orchestra.run.smithi008.stdout: "event": "commit_sent", 2023-08-01T19:54:54.861 INFO:teuthology.orchestra.run.smithi008.stdout: "time": "2023-08-01T19:54:45.760207+0000", 2023-08-01T19:54:54.861 INFO:teuthology.orchestra.run.smithi008.stdout: "duration": 0.013817378 2023-08-01T19:54:54.861 INFO:teuthology.orchestra.run.smithi008.stdout: }, 2023-08-01T19:54:54.862 INFO:teuthology.orchestra.run.smithi008.stdout: { 2023-08-01T19:54:54.862 INFO:teuthology.orchestra.run.smithi008.stdout: "event": "done", 2023-08-01T19:54:54.862 INFO:teuthology.orchestra.run.smithi008.stdout: "time": "2023-08-01T19:54:45.760236+0000", 2023-08-01T19:54:54.862 INFO:teuthology.orchestra.run.smithi008.stdout: "duration": 2.8929999999999999e-05 2023-08-01T19:54:54.862 INFO:teuthology.orchestra.run.smithi008.stdout: } 2023-08-01T19:54:54.862 INFO:teuthology.orchestra.run.smithi008.stdout: ] 2023-08-01T19:54:54.862 INFO:teuthology.orchestra.run.smithi008.stdout: } 2023-08-01T19:54:54.862 INFO:teuthology.orchestra.run.smithi008.stdout: }, 2023-08-01T19:54:54.863 INFO:teuthology.orchestra.run.smithi008.stdout: { 2023-08-01T19:54:54.863 INFO:teuthology.orchestra.run.smithi008.stdout: "description": "osd_op(client.4668.0:65870 5.c 5:33dffb88:::benchmark_data_smithi006_114134_object65869:head [set-alloc-hint object_size 65536 write_size 65536,write 0~65536] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e29)", 2023-08-01T19:54:54.863 INFO:teuthology.orchestra.run.smithi008.stdout: "initiated_at": "2023-08-01T19:54:47.659854+0000", 2023-08-01T19:54:54.863 INFO:teuthology.orchestra.run.smithi008.stdout: "age": 7.1485199789999996, 2023-08-01T19:54:54.863 INFO:teuthology.orchestra.run.smithi008.stdout: "duration": 0.018513103999999999, 2023-08-01T19:54:54.863 INFO:teuthology.orchestra.run.smithi008.stdout: "type_data": { 2023-08-01T19:54:54.863 INFO:teuthology.orchestra.run.smithi008.stdout: "flag_point": "commit sent; apply or cleanup", 2023-08-01T19:54:54.863 INFO:teuthology.orchestra.run.smithi008.stdout: "client_info": { 2023-08-01T19:54:54.864 INFO:teuthology.orchestra.run.smithi008.stdout: "client": "client.4668", 2023-08-01T19:54:54.864 INFO:teuthology.orchestra.run.smithi008.stdout: "client_addr": "172.21.15.6:0/1709472247", 2023-08-01T19:54:54.864 INFO:teuthology.orchestra.run.smithi008.stdout: "tid": 65870 2023-08-01T19:54:54.864 INFO:teuthology.orchestra.run.smithi008.stdout: }, 2023-08-01T19:54:54.864 INFO:teuthology.orchestra.run.smithi008.stdout: "events": [ 2023-08-01T19:54:54.864 INFO:teuthology.orchestra.run.smithi008.stdout: { 2023-08-01T19:54:54.864 INFO:teuthology.orchestra.run.smithi008.stdout: "event": "initiated", 2023-08-01T19:54:54.865 INFO:teuthology.orchestra.run.smithi008.stdout: "time": "2023-08-01T19:54:47.659854+0000", 2023-08-01T19:54:54.865 INFO:teuthology.orchestra.run.smithi008.stdout: "duration": 0 2023-08-01T19:54:54.865 INFO:teuthology.orchestra.run.smithi008.stdout: }, 2023-08-01T19:54:54.865 INFO:teuthology.orchestra.run.smithi008.stdout: { 2023-08-01T19:54:54.865 INFO:teuthology.orchestra.run.smithi008.stdout: "event": "throttled", 2023-08-01T19:54:54.865 INFO:teuthology.orchestra.run.smithi008.stdout: "time": "2023-08-01T19:54:47.659854+0000", 2023-08-01T19:54:54.865 INFO:teuthology.orchestra.run.smithi008.stdout: "duration": 0 2023-08-01T19:54:54.865 INFO:teuthology.orchestra.run.smithi008.stdout: }, 2023-08-01T19:54:54.866 INFO:teuthology.orchestra.run.smithi008.stdout: { 2023-08-01T19:54:54.866 INFO:teuthology.orchestra.run.smithi008.stdout: "event": "header_read", 2023-08-01T19:54:54.866 INFO:teuthology.orchestra.run.smithi008.stdout: "time": "2023-08-01T19:54:47.659853+0000", 2023-08-01T19:54:54.866 INFO:teuthology.orchestra.run.smithi008.stdout: "duration": 4294967295.999999 2023-08-01T19:54:54.866 INFO:teuthology.orchestra.run.smithi008.stdout: }, 2023-08-01T19:54:54.866 INFO:teuthology.orchestra.run.smithi008.stdout: { 2023-08-01T19:54:54.866 INFO:teuthology.orchestra.run.smithi008.stdout: "event": "all_read", 2023-08-01T19:54:54.867 INFO:teuthology.orchestra.run.smithi008.stdout: "time": "2023-08-01T19:54:47.660013+0000", 2023-08-01T19:54:54.867 INFO:teuthology.orchestra.run.smithi008.stdout: "duration": 0.00015954900000000001 2023-08-01T19:54:54.867 INFO:teuthology.orchestra.run.smithi008.stdout: }, 2023-08-01T19:54:54.867 INFO:teuthology.orchestra.run.smithi008.stdout: { 2023-08-01T19:54:54.867 INFO:teuthology.orchestra.run.smithi008.stdout: "event": "dispatched", 2023-08-01T19:54:54.867 INFO:teuthology.orchestra.run.smithi008.stdout: "time": "2023-08-01T19:54:47.660023+0000", 2023-08-01T19:54:54.867 INFO:teuthology.orchestra.run.smithi008.stdout: "duration": 1.0327e-05 2023-08-01T19:54:54.867 INFO:teuthology.orchestra.run.smithi008.stdout: }, 2023-08-01T19:54:54.868 INFO:teuthology.orchestra.run.smithi008.stdout: { 2023-08-01T19:54:54.868 INFO:teuthology.orchestra.run.smithi008.stdout: "event": "queued_for_pg", 2023-08-01T19:54:54.868 INFO:teuthology.orchestra.run.smithi008.stdout: "time": "2023-08-01T19:54:47.660039+0000", 2023-08-01T19:54:54.868 INFO:teuthology.orchestra.run.smithi008.stdout: "duration": 1.5829999999999999e-05 2023-08-01T19:54:54.868 INFO:teuthology.orchestra.run.smithi008.stdout: }, 2023-08-01T19:54:54.868 INFO:teuthology.orchestra.run.smithi008.stdout: { 2023-08-01T19:54:54.868 INFO:teuthology.orchestra.run.smithi008.stdout: "event": "reached_pg", 2023-08-01T19:54:54.869 INFO:teuthology.orchestra.run.smithi008.stdout: "time": "2023-08-01T19:54:47.662611+0000", 2023-08-01T19:54:54.869 INFO:teuthology.orchestra.run.smithi008.stdout: "duration": 0.002572319 2023-08-01T19:54:54.869 INFO:teuthology.orchestra.run.smithi008.stdout: }, 2023-08-01T19:54:54.869 INFO:teuthology.orchestra.run.smithi008.stdout: { 2023-08-01T19:54:54.869 INFO:teuthology.orchestra.run.smithi008.stdout: "event": "started", 2023-08-01T19:54:54.869 INFO:teuthology.orchestra.run.smithi008.stdout: "time": "2023-08-01T19:54:47.662767+0000", 2023-08-01T19:54:54.869 INFO:teuthology.orchestra.run.smithi008.stdout: "duration": 0.00015598200000000001 2023-08-01T19:54:54.869 INFO:teuthology.orchestra.run.smithi008.stdout: }, 2023-08-01T19:54:54.870 INFO:teuthology.orchestra.run.smithi008.stdout: { 2023-08-01T19:54:54.870 INFO:teuthology.orchestra.run.smithi008.stdout: "event": "waiting for subops from 1", 2023-08-01T19:54:54.870 INFO:teuthology.orchestra.run.smithi008.stdout: "time": "2023-08-01T19:54:47.662930+0000", 2023-08-01T19:54:54.870 INFO:teuthology.orchestra.run.smithi008.stdout: "duration": 0.000163086 2023-08-01T19:54:54.870 INFO:teuthology.orchestra.run.smithi008.stdout: }, 2023-08-01T19:54:54.870 INFO:teuthology.orchestra.run.smithi008.stdout: { 2023-08-01T19:54:54.870 INFO:teuthology.orchestra.run.smithi008.stdout: "event": "sub_op_commit_rec", 2023-08-01T19:54:54.870 INFO:teuthology.orchestra.run.smithi008.stdout: "time": "2023-08-01T19:54:47.667336+0000", 2023-08-01T19:54:54.871 INFO:teuthology.orchestra.run.smithi008.stdout: "duration": 0.0044062839999999999 2023-08-01T19:54:54.871 INFO:teuthology.orchestra.run.smithi008.stdout: }, 2023-08-01T19:54:54.871 INFO:teuthology.orchestra.run.smithi008.stdout: { 2023-08-01T19:54:54.871 INFO:teuthology.orchestra.run.smithi008.stdout: "event": "op_commit", 2023-08-01T19:54:54.871 INFO:teuthology.orchestra.run.smithi008.stdout: "time": "2023-08-01T19:54:47.678278+0000", 2023-08-01T19:54:54.871 INFO:teuthology.orchestra.run.smithi008.stdout: "duration": 0.010941912999999999 2023-08-01T19:54:54.871 INFO:teuthology.orchestra.run.smithi008.stdout: }, 2023-08-01T19:54:54.872 INFO:teuthology.orchestra.run.smithi008.stdout: { 2023-08-01T19:54:54.872 INFO:teuthology.orchestra.run.smithi008.stdout: "event": "commit_sent", 2023-08-01T19:54:54.872 INFO:teuthology.orchestra.run.smithi008.stdout: "time": "2023-08-01T19:54:47.678325+0000", 2023-08-01T19:54:54.872 INFO:teuthology.orchestra.run.smithi008.stdout: "duration": 4.6449999999999997e-05 2023-08-01T19:54:54.872 INFO:teuthology.orchestra.run.smithi008.stdout: }, 2023-08-01T19:54:54.872 INFO:teuthology.orchestra.run.smithi008.stdout: { 2023-08-01T19:54:54.872 INFO:teuthology.orchestra.run.smithi008.stdout: "event": "done", 2023-08-01T19:54:54.872 INFO:teuthology.orchestra.run.smithi008.stdout: "time": "2023-08-01T19:54:47.678367+0000", 2023-08-01T19:54:54.873 INFO:teuthology.orchestra.run.smithi008.stdout: "duration": 4.2222999999999999e-05 2023-08-01T19:54:54.873 INFO:teuthology.orchestra.run.smithi008.stdout: } 2023-08-01T19:54:54.873 INFO:teuthology.orchestra.run.smithi008.stdout: ] 2023-08-01T19:54:54.873 INFO:teuthology.orchestra.run.smithi008.stdout: } 2023-08-01T19:54:54.873 INFO:teuthology.orchestra.run.smithi008.stdout: }, 2023-08-01T19:54:54.873 INFO:teuthology.orchestra.run.smithi008.stdout: { 2023-08-01T19:54:54.873 INFO:teuthology.orchestra.run.smithi008.stdout: "description": "osd_op(client.4668.0:72019 5.5 5:a71bfef3:::benchmark_data_smithi006_114134_object72018:head [set-alloc-hint object_size 65536 write_size 65536,write 0~65536] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e30)", 2023-08-01T19:54:54.873 INFO:teuthology.orchestra.run.smithi008.stdout: "initiated_at": "2023-08-01T19:54:50.769454+0000", 2023-08-01T19:54:54.874 INFO:teuthology.orchestra.run.smithi008.stdout: "age": 4.0389201029999997, 2023-08-01T19:54:54.874 INFO:teuthology.orchestra.run.smithi008.stdout: "duration": 0.015017872, 2023-08-01T19:54:54.874 INFO:teuthology.orchestra.run.smithi008.stdout: "type_data": { 2023-08-01T19:54:54.874 INFO:teuthology.orchestra.run.smithi008.stdout: "flag_point": "commit sent; apply or cleanup", 2023-08-01T19:54:54.874 INFO:teuthology.orchestra.run.smithi008.stdout: "client_info": { 2023-08-01T19:54:54.874 INFO:teuthology.orchestra.run.smithi008.stdout: "client": "client.4668", 2023-08-01T19:54:54.874 INFO:teuthology.orchestra.run.smithi008.stdout: "client_addr": "172.21.15.6:0/1709472247", 2023-08-01T19:54:54.874 INFO:teuthology.orchestra.run.smithi008.stdout: "tid": 72019 2023-08-01T19:54:54.875 INFO:teuthology.orchestra.run.smithi008.stdout: }, 2023-08-01T19:54:54.875 INFO:teuthology.orchestra.run.smithi008.stdout: "events": [ 2023-08-01T19:54:54.875 INFO:teuthology.orchestra.run.smithi008.stdout: { 2023-08-01T19:54:54.875 INFO:teuthology.orchestra.run.smithi008.stdout: "event": "initiated", 2023-08-01T19:54:54.875 INFO:teuthology.orchestra.run.smithi008.stdout: "time": "2023-08-01T19:54:50.769454+0000", 2023-08-01T19:54:54.875 INFO:teuthology.orchestra.run.smithi008.stdout: "duration": 0 2023-08-01T19:54:54.875 INFO:teuthology.orchestra.run.smithi008.stdout: }, 2023-08-01T19:54:54.875 INFO:teuthology.orchestra.run.smithi008.stdout: { 2023-08-01T19:54:54.876 INFO:teuthology.orchestra.run.smithi008.stdout: "event": "throttled", 2023-08-01T19:54:54.876 INFO:teuthology.orchestra.run.smithi008.stdout: "time": "2023-08-01T19:54:50.769454+0000", 2023-08-01T19:54:54.876 INFO:teuthology.orchestra.run.smithi008.stdout: "duration": 0 2023-08-01T19:54:54.876 INFO:teuthology.orchestra.run.smithi008.stdout: }, 2023-08-01T19:54:54.876 INFO:teuthology.orchestra.run.smithi008.stdout: { 2023-08-01T19:54:54.876 INFO:teuthology.orchestra.run.smithi008.stdout: "event": "header_read", 2023-08-01T19:54:54.876 INFO:teuthology.orchestra.run.smithi008.stdout: "time": "2023-08-01T19:54:50.769453+0000", 2023-08-01T19:54:54.877 INFO:teuthology.orchestra.run.smithi008.stdout: "duration": 4294967295.999999 2023-08-01T19:54:54.877 INFO:teuthology.orchestra.run.smithi008.stdout: }, 2023-08-01T19:54:54.877 INFO:teuthology.orchestra.run.smithi008.stdout: { 2023-08-01T19:54:54.877 INFO:teuthology.orchestra.run.smithi008.stdout: "event": "all_read", 2023-08-01T19:54:54.877 INFO:teuthology.orchestra.run.smithi008.stdout: "time": "2023-08-01T19:54:50.769481+0000", 2023-08-01T19:54:54.877 INFO:teuthology.orchestra.run.smithi008.stdout: "duration": 2.8605000000000001e-05 2023-08-01T19:54:54.877 INFO:teuthology.orchestra.run.smithi008.stdout: }, 2023-08-01T19:54:54.877 INFO:teuthology.orchestra.run.smithi008.stdout: { 2023-08-01T19:54:54.878 INFO:teuthology.orchestra.run.smithi008.stdout: "event": "dispatched", 2023-08-01T19:54:54.878 INFO:teuthology.orchestra.run.smithi008.stdout: "time": "2023-08-01T19:54:50.769491+0000", 2023-08-01T19:54:54.878 INFO:teuthology.orchestra.run.smithi008.stdout: "duration": 9.9299999999999998e-06 2023-08-01T19:54:54.878 INFO:teuthology.orchestra.run.smithi008.stdout: }, 2023-08-01T19:54:54.878 INFO:teuthology.orchestra.run.smithi008.stdout: { 2023-08-01T19:54:54.878 INFO:teuthology.orchestra.run.smithi008.stdout: "event": "queued_for_pg", 2023-08-01T19:54:54.878 INFO:teuthology.orchestra.run.smithi008.stdout: "time": "2023-08-01T19:54:50.769497+0000", 2023-08-01T19:54:54.878 INFO:teuthology.orchestra.run.smithi008.stdout: "duration": 5.2259999999999996e-06 2023-08-01T19:54:54.879 INFO:teuthology.orchestra.run.smithi008.stdout: }, 2023-08-01T19:54:54.879 INFO:teuthology.orchestra.run.smithi008.stdout: { 2023-08-01T19:54:54.879 INFO:teuthology.orchestra.run.smithi008.stdout: "event": "reached_pg", 2023-08-01T19:54:54.879 INFO:teuthology.orchestra.run.smithi008.stdout: "time": "2023-08-01T19:54:50.772746+0000", 2023-08-01T19:54:54.879 INFO:teuthology.orchestra.run.smithi008.stdout: "duration": 0.0032490140000000002 2023-08-01T19:54:54.879 INFO:teuthology.orchestra.run.smithi008.stdout: }, 2023-08-01T19:54:54.879 INFO:teuthology.orchestra.run.smithi008.stdout: { 2023-08-01T19:54:54.880 INFO:teuthology.orchestra.run.smithi008.stdout: "event": "started", 2023-08-01T19:54:54.880 INFO:teuthology.orchestra.run.smithi008.stdout: "time": "2023-08-01T19:54:50.772822+0000", 2023-08-01T19:54:54.880 INFO:teuthology.orchestra.run.smithi008.stdout: "duration": 7.6225999999999998e-05 2023-08-01T19:54:54.880 INFO:teuthology.orchestra.run.smithi008.stdout: }, 2023-08-01T19:54:54.880 INFO:teuthology.orchestra.run.smithi008.stdout: { 2023-08-01T19:54:54.880 INFO:teuthology.orchestra.run.smithi008.stdout: "event": "waiting for subops from 1", 2023-08-01T19:54:54.880 INFO:teuthology.orchestra.run.smithi008.stdout: "time": "2023-08-01T19:54:50.772907+0000", 2023-08-01T19:54:54.880 INFO:teuthology.orchestra.run.smithi008.stdout: "duration": 8.4931000000000004e-05 2023-08-01T19:54:54.881 INFO:teuthology.orchestra.run.smithi008.stdout: }, 2023-08-01T19:54:54.881 INFO:teuthology.orchestra.run.smithi008.stdout: { 2023-08-01T19:54:54.881 INFO:teuthology.orchestra.run.smithi008.stdout: "event": "op_commit", 2023-08-01T19:54:54.881 INFO:teuthology.orchestra.run.smithi008.stdout: "time": "2023-08-01T19:54:50.776490+0000", 2023-08-01T19:54:54.881 INFO:teuthology.orchestra.run.smithi008.stdout: "duration": 0.0035830329999999998 2023-08-01T19:54:54.881 INFO:teuthology.orchestra.run.smithi008.stdout: }, 2023-08-01T19:54:54.881 INFO:teuthology.orchestra.run.smithi008.stdout: { 2023-08-01T19:54:54.881 INFO:teuthology.orchestra.run.smithi008.stdout: "event": "sub_op_commit_rec", 2023-08-01T19:54:54.882 INFO:teuthology.orchestra.run.smithi008.stdout: "time": "2023-08-01T19:54:50.784391+0000", 2023-08-01T19:54:54.882 INFO:teuthology.orchestra.run.smithi008.stdout: "duration": 0.0079013429999999999 2023-08-01T19:54:54.882 INFO:teuthology.orchestra.run.smithi008.stdout: }, 2023-08-01T19:54:54.882 INFO:teuthology.orchestra.run.smithi008.stdout: { 2023-08-01T19:54:54.882 INFO:teuthology.orchestra.run.smithi008.stdout: "event": "commit_sent", 2023-08-01T19:54:54.882 INFO:teuthology.orchestra.run.smithi008.stdout: "time": "2023-08-01T19:54:50.784435+0000", 2023-08-01T19:54:54.882 INFO:teuthology.orchestra.run.smithi008.stdout: "duration": 4.4298999999999997e-05 2023-08-01T19:54:54.882 INFO:teuthology.orchestra.run.smithi008.stdout: }, 2023-08-01T19:54:54.883 INFO:teuthology.orchestra.run.smithi008.stdout: { 2023-08-01T19:54:54.883 INFO:teuthology.orchestra.run.smithi008.stdout: "event": "done", 2023-08-01T19:54:54.883 INFO:teuthology.orchestra.run.smithi008.stdout: "time": "2023-08-01T19:54:50.784472+0000", 2023-08-01T19:54:54.883 INFO:teuthology.orchestra.run.smithi008.stdout: "duration": 3.6186000000000002e-05 2023-08-01T19:54:54.883 INFO:teuthology.orchestra.run.smithi008.stdout: } 2023-08-01T19:54:54.883 INFO:teuthology.orchestra.run.smithi008.stdout: ] 2023-08-01T19:54:54.883 INFO:teuthology.orchestra.run.smithi008.stdout: } 2023-08-01T19:54:54.884 INFO:teuthology.orchestra.run.smithi008.stdout: }, 2023-08-01T19:54:54.884 INFO:teuthology.orchestra.run.smithi008.stdout: { 2023-08-01T19:54:54.884 INFO:teuthology.orchestra.run.smithi008.stdout: "description": "osd_op(client.4668.0:72163 5.5 5:a05c719b:::benchmark_data_smithi006_114134_object72162:head [set-alloc-hint object_size 65536 write_size 65536,write 0~65536] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e30)", 2023-08-01T19:54:54.884 INFO:teuthology.orchestra.run.smithi008.stdout: "initiated_at": "2023-08-01T19:54:50.841517+0000", 2023-08-01T19:54:54.884 INFO:teuthology.orchestra.run.smithi008.stdout: "age": 3.9668571780000002, 2023-08-01T19:54:54.884 INFO:teuthology.orchestra.run.smithi008.stdout: "duration": 0.015205823, 2023-08-01T19:54:54.884 INFO:teuthology.orchestra.run.smithi008.stdout: "type_data": { 2023-08-01T19:54:54.884 INFO:teuthology.orchestra.run.smithi008.stdout: "flag_point": "commit sent; apply or cleanup", 2023-08-01T19:54:54.885 INFO:teuthology.orchestra.run.smithi008.stdout: "client_info": { 2023-08-01T19:54:54.885 INFO:teuthology.orchestra.run.smithi008.stdout: "client": "client.4668", 2023-08-01T19:54:54.885 INFO:teuthology.orchestra.run.smithi008.stdout: "client_addr": "172.21.15.6:0/1709472247", 2023-08-01T19:54:54.885 INFO:teuthology.orchestra.run.smithi008.stdout: "tid": 72163 2023-08-01T19:54:54.885 INFO:teuthology.orchestra.run.smithi008.stdout: }, 2023-08-01T19:54:54.885 INFO:teuthology.orchestra.run.smithi008.stdout: "events": [ 2023-08-01T19:54:54.885 INFO:teuthology.orchestra.run.smithi008.stdout: { 2023-08-01T19:54:54.885 INFO:teuthology.orchestra.run.smithi008.stdout: "event": "initiated", 2023-08-01T19:54:54.886 INFO:teuthology.orchestra.run.smithi008.stdout: "time": "2023-08-01T19:54:50.841517+0000", 2023-08-01T19:54:54.886 INFO:teuthology.orchestra.run.smithi008.stdout: "duration": 0 2023-08-01T19:54:54.886 INFO:teuthology.orchestra.run.smithi008.stdout: }, 2023-08-01T19:54:54.886 INFO:teuthology.orchestra.run.smithi008.stdout: { 2023-08-01T19:54:54.886 INFO:teuthology.orchestra.run.smithi008.stdout: "event": "throttled", 2023-08-01T19:54:54.886 INFO:teuthology.orchestra.run.smithi008.stdout: "time": "2023-08-01T19:54:50.841517+0000", 2023-08-01T19:54:54.886 INFO:teuthology.orchestra.run.smithi008.stdout: "duration": 0 2023-08-01T19:54:54.886 INFO:teuthology.orchestra.run.smithi008.stdout: }, 2023-08-01T19:54:54.887 INFO:teuthology.orchestra.run.smithi008.stdout: { 2023-08-01T19:54:54.887 INFO:teuthology.orchestra.run.smithi008.stdout: "event": "header_read", 2023-08-01T19:54:54.887 INFO:teuthology.orchestra.run.smithi008.stdout: "time": "2023-08-01T19:54:50.841516+0000", 2023-08-01T19:54:54.887 INFO:teuthology.orchestra.run.smithi008.stdout: "duration": 4294967295.9999995 2023-08-01T19:54:54.887 INFO:teuthology.orchestra.run.smithi008.stdout: }, 2023-08-01T19:54:54.887 INFO:teuthology.orchestra.run.smithi008.stdout: { 2023-08-01T19:54:54.887 INFO:teuthology.orchestra.run.smithi008.stdout: "event": "all_read", 2023-08-01T19:54:54.887 INFO:teuthology.orchestra.run.smithi008.stdout: "time": "2023-08-01T19:54:50.841540+0000", 2023-08-01T19:54:54.888 INFO:teuthology.orchestra.run.smithi008.stdout: "duration": 2.3988000000000001e-05 2023-08-01T19:54:54.888 INFO:teuthology.orchestra.run.smithi008.stdout: }, 2023-08-01T19:54:54.888 INFO:teuthology.orchestra.run.smithi008.stdout: { 2023-08-01T19:54:54.888 INFO:teuthology.orchestra.run.smithi008.stdout: "event": "dispatched", 2023-08-01T19:54:54.888 INFO:teuthology.orchestra.run.smithi008.stdout: "time": "2023-08-01T19:54:50.841548+0000", 2023-08-01T19:54:54.888 INFO:teuthology.orchestra.run.smithi008.stdout: "duration": 7.4209999999999998e-06 2023-08-01T19:54:54.888 INFO:teuthology.orchestra.run.smithi008.stdout: }, 2023-08-01T19:54:54.889 INFO:teuthology.orchestra.run.smithi008.stdout: { 2023-08-01T19:54:54.889 INFO:teuthology.orchestra.run.smithi008.stdout: "event": "queued_for_pg", 2023-08-01T19:54:54.889 INFO:teuthology.orchestra.run.smithi008.stdout: "time": "2023-08-01T19:54:50.841552+0000", 2023-08-01T19:54:54.889 INFO:teuthology.orchestra.run.smithi008.stdout: "duration": 4.9540000000000003e-06 2023-08-01T19:54:54.889 INFO:teuthology.orchestra.run.smithi008.stdout: }, 2023-08-01T19:54:54.889 INFO:teuthology.orchestra.run.smithi008.stdout: { 2023-08-01T19:54:54.889 INFO:teuthology.orchestra.run.smithi008.stdout: "event": "reached_pg", 2023-08-01T19:54:54.890 INFO:teuthology.orchestra.run.smithi008.stdout: "time": "2023-08-01T19:54:50.845762+0000", 2023-08-01T19:54:54.890 INFO:teuthology.orchestra.run.smithi008.stdout: "duration": 0.0042091869999999997 2023-08-01T19:54:54.890 INFO:teuthology.orchestra.run.smithi008.stdout: }, 2023-08-01T19:54:54.890 INFO:teuthology.orchestra.run.smithi008.stdout: { 2023-08-01T19:54:54.890 INFO:teuthology.orchestra.run.smithi008.stdout: "event": "started", 2023-08-01T19:54:54.890 INFO:teuthology.orchestra.run.smithi008.stdout: "time": "2023-08-01T19:54:50.845910+0000", 2023-08-01T19:54:54.890 INFO:teuthology.orchestra.run.smithi008.stdout: "duration": 0.000148815 2023-08-01T19:54:54.890 INFO:teuthology.orchestra.run.smithi008.stdout: }, 2023-08-01T19:54:54.891 INFO:teuthology.orchestra.run.smithi008.stdout: { 2023-08-01T19:54:54.891 INFO:teuthology.orchestra.run.smithi008.stdout: "event": "waiting for subops from 1", 2023-08-01T19:54:54.891 INFO:teuthology.orchestra.run.smithi008.stdout: "time": "2023-08-01T19:54:50.846067+0000", 2023-08-01T19:54:54.891 INFO:teuthology.orchestra.run.smithi008.stdout: "duration": 0.000156501 2023-08-01T19:54:54.891 INFO:teuthology.orchestra.run.smithi008.stdout: }, 2023-08-01T19:54:54.891 INFO:teuthology.orchestra.run.smithi008.stdout: { 2023-08-01T19:54:54.891 INFO:teuthology.orchestra.run.smithi008.stdout: "event": "sub_op_commit_rec", 2023-08-01T19:54:54.891 INFO:teuthology.orchestra.run.smithi008.stdout: "time": "2023-08-01T19:54:50.851334+0000", 2023-08-01T19:54:54.892 INFO:teuthology.orchestra.run.smithi008.stdout: "duration": 0.0052670640000000001 2023-08-01T19:54:54.892 INFO:teuthology.orchestra.run.smithi008.stdout: }, 2023-08-01T19:54:54.892 INFO:teuthology.orchestra.run.smithi008.stdout: { 2023-08-01T19:54:54.892 INFO:teuthology.orchestra.run.smithi008.stdout: "event": "op_commit", 2023-08-01T19:54:54.892 INFO:teuthology.orchestra.run.smithi008.stdout: "time": "2023-08-01T19:54:50.856669+0000", 2023-08-01T19:54:54.892 INFO:teuthology.orchestra.run.smithi008.stdout: "duration": 0.0053349349999999999 2023-08-01T19:54:54.892 INFO:teuthology.orchestra.run.smithi008.stdout: }, 2023-08-01T19:54:54.893 INFO:teuthology.orchestra.run.smithi008.stdout: { 2023-08-01T19:54:54.893 INFO:teuthology.orchestra.run.smithi008.stdout: "event": "commit_sent", 2023-08-01T19:54:54.893 INFO:teuthology.orchestra.run.smithi008.stdout: "time": "2023-08-01T19:54:50.856700+0000", 2023-08-01T19:54:54.893 INFO:teuthology.orchestra.run.smithi008.stdout: "duration": 3.1251999999999998e-05 2023-08-01T19:54:54.893 INFO:teuthology.orchestra.run.smithi008.stdout: }, 2023-08-01T19:54:54.893 INFO:teuthology.orchestra.run.smithi008.stdout: { 2023-08-01T19:54:54.893 INFO:teuthology.orchestra.run.smithi008.stdout: "event": "done", 2023-08-01T19:54:54.893 INFO:teuthology.orchestra.run.smithi008.stdout: "time": "2023-08-01T19:54:50.856722+0000", 2023-08-01T19:54:54.894 INFO:teuthology.orchestra.run.smithi008.stdout: "duration": 2.2208000000000002e-05 2023-08-01T19:54:54.894 INFO:teuthology.orchestra.run.smithi008.stdout: } 2023-08-01T19:54:54.894 INFO:teuthology.orchestra.run.smithi008.stdout: ] 2023-08-01T19:54:54.894 INFO:teuthology.orchestra.run.smithi008.stdout: } 2023-08-01T19:54:54.894 INFO:teuthology.orchestra.run.smithi008.stdout: }, 2023-08-01T19:54:54.894 INFO:teuthology.orchestra.run.smithi008.stdout: { 2023-08-01T19:54:54.894 INFO:teuthology.orchestra.run.smithi008.stdout: "description": "osd_op(client.4668.0:72937 5.6 5:690f72b2:::benchmark_data_smithi006_114134_object72936:head [set-alloc-hint object_size 65536 write_size 65536,write 0~65536] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e31)", 2023-08-01T19:54:54.894 INFO:teuthology.orchestra.run.smithi008.stdout: "initiated_at": "2023-08-01T19:54:51.214102+0000", 2023-08-01T19:54:54.895 INFO:teuthology.orchestra.run.smithi008.stdout: "age": 3.594271725, 2023-08-01T19:54:54.895 INFO:teuthology.orchestra.run.smithi008.stdout: "duration": 0.015280545, 2023-08-01T19:54:54.895 INFO:teuthology.orchestra.run.smithi008.stdout: "type_data": { 2023-08-01T19:54:54.895 INFO:teuthology.orchestra.run.smithi008.stdout: "flag_point": "commit sent; apply or cleanup", 2023-08-01T19:54:54.895 INFO:teuthology.orchestra.run.smithi008.stdout: "client_info": { 2023-08-01T19:54:54.895 INFO:teuthology.orchestra.run.smithi008.stdout: "client": "client.4668", 2023-08-01T19:54:54.895 INFO:teuthology.orchestra.run.smithi008.stdout: "client_addr": "172.21.15.6:0/1709472247", 2023-08-01T19:54:54.896 INFO:teuthology.orchestra.run.smithi008.stdout: "tid": 72937 2023-08-01T19:54:54.896 INFO:teuthology.orchestra.run.smithi008.stdout: }, 2023-08-01T19:54:54.896 INFO:teuthology.orchestra.run.smithi008.stdout: "events": [ 2023-08-01T19:54:54.896 INFO:teuthology.orchestra.run.smithi008.stdout: { 2023-08-01T19:54:54.896 INFO:teuthology.orchestra.run.smithi008.stdout: "event": "initiated", 2023-08-01T19:54:54.896 INFO:teuthology.orchestra.run.smithi008.stdout: "time": "2023-08-01T19:54:51.214102+0000", 2023-08-01T19:54:54.896 INFO:teuthology.orchestra.run.smithi008.stdout: "duration": 0 2023-08-01T19:54:54.896 INFO:teuthology.orchestra.run.smithi008.stdout: }, 2023-08-01T19:54:54.897 INFO:teuthology.orchestra.run.smithi008.stdout: { 2023-08-01T19:54:54.897 INFO:teuthology.orchestra.run.smithi008.stdout: "event": "throttled", 2023-08-01T19:54:54.897 INFO:teuthology.orchestra.run.smithi008.stdout: "time": "2023-08-01T19:54:51.214102+0000", 2023-08-01T19:54:54.897 INFO:teuthology.orchestra.run.smithi008.stdout: "duration": 0 2023-08-01T19:54:54.897 INFO:teuthology.orchestra.run.smithi008.stdout: }, 2023-08-01T19:54:54.897 INFO:teuthology.orchestra.run.smithi008.stdout: { 2023-08-01T19:54:54.897 INFO:teuthology.orchestra.run.smithi008.stdout: "event": "header_read", 2023-08-01T19:54:54.897 INFO:teuthology.orchestra.run.smithi008.stdout: "time": "2023-08-01T19:54:51.214102+0000", 2023-08-01T19:54:54.898 INFO:teuthology.orchestra.run.smithi008.stdout: "duration": 4294967295.9999995 2023-08-01T19:54:54.898 INFO:teuthology.orchestra.run.smithi008.stdout: }, 2023-08-01T19:54:54.898 INFO:teuthology.orchestra.run.smithi008.stdout: { 2023-08-01T19:54:54.898 INFO:teuthology.orchestra.run.smithi008.stdout: "event": "all_read", 2023-08-01T19:54:54.898 INFO:teuthology.orchestra.run.smithi008.stdout: "time": "2023-08-01T19:54:51.214128+0000", 2023-08-01T19:54:54.898 INFO:teuthology.orchestra.run.smithi008.stdout: "duration": 2.6049000000000001e-05 2023-08-01T19:54:54.898 INFO:teuthology.orchestra.run.smithi008.stdout: }, 2023-08-01T19:54:54.899 INFO:teuthology.orchestra.run.smithi008.stdout: { 2023-08-01T19:54:54.899 INFO:teuthology.orchestra.run.smithi008.stdout: "event": "dispatched", 2023-08-01T19:54:54.899 INFO:teuthology.orchestra.run.smithi008.stdout: "time": "2023-08-01T19:54:51.214135+0000", 2023-08-01T19:54:54.899 INFO:teuthology.orchestra.run.smithi008.stdout: "duration": 7.8590000000000005e-06 2023-08-01T19:54:54.899 INFO:teuthology.orchestra.run.smithi008.stdout: }, 2023-08-01T19:54:54.899 INFO:teuthology.orchestra.run.smithi008.stdout: { 2023-08-01T19:54:54.899 INFO:teuthology.orchestra.run.smithi008.stdout: "event": "queued_for_pg", 2023-08-01T19:54:54.899 INFO:teuthology.orchestra.run.smithi008.stdout: "time": "2023-08-01T19:54:51.214140+0000", 2023-08-01T19:54:54.900 INFO:teuthology.orchestra.run.smithi008.stdout: "duration": 4.5000000000000001e-06 2023-08-01T19:54:54.900 INFO:teuthology.orchestra.run.smithi008.stdout: }, 2023-08-01T19:54:54.900 INFO:teuthology.orchestra.run.smithi008.stdout: { 2023-08-01T19:54:54.900 INFO:teuthology.orchestra.run.smithi008.stdout: "event": "reached_pg", 2023-08-01T19:54:54.900 INFO:teuthology.orchestra.run.smithi008.stdout: "time": "2023-08-01T19:54:51.216270+0000", 2023-08-01T19:54:54.900 INFO:teuthology.orchestra.run.smithi008.stdout: "duration": 0.0021297820000000002 2023-08-01T19:54:54.900 INFO:teuthology.orchestra.run.smithi008.stdout: }, 2023-08-01T19:54:54.900 INFO:teuthology.orchestra.run.smithi008.stdout: { 2023-08-01T19:54:54.901 INFO:teuthology.orchestra.run.smithi008.stdout: "event": "started", 2023-08-01T19:54:54.901 INFO:teuthology.orchestra.run.smithi008.stdout: "time": "2023-08-01T19:54:51.216395+0000", 2023-08-01T19:54:54.901 INFO:teuthology.orchestra.run.smithi008.stdout: "duration": 0.000125384 2023-08-01T19:54:54.901 INFO:teuthology.orchestra.run.smithi008.stdout: }, 2023-08-01T19:54:54.901 INFO:teuthology.orchestra.run.smithi008.stdout: { 2023-08-01T19:54:54.901 INFO:teuthology.orchestra.run.smithi008.stdout: "event": "waiting for subops from 1", 2023-08-01T19:54:54.901 INFO:teuthology.orchestra.run.smithi008.stdout: "time": "2023-08-01T19:54:51.216561+0000", 2023-08-01T19:54:54.901 INFO:teuthology.orchestra.run.smithi008.stdout: "duration": 0.00016589900000000001 2023-08-01T19:54:54.902 INFO:teuthology.orchestra.run.smithi008.stdout: }, 2023-08-01T19:54:54.902 INFO:teuthology.orchestra.run.smithi008.stdout: { 2023-08-01T19:54:54.902 INFO:teuthology.orchestra.run.smithi008.stdout: "event": "sub_op_commit_rec", 2023-08-01T19:54:54.902 INFO:teuthology.orchestra.run.smithi008.stdout: "time": "2023-08-01T19:54:51.220839+0000", 2023-08-01T19:54:54.902 INFO:teuthology.orchestra.run.smithi008.stdout: "duration": 0.004278202 2023-08-01T19:54:54.902 INFO:teuthology.orchestra.run.smithi008.stdout: }, 2023-08-01T19:54:54.902 INFO:teuthology.orchestra.run.smithi008.stdout: { 2023-08-01T19:54:54.902 INFO:teuthology.orchestra.run.smithi008.stdout: "event": "op_commit", 2023-08-01T19:54:54.903 INFO:teuthology.orchestra.run.smithi008.stdout: "time": "2023-08-01T19:54:51.229298+0000", 2023-08-01T19:54:54.903 INFO:teuthology.orchestra.run.smithi008.stdout: "duration": 0.0084587499999999993 2023-08-01T19:54:54.903 INFO:teuthology.orchestra.run.smithi008.stdout: }, 2023-08-01T19:54:54.903 INFO:teuthology.orchestra.run.smithi008.stdout: { 2023-08-01T19:54:54.903 INFO:teuthology.orchestra.run.smithi008.stdout: "event": "commit_sent", 2023-08-01T19:54:54.903 INFO:teuthology.orchestra.run.smithi008.stdout: "time": "2023-08-01T19:54:51.229352+0000", 2023-08-01T19:54:54.903 INFO:teuthology.orchestra.run.smithi008.stdout: "duration": 5.4289000000000001e-05 2023-08-01T19:54:54.904 INFO:teuthology.orchestra.run.smithi008.stdout: }, 2023-08-01T19:54:54.904 INFO:teuthology.orchestra.run.smithi008.stdout: { 2023-08-01T19:54:54.904 INFO:teuthology.orchestra.run.smithi008.stdout: "event": "done", 2023-08-01T19:54:54.904 INFO:teuthology.orchestra.run.smithi008.stdout: "time": "2023-08-01T19:54:51.229383+0000", 2023-08-01T19:54:54.904 INFO:teuthology.orchestra.run.smithi008.stdout: "duration": 3.0324999999999998e-05 2023-08-01T19:54:54.904 INFO:teuthology.orchestra.run.smithi008.stdout: } 2023-08-01T19:54:54.904 INFO:teuthology.orchestra.run.smithi008.stdout: ] 2023-08-01T19:54:54.904 INFO:teuthology.orchestra.run.smithi008.stdout: } 2023-08-01T19:54:54.905 INFO:teuthology.orchestra.run.smithi008.stdout: }, 2023-08-01T19:54:54.905 INFO:teuthology.orchestra.run.smithi008.stdout: { 2023-08-01T19:54:54.905 INFO:teuthology.orchestra.run.smithi008.stdout: "description": "osd_op(client.4668.0:74271 5.a 5:510c0950:::benchmark_data_smithi006_114134_object74270:head [set-alloc-hint object_size 65536 write_size 65536,write 0~65536] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e31)", 2023-08-01T19:54:54.905 INFO:teuthology.orchestra.run.smithi008.stdout: "initiated_at": "2023-08-01T19:54:51.858239+0000", 2023-08-01T19:54:54.905 INFO:teuthology.orchestra.run.smithi008.stdout: "age": 2.9501350300000002, 2023-08-01T19:54:54.905 INFO:teuthology.orchestra.run.smithi008.stdout: "duration": 0.015474116, 2023-08-01T19:54:54.905 INFO:teuthology.orchestra.run.smithi008.stdout: "type_data": { 2023-08-01T19:54:54.905 INFO:teuthology.orchestra.run.smithi008.stdout: "flag_point": "commit sent; apply or cleanup", 2023-08-01T19:54:54.906 INFO:teuthology.orchestra.run.smithi008.stdout: "client_info": { 2023-08-01T19:54:54.906 INFO:teuthology.orchestra.run.smithi008.stdout: "client": "client.4668", 2023-08-01T19:54:54.906 INFO:teuthology.orchestra.run.smithi008.stdout: "client_addr": "172.21.15.6:0/1709472247", 2023-08-01T19:54:54.906 INFO:teuthology.orchestra.run.smithi008.stdout: "tid": 74271 2023-08-01T19:54:54.906 INFO:teuthology.orchestra.run.smithi008.stdout: }, 2023-08-01T19:54:54.906 INFO:teuthology.orchestra.run.smithi008.stdout: "events": [ 2023-08-01T19:54:54.906 INFO:teuthology.orchestra.run.smithi008.stdout: { 2023-08-01T19:54:54.906 INFO:teuthology.orchestra.run.smithi008.stdout: "event": "initiated", 2023-08-01T19:54:54.907 INFO:teuthology.orchestra.run.smithi008.stdout: "time": "2023-08-01T19:54:51.858239+0000", 2023-08-01T19:54:54.907 INFO:teuthology.orchestra.run.smithi008.stdout: "duration": 0 2023-08-01T19:54:54.907 INFO:teuthology.orchestra.run.smithi008.stdout: }, 2023-08-01T19:54:54.907 INFO:teuthology.orchestra.run.smithi008.stdout: { 2023-08-01T19:54:54.907 INFO:teuthology.orchestra.run.smithi008.stdout: "event": "throttled", 2023-08-01T19:54:54.907 INFO:teuthology.orchestra.run.smithi008.stdout: "time": "2023-08-01T19:54:51.858239+0000", 2023-08-01T19:54:54.907 INFO:teuthology.orchestra.run.smithi008.stdout: "duration": 0 2023-08-01T19:54:54.908 INFO:teuthology.orchestra.run.smithi008.stdout: }, 2023-08-01T19:54:54.908 INFO:teuthology.orchestra.run.smithi008.stdout: { 2023-08-01T19:54:54.908 INFO:teuthology.orchestra.run.smithi008.stdout: "event": "header_read", 2023-08-01T19:54:54.908 INFO:teuthology.orchestra.run.smithi008.stdout: "time": "2023-08-01T19:54:51.858238+0000", 2023-08-01T19:54:54.908 INFO:teuthology.orchestra.run.smithi008.stdout: "duration": 4294967295.999999 2023-08-01T19:54:54.908 INFO:teuthology.orchestra.run.smithi008.stdout: }, 2023-08-01T19:54:54.908 INFO:teuthology.orchestra.run.smithi008.stdout: { 2023-08-01T19:54:54.908 INFO:teuthology.orchestra.run.smithi008.stdout: "event": "all_read", 2023-08-01T19:54:54.909 INFO:teuthology.orchestra.run.smithi008.stdout: "time": "2023-08-01T19:54:51.858355+0000", 2023-08-01T19:54:54.909 INFO:teuthology.orchestra.run.smithi008.stdout: "duration": 0.000117277 2023-08-01T19:54:54.909 INFO:teuthology.orchestra.run.smithi008.stdout: }, 2023-08-01T19:54:54.909 INFO:teuthology.orchestra.run.smithi008.stdout: { 2023-08-01T19:54:54.909 INFO:teuthology.orchestra.run.smithi008.stdout: "event": "dispatched", 2023-08-01T19:54:54.909 INFO:teuthology.orchestra.run.smithi008.stdout: "time": "2023-08-01T19:54:51.858365+0000", 2023-08-01T19:54:54.909 INFO:teuthology.orchestra.run.smithi008.stdout: "duration": 9.3999999999999998e-06 2023-08-01T19:54:54.909 INFO:teuthology.orchestra.run.smithi008.stdout: }, 2023-08-01T19:54:54.910 INFO:teuthology.orchestra.run.smithi008.stdout: { 2023-08-01T19:54:54.910 INFO:teuthology.orchestra.run.smithi008.stdout: "event": "queued_for_pg", 2023-08-01T19:54:54.910 INFO:teuthology.orchestra.run.smithi008.stdout: "time": "2023-08-01T19:54:51.858370+0000", 2023-08-01T19:54:54.910 INFO:teuthology.orchestra.run.smithi008.stdout: "duration": 5.361e-06 2023-08-01T19:54:54.910 INFO:teuthology.orchestra.run.smithi008.stdout: }, 2023-08-01T19:54:54.910 INFO:teuthology.orchestra.run.smithi008.stdout: { 2023-08-01T19:54:54.910 INFO:teuthology.orchestra.run.smithi008.stdout: "event": "reached_pg", 2023-08-01T19:54:54.910 INFO:teuthology.orchestra.run.smithi008.stdout: "time": "2023-08-01T19:54:51.861465+0000", 2023-08-01T19:54:54.911 INFO:teuthology.orchestra.run.smithi008.stdout: "duration": 0.0030946290000000002 2023-08-01T19:54:54.911 INFO:teuthology.orchestra.run.smithi008.stdout: }, 2023-08-01T19:54:54.911 INFO:teuthology.orchestra.run.smithi008.stdout: { 2023-08-01T19:54:54.911 INFO:teuthology.orchestra.run.smithi008.stdout: "event": "started", 2023-08-01T19:54:54.911 INFO:teuthology.orchestra.run.smithi008.stdout: "time": "2023-08-01T19:54:51.861622+0000", 2023-08-01T19:54:54.911 INFO:teuthology.orchestra.run.smithi008.stdout: "duration": 0.00015781000000000001 2023-08-01T19:54:54.911 INFO:teuthology.orchestra.run.smithi008.stdout: }, 2023-08-01T19:54:54.911 INFO:teuthology.orchestra.run.smithi008.stdout: { 2023-08-01T19:54:54.912 INFO:teuthology.orchestra.run.smithi008.stdout: "event": "waiting for subops from 2", 2023-08-01T19:54:54.912 INFO:teuthology.orchestra.run.smithi008.stdout: "time": "2023-08-01T19:54:51.861782+0000", 2023-08-01T19:54:54.912 INFO:teuthology.orchestra.run.smithi008.stdout: "duration": 0.000159693 2023-08-01T19:54:54.912 INFO:teuthology.orchestra.run.smithi008.stdout: }, 2023-08-01T19:54:54.912 INFO:teuthology.orchestra.run.smithi008.stdout: { 2023-08-01T19:54:54.912 INFO:teuthology.orchestra.run.smithi008.stdout: "event": "op_commit", 2023-08-01T19:54:54.912 INFO:teuthology.orchestra.run.smithi008.stdout: "time": "2023-08-01T19:54:51.867540+0000", 2023-08-01T19:54:54.913 INFO:teuthology.orchestra.run.smithi008.stdout: "duration": 0.0057582889999999998 2023-08-01T19:54:54.913 INFO:teuthology.orchestra.run.smithi008.stdout: }, 2023-08-01T19:54:54.913 INFO:teuthology.orchestra.run.smithi008.stdout: { 2023-08-01T19:54:54.913 INFO:teuthology.orchestra.run.smithi008.stdout: "event": "sub_op_commit_rec", 2023-08-01T19:54:54.913 INFO:teuthology.orchestra.run.smithi008.stdout: "time": "2023-08-01T19:54:51.873630+0000", 2023-08-01T19:54:54.913 INFO:teuthology.orchestra.run.smithi008.stdout: "duration": 0.0060899659999999996 2023-08-01T19:54:54.913 INFO:teuthology.orchestra.run.smithi008.stdout: }, 2023-08-01T19:54:54.913 INFO:teuthology.orchestra.run.smithi008.stdout: { 2023-08-01T19:54:54.914 INFO:teuthology.orchestra.run.smithi008.stdout: "event": "commit_sent", 2023-08-01T19:54:54.914 INFO:teuthology.orchestra.run.smithi008.stdout: "time": "2023-08-01T19:54:51.873678+0000", 2023-08-01T19:54:54.914 INFO:teuthology.orchestra.run.smithi008.stdout: "duration": 4.7975000000000001e-05 2023-08-01T19:54:54.914 INFO:teuthology.orchestra.run.smithi008.stdout: }, 2023-08-01T19:54:54.914 INFO:teuthology.orchestra.run.smithi008.stdout: { 2023-08-01T19:54:54.914 INFO:teuthology.orchestra.run.smithi008.stdout: "event": "done", 2023-08-01T19:54:54.914 INFO:teuthology.orchestra.run.smithi008.stdout: "time": "2023-08-01T19:54:51.873713+0000", 2023-08-01T19:54:54.914 INFO:teuthology.orchestra.run.smithi008.stdout: "duration": 3.4629999999999999e-05 2023-08-01T19:54:54.915 INFO:teuthology.orchestra.run.smithi008.stdout: } 2023-08-01T19:54:54.915 INFO:teuthology.orchestra.run.smithi008.stdout: ] 2023-08-01T19:54:54.915 INFO:teuthology.orchestra.run.smithi008.stdout: } 2023-08-01T19:54:54.915 INFO:teuthology.orchestra.run.smithi008.stdout: }, 2023-08-01T19:54:54.915 INFO:teuthology.orchestra.run.smithi008.stdout: { 2023-08-01T19:54:54.915 INFO:teuthology.orchestra.run.smithi008.stdout: "description": "osd_op(client.4668.0:74273 5.a 5:5dd61108:::benchmark_data_smithi006_114134_object74272:head [set-alloc-hint object_size 65536 write_size 65536,write 0~65536] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e31)", 2023-08-01T19:54:54.915 INFO:teuthology.orchestra.run.smithi008.stdout: "initiated_at": "2023-08-01T19:54:51.858577+0000", 2023-08-01T19:54:54.915 INFO:teuthology.orchestra.run.smithi008.stdout: "age": 2.9497968409999999, 2023-08-01T19:54:54.916 INFO:teuthology.orchestra.run.smithi008.stdout: "duration": 0.015258379000000001, 2023-08-01T19:54:54.916 INFO:teuthology.orchestra.run.smithi008.stdout: "type_data": { 2023-08-01T19:54:54.916 INFO:teuthology.orchestra.run.smithi008.stdout: "flag_point": "commit sent; apply or cleanup", 2023-08-01T19:54:54.916 INFO:teuthology.orchestra.run.smithi008.stdout: "client_info": { 2023-08-01T19:54:54.916 INFO:teuthology.orchestra.run.smithi008.stdout: "client": "client.4668", 2023-08-01T19:54:54.916 INFO:teuthology.orchestra.run.smithi008.stdout: "client_addr": "172.21.15.6:0/1709472247", 2023-08-01T19:54:54.916 INFO:teuthology.orchestra.run.smithi008.stdout: "tid": 74273 2023-08-01T19:54:54.917 INFO:teuthology.orchestra.run.smithi008.stdout: }, 2023-08-01T19:54:54.917 INFO:teuthology.orchestra.run.smithi008.stdout: "events": [ 2023-08-01T19:54:54.917 INFO:teuthology.orchestra.run.smithi008.stdout: { 2023-08-01T19:54:54.917 INFO:teuthology.orchestra.run.smithi008.stdout: "event": "initiated", 2023-08-01T19:54:54.917 INFO:teuthology.orchestra.run.smithi008.stdout: "time": "2023-08-01T19:54:51.858577+0000", 2023-08-01T19:54:54.917 INFO:teuthology.orchestra.run.smithi008.stdout: "duration": 0 2023-08-01T19:54:54.917 INFO:teuthology.orchestra.run.smithi008.stdout: }, 2023-08-01T19:54:54.917 INFO:teuthology.orchestra.run.smithi008.stdout: { 2023-08-01T19:54:54.918 INFO:teuthology.orchestra.run.smithi008.stdout: "event": "throttled", 2023-08-01T19:54:54.918 INFO:teuthology.orchestra.run.smithi008.stdout: "time": "2023-08-01T19:54:51.858577+0000", 2023-08-01T19:54:54.918 INFO:teuthology.orchestra.run.smithi008.stdout: "duration": 0 2023-08-01T19:54:54.918 INFO:teuthology.orchestra.run.smithi008.stdout: }, 2023-08-01T19:54:54.918 INFO:teuthology.orchestra.run.smithi008.stdout: { 2023-08-01T19:54:54.918 INFO:teuthology.orchestra.run.smithi008.stdout: "event": "header_read", 2023-08-01T19:54:54.918 INFO:teuthology.orchestra.run.smithi008.stdout: "time": "2023-08-01T19:54:51.858576+0000", 2023-08-01T19:54:54.918 INFO:teuthology.orchestra.run.smithi008.stdout: "duration": 4294967295.999999 2023-08-01T19:54:54.919 INFO:teuthology.orchestra.run.smithi008.stdout: }, 2023-08-01T19:54:54.919 INFO:teuthology.orchestra.run.smithi008.stdout: { 2023-08-01T19:54:54.919 INFO:teuthology.orchestra.run.smithi008.stdout: "event": "all_read", 2023-08-01T19:54:54.919 INFO:teuthology.orchestra.run.smithi008.stdout: "time": "2023-08-01T19:54:51.858654+0000", 2023-08-01T19:54:54.919 INFO:teuthology.orchestra.run.smithi008.stdout: "duration": 7.7909000000000002e-05 2023-08-01T19:54:54.919 INFO:teuthology.orchestra.run.smithi008.stdout: }, 2023-08-01T19:54:54.919 INFO:teuthology.orchestra.run.smithi008.stdout: { 2023-08-01T19:54:54.919 INFO:teuthology.orchestra.run.smithi008.stdout: "event": "dispatched", 2023-08-01T19:54:54.920 INFO:teuthology.orchestra.run.smithi008.stdout: "time": "2023-08-01T19:54:51.858663+0000", 2023-08-01T19:54:54.920 INFO:teuthology.orchestra.run.smithi008.stdout: "duration": 8.9060000000000008e-06 2023-08-01T19:54:54.920 INFO:teuthology.orchestra.run.smithi008.stdout: }, 2023-08-01T19:54:54.920 INFO:teuthology.orchestra.run.smithi008.stdout: { 2023-08-01T19:54:54.920 INFO:teuthology.orchestra.run.smithi008.stdout: "event": "queued_for_pg", 2023-08-01T19:54:54.920 INFO:teuthology.orchestra.run.smithi008.stdout: "time": "2023-08-01T19:54:51.858670+0000", 2023-08-01T19:54:54.920 INFO:teuthology.orchestra.run.smithi008.stdout: "duration": 7.3799999999999996e-06 2023-08-01T19:54:54.921 INFO:teuthology.orchestra.run.smithi008.stdout: }, 2023-08-01T19:54:54.921 INFO:teuthology.orchestra.run.smithi008.stdout: { 2023-08-01T19:54:54.921 INFO:teuthology.orchestra.run.smithi008.stdout: "event": "reached_pg", 2023-08-01T19:54:54.921 INFO:teuthology.orchestra.run.smithi008.stdout: "time": "2023-08-01T19:54:51.863680+0000", 2023-08-01T19:54:54.921 INFO:teuthology.orchestra.run.smithi008.stdout: "duration": 0.0050096259999999997 2023-08-01T19:54:54.921 INFO:teuthology.orchestra.run.smithi008.stdout: }, 2023-08-01T19:54:54.921 INFO:teuthology.orchestra.run.smithi008.stdout: { 2023-08-01T19:54:54.921 INFO:teuthology.orchestra.run.smithi008.stdout: "event": "started", 2023-08-01T19:54:54.922 INFO:teuthology.orchestra.run.smithi008.stdout: "time": "2023-08-01T19:54:51.863817+0000", 2023-08-01T19:54:54.922 INFO:teuthology.orchestra.run.smithi008.stdout: "duration": 0.00013683900000000001 2023-08-01T19:54:54.922 INFO:teuthology.orchestra.run.smithi008.stdout: }, 2023-08-01T19:54:54.922 INFO:teuthology.orchestra.run.smithi008.stdout: { 2023-08-01T19:54:54.922 INFO:teuthology.orchestra.run.smithi008.stdout: "event": "waiting for subops from 2", 2023-08-01T19:54:54.922 INFO:teuthology.orchestra.run.smithi008.stdout: "time": "2023-08-01T19:54:51.863983+0000", 2023-08-01T19:54:54.922 INFO:teuthology.orchestra.run.smithi008.stdout: "duration": 0.00016626600000000001 2023-08-01T19:54:54.922 INFO:teuthology.orchestra.run.smithi008.stdout: }, 2023-08-01T19:54:54.923 INFO:teuthology.orchestra.run.smithi008.stdout: { 2023-08-01T19:54:54.923 INFO:teuthology.orchestra.run.smithi008.stdout: "event": "op_commit", 2023-08-01T19:54:54.923 INFO:teuthology.orchestra.run.smithi008.stdout: "time": "2023-08-01T19:54:51.871752+0000", 2023-08-01T19:54:54.923 INFO:teuthology.orchestra.run.smithi008.stdout: "duration": 0.0077690370000000003 2023-08-01T19:54:54.923 INFO:teuthology.orchestra.run.smithi008.stdout: }, 2023-08-01T19:54:54.923 INFO:teuthology.orchestra.run.smithi008.stdout: { 2023-08-01T19:54:54.923 INFO:teuthology.orchestra.run.smithi008.stdout: "event": "sub_op_commit_rec", 2023-08-01T19:54:54.923 INFO:teuthology.orchestra.run.smithi008.stdout: "time": "2023-08-01T19:54:51.873763+0000", 2023-08-01T19:54:54.924 INFO:teuthology.orchestra.run.smithi008.stdout: "duration": 0.0020105930000000002 2023-08-01T19:54:54.924 INFO:teuthology.orchestra.run.smithi008.stdout: }, 2023-08-01T19:54:54.924 INFO:teuthology.orchestra.run.smithi008.stdout: { 2023-08-01T19:54:54.924 INFO:teuthology.orchestra.run.smithi008.stdout: "event": "commit_sent", 2023-08-01T19:54:54.924 INFO:teuthology.orchestra.run.smithi008.stdout: "time": "2023-08-01T19:54:51.873803+0000", 2023-08-01T19:54:54.924 INFO:teuthology.orchestra.run.smithi008.stdout: "duration": 3.9873999999999998e-05 2023-08-01T19:54:54.924 INFO:teuthology.orchestra.run.smithi008.stdout: }, 2023-08-01T19:54:54.924 INFO:teuthology.orchestra.run.smithi008.stdout: { 2023-08-01T19:54:54.925 INFO:teuthology.orchestra.run.smithi008.stdout: "event": "done", 2023-08-01T19:54:54.925 INFO:teuthology.orchestra.run.smithi008.stdout: "time": "2023-08-01T19:54:51.873835+0000", 2023-08-01T19:54:54.925 INFO:teuthology.orchestra.run.smithi008.stdout: "duration": 3.2700999999999997e-05 2023-08-01T19:54:54.925 INFO:teuthology.orchestra.run.smithi008.stdout: } 2023-08-01T19:54:54.925 INFO:teuthology.orchestra.run.smithi008.stdout: ] 2023-08-01T19:54:54.925 INFO:teuthology.orchestra.run.smithi008.stdout: } 2023-08-01T19:54:54.925 INFO:teuthology.orchestra.run.smithi008.stdout: }, 2023-08-01T19:54:54.925 INFO:teuthology.orchestra.run.smithi008.stdout: { 2023-08-01T19:54:54.926 INFO:teuthology.orchestra.run.smithi008.stdout: "description": "osd_op(client.4668.0:75014 5.c 5:3d8cba0f:::benchmark_data_smithi006_114134_object75013:head [set-alloc-hint object_size 65536 write_size 65536,write 0~65536] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e32)", 2023-08-01T19:54:54.926 INFO:teuthology.orchestra.run.smithi008.stdout: "initiated_at": "2023-08-01T19:54:52.218900+0000", 2023-08-01T19:54:54.926 INFO:teuthology.orchestra.run.smithi008.stdout: "age": 2.589473999, 2023-08-01T19:54:54.926 INFO:teuthology.orchestra.run.smithi008.stdout: "duration": 0.015819357999999999, 2023-08-01T19:54:54.926 INFO:teuthology.orchestra.run.smithi008.stdout: "type_data": { 2023-08-01T19:54:54.926 INFO:teuthology.orchestra.run.smithi008.stdout: "flag_point": "commit sent; apply or cleanup", 2023-08-01T19:54:54.926 INFO:teuthology.orchestra.run.smithi008.stdout: "client_info": { 2023-08-01T19:54:54.926 INFO:teuthology.orchestra.run.smithi008.stdout: "client": "client.4668", 2023-08-01T19:54:54.927 INFO:teuthology.orchestra.run.smithi008.stdout: "client_addr": "172.21.15.6:0/1709472247", 2023-08-01T19:54:54.927 INFO:teuthology.orchestra.run.smithi008.stdout: "tid": 75014 2023-08-01T19:54:54.927 INFO:teuthology.orchestra.run.smithi008.stdout: }, 2023-08-01T19:54:54.927 INFO:teuthology.orchestra.run.smithi008.stdout: "events": [ 2023-08-01T19:54:54.927 INFO:teuthology.orchestra.run.smithi008.stdout: { 2023-08-01T19:54:54.927 INFO:teuthology.orchestra.run.smithi008.stdout: "event": "initiated", 2023-08-01T19:54:54.927 INFO:teuthology.orchestra.run.smithi008.stdout: "time": "2023-08-01T19:54:52.218900+0000", 2023-08-01T19:54:54.928 INFO:teuthology.orchestra.run.smithi008.stdout: "duration": 0 2023-08-01T19:54:54.928 INFO:teuthology.orchestra.run.smithi008.stdout: }, 2023-08-01T19:54:54.928 INFO:teuthology.orchestra.run.smithi008.stdout: { 2023-08-01T19:54:54.928 INFO:teuthology.orchestra.run.smithi008.stdout: "event": "throttled", 2023-08-01T19:54:54.928 INFO:teuthology.orchestra.run.smithi008.stdout: "time": "2023-08-01T19:54:52.218900+0000", 2023-08-01T19:54:54.928 INFO:teuthology.orchestra.run.smithi008.stdout: "duration": 0 2023-08-01T19:54:54.928 INFO:teuthology.orchestra.run.smithi008.stdout: }, 2023-08-01T19:54:54.928 INFO:teuthology.orchestra.run.smithi008.stdout: { 2023-08-01T19:54:54.929 INFO:teuthology.orchestra.run.smithi008.stdout: "event": "header_read", 2023-08-01T19:54:54.929 INFO:teuthology.orchestra.run.smithi008.stdout: "time": "2023-08-01T19:54:52.218899+0000", 2023-08-01T19:54:54.929 INFO:teuthology.orchestra.run.smithi008.stdout: "duration": 4294967295.999999 2023-08-01T19:54:54.929 INFO:teuthology.orchestra.run.smithi008.stdout: }, 2023-08-01T19:54:54.929 INFO:teuthology.orchestra.run.smithi008.stdout: { 2023-08-01T19:54:54.929 INFO:teuthology.orchestra.run.smithi008.stdout: "event": "all_read", 2023-08-01T19:54:54.929 INFO:teuthology.orchestra.run.smithi008.stdout: "time": "2023-08-01T19:54:52.218930+0000", 2023-08-01T19:54:54.929 INFO:teuthology.orchestra.run.smithi008.stdout: "duration": 3.1211999999999999e-05 2023-08-01T19:54:54.930 INFO:teuthology.orchestra.run.smithi008.stdout: }, 2023-08-01T19:54:54.930 INFO:teuthology.orchestra.run.smithi008.stdout: { 2023-08-01T19:54:54.930 INFO:teuthology.orchestra.run.smithi008.stdout: "event": "dispatched", 2023-08-01T19:54:54.930 INFO:teuthology.orchestra.run.smithi008.stdout: "time": "2023-08-01T19:54:52.218938+0000", 2023-08-01T19:54:54.930 INFO:teuthology.orchestra.run.smithi008.stdout: "duration": 8.1850000000000004e-06 2023-08-01T19:54:54.930 INFO:teuthology.orchestra.run.smithi008.stdout: }, 2023-08-01T19:54:54.930 INFO:teuthology.orchestra.run.smithi008.stdout: { 2023-08-01T19:54:54.930 INFO:teuthology.orchestra.run.smithi008.stdout: "event": "queued_for_pg", 2023-08-01T19:54:54.931 INFO:teuthology.orchestra.run.smithi008.stdout: "time": "2023-08-01T19:54:52.218946+0000", 2023-08-01T19:54:54.931 INFO:teuthology.orchestra.run.smithi008.stdout: "duration": 7.272e-06 2023-08-01T19:54:54.931 INFO:teuthology.orchestra.run.smithi008.stdout: }, 2023-08-01T19:54:54.931 INFO:teuthology.orchestra.run.smithi008.stdout: { 2023-08-01T19:54:54.931 INFO:teuthology.orchestra.run.smithi008.stdout: "event": "reached_pg", 2023-08-01T19:54:54.931 INFO:teuthology.orchestra.run.smithi008.stdout: "time": "2023-08-01T19:54:52.218984+0000", 2023-08-01T19:54:54.931 INFO:teuthology.orchestra.run.smithi008.stdout: "duration": 3.8566000000000003e-05 2023-08-01T19:54:54.932 INFO:teuthology.orchestra.run.smithi008.stdout: }, 2023-08-01T19:54:54.932 INFO:teuthology.orchestra.run.smithi008.stdout: { 2023-08-01T19:54:54.932 INFO:teuthology.orchestra.run.smithi008.stdout: "event": "started", 2023-08-01T19:54:54.932 INFO:teuthology.orchestra.run.smithi008.stdout: "time": "2023-08-01T19:54:52.219093+0000", 2023-08-01T19:54:54.932 INFO:teuthology.orchestra.run.smithi008.stdout: "duration": 0.00010921000000000001 2023-08-01T19:54:54.932 INFO:teuthology.orchestra.run.smithi008.stdout: }, 2023-08-01T19:54:54.932 INFO:teuthology.orchestra.run.smithi008.stdout: { 2023-08-01T19:54:54.933 INFO:teuthology.orchestra.run.smithi008.stdout: "event": "waiting for subops from 1", 2023-08-01T19:54:54.933 INFO:teuthology.orchestra.run.smithi008.stdout: "time": "2023-08-01T19:54:52.219206+0000", 2023-08-01T19:54:54.933 INFO:teuthology.orchestra.run.smithi008.stdout: "duration": 0.00011312299999999999 2023-08-01T19:54:54.933 INFO:teuthology.orchestra.run.smithi008.stdout: }, 2023-08-01T19:54:54.933 INFO:teuthology.orchestra.run.smithi008.stdout: { 2023-08-01T19:54:54.933 INFO:teuthology.orchestra.run.smithi008.stdout: "event": "sub_op_commit_rec", 2023-08-01T19:54:54.933 INFO:teuthology.orchestra.run.smithi008.stdout: "time": "2023-08-01T19:54:52.224966+0000", 2023-08-01T19:54:54.933 INFO:teuthology.orchestra.run.smithi008.stdout: "duration": 0.0057594300000000003 2023-08-01T19:54:54.934 INFO:teuthology.orchestra.run.smithi008.stdout: }, 2023-08-01T19:54:54.934 INFO:teuthology.orchestra.run.smithi008.stdout: { 2023-08-01T19:54:54.934 INFO:teuthology.orchestra.run.smithi008.stdout: "event": "op_commit", 2023-08-01T19:54:54.934 INFO:teuthology.orchestra.run.smithi008.stdout: "time": "2023-08-01T19:54:52.234622+0000", 2023-08-01T19:54:54.934 INFO:teuthology.orchestra.run.smithi008.stdout: "duration": 0.0096563919999999998 2023-08-01T19:54:54.934 INFO:teuthology.orchestra.run.smithi008.stdout: }, 2023-08-01T19:54:54.934 INFO:teuthology.orchestra.run.smithi008.stdout: { 2023-08-01T19:54:54.935 INFO:teuthology.orchestra.run.smithi008.stdout: "event": "commit_sent", 2023-08-01T19:54:54.935 INFO:teuthology.orchestra.run.smithi008.stdout: "time": "2023-08-01T19:54:52.234674+0000", 2023-08-01T19:54:54.935 INFO:teuthology.orchestra.run.smithi008.stdout: "duration": 5.2212000000000001e-05 2023-08-01T19:54:54.935 INFO:teuthology.orchestra.run.smithi008.stdout: }, 2023-08-01T19:54:54.935 INFO:teuthology.orchestra.run.smithi008.stdout: { 2023-08-01T19:54:54.935 INFO:teuthology.orchestra.run.smithi008.stdout: "event": "done", 2023-08-01T19:54:54.935 INFO:teuthology.orchestra.run.smithi008.stdout: "time": "2023-08-01T19:54:52.234719+0000", 2023-08-01T19:54:54.935 INFO:teuthology.orchestra.run.smithi008.stdout: "duration": 4.4666000000000002e-05 2023-08-01T19:54:54.936 INFO:teuthology.orchestra.run.smithi008.stdout: } 2023-08-01T19:54:54.936 INFO:teuthology.orchestra.run.smithi008.stdout: ] 2023-08-01T19:54:54.936 INFO:teuthology.orchestra.run.smithi008.stdout: } 2023-08-01T19:54:54.936 INFO:teuthology.orchestra.run.smithi008.stdout: }, 2023-08-01T19:54:54.936 INFO:teuthology.orchestra.run.smithi008.stdout: { 2023-08-01T19:54:54.936 INFO:teuthology.orchestra.run.smithi008.stdout: "description": "osd_op(client.4668.0:75016 5.c 5:3bdd56bb:::benchmark_data_smithi006_114134_object75015:head [set-alloc-hint object_size 65536 write_size 65536,write 0~65536] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e32)", 2023-08-01T19:54:54.936 INFO:teuthology.orchestra.run.smithi008.stdout: "initiated_at": "2023-08-01T19:54:52.219222+0000", 2023-08-01T19:54:54.937 INFO:teuthology.orchestra.run.smithi008.stdout: "age": 2.589152221, 2023-08-01T19:54:54.937 INFO:teuthology.orchestra.run.smithi008.stdout: "duration": 0.01558884, 2023-08-01T19:54:54.937 INFO:teuthology.orchestra.run.smithi008.stdout: "type_data": { 2023-08-01T19:54:54.937 INFO:teuthology.orchestra.run.smithi008.stdout: "flag_point": "commit sent; apply or cleanup", 2023-08-01T19:54:54.937 INFO:teuthology.orchestra.run.smithi008.stdout: "client_info": { 2023-08-01T19:54:54.937 INFO:teuthology.orchestra.run.smithi008.stdout: "client": "client.4668", 2023-08-01T19:54:54.937 INFO:teuthology.orchestra.run.smithi008.stdout: "client_addr": "172.21.15.6:0/1709472247", 2023-08-01T19:54:54.937 INFO:teuthology.orchestra.run.smithi008.stdout: "tid": 75016 2023-08-01T19:54:54.938 INFO:teuthology.orchestra.run.smithi008.stdout: }, 2023-08-01T19:54:54.938 INFO:teuthology.orchestra.run.smithi008.stdout: "events": [ 2023-08-01T19:54:54.938 INFO:teuthology.orchestra.run.smithi008.stdout: { 2023-08-01T19:54:54.938 INFO:teuthology.orchestra.run.smithi008.stdout: "event": "initiated", 2023-08-01T19:54:54.938 INFO:teuthology.orchestra.run.smithi008.stdout: "time": "2023-08-01T19:54:52.219222+0000", 2023-08-01T19:54:54.938 INFO:teuthology.orchestra.run.smithi008.stdout: "duration": 0 2023-08-01T19:54:54.938 INFO:teuthology.orchestra.run.smithi008.stdout: }, 2023-08-01T19:54:54.938 INFO:teuthology.orchestra.run.smithi008.stdout: { 2023-08-01T19:54:54.939 INFO:teuthology.orchestra.run.smithi008.stdout: "event": "throttled", 2023-08-01T19:54:54.939 INFO:teuthology.orchestra.run.smithi008.stdout: "time": "2023-08-01T19:54:52.219222+0000", 2023-08-01T19:54:54.939 INFO:teuthology.orchestra.run.smithi008.stdout: "duration": 0 2023-08-01T19:54:54.939 INFO:teuthology.orchestra.run.smithi008.stdout: }, 2023-08-01T19:54:54.939 INFO:teuthology.orchestra.run.smithi008.stdout: { 2023-08-01T19:54:54.939 INFO:teuthology.orchestra.run.smithi008.stdout: "event": "header_read", 2023-08-01T19:54:54.939 INFO:teuthology.orchestra.run.smithi008.stdout: "time": "2023-08-01T19:54:52.219221+0000", 2023-08-01T19:54:54.940 INFO:teuthology.orchestra.run.smithi008.stdout: "duration": 4294967295.999999 2023-08-01T19:54:54.940 INFO:teuthology.orchestra.run.smithi008.stdout: }, 2023-08-01T19:54:54.940 INFO:teuthology.orchestra.run.smithi008.stdout: { 2023-08-01T19:54:54.940 INFO:teuthology.orchestra.run.smithi008.stdout: "event": "all_read", 2023-08-01T19:54:54.940 INFO:teuthology.orchestra.run.smithi008.stdout: "time": "2023-08-01T19:54:52.219378+0000", 2023-08-01T19:54:54.940 INFO:teuthology.orchestra.run.smithi008.stdout: "duration": 0.00015761799999999999 2023-08-01T19:54:54.940 INFO:teuthology.orchestra.run.smithi008.stdout: }, 2023-08-01T19:54:54.940 INFO:teuthology.orchestra.run.smithi008.stdout: { 2023-08-01T19:54:54.941 INFO:teuthology.orchestra.run.smithi008.stdout: "event": "dispatched", 2023-08-01T19:54:54.941 INFO:teuthology.orchestra.run.smithi008.stdout: "time": "2023-08-01T19:54:52.219397+0000", 2023-08-01T19:54:54.941 INFO:teuthology.orchestra.run.smithi008.stdout: "duration": 1.8527000000000001e-05 2023-08-01T19:54:54.941 INFO:teuthology.orchestra.run.smithi008.stdout: }, 2023-08-01T19:54:54.941 INFO:teuthology.orchestra.run.smithi008.stdout: { 2023-08-01T19:54:54.941 INFO:teuthology.orchestra.run.smithi008.stdout: "event": "queued_for_pg", 2023-08-01T19:54:54.941 INFO:teuthology.orchestra.run.smithi008.stdout: "time": "2023-08-01T19:54:52.219403+0000", 2023-08-01T19:54:54.942 INFO:teuthology.orchestra.run.smithi008.stdout: "duration": 5.9909999999999999e-06 2023-08-01T19:54:54.942 INFO:teuthology.orchestra.run.smithi008.stdout: }, 2023-08-01T19:54:54.942 INFO:teuthology.orchestra.run.smithi008.stdout: { 2023-08-01T19:54:54.942 INFO:teuthology.orchestra.run.smithi008.stdout: "event": "reached_pg", 2023-08-01T19:54:54.942 INFO:teuthology.orchestra.run.smithi008.stdout: "time": "2023-08-01T19:54:52.222379+0000", 2023-08-01T19:54:54.942 INFO:teuthology.orchestra.run.smithi008.stdout: "duration": 0.002975966 2023-08-01T19:54:54.942 INFO:teuthology.orchestra.run.smithi008.stdout: }, 2023-08-01T19:54:54.942 INFO:teuthology.orchestra.run.smithi008.stdout: { 2023-08-01T19:54:54.943 INFO:teuthology.orchestra.run.smithi008.stdout: "event": "started", 2023-08-01T19:54:54.943 INFO:teuthology.orchestra.run.smithi008.stdout: "time": "2023-08-01T19:54:52.222541+0000", 2023-08-01T19:54:54.943 INFO:teuthology.orchestra.run.smithi008.stdout: "duration": 0.000161986 2023-08-01T19:54:54.943 INFO:teuthology.orchestra.run.smithi008.stdout: }, 2023-08-01T19:54:54.943 INFO:teuthology.orchestra.run.smithi008.stdout: { 2023-08-01T19:54:54.943 INFO:teuthology.orchestra.run.smithi008.stdout: "event": "waiting for subops from 1", 2023-08-01T19:54:54.943 INFO:teuthology.orchestra.run.smithi008.stdout: "time": "2023-08-01T19:54:52.222709+0000", 2023-08-01T19:54:54.943 INFO:teuthology.orchestra.run.smithi008.stdout: "duration": 0.00016778299999999999 2023-08-01T19:54:54.944 INFO:teuthology.orchestra.run.smithi008.stdout: }, 2023-08-01T19:54:54.944 INFO:teuthology.orchestra.run.smithi008.stdout: { 2023-08-01T19:54:54.944 INFO:teuthology.orchestra.run.smithi008.stdout: "event": "sub_op_commit_rec", 2023-08-01T19:54:54.944 INFO:teuthology.orchestra.run.smithi008.stdout: "time": "2023-08-01T19:54:52.226832+0000", 2023-08-01T19:54:54.944 INFO:teuthology.orchestra.run.smithi008.stdout: "duration": 0.004122967 2023-08-01T19:54:54.944 INFO:teuthology.orchestra.run.smithi008.stdout: }, 2023-08-01T19:54:54.944 INFO:teuthology.orchestra.run.smithi008.stdout: { 2023-08-01T19:54:54.944 INFO:teuthology.orchestra.run.smithi008.stdout: "event": "op_commit", 2023-08-01T19:54:54.945 INFO:teuthology.orchestra.run.smithi008.stdout: "time": "2023-08-01T19:54:52.234730+0000", 2023-08-01T19:54:54.945 INFO:teuthology.orchestra.run.smithi008.stdout: "duration": 0.0078985559999999993 2023-08-01T19:54:54.945 INFO:teuthology.orchestra.run.smithi008.stdout: }, 2023-08-01T19:54:54.945 INFO:teuthology.orchestra.run.smithi008.stdout: { 2023-08-01T19:54:54.945 INFO:teuthology.orchestra.run.smithi008.stdout: "event": "commit_sent", 2023-08-01T19:54:54.945 INFO:teuthology.orchestra.run.smithi008.stdout: "time": "2023-08-01T19:54:52.234774+0000", 2023-08-01T19:54:54.945 INFO:teuthology.orchestra.run.smithi008.stdout: "duration": 4.3819000000000002e-05 2023-08-01T19:54:54.945 INFO:teuthology.orchestra.run.smithi008.stdout: }, 2023-08-01T19:54:54.946 INFO:teuthology.orchestra.run.smithi008.stdout: { 2023-08-01T19:54:54.946 INFO:teuthology.orchestra.run.smithi008.stdout: "event": "done", 2023-08-01T19:54:54.946 INFO:teuthology.orchestra.run.smithi008.stdout: "time": "2023-08-01T19:54:52.234810+0000", 2023-08-01T19:54:54.946 INFO:teuthology.orchestra.run.smithi008.stdout: "duration": 3.6486999999999998e-05 2023-08-01T19:54:54.946 INFO:teuthology.orchestra.run.smithi008.stdout: } 2023-08-01T19:54:54.946 INFO:teuthology.orchestra.run.smithi008.stdout: ] 2023-08-01T19:54:54.946 INFO:teuthology.orchestra.run.smithi008.stdout: } 2023-08-01T19:54:54.947 INFO:teuthology.orchestra.run.smithi008.stdout: }, 2023-08-01T19:54:54.947 INFO:teuthology.orchestra.run.smithi008.stdout: { 2023-08-01T19:54:54.947 INFO:teuthology.orchestra.run.smithi008.stdout: "description": "osd_op(client.4668.0:75018 5.c 5:337cd9ad:::benchmark_data_smithi006_114134_object75017:head [set-alloc-hint object_size 65536 write_size 65536,write 0~65536] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e32)", 2023-08-01T19:54:54.947 INFO:teuthology.orchestra.run.smithi008.stdout: "initiated_at": "2023-08-01T19:54:52.219412+0000", 2023-08-01T19:54:54.947 INFO:teuthology.orchestra.run.smithi008.stdout: "age": 2.5889614559999998, 2023-08-01T19:54:54.947 INFO:teuthology.orchestra.run.smithi008.stdout: "duration": 0.021247918000000001, 2023-08-01T19:54:54.947 INFO:teuthology.orchestra.run.smithi008.stdout: "type_data": { 2023-08-01T19:54:54.947 INFO:teuthology.orchestra.run.smithi008.stdout: "flag_point": "commit sent; apply or cleanup", 2023-08-01T19:54:54.948 INFO:teuthology.orchestra.run.smithi008.stdout: "client_info": { 2023-08-01T19:54:54.948 INFO:teuthology.orchestra.run.smithi008.stdout: "client": "client.4668", 2023-08-01T19:54:54.948 INFO:teuthology.orchestra.run.smithi008.stdout: "client_addr": "172.21.15.6:0/1709472247", 2023-08-01T19:54:54.948 INFO:teuthology.orchestra.run.smithi008.stdout: "tid": 75018 2023-08-01T19:54:54.948 INFO:teuthology.orchestra.run.smithi008.stdout: }, 2023-08-01T19:54:54.948 INFO:teuthology.orchestra.run.smithi008.stdout: "events": [ 2023-08-01T19:54:54.948 INFO:teuthology.orchestra.run.smithi008.stdout: { 2023-08-01T19:54:54.948 INFO:teuthology.orchestra.run.smithi008.stdout: "event": "initiated", 2023-08-01T19:54:54.949 INFO:teuthology.orchestra.run.smithi008.stdout: "time": "2023-08-01T19:54:52.219412+0000", 2023-08-01T19:54:54.949 INFO:teuthology.orchestra.run.smithi008.stdout: "duration": 0 2023-08-01T19:54:54.949 INFO:teuthology.orchestra.run.smithi008.stdout: }, 2023-08-01T19:54:54.949 INFO:teuthology.orchestra.run.smithi008.stdout: { 2023-08-01T19:54:54.949 INFO:teuthology.orchestra.run.smithi008.stdout: "event": "throttled", 2023-08-01T19:54:54.949 INFO:teuthology.orchestra.run.smithi008.stdout: "time": "2023-08-01T19:54:52.219412+0000", 2023-08-01T19:54:54.949 INFO:teuthology.orchestra.run.smithi008.stdout: "duration": 0 2023-08-01T19:54:54.950 INFO:teuthology.orchestra.run.smithi008.stdout: }, 2023-08-01T19:54:54.950 INFO:teuthology.orchestra.run.smithi008.stdout: { 2023-08-01T19:54:54.950 INFO:teuthology.orchestra.run.smithi008.stdout: "event": "header_read", 2023-08-01T19:54:54.950 INFO:teuthology.orchestra.run.smithi008.stdout: "time": "2023-08-01T19:54:52.219412+0000", 2023-08-01T19:54:54.950 INFO:teuthology.orchestra.run.smithi008.stdout: "duration": 4294967295.999999 2023-08-01T19:54:54.950 INFO:teuthology.orchestra.run.smithi008.stdout: }, 2023-08-01T19:54:54.950 INFO:teuthology.orchestra.run.smithi008.stdout: { 2023-08-01T19:54:54.950 INFO:teuthology.orchestra.run.smithi008.stdout: "event": "all_read", 2023-08-01T19:54:54.951 INFO:teuthology.orchestra.run.smithi008.stdout: "time": "2023-08-01T19:54:52.219529+0000", 2023-08-01T19:54:54.951 INFO:teuthology.orchestra.run.smithi008.stdout: "duration": 0.000117207 2023-08-01T19:54:54.951 INFO:teuthology.orchestra.run.smithi008.stdout: }, 2023-08-01T19:54:54.951 INFO:teuthology.orchestra.run.smithi008.stdout: { 2023-08-01T19:54:54.951 INFO:teuthology.orchestra.run.smithi008.stdout: "event": "dispatched", 2023-08-01T19:54:54.951 INFO:teuthology.orchestra.run.smithi008.stdout: "time": "2023-08-01T19:54:52.219541+0000", 2023-08-01T19:54:54.951 INFO:teuthology.orchestra.run.smithi008.stdout: "duration": 1.2448e-05 2023-08-01T19:54:54.951 INFO:teuthology.orchestra.run.smithi008.stdout: }, 2023-08-01T19:54:54.952 INFO:teuthology.orchestra.run.smithi008.stdout: { 2023-08-01T19:54:54.952 INFO:teuthology.orchestra.run.smithi008.stdout: "event": "queued_for_pg", 2023-08-01T19:54:54.952 INFO:teuthology.orchestra.run.smithi008.stdout: "time": "2023-08-01T19:54:52.219547+0000", 2023-08-01T19:54:54.952 INFO:teuthology.orchestra.run.smithi008.stdout: "duration": 5.7899999999999996e-06 2023-08-01T19:54:54.952 INFO:teuthology.orchestra.run.smithi008.stdout: }, 2023-08-01T19:54:54.952 INFO:teuthology.orchestra.run.smithi008.stdout: { 2023-08-01T19:54:54.952 INFO:teuthology.orchestra.run.smithi008.stdout: "event": "reached_pg", 2023-08-01T19:54:54.952 INFO:teuthology.orchestra.run.smithi008.stdout: "time": "2023-08-01T19:54:52.228949+0000", 2023-08-01T19:54:54.953 INFO:teuthology.orchestra.run.smithi008.stdout: "duration": 0.009401754 2023-08-01T19:54:54.953 INFO:teuthology.orchestra.run.smithi008.stdout: }, 2023-08-01T19:54:54.953 INFO:teuthology.orchestra.run.smithi008.stdout: { 2023-08-01T19:54:54.953 INFO:teuthology.orchestra.run.smithi008.stdout: "event": "started", 2023-08-01T19:54:54.953 INFO:teuthology.orchestra.run.smithi008.stdout: "time": "2023-08-01T19:54:52.229103+0000", 2023-08-01T19:54:54.953 INFO:teuthology.orchestra.run.smithi008.stdout: "duration": 0.00015462399999999999 2023-08-01T19:54:54.953 INFO:teuthology.orchestra.run.smithi008.stdout: }, 2023-08-01T19:54:54.954 INFO:teuthology.orchestra.run.smithi008.stdout: { 2023-08-01T19:54:54.954 INFO:teuthology.orchestra.run.smithi008.stdout: "event": "waiting for subops from 1", 2023-08-01T19:54:54.954 INFO:teuthology.orchestra.run.smithi008.stdout: "time": "2023-08-01T19:54:52.229261+0000", 2023-08-01T19:54:54.954 INFO:teuthology.orchestra.run.smithi008.stdout: "duration": 0.00015758300000000001 2023-08-01T19:54:54.954 INFO:teuthology.orchestra.run.smithi008.stdout: }, 2023-08-01T19:54:54.954 INFO:teuthology.orchestra.run.smithi008.stdout: { 2023-08-01T19:54:54.954 INFO:teuthology.orchestra.run.smithi008.stdout: "event": "sub_op_commit_rec", 2023-08-01T19:54:54.954 INFO:teuthology.orchestra.run.smithi008.stdout: "time": "2023-08-01T19:54:52.234395+0000", 2023-08-01T19:54:54.955 INFO:teuthology.orchestra.run.smithi008.stdout: "duration": 0.0051335080000000002 2023-08-01T19:54:54.955 INFO:teuthology.orchestra.run.smithi008.stdout: }, 2023-08-01T19:54:54.955 INFO:teuthology.orchestra.run.smithi008.stdout: { 2023-08-01T19:54:54.955 INFO:teuthology.orchestra.run.smithi008.stdout: "event": "op_commit", 2023-08-01T19:54:54.955 INFO:teuthology.orchestra.run.smithi008.stdout: "time": "2023-08-01T19:54:52.240575+0000", 2023-08-01T19:54:54.955 INFO:teuthology.orchestra.run.smithi008.stdout: "duration": 0.0061804099999999999 2023-08-01T19:54:54.955 INFO:teuthology.orchestra.run.smithi008.stdout: }, 2023-08-01T19:54:54.956 INFO:teuthology.orchestra.run.smithi008.stdout: { 2023-08-01T19:54:54.956 INFO:teuthology.orchestra.run.smithi008.stdout: "event": "commit_sent", 2023-08-01T19:54:54.956 INFO:teuthology.orchestra.run.smithi008.stdout: "time": "2023-08-01T19:54:52.240620+0000", 2023-08-01T19:54:54.956 INFO:teuthology.orchestra.run.smithi008.stdout: "duration": 4.4972999999999998e-05 2023-08-01T19:54:54.956 INFO:teuthology.orchestra.run.smithi008.stdout: }, 2023-08-01T19:54:54.956 INFO:teuthology.orchestra.run.smithi008.stdout: { 2023-08-01T19:54:54.956 INFO:teuthology.orchestra.run.smithi008.stdout: "event": "done", 2023-08-01T19:54:54.957 INFO:teuthology.orchestra.run.smithi008.stdout: "time": "2023-08-01T19:54:52.240660+0000", 2023-08-01T19:54:54.957 INFO:teuthology.orchestra.run.smithi008.stdout: "duration": 4.0348000000000001e-05 2023-08-01T19:54:54.957 INFO:teuthology.orchestra.run.smithi008.stdout: } 2023-08-01T19:54:54.957 INFO:teuthology.orchestra.run.smithi008.stdout: ] 2023-08-01T19:54:54.957 INFO:teuthology.orchestra.run.smithi008.stdout: } 2023-08-01T19:54:54.957 INFO:teuthology.orchestra.run.smithi008.stdout: }, 2023-08-01T19:54:54.957 INFO:teuthology.orchestra.run.smithi008.stdout: { 2023-08-01T19:54:54.958 INFO:teuthology.orchestra.run.smithi008.stdout: "description": "osd_repop(client.4668.0:75022 5.4 e32/19 5:20404e0b:::benchmark_data_smithi006_114134_object75021:head v 32'4630, mlcod=32'4627)", 2023-08-01T19:54:54.958 INFO:teuthology.orchestra.run.smithi008.stdout: "initiated_at": "2023-08-01T19:54:52.221931+0000", 2023-08-01T19:54:54.958 INFO:teuthology.orchestra.run.smithi008.stdout: "age": 2.5864423670000001, 2023-08-01T19:54:54.958 INFO:teuthology.orchestra.run.smithi008.stdout: "duration": 0.018596688, 2023-08-01T19:54:54.958 INFO:teuthology.orchestra.run.smithi008.stdout: "type_data": { 2023-08-01T19:54:54.958 INFO:teuthology.orchestra.run.smithi008.stdout: "flag_point": "commit sent; apply or cleanup", 2023-08-01T19:54:54.958 INFO:teuthology.orchestra.run.smithi008.stdout: "events": [ 2023-08-01T19:54:54.959 INFO:teuthology.orchestra.run.smithi008.stdout: { 2023-08-01T19:54:54.959 INFO:teuthology.orchestra.run.smithi008.stdout: "event": "initiated", 2023-08-01T19:54:54.959 INFO:teuthology.orchestra.run.smithi008.stdout: "time": "2023-08-01T19:54:52.221931+0000", 2023-08-01T19:54:54.959 INFO:teuthology.orchestra.run.smithi008.stdout: "duration": 0 2023-08-01T19:54:54.959 INFO:teuthology.orchestra.run.smithi008.stdout: }, 2023-08-01T19:54:54.959 INFO:teuthology.orchestra.run.smithi008.stdout: { 2023-08-01T19:54:54.959 INFO:teuthology.orchestra.run.smithi008.stdout: "event": "throttled", 2023-08-01T19:54:54.960 INFO:teuthology.orchestra.run.smithi008.stdout: "time": "2023-08-01T19:54:52.221931+0000", 2023-08-01T19:54:54.960 INFO:teuthology.orchestra.run.smithi008.stdout: "duration": 0 2023-08-01T19:54:54.960 INFO:teuthology.orchestra.run.smithi008.stdout: }, 2023-08-01T19:54:54.960 INFO:teuthology.orchestra.run.smithi008.stdout: { 2023-08-01T19:54:54.960 INFO:teuthology.orchestra.run.smithi008.stdout: "event": "header_read", 2023-08-01T19:54:54.960 INFO:teuthology.orchestra.run.smithi008.stdout: "time": "2023-08-01T19:54:52.221931+0000", 2023-08-01T19:54:54.960 INFO:teuthology.orchestra.run.smithi008.stdout: "duration": 4294967295.9999995 2023-08-01T19:54:54.961 INFO:teuthology.orchestra.run.smithi008.stdout: }, 2023-08-01T19:54:54.961 INFO:teuthology.orchestra.run.smithi008.stdout: { 2023-08-01T19:54:54.961 INFO:teuthology.orchestra.run.smithi008.stdout: "event": "all_read", 2023-08-01T19:54:54.961 INFO:teuthology.orchestra.run.smithi008.stdout: "time": "2023-08-01T19:54:52.222002+0000", 2023-08-01T19:54:54.961 INFO:teuthology.orchestra.run.smithi008.stdout: "duration": 7.0870000000000004e-05 2023-08-01T19:54:54.961 INFO:teuthology.orchestra.run.smithi008.stdout: }, 2023-08-01T19:54:54.961 INFO:teuthology.orchestra.run.smithi008.stdout: { 2023-08-01T19:54:54.962 INFO:teuthology.orchestra.run.smithi008.stdout: "event": "dispatched", 2023-08-01T19:54:54.962 INFO:teuthology.orchestra.run.smithi008.stdout: "time": "2023-08-01T19:54:52.222015+0000", 2023-08-01T19:54:54.962 INFO:teuthology.orchestra.run.smithi008.stdout: "duration": 1.327e-05 2023-08-01T19:54:54.962 INFO:teuthology.orchestra.run.smithi008.stdout: }, 2023-08-01T19:54:54.962 INFO:teuthology.orchestra.run.smithi008.stdout: { 2023-08-01T19:54:54.962 INFO:teuthology.orchestra.run.smithi008.stdout: "event": "queued_for_pg", 2023-08-01T19:54:54.962 INFO:teuthology.orchestra.run.smithi008.stdout: "time": "2023-08-01T19:54:52.222022+0000", 2023-08-01T19:54:54.963 INFO:teuthology.orchestra.run.smithi008.stdout: "duration": 7.1729999999999998e-06 2023-08-01T19:54:54.963 INFO:teuthology.orchestra.run.smithi008.stdout: }, 2023-08-01T19:54:54.963 INFO:teuthology.orchestra.run.smithi008.stdout: { 2023-08-01T19:54:54.963 INFO:teuthology.orchestra.run.smithi008.stdout: "event": "reached_pg", 2023-08-01T19:54:54.963 INFO:teuthology.orchestra.run.smithi008.stdout: "time": "2023-08-01T19:54:52.224857+0000", 2023-08-01T19:54:54.963 INFO:teuthology.orchestra.run.smithi008.stdout: "duration": 0.0028351600000000002 2023-08-01T19:54:54.963 INFO:teuthology.orchestra.run.smithi008.stdout: }, 2023-08-01T19:54:54.963 INFO:teuthology.orchestra.run.smithi008.stdout: { 2023-08-01T19:54:54.964 INFO:teuthology.orchestra.run.smithi008.stdout: "event": "started", 2023-08-01T19:54:54.964 INFO:teuthology.orchestra.run.smithi008.stdout: "time": "2023-08-01T19:54:52.224877+0000", 2023-08-01T19:54:54.964 INFO:teuthology.orchestra.run.smithi008.stdout: "duration": 1.9839000000000001e-05 2023-08-01T19:54:54.964 INFO:teuthology.orchestra.run.smithi008.stdout: }, 2023-08-01T19:54:54.964 INFO:teuthology.orchestra.run.smithi008.stdout: { 2023-08-01T19:54:54.964 INFO:teuthology.orchestra.run.smithi008.stdout: "event": "commit_sent", 2023-08-01T19:54:54.964 INFO:teuthology.orchestra.run.smithi008.stdout: "time": "2023-08-01T19:54:52.240497+0000", 2023-08-01T19:54:54.965 INFO:teuthology.orchestra.run.smithi008.stdout: "duration": 0.015619928 2023-08-01T19:54:54.965 INFO:teuthology.orchestra.run.smithi008.stdout: }, 2023-08-01T19:54:54.965 INFO:teuthology.orchestra.run.smithi008.stdout: { 2023-08-01T19:54:54.965 INFO:teuthology.orchestra.run.smithi008.stdout: "event": "done", 2023-08-01T19:54:54.965 INFO:teuthology.orchestra.run.smithi008.stdout: "time": "2023-08-01T19:54:52.240528+0000", 2023-08-01T19:54:54.965 INFO:teuthology.orchestra.run.smithi008.stdout: "duration": 3.1029999999999999e-05 2023-08-01T19:54:54.965 INFO:teuthology.orchestra.run.smithi008.stdout: } 2023-08-01T19:54:54.965 INFO:teuthology.orchestra.run.smithi008.stdout: ] 2023-08-01T19:54:54.966 INFO:teuthology.orchestra.run.smithi008.stdout: } 2023-08-01T19:54:54.966 INFO:teuthology.orchestra.run.smithi008.stdout: }, 2023-08-01T19:54:54.966 INFO:teuthology.orchestra.run.smithi008.stdout: { 2023-08-01T19:54:54.966 INFO:teuthology.orchestra.run.smithi008.stdout: "description": "osd_repop(client.4668.0:75023 5.4 e32/19 5:2ff1db38:::benchmark_data_smithi006_114134_object75022:head v 32'4631, mlcod=32'4627)", 2023-08-01T19:54:54.966 INFO:teuthology.orchestra.run.smithi008.stdout: "initiated_at": "2023-08-01T19:54:52.223928+0000", 2023-08-01T19:54:54.966 INFO:teuthology.orchestra.run.smithi008.stdout: "age": 2.5844457840000001, 2023-08-01T19:54:54.966 INFO:teuthology.orchestra.run.smithi008.stdout: "duration": 0.016622168999999999, 2023-08-01T19:54:54.966 INFO:teuthology.orchestra.run.smithi008.stdout: "type_data": { 2023-08-01T19:54:54.967 INFO:teuthology.orchestra.run.smithi008.stdout: "flag_point": "commit sent; apply or cleanup", 2023-08-01T19:54:54.967 INFO:teuthology.orchestra.run.smithi008.stdout: "events": [ 2023-08-01T19:54:54.967 INFO:teuthology.orchestra.run.smithi008.stdout: { 2023-08-01T19:54:54.967 INFO:teuthology.orchestra.run.smithi008.stdout: "event": "initiated", 2023-08-01T19:54:54.967 INFO:teuthology.orchestra.run.smithi008.stdout: "time": "2023-08-01T19:54:52.223928+0000", 2023-08-01T19:54:54.967 INFO:teuthology.orchestra.run.smithi008.stdout: "duration": 0 2023-08-01T19:54:54.967 INFO:teuthology.orchestra.run.smithi008.stdout: }, 2023-08-01T19:54:54.967 INFO:teuthology.orchestra.run.smithi008.stdout: { 2023-08-01T19:54:54.968 INFO:teuthology.orchestra.run.smithi008.stdout: "event": "throttled", 2023-08-01T19:54:54.968 INFO:teuthology.orchestra.run.smithi008.stdout: "time": "2023-08-01T19:54:52.223928+0000", 2023-08-01T19:54:54.968 INFO:teuthology.orchestra.run.smithi008.stdout: "duration": 0 2023-08-01T19:54:54.968 INFO:teuthology.orchestra.run.smithi008.stdout: }, 2023-08-01T19:54:54.968 INFO:teuthology.orchestra.run.smithi008.stdout: { 2023-08-01T19:54:54.968 INFO:teuthology.orchestra.run.smithi008.stdout: "event": "header_read", 2023-08-01T19:54:54.968 INFO:teuthology.orchestra.run.smithi008.stdout: "time": "2023-08-01T19:54:52.223928+0000", 2023-08-01T19:54:54.969 INFO:teuthology.orchestra.run.smithi008.stdout: "duration": 4294967296 2023-08-01T19:54:54.969 INFO:teuthology.orchestra.run.smithi008.stdout: }, 2023-08-01T19:54:54.969 INFO:teuthology.orchestra.run.smithi008.stdout: { 2023-08-01T19:54:54.969 INFO:teuthology.orchestra.run.smithi008.stdout: "event": "all_read", 2023-08-01T19:54:54.969 INFO:teuthology.orchestra.run.smithi008.stdout: "time": "2023-08-01T19:54:52.223952+0000", 2023-08-01T19:54:54.969 INFO:teuthology.orchestra.run.smithi008.stdout: "duration": 2.4238000000000001e-05 2023-08-01T19:54:54.969 INFO:teuthology.orchestra.run.smithi008.stdout: }, 2023-08-01T19:54:54.970 INFO:teuthology.orchestra.run.smithi008.stdout: { 2023-08-01T19:54:54.970 INFO:teuthology.orchestra.run.smithi008.stdout: "event": "dispatched", 2023-08-01T19:54:54.970 INFO:teuthology.orchestra.run.smithi008.stdout: "time": "2023-08-01T19:54:52.223958+0000", 2023-08-01T19:54:54.970 INFO:teuthology.orchestra.run.smithi008.stdout: "duration": 6.1589999999999998e-06 2023-08-01T19:54:54.970 INFO:teuthology.orchestra.run.smithi008.stdout: }, 2023-08-01T19:54:54.970 INFO:teuthology.orchestra.run.smithi008.stdout: { 2023-08-01T19:54:54.970 INFO:teuthology.orchestra.run.smithi008.stdout: "event": "queued_for_pg", 2023-08-01T19:54:54.970 INFO:teuthology.orchestra.run.smithi008.stdout: "time": "2023-08-01T19:54:52.223962+0000", 2023-08-01T19:54:54.971 INFO:teuthology.orchestra.run.smithi008.stdout: "duration": 3.523e-06 2023-08-01T19:54:54.971 INFO:teuthology.orchestra.run.smithi008.stdout: }, 2023-08-01T19:54:54.971 INFO:teuthology.orchestra.run.smithi008.stdout: { 2023-08-01T19:54:54.971 INFO:teuthology.orchestra.run.smithi008.stdout: "event": "reached_pg", 2023-08-01T19:54:54.971 INFO:teuthology.orchestra.run.smithi008.stdout: "time": "2023-08-01T19:54:52.226856+0000", 2023-08-01T19:54:54.971 INFO:teuthology.orchestra.run.smithi008.stdout: "duration": 0.0028944130000000002 2023-08-01T19:54:54.971 INFO:teuthology.orchestra.run.smithi008.stdout: }, 2023-08-01T19:54:54.971 INFO:teuthology.orchestra.run.smithi008.stdout: { 2023-08-01T19:54:54.972 INFO:teuthology.orchestra.run.smithi008.stdout: "event": "started", 2023-08-01T19:54:54.972 INFO:teuthology.orchestra.run.smithi008.stdout: "time": "2023-08-01T19:54:52.226872+0000", 2023-08-01T19:54:54.972 INFO:teuthology.orchestra.run.smithi008.stdout: "duration": 1.6155e-05 2023-08-01T19:54:54.972 INFO:teuthology.orchestra.run.smithi008.stdout: }, 2023-08-01T19:54:54.972 INFO:teuthology.orchestra.run.smithi008.stdout: { 2023-08-01T19:54:54.972 INFO:teuthology.orchestra.run.smithi008.stdout: "event": "commit_sent", 2023-08-01T19:54:54.972 INFO:teuthology.orchestra.run.smithi008.stdout: "time": "2023-08-01T19:54:52.240533+0000", 2023-08-01T19:54:54.973 INFO:teuthology.orchestra.run.smithi008.stdout: "duration": 0.013660736999999999 2023-08-01T19:54:54.973 INFO:teuthology.orchestra.run.smithi008.stdout: }, 2023-08-01T19:54:54.973 INFO:teuthology.orchestra.run.smithi008.stdout: { 2023-08-01T19:54:54.973 INFO:teuthology.orchestra.run.smithi008.stdout: "event": "done", 2023-08-01T19:54:54.973 INFO:teuthology.orchestra.run.smithi008.stdout: "time": "2023-08-01T19:54:52.240550+0000", 2023-08-01T19:54:54.973 INFO:teuthology.orchestra.run.smithi008.stdout: "duration": 1.7180000000000002e-05 2023-08-01T19:54:54.973 INFO:teuthology.orchestra.run.smithi008.stdout: } 2023-08-01T19:54:54.973 INFO:teuthology.orchestra.run.smithi008.stdout: ] 2023-08-01T19:54:54.974 INFO:teuthology.orchestra.run.smithi008.stdout: } 2023-08-01T19:54:54.974 INFO:teuthology.orchestra.run.smithi008.stdout: }, 2023-08-01T19:54:54.974 INFO:teuthology.orchestra.run.smithi008.stdout: { 2023-08-01T19:54:54.974 INFO:teuthology.orchestra.run.smithi008.stdout: "description": "osd_op(client.4668.0:75029 5.c 5:38b666aa:::benchmark_data_smithi006_114134_object75028:head [set-alloc-hint object_size 65536 write_size 65536,write 0~65536] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e32)", 2023-08-01T19:54:54.974 INFO:teuthology.orchestra.run.smithi008.stdout: "initiated_at": "2023-08-01T19:54:52.224968+0000", 2023-08-01T19:54:54.974 INFO:teuthology.orchestra.run.smithi008.stdout: "age": 2.583405403, 2023-08-01T19:54:54.974 INFO:teuthology.orchestra.run.smithi008.stdout: "duration": 0.015765280999999999, 2023-08-01T19:54:54.975 INFO:teuthology.orchestra.run.smithi008.stdout: "type_data": { 2023-08-01T19:54:54.975 INFO:teuthology.orchestra.run.smithi008.stdout: "flag_point": "commit sent; apply or cleanup", 2023-08-01T19:54:54.975 INFO:teuthology.orchestra.run.smithi008.stdout: "client_info": { 2023-08-01T19:54:54.975 INFO:teuthology.orchestra.run.smithi008.stdout: "client": "client.4668", 2023-08-01T19:54:54.975 INFO:teuthology.orchestra.run.smithi008.stdout: "client_addr": "172.21.15.6:0/1709472247", 2023-08-01T19:54:54.975 INFO:teuthology.orchestra.run.smithi008.stdout: "tid": 75029 2023-08-01T19:54:54.975 INFO:teuthology.orchestra.run.smithi008.stdout: }, 2023-08-01T19:54:54.975 INFO:teuthology.orchestra.run.smithi008.stdout: "events": [ 2023-08-01T19:54:54.976 INFO:teuthology.orchestra.run.smithi008.stdout: { 2023-08-01T19:54:54.976 INFO:teuthology.orchestra.run.smithi008.stdout: "event": "initiated", 2023-08-01T19:54:54.976 INFO:teuthology.orchestra.run.smithi008.stdout: "time": "2023-08-01T19:54:52.224968+0000", 2023-08-01T19:54:54.976 INFO:teuthology.orchestra.run.smithi008.stdout: "duration": 0 2023-08-01T19:54:54.976 INFO:teuthology.orchestra.run.smithi008.stdout: }, 2023-08-01T19:54:54.976 INFO:teuthology.orchestra.run.smithi008.stdout: { 2023-08-01T19:54:54.976 INFO:teuthology.orchestra.run.smithi008.stdout: "event": "throttled", 2023-08-01T19:54:54.976 INFO:teuthology.orchestra.run.smithi008.stdout: "time": "2023-08-01T19:54:52.224968+0000", 2023-08-01T19:54:54.977 INFO:teuthology.orchestra.run.smithi008.stdout: "duration": 0 2023-08-01T19:54:54.977 INFO:teuthology.orchestra.run.smithi008.stdout: }, 2023-08-01T19:54:54.977 INFO:teuthology.orchestra.run.smithi008.stdout: { 2023-08-01T19:54:54.977 INFO:teuthology.orchestra.run.smithi008.stdout: "event": "header_read", 2023-08-01T19:54:54.977 INFO:teuthology.orchestra.run.smithi008.stdout: "time": "2023-08-01T19:54:52.224967+0000", 2023-08-01T19:54:54.977 INFO:teuthology.orchestra.run.smithi008.stdout: "duration": 4294967295.999999 2023-08-01T19:54:54.977 INFO:teuthology.orchestra.run.smithi008.stdout: }, 2023-08-01T19:54:54.978 INFO:teuthology.orchestra.run.smithi008.stdout: { 2023-08-01T19:54:54.978 INFO:teuthology.orchestra.run.smithi008.stdout: "event": "all_read", 2023-08-01T19:54:54.978 INFO:teuthology.orchestra.run.smithi008.stdout: "time": "2023-08-01T19:54:52.225054+0000", 2023-08-01T19:54:54.978 INFO:teuthology.orchestra.run.smithi008.stdout: "duration": 8.6403000000000006e-05 2023-08-01T19:54:54.978 INFO:teuthology.orchestra.run.smithi008.stdout: }, 2023-08-01T19:54:54.978 INFO:teuthology.orchestra.run.smithi008.stdout: { 2023-08-01T19:54:54.978 INFO:teuthology.orchestra.run.smithi008.stdout: "event": "dispatched", 2023-08-01T19:54:54.978 INFO:teuthology.orchestra.run.smithi008.stdout: "time": "2023-08-01T19:54:52.225064+0000", 2023-08-01T19:54:54.979 INFO:teuthology.orchestra.run.smithi008.stdout: "duration": 1.0018e-05 2023-08-01T19:54:54.979 INFO:teuthology.orchestra.run.smithi008.stdout: }, 2023-08-01T19:54:54.979 INFO:teuthology.orchestra.run.smithi008.stdout: { 2023-08-01T19:54:54.979 INFO:teuthology.orchestra.run.smithi008.stdout: "event": "queued_for_pg", 2023-08-01T19:54:54.979 INFO:teuthology.orchestra.run.smithi008.stdout: "time": "2023-08-01T19:54:52.225069+0000", 2023-08-01T19:54:54.979 INFO:teuthology.orchestra.run.smithi008.stdout: "duration": 5.0409999999999997e-06 2023-08-01T19:54:54.979 INFO:teuthology.orchestra.run.smithi008.stdout: }, 2023-08-01T19:54:54.979 INFO:teuthology.orchestra.run.smithi008.stdout: { 2023-08-01T19:54:54.980 INFO:teuthology.orchestra.run.smithi008.stdout: "event": "reached_pg", 2023-08-01T19:54:54.980 INFO:teuthology.orchestra.run.smithi008.stdout: "time": "2023-08-01T19:54:52.231919+0000", 2023-08-01T19:54:54.980 INFO:teuthology.orchestra.run.smithi008.stdout: "duration": 0.006849623 2023-08-01T19:54:54.980 INFO:teuthology.orchestra.run.smithi008.stdout: }, 2023-08-01T19:54:54.980 INFO:teuthology.orchestra.run.smithi008.stdout: { 2023-08-01T19:54:54.980 INFO:teuthology.orchestra.run.smithi008.stdout: "event": "started", 2023-08-01T19:54:54.980 INFO:teuthology.orchestra.run.smithi008.stdout: "time": "2023-08-01T19:54:52.232118+0000", 2023-08-01T19:54:54.980 INFO:teuthology.orchestra.run.smithi008.stdout: "duration": 0.00019987100000000001 2023-08-01T19:54:54.981 INFO:teuthology.orchestra.run.smithi008.stdout: }, 2023-08-01T19:54:54.981 INFO:teuthology.orchestra.run.smithi008.stdout: { 2023-08-01T19:54:54.981 INFO:teuthology.orchestra.run.smithi008.stdout: "event": "waiting for subops from 1", 2023-08-01T19:54:54.981 INFO:teuthology.orchestra.run.smithi008.stdout: "time": "2023-08-01T19:54:52.232350+0000", 2023-08-01T19:54:54.981 INFO:teuthology.orchestra.run.smithi008.stdout: "duration": 0.00023154299999999999 2023-08-01T19:54:54.981 INFO:teuthology.orchestra.run.smithi008.stdout: }, 2023-08-01T19:54:54.981 INFO:teuthology.orchestra.run.smithi008.stdout: { 2023-08-01T19:54:54.981 INFO:teuthology.orchestra.run.smithi008.stdout: "event": "sub_op_commit_rec", 2023-08-01T19:54:54.982 INFO:teuthology.orchestra.run.smithi008.stdout: "time": "2023-08-01T19:54:52.234979+0000", 2023-08-01T19:54:54.982 INFO:teuthology.orchestra.run.smithi008.stdout: "duration": 0.002629485 2023-08-01T19:54:54.982 INFO:teuthology.orchestra.run.smithi008.stdout: }, 2023-08-01T19:54:54.982 INFO:teuthology.orchestra.run.smithi008.stdout: { 2023-08-01T19:54:54.982 INFO:teuthology.orchestra.run.smithi008.stdout: "event": "op_commit", 2023-08-01T19:54:54.982 INFO:teuthology.orchestra.run.smithi008.stdout: "time": "2023-08-01T19:54:52.240667+0000", 2023-08-01T19:54:54.982 INFO:teuthology.orchestra.run.smithi008.stdout: "duration": 0.0056880869999999997 2023-08-01T19:54:54.982 INFO:teuthology.orchestra.run.smithi008.stdout: }, 2023-08-01T19:54:54.983 INFO:teuthology.orchestra.run.smithi008.stdout: { 2023-08-01T19:54:54.983 INFO:teuthology.orchestra.run.smithi008.stdout: "event": "commit_sent", 2023-08-01T19:54:54.983 INFO:teuthology.orchestra.run.smithi008.stdout: "time": "2023-08-01T19:54:52.240705+0000", 2023-08-01T19:54:54.983 INFO:teuthology.orchestra.run.smithi008.stdout: "duration": 3.7302000000000003e-05 2023-08-01T19:54:54.983 INFO:teuthology.orchestra.run.smithi008.stdout: }, 2023-08-01T19:54:54.983 INFO:teuthology.orchestra.run.smithi008.stdout: { 2023-08-01T19:54:54.983 INFO:teuthology.orchestra.run.smithi008.stdout: "event": "done", 2023-08-01T19:54:54.984 INFO:teuthology.orchestra.run.smithi008.stdout: "time": "2023-08-01T19:54:52.240734+0000", 2023-08-01T19:54:54.984 INFO:teuthology.orchestra.run.smithi008.stdout: "duration": 2.8887e-05 2023-08-01T19:54:54.984 INFO:teuthology.orchestra.run.smithi008.stdout: } 2023-08-01T19:54:54.984 INFO:teuthology.orchestra.run.smithi008.stdout: ] 2023-08-01T19:54:54.984 INFO:teuthology.orchestra.run.smithi008.stdout: } 2023-08-01T19:54:54.984 INFO:teuthology.orchestra.run.smithi008.stdout: }, 2023-08-01T19:54:54.984 INFO:teuthology.orchestra.run.smithi008.stdout: { 2023-08-01T19:54:54.984 INFO:teuthology.orchestra.run.smithi008.stdout: "description": "osd_repop(client.4668.0:75028 5.4 e32/19 5:2c62c41c:::benchmark_data_smithi006_114134_object75027:head v 32'4632, mlcod=32'4627)", 2023-08-01T19:54:54.985 INFO:teuthology.orchestra.run.smithi008.stdout: "initiated_at": "2023-08-01T19:54:52.225326+0000", 2023-08-01T19:54:54.985 INFO:teuthology.orchestra.run.smithi008.stdout: "age": 2.5830477539999999, 2023-08-01T19:54:54.985 INFO:teuthology.orchestra.run.smithi008.stdout: "duration": 0.015241230999999999, 2023-08-01T19:54:54.985 INFO:teuthology.orchestra.run.smithi008.stdout: "type_data": { 2023-08-01T19:54:54.985 INFO:teuthology.orchestra.run.smithi008.stdout: "flag_point": "commit sent; apply or cleanup", 2023-08-01T19:54:54.985 INFO:teuthology.orchestra.run.smithi008.stdout: "events": [ 2023-08-01T19:54:54.985 INFO:teuthology.orchestra.run.smithi008.stdout: { 2023-08-01T19:54:54.985 INFO:teuthology.orchestra.run.smithi008.stdout: "event": "initiated", 2023-08-01T19:54:54.986 INFO:teuthology.orchestra.run.smithi008.stdout: "time": "2023-08-01T19:54:52.225326+0000", 2023-08-01T19:54:54.986 INFO:teuthology.orchestra.run.smithi008.stdout: "duration": 0 2023-08-01T19:54:54.986 INFO:teuthology.orchestra.run.smithi008.stdout: }, 2023-08-01T19:54:54.986 INFO:teuthology.orchestra.run.smithi008.stdout: { 2023-08-01T19:54:54.986 INFO:teuthology.orchestra.run.smithi008.stdout: "event": "throttled", 2023-08-01T19:54:54.986 INFO:teuthology.orchestra.run.smithi008.stdout: "time": "2023-08-01T19:54:52.225326+0000", 2023-08-01T19:54:54.986 INFO:teuthology.orchestra.run.smithi008.stdout: "duration": 0 2023-08-01T19:54:54.986 INFO:teuthology.orchestra.run.smithi008.stdout: }, 2023-08-01T19:54:54.987 INFO:teuthology.orchestra.run.smithi008.stdout: { 2023-08-01T19:54:54.987 INFO:teuthology.orchestra.run.smithi008.stdout: "event": "header_read", 2023-08-01T19:54:54.987 INFO:teuthology.orchestra.run.smithi008.stdout: "time": "2023-08-01T19:54:52.225326+0000", 2023-08-01T19:54:54.987 INFO:teuthology.orchestra.run.smithi008.stdout: "duration": 4294967295.9999995 2023-08-01T19:54:54.987 INFO:teuthology.orchestra.run.smithi008.stdout: }, 2023-08-01T19:54:54.987 INFO:teuthology.orchestra.run.smithi008.stdout: { 2023-08-01T19:54:54.987 INFO:teuthology.orchestra.run.smithi008.stdout: "event": "all_read", 2023-08-01T19:54:54.987 INFO:teuthology.orchestra.run.smithi008.stdout: "time": "2023-08-01T19:54:52.225385+0000", 2023-08-01T19:54:54.988 INFO:teuthology.orchestra.run.smithi008.stdout: "duration": 5.9135000000000002e-05 2023-08-01T19:54:54.988 INFO:teuthology.orchestra.run.smithi008.stdout: }, 2023-08-01T19:54:54.988 INFO:teuthology.orchestra.run.smithi008.stdout: { 2023-08-01T19:54:54.988 INFO:teuthology.orchestra.run.smithi008.stdout: "event": "dispatched", 2023-08-01T19:54:54.988 INFO:teuthology.orchestra.run.smithi008.stdout: "time": "2023-08-01T19:54:52.225393+0000", 2023-08-01T19:54:54.988 INFO:teuthology.orchestra.run.smithi008.stdout: "duration": 8.2660000000000001e-06 2023-08-01T19:54:54.988 INFO:teuthology.orchestra.run.smithi008.stdout: }, 2023-08-01T19:54:54.989 INFO:teuthology.orchestra.run.smithi008.stdout: { 2023-08-01T19:54:54.989 INFO:teuthology.orchestra.run.smithi008.stdout: "event": "queued_for_pg", 2023-08-01T19:54:54.989 INFO:teuthology.orchestra.run.smithi008.stdout: "time": "2023-08-01T19:54:52.225397+0000", 2023-08-01T19:54:54.989 INFO:teuthology.orchestra.run.smithi008.stdout: "duration": 4.5190000000000003e-06 2023-08-01T19:54:54.989 INFO:teuthology.orchestra.run.smithi008.stdout: }, 2023-08-01T19:54:54.989 INFO:teuthology.orchestra.run.smithi008.stdout: { 2023-08-01T19:54:54.989 INFO:teuthology.orchestra.run.smithi008.stdout: "event": "reached_pg", 2023-08-01T19:54:54.989 INFO:teuthology.orchestra.run.smithi008.stdout: "time": "2023-08-01T19:54:52.229136+0000", 2023-08-01T19:54:54.990 INFO:teuthology.orchestra.run.smithi008.stdout: "duration": 0.0037389989999999998 2023-08-01T19:54:54.990 INFO:teuthology.orchestra.run.smithi008.stdout: }, 2023-08-01T19:54:54.990 INFO:teuthology.orchestra.run.smithi008.stdout: { 2023-08-01T19:54:54.990 INFO:teuthology.orchestra.run.smithi008.stdout: "event": "started", 2023-08-01T19:54:54.990 INFO:teuthology.orchestra.run.smithi008.stdout: "time": "2023-08-01T19:54:52.229155+0000", 2023-08-01T19:54:54.990 INFO:teuthology.orchestra.run.smithi008.stdout: "duration": 1.8448999999999999e-05 2023-08-01T19:54:54.990 INFO:teuthology.orchestra.run.smithi008.stdout: }, 2023-08-01T19:54:54.990 INFO:teuthology.orchestra.run.smithi008.stdout: { 2023-08-01T19:54:54.991 INFO:teuthology.orchestra.run.smithi008.stdout: "event": "commit_sent", 2023-08-01T19:54:54.991 INFO:teuthology.orchestra.run.smithi008.stdout: "time": "2023-08-01T19:54:52.240552+0000", 2023-08-01T19:54:54.991 INFO:teuthology.orchestra.run.smithi008.stdout: "duration": 0.011397027000000001 2023-08-01T19:54:54.991 INFO:teuthology.orchestra.run.smithi008.stdout: }, 2023-08-01T19:54:54.991 INFO:teuthology.orchestra.run.smithi008.stdout: { 2023-08-01T19:54:54.991 INFO:teuthology.orchestra.run.smithi008.stdout: "event": "done", 2023-08-01T19:54:54.991 INFO:teuthology.orchestra.run.smithi008.stdout: "time": "2023-08-01T19:54:52.240567+0000", 2023-08-01T19:54:54.991 INFO:teuthology.orchestra.run.smithi008.stdout: "duration": 1.5313000000000001e-05 2023-08-01T19:54:54.992 INFO:teuthology.orchestra.run.smithi008.stdout: } 2023-08-01T19:54:54.992 INFO:teuthology.orchestra.run.smithi008.stdout: ] 2023-08-01T19:54:54.992 INFO:teuthology.orchestra.run.smithi008.stdout: } 2023-08-01T19:54:54.992 INFO:teuthology.orchestra.run.smithi008.stdout: }, 2023-08-01T19:54:54.992 INFO:teuthology.orchestra.run.smithi008.stdout: { 2023-08-01T19:54:54.992 INFO:teuthology.orchestra.run.smithi008.stdout: "description": "osd_op(client.4668.0:75065 5.6 5:6205fb02:::benchmark_data_smithi006_114134_object75064:head [set-alloc-hint object_size 65536 write_size 65536,write 0~65536] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e32)", 2023-08-01T19:54:54.992 INFO:teuthology.orchestra.run.smithi008.stdout: "initiated_at": "2023-08-01T19:54:52.250401+0000", 2023-08-01T19:54:54.993 INFO:teuthology.orchestra.run.smithi008.stdout: "age": 2.557973123, 2023-08-01T19:54:54.993 INFO:teuthology.orchestra.run.smithi008.stdout: "duration": 0.01559367, 2023-08-01T19:54:54.993 INFO:teuthology.orchestra.run.smithi008.stdout: "type_data": { 2023-08-01T19:54:54.993 INFO:teuthology.orchestra.run.smithi008.stdout: "flag_point": "commit sent; apply or cleanup", 2023-08-01T19:54:54.993 INFO:teuthology.orchestra.run.smithi008.stdout: "client_info": { 2023-08-01T19:54:54.993 INFO:teuthology.orchestra.run.smithi008.stdout: "client": "client.4668", 2023-08-01T19:54:54.993 INFO:teuthology.orchestra.run.smithi008.stdout: "client_addr": "172.21.15.6:0/1709472247", 2023-08-01T19:54:54.993 INFO:teuthology.orchestra.run.smithi008.stdout: "tid": 75065 2023-08-01T19:54:54.994 INFO:teuthology.orchestra.run.smithi008.stdout: }, 2023-08-01T19:54:54.994 INFO:teuthology.orchestra.run.smithi008.stdout: "events": [ 2023-08-01T19:54:54.994 INFO:teuthology.orchestra.run.smithi008.stdout: { 2023-08-01T19:54:54.994 INFO:teuthology.orchestra.run.smithi008.stdout: "event": "initiated", 2023-08-01T19:54:54.994 INFO:teuthology.orchestra.run.smithi008.stdout: "time": "2023-08-01T19:54:52.250401+0000", 2023-08-01T19:54:54.994 INFO:teuthology.orchestra.run.smithi008.stdout: "duration": 0 2023-08-01T19:54:54.994 INFO:teuthology.orchestra.run.smithi008.stdout: }, 2023-08-01T19:54:54.994 INFO:teuthology.orchestra.run.smithi008.stdout: { 2023-08-01T19:54:54.995 INFO:teuthology.orchestra.run.smithi008.stdout: "event": "throttled", 2023-08-01T19:54:54.995 INFO:teuthology.orchestra.run.smithi008.stdout: "time": "2023-08-01T19:54:52.250401+0000", 2023-08-01T19:54:54.995 INFO:teuthology.orchestra.run.smithi008.stdout: "duration": 0 2023-08-01T19:54:54.995 INFO:teuthology.orchestra.run.smithi008.stdout: }, 2023-08-01T19:54:54.995 INFO:teuthology.orchestra.run.smithi008.stdout: { 2023-08-01T19:54:54.995 INFO:teuthology.orchestra.run.smithi008.stdout: "event": "header_read", 2023-08-01T19:54:54.995 INFO:teuthology.orchestra.run.smithi008.stdout: "time": "2023-08-01T19:54:52.250399+0000", 2023-08-01T19:54:54.995 INFO:teuthology.orchestra.run.smithi008.stdout: "duration": 4294967295.9999986 2023-08-01T19:54:54.996 INFO:teuthology.orchestra.run.smithi008.stdout: }, 2023-08-01T19:54:54.996 INFO:teuthology.orchestra.run.smithi008.stdout: { 2023-08-01T19:54:54.996 INFO:teuthology.orchestra.run.smithi008.stdout: "event": "all_read", 2023-08-01T19:54:54.996 INFO:teuthology.orchestra.run.smithi008.stdout: "time": "2023-08-01T19:54:52.250446+0000", 2023-08-01T19:54:54.996 INFO:teuthology.orchestra.run.smithi008.stdout: "duration": 4.6499999999999999e-05 2023-08-01T19:54:54.996 INFO:teuthology.orchestra.run.smithi008.stdout: }, 2023-08-01T19:54:54.996 INFO:teuthology.orchestra.run.smithi008.stdout: { 2023-08-01T19:54:54.996 INFO:teuthology.orchestra.run.smithi008.stdout: "event": "dispatched", 2023-08-01T19:54:54.997 INFO:teuthology.orchestra.run.smithi008.stdout: "time": "2023-08-01T19:54:52.250458+0000", 2023-08-01T19:54:54.997 INFO:teuthology.orchestra.run.smithi008.stdout: "duration": 1.1933000000000001e-05 2023-08-01T19:54:54.997 INFO:teuthology.orchestra.run.smithi008.stdout: }, 2023-08-01T19:54:54.997 INFO:teuthology.orchestra.run.smithi008.stdout: { 2023-08-01T19:54:54.997 INFO:teuthology.orchestra.run.smithi008.stdout: "event": "queued_for_pg", 2023-08-01T19:54:54.997 INFO:teuthology.orchestra.run.smithi008.stdout: "time": "2023-08-01T19:54:52.250464+0000", 2023-08-01T19:54:54.997 INFO:teuthology.orchestra.run.smithi008.stdout: "duration": 6.8140000000000003e-06 2023-08-01T19:54:54.998 INFO:teuthology.orchestra.run.smithi008.stdout: }, 2023-08-01T19:54:54.998 INFO:teuthology.orchestra.run.smithi008.stdout: { 2023-08-01T19:54:54.998 INFO:teuthology.orchestra.run.smithi008.stdout: "event": "reached_pg", 2023-08-01T19:54:54.998 INFO:teuthology.orchestra.run.smithi008.stdout: "time": "2023-08-01T19:54:52.251070+0000", 2023-08-01T19:54:54.998 INFO:teuthology.orchestra.run.smithi008.stdout: "duration": 0.00060562500000000004 2023-08-01T19:54:54.998 INFO:teuthology.orchestra.run.smithi008.stdout: }, 2023-08-01T19:54:54.998 INFO:teuthology.orchestra.run.smithi008.stdout: { 2023-08-01T19:54:54.998 INFO:teuthology.orchestra.run.smithi008.stdout: "event": "started", 2023-08-01T19:54:54.999 INFO:teuthology.orchestra.run.smithi008.stdout: "time": "2023-08-01T19:54:52.251270+0000", 2023-08-01T19:54:54.999 INFO:teuthology.orchestra.run.smithi008.stdout: "duration": 0.00020012200000000001 2023-08-01T19:54:54.999 INFO:teuthology.orchestra.run.smithi008.stdout: }, 2023-08-01T19:54:54.999 INFO:teuthology.orchestra.run.smithi008.stdout: { 2023-08-01T19:54:54.999 INFO:teuthology.orchestra.run.smithi008.stdout: "event": "waiting for subops from 1", 2023-08-01T19:54:54.999 INFO:teuthology.orchestra.run.smithi008.stdout: "time": "2023-08-01T19:54:52.251448+0000", 2023-08-01T19:54:54.999 INFO:teuthology.orchestra.run.smithi008.stdout: "duration": 0.000177918 2023-08-01T19:54:55.000 INFO:teuthology.orchestra.run.smithi008.stdout: }, 2023-08-01T19:54:55.000 INFO:teuthology.orchestra.run.smithi008.stdout: { 2023-08-01T19:54:55.000 INFO:teuthology.orchestra.run.smithi008.stdout: "event": "sub_op_commit_rec", 2023-08-01T19:54:55.000 INFO:teuthology.orchestra.run.smithi008.stdout: "time": "2023-08-01T19:54:52.257590+0000", 2023-08-01T19:54:55.000 INFO:teuthology.orchestra.run.smithi008.stdout: "duration": 0.0061422450000000002 2023-08-01T19:54:55.000 INFO:teuthology.orchestra.run.smithi008.stdout: }, 2023-08-01T19:54:55.000 INFO:teuthology.orchestra.run.smithi008.stdout: { 2023-08-01T19:54:55.000 INFO:teuthology.orchestra.run.smithi008.stdout: "event": "op_commit", 2023-08-01T19:54:55.001 INFO:teuthology.orchestra.run.smithi008.stdout: "time": "2023-08-01T19:54:52.265910+0000", 2023-08-01T19:54:55.001 INFO:teuthology.orchestra.run.smithi008.stdout: "duration": 0.0083197649999999998 2023-08-01T19:54:55.001 INFO:teuthology.orchestra.run.smithi008.stdout: }, 2023-08-01T19:54:55.001 INFO:teuthology.orchestra.run.smithi008.stdout: { 2023-08-01T19:54:55.001 INFO:teuthology.orchestra.run.smithi008.stdout: "event": "commit_sent", 2023-08-01T19:54:55.001 INFO:teuthology.orchestra.run.smithi008.stdout: "time": "2023-08-01T19:54:52.265958+0000", 2023-08-01T19:54:55.001 INFO:teuthology.orchestra.run.smithi008.stdout: "duration": 4.7559999999999999e-05 2023-08-01T19:54:55.001 INFO:teuthology.orchestra.run.smithi008.stdout: }, 2023-08-01T19:54:55.002 INFO:teuthology.orchestra.run.smithi008.stdout: { 2023-08-01T19:54:55.002 INFO:teuthology.orchestra.run.smithi008.stdout: "event": "done", 2023-08-01T19:54:55.002 INFO:teuthology.orchestra.run.smithi008.stdout: "time": "2023-08-01T19:54:52.265994+0000", 2023-08-01T19:54:55.002 INFO:teuthology.orchestra.run.smithi008.stdout: "duration": 3.6628999999999998e-05 2023-08-01T19:54:55.002 INFO:teuthology.orchestra.run.smithi008.stdout: } 2023-08-01T19:54:55.002 INFO:teuthology.orchestra.run.smithi008.stdout: ] 2023-08-01T19:54:55.002 INFO:teuthology.orchestra.run.smithi008.stdout: } 2023-08-01T19:54:55.002 INFO:teuthology.orchestra.run.smithi008.stdout: }, 2023-08-01T19:54:55.003 INFO:teuthology.orchestra.run.smithi008.stdout: { 2023-08-01T19:54:55.003 INFO:teuthology.orchestra.run.smithi008.stdout: "description": "osd_repop(client.4668.0:75287 5.0 e32/19 5:0c891239:::benchmark_data_smithi006_114134_object75286:head v 32'4775, mlcod=32'4771)", 2023-08-01T19:54:55.003 INFO:teuthology.orchestra.run.smithi008.stdout: "initiated_at": "2023-08-01T19:54:52.374237+0000", 2023-08-01T19:54:55.003 INFO:teuthology.orchestra.run.smithi008.stdout: "age": 2.4341372109999999, 2023-08-01T19:54:55.003 INFO:teuthology.orchestra.run.smithi008.stdout: "duration": 0.015221561, 2023-08-01T19:54:55.003 INFO:teuthology.orchestra.run.smithi008.stdout: "type_data": { 2023-08-01T19:54:55.003 INFO:teuthology.orchestra.run.smithi008.stdout: "flag_point": "commit sent; apply or cleanup", 2023-08-01T19:54:55.003 INFO:teuthology.orchestra.run.smithi008.stdout: "events": [ 2023-08-01T19:54:55.004 INFO:teuthology.orchestra.run.smithi008.stdout: { 2023-08-01T19:54:55.004 INFO:teuthology.orchestra.run.smithi008.stdout: "event": "initiated", 2023-08-01T19:54:55.004 INFO:teuthology.orchestra.run.smithi008.stdout: "time": "2023-08-01T19:54:52.374237+0000", 2023-08-01T19:54:55.004 INFO:teuthology.orchestra.run.smithi008.stdout: "duration": 0 2023-08-01T19:54:55.004 INFO:teuthology.orchestra.run.smithi008.stdout: }, 2023-08-01T19:54:55.004 INFO:teuthology.orchestra.run.smithi008.stdout: { 2023-08-01T19:54:55.004 INFO:teuthology.orchestra.run.smithi008.stdout: "event": "throttled", 2023-08-01T19:54:55.005 INFO:teuthology.orchestra.run.smithi008.stdout: "time": "2023-08-01T19:54:52.374237+0000", 2023-08-01T19:54:55.005 INFO:teuthology.orchestra.run.smithi008.stdout: "duration": 0 2023-08-01T19:54:55.005 INFO:teuthology.orchestra.run.smithi008.stdout: }, 2023-08-01T19:54:55.005 INFO:teuthology.orchestra.run.smithi008.stdout: { 2023-08-01T19:54:55.005 INFO:teuthology.orchestra.run.smithi008.stdout: "event": "header_read", 2023-08-01T19:54:55.005 INFO:teuthology.orchestra.run.smithi008.stdout: "time": "2023-08-01T19:54:52.374236+0000", 2023-08-01T19:54:55.005 INFO:teuthology.orchestra.run.smithi008.stdout: "duration": 4294967295.999999 2023-08-01T19:54:55.006 INFO:teuthology.orchestra.run.smithi008.stdout: }, 2023-08-01T19:54:55.006 INFO:teuthology.orchestra.run.smithi008.stdout: { 2023-08-01T19:54:55.006 INFO:teuthology.orchestra.run.smithi008.stdout: "event": "all_read", 2023-08-01T19:54:55.006 INFO:teuthology.orchestra.run.smithi008.stdout: "time": "2023-08-01T19:54:52.374294+0000", 2023-08-01T19:54:55.006 INFO:teuthology.orchestra.run.smithi008.stdout: "duration": 5.7772000000000002e-05 2023-08-01T19:54:55.006 INFO:teuthology.orchestra.run.smithi008.stdout: }, 2023-08-01T19:54:55.006 INFO:teuthology.orchestra.run.smithi008.stdout: { 2023-08-01T19:54:55.006 INFO:teuthology.orchestra.run.smithi008.stdout: "event": "dispatched", 2023-08-01T19:54:55.007 INFO:teuthology.orchestra.run.smithi008.stdout: "time": "2023-08-01T19:54:52.374306+0000", 2023-08-01T19:54:55.007 INFO:teuthology.orchestra.run.smithi008.stdout: "duration": 1.2449999999999999e-05 2023-08-01T19:54:55.007 INFO:teuthology.orchestra.run.smithi008.stdout: }, 2023-08-01T19:54:55.007 INFO:teuthology.orchestra.run.smithi008.stdout: { 2023-08-01T19:54:55.007 INFO:teuthology.orchestra.run.smithi008.stdout: "event": "queued_for_pg", 2023-08-01T19:54:55.007 INFO:teuthology.orchestra.run.smithi008.stdout: "time": "2023-08-01T19:54:52.374315+0000", 2023-08-01T19:54:55.007 INFO:teuthology.orchestra.run.smithi008.stdout: "duration": 8.4339999999999992e-06 2023-08-01T19:54:55.008 INFO:teuthology.orchestra.run.smithi008.stdout: }, 2023-08-01T19:54:55.008 INFO:teuthology.orchestra.run.smithi008.stdout: { 2023-08-01T19:54:55.008 INFO:teuthology.orchestra.run.smithi008.stdout: "event": "reached_pg", 2023-08-01T19:54:55.008 INFO:teuthology.orchestra.run.smithi008.stdout: "time": "2023-08-01T19:54:52.374354+0000", 2023-08-01T19:54:55.008 INFO:teuthology.orchestra.run.smithi008.stdout: "duration": 3.9533000000000002e-05 2023-08-01T19:54:55.008 INFO:teuthology.orchestra.run.smithi008.stdout: }, 2023-08-01T19:54:55.008 INFO:teuthology.orchestra.run.smithi008.stdout: { 2023-08-01T19:54:55.008 INFO:teuthology.orchestra.run.smithi008.stdout: "event": "started", 2023-08-01T19:54:55.009 INFO:teuthology.orchestra.run.smithi008.stdout: "time": "2023-08-01T19:54:52.374374+0000", 2023-08-01T19:54:55.009 INFO:teuthology.orchestra.run.smithi008.stdout: "duration": 1.9749999999999999e-05 2023-08-01T19:54:55.009 INFO:teuthology.orchestra.run.smithi008.stdout: }, 2023-08-01T19:54:55.009 INFO:teuthology.orchestra.run.smithi008.stdout: { 2023-08-01T19:54:55.009 INFO:teuthology.orchestra.run.smithi008.stdout: "event": "commit_sent", 2023-08-01T19:54:55.009 INFO:teuthology.orchestra.run.smithi008.stdout: "time": "2023-08-01T19:54:52.389422+0000", 2023-08-01T19:54:55.009 INFO:teuthology.orchestra.run.smithi008.stdout: "duration": 0.015048448000000001 2023-08-01T19:54:55.009 INFO:teuthology.orchestra.run.smithi008.stdout: }, 2023-08-01T19:54:55.010 INFO:teuthology.orchestra.run.smithi008.stdout: { 2023-08-01T19:54:55.010 INFO:teuthology.orchestra.run.smithi008.stdout: "event": "done", 2023-08-01T19:54:55.010 INFO:teuthology.orchestra.run.smithi008.stdout: "time": "2023-08-01T19:54:52.389458+0000", 2023-08-01T19:54:55.010 INFO:teuthology.orchestra.run.smithi008.stdout: "duration": 3.5889999999999997e-05 2023-08-01T19:54:55.010 INFO:teuthology.orchestra.run.smithi008.stdout: } 2023-08-01T19:54:55.010 INFO:teuthology.orchestra.run.smithi008.stdout: ] 2023-08-01T19:54:55.010 INFO:teuthology.orchestra.run.smithi008.stdout: } 2023-08-01T19:54:55.011 INFO:teuthology.orchestra.run.smithi008.stdout: } 2023-08-01T19:54:55.011 INFO:teuthology.orchestra.run.smithi008.stdout: ] 2023-08-01T19:54:55.011 INFO:teuthology.orchestra.run.smithi008.stdout:} 2023-08-01T19:54:55.012 DEBUG:teuthology.orchestra.run.smithi101:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 30 ceph --cluster ceph --admin-daemon /var/run/ceph/ceph-osd.1.asok dump_ops_in_flight 2023-08-01T19:54:55.013 INFO:tasks.ceph.osd.0.smithi008.stderr:2023-08-01T19:54:55.011+0000 7f16a58f4700 -1 received signal: Hangup from /usr/bin/python3 /bin/daemon-helper kill ceph-osd -f --cluster ceph -i 0 (PID: 111179) UID: 0 2023-08-01T19:54:55.065 INFO:teuthology.orchestra.run.smithi006.stderr:nodeep-scrub is unset 2023-08-01T19:54:55.113 INFO:tasks.ceph.osd.0.smithi008.stderr:2023-08-01T19:54:55.112+0000 7f16a58f4700 -1 received signal: Hangup from /usr/bin/python3 /bin/daemon-helper kill ceph-osd -f --cluster ceph -i 0 (PID: 111179) UID: 0 2023-08-01T19:54:55.177 INFO:teuthology.orchestra.run.smithi101.stdout:{ 2023-08-01T19:54:55.177 INFO:teuthology.orchestra.run.smithi101.stdout: "ops": [ 2023-08-01T19:54:55.177 INFO:teuthology.orchestra.run.smithi101.stdout: { 2023-08-01T19:54:55.177 INFO:teuthology.orchestra.run.smithi101.stdout: "description": "osd_repop(client.4668.0:80733 5.c e34/19 5:37d754f8:::benchmark_data_smithi006_114134_object80732:head v 34'5052, mlcod=34'5049)", 2023-08-01T19:54:55.177 INFO:teuthology.orchestra.run.smithi101.stdout: "initiated_at": "2023-08-01T19:54:55.175368+0000", 2023-08-01T19:54:55.178 INFO:teuthology.orchestra.run.smithi101.stdout: "age": 0.00022164600000000001, 2023-08-01T19:54:55.178 INFO:teuthology.orchestra.run.smithi101.stdout: "duration": 0.00024923799999999999, 2023-08-01T19:54:55.178 INFO:teuthology.orchestra.run.smithi101.stdout: "type_data": { 2023-08-01T19:54:55.178 INFO:teuthology.orchestra.run.smithi101.stdout: "flag_point": "started", 2023-08-01T19:54:55.178 INFO:teuthology.orchestra.run.smithi101.stdout: "events": [ 2023-08-01T19:54:55.178 INFO:teuthology.orchestra.run.smithi101.stdout: { 2023-08-01T19:54:55.178 INFO:teuthology.orchestra.run.smithi101.stdout: "event": "initiated", 2023-08-01T19:54:55.179 INFO:teuthology.orchestra.run.smithi101.stdout: "time": "2023-08-01T19:54:55.175368+0000", 2023-08-01T19:54:55.179 INFO:teuthology.orchestra.run.smithi101.stdout: "duration": 0 2023-08-01T19:54:55.179 INFO:teuthology.orchestra.run.smithi101.stdout: }, 2023-08-01T19:54:55.179 INFO:teuthology.orchestra.run.smithi101.stdout: { 2023-08-01T19:54:55.179 INFO:teuthology.orchestra.run.smithi101.stdout: "event": "throttled", 2023-08-01T19:54:55.179 INFO:teuthology.orchestra.run.smithi101.stdout: "time": "2023-08-01T19:54:55.175368+0000", 2023-08-01T19:54:55.179 INFO:teuthology.orchestra.run.smithi101.stdout: "duration": 0 2023-08-01T19:54:55.179 INFO:teuthology.orchestra.run.smithi101.stdout: }, 2023-08-01T19:54:55.180 INFO:teuthology.orchestra.run.smithi101.stdout: { 2023-08-01T19:54:55.180 INFO:teuthology.orchestra.run.smithi101.stdout: "event": "header_read", 2023-08-01T19:54:55.180 INFO:teuthology.orchestra.run.smithi101.stdout: "time": "2023-08-01T19:54:55.175367+0000", 2023-08-01T19:54:55.180 INFO:teuthology.orchestra.run.smithi101.stdout: "duration": 4294967295.9999995 2023-08-01T19:54:55.180 INFO:teuthology.orchestra.run.smithi101.stdout: }, 2023-08-01T19:54:55.180 INFO:teuthology.orchestra.run.smithi101.stdout: { 2023-08-01T19:54:55.180 INFO:teuthology.orchestra.run.smithi101.stdout: "event": "all_read", 2023-08-01T19:54:55.181 INFO:teuthology.orchestra.run.smithi101.stdout: "time": "2023-08-01T19:54:55.175419+0000", 2023-08-01T19:54:55.181 INFO:teuthology.orchestra.run.smithi101.stdout: "duration": 5.2108999999999999e-05 2023-08-01T19:54:55.181 INFO:teuthology.orchestra.run.smithi101.stdout: }, 2023-08-01T19:54:55.181 INFO:teuthology.orchestra.run.smithi101.stdout: { 2023-08-01T19:54:55.181 INFO:teuthology.orchestra.run.smithi101.stdout: "event": "dispatched", 2023-08-01T19:54:55.181 INFO:teuthology.orchestra.run.smithi101.stdout: "time": "2023-08-01T19:54:55.175433+0000", 2023-08-01T19:54:55.181 INFO:teuthology.orchestra.run.smithi101.stdout: "duration": 1.3781000000000001e-05 2023-08-01T19:54:55.181 INFO:teuthology.orchestra.run.smithi101.stdout: }, 2023-08-01T19:54:55.182 INFO:teuthology.orchestra.run.smithi101.stdout: { 2023-08-01T19:54:55.182 INFO:teuthology.orchestra.run.smithi101.stdout: "event": "queued_for_pg", 2023-08-01T19:54:55.182 INFO:teuthology.orchestra.run.smithi101.stdout: "time": "2023-08-01T19:54:55.175439+0000", 2023-08-01T19:54:55.182 INFO:teuthology.orchestra.run.smithi101.stdout: "duration": 5.8409999999999996e-06 2023-08-01T19:54:55.182 INFO:teuthology.orchestra.run.smithi101.stdout: }, 2023-08-01T19:54:55.182 INFO:teuthology.orchestra.run.smithi101.stdout: { 2023-08-01T19:54:55.182 INFO:teuthology.orchestra.run.smithi101.stdout: "event": "reached_pg", 2023-08-01T19:54:55.183 INFO:teuthology.orchestra.run.smithi101.stdout: "time": "2023-08-01T19:54:55.175472+0000", 2023-08-01T19:54:55.183 INFO:teuthology.orchestra.run.smithi101.stdout: "duration": 3.3176999999999998e-05 2023-08-01T19:54:55.183 INFO:teuthology.orchestra.run.smithi101.stdout: }, 2023-08-01T19:54:55.183 INFO:teuthology.orchestra.run.smithi101.stdout: { 2023-08-01T19:54:55.183 INFO:teuthology.orchestra.run.smithi101.stdout: "event": "started", 2023-08-01T19:54:55.183 INFO:teuthology.orchestra.run.smithi101.stdout: "time": "2023-08-01T19:54:55.175502+0000", 2023-08-01T19:54:55.183 INFO:teuthology.orchestra.run.smithi101.stdout: "duration": 2.9974000000000001e-05 2023-08-01T19:54:55.183 INFO:teuthology.orchestra.run.smithi101.stdout: } 2023-08-01T19:54:55.184 INFO:teuthology.orchestra.run.smithi101.stdout: ] 2023-08-01T19:54:55.184 INFO:teuthology.orchestra.run.smithi101.stdout: } 2023-08-01T19:54:55.184 INFO:teuthology.orchestra.run.smithi101.stdout: }, 2023-08-01T19:54:55.184 INFO:teuthology.orchestra.run.smithi101.stdout: { 2023-08-01T19:54:55.184 INFO:teuthology.orchestra.run.smithi101.stdout: "description": "osd_repop(client.4668.0:80734 5.5 e34/19)", 2023-08-01T19:54:55.184 INFO:teuthology.orchestra.run.smithi101.stdout: "initiated_at": "2023-08-01T19:54:55.175454+0000", 2023-08-01T19:54:55.184 INFO:teuthology.orchestra.run.smithi101.stdout: "age": 0.000135403, 2023-08-01T19:54:55.185 INFO:teuthology.orchestra.run.smithi101.stdout: "duration": 0.00023603, 2023-08-01T19:54:55.185 INFO:teuthology.orchestra.run.smithi101.stdout: "type_data": { 2023-08-01T19:54:55.185 INFO:teuthology.orchestra.run.smithi101.stdout: "flag_point": "queued for pg", 2023-08-01T19:54:55.185 INFO:teuthology.orchestra.run.smithi101.stdout: "events": [ 2023-08-01T19:54:55.185 INFO:teuthology.orchestra.run.smithi101.stdout: { 2023-08-01T19:54:55.185 INFO:teuthology.orchestra.run.smithi101.stdout: "event": "initiated", 2023-08-01T19:54:55.185 INFO:teuthology.orchestra.run.smithi101.stdout: "time": "2023-08-01T19:54:55.175454+0000", 2023-08-01T19:54:55.186 INFO:teuthology.orchestra.run.smithi101.stdout: "duration": 0 2023-08-01T19:54:55.186 INFO:teuthology.orchestra.run.smithi101.stdout: }, 2023-08-01T19:54:55.186 INFO:teuthology.orchestra.run.smithi101.stdout: { 2023-08-01T19:54:55.186 INFO:teuthology.orchestra.run.smithi101.stdout: "event": "throttled", 2023-08-01T19:54:55.186 INFO:teuthology.orchestra.run.smithi101.stdout: "time": "2023-08-01T19:54:55.175454+0000", 2023-08-01T19:54:55.186 INFO:teuthology.orchestra.run.smithi101.stdout: "duration": 0 2023-08-01T19:54:55.186 INFO:teuthology.orchestra.run.smithi101.stdout: }, 2023-08-01T19:54:55.186 INFO:teuthology.orchestra.run.smithi101.stdout: { 2023-08-01T19:54:55.187 INFO:teuthology.orchestra.run.smithi101.stdout: "event": "header_read", 2023-08-01T19:54:55.187 INFO:teuthology.orchestra.run.smithi101.stdout: "time": "2023-08-01T19:54:55.175453+0000", 2023-08-01T19:54:55.187 INFO:teuthology.orchestra.run.smithi101.stdout: "duration": 4294967295.9999995 2023-08-01T19:54:55.187 INFO:teuthology.orchestra.run.smithi101.stdout: }, 2023-08-01T19:54:55.187 INFO:teuthology.orchestra.run.smithi101.stdout: { 2023-08-01T19:54:55.187 INFO:teuthology.orchestra.run.smithi101.stdout: "event": "all_read", 2023-08-01T19:54:55.187 INFO:teuthology.orchestra.run.smithi101.stdout: "time": "2023-08-01T19:54:55.175483+0000", 2023-08-01T19:54:55.187 INFO:teuthology.orchestra.run.smithi101.stdout: "duration": 3.0008000000000001e-05 2023-08-01T19:54:55.188 INFO:teuthology.orchestra.run.smithi101.stdout: }, 2023-08-01T19:54:55.188 INFO:teuthology.orchestra.run.smithi101.stdout: { 2023-08-01T19:54:55.188 INFO:teuthology.orchestra.run.smithi101.stdout: "event": "dispatched", 2023-08-01T19:54:55.188 INFO:teuthology.orchestra.run.smithi101.stdout: "time": "2023-08-01T19:54:55.175492+0000", 2023-08-01T19:54:55.188 INFO:teuthology.orchestra.run.smithi101.stdout: "duration": 8.4200000000000007e-06 2023-08-01T19:54:55.188 INFO:teuthology.orchestra.run.smithi101.stdout: }, 2023-08-01T19:54:55.188 INFO:teuthology.orchestra.run.smithi101.stdout: { 2023-08-01T19:54:55.188 INFO:teuthology.orchestra.run.smithi101.stdout: "event": "queued_for_pg", 2023-08-01T19:54:55.189 INFO:teuthology.orchestra.run.smithi101.stdout: "time": "2023-08-01T19:54:55.175496+0000", 2023-08-01T19:54:55.189 INFO:teuthology.orchestra.run.smithi101.stdout: "duration": 4.2300000000000002e-06 2023-08-01T19:54:55.189 INFO:teuthology.orchestra.run.smithi101.stdout: } 2023-08-01T19:54:55.189 INFO:teuthology.orchestra.run.smithi101.stdout: ] 2023-08-01T19:54:55.189 INFO:teuthology.orchestra.run.smithi101.stdout: } 2023-08-01T19:54:55.189 INFO:teuthology.orchestra.run.smithi101.stdout: }, 2023-08-01T19:54:55.189 INFO:teuthology.orchestra.run.smithi101.stdout: { 2023-08-01T19:54:55.190 INFO:teuthology.orchestra.run.smithi101.stdout: "description": "osd_op(client.4668.0:80737 5.7 5:e7d81e97:::benchmark_data_smithi006_114134_object80736:head [set-alloc-hint object_size 65536 write_size 65536,write 0~65536 in=65536b] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e34)", 2023-08-01T19:54:55.190 INFO:teuthology.orchestra.run.smithi101.stdout: "initiated_at": "2023-08-01T19:54:55.175548+0000", 2023-08-01T19:54:55.190 INFO:teuthology.orchestra.run.smithi101.stdout: "age": 4.1467000000000001e-05, 2023-08-01T19:54:55.190 INFO:teuthology.orchestra.run.smithi101.stdout: "duration": 0.00020580699999999999, 2023-08-01T19:54:55.190 INFO:teuthology.orchestra.run.smithi101.stdout: "type_data": { 2023-08-01T19:54:55.190 INFO:teuthology.orchestra.run.smithi101.stdout: "flag_point": "reached pg", 2023-08-01T19:54:55.190 INFO:teuthology.orchestra.run.smithi101.stdout: "client_info": { 2023-08-01T19:54:55.190 INFO:teuthology.orchestra.run.smithi101.stdout: "client": "client.4668", 2023-08-01T19:54:55.191 INFO:teuthology.orchestra.run.smithi101.stdout: "client_addr": "172.21.15.6:0/1709472247", 2023-08-01T19:54:55.191 INFO:teuthology.orchestra.run.smithi101.stdout: "tid": 80737 2023-08-01T19:54:55.191 INFO:teuthology.orchestra.run.smithi101.stdout: }, 2023-08-01T19:54:55.191 INFO:teuthology.orchestra.run.smithi101.stdout: "events": [ 2023-08-01T19:54:55.191 INFO:teuthology.orchestra.run.smithi101.stdout: { 2023-08-01T19:54:55.191 INFO:teuthology.orchestra.run.smithi101.stdout: "event": "initiated", 2023-08-01T19:54:55.191 INFO:teuthology.orchestra.run.smithi101.stdout: "time": "2023-08-01T19:54:55.175548+0000", 2023-08-01T19:54:55.191 INFO:teuthology.orchestra.run.smithi101.stdout: "duration": 0 2023-08-01T19:54:55.192 INFO:teuthology.orchestra.run.smithi101.stdout: }, 2023-08-01T19:54:55.192 INFO:teuthology.orchestra.run.smithi101.stdout: { 2023-08-01T19:54:55.192 INFO:teuthology.orchestra.run.smithi101.stdout: "event": "throttled", 2023-08-01T19:54:55.192 INFO:teuthology.orchestra.run.smithi101.stdout: "time": "2023-08-01T19:54:55.175548+0000", 2023-08-01T19:54:55.192 INFO:teuthology.orchestra.run.smithi101.stdout: "duration": 0 2023-08-01T19:54:55.192 INFO:teuthology.orchestra.run.smithi101.stdout: }, 2023-08-01T19:54:55.192 INFO:teuthology.orchestra.run.smithi101.stdout: { 2023-08-01T19:54:55.193 INFO:teuthology.orchestra.run.smithi101.stdout: "event": "header_read", 2023-08-01T19:54:55.193 INFO:teuthology.orchestra.run.smithi101.stdout: "time": "2023-08-01T19:54:55.175547+0000", 2023-08-01T19:54:55.193 INFO:teuthology.orchestra.run.smithi101.stdout: "duration": 4294967295.999999 2023-08-01T19:54:55.193 INFO:teuthology.orchestra.run.smithi101.stdout: }, 2023-08-01T19:54:55.193 INFO:teuthology.orchestra.run.smithi101.stdout: { 2023-08-01T19:54:55.193 INFO:teuthology.orchestra.run.smithi101.stdout: "event": "all_read", 2023-08-01T19:54:55.193 INFO:teuthology.orchestra.run.smithi101.stdout: "time": "2023-08-01T19:54:55.175610+0000", 2023-08-01T19:54:55.193 INFO:teuthology.orchestra.run.smithi101.stdout: "duration": 6.2850999999999998e-05 2023-08-01T19:54:55.194 INFO:teuthology.orchestra.run.smithi101.stdout: }, 2023-08-01T19:54:55.194 INFO:teuthology.orchestra.run.smithi101.stdout: { 2023-08-01T19:54:55.194 INFO:teuthology.orchestra.run.smithi101.stdout: "event": "dispatched", 2023-08-01T19:54:55.194 INFO:teuthology.orchestra.run.smithi101.stdout: "time": "2023-08-01T19:54:55.175619+0000", 2023-08-01T19:54:55.194 INFO:teuthology.orchestra.run.smithi101.stdout: "duration": 9.7010000000000008e-06 2023-08-01T19:54:55.194 INFO:teuthology.orchestra.run.smithi101.stdout: }, 2023-08-01T19:54:55.194 INFO:teuthology.orchestra.run.smithi101.stdout: { 2023-08-01T19:54:55.194 INFO:teuthology.orchestra.run.smithi101.stdout: "event": "queued_for_pg", 2023-08-01T19:54:55.195 INFO:teuthology.orchestra.run.smithi101.stdout: "time": "2023-08-01T19:54:55.175626+0000", 2023-08-01T19:54:55.195 INFO:teuthology.orchestra.run.smithi101.stdout: "duration": 6.6000000000000003e-06 2023-08-01T19:54:55.195 INFO:teuthology.orchestra.run.smithi101.stdout: }, 2023-08-01T19:54:55.195 INFO:teuthology.orchestra.run.smithi101.stdout: { 2023-08-01T19:54:55.195 INFO:teuthology.orchestra.run.smithi101.stdout: "event": "reached_pg", 2023-08-01T19:54:55.195 INFO:teuthology.orchestra.run.smithi101.stdout: "time": "2023-08-01T19:54:55.175660+0000", 2023-08-01T19:54:55.195 INFO:teuthology.orchestra.run.smithi101.stdout: "duration": 3.3776000000000003e-05 2023-08-01T19:54:55.196 INFO:teuthology.orchestra.run.smithi101.stdout: } 2023-08-01T19:54:55.196 INFO:teuthology.orchestra.run.smithi101.stdout: ] 2023-08-01T19:54:55.196 INFO:teuthology.orchestra.run.smithi101.stdout: } 2023-08-01T19:54:55.196 INFO:teuthology.orchestra.run.smithi101.stdout: }, 2023-08-01T19:54:55.196 INFO:teuthology.orchestra.run.smithi101.stdout: { 2023-08-01T19:54:55.196 INFO:teuthology.orchestra.run.smithi101.stdout: "description": "osd_op(client.4668.0:80729 5.7 5:e93b2c56:::benchmark_data_smithi006_114134_object80728:head [set-alloc-hint object_size 65536 write_size 65536,write 0~65536 in=65536b] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e34)", 2023-08-01T19:54:55.196 INFO:teuthology.orchestra.run.smithi101.stdout: "initiated_at": "2023-08-01T19:54:55.170407+0000", 2023-08-01T19:54:55.196 INFO:teuthology.orchestra.run.smithi101.stdout: "age": 0.0051824419999999998, 2023-08-01T19:54:55.197 INFO:teuthology.orchestra.run.smithi101.stdout: "duration": 0.0054044690000000003, 2023-08-01T19:54:55.197 INFO:teuthology.orchestra.run.smithi101.stdout: "type_data": { 2023-08-01T19:54:55.197 INFO:teuthology.orchestra.run.smithi101.stdout: "flag_point": "waiting for sub ops", 2023-08-01T19:54:55.197 INFO:teuthology.orchestra.run.smithi101.stdout: "client_info": { 2023-08-01T19:54:55.197 INFO:teuthology.orchestra.run.smithi101.stdout: "client": "client.4668", 2023-08-01T19:54:55.197 INFO:teuthology.orchestra.run.smithi101.stdout: "client_addr": "172.21.15.6:0/1709472247", 2023-08-01T19:54:55.197 INFO:teuthology.orchestra.run.smithi101.stdout: "tid": 80729 2023-08-01T19:54:55.197 INFO:teuthology.orchestra.run.smithi101.stdout: }, 2023-08-01T19:54:55.198 INFO:teuthology.orchestra.run.smithi101.stdout: "events": [ 2023-08-01T19:54:55.198 INFO:teuthology.orchestra.run.smithi101.stdout: { 2023-08-01T19:54:55.198 INFO:teuthology.orchestra.run.smithi101.stdout: "event": "initiated", 2023-08-01T19:54:55.198 INFO:teuthology.orchestra.run.smithi101.stdout: "time": "2023-08-01T19:54:55.170407+0000", 2023-08-01T19:54:55.198 INFO:teuthology.orchestra.run.smithi101.stdout: "duration": 0 2023-08-01T19:54:55.198 INFO:teuthology.orchestra.run.smithi101.stdout: }, 2023-08-01T19:54:55.198 INFO:teuthology.orchestra.run.smithi101.stdout: { 2023-08-01T19:54:55.198 INFO:teuthology.orchestra.run.smithi101.stdout: "event": "throttled", 2023-08-01T19:54:55.199 INFO:teuthology.orchestra.run.smithi101.stdout: "time": "2023-08-01T19:54:55.170407+0000", 2023-08-01T19:54:55.199 INFO:teuthology.orchestra.run.smithi101.stdout: "duration": 0 2023-08-01T19:54:55.199 INFO:teuthology.orchestra.run.smithi101.stdout: }, 2023-08-01T19:54:55.199 INFO:teuthology.orchestra.run.smithi101.stdout: { 2023-08-01T19:54:55.199 INFO:teuthology.orchestra.run.smithi101.stdout: "event": "header_read", 2023-08-01T19:54:55.199 INFO:teuthology.orchestra.run.smithi101.stdout: "time": "2023-08-01T19:54:55.170406+0000", 2023-08-01T19:54:55.199 INFO:teuthology.orchestra.run.smithi101.stdout: "duration": 4294967295.999999 2023-08-01T19:54:55.200 INFO:teuthology.orchestra.run.smithi101.stdout: }, 2023-08-01T19:54:55.200 INFO:teuthology.orchestra.run.smithi101.stdout: { 2023-08-01T19:54:55.200 INFO:teuthology.orchestra.run.smithi101.stdout: "event": "all_read", 2023-08-01T19:54:55.200 INFO:teuthology.orchestra.run.smithi101.stdout: "time": "2023-08-01T19:54:55.170546+0000", 2023-08-01T19:54:55.200 INFO:teuthology.orchestra.run.smithi101.stdout: "duration": 0.000140302 2023-08-01T19:54:55.200 INFO:teuthology.orchestra.run.smithi101.stdout: }, 2023-08-01T19:54:55.200 INFO:teuthology.orchestra.run.smithi101.stdout: { 2023-08-01T19:54:55.200 INFO:teuthology.orchestra.run.smithi101.stdout: "event": "dispatched", 2023-08-01T19:54:55.201 INFO:teuthology.orchestra.run.smithi101.stdout: "time": "2023-08-01T19:54:55.170558+0000", 2023-08-01T19:54:55.201 INFO:teuthology.orchestra.run.smithi101.stdout: "duration": 1.198e-05 2023-08-01T19:54:55.201 INFO:teuthology.orchestra.run.smithi101.stdout: }, 2023-08-01T19:54:55.201 INFO:teuthology.orchestra.run.smithi101.stdout: { 2023-08-01T19:54:55.201 INFO:teuthology.orchestra.run.smithi101.stdout: "event": "queued_for_pg", 2023-08-01T19:54:55.201 INFO:teuthology.orchestra.run.smithi101.stdout: "time": "2023-08-01T19:54:55.170563+0000", 2023-08-01T19:54:55.201 INFO:teuthology.orchestra.run.smithi101.stdout: "duration": 4.3649999999999997e-06 2023-08-01T19:54:55.201 INFO:teuthology.orchestra.run.smithi101.stdout: }, 2023-08-01T19:54:55.202 INFO:teuthology.orchestra.run.smithi101.stdout: { 2023-08-01T19:54:55.202 INFO:teuthology.orchestra.run.smithi101.stdout: "event": "reached_pg", 2023-08-01T19:54:55.202 INFO:teuthology.orchestra.run.smithi101.stdout: "time": "2023-08-01T19:54:55.170645+0000", 2023-08-01T19:54:55.202 INFO:teuthology.orchestra.run.smithi101.stdout: "duration": 8.2721999999999998e-05 2023-08-01T19:54:55.202 INFO:teuthology.orchestra.run.smithi101.stdout: }, 2023-08-01T19:54:55.202 INFO:teuthology.orchestra.run.smithi101.stdout: { 2023-08-01T19:54:55.202 INFO:teuthology.orchestra.run.smithi101.stdout: "event": "started", 2023-08-01T19:54:55.203 INFO:teuthology.orchestra.run.smithi101.stdout: "time": "2023-08-01T19:54:55.170775+0000", 2023-08-01T19:54:55.203 INFO:teuthology.orchestra.run.smithi101.stdout: "duration": 0.000129269 2023-08-01T19:54:55.203 INFO:teuthology.orchestra.run.smithi101.stdout: }, 2023-08-01T19:54:55.203 INFO:teuthology.orchestra.run.smithi101.stdout: { 2023-08-01T19:54:55.203 INFO:teuthology.orchestra.run.smithi101.stdout: "event": "waiting for subops from 0", 2023-08-01T19:54:55.203 INFO:teuthology.orchestra.run.smithi101.stdout: "time": "2023-08-01T19:54:55.170877+0000", 2023-08-01T19:54:55.203 INFO:teuthology.orchestra.run.smithi101.stdout: "duration": 0.00010289900000000001 2023-08-01T19:54:55.203 INFO:teuthology.orchestra.run.smithi101.stdout: }, 2023-08-01T19:54:55.204 INFO:teuthology.orchestra.run.smithi101.stdout: { 2023-08-01T19:54:55.204 INFO:teuthology.orchestra.run.smithi101.stdout: "event": "op_commit", 2023-08-01T19:54:55.204 INFO:teuthology.orchestra.run.smithi101.stdout: "time": "2023-08-01T19:54:55.174869+0000", 2023-08-01T19:54:55.204 INFO:teuthology.orchestra.run.smithi101.stdout: "duration": 0.0039914950000000003 2023-08-01T19:54:55.204 INFO:teuthology.orchestra.run.smithi101.stdout: } 2023-08-01T19:54:55.204 INFO:teuthology.orchestra.run.smithi101.stdout: ] 2023-08-01T19:54:55.204 INFO:teuthology.orchestra.run.smithi101.stdout: } 2023-08-01T19:54:55.204 INFO:teuthology.orchestra.run.smithi101.stdout: }, 2023-08-01T19:54:55.205 INFO:teuthology.orchestra.run.smithi101.stdout: { 2023-08-01T19:54:55.205 INFO:teuthology.orchestra.run.smithi101.stdout: "description": "osd_op(client.4668.0:80731 5.2 5:4f1d4f89:::benchmark_data_smithi006_114134_object80730:head [set-alloc-hint object_size 65536 write_size 65536,write 0~65536 in=65536b] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e34)", 2023-08-01T19:54:55.205 INFO:teuthology.orchestra.run.smithi101.stdout: "initiated_at": "2023-08-01T19:54:55.170582+0000", 2023-08-01T19:54:55.205 INFO:teuthology.orchestra.run.smithi101.stdout: "age": 0.0050074990000000003, 2023-08-01T19:54:55.205 INFO:teuthology.orchestra.run.smithi101.stdout: "duration": 0.0053208919999999998, 2023-08-01T19:54:55.205 INFO:teuthology.orchestra.run.smithi101.stdout: "type_data": { 2023-08-01T19:54:55.205 INFO:teuthology.orchestra.run.smithi101.stdout: "flag_point": "waiting for sub ops", 2023-08-01T19:54:55.206 INFO:teuthology.orchestra.run.smithi101.stdout: "client_info": { 2023-08-01T19:54:55.206 INFO:teuthology.orchestra.run.smithi101.stdout: "client": "client.4668", 2023-08-01T19:54:55.206 INFO:teuthology.orchestra.run.smithi101.stdout: "client_addr": "172.21.15.6:0/1709472247", 2023-08-01T19:54:55.206 INFO:teuthology.orchestra.run.smithi101.stdout: "tid": 80731 2023-08-01T19:54:55.206 INFO:teuthology.orchestra.run.smithi101.stdout: }, 2023-08-01T19:54:55.206 INFO:teuthology.orchestra.run.smithi101.stdout: "events": [ 2023-08-01T19:54:55.206 INFO:teuthology.orchestra.run.smithi101.stdout: { 2023-08-01T19:54:55.207 INFO:teuthology.orchestra.run.smithi101.stdout: "event": "initiated", 2023-08-01T19:54:55.207 INFO:teuthology.orchestra.run.smithi101.stdout: "time": "2023-08-01T19:54:55.170582+0000", 2023-08-01T19:54:55.207 INFO:teuthology.orchestra.run.smithi101.stdout: "duration": 0 2023-08-01T19:54:55.207 INFO:teuthology.orchestra.run.smithi101.stdout: }, 2023-08-01T19:54:55.207 INFO:teuthology.orchestra.run.smithi101.stdout: { 2023-08-01T19:54:55.207 INFO:teuthology.orchestra.run.smithi101.stdout: "event": "throttled", 2023-08-01T19:54:55.207 INFO:teuthology.orchestra.run.smithi101.stdout: "time": "2023-08-01T19:54:55.170582+0000", 2023-08-01T19:54:55.208 INFO:teuthology.orchestra.run.smithi101.stdout: "duration": 0 2023-08-01T19:54:55.208 INFO:teuthology.orchestra.run.smithi101.stdout: }, 2023-08-01T19:54:55.208 INFO:teuthology.orchestra.run.smithi101.stdout: { 2023-08-01T19:54:55.208 INFO:teuthology.orchestra.run.smithi101.stdout: "event": "header_read", 2023-08-01T19:54:55.208 INFO:teuthology.orchestra.run.smithi101.stdout: "time": "2023-08-01T19:54:55.170578+0000", 2023-08-01T19:54:55.208 INFO:teuthology.orchestra.run.smithi101.stdout: "duration": 4294967295.9999957 2023-08-01T19:54:55.208 INFO:teuthology.orchestra.run.smithi101.stdout: }, 2023-08-01T19:54:55.208 INFO:teuthology.orchestra.run.smithi101.stdout: { 2023-08-01T19:54:55.209 INFO:teuthology.orchestra.run.smithi101.stdout: "event": "all_read", 2023-08-01T19:54:55.209 INFO:teuthology.orchestra.run.smithi101.stdout: "time": "2023-08-01T19:54:55.170649+0000", 2023-08-01T19:54:55.209 INFO:teuthology.orchestra.run.smithi101.stdout: "duration": 7.1833000000000002e-05 2023-08-01T19:54:55.209 INFO:teuthology.orchestra.run.smithi101.stdout: }, 2023-08-01T19:54:55.209 INFO:teuthology.orchestra.run.smithi101.stdout: { 2023-08-01T19:54:55.209 INFO:teuthology.orchestra.run.smithi101.stdout: "event": "dispatched", 2023-08-01T19:54:55.209 INFO:teuthology.orchestra.run.smithi101.stdout: "time": "2023-08-01T19:54:55.170657+0000", 2023-08-01T19:54:55.210 INFO:teuthology.orchestra.run.smithi101.stdout: "duration": 7.9330000000000001e-06 2023-08-01T19:54:55.210 INFO:teuthology.orchestra.run.smithi101.stdout: }, 2023-08-01T19:54:55.210 INFO:teuthology.orchestra.run.smithi101.stdout: { 2023-08-01T19:54:55.210 INFO:teuthology.orchestra.run.smithi101.stdout: "event": "queued_for_pg", 2023-08-01T19:54:55.210 INFO:teuthology.orchestra.run.smithi101.stdout: "time": "2023-08-01T19:54:55.170662+0000", 2023-08-01T19:54:55.210 INFO:teuthology.orchestra.run.smithi101.stdout: "duration": 5.1699999999999996e-06 2023-08-01T19:54:55.210 INFO:teuthology.orchestra.run.smithi101.stdout: }, 2023-08-01T19:54:55.211 INFO:teuthology.orchestra.run.smithi101.stdout: { 2023-08-01T19:54:55.211 INFO:teuthology.orchestra.run.smithi101.stdout: "event": "reached_pg", 2023-08-01T19:54:55.211 INFO:teuthology.orchestra.run.smithi101.stdout: "time": "2023-08-01T19:54:55.170694+0000", 2023-08-01T19:54:55.211 INFO:teuthology.orchestra.run.smithi101.stdout: "duration": 3.1659000000000003e-05 2023-08-01T19:54:55.211 INFO:teuthology.orchestra.run.smithi101.stdout: }, 2023-08-01T19:54:55.211 INFO:teuthology.orchestra.run.smithi101.stdout: { 2023-08-01T19:54:55.211 INFO:teuthology.orchestra.run.smithi101.stdout: "event": "started", 2023-08-01T19:54:55.212 INFO:teuthology.orchestra.run.smithi101.stdout: "time": "2023-08-01T19:54:55.170786+0000", 2023-08-01T19:54:55.212 INFO:teuthology.orchestra.run.smithi101.stdout: "duration": 9.1576000000000005e-05 2023-08-01T19:54:55.212 INFO:teuthology.orchestra.run.smithi101.stdout: }, 2023-08-01T19:54:55.212 INFO:teuthology.orchestra.run.smithi101.stdout: { 2023-08-01T19:54:55.212 INFO:teuthology.orchestra.run.smithi101.stdout: "event": "waiting for subops from 0", 2023-08-01T19:54:55.212 INFO:teuthology.orchestra.run.smithi101.stdout: "time": "2023-08-01T19:54:55.170930+0000", 2023-08-01T19:54:55.212 INFO:teuthology.orchestra.run.smithi101.stdout: "duration": 0.00014389599999999999 2023-08-01T19:54:55.213 INFO:teuthology.orchestra.run.smithi101.stdout: } 2023-08-01T19:54:55.213 INFO:teuthology.orchestra.run.smithi101.stdout: ] 2023-08-01T19:54:55.213 INFO:teuthology.orchestra.run.smithi101.stdout: } 2023-08-01T19:54:55.213 INFO:teuthology.orchestra.run.smithi101.stdout: }, 2023-08-01T19:54:55.213 INFO:teuthology.orchestra.run.smithi101.stdout: { 2023-08-01T19:54:55.213 INFO:teuthology.orchestra.run.smithi101.stdout: "description": "osd_repop(client.4668.0:80730 5.3 e34/19 5:c718b3ab:::benchmark_data_smithi006_114134_object80729:head v 34'5102, mlcod=34'5098)", 2023-08-01T19:54:55.213 INFO:teuthology.orchestra.run.smithi101.stdout: "initiated_at": "2023-08-01T19:54:55.172856+0000", 2023-08-01T19:54:55.213 INFO:teuthology.orchestra.run.smithi101.stdout: "age": 0.0027333909999999999, 2023-08-01T19:54:55.214 INFO:teuthology.orchestra.run.smithi101.stdout: "duration": 0.0030907069999999998, 2023-08-01T19:54:55.214 INFO:teuthology.orchestra.run.smithi101.stdout: "type_data": { 2023-08-01T19:54:55.214 INFO:teuthology.orchestra.run.smithi101.stdout: "flag_point": "started", 2023-08-01T19:54:55.214 INFO:teuthology.orchestra.run.smithi101.stdout: "events": [ 2023-08-01T19:54:55.214 INFO:teuthology.orchestra.run.smithi101.stdout: { 2023-08-01T19:54:55.214 INFO:teuthology.orchestra.run.smithi101.stdout: "event": "initiated", 2023-08-01T19:54:55.214 INFO:teuthology.orchestra.run.smithi101.stdout: "time": "2023-08-01T19:54:55.172856+0000", 2023-08-01T19:54:55.214 INFO:teuthology.orchestra.run.smithi101.stdout: "duration": 0 2023-08-01T19:54:55.215 INFO:teuthology.orchestra.run.smithi101.stdout: }, 2023-08-01T19:54:55.215 INFO:teuthology.orchestra.run.smithi101.stdout: { 2023-08-01T19:54:55.215 INFO:teuthology.orchestra.run.smithi101.stdout: "event": "throttled", 2023-08-01T19:54:55.215 INFO:teuthology.orchestra.run.smithi101.stdout: "time": "2023-08-01T19:54:55.172856+0000", 2023-08-01T19:54:55.215 INFO:teuthology.orchestra.run.smithi101.stdout: "duration": 0 2023-08-01T19:54:55.215 INFO:teuthology.orchestra.run.smithi101.stdout: }, 2023-08-01T19:54:55.215 INFO:teuthology.orchestra.run.smithi101.stdout: { 2023-08-01T19:54:55.216 INFO:teuthology.orchestra.run.smithi101.stdout: "event": "header_read", 2023-08-01T19:54:55.216 INFO:teuthology.orchestra.run.smithi101.stdout: "time": "2023-08-01T19:54:55.172855+0000", 2023-08-01T19:54:55.216 INFO:teuthology.orchestra.run.smithi101.stdout: "duration": 4294967295.9999995 2023-08-01T19:54:55.216 INFO:teuthology.orchestra.run.smithi101.stdout: }, 2023-08-01T19:54:55.216 INFO:teuthology.orchestra.run.smithi101.stdout: { 2023-08-01T19:54:55.216 INFO:teuthology.orchestra.run.smithi101.stdout: "event": "all_read", 2023-08-01T19:54:55.216 INFO:teuthology.orchestra.run.smithi101.stdout: "time": "2023-08-01T19:54:55.172929+0000", 2023-08-01T19:54:55.217 INFO:teuthology.orchestra.run.smithi101.stdout: "duration": 7.3491999999999994e-05 2023-08-01T19:54:55.217 INFO:teuthology.orchestra.run.smithi101.stdout: }, 2023-08-01T19:54:55.217 INFO:teuthology.orchestra.run.smithi101.stdout: { 2023-08-01T19:54:55.217 INFO:teuthology.orchestra.run.smithi101.stdout: "event": "dispatched", 2023-08-01T19:54:55.217 INFO:teuthology.orchestra.run.smithi101.stdout: "time": "2023-08-01T19:54:55.172937+0000", 2023-08-01T19:54:55.217 INFO:teuthology.orchestra.run.smithi101.stdout: "duration": 8.2369999999999992e-06 2023-08-01T19:54:55.217 INFO:teuthology.orchestra.run.smithi101.stdout: }, 2023-08-01T19:54:55.218 INFO:teuthology.orchestra.run.smithi101.stdout: { 2023-08-01T19:54:55.218 INFO:teuthology.orchestra.run.smithi101.stdout: "event": "queued_for_pg", 2023-08-01T19:54:55.218 INFO:teuthology.orchestra.run.smithi101.stdout: "time": "2023-08-01T19:54:55.172941+0000", 2023-08-01T19:54:55.218 INFO:teuthology.orchestra.run.smithi101.stdout: "duration": 4.1729999999999997e-06 2023-08-01T19:54:55.218 INFO:teuthology.orchestra.run.smithi101.stdout: }, 2023-08-01T19:54:55.218 INFO:teuthology.orchestra.run.smithi101.stdout: { 2023-08-01T19:54:55.218 INFO:teuthology.orchestra.run.smithi101.stdout: "event": "reached_pg", 2023-08-01T19:54:55.218 INFO:teuthology.orchestra.run.smithi101.stdout: "time": "2023-08-01T19:54:55.172971+0000", 2023-08-01T19:54:55.219 INFO:teuthology.orchestra.run.smithi101.stdout: "duration": 2.9972999999999999e-05 2023-08-01T19:54:55.219 INFO:teuthology.orchestra.run.smithi101.stdout: }, 2023-08-01T19:54:55.219 INFO:teuthology.orchestra.run.smithi101.stdout: { 2023-08-01T19:54:55.219 INFO:teuthology.orchestra.run.smithi101.stdout: "event": "started", 2023-08-01T19:54:55.219 INFO:teuthology.orchestra.run.smithi101.stdout: "time": "2023-08-01T19:54:55.172990+0000", 2023-08-01T19:54:55.219 INFO:teuthology.orchestra.run.smithi101.stdout: "duration": 1.9315999999999999e-05 2023-08-01T19:54:55.219 INFO:teuthology.orchestra.run.smithi101.stdout: } 2023-08-01T19:54:55.219 INFO:teuthology.orchestra.run.smithi101.stdout: ] 2023-08-01T19:54:55.220 INFO:teuthology.orchestra.run.smithi101.stdout: } 2023-08-01T19:54:55.220 INFO:teuthology.orchestra.run.smithi101.stdout: }, 2023-08-01T19:54:55.220 INFO:teuthology.orchestra.run.smithi101.stdout: { 2023-08-01T19:54:55.220 INFO:teuthology.orchestra.run.smithi101.stdout: "description": "osd_repop(client.4668.0:80732 5.5 e34/19 5:af89adcc:::benchmark_data_smithi006_114134_object80731:head v 34'4977, mlcod=34'4975)", 2023-08-01T19:54:55.220 INFO:teuthology.orchestra.run.smithi101.stdout: "initiated_at": "2023-08-01T19:54:55.175290+0000", 2023-08-01T19:54:55.220 INFO:teuthology.orchestra.run.smithi101.stdout: "age": 0.00029945900000000002, 2023-08-01T19:54:55.220 INFO:teuthology.orchestra.run.smithi101.stdout: "duration": 0.00071644600000000003, 2023-08-01T19:54:55.221 INFO:teuthology.orchestra.run.smithi101.stdout: "type_data": { 2023-08-01T19:54:55.221 INFO:teuthology.orchestra.run.smithi101.stdout: "flag_point": "started", 2023-08-01T19:54:55.221 INFO:teuthology.orchestra.run.smithi101.stdout: "events": [ 2023-08-01T19:54:55.221 INFO:teuthology.orchestra.run.smithi101.stdout: { 2023-08-01T19:54:55.221 INFO:teuthology.orchestra.run.smithi101.stdout: "event": "initiated", 2023-08-01T19:54:55.221 INFO:teuthology.orchestra.run.smithi101.stdout: "time": "2023-08-01T19:54:55.175290+0000", 2023-08-01T19:54:55.221 INFO:teuthology.orchestra.run.smithi101.stdout: "duration": 0 2023-08-01T19:54:55.221 INFO:teuthology.orchestra.run.smithi101.stdout: }, 2023-08-01T19:54:55.222 INFO:teuthology.orchestra.run.smithi101.stdout: { 2023-08-01T19:54:55.222 INFO:teuthology.orchestra.run.smithi101.stdout: "event": "throttled", 2023-08-01T19:54:55.222 INFO:teuthology.orchestra.run.smithi101.stdout: "time": "2023-08-01T19:54:55.175290+0000", 2023-08-01T19:54:55.222 INFO:teuthology.orchestra.run.smithi101.stdout: "duration": 0 2023-08-01T19:54:55.222 INFO:teuthology.orchestra.run.smithi101.stdout: }, 2023-08-01T19:54:55.222 INFO:teuthology.orchestra.run.smithi101.stdout: { 2023-08-01T19:54:55.222 INFO:teuthology.orchestra.run.smithi101.stdout: "event": "header_read", 2023-08-01T19:54:55.222 INFO:teuthology.orchestra.run.smithi101.stdout: "time": "2023-08-01T19:54:55.175289+0000", 2023-08-01T19:54:55.223 INFO:teuthology.orchestra.run.smithi101.stdout: "duration": 4294967295.9999995 2023-08-01T19:54:55.223 INFO:teuthology.orchestra.run.smithi101.stdout: }, 2023-08-01T19:54:55.223 INFO:teuthology.orchestra.run.smithi101.stdout: { 2023-08-01T19:54:55.223 INFO:teuthology.orchestra.run.smithi101.stdout: "event": "all_read", 2023-08-01T19:54:55.223 INFO:teuthology.orchestra.run.smithi101.stdout: "time": "2023-08-01T19:54:55.175333+0000", 2023-08-01T19:54:55.223 INFO:teuthology.orchestra.run.smithi101.stdout: "duration": 4.4042000000000003e-05 2023-08-01T19:54:55.223 INFO:teuthology.orchestra.run.smithi101.stdout: }, 2023-08-01T19:54:55.224 INFO:teuthology.orchestra.run.smithi101.stdout: { 2023-08-01T19:54:55.224 INFO:teuthology.orchestra.run.smithi101.stdout: "event": "dispatched", 2023-08-01T19:54:55.224 INFO:teuthology.orchestra.run.smithi101.stdout: "time": "2023-08-01T19:54:55.175344+0000", 2023-08-01T19:54:55.224 INFO:teuthology.orchestra.run.smithi101.stdout: "duration": 1.0176e-05 2023-08-01T19:54:55.224 INFO:teuthology.orchestra.run.smithi101.stdout: }, 2023-08-01T19:54:55.224 INFO:teuthology.orchestra.run.smithi101.stdout: { 2023-08-01T19:54:55.224 INFO:teuthology.orchestra.run.smithi101.stdout: "event": "queued_for_pg", 2023-08-01T19:54:55.225 INFO:teuthology.orchestra.run.smithi101.stdout: "time": "2023-08-01T19:54:55.175349+0000", 2023-08-01T19:54:55.225 INFO:teuthology.orchestra.run.smithi101.stdout: "duration": 5.7620000000000001e-06 2023-08-01T19:54:55.225 INFO:teuthology.orchestra.run.smithi101.stdout: }, 2023-08-01T19:54:55.225 INFO:teuthology.orchestra.run.smithi101.stdout: { 2023-08-01T19:54:55.225 INFO:teuthology.orchestra.run.smithi101.stdout: "event": "reached_pg", 2023-08-01T19:54:55.225 INFO:teuthology.orchestra.run.smithi101.stdout: "time": "2023-08-01T19:54:55.175395+0000", 2023-08-01T19:54:55.225 INFO:teuthology.orchestra.run.smithi101.stdout: "duration": 4.5188000000000002e-05 2023-08-01T19:54:55.225 INFO:teuthology.orchestra.run.smithi101.stdout: }, 2023-08-01T19:54:55.226 INFO:teuthology.orchestra.run.smithi101.stdout: { 2023-08-01T19:54:55.226 INFO:teuthology.orchestra.run.smithi101.stdout: "event": "started", 2023-08-01T19:54:55.226 INFO:teuthology.orchestra.run.smithi101.stdout: "time": "2023-08-01T19:54:55.175413+0000", 2023-08-01T19:54:55.226 INFO:teuthology.orchestra.run.smithi101.stdout: "duration": 1.8757999999999999e-05 2023-08-01T19:54:55.226 INFO:teuthology.orchestra.run.smithi101.stdout: } 2023-08-01T19:54:55.226 INFO:teuthology.orchestra.run.smithi101.stdout: ] 2023-08-01T19:54:55.226 INFO:teuthology.orchestra.run.smithi101.stdout: } 2023-08-01T19:54:55.226 INFO:teuthology.orchestra.run.smithi101.stdout: }, 2023-08-01T19:54:55.227 INFO:teuthology.orchestra.run.smithi101.stdout: { 2023-08-01T19:54:55.227 INFO:teuthology.orchestra.run.smithi101.stdout: "description": "osd_op(client.4668.0:80735 5.2 5:414a6f89:::benchmark_data_smithi006_114134_object80734:head [set-alloc-hint object_size 65536 write_size 65536,write 0~65536 in=65536b] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e34)", 2023-08-01T19:54:55.227 INFO:teuthology.orchestra.run.smithi101.stdout: "initiated_at": "2023-08-01T19:54:55.175250+0000", 2023-08-01T19:54:55.227 INFO:teuthology.orchestra.run.smithi101.stdout: "age": 0.000339589, 2023-08-01T19:54:55.227 INFO:teuthology.orchestra.run.smithi101.stdout: "duration": 0.000808233, 2023-08-01T19:54:55.227 INFO:teuthology.orchestra.run.smithi101.stdout: "type_data": { 2023-08-01T19:54:55.227 INFO:teuthology.orchestra.run.smithi101.stdout: "flag_point": "waiting for sub ops", 2023-08-01T19:54:55.228 INFO:teuthology.orchestra.run.smithi101.stdout: "client_info": { 2023-08-01T19:54:55.228 INFO:teuthology.orchestra.run.smithi101.stdout: "client": "client.4668", 2023-08-01T19:54:55.228 INFO:teuthology.orchestra.run.smithi101.stdout: "client_addr": "172.21.15.6:0/1709472247", 2023-08-01T19:54:55.228 INFO:teuthology.orchestra.run.smithi101.stdout: "tid": 80735 2023-08-01T19:54:55.228 INFO:teuthology.orchestra.run.smithi101.stdout: }, 2023-08-01T19:54:55.228 INFO:teuthology.orchestra.run.smithi101.stdout: "events": [ 2023-08-01T19:54:55.228 INFO:teuthology.orchestra.run.smithi101.stdout: { 2023-08-01T19:54:55.229 INFO:teuthology.orchestra.run.smithi101.stdout: "event": "initiated", 2023-08-01T19:54:55.229 INFO:teuthology.orchestra.run.smithi101.stdout: "time": "2023-08-01T19:54:55.175250+0000", 2023-08-01T19:54:55.229 INFO:teuthology.orchestra.run.smithi101.stdout: "duration": 0 2023-08-01T19:54:55.229 INFO:teuthology.orchestra.run.smithi101.stdout: }, 2023-08-01T19:54:55.229 INFO:teuthology.orchestra.run.smithi101.stdout: { 2023-08-01T19:54:55.229 INFO:teuthology.orchestra.run.smithi101.stdout: "event": "throttled", 2023-08-01T19:54:55.229 INFO:teuthology.orchestra.run.smithi101.stdout: "time": "2023-08-01T19:54:55.175250+0000", 2023-08-01T19:54:55.229 INFO:teuthology.orchestra.run.smithi101.stdout: "duration": 0 2023-08-01T19:54:55.230 INFO:teuthology.orchestra.run.smithi101.stdout: }, 2023-08-01T19:54:55.230 INFO:teuthology.orchestra.run.smithi101.stdout: { 2023-08-01T19:54:55.230 INFO:teuthology.orchestra.run.smithi101.stdout: "event": "header_read", 2023-08-01T19:54:55.230 INFO:teuthology.orchestra.run.smithi101.stdout: "time": "2023-08-01T19:54:55.175249+0000", 2023-08-01T19:54:55.230 INFO:teuthology.orchestra.run.smithi101.stdout: "duration": 4294967295.999999 2023-08-01T19:54:55.230 INFO:teuthology.orchestra.run.smithi101.stdout: }, 2023-08-01T19:54:55.230 INFO:teuthology.orchestra.run.smithi101.stdout: { 2023-08-01T19:54:55.230 INFO:teuthology.orchestra.run.smithi101.stdout: "event": "all_read", 2023-08-01T19:54:55.231 INFO:teuthology.orchestra.run.smithi101.stdout: "time": "2023-08-01T19:54:55.175349+0000", 2023-08-01T19:54:55.231 INFO:teuthology.orchestra.run.smithi101.stdout: "duration": 0.000100053 2023-08-01T19:54:55.231 INFO:teuthology.orchestra.run.smithi101.stdout: }, 2023-08-01T19:54:55.231 INFO:teuthology.orchestra.run.smithi101.stdout: { 2023-08-01T19:54:55.231 INFO:teuthology.orchestra.run.smithi101.stdout: "event": "dispatched", 2023-08-01T19:54:55.231 INFO:teuthology.orchestra.run.smithi101.stdout: "time": "2023-08-01T19:54:55.175358+0000", 2023-08-01T19:54:55.231 INFO:teuthology.orchestra.run.smithi101.stdout: "duration": 9.2480000000000002e-06 2023-08-01T19:54:55.232 INFO:teuthology.orchestra.run.smithi101.stdout: }, 2023-08-01T19:54:55.232 INFO:teuthology.orchestra.run.smithi101.stdout: { 2023-08-01T19:54:55.232 INFO:teuthology.orchestra.run.smithi101.stdout: "event": "queued_for_pg", 2023-08-01T19:54:55.232 INFO:teuthology.orchestra.run.smithi101.stdout: "time": "2023-08-01T19:54:55.175363+0000", 2023-08-01T19:54:55.232 INFO:teuthology.orchestra.run.smithi101.stdout: "duration": 5.5119999999999999e-06 2023-08-01T19:54:55.232 INFO:teuthology.orchestra.run.smithi101.stdout: }, 2023-08-01T19:54:55.232 INFO:teuthology.orchestra.run.smithi101.stdout: { 2023-08-01T19:54:55.232 INFO:teuthology.orchestra.run.smithi101.stdout: "event": "reached_pg", 2023-08-01T19:54:55.233 INFO:teuthology.orchestra.run.smithi101.stdout: "time": "2023-08-01T19:54:55.175400+0000", 2023-08-01T19:54:55.233 INFO:teuthology.orchestra.run.smithi101.stdout: "duration": 3.7122999999999997e-05 2023-08-01T19:54:55.233 INFO:teuthology.orchestra.run.smithi101.stdout: }, 2023-08-01T19:54:55.233 INFO:teuthology.orchestra.run.smithi101.stdout: { 2023-08-01T19:54:55.233 INFO:teuthology.orchestra.run.smithi101.stdout: "event": "started", 2023-08-01T19:54:55.233 INFO:teuthology.orchestra.run.smithi101.stdout: "time": "2023-08-01T19:54:55.175531+0000", 2023-08-01T19:54:55.233 INFO:teuthology.orchestra.run.smithi101.stdout: "duration": 0.00013034400000000001 2023-08-01T19:54:55.233 INFO:teuthology.orchestra.run.smithi101.stdout: }, 2023-08-01T19:54:55.234 INFO:teuthology.orchestra.run.smithi101.stdout: { 2023-08-01T19:54:55.234 INFO:teuthology.orchestra.run.smithi101.stdout: "event": "waiting for subops from 0", 2023-08-01T19:54:55.234 INFO:teuthology.orchestra.run.smithi101.stdout: "time": "2023-08-01T19:54:55.175673+0000", 2023-08-01T19:54:55.234 INFO:teuthology.orchestra.run.smithi101.stdout: "duration": 0.000142671 2023-08-01T19:54:55.234 INFO:teuthology.orchestra.run.smithi101.stdout: } 2023-08-01T19:54:55.234 INFO:teuthology.orchestra.run.smithi101.stdout: ] 2023-08-01T19:54:55.234 INFO:teuthology.orchestra.run.smithi101.stdout: } 2023-08-01T19:54:55.234 INFO:teuthology.orchestra.run.smithi101.stdout: }, 2023-08-01T19:54:55.235 INFO:teuthology.orchestra.run.smithi101.stdout: { 2023-08-01T19:54:55.235 INFO:teuthology.orchestra.run.smithi101.stdout: "description": "osd_op(client.4668.0:80736 5.f 5:fdb816db:::benchmark_data_smithi006_114134_object80735:head [set-alloc-hint object_size 65536 write_size 65536,write 0~65536 in=65536b] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e34)", 2023-08-01T19:54:55.235 INFO:teuthology.orchestra.run.smithi101.stdout: "initiated_at": "2023-08-01T19:54:55.175376+0000", 2023-08-01T19:54:55.235 INFO:teuthology.orchestra.run.smithi101.stdout: "age": 0.000213561, 2023-08-01T19:54:55.235 INFO:teuthology.orchestra.run.smithi101.stdout: "duration": 0.00073301900000000001, 2023-08-01T19:54:55.235 INFO:teuthology.orchestra.run.smithi101.stdout: "type_data": { 2023-08-01T19:54:55.235 INFO:teuthology.orchestra.run.smithi101.stdout: "flag_point": "waiting for sub ops", 2023-08-01T19:54:55.236 INFO:teuthology.orchestra.run.smithi101.stdout: "client_info": { 2023-08-01T19:54:55.236 INFO:teuthology.orchestra.run.smithi101.stdout: "client": "client.4668", 2023-08-01T19:54:55.236 INFO:teuthology.orchestra.run.smithi101.stdout: "client_addr": "172.21.15.6:0/1709472247", 2023-08-01T19:54:55.236 INFO:teuthology.orchestra.run.smithi101.stdout: "tid": 80736 2023-08-01T19:54:55.236 INFO:teuthology.orchestra.run.smithi101.stdout: }, 2023-08-01T19:54:55.236 INFO:teuthology.orchestra.run.smithi101.stdout: "events": [ 2023-08-01T19:54:55.236 INFO:teuthology.orchestra.run.smithi101.stdout: { 2023-08-01T19:54:55.236 INFO:teuthology.orchestra.run.smithi101.stdout: "event": "initiated", 2023-08-01T19:54:55.237 INFO:teuthology.orchestra.run.smithi101.stdout: "time": "2023-08-01T19:54:55.175376+0000", 2023-08-01T19:54:55.237 INFO:teuthology.orchestra.run.smithi101.stdout: "duration": 0 2023-08-01T19:54:55.237 INFO:teuthology.orchestra.run.smithi101.stdout: }, 2023-08-01T19:54:55.237 INFO:teuthology.orchestra.run.smithi101.stdout: { 2023-08-01T19:54:55.237 INFO:teuthology.orchestra.run.smithi101.stdout: "event": "throttled", 2023-08-01T19:54:55.237 INFO:teuthology.orchestra.run.smithi101.stdout: "time": "2023-08-01T19:54:55.175376+0000", 2023-08-01T19:54:55.237 INFO:teuthology.orchestra.run.smithi101.stdout: "duration": 0 2023-08-01T19:54:55.237 INFO:teuthology.orchestra.run.smithi101.stdout: }, 2023-08-01T19:54:55.238 INFO:teuthology.orchestra.run.smithi101.stdout: { 2023-08-01T19:54:55.238 INFO:teuthology.orchestra.run.smithi101.stdout: "event": "header_read", 2023-08-01T19:54:55.238 INFO:teuthology.orchestra.run.smithi101.stdout: "time": "2023-08-01T19:54:55.175375+0000", 2023-08-01T19:54:55.238 INFO:teuthology.orchestra.run.smithi101.stdout: "duration": 4294967295.9999995 2023-08-01T19:54:55.238 INFO:teuthology.orchestra.run.smithi101.stdout: }, 2023-08-01T19:54:55.238 INFO:teuthology.orchestra.run.smithi101.stdout: { 2023-08-01T19:54:55.238 INFO:teuthology.orchestra.run.smithi101.stdout: "event": "all_read", 2023-08-01T19:54:55.239 INFO:teuthology.orchestra.run.smithi101.stdout: "time": "2023-08-01T19:54:55.175408+0000", 2023-08-01T19:54:55.239 INFO:teuthology.orchestra.run.smithi101.stdout: "duration": 3.2849999999999999e-05 2023-08-01T19:54:55.239 INFO:teuthology.orchestra.run.smithi101.stdout: }, 2023-08-01T19:54:55.239 INFO:teuthology.orchestra.run.smithi101.stdout: { 2023-08-01T19:54:55.239 INFO:teuthology.orchestra.run.smithi101.stdout: "event": "dispatched", 2023-08-01T19:54:55.239 INFO:teuthology.orchestra.run.smithi101.stdout: "time": "2023-08-01T19:54:55.175415+0000", 2023-08-01T19:54:55.239 INFO:teuthology.orchestra.run.smithi101.stdout: "duration": 7.328e-06 2023-08-01T19:54:55.239 INFO:teuthology.orchestra.run.smithi101.stdout: }, 2023-08-01T19:54:55.240 INFO:teuthology.orchestra.run.smithi101.stdout: { 2023-08-01T19:54:55.240 INFO:teuthology.orchestra.run.smithi101.stdout: "event": "queued_for_pg", 2023-08-01T19:54:55.240 INFO:teuthology.orchestra.run.smithi101.stdout: "time": "2023-08-01T19:54:55.175420+0000", 2023-08-01T19:54:55.240 INFO:teuthology.orchestra.run.smithi101.stdout: "duration": 4.7589999999999997e-06 2023-08-01T19:54:55.240 INFO:teuthology.orchestra.run.smithi101.stdout: }, 2023-08-01T19:54:55.240 INFO:teuthology.orchestra.run.smithi101.stdout: { 2023-08-01T19:54:55.240 INFO:teuthology.orchestra.run.smithi101.stdout: "event": "reached_pg", 2023-08-01T19:54:55.241 INFO:teuthology.orchestra.run.smithi101.stdout: "time": "2023-08-01T19:54:55.175465+0000", 2023-08-01T19:54:55.241 INFO:teuthology.orchestra.run.smithi101.stdout: "duration": 4.4579999999999997e-05 2023-08-01T19:54:55.241 INFO:teuthology.orchestra.run.smithi101.stdout: }, 2023-08-01T19:54:55.241 INFO:teuthology.orchestra.run.smithi101.stdout: { 2023-08-01T19:54:55.241 INFO:teuthology.orchestra.run.smithi101.stdout: "event": "started", 2023-08-01T19:54:55.241 INFO:teuthology.orchestra.run.smithi101.stdout: "time": "2023-08-01T19:54:55.175601+0000", 2023-08-01T19:54:55.241 INFO:teuthology.orchestra.run.smithi101.stdout: "duration": 0.00013656000000000001 2023-08-01T19:54:55.241 INFO:teuthology.orchestra.run.smithi101.stdout: }, 2023-08-01T19:54:55.242 INFO:teuthology.orchestra.run.smithi101.stdout: { 2023-08-01T19:54:55.242 INFO:teuthology.orchestra.run.smithi101.stdout: "event": "waiting for subops from 2", 2023-08-01T19:54:55.242 INFO:teuthology.orchestra.run.smithi101.stdout: "time": "2023-08-01T19:54:55.175713+0000", 2023-08-01T19:54:55.242 INFO:teuthology.orchestra.run.smithi101.stdout: "duration": 0.00011178199999999999 2023-08-01T19:54:55.242 INFO:teuthology.orchestra.run.smithi101.stdout: } 2023-08-01T19:54:55.242 INFO:teuthology.orchestra.run.smithi101.stdout: ] 2023-08-01T19:54:55.242 INFO:teuthology.orchestra.run.smithi101.stdout: } 2023-08-01T19:54:55.242 INFO:teuthology.orchestra.run.smithi101.stdout: } 2023-08-01T19:54:55.243 INFO:teuthology.orchestra.run.smithi101.stdout: ], 2023-08-01T19:54:55.243 INFO:teuthology.orchestra.run.smithi101.stdout: "num_ops": 9 2023-08-01T19:54:55.243 INFO:teuthology.orchestra.run.smithi101.stdout:} 2023-08-01T19:54:55.244 DEBUG:teuthology.orchestra.run.smithi101:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 30 ceph --cluster ceph --admin-daemon /var/run/ceph/ceph-osd.1.asok dump_blocked_ops 2023-08-01T19:54:55.245 INFO:tasks.ceph.osd.1.smithi101.stderr:2023-08-01T19:54:55.242+0000 7fb0cb7f6700 -1 received signal: Hangup from /usr/bin/python3 /bin/daemon-helper kill ceph-osd -f --cluster ceph -i 1 (PID: 111141) UID: 0 2023-08-01T19:54:55.315 INFO:tasks.radosbench.radosbench.0.smithi006.stdout: 31 16 81017 81001 163.295 120.625 0.00799078 0.00612109 2023-08-01T19:54:55.345 INFO:tasks.ceph.osd.1.smithi101.stderr:2023-08-01T19:54:55.343+0000 7fb0cb7f6700 -1 received signal: Hangup from /usr/bin/python3 /bin/daemon-helper kill ceph-osd -f --cluster ceph -i 1 (PID: 111141) UID: 0 2023-08-01T19:54:55.446 INFO:tasks.ceph.osd.2.smithi155.stderr:2023-08-01T19:54:55.444+0000 7faa5c6ac700 -1 received signal: Hangup from /usr/bin/python3 /bin/daemon-helper kill ceph-osd -f --cluster ceph -i 2 (PID: 111337) UID: 0 2023-08-01T19:54:55.461 INFO:teuthology.orchestra.run.smithi101.stdout:{ 2023-08-01T19:54:55.462 INFO:teuthology.orchestra.run.smithi101.stdout: "ops": [], 2023-08-01T19:54:55.462 INFO:teuthology.orchestra.run.smithi101.stdout: "complaint_time": 30, 2023-08-01T19:54:55.462 INFO:teuthology.orchestra.run.smithi101.stdout: "num_blocked_ops": 0 2023-08-01T19:54:55.462 INFO:teuthology.orchestra.run.smithi101.stdout:} 2023-08-01T19:54:55.475 DEBUG:teuthology.orchestra.run.smithi101:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 30 ceph --cluster ceph --admin-daemon /var/run/ceph/ceph-osd.1.asok dump_historic_ops 2023-08-01T19:54:55.559 INFO:tasks.ceph.osd.1.smithi101.stderr:2023-08-01T19:54:55.557+0000 7fb0cb7f6700 -1 received signal: Hangup from /usr/bin/python3 /bin/daemon-helper kill ceph-osd -f --cluster ceph -i 1 (PID: 111141) UID: 0 2023-08-01T19:54:55.647 INFO:tasks.ceph.osd.2.smithi155.stderr:2023-08-01T19:54:55.646+0000 7faa5c6ac700 -1 received signal: Hangup from /usr/bin/python3 /bin/daemon-helper kill ceph-osd -f --cluster ceph -i 2 (PID: 111337) UID: 0 2023-08-01T19:54:55.690 INFO:teuthology.orchestra.run.smithi101.stdout:{ 2023-08-01T19:54:55.690 INFO:teuthology.orchestra.run.smithi101.stdout: "size": 20, 2023-08-01T19:54:55.691 INFO:teuthology.orchestra.run.smithi101.stdout: "duration": 600, 2023-08-01T19:54:55.691 INFO:teuthology.orchestra.run.smithi101.stdout: "ops": [ 2023-08-01T19:54:55.691 INFO:teuthology.orchestra.run.smithi101.stdout: { 2023-08-01T19:54:55.691 INFO:teuthology.orchestra.run.smithi101.stdout: "description": "osd_op(mds.0.3:6 3.10 3:0d82a743:::600.00000000:head [omap-set-header] snapc 0=[] ondisk+write+known_if_redirected+full_force+supports_pool_eio e17)", 2023-08-01T19:54:55.691 INFO:teuthology.orchestra.run.smithi101.stdout: "initiated_at": "2023-08-01T19:54:04.458774+0000", 2023-08-01T19:54:55.691 INFO:teuthology.orchestra.run.smithi101.stdout: "age": 51.228424971000003, 2023-08-01T19:54:55.691 INFO:teuthology.orchestra.run.smithi101.stdout: "duration": 0.017582611000000001, 2023-08-01T19:54:55.692 INFO:teuthology.orchestra.run.smithi101.stdout: "type_data": { 2023-08-01T19:54:55.692 INFO:teuthology.orchestra.run.smithi101.stdout: "flag_point": "commit sent; apply or cleanup", 2023-08-01T19:54:55.692 INFO:teuthology.orchestra.run.smithi101.stdout: "events": [ 2023-08-01T19:54:55.692 INFO:teuthology.orchestra.run.smithi101.stdout: { 2023-08-01T19:54:55.692 INFO:teuthology.orchestra.run.smithi101.stdout: "event": "initiated", 2023-08-01T19:54:55.692 INFO:teuthology.orchestra.run.smithi101.stdout: "time": "2023-08-01T19:54:04.458774+0000", 2023-08-01T19:54:55.693 INFO:teuthology.orchestra.run.smithi101.stdout: "duration": 0 2023-08-01T19:54:55.693 INFO:teuthology.orchestra.run.smithi101.stdout: }, 2023-08-01T19:54:55.693 INFO:teuthology.orchestra.run.smithi101.stdout: { 2023-08-01T19:54:55.693 INFO:teuthology.orchestra.run.smithi101.stdout: "event": "throttled", 2023-08-01T19:54:55.693 INFO:teuthology.orchestra.run.smithi101.stdout: "time": "2023-08-01T19:54:04.458774+0000", 2023-08-01T19:54:55.694 INFO:teuthology.orchestra.run.smithi101.stdout: "duration": 0 2023-08-01T19:54:55.694 INFO:teuthology.orchestra.run.smithi101.stdout: }, 2023-08-01T19:54:55.694 INFO:teuthology.orchestra.run.smithi101.stdout: { 2023-08-01T19:54:55.694 INFO:teuthology.orchestra.run.smithi101.stdout: "event": "header_read", 2023-08-01T19:54:55.694 INFO:teuthology.orchestra.run.smithi101.stdout: "time": "2023-08-01T19:54:04.458772+0000", 2023-08-01T19:54:55.695 INFO:teuthology.orchestra.run.smithi101.stdout: "duration": 4294967295.9999981 2023-08-01T19:54:55.695 INFO:teuthology.orchestra.run.smithi101.stdout: }, 2023-08-01T19:54:55.695 INFO:teuthology.orchestra.run.smithi101.stdout: { 2023-08-01T19:54:55.695 INFO:teuthology.orchestra.run.smithi101.stdout: "event": "all_read", 2023-08-01T19:54:55.695 INFO:teuthology.orchestra.run.smithi101.stdout: "time": "2023-08-01T19:54:04.458781+0000", 2023-08-01T19:54:55.695 INFO:teuthology.orchestra.run.smithi101.stdout: "duration": 8.6670000000000002e-06 2023-08-01T19:54:55.695 INFO:teuthology.orchestra.run.smithi101.stdout: }, 2023-08-01T19:54:55.696 INFO:teuthology.orchestra.run.smithi101.stdout: { 2023-08-01T19:54:55.696 INFO:teuthology.orchestra.run.smithi101.stdout: "event": "dispatched", 2023-08-01T19:54:55.696 INFO:teuthology.orchestra.run.smithi101.stdout: "time": "2023-08-01T19:54:04.458797+0000", 2023-08-01T19:54:55.696 INFO:teuthology.orchestra.run.smithi101.stdout: "duration": 1.6463000000000001e-05 2023-08-01T19:54:55.696 INFO:teuthology.orchestra.run.smithi101.stdout: }, 2023-08-01T19:54:55.696 INFO:teuthology.orchestra.run.smithi101.stdout: { 2023-08-01T19:54:55.696 INFO:teuthology.orchestra.run.smithi101.stdout: "event": "queued_for_pg", 2023-08-01T19:54:55.697 INFO:teuthology.orchestra.run.smithi101.stdout: "time": "2023-08-01T19:54:04.458810+0000", 2023-08-01T19:54:55.697 INFO:teuthology.orchestra.run.smithi101.stdout: "duration": 1.2753e-05 2023-08-01T19:54:55.697 INFO:teuthology.orchestra.run.smithi101.stdout: }, 2023-08-01T19:54:55.697 INFO:teuthology.orchestra.run.smithi101.stdout: { 2023-08-01T19:54:55.698 INFO:teuthology.orchestra.run.smithi101.stdout: "event": "reached_pg", 2023-08-01T19:54:55.698 INFO:teuthology.orchestra.run.smithi101.stdout: "time": "2023-08-01T19:54:04.458866+0000", 2023-08-01T19:54:55.698 INFO:teuthology.orchestra.run.smithi101.stdout: "duration": 5.6625000000000001e-05 2023-08-01T19:54:55.698 INFO:teuthology.orchestra.run.smithi101.stdout: }, 2023-08-01T19:54:55.698 INFO:teuthology.orchestra.run.smithi101.stdout: { 2023-08-01T19:54:55.698 INFO:teuthology.orchestra.run.smithi101.stdout: "event": "op must wait for map", 2023-08-01T19:54:55.699 INFO:teuthology.orchestra.run.smithi101.stdout: "time": "2023-08-01T19:54:04.458873+0000", 2023-08-01T19:54:55.699 INFO:teuthology.orchestra.run.smithi101.stdout: "duration": 6.9110000000000004e-06 2023-08-01T19:54:55.699 INFO:teuthology.orchestra.run.smithi101.stdout: }, 2023-08-01T19:54:55.699 INFO:teuthology.orchestra.run.smithi101.stdout: { 2023-08-01T19:54:55.699 INFO:teuthology.orchestra.run.smithi101.stdout: "event": "reached_pg", 2023-08-01T19:54:55.699 INFO:teuthology.orchestra.run.smithi101.stdout: "time": "2023-08-01T19:54:04.466999+0000", 2023-08-01T19:54:55.699 INFO:teuthology.orchestra.run.smithi101.stdout: "duration": 0.0081256550000000007 2023-08-01T19:54:55.700 INFO:teuthology.orchestra.run.smithi101.stdout: }, 2023-08-01T19:54:55.700 INFO:teuthology.orchestra.run.smithi101.stdout: { 2023-08-01T19:54:55.700 INFO:teuthology.orchestra.run.smithi101.stdout: "event": "started", 2023-08-01T19:54:55.701 INFO:teuthology.orchestra.run.smithi101.stdout: "time": "2023-08-01T19:54:04.467201+0000", 2023-08-01T19:54:55.701 INFO:teuthology.orchestra.run.smithi101.stdout: "duration": 0.00020166199999999999 2023-08-01T19:54:55.701 INFO:teuthology.orchestra.run.smithi101.stdout: }, 2023-08-01T19:54:55.701 INFO:teuthology.orchestra.run.smithi101.stdout: { 2023-08-01T19:54:55.702 INFO:teuthology.orchestra.run.smithi101.stdout: "event": "waiting for subops from 2", 2023-08-01T19:54:55.702 INFO:teuthology.orchestra.run.smithi101.stdout: "time": "2023-08-01T19:54:04.467350+0000", 2023-08-01T19:54:55.702 INFO:teuthology.orchestra.run.smithi101.stdout: "duration": 0.000149173 2023-08-01T19:54:55.702 INFO:teuthology.orchestra.run.smithi101.stdout: }, 2023-08-01T19:54:55.702 INFO:teuthology.orchestra.run.smithi101.stdout: { 2023-08-01T19:54:55.703 INFO:teuthology.orchestra.run.smithi101.stdout: "event": "op_commit", 2023-08-01T19:54:55.703 INFO:teuthology.orchestra.run.smithi101.stdout: "time": "2023-08-01T19:54:04.476168+0000", 2023-08-01T19:54:55.703 INFO:teuthology.orchestra.run.smithi101.stdout: "duration": 0.0088183250000000001 2023-08-01T19:54:55.703 INFO:teuthology.orchestra.run.smithi101.stdout: }, 2023-08-01T19:54:55.704 INFO:teuthology.orchestra.run.smithi101.stdout: { 2023-08-01T19:54:55.704 INFO:teuthology.orchestra.run.smithi101.stdout: "event": "sub_op_commit_rec", 2023-08-01T19:54:55.704 INFO:teuthology.orchestra.run.smithi101.stdout: "time": "2023-08-01T19:54:04.476239+0000", 2023-08-01T19:54:55.704 INFO:teuthology.orchestra.run.smithi101.stdout: "duration": 7.1296000000000003e-05 2023-08-01T19:54:55.704 INFO:teuthology.orchestra.run.smithi101.stdout: }, 2023-08-01T19:54:55.704 INFO:teuthology.orchestra.run.smithi101.stdout: { 2023-08-01T19:54:55.704 INFO:teuthology.orchestra.run.smithi101.stdout: "event": "commit_sent", 2023-08-01T19:54:55.705 INFO:teuthology.orchestra.run.smithi101.stdout: "time": "2023-08-01T19:54:04.476290+0000", 2023-08-01T19:54:55.705 INFO:teuthology.orchestra.run.smithi101.stdout: "duration": 5.0423999999999997e-05 2023-08-01T19:54:55.705 INFO:teuthology.orchestra.run.smithi101.stdout: }, 2023-08-01T19:54:55.705 INFO:teuthology.orchestra.run.smithi101.stdout: { 2023-08-01T19:54:55.705 INFO:teuthology.orchestra.run.smithi101.stdout: "event": "done", 2023-08-01T19:54:55.705 INFO:teuthology.orchestra.run.smithi101.stdout: "time": "2023-08-01T19:54:04.476356+0000", 2023-08-01T19:54:55.705 INFO:teuthology.orchestra.run.smithi101.stdout: "duration": 6.6439000000000005e-05 2023-08-01T19:54:55.706 INFO:teuthology.orchestra.run.smithi101.stdout: } 2023-08-01T19:54:55.706 INFO:teuthology.orchestra.run.smithi101.stdout: ] 2023-08-01T19:54:55.706 INFO:teuthology.orchestra.run.smithi101.stdout: } 2023-08-01T19:54:55.706 INFO:teuthology.orchestra.run.smithi101.stdout: }, 2023-08-01T19:54:55.706 INFO:teuthology.orchestra.run.smithi101.stdout: { 2023-08-01T19:54:55.706 INFO:teuthology.orchestra.run.smithi101.stdout: "description": "osd_op(mds.0.3:7 3.10 3:0d82a743:::600.00000000:head [create,setxattr parent (62) in=6b,setxattr layout (30) in=6b] snapc 0=[] ondisk+write+known_if_redirected+full_force+supports_pool_eio e17)", 2023-08-01T19:54:55.706 INFO:teuthology.orchestra.run.smithi101.stdout: "initiated_at": "2023-08-01T19:54:04.458830+0000", 2023-08-01T19:54:55.707 INFO:teuthology.orchestra.run.smithi101.stdout: "age": 51.228368584000002, 2023-08-01T19:54:55.707 INFO:teuthology.orchestra.run.smithi101.stdout: "duration": 0.018463726, 2023-08-01T19:54:55.707 INFO:teuthology.orchestra.run.smithi101.stdout: "type_data": { 2023-08-01T19:54:55.707 INFO:teuthology.orchestra.run.smithi101.stdout: "flag_point": "commit sent; apply or cleanup", 2023-08-01T19:54:55.707 INFO:teuthology.orchestra.run.smithi101.stdout: "events": [ 2023-08-01T19:54:55.707 INFO:teuthology.orchestra.run.smithi101.stdout: { 2023-08-01T19:54:55.707 INFO:teuthology.orchestra.run.smithi101.stdout: "event": "initiated", 2023-08-01T19:54:55.708 INFO:teuthology.orchestra.run.smithi101.stdout: "time": "2023-08-01T19:54:04.458830+0000", 2023-08-01T19:54:55.708 INFO:teuthology.orchestra.run.smithi101.stdout: "duration": 0 2023-08-01T19:54:55.708 INFO:teuthology.orchestra.run.smithi101.stdout: }, 2023-08-01T19:54:55.708 INFO:teuthology.orchestra.run.smithi101.stdout: { 2023-08-01T19:54:55.708 INFO:teuthology.orchestra.run.smithi101.stdout: "event": "throttled", 2023-08-01T19:54:55.708 INFO:teuthology.orchestra.run.smithi101.stdout: "time": "2023-08-01T19:54:04.458830+0000", 2023-08-01T19:54:55.708 INFO:teuthology.orchestra.run.smithi101.stdout: "duration": 0 2023-08-01T19:54:55.709 INFO:teuthology.orchestra.run.smithi101.stdout: }, 2023-08-01T19:54:55.709 INFO:teuthology.orchestra.run.smithi101.stdout: { 2023-08-01T19:54:55.709 INFO:teuthology.orchestra.run.smithi101.stdout: "event": "header_read", 2023-08-01T19:54:55.709 INFO:teuthology.orchestra.run.smithi101.stdout: "time": "2023-08-01T19:54:04.458829+0000", 2023-08-01T19:54:55.709 INFO:teuthology.orchestra.run.smithi101.stdout: "duration": 4294967295.999999 2023-08-01T19:54:55.709 INFO:teuthology.orchestra.run.smithi101.stdout: }, 2023-08-01T19:54:55.709 INFO:teuthology.orchestra.run.smithi101.stdout: { 2023-08-01T19:54:55.710 INFO:teuthology.orchestra.run.smithi101.stdout: "event": "all_read", 2023-08-01T19:54:55.710 INFO:teuthology.orchestra.run.smithi101.stdout: "time": "2023-08-01T19:54:04.458838+0000", 2023-08-01T19:54:55.710 INFO:teuthology.orchestra.run.smithi101.stdout: "duration": 8.5369999999999997e-06 2023-08-01T19:54:55.710 INFO:teuthology.orchestra.run.smithi101.stdout: }, 2023-08-01T19:54:55.710 INFO:teuthology.orchestra.run.smithi101.stdout: { 2023-08-01T19:54:55.710 INFO:teuthology.orchestra.run.smithi101.stdout: "event": "dispatched", 2023-08-01T19:54:55.710 INFO:teuthology.orchestra.run.smithi101.stdout: "time": "2023-08-01T19:54:04.458850+0000", 2023-08-01T19:54:55.711 INFO:teuthology.orchestra.run.smithi101.stdout: "duration": 1.203e-05 2023-08-01T19:54:55.711 INFO:teuthology.orchestra.run.smithi101.stdout: }, 2023-08-01T19:54:55.711 INFO:teuthology.orchestra.run.smithi101.stdout: { 2023-08-01T19:54:55.711 INFO:teuthology.orchestra.run.smithi101.stdout: "event": "queued_for_pg", 2023-08-01T19:54:55.711 INFO:teuthology.orchestra.run.smithi101.stdout: "time": "2023-08-01T19:54:04.458859+0000", 2023-08-01T19:54:55.711 INFO:teuthology.orchestra.run.smithi101.stdout: "duration": 8.9889999999999998e-06 2023-08-01T19:54:55.711 INFO:teuthology.orchestra.run.smithi101.stdout: }, 2023-08-01T19:54:55.712 INFO:teuthology.orchestra.run.smithi101.stdout: { 2023-08-01T19:54:55.712 INFO:teuthology.orchestra.run.smithi101.stdout: "event": "reached_pg", 2023-08-01T19:54:55.712 INFO:teuthology.orchestra.run.smithi101.stdout: "time": "2023-08-01T19:54:04.458926+0000", 2023-08-01T19:54:55.712 INFO:teuthology.orchestra.run.smithi101.stdout: "duration": 6.6741000000000004e-05 2023-08-01T19:54:55.712 INFO:teuthology.orchestra.run.smithi101.stdout: }, 2023-08-01T19:54:55.712 INFO:teuthology.orchestra.run.smithi101.stdout: { 2023-08-01T19:54:55.712 INFO:teuthology.orchestra.run.smithi101.stdout: "event": "waiting_for_map not empty", 2023-08-01T19:54:55.713 INFO:teuthology.orchestra.run.smithi101.stdout: "time": "2023-08-01T19:54:04.458929+0000", 2023-08-01T19:54:55.713 INFO:teuthology.orchestra.run.smithi101.stdout: "duration": 3.303e-06 2023-08-01T19:54:55.713 INFO:teuthology.orchestra.run.smithi101.stdout: }, 2023-08-01T19:54:55.713 INFO:teuthology.orchestra.run.smithi101.stdout: { 2023-08-01T19:54:55.713 INFO:teuthology.orchestra.run.smithi101.stdout: "event": "reached_pg", 2023-08-01T19:54:55.713 INFO:teuthology.orchestra.run.smithi101.stdout: "time": "2023-08-01T19:54:04.468692+0000", 2023-08-01T19:54:55.713 INFO:teuthology.orchestra.run.smithi101.stdout: "duration": 0.0097635910000000003 2023-08-01T19:54:55.714 INFO:teuthology.orchestra.run.smithi101.stdout: }, 2023-08-01T19:54:55.714 INFO:teuthology.orchestra.run.smithi101.stdout: { 2023-08-01T19:54:55.714 INFO:teuthology.orchestra.run.smithi101.stdout: "event": "started", 2023-08-01T19:54:55.714 INFO:teuthology.orchestra.run.smithi101.stdout: "time": "2023-08-01T19:54:04.468774+0000", 2023-08-01T19:54:55.714 INFO:teuthology.orchestra.run.smithi101.stdout: "duration": 8.1092000000000002e-05 2023-08-01T19:54:55.714 INFO:teuthology.orchestra.run.smithi101.stdout: }, 2023-08-01T19:54:55.714 INFO:teuthology.orchestra.run.smithi101.stdout: { 2023-08-01T19:54:55.714 INFO:teuthology.orchestra.run.smithi101.stdout: "event": "waiting for subops from 2", 2023-08-01T19:54:55.715 INFO:teuthology.orchestra.run.smithi101.stdout: "time": "2023-08-01T19:54:04.468934+0000", 2023-08-01T19:54:55.715 INFO:teuthology.orchestra.run.smithi101.stdout: "duration": 0.000160027 2023-08-01T19:54:55.715 INFO:teuthology.orchestra.run.smithi101.stdout: }, 2023-08-01T19:54:55.715 INFO:teuthology.orchestra.run.smithi101.stdout: { 2023-08-01T19:54:55.715 INFO:teuthology.orchestra.run.smithi101.stdout: "event": "op_commit", 2023-08-01T19:54:55.715 INFO:teuthology.orchestra.run.smithi101.stdout: "time": "2023-08-01T19:54:04.476174+0000", 2023-08-01T19:54:55.715 INFO:teuthology.orchestra.run.smithi101.stdout: "duration": 0.0072400479999999998 2023-08-01T19:54:55.716 INFO:teuthology.orchestra.run.smithi101.stdout: }, 2023-08-01T19:54:55.716 INFO:teuthology.orchestra.run.smithi101.stdout: { 2023-08-01T19:54:55.716 INFO:teuthology.orchestra.run.smithi101.stdout: "event": "sub_op_commit_rec", 2023-08-01T19:54:55.716 INFO:teuthology.orchestra.run.smithi101.stdout: "time": "2023-08-01T19:54:04.477206+0000", 2023-08-01T19:54:55.716 INFO:teuthology.orchestra.run.smithi101.stdout: "duration": 0.0010318969999999999 2023-08-01T19:54:55.716 INFO:teuthology.orchestra.run.smithi101.stdout: }, 2023-08-01T19:54:55.717 INFO:teuthology.orchestra.run.smithi101.stdout: { 2023-08-01T19:54:55.717 INFO:teuthology.orchestra.run.smithi101.stdout: "event": "commit_sent", 2023-08-01T19:54:55.717 INFO:teuthology.orchestra.run.smithi101.stdout: "time": "2023-08-01T19:54:04.477257+0000", 2023-08-01T19:54:55.717 INFO:teuthology.orchestra.run.smithi101.stdout: "duration": 5.1156000000000003e-05 2023-08-01T19:54:55.717 INFO:teuthology.orchestra.run.smithi101.stdout: }, 2023-08-01T19:54:55.717 INFO:teuthology.orchestra.run.smithi101.stdout: { 2023-08-01T19:54:55.717 INFO:teuthology.orchestra.run.smithi101.stdout: "event": "done", 2023-08-01T19:54:55.718 INFO:teuthology.orchestra.run.smithi101.stdout: "time": "2023-08-01T19:54:04.477294+0000", 2023-08-01T19:54:55.718 INFO:teuthology.orchestra.run.smithi101.stdout: "duration": 3.7150000000000002e-05 2023-08-01T19:54:55.718 INFO:teuthology.orchestra.run.smithi101.stdout: } 2023-08-01T19:54:55.718 INFO:teuthology.orchestra.run.smithi101.stdout: ] 2023-08-01T19:54:55.718 INFO:teuthology.orchestra.run.smithi101.stdout: } 2023-08-01T19:54:55.718 INFO:teuthology.orchestra.run.smithi101.stdout: }, 2023-08-01T19:54:55.718 INFO:teuthology.orchestra.run.smithi101.stdout: { 2023-08-01T19:54:55.718 INFO:teuthology.orchestra.run.smithi101.stdout: "description": "osd_op(mds.0.3:8 3.10 3:09401a81:::601.00000000:head [omap-set-header] snapc 0=[] ondisk+write+known_if_redirected+full_force+supports_pool_eio e17)", 2023-08-01T19:54:55.719 INFO:teuthology.orchestra.run.smithi101.stdout: "initiated_at": "2023-08-01T19:54:04.458869+0000", 2023-08-01T19:54:55.719 INFO:teuthology.orchestra.run.smithi101.stdout: "age": 51.228329447999997, 2023-08-01T19:54:55.719 INFO:teuthology.orchestra.run.smithi101.stdout: "duration": 0.018528932000000001, 2023-08-01T19:54:55.719 INFO:teuthology.orchestra.run.smithi101.stdout: "type_data": { 2023-08-01T19:54:55.719 INFO:teuthology.orchestra.run.smithi101.stdout: "flag_point": "commit sent; apply or cleanup", 2023-08-01T19:54:55.719 INFO:teuthology.orchestra.run.smithi101.stdout: "events": [ 2023-08-01T19:54:55.719 INFO:teuthology.orchestra.run.smithi101.stdout: { 2023-08-01T19:54:55.720 INFO:teuthology.orchestra.run.smithi101.stdout: "event": "initiated", 2023-08-01T19:54:55.720 INFO:teuthology.orchestra.run.smithi101.stdout: "time": "2023-08-01T19:54:04.458869+0000", 2023-08-01T19:54:55.720 INFO:teuthology.orchestra.run.smithi101.stdout: "duration": 0 2023-08-01T19:54:55.720 INFO:teuthology.orchestra.run.smithi101.stdout: }, 2023-08-01T19:54:55.720 INFO:teuthology.orchestra.run.smithi101.stdout: { 2023-08-01T19:54:55.720 INFO:teuthology.orchestra.run.smithi101.stdout: "event": "throttled", 2023-08-01T19:54:55.721 INFO:teuthology.orchestra.run.smithi101.stdout: "time": "2023-08-01T19:54:04.458869+0000", 2023-08-01T19:54:55.721 INFO:teuthology.orchestra.run.smithi101.stdout: "duration": 0 2023-08-01T19:54:55.721 INFO:teuthology.orchestra.run.smithi101.stdout: }, 2023-08-01T19:54:55.721 INFO:teuthology.orchestra.run.smithi101.stdout: { 2023-08-01T19:54:55.721 INFO:teuthology.orchestra.run.smithi101.stdout: "event": "header_read", 2023-08-01T19:54:55.721 INFO:teuthology.orchestra.run.smithi101.stdout: "time": "2023-08-01T19:54:04.458869+0000", 2023-08-01T19:54:55.721 INFO:teuthology.orchestra.run.smithi101.stdout: "duration": 4294967295.9999995 2023-08-01T19:54:55.722 INFO:teuthology.orchestra.run.smithi101.stdout: }, 2023-08-01T19:54:55.722 INFO:teuthology.orchestra.run.smithi101.stdout: { 2023-08-01T19:54:55.722 INFO:teuthology.orchestra.run.smithi101.stdout: "event": "all_read", 2023-08-01T19:54:55.722 INFO:teuthology.orchestra.run.smithi101.stdout: "time": "2023-08-01T19:54:04.458878+0000", 2023-08-01T19:54:55.722 INFO:teuthology.orchestra.run.smithi101.stdout: "duration": 9.4110000000000002e-06 2023-08-01T19:54:55.722 INFO:teuthology.orchestra.run.smithi101.stdout: }, 2023-08-01T19:54:55.722 INFO:teuthology.orchestra.run.smithi101.stdout: { 2023-08-01T19:54:55.723 INFO:teuthology.orchestra.run.smithi101.stdout: "event": "dispatched", 2023-08-01T19:54:55.723 INFO:teuthology.orchestra.run.smithi101.stdout: "time": "2023-08-01T19:54:04.458886+0000", 2023-08-01T19:54:55.723 INFO:teuthology.orchestra.run.smithi101.stdout: "duration": 7.6090000000000003e-06 2023-08-01T19:54:55.723 INFO:teuthology.orchestra.run.smithi101.stdout: }, 2023-08-01T19:54:55.723 INFO:teuthology.orchestra.run.smithi101.stdout: { 2023-08-01T19:54:55.723 INFO:teuthology.orchestra.run.smithi101.stdout: "event": "queued_for_pg", 2023-08-01T19:54:55.723 INFO:teuthology.orchestra.run.smithi101.stdout: "time": "2023-08-01T19:54:04.458890+0000", 2023-08-01T19:54:55.724 INFO:teuthology.orchestra.run.smithi101.stdout: "duration": 4.8470000000000003e-06 2023-08-01T19:54:55.724 INFO:teuthology.orchestra.run.smithi101.stdout: }, 2023-08-01T19:54:55.724 INFO:teuthology.orchestra.run.smithi101.stdout: { 2023-08-01T19:54:55.724 INFO:teuthology.orchestra.run.smithi101.stdout: "event": "reached_pg", 2023-08-01T19:54:55.724 INFO:teuthology.orchestra.run.smithi101.stdout: "time": "2023-08-01T19:54:04.458957+0000", 2023-08-01T19:54:55.724 INFO:teuthology.orchestra.run.smithi101.stdout: "duration": 6.6502999999999997e-05 2023-08-01T19:54:55.724 INFO:teuthology.orchestra.run.smithi101.stdout: }, 2023-08-01T19:54:55.725 INFO:teuthology.orchestra.run.smithi101.stdout: { 2023-08-01T19:54:55.725 INFO:teuthology.orchestra.run.smithi101.stdout: "event": "waiting_for_map not empty", 2023-08-01T19:54:55.725 INFO:teuthology.orchestra.run.smithi101.stdout: "time": "2023-08-01T19:54:04.458959+0000", 2023-08-01T19:54:55.725 INFO:teuthology.orchestra.run.smithi101.stdout: "duration": 2.3989999999999998e-06 2023-08-01T19:54:55.725 INFO:teuthology.orchestra.run.smithi101.stdout: }, 2023-08-01T19:54:55.725 INFO:teuthology.orchestra.run.smithi101.stdout: { 2023-08-01T19:54:55.725 INFO:teuthology.orchestra.run.smithi101.stdout: "event": "reached_pg", 2023-08-01T19:54:55.726 INFO:teuthology.orchestra.run.smithi101.stdout: "time": "2023-08-01T19:54:04.469554+0000", 2023-08-01T19:54:55.726 INFO:teuthology.orchestra.run.smithi101.stdout: "duration": 0.010594404 2023-08-01T19:54:55.726 INFO:teuthology.orchestra.run.smithi101.stdout: }, 2023-08-01T19:54:55.726 INFO:teuthology.orchestra.run.smithi101.stdout: { 2023-08-01T19:54:55.726 INFO:teuthology.orchestra.run.smithi101.stdout: "event": "started", 2023-08-01T19:54:55.726 INFO:teuthology.orchestra.run.smithi101.stdout: "time": "2023-08-01T19:54:04.469694+0000", 2023-08-01T19:54:55.726 INFO:teuthology.orchestra.run.smithi101.stdout: "duration": 0.00014006899999999999 2023-08-01T19:54:55.727 INFO:teuthology.orchestra.run.smithi101.stdout: }, 2023-08-01T19:54:55.727 INFO:teuthology.orchestra.run.smithi101.stdout: { 2023-08-01T19:54:55.727 INFO:teuthology.orchestra.run.smithi101.stdout: "event": "waiting for subops from 2", 2023-08-01T19:54:55.727 INFO:teuthology.orchestra.run.smithi101.stdout: "time": "2023-08-01T19:54:04.469826+0000", 2023-08-01T19:54:55.727 INFO:teuthology.orchestra.run.smithi101.stdout: "duration": 0.000132285 2023-08-01T19:54:55.727 INFO:teuthology.orchestra.run.smithi101.stdout: }, 2023-08-01T19:54:55.727 INFO:teuthology.orchestra.run.smithi101.stdout: { 2023-08-01T19:54:55.728 INFO:teuthology.orchestra.run.smithi101.stdout: "event": "op_commit", 2023-08-01T19:54:55.728 INFO:teuthology.orchestra.run.smithi101.stdout: "time": "2023-08-01T19:54:04.476179+0000", 2023-08-01T19:54:55.728 INFO:teuthology.orchestra.run.smithi101.stdout: "duration": 0.0063524289999999997 2023-08-01T19:54:55.728 INFO:teuthology.orchestra.run.smithi101.stdout: }, 2023-08-01T19:54:55.728 INFO:teuthology.orchestra.run.smithi101.stdout: { 2023-08-01T19:54:55.728 INFO:teuthology.orchestra.run.smithi101.stdout: "event": "sub_op_commit_rec", 2023-08-01T19:54:55.728 INFO:teuthology.orchestra.run.smithi101.stdout: "time": "2023-08-01T19:54:04.477334+0000", 2023-08-01T19:54:55.729 INFO:teuthology.orchestra.run.smithi101.stdout: "duration": 0.0011551070000000001 2023-08-01T19:54:55.729 INFO:teuthology.orchestra.run.smithi101.stdout: }, 2023-08-01T19:54:55.729 INFO:teuthology.orchestra.run.smithi101.stdout: { 2023-08-01T19:54:55.729 INFO:teuthology.orchestra.run.smithi101.stdout: "event": "commit_sent", 2023-08-01T19:54:55.729 INFO:teuthology.orchestra.run.smithi101.stdout: "time": "2023-08-01T19:54:04.477371+0000", 2023-08-01T19:54:55.729 INFO:teuthology.orchestra.run.smithi101.stdout: "duration": 3.7425000000000002e-05 2023-08-01T19:54:55.729 INFO:teuthology.orchestra.run.smithi101.stdout: }, 2023-08-01T19:54:55.730 INFO:teuthology.orchestra.run.smithi101.stdout: { 2023-08-01T19:54:55.730 INFO:teuthology.orchestra.run.smithi101.stdout: "event": "done", 2023-08-01T19:54:55.730 INFO:teuthology.orchestra.run.smithi101.stdout: "time": "2023-08-01T19:54:04.477398+0000", 2023-08-01T19:54:55.730 INFO:teuthology.orchestra.run.smithi101.stdout: "duration": 2.7078000000000001e-05 2023-08-01T19:54:55.730 INFO:teuthology.orchestra.run.smithi101.stdout: } 2023-08-01T19:54:55.730 INFO:teuthology.orchestra.run.smithi101.stdout: ] 2023-08-01T19:54:55.730 INFO:teuthology.orchestra.run.smithi101.stdout: } 2023-08-01T19:54:55.731 INFO:teuthology.orchestra.run.smithi101.stdout: }, 2023-08-01T19:54:55.731 INFO:teuthology.orchestra.run.smithi101.stdout: { 2023-08-01T19:54:55.731 INFO:teuthology.orchestra.run.smithi101.stdout: "description": "osd_op(mds.0.3:9 3.10 3:09401a81:::601.00000000:head [create,setxattr parent (62) in=6b,setxattr layout (30) in=6b] snapc 0=[] ondisk+write+known_if_redirected+full_force+supports_pool_eio e17)", 2023-08-01T19:54:55.731 INFO:teuthology.orchestra.run.smithi101.stdout: "initiated_at": "2023-08-01T19:54:04.458896+0000", 2023-08-01T19:54:55.731 INFO:teuthology.orchestra.run.smithi101.stdout: "age": 51.228302280999998, 2023-08-01T19:54:55.731 INFO:teuthology.orchestra.run.smithi101.stdout: "duration": 0.018577215000000001, 2023-08-01T19:54:55.731 INFO:teuthology.orchestra.run.smithi101.stdout: "type_data": { 2023-08-01T19:54:55.732 INFO:teuthology.orchestra.run.smithi101.stdout: "flag_point": "commit sent; apply or cleanup", 2023-08-01T19:54:55.732 INFO:teuthology.orchestra.run.smithi101.stdout: "events": [ 2023-08-01T19:54:55.732 INFO:teuthology.orchestra.run.smithi101.stdout: { 2023-08-01T19:54:55.732 INFO:teuthology.orchestra.run.smithi101.stdout: "event": "initiated", 2023-08-01T19:54:55.732 INFO:teuthology.orchestra.run.smithi101.stdout: "time": "2023-08-01T19:54:04.458896+0000", 2023-08-01T19:54:55.732 INFO:teuthology.orchestra.run.smithi101.stdout: "duration": 0 2023-08-01T19:54:55.733 INFO:teuthology.orchestra.run.smithi101.stdout: }, 2023-08-01T19:54:55.733 INFO:teuthology.orchestra.run.smithi101.stdout: { 2023-08-01T19:54:55.733 INFO:teuthology.orchestra.run.smithi101.stdout: "event": "throttled", 2023-08-01T19:54:55.733 INFO:teuthology.orchestra.run.smithi101.stdout: "time": "2023-08-01T19:54:04.458896+0000", 2023-08-01T19:54:55.733 INFO:teuthology.orchestra.run.smithi101.stdout: "duration": 0 2023-08-01T19:54:55.733 INFO:teuthology.orchestra.run.smithi101.stdout: }, 2023-08-01T19:54:55.733 INFO:teuthology.orchestra.run.smithi101.stdout: { 2023-08-01T19:54:55.733 INFO:teuthology.orchestra.run.smithi101.stdout: "event": "header_read", 2023-08-01T19:54:55.734 INFO:teuthology.orchestra.run.smithi101.stdout: "time": "2023-08-01T19:54:04.458896+0000", 2023-08-01T19:54:55.734 INFO:teuthology.orchestra.run.smithi101.stdout: "duration": 4294967295.9999995 2023-08-01T19:54:55.734 INFO:teuthology.orchestra.run.smithi101.stdout: }, 2023-08-01T19:54:55.734 INFO:teuthology.orchestra.run.smithi101.stdout: { 2023-08-01T19:54:55.734 INFO:teuthology.orchestra.run.smithi101.stdout: "event": "all_read", 2023-08-01T19:54:55.734 INFO:teuthology.orchestra.run.smithi101.stdout: "time": "2023-08-01T19:54:04.458900+0000", 2023-08-01T19:54:55.734 INFO:teuthology.orchestra.run.smithi101.stdout: "duration": 4.0829999999999997e-06 2023-08-01T19:54:55.735 INFO:teuthology.orchestra.run.smithi101.stdout: }, 2023-08-01T19:54:55.735 INFO:teuthology.orchestra.run.smithi101.stdout: { 2023-08-01T19:54:55.735 INFO:teuthology.orchestra.run.smithi101.stdout: "event": "dispatched", 2023-08-01T19:54:55.735 INFO:teuthology.orchestra.run.smithi101.stdout: "time": "2023-08-01T19:54:04.458906+0000", 2023-08-01T19:54:55.735 INFO:teuthology.orchestra.run.smithi101.stdout: "duration": 6.4099999999999996e-06 2023-08-01T19:54:55.735 INFO:teuthology.orchestra.run.smithi101.stdout: }, 2023-08-01T19:54:55.735 INFO:teuthology.orchestra.run.smithi101.stdout: { 2023-08-01T19:54:55.736 INFO:teuthology.orchestra.run.smithi101.stdout: "event": "queued_for_pg", 2023-08-01T19:54:55.736 INFO:teuthology.orchestra.run.smithi101.stdout: "time": "2023-08-01T19:54:04.458911+0000", 2023-08-01T19:54:55.736 INFO:teuthology.orchestra.run.smithi101.stdout: "duration": 4.0500000000000002e-06 2023-08-01T19:54:55.736 INFO:teuthology.orchestra.run.smithi101.stdout: }, 2023-08-01T19:54:55.736 INFO:teuthology.orchestra.run.smithi101.stdout: { 2023-08-01T19:54:55.736 INFO:teuthology.orchestra.run.smithi101.stdout: "event": "reached_pg", 2023-08-01T19:54:55.736 INFO:teuthology.orchestra.run.smithi101.stdout: "time": "2023-08-01T19:54:04.458981+0000", 2023-08-01T19:54:55.737 INFO:teuthology.orchestra.run.smithi101.stdout: "duration": 7.0121000000000002e-05 2023-08-01T19:54:55.737 INFO:teuthology.orchestra.run.smithi101.stdout: }, 2023-08-01T19:54:55.737 INFO:teuthology.orchestra.run.smithi101.stdout: { 2023-08-01T19:54:55.737 INFO:teuthology.orchestra.run.smithi101.stdout: "event": "waiting_for_map not empty", 2023-08-01T19:54:55.737 INFO:teuthology.orchestra.run.smithi101.stdout: "time": "2023-08-01T19:54:04.458983+0000", 2023-08-01T19:54:55.737 INFO:teuthology.orchestra.run.smithi101.stdout: "duration": 2.2299999999999998e-06 2023-08-01T19:54:55.737 INFO:teuthology.orchestra.run.smithi101.stdout: }, 2023-08-01T19:54:55.738 INFO:teuthology.orchestra.run.smithi101.stdout: { 2023-08-01T19:54:55.738 INFO:teuthology.orchestra.run.smithi101.stdout: "event": "reached_pg", 2023-08-01T19:54:55.738 INFO:teuthology.orchestra.run.smithi101.stdout: "time": "2023-08-01T19:54:04.470122+0000", 2023-08-01T19:54:55.738 INFO:teuthology.orchestra.run.smithi101.stdout: "duration": 0.011139593999999999 2023-08-01T19:54:55.738 INFO:teuthology.orchestra.run.smithi101.stdout: }, 2023-08-01T19:54:55.738 INFO:teuthology.orchestra.run.smithi101.stdout: { 2023-08-01T19:54:55.738 INFO:teuthology.orchestra.run.smithi101.stdout: "event": "started", 2023-08-01T19:54:55.739 INFO:teuthology.orchestra.run.smithi101.stdout: "time": "2023-08-01T19:54:04.470217+0000", 2023-08-01T19:54:55.739 INFO:teuthology.orchestra.run.smithi101.stdout: "duration": 9.4388000000000005e-05 2023-08-01T19:54:55.739 INFO:teuthology.orchestra.run.smithi101.stdout: }, 2023-08-01T19:54:55.739 INFO:teuthology.orchestra.run.smithi101.stdout: { 2023-08-01T19:54:55.739 INFO:teuthology.orchestra.run.smithi101.stdout: "event": "waiting for subops from 2", 2023-08-01T19:54:55.739 INFO:teuthology.orchestra.run.smithi101.stdout: "time": "2023-08-01T19:54:04.470714+0000", 2023-08-01T19:54:55.739 INFO:teuthology.orchestra.run.smithi101.stdout: "duration": 0.00049680999999999998 2023-08-01T19:54:55.739 INFO:teuthology.orchestra.run.smithi101.stdout: }, 2023-08-01T19:54:55.740 INFO:teuthology.orchestra.run.smithi101.stdout: { 2023-08-01T19:54:55.740 INFO:teuthology.orchestra.run.smithi101.stdout: "event": "op_commit", 2023-08-01T19:54:55.740 INFO:teuthology.orchestra.run.smithi101.stdout: "time": "2023-08-01T19:54:04.476183+0000", 2023-08-01T19:54:55.740 INFO:teuthology.orchestra.run.smithi101.stdout: "duration": 0.0054695880000000001 2023-08-01T19:54:55.740 INFO:teuthology.orchestra.run.smithi101.stdout: }, 2023-08-01T19:54:55.740 INFO:teuthology.orchestra.run.smithi101.stdout: { 2023-08-01T19:54:55.741 INFO:teuthology.orchestra.run.smithi101.stdout: "event": "sub_op_commit_rec", 2023-08-01T19:54:55.741 INFO:teuthology.orchestra.run.smithi101.stdout: "time": "2023-08-01T19:54:04.477428+0000", 2023-08-01T19:54:55.741 INFO:teuthology.orchestra.run.smithi101.stdout: "duration": 0.001244843 2023-08-01T19:54:55.741 INFO:teuthology.orchestra.run.smithi101.stdout: }, 2023-08-01T19:54:55.741 INFO:teuthology.orchestra.run.smithi101.stdout: { 2023-08-01T19:54:55.741 INFO:teuthology.orchestra.run.smithi101.stdout: "event": "commit_sent", 2023-08-01T19:54:55.741 INFO:teuthology.orchestra.run.smithi101.stdout: "time": "2023-08-01T19:54:04.477456+0000", 2023-08-01T19:54:55.742 INFO:teuthology.orchestra.run.smithi101.stdout: "duration": 2.7538e-05 2023-08-01T19:54:55.742 INFO:teuthology.orchestra.run.smithi101.stdout: }, 2023-08-01T19:54:55.742 INFO:teuthology.orchestra.run.smithi101.stdout: { 2023-08-01T19:54:55.742 INFO:teuthology.orchestra.run.smithi101.stdout: "event": "done", 2023-08-01T19:54:55.742 INFO:teuthology.orchestra.run.smithi101.stdout: "time": "2023-08-01T19:54:04.477474+0000", 2023-08-01T19:54:55.742 INFO:teuthology.orchestra.run.smithi101.stdout: "duration": 1.7974000000000001e-05 2023-08-01T19:54:55.742 INFO:teuthology.orchestra.run.smithi101.stdout: } 2023-08-01T19:54:55.743 INFO:teuthology.orchestra.run.smithi101.stdout: ] 2023-08-01T19:54:55.743 INFO:teuthology.orchestra.run.smithi101.stdout: } 2023-08-01T19:54:55.743 INFO:teuthology.orchestra.run.smithi101.stdout: }, 2023-08-01T19:54:55.743 INFO:teuthology.orchestra.run.smithi101.stdout: { 2023-08-01T19:54:55.743 INFO:teuthology.orchestra.run.smithi101.stdout: "description": "osd_op(mds.0.3:10 3.10 3:0bd6d154:::602.00000000:head [omap-set-header] snapc 0=[] ondisk+write+known_if_redirected+full_force+supports_pool_eio e17)", 2023-08-01T19:54:55.743 INFO:teuthology.orchestra.run.smithi101.stdout: "initiated_at": "2023-08-01T19:54:04.458927+0000", 2023-08-01T19:54:55.743 INFO:teuthology.orchestra.run.smithi101.stdout: "age": 51.228271303, 2023-08-01T19:54:55.744 INFO:teuthology.orchestra.run.smithi101.stdout: "duration": 0.019574352, 2023-08-01T19:54:55.744 INFO:teuthology.orchestra.run.smithi101.stdout: "type_data": { 2023-08-01T19:54:55.744 INFO:teuthology.orchestra.run.smithi101.stdout: "flag_point": "commit sent; apply or cleanup", 2023-08-01T19:54:55.744 INFO:teuthology.orchestra.run.smithi101.stdout: "events": [ 2023-08-01T19:54:55.744 INFO:teuthology.orchestra.run.smithi101.stdout: { 2023-08-01T19:54:55.744 INFO:teuthology.orchestra.run.smithi101.stdout: "event": "initiated", 2023-08-01T19:54:55.744 INFO:teuthology.orchestra.run.smithi101.stdout: "time": "2023-08-01T19:54:04.458927+0000", 2023-08-01T19:54:55.745 INFO:teuthology.orchestra.run.smithi101.stdout: "duration": 0 2023-08-01T19:54:55.745 INFO:teuthology.orchestra.run.smithi101.stdout: }, 2023-08-01T19:54:55.745 INFO:teuthology.orchestra.run.smithi101.stdout: { 2023-08-01T19:54:55.745 INFO:teuthology.orchestra.run.smithi101.stdout: "event": "throttled", 2023-08-01T19:54:55.745 INFO:teuthology.orchestra.run.smithi101.stdout: "time": "2023-08-01T19:54:04.458927+0000", 2023-08-01T19:54:55.745 INFO:teuthology.orchestra.run.smithi101.stdout: "duration": 0 2023-08-01T19:54:55.745 INFO:teuthology.orchestra.run.smithi101.stdout: }, 2023-08-01T19:54:55.746 INFO:teuthology.orchestra.run.smithi101.stdout: { 2023-08-01T19:54:55.746 INFO:teuthology.orchestra.run.smithi101.stdout: "event": "header_read", 2023-08-01T19:54:55.746 INFO:teuthology.orchestra.run.smithi101.stdout: "time": "2023-08-01T19:54:04.458927+0000", 2023-08-01T19:54:55.746 INFO:teuthology.orchestra.run.smithi101.stdout: "duration": 4294967295.9999995 2023-08-01T19:54:55.746 INFO:teuthology.orchestra.run.smithi101.stdout: }, 2023-08-01T19:54:55.746 INFO:teuthology.orchestra.run.smithi101.stdout: { 2023-08-01T19:54:55.746 INFO:teuthology.orchestra.run.smithi101.stdout: "event": "all_read", 2023-08-01T19:54:55.747 INFO:teuthology.orchestra.run.smithi101.stdout: "time": "2023-08-01T19:54:04.458931+0000", 2023-08-01T19:54:55.747 INFO:teuthology.orchestra.run.smithi101.stdout: "duration": 4.3000000000000003e-06 2023-08-01T19:54:55.747 INFO:teuthology.orchestra.run.smithi101.stdout: }, 2023-08-01T19:54:55.747 INFO:teuthology.orchestra.run.smithi101.stdout: { 2023-08-01T19:54:55.747 INFO:teuthology.orchestra.run.smithi101.stdout: "event": "dispatched", 2023-08-01T19:54:55.747 INFO:teuthology.orchestra.run.smithi101.stdout: "time": "2023-08-01T19:54:04.458938+0000", 2023-08-01T19:54:55.748 INFO:teuthology.orchestra.run.smithi101.stdout: "duration": 7.3220000000000004e-06 2023-08-01T19:54:55.748 INFO:teuthology.orchestra.run.smithi101.stdout: }, 2023-08-01T19:54:55.748 INFO:teuthology.orchestra.run.smithi101.stdout: { 2023-08-01T19:54:55.748 INFO:teuthology.orchestra.run.smithi101.stdout: "event": "queued_for_pg", 2023-08-01T19:54:55.748 INFO:teuthology.orchestra.run.smithi101.stdout: "time": "2023-08-01T19:54:04.458944+0000", 2023-08-01T19:54:55.748 INFO:teuthology.orchestra.run.smithi101.stdout: "duration": 5.3040000000000004e-06 2023-08-01T19:54:55.748 INFO:teuthology.orchestra.run.smithi101.stdout: }, 2023-08-01T19:54:55.749 INFO:teuthology.orchestra.run.smithi101.stdout: { 2023-08-01T19:54:55.749 INFO:teuthology.orchestra.run.smithi101.stdout: "event": "reached_pg", 2023-08-01T19:54:55.749 INFO:teuthology.orchestra.run.smithi101.stdout: "time": "2023-08-01T19:54:04.459006+0000", 2023-08-01T19:54:55.749 INFO:teuthology.orchestra.run.smithi101.stdout: "duration": 6.2081000000000004e-05 2023-08-01T19:54:55.749 INFO:teuthology.orchestra.run.smithi101.stdout: }, 2023-08-01T19:54:55.749 INFO:teuthology.orchestra.run.smithi101.stdout: { 2023-08-01T19:54:55.749 INFO:teuthology.orchestra.run.smithi101.stdout: "event": "waiting_for_map not empty", 2023-08-01T19:54:55.750 INFO:teuthology.orchestra.run.smithi101.stdout: "time": "2023-08-01T19:54:04.459008+0000", 2023-08-01T19:54:55.750 INFO:teuthology.orchestra.run.smithi101.stdout: "duration": 2.2500000000000001e-06 2023-08-01T19:54:55.750 INFO:teuthology.orchestra.run.smithi101.stdout: }, 2023-08-01T19:54:55.750 INFO:teuthology.orchestra.run.smithi101.stdout: { 2023-08-01T19:54:55.751 INFO:teuthology.orchestra.run.smithi101.stdout: "event": "reached_pg", 2023-08-01T19:54:55.751 INFO:teuthology.orchestra.run.smithi101.stdout: "time": "2023-08-01T19:54:04.470946+0000", 2023-08-01T19:54:55.751 INFO:teuthology.orchestra.run.smithi101.stdout: "duration": 0.011938347 2023-08-01T19:54:55.751 INFO:teuthology.orchestra.run.smithi101.stdout: }, 2023-08-01T19:54:55.752 INFO:teuthology.orchestra.run.smithi101.stdout: { 2023-08-01T19:54:55.752 INFO:teuthology.orchestra.run.smithi101.stdout: "event": "started", 2023-08-01T19:54:55.752 INFO:teuthology.orchestra.run.smithi101.stdout: "time": "2023-08-01T19:54:04.471071+0000", 2023-08-01T19:54:55.752 INFO:teuthology.orchestra.run.smithi101.stdout: "duration": 0.00012470299999999999 2023-08-01T19:54:55.753 INFO:teuthology.orchestra.run.smithi101.stdout: }, 2023-08-01T19:54:55.753 INFO:teuthology.orchestra.run.smithi101.stdout: { 2023-08-01T19:54:55.753 INFO:teuthology.orchestra.run.smithi101.stdout: "event": "waiting for subops from 2", 2023-08-01T19:54:55.753 INFO:teuthology.orchestra.run.smithi101.stdout: "time": "2023-08-01T19:54:04.471205+0000", 2023-08-01T19:54:55.753 INFO:teuthology.orchestra.run.smithi101.stdout: "duration": 0.000133891 2023-08-01T19:54:55.754 INFO:teuthology.orchestra.run.smithi101.stdout: }, 2023-08-01T19:54:55.754 INFO:teuthology.orchestra.run.smithi101.stdout: { 2023-08-01T19:54:55.754 INFO:teuthology.orchestra.run.smithi101.stdout: "event": "op_commit", 2023-08-01T19:54:55.754 INFO:teuthology.orchestra.run.smithi101.stdout: "time": "2023-08-01T19:54:04.477042+0000", 2023-08-01T19:54:55.754 INFO:teuthology.orchestra.run.smithi101.stdout: "duration": 0.0058374849999999999 2023-08-01T19:54:55.755 INFO:teuthology.orchestra.run.smithi101.stdout: }, 2023-08-01T19:54:55.755 INFO:teuthology.orchestra.run.smithi101.stdout: { 2023-08-01T19:54:55.755 INFO:teuthology.orchestra.run.smithi101.stdout: "event": "sub_op_commit_rec", 2023-08-01T19:54:55.755 INFO:teuthology.orchestra.run.smithi101.stdout: "time": "2023-08-01T19:54:04.478445+0000", 2023-08-01T19:54:55.755 INFO:teuthology.orchestra.run.smithi101.stdout: "duration": 0.0014023239999999999 2023-08-01T19:54:55.755 INFO:teuthology.orchestra.run.smithi101.stdout: }, 2023-08-01T19:54:55.755 INFO:teuthology.orchestra.run.smithi101.stdout: { 2023-08-01T19:54:55.756 INFO:teuthology.orchestra.run.smithi101.stdout: "event": "commit_sent", 2023-08-01T19:54:55.756 INFO:teuthology.orchestra.run.smithi101.stdout: "time": "2023-08-01T19:54:04.478478+0000", 2023-08-01T19:54:55.756 INFO:teuthology.orchestra.run.smithi101.stdout: "duration": 3.3503000000000001e-05 2023-08-01T19:54:55.756 INFO:teuthology.orchestra.run.smithi101.stdout: }, 2023-08-01T19:54:55.756 INFO:teuthology.orchestra.run.smithi101.stdout: { 2023-08-01T19:54:55.756 INFO:teuthology.orchestra.run.smithi101.stdout: "event": "done", 2023-08-01T19:54:55.756 INFO:teuthology.orchestra.run.smithi101.stdout: "time": "2023-08-01T19:54:04.478502+0000", 2023-08-01T19:54:55.757 INFO:teuthology.orchestra.run.smithi101.stdout: "duration": 2.3402000000000001e-05 2023-08-01T19:54:55.757 INFO:teuthology.orchestra.run.smithi101.stdout: } 2023-08-01T19:54:55.757 INFO:teuthology.orchestra.run.smithi101.stdout: ] 2023-08-01T19:54:55.757 INFO:teuthology.orchestra.run.smithi101.stdout: } 2023-08-01T19:54:55.757 INFO:teuthology.orchestra.run.smithi101.stdout: }, 2023-08-01T19:54:55.757 INFO:teuthology.orchestra.run.smithi101.stdout: { 2023-08-01T19:54:55.757 INFO:teuthology.orchestra.run.smithi101.stdout: "description": "osd_op(mds.0.3:11 3.10 3:0bd6d154:::602.00000000:head [create,setxattr parent (62) in=6b,setxattr layout (30) in=6b] snapc 0=[] ondisk+write+known_if_redirected+full_force+supports_pool_eio e17)", 2023-08-01T19:54:55.758 INFO:teuthology.orchestra.run.smithi101.stdout: "initiated_at": "2023-08-01T19:54:04.458960+0000", 2023-08-01T19:54:55.758 INFO:teuthology.orchestra.run.smithi101.stdout: "age": 51.228238855000001, 2023-08-01T19:54:55.758 INFO:teuthology.orchestra.run.smithi101.stdout: "duration": 0.019645459000000001, 2023-08-01T19:54:55.758 INFO:teuthology.orchestra.run.smithi101.stdout: "type_data": { 2023-08-01T19:54:55.758 INFO:teuthology.orchestra.run.smithi101.stdout: "flag_point": "commit sent; apply or cleanup", 2023-08-01T19:54:55.758 INFO:teuthology.orchestra.run.smithi101.stdout: "events": [ 2023-08-01T19:54:55.758 INFO:teuthology.orchestra.run.smithi101.stdout: { 2023-08-01T19:54:55.759 INFO:teuthology.orchestra.run.smithi101.stdout: "event": "initiated", 2023-08-01T19:54:55.759 INFO:teuthology.orchestra.run.smithi101.stdout: "time": "2023-08-01T19:54:04.458960+0000", 2023-08-01T19:54:55.759 INFO:teuthology.orchestra.run.smithi101.stdout: "duration": 0 2023-08-01T19:54:55.759 INFO:teuthology.orchestra.run.smithi101.stdout: }, 2023-08-01T19:54:55.759 INFO:teuthology.orchestra.run.smithi101.stdout: { 2023-08-01T19:54:55.759 INFO:teuthology.orchestra.run.smithi101.stdout: "event": "throttled", 2023-08-01T19:54:55.759 INFO:teuthology.orchestra.run.smithi101.stdout: "time": "2023-08-01T19:54:04.458960+0000", 2023-08-01T19:54:55.760 INFO:teuthology.orchestra.run.smithi101.stdout: "duration": 0 2023-08-01T19:54:55.760 INFO:teuthology.orchestra.run.smithi101.stdout: }, 2023-08-01T19:54:55.760 INFO:teuthology.orchestra.run.smithi101.stdout: { 2023-08-01T19:54:55.760 INFO:teuthology.orchestra.run.smithi101.stdout: "event": "header_read", 2023-08-01T19:54:55.760 INFO:teuthology.orchestra.run.smithi101.stdout: "time": "2023-08-01T19:54:04.458959+0000", 2023-08-01T19:54:55.760 INFO:teuthology.orchestra.run.smithi101.stdout: "duration": 4294967295.9999995 2023-08-01T19:54:55.760 INFO:teuthology.orchestra.run.smithi101.stdout: }, 2023-08-01T19:54:55.761 INFO:teuthology.orchestra.run.smithi101.stdout: { 2023-08-01T19:54:55.761 INFO:teuthology.orchestra.run.smithi101.stdout: "event": "all_read", 2023-08-01T19:54:55.761 INFO:teuthology.orchestra.run.smithi101.stdout: "time": "2023-08-01T19:54:04.458963+0000", 2023-08-01T19:54:55.761 INFO:teuthology.orchestra.run.smithi101.stdout: "duration": 3.9199999999999997e-06 2023-08-01T19:54:55.761 INFO:teuthology.orchestra.run.smithi101.stdout: }, 2023-08-01T19:54:55.761 INFO:teuthology.orchestra.run.smithi101.stdout: { 2023-08-01T19:54:55.761 INFO:teuthology.orchestra.run.smithi101.stdout: "event": "dispatched", 2023-08-01T19:54:55.762 INFO:teuthology.orchestra.run.smithi101.stdout: "time": "2023-08-01T19:54:04.458970+0000", 2023-08-01T19:54:55.762 INFO:teuthology.orchestra.run.smithi101.stdout: "duration": 7.0439999999999998e-06 2023-08-01T19:54:55.762 INFO:teuthology.orchestra.run.smithi101.stdout: }, 2023-08-01T19:54:55.762 INFO:teuthology.orchestra.run.smithi101.stdout: { 2023-08-01T19:54:55.762 INFO:teuthology.orchestra.run.smithi101.stdout: "event": "queued_for_pg", 2023-08-01T19:54:55.762 INFO:teuthology.orchestra.run.smithi101.stdout: "time": "2023-08-01T19:54:04.458976+0000", 2023-08-01T19:54:55.762 INFO:teuthology.orchestra.run.smithi101.stdout: "duration": 5.9540000000000001e-06 2023-08-01T19:54:55.762 INFO:teuthology.orchestra.run.smithi101.stdout: }, 2023-08-01T19:54:55.763 INFO:teuthology.orchestra.run.smithi101.stdout: { 2023-08-01T19:54:55.763 INFO:teuthology.orchestra.run.smithi101.stdout: "event": "reached_pg", 2023-08-01T19:54:55.763 INFO:teuthology.orchestra.run.smithi101.stdout: "time": "2023-08-01T19:54:04.459035+0000", 2023-08-01T19:54:55.763 INFO:teuthology.orchestra.run.smithi101.stdout: "duration": 5.8924e-05 2023-08-01T19:54:55.763 INFO:teuthology.orchestra.run.smithi101.stdout: }, 2023-08-01T19:54:55.763 INFO:teuthology.orchestra.run.smithi101.stdout: { 2023-08-01T19:54:55.763 INFO:teuthology.orchestra.run.smithi101.stdout: "event": "waiting_for_map not empty", 2023-08-01T19:54:55.764 INFO:teuthology.orchestra.run.smithi101.stdout: "time": "2023-08-01T19:54:04.459038+0000", 2023-08-01T19:54:55.764 INFO:teuthology.orchestra.run.smithi101.stdout: "duration": 3.2760000000000001e-06 2023-08-01T19:54:55.764 INFO:teuthology.orchestra.run.smithi101.stdout: }, 2023-08-01T19:54:55.764 INFO:teuthology.orchestra.run.smithi101.stdout: { 2023-08-01T19:54:55.764 INFO:teuthology.orchestra.run.smithi101.stdout: "event": "reached_pg", 2023-08-01T19:54:55.764 INFO:teuthology.orchestra.run.smithi101.stdout: "time": "2023-08-01T19:54:04.471511+0000", 2023-08-01T19:54:55.765 INFO:teuthology.orchestra.run.smithi101.stdout: "duration": 0.012473039999999999 2023-08-01T19:54:55.765 INFO:teuthology.orchestra.run.smithi101.stdout: }, 2023-08-01T19:54:55.765 INFO:teuthology.orchestra.run.smithi101.stdout: { 2023-08-01T19:54:55.765 INFO:teuthology.orchestra.run.smithi101.stdout: "event": "started", 2023-08-01T19:54:55.765 INFO:teuthology.orchestra.run.smithi101.stdout: "time": "2023-08-01T19:54:04.472086+0000", 2023-08-01T19:54:55.765 INFO:teuthology.orchestra.run.smithi101.stdout: "duration": 0.00057491699999999998 2023-08-01T19:54:55.765 INFO:teuthology.orchestra.run.smithi101.stdout: }, 2023-08-01T19:54:55.765 INFO:teuthology.orchestra.run.smithi101.stdout: { 2023-08-01T19:54:55.766 INFO:teuthology.orchestra.run.smithi101.stdout: "event": "waiting for subops from 2", 2023-08-01T19:54:55.766 INFO:teuthology.orchestra.run.smithi101.stdout: "time": "2023-08-01T19:54:04.472310+0000", 2023-08-01T19:54:55.766 INFO:teuthology.orchestra.run.smithi101.stdout: "duration": 0.00022396499999999999 2023-08-01T19:54:55.766 INFO:teuthology.orchestra.run.smithi101.stdout: }, 2023-08-01T19:54:55.766 INFO:teuthology.orchestra.run.smithi101.stdout: { 2023-08-01T19:54:55.766 INFO:teuthology.orchestra.run.smithi101.stdout: "event": "op_commit", 2023-08-01T19:54:55.766 INFO:teuthology.orchestra.run.smithi101.stdout: "time": "2023-08-01T19:54:04.478141+0000", 2023-08-01T19:54:55.767 INFO:teuthology.orchestra.run.smithi101.stdout: "duration": 0.0058312320000000004 2023-08-01T19:54:55.767 INFO:teuthology.orchestra.run.smithi101.stdout: }, 2023-08-01T19:54:55.767 INFO:teuthology.orchestra.run.smithi101.stdout: { 2023-08-01T19:54:55.767 INFO:teuthology.orchestra.run.smithi101.stdout: "event": "sub_op_commit_rec", 2023-08-01T19:54:55.767 INFO:teuthology.orchestra.run.smithi101.stdout: "time": "2023-08-01T19:54:04.478543+0000", 2023-08-01T19:54:55.767 INFO:teuthology.orchestra.run.smithi101.stdout: "duration": 0.00040160800000000002 2023-08-01T19:54:55.767 INFO:teuthology.orchestra.run.smithi101.stdout: }, 2023-08-01T19:54:55.768 INFO:teuthology.orchestra.run.smithi101.stdout: { 2023-08-01T19:54:55.768 INFO:teuthology.orchestra.run.smithi101.stdout: "event": "commit_sent", 2023-08-01T19:54:55.768 INFO:teuthology.orchestra.run.smithi101.stdout: "time": "2023-08-01T19:54:04.478584+0000", 2023-08-01T19:54:55.768 INFO:teuthology.orchestra.run.smithi101.stdout: "duration": 4.0989999999999999e-05 2023-08-01T19:54:55.768 INFO:teuthology.orchestra.run.smithi101.stdout: }, 2023-08-01T19:54:55.768 INFO:teuthology.orchestra.run.smithi101.stdout: { 2023-08-01T19:54:55.768 INFO:teuthology.orchestra.run.smithi101.stdout: "event": "done", 2023-08-01T19:54:55.769 INFO:teuthology.orchestra.run.smithi101.stdout: "time": "2023-08-01T19:54:04.478605+0000", 2023-08-01T19:54:55.769 INFO:teuthology.orchestra.run.smithi101.stdout: "duration": 2.1178e-05 2023-08-01T19:54:55.769 INFO:teuthology.orchestra.run.smithi101.stdout: } 2023-08-01T19:54:55.769 INFO:teuthology.orchestra.run.smithi101.stdout: ] 2023-08-01T19:54:55.769 INFO:teuthology.orchestra.run.smithi101.stdout: } 2023-08-01T19:54:55.769 INFO:teuthology.orchestra.run.smithi101.stdout: }, 2023-08-01T19:54:55.769 INFO:teuthology.orchestra.run.smithi101.stdout: { 2023-08-01T19:54:55.770 INFO:teuthology.orchestra.run.smithi101.stdout: "description": "osd_op(mds.0.3:12 3.10 3:0d89b25e:::603.00000000:head [omap-set-header] snapc 0=[] ondisk+write+known_if_redirected+full_force+supports_pool_eio e17)", 2023-08-01T19:54:55.770 INFO:teuthology.orchestra.run.smithi101.stdout: "initiated_at": "2023-08-01T19:54:04.458982+0000", 2023-08-01T19:54:55.770 INFO:teuthology.orchestra.run.smithi101.stdout: "age": 51.228216627000002, 2023-08-01T19:54:55.770 INFO:teuthology.orchestra.run.smithi101.stdout: "duration": 0.021266334000000001, 2023-08-01T19:54:55.770 INFO:teuthology.orchestra.run.smithi101.stdout: "type_data": { 2023-08-01T19:54:55.770 INFO:teuthology.orchestra.run.smithi101.stdout: "flag_point": "commit sent; apply or cleanup", 2023-08-01T19:54:55.770 INFO:teuthology.orchestra.run.smithi101.stdout: "events": [ 2023-08-01T19:54:55.771 INFO:teuthology.orchestra.run.smithi101.stdout: { 2023-08-01T19:54:55.771 INFO:teuthology.orchestra.run.smithi101.stdout: "event": "initiated", 2023-08-01T19:54:55.771 INFO:teuthology.orchestra.run.smithi101.stdout: "time": "2023-08-01T19:54:04.458982+0000", 2023-08-01T19:54:55.771 INFO:teuthology.orchestra.run.smithi101.stdout: "duration": 0 2023-08-01T19:54:55.771 INFO:teuthology.orchestra.run.smithi101.stdout: }, 2023-08-01T19:54:55.771 INFO:teuthology.orchestra.run.smithi101.stdout: { 2023-08-01T19:54:55.771 INFO:teuthology.orchestra.run.smithi101.stdout: "event": "throttled", 2023-08-01T19:54:55.771 INFO:teuthology.orchestra.run.smithi101.stdout: "time": "2023-08-01T19:54:04.458982+0000", 2023-08-01T19:54:55.772 INFO:teuthology.orchestra.run.smithi101.stdout: "duration": 0 2023-08-01T19:54:55.772 INFO:teuthology.orchestra.run.smithi101.stdout: }, 2023-08-01T19:54:55.772 INFO:teuthology.orchestra.run.smithi101.stdout: { 2023-08-01T19:54:55.772 INFO:teuthology.orchestra.run.smithi101.stdout: "event": "header_read", 2023-08-01T19:54:55.772 INFO:teuthology.orchestra.run.smithi101.stdout: "time": "2023-08-01T19:54:04.458982+0000", 2023-08-01T19:54:55.772 INFO:teuthology.orchestra.run.smithi101.stdout: "duration": 4294967295.9999995 2023-08-01T19:54:55.772 INFO:teuthology.orchestra.run.smithi101.stdout: }, 2023-08-01T19:54:55.773 INFO:teuthology.orchestra.run.smithi101.stdout: { 2023-08-01T19:54:55.773 INFO:teuthology.orchestra.run.smithi101.stdout: "event": "all_read", 2023-08-01T19:54:55.773 INFO:teuthology.orchestra.run.smithi101.stdout: "time": "2023-08-01T19:54:04.458985+0000", 2023-08-01T19:54:55.773 INFO:teuthology.orchestra.run.smithi101.stdout: "duration": 3.4800000000000001e-06 2023-08-01T19:54:55.773 INFO:teuthology.orchestra.run.smithi101.stdout: }, 2023-08-01T19:54:55.773 INFO:teuthology.orchestra.run.smithi101.stdout: { 2023-08-01T19:54:55.773 INFO:teuthology.orchestra.run.smithi101.stdout: "event": "dispatched", 2023-08-01T19:54:55.774 INFO:teuthology.orchestra.run.smithi101.stdout: "time": "2023-08-01T19:54:04.458992+0000", 2023-08-01T19:54:55.774 INFO:teuthology.orchestra.run.smithi101.stdout: "duration": 7.306e-06 2023-08-01T19:54:55.774 INFO:teuthology.orchestra.run.smithi101.stdout: }, 2023-08-01T19:54:55.774 INFO:teuthology.orchestra.run.smithi101.stdout: { 2023-08-01T19:54:55.774 INFO:teuthology.orchestra.run.smithi101.stdout: "event": "queued_for_pg", 2023-08-01T19:54:55.774 INFO:teuthology.orchestra.run.smithi101.stdout: "time": "2023-08-01T19:54:04.458997+0000", 2023-08-01T19:54:55.774 INFO:teuthology.orchestra.run.smithi101.stdout: "duration": 4.4530000000000004e-06 2023-08-01T19:54:55.775 INFO:teuthology.orchestra.run.smithi101.stdout: }, 2023-08-01T19:54:55.775 INFO:teuthology.orchestra.run.smithi101.stdout: { 2023-08-01T19:54:55.775 INFO:teuthology.orchestra.run.smithi101.stdout: "event": "reached_pg", 2023-08-01T19:54:55.775 INFO:teuthology.orchestra.run.smithi101.stdout: "time": "2023-08-01T19:54:04.459060+0000", 2023-08-01T19:54:55.775 INFO:teuthology.orchestra.run.smithi101.stdout: "duration": 6.3249000000000004e-05 2023-08-01T19:54:55.775 INFO:teuthology.orchestra.run.smithi101.stdout: }, 2023-08-01T19:54:55.775 INFO:teuthology.orchestra.run.smithi101.stdout: { 2023-08-01T19:54:55.776 INFO:teuthology.orchestra.run.smithi101.stdout: "event": "waiting_for_map not empty", 2023-08-01T19:54:55.776 INFO:teuthology.orchestra.run.smithi101.stdout: "time": "2023-08-01T19:54:04.459063+0000", 2023-08-01T19:54:55.776 INFO:teuthology.orchestra.run.smithi101.stdout: "duration": 2.717e-06 2023-08-01T19:54:55.776 INFO:teuthology.orchestra.run.smithi101.stdout: }, 2023-08-01T19:54:55.776 INFO:teuthology.orchestra.run.smithi101.stdout: { 2023-08-01T19:54:55.776 INFO:teuthology.orchestra.run.smithi101.stdout: "event": "reached_pg", 2023-08-01T19:54:55.776 INFO:teuthology.orchestra.run.smithi101.stdout: "time": "2023-08-01T19:54:04.473625+0000", 2023-08-01T19:54:55.777 INFO:teuthology.orchestra.run.smithi101.stdout: "duration": 0.014562007 2023-08-01T19:54:55.777 INFO:teuthology.orchestra.run.smithi101.stdout: }, 2023-08-01T19:54:55.777 INFO:teuthology.orchestra.run.smithi101.stdout: { 2023-08-01T19:54:55.777 INFO:teuthology.orchestra.run.smithi101.stdout: "event": "started", 2023-08-01T19:54:55.777 INFO:teuthology.orchestra.run.smithi101.stdout: "time": "2023-08-01T19:54:04.473757+0000", 2023-08-01T19:54:55.777 INFO:teuthology.orchestra.run.smithi101.stdout: "duration": 0.00013238599999999999 2023-08-01T19:54:55.777 INFO:teuthology.orchestra.run.smithi101.stdout: }, 2023-08-01T19:54:55.778 INFO:teuthology.orchestra.run.smithi101.stdout: { 2023-08-01T19:54:55.778 INFO:teuthology.orchestra.run.smithi101.stdout: "event": "waiting for subops from 2", 2023-08-01T19:54:55.778 INFO:teuthology.orchestra.run.smithi101.stdout: "time": "2023-08-01T19:54:04.473898+0000", 2023-08-01T19:54:55.778 INFO:teuthology.orchestra.run.smithi101.stdout: "duration": 0.00014039 2023-08-01T19:54:55.778 INFO:teuthology.orchestra.run.smithi101.stdout: }, 2023-08-01T19:54:55.778 INFO:teuthology.orchestra.run.smithi101.stdout: { 2023-08-01T19:54:55.778 INFO:teuthology.orchestra.run.smithi101.stdout: "event": "op_commit", 2023-08-01T19:54:55.778 INFO:teuthology.orchestra.run.smithi101.stdout: "time": "2023-08-01T19:54:04.478380+0000", 2023-08-01T19:54:55.779 INFO:teuthology.orchestra.run.smithi101.stdout: "duration": 0.0044827449999999998 2023-08-01T19:54:55.779 INFO:teuthology.orchestra.run.smithi101.stdout: }, 2023-08-01T19:54:55.779 INFO:teuthology.orchestra.run.smithi101.stdout: { 2023-08-01T19:54:55.779 INFO:teuthology.orchestra.run.smithi101.stdout: "event": "sub_op_commit_rec", 2023-08-01T19:54:55.779 INFO:teuthology.orchestra.run.smithi101.stdout: "time": "2023-08-01T19:54:04.480169+0000", 2023-08-01T19:54:55.779 INFO:teuthology.orchestra.run.smithi101.stdout: "duration": 0.0017886040000000001 2023-08-01T19:54:55.780 INFO:teuthology.orchestra.run.smithi101.stdout: }, 2023-08-01T19:54:55.780 INFO:teuthology.orchestra.run.smithi101.stdout: { 2023-08-01T19:54:55.780 INFO:teuthology.orchestra.run.smithi101.stdout: "event": "commit_sent", 2023-08-01T19:54:55.780 INFO:teuthology.orchestra.run.smithi101.stdout: "time": "2023-08-01T19:54:04.480212+0000", 2023-08-01T19:54:55.781 INFO:teuthology.orchestra.run.smithi101.stdout: "duration": 4.2687e-05 2023-08-01T19:54:55.781 INFO:teuthology.orchestra.run.smithi101.stdout: }, 2023-08-01T19:54:55.781 INFO:teuthology.orchestra.run.smithi101.stdout: { 2023-08-01T19:54:55.782 INFO:teuthology.orchestra.run.smithi101.stdout: "event": "done", 2023-08-01T19:54:55.782 INFO:teuthology.orchestra.run.smithi101.stdout: "time": "2023-08-01T19:54:04.480248+0000", 2023-08-01T19:54:55.782 INFO:teuthology.orchestra.run.smithi101.stdout: "duration": 3.6743999999999999e-05 2023-08-01T19:54:55.782 INFO:teuthology.orchestra.run.smithi101.stdout: } 2023-08-01T19:54:55.783 INFO:teuthology.orchestra.run.smithi101.stdout: ] 2023-08-01T19:54:55.783 INFO:teuthology.orchestra.run.smithi101.stdout: } 2023-08-01T19:54:55.783 INFO:teuthology.orchestra.run.smithi101.stdout: }, 2023-08-01T19:54:55.783 INFO:teuthology.orchestra.run.smithi101.stdout: { 2023-08-01T19:54:55.784 INFO:teuthology.orchestra.run.smithi101.stdout: "description": "osd_op(mds.0.3:13 3.10 3:0d89b25e:::603.00000000:head [create,setxattr parent (62) in=6b,setxattr layout (30) in=6b] snapc 0=[] ondisk+write+known_if_redirected+full_force+supports_pool_eio e17)", 2023-08-01T19:54:55.784 INFO:teuthology.orchestra.run.smithi101.stdout: "initiated_at": "2023-08-01T19:54:04.459010+0000", 2023-08-01T19:54:55.784 INFO:teuthology.orchestra.run.smithi101.stdout: "age": 51.228188907000003, 2023-08-01T19:54:55.784 INFO:teuthology.orchestra.run.smithi101.stdout: "duration": 0.021327220000000001, 2023-08-01T19:54:55.785 INFO:teuthology.orchestra.run.smithi101.stdout: "type_data": { 2023-08-01T19:54:55.785 INFO:teuthology.orchestra.run.smithi101.stdout: "flag_point": "commit sent; apply or cleanup", 2023-08-01T19:54:55.785 INFO:teuthology.orchestra.run.smithi101.stdout: "events": [ 2023-08-01T19:54:55.785 INFO:teuthology.orchestra.run.smithi101.stdout: { 2023-08-01T19:54:55.785 INFO:teuthology.orchestra.run.smithi101.stdout: "event": "initiated", 2023-08-01T19:54:55.785 INFO:teuthology.orchestra.run.smithi101.stdout: "time": "2023-08-01T19:54:04.459010+0000", 2023-08-01T19:54:55.785 INFO:teuthology.orchestra.run.smithi101.stdout: "duration": 0 2023-08-01T19:54:55.785 INFO:teuthology.orchestra.run.smithi101.stdout: }, 2023-08-01T19:54:55.786 INFO:teuthology.orchestra.run.smithi101.stdout: { 2023-08-01T19:54:55.786 INFO:teuthology.orchestra.run.smithi101.stdout: "event": "throttled", 2023-08-01T19:54:55.786 INFO:teuthology.orchestra.run.smithi101.stdout: "time": "2023-08-01T19:54:04.459010+0000", 2023-08-01T19:54:55.786 INFO:teuthology.orchestra.run.smithi101.stdout: "duration": 0 2023-08-01T19:54:55.786 INFO:teuthology.orchestra.run.smithi101.stdout: }, 2023-08-01T19:54:55.786 INFO:teuthology.orchestra.run.smithi101.stdout: { 2023-08-01T19:54:55.786 INFO:teuthology.orchestra.run.smithi101.stdout: "event": "header_read", 2023-08-01T19:54:55.787 INFO:teuthology.orchestra.run.smithi101.stdout: "time": "2023-08-01T19:54:04.459009+0000", 2023-08-01T19:54:55.787 INFO:teuthology.orchestra.run.smithi101.stdout: "duration": 4294967295.9999995 2023-08-01T19:54:55.787 INFO:teuthology.orchestra.run.smithi101.stdout: }, 2023-08-01T19:54:55.787 INFO:teuthology.orchestra.run.smithi101.stdout: { 2023-08-01T19:54:55.787 INFO:teuthology.orchestra.run.smithi101.stdout: "event": "all_read", 2023-08-01T19:54:55.787 INFO:teuthology.orchestra.run.smithi101.stdout: "time": "2023-08-01T19:54:04.459013+0000", 2023-08-01T19:54:55.787 INFO:teuthology.orchestra.run.smithi101.stdout: "duration": 3.8929999999999998e-06 2023-08-01T19:54:55.788 INFO:teuthology.orchestra.run.smithi101.stdout: }, 2023-08-01T19:54:55.788 INFO:teuthology.orchestra.run.smithi101.stdout: { 2023-08-01T19:54:55.788 INFO:teuthology.orchestra.run.smithi101.stdout: "event": "dispatched", 2023-08-01T19:54:55.788 INFO:teuthology.orchestra.run.smithi101.stdout: "time": "2023-08-01T19:54:04.459027+0000", 2023-08-01T19:54:55.788 INFO:teuthology.orchestra.run.smithi101.stdout: "duration": 1.3416e-05 2023-08-01T19:54:55.788 INFO:teuthology.orchestra.run.smithi101.stdout: }, 2023-08-01T19:54:55.788 INFO:teuthology.orchestra.run.smithi101.stdout: { 2023-08-01T19:54:55.789 INFO:teuthology.orchestra.run.smithi101.stdout: "event": "queued_for_pg", 2023-08-01T19:54:55.789 INFO:teuthology.orchestra.run.smithi101.stdout: "time": "2023-08-01T19:54:04.459033+0000", 2023-08-01T19:54:55.789 INFO:teuthology.orchestra.run.smithi101.stdout: "duration": 5.9800000000000003e-06 2023-08-01T19:54:55.789 INFO:teuthology.orchestra.run.smithi101.stdout: }, 2023-08-01T19:54:55.789 INFO:teuthology.orchestra.run.smithi101.stdout: { 2023-08-01T19:54:55.789 INFO:teuthology.orchestra.run.smithi101.stdout: "event": "reached_pg", 2023-08-01T19:54:55.789 INFO:teuthology.orchestra.run.smithi101.stdout: "time": "2023-08-01T19:54:04.459099+0000", 2023-08-01T19:54:55.790 INFO:teuthology.orchestra.run.smithi101.stdout: "duration": 6.6192999999999995e-05 2023-08-01T19:54:55.790 INFO:teuthology.orchestra.run.smithi101.stdout: }, 2023-08-01T19:54:55.790 INFO:teuthology.orchestra.run.smithi101.stdout: { 2023-08-01T19:54:55.790 INFO:teuthology.orchestra.run.smithi101.stdout: "event": "waiting_for_map not empty", 2023-08-01T19:54:55.790 INFO:teuthology.orchestra.run.smithi101.stdout: "time": "2023-08-01T19:54:04.459106+0000", 2023-08-01T19:54:55.790 INFO:teuthology.orchestra.run.smithi101.stdout: "duration": 6.8619999999999997e-06 2023-08-01T19:54:55.790 INFO:teuthology.orchestra.run.smithi101.stdout: }, 2023-08-01T19:54:55.791 INFO:teuthology.orchestra.run.smithi101.stdout: { 2023-08-01T19:54:55.791 INFO:teuthology.orchestra.run.smithi101.stdout: "event": "reached_pg", 2023-08-01T19:54:55.791 INFO:teuthology.orchestra.run.smithi101.stdout: "time": "2023-08-01T19:54:04.475182+0000", 2023-08-01T19:54:55.791 INFO:teuthology.orchestra.run.smithi101.stdout: "duration": 0.016076333000000002 2023-08-01T19:54:55.791 INFO:teuthology.orchestra.run.smithi101.stdout: }, 2023-08-01T19:54:55.791 INFO:teuthology.orchestra.run.smithi101.stdout: { 2023-08-01T19:54:55.791 INFO:teuthology.orchestra.run.smithi101.stdout: "event": "started", 2023-08-01T19:54:55.792 INFO:teuthology.orchestra.run.smithi101.stdout: "time": "2023-08-01T19:54:04.475353+0000", 2023-08-01T19:54:55.792 INFO:teuthology.orchestra.run.smithi101.stdout: "duration": 0.000171378 2023-08-01T19:54:55.792 INFO:teuthology.orchestra.run.smithi101.stdout: }, 2023-08-01T19:54:55.792 INFO:teuthology.orchestra.run.smithi101.stdout: { 2023-08-01T19:54:55.792 INFO:teuthology.orchestra.run.smithi101.stdout: "event": "waiting for subops from 2", 2023-08-01T19:54:55.792 INFO:teuthology.orchestra.run.smithi101.stdout: "time": "2023-08-01T19:54:04.475793+0000", 2023-08-01T19:54:55.792 INFO:teuthology.orchestra.run.smithi101.stdout: "duration": 0.000440123 2023-08-01T19:54:55.793 INFO:teuthology.orchestra.run.smithi101.stdout: }, 2023-08-01T19:54:55.793 INFO:teuthology.orchestra.run.smithi101.stdout: { 2023-08-01T19:54:55.793 INFO:teuthology.orchestra.run.smithi101.stdout: "event": "op_commit", 2023-08-01T19:54:55.793 INFO:teuthology.orchestra.run.smithi101.stdout: "time": "2023-08-01T19:54:04.478624+0000", 2023-08-01T19:54:55.793 INFO:teuthology.orchestra.run.smithi101.stdout: "duration": 0.0028305000000000001 2023-08-01T19:54:55.793 INFO:teuthology.orchestra.run.smithi101.stdout: }, 2023-08-01T19:54:55.793 INFO:teuthology.orchestra.run.smithi101.stdout: { 2023-08-01T19:54:55.793 INFO:teuthology.orchestra.run.smithi101.stdout: "event": "sub_op_commit_rec", 2023-08-01T19:54:55.794 INFO:teuthology.orchestra.run.smithi101.stdout: "time": "2023-08-01T19:54:04.480291+0000", 2023-08-01T19:54:55.794 INFO:teuthology.orchestra.run.smithi101.stdout: "duration": 0.0016670000000000001 2023-08-01T19:54:55.794 INFO:teuthology.orchestra.run.smithi101.stdout: }, 2023-08-01T19:54:55.794 INFO:teuthology.orchestra.run.smithi101.stdout: { 2023-08-01T19:54:55.794 INFO:teuthology.orchestra.run.smithi101.stdout: "event": "commit_sent", 2023-08-01T19:54:55.794 INFO:teuthology.orchestra.run.smithi101.stdout: "time": "2023-08-01T19:54:04.480318+0000", 2023-08-01T19:54:55.794 INFO:teuthology.orchestra.run.smithi101.stdout: "duration": 2.6815e-05 2023-08-01T19:54:55.795 INFO:teuthology.orchestra.run.smithi101.stdout: }, 2023-08-01T19:54:55.795 INFO:teuthology.orchestra.run.smithi101.stdout: { 2023-08-01T19:54:55.795 INFO:teuthology.orchestra.run.smithi101.stdout: "event": "done", 2023-08-01T19:54:55.795 INFO:teuthology.orchestra.run.smithi101.stdout: "time": "2023-08-01T19:54:04.480337+0000", 2023-08-01T19:54:55.795 INFO:teuthology.orchestra.run.smithi101.stdout: "duration": 1.9241000000000001e-05 2023-08-01T19:54:55.795 INFO:teuthology.orchestra.run.smithi101.stdout: } 2023-08-01T19:54:55.795 INFO:teuthology.orchestra.run.smithi101.stdout: ] 2023-08-01T19:54:55.796 INFO:teuthology.orchestra.run.smithi101.stdout: } 2023-08-01T19:54:55.796 INFO:teuthology.orchestra.run.smithi101.stdout: }, 2023-08-01T19:54:55.796 INFO:teuthology.orchestra.run.smithi101.stdout: { 2023-08-01T19:54:55.796 INFO:teuthology.orchestra.run.smithi101.stdout: "description": "osd_op(mds.0.3:18 3.14 3:2f55791f:::606.00000000:head [omap-set-header] snapc 0=[] ondisk+write+known_if_redirected+full_force+supports_pool_eio e17)", 2023-08-01T19:54:55.796 INFO:teuthology.orchestra.run.smithi101.stdout: "initiated_at": "2023-08-01T19:54:04.459039+0000", 2023-08-01T19:54:55.796 INFO:teuthology.orchestra.run.smithi101.stdout: "age": 51.228159613000003, 2023-08-01T19:54:55.796 INFO:teuthology.orchestra.run.smithi101.stdout: "duration": 0.018756419, 2023-08-01T19:54:55.797 INFO:teuthology.orchestra.run.smithi101.stdout: "type_data": { 2023-08-01T19:54:55.797 INFO:teuthology.orchestra.run.smithi101.stdout: "flag_point": "commit sent; apply or cleanup", 2023-08-01T19:54:55.797 INFO:teuthology.orchestra.run.smithi101.stdout: "events": [ 2023-08-01T19:54:55.797 INFO:teuthology.orchestra.run.smithi101.stdout: { 2023-08-01T19:54:55.797 INFO:teuthology.orchestra.run.smithi101.stdout: "event": "initiated", 2023-08-01T19:54:55.797 INFO:teuthology.orchestra.run.smithi101.stdout: "time": "2023-08-01T19:54:04.459039+0000", 2023-08-01T19:54:55.797 INFO:teuthology.orchestra.run.smithi101.stdout: "duration": 0 2023-08-01T19:54:55.798 INFO:teuthology.orchestra.run.smithi101.stdout: }, 2023-08-01T19:54:55.798 INFO:teuthology.orchestra.run.smithi101.stdout: { 2023-08-01T19:54:55.798 INFO:teuthology.orchestra.run.smithi101.stdout: "event": "throttled", 2023-08-01T19:54:55.798 INFO:teuthology.orchestra.run.smithi101.stdout: "time": "2023-08-01T19:54:04.459039+0000", 2023-08-01T19:54:55.798 INFO:teuthology.orchestra.run.smithi101.stdout: "duration": 0 2023-08-01T19:54:55.798 INFO:teuthology.orchestra.run.smithi101.stdout: }, 2023-08-01T19:54:55.798 INFO:teuthology.orchestra.run.smithi101.stdout: { 2023-08-01T19:54:55.798 INFO:teuthology.orchestra.run.smithi101.stdout: "event": "header_read", 2023-08-01T19:54:55.799 INFO:teuthology.orchestra.run.smithi101.stdout: "time": "2023-08-01T19:54:04.459039+0000", 2023-08-01T19:54:55.799 INFO:teuthology.orchestra.run.smithi101.stdout: "duration": 4294967295.9999995 2023-08-01T19:54:55.799 INFO:teuthology.orchestra.run.smithi101.stdout: }, 2023-08-01T19:54:55.799 INFO:teuthology.orchestra.run.smithi101.stdout: { 2023-08-01T19:54:55.799 INFO:teuthology.orchestra.run.smithi101.stdout: "event": "all_read", 2023-08-01T19:54:55.799 INFO:teuthology.orchestra.run.smithi101.stdout: "time": "2023-08-01T19:54:04.459043+0000", 2023-08-01T19:54:55.799 INFO:teuthology.orchestra.run.smithi101.stdout: "duration": 4.1500000000000001e-06 2023-08-01T19:54:55.800 INFO:teuthology.orchestra.run.smithi101.stdout: }, 2023-08-01T19:54:55.800 INFO:teuthology.orchestra.run.smithi101.stdout: { 2023-08-01T19:54:55.800 INFO:teuthology.orchestra.run.smithi101.stdout: "event": "dispatched", 2023-08-01T19:54:55.800 INFO:teuthology.orchestra.run.smithi101.stdout: "time": "2023-08-01T19:54:04.459051+0000", 2023-08-01T19:54:55.800 INFO:teuthology.orchestra.run.smithi101.stdout: "duration": 8.4190000000000002e-06 2023-08-01T19:54:55.800 INFO:teuthology.orchestra.run.smithi101.stdout: }, 2023-08-01T19:54:55.801 INFO:teuthology.orchestra.run.smithi101.stdout: { 2023-08-01T19:54:55.801 INFO:teuthology.orchestra.run.smithi101.stdout: "event": "queued_for_pg", 2023-08-01T19:54:55.801 INFO:teuthology.orchestra.run.smithi101.stdout: "time": "2023-08-01T19:54:04.459056+0000", 2023-08-01T19:54:55.801 INFO:teuthology.orchestra.run.smithi101.stdout: "duration": 5.339e-06 2023-08-01T19:54:55.801 INFO:teuthology.orchestra.run.smithi101.stdout: }, 2023-08-01T19:54:55.801 INFO:teuthology.orchestra.run.smithi101.stdout: { 2023-08-01T19:54:55.801 INFO:teuthology.orchestra.run.smithi101.stdout: "event": "reached_pg", 2023-08-01T19:54:55.802 INFO:teuthology.orchestra.run.smithi101.stdout: "time": "2023-08-01T19:54:04.459091+0000", 2023-08-01T19:54:55.802 INFO:teuthology.orchestra.run.smithi101.stdout: "duration": 3.4090000000000001e-05 2023-08-01T19:54:55.802 INFO:teuthology.orchestra.run.smithi101.stdout: }, 2023-08-01T19:54:55.802 INFO:teuthology.orchestra.run.smithi101.stdout: { 2023-08-01T19:54:55.802 INFO:teuthology.orchestra.run.smithi101.stdout: "event": "op must wait for map", 2023-08-01T19:54:55.802 INFO:teuthology.orchestra.run.smithi101.stdout: "time": "2023-08-01T19:54:04.459094+0000", 2023-08-01T19:54:55.802 INFO:teuthology.orchestra.run.smithi101.stdout: "duration": 3.303e-06 2023-08-01T19:54:55.803 INFO:teuthology.orchestra.run.smithi101.stdout: }, 2023-08-01T19:54:55.803 INFO:teuthology.orchestra.run.smithi101.stdout: { 2023-08-01T19:54:55.803 INFO:teuthology.orchestra.run.smithi101.stdout: "event": "reached_pg", 2023-08-01T19:54:55.803 INFO:teuthology.orchestra.run.smithi101.stdout: "time": "2023-08-01T19:54:04.469860+0000", 2023-08-01T19:54:55.803 INFO:teuthology.orchestra.run.smithi101.stdout: "duration": 0.010765749 2023-08-01T19:54:55.803 INFO:teuthology.orchestra.run.smithi101.stdout: }, 2023-08-01T19:54:55.803 INFO:teuthology.orchestra.run.smithi101.stdout: { 2023-08-01T19:54:55.804 INFO:teuthology.orchestra.run.smithi101.stdout: "event": "started", 2023-08-01T19:54:55.804 INFO:teuthology.orchestra.run.smithi101.stdout: "time": "2023-08-01T19:54:04.470008+0000", 2023-08-01T19:54:55.804 INFO:teuthology.orchestra.run.smithi101.stdout: "duration": 0.000148367 2023-08-01T19:54:55.804 INFO:teuthology.orchestra.run.smithi101.stdout: }, 2023-08-01T19:54:55.804 INFO:teuthology.orchestra.run.smithi101.stdout: { 2023-08-01T19:54:55.804 INFO:teuthology.orchestra.run.smithi101.stdout: "event": "waiting for subops from 2", 2023-08-01T19:54:55.805 INFO:teuthology.orchestra.run.smithi101.stdout: "time": "2023-08-01T19:54:04.470136+0000", 2023-08-01T19:54:55.805 INFO:teuthology.orchestra.run.smithi101.stdout: "duration": 0.000128329 2023-08-01T19:54:55.805 INFO:teuthology.orchestra.run.smithi101.stdout: }, 2023-08-01T19:54:55.805 INFO:teuthology.orchestra.run.smithi101.stdout: { 2023-08-01T19:54:55.805 INFO:teuthology.orchestra.run.smithi101.stdout: "event": "op_commit", 2023-08-01T19:54:55.805 INFO:teuthology.orchestra.run.smithi101.stdout: "time": "2023-08-01T19:54:04.476399+0000", 2023-08-01T19:54:55.805 INFO:teuthology.orchestra.run.smithi101.stdout: "duration": 0.0062627259999999997 2023-08-01T19:54:55.806 INFO:teuthology.orchestra.run.smithi101.stdout: }, 2023-08-01T19:54:55.806 INFO:teuthology.orchestra.run.smithi101.stdout: { 2023-08-01T19:54:55.806 INFO:teuthology.orchestra.run.smithi101.stdout: "event": "sub_op_commit_rec", 2023-08-01T19:54:55.806 INFO:teuthology.orchestra.run.smithi101.stdout: "time": "2023-08-01T19:54:04.477726+0000", 2023-08-01T19:54:55.806 INFO:teuthology.orchestra.run.smithi101.stdout: "duration": 0.001327103 2023-08-01T19:54:55.806 INFO:teuthology.orchestra.run.smithi101.stdout: }, 2023-08-01T19:54:55.806 INFO:teuthology.orchestra.run.smithi101.stdout: { 2023-08-01T19:54:55.807 INFO:teuthology.orchestra.run.smithi101.stdout: "event": "commit_sent", 2023-08-01T19:54:55.807 INFO:teuthology.orchestra.run.smithi101.stdout: "time": "2023-08-01T19:54:04.477771+0000", 2023-08-01T19:54:55.807 INFO:teuthology.orchestra.run.smithi101.stdout: "duration": 4.5232000000000003e-05 2023-08-01T19:54:55.807 INFO:teuthology.orchestra.run.smithi101.stdout: }, 2023-08-01T19:54:55.807 INFO:teuthology.orchestra.run.smithi101.stdout: { 2023-08-01T19:54:55.807 INFO:teuthology.orchestra.run.smithi101.stdout: "event": "done", 2023-08-01T19:54:55.807 INFO:teuthology.orchestra.run.smithi101.stdout: "time": "2023-08-01T19:54:04.477795+0000", 2023-08-01T19:54:55.808 INFO:teuthology.orchestra.run.smithi101.stdout: "duration": 2.4134999999999998e-05 2023-08-01T19:54:55.808 INFO:teuthology.orchestra.run.smithi101.stdout: } 2023-08-01T19:54:55.808 INFO:teuthology.orchestra.run.smithi101.stdout: ] 2023-08-01T19:54:55.808 INFO:teuthology.orchestra.run.smithi101.stdout: } 2023-08-01T19:54:55.808 INFO:teuthology.orchestra.run.smithi101.stdout: }, 2023-08-01T19:54:55.808 INFO:teuthology.orchestra.run.smithi101.stdout: { 2023-08-01T19:54:55.808 INFO:teuthology.orchestra.run.smithi101.stdout: "description": "osd_op(mds.0.3:19 3.14 3:2f55791f:::606.00000000:head [create,setxattr parent (62) in=6b,setxattr layout (30) in=6b] snapc 0=[] ondisk+write+known_if_redirected+full_force+supports_pool_eio e17)", 2023-08-01T19:54:55.809 INFO:teuthology.orchestra.run.smithi101.stdout: "initiated_at": "2023-08-01T19:54:04.459069+0000", 2023-08-01T19:54:55.809 INFO:teuthology.orchestra.run.smithi101.stdout: "age": 51.228129578000001, 2023-08-01T19:54:55.809 INFO:teuthology.orchestra.run.smithi101.stdout: "duration": 0.019523045999999999, 2023-08-01T19:54:55.809 INFO:teuthology.orchestra.run.smithi101.stdout: "type_data": { 2023-08-01T19:54:55.809 INFO:teuthology.orchestra.run.smithi101.stdout: "flag_point": "commit sent; apply or cleanup", 2023-08-01T19:54:55.809 INFO:teuthology.orchestra.run.smithi101.stdout: "events": [ 2023-08-01T19:54:55.809 INFO:teuthology.orchestra.run.smithi101.stdout: { 2023-08-01T19:54:55.810 INFO:teuthology.orchestra.run.smithi101.stdout: "event": "initiated", 2023-08-01T19:54:55.810 INFO:teuthology.orchestra.run.smithi101.stdout: "time": "2023-08-01T19:54:04.459069+0000", 2023-08-01T19:54:55.810 INFO:teuthology.orchestra.run.smithi101.stdout: "duration": 0 2023-08-01T19:54:55.810 INFO:teuthology.orchestra.run.smithi101.stdout: }, 2023-08-01T19:54:55.810 INFO:teuthology.orchestra.run.smithi101.stdout: { 2023-08-01T19:54:55.810 INFO:teuthology.orchestra.run.smithi101.stdout: "event": "throttled", 2023-08-01T19:54:55.810 INFO:teuthology.orchestra.run.smithi101.stdout: "time": "2023-08-01T19:54:04.459069+0000", 2023-08-01T19:54:55.811 INFO:teuthology.orchestra.run.smithi101.stdout: "duration": 0 2023-08-01T19:54:55.811 INFO:teuthology.orchestra.run.smithi101.stdout: }, 2023-08-01T19:54:55.811 INFO:teuthology.orchestra.run.smithi101.stdout: { 2023-08-01T19:54:55.811 INFO:teuthology.orchestra.run.smithi101.stdout: "event": "header_read", 2023-08-01T19:54:55.811 INFO:teuthology.orchestra.run.smithi101.stdout: "time": "2023-08-01T19:54:04.459069+0000", 2023-08-01T19:54:55.811 INFO:teuthology.orchestra.run.smithi101.stdout: "duration": 4294967295.9999995 2023-08-01T19:54:55.811 INFO:teuthology.orchestra.run.smithi101.stdout: }, 2023-08-01T19:54:55.811 INFO:teuthology.orchestra.run.smithi101.stdout: { 2023-08-01T19:54:55.812 INFO:teuthology.orchestra.run.smithi101.stdout: "event": "all_read", 2023-08-01T19:54:55.812 INFO:teuthology.orchestra.run.smithi101.stdout: "time": "2023-08-01T19:54:04.459072+0000", 2023-08-01T19:54:55.812 INFO:teuthology.orchestra.run.smithi101.stdout: "duration": 3.4570000000000001e-06 2023-08-01T19:54:55.812 INFO:teuthology.orchestra.run.smithi101.stdout: }, 2023-08-01T19:54:55.812 INFO:teuthology.orchestra.run.smithi101.stdout: { 2023-08-01T19:54:55.812 INFO:teuthology.orchestra.run.smithi101.stdout: "event": "dispatched", 2023-08-01T19:54:55.812 INFO:teuthology.orchestra.run.smithi101.stdout: "time": "2023-08-01T19:54:04.459080+0000", 2023-08-01T19:54:55.813 INFO:teuthology.orchestra.run.smithi101.stdout: "duration": 7.6009999999999997e-06 2023-08-01T19:54:55.813 INFO:teuthology.orchestra.run.smithi101.stdout: }, 2023-08-01T19:54:55.813 INFO:teuthology.orchestra.run.smithi101.stdout: { 2023-08-01T19:54:55.813 INFO:teuthology.orchestra.run.smithi101.stdout: "event": "queued_for_pg", 2023-08-01T19:54:55.813 INFO:teuthology.orchestra.run.smithi101.stdout: "time": "2023-08-01T19:54:04.459088+0000", 2023-08-01T19:54:55.813 INFO:teuthology.orchestra.run.smithi101.stdout: "duration": 8.0509999999999997e-06 2023-08-01T19:54:55.813 INFO:teuthology.orchestra.run.smithi101.stdout: }, 2023-08-01T19:54:55.814 INFO:teuthology.orchestra.run.smithi101.stdout: { 2023-08-01T19:54:55.814 INFO:teuthology.orchestra.run.smithi101.stdout: "event": "reached_pg", 2023-08-01T19:54:55.814 INFO:teuthology.orchestra.run.smithi101.stdout: "time": "2023-08-01T19:54:04.459120+0000", 2023-08-01T19:54:55.814 INFO:teuthology.orchestra.run.smithi101.stdout: "duration": 3.2078e-05 2023-08-01T19:54:55.814 INFO:teuthology.orchestra.run.smithi101.stdout: }, 2023-08-01T19:54:55.814 INFO:teuthology.orchestra.run.smithi101.stdout: { 2023-08-01T19:54:55.814 INFO:teuthology.orchestra.run.smithi101.stdout: "event": "waiting_for_map not empty", 2023-08-01T19:54:55.815 INFO:teuthology.orchestra.run.smithi101.stdout: "time": "2023-08-01T19:54:04.459123+0000", 2023-08-01T19:54:55.815 INFO:teuthology.orchestra.run.smithi101.stdout: "duration": 3.4699999999999998e-06 2023-08-01T19:54:55.815 INFO:teuthology.orchestra.run.smithi101.stdout: }, 2023-08-01T19:54:55.815 INFO:teuthology.orchestra.run.smithi101.stdout: { 2023-08-01T19:54:55.815 INFO:teuthology.orchestra.run.smithi101.stdout: "event": "reached_pg", 2023-08-01T19:54:55.815 INFO:teuthology.orchestra.run.smithi101.stdout: "time": "2023-08-01T19:54:04.471352+0000", 2023-08-01T19:54:55.815 INFO:teuthology.orchestra.run.smithi101.stdout: "duration": 0.01222926 2023-08-01T19:54:55.816 INFO:teuthology.orchestra.run.smithi101.stdout: }, 2023-08-01T19:54:55.816 INFO:teuthology.orchestra.run.smithi101.stdout: { 2023-08-01T19:54:55.816 INFO:teuthology.orchestra.run.smithi101.stdout: "event": "started", 2023-08-01T19:54:55.816 INFO:teuthology.orchestra.run.smithi101.stdout: "time": "2023-08-01T19:54:04.471495+0000", 2023-08-01T19:54:55.816 INFO:teuthology.orchestra.run.smithi101.stdout: "duration": 0.00014263899999999999 2023-08-01T19:54:55.816 INFO:teuthology.orchestra.run.smithi101.stdout: }, 2023-08-01T19:54:55.817 INFO:teuthology.orchestra.run.smithi101.stdout: { 2023-08-01T19:54:55.817 INFO:teuthology.orchestra.run.smithi101.stdout: "event": "waiting for subops from 2", 2023-08-01T19:54:55.817 INFO:teuthology.orchestra.run.smithi101.stdout: "time": "2023-08-01T19:54:04.472368+0000", 2023-08-01T19:54:55.817 INFO:teuthology.orchestra.run.smithi101.stdout: "duration": 0.00087245300000000003 2023-08-01T19:54:55.817 INFO:teuthology.orchestra.run.smithi101.stdout: }, 2023-08-01T19:54:55.817 INFO:teuthology.orchestra.run.smithi101.stdout: { 2023-08-01T19:54:55.817 INFO:teuthology.orchestra.run.smithi101.stdout: "event": "op_commit", 2023-08-01T19:54:55.817 INFO:teuthology.orchestra.run.smithi101.stdout: "time": "2023-08-01T19:54:04.477612+0000", 2023-08-01T19:54:55.818 INFO:teuthology.orchestra.run.smithi101.stdout: "duration": 0.0052442809999999999 2023-08-01T19:54:55.818 INFO:teuthology.orchestra.run.smithi101.stdout: }, 2023-08-01T19:54:55.818 INFO:teuthology.orchestra.run.smithi101.stdout: { 2023-08-01T19:54:55.818 INFO:teuthology.orchestra.run.smithi101.stdout: "event": "sub_op_commit_rec", 2023-08-01T19:54:55.818 INFO:teuthology.orchestra.run.smithi101.stdout: "time": "2023-08-01T19:54:04.478516+0000", 2023-08-01T19:54:55.818 INFO:teuthology.orchestra.run.smithi101.stdout: "duration": 0.00090399800000000004 2023-08-01T19:54:55.818 INFO:teuthology.orchestra.run.smithi101.stdout: }, 2023-08-01T19:54:55.819 INFO:teuthology.orchestra.run.smithi101.stdout: { 2023-08-01T19:54:55.819 INFO:teuthology.orchestra.run.smithi101.stdout: "event": "commit_sent", 2023-08-01T19:54:55.819 INFO:teuthology.orchestra.run.smithi101.stdout: "time": "2023-08-01T19:54:04.478555+0000", 2023-08-01T19:54:55.819 INFO:teuthology.orchestra.run.smithi101.stdout: "duration": 3.8977000000000003e-05 2023-08-01T19:54:55.819 INFO:teuthology.orchestra.run.smithi101.stdout: }, 2023-08-01T19:54:55.819 INFO:teuthology.orchestra.run.smithi101.stdout: { 2023-08-01T19:54:55.819 INFO:teuthology.orchestra.run.smithi101.stdout: "event": "done", 2023-08-01T19:54:55.820 INFO:teuthology.orchestra.run.smithi101.stdout: "time": "2023-08-01T19:54:04.478592+0000", 2023-08-01T19:54:55.820 INFO:teuthology.orchestra.run.smithi101.stdout: "duration": 3.7287999999999999e-05 2023-08-01T19:54:55.820 INFO:teuthology.orchestra.run.smithi101.stdout: } 2023-08-01T19:54:55.820 INFO:teuthology.orchestra.run.smithi101.stdout: ] 2023-08-01T19:54:55.820 INFO:teuthology.orchestra.run.smithi101.stdout: } 2023-08-01T19:54:55.820 INFO:teuthology.orchestra.run.smithi101.stdout: }, 2023-08-01T19:54:55.820 INFO:teuthology.orchestra.run.smithi101.stdout: { 2023-08-01T19:54:55.821 INFO:teuthology.orchestra.run.smithi101.stdout: "description": "osd_op(mds.0.3:20 3.1c 3:3ed09add:::607.00000000:head [omap-set-header] snapc 0=[] ondisk+write+known_if_redirected+full_force+supports_pool_eio e17)", 2023-08-01T19:54:55.821 INFO:teuthology.orchestra.run.smithi101.stdout: "initiated_at": "2023-08-01T19:54:04.459097+0000", 2023-08-01T19:54:55.821 INFO:teuthology.orchestra.run.smithi101.stdout: "age": 51.228101873999996, 2023-08-01T19:54:55.821 INFO:teuthology.orchestra.run.smithi101.stdout: "duration": 0.018578978999999999, 2023-08-01T19:54:55.822 INFO:teuthology.orchestra.run.smithi101.stdout: "type_data": { 2023-08-01T19:54:55.822 INFO:teuthology.orchestra.run.smithi101.stdout: "flag_point": "commit sent; apply or cleanup", 2023-08-01T19:54:55.822 INFO:teuthology.orchestra.run.smithi101.stdout: "events": [ 2023-08-01T19:54:55.822 INFO:teuthology.orchestra.run.smithi101.stdout: { 2023-08-01T19:54:55.822 INFO:teuthology.orchestra.run.smithi101.stdout: "event": "initiated", 2023-08-01T19:54:55.822 INFO:teuthology.orchestra.run.smithi101.stdout: "time": "2023-08-01T19:54:04.459097+0000", 2023-08-01T19:54:55.823 INFO:teuthology.orchestra.run.smithi101.stdout: "duration": 0 2023-08-01T19:54:55.823 INFO:teuthology.orchestra.run.smithi101.stdout: }, 2023-08-01T19:54:55.823 INFO:teuthology.orchestra.run.smithi101.stdout: { 2023-08-01T19:54:55.823 INFO:teuthology.orchestra.run.smithi101.stdout: "event": "throttled", 2023-08-01T19:54:55.824 INFO:teuthology.orchestra.run.smithi101.stdout: "time": "2023-08-01T19:54:04.459097+0000", 2023-08-01T19:54:55.824 INFO:teuthology.orchestra.run.smithi101.stdout: "duration": 0 2023-08-01T19:54:55.824 INFO:teuthology.orchestra.run.smithi101.stdout: }, 2023-08-01T19:54:55.824 INFO:teuthology.orchestra.run.smithi101.stdout: { 2023-08-01T19:54:55.824 INFO:teuthology.orchestra.run.smithi101.stdout: "event": "header_read", 2023-08-01T19:54:55.824 INFO:teuthology.orchestra.run.smithi101.stdout: "time": "2023-08-01T19:54:04.459096+0000", 2023-08-01T19:54:55.825 INFO:teuthology.orchestra.run.smithi101.stdout: "duration": 4294967295.9999995 2023-08-01T19:54:55.825 INFO:teuthology.orchestra.run.smithi101.stdout: }, 2023-08-01T19:54:55.825 INFO:teuthology.orchestra.run.smithi101.stdout: { 2023-08-01T19:54:55.825 INFO:teuthology.orchestra.run.smithi101.stdout: "event": "all_read", 2023-08-01T19:54:55.826 INFO:teuthology.orchestra.run.smithi101.stdout: "time": "2023-08-01T19:54:04.459105+0000", 2023-08-01T19:54:55.826 INFO:teuthology.orchestra.run.smithi101.stdout: "duration": 8.8259999999999999e-06 2023-08-01T19:54:55.826 INFO:teuthology.orchestra.run.smithi101.stdout: }, 2023-08-01T19:54:55.826 INFO:teuthology.orchestra.run.smithi101.stdout: { 2023-08-01T19:54:55.826 INFO:teuthology.orchestra.run.smithi101.stdout: "event": "dispatched", 2023-08-01T19:54:55.826 INFO:teuthology.orchestra.run.smithi101.stdout: "time": "2023-08-01T19:54:04.459112+0000", 2023-08-01T19:54:55.826 INFO:teuthology.orchestra.run.smithi101.stdout: "duration": 6.6660000000000002e-06 2023-08-01T19:54:55.827 INFO:teuthology.orchestra.run.smithi101.stdout: }, 2023-08-01T19:54:55.827 INFO:teuthology.orchestra.run.smithi101.stdout: { 2023-08-01T19:54:55.827 INFO:teuthology.orchestra.run.smithi101.stdout: "event": "queued_for_pg", 2023-08-01T19:54:55.827 INFO:teuthology.orchestra.run.smithi101.stdout: "time": "2023-08-01T19:54:04.459116+0000", 2023-08-01T19:54:55.828 INFO:teuthology.orchestra.run.smithi101.stdout: "duration": 4.2209999999999999e-06 2023-08-01T19:54:55.828 INFO:teuthology.orchestra.run.smithi101.stdout: }, 2023-08-01T19:54:55.828 INFO:teuthology.orchestra.run.smithi101.stdout: { 2023-08-01T19:54:55.828 INFO:teuthology.orchestra.run.smithi101.stdout: "event": "reached_pg", 2023-08-01T19:54:55.828 INFO:teuthology.orchestra.run.smithi101.stdout: "time": "2023-08-01T19:54:04.459141+0000", 2023-08-01T19:54:55.829 INFO:teuthology.orchestra.run.smithi101.stdout: "duration": 2.4627e-05 2023-08-01T19:54:55.829 INFO:teuthology.orchestra.run.smithi101.stdout: }, 2023-08-01T19:54:55.829 INFO:teuthology.orchestra.run.smithi101.stdout: { 2023-08-01T19:54:55.829 INFO:teuthology.orchestra.run.smithi101.stdout: "event": "op must wait for map", 2023-08-01T19:54:55.829 INFO:teuthology.orchestra.run.smithi101.stdout: "time": "2023-08-01T19:54:04.459144+0000", 2023-08-01T19:54:55.829 INFO:teuthology.orchestra.run.smithi101.stdout: "duration": 3.6559999999999998e-06 2023-08-01T19:54:55.830 INFO:teuthology.orchestra.run.smithi101.stdout: }, 2023-08-01T19:54:55.830 INFO:teuthology.orchestra.run.smithi101.stdout: { 2023-08-01T19:54:55.830 INFO:teuthology.orchestra.run.smithi101.stdout: "event": "reached_pg", 2023-08-01T19:54:55.830 INFO:teuthology.orchestra.run.smithi101.stdout: "time": "2023-08-01T19:54:04.468086+0000", 2023-08-01T19:54:55.830 INFO:teuthology.orchestra.run.smithi101.stdout: "duration": 0.0089415569999999993 2023-08-01T19:54:55.830 INFO:teuthology.orchestra.run.smithi101.stdout: }, 2023-08-01T19:54:55.830 INFO:teuthology.orchestra.run.smithi101.stdout: { 2023-08-01T19:54:55.831 INFO:teuthology.orchestra.run.smithi101.stdout: "event": "started", 2023-08-01T19:54:55.831 INFO:teuthology.orchestra.run.smithi101.stdout: "time": "2023-08-01T19:54:04.468204+0000", 2023-08-01T19:54:55.831 INFO:teuthology.orchestra.run.smithi101.stdout: "duration": 0.00011806700000000001 2023-08-01T19:54:55.831 INFO:teuthology.orchestra.run.smithi101.stdout: }, 2023-08-01T19:54:55.831 INFO:teuthology.orchestra.run.smithi101.stdout: { 2023-08-01T19:54:55.831 INFO:teuthology.orchestra.run.smithi101.stdout: "event": "waiting for subops from 0", 2023-08-01T19:54:55.831 INFO:teuthology.orchestra.run.smithi101.stdout: "time": "2023-08-01T19:54:04.468342+0000", 2023-08-01T19:54:55.831 INFO:teuthology.orchestra.run.smithi101.stdout: "duration": 0.000138269 2023-08-01T19:54:55.832 INFO:teuthology.orchestra.run.smithi101.stdout: }, 2023-08-01T19:54:55.832 INFO:teuthology.orchestra.run.smithi101.stdout: { 2023-08-01T19:54:55.832 INFO:teuthology.orchestra.run.smithi101.stdout: "event": "op_commit", 2023-08-01T19:54:55.832 INFO:teuthology.orchestra.run.smithi101.stdout: "time": "2023-08-01T19:54:04.474028+0000", 2023-08-01T19:54:55.833 INFO:teuthology.orchestra.run.smithi101.stdout: "duration": 0.005685458 2023-08-01T19:54:55.833 INFO:teuthology.orchestra.run.smithi101.stdout: }, 2023-08-01T19:54:55.833 INFO:teuthology.orchestra.run.smithi101.stdout: { 2023-08-01T19:54:55.834 INFO:teuthology.orchestra.run.smithi101.stdout: "event": "sub_op_commit_rec", 2023-08-01T19:54:55.834 INFO:teuthology.orchestra.run.smithi101.stdout: "time": "2023-08-01T19:54:04.477581+0000", 2023-08-01T19:54:55.834 INFO:teuthology.orchestra.run.smithi101.stdout: "duration": 0.0035531109999999999 2023-08-01T19:54:55.834 INFO:teuthology.orchestra.run.smithi101.stdout: }, 2023-08-01T19:54:55.834 INFO:teuthology.orchestra.run.smithi101.stdout: { 2023-08-01T19:54:55.835 INFO:teuthology.orchestra.run.smithi101.stdout: "event": "commit_sent", 2023-08-01T19:54:55.835 INFO:teuthology.orchestra.run.smithi101.stdout: "time": "2023-08-01T19:54:04.477635+0000", 2023-08-01T19:54:55.835 INFO:teuthology.orchestra.run.smithi101.stdout: "duration": 5.3769e-05 2023-08-01T19:54:55.835 INFO:teuthology.orchestra.run.smithi101.stdout: }, 2023-08-01T19:54:55.835 INFO:teuthology.orchestra.run.smithi101.stdout: { 2023-08-01T19:54:55.835 INFO:teuthology.orchestra.run.smithi101.stdout: "event": "done", 2023-08-01T19:54:55.835 INFO:teuthology.orchestra.run.smithi101.stdout: "time": "2023-08-01T19:54:04.477676+0000", 2023-08-01T19:54:55.836 INFO:teuthology.orchestra.run.smithi101.stdout: "duration": 4.1148e-05 2023-08-01T19:54:55.836 INFO:teuthology.orchestra.run.smithi101.stdout: } 2023-08-01T19:54:55.836 INFO:teuthology.orchestra.run.smithi101.stdout: ] 2023-08-01T19:54:55.836 INFO:teuthology.orchestra.run.smithi101.stdout: } 2023-08-01T19:54:55.836 INFO:teuthology.orchestra.run.smithi101.stdout: }, 2023-08-01T19:54:55.836 INFO:teuthology.orchestra.run.smithi101.stdout: { 2023-08-01T19:54:55.837 INFO:teuthology.orchestra.run.smithi101.stdout: "description": "osd_op(mds.0.3:21 3.1c 3:3ed09add:::607.00000000:head [create,setxattr parent (62) in=6b,setxattr layout (30) in=6b] snapc 0=[] ondisk+write+known_if_redirected+full_force+supports_pool_eio e17)", 2023-08-01T19:54:55.837 INFO:teuthology.orchestra.run.smithi101.stdout: "initiated_at": "2023-08-01T19:54:04.459123+0000", 2023-08-01T19:54:55.837 INFO:teuthology.orchestra.run.smithi101.stdout: "age": 51.228075717000003, 2023-08-01T19:54:55.837 INFO:teuthology.orchestra.run.smithi101.stdout: "duration": 0.018736452000000001, 2023-08-01T19:54:55.838 INFO:teuthology.orchestra.run.smithi101.stdout: "type_data": { 2023-08-01T19:54:55.838 INFO:teuthology.orchestra.run.smithi101.stdout: "flag_point": "commit sent; apply or cleanup", 2023-08-01T19:54:55.838 INFO:teuthology.orchestra.run.smithi101.stdout: "events": [ 2023-08-01T19:54:55.838 INFO:teuthology.orchestra.run.smithi101.stdout: { 2023-08-01T19:54:55.839 INFO:teuthology.orchestra.run.smithi101.stdout: "event": "initiated", 2023-08-01T19:54:55.839 INFO:teuthology.orchestra.run.smithi101.stdout: "time": "2023-08-01T19:54:04.459123+0000", 2023-08-01T19:54:55.839 INFO:teuthology.orchestra.run.smithi101.stdout: "duration": 0 2023-08-01T19:54:55.839 INFO:teuthology.orchestra.run.smithi101.stdout: }, 2023-08-01T19:54:55.839 INFO:teuthology.orchestra.run.smithi101.stdout: { 2023-08-01T19:54:55.839 INFO:teuthology.orchestra.run.smithi101.stdout: "event": "throttled", 2023-08-01T19:54:55.840 INFO:teuthology.orchestra.run.smithi101.stdout: "time": "2023-08-01T19:54:04.459123+0000", 2023-08-01T19:54:55.840 INFO:teuthology.orchestra.run.smithi101.stdout: "duration": 0 2023-08-01T19:54:55.840 INFO:teuthology.orchestra.run.smithi101.stdout: }, 2023-08-01T19:54:55.840 INFO:teuthology.orchestra.run.smithi101.stdout: { 2023-08-01T19:54:55.840 INFO:teuthology.orchestra.run.smithi101.stdout: "event": "header_read", 2023-08-01T19:54:55.840 INFO:teuthology.orchestra.run.smithi101.stdout: "time": "2023-08-01T19:54:04.459123+0000", 2023-08-01T19:54:55.840 INFO:teuthology.orchestra.run.smithi101.stdout: "duration": 4294967295.9999995 2023-08-01T19:54:55.841 INFO:teuthology.orchestra.run.smithi101.stdout: }, 2023-08-01T19:54:55.841 INFO:teuthology.orchestra.run.smithi101.stdout: { 2023-08-01T19:54:55.841 INFO:teuthology.orchestra.run.smithi101.stdout: "event": "all_read", 2023-08-01T19:54:55.841 INFO:teuthology.orchestra.run.smithi101.stdout: "time": "2023-08-01T19:54:04.459127+0000", 2023-08-01T19:54:55.841 INFO:teuthology.orchestra.run.smithi101.stdout: "duration": 4.5770000000000004e-06 2023-08-01T19:54:55.841 INFO:teuthology.orchestra.run.smithi101.stdout: }, 2023-08-01T19:54:55.841 INFO:teuthology.orchestra.run.smithi101.stdout: { 2023-08-01T19:54:55.842 INFO:teuthology.orchestra.run.smithi101.stdout: "event": "dispatched", 2023-08-01T19:54:55.842 INFO:teuthology.orchestra.run.smithi101.stdout: "time": "2023-08-01T19:54:04.459134+0000", 2023-08-01T19:54:55.842 INFO:teuthology.orchestra.run.smithi101.stdout: "duration": 6.5080000000000002e-06 2023-08-01T19:54:55.842 INFO:teuthology.orchestra.run.smithi101.stdout: }, 2023-08-01T19:54:55.842 INFO:teuthology.orchestra.run.smithi101.stdout: { 2023-08-01T19:54:55.842 INFO:teuthology.orchestra.run.smithi101.stdout: "event": "queued_for_pg", 2023-08-01T19:54:55.843 INFO:teuthology.orchestra.run.smithi101.stdout: "time": "2023-08-01T19:54:04.459138+0000", 2023-08-01T19:54:55.843 INFO:teuthology.orchestra.run.smithi101.stdout: "duration": 4.6249999999999998e-06 2023-08-01T19:54:55.843 INFO:teuthology.orchestra.run.smithi101.stdout: }, 2023-08-01T19:54:55.843 INFO:teuthology.orchestra.run.smithi101.stdout: { 2023-08-01T19:54:55.843 INFO:teuthology.orchestra.run.smithi101.stdout: "event": "reached_pg", 2023-08-01T19:54:55.844 INFO:teuthology.orchestra.run.smithi101.stdout: "time": "2023-08-01T19:54:04.459158+0000", 2023-08-01T19:54:55.844 INFO:teuthology.orchestra.run.smithi101.stdout: "duration": 1.9354000000000001e-05 2023-08-01T19:54:55.844 INFO:teuthology.orchestra.run.smithi101.stdout: }, 2023-08-01T19:54:55.844 INFO:teuthology.orchestra.run.smithi101.stdout: { 2023-08-01T19:54:55.844 INFO:teuthology.orchestra.run.smithi101.stdout: "event": "waiting_for_map not empty", 2023-08-01T19:54:55.844 INFO:teuthology.orchestra.run.smithi101.stdout: "time": "2023-08-01T19:54:04.459160+0000", 2023-08-01T19:54:55.844 INFO:teuthology.orchestra.run.smithi101.stdout: "duration": 2.2740000000000002e-06 2023-08-01T19:54:55.845 INFO:teuthology.orchestra.run.smithi101.stdout: }, 2023-08-01T19:54:55.845 INFO:teuthology.orchestra.run.smithi101.stdout: { 2023-08-01T19:54:55.845 INFO:teuthology.orchestra.run.smithi101.stdout: "event": "reached_pg", 2023-08-01T19:54:55.845 INFO:teuthology.orchestra.run.smithi101.stdout: "time": "2023-08-01T19:54:04.468839+0000", 2023-08-01T19:54:55.845 INFO:teuthology.orchestra.run.smithi101.stdout: "duration": 0.0096787109999999996 2023-08-01T19:54:55.845 INFO:teuthology.orchestra.run.smithi101.stdout: }, 2023-08-01T19:54:55.845 INFO:teuthology.orchestra.run.smithi101.stdout: { 2023-08-01T19:54:55.846 INFO:teuthology.orchestra.run.smithi101.stdout: "event": "started", 2023-08-01T19:54:55.846 INFO:teuthology.orchestra.run.smithi101.stdout: "time": "2023-08-01T19:54:04.469446+0000", 2023-08-01T19:54:55.846 INFO:teuthology.orchestra.run.smithi101.stdout: "duration": 0.00060714899999999997 2023-08-01T19:54:55.846 INFO:teuthology.orchestra.run.smithi101.stdout: }, 2023-08-01T19:54:55.846 INFO:teuthology.orchestra.run.smithi101.stdout: { 2023-08-01T19:54:55.846 INFO:teuthology.orchestra.run.smithi101.stdout: "event": "waiting for subops from 0", 2023-08-01T19:54:55.846 INFO:teuthology.orchestra.run.smithi101.stdout: "time": "2023-08-01T19:54:04.470133+0000", 2023-08-01T19:54:55.847 INFO:teuthology.orchestra.run.smithi101.stdout: "duration": 0.00068691900000000003 2023-08-01T19:54:55.847 INFO:teuthology.orchestra.run.smithi101.stdout: }, 2023-08-01T19:54:55.847 INFO:teuthology.orchestra.run.smithi101.stdout: { 2023-08-01T19:54:55.847 INFO:teuthology.orchestra.run.smithi101.stdout: "event": "op_commit", 2023-08-01T19:54:55.847 INFO:teuthology.orchestra.run.smithi101.stdout: "time": "2023-08-01T19:54:04.475933+0000", 2023-08-01T19:54:55.847 INFO:teuthology.orchestra.run.smithi101.stdout: "duration": 0.0058002560000000002 2023-08-01T19:54:55.847 INFO:teuthology.orchestra.run.smithi101.stdout: }, 2023-08-01T19:54:55.847 INFO:teuthology.orchestra.run.smithi101.stdout: { 2023-08-01T19:54:55.848 INFO:teuthology.orchestra.run.smithi101.stdout: "event": "sub_op_commit_rec", 2023-08-01T19:54:55.848 INFO:teuthology.orchestra.run.smithi101.stdout: "time": "2023-08-01T19:54:04.477749+0000", 2023-08-01T19:54:55.848 INFO:teuthology.orchestra.run.smithi101.stdout: "duration": 0.00181584 2023-08-01T19:54:55.848 INFO:teuthology.orchestra.run.smithi101.stdout: }, 2023-08-01T19:54:55.848 INFO:teuthology.orchestra.run.smithi101.stdout: { 2023-08-01T19:54:55.848 INFO:teuthology.orchestra.run.smithi101.stdout: "event": "commit_sent", 2023-08-01T19:54:55.848 INFO:teuthology.orchestra.run.smithi101.stdout: "time": "2023-08-01T19:54:04.477823+0000", 2023-08-01T19:54:55.849 INFO:teuthology.orchestra.run.smithi101.stdout: "duration": 7.4405000000000003e-05 2023-08-01T19:54:55.849 INFO:teuthology.orchestra.run.smithi101.stdout: }, 2023-08-01T19:54:55.849 INFO:teuthology.orchestra.run.smithi101.stdout: { 2023-08-01T19:54:55.849 INFO:teuthology.orchestra.run.smithi101.stdout: "event": "done", 2023-08-01T19:54:55.849 INFO:teuthology.orchestra.run.smithi101.stdout: "time": "2023-08-01T19:54:04.477859+0000", 2023-08-01T19:54:55.849 INFO:teuthology.orchestra.run.smithi101.stdout: "duration": 3.6211000000000003e-05 2023-08-01T19:54:55.849 INFO:teuthology.orchestra.run.smithi101.stdout: } 2023-08-01T19:54:55.849 INFO:teuthology.orchestra.run.smithi101.stdout: ] 2023-08-01T19:54:55.850 INFO:teuthology.orchestra.run.smithi101.stdout: } 2023-08-01T19:54:55.850 INFO:teuthology.orchestra.run.smithi101.stdout: }, 2023-08-01T19:54:55.850 INFO:teuthology.orchestra.run.smithi101.stdout: { 2023-08-01T19:54:55.850 INFO:teuthology.orchestra.run.smithi101.stdout: "description": "osd_op(mds.0.3:1 3.14 3:292cf221:::200.00000000:head [writefull 0~90] snapc 0=[] ondisk+write+known_if_redirected+full_force+supports_pool_eio e17)", 2023-08-01T19:54:55.850 INFO:teuthology.orchestra.run.smithi101.stdout: "initiated_at": "2023-08-01T19:54:04.459177+0000", 2023-08-01T19:54:55.850 INFO:teuthology.orchestra.run.smithi101.stdout: "age": 51.228022008000003, 2023-08-01T19:54:55.850 INFO:teuthology.orchestra.run.smithi101.stdout: "duration": 0.021067196, 2023-08-01T19:54:55.851 INFO:teuthology.orchestra.run.smithi101.stdout: "type_data": { 2023-08-01T19:54:55.851 INFO:teuthology.orchestra.run.smithi101.stdout: "flag_point": "commit sent; apply or cleanup", 2023-08-01T19:54:55.851 INFO:teuthology.orchestra.run.smithi101.stdout: "events": [ 2023-08-01T19:54:55.851 INFO:teuthology.orchestra.run.smithi101.stdout: { 2023-08-01T19:54:55.851 INFO:teuthology.orchestra.run.smithi101.stdout: "event": "initiated", 2023-08-01T19:54:55.851 INFO:teuthology.orchestra.run.smithi101.stdout: "time": "2023-08-01T19:54:04.459177+0000", 2023-08-01T19:54:55.851 INFO:teuthology.orchestra.run.smithi101.stdout: "duration": 0 2023-08-01T19:54:55.851 INFO:teuthology.orchestra.run.smithi101.stdout: }, 2023-08-01T19:54:55.852 INFO:teuthology.orchestra.run.smithi101.stdout: { 2023-08-01T19:54:55.852 INFO:teuthology.orchestra.run.smithi101.stdout: "event": "throttled", 2023-08-01T19:54:55.852 INFO:teuthology.orchestra.run.smithi101.stdout: "time": "2023-08-01T19:54:04.459177+0000", 2023-08-01T19:54:55.852 INFO:teuthology.orchestra.run.smithi101.stdout: "duration": 0 2023-08-01T19:54:55.852 INFO:teuthology.orchestra.run.smithi101.stdout: }, 2023-08-01T19:54:55.852 INFO:teuthology.orchestra.run.smithi101.stdout: { 2023-08-01T19:54:55.852 INFO:teuthology.orchestra.run.smithi101.stdout: "event": "header_read", 2023-08-01T19:54:55.852 INFO:teuthology.orchestra.run.smithi101.stdout: "time": "2023-08-01T19:54:04.459176+0000", 2023-08-01T19:54:55.853 INFO:teuthology.orchestra.run.smithi101.stdout: "duration": 4294967295.9999995 2023-08-01T19:54:55.853 INFO:teuthology.orchestra.run.smithi101.stdout: }, 2023-08-01T19:54:55.853 INFO:teuthology.orchestra.run.smithi101.stdout: { 2023-08-01T19:54:55.853 INFO:teuthology.orchestra.run.smithi101.stdout: "event": "all_read", 2023-08-01T19:54:55.853 INFO:teuthology.orchestra.run.smithi101.stdout: "time": "2023-08-01T19:54:04.459181+0000", 2023-08-01T19:54:55.853 INFO:teuthology.orchestra.run.smithi101.stdout: "duration": 5.2109999999999997e-06 2023-08-01T19:54:55.853 INFO:teuthology.orchestra.run.smithi101.stdout: }, 2023-08-01T19:54:55.854 INFO:teuthology.orchestra.run.smithi101.stdout: { 2023-08-01T19:54:55.854 INFO:teuthology.orchestra.run.smithi101.stdout: "event": "dispatched", 2023-08-01T19:54:55.854 INFO:teuthology.orchestra.run.smithi101.stdout: "time": "2023-08-01T19:54:04.459188+0000", 2023-08-01T19:54:55.854 INFO:teuthology.orchestra.run.smithi101.stdout: "duration": 6.6680000000000004e-06 2023-08-01T19:54:55.854 INFO:teuthology.orchestra.run.smithi101.stdout: }, 2023-08-01T19:54:55.854 INFO:teuthology.orchestra.run.smithi101.stdout: { 2023-08-01T19:54:55.854 INFO:teuthology.orchestra.run.smithi101.stdout: "event": "queued_for_pg", 2023-08-01T19:54:55.854 INFO:teuthology.orchestra.run.smithi101.stdout: "time": "2023-08-01T19:54:04.459192+0000", 2023-08-01T19:54:55.855 INFO:teuthology.orchestra.run.smithi101.stdout: "duration": 4.228e-06 2023-08-01T19:54:55.855 INFO:teuthology.orchestra.run.smithi101.stdout: }, 2023-08-01T19:54:55.855 INFO:teuthology.orchestra.run.smithi101.stdout: { 2023-08-01T19:54:55.855 INFO:teuthology.orchestra.run.smithi101.stdout: "event": "reached_pg", 2023-08-01T19:54:55.855 INFO:teuthology.orchestra.run.smithi101.stdout: "time": "2023-08-01T19:54:04.459219+0000", 2023-08-01T19:54:55.855 INFO:teuthology.orchestra.run.smithi101.stdout: "duration": 2.6930000000000001e-05 2023-08-01T19:54:55.855 INFO:teuthology.orchestra.run.smithi101.stdout: }, 2023-08-01T19:54:55.855 INFO:teuthology.orchestra.run.smithi101.stdout: { 2023-08-01T19:54:55.856 INFO:teuthology.orchestra.run.smithi101.stdout: "event": "waiting_for_map not empty", 2023-08-01T19:54:55.856 INFO:teuthology.orchestra.run.smithi101.stdout: "time": "2023-08-01T19:54:04.459223+0000", 2023-08-01T19:54:55.856 INFO:teuthology.orchestra.run.smithi101.stdout: "duration": 3.8469999999999998e-06 2023-08-01T19:54:55.856 INFO:teuthology.orchestra.run.smithi101.stdout: }, 2023-08-01T19:54:55.856 INFO:teuthology.orchestra.run.smithi101.stdout: { 2023-08-01T19:54:55.856 INFO:teuthology.orchestra.run.smithi101.stdout: "event": "reached_pg", 2023-08-01T19:54:55.856 INFO:teuthology.orchestra.run.smithi101.stdout: "time": "2023-08-01T19:54:04.473347+0000", 2023-08-01T19:54:55.857 INFO:teuthology.orchestra.run.smithi101.stdout: "duration": 0.014124319 2023-08-01T19:54:55.857 INFO:teuthology.orchestra.run.smithi101.stdout: }, 2023-08-01T19:54:55.857 INFO:teuthology.orchestra.run.smithi101.stdout: { 2023-08-01T19:54:55.857 INFO:teuthology.orchestra.run.smithi101.stdout: "event": "started", 2023-08-01T19:54:55.857 INFO:teuthology.orchestra.run.smithi101.stdout: "time": "2023-08-01T19:54:04.473480+0000", 2023-08-01T19:54:55.857 INFO:teuthology.orchestra.run.smithi101.stdout: "duration": 0.00013276799999999999 2023-08-01T19:54:55.857 INFO:teuthology.orchestra.run.smithi101.stdout: }, 2023-08-01T19:54:55.857 INFO:teuthology.orchestra.run.smithi101.stdout: { 2023-08-01T19:54:55.858 INFO:teuthology.orchestra.run.smithi101.stdout: "event": "waiting for subops from 2", 2023-08-01T19:54:55.858 INFO:teuthology.orchestra.run.smithi101.stdout: "time": "2023-08-01T19:54:04.473622+0000", 2023-08-01T19:54:55.858 INFO:teuthology.orchestra.run.smithi101.stdout: "duration": 0.00014154799999999999 2023-08-01T19:54:55.858 INFO:teuthology.orchestra.run.smithi101.stdout: }, 2023-08-01T19:54:55.858 INFO:teuthology.orchestra.run.smithi101.stdout: { 2023-08-01T19:54:55.858 INFO:teuthology.orchestra.run.smithi101.stdout: "event": "op_commit", 2023-08-01T19:54:55.858 INFO:teuthology.orchestra.run.smithi101.stdout: "time": "2023-08-01T19:54:04.478281+0000", 2023-08-01T19:54:55.858 INFO:teuthology.orchestra.run.smithi101.stdout: "duration": 0.004659252 2023-08-01T19:54:55.859 INFO:teuthology.orchestra.run.smithi101.stdout: }, 2023-08-01T19:54:55.859 INFO:teuthology.orchestra.run.smithi101.stdout: { 2023-08-01T19:54:55.859 INFO:teuthology.orchestra.run.smithi101.stdout: "event": "sub_op_commit_rec", 2023-08-01T19:54:55.859 INFO:teuthology.orchestra.run.smithi101.stdout: "time": "2023-08-01T19:54:04.480180+0000", 2023-08-01T19:54:55.859 INFO:teuthology.orchestra.run.smithi101.stdout: "duration": 0.0018986859999999999 2023-08-01T19:54:55.859 INFO:teuthology.orchestra.run.smithi101.stdout: }, 2023-08-01T19:54:55.859 INFO:teuthology.orchestra.run.smithi101.stdout: { 2023-08-01T19:54:55.859 INFO:teuthology.orchestra.run.smithi101.stdout: "event": "commit_sent", 2023-08-01T19:54:55.860 INFO:teuthology.orchestra.run.smithi101.stdout: "time": "2023-08-01T19:54:04.480209+0000", 2023-08-01T19:54:55.860 INFO:teuthology.orchestra.run.smithi101.stdout: "duration": 2.9244999999999999e-05 2023-08-01T19:54:55.860 INFO:teuthology.orchestra.run.smithi101.stdout: }, 2023-08-01T19:54:55.860 INFO:teuthology.orchestra.run.smithi101.stdout: { 2023-08-01T19:54:55.860 INFO:teuthology.orchestra.run.smithi101.stdout: "event": "done", 2023-08-01T19:54:55.860 INFO:teuthology.orchestra.run.smithi101.stdout: "time": "2023-08-01T19:54:04.480244+0000", 2023-08-01T19:54:55.860 INFO:teuthology.orchestra.run.smithi101.stdout: "duration": 3.4875000000000001e-05 2023-08-01T19:54:55.861 INFO:teuthology.orchestra.run.smithi101.stdout: } 2023-08-01T19:54:55.861 INFO:teuthology.orchestra.run.smithi101.stdout: ] 2023-08-01T19:54:55.861 INFO:teuthology.orchestra.run.smithi101.stdout: } 2023-08-01T19:54:55.861 INFO:teuthology.orchestra.run.smithi101.stdout: }, 2023-08-01T19:54:55.861 INFO:teuthology.orchestra.run.smithi101.stdout: { 2023-08-01T19:54:55.861 INFO:teuthology.orchestra.run.smithi101.stdout: "description": "osd_op(mds.0.3:3 3.14 3:287034c4:::1.00000000.inode:head [writefull 0~554] snapc 0=[] ondisk+write+known_if_redirected+full_force+supports_pool_eio e17)", 2023-08-01T19:54:55.861 INFO:teuthology.orchestra.run.smithi101.stdout: "initiated_at": "2023-08-01T19:54:04.459226+0000", 2023-08-01T19:54:55.861 INFO:teuthology.orchestra.run.smithi101.stdout: "age": 51.227972929000003, 2023-08-01T19:54:55.862 INFO:teuthology.orchestra.run.smithi101.stdout: "duration": 0.021104531999999999, 2023-08-01T19:54:55.862 INFO:teuthology.orchestra.run.smithi101.stdout: "type_data": { 2023-08-01T19:54:55.862 INFO:teuthology.orchestra.run.smithi101.stdout: "flag_point": "commit sent; apply or cleanup", 2023-08-01T19:54:55.862 INFO:teuthology.orchestra.run.smithi101.stdout: "events": [ 2023-08-01T19:54:55.862 INFO:teuthology.orchestra.run.smithi101.stdout: { 2023-08-01T19:54:55.862 INFO:teuthology.orchestra.run.smithi101.stdout: "event": "initiated", 2023-08-01T19:54:55.862 INFO:teuthology.orchestra.run.smithi101.stdout: "time": "2023-08-01T19:54:04.459226+0000", 2023-08-01T19:54:55.862 INFO:teuthology.orchestra.run.smithi101.stdout: "duration": 0 2023-08-01T19:54:55.863 INFO:teuthology.orchestra.run.smithi101.stdout: }, 2023-08-01T19:54:55.863 INFO:teuthology.orchestra.run.smithi101.stdout: { 2023-08-01T19:54:55.863 INFO:teuthology.orchestra.run.smithi101.stdout: "event": "throttled", 2023-08-01T19:54:55.863 INFO:teuthology.orchestra.run.smithi101.stdout: "time": "2023-08-01T19:54:04.459226+0000", 2023-08-01T19:54:55.863 INFO:teuthology.orchestra.run.smithi101.stdout: "duration": 0 2023-08-01T19:54:55.863 INFO:teuthology.orchestra.run.smithi101.stdout: }, 2023-08-01T19:54:55.863 INFO:teuthology.orchestra.run.smithi101.stdout: { 2023-08-01T19:54:55.864 INFO:teuthology.orchestra.run.smithi101.stdout: "event": "header_read", 2023-08-01T19:54:55.864 INFO:teuthology.orchestra.run.smithi101.stdout: "time": "2023-08-01T19:54:04.459225+0000", 2023-08-01T19:54:55.864 INFO:teuthology.orchestra.run.smithi101.stdout: "duration": 4294967295.9999995 2023-08-01T19:54:55.864 INFO:teuthology.orchestra.run.smithi101.stdout: }, 2023-08-01T19:54:55.864 INFO:teuthology.orchestra.run.smithi101.stdout: { 2023-08-01T19:54:55.864 INFO:teuthology.orchestra.run.smithi101.stdout: "event": "all_read", 2023-08-01T19:54:55.864 INFO:teuthology.orchestra.run.smithi101.stdout: "time": "2023-08-01T19:54:04.459238+0000", 2023-08-01T19:54:55.865 INFO:teuthology.orchestra.run.smithi101.stdout: "duration": 1.2809000000000001e-05 2023-08-01T19:54:55.865 INFO:teuthology.orchestra.run.smithi101.stdout: }, 2023-08-01T19:54:55.865 INFO:teuthology.orchestra.run.smithi101.stdout: { 2023-08-01T19:54:55.865 INFO:teuthology.orchestra.run.smithi101.stdout: "event": "dispatched", 2023-08-01T19:54:55.865 INFO:teuthology.orchestra.run.smithi101.stdout: "time": "2023-08-01T19:54:04.459245+0000", 2023-08-01T19:54:55.865 INFO:teuthology.orchestra.run.smithi101.stdout: "duration": 6.6540000000000002e-06 2023-08-01T19:54:55.865 INFO:teuthology.orchestra.run.smithi101.stdout: }, 2023-08-01T19:54:55.865 INFO:teuthology.orchestra.run.smithi101.stdout: { 2023-08-01T19:54:55.866 INFO:teuthology.orchestra.run.smithi101.stdout: "event": "queued_for_pg", 2023-08-01T19:54:55.866 INFO:teuthology.orchestra.run.smithi101.stdout: "time": "2023-08-01T19:54:04.459249+0000", 2023-08-01T19:54:55.866 INFO:teuthology.orchestra.run.smithi101.stdout: "duration": 4.6e-06 2023-08-01T19:54:55.866 INFO:teuthology.orchestra.run.smithi101.stdout: }, 2023-08-01T19:54:55.866 INFO:teuthology.orchestra.run.smithi101.stdout: { 2023-08-01T19:54:55.866 INFO:teuthology.orchestra.run.smithi101.stdout: "event": "reached_pg", 2023-08-01T19:54:55.866 INFO:teuthology.orchestra.run.smithi101.stdout: "time": "2023-08-01T19:54:04.459276+0000", 2023-08-01T19:54:55.866 INFO:teuthology.orchestra.run.smithi101.stdout: "duration": 2.6373999999999999e-05 2023-08-01T19:54:55.867 INFO:teuthology.orchestra.run.smithi101.stdout: }, 2023-08-01T19:54:55.867 INFO:teuthology.orchestra.run.smithi101.stdout: { 2023-08-01T19:54:55.867 INFO:teuthology.orchestra.run.smithi101.stdout: "event": "waiting_for_map not empty", 2023-08-01T19:54:55.867 INFO:teuthology.orchestra.run.smithi101.stdout: "time": "2023-08-01T19:54:04.459278+0000", 2023-08-01T19:54:55.867 INFO:teuthology.orchestra.run.smithi101.stdout: "duration": 2.4980000000000001e-06 2023-08-01T19:54:55.867 INFO:teuthology.orchestra.run.smithi101.stdout: }, 2023-08-01T19:54:55.867 INFO:teuthology.orchestra.run.smithi101.stdout: { 2023-08-01T19:54:55.867 INFO:teuthology.orchestra.run.smithi101.stdout: "event": "reached_pg", 2023-08-01T19:54:55.868 INFO:teuthology.orchestra.run.smithi101.stdout: "time": "2023-08-01T19:54:04.474058+0000", 2023-08-01T19:54:55.868 INFO:teuthology.orchestra.run.smithi101.stdout: "duration": 0.014779979 2023-08-01T19:54:55.868 INFO:teuthology.orchestra.run.smithi101.stdout: }, 2023-08-01T19:54:55.868 INFO:teuthology.orchestra.run.smithi101.stdout: { 2023-08-01T19:54:55.868 INFO:teuthology.orchestra.run.smithi101.stdout: "event": "started", 2023-08-01T19:54:55.868 INFO:teuthology.orchestra.run.smithi101.stdout: "time": "2023-08-01T19:54:04.474614+0000", 2023-08-01T19:54:55.868 INFO:teuthology.orchestra.run.smithi101.stdout: "duration": 0.00055546899999999995 2023-08-01T19:54:55.868 INFO:teuthology.orchestra.run.smithi101.stdout: }, 2023-08-01T19:54:55.869 INFO:teuthology.orchestra.run.smithi101.stdout: { 2023-08-01T19:54:55.869 INFO:teuthology.orchestra.run.smithi101.stdout: "event": "waiting for subops from 2", 2023-08-01T19:54:55.869 INFO:teuthology.orchestra.run.smithi101.stdout: "time": "2023-08-01T19:54:04.474720+0000", 2023-08-01T19:54:55.869 INFO:teuthology.orchestra.run.smithi101.stdout: "duration": 0.00010645300000000001 2023-08-01T19:54:55.869 INFO:teuthology.orchestra.run.smithi101.stdout: }, 2023-08-01T19:54:55.869 INFO:teuthology.orchestra.run.smithi101.stdout: { 2023-08-01T19:54:55.869 INFO:teuthology.orchestra.run.smithi101.stdout: "event": "op_commit", 2023-08-01T19:54:55.870 INFO:teuthology.orchestra.run.smithi101.stdout: "time": "2023-08-01T19:54:04.478480+0000", 2023-08-01T19:54:55.870 INFO:teuthology.orchestra.run.smithi101.stdout: "duration": 0.0037600279999999999 2023-08-01T19:54:55.870 INFO:teuthology.orchestra.run.smithi101.stdout: }, 2023-08-01T19:54:55.870 INFO:teuthology.orchestra.run.smithi101.stdout: { 2023-08-01T19:54:55.870 INFO:teuthology.orchestra.run.smithi101.stdout: "event": "sub_op_commit_rec", 2023-08-01T19:54:55.870 INFO:teuthology.orchestra.run.smithi101.stdout: "time": "2023-08-01T19:54:04.480273+0000", 2023-08-01T19:54:55.870 INFO:teuthology.orchestra.run.smithi101.stdout: "duration": 0.001792465 2023-08-01T19:54:55.870 INFO:teuthology.orchestra.run.smithi101.stdout: }, 2023-08-01T19:54:55.871 INFO:teuthology.orchestra.run.smithi101.stdout: { 2023-08-01T19:54:55.871 INFO:teuthology.orchestra.run.smithi101.stdout: "event": "commit_sent", 2023-08-01T19:54:55.871 INFO:teuthology.orchestra.run.smithi101.stdout: "time": "2023-08-01T19:54:04.480304+0000", 2023-08-01T19:54:55.871 INFO:teuthology.orchestra.run.smithi101.stdout: "duration": 3.1708999999999997e-05 2023-08-01T19:54:55.871 INFO:teuthology.orchestra.run.smithi101.stdout: }, 2023-08-01T19:54:55.871 INFO:teuthology.orchestra.run.smithi101.stdout: { 2023-08-01T19:54:55.871 INFO:teuthology.orchestra.run.smithi101.stdout: "event": "done", 2023-08-01T19:54:55.871 INFO:teuthology.orchestra.run.smithi101.stdout: "time": "2023-08-01T19:54:04.480330+0000", 2023-08-01T19:54:55.872 INFO:teuthology.orchestra.run.smithi101.stdout: "duration": 2.5860999999999999e-05 2023-08-01T19:54:55.872 INFO:teuthology.orchestra.run.smithi101.stdout: } 2023-08-01T19:54:55.872 INFO:teuthology.orchestra.run.smithi101.stdout: ] 2023-08-01T19:54:55.872 INFO:teuthology.orchestra.run.smithi101.stdout: } 2023-08-01T19:54:55.872 INFO:teuthology.orchestra.run.smithi101.stdout: }, 2023-08-01T19:54:55.872 INFO:teuthology.orchestra.run.smithi101.stdout: { 2023-08-01T19:54:55.872 INFO:teuthology.orchestra.run.smithi101.stdout: "description": "osd_op(mds.0.3:32 3.14 3:2e2fa760:::200.00000001:head [delete] snapc 0=[] ondisk+write+known_if_redirected+full_force+supports_pool_eio e17)", 2023-08-01T19:54:55.872 INFO:teuthology.orchestra.run.smithi101.stdout: "initiated_at": "2023-08-01T19:54:04.459304+0000", 2023-08-01T19:54:55.873 INFO:teuthology.orchestra.run.smithi101.stdout: "age": 51.227894268, 2023-08-01T19:54:55.873 INFO:teuthology.orchestra.run.smithi101.stdout: "duration": 0.021110606000000001, 2023-08-01T19:54:55.873 INFO:teuthology.orchestra.run.smithi101.stdout: "type_data": { 2023-08-01T19:54:55.873 INFO:teuthology.orchestra.run.smithi101.stdout: "flag_point": "started", 2023-08-01T19:54:55.873 INFO:teuthology.orchestra.run.smithi101.stdout: "events": [ 2023-08-01T19:54:55.873 INFO:teuthology.orchestra.run.smithi101.stdout: { 2023-08-01T19:54:55.873 INFO:teuthology.orchestra.run.smithi101.stdout: "event": "initiated", 2023-08-01T19:54:55.874 INFO:teuthology.orchestra.run.smithi101.stdout: "time": "2023-08-01T19:54:04.459304+0000", 2023-08-01T19:54:55.874 INFO:teuthology.orchestra.run.smithi101.stdout: "duration": 0 2023-08-01T19:54:55.874 INFO:teuthology.orchestra.run.smithi101.stdout: }, 2023-08-01T19:54:55.874 INFO:teuthology.orchestra.run.smithi101.stdout: { 2023-08-01T19:54:55.874 INFO:teuthology.orchestra.run.smithi101.stdout: "event": "throttled", 2023-08-01T19:54:55.874 INFO:teuthology.orchestra.run.smithi101.stdout: "time": "2023-08-01T19:54:04.459304+0000", 2023-08-01T19:54:55.874 INFO:teuthology.orchestra.run.smithi101.stdout: "duration": 0 2023-08-01T19:54:55.874 INFO:teuthology.orchestra.run.smithi101.stdout: }, 2023-08-01T19:54:55.875 INFO:teuthology.orchestra.run.smithi101.stdout: { 2023-08-01T19:54:55.875 INFO:teuthology.orchestra.run.smithi101.stdout: "event": "header_read", 2023-08-01T19:54:55.875 INFO:teuthology.orchestra.run.smithi101.stdout: "time": "2023-08-01T19:54:04.459304+0000", 2023-08-01T19:54:55.875 INFO:teuthology.orchestra.run.smithi101.stdout: "duration": 4294967295.9999995 2023-08-01T19:54:55.875 INFO:teuthology.orchestra.run.smithi101.stdout: }, 2023-08-01T19:54:55.875 INFO:teuthology.orchestra.run.smithi101.stdout: { 2023-08-01T19:54:55.875 INFO:teuthology.orchestra.run.smithi101.stdout: "event": "all_read", 2023-08-01T19:54:55.876 INFO:teuthology.orchestra.run.smithi101.stdout: "time": "2023-08-01T19:54:04.459306+0000", 2023-08-01T19:54:55.876 INFO:teuthology.orchestra.run.smithi101.stdout: "duration": 2.3889999999999999e-06 2023-08-01T19:54:55.876 INFO:teuthology.orchestra.run.smithi101.stdout: }, 2023-08-01T19:54:55.876 INFO:teuthology.orchestra.run.smithi101.stdout: { 2023-08-01T19:54:55.876 INFO:teuthology.orchestra.run.smithi101.stdout: "event": "dispatched", 2023-08-01T19:54:55.876 INFO:teuthology.orchestra.run.smithi101.stdout: "time": "2023-08-01T19:54:04.459314+0000", 2023-08-01T19:54:55.876 INFO:teuthology.orchestra.run.smithi101.stdout: "duration": 7.1180000000000003e-06 2023-08-01T19:54:55.877 INFO:teuthology.orchestra.run.smithi101.stdout: }, 2023-08-01T19:54:55.877 INFO:teuthology.orchestra.run.smithi101.stdout: { 2023-08-01T19:54:55.877 INFO:teuthology.orchestra.run.smithi101.stdout: "event": "queued_for_pg", 2023-08-01T19:54:55.877 INFO:teuthology.orchestra.run.smithi101.stdout: "time": "2023-08-01T19:54:04.459318+0000", 2023-08-01T19:54:55.877 INFO:teuthology.orchestra.run.smithi101.stdout: "duration": 4.0239999999999999e-06 2023-08-01T19:54:55.877 INFO:teuthology.orchestra.run.smithi101.stdout: }, 2023-08-01T19:54:55.877 INFO:teuthology.orchestra.run.smithi101.stdout: { 2023-08-01T19:54:55.877 INFO:teuthology.orchestra.run.smithi101.stdout: "event": "reached_pg", 2023-08-01T19:54:55.878 INFO:teuthology.orchestra.run.smithi101.stdout: "time": "2023-08-01T19:54:04.459340+0000", 2023-08-01T19:54:55.878 INFO:teuthology.orchestra.run.smithi101.stdout: "duration": 2.2476e-05 2023-08-01T19:54:55.878 INFO:teuthology.orchestra.run.smithi101.stdout: }, 2023-08-01T19:54:55.878 INFO:teuthology.orchestra.run.smithi101.stdout: { 2023-08-01T19:54:55.878 INFO:teuthology.orchestra.run.smithi101.stdout: "event": "waiting_for_map not empty", 2023-08-01T19:54:55.878 INFO:teuthology.orchestra.run.smithi101.stdout: "time": "2023-08-01T19:54:04.459342+0000", 2023-08-01T19:54:55.878 INFO:teuthology.orchestra.run.smithi101.stdout: "duration": 2.272e-06 2023-08-01T19:54:55.878 INFO:teuthology.orchestra.run.smithi101.stdout: }, 2023-08-01T19:54:55.879 INFO:teuthology.orchestra.run.smithi101.stdout: { 2023-08-01T19:54:55.879 INFO:teuthology.orchestra.run.smithi101.stdout: "event": "reached_pg", 2023-08-01T19:54:55.879 INFO:teuthology.orchestra.run.smithi101.stdout: "time": "2023-08-01T19:54:04.475922+0000", 2023-08-01T19:54:55.879 INFO:teuthology.orchestra.run.smithi101.stdout: "duration": 0.016579388 2023-08-01T19:54:55.879 INFO:teuthology.orchestra.run.smithi101.stdout: }, 2023-08-01T19:54:55.879 INFO:teuthology.orchestra.run.smithi101.stdout: { 2023-08-01T19:54:55.879 INFO:teuthology.orchestra.run.smithi101.stdout: "event": "started", 2023-08-01T19:54:55.879 INFO:teuthology.orchestra.run.smithi101.stdout: "time": "2023-08-01T19:54:04.476107+0000", 2023-08-01T19:54:55.880 INFO:teuthology.orchestra.run.smithi101.stdout: "duration": 0.00018486300000000001 2023-08-01T19:54:55.880 INFO:teuthology.orchestra.run.smithi101.stdout: }, 2023-08-01T19:54:55.880 INFO:teuthology.orchestra.run.smithi101.stdout: { 2023-08-01T19:54:55.880 INFO:teuthology.orchestra.run.smithi101.stdout: "event": "done", 2023-08-01T19:54:55.880 INFO:teuthology.orchestra.run.smithi101.stdout: "time": "2023-08-01T19:54:04.480415+0000", 2023-08-01T19:54:55.880 INFO:teuthology.orchestra.run.smithi101.stdout: "duration": 0.0043084589999999997 2023-08-01T19:54:55.880 INFO:teuthology.orchestra.run.smithi101.stdout: } 2023-08-01T19:54:55.880 INFO:teuthology.orchestra.run.smithi101.stdout: ] 2023-08-01T19:54:55.881 INFO:teuthology.orchestra.run.smithi101.stdout: } 2023-08-01T19:54:55.881 INFO:teuthology.orchestra.run.smithi101.stdout: }, 2023-08-01T19:54:55.881 INFO:teuthology.orchestra.run.smithi101.stdout: { 2023-08-01T19:54:55.881 INFO:teuthology.orchestra.run.smithi101.stdout: "description": "osd_op(client.4668.0:62896 5.f 5:f59d90d6:::benchmark_data_smithi006_114134_object62895:head [set-alloc-hint object_size 65536 write_size 65536,write 0~65536] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e29)", 2023-08-01T19:54:55.881 INFO:teuthology.orchestra.run.smithi101.stdout: "initiated_at": "2023-08-01T19:54:46.254123+0000", 2023-08-01T19:54:55.881 INFO:teuthology.orchestra.run.smithi101.stdout: "age": 9.4330753739999995, 2023-08-01T19:54:55.881 INFO:teuthology.orchestra.run.smithi101.stdout: "duration": 0.018097106000000002, 2023-08-01T19:54:55.881 INFO:teuthology.orchestra.run.smithi101.stdout: "type_data": { 2023-08-01T19:54:55.882 INFO:teuthology.orchestra.run.smithi101.stdout: "flag_point": "commit sent; apply or cleanup", 2023-08-01T19:54:55.882 INFO:teuthology.orchestra.run.smithi101.stdout: "client_info": { 2023-08-01T19:54:55.882 INFO:teuthology.orchestra.run.smithi101.stdout: "client": "client.4668", 2023-08-01T19:54:55.882 INFO:teuthology.orchestra.run.smithi101.stdout: "client_addr": "172.21.15.6:0/1709472247", 2023-08-01T19:54:55.882 INFO:teuthology.orchestra.run.smithi101.stdout: "tid": 62896 2023-08-01T19:54:55.882 INFO:teuthology.orchestra.run.smithi101.stdout: }, 2023-08-01T19:54:55.882 INFO:teuthology.orchestra.run.smithi101.stdout: "events": [ 2023-08-01T19:54:55.883 INFO:teuthology.orchestra.run.smithi101.stdout: { 2023-08-01T19:54:55.883 INFO:teuthology.orchestra.run.smithi101.stdout: "event": "initiated", 2023-08-01T19:54:55.883 INFO:teuthology.orchestra.run.smithi101.stdout: "time": "2023-08-01T19:54:46.254123+0000", 2023-08-01T19:54:55.883 INFO:teuthology.orchestra.run.smithi101.stdout: "duration": 0 2023-08-01T19:54:55.883 INFO:teuthology.orchestra.run.smithi101.stdout: }, 2023-08-01T19:54:55.883 INFO:teuthology.orchestra.run.smithi101.stdout: { 2023-08-01T19:54:55.883 INFO:teuthology.orchestra.run.smithi101.stdout: "event": "throttled", 2023-08-01T19:54:55.883 INFO:teuthology.orchestra.run.smithi101.stdout: "time": "2023-08-01T19:54:46.254123+0000", 2023-08-01T19:54:55.884 INFO:teuthology.orchestra.run.smithi101.stdout: "duration": 0 2023-08-01T19:54:55.884 INFO:teuthology.orchestra.run.smithi101.stdout: }, 2023-08-01T19:54:55.884 INFO:teuthology.orchestra.run.smithi101.stdout: { 2023-08-01T19:54:55.884 INFO:teuthology.orchestra.run.smithi101.stdout: "event": "header_read", 2023-08-01T19:54:55.884 INFO:teuthology.orchestra.run.smithi101.stdout: "time": "2023-08-01T19:54:46.254122+0000", 2023-08-01T19:54:55.884 INFO:teuthology.orchestra.run.smithi101.stdout: "duration": 4294967295.999999 2023-08-01T19:54:55.884 INFO:teuthology.orchestra.run.smithi101.stdout: }, 2023-08-01T19:54:55.885 INFO:teuthology.orchestra.run.smithi101.stdout: { 2023-08-01T19:54:55.885 INFO:teuthology.orchestra.run.smithi101.stdout: "event": "all_read", 2023-08-01T19:54:55.885 INFO:teuthology.orchestra.run.smithi101.stdout: "time": "2023-08-01T19:54:46.254214+0000", 2023-08-01T19:54:55.885 INFO:teuthology.orchestra.run.smithi101.stdout: "duration": 9.1421000000000004e-05 2023-08-01T19:54:55.885 INFO:teuthology.orchestra.run.smithi101.stdout: }, 2023-08-01T19:54:55.885 INFO:teuthology.orchestra.run.smithi101.stdout: { 2023-08-01T19:54:55.885 INFO:teuthology.orchestra.run.smithi101.stdout: "event": "dispatched", 2023-08-01T19:54:55.885 INFO:teuthology.orchestra.run.smithi101.stdout: "time": "2023-08-01T19:54:46.254222+0000", 2023-08-01T19:54:55.886 INFO:teuthology.orchestra.run.smithi101.stdout: "duration": 8.6100000000000006e-06 2023-08-01T19:54:55.886 INFO:teuthology.orchestra.run.smithi101.stdout: }, 2023-08-01T19:54:55.886 INFO:teuthology.orchestra.run.smithi101.stdout: { 2023-08-01T19:54:55.886 INFO:teuthology.orchestra.run.smithi101.stdout: "event": "queued_for_pg", 2023-08-01T19:54:55.886 INFO:teuthology.orchestra.run.smithi101.stdout: "time": "2023-08-01T19:54:46.254228+0000", 2023-08-01T19:54:55.886 INFO:teuthology.orchestra.run.smithi101.stdout: "duration": 5.5840000000000002e-06 2023-08-01T19:54:55.886 INFO:teuthology.orchestra.run.smithi101.stdout: }, 2023-08-01T19:54:55.886 INFO:teuthology.orchestra.run.smithi101.stdout: { 2023-08-01T19:54:55.887 INFO:teuthology.orchestra.run.smithi101.stdout: "event": "reached_pg", 2023-08-01T19:54:55.887 INFO:teuthology.orchestra.run.smithi101.stdout: "time": "2023-08-01T19:54:46.254259+0000", 2023-08-01T19:54:55.887 INFO:teuthology.orchestra.run.smithi101.stdout: "duration": 3.0580999999999997e-05 2023-08-01T19:54:55.887 INFO:teuthology.orchestra.run.smithi101.stdout: }, 2023-08-01T19:54:55.887 INFO:teuthology.orchestra.run.smithi101.stdout: { 2023-08-01T19:54:55.887 INFO:teuthology.orchestra.run.smithi101.stdout: "event": "started", 2023-08-01T19:54:55.887 INFO:teuthology.orchestra.run.smithi101.stdout: "time": "2023-08-01T19:54:46.254342+0000", 2023-08-01T19:54:55.888 INFO:teuthology.orchestra.run.smithi101.stdout: "duration": 8.3183999999999995e-05 2023-08-01T19:54:55.888 INFO:teuthology.orchestra.run.smithi101.stdout: }, 2023-08-01T19:54:55.888 INFO:teuthology.orchestra.run.smithi101.stdout: { 2023-08-01T19:54:55.888 INFO:teuthology.orchestra.run.smithi101.stdout: "event": "waiting for subops from 2", 2023-08-01T19:54:55.888 INFO:teuthology.orchestra.run.smithi101.stdout: "time": "2023-08-01T19:54:46.254422+0000", 2023-08-01T19:54:55.888 INFO:teuthology.orchestra.run.smithi101.stdout: "duration": 7.9703000000000006e-05 2023-08-01T19:54:55.889 INFO:teuthology.orchestra.run.smithi101.stdout: }, 2023-08-01T19:54:55.889 INFO:teuthology.orchestra.run.smithi101.stdout: { 2023-08-01T19:54:55.889 INFO:teuthology.orchestra.run.smithi101.stdout: "event": "sub_op_commit_rec", 2023-08-01T19:54:55.889 INFO:teuthology.orchestra.run.smithi101.stdout: "time": "2023-08-01T19:54:46.259940+0000", 2023-08-01T19:54:55.889 INFO:teuthology.orchestra.run.smithi101.stdout: "duration": 0.0055188650000000004 2023-08-01T19:54:55.889 INFO:teuthology.orchestra.run.smithi101.stdout: }, 2023-08-01T19:54:55.889 INFO:teuthology.orchestra.run.smithi101.stdout: { 2023-08-01T19:54:55.890 INFO:teuthology.orchestra.run.smithi101.stdout: "event": "op_commit", 2023-08-01T19:54:55.890 INFO:teuthology.orchestra.run.smithi101.stdout: "time": "2023-08-01T19:54:46.272127+0000", 2023-08-01T19:54:55.890 INFO:teuthology.orchestra.run.smithi101.stdout: "duration": 0.012186463 2023-08-01T19:54:55.890 INFO:teuthology.orchestra.run.smithi101.stdout: }, 2023-08-01T19:54:55.890 INFO:teuthology.orchestra.run.smithi101.stdout: { 2023-08-01T19:54:55.890 INFO:teuthology.orchestra.run.smithi101.stdout: "event": "commit_sent", 2023-08-01T19:54:55.890 INFO:teuthology.orchestra.run.smithi101.stdout: "time": "2023-08-01T19:54:46.272178+0000", 2023-08-01T19:54:55.890 INFO:teuthology.orchestra.run.smithi101.stdout: "duration": 5.1332000000000003e-05 2023-08-01T19:54:55.891 INFO:teuthology.orchestra.run.smithi101.stdout: }, 2023-08-01T19:54:55.891 INFO:teuthology.orchestra.run.smithi101.stdout: { 2023-08-01T19:54:55.891 INFO:teuthology.orchestra.run.smithi101.stdout: "event": "done", 2023-08-01T19:54:55.891 INFO:teuthology.orchestra.run.smithi101.stdout: "time": "2023-08-01T19:54:46.272220+0000", 2023-08-01T19:54:55.891 INFO:teuthology.orchestra.run.smithi101.stdout: "duration": 4.2227000000000001e-05 2023-08-01T19:54:55.891 INFO:teuthology.orchestra.run.smithi101.stdout: } 2023-08-01T19:54:55.892 INFO:teuthology.orchestra.run.smithi101.stdout: ] 2023-08-01T19:54:55.892 INFO:teuthology.orchestra.run.smithi101.stdout: } 2023-08-01T19:54:55.892 INFO:teuthology.orchestra.run.smithi101.stdout: }, 2023-08-01T19:54:55.892 INFO:teuthology.orchestra.run.smithi101.stdout: { 2023-08-01T19:54:55.892 INFO:teuthology.orchestra.run.smithi101.stdout: "description": "osd_op(client.4668.0:62898 5.f 5:fa45093a:::benchmark_data_smithi006_114134_object62897:head [set-alloc-hint object_size 65536 write_size 65536,write 0~65536] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e29)", 2023-08-01T19:54:55.892 INFO:teuthology.orchestra.run.smithi101.stdout: "initiated_at": "2023-08-01T19:54:46.254356+0000", 2023-08-01T19:54:55.892 INFO:teuthology.orchestra.run.smithi101.stdout: "age": 9.4328425490000001, 2023-08-01T19:54:55.893 INFO:teuthology.orchestra.run.smithi101.stdout: "duration": 0.017950870000000001, 2023-08-01T19:54:55.893 INFO:teuthology.orchestra.run.smithi101.stdout: "type_data": { 2023-08-01T19:54:55.893 INFO:teuthology.orchestra.run.smithi101.stdout: "flag_point": "commit sent; apply or cleanup", 2023-08-01T19:54:55.893 INFO:teuthology.orchestra.run.smithi101.stdout: "client_info": { 2023-08-01T19:54:55.893 INFO:teuthology.orchestra.run.smithi101.stdout: "client": "client.4668", 2023-08-01T19:54:55.893 INFO:teuthology.orchestra.run.smithi101.stdout: "client_addr": "172.21.15.6:0/1709472247", 2023-08-01T19:54:55.893 INFO:teuthology.orchestra.run.smithi101.stdout: "tid": 62898 2023-08-01T19:54:55.894 INFO:teuthology.orchestra.run.smithi101.stdout: }, 2023-08-01T19:54:55.894 INFO:teuthology.orchestra.run.smithi101.stdout: "events": [ 2023-08-01T19:54:55.894 INFO:teuthology.orchestra.run.smithi101.stdout: { 2023-08-01T19:54:55.894 INFO:teuthology.orchestra.run.smithi101.stdout: "event": "initiated", 2023-08-01T19:54:55.894 INFO:teuthology.orchestra.run.smithi101.stdout: "time": "2023-08-01T19:54:46.254356+0000", 2023-08-01T19:54:55.894 INFO:teuthology.orchestra.run.smithi101.stdout: "duration": 0 2023-08-01T19:54:55.894 INFO:teuthology.orchestra.run.smithi101.stdout: }, 2023-08-01T19:54:55.894 INFO:teuthology.orchestra.run.smithi101.stdout: { 2023-08-01T19:54:55.895 INFO:teuthology.orchestra.run.smithi101.stdout: "event": "throttled", 2023-08-01T19:54:55.895 INFO:teuthology.orchestra.run.smithi101.stdout: "time": "2023-08-01T19:54:46.254356+0000", 2023-08-01T19:54:55.895 INFO:teuthology.orchestra.run.smithi101.stdout: "duration": 0 2023-08-01T19:54:55.895 INFO:teuthology.orchestra.run.smithi101.stdout: }, 2023-08-01T19:54:55.895 INFO:teuthology.orchestra.run.smithi101.stdout: { 2023-08-01T19:54:55.895 INFO:teuthology.orchestra.run.smithi101.stdout: "event": "header_read", 2023-08-01T19:54:55.896 INFO:teuthology.orchestra.run.smithi101.stdout: "time": "2023-08-01T19:54:46.254355+0000", 2023-08-01T19:54:55.896 INFO:teuthology.orchestra.run.smithi101.stdout: "duration": 4294967295.9999995 2023-08-01T19:54:55.896 INFO:teuthology.orchestra.run.smithi101.stdout: }, 2023-08-01T19:54:55.896 INFO:teuthology.orchestra.run.smithi101.stdout: { 2023-08-01T19:54:55.896 INFO:teuthology.orchestra.run.smithi101.stdout: "event": "all_read", 2023-08-01T19:54:55.896 INFO:teuthology.orchestra.run.smithi101.stdout: "time": "2023-08-01T19:54:46.254415+0000", 2023-08-01T19:54:55.896 INFO:teuthology.orchestra.run.smithi101.stdout: "duration": 5.9713999999999998e-05 2023-08-01T19:54:55.897 INFO:teuthology.orchestra.run.smithi101.stdout: }, 2023-08-01T19:54:55.897 INFO:teuthology.orchestra.run.smithi101.stdout: { 2023-08-01T19:54:55.897 INFO:teuthology.orchestra.run.smithi101.stdout: "event": "dispatched", 2023-08-01T19:54:55.897 INFO:teuthology.orchestra.run.smithi101.stdout: "time": "2023-08-01T19:54:46.254423+0000", 2023-08-01T19:54:55.897 INFO:teuthology.orchestra.run.smithi101.stdout: "duration": 7.8399999999999995e-06 2023-08-01T19:54:55.897 INFO:teuthology.orchestra.run.smithi101.stdout: }, 2023-08-01T19:54:55.897 INFO:teuthology.orchestra.run.smithi101.stdout: { 2023-08-01T19:54:55.897 INFO:teuthology.orchestra.run.smithi101.stdout: "event": "queued_for_pg", 2023-08-01T19:54:55.898 INFO:teuthology.orchestra.run.smithi101.stdout: "time": "2023-08-01T19:54:46.254428+0000", 2023-08-01T19:54:55.898 INFO:teuthology.orchestra.run.smithi101.stdout: "duration": 4.5040000000000004e-06 2023-08-01T19:54:55.898 INFO:teuthology.orchestra.run.smithi101.stdout: }, 2023-08-01T19:54:55.898 INFO:teuthology.orchestra.run.smithi101.stdout: { 2023-08-01T19:54:55.898 INFO:teuthology.orchestra.run.smithi101.stdout: "event": "reached_pg", 2023-08-01T19:54:55.898 INFO:teuthology.orchestra.run.smithi101.stdout: "time": "2023-08-01T19:54:46.255926+0000", 2023-08-01T19:54:55.898 INFO:teuthology.orchestra.run.smithi101.stdout: "duration": 0.001498741 2023-08-01T19:54:55.899 INFO:teuthology.orchestra.run.smithi101.stdout: }, 2023-08-01T19:54:55.899 INFO:teuthology.orchestra.run.smithi101.stdout: { 2023-08-01T19:54:55.899 INFO:teuthology.orchestra.run.smithi101.stdout: "event": "started", 2023-08-01T19:54:55.899 INFO:teuthology.orchestra.run.smithi101.stdout: "time": "2023-08-01T19:54:46.256006+0000", 2023-08-01T19:54:55.899 INFO:teuthology.orchestra.run.smithi101.stdout: "duration": 8.0185000000000006e-05 2023-08-01T19:54:55.899 INFO:teuthology.orchestra.run.smithi101.stdout: }, 2023-08-01T19:54:55.899 INFO:teuthology.orchestra.run.smithi101.stdout: { 2023-08-01T19:54:55.900 INFO:teuthology.orchestra.run.smithi101.stdout: "event": "waiting for subops from 2", 2023-08-01T19:54:55.900 INFO:teuthology.orchestra.run.smithi101.stdout: "time": "2023-08-01T19:54:46.256158+0000", 2023-08-01T19:54:55.900 INFO:teuthology.orchestra.run.smithi101.stdout: "duration": 0.00015124 2023-08-01T19:54:55.900 INFO:teuthology.orchestra.run.smithi101.stdout: }, 2023-08-01T19:54:55.900 INFO:teuthology.orchestra.run.smithi101.stdout: { 2023-08-01T19:54:55.900 INFO:teuthology.orchestra.run.smithi101.stdout: "event": "sub_op_commit_rec", 2023-08-01T19:54:55.900 INFO:teuthology.orchestra.run.smithi101.stdout: "time": "2023-08-01T19:54:46.260449+0000", 2023-08-01T19:54:55.900 INFO:teuthology.orchestra.run.smithi101.stdout: "duration": 0.0042917179999999999 2023-08-01T19:54:55.901 INFO:teuthology.orchestra.run.smithi101.stdout: }, 2023-08-01T19:54:55.901 INFO:teuthology.orchestra.run.smithi101.stdout: { 2023-08-01T19:54:55.901 INFO:teuthology.orchestra.run.smithi101.stdout: "event": "op_commit", 2023-08-01T19:54:55.901 INFO:teuthology.orchestra.run.smithi101.stdout: "time": "2023-08-01T19:54:46.272229+0000", 2023-08-01T19:54:55.901 INFO:teuthology.orchestra.run.smithi101.stdout: "duration": 0.011779243999999999 2023-08-01T19:54:55.901 INFO:teuthology.orchestra.run.smithi101.stdout: }, 2023-08-01T19:54:55.901 INFO:teuthology.orchestra.run.smithi101.stdout: { 2023-08-01T19:54:55.902 INFO:teuthology.orchestra.run.smithi101.stdout: "event": "commit_sent", 2023-08-01T19:54:55.902 INFO:teuthology.orchestra.run.smithi101.stdout: "time": "2023-08-01T19:54:46.272270+0000", 2023-08-01T19:54:55.902 INFO:teuthology.orchestra.run.smithi101.stdout: "duration": 4.1516e-05 2023-08-01T19:54:55.902 INFO:teuthology.orchestra.run.smithi101.stdout: }, 2023-08-01T19:54:55.902 INFO:teuthology.orchestra.run.smithi101.stdout: { 2023-08-01T19:54:55.902 INFO:teuthology.orchestra.run.smithi101.stdout: "event": "done", 2023-08-01T19:54:55.902 INFO:teuthology.orchestra.run.smithi101.stdout: "time": "2023-08-01T19:54:46.272307+0000", 2023-08-01T19:54:55.902 INFO:teuthology.orchestra.run.smithi101.stdout: "duration": 3.6813000000000001e-05 2023-08-01T19:54:55.903 INFO:teuthology.orchestra.run.smithi101.stdout: } 2023-08-01T19:54:55.903 INFO:teuthology.orchestra.run.smithi101.stdout: ] 2023-08-01T19:54:55.903 INFO:teuthology.orchestra.run.smithi101.stdout: } 2023-08-01T19:54:55.903 INFO:teuthology.orchestra.run.smithi101.stdout: }, 2023-08-01T19:54:55.903 INFO:teuthology.orchestra.run.smithi101.stdout: { 2023-08-01T19:54:55.903 INFO:teuthology.orchestra.run.smithi101.stdout: "description": "osd_op(client.4668.0:70878 5.2 5:49b7d2be:::benchmark_data_smithi006_114134_object70877:head [set-alloc-hint object_size 65536 write_size 65536,write 0~65536] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e30)", 2023-08-01T19:54:55.903 INFO:teuthology.orchestra.run.smithi101.stdout: "initiated_at": "2023-08-01T19:54:50.210223+0000", 2023-08-01T19:54:55.904 INFO:teuthology.orchestra.run.smithi101.stdout: "age": 5.4769756980000004, 2023-08-01T19:54:55.904 INFO:teuthology.orchestra.run.smithi101.stdout: "duration": 0.019884895, 2023-08-01T19:54:55.904 INFO:teuthology.orchestra.run.smithi101.stdout: "type_data": { 2023-08-01T19:54:55.904 INFO:teuthology.orchestra.run.smithi101.stdout: "flag_point": "commit sent; apply or cleanup", 2023-08-01T19:54:55.904 INFO:teuthology.orchestra.run.smithi101.stdout: "client_info": { 2023-08-01T19:54:55.904 INFO:teuthology.orchestra.run.smithi101.stdout: "client": "client.4668", 2023-08-01T19:54:55.904 INFO:teuthology.orchestra.run.smithi101.stdout: "client_addr": "172.21.15.6:0/1709472247", 2023-08-01T19:54:55.904 INFO:teuthology.orchestra.run.smithi101.stdout: "tid": 70878 2023-08-01T19:54:55.905 INFO:teuthology.orchestra.run.smithi101.stdout: }, 2023-08-01T19:54:55.905 INFO:teuthology.orchestra.run.smithi101.stdout: "events": [ 2023-08-01T19:54:55.905 INFO:teuthology.orchestra.run.smithi101.stdout: { 2023-08-01T19:54:55.905 INFO:teuthology.orchestra.run.smithi101.stdout: "event": "initiated", 2023-08-01T19:54:55.905 INFO:teuthology.orchestra.run.smithi101.stdout: "time": "2023-08-01T19:54:50.210223+0000", 2023-08-01T19:54:55.905 INFO:teuthology.orchestra.run.smithi101.stdout: "duration": 0 2023-08-01T19:54:55.905 INFO:teuthology.orchestra.run.smithi101.stdout: }, 2023-08-01T19:54:55.905 INFO:teuthology.orchestra.run.smithi101.stdout: { 2023-08-01T19:54:55.906 INFO:teuthology.orchestra.run.smithi101.stdout: "event": "throttled", 2023-08-01T19:54:55.906 INFO:teuthology.orchestra.run.smithi101.stdout: "time": "2023-08-01T19:54:50.210223+0000", 2023-08-01T19:54:55.906 INFO:teuthology.orchestra.run.smithi101.stdout: "duration": 0 2023-08-01T19:54:55.906 INFO:teuthology.orchestra.run.smithi101.stdout: }, 2023-08-01T19:54:55.906 INFO:teuthology.orchestra.run.smithi101.stdout: { 2023-08-01T19:54:55.906 INFO:teuthology.orchestra.run.smithi101.stdout: "event": "header_read", 2023-08-01T19:54:55.906 INFO:teuthology.orchestra.run.smithi101.stdout: "time": "2023-08-01T19:54:50.210222+0000", 2023-08-01T19:54:55.906 INFO:teuthology.orchestra.run.smithi101.stdout: "duration": 4294967295.999999 2023-08-01T19:54:55.907 INFO:teuthology.orchestra.run.smithi101.stdout: }, 2023-08-01T19:54:55.907 INFO:teuthology.orchestra.run.smithi101.stdout: { 2023-08-01T19:54:55.907 INFO:teuthology.orchestra.run.smithi101.stdout: "event": "all_read", 2023-08-01T19:54:55.907 INFO:teuthology.orchestra.run.smithi101.stdout: "time": "2023-08-01T19:54:50.210315+0000", 2023-08-01T19:54:55.907 INFO:teuthology.orchestra.run.smithi101.stdout: "duration": 9.2567999999999999e-05 2023-08-01T19:54:55.907 INFO:teuthology.orchestra.run.smithi101.stdout: }, 2023-08-01T19:54:55.907 INFO:teuthology.orchestra.run.smithi101.stdout: { 2023-08-01T19:54:55.908 INFO:teuthology.orchestra.run.smithi101.stdout: "event": "dispatched", 2023-08-01T19:54:55.908 INFO:teuthology.orchestra.run.smithi101.stdout: "time": "2023-08-01T19:54:50.210326+0000", 2023-08-01T19:54:55.908 INFO:teuthology.orchestra.run.smithi101.stdout: "duration": 1.1430000000000001e-05 2023-08-01T19:54:55.908 INFO:teuthology.orchestra.run.smithi101.stdout: }, 2023-08-01T19:54:55.908 INFO:teuthology.orchestra.run.smithi101.stdout: { 2023-08-01T19:54:55.908 INFO:teuthology.orchestra.run.smithi101.stdout: "event": "queued_for_pg", 2023-08-01T19:54:55.908 INFO:teuthology.orchestra.run.smithi101.stdout: "time": "2023-08-01T19:54:50.210332+0000", 2023-08-01T19:54:55.909 INFO:teuthology.orchestra.run.smithi101.stdout: "duration": 5.8479999999999997e-06 2023-08-01T19:54:55.909 INFO:teuthology.orchestra.run.smithi101.stdout: }, 2023-08-01T19:54:55.909 INFO:teuthology.orchestra.run.smithi101.stdout: { 2023-08-01T19:54:55.909 INFO:teuthology.orchestra.run.smithi101.stdout: "event": "reached_pg", 2023-08-01T19:54:55.909 INFO:teuthology.orchestra.run.smithi101.stdout: "time": "2023-08-01T19:54:50.214259+0000", 2023-08-01T19:54:55.909 INFO:teuthology.orchestra.run.smithi101.stdout: "duration": 0.003926789 2023-08-01T19:54:55.909 INFO:teuthology.orchestra.run.smithi101.stdout: }, 2023-08-01T19:54:55.909 INFO:teuthology.orchestra.run.smithi101.stdout: { 2023-08-01T19:54:55.910 INFO:teuthology.orchestra.run.smithi101.stdout: "event": "started", 2023-08-01T19:54:55.910 INFO:teuthology.orchestra.run.smithi101.stdout: "time": "2023-08-01T19:54:50.214387+0000", 2023-08-01T19:54:55.910 INFO:teuthology.orchestra.run.smithi101.stdout: "duration": 0.00012787599999999999 2023-08-01T19:54:55.910 INFO:teuthology.orchestra.run.smithi101.stdout: }, 2023-08-01T19:54:55.910 INFO:teuthology.orchestra.run.smithi101.stdout: { 2023-08-01T19:54:55.910 INFO:teuthology.orchestra.run.smithi101.stdout: "event": "waiting for subops from 0", 2023-08-01T19:54:55.910 INFO:teuthology.orchestra.run.smithi101.stdout: "time": "2023-08-01T19:54:50.214536+0000", 2023-08-01T19:54:55.910 INFO:teuthology.orchestra.run.smithi101.stdout: "duration": 0.00014935299999999999 2023-08-01T19:54:55.911 INFO:teuthology.orchestra.run.smithi101.stdout: }, 2023-08-01T19:54:55.911 INFO:teuthology.orchestra.run.smithi101.stdout: { 2023-08-01T19:54:55.911 INFO:teuthology.orchestra.run.smithi101.stdout: "event": "op_commit", 2023-08-01T19:54:55.911 INFO:teuthology.orchestra.run.smithi101.stdout: "time": "2023-08-01T19:54:50.217739+0000", 2023-08-01T19:54:55.911 INFO:teuthology.orchestra.run.smithi101.stdout: "duration": 0.0032034619999999998 2023-08-01T19:54:55.911 INFO:teuthology.orchestra.run.smithi101.stdout: }, 2023-08-01T19:54:55.911 INFO:teuthology.orchestra.run.smithi101.stdout: { 2023-08-01T19:54:55.911 INFO:teuthology.orchestra.run.smithi101.stdout: "event": "sub_op_commit_rec", 2023-08-01T19:54:55.912 INFO:teuthology.orchestra.run.smithi101.stdout: "time": "2023-08-01T19:54:50.230032+0000", 2023-08-01T19:54:55.912 INFO:teuthology.orchestra.run.smithi101.stdout: "duration": 0.012293068000000001 2023-08-01T19:54:55.912 INFO:teuthology.orchestra.run.smithi101.stdout: }, 2023-08-01T19:54:55.912 INFO:teuthology.orchestra.run.smithi101.stdout: { 2023-08-01T19:54:55.912 INFO:teuthology.orchestra.run.smithi101.stdout: "event": "commit_sent", 2023-08-01T19:54:55.912 INFO:teuthology.orchestra.run.smithi101.stdout: "time": "2023-08-01T19:54:50.230075+0000", 2023-08-01T19:54:55.912 INFO:teuthology.orchestra.run.smithi101.stdout: "duration": 4.3062999999999997e-05 2023-08-01T19:54:55.913 INFO:teuthology.orchestra.run.smithi101.stdout: }, 2023-08-01T19:54:55.913 INFO:teuthology.orchestra.run.smithi101.stdout: { 2023-08-01T19:54:55.913 INFO:teuthology.orchestra.run.smithi101.stdout: "event": "done", 2023-08-01T19:54:55.913 INFO:teuthology.orchestra.run.smithi101.stdout: "time": "2023-08-01T19:54:50.230108+0000", 2023-08-01T19:54:55.913 INFO:teuthology.orchestra.run.smithi101.stdout: "duration": 3.2366999999999997e-05 2023-08-01T19:54:55.913 INFO:teuthology.orchestra.run.smithi101.stdout: } 2023-08-01T19:54:55.913 INFO:teuthology.orchestra.run.smithi101.stdout: ] 2023-08-01T19:54:55.914 INFO:teuthology.orchestra.run.smithi101.stdout: } 2023-08-01T19:54:55.914 INFO:teuthology.orchestra.run.smithi101.stdout: }, 2023-08-01T19:54:55.914 INFO:teuthology.orchestra.run.smithi101.stdout: { 2023-08-01T19:54:55.914 INFO:teuthology.orchestra.run.smithi101.stdout: "description": "osd_op(client.4668.0:73460 5.f 5:ff4f0704:::benchmark_data_smithi006_114134_object73459:head [set-alloc-hint object_size 65536 write_size 65536,write 0~65536] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e31)", 2023-08-01T19:54:55.914 INFO:teuthology.orchestra.run.smithi101.stdout: "initiated_at": "2023-08-01T19:54:51.462968+0000", 2023-08-01T19:54:55.914 INFO:teuthology.orchestra.run.smithi101.stdout: "age": 4.2242308189999997, 2023-08-01T19:54:55.915 INFO:teuthology.orchestra.run.smithi101.stdout: "duration": 0.020056502, 2023-08-01T19:54:55.915 INFO:teuthology.orchestra.run.smithi101.stdout: "type_data": { 2023-08-01T19:54:55.915 INFO:teuthology.orchestra.run.smithi101.stdout: "flag_point": "commit sent; apply or cleanup", 2023-08-01T19:54:55.915 INFO:teuthology.orchestra.run.smithi101.stdout: "client_info": { 2023-08-01T19:54:55.915 INFO:teuthology.orchestra.run.smithi101.stdout: "client": "client.4668", 2023-08-01T19:54:55.915 INFO:teuthology.orchestra.run.smithi101.stdout: "client_addr": "172.21.15.6:0/1709472247", 2023-08-01T19:54:55.915 INFO:teuthology.orchestra.run.smithi101.stdout: "tid": 73460 2023-08-01T19:54:55.915 INFO:teuthology.orchestra.run.smithi101.stdout: }, 2023-08-01T19:54:55.916 INFO:teuthology.orchestra.run.smithi101.stdout: "events": [ 2023-08-01T19:54:55.916 INFO:teuthology.orchestra.run.smithi101.stdout: { 2023-08-01T19:54:55.916 INFO:teuthology.orchestra.run.smithi101.stdout: "event": "initiated", 2023-08-01T19:54:55.916 INFO:teuthology.orchestra.run.smithi101.stdout: "time": "2023-08-01T19:54:51.462968+0000", 2023-08-01T19:54:55.916 INFO:teuthology.orchestra.run.smithi101.stdout: "duration": 0 2023-08-01T19:54:55.916 INFO:teuthology.orchestra.run.smithi101.stdout: }, 2023-08-01T19:54:55.917 INFO:teuthology.orchestra.run.smithi101.stdout: { 2023-08-01T19:54:55.917 INFO:teuthology.orchestra.run.smithi101.stdout: "event": "throttled", 2023-08-01T19:54:55.917 INFO:teuthology.orchestra.run.smithi101.stdout: "time": "2023-08-01T19:54:51.462968+0000", 2023-08-01T19:54:55.917 INFO:teuthology.orchestra.run.smithi101.stdout: "duration": 0 2023-08-01T19:54:55.917 INFO:teuthology.orchestra.run.smithi101.stdout: }, 2023-08-01T19:54:55.917 INFO:teuthology.orchestra.run.smithi101.stdout: { 2023-08-01T19:54:55.917 INFO:teuthology.orchestra.run.smithi101.stdout: "event": "header_read", 2023-08-01T19:54:55.917 INFO:teuthology.orchestra.run.smithi101.stdout: "time": "2023-08-01T19:54:51.462967+0000", 2023-08-01T19:54:55.918 INFO:teuthology.orchestra.run.smithi101.stdout: "duration": 4294967295.999999 2023-08-01T19:54:55.918 INFO:teuthology.orchestra.run.smithi101.stdout: }, 2023-08-01T19:54:55.918 INFO:teuthology.orchestra.run.smithi101.stdout: { 2023-08-01T19:54:55.918 INFO:teuthology.orchestra.run.smithi101.stdout: "event": "all_read", 2023-08-01T19:54:55.918 INFO:teuthology.orchestra.run.smithi101.stdout: "time": "2023-08-01T19:54:51.463009+0000", 2023-08-01T19:54:55.918 INFO:teuthology.orchestra.run.smithi101.stdout: "duration": 4.2106e-05 2023-08-01T19:54:55.918 INFO:teuthology.orchestra.run.smithi101.stdout: }, 2023-08-01T19:54:55.919 INFO:teuthology.orchestra.run.smithi101.stdout: { 2023-08-01T19:54:55.919 INFO:teuthology.orchestra.run.smithi101.stdout: "event": "dispatched", 2023-08-01T19:54:55.919 INFO:teuthology.orchestra.run.smithi101.stdout: "time": "2023-08-01T19:54:51.463017+0000", 2023-08-01T19:54:55.919 INFO:teuthology.orchestra.run.smithi101.stdout: "duration": 8.1529999999999997e-06 2023-08-01T19:54:55.919 INFO:teuthology.orchestra.run.smithi101.stdout: }, 2023-08-01T19:54:55.919 INFO:teuthology.orchestra.run.smithi101.stdout: { 2023-08-01T19:54:55.919 INFO:teuthology.orchestra.run.smithi101.stdout: "event": "queued_for_pg", 2023-08-01T19:54:55.919 INFO:teuthology.orchestra.run.smithi101.stdout: "time": "2023-08-01T19:54:51.463027+0000", 2023-08-01T19:54:55.920 INFO:teuthology.orchestra.run.smithi101.stdout: "duration": 9.5659999999999996e-06 2023-08-01T19:54:55.920 INFO:teuthology.orchestra.run.smithi101.stdout: }, 2023-08-01T19:54:55.920 INFO:teuthology.orchestra.run.smithi101.stdout: { 2023-08-01T19:54:55.920 INFO:teuthology.orchestra.run.smithi101.stdout: "event": "reached_pg", 2023-08-01T19:54:55.920 INFO:teuthology.orchestra.run.smithi101.stdout: "time": "2023-08-01T19:54:51.463062+0000", 2023-08-01T19:54:55.920 INFO:teuthology.orchestra.run.smithi101.stdout: "duration": 3.5442999999999999e-05 2023-08-01T19:54:55.920 INFO:teuthology.orchestra.run.smithi101.stdout: }, 2023-08-01T19:54:55.921 INFO:teuthology.orchestra.run.smithi101.stdout: { 2023-08-01T19:54:55.921 INFO:teuthology.orchestra.run.smithi101.stdout: "event": "started", 2023-08-01T19:54:55.921 INFO:teuthology.orchestra.run.smithi101.stdout: "time": "2023-08-01T19:54:51.463198+0000", 2023-08-01T19:54:55.921 INFO:teuthology.orchestra.run.smithi101.stdout: "duration": 0.000135628 2023-08-01T19:54:55.921 INFO:teuthology.orchestra.run.smithi101.stdout: }, 2023-08-01T19:54:55.921 INFO:teuthology.orchestra.run.smithi101.stdout: { 2023-08-01T19:54:55.921 INFO:teuthology.orchestra.run.smithi101.stdout: "event": "waiting for subops from 2", 2023-08-01T19:54:55.922 INFO:teuthology.orchestra.run.smithi101.stdout: "time": "2023-08-01T19:54:51.463341+0000", 2023-08-01T19:54:55.922 INFO:teuthology.orchestra.run.smithi101.stdout: "duration": 0.00014346500000000001 2023-08-01T19:54:55.922 INFO:teuthology.orchestra.run.smithi101.stdout: }, 2023-08-01T19:54:55.922 INFO:teuthology.orchestra.run.smithi101.stdout: { 2023-08-01T19:54:55.922 INFO:teuthology.orchestra.run.smithi101.stdout: "event": "op_commit", 2023-08-01T19:54:55.922 INFO:teuthology.orchestra.run.smithi101.stdout: "time": "2023-08-01T19:54:51.472684+0000", 2023-08-01T19:54:55.922 INFO:teuthology.orchestra.run.smithi101.stdout: "duration": 0.0093427900000000001 2023-08-01T19:54:55.923 INFO:teuthology.orchestra.run.smithi101.stdout: }, 2023-08-01T19:54:55.923 INFO:teuthology.orchestra.run.smithi101.stdout: { 2023-08-01T19:54:55.923 INFO:teuthology.orchestra.run.smithi101.stdout: "event": "sub_op_commit_rec", 2023-08-01T19:54:55.923 INFO:teuthology.orchestra.run.smithi101.stdout: "time": "2023-08-01T19:54:51.482937+0000", 2023-08-01T19:54:55.923 INFO:teuthology.orchestra.run.smithi101.stdout: "duration": 0.010252557000000001 2023-08-01T19:54:55.923 INFO:teuthology.orchestra.run.smithi101.stdout: }, 2023-08-01T19:54:55.923 INFO:teuthology.orchestra.run.smithi101.stdout: { 2023-08-01T19:54:55.923 INFO:teuthology.orchestra.run.smithi101.stdout: "event": "commit_sent", 2023-08-01T19:54:55.924 INFO:teuthology.orchestra.run.smithi101.stdout: "time": "2023-08-01T19:54:51.482984+0000", 2023-08-01T19:54:55.924 INFO:teuthology.orchestra.run.smithi101.stdout: "duration": 4.7394000000000001e-05 2023-08-01T19:54:55.924 INFO:teuthology.orchestra.run.smithi101.stdout: }, 2023-08-01T19:54:55.924 INFO:teuthology.orchestra.run.smithi101.stdout: { 2023-08-01T19:54:55.924 INFO:teuthology.orchestra.run.smithi101.stdout: "event": "done", 2023-08-01T19:54:55.924 INFO:teuthology.orchestra.run.smithi101.stdout: "time": "2023-08-01T19:54:51.483024+0000", 2023-08-01T19:54:55.924 INFO:teuthology.orchestra.run.smithi101.stdout: "duration": 4.0159e-05 2023-08-01T19:54:55.925 INFO:teuthology.orchestra.run.smithi101.stdout: } 2023-08-01T19:54:55.925 INFO:teuthology.orchestra.run.smithi101.stdout: ] 2023-08-01T19:54:55.925 INFO:teuthology.orchestra.run.smithi101.stdout: } 2023-08-01T19:54:55.925 INFO:teuthology.orchestra.run.smithi101.stdout: }, 2023-08-01T19:54:55.925 INFO:teuthology.orchestra.run.smithi101.stdout: { 2023-08-01T19:54:55.925 INFO:teuthology.orchestra.run.smithi101.stdout: "description": "osd_op(client.4668.0:73464 5.f 5:f261eb35:::benchmark_data_smithi006_114134_object73463:head [set-alloc-hint object_size 65536 write_size 65536,write 0~65536] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e31)", 2023-08-01T19:54:55.925 INFO:teuthology.orchestra.run.smithi101.stdout: "initiated_at": "2023-08-01T19:54:51.465789+0000", 2023-08-01T19:54:55.925 INFO:teuthology.orchestra.run.smithi101.stdout: "age": 4.2214092860000001, 2023-08-01T19:54:55.926 INFO:teuthology.orchestra.run.smithi101.stdout: "duration": 0.017372190999999999, 2023-08-01T19:54:55.926 INFO:teuthology.orchestra.run.smithi101.stdout: "type_data": { 2023-08-01T19:54:55.926 INFO:teuthology.orchestra.run.smithi101.stdout: "flag_point": "commit sent; apply or cleanup", 2023-08-01T19:54:55.926 INFO:teuthology.orchestra.run.smithi101.stdout: "client_info": { 2023-08-01T19:54:55.926 INFO:teuthology.orchestra.run.smithi101.stdout: "client": "client.4668", 2023-08-01T19:54:55.926 INFO:teuthology.orchestra.run.smithi101.stdout: "client_addr": "172.21.15.6:0/1709472247", 2023-08-01T19:54:55.926 INFO:teuthology.orchestra.run.smithi101.stdout: "tid": 73464 2023-08-01T19:54:55.927 INFO:teuthology.orchestra.run.smithi101.stdout: }, 2023-08-01T19:54:55.927 INFO:teuthology.orchestra.run.smithi101.stdout: "events": [ 2023-08-01T19:54:55.927 INFO:teuthology.orchestra.run.smithi101.stdout: { 2023-08-01T19:54:55.927 INFO:teuthology.orchestra.run.smithi101.stdout: "event": "initiated", 2023-08-01T19:54:55.927 INFO:teuthology.orchestra.run.smithi101.stdout: "time": "2023-08-01T19:54:51.465789+0000", 2023-08-01T19:54:55.927 INFO:teuthology.orchestra.run.smithi101.stdout: "duration": 0 2023-08-01T19:54:55.927 INFO:teuthology.orchestra.run.smithi101.stdout: }, 2023-08-01T19:54:55.927 INFO:teuthology.orchestra.run.smithi101.stdout: { 2023-08-01T19:54:55.928 INFO:teuthology.orchestra.run.smithi101.stdout: "event": "throttled", 2023-08-01T19:54:55.928 INFO:teuthology.orchestra.run.smithi101.stdout: "time": "2023-08-01T19:54:51.465789+0000", 2023-08-01T19:54:55.928 INFO:teuthology.orchestra.run.smithi101.stdout: "duration": 0 2023-08-01T19:54:55.928 INFO:teuthology.orchestra.run.smithi101.stdout: }, 2023-08-01T19:54:55.928 INFO:teuthology.orchestra.run.smithi101.stdout: { 2023-08-01T19:54:55.928 INFO:teuthology.orchestra.run.smithi101.stdout: "event": "header_read", 2023-08-01T19:54:55.928 INFO:teuthology.orchestra.run.smithi101.stdout: "time": "2023-08-01T19:54:51.465789+0000", 2023-08-01T19:54:55.929 INFO:teuthology.orchestra.run.smithi101.stdout: "duration": 4294967295.999999 2023-08-01T19:54:55.929 INFO:teuthology.orchestra.run.smithi101.stdout: }, 2023-08-01T19:54:55.929 INFO:teuthology.orchestra.run.smithi101.stdout: { 2023-08-01T19:54:55.929 INFO:teuthology.orchestra.run.smithi101.stdout: "event": "all_read", 2023-08-01T19:54:55.929 INFO:teuthology.orchestra.run.smithi101.stdout: "time": "2023-08-01T19:54:51.465950+0000", 2023-08-01T19:54:55.929 INFO:teuthology.orchestra.run.smithi101.stdout: "duration": 0.00016093600000000001 2023-08-01T19:54:55.929 INFO:teuthology.orchestra.run.smithi101.stdout: }, 2023-08-01T19:54:55.929 INFO:teuthology.orchestra.run.smithi101.stdout: { 2023-08-01T19:54:55.930 INFO:teuthology.orchestra.run.smithi101.stdout: "event": "dispatched", 2023-08-01T19:54:55.930 INFO:teuthology.orchestra.run.smithi101.stdout: "time": "2023-08-01T19:54:51.465960+0000", 2023-08-01T19:54:55.930 INFO:teuthology.orchestra.run.smithi101.stdout: "duration": 1.0025e-05 2023-08-01T19:54:55.930 INFO:teuthology.orchestra.run.smithi101.stdout: }, 2023-08-01T19:54:55.930 INFO:teuthology.orchestra.run.smithi101.stdout: { 2023-08-01T19:54:55.930 INFO:teuthology.orchestra.run.smithi101.stdout: "event": "queued_for_pg", 2023-08-01T19:54:55.930 INFO:teuthology.orchestra.run.smithi101.stdout: "time": "2023-08-01T19:54:51.465965+0000", 2023-08-01T19:54:55.931 INFO:teuthology.orchestra.run.smithi101.stdout: "duration": 4.989e-06 2023-08-01T19:54:55.931 INFO:teuthology.orchestra.run.smithi101.stdout: }, 2023-08-01T19:54:55.931 INFO:teuthology.orchestra.run.smithi101.stdout: { 2023-08-01T19:54:55.931 INFO:teuthology.orchestra.run.smithi101.stdout: "event": "reached_pg", 2023-08-01T19:54:55.931 INFO:teuthology.orchestra.run.smithi101.stdout: "time": "2023-08-01T19:54:51.466002+0000", 2023-08-01T19:54:55.931 INFO:teuthology.orchestra.run.smithi101.stdout: "duration": 3.7895000000000002e-05 2023-08-01T19:54:55.931 INFO:teuthology.orchestra.run.smithi101.stdout: }, 2023-08-01T19:54:55.931 INFO:teuthology.orchestra.run.smithi101.stdout: { 2023-08-01T19:54:55.932 INFO:teuthology.orchestra.run.smithi101.stdout: "event": "started", 2023-08-01T19:54:55.932 INFO:teuthology.orchestra.run.smithi101.stdout: "time": "2023-08-01T19:54:51.466132+0000", 2023-08-01T19:54:55.932 INFO:teuthology.orchestra.run.smithi101.stdout: "duration": 0.000129882 2023-08-01T19:54:55.932 INFO:teuthology.orchestra.run.smithi101.stdout: }, 2023-08-01T19:54:55.932 INFO:teuthology.orchestra.run.smithi101.stdout: { 2023-08-01T19:54:55.932 INFO:teuthology.orchestra.run.smithi101.stdout: "event": "waiting for subops from 2", 2023-08-01T19:54:55.932 INFO:teuthology.orchestra.run.smithi101.stdout: "time": "2023-08-01T19:54:51.466289+0000", 2023-08-01T19:54:55.933 INFO:teuthology.orchestra.run.smithi101.stdout: "duration": 0.00015683599999999999 2023-08-01T19:54:55.933 INFO:teuthology.orchestra.run.smithi101.stdout: }, 2023-08-01T19:54:55.933 INFO:teuthology.orchestra.run.smithi101.stdout: { 2023-08-01T19:54:55.933 INFO:teuthology.orchestra.run.smithi101.stdout: "event": "op_commit", 2023-08-01T19:54:55.933 INFO:teuthology.orchestra.run.smithi101.stdout: "time": "2023-08-01T19:54:51.472691+0000", 2023-08-01T19:54:55.933 INFO:teuthology.orchestra.run.smithi101.stdout: "duration": 0.0064019159999999997 2023-08-01T19:54:55.933 INFO:teuthology.orchestra.run.smithi101.stdout: }, 2023-08-01T19:54:55.933 INFO:teuthology.orchestra.run.smithi101.stdout: { 2023-08-01T19:54:55.934 INFO:teuthology.orchestra.run.smithi101.stdout: "event": "sub_op_commit_rec", 2023-08-01T19:54:55.934 INFO:teuthology.orchestra.run.smithi101.stdout: "time": "2023-08-01T19:54:51.483071+0000", 2023-08-01T19:54:55.934 INFO:teuthology.orchestra.run.smithi101.stdout: "duration": 0.010380265 2023-08-01T19:54:55.934 INFO:teuthology.orchestra.run.smithi101.stdout: }, 2023-08-01T19:54:55.934 INFO:teuthology.orchestra.run.smithi101.stdout: { 2023-08-01T19:54:55.934 INFO:teuthology.orchestra.run.smithi101.stdout: "event": "commit_sent", 2023-08-01T19:54:55.934 INFO:teuthology.orchestra.run.smithi101.stdout: "time": "2023-08-01T19:54:51.483122+0000", 2023-08-01T19:54:55.934 INFO:teuthology.orchestra.run.smithi101.stdout: "duration": 5.1063999999999998e-05 2023-08-01T19:54:55.935 INFO:teuthology.orchestra.run.smithi101.stdout: }, 2023-08-01T19:54:55.935 INFO:teuthology.orchestra.run.smithi101.stdout: { 2023-08-01T19:54:55.935 INFO:teuthology.orchestra.run.smithi101.stdout: "event": "done", 2023-08-01T19:54:55.935 INFO:teuthology.orchestra.run.smithi101.stdout: "time": "2023-08-01T19:54:51.483162+0000", 2023-08-01T19:54:55.935 INFO:teuthology.orchestra.run.smithi101.stdout: "duration": 3.9156999999999998e-05 2023-08-01T19:54:55.935 INFO:teuthology.orchestra.run.smithi101.stdout: } 2023-08-01T19:54:55.935 INFO:teuthology.orchestra.run.smithi101.stdout: ] 2023-08-01T19:54:55.936 INFO:teuthology.orchestra.run.smithi101.stdout: } 2023-08-01T19:54:55.936 INFO:teuthology.orchestra.run.smithi101.stdout: } 2023-08-01T19:54:55.936 INFO:teuthology.orchestra.run.smithi101.stdout: ] 2023-08-01T19:54:55.936 INFO:teuthology.orchestra.run.smithi101.stdout:} 2023-08-01T19:54:55.937 INFO:tasks.ceph.osd.2.smithi155.stderr:2023-08-01T19:54:55.935+0000 7faa5c6ac700 -1 received signal: Hangup from /usr/bin/python3 /bin/daemon-helper kill ceph-osd -f --cluster ceph -i 2 (PID: 111337) UID: 0 2023-08-01T19:54:55.938 DEBUG:teuthology.orchestra.run.smithi155:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 30 ceph --cluster ceph --admin-daemon /var/run/ceph/ceph-osd.2.asok dump_ops_in_flight 2023-08-01T19:54:56.038 INFO:tasks.ceph.osd.0.smithi008.stderr:2023-08-01T19:54:56.037+0000 7f16a58f4700 -1 received signal: Hangup from /usr/bin/python3 /bin/daemon-helper kill ceph-osd -f --cluster ceph -i 0 (PID: 111179) UID: 0 2023-08-01T19:54:56.103 INFO:teuthology.orchestra.run.smithi155.stdout:{ 2023-08-01T19:54:56.103 INFO:teuthology.orchestra.run.smithi155.stdout: "ops": [ 2023-08-01T19:54:56.103 INFO:teuthology.orchestra.run.smithi155.stdout: { 2023-08-01T19:54:56.103 INFO:teuthology.orchestra.run.smithi155.stdout: "description": "osd_op(client.4668.0:82586 5.b 5:d75e6714:::benchmark_data_smithi006_114134_object82585:head [set-alloc-hint object_size 65536 write_size 65536,write 0~65536 in=65536b] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e34)", 2023-08-01T19:54:56.103 INFO:teuthology.orchestra.run.smithi155.stdout: "initiated_at": "2023-08-01T19:54:56.094823+0000", 2023-08-01T19:54:56.104 INFO:teuthology.orchestra.run.smithi155.stdout: "age": 0.0064058869999999999, 2023-08-01T19:54:56.104 INFO:teuthology.orchestra.run.smithi155.stdout: "duration": 0.006436092, 2023-08-01T19:54:56.104 INFO:teuthology.orchestra.run.smithi155.stdout: "type_data": { 2023-08-01T19:54:56.104 INFO:teuthology.orchestra.run.smithi155.stdout: "flag_point": "waiting for sub ops", 2023-08-01T19:54:56.104 INFO:teuthology.orchestra.run.smithi155.stdout: "client_info": { 2023-08-01T19:54:56.104 INFO:teuthology.orchestra.run.smithi155.stdout: "client": "client.4668", 2023-08-01T19:54:56.104 INFO:teuthology.orchestra.run.smithi155.stdout: "client_addr": "172.21.15.6:0/1709472247", 2023-08-01T19:54:56.105 INFO:teuthology.orchestra.run.smithi155.stdout: "tid": 82586 2023-08-01T19:54:56.105 INFO:teuthology.orchestra.run.smithi155.stdout: }, 2023-08-01T19:54:56.105 INFO:teuthology.orchestra.run.smithi155.stdout: "events": [ 2023-08-01T19:54:56.105 INFO:teuthology.orchestra.run.smithi155.stdout: { 2023-08-01T19:54:56.105 INFO:teuthology.orchestra.run.smithi155.stdout: "event": "initiated", 2023-08-01T19:54:56.105 INFO:teuthology.orchestra.run.smithi155.stdout: "time": "2023-08-01T19:54:56.094823+0000", 2023-08-01T19:54:56.105 INFO:teuthology.orchestra.run.smithi155.stdout: "duration": 0 2023-08-01T19:54:56.105 INFO:teuthology.orchestra.run.smithi155.stdout: }, 2023-08-01T19:54:56.106 INFO:teuthology.orchestra.run.smithi155.stdout: { 2023-08-01T19:54:56.106 INFO:teuthology.orchestra.run.smithi155.stdout: "event": "throttled", 2023-08-01T19:54:56.106 INFO:teuthology.orchestra.run.smithi155.stdout: "time": "2023-08-01T19:54:56.094823+0000", 2023-08-01T19:54:56.106 INFO:teuthology.orchestra.run.smithi155.stdout: "duration": 0 2023-08-01T19:54:56.106 INFO:teuthology.orchestra.run.smithi155.stdout: }, 2023-08-01T19:54:56.106 INFO:teuthology.orchestra.run.smithi155.stdout: { 2023-08-01T19:54:56.106 INFO:teuthology.orchestra.run.smithi155.stdout: "event": "header_read", 2023-08-01T19:54:56.107 INFO:teuthology.orchestra.run.smithi155.stdout: "time": "2023-08-01T19:54:56.094822+0000", 2023-08-01T19:54:56.107 INFO:teuthology.orchestra.run.smithi155.stdout: "duration": 4294967295.999999 2023-08-01T19:54:56.107 INFO:teuthology.orchestra.run.smithi155.stdout: }, 2023-08-01T19:54:56.107 INFO:teuthology.orchestra.run.smithi155.stdout: { 2023-08-01T19:54:56.107 INFO:teuthology.orchestra.run.smithi155.stdout: "event": "all_read", 2023-08-01T19:54:56.107 INFO:teuthology.orchestra.run.smithi155.stdout: "time": "2023-08-01T19:54:56.094930+0000", 2023-08-01T19:54:56.107 INFO:teuthology.orchestra.run.smithi155.stdout: "duration": 0.00010833800000000001 2023-08-01T19:54:56.107 INFO:teuthology.orchestra.run.smithi155.stdout: }, 2023-08-01T19:54:56.108 INFO:teuthology.orchestra.run.smithi155.stdout: { 2023-08-01T19:54:56.108 INFO:teuthology.orchestra.run.smithi155.stdout: "event": "dispatched", 2023-08-01T19:54:56.108 INFO:teuthology.orchestra.run.smithi155.stdout: "time": "2023-08-01T19:54:56.094939+0000", 2023-08-01T19:54:56.108 INFO:teuthology.orchestra.run.smithi155.stdout: "duration": 8.7129999999999994e-06 2023-08-01T19:54:56.108 INFO:teuthology.orchestra.run.smithi155.stdout: }, 2023-08-01T19:54:56.108 INFO:teuthology.orchestra.run.smithi155.stdout: { 2023-08-01T19:54:56.108 INFO:teuthology.orchestra.run.smithi155.stdout: "event": "queued_for_pg", 2023-08-01T19:54:56.109 INFO:teuthology.orchestra.run.smithi155.stdout: "time": "2023-08-01T19:54:56.094943+0000", 2023-08-01T19:54:56.109 INFO:teuthology.orchestra.run.smithi155.stdout: "duration": 3.9160000000000003e-06 2023-08-01T19:54:56.109 INFO:teuthology.orchestra.run.smithi155.stdout: }, 2023-08-01T19:54:56.109 INFO:teuthology.orchestra.run.smithi155.stdout: { 2023-08-01T19:54:56.109 INFO:teuthology.orchestra.run.smithi155.stdout: "event": "reached_pg", 2023-08-01T19:54:56.109 INFO:teuthology.orchestra.run.smithi155.stdout: "time": "2023-08-01T19:54:56.094983+0000", 2023-08-01T19:54:56.109 INFO:teuthology.orchestra.run.smithi155.stdout: "duration": 4.0059999999999999e-05 2023-08-01T19:54:56.109 INFO:teuthology.orchestra.run.smithi155.stdout: }, 2023-08-01T19:54:56.110 INFO:teuthology.orchestra.run.smithi155.stdout: { 2023-08-01T19:54:56.110 INFO:teuthology.orchestra.run.smithi155.stdout: "event": "started", 2023-08-01T19:54:56.110 INFO:teuthology.orchestra.run.smithi155.stdout: "time": "2023-08-01T19:54:56.095104+0000", 2023-08-01T19:54:56.110 INFO:teuthology.orchestra.run.smithi155.stdout: "duration": 0.000121439 2023-08-01T19:54:56.110 INFO:teuthology.orchestra.run.smithi155.stdout: }, 2023-08-01T19:54:56.110 INFO:teuthology.orchestra.run.smithi155.stdout: { 2023-08-01T19:54:56.110 INFO:teuthology.orchestra.run.smithi155.stdout: "event": "waiting for subops from 0", 2023-08-01T19:54:56.110 INFO:teuthology.orchestra.run.smithi155.stdout: "time": "2023-08-01T19:54:56.095277+0000", 2023-08-01T19:54:56.111 INFO:teuthology.orchestra.run.smithi155.stdout: "duration": 0.00017234499999999999 2023-08-01T19:54:56.111 INFO:teuthology.orchestra.run.smithi155.stdout: }, 2023-08-01T19:54:56.111 INFO:teuthology.orchestra.run.smithi155.stdout: { 2023-08-01T19:54:56.111 INFO:teuthology.orchestra.run.smithi155.stdout: "event": "op_commit", 2023-08-01T19:54:56.111 INFO:teuthology.orchestra.run.smithi155.stdout: "time": "2023-08-01T19:54:56.100088+0000", 2023-08-01T19:54:56.111 INFO:teuthology.orchestra.run.smithi155.stdout: "duration": 0.0048113729999999999 2023-08-01T19:54:56.111 INFO:teuthology.orchestra.run.smithi155.stdout: } 2023-08-01T19:54:56.111 INFO:teuthology.orchestra.run.smithi155.stdout: ] 2023-08-01T19:54:56.112 INFO:teuthology.orchestra.run.smithi155.stdout: } 2023-08-01T19:54:56.112 INFO:teuthology.orchestra.run.smithi155.stdout: }, 2023-08-01T19:54:56.112 INFO:teuthology.orchestra.run.smithi155.stdout: { 2023-08-01T19:54:56.112 INFO:teuthology.orchestra.run.smithi155.stdout: "description": "osd_op(client.4668.0:82587 5.b 5:df4b8ba2:::benchmark_data_smithi006_114134_object82586:head [set-alloc-hint object_size 65536 write_size 65536,write 0~65536 in=65536b] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e34)", 2023-08-01T19:54:56.112 INFO:teuthology.orchestra.run.smithi155.stdout: "initiated_at": "2023-08-01T19:54:56.095006+0000", 2023-08-01T19:54:56.112 INFO:teuthology.orchestra.run.smithi155.stdout: "age": 0.0062230289999999997, 2023-08-01T19:54:56.112 INFO:teuthology.orchestra.run.smithi155.stdout: "duration": 0.0063110129999999999, 2023-08-01T19:54:56.113 INFO:teuthology.orchestra.run.smithi155.stdout: "type_data": { 2023-08-01T19:54:56.113 INFO:teuthology.orchestra.run.smithi155.stdout: "flag_point": "waiting for sub ops", 2023-08-01T19:54:56.113 INFO:teuthology.orchestra.run.smithi155.stdout: "client_info": { 2023-08-01T19:54:56.113 INFO:teuthology.orchestra.run.smithi155.stdout: "client": "client.4668", 2023-08-01T19:54:56.113 INFO:teuthology.orchestra.run.smithi155.stdout: "client_addr": "172.21.15.6:0/1709472247", 2023-08-01T19:54:56.113 INFO:teuthology.orchestra.run.smithi155.stdout: "tid": 82587 2023-08-01T19:54:56.113 INFO:teuthology.orchestra.run.smithi155.stdout: }, 2023-08-01T19:54:56.113 INFO:teuthology.orchestra.run.smithi155.stdout: "events": [ 2023-08-01T19:54:56.114 INFO:teuthology.orchestra.run.smithi155.stdout: { 2023-08-01T19:54:56.114 INFO:teuthology.orchestra.run.smithi155.stdout: "event": "initiated", 2023-08-01T19:54:56.114 INFO:teuthology.orchestra.run.smithi155.stdout: "time": "2023-08-01T19:54:56.095006+0000", 2023-08-01T19:54:56.114 INFO:teuthology.orchestra.run.smithi155.stdout: "duration": 0 2023-08-01T19:54:56.114 INFO:teuthology.orchestra.run.smithi155.stdout: }, 2023-08-01T19:54:56.114 INFO:teuthology.orchestra.run.smithi155.stdout: { 2023-08-01T19:54:56.114 INFO:teuthology.orchestra.run.smithi155.stdout: "event": "throttled", 2023-08-01T19:54:56.114 INFO:teuthology.orchestra.run.smithi155.stdout: "time": "2023-08-01T19:54:56.095006+0000", 2023-08-01T19:54:56.115 INFO:teuthology.orchestra.run.smithi155.stdout: "duration": 0 2023-08-01T19:54:56.115 INFO:teuthology.orchestra.run.smithi155.stdout: }, 2023-08-01T19:54:56.115 INFO:teuthology.orchestra.run.smithi155.stdout: { 2023-08-01T19:54:56.115 INFO:teuthology.orchestra.run.smithi155.stdout: "event": "header_read", 2023-08-01T19:54:56.115 INFO:teuthology.orchestra.run.smithi155.stdout: "time": "2023-08-01T19:54:56.095005+0000", 2023-08-01T19:54:56.115 INFO:teuthology.orchestra.run.smithi155.stdout: "duration": 4294967295.9999995 2023-08-01T19:54:56.115 INFO:teuthology.orchestra.run.smithi155.stdout: }, 2023-08-01T19:54:56.116 INFO:teuthology.orchestra.run.smithi155.stdout: { 2023-08-01T19:54:56.116 INFO:teuthology.orchestra.run.smithi155.stdout: "event": "all_read", 2023-08-01T19:54:56.116 INFO:teuthology.orchestra.run.smithi155.stdout: "time": "2023-08-01T19:54:56.095068+0000", 2023-08-01T19:54:56.116 INFO:teuthology.orchestra.run.smithi155.stdout: "duration": 6.2856999999999998e-05 2023-08-01T19:54:56.116 INFO:teuthology.orchestra.run.smithi155.stdout: }, 2023-08-01T19:54:56.116 INFO:teuthology.orchestra.run.smithi155.stdout: { 2023-08-01T19:54:56.116 INFO:teuthology.orchestra.run.smithi155.stdout: "event": "dispatched", 2023-08-01T19:54:56.117 INFO:teuthology.orchestra.run.smithi155.stdout: "time": "2023-08-01T19:54:56.095073+0000", 2023-08-01T19:54:56.117 INFO:teuthology.orchestra.run.smithi155.stdout: "duration": 5.3850000000000001e-06 2023-08-01T19:54:56.117 INFO:teuthology.orchestra.run.smithi155.stdout: }, 2023-08-01T19:54:56.117 INFO:teuthology.orchestra.run.smithi155.stdout: { 2023-08-01T19:54:56.117 INFO:teuthology.orchestra.run.smithi155.stdout: "event": "queued_for_pg", 2023-08-01T19:54:56.117 INFO:teuthology.orchestra.run.smithi155.stdout: "time": "2023-08-01T19:54:56.095076+0000", 2023-08-01T19:54:56.117 INFO:teuthology.orchestra.run.smithi155.stdout: "duration": 2.773e-06 2023-08-01T19:54:56.117 INFO:teuthology.orchestra.run.smithi155.stdout: }, 2023-08-01T19:54:56.118 INFO:teuthology.orchestra.run.smithi155.stdout: { 2023-08-01T19:54:56.118 INFO:teuthology.orchestra.run.smithi155.stdout: "event": "reached_pg", 2023-08-01T19:54:56.118 INFO:teuthology.orchestra.run.smithi155.stdout: "time": "2023-08-01T19:54:56.097061+0000", 2023-08-01T19:54:56.118 INFO:teuthology.orchestra.run.smithi155.stdout: "duration": 0.0019846540000000002 2023-08-01T19:54:56.118 INFO:teuthology.orchestra.run.smithi155.stdout: }, 2023-08-01T19:54:56.118 INFO:teuthology.orchestra.run.smithi155.stdout: { 2023-08-01T19:54:56.118 INFO:teuthology.orchestra.run.smithi155.stdout: "event": "started", 2023-08-01T19:54:56.118 INFO:teuthology.orchestra.run.smithi155.stdout: "time": "2023-08-01T19:54:56.097247+0000", 2023-08-01T19:54:56.119 INFO:teuthology.orchestra.run.smithi155.stdout: "duration": 0.00018596899999999999 2023-08-01T19:54:56.119 INFO:teuthology.orchestra.run.smithi155.stdout: }, 2023-08-01T19:54:56.119 INFO:teuthology.orchestra.run.smithi155.stdout: { 2023-08-01T19:54:56.119 INFO:teuthology.orchestra.run.smithi155.stdout: "event": "waiting for subops from 0", 2023-08-01T19:54:56.119 INFO:teuthology.orchestra.run.smithi155.stdout: "time": "2023-08-01T19:54:56.097396+0000", 2023-08-01T19:54:56.119 INFO:teuthology.orchestra.run.smithi155.stdout: "duration": 0.000148782 2023-08-01T19:54:56.119 INFO:teuthology.orchestra.run.smithi155.stdout: } 2023-08-01T19:54:56.119 INFO:teuthology.orchestra.run.smithi155.stdout: ] 2023-08-01T19:54:56.120 INFO:teuthology.orchestra.run.smithi155.stdout: } 2023-08-01T19:54:56.120 INFO:teuthology.orchestra.run.smithi155.stdout: }, 2023-08-01T19:54:56.120 INFO:teuthology.orchestra.run.smithi155.stdout: { 2023-08-01T19:54:56.120 INFO:teuthology.orchestra.run.smithi155.stdout: "description": "osd_op(client.4668.0:82589 5.0 5:04ab4a25:::benchmark_data_smithi006_114134_object82588:head [set-alloc-hint object_size 65536 write_size 65536,write 0~65536 in=65536b] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e34)", 2023-08-01T19:54:56.120 INFO:teuthology.orchestra.run.smithi155.stdout: "initiated_at": "2023-08-01T19:54:56.096024+0000", 2023-08-01T19:54:56.120 INFO:teuthology.orchestra.run.smithi155.stdout: "age": 0.0052044939999999996, 2023-08-01T19:54:56.120 INFO:teuthology.orchestra.run.smithi155.stdout: "duration": 0.0053374779999999997, 2023-08-01T19:54:56.121 INFO:teuthology.orchestra.run.smithi155.stdout: "type_data": { 2023-08-01T19:54:56.121 INFO:teuthology.orchestra.run.smithi155.stdout: "flag_point": "waiting for sub ops", 2023-08-01T19:54:56.121 INFO:teuthology.orchestra.run.smithi155.stdout: "client_info": { 2023-08-01T19:54:56.121 INFO:teuthology.orchestra.run.smithi155.stdout: "client": "client.4668", 2023-08-01T19:54:56.121 INFO:teuthology.orchestra.run.smithi155.stdout: "client_addr": "172.21.15.6:0/1709472247", 2023-08-01T19:54:56.121 INFO:teuthology.orchestra.run.smithi155.stdout: "tid": 82589 2023-08-01T19:54:56.121 INFO:teuthology.orchestra.run.smithi155.stdout: }, 2023-08-01T19:54:56.121 INFO:teuthology.orchestra.run.smithi155.stdout: "events": [ 2023-08-01T19:54:56.122 INFO:teuthology.orchestra.run.smithi155.stdout: { 2023-08-01T19:54:56.122 INFO:teuthology.orchestra.run.smithi155.stdout: "event": "initiated", 2023-08-01T19:54:56.122 INFO:teuthology.orchestra.run.smithi155.stdout: "time": "2023-08-01T19:54:56.096024+0000", 2023-08-01T19:54:56.122 INFO:teuthology.orchestra.run.smithi155.stdout: "duration": 0 2023-08-01T19:54:56.122 INFO:teuthology.orchestra.run.smithi155.stdout: }, 2023-08-01T19:54:56.122 INFO:teuthology.orchestra.run.smithi155.stdout: { 2023-08-01T19:54:56.122 INFO:teuthology.orchestra.run.smithi155.stdout: "event": "throttled", 2023-08-01T19:54:56.122 INFO:teuthology.orchestra.run.smithi155.stdout: "time": "2023-08-01T19:54:56.096024+0000", 2023-08-01T19:54:56.123 INFO:teuthology.orchestra.run.smithi155.stdout: "duration": 0 2023-08-01T19:54:56.123 INFO:teuthology.orchestra.run.smithi155.stdout: }, 2023-08-01T19:54:56.123 INFO:teuthology.orchestra.run.smithi155.stdout: { 2023-08-01T19:54:56.123 INFO:teuthology.orchestra.run.smithi155.stdout: "event": "header_read", 2023-08-01T19:54:56.123 INFO:teuthology.orchestra.run.smithi155.stdout: "time": "2023-08-01T19:54:56.096024+0000", 2023-08-01T19:54:56.123 INFO:teuthology.orchestra.run.smithi155.stdout: "duration": 4294967295.999999 2023-08-01T19:54:56.123 INFO:teuthology.orchestra.run.smithi155.stdout: }, 2023-08-01T19:54:56.123 INFO:teuthology.orchestra.run.smithi155.stdout: { 2023-08-01T19:54:56.124 INFO:teuthology.orchestra.run.smithi155.stdout: "event": "all_read", 2023-08-01T19:54:56.124 INFO:teuthology.orchestra.run.smithi155.stdout: "time": "2023-08-01T19:54:56.096136+0000", 2023-08-01T19:54:56.124 INFO:teuthology.orchestra.run.smithi155.stdout: "duration": 0.00011246199999999999 2023-08-01T19:54:56.124 INFO:teuthology.orchestra.run.smithi155.stdout: }, 2023-08-01T19:54:56.124 INFO:teuthology.orchestra.run.smithi155.stdout: { 2023-08-01T19:54:56.124 INFO:teuthology.orchestra.run.smithi155.stdout: "event": "dispatched", 2023-08-01T19:54:56.124 INFO:teuthology.orchestra.run.smithi155.stdout: "time": "2023-08-01T19:54:56.096148+0000", 2023-08-01T19:54:56.125 INFO:teuthology.orchestra.run.smithi155.stdout: "duration": 1.1766999999999999e-05 2023-08-01T19:54:56.125 INFO:teuthology.orchestra.run.smithi155.stdout: }, 2023-08-01T19:54:56.125 INFO:teuthology.orchestra.run.smithi155.stdout: { 2023-08-01T19:54:56.125 INFO:teuthology.orchestra.run.smithi155.stdout: "event": "queued_for_pg", 2023-08-01T19:54:56.125 INFO:teuthology.orchestra.run.smithi155.stdout: "time": "2023-08-01T19:54:56.096153+0000", 2023-08-01T19:54:56.125 INFO:teuthology.orchestra.run.smithi155.stdout: "duration": 5.4700000000000001e-06 2023-08-01T19:54:56.125 INFO:teuthology.orchestra.run.smithi155.stdout: }, 2023-08-01T19:54:56.125 INFO:teuthology.orchestra.run.smithi155.stdout: { 2023-08-01T19:54:56.126 INFO:teuthology.orchestra.run.smithi155.stdout: "event": "reached_pg", 2023-08-01T19:54:56.126 INFO:teuthology.orchestra.run.smithi155.stdout: "time": "2023-08-01T19:54:56.096197+0000", 2023-08-01T19:54:56.126 INFO:teuthology.orchestra.run.smithi155.stdout: "duration": 4.4224999999999998e-05 2023-08-01T19:54:56.126 INFO:teuthology.orchestra.run.smithi155.stdout: }, 2023-08-01T19:54:56.126 INFO:teuthology.orchestra.run.smithi155.stdout: { 2023-08-01T19:54:56.126 INFO:teuthology.orchestra.run.smithi155.stdout: "event": "started", 2023-08-01T19:54:56.126 INFO:teuthology.orchestra.run.smithi155.stdout: "time": "2023-08-01T19:54:56.096328+0000", 2023-08-01T19:54:56.127 INFO:teuthology.orchestra.run.smithi155.stdout: "duration": 0.00013016199999999999 2023-08-01T19:54:56.127 INFO:teuthology.orchestra.run.smithi155.stdout: }, 2023-08-01T19:54:56.127 INFO:teuthology.orchestra.run.smithi155.stdout: { 2023-08-01T19:54:56.127 INFO:teuthology.orchestra.run.smithi155.stdout: "event": "waiting for subops from 0", 2023-08-01T19:54:56.127 INFO:teuthology.orchestra.run.smithi155.stdout: "time": "2023-08-01T19:54:56.096473+0000", 2023-08-01T19:54:56.127 INFO:teuthology.orchestra.run.smithi155.stdout: "duration": 0.00014496299999999999 2023-08-01T19:54:56.127 INFO:teuthology.orchestra.run.smithi155.stdout: }, 2023-08-01T19:54:56.127 INFO:teuthology.orchestra.run.smithi155.stdout: { 2023-08-01T19:54:56.128 INFO:teuthology.orchestra.run.smithi155.stdout: "event": "op_commit", 2023-08-01T19:54:56.128 INFO:teuthology.orchestra.run.smithi155.stdout: "time": "2023-08-01T19:54:56.100002+0000", 2023-08-01T19:54:56.128 INFO:teuthology.orchestra.run.smithi155.stdout: "duration": 0.0035294089999999998 2023-08-01T19:54:56.128 INFO:teuthology.orchestra.run.smithi155.stdout: } 2023-08-01T19:54:56.128 INFO:teuthology.orchestra.run.smithi155.stdout: ] 2023-08-01T19:54:56.128 INFO:teuthology.orchestra.run.smithi155.stdout: } 2023-08-01T19:54:56.128 INFO:teuthology.orchestra.run.smithi155.stdout: }, 2023-08-01T19:54:56.128 INFO:teuthology.orchestra.run.smithi155.stdout: { 2023-08-01T19:54:56.129 INFO:teuthology.orchestra.run.smithi155.stdout: "description": "osd_op(client.4668.0:82593 5.e 5:7639fae9:::benchmark_data_smithi006_114134_object82592:head [set-alloc-hint object_size 65536 write_size 65536,write 0~65536 in=65536b] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e34)", 2023-08-01T19:54:56.129 INFO:teuthology.orchestra.run.smithi155.stdout: "initiated_at": "2023-08-01T19:54:56.096946+0000", 2023-08-01T19:54:56.129 INFO:teuthology.orchestra.run.smithi155.stdout: "age": 0.004282714, 2023-08-01T19:54:56.129 INFO:teuthology.orchestra.run.smithi155.stdout: "duration": 0.0044624679999999998, 2023-08-01T19:54:56.129 INFO:teuthology.orchestra.run.smithi155.stdout: "type_data": { 2023-08-01T19:54:56.129 INFO:teuthology.orchestra.run.smithi155.stdout: "flag_point": "waiting for sub ops", 2023-08-01T19:54:56.129 INFO:teuthology.orchestra.run.smithi155.stdout: "client_info": { 2023-08-01T19:54:56.130 INFO:teuthology.orchestra.run.smithi155.stdout: "client": "client.4668", 2023-08-01T19:54:56.130 INFO:teuthology.orchestra.run.smithi155.stdout: "client_addr": "172.21.15.6:0/1709472247", 2023-08-01T19:54:56.130 INFO:teuthology.orchestra.run.smithi155.stdout: "tid": 82593 2023-08-01T19:54:56.130 INFO:teuthology.orchestra.run.smithi155.stdout: }, 2023-08-01T19:54:56.130 INFO:teuthology.orchestra.run.smithi155.stdout: "events": [ 2023-08-01T19:54:56.130 INFO:teuthology.orchestra.run.smithi155.stdout: { 2023-08-01T19:54:56.130 INFO:teuthology.orchestra.run.smithi155.stdout: "event": "initiated", 2023-08-01T19:54:56.130 INFO:teuthology.orchestra.run.smithi155.stdout: "time": "2023-08-01T19:54:56.096946+0000", 2023-08-01T19:54:56.131 INFO:teuthology.orchestra.run.smithi155.stdout: "duration": 0 2023-08-01T19:54:56.131 INFO:teuthology.orchestra.run.smithi155.stdout: }, 2023-08-01T19:54:56.131 INFO:teuthology.orchestra.run.smithi155.stdout: { 2023-08-01T19:54:56.131 INFO:teuthology.orchestra.run.smithi155.stdout: "event": "throttled", 2023-08-01T19:54:56.131 INFO:teuthology.orchestra.run.smithi155.stdout: "time": "2023-08-01T19:54:56.096946+0000", 2023-08-01T19:54:56.131 INFO:teuthology.orchestra.run.smithi155.stdout: "duration": 0 2023-08-01T19:54:56.131 INFO:teuthology.orchestra.run.smithi155.stdout: }, 2023-08-01T19:54:56.131 INFO:teuthology.orchestra.run.smithi155.stdout: { 2023-08-01T19:54:56.132 INFO:teuthology.orchestra.run.smithi155.stdout: "event": "header_read", 2023-08-01T19:54:56.132 INFO:teuthology.orchestra.run.smithi155.stdout: "time": "2023-08-01T19:54:56.096945+0000", 2023-08-01T19:54:56.132 INFO:teuthology.orchestra.run.smithi155.stdout: "duration": 4294967295.999999 2023-08-01T19:54:56.132 INFO:teuthology.orchestra.run.smithi155.stdout: }, 2023-08-01T19:54:56.132 INFO:teuthology.orchestra.run.smithi155.stdout: { 2023-08-01T19:54:56.132 INFO:teuthology.orchestra.run.smithi155.stdout: "event": "all_read", 2023-08-01T19:54:56.132 INFO:teuthology.orchestra.run.smithi155.stdout: "time": "2023-08-01T19:54:56.097004+0000", 2023-08-01T19:54:56.132 INFO:teuthology.orchestra.run.smithi155.stdout: "duration": 5.9273e-05 2023-08-01T19:54:56.133 INFO:teuthology.orchestra.run.smithi155.stdout: }, 2023-08-01T19:54:56.133 INFO:teuthology.orchestra.run.smithi155.stdout: { 2023-08-01T19:54:56.133 INFO:teuthology.orchestra.run.smithi155.stdout: "event": "dispatched", 2023-08-01T19:54:56.133 INFO:teuthology.orchestra.run.smithi155.stdout: "time": "2023-08-01T19:54:56.097016+0000", 2023-08-01T19:54:56.133 INFO:teuthology.orchestra.run.smithi155.stdout: "duration": 1.2021999999999999e-05 2023-08-01T19:54:56.133 INFO:teuthology.orchestra.run.smithi155.stdout: }, 2023-08-01T19:54:56.133 INFO:teuthology.orchestra.run.smithi155.stdout: { 2023-08-01T19:54:56.133 INFO:teuthology.orchestra.run.smithi155.stdout: "event": "queued_for_pg", 2023-08-01T19:54:56.134 INFO:teuthology.orchestra.run.smithi155.stdout: "time": "2023-08-01T19:54:56.097022+0000", 2023-08-01T19:54:56.134 INFO:teuthology.orchestra.run.smithi155.stdout: "duration": 5.8340000000000004e-06 2023-08-01T19:54:56.134 INFO:teuthology.orchestra.run.smithi155.stdout: }, 2023-08-01T19:54:56.134 INFO:teuthology.orchestra.run.smithi155.stdout: { 2023-08-01T19:54:56.134 INFO:teuthology.orchestra.run.smithi155.stdout: "event": "reached_pg", 2023-08-01T19:54:56.134 INFO:teuthology.orchestra.run.smithi155.stdout: "time": "2023-08-01T19:54:56.097060+0000", 2023-08-01T19:54:56.134 INFO:teuthology.orchestra.run.smithi155.stdout: "duration": 3.8158000000000003e-05 2023-08-01T19:54:56.135 INFO:teuthology.orchestra.run.smithi155.stdout: }, 2023-08-01T19:54:56.135 INFO:teuthology.orchestra.run.smithi155.stdout: { 2023-08-01T19:54:56.135 INFO:teuthology.orchestra.run.smithi155.stdout: "event": "started", 2023-08-01T19:54:56.135 INFO:teuthology.orchestra.run.smithi155.stdout: "time": "2023-08-01T19:54:56.097193+0000", 2023-08-01T19:54:56.135 INFO:teuthology.orchestra.run.smithi155.stdout: "duration": 0.00013260600000000001 2023-08-01T19:54:56.135 INFO:teuthology.orchestra.run.smithi155.stdout: }, 2023-08-01T19:54:56.136 INFO:teuthology.orchestra.run.smithi155.stdout: { 2023-08-01T19:54:56.136 INFO:teuthology.orchestra.run.smithi155.stdout: "event": "waiting for subops from 0", 2023-08-01T19:54:56.136 INFO:teuthology.orchestra.run.smithi155.stdout: "time": "2023-08-01T19:54:56.097333+0000", 2023-08-01T19:54:56.136 INFO:teuthology.orchestra.run.smithi155.stdout: "duration": 0.00014043700000000001 2023-08-01T19:54:56.136 INFO:teuthology.orchestra.run.smithi155.stdout: }, 2023-08-01T19:54:56.136 INFO:teuthology.orchestra.run.smithi155.stdout: { 2023-08-01T19:54:56.136 INFO:teuthology.orchestra.run.smithi155.stdout: "event": "op_commit", 2023-08-01T19:54:56.137 INFO:teuthology.orchestra.run.smithi155.stdout: "time": "2023-08-01T19:54:56.101139+0000", 2023-08-01T19:54:56.137 INFO:teuthology.orchestra.run.smithi155.stdout: "duration": 0.0038051420000000001 2023-08-01T19:54:56.137 INFO:teuthology.orchestra.run.smithi155.stdout: } 2023-08-01T19:54:56.137 INFO:teuthology.orchestra.run.smithi155.stdout: ] 2023-08-01T19:54:56.137 INFO:teuthology.orchestra.run.smithi155.stdout: } 2023-08-01T19:54:56.137 INFO:teuthology.orchestra.run.smithi155.stdout: }, 2023-08-01T19:54:56.137 INFO:teuthology.orchestra.run.smithi155.stdout: { 2023-08-01T19:54:56.138 INFO:teuthology.orchestra.run.smithi155.stdout: "description": "osd_op(client.4668.0:82596 5.0 5:08e5df3e:::benchmark_data_smithi006_114134_object82595:head [set-alloc-hint object_size 65536 write_size 65536,write 0~65536 in=65536b] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e34)", 2023-08-01T19:54:56.138 INFO:teuthology.orchestra.run.smithi155.stdout: "initiated_at": "2023-08-01T19:54:56.100086+0000", 2023-08-01T19:54:56.138 INFO:teuthology.orchestra.run.smithi155.stdout: "age": 0.0011429739999999999, 2023-08-01T19:54:56.138 INFO:teuthology.orchestra.run.smithi155.stdout: "duration": 0.0013679180000000001, 2023-08-01T19:54:56.138 INFO:teuthology.orchestra.run.smithi155.stdout: "type_data": { 2023-08-01T19:54:56.138 INFO:teuthology.orchestra.run.smithi155.stdout: "flag_point": "waiting for sub ops", 2023-08-01T19:54:56.138 INFO:teuthology.orchestra.run.smithi155.stdout: "client_info": { 2023-08-01T19:54:56.139 INFO:teuthology.orchestra.run.smithi155.stdout: "client": "client.4668", 2023-08-01T19:54:56.139 INFO:teuthology.orchestra.run.smithi155.stdout: "client_addr": "172.21.15.6:0/1709472247", 2023-08-01T19:54:56.139 INFO:teuthology.orchestra.run.smithi155.stdout: "tid": 82596 2023-08-01T19:54:56.139 INFO:teuthology.orchestra.run.smithi155.stdout: }, 2023-08-01T19:54:56.139 INFO:teuthology.orchestra.run.smithi155.stdout: "events": [ 2023-08-01T19:54:56.139 INFO:teuthology.orchestra.run.smithi155.stdout: { 2023-08-01T19:54:56.139 INFO:teuthology.orchestra.run.smithi155.stdout: "event": "initiated", 2023-08-01T19:54:56.139 INFO:teuthology.orchestra.run.smithi155.stdout: "time": "2023-08-01T19:54:56.100086+0000", 2023-08-01T19:54:56.140 INFO:teuthology.orchestra.run.smithi155.stdout: "duration": 0 2023-08-01T19:54:56.140 INFO:teuthology.orchestra.run.smithi155.stdout: }, 2023-08-01T19:54:56.140 INFO:teuthology.orchestra.run.smithi155.stdout: { 2023-08-01T19:54:56.140 INFO:teuthology.orchestra.run.smithi155.stdout: "event": "throttled", 2023-08-01T19:54:56.140 INFO:teuthology.orchestra.run.smithi155.stdout: "time": "2023-08-01T19:54:56.100086+0000", 2023-08-01T19:54:56.140 INFO:teuthology.orchestra.run.smithi155.stdout: "duration": 0 2023-08-01T19:54:56.140 INFO:teuthology.orchestra.run.smithi155.stdout: }, 2023-08-01T19:54:56.141 INFO:teuthology.orchestra.run.smithi155.stdout: { 2023-08-01T19:54:56.141 INFO:teuthology.orchestra.run.smithi155.stdout: "event": "header_read", 2023-08-01T19:54:56.141 INFO:teuthology.orchestra.run.smithi155.stdout: "time": "2023-08-01T19:54:56.100085+0000", 2023-08-01T19:54:56.141 INFO:teuthology.orchestra.run.smithi155.stdout: "duration": 4294967295.999999 2023-08-01T19:54:56.141 INFO:teuthology.orchestra.run.smithi155.stdout: }, 2023-08-01T19:54:56.141 INFO:teuthology.orchestra.run.smithi155.stdout: { 2023-08-01T19:54:56.141 INFO:teuthology.orchestra.run.smithi155.stdout: "event": "all_read", 2023-08-01T19:54:56.141 INFO:teuthology.orchestra.run.smithi155.stdout: "time": "2023-08-01T19:54:56.100206+0000", 2023-08-01T19:54:56.142 INFO:teuthology.orchestra.run.smithi155.stdout: "duration": 0.000121712 2023-08-01T19:54:56.142 INFO:teuthology.orchestra.run.smithi155.stdout: }, 2023-08-01T19:54:56.142 INFO:teuthology.orchestra.run.smithi155.stdout: { 2023-08-01T19:54:56.142 INFO:teuthology.orchestra.run.smithi155.stdout: "event": "dispatched", 2023-08-01T19:54:56.142 INFO:teuthology.orchestra.run.smithi155.stdout: "time": "2023-08-01T19:54:56.100235+0000", 2023-08-01T19:54:56.142 INFO:teuthology.orchestra.run.smithi155.stdout: "duration": 2.8886000000000001e-05 2023-08-01T19:54:56.142 INFO:teuthology.orchestra.run.smithi155.stdout: }, 2023-08-01T19:54:56.143 INFO:teuthology.orchestra.run.smithi155.stdout: { 2023-08-01T19:54:56.143 INFO:teuthology.orchestra.run.smithi155.stdout: "event": "queued_for_pg", 2023-08-01T19:54:56.143 INFO:teuthology.orchestra.run.smithi155.stdout: "time": "2023-08-01T19:54:56.100260+0000", 2023-08-01T19:54:56.143 INFO:teuthology.orchestra.run.smithi155.stdout: "duration": 2.5004e-05 2023-08-01T19:54:56.143 INFO:teuthology.orchestra.run.smithi155.stdout: }, 2023-08-01T19:54:56.143 INFO:teuthology.orchestra.run.smithi155.stdout: { 2023-08-01T19:54:56.143 INFO:teuthology.orchestra.run.smithi155.stdout: "event": "reached_pg", 2023-08-01T19:54:56.144 INFO:teuthology.orchestra.run.smithi155.stdout: "time": "2023-08-01T19:54:56.100302+0000", 2023-08-01T19:54:56.144 INFO:teuthology.orchestra.run.smithi155.stdout: "duration": 4.1727000000000002e-05 2023-08-01T19:54:56.144 INFO:teuthology.orchestra.run.smithi155.stdout: }, 2023-08-01T19:54:56.144 INFO:teuthology.orchestra.run.smithi155.stdout: { 2023-08-01T19:54:56.144 INFO:teuthology.orchestra.run.smithi155.stdout: "event": "started", 2023-08-01T19:54:56.144 INFO:teuthology.orchestra.run.smithi155.stdout: "time": "2023-08-01T19:54:56.100389+0000", 2023-08-01T19:54:56.144 INFO:teuthology.orchestra.run.smithi155.stdout: "duration": 8.6811000000000006e-05 2023-08-01T19:54:56.145 INFO:teuthology.orchestra.run.smithi155.stdout: }, 2023-08-01T19:54:56.145 INFO:teuthology.orchestra.run.smithi155.stdout: { 2023-08-01T19:54:56.145 INFO:teuthology.orchestra.run.smithi155.stdout: "event": "waiting for subops from 0", 2023-08-01T19:54:56.145 INFO:teuthology.orchestra.run.smithi155.stdout: "time": "2023-08-01T19:54:56.100484+0000", 2023-08-01T19:54:56.145 INFO:teuthology.orchestra.run.smithi155.stdout: "duration": 9.5605000000000004e-05 2023-08-01T19:54:56.145 INFO:teuthology.orchestra.run.smithi155.stdout: } 2023-08-01T19:54:56.146 INFO:teuthology.orchestra.run.smithi155.stdout: ] 2023-08-01T19:54:56.146 INFO:teuthology.orchestra.run.smithi155.stdout: } 2023-08-01T19:54:56.146 INFO:teuthology.orchestra.run.smithi155.stdout: }, 2023-08-01T19:54:56.146 INFO:teuthology.orchestra.run.smithi155.stdout: { 2023-08-01T19:54:56.146 INFO:teuthology.orchestra.run.smithi155.stdout: "description": "osd_op(client.4668.0:82598 5.0 5.d5581950 (undecoded) ondisk+write+known_if_redirected+supports_pool_eio e34)", 2023-08-01T19:54:56.146 INFO:teuthology.orchestra.run.smithi155.stdout: "initiated_at": "2023-08-01T19:54:56.100280+0000", 2023-08-01T19:54:56.146 INFO:teuthology.orchestra.run.smithi155.stdout: "age": 0.00094891099999999998, 2023-08-01T19:54:56.146 INFO:teuthology.orchestra.run.smithi155.stdout: "duration": 0.001212617, 2023-08-01T19:54:56.147 INFO:teuthology.orchestra.run.smithi155.stdout: "type_data": { 2023-08-01T19:54:56.147 INFO:teuthology.orchestra.run.smithi155.stdout: "flag_point": "queued for pg", 2023-08-01T19:54:56.147 INFO:teuthology.orchestra.run.smithi155.stdout: "client_info": { 2023-08-01T19:54:56.147 INFO:teuthology.orchestra.run.smithi155.stdout: "client": "client.4668", 2023-08-01T19:54:56.147 INFO:teuthology.orchestra.run.smithi155.stdout: "client_addr": "172.21.15.6:0/1709472247", 2023-08-01T19:54:56.147 INFO:teuthology.orchestra.run.smithi155.stdout: "tid": 82598 2023-08-01T19:54:56.147 INFO:teuthology.orchestra.run.smithi155.stdout: }, 2023-08-01T19:54:56.147 INFO:teuthology.orchestra.run.smithi155.stdout: "events": [ 2023-08-01T19:54:56.148 INFO:teuthology.orchestra.run.smithi155.stdout: { 2023-08-01T19:54:56.148 INFO:teuthology.orchestra.run.smithi155.stdout: "event": "initiated", 2023-08-01T19:54:56.148 INFO:teuthology.orchestra.run.smithi155.stdout: "time": "2023-08-01T19:54:56.100280+0000", 2023-08-01T19:54:56.148 INFO:teuthology.orchestra.run.smithi155.stdout: "duration": 0 2023-08-01T19:54:56.148 INFO:teuthology.orchestra.run.smithi155.stdout: }, 2023-08-01T19:54:56.148 INFO:teuthology.orchestra.run.smithi155.stdout: { 2023-08-01T19:54:56.148 INFO:teuthology.orchestra.run.smithi155.stdout: "event": "throttled", 2023-08-01T19:54:56.149 INFO:teuthology.orchestra.run.smithi155.stdout: "time": "2023-08-01T19:54:56.100280+0000", 2023-08-01T19:54:56.149 INFO:teuthology.orchestra.run.smithi155.stdout: "duration": 0 2023-08-01T19:54:56.149 INFO:teuthology.orchestra.run.smithi155.stdout: }, 2023-08-01T19:54:56.149 INFO:teuthology.orchestra.run.smithi155.stdout: { 2023-08-01T19:54:56.149 INFO:teuthology.orchestra.run.smithi155.stdout: "event": "header_read", 2023-08-01T19:54:56.149 INFO:teuthology.orchestra.run.smithi155.stdout: "time": "2023-08-01T19:54:56.100279+0000", 2023-08-01T19:54:56.149 INFO:teuthology.orchestra.run.smithi155.stdout: "duration": 4294967295.9999995 2023-08-01T19:54:56.149 INFO:teuthology.orchestra.run.smithi155.stdout: }, 2023-08-01T19:54:56.150 INFO:teuthology.orchestra.run.smithi155.stdout: { 2023-08-01T19:54:56.150 INFO:teuthology.orchestra.run.smithi155.stdout: "event": "all_read", 2023-08-01T19:54:56.150 INFO:teuthology.orchestra.run.smithi155.stdout: "time": "2023-08-01T19:54:56.100317+0000", 2023-08-01T19:54:56.150 INFO:teuthology.orchestra.run.smithi155.stdout: "duration": 3.8155000000000003e-05 2023-08-01T19:54:56.150 INFO:teuthology.orchestra.run.smithi155.stdout: }, 2023-08-01T19:54:56.150 INFO:teuthology.orchestra.run.smithi155.stdout: { 2023-08-01T19:54:56.150 INFO:teuthology.orchestra.run.smithi155.stdout: "event": "dispatched", 2023-08-01T19:54:56.150 INFO:teuthology.orchestra.run.smithi155.stdout: "time": "2023-08-01T19:54:56.100326+0000", 2023-08-01T19:54:56.151 INFO:teuthology.orchestra.run.smithi155.stdout: "duration": 8.5639999999999997e-06 2023-08-01T19:54:56.151 INFO:teuthology.orchestra.run.smithi155.stdout: }, 2023-08-01T19:54:56.151 INFO:teuthology.orchestra.run.smithi155.stdout: { 2023-08-01T19:54:56.151 INFO:teuthology.orchestra.run.smithi155.stdout: "event": "queued_for_pg", 2023-08-01T19:54:56.151 INFO:teuthology.orchestra.run.smithi155.stdout: "time": "2023-08-01T19:54:56.100331+0000", 2023-08-01T19:54:56.151 INFO:teuthology.orchestra.run.smithi155.stdout: "duration": 5.1109999999999999e-06 2023-08-01T19:54:56.151 INFO:teuthology.orchestra.run.smithi155.stdout: } 2023-08-01T19:54:56.152 INFO:teuthology.orchestra.run.smithi155.stdout: ] 2023-08-01T19:54:56.152 INFO:teuthology.orchestra.run.smithi155.stdout: } 2023-08-01T19:54:56.152 INFO:teuthology.orchestra.run.smithi155.stdout: }, 2023-08-01T19:54:56.152 INFO:teuthology.orchestra.run.smithi155.stdout: { 2023-08-01T19:54:56.152 INFO:teuthology.orchestra.run.smithi155.stdout: "description": "osd_op(client.4668.0:82599 5.b 5:d84a5c3d:::benchmark_data_smithi006_114134_object82598:head [set-alloc-hint object_size 65536 write_size 65536,write 0~65536 in=65536b] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e34)", 2023-08-01T19:54:56.152 INFO:teuthology.orchestra.run.smithi155.stdout: "initiated_at": "2023-08-01T19:54:56.100340+0000", 2023-08-01T19:54:56.152 INFO:teuthology.orchestra.run.smithi155.stdout: "age": 0.00088855200000000003, 2023-08-01T19:54:56.152 INFO:teuthology.orchestra.run.smithi155.stdout: "duration": 0.001185066, 2023-08-01T19:54:56.153 INFO:teuthology.orchestra.run.smithi155.stdout: "type_data": { 2023-08-01T19:54:56.153 INFO:teuthology.orchestra.run.smithi155.stdout: "flag_point": "waiting for sub ops", 2023-08-01T19:54:56.153 INFO:teuthology.orchestra.run.smithi155.stdout: "client_info": { 2023-08-01T19:54:56.153 INFO:teuthology.orchestra.run.smithi155.stdout: "client": "client.4668", 2023-08-01T19:54:56.153 INFO:teuthology.orchestra.run.smithi155.stdout: "client_addr": "172.21.15.6:0/1709472247", 2023-08-01T19:54:56.153 INFO:teuthology.orchestra.run.smithi155.stdout: "tid": 82599 2023-08-01T19:54:56.153 INFO:teuthology.orchestra.run.smithi155.stdout: }, 2023-08-01T19:54:56.154 INFO:teuthology.orchestra.run.smithi155.stdout: "events": [ 2023-08-01T19:54:56.154 INFO:teuthology.orchestra.run.smithi155.stdout: { 2023-08-01T19:54:56.154 INFO:teuthology.orchestra.run.smithi155.stdout: "event": "initiated", 2023-08-01T19:54:56.154 INFO:teuthology.orchestra.run.smithi155.stdout: "time": "2023-08-01T19:54:56.100340+0000", 2023-08-01T19:54:56.154 INFO:teuthology.orchestra.run.smithi155.stdout: "duration": 0 2023-08-01T19:54:56.154 INFO:teuthology.orchestra.run.smithi155.stdout: }, 2023-08-01T19:54:56.154 INFO:teuthology.orchestra.run.smithi155.stdout: { 2023-08-01T19:54:56.154 INFO:teuthology.orchestra.run.smithi155.stdout: "event": "throttled", 2023-08-01T19:54:56.155 INFO:teuthology.orchestra.run.smithi155.stdout: "time": "2023-08-01T19:54:56.100340+0000", 2023-08-01T19:54:56.155 INFO:teuthology.orchestra.run.smithi155.stdout: "duration": 0 2023-08-01T19:54:56.155 INFO:teuthology.orchestra.run.smithi155.stdout: }, 2023-08-01T19:54:56.155 INFO:teuthology.orchestra.run.smithi155.stdout: { 2023-08-01T19:54:56.155 INFO:teuthology.orchestra.run.smithi155.stdout: "event": "header_read", 2023-08-01T19:54:56.155 INFO:teuthology.orchestra.run.smithi155.stdout: "time": "2023-08-01T19:54:56.100340+0000", 2023-08-01T19:54:56.155 INFO:teuthology.orchestra.run.smithi155.stdout: "duration": 4294967295.9999995 2023-08-01T19:54:56.155 INFO:teuthology.orchestra.run.smithi155.stdout: }, 2023-08-01T19:54:56.156 INFO:teuthology.orchestra.run.smithi155.stdout: { 2023-08-01T19:54:56.156 INFO:teuthology.orchestra.run.smithi155.stdout: "event": "all_read", 2023-08-01T19:54:56.156 INFO:teuthology.orchestra.run.smithi155.stdout: "time": "2023-08-01T19:54:56.100364+0000", 2023-08-01T19:54:56.156 INFO:teuthology.orchestra.run.smithi155.stdout: "duration": 2.3946000000000001e-05 2023-08-01T19:54:56.156 INFO:teuthology.orchestra.run.smithi155.stdout: }, 2023-08-01T19:54:56.156 INFO:teuthology.orchestra.run.smithi155.stdout: { 2023-08-01T19:54:56.156 INFO:teuthology.orchestra.run.smithi155.stdout: "event": "dispatched", 2023-08-01T19:54:56.156 INFO:teuthology.orchestra.run.smithi155.stdout: "time": "2023-08-01T19:54:56.100370+0000", 2023-08-01T19:54:56.157 INFO:teuthology.orchestra.run.smithi155.stdout: "duration": 6.905e-06 2023-08-01T19:54:56.157 INFO:teuthology.orchestra.run.smithi155.stdout: }, 2023-08-01T19:54:56.157 INFO:teuthology.orchestra.run.smithi155.stdout: { 2023-08-01T19:54:56.157 INFO:teuthology.orchestra.run.smithi155.stdout: "event": "queued_for_pg", 2023-08-01T19:54:56.157 INFO:teuthology.orchestra.run.smithi155.stdout: "time": "2023-08-01T19:54:56.100376+0000", 2023-08-01T19:54:56.157 INFO:teuthology.orchestra.run.smithi155.stdout: "duration": 5.2989999999999996e-06 2023-08-01T19:54:56.157 INFO:teuthology.orchestra.run.smithi155.stdout: }, 2023-08-01T19:54:56.158 INFO:teuthology.orchestra.run.smithi155.stdout: { 2023-08-01T19:54:56.158 INFO:teuthology.orchestra.run.smithi155.stdout: "event": "reached_pg", 2023-08-01T19:54:56.158 INFO:teuthology.orchestra.run.smithi155.stdout: "time": "2023-08-01T19:54:56.100412+0000", 2023-08-01T19:54:56.158 INFO:teuthology.orchestra.run.smithi155.stdout: "duration": 3.6534e-05 2023-08-01T19:54:56.158 INFO:teuthology.orchestra.run.smithi155.stdout: }, 2023-08-01T19:54:56.158 INFO:teuthology.orchestra.run.smithi155.stdout: { 2023-08-01T19:54:56.158 INFO:teuthology.orchestra.run.smithi155.stdout: "event": "started", 2023-08-01T19:54:56.159 INFO:teuthology.orchestra.run.smithi155.stdout: "time": "2023-08-01T19:54:56.100529+0000", 2023-08-01T19:54:56.159 INFO:teuthology.orchestra.run.smithi155.stdout: "duration": 0.000116638 2023-08-01T19:54:56.159 INFO:teuthology.orchestra.run.smithi155.stdout: }, 2023-08-01T19:54:56.159 INFO:teuthology.orchestra.run.smithi155.stdout: { 2023-08-01T19:54:56.159 INFO:teuthology.orchestra.run.smithi155.stdout: "event": "waiting for subops from 0", 2023-08-01T19:54:56.159 INFO:teuthology.orchestra.run.smithi155.stdout: "time": "2023-08-01T19:54:56.100671+0000", 2023-08-01T19:54:56.159 INFO:teuthology.orchestra.run.smithi155.stdout: "duration": 0.00014248700000000001 2023-08-01T19:54:56.160 INFO:teuthology.orchestra.run.smithi155.stdout: } 2023-08-01T19:54:56.160 INFO:teuthology.orchestra.run.smithi155.stdout: ] 2023-08-01T19:54:56.160 INFO:teuthology.orchestra.run.smithi155.stdout: } 2023-08-01T19:54:56.160 INFO:teuthology.orchestra.run.smithi155.stdout: } 2023-08-01T19:54:56.160 INFO:teuthology.orchestra.run.smithi155.stdout: ], 2023-08-01T19:54:56.160 INFO:teuthology.orchestra.run.smithi155.stdout: "num_ops": 7 2023-08-01T19:54:56.160 INFO:teuthology.orchestra.run.smithi155.stdout:} 2023-08-01T19:54:56.162 DEBUG:teuthology.orchestra.run.smithi155:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 30 ceph --cluster ceph --admin-daemon /var/run/ceph/ceph-osd.2.asok dump_blocked_ops 2023-08-01T19:54:56.162 INFO:tasks.ceph.osd.2.smithi155.stderr:2023-08-01T19:54:56.160+0000 7faa5c6ac700 -1 received signal: Hangup from /usr/bin/python3 /bin/daemon-helper kill ceph-osd -f --cluster ceph -i 2 (PID: 111337) UID: 0 2023-08-01T19:54:56.262 INFO:tasks.ceph.osd.1.smithi101.stderr:2023-08-01T19:54:56.260+0000 7fb0cb7f6700 -1 received signal: Hangup from /usr/bin/python3 /bin/daemon-helper kill ceph-osd -f --cluster ceph -i 1 (PID: 111141) UID: 0 2023-08-01T19:54:56.315 INFO:tasks.radosbench.radosbench.0.smithi006.stdout: 32 16 83042 83026 162.147 126.562 0.00913319 0.00616467 2023-08-01T19:54:56.363 INFO:tasks.ceph.osd.1.smithi101.stderr:2023-08-01T19:54:56.362+0000 7fb0cb7f6700 -1 received signal: Hangup from /usr/bin/python3 /bin/daemon-helper kill ceph-osd -f --cluster ceph -i 1 (PID: 111141) UID: 0 2023-08-01T19:54:56.374 INFO:teuthology.orchestra.run.smithi155.stdout:{ 2023-08-01T19:54:56.375 INFO:teuthology.orchestra.run.smithi155.stdout: "ops": [], 2023-08-01T19:54:56.375 INFO:teuthology.orchestra.run.smithi155.stdout: "complaint_time": 30, 2023-08-01T19:54:56.375 INFO:teuthology.orchestra.run.smithi155.stdout: "num_blocked_ops": 0 2023-08-01T19:54:56.375 INFO:teuthology.orchestra.run.smithi155.stdout:} 2023-08-01T19:54:56.389 DEBUG:teuthology.orchestra.run.smithi155:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 30 ceph --cluster ceph --admin-daemon /var/run/ceph/ceph-osd.2.asok dump_historic_ops 2023-08-01T19:54:56.464 INFO:tasks.ceph.osd.0.smithi008.stderr:2023-08-01T19:54:56.463+0000 7f16a58f4700 -1 received signal: Hangup from /usr/bin/python3 /bin/daemon-helper kill ceph-osd -f --cluster ceph -i 0 (PID: 111179) UID: 0 2023-08-01T19:54:56.561 INFO:teuthology.orchestra.run.smithi155.stdout:{ 2023-08-01T19:54:56.561 INFO:teuthology.orchestra.run.smithi155.stdout: "size": 20, 2023-08-01T19:54:56.561 INFO:teuthology.orchestra.run.smithi155.stdout: "duration": 600, 2023-08-01T19:54:56.561 INFO:teuthology.orchestra.run.smithi155.stdout: "ops": [ 2023-08-01T19:54:56.562 INFO:teuthology.orchestra.run.smithi155.stdout: { 2023-08-01T19:54:56.562 INFO:teuthology.orchestra.run.smithi155.stdout: "description": "osd_op(client.4668.0:61802 5.b 5:dcfcf99c:::benchmark_data_smithi006_114134_object61801:head [set-alloc-hint object_size 65536 write_size 65536,write 0~65536] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e29)", 2023-08-01T19:54:56.562 INFO:teuthology.orchestra.run.smithi155.stdout: "initiated_at": "2023-08-01T19:54:45.742720+0000", 2023-08-01T19:54:56.562 INFO:teuthology.orchestra.run.smithi155.stdout: "age": 10.815499398, 2023-08-01T19:54:56.562 INFO:teuthology.orchestra.run.smithi155.stdout: "duration": 0.017797548999999999, 2023-08-01T19:54:56.562 INFO:teuthology.orchestra.run.smithi155.stdout: "type_data": { 2023-08-01T19:54:56.562 INFO:teuthology.orchestra.run.smithi155.stdout: "flag_point": "commit sent; apply or cleanup", 2023-08-01T19:54:56.562 INFO:teuthology.orchestra.run.smithi155.stdout: "client_info": { 2023-08-01T19:54:56.563 INFO:teuthology.orchestra.run.smithi155.stdout: "client": "client.4668", 2023-08-01T19:54:56.563 INFO:teuthology.orchestra.run.smithi155.stdout: "client_addr": "172.21.15.6:0/1709472247", 2023-08-01T19:54:56.563 INFO:teuthology.orchestra.run.smithi155.stdout: "tid": 61802 2023-08-01T19:54:56.563 INFO:teuthology.orchestra.run.smithi155.stdout: }, 2023-08-01T19:54:56.563 INFO:teuthology.orchestra.run.smithi155.stdout: "events": [ 2023-08-01T19:54:56.563 INFO:teuthology.orchestra.run.smithi155.stdout: { 2023-08-01T19:54:56.563 INFO:teuthology.orchestra.run.smithi155.stdout: "event": "initiated", 2023-08-01T19:54:56.564 INFO:teuthology.orchestra.run.smithi155.stdout: "time": "2023-08-01T19:54:45.742720+0000", 2023-08-01T19:54:56.564 INFO:teuthology.orchestra.run.smithi155.stdout: "duration": 0 2023-08-01T19:54:56.564 INFO:teuthology.orchestra.run.smithi155.stdout: }, 2023-08-01T19:54:56.564 INFO:teuthology.orchestra.run.smithi155.stdout: { 2023-08-01T19:54:56.564 INFO:teuthology.orchestra.run.smithi155.stdout: "event": "throttled", 2023-08-01T19:54:56.564 INFO:teuthology.orchestra.run.smithi155.stdout: "time": "2023-08-01T19:54:45.742720+0000", 2023-08-01T19:54:56.564 INFO:teuthology.orchestra.run.smithi155.stdout: "duration": 0 2023-08-01T19:54:56.564 INFO:teuthology.orchestra.run.smithi155.stdout: }, 2023-08-01T19:54:56.565 INFO:teuthology.orchestra.run.smithi155.stdout: { 2023-08-01T19:54:56.565 INFO:teuthology.orchestra.run.smithi155.stdout: "event": "header_read", 2023-08-01T19:54:56.565 INFO:teuthology.orchestra.run.smithi155.stdout: "time": "2023-08-01T19:54:45.742720+0000", 2023-08-01T19:54:56.565 INFO:teuthology.orchestra.run.smithi155.stdout: "duration": 4294967295.9999995 2023-08-01T19:54:56.565 INFO:teuthology.orchestra.run.smithi155.stdout: }, 2023-08-01T19:54:56.565 INFO:teuthology.orchestra.run.smithi155.stdout: { 2023-08-01T19:54:56.565 INFO:teuthology.orchestra.run.smithi155.stdout: "event": "all_read", 2023-08-01T19:54:56.566 INFO:teuthology.orchestra.run.smithi155.stdout: "time": "2023-08-01T19:54:45.742747+0000", 2023-08-01T19:54:56.566 INFO:teuthology.orchestra.run.smithi155.stdout: "duration": 2.7713e-05 2023-08-01T19:54:56.566 INFO:teuthology.orchestra.run.smithi155.stdout: }, 2023-08-01T19:54:56.566 INFO:teuthology.orchestra.run.smithi155.stdout: { 2023-08-01T19:54:56.566 INFO:teuthology.orchestra.run.smithi155.stdout: "event": "dispatched", 2023-08-01T19:54:56.566 INFO:teuthology.orchestra.run.smithi155.stdout: "time": "2023-08-01T19:54:45.742752+0000", 2023-08-01T19:54:56.566 INFO:teuthology.orchestra.run.smithi155.stdout: "duration": 4.8080000000000004e-06 2023-08-01T19:54:56.567 INFO:teuthology.orchestra.run.smithi155.stdout: }, 2023-08-01T19:54:56.567 INFO:teuthology.orchestra.run.smithi155.stdout: { 2023-08-01T19:54:56.567 INFO:teuthology.orchestra.run.smithi155.stdout: "event": "queued_for_pg", 2023-08-01T19:54:56.567 INFO:teuthology.orchestra.run.smithi155.stdout: "time": "2023-08-01T19:54:45.742757+0000", 2023-08-01T19:54:56.567 INFO:teuthology.orchestra.run.smithi155.stdout: "duration": 4.5220000000000001e-06 2023-08-01T19:54:56.567 INFO:teuthology.orchestra.run.smithi155.stdout: }, 2023-08-01T19:54:56.567 INFO:teuthology.orchestra.run.smithi155.stdout: { 2023-08-01T19:54:56.567 INFO:teuthology.orchestra.run.smithi155.stdout: "event": "reached_pg", 2023-08-01T19:54:56.568 INFO:teuthology.orchestra.run.smithi155.stdout: "time": "2023-08-01T19:54:45.744448+0000", 2023-08-01T19:54:56.568 INFO:teuthology.orchestra.run.smithi155.stdout: "duration": 0.0016914600000000001 2023-08-01T19:54:56.568 INFO:teuthology.orchestra.run.smithi155.stdout: }, 2023-08-01T19:54:56.568 INFO:teuthology.orchestra.run.smithi155.stdout: { 2023-08-01T19:54:56.568 INFO:teuthology.orchestra.run.smithi155.stdout: "event": "started", 2023-08-01T19:54:56.568 INFO:teuthology.orchestra.run.smithi155.stdout: "time": "2023-08-01T19:54:45.744538+0000", 2023-08-01T19:54:56.568 INFO:teuthology.orchestra.run.smithi155.stdout: "duration": 8.9615000000000002e-05 2023-08-01T19:54:56.569 INFO:teuthology.orchestra.run.smithi155.stdout: }, 2023-08-01T19:54:56.569 INFO:teuthology.orchestra.run.smithi155.stdout: { 2023-08-01T19:54:56.569 INFO:teuthology.orchestra.run.smithi155.stdout: "event": "waiting for subops from 0", 2023-08-01T19:54:56.569 INFO:teuthology.orchestra.run.smithi155.stdout: "time": "2023-08-01T19:54:45.744620+0000", 2023-08-01T19:54:56.569 INFO:teuthology.orchestra.run.smithi155.stdout: "duration": 8.1681000000000006e-05 2023-08-01T19:54:56.569 INFO:teuthology.orchestra.run.smithi155.stdout: }, 2023-08-01T19:54:56.569 INFO:teuthology.orchestra.run.smithi155.stdout: { 2023-08-01T19:54:56.569 INFO:teuthology.orchestra.run.smithi155.stdout: "event": "op_commit", 2023-08-01T19:54:56.570 INFO:teuthology.orchestra.run.smithi155.stdout: "time": "2023-08-01T19:54:45.746954+0000", 2023-08-01T19:54:56.570 INFO:teuthology.orchestra.run.smithi155.stdout: "duration": 0.0023339490000000001 2023-08-01T19:54:56.570 INFO:teuthology.orchestra.run.smithi155.stdout: }, 2023-08-01T19:54:56.570 INFO:teuthology.orchestra.run.smithi155.stdout: { 2023-08-01T19:54:56.570 INFO:teuthology.orchestra.run.smithi155.stdout: "event": "sub_op_commit_rec", 2023-08-01T19:54:56.570 INFO:teuthology.orchestra.run.smithi155.stdout: "time": "2023-08-01T19:54:45.760465+0000", 2023-08-01T19:54:56.570 INFO:teuthology.orchestra.run.smithi155.stdout: "duration": 0.013511861 2023-08-01T19:54:56.570 INFO:teuthology.orchestra.run.smithi155.stdout: }, 2023-08-01T19:54:56.571 INFO:teuthology.orchestra.run.smithi155.stdout: { 2023-08-01T19:54:56.571 INFO:teuthology.orchestra.run.smithi155.stdout: "event": "commit_sent", 2023-08-01T19:54:56.571 INFO:teuthology.orchestra.run.smithi155.stdout: "time": "2023-08-01T19:54:45.760494+0000", 2023-08-01T19:54:56.571 INFO:teuthology.orchestra.run.smithi155.stdout: "duration": 2.9025000000000001e-05 2023-08-01T19:54:56.571 INFO:teuthology.orchestra.run.smithi155.stdout: }, 2023-08-01T19:54:56.571 INFO:teuthology.orchestra.run.smithi155.stdout: { 2023-08-01T19:54:56.571 INFO:teuthology.orchestra.run.smithi155.stdout: "event": "done", 2023-08-01T19:54:56.571 INFO:teuthology.orchestra.run.smithi155.stdout: "time": "2023-08-01T19:54:45.760518+0000", 2023-08-01T19:54:56.572 INFO:teuthology.orchestra.run.smithi155.stdout: "duration": 2.3269e-05 2023-08-01T19:54:56.572 INFO:teuthology.orchestra.run.smithi155.stdout: } 2023-08-01T19:54:56.572 INFO:teuthology.orchestra.run.smithi155.stdout: ] 2023-08-01T19:54:56.572 INFO:teuthology.orchestra.run.smithi155.stdout: } 2023-08-01T19:54:56.572 INFO:teuthology.orchestra.run.smithi155.stdout: }, 2023-08-01T19:54:56.572 INFO:teuthology.orchestra.run.smithi155.stdout: { 2023-08-01T19:54:56.572 INFO:teuthology.orchestra.run.smithi155.stdout: "description": "osd_op(client.4668.0:66162 5.b 5:d2306600:::benchmark_data_smithi006_114134_object66161:head [set-alloc-hint object_size 65536 write_size 65536,write 0~65536] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e29)", 2023-08-01T19:54:56.573 INFO:teuthology.orchestra.run.smithi155.stdout: "initiated_at": "2023-08-01T19:54:47.818865+0000", 2023-08-01T19:54:56.573 INFO:teuthology.orchestra.run.smithi155.stdout: "age": 8.7393549499999992, 2023-08-01T19:54:56.573 INFO:teuthology.orchestra.run.smithi155.stdout: "duration": 0.016254494000000001, 2023-08-01T19:54:56.573 INFO:teuthology.orchestra.run.smithi155.stdout: "type_data": { 2023-08-01T19:54:56.573 INFO:teuthology.orchestra.run.smithi155.stdout: "flag_point": "commit sent; apply or cleanup", 2023-08-01T19:54:56.573 INFO:teuthology.orchestra.run.smithi155.stdout: "client_info": { 2023-08-01T19:54:56.573 INFO:teuthology.orchestra.run.smithi155.stdout: "client": "client.4668", 2023-08-01T19:54:56.573 INFO:teuthology.orchestra.run.smithi155.stdout: "client_addr": "172.21.15.6:0/1709472247", 2023-08-01T19:54:56.574 INFO:teuthology.orchestra.run.smithi155.stdout: "tid": 66162 2023-08-01T19:54:56.574 INFO:teuthology.orchestra.run.smithi155.stdout: }, 2023-08-01T19:54:56.574 INFO:teuthology.orchestra.run.smithi155.stdout: "events": [ 2023-08-01T19:54:56.574 INFO:teuthology.orchestra.run.smithi155.stdout: { 2023-08-01T19:54:56.574 INFO:teuthology.orchestra.run.smithi155.stdout: "event": "initiated", 2023-08-01T19:54:56.574 INFO:teuthology.orchestra.run.smithi155.stdout: "time": "2023-08-01T19:54:47.818865+0000", 2023-08-01T19:54:56.574 INFO:teuthology.orchestra.run.smithi155.stdout: "duration": 0 2023-08-01T19:54:56.575 INFO:teuthology.orchestra.run.smithi155.stdout: }, 2023-08-01T19:54:56.575 INFO:teuthology.orchestra.run.smithi155.stdout: { 2023-08-01T19:54:56.575 INFO:teuthology.orchestra.run.smithi155.stdout: "event": "throttled", 2023-08-01T19:54:56.575 INFO:teuthology.orchestra.run.smithi155.stdout: "time": "2023-08-01T19:54:47.818865+0000", 2023-08-01T19:54:56.575 INFO:teuthology.orchestra.run.smithi155.stdout: "duration": 0 2023-08-01T19:54:56.575 INFO:teuthology.orchestra.run.smithi155.stdout: }, 2023-08-01T19:54:56.575 INFO:teuthology.orchestra.run.smithi155.stdout: { 2023-08-01T19:54:56.575 INFO:teuthology.orchestra.run.smithi155.stdout: "event": "header_read", 2023-08-01T19:54:56.576 INFO:teuthology.orchestra.run.smithi155.stdout: "time": "2023-08-01T19:54:47.818864+0000", 2023-08-01T19:54:56.576 INFO:teuthology.orchestra.run.smithi155.stdout: "duration": 4294967295.9999995 2023-08-01T19:54:56.576 INFO:teuthology.orchestra.run.smithi155.stdout: }, 2023-08-01T19:54:56.576 INFO:teuthology.orchestra.run.smithi155.stdout: { 2023-08-01T19:54:56.576 INFO:teuthology.orchestra.run.smithi155.stdout: "event": "all_read", 2023-08-01T19:54:56.576 INFO:teuthology.orchestra.run.smithi155.stdout: "time": "2023-08-01T19:54:47.818944+0000", 2023-08-01T19:54:56.576 INFO:teuthology.orchestra.run.smithi155.stdout: "duration": 8.0112999999999997e-05 2023-08-01T19:54:56.577 INFO:teuthology.orchestra.run.smithi155.stdout: }, 2023-08-01T19:54:56.577 INFO:teuthology.orchestra.run.smithi155.stdout: { 2023-08-01T19:54:56.577 INFO:teuthology.orchestra.run.smithi155.stdout: "event": "dispatched", 2023-08-01T19:54:56.577 INFO:teuthology.orchestra.run.smithi155.stdout: "time": "2023-08-01T19:54:47.818951+0000", 2023-08-01T19:54:56.577 INFO:teuthology.orchestra.run.smithi155.stdout: "duration": 6.7360000000000004e-06 2023-08-01T19:54:56.577 INFO:teuthology.orchestra.run.smithi155.stdout: }, 2023-08-01T19:54:56.578 INFO:teuthology.orchestra.run.smithi155.stdout: { 2023-08-01T19:54:56.578 INFO:teuthology.orchestra.run.smithi155.stdout: "event": "queued_for_pg", 2023-08-01T19:54:56.578 INFO:teuthology.orchestra.run.smithi155.stdout: "time": "2023-08-01T19:54:47.818954+0000", 2023-08-01T19:54:56.578 INFO:teuthology.orchestra.run.smithi155.stdout: "duration": 2.9550000000000001e-06 2023-08-01T19:54:56.578 INFO:teuthology.orchestra.run.smithi155.stdout: }, 2023-08-01T19:54:56.578 INFO:teuthology.orchestra.run.smithi155.stdout: { 2023-08-01T19:54:56.578 INFO:teuthology.orchestra.run.smithi155.stdout: "event": "reached_pg", 2023-08-01T19:54:56.579 INFO:teuthology.orchestra.run.smithi155.stdout: "time": "2023-08-01T19:54:47.820967+0000", 2023-08-01T19:54:56.579 INFO:teuthology.orchestra.run.smithi155.stdout: "duration": 0.0020131659999999998 2023-08-01T19:54:56.579 INFO:teuthology.orchestra.run.smithi155.stdout: }, 2023-08-01T19:54:56.579 INFO:teuthology.orchestra.run.smithi155.stdout: { 2023-08-01T19:54:56.579 INFO:teuthology.orchestra.run.smithi155.stdout: "event": "started", 2023-08-01T19:54:56.579 INFO:teuthology.orchestra.run.smithi155.stdout: "time": "2023-08-01T19:54:47.821043+0000", 2023-08-01T19:54:56.579 INFO:teuthology.orchestra.run.smithi155.stdout: "duration": 7.5706999999999999e-05 2023-08-01T19:54:56.580 INFO:teuthology.orchestra.run.smithi155.stdout: }, 2023-08-01T19:54:56.580 INFO:teuthology.orchestra.run.smithi155.stdout: { 2023-08-01T19:54:56.580 INFO:teuthology.orchestra.run.smithi155.stdout: "event": "waiting for subops from 0", 2023-08-01T19:54:56.580 INFO:teuthology.orchestra.run.smithi155.stdout: "time": "2023-08-01T19:54:47.821128+0000", 2023-08-01T19:54:56.580 INFO:teuthology.orchestra.run.smithi155.stdout: "duration": 8.5628000000000001e-05 2023-08-01T19:54:56.580 INFO:teuthology.orchestra.run.smithi155.stdout: }, 2023-08-01T19:54:56.580 INFO:teuthology.orchestra.run.smithi155.stdout: { 2023-08-01T19:54:56.580 INFO:teuthology.orchestra.run.smithi155.stdout: "event": "op_commit", 2023-08-01T19:54:56.581 INFO:teuthology.orchestra.run.smithi155.stdout: "time": "2023-08-01T19:54:47.824340+0000", 2023-08-01T19:54:56.581 INFO:teuthology.orchestra.run.smithi155.stdout: "duration": 0.0032116750000000002 2023-08-01T19:54:56.581 INFO:teuthology.orchestra.run.smithi155.stdout: }, 2023-08-01T19:54:56.581 INFO:teuthology.orchestra.run.smithi155.stdout: { 2023-08-01T19:54:56.581 INFO:teuthology.orchestra.run.smithi155.stdout: "event": "sub_op_commit_rec", 2023-08-01T19:54:56.581 INFO:teuthology.orchestra.run.smithi155.stdout: "time": "2023-08-01T19:54:47.835051+0000", 2023-08-01T19:54:56.581 INFO:teuthology.orchestra.run.smithi155.stdout: "duration": 0.010711299000000001 2023-08-01T19:54:56.581 INFO:teuthology.orchestra.run.smithi155.stdout: }, 2023-08-01T19:54:56.582 INFO:teuthology.orchestra.run.smithi155.stdout: { 2023-08-01T19:54:56.582 INFO:teuthology.orchestra.run.smithi155.stdout: "event": "commit_sent", 2023-08-01T19:54:56.582 INFO:teuthology.orchestra.run.smithi155.stdout: "time": "2023-08-01T19:54:47.835094+0000", 2023-08-01T19:54:56.582 INFO:teuthology.orchestra.run.smithi155.stdout: "duration": 4.2410000000000002e-05 2023-08-01T19:54:56.582 INFO:teuthology.orchestra.run.smithi155.stdout: }, 2023-08-01T19:54:56.582 INFO:teuthology.orchestra.run.smithi155.stdout: { 2023-08-01T19:54:56.582 INFO:teuthology.orchestra.run.smithi155.stdout: "event": "done", 2023-08-01T19:54:56.582 INFO:teuthology.orchestra.run.smithi155.stdout: "time": "2023-08-01T19:54:47.835119+0000", 2023-08-01T19:54:56.583 INFO:teuthology.orchestra.run.smithi155.stdout: "duration": 2.5401e-05 2023-08-01T19:54:56.583 INFO:teuthology.orchestra.run.smithi155.stdout: } 2023-08-01T19:54:56.583 INFO:teuthology.orchestra.run.smithi155.stdout: ] 2023-08-01T19:54:56.583 INFO:teuthology.orchestra.run.smithi155.stdout: } 2023-08-01T19:54:56.583 INFO:teuthology.orchestra.run.smithi155.stdout: }, 2023-08-01T19:54:56.583 INFO:teuthology.orchestra.run.smithi155.stdout: { 2023-08-01T19:54:56.583 INFO:teuthology.orchestra.run.smithi155.stdout: "description": "osd_op(client.4668.0:70886 5.4 5:27fcffab:::benchmark_data_smithi006_114134_object70885:head [set-alloc-hint object_size 65536 write_size 65536,write 0~65536] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e30)", 2023-08-01T19:54:56.584 INFO:teuthology.orchestra.run.smithi155.stdout: "initiated_at": "2023-08-01T19:54:50.214727+0000", 2023-08-01T19:54:56.584 INFO:teuthology.orchestra.run.smithi155.stdout: "age": 6.343492693, 2023-08-01T19:54:56.584 INFO:teuthology.orchestra.run.smithi155.stdout: "duration": 0.016804395999999999, 2023-08-01T19:54:56.584 INFO:teuthology.orchestra.run.smithi155.stdout: "type_data": { 2023-08-01T19:54:56.584 INFO:teuthology.orchestra.run.smithi155.stdout: "flag_point": "commit sent; apply or cleanup", 2023-08-01T19:54:56.584 INFO:teuthology.orchestra.run.smithi155.stdout: "client_info": { 2023-08-01T19:54:56.584 INFO:teuthology.orchestra.run.smithi155.stdout: "client": "client.4668", 2023-08-01T19:54:56.585 INFO:teuthology.orchestra.run.smithi155.stdout: "client_addr": "172.21.15.6:0/1709472247", 2023-08-01T19:54:56.585 INFO:teuthology.orchestra.run.smithi155.stdout: "tid": 70886 2023-08-01T19:54:56.585 INFO:teuthology.orchestra.run.smithi155.stdout: }, 2023-08-01T19:54:56.585 INFO:teuthology.orchestra.run.smithi155.stdout: "events": [ 2023-08-01T19:54:56.585 INFO:teuthology.orchestra.run.smithi155.stdout: { 2023-08-01T19:54:56.585 INFO:teuthology.orchestra.run.smithi155.stdout: "event": "initiated", 2023-08-01T19:54:56.585 INFO:teuthology.orchestra.run.smithi155.stdout: "time": "2023-08-01T19:54:50.214727+0000", 2023-08-01T19:54:56.586 INFO:teuthology.orchestra.run.smithi155.stdout: "duration": 0 2023-08-01T19:54:56.586 INFO:teuthology.orchestra.run.smithi155.stdout: }, 2023-08-01T19:54:56.586 INFO:teuthology.orchestra.run.smithi155.stdout: { 2023-08-01T19:54:56.586 INFO:teuthology.orchestra.run.smithi155.stdout: "event": "throttled", 2023-08-01T19:54:56.586 INFO:teuthology.orchestra.run.smithi155.stdout: "time": "2023-08-01T19:54:50.214727+0000", 2023-08-01T19:54:56.586 INFO:teuthology.orchestra.run.smithi155.stdout: "duration": 0 2023-08-01T19:54:56.586 INFO:teuthology.orchestra.run.smithi155.stdout: }, 2023-08-01T19:54:56.587 INFO:teuthology.orchestra.run.smithi155.stdout: { 2023-08-01T19:54:56.587 INFO:teuthology.orchestra.run.smithi155.stdout: "event": "header_read", 2023-08-01T19:54:56.587 INFO:teuthology.orchestra.run.smithi155.stdout: "time": "2023-08-01T19:54:50.214726+0000", 2023-08-01T19:54:56.587 INFO:teuthology.orchestra.run.smithi155.stdout: "duration": 4294967295.9999995 2023-08-01T19:54:56.587 INFO:teuthology.orchestra.run.smithi155.stdout: }, 2023-08-01T19:54:56.587 INFO:teuthology.orchestra.run.smithi155.stdout: { 2023-08-01T19:54:56.587 INFO:teuthology.orchestra.run.smithi155.stdout: "event": "all_read", 2023-08-01T19:54:56.588 INFO:teuthology.orchestra.run.smithi155.stdout: "time": "2023-08-01T19:54:50.214790+0000", 2023-08-01T19:54:56.588 INFO:teuthology.orchestra.run.smithi155.stdout: "duration": 6.3538000000000001e-05 2023-08-01T19:54:56.588 INFO:teuthology.orchestra.run.smithi155.stdout: }, 2023-08-01T19:54:56.588 INFO:teuthology.orchestra.run.smithi155.stdout: { 2023-08-01T19:54:56.588 INFO:teuthology.orchestra.run.smithi155.stdout: "event": "dispatched", 2023-08-01T19:54:56.588 INFO:teuthology.orchestra.run.smithi155.stdout: "time": "2023-08-01T19:54:50.214797+0000", 2023-08-01T19:54:56.588 INFO:teuthology.orchestra.run.smithi155.stdout: "duration": 7.0759999999999997e-06 2023-08-01T19:54:56.589 INFO:teuthology.orchestra.run.smithi155.stdout: }, 2023-08-01T19:54:56.589 INFO:teuthology.orchestra.run.smithi155.stdout: { 2023-08-01T19:54:56.589 INFO:teuthology.orchestra.run.smithi155.stdout: "event": "queued_for_pg", 2023-08-01T19:54:56.589 INFO:teuthology.orchestra.run.smithi155.stdout: "time": "2023-08-01T19:54:50.214800+0000", 2023-08-01T19:54:56.589 INFO:teuthology.orchestra.run.smithi155.stdout: "duration": 3.3230000000000002e-06 2023-08-01T19:54:56.589 INFO:teuthology.orchestra.run.smithi155.stdout: }, 2023-08-01T19:54:56.589 INFO:teuthology.orchestra.run.smithi155.stdout: { 2023-08-01T19:54:56.589 INFO:teuthology.orchestra.run.smithi155.stdout: "event": "reached_pg", 2023-08-01T19:54:56.590 INFO:teuthology.orchestra.run.smithi155.stdout: "time": "2023-08-01T19:54:50.214836+0000", 2023-08-01T19:54:56.590 INFO:teuthology.orchestra.run.smithi155.stdout: "duration": 3.6236999999999999e-05 2023-08-01T19:54:56.590 INFO:teuthology.orchestra.run.smithi155.stdout: }, 2023-08-01T19:54:56.590 INFO:teuthology.orchestra.run.smithi155.stdout: { 2023-08-01T19:54:56.590 INFO:teuthology.orchestra.run.smithi155.stdout: "event": "started", 2023-08-01T19:54:56.590 INFO:teuthology.orchestra.run.smithi155.stdout: "time": "2023-08-01T19:54:50.214960+0000", 2023-08-01T19:54:56.591 INFO:teuthology.orchestra.run.smithi155.stdout: "duration": 0.00012351199999999999 2023-08-01T19:54:56.591 INFO:teuthology.orchestra.run.smithi155.stdout: }, 2023-08-01T19:54:56.591 INFO:teuthology.orchestra.run.smithi155.stdout: { 2023-08-01T19:54:56.591 INFO:teuthology.orchestra.run.smithi155.stdout: "event": "waiting for subops from 0", 2023-08-01T19:54:56.591 INFO:teuthology.orchestra.run.smithi155.stdout: "time": "2023-08-01T19:54:50.215307+0000", 2023-08-01T19:54:56.591 INFO:teuthology.orchestra.run.smithi155.stdout: "duration": 0.00034703400000000003 2023-08-01T19:54:56.591 INFO:teuthology.orchestra.run.smithi155.stdout: }, 2023-08-01T19:54:56.591 INFO:teuthology.orchestra.run.smithi155.stdout: { 2023-08-01T19:54:56.592 INFO:teuthology.orchestra.run.smithi155.stdout: "event": "op_commit", 2023-08-01T19:54:56.592 INFO:teuthology.orchestra.run.smithi155.stdout: "time": "2023-08-01T19:54:50.218915+0000", 2023-08-01T19:54:56.592 INFO:teuthology.orchestra.run.smithi155.stdout: "duration": 0.0036078030000000001 2023-08-01T19:54:56.592 INFO:teuthology.orchestra.run.smithi155.stdout: }, 2023-08-01T19:54:56.592 INFO:teuthology.orchestra.run.smithi155.stdout: { 2023-08-01T19:54:56.592 INFO:teuthology.orchestra.run.smithi155.stdout: "event": "sub_op_commit_rec", 2023-08-01T19:54:56.592 INFO:teuthology.orchestra.run.smithi155.stdout: "time": "2023-08-01T19:54:50.231476+0000", 2023-08-01T19:54:56.593 INFO:teuthology.orchestra.run.smithi155.stdout: "duration": 0.012561113 2023-08-01T19:54:56.593 INFO:teuthology.orchestra.run.smithi155.stdout: }, 2023-08-01T19:54:56.593 INFO:teuthology.orchestra.run.smithi155.stdout: { 2023-08-01T19:54:56.593 INFO:teuthology.orchestra.run.smithi155.stdout: "event": "commit_sent", 2023-08-01T19:54:56.593 INFO:teuthology.orchestra.run.smithi155.stdout: "time": "2023-08-01T19:54:50.231507+0000", 2023-08-01T19:54:56.593 INFO:teuthology.orchestra.run.smithi155.stdout: "duration": 3.1285999999999998e-05 2023-08-01T19:54:56.593 INFO:teuthology.orchestra.run.smithi155.stdout: }, 2023-08-01T19:54:56.594 INFO:teuthology.orchestra.run.smithi155.stdout: { 2023-08-01T19:54:56.594 INFO:teuthology.orchestra.run.smithi155.stdout: "event": "done", 2023-08-01T19:54:56.594 INFO:teuthology.orchestra.run.smithi155.stdout: "time": "2023-08-01T19:54:50.231531+0000", 2023-08-01T19:54:56.594 INFO:teuthology.orchestra.run.smithi155.stdout: "duration": 2.3989999999999999e-05 2023-08-01T19:54:56.594 INFO:teuthology.orchestra.run.smithi155.stdout: } 2023-08-01T19:54:56.594 INFO:teuthology.orchestra.run.smithi155.stdout: ] 2023-08-01T19:54:56.594 INFO:teuthology.orchestra.run.smithi155.stdout: } 2023-08-01T19:54:56.595 INFO:teuthology.orchestra.run.smithi155.stdout: }, 2023-08-01T19:54:56.595 INFO:teuthology.orchestra.run.smithi155.stdout: { 2023-08-01T19:54:56.595 INFO:teuthology.orchestra.run.smithi155.stdout: "description": "osd_op(client.4668.0:70887 5.4 5:297593d5:::benchmark_data_smithi006_114134_object70886:head [set-alloc-hint object_size 65536 write_size 65536,write 0~65536] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e30)", 2023-08-01T19:54:56.595 INFO:teuthology.orchestra.run.smithi155.stdout: "initiated_at": "2023-08-01T19:54:50.216359+0000", 2023-08-01T19:54:56.595 INFO:teuthology.orchestra.run.smithi155.stdout: "age": 6.3418604290000005, 2023-08-01T19:54:56.595 INFO:teuthology.orchestra.run.smithi155.stdout: "duration": 0.018298663, 2023-08-01T19:54:56.595 INFO:teuthology.orchestra.run.smithi155.stdout: "type_data": { 2023-08-01T19:54:56.596 INFO:teuthology.orchestra.run.smithi155.stdout: "flag_point": "commit sent; apply or cleanup", 2023-08-01T19:54:56.596 INFO:teuthology.orchestra.run.smithi155.stdout: "client_info": { 2023-08-01T19:54:56.596 INFO:teuthology.orchestra.run.smithi155.stdout: "client": "client.4668", 2023-08-01T19:54:56.596 INFO:teuthology.orchestra.run.smithi155.stdout: "client_addr": "172.21.15.6:0/1709472247", 2023-08-01T19:54:56.596 INFO:teuthology.orchestra.run.smithi155.stdout: "tid": 70887 2023-08-01T19:54:56.596 INFO:teuthology.orchestra.run.smithi155.stdout: }, 2023-08-01T19:54:56.596 INFO:teuthology.orchestra.run.smithi155.stdout: "events": [ 2023-08-01T19:54:56.597 INFO:teuthology.orchestra.run.smithi155.stdout: { 2023-08-01T19:54:56.597 INFO:teuthology.orchestra.run.smithi155.stdout: "event": "initiated", 2023-08-01T19:54:56.597 INFO:teuthology.orchestra.run.smithi155.stdout: "time": "2023-08-01T19:54:50.216359+0000", 2023-08-01T19:54:56.597 INFO:teuthology.orchestra.run.smithi155.stdout: "duration": 0 2023-08-01T19:54:56.597 INFO:teuthology.orchestra.run.smithi155.stdout: }, 2023-08-01T19:54:56.597 INFO:teuthology.orchestra.run.smithi155.stdout: { 2023-08-01T19:54:56.597 INFO:teuthology.orchestra.run.smithi155.stdout: "event": "throttled", 2023-08-01T19:54:56.598 INFO:teuthology.orchestra.run.smithi155.stdout: "time": "2023-08-01T19:54:50.216359+0000", 2023-08-01T19:54:56.598 INFO:teuthology.orchestra.run.smithi155.stdout: "duration": 0 2023-08-01T19:54:56.598 INFO:teuthology.orchestra.run.smithi155.stdout: }, 2023-08-01T19:54:56.598 INFO:teuthology.orchestra.run.smithi155.stdout: { 2023-08-01T19:54:56.598 INFO:teuthology.orchestra.run.smithi155.stdout: "event": "header_read", 2023-08-01T19:54:56.598 INFO:teuthology.orchestra.run.smithi155.stdout: "time": "2023-08-01T19:54:50.216358+0000", 2023-08-01T19:54:56.598 INFO:teuthology.orchestra.run.smithi155.stdout: "duration": 4294967295.9999995 2023-08-01T19:54:56.599 INFO:teuthology.orchestra.run.smithi155.stdout: }, 2023-08-01T19:54:56.599 INFO:teuthology.orchestra.run.smithi155.stdout: { 2023-08-01T19:54:56.599 INFO:teuthology.orchestra.run.smithi155.stdout: "event": "all_read", 2023-08-01T19:54:56.599 INFO:teuthology.orchestra.run.smithi155.stdout: "time": "2023-08-01T19:54:50.216445+0000", 2023-08-01T19:54:56.599 INFO:teuthology.orchestra.run.smithi155.stdout: "duration": 8.6108999999999998e-05 2023-08-01T19:54:56.599 INFO:teuthology.orchestra.run.smithi155.stdout: }, 2023-08-01T19:54:56.599 INFO:teuthology.orchestra.run.smithi155.stdout: { 2023-08-01T19:54:56.599 INFO:teuthology.orchestra.run.smithi155.stdout: "event": "dispatched", 2023-08-01T19:54:56.600 INFO:teuthology.orchestra.run.smithi155.stdout: "time": "2023-08-01T19:54:50.216454+0000", 2023-08-01T19:54:56.600 INFO:teuthology.orchestra.run.smithi155.stdout: "duration": 9.2869999999999993e-06 2023-08-01T19:54:56.600 INFO:teuthology.orchestra.run.smithi155.stdout: }, 2023-08-01T19:54:56.600 INFO:teuthology.orchestra.run.smithi155.stdout: { 2023-08-01T19:54:56.600 INFO:teuthology.orchestra.run.smithi155.stdout: "event": "queued_for_pg", 2023-08-01T19:54:56.600 INFO:teuthology.orchestra.run.smithi155.stdout: "time": "2023-08-01T19:54:50.216458+0000", 2023-08-01T19:54:56.600 INFO:teuthology.orchestra.run.smithi155.stdout: "duration": 3.6349999999999999e-06 2023-08-01T19:54:56.600 INFO:teuthology.orchestra.run.smithi155.stdout: }, 2023-08-01T19:54:56.601 INFO:teuthology.orchestra.run.smithi155.stdout: { 2023-08-01T19:54:56.601 INFO:teuthology.orchestra.run.smithi155.stdout: "event": "reached_pg", 2023-08-01T19:54:56.601 INFO:teuthology.orchestra.run.smithi155.stdout: "time": "2023-08-01T19:54:50.217512+0000", 2023-08-01T19:54:56.601 INFO:teuthology.orchestra.run.smithi155.stdout: "duration": 0.0010542450000000001 2023-08-01T19:54:56.601 INFO:teuthology.orchestra.run.smithi155.stdout: }, 2023-08-01T19:54:56.601 INFO:teuthology.orchestra.run.smithi155.stdout: { 2023-08-01T19:54:56.601 INFO:teuthology.orchestra.run.smithi155.stdout: "event": "started", 2023-08-01T19:54:56.602 INFO:teuthology.orchestra.run.smithi155.stdout: "time": "2023-08-01T19:54:50.217597+0000", 2023-08-01T19:54:56.602 INFO:teuthology.orchestra.run.smithi155.stdout: "duration": 8.5310999999999997e-05 2023-08-01T19:54:56.602 INFO:teuthology.orchestra.run.smithi155.stdout: }, 2023-08-01T19:54:56.602 INFO:teuthology.orchestra.run.smithi155.stdout: { 2023-08-01T19:54:56.602 INFO:teuthology.orchestra.run.smithi155.stdout: "event": "waiting for subops from 0", 2023-08-01T19:54:56.602 INFO:teuthology.orchestra.run.smithi155.stdout: "time": "2023-08-01T19:54:50.217685+0000", 2023-08-01T19:54:56.602 INFO:teuthology.orchestra.run.smithi155.stdout: "duration": 8.7606000000000001e-05 2023-08-01T19:54:56.602 INFO:teuthology.orchestra.run.smithi155.stdout: }, 2023-08-01T19:54:56.603 INFO:teuthology.orchestra.run.smithi155.stdout: { 2023-08-01T19:54:56.603 INFO:teuthology.orchestra.run.smithi155.stdout: "event": "op_commit", 2023-08-01T19:54:56.603 INFO:teuthology.orchestra.run.smithi155.stdout: "time": "2023-08-01T19:54:50.220467+0000", 2023-08-01T19:54:56.603 INFO:teuthology.orchestra.run.smithi155.stdout: "duration": 0.0027821629999999998 2023-08-01T19:54:56.603 INFO:teuthology.orchestra.run.smithi155.stdout: }, 2023-08-01T19:54:56.603 INFO:teuthology.orchestra.run.smithi155.stdout: { 2023-08-01T19:54:56.603 INFO:teuthology.orchestra.run.smithi155.stdout: "event": "sub_op_commit_rec", 2023-08-01T19:54:56.603 INFO:teuthology.orchestra.run.smithi155.stdout: "time": "2023-08-01T19:54:50.234601+0000", 2023-08-01T19:54:56.604 INFO:teuthology.orchestra.run.smithi155.stdout: "duration": 0.014133949 2023-08-01T19:54:56.604 INFO:teuthology.orchestra.run.smithi155.stdout: }, 2023-08-01T19:54:56.604 INFO:teuthology.orchestra.run.smithi155.stdout: { 2023-08-01T19:54:56.604 INFO:teuthology.orchestra.run.smithi155.stdout: "event": "commit_sent", 2023-08-01T19:54:56.604 INFO:teuthology.orchestra.run.smithi155.stdout: "time": "2023-08-01T19:54:50.234634+0000", 2023-08-01T19:54:56.604 INFO:teuthology.orchestra.run.smithi155.stdout: "duration": 3.3259000000000001e-05 2023-08-01T19:54:56.604 INFO:teuthology.orchestra.run.smithi155.stdout: }, 2023-08-01T19:54:56.605 INFO:teuthology.orchestra.run.smithi155.stdout: { 2023-08-01T19:54:56.605 INFO:teuthology.orchestra.run.smithi155.stdout: "event": "done", 2023-08-01T19:54:56.605 INFO:teuthology.orchestra.run.smithi155.stdout: "time": "2023-08-01T19:54:50.234658+0000", 2023-08-01T19:54:56.605 INFO:teuthology.orchestra.run.smithi155.stdout: "duration": 2.3726999999999998e-05 2023-08-01T19:54:56.605 INFO:teuthology.orchestra.run.smithi155.stdout: } 2023-08-01T19:54:56.605 INFO:teuthology.orchestra.run.smithi155.stdout: ] 2023-08-01T19:54:56.605 INFO:teuthology.orchestra.run.smithi155.stdout: } 2023-08-01T19:54:56.605 INFO:teuthology.orchestra.run.smithi155.stdout: }, 2023-08-01T19:54:56.606 INFO:teuthology.orchestra.run.smithi155.stdout: { 2023-08-01T19:54:56.606 INFO:teuthology.orchestra.run.smithi155.stdout: "description": "osd_op(client.4668.0:71411 5.e 5:7c6c4519:::benchmark_data_smithi006_114134_object71410:head [set-alloc-hint object_size 65536 write_size 65536,write 0~65536] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e30)", 2023-08-01T19:54:56.606 INFO:teuthology.orchestra.run.smithi155.stdout: "initiated_at": "2023-08-01T19:54:50.471084+0000", 2023-08-01T19:54:56.606 INFO:teuthology.orchestra.run.smithi155.stdout: "age": 6.0871353829999997, 2023-08-01T19:54:56.606 INFO:teuthology.orchestra.run.smithi155.stdout: "duration": 0.016135705, 2023-08-01T19:54:56.606 INFO:teuthology.orchestra.run.smithi155.stdout: "type_data": { 2023-08-01T19:54:56.606 INFO:teuthology.orchestra.run.smithi155.stdout: "flag_point": "commit sent; apply or cleanup", 2023-08-01T19:54:56.607 INFO:teuthology.orchestra.run.smithi155.stdout: "client_info": { 2023-08-01T19:54:56.607 INFO:teuthology.orchestra.run.smithi155.stdout: "client": "client.4668", 2023-08-01T19:54:56.607 INFO:teuthology.orchestra.run.smithi155.stdout: "client_addr": "172.21.15.6:0/1709472247", 2023-08-01T19:54:56.607 INFO:teuthology.orchestra.run.smithi155.stdout: "tid": 71411 2023-08-01T19:54:56.607 INFO:teuthology.orchestra.run.smithi155.stdout: }, 2023-08-01T19:54:56.607 INFO:teuthology.orchestra.run.smithi155.stdout: "events": [ 2023-08-01T19:54:56.607 INFO:teuthology.orchestra.run.smithi155.stdout: { 2023-08-01T19:54:56.607 INFO:teuthology.orchestra.run.smithi155.stdout: "event": "initiated", 2023-08-01T19:54:56.608 INFO:teuthology.orchestra.run.smithi155.stdout: "time": "2023-08-01T19:54:50.471084+0000", 2023-08-01T19:54:56.608 INFO:teuthology.orchestra.run.smithi155.stdout: "duration": 0 2023-08-01T19:54:56.608 INFO:teuthology.orchestra.run.smithi155.stdout: }, 2023-08-01T19:54:56.608 INFO:teuthology.orchestra.run.smithi155.stdout: { 2023-08-01T19:54:56.608 INFO:teuthology.orchestra.run.smithi155.stdout: "event": "throttled", 2023-08-01T19:54:56.608 INFO:teuthology.orchestra.run.smithi155.stdout: "time": "2023-08-01T19:54:50.471084+0000", 2023-08-01T19:54:56.608 INFO:teuthology.orchestra.run.smithi155.stdout: "duration": 0 2023-08-01T19:54:56.609 INFO:teuthology.orchestra.run.smithi155.stdout: }, 2023-08-01T19:54:56.609 INFO:teuthology.orchestra.run.smithi155.stdout: { 2023-08-01T19:54:56.609 INFO:teuthology.orchestra.run.smithi155.stdout: "event": "header_read", 2023-08-01T19:54:56.609 INFO:teuthology.orchestra.run.smithi155.stdout: "time": "2023-08-01T19:54:50.471084+0000", 2023-08-01T19:54:56.609 INFO:teuthology.orchestra.run.smithi155.stdout: "duration": 4294967295.9999995 2023-08-01T19:54:56.609 INFO:teuthology.orchestra.run.smithi155.stdout: }, 2023-08-01T19:54:56.609 INFO:teuthology.orchestra.run.smithi155.stdout: { 2023-08-01T19:54:56.610 INFO:teuthology.orchestra.run.smithi155.stdout: "event": "all_read", 2023-08-01T19:54:56.610 INFO:teuthology.orchestra.run.smithi155.stdout: "time": "2023-08-01T19:54:50.471159+0000", 2023-08-01T19:54:56.610 INFO:teuthology.orchestra.run.smithi155.stdout: "duration": 7.5179999999999995e-05 2023-08-01T19:54:56.610 INFO:teuthology.orchestra.run.smithi155.stdout: }, 2023-08-01T19:54:56.610 INFO:teuthology.orchestra.run.smithi155.stdout: { 2023-08-01T19:54:56.610 INFO:teuthology.orchestra.run.smithi155.stdout: "event": "dispatched", 2023-08-01T19:54:56.610 INFO:teuthology.orchestra.run.smithi155.stdout: "time": "2023-08-01T19:54:50.471166+0000", 2023-08-01T19:54:56.610 INFO:teuthology.orchestra.run.smithi155.stdout: "duration": 7.0859999999999996e-06 2023-08-01T19:54:56.611 INFO:teuthology.orchestra.run.smithi155.stdout: }, 2023-08-01T19:54:56.611 INFO:teuthology.orchestra.run.smithi155.stdout: { 2023-08-01T19:54:56.611 INFO:teuthology.orchestra.run.smithi155.stdout: "event": "queued_for_pg", 2023-08-01T19:54:56.611 INFO:teuthology.orchestra.run.smithi155.stdout: "time": "2023-08-01T19:54:50.471169+0000", 2023-08-01T19:54:56.611 INFO:teuthology.orchestra.run.smithi155.stdout: "duration": 2.9239999999999999e-06 2023-08-01T19:54:56.611 INFO:teuthology.orchestra.run.smithi155.stdout: }, 2023-08-01T19:54:56.611 INFO:teuthology.orchestra.run.smithi155.stdout: { 2023-08-01T19:54:56.612 INFO:teuthology.orchestra.run.smithi155.stdout: "event": "reached_pg", 2023-08-01T19:54:56.612 INFO:teuthology.orchestra.run.smithi155.stdout: "time": "2023-08-01T19:54:50.476521+0000", 2023-08-01T19:54:56.612 INFO:teuthology.orchestra.run.smithi155.stdout: "duration": 0.0053523900000000003 2023-08-01T19:54:56.612 INFO:teuthology.orchestra.run.smithi155.stdout: }, 2023-08-01T19:54:56.612 INFO:teuthology.orchestra.run.smithi155.stdout: { 2023-08-01T19:54:56.612 INFO:teuthology.orchestra.run.smithi155.stdout: "event": "started", 2023-08-01T19:54:56.612 INFO:teuthology.orchestra.run.smithi155.stdout: "time": "2023-08-01T19:54:50.476637+0000", 2023-08-01T19:54:56.613 INFO:teuthology.orchestra.run.smithi155.stdout: "duration": 0.000115321 2023-08-01T19:54:56.613 INFO:teuthology.orchestra.run.smithi155.stdout: }, 2023-08-01T19:54:56.613 INFO:teuthology.orchestra.run.smithi155.stdout: { 2023-08-01T19:54:56.613 INFO:teuthology.orchestra.run.smithi155.stdout: "event": "waiting for subops from 0", 2023-08-01T19:54:56.613 INFO:teuthology.orchestra.run.smithi155.stdout: "time": "2023-08-01T19:54:50.476777+0000", 2023-08-01T19:54:56.613 INFO:teuthology.orchestra.run.smithi155.stdout: "duration": 0.000140135 2023-08-01T19:54:56.613 INFO:teuthology.orchestra.run.smithi155.stdout: }, 2023-08-01T19:54:56.614 INFO:teuthology.orchestra.run.smithi155.stdout: { 2023-08-01T19:54:56.614 INFO:teuthology.orchestra.run.smithi155.stdout: "event": "op_commit", 2023-08-01T19:54:56.614 INFO:teuthology.orchestra.run.smithi155.stdout: "time": "2023-08-01T19:54:50.479458+0000", 2023-08-01T19:54:56.614 INFO:teuthology.orchestra.run.smithi155.stdout: "duration": 0.0026815530000000001 2023-08-01T19:54:56.614 INFO:teuthology.orchestra.run.smithi155.stdout: }, 2023-08-01T19:54:56.614 INFO:teuthology.orchestra.run.smithi155.stdout: { 2023-08-01T19:54:56.614 INFO:teuthology.orchestra.run.smithi155.stdout: "event": "sub_op_commit_rec", 2023-08-01T19:54:56.614 INFO:teuthology.orchestra.run.smithi155.stdout: "time": "2023-08-01T19:54:50.487118+0000", 2023-08-01T19:54:56.615 INFO:teuthology.orchestra.run.smithi155.stdout: "duration": 0.007659908 2023-08-01T19:54:56.615 INFO:teuthology.orchestra.run.smithi155.stdout: }, 2023-08-01T19:54:56.615 INFO:teuthology.orchestra.run.smithi155.stdout: { 2023-08-01T19:54:56.615 INFO:teuthology.orchestra.run.smithi155.stdout: "event": "commit_sent", 2023-08-01T19:54:56.615 INFO:teuthology.orchestra.run.smithi155.stdout: "time": "2023-08-01T19:54:50.487171+0000", 2023-08-01T19:54:56.615 INFO:teuthology.orchestra.run.smithi155.stdout: "duration": 5.3029000000000003e-05 2023-08-01T19:54:56.615 INFO:teuthology.orchestra.run.smithi155.stdout: }, 2023-08-01T19:54:56.615 INFO:teuthology.orchestra.run.smithi155.stdout: { 2023-08-01T19:54:56.616 INFO:teuthology.orchestra.run.smithi155.stdout: "event": "done", 2023-08-01T19:54:56.616 INFO:teuthology.orchestra.run.smithi155.stdout: "time": "2023-08-01T19:54:50.487220+0000", 2023-08-01T19:54:56.616 INFO:teuthology.orchestra.run.smithi155.stdout: "duration": 4.8535000000000002e-05 2023-08-01T19:54:56.616 INFO:teuthology.orchestra.run.smithi155.stdout: } 2023-08-01T19:54:56.616 INFO:teuthology.orchestra.run.smithi155.stdout: ] 2023-08-01T19:54:56.616 INFO:teuthology.orchestra.run.smithi155.stdout: } 2023-08-01T19:54:56.616 INFO:teuthology.orchestra.run.smithi155.stdout: }, 2023-08-01T19:54:56.616 INFO:teuthology.orchestra.run.smithi155.stdout: { 2023-08-01T19:54:56.617 INFO:teuthology.orchestra.run.smithi155.stdout: "description": "osd_op(client.4668.0:73454 5.8 5:15596b2f:::benchmark_data_smithi006_114134_object73453:head [set-alloc-hint object_size 65536 write_size 65536,write 0~65536] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e31)", 2023-08-01T19:54:56.617 INFO:teuthology.orchestra.run.smithi155.stdout: "initiated_at": "2023-08-01T19:54:51.460020+0000", 2023-08-01T19:54:56.617 INFO:teuthology.orchestra.run.smithi155.stdout: "age": 5.0981998859999997, 2023-08-01T19:54:56.617 INFO:teuthology.orchestra.run.smithi155.stdout: "duration": 0.022889436999999999, 2023-08-01T19:54:56.617 INFO:teuthology.orchestra.run.smithi155.stdout: "type_data": { 2023-08-01T19:54:56.617 INFO:teuthology.orchestra.run.smithi155.stdout: "flag_point": "commit sent; apply or cleanup", 2023-08-01T19:54:56.617 INFO:teuthology.orchestra.run.smithi155.stdout: "client_info": { 2023-08-01T19:54:56.618 INFO:teuthology.orchestra.run.smithi155.stdout: "client": "client.4668", 2023-08-01T19:54:56.618 INFO:teuthology.orchestra.run.smithi155.stdout: "client_addr": "172.21.15.6:0/1709472247", 2023-08-01T19:54:56.618 INFO:teuthology.orchestra.run.smithi155.stdout: "tid": 73454 2023-08-01T19:54:56.618 INFO:teuthology.orchestra.run.smithi155.stdout: }, 2023-08-01T19:54:56.618 INFO:teuthology.orchestra.run.smithi155.stdout: "events": [ 2023-08-01T19:54:56.618 INFO:teuthology.orchestra.run.smithi155.stdout: { 2023-08-01T19:54:56.618 INFO:teuthology.orchestra.run.smithi155.stdout: "event": "initiated", 2023-08-01T19:54:56.618 INFO:teuthology.orchestra.run.smithi155.stdout: "time": "2023-08-01T19:54:51.460020+0000", 2023-08-01T19:54:56.619 INFO:teuthology.orchestra.run.smithi155.stdout: "duration": 0 2023-08-01T19:54:56.619 INFO:teuthology.orchestra.run.smithi155.stdout: }, 2023-08-01T19:54:56.619 INFO:teuthology.orchestra.run.smithi155.stdout: { 2023-08-01T19:54:56.619 INFO:teuthology.orchestra.run.smithi155.stdout: "event": "throttled", 2023-08-01T19:54:56.619 INFO:teuthology.orchestra.run.smithi155.stdout: "time": "2023-08-01T19:54:51.460020+0000", 2023-08-01T19:54:56.619 INFO:teuthology.orchestra.run.smithi155.stdout: "duration": 0 2023-08-01T19:54:56.619 INFO:teuthology.orchestra.run.smithi155.stdout: }, 2023-08-01T19:54:56.619 INFO:teuthology.orchestra.run.smithi155.stdout: { 2023-08-01T19:54:56.620 INFO:teuthology.orchestra.run.smithi155.stdout: "event": "header_read", 2023-08-01T19:54:56.620 INFO:teuthology.orchestra.run.smithi155.stdout: "time": "2023-08-01T19:54:51.460019+0000", 2023-08-01T19:54:56.620 INFO:teuthology.orchestra.run.smithi155.stdout: "duration": 4294967295.9999995 2023-08-01T19:54:56.620 INFO:teuthology.orchestra.run.smithi155.stdout: }, 2023-08-01T19:54:56.620 INFO:teuthology.orchestra.run.smithi155.stdout: { 2023-08-01T19:54:56.620 INFO:teuthology.orchestra.run.smithi155.stdout: "event": "all_read", 2023-08-01T19:54:56.620 INFO:teuthology.orchestra.run.smithi155.stdout: "time": "2023-08-01T19:54:51.460051+0000", 2023-08-01T19:54:56.621 INFO:teuthology.orchestra.run.smithi155.stdout: "duration": 3.1736000000000002e-05 2023-08-01T19:54:56.621 INFO:teuthology.orchestra.run.smithi155.stdout: }, 2023-08-01T19:54:56.621 INFO:teuthology.orchestra.run.smithi155.stdout: { 2023-08-01T19:54:56.621 INFO:teuthology.orchestra.run.smithi155.stdout: "event": "dispatched", 2023-08-01T19:54:56.621 INFO:teuthology.orchestra.run.smithi155.stdout: "time": "2023-08-01T19:54:51.460058+0000", 2023-08-01T19:54:56.621 INFO:teuthology.orchestra.run.smithi155.stdout: "duration": 7.3869999999999997e-06 2023-08-01T19:54:56.621 INFO:teuthology.orchestra.run.smithi155.stdout: }, 2023-08-01T19:54:56.621 INFO:teuthology.orchestra.run.smithi155.stdout: { 2023-08-01T19:54:56.622 INFO:teuthology.orchestra.run.smithi155.stdout: "event": "queued_for_pg", 2023-08-01T19:54:56.622 INFO:teuthology.orchestra.run.smithi155.stdout: "time": "2023-08-01T19:54:51.460062+0000", 2023-08-01T19:54:56.622 INFO:teuthology.orchestra.run.smithi155.stdout: "duration": 4.352e-06 2023-08-01T19:54:56.622 INFO:teuthology.orchestra.run.smithi155.stdout: }, 2023-08-01T19:54:56.622 INFO:teuthology.orchestra.run.smithi155.stdout: { 2023-08-01T19:54:56.622 INFO:teuthology.orchestra.run.smithi155.stdout: "event": "reached_pg", 2023-08-01T19:54:56.622 INFO:teuthology.orchestra.run.smithi155.stdout: "time": "2023-08-01T19:54:51.460101+0000", 2023-08-01T19:54:56.622 INFO:teuthology.orchestra.run.smithi155.stdout: "duration": 3.8705000000000003e-05 2023-08-01T19:54:56.623 INFO:teuthology.orchestra.run.smithi155.stdout: }, 2023-08-01T19:54:56.623 INFO:teuthology.orchestra.run.smithi155.stdout: { 2023-08-01T19:54:56.623 INFO:teuthology.orchestra.run.smithi155.stdout: "event": "started", 2023-08-01T19:54:56.623 INFO:teuthology.orchestra.run.smithi155.stdout: "time": "2023-08-01T19:54:51.460236+0000", 2023-08-01T19:54:56.623 INFO:teuthology.orchestra.run.smithi155.stdout: "duration": 0.00013463599999999999 2023-08-01T19:54:56.623 INFO:teuthology.orchestra.run.smithi155.stdout: }, 2023-08-01T19:54:56.623 INFO:teuthology.orchestra.run.smithi155.stdout: { 2023-08-01T19:54:56.623 INFO:teuthology.orchestra.run.smithi155.stdout: "event": "waiting for subops from 0", 2023-08-01T19:54:56.624 INFO:teuthology.orchestra.run.smithi155.stdout: "time": "2023-08-01T19:54:51.460391+0000", 2023-08-01T19:54:56.624 INFO:teuthology.orchestra.run.smithi155.stdout: "duration": 0.00015525000000000001 2023-08-01T19:54:56.624 INFO:teuthology.orchestra.run.smithi155.stdout: }, 2023-08-01T19:54:56.624 INFO:teuthology.orchestra.run.smithi155.stdout: { 2023-08-01T19:54:56.624 INFO:teuthology.orchestra.run.smithi155.stdout: "event": "sub_op_commit_rec", 2023-08-01T19:54:56.624 INFO:teuthology.orchestra.run.smithi155.stdout: "time": "2023-08-01T19:54:51.468393+0000", 2023-08-01T19:54:56.624 INFO:teuthology.orchestra.run.smithi155.stdout: "duration": 0.00800208 2023-08-01T19:54:56.625 INFO:teuthology.orchestra.run.smithi155.stdout: }, 2023-08-01T19:54:56.625 INFO:teuthology.orchestra.run.smithi155.stdout: { 2023-08-01T19:54:56.625 INFO:teuthology.orchestra.run.smithi155.stdout: "event": "op_commit", 2023-08-01T19:54:56.625 INFO:teuthology.orchestra.run.smithi155.stdout: "time": "2023-08-01T19:54:51.482815+0000", 2023-08-01T19:54:56.625 INFO:teuthology.orchestra.run.smithi155.stdout: "duration": 0.01442148 2023-08-01T19:54:56.625 INFO:teuthology.orchestra.run.smithi155.stdout: }, 2023-08-01T19:54:56.625 INFO:teuthology.orchestra.run.smithi155.stdout: { 2023-08-01T19:54:56.626 INFO:teuthology.orchestra.run.smithi155.stdout: "event": "commit_sent", 2023-08-01T19:54:56.626 INFO:teuthology.orchestra.run.smithi155.stdout: "time": "2023-08-01T19:54:51.482866+0000", 2023-08-01T19:54:56.626 INFO:teuthology.orchestra.run.smithi155.stdout: "duration": 5.1842999999999998e-05 2023-08-01T19:54:56.626 INFO:teuthology.orchestra.run.smithi155.stdout: }, 2023-08-01T19:54:56.626 INFO:teuthology.orchestra.run.smithi155.stdout: { 2023-08-01T19:54:56.626 INFO:teuthology.orchestra.run.smithi155.stdout: "event": "done", 2023-08-01T19:54:56.626 INFO:teuthology.orchestra.run.smithi155.stdout: "time": "2023-08-01T19:54:51.482909+0000", 2023-08-01T19:54:56.626 INFO:teuthology.orchestra.run.smithi155.stdout: "duration": 4.2663000000000001e-05 2023-08-01T19:54:56.627 INFO:teuthology.orchestra.run.smithi155.stdout: } 2023-08-01T19:54:56.627 INFO:teuthology.orchestra.run.smithi155.stdout: ] 2023-08-01T19:54:56.627 INFO:teuthology.orchestra.run.smithi155.stdout: } 2023-08-01T19:54:56.627 INFO:teuthology.orchestra.run.smithi155.stdout: }, 2023-08-01T19:54:56.627 INFO:teuthology.orchestra.run.smithi155.stdout: { 2023-08-01T19:54:56.627 INFO:teuthology.orchestra.run.smithi155.stdout: "description": "osd_op(client.4668.0:73455 5.b 5:de51121e:::benchmark_data_smithi006_114134_object73454:head [set-alloc-hint object_size 65536 write_size 65536,write 0~65536] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e31)", 2023-08-01T19:54:56.627 INFO:teuthology.orchestra.run.smithi155.stdout: "initiated_at": "2023-08-01T19:54:51.460078+0000", 2023-08-01T19:54:56.628 INFO:teuthology.orchestra.run.smithi155.stdout: "age": 5.098141912, 2023-08-01T19:54:56.628 INFO:teuthology.orchestra.run.smithi155.stdout: "duration": 0.022689121999999999, 2023-08-01T19:54:56.628 INFO:teuthology.orchestra.run.smithi155.stdout: "type_data": { 2023-08-01T19:54:56.628 INFO:teuthology.orchestra.run.smithi155.stdout: "flag_point": "commit sent; apply or cleanup", 2023-08-01T19:54:56.628 INFO:teuthology.orchestra.run.smithi155.stdout: "client_info": { 2023-08-01T19:54:56.628 INFO:teuthology.orchestra.run.smithi155.stdout: "client": "client.4668", 2023-08-01T19:54:56.628 INFO:teuthology.orchestra.run.smithi155.stdout: "client_addr": "172.21.15.6:0/1709472247", 2023-08-01T19:54:56.629 INFO:teuthology.orchestra.run.smithi155.stdout: "tid": 73455 2023-08-01T19:54:56.629 INFO:teuthology.orchestra.run.smithi155.stdout: }, 2023-08-01T19:54:56.629 INFO:teuthology.orchestra.run.smithi155.stdout: "events": [ 2023-08-01T19:54:56.629 INFO:teuthology.orchestra.run.smithi155.stdout: { 2023-08-01T19:54:56.629 INFO:teuthology.orchestra.run.smithi155.stdout: "event": "initiated", 2023-08-01T19:54:56.629 INFO:teuthology.orchestra.run.smithi155.stdout: "time": "2023-08-01T19:54:51.460078+0000", 2023-08-01T19:54:56.629 INFO:teuthology.orchestra.run.smithi155.stdout: "duration": 0 2023-08-01T19:54:56.629 INFO:teuthology.orchestra.run.smithi155.stdout: }, 2023-08-01T19:54:56.630 INFO:teuthology.orchestra.run.smithi155.stdout: { 2023-08-01T19:54:56.630 INFO:teuthology.orchestra.run.smithi155.stdout: "event": "throttled", 2023-08-01T19:54:56.630 INFO:teuthology.orchestra.run.smithi155.stdout: "time": "2023-08-01T19:54:51.460078+0000", 2023-08-01T19:54:56.630 INFO:teuthology.orchestra.run.smithi155.stdout: "duration": 0 2023-08-01T19:54:56.630 INFO:teuthology.orchestra.run.smithi155.stdout: }, 2023-08-01T19:54:56.630 INFO:teuthology.orchestra.run.smithi155.stdout: { 2023-08-01T19:54:56.630 INFO:teuthology.orchestra.run.smithi155.stdout: "event": "header_read", 2023-08-01T19:54:56.631 INFO:teuthology.orchestra.run.smithi155.stdout: "time": "2023-08-01T19:54:51.460077+0000", 2023-08-01T19:54:56.631 INFO:teuthology.orchestra.run.smithi155.stdout: "duration": 4294967295.9999995 2023-08-01T19:54:56.631 INFO:teuthology.orchestra.run.smithi155.stdout: }, 2023-08-01T19:54:56.631 INFO:teuthology.orchestra.run.smithi155.stdout: { 2023-08-01T19:54:56.631 INFO:teuthology.orchestra.run.smithi155.stdout: "event": "all_read", 2023-08-01T19:54:56.631 INFO:teuthology.orchestra.run.smithi155.stdout: "time": "2023-08-01T19:54:51.460102+0000", 2023-08-01T19:54:56.631 INFO:teuthology.orchestra.run.smithi155.stdout: "duration": 2.4933e-05 2023-08-01T19:54:56.631 INFO:teuthology.orchestra.run.smithi155.stdout: }, 2023-08-01T19:54:56.632 INFO:teuthology.orchestra.run.smithi155.stdout: { 2023-08-01T19:54:56.632 INFO:teuthology.orchestra.run.smithi155.stdout: "event": "dispatched", 2023-08-01T19:54:56.632 INFO:teuthology.orchestra.run.smithi155.stdout: "time": "2023-08-01T19:54:51.460109+0000", 2023-08-01T19:54:56.632 INFO:teuthology.orchestra.run.smithi155.stdout: "duration": 7.0720000000000002e-06 2023-08-01T19:54:56.632 INFO:teuthology.orchestra.run.smithi155.stdout: }, 2023-08-01T19:54:56.632 INFO:teuthology.orchestra.run.smithi155.stdout: { 2023-08-01T19:54:56.632 INFO:teuthology.orchestra.run.smithi155.stdout: "event": "queued_for_pg", 2023-08-01T19:54:56.633 INFO:teuthology.orchestra.run.smithi155.stdout: "time": "2023-08-01T19:54:51.460113+0000", 2023-08-01T19:54:56.633 INFO:teuthology.orchestra.run.smithi155.stdout: "duration": 4.3220000000000003e-06 2023-08-01T19:54:56.633 INFO:teuthology.orchestra.run.smithi155.stdout: }, 2023-08-01T19:54:56.633 INFO:teuthology.orchestra.run.smithi155.stdout: { 2023-08-01T19:54:56.633 INFO:teuthology.orchestra.run.smithi155.stdout: "event": "reached_pg", 2023-08-01T19:54:56.633 INFO:teuthology.orchestra.run.smithi155.stdout: "time": "2023-08-01T19:54:51.460955+0000", 2023-08-01T19:54:56.633 INFO:teuthology.orchestra.run.smithi155.stdout: "duration": 0.00084142500000000003 2023-08-01T19:54:56.633 INFO:teuthology.orchestra.run.smithi155.stdout: }, 2023-08-01T19:54:56.634 INFO:teuthology.orchestra.run.smithi155.stdout: { 2023-08-01T19:54:56.634 INFO:teuthology.orchestra.run.smithi155.stdout: "event": "started", 2023-08-01T19:54:56.634 INFO:teuthology.orchestra.run.smithi155.stdout: "time": "2023-08-01T19:54:51.461079+0000", 2023-08-01T19:54:56.634 INFO:teuthology.orchestra.run.smithi155.stdout: "duration": 0.000123826 2023-08-01T19:54:56.634 INFO:teuthology.orchestra.run.smithi155.stdout: }, 2023-08-01T19:54:56.634 INFO:teuthology.orchestra.run.smithi155.stdout: { 2023-08-01T19:54:56.634 INFO:teuthology.orchestra.run.smithi155.stdout: "event": "waiting for subops from 0", 2023-08-01T19:54:56.634 INFO:teuthology.orchestra.run.smithi155.stdout: "time": "2023-08-01T19:54:51.461233+0000", 2023-08-01T19:54:56.635 INFO:teuthology.orchestra.run.smithi155.stdout: "duration": 0.00015431900000000001 2023-08-01T19:54:56.635 INFO:teuthology.orchestra.run.smithi155.stdout: }, 2023-08-01T19:54:56.635 INFO:teuthology.orchestra.run.smithi155.stdout: { 2023-08-01T19:54:56.635 INFO:teuthology.orchestra.run.smithi155.stdout: "event": "sub_op_commit_rec", 2023-08-01T19:54:56.635 INFO:teuthology.orchestra.run.smithi155.stdout: "time": "2023-08-01T19:54:51.468509+0000", 2023-08-01T19:54:56.635 INFO:teuthology.orchestra.run.smithi155.stdout: "duration": 0.0072759859999999999 2023-08-01T19:54:56.635 INFO:teuthology.orchestra.run.smithi155.stdout: }, 2023-08-01T19:54:56.635 INFO:teuthology.orchestra.run.smithi155.stdout: { 2023-08-01T19:54:56.636 INFO:teuthology.orchestra.run.smithi155.stdout: "event": "op_commit", 2023-08-01T19:54:56.636 INFO:teuthology.orchestra.run.smithi155.stdout: "time": "2023-08-01T19:54:51.482704+0000", 2023-08-01T19:54:56.636 INFO:teuthology.orchestra.run.smithi155.stdout: "duration": 0.01419545 2023-08-01T19:54:56.636 INFO:teuthology.orchestra.run.smithi155.stdout: }, 2023-08-01T19:54:56.636 INFO:teuthology.orchestra.run.smithi155.stdout: { 2023-08-01T19:54:56.636 INFO:teuthology.orchestra.run.smithi155.stdout: "event": "commit_sent", 2023-08-01T19:54:56.636 INFO:teuthology.orchestra.run.smithi155.stdout: "time": "2023-08-01T19:54:51.482747+0000", 2023-08-01T19:54:56.637 INFO:teuthology.orchestra.run.smithi155.stdout: "duration": 4.2413999999999997e-05 2023-08-01T19:54:56.637 INFO:teuthology.orchestra.run.smithi155.stdout: }, 2023-08-01T19:54:56.637 INFO:teuthology.orchestra.run.smithi155.stdout: { 2023-08-01T19:54:56.637 INFO:teuthology.orchestra.run.smithi155.stdout: "event": "done", 2023-08-01T19:54:56.637 INFO:teuthology.orchestra.run.smithi155.stdout: "time": "2023-08-01T19:54:51.482767+0000", 2023-08-01T19:54:56.637 INFO:teuthology.orchestra.run.smithi155.stdout: "duration": 1.9908999999999999e-05 2023-08-01T19:54:56.637 INFO:teuthology.orchestra.run.smithi155.stdout: } 2023-08-01T19:54:56.638 INFO:teuthology.orchestra.run.smithi155.stdout: ] 2023-08-01T19:54:56.638 INFO:teuthology.orchestra.run.smithi155.stdout: } 2023-08-01T19:54:56.638 INFO:teuthology.orchestra.run.smithi155.stdout: }, 2023-08-01T19:54:56.638 INFO:teuthology.orchestra.run.smithi155.stdout: { 2023-08-01T19:54:56.638 INFO:teuthology.orchestra.run.smithi155.stdout: "description": "osd_op(client.4668.0:73456 5.0 5:0164baf4:::benchmark_data_smithi006_114134_object73455:head [set-alloc-hint object_size 65536 write_size 65536,write 0~65536] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e31)", 2023-08-01T19:54:56.638 INFO:teuthology.orchestra.run.smithi155.stdout: "initiated_at": "2023-08-01T19:54:51.461520+0000", 2023-08-01T19:54:56.638 INFO:teuthology.orchestra.run.smithi155.stdout: "age": 5.096699922, 2023-08-01T19:54:56.638 INFO:teuthology.orchestra.run.smithi155.stdout: "duration": 0.023899916, 2023-08-01T19:54:56.639 INFO:teuthology.orchestra.run.smithi155.stdout: "type_data": { 2023-08-01T19:54:56.639 INFO:teuthology.orchestra.run.smithi155.stdout: "flag_point": "commit sent; apply or cleanup", 2023-08-01T19:54:56.639 INFO:teuthology.orchestra.run.smithi155.stdout: "client_info": { 2023-08-01T19:54:56.639 INFO:teuthology.orchestra.run.smithi155.stdout: "client": "client.4668", 2023-08-01T19:54:56.639 INFO:teuthology.orchestra.run.smithi155.stdout: "client_addr": "172.21.15.6:0/1709472247", 2023-08-01T19:54:56.639 INFO:teuthology.orchestra.run.smithi155.stdout: "tid": 73456 2023-08-01T19:54:56.639 INFO:teuthology.orchestra.run.smithi155.stdout: }, 2023-08-01T19:54:56.639 INFO:teuthology.orchestra.run.smithi155.stdout: "events": [ 2023-08-01T19:54:56.640 INFO:teuthology.orchestra.run.smithi155.stdout: { 2023-08-01T19:54:56.640 INFO:teuthology.orchestra.run.smithi155.stdout: "event": "initiated", 2023-08-01T19:54:56.640 INFO:teuthology.orchestra.run.smithi155.stdout: "time": "2023-08-01T19:54:51.461520+0000", 2023-08-01T19:54:56.640 INFO:teuthology.orchestra.run.smithi155.stdout: "duration": 0 2023-08-01T19:54:56.640 INFO:teuthology.orchestra.run.smithi155.stdout: }, 2023-08-01T19:54:56.640 INFO:teuthology.orchestra.run.smithi155.stdout: { 2023-08-01T19:54:56.640 INFO:teuthology.orchestra.run.smithi155.stdout: "event": "throttled", 2023-08-01T19:54:56.640 INFO:teuthology.orchestra.run.smithi155.stdout: "time": "2023-08-01T19:54:51.461520+0000", 2023-08-01T19:54:56.641 INFO:teuthology.orchestra.run.smithi155.stdout: "duration": 0 2023-08-01T19:54:56.641 INFO:teuthology.orchestra.run.smithi155.stdout: }, 2023-08-01T19:54:56.641 INFO:teuthology.orchestra.run.smithi155.stdout: { 2023-08-01T19:54:56.641 INFO:teuthology.orchestra.run.smithi155.stdout: "event": "header_read", 2023-08-01T19:54:56.641 INFO:teuthology.orchestra.run.smithi155.stdout: "time": "2023-08-01T19:54:51.461519+0000", 2023-08-01T19:54:56.641 INFO:teuthology.orchestra.run.smithi155.stdout: "duration": 4294967295.999999 2023-08-01T19:54:56.641 INFO:teuthology.orchestra.run.smithi155.stdout: }, 2023-08-01T19:54:56.642 INFO:teuthology.orchestra.run.smithi155.stdout: { 2023-08-01T19:54:56.642 INFO:teuthology.orchestra.run.smithi155.stdout: "event": "all_read", 2023-08-01T19:54:56.642 INFO:teuthology.orchestra.run.smithi155.stdout: "time": "2023-08-01T19:54:51.461633+0000", 2023-08-01T19:54:56.642 INFO:teuthology.orchestra.run.smithi155.stdout: "duration": 0.000114015 2023-08-01T19:54:56.642 INFO:teuthology.orchestra.run.smithi155.stdout: }, 2023-08-01T19:54:56.642 INFO:teuthology.orchestra.run.smithi155.stdout: { 2023-08-01T19:54:56.642 INFO:teuthology.orchestra.run.smithi155.stdout: "event": "dispatched", 2023-08-01T19:54:56.642 INFO:teuthology.orchestra.run.smithi155.stdout: "time": "2023-08-01T19:54:51.461643+0000", 2023-08-01T19:54:56.643 INFO:teuthology.orchestra.run.smithi155.stdout: "duration": 1.0217000000000001e-05 2023-08-01T19:54:56.643 INFO:teuthology.orchestra.run.smithi155.stdout: }, 2023-08-01T19:54:56.643 INFO:teuthology.orchestra.run.smithi155.stdout: { 2023-08-01T19:54:56.643 INFO:teuthology.orchestra.run.smithi155.stdout: "event": "queued_for_pg", 2023-08-01T19:54:56.643 INFO:teuthology.orchestra.run.smithi155.stdout: "time": "2023-08-01T19:54:51.461649+0000", 2023-08-01T19:54:56.643 INFO:teuthology.orchestra.run.smithi155.stdout: "duration": 5.8850000000000004e-06 2023-08-01T19:54:56.643 INFO:teuthology.orchestra.run.smithi155.stdout: }, 2023-08-01T19:54:56.643 INFO:teuthology.orchestra.run.smithi155.stdout: { 2023-08-01T19:54:56.644 INFO:teuthology.orchestra.run.smithi155.stdout: "event": "reached_pg", 2023-08-01T19:54:56.644 INFO:teuthology.orchestra.run.smithi155.stdout: "time": "2023-08-01T19:54:51.461686+0000", 2023-08-01T19:54:56.644 INFO:teuthology.orchestra.run.smithi155.stdout: "duration": 3.7319e-05 2023-08-01T19:54:56.644 INFO:teuthology.orchestra.run.smithi155.stdout: }, 2023-08-01T19:54:56.644 INFO:teuthology.orchestra.run.smithi155.stdout: { 2023-08-01T19:54:56.644 INFO:teuthology.orchestra.run.smithi155.stdout: "event": "started", 2023-08-01T19:54:56.644 INFO:teuthology.orchestra.run.smithi155.stdout: "time": "2023-08-01T19:54:51.461802+0000", 2023-08-01T19:54:56.645 INFO:teuthology.orchestra.run.smithi155.stdout: "duration": 0.000115604 2023-08-01T19:54:56.645 INFO:teuthology.orchestra.run.smithi155.stdout: }, 2023-08-01T19:54:56.645 INFO:teuthology.orchestra.run.smithi155.stdout: { 2023-08-01T19:54:56.645 INFO:teuthology.orchestra.run.smithi155.stdout: "event": "waiting for subops from 0", 2023-08-01T19:54:56.645 INFO:teuthology.orchestra.run.smithi155.stdout: "time": "2023-08-01T19:54:51.461933+0000", 2023-08-01T19:54:56.645 INFO:teuthology.orchestra.run.smithi155.stdout: "duration": 0.000131175 2023-08-01T19:54:56.645 INFO:teuthology.orchestra.run.smithi155.stdout: }, 2023-08-01T19:54:56.645 INFO:teuthology.orchestra.run.smithi155.stdout: { 2023-08-01T19:54:56.646 INFO:teuthology.orchestra.run.smithi155.stdout: "event": "sub_op_commit_rec", 2023-08-01T19:54:56.646 INFO:teuthology.orchestra.run.smithi155.stdout: "time": "2023-08-01T19:54:51.468411+0000", 2023-08-01T19:54:56.646 INFO:teuthology.orchestra.run.smithi155.stdout: "duration": 0.0064775850000000001 2023-08-01T19:54:56.646 INFO:teuthology.orchestra.run.smithi155.stdout: }, 2023-08-01T19:54:56.646 INFO:teuthology.orchestra.run.smithi155.stdout: { 2023-08-01T19:54:56.646 INFO:teuthology.orchestra.run.smithi155.stdout: "event": "op_commit", 2023-08-01T19:54:56.646 INFO:teuthology.orchestra.run.smithi155.stdout: "time": "2023-08-01T19:54:51.485340+0000", 2023-08-01T19:54:56.646 INFO:teuthology.orchestra.run.smithi155.stdout: "duration": 0.016928907 2023-08-01T19:54:56.647 INFO:teuthology.orchestra.run.smithi155.stdout: }, 2023-08-01T19:54:56.647 INFO:teuthology.orchestra.run.smithi155.stdout: { 2023-08-01T19:54:56.647 INFO:teuthology.orchestra.run.smithi155.stdout: "event": "commit_sent", 2023-08-01T19:54:56.647 INFO:teuthology.orchestra.run.smithi155.stdout: "time": "2023-08-01T19:54:51.485385+0000", 2023-08-01T19:54:56.647 INFO:teuthology.orchestra.run.smithi155.stdout: "duration": 4.5222000000000002e-05 2023-08-01T19:54:56.647 INFO:teuthology.orchestra.run.smithi155.stdout: }, 2023-08-01T19:54:56.647 INFO:teuthology.orchestra.run.smithi155.stdout: { 2023-08-01T19:54:56.648 INFO:teuthology.orchestra.run.smithi155.stdout: "event": "done", 2023-08-01T19:54:56.648 INFO:teuthology.orchestra.run.smithi155.stdout: "time": "2023-08-01T19:54:51.485420+0000", 2023-08-01T19:54:56.648 INFO:teuthology.orchestra.run.smithi155.stdout: "duration": 3.4717e-05 2023-08-01T19:54:56.648 INFO:teuthology.orchestra.run.smithi155.stdout: } 2023-08-01T19:54:56.648 INFO:teuthology.orchestra.run.smithi155.stdout: ] 2023-08-01T19:54:56.648 INFO:teuthology.orchestra.run.smithi155.stdout: } 2023-08-01T19:54:56.649 INFO:teuthology.orchestra.run.smithi155.stdout: }, 2023-08-01T19:54:56.649 INFO:teuthology.orchestra.run.smithi155.stdout: { 2023-08-01T19:54:56.649 INFO:teuthology.orchestra.run.smithi155.stdout: "description": "osd_op(client.4668.0:73458 5.e 5:7e500c47:::benchmark_data_smithi006_114134_object73457:head [set-alloc-hint object_size 65536 write_size 65536,write 0~65536] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e31)", 2023-08-01T19:54:56.649 INFO:teuthology.orchestra.run.smithi155.stdout: "initiated_at": "2023-08-01T19:54:51.461880+0000", 2023-08-01T19:54:56.649 INFO:teuthology.orchestra.run.smithi155.stdout: "age": 5.0963399740000002, 2023-08-01T19:54:56.649 INFO:teuthology.orchestra.run.smithi155.stdout: "duration": 0.020850289000000001, 2023-08-01T19:54:56.649 INFO:teuthology.orchestra.run.smithi155.stdout: "type_data": { 2023-08-01T19:54:56.650 INFO:teuthology.orchestra.run.smithi155.stdout: "flag_point": "commit sent; apply or cleanup", 2023-08-01T19:54:56.650 INFO:teuthology.orchestra.run.smithi155.stdout: "client_info": { 2023-08-01T19:54:56.650 INFO:teuthology.orchestra.run.smithi155.stdout: "client": "client.4668", 2023-08-01T19:54:56.650 INFO:teuthology.orchestra.run.smithi155.stdout: "client_addr": "172.21.15.6:0/1709472247", 2023-08-01T19:54:56.650 INFO:teuthology.orchestra.run.smithi155.stdout: "tid": 73458 2023-08-01T19:54:56.650 INFO:teuthology.orchestra.run.smithi155.stdout: }, 2023-08-01T19:54:56.650 INFO:teuthology.orchestra.run.smithi155.stdout: "events": [ 2023-08-01T19:54:56.650 INFO:teuthology.orchestra.run.smithi155.stdout: { 2023-08-01T19:54:56.651 INFO:teuthology.orchestra.run.smithi155.stdout: "event": "initiated", 2023-08-01T19:54:56.651 INFO:teuthology.orchestra.run.smithi155.stdout: "time": "2023-08-01T19:54:51.461880+0000", 2023-08-01T19:54:56.651 INFO:teuthology.orchestra.run.smithi155.stdout: "duration": 0 2023-08-01T19:54:56.651 INFO:teuthology.orchestra.run.smithi155.stdout: }, 2023-08-01T19:54:56.651 INFO:teuthology.orchestra.run.smithi155.stdout: { 2023-08-01T19:54:56.651 INFO:teuthology.orchestra.run.smithi155.stdout: "event": "throttled", 2023-08-01T19:54:56.651 INFO:teuthology.orchestra.run.smithi155.stdout: "time": "2023-08-01T19:54:51.461880+0000", 2023-08-01T19:54:56.652 INFO:teuthology.orchestra.run.smithi155.stdout: "duration": 0 2023-08-01T19:54:56.652 INFO:teuthology.orchestra.run.smithi155.stdout: }, 2023-08-01T19:54:56.652 INFO:teuthology.orchestra.run.smithi155.stdout: { 2023-08-01T19:54:56.652 INFO:teuthology.orchestra.run.smithi155.stdout: "event": "header_read", 2023-08-01T19:54:56.652 INFO:teuthology.orchestra.run.smithi155.stdout: "time": "2023-08-01T19:54:51.461879+0000", 2023-08-01T19:54:56.652 INFO:teuthology.orchestra.run.smithi155.stdout: "duration": 4294967295.999999 2023-08-01T19:54:56.653 INFO:teuthology.orchestra.run.smithi155.stdout: }, 2023-08-01T19:54:56.653 INFO:teuthology.orchestra.run.smithi155.stdout: { 2023-08-01T19:54:56.653 INFO:teuthology.orchestra.run.smithi155.stdout: "event": "all_read", 2023-08-01T19:54:56.653 INFO:teuthology.orchestra.run.smithi155.stdout: "time": "2023-08-01T19:54:51.461950+0000", 2023-08-01T19:54:56.653 INFO:teuthology.orchestra.run.smithi155.stdout: "duration": 7.1371999999999994e-05 2023-08-01T19:54:56.653 INFO:teuthology.orchestra.run.smithi155.stdout: }, 2023-08-01T19:54:56.654 INFO:teuthology.orchestra.run.smithi155.stdout: { 2023-08-01T19:54:56.654 INFO:teuthology.orchestra.run.smithi155.stdout: "event": "dispatched", 2023-08-01T19:54:56.654 INFO:teuthology.orchestra.run.smithi155.stdout: "time": "2023-08-01T19:54:51.461962+0000", 2023-08-01T19:54:56.654 INFO:teuthology.orchestra.run.smithi155.stdout: "duration": 1.2193e-05 2023-08-01T19:54:56.654 INFO:teuthology.orchestra.run.smithi155.stdout: }, 2023-08-01T19:54:56.654 INFO:teuthology.orchestra.run.smithi155.stdout: { 2023-08-01T19:54:56.654 INFO:teuthology.orchestra.run.smithi155.stdout: "event": "queued_for_pg", 2023-08-01T19:54:56.654 INFO:teuthology.orchestra.run.smithi155.stdout: "time": "2023-08-01T19:54:51.461969+0000", 2023-08-01T19:54:56.655 INFO:teuthology.orchestra.run.smithi155.stdout: "duration": 6.6880000000000002e-06 2023-08-01T19:54:56.655 INFO:teuthology.orchestra.run.smithi155.stdout: }, 2023-08-01T19:54:56.655 INFO:teuthology.orchestra.run.smithi155.stdout: { 2023-08-01T19:54:56.655 INFO:teuthology.orchestra.run.smithi155.stdout: "event": "reached_pg", 2023-08-01T19:54:56.655 INFO:teuthology.orchestra.run.smithi155.stdout: "time": "2023-08-01T19:54:51.462013+0000", 2023-08-01T19:54:56.655 INFO:teuthology.orchestra.run.smithi155.stdout: "duration": 4.4227999999999997e-05 2023-08-01T19:54:56.655 INFO:teuthology.orchestra.run.smithi155.stdout: }, 2023-08-01T19:54:56.656 INFO:teuthology.orchestra.run.smithi155.stdout: { 2023-08-01T19:54:56.656 INFO:teuthology.orchestra.run.smithi155.stdout: "event": "started", 2023-08-01T19:54:56.656 INFO:teuthology.orchestra.run.smithi155.stdout: "time": "2023-08-01T19:54:51.462144+0000", 2023-08-01T19:54:56.656 INFO:teuthology.orchestra.run.smithi155.stdout: "duration": 0.000130545 2023-08-01T19:54:56.656 INFO:teuthology.orchestra.run.smithi155.stdout: }, 2023-08-01T19:54:56.656 INFO:teuthology.orchestra.run.smithi155.stdout: { 2023-08-01T19:54:56.656 INFO:teuthology.orchestra.run.smithi155.stdout: "event": "waiting for subops from 0", 2023-08-01T19:54:56.657 INFO:teuthology.orchestra.run.smithi155.stdout: "time": "2023-08-01T19:54:51.462334+0000", 2023-08-01T19:54:56.657 INFO:teuthology.orchestra.run.smithi155.stdout: "duration": 0.00019000000000000001 2023-08-01T19:54:56.657 INFO:teuthology.orchestra.run.smithi155.stdout: }, 2023-08-01T19:54:56.657 INFO:teuthology.orchestra.run.smithi155.stdout: { 2023-08-01T19:54:56.657 INFO:teuthology.orchestra.run.smithi155.stdout: "event": "sub_op_commit_rec", 2023-08-01T19:54:56.657 INFO:teuthology.orchestra.run.smithi155.stdout: "time": "2023-08-01T19:54:51.470224+0000", 2023-08-01T19:54:56.657 INFO:teuthology.orchestra.run.smithi155.stdout: "duration": 0.0078904000000000005 2023-08-01T19:54:56.658 INFO:teuthology.orchestra.run.smithi155.stdout: }, 2023-08-01T19:54:56.658 INFO:teuthology.orchestra.run.smithi155.stdout: { 2023-08-01T19:54:56.658 INFO:teuthology.orchestra.run.smithi155.stdout: "event": "op_commit", 2023-08-01T19:54:56.658 INFO:teuthology.orchestra.run.smithi155.stdout: "time": "2023-08-01T19:54:51.482650+0000", 2023-08-01T19:54:56.658 INFO:teuthology.orchestra.run.smithi155.stdout: "duration": 0.012425607 2023-08-01T19:54:56.658 INFO:teuthology.orchestra.run.smithi155.stdout: }, 2023-08-01T19:54:56.658 INFO:teuthology.orchestra.run.smithi155.stdout: { 2023-08-01T19:54:56.658 INFO:teuthology.orchestra.run.smithi155.stdout: "event": "commit_sent", 2023-08-01T19:54:56.659 INFO:teuthology.orchestra.run.smithi155.stdout: "time": "2023-08-01T19:54:51.482692+0000", 2023-08-01T19:54:56.659 INFO:teuthology.orchestra.run.smithi155.stdout: "duration": 4.1844000000000001e-05 2023-08-01T19:54:56.659 INFO:teuthology.orchestra.run.smithi155.stdout: }, 2023-08-01T19:54:56.659 INFO:teuthology.orchestra.run.smithi155.stdout: { 2023-08-01T19:54:56.659 INFO:teuthology.orchestra.run.smithi155.stdout: "event": "done", 2023-08-01T19:54:56.659 INFO:teuthology.orchestra.run.smithi155.stdout: "time": "2023-08-01T19:54:51.482730+0000", 2023-08-01T19:54:56.659 INFO:teuthology.orchestra.run.smithi155.stdout: "duration": 3.8223000000000003e-05 2023-08-01T19:54:56.659 INFO:teuthology.orchestra.run.smithi155.stdout: } 2023-08-01T19:54:56.660 INFO:teuthology.orchestra.run.smithi155.stdout: ] 2023-08-01T19:54:56.660 INFO:teuthology.orchestra.run.smithi155.stdout: } 2023-08-01T19:54:56.660 INFO:teuthology.orchestra.run.smithi155.stdout: }, 2023-08-01T19:54:56.660 INFO:teuthology.orchestra.run.smithi155.stdout: { 2023-08-01T19:54:56.660 INFO:teuthology.orchestra.run.smithi155.stdout: "description": "osd_op(client.4668.0:73461 5.8 5:1836657a:::benchmark_data_smithi006_114134_object73460:head [set-alloc-hint object_size 65536 write_size 65536,write 0~65536] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e31)", 2023-08-01T19:54:56.660 INFO:teuthology.orchestra.run.smithi155.stdout: "initiated_at": "2023-08-01T19:54:51.463336+0000", 2023-08-01T19:54:56.660 INFO:teuthology.orchestra.run.smithi155.stdout: "age": 5.0948836929999999, 2023-08-01T19:54:56.661 INFO:teuthology.orchestra.run.smithi155.stdout: "duration": 0.022268217, 2023-08-01T19:54:56.661 INFO:teuthology.orchestra.run.smithi155.stdout: "type_data": { 2023-08-01T19:54:56.661 INFO:teuthology.orchestra.run.smithi155.stdout: "flag_point": "commit sent; apply or cleanup", 2023-08-01T19:54:56.661 INFO:teuthology.orchestra.run.smithi155.stdout: "client_info": { 2023-08-01T19:54:56.661 INFO:teuthology.orchestra.run.smithi155.stdout: "client": "client.4668", 2023-08-01T19:54:56.661 INFO:teuthology.orchestra.run.smithi155.stdout: "client_addr": "172.21.15.6:0/1709472247", 2023-08-01T19:54:56.661 INFO:teuthology.orchestra.run.smithi155.stdout: "tid": 73461 2023-08-01T19:54:56.661 INFO:teuthology.orchestra.run.smithi155.stdout: }, 2023-08-01T19:54:56.662 INFO:teuthology.orchestra.run.smithi155.stdout: "events": [ 2023-08-01T19:54:56.662 INFO:teuthology.orchestra.run.smithi155.stdout: { 2023-08-01T19:54:56.662 INFO:teuthology.orchestra.run.smithi155.stdout: "event": "initiated", 2023-08-01T19:54:56.662 INFO:teuthology.orchestra.run.smithi155.stdout: "time": "2023-08-01T19:54:51.463336+0000", 2023-08-01T19:54:56.662 INFO:teuthology.orchestra.run.smithi155.stdout: "duration": 0 2023-08-01T19:54:56.662 INFO:teuthology.orchestra.run.smithi155.stdout: }, 2023-08-01T19:54:56.662 INFO:teuthology.orchestra.run.smithi155.stdout: { 2023-08-01T19:54:56.662 INFO:teuthology.orchestra.run.smithi155.stdout: "event": "throttled", 2023-08-01T19:54:56.663 INFO:teuthology.orchestra.run.smithi155.stdout: "time": "2023-08-01T19:54:51.463336+0000", 2023-08-01T19:54:56.663 INFO:teuthology.orchestra.run.smithi155.stdout: "duration": 0 2023-08-01T19:54:56.663 INFO:teuthology.orchestra.run.smithi155.stdout: }, 2023-08-01T19:54:56.663 INFO:teuthology.orchestra.run.smithi155.stdout: { 2023-08-01T19:54:56.663 INFO:teuthology.orchestra.run.smithi155.stdout: "event": "header_read", 2023-08-01T19:54:56.663 INFO:teuthology.orchestra.run.smithi155.stdout: "time": "2023-08-01T19:54:51.463335+0000", 2023-08-01T19:54:56.663 INFO:teuthology.orchestra.run.smithi155.stdout: "duration": 4294967295.999999 2023-08-01T19:54:56.664 INFO:teuthology.orchestra.run.smithi155.stdout: }, 2023-08-01T19:54:56.664 INFO:teuthology.orchestra.run.smithi155.stdout: { 2023-08-01T19:54:56.664 INFO:teuthology.orchestra.run.smithi155.stdout: "event": "all_read", 2023-08-01T19:54:56.664 INFO:teuthology.orchestra.run.smithi155.stdout: "time": "2023-08-01T19:54:51.463437+0000", 2023-08-01T19:54:56.664 INFO:teuthology.orchestra.run.smithi155.stdout: "duration": 0.00010173700000000001 2023-08-01T19:54:56.664 INFO:teuthology.orchestra.run.smithi155.stdout: }, 2023-08-01T19:54:56.664 INFO:teuthology.orchestra.run.smithi155.stdout: { 2023-08-01T19:54:56.664 INFO:teuthology.orchestra.run.smithi155.stdout: "event": "dispatched", 2023-08-01T19:54:56.665 INFO:teuthology.orchestra.run.smithi155.stdout: "time": "2023-08-01T19:54:51.463448+0000", 2023-08-01T19:54:56.665 INFO:teuthology.orchestra.run.smithi155.stdout: "duration": 1.171e-05 2023-08-01T19:54:56.665 INFO:teuthology.orchestra.run.smithi155.stdout: }, 2023-08-01T19:54:56.665 INFO:teuthology.orchestra.run.smithi155.stdout: { 2023-08-01T19:54:56.665 INFO:teuthology.orchestra.run.smithi155.stdout: "event": "queued_for_pg", 2023-08-01T19:54:56.665 INFO:teuthology.orchestra.run.smithi155.stdout: "time": "2023-08-01T19:54:51.463454+0000", 2023-08-01T19:54:56.665 INFO:teuthology.orchestra.run.smithi155.stdout: "duration": 6.0959999999999997e-06 2023-08-01T19:54:56.665 INFO:teuthology.orchestra.run.smithi155.stdout: }, 2023-08-01T19:54:56.666 INFO:teuthology.orchestra.run.smithi155.stdout: { 2023-08-01T19:54:56.666 INFO:teuthology.orchestra.run.smithi155.stdout: "event": "reached_pg", 2023-08-01T19:54:56.666 INFO:teuthology.orchestra.run.smithi155.stdout: "time": "2023-08-01T19:54:51.463491+0000", 2023-08-01T19:54:56.666 INFO:teuthology.orchestra.run.smithi155.stdout: "duration": 3.6365999999999997e-05 2023-08-01T19:54:56.666 INFO:teuthology.orchestra.run.smithi155.stdout: }, 2023-08-01T19:54:56.666 INFO:teuthology.orchestra.run.smithi155.stdout: { 2023-08-01T19:54:56.666 INFO:teuthology.orchestra.run.smithi155.stdout: "event": "started", 2023-08-01T19:54:56.667 INFO:teuthology.orchestra.run.smithi155.stdout: "time": "2023-08-01T19:54:51.463610+0000", 2023-08-01T19:54:56.667 INFO:teuthology.orchestra.run.smithi155.stdout: "duration": 0.000119517 2023-08-01T19:54:56.667 INFO:teuthology.orchestra.run.smithi155.stdout: }, 2023-08-01T19:54:56.667 INFO:teuthology.orchestra.run.smithi155.stdout: { 2023-08-01T19:54:56.667 INFO:teuthology.orchestra.run.smithi155.stdout: "event": "waiting for subops from 0", 2023-08-01T19:54:56.667 INFO:teuthology.orchestra.run.smithi155.stdout: "time": "2023-08-01T19:54:51.463746+0000", 2023-08-01T19:54:56.667 INFO:teuthology.orchestra.run.smithi155.stdout: "duration": 0.000136179 2023-08-01T19:54:56.667 INFO:teuthology.orchestra.run.smithi155.stdout: }, 2023-08-01T19:54:56.668 INFO:teuthology.orchestra.run.smithi155.stdout: { 2023-08-01T19:54:56.668 INFO:teuthology.orchestra.run.smithi155.stdout: "event": "sub_op_commit_rec", 2023-08-01T19:54:56.668 INFO:teuthology.orchestra.run.smithi155.stdout: "time": "2023-08-01T19:54:51.480388+0000", 2023-08-01T19:54:56.668 INFO:teuthology.orchestra.run.smithi155.stdout: "duration": 0.016641810999999999 2023-08-01T19:54:56.668 INFO:teuthology.orchestra.run.smithi155.stdout: }, 2023-08-01T19:54:56.668 INFO:teuthology.orchestra.run.smithi155.stdout: { 2023-08-01T19:54:56.668 INFO:teuthology.orchestra.run.smithi155.stdout: "event": "op_commit", 2023-08-01T19:54:56.668 INFO:teuthology.orchestra.run.smithi155.stdout: "time": "2023-08-01T19:54:51.485526+0000", 2023-08-01T19:54:56.669 INFO:teuthology.orchestra.run.smithi155.stdout: "duration": 0.0051382759999999998 2023-08-01T19:54:56.669 INFO:teuthology.orchestra.run.smithi155.stdout: }, 2023-08-01T19:54:56.669 INFO:teuthology.orchestra.run.smithi155.stdout: { 2023-08-01T19:54:56.669 INFO:teuthology.orchestra.run.smithi155.stdout: "event": "commit_sent", 2023-08-01T19:54:56.669 INFO:teuthology.orchestra.run.smithi155.stdout: "time": "2023-08-01T19:54:51.485569+0000", 2023-08-01T19:54:56.669 INFO:teuthology.orchestra.run.smithi155.stdout: "duration": 4.2840999999999999e-05 2023-08-01T19:54:56.669 INFO:teuthology.orchestra.run.smithi155.stdout: }, 2023-08-01T19:54:56.670 INFO:teuthology.orchestra.run.smithi155.stdout: { 2023-08-01T19:54:56.670 INFO:teuthology.orchestra.run.smithi155.stdout: "event": "done", 2023-08-01T19:54:56.670 INFO:teuthology.orchestra.run.smithi155.stdout: "time": "2023-08-01T19:54:51.485604+0000", 2023-08-01T19:54:56.670 INFO:teuthology.orchestra.run.smithi155.stdout: "duration": 3.4731999999999999e-05 2023-08-01T19:54:56.670 INFO:teuthology.orchestra.run.smithi155.stdout: } 2023-08-01T19:54:56.670 INFO:teuthology.orchestra.run.smithi155.stdout: ] 2023-08-01T19:54:56.670 INFO:teuthology.orchestra.run.smithi155.stdout: } 2023-08-01T19:54:56.670 INFO:teuthology.orchestra.run.smithi155.stdout: }, 2023-08-01T19:54:56.671 INFO:teuthology.orchestra.run.smithi155.stdout: { 2023-08-01T19:54:56.671 INFO:teuthology.orchestra.run.smithi155.stdout: "description": "osd_repop(client.4668.0:73460 5.f e31/19 5:ff4f0704:::benchmark_data_smithi006_114134_object73459:head v 31'4631, mlcod=31'4629)", 2023-08-01T19:54:56.671 INFO:teuthology.orchestra.run.smithi155.stdout: "initiated_at": "2023-08-01T19:54:51.463349+0000", 2023-08-01T19:54:56.671 INFO:teuthology.orchestra.run.smithi155.stdout: "age": 5.0948704280000001, 2023-08-01T19:54:56.671 INFO:teuthology.orchestra.run.smithi155.stdout: "duration": 0.019357510000000001, 2023-08-01T19:54:56.671 INFO:teuthology.orchestra.run.smithi155.stdout: "type_data": { 2023-08-01T19:54:56.671 INFO:teuthology.orchestra.run.smithi155.stdout: "flag_point": "commit sent; apply or cleanup", 2023-08-01T19:54:56.671 INFO:teuthology.orchestra.run.smithi155.stdout: "events": [ 2023-08-01T19:54:56.672 INFO:teuthology.orchestra.run.smithi155.stdout: { 2023-08-01T19:54:56.672 INFO:teuthology.orchestra.run.smithi155.stdout: "event": "initiated", 2023-08-01T19:54:56.672 INFO:teuthology.orchestra.run.smithi155.stdout: "time": "2023-08-01T19:54:51.463349+0000", 2023-08-01T19:54:56.672 INFO:teuthology.orchestra.run.smithi155.stdout: "duration": 0 2023-08-01T19:54:56.672 INFO:teuthology.orchestra.run.smithi155.stdout: }, 2023-08-01T19:54:56.672 INFO:teuthology.orchestra.run.smithi155.stdout: { 2023-08-01T19:54:56.672 INFO:teuthology.orchestra.run.smithi155.stdout: "event": "throttled", 2023-08-01T19:54:56.673 INFO:teuthology.orchestra.run.smithi155.stdout: "time": "2023-08-01T19:54:51.463349+0000", 2023-08-01T19:54:56.673 INFO:teuthology.orchestra.run.smithi155.stdout: "duration": 0 2023-08-01T19:54:56.673 INFO:teuthology.orchestra.run.smithi155.stdout: }, 2023-08-01T19:54:56.673 INFO:teuthology.orchestra.run.smithi155.stdout: { 2023-08-01T19:54:56.673 INFO:teuthology.orchestra.run.smithi155.stdout: "event": "header_read", 2023-08-01T19:54:56.673 INFO:teuthology.orchestra.run.smithi155.stdout: "time": "2023-08-01T19:54:51.463349+0000", 2023-08-01T19:54:56.673 INFO:teuthology.orchestra.run.smithi155.stdout: "duration": 4294967295.9999995 2023-08-01T19:54:56.673 INFO:teuthology.orchestra.run.smithi155.stdout: }, 2023-08-01T19:54:56.674 INFO:teuthology.orchestra.run.smithi155.stdout: { 2023-08-01T19:54:56.674 INFO:teuthology.orchestra.run.smithi155.stdout: "event": "all_read", 2023-08-01T19:54:56.674 INFO:teuthology.orchestra.run.smithi155.stdout: "time": "2023-08-01T19:54:51.463482+0000", 2023-08-01T19:54:56.674 INFO:teuthology.orchestra.run.smithi155.stdout: "duration": 0.00013323 2023-08-01T19:54:56.674 INFO:teuthology.orchestra.run.smithi155.stdout: }, 2023-08-01T19:54:56.674 INFO:teuthology.orchestra.run.smithi155.stdout: { 2023-08-01T19:54:56.674 INFO:teuthology.orchestra.run.smithi155.stdout: "event": "dispatched", 2023-08-01T19:54:56.674 INFO:teuthology.orchestra.run.smithi155.stdout: "time": "2023-08-01T19:54:51.463490+0000", 2023-08-01T19:54:56.675 INFO:teuthology.orchestra.run.smithi155.stdout: "duration": 7.6869999999999994e-06 2023-08-01T19:54:56.675 INFO:teuthology.orchestra.run.smithi155.stdout: }, 2023-08-01T19:54:56.675 INFO:teuthology.orchestra.run.smithi155.stdout: { 2023-08-01T19:54:56.675 INFO:teuthology.orchestra.run.smithi155.stdout: "event": "queued_for_pg", 2023-08-01T19:54:56.675 INFO:teuthology.orchestra.run.smithi155.stdout: "time": "2023-08-01T19:54:51.463494+0000", 2023-08-01T19:54:56.675 INFO:teuthology.orchestra.run.smithi155.stdout: "duration": 4.5220000000000001e-06 2023-08-01T19:54:56.675 INFO:teuthology.orchestra.run.smithi155.stdout: }, 2023-08-01T19:54:56.675 INFO:teuthology.orchestra.run.smithi155.stdout: { 2023-08-01T19:54:56.676 INFO:teuthology.orchestra.run.smithi155.stdout: "event": "reached_pg", 2023-08-01T19:54:56.676 INFO:teuthology.orchestra.run.smithi155.stdout: "time": "2023-08-01T19:54:51.463864+0000", 2023-08-01T19:54:56.676 INFO:teuthology.orchestra.run.smithi155.stdout: "duration": 0.00036956700000000001 2023-08-01T19:54:56.676 INFO:teuthology.orchestra.run.smithi155.stdout: }, 2023-08-01T19:54:56.676 INFO:teuthology.orchestra.run.smithi155.stdout: { 2023-08-01T19:54:56.676 INFO:teuthology.orchestra.run.smithi155.stdout: "event": "started", 2023-08-01T19:54:56.676 INFO:teuthology.orchestra.run.smithi155.stdout: "time": "2023-08-01T19:54:51.463884+0000", 2023-08-01T19:54:56.677 INFO:teuthology.orchestra.run.smithi155.stdout: "duration": 2.0029000000000001e-05 2023-08-01T19:54:56.677 INFO:teuthology.orchestra.run.smithi155.stdout: }, 2023-08-01T19:54:56.677 INFO:teuthology.orchestra.run.smithi155.stdout: { 2023-08-01T19:54:56.677 INFO:teuthology.orchestra.run.smithi155.stdout: "event": "commit_sent", 2023-08-01T19:54:56.677 INFO:teuthology.orchestra.run.smithi155.stdout: "time": "2023-08-01T19:54:51.482669+0000", 2023-08-01T19:54:56.677 INFO:teuthology.orchestra.run.smithi155.stdout: "duration": 0.018784896999999998 2023-08-01T19:54:56.677 INFO:teuthology.orchestra.run.smithi155.stdout: }, 2023-08-01T19:54:56.678 INFO:teuthology.orchestra.run.smithi155.stdout: { 2023-08-01T19:54:56.678 INFO:teuthology.orchestra.run.smithi155.stdout: "event": "done", 2023-08-01T19:54:56.678 INFO:teuthology.orchestra.run.smithi155.stdout: "time": "2023-08-01T19:54:51.482707+0000", 2023-08-01T19:54:56.678 INFO:teuthology.orchestra.run.smithi155.stdout: "duration": 3.7928e-05 2023-08-01T19:54:56.678 INFO:teuthology.orchestra.run.smithi155.stdout: } 2023-08-01T19:54:56.678 INFO:teuthology.orchestra.run.smithi155.stdout: ] 2023-08-01T19:54:56.678 INFO:teuthology.orchestra.run.smithi155.stdout: } 2023-08-01T19:54:56.678 INFO:teuthology.orchestra.run.smithi155.stdout: }, 2023-08-01T19:54:56.679 INFO:teuthology.orchestra.run.smithi155.stdout: { 2023-08-01T19:54:56.679 INFO:teuthology.orchestra.run.smithi155.stdout: "description": "osd_op(client.4668.0:73462 5.0 5:01d74876:::benchmark_data_smithi006_114134_object73461:head [set-alloc-hint object_size 65536 write_size 65536,write 0~65536] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e31)", 2023-08-01T19:54:56.679 INFO:teuthology.orchestra.run.smithi155.stdout: "initiated_at": "2023-08-01T19:54:51.463648+0000", 2023-08-01T19:54:56.679 INFO:teuthology.orchestra.run.smithi155.stdout: "age": 5.0945719949999999, 2023-08-01T19:54:56.679 INFO:teuthology.orchestra.run.smithi155.stdout: "duration": 0.021868533999999999, 2023-08-01T19:54:56.679 INFO:teuthology.orchestra.run.smithi155.stdout: "type_data": { 2023-08-01T19:54:56.679 INFO:teuthology.orchestra.run.smithi155.stdout: "flag_point": "commit sent; apply or cleanup", 2023-08-01T19:54:56.679 INFO:teuthology.orchestra.run.smithi155.stdout: "client_info": { 2023-08-01T19:54:56.680 INFO:teuthology.orchestra.run.smithi155.stdout: "client": "client.4668", 2023-08-01T19:54:56.680 INFO:teuthology.orchestra.run.smithi155.stdout: "client_addr": "172.21.15.6:0/1709472247", 2023-08-01T19:54:56.680 INFO:teuthology.orchestra.run.smithi155.stdout: "tid": 73462 2023-08-01T19:54:56.680 INFO:teuthology.orchestra.run.smithi155.stdout: }, 2023-08-01T19:54:56.680 INFO:teuthology.orchestra.run.smithi155.stdout: "events": [ 2023-08-01T19:54:56.680 INFO:teuthology.orchestra.run.smithi155.stdout: { 2023-08-01T19:54:56.680 INFO:teuthology.orchestra.run.smithi155.stdout: "event": "initiated", 2023-08-01T19:54:56.681 INFO:teuthology.orchestra.run.smithi155.stdout: "time": "2023-08-01T19:54:51.463648+0000", 2023-08-01T19:54:56.681 INFO:teuthology.orchestra.run.smithi155.stdout: "duration": 0 2023-08-01T19:54:56.681 INFO:teuthology.orchestra.run.smithi155.stdout: }, 2023-08-01T19:54:56.681 INFO:teuthology.orchestra.run.smithi155.stdout: { 2023-08-01T19:54:56.681 INFO:teuthology.orchestra.run.smithi155.stdout: "event": "throttled", 2023-08-01T19:54:56.681 INFO:teuthology.orchestra.run.smithi155.stdout: "time": "2023-08-01T19:54:51.463648+0000", 2023-08-01T19:54:56.681 INFO:teuthology.orchestra.run.smithi155.stdout: "duration": 0 2023-08-01T19:54:56.681 INFO:teuthology.orchestra.run.smithi155.stdout: }, 2023-08-01T19:54:56.682 INFO:teuthology.orchestra.run.smithi155.stdout: { 2023-08-01T19:54:56.682 INFO:teuthology.orchestra.run.smithi155.stdout: "event": "header_read", 2023-08-01T19:54:56.682 INFO:teuthology.orchestra.run.smithi155.stdout: "time": "2023-08-01T19:54:51.463646+0000", 2023-08-01T19:54:56.682 INFO:teuthology.orchestra.run.smithi155.stdout: "duration": 4294967295.999999 2023-08-01T19:54:56.682 INFO:teuthology.orchestra.run.smithi155.stdout: }, 2023-08-01T19:54:56.682 INFO:teuthology.orchestra.run.smithi155.stdout: { 2023-08-01T19:54:56.682 INFO:teuthology.orchestra.run.smithi155.stdout: "event": "all_read", 2023-08-01T19:54:56.683 INFO:teuthology.orchestra.run.smithi155.stdout: "time": "2023-08-01T19:54:51.463706+0000", 2023-08-01T19:54:56.683 INFO:teuthology.orchestra.run.smithi155.stdout: "duration": 6.0010000000000003e-05 2023-08-01T19:54:56.683 INFO:teuthology.orchestra.run.smithi155.stdout: }, 2023-08-01T19:54:56.683 INFO:teuthology.orchestra.run.smithi155.stdout: { 2023-08-01T19:54:56.683 INFO:teuthology.orchestra.run.smithi155.stdout: "event": "dispatched", 2023-08-01T19:54:56.683 INFO:teuthology.orchestra.run.smithi155.stdout: "time": "2023-08-01T19:54:51.463715+0000", 2023-08-01T19:54:56.683 INFO:teuthology.orchestra.run.smithi155.stdout: "duration": 8.5089999999999993e-06 2023-08-01T19:54:56.683 INFO:teuthology.orchestra.run.smithi155.stdout: }, 2023-08-01T19:54:56.684 INFO:teuthology.orchestra.run.smithi155.stdout: { 2023-08-01T19:54:56.684 INFO:teuthology.orchestra.run.smithi155.stdout: "event": "queued_for_pg", 2023-08-01T19:54:56.684 INFO:teuthology.orchestra.run.smithi155.stdout: "time": "2023-08-01T19:54:51.463720+0000", 2023-08-01T19:54:56.684 INFO:teuthology.orchestra.run.smithi155.stdout: "duration": 4.95e-06 2023-08-01T19:54:56.684 INFO:teuthology.orchestra.run.smithi155.stdout: }, 2023-08-01T19:54:56.684 INFO:teuthology.orchestra.run.smithi155.stdout: { 2023-08-01T19:54:56.684 INFO:teuthology.orchestra.run.smithi155.stdout: "event": "reached_pg", 2023-08-01T19:54:56.685 INFO:teuthology.orchestra.run.smithi155.stdout: "time": "2023-08-01T19:54:51.468441+0000", 2023-08-01T19:54:56.685 INFO:teuthology.orchestra.run.smithi155.stdout: "duration": 0.0047213819999999997 2023-08-01T19:54:56.685 INFO:teuthology.orchestra.run.smithi155.stdout: }, 2023-08-01T19:54:56.685 INFO:teuthology.orchestra.run.smithi155.stdout: { 2023-08-01T19:54:56.685 INFO:teuthology.orchestra.run.smithi155.stdout: "event": "started", 2023-08-01T19:54:56.685 INFO:teuthology.orchestra.run.smithi155.stdout: "time": "2023-08-01T19:54:51.468553+0000", 2023-08-01T19:54:56.685 INFO:teuthology.orchestra.run.smithi155.stdout: "duration": 0.000111462 2023-08-01T19:54:56.686 INFO:teuthology.orchestra.run.smithi155.stdout: }, 2023-08-01T19:54:56.686 INFO:teuthology.orchestra.run.smithi155.stdout: { 2023-08-01T19:54:56.686 INFO:teuthology.orchestra.run.smithi155.stdout: "event": "waiting for subops from 0", 2023-08-01T19:54:56.686 INFO:teuthology.orchestra.run.smithi155.stdout: "time": "2023-08-01T19:54:51.468697+0000", 2023-08-01T19:54:56.686 INFO:teuthology.orchestra.run.smithi155.stdout: "duration": 0.000144411 2023-08-01T19:54:56.686 INFO:teuthology.orchestra.run.smithi155.stdout: }, 2023-08-01T19:54:56.686 INFO:teuthology.orchestra.run.smithi155.stdout: { 2023-08-01T19:54:56.686 INFO:teuthology.orchestra.run.smithi155.stdout: "event": "sub_op_commit_rec", 2023-08-01T19:54:56.687 INFO:teuthology.orchestra.run.smithi155.stdout: "time": "2023-08-01T19:54:51.480377+0000", 2023-08-01T19:54:56.687 INFO:teuthology.orchestra.run.smithi155.stdout: "duration": 0.011680106000000001 2023-08-01T19:54:56.687 INFO:teuthology.orchestra.run.smithi155.stdout: }, 2023-08-01T19:54:56.687 INFO:teuthology.orchestra.run.smithi155.stdout: { 2023-08-01T19:54:56.687 INFO:teuthology.orchestra.run.smithi155.stdout: "event": "op_commit", 2023-08-01T19:54:56.687 INFO:teuthology.orchestra.run.smithi155.stdout: "time": "2023-08-01T19:54:51.485427+0000", 2023-08-01T19:54:56.687 INFO:teuthology.orchestra.run.smithi155.stdout: "duration": 0.005049998 2023-08-01T19:54:56.687 INFO:teuthology.orchestra.run.smithi155.stdout: }, 2023-08-01T19:54:56.688 INFO:teuthology.orchestra.run.smithi155.stdout: { 2023-08-01T19:54:56.688 INFO:teuthology.orchestra.run.smithi155.stdout: "event": "commit_sent", 2023-08-01T19:54:56.688 INFO:teuthology.orchestra.run.smithi155.stdout: "time": "2023-08-01T19:54:51.485485+0000", 2023-08-01T19:54:56.688 INFO:teuthology.orchestra.run.smithi155.stdout: "duration": 5.8199999999999998e-05 2023-08-01T19:54:56.688 INFO:teuthology.orchestra.run.smithi155.stdout: }, 2023-08-01T19:54:56.688 INFO:teuthology.orchestra.run.smithi155.stdout: { 2023-08-01T19:54:56.688 INFO:teuthology.orchestra.run.smithi155.stdout: "event": "done", 2023-08-01T19:54:56.689 INFO:teuthology.orchestra.run.smithi155.stdout: "time": "2023-08-01T19:54:51.485516+0000", 2023-08-01T19:54:56.689 INFO:teuthology.orchestra.run.smithi155.stdout: "duration": 3.0602999999999998e-05 2023-08-01T19:54:56.689 INFO:teuthology.orchestra.run.smithi155.stdout: } 2023-08-01T19:54:56.689 INFO:teuthology.orchestra.run.smithi155.stdout: ] 2023-08-01T19:54:56.689 INFO:teuthology.orchestra.run.smithi155.stdout: } 2023-08-01T19:54:56.689 INFO:teuthology.orchestra.run.smithi155.stdout: }, 2023-08-01T19:54:56.689 INFO:teuthology.orchestra.run.smithi155.stdout: { 2023-08-01T19:54:56.690 INFO:teuthology.orchestra.run.smithi155.stdout: "description": "osd_op(client.4668.0:73465 5.8 5:1617a69f:::benchmark_data_smithi006_114134_object73464:head [set-alloc-hint object_size 65536 write_size 65536,write 0~65536] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e31)", 2023-08-01T19:54:56.690 INFO:teuthology.orchestra.run.smithi155.stdout: "initiated_at": "2023-08-01T19:54:51.465724+0000", 2023-08-01T19:54:56.690 INFO:teuthology.orchestra.run.smithi155.stdout: "age": 5.0924957629999996, 2023-08-01T19:54:56.690 INFO:teuthology.orchestra.run.smithi155.stdout: "duration": 0.019964584, 2023-08-01T19:54:56.690 INFO:teuthology.orchestra.run.smithi155.stdout: "type_data": { 2023-08-01T19:54:56.690 INFO:teuthology.orchestra.run.smithi155.stdout: "flag_point": "commit sent; apply or cleanup", 2023-08-01T19:54:56.690 INFO:teuthology.orchestra.run.smithi155.stdout: "client_info": { 2023-08-01T19:54:56.690 INFO:teuthology.orchestra.run.smithi155.stdout: "client": "client.4668", 2023-08-01T19:54:56.691 INFO:teuthology.orchestra.run.smithi155.stdout: "client_addr": "172.21.15.6:0/1709472247", 2023-08-01T19:54:56.691 INFO:teuthology.orchestra.run.smithi155.stdout: "tid": 73465 2023-08-01T19:54:56.691 INFO:teuthology.orchestra.run.smithi155.stdout: }, 2023-08-01T19:54:56.691 INFO:teuthology.orchestra.run.smithi155.stdout: "events": [ 2023-08-01T19:54:56.691 INFO:teuthology.orchestra.run.smithi155.stdout: { 2023-08-01T19:54:56.691 INFO:teuthology.orchestra.run.smithi155.stdout: "event": "initiated", 2023-08-01T19:54:56.691 INFO:teuthology.orchestra.run.smithi155.stdout: "time": "2023-08-01T19:54:51.465724+0000", 2023-08-01T19:54:56.691 INFO:teuthology.orchestra.run.smithi155.stdout: "duration": 0 2023-08-01T19:54:56.692 INFO:teuthology.orchestra.run.smithi155.stdout: }, 2023-08-01T19:54:56.692 INFO:teuthology.orchestra.run.smithi155.stdout: { 2023-08-01T19:54:56.692 INFO:teuthology.orchestra.run.smithi155.stdout: "event": "throttled", 2023-08-01T19:54:56.692 INFO:teuthology.orchestra.run.smithi155.stdout: "time": "2023-08-01T19:54:51.465724+0000", 2023-08-01T19:54:56.692 INFO:teuthology.orchestra.run.smithi155.stdout: "duration": 0 2023-08-01T19:54:56.692 INFO:teuthology.orchestra.run.smithi155.stdout: }, 2023-08-01T19:54:56.692 INFO:teuthology.orchestra.run.smithi155.stdout: { 2023-08-01T19:54:56.693 INFO:teuthology.orchestra.run.smithi155.stdout: "event": "header_read", 2023-08-01T19:54:56.693 INFO:teuthology.orchestra.run.smithi155.stdout: "time": "2023-08-01T19:54:51.465723+0000", 2023-08-01T19:54:56.693 INFO:teuthology.orchestra.run.smithi155.stdout: "duration": 4294967295.9999995 2023-08-01T19:54:56.693 INFO:teuthology.orchestra.run.smithi155.stdout: }, 2023-08-01T19:54:56.693 INFO:teuthology.orchestra.run.smithi155.stdout: { 2023-08-01T19:54:56.693 INFO:teuthology.orchestra.run.smithi155.stdout: "event": "all_read", 2023-08-01T19:54:56.693 INFO:teuthology.orchestra.run.smithi155.stdout: "time": "2023-08-01T19:54:51.465868+0000", 2023-08-01T19:54:56.694 INFO:teuthology.orchestra.run.smithi155.stdout: "duration": 0.000145289 2023-08-01T19:54:56.694 INFO:teuthology.orchestra.run.smithi155.stdout: }, 2023-08-01T19:54:56.694 INFO:teuthology.orchestra.run.smithi155.stdout: { 2023-08-01T19:54:56.694 INFO:teuthology.orchestra.run.smithi155.stdout: "event": "dispatched", 2023-08-01T19:54:56.694 INFO:teuthology.orchestra.run.smithi155.stdout: "time": "2023-08-01T19:54:51.465880+0000", 2023-08-01T19:54:56.694 INFO:teuthology.orchestra.run.smithi155.stdout: "duration": 1.1378e-05 2023-08-01T19:54:56.694 INFO:teuthology.orchestra.run.smithi155.stdout: }, 2023-08-01T19:54:56.694 INFO:teuthology.orchestra.run.smithi155.stdout: { 2023-08-01T19:54:56.695 INFO:teuthology.orchestra.run.smithi155.stdout: "event": "queued_for_pg", 2023-08-01T19:54:56.695 INFO:teuthology.orchestra.run.smithi155.stdout: "time": "2023-08-01T19:54:51.465885+0000", 2023-08-01T19:54:56.695 INFO:teuthology.orchestra.run.smithi155.stdout: "duration": 4.7559999999999999e-06 2023-08-01T19:54:56.695 INFO:teuthology.orchestra.run.smithi155.stdout: }, 2023-08-01T19:54:56.695 INFO:teuthology.orchestra.run.smithi155.stdout: { 2023-08-01T19:54:56.695 INFO:teuthology.orchestra.run.smithi155.stdout: "event": "reached_pg", 2023-08-01T19:54:56.695 INFO:teuthology.orchestra.run.smithi155.stdout: "time": "2023-08-01T19:54:51.468434+0000", 2023-08-01T19:54:56.696 INFO:teuthology.orchestra.run.smithi155.stdout: "duration": 0.0025498579999999999 2023-08-01T19:54:56.696 INFO:teuthology.orchestra.run.smithi155.stdout: }, 2023-08-01T19:54:56.696 INFO:teuthology.orchestra.run.smithi155.stdout: { 2023-08-01T19:54:56.696 INFO:teuthology.orchestra.run.smithi155.stdout: "event": "started", 2023-08-01T19:54:56.696 INFO:teuthology.orchestra.run.smithi155.stdout: "time": "2023-08-01T19:54:51.468552+0000", 2023-08-01T19:54:56.696 INFO:teuthology.orchestra.run.smithi155.stdout: "duration": 0.000117992 2023-08-01T19:54:56.696 INFO:teuthology.orchestra.run.smithi155.stdout: }, 2023-08-01T19:54:56.696 INFO:teuthology.orchestra.run.smithi155.stdout: { 2023-08-01T19:54:56.697 INFO:teuthology.orchestra.run.smithi155.stdout: "event": "waiting for subops from 0", 2023-08-01T19:54:56.697 INFO:teuthology.orchestra.run.smithi155.stdout: "time": "2023-08-01T19:54:51.468697+0000", 2023-08-01T19:54:56.697 INFO:teuthology.orchestra.run.smithi155.stdout: "duration": 0.000144769 2023-08-01T19:54:56.697 INFO:teuthology.orchestra.run.smithi155.stdout: }, 2023-08-01T19:54:56.697 INFO:teuthology.orchestra.run.smithi155.stdout: { 2023-08-01T19:54:56.697 INFO:teuthology.orchestra.run.smithi155.stdout: "event": "sub_op_commit_rec", 2023-08-01T19:54:56.697 INFO:teuthology.orchestra.run.smithi155.stdout: "time": "2023-08-01T19:54:51.480446+0000", 2023-08-01T19:54:56.697 INFO:teuthology.orchestra.run.smithi155.stdout: "duration": 0.011749257000000001 2023-08-01T19:54:56.698 INFO:teuthology.orchestra.run.smithi155.stdout: }, 2023-08-01T19:54:56.698 INFO:teuthology.orchestra.run.smithi155.stdout: { 2023-08-01T19:54:56.698 INFO:teuthology.orchestra.run.smithi155.stdout: "event": "op_commit", 2023-08-01T19:54:56.698 INFO:teuthology.orchestra.run.smithi155.stdout: "time": "2023-08-01T19:54:51.485613+0000", 2023-08-01T19:54:56.698 INFO:teuthology.orchestra.run.smithi155.stdout: "duration": 0.0051662269999999998 2023-08-01T19:54:56.698 INFO:teuthology.orchestra.run.smithi155.stdout: }, 2023-08-01T19:54:56.698 INFO:teuthology.orchestra.run.smithi155.stdout: { 2023-08-01T19:54:56.699 INFO:teuthology.orchestra.run.smithi155.stdout: "event": "commit_sent", 2023-08-01T19:54:56.699 INFO:teuthology.orchestra.run.smithi155.stdout: "time": "2023-08-01T19:54:51.485655+0000", 2023-08-01T19:54:56.699 INFO:teuthology.orchestra.run.smithi155.stdout: "duration": 4.1879999999999999e-05 2023-08-01T19:54:56.699 INFO:teuthology.orchestra.run.smithi155.stdout: }, 2023-08-01T19:54:56.699 INFO:teuthology.orchestra.run.smithi155.stdout: { 2023-08-01T19:54:56.699 INFO:teuthology.orchestra.run.smithi155.stdout: "event": "done", 2023-08-01T19:54:56.699 INFO:teuthology.orchestra.run.smithi155.stdout: "time": "2023-08-01T19:54:51.485688+0000", 2023-08-01T19:54:56.699 INFO:teuthology.orchestra.run.smithi155.stdout: "duration": 3.3800999999999997e-05 2023-08-01T19:54:56.700 INFO:teuthology.orchestra.run.smithi155.stdout: } 2023-08-01T19:54:56.700 INFO:teuthology.orchestra.run.smithi155.stdout: ] 2023-08-01T19:54:56.700 INFO:teuthology.orchestra.run.smithi155.stdout: } 2023-08-01T19:54:56.700 INFO:teuthology.orchestra.run.smithi155.stdout: }, 2023-08-01T19:54:56.700 INFO:teuthology.orchestra.run.smithi155.stdout: { 2023-08-01T19:54:56.700 INFO:teuthology.orchestra.run.smithi155.stdout: "description": "osd_repop(client.4668.0:73464 5.f e31/19 5:f261eb35:::benchmark_data_smithi006_114134_object73463:head v 31'4632, mlcod=31'4629)", 2023-08-01T19:54:56.700 INFO:teuthology.orchestra.run.smithi155.stdout: "initiated_at": "2023-08-01T19:54:51.466330+0000", 2023-08-01T19:54:56.701 INFO:teuthology.orchestra.run.smithi155.stdout: "age": 5.0918893130000003, 2023-08-01T19:54:56.701 INFO:teuthology.orchestra.run.smithi155.stdout: "duration": 0.016398626999999999, 2023-08-01T19:54:56.701 INFO:teuthology.orchestra.run.smithi155.stdout: "type_data": { 2023-08-01T19:54:56.701 INFO:teuthology.orchestra.run.smithi155.stdout: "flag_point": "commit sent; apply or cleanup", 2023-08-01T19:54:56.701 INFO:teuthology.orchestra.run.smithi155.stdout: "events": [ 2023-08-01T19:54:56.701 INFO:teuthology.orchestra.run.smithi155.stdout: { 2023-08-01T19:54:56.701 INFO:teuthology.orchestra.run.smithi155.stdout: "event": "initiated", 2023-08-01T19:54:56.701 INFO:teuthology.orchestra.run.smithi155.stdout: "time": "2023-08-01T19:54:51.466330+0000", 2023-08-01T19:54:56.702 INFO:teuthology.orchestra.run.smithi155.stdout: "duration": 0 2023-08-01T19:54:56.702 INFO:teuthology.orchestra.run.smithi155.stdout: }, 2023-08-01T19:54:56.702 INFO:teuthology.orchestra.run.smithi155.stdout: { 2023-08-01T19:54:56.702 INFO:teuthology.orchestra.run.smithi155.stdout: "event": "throttled", 2023-08-01T19:54:56.702 INFO:teuthology.orchestra.run.smithi155.stdout: "time": "2023-08-01T19:54:51.466330+0000", 2023-08-01T19:54:56.702 INFO:teuthology.orchestra.run.smithi155.stdout: "duration": 0 2023-08-01T19:54:56.702 INFO:teuthology.orchestra.run.smithi155.stdout: }, 2023-08-01T19:54:56.703 INFO:teuthology.orchestra.run.smithi155.stdout: { 2023-08-01T19:54:56.703 INFO:teuthology.orchestra.run.smithi155.stdout: "event": "header_read", 2023-08-01T19:54:56.703 INFO:teuthology.orchestra.run.smithi155.stdout: "time": "2023-08-01T19:54:51.466330+0000", 2023-08-01T19:54:56.703 INFO:teuthology.orchestra.run.smithi155.stdout: "duration": 4294967295.9999995 2023-08-01T19:54:56.703 INFO:teuthology.orchestra.run.smithi155.stdout: }, 2023-08-01T19:54:56.703 INFO:teuthology.orchestra.run.smithi155.stdout: { 2023-08-01T19:54:56.703 INFO:teuthology.orchestra.run.smithi155.stdout: "event": "all_read", 2023-08-01T19:54:56.703 INFO:teuthology.orchestra.run.smithi155.stdout: "time": "2023-08-01T19:54:51.466392+0000", 2023-08-01T19:54:56.704 INFO:teuthology.orchestra.run.smithi155.stdout: "duration": 6.2136000000000003e-05 2023-08-01T19:54:56.704 INFO:teuthology.orchestra.run.smithi155.stdout: }, 2023-08-01T19:54:56.704 INFO:teuthology.orchestra.run.smithi155.stdout: { 2023-08-01T19:54:56.704 INFO:teuthology.orchestra.run.smithi155.stdout: "event": "dispatched", 2023-08-01T19:54:56.704 INFO:teuthology.orchestra.run.smithi155.stdout: "time": "2023-08-01T19:54:51.466400+0000", 2023-08-01T19:54:56.704 INFO:teuthology.orchestra.run.smithi155.stdout: "duration": 7.7589999999999997e-06 2023-08-01T19:54:56.704 INFO:teuthology.orchestra.run.smithi155.stdout: }, 2023-08-01T19:54:56.704 INFO:teuthology.orchestra.run.smithi155.stdout: { 2023-08-01T19:54:56.705 INFO:teuthology.orchestra.run.smithi155.stdout: "event": "queued_for_pg", 2023-08-01T19:54:56.705 INFO:teuthology.orchestra.run.smithi155.stdout: "time": "2023-08-01T19:54:51.466404+0000", 2023-08-01T19:54:56.705 INFO:teuthology.orchestra.run.smithi155.stdout: "duration": 4.0810000000000004e-06 2023-08-01T19:54:56.705 INFO:teuthology.orchestra.run.smithi155.stdout: }, 2023-08-01T19:54:56.705 INFO:teuthology.orchestra.run.smithi155.stdout: { 2023-08-01T19:54:56.705 INFO:teuthology.orchestra.run.smithi155.stdout: "event": "reached_pg", 2023-08-01T19:54:56.705 INFO:teuthology.orchestra.run.smithi155.stdout: "time": "2023-08-01T19:54:51.468401+0000", 2023-08-01T19:54:56.706 INFO:teuthology.orchestra.run.smithi155.stdout: "duration": 0.0019972850000000001 2023-08-01T19:54:56.706 INFO:teuthology.orchestra.run.smithi155.stdout: }, 2023-08-01T19:54:56.706 INFO:teuthology.orchestra.run.smithi155.stdout: { 2023-08-01T19:54:56.706 INFO:teuthology.orchestra.run.smithi155.stdout: "event": "started", 2023-08-01T19:54:56.706 INFO:teuthology.orchestra.run.smithi155.stdout: "time": "2023-08-01T19:54:51.468420+0000", 2023-08-01T19:54:56.706 INFO:teuthology.orchestra.run.smithi155.stdout: "duration": 1.8717000000000001e-05 2023-08-01T19:54:56.706 INFO:teuthology.orchestra.run.smithi155.stdout: }, 2023-08-01T19:54:56.706 INFO:teuthology.orchestra.run.smithi155.stdout: { 2023-08-01T19:54:56.707 INFO:teuthology.orchestra.run.smithi155.stdout: "event": "commit_sent", 2023-08-01T19:54:56.707 INFO:teuthology.orchestra.run.smithi155.stdout: "time": "2023-08-01T19:54:51.482709+0000", 2023-08-01T19:54:56.707 INFO:teuthology.orchestra.run.smithi155.stdout: "duration": 0.014289717 2023-08-01T19:54:56.707 INFO:teuthology.orchestra.run.smithi155.stdout: }, 2023-08-01T19:54:56.707 INFO:teuthology.orchestra.run.smithi155.stdout: { 2023-08-01T19:54:56.707 INFO:teuthology.orchestra.run.smithi155.stdout: "event": "done", 2023-08-01T19:54:56.707 INFO:teuthology.orchestra.run.smithi155.stdout: "time": "2023-08-01T19:54:51.482729+0000", 2023-08-01T19:54:56.707 INFO:teuthology.orchestra.run.smithi155.stdout: "duration": 1.944e-05 2023-08-01T19:54:56.708 INFO:teuthology.orchestra.run.smithi155.stdout: } 2023-08-01T19:54:56.708 INFO:teuthology.orchestra.run.smithi155.stdout: ] 2023-08-01T19:54:56.708 INFO:teuthology.orchestra.run.smithi155.stdout: } 2023-08-01T19:54:56.708 INFO:teuthology.orchestra.run.smithi155.stdout: }, 2023-08-01T19:54:56.708 INFO:teuthology.orchestra.run.smithi155.stdout: { 2023-08-01T19:54:56.708 INFO:teuthology.orchestra.run.smithi155.stdout: "description": "osd_op(client.4668.0:75022 5.4 5:20404e0b:::benchmark_data_smithi006_114134_object75021:head [set-alloc-hint object_size 65536 write_size 65536,write 0~65536] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e32)", 2023-08-01T19:54:56.709 INFO:teuthology.orchestra.run.smithi155.stdout: "initiated_at": "2023-08-01T19:54:52.219424+0000", 2023-08-01T19:54:56.709 INFO:teuthology.orchestra.run.smithi155.stdout: "age": 4.338795266, 2023-08-01T19:54:56.709 INFO:teuthology.orchestra.run.smithi155.stdout: "duration": 0.021270407000000002, 2023-08-01T19:54:56.709 INFO:teuthology.orchestra.run.smithi155.stdout: "type_data": { 2023-08-01T19:54:56.709 INFO:teuthology.orchestra.run.smithi155.stdout: "flag_point": "commit sent; apply or cleanup", 2023-08-01T19:54:56.709 INFO:teuthology.orchestra.run.smithi155.stdout: "client_info": { 2023-08-01T19:54:56.709 INFO:teuthology.orchestra.run.smithi155.stdout: "client": "client.4668", 2023-08-01T19:54:56.709 INFO:teuthology.orchestra.run.smithi155.stdout: "client_addr": "172.21.15.6:0/1709472247", 2023-08-01T19:54:56.710 INFO:teuthology.orchestra.run.smithi155.stdout: "tid": 75022 2023-08-01T19:54:56.710 INFO:teuthology.orchestra.run.smithi155.stdout: }, 2023-08-01T19:54:56.710 INFO:teuthology.orchestra.run.smithi155.stdout: "events": [ 2023-08-01T19:54:56.710 INFO:teuthology.orchestra.run.smithi155.stdout: { 2023-08-01T19:54:56.710 INFO:teuthology.orchestra.run.smithi155.stdout: "event": "initiated", 2023-08-01T19:54:56.710 INFO:teuthology.orchestra.run.smithi155.stdout: "time": "2023-08-01T19:54:52.219424+0000", 2023-08-01T19:54:56.710 INFO:teuthology.orchestra.run.smithi155.stdout: "duration": 0 2023-08-01T19:54:56.711 INFO:teuthology.orchestra.run.smithi155.stdout: }, 2023-08-01T19:54:56.711 INFO:teuthology.orchestra.run.smithi155.stdout: { 2023-08-01T19:54:56.711 INFO:teuthology.orchestra.run.smithi155.stdout: "event": "throttled", 2023-08-01T19:54:56.711 INFO:teuthology.orchestra.run.smithi155.stdout: "time": "2023-08-01T19:54:52.219424+0000", 2023-08-01T19:54:56.711 INFO:teuthology.orchestra.run.smithi155.stdout: "duration": 0 2023-08-01T19:54:56.711 INFO:teuthology.orchestra.run.smithi155.stdout: }, 2023-08-01T19:54:56.711 INFO:teuthology.orchestra.run.smithi155.stdout: { 2023-08-01T19:54:56.712 INFO:teuthology.orchestra.run.smithi155.stdout: "event": "header_read", 2023-08-01T19:54:56.712 INFO:teuthology.orchestra.run.smithi155.stdout: "time": "2023-08-01T19:54:52.219424+0000", 2023-08-01T19:54:56.712 INFO:teuthology.orchestra.run.smithi155.stdout: "duration": 4294967295.9999995 2023-08-01T19:54:56.712 INFO:teuthology.orchestra.run.smithi155.stdout: }, 2023-08-01T19:54:56.712 INFO:teuthology.orchestra.run.smithi155.stdout: { 2023-08-01T19:54:56.712 INFO:teuthology.orchestra.run.smithi155.stdout: "event": "all_read", 2023-08-01T19:54:56.712 INFO:teuthology.orchestra.run.smithi155.stdout: "time": "2023-08-01T19:54:52.219562+0000", 2023-08-01T19:54:56.713 INFO:teuthology.orchestra.run.smithi155.stdout: "duration": 0.000137866 2023-08-01T19:54:56.713 INFO:teuthology.orchestra.run.smithi155.stdout: }, 2023-08-01T19:54:56.713 INFO:teuthology.orchestra.run.smithi155.stdout: { 2023-08-01T19:54:56.713 INFO:teuthology.orchestra.run.smithi155.stdout: "event": "dispatched", 2023-08-01T19:54:56.713 INFO:teuthology.orchestra.run.smithi155.stdout: "time": "2023-08-01T19:54:52.219569+0000", 2023-08-01T19:54:56.713 INFO:teuthology.orchestra.run.smithi155.stdout: "duration": 7.3869999999999997e-06 2023-08-01T19:54:56.713 INFO:teuthology.orchestra.run.smithi155.stdout: }, 2023-08-01T19:54:56.713 INFO:teuthology.orchestra.run.smithi155.stdout: { 2023-08-01T19:54:56.714 INFO:teuthology.orchestra.run.smithi155.stdout: "event": "queued_for_pg", 2023-08-01T19:54:56.714 INFO:teuthology.orchestra.run.smithi155.stdout: "time": "2023-08-01T19:54:52.219572+0000", 2023-08-01T19:54:56.714 INFO:teuthology.orchestra.run.smithi155.stdout: "duration": 2.9409999999999999e-06 2023-08-01T19:54:56.714 INFO:teuthology.orchestra.run.smithi155.stdout: }, 2023-08-01T19:54:56.714 INFO:teuthology.orchestra.run.smithi155.stdout: { 2023-08-01T19:54:56.714 INFO:teuthology.orchestra.run.smithi155.stdout: "event": "reached_pg", 2023-08-01T19:54:56.715 INFO:teuthology.orchestra.run.smithi155.stdout: "time": "2023-08-01T19:54:52.221622+0000", 2023-08-01T19:54:56.715 INFO:teuthology.orchestra.run.smithi155.stdout: "duration": 0.0020502910000000001 2023-08-01T19:54:56.715 INFO:teuthology.orchestra.run.smithi155.stdout: }, 2023-08-01T19:54:56.715 INFO:teuthology.orchestra.run.smithi155.stdout: { 2023-08-01T19:54:56.715 INFO:teuthology.orchestra.run.smithi155.stdout: "event": "started", 2023-08-01T19:54:56.715 INFO:teuthology.orchestra.run.smithi155.stdout: "time": "2023-08-01T19:54:52.221708+0000", 2023-08-01T19:54:56.715 INFO:teuthology.orchestra.run.smithi155.stdout: "duration": 8.5958999999999995e-05 2023-08-01T19:54:56.716 INFO:teuthology.orchestra.run.smithi155.stdout: }, 2023-08-01T19:54:56.716 INFO:teuthology.orchestra.run.smithi155.stdout: { 2023-08-01T19:54:56.716 INFO:teuthology.orchestra.run.smithi155.stdout: "event": "waiting for subops from 0", 2023-08-01T19:54:56.716 INFO:teuthology.orchestra.run.smithi155.stdout: "time": "2023-08-01T19:54:52.221802+0000", 2023-08-01T19:54:56.716 INFO:teuthology.orchestra.run.smithi155.stdout: "duration": 9.3521000000000001e-05 2023-08-01T19:54:56.716 INFO:teuthology.orchestra.run.smithi155.stdout: }, 2023-08-01T19:54:56.716 INFO:teuthology.orchestra.run.smithi155.stdout: { 2023-08-01T19:54:56.716 INFO:teuthology.orchestra.run.smithi155.stdout: "event": "op_commit", 2023-08-01T19:54:56.717 INFO:teuthology.orchestra.run.smithi155.stdout: "time": "2023-08-01T19:54:52.224578+0000", 2023-08-01T19:54:56.717 INFO:teuthology.orchestra.run.smithi155.stdout: "duration": 0.0027759659999999999 2023-08-01T19:54:56.717 INFO:teuthology.orchestra.run.smithi155.stdout: }, 2023-08-01T19:54:56.717 INFO:teuthology.orchestra.run.smithi155.stdout: { 2023-08-01T19:54:56.717 INFO:teuthology.orchestra.run.smithi155.stdout: "event": "sub_op_commit_rec", 2023-08-01T19:54:56.717 INFO:teuthology.orchestra.run.smithi155.stdout: "time": "2023-08-01T19:54:52.240611+0000", 2023-08-01T19:54:56.717 INFO:teuthology.orchestra.run.smithi155.stdout: "duration": 0.016033068000000001 2023-08-01T19:54:56.717 INFO:teuthology.orchestra.run.smithi155.stdout: }, 2023-08-01T19:54:56.718 INFO:teuthology.orchestra.run.smithi155.stdout: { 2023-08-01T19:54:56.718 INFO:teuthology.orchestra.run.smithi155.stdout: "event": "commit_sent", 2023-08-01T19:54:56.718 INFO:teuthology.orchestra.run.smithi155.stdout: "time": "2023-08-01T19:54:52.240659+0000", 2023-08-01T19:54:56.718 INFO:teuthology.orchestra.run.smithi155.stdout: "duration": 4.7794999999999999e-05 2023-08-01T19:54:56.718 INFO:teuthology.orchestra.run.smithi155.stdout: }, 2023-08-01T19:54:56.718 INFO:teuthology.orchestra.run.smithi155.stdout: { 2023-08-01T19:54:56.719 INFO:teuthology.orchestra.run.smithi155.stdout: "event": "done", 2023-08-01T19:54:56.719 INFO:teuthology.orchestra.run.smithi155.stdout: "time": "2023-08-01T19:54:52.240695+0000", 2023-08-01T19:54:56.719 INFO:teuthology.orchestra.run.smithi155.stdout: "duration": 3.5942000000000002e-05 2023-08-01T19:54:56.719 INFO:teuthology.orchestra.run.smithi155.stdout: } 2023-08-01T19:54:56.719 INFO:teuthology.orchestra.run.smithi155.stdout: ] 2023-08-01T19:54:56.719 INFO:teuthology.orchestra.run.smithi155.stdout: } 2023-08-01T19:54:56.719 INFO:teuthology.orchestra.run.smithi155.stdout: }, 2023-08-01T19:54:56.720 INFO:teuthology.orchestra.run.smithi155.stdout: { 2023-08-01T19:54:56.720 INFO:teuthology.orchestra.run.smithi155.stdout: "description": "osd_op(client.4668.0:75023 5.4 5:2ff1db38:::benchmark_data_smithi006_114134_object75022:head [set-alloc-hint object_size 65536 write_size 65536,write 0~65536] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e32)", 2023-08-01T19:54:56.720 INFO:teuthology.orchestra.run.smithi155.stdout: "initiated_at": "2023-08-01T19:54:52.219577+0000", 2023-08-01T19:54:56.720 INFO:teuthology.orchestra.run.smithi155.stdout: "age": 4.3386421200000003, 2023-08-01T19:54:56.720 INFO:teuthology.orchestra.run.smithi155.stdout: "duration": 0.021226956000000002, 2023-08-01T19:54:56.720 INFO:teuthology.orchestra.run.smithi155.stdout: "type_data": { 2023-08-01T19:54:56.720 INFO:teuthology.orchestra.run.smithi155.stdout: "flag_point": "commit sent; apply or cleanup", 2023-08-01T19:54:56.721 INFO:teuthology.orchestra.run.smithi155.stdout: "client_info": { 2023-08-01T19:54:56.721 INFO:teuthology.orchestra.run.smithi155.stdout: "client": "client.4668", 2023-08-01T19:54:56.721 INFO:teuthology.orchestra.run.smithi155.stdout: "client_addr": "172.21.15.6:0/1709472247", 2023-08-01T19:54:56.721 INFO:teuthology.orchestra.run.smithi155.stdout: "tid": 75023 2023-08-01T19:54:56.721 INFO:teuthology.orchestra.run.smithi155.stdout: }, 2023-08-01T19:54:56.721 INFO:teuthology.orchestra.run.smithi155.stdout: "events": [ 2023-08-01T19:54:56.721 INFO:teuthology.orchestra.run.smithi155.stdout: { 2023-08-01T19:54:56.722 INFO:teuthology.orchestra.run.smithi155.stdout: "event": "initiated", 2023-08-01T19:54:56.722 INFO:teuthology.orchestra.run.smithi155.stdout: "time": "2023-08-01T19:54:52.219577+0000", 2023-08-01T19:54:56.722 INFO:teuthology.orchestra.run.smithi155.stdout: "duration": 0 2023-08-01T19:54:56.722 INFO:teuthology.orchestra.run.smithi155.stdout: }, 2023-08-01T19:54:56.722 INFO:teuthology.orchestra.run.smithi155.stdout: { 2023-08-01T19:54:56.722 INFO:teuthology.orchestra.run.smithi155.stdout: "event": "throttled", 2023-08-01T19:54:56.722 INFO:teuthology.orchestra.run.smithi155.stdout: "time": "2023-08-01T19:54:52.219577+0000", 2023-08-01T19:54:56.722 INFO:teuthology.orchestra.run.smithi155.stdout: "duration": 0 2023-08-01T19:54:56.723 INFO:teuthology.orchestra.run.smithi155.stdout: }, 2023-08-01T19:54:56.723 INFO:teuthology.orchestra.run.smithi155.stdout: { 2023-08-01T19:54:56.723 INFO:teuthology.orchestra.run.smithi155.stdout: "event": "header_read", 2023-08-01T19:54:56.723 INFO:teuthology.orchestra.run.smithi155.stdout: "time": "2023-08-01T19:54:52.219577+0000", 2023-08-01T19:54:56.723 INFO:teuthology.orchestra.run.smithi155.stdout: "duration": 4294967295.9999995 2023-08-01T19:54:56.723 INFO:teuthology.orchestra.run.smithi155.stdout: }, 2023-08-01T19:54:56.723 INFO:teuthology.orchestra.run.smithi155.stdout: { 2023-08-01T19:54:56.723 INFO:teuthology.orchestra.run.smithi155.stdout: "event": "all_read", 2023-08-01T19:54:56.724 INFO:teuthology.orchestra.run.smithi155.stdout: "time": "2023-08-01T19:54:52.219655+0000", 2023-08-01T19:54:56.724 INFO:teuthology.orchestra.run.smithi155.stdout: "duration": 7.7459999999999994e-05 2023-08-01T19:54:56.724 INFO:teuthology.orchestra.run.smithi155.stdout: }, 2023-08-01T19:54:56.724 INFO:teuthology.orchestra.run.smithi155.stdout: { 2023-08-01T19:54:56.724 INFO:teuthology.orchestra.run.smithi155.stdout: "event": "dispatched", 2023-08-01T19:54:56.724 INFO:teuthology.orchestra.run.smithi155.stdout: "time": "2023-08-01T19:54:52.219660+0000", 2023-08-01T19:54:56.724 INFO:teuthology.orchestra.run.smithi155.stdout: "duration": 5.0719999999999999e-06 2023-08-01T19:54:56.725 INFO:teuthology.orchestra.run.smithi155.stdout: }, 2023-08-01T19:54:56.725 INFO:teuthology.orchestra.run.smithi155.stdout: { 2023-08-01T19:54:56.725 INFO:teuthology.orchestra.run.smithi155.stdout: "event": "queued_for_pg", 2023-08-01T19:54:56.725 INFO:teuthology.orchestra.run.smithi155.stdout: "time": "2023-08-01T19:54:52.219662+0000", 2023-08-01T19:54:56.725 INFO:teuthology.orchestra.run.smithi155.stdout: "duration": 2.706e-06 2023-08-01T19:54:56.725 INFO:teuthology.orchestra.run.smithi155.stdout: }, 2023-08-01T19:54:56.725 INFO:teuthology.orchestra.run.smithi155.stdout: { 2023-08-01T19:54:56.726 INFO:teuthology.orchestra.run.smithi155.stdout: "event": "reached_pg", 2023-08-01T19:54:56.726 INFO:teuthology.orchestra.run.smithi155.stdout: "time": "2023-08-01T19:54:52.223120+0000", 2023-08-01T19:54:56.726 INFO:teuthology.orchestra.run.smithi155.stdout: "duration": 0.0034574699999999998 2023-08-01T19:54:56.726 INFO:teuthology.orchestra.run.smithi155.stdout: }, 2023-08-01T19:54:56.726 INFO:teuthology.orchestra.run.smithi155.stdout: { 2023-08-01T19:54:56.726 INFO:teuthology.orchestra.run.smithi155.stdout: "event": "started", 2023-08-01T19:54:56.726 INFO:teuthology.orchestra.run.smithi155.stdout: "time": "2023-08-01T19:54:52.223250+0000", 2023-08-01T19:54:56.726 INFO:teuthology.orchestra.run.smithi155.stdout: "duration": 0.000129751 2023-08-01T19:54:56.727 INFO:teuthology.orchestra.run.smithi155.stdout: }, 2023-08-01T19:54:56.727 INFO:teuthology.orchestra.run.smithi155.stdout: { 2023-08-01T19:54:56.727 INFO:teuthology.orchestra.run.smithi155.stdout: "event": "waiting for subops from 0", 2023-08-01T19:54:56.727 INFO:teuthology.orchestra.run.smithi155.stdout: "time": "2023-08-01T19:54:52.223406+0000", 2023-08-01T19:54:56.727 INFO:teuthology.orchestra.run.smithi155.stdout: "duration": 0.00015661599999999999 2023-08-01T19:54:56.727 INFO:teuthology.orchestra.run.smithi155.stdout: }, 2023-08-01T19:54:56.727 INFO:teuthology.orchestra.run.smithi155.stdout: { 2023-08-01T19:54:56.728 INFO:teuthology.orchestra.run.smithi155.stdout: "event": "op_commit", 2023-08-01T19:54:56.728 INFO:teuthology.orchestra.run.smithi155.stdout: "time": "2023-08-01T19:54:52.226217+0000", 2023-08-01T19:54:56.728 INFO:teuthology.orchestra.run.smithi155.stdout: "duration": 0.0028110280000000001 2023-08-01T19:54:56.728 INFO:teuthology.orchestra.run.smithi155.stdout: }, 2023-08-01T19:54:56.728 INFO:teuthology.orchestra.run.smithi155.stdout: { 2023-08-01T19:54:56.728 INFO:teuthology.orchestra.run.smithi155.stdout: "event": "sub_op_commit_rec", 2023-08-01T19:54:56.728 INFO:teuthology.orchestra.run.smithi155.stdout: "time": "2023-08-01T19:54:52.240732+0000", 2023-08-01T19:54:56.728 INFO:teuthology.orchestra.run.smithi155.stdout: "duration": 0.014515068000000001 2023-08-01T19:54:56.729 INFO:teuthology.orchestra.run.smithi155.stdout: }, 2023-08-01T19:54:56.729 INFO:teuthology.orchestra.run.smithi155.stdout: { 2023-08-01T19:54:56.729 INFO:teuthology.orchestra.run.smithi155.stdout: "event": "commit_sent", 2023-08-01T19:54:56.729 INFO:teuthology.orchestra.run.smithi155.stdout: "time": "2023-08-01T19:54:52.240766+0000", 2023-08-01T19:54:56.729 INFO:teuthology.orchestra.run.smithi155.stdout: "duration": 3.3689000000000002e-05 2023-08-01T19:54:56.729 INFO:teuthology.orchestra.run.smithi155.stdout: }, 2023-08-01T19:54:56.729 INFO:teuthology.orchestra.run.smithi155.stdout: { 2023-08-01T19:54:56.729 INFO:teuthology.orchestra.run.smithi155.stdout: "event": "done", 2023-08-01T19:54:56.730 INFO:teuthology.orchestra.run.smithi155.stdout: "time": "2023-08-01T19:54:52.240804+0000", 2023-08-01T19:54:56.730 INFO:teuthology.orchestra.run.smithi155.stdout: "duration": 3.841e-05 2023-08-01T19:54:56.730 INFO:teuthology.orchestra.run.smithi155.stdout: } 2023-08-01T19:54:56.730 INFO:teuthology.orchestra.run.smithi155.stdout: ] 2023-08-01T19:54:56.730 INFO:teuthology.orchestra.run.smithi155.stdout: } 2023-08-01T19:54:56.730 INFO:teuthology.orchestra.run.smithi155.stdout: }, 2023-08-01T19:54:56.730 INFO:teuthology.orchestra.run.smithi155.stdout: { 2023-08-01T19:54:56.731 INFO:teuthology.orchestra.run.smithi155.stdout: "description": "osd_op(client.4668.0:75028 5.4 5:2c62c41c:::benchmark_data_smithi006_114134_object75027:head [set-alloc-hint object_size 65536 write_size 65536,write 0~65536] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e32)", 2023-08-01T19:54:56.731 INFO:teuthology.orchestra.run.smithi155.stdout: "initiated_at": "2023-08-01T19:54:52.224915+0000", 2023-08-01T19:54:56.731 INFO:teuthology.orchestra.run.smithi155.stdout: "age": 4.3333040309999999, 2023-08-01T19:54:56.731 INFO:teuthology.orchestra.run.smithi155.stdout: "duration": 0.016009299000000001, 2023-08-01T19:54:56.731 INFO:teuthology.orchestra.run.smithi155.stdout: "type_data": { 2023-08-01T19:54:56.731 INFO:teuthology.orchestra.run.smithi155.stdout: "flag_point": "commit sent; apply or cleanup", 2023-08-01T19:54:56.731 INFO:teuthology.orchestra.run.smithi155.stdout: "client_info": { 2023-08-01T19:54:56.731 INFO:teuthology.orchestra.run.smithi155.stdout: "client": "client.4668", 2023-08-01T19:54:56.732 INFO:teuthology.orchestra.run.smithi155.stdout: "client_addr": "172.21.15.6:0/1709472247", 2023-08-01T19:54:56.732 INFO:teuthology.orchestra.run.smithi155.stdout: "tid": 75028 2023-08-01T19:54:56.732 INFO:teuthology.orchestra.run.smithi155.stdout: }, 2023-08-01T19:54:56.732 INFO:teuthology.orchestra.run.smithi155.stdout: "events": [ 2023-08-01T19:54:56.732 INFO:teuthology.orchestra.run.smithi155.stdout: { 2023-08-01T19:54:56.732 INFO:teuthology.orchestra.run.smithi155.stdout: "event": "initiated", 2023-08-01T19:54:56.732 INFO:teuthology.orchestra.run.smithi155.stdout: "time": "2023-08-01T19:54:52.224915+0000", 2023-08-01T19:54:56.732 INFO:teuthology.orchestra.run.smithi155.stdout: "duration": 0 2023-08-01T19:54:56.733 INFO:teuthology.orchestra.run.smithi155.stdout: }, 2023-08-01T19:54:56.733 INFO:teuthology.orchestra.run.smithi155.stdout: { 2023-08-01T19:54:56.733 INFO:teuthology.orchestra.run.smithi155.stdout: "event": "throttled", 2023-08-01T19:54:56.733 INFO:teuthology.orchestra.run.smithi155.stdout: "time": "2023-08-01T19:54:52.224915+0000", 2023-08-01T19:54:56.733 INFO:teuthology.orchestra.run.smithi155.stdout: "duration": 0 2023-08-01T19:54:56.733 INFO:teuthology.orchestra.run.smithi155.stdout: }, 2023-08-01T19:54:56.733 INFO:teuthology.orchestra.run.smithi155.stdout: { 2023-08-01T19:54:56.734 INFO:teuthology.orchestra.run.smithi155.stdout: "event": "header_read", 2023-08-01T19:54:56.734 INFO:teuthology.orchestra.run.smithi155.stdout: "time": "2023-08-01T19:54:52.224915+0000", 2023-08-01T19:54:56.734 INFO:teuthology.orchestra.run.smithi155.stdout: "duration": 4294967295.9999995 2023-08-01T19:54:56.734 INFO:teuthology.orchestra.run.smithi155.stdout: }, 2023-08-01T19:54:56.734 INFO:teuthology.orchestra.run.smithi155.stdout: { 2023-08-01T19:54:56.734 INFO:teuthology.orchestra.run.smithi155.stdout: "event": "all_read", 2023-08-01T19:54:56.734 INFO:teuthology.orchestra.run.smithi155.stdout: "time": "2023-08-01T19:54:52.224981+0000", 2023-08-01T19:54:56.734 INFO:teuthology.orchestra.run.smithi155.stdout: "duration": 6.5333999999999995e-05 2023-08-01T19:54:56.735 INFO:teuthology.orchestra.run.smithi155.stdout: }, 2023-08-01T19:54:56.735 INFO:teuthology.orchestra.run.smithi155.stdout: { 2023-08-01T19:54:56.735 INFO:teuthology.orchestra.run.smithi155.stdout: "event": "dispatched", 2023-08-01T19:54:56.735 INFO:teuthology.orchestra.run.smithi155.stdout: "time": "2023-08-01T19:54:52.224987+0000", 2023-08-01T19:54:56.735 INFO:teuthology.orchestra.run.smithi155.stdout: "duration": 6.037e-06 2023-08-01T19:54:56.735 INFO:teuthology.orchestra.run.smithi155.stdout: }, 2023-08-01T19:54:56.735 INFO:teuthology.orchestra.run.smithi155.stdout: { 2023-08-01T19:54:56.735 INFO:teuthology.orchestra.run.smithi155.stdout: "event": "queued_for_pg", 2023-08-01T19:54:56.736 INFO:teuthology.orchestra.run.smithi155.stdout: "time": "2023-08-01T19:54:52.224990+0000", 2023-08-01T19:54:56.736 INFO:teuthology.orchestra.run.smithi155.stdout: "duration": 3.4199999999999999e-06 2023-08-01T19:54:56.736 INFO:teuthology.orchestra.run.smithi155.stdout: }, 2023-08-01T19:54:56.736 INFO:teuthology.orchestra.run.smithi155.stdout: { 2023-08-01T19:54:56.736 INFO:teuthology.orchestra.run.smithi155.stdout: "event": "reached_pg", 2023-08-01T19:54:56.736 INFO:teuthology.orchestra.run.smithi155.stdout: "time": "2023-08-01T19:54:52.225029+0000", 2023-08-01T19:54:56.737 INFO:teuthology.orchestra.run.smithi155.stdout: "duration": 3.8850999999999998e-05 2023-08-01T19:54:56.737 INFO:teuthology.orchestra.run.smithi155.stdout: }, 2023-08-01T19:54:56.737 INFO:teuthology.orchestra.run.smithi155.stdout: { 2023-08-01T19:54:56.737 INFO:teuthology.orchestra.run.smithi155.stdout: "event": "started", 2023-08-01T19:54:56.737 INFO:teuthology.orchestra.run.smithi155.stdout: "time": "2023-08-01T19:54:52.225100+0000", 2023-08-01T19:54:56.737 INFO:teuthology.orchestra.run.smithi155.stdout: "duration": 7.1355999999999999e-05 2023-08-01T19:54:56.737 INFO:teuthology.orchestra.run.smithi155.stdout: }, 2023-08-01T19:54:56.738 INFO:teuthology.orchestra.run.smithi155.stdout: { 2023-08-01T19:54:56.738 INFO:teuthology.orchestra.run.smithi155.stdout: "event": "waiting for subops from 0", 2023-08-01T19:54:56.738 INFO:teuthology.orchestra.run.smithi155.stdout: "time": "2023-08-01T19:54:52.225187+0000", 2023-08-01T19:54:56.738 INFO:teuthology.orchestra.run.smithi155.stdout: "duration": 8.7138999999999994e-05 2023-08-01T19:54:56.738 INFO:teuthology.orchestra.run.smithi155.stdout: }, 2023-08-01T19:54:56.738 INFO:teuthology.orchestra.run.smithi155.stdout: { 2023-08-01T19:54:56.738 INFO:teuthology.orchestra.run.smithi155.stdout: "event": "op_commit", 2023-08-01T19:54:56.738 INFO:teuthology.orchestra.run.smithi155.stdout: "time": "2023-08-01T19:54:52.227343+0000", 2023-08-01T19:54:56.739 INFO:teuthology.orchestra.run.smithi155.stdout: "duration": 0.002155784 2023-08-01T19:54:56.739 INFO:teuthology.orchestra.run.smithi155.stdout: }, 2023-08-01T19:54:56.739 INFO:teuthology.orchestra.run.smithi155.stdout: { 2023-08-01T19:54:56.739 INFO:teuthology.orchestra.run.smithi155.stdout: "event": "sub_op_commit_rec", 2023-08-01T19:54:56.739 INFO:teuthology.orchestra.run.smithi155.stdout: "time": "2023-08-01T19:54:52.240839+0000", 2023-08-01T19:54:56.739 INFO:teuthology.orchestra.run.smithi155.stdout: "duration": 0.013496192000000001 2023-08-01T19:54:56.739 INFO:teuthology.orchestra.run.smithi155.stdout: }, 2023-08-01T19:54:56.739 INFO:teuthology.orchestra.run.smithi155.stdout: { 2023-08-01T19:54:56.740 INFO:teuthology.orchestra.run.smithi155.stdout: "event": "commit_sent", 2023-08-01T19:54:56.740 INFO:teuthology.orchestra.run.smithi155.stdout: "time": "2023-08-01T19:54:52.240892+0000", 2023-08-01T19:54:56.740 INFO:teuthology.orchestra.run.smithi155.stdout: "duration": 5.3164000000000001e-05 2023-08-01T19:54:56.740 INFO:teuthology.orchestra.run.smithi155.stdout: }, 2023-08-01T19:54:56.740 INFO:teuthology.orchestra.run.smithi155.stdout: { 2023-08-01T19:54:56.740 INFO:teuthology.orchestra.run.smithi155.stdout: "event": "done", 2023-08-01T19:54:56.741 INFO:teuthology.orchestra.run.smithi155.stdout: "time": "2023-08-01T19:54:52.240925+0000", 2023-08-01T19:54:56.741 INFO:teuthology.orchestra.run.smithi155.stdout: "duration": 3.2323999999999997e-05 2023-08-01T19:54:56.741 INFO:teuthology.orchestra.run.smithi155.stdout: } 2023-08-01T19:54:56.741 INFO:teuthology.orchestra.run.smithi155.stdout: ] 2023-08-01T19:54:56.741 INFO:teuthology.orchestra.run.smithi155.stdout: } 2023-08-01T19:54:56.741 INFO:teuthology.orchestra.run.smithi155.stdout: }, 2023-08-01T19:54:56.741 INFO:teuthology.orchestra.run.smithi155.stdout: { 2023-08-01T19:54:56.742 INFO:teuthology.orchestra.run.smithi155.stdout: "description": "osd_op(client.4668.0:75287 5.0 5:0c891239:::benchmark_data_smithi006_114134_object75286:head [set-alloc-hint object_size 65536 write_size 65536,write 0~65536] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e32)", 2023-08-01T19:54:56.742 INFO:teuthology.orchestra.run.smithi155.stdout: "initiated_at": "2023-08-01T19:54:52.371511+0000", 2023-08-01T19:54:56.742 INFO:teuthology.orchestra.run.smithi155.stdout: "age": 4.1867086000000002, 2023-08-01T19:54:56.742 INFO:teuthology.orchestra.run.smithi155.stdout: "duration": 0.018046647999999998, 2023-08-01T19:54:56.742 INFO:teuthology.orchestra.run.smithi155.stdout: "type_data": { 2023-08-01T19:54:56.742 INFO:teuthology.orchestra.run.smithi155.stdout: "flag_point": "commit sent; apply or cleanup", 2023-08-01T19:54:56.742 INFO:teuthology.orchestra.run.smithi155.stdout: "client_info": { 2023-08-01T19:54:56.743 INFO:teuthology.orchestra.run.smithi155.stdout: "client": "client.4668", 2023-08-01T19:54:56.743 INFO:teuthology.orchestra.run.smithi155.stdout: "client_addr": "172.21.15.6:0/1709472247", 2023-08-01T19:54:56.743 INFO:teuthology.orchestra.run.smithi155.stdout: "tid": 75287 2023-08-01T19:54:56.743 INFO:teuthology.orchestra.run.smithi155.stdout: }, 2023-08-01T19:54:56.743 INFO:teuthology.orchestra.run.smithi155.stdout: "events": [ 2023-08-01T19:54:56.743 INFO:teuthology.orchestra.run.smithi155.stdout: { 2023-08-01T19:54:56.743 INFO:teuthology.orchestra.run.smithi155.stdout: "event": "initiated", 2023-08-01T19:54:56.744 INFO:teuthology.orchestra.run.smithi155.stdout: "time": "2023-08-01T19:54:52.371511+0000", 2023-08-01T19:54:56.744 INFO:teuthology.orchestra.run.smithi155.stdout: "duration": 0 2023-08-01T19:54:56.744 INFO:teuthology.orchestra.run.smithi155.stdout: }, 2023-08-01T19:54:56.744 INFO:teuthology.orchestra.run.smithi155.stdout: { 2023-08-01T19:54:56.744 INFO:teuthology.orchestra.run.smithi155.stdout: "event": "throttled", 2023-08-01T19:54:56.744 INFO:teuthology.orchestra.run.smithi155.stdout: "time": "2023-08-01T19:54:52.371511+0000", 2023-08-01T19:54:56.744 INFO:teuthology.orchestra.run.smithi155.stdout: "duration": 0 2023-08-01T19:54:56.744 INFO:teuthology.orchestra.run.smithi155.stdout: }, 2023-08-01T19:54:56.745 INFO:teuthology.orchestra.run.smithi155.stdout: { 2023-08-01T19:54:56.745 INFO:teuthology.orchestra.run.smithi155.stdout: "event": "header_read", 2023-08-01T19:54:56.745 INFO:teuthology.orchestra.run.smithi155.stdout: "time": "2023-08-01T19:54:52.371510+0000", 2023-08-01T19:54:56.745 INFO:teuthology.orchestra.run.smithi155.stdout: "duration": 4294967295.9999995 2023-08-01T19:54:56.745 INFO:teuthology.orchestra.run.smithi155.stdout: }, 2023-08-01T19:54:56.745 INFO:teuthology.orchestra.run.smithi155.stdout: { 2023-08-01T19:54:56.745 INFO:teuthology.orchestra.run.smithi155.stdout: "event": "all_read", 2023-08-01T19:54:56.746 INFO:teuthology.orchestra.run.smithi155.stdout: "time": "2023-08-01T19:54:52.371540+0000", 2023-08-01T19:54:56.746 INFO:teuthology.orchestra.run.smithi155.stdout: "duration": 2.9526000000000002e-05 2023-08-01T19:54:56.746 INFO:teuthology.orchestra.run.smithi155.stdout: }, 2023-08-01T19:54:56.746 INFO:teuthology.orchestra.run.smithi155.stdout: { 2023-08-01T19:54:56.746 INFO:teuthology.orchestra.run.smithi155.stdout: "event": "dispatched", 2023-08-01T19:54:56.746 INFO:teuthology.orchestra.run.smithi155.stdout: "time": "2023-08-01T19:54:52.371551+0000", 2023-08-01T19:54:56.746 INFO:teuthology.orchestra.run.smithi155.stdout: "duration": 1.1019000000000001e-05 2023-08-01T19:54:56.746 INFO:teuthology.orchestra.run.smithi155.stdout: }, 2023-08-01T19:54:56.747 INFO:teuthology.orchestra.run.smithi155.stdout: { 2023-08-01T19:54:56.747 INFO:teuthology.orchestra.run.smithi155.stdout: "event": "queued_for_pg", 2023-08-01T19:54:56.747 INFO:teuthology.orchestra.run.smithi155.stdout: "time": "2023-08-01T19:54:52.371556+0000", 2023-08-01T19:54:56.747 INFO:teuthology.orchestra.run.smithi155.stdout: "duration": 5.4099999999999999e-06 2023-08-01T19:54:56.747 INFO:teuthology.orchestra.run.smithi155.stdout: }, 2023-08-01T19:54:56.747 INFO:teuthology.orchestra.run.smithi155.stdout: { 2023-08-01T19:54:56.747 INFO:teuthology.orchestra.run.smithi155.stdout: "event": "reached_pg", 2023-08-01T19:54:56.748 INFO:teuthology.orchestra.run.smithi155.stdout: "time": "2023-08-01T19:54:52.373214+0000", 2023-08-01T19:54:56.748 INFO:teuthology.orchestra.run.smithi155.stdout: "duration": 0.0016573239999999999 2023-08-01T19:54:56.748 INFO:teuthology.orchestra.run.smithi155.stdout: }, 2023-08-01T19:54:56.748 INFO:teuthology.orchestra.run.smithi155.stdout: { 2023-08-01T19:54:56.748 INFO:teuthology.orchestra.run.smithi155.stdout: "event": "started", 2023-08-01T19:54:56.748 INFO:teuthology.orchestra.run.smithi155.stdout: "time": "2023-08-01T19:54:52.373297+0000", 2023-08-01T19:54:56.748 INFO:teuthology.orchestra.run.smithi155.stdout: "duration": 8.3440000000000001e-05 2023-08-01T19:54:56.749 INFO:teuthology.orchestra.run.smithi155.stdout: }, 2023-08-01T19:54:56.749 INFO:teuthology.orchestra.run.smithi155.stdout: { 2023-08-01T19:54:56.749 INFO:teuthology.orchestra.run.smithi155.stdout: "event": "waiting for subops from 0", 2023-08-01T19:54:56.749 INFO:teuthology.orchestra.run.smithi155.stdout: "time": "2023-08-01T19:54:52.373381+0000", 2023-08-01T19:54:56.749 INFO:teuthology.orchestra.run.smithi155.stdout: "duration": 8.4172999999999995e-05 2023-08-01T19:54:56.749 INFO:teuthology.orchestra.run.smithi155.stdout: }, 2023-08-01T19:54:56.749 INFO:teuthology.orchestra.run.smithi155.stdout: { 2023-08-01T19:54:56.750 INFO:teuthology.orchestra.run.smithi155.stdout: "event": "op_commit", 2023-08-01T19:54:56.750 INFO:teuthology.orchestra.run.smithi155.stdout: "time": "2023-08-01T19:54:52.375698+0000", 2023-08-01T19:54:56.750 INFO:teuthology.orchestra.run.smithi155.stdout: "duration": 0.0023168889999999999 2023-08-01T19:54:56.750 INFO:teuthology.orchestra.run.smithi155.stdout: }, 2023-08-01T19:54:56.750 INFO:teuthology.orchestra.run.smithi155.stdout: { 2023-08-01T19:54:56.750 INFO:teuthology.orchestra.run.smithi155.stdout: "event": "sub_op_commit_rec", 2023-08-01T19:54:56.750 INFO:teuthology.orchestra.run.smithi155.stdout: "time": "2023-08-01T19:54:52.389493+0000", 2023-08-01T19:54:56.750 INFO:teuthology.orchestra.run.smithi155.stdout: "duration": 0.013794705000000001 2023-08-01T19:54:56.751 INFO:teuthology.orchestra.run.smithi155.stdout: }, 2023-08-01T19:54:56.751 INFO:teuthology.orchestra.run.smithi155.stdout: { 2023-08-01T19:54:56.751 INFO:teuthology.orchestra.run.smithi155.stdout: "event": "commit_sent", 2023-08-01T19:54:56.751 INFO:teuthology.orchestra.run.smithi155.stdout: "time": "2023-08-01T19:54:52.389527+0000", 2023-08-01T19:54:56.751 INFO:teuthology.orchestra.run.smithi155.stdout: "duration": 3.4149000000000001e-05 2023-08-01T19:54:56.751 INFO:teuthology.orchestra.run.smithi155.stdout: }, 2023-08-01T19:54:56.751 INFO:teuthology.orchestra.run.smithi155.stdout: { 2023-08-01T19:54:56.751 INFO:teuthology.orchestra.run.smithi155.stdout: "event": "done", 2023-08-01T19:54:56.752 INFO:teuthology.orchestra.run.smithi155.stdout: "time": "2023-08-01T19:54:52.389558+0000", 2023-08-01T19:54:56.752 INFO:teuthology.orchestra.run.smithi155.stdout: "duration": 3.0590999999999999e-05 2023-08-01T19:54:56.752 INFO:teuthology.orchestra.run.smithi155.stdout: } 2023-08-01T19:54:56.752 INFO:teuthology.orchestra.run.smithi155.stdout: ] 2023-08-01T19:54:56.752 INFO:teuthology.orchestra.run.smithi155.stdout: } 2023-08-01T19:54:56.752 INFO:teuthology.orchestra.run.smithi155.stdout: }, 2023-08-01T19:54:56.752 INFO:teuthology.orchestra.run.smithi155.stdout: { 2023-08-01T19:54:56.753 INFO:teuthology.orchestra.run.smithi155.stdout: "description": "osd_op(client.4668.0:82525 5.d 5:bcfac7fd:::benchmark_data_smithi006_114134_object82524:head [set-alloc-hint object_size 65536 write_size 65536,write 0~65536] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e34)", 2023-08-01T19:54:56.753 INFO:teuthology.orchestra.run.smithi155.stdout: "initiated_at": "2023-08-01T19:54:56.061190+0000", 2023-08-01T19:54:56.753 INFO:teuthology.orchestra.run.smithi155.stdout: "age": 0.49702995900000002, 2023-08-01T19:54:56.753 INFO:teuthology.orchestra.run.smithi155.stdout: "duration": 0.016633917000000002, 2023-08-01T19:54:56.753 INFO:teuthology.orchestra.run.smithi155.stdout: "type_data": { 2023-08-01T19:54:56.753 INFO:teuthology.orchestra.run.smithi155.stdout: "flag_point": "commit sent; apply or cleanup", 2023-08-01T19:54:56.753 INFO:teuthology.orchestra.run.smithi155.stdout: "client_info": { 2023-08-01T19:54:56.753 INFO:teuthology.orchestra.run.smithi155.stdout: "client": "client.4668", 2023-08-01T19:54:56.754 INFO:teuthology.orchestra.run.smithi155.stdout: "client_addr": "172.21.15.6:0/1709472247", 2023-08-01T19:54:56.754 INFO:teuthology.orchestra.run.smithi155.stdout: "tid": 82525 2023-08-01T19:54:56.754 INFO:teuthology.orchestra.run.smithi155.stdout: }, 2023-08-01T19:54:56.754 INFO:teuthology.orchestra.run.smithi155.stdout: "events": [ 2023-08-01T19:54:56.754 INFO:teuthology.orchestra.run.smithi155.stdout: { 2023-08-01T19:54:56.754 INFO:teuthology.orchestra.run.smithi155.stdout: "event": "initiated", 2023-08-01T19:54:56.754 INFO:teuthology.orchestra.run.smithi155.stdout: "time": "2023-08-01T19:54:56.061190+0000", 2023-08-01T19:54:56.755 INFO:teuthology.orchestra.run.smithi155.stdout: "duration": 0 2023-08-01T19:54:56.755 INFO:teuthology.orchestra.run.smithi155.stdout: }, 2023-08-01T19:54:56.755 INFO:teuthology.orchestra.run.smithi155.stdout: { 2023-08-01T19:54:56.755 INFO:teuthology.orchestra.run.smithi155.stdout: "event": "throttled", 2023-08-01T19:54:56.755 INFO:teuthology.orchestra.run.smithi155.stdout: "time": "2023-08-01T19:54:56.061190+0000", 2023-08-01T19:54:56.755 INFO:teuthology.orchestra.run.smithi155.stdout: "duration": 0 2023-08-01T19:54:56.755 INFO:teuthology.orchestra.run.smithi155.stdout: }, 2023-08-01T19:54:56.755 INFO:teuthology.orchestra.run.smithi155.stdout: { 2023-08-01T19:54:56.756 INFO:teuthology.orchestra.run.smithi155.stdout: "event": "header_read", 2023-08-01T19:54:56.756 INFO:teuthology.orchestra.run.smithi155.stdout: "time": "2023-08-01T19:54:56.061189+0000", 2023-08-01T19:54:56.756 INFO:teuthology.orchestra.run.smithi155.stdout: "duration": 4294967295.9999995 2023-08-01T19:54:56.756 INFO:teuthology.orchestra.run.smithi155.stdout: }, 2023-08-01T19:54:56.756 INFO:teuthology.orchestra.run.smithi155.stdout: { 2023-08-01T19:54:56.756 INFO:teuthology.orchestra.run.smithi155.stdout: "event": "all_read", 2023-08-01T19:54:56.756 INFO:teuthology.orchestra.run.smithi155.stdout: "time": "2023-08-01T19:54:56.061240+0000", 2023-08-01T19:54:56.757 INFO:teuthology.orchestra.run.smithi155.stdout: "duration": 5.0995999999999998e-05 2023-08-01T19:54:56.757 INFO:teuthology.orchestra.run.smithi155.stdout: }, 2023-08-01T19:54:56.757 INFO:teuthology.orchestra.run.smithi155.stdout: { 2023-08-01T19:54:56.757 INFO:teuthology.orchestra.run.smithi155.stdout: "event": "dispatched", 2023-08-01T19:54:56.757 INFO:teuthology.orchestra.run.smithi155.stdout: "time": "2023-08-01T19:54:56.061253+0000", 2023-08-01T19:54:56.757 INFO:teuthology.orchestra.run.smithi155.stdout: "duration": 1.2777e-05 2023-08-01T19:54:56.757 INFO:teuthology.orchestra.run.smithi155.stdout: }, 2023-08-01T19:54:56.757 INFO:teuthology.orchestra.run.smithi155.stdout: { 2023-08-01T19:54:56.758 INFO:teuthology.orchestra.run.smithi155.stdout: "event": "queued_for_pg", 2023-08-01T19:54:56.758 INFO:teuthology.orchestra.run.smithi155.stdout: "time": "2023-08-01T19:54:56.061257+0000", 2023-08-01T19:54:56.758 INFO:teuthology.orchestra.run.smithi155.stdout: "duration": 4.5179999999999998e-06 2023-08-01T19:54:56.758 INFO:teuthology.orchestra.run.smithi155.stdout: }, 2023-08-01T19:54:56.758 INFO:teuthology.orchestra.run.smithi155.stdout: { 2023-08-01T19:54:56.758 INFO:teuthology.orchestra.run.smithi155.stdout: "event": "reached_pg", 2023-08-01T19:54:56.758 INFO:teuthology.orchestra.run.smithi155.stdout: "time": "2023-08-01T19:54:56.061300+0000", 2023-08-01T19:54:56.759 INFO:teuthology.orchestra.run.smithi155.stdout: "duration": 4.3183999999999999e-05 2023-08-01T19:54:56.759 INFO:teuthology.orchestra.run.smithi155.stdout: }, 2023-08-01T19:54:56.759 INFO:teuthology.orchestra.run.smithi155.stdout: { 2023-08-01T19:54:56.759 INFO:teuthology.orchestra.run.smithi155.stdout: "event": "started", 2023-08-01T19:54:56.759 INFO:teuthology.orchestra.run.smithi155.stdout: "time": "2023-08-01T19:54:56.061424+0000", 2023-08-01T19:54:56.759 INFO:teuthology.orchestra.run.smithi155.stdout: "duration": 0.00012323 2023-08-01T19:54:56.759 INFO:teuthology.orchestra.run.smithi155.stdout: }, 2023-08-01T19:54:56.760 INFO:teuthology.orchestra.run.smithi155.stdout: { 2023-08-01T19:54:56.760 INFO:teuthology.orchestra.run.smithi155.stdout: "event": "waiting for subops from 1", 2023-08-01T19:54:56.760 INFO:teuthology.orchestra.run.smithi155.stdout: "time": "2023-08-01T19:54:56.061798+0000", 2023-08-01T19:54:56.760 INFO:teuthology.orchestra.run.smithi155.stdout: "duration": 0.000373925 2023-08-01T19:54:56.760 INFO:teuthology.orchestra.run.smithi155.stdout: }, 2023-08-01T19:54:56.760 INFO:teuthology.orchestra.run.smithi155.stdout: { 2023-08-01T19:54:56.760 INFO:teuthology.orchestra.run.smithi155.stdout: "event": "sub_op_commit_rec", 2023-08-01T19:54:56.761 INFO:teuthology.orchestra.run.smithi155.stdout: "time": "2023-08-01T19:54:56.068505+0000", 2023-08-01T19:54:56.761 INFO:teuthology.orchestra.run.smithi155.stdout: "duration": 0.0067069900000000003 2023-08-01T19:54:56.761 INFO:teuthology.orchestra.run.smithi155.stdout: }, 2023-08-01T19:54:56.761 INFO:teuthology.orchestra.run.smithi155.stdout: { 2023-08-01T19:54:56.761 INFO:teuthology.orchestra.run.smithi155.stdout: "event": "op_commit", 2023-08-01T19:54:56.761 INFO:teuthology.orchestra.run.smithi155.stdout: "time": "2023-08-01T19:54:56.077749+0000", 2023-08-01T19:54:56.761 INFO:teuthology.orchestra.run.smithi155.stdout: "duration": 0.0092441490000000001 2023-08-01T19:54:56.762 INFO:teuthology.orchestra.run.smithi155.stdout: }, 2023-08-01T19:54:56.762 INFO:teuthology.orchestra.run.smithi155.stdout: { 2023-08-01T19:54:56.762 INFO:teuthology.orchestra.run.smithi155.stdout: "event": "commit_sent", 2023-08-01T19:54:56.762 INFO:teuthology.orchestra.run.smithi155.stdout: "time": "2023-08-01T19:54:56.077797+0000", 2023-08-01T19:54:56.762 INFO:teuthology.orchestra.run.smithi155.stdout: "duration": 4.7796000000000001e-05 2023-08-01T19:54:56.762 INFO:teuthology.orchestra.run.smithi155.stdout: }, 2023-08-01T19:54:56.762 INFO:teuthology.orchestra.run.smithi155.stdout: { 2023-08-01T19:54:56.762 INFO:teuthology.orchestra.run.smithi155.stdout: "event": "done", 2023-08-01T19:54:56.763 INFO:teuthology.orchestra.run.smithi155.stdout: "time": "2023-08-01T19:54:56.077823+0000", 2023-08-01T19:54:56.763 INFO:teuthology.orchestra.run.smithi155.stdout: "duration": 2.6959000000000001e-05 2023-08-01T19:54:56.763 INFO:teuthology.orchestra.run.smithi155.stdout: } 2023-08-01T19:54:56.763 INFO:teuthology.orchestra.run.smithi155.stdout: ] 2023-08-01T19:54:56.763 INFO:teuthology.orchestra.run.smithi155.stdout: } 2023-08-01T19:54:56.763 INFO:teuthology.orchestra.run.smithi155.stdout: }, 2023-08-01T19:54:56.763 INFO:teuthology.orchestra.run.smithi155.stdout: { 2023-08-01T19:54:56.763 INFO:teuthology.orchestra.run.smithi155.stdout: "description": "osd_op(client.4668.0:82531 5.0 5:062782d2:::benchmark_data_smithi006_114134_object82530:head [set-alloc-hint object_size 65536 write_size 65536,write 0~65536] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e34)", 2023-08-01T19:54:56.764 INFO:teuthology.orchestra.run.smithi155.stdout: "initiated_at": "2023-08-01T19:54:56.064669+0000", 2023-08-01T19:54:56.764 INFO:teuthology.orchestra.run.smithi155.stdout: "age": 0.49355054799999998, 2023-08-01T19:54:56.764 INFO:teuthology.orchestra.run.smithi155.stdout: "duration": 0.017374690000000002, 2023-08-01T19:54:56.764 INFO:teuthology.orchestra.run.smithi155.stdout: "type_data": { 2023-08-01T19:54:56.764 INFO:teuthology.orchestra.run.smithi155.stdout: "flag_point": "commit sent; apply or cleanup", 2023-08-01T19:54:56.764 INFO:teuthology.orchestra.run.smithi155.stdout: "client_info": { 2023-08-01T19:54:56.765 INFO:teuthology.orchestra.run.smithi155.stdout: "client": "client.4668", 2023-08-01T19:54:56.765 INFO:teuthology.orchestra.run.smithi155.stdout: "client_addr": "172.21.15.6:0/1709472247", 2023-08-01T19:54:56.765 INFO:teuthology.orchestra.run.smithi155.stdout: "tid": 82531 2023-08-01T19:54:56.765 INFO:teuthology.orchestra.run.smithi155.stdout: }, 2023-08-01T19:54:56.765 INFO:teuthology.orchestra.run.smithi155.stdout: "events": [ 2023-08-01T19:54:56.765 INFO:teuthology.orchestra.run.smithi155.stdout: { 2023-08-01T19:54:56.765 INFO:teuthology.orchestra.run.smithi155.stdout: "event": "initiated", 2023-08-01T19:54:56.766 INFO:teuthology.orchestra.run.smithi155.stdout: "time": "2023-08-01T19:54:56.064669+0000", 2023-08-01T19:54:56.766 INFO:teuthology.orchestra.run.smithi155.stdout: "duration": 0 2023-08-01T19:54:56.766 INFO:teuthology.orchestra.run.smithi155.stdout: }, 2023-08-01T19:54:56.766 INFO:teuthology.orchestra.run.smithi155.stdout: { 2023-08-01T19:54:56.766 INFO:teuthology.orchestra.run.smithi155.stdout: "event": "throttled", 2023-08-01T19:54:56.766 INFO:teuthology.orchestra.run.smithi155.stdout: "time": "2023-08-01T19:54:56.064669+0000", 2023-08-01T19:54:56.766 INFO:teuthology.orchestra.run.smithi155.stdout: "duration": 0 2023-08-01T19:54:56.766 INFO:teuthology.orchestra.run.smithi155.stdout: }, 2023-08-01T19:54:56.767 INFO:teuthology.orchestra.run.smithi155.stdout: { 2023-08-01T19:54:56.767 INFO:teuthology.orchestra.run.smithi155.stdout: "event": "header_read", 2023-08-01T19:54:56.767 INFO:teuthology.orchestra.run.smithi155.stdout: "time": "2023-08-01T19:54:56.064668+0000", 2023-08-01T19:54:56.767 INFO:teuthology.orchestra.run.smithi155.stdout: "duration": 4294967295.9999986 2023-08-01T19:54:56.767 INFO:teuthology.orchestra.run.smithi155.stdout: }, 2023-08-01T19:54:56.767 INFO:teuthology.orchestra.run.smithi155.stdout: { 2023-08-01T19:54:56.767 INFO:teuthology.orchestra.run.smithi155.stdout: "event": "all_read", 2023-08-01T19:54:56.767 INFO:teuthology.orchestra.run.smithi155.stdout: "time": "2023-08-01T19:54:56.064785+0000", 2023-08-01T19:54:56.768 INFO:teuthology.orchestra.run.smithi155.stdout: "duration": 0.000117064 2023-08-01T19:54:56.768 INFO:teuthology.orchestra.run.smithi155.stdout: }, 2023-08-01T19:54:56.768 INFO:teuthology.orchestra.run.smithi155.stdout: { 2023-08-01T19:54:56.768 INFO:teuthology.orchestra.run.smithi155.stdout: "event": "dispatched", 2023-08-01T19:54:56.768 INFO:teuthology.orchestra.run.smithi155.stdout: "time": "2023-08-01T19:54:56.064797+0000", 2023-08-01T19:54:56.768 INFO:teuthology.orchestra.run.smithi155.stdout: "duration": 1.1963e-05 2023-08-01T19:54:56.768 INFO:teuthology.orchestra.run.smithi155.stdout: }, 2023-08-01T19:54:56.768 INFO:teuthology.orchestra.run.smithi155.stdout: { 2023-08-01T19:54:56.769 INFO:teuthology.orchestra.run.smithi155.stdout: "event": "queued_for_pg", 2023-08-01T19:54:56.769 INFO:teuthology.orchestra.run.smithi155.stdout: "time": "2023-08-01T19:54:56.064804+0000", 2023-08-01T19:54:56.769 INFO:teuthology.orchestra.run.smithi155.stdout: "duration": 7.2710000000000003e-06 2023-08-01T19:54:56.769 INFO:teuthology.orchestra.run.smithi155.stdout: }, 2023-08-01T19:54:56.769 INFO:teuthology.orchestra.run.smithi155.stdout: { 2023-08-01T19:54:56.769 INFO:teuthology.orchestra.run.smithi155.stdout: "event": "reached_pg", 2023-08-01T19:54:56.769 INFO:teuthology.orchestra.run.smithi155.stdout: "time": "2023-08-01T19:54:56.064836+0000", 2023-08-01T19:54:56.769 INFO:teuthology.orchestra.run.smithi155.stdout: "duration": 3.1714999999999997e-05 2023-08-01T19:54:56.770 INFO:teuthology.orchestra.run.smithi155.stdout: }, 2023-08-01T19:54:56.770 INFO:teuthology.orchestra.run.smithi155.stdout: { 2023-08-01T19:54:56.770 INFO:teuthology.orchestra.run.smithi155.stdout: "event": "started", 2023-08-01T19:54:56.770 INFO:teuthology.orchestra.run.smithi155.stdout: "time": "2023-08-01T19:54:56.064928+0000", 2023-08-01T19:54:56.770 INFO:teuthology.orchestra.run.smithi155.stdout: "duration": 9.2335000000000003e-05 2023-08-01T19:54:56.770 INFO:teuthology.orchestra.run.smithi155.stdout: }, 2023-08-01T19:54:56.770 INFO:teuthology.orchestra.run.smithi155.stdout: { 2023-08-01T19:54:56.771 INFO:teuthology.orchestra.run.smithi155.stdout: "event": "waiting for subops from 0", 2023-08-01T19:54:56.771 INFO:teuthology.orchestra.run.smithi155.stdout: "time": "2023-08-01T19:54:56.065019+0000", 2023-08-01T19:54:56.771 INFO:teuthology.orchestra.run.smithi155.stdout: "duration": 9.1176999999999998e-05 2023-08-01T19:54:56.771 INFO:teuthology.orchestra.run.smithi155.stdout: }, 2023-08-01T19:54:56.771 INFO:teuthology.orchestra.run.smithi155.stdout: { 2023-08-01T19:54:56.771 INFO:teuthology.orchestra.run.smithi155.stdout: "event": "sub_op_commit_rec", 2023-08-01T19:54:56.771 INFO:teuthology.orchestra.run.smithi155.stdout: "time": "2023-08-01T19:54:56.069544+0000", 2023-08-01T19:54:56.772 INFO:teuthology.orchestra.run.smithi155.stdout: "duration": 0.0045247000000000004 2023-08-01T19:54:56.772 INFO:teuthology.orchestra.run.smithi155.stdout: }, 2023-08-01T19:54:56.772 INFO:teuthology.orchestra.run.smithi155.stdout: { 2023-08-01T19:54:56.772 INFO:teuthology.orchestra.run.smithi155.stdout: "event": "op_commit", 2023-08-01T19:54:56.772 INFO:teuthology.orchestra.run.smithi155.stdout: "time": "2023-08-01T19:54:56.081961+0000", 2023-08-01T19:54:56.772 INFO:teuthology.orchestra.run.smithi155.stdout: "duration": 0.012416801999999999 2023-08-01T19:54:56.772 INFO:teuthology.orchestra.run.smithi155.stdout: }, 2023-08-01T19:54:56.772 INFO:teuthology.orchestra.run.smithi155.stdout: { 2023-08-01T19:54:56.773 INFO:teuthology.orchestra.run.smithi155.stdout: "event": "commit_sent", 2023-08-01T19:54:56.773 INFO:teuthology.orchestra.run.smithi155.stdout: "time": "2023-08-01T19:54:56.082007+0000", 2023-08-01T19:54:56.773 INFO:teuthology.orchestra.run.smithi155.stdout: "duration": 4.6446999999999998e-05 2023-08-01T19:54:56.773 INFO:teuthology.orchestra.run.smithi155.stdout: }, 2023-08-01T19:54:56.773 INFO:teuthology.orchestra.run.smithi155.stdout: { 2023-08-01T19:54:56.773 INFO:teuthology.orchestra.run.smithi155.stdout: "event": "done", 2023-08-01T19:54:56.773 INFO:teuthology.orchestra.run.smithi155.stdout: "time": "2023-08-01T19:54:56.082044+0000", 2023-08-01T19:54:56.773 INFO:teuthology.orchestra.run.smithi155.stdout: "duration": 3.6427999999999997e-05 2023-08-01T19:54:56.774 INFO:teuthology.orchestra.run.smithi155.stdout: } 2023-08-01T19:54:56.774 INFO:teuthology.orchestra.run.smithi155.stdout: ] 2023-08-01T19:54:56.774 INFO:teuthology.orchestra.run.smithi155.stdout: } 2023-08-01T19:54:56.774 INFO:teuthology.orchestra.run.smithi155.stdout: } 2023-08-01T19:54:56.774 INFO:teuthology.orchestra.run.smithi155.stdout: ] 2023-08-01T19:54:56.774 INFO:teuthology.orchestra.run.smithi155.stdout:} 2023-08-01T19:54:56.775 DEBUG:teuthology.orchestra.run.smithi006:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 120 ceph --cluster ceph -- tell 'osd.*' injectargs --osd_enable_op_tracker=false 2023-08-01T19:54:56.776 INFO:tasks.ceph.osd.1.smithi101.stderr:2023-08-01T19:54:56.774+0000 7fb0cb7f6700 -1 received signal: Hangup from /usr/bin/python3 /bin/daemon-helper kill ceph-osd -f --cluster ceph -i 1 (PID: 111141) UID: 0 2023-08-01T19:54:56.777 DEBUG:teuthology.orchestra.run.smithi008:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 30 ceph --cluster ceph --admin-daemon /var/run/ceph/ceph-osd.0.asok dump_ops_in_flight 2023-08-01T19:54:56.876 INFO:tasks.ceph.osd.2.smithi155.stderr:2023-08-01T19:54:56.874+0000 7faa5c6ac700 -1 received signal: Hangup from /usr/bin/python3 /bin/daemon-helper kill ceph-osd -f --cluster ceph -i 2 (PID: 111337) UID: 0 2023-08-01T19:54:56.926 INFO:teuthology.orchestra.run.smithi006.stdout:osd.0: {} 2023-08-01T19:54:56.945 INFO:teuthology.orchestra.run.smithi006.stdout:osd.1: {} 2023-08-01T19:54:56.964 INFO:teuthology.orchestra.run.smithi006.stdout:osd.2: {} 2023-08-01T19:54:56.965 INFO:teuthology.orchestra.run.smithi006.stderr:osd.0: osd_enable_op_tracker = 'false' 2023-08-01T19:54:56.965 INFO:teuthology.orchestra.run.smithi006.stderr:osd.1: osd_enable_op_tracker = 'false' 2023-08-01T19:54:56.966 INFO:teuthology.orchestra.run.smithi006.stderr:osd.2: osd_enable_op_tracker = 'false' 2023-08-01T19:54:56.966 INFO:teuthology.orchestra.run.smithi008.stdout:ERROR: (22) Invalid argument 2023-08-01T19:54:56.966 INFO:teuthology.orchestra.run.smithi008.stdout:op_tracker tracking is not enabled now, so no ops are tracked currently, even those get stuck. Please enable "osd_enable_op_tracker", and the tracker will start to track new ops received afterwards. 2023-08-01T19:54:56.976 INFO:tasks.ceph.osd.1.smithi101.stderr:2023-08-01T19:54:56.975+0000 7fb0cb7f6700 -1 received signal: Hangup from /usr/bin/python3 /bin/daemon-helper kill ceph-osd -f --cluster ceph -i 1 (PID: 111141) UID: 0 2023-08-01T19:54:56.979 DEBUG:teuthology.orchestra.run.smithi008:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 30 ceph --cluster ceph --admin-daemon /var/run/ceph/ceph-osd.0.asok dump_blocked_ops 2023-08-01T19:54:57.076 DEBUG:teuthology.orchestra.run.smithi006:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 120 ceph --cluster ceph osd set noscrub 2023-08-01T19:54:57.077 INFO:tasks.ceph.osd.2.smithi155.stderr:2023-08-01T19:54:57.076+0000 7faa5c6ac700 -1 received signal: Hangup from /usr/bin/python3 /bin/daemon-helper kill ceph-osd -f --cluster ceph -i 2 (PID: 111337) UID: 0 2023-08-01T19:54:57.169 INFO:teuthology.orchestra.run.smithi008.stdout:ERROR: (22) Invalid argument 2023-08-01T19:54:57.169 INFO:teuthology.orchestra.run.smithi008.stdout:op_tracker tracking is not enabled now, so no ops are tracked currently, even those get stuck. Please enable "osd_enable_op_tracker", and the tracker will start to track new ops received afterwards. 2023-08-01T19:54:57.178 INFO:tasks.ceph.osd.2.smithi155.stderr:2023-08-01T19:54:57.176+0000 7faa5c6ac700 -1 received signal: Hangup from /usr/bin/python3 /bin/daemon-helper kill ceph-osd -f --cluster ceph -i 2 (PID: 111337) UID: 0 2023-08-01T19:54:57.183 DEBUG:teuthology.orchestra.run.smithi008:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 30 ceph --cluster ceph --admin-daemon /var/run/ceph/ceph-osd.0.asok dump_historic_ops 2023-08-01T19:54:57.279 INFO:tasks.ceph.osd.1.smithi101.stderr:2023-08-01T19:54:57.278+0000 7fb0cb7f6700 -1 received signal: Hangup from /usr/bin/python3 /bin/daemon-helper kill ceph-osd -f --cluster ceph -i 1 (PID: 111141) UID: 0 2023-08-01T19:54:57.315 INFO:tasks.radosbench.radosbench.0.smithi006.stdout: 33 16 84944 84928 160.836 118.875 0.0110784 0.00621459 2023-08-01T19:54:57.375 INFO:teuthology.orchestra.run.smithi008.stdout:ERROR: (22) Invalid argument 2023-08-01T19:54:57.376 INFO:teuthology.orchestra.run.smithi008.stdout:op_tracker tracking is not enabled now, so no ops are tracked currently, even those get stuck. Please enable "osd_enable_op_tracker", and the tracker will start to track new ops received afterwards. 2023-08-01T19:54:57.380 INFO:tasks.ceph.osd.2.smithi155.stderr:2023-08-01T19:54:57.378+0000 7faa5c6ac700 -1 received signal: Hangup from /usr/bin/python3 /bin/daemon-helper kill ceph-osd -f --cluster ceph -i 2 (PID: 111337) UID: 0 2023-08-01T19:54:57.388 DEBUG:teuthology.orchestra.run.smithi101:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 30 ceph --cluster ceph --admin-daemon /var/run/ceph/ceph-osd.1.asok dump_ops_in_flight 2023-08-01T19:54:57.481 INFO:tasks.ceph.osd.1.smithi101.stderr:2023-08-01T19:54:57.480+0000 7fb0cb7f6700 -1 received signal: Hangup from /usr/bin/python3 /bin/daemon-helper kill ceph-osd -f --cluster ceph -i 1 (PID: 111141) UID: 0 2023-08-01T19:54:57.558 INFO:teuthology.orchestra.run.smithi101.stdout:ERROR: (22) Invalid argument 2023-08-01T19:54:57.558 INFO:teuthology.orchestra.run.smithi101.stdout:op_tracker tracking is not enabled now, so no ops are tracked currently, even those get stuck. Please enable "osd_enable_op_tracker", and the tracker will start to track new ops received afterwards. 2023-08-01T19:54:57.572 DEBUG:teuthology.orchestra.run.smithi101:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 30 ceph --cluster ceph --admin-daemon /var/run/ceph/ceph-osd.1.asok dump_blocked_ops 2023-08-01T19:54:57.581 INFO:tasks.ceph.osd.0.smithi008.stderr:2023-08-01T19:54:57.581+0000 7f16a58f4700 -1 received signal: Hangup from /usr/bin/python3 /bin/daemon-helper kill ceph-osd -f --cluster ceph -i 0 (PID: 111179) UID: 0 2023-08-01T19:54:57.682 INFO:tasks.ceph.osd.2.smithi155.stderr:2023-08-01T19:54:57.681+0000 7faa5c6ac700 -1 received signal: Hangup from /usr/bin/python3 /bin/daemon-helper kill ceph-osd -f --cluster ceph -i 2 (PID: 111337) UID: 0 2023-08-01T19:54:57.782 INFO:teuthology.orchestra.run.smithi101.stdout:ERROR: (22) Invalid argument 2023-08-01T19:54:57.782 INFO:teuthology.orchestra.run.smithi101.stdout:op_tracker tracking is not enabled now, so no ops are tracked currently, even those get stuck. Please enable "osd_enable_op_tracker", and the tracker will start to track new ops received afterwards. 2023-08-01T19:54:57.783 INFO:tasks.ceph.osd.2.smithi155.stderr:2023-08-01T19:54:57.781+0000 7faa5c6ac700 -1 received signal: Hangup from /usr/bin/python3 /bin/daemon-helper kill ceph-osd -f --cluster ceph -i 2 (PID: 111337) UID: 0 2023-08-01T19:54:57.798 DEBUG:teuthology.orchestra.run.smithi101:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 30 ceph --cluster ceph --admin-daemon /var/run/ceph/ceph-osd.1.asok dump_historic_ops 2023-08-01T19:54:57.885 INFO:tasks.ceph.osd.0.smithi008.stderr:2023-08-01T19:54:57.883+0000 7f16a58f4700 -1 received signal: Hangup from /usr/bin/python3 /bin/daemon-helper kill ceph-osd -f --cluster ceph -i 0 (PID: 111179) UID: 0 2023-08-01T19:54:57.972 INFO:teuthology.orchestra.run.smithi101.stdout:ERROR: (22) Invalid argument 2023-08-01T19:54:57.973 INFO:teuthology.orchestra.run.smithi101.stdout:op_tracker tracking is not enabled now, so no ops are tracked currently, even those get stuck. Please enable "osd_enable_op_tracker", and the tracker will start to track new ops received afterwards. 2023-08-01T19:54:57.985 INFO:tasks.ceph.osd.0.smithi008.stderr:2023-08-01T19:54:57.984+0000 7f16a58f4700 -1 received signal: Hangup from /usr/bin/python3 /bin/daemon-helper kill ceph-osd -f --cluster ceph -i 0 (PID: 111179) UID: 0 2023-08-01T19:54:57.986 DEBUG:teuthology.orchestra.run.smithi155:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 30 ceph --cluster ceph --admin-daemon /var/run/ceph/ceph-osd.2.asok dump_ops_in_flight 2023-08-01T19:54:58.078 INFO:teuthology.orchestra.run.smithi006.stderr:noscrub is set 2023-08-01T19:54:58.100 INFO:tasks.ceph.osd.2.smithi155.stderr:2023-08-01T19:54:58.098+0000 7faa5c6ac700 -1 received signal: Hangup from /usr/bin/python3 /bin/daemon-helper kill ceph-osd -f --cluster ceph -i 2 (PID: 111337) UID: 0 2023-08-01T19:54:58.151 INFO:teuthology.orchestra.run.smithi155.stdout:ERROR: (22) Invalid argument 2023-08-01T19:54:58.151 INFO:teuthology.orchestra.run.smithi155.stdout:op_tracker tracking is not enabled now, so no ops are tracked currently, even those get stuck. Please enable "osd_enable_op_tracker", and the tracker will start to track new ops received afterwards. 2023-08-01T19:54:58.165 DEBUG:teuthology.orchestra.run.smithi155:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 30 ceph --cluster ceph --admin-daemon /var/run/ceph/ceph-osd.2.asok dump_blocked_ops 2023-08-01T19:54:58.201 INFO:tasks.ceph.osd.0.smithi008.stderr:2023-08-01T19:54:58.200+0000 7f16a58f4700 -1 received signal: Hangup from /usr/bin/python3 /bin/daemon-helper kill ceph-osd -f --cluster ceph -i 0 (PID: 111179) UID: 0 2023-08-01T19:54:58.301 INFO:tasks.ceph.osd.1.smithi101.stderr:2023-08-01T19:54:58.300+0000 7fb0cb7f6700 -1 received signal: Hangup from /usr/bin/python3 /bin/daemon-helper kill ceph-osd -f --cluster ceph -i 1 (PID: 111141) UID: 0 2023-08-01T19:54:58.315 INFO:tasks.radosbench.radosbench.0.smithi006.stdout: 34 16 86941 86925 159.776 124.812 0.00796171 0.00625586 2023-08-01T19:54:58.369 INFO:teuthology.orchestra.run.smithi155.stdout:ERROR: (22) Invalid argument 2023-08-01T19:54:58.369 INFO:teuthology.orchestra.run.smithi155.stdout:op_tracker tracking is not enabled now, so no ops are tracked currently, even those get stuck. Please enable "osd_enable_op_tracker", and the tracker will start to track new ops received afterwards. 2023-08-01T19:54:58.382 DEBUG:teuthology.orchestra.run.smithi155:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 30 ceph --cluster ceph --admin-daemon /var/run/ceph/ceph-osd.2.asok dump_historic_ops 2023-08-01T19:54:58.403 INFO:tasks.ceph.osd.1.smithi101.stderr:2023-08-01T19:54:58.401+0000 7fb0cb7f6700 -1 received signal: Hangup from /usr/bin/python3 /bin/daemon-helper kill ceph-osd -f --cluster ceph -i 1 (PID: 111141) UID: 0 2023-08-01T19:54:58.503 INFO:tasks.ceph.osd.1.smithi101.stderr:2023-08-01T19:54:58.502+0000 7fb0cb7f6700 -1 received signal: Hangup from /usr/bin/python3 /bin/daemon-helper kill ceph-osd -f --cluster ceph -i 1 (PID: 111141) UID: 0 2023-08-01T19:54:58.559 INFO:teuthology.orchestra.run.smithi155.stdout:ERROR: (22) Invalid argument 2023-08-01T19:54:58.560 INFO:teuthology.orchestra.run.smithi155.stdout:op_tracker tracking is not enabled now, so no ops are tracked currently, even those get stuck. Please enable "osd_enable_op_tracker", and the tracker will start to track new ops received afterwards. 2023-08-01T19:54:58.574 DEBUG:teuthology.orchestra.run.smithi008:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 30 ceph --cluster ceph --admin-daemon /var/run/ceph/ceph-osd.0.asok dump_ops_in_flight 2023-08-01T19:54:58.618 INFO:tasks.ceph.osd.0.smithi008.stderr:2023-08-01T19:54:58.617+0000 7f16a58f4700 -1 received signal: Hangup from /usr/bin/python3 /bin/daemon-helper kill ceph-osd -f --cluster ceph -i 0 (PID: 111179) UID: 0 2023-08-01T19:54:58.704 INFO:tasks.ceph.osd.2.smithi155.stderr:2023-08-01T19:54:58.703+0000 7faa5c6ac700 -1 received signal: Hangup from /usr/bin/python3 /bin/daemon-helper kill ceph-osd -f --cluster ceph -i 2 (PID: 111337) UID: 0 2023-08-01T19:54:58.764 INFO:teuthology.orchestra.run.smithi008.stdout:ERROR: (22) Invalid argument 2023-08-01T19:54:58.764 INFO:teuthology.orchestra.run.smithi008.stdout:op_tracker tracking is not enabled now, so no ops are tracked currently, even those get stuck. Please enable "osd_enable_op_tracker", and the tracker will start to track new ops received afterwards. 2023-08-01T19:54:58.780 DEBUG:teuthology.orchestra.run.smithi008:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 30 ceph --cluster ceph --admin-daemon /var/run/ceph/ceph-osd.0.asok dump_blocked_ops 2023-08-01T19:54:58.804 INFO:tasks.ceph.osd.2.smithi155.stderr:2023-08-01T19:54:58.803+0000 7faa5c6ac700 -1 received signal: Hangup from /usr/bin/python3 /bin/daemon-helper kill ceph-osd -f --cluster ceph -i 2 (PID: 111337) UID: 0 2023-08-01T19:54:58.905 INFO:tasks.ceph.osd.0.smithi008.stderr:2023-08-01T19:54:58.905+0000 7f16a58f4700 -1 received signal: Hangup from /usr/bin/python3 /bin/daemon-helper kill ceph-osd -f --cluster ceph -i 0 (PID: 111179) UID: 0 2023-08-01T19:54:58.977 DEBUG:teuthology.orchestra.run.smithi006:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 120 ceph --cluster ceph -- tell 'osd.*' injectargs --osd_enable_op_tracker=true 2023-08-01T19:54:59.006 INFO:tasks.ceph.osd.0.smithi008.stderr:2023-08-01T19:54:59.005+0000 7f16a58f4700 -1 received signal: Hangup from /usr/bin/python3 /bin/daemon-helper kill ceph-osd -f --cluster ceph -i 0 (PID: 111179) UID: 0 2023-08-01T19:54:59.011 INFO:teuthology.orchestra.run.smithi008.stdout:ERROR: (22) Invalid argument 2023-08-01T19:54:59.011 INFO:teuthology.orchestra.run.smithi008.stdout:op_tracker tracking is not enabled now, so no ops are tracked currently, even those get stuck. Please enable "osd_enable_op_tracker", and the tracker will start to track new ops received afterwards. 2023-08-01T19:54:59.025 INFO:tasks.thrashosds.thrasher:in_osds: [0, 1, 2] out_osds: [] dead_osds: [] live_osds: [0, 1, 2] 2023-08-01T19:54:59.025 INFO:tasks.thrashosds.thrasher:choose_action: min_in 4 min_out 0 min_live 2 min_dead 0 chance_down 1.00 2023-08-01T19:54:59.025 INFO:tasks.thrashosds.thrasher:inject_pause on osd.2 2023-08-01T19:54:59.026 INFO:tasks.thrashosds.thrasher:Testing filestore_inject_stall pause injection for duration 3 2023-08-01T19:54:59.026 INFO:tasks.thrashosds.thrasher:Checking after 0, should_be_down=False 2023-08-01T19:54:59.026 DEBUG:teuthology.orchestra.run.smithi155:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 0 ceph --cluster ceph --admin-daemon /var/run/ceph/ceph-osd.2.asok config set filestore_inject_stall 3 2023-08-01T19:54:59.027 DEBUG:teuthology.orchestra.run.smithi008:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 30 ceph --cluster ceph --admin-daemon /var/run/ceph/ceph-osd.0.asok dump_historic_ops 2023-08-01T19:54:59.111 INFO:tasks.ceph.osd.0.smithi008.stderr:2023-08-01T19:54:59.111+0000 7f16a58f4700 -1 received signal: Hangup from /usr/bin/python3 /bin/daemon-helper kill ceph-osd -f --cluster ceph -i 0 (PID: 111179) UID: 0 2023-08-01T19:54:59.129 INFO:teuthology.orchestra.run.smithi006.stdout:osd.0: {} 2023-08-01T19:54:59.148 INFO:teuthology.orchestra.run.smithi006.stdout:osd.1: {} 2023-08-01T19:54:59.169 INFO:teuthology.orchestra.run.smithi006.stdout:osd.2: {} 2023-08-01T19:54:59.170 INFO:teuthology.orchestra.run.smithi006.stderr:osd.0: osd_enable_op_tracker = 'true' 2023-08-01T19:54:59.170 INFO:teuthology.orchestra.run.smithi006.stderr:osd.1: osd_enable_op_tracker = 'true' 2023-08-01T19:54:59.171 INFO:teuthology.orchestra.run.smithi006.stderr:osd.2: osd_enable_op_tracker = 'true' 2023-08-01T19:54:59.197 INFO:teuthology.orchestra.run.smithi155.stdout:{ 2023-08-01T19:54:59.197 INFO:teuthology.orchestra.run.smithi155.stdout: "success": "filestore_inject_stall = '3' (not observed, change may require restart) " 2023-08-01T19:54:59.197 INFO:teuthology.orchestra.run.smithi155.stdout:} 2023-08-01T19:54:59.207 INFO:tasks.ceph.osd.1.smithi101.stderr:2023-08-01T19:54:59.206+0000 7fb0cb7f6700 -1 received signal: Hangup from /usr/bin/python3 /bin/daemon-helper kill ceph-osd -f --cluster ceph -i 1 (PID: 111141) UID: 0 2023-08-01T19:54:59.253 INFO:teuthology.orchestra.run.smithi008.stdout:{ 2023-08-01T19:54:59.253 INFO:teuthology.orchestra.run.smithi008.stdout: "size": 20, 2023-08-01T19:54:59.254 INFO:teuthology.orchestra.run.smithi008.stdout: "duration": 600, 2023-08-01T19:54:59.254 INFO:teuthology.orchestra.run.smithi008.stdout: "ops": [ 2023-08-01T19:54:59.254 INFO:teuthology.orchestra.run.smithi008.stdout: { 2023-08-01T19:54:59.254 INFO:teuthology.orchestra.run.smithi008.stdout: "description": "osd_op(client.4668.0:18360 5.6 5:65d8e237:::benchmark_data_smithi006_114134_object18359:head [set-alloc-hint object_size 65536 write_size 65536,write 0~65536] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e23)", 2023-08-01T19:54:59.255 INFO:teuthology.orchestra.run.smithi008.stdout: "initiated_at": "2023-08-01T19:54:28.994296+0000", 2023-08-01T19:54:59.255 INFO:teuthology.orchestra.run.smithi008.stdout: "age": 30.255713104000002, 2023-08-01T19:54:59.255 INFO:teuthology.orchestra.run.smithi008.stdout: "duration": 0.017459669000000001, 2023-08-01T19:54:59.255 INFO:teuthology.orchestra.run.smithi008.stdout: "type_data": { 2023-08-01T19:54:59.255 INFO:teuthology.orchestra.run.smithi008.stdout: "flag_point": "commit sent; apply or cleanup", 2023-08-01T19:54:59.256 INFO:teuthology.orchestra.run.smithi008.stdout: "client_info": { 2023-08-01T19:54:59.256 INFO:teuthology.orchestra.run.smithi008.stdout: "client": "client.4668", 2023-08-01T19:54:59.256 INFO:teuthology.orchestra.run.smithi008.stdout: "client_addr": "172.21.15.6:0/1709472247", 2023-08-01T19:54:59.256 INFO:teuthology.orchestra.run.smithi008.stdout: "tid": 18360 2023-08-01T19:54:59.256 INFO:teuthology.orchestra.run.smithi008.stdout: }, 2023-08-01T19:54:59.257 INFO:teuthology.orchestra.run.smithi008.stdout: "events": [ 2023-08-01T19:54:59.257 INFO:teuthology.orchestra.run.smithi008.stdout: { 2023-08-01T19:54:59.257 INFO:teuthology.orchestra.run.smithi008.stdout: "event": "initiated", 2023-08-01T19:54:59.257 INFO:teuthology.orchestra.run.smithi008.stdout: "time": "2023-08-01T19:54:28.994296+0000", 2023-08-01T19:54:59.257 INFO:teuthology.orchestra.run.smithi008.stdout: "duration": 0 2023-08-01T19:54:59.257 INFO:teuthology.orchestra.run.smithi008.stdout: }, 2023-08-01T19:54:59.257 INFO:teuthology.orchestra.run.smithi008.stdout: { 2023-08-01T19:54:59.257 INFO:teuthology.orchestra.run.smithi008.stdout: "event": "throttled", 2023-08-01T19:54:59.258 INFO:teuthology.orchestra.run.smithi008.stdout: "time": "2023-08-01T19:54:28.994296+0000", 2023-08-01T19:54:59.258 INFO:teuthology.orchestra.run.smithi008.stdout: "duration": 0 2023-08-01T19:54:59.258 INFO:teuthology.orchestra.run.smithi008.stdout: }, 2023-08-01T19:54:59.258 INFO:teuthology.orchestra.run.smithi008.stdout: { 2023-08-01T19:54:59.258 INFO:teuthology.orchestra.run.smithi008.stdout: "event": "header_read", 2023-08-01T19:54:59.258 INFO:teuthology.orchestra.run.smithi008.stdout: "time": "2023-08-01T19:54:28.994295+0000", 2023-08-01T19:54:59.258 INFO:teuthology.orchestra.run.smithi008.stdout: "duration": 4294967295.9999995 2023-08-01T19:54:59.259 INFO:teuthology.orchestra.run.smithi008.stdout: }, 2023-08-01T19:54:59.259 INFO:teuthology.orchestra.run.smithi008.stdout: { 2023-08-01T19:54:59.259 INFO:teuthology.orchestra.run.smithi008.stdout: "event": "all_read", 2023-08-01T19:54:59.259 INFO:teuthology.orchestra.run.smithi008.stdout: "time": "2023-08-01T19:54:28.994381+0000", 2023-08-01T19:54:59.259 INFO:teuthology.orchestra.run.smithi008.stdout: "duration": 8.6055000000000002e-05 2023-08-01T19:54:59.259 INFO:teuthology.orchestra.run.smithi008.stdout: }, 2023-08-01T19:54:59.259 INFO:teuthology.orchestra.run.smithi008.stdout: { 2023-08-01T19:54:59.259 INFO:teuthology.orchestra.run.smithi008.stdout: "event": "dispatched", 2023-08-01T19:54:59.260 INFO:teuthology.orchestra.run.smithi008.stdout: "time": "2023-08-01T19:54:28.994390+0000", 2023-08-01T19:54:59.260 INFO:teuthology.orchestra.run.smithi008.stdout: "duration": 8.7530000000000007e-06 2023-08-01T19:54:59.260 INFO:teuthology.orchestra.run.smithi008.stdout: }, 2023-08-01T19:54:59.260 INFO:teuthology.orchestra.run.smithi008.stdout: { 2023-08-01T19:54:59.260 INFO:teuthology.orchestra.run.smithi008.stdout: "event": "queued_for_pg", 2023-08-01T19:54:59.260 INFO:teuthology.orchestra.run.smithi008.stdout: "time": "2023-08-01T19:54:28.994394+0000", 2023-08-01T19:54:59.260 INFO:teuthology.orchestra.run.smithi008.stdout: "duration": 3.4929999999999998e-06 2023-08-01T19:54:59.260 INFO:teuthology.orchestra.run.smithi008.stdout: }, 2023-08-01T19:54:59.261 INFO:teuthology.orchestra.run.smithi008.stdout: { 2023-08-01T19:54:59.261 INFO:teuthology.orchestra.run.smithi008.stdout: "event": "reached_pg", 2023-08-01T19:54:59.261 INFO:teuthology.orchestra.run.smithi008.stdout: "time": "2023-08-01T19:54:28.995799+0000", 2023-08-01T19:54:59.261 INFO:teuthology.orchestra.run.smithi008.stdout: "duration": 0.001405779 2023-08-01T19:54:59.261 INFO:teuthology.orchestra.run.smithi008.stdout: }, 2023-08-01T19:54:59.261 INFO:teuthology.orchestra.run.smithi008.stdout: { 2023-08-01T19:54:59.261 INFO:teuthology.orchestra.run.smithi008.stdout: "event": "started", 2023-08-01T19:54:59.261 INFO:teuthology.orchestra.run.smithi008.stdout: "time": "2023-08-01T19:54:28.995896+0000", 2023-08-01T19:54:59.262 INFO:teuthology.orchestra.run.smithi008.stdout: "duration": 9.6597999999999999e-05 2023-08-01T19:54:59.262 INFO:teuthology.orchestra.run.smithi008.stdout: }, 2023-08-01T19:54:59.262 INFO:teuthology.orchestra.run.smithi008.stdout: { 2023-08-01T19:54:59.262 INFO:teuthology.orchestra.run.smithi008.stdout: "event": "waiting for subops from 1", 2023-08-01T19:54:59.262 INFO:teuthology.orchestra.run.smithi008.stdout: "time": "2023-08-01T19:54:28.995985+0000", 2023-08-01T19:54:59.262 INFO:teuthology.orchestra.run.smithi008.stdout: "duration": 8.8479000000000004e-05 2023-08-01T19:54:59.262 INFO:teuthology.orchestra.run.smithi008.stdout: }, 2023-08-01T19:54:59.263 INFO:teuthology.orchestra.run.smithi008.stdout: { 2023-08-01T19:54:59.263 INFO:teuthology.orchestra.run.smithi008.stdout: "event": "op_commit", 2023-08-01T19:54:59.263 INFO:teuthology.orchestra.run.smithi008.stdout: "time": "2023-08-01T19:54:28.997700+0000", 2023-08-01T19:54:59.263 INFO:teuthology.orchestra.run.smithi008.stdout: "duration": 0.001714997 2023-08-01T19:54:59.263 INFO:teuthology.orchestra.run.smithi008.stdout: }, 2023-08-01T19:54:59.263 INFO:teuthology.orchestra.run.smithi008.stdout: { 2023-08-01T19:54:59.263 INFO:teuthology.orchestra.run.smithi008.stdout: "event": "sub_op_commit_rec", 2023-08-01T19:54:59.263 INFO:teuthology.orchestra.run.smithi008.stdout: "time": "2023-08-01T19:54:29.011671+0000", 2023-08-01T19:54:59.264 INFO:teuthology.orchestra.run.smithi008.stdout: "duration": 0.0139712 2023-08-01T19:54:59.264 INFO:teuthology.orchestra.run.smithi008.stdout: }, 2023-08-01T19:54:59.264 INFO:teuthology.orchestra.run.smithi008.stdout: { 2023-08-01T19:54:59.264 INFO:teuthology.orchestra.run.smithi008.stdout: "event": "commit_sent", 2023-08-01T19:54:59.264 INFO:teuthology.orchestra.run.smithi008.stdout: "time": "2023-08-01T19:54:29.011719+0000", 2023-08-01T19:54:59.264 INFO:teuthology.orchestra.run.smithi008.stdout: "duration": 4.8025000000000002e-05 2023-08-01T19:54:59.264 INFO:teuthology.orchestra.run.smithi008.stdout: }, 2023-08-01T19:54:59.264 INFO:teuthology.orchestra.run.smithi008.stdout: { 2023-08-01T19:54:59.265 INFO:teuthology.orchestra.run.smithi008.stdout: "event": "done", 2023-08-01T19:54:59.265 INFO:teuthology.orchestra.run.smithi008.stdout: "time": "2023-08-01T19:54:29.011756+0000", 2023-08-01T19:54:59.265 INFO:teuthology.orchestra.run.smithi008.stdout: "duration": 3.6825000000000001e-05 2023-08-01T19:54:59.265 INFO:teuthology.orchestra.run.smithi008.stdout: } 2023-08-01T19:54:59.265 INFO:teuthology.orchestra.run.smithi008.stdout: ] 2023-08-01T19:54:59.265 INFO:teuthology.orchestra.run.smithi008.stdout: } 2023-08-01T19:54:59.265 INFO:teuthology.orchestra.run.smithi008.stdout: }, 2023-08-01T19:54:59.265 INFO:teuthology.orchestra.run.smithi008.stdout: { 2023-08-01T19:54:59.266 INFO:teuthology.orchestra.run.smithi008.stdout: "description": "osd_op(client.4668.0:18361 5.6 5:65a8a093:::benchmark_data_smithi006_114134_object18360:head [set-alloc-hint object_size 65536 write_size 65536,write 0~65536] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e23)", 2023-08-01T19:54:59.266 INFO:teuthology.orchestra.run.smithi008.stdout: "initiated_at": "2023-08-01T19:54:28.994398+0000", 2023-08-01T19:54:59.266 INFO:teuthology.orchestra.run.smithi008.stdout: "age": 30.255611245000001, 2023-08-01T19:54:59.266 INFO:teuthology.orchestra.run.smithi008.stdout: "duration": 0.017435484000000001, 2023-08-01T19:54:59.266 INFO:teuthology.orchestra.run.smithi008.stdout: "type_data": { 2023-08-01T19:54:59.266 INFO:teuthology.orchestra.run.smithi008.stdout: "flag_point": "commit sent; apply or cleanup", 2023-08-01T19:54:59.266 INFO:teuthology.orchestra.run.smithi008.stdout: "client_info": { 2023-08-01T19:54:59.266 INFO:teuthology.orchestra.run.smithi008.stdout: "client": "client.4668", 2023-08-01T19:54:59.267 INFO:teuthology.orchestra.run.smithi008.stdout: "client_addr": "172.21.15.6:0/1709472247", 2023-08-01T19:54:59.267 INFO:teuthology.orchestra.run.smithi008.stdout: "tid": 18361 2023-08-01T19:54:59.267 INFO:teuthology.orchestra.run.smithi008.stdout: }, 2023-08-01T19:54:59.267 INFO:teuthology.orchestra.run.smithi008.stdout: "events": [ 2023-08-01T19:54:59.267 INFO:teuthology.orchestra.run.smithi008.stdout: { 2023-08-01T19:54:59.267 INFO:teuthology.orchestra.run.smithi008.stdout: "event": "initiated", 2023-08-01T19:54:59.267 INFO:teuthology.orchestra.run.smithi008.stdout: "time": "2023-08-01T19:54:28.994398+0000", 2023-08-01T19:54:59.268 INFO:teuthology.orchestra.run.smithi008.stdout: "duration": 0 2023-08-01T19:54:59.268 INFO:teuthology.orchestra.run.smithi008.stdout: }, 2023-08-01T19:54:59.268 INFO:teuthology.orchestra.run.smithi008.stdout: { 2023-08-01T19:54:59.268 INFO:teuthology.orchestra.run.smithi008.stdout: "event": "throttled", 2023-08-01T19:54:59.268 INFO:teuthology.orchestra.run.smithi008.stdout: "time": "2023-08-01T19:54:28.994398+0000", 2023-08-01T19:54:59.268 INFO:teuthology.orchestra.run.smithi008.stdout: "duration": 0 2023-08-01T19:54:59.268 INFO:teuthology.orchestra.run.smithi008.stdout: }, 2023-08-01T19:54:59.268 INFO:teuthology.orchestra.run.smithi008.stdout: { 2023-08-01T19:54:59.269 INFO:teuthology.orchestra.run.smithi008.stdout: "event": "header_read", 2023-08-01T19:54:59.269 INFO:teuthology.orchestra.run.smithi008.stdout: "time": "2023-08-01T19:54:28.994397+0000", 2023-08-01T19:54:59.269 INFO:teuthology.orchestra.run.smithi008.stdout: "duration": 4294967295.9999995 2023-08-01T19:54:59.269 INFO:teuthology.orchestra.run.smithi008.stdout: }, 2023-08-01T19:54:59.269 INFO:teuthology.orchestra.run.smithi008.stdout: { 2023-08-01T19:54:59.269 INFO:teuthology.orchestra.run.smithi008.stdout: "event": "all_read", 2023-08-01T19:54:59.269 INFO:teuthology.orchestra.run.smithi008.stdout: "time": "2023-08-01T19:54:28.994475+0000", 2023-08-01T19:54:59.269 INFO:teuthology.orchestra.run.smithi008.stdout: "duration": 7.7408000000000002e-05 2023-08-01T19:54:59.270 INFO:teuthology.orchestra.run.smithi008.stdout: }, 2023-08-01T19:54:59.270 INFO:teuthology.orchestra.run.smithi008.stdout: { 2023-08-01T19:54:59.270 INFO:teuthology.orchestra.run.smithi008.stdout: "event": "dispatched", 2023-08-01T19:54:59.270 INFO:teuthology.orchestra.run.smithi008.stdout: "time": "2023-08-01T19:54:28.994480+0000", 2023-08-01T19:54:59.270 INFO:teuthology.orchestra.run.smithi008.stdout: "duration": 5.3589999999999999e-06 2023-08-01T19:54:59.270 INFO:teuthology.orchestra.run.smithi008.stdout: }, 2023-08-01T19:54:59.270 INFO:teuthology.orchestra.run.smithi008.stdout: { 2023-08-01T19:54:59.270 INFO:teuthology.orchestra.run.smithi008.stdout: "event": "queued_for_pg", 2023-08-01T19:54:59.271 INFO:teuthology.orchestra.run.smithi008.stdout: "time": "2023-08-01T19:54:28.994484+0000", 2023-08-01T19:54:59.271 INFO:teuthology.orchestra.run.smithi008.stdout: "duration": 3.9750000000000001e-06 2023-08-01T19:54:59.271 INFO:teuthology.orchestra.run.smithi008.stdout: }, 2023-08-01T19:54:59.271 INFO:teuthology.orchestra.run.smithi008.stdout: { 2023-08-01T19:54:59.271 INFO:teuthology.orchestra.run.smithi008.stdout: "event": "reached_pg", 2023-08-01T19:54:59.271 INFO:teuthology.orchestra.run.smithi008.stdout: "time": "2023-08-01T19:54:28.996504+0000", 2023-08-01T19:54:59.271 INFO:teuthology.orchestra.run.smithi008.stdout: "duration": 0.0020198550000000001 2023-08-01T19:54:59.272 INFO:teuthology.orchestra.run.smithi008.stdout: }, 2023-08-01T19:54:59.272 INFO:teuthology.orchestra.run.smithi008.stdout: { 2023-08-01T19:54:59.272 INFO:teuthology.orchestra.run.smithi008.stdout: "event": "started", 2023-08-01T19:54:59.272 INFO:teuthology.orchestra.run.smithi008.stdout: "time": "2023-08-01T19:54:28.996624+0000", 2023-08-01T19:54:59.272 INFO:teuthology.orchestra.run.smithi008.stdout: "duration": 0.000120118 2023-08-01T19:54:59.272 INFO:teuthology.orchestra.run.smithi008.stdout: }, 2023-08-01T19:54:59.272 INFO:teuthology.orchestra.run.smithi008.stdout: { 2023-08-01T19:54:59.272 INFO:teuthology.orchestra.run.smithi008.stdout: "event": "waiting for subops from 1", 2023-08-01T19:54:59.273 INFO:teuthology.orchestra.run.smithi008.stdout: "time": "2023-08-01T19:54:28.996790+0000", 2023-08-01T19:54:59.273 INFO:teuthology.orchestra.run.smithi008.stdout: "duration": 0.000165398 2023-08-01T19:54:59.273 INFO:teuthology.orchestra.run.smithi008.stdout: }, 2023-08-01T19:54:59.273 INFO:teuthology.orchestra.run.smithi008.stdout: { 2023-08-01T19:54:59.273 INFO:teuthology.orchestra.run.smithi008.stdout: "event": "op_commit", 2023-08-01T19:54:59.273 INFO:teuthology.orchestra.run.smithi008.stdout: "time": "2023-08-01T19:54:28.999061+0000", 2023-08-01T19:54:59.273 INFO:teuthology.orchestra.run.smithi008.stdout: "duration": 0.0022714800000000002 2023-08-01T19:54:59.273 INFO:teuthology.orchestra.run.smithi008.stdout: }, 2023-08-01T19:54:59.274 INFO:teuthology.orchestra.run.smithi008.stdout: { 2023-08-01T19:54:59.274 INFO:teuthology.orchestra.run.smithi008.stdout: "event": "sub_op_commit_rec", 2023-08-01T19:54:59.274 INFO:teuthology.orchestra.run.smithi008.stdout: "time": "2023-08-01T19:54:29.011788+0000", 2023-08-01T19:54:59.274 INFO:teuthology.orchestra.run.smithi008.stdout: "duration": 0.012726774999999999 2023-08-01T19:54:59.274 INFO:teuthology.orchestra.run.smithi008.stdout: }, 2023-08-01T19:54:59.274 INFO:teuthology.orchestra.run.smithi008.stdout: { 2023-08-01T19:54:59.274 INFO:teuthology.orchestra.run.smithi008.stdout: "event": "commit_sent", 2023-08-01T19:54:59.274 INFO:teuthology.orchestra.run.smithi008.stdout: "time": "2023-08-01T19:54:29.011815+0000", 2023-08-01T19:54:59.275 INFO:teuthology.orchestra.run.smithi008.stdout: "duration": 2.7032000000000001e-05 2023-08-01T19:54:59.275 INFO:teuthology.orchestra.run.smithi008.stdout: }, 2023-08-01T19:54:59.275 INFO:teuthology.orchestra.run.smithi008.stdout: { 2023-08-01T19:54:59.275 INFO:teuthology.orchestra.run.smithi008.stdout: "event": "done", 2023-08-01T19:54:59.275 INFO:teuthology.orchestra.run.smithi008.stdout: "time": "2023-08-01T19:54:29.011833+0000", 2023-08-01T19:54:59.275 INFO:teuthology.orchestra.run.smithi008.stdout: "duration": 1.8437e-05 2023-08-01T19:54:59.275 INFO:teuthology.orchestra.run.smithi008.stdout: } 2023-08-01T19:54:59.275 INFO:teuthology.orchestra.run.smithi008.stdout: ] 2023-08-01T19:54:59.276 INFO:teuthology.orchestra.run.smithi008.stdout: } 2023-08-01T19:54:59.276 INFO:teuthology.orchestra.run.smithi008.stdout: }, 2023-08-01T19:54:59.276 INFO:teuthology.orchestra.run.smithi008.stdout: { 2023-08-01T19:54:59.276 INFO:teuthology.orchestra.run.smithi008.stdout: "description": "osd_op(client.4668.0:18363 5.5 5:ab48299e:::benchmark_data_smithi006_114134_object18362:head [set-alloc-hint object_size 65536 write_size 65536,write 0~65536] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e23)", 2023-08-01T19:54:59.276 INFO:teuthology.orchestra.run.smithi008.stdout: "initiated_at": "2023-08-01T19:54:28.996467+0000", 2023-08-01T19:54:59.276 INFO:teuthology.orchestra.run.smithi008.stdout: "age": 30.253541804000001, 2023-08-01T19:54:59.276 INFO:teuthology.orchestra.run.smithi008.stdout: "duration": 0.015287689, 2023-08-01T19:54:59.276 INFO:teuthology.orchestra.run.smithi008.stdout: "type_data": { 2023-08-01T19:54:59.277 INFO:teuthology.orchestra.run.smithi008.stdout: "flag_point": "commit sent; apply or cleanup", 2023-08-01T19:54:59.277 INFO:teuthology.orchestra.run.smithi008.stdout: "client_info": { 2023-08-01T19:54:59.277 INFO:teuthology.orchestra.run.smithi008.stdout: "client": "client.4668", 2023-08-01T19:54:59.277 INFO:teuthology.orchestra.run.smithi008.stdout: "client_addr": "172.21.15.6:0/1709472247", 2023-08-01T19:54:59.277 INFO:teuthology.orchestra.run.smithi008.stdout: "tid": 18363 2023-08-01T19:54:59.277 INFO:teuthology.orchestra.run.smithi008.stdout: }, 2023-08-01T19:54:59.277 INFO:teuthology.orchestra.run.smithi008.stdout: "events": [ 2023-08-01T19:54:59.277 INFO:teuthology.orchestra.run.smithi008.stdout: { 2023-08-01T19:54:59.278 INFO:teuthology.orchestra.run.smithi008.stdout: "event": "initiated", 2023-08-01T19:54:59.278 INFO:teuthology.orchestra.run.smithi008.stdout: "time": "2023-08-01T19:54:28.996467+0000", 2023-08-01T19:54:59.278 INFO:teuthology.orchestra.run.smithi008.stdout: "duration": 0 2023-08-01T19:54:59.278 INFO:teuthology.orchestra.run.smithi008.stdout: }, 2023-08-01T19:54:59.278 INFO:teuthology.orchestra.run.smithi008.stdout: { 2023-08-01T19:54:59.278 INFO:teuthology.orchestra.run.smithi008.stdout: "event": "throttled", 2023-08-01T19:54:59.278 INFO:teuthology.orchestra.run.smithi008.stdout: "time": "2023-08-01T19:54:28.996467+0000", 2023-08-01T19:54:59.279 INFO:teuthology.orchestra.run.smithi008.stdout: "duration": 0 2023-08-01T19:54:59.279 INFO:teuthology.orchestra.run.smithi008.stdout: }, 2023-08-01T19:54:59.279 INFO:teuthology.orchestra.run.smithi008.stdout: { 2023-08-01T19:54:59.279 INFO:teuthology.orchestra.run.smithi008.stdout: "event": "header_read", 2023-08-01T19:54:59.279 INFO:teuthology.orchestra.run.smithi008.stdout: "time": "2023-08-01T19:54:28.996466+0000", 2023-08-01T19:54:59.279 INFO:teuthology.orchestra.run.smithi008.stdout: "duration": 4294967295.999999 2023-08-01T19:54:59.279 INFO:teuthology.orchestra.run.smithi008.stdout: }, 2023-08-01T19:54:59.279 INFO:teuthology.orchestra.run.smithi008.stdout: { 2023-08-01T19:54:59.280 INFO:teuthology.orchestra.run.smithi008.stdout: "event": "all_read", 2023-08-01T19:54:59.280 INFO:teuthology.orchestra.run.smithi008.stdout: "time": "2023-08-01T19:54:28.996519+0000", 2023-08-01T19:54:59.280 INFO:teuthology.orchestra.run.smithi008.stdout: "duration": 5.3075000000000003e-05 2023-08-01T19:54:59.280 INFO:teuthology.orchestra.run.smithi008.stdout: }, 2023-08-01T19:54:59.280 INFO:teuthology.orchestra.run.smithi008.stdout: { 2023-08-01T19:54:59.280 INFO:teuthology.orchestra.run.smithi008.stdout: "event": "dispatched", 2023-08-01T19:54:59.280 INFO:teuthology.orchestra.run.smithi008.stdout: "time": "2023-08-01T19:54:28.996529+0000", 2023-08-01T19:54:59.280 INFO:teuthology.orchestra.run.smithi008.stdout: "duration": 9.2499999999999995e-06 2023-08-01T19:54:59.281 INFO:teuthology.orchestra.run.smithi008.stdout: }, 2023-08-01T19:54:59.281 INFO:teuthology.orchestra.run.smithi008.stdout: { 2023-08-01T19:54:59.281 INFO:teuthology.orchestra.run.smithi008.stdout: "event": "queued_for_pg", 2023-08-01T19:54:59.281 INFO:teuthology.orchestra.run.smithi008.stdout: "time": "2023-08-01T19:54:28.996537+0000", 2023-08-01T19:54:59.281 INFO:teuthology.orchestra.run.smithi008.stdout: "duration": 8.4239999999999993e-06 2023-08-01T19:54:59.281 INFO:teuthology.orchestra.run.smithi008.stdout: }, 2023-08-01T19:54:59.281 INFO:teuthology.orchestra.run.smithi008.stdout: { 2023-08-01T19:54:59.281 INFO:teuthology.orchestra.run.smithi008.stdout: "event": "reached_pg", 2023-08-01T19:54:59.282 INFO:teuthology.orchestra.run.smithi008.stdout: "time": "2023-08-01T19:54:28.996590+0000", 2023-08-01T19:54:59.282 INFO:teuthology.orchestra.run.smithi008.stdout: "duration": 5.3047999999999998e-05 2023-08-01T19:54:59.282 INFO:teuthology.orchestra.run.smithi008.stdout: }, 2023-08-01T19:54:59.282 INFO:teuthology.orchestra.run.smithi008.stdout: { 2023-08-01T19:54:59.282 INFO:teuthology.orchestra.run.smithi008.stdout: "event": "started", 2023-08-01T19:54:59.282 INFO:teuthology.orchestra.run.smithi008.stdout: "time": "2023-08-01T19:54:28.996707+0000", 2023-08-01T19:54:59.282 INFO:teuthology.orchestra.run.smithi008.stdout: "duration": 0.000117005 2023-08-01T19:54:59.283 INFO:teuthology.orchestra.run.smithi008.stdout: }, 2023-08-01T19:54:59.283 INFO:teuthology.orchestra.run.smithi008.stdout: { 2023-08-01T19:54:59.283 INFO:teuthology.orchestra.run.smithi008.stdout: "event": "waiting for subops from 1", 2023-08-01T19:54:59.283 INFO:teuthology.orchestra.run.smithi008.stdout: "time": "2023-08-01T19:54:28.996807+0000", 2023-08-01T19:54:59.283 INFO:teuthology.orchestra.run.smithi008.stdout: "duration": 0.0001003 2023-08-01T19:54:59.283 INFO:teuthology.orchestra.run.smithi008.stdout: }, 2023-08-01T19:54:59.283 INFO:teuthology.orchestra.run.smithi008.stdout: { 2023-08-01T19:54:59.283 INFO:teuthology.orchestra.run.smithi008.stdout: "event": "op_commit", 2023-08-01T19:54:59.284 INFO:teuthology.orchestra.run.smithi008.stdout: "time": "2023-08-01T19:54:28.998511+0000", 2023-08-01T19:54:59.284 INFO:teuthology.orchestra.run.smithi008.stdout: "duration": 0.00170397 2023-08-01T19:54:59.284 INFO:teuthology.orchestra.run.smithi008.stdout: }, 2023-08-01T19:54:59.284 INFO:teuthology.orchestra.run.smithi008.stdout: { 2023-08-01T19:54:59.284 INFO:teuthology.orchestra.run.smithi008.stdout: "event": "sub_op_commit_rec", 2023-08-01T19:54:59.284 INFO:teuthology.orchestra.run.smithi008.stdout: "time": "2023-08-01T19:54:29.011698+0000", 2023-08-01T19:54:59.284 INFO:teuthology.orchestra.run.smithi008.stdout: "duration": 0.013186959 2023-08-01T19:54:59.284 INFO:teuthology.orchestra.run.smithi008.stdout: }, 2023-08-01T19:54:59.285 INFO:teuthology.orchestra.run.smithi008.stdout: { 2023-08-01T19:54:59.285 INFO:teuthology.orchestra.run.smithi008.stdout: "event": "commit_sent", 2023-08-01T19:54:59.285 INFO:teuthology.orchestra.run.smithi008.stdout: "time": "2023-08-01T19:54:29.011729+0000", 2023-08-01T19:54:59.285 INFO:teuthology.orchestra.run.smithi008.stdout: "duration": 3.044e-05 2023-08-01T19:54:59.285 INFO:teuthology.orchestra.run.smithi008.stdout: }, 2023-08-01T19:54:59.285 INFO:teuthology.orchestra.run.smithi008.stdout: { 2023-08-01T19:54:59.285 INFO:teuthology.orchestra.run.smithi008.stdout: "event": "done", 2023-08-01T19:54:59.285 INFO:teuthology.orchestra.run.smithi008.stdout: "time": "2023-08-01T19:54:29.011755+0000", 2023-08-01T19:54:59.286 INFO:teuthology.orchestra.run.smithi008.stdout: "duration": 2.6165000000000001e-05 2023-08-01T19:54:59.286 INFO:teuthology.orchestra.run.smithi008.stdout: } 2023-08-01T19:54:59.286 INFO:teuthology.orchestra.run.smithi008.stdout: ] 2023-08-01T19:54:59.286 INFO:teuthology.orchestra.run.smithi008.stdout: } 2023-08-01T19:54:59.286 INFO:teuthology.orchestra.run.smithi008.stdout: }, 2023-08-01T19:54:59.286 INFO:teuthology.orchestra.run.smithi008.stdout: { 2023-08-01T19:54:59.286 INFO:teuthology.orchestra.run.smithi008.stdout: "description": "osd_repop(client.4668.0:61802 5.b e29/19 5:dcfcf99c:::benchmark_data_smithi006_114134_object61801:head v 29'3819, mlcod=28'3815)", 2023-08-01T19:54:59.286 INFO:teuthology.orchestra.run.smithi008.stdout: "initiated_at": "2023-08-01T19:54:45.744751+0000", 2023-08-01T19:54:59.287 INFO:teuthology.orchestra.run.smithi008.stdout: "age": 13.505258086, 2023-08-01T19:54:59.287 INFO:teuthology.orchestra.run.smithi008.stdout: "duration": 0.015484753, 2023-08-01T19:54:59.287 INFO:teuthology.orchestra.run.smithi008.stdout: "type_data": { 2023-08-01T19:54:59.287 INFO:teuthology.orchestra.run.smithi008.stdout: "flag_point": "commit sent; apply or cleanup", 2023-08-01T19:54:59.287 INFO:teuthology.orchestra.run.smithi008.stdout: "events": [ 2023-08-01T19:54:59.287 INFO:teuthology.orchestra.run.smithi008.stdout: { 2023-08-01T19:54:59.288 INFO:teuthology.orchestra.run.smithi008.stdout: "event": "initiated", 2023-08-01T19:54:59.288 INFO:teuthology.orchestra.run.smithi008.stdout: "time": "2023-08-01T19:54:45.744751+0000", 2023-08-01T19:54:59.288 INFO:teuthology.orchestra.run.smithi008.stdout: "duration": 0 2023-08-01T19:54:59.288 INFO:teuthology.orchestra.run.smithi008.stdout: }, 2023-08-01T19:54:59.289 INFO:teuthology.orchestra.run.smithi008.stdout: { 2023-08-01T19:54:59.289 INFO:teuthology.orchestra.run.smithi008.stdout: "event": "throttled", 2023-08-01T19:54:59.289 INFO:teuthology.orchestra.run.smithi008.stdout: "time": "2023-08-01T19:54:45.744751+0000", 2023-08-01T19:54:59.290 INFO:teuthology.orchestra.run.smithi008.stdout: "duration": 0 2023-08-01T19:54:59.290 INFO:teuthology.orchestra.run.smithi008.stdout: }, 2023-08-01T19:54:59.290 INFO:teuthology.orchestra.run.smithi008.stdout: { 2023-08-01T19:54:59.290 INFO:teuthology.orchestra.run.smithi008.stdout: "event": "header_read", 2023-08-01T19:54:59.291 INFO:teuthology.orchestra.run.smithi008.stdout: "time": "2023-08-01T19:54:45.744750+0000", 2023-08-01T19:54:59.291 INFO:teuthology.orchestra.run.smithi008.stdout: "duration": 4294967295.9999995 2023-08-01T19:54:59.291 INFO:teuthology.orchestra.run.smithi008.stdout: }, 2023-08-01T19:54:59.291 INFO:teuthology.orchestra.run.smithi008.stdout: { 2023-08-01T19:54:59.292 INFO:teuthology.orchestra.run.smithi008.stdout: "event": "all_read", 2023-08-01T19:54:59.292 INFO:teuthology.orchestra.run.smithi008.stdout: "time": "2023-08-01T19:54:45.744820+0000", 2023-08-01T19:54:59.292 INFO:teuthology.orchestra.run.smithi008.stdout: "duration": 6.9839999999999995e-05 2023-08-01T19:54:59.292 INFO:teuthology.orchestra.run.smithi008.stdout: }, 2023-08-01T19:54:59.293 INFO:teuthology.orchestra.run.smithi008.stdout: { 2023-08-01T19:54:59.293 INFO:teuthology.orchestra.run.smithi008.stdout: "event": "dispatched", 2023-08-01T19:54:59.293 INFO:teuthology.orchestra.run.smithi008.stdout: "time": "2023-08-01T19:54:45.744829+0000", 2023-08-01T19:54:59.293 INFO:teuthology.orchestra.run.smithi008.stdout: "duration": 8.7499999999999992e-06 2023-08-01T19:54:59.293 INFO:teuthology.orchestra.run.smithi008.stdout: }, 2023-08-01T19:54:59.294 INFO:teuthology.orchestra.run.smithi008.stdout: { 2023-08-01T19:54:59.294 INFO:teuthology.orchestra.run.smithi008.stdout: "event": "queued_for_pg", 2023-08-01T19:54:59.294 INFO:teuthology.orchestra.run.smithi008.stdout: "time": "2023-08-01T19:54:45.744835+0000", 2023-08-01T19:54:59.294 INFO:teuthology.orchestra.run.smithi008.stdout: "duration": 5.6609999999999997e-06 2023-08-01T19:54:59.295 INFO:teuthology.orchestra.run.smithi008.stdout: }, 2023-08-01T19:54:59.295 INFO:teuthology.orchestra.run.smithi008.stdout: { 2023-08-01T19:54:59.295 INFO:teuthology.orchestra.run.smithi008.stdout: "event": "reached_pg", 2023-08-01T19:54:59.295 INFO:teuthology.orchestra.run.smithi008.stdout: "time": "2023-08-01T19:54:45.746369+0000", 2023-08-01T19:54:59.296 INFO:teuthology.orchestra.run.smithi008.stdout: "duration": 0.001534512 2023-08-01T19:54:59.296 INFO:teuthology.orchestra.run.smithi008.stdout: }, 2023-08-01T19:54:59.296 INFO:teuthology.orchestra.run.smithi008.stdout: { 2023-08-01T19:54:59.296 INFO:teuthology.orchestra.run.smithi008.stdout: "event": "started", 2023-08-01T19:54:59.297 INFO:teuthology.orchestra.run.smithi008.stdout: "time": "2023-08-01T19:54:45.746389+0000", 2023-08-01T19:54:59.297 INFO:teuthology.orchestra.run.smithi008.stdout: "duration": 2.0271999999999998e-05 2023-08-01T19:54:59.297 INFO:teuthology.orchestra.run.smithi008.stdout: }, 2023-08-01T19:54:59.297 INFO:teuthology.orchestra.run.smithi008.stdout: { 2023-08-01T19:54:59.298 INFO:teuthology.orchestra.run.smithi008.stdout: "event": "commit_sent", 2023-08-01T19:54:59.298 INFO:teuthology.orchestra.run.smithi008.stdout: "time": "2023-08-01T19:54:45.760207+0000", 2023-08-01T19:54:59.298 INFO:teuthology.orchestra.run.smithi008.stdout: "duration": 0.013817378 2023-08-01T19:54:59.298 INFO:teuthology.orchestra.run.smithi008.stdout: }, 2023-08-01T19:54:59.298 INFO:teuthology.orchestra.run.smithi008.stdout: { 2023-08-01T19:54:59.299 INFO:teuthology.orchestra.run.smithi008.stdout: "event": "done", 2023-08-01T19:54:59.299 INFO:teuthology.orchestra.run.smithi008.stdout: "time": "2023-08-01T19:54:45.760236+0000", 2023-08-01T19:54:59.299 INFO:teuthology.orchestra.run.smithi008.stdout: "duration": 2.8929999999999999e-05 2023-08-01T19:54:59.299 INFO:teuthology.orchestra.run.smithi008.stdout: } 2023-08-01T19:54:59.300 INFO:teuthology.orchestra.run.smithi008.stdout: ] 2023-08-01T19:54:59.300 INFO:teuthology.orchestra.run.smithi008.stdout: } 2023-08-01T19:54:59.300 INFO:teuthology.orchestra.run.smithi008.stdout: }, 2023-08-01T19:54:59.300 INFO:teuthology.orchestra.run.smithi008.stdout: { 2023-08-01T19:54:59.301 INFO:teuthology.orchestra.run.smithi008.stdout: "description": "osd_op(client.4668.0:65870 5.c 5:33dffb88:::benchmark_data_smithi006_114134_object65869:head [set-alloc-hint object_size 65536 write_size 65536,write 0~65536] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e29)", 2023-08-01T19:54:59.301 INFO:teuthology.orchestra.run.smithi008.stdout: "initiated_at": "2023-08-01T19:54:47.659854+0000", 2023-08-01T19:54:59.301 INFO:teuthology.orchestra.run.smithi008.stdout: "age": 11.590155196, 2023-08-01T19:54:59.301 INFO:teuthology.orchestra.run.smithi008.stdout: "duration": 0.018513103999999999, 2023-08-01T19:54:59.302 INFO:teuthology.orchestra.run.smithi008.stdout: "type_data": { 2023-08-01T19:54:59.302 INFO:teuthology.orchestra.run.smithi008.stdout: "flag_point": "commit sent; apply or cleanup", 2023-08-01T19:54:59.302 INFO:teuthology.orchestra.run.smithi008.stdout: "client_info": { 2023-08-01T19:54:59.302 INFO:teuthology.orchestra.run.smithi008.stdout: "client": "client.4668", 2023-08-01T19:54:59.302 INFO:teuthology.orchestra.run.smithi008.stdout: "client_addr": "172.21.15.6:0/1709472247", 2023-08-01T19:54:59.303 INFO:teuthology.orchestra.run.smithi008.stdout: "tid": 65870 2023-08-01T19:54:59.303 INFO:teuthology.orchestra.run.smithi008.stdout: }, 2023-08-01T19:54:59.303 INFO:teuthology.orchestra.run.smithi008.stdout: "events": [ 2023-08-01T19:54:59.303 INFO:teuthology.orchestra.run.smithi008.stdout: { 2023-08-01T19:54:59.304 INFO:teuthology.orchestra.run.smithi008.stdout: "event": "initiated", 2023-08-01T19:54:59.304 INFO:teuthology.orchestra.run.smithi008.stdout: "time": "2023-08-01T19:54:47.659854+0000", 2023-08-01T19:54:59.304 INFO:teuthology.orchestra.run.smithi008.stdout: "duration": 0 2023-08-01T19:54:59.304 INFO:teuthology.orchestra.run.smithi008.stdout: }, 2023-08-01T19:54:59.304 INFO:teuthology.orchestra.run.smithi008.stdout: { 2023-08-01T19:54:59.304 INFO:teuthology.orchestra.run.smithi008.stdout: "event": "throttled", 2023-08-01T19:54:59.305 INFO:teuthology.orchestra.run.smithi008.stdout: "time": "2023-08-01T19:54:47.659854+0000", 2023-08-01T19:54:59.305 INFO:teuthology.orchestra.run.smithi008.stdout: "duration": 0 2023-08-01T19:54:59.305 INFO:teuthology.orchestra.run.smithi008.stdout: }, 2023-08-01T19:54:59.305 INFO:teuthology.orchestra.run.smithi008.stdout: { 2023-08-01T19:54:59.305 INFO:teuthology.orchestra.run.smithi008.stdout: "event": "header_read", 2023-08-01T19:54:59.305 INFO:teuthology.orchestra.run.smithi008.stdout: "time": "2023-08-01T19:54:47.659853+0000", 2023-08-01T19:54:59.305 INFO:teuthology.orchestra.run.smithi008.stdout: "duration": 4294967295.999999 2023-08-01T19:54:59.306 INFO:teuthology.orchestra.run.smithi008.stdout: }, 2023-08-01T19:54:59.306 INFO:teuthology.orchestra.run.smithi008.stdout: { 2023-08-01T19:54:59.306 INFO:teuthology.orchestra.run.smithi008.stdout: "event": "all_read", 2023-08-01T19:54:59.306 INFO:teuthology.orchestra.run.smithi008.stdout: "time": "2023-08-01T19:54:47.660013+0000", 2023-08-01T19:54:59.306 INFO:teuthology.orchestra.run.smithi008.stdout: "duration": 0.00015954900000000001 2023-08-01T19:54:59.306 INFO:teuthology.orchestra.run.smithi008.stdout: }, 2023-08-01T19:54:59.306 INFO:teuthology.orchestra.run.smithi008.stdout: { 2023-08-01T19:54:59.307 INFO:teuthology.orchestra.run.smithi008.stdout: "event": "dispatched", 2023-08-01T19:54:59.307 INFO:teuthology.orchestra.run.smithi008.stdout: "time": "2023-08-01T19:54:47.660023+0000", 2023-08-01T19:54:59.307 INFO:teuthology.orchestra.run.smithi008.stdout: "duration": 1.0327e-05 2023-08-01T19:54:59.307 INFO:teuthology.orchestra.run.smithi008.stdout: }, 2023-08-01T19:54:59.307 INFO:teuthology.orchestra.run.smithi008.stdout: { 2023-08-01T19:54:59.308 INFO:teuthology.orchestra.run.smithi008.stdout: "event": "queued_for_pg", 2023-08-01T19:54:59.308 INFO:teuthology.orchestra.run.smithi008.stdout: "time": "2023-08-01T19:54:47.660039+0000", 2023-08-01T19:54:59.308 INFO:teuthology.orchestra.run.smithi008.stdout: "duration": 1.5829999999999999e-05 2023-08-01T19:54:59.308 INFO:teuthology.orchestra.run.smithi008.stdout: }, 2023-08-01T19:54:59.308 INFO:teuthology.orchestra.run.smithi008.stdout: { 2023-08-01T19:54:59.308 INFO:teuthology.orchestra.run.smithi008.stdout: "event": "reached_pg", 2023-08-01T19:54:59.308 INFO:teuthology.orchestra.run.smithi008.stdout: "time": "2023-08-01T19:54:47.662611+0000", 2023-08-01T19:54:59.309 INFO:teuthology.orchestra.run.smithi008.stdout: "duration": 0.002572319 2023-08-01T19:54:59.309 INFO:teuthology.orchestra.run.smithi008.stdout: }, 2023-08-01T19:54:59.309 INFO:teuthology.orchestra.run.smithi008.stdout: { 2023-08-01T19:54:59.309 INFO:teuthology.orchestra.run.smithi008.stdout: "event": "started", 2023-08-01T19:54:59.309 INFO:teuthology.orchestra.run.smithi008.stdout: "time": "2023-08-01T19:54:47.662767+0000", 2023-08-01T19:54:59.309 INFO:teuthology.orchestra.run.smithi008.stdout: "duration": 0.00015598200000000001 2023-08-01T19:54:59.309 INFO:teuthology.orchestra.run.smithi008.stdout: }, 2023-08-01T19:54:59.309 INFO:teuthology.orchestra.run.smithi008.stdout: { 2023-08-01T19:54:59.310 INFO:teuthology.orchestra.run.smithi008.stdout: "event": "waiting for subops from 1", 2023-08-01T19:54:59.310 INFO:teuthology.orchestra.run.smithi008.stdout: "time": "2023-08-01T19:54:47.662930+0000", 2023-08-01T19:54:59.310 INFO:teuthology.orchestra.run.smithi008.stdout: "duration": 0.000163086 2023-08-01T19:54:59.310 INFO:teuthology.orchestra.run.smithi008.stdout: }, 2023-08-01T19:54:59.310 INFO:teuthology.orchestra.run.smithi008.stdout: { 2023-08-01T19:54:59.310 INFO:teuthology.orchestra.run.smithi008.stdout: "event": "sub_op_commit_rec", 2023-08-01T19:54:59.310 INFO:teuthology.orchestra.run.smithi008.stdout: "time": "2023-08-01T19:54:47.667336+0000", 2023-08-01T19:54:59.310 INFO:teuthology.orchestra.run.smithi008.stdout: "duration": 0.0044062839999999999 2023-08-01T19:54:59.311 INFO:teuthology.orchestra.run.smithi008.stdout: }, 2023-08-01T19:54:59.311 INFO:teuthology.orchestra.run.smithi008.stdout: { 2023-08-01T19:54:59.311 INFO:teuthology.orchestra.run.smithi008.stdout: "event": "op_commit", 2023-08-01T19:54:59.311 INFO:teuthology.orchestra.run.smithi008.stdout: "time": "2023-08-01T19:54:47.678278+0000", 2023-08-01T19:54:59.311 INFO:teuthology.orchestra.run.smithi008.stdout: "duration": 0.010941912999999999 2023-08-01T19:54:59.311 INFO:teuthology.orchestra.run.smithi008.stdout: }, 2023-08-01T19:54:59.311 INFO:teuthology.orchestra.run.smithi008.stdout: { 2023-08-01T19:54:59.311 INFO:teuthology.orchestra.run.smithi008.stdout: "event": "commit_sent", 2023-08-01T19:54:59.312 INFO:teuthology.orchestra.run.smithi008.stdout: "time": "2023-08-01T19:54:47.678325+0000", 2023-08-01T19:54:59.312 INFO:teuthology.orchestra.run.smithi008.stdout: "duration": 4.6449999999999997e-05 2023-08-01T19:54:59.312 INFO:teuthology.orchestra.run.smithi008.stdout: }, 2023-08-01T19:54:59.312 INFO:teuthology.orchestra.run.smithi008.stdout: { 2023-08-01T19:54:59.312 INFO:teuthology.orchestra.run.smithi008.stdout: "event": "done", 2023-08-01T19:54:59.312 INFO:teuthology.orchestra.run.smithi008.stdout: "time": "2023-08-01T19:54:47.678367+0000", 2023-08-01T19:54:59.313 INFO:teuthology.orchestra.run.smithi008.stdout: "duration": 4.2222999999999999e-05 2023-08-01T19:54:59.313 INFO:teuthology.orchestra.run.smithi008.stdout: } 2023-08-01T19:54:59.313 INFO:teuthology.orchestra.run.smithi008.stdout: ] 2023-08-01T19:54:59.313 INFO:teuthology.orchestra.run.smithi008.stdout: } 2023-08-01T19:54:59.313 INFO:teuthology.orchestra.run.smithi008.stdout: }, 2023-08-01T19:54:59.313 INFO:teuthology.orchestra.run.smithi008.stdout: { 2023-08-01T19:54:59.313 INFO:teuthology.orchestra.run.smithi008.stdout: "description": "osd_op(client.4668.0:72937 5.6 5:690f72b2:::benchmark_data_smithi006_114134_object72936:head [set-alloc-hint object_size 65536 write_size 65536,write 0~65536] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e31)", 2023-08-01T19:54:59.313 INFO:teuthology.orchestra.run.smithi008.stdout: "initiated_at": "2023-08-01T19:54:51.214102+0000", 2023-08-01T19:54:59.314 INFO:teuthology.orchestra.run.smithi008.stdout: "age": 8.0359069420000004, 2023-08-01T19:54:59.314 INFO:teuthology.orchestra.run.smithi008.stdout: "duration": 0.015280545, 2023-08-01T19:54:59.314 INFO:teuthology.orchestra.run.smithi008.stdout: "type_data": { 2023-08-01T19:54:59.314 INFO:teuthology.orchestra.run.smithi008.stdout: "flag_point": "commit sent; apply or cleanup", 2023-08-01T19:54:59.314 INFO:teuthology.orchestra.run.smithi008.stdout: "client_info": { 2023-08-01T19:54:59.314 INFO:teuthology.orchestra.run.smithi008.stdout: "client": "client.4668", 2023-08-01T19:54:59.314 INFO:teuthology.orchestra.run.smithi008.stdout: "client_addr": "172.21.15.6:0/1709472247", 2023-08-01T19:54:59.314 INFO:teuthology.orchestra.run.smithi008.stdout: "tid": 72937 2023-08-01T19:54:59.315 INFO:teuthology.orchestra.run.smithi008.stdout: }, 2023-08-01T19:54:59.315 INFO:teuthology.orchestra.run.smithi008.stdout: "events": [ 2023-08-01T19:54:59.315 INFO:teuthology.orchestra.run.smithi008.stdout: { 2023-08-01T19:54:59.315 INFO:teuthology.orchestra.run.smithi008.stdout: "event": "initiated", 2023-08-01T19:54:59.315 INFO:teuthology.orchestra.run.smithi008.stdout: "time": "2023-08-01T19:54:51.214102+0000", 2023-08-01T19:54:59.315 INFO:teuthology.orchestra.run.smithi008.stdout: "duration": 0 2023-08-01T19:54:59.315 INFO:teuthology.orchestra.run.smithi008.stdout: }, 2023-08-01T19:54:59.316 INFO:teuthology.orchestra.run.smithi008.stdout: { 2023-08-01T19:54:59.316 INFO:teuthology.orchestra.run.smithi008.stdout: "event": "throttled", 2023-08-01T19:54:59.316 INFO:teuthology.orchestra.run.smithi008.stdout: "time": "2023-08-01T19:54:51.214102+0000", 2023-08-01T19:54:59.316 INFO:teuthology.orchestra.run.smithi008.stdout: "duration": 0 2023-08-01T19:54:59.316 INFO:teuthology.orchestra.run.smithi008.stdout: }, 2023-08-01T19:54:59.316 INFO:teuthology.orchestra.run.smithi008.stdout: { 2023-08-01T19:54:59.316 INFO:teuthology.orchestra.run.smithi008.stdout: "event": "header_read", 2023-08-01T19:54:59.317 INFO:teuthology.orchestra.run.smithi008.stdout: "time": "2023-08-01T19:54:51.214102+0000", 2023-08-01T19:54:59.317 INFO:teuthology.orchestra.run.smithi008.stdout: "duration": 4294967295.9999995 2023-08-01T19:54:59.317 INFO:teuthology.orchestra.run.smithi008.stdout: }, 2023-08-01T19:54:59.317 INFO:teuthology.orchestra.run.smithi008.stdout: { 2023-08-01T19:54:59.317 INFO:teuthology.orchestra.run.smithi008.stdout: "event": "all_read", 2023-08-01T19:54:59.317 INFO:teuthology.orchestra.run.smithi008.stdout: "time": "2023-08-01T19:54:51.214128+0000", 2023-08-01T19:54:59.317 INFO:teuthology.orchestra.run.smithi008.stdout: "duration": 2.6049000000000001e-05 2023-08-01T19:54:59.317 INFO:teuthology.orchestra.run.smithi008.stdout: }, 2023-08-01T19:54:59.318 INFO:teuthology.orchestra.run.smithi008.stdout: { 2023-08-01T19:54:59.318 INFO:teuthology.orchestra.run.smithi008.stdout: "event": "dispatched", 2023-08-01T19:54:59.318 INFO:teuthology.orchestra.run.smithi008.stdout: "time": "2023-08-01T19:54:51.214135+0000", 2023-08-01T19:54:59.318 INFO:teuthology.orchestra.run.smithi008.stdout: "duration": 7.8590000000000005e-06 2023-08-01T19:54:59.318 INFO:teuthology.orchestra.run.smithi008.stdout: }, 2023-08-01T19:54:59.318 INFO:teuthology.orchestra.run.smithi008.stdout: { 2023-08-01T19:54:59.318 INFO:teuthology.orchestra.run.smithi008.stdout: "event": "queued_for_pg", 2023-08-01T19:54:59.318 INFO:teuthology.orchestra.run.smithi008.stdout: "time": "2023-08-01T19:54:51.214140+0000", 2023-08-01T19:54:59.319 INFO:teuthology.orchestra.run.smithi008.stdout: "duration": 4.5000000000000001e-06 2023-08-01T19:54:59.319 INFO:teuthology.orchestra.run.smithi008.stdout: }, 2023-08-01T19:54:59.319 INFO:teuthology.orchestra.run.smithi008.stdout: { 2023-08-01T19:54:59.319 INFO:teuthology.orchestra.run.smithi008.stdout: "event": "reached_pg", 2023-08-01T19:54:59.319 INFO:teuthology.orchestra.run.smithi008.stdout: "time": "2023-08-01T19:54:51.216270+0000", 2023-08-01T19:54:59.319 INFO:teuthology.orchestra.run.smithi008.stdout: "duration": 0.0021297820000000002 2023-08-01T19:54:59.319 INFO:teuthology.orchestra.run.smithi008.stdout: }, 2023-08-01T19:54:59.320 INFO:teuthology.orchestra.run.smithi008.stdout: { 2023-08-01T19:54:59.320 INFO:teuthology.orchestra.run.smithi008.stdout: "event": "started", 2023-08-01T19:54:59.320 INFO:teuthology.orchestra.run.smithi008.stdout: "time": "2023-08-01T19:54:51.216395+0000", 2023-08-01T19:54:59.320 INFO:teuthology.orchestra.run.smithi008.stdout: "duration": 0.000125384 2023-08-01T19:54:59.320 INFO:teuthology.orchestra.run.smithi008.stdout: }, 2023-08-01T19:54:59.320 INFO:teuthology.orchestra.run.smithi008.stdout: { 2023-08-01T19:54:59.320 INFO:teuthology.orchestra.run.smithi008.stdout: "event": "waiting for subops from 1", 2023-08-01T19:54:59.320 INFO:teuthology.orchestra.run.smithi008.stdout: "time": "2023-08-01T19:54:51.216561+0000", 2023-08-01T19:54:59.321 INFO:teuthology.orchestra.run.smithi008.stdout: "duration": 0.00016589900000000001 2023-08-01T19:54:59.321 INFO:teuthology.orchestra.run.smithi008.stdout: }, 2023-08-01T19:54:59.321 INFO:teuthology.orchestra.run.smithi008.stdout: { 2023-08-01T19:54:59.321 INFO:teuthology.orchestra.run.smithi008.stdout: "event": "sub_op_commit_rec", 2023-08-01T19:54:59.321 INFO:teuthology.orchestra.run.smithi008.stdout: "time": "2023-08-01T19:54:51.220839+0000", 2023-08-01T19:54:59.321 INFO:teuthology.orchestra.run.smithi008.stdout: "duration": 0.004278202 2023-08-01T19:54:59.321 INFO:teuthology.orchestra.run.smithi008.stdout: }, 2023-08-01T19:54:59.321 INFO:teuthology.orchestra.run.smithi008.stdout: { 2023-08-01T19:54:59.322 INFO:teuthology.orchestra.run.smithi008.stdout: "event": "op_commit", 2023-08-01T19:54:59.322 INFO:teuthology.orchestra.run.smithi008.stdout: "time": "2023-08-01T19:54:51.229298+0000", 2023-08-01T19:54:59.322 INFO:teuthology.orchestra.run.smithi008.stdout: "duration": 0.0084587499999999993 2023-08-01T19:54:59.322 INFO:teuthology.orchestra.run.smithi008.stdout: }, 2023-08-01T19:54:59.322 INFO:teuthology.orchestra.run.smithi008.stdout: { 2023-08-01T19:54:59.322 INFO:teuthology.orchestra.run.smithi008.stdout: "event": "commit_sent", 2023-08-01T19:54:59.322 INFO:teuthology.orchestra.run.smithi008.stdout: "time": "2023-08-01T19:54:51.229352+0000", 2023-08-01T19:54:59.322 INFO:teuthology.orchestra.run.smithi008.stdout: "duration": 5.4289000000000001e-05 2023-08-01T19:54:59.323 INFO:teuthology.orchestra.run.smithi008.stdout: }, 2023-08-01T19:54:59.323 INFO:teuthology.orchestra.run.smithi008.stdout: { 2023-08-01T19:54:59.323 INFO:teuthology.orchestra.run.smithi008.stdout: "event": "done", 2023-08-01T19:54:59.323 INFO:teuthology.orchestra.run.smithi008.stdout: "time": "2023-08-01T19:54:51.229383+0000", 2023-08-01T19:54:59.323 INFO:teuthology.orchestra.run.smithi008.stdout: "duration": 3.0324999999999998e-05 2023-08-01T19:54:59.323 INFO:teuthology.orchestra.run.smithi008.stdout: } 2023-08-01T19:54:59.323 INFO:teuthology.orchestra.run.smithi008.stdout: ] 2023-08-01T19:54:59.323 INFO:teuthology.orchestra.run.smithi008.stdout: } 2023-08-01T19:54:59.324 INFO:teuthology.orchestra.run.smithi008.stdout: }, 2023-08-01T19:54:59.324 INFO:teuthology.orchestra.run.smithi008.stdout: { 2023-08-01T19:54:59.324 INFO:teuthology.orchestra.run.smithi008.stdout: "description": "osd_op(client.4668.0:74271 5.a 5:510c0950:::benchmark_data_smithi006_114134_object74270:head [set-alloc-hint object_size 65536 write_size 65536,write 0~65536] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e31)", 2023-08-01T19:54:59.324 INFO:teuthology.orchestra.run.smithi008.stdout: "initiated_at": "2023-08-01T19:54:51.858239+0000", 2023-08-01T19:54:59.324 INFO:teuthology.orchestra.run.smithi008.stdout: "age": 7.3917702470000002, 2023-08-01T19:54:59.324 INFO:teuthology.orchestra.run.smithi008.stdout: "duration": 0.015474116, 2023-08-01T19:54:59.324 INFO:teuthology.orchestra.run.smithi008.stdout: "type_data": { 2023-08-01T19:54:59.325 INFO:teuthology.orchestra.run.smithi008.stdout: "flag_point": "commit sent; apply or cleanup", 2023-08-01T19:54:59.325 INFO:teuthology.orchestra.run.smithi008.stdout: "client_info": { 2023-08-01T19:54:59.325 INFO:teuthology.orchestra.run.smithi008.stdout: "client": "client.4668", 2023-08-01T19:54:59.325 INFO:teuthology.orchestra.run.smithi008.stdout: "client_addr": "172.21.15.6:0/1709472247", 2023-08-01T19:54:59.325 INFO:teuthology.orchestra.run.smithi008.stdout: "tid": 74271 2023-08-01T19:54:59.325 INFO:teuthology.orchestra.run.smithi008.stdout: }, 2023-08-01T19:54:59.325 INFO:teuthology.orchestra.run.smithi008.stdout: "events": [ 2023-08-01T19:54:59.325 INFO:teuthology.orchestra.run.smithi008.stdout: { 2023-08-01T19:54:59.326 INFO:teuthology.orchestra.run.smithi008.stdout: "event": "initiated", 2023-08-01T19:54:59.326 INFO:teuthology.orchestra.run.smithi008.stdout: "time": "2023-08-01T19:54:51.858239+0000", 2023-08-01T19:54:59.326 INFO:teuthology.orchestra.run.smithi008.stdout: "duration": 0 2023-08-01T19:54:59.326 INFO:teuthology.orchestra.run.smithi008.stdout: }, 2023-08-01T19:54:59.326 INFO:teuthology.orchestra.run.smithi008.stdout: { 2023-08-01T19:54:59.326 INFO:teuthology.orchestra.run.smithi008.stdout: "event": "throttled", 2023-08-01T19:54:59.326 INFO:teuthology.orchestra.run.smithi008.stdout: "time": "2023-08-01T19:54:51.858239+0000", 2023-08-01T19:54:59.326 INFO:teuthology.orchestra.run.smithi008.stdout: "duration": 0 2023-08-01T19:54:59.327 INFO:teuthology.orchestra.run.smithi008.stdout: }, 2023-08-01T19:54:59.327 INFO:teuthology.orchestra.run.smithi008.stdout: { 2023-08-01T19:54:59.327 INFO:teuthology.orchestra.run.smithi008.stdout: "event": "header_read", 2023-08-01T19:54:59.327 INFO:teuthology.orchestra.run.smithi008.stdout: "time": "2023-08-01T19:54:51.858238+0000", 2023-08-01T19:54:59.327 INFO:teuthology.orchestra.run.smithi008.stdout: "duration": 4294967295.999999 2023-08-01T19:54:59.327 INFO:teuthology.orchestra.run.smithi008.stdout: }, 2023-08-01T19:54:59.327 INFO:teuthology.orchestra.run.smithi008.stdout: { 2023-08-01T19:54:59.327 INFO:teuthology.orchestra.run.smithi008.stdout: "event": "all_read", 2023-08-01T19:54:59.328 INFO:teuthology.orchestra.run.smithi008.stdout: "time": "2023-08-01T19:54:51.858355+0000", 2023-08-01T19:54:59.328 INFO:teuthology.orchestra.run.smithi008.stdout: "duration": 0.000117277 2023-08-01T19:54:59.328 INFO:teuthology.orchestra.run.smithi008.stdout: }, 2023-08-01T19:54:59.328 INFO:teuthology.orchestra.run.smithi008.stdout: { 2023-08-01T19:54:59.328 INFO:teuthology.orchestra.run.smithi008.stdout: "event": "dispatched", 2023-08-01T19:54:59.328 INFO:teuthology.orchestra.run.smithi008.stdout: "time": "2023-08-01T19:54:51.858365+0000", 2023-08-01T19:54:59.328 INFO:teuthology.orchestra.run.smithi008.stdout: "duration": 9.3999999999999998e-06 2023-08-01T19:54:59.329 INFO:teuthology.orchestra.run.smithi008.stdout: }, 2023-08-01T19:54:59.329 INFO:teuthology.orchestra.run.smithi008.stdout: { 2023-08-01T19:54:59.329 INFO:teuthology.orchestra.run.smithi008.stdout: "event": "queued_for_pg", 2023-08-01T19:54:59.329 INFO:teuthology.orchestra.run.smithi008.stdout: "time": "2023-08-01T19:54:51.858370+0000", 2023-08-01T19:54:59.329 INFO:teuthology.orchestra.run.smithi008.stdout: "duration": 5.361e-06 2023-08-01T19:54:59.329 INFO:teuthology.orchestra.run.smithi008.stdout: }, 2023-08-01T19:54:59.329 INFO:teuthology.orchestra.run.smithi008.stdout: { 2023-08-01T19:54:59.329 INFO:teuthology.orchestra.run.smithi008.stdout: "event": "reached_pg", 2023-08-01T19:54:59.330 INFO:teuthology.orchestra.run.smithi008.stdout: "time": "2023-08-01T19:54:51.861465+0000", 2023-08-01T19:54:59.330 INFO:teuthology.orchestra.run.smithi008.stdout: "duration": 0.0030946290000000002 2023-08-01T19:54:59.330 INFO:teuthology.orchestra.run.smithi008.stdout: }, 2023-08-01T19:54:59.330 INFO:teuthology.orchestra.run.smithi008.stdout: { 2023-08-01T19:54:59.330 INFO:teuthology.orchestra.run.smithi008.stdout: "event": "started", 2023-08-01T19:54:59.330 INFO:teuthology.orchestra.run.smithi008.stdout: "time": "2023-08-01T19:54:51.861622+0000", 2023-08-01T19:54:59.330 INFO:teuthology.orchestra.run.smithi008.stdout: "duration": 0.00015781000000000001 2023-08-01T19:54:59.330 INFO:teuthology.orchestra.run.smithi008.stdout: }, 2023-08-01T19:54:59.331 INFO:teuthology.orchestra.run.smithi008.stdout: { 2023-08-01T19:54:59.331 INFO:teuthology.orchestra.run.smithi008.stdout: "event": "waiting for subops from 2", 2023-08-01T19:54:59.331 INFO:teuthology.orchestra.run.smithi008.stdout: "time": "2023-08-01T19:54:51.861782+0000", 2023-08-01T19:54:59.331 INFO:teuthology.orchestra.run.smithi008.stdout: "duration": 0.000159693 2023-08-01T19:54:59.331 INFO:teuthology.orchestra.run.smithi008.stdout: }, 2023-08-01T19:54:59.331 INFO:teuthology.orchestra.run.smithi008.stdout: { 2023-08-01T19:54:59.331 INFO:teuthology.orchestra.run.smithi008.stdout: "event": "op_commit", 2023-08-01T19:54:59.332 INFO:teuthology.orchestra.run.smithi008.stdout: "time": "2023-08-01T19:54:51.867540+0000", 2023-08-01T19:54:59.332 INFO:teuthology.orchestra.run.smithi008.stdout: "duration": 0.0057582889999999998 2023-08-01T19:54:59.332 INFO:teuthology.orchestra.run.smithi008.stdout: }, 2023-08-01T19:54:59.332 INFO:teuthology.orchestra.run.smithi008.stdout: { 2023-08-01T19:54:59.332 INFO:teuthology.orchestra.run.smithi008.stdout: "event": "sub_op_commit_rec", 2023-08-01T19:54:59.332 INFO:teuthology.orchestra.run.smithi008.stdout: "time": "2023-08-01T19:54:51.873630+0000", 2023-08-01T19:54:59.332 INFO:teuthology.orchestra.run.smithi008.stdout: "duration": 0.0060899659999999996 2023-08-01T19:54:59.332 INFO:teuthology.orchestra.run.smithi008.stdout: }, 2023-08-01T19:54:59.333 INFO:teuthology.orchestra.run.smithi008.stdout: { 2023-08-01T19:54:59.333 INFO:teuthology.orchestra.run.smithi008.stdout: "event": "commit_sent", 2023-08-01T19:54:59.333 INFO:teuthology.orchestra.run.smithi008.stdout: "time": "2023-08-01T19:54:51.873678+0000", 2023-08-01T19:54:59.333 INFO:teuthology.orchestra.run.smithi008.stdout: "duration": 4.7975000000000001e-05 2023-08-01T19:54:59.333 INFO:teuthology.orchestra.run.smithi008.stdout: }, 2023-08-01T19:54:59.333 INFO:teuthology.orchestra.run.smithi008.stdout: { 2023-08-01T19:54:59.333 INFO:teuthology.orchestra.run.smithi008.stdout: "event": "done", 2023-08-01T19:54:59.333 INFO:teuthology.orchestra.run.smithi008.stdout: "time": "2023-08-01T19:54:51.873713+0000", 2023-08-01T19:54:59.334 INFO:teuthology.orchestra.run.smithi008.stdout: "duration": 3.4629999999999999e-05 2023-08-01T19:54:59.334 INFO:teuthology.orchestra.run.smithi008.stdout: } 2023-08-01T19:54:59.334 INFO:teuthology.orchestra.run.smithi008.stdout: ] 2023-08-01T19:54:59.334 INFO:teuthology.orchestra.run.smithi008.stdout: } 2023-08-01T19:54:59.334 INFO:teuthology.orchestra.run.smithi008.stdout: }, 2023-08-01T19:54:59.334 INFO:teuthology.orchestra.run.smithi008.stdout: { 2023-08-01T19:54:59.334 INFO:teuthology.orchestra.run.smithi008.stdout: "description": "osd_op(client.4668.0:74273 5.a 5:5dd61108:::benchmark_data_smithi006_114134_object74272:head [set-alloc-hint object_size 65536 write_size 65536,write 0~65536] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e31)", 2023-08-01T19:54:59.334 INFO:teuthology.orchestra.run.smithi008.stdout: "initiated_at": "2023-08-01T19:54:51.858577+0000", 2023-08-01T19:54:59.335 INFO:teuthology.orchestra.run.smithi008.stdout: "age": 7.3914320580000004, 2023-08-01T19:54:59.335 INFO:teuthology.orchestra.run.smithi008.stdout: "duration": 0.015258379000000001, 2023-08-01T19:54:59.335 INFO:teuthology.orchestra.run.smithi008.stdout: "type_data": { 2023-08-01T19:54:59.335 INFO:teuthology.orchestra.run.smithi008.stdout: "flag_point": "commit sent; apply or cleanup", 2023-08-01T19:54:59.335 INFO:teuthology.orchestra.run.smithi008.stdout: "client_info": { 2023-08-01T19:54:59.335 INFO:teuthology.orchestra.run.smithi008.stdout: "client": "client.4668", 2023-08-01T19:54:59.335 INFO:teuthology.orchestra.run.smithi008.stdout: "client_addr": "172.21.15.6:0/1709472247", 2023-08-01T19:54:59.336 INFO:teuthology.orchestra.run.smithi008.stdout: "tid": 74273 2023-08-01T19:54:59.336 INFO:teuthology.orchestra.run.smithi008.stdout: }, 2023-08-01T19:54:59.336 INFO:teuthology.orchestra.run.smithi008.stdout: "events": [ 2023-08-01T19:54:59.336 INFO:teuthology.orchestra.run.smithi008.stdout: { 2023-08-01T19:54:59.336 INFO:teuthology.orchestra.run.smithi008.stdout: "event": "initiated", 2023-08-01T19:54:59.336 INFO:teuthology.orchestra.run.smithi008.stdout: "time": "2023-08-01T19:54:51.858577+0000", 2023-08-01T19:54:59.336 INFO:teuthology.orchestra.run.smithi008.stdout: "duration": 0 2023-08-01T19:54:59.337 INFO:teuthology.orchestra.run.smithi008.stdout: }, 2023-08-01T19:54:59.337 INFO:teuthology.orchestra.run.smithi008.stdout: { 2023-08-01T19:54:59.337 INFO:teuthology.orchestra.run.smithi008.stdout: "event": "throttled", 2023-08-01T19:54:59.337 INFO:teuthology.orchestra.run.smithi008.stdout: "time": "2023-08-01T19:54:51.858577+0000", 2023-08-01T19:54:59.337 INFO:teuthology.orchestra.run.smithi008.stdout: "duration": 0 2023-08-01T19:54:59.337 INFO:teuthology.orchestra.run.smithi008.stdout: }, 2023-08-01T19:54:59.337 INFO:teuthology.orchestra.run.smithi008.stdout: { 2023-08-01T19:54:59.337 INFO:teuthology.orchestra.run.smithi008.stdout: "event": "header_read", 2023-08-01T19:54:59.338 INFO:teuthology.orchestra.run.smithi008.stdout: "time": "2023-08-01T19:54:51.858576+0000", 2023-08-01T19:54:59.338 INFO:teuthology.orchestra.run.smithi008.stdout: "duration": 4294967295.999999 2023-08-01T19:54:59.338 INFO:teuthology.orchestra.run.smithi008.stdout: }, 2023-08-01T19:54:59.338 INFO:teuthology.orchestra.run.smithi008.stdout: { 2023-08-01T19:54:59.338 INFO:teuthology.orchestra.run.smithi008.stdout: "event": "all_read", 2023-08-01T19:54:59.338 INFO:teuthology.orchestra.run.smithi008.stdout: "time": "2023-08-01T19:54:51.858654+0000", 2023-08-01T19:54:59.338 INFO:teuthology.orchestra.run.smithi008.stdout: "duration": 7.7909000000000002e-05 2023-08-01T19:54:59.338 INFO:teuthology.orchestra.run.smithi008.stdout: }, 2023-08-01T19:54:59.339 INFO:teuthology.orchestra.run.smithi008.stdout: { 2023-08-01T19:54:59.339 INFO:teuthology.orchestra.run.smithi008.stdout: "event": "dispatched", 2023-08-01T19:54:59.339 INFO:teuthology.orchestra.run.smithi008.stdout: "time": "2023-08-01T19:54:51.858663+0000", 2023-08-01T19:54:59.339 INFO:teuthology.orchestra.run.smithi008.stdout: "duration": 8.9060000000000008e-06 2023-08-01T19:54:59.339 INFO:teuthology.orchestra.run.smithi008.stdout: }, 2023-08-01T19:54:59.339 INFO:teuthology.orchestra.run.smithi008.stdout: { 2023-08-01T19:54:59.339 INFO:teuthology.orchestra.run.smithi008.stdout: "event": "queued_for_pg", 2023-08-01T19:54:59.340 INFO:teuthology.orchestra.run.smithi008.stdout: "time": "2023-08-01T19:54:51.858670+0000", 2023-08-01T19:54:59.340 INFO:teuthology.orchestra.run.smithi008.stdout: "duration": 7.3799999999999996e-06 2023-08-01T19:54:59.340 INFO:teuthology.orchestra.run.smithi008.stdout: }, 2023-08-01T19:54:59.340 INFO:teuthology.orchestra.run.smithi008.stdout: { 2023-08-01T19:54:59.340 INFO:teuthology.orchestra.run.smithi008.stdout: "event": "reached_pg", 2023-08-01T19:54:59.340 INFO:teuthology.orchestra.run.smithi008.stdout: "time": "2023-08-01T19:54:51.863680+0000", 2023-08-01T19:54:59.340 INFO:teuthology.orchestra.run.smithi008.stdout: "duration": 0.0050096259999999997 2023-08-01T19:54:59.340 INFO:teuthology.orchestra.run.smithi008.stdout: }, 2023-08-01T19:54:59.341 INFO:teuthology.orchestra.run.smithi008.stdout: { 2023-08-01T19:54:59.341 INFO:teuthology.orchestra.run.smithi008.stdout: "event": "started", 2023-08-01T19:54:59.341 INFO:teuthology.orchestra.run.smithi008.stdout: "time": "2023-08-01T19:54:51.863817+0000", 2023-08-01T19:54:59.341 INFO:teuthology.orchestra.run.smithi008.stdout: "duration": 0.00013683900000000001 2023-08-01T19:54:59.341 INFO:teuthology.orchestra.run.smithi008.stdout: }, 2023-08-01T19:54:59.341 INFO:teuthology.orchestra.run.smithi008.stdout: { 2023-08-01T19:54:59.341 INFO:teuthology.orchestra.run.smithi008.stdout: "event": "waiting for subops from 2", 2023-08-01T19:54:59.342 INFO:teuthology.orchestra.run.smithi008.stdout: "time": "2023-08-01T19:54:51.863983+0000", 2023-08-01T19:54:59.342 INFO:teuthology.orchestra.run.smithi008.stdout: "duration": 0.00016626600000000001 2023-08-01T19:54:59.342 INFO:teuthology.orchestra.run.smithi008.stdout: }, 2023-08-01T19:54:59.342 INFO:teuthology.orchestra.run.smithi008.stdout: { 2023-08-01T19:54:59.342 INFO:teuthology.orchestra.run.smithi008.stdout: "event": "op_commit", 2023-08-01T19:54:59.342 INFO:teuthology.orchestra.run.smithi008.stdout: "time": "2023-08-01T19:54:51.871752+0000", 2023-08-01T19:54:59.342 INFO:teuthology.orchestra.run.smithi008.stdout: "duration": 0.0077690370000000003 2023-08-01T19:54:59.342 INFO:teuthology.orchestra.run.smithi008.stdout: }, 2023-08-01T19:54:59.343 INFO:teuthology.orchestra.run.smithi008.stdout: { 2023-08-01T19:54:59.343 INFO:teuthology.orchestra.run.smithi008.stdout: "event": "sub_op_commit_rec", 2023-08-01T19:54:59.343 INFO:teuthology.orchestra.run.smithi008.stdout: "time": "2023-08-01T19:54:51.873763+0000", 2023-08-01T19:54:59.343 INFO:teuthology.orchestra.run.smithi008.stdout: "duration": 0.0020105930000000002 2023-08-01T19:54:59.344 INFO:teuthology.orchestra.run.smithi008.stdout: }, 2023-08-01T19:54:59.344 INFO:teuthology.orchestra.run.smithi008.stdout: { 2023-08-01T19:54:59.344 INFO:teuthology.orchestra.run.smithi008.stdout: "event": "commit_sent", 2023-08-01T19:54:59.344 INFO:teuthology.orchestra.run.smithi008.stdout: "time": "2023-08-01T19:54:51.873803+0000", 2023-08-01T19:54:59.344 INFO:teuthology.orchestra.run.smithi008.stdout: "duration": 3.9873999999999998e-05 2023-08-01T19:54:59.344 INFO:teuthology.orchestra.run.smithi008.stdout: }, 2023-08-01T19:54:59.344 INFO:teuthology.orchestra.run.smithi008.stdout: { 2023-08-01T19:54:59.344 INFO:teuthology.orchestra.run.smithi008.stdout: "event": "done", 2023-08-01T19:54:59.345 INFO:teuthology.orchestra.run.smithi008.stdout: "time": "2023-08-01T19:54:51.873835+0000", 2023-08-01T19:54:59.345 INFO:teuthology.orchestra.run.smithi008.stdout: "duration": 3.2700999999999997e-05 2023-08-01T19:54:59.345 INFO:teuthology.orchestra.run.smithi008.stdout: } 2023-08-01T19:54:59.345 INFO:teuthology.orchestra.run.smithi008.stdout: ] 2023-08-01T19:54:59.345 INFO:teuthology.orchestra.run.smithi008.stdout: } 2023-08-01T19:54:59.345 INFO:teuthology.orchestra.run.smithi008.stdout: }, 2023-08-01T19:54:59.345 INFO:teuthology.orchestra.run.smithi008.stdout: { 2023-08-01T19:54:59.346 INFO:teuthology.orchestra.run.smithi008.stdout: "description": "osd_op(client.4668.0:75014 5.c 5:3d8cba0f:::benchmark_data_smithi006_114134_object75013:head [set-alloc-hint object_size 65536 write_size 65536,write 0~65536] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e32)", 2023-08-01T19:54:59.346 INFO:teuthology.orchestra.run.smithi008.stdout: "initiated_at": "2023-08-01T19:54:52.218900+0000", 2023-08-01T19:54:59.346 INFO:teuthology.orchestra.run.smithi008.stdout: "age": 7.0311092159999999, 2023-08-01T19:54:59.346 INFO:teuthology.orchestra.run.smithi008.stdout: "duration": 0.015819357999999999, 2023-08-01T19:54:59.346 INFO:teuthology.orchestra.run.smithi008.stdout: "type_data": { 2023-08-01T19:54:59.346 INFO:teuthology.orchestra.run.smithi008.stdout: "flag_point": "commit sent; apply or cleanup", 2023-08-01T19:54:59.346 INFO:teuthology.orchestra.run.smithi008.stdout: "client_info": { 2023-08-01T19:54:59.346 INFO:teuthology.orchestra.run.smithi008.stdout: "client": "client.4668", 2023-08-01T19:54:59.347 INFO:teuthology.orchestra.run.smithi008.stdout: "client_addr": "172.21.15.6:0/1709472247", 2023-08-01T19:54:59.347 INFO:teuthology.orchestra.run.smithi008.stdout: "tid": 75014 2023-08-01T19:54:59.347 INFO:teuthology.orchestra.run.smithi008.stdout: }, 2023-08-01T19:54:59.347 INFO:teuthology.orchestra.run.smithi008.stdout: "events": [ 2023-08-01T19:54:59.347 INFO:teuthology.orchestra.run.smithi008.stdout: { 2023-08-01T19:54:59.347 INFO:teuthology.orchestra.run.smithi008.stdout: "event": "initiated", 2023-08-01T19:54:59.347 INFO:teuthology.orchestra.run.smithi008.stdout: "time": "2023-08-01T19:54:52.218900+0000", 2023-08-01T19:54:59.348 INFO:teuthology.orchestra.run.smithi008.stdout: "duration": 0 2023-08-01T19:54:59.348 INFO:teuthology.orchestra.run.smithi008.stdout: }, 2023-08-01T19:54:59.348 INFO:teuthology.orchestra.run.smithi008.stdout: { 2023-08-01T19:54:59.348 INFO:teuthology.orchestra.run.smithi008.stdout: "event": "throttled", 2023-08-01T19:54:59.348 INFO:teuthology.orchestra.run.smithi008.stdout: "time": "2023-08-01T19:54:52.218900+0000", 2023-08-01T19:54:59.348 INFO:teuthology.orchestra.run.smithi008.stdout: "duration": 0 2023-08-01T19:54:59.348 INFO:teuthology.orchestra.run.smithi008.stdout: }, 2023-08-01T19:54:59.349 INFO:teuthology.orchestra.run.smithi008.stdout: { 2023-08-01T19:54:59.349 INFO:teuthology.orchestra.run.smithi008.stdout: "event": "header_read", 2023-08-01T19:54:59.349 INFO:teuthology.orchestra.run.smithi008.stdout: "time": "2023-08-01T19:54:52.218899+0000", 2023-08-01T19:54:59.349 INFO:teuthology.orchestra.run.smithi008.stdout: "duration": 4294967295.999999 2023-08-01T19:54:59.349 INFO:teuthology.orchestra.run.smithi008.stdout: }, 2023-08-01T19:54:59.349 INFO:teuthology.orchestra.run.smithi008.stdout: { 2023-08-01T19:54:59.349 INFO:teuthology.orchestra.run.smithi008.stdout: "event": "all_read", 2023-08-01T19:54:59.349 INFO:teuthology.orchestra.run.smithi008.stdout: "time": "2023-08-01T19:54:52.218930+0000", 2023-08-01T19:54:59.350 INFO:teuthology.orchestra.run.smithi008.stdout: "duration": 3.1211999999999999e-05 2023-08-01T19:54:59.350 INFO:teuthology.orchestra.run.smithi008.stdout: }, 2023-08-01T19:54:59.350 INFO:teuthology.orchestra.run.smithi008.stdout: { 2023-08-01T19:54:59.350 INFO:teuthology.orchestra.run.smithi008.stdout: "event": "dispatched", 2023-08-01T19:54:59.350 INFO:teuthology.orchestra.run.smithi008.stdout: "time": "2023-08-01T19:54:52.218938+0000", 2023-08-01T19:54:59.350 INFO:teuthology.orchestra.run.smithi008.stdout: "duration": 8.1850000000000004e-06 2023-08-01T19:54:59.350 INFO:teuthology.orchestra.run.smithi008.stdout: }, 2023-08-01T19:54:59.351 INFO:teuthology.orchestra.run.smithi008.stdout: { 2023-08-01T19:54:59.351 INFO:teuthology.orchestra.run.smithi008.stdout: "event": "queued_for_pg", 2023-08-01T19:54:59.351 INFO:teuthology.orchestra.run.smithi008.stdout: "time": "2023-08-01T19:54:52.218946+0000", 2023-08-01T19:54:59.351 INFO:teuthology.orchestra.run.smithi008.stdout: "duration": 7.272e-06 2023-08-01T19:54:59.351 INFO:teuthology.orchestra.run.smithi008.stdout: }, 2023-08-01T19:54:59.351 INFO:teuthology.orchestra.run.smithi008.stdout: { 2023-08-01T19:54:59.351 INFO:teuthology.orchestra.run.smithi008.stdout: "event": "reached_pg", 2023-08-01T19:54:59.351 INFO:teuthology.orchestra.run.smithi008.stdout: "time": "2023-08-01T19:54:52.218984+0000", 2023-08-01T19:54:59.352 INFO:teuthology.orchestra.run.smithi008.stdout: "duration": 3.8566000000000003e-05 2023-08-01T19:54:59.352 INFO:teuthology.orchestra.run.smithi008.stdout: }, 2023-08-01T19:54:59.352 INFO:teuthology.orchestra.run.smithi008.stdout: { 2023-08-01T19:54:59.352 INFO:teuthology.orchestra.run.smithi008.stdout: "event": "started", 2023-08-01T19:54:59.352 INFO:teuthology.orchestra.run.smithi008.stdout: "time": "2023-08-01T19:54:52.219093+0000", 2023-08-01T19:54:59.352 INFO:teuthology.orchestra.run.smithi008.stdout: "duration": 0.00010921000000000001 2023-08-01T19:54:59.352 INFO:teuthology.orchestra.run.smithi008.stdout: }, 2023-08-01T19:54:59.352 INFO:teuthology.orchestra.run.smithi008.stdout: { 2023-08-01T19:54:59.353 INFO:teuthology.orchestra.run.smithi008.stdout: "event": "waiting for subops from 1", 2023-08-01T19:54:59.353 INFO:teuthology.orchestra.run.smithi008.stdout: "time": "2023-08-01T19:54:52.219206+0000", 2023-08-01T19:54:59.353 INFO:teuthology.orchestra.run.smithi008.stdout: "duration": 0.00011312299999999999 2023-08-01T19:54:59.353 INFO:teuthology.orchestra.run.smithi008.stdout: }, 2023-08-01T19:54:59.353 INFO:teuthology.orchestra.run.smithi008.stdout: { 2023-08-01T19:54:59.353 INFO:teuthology.orchestra.run.smithi008.stdout: "event": "sub_op_commit_rec", 2023-08-01T19:54:59.353 INFO:teuthology.orchestra.run.smithi008.stdout: "time": "2023-08-01T19:54:52.224966+0000", 2023-08-01T19:54:59.353 INFO:teuthology.orchestra.run.smithi008.stdout: "duration": 0.0057594300000000003 2023-08-01T19:54:59.354 INFO:teuthology.orchestra.run.smithi008.stdout: }, 2023-08-01T19:54:59.354 INFO:teuthology.orchestra.run.smithi008.stdout: { 2023-08-01T19:54:59.354 INFO:teuthology.orchestra.run.smithi008.stdout: "event": "op_commit", 2023-08-01T19:54:59.354 INFO:teuthology.orchestra.run.smithi008.stdout: "time": "2023-08-01T19:54:52.234622+0000", 2023-08-01T19:54:59.354 INFO:teuthology.orchestra.run.smithi008.stdout: "duration": 0.0096563919999999998 2023-08-01T19:54:59.354 INFO:teuthology.orchestra.run.smithi008.stdout: }, 2023-08-01T19:54:59.354 INFO:teuthology.orchestra.run.smithi008.stdout: { 2023-08-01T19:54:59.355 INFO:teuthology.orchestra.run.smithi008.stdout: "event": "commit_sent", 2023-08-01T19:54:59.355 INFO:teuthology.orchestra.run.smithi008.stdout: "time": "2023-08-01T19:54:52.234674+0000", 2023-08-01T19:54:59.355 INFO:teuthology.orchestra.run.smithi008.stdout: "duration": 5.2212000000000001e-05 2023-08-01T19:54:59.355 INFO:teuthology.orchestra.run.smithi008.stdout: }, 2023-08-01T19:54:59.355 INFO:teuthology.orchestra.run.smithi008.stdout: { 2023-08-01T19:54:59.355 INFO:teuthology.orchestra.run.smithi008.stdout: "event": "done", 2023-08-01T19:54:59.355 INFO:teuthology.orchestra.run.smithi008.stdout: "time": "2023-08-01T19:54:52.234719+0000", 2023-08-01T19:54:59.355 INFO:teuthology.orchestra.run.smithi008.stdout: "duration": 4.4666000000000002e-05 2023-08-01T19:54:59.356 INFO:teuthology.orchestra.run.smithi008.stdout: } 2023-08-01T19:54:59.356 INFO:teuthology.orchestra.run.smithi008.stdout: ] 2023-08-01T19:54:59.356 INFO:teuthology.orchestra.run.smithi008.stdout: } 2023-08-01T19:54:59.356 INFO:teuthology.orchestra.run.smithi008.stdout: }, 2023-08-01T19:54:59.356 INFO:teuthology.orchestra.run.smithi008.stdout: { 2023-08-01T19:54:59.356 INFO:teuthology.orchestra.run.smithi008.stdout: "description": "osd_op(client.4668.0:75016 5.c 5:3bdd56bb:::benchmark_data_smithi006_114134_object75015:head [set-alloc-hint object_size 65536 write_size 65536,write 0~65536] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e32)", 2023-08-01T19:54:59.356 INFO:teuthology.orchestra.run.smithi008.stdout: "initiated_at": "2023-08-01T19:54:52.219222+0000", 2023-08-01T19:54:59.356 INFO:teuthology.orchestra.run.smithi008.stdout: "age": 7.0307874379999999, 2023-08-01T19:54:59.357 INFO:teuthology.orchestra.run.smithi008.stdout: "duration": 0.01558884, 2023-08-01T19:54:59.357 INFO:teuthology.orchestra.run.smithi008.stdout: "type_data": { 2023-08-01T19:54:59.357 INFO:teuthology.orchestra.run.smithi008.stdout: "flag_point": "commit sent; apply or cleanup", 2023-08-01T19:54:59.357 INFO:teuthology.orchestra.run.smithi008.stdout: "client_info": { 2023-08-01T19:54:59.357 INFO:teuthology.orchestra.run.smithi008.stdout: "client": "client.4668", 2023-08-01T19:54:59.357 INFO:teuthology.orchestra.run.smithi008.stdout: "client_addr": "172.21.15.6:0/1709472247", 2023-08-01T19:54:59.357 INFO:teuthology.orchestra.run.smithi008.stdout: "tid": 75016 2023-08-01T19:54:59.357 INFO:teuthology.orchestra.run.smithi008.stdout: }, 2023-08-01T19:54:59.358 INFO:teuthology.orchestra.run.smithi008.stdout: "events": [ 2023-08-01T19:54:59.358 INFO:teuthology.orchestra.run.smithi008.stdout: { 2023-08-01T19:54:59.358 INFO:teuthology.orchestra.run.smithi008.stdout: "event": "initiated", 2023-08-01T19:54:59.358 INFO:teuthology.orchestra.run.smithi008.stdout: "time": "2023-08-01T19:54:52.219222+0000", 2023-08-01T19:54:59.358 INFO:teuthology.orchestra.run.smithi008.stdout: "duration": 0 2023-08-01T19:54:59.358 INFO:teuthology.orchestra.run.smithi008.stdout: }, 2023-08-01T19:54:59.358 INFO:teuthology.orchestra.run.smithi008.stdout: { 2023-08-01T19:54:59.359 INFO:teuthology.orchestra.run.smithi008.stdout: "event": "throttled", 2023-08-01T19:54:59.359 INFO:teuthology.orchestra.run.smithi008.stdout: "time": "2023-08-01T19:54:52.219222+0000", 2023-08-01T19:54:59.359 INFO:teuthology.orchestra.run.smithi008.stdout: "duration": 0 2023-08-01T19:54:59.359 INFO:teuthology.orchestra.run.smithi008.stdout: }, 2023-08-01T19:54:59.359 INFO:teuthology.orchestra.run.smithi008.stdout: { 2023-08-01T19:54:59.359 INFO:teuthology.orchestra.run.smithi008.stdout: "event": "header_read", 2023-08-01T19:54:59.359 INFO:teuthology.orchestra.run.smithi008.stdout: "time": "2023-08-01T19:54:52.219221+0000", 2023-08-01T19:54:59.359 INFO:teuthology.orchestra.run.smithi008.stdout: "duration": 4294967295.999999 2023-08-01T19:54:59.360 INFO:teuthology.orchestra.run.smithi008.stdout: }, 2023-08-01T19:54:59.360 INFO:teuthology.orchestra.run.smithi008.stdout: { 2023-08-01T19:54:59.360 INFO:teuthology.orchestra.run.smithi008.stdout: "event": "all_read", 2023-08-01T19:54:59.360 INFO:teuthology.orchestra.run.smithi008.stdout: "time": "2023-08-01T19:54:52.219378+0000", 2023-08-01T19:54:59.360 INFO:teuthology.orchestra.run.smithi008.stdout: "duration": 0.00015761799999999999 2023-08-01T19:54:59.360 INFO:teuthology.orchestra.run.smithi008.stdout: }, 2023-08-01T19:54:59.360 INFO:teuthology.orchestra.run.smithi008.stdout: { 2023-08-01T19:54:59.361 INFO:teuthology.orchestra.run.smithi008.stdout: "event": "dispatched", 2023-08-01T19:54:59.361 INFO:teuthology.orchestra.run.smithi008.stdout: "time": "2023-08-01T19:54:52.219397+0000", 2023-08-01T19:54:59.361 INFO:teuthology.orchestra.run.smithi008.stdout: "duration": 1.8527000000000001e-05 2023-08-01T19:54:59.361 INFO:teuthology.orchestra.run.smithi008.stdout: }, 2023-08-01T19:54:59.361 INFO:teuthology.orchestra.run.smithi008.stdout: { 2023-08-01T19:54:59.361 INFO:teuthology.orchestra.run.smithi008.stdout: "event": "queued_for_pg", 2023-08-01T19:54:59.361 INFO:teuthology.orchestra.run.smithi008.stdout: "time": "2023-08-01T19:54:52.219403+0000", 2023-08-01T19:54:59.362 INFO:teuthology.orchestra.run.smithi008.stdout: "duration": 5.9909999999999999e-06 2023-08-01T19:54:59.362 INFO:teuthology.orchestra.run.smithi008.stdout: }, 2023-08-01T19:54:59.362 INFO:teuthology.orchestra.run.smithi008.stdout: { 2023-08-01T19:54:59.362 INFO:teuthology.orchestra.run.smithi008.stdout: "event": "reached_pg", 2023-08-01T19:54:59.362 INFO:teuthology.orchestra.run.smithi008.stdout: "time": "2023-08-01T19:54:52.222379+0000", 2023-08-01T19:54:59.362 INFO:teuthology.orchestra.run.smithi008.stdout: "duration": 0.002975966 2023-08-01T19:54:59.362 INFO:teuthology.orchestra.run.smithi008.stdout: }, 2023-08-01T19:54:59.362 INFO:teuthology.orchestra.run.smithi008.stdout: { 2023-08-01T19:54:59.363 INFO:teuthology.orchestra.run.smithi008.stdout: "event": "started", 2023-08-01T19:54:59.363 INFO:teuthology.orchestra.run.smithi008.stdout: "time": "2023-08-01T19:54:52.222541+0000", 2023-08-01T19:54:59.363 INFO:teuthology.orchestra.run.smithi008.stdout: "duration": 0.000161986 2023-08-01T19:54:59.363 INFO:teuthology.orchestra.run.smithi008.stdout: }, 2023-08-01T19:54:59.363 INFO:teuthology.orchestra.run.smithi008.stdout: { 2023-08-01T19:54:59.363 INFO:teuthology.orchestra.run.smithi008.stdout: "event": "waiting for subops from 1", 2023-08-01T19:54:59.363 INFO:teuthology.orchestra.run.smithi008.stdout: "time": "2023-08-01T19:54:52.222709+0000", 2023-08-01T19:54:59.363 INFO:teuthology.orchestra.run.smithi008.stdout: "duration": 0.00016778299999999999 2023-08-01T19:54:59.364 INFO:teuthology.orchestra.run.smithi008.stdout: }, 2023-08-01T19:54:59.364 INFO:teuthology.orchestra.run.smithi008.stdout: { 2023-08-01T19:54:59.364 INFO:teuthology.orchestra.run.smithi008.stdout: "event": "sub_op_commit_rec", 2023-08-01T19:54:59.364 INFO:teuthology.orchestra.run.smithi008.stdout: "time": "2023-08-01T19:54:52.226832+0000", 2023-08-01T19:54:59.364 INFO:teuthology.orchestra.run.smithi008.stdout: "duration": 0.004122967 2023-08-01T19:54:59.364 INFO:teuthology.orchestra.run.smithi008.stdout: }, 2023-08-01T19:54:59.364 INFO:teuthology.orchestra.run.smithi008.stdout: { 2023-08-01T19:54:59.365 INFO:teuthology.orchestra.run.smithi008.stdout: "event": "op_commit", 2023-08-01T19:54:59.365 INFO:teuthology.orchestra.run.smithi008.stdout: "time": "2023-08-01T19:54:52.234730+0000", 2023-08-01T19:54:59.365 INFO:teuthology.orchestra.run.smithi008.stdout: "duration": 0.0078985559999999993 2023-08-01T19:54:59.365 INFO:teuthology.orchestra.run.smithi008.stdout: }, 2023-08-01T19:54:59.365 INFO:teuthology.orchestra.run.smithi008.stdout: { 2023-08-01T19:54:59.365 INFO:teuthology.orchestra.run.smithi008.stdout: "event": "commit_sent", 2023-08-01T19:54:59.365 INFO:teuthology.orchestra.run.smithi008.stdout: "time": "2023-08-01T19:54:52.234774+0000", 2023-08-01T19:54:59.365 INFO:teuthology.orchestra.run.smithi008.stdout: "duration": 4.3819000000000002e-05 2023-08-01T19:54:59.366 INFO:teuthology.orchestra.run.smithi008.stdout: }, 2023-08-01T19:54:59.366 INFO:teuthology.orchestra.run.smithi008.stdout: { 2023-08-01T19:54:59.366 INFO:teuthology.orchestra.run.smithi008.stdout: "event": "done", 2023-08-01T19:54:59.366 INFO:teuthology.orchestra.run.smithi008.stdout: "time": "2023-08-01T19:54:52.234810+0000", 2023-08-01T19:54:59.366 INFO:teuthology.orchestra.run.smithi008.stdout: "duration": 3.6486999999999998e-05 2023-08-01T19:54:59.366 INFO:teuthology.orchestra.run.smithi008.stdout: } 2023-08-01T19:54:59.366 INFO:teuthology.orchestra.run.smithi008.stdout: ] 2023-08-01T19:54:59.366 INFO:teuthology.orchestra.run.smithi008.stdout: } 2023-08-01T19:54:59.367 INFO:teuthology.orchestra.run.smithi008.stdout: }, 2023-08-01T19:54:59.367 INFO:teuthology.orchestra.run.smithi008.stdout: { 2023-08-01T19:54:59.367 INFO:teuthology.orchestra.run.smithi008.stdout: "description": "osd_op(client.4668.0:75018 5.c 5:337cd9ad:::benchmark_data_smithi006_114134_object75017:head [set-alloc-hint object_size 65536 write_size 65536,write 0~65536] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e32)", 2023-08-01T19:54:59.367 INFO:teuthology.orchestra.run.smithi008.stdout: "initiated_at": "2023-08-01T19:54:52.219412+0000", 2023-08-01T19:54:59.367 INFO:teuthology.orchestra.run.smithi008.stdout: "age": 7.0305966729999998, 2023-08-01T19:54:59.367 INFO:teuthology.orchestra.run.smithi008.stdout: "duration": 0.021247918000000001, 2023-08-01T19:54:59.367 INFO:teuthology.orchestra.run.smithi008.stdout: "type_data": { 2023-08-01T19:54:59.367 INFO:teuthology.orchestra.run.smithi008.stdout: "flag_point": "commit sent; apply or cleanup", 2023-08-01T19:54:59.368 INFO:teuthology.orchestra.run.smithi008.stdout: "client_info": { 2023-08-01T19:54:59.368 INFO:teuthology.orchestra.run.smithi008.stdout: "client": "client.4668", 2023-08-01T19:54:59.368 INFO:teuthology.orchestra.run.smithi008.stdout: "client_addr": "172.21.15.6:0/1709472247", 2023-08-01T19:54:59.368 INFO:teuthology.orchestra.run.smithi008.stdout: "tid": 75018 2023-08-01T19:54:59.368 INFO:teuthology.orchestra.run.smithi008.stdout: }, 2023-08-01T19:54:59.368 INFO:teuthology.orchestra.run.smithi008.stdout: "events": [ 2023-08-01T19:54:59.368 INFO:teuthology.orchestra.run.smithi008.stdout: { 2023-08-01T19:54:59.369 INFO:teuthology.orchestra.run.smithi008.stdout: "event": "initiated", 2023-08-01T19:54:59.369 INFO:teuthology.orchestra.run.smithi008.stdout: "time": "2023-08-01T19:54:52.219412+0000", 2023-08-01T19:54:59.369 INFO:teuthology.orchestra.run.smithi008.stdout: "duration": 0 2023-08-01T19:54:59.369 INFO:teuthology.orchestra.run.smithi008.stdout: }, 2023-08-01T19:54:59.369 INFO:teuthology.orchestra.run.smithi008.stdout: { 2023-08-01T19:54:59.369 INFO:teuthology.orchestra.run.smithi008.stdout: "event": "throttled", 2023-08-01T19:54:59.369 INFO:teuthology.orchestra.run.smithi008.stdout: "time": "2023-08-01T19:54:52.219412+0000", 2023-08-01T19:54:59.369 INFO:teuthology.orchestra.run.smithi008.stdout: "duration": 0 2023-08-01T19:54:59.370 INFO:teuthology.orchestra.run.smithi008.stdout: }, 2023-08-01T19:54:59.370 INFO:teuthology.orchestra.run.smithi008.stdout: { 2023-08-01T19:54:59.370 INFO:teuthology.orchestra.run.smithi008.stdout: "event": "header_read", 2023-08-01T19:54:59.370 INFO:teuthology.orchestra.run.smithi008.stdout: "time": "2023-08-01T19:54:52.219412+0000", 2023-08-01T19:54:59.370 INFO:teuthology.orchestra.run.smithi008.stdout: "duration": 4294967295.999999 2023-08-01T19:54:59.370 INFO:teuthology.orchestra.run.smithi008.stdout: }, 2023-08-01T19:54:59.370 INFO:teuthology.orchestra.run.smithi008.stdout: { 2023-08-01T19:54:59.370 INFO:teuthology.orchestra.run.smithi008.stdout: "event": "all_read", 2023-08-01T19:54:59.371 INFO:teuthology.orchestra.run.smithi008.stdout: "time": "2023-08-01T19:54:52.219529+0000", 2023-08-01T19:54:59.371 INFO:teuthology.orchestra.run.smithi008.stdout: "duration": 0.000117207 2023-08-01T19:54:59.371 INFO:teuthology.orchestra.run.smithi008.stdout: }, 2023-08-01T19:54:59.371 INFO:teuthology.orchestra.run.smithi008.stdout: { 2023-08-01T19:54:59.371 INFO:teuthology.orchestra.run.smithi008.stdout: "event": "dispatched", 2023-08-01T19:54:59.371 INFO:teuthology.orchestra.run.smithi008.stdout: "time": "2023-08-01T19:54:52.219541+0000", 2023-08-01T19:54:59.371 INFO:teuthology.orchestra.run.smithi008.stdout: "duration": 1.2448e-05 2023-08-01T19:54:59.371 INFO:teuthology.orchestra.run.smithi008.stdout: }, 2023-08-01T19:54:59.372 INFO:teuthology.orchestra.run.smithi008.stdout: { 2023-08-01T19:54:59.372 INFO:teuthology.orchestra.run.smithi008.stdout: "event": "queued_for_pg", 2023-08-01T19:54:59.372 INFO:teuthology.orchestra.run.smithi008.stdout: "time": "2023-08-01T19:54:52.219547+0000", 2023-08-01T19:54:59.372 INFO:teuthology.orchestra.run.smithi008.stdout: "duration": 5.7899999999999996e-06 2023-08-01T19:54:59.372 INFO:teuthology.orchestra.run.smithi008.stdout: }, 2023-08-01T19:54:59.372 INFO:teuthology.orchestra.run.smithi008.stdout: { 2023-08-01T19:54:59.372 INFO:teuthology.orchestra.run.smithi008.stdout: "event": "reached_pg", 2023-08-01T19:54:59.373 INFO:teuthology.orchestra.run.smithi008.stdout: "time": "2023-08-01T19:54:52.228949+0000", 2023-08-01T19:54:59.373 INFO:teuthology.orchestra.run.smithi008.stdout: "duration": 0.009401754 2023-08-01T19:54:59.373 INFO:teuthology.orchestra.run.smithi008.stdout: }, 2023-08-01T19:54:59.373 INFO:teuthology.orchestra.run.smithi008.stdout: { 2023-08-01T19:54:59.373 INFO:teuthology.orchestra.run.smithi008.stdout: "event": "started", 2023-08-01T19:54:59.373 INFO:teuthology.orchestra.run.smithi008.stdout: "time": "2023-08-01T19:54:52.229103+0000", 2023-08-01T19:54:59.373 INFO:teuthology.orchestra.run.smithi008.stdout: "duration": 0.00015462399999999999 2023-08-01T19:54:59.373 INFO:teuthology.orchestra.run.smithi008.stdout: }, 2023-08-01T19:54:59.374 INFO:teuthology.orchestra.run.smithi008.stdout: { 2023-08-01T19:54:59.374 INFO:teuthology.orchestra.run.smithi008.stdout: "event": "waiting for subops from 1", 2023-08-01T19:54:59.374 INFO:teuthology.orchestra.run.smithi008.stdout: "time": "2023-08-01T19:54:52.229261+0000", 2023-08-01T19:54:59.374 INFO:teuthology.orchestra.run.smithi008.stdout: "duration": 0.00015758300000000001 2023-08-01T19:54:59.374 INFO:teuthology.orchestra.run.smithi008.stdout: }, 2023-08-01T19:54:59.374 INFO:teuthology.orchestra.run.smithi008.stdout: { 2023-08-01T19:54:59.374 INFO:teuthology.orchestra.run.smithi008.stdout: "event": "sub_op_commit_rec", 2023-08-01T19:54:59.374 INFO:teuthology.orchestra.run.smithi008.stdout: "time": "2023-08-01T19:54:52.234395+0000", 2023-08-01T19:54:59.375 INFO:teuthology.orchestra.run.smithi008.stdout: "duration": 0.0051335080000000002 2023-08-01T19:54:59.375 INFO:teuthology.orchestra.run.smithi008.stdout: }, 2023-08-01T19:54:59.375 INFO:teuthology.orchestra.run.smithi008.stdout: { 2023-08-01T19:54:59.375 INFO:teuthology.orchestra.run.smithi008.stdout: "event": "op_commit", 2023-08-01T19:54:59.375 INFO:teuthology.orchestra.run.smithi008.stdout: "time": "2023-08-01T19:54:52.240575+0000", 2023-08-01T19:54:59.375 INFO:teuthology.orchestra.run.smithi008.stdout: "duration": 0.0061804099999999999 2023-08-01T19:54:59.375 INFO:teuthology.orchestra.run.smithi008.stdout: }, 2023-08-01T19:54:59.375 INFO:teuthology.orchestra.run.smithi008.stdout: { 2023-08-01T19:54:59.376 INFO:teuthology.orchestra.run.smithi008.stdout: "event": "commit_sent", 2023-08-01T19:54:59.376 INFO:teuthology.orchestra.run.smithi008.stdout: "time": "2023-08-01T19:54:52.240620+0000", 2023-08-01T19:54:59.376 INFO:teuthology.orchestra.run.smithi008.stdout: "duration": 4.4972999999999998e-05 2023-08-01T19:54:59.376 INFO:teuthology.orchestra.run.smithi008.stdout: }, 2023-08-01T19:54:59.376 INFO:teuthology.orchestra.run.smithi008.stdout: { 2023-08-01T19:54:59.376 INFO:teuthology.orchestra.run.smithi008.stdout: "event": "done", 2023-08-01T19:54:59.376 INFO:teuthology.orchestra.run.smithi008.stdout: "time": "2023-08-01T19:54:52.240660+0000", 2023-08-01T19:54:59.376 INFO:teuthology.orchestra.run.smithi008.stdout: "duration": 4.0348000000000001e-05 2023-08-01T19:54:59.377 INFO:teuthology.orchestra.run.smithi008.stdout: } 2023-08-01T19:54:59.377 INFO:teuthology.orchestra.run.smithi008.stdout: ] 2023-08-01T19:54:59.377 INFO:teuthology.orchestra.run.smithi008.stdout: } 2023-08-01T19:54:59.377 INFO:teuthology.orchestra.run.smithi008.stdout: }, 2023-08-01T19:54:59.377 INFO:teuthology.orchestra.run.smithi008.stdout: { 2023-08-01T19:54:59.377 INFO:teuthology.orchestra.run.smithi008.stdout: "description": "osd_repop(client.4668.0:75022 5.4 e32/19 5:20404e0b:::benchmark_data_smithi006_114134_object75021:head v 32'4630, mlcod=32'4627)", 2023-08-01T19:54:59.377 INFO:teuthology.orchestra.run.smithi008.stdout: "initiated_at": "2023-08-01T19:54:52.221931+0000", 2023-08-01T19:54:59.378 INFO:teuthology.orchestra.run.smithi008.stdout: "age": 7.028077584, 2023-08-01T19:54:59.378 INFO:teuthology.orchestra.run.smithi008.stdout: "duration": 0.018596688, 2023-08-01T19:54:59.378 INFO:teuthology.orchestra.run.smithi008.stdout: "type_data": { 2023-08-01T19:54:59.378 INFO:teuthology.orchestra.run.smithi008.stdout: "flag_point": "commit sent; apply or cleanup", 2023-08-01T19:54:59.378 INFO:teuthology.orchestra.run.smithi008.stdout: "events": [ 2023-08-01T19:54:59.378 INFO:teuthology.orchestra.run.smithi008.stdout: { 2023-08-01T19:54:59.378 INFO:teuthology.orchestra.run.smithi008.stdout: "event": "initiated", 2023-08-01T19:54:59.378 INFO:teuthology.orchestra.run.smithi008.stdout: "time": "2023-08-01T19:54:52.221931+0000", 2023-08-01T19:54:59.379 INFO:teuthology.orchestra.run.smithi008.stdout: "duration": 0 2023-08-01T19:54:59.379 INFO:teuthology.orchestra.run.smithi008.stdout: }, 2023-08-01T19:54:59.379 INFO:teuthology.orchestra.run.smithi008.stdout: { 2023-08-01T19:54:59.379 INFO:teuthology.orchestra.run.smithi008.stdout: "event": "throttled", 2023-08-01T19:54:59.379 INFO:teuthology.orchestra.run.smithi008.stdout: "time": "2023-08-01T19:54:52.221931+0000", 2023-08-01T19:54:59.379 INFO:teuthology.orchestra.run.smithi008.stdout: "duration": 0 2023-08-01T19:54:59.379 INFO:teuthology.orchestra.run.smithi008.stdout: }, 2023-08-01T19:54:59.379 INFO:teuthology.orchestra.run.smithi008.stdout: { 2023-08-01T19:54:59.380 INFO:teuthology.orchestra.run.smithi008.stdout: "event": "header_read", 2023-08-01T19:54:59.380 INFO:teuthology.orchestra.run.smithi008.stdout: "time": "2023-08-01T19:54:52.221931+0000", 2023-08-01T19:54:59.380 INFO:teuthology.orchestra.run.smithi008.stdout: "duration": 4294967295.9999995 2023-08-01T19:54:59.380 INFO:teuthology.orchestra.run.smithi008.stdout: }, 2023-08-01T19:54:59.380 INFO:teuthology.orchestra.run.smithi008.stdout: { 2023-08-01T19:54:59.380 INFO:teuthology.orchestra.run.smithi008.stdout: "event": "all_read", 2023-08-01T19:54:59.380 INFO:teuthology.orchestra.run.smithi008.stdout: "time": "2023-08-01T19:54:52.222002+0000", 2023-08-01T19:54:59.380 INFO:teuthology.orchestra.run.smithi008.stdout: "duration": 7.0870000000000004e-05 2023-08-01T19:54:59.381 INFO:teuthology.orchestra.run.smithi008.stdout: }, 2023-08-01T19:54:59.381 INFO:teuthology.orchestra.run.smithi008.stdout: { 2023-08-01T19:54:59.381 INFO:teuthology.orchestra.run.smithi008.stdout: "event": "dispatched", 2023-08-01T19:54:59.381 INFO:teuthology.orchestra.run.smithi008.stdout: "time": "2023-08-01T19:54:52.222015+0000", 2023-08-01T19:54:59.381 INFO:teuthology.orchestra.run.smithi008.stdout: "duration": 1.327e-05 2023-08-01T19:54:59.381 INFO:teuthology.orchestra.run.smithi008.stdout: }, 2023-08-01T19:54:59.381 INFO:teuthology.orchestra.run.smithi008.stdout: { 2023-08-01T19:54:59.381 INFO:teuthology.orchestra.run.smithi008.stdout: "event": "queued_for_pg", 2023-08-01T19:54:59.382 INFO:teuthology.orchestra.run.smithi008.stdout: "time": "2023-08-01T19:54:52.222022+0000", 2023-08-01T19:54:59.382 INFO:teuthology.orchestra.run.smithi008.stdout: "duration": 7.1729999999999998e-06 2023-08-01T19:54:59.382 INFO:teuthology.orchestra.run.smithi008.stdout: }, 2023-08-01T19:54:59.382 INFO:teuthology.orchestra.run.smithi008.stdout: { 2023-08-01T19:54:59.382 INFO:teuthology.orchestra.run.smithi008.stdout: "event": "reached_pg", 2023-08-01T19:54:59.382 INFO:teuthology.orchestra.run.smithi008.stdout: "time": "2023-08-01T19:54:52.224857+0000", 2023-08-01T19:54:59.382 INFO:teuthology.orchestra.run.smithi008.stdout: "duration": 0.0028351600000000002 2023-08-01T19:54:59.382 INFO:teuthology.orchestra.run.smithi008.stdout: }, 2023-08-01T19:54:59.383 INFO:teuthology.orchestra.run.smithi008.stdout: { 2023-08-01T19:54:59.383 INFO:teuthology.orchestra.run.smithi008.stdout: "event": "started", 2023-08-01T19:54:59.383 INFO:teuthology.orchestra.run.smithi008.stdout: "time": "2023-08-01T19:54:52.224877+0000", 2023-08-01T19:54:59.383 INFO:teuthology.orchestra.run.smithi008.stdout: "duration": 1.9839000000000001e-05 2023-08-01T19:54:59.383 INFO:teuthology.orchestra.run.smithi008.stdout: }, 2023-08-01T19:54:59.383 INFO:teuthology.orchestra.run.smithi008.stdout: { 2023-08-01T19:54:59.383 INFO:teuthology.orchestra.run.smithi008.stdout: "event": "commit_sent", 2023-08-01T19:54:59.384 INFO:teuthology.orchestra.run.smithi008.stdout: "time": "2023-08-01T19:54:52.240497+0000", 2023-08-01T19:54:59.384 INFO:teuthology.orchestra.run.smithi008.stdout: "duration": 0.015619928 2023-08-01T19:54:59.384 INFO:teuthology.orchestra.run.smithi008.stdout: }, 2023-08-01T19:54:59.384 INFO:teuthology.orchestra.run.smithi008.stdout: { 2023-08-01T19:54:59.384 INFO:teuthology.orchestra.run.smithi008.stdout: "event": "done", 2023-08-01T19:54:59.384 INFO:teuthology.orchestra.run.smithi008.stdout: "time": "2023-08-01T19:54:52.240528+0000", 2023-08-01T19:54:59.384 INFO:teuthology.orchestra.run.smithi008.stdout: "duration": 3.1029999999999999e-05 2023-08-01T19:54:59.384 INFO:teuthology.orchestra.run.smithi008.stdout: } 2023-08-01T19:54:59.385 INFO:teuthology.orchestra.run.smithi008.stdout: ] 2023-08-01T19:54:59.385 INFO:teuthology.orchestra.run.smithi008.stdout: } 2023-08-01T19:54:59.385 INFO:teuthology.orchestra.run.smithi008.stdout: }, 2023-08-01T19:54:59.385 INFO:teuthology.orchestra.run.smithi008.stdout: { 2023-08-01T19:54:59.385 INFO:teuthology.orchestra.run.smithi008.stdout: "description": "osd_repop(client.4668.0:75023 5.4 e32/19 5:2ff1db38:::benchmark_data_smithi006_114134_object75022:head v 32'4631, mlcod=32'4627)", 2023-08-01T19:54:59.385 INFO:teuthology.orchestra.run.smithi008.stdout: "initiated_at": "2023-08-01T19:54:52.223928+0000", 2023-08-01T19:54:59.385 INFO:teuthology.orchestra.run.smithi008.stdout: "age": 7.0260810009999997, 2023-08-01T19:54:59.385 INFO:teuthology.orchestra.run.smithi008.stdout: "duration": 0.016622168999999999, 2023-08-01T19:54:59.386 INFO:teuthology.orchestra.run.smithi008.stdout: "type_data": { 2023-08-01T19:54:59.386 INFO:teuthology.orchestra.run.smithi008.stdout: "flag_point": "commit sent; apply or cleanup", 2023-08-01T19:54:59.386 INFO:teuthology.orchestra.run.smithi008.stdout: "events": [ 2023-08-01T19:54:59.386 INFO:teuthology.orchestra.run.smithi008.stdout: { 2023-08-01T19:54:59.386 INFO:teuthology.orchestra.run.smithi008.stdout: "event": "initiated", 2023-08-01T19:54:59.386 INFO:teuthology.orchestra.run.smithi008.stdout: "time": "2023-08-01T19:54:52.223928+0000", 2023-08-01T19:54:59.386 INFO:teuthology.orchestra.run.smithi008.stdout: "duration": 0 2023-08-01T19:54:59.386 INFO:teuthology.orchestra.run.smithi008.stdout: }, 2023-08-01T19:54:59.387 INFO:teuthology.orchestra.run.smithi008.stdout: { 2023-08-01T19:54:59.387 INFO:teuthology.orchestra.run.smithi008.stdout: "event": "throttled", 2023-08-01T19:54:59.387 INFO:teuthology.orchestra.run.smithi008.stdout: "time": "2023-08-01T19:54:52.223928+0000", 2023-08-01T19:54:59.387 INFO:teuthology.orchestra.run.smithi008.stdout: "duration": 0 2023-08-01T19:54:59.387 INFO:teuthology.orchestra.run.smithi008.stdout: }, 2023-08-01T19:54:59.387 INFO:teuthology.orchestra.run.smithi008.stdout: { 2023-08-01T19:54:59.387 INFO:teuthology.orchestra.run.smithi008.stdout: "event": "header_read", 2023-08-01T19:54:59.388 INFO:teuthology.orchestra.run.smithi008.stdout: "time": "2023-08-01T19:54:52.223928+0000", 2023-08-01T19:54:59.388 INFO:teuthology.orchestra.run.smithi008.stdout: "duration": 4294967296 2023-08-01T19:54:59.388 INFO:teuthology.orchestra.run.smithi008.stdout: }, 2023-08-01T19:54:59.388 INFO:teuthology.orchestra.run.smithi008.stdout: { 2023-08-01T19:54:59.388 INFO:teuthology.orchestra.run.smithi008.stdout: "event": "all_read", 2023-08-01T19:54:59.388 INFO:teuthology.orchestra.run.smithi008.stdout: "time": "2023-08-01T19:54:52.223952+0000", 2023-08-01T19:54:59.388 INFO:teuthology.orchestra.run.smithi008.stdout: "duration": 2.4238000000000001e-05 2023-08-01T19:54:59.388 INFO:teuthology.orchestra.run.smithi008.stdout: }, 2023-08-01T19:54:59.389 INFO:teuthology.orchestra.run.smithi008.stdout: { 2023-08-01T19:54:59.389 INFO:teuthology.orchestra.run.smithi008.stdout: "event": "dispatched", 2023-08-01T19:54:59.389 INFO:teuthology.orchestra.run.smithi008.stdout: "time": "2023-08-01T19:54:52.223958+0000", 2023-08-01T19:54:59.389 INFO:teuthology.orchestra.run.smithi008.stdout: "duration": 6.1589999999999998e-06 2023-08-01T19:54:59.389 INFO:teuthology.orchestra.run.smithi008.stdout: }, 2023-08-01T19:54:59.389 INFO:teuthology.orchestra.run.smithi008.stdout: { 2023-08-01T19:54:59.389 INFO:teuthology.orchestra.run.smithi008.stdout: "event": "queued_for_pg", 2023-08-01T19:54:59.389 INFO:teuthology.orchestra.run.smithi008.stdout: "time": "2023-08-01T19:54:52.223962+0000", 2023-08-01T19:54:59.390 INFO:teuthology.orchestra.run.smithi008.stdout: "duration": 3.523e-06 2023-08-01T19:54:59.390 INFO:teuthology.orchestra.run.smithi008.stdout: }, 2023-08-01T19:54:59.390 INFO:teuthology.orchestra.run.smithi008.stdout: { 2023-08-01T19:54:59.390 INFO:teuthology.orchestra.run.smithi008.stdout: "event": "reached_pg", 2023-08-01T19:54:59.390 INFO:teuthology.orchestra.run.smithi008.stdout: "time": "2023-08-01T19:54:52.226856+0000", 2023-08-01T19:54:59.390 INFO:teuthology.orchestra.run.smithi008.stdout: "duration": 0.0028944130000000002 2023-08-01T19:54:59.390 INFO:teuthology.orchestra.run.smithi008.stdout: }, 2023-08-01T19:54:59.391 INFO:teuthology.orchestra.run.smithi008.stdout: { 2023-08-01T19:54:59.391 INFO:teuthology.orchestra.run.smithi008.stdout: "event": "started", 2023-08-01T19:54:59.391 INFO:teuthology.orchestra.run.smithi008.stdout: "time": "2023-08-01T19:54:52.226872+0000", 2023-08-01T19:54:59.391 INFO:teuthology.orchestra.run.smithi008.stdout: "duration": 1.6155e-05 2023-08-01T19:54:59.391 INFO:teuthology.orchestra.run.smithi008.stdout: }, 2023-08-01T19:54:59.391 INFO:teuthology.orchestra.run.smithi008.stdout: { 2023-08-01T19:54:59.391 INFO:teuthology.orchestra.run.smithi008.stdout: "event": "commit_sent", 2023-08-01T19:54:59.391 INFO:teuthology.orchestra.run.smithi008.stdout: "time": "2023-08-01T19:54:52.240533+0000", 2023-08-01T19:54:59.392 INFO:teuthology.orchestra.run.smithi008.stdout: "duration": 0.013660736999999999 2023-08-01T19:54:59.392 INFO:teuthology.orchestra.run.smithi008.stdout: }, 2023-08-01T19:54:59.392 INFO:teuthology.orchestra.run.smithi008.stdout: { 2023-08-01T19:54:59.392 INFO:teuthology.orchestra.run.smithi008.stdout: "event": "done", 2023-08-01T19:54:59.392 INFO:teuthology.orchestra.run.smithi008.stdout: "time": "2023-08-01T19:54:52.240550+0000", 2023-08-01T19:54:59.392 INFO:teuthology.orchestra.run.smithi008.stdout: "duration": 1.7180000000000002e-05 2023-08-01T19:54:59.392 INFO:teuthology.orchestra.run.smithi008.stdout: } 2023-08-01T19:54:59.392 INFO:teuthology.orchestra.run.smithi008.stdout: ] 2023-08-01T19:54:59.393 INFO:teuthology.orchestra.run.smithi008.stdout: } 2023-08-01T19:54:59.393 INFO:teuthology.orchestra.run.smithi008.stdout: }, 2023-08-01T19:54:59.393 INFO:teuthology.orchestra.run.smithi008.stdout: { 2023-08-01T19:54:59.393 INFO:teuthology.orchestra.run.smithi008.stdout: "description": "osd_op(client.4668.0:75029 5.c 5:38b666aa:::benchmark_data_smithi006_114134_object75028:head [set-alloc-hint object_size 65536 write_size 65536,write 0~65536] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e32)", 2023-08-01T19:54:59.393 INFO:teuthology.orchestra.run.smithi008.stdout: "initiated_at": "2023-08-01T19:54:52.224968+0000", 2023-08-01T19:54:59.393 INFO:teuthology.orchestra.run.smithi008.stdout: "age": 7.0250406200000004, 2023-08-01T19:54:59.393 INFO:teuthology.orchestra.run.smithi008.stdout: "duration": 0.015765280999999999, 2023-08-01T19:54:59.394 INFO:teuthology.orchestra.run.smithi008.stdout: "type_data": { 2023-08-01T19:54:59.394 INFO:teuthology.orchestra.run.smithi008.stdout: "flag_point": "commit sent; apply or cleanup", 2023-08-01T19:54:59.394 INFO:teuthology.orchestra.run.smithi008.stdout: "client_info": { 2023-08-01T19:54:59.394 INFO:teuthology.orchestra.run.smithi008.stdout: "client": "client.4668", 2023-08-01T19:54:59.394 INFO:teuthology.orchestra.run.smithi008.stdout: "client_addr": "172.21.15.6:0/1709472247", 2023-08-01T19:54:59.394 INFO:teuthology.orchestra.run.smithi008.stdout: "tid": 75029 2023-08-01T19:54:59.394 INFO:teuthology.orchestra.run.smithi008.stdout: }, 2023-08-01T19:54:59.394 INFO:teuthology.orchestra.run.smithi008.stdout: "events": [ 2023-08-01T19:54:59.395 INFO:teuthology.orchestra.run.smithi008.stdout: { 2023-08-01T19:54:59.395 INFO:teuthology.orchestra.run.smithi008.stdout: "event": "initiated", 2023-08-01T19:54:59.395 INFO:teuthology.orchestra.run.smithi008.stdout: "time": "2023-08-01T19:54:52.224968+0000", 2023-08-01T19:54:59.395 INFO:teuthology.orchestra.run.smithi008.stdout: "duration": 0 2023-08-01T19:54:59.395 INFO:teuthology.orchestra.run.smithi008.stdout: }, 2023-08-01T19:54:59.395 INFO:teuthology.orchestra.run.smithi008.stdout: { 2023-08-01T19:54:59.395 INFO:teuthology.orchestra.run.smithi008.stdout: "event": "throttled", 2023-08-01T19:54:59.395 INFO:teuthology.orchestra.run.smithi008.stdout: "time": "2023-08-01T19:54:52.224968+0000", 2023-08-01T19:54:59.396 INFO:teuthology.orchestra.run.smithi008.stdout: "duration": 0 2023-08-01T19:54:59.396 INFO:teuthology.orchestra.run.smithi008.stdout: }, 2023-08-01T19:54:59.396 INFO:teuthology.orchestra.run.smithi008.stdout: { 2023-08-01T19:54:59.396 INFO:teuthology.orchestra.run.smithi008.stdout: "event": "header_read", 2023-08-01T19:54:59.396 INFO:teuthology.orchestra.run.smithi008.stdout: "time": "2023-08-01T19:54:52.224967+0000", 2023-08-01T19:54:59.396 INFO:teuthology.orchestra.run.smithi008.stdout: "duration": 4294967295.999999 2023-08-01T19:54:59.396 INFO:teuthology.orchestra.run.smithi008.stdout: }, 2023-08-01T19:54:59.397 INFO:teuthology.orchestra.run.smithi008.stdout: { 2023-08-01T19:54:59.397 INFO:teuthology.orchestra.run.smithi008.stdout: "event": "all_read", 2023-08-01T19:54:59.397 INFO:teuthology.orchestra.run.smithi008.stdout: "time": "2023-08-01T19:54:52.225054+0000", 2023-08-01T19:54:59.397 INFO:teuthology.orchestra.run.smithi008.stdout: "duration": 8.6403000000000006e-05 2023-08-01T19:54:59.397 INFO:teuthology.orchestra.run.smithi008.stdout: }, 2023-08-01T19:54:59.397 INFO:teuthology.orchestra.run.smithi008.stdout: { 2023-08-01T19:54:59.397 INFO:teuthology.orchestra.run.smithi008.stdout: "event": "dispatched", 2023-08-01T19:54:59.397 INFO:teuthology.orchestra.run.smithi008.stdout: "time": "2023-08-01T19:54:52.225064+0000", 2023-08-01T19:54:59.398 INFO:teuthology.orchestra.run.smithi008.stdout: "duration": 1.0018e-05 2023-08-01T19:54:59.398 INFO:teuthology.orchestra.run.smithi008.stdout: }, 2023-08-01T19:54:59.398 INFO:teuthology.orchestra.run.smithi008.stdout: { 2023-08-01T19:54:59.398 INFO:teuthology.orchestra.run.smithi008.stdout: "event": "queued_for_pg", 2023-08-01T19:54:59.398 INFO:teuthology.orchestra.run.smithi008.stdout: "time": "2023-08-01T19:54:52.225069+0000", 2023-08-01T19:54:59.398 INFO:teuthology.orchestra.run.smithi008.stdout: "duration": 5.0409999999999997e-06 2023-08-01T19:54:59.398 INFO:teuthology.orchestra.run.smithi008.stdout: }, 2023-08-01T19:54:59.398 INFO:teuthology.orchestra.run.smithi008.stdout: { 2023-08-01T19:54:59.399 INFO:teuthology.orchestra.run.smithi008.stdout: "event": "reached_pg", 2023-08-01T19:54:59.399 INFO:teuthology.orchestra.run.smithi008.stdout: "time": "2023-08-01T19:54:52.231919+0000", 2023-08-01T19:54:59.399 INFO:teuthology.orchestra.run.smithi008.stdout: "duration": 0.006849623 2023-08-01T19:54:59.399 INFO:teuthology.orchestra.run.smithi008.stdout: }, 2023-08-01T19:54:59.399 INFO:teuthology.orchestra.run.smithi008.stdout: { 2023-08-01T19:54:59.399 INFO:teuthology.orchestra.run.smithi008.stdout: "event": "started", 2023-08-01T19:54:59.399 INFO:teuthology.orchestra.run.smithi008.stdout: "time": "2023-08-01T19:54:52.232118+0000", 2023-08-01T19:54:59.399 INFO:teuthology.orchestra.run.smithi008.stdout: "duration": 0.00019987100000000001 2023-08-01T19:54:59.400 INFO:teuthology.orchestra.run.smithi008.stdout: }, 2023-08-01T19:54:59.400 INFO:teuthology.orchestra.run.smithi008.stdout: { 2023-08-01T19:54:59.400 INFO:teuthology.orchestra.run.smithi008.stdout: "event": "waiting for subops from 1", 2023-08-01T19:54:59.400 INFO:teuthology.orchestra.run.smithi008.stdout: "time": "2023-08-01T19:54:52.232350+0000", 2023-08-01T19:54:59.400 INFO:teuthology.orchestra.run.smithi008.stdout: "duration": 0.00023154299999999999 2023-08-01T19:54:59.400 INFO:teuthology.orchestra.run.smithi008.stdout: }, 2023-08-01T19:54:59.400 INFO:teuthology.orchestra.run.smithi008.stdout: { 2023-08-01T19:54:59.400 INFO:teuthology.orchestra.run.smithi008.stdout: "event": "sub_op_commit_rec", 2023-08-01T19:54:59.401 INFO:teuthology.orchestra.run.smithi008.stdout: "time": "2023-08-01T19:54:52.234979+0000", 2023-08-01T19:54:59.401 INFO:teuthology.orchestra.run.smithi008.stdout: "duration": 0.002629485 2023-08-01T19:54:59.401 INFO:teuthology.orchestra.run.smithi008.stdout: }, 2023-08-01T19:54:59.401 INFO:teuthology.orchestra.run.smithi008.stdout: { 2023-08-01T19:54:59.401 INFO:teuthology.orchestra.run.smithi008.stdout: "event": "op_commit", 2023-08-01T19:54:59.401 INFO:teuthology.orchestra.run.smithi008.stdout: "time": "2023-08-01T19:54:52.240667+0000", 2023-08-01T19:54:59.401 INFO:teuthology.orchestra.run.smithi008.stdout: "duration": 0.0056880869999999997 2023-08-01T19:54:59.401 INFO:teuthology.orchestra.run.smithi008.stdout: }, 2023-08-01T19:54:59.402 INFO:teuthology.orchestra.run.smithi008.stdout: { 2023-08-01T19:54:59.402 INFO:teuthology.orchestra.run.smithi008.stdout: "event": "commit_sent", 2023-08-01T19:54:59.402 INFO:teuthology.orchestra.run.smithi008.stdout: "time": "2023-08-01T19:54:52.240705+0000", 2023-08-01T19:54:59.402 INFO:teuthology.orchestra.run.smithi008.stdout: "duration": 3.7302000000000003e-05 2023-08-01T19:54:59.402 INFO:teuthology.orchestra.run.smithi008.stdout: }, 2023-08-01T19:54:59.402 INFO:teuthology.orchestra.run.smithi008.stdout: { 2023-08-01T19:54:59.402 INFO:teuthology.orchestra.run.smithi008.stdout: "event": "done", 2023-08-01T19:54:59.403 INFO:teuthology.orchestra.run.smithi008.stdout: "time": "2023-08-01T19:54:52.240734+0000", 2023-08-01T19:54:59.403 INFO:teuthology.orchestra.run.smithi008.stdout: "duration": 2.8887e-05 2023-08-01T19:54:59.403 INFO:teuthology.orchestra.run.smithi008.stdout: } 2023-08-01T19:54:59.403 INFO:teuthology.orchestra.run.smithi008.stdout: ] 2023-08-01T19:54:59.403 INFO:teuthology.orchestra.run.smithi008.stdout: } 2023-08-01T19:54:59.403 INFO:teuthology.orchestra.run.smithi008.stdout: }, 2023-08-01T19:54:59.403 INFO:teuthology.orchestra.run.smithi008.stdout: { 2023-08-01T19:54:59.403 INFO:teuthology.orchestra.run.smithi008.stdout: "description": "osd_op(client.4668.0:75065 5.6 5:6205fb02:::benchmark_data_smithi006_114134_object75064:head [set-alloc-hint object_size 65536 write_size 65536,write 0~65536] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e32)", 2023-08-01T19:54:59.404 INFO:teuthology.orchestra.run.smithi008.stdout: "initiated_at": "2023-08-01T19:54:52.250401+0000", 2023-08-01T19:54:59.404 INFO:teuthology.orchestra.run.smithi008.stdout: "age": 6.99960834, 2023-08-01T19:54:59.404 INFO:teuthology.orchestra.run.smithi008.stdout: "duration": 0.01559367, 2023-08-01T19:54:59.404 INFO:teuthology.orchestra.run.smithi008.stdout: "type_data": { 2023-08-01T19:54:59.404 INFO:teuthology.orchestra.run.smithi008.stdout: "flag_point": "commit sent; apply or cleanup", 2023-08-01T19:54:59.404 INFO:teuthology.orchestra.run.smithi008.stdout: "client_info": { 2023-08-01T19:54:59.404 INFO:teuthology.orchestra.run.smithi008.stdout: "client": "client.4668", 2023-08-01T19:54:59.404 INFO:teuthology.orchestra.run.smithi008.stdout: "client_addr": "172.21.15.6:0/1709472247", 2023-08-01T19:54:59.405 INFO:teuthology.orchestra.run.smithi008.stdout: "tid": 75065 2023-08-01T19:54:59.405 INFO:teuthology.orchestra.run.smithi008.stdout: }, 2023-08-01T19:54:59.405 INFO:teuthology.orchestra.run.smithi008.stdout: "events": [ 2023-08-01T19:54:59.405 INFO:teuthology.orchestra.run.smithi008.stdout: { 2023-08-01T19:54:59.405 INFO:teuthology.orchestra.run.smithi008.stdout: "event": "initiated", 2023-08-01T19:54:59.405 INFO:teuthology.orchestra.run.smithi008.stdout: "time": "2023-08-01T19:54:52.250401+0000", 2023-08-01T19:54:59.405 INFO:teuthology.orchestra.run.smithi008.stdout: "duration": 0 2023-08-01T19:54:59.405 INFO:teuthology.orchestra.run.smithi008.stdout: }, 2023-08-01T19:54:59.406 INFO:teuthology.orchestra.run.smithi008.stdout: { 2023-08-01T19:54:59.406 INFO:teuthology.orchestra.run.smithi008.stdout: "event": "throttled", 2023-08-01T19:54:59.406 INFO:teuthology.orchestra.run.smithi008.stdout: "time": "2023-08-01T19:54:52.250401+0000", 2023-08-01T19:54:59.406 INFO:teuthology.orchestra.run.smithi008.stdout: "duration": 0 2023-08-01T19:54:59.406 INFO:teuthology.orchestra.run.smithi008.stdout: }, 2023-08-01T19:54:59.406 INFO:teuthology.orchestra.run.smithi008.stdout: { 2023-08-01T19:54:59.406 INFO:teuthology.orchestra.run.smithi008.stdout: "event": "header_read", 2023-08-01T19:54:59.407 INFO:teuthology.orchestra.run.smithi008.stdout: "time": "2023-08-01T19:54:52.250399+0000", 2023-08-01T19:54:59.407 INFO:teuthology.orchestra.run.smithi008.stdout: "duration": 4294967295.9999986 2023-08-01T19:54:59.407 INFO:teuthology.orchestra.run.smithi008.stdout: }, 2023-08-01T19:54:59.407 INFO:teuthology.orchestra.run.smithi008.stdout: { 2023-08-01T19:54:59.407 INFO:teuthology.orchestra.run.smithi008.stdout: "event": "all_read", 2023-08-01T19:54:59.407 INFO:teuthology.orchestra.run.smithi008.stdout: "time": "2023-08-01T19:54:52.250446+0000", 2023-08-01T19:54:59.407 INFO:teuthology.orchestra.run.smithi008.stdout: "duration": 4.6499999999999999e-05 2023-08-01T19:54:59.407 INFO:teuthology.orchestra.run.smithi008.stdout: }, 2023-08-01T19:54:59.408 INFO:teuthology.orchestra.run.smithi008.stdout: { 2023-08-01T19:54:59.408 INFO:teuthology.orchestra.run.smithi008.stdout: "event": "dispatched", 2023-08-01T19:54:59.408 INFO:teuthology.orchestra.run.smithi008.stdout: "time": "2023-08-01T19:54:52.250458+0000", 2023-08-01T19:54:59.408 INFO:teuthology.orchestra.run.smithi008.stdout: "duration": 1.1933000000000001e-05 2023-08-01T19:54:59.408 INFO:teuthology.orchestra.run.smithi008.stdout: }, 2023-08-01T19:54:59.408 INFO:teuthology.orchestra.run.smithi008.stdout: { 2023-08-01T19:54:59.408 INFO:teuthology.orchestra.run.smithi008.stdout: "event": "queued_for_pg", 2023-08-01T19:54:59.408 INFO:teuthology.orchestra.run.smithi008.stdout: "time": "2023-08-01T19:54:52.250464+0000", 2023-08-01T19:54:59.409 INFO:teuthology.orchestra.run.smithi008.stdout: "duration": 6.8140000000000003e-06 2023-08-01T19:54:59.409 INFO:teuthology.orchestra.run.smithi008.stdout: }, 2023-08-01T19:54:59.409 INFO:teuthology.orchestra.run.smithi008.stdout: { 2023-08-01T19:54:59.409 INFO:teuthology.orchestra.run.smithi008.stdout: "event": "reached_pg", 2023-08-01T19:54:59.409 INFO:teuthology.orchestra.run.smithi008.stdout: "time": "2023-08-01T19:54:52.251070+0000", 2023-08-01T19:54:59.409 INFO:teuthology.orchestra.run.smithi008.stdout: "duration": 0.00060562500000000004 2023-08-01T19:54:59.409 INFO:teuthology.orchestra.run.smithi008.stdout: }, 2023-08-01T19:54:59.409 INFO:teuthology.orchestra.run.smithi008.stdout: { 2023-08-01T19:54:59.410 INFO:teuthology.orchestra.run.smithi008.stdout: "event": "started", 2023-08-01T19:54:59.410 INFO:teuthology.orchestra.run.smithi008.stdout: "time": "2023-08-01T19:54:52.251270+0000", 2023-08-01T19:54:59.410 INFO:teuthology.orchestra.run.smithi008.stdout: "duration": 0.00020012200000000001 2023-08-01T19:54:59.410 INFO:teuthology.orchestra.run.smithi008.stdout: }, 2023-08-01T19:54:59.410 INFO:teuthology.orchestra.run.smithi008.stdout: { 2023-08-01T19:54:59.410 INFO:teuthology.orchestra.run.smithi008.stdout: "event": "waiting for subops from 1", 2023-08-01T19:54:59.410 INFO:teuthology.orchestra.run.smithi008.stdout: "time": "2023-08-01T19:54:52.251448+0000", 2023-08-01T19:54:59.411 INFO:teuthology.orchestra.run.smithi008.stdout: "duration": 0.000177918 2023-08-01T19:54:59.411 INFO:teuthology.orchestra.run.smithi008.stdout: }, 2023-08-01T19:54:59.411 INFO:teuthology.orchestra.run.smithi008.stdout: { 2023-08-01T19:54:59.411 INFO:teuthology.orchestra.run.smithi008.stdout: "event": "sub_op_commit_rec", 2023-08-01T19:54:59.411 INFO:teuthology.orchestra.run.smithi008.stdout: "time": "2023-08-01T19:54:52.257590+0000", 2023-08-01T19:54:59.411 INFO:teuthology.orchestra.run.smithi008.stdout: "duration": 0.0061422450000000002 2023-08-01T19:54:59.411 INFO:teuthology.orchestra.run.smithi008.stdout: }, 2023-08-01T19:54:59.411 INFO:teuthology.orchestra.run.smithi008.stdout: { 2023-08-01T19:54:59.412 INFO:teuthology.orchestra.run.smithi008.stdout: "event": "op_commit", 2023-08-01T19:54:59.412 INFO:teuthology.orchestra.run.smithi008.stdout: "time": "2023-08-01T19:54:52.265910+0000", 2023-08-01T19:54:59.412 INFO:teuthology.orchestra.run.smithi008.stdout: "duration": 0.0083197649999999998 2023-08-01T19:54:59.412 INFO:teuthology.orchestra.run.smithi008.stdout: }, 2023-08-01T19:54:59.412 INFO:teuthology.orchestra.run.smithi008.stdout: { 2023-08-01T19:54:59.412 INFO:teuthology.orchestra.run.smithi008.stdout: "event": "commit_sent", 2023-08-01T19:54:59.412 INFO:teuthology.orchestra.run.smithi008.stdout: "time": "2023-08-01T19:54:52.265958+0000", 2023-08-01T19:54:59.412 INFO:teuthology.orchestra.run.smithi008.stdout: "duration": 4.7559999999999999e-05 2023-08-01T19:54:59.413 INFO:teuthology.orchestra.run.smithi008.stdout: }, 2023-08-01T19:54:59.413 INFO:teuthology.orchestra.run.smithi008.stdout: { 2023-08-01T19:54:59.413 INFO:teuthology.orchestra.run.smithi008.stdout: "event": "done", 2023-08-01T19:54:59.413 INFO:teuthology.orchestra.run.smithi008.stdout: "time": "2023-08-01T19:54:52.265994+0000", 2023-08-01T19:54:59.413 INFO:teuthology.orchestra.run.smithi008.stdout: "duration": 3.6628999999999998e-05 2023-08-01T19:54:59.413 INFO:teuthology.orchestra.run.smithi008.stdout: } 2023-08-01T19:54:59.413 INFO:teuthology.orchestra.run.smithi008.stdout: ] 2023-08-01T19:54:59.413 INFO:teuthology.orchestra.run.smithi008.stdout: } 2023-08-01T19:54:59.414 INFO:teuthology.orchestra.run.smithi008.stdout: }, 2023-08-01T19:54:59.414 INFO:teuthology.orchestra.run.smithi008.stdout: { 2023-08-01T19:54:59.414 INFO:teuthology.orchestra.run.smithi008.stdout: "description": "osd_op(client.4668.0:80520 5.5 5:ab281506:::benchmark_data_smithi006_114134_object80519:head [set-alloc-hint object_size 65536 write_size 65536,write 0~65536] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e34)", 2023-08-01T19:54:59.414 INFO:teuthology.orchestra.run.smithi008.stdout: "initiated_at": "2023-08-01T19:54:55.064206+0000", 2023-08-01T19:54:59.414 INFO:teuthology.orchestra.run.smithi008.stdout: "age": 4.1858034450000003, 2023-08-01T19:54:59.414 INFO:teuthology.orchestra.run.smithi008.stdout: "duration": 0.016529129, 2023-08-01T19:54:59.414 INFO:teuthology.orchestra.run.smithi008.stdout: "type_data": { 2023-08-01T19:54:59.415 INFO:teuthology.orchestra.run.smithi008.stdout: "flag_point": "commit sent; apply or cleanup", 2023-08-01T19:54:59.415 INFO:teuthology.orchestra.run.smithi008.stdout: "client_info": { 2023-08-01T19:54:59.415 INFO:teuthology.orchestra.run.smithi008.stdout: "client": "client.4668", 2023-08-01T19:54:59.415 INFO:teuthology.orchestra.run.smithi008.stdout: "client_addr": "172.21.15.6:0/1709472247", 2023-08-01T19:54:59.415 INFO:teuthology.orchestra.run.smithi008.stdout: "tid": 80520 2023-08-01T19:54:59.415 INFO:teuthology.orchestra.run.smithi008.stdout: }, 2023-08-01T19:54:59.415 INFO:teuthology.orchestra.run.smithi008.stdout: "events": [ 2023-08-01T19:54:59.415 INFO:teuthology.orchestra.run.smithi008.stdout: { 2023-08-01T19:54:59.416 INFO:teuthology.orchestra.run.smithi008.stdout: "event": "initiated", 2023-08-01T19:54:59.416 INFO:teuthology.orchestra.run.smithi008.stdout: "time": "2023-08-01T19:54:55.064206+0000", 2023-08-01T19:54:59.416 INFO:teuthology.orchestra.run.smithi008.stdout: "duration": 0 2023-08-01T19:54:59.416 INFO:teuthology.orchestra.run.smithi008.stdout: }, 2023-08-01T19:54:59.416 INFO:teuthology.orchestra.run.smithi008.stdout: { 2023-08-01T19:54:59.416 INFO:teuthology.orchestra.run.smithi008.stdout: "event": "throttled", 2023-08-01T19:54:59.416 INFO:teuthology.orchestra.run.smithi008.stdout: "time": "2023-08-01T19:54:55.064206+0000", 2023-08-01T19:54:59.416 INFO:teuthology.orchestra.run.smithi008.stdout: "duration": 0 2023-08-01T19:54:59.417 INFO:teuthology.orchestra.run.smithi008.stdout: }, 2023-08-01T19:54:59.417 INFO:teuthology.orchestra.run.smithi008.stdout: { 2023-08-01T19:54:59.417 INFO:teuthology.orchestra.run.smithi008.stdout: "event": "header_read", 2023-08-01T19:54:59.417 INFO:teuthology.orchestra.run.smithi008.stdout: "time": "2023-08-01T19:54:55.064205+0000", 2023-08-01T19:54:59.417 INFO:teuthology.orchestra.run.smithi008.stdout: "duration": 4294967295.999999 2023-08-01T19:54:59.417 INFO:teuthology.orchestra.run.smithi008.stdout: }, 2023-08-01T19:54:59.417 INFO:teuthology.orchestra.run.smithi008.stdout: { 2023-08-01T19:54:59.417 INFO:teuthology.orchestra.run.smithi008.stdout: "event": "all_read", 2023-08-01T19:54:59.418 INFO:teuthology.orchestra.run.smithi008.stdout: "time": "2023-08-01T19:54:55.064295+0000", 2023-08-01T19:54:59.418 INFO:teuthology.orchestra.run.smithi008.stdout: "duration": 9.0132999999999999e-05 2023-08-01T19:54:59.418 INFO:teuthology.orchestra.run.smithi008.stdout: }, 2023-08-01T19:54:59.418 INFO:teuthology.orchestra.run.smithi008.stdout: { 2023-08-01T19:54:59.418 INFO:teuthology.orchestra.run.smithi008.stdout: "event": "dispatched", 2023-08-01T19:54:59.418 INFO:teuthology.orchestra.run.smithi008.stdout: "time": "2023-08-01T19:54:55.064306+0000", 2023-08-01T19:54:59.418 INFO:teuthology.orchestra.run.smithi008.stdout: "duration": 1.0824e-05 2023-08-01T19:54:59.418 INFO:teuthology.orchestra.run.smithi008.stdout: }, 2023-08-01T19:54:59.419 INFO:teuthology.orchestra.run.smithi008.stdout: { 2023-08-01T19:54:59.419 INFO:teuthology.orchestra.run.smithi008.stdout: "event": "queued_for_pg", 2023-08-01T19:54:59.419 INFO:teuthology.orchestra.run.smithi008.stdout: "time": "2023-08-01T19:54:55.064325+0000", 2023-08-01T19:54:59.419 INFO:teuthology.orchestra.run.smithi008.stdout: "duration": 1.9045000000000001e-05 2023-08-01T19:54:59.419 INFO:teuthology.orchestra.run.smithi008.stdout: }, 2023-08-01T19:54:59.419 INFO:teuthology.orchestra.run.smithi008.stdout: { 2023-08-01T19:54:59.419 INFO:teuthology.orchestra.run.smithi008.stdout: "event": "reached_pg", 2023-08-01T19:54:59.419 INFO:teuthology.orchestra.run.smithi008.stdout: "time": "2023-08-01T19:54:55.064371+0000", 2023-08-01T19:54:59.420 INFO:teuthology.orchestra.run.smithi008.stdout: "duration": 4.6254000000000001e-05 2023-08-01T19:54:59.420 INFO:teuthology.orchestra.run.smithi008.stdout: }, 2023-08-01T19:54:59.420 INFO:teuthology.orchestra.run.smithi008.stdout: { 2023-08-01T19:54:59.420 INFO:teuthology.orchestra.run.smithi008.stdout: "event": "op must wait for map", 2023-08-01T19:54:59.420 INFO:teuthology.orchestra.run.smithi008.stdout: "time": "2023-08-01T19:54:55.064375+0000", 2023-08-01T19:54:59.420 INFO:teuthology.orchestra.run.smithi008.stdout: "duration": 3.7749999999999999e-06 2023-08-01T19:54:59.420 INFO:teuthology.orchestra.run.smithi008.stdout: }, 2023-08-01T19:54:59.421 INFO:teuthology.orchestra.run.smithi008.stdout: { 2023-08-01T19:54:59.421 INFO:teuthology.orchestra.run.smithi008.stdout: "event": "reached_pg", 2023-08-01T19:54:59.421 INFO:teuthology.orchestra.run.smithi008.stdout: "time": "2023-08-01T19:54:55.069678+0000", 2023-08-01T19:54:59.421 INFO:teuthology.orchestra.run.smithi008.stdout: "duration": 0.0053035360000000002 2023-08-01T19:54:59.421 INFO:teuthology.orchestra.run.smithi008.stdout: }, 2023-08-01T19:54:59.421 INFO:teuthology.orchestra.run.smithi008.stdout: { 2023-08-01T19:54:59.421 INFO:teuthology.orchestra.run.smithi008.stdout: "event": "started", 2023-08-01T19:54:59.421 INFO:teuthology.orchestra.run.smithi008.stdout: "time": "2023-08-01T19:54:55.069800+0000", 2023-08-01T19:54:59.422 INFO:teuthology.orchestra.run.smithi008.stdout: "duration": 0.00012183799999999999 2023-08-01T19:54:59.422 INFO:teuthology.orchestra.run.smithi008.stdout: }, 2023-08-01T19:54:59.422 INFO:teuthology.orchestra.run.smithi008.stdout: { 2023-08-01T19:54:59.422 INFO:teuthology.orchestra.run.smithi008.stdout: "event": "waiting for subops from 1", 2023-08-01T19:54:59.422 INFO:teuthology.orchestra.run.smithi008.stdout: "time": "2023-08-01T19:54:55.070411+0000", 2023-08-01T19:54:59.422 INFO:teuthology.orchestra.run.smithi008.stdout: "duration": 0.00061113499999999996 2023-08-01T19:54:59.422 INFO:teuthology.orchestra.run.smithi008.stdout: }, 2023-08-01T19:54:59.422 INFO:teuthology.orchestra.run.smithi008.stdout: { 2023-08-01T19:54:59.423 INFO:teuthology.orchestra.run.smithi008.stdout: "event": "op_commit", 2023-08-01T19:54:59.423 INFO:teuthology.orchestra.run.smithi008.stdout: "time": "2023-08-01T19:54:55.077232+0000", 2023-08-01T19:54:59.423 INFO:teuthology.orchestra.run.smithi008.stdout: "duration": 0.006821171 2023-08-01T19:54:59.423 INFO:teuthology.orchestra.run.smithi008.stdout: }, 2023-08-01T19:54:59.423 INFO:teuthology.orchestra.run.smithi008.stdout: { 2023-08-01T19:54:59.423 INFO:teuthology.orchestra.run.smithi008.stdout: "event": "sub_op_commit_rec", 2023-08-01T19:54:59.423 INFO:teuthology.orchestra.run.smithi008.stdout: "time": "2023-08-01T19:54:55.080641+0000", 2023-08-01T19:54:59.424 INFO:teuthology.orchestra.run.smithi008.stdout: "duration": 0.0034086479999999998 2023-08-01T19:54:59.424 INFO:teuthology.orchestra.run.smithi008.stdout: }, 2023-08-01T19:54:59.424 INFO:teuthology.orchestra.run.smithi008.stdout: { 2023-08-01T19:54:59.424 INFO:teuthology.orchestra.run.smithi008.stdout: "event": "commit_sent", 2023-08-01T19:54:59.424 INFO:teuthology.orchestra.run.smithi008.stdout: "time": "2023-08-01T19:54:55.080693+0000", 2023-08-01T19:54:59.424 INFO:teuthology.orchestra.run.smithi008.stdout: "duration": 5.1660999999999999e-05 2023-08-01T19:54:59.424 INFO:teuthology.orchestra.run.smithi008.stdout: }, 2023-08-01T19:54:59.424 INFO:teuthology.orchestra.run.smithi008.stdout: { 2023-08-01T19:54:59.425 INFO:teuthology.orchestra.run.smithi008.stdout: "event": "done", 2023-08-01T19:54:59.425 INFO:teuthology.orchestra.run.smithi008.stdout: "time": "2023-08-01T19:54:55.080735+0000", 2023-08-01T19:54:59.425 INFO:teuthology.orchestra.run.smithi008.stdout: "duration": 4.2002999999999997e-05 2023-08-01T19:54:59.425 INFO:teuthology.orchestra.run.smithi008.stdout: } 2023-08-01T19:54:59.425 INFO:teuthology.orchestra.run.smithi008.stdout: ] 2023-08-01T19:54:59.425 INFO:teuthology.orchestra.run.smithi008.stdout: } 2023-08-01T19:54:59.425 INFO:teuthology.orchestra.run.smithi008.stdout: }, 2023-08-01T19:54:59.426 INFO:teuthology.orchestra.run.smithi008.stdout: { 2023-08-01T19:54:59.426 INFO:teuthology.orchestra.run.smithi008.stdout: "description": "osd_op(client.4668.0:81440 5.5 5:af339bc6:::benchmark_data_smithi006_114134_object81439:head [set-alloc-hint object_size 65536 write_size 65536,write 0~65536] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e34)", 2023-08-01T19:54:59.426 INFO:teuthology.orchestra.run.smithi008.stdout: "initiated_at": "2023-08-01T19:54:55.523596+0000", 2023-08-01T19:54:59.426 INFO:teuthology.orchestra.run.smithi008.stdout: "age": 3.7264130280000001, 2023-08-01T19:54:59.426 INFO:teuthology.orchestra.run.smithi008.stdout: "duration": 0.015552576, 2023-08-01T19:54:59.426 INFO:teuthology.orchestra.run.smithi008.stdout: "type_data": { 2023-08-01T19:54:59.426 INFO:teuthology.orchestra.run.smithi008.stdout: "flag_point": "commit sent; apply or cleanup", 2023-08-01T19:54:59.426 INFO:teuthology.orchestra.run.smithi008.stdout: "client_info": { 2023-08-01T19:54:59.427 INFO:teuthology.orchestra.run.smithi008.stdout: "client": "client.4668", 2023-08-01T19:54:59.427 INFO:teuthology.orchestra.run.smithi008.stdout: "client_addr": "172.21.15.6:0/1709472247", 2023-08-01T19:54:59.427 INFO:teuthology.orchestra.run.smithi008.stdout: "tid": 81440 2023-08-01T19:54:59.427 INFO:teuthology.orchestra.run.smithi008.stdout: }, 2023-08-01T19:54:59.427 INFO:teuthology.orchestra.run.smithi008.stdout: "events": [ 2023-08-01T19:54:59.427 INFO:teuthology.orchestra.run.smithi008.stdout: { 2023-08-01T19:54:59.427 INFO:teuthology.orchestra.run.smithi008.stdout: "event": "initiated", 2023-08-01T19:54:59.427 INFO:teuthology.orchestra.run.smithi008.stdout: "time": "2023-08-01T19:54:55.523596+0000", 2023-08-01T19:54:59.428 INFO:teuthology.orchestra.run.smithi008.stdout: "duration": 0 2023-08-01T19:54:59.428 INFO:teuthology.orchestra.run.smithi008.stdout: }, 2023-08-01T19:54:59.428 INFO:teuthology.orchestra.run.smithi008.stdout: { 2023-08-01T19:54:59.428 INFO:teuthology.orchestra.run.smithi008.stdout: "event": "throttled", 2023-08-01T19:54:59.428 INFO:teuthology.orchestra.run.smithi008.stdout: "time": "2023-08-01T19:54:55.523596+0000", 2023-08-01T19:54:59.428 INFO:teuthology.orchestra.run.smithi008.stdout: "duration": 0 2023-08-01T19:54:59.428 INFO:teuthology.orchestra.run.smithi008.stdout: }, 2023-08-01T19:54:59.428 INFO:teuthology.orchestra.run.smithi008.stdout: { 2023-08-01T19:54:59.429 INFO:teuthology.orchestra.run.smithi008.stdout: "event": "header_read", 2023-08-01T19:54:59.429 INFO:teuthology.orchestra.run.smithi008.stdout: "time": "2023-08-01T19:54:55.523596+0000", 2023-08-01T19:54:59.429 INFO:teuthology.orchestra.run.smithi008.stdout: "duration": 4294967295.9999995 2023-08-01T19:54:59.429 INFO:teuthology.orchestra.run.smithi008.stdout: }, 2023-08-01T19:54:59.429 INFO:teuthology.orchestra.run.smithi008.stdout: { 2023-08-01T19:54:59.429 INFO:teuthology.orchestra.run.smithi008.stdout: "event": "all_read", 2023-08-01T19:54:59.429 INFO:teuthology.orchestra.run.smithi008.stdout: "time": "2023-08-01T19:54:55.523688+0000", 2023-08-01T19:54:59.430 INFO:teuthology.orchestra.run.smithi008.stdout: "duration": 9.2604999999999999e-05 2023-08-01T19:54:59.430 INFO:teuthology.orchestra.run.smithi008.stdout: }, 2023-08-01T19:54:59.430 INFO:teuthology.orchestra.run.smithi008.stdout: { 2023-08-01T19:54:59.430 INFO:teuthology.orchestra.run.smithi008.stdout: "event": "dispatched", 2023-08-01T19:54:59.430 INFO:teuthology.orchestra.run.smithi008.stdout: "time": "2023-08-01T19:54:55.523693+0000", 2023-08-01T19:54:59.430 INFO:teuthology.orchestra.run.smithi008.stdout: "duration": 5.2639999999999999e-06 2023-08-01T19:54:59.430 INFO:teuthology.orchestra.run.smithi008.stdout: }, 2023-08-01T19:54:59.430 INFO:teuthology.orchestra.run.smithi008.stdout: { 2023-08-01T19:54:59.431 INFO:teuthology.orchestra.run.smithi008.stdout: "event": "queued_for_pg", 2023-08-01T19:54:59.431 INFO:teuthology.orchestra.run.smithi008.stdout: "time": "2023-08-01T19:54:55.523696+0000", 2023-08-01T19:54:59.431 INFO:teuthology.orchestra.run.smithi008.stdout: "duration": 2.7480000000000002e-06 2023-08-01T19:54:59.431 INFO:teuthology.orchestra.run.smithi008.stdout: }, 2023-08-01T19:54:59.431 INFO:teuthology.orchestra.run.smithi008.stdout: { 2023-08-01T19:54:59.431 INFO:teuthology.orchestra.run.smithi008.stdout: "event": "reached_pg", 2023-08-01T19:54:59.431 INFO:teuthology.orchestra.run.smithi008.stdout: "time": "2023-08-01T19:54:55.529052+0000", 2023-08-01T19:54:59.431 INFO:teuthology.orchestra.run.smithi008.stdout: "duration": 0.0053563059999999999 2023-08-01T19:54:59.432 INFO:teuthology.orchestra.run.smithi008.stdout: }, 2023-08-01T19:54:59.432 INFO:teuthology.orchestra.run.smithi008.stdout: { 2023-08-01T19:54:59.432 INFO:teuthology.orchestra.run.smithi008.stdout: "event": "started", 2023-08-01T19:54:59.432 INFO:teuthology.orchestra.run.smithi008.stdout: "time": "2023-08-01T19:54:55.529137+0000", 2023-08-01T19:54:59.432 INFO:teuthology.orchestra.run.smithi008.stdout: "duration": 8.4697000000000006e-05 2023-08-01T19:54:59.432 INFO:teuthology.orchestra.run.smithi008.stdout: }, 2023-08-01T19:54:59.432 INFO:teuthology.orchestra.run.smithi008.stdout: { 2023-08-01T19:54:59.432 INFO:teuthology.orchestra.run.smithi008.stdout: "event": "waiting for subops from 1", 2023-08-01T19:54:59.433 INFO:teuthology.orchestra.run.smithi008.stdout: "time": "2023-08-01T19:54:55.529222+0000", 2023-08-01T19:54:59.433 INFO:teuthology.orchestra.run.smithi008.stdout: "duration": 8.5284000000000005e-05 2023-08-01T19:54:59.433 INFO:teuthology.orchestra.run.smithi008.stdout: }, 2023-08-01T19:54:59.433 INFO:teuthology.orchestra.run.smithi008.stdout: { 2023-08-01T19:54:59.433 INFO:teuthology.orchestra.run.smithi008.stdout: "event": "op_commit", 2023-08-01T19:54:59.433 INFO:teuthology.orchestra.run.smithi008.stdout: "time": "2023-08-01T19:54:55.536200+0000", 2023-08-01T19:54:59.433 INFO:teuthology.orchestra.run.smithi008.stdout: "duration": 0.0069771310000000001 2023-08-01T19:54:59.434 INFO:teuthology.orchestra.run.smithi008.stdout: }, 2023-08-01T19:54:59.434 INFO:teuthology.orchestra.run.smithi008.stdout: { 2023-08-01T19:54:59.434 INFO:teuthology.orchestra.run.smithi008.stdout: "event": "sub_op_commit_rec", 2023-08-01T19:54:59.434 INFO:teuthology.orchestra.run.smithi008.stdout: "time": "2023-08-01T19:54:55.539095+0000", 2023-08-01T19:54:59.434 INFO:teuthology.orchestra.run.smithi008.stdout: "duration": 0.0028953170000000001 2023-08-01T19:54:59.434 INFO:teuthology.orchestra.run.smithi008.stdout: }, 2023-08-01T19:54:59.434 INFO:teuthology.orchestra.run.smithi008.stdout: { 2023-08-01T19:54:59.434 INFO:teuthology.orchestra.run.smithi008.stdout: "event": "commit_sent", 2023-08-01T19:54:59.435 INFO:teuthology.orchestra.run.smithi008.stdout: "time": "2023-08-01T19:54:55.539127+0000", 2023-08-01T19:54:59.435 INFO:teuthology.orchestra.run.smithi008.stdout: "duration": 3.2094999999999997e-05 2023-08-01T19:54:59.435 INFO:teuthology.orchestra.run.smithi008.stdout: }, 2023-08-01T19:54:59.435 INFO:teuthology.orchestra.run.smithi008.stdout: { 2023-08-01T19:54:59.435 INFO:teuthology.orchestra.run.smithi008.stdout: "event": "done", 2023-08-01T19:54:59.435 INFO:teuthology.orchestra.run.smithi008.stdout: "time": "2023-08-01T19:54:55.539149+0000", 2023-08-01T19:54:59.435 INFO:teuthology.orchestra.run.smithi008.stdout: "duration": 2.1571999999999999e-05 2023-08-01T19:54:59.435 INFO:teuthology.orchestra.run.smithi008.stdout: } 2023-08-01T19:54:59.436 INFO:teuthology.orchestra.run.smithi008.stdout: ] 2023-08-01T19:54:59.436 INFO:teuthology.orchestra.run.smithi008.stdout: } 2023-08-01T19:54:59.436 INFO:teuthology.orchestra.run.smithi008.stdout: }, 2023-08-01T19:54:59.436 INFO:teuthology.orchestra.run.smithi008.stdout: { 2023-08-01T19:54:59.436 INFO:teuthology.orchestra.run.smithi008.stdout: "description": "osd_op(client.4668.0:81441 5.5 5:ab200711:::benchmark_data_smithi006_114134_object81440:head [set-alloc-hint object_size 65536 write_size 65536,write 0~65536] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e34)", 2023-08-01T19:54:59.436 INFO:teuthology.orchestra.run.smithi008.stdout: "initiated_at": "2023-08-01T19:54:55.523719+0000", 2023-08-01T19:54:59.436 INFO:teuthology.orchestra.run.smithi008.stdout: "age": 3.7262900759999997, 2023-08-01T19:54:59.437 INFO:teuthology.orchestra.run.smithi008.stdout: "duration": 0.018134344, 2023-08-01T19:54:59.437 INFO:teuthology.orchestra.run.smithi008.stdout: "type_data": { 2023-08-01T19:54:59.437 INFO:teuthology.orchestra.run.smithi008.stdout: "flag_point": "commit sent; apply or cleanup", 2023-08-01T19:54:59.437 INFO:teuthology.orchestra.run.smithi008.stdout: "client_info": { 2023-08-01T19:54:59.437 INFO:teuthology.orchestra.run.smithi008.stdout: "client": "client.4668", 2023-08-01T19:54:59.437 INFO:teuthology.orchestra.run.smithi008.stdout: "client_addr": "172.21.15.6:0/1709472247", 2023-08-01T19:54:59.437 INFO:teuthology.orchestra.run.smithi008.stdout: "tid": 81441 2023-08-01T19:54:59.437 INFO:teuthology.orchestra.run.smithi008.stdout: }, 2023-08-01T19:54:59.438 INFO:teuthology.orchestra.run.smithi008.stdout: "events": [ 2023-08-01T19:54:59.438 INFO:teuthology.orchestra.run.smithi008.stdout: { 2023-08-01T19:54:59.438 INFO:teuthology.orchestra.run.smithi008.stdout: "event": "initiated", 2023-08-01T19:54:59.438 INFO:teuthology.orchestra.run.smithi008.stdout: "time": "2023-08-01T19:54:55.523719+0000", 2023-08-01T19:54:59.438 INFO:teuthology.orchestra.run.smithi008.stdout: "duration": 0 2023-08-01T19:54:59.438 INFO:teuthology.orchestra.run.smithi008.stdout: }, 2023-08-01T19:54:59.438 INFO:teuthology.orchestra.run.smithi008.stdout: { 2023-08-01T19:54:59.438 INFO:teuthology.orchestra.run.smithi008.stdout: "event": "throttled", 2023-08-01T19:54:59.439 INFO:teuthology.orchestra.run.smithi008.stdout: "time": "2023-08-01T19:54:55.523719+0000", 2023-08-01T19:54:59.439 INFO:teuthology.orchestra.run.smithi008.stdout: "duration": 0 2023-08-01T19:54:59.439 INFO:teuthology.orchestra.run.smithi008.stdout: }, 2023-08-01T19:54:59.439 INFO:teuthology.orchestra.run.smithi008.stdout: { 2023-08-01T19:54:59.439 INFO:teuthology.orchestra.run.smithi008.stdout: "event": "header_read", 2023-08-01T19:54:59.439 INFO:teuthology.orchestra.run.smithi008.stdout: "time": "2023-08-01T19:54:55.523718+0000", 2023-08-01T19:54:59.439 INFO:teuthology.orchestra.run.smithi008.stdout: "duration": 4294967295.9999995 2023-08-01T19:54:59.440 INFO:teuthology.orchestra.run.smithi008.stdout: }, 2023-08-01T19:54:59.440 INFO:teuthology.orchestra.run.smithi008.stdout: { 2023-08-01T19:54:59.440 INFO:teuthology.orchestra.run.smithi008.stdout: "event": "all_read", 2023-08-01T19:54:59.440 INFO:teuthology.orchestra.run.smithi008.stdout: "time": "2023-08-01T19:54:55.523792+0000", 2023-08-01T19:54:59.440 INFO:teuthology.orchestra.run.smithi008.stdout: "duration": 7.3818000000000004e-05 2023-08-01T19:54:59.440 INFO:teuthology.orchestra.run.smithi008.stdout: }, 2023-08-01T19:54:59.440 INFO:teuthology.orchestra.run.smithi008.stdout: { 2023-08-01T19:54:59.440 INFO:teuthology.orchestra.run.smithi008.stdout: "event": "dispatched", 2023-08-01T19:54:59.441 INFO:teuthology.orchestra.run.smithi008.stdout: "time": "2023-08-01T19:54:55.523797+0000", 2023-08-01T19:54:59.441 INFO:teuthology.orchestra.run.smithi008.stdout: "duration": 4.6229999999999996e-06 2023-08-01T19:54:59.441 INFO:teuthology.orchestra.run.smithi008.stdout: }, 2023-08-01T19:54:59.441 INFO:teuthology.orchestra.run.smithi008.stdout: { 2023-08-01T19:54:59.441 INFO:teuthology.orchestra.run.smithi008.stdout: "event": "queued_for_pg", 2023-08-01T19:54:59.441 INFO:teuthology.orchestra.run.smithi008.stdout: "time": "2023-08-01T19:54:55.523800+0000", 2023-08-01T19:54:59.441 INFO:teuthology.orchestra.run.smithi008.stdout: "duration": 3.4680000000000001e-06 2023-08-01T19:54:59.442 INFO:teuthology.orchestra.run.smithi008.stdout: }, 2023-08-01T19:54:59.442 INFO:teuthology.orchestra.run.smithi008.stdout: { 2023-08-01T19:54:59.442 INFO:teuthology.orchestra.run.smithi008.stdout: "event": "reached_pg", 2023-08-01T19:54:59.442 INFO:teuthology.orchestra.run.smithi008.stdout: "time": "2023-08-01T19:54:55.530492+0000", 2023-08-01T19:54:59.442 INFO:teuthology.orchestra.run.smithi008.stdout: "duration": 0.0066918050000000003 2023-08-01T19:54:59.442 INFO:teuthology.orchestra.run.smithi008.stdout: }, 2023-08-01T19:54:59.442 INFO:teuthology.orchestra.run.smithi008.stdout: { 2023-08-01T19:54:59.442 INFO:teuthology.orchestra.run.smithi008.stdout: "event": "started", 2023-08-01T19:54:59.443 INFO:teuthology.orchestra.run.smithi008.stdout: "time": "2023-08-01T19:54:55.530631+0000", 2023-08-01T19:54:59.443 INFO:teuthology.orchestra.run.smithi008.stdout: "duration": 0.000138794 2023-08-01T19:54:59.443 INFO:teuthology.orchestra.run.smithi008.stdout: }, 2023-08-01T19:54:59.443 INFO:teuthology.orchestra.run.smithi008.stdout: { 2023-08-01T19:54:59.443 INFO:teuthology.orchestra.run.smithi008.stdout: "event": "waiting for subops from 1", 2023-08-01T19:54:59.443 INFO:teuthology.orchestra.run.smithi008.stdout: "time": "2023-08-01T19:54:55.530792+0000", 2023-08-01T19:54:59.443 INFO:teuthology.orchestra.run.smithi008.stdout: "duration": 0.00016092299999999999 2023-08-01T19:54:59.443 INFO:teuthology.orchestra.run.smithi008.stdout: }, 2023-08-01T19:54:59.444 INFO:teuthology.orchestra.run.smithi008.stdout: { 2023-08-01T19:54:59.444 INFO:teuthology.orchestra.run.smithi008.stdout: "event": "sub_op_commit_rec", 2023-08-01T19:54:59.444 INFO:teuthology.orchestra.run.smithi008.stdout: "time": "2023-08-01T19:54:55.539186+0000", 2023-08-01T19:54:59.444 INFO:teuthology.orchestra.run.smithi008.stdout: "duration": 0.0083942630000000008 2023-08-01T19:54:59.444 INFO:teuthology.orchestra.run.smithi008.stdout: }, 2023-08-01T19:54:59.444 INFO:teuthology.orchestra.run.smithi008.stdout: { 2023-08-01T19:54:59.444 INFO:teuthology.orchestra.run.smithi008.stdout: "event": "op_commit", 2023-08-01T19:54:59.445 INFO:teuthology.orchestra.run.smithi008.stdout: "time": "2023-08-01T19:54:55.541775+0000", 2023-08-01T19:54:59.445 INFO:teuthology.orchestra.run.smithi008.stdout: "duration": 0.0025887530000000001 2023-08-01T19:54:59.445 INFO:teuthology.orchestra.run.smithi008.stdout: }, 2023-08-01T19:54:59.445 INFO:teuthology.orchestra.run.smithi008.stdout: { 2023-08-01T19:54:59.445 INFO:teuthology.orchestra.run.smithi008.stdout: "event": "commit_sent", 2023-08-01T19:54:59.445 INFO:teuthology.orchestra.run.smithi008.stdout: "time": "2023-08-01T19:54:55.541820+0000", 2023-08-01T19:54:59.445 INFO:teuthology.orchestra.run.smithi008.stdout: "duration": 4.4870000000000002e-05 2023-08-01T19:54:59.445 INFO:teuthology.orchestra.run.smithi008.stdout: }, 2023-08-01T19:54:59.446 INFO:teuthology.orchestra.run.smithi008.stdout: { 2023-08-01T19:54:59.446 INFO:teuthology.orchestra.run.smithi008.stdout: "event": "done", 2023-08-01T19:54:59.446 INFO:teuthology.orchestra.run.smithi008.stdout: "time": "2023-08-01T19:54:55.541853+0000", 2023-08-01T19:54:59.446 INFO:teuthology.orchestra.run.smithi008.stdout: "duration": 3.3568000000000001e-05 2023-08-01T19:54:59.446 INFO:teuthology.orchestra.run.smithi008.stdout: } 2023-08-01T19:54:59.446 INFO:teuthology.orchestra.run.smithi008.stdout: ] 2023-08-01T19:54:59.446 INFO:teuthology.orchestra.run.smithi008.stdout: } 2023-08-01T19:54:59.447 INFO:teuthology.orchestra.run.smithi008.stdout: }, 2023-08-01T19:54:59.447 INFO:teuthology.orchestra.run.smithi008.stdout: { 2023-08-01T19:54:59.447 INFO:teuthology.orchestra.run.smithi008.stdout: "description": "osd_op(client.4668.0:83724 5.a 5:51683221:::benchmark_data_smithi006_114134_object83723:head [set-alloc-hint object_size 65536 write_size 65536,write 0~65536] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e34)", 2023-08-01T19:54:59.447 INFO:teuthology.orchestra.run.smithi008.stdout: "initiated_at": "2023-08-01T19:54:56.650569+0000", 2023-08-01T19:54:59.447 INFO:teuthology.orchestra.run.smithi008.stdout: "age": 2.599440392, 2023-08-01T19:54:59.447 INFO:teuthology.orchestra.run.smithi008.stdout: "duration": 0.017545056, 2023-08-01T19:54:59.447 INFO:teuthology.orchestra.run.smithi008.stdout: "type_data": { 2023-08-01T19:54:59.447 INFO:teuthology.orchestra.run.smithi008.stdout: "flag_point": "commit sent; apply or cleanup", 2023-08-01T19:54:59.448 INFO:teuthology.orchestra.run.smithi008.stdout: "client_info": { 2023-08-01T19:54:59.448 INFO:teuthology.orchestra.run.smithi008.stdout: "client": "client.4668", 2023-08-01T19:54:59.448 INFO:teuthology.orchestra.run.smithi008.stdout: "client_addr": "172.21.15.6:0/1709472247", 2023-08-01T19:54:59.448 INFO:teuthology.orchestra.run.smithi008.stdout: "tid": 83724 2023-08-01T19:54:59.448 INFO:teuthology.orchestra.run.smithi008.stdout: }, 2023-08-01T19:54:59.448 INFO:teuthology.orchestra.run.smithi008.stdout: "events": [ 2023-08-01T19:54:59.448 INFO:teuthology.orchestra.run.smithi008.stdout: { 2023-08-01T19:54:59.448 INFO:teuthology.orchestra.run.smithi008.stdout: "event": "initiated", 2023-08-01T19:54:59.449 INFO:teuthology.orchestra.run.smithi008.stdout: "time": "2023-08-01T19:54:56.650569+0000", 2023-08-01T19:54:59.449 INFO:teuthology.orchestra.run.smithi008.stdout: "duration": 0 2023-08-01T19:54:59.449 INFO:teuthology.orchestra.run.smithi008.stdout: }, 2023-08-01T19:54:59.449 INFO:teuthology.orchestra.run.smithi008.stdout: { 2023-08-01T19:54:59.449 INFO:teuthology.orchestra.run.smithi008.stdout: "event": "throttled", 2023-08-01T19:54:59.449 INFO:teuthology.orchestra.run.smithi008.stdout: "time": "2023-08-01T19:54:56.650569+0000", 2023-08-01T19:54:59.449 INFO:teuthology.orchestra.run.smithi008.stdout: "duration": 0 2023-08-01T19:54:59.449 INFO:teuthology.orchestra.run.smithi008.stdout: }, 2023-08-01T19:54:59.450 INFO:teuthology.orchestra.run.smithi008.stdout: { 2023-08-01T19:54:59.450 INFO:teuthology.orchestra.run.smithi008.stdout: "event": "header_read", 2023-08-01T19:54:59.450 INFO:teuthology.orchestra.run.smithi008.stdout: "time": "2023-08-01T19:54:56.650568+0000", 2023-08-01T19:54:59.450 INFO:teuthology.orchestra.run.smithi008.stdout: "duration": 4294967295.999999 2023-08-01T19:54:59.450 INFO:teuthology.orchestra.run.smithi008.stdout: }, 2023-08-01T19:54:59.450 INFO:teuthology.orchestra.run.smithi008.stdout: { 2023-08-01T19:54:59.450 INFO:teuthology.orchestra.run.smithi008.stdout: "event": "all_read", 2023-08-01T19:54:59.451 INFO:teuthology.orchestra.run.smithi008.stdout: "time": "2023-08-01T19:54:56.650642+0000", 2023-08-01T19:54:59.451 INFO:teuthology.orchestra.run.smithi008.stdout: "duration": 7.4239999999999994e-05 2023-08-01T19:54:59.451 INFO:teuthology.orchestra.run.smithi008.stdout: }, 2023-08-01T19:54:59.451 INFO:teuthology.orchestra.run.smithi008.stdout: { 2023-08-01T19:54:59.451 INFO:teuthology.orchestra.run.smithi008.stdout: "event": "dispatched", 2023-08-01T19:54:59.451 INFO:teuthology.orchestra.run.smithi008.stdout: "time": "2023-08-01T19:54:56.650650+0000", 2023-08-01T19:54:59.451 INFO:teuthology.orchestra.run.smithi008.stdout: "duration": 8.2789999999999998e-06 2023-08-01T19:54:59.451 INFO:teuthology.orchestra.run.smithi008.stdout: }, 2023-08-01T19:54:59.452 INFO:teuthology.orchestra.run.smithi008.stdout: { 2023-08-01T19:54:59.452 INFO:teuthology.orchestra.run.smithi008.stdout: "event": "queued_for_pg", 2023-08-01T19:54:59.452 INFO:teuthology.orchestra.run.smithi008.stdout: "time": "2023-08-01T19:54:56.650654+0000", 2023-08-01T19:54:59.452 INFO:teuthology.orchestra.run.smithi008.stdout: "duration": 3.5389999999999999e-06 2023-08-01T19:54:59.452 INFO:teuthology.orchestra.run.smithi008.stdout: }, 2023-08-01T19:54:59.452 INFO:teuthology.orchestra.run.smithi008.stdout: { 2023-08-01T19:54:59.452 INFO:teuthology.orchestra.run.smithi008.stdout: "event": "reached_pg", 2023-08-01T19:54:59.452 INFO:teuthology.orchestra.run.smithi008.stdout: "time": "2023-08-01T19:54:56.654606+0000", 2023-08-01T19:54:59.453 INFO:teuthology.orchestra.run.smithi008.stdout: "duration": 0.003952288 2023-08-01T19:54:59.453 INFO:teuthology.orchestra.run.smithi008.stdout: }, 2023-08-01T19:54:59.453 INFO:teuthology.orchestra.run.smithi008.stdout: { 2023-08-01T19:54:59.453 INFO:teuthology.orchestra.run.smithi008.stdout: "event": "started", 2023-08-01T19:54:59.453 INFO:teuthology.orchestra.run.smithi008.stdout: "time": "2023-08-01T19:54:56.654704+0000", 2023-08-01T19:54:59.453 INFO:teuthology.orchestra.run.smithi008.stdout: "duration": 9.7460000000000005e-05 2023-08-01T19:54:59.453 INFO:teuthology.orchestra.run.smithi008.stdout: }, 2023-08-01T19:54:59.454 INFO:teuthology.orchestra.run.smithi008.stdout: { 2023-08-01T19:54:59.454 INFO:teuthology.orchestra.run.smithi008.stdout: "event": "waiting for subops from 2", 2023-08-01T19:54:59.454 INFO:teuthology.orchestra.run.smithi008.stdout: "time": "2023-08-01T19:54:56.654815+0000", 2023-08-01T19:54:59.454 INFO:teuthology.orchestra.run.smithi008.stdout: "duration": 0.00011138599999999999 2023-08-01T19:54:59.454 INFO:teuthology.orchestra.run.smithi008.stdout: }, 2023-08-01T19:54:59.454 INFO:teuthology.orchestra.run.smithi008.stdout: { 2023-08-01T19:54:59.454 INFO:teuthology.orchestra.run.smithi008.stdout: "event": "sub_op_commit_rec", 2023-08-01T19:54:59.454 INFO:teuthology.orchestra.run.smithi008.stdout: "time": "2023-08-01T19:54:56.662591+0000", 2023-08-01T19:54:59.455 INFO:teuthology.orchestra.run.smithi008.stdout: "duration": 0.0077756869999999999 2023-08-01T19:54:59.455 INFO:teuthology.orchestra.run.smithi008.stdout: }, 2023-08-01T19:54:59.455 INFO:teuthology.orchestra.run.smithi008.stdout: { 2023-08-01T19:54:59.455 INFO:teuthology.orchestra.run.smithi008.stdout: "event": "op_commit", 2023-08-01T19:54:59.455 INFO:teuthology.orchestra.run.smithi008.stdout: "time": "2023-08-01T19:54:56.668029+0000", 2023-08-01T19:54:59.455 INFO:teuthology.orchestra.run.smithi008.stdout: "duration": 0.0054382500000000004 2023-08-01T19:54:59.455 INFO:teuthology.orchestra.run.smithi008.stdout: }, 2023-08-01T19:54:59.455 INFO:teuthology.orchestra.run.smithi008.stdout: { 2023-08-01T19:54:59.456 INFO:teuthology.orchestra.run.smithi008.stdout: "event": "commit_sent", 2023-08-01T19:54:59.456 INFO:teuthology.orchestra.run.smithi008.stdout: "time": "2023-08-01T19:54:56.668070+0000", 2023-08-01T19:54:59.456 INFO:teuthology.orchestra.run.smithi008.stdout: "duration": 4.1625999999999998e-05 2023-08-01T19:54:59.456 INFO:teuthology.orchestra.run.smithi008.stdout: }, 2023-08-01T19:54:59.456 INFO:teuthology.orchestra.run.smithi008.stdout: { 2023-08-01T19:54:59.456 INFO:teuthology.orchestra.run.smithi008.stdout: "event": "done", 2023-08-01T19:54:59.456 INFO:teuthology.orchestra.run.smithi008.stdout: "time": "2023-08-01T19:54:56.668114+0000", 2023-08-01T19:54:59.456 INFO:teuthology.orchestra.run.smithi008.stdout: "duration": 4.3229000000000002e-05 2023-08-01T19:54:59.457 INFO:teuthology.orchestra.run.smithi008.stdout: } 2023-08-01T19:54:59.457 INFO:teuthology.orchestra.run.smithi008.stdout: ] 2023-08-01T19:54:59.457 INFO:teuthology.orchestra.run.smithi008.stdout: } 2023-08-01T19:54:59.457 INFO:teuthology.orchestra.run.smithi008.stdout: }, 2023-08-01T19:54:59.457 INFO:teuthology.orchestra.run.smithi008.stdout: { 2023-08-01T19:54:59.457 INFO:teuthology.orchestra.run.smithi008.stdout: "description": "osd_op(client.4668.0:84109 5.5 5:a84da05f:::benchmark_data_smithi006_114134_object84108:head [set-alloc-hint object_size 65536 write_size 65536,write 0~65536] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e34)", 2023-08-01T19:54:59.457 INFO:teuthology.orchestra.run.smithi008.stdout: "initiated_at": "2023-08-01T19:54:56.853497+0000", 2023-08-01T19:54:59.457 INFO:teuthology.orchestra.run.smithi008.stdout: "age": 2.3965122230000002, 2023-08-01T19:54:59.458 INFO:teuthology.orchestra.run.smithi008.stdout: "duration": 0.017082654999999999, 2023-08-01T19:54:59.458 INFO:teuthology.orchestra.run.smithi008.stdout: "type_data": { 2023-08-01T19:54:59.458 INFO:teuthology.orchestra.run.smithi008.stdout: "flag_point": "commit sent; apply or cleanup", 2023-08-01T19:54:59.458 INFO:teuthology.orchestra.run.smithi008.stdout: "client_info": { 2023-08-01T19:54:59.458 INFO:teuthology.orchestra.run.smithi008.stdout: "client": "client.4668", 2023-08-01T19:54:59.458 INFO:teuthology.orchestra.run.smithi008.stdout: "client_addr": "172.21.15.6:0/1709472247", 2023-08-01T19:54:59.458 INFO:teuthology.orchestra.run.smithi008.stdout: "tid": 84109 2023-08-01T19:54:59.458 INFO:teuthology.orchestra.run.smithi008.stdout: }, 2023-08-01T19:54:59.459 INFO:teuthology.orchestra.run.smithi008.stdout: "events": [ 2023-08-01T19:54:59.459 INFO:teuthology.orchestra.run.smithi008.stdout: { 2023-08-01T19:54:59.459 INFO:teuthology.orchestra.run.smithi008.stdout: "event": "initiated", 2023-08-01T19:54:59.459 INFO:teuthology.orchestra.run.smithi008.stdout: "time": "2023-08-01T19:54:56.853497+0000", 2023-08-01T19:54:59.459 INFO:teuthology.orchestra.run.smithi008.stdout: "duration": 0 2023-08-01T19:54:59.459 INFO:teuthology.orchestra.run.smithi008.stdout: }, 2023-08-01T19:54:59.459 INFO:teuthology.orchestra.run.smithi008.stdout: { 2023-08-01T19:54:59.460 INFO:teuthology.orchestra.run.smithi008.stdout: "event": "throttled", 2023-08-01T19:54:59.460 INFO:teuthology.orchestra.run.smithi008.stdout: "time": "2023-08-01T19:54:56.853497+0000", 2023-08-01T19:54:59.460 INFO:teuthology.orchestra.run.smithi008.stdout: "duration": 0 2023-08-01T19:54:59.460 INFO:teuthology.orchestra.run.smithi008.stdout: }, 2023-08-01T19:54:59.460 INFO:teuthology.orchestra.run.smithi008.stdout: { 2023-08-01T19:54:59.460 INFO:teuthology.orchestra.run.smithi008.stdout: "event": "header_read", 2023-08-01T19:54:59.461 INFO:teuthology.orchestra.run.smithi008.stdout: "time": "2023-08-01T19:54:56.853496+0000", 2023-08-01T19:54:59.461 INFO:teuthology.orchestra.run.smithi008.stdout: "duration": 4294967295.999999 2023-08-01T19:54:59.461 INFO:teuthology.orchestra.run.smithi008.stdout: }, 2023-08-01T19:54:59.461 INFO:teuthology.orchestra.run.smithi008.stdout: { 2023-08-01T19:54:59.461 INFO:teuthology.orchestra.run.smithi008.stdout: "event": "all_read", 2023-08-01T19:54:59.461 INFO:teuthology.orchestra.run.smithi008.stdout: "time": "2023-08-01T19:54:56.853540+0000", 2023-08-01T19:54:59.461 INFO:teuthology.orchestra.run.smithi008.stdout: "duration": 4.4161e-05 2023-08-01T19:54:59.462 INFO:teuthology.orchestra.run.smithi008.stdout: }, 2023-08-01T19:54:59.462 INFO:teuthology.orchestra.run.smithi008.stdout: { 2023-08-01T19:54:59.462 INFO:teuthology.orchestra.run.smithi008.stdout: "event": "dispatched", 2023-08-01T19:54:59.462 INFO:teuthology.orchestra.run.smithi008.stdout: "time": "2023-08-01T19:54:56.853548+0000", 2023-08-01T19:54:59.462 INFO:teuthology.orchestra.run.smithi008.stdout: "duration": 8.1499999999999999e-06 2023-08-01T19:54:59.462 INFO:teuthology.orchestra.run.smithi008.stdout: }, 2023-08-01T19:54:59.462 INFO:teuthology.orchestra.run.smithi008.stdout: { 2023-08-01T19:54:59.463 INFO:teuthology.orchestra.run.smithi008.stdout: "event": "queued_for_pg", 2023-08-01T19:54:59.463 INFO:teuthology.orchestra.run.smithi008.stdout: "time": "2023-08-01T19:54:56.853552+0000", 2023-08-01T19:54:59.463 INFO:teuthology.orchestra.run.smithi008.stdout: "duration": 4.1969999999999998e-06 2023-08-01T19:54:59.463 INFO:teuthology.orchestra.run.smithi008.stdout: }, 2023-08-01T19:54:59.463 INFO:teuthology.orchestra.run.smithi008.stdout: { 2023-08-01T19:54:59.463 INFO:teuthology.orchestra.run.smithi008.stdout: "event": "reached_pg", 2023-08-01T19:54:59.463 INFO:teuthology.orchestra.run.smithi008.stdout: "time": "2023-08-01T19:54:56.854385+0000", 2023-08-01T19:54:59.464 INFO:teuthology.orchestra.run.smithi008.stdout: "duration": 0.00083224500000000001 2023-08-01T19:54:59.464 INFO:teuthology.orchestra.run.smithi008.stdout: }, 2023-08-01T19:54:59.464 INFO:teuthology.orchestra.run.smithi008.stdout: { 2023-08-01T19:54:59.464 INFO:teuthology.orchestra.run.smithi008.stdout: "event": "started", 2023-08-01T19:54:59.464 INFO:teuthology.orchestra.run.smithi008.stdout: "time": "2023-08-01T19:54:56.854546+0000", 2023-08-01T19:54:59.464 INFO:teuthology.orchestra.run.smithi008.stdout: "duration": 0.00016117599999999999 2023-08-01T19:54:59.464 INFO:teuthology.orchestra.run.smithi008.stdout: }, 2023-08-01T19:54:59.464 INFO:teuthology.orchestra.run.smithi008.stdout: { 2023-08-01T19:54:59.465 INFO:teuthology.orchestra.run.smithi008.stdout: "event": "waiting for subops from 1", 2023-08-01T19:54:59.465 INFO:teuthology.orchestra.run.smithi008.stdout: "time": "2023-08-01T19:54:56.854671+0000", 2023-08-01T19:54:59.465 INFO:teuthology.orchestra.run.smithi008.stdout: "duration": 0.000124993 2023-08-01T19:54:59.465 INFO:teuthology.orchestra.run.smithi008.stdout: }, 2023-08-01T19:54:59.465 INFO:teuthology.orchestra.run.smithi008.stdout: { 2023-08-01T19:54:59.465 INFO:teuthology.orchestra.run.smithi008.stdout: "event": "sub_op_commit_rec", 2023-08-01T19:54:59.465 INFO:teuthology.orchestra.run.smithi008.stdout: "time": "2023-08-01T19:54:56.860986+0000", 2023-08-01T19:54:59.465 INFO:teuthology.orchestra.run.smithi008.stdout: "duration": 0.0063150619999999998 2023-08-01T19:54:59.466 INFO:teuthology.orchestra.run.smithi008.stdout: }, 2023-08-01T19:54:59.466 INFO:teuthology.orchestra.run.smithi008.stdout: { 2023-08-01T19:54:59.466 INFO:teuthology.orchestra.run.smithi008.stdout: "event": "op_commit", 2023-08-01T19:54:59.466 INFO:teuthology.orchestra.run.smithi008.stdout: "time": "2023-08-01T19:54:56.870455+0000", 2023-08-01T19:54:59.466 INFO:teuthology.orchestra.run.smithi008.stdout: "duration": 0.0094689349999999995 2023-08-01T19:54:59.466 INFO:teuthology.orchestra.run.smithi008.stdout: }, 2023-08-01T19:54:59.466 INFO:teuthology.orchestra.run.smithi008.stdout: { 2023-08-01T19:54:59.467 INFO:teuthology.orchestra.run.smithi008.stdout: "event": "commit_sent", 2023-08-01T19:54:59.467 INFO:teuthology.orchestra.run.smithi008.stdout: "time": "2023-08-01T19:54:56.870515+0000", 2023-08-01T19:54:59.467 INFO:teuthology.orchestra.run.smithi008.stdout: "duration": 6.0578999999999997e-05 2023-08-01T19:54:59.467 INFO:teuthology.orchestra.run.smithi008.stdout: }, 2023-08-01T19:54:59.467 INFO:teuthology.orchestra.run.smithi008.stdout: { 2023-08-01T19:54:59.467 INFO:teuthology.orchestra.run.smithi008.stdout: "event": "done", 2023-08-01T19:54:59.467 INFO:teuthology.orchestra.run.smithi008.stdout: "time": "2023-08-01T19:54:56.870579+0000", 2023-08-01T19:54:59.468 INFO:teuthology.orchestra.run.smithi008.stdout: "duration": 6.4152999999999994e-05 2023-08-01T19:54:59.468 INFO:teuthology.orchestra.run.smithi008.stdout: } 2023-08-01T19:54:59.468 INFO:teuthology.orchestra.run.smithi008.stdout: ] 2023-08-01T19:54:59.468 INFO:teuthology.orchestra.run.smithi008.stdout: } 2023-08-01T19:54:59.468 INFO:teuthology.orchestra.run.smithi008.stdout: } 2023-08-01T19:54:59.468 INFO:teuthology.orchestra.run.smithi008.stdout: ] 2023-08-01T19:54:59.468 INFO:teuthology.orchestra.run.smithi008.stdout:} 2023-08-01T19:54:59.470 INFO:tasks.radosbench.radosbench.0.smithi006.stdout: 35 16 88818 88802 158.562 117.312 0.00865994 0.00630353 2023-08-01T19:54:59.470 INFO:tasks.ceph.osd.2.smithi155.stderr:2023-08-01T19:54:59.468+0000 7faa5c6ac700 -1 received signal: Hangup from /usr/bin/python3 /bin/daemon-helper kill ceph-osd -f --cluster ceph -i 2 (PID: 111337) UID: 0 2023-08-01T19:54:59.471 DEBUG:teuthology.orchestra.run.smithi101:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 30 ceph --cluster ceph --admin-daemon /var/run/ceph/ceph-osd.1.asok dump_ops_in_flight 2023-08-01T19:54:59.571 INFO:tasks.ceph.osd.0.smithi008.stderr:2023-08-01T19:54:59.570+0000 7f16a58f4700 -1 received signal: Hangup from /usr/bin/python3 /bin/daemon-helper kill ceph-osd -f --cluster ceph -i 0 (PID: 111179) UID: 0 2023-08-01T19:54:59.648 INFO:teuthology.orchestra.run.smithi101.stdout:{ 2023-08-01T19:54:59.648 INFO:teuthology.orchestra.run.smithi101.stdout: "ops": [ 2023-08-01T19:54:59.648 INFO:teuthology.orchestra.run.smithi101.stdout: { 2023-08-01T19:54:59.648 INFO:teuthology.orchestra.run.smithi101.stdout: "description": "osd_repop(client.4668.0:89485 5.3 e35/19 5:c810998d:::benchmark_data_smithi006_114134_object89484:head v 35'5646, mlcod=35'5641)", 2023-08-01T19:54:59.649 INFO:teuthology.orchestra.run.smithi101.stdout: "initiated_at": "2023-08-01T19:54:59.646040+0000", 2023-08-01T19:54:59.649 INFO:teuthology.orchestra.run.smithi101.stdout: "age": 0.00096626100000000005, 2023-08-01T19:54:59.649 INFO:teuthology.orchestra.run.smithi101.stdout: "duration": 0.000997003, 2023-08-01T19:54:59.649 INFO:teuthology.orchestra.run.smithi101.stdout: "type_data": { 2023-08-01T19:54:59.649 INFO:teuthology.orchestra.run.smithi101.stdout: "flag_point": "started", 2023-08-01T19:54:59.649 INFO:teuthology.orchestra.run.smithi101.stdout: "events": [ 2023-08-01T19:54:59.649 INFO:teuthology.orchestra.run.smithi101.stdout: { 2023-08-01T19:54:59.650 INFO:teuthology.orchestra.run.smithi101.stdout: "event": "initiated", 2023-08-01T19:54:59.650 INFO:teuthology.orchestra.run.smithi101.stdout: "time": "2023-08-01T19:54:59.646040+0000", 2023-08-01T19:54:59.650 INFO:teuthology.orchestra.run.smithi101.stdout: "duration": 0 2023-08-01T19:54:59.650 INFO:teuthology.orchestra.run.smithi101.stdout: }, 2023-08-01T19:54:59.650 INFO:teuthology.orchestra.run.smithi101.stdout: { 2023-08-01T19:54:59.650 INFO:teuthology.orchestra.run.smithi101.stdout: "event": "throttled", 2023-08-01T19:54:59.650 INFO:teuthology.orchestra.run.smithi101.stdout: "time": "2023-08-01T19:54:59.646040+0000", 2023-08-01T19:54:59.650 INFO:teuthology.orchestra.run.smithi101.stdout: "duration": 0 2023-08-01T19:54:59.651 INFO:teuthology.orchestra.run.smithi101.stdout: }, 2023-08-01T19:54:59.651 INFO:teuthology.orchestra.run.smithi101.stdout: { 2023-08-01T19:54:59.651 INFO:teuthology.orchestra.run.smithi101.stdout: "event": "header_read", 2023-08-01T19:54:59.651 INFO:teuthology.orchestra.run.smithi101.stdout: "time": "2023-08-01T19:54:59.646040+0000", 2023-08-01T19:54:59.651 INFO:teuthology.orchestra.run.smithi101.stdout: "duration": 4294967295.9999995 2023-08-01T19:54:59.651 INFO:teuthology.orchestra.run.smithi101.stdout: }, 2023-08-01T19:54:59.651 INFO:teuthology.orchestra.run.smithi101.stdout: { 2023-08-01T19:54:59.652 INFO:teuthology.orchestra.run.smithi101.stdout: "event": "all_read", 2023-08-01T19:54:59.652 INFO:teuthology.orchestra.run.smithi101.stdout: "time": "2023-08-01T19:54:59.646088+0000", 2023-08-01T19:54:59.652 INFO:teuthology.orchestra.run.smithi101.stdout: "duration": 4.8000000000000001e-05 2023-08-01T19:54:59.652 INFO:teuthology.orchestra.run.smithi101.stdout: }, 2023-08-01T19:54:59.652 INFO:teuthology.orchestra.run.smithi101.stdout: { 2023-08-01T19:54:59.652 INFO:teuthology.orchestra.run.smithi101.stdout: "event": "dispatched", 2023-08-01T19:54:59.652 INFO:teuthology.orchestra.run.smithi101.stdout: "time": "2023-08-01T19:54:59.646095+0000", 2023-08-01T19:54:59.653 INFO:teuthology.orchestra.run.smithi101.stdout: "duration": 7.1980000000000004e-06 2023-08-01T19:54:59.653 INFO:teuthology.orchestra.run.smithi101.stdout: }, 2023-08-01T19:54:59.653 INFO:teuthology.orchestra.run.smithi101.stdout: { 2023-08-01T19:54:59.653 INFO:teuthology.orchestra.run.smithi101.stdout: "event": "queued_for_pg", 2023-08-01T19:54:59.653 INFO:teuthology.orchestra.run.smithi101.stdout: "time": "2023-08-01T19:54:59.646099+0000", 2023-08-01T19:54:59.653 INFO:teuthology.orchestra.run.smithi101.stdout: "duration": 3.6320000000000001e-06 2023-08-01T19:54:59.653 INFO:teuthology.orchestra.run.smithi101.stdout: }, 2023-08-01T19:54:59.653 INFO:teuthology.orchestra.run.smithi101.stdout: { 2023-08-01T19:54:59.654 INFO:teuthology.orchestra.run.smithi101.stdout: "event": "reached_pg", 2023-08-01T19:54:59.654 INFO:teuthology.orchestra.run.smithi101.stdout: "time": "2023-08-01T19:54:59.646125+0000", 2023-08-01T19:54:59.654 INFO:teuthology.orchestra.run.smithi101.stdout: "duration": 2.6570000000000001e-05 2023-08-01T19:54:59.654 INFO:teuthology.orchestra.run.smithi101.stdout: }, 2023-08-01T19:54:59.654 INFO:teuthology.orchestra.run.smithi101.stdout: { 2023-08-01T19:54:59.654 INFO:teuthology.orchestra.run.smithi101.stdout: "event": "started", 2023-08-01T19:54:59.655 INFO:teuthology.orchestra.run.smithi101.stdout: "time": "2023-08-01T19:54:59.646143+0000", 2023-08-01T19:54:59.655 INFO:teuthology.orchestra.run.smithi101.stdout: "duration": 1.8085999999999999e-05 2023-08-01T19:54:59.655 INFO:teuthology.orchestra.run.smithi101.stdout: } 2023-08-01T19:54:59.655 INFO:teuthology.orchestra.run.smithi101.stdout: ] 2023-08-01T19:54:59.655 INFO:teuthology.orchestra.run.smithi101.stdout: } 2023-08-01T19:54:59.655 INFO:teuthology.orchestra.run.smithi101.stdout: }, 2023-08-01T19:54:59.655 INFO:teuthology.orchestra.run.smithi101.stdout: { 2023-08-01T19:54:59.655 INFO:teuthology.orchestra.run.smithi101.stdout: "description": "osd_op(client.4668.0:89489 5.1 5:805ae279:::benchmark_data_smithi006_114134_object89488:head [set-alloc-hint object_size 65536 write_size 65536,write 0~65536 in=65536b] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e35)", 2023-08-01T19:54:59.656 INFO:teuthology.orchestra.run.smithi101.stdout: "initiated_at": "2023-08-01T19:54:59.646165+0000", 2023-08-01T19:54:59.656 INFO:teuthology.orchestra.run.smithi101.stdout: "age": 0.00084150900000000005, 2023-08-01T19:54:59.656 INFO:teuthology.orchestra.run.smithi101.stdout: "duration": 0.00094912200000000005, 2023-08-01T19:54:59.656 INFO:teuthology.orchestra.run.smithi101.stdout: "type_data": { 2023-08-01T19:54:59.656 INFO:teuthology.orchestra.run.smithi101.stdout: "flag_point": "waiting for sub ops", 2023-08-01T19:54:59.656 INFO:teuthology.orchestra.run.smithi101.stdout: "client_info": { 2023-08-01T19:54:59.657 INFO:teuthology.orchestra.run.smithi101.stdout: "client": "client.4668", 2023-08-01T19:54:59.657 INFO:teuthology.orchestra.run.smithi101.stdout: "client_addr": "172.21.15.6:0/1709472247", 2023-08-01T19:54:59.657 INFO:teuthology.orchestra.run.smithi101.stdout: "tid": 89489 2023-08-01T19:54:59.657 INFO:teuthology.orchestra.run.smithi101.stdout: }, 2023-08-01T19:54:59.657 INFO:teuthology.orchestra.run.smithi101.stdout: "events": [ 2023-08-01T19:54:59.657 INFO:teuthology.orchestra.run.smithi101.stdout: { 2023-08-01T19:54:59.657 INFO:teuthology.orchestra.run.smithi101.stdout: "event": "initiated", 2023-08-01T19:54:59.657 INFO:teuthology.orchestra.run.smithi101.stdout: "time": "2023-08-01T19:54:59.646165+0000", 2023-08-01T19:54:59.658 INFO:teuthology.orchestra.run.smithi101.stdout: "duration": 0 2023-08-01T19:54:59.658 INFO:teuthology.orchestra.run.smithi101.stdout: }, 2023-08-01T19:54:59.658 INFO:teuthology.orchestra.run.smithi101.stdout: { 2023-08-01T19:54:59.658 INFO:teuthology.orchestra.run.smithi101.stdout: "event": "throttled", 2023-08-01T19:54:59.658 INFO:teuthology.orchestra.run.smithi101.stdout: "time": "2023-08-01T19:54:59.646165+0000", 2023-08-01T19:54:59.658 INFO:teuthology.orchestra.run.smithi101.stdout: "duration": 0 2023-08-01T19:54:59.658 INFO:teuthology.orchestra.run.smithi101.stdout: }, 2023-08-01T19:54:59.659 INFO:teuthology.orchestra.run.smithi101.stdout: { 2023-08-01T19:54:59.659 INFO:teuthology.orchestra.run.smithi101.stdout: "event": "header_read", 2023-08-01T19:54:59.659 INFO:teuthology.orchestra.run.smithi101.stdout: "time": "2023-08-01T19:54:59.646164+0000", 2023-08-01T19:54:59.659 INFO:teuthology.orchestra.run.smithi101.stdout: "duration": 4294967295.999999 2023-08-01T19:54:59.659 INFO:teuthology.orchestra.run.smithi101.stdout: }, 2023-08-01T19:54:59.659 INFO:teuthology.orchestra.run.smithi101.stdout: { 2023-08-01T19:54:59.659 INFO:teuthology.orchestra.run.smithi101.stdout: "event": "all_read", 2023-08-01T19:54:59.659 INFO:teuthology.orchestra.run.smithi101.stdout: "time": "2023-08-01T19:54:59.646220+0000", 2023-08-01T19:54:59.660 INFO:teuthology.orchestra.run.smithi101.stdout: "duration": 5.6016e-05 2023-08-01T19:54:59.660 INFO:teuthology.orchestra.run.smithi101.stdout: }, 2023-08-01T19:54:59.660 INFO:teuthology.orchestra.run.smithi101.stdout: { 2023-08-01T19:54:59.660 INFO:teuthology.orchestra.run.smithi101.stdout: "event": "dispatched", 2023-08-01T19:54:59.660 INFO:teuthology.orchestra.run.smithi101.stdout: "time": "2023-08-01T19:54:59.646233+0000", 2023-08-01T19:54:59.660 INFO:teuthology.orchestra.run.smithi101.stdout: "duration": 1.2979000000000001e-05 2023-08-01T19:54:59.660 INFO:teuthology.orchestra.run.smithi101.stdout: }, 2023-08-01T19:54:59.661 INFO:teuthology.orchestra.run.smithi101.stdout: { 2023-08-01T19:54:59.661 INFO:teuthology.orchestra.run.smithi101.stdout: "event": "queued_for_pg", 2023-08-01T19:54:59.661 INFO:teuthology.orchestra.run.smithi101.stdout: "time": "2023-08-01T19:54:59.646239+0000", 2023-08-01T19:54:59.661 INFO:teuthology.orchestra.run.smithi101.stdout: "duration": 6.4609999999999996e-06 2023-08-01T19:54:59.661 INFO:teuthology.orchestra.run.smithi101.stdout: }, 2023-08-01T19:54:59.661 INFO:teuthology.orchestra.run.smithi101.stdout: { 2023-08-01T19:54:59.661 INFO:teuthology.orchestra.run.smithi101.stdout: "event": "reached_pg", 2023-08-01T19:54:59.661 INFO:teuthology.orchestra.run.smithi101.stdout: "time": "2023-08-01T19:54:59.646288+0000", 2023-08-01T19:54:59.662 INFO:teuthology.orchestra.run.smithi101.stdout: "duration": 4.8911e-05 2023-08-01T19:54:59.662 INFO:teuthology.orchestra.run.smithi101.stdout: }, 2023-08-01T19:54:59.662 INFO:teuthology.orchestra.run.smithi101.stdout: { 2023-08-01T19:54:59.662 INFO:teuthology.orchestra.run.smithi101.stdout: "event": "started", 2023-08-01T19:54:59.662 INFO:teuthology.orchestra.run.smithi101.stdout: "time": "2023-08-01T19:54:59.646421+0000", 2023-08-01T19:54:59.662 INFO:teuthology.orchestra.run.smithi101.stdout: "duration": 0.000132757 2023-08-01T19:54:59.663 INFO:teuthology.orchestra.run.smithi101.stdout: }, 2023-08-01T19:54:59.663 INFO:teuthology.orchestra.run.smithi101.stdout: { 2023-08-01T19:54:59.663 INFO:teuthology.orchestra.run.smithi101.stdout: "event": "waiting for subops from 0", 2023-08-01T19:54:59.663 INFO:teuthology.orchestra.run.smithi101.stdout: "time": "2023-08-01T19:54:59.646582+0000", 2023-08-01T19:54:59.663 INFO:teuthology.orchestra.run.smithi101.stdout: "duration": 0.00016091599999999999 2023-08-01T19:54:59.663 INFO:teuthology.orchestra.run.smithi101.stdout: } 2023-08-01T19:54:59.663 INFO:teuthology.orchestra.run.smithi101.stdout: ] 2023-08-01T19:54:59.663 INFO:teuthology.orchestra.run.smithi101.stdout: } 2023-08-01T19:54:59.664 INFO:teuthology.orchestra.run.smithi101.stdout: }, 2023-08-01T19:54:59.664 INFO:teuthology.orchestra.run.smithi101.stdout: { 2023-08-01T19:54:59.664 INFO:teuthology.orchestra.run.smithi101.stdout: "description": "osd_op(client.4668.0:89478 5.1 5:8b976d89:::benchmark_data_smithi006_114134_object89477:head [set-alloc-hint object_size 65536 write_size 65536,write 0~65536 in=65536b] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e35)", 2023-08-01T19:54:59.664 INFO:teuthology.orchestra.run.smithi101.stdout: "initiated_at": "2023-08-01T19:54:59.640610+0000", 2023-08-01T19:54:59.664 INFO:teuthology.orchestra.run.smithi101.stdout: "age": 0.0063968569999999997, 2023-08-01T19:54:59.664 INFO:teuthology.orchestra.run.smithi101.stdout: "duration": 0.0065943260000000002, 2023-08-01T19:54:59.664 INFO:teuthology.orchestra.run.smithi101.stdout: "type_data": { 2023-08-01T19:54:59.664 INFO:teuthology.orchestra.run.smithi101.stdout: "flag_point": "waiting for sub ops", 2023-08-01T19:54:59.665 INFO:teuthology.orchestra.run.smithi101.stdout: "client_info": { 2023-08-01T19:54:59.665 INFO:teuthology.orchestra.run.smithi101.stdout: "client": "client.4668", 2023-08-01T19:54:59.665 INFO:teuthology.orchestra.run.smithi101.stdout: "client_addr": "172.21.15.6:0/1709472247", 2023-08-01T19:54:59.665 INFO:teuthology.orchestra.run.smithi101.stdout: "tid": 89478 2023-08-01T19:54:59.665 INFO:teuthology.orchestra.run.smithi101.stdout: }, 2023-08-01T19:54:59.665 INFO:teuthology.orchestra.run.smithi101.stdout: "events": [ 2023-08-01T19:54:59.665 INFO:teuthology.orchestra.run.smithi101.stdout: { 2023-08-01T19:54:59.665 INFO:teuthology.orchestra.run.smithi101.stdout: "event": "initiated", 2023-08-01T19:54:59.666 INFO:teuthology.orchestra.run.smithi101.stdout: "time": "2023-08-01T19:54:59.640610+0000", 2023-08-01T19:54:59.666 INFO:teuthology.orchestra.run.smithi101.stdout: "duration": 0 2023-08-01T19:54:59.666 INFO:teuthology.orchestra.run.smithi101.stdout: }, 2023-08-01T19:54:59.666 INFO:teuthology.orchestra.run.smithi101.stdout: { 2023-08-01T19:54:59.666 INFO:teuthology.orchestra.run.smithi101.stdout: "event": "throttled", 2023-08-01T19:54:59.666 INFO:teuthology.orchestra.run.smithi101.stdout: "time": "2023-08-01T19:54:59.640610+0000", 2023-08-01T19:54:59.666 INFO:teuthology.orchestra.run.smithi101.stdout: "duration": 0 2023-08-01T19:54:59.666 INFO:teuthology.orchestra.run.smithi101.stdout: }, 2023-08-01T19:54:59.667 INFO:teuthology.orchestra.run.smithi101.stdout: { 2023-08-01T19:54:59.667 INFO:teuthology.orchestra.run.smithi101.stdout: "event": "header_read", 2023-08-01T19:54:59.667 INFO:teuthology.orchestra.run.smithi101.stdout: "time": "2023-08-01T19:54:59.640608+0000", 2023-08-01T19:54:59.667 INFO:teuthology.orchestra.run.smithi101.stdout: "duration": 4294967295.9999986 2023-08-01T19:54:59.667 INFO:teuthology.orchestra.run.smithi101.stdout: }, 2023-08-01T19:54:59.667 INFO:teuthology.orchestra.run.smithi101.stdout: { 2023-08-01T19:54:59.667 INFO:teuthology.orchestra.run.smithi101.stdout: "event": "all_read", 2023-08-01T19:54:59.667 INFO:teuthology.orchestra.run.smithi101.stdout: "time": "2023-08-01T19:54:59.640731+0000", 2023-08-01T19:54:59.668 INFO:teuthology.orchestra.run.smithi101.stdout: "duration": 0.000122507 2023-08-01T19:54:59.668 INFO:teuthology.orchestra.run.smithi101.stdout: }, 2023-08-01T19:54:59.668 INFO:teuthology.orchestra.run.smithi101.stdout: { 2023-08-01T19:54:59.668 INFO:teuthology.orchestra.run.smithi101.stdout: "event": "dispatched", 2023-08-01T19:54:59.668 INFO:teuthology.orchestra.run.smithi101.stdout: "time": "2023-08-01T19:54:59.640741+0000", 2023-08-01T19:54:59.668 INFO:teuthology.orchestra.run.smithi101.stdout: "duration": 1.0447e-05 2023-08-01T19:54:59.668 INFO:teuthology.orchestra.run.smithi101.stdout: }, 2023-08-01T19:54:59.669 INFO:teuthology.orchestra.run.smithi101.stdout: { 2023-08-01T19:54:59.669 INFO:teuthology.orchestra.run.smithi101.stdout: "event": "queued_for_pg", 2023-08-01T19:54:59.669 INFO:teuthology.orchestra.run.smithi101.stdout: "time": "2023-08-01T19:54:59.640748+0000", 2023-08-01T19:54:59.669 INFO:teuthology.orchestra.run.smithi101.stdout: "duration": 6.7499999999999997e-06 2023-08-01T19:54:59.669 INFO:teuthology.orchestra.run.smithi101.stdout: }, 2023-08-01T19:54:59.669 INFO:teuthology.orchestra.run.smithi101.stdout: { 2023-08-01T19:54:59.669 INFO:teuthology.orchestra.run.smithi101.stdout: "event": "reached_pg", 2023-08-01T19:54:59.669 INFO:teuthology.orchestra.run.smithi101.stdout: "time": "2023-08-01T19:54:59.640800+0000", 2023-08-01T19:54:59.670 INFO:teuthology.orchestra.run.smithi101.stdout: "duration": 5.1949e-05 2023-08-01T19:54:59.670 INFO:teuthology.orchestra.run.smithi101.stdout: }, 2023-08-01T19:54:59.670 INFO:teuthology.orchestra.run.smithi101.stdout: { 2023-08-01T19:54:59.670 INFO:teuthology.orchestra.run.smithi101.stdout: "event": "started", 2023-08-01T19:54:59.670 INFO:teuthology.orchestra.run.smithi101.stdout: "time": "2023-08-01T19:54:59.640927+0000", 2023-08-01T19:54:59.670 INFO:teuthology.orchestra.run.smithi101.stdout: "duration": 0.000127107 2023-08-01T19:54:59.670 INFO:teuthology.orchestra.run.smithi101.stdout: }, 2023-08-01T19:54:59.670 INFO:teuthology.orchestra.run.smithi101.stdout: { 2023-08-01T19:54:59.671 INFO:teuthology.orchestra.run.smithi101.stdout: "event": "waiting for subops from 0", 2023-08-01T19:54:59.671 INFO:teuthology.orchestra.run.smithi101.stdout: "time": "2023-08-01T19:54:59.641079+0000", 2023-08-01T19:54:59.671 INFO:teuthology.orchestra.run.smithi101.stdout: "duration": 0.00015176 2023-08-01T19:54:59.671 INFO:teuthology.orchestra.run.smithi101.stdout: }, 2023-08-01T19:54:59.671 INFO:teuthology.orchestra.run.smithi101.stdout: { 2023-08-01T19:54:59.671 INFO:teuthology.orchestra.run.smithi101.stdout: "event": "op_commit", 2023-08-01T19:54:59.671 INFO:teuthology.orchestra.run.smithi101.stdout: "time": "2023-08-01T19:54:59.644944+0000", 2023-08-01T19:54:59.671 INFO:teuthology.orchestra.run.smithi101.stdout: "duration": 0.0038650899999999998 2023-08-01T19:54:59.672 INFO:teuthology.orchestra.run.smithi101.stdout: } 2023-08-01T19:54:59.672 INFO:teuthology.orchestra.run.smithi101.stdout: ] 2023-08-01T19:54:59.672 INFO:teuthology.orchestra.run.smithi101.stdout: } 2023-08-01T19:54:59.672 INFO:teuthology.orchestra.run.smithi101.stdout: }, 2023-08-01T19:54:59.672 INFO:teuthology.orchestra.run.smithi101.stdout: { 2023-08-01T19:54:59.672 INFO:teuthology.orchestra.run.smithi101.stdout: "description": "osd_op(client.4668.0:89486 5.2 5:445f7d51:::benchmark_data_smithi006_114134_object89485:head [set-alloc-hint object_size 65536 write_size 65536,write 0~65536 in=65536b] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e35)", 2023-08-01T19:54:59.672 INFO:teuthology.orchestra.run.smithi101.stdout: "initiated_at": "2023-08-01T19:54:59.643808+0000", 2023-08-01T19:54:59.672 INFO:teuthology.orchestra.run.smithi101.stdout: "age": 0.00319863, 2023-08-01T19:54:59.673 INFO:teuthology.orchestra.run.smithi101.stdout: "duration": 0.0034873489999999998, 2023-08-01T19:54:59.673 INFO:teuthology.orchestra.run.smithi101.stdout: "type_data": { 2023-08-01T19:54:59.673 INFO:teuthology.orchestra.run.smithi101.stdout: "flag_point": "waiting for sub ops", 2023-08-01T19:54:59.673 INFO:teuthology.orchestra.run.smithi101.stdout: "client_info": { 2023-08-01T19:54:59.673 INFO:teuthology.orchestra.run.smithi101.stdout: "client": "client.4668", 2023-08-01T19:54:59.673 INFO:teuthology.orchestra.run.smithi101.stdout: "client_addr": "172.21.15.6:0/1709472247", 2023-08-01T19:54:59.673 INFO:teuthology.orchestra.run.smithi101.stdout: "tid": 89486 2023-08-01T19:54:59.674 INFO:teuthology.orchestra.run.smithi101.stdout: }, 2023-08-01T19:54:59.674 INFO:teuthology.orchestra.run.smithi101.stdout: "events": [ 2023-08-01T19:54:59.674 INFO:teuthology.orchestra.run.smithi101.stdout: { 2023-08-01T19:54:59.674 INFO:teuthology.orchestra.run.smithi101.stdout: "event": "initiated", 2023-08-01T19:54:59.674 INFO:teuthology.orchestra.run.smithi101.stdout: "time": "2023-08-01T19:54:59.643808+0000", 2023-08-01T19:54:59.674 INFO:teuthology.orchestra.run.smithi101.stdout: "duration": 0 2023-08-01T19:54:59.674 INFO:teuthology.orchestra.run.smithi101.stdout: }, 2023-08-01T19:54:59.674 INFO:teuthology.orchestra.run.smithi101.stdout: { 2023-08-01T19:54:59.675 INFO:teuthology.orchestra.run.smithi101.stdout: "event": "throttled", 2023-08-01T19:54:59.675 INFO:teuthology.orchestra.run.smithi101.stdout: "time": "2023-08-01T19:54:59.643808+0000", 2023-08-01T19:54:59.675 INFO:teuthology.orchestra.run.smithi101.stdout: "duration": 0 2023-08-01T19:54:59.675 INFO:teuthology.orchestra.run.smithi101.stdout: }, 2023-08-01T19:54:59.675 INFO:teuthology.orchestra.run.smithi101.stdout: { 2023-08-01T19:54:59.675 INFO:teuthology.orchestra.run.smithi101.stdout: "event": "header_read", 2023-08-01T19:54:59.675 INFO:teuthology.orchestra.run.smithi101.stdout: "time": "2023-08-01T19:54:59.643807+0000", 2023-08-01T19:54:59.675 INFO:teuthology.orchestra.run.smithi101.stdout: "duration": 4294967295.9999986 2023-08-01T19:54:59.676 INFO:teuthology.orchestra.run.smithi101.stdout: }, 2023-08-01T19:54:59.676 INFO:teuthology.orchestra.run.smithi101.stdout: { 2023-08-01T19:54:59.676 INFO:teuthology.orchestra.run.smithi101.stdout: "event": "all_read", 2023-08-01T19:54:59.676 INFO:teuthology.orchestra.run.smithi101.stdout: "time": "2023-08-01T19:54:59.643912+0000", 2023-08-01T19:54:59.676 INFO:teuthology.orchestra.run.smithi101.stdout: "duration": 0.00010572499999999999 2023-08-01T19:54:59.676 INFO:teuthology.orchestra.run.smithi101.stdout: }, 2023-08-01T19:54:59.676 INFO:teuthology.orchestra.run.smithi101.stdout: { 2023-08-01T19:54:59.677 INFO:teuthology.orchestra.run.smithi101.stdout: "event": "dispatched", 2023-08-01T19:54:59.677 INFO:teuthology.orchestra.run.smithi101.stdout: "time": "2023-08-01T19:54:59.643926+0000", 2023-08-01T19:54:59.677 INFO:teuthology.orchestra.run.smithi101.stdout: "duration": 1.3525e-05 2023-08-01T19:54:59.677 INFO:teuthology.orchestra.run.smithi101.stdout: }, 2023-08-01T19:54:59.677 INFO:teuthology.orchestra.run.smithi101.stdout: { 2023-08-01T19:54:59.677 INFO:teuthology.orchestra.run.smithi101.stdout: "event": "queued_for_pg", 2023-08-01T19:54:59.677 INFO:teuthology.orchestra.run.smithi101.stdout: "time": "2023-08-01T19:54:59.643934+0000", 2023-08-01T19:54:59.677 INFO:teuthology.orchestra.run.smithi101.stdout: "duration": 7.8320000000000006e-06 2023-08-01T19:54:59.678 INFO:teuthology.orchestra.run.smithi101.stdout: }, 2023-08-01T19:54:59.678 INFO:teuthology.orchestra.run.smithi101.stdout: { 2023-08-01T19:54:59.678 INFO:teuthology.orchestra.run.smithi101.stdout: "event": "reached_pg", 2023-08-01T19:54:59.678 INFO:teuthology.orchestra.run.smithi101.stdout: "time": "2023-08-01T19:54:59.643968+0000", 2023-08-01T19:54:59.678 INFO:teuthology.orchestra.run.smithi101.stdout: "duration": 3.4456999999999999e-05 2023-08-01T19:54:59.678 INFO:teuthology.orchestra.run.smithi101.stdout: }, 2023-08-01T19:54:59.678 INFO:teuthology.orchestra.run.smithi101.stdout: { 2023-08-01T19:54:59.679 INFO:teuthology.orchestra.run.smithi101.stdout: "event": "started", 2023-08-01T19:54:59.679 INFO:teuthology.orchestra.run.smithi101.stdout: "time": "2023-08-01T19:54:59.644110+0000", 2023-08-01T19:54:59.679 INFO:teuthology.orchestra.run.smithi101.stdout: "duration": 0.00014234499999999999 2023-08-01T19:54:59.679 INFO:teuthology.orchestra.run.smithi101.stdout: }, 2023-08-01T19:54:59.679 INFO:teuthology.orchestra.run.smithi101.stdout: { 2023-08-01T19:54:59.679 INFO:teuthology.orchestra.run.smithi101.stdout: "event": "waiting for subops from 0", 2023-08-01T19:54:59.679 INFO:teuthology.orchestra.run.smithi101.stdout: "time": "2023-08-01T19:54:59.644254+0000", 2023-08-01T19:54:59.679 INFO:teuthology.orchestra.run.smithi101.stdout: "duration": 0.00014374900000000001 2023-08-01T19:54:59.680 INFO:teuthology.orchestra.run.smithi101.stdout: } 2023-08-01T19:54:59.680 INFO:teuthology.orchestra.run.smithi101.stdout: ] 2023-08-01T19:54:59.680 INFO:teuthology.orchestra.run.smithi101.stdout: } 2023-08-01T19:54:59.680 INFO:teuthology.orchestra.run.smithi101.stdout: }, 2023-08-01T19:54:59.680 INFO:teuthology.orchestra.run.smithi101.stdout: { 2023-08-01T19:54:59.680 INFO:teuthology.orchestra.run.smithi101.stdout: "description": "osd_repop(client.4668.0:89477 5.3 e35/19 5:c623da77:::benchmark_data_smithi006_114134_object89476:head v 35'5645, mlcod=35'5641)", 2023-08-01T19:54:59.680 INFO:teuthology.orchestra.run.smithi101.stdout: "initiated_at": "2023-08-01T19:54:59.644119+0000", 2023-08-01T19:54:59.680 INFO:teuthology.orchestra.run.smithi101.stdout: "age": 0.0028877550000000001, 2023-08-01T19:54:59.681 INFO:teuthology.orchestra.run.smithi101.stdout: "duration": 0.0032363890000000001, 2023-08-01T19:54:59.681 INFO:teuthology.orchestra.run.smithi101.stdout: "type_data": { 2023-08-01T19:54:59.681 INFO:teuthology.orchestra.run.smithi101.stdout: "flag_point": "started", 2023-08-01T19:54:59.681 INFO:teuthology.orchestra.run.smithi101.stdout: "events": [ 2023-08-01T19:54:59.681 INFO:teuthology.orchestra.run.smithi101.stdout: { 2023-08-01T19:54:59.681 INFO:teuthology.orchestra.run.smithi101.stdout: "event": "initiated", 2023-08-01T19:54:59.681 INFO:teuthology.orchestra.run.smithi101.stdout: "time": "2023-08-01T19:54:59.644119+0000", 2023-08-01T19:54:59.682 INFO:teuthology.orchestra.run.smithi101.stdout: "duration": 0 2023-08-01T19:54:59.682 INFO:teuthology.orchestra.run.smithi101.stdout: }, 2023-08-01T19:54:59.682 INFO:teuthology.orchestra.run.smithi101.stdout: { 2023-08-01T19:54:59.682 INFO:teuthology.orchestra.run.smithi101.stdout: "event": "throttled", 2023-08-01T19:54:59.682 INFO:teuthology.orchestra.run.smithi101.stdout: "time": "2023-08-01T19:54:59.644119+0000", 2023-08-01T19:54:59.682 INFO:teuthology.orchestra.run.smithi101.stdout: "duration": 0 2023-08-01T19:54:59.682 INFO:teuthology.orchestra.run.smithi101.stdout: }, 2023-08-01T19:54:59.683 INFO:teuthology.orchestra.run.smithi101.stdout: { 2023-08-01T19:54:59.683 INFO:teuthology.orchestra.run.smithi101.stdout: "event": "header_read", 2023-08-01T19:54:59.683 INFO:teuthology.orchestra.run.smithi101.stdout: "time": "2023-08-01T19:54:59.644118+0000", 2023-08-01T19:54:59.683 INFO:teuthology.orchestra.run.smithi101.stdout: "duration": 4294967295.9999995 2023-08-01T19:54:59.683 INFO:teuthology.orchestra.run.smithi101.stdout: }, 2023-08-01T19:54:59.683 INFO:teuthology.orchestra.run.smithi101.stdout: { 2023-08-01T19:54:59.683 INFO:teuthology.orchestra.run.smithi101.stdout: "event": "all_read", 2023-08-01T19:54:59.683 INFO:teuthology.orchestra.run.smithi101.stdout: "time": "2023-08-01T19:54:59.644186+0000", 2023-08-01T19:54:59.684 INFO:teuthology.orchestra.run.smithi101.stdout: "duration": 6.7510999999999998e-05 2023-08-01T19:54:59.684 INFO:teuthology.orchestra.run.smithi101.stdout: }, 2023-08-01T19:54:59.684 INFO:teuthology.orchestra.run.smithi101.stdout: { 2023-08-01T19:54:59.684 INFO:teuthology.orchestra.run.smithi101.stdout: "event": "dispatched", 2023-08-01T19:54:59.684 INFO:teuthology.orchestra.run.smithi101.stdout: "time": "2023-08-01T19:54:59.644191+0000", 2023-08-01T19:54:59.684 INFO:teuthology.orchestra.run.smithi101.stdout: "duration": 5.2190000000000003e-06 2023-08-01T19:54:59.684 INFO:teuthology.orchestra.run.smithi101.stdout: }, 2023-08-01T19:54:59.685 INFO:teuthology.orchestra.run.smithi101.stdout: { 2023-08-01T19:54:59.685 INFO:teuthology.orchestra.run.smithi101.stdout: "event": "queued_for_pg", 2023-08-01T19:54:59.685 INFO:teuthology.orchestra.run.smithi101.stdout: "time": "2023-08-01T19:54:59.644194+0000", 2023-08-01T19:54:59.685 INFO:teuthology.orchestra.run.smithi101.stdout: "duration": 2.8779999999999998e-06 2023-08-01T19:54:59.685 INFO:teuthology.orchestra.run.smithi101.stdout: }, 2023-08-01T19:54:59.685 INFO:teuthology.orchestra.run.smithi101.stdout: { 2023-08-01T19:54:59.685 INFO:teuthology.orchestra.run.smithi101.stdout: "event": "reached_pg", 2023-08-01T19:54:59.685 INFO:teuthology.orchestra.run.smithi101.stdout: "time": "2023-08-01T19:54:59.644229+0000", 2023-08-01T19:54:59.686 INFO:teuthology.orchestra.run.smithi101.stdout: "duration": 3.4962999999999997e-05 2023-08-01T19:54:59.686 INFO:teuthology.orchestra.run.smithi101.stdout: }, 2023-08-01T19:54:59.686 INFO:teuthology.orchestra.run.smithi101.stdout: { 2023-08-01T19:54:59.686 INFO:teuthology.orchestra.run.smithi101.stdout: "event": "started", 2023-08-01T19:54:59.686 INFO:teuthology.orchestra.run.smithi101.stdout: "time": "2023-08-01T19:54:59.644247+0000", 2023-08-01T19:54:59.686 INFO:teuthology.orchestra.run.smithi101.stdout: "duration": 1.8006e-05 2023-08-01T19:54:59.686 INFO:teuthology.orchestra.run.smithi101.stdout: } 2023-08-01T19:54:59.686 INFO:teuthology.orchestra.run.smithi101.stdout: ] 2023-08-01T19:54:59.687 INFO:teuthology.orchestra.run.smithi101.stdout: } 2023-08-01T19:54:59.687 INFO:teuthology.orchestra.run.smithi101.stdout: }, 2023-08-01T19:54:59.687 INFO:teuthology.orchestra.run.smithi101.stdout: { 2023-08-01T19:54:59.687 INFO:teuthology.orchestra.run.smithi101.stdout: "description": "osd_repop(client.4668.0:89487 5.5 e35/19 5:ab6d16a3:::benchmark_data_smithi006_114134_object89486:head v 35'5558, mlcod=35'5556)", 2023-08-01T19:54:59.687 INFO:teuthology.orchestra.run.smithi101.stdout: "initiated_at": "2023-08-01T19:54:59.644308+0000", 2023-08-01T19:54:59.687 INFO:teuthology.orchestra.run.smithi101.stdout: "age": 0.002698481, 2023-08-01T19:54:59.687 INFO:teuthology.orchestra.run.smithi101.stdout: "duration": 0.0030826600000000001, 2023-08-01T19:54:59.688 INFO:teuthology.orchestra.run.smithi101.stdout: "type_data": { 2023-08-01T19:54:59.688 INFO:teuthology.orchestra.run.smithi101.stdout: "flag_point": "started", 2023-08-01T19:54:59.688 INFO:teuthology.orchestra.run.smithi101.stdout: "events": [ 2023-08-01T19:54:59.688 INFO:teuthology.orchestra.run.smithi101.stdout: { 2023-08-01T19:54:59.688 INFO:teuthology.orchestra.run.smithi101.stdout: "event": "initiated", 2023-08-01T19:54:59.688 INFO:teuthology.orchestra.run.smithi101.stdout: "time": "2023-08-01T19:54:59.644308+0000", 2023-08-01T19:54:59.688 INFO:teuthology.orchestra.run.smithi101.stdout: "duration": 0 2023-08-01T19:54:59.689 INFO:teuthology.orchestra.run.smithi101.stdout: }, 2023-08-01T19:54:59.689 INFO:teuthology.orchestra.run.smithi101.stdout: { 2023-08-01T19:54:59.689 INFO:teuthology.orchestra.run.smithi101.stdout: "event": "throttled", 2023-08-01T19:54:59.689 INFO:teuthology.orchestra.run.smithi101.stdout: "time": "2023-08-01T19:54:59.644308+0000", 2023-08-01T19:54:59.689 INFO:teuthology.orchestra.run.smithi101.stdout: "duration": 0 2023-08-01T19:54:59.689 INFO:teuthology.orchestra.run.smithi101.stdout: }, 2023-08-01T19:54:59.689 INFO:teuthology.orchestra.run.smithi101.stdout: { 2023-08-01T19:54:59.689 INFO:teuthology.orchestra.run.smithi101.stdout: "event": "header_read", 2023-08-01T19:54:59.690 INFO:teuthology.orchestra.run.smithi101.stdout: "time": "2023-08-01T19:54:59.644308+0000", 2023-08-01T19:54:59.690 INFO:teuthology.orchestra.run.smithi101.stdout: "duration": 4294967295.9999995 2023-08-01T19:54:59.690 INFO:teuthology.orchestra.run.smithi101.stdout: }, 2023-08-01T19:54:59.690 INFO:teuthology.orchestra.run.smithi101.stdout: { 2023-08-01T19:54:59.690 INFO:teuthology.orchestra.run.smithi101.stdout: "event": "all_read", 2023-08-01T19:54:59.690 INFO:teuthology.orchestra.run.smithi101.stdout: "time": "2023-08-01T19:54:59.644352+0000", 2023-08-01T19:54:59.690 INFO:teuthology.orchestra.run.smithi101.stdout: "duration": 4.3988e-05 2023-08-01T19:54:59.690 INFO:teuthology.orchestra.run.smithi101.stdout: }, 2023-08-01T19:54:59.691 INFO:teuthology.orchestra.run.smithi101.stdout: { 2023-08-01T19:54:59.691 INFO:teuthology.orchestra.run.smithi101.stdout: "event": "dispatched", 2023-08-01T19:54:59.691 INFO:teuthology.orchestra.run.smithi101.stdout: "time": "2023-08-01T19:54:59.644356+0000", 2023-08-01T19:54:59.691 INFO:teuthology.orchestra.run.smithi101.stdout: "duration": 4.605e-06 2023-08-01T19:54:59.691 INFO:teuthology.orchestra.run.smithi101.stdout: }, 2023-08-01T19:54:59.691 INFO:teuthology.orchestra.run.smithi101.stdout: { 2023-08-01T19:54:59.691 INFO:teuthology.orchestra.run.smithi101.stdout: "event": "queued_for_pg", 2023-08-01T19:54:59.691 INFO:teuthology.orchestra.run.smithi101.stdout: "time": "2023-08-01T19:54:59.644359+0000", 2023-08-01T19:54:59.692 INFO:teuthology.orchestra.run.smithi101.stdout: "duration": 2.6929999999999999e-06 2023-08-01T19:54:59.692 INFO:teuthology.orchestra.run.smithi101.stdout: }, 2023-08-01T19:54:59.692 INFO:teuthology.orchestra.run.smithi101.stdout: { 2023-08-01T19:54:59.692 INFO:teuthology.orchestra.run.smithi101.stdout: "event": "reached_pg", 2023-08-01T19:54:59.692 INFO:teuthology.orchestra.run.smithi101.stdout: "time": "2023-08-01T19:54:59.644388+0000", 2023-08-01T19:54:59.692 INFO:teuthology.orchestra.run.smithi101.stdout: "duration": 2.8997e-05 2023-08-01T19:54:59.692 INFO:teuthology.orchestra.run.smithi101.stdout: }, 2023-08-01T19:54:59.692 INFO:teuthology.orchestra.run.smithi101.stdout: { 2023-08-01T19:54:59.693 INFO:teuthology.orchestra.run.smithi101.stdout: "event": "started", 2023-08-01T19:54:59.693 INFO:teuthology.orchestra.run.smithi101.stdout: "time": "2023-08-01T19:54:59.644400+0000", 2023-08-01T19:54:59.693 INFO:teuthology.orchestra.run.smithi101.stdout: "duration": 1.1440999999999999e-05 2023-08-01T19:54:59.693 INFO:teuthology.orchestra.run.smithi101.stdout: } 2023-08-01T19:54:59.693 INFO:teuthology.orchestra.run.smithi101.stdout: ] 2023-08-01T19:54:59.693 INFO:teuthology.orchestra.run.smithi101.stdout: } 2023-08-01T19:54:59.693 INFO:teuthology.orchestra.run.smithi101.stdout: } 2023-08-01T19:54:59.693 INFO:teuthology.orchestra.run.smithi101.stdout: ], 2023-08-01T19:54:59.694 INFO:teuthology.orchestra.run.smithi101.stdout: "num_ops": 6 2023-08-01T19:54:59.694 INFO:teuthology.orchestra.run.smithi101.stdout:} 2023-08-01T19:54:59.695 DEBUG:teuthology.orchestra.run.smithi101:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 30 ceph --cluster ceph --admin-daemon /var/run/ceph/ceph-osd.1.asok dump_blocked_ops 2023-08-01T19:54:59.696 INFO:tasks.ceph.osd.0.smithi008.stderr:2023-08-01T19:54:59.694+0000 7f16a58f4700 -1 received signal: Hangup from /usr/bin/python3 /bin/daemon-helper kill ceph-osd -f --cluster ceph -i 0 (PID: 111179) UID: 0 2023-08-01T19:54:59.795 INFO:tasks.ceph.osd.0.smithi008.stderr:2023-08-01T19:54:59.795+0000 7f16a58f4700 -1 received signal: Hangup from /usr/bin/python3 /bin/daemon-helper kill ceph-osd -f --cluster ceph -i 0 (PID: 111179) UID: 0 2023-08-01T19:54:59.866 INFO:teuthology.orchestra.run.smithi101.stdout:{ 2023-08-01T19:54:59.866 INFO:teuthology.orchestra.run.smithi101.stdout: "ops": [], 2023-08-01T19:54:59.866 INFO:teuthology.orchestra.run.smithi101.stdout: "complaint_time": 30, 2023-08-01T19:54:59.866 INFO:teuthology.orchestra.run.smithi101.stdout: "num_blocked_ops": 0 2023-08-01T19:54:59.867 INFO:teuthology.orchestra.run.smithi101.stdout:} 2023-08-01T19:54:59.878 DEBUG:teuthology.orchestra.run.smithi101:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 30 ceph --cluster ceph --admin-daemon /var/run/ceph/ceph-osd.1.asok dump_historic_ops 2023-08-01T19:54:59.896 INFO:tasks.ceph.osd.2.smithi155.stderr:2023-08-01T19:54:59.895+0000 7faa5c6ac700 -1 received signal: Hangup from /usr/bin/python3 /bin/daemon-helper kill ceph-osd -f --cluster ceph -i 2 (PID: 111337) UID: 0 2023-08-01T19:54:59.997 INFO:tasks.ceph.osd.2.smithi155.stderr:2023-08-01T19:54:59.995+0000 7faa5c6ac700 -1 received signal: Hangup from /usr/bin/python3 /bin/daemon-helper kill ceph-osd -f --cluster ceph -i 2 (PID: 111337) UID: 0 2023-08-01T19:55:00.050 INFO:teuthology.orchestra.run.smithi101.stdout:{ 2023-08-01T19:55:00.051 INFO:teuthology.orchestra.run.smithi101.stdout: "size": 20, 2023-08-01T19:55:00.051 INFO:teuthology.orchestra.run.smithi101.stdout: "duration": 600, 2023-08-01T19:55:00.051 INFO:teuthology.orchestra.run.smithi101.stdout: "ops": [ 2023-08-01T19:55:00.051 INFO:teuthology.orchestra.run.smithi101.stdout: { 2023-08-01T19:55:00.051 INFO:teuthology.orchestra.run.smithi101.stdout: "description": "osd_op(mds.0.3:6 3.10 3:0d82a743:::600.00000000:head [omap-set-header] snapc 0=[] ondisk+write+known_if_redirected+full_force+supports_pool_eio e17)", 2023-08-01T19:55:00.052 INFO:teuthology.orchestra.run.smithi101.stdout: "initiated_at": "2023-08-01T19:54:04.458774+0000", 2023-08-01T19:55:00.052 INFO:teuthology.orchestra.run.smithi101.stdout: "age": 55.588227789000001, 2023-08-01T19:55:00.052 INFO:teuthology.orchestra.run.smithi101.stdout: "duration": 0.017582611000000001, 2023-08-01T19:55:00.052 INFO:teuthology.orchestra.run.smithi101.stdout: "type_data": { 2023-08-01T19:55:00.052 INFO:teuthology.orchestra.run.smithi101.stdout: "flag_point": "commit sent; apply or cleanup", 2023-08-01T19:55:00.052 INFO:teuthology.orchestra.run.smithi101.stdout: "events": [ 2023-08-01T19:55:00.052 INFO:teuthology.orchestra.run.smithi101.stdout: { 2023-08-01T19:55:00.052 INFO:teuthology.orchestra.run.smithi101.stdout: "event": "initiated", 2023-08-01T19:55:00.053 INFO:teuthology.orchestra.run.smithi101.stdout: "time": "2023-08-01T19:54:04.458774+0000", 2023-08-01T19:55:00.053 INFO:teuthology.orchestra.run.smithi101.stdout: "duration": 0 2023-08-01T19:55:00.053 INFO:teuthology.orchestra.run.smithi101.stdout: }, 2023-08-01T19:55:00.053 INFO:teuthology.orchestra.run.smithi101.stdout: { 2023-08-01T19:55:00.053 INFO:teuthology.orchestra.run.smithi101.stdout: "event": "throttled", 2023-08-01T19:55:00.053 INFO:teuthology.orchestra.run.smithi101.stdout: "time": "2023-08-01T19:54:04.458774+0000", 2023-08-01T19:55:00.053 INFO:teuthology.orchestra.run.smithi101.stdout: "duration": 0 2023-08-01T19:55:00.054 INFO:teuthology.orchestra.run.smithi101.stdout: }, 2023-08-01T19:55:00.054 INFO:teuthology.orchestra.run.smithi101.stdout: { 2023-08-01T19:55:00.054 INFO:teuthology.orchestra.run.smithi101.stdout: "event": "header_read", 2023-08-01T19:55:00.054 INFO:teuthology.orchestra.run.smithi101.stdout: "time": "2023-08-01T19:54:04.458772+0000", 2023-08-01T19:55:00.054 INFO:teuthology.orchestra.run.smithi101.stdout: "duration": 4294967295.9999981 2023-08-01T19:55:00.054 INFO:teuthology.orchestra.run.smithi101.stdout: }, 2023-08-01T19:55:00.054 INFO:teuthology.orchestra.run.smithi101.stdout: { 2023-08-01T19:55:00.054 INFO:teuthology.orchestra.run.smithi101.stdout: "event": "all_read", 2023-08-01T19:55:00.055 INFO:teuthology.orchestra.run.smithi101.stdout: "time": "2023-08-01T19:54:04.458781+0000", 2023-08-01T19:55:00.055 INFO:teuthology.orchestra.run.smithi101.stdout: "duration": 8.6670000000000002e-06 2023-08-01T19:55:00.055 INFO:teuthology.orchestra.run.smithi101.stdout: }, 2023-08-01T19:55:00.055 INFO:teuthology.orchestra.run.smithi101.stdout: { 2023-08-01T19:55:00.055 INFO:teuthology.orchestra.run.smithi101.stdout: "event": "dispatched", 2023-08-01T19:55:00.055 INFO:teuthology.orchestra.run.smithi101.stdout: "time": "2023-08-01T19:54:04.458797+0000", 2023-08-01T19:55:00.055 INFO:teuthology.orchestra.run.smithi101.stdout: "duration": 1.6463000000000001e-05 2023-08-01T19:55:00.055 INFO:teuthology.orchestra.run.smithi101.stdout: }, 2023-08-01T19:55:00.056 INFO:teuthology.orchestra.run.smithi101.stdout: { 2023-08-01T19:55:00.056 INFO:teuthology.orchestra.run.smithi101.stdout: "event": "queued_for_pg", 2023-08-01T19:55:00.056 INFO:teuthology.orchestra.run.smithi101.stdout: "time": "2023-08-01T19:54:04.458810+0000", 2023-08-01T19:55:00.056 INFO:teuthology.orchestra.run.smithi101.stdout: "duration": 1.2753e-05 2023-08-01T19:55:00.056 INFO:teuthology.orchestra.run.smithi101.stdout: }, 2023-08-01T19:55:00.056 INFO:teuthology.orchestra.run.smithi101.stdout: { 2023-08-01T19:55:00.056 INFO:teuthology.orchestra.run.smithi101.stdout: "event": "reached_pg", 2023-08-01T19:55:00.057 INFO:teuthology.orchestra.run.smithi101.stdout: "time": "2023-08-01T19:54:04.458866+0000", 2023-08-01T19:55:00.057 INFO:teuthology.orchestra.run.smithi101.stdout: "duration": 5.6625000000000001e-05 2023-08-01T19:55:00.057 INFO:teuthology.orchestra.run.smithi101.stdout: }, 2023-08-01T19:55:00.057 INFO:teuthology.orchestra.run.smithi101.stdout: { 2023-08-01T19:55:00.057 INFO:teuthology.orchestra.run.smithi101.stdout: "event": "op must wait for map", 2023-08-01T19:55:00.057 INFO:teuthology.orchestra.run.smithi101.stdout: "time": "2023-08-01T19:54:04.458873+0000", 2023-08-01T19:55:00.057 INFO:teuthology.orchestra.run.smithi101.stdout: "duration": 6.9110000000000004e-06 2023-08-01T19:55:00.057 INFO:teuthology.orchestra.run.smithi101.stdout: }, 2023-08-01T19:55:00.058 INFO:teuthology.orchestra.run.smithi101.stdout: { 2023-08-01T19:55:00.058 INFO:teuthology.orchestra.run.smithi101.stdout: "event": "reached_pg", 2023-08-01T19:55:00.058 INFO:teuthology.orchestra.run.smithi101.stdout: "time": "2023-08-01T19:54:04.466999+0000", 2023-08-01T19:55:00.058 INFO:teuthology.orchestra.run.smithi101.stdout: "duration": 0.0081256550000000007 2023-08-01T19:55:00.058 INFO:teuthology.orchestra.run.smithi101.stdout: }, 2023-08-01T19:55:00.058 INFO:teuthology.orchestra.run.smithi101.stdout: { 2023-08-01T19:55:00.058 INFO:teuthology.orchestra.run.smithi101.stdout: "event": "started", 2023-08-01T19:55:00.059 INFO:teuthology.orchestra.run.smithi101.stdout: "time": "2023-08-01T19:54:04.467201+0000", 2023-08-01T19:55:00.059 INFO:teuthology.orchestra.run.smithi101.stdout: "duration": 0.00020166199999999999 2023-08-01T19:55:00.059 INFO:teuthology.orchestra.run.smithi101.stdout: }, 2023-08-01T19:55:00.059 INFO:teuthology.orchestra.run.smithi101.stdout: { 2023-08-01T19:55:00.059 INFO:teuthology.orchestra.run.smithi101.stdout: "event": "waiting for subops from 2", 2023-08-01T19:55:00.059 INFO:teuthology.orchestra.run.smithi101.stdout: "time": "2023-08-01T19:54:04.467350+0000", 2023-08-01T19:55:00.059 INFO:teuthology.orchestra.run.smithi101.stdout: "duration": 0.000149173 2023-08-01T19:55:00.059 INFO:teuthology.orchestra.run.smithi101.stdout: }, 2023-08-01T19:55:00.060 INFO:teuthology.orchestra.run.smithi101.stdout: { 2023-08-01T19:55:00.060 INFO:teuthology.orchestra.run.smithi101.stdout: "event": "op_commit", 2023-08-01T19:55:00.060 INFO:teuthology.orchestra.run.smithi101.stdout: "time": "2023-08-01T19:54:04.476168+0000", 2023-08-01T19:55:00.060 INFO:teuthology.orchestra.run.smithi101.stdout: "duration": 0.0088183250000000001 2023-08-01T19:55:00.060 INFO:teuthology.orchestra.run.smithi101.stdout: }, 2023-08-01T19:55:00.060 INFO:teuthology.orchestra.run.smithi101.stdout: { 2023-08-01T19:55:00.060 INFO:teuthology.orchestra.run.smithi101.stdout: "event": "sub_op_commit_rec", 2023-08-01T19:55:00.060 INFO:teuthology.orchestra.run.smithi101.stdout: "time": "2023-08-01T19:54:04.476239+0000", 2023-08-01T19:55:00.061 INFO:teuthology.orchestra.run.smithi101.stdout: "duration": 7.1296000000000003e-05 2023-08-01T19:55:00.061 INFO:teuthology.orchestra.run.smithi101.stdout: }, 2023-08-01T19:55:00.061 INFO:teuthology.orchestra.run.smithi101.stdout: { 2023-08-01T19:55:00.061 INFO:teuthology.orchestra.run.smithi101.stdout: "event": "commit_sent", 2023-08-01T19:55:00.061 INFO:teuthology.orchestra.run.smithi101.stdout: "time": "2023-08-01T19:54:04.476290+0000", 2023-08-01T19:55:00.061 INFO:teuthology.orchestra.run.smithi101.stdout: "duration": 5.0423999999999997e-05 2023-08-01T19:55:00.061 INFO:teuthology.orchestra.run.smithi101.stdout: }, 2023-08-01T19:55:00.062 INFO:teuthology.orchestra.run.smithi101.stdout: { 2023-08-01T19:55:00.062 INFO:teuthology.orchestra.run.smithi101.stdout: "event": "done", 2023-08-01T19:55:00.062 INFO:teuthology.orchestra.run.smithi101.stdout: "time": "2023-08-01T19:54:04.476356+0000", 2023-08-01T19:55:00.062 INFO:teuthology.orchestra.run.smithi101.stdout: "duration": 6.6439000000000005e-05 2023-08-01T19:55:00.062 INFO:teuthology.orchestra.run.smithi101.stdout: } 2023-08-01T19:55:00.062 INFO:teuthology.orchestra.run.smithi101.stdout: ] 2023-08-01T19:55:00.062 INFO:teuthology.orchestra.run.smithi101.stdout: } 2023-08-01T19:55:00.062 INFO:teuthology.orchestra.run.smithi101.stdout: }, 2023-08-01T19:55:00.063 INFO:teuthology.orchestra.run.smithi101.stdout: { 2023-08-01T19:55:00.063 INFO:teuthology.orchestra.run.smithi101.stdout: "description": "osd_op(mds.0.3:7 3.10 3:0d82a743:::600.00000000:head [create,setxattr parent (62) in=6b,setxattr layout (30) in=6b] snapc 0=[] ondisk+write+known_if_redirected+full_force+supports_pool_eio e17)", 2023-08-01T19:55:00.063 INFO:teuthology.orchestra.run.smithi101.stdout: "initiated_at": "2023-08-01T19:54:04.458830+0000", 2023-08-01T19:55:00.063 INFO:teuthology.orchestra.run.smithi101.stdout: "age": 55.588171402, 2023-08-01T19:55:00.063 INFO:teuthology.orchestra.run.smithi101.stdout: "duration": 0.018463726, 2023-08-01T19:55:00.063 INFO:teuthology.orchestra.run.smithi101.stdout: "type_data": { 2023-08-01T19:55:00.063 INFO:teuthology.orchestra.run.smithi101.stdout: "flag_point": "commit sent; apply or cleanup", 2023-08-01T19:55:00.064 INFO:teuthology.orchestra.run.smithi101.stdout: "events": [ 2023-08-01T19:55:00.064 INFO:teuthology.orchestra.run.smithi101.stdout: { 2023-08-01T19:55:00.064 INFO:teuthology.orchestra.run.smithi101.stdout: "event": "initiated", 2023-08-01T19:55:00.064 INFO:teuthology.orchestra.run.smithi101.stdout: "time": "2023-08-01T19:54:04.458830+0000", 2023-08-01T19:55:00.064 INFO:teuthology.orchestra.run.smithi101.stdout: "duration": 0 2023-08-01T19:55:00.064 INFO:teuthology.orchestra.run.smithi101.stdout: }, 2023-08-01T19:55:00.064 INFO:teuthology.orchestra.run.smithi101.stdout: { 2023-08-01T19:55:00.064 INFO:teuthology.orchestra.run.smithi101.stdout: "event": "throttled", 2023-08-01T19:55:00.065 INFO:teuthology.orchestra.run.smithi101.stdout: "time": "2023-08-01T19:54:04.458830+0000", 2023-08-01T19:55:00.065 INFO:teuthology.orchestra.run.smithi101.stdout: "duration": 0 2023-08-01T19:55:00.065 INFO:teuthology.orchestra.run.smithi101.stdout: }, 2023-08-01T19:55:00.065 INFO:teuthology.orchestra.run.smithi101.stdout: { 2023-08-01T19:55:00.065 INFO:teuthology.orchestra.run.smithi101.stdout: "event": "header_read", 2023-08-01T19:55:00.065 INFO:teuthology.orchestra.run.smithi101.stdout: "time": "2023-08-01T19:54:04.458829+0000", 2023-08-01T19:55:00.065 INFO:teuthology.orchestra.run.smithi101.stdout: "duration": 4294967295.999999 2023-08-01T19:55:00.066 INFO:teuthology.orchestra.run.smithi101.stdout: }, 2023-08-01T19:55:00.066 INFO:teuthology.orchestra.run.smithi101.stdout: { 2023-08-01T19:55:00.066 INFO:teuthology.orchestra.run.smithi101.stdout: "event": "all_read", 2023-08-01T19:55:00.066 INFO:teuthology.orchestra.run.smithi101.stdout: "time": "2023-08-01T19:54:04.458838+0000", 2023-08-01T19:55:00.066 INFO:teuthology.orchestra.run.smithi101.stdout: "duration": 8.5369999999999997e-06 2023-08-01T19:55:00.066 INFO:teuthology.orchestra.run.smithi101.stdout: }, 2023-08-01T19:55:00.066 INFO:teuthology.orchestra.run.smithi101.stdout: { 2023-08-01T19:55:00.066 INFO:teuthology.orchestra.run.smithi101.stdout: "event": "dispatched", 2023-08-01T19:55:00.067 INFO:teuthology.orchestra.run.smithi101.stdout: "time": "2023-08-01T19:54:04.458850+0000", 2023-08-01T19:55:00.067 INFO:teuthology.orchestra.run.smithi101.stdout: "duration": 1.203e-05 2023-08-01T19:55:00.067 INFO:teuthology.orchestra.run.smithi101.stdout: }, 2023-08-01T19:55:00.067 INFO:teuthology.orchestra.run.smithi101.stdout: { 2023-08-01T19:55:00.067 INFO:teuthology.orchestra.run.smithi101.stdout: "event": "queued_for_pg", 2023-08-01T19:55:00.067 INFO:teuthology.orchestra.run.smithi101.stdout: "time": "2023-08-01T19:54:04.458859+0000", 2023-08-01T19:55:00.067 INFO:teuthology.orchestra.run.smithi101.stdout: "duration": 8.9889999999999998e-06 2023-08-01T19:55:00.067 INFO:teuthology.orchestra.run.smithi101.stdout: }, 2023-08-01T19:55:00.068 INFO:teuthology.orchestra.run.smithi101.stdout: { 2023-08-01T19:55:00.068 INFO:teuthology.orchestra.run.smithi101.stdout: "event": "reached_pg", 2023-08-01T19:55:00.068 INFO:teuthology.orchestra.run.smithi101.stdout: "time": "2023-08-01T19:54:04.458926+0000", 2023-08-01T19:55:00.068 INFO:teuthology.orchestra.run.smithi101.stdout: "duration": 6.6741000000000004e-05 2023-08-01T19:55:00.068 INFO:teuthology.orchestra.run.smithi101.stdout: }, 2023-08-01T19:55:00.068 INFO:teuthology.orchestra.run.smithi101.stdout: { 2023-08-01T19:55:00.068 INFO:teuthology.orchestra.run.smithi101.stdout: "event": "waiting_for_map not empty", 2023-08-01T19:55:00.068 INFO:teuthology.orchestra.run.smithi101.stdout: "time": "2023-08-01T19:54:04.458929+0000", 2023-08-01T19:55:00.069 INFO:teuthology.orchestra.run.smithi101.stdout: "duration": 3.303e-06 2023-08-01T19:55:00.069 INFO:teuthology.orchestra.run.smithi101.stdout: }, 2023-08-01T19:55:00.069 INFO:teuthology.orchestra.run.smithi101.stdout: { 2023-08-01T19:55:00.069 INFO:teuthology.orchestra.run.smithi101.stdout: "event": "reached_pg", 2023-08-01T19:55:00.069 INFO:teuthology.orchestra.run.smithi101.stdout: "time": "2023-08-01T19:54:04.468692+0000", 2023-08-01T19:55:00.069 INFO:teuthology.orchestra.run.smithi101.stdout: "duration": 0.0097635910000000003 2023-08-01T19:55:00.069 INFO:teuthology.orchestra.run.smithi101.stdout: }, 2023-08-01T19:55:00.070 INFO:teuthology.orchestra.run.smithi101.stdout: { 2023-08-01T19:55:00.070 INFO:teuthology.orchestra.run.smithi101.stdout: "event": "started", 2023-08-01T19:55:00.070 INFO:teuthology.orchestra.run.smithi101.stdout: "time": "2023-08-01T19:54:04.468774+0000", 2023-08-01T19:55:00.070 INFO:teuthology.orchestra.run.smithi101.stdout: "duration": 8.1092000000000002e-05 2023-08-01T19:55:00.070 INFO:teuthology.orchestra.run.smithi101.stdout: }, 2023-08-01T19:55:00.070 INFO:teuthology.orchestra.run.smithi101.stdout: { 2023-08-01T19:55:00.070 INFO:teuthology.orchestra.run.smithi101.stdout: "event": "waiting for subops from 2", 2023-08-01T19:55:00.070 INFO:teuthology.orchestra.run.smithi101.stdout: "time": "2023-08-01T19:54:04.468934+0000", 2023-08-01T19:55:00.071 INFO:teuthology.orchestra.run.smithi101.stdout: "duration": 0.000160027 2023-08-01T19:55:00.071 INFO:teuthology.orchestra.run.smithi101.stdout: }, 2023-08-01T19:55:00.071 INFO:teuthology.orchestra.run.smithi101.stdout: { 2023-08-01T19:55:00.071 INFO:teuthology.orchestra.run.smithi101.stdout: "event": "op_commit", 2023-08-01T19:55:00.071 INFO:teuthology.orchestra.run.smithi101.stdout: "time": "2023-08-01T19:54:04.476174+0000", 2023-08-01T19:55:00.071 INFO:teuthology.orchestra.run.smithi101.stdout: "duration": 0.0072400479999999998 2023-08-01T19:55:00.071 INFO:teuthology.orchestra.run.smithi101.stdout: }, 2023-08-01T19:55:00.071 INFO:teuthology.orchestra.run.smithi101.stdout: { 2023-08-01T19:55:00.072 INFO:teuthology.orchestra.run.smithi101.stdout: "event": "sub_op_commit_rec", 2023-08-01T19:55:00.072 INFO:teuthology.orchestra.run.smithi101.stdout: "time": "2023-08-01T19:54:04.477206+0000", 2023-08-01T19:55:00.072 INFO:teuthology.orchestra.run.smithi101.stdout: "duration": 0.0010318969999999999 2023-08-01T19:55:00.072 INFO:teuthology.orchestra.run.smithi101.stdout: }, 2023-08-01T19:55:00.072 INFO:teuthology.orchestra.run.smithi101.stdout: { 2023-08-01T19:55:00.072 INFO:teuthology.orchestra.run.smithi101.stdout: "event": "commit_sent", 2023-08-01T19:55:00.072 INFO:teuthology.orchestra.run.smithi101.stdout: "time": "2023-08-01T19:54:04.477257+0000", 2023-08-01T19:55:00.072 INFO:teuthology.orchestra.run.smithi101.stdout: "duration": 5.1156000000000003e-05 2023-08-01T19:55:00.073 INFO:teuthology.orchestra.run.smithi101.stdout: }, 2023-08-01T19:55:00.073 INFO:teuthology.orchestra.run.smithi101.stdout: { 2023-08-01T19:55:00.073 INFO:teuthology.orchestra.run.smithi101.stdout: "event": "done", 2023-08-01T19:55:00.073 INFO:teuthology.orchestra.run.smithi101.stdout: "time": "2023-08-01T19:54:04.477294+0000", 2023-08-01T19:55:00.073 INFO:teuthology.orchestra.run.smithi101.stdout: "duration": 3.7150000000000002e-05 2023-08-01T19:55:00.073 INFO:teuthology.orchestra.run.smithi101.stdout: } 2023-08-01T19:55:00.073 INFO:teuthology.orchestra.run.smithi101.stdout: ] 2023-08-01T19:55:00.074 INFO:teuthology.orchestra.run.smithi101.stdout: } 2023-08-01T19:55:00.074 INFO:teuthology.orchestra.run.smithi101.stdout: }, 2023-08-01T19:55:00.074 INFO:teuthology.orchestra.run.smithi101.stdout: { 2023-08-01T19:55:00.074 INFO:teuthology.orchestra.run.smithi101.stdout: "description": "osd_op(mds.0.3:8 3.10 3:09401a81:::601.00000000:head [omap-set-header] snapc 0=[] ondisk+write+known_if_redirected+full_force+supports_pool_eio e17)", 2023-08-01T19:55:00.074 INFO:teuthology.orchestra.run.smithi101.stdout: "initiated_at": "2023-08-01T19:54:04.458869+0000", 2023-08-01T19:55:00.074 INFO:teuthology.orchestra.run.smithi101.stdout: "age": 55.588132266000002, 2023-08-01T19:55:00.074 INFO:teuthology.orchestra.run.smithi101.stdout: "duration": 0.018528932000000001, 2023-08-01T19:55:00.075 INFO:teuthology.orchestra.run.smithi101.stdout: "type_data": { 2023-08-01T19:55:00.075 INFO:teuthology.orchestra.run.smithi101.stdout: "flag_point": "commit sent; apply or cleanup", 2023-08-01T19:55:00.075 INFO:teuthology.orchestra.run.smithi101.stdout: "events": [ 2023-08-01T19:55:00.075 INFO:teuthology.orchestra.run.smithi101.stdout: { 2023-08-01T19:55:00.075 INFO:teuthology.orchestra.run.smithi101.stdout: "event": "initiated", 2023-08-01T19:55:00.075 INFO:teuthology.orchestra.run.smithi101.stdout: "time": "2023-08-01T19:54:04.458869+0000", 2023-08-01T19:55:00.076 INFO:teuthology.orchestra.run.smithi101.stdout: "duration": 0 2023-08-01T19:55:00.076 INFO:teuthology.orchestra.run.smithi101.stdout: }, 2023-08-01T19:55:00.076 INFO:teuthology.orchestra.run.smithi101.stdout: { 2023-08-01T19:55:00.076 INFO:teuthology.orchestra.run.smithi101.stdout: "event": "throttled", 2023-08-01T19:55:00.076 INFO:teuthology.orchestra.run.smithi101.stdout: "time": "2023-08-01T19:54:04.458869+0000", 2023-08-01T19:55:00.076 INFO:teuthology.orchestra.run.smithi101.stdout: "duration": 0 2023-08-01T19:55:00.077 INFO:teuthology.orchestra.run.smithi101.stdout: }, 2023-08-01T19:55:00.077 INFO:teuthology.orchestra.run.smithi101.stdout: { 2023-08-01T19:55:00.077 INFO:teuthology.orchestra.run.smithi101.stdout: "event": "header_read", 2023-08-01T19:55:00.077 INFO:teuthology.orchestra.run.smithi101.stdout: "time": "2023-08-01T19:54:04.458869+0000", 2023-08-01T19:55:00.077 INFO:teuthology.orchestra.run.smithi101.stdout: "duration": 4294967295.9999995 2023-08-01T19:55:00.077 INFO:teuthology.orchestra.run.smithi101.stdout: }, 2023-08-01T19:55:00.077 INFO:teuthology.orchestra.run.smithi101.stdout: { 2023-08-01T19:55:00.078 INFO:teuthology.orchestra.run.smithi101.stdout: "event": "all_read", 2023-08-01T19:55:00.078 INFO:teuthology.orchestra.run.smithi101.stdout: "time": "2023-08-01T19:54:04.458878+0000", 2023-08-01T19:55:00.078 INFO:teuthology.orchestra.run.smithi101.stdout: "duration": 9.4110000000000002e-06 2023-08-01T19:55:00.078 INFO:teuthology.orchestra.run.smithi101.stdout: }, 2023-08-01T19:55:00.078 INFO:teuthology.orchestra.run.smithi101.stdout: { 2023-08-01T19:55:00.078 INFO:teuthology.orchestra.run.smithi101.stdout: "event": "dispatched", 2023-08-01T19:55:00.079 INFO:teuthology.orchestra.run.smithi101.stdout: "time": "2023-08-01T19:54:04.458886+0000", 2023-08-01T19:55:00.079 INFO:teuthology.orchestra.run.smithi101.stdout: "duration": 7.6090000000000003e-06 2023-08-01T19:55:00.079 INFO:teuthology.orchestra.run.smithi101.stdout: }, 2023-08-01T19:55:00.079 INFO:teuthology.orchestra.run.smithi101.stdout: { 2023-08-01T19:55:00.079 INFO:teuthology.orchestra.run.smithi101.stdout: "event": "queued_for_pg", 2023-08-01T19:55:00.079 INFO:teuthology.orchestra.run.smithi101.stdout: "time": "2023-08-01T19:54:04.458890+0000", 2023-08-01T19:55:00.079 INFO:teuthology.orchestra.run.smithi101.stdout: "duration": 4.8470000000000003e-06 2023-08-01T19:55:00.080 INFO:teuthology.orchestra.run.smithi101.stdout: }, 2023-08-01T19:55:00.080 INFO:teuthology.orchestra.run.smithi101.stdout: { 2023-08-01T19:55:00.080 INFO:teuthology.orchestra.run.smithi101.stdout: "event": "reached_pg", 2023-08-01T19:55:00.080 INFO:teuthology.orchestra.run.smithi101.stdout: "time": "2023-08-01T19:54:04.458957+0000", 2023-08-01T19:55:00.080 INFO:teuthology.orchestra.run.smithi101.stdout: "duration": 6.6502999999999997e-05 2023-08-01T19:55:00.080 INFO:teuthology.orchestra.run.smithi101.stdout: }, 2023-08-01T19:55:00.081 INFO:teuthology.orchestra.run.smithi101.stdout: { 2023-08-01T19:55:00.081 INFO:teuthology.orchestra.run.smithi101.stdout: "event": "waiting_for_map not empty", 2023-08-01T19:55:00.081 INFO:teuthology.orchestra.run.smithi101.stdout: "time": "2023-08-01T19:54:04.458959+0000", 2023-08-01T19:55:00.081 INFO:teuthology.orchestra.run.smithi101.stdout: "duration": 2.3989999999999998e-06 2023-08-01T19:55:00.081 INFO:teuthology.orchestra.run.smithi101.stdout: }, 2023-08-01T19:55:00.081 INFO:teuthology.orchestra.run.smithi101.stdout: { 2023-08-01T19:55:00.081 INFO:teuthology.orchestra.run.smithi101.stdout: "event": "reached_pg", 2023-08-01T19:55:00.081 INFO:teuthology.orchestra.run.smithi101.stdout: "time": "2023-08-01T19:54:04.469554+0000", 2023-08-01T19:55:00.082 INFO:teuthology.orchestra.run.smithi101.stdout: "duration": 0.010594404 2023-08-01T19:55:00.082 INFO:teuthology.orchestra.run.smithi101.stdout: }, 2023-08-01T19:55:00.082 INFO:teuthology.orchestra.run.smithi101.stdout: { 2023-08-01T19:55:00.082 INFO:teuthology.orchestra.run.smithi101.stdout: "event": "started", 2023-08-01T19:55:00.082 INFO:teuthology.orchestra.run.smithi101.stdout: "time": "2023-08-01T19:54:04.469694+0000", 2023-08-01T19:55:00.082 INFO:teuthology.orchestra.run.smithi101.stdout: "duration": 0.00014006899999999999 2023-08-01T19:55:00.082 INFO:teuthology.orchestra.run.smithi101.stdout: }, 2023-08-01T19:55:00.083 INFO:teuthology.orchestra.run.smithi101.stdout: { 2023-08-01T19:55:00.083 INFO:teuthology.orchestra.run.smithi101.stdout: "event": "waiting for subops from 2", 2023-08-01T19:55:00.083 INFO:teuthology.orchestra.run.smithi101.stdout: "time": "2023-08-01T19:54:04.469826+0000", 2023-08-01T19:55:00.083 INFO:teuthology.orchestra.run.smithi101.stdout: "duration": 0.000132285 2023-08-01T19:55:00.083 INFO:teuthology.orchestra.run.smithi101.stdout: }, 2023-08-01T19:55:00.083 INFO:teuthology.orchestra.run.smithi101.stdout: { 2023-08-01T19:55:00.083 INFO:teuthology.orchestra.run.smithi101.stdout: "event": "op_commit", 2023-08-01T19:55:00.084 INFO:teuthology.orchestra.run.smithi101.stdout: "time": "2023-08-01T19:54:04.476179+0000", 2023-08-01T19:55:00.084 INFO:teuthology.orchestra.run.smithi101.stdout: "duration": 0.0063524289999999997 2023-08-01T19:55:00.084 INFO:teuthology.orchestra.run.smithi101.stdout: }, 2023-08-01T19:55:00.084 INFO:teuthology.orchestra.run.smithi101.stdout: { 2023-08-01T19:55:00.084 INFO:teuthology.orchestra.run.smithi101.stdout: "event": "sub_op_commit_rec", 2023-08-01T19:55:00.084 INFO:teuthology.orchestra.run.smithi101.stdout: "time": "2023-08-01T19:54:04.477334+0000", 2023-08-01T19:55:00.084 INFO:teuthology.orchestra.run.smithi101.stdout: "duration": 0.0011551070000000001 2023-08-01T19:55:00.085 INFO:teuthology.orchestra.run.smithi101.stdout: }, 2023-08-01T19:55:00.085 INFO:teuthology.orchestra.run.smithi101.stdout: { 2023-08-01T19:55:00.085 INFO:teuthology.orchestra.run.smithi101.stdout: "event": "commit_sent", 2023-08-01T19:55:00.085 INFO:teuthology.orchestra.run.smithi101.stdout: "time": "2023-08-01T19:54:04.477371+0000", 2023-08-01T19:55:00.085 INFO:teuthology.orchestra.run.smithi101.stdout: "duration": 3.7425000000000002e-05 2023-08-01T19:55:00.085 INFO:teuthology.orchestra.run.smithi101.stdout: }, 2023-08-01T19:55:00.085 INFO:teuthology.orchestra.run.smithi101.stdout: { 2023-08-01T19:55:00.085 INFO:teuthology.orchestra.run.smithi101.stdout: "event": "done", 2023-08-01T19:55:00.086 INFO:teuthology.orchestra.run.smithi101.stdout: "time": "2023-08-01T19:54:04.477398+0000", 2023-08-01T19:55:00.086 INFO:teuthology.orchestra.run.smithi101.stdout: "duration": 2.7078000000000001e-05 2023-08-01T19:55:00.086 INFO:teuthology.orchestra.run.smithi101.stdout: } 2023-08-01T19:55:00.086 INFO:teuthology.orchestra.run.smithi101.stdout: ] 2023-08-01T19:55:00.086 INFO:teuthology.orchestra.run.smithi101.stdout: } 2023-08-01T19:55:00.086 INFO:teuthology.orchestra.run.smithi101.stdout: }, 2023-08-01T19:55:00.086 INFO:teuthology.orchestra.run.smithi101.stdout: { 2023-08-01T19:55:00.086 INFO:teuthology.orchestra.run.smithi101.stdout: "description": "osd_op(mds.0.3:9 3.10 3:09401a81:::601.00000000:head [create,setxattr parent (62) in=6b,setxattr layout (30) in=6b] snapc 0=[] ondisk+write+known_if_redirected+full_force+supports_pool_eio e17)", 2023-08-01T19:55:00.087 INFO:teuthology.orchestra.run.smithi101.stdout: "initiated_at": "2023-08-01T19:54:04.458896+0000", 2023-08-01T19:55:00.087 INFO:teuthology.orchestra.run.smithi101.stdout: "age": 55.588105099000003, 2023-08-01T19:55:00.087 INFO:teuthology.orchestra.run.smithi101.stdout: "duration": 0.018577215000000001, 2023-08-01T19:55:00.087 INFO:teuthology.orchestra.run.smithi101.stdout: "type_data": { 2023-08-01T19:55:00.087 INFO:teuthology.orchestra.run.smithi101.stdout: "flag_point": "commit sent; apply or cleanup", 2023-08-01T19:55:00.087 INFO:teuthology.orchestra.run.smithi101.stdout: "events": [ 2023-08-01T19:55:00.087 INFO:teuthology.orchestra.run.smithi101.stdout: { 2023-08-01T19:55:00.087 INFO:teuthology.orchestra.run.smithi101.stdout: "event": "initiated", 2023-08-01T19:55:00.088 INFO:teuthology.orchestra.run.smithi101.stdout: "time": "2023-08-01T19:54:04.458896+0000", 2023-08-01T19:55:00.088 INFO:teuthology.orchestra.run.smithi101.stdout: "duration": 0 2023-08-01T19:55:00.088 INFO:teuthology.orchestra.run.smithi101.stdout: }, 2023-08-01T19:55:00.088 INFO:teuthology.orchestra.run.smithi101.stdout: { 2023-08-01T19:55:00.088 INFO:teuthology.orchestra.run.smithi101.stdout: "event": "throttled", 2023-08-01T19:55:00.088 INFO:teuthology.orchestra.run.smithi101.stdout: "time": "2023-08-01T19:54:04.458896+0000", 2023-08-01T19:55:00.088 INFO:teuthology.orchestra.run.smithi101.stdout: "duration": 0 2023-08-01T19:55:00.089 INFO:teuthology.orchestra.run.smithi101.stdout: }, 2023-08-01T19:55:00.089 INFO:teuthology.orchestra.run.smithi101.stdout: { 2023-08-01T19:55:00.089 INFO:teuthology.orchestra.run.smithi101.stdout: "event": "header_read", 2023-08-01T19:55:00.089 INFO:teuthology.orchestra.run.smithi101.stdout: "time": "2023-08-01T19:54:04.458896+0000", 2023-08-01T19:55:00.089 INFO:teuthology.orchestra.run.smithi101.stdout: "duration": 4294967295.9999995 2023-08-01T19:55:00.089 INFO:teuthology.orchestra.run.smithi101.stdout: }, 2023-08-01T19:55:00.089 INFO:teuthology.orchestra.run.smithi101.stdout: { 2023-08-01T19:55:00.089 INFO:teuthology.orchestra.run.smithi101.stdout: "event": "all_read", 2023-08-01T19:55:00.090 INFO:teuthology.orchestra.run.smithi101.stdout: "time": "2023-08-01T19:54:04.458900+0000", 2023-08-01T19:55:00.090 INFO:teuthology.orchestra.run.smithi101.stdout: "duration": 4.0829999999999997e-06 2023-08-01T19:55:00.090 INFO:teuthology.orchestra.run.smithi101.stdout: }, 2023-08-01T19:55:00.090 INFO:teuthology.orchestra.run.smithi101.stdout: { 2023-08-01T19:55:00.090 INFO:teuthology.orchestra.run.smithi101.stdout: "event": "dispatched", 2023-08-01T19:55:00.090 INFO:teuthology.orchestra.run.smithi101.stdout: "time": "2023-08-01T19:54:04.458906+0000", 2023-08-01T19:55:00.090 INFO:teuthology.orchestra.run.smithi101.stdout: "duration": 6.4099999999999996e-06 2023-08-01T19:55:00.090 INFO:teuthology.orchestra.run.smithi101.stdout: }, 2023-08-01T19:55:00.091 INFO:teuthology.orchestra.run.smithi101.stdout: { 2023-08-01T19:55:00.091 INFO:teuthology.orchestra.run.smithi101.stdout: "event": "queued_for_pg", 2023-08-01T19:55:00.091 INFO:teuthology.orchestra.run.smithi101.stdout: "time": "2023-08-01T19:54:04.458911+0000", 2023-08-01T19:55:00.091 INFO:teuthology.orchestra.run.smithi101.stdout: "duration": 4.0500000000000002e-06 2023-08-01T19:55:00.091 INFO:teuthology.orchestra.run.smithi101.stdout: }, 2023-08-01T19:55:00.091 INFO:teuthology.orchestra.run.smithi101.stdout: { 2023-08-01T19:55:00.091 INFO:teuthology.orchestra.run.smithi101.stdout: "event": "reached_pg", 2023-08-01T19:55:00.092 INFO:teuthology.orchestra.run.smithi101.stdout: "time": "2023-08-01T19:54:04.458981+0000", 2023-08-01T19:55:00.092 INFO:teuthology.orchestra.run.smithi101.stdout: "duration": 7.0121000000000002e-05 2023-08-01T19:55:00.092 INFO:teuthology.orchestra.run.smithi101.stdout: }, 2023-08-01T19:55:00.092 INFO:teuthology.orchestra.run.smithi101.stdout: { 2023-08-01T19:55:00.092 INFO:teuthology.orchestra.run.smithi101.stdout: "event": "waiting_for_map not empty", 2023-08-01T19:55:00.092 INFO:teuthology.orchestra.run.smithi101.stdout: "time": "2023-08-01T19:54:04.458983+0000", 2023-08-01T19:55:00.092 INFO:teuthology.orchestra.run.smithi101.stdout: "duration": 2.2299999999999998e-06 2023-08-01T19:55:00.092 INFO:teuthology.orchestra.run.smithi101.stdout: }, 2023-08-01T19:55:00.093 INFO:teuthology.orchestra.run.smithi101.stdout: { 2023-08-01T19:55:00.093 INFO:teuthology.orchestra.run.smithi101.stdout: "event": "reached_pg", 2023-08-01T19:55:00.093 INFO:teuthology.orchestra.run.smithi101.stdout: "time": "2023-08-01T19:54:04.470122+0000", 2023-08-01T19:55:00.093 INFO:teuthology.orchestra.run.smithi101.stdout: "duration": 0.011139593999999999 2023-08-01T19:55:00.093 INFO:teuthology.orchestra.run.smithi101.stdout: }, 2023-08-01T19:55:00.093 INFO:teuthology.orchestra.run.smithi101.stdout: { 2023-08-01T19:55:00.093 INFO:teuthology.orchestra.run.smithi101.stdout: "event": "started", 2023-08-01T19:55:00.094 INFO:teuthology.orchestra.run.smithi101.stdout: "time": "2023-08-01T19:54:04.470217+0000", 2023-08-01T19:55:00.094 INFO:teuthology.orchestra.run.smithi101.stdout: "duration": 9.4388000000000005e-05 2023-08-01T19:55:00.094 INFO:teuthology.orchestra.run.smithi101.stdout: }, 2023-08-01T19:55:00.094 INFO:teuthology.orchestra.run.smithi101.stdout: { 2023-08-01T19:55:00.094 INFO:teuthology.orchestra.run.smithi101.stdout: "event": "waiting for subops from 2", 2023-08-01T19:55:00.094 INFO:teuthology.orchestra.run.smithi101.stdout: "time": "2023-08-01T19:54:04.470714+0000", 2023-08-01T19:55:00.094 INFO:teuthology.orchestra.run.smithi101.stdout: "duration": 0.00049680999999999998 2023-08-01T19:55:00.095 INFO:teuthology.orchestra.run.smithi101.stdout: }, 2023-08-01T19:55:00.095 INFO:teuthology.orchestra.run.smithi101.stdout: { 2023-08-01T19:55:00.095 INFO:teuthology.orchestra.run.smithi101.stdout: "event": "op_commit", 2023-08-01T19:55:00.095 INFO:teuthology.orchestra.run.smithi101.stdout: "time": "2023-08-01T19:54:04.476183+0000", 2023-08-01T19:55:00.095 INFO:teuthology.orchestra.run.smithi101.stdout: "duration": 0.0054695880000000001 2023-08-01T19:55:00.095 INFO:teuthology.orchestra.run.smithi101.stdout: }, 2023-08-01T19:55:00.096 INFO:teuthology.orchestra.run.smithi101.stdout: { 2023-08-01T19:55:00.096 INFO:teuthology.orchestra.run.smithi101.stdout: "event": "sub_op_commit_rec", 2023-08-01T19:55:00.096 INFO:teuthology.orchestra.run.smithi101.stdout: "time": "2023-08-01T19:54:04.477428+0000", 2023-08-01T19:55:00.096 INFO:teuthology.orchestra.run.smithi101.stdout: "duration": 0.001244843 2023-08-01T19:55:00.096 INFO:teuthology.orchestra.run.smithi101.stdout: }, 2023-08-01T19:55:00.096 INFO:teuthology.orchestra.run.smithi101.stdout: { 2023-08-01T19:55:00.096 INFO:teuthology.orchestra.run.smithi101.stdout: "event": "commit_sent", 2023-08-01T19:55:00.097 INFO:teuthology.orchestra.run.smithi101.stdout: "time": "2023-08-01T19:54:04.477456+0000", 2023-08-01T19:55:00.097 INFO:teuthology.orchestra.run.smithi101.stdout: "duration": 2.7538e-05 2023-08-01T19:55:00.097 INFO:teuthology.orchestra.run.smithi101.stdout: }, 2023-08-01T19:55:00.097 INFO:teuthology.orchestra.run.smithi101.stdout: { 2023-08-01T19:55:00.097 INFO:teuthology.orchestra.run.smithi101.stdout: "event": "done", 2023-08-01T19:55:00.097 INFO:teuthology.orchestra.run.smithi101.stdout: "time": "2023-08-01T19:54:04.477474+0000", 2023-08-01T19:55:00.097 INFO:teuthology.orchestra.run.smithi101.stdout: "duration": 1.7974000000000001e-05 2023-08-01T19:55:00.098 INFO:teuthology.orchestra.run.smithi101.stdout: } 2023-08-01T19:55:00.098 INFO:teuthology.orchestra.run.smithi101.stdout: ] 2023-08-01T19:55:00.098 INFO:teuthology.orchestra.run.smithi101.stdout: } 2023-08-01T19:55:00.098 INFO:teuthology.orchestra.run.smithi101.stdout: }, 2023-08-01T19:55:00.098 INFO:teuthology.orchestra.run.smithi101.stdout: { 2023-08-01T19:55:00.098 INFO:teuthology.orchestra.run.smithi101.stdout: "description": "osd_op(mds.0.3:10 3.10 3:0bd6d154:::602.00000000:head [omap-set-header] snapc 0=[] ondisk+write+known_if_redirected+full_force+supports_pool_eio e17)", 2023-08-01T19:55:00.098 INFO:teuthology.orchestra.run.smithi101.stdout: "initiated_at": "2023-08-01T19:54:04.458927+0000", 2023-08-01T19:55:00.099 INFO:teuthology.orchestra.run.smithi101.stdout: "age": 55.588074120999998, 2023-08-01T19:55:00.099 INFO:teuthology.orchestra.run.smithi101.stdout: "duration": 0.019574352, 2023-08-01T19:55:00.099 INFO:teuthology.orchestra.run.smithi101.stdout: "type_data": { 2023-08-01T19:55:00.099 INFO:teuthology.orchestra.run.smithi101.stdout: "flag_point": "commit sent; apply or cleanup", 2023-08-01T19:55:00.099 INFO:teuthology.orchestra.run.smithi101.stdout: "events": [ 2023-08-01T19:55:00.099 INFO:teuthology.orchestra.run.smithi101.stdout: { 2023-08-01T19:55:00.099 INFO:teuthology.orchestra.run.smithi101.stdout: "event": "initiated", 2023-08-01T19:55:00.099 INFO:teuthology.orchestra.run.smithi101.stdout: "time": "2023-08-01T19:54:04.458927+0000", 2023-08-01T19:55:00.100 INFO:teuthology.orchestra.run.smithi101.stdout: "duration": 0 2023-08-01T19:55:00.100 INFO:teuthology.orchestra.run.smithi101.stdout: }, 2023-08-01T19:55:00.100 INFO:teuthology.orchestra.run.smithi101.stdout: { 2023-08-01T19:55:00.100 INFO:teuthology.orchestra.run.smithi101.stdout: "event": "throttled", 2023-08-01T19:55:00.100 INFO:teuthology.orchestra.run.smithi101.stdout: "time": "2023-08-01T19:54:04.458927+0000", 2023-08-01T19:55:00.100 INFO:teuthology.orchestra.run.smithi101.stdout: "duration": 0 2023-08-01T19:55:00.100 INFO:teuthology.orchestra.run.smithi101.stdout: }, 2023-08-01T19:55:00.101 INFO:teuthology.orchestra.run.smithi101.stdout: { 2023-08-01T19:55:00.101 INFO:teuthology.orchestra.run.smithi101.stdout: "event": "header_read", 2023-08-01T19:55:00.101 INFO:teuthology.orchestra.run.smithi101.stdout: "time": "2023-08-01T19:54:04.458927+0000", 2023-08-01T19:55:00.101 INFO:teuthology.orchestra.run.smithi101.stdout: "duration": 4294967295.9999995 2023-08-01T19:55:00.101 INFO:teuthology.orchestra.run.smithi101.stdout: }, 2023-08-01T19:55:00.101 INFO:teuthology.orchestra.run.smithi101.stdout: { 2023-08-01T19:55:00.101 INFO:teuthology.orchestra.run.smithi101.stdout: "event": "all_read", 2023-08-01T19:55:00.101 INFO:teuthology.orchestra.run.smithi101.stdout: "time": "2023-08-01T19:54:04.458931+0000", 2023-08-01T19:55:00.102 INFO:teuthology.orchestra.run.smithi101.stdout: "duration": 4.3000000000000003e-06 2023-08-01T19:55:00.102 INFO:teuthology.orchestra.run.smithi101.stdout: }, 2023-08-01T19:55:00.102 INFO:teuthology.orchestra.run.smithi101.stdout: { 2023-08-01T19:55:00.102 INFO:teuthology.orchestra.run.smithi101.stdout: "event": "dispatched", 2023-08-01T19:55:00.102 INFO:teuthology.orchestra.run.smithi101.stdout: "time": "2023-08-01T19:54:04.458938+0000", 2023-08-01T19:55:00.102 INFO:teuthology.orchestra.run.smithi101.stdout: "duration": 7.3220000000000004e-06 2023-08-01T19:55:00.102 INFO:teuthology.orchestra.run.smithi101.stdout: }, 2023-08-01T19:55:00.102 INFO:teuthology.orchestra.run.smithi101.stdout: { 2023-08-01T19:55:00.103 INFO:teuthology.orchestra.run.smithi101.stdout: "event": "queued_for_pg", 2023-08-01T19:55:00.103 INFO:teuthology.orchestra.run.smithi101.stdout: "time": "2023-08-01T19:54:04.458944+0000", 2023-08-01T19:55:00.103 INFO:teuthology.orchestra.run.smithi101.stdout: "duration": 5.3040000000000004e-06 2023-08-01T19:55:00.103 INFO:teuthology.orchestra.run.smithi101.stdout: }, 2023-08-01T19:55:00.103 INFO:teuthology.orchestra.run.smithi101.stdout: { 2023-08-01T19:55:00.103 INFO:teuthology.orchestra.run.smithi101.stdout: "event": "reached_pg", 2023-08-01T19:55:00.103 INFO:teuthology.orchestra.run.smithi101.stdout: "time": "2023-08-01T19:54:04.459006+0000", 2023-08-01T19:55:00.104 INFO:teuthology.orchestra.run.smithi101.stdout: "duration": 6.2081000000000004e-05 2023-08-01T19:55:00.104 INFO:teuthology.orchestra.run.smithi101.stdout: }, 2023-08-01T19:55:00.104 INFO:teuthology.orchestra.run.smithi101.stdout: { 2023-08-01T19:55:00.104 INFO:teuthology.orchestra.run.smithi101.stdout: "event": "waiting_for_map not empty", 2023-08-01T19:55:00.104 INFO:teuthology.orchestra.run.smithi101.stdout: "time": "2023-08-01T19:54:04.459008+0000", 2023-08-01T19:55:00.104 INFO:teuthology.orchestra.run.smithi101.stdout: "duration": 2.2500000000000001e-06 2023-08-01T19:55:00.104 INFO:teuthology.orchestra.run.smithi101.stdout: }, 2023-08-01T19:55:00.104 INFO:teuthology.orchestra.run.smithi101.stdout: { 2023-08-01T19:55:00.105 INFO:teuthology.orchestra.run.smithi101.stdout: "event": "reached_pg", 2023-08-01T19:55:00.105 INFO:teuthology.orchestra.run.smithi101.stdout: "time": "2023-08-01T19:54:04.470946+0000", 2023-08-01T19:55:00.105 INFO:teuthology.orchestra.run.smithi101.stdout: "duration": 0.011938347 2023-08-01T19:55:00.105 INFO:teuthology.orchestra.run.smithi101.stdout: }, 2023-08-01T19:55:00.105 INFO:teuthology.orchestra.run.smithi101.stdout: { 2023-08-01T19:55:00.105 INFO:teuthology.orchestra.run.smithi101.stdout: "event": "started", 2023-08-01T19:55:00.105 INFO:teuthology.orchestra.run.smithi101.stdout: "time": "2023-08-01T19:54:04.471071+0000", 2023-08-01T19:55:00.105 INFO:teuthology.orchestra.run.smithi101.stdout: "duration": 0.00012470299999999999 2023-08-01T19:55:00.106 INFO:teuthology.orchestra.run.smithi101.stdout: }, 2023-08-01T19:55:00.106 INFO:teuthology.orchestra.run.smithi101.stdout: { 2023-08-01T19:55:00.106 INFO:teuthology.orchestra.run.smithi101.stdout: "event": "waiting for subops from 2", 2023-08-01T19:55:00.106 INFO:teuthology.orchestra.run.smithi101.stdout: "time": "2023-08-01T19:54:04.471205+0000", 2023-08-01T19:55:00.106 INFO:teuthology.orchestra.run.smithi101.stdout: "duration": 0.000133891 2023-08-01T19:55:00.106 INFO:teuthology.orchestra.run.smithi101.stdout: }, 2023-08-01T19:55:00.106 INFO:teuthology.orchestra.run.smithi101.stdout: { 2023-08-01T19:55:00.107 INFO:teuthology.orchestra.run.smithi101.stdout: "event": "op_commit", 2023-08-01T19:55:00.107 INFO:teuthology.orchestra.run.smithi101.stdout: "time": "2023-08-01T19:54:04.477042+0000", 2023-08-01T19:55:00.107 INFO:teuthology.orchestra.run.smithi101.stdout: "duration": 0.0058374849999999999 2023-08-01T19:55:00.107 INFO:teuthology.orchestra.run.smithi101.stdout: }, 2023-08-01T19:55:00.107 INFO:teuthology.orchestra.run.smithi101.stdout: { 2023-08-01T19:55:00.107 INFO:teuthology.orchestra.run.smithi101.stdout: "event": "sub_op_commit_rec", 2023-08-01T19:55:00.107 INFO:teuthology.orchestra.run.smithi101.stdout: "time": "2023-08-01T19:54:04.478445+0000", 2023-08-01T19:55:00.107 INFO:teuthology.orchestra.run.smithi101.stdout: "duration": 0.0014023239999999999 2023-08-01T19:55:00.108 INFO:teuthology.orchestra.run.smithi101.stdout: }, 2023-08-01T19:55:00.108 INFO:teuthology.orchestra.run.smithi101.stdout: { 2023-08-01T19:55:00.108 INFO:teuthology.orchestra.run.smithi101.stdout: "event": "commit_sent", 2023-08-01T19:55:00.108 INFO:teuthology.orchestra.run.smithi101.stdout: "time": "2023-08-01T19:54:04.478478+0000", 2023-08-01T19:55:00.108 INFO:teuthology.orchestra.run.smithi101.stdout: "duration": 3.3503000000000001e-05 2023-08-01T19:55:00.108 INFO:teuthology.orchestra.run.smithi101.stdout: }, 2023-08-01T19:55:00.108 INFO:teuthology.orchestra.run.smithi101.stdout: { 2023-08-01T19:55:00.108 INFO:teuthology.orchestra.run.smithi101.stdout: "event": "done", 2023-08-01T19:55:00.109 INFO:teuthology.orchestra.run.smithi101.stdout: "time": "2023-08-01T19:54:04.478502+0000", 2023-08-01T19:55:00.109 INFO:teuthology.orchestra.run.smithi101.stdout: "duration": 2.3402000000000001e-05 2023-08-01T19:55:00.109 INFO:teuthology.orchestra.run.smithi101.stdout: } 2023-08-01T19:55:00.109 INFO:teuthology.orchestra.run.smithi101.stdout: ] 2023-08-01T19:55:00.109 INFO:teuthology.orchestra.run.smithi101.stdout: } 2023-08-01T19:55:00.109 INFO:teuthology.orchestra.run.smithi101.stdout: }, 2023-08-01T19:55:00.109 INFO:teuthology.orchestra.run.smithi101.stdout: { 2023-08-01T19:55:00.109 INFO:teuthology.orchestra.run.smithi101.stdout: "description": "osd_op(mds.0.3:11 3.10 3:0bd6d154:::602.00000000:head [create,setxattr parent (62) in=6b,setxattr layout (30) in=6b] snapc 0=[] ondisk+write+known_if_redirected+full_force+supports_pool_eio e17)", 2023-08-01T19:55:00.110 INFO:teuthology.orchestra.run.smithi101.stdout: "initiated_at": "2023-08-01T19:54:04.458960+0000", 2023-08-01T19:55:00.110 INFO:teuthology.orchestra.run.smithi101.stdout: "age": 55.588041672999999, 2023-08-01T19:55:00.110 INFO:teuthology.orchestra.run.smithi101.stdout: "duration": 0.019645459000000001, 2023-08-01T19:55:00.110 INFO:teuthology.orchestra.run.smithi101.stdout: "type_data": { 2023-08-01T19:55:00.110 INFO:teuthology.orchestra.run.smithi101.stdout: "flag_point": "commit sent; apply or cleanup", 2023-08-01T19:55:00.110 INFO:teuthology.orchestra.run.smithi101.stdout: "events": [ 2023-08-01T19:55:00.110 INFO:teuthology.orchestra.run.smithi101.stdout: { 2023-08-01T19:55:00.110 INFO:teuthology.orchestra.run.smithi101.stdout: "event": "initiated", 2023-08-01T19:55:00.111 INFO:teuthology.orchestra.run.smithi101.stdout: "time": "2023-08-01T19:54:04.458960+0000", 2023-08-01T19:55:00.111 INFO:teuthology.orchestra.run.smithi101.stdout: "duration": 0 2023-08-01T19:55:00.111 INFO:teuthology.orchestra.run.smithi101.stdout: }, 2023-08-01T19:55:00.111 INFO:teuthology.orchestra.run.smithi101.stdout: { 2023-08-01T19:55:00.111 INFO:teuthology.orchestra.run.smithi101.stdout: "event": "throttled", 2023-08-01T19:55:00.111 INFO:teuthology.orchestra.run.smithi101.stdout: "time": "2023-08-01T19:54:04.458960+0000", 2023-08-01T19:55:00.111 INFO:teuthology.orchestra.run.smithi101.stdout: "duration": 0 2023-08-01T19:55:00.112 INFO:teuthology.orchestra.run.smithi101.stdout: }, 2023-08-01T19:55:00.112 INFO:teuthology.orchestra.run.smithi101.stdout: { 2023-08-01T19:55:00.112 INFO:teuthology.orchestra.run.smithi101.stdout: "event": "header_read", 2023-08-01T19:55:00.112 INFO:teuthology.orchestra.run.smithi101.stdout: "time": "2023-08-01T19:54:04.458959+0000", 2023-08-01T19:55:00.112 INFO:teuthology.orchestra.run.smithi101.stdout: "duration": 4294967295.9999995 2023-08-01T19:55:00.112 INFO:teuthology.orchestra.run.smithi101.stdout: }, 2023-08-01T19:55:00.112 INFO:teuthology.orchestra.run.smithi101.stdout: { 2023-08-01T19:55:00.112 INFO:teuthology.orchestra.run.smithi101.stdout: "event": "all_read", 2023-08-01T19:55:00.113 INFO:teuthology.orchestra.run.smithi101.stdout: "time": "2023-08-01T19:54:04.458963+0000", 2023-08-01T19:55:00.113 INFO:teuthology.orchestra.run.smithi101.stdout: "duration": 3.9199999999999997e-06 2023-08-01T19:55:00.113 INFO:teuthology.orchestra.run.smithi101.stdout: }, 2023-08-01T19:55:00.113 INFO:teuthology.orchestra.run.smithi101.stdout: { 2023-08-01T19:55:00.113 INFO:teuthology.orchestra.run.smithi101.stdout: "event": "dispatched", 2023-08-01T19:55:00.113 INFO:teuthology.orchestra.run.smithi101.stdout: "time": "2023-08-01T19:54:04.458970+0000", 2023-08-01T19:55:00.113 INFO:teuthology.orchestra.run.smithi101.stdout: "duration": 7.0439999999999998e-06 2023-08-01T19:55:00.113 INFO:teuthology.orchestra.run.smithi101.stdout: }, 2023-08-01T19:55:00.114 INFO:teuthology.orchestra.run.smithi101.stdout: { 2023-08-01T19:55:00.114 INFO:teuthology.orchestra.run.smithi101.stdout: "event": "queued_for_pg", 2023-08-01T19:55:00.114 INFO:teuthology.orchestra.run.smithi101.stdout: "time": "2023-08-01T19:54:04.458976+0000", 2023-08-01T19:55:00.114 INFO:teuthology.orchestra.run.smithi101.stdout: "duration": 5.9540000000000001e-06 2023-08-01T19:55:00.114 INFO:teuthology.orchestra.run.smithi101.stdout: }, 2023-08-01T19:55:00.114 INFO:teuthology.orchestra.run.smithi101.stdout: { 2023-08-01T19:55:00.114 INFO:teuthology.orchestra.run.smithi101.stdout: "event": "reached_pg", 2023-08-01T19:55:00.115 INFO:teuthology.orchestra.run.smithi101.stdout: "time": "2023-08-01T19:54:04.459035+0000", 2023-08-01T19:55:00.115 INFO:teuthology.orchestra.run.smithi101.stdout: "duration": 5.8924e-05 2023-08-01T19:55:00.115 INFO:teuthology.orchestra.run.smithi101.stdout: }, 2023-08-01T19:55:00.115 INFO:teuthology.orchestra.run.smithi101.stdout: { 2023-08-01T19:55:00.115 INFO:teuthology.orchestra.run.smithi101.stdout: "event": "waiting_for_map not empty", 2023-08-01T19:55:00.115 INFO:teuthology.orchestra.run.smithi101.stdout: "time": "2023-08-01T19:54:04.459038+0000", 2023-08-01T19:55:00.115 INFO:teuthology.orchestra.run.smithi101.stdout: "duration": 3.2760000000000001e-06 2023-08-01T19:55:00.115 INFO:teuthology.orchestra.run.smithi101.stdout: }, 2023-08-01T19:55:00.116 INFO:teuthology.orchestra.run.smithi101.stdout: { 2023-08-01T19:55:00.116 INFO:teuthology.orchestra.run.smithi101.stdout: "event": "reached_pg", 2023-08-01T19:55:00.116 INFO:teuthology.orchestra.run.smithi101.stdout: "time": "2023-08-01T19:54:04.471511+0000", 2023-08-01T19:55:00.116 INFO:teuthology.orchestra.run.smithi101.stdout: "duration": 0.012473039999999999 2023-08-01T19:55:00.116 INFO:teuthology.orchestra.run.smithi101.stdout: }, 2023-08-01T19:55:00.116 INFO:teuthology.orchestra.run.smithi101.stdout: { 2023-08-01T19:55:00.116 INFO:teuthology.orchestra.run.smithi101.stdout: "event": "started", 2023-08-01T19:55:00.116 INFO:teuthology.orchestra.run.smithi101.stdout: "time": "2023-08-01T19:54:04.472086+0000", 2023-08-01T19:55:00.117 INFO:teuthology.orchestra.run.smithi101.stdout: "duration": 0.00057491699999999998 2023-08-01T19:55:00.117 INFO:teuthology.orchestra.run.smithi101.stdout: }, 2023-08-01T19:55:00.117 INFO:teuthology.orchestra.run.smithi101.stdout: { 2023-08-01T19:55:00.117 INFO:teuthology.orchestra.run.smithi101.stdout: "event": "waiting for subops from 2", 2023-08-01T19:55:00.117 INFO:teuthology.orchestra.run.smithi101.stdout: "time": "2023-08-01T19:54:04.472310+0000", 2023-08-01T19:55:00.117 INFO:teuthology.orchestra.run.smithi101.stdout: "duration": 0.00022396499999999999 2023-08-01T19:55:00.117 INFO:teuthology.orchestra.run.smithi101.stdout: }, 2023-08-01T19:55:00.118 INFO:teuthology.orchestra.run.smithi101.stdout: { 2023-08-01T19:55:00.118 INFO:teuthology.orchestra.run.smithi101.stdout: "event": "op_commit", 2023-08-01T19:55:00.118 INFO:teuthology.orchestra.run.smithi101.stdout: "time": "2023-08-01T19:54:04.478141+0000", 2023-08-01T19:55:00.118 INFO:teuthology.orchestra.run.smithi101.stdout: "duration": 0.0058312320000000004 2023-08-01T19:55:00.118 INFO:teuthology.orchestra.run.smithi101.stdout: }, 2023-08-01T19:55:00.118 INFO:teuthology.orchestra.run.smithi101.stdout: { 2023-08-01T19:55:00.118 INFO:teuthology.orchestra.run.smithi101.stdout: "event": "sub_op_commit_rec", 2023-08-01T19:55:00.118 INFO:teuthology.orchestra.run.smithi101.stdout: "time": "2023-08-01T19:54:04.478543+0000", 2023-08-01T19:55:00.119 INFO:teuthology.orchestra.run.smithi101.stdout: "duration": 0.00040160800000000002 2023-08-01T19:55:00.119 INFO:teuthology.orchestra.run.smithi101.stdout: }, 2023-08-01T19:55:00.119 INFO:teuthology.orchestra.run.smithi101.stdout: { 2023-08-01T19:55:00.119 INFO:teuthology.orchestra.run.smithi101.stdout: "event": "commit_sent", 2023-08-01T19:55:00.119 INFO:teuthology.orchestra.run.smithi101.stdout: "time": "2023-08-01T19:54:04.478584+0000", 2023-08-01T19:55:00.119 INFO:teuthology.orchestra.run.smithi101.stdout: "duration": 4.0989999999999999e-05 2023-08-01T19:55:00.119 INFO:teuthology.orchestra.run.smithi101.stdout: }, 2023-08-01T19:55:00.119 INFO:teuthology.orchestra.run.smithi101.stdout: { 2023-08-01T19:55:00.120 INFO:teuthology.orchestra.run.smithi101.stdout: "event": "done", 2023-08-01T19:55:00.120 INFO:teuthology.orchestra.run.smithi101.stdout: "time": "2023-08-01T19:54:04.478605+0000", 2023-08-01T19:55:00.120 INFO:teuthology.orchestra.run.smithi101.stdout: "duration": 2.1178e-05 2023-08-01T19:55:00.120 INFO:teuthology.orchestra.run.smithi101.stdout: } 2023-08-01T19:55:00.120 INFO:teuthology.orchestra.run.smithi101.stdout: ] 2023-08-01T19:55:00.120 INFO:teuthology.orchestra.run.smithi101.stdout: } 2023-08-01T19:55:00.120 INFO:teuthology.orchestra.run.smithi101.stdout: }, 2023-08-01T19:55:00.121 INFO:teuthology.orchestra.run.smithi101.stdout: { 2023-08-01T19:55:00.121 INFO:teuthology.orchestra.run.smithi101.stdout: "description": "osd_op(mds.0.3:12 3.10 3:0d89b25e:::603.00000000:head [omap-set-header] snapc 0=[] ondisk+write+known_if_redirected+full_force+supports_pool_eio e17)", 2023-08-01T19:55:00.121 INFO:teuthology.orchestra.run.smithi101.stdout: "initiated_at": "2023-08-01T19:54:04.458982+0000", 2023-08-01T19:55:00.121 INFO:teuthology.orchestra.run.smithi101.stdout: "age": 55.588019445, 2023-08-01T19:55:00.121 INFO:teuthology.orchestra.run.smithi101.stdout: "duration": 0.021266334000000001, 2023-08-01T19:55:00.121 INFO:teuthology.orchestra.run.smithi101.stdout: "type_data": { 2023-08-01T19:55:00.121 INFO:teuthology.orchestra.run.smithi101.stdout: "flag_point": "commit sent; apply or cleanup", 2023-08-01T19:55:00.121 INFO:teuthology.orchestra.run.smithi101.stdout: "events": [ 2023-08-01T19:55:00.122 INFO:teuthology.orchestra.run.smithi101.stdout: { 2023-08-01T19:55:00.122 INFO:teuthology.orchestra.run.smithi101.stdout: "event": "initiated", 2023-08-01T19:55:00.122 INFO:teuthology.orchestra.run.smithi101.stdout: "time": "2023-08-01T19:54:04.458982+0000", 2023-08-01T19:55:00.122 INFO:teuthology.orchestra.run.smithi101.stdout: "duration": 0 2023-08-01T19:55:00.122 INFO:teuthology.orchestra.run.smithi101.stdout: }, 2023-08-01T19:55:00.122 INFO:teuthology.orchestra.run.smithi101.stdout: { 2023-08-01T19:55:00.122 INFO:teuthology.orchestra.run.smithi101.stdout: "event": "throttled", 2023-08-01T19:55:00.122 INFO:teuthology.orchestra.run.smithi101.stdout: "time": "2023-08-01T19:54:04.458982+0000", 2023-08-01T19:55:00.123 INFO:teuthology.orchestra.run.smithi101.stdout: "duration": 0 2023-08-01T19:55:00.123 INFO:teuthology.orchestra.run.smithi101.stdout: }, 2023-08-01T19:55:00.123 INFO:teuthology.orchestra.run.smithi101.stdout: { 2023-08-01T19:55:00.123 INFO:teuthology.orchestra.run.smithi101.stdout: "event": "header_read", 2023-08-01T19:55:00.123 INFO:teuthology.orchestra.run.smithi101.stdout: "time": "2023-08-01T19:54:04.458982+0000", 2023-08-01T19:55:00.123 INFO:teuthology.orchestra.run.smithi101.stdout: "duration": 4294967295.9999995 2023-08-01T19:55:00.123 INFO:teuthology.orchestra.run.smithi101.stdout: }, 2023-08-01T19:55:00.123 INFO:teuthology.orchestra.run.smithi101.stdout: { 2023-08-01T19:55:00.124 INFO:teuthology.orchestra.run.smithi101.stdout: "event": "all_read", 2023-08-01T19:55:00.124 INFO:teuthology.orchestra.run.smithi101.stdout: "time": "2023-08-01T19:54:04.458985+0000", 2023-08-01T19:55:00.124 INFO:teuthology.orchestra.run.smithi101.stdout: "duration": 3.4800000000000001e-06 2023-08-01T19:55:00.124 INFO:teuthology.orchestra.run.smithi101.stdout: }, 2023-08-01T19:55:00.124 INFO:teuthology.orchestra.run.smithi101.stdout: { 2023-08-01T19:55:00.124 INFO:teuthology.orchestra.run.smithi101.stdout: "event": "dispatched", 2023-08-01T19:55:00.124 INFO:teuthology.orchestra.run.smithi101.stdout: "time": "2023-08-01T19:54:04.458992+0000", 2023-08-01T19:55:00.125 INFO:teuthology.orchestra.run.smithi101.stdout: "duration": 7.306e-06 2023-08-01T19:55:00.125 INFO:teuthology.orchestra.run.smithi101.stdout: }, 2023-08-01T19:55:00.125 INFO:teuthology.orchestra.run.smithi101.stdout: { 2023-08-01T19:55:00.125 INFO:teuthology.orchestra.run.smithi101.stdout: "event": "queued_for_pg", 2023-08-01T19:55:00.125 INFO:teuthology.orchestra.run.smithi101.stdout: "time": "2023-08-01T19:54:04.458997+0000", 2023-08-01T19:55:00.125 INFO:teuthology.orchestra.run.smithi101.stdout: "duration": 4.4530000000000004e-06 2023-08-01T19:55:00.125 INFO:teuthology.orchestra.run.smithi101.stdout: }, 2023-08-01T19:55:00.126 INFO:teuthology.orchestra.run.smithi101.stdout: { 2023-08-01T19:55:00.126 INFO:teuthology.orchestra.run.smithi101.stdout: "event": "reached_pg", 2023-08-01T19:55:00.126 INFO:teuthology.orchestra.run.smithi101.stdout: "time": "2023-08-01T19:54:04.459060+0000", 2023-08-01T19:55:00.126 INFO:teuthology.orchestra.run.smithi101.stdout: "duration": 6.3249000000000004e-05 2023-08-01T19:55:00.126 INFO:teuthology.orchestra.run.smithi101.stdout: }, 2023-08-01T19:55:00.126 INFO:teuthology.orchestra.run.smithi101.stdout: { 2023-08-01T19:55:00.126 INFO:teuthology.orchestra.run.smithi101.stdout: "event": "waiting_for_map not empty", 2023-08-01T19:55:00.127 INFO:teuthology.orchestra.run.smithi101.stdout: "time": "2023-08-01T19:54:04.459063+0000", 2023-08-01T19:55:00.127 INFO:teuthology.orchestra.run.smithi101.stdout: "duration": 2.717e-06 2023-08-01T19:55:00.127 INFO:teuthology.orchestra.run.smithi101.stdout: }, 2023-08-01T19:55:00.127 INFO:teuthology.orchestra.run.smithi101.stdout: { 2023-08-01T19:55:00.127 INFO:teuthology.orchestra.run.smithi101.stdout: "event": "reached_pg", 2023-08-01T19:55:00.127 INFO:teuthology.orchestra.run.smithi101.stdout: "time": "2023-08-01T19:54:04.473625+0000", 2023-08-01T19:55:00.127 INFO:teuthology.orchestra.run.smithi101.stdout: "duration": 0.014562007 2023-08-01T19:55:00.128 INFO:teuthology.orchestra.run.smithi101.stdout: }, 2023-08-01T19:55:00.128 INFO:teuthology.orchestra.run.smithi101.stdout: { 2023-08-01T19:55:00.128 INFO:teuthology.orchestra.run.smithi101.stdout: "event": "started", 2023-08-01T19:55:00.128 INFO:teuthology.orchestra.run.smithi101.stdout: "time": "2023-08-01T19:54:04.473757+0000", 2023-08-01T19:55:00.128 INFO:teuthology.orchestra.run.smithi101.stdout: "duration": 0.00013238599999999999 2023-08-01T19:55:00.128 INFO:teuthology.orchestra.run.smithi101.stdout: }, 2023-08-01T19:55:00.129 INFO:teuthology.orchestra.run.smithi101.stdout: { 2023-08-01T19:55:00.129 INFO:teuthology.orchestra.run.smithi101.stdout: "event": "waiting for subops from 2", 2023-08-01T19:55:00.129 INFO:teuthology.orchestra.run.smithi101.stdout: "time": "2023-08-01T19:54:04.473898+0000", 2023-08-01T19:55:00.129 INFO:teuthology.orchestra.run.smithi101.stdout: "duration": 0.00014039 2023-08-01T19:55:00.129 INFO:teuthology.orchestra.run.smithi101.stdout: }, 2023-08-01T19:55:00.129 INFO:teuthology.orchestra.run.smithi101.stdout: { 2023-08-01T19:55:00.129 INFO:teuthology.orchestra.run.smithi101.stdout: "event": "op_commit", 2023-08-01T19:55:00.130 INFO:teuthology.orchestra.run.smithi101.stdout: "time": "2023-08-01T19:54:04.478380+0000", 2023-08-01T19:55:00.130 INFO:teuthology.orchestra.run.smithi101.stdout: "duration": 0.0044827449999999998 2023-08-01T19:55:00.130 INFO:teuthology.orchestra.run.smithi101.stdout: }, 2023-08-01T19:55:00.130 INFO:teuthology.orchestra.run.smithi101.stdout: { 2023-08-01T19:55:00.130 INFO:teuthology.orchestra.run.smithi101.stdout: "event": "sub_op_commit_rec", 2023-08-01T19:55:00.130 INFO:teuthology.orchestra.run.smithi101.stdout: "time": "2023-08-01T19:54:04.480169+0000", 2023-08-01T19:55:00.130 INFO:teuthology.orchestra.run.smithi101.stdout: "duration": 0.0017886040000000001 2023-08-01T19:55:00.131 INFO:teuthology.orchestra.run.smithi101.stdout: }, 2023-08-01T19:55:00.131 INFO:teuthology.orchestra.run.smithi101.stdout: { 2023-08-01T19:55:00.131 INFO:teuthology.orchestra.run.smithi101.stdout: "event": "commit_sent", 2023-08-01T19:55:00.131 INFO:teuthology.orchestra.run.smithi101.stdout: "time": "2023-08-01T19:54:04.480212+0000", 2023-08-01T19:55:00.131 INFO:teuthology.orchestra.run.smithi101.stdout: "duration": 4.2687e-05 2023-08-01T19:55:00.131 INFO:teuthology.orchestra.run.smithi101.stdout: }, 2023-08-01T19:55:00.131 INFO:teuthology.orchestra.run.smithi101.stdout: { 2023-08-01T19:55:00.131 INFO:teuthology.orchestra.run.smithi101.stdout: "event": "done", 2023-08-01T19:55:00.132 INFO:teuthology.orchestra.run.smithi101.stdout: "time": "2023-08-01T19:54:04.480248+0000", 2023-08-01T19:55:00.132 INFO:teuthology.orchestra.run.smithi101.stdout: "duration": 3.6743999999999999e-05 2023-08-01T19:55:00.132 INFO:teuthology.orchestra.run.smithi101.stdout: } 2023-08-01T19:55:00.132 INFO:teuthology.orchestra.run.smithi101.stdout: ] 2023-08-01T19:55:00.132 INFO:teuthology.orchestra.run.smithi101.stdout: } 2023-08-01T19:55:00.132 INFO:teuthology.orchestra.run.smithi101.stdout: }, 2023-08-01T19:55:00.132 INFO:teuthology.orchestra.run.smithi101.stdout: { 2023-08-01T19:55:00.132 INFO:teuthology.orchestra.run.smithi101.stdout: "description": "osd_op(mds.0.3:13 3.10 3:0d89b25e:::603.00000000:head [create,setxattr parent (62) in=6b,setxattr layout (30) in=6b] snapc 0=[] ondisk+write+known_if_redirected+full_force+supports_pool_eio e17)", 2023-08-01T19:55:00.133 INFO:teuthology.orchestra.run.smithi101.stdout: "initiated_at": "2023-08-01T19:54:04.459010+0000", 2023-08-01T19:55:00.133 INFO:teuthology.orchestra.run.smithi101.stdout: "age": 55.587991725000002, 2023-08-01T19:55:00.133 INFO:teuthology.orchestra.run.smithi101.stdout: "duration": 0.021327220000000001, 2023-08-01T19:55:00.133 INFO:teuthology.orchestra.run.smithi101.stdout: "type_data": { 2023-08-01T19:55:00.133 INFO:teuthology.orchestra.run.smithi101.stdout: "flag_point": "commit sent; apply or cleanup", 2023-08-01T19:55:00.133 INFO:teuthology.orchestra.run.smithi101.stdout: "events": [ 2023-08-01T19:55:00.133 INFO:teuthology.orchestra.run.smithi101.stdout: { 2023-08-01T19:55:00.134 INFO:teuthology.orchestra.run.smithi101.stdout: "event": "initiated", 2023-08-01T19:55:00.134 INFO:teuthology.orchestra.run.smithi101.stdout: "time": "2023-08-01T19:54:04.459010+0000", 2023-08-01T19:55:00.134 INFO:teuthology.orchestra.run.smithi101.stdout: "duration": 0 2023-08-01T19:55:00.134 INFO:teuthology.orchestra.run.smithi101.stdout: }, 2023-08-01T19:55:00.134 INFO:teuthology.orchestra.run.smithi101.stdout: { 2023-08-01T19:55:00.134 INFO:teuthology.orchestra.run.smithi101.stdout: "event": "throttled", 2023-08-01T19:55:00.134 INFO:teuthology.orchestra.run.smithi101.stdout: "time": "2023-08-01T19:54:04.459010+0000", 2023-08-01T19:55:00.134 INFO:teuthology.orchestra.run.smithi101.stdout: "duration": 0 2023-08-01T19:55:00.135 INFO:teuthology.orchestra.run.smithi101.stdout: }, 2023-08-01T19:55:00.135 INFO:teuthology.orchestra.run.smithi101.stdout: { 2023-08-01T19:55:00.135 INFO:teuthology.orchestra.run.smithi101.stdout: "event": "header_read", 2023-08-01T19:55:00.135 INFO:teuthology.orchestra.run.smithi101.stdout: "time": "2023-08-01T19:54:04.459009+0000", 2023-08-01T19:55:00.135 INFO:teuthology.orchestra.run.smithi101.stdout: "duration": 4294967295.9999995 2023-08-01T19:55:00.135 INFO:teuthology.orchestra.run.smithi101.stdout: }, 2023-08-01T19:55:00.135 INFO:teuthology.orchestra.run.smithi101.stdout: { 2023-08-01T19:55:00.135 INFO:teuthology.orchestra.run.smithi101.stdout: "event": "all_read", 2023-08-01T19:55:00.136 INFO:teuthology.orchestra.run.smithi101.stdout: "time": "2023-08-01T19:54:04.459013+0000", 2023-08-01T19:55:00.136 INFO:teuthology.orchestra.run.smithi101.stdout: "duration": 3.8929999999999998e-06 2023-08-01T19:55:00.136 INFO:teuthology.orchestra.run.smithi101.stdout: }, 2023-08-01T19:55:00.136 INFO:teuthology.orchestra.run.smithi101.stdout: { 2023-08-01T19:55:00.136 INFO:teuthology.orchestra.run.smithi101.stdout: "event": "dispatched", 2023-08-01T19:55:00.136 INFO:teuthology.orchestra.run.smithi101.stdout: "time": "2023-08-01T19:54:04.459027+0000", 2023-08-01T19:55:00.136 INFO:teuthology.orchestra.run.smithi101.stdout: "duration": 1.3416e-05 2023-08-01T19:55:00.137 INFO:teuthology.orchestra.run.smithi101.stdout: }, 2023-08-01T19:55:00.137 INFO:teuthology.orchestra.run.smithi101.stdout: { 2023-08-01T19:55:00.137 INFO:teuthology.orchestra.run.smithi101.stdout: "event": "queued_for_pg", 2023-08-01T19:55:00.137 INFO:teuthology.orchestra.run.smithi101.stdout: "time": "2023-08-01T19:54:04.459033+0000", 2023-08-01T19:55:00.137 INFO:teuthology.orchestra.run.smithi101.stdout: "duration": 5.9800000000000003e-06 2023-08-01T19:55:00.137 INFO:teuthology.orchestra.run.smithi101.stdout: }, 2023-08-01T19:55:00.137 INFO:teuthology.orchestra.run.smithi101.stdout: { 2023-08-01T19:55:00.137 INFO:teuthology.orchestra.run.smithi101.stdout: "event": "reached_pg", 2023-08-01T19:55:00.138 INFO:teuthology.orchestra.run.smithi101.stdout: "time": "2023-08-01T19:54:04.459099+0000", 2023-08-01T19:55:00.138 INFO:teuthology.orchestra.run.smithi101.stdout: "duration": 6.6192999999999995e-05 2023-08-01T19:55:00.138 INFO:teuthology.orchestra.run.smithi101.stdout: }, 2023-08-01T19:55:00.138 INFO:teuthology.orchestra.run.smithi101.stdout: { 2023-08-01T19:55:00.138 INFO:teuthology.orchestra.run.smithi101.stdout: "event": "waiting_for_map not empty", 2023-08-01T19:55:00.138 INFO:teuthology.orchestra.run.smithi101.stdout: "time": "2023-08-01T19:54:04.459106+0000", 2023-08-01T19:55:00.138 INFO:teuthology.orchestra.run.smithi101.stdout: "duration": 6.8619999999999997e-06 2023-08-01T19:55:00.138 INFO:teuthology.orchestra.run.smithi101.stdout: }, 2023-08-01T19:55:00.139 INFO:teuthology.orchestra.run.smithi101.stdout: { 2023-08-01T19:55:00.139 INFO:teuthology.orchestra.run.smithi101.stdout: "event": "reached_pg", 2023-08-01T19:55:00.139 INFO:teuthology.orchestra.run.smithi101.stdout: "time": "2023-08-01T19:54:04.475182+0000", 2023-08-01T19:55:00.139 INFO:teuthology.orchestra.run.smithi101.stdout: "duration": 0.016076333000000002 2023-08-01T19:55:00.139 INFO:teuthology.orchestra.run.smithi101.stdout: }, 2023-08-01T19:55:00.139 INFO:teuthology.orchestra.run.smithi101.stdout: { 2023-08-01T19:55:00.139 INFO:teuthology.orchestra.run.smithi101.stdout: "event": "started", 2023-08-01T19:55:00.140 INFO:teuthology.orchestra.run.smithi101.stdout: "time": "2023-08-01T19:54:04.475353+0000", 2023-08-01T19:55:00.140 INFO:teuthology.orchestra.run.smithi101.stdout: "duration": 0.000171378 2023-08-01T19:55:00.140 INFO:teuthology.orchestra.run.smithi101.stdout: }, 2023-08-01T19:55:00.140 INFO:teuthology.orchestra.run.smithi101.stdout: { 2023-08-01T19:55:00.140 INFO:teuthology.orchestra.run.smithi101.stdout: "event": "waiting for subops from 2", 2023-08-01T19:55:00.140 INFO:teuthology.orchestra.run.smithi101.stdout: "time": "2023-08-01T19:54:04.475793+0000", 2023-08-01T19:55:00.140 INFO:teuthology.orchestra.run.smithi101.stdout: "duration": 0.000440123 2023-08-01T19:55:00.140 INFO:teuthology.orchestra.run.smithi101.stdout: }, 2023-08-01T19:55:00.141 INFO:teuthology.orchestra.run.smithi101.stdout: { 2023-08-01T19:55:00.141 INFO:teuthology.orchestra.run.smithi101.stdout: "event": "op_commit", 2023-08-01T19:55:00.141 INFO:teuthology.orchestra.run.smithi101.stdout: "time": "2023-08-01T19:54:04.478624+0000", 2023-08-01T19:55:00.141 INFO:teuthology.orchestra.run.smithi101.stdout: "duration": 0.0028305000000000001 2023-08-01T19:55:00.141 INFO:teuthology.orchestra.run.smithi101.stdout: }, 2023-08-01T19:55:00.141 INFO:teuthology.orchestra.run.smithi101.stdout: { 2023-08-01T19:55:00.141 INFO:teuthology.orchestra.run.smithi101.stdout: "event": "sub_op_commit_rec", 2023-08-01T19:55:00.142 INFO:teuthology.orchestra.run.smithi101.stdout: "time": "2023-08-01T19:54:04.480291+0000", 2023-08-01T19:55:00.142 INFO:teuthology.orchestra.run.smithi101.stdout: "duration": 0.0016670000000000001 2023-08-01T19:55:00.142 INFO:teuthology.orchestra.run.smithi101.stdout: }, 2023-08-01T19:55:00.142 INFO:teuthology.orchestra.run.smithi101.stdout: { 2023-08-01T19:55:00.142 INFO:teuthology.orchestra.run.smithi101.stdout: "event": "commit_sent", 2023-08-01T19:55:00.142 INFO:teuthology.orchestra.run.smithi101.stdout: "time": "2023-08-01T19:54:04.480318+0000", 2023-08-01T19:55:00.142 INFO:teuthology.orchestra.run.smithi101.stdout: "duration": 2.6815e-05 2023-08-01T19:55:00.142 INFO:teuthology.orchestra.run.smithi101.stdout: }, 2023-08-01T19:55:00.143 INFO:teuthology.orchestra.run.smithi101.stdout: { 2023-08-01T19:55:00.143 INFO:teuthology.orchestra.run.smithi101.stdout: "event": "done", 2023-08-01T19:55:00.143 INFO:teuthology.orchestra.run.smithi101.stdout: "time": "2023-08-01T19:54:04.480337+0000", 2023-08-01T19:55:00.143 INFO:teuthology.orchestra.run.smithi101.stdout: "duration": 1.9241000000000001e-05 2023-08-01T19:55:00.143 INFO:teuthology.orchestra.run.smithi101.stdout: } 2023-08-01T19:55:00.143 INFO:teuthology.orchestra.run.smithi101.stdout: ] 2023-08-01T19:55:00.143 INFO:teuthology.orchestra.run.smithi101.stdout: } 2023-08-01T19:55:00.143 INFO:teuthology.orchestra.run.smithi101.stdout: }, 2023-08-01T19:55:00.144 INFO:teuthology.orchestra.run.smithi101.stdout: { 2023-08-01T19:55:00.144 INFO:teuthology.orchestra.run.smithi101.stdout: "description": "osd_op(mds.0.3:18 3.14 3:2f55791f:::606.00000000:head [omap-set-header] snapc 0=[] ondisk+write+known_if_redirected+full_force+supports_pool_eio e17)", 2023-08-01T19:55:00.144 INFO:teuthology.orchestra.run.smithi101.stdout: "initiated_at": "2023-08-01T19:54:04.459039+0000", 2023-08-01T19:55:00.144 INFO:teuthology.orchestra.run.smithi101.stdout: "age": 55.587962431000001, 2023-08-01T19:55:00.144 INFO:teuthology.orchestra.run.smithi101.stdout: "duration": 0.018756419, 2023-08-01T19:55:00.144 INFO:teuthology.orchestra.run.smithi101.stdout: "type_data": { 2023-08-01T19:55:00.144 INFO:teuthology.orchestra.run.smithi101.stdout: "flag_point": "commit sent; apply or cleanup", 2023-08-01T19:55:00.144 INFO:teuthology.orchestra.run.smithi101.stdout: "events": [ 2023-08-01T19:55:00.145 INFO:teuthology.orchestra.run.smithi101.stdout: { 2023-08-01T19:55:00.145 INFO:teuthology.orchestra.run.smithi101.stdout: "event": "initiated", 2023-08-01T19:55:00.145 INFO:teuthology.orchestra.run.smithi101.stdout: "time": "2023-08-01T19:54:04.459039+0000", 2023-08-01T19:55:00.145 INFO:teuthology.orchestra.run.smithi101.stdout: "duration": 0 2023-08-01T19:55:00.145 INFO:teuthology.orchestra.run.smithi101.stdout: }, 2023-08-01T19:55:00.145 INFO:teuthology.orchestra.run.smithi101.stdout: { 2023-08-01T19:55:00.145 INFO:teuthology.orchestra.run.smithi101.stdout: "event": "throttled", 2023-08-01T19:55:00.146 INFO:teuthology.orchestra.run.smithi101.stdout: "time": "2023-08-01T19:54:04.459039+0000", 2023-08-01T19:55:00.146 INFO:teuthology.orchestra.run.smithi101.stdout: "duration": 0 2023-08-01T19:55:00.146 INFO:teuthology.orchestra.run.smithi101.stdout: }, 2023-08-01T19:55:00.146 INFO:teuthology.orchestra.run.smithi101.stdout: { 2023-08-01T19:55:00.146 INFO:teuthology.orchestra.run.smithi101.stdout: "event": "header_read", 2023-08-01T19:55:00.146 INFO:teuthology.orchestra.run.smithi101.stdout: "time": "2023-08-01T19:54:04.459039+0000", 2023-08-01T19:55:00.146 INFO:teuthology.orchestra.run.smithi101.stdout: "duration": 4294967295.9999995 2023-08-01T19:55:00.146 INFO:teuthology.orchestra.run.smithi101.stdout: }, 2023-08-01T19:55:00.147 INFO:teuthology.orchestra.run.smithi101.stdout: { 2023-08-01T19:55:00.147 INFO:teuthology.orchestra.run.smithi101.stdout: "event": "all_read", 2023-08-01T19:55:00.147 INFO:teuthology.orchestra.run.smithi101.stdout: "time": "2023-08-01T19:54:04.459043+0000", 2023-08-01T19:55:00.147 INFO:teuthology.orchestra.run.smithi101.stdout: "duration": 4.1500000000000001e-06 2023-08-01T19:55:00.147 INFO:teuthology.orchestra.run.smithi101.stdout: }, 2023-08-01T19:55:00.147 INFO:teuthology.orchestra.run.smithi101.stdout: { 2023-08-01T19:55:00.147 INFO:teuthology.orchestra.run.smithi101.stdout: "event": "dispatched", 2023-08-01T19:55:00.147 INFO:teuthology.orchestra.run.smithi101.stdout: "time": "2023-08-01T19:54:04.459051+0000", 2023-08-01T19:55:00.148 INFO:teuthology.orchestra.run.smithi101.stdout: "duration": 8.4190000000000002e-06 2023-08-01T19:55:00.148 INFO:teuthology.orchestra.run.smithi101.stdout: }, 2023-08-01T19:55:00.148 INFO:teuthology.orchestra.run.smithi101.stdout: { 2023-08-01T19:55:00.148 INFO:teuthology.orchestra.run.smithi101.stdout: "event": "queued_for_pg", 2023-08-01T19:55:00.148 INFO:teuthology.orchestra.run.smithi101.stdout: "time": "2023-08-01T19:54:04.459056+0000", 2023-08-01T19:55:00.148 INFO:teuthology.orchestra.run.smithi101.stdout: "duration": 5.339e-06 2023-08-01T19:55:00.148 INFO:teuthology.orchestra.run.smithi101.stdout: }, 2023-08-01T19:55:00.149 INFO:teuthology.orchestra.run.smithi101.stdout: { 2023-08-01T19:55:00.149 INFO:teuthology.orchestra.run.smithi101.stdout: "event": "reached_pg", 2023-08-01T19:55:00.149 INFO:teuthology.orchestra.run.smithi101.stdout: "time": "2023-08-01T19:54:04.459091+0000", 2023-08-01T19:55:00.149 INFO:teuthology.orchestra.run.smithi101.stdout: "duration": 3.4090000000000001e-05 2023-08-01T19:55:00.149 INFO:teuthology.orchestra.run.smithi101.stdout: }, 2023-08-01T19:55:00.149 INFO:teuthology.orchestra.run.smithi101.stdout: { 2023-08-01T19:55:00.149 INFO:teuthology.orchestra.run.smithi101.stdout: "event": "op must wait for map", 2023-08-01T19:55:00.149 INFO:teuthology.orchestra.run.smithi101.stdout: "time": "2023-08-01T19:54:04.459094+0000", 2023-08-01T19:55:00.150 INFO:teuthology.orchestra.run.smithi101.stdout: "duration": 3.303e-06 2023-08-01T19:55:00.150 INFO:teuthology.orchestra.run.smithi101.stdout: }, 2023-08-01T19:55:00.150 INFO:teuthology.orchestra.run.smithi101.stdout: { 2023-08-01T19:55:00.150 INFO:teuthology.orchestra.run.smithi101.stdout: "event": "reached_pg", 2023-08-01T19:55:00.150 INFO:teuthology.orchestra.run.smithi101.stdout: "time": "2023-08-01T19:54:04.469860+0000", 2023-08-01T19:55:00.150 INFO:teuthology.orchestra.run.smithi101.stdout: "duration": 0.010765749 2023-08-01T19:55:00.150 INFO:teuthology.orchestra.run.smithi101.stdout: }, 2023-08-01T19:55:00.150 INFO:teuthology.orchestra.run.smithi101.stdout: { 2023-08-01T19:55:00.151 INFO:teuthology.orchestra.run.smithi101.stdout: "event": "started", 2023-08-01T19:55:00.151 INFO:teuthology.orchestra.run.smithi101.stdout: "time": "2023-08-01T19:54:04.470008+0000", 2023-08-01T19:55:00.151 INFO:teuthology.orchestra.run.smithi101.stdout: "duration": 0.000148367 2023-08-01T19:55:00.151 INFO:teuthology.orchestra.run.smithi101.stdout: }, 2023-08-01T19:55:00.151 INFO:teuthology.orchestra.run.smithi101.stdout: { 2023-08-01T19:55:00.151 INFO:teuthology.orchestra.run.smithi101.stdout: "event": "waiting for subops from 2", 2023-08-01T19:55:00.151 INFO:teuthology.orchestra.run.smithi101.stdout: "time": "2023-08-01T19:54:04.470136+0000", 2023-08-01T19:55:00.151 INFO:teuthology.orchestra.run.smithi101.stdout: "duration": 0.000128329 2023-08-01T19:55:00.152 INFO:teuthology.orchestra.run.smithi101.stdout: }, 2023-08-01T19:55:00.152 INFO:teuthology.orchestra.run.smithi101.stdout: { 2023-08-01T19:55:00.152 INFO:teuthology.orchestra.run.smithi101.stdout: "event": "op_commit", 2023-08-01T19:55:00.152 INFO:teuthology.orchestra.run.smithi101.stdout: "time": "2023-08-01T19:54:04.476399+0000", 2023-08-01T19:55:00.152 INFO:teuthology.orchestra.run.smithi101.stdout: "duration": 0.0062627259999999997 2023-08-01T19:55:00.152 INFO:teuthology.orchestra.run.smithi101.stdout: }, 2023-08-01T19:55:00.152 INFO:teuthology.orchestra.run.smithi101.stdout: { 2023-08-01T19:55:00.153 INFO:teuthology.orchestra.run.smithi101.stdout: "event": "sub_op_commit_rec", 2023-08-01T19:55:00.153 INFO:teuthology.orchestra.run.smithi101.stdout: "time": "2023-08-01T19:54:04.477726+0000", 2023-08-01T19:55:00.153 INFO:teuthology.orchestra.run.smithi101.stdout: "duration": 0.001327103 2023-08-01T19:55:00.153 INFO:teuthology.orchestra.run.smithi101.stdout: }, 2023-08-01T19:55:00.153 INFO:teuthology.orchestra.run.smithi101.stdout: { 2023-08-01T19:55:00.153 INFO:teuthology.orchestra.run.smithi101.stdout: "event": "commit_sent", 2023-08-01T19:55:00.153 INFO:teuthology.orchestra.run.smithi101.stdout: "time": "2023-08-01T19:54:04.477771+0000", 2023-08-01T19:55:00.153 INFO:teuthology.orchestra.run.smithi101.stdout: "duration": 4.5232000000000003e-05 2023-08-01T19:55:00.154 INFO:teuthology.orchestra.run.smithi101.stdout: }, 2023-08-01T19:55:00.154 INFO:teuthology.orchestra.run.smithi101.stdout: { 2023-08-01T19:55:00.154 INFO:teuthology.orchestra.run.smithi101.stdout: "event": "done", 2023-08-01T19:55:00.154 INFO:teuthology.orchestra.run.smithi101.stdout: "time": "2023-08-01T19:54:04.477795+0000", 2023-08-01T19:55:00.154 INFO:teuthology.orchestra.run.smithi101.stdout: "duration": 2.4134999999999998e-05 2023-08-01T19:55:00.154 INFO:teuthology.orchestra.run.smithi101.stdout: } 2023-08-01T19:55:00.154 INFO:teuthology.orchestra.run.smithi101.stdout: ] 2023-08-01T19:55:00.154 INFO:teuthology.orchestra.run.smithi101.stdout: } 2023-08-01T19:55:00.155 INFO:teuthology.orchestra.run.smithi101.stdout: }, 2023-08-01T19:55:00.155 INFO:teuthology.orchestra.run.smithi101.stdout: { 2023-08-01T19:55:00.155 INFO:teuthology.orchestra.run.smithi101.stdout: "description": "osd_op(mds.0.3:19 3.14 3:2f55791f:::606.00000000:head [create,setxattr parent (62) in=6b,setxattr layout (30) in=6b] snapc 0=[] ondisk+write+known_if_redirected+full_force+supports_pool_eio e17)", 2023-08-01T19:55:00.155 INFO:teuthology.orchestra.run.smithi101.stdout: "initiated_at": "2023-08-01T19:54:04.459069+0000", 2023-08-01T19:55:00.155 INFO:teuthology.orchestra.run.smithi101.stdout: "age": 55.587932395999999, 2023-08-01T19:55:00.155 INFO:teuthology.orchestra.run.smithi101.stdout: "duration": 0.019523045999999999, 2023-08-01T19:55:00.155 INFO:teuthology.orchestra.run.smithi101.stdout: "type_data": { 2023-08-01T19:55:00.155 INFO:teuthology.orchestra.run.smithi101.stdout: "flag_point": "commit sent; apply or cleanup", 2023-08-01T19:55:00.156 INFO:teuthology.orchestra.run.smithi101.stdout: "events": [ 2023-08-01T19:55:00.156 INFO:teuthology.orchestra.run.smithi101.stdout: { 2023-08-01T19:55:00.156 INFO:teuthology.orchestra.run.smithi101.stdout: "event": "initiated", 2023-08-01T19:55:00.156 INFO:teuthology.orchestra.run.smithi101.stdout: "time": "2023-08-01T19:54:04.459069+0000", 2023-08-01T19:55:00.156 INFO:teuthology.orchestra.run.smithi101.stdout: "duration": 0 2023-08-01T19:55:00.156 INFO:teuthology.orchestra.run.smithi101.stdout: }, 2023-08-01T19:55:00.156 INFO:teuthology.orchestra.run.smithi101.stdout: { 2023-08-01T19:55:00.157 INFO:teuthology.orchestra.run.smithi101.stdout: "event": "throttled", 2023-08-01T19:55:00.157 INFO:teuthology.orchestra.run.smithi101.stdout: "time": "2023-08-01T19:54:04.459069+0000", 2023-08-01T19:55:00.157 INFO:teuthology.orchestra.run.smithi101.stdout: "duration": 0 2023-08-01T19:55:00.157 INFO:teuthology.orchestra.run.smithi101.stdout: }, 2023-08-01T19:55:00.157 INFO:teuthology.orchestra.run.smithi101.stdout: { 2023-08-01T19:55:00.157 INFO:teuthology.orchestra.run.smithi101.stdout: "event": "header_read", 2023-08-01T19:55:00.157 INFO:teuthology.orchestra.run.smithi101.stdout: "time": "2023-08-01T19:54:04.459069+0000", 2023-08-01T19:55:00.157 INFO:teuthology.orchestra.run.smithi101.stdout: "duration": 4294967295.9999995 2023-08-01T19:55:00.158 INFO:teuthology.orchestra.run.smithi101.stdout: }, 2023-08-01T19:55:00.158 INFO:teuthology.orchestra.run.smithi101.stdout: { 2023-08-01T19:55:00.158 INFO:teuthology.orchestra.run.smithi101.stdout: "event": "all_read", 2023-08-01T19:55:00.158 INFO:teuthology.orchestra.run.smithi101.stdout: "time": "2023-08-01T19:54:04.459072+0000", 2023-08-01T19:55:00.158 INFO:teuthology.orchestra.run.smithi101.stdout: "duration": 3.4570000000000001e-06 2023-08-01T19:55:00.158 INFO:teuthology.orchestra.run.smithi101.stdout: }, 2023-08-01T19:55:00.158 INFO:teuthology.orchestra.run.smithi101.stdout: { 2023-08-01T19:55:00.159 INFO:teuthology.orchestra.run.smithi101.stdout: "event": "dispatched", 2023-08-01T19:55:00.159 INFO:teuthology.orchestra.run.smithi101.stdout: "time": "2023-08-01T19:54:04.459080+0000", 2023-08-01T19:55:00.159 INFO:teuthology.orchestra.run.smithi101.stdout: "duration": 7.6009999999999997e-06 2023-08-01T19:55:00.159 INFO:teuthology.orchestra.run.smithi101.stdout: }, 2023-08-01T19:55:00.159 INFO:teuthology.orchestra.run.smithi101.stdout: { 2023-08-01T19:55:00.159 INFO:teuthology.orchestra.run.smithi101.stdout: "event": "queued_for_pg", 2023-08-01T19:55:00.159 INFO:teuthology.orchestra.run.smithi101.stdout: "time": "2023-08-01T19:54:04.459088+0000", 2023-08-01T19:55:00.160 INFO:teuthology.orchestra.run.smithi101.stdout: "duration": 8.0509999999999997e-06 2023-08-01T19:55:00.160 INFO:teuthology.orchestra.run.smithi101.stdout: }, 2023-08-01T19:55:00.160 INFO:teuthology.orchestra.run.smithi101.stdout: { 2023-08-01T19:55:00.160 INFO:teuthology.orchestra.run.smithi101.stdout: "event": "reached_pg", 2023-08-01T19:55:00.160 INFO:teuthology.orchestra.run.smithi101.stdout: "time": "2023-08-01T19:54:04.459120+0000", 2023-08-01T19:55:00.160 INFO:teuthology.orchestra.run.smithi101.stdout: "duration": 3.2078e-05 2023-08-01T19:55:00.160 INFO:teuthology.orchestra.run.smithi101.stdout: }, 2023-08-01T19:55:00.160 INFO:teuthology.orchestra.run.smithi101.stdout: { 2023-08-01T19:55:00.161 INFO:teuthology.orchestra.run.smithi101.stdout: "event": "waiting_for_map not empty", 2023-08-01T19:55:00.161 INFO:teuthology.orchestra.run.smithi101.stdout: "time": "2023-08-01T19:54:04.459123+0000", 2023-08-01T19:55:00.161 INFO:teuthology.orchestra.run.smithi101.stdout: "duration": 3.4699999999999998e-06 2023-08-01T19:55:00.161 INFO:teuthology.orchestra.run.smithi101.stdout: }, 2023-08-01T19:55:00.161 INFO:teuthology.orchestra.run.smithi101.stdout: { 2023-08-01T19:55:00.161 INFO:teuthology.orchestra.run.smithi101.stdout: "event": "reached_pg", 2023-08-01T19:55:00.161 INFO:teuthology.orchestra.run.smithi101.stdout: "time": "2023-08-01T19:54:04.471352+0000", 2023-08-01T19:55:00.161 INFO:teuthology.orchestra.run.smithi101.stdout: "duration": 0.01222926 2023-08-01T19:55:00.162 INFO:teuthology.orchestra.run.smithi101.stdout: }, 2023-08-01T19:55:00.162 INFO:teuthology.orchestra.run.smithi101.stdout: { 2023-08-01T19:55:00.162 INFO:teuthology.orchestra.run.smithi101.stdout: "event": "started", 2023-08-01T19:55:00.162 INFO:teuthology.orchestra.run.smithi101.stdout: "time": "2023-08-01T19:54:04.471495+0000", 2023-08-01T19:55:00.162 INFO:teuthology.orchestra.run.smithi101.stdout: "duration": 0.00014263899999999999 2023-08-01T19:55:00.162 INFO:teuthology.orchestra.run.smithi101.stdout: }, 2023-08-01T19:55:00.162 INFO:teuthology.orchestra.run.smithi101.stdout: { 2023-08-01T19:55:00.163 INFO:teuthology.orchestra.run.smithi101.stdout: "event": "waiting for subops from 2", 2023-08-01T19:55:00.163 INFO:teuthology.orchestra.run.smithi101.stdout: "time": "2023-08-01T19:54:04.472368+0000", 2023-08-01T19:55:00.163 INFO:teuthology.orchestra.run.smithi101.stdout: "duration": 0.00087245300000000003 2023-08-01T19:55:00.163 INFO:teuthology.orchestra.run.smithi101.stdout: }, 2023-08-01T19:55:00.163 INFO:teuthology.orchestra.run.smithi101.stdout: { 2023-08-01T19:55:00.163 INFO:teuthology.orchestra.run.smithi101.stdout: "event": "op_commit", 2023-08-01T19:55:00.163 INFO:teuthology.orchestra.run.smithi101.stdout: "time": "2023-08-01T19:54:04.477612+0000", 2023-08-01T19:55:00.163 INFO:teuthology.orchestra.run.smithi101.stdout: "duration": 0.0052442809999999999 2023-08-01T19:55:00.164 INFO:teuthology.orchestra.run.smithi101.stdout: }, 2023-08-01T19:55:00.164 INFO:teuthology.orchestra.run.smithi101.stdout: { 2023-08-01T19:55:00.164 INFO:teuthology.orchestra.run.smithi101.stdout: "event": "sub_op_commit_rec", 2023-08-01T19:55:00.164 INFO:teuthology.orchestra.run.smithi101.stdout: "time": "2023-08-01T19:54:04.478516+0000", 2023-08-01T19:55:00.164 INFO:teuthology.orchestra.run.smithi101.stdout: "duration": 0.00090399800000000004 2023-08-01T19:55:00.164 INFO:teuthology.orchestra.run.smithi101.stdout: }, 2023-08-01T19:55:00.164 INFO:teuthology.orchestra.run.smithi101.stdout: { 2023-08-01T19:55:00.165 INFO:teuthology.orchestra.run.smithi101.stdout: "event": "commit_sent", 2023-08-01T19:55:00.165 INFO:teuthology.orchestra.run.smithi101.stdout: "time": "2023-08-01T19:54:04.478555+0000", 2023-08-01T19:55:00.165 INFO:teuthology.orchestra.run.smithi101.stdout: "duration": 3.8977000000000003e-05 2023-08-01T19:55:00.165 INFO:teuthology.orchestra.run.smithi101.stdout: }, 2023-08-01T19:55:00.165 INFO:teuthology.orchestra.run.smithi101.stdout: { 2023-08-01T19:55:00.165 INFO:teuthology.orchestra.run.smithi101.stdout: "event": "done", 2023-08-01T19:55:00.165 INFO:teuthology.orchestra.run.smithi101.stdout: "time": "2023-08-01T19:54:04.478592+0000", 2023-08-01T19:55:00.165 INFO:teuthology.orchestra.run.smithi101.stdout: "duration": 3.7287999999999999e-05 2023-08-01T19:55:00.166 INFO:teuthology.orchestra.run.smithi101.stdout: } 2023-08-01T19:55:00.166 INFO:teuthology.orchestra.run.smithi101.stdout: ] 2023-08-01T19:55:00.166 INFO:teuthology.orchestra.run.smithi101.stdout: } 2023-08-01T19:55:00.166 INFO:teuthology.orchestra.run.smithi101.stdout: }, 2023-08-01T19:55:00.166 INFO:teuthology.orchestra.run.smithi101.stdout: { 2023-08-01T19:55:00.166 INFO:teuthology.orchestra.run.smithi101.stdout: "description": "osd_op(mds.0.3:20 3.1c 3:3ed09add:::607.00000000:head [omap-set-header] snapc 0=[] ondisk+write+known_if_redirected+full_force+supports_pool_eio e17)", 2023-08-01T19:55:00.166 INFO:teuthology.orchestra.run.smithi101.stdout: "initiated_at": "2023-08-01T19:54:04.459097+0000", 2023-08-01T19:55:00.166 INFO:teuthology.orchestra.run.smithi101.stdout: "age": 55.587904692000002, 2023-08-01T19:55:00.167 INFO:teuthology.orchestra.run.smithi101.stdout: "duration": 0.018578978999999999, 2023-08-01T19:55:00.167 INFO:teuthology.orchestra.run.smithi101.stdout: "type_data": { 2023-08-01T19:55:00.167 INFO:teuthology.orchestra.run.smithi101.stdout: "flag_point": "commit sent; apply or cleanup", 2023-08-01T19:55:00.167 INFO:teuthology.orchestra.run.smithi101.stdout: "events": [ 2023-08-01T19:55:00.167 INFO:teuthology.orchestra.run.smithi101.stdout: { 2023-08-01T19:55:00.167 INFO:teuthology.orchestra.run.smithi101.stdout: "event": "initiated", 2023-08-01T19:55:00.167 INFO:teuthology.orchestra.run.smithi101.stdout: "time": "2023-08-01T19:54:04.459097+0000", 2023-08-01T19:55:00.167 INFO:teuthology.orchestra.run.smithi101.stdout: "duration": 0 2023-08-01T19:55:00.168 INFO:teuthology.orchestra.run.smithi101.stdout: }, 2023-08-01T19:55:00.168 INFO:teuthology.orchestra.run.smithi101.stdout: { 2023-08-01T19:55:00.168 INFO:teuthology.orchestra.run.smithi101.stdout: "event": "throttled", 2023-08-01T19:55:00.168 INFO:teuthology.orchestra.run.smithi101.stdout: "time": "2023-08-01T19:54:04.459097+0000", 2023-08-01T19:55:00.168 INFO:teuthology.orchestra.run.smithi101.stdout: "duration": 0 2023-08-01T19:55:00.168 INFO:teuthology.orchestra.run.smithi101.stdout: }, 2023-08-01T19:55:00.168 INFO:teuthology.orchestra.run.smithi101.stdout: { 2023-08-01T19:55:00.169 INFO:teuthology.orchestra.run.smithi101.stdout: "event": "header_read", 2023-08-01T19:55:00.169 INFO:teuthology.orchestra.run.smithi101.stdout: "time": "2023-08-01T19:54:04.459096+0000", 2023-08-01T19:55:00.169 INFO:teuthology.orchestra.run.smithi101.stdout: "duration": 4294967295.9999995 2023-08-01T19:55:00.169 INFO:teuthology.orchestra.run.smithi101.stdout: }, 2023-08-01T19:55:00.169 INFO:teuthology.orchestra.run.smithi101.stdout: { 2023-08-01T19:55:00.169 INFO:teuthology.orchestra.run.smithi101.stdout: "event": "all_read", 2023-08-01T19:55:00.169 INFO:teuthology.orchestra.run.smithi101.stdout: "time": "2023-08-01T19:54:04.459105+0000", 2023-08-01T19:55:00.169 INFO:teuthology.orchestra.run.smithi101.stdout: "duration": 8.8259999999999999e-06 2023-08-01T19:55:00.170 INFO:teuthology.orchestra.run.smithi101.stdout: }, 2023-08-01T19:55:00.170 INFO:teuthology.orchestra.run.smithi101.stdout: { 2023-08-01T19:55:00.170 INFO:teuthology.orchestra.run.smithi101.stdout: "event": "dispatched", 2023-08-01T19:55:00.170 INFO:teuthology.orchestra.run.smithi101.stdout: "time": "2023-08-01T19:54:04.459112+0000", 2023-08-01T19:55:00.170 INFO:teuthology.orchestra.run.smithi101.stdout: "duration": 6.6660000000000002e-06 2023-08-01T19:55:00.170 INFO:teuthology.orchestra.run.smithi101.stdout: }, 2023-08-01T19:55:00.170 INFO:teuthology.orchestra.run.smithi101.stdout: { 2023-08-01T19:55:00.170 INFO:teuthology.orchestra.run.smithi101.stdout: "event": "queued_for_pg", 2023-08-01T19:55:00.171 INFO:teuthology.orchestra.run.smithi101.stdout: "time": "2023-08-01T19:54:04.459116+0000", 2023-08-01T19:55:00.171 INFO:teuthology.orchestra.run.smithi101.stdout: "duration": 4.2209999999999999e-06 2023-08-01T19:55:00.171 INFO:teuthology.orchestra.run.smithi101.stdout: }, 2023-08-01T19:55:00.171 INFO:teuthology.orchestra.run.smithi101.stdout: { 2023-08-01T19:55:00.171 INFO:teuthology.orchestra.run.smithi101.stdout: "event": "reached_pg", 2023-08-01T19:55:00.171 INFO:teuthology.orchestra.run.smithi101.stdout: "time": "2023-08-01T19:54:04.459141+0000", 2023-08-01T19:55:00.171 INFO:teuthology.orchestra.run.smithi101.stdout: "duration": 2.4627e-05 2023-08-01T19:55:00.171 INFO:teuthology.orchestra.run.smithi101.stdout: }, 2023-08-01T19:55:00.172 INFO:teuthology.orchestra.run.smithi101.stdout: { 2023-08-01T19:55:00.172 INFO:teuthology.orchestra.run.smithi101.stdout: "event": "op must wait for map", 2023-08-01T19:55:00.172 INFO:teuthology.orchestra.run.smithi101.stdout: "time": "2023-08-01T19:54:04.459144+0000", 2023-08-01T19:55:00.172 INFO:teuthology.orchestra.run.smithi101.stdout: "duration": 3.6559999999999998e-06 2023-08-01T19:55:00.172 INFO:teuthology.orchestra.run.smithi101.stdout: }, 2023-08-01T19:55:00.172 INFO:teuthology.orchestra.run.smithi101.stdout: { 2023-08-01T19:55:00.172 INFO:teuthology.orchestra.run.smithi101.stdout: "event": "reached_pg", 2023-08-01T19:55:00.173 INFO:teuthology.orchestra.run.smithi101.stdout: "time": "2023-08-01T19:54:04.468086+0000", 2023-08-01T19:55:00.173 INFO:teuthology.orchestra.run.smithi101.stdout: "duration": 0.0089415569999999993 2023-08-01T19:55:00.173 INFO:teuthology.orchestra.run.smithi101.stdout: }, 2023-08-01T19:55:00.173 INFO:teuthology.orchestra.run.smithi101.stdout: { 2023-08-01T19:55:00.173 INFO:teuthology.orchestra.run.smithi101.stdout: "event": "started", 2023-08-01T19:55:00.173 INFO:teuthology.orchestra.run.smithi101.stdout: "time": "2023-08-01T19:54:04.468204+0000", 2023-08-01T19:55:00.173 INFO:teuthology.orchestra.run.smithi101.stdout: "duration": 0.00011806700000000001 2023-08-01T19:55:00.173 INFO:teuthology.orchestra.run.smithi101.stdout: }, 2023-08-01T19:55:00.174 INFO:teuthology.orchestra.run.smithi101.stdout: { 2023-08-01T19:55:00.174 INFO:teuthology.orchestra.run.smithi101.stdout: "event": "waiting for subops from 0", 2023-08-01T19:55:00.174 INFO:teuthology.orchestra.run.smithi101.stdout: "time": "2023-08-01T19:54:04.468342+0000", 2023-08-01T19:55:00.174 INFO:teuthology.orchestra.run.smithi101.stdout: "duration": 0.000138269 2023-08-01T19:55:00.174 INFO:teuthology.orchestra.run.smithi101.stdout: }, 2023-08-01T19:55:00.174 INFO:teuthology.orchestra.run.smithi101.stdout: { 2023-08-01T19:55:00.174 INFO:teuthology.orchestra.run.smithi101.stdout: "event": "op_commit", 2023-08-01T19:55:00.174 INFO:teuthology.orchestra.run.smithi101.stdout: "time": "2023-08-01T19:54:04.474028+0000", 2023-08-01T19:55:00.175 INFO:teuthology.orchestra.run.smithi101.stdout: "duration": 0.005685458 2023-08-01T19:55:00.175 INFO:teuthology.orchestra.run.smithi101.stdout: }, 2023-08-01T19:55:00.175 INFO:teuthology.orchestra.run.smithi101.stdout: { 2023-08-01T19:55:00.175 INFO:teuthology.orchestra.run.smithi101.stdout: "event": "sub_op_commit_rec", 2023-08-01T19:55:00.175 INFO:teuthology.orchestra.run.smithi101.stdout: "time": "2023-08-01T19:54:04.477581+0000", 2023-08-01T19:55:00.175 INFO:teuthology.orchestra.run.smithi101.stdout: "duration": 0.0035531109999999999 2023-08-01T19:55:00.175 INFO:teuthology.orchestra.run.smithi101.stdout: }, 2023-08-01T19:55:00.176 INFO:teuthology.orchestra.run.smithi101.stdout: { 2023-08-01T19:55:00.176 INFO:teuthology.orchestra.run.smithi101.stdout: "event": "commit_sent", 2023-08-01T19:55:00.176 INFO:teuthology.orchestra.run.smithi101.stdout: "time": "2023-08-01T19:54:04.477635+0000", 2023-08-01T19:55:00.176 INFO:teuthology.orchestra.run.smithi101.stdout: "duration": 5.3769e-05 2023-08-01T19:55:00.176 INFO:teuthology.orchestra.run.smithi101.stdout: }, 2023-08-01T19:55:00.176 INFO:teuthology.orchestra.run.smithi101.stdout: { 2023-08-01T19:55:00.176 INFO:teuthology.orchestra.run.smithi101.stdout: "event": "done", 2023-08-01T19:55:00.176 INFO:teuthology.orchestra.run.smithi101.stdout: "time": "2023-08-01T19:54:04.477676+0000", 2023-08-01T19:55:00.177 INFO:teuthology.orchestra.run.smithi101.stdout: "duration": 4.1148e-05 2023-08-01T19:55:00.177 INFO:teuthology.orchestra.run.smithi101.stdout: } 2023-08-01T19:55:00.177 INFO:teuthology.orchestra.run.smithi101.stdout: ] 2023-08-01T19:55:00.177 INFO:teuthology.orchestra.run.smithi101.stdout: } 2023-08-01T19:55:00.177 INFO:teuthology.orchestra.run.smithi101.stdout: }, 2023-08-01T19:55:00.177 INFO:teuthology.orchestra.run.smithi101.stdout: { 2023-08-01T19:55:00.178 INFO:teuthology.orchestra.run.smithi101.stdout: "description": "osd_op(mds.0.3:21 3.1c 3:3ed09add:::607.00000000:head [create,setxattr parent (62) in=6b,setxattr layout (30) in=6b] snapc 0=[] ondisk+write+known_if_redirected+full_force+supports_pool_eio e17)", 2023-08-01T19:55:00.178 INFO:teuthology.orchestra.run.smithi101.stdout: "initiated_at": "2023-08-01T19:54:04.459123+0000", 2023-08-01T19:55:00.178 INFO:teuthology.orchestra.run.smithi101.stdout: "age": 55.587878535000002, 2023-08-01T19:55:00.178 INFO:teuthology.orchestra.run.smithi101.stdout: "duration": 0.018736452000000001, 2023-08-01T19:55:00.178 INFO:teuthology.orchestra.run.smithi101.stdout: "type_data": { 2023-08-01T19:55:00.178 INFO:teuthology.orchestra.run.smithi101.stdout: "flag_point": "commit sent; apply or cleanup", 2023-08-01T19:55:00.178 INFO:teuthology.orchestra.run.smithi101.stdout: "events": [ 2023-08-01T19:55:00.178 INFO:teuthology.orchestra.run.smithi101.stdout: { 2023-08-01T19:55:00.179 INFO:teuthology.orchestra.run.smithi101.stdout: "event": "initiated", 2023-08-01T19:55:00.179 INFO:teuthology.orchestra.run.smithi101.stdout: "time": "2023-08-01T19:54:04.459123+0000", 2023-08-01T19:55:00.179 INFO:teuthology.orchestra.run.smithi101.stdout: "duration": 0 2023-08-01T19:55:00.179 INFO:teuthology.orchestra.run.smithi101.stdout: }, 2023-08-01T19:55:00.179 INFO:teuthology.orchestra.run.smithi101.stdout: { 2023-08-01T19:55:00.179 INFO:teuthology.orchestra.run.smithi101.stdout: "event": "throttled", 2023-08-01T19:55:00.179 INFO:teuthology.orchestra.run.smithi101.stdout: "time": "2023-08-01T19:54:04.459123+0000", 2023-08-01T19:55:00.180 INFO:teuthology.orchestra.run.smithi101.stdout: "duration": 0 2023-08-01T19:55:00.180 INFO:teuthology.orchestra.run.smithi101.stdout: }, 2023-08-01T19:55:00.180 INFO:teuthology.orchestra.run.smithi101.stdout: { 2023-08-01T19:55:00.180 INFO:teuthology.orchestra.run.smithi101.stdout: "event": "header_read", 2023-08-01T19:55:00.180 INFO:teuthology.orchestra.run.smithi101.stdout: "time": "2023-08-01T19:54:04.459123+0000", 2023-08-01T19:55:00.180 INFO:teuthology.orchestra.run.smithi101.stdout: "duration": 4294967295.9999995 2023-08-01T19:55:00.180 INFO:teuthology.orchestra.run.smithi101.stdout: }, 2023-08-01T19:55:00.181 INFO:teuthology.orchestra.run.smithi101.stdout: { 2023-08-01T19:55:00.181 INFO:teuthology.orchestra.run.smithi101.stdout: "event": "all_read", 2023-08-01T19:55:00.181 INFO:teuthology.orchestra.run.smithi101.stdout: "time": "2023-08-01T19:54:04.459127+0000", 2023-08-01T19:55:00.181 INFO:teuthology.orchestra.run.smithi101.stdout: "duration": 4.5770000000000004e-06 2023-08-01T19:55:00.181 INFO:teuthology.orchestra.run.smithi101.stdout: }, 2023-08-01T19:55:00.181 INFO:teuthology.orchestra.run.smithi101.stdout: { 2023-08-01T19:55:00.181 INFO:teuthology.orchestra.run.smithi101.stdout: "event": "dispatched", 2023-08-01T19:55:00.181 INFO:teuthology.orchestra.run.smithi101.stdout: "time": "2023-08-01T19:54:04.459134+0000", 2023-08-01T19:55:00.182 INFO:teuthology.orchestra.run.smithi101.stdout: "duration": 6.5080000000000002e-06 2023-08-01T19:55:00.182 INFO:teuthology.orchestra.run.smithi101.stdout: }, 2023-08-01T19:55:00.182 INFO:teuthology.orchestra.run.smithi101.stdout: { 2023-08-01T19:55:00.182 INFO:teuthology.orchestra.run.smithi101.stdout: "event": "queued_for_pg", 2023-08-01T19:55:00.182 INFO:teuthology.orchestra.run.smithi101.stdout: "time": "2023-08-01T19:54:04.459138+0000", 2023-08-01T19:55:00.182 INFO:teuthology.orchestra.run.smithi101.stdout: "duration": 4.6249999999999998e-06 2023-08-01T19:55:00.182 INFO:teuthology.orchestra.run.smithi101.stdout: }, 2023-08-01T19:55:00.183 INFO:teuthology.orchestra.run.smithi101.stdout: { 2023-08-01T19:55:00.183 INFO:teuthology.orchestra.run.smithi101.stdout: "event": "reached_pg", 2023-08-01T19:55:00.183 INFO:teuthology.orchestra.run.smithi101.stdout: "time": "2023-08-01T19:54:04.459158+0000", 2023-08-01T19:55:00.183 INFO:teuthology.orchestra.run.smithi101.stdout: "duration": 1.9354000000000001e-05 2023-08-01T19:55:00.183 INFO:teuthology.orchestra.run.smithi101.stdout: }, 2023-08-01T19:55:00.183 INFO:teuthology.orchestra.run.smithi101.stdout: { 2023-08-01T19:55:00.183 INFO:teuthology.orchestra.run.smithi101.stdout: "event": "waiting_for_map not empty", 2023-08-01T19:55:00.183 INFO:teuthology.orchestra.run.smithi101.stdout: "time": "2023-08-01T19:54:04.459160+0000", 2023-08-01T19:55:00.184 INFO:teuthology.orchestra.run.smithi101.stdout: "duration": 2.2740000000000002e-06 2023-08-01T19:55:00.184 INFO:teuthology.orchestra.run.smithi101.stdout: }, 2023-08-01T19:55:00.184 INFO:teuthology.orchestra.run.smithi101.stdout: { 2023-08-01T19:55:00.184 INFO:teuthology.orchestra.run.smithi101.stdout: "event": "reached_pg", 2023-08-01T19:55:00.184 INFO:teuthology.orchestra.run.smithi101.stdout: "time": "2023-08-01T19:54:04.468839+0000", 2023-08-01T19:55:00.184 INFO:teuthology.orchestra.run.smithi101.stdout: "duration": 0.0096787109999999996 2023-08-01T19:55:00.184 INFO:teuthology.orchestra.run.smithi101.stdout: }, 2023-08-01T19:55:00.185 INFO:teuthology.orchestra.run.smithi101.stdout: { 2023-08-01T19:55:00.185 INFO:teuthology.orchestra.run.smithi101.stdout: "event": "started", 2023-08-01T19:55:00.185 INFO:teuthology.orchestra.run.smithi101.stdout: "time": "2023-08-01T19:54:04.469446+0000", 2023-08-01T19:55:00.185 INFO:teuthology.orchestra.run.smithi101.stdout: "duration": 0.00060714899999999997 2023-08-01T19:55:00.185 INFO:teuthology.orchestra.run.smithi101.stdout: }, 2023-08-01T19:55:00.185 INFO:teuthology.orchestra.run.smithi101.stdout: { 2023-08-01T19:55:00.186 INFO:teuthology.orchestra.run.smithi101.stdout: "event": "waiting for subops from 0", 2023-08-01T19:55:00.186 INFO:teuthology.orchestra.run.smithi101.stdout: "time": "2023-08-01T19:54:04.470133+0000", 2023-08-01T19:55:00.186 INFO:teuthology.orchestra.run.smithi101.stdout: "duration": 0.00068691900000000003 2023-08-01T19:55:00.186 INFO:teuthology.orchestra.run.smithi101.stdout: }, 2023-08-01T19:55:00.186 INFO:teuthology.orchestra.run.smithi101.stdout: { 2023-08-01T19:55:00.186 INFO:teuthology.orchestra.run.smithi101.stdout: "event": "op_commit", 2023-08-01T19:55:00.186 INFO:teuthology.orchestra.run.smithi101.stdout: "time": "2023-08-01T19:54:04.475933+0000", 2023-08-01T19:55:00.187 INFO:teuthology.orchestra.run.smithi101.stdout: "duration": 0.0058002560000000002 2023-08-01T19:55:00.187 INFO:teuthology.orchestra.run.smithi101.stdout: }, 2023-08-01T19:55:00.187 INFO:teuthology.orchestra.run.smithi101.stdout: { 2023-08-01T19:55:00.187 INFO:teuthology.orchestra.run.smithi101.stdout: "event": "sub_op_commit_rec", 2023-08-01T19:55:00.187 INFO:teuthology.orchestra.run.smithi101.stdout: "time": "2023-08-01T19:54:04.477749+0000", 2023-08-01T19:55:00.187 INFO:teuthology.orchestra.run.smithi101.stdout: "duration": 0.00181584 2023-08-01T19:55:00.187 INFO:teuthology.orchestra.run.smithi101.stdout: }, 2023-08-01T19:55:00.188 INFO:teuthology.orchestra.run.smithi101.stdout: { 2023-08-01T19:55:00.188 INFO:teuthology.orchestra.run.smithi101.stdout: "event": "commit_sent", 2023-08-01T19:55:00.188 INFO:teuthology.orchestra.run.smithi101.stdout: "time": "2023-08-01T19:54:04.477823+0000", 2023-08-01T19:55:00.188 INFO:teuthology.orchestra.run.smithi101.stdout: "duration": 7.4405000000000003e-05 2023-08-01T19:55:00.188 INFO:teuthology.orchestra.run.smithi101.stdout: }, 2023-08-01T19:55:00.188 INFO:teuthology.orchestra.run.smithi101.stdout: { 2023-08-01T19:55:00.189 INFO:teuthology.orchestra.run.smithi101.stdout: "event": "done", 2023-08-01T19:55:00.189 INFO:teuthology.orchestra.run.smithi101.stdout: "time": "2023-08-01T19:54:04.477859+0000", 2023-08-01T19:55:00.189 INFO:teuthology.orchestra.run.smithi101.stdout: "duration": 3.6211000000000003e-05 2023-08-01T19:55:00.189 INFO:teuthology.orchestra.run.smithi101.stdout: } 2023-08-01T19:55:00.189 INFO:teuthology.orchestra.run.smithi101.stdout: ] 2023-08-01T19:55:00.189 INFO:teuthology.orchestra.run.smithi101.stdout: } 2023-08-01T19:55:00.189 INFO:teuthology.orchestra.run.smithi101.stdout: }, 2023-08-01T19:55:00.190 INFO:teuthology.orchestra.run.smithi101.stdout: { 2023-08-01T19:55:00.190 INFO:teuthology.orchestra.run.smithi101.stdout: "description": "osd_op(mds.0.3:1 3.14 3:292cf221:::200.00000000:head [writefull 0~90] snapc 0=[] ondisk+write+known_if_redirected+full_force+supports_pool_eio e17)", 2023-08-01T19:55:00.190 INFO:teuthology.orchestra.run.smithi101.stdout: "initiated_at": "2023-08-01T19:54:04.459177+0000", 2023-08-01T19:55:00.190 INFO:teuthology.orchestra.run.smithi101.stdout: "age": 55.587824826000002, 2023-08-01T19:55:00.190 INFO:teuthology.orchestra.run.smithi101.stdout: "duration": 0.021067196, 2023-08-01T19:55:00.190 INFO:teuthology.orchestra.run.smithi101.stdout: "type_data": { 2023-08-01T19:55:00.190 INFO:teuthology.orchestra.run.smithi101.stdout: "flag_point": "commit sent; apply or cleanup", 2023-08-01T19:55:00.191 INFO:teuthology.orchestra.run.smithi101.stdout: "events": [ 2023-08-01T19:55:00.191 INFO:teuthology.orchestra.run.smithi101.stdout: { 2023-08-01T19:55:00.191 INFO:teuthology.orchestra.run.smithi101.stdout: "event": "initiated", 2023-08-01T19:55:00.191 INFO:teuthology.orchestra.run.smithi101.stdout: "time": "2023-08-01T19:54:04.459177+0000", 2023-08-01T19:55:00.191 INFO:teuthology.orchestra.run.smithi101.stdout: "duration": 0 2023-08-01T19:55:00.191 INFO:teuthology.orchestra.run.smithi101.stdout: }, 2023-08-01T19:55:00.191 INFO:teuthology.orchestra.run.smithi101.stdout: { 2023-08-01T19:55:00.191 INFO:teuthology.orchestra.run.smithi101.stdout: "event": "throttled", 2023-08-01T19:55:00.192 INFO:teuthology.orchestra.run.smithi101.stdout: "time": "2023-08-01T19:54:04.459177+0000", 2023-08-01T19:55:00.192 INFO:teuthology.orchestra.run.smithi101.stdout: "duration": 0 2023-08-01T19:55:00.192 INFO:teuthology.orchestra.run.smithi101.stdout: }, 2023-08-01T19:55:00.192 INFO:teuthology.orchestra.run.smithi101.stdout: { 2023-08-01T19:55:00.192 INFO:teuthology.orchestra.run.smithi101.stdout: "event": "header_read", 2023-08-01T19:55:00.192 INFO:teuthology.orchestra.run.smithi101.stdout: "time": "2023-08-01T19:54:04.459176+0000", 2023-08-01T19:55:00.192 INFO:teuthology.orchestra.run.smithi101.stdout: "duration": 4294967295.9999995 2023-08-01T19:55:00.193 INFO:teuthology.orchestra.run.smithi101.stdout: }, 2023-08-01T19:55:00.193 INFO:teuthology.orchestra.run.smithi101.stdout: { 2023-08-01T19:55:00.193 INFO:teuthology.orchestra.run.smithi101.stdout: "event": "all_read", 2023-08-01T19:55:00.193 INFO:teuthology.orchestra.run.smithi101.stdout: "time": "2023-08-01T19:54:04.459181+0000", 2023-08-01T19:55:00.193 INFO:teuthology.orchestra.run.smithi101.stdout: "duration": 5.2109999999999997e-06 2023-08-01T19:55:00.193 INFO:teuthology.orchestra.run.smithi101.stdout: }, 2023-08-01T19:55:00.193 INFO:teuthology.orchestra.run.smithi101.stdout: { 2023-08-01T19:55:00.193 INFO:teuthology.orchestra.run.smithi101.stdout: "event": "dispatched", 2023-08-01T19:55:00.194 INFO:teuthology.orchestra.run.smithi101.stdout: "time": "2023-08-01T19:54:04.459188+0000", 2023-08-01T19:55:00.194 INFO:teuthology.orchestra.run.smithi101.stdout: "duration": 6.6680000000000004e-06 2023-08-01T19:55:00.194 INFO:teuthology.orchestra.run.smithi101.stdout: }, 2023-08-01T19:55:00.194 INFO:teuthology.orchestra.run.smithi101.stdout: { 2023-08-01T19:55:00.194 INFO:teuthology.orchestra.run.smithi101.stdout: "event": "queued_for_pg", 2023-08-01T19:55:00.194 INFO:teuthology.orchestra.run.smithi101.stdout: "time": "2023-08-01T19:54:04.459192+0000", 2023-08-01T19:55:00.194 INFO:teuthology.orchestra.run.smithi101.stdout: "duration": 4.228e-06 2023-08-01T19:55:00.194 INFO:teuthology.orchestra.run.smithi101.stdout: }, 2023-08-01T19:55:00.195 INFO:teuthology.orchestra.run.smithi101.stdout: { 2023-08-01T19:55:00.195 INFO:teuthology.orchestra.run.smithi101.stdout: "event": "reached_pg", 2023-08-01T19:55:00.195 INFO:teuthology.orchestra.run.smithi101.stdout: "time": "2023-08-01T19:54:04.459219+0000", 2023-08-01T19:55:00.195 INFO:teuthology.orchestra.run.smithi101.stdout: "duration": 2.6930000000000001e-05 2023-08-01T19:55:00.195 INFO:teuthology.orchestra.run.smithi101.stdout: }, 2023-08-01T19:55:00.195 INFO:teuthology.orchestra.run.smithi101.stdout: { 2023-08-01T19:55:00.195 INFO:teuthology.orchestra.run.smithi101.stdout: "event": "waiting_for_map not empty", 2023-08-01T19:55:00.195 INFO:teuthology.orchestra.run.smithi101.stdout: "time": "2023-08-01T19:54:04.459223+0000", 2023-08-01T19:55:00.196 INFO:teuthology.orchestra.run.smithi101.stdout: "duration": 3.8469999999999998e-06 2023-08-01T19:55:00.196 INFO:teuthology.orchestra.run.smithi101.stdout: }, 2023-08-01T19:55:00.196 INFO:teuthology.orchestra.run.smithi101.stdout: { 2023-08-01T19:55:00.196 INFO:teuthology.orchestra.run.smithi101.stdout: "event": "reached_pg", 2023-08-01T19:55:00.196 INFO:teuthology.orchestra.run.smithi101.stdout: "time": "2023-08-01T19:54:04.473347+0000", 2023-08-01T19:55:00.196 INFO:teuthology.orchestra.run.smithi101.stdout: "duration": 0.014124319 2023-08-01T19:55:00.197 INFO:teuthology.orchestra.run.smithi101.stdout: }, 2023-08-01T19:55:00.197 INFO:teuthology.orchestra.run.smithi101.stdout: { 2023-08-01T19:55:00.197 INFO:teuthology.orchestra.run.smithi101.stdout: "event": "started", 2023-08-01T19:55:00.197 INFO:teuthology.orchestra.run.smithi101.stdout: "time": "2023-08-01T19:54:04.473480+0000", 2023-08-01T19:55:00.197 INFO:teuthology.orchestra.run.smithi101.stdout: "duration": 0.00013276799999999999 2023-08-01T19:55:00.197 INFO:teuthology.orchestra.run.smithi101.stdout: }, 2023-08-01T19:55:00.197 INFO:teuthology.orchestra.run.smithi101.stdout: { 2023-08-01T19:55:00.198 INFO:teuthology.orchestra.run.smithi101.stdout: "event": "waiting for subops from 2", 2023-08-01T19:55:00.198 INFO:teuthology.orchestra.run.smithi101.stdout: "time": "2023-08-01T19:54:04.473622+0000", 2023-08-01T19:55:00.198 INFO:teuthology.orchestra.run.smithi101.stdout: "duration": 0.00014154799999999999 2023-08-01T19:55:00.198 INFO:teuthology.orchestra.run.smithi101.stdout: }, 2023-08-01T19:55:00.198 INFO:teuthology.orchestra.run.smithi101.stdout: { 2023-08-01T19:55:00.198 INFO:teuthology.orchestra.run.smithi101.stdout: "event": "op_commit", 2023-08-01T19:55:00.198 INFO:teuthology.orchestra.run.smithi101.stdout: "time": "2023-08-01T19:54:04.478281+0000", 2023-08-01T19:55:00.198 INFO:teuthology.orchestra.run.smithi101.stdout: "duration": 0.004659252 2023-08-01T19:55:00.199 INFO:teuthology.orchestra.run.smithi101.stdout: }, 2023-08-01T19:55:00.199 INFO:teuthology.orchestra.run.smithi101.stdout: { 2023-08-01T19:55:00.199 INFO:teuthology.orchestra.run.smithi101.stdout: "event": "sub_op_commit_rec", 2023-08-01T19:55:00.199 INFO:teuthology.orchestra.run.smithi101.stdout: "time": "2023-08-01T19:54:04.480180+0000", 2023-08-01T19:55:00.199 INFO:teuthology.orchestra.run.smithi101.stdout: "duration": 0.0018986859999999999 2023-08-01T19:55:00.199 INFO:teuthology.orchestra.run.smithi101.stdout: }, 2023-08-01T19:55:00.199 INFO:teuthology.orchestra.run.smithi101.stdout: { 2023-08-01T19:55:00.200 INFO:teuthology.orchestra.run.smithi101.stdout: "event": "commit_sent", 2023-08-01T19:55:00.200 INFO:teuthology.orchestra.run.smithi101.stdout: "time": "2023-08-01T19:54:04.480209+0000", 2023-08-01T19:55:00.200 INFO:teuthology.orchestra.run.smithi101.stdout: "duration": 2.9244999999999999e-05 2023-08-01T19:55:00.200 INFO:teuthology.orchestra.run.smithi101.stdout: }, 2023-08-01T19:55:00.200 INFO:teuthology.orchestra.run.smithi101.stdout: { 2023-08-01T19:55:00.200 INFO:teuthology.orchestra.run.smithi101.stdout: "event": "done", 2023-08-01T19:55:00.200 INFO:teuthology.orchestra.run.smithi101.stdout: "time": "2023-08-01T19:54:04.480244+0000", 2023-08-01T19:55:00.200 INFO:teuthology.orchestra.run.smithi101.stdout: "duration": 3.4875000000000001e-05 2023-08-01T19:55:00.201 INFO:teuthology.orchestra.run.smithi101.stdout: } 2023-08-01T19:55:00.201 INFO:teuthology.orchestra.run.smithi101.stdout: ] 2023-08-01T19:55:00.201 INFO:teuthology.orchestra.run.smithi101.stdout: } 2023-08-01T19:55:00.201 INFO:teuthology.orchestra.run.smithi101.stdout: }, 2023-08-01T19:55:00.201 INFO:teuthology.orchestra.run.smithi101.stdout: { 2023-08-01T19:55:00.201 INFO:teuthology.orchestra.run.smithi101.stdout: "description": "osd_op(mds.0.3:3 3.14 3:287034c4:::1.00000000.inode:head [writefull 0~554] snapc 0=[] ondisk+write+known_if_redirected+full_force+supports_pool_eio e17)", 2023-08-01T19:55:00.201 INFO:teuthology.orchestra.run.smithi101.stdout: "initiated_at": "2023-08-01T19:54:04.459226+0000", 2023-08-01T19:55:00.202 INFO:teuthology.orchestra.run.smithi101.stdout: "age": 55.587775747000002, 2023-08-01T19:55:00.202 INFO:teuthology.orchestra.run.smithi101.stdout: "duration": 0.021104531999999999, 2023-08-01T19:55:00.202 INFO:teuthology.orchestra.run.smithi101.stdout: "type_data": { 2023-08-01T19:55:00.202 INFO:teuthology.orchestra.run.smithi101.stdout: "flag_point": "commit sent; apply or cleanup", 2023-08-01T19:55:00.202 INFO:teuthology.orchestra.run.smithi101.stdout: "events": [ 2023-08-01T19:55:00.202 INFO:teuthology.orchestra.run.smithi101.stdout: { 2023-08-01T19:55:00.202 INFO:teuthology.orchestra.run.smithi101.stdout: "event": "initiated", 2023-08-01T19:55:00.203 INFO:teuthology.orchestra.run.smithi101.stdout: "time": "2023-08-01T19:54:04.459226+0000", 2023-08-01T19:55:00.203 INFO:teuthology.orchestra.run.smithi101.stdout: "duration": 0 2023-08-01T19:55:00.203 INFO:teuthology.orchestra.run.smithi101.stdout: }, 2023-08-01T19:55:00.203 INFO:teuthology.orchestra.run.smithi101.stdout: { 2023-08-01T19:55:00.203 INFO:teuthology.orchestra.run.smithi101.stdout: "event": "throttled", 2023-08-01T19:55:00.203 INFO:teuthology.orchestra.run.smithi101.stdout: "time": "2023-08-01T19:54:04.459226+0000", 2023-08-01T19:55:00.203 INFO:teuthology.orchestra.run.smithi101.stdout: "duration": 0 2023-08-01T19:55:00.203 INFO:teuthology.orchestra.run.smithi101.stdout: }, 2023-08-01T19:55:00.204 INFO:teuthology.orchestra.run.smithi101.stdout: { 2023-08-01T19:55:00.204 INFO:teuthology.orchestra.run.smithi101.stdout: "event": "header_read", 2023-08-01T19:55:00.204 INFO:teuthology.orchestra.run.smithi101.stdout: "time": "2023-08-01T19:54:04.459225+0000", 2023-08-01T19:55:00.204 INFO:teuthology.orchestra.run.smithi101.stdout: "duration": 4294967295.9999995 2023-08-01T19:55:00.204 INFO:teuthology.orchestra.run.smithi101.stdout: }, 2023-08-01T19:55:00.204 INFO:teuthology.orchestra.run.smithi101.stdout: { 2023-08-01T19:55:00.204 INFO:teuthology.orchestra.run.smithi101.stdout: "event": "all_read", 2023-08-01T19:55:00.205 INFO:teuthology.orchestra.run.smithi101.stdout: "time": "2023-08-01T19:54:04.459238+0000", 2023-08-01T19:55:00.205 INFO:teuthology.orchestra.run.smithi101.stdout: "duration": 1.2809000000000001e-05 2023-08-01T19:55:00.205 INFO:teuthology.orchestra.run.smithi101.stdout: }, 2023-08-01T19:55:00.205 INFO:teuthology.orchestra.run.smithi101.stdout: { 2023-08-01T19:55:00.205 INFO:teuthology.orchestra.run.smithi101.stdout: "event": "dispatched", 2023-08-01T19:55:00.205 INFO:teuthology.orchestra.run.smithi101.stdout: "time": "2023-08-01T19:54:04.459245+0000", 2023-08-01T19:55:00.205 INFO:teuthology.orchestra.run.smithi101.stdout: "duration": 6.6540000000000002e-06 2023-08-01T19:55:00.205 INFO:teuthology.orchestra.run.smithi101.stdout: }, 2023-08-01T19:55:00.206 INFO:teuthology.orchestra.run.smithi101.stdout: { 2023-08-01T19:55:00.206 INFO:teuthology.orchestra.run.smithi101.stdout: "event": "queued_for_pg", 2023-08-01T19:55:00.206 INFO:teuthology.orchestra.run.smithi101.stdout: "time": "2023-08-01T19:54:04.459249+0000", 2023-08-01T19:55:00.206 INFO:teuthology.orchestra.run.smithi101.stdout: "duration": 4.6e-06 2023-08-01T19:55:00.206 INFO:teuthology.orchestra.run.smithi101.stdout: }, 2023-08-01T19:55:00.206 INFO:teuthology.orchestra.run.smithi101.stdout: { 2023-08-01T19:55:00.206 INFO:teuthology.orchestra.run.smithi101.stdout: "event": "reached_pg", 2023-08-01T19:55:00.206 INFO:teuthology.orchestra.run.smithi101.stdout: "time": "2023-08-01T19:54:04.459276+0000", 2023-08-01T19:55:00.207 INFO:teuthology.orchestra.run.smithi101.stdout: "duration": 2.6373999999999999e-05 2023-08-01T19:55:00.207 INFO:teuthology.orchestra.run.smithi101.stdout: }, 2023-08-01T19:55:00.207 INFO:teuthology.orchestra.run.smithi101.stdout: { 2023-08-01T19:55:00.207 INFO:teuthology.orchestra.run.smithi101.stdout: "event": "waiting_for_map not empty", 2023-08-01T19:55:00.207 INFO:teuthology.orchestra.run.smithi101.stdout: "time": "2023-08-01T19:54:04.459278+0000", 2023-08-01T19:55:00.207 INFO:teuthology.orchestra.run.smithi101.stdout: "duration": 2.4980000000000001e-06 2023-08-01T19:55:00.207 INFO:teuthology.orchestra.run.smithi101.stdout: }, 2023-08-01T19:55:00.207 INFO:teuthology.orchestra.run.smithi101.stdout: { 2023-08-01T19:55:00.208 INFO:teuthology.orchestra.run.smithi101.stdout: "event": "reached_pg", 2023-08-01T19:55:00.208 INFO:teuthology.orchestra.run.smithi101.stdout: "time": "2023-08-01T19:54:04.474058+0000", 2023-08-01T19:55:00.208 INFO:teuthology.orchestra.run.smithi101.stdout: "duration": 0.014779979 2023-08-01T19:55:00.208 INFO:teuthology.orchestra.run.smithi101.stdout: }, 2023-08-01T19:55:00.208 INFO:teuthology.orchestra.run.smithi101.stdout: { 2023-08-01T19:55:00.208 INFO:teuthology.orchestra.run.smithi101.stdout: "event": "started", 2023-08-01T19:55:00.208 INFO:teuthology.orchestra.run.smithi101.stdout: "time": "2023-08-01T19:54:04.474614+0000", 2023-08-01T19:55:00.208 INFO:teuthology.orchestra.run.smithi101.stdout: "duration": 0.00055546899999999995 2023-08-01T19:55:00.209 INFO:teuthology.orchestra.run.smithi101.stdout: }, 2023-08-01T19:55:00.209 INFO:teuthology.orchestra.run.smithi101.stdout: { 2023-08-01T19:55:00.209 INFO:teuthology.orchestra.run.smithi101.stdout: "event": "waiting for subops from 2", 2023-08-01T19:55:00.209 INFO:teuthology.orchestra.run.smithi101.stdout: "time": "2023-08-01T19:54:04.474720+0000", 2023-08-01T19:55:00.209 INFO:teuthology.orchestra.run.smithi101.stdout: "duration": 0.00010645300000000001 2023-08-01T19:55:00.209 INFO:teuthology.orchestra.run.smithi101.stdout: }, 2023-08-01T19:55:00.209 INFO:teuthology.orchestra.run.smithi101.stdout: { 2023-08-01T19:55:00.209 INFO:teuthology.orchestra.run.smithi101.stdout: "event": "op_commit", 2023-08-01T19:55:00.210 INFO:teuthology.orchestra.run.smithi101.stdout: "time": "2023-08-01T19:54:04.478480+0000", 2023-08-01T19:55:00.210 INFO:teuthology.orchestra.run.smithi101.stdout: "duration": 0.0037600279999999999 2023-08-01T19:55:00.210 INFO:teuthology.orchestra.run.smithi101.stdout: }, 2023-08-01T19:55:00.210 INFO:teuthology.orchestra.run.smithi101.stdout: { 2023-08-01T19:55:00.210 INFO:teuthology.orchestra.run.smithi101.stdout: "event": "sub_op_commit_rec", 2023-08-01T19:55:00.210 INFO:teuthology.orchestra.run.smithi101.stdout: "time": "2023-08-01T19:54:04.480273+0000", 2023-08-01T19:55:00.210 INFO:teuthology.orchestra.run.smithi101.stdout: "duration": 0.001792465 2023-08-01T19:55:00.211 INFO:teuthology.orchestra.run.smithi101.stdout: }, 2023-08-01T19:55:00.211 INFO:teuthology.orchestra.run.smithi101.stdout: { 2023-08-01T19:55:00.211 INFO:teuthology.orchestra.run.smithi101.stdout: "event": "commit_sent", 2023-08-01T19:55:00.211 INFO:teuthology.orchestra.run.smithi101.stdout: "time": "2023-08-01T19:54:04.480304+0000", 2023-08-01T19:55:00.211 INFO:teuthology.orchestra.run.smithi101.stdout: "duration": 3.1708999999999997e-05 2023-08-01T19:55:00.211 INFO:teuthology.orchestra.run.smithi101.stdout: }, 2023-08-01T19:55:00.211 INFO:teuthology.orchestra.run.smithi101.stdout: { 2023-08-01T19:55:00.211 INFO:teuthology.orchestra.run.smithi101.stdout: "event": "done", 2023-08-01T19:55:00.212 INFO:teuthology.orchestra.run.smithi101.stdout: "time": "2023-08-01T19:54:04.480330+0000", 2023-08-01T19:55:00.212 INFO:teuthology.orchestra.run.smithi101.stdout: "duration": 2.5860999999999999e-05 2023-08-01T19:55:00.212 INFO:teuthology.orchestra.run.smithi101.stdout: } 2023-08-01T19:55:00.212 INFO:teuthology.orchestra.run.smithi101.stdout: ] 2023-08-01T19:55:00.212 INFO:teuthology.orchestra.run.smithi101.stdout: } 2023-08-01T19:55:00.212 INFO:teuthology.orchestra.run.smithi101.stdout: }, 2023-08-01T19:55:00.212 INFO:teuthology.orchestra.run.smithi101.stdout: { 2023-08-01T19:55:00.212 INFO:teuthology.orchestra.run.smithi101.stdout: "description": "osd_op(mds.0.3:32 3.14 3:2e2fa760:::200.00000001:head [delete] snapc 0=[] ondisk+write+known_if_redirected+full_force+supports_pool_eio e17)", 2023-08-01T19:55:00.213 INFO:teuthology.orchestra.run.smithi101.stdout: "initiated_at": "2023-08-01T19:54:04.459304+0000", 2023-08-01T19:55:00.213 INFO:teuthology.orchestra.run.smithi101.stdout: "age": 55.587697085999999, 2023-08-01T19:55:00.213 INFO:teuthology.orchestra.run.smithi101.stdout: "duration": 0.021110606000000001, 2023-08-01T19:55:00.213 INFO:teuthology.orchestra.run.smithi101.stdout: "type_data": { 2023-08-01T19:55:00.213 INFO:teuthology.orchestra.run.smithi101.stdout: "flag_point": "started", 2023-08-01T19:55:00.213 INFO:teuthology.orchestra.run.smithi101.stdout: "events": [ 2023-08-01T19:55:00.213 INFO:teuthology.orchestra.run.smithi101.stdout: { 2023-08-01T19:55:00.213 INFO:teuthology.orchestra.run.smithi101.stdout: "event": "initiated", 2023-08-01T19:55:00.214 INFO:teuthology.orchestra.run.smithi101.stdout: "time": "2023-08-01T19:54:04.459304+0000", 2023-08-01T19:55:00.214 INFO:teuthology.orchestra.run.smithi101.stdout: "duration": 0 2023-08-01T19:55:00.214 INFO:teuthology.orchestra.run.smithi101.stdout: }, 2023-08-01T19:55:00.214 INFO:teuthology.orchestra.run.smithi101.stdout: { 2023-08-01T19:55:00.214 INFO:teuthology.orchestra.run.smithi101.stdout: "event": "throttled", 2023-08-01T19:55:00.214 INFO:teuthology.orchestra.run.smithi101.stdout: "time": "2023-08-01T19:54:04.459304+0000", 2023-08-01T19:55:00.214 INFO:teuthology.orchestra.run.smithi101.stdout: "duration": 0 2023-08-01T19:55:00.215 INFO:teuthology.orchestra.run.smithi101.stdout: }, 2023-08-01T19:55:00.215 INFO:teuthology.orchestra.run.smithi101.stdout: { 2023-08-01T19:55:00.215 INFO:teuthology.orchestra.run.smithi101.stdout: "event": "header_read", 2023-08-01T19:55:00.215 INFO:teuthology.orchestra.run.smithi101.stdout: "time": "2023-08-01T19:54:04.459304+0000", 2023-08-01T19:55:00.215 INFO:teuthology.orchestra.run.smithi101.stdout: "duration": 4294967295.9999995 2023-08-01T19:55:00.215 INFO:teuthology.orchestra.run.smithi101.stdout: }, 2023-08-01T19:55:00.215 INFO:teuthology.orchestra.run.smithi101.stdout: { 2023-08-01T19:55:00.215 INFO:teuthology.orchestra.run.smithi101.stdout: "event": "all_read", 2023-08-01T19:55:00.216 INFO:teuthology.orchestra.run.smithi101.stdout: "time": "2023-08-01T19:54:04.459306+0000", 2023-08-01T19:55:00.216 INFO:teuthology.orchestra.run.smithi101.stdout: "duration": 2.3889999999999999e-06 2023-08-01T19:55:00.216 INFO:teuthology.orchestra.run.smithi101.stdout: }, 2023-08-01T19:55:00.216 INFO:teuthology.orchestra.run.smithi101.stdout: { 2023-08-01T19:55:00.216 INFO:teuthology.orchestra.run.smithi101.stdout: "event": "dispatched", 2023-08-01T19:55:00.216 INFO:teuthology.orchestra.run.smithi101.stdout: "time": "2023-08-01T19:54:04.459314+0000", 2023-08-01T19:55:00.216 INFO:teuthology.orchestra.run.smithi101.stdout: "duration": 7.1180000000000003e-06 2023-08-01T19:55:00.217 INFO:teuthology.orchestra.run.smithi101.stdout: }, 2023-08-01T19:55:00.217 INFO:teuthology.orchestra.run.smithi101.stdout: { 2023-08-01T19:55:00.217 INFO:teuthology.orchestra.run.smithi101.stdout: "event": "queued_for_pg", 2023-08-01T19:55:00.217 INFO:teuthology.orchestra.run.smithi101.stdout: "time": "2023-08-01T19:54:04.459318+0000", 2023-08-01T19:55:00.217 INFO:teuthology.orchestra.run.smithi101.stdout: "duration": 4.0239999999999999e-06 2023-08-01T19:55:00.217 INFO:teuthology.orchestra.run.smithi101.stdout: }, 2023-08-01T19:55:00.217 INFO:teuthology.orchestra.run.smithi101.stdout: { 2023-08-01T19:55:00.218 INFO:teuthology.orchestra.run.smithi101.stdout: "event": "reached_pg", 2023-08-01T19:55:00.218 INFO:teuthology.orchestra.run.smithi101.stdout: "time": "2023-08-01T19:54:04.459340+0000", 2023-08-01T19:55:00.218 INFO:teuthology.orchestra.run.smithi101.stdout: "duration": 2.2476e-05 2023-08-01T19:55:00.218 INFO:teuthology.orchestra.run.smithi101.stdout: }, 2023-08-01T19:55:00.218 INFO:teuthology.orchestra.run.smithi101.stdout: { 2023-08-01T19:55:00.218 INFO:teuthology.orchestra.run.smithi101.stdout: "event": "waiting_for_map not empty", 2023-08-01T19:55:00.219 INFO:teuthology.orchestra.run.smithi101.stdout: "time": "2023-08-01T19:54:04.459342+0000", 2023-08-01T19:55:00.219 INFO:teuthology.orchestra.run.smithi101.stdout: "duration": 2.272e-06 2023-08-01T19:55:00.219 INFO:teuthology.orchestra.run.smithi101.stdout: }, 2023-08-01T19:55:00.219 INFO:teuthology.orchestra.run.smithi101.stdout: { 2023-08-01T19:55:00.219 INFO:teuthology.orchestra.run.smithi101.stdout: "event": "reached_pg", 2023-08-01T19:55:00.219 INFO:teuthology.orchestra.run.smithi101.stdout: "time": "2023-08-01T19:54:04.475922+0000", 2023-08-01T19:55:00.219 INFO:teuthology.orchestra.run.smithi101.stdout: "duration": 0.016579388 2023-08-01T19:55:00.220 INFO:teuthology.orchestra.run.smithi101.stdout: }, 2023-08-01T19:55:00.220 INFO:teuthology.orchestra.run.smithi101.stdout: { 2023-08-01T19:55:00.220 INFO:teuthology.orchestra.run.smithi101.stdout: "event": "started", 2023-08-01T19:55:00.220 INFO:teuthology.orchestra.run.smithi101.stdout: "time": "2023-08-01T19:54:04.476107+0000", 2023-08-01T19:55:00.220 INFO:teuthology.orchestra.run.smithi101.stdout: "duration": 0.00018486300000000001 2023-08-01T19:55:00.220 INFO:teuthology.orchestra.run.smithi101.stdout: }, 2023-08-01T19:55:00.220 INFO:teuthology.orchestra.run.smithi101.stdout: { 2023-08-01T19:55:00.221 INFO:teuthology.orchestra.run.smithi101.stdout: "event": "done", 2023-08-01T19:55:00.221 INFO:teuthology.orchestra.run.smithi101.stdout: "time": "2023-08-01T19:54:04.480415+0000", 2023-08-01T19:55:00.221 INFO:teuthology.orchestra.run.smithi101.stdout: "duration": 0.0043084589999999997 2023-08-01T19:55:00.221 INFO:teuthology.orchestra.run.smithi101.stdout: } 2023-08-01T19:55:00.221 INFO:teuthology.orchestra.run.smithi101.stdout: ] 2023-08-01T19:55:00.221 INFO:teuthology.orchestra.run.smithi101.stdout: } 2023-08-01T19:55:00.221 INFO:teuthology.orchestra.run.smithi101.stdout: }, 2023-08-01T19:55:00.222 INFO:teuthology.orchestra.run.smithi101.stdout: { 2023-08-01T19:55:00.222 INFO:teuthology.orchestra.run.smithi101.stdout: "description": "osd_op(client.4668.0:62896 5.f 5:f59d90d6:::benchmark_data_smithi006_114134_object62895:head [set-alloc-hint object_size 65536 write_size 65536,write 0~65536] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e29)", 2023-08-01T19:55:00.222 INFO:teuthology.orchestra.run.smithi101.stdout: "initiated_at": "2023-08-01T19:54:46.254123+0000", 2023-08-01T19:55:00.222 INFO:teuthology.orchestra.run.smithi101.stdout: "age": 13.792878192, 2023-08-01T19:55:00.222 INFO:teuthology.orchestra.run.smithi101.stdout: "duration": 0.018097106000000002, 2023-08-01T19:55:00.222 INFO:teuthology.orchestra.run.smithi101.stdout: "type_data": { 2023-08-01T19:55:00.222 INFO:teuthology.orchestra.run.smithi101.stdout: "flag_point": "commit sent; apply or cleanup", 2023-08-01T19:55:00.223 INFO:teuthology.orchestra.run.smithi101.stdout: "client_info": { 2023-08-01T19:55:00.223 INFO:teuthology.orchestra.run.smithi101.stdout: "client": "client.4668", 2023-08-01T19:55:00.223 INFO:teuthology.orchestra.run.smithi101.stdout: "client_addr": "172.21.15.6:0/1709472247", 2023-08-01T19:55:00.223 INFO:teuthology.orchestra.run.smithi101.stdout: "tid": 62896 2023-08-01T19:55:00.223 INFO:teuthology.orchestra.run.smithi101.stdout: }, 2023-08-01T19:55:00.223 INFO:teuthology.orchestra.run.smithi101.stdout: "events": [ 2023-08-01T19:55:00.223 INFO:teuthology.orchestra.run.smithi101.stdout: { 2023-08-01T19:55:00.223 INFO:teuthology.orchestra.run.smithi101.stdout: "event": "initiated", 2023-08-01T19:55:00.224 INFO:teuthology.orchestra.run.smithi101.stdout: "time": "2023-08-01T19:54:46.254123+0000", 2023-08-01T19:55:00.224 INFO:teuthology.orchestra.run.smithi101.stdout: "duration": 0 2023-08-01T19:55:00.224 INFO:teuthology.orchestra.run.smithi101.stdout: }, 2023-08-01T19:55:00.224 INFO:teuthology.orchestra.run.smithi101.stdout: { 2023-08-01T19:55:00.224 INFO:teuthology.orchestra.run.smithi101.stdout: "event": "throttled", 2023-08-01T19:55:00.224 INFO:teuthology.orchestra.run.smithi101.stdout: "time": "2023-08-01T19:54:46.254123+0000", 2023-08-01T19:55:00.224 INFO:teuthology.orchestra.run.smithi101.stdout: "duration": 0 2023-08-01T19:55:00.225 INFO:teuthology.orchestra.run.smithi101.stdout: }, 2023-08-01T19:55:00.225 INFO:teuthology.orchestra.run.smithi101.stdout: { 2023-08-01T19:55:00.225 INFO:teuthology.orchestra.run.smithi101.stdout: "event": "header_read", 2023-08-01T19:55:00.225 INFO:teuthology.orchestra.run.smithi101.stdout: "time": "2023-08-01T19:54:46.254122+0000", 2023-08-01T19:55:00.225 INFO:teuthology.orchestra.run.smithi101.stdout: "duration": 4294967295.999999 2023-08-01T19:55:00.225 INFO:teuthology.orchestra.run.smithi101.stdout: }, 2023-08-01T19:55:00.225 INFO:teuthology.orchestra.run.smithi101.stdout: { 2023-08-01T19:55:00.226 INFO:teuthology.orchestra.run.smithi101.stdout: "event": "all_read", 2023-08-01T19:55:00.226 INFO:teuthology.orchestra.run.smithi101.stdout: "time": "2023-08-01T19:54:46.254214+0000", 2023-08-01T19:55:00.226 INFO:teuthology.orchestra.run.smithi101.stdout: "duration": 9.1421000000000004e-05 2023-08-01T19:55:00.226 INFO:teuthology.orchestra.run.smithi101.stdout: }, 2023-08-01T19:55:00.226 INFO:teuthology.orchestra.run.smithi101.stdout: { 2023-08-01T19:55:00.226 INFO:teuthology.orchestra.run.smithi101.stdout: "event": "dispatched", 2023-08-01T19:55:00.226 INFO:teuthology.orchestra.run.smithi101.stdout: "time": "2023-08-01T19:54:46.254222+0000", 2023-08-01T19:55:00.226 INFO:teuthology.orchestra.run.smithi101.stdout: "duration": 8.6100000000000006e-06 2023-08-01T19:55:00.227 INFO:teuthology.orchestra.run.smithi101.stdout: }, 2023-08-01T19:55:00.227 INFO:teuthology.orchestra.run.smithi101.stdout: { 2023-08-01T19:55:00.227 INFO:teuthology.orchestra.run.smithi101.stdout: "event": "queued_for_pg", 2023-08-01T19:55:00.227 INFO:teuthology.orchestra.run.smithi101.stdout: "time": "2023-08-01T19:54:46.254228+0000", 2023-08-01T19:55:00.227 INFO:teuthology.orchestra.run.smithi101.stdout: "duration": 5.5840000000000002e-06 2023-08-01T19:55:00.227 INFO:teuthology.orchestra.run.smithi101.stdout: }, 2023-08-01T19:55:00.227 INFO:teuthology.orchestra.run.smithi101.stdout: { 2023-08-01T19:55:00.228 INFO:teuthology.orchestra.run.smithi101.stdout: "event": "reached_pg", 2023-08-01T19:55:00.228 INFO:teuthology.orchestra.run.smithi101.stdout: "time": "2023-08-01T19:54:46.254259+0000", 2023-08-01T19:55:00.228 INFO:teuthology.orchestra.run.smithi101.stdout: "duration": 3.0580999999999997e-05 2023-08-01T19:55:00.228 INFO:teuthology.orchestra.run.smithi101.stdout: }, 2023-08-01T19:55:00.228 INFO:teuthology.orchestra.run.smithi101.stdout: { 2023-08-01T19:55:00.228 INFO:teuthology.orchestra.run.smithi101.stdout: "event": "started", 2023-08-01T19:55:00.228 INFO:teuthology.orchestra.run.smithi101.stdout: "time": "2023-08-01T19:54:46.254342+0000", 2023-08-01T19:55:00.229 INFO:teuthology.orchestra.run.smithi101.stdout: "duration": 8.3183999999999995e-05 2023-08-01T19:55:00.229 INFO:teuthology.orchestra.run.smithi101.stdout: }, 2023-08-01T19:55:00.229 INFO:teuthology.orchestra.run.smithi101.stdout: { 2023-08-01T19:55:00.229 INFO:teuthology.orchestra.run.smithi101.stdout: "event": "waiting for subops from 2", 2023-08-01T19:55:00.229 INFO:teuthology.orchestra.run.smithi101.stdout: "time": "2023-08-01T19:54:46.254422+0000", 2023-08-01T19:55:00.229 INFO:teuthology.orchestra.run.smithi101.stdout: "duration": 7.9703000000000006e-05 2023-08-01T19:55:00.229 INFO:teuthology.orchestra.run.smithi101.stdout: }, 2023-08-01T19:55:00.229 INFO:teuthology.orchestra.run.smithi101.stdout: { 2023-08-01T19:55:00.230 INFO:teuthology.orchestra.run.smithi101.stdout: "event": "sub_op_commit_rec", 2023-08-01T19:55:00.230 INFO:teuthology.orchestra.run.smithi101.stdout: "time": "2023-08-01T19:54:46.259940+0000", 2023-08-01T19:55:00.230 INFO:teuthology.orchestra.run.smithi101.stdout: "duration": 0.0055188650000000004 2023-08-01T19:55:00.230 INFO:teuthology.orchestra.run.smithi101.stdout: }, 2023-08-01T19:55:00.230 INFO:teuthology.orchestra.run.smithi101.stdout: { 2023-08-01T19:55:00.230 INFO:teuthology.orchestra.run.smithi101.stdout: "event": "op_commit", 2023-08-01T19:55:00.230 INFO:teuthology.orchestra.run.smithi101.stdout: "time": "2023-08-01T19:54:46.272127+0000", 2023-08-01T19:55:00.231 INFO:teuthology.orchestra.run.smithi101.stdout: "duration": 0.012186463 2023-08-01T19:55:00.231 INFO:teuthology.orchestra.run.smithi101.stdout: }, 2023-08-01T19:55:00.231 INFO:teuthology.orchestra.run.smithi101.stdout: { 2023-08-01T19:55:00.231 INFO:teuthology.orchestra.run.smithi101.stdout: "event": "commit_sent", 2023-08-01T19:55:00.231 INFO:teuthology.orchestra.run.smithi101.stdout: "time": "2023-08-01T19:54:46.272178+0000", 2023-08-01T19:55:00.231 INFO:teuthology.orchestra.run.smithi101.stdout: "duration": 5.1332000000000003e-05 2023-08-01T19:55:00.231 INFO:teuthology.orchestra.run.smithi101.stdout: }, 2023-08-01T19:55:00.232 INFO:teuthology.orchestra.run.smithi101.stdout: { 2023-08-01T19:55:00.232 INFO:teuthology.orchestra.run.smithi101.stdout: "event": "done", 2023-08-01T19:55:00.232 INFO:teuthology.orchestra.run.smithi101.stdout: "time": "2023-08-01T19:54:46.272220+0000", 2023-08-01T19:55:00.232 INFO:teuthology.orchestra.run.smithi101.stdout: "duration": 4.2227000000000001e-05 2023-08-01T19:55:00.232 INFO:teuthology.orchestra.run.smithi101.stdout: } 2023-08-01T19:55:00.232 INFO:teuthology.orchestra.run.smithi101.stdout: ] 2023-08-01T19:55:00.233 INFO:teuthology.orchestra.run.smithi101.stdout: } 2023-08-01T19:55:00.233 INFO:teuthology.orchestra.run.smithi101.stdout: }, 2023-08-01T19:55:00.233 INFO:teuthology.orchestra.run.smithi101.stdout: { 2023-08-01T19:55:00.233 INFO:teuthology.orchestra.run.smithi101.stdout: "description": "osd_op(client.4668.0:62898 5.f 5:fa45093a:::benchmark_data_smithi006_114134_object62897:head [set-alloc-hint object_size 65536 write_size 65536,write 0~65536] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e29)", 2023-08-01T19:55:00.233 INFO:teuthology.orchestra.run.smithi101.stdout: "initiated_at": "2023-08-01T19:54:46.254356+0000", 2023-08-01T19:55:00.233 INFO:teuthology.orchestra.run.smithi101.stdout: "age": 13.792645367, 2023-08-01T19:55:00.233 INFO:teuthology.orchestra.run.smithi101.stdout: "duration": 0.017950870000000001, 2023-08-01T19:55:00.234 INFO:teuthology.orchestra.run.smithi101.stdout: "type_data": { 2023-08-01T19:55:00.234 INFO:teuthology.orchestra.run.smithi101.stdout: "flag_point": "commit sent; apply or cleanup", 2023-08-01T19:55:00.234 INFO:teuthology.orchestra.run.smithi101.stdout: "client_info": { 2023-08-01T19:55:00.234 INFO:teuthology.orchestra.run.smithi101.stdout: "client": "client.4668", 2023-08-01T19:55:00.234 INFO:teuthology.orchestra.run.smithi101.stdout: "client_addr": "172.21.15.6:0/1709472247", 2023-08-01T19:55:00.234 INFO:teuthology.orchestra.run.smithi101.stdout: "tid": 62898 2023-08-01T19:55:00.234 INFO:teuthology.orchestra.run.smithi101.stdout: }, 2023-08-01T19:55:00.234 INFO:teuthology.orchestra.run.smithi101.stdout: "events": [ 2023-08-01T19:55:00.235 INFO:teuthology.orchestra.run.smithi101.stdout: { 2023-08-01T19:55:00.235 INFO:teuthology.orchestra.run.smithi101.stdout: "event": "initiated", 2023-08-01T19:55:00.235 INFO:teuthology.orchestra.run.smithi101.stdout: "time": "2023-08-01T19:54:46.254356+0000", 2023-08-01T19:55:00.235 INFO:teuthology.orchestra.run.smithi101.stdout: "duration": 0 2023-08-01T19:55:00.235 INFO:teuthology.orchestra.run.smithi101.stdout: }, 2023-08-01T19:55:00.235 INFO:teuthology.orchestra.run.smithi101.stdout: { 2023-08-01T19:55:00.235 INFO:teuthology.orchestra.run.smithi101.stdout: "event": "throttled", 2023-08-01T19:55:00.235 INFO:teuthology.orchestra.run.smithi101.stdout: "time": "2023-08-01T19:54:46.254356+0000", 2023-08-01T19:55:00.236 INFO:teuthology.orchestra.run.smithi101.stdout: "duration": 0 2023-08-01T19:55:00.236 INFO:teuthology.orchestra.run.smithi101.stdout: }, 2023-08-01T19:55:00.236 INFO:teuthology.orchestra.run.smithi101.stdout: { 2023-08-01T19:55:00.236 INFO:teuthology.orchestra.run.smithi101.stdout: "event": "header_read", 2023-08-01T19:55:00.236 INFO:teuthology.orchestra.run.smithi101.stdout: "time": "2023-08-01T19:54:46.254355+0000", 2023-08-01T19:55:00.236 INFO:teuthology.orchestra.run.smithi101.stdout: "duration": 4294967295.9999995 2023-08-01T19:55:00.236 INFO:teuthology.orchestra.run.smithi101.stdout: }, 2023-08-01T19:55:00.237 INFO:teuthology.orchestra.run.smithi101.stdout: { 2023-08-01T19:55:00.237 INFO:teuthology.orchestra.run.smithi101.stdout: "event": "all_read", 2023-08-01T19:55:00.237 INFO:teuthology.orchestra.run.smithi101.stdout: "time": "2023-08-01T19:54:46.254415+0000", 2023-08-01T19:55:00.237 INFO:teuthology.orchestra.run.smithi101.stdout: "duration": 5.9713999999999998e-05 2023-08-01T19:55:00.237 INFO:teuthology.orchestra.run.smithi101.stdout: }, 2023-08-01T19:55:00.237 INFO:teuthology.orchestra.run.smithi101.stdout: { 2023-08-01T19:55:00.237 INFO:teuthology.orchestra.run.smithi101.stdout: "event": "dispatched", 2023-08-01T19:55:00.237 INFO:teuthology.orchestra.run.smithi101.stdout: "time": "2023-08-01T19:54:46.254423+0000", 2023-08-01T19:55:00.238 INFO:teuthology.orchestra.run.smithi101.stdout: "duration": 7.8399999999999995e-06 2023-08-01T19:55:00.238 INFO:teuthology.orchestra.run.smithi101.stdout: }, 2023-08-01T19:55:00.238 INFO:teuthology.orchestra.run.smithi101.stdout: { 2023-08-01T19:55:00.238 INFO:teuthology.orchestra.run.smithi101.stdout: "event": "queued_for_pg", 2023-08-01T19:55:00.238 INFO:teuthology.orchestra.run.smithi101.stdout: "time": "2023-08-01T19:54:46.254428+0000", 2023-08-01T19:55:00.238 INFO:teuthology.orchestra.run.smithi101.stdout: "duration": 4.5040000000000004e-06 2023-08-01T19:55:00.238 INFO:teuthology.orchestra.run.smithi101.stdout: }, 2023-08-01T19:55:00.239 INFO:teuthology.orchestra.run.smithi101.stdout: { 2023-08-01T19:55:00.239 INFO:teuthology.orchestra.run.smithi101.stdout: "event": "reached_pg", 2023-08-01T19:55:00.239 INFO:teuthology.orchestra.run.smithi101.stdout: "time": "2023-08-01T19:54:46.255926+0000", 2023-08-01T19:55:00.239 INFO:teuthology.orchestra.run.smithi101.stdout: "duration": 0.001498741 2023-08-01T19:55:00.239 INFO:teuthology.orchestra.run.smithi101.stdout: }, 2023-08-01T19:55:00.239 INFO:teuthology.orchestra.run.smithi101.stdout: { 2023-08-01T19:55:00.239 INFO:teuthology.orchestra.run.smithi101.stdout: "event": "started", 2023-08-01T19:55:00.239 INFO:teuthology.orchestra.run.smithi101.stdout: "time": "2023-08-01T19:54:46.256006+0000", 2023-08-01T19:55:00.240 INFO:teuthology.orchestra.run.smithi101.stdout: "duration": 8.0185000000000006e-05 2023-08-01T19:55:00.240 INFO:teuthology.orchestra.run.smithi101.stdout: }, 2023-08-01T19:55:00.240 INFO:teuthology.orchestra.run.smithi101.stdout: { 2023-08-01T19:55:00.240 INFO:teuthology.orchestra.run.smithi101.stdout: "event": "waiting for subops from 2", 2023-08-01T19:55:00.240 INFO:teuthology.orchestra.run.smithi101.stdout: "time": "2023-08-01T19:54:46.256158+0000", 2023-08-01T19:55:00.240 INFO:teuthology.orchestra.run.smithi101.stdout: "duration": 0.00015124 2023-08-01T19:55:00.240 INFO:teuthology.orchestra.run.smithi101.stdout: }, 2023-08-01T19:55:00.241 INFO:teuthology.orchestra.run.smithi101.stdout: { 2023-08-01T19:55:00.241 INFO:teuthology.orchestra.run.smithi101.stdout: "event": "sub_op_commit_rec", 2023-08-01T19:55:00.241 INFO:teuthology.orchestra.run.smithi101.stdout: "time": "2023-08-01T19:54:46.260449+0000", 2023-08-01T19:55:00.241 INFO:teuthology.orchestra.run.smithi101.stdout: "duration": 0.0042917179999999999 2023-08-01T19:55:00.241 INFO:teuthology.orchestra.run.smithi101.stdout: }, 2023-08-01T19:55:00.241 INFO:teuthology.orchestra.run.smithi101.stdout: { 2023-08-01T19:55:00.241 INFO:teuthology.orchestra.run.smithi101.stdout: "event": "op_commit", 2023-08-01T19:55:00.241 INFO:teuthology.orchestra.run.smithi101.stdout: "time": "2023-08-01T19:54:46.272229+0000", 2023-08-01T19:55:00.242 INFO:teuthology.orchestra.run.smithi101.stdout: "duration": 0.011779243999999999 2023-08-01T19:55:00.242 INFO:teuthology.orchestra.run.smithi101.stdout: }, 2023-08-01T19:55:00.242 INFO:teuthology.orchestra.run.smithi101.stdout: { 2023-08-01T19:55:00.242 INFO:teuthology.orchestra.run.smithi101.stdout: "event": "commit_sent", 2023-08-01T19:55:00.242 INFO:teuthology.orchestra.run.smithi101.stdout: "time": "2023-08-01T19:54:46.272270+0000", 2023-08-01T19:55:00.242 INFO:teuthology.orchestra.run.smithi101.stdout: "duration": 4.1516e-05 2023-08-01T19:55:00.242 INFO:teuthology.orchestra.run.smithi101.stdout: }, 2023-08-01T19:55:00.243 INFO:teuthology.orchestra.run.smithi101.stdout: { 2023-08-01T19:55:00.243 INFO:teuthology.orchestra.run.smithi101.stdout: "event": "done", 2023-08-01T19:55:00.243 INFO:teuthology.orchestra.run.smithi101.stdout: "time": "2023-08-01T19:54:46.272307+0000", 2023-08-01T19:55:00.243 INFO:teuthology.orchestra.run.smithi101.stdout: "duration": 3.6813000000000001e-05 2023-08-01T19:55:00.243 INFO:teuthology.orchestra.run.smithi101.stdout: } 2023-08-01T19:55:00.243 INFO:teuthology.orchestra.run.smithi101.stdout: ] 2023-08-01T19:55:00.243 INFO:teuthology.orchestra.run.smithi101.stdout: } 2023-08-01T19:55:00.244 INFO:teuthology.orchestra.run.smithi101.stdout: }, 2023-08-01T19:55:00.244 INFO:teuthology.orchestra.run.smithi101.stdout: { 2023-08-01T19:55:00.244 INFO:teuthology.orchestra.run.smithi101.stdout: "description": "osd_op(client.4668.0:70878 5.2 5:49b7d2be:::benchmark_data_smithi006_114134_object70877:head [set-alloc-hint object_size 65536 write_size 65536,write 0~65536] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e30)", 2023-08-01T19:55:00.244 INFO:teuthology.orchestra.run.smithi101.stdout: "initiated_at": "2023-08-01T19:54:50.210223+0000", 2023-08-01T19:55:00.244 INFO:teuthology.orchestra.run.smithi101.stdout: "age": 9.8367785160000007, 2023-08-01T19:55:00.244 INFO:teuthology.orchestra.run.smithi101.stdout: "duration": 0.019884895, 2023-08-01T19:55:00.244 INFO:teuthology.orchestra.run.smithi101.stdout: "type_data": { 2023-08-01T19:55:00.244 INFO:teuthology.orchestra.run.smithi101.stdout: "flag_point": "commit sent; apply or cleanup", 2023-08-01T19:55:00.245 INFO:teuthology.orchestra.run.smithi101.stdout: "client_info": { 2023-08-01T19:55:00.245 INFO:teuthology.orchestra.run.smithi101.stdout: "client": "client.4668", 2023-08-01T19:55:00.245 INFO:teuthology.orchestra.run.smithi101.stdout: "client_addr": "172.21.15.6:0/1709472247", 2023-08-01T19:55:00.245 INFO:teuthology.orchestra.run.smithi101.stdout: "tid": 70878 2023-08-01T19:55:00.245 INFO:teuthology.orchestra.run.smithi101.stdout: }, 2023-08-01T19:55:00.245 INFO:teuthology.orchestra.run.smithi101.stdout: "events": [ 2023-08-01T19:55:00.245 INFO:teuthology.orchestra.run.smithi101.stdout: { 2023-08-01T19:55:00.246 INFO:teuthology.orchestra.run.smithi101.stdout: "event": "initiated", 2023-08-01T19:55:00.246 INFO:teuthology.orchestra.run.smithi101.stdout: "time": "2023-08-01T19:54:50.210223+0000", 2023-08-01T19:55:00.246 INFO:teuthology.orchestra.run.smithi101.stdout: "duration": 0 2023-08-01T19:55:00.246 INFO:teuthology.orchestra.run.smithi101.stdout: }, 2023-08-01T19:55:00.246 INFO:teuthology.orchestra.run.smithi101.stdout: { 2023-08-01T19:55:00.246 INFO:teuthology.orchestra.run.smithi101.stdout: "event": "throttled", 2023-08-01T19:55:00.246 INFO:teuthology.orchestra.run.smithi101.stdout: "time": "2023-08-01T19:54:50.210223+0000", 2023-08-01T19:55:00.246 INFO:teuthology.orchestra.run.smithi101.stdout: "duration": 0 2023-08-01T19:55:00.247 INFO:teuthology.orchestra.run.smithi101.stdout: }, 2023-08-01T19:55:00.247 INFO:teuthology.orchestra.run.smithi101.stdout: { 2023-08-01T19:55:00.247 INFO:teuthology.orchestra.run.smithi101.stdout: "event": "header_read", 2023-08-01T19:55:00.247 INFO:teuthology.orchestra.run.smithi101.stdout: "time": "2023-08-01T19:54:50.210222+0000", 2023-08-01T19:55:00.247 INFO:teuthology.orchestra.run.smithi101.stdout: "duration": 4294967295.999999 2023-08-01T19:55:00.247 INFO:teuthology.orchestra.run.smithi101.stdout: }, 2023-08-01T19:55:00.247 INFO:teuthology.orchestra.run.smithi101.stdout: { 2023-08-01T19:55:00.247 INFO:teuthology.orchestra.run.smithi101.stdout: "event": "all_read", 2023-08-01T19:55:00.248 INFO:teuthology.orchestra.run.smithi101.stdout: "time": "2023-08-01T19:54:50.210315+0000", 2023-08-01T19:55:00.248 INFO:teuthology.orchestra.run.smithi101.stdout: "duration": 9.2567999999999999e-05 2023-08-01T19:55:00.248 INFO:teuthology.orchestra.run.smithi101.stdout: }, 2023-08-01T19:55:00.248 INFO:teuthology.orchestra.run.smithi101.stdout: { 2023-08-01T19:55:00.248 INFO:teuthology.orchestra.run.smithi101.stdout: "event": "dispatched", 2023-08-01T19:55:00.248 INFO:teuthology.orchestra.run.smithi101.stdout: "time": "2023-08-01T19:54:50.210326+0000", 2023-08-01T19:55:00.248 INFO:teuthology.orchestra.run.smithi101.stdout: "duration": 1.1430000000000001e-05 2023-08-01T19:55:00.249 INFO:teuthology.orchestra.run.smithi101.stdout: }, 2023-08-01T19:55:00.249 INFO:teuthology.orchestra.run.smithi101.stdout: { 2023-08-01T19:55:00.249 INFO:teuthology.orchestra.run.smithi101.stdout: "event": "queued_for_pg", 2023-08-01T19:55:00.249 INFO:teuthology.orchestra.run.smithi101.stdout: "time": "2023-08-01T19:54:50.210332+0000", 2023-08-01T19:55:00.249 INFO:teuthology.orchestra.run.smithi101.stdout: "duration": 5.8479999999999997e-06 2023-08-01T19:55:00.249 INFO:teuthology.orchestra.run.smithi101.stdout: }, 2023-08-01T19:55:00.250 INFO:teuthology.orchestra.run.smithi101.stdout: { 2023-08-01T19:55:00.250 INFO:teuthology.orchestra.run.smithi101.stdout: "event": "reached_pg", 2023-08-01T19:55:00.250 INFO:teuthology.orchestra.run.smithi101.stdout: "time": "2023-08-01T19:54:50.214259+0000", 2023-08-01T19:55:00.250 INFO:teuthology.orchestra.run.smithi101.stdout: "duration": 0.003926789 2023-08-01T19:55:00.250 INFO:teuthology.orchestra.run.smithi101.stdout: }, 2023-08-01T19:55:00.250 INFO:teuthology.orchestra.run.smithi101.stdout: { 2023-08-01T19:55:00.250 INFO:teuthology.orchestra.run.smithi101.stdout: "event": "started", 2023-08-01T19:55:00.251 INFO:teuthology.orchestra.run.smithi101.stdout: "time": "2023-08-01T19:54:50.214387+0000", 2023-08-01T19:55:00.251 INFO:teuthology.orchestra.run.smithi101.stdout: "duration": 0.00012787599999999999 2023-08-01T19:55:00.251 INFO:teuthology.orchestra.run.smithi101.stdout: }, 2023-08-01T19:55:00.251 INFO:teuthology.orchestra.run.smithi101.stdout: { 2023-08-01T19:55:00.251 INFO:teuthology.orchestra.run.smithi101.stdout: "event": "waiting for subops from 0", 2023-08-01T19:55:00.251 INFO:teuthology.orchestra.run.smithi101.stdout: "time": "2023-08-01T19:54:50.214536+0000", 2023-08-01T19:55:00.251 INFO:teuthology.orchestra.run.smithi101.stdout: "duration": 0.00014935299999999999 2023-08-01T19:55:00.251 INFO:teuthology.orchestra.run.smithi101.stdout: }, 2023-08-01T19:55:00.252 INFO:teuthology.orchestra.run.smithi101.stdout: { 2023-08-01T19:55:00.252 INFO:teuthology.orchestra.run.smithi101.stdout: "event": "op_commit", 2023-08-01T19:55:00.252 INFO:teuthology.orchestra.run.smithi101.stdout: "time": "2023-08-01T19:54:50.217739+0000", 2023-08-01T19:55:00.252 INFO:teuthology.orchestra.run.smithi101.stdout: "duration": 0.0032034619999999998 2023-08-01T19:55:00.252 INFO:teuthology.orchestra.run.smithi101.stdout: }, 2023-08-01T19:55:00.252 INFO:teuthology.orchestra.run.smithi101.stdout: { 2023-08-01T19:55:00.252 INFO:teuthology.orchestra.run.smithi101.stdout: "event": "sub_op_commit_rec", 2023-08-01T19:55:00.253 INFO:teuthology.orchestra.run.smithi101.stdout: "time": "2023-08-01T19:54:50.230032+0000", 2023-08-01T19:55:00.253 INFO:teuthology.orchestra.run.smithi101.stdout: "duration": 0.012293068000000001 2023-08-01T19:55:00.253 INFO:teuthology.orchestra.run.smithi101.stdout: }, 2023-08-01T19:55:00.253 INFO:teuthology.orchestra.run.smithi101.stdout: { 2023-08-01T19:55:00.253 INFO:teuthology.orchestra.run.smithi101.stdout: "event": "commit_sent", 2023-08-01T19:55:00.253 INFO:teuthology.orchestra.run.smithi101.stdout: "time": "2023-08-01T19:54:50.230075+0000", 2023-08-01T19:55:00.253 INFO:teuthology.orchestra.run.smithi101.stdout: "duration": 4.3062999999999997e-05 2023-08-01T19:55:00.253 INFO:teuthology.orchestra.run.smithi101.stdout: }, 2023-08-01T19:55:00.254 INFO:teuthology.orchestra.run.smithi101.stdout: { 2023-08-01T19:55:00.254 INFO:teuthology.orchestra.run.smithi101.stdout: "event": "done", 2023-08-01T19:55:00.254 INFO:teuthology.orchestra.run.smithi101.stdout: "time": "2023-08-01T19:54:50.230108+0000", 2023-08-01T19:55:00.254 INFO:teuthology.orchestra.run.smithi101.stdout: "duration": 3.2366999999999997e-05 2023-08-01T19:55:00.254 INFO:teuthology.orchestra.run.smithi101.stdout: } 2023-08-01T19:55:00.254 INFO:teuthology.orchestra.run.smithi101.stdout: ] 2023-08-01T19:55:00.254 INFO:teuthology.orchestra.run.smithi101.stdout: } 2023-08-01T19:55:00.255 INFO:teuthology.orchestra.run.smithi101.stdout: }, 2023-08-01T19:55:00.255 INFO:teuthology.orchestra.run.smithi101.stdout: { 2023-08-01T19:55:00.255 INFO:teuthology.orchestra.run.smithi101.stdout: "description": "osd_op(client.4668.0:73460 5.f 5:ff4f0704:::benchmark_data_smithi006_114134_object73459:head [set-alloc-hint object_size 65536 write_size 65536,write 0~65536] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e31)", 2023-08-01T19:55:00.255 INFO:teuthology.orchestra.run.smithi101.stdout: "initiated_at": "2023-08-01T19:54:51.462968+0000", 2023-08-01T19:55:00.255 INFO:teuthology.orchestra.run.smithi101.stdout: "age": 8.5840336369999992, 2023-08-01T19:55:00.255 INFO:teuthology.orchestra.run.smithi101.stdout: "duration": 0.020056502, 2023-08-01T19:55:00.255 INFO:teuthology.orchestra.run.smithi101.stdout: "type_data": { 2023-08-01T19:55:00.255 INFO:teuthology.orchestra.run.smithi101.stdout: "flag_point": "commit sent; apply or cleanup", 2023-08-01T19:55:00.256 INFO:teuthology.orchestra.run.smithi101.stdout: "client_info": { 2023-08-01T19:55:00.256 INFO:teuthology.orchestra.run.smithi101.stdout: "client": "client.4668", 2023-08-01T19:55:00.256 INFO:teuthology.orchestra.run.smithi101.stdout: "client_addr": "172.21.15.6:0/1709472247", 2023-08-01T19:55:00.256 INFO:teuthology.orchestra.run.smithi101.stdout: "tid": 73460 2023-08-01T19:55:00.256 INFO:teuthology.orchestra.run.smithi101.stdout: }, 2023-08-01T19:55:00.256 INFO:teuthology.orchestra.run.smithi101.stdout: "events": [ 2023-08-01T19:55:00.256 INFO:teuthology.orchestra.run.smithi101.stdout: { 2023-08-01T19:55:00.257 INFO:teuthology.orchestra.run.smithi101.stdout: "event": "initiated", 2023-08-01T19:55:00.257 INFO:teuthology.orchestra.run.smithi101.stdout: "time": "2023-08-01T19:54:51.462968+0000", 2023-08-01T19:55:00.257 INFO:teuthology.orchestra.run.smithi101.stdout: "duration": 0 2023-08-01T19:55:00.257 INFO:teuthology.orchestra.run.smithi101.stdout: }, 2023-08-01T19:55:00.257 INFO:teuthology.orchestra.run.smithi101.stdout: { 2023-08-01T19:55:00.257 INFO:teuthology.orchestra.run.smithi101.stdout: "event": "throttled", 2023-08-01T19:55:00.257 INFO:teuthology.orchestra.run.smithi101.stdout: "time": "2023-08-01T19:54:51.462968+0000", 2023-08-01T19:55:00.257 INFO:teuthology.orchestra.run.smithi101.stdout: "duration": 0 2023-08-01T19:55:00.258 INFO:teuthology.orchestra.run.smithi101.stdout: }, 2023-08-01T19:55:00.258 INFO:teuthology.orchestra.run.smithi101.stdout: { 2023-08-01T19:55:00.258 INFO:teuthology.orchestra.run.smithi101.stdout: "event": "header_read", 2023-08-01T19:55:00.258 INFO:teuthology.orchestra.run.smithi101.stdout: "time": "2023-08-01T19:54:51.462967+0000", 2023-08-01T19:55:00.258 INFO:teuthology.orchestra.run.smithi101.stdout: "duration": 4294967295.999999 2023-08-01T19:55:00.258 INFO:teuthology.orchestra.run.smithi101.stdout: }, 2023-08-01T19:55:00.258 INFO:teuthology.orchestra.run.smithi101.stdout: { 2023-08-01T19:55:00.259 INFO:teuthology.orchestra.run.smithi101.stdout: "event": "all_read", 2023-08-01T19:55:00.259 INFO:teuthology.orchestra.run.smithi101.stdout: "time": "2023-08-01T19:54:51.463009+0000", 2023-08-01T19:55:00.259 INFO:teuthology.orchestra.run.smithi101.stdout: "duration": 4.2106e-05 2023-08-01T19:55:00.259 INFO:teuthology.orchestra.run.smithi101.stdout: }, 2023-08-01T19:55:00.259 INFO:teuthology.orchestra.run.smithi101.stdout: { 2023-08-01T19:55:00.259 INFO:teuthology.orchestra.run.smithi101.stdout: "event": "dispatched", 2023-08-01T19:55:00.259 INFO:teuthology.orchestra.run.smithi101.stdout: "time": "2023-08-01T19:54:51.463017+0000", 2023-08-01T19:55:00.259 INFO:teuthology.orchestra.run.smithi101.stdout: "duration": 8.1529999999999997e-06 2023-08-01T19:55:00.260 INFO:teuthology.orchestra.run.smithi101.stdout: }, 2023-08-01T19:55:00.260 INFO:teuthology.orchestra.run.smithi101.stdout: { 2023-08-01T19:55:00.260 INFO:teuthology.orchestra.run.smithi101.stdout: "event": "queued_for_pg", 2023-08-01T19:55:00.260 INFO:teuthology.orchestra.run.smithi101.stdout: "time": "2023-08-01T19:54:51.463027+0000", 2023-08-01T19:55:00.260 INFO:teuthology.orchestra.run.smithi101.stdout: "duration": 9.5659999999999996e-06 2023-08-01T19:55:00.260 INFO:teuthology.orchestra.run.smithi101.stdout: }, 2023-08-01T19:55:00.260 INFO:teuthology.orchestra.run.smithi101.stdout: { 2023-08-01T19:55:00.261 INFO:teuthology.orchestra.run.smithi101.stdout: "event": "reached_pg", 2023-08-01T19:55:00.261 INFO:teuthology.orchestra.run.smithi101.stdout: "time": "2023-08-01T19:54:51.463062+0000", 2023-08-01T19:55:00.261 INFO:teuthology.orchestra.run.smithi101.stdout: "duration": 3.5442999999999999e-05 2023-08-01T19:55:00.261 INFO:teuthology.orchestra.run.smithi101.stdout: }, 2023-08-01T19:55:00.261 INFO:teuthology.orchestra.run.smithi101.stdout: { 2023-08-01T19:55:00.261 INFO:teuthology.orchestra.run.smithi101.stdout: "event": "started", 2023-08-01T19:55:00.261 INFO:teuthology.orchestra.run.smithi101.stdout: "time": "2023-08-01T19:54:51.463198+0000", 2023-08-01T19:55:00.261 INFO:teuthology.orchestra.run.smithi101.stdout: "duration": 0.000135628 2023-08-01T19:55:00.262 INFO:teuthology.orchestra.run.smithi101.stdout: }, 2023-08-01T19:55:00.262 INFO:teuthology.orchestra.run.smithi101.stdout: { 2023-08-01T19:55:00.262 INFO:teuthology.orchestra.run.smithi101.stdout: "event": "waiting for subops from 2", 2023-08-01T19:55:00.262 INFO:teuthology.orchestra.run.smithi101.stdout: "time": "2023-08-01T19:54:51.463341+0000", 2023-08-01T19:55:00.262 INFO:teuthology.orchestra.run.smithi101.stdout: "duration": 0.00014346500000000001 2023-08-01T19:55:00.262 INFO:teuthology.orchestra.run.smithi101.stdout: }, 2023-08-01T19:55:00.262 INFO:teuthology.orchestra.run.smithi101.stdout: { 2023-08-01T19:55:00.262 INFO:teuthology.orchestra.run.smithi101.stdout: "event": "op_commit", 2023-08-01T19:55:00.263 INFO:teuthology.orchestra.run.smithi101.stdout: "time": "2023-08-01T19:54:51.472684+0000", 2023-08-01T19:55:00.263 INFO:teuthology.orchestra.run.smithi101.stdout: "duration": 0.0093427900000000001 2023-08-01T19:55:00.263 INFO:teuthology.orchestra.run.smithi101.stdout: }, 2023-08-01T19:55:00.263 INFO:teuthology.orchestra.run.smithi101.stdout: { 2023-08-01T19:55:00.263 INFO:teuthology.orchestra.run.smithi101.stdout: "event": "sub_op_commit_rec", 2023-08-01T19:55:00.263 INFO:teuthology.orchestra.run.smithi101.stdout: "time": "2023-08-01T19:54:51.482937+0000", 2023-08-01T19:55:00.263 INFO:teuthology.orchestra.run.smithi101.stdout: "duration": 0.010252557000000001 2023-08-01T19:55:00.264 INFO:teuthology.orchestra.run.smithi101.stdout: }, 2023-08-01T19:55:00.264 INFO:teuthology.orchestra.run.smithi101.stdout: { 2023-08-01T19:55:00.264 INFO:teuthology.orchestra.run.smithi101.stdout: "event": "commit_sent", 2023-08-01T19:55:00.264 INFO:teuthology.orchestra.run.smithi101.stdout: "time": "2023-08-01T19:54:51.482984+0000", 2023-08-01T19:55:00.264 INFO:teuthology.orchestra.run.smithi101.stdout: "duration": 4.7394000000000001e-05 2023-08-01T19:55:00.264 INFO:teuthology.orchestra.run.smithi101.stdout: }, 2023-08-01T19:55:00.264 INFO:teuthology.orchestra.run.smithi101.stdout: { 2023-08-01T19:55:00.264 INFO:teuthology.orchestra.run.smithi101.stdout: "event": "done", 2023-08-01T19:55:00.265 INFO:teuthology.orchestra.run.smithi101.stdout: "time": "2023-08-01T19:54:51.483024+0000", 2023-08-01T19:55:00.265 INFO:teuthology.orchestra.run.smithi101.stdout: "duration": 4.0159e-05 2023-08-01T19:55:00.265 INFO:teuthology.orchestra.run.smithi101.stdout: } 2023-08-01T19:55:00.265 INFO:teuthology.orchestra.run.smithi101.stdout: ] 2023-08-01T19:55:00.265 INFO:teuthology.orchestra.run.smithi101.stdout: } 2023-08-01T19:55:00.265 INFO:teuthology.orchestra.run.smithi101.stdout: }, 2023-08-01T19:55:00.265 INFO:teuthology.orchestra.run.smithi101.stdout: { 2023-08-01T19:55:00.266 INFO:teuthology.orchestra.run.smithi101.stdout: "description": "osd_op(client.4668.0:73464 5.f 5:f261eb35:::benchmark_data_smithi006_114134_object73463:head [set-alloc-hint object_size 65536 write_size 65536,write 0~65536] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e31)", 2023-08-01T19:55:00.266 INFO:teuthology.orchestra.run.smithi101.stdout: "initiated_at": "2023-08-01T19:54:51.465789+0000", 2023-08-01T19:55:00.266 INFO:teuthology.orchestra.run.smithi101.stdout: "age": 8.5812121040000005, 2023-08-01T19:55:00.266 INFO:teuthology.orchestra.run.smithi101.stdout: "duration": 0.017372190999999999, 2023-08-01T19:55:00.266 INFO:teuthology.orchestra.run.smithi101.stdout: "type_data": { 2023-08-01T19:55:00.266 INFO:teuthology.orchestra.run.smithi101.stdout: "flag_point": "commit sent; apply or cleanup", 2023-08-01T19:55:00.266 INFO:teuthology.orchestra.run.smithi101.stdout: "client_info": { 2023-08-01T19:55:00.266 INFO:teuthology.orchestra.run.smithi101.stdout: "client": "client.4668", 2023-08-01T19:55:00.267 INFO:teuthology.orchestra.run.smithi101.stdout: "client_addr": "172.21.15.6:0/1709472247", 2023-08-01T19:55:00.267 INFO:teuthology.orchestra.run.smithi101.stdout: "tid": 73464 2023-08-01T19:55:00.267 INFO:teuthology.orchestra.run.smithi101.stdout: }, 2023-08-01T19:55:00.267 INFO:teuthology.orchestra.run.smithi101.stdout: "events": [ 2023-08-01T19:55:00.267 INFO:teuthology.orchestra.run.smithi101.stdout: { 2023-08-01T19:55:00.267 INFO:teuthology.orchestra.run.smithi101.stdout: "event": "initiated", 2023-08-01T19:55:00.267 INFO:teuthology.orchestra.run.smithi101.stdout: "time": "2023-08-01T19:54:51.465789+0000", 2023-08-01T19:55:00.267 INFO:teuthology.orchestra.run.smithi101.stdout: "duration": 0 2023-08-01T19:55:00.268 INFO:teuthology.orchestra.run.smithi101.stdout: }, 2023-08-01T19:55:00.268 INFO:teuthology.orchestra.run.smithi101.stdout: { 2023-08-01T19:55:00.268 INFO:teuthology.orchestra.run.smithi101.stdout: "event": "throttled", 2023-08-01T19:55:00.268 INFO:teuthology.orchestra.run.smithi101.stdout: "time": "2023-08-01T19:54:51.465789+0000", 2023-08-01T19:55:00.268 INFO:teuthology.orchestra.run.smithi101.stdout: "duration": 0 2023-08-01T19:55:00.268 INFO:teuthology.orchestra.run.smithi101.stdout: }, 2023-08-01T19:55:00.268 INFO:teuthology.orchestra.run.smithi101.stdout: { 2023-08-01T19:55:00.269 INFO:teuthology.orchestra.run.smithi101.stdout: "event": "header_read", 2023-08-01T19:55:00.269 INFO:teuthology.orchestra.run.smithi101.stdout: "time": "2023-08-01T19:54:51.465789+0000", 2023-08-01T19:55:00.269 INFO:teuthology.orchestra.run.smithi101.stdout: "duration": 4294967295.999999 2023-08-01T19:55:00.269 INFO:teuthology.orchestra.run.smithi101.stdout: }, 2023-08-01T19:55:00.269 INFO:teuthology.orchestra.run.smithi101.stdout: { 2023-08-01T19:55:00.269 INFO:teuthology.orchestra.run.smithi101.stdout: "event": "all_read", 2023-08-01T19:55:00.269 INFO:teuthology.orchestra.run.smithi101.stdout: "time": "2023-08-01T19:54:51.465950+0000", 2023-08-01T19:55:00.269 INFO:teuthology.orchestra.run.smithi101.stdout: "duration": 0.00016093600000000001 2023-08-01T19:55:00.270 INFO:teuthology.orchestra.run.smithi101.stdout: }, 2023-08-01T19:55:00.270 INFO:teuthology.orchestra.run.smithi101.stdout: { 2023-08-01T19:55:00.270 INFO:teuthology.orchestra.run.smithi101.stdout: "event": "dispatched", 2023-08-01T19:55:00.270 INFO:teuthology.orchestra.run.smithi101.stdout: "time": "2023-08-01T19:54:51.465960+0000", 2023-08-01T19:55:00.270 INFO:teuthology.orchestra.run.smithi101.stdout: "duration": 1.0025e-05 2023-08-01T19:55:00.270 INFO:teuthology.orchestra.run.smithi101.stdout: }, 2023-08-01T19:55:00.270 INFO:teuthology.orchestra.run.smithi101.stdout: { 2023-08-01T19:55:00.271 INFO:teuthology.orchestra.run.smithi101.stdout: "event": "queued_for_pg", 2023-08-01T19:55:00.271 INFO:teuthology.orchestra.run.smithi101.stdout: "time": "2023-08-01T19:54:51.465965+0000", 2023-08-01T19:55:00.271 INFO:teuthology.orchestra.run.smithi101.stdout: "duration": 4.989e-06 2023-08-01T19:55:00.271 INFO:teuthology.orchestra.run.smithi101.stdout: }, 2023-08-01T19:55:00.271 INFO:teuthology.orchestra.run.smithi101.stdout: { 2023-08-01T19:55:00.271 INFO:teuthology.orchestra.run.smithi101.stdout: "event": "reached_pg", 2023-08-01T19:55:00.271 INFO:teuthology.orchestra.run.smithi101.stdout: "time": "2023-08-01T19:54:51.466002+0000", 2023-08-01T19:55:00.271 INFO:teuthology.orchestra.run.smithi101.stdout: "duration": 3.7895000000000002e-05 2023-08-01T19:55:00.272 INFO:teuthology.orchestra.run.smithi101.stdout: }, 2023-08-01T19:55:00.272 INFO:teuthology.orchestra.run.smithi101.stdout: { 2023-08-01T19:55:00.272 INFO:teuthology.orchestra.run.smithi101.stdout: "event": "started", 2023-08-01T19:55:00.272 INFO:teuthology.orchestra.run.smithi101.stdout: "time": "2023-08-01T19:54:51.466132+0000", 2023-08-01T19:55:00.272 INFO:teuthology.orchestra.run.smithi101.stdout: "duration": 0.000129882 2023-08-01T19:55:00.272 INFO:teuthology.orchestra.run.smithi101.stdout: }, 2023-08-01T19:55:00.272 INFO:teuthology.orchestra.run.smithi101.stdout: { 2023-08-01T19:55:00.272 INFO:teuthology.orchestra.run.smithi101.stdout: "event": "waiting for subops from 2", 2023-08-01T19:55:00.273 INFO:teuthology.orchestra.run.smithi101.stdout: "time": "2023-08-01T19:54:51.466289+0000", 2023-08-01T19:55:00.273 INFO:teuthology.orchestra.run.smithi101.stdout: "duration": 0.00015683599999999999 2023-08-01T19:55:00.273 INFO:teuthology.orchestra.run.smithi101.stdout: }, 2023-08-01T19:55:00.273 INFO:teuthology.orchestra.run.smithi101.stdout: { 2023-08-01T19:55:00.273 INFO:teuthology.orchestra.run.smithi101.stdout: "event": "op_commit", 2023-08-01T19:55:00.273 INFO:teuthology.orchestra.run.smithi101.stdout: "time": "2023-08-01T19:54:51.472691+0000", 2023-08-01T19:55:00.273 INFO:teuthology.orchestra.run.smithi101.stdout: "duration": 0.0064019159999999997 2023-08-01T19:55:00.274 INFO:teuthology.orchestra.run.smithi101.stdout: }, 2023-08-01T19:55:00.274 INFO:teuthology.orchestra.run.smithi101.stdout: { 2023-08-01T19:55:00.274 INFO:teuthology.orchestra.run.smithi101.stdout: "event": "sub_op_commit_rec", 2023-08-01T19:55:00.274 INFO:teuthology.orchestra.run.smithi101.stdout: "time": "2023-08-01T19:54:51.483071+0000", 2023-08-01T19:55:00.274 INFO:teuthology.orchestra.run.smithi101.stdout: "duration": 0.010380265 2023-08-01T19:55:00.274 INFO:teuthology.orchestra.run.smithi101.stdout: }, 2023-08-01T19:55:00.274 INFO:teuthology.orchestra.run.smithi101.stdout: { 2023-08-01T19:55:00.275 INFO:teuthology.orchestra.run.smithi101.stdout: "event": "commit_sent", 2023-08-01T19:55:00.275 INFO:teuthology.orchestra.run.smithi101.stdout: "time": "2023-08-01T19:54:51.483122+0000", 2023-08-01T19:55:00.275 INFO:teuthology.orchestra.run.smithi101.stdout: "duration": 5.1063999999999998e-05 2023-08-01T19:55:00.275 INFO:teuthology.orchestra.run.smithi101.stdout: }, 2023-08-01T19:55:00.275 INFO:teuthology.orchestra.run.smithi101.stdout: { 2023-08-01T19:55:00.275 INFO:teuthology.orchestra.run.smithi101.stdout: "event": "done", 2023-08-01T19:55:00.275 INFO:teuthology.orchestra.run.smithi101.stdout: "time": "2023-08-01T19:54:51.483162+0000", 2023-08-01T19:55:00.276 INFO:teuthology.orchestra.run.smithi101.stdout: "duration": 3.9156999999999998e-05 2023-08-01T19:55:00.276 INFO:teuthology.orchestra.run.smithi101.stdout: } 2023-08-01T19:55:00.276 INFO:teuthology.orchestra.run.smithi101.stdout: ] 2023-08-01T19:55:00.276 INFO:teuthology.orchestra.run.smithi101.stdout: } 2023-08-01T19:55:00.276 INFO:teuthology.orchestra.run.smithi101.stdout: } 2023-08-01T19:55:00.276 INFO:teuthology.orchestra.run.smithi101.stdout: ] 2023-08-01T19:55:00.276 INFO:teuthology.orchestra.run.smithi101.stdout:} 2023-08-01T19:55:00.277 DEBUG:teuthology.orchestra.run.smithi006:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 120 ceph --cluster ceph osd set nodeep-scrub 2023-08-01T19:55:00.278 INFO:tasks.ceph.osd.2.smithi155.stderr:2023-08-01T19:55:00.276+0000 7faa5c6ac700 -1 received signal: Hangup from /usr/bin/python3 /bin/daemon-helper kill ceph-osd -f --cluster ceph -i 2 (PID: 111337) UID: 0 2023-08-01T19:55:00.279 DEBUG:teuthology.orchestra.run.smithi155:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 30 ceph --cluster ceph --admin-daemon /var/run/ceph/ceph-osd.2.asok dump_ops_in_flight 2023-08-01T19:55:00.315 INFO:tasks.radosbench.radosbench.0.smithi006.stdout: 36 16 90846 90830 157.678 126.75 0.00592522 0.00633903 2023-08-01T19:55:00.378 INFO:tasks.ceph.osd.0.smithi008.stderr:2023-08-01T19:55:00.378+0000 7f16a58f4700 -1 received signal: Hangup from /usr/bin/python3 /bin/daemon-helper kill ceph-osd -f --cluster ceph -i 0 (PID: 111179) UID: 0 2023-08-01T19:55:00.448 INFO:teuthology.orchestra.run.smithi155.stdout:{ 2023-08-01T19:55:00.448 INFO:teuthology.orchestra.run.smithi155.stdout: "ops": [ 2023-08-01T19:55:00.449 INFO:teuthology.orchestra.run.smithi155.stdout: { 2023-08-01T19:55:00.449 INFO:teuthology.orchestra.run.smithi155.stdout: "description": "osd_op(client.4668.0:91100 5.d 5:bb05929e:::benchmark_data_smithi006_114134_object91099:head [set-alloc-hint object_size 65536 write_size 65536,write 0~65536 in=65536b] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e35)", 2023-08-01T19:55:00.449 INFO:teuthology.orchestra.run.smithi155.stdout: "initiated_at": "2023-08-01T19:55:00.439932+0000", 2023-08-01T19:55:00.449 INFO:teuthology.orchestra.run.smithi155.stdout: "age": 0.0067609130000000003, 2023-08-01T19:55:00.449 INFO:teuthology.orchestra.run.smithi155.stdout: "duration": 0.0067819239999999999, 2023-08-01T19:55:00.449 INFO:teuthology.orchestra.run.smithi155.stdout: "type_data": { 2023-08-01T19:55:00.449 INFO:teuthology.orchestra.run.smithi155.stdout: "flag_point": "waiting for sub ops", 2023-08-01T19:55:00.450 INFO:teuthology.orchestra.run.smithi155.stdout: "client_info": { 2023-08-01T19:55:00.450 INFO:teuthology.orchestra.run.smithi155.stdout: "client": "client.4668", 2023-08-01T19:55:00.450 INFO:teuthology.orchestra.run.smithi155.stdout: "client_addr": "172.21.15.6:0/1709472247", 2023-08-01T19:55:00.450 INFO:teuthology.orchestra.run.smithi155.stdout: "tid": 91100 2023-08-01T19:55:00.450 INFO:teuthology.orchestra.run.smithi155.stdout: }, 2023-08-01T19:55:00.450 INFO:teuthology.orchestra.run.smithi155.stdout: "events": [ 2023-08-01T19:55:00.450 INFO:teuthology.orchestra.run.smithi155.stdout: { 2023-08-01T19:55:00.451 INFO:teuthology.orchestra.run.smithi155.stdout: "event": "initiated", 2023-08-01T19:55:00.451 INFO:teuthology.orchestra.run.smithi155.stdout: "time": "2023-08-01T19:55:00.439932+0000", 2023-08-01T19:55:00.451 INFO:teuthology.orchestra.run.smithi155.stdout: "duration": 0 2023-08-01T19:55:00.451 INFO:teuthology.orchestra.run.smithi155.stdout: }, 2023-08-01T19:55:00.451 INFO:teuthology.orchestra.run.smithi155.stdout: { 2023-08-01T19:55:00.451 INFO:teuthology.orchestra.run.smithi155.stdout: "event": "throttled", 2023-08-01T19:55:00.451 INFO:teuthology.orchestra.run.smithi155.stdout: "time": "2023-08-01T19:55:00.439932+0000", 2023-08-01T19:55:00.451 INFO:teuthology.orchestra.run.smithi155.stdout: "duration": 0 2023-08-01T19:55:00.452 INFO:teuthology.orchestra.run.smithi155.stdout: }, 2023-08-01T19:55:00.452 INFO:teuthology.orchestra.run.smithi155.stdout: { 2023-08-01T19:55:00.452 INFO:teuthology.orchestra.run.smithi155.stdout: "event": "header_read", 2023-08-01T19:55:00.452 INFO:teuthology.orchestra.run.smithi155.stdout: "time": "2023-08-01T19:55:00.439931+0000", 2023-08-01T19:55:00.452 INFO:teuthology.orchestra.run.smithi155.stdout: "duration": 4294967295.9999986 2023-08-01T19:55:00.452 INFO:teuthology.orchestra.run.smithi155.stdout: }, 2023-08-01T19:55:00.452 INFO:teuthology.orchestra.run.smithi155.stdout: { 2023-08-01T19:55:00.453 INFO:teuthology.orchestra.run.smithi155.stdout: "event": "all_read", 2023-08-01T19:55:00.453 INFO:teuthology.orchestra.run.smithi155.stdout: "time": "2023-08-01T19:55:00.439989+0000", 2023-08-01T19:55:00.453 INFO:teuthology.orchestra.run.smithi155.stdout: "duration": 5.8093000000000001e-05 2023-08-01T19:55:00.453 INFO:teuthology.orchestra.run.smithi155.stdout: }, 2023-08-01T19:55:00.453 INFO:teuthology.orchestra.run.smithi155.stdout: { 2023-08-01T19:55:00.453 INFO:teuthology.orchestra.run.smithi155.stdout: "event": "dispatched", 2023-08-01T19:55:00.453 INFO:teuthology.orchestra.run.smithi155.stdout: "time": "2023-08-01T19:55:00.440000+0000", 2023-08-01T19:55:00.454 INFO:teuthology.orchestra.run.smithi155.stdout: "duration": 1.0426e-05 2023-08-01T19:55:00.454 INFO:teuthology.orchestra.run.smithi155.stdout: }, 2023-08-01T19:55:00.454 INFO:teuthology.orchestra.run.smithi155.stdout: { 2023-08-01T19:55:00.454 INFO:teuthology.orchestra.run.smithi155.stdout: "event": "queued_for_pg", 2023-08-01T19:55:00.454 INFO:teuthology.orchestra.run.smithi155.stdout: "time": "2023-08-01T19:55:00.440004+0000", 2023-08-01T19:55:00.454 INFO:teuthology.orchestra.run.smithi155.stdout: "duration": 4.2230000000000001e-06 2023-08-01T19:55:00.454 INFO:teuthology.orchestra.run.smithi155.stdout: }, 2023-08-01T19:55:00.455 INFO:teuthology.orchestra.run.smithi155.stdout: { 2023-08-01T19:55:00.455 INFO:teuthology.orchestra.run.smithi155.stdout: "event": "reached_pg", 2023-08-01T19:55:00.455 INFO:teuthology.orchestra.run.smithi155.stdout: "time": "2023-08-01T19:55:00.440032+0000", 2023-08-01T19:55:00.455 INFO:teuthology.orchestra.run.smithi155.stdout: "duration": 2.8467e-05 2023-08-01T19:55:00.455 INFO:teuthology.orchestra.run.smithi155.stdout: }, 2023-08-01T19:55:00.455 INFO:teuthology.orchestra.run.smithi155.stdout: { 2023-08-01T19:55:00.455 INFO:teuthology.orchestra.run.smithi155.stdout: "event": "started", 2023-08-01T19:55:00.455 INFO:teuthology.orchestra.run.smithi155.stdout: "time": "2023-08-01T19:55:00.440131+0000", 2023-08-01T19:55:00.456 INFO:teuthology.orchestra.run.smithi155.stdout: "duration": 9.8597999999999993e-05 2023-08-01T19:55:00.456 INFO:teuthology.orchestra.run.smithi155.stdout: }, 2023-08-01T19:55:00.456 INFO:teuthology.orchestra.run.smithi155.stdout: { 2023-08-01T19:55:00.456 INFO:teuthology.orchestra.run.smithi155.stdout: "event": "waiting for subops from 1", 2023-08-01T19:55:00.456 INFO:teuthology.orchestra.run.smithi155.stdout: "time": "2023-08-01T19:55:00.440265+0000", 2023-08-01T19:55:00.456 INFO:teuthology.orchestra.run.smithi155.stdout: "duration": 0.00013463200000000001 2023-08-01T19:55:00.456 INFO:teuthology.orchestra.run.smithi155.stdout: }, 2023-08-01T19:55:00.457 INFO:teuthology.orchestra.run.smithi155.stdout: { 2023-08-01T19:55:00.457 INFO:teuthology.orchestra.run.smithi155.stdout: "event": "op_commit", 2023-08-01T19:55:00.457 INFO:teuthology.orchestra.run.smithi155.stdout: "time": "2023-08-01T19:55:00.443899+0000", 2023-08-01T19:55:00.457 INFO:teuthology.orchestra.run.smithi155.stdout: "duration": 0.0036337079999999998 2023-08-01T19:55:00.457 INFO:teuthology.orchestra.run.smithi155.stdout: } 2023-08-01T19:55:00.457 INFO:teuthology.orchestra.run.smithi155.stdout: ] 2023-08-01T19:55:00.457 INFO:teuthology.orchestra.run.smithi155.stdout: } 2023-08-01T19:55:00.458 INFO:teuthology.orchestra.run.smithi155.stdout: }, 2023-08-01T19:55:00.458 INFO:teuthology.orchestra.run.smithi155.stdout: { 2023-08-01T19:55:00.458 INFO:teuthology.orchestra.run.smithi155.stdout: "description": "osd_op(client.4668.0:91101 5.4 5:29a79931:::benchmark_data_smithi006_114134_object91100:head [set-alloc-hint object_size 65536 write_size 65536,write 0~65536 in=65536b] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e35)", 2023-08-01T19:55:00.458 INFO:teuthology.orchestra.run.smithi155.stdout: "initiated_at": "2023-08-01T19:55:00.440396+0000", 2023-08-01T19:55:00.458 INFO:teuthology.orchestra.run.smithi155.stdout: "age": 0.0062976259999999997, 2023-08-01T19:55:00.458 INFO:teuthology.orchestra.run.smithi155.stdout: "duration": 0.0063876760000000001, 2023-08-01T19:55:00.458 INFO:teuthology.orchestra.run.smithi155.stdout: "type_data": { 2023-08-01T19:55:00.458 INFO:teuthology.orchestra.run.smithi155.stdout: "flag_point": "waiting for sub ops", 2023-08-01T19:55:00.459 INFO:teuthology.orchestra.run.smithi155.stdout: "client_info": { 2023-08-01T19:55:00.459 INFO:teuthology.orchestra.run.smithi155.stdout: "client": "client.4668", 2023-08-01T19:55:00.459 INFO:teuthology.orchestra.run.smithi155.stdout: "client_addr": "172.21.15.6:0/1709472247", 2023-08-01T19:55:00.459 INFO:teuthology.orchestra.run.smithi155.stdout: "tid": 91101 2023-08-01T19:55:00.459 INFO:teuthology.orchestra.run.smithi155.stdout: }, 2023-08-01T19:55:00.459 INFO:teuthology.orchestra.run.smithi155.stdout: "events": [ 2023-08-01T19:55:00.459 INFO:teuthology.orchestra.run.smithi155.stdout: { 2023-08-01T19:55:00.459 INFO:teuthology.orchestra.run.smithi155.stdout: "event": "initiated", 2023-08-01T19:55:00.460 INFO:teuthology.orchestra.run.smithi155.stdout: "time": "2023-08-01T19:55:00.440396+0000", 2023-08-01T19:55:00.460 INFO:teuthology.orchestra.run.smithi155.stdout: "duration": 0 2023-08-01T19:55:00.460 INFO:teuthology.orchestra.run.smithi155.stdout: }, 2023-08-01T19:55:00.460 INFO:teuthology.orchestra.run.smithi155.stdout: { 2023-08-01T19:55:00.460 INFO:teuthology.orchestra.run.smithi155.stdout: "event": "throttled", 2023-08-01T19:55:00.460 INFO:teuthology.orchestra.run.smithi155.stdout: "time": "2023-08-01T19:55:00.440396+0000", 2023-08-01T19:55:00.460 INFO:teuthology.orchestra.run.smithi155.stdout: "duration": 0 2023-08-01T19:55:00.461 INFO:teuthology.orchestra.run.smithi155.stdout: }, 2023-08-01T19:55:00.461 INFO:teuthology.orchestra.run.smithi155.stdout: { 2023-08-01T19:55:00.461 INFO:teuthology.orchestra.run.smithi155.stdout: "event": "header_read", 2023-08-01T19:55:00.461 INFO:teuthology.orchestra.run.smithi155.stdout: "time": "2023-08-01T19:55:00.440395+0000", 2023-08-01T19:55:00.461 INFO:teuthology.orchestra.run.smithi155.stdout: "duration": 4294967295.9999995 2023-08-01T19:55:00.461 INFO:teuthology.orchestra.run.smithi155.stdout: }, 2023-08-01T19:55:00.461 INFO:teuthology.orchestra.run.smithi155.stdout: { 2023-08-01T19:55:00.461 INFO:teuthology.orchestra.run.smithi155.stdout: "event": "all_read", 2023-08-01T19:55:00.462 INFO:teuthology.orchestra.run.smithi155.stdout: "time": "2023-08-01T19:55:00.440463+0000", 2023-08-01T19:55:00.462 INFO:teuthology.orchestra.run.smithi155.stdout: "duration": 6.7859000000000002e-05 2023-08-01T19:55:00.462 INFO:teuthology.orchestra.run.smithi155.stdout: }, 2023-08-01T19:55:00.462 INFO:teuthology.orchestra.run.smithi155.stdout: { 2023-08-01T19:55:00.462 INFO:teuthology.orchestra.run.smithi155.stdout: "event": "dispatched", 2023-08-01T19:55:00.462 INFO:teuthology.orchestra.run.smithi155.stdout: "time": "2023-08-01T19:55:00.440473+0000", 2023-08-01T19:55:00.462 INFO:teuthology.orchestra.run.smithi155.stdout: "duration": 9.9399999999999997e-06 2023-08-01T19:55:00.462 INFO:teuthology.orchestra.run.smithi155.stdout: }, 2023-08-01T19:55:00.463 INFO:teuthology.orchestra.run.smithi155.stdout: { 2023-08-01T19:55:00.463 INFO:teuthology.orchestra.run.smithi155.stdout: "event": "queued_for_pg", 2023-08-01T19:55:00.463 INFO:teuthology.orchestra.run.smithi155.stdout: "time": "2023-08-01T19:55:00.440478+0000", 2023-08-01T19:55:00.463 INFO:teuthology.orchestra.run.smithi155.stdout: "duration": 5.5090000000000001e-06 2023-08-01T19:55:00.463 INFO:teuthology.orchestra.run.smithi155.stdout: }, 2023-08-01T19:55:00.463 INFO:teuthology.orchestra.run.smithi155.stdout: { 2023-08-01T19:55:00.463 INFO:teuthology.orchestra.run.smithi155.stdout: "event": "reached_pg", 2023-08-01T19:55:00.464 INFO:teuthology.orchestra.run.smithi155.stdout: "time": "2023-08-01T19:55:00.440515+0000", 2023-08-01T19:55:00.464 INFO:teuthology.orchestra.run.smithi155.stdout: "duration": 3.6349e-05 2023-08-01T19:55:00.464 INFO:teuthology.orchestra.run.smithi155.stdout: }, 2023-08-01T19:55:00.464 INFO:teuthology.orchestra.run.smithi155.stdout: { 2023-08-01T19:55:00.464 INFO:teuthology.orchestra.run.smithi155.stdout: "event": "started", 2023-08-01T19:55:00.464 INFO:teuthology.orchestra.run.smithi155.stdout: "time": "2023-08-01T19:55:00.440599+0000", 2023-08-01T19:55:00.464 INFO:teuthology.orchestra.run.smithi155.stdout: "duration": 8.4520999999999999e-05 2023-08-01T19:55:00.464 INFO:teuthology.orchestra.run.smithi155.stdout: }, 2023-08-01T19:55:00.465 INFO:teuthology.orchestra.run.smithi155.stdout: { 2023-08-01T19:55:00.465 INFO:teuthology.orchestra.run.smithi155.stdout: "event": "waiting for subops from 0", 2023-08-01T19:55:00.465 INFO:teuthology.orchestra.run.smithi155.stdout: "time": "2023-08-01T19:55:00.440682+0000", 2023-08-01T19:55:00.465 INFO:teuthology.orchestra.run.smithi155.stdout: "duration": 8.3055999999999999e-05 2023-08-01T19:55:00.465 INFO:teuthology.orchestra.run.smithi155.stdout: }, 2023-08-01T19:55:00.465 INFO:teuthology.orchestra.run.smithi155.stdout: { 2023-08-01T19:55:00.465 INFO:teuthology.orchestra.run.smithi155.stdout: "event": "op_commit", 2023-08-01T19:55:00.465 INFO:teuthology.orchestra.run.smithi155.stdout: "time": "2023-08-01T19:55:00.444539+0000", 2023-08-01T19:55:00.466 INFO:teuthology.orchestra.run.smithi155.stdout: "duration": 0.0038564469999999998 2023-08-01T19:55:00.466 INFO:teuthology.orchestra.run.smithi155.stdout: } 2023-08-01T19:55:00.466 INFO:teuthology.orchestra.run.smithi155.stdout: ] 2023-08-01T19:55:00.466 INFO:teuthology.orchestra.run.smithi155.stdout: } 2023-08-01T19:55:00.466 INFO:teuthology.orchestra.run.smithi155.stdout: }, 2023-08-01T19:55:00.466 INFO:teuthology.orchestra.run.smithi155.stdout: { 2023-08-01T19:55:00.466 INFO:teuthology.orchestra.run.smithi155.stdout: "description": "osd_op(client.4668.0:91102 5.b 5:d8c37476:::benchmark_data_smithi006_114134_object91101:head [set-alloc-hint object_size 65536 write_size 65536,write 0~65536 in=65536b] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e35)", 2023-08-01T19:55:00.466 INFO:teuthology.orchestra.run.smithi155.stdout: "initiated_at": "2023-08-01T19:55:00.440489+0000", 2023-08-01T19:55:00.467 INFO:teuthology.orchestra.run.smithi155.stdout: "age": 0.006204406, 2023-08-01T19:55:00.467 INFO:teuthology.orchestra.run.smithi155.stdout: "duration": 0.0063497720000000001, 2023-08-01T19:55:00.467 INFO:teuthology.orchestra.run.smithi155.stdout: "type_data": { 2023-08-01T19:55:00.467 INFO:teuthology.orchestra.run.smithi155.stdout: "flag_point": "waiting for sub ops", 2023-08-01T19:55:00.467 INFO:teuthology.orchestra.run.smithi155.stdout: "client_info": { 2023-08-01T19:55:00.467 INFO:teuthology.orchestra.run.smithi155.stdout: "client": "client.4668", 2023-08-01T19:55:00.467 INFO:teuthology.orchestra.run.smithi155.stdout: "client_addr": "172.21.15.6:0/1709472247", 2023-08-01T19:55:00.468 INFO:teuthology.orchestra.run.smithi155.stdout: "tid": 91102 2023-08-01T19:55:00.468 INFO:teuthology.orchestra.run.smithi155.stdout: }, 2023-08-01T19:55:00.468 INFO:teuthology.orchestra.run.smithi155.stdout: "events": [ 2023-08-01T19:55:00.468 INFO:teuthology.orchestra.run.smithi155.stdout: { 2023-08-01T19:55:00.468 INFO:teuthology.orchestra.run.smithi155.stdout: "event": "initiated", 2023-08-01T19:55:00.468 INFO:teuthology.orchestra.run.smithi155.stdout: "time": "2023-08-01T19:55:00.440489+0000", 2023-08-01T19:55:00.468 INFO:teuthology.orchestra.run.smithi155.stdout: "duration": 0 2023-08-01T19:55:00.468 INFO:teuthology.orchestra.run.smithi155.stdout: }, 2023-08-01T19:55:00.469 INFO:teuthology.orchestra.run.smithi155.stdout: { 2023-08-01T19:55:00.469 INFO:teuthology.orchestra.run.smithi155.stdout: "event": "throttled", 2023-08-01T19:55:00.469 INFO:teuthology.orchestra.run.smithi155.stdout: "time": "2023-08-01T19:55:00.440489+0000", 2023-08-01T19:55:00.469 INFO:teuthology.orchestra.run.smithi155.stdout: "duration": 0 2023-08-01T19:55:00.469 INFO:teuthology.orchestra.run.smithi155.stdout: }, 2023-08-01T19:55:00.469 INFO:teuthology.orchestra.run.smithi155.stdout: { 2023-08-01T19:55:00.469 INFO:teuthology.orchestra.run.smithi155.stdout: "event": "header_read", 2023-08-01T19:55:00.469 INFO:teuthology.orchestra.run.smithi155.stdout: "time": "2023-08-01T19:55:00.440488+0000", 2023-08-01T19:55:00.470 INFO:teuthology.orchestra.run.smithi155.stdout: "duration": 4294967295.9999995 2023-08-01T19:55:00.470 INFO:teuthology.orchestra.run.smithi155.stdout: }, 2023-08-01T19:55:00.470 INFO:teuthology.orchestra.run.smithi155.stdout: { 2023-08-01T19:55:00.470 INFO:teuthology.orchestra.run.smithi155.stdout: "event": "all_read", 2023-08-01T19:55:00.470 INFO:teuthology.orchestra.run.smithi155.stdout: "time": "2023-08-01T19:55:00.440523+0000", 2023-08-01T19:55:00.470 INFO:teuthology.orchestra.run.smithi155.stdout: "duration": 3.5250000000000003e-05 2023-08-01T19:55:00.470 INFO:teuthology.orchestra.run.smithi155.stdout: }, 2023-08-01T19:55:00.470 INFO:teuthology.orchestra.run.smithi155.stdout: { 2023-08-01T19:55:00.471 INFO:teuthology.orchestra.run.smithi155.stdout: "event": "dispatched", 2023-08-01T19:55:00.471 INFO:teuthology.orchestra.run.smithi155.stdout: "time": "2023-08-01T19:55:00.440531+0000", 2023-08-01T19:55:00.471 INFO:teuthology.orchestra.run.smithi155.stdout: "duration": 7.1149999999999996e-06 2023-08-01T19:55:00.471 INFO:teuthology.orchestra.run.smithi155.stdout: }, 2023-08-01T19:55:00.471 INFO:teuthology.orchestra.run.smithi155.stdout: { 2023-08-01T19:55:00.471 INFO:teuthology.orchestra.run.smithi155.stdout: "event": "queued_for_pg", 2023-08-01T19:55:00.471 INFO:teuthology.orchestra.run.smithi155.stdout: "time": "2023-08-01T19:55:00.440535+0000", 2023-08-01T19:55:00.471 INFO:teuthology.orchestra.run.smithi155.stdout: "duration": 4.8910000000000003e-06 2023-08-01T19:55:00.472 INFO:teuthology.orchestra.run.smithi155.stdout: }, 2023-08-01T19:55:00.472 INFO:teuthology.orchestra.run.smithi155.stdout: { 2023-08-01T19:55:00.472 INFO:teuthology.orchestra.run.smithi155.stdout: "event": "reached_pg", 2023-08-01T19:55:00.472 INFO:teuthology.orchestra.run.smithi155.stdout: "time": "2023-08-01T19:55:00.440576+0000", 2023-08-01T19:55:00.472 INFO:teuthology.orchestra.run.smithi155.stdout: "duration": 4.0839e-05 2023-08-01T19:55:00.472 INFO:teuthology.orchestra.run.smithi155.stdout: }, 2023-08-01T19:55:00.472 INFO:teuthology.orchestra.run.smithi155.stdout: { 2023-08-01T19:55:00.473 INFO:teuthology.orchestra.run.smithi155.stdout: "event": "started", 2023-08-01T19:55:00.473 INFO:teuthology.orchestra.run.smithi155.stdout: "time": "2023-08-01T19:55:00.440689+0000", 2023-08-01T19:55:00.473 INFO:teuthology.orchestra.run.smithi155.stdout: "duration": 0.00011311000000000001 2023-08-01T19:55:00.473 INFO:teuthology.orchestra.run.smithi155.stdout: }, 2023-08-01T19:55:00.473 INFO:teuthology.orchestra.run.smithi155.stdout: { 2023-08-01T19:55:00.473 INFO:teuthology.orchestra.run.smithi155.stdout: "event": "waiting for subops from 0", 2023-08-01T19:55:00.473 INFO:teuthology.orchestra.run.smithi155.stdout: "time": "2023-08-01T19:55:00.440830+0000", 2023-08-01T19:55:00.473 INFO:teuthology.orchestra.run.smithi155.stdout: "duration": 0.00014052699999999999 2023-08-01T19:55:00.474 INFO:teuthology.orchestra.run.smithi155.stdout: } 2023-08-01T19:55:00.474 INFO:teuthology.orchestra.run.smithi155.stdout: ] 2023-08-01T19:55:00.474 INFO:teuthology.orchestra.run.smithi155.stdout: } 2023-08-01T19:55:00.474 INFO:teuthology.orchestra.run.smithi155.stdout: }, 2023-08-01T19:55:00.474 INFO:teuthology.orchestra.run.smithi155.stdout: { 2023-08-01T19:55:00.474 INFO:teuthology.orchestra.run.smithi155.stdout: "description": "osd_op(client.4668.0:91105 5.8 5:1d3be9bb:::benchmark_data_smithi006_114134_object91104:head [set-alloc-hint object_size 65536 write_size 65536,write 0~65536 in=65536b] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e35)", 2023-08-01T19:55:00.474 INFO:teuthology.orchestra.run.smithi155.stdout: "initiated_at": "2023-08-01T19:55:00.440696+0000", 2023-08-01T19:55:00.475 INFO:teuthology.orchestra.run.smithi155.stdout: "age": 0.0059971570000000004, 2023-08-01T19:55:00.475 INFO:teuthology.orchestra.run.smithi155.stdout: "duration": 0.0061983949999999998, 2023-08-01T19:55:00.475 INFO:teuthology.orchestra.run.smithi155.stdout: "type_data": { 2023-08-01T19:55:00.475 INFO:teuthology.orchestra.run.smithi155.stdout: "flag_point": "waiting for sub ops", 2023-08-01T19:55:00.475 INFO:teuthology.orchestra.run.smithi155.stdout: "client_info": { 2023-08-01T19:55:00.475 INFO:teuthology.orchestra.run.smithi155.stdout: "client": "client.4668", 2023-08-01T19:55:00.475 INFO:teuthology.orchestra.run.smithi155.stdout: "client_addr": "172.21.15.6:0/1709472247", 2023-08-01T19:55:00.475 INFO:teuthology.orchestra.run.smithi155.stdout: "tid": 91105 2023-08-01T19:55:00.476 INFO:teuthology.orchestra.run.smithi155.stdout: }, 2023-08-01T19:55:00.476 INFO:teuthology.orchestra.run.smithi155.stdout: "events": [ 2023-08-01T19:55:00.476 INFO:teuthology.orchestra.run.smithi155.stdout: { 2023-08-01T19:55:00.476 INFO:teuthology.orchestra.run.smithi155.stdout: "event": "initiated", 2023-08-01T19:55:00.476 INFO:teuthology.orchestra.run.smithi155.stdout: "time": "2023-08-01T19:55:00.440696+0000", 2023-08-01T19:55:00.476 INFO:teuthology.orchestra.run.smithi155.stdout: "duration": 0 2023-08-01T19:55:00.476 INFO:teuthology.orchestra.run.smithi155.stdout: }, 2023-08-01T19:55:00.476 INFO:teuthology.orchestra.run.smithi155.stdout: { 2023-08-01T19:55:00.477 INFO:teuthology.orchestra.run.smithi155.stdout: "event": "throttled", 2023-08-01T19:55:00.477 INFO:teuthology.orchestra.run.smithi155.stdout: "time": "2023-08-01T19:55:00.440696+0000", 2023-08-01T19:55:00.477 INFO:teuthology.orchestra.run.smithi155.stdout: "duration": 0 2023-08-01T19:55:00.477 INFO:teuthology.orchestra.run.smithi155.stdout: }, 2023-08-01T19:55:00.477 INFO:teuthology.orchestra.run.smithi155.stdout: { 2023-08-01T19:55:00.477 INFO:teuthology.orchestra.run.smithi155.stdout: "event": "header_read", 2023-08-01T19:55:00.477 INFO:teuthology.orchestra.run.smithi155.stdout: "time": "2023-08-01T19:55:00.440696+0000", 2023-08-01T19:55:00.478 INFO:teuthology.orchestra.run.smithi155.stdout: "duration": 4294967295.9999995 2023-08-01T19:55:00.478 INFO:teuthology.orchestra.run.smithi155.stdout: }, 2023-08-01T19:55:00.478 INFO:teuthology.orchestra.run.smithi155.stdout: { 2023-08-01T19:55:00.478 INFO:teuthology.orchestra.run.smithi155.stdout: "event": "all_read", 2023-08-01T19:55:00.478 INFO:teuthology.orchestra.run.smithi155.stdout: "time": "2023-08-01T19:55:00.440770+0000", 2023-08-01T19:55:00.478 INFO:teuthology.orchestra.run.smithi155.stdout: "duration": 7.4738000000000002e-05 2023-08-01T19:55:00.479 INFO:teuthology.orchestra.run.smithi155.stdout: }, 2023-08-01T19:55:00.479 INFO:teuthology.orchestra.run.smithi155.stdout: { 2023-08-01T19:55:00.479 INFO:teuthology.orchestra.run.smithi155.stdout: "event": "dispatched", 2023-08-01T19:55:00.479 INFO:teuthology.orchestra.run.smithi155.stdout: "time": "2023-08-01T19:55:00.440777+0000", 2023-08-01T19:55:00.479 INFO:teuthology.orchestra.run.smithi155.stdout: "duration": 6.2759999999999997e-06 2023-08-01T19:55:00.479 INFO:teuthology.orchestra.run.smithi155.stdout: }, 2023-08-01T19:55:00.479 INFO:teuthology.orchestra.run.smithi155.stdout: { 2023-08-01T19:55:00.480 INFO:teuthology.orchestra.run.smithi155.stdout: "event": "queued_for_pg", 2023-08-01T19:55:00.480 INFO:teuthology.orchestra.run.smithi155.stdout: "time": "2023-08-01T19:55:00.440781+0000", 2023-08-01T19:55:00.480 INFO:teuthology.orchestra.run.smithi155.stdout: "duration": 4.267e-06 2023-08-01T19:55:00.480 INFO:teuthology.orchestra.run.smithi155.stdout: }, 2023-08-01T19:55:00.480 INFO:teuthology.orchestra.run.smithi155.stdout: { 2023-08-01T19:55:00.480 INFO:teuthology.orchestra.run.smithi155.stdout: "event": "reached_pg", 2023-08-01T19:55:00.480 INFO:teuthology.orchestra.run.smithi155.stdout: "time": "2023-08-01T19:55:00.440815+0000", 2023-08-01T19:55:00.481 INFO:teuthology.orchestra.run.smithi155.stdout: "duration": 3.3957e-05 2023-08-01T19:55:00.481 INFO:teuthology.orchestra.run.smithi155.stdout: }, 2023-08-01T19:55:00.481 INFO:teuthology.orchestra.run.smithi155.stdout: { 2023-08-01T19:55:00.481 INFO:teuthology.orchestra.run.smithi155.stdout: "event": "started", 2023-08-01T19:55:00.481 INFO:teuthology.orchestra.run.smithi155.stdout: "time": "2023-08-01T19:55:00.440887+0000", 2023-08-01T19:55:00.481 INFO:teuthology.orchestra.run.smithi155.stdout: "duration": 7.2171999999999999e-05 2023-08-01T19:55:00.481 INFO:teuthology.orchestra.run.smithi155.stdout: }, 2023-08-01T19:55:00.481 INFO:teuthology.orchestra.run.smithi155.stdout: { 2023-08-01T19:55:00.482 INFO:teuthology.orchestra.run.smithi155.stdout: "event": "waiting for subops from 0", 2023-08-01T19:55:00.482 INFO:teuthology.orchestra.run.smithi155.stdout: "time": "2023-08-01T19:55:00.440964+0000", 2023-08-01T19:55:00.482 INFO:teuthology.orchestra.run.smithi155.stdout: "duration": 7.7449999999999999e-05 2023-08-01T19:55:00.482 INFO:teuthology.orchestra.run.smithi155.stdout: } 2023-08-01T19:55:00.482 INFO:teuthology.orchestra.run.smithi155.stdout: ] 2023-08-01T19:55:00.482 INFO:teuthology.orchestra.run.smithi155.stdout: } 2023-08-01T19:55:00.482 INFO:teuthology.orchestra.run.smithi155.stdout: }, 2023-08-01T19:55:00.482 INFO:teuthology.orchestra.run.smithi155.stdout: { 2023-08-01T19:55:00.483 INFO:teuthology.orchestra.run.smithi155.stdout: "description": "osd_op(client.4668.0:91106 5.4 5:226c7807:::benchmark_data_smithi006_114134_object91105:head [set-alloc-hint object_size 65536 write_size 65536,write 0~65536 in=65536b] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e35)", 2023-08-01T19:55:00.483 INFO:teuthology.orchestra.run.smithi155.stdout: "initiated_at": "2023-08-01T19:55:00.442920+0000", 2023-08-01T19:55:00.483 INFO:teuthology.orchestra.run.smithi155.stdout: "age": 0.0037733879999999999, 2023-08-01T19:55:00.483 INFO:teuthology.orchestra.run.smithi155.stdout: "duration": 0.0040510260000000001, 2023-08-01T19:55:00.483 INFO:teuthology.orchestra.run.smithi155.stdout: "type_data": { 2023-08-01T19:55:00.483 INFO:teuthology.orchestra.run.smithi155.stdout: "flag_point": "waiting for sub ops", 2023-08-01T19:55:00.483 INFO:teuthology.orchestra.run.smithi155.stdout: "client_info": { 2023-08-01T19:55:00.484 INFO:teuthology.orchestra.run.smithi155.stdout: "client": "client.4668", 2023-08-01T19:55:00.484 INFO:teuthology.orchestra.run.smithi155.stdout: "client_addr": "172.21.15.6:0/1709472247", 2023-08-01T19:55:00.484 INFO:teuthology.orchestra.run.smithi155.stdout: "tid": 91106 2023-08-01T19:55:00.484 INFO:teuthology.orchestra.run.smithi155.stdout: }, 2023-08-01T19:55:00.484 INFO:teuthology.orchestra.run.smithi155.stdout: "events": [ 2023-08-01T19:55:00.484 INFO:teuthology.orchestra.run.smithi155.stdout: { 2023-08-01T19:55:00.484 INFO:teuthology.orchestra.run.smithi155.stdout: "event": "initiated", 2023-08-01T19:55:00.485 INFO:teuthology.orchestra.run.smithi155.stdout: "time": "2023-08-01T19:55:00.442920+0000", 2023-08-01T19:55:00.485 INFO:teuthology.orchestra.run.smithi155.stdout: "duration": 0 2023-08-01T19:55:00.485 INFO:teuthology.orchestra.run.smithi155.stdout: }, 2023-08-01T19:55:00.485 INFO:teuthology.orchestra.run.smithi155.stdout: { 2023-08-01T19:55:00.485 INFO:teuthology.orchestra.run.smithi155.stdout: "event": "throttled", 2023-08-01T19:55:00.485 INFO:teuthology.orchestra.run.smithi155.stdout: "time": "2023-08-01T19:55:00.442920+0000", 2023-08-01T19:55:00.485 INFO:teuthology.orchestra.run.smithi155.stdout: "duration": 0 2023-08-01T19:55:00.486 INFO:teuthology.orchestra.run.smithi155.stdout: }, 2023-08-01T19:55:00.486 INFO:teuthology.orchestra.run.smithi155.stdout: { 2023-08-01T19:55:00.486 INFO:teuthology.orchestra.run.smithi155.stdout: "event": "header_read", 2023-08-01T19:55:00.486 INFO:teuthology.orchestra.run.smithi155.stdout: "time": "2023-08-01T19:55:00.442919+0000", 2023-08-01T19:55:00.486 INFO:teuthology.orchestra.run.smithi155.stdout: "duration": 4294967295.999999 2023-08-01T19:55:00.486 INFO:teuthology.orchestra.run.smithi155.stdout: }, 2023-08-01T19:55:00.486 INFO:teuthology.orchestra.run.smithi155.stdout: { 2023-08-01T19:55:00.486 INFO:teuthology.orchestra.run.smithi155.stdout: "event": "all_read", 2023-08-01T19:55:00.487 INFO:teuthology.orchestra.run.smithi155.stdout: "time": "2023-08-01T19:55:00.442967+0000", 2023-08-01T19:55:00.487 INFO:teuthology.orchestra.run.smithi155.stdout: "duration": 4.7985999999999998e-05 2023-08-01T19:55:00.487 INFO:teuthology.orchestra.run.smithi155.stdout: }, 2023-08-01T19:55:00.487 INFO:teuthology.orchestra.run.smithi155.stdout: { 2023-08-01T19:55:00.487 INFO:teuthology.orchestra.run.smithi155.stdout: "event": "dispatched", 2023-08-01T19:55:00.487 INFO:teuthology.orchestra.run.smithi155.stdout: "time": "2023-08-01T19:55:00.442976+0000", 2023-08-01T19:55:00.487 INFO:teuthology.orchestra.run.smithi155.stdout: "duration": 9.5529999999999998e-06 2023-08-01T19:55:00.487 INFO:teuthology.orchestra.run.smithi155.stdout: }, 2023-08-01T19:55:00.488 INFO:teuthology.orchestra.run.smithi155.stdout: { 2023-08-01T19:55:00.488 INFO:teuthology.orchestra.run.smithi155.stdout: "event": "queued_for_pg", 2023-08-01T19:55:00.488 INFO:teuthology.orchestra.run.smithi155.stdout: "time": "2023-08-01T19:55:00.442981+0000", 2023-08-01T19:55:00.488 INFO:teuthology.orchestra.run.smithi155.stdout: "duration": 4.5190000000000003e-06 2023-08-01T19:55:00.488 INFO:teuthology.orchestra.run.smithi155.stdout: }, 2023-08-01T19:55:00.488 INFO:teuthology.orchestra.run.smithi155.stdout: { 2023-08-01T19:55:00.488 INFO:teuthology.orchestra.run.smithi155.stdout: "event": "reached_pg", 2023-08-01T19:55:00.489 INFO:teuthology.orchestra.run.smithi155.stdout: "time": "2023-08-01T19:55:00.443008+0000", 2023-08-01T19:55:00.489 INFO:teuthology.orchestra.run.smithi155.stdout: "duration": 2.7784999999999999e-05 2023-08-01T19:55:00.489 INFO:teuthology.orchestra.run.smithi155.stdout: }, 2023-08-01T19:55:00.489 INFO:teuthology.orchestra.run.smithi155.stdout: { 2023-08-01T19:55:00.489 INFO:teuthology.orchestra.run.smithi155.stdout: "event": "started", 2023-08-01T19:55:00.489 INFO:teuthology.orchestra.run.smithi155.stdout: "time": "2023-08-01T19:55:00.443084+0000", 2023-08-01T19:55:00.489 INFO:teuthology.orchestra.run.smithi155.stdout: "duration": 7.5067999999999993e-05 2023-08-01T19:55:00.489 INFO:teuthology.orchestra.run.smithi155.stdout: }, 2023-08-01T19:55:00.490 INFO:teuthology.orchestra.run.smithi155.stdout: { 2023-08-01T19:55:00.490 INFO:teuthology.orchestra.run.smithi155.stdout: "event": "waiting for subops from 0", 2023-08-01T19:55:00.490 INFO:teuthology.orchestra.run.smithi155.stdout: "time": "2023-08-01T19:55:00.443166+0000", 2023-08-01T19:55:00.490 INFO:teuthology.orchestra.run.smithi155.stdout: "duration": 8.1971000000000005e-05 2023-08-01T19:55:00.490 INFO:teuthology.orchestra.run.smithi155.stdout: } 2023-08-01T19:55:00.490 INFO:teuthology.orchestra.run.smithi155.stdout: ] 2023-08-01T19:55:00.490 INFO:teuthology.orchestra.run.smithi155.stdout: } 2023-08-01T19:55:00.490 INFO:teuthology.orchestra.run.smithi155.stdout: }, 2023-08-01T19:55:00.491 INFO:teuthology.orchestra.run.smithi155.stdout: { 2023-08-01T19:55:00.491 INFO:teuthology.orchestra.run.smithi155.stdout: "description": "osd_op(client.4668.0:91107 5.4 5:25420c4b:::benchmark_data_smithi006_114134_object91106:head [set-alloc-hint object_size 65536 write_size 65536,write 0~65536 in=65536b] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e35)", 2023-08-01T19:55:00.491 INFO:teuthology.orchestra.run.smithi155.stdout: "initiated_at": "2023-08-01T19:55:00.444192+0000", 2023-08-01T19:55:00.491 INFO:teuthology.orchestra.run.smithi155.stdout: "age": 0.002501058, 2023-08-01T19:55:00.491 INFO:teuthology.orchestra.run.smithi155.stdout: "duration": 0.0028268189999999999, 2023-08-01T19:55:00.491 INFO:teuthology.orchestra.run.smithi155.stdout: "type_data": { 2023-08-01T19:55:00.491 INFO:teuthology.orchestra.run.smithi155.stdout: "flag_point": "waiting for sub ops", 2023-08-01T19:55:00.492 INFO:teuthology.orchestra.run.smithi155.stdout: "client_info": { 2023-08-01T19:55:00.492 INFO:teuthology.orchestra.run.smithi155.stdout: "client": "client.4668", 2023-08-01T19:55:00.492 INFO:teuthology.orchestra.run.smithi155.stdout: "client_addr": "172.21.15.6:0/1709472247", 2023-08-01T19:55:00.492 INFO:teuthology.orchestra.run.smithi155.stdout: "tid": 91107 2023-08-01T19:55:00.492 INFO:teuthology.orchestra.run.smithi155.stdout: }, 2023-08-01T19:55:00.492 INFO:teuthology.orchestra.run.smithi155.stdout: "events": [ 2023-08-01T19:55:00.492 INFO:teuthology.orchestra.run.smithi155.stdout: { 2023-08-01T19:55:00.492 INFO:teuthology.orchestra.run.smithi155.stdout: "event": "initiated", 2023-08-01T19:55:00.493 INFO:teuthology.orchestra.run.smithi155.stdout: "time": "2023-08-01T19:55:00.444192+0000", 2023-08-01T19:55:00.493 INFO:teuthology.orchestra.run.smithi155.stdout: "duration": 0 2023-08-01T19:55:00.493 INFO:teuthology.orchestra.run.smithi155.stdout: }, 2023-08-01T19:55:00.493 INFO:teuthology.orchestra.run.smithi155.stdout: { 2023-08-01T19:55:00.493 INFO:teuthology.orchestra.run.smithi155.stdout: "event": "throttled", 2023-08-01T19:55:00.493 INFO:teuthology.orchestra.run.smithi155.stdout: "time": "2023-08-01T19:55:00.444192+0000", 2023-08-01T19:55:00.493 INFO:teuthology.orchestra.run.smithi155.stdout: "duration": 0 2023-08-01T19:55:00.494 INFO:teuthology.orchestra.run.smithi155.stdout: }, 2023-08-01T19:55:00.494 INFO:teuthology.orchestra.run.smithi155.stdout: { 2023-08-01T19:55:00.494 INFO:teuthology.orchestra.run.smithi155.stdout: "event": "header_read", 2023-08-01T19:55:00.494 INFO:teuthology.orchestra.run.smithi155.stdout: "time": "2023-08-01T19:55:00.444192+0000", 2023-08-01T19:55:00.494 INFO:teuthology.orchestra.run.smithi155.stdout: "duration": 4294967295.9999995 2023-08-01T19:55:00.494 INFO:teuthology.orchestra.run.smithi155.stdout: }, 2023-08-01T19:55:00.494 INFO:teuthology.orchestra.run.smithi155.stdout: { 2023-08-01T19:55:00.494 INFO:teuthology.orchestra.run.smithi155.stdout: "event": "all_read", 2023-08-01T19:55:00.495 INFO:teuthology.orchestra.run.smithi155.stdout: "time": "2023-08-01T19:55:00.444247+0000", 2023-08-01T19:55:00.495 INFO:teuthology.orchestra.run.smithi155.stdout: "duration": 5.5216999999999997e-05 2023-08-01T19:55:00.495 INFO:teuthology.orchestra.run.smithi155.stdout: }, 2023-08-01T19:55:00.495 INFO:teuthology.orchestra.run.smithi155.stdout: { 2023-08-01T19:55:00.495 INFO:teuthology.orchestra.run.smithi155.stdout: "event": "dispatched", 2023-08-01T19:55:00.495 INFO:teuthology.orchestra.run.smithi155.stdout: "time": "2023-08-01T19:55:00.444255+0000", 2023-08-01T19:55:00.495 INFO:teuthology.orchestra.run.smithi155.stdout: "duration": 8.1510000000000004e-06 2023-08-01T19:55:00.495 INFO:teuthology.orchestra.run.smithi155.stdout: }, 2023-08-01T19:55:00.496 INFO:teuthology.orchestra.run.smithi155.stdout: { 2023-08-01T19:55:00.496 INFO:teuthology.orchestra.run.smithi155.stdout: "event": "queued_for_pg", 2023-08-01T19:55:00.496 INFO:teuthology.orchestra.run.smithi155.stdout: "time": "2023-08-01T19:55:00.444259+0000", 2023-08-01T19:55:00.496 INFO:teuthology.orchestra.run.smithi155.stdout: "duration": 3.878e-06 2023-08-01T19:55:00.496 INFO:teuthology.orchestra.run.smithi155.stdout: }, 2023-08-01T19:55:00.496 INFO:teuthology.orchestra.run.smithi155.stdout: { 2023-08-01T19:55:00.496 INFO:teuthology.orchestra.run.smithi155.stdout: "event": "reached_pg", 2023-08-01T19:55:00.497 INFO:teuthology.orchestra.run.smithi155.stdout: "time": "2023-08-01T19:55:00.444556+0000", 2023-08-01T19:55:00.497 INFO:teuthology.orchestra.run.smithi155.stdout: "duration": 0.00029770900000000001 2023-08-01T19:55:00.497 INFO:teuthology.orchestra.run.smithi155.stdout: }, 2023-08-01T19:55:00.497 INFO:teuthology.orchestra.run.smithi155.stdout: { 2023-08-01T19:55:00.497 INFO:teuthology.orchestra.run.smithi155.stdout: "event": "started", 2023-08-01T19:55:00.497 INFO:teuthology.orchestra.run.smithi155.stdout: "time": "2023-08-01T19:55:00.444638+0000", 2023-08-01T19:55:00.497 INFO:teuthology.orchestra.run.smithi155.stdout: "duration": 8.1976000000000003e-05 2023-08-01T19:55:00.498 INFO:teuthology.orchestra.run.smithi155.stdout: }, 2023-08-01T19:55:00.498 INFO:teuthology.orchestra.run.smithi155.stdout: { 2023-08-01T19:55:00.498 INFO:teuthology.orchestra.run.smithi155.stdout: "event": "waiting for subops from 0", 2023-08-01T19:55:00.498 INFO:teuthology.orchestra.run.smithi155.stdout: "time": "2023-08-01T19:55:00.444733+0000", 2023-08-01T19:55:00.498 INFO:teuthology.orchestra.run.smithi155.stdout: "duration": 9.4522000000000001e-05 2023-08-01T19:55:00.498 INFO:teuthology.orchestra.run.smithi155.stdout: } 2023-08-01T19:55:00.498 INFO:teuthology.orchestra.run.smithi155.stdout: ] 2023-08-01T19:55:00.498 INFO:teuthology.orchestra.run.smithi155.stdout: } 2023-08-01T19:55:00.499 INFO:teuthology.orchestra.run.smithi155.stdout: }, 2023-08-01T19:55:00.499 INFO:teuthology.orchestra.run.smithi155.stdout: { 2023-08-01T19:55:00.499 INFO:teuthology.orchestra.run.smithi155.stdout: "description": "osd_op(client.4668.0:91108 5.b 5:d52de527:::benchmark_data_smithi006_114134_object91107:head [set-alloc-hint object_size 65536 write_size 65536,write 0~65536 in=65536b] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e35)", 2023-08-01T19:55:00.499 INFO:teuthology.orchestra.run.smithi155.stdout: "initiated_at": "2023-08-01T19:55:00.444749+0000", 2023-08-01T19:55:00.499 INFO:teuthology.orchestra.run.smithi155.stdout: "age": 0.0019440970000000001, 2023-08-01T19:55:00.499 INFO:teuthology.orchestra.run.smithi155.stdout: "duration": 0.0023168989999999999, 2023-08-01T19:55:00.500 INFO:teuthology.orchestra.run.smithi155.stdout: "type_data": { 2023-08-01T19:55:00.500 INFO:teuthology.orchestra.run.smithi155.stdout: "flag_point": "waiting for sub ops", 2023-08-01T19:55:00.500 INFO:teuthology.orchestra.run.smithi155.stdout: "client_info": { 2023-08-01T19:55:00.500 INFO:teuthology.orchestra.run.smithi155.stdout: "client": "client.4668", 2023-08-01T19:55:00.500 INFO:teuthology.orchestra.run.smithi155.stdout: "client_addr": "172.21.15.6:0/1709472247", 2023-08-01T19:55:00.500 INFO:teuthology.orchestra.run.smithi155.stdout: "tid": 91108 2023-08-01T19:55:00.500 INFO:teuthology.orchestra.run.smithi155.stdout: }, 2023-08-01T19:55:00.500 INFO:teuthology.orchestra.run.smithi155.stdout: "events": [ 2023-08-01T19:55:00.501 INFO:teuthology.orchestra.run.smithi155.stdout: { 2023-08-01T19:55:00.501 INFO:teuthology.orchestra.run.smithi155.stdout: "event": "initiated", 2023-08-01T19:55:00.501 INFO:teuthology.orchestra.run.smithi155.stdout: "time": "2023-08-01T19:55:00.444749+0000", 2023-08-01T19:55:00.501 INFO:teuthology.orchestra.run.smithi155.stdout: "duration": 0 2023-08-01T19:55:00.501 INFO:teuthology.orchestra.run.smithi155.stdout: }, 2023-08-01T19:55:00.501 INFO:teuthology.orchestra.run.smithi155.stdout: { 2023-08-01T19:55:00.501 INFO:teuthology.orchestra.run.smithi155.stdout: "event": "throttled", 2023-08-01T19:55:00.502 INFO:teuthology.orchestra.run.smithi155.stdout: "time": "2023-08-01T19:55:00.444749+0000", 2023-08-01T19:55:00.502 INFO:teuthology.orchestra.run.smithi155.stdout: "duration": 0 2023-08-01T19:55:00.502 INFO:teuthology.orchestra.run.smithi155.stdout: }, 2023-08-01T19:55:00.502 INFO:teuthology.orchestra.run.smithi155.stdout: { 2023-08-01T19:55:00.502 INFO:teuthology.orchestra.run.smithi155.stdout: "event": "header_read", 2023-08-01T19:55:00.502 INFO:teuthology.orchestra.run.smithi155.stdout: "time": "2023-08-01T19:55:00.444748+0000", 2023-08-01T19:55:00.502 INFO:teuthology.orchestra.run.smithi155.stdout: "duration": 4294967295.999999 2023-08-01T19:55:00.503 INFO:teuthology.orchestra.run.smithi155.stdout: }, 2023-08-01T19:55:00.503 INFO:teuthology.orchestra.run.smithi155.stdout: { 2023-08-01T19:55:00.503 INFO:teuthology.orchestra.run.smithi155.stdout: "event": "all_read", 2023-08-01T19:55:00.503 INFO:teuthology.orchestra.run.smithi155.stdout: "time": "2023-08-01T19:55:00.444863+0000", 2023-08-01T19:55:00.503 INFO:teuthology.orchestra.run.smithi155.stdout: "duration": 0.000114533 2023-08-01T19:55:00.503 INFO:teuthology.orchestra.run.smithi155.stdout: }, 2023-08-01T19:55:00.503 INFO:teuthology.orchestra.run.smithi155.stdout: { 2023-08-01T19:55:00.504 INFO:teuthology.orchestra.run.smithi155.stdout: "event": "dispatched", 2023-08-01T19:55:00.504 INFO:teuthology.orchestra.run.smithi155.stdout: "time": "2023-08-01T19:55:00.444874+0000", 2023-08-01T19:55:00.504 INFO:teuthology.orchestra.run.smithi155.stdout: "duration": 1.1574e-05 2023-08-01T19:55:00.504 INFO:teuthology.orchestra.run.smithi155.stdout: }, 2023-08-01T19:55:00.504 INFO:teuthology.orchestra.run.smithi155.stdout: { 2023-08-01T19:55:00.504 INFO:teuthology.orchestra.run.smithi155.stdout: "event": "queued_for_pg", 2023-08-01T19:55:00.504 INFO:teuthology.orchestra.run.smithi155.stdout: "time": "2023-08-01T19:55:00.444880+0000", 2023-08-01T19:55:00.504 INFO:teuthology.orchestra.run.smithi155.stdout: "duration": 5.5940000000000001e-06 2023-08-01T19:55:00.505 INFO:teuthology.orchestra.run.smithi155.stdout: }, 2023-08-01T19:55:00.505 INFO:teuthology.orchestra.run.smithi155.stdout: { 2023-08-01T19:55:00.505 INFO:teuthology.orchestra.run.smithi155.stdout: "event": "reached_pg", 2023-08-01T19:55:00.505 INFO:teuthology.orchestra.run.smithi155.stdout: "time": "2023-08-01T19:55:00.444914+0000", 2023-08-01T19:55:00.505 INFO:teuthology.orchestra.run.smithi155.stdout: "duration": 3.3674000000000003e-05 2023-08-01T19:55:00.505 INFO:teuthology.orchestra.run.smithi155.stdout: }, 2023-08-01T19:55:00.505 INFO:teuthology.orchestra.run.smithi155.stdout: { 2023-08-01T19:55:00.506 INFO:teuthology.orchestra.run.smithi155.stdout: "event": "started", 2023-08-01T19:55:00.506 INFO:teuthology.orchestra.run.smithi155.stdout: "time": "2023-08-01T19:55:00.445025+0000", 2023-08-01T19:55:00.506 INFO:teuthology.orchestra.run.smithi155.stdout: "duration": 0.000111581 2023-08-01T19:55:00.506 INFO:teuthology.orchestra.run.smithi155.stdout: }, 2023-08-01T19:55:00.506 INFO:teuthology.orchestra.run.smithi155.stdout: { 2023-08-01T19:55:00.506 INFO:teuthology.orchestra.run.smithi155.stdout: "event": "waiting for subops from 0", 2023-08-01T19:55:00.506 INFO:teuthology.orchestra.run.smithi155.stdout: "time": "2023-08-01T19:55:00.445131+0000", 2023-08-01T19:55:00.507 INFO:teuthology.orchestra.run.smithi155.stdout: "duration": 0.000106137 2023-08-01T19:55:00.507 INFO:teuthology.orchestra.run.smithi155.stdout: } 2023-08-01T19:55:00.507 INFO:teuthology.orchestra.run.smithi155.stdout: ] 2023-08-01T19:55:00.507 INFO:teuthology.orchestra.run.smithi155.stdout: } 2023-08-01T19:55:00.507 INFO:teuthology.orchestra.run.smithi155.stdout: }, 2023-08-01T19:55:00.507 INFO:teuthology.orchestra.run.smithi155.stdout: { 2023-08-01T19:55:00.507 INFO:teuthology.orchestra.run.smithi155.stdout: "description": "osd_op(client.4668.0:91111 5.4 5:2c458966:::benchmark_data_smithi006_114134_object91110:head [set-alloc-hint object_size 65536 write_size 65536,write 0~65536 in=65536b] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e35)", 2023-08-01T19:55:00.507 INFO:teuthology.orchestra.run.smithi155.stdout: "initiated_at": "2023-08-01T19:55:00.444914+0000", 2023-08-01T19:55:00.508 INFO:teuthology.orchestra.run.smithi155.stdout: "age": 0.001778887, 2023-08-01T19:55:00.508 INFO:teuthology.orchestra.run.smithi155.stdout: "duration": 0.002200446, 2023-08-01T19:55:00.508 INFO:teuthology.orchestra.run.smithi155.stdout: "type_data": { 2023-08-01T19:55:00.508 INFO:teuthology.orchestra.run.smithi155.stdout: "flag_point": "waiting for sub ops", 2023-08-01T19:55:00.508 INFO:teuthology.orchestra.run.smithi155.stdout: "client_info": { 2023-08-01T19:55:00.508 INFO:teuthology.orchestra.run.smithi155.stdout: "client": "client.4668", 2023-08-01T19:55:00.508 INFO:teuthology.orchestra.run.smithi155.stdout: "client_addr": "172.21.15.6:0/1709472247", 2023-08-01T19:55:00.509 INFO:teuthology.orchestra.run.smithi155.stdout: "tid": 91111 2023-08-01T19:55:00.509 INFO:teuthology.orchestra.run.smithi155.stdout: }, 2023-08-01T19:55:00.509 INFO:teuthology.orchestra.run.smithi155.stdout: "events": [ 2023-08-01T19:55:00.509 INFO:teuthology.orchestra.run.smithi155.stdout: { 2023-08-01T19:55:00.509 INFO:teuthology.orchestra.run.smithi155.stdout: "event": "initiated", 2023-08-01T19:55:00.509 INFO:teuthology.orchestra.run.smithi155.stdout: "time": "2023-08-01T19:55:00.444914+0000", 2023-08-01T19:55:00.509 INFO:teuthology.orchestra.run.smithi155.stdout: "duration": 0 2023-08-01T19:55:00.509 INFO:teuthology.orchestra.run.smithi155.stdout: }, 2023-08-01T19:55:00.510 INFO:teuthology.orchestra.run.smithi155.stdout: { 2023-08-01T19:55:00.510 INFO:teuthology.orchestra.run.smithi155.stdout: "event": "throttled", 2023-08-01T19:55:00.510 INFO:teuthology.orchestra.run.smithi155.stdout: "time": "2023-08-01T19:55:00.444914+0000", 2023-08-01T19:55:00.510 INFO:teuthology.orchestra.run.smithi155.stdout: "duration": 0 2023-08-01T19:55:00.510 INFO:teuthology.orchestra.run.smithi155.stdout: }, 2023-08-01T19:55:00.510 INFO:teuthology.orchestra.run.smithi155.stdout: { 2023-08-01T19:55:00.510 INFO:teuthology.orchestra.run.smithi155.stdout: "event": "header_read", 2023-08-01T19:55:00.511 INFO:teuthology.orchestra.run.smithi155.stdout: "time": "2023-08-01T19:55:00.444914+0000", 2023-08-01T19:55:00.511 INFO:teuthology.orchestra.run.smithi155.stdout: "duration": 4294967295.9999995 2023-08-01T19:55:00.511 INFO:teuthology.orchestra.run.smithi155.stdout: }, 2023-08-01T19:55:00.511 INFO:teuthology.orchestra.run.smithi155.stdout: { 2023-08-01T19:55:00.511 INFO:teuthology.orchestra.run.smithi155.stdout: "event": "all_read", 2023-08-01T19:55:00.511 INFO:teuthology.orchestra.run.smithi155.stdout: "time": "2023-08-01T19:55:00.445021+0000", 2023-08-01T19:55:00.511 INFO:teuthology.orchestra.run.smithi155.stdout: "duration": 0.000107388 2023-08-01T19:55:00.511 INFO:teuthology.orchestra.run.smithi155.stdout: }, 2023-08-01T19:55:00.512 INFO:teuthology.orchestra.run.smithi155.stdout: { 2023-08-01T19:55:00.512 INFO:teuthology.orchestra.run.smithi155.stdout: "event": "dispatched", 2023-08-01T19:55:00.512 INFO:teuthology.orchestra.run.smithi155.stdout: "time": "2023-08-01T19:55:00.445030+0000", 2023-08-01T19:55:00.512 INFO:teuthology.orchestra.run.smithi155.stdout: "duration": 8.9479999999999997e-06 2023-08-01T19:55:00.512 INFO:teuthology.orchestra.run.smithi155.stdout: }, 2023-08-01T19:55:00.512 INFO:teuthology.orchestra.run.smithi155.stdout: { 2023-08-01T19:55:00.512 INFO:teuthology.orchestra.run.smithi155.stdout: "event": "queued_for_pg", 2023-08-01T19:55:00.512 INFO:teuthology.orchestra.run.smithi155.stdout: "time": "2023-08-01T19:55:00.445035+0000", 2023-08-01T19:55:00.513 INFO:teuthology.orchestra.run.smithi155.stdout: "duration": 4.9790000000000001e-06 2023-08-01T19:55:00.513 INFO:teuthology.orchestra.run.smithi155.stdout: }, 2023-08-01T19:55:00.513 INFO:teuthology.orchestra.run.smithi155.stdout: { 2023-08-01T19:55:00.513 INFO:teuthology.orchestra.run.smithi155.stdout: "event": "reached_pg", 2023-08-01T19:55:00.513 INFO:teuthology.orchestra.run.smithi155.stdout: "time": "2023-08-01T19:55:00.446088+0000", 2023-08-01T19:55:00.513 INFO:teuthology.orchestra.run.smithi155.stdout: "duration": 0.0010528600000000001 2023-08-01T19:55:00.513 INFO:teuthology.orchestra.run.smithi155.stdout: }, 2023-08-01T19:55:00.514 INFO:teuthology.orchestra.run.smithi155.stdout: { 2023-08-01T19:55:00.514 INFO:teuthology.orchestra.run.smithi155.stdout: "event": "started", 2023-08-01T19:55:00.514 INFO:teuthology.orchestra.run.smithi155.stdout: "time": "2023-08-01T19:55:00.446206+0000", 2023-08-01T19:55:00.514 INFO:teuthology.orchestra.run.smithi155.stdout: "duration": 0.000118235 2023-08-01T19:55:00.514 INFO:teuthology.orchestra.run.smithi155.stdout: }, 2023-08-01T19:55:00.514 INFO:teuthology.orchestra.run.smithi155.stdout: { 2023-08-01T19:55:00.514 INFO:teuthology.orchestra.run.smithi155.stdout: "event": "waiting for subops from 0", 2023-08-01T19:55:00.514 INFO:teuthology.orchestra.run.smithi155.stdout: "time": "2023-08-01T19:55:00.446339+0000", 2023-08-01T19:55:00.515 INFO:teuthology.orchestra.run.smithi155.stdout: "duration": 0.000133082 2023-08-01T19:55:00.515 INFO:teuthology.orchestra.run.smithi155.stdout: } 2023-08-01T19:55:00.515 INFO:teuthology.orchestra.run.smithi155.stdout: ] 2023-08-01T19:55:00.515 INFO:teuthology.orchestra.run.smithi155.stdout: } 2023-08-01T19:55:00.515 INFO:teuthology.orchestra.run.smithi155.stdout: }, 2023-08-01T19:55:00.515 INFO:teuthology.orchestra.run.smithi155.stdout: { 2023-08-01T19:55:00.515 INFO:teuthology.orchestra.run.smithi155.stdout: "description": "osd_op(client.4668.0:91112 5.4 5.67921ce4 (undecoded) ondisk+write+known_if_redirected+supports_pool_eio e35)", 2023-08-01T19:55:00.515 INFO:teuthology.orchestra.run.smithi155.stdout: "initiated_at": "2023-08-01T19:55:00.445043+0000", 2023-08-01T19:55:00.516 INFO:teuthology.orchestra.run.smithi155.stdout: "age": 0.001649948, 2023-08-01T19:55:00.516 INFO:teuthology.orchestra.run.smithi155.stdout: "duration": 0.0021137510000000001, 2023-08-01T19:55:00.516 INFO:teuthology.orchestra.run.smithi155.stdout: "type_data": { 2023-08-01T19:55:00.516 INFO:teuthology.orchestra.run.smithi155.stdout: "flag_point": "queued for pg", 2023-08-01T19:55:00.516 INFO:teuthology.orchestra.run.smithi155.stdout: "client_info": { 2023-08-01T19:55:00.516 INFO:teuthology.orchestra.run.smithi155.stdout: "client": "client.4668", 2023-08-01T19:55:00.516 INFO:teuthology.orchestra.run.smithi155.stdout: "client_addr": "172.21.15.6:0/1709472247", 2023-08-01T19:55:00.517 INFO:teuthology.orchestra.run.smithi155.stdout: "tid": 91112 2023-08-01T19:55:00.517 INFO:teuthology.orchestra.run.smithi155.stdout: }, 2023-08-01T19:55:00.517 INFO:teuthology.orchestra.run.smithi155.stdout: "events": [ 2023-08-01T19:55:00.517 INFO:teuthology.orchestra.run.smithi155.stdout: { 2023-08-01T19:55:00.517 INFO:teuthology.orchestra.run.smithi155.stdout: "event": "initiated", 2023-08-01T19:55:00.517 INFO:teuthology.orchestra.run.smithi155.stdout: "time": "2023-08-01T19:55:00.445043+0000", 2023-08-01T19:55:00.517 INFO:teuthology.orchestra.run.smithi155.stdout: "duration": 0 2023-08-01T19:55:00.517 INFO:teuthology.orchestra.run.smithi155.stdout: }, 2023-08-01T19:55:00.518 INFO:teuthology.orchestra.run.smithi155.stdout: { 2023-08-01T19:55:00.518 INFO:teuthology.orchestra.run.smithi155.stdout: "event": "throttled", 2023-08-01T19:55:00.518 INFO:teuthology.orchestra.run.smithi155.stdout: "time": "2023-08-01T19:55:00.445043+0000", 2023-08-01T19:55:00.518 INFO:teuthology.orchestra.run.smithi155.stdout: "duration": 0 2023-08-01T19:55:00.518 INFO:teuthology.orchestra.run.smithi155.stdout: }, 2023-08-01T19:55:00.518 INFO:teuthology.orchestra.run.smithi155.stdout: { 2023-08-01T19:55:00.518 INFO:teuthology.orchestra.run.smithi155.stdout: "event": "header_read", 2023-08-01T19:55:00.518 INFO:teuthology.orchestra.run.smithi155.stdout: "time": "2023-08-01T19:55:00.445043+0000", 2023-08-01T19:55:00.519 INFO:teuthology.orchestra.run.smithi155.stdout: "duration": 4294967295.9999995 2023-08-01T19:55:00.519 INFO:teuthology.orchestra.run.smithi155.stdout: }, 2023-08-01T19:55:00.519 INFO:teuthology.orchestra.run.smithi155.stdout: { 2023-08-01T19:55:00.519 INFO:teuthology.orchestra.run.smithi155.stdout: "event": "all_read", 2023-08-01T19:55:00.519 INFO:teuthology.orchestra.run.smithi155.stdout: "time": "2023-08-01T19:55:00.445135+0000", 2023-08-01T19:55:00.519 INFO:teuthology.orchestra.run.smithi155.stdout: "duration": 9.2517999999999997e-05 2023-08-01T19:55:00.519 INFO:teuthology.orchestra.run.smithi155.stdout: }, 2023-08-01T19:55:00.519 INFO:teuthology.orchestra.run.smithi155.stdout: { 2023-08-01T19:55:00.520 INFO:teuthology.orchestra.run.smithi155.stdout: "event": "dispatched", 2023-08-01T19:55:00.520 INFO:teuthology.orchestra.run.smithi155.stdout: "time": "2023-08-01T19:55:00.445142+0000", 2023-08-01T19:55:00.520 INFO:teuthology.orchestra.run.smithi155.stdout: "duration": 7.2309999999999999e-06 2023-08-01T19:55:00.520 INFO:teuthology.orchestra.run.smithi155.stdout: }, 2023-08-01T19:55:00.520 INFO:teuthology.orchestra.run.smithi155.stdout: { 2023-08-01T19:55:00.520 INFO:teuthology.orchestra.run.smithi155.stdout: "event": "queued_for_pg", 2023-08-01T19:55:00.520 INFO:teuthology.orchestra.run.smithi155.stdout: "time": "2023-08-01T19:55:00.445147+0000", 2023-08-01T19:55:00.521 INFO:teuthology.orchestra.run.smithi155.stdout: "duration": 4.4889999999999997e-06 2023-08-01T19:55:00.521 INFO:teuthology.orchestra.run.smithi155.stdout: } 2023-08-01T19:55:00.521 INFO:teuthology.orchestra.run.smithi155.stdout: ] 2023-08-01T19:55:00.521 INFO:teuthology.orchestra.run.smithi155.stdout: } 2023-08-01T19:55:00.521 INFO:teuthology.orchestra.run.smithi155.stdout: }, 2023-08-01T19:55:00.521 INFO:teuthology.orchestra.run.smithi155.stdout: { 2023-08-01T19:55:00.521 INFO:teuthology.orchestra.run.smithi155.stdout: "description": "osd_op(client.4668.0:91114 5.e 5:75b1a414:::benchmark_data_smithi006_114134_object91113:head [set-alloc-hint object_size 65536 write_size 65536,write 0~65536 in=65536b] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e35)", 2023-08-01T19:55:00.521 INFO:teuthology.orchestra.run.smithi155.stdout: "initiated_at": "2023-08-01T19:55:00.445152+0000", 2023-08-01T19:55:00.522 INFO:teuthology.orchestra.run.smithi155.stdout: "age": 0.0015408010000000001, 2023-08-01T19:55:00.522 INFO:teuthology.orchestra.run.smithi155.stdout: "duration": 0.002063521, 2023-08-01T19:55:00.522 INFO:teuthology.orchestra.run.smithi155.stdout: "type_data": { 2023-08-01T19:55:00.522 INFO:teuthology.orchestra.run.smithi155.stdout: "flag_point": "waiting for sub ops", 2023-08-01T19:55:00.522 INFO:teuthology.orchestra.run.smithi155.stdout: "client_info": { 2023-08-01T19:55:00.522 INFO:teuthology.orchestra.run.smithi155.stdout: "client": "client.4668", 2023-08-01T19:55:00.522 INFO:teuthology.orchestra.run.smithi155.stdout: "client_addr": "172.21.15.6:0/1709472247", 2023-08-01T19:55:00.522 INFO:teuthology.orchestra.run.smithi155.stdout: "tid": 91114 2023-08-01T19:55:00.523 INFO:teuthology.orchestra.run.smithi155.stdout: }, 2023-08-01T19:55:00.523 INFO:teuthology.orchestra.run.smithi155.stdout: "events": [ 2023-08-01T19:55:00.523 INFO:teuthology.orchestra.run.smithi155.stdout: { 2023-08-01T19:55:00.523 INFO:teuthology.orchestra.run.smithi155.stdout: "event": "initiated", 2023-08-01T19:55:00.523 INFO:teuthology.orchestra.run.smithi155.stdout: "time": "2023-08-01T19:55:00.445152+0000", 2023-08-01T19:55:00.523 INFO:teuthology.orchestra.run.smithi155.stdout: "duration": 0 2023-08-01T19:55:00.523 INFO:teuthology.orchestra.run.smithi155.stdout: }, 2023-08-01T19:55:00.523 INFO:teuthology.orchestra.run.smithi155.stdout: { 2023-08-01T19:55:00.524 INFO:teuthology.orchestra.run.smithi155.stdout: "event": "throttled", 2023-08-01T19:55:00.524 INFO:teuthology.orchestra.run.smithi155.stdout: "time": "2023-08-01T19:55:00.445152+0000", 2023-08-01T19:55:00.524 INFO:teuthology.orchestra.run.smithi155.stdout: "duration": 0 2023-08-01T19:55:00.524 INFO:teuthology.orchestra.run.smithi155.stdout: }, 2023-08-01T19:55:00.524 INFO:teuthology.orchestra.run.smithi155.stdout: { 2023-08-01T19:55:00.524 INFO:teuthology.orchestra.run.smithi155.stdout: "event": "header_read", 2023-08-01T19:55:00.524 INFO:teuthology.orchestra.run.smithi155.stdout: "time": "2023-08-01T19:55:00.445152+0000", 2023-08-01T19:55:00.525 INFO:teuthology.orchestra.run.smithi155.stdout: "duration": 4294967295.9999995 2023-08-01T19:55:00.525 INFO:teuthology.orchestra.run.smithi155.stdout: }, 2023-08-01T19:55:00.525 INFO:teuthology.orchestra.run.smithi155.stdout: { 2023-08-01T19:55:00.525 INFO:teuthology.orchestra.run.smithi155.stdout: "event": "all_read", 2023-08-01T19:55:00.525 INFO:teuthology.orchestra.run.smithi155.stdout: "time": "2023-08-01T19:55:00.445272+0000", 2023-08-01T19:55:00.525 INFO:teuthology.orchestra.run.smithi155.stdout: "duration": 0.000120208 2023-08-01T19:55:00.525 INFO:teuthology.orchestra.run.smithi155.stdout: }, 2023-08-01T19:55:00.526 INFO:teuthology.orchestra.run.smithi155.stdout: { 2023-08-01T19:55:00.526 INFO:teuthology.orchestra.run.smithi155.stdout: "event": "dispatched", 2023-08-01T19:55:00.526 INFO:teuthology.orchestra.run.smithi155.stdout: "time": "2023-08-01T19:55:00.445281+0000", 2023-08-01T19:55:00.526 INFO:teuthology.orchestra.run.smithi155.stdout: "duration": 9.3680000000000008e-06 2023-08-01T19:55:00.526 INFO:teuthology.orchestra.run.smithi155.stdout: }, 2023-08-01T19:55:00.526 INFO:teuthology.orchestra.run.smithi155.stdout: { 2023-08-01T19:55:00.526 INFO:teuthology.orchestra.run.smithi155.stdout: "event": "queued_for_pg", 2023-08-01T19:55:00.526 INFO:teuthology.orchestra.run.smithi155.stdout: "time": "2023-08-01T19:55:00.445287+0000", 2023-08-01T19:55:00.527 INFO:teuthology.orchestra.run.smithi155.stdout: "duration": 5.1039999999999998e-06 2023-08-01T19:55:00.527 INFO:teuthology.orchestra.run.smithi155.stdout: }, 2023-08-01T19:55:00.527 INFO:teuthology.orchestra.run.smithi155.stdout: { 2023-08-01T19:55:00.527 INFO:teuthology.orchestra.run.smithi155.stdout: "event": "reached_pg", 2023-08-01T19:55:00.527 INFO:teuthology.orchestra.run.smithi155.stdout: "time": "2023-08-01T19:55:00.445324+0000", 2023-08-01T19:55:00.527 INFO:teuthology.orchestra.run.smithi155.stdout: "duration": 3.7217e-05 2023-08-01T19:55:00.527 INFO:teuthology.orchestra.run.smithi155.stdout: }, 2023-08-01T19:55:00.527 INFO:teuthology.orchestra.run.smithi155.stdout: { 2023-08-01T19:55:00.528 INFO:teuthology.orchestra.run.smithi155.stdout: "event": "started", 2023-08-01T19:55:00.528 INFO:teuthology.orchestra.run.smithi155.stdout: "time": "2023-08-01T19:55:00.445408+0000", 2023-08-01T19:55:00.528 INFO:teuthology.orchestra.run.smithi155.stdout: "duration": 8.4660000000000006e-05 2023-08-01T19:55:00.528 INFO:teuthology.orchestra.run.smithi155.stdout: }, 2023-08-01T19:55:00.528 INFO:teuthology.orchestra.run.smithi155.stdout: { 2023-08-01T19:55:00.528 INFO:teuthology.orchestra.run.smithi155.stdout: "event": "waiting for subops from 0", 2023-08-01T19:55:00.528 INFO:teuthology.orchestra.run.smithi155.stdout: "time": "2023-08-01T19:55:00.445489+0000", 2023-08-01T19:55:00.529 INFO:teuthology.orchestra.run.smithi155.stdout: "duration": 8.0220000000000001e-05 2023-08-01T19:55:00.529 INFO:teuthology.orchestra.run.smithi155.stdout: } 2023-08-01T19:55:00.529 INFO:teuthology.orchestra.run.smithi155.stdout: ] 2023-08-01T19:55:00.529 INFO:teuthology.orchestra.run.smithi155.stdout: } 2023-08-01T19:55:00.529 INFO:teuthology.orchestra.run.smithi155.stdout: }, 2023-08-01T19:55:00.529 INFO:teuthology.orchestra.run.smithi155.stdout: { 2023-08-01T19:55:00.529 INFO:teuthology.orchestra.run.smithi155.stdout: "description": "osd_repop_reply(client.4668.0:91100 5.d e35/19 ondisk, result = 0)", 2023-08-01T19:55:00.529 INFO:teuthology.orchestra.run.smithi155.stdout: "initiated_at": "2023-08-01T19:55:00.447168+0000", 2023-08-01T19:55:00.530 INFO:teuthology.orchestra.run.smithi155.stdout: "age": 4294967295.9995255, 2023-08-01T19:55:00.530 INFO:teuthology.orchestra.run.smithi155.stdout: "duration": 0.00012851599999999999, 2023-08-01T19:55:00.530 INFO:teuthology.orchestra.run.smithi155.stdout: "type_data": { 2023-08-01T19:55:00.530 INFO:teuthology.orchestra.run.smithi155.stdout: "flag_point": "started", 2023-08-01T19:55:00.530 INFO:teuthology.orchestra.run.smithi155.stdout: "events": [ 2023-08-01T19:55:00.530 INFO:teuthology.orchestra.run.smithi155.stdout: { 2023-08-01T19:55:00.530 INFO:teuthology.orchestra.run.smithi155.stdout: "event": "initiated", 2023-08-01T19:55:00.530 INFO:teuthology.orchestra.run.smithi155.stdout: "time": "2023-08-01T19:55:00.447168+0000", 2023-08-01T19:55:00.531 INFO:teuthology.orchestra.run.smithi155.stdout: "duration": 0 2023-08-01T19:55:00.531 INFO:teuthology.orchestra.run.smithi155.stdout: }, 2023-08-01T19:55:00.531 INFO:teuthology.orchestra.run.smithi155.stdout: { 2023-08-01T19:55:00.531 INFO:teuthology.orchestra.run.smithi155.stdout: "event": "throttled", 2023-08-01T19:55:00.531 INFO:teuthology.orchestra.run.smithi155.stdout: "time": "2023-08-01T19:55:00.447168+0000", 2023-08-01T19:55:00.531 INFO:teuthology.orchestra.run.smithi155.stdout: "duration": 0 2023-08-01T19:55:00.531 INFO:teuthology.orchestra.run.smithi155.stdout: }, 2023-08-01T19:55:00.531 INFO:teuthology.orchestra.run.smithi155.stdout: { 2023-08-01T19:55:00.532 INFO:teuthology.orchestra.run.smithi155.stdout: "event": "header_read", 2023-08-01T19:55:00.532 INFO:teuthology.orchestra.run.smithi155.stdout: "time": "2023-08-01T19:55:00.447167+0000", 2023-08-01T19:55:00.532 INFO:teuthology.orchestra.run.smithi155.stdout: "duration": 4294967295.9999995 2023-08-01T19:55:00.532 INFO:teuthology.orchestra.run.smithi155.stdout: }, 2023-08-01T19:55:00.532 INFO:teuthology.orchestra.run.smithi155.stdout: { 2023-08-01T19:55:00.532 INFO:teuthology.orchestra.run.smithi155.stdout: "event": "all_read", 2023-08-01T19:55:00.532 INFO:teuthology.orchestra.run.smithi155.stdout: "time": "2023-08-01T19:55:00.447172+0000", 2023-08-01T19:55:00.533 INFO:teuthology.orchestra.run.smithi155.stdout: "duration": 5.0930000000000002e-06 2023-08-01T19:55:00.533 INFO:teuthology.orchestra.run.smithi155.stdout: }, 2023-08-01T19:55:00.533 INFO:teuthology.orchestra.run.smithi155.stdout: { 2023-08-01T19:55:00.533 INFO:teuthology.orchestra.run.smithi155.stdout: "event": "dispatched", 2023-08-01T19:55:00.533 INFO:teuthology.orchestra.run.smithi155.stdout: "time": "2023-08-01T19:55:00.447186+0000", 2023-08-01T19:55:00.533 INFO:teuthology.orchestra.run.smithi155.stdout: "duration": 1.3844e-05 2023-08-01T19:55:00.533 INFO:teuthology.orchestra.run.smithi155.stdout: }, 2023-08-01T19:55:00.533 INFO:teuthology.orchestra.run.smithi155.stdout: { 2023-08-01T19:55:00.534 INFO:teuthology.orchestra.run.smithi155.stdout: "event": "queued_for_pg", 2023-08-01T19:55:00.534 INFO:teuthology.orchestra.run.smithi155.stdout: "time": "2023-08-01T19:55:00.447190+0000", 2023-08-01T19:55:00.534 INFO:teuthology.orchestra.run.smithi155.stdout: "duration": 4.2019999999999997e-06 2023-08-01T19:55:00.534 INFO:teuthology.orchestra.run.smithi155.stdout: }, 2023-08-01T19:55:00.534 INFO:teuthology.orchestra.run.smithi155.stdout: { 2023-08-01T19:55:00.534 INFO:teuthology.orchestra.run.smithi155.stdout: "event": "reached_pg", 2023-08-01T19:55:00.534 INFO:teuthology.orchestra.run.smithi155.stdout: "time": "2023-08-01T19:55:00.447223+0000", 2023-08-01T19:55:00.534 INFO:teuthology.orchestra.run.smithi155.stdout: "duration": 3.3219000000000002e-05 2023-08-01T19:55:00.535 INFO:teuthology.orchestra.run.smithi155.stdout: }, 2023-08-01T19:55:00.535 INFO:teuthology.orchestra.run.smithi155.stdout: { 2023-08-01T19:55:00.535 INFO:teuthology.orchestra.run.smithi155.stdout: "event": "started", 2023-08-01T19:55:00.535 INFO:teuthology.orchestra.run.smithi155.stdout: "time": "2023-08-01T19:55:00.447230+0000", 2023-08-01T19:55:00.535 INFO:teuthology.orchestra.run.smithi155.stdout: "duration": 6.8399999999999997e-06 2023-08-01T19:55:00.535 INFO:teuthology.orchestra.run.smithi155.stdout: } 2023-08-01T19:55:00.535 INFO:teuthology.orchestra.run.smithi155.stdout: ] 2023-08-01T19:55:00.536 INFO:teuthology.orchestra.run.smithi155.stdout: } 2023-08-01T19:55:00.536 INFO:teuthology.orchestra.run.smithi155.stdout: } 2023-08-01T19:55:00.536 INFO:teuthology.orchestra.run.smithi155.stdout: ], 2023-08-01T19:55:00.536 INFO:teuthology.orchestra.run.smithi155.stdout: "num_ops": 11 2023-08-01T19:55:00.536 INFO:teuthology.orchestra.run.smithi155.stdout:} 2023-08-01T19:55:00.537 DEBUG:teuthology.orchestra.run.smithi155:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 30 ceph --cluster ceph --admin-daemon /var/run/ceph/ceph-osd.2.asok dump_blocked_ops 2023-08-01T19:55:00.538 INFO:tasks.ceph.osd.2.smithi155.stderr:2023-08-01T19:55:00.535+0000 7faa5c6ac700 -1 received signal: Hangup from /usr/bin/python3 /bin/daemon-helper kill ceph-osd -f --cluster ceph -i 2 (PID: 111337) UID: 0 2023-08-01T19:55:00.638 INFO:tasks.ceph.osd.1.smithi101.stderr:2023-08-01T19:55:00.636+0000 7fb0cb7f6700 -1 received signal: Hangup from /usr/bin/python3 /bin/daemon-helper kill ceph-osd -f --cluster ceph -i 1 (PID: 111141) UID: 0 2023-08-01T19:55:00.738 INFO:tasks.ceph.osd.1.smithi101.stderr:2023-08-01T19:55:00.737+0000 7fb0cb7f6700 -1 received signal: Hangup from /usr/bin/python3 /bin/daemon-helper kill ceph-osd -f --cluster ceph -i 1 (PID: 111141) UID: 0 2023-08-01T19:55:00.747 INFO:teuthology.orchestra.run.smithi155.stdout:{ 2023-08-01T19:55:00.747 INFO:teuthology.orchestra.run.smithi155.stdout: "ops": [], 2023-08-01T19:55:00.748 INFO:teuthology.orchestra.run.smithi155.stdout: "complaint_time": 30, 2023-08-01T19:55:00.748 INFO:teuthology.orchestra.run.smithi155.stdout: "num_blocked_ops": 0 2023-08-01T19:55:00.748 INFO:teuthology.orchestra.run.smithi155.stdout:} 2023-08-01T19:55:00.761 DEBUG:teuthology.orchestra.run.smithi155:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 30 ceph --cluster ceph --admin-daemon /var/run/ceph/ceph-osd.2.asok dump_historic_ops 2023-08-01T19:55:00.839 INFO:tasks.ceph.osd.0.smithi008.stderr:2023-08-01T19:55:00.838+0000 7f16a58f4700 -1 received signal: Hangup from /usr/bin/python3 /bin/daemon-helper kill ceph-osd -f --cluster ceph -i 0 (PID: 111179) UID: 0 2023-08-01T19:55:00.937 INFO:teuthology.orchestra.run.smithi155.stdout:{ 2023-08-01T19:55:00.937 INFO:teuthology.orchestra.run.smithi155.stdout: "size": 20, 2023-08-01T19:55:00.938 INFO:teuthology.orchestra.run.smithi155.stdout: "duration": 600, 2023-08-01T19:55:00.938 INFO:teuthology.orchestra.run.smithi155.stdout: "ops": [ 2023-08-01T19:55:00.938 INFO:teuthology.orchestra.run.smithi155.stdout: { 2023-08-01T19:55:00.938 INFO:teuthology.orchestra.run.smithi155.stdout: "description": "osd_op(client.4668.0:61802 5.b 5:dcfcf99c:::benchmark_data_smithi006_114134_object61801:head [set-alloc-hint object_size 65536 write_size 65536,write 0~65536] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e29)", 2023-08-01T19:55:00.938 INFO:teuthology.orchestra.run.smithi155.stdout: "initiated_at": "2023-08-01T19:54:45.742720+0000", 2023-08-01T19:55:00.938 INFO:teuthology.orchestra.run.smithi155.stdout: "age": 15.191461543999999, 2023-08-01T19:55:00.938 INFO:teuthology.orchestra.run.smithi155.stdout: "duration": 0.017797548999999999, 2023-08-01T19:55:00.939 INFO:teuthology.orchestra.run.smithi155.stdout: "type_data": { 2023-08-01T19:55:00.939 INFO:teuthology.orchestra.run.smithi155.stdout: "flag_point": "commit sent; apply or cleanup", 2023-08-01T19:55:00.939 INFO:teuthology.orchestra.run.smithi155.stdout: "client_info": { 2023-08-01T19:55:00.939 INFO:teuthology.orchestra.run.smithi155.stdout: "client": "client.4668", 2023-08-01T19:55:00.939 INFO:teuthology.orchestra.run.smithi155.stdout: "client_addr": "172.21.15.6:0/1709472247", 2023-08-01T19:55:00.939 INFO:teuthology.orchestra.run.smithi155.stdout: "tid": 61802 2023-08-01T19:55:00.939 INFO:teuthology.orchestra.run.smithi155.stdout: }, 2023-08-01T19:55:00.939 INFO:teuthology.orchestra.run.smithi155.stdout: "events": [ 2023-08-01T19:55:00.940 INFO:teuthology.orchestra.run.smithi155.stdout: { 2023-08-01T19:55:00.940 INFO:teuthology.orchestra.run.smithi155.stdout: "event": "initiated", 2023-08-01T19:55:00.940 INFO:teuthology.orchestra.run.smithi155.stdout: "time": "2023-08-01T19:54:45.742720+0000", 2023-08-01T19:55:00.940 INFO:teuthology.orchestra.run.smithi155.stdout: "duration": 0 2023-08-01T19:55:00.940 INFO:teuthology.orchestra.run.smithi155.stdout: }, 2023-08-01T19:55:00.940 INFO:teuthology.orchestra.run.smithi155.stdout: { 2023-08-01T19:55:00.940 INFO:teuthology.orchestra.run.smithi155.stdout: "event": "throttled", 2023-08-01T19:55:00.941 INFO:teuthology.orchestra.run.smithi155.stdout: "time": "2023-08-01T19:54:45.742720+0000", 2023-08-01T19:55:00.941 INFO:teuthology.orchestra.run.smithi155.stdout: "duration": 0 2023-08-01T19:55:00.941 INFO:teuthology.orchestra.run.smithi155.stdout: }, 2023-08-01T19:55:00.941 INFO:teuthology.orchestra.run.smithi155.stdout: { 2023-08-01T19:55:00.941 INFO:teuthology.orchestra.run.smithi155.stdout: "event": "header_read", 2023-08-01T19:55:00.941 INFO:teuthology.orchestra.run.smithi155.stdout: "time": "2023-08-01T19:54:45.742720+0000", 2023-08-01T19:55:00.941 INFO:teuthology.orchestra.run.smithi155.stdout: "duration": 4294967295.9999995 2023-08-01T19:55:00.942 INFO:teuthology.orchestra.run.smithi155.stdout: }, 2023-08-01T19:55:00.942 INFO:teuthology.orchestra.run.smithi155.stdout: { 2023-08-01T19:55:00.942 INFO:teuthology.orchestra.run.smithi155.stdout: "event": "all_read", 2023-08-01T19:55:00.942 INFO:teuthology.orchestra.run.smithi155.stdout: "time": "2023-08-01T19:54:45.742747+0000", 2023-08-01T19:55:00.942 INFO:teuthology.orchestra.run.smithi155.stdout: "duration": 2.7713e-05 2023-08-01T19:55:00.942 INFO:teuthology.orchestra.run.smithi155.stdout: }, 2023-08-01T19:55:00.942 INFO:teuthology.orchestra.run.smithi155.stdout: { 2023-08-01T19:55:00.943 INFO:teuthology.orchestra.run.smithi155.stdout: "event": "dispatched", 2023-08-01T19:55:00.943 INFO:teuthology.orchestra.run.smithi155.stdout: "time": "2023-08-01T19:54:45.742752+0000", 2023-08-01T19:55:00.943 INFO:teuthology.orchestra.run.smithi155.stdout: "duration": 4.8080000000000004e-06 2023-08-01T19:55:00.943 INFO:teuthology.orchestra.run.smithi155.stdout: }, 2023-08-01T19:55:00.943 INFO:teuthology.orchestra.run.smithi155.stdout: { 2023-08-01T19:55:00.943 INFO:teuthology.orchestra.run.smithi155.stdout: "event": "queued_for_pg", 2023-08-01T19:55:00.943 INFO:teuthology.orchestra.run.smithi155.stdout: "time": "2023-08-01T19:54:45.742757+0000", 2023-08-01T19:55:00.944 INFO:teuthology.orchestra.run.smithi155.stdout: "duration": 4.5220000000000001e-06 2023-08-01T19:55:00.944 INFO:teuthology.orchestra.run.smithi155.stdout: }, 2023-08-01T19:55:00.944 INFO:teuthology.orchestra.run.smithi155.stdout: { 2023-08-01T19:55:00.944 INFO:teuthology.orchestra.run.smithi155.stdout: "event": "reached_pg", 2023-08-01T19:55:00.944 INFO:teuthology.orchestra.run.smithi155.stdout: "time": "2023-08-01T19:54:45.744448+0000", 2023-08-01T19:55:00.944 INFO:teuthology.orchestra.run.smithi155.stdout: "duration": 0.0016914600000000001 2023-08-01T19:55:00.945 INFO:teuthology.orchestra.run.smithi155.stdout: }, 2023-08-01T19:55:00.945 INFO:teuthology.orchestra.run.smithi155.stdout: { 2023-08-01T19:55:00.945 INFO:teuthology.orchestra.run.smithi155.stdout: "event": "started", 2023-08-01T19:55:00.945 INFO:teuthology.orchestra.run.smithi155.stdout: "time": "2023-08-01T19:54:45.744538+0000", 2023-08-01T19:55:00.945 INFO:teuthology.orchestra.run.smithi155.stdout: "duration": 8.9615000000000002e-05 2023-08-01T19:55:00.945 INFO:teuthology.orchestra.run.smithi155.stdout: }, 2023-08-01T19:55:00.945 INFO:teuthology.orchestra.run.smithi155.stdout: { 2023-08-01T19:55:00.946 INFO:teuthology.orchestra.run.smithi155.stdout: "event": "waiting for subops from 0", 2023-08-01T19:55:00.946 INFO:teuthology.orchestra.run.smithi155.stdout: "time": "2023-08-01T19:54:45.744620+0000", 2023-08-01T19:55:00.946 INFO:teuthology.orchestra.run.smithi155.stdout: "duration": 8.1681000000000006e-05 2023-08-01T19:55:00.946 INFO:teuthology.orchestra.run.smithi155.stdout: }, 2023-08-01T19:55:00.946 INFO:teuthology.orchestra.run.smithi155.stdout: { 2023-08-01T19:55:00.946 INFO:teuthology.orchestra.run.smithi155.stdout: "event": "op_commit", 2023-08-01T19:55:00.946 INFO:teuthology.orchestra.run.smithi155.stdout: "time": "2023-08-01T19:54:45.746954+0000", 2023-08-01T19:55:00.946 INFO:teuthology.orchestra.run.smithi155.stdout: "duration": 0.0023339490000000001 2023-08-01T19:55:00.947 INFO:teuthology.orchestra.run.smithi155.stdout: }, 2023-08-01T19:55:00.947 INFO:teuthology.orchestra.run.smithi155.stdout: { 2023-08-01T19:55:00.947 INFO:teuthology.orchestra.run.smithi155.stdout: "event": "sub_op_commit_rec", 2023-08-01T19:55:00.947 INFO:teuthology.orchestra.run.smithi155.stdout: "time": "2023-08-01T19:54:45.760465+0000", 2023-08-01T19:55:00.947 INFO:teuthology.orchestra.run.smithi155.stdout: "duration": 0.013511861 2023-08-01T19:55:00.947 INFO:teuthology.orchestra.run.smithi155.stdout: }, 2023-08-01T19:55:00.947 INFO:teuthology.orchestra.run.smithi155.stdout: { 2023-08-01T19:55:00.947 INFO:teuthology.orchestra.run.smithi155.stdout: "event": "commit_sent", 2023-08-01T19:55:00.948 INFO:teuthology.orchestra.run.smithi155.stdout: "time": "2023-08-01T19:54:45.760494+0000", 2023-08-01T19:55:00.948 INFO:teuthology.orchestra.run.smithi155.stdout: "duration": 2.9025000000000001e-05 2023-08-01T19:55:00.948 INFO:teuthology.orchestra.run.smithi155.stdout: }, 2023-08-01T19:55:00.948 INFO:teuthology.orchestra.run.smithi155.stdout: { 2023-08-01T19:55:00.948 INFO:teuthology.orchestra.run.smithi155.stdout: "event": "done", 2023-08-01T19:55:00.948 INFO:teuthology.orchestra.run.smithi155.stdout: "time": "2023-08-01T19:54:45.760518+0000", 2023-08-01T19:55:00.948 INFO:teuthology.orchestra.run.smithi155.stdout: "duration": 2.3269e-05 2023-08-01T19:55:00.949 INFO:teuthology.orchestra.run.smithi155.stdout: } 2023-08-01T19:55:00.949 INFO:teuthology.orchestra.run.smithi155.stdout: ] 2023-08-01T19:55:00.949 INFO:teuthology.orchestra.run.smithi155.stdout: } 2023-08-01T19:55:00.949 INFO:teuthology.orchestra.run.smithi155.stdout: }, 2023-08-01T19:55:00.949 INFO:teuthology.orchestra.run.smithi155.stdout: { 2023-08-01T19:55:00.949 INFO:teuthology.orchestra.run.smithi155.stdout: "description": "osd_op(client.4668.0:66162 5.b 5:d2306600:::benchmark_data_smithi006_114134_object66161:head [set-alloc-hint object_size 65536 write_size 65536,write 0~65536] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e29)", 2023-08-01T19:55:00.949 INFO:teuthology.orchestra.run.smithi155.stdout: "initiated_at": "2023-08-01T19:54:47.818865+0000", 2023-08-01T19:55:00.949 INFO:teuthology.orchestra.run.smithi155.stdout: "age": 13.115317096, 2023-08-01T19:55:00.950 INFO:teuthology.orchestra.run.smithi155.stdout: "duration": 0.016254494000000001, 2023-08-01T19:55:00.950 INFO:teuthology.orchestra.run.smithi155.stdout: "type_data": { 2023-08-01T19:55:00.950 INFO:teuthology.orchestra.run.smithi155.stdout: "flag_point": "commit sent; apply or cleanup", 2023-08-01T19:55:00.950 INFO:teuthology.orchestra.run.smithi155.stdout: "client_info": { 2023-08-01T19:55:00.950 INFO:teuthology.orchestra.run.smithi155.stdout: "client": "client.4668", 2023-08-01T19:55:00.950 INFO:teuthology.orchestra.run.smithi155.stdout: "client_addr": "172.21.15.6:0/1709472247", 2023-08-01T19:55:00.950 INFO:teuthology.orchestra.run.smithi155.stdout: "tid": 66162 2023-08-01T19:55:00.951 INFO:teuthology.orchestra.run.smithi155.stdout: }, 2023-08-01T19:55:00.951 INFO:teuthology.orchestra.run.smithi155.stdout: "events": [ 2023-08-01T19:55:00.951 INFO:teuthology.orchestra.run.smithi155.stdout: { 2023-08-01T19:55:00.951 INFO:teuthology.orchestra.run.smithi155.stdout: "event": "initiated", 2023-08-01T19:55:00.951 INFO:teuthology.orchestra.run.smithi155.stdout: "time": "2023-08-01T19:54:47.818865+0000", 2023-08-01T19:55:00.951 INFO:teuthology.orchestra.run.smithi155.stdout: "duration": 0 2023-08-01T19:55:00.951 INFO:teuthology.orchestra.run.smithi155.stdout: }, 2023-08-01T19:55:00.952 INFO:teuthology.orchestra.run.smithi155.stdout: { 2023-08-01T19:55:00.952 INFO:teuthology.orchestra.run.smithi155.stdout: "event": "throttled", 2023-08-01T19:55:00.952 INFO:teuthology.orchestra.run.smithi155.stdout: "time": "2023-08-01T19:54:47.818865+0000", 2023-08-01T19:55:00.952 INFO:teuthology.orchestra.run.smithi155.stdout: "duration": 0 2023-08-01T19:55:00.952 INFO:teuthology.orchestra.run.smithi155.stdout: }, 2023-08-01T19:55:00.952 INFO:teuthology.orchestra.run.smithi155.stdout: { 2023-08-01T19:55:00.952 INFO:teuthology.orchestra.run.smithi155.stdout: "event": "header_read", 2023-08-01T19:55:00.953 INFO:teuthology.orchestra.run.smithi155.stdout: "time": "2023-08-01T19:54:47.818864+0000", 2023-08-01T19:55:00.953 INFO:teuthology.orchestra.run.smithi155.stdout: "duration": 4294967295.9999995 2023-08-01T19:55:00.953 INFO:teuthology.orchestra.run.smithi155.stdout: }, 2023-08-01T19:55:00.953 INFO:teuthology.orchestra.run.smithi155.stdout: { 2023-08-01T19:55:00.953 INFO:teuthology.orchestra.run.smithi155.stdout: "event": "all_read", 2023-08-01T19:55:00.953 INFO:teuthology.orchestra.run.smithi155.stdout: "time": "2023-08-01T19:54:47.818944+0000", 2023-08-01T19:55:00.953 INFO:teuthology.orchestra.run.smithi155.stdout: "duration": 8.0112999999999997e-05 2023-08-01T19:55:00.953 INFO:teuthology.orchestra.run.smithi155.stdout: }, 2023-08-01T19:55:00.954 INFO:teuthology.orchestra.run.smithi155.stdout: { 2023-08-01T19:55:00.954 INFO:teuthology.orchestra.run.smithi155.stdout: "event": "dispatched", 2023-08-01T19:55:00.954 INFO:teuthology.orchestra.run.smithi155.stdout: "time": "2023-08-01T19:54:47.818951+0000", 2023-08-01T19:55:00.954 INFO:teuthology.orchestra.run.smithi155.stdout: "duration": 6.7360000000000004e-06 2023-08-01T19:55:00.954 INFO:teuthology.orchestra.run.smithi155.stdout: }, 2023-08-01T19:55:00.954 INFO:teuthology.orchestra.run.smithi155.stdout: { 2023-08-01T19:55:00.954 INFO:teuthology.orchestra.run.smithi155.stdout: "event": "queued_for_pg", 2023-08-01T19:55:00.954 INFO:teuthology.orchestra.run.smithi155.stdout: "time": "2023-08-01T19:54:47.818954+0000", 2023-08-01T19:55:00.955 INFO:teuthology.orchestra.run.smithi155.stdout: "duration": 2.9550000000000001e-06 2023-08-01T19:55:00.955 INFO:teuthology.orchestra.run.smithi155.stdout: }, 2023-08-01T19:55:00.955 INFO:teuthology.orchestra.run.smithi155.stdout: { 2023-08-01T19:55:00.955 INFO:teuthology.orchestra.run.smithi155.stdout: "event": "reached_pg", 2023-08-01T19:55:00.955 INFO:teuthology.orchestra.run.smithi155.stdout: "time": "2023-08-01T19:54:47.820967+0000", 2023-08-01T19:55:00.955 INFO:teuthology.orchestra.run.smithi155.stdout: "duration": 0.0020131659999999998 2023-08-01T19:55:00.955 INFO:teuthology.orchestra.run.smithi155.stdout: }, 2023-08-01T19:55:00.955 INFO:teuthology.orchestra.run.smithi155.stdout: { 2023-08-01T19:55:00.956 INFO:teuthology.orchestra.run.smithi155.stdout: "event": "started", 2023-08-01T19:55:00.956 INFO:teuthology.orchestra.run.smithi155.stdout: "time": "2023-08-01T19:54:47.821043+0000", 2023-08-01T19:55:00.956 INFO:teuthology.orchestra.run.smithi155.stdout: "duration": 7.5706999999999999e-05 2023-08-01T19:55:00.956 INFO:teuthology.orchestra.run.smithi155.stdout: }, 2023-08-01T19:55:00.956 INFO:teuthology.orchestra.run.smithi155.stdout: { 2023-08-01T19:55:00.956 INFO:teuthology.orchestra.run.smithi155.stdout: "event": "waiting for subops from 0", 2023-08-01T19:55:00.956 INFO:teuthology.orchestra.run.smithi155.stdout: "time": "2023-08-01T19:54:47.821128+0000", 2023-08-01T19:55:00.957 INFO:teuthology.orchestra.run.smithi155.stdout: "duration": 8.5628000000000001e-05 2023-08-01T19:55:00.957 INFO:teuthology.orchestra.run.smithi155.stdout: }, 2023-08-01T19:55:00.957 INFO:teuthology.orchestra.run.smithi155.stdout: { 2023-08-01T19:55:00.957 INFO:teuthology.orchestra.run.smithi155.stdout: "event": "op_commit", 2023-08-01T19:55:00.957 INFO:teuthology.orchestra.run.smithi155.stdout: "time": "2023-08-01T19:54:47.824340+0000", 2023-08-01T19:55:00.957 INFO:teuthology.orchestra.run.smithi155.stdout: "duration": 0.0032116750000000002 2023-08-01T19:55:00.957 INFO:teuthology.orchestra.run.smithi155.stdout: }, 2023-08-01T19:55:00.957 INFO:teuthology.orchestra.run.smithi155.stdout: { 2023-08-01T19:55:00.958 INFO:teuthology.orchestra.run.smithi155.stdout: "event": "sub_op_commit_rec", 2023-08-01T19:55:00.958 INFO:teuthology.orchestra.run.smithi155.stdout: "time": "2023-08-01T19:54:47.835051+0000", 2023-08-01T19:55:00.958 INFO:teuthology.orchestra.run.smithi155.stdout: "duration": 0.010711299000000001 2023-08-01T19:55:00.958 INFO:teuthology.orchestra.run.smithi155.stdout: }, 2023-08-01T19:55:00.958 INFO:teuthology.orchestra.run.smithi155.stdout: { 2023-08-01T19:55:00.958 INFO:teuthology.orchestra.run.smithi155.stdout: "event": "commit_sent", 2023-08-01T19:55:00.958 INFO:teuthology.orchestra.run.smithi155.stdout: "time": "2023-08-01T19:54:47.835094+0000", 2023-08-01T19:55:00.959 INFO:teuthology.orchestra.run.smithi155.stdout: "duration": 4.2410000000000002e-05 2023-08-01T19:55:00.959 INFO:teuthology.orchestra.run.smithi155.stdout: }, 2023-08-01T19:55:00.959 INFO:teuthology.orchestra.run.smithi155.stdout: { 2023-08-01T19:55:00.959 INFO:teuthology.orchestra.run.smithi155.stdout: "event": "done", 2023-08-01T19:55:00.959 INFO:teuthology.orchestra.run.smithi155.stdout: "time": "2023-08-01T19:54:47.835119+0000", 2023-08-01T19:55:00.959 INFO:teuthology.orchestra.run.smithi155.stdout: "duration": 2.5401e-05 2023-08-01T19:55:00.959 INFO:teuthology.orchestra.run.smithi155.stdout: } 2023-08-01T19:55:00.959 INFO:teuthology.orchestra.run.smithi155.stdout: ] 2023-08-01T19:55:00.960 INFO:teuthology.orchestra.run.smithi155.stdout: } 2023-08-01T19:55:00.960 INFO:teuthology.orchestra.run.smithi155.stdout: }, 2023-08-01T19:55:00.960 INFO:teuthology.orchestra.run.smithi155.stdout: { 2023-08-01T19:55:00.960 INFO:teuthology.orchestra.run.smithi155.stdout: "description": "osd_op(client.4668.0:70886 5.4 5:27fcffab:::benchmark_data_smithi006_114134_object70885:head [set-alloc-hint object_size 65536 write_size 65536,write 0~65536] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e30)", 2023-08-01T19:55:00.960 INFO:teuthology.orchestra.run.smithi155.stdout: "initiated_at": "2023-08-01T19:54:50.214727+0000", 2023-08-01T19:55:00.960 INFO:teuthology.orchestra.run.smithi155.stdout: "age": 10.719454839000001, 2023-08-01T19:55:00.960 INFO:teuthology.orchestra.run.smithi155.stdout: "duration": 0.016804395999999999, 2023-08-01T19:55:00.961 INFO:teuthology.orchestra.run.smithi155.stdout: "type_data": { 2023-08-01T19:55:00.961 INFO:teuthology.orchestra.run.smithi155.stdout: "flag_point": "commit sent; apply or cleanup", 2023-08-01T19:55:00.961 INFO:teuthology.orchestra.run.smithi155.stdout: "client_info": { 2023-08-01T19:55:00.961 INFO:teuthology.orchestra.run.smithi155.stdout: "client": "client.4668", 2023-08-01T19:55:00.961 INFO:teuthology.orchestra.run.smithi155.stdout: "client_addr": "172.21.15.6:0/1709472247", 2023-08-01T19:55:00.961 INFO:teuthology.orchestra.run.smithi155.stdout: "tid": 70886 2023-08-01T19:55:00.961 INFO:teuthology.orchestra.run.smithi155.stdout: }, 2023-08-01T19:55:00.961 INFO:teuthology.orchestra.run.smithi155.stdout: "events": [ 2023-08-01T19:55:00.962 INFO:teuthology.orchestra.run.smithi155.stdout: { 2023-08-01T19:55:00.962 INFO:teuthology.orchestra.run.smithi155.stdout: "event": "initiated", 2023-08-01T19:55:00.962 INFO:teuthology.orchestra.run.smithi155.stdout: "time": "2023-08-01T19:54:50.214727+0000", 2023-08-01T19:55:00.962 INFO:teuthology.orchestra.run.smithi155.stdout: "duration": 0 2023-08-01T19:55:00.962 INFO:teuthology.orchestra.run.smithi155.stdout: }, 2023-08-01T19:55:00.962 INFO:teuthology.orchestra.run.smithi155.stdout: { 2023-08-01T19:55:00.962 INFO:teuthology.orchestra.run.smithi155.stdout: "event": "throttled", 2023-08-01T19:55:00.962 INFO:teuthology.orchestra.run.smithi155.stdout: "time": "2023-08-01T19:54:50.214727+0000", 2023-08-01T19:55:00.963 INFO:teuthology.orchestra.run.smithi155.stdout: "duration": 0 2023-08-01T19:55:00.963 INFO:teuthology.orchestra.run.smithi155.stdout: }, 2023-08-01T19:55:00.963 INFO:teuthology.orchestra.run.smithi155.stdout: { 2023-08-01T19:55:00.963 INFO:teuthology.orchestra.run.smithi155.stdout: "event": "header_read", 2023-08-01T19:55:00.963 INFO:teuthology.orchestra.run.smithi155.stdout: "time": "2023-08-01T19:54:50.214726+0000", 2023-08-01T19:55:00.963 INFO:teuthology.orchestra.run.smithi155.stdout: "duration": 4294967295.9999995 2023-08-01T19:55:00.963 INFO:teuthology.orchestra.run.smithi155.stdout: }, 2023-08-01T19:55:00.964 INFO:teuthology.orchestra.run.smithi155.stdout: { 2023-08-01T19:55:00.964 INFO:teuthology.orchestra.run.smithi155.stdout: "event": "all_read", 2023-08-01T19:55:00.964 INFO:teuthology.orchestra.run.smithi155.stdout: "time": "2023-08-01T19:54:50.214790+0000", 2023-08-01T19:55:00.964 INFO:teuthology.orchestra.run.smithi155.stdout: "duration": 6.3538000000000001e-05 2023-08-01T19:55:00.964 INFO:teuthology.orchestra.run.smithi155.stdout: }, 2023-08-01T19:55:00.964 INFO:teuthology.orchestra.run.smithi155.stdout: { 2023-08-01T19:55:00.964 INFO:teuthology.orchestra.run.smithi155.stdout: "event": "dispatched", 2023-08-01T19:55:00.964 INFO:teuthology.orchestra.run.smithi155.stdout: "time": "2023-08-01T19:54:50.214797+0000", 2023-08-01T19:55:00.965 INFO:teuthology.orchestra.run.smithi155.stdout: "duration": 7.0759999999999997e-06 2023-08-01T19:55:00.965 INFO:teuthology.orchestra.run.smithi155.stdout: }, 2023-08-01T19:55:00.965 INFO:teuthology.orchestra.run.smithi155.stdout: { 2023-08-01T19:55:00.965 INFO:teuthology.orchestra.run.smithi155.stdout: "event": "queued_for_pg", 2023-08-01T19:55:00.965 INFO:teuthology.orchestra.run.smithi155.stdout: "time": "2023-08-01T19:54:50.214800+0000", 2023-08-01T19:55:00.965 INFO:teuthology.orchestra.run.smithi155.stdout: "duration": 3.3230000000000002e-06 2023-08-01T19:55:00.965 INFO:teuthology.orchestra.run.smithi155.stdout: }, 2023-08-01T19:55:00.966 INFO:teuthology.orchestra.run.smithi155.stdout: { 2023-08-01T19:55:00.966 INFO:teuthology.orchestra.run.smithi155.stdout: "event": "reached_pg", 2023-08-01T19:55:00.966 INFO:teuthology.orchestra.run.smithi155.stdout: "time": "2023-08-01T19:54:50.214836+0000", 2023-08-01T19:55:00.966 INFO:teuthology.orchestra.run.smithi155.stdout: "duration": 3.6236999999999999e-05 2023-08-01T19:55:00.966 INFO:teuthology.orchestra.run.smithi155.stdout: }, 2023-08-01T19:55:00.966 INFO:teuthology.orchestra.run.smithi155.stdout: { 2023-08-01T19:55:00.966 INFO:teuthology.orchestra.run.smithi155.stdout: "event": "started", 2023-08-01T19:55:00.966 INFO:teuthology.orchestra.run.smithi155.stdout: "time": "2023-08-01T19:54:50.214960+0000", 2023-08-01T19:55:00.967 INFO:teuthology.orchestra.run.smithi155.stdout: "duration": 0.00012351199999999999 2023-08-01T19:55:00.967 INFO:teuthology.orchestra.run.smithi155.stdout: }, 2023-08-01T19:55:00.967 INFO:teuthology.orchestra.run.smithi155.stdout: { 2023-08-01T19:55:00.967 INFO:teuthology.orchestra.run.smithi155.stdout: "event": "waiting for subops from 0", 2023-08-01T19:55:00.967 INFO:teuthology.orchestra.run.smithi155.stdout: "time": "2023-08-01T19:54:50.215307+0000", 2023-08-01T19:55:00.967 INFO:teuthology.orchestra.run.smithi155.stdout: "duration": 0.00034703400000000003 2023-08-01T19:55:00.967 INFO:teuthology.orchestra.run.smithi155.stdout: }, 2023-08-01T19:55:00.967 INFO:teuthology.orchestra.run.smithi155.stdout: { 2023-08-01T19:55:00.968 INFO:teuthology.orchestra.run.smithi155.stdout: "event": "op_commit", 2023-08-01T19:55:00.968 INFO:teuthology.orchestra.run.smithi155.stdout: "time": "2023-08-01T19:54:50.218915+0000", 2023-08-01T19:55:00.968 INFO:teuthology.orchestra.run.smithi155.stdout: "duration": 0.0036078030000000001 2023-08-01T19:55:00.968 INFO:teuthology.orchestra.run.smithi155.stdout: }, 2023-08-01T19:55:00.968 INFO:teuthology.orchestra.run.smithi155.stdout: { 2023-08-01T19:55:00.968 INFO:teuthology.orchestra.run.smithi155.stdout: "event": "sub_op_commit_rec", 2023-08-01T19:55:00.968 INFO:teuthology.orchestra.run.smithi155.stdout: "time": "2023-08-01T19:54:50.231476+0000", 2023-08-01T19:55:00.968 INFO:teuthology.orchestra.run.smithi155.stdout: "duration": 0.012561113 2023-08-01T19:55:00.969 INFO:teuthology.orchestra.run.smithi155.stdout: }, 2023-08-01T19:55:00.969 INFO:teuthology.orchestra.run.smithi155.stdout: { 2023-08-01T19:55:00.969 INFO:teuthology.orchestra.run.smithi155.stdout: "event": "commit_sent", 2023-08-01T19:55:00.969 INFO:teuthology.orchestra.run.smithi155.stdout: "time": "2023-08-01T19:54:50.231507+0000", 2023-08-01T19:55:00.969 INFO:teuthology.orchestra.run.smithi155.stdout: "duration": 3.1285999999999998e-05 2023-08-01T19:55:00.969 INFO:teuthology.orchestra.run.smithi155.stdout: }, 2023-08-01T19:55:00.969 INFO:teuthology.orchestra.run.smithi155.stdout: { 2023-08-01T19:55:00.969 INFO:teuthology.orchestra.run.smithi155.stdout: "event": "done", 2023-08-01T19:55:00.970 INFO:teuthology.orchestra.run.smithi155.stdout: "time": "2023-08-01T19:54:50.231531+0000", 2023-08-01T19:55:00.970 INFO:teuthology.orchestra.run.smithi155.stdout: "duration": 2.3989999999999999e-05 2023-08-01T19:55:00.970 INFO:teuthology.orchestra.run.smithi155.stdout: } 2023-08-01T19:55:00.970 INFO:teuthology.orchestra.run.smithi155.stdout: ] 2023-08-01T19:55:00.970 INFO:teuthology.orchestra.run.smithi155.stdout: } 2023-08-01T19:55:00.970 INFO:teuthology.orchestra.run.smithi155.stdout: }, 2023-08-01T19:55:00.970 INFO:teuthology.orchestra.run.smithi155.stdout: { 2023-08-01T19:55:00.971 INFO:teuthology.orchestra.run.smithi155.stdout: "description": "osd_op(client.4668.0:70887 5.4 5:297593d5:::benchmark_data_smithi006_114134_object70886:head [set-alloc-hint object_size 65536 write_size 65536,write 0~65536] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e30)", 2023-08-01T19:55:00.971 INFO:teuthology.orchestra.run.smithi155.stdout: "initiated_at": "2023-08-01T19:54:50.216359+0000", 2023-08-01T19:55:00.971 INFO:teuthology.orchestra.run.smithi155.stdout: "age": 10.717822575, 2023-08-01T19:55:00.971 INFO:teuthology.orchestra.run.smithi155.stdout: "duration": 0.018298663, 2023-08-01T19:55:00.971 INFO:teuthology.orchestra.run.smithi155.stdout: "type_data": { 2023-08-01T19:55:00.971 INFO:teuthology.orchestra.run.smithi155.stdout: "flag_point": "commit sent; apply or cleanup", 2023-08-01T19:55:00.971 INFO:teuthology.orchestra.run.smithi155.stdout: "client_info": { 2023-08-01T19:55:00.971 INFO:teuthology.orchestra.run.smithi155.stdout: "client": "client.4668", 2023-08-01T19:55:00.972 INFO:teuthology.orchestra.run.smithi155.stdout: "client_addr": "172.21.15.6:0/1709472247", 2023-08-01T19:55:00.972 INFO:teuthology.orchestra.run.smithi155.stdout: "tid": 70887 2023-08-01T19:55:00.972 INFO:teuthology.orchestra.run.smithi155.stdout: }, 2023-08-01T19:55:00.972 INFO:teuthology.orchestra.run.smithi155.stdout: "events": [ 2023-08-01T19:55:00.972 INFO:teuthology.orchestra.run.smithi155.stdout: { 2023-08-01T19:55:00.972 INFO:teuthology.orchestra.run.smithi155.stdout: "event": "initiated", 2023-08-01T19:55:00.972 INFO:teuthology.orchestra.run.smithi155.stdout: "time": "2023-08-01T19:54:50.216359+0000", 2023-08-01T19:55:00.972 INFO:teuthology.orchestra.run.smithi155.stdout: "duration": 0 2023-08-01T19:55:00.973 INFO:teuthology.orchestra.run.smithi155.stdout: }, 2023-08-01T19:55:00.973 INFO:teuthology.orchestra.run.smithi155.stdout: { 2023-08-01T19:55:00.973 INFO:teuthology.orchestra.run.smithi155.stdout: "event": "throttled", 2023-08-01T19:55:00.973 INFO:teuthology.orchestra.run.smithi155.stdout: "time": "2023-08-01T19:54:50.216359+0000", 2023-08-01T19:55:00.973 INFO:teuthology.orchestra.run.smithi155.stdout: "duration": 0 2023-08-01T19:55:00.973 INFO:teuthology.orchestra.run.smithi155.stdout: }, 2023-08-01T19:55:00.973 INFO:teuthology.orchestra.run.smithi155.stdout: { 2023-08-01T19:55:00.973 INFO:teuthology.orchestra.run.smithi155.stdout: "event": "header_read", 2023-08-01T19:55:00.974 INFO:teuthology.orchestra.run.smithi155.stdout: "time": "2023-08-01T19:54:50.216358+0000", 2023-08-01T19:55:00.974 INFO:teuthology.orchestra.run.smithi155.stdout: "duration": 4294967295.9999995 2023-08-01T19:55:00.974 INFO:teuthology.orchestra.run.smithi155.stdout: }, 2023-08-01T19:55:00.974 INFO:teuthology.orchestra.run.smithi155.stdout: { 2023-08-01T19:55:00.974 INFO:teuthology.orchestra.run.smithi155.stdout: "event": "all_read", 2023-08-01T19:55:00.974 INFO:teuthology.orchestra.run.smithi155.stdout: "time": "2023-08-01T19:54:50.216445+0000", 2023-08-01T19:55:00.974 INFO:teuthology.orchestra.run.smithi155.stdout: "duration": 8.6108999999999998e-05 2023-08-01T19:55:00.974 INFO:teuthology.orchestra.run.smithi155.stdout: }, 2023-08-01T19:55:00.975 INFO:teuthology.orchestra.run.smithi155.stdout: { 2023-08-01T19:55:00.975 INFO:teuthology.orchestra.run.smithi155.stdout: "event": "dispatched", 2023-08-01T19:55:00.975 INFO:teuthology.orchestra.run.smithi155.stdout: "time": "2023-08-01T19:54:50.216454+0000", 2023-08-01T19:55:00.975 INFO:teuthology.orchestra.run.smithi155.stdout: "duration": 9.2869999999999993e-06 2023-08-01T19:55:00.975 INFO:teuthology.orchestra.run.smithi155.stdout: }, 2023-08-01T19:55:00.975 INFO:teuthology.orchestra.run.smithi155.stdout: { 2023-08-01T19:55:00.975 INFO:teuthology.orchestra.run.smithi155.stdout: "event": "queued_for_pg", 2023-08-01T19:55:00.975 INFO:teuthology.orchestra.run.smithi155.stdout: "time": "2023-08-01T19:54:50.216458+0000", 2023-08-01T19:55:00.976 INFO:teuthology.orchestra.run.smithi155.stdout: "duration": 3.6349999999999999e-06 2023-08-01T19:55:00.976 INFO:teuthology.orchestra.run.smithi155.stdout: }, 2023-08-01T19:55:00.976 INFO:teuthology.orchestra.run.smithi155.stdout: { 2023-08-01T19:55:00.976 INFO:teuthology.orchestra.run.smithi155.stdout: "event": "reached_pg", 2023-08-01T19:55:00.976 INFO:teuthology.orchestra.run.smithi155.stdout: "time": "2023-08-01T19:54:50.217512+0000", 2023-08-01T19:55:00.976 INFO:teuthology.orchestra.run.smithi155.stdout: "duration": 0.0010542450000000001 2023-08-01T19:55:00.976 INFO:teuthology.orchestra.run.smithi155.stdout: }, 2023-08-01T19:55:00.977 INFO:teuthology.orchestra.run.smithi155.stdout: { 2023-08-01T19:55:00.977 INFO:teuthology.orchestra.run.smithi155.stdout: "event": "started", 2023-08-01T19:55:00.977 INFO:teuthology.orchestra.run.smithi155.stdout: "time": "2023-08-01T19:54:50.217597+0000", 2023-08-01T19:55:00.977 INFO:teuthology.orchestra.run.smithi155.stdout: "duration": 8.5310999999999997e-05 2023-08-01T19:55:00.977 INFO:teuthology.orchestra.run.smithi155.stdout: }, 2023-08-01T19:55:00.977 INFO:teuthology.orchestra.run.smithi155.stdout: { 2023-08-01T19:55:00.977 INFO:teuthology.orchestra.run.smithi155.stdout: "event": "waiting for subops from 0", 2023-08-01T19:55:00.977 INFO:teuthology.orchestra.run.smithi155.stdout: "time": "2023-08-01T19:54:50.217685+0000", 2023-08-01T19:55:00.978 INFO:teuthology.orchestra.run.smithi155.stdout: "duration": 8.7606000000000001e-05 2023-08-01T19:55:00.978 INFO:teuthology.orchestra.run.smithi155.stdout: }, 2023-08-01T19:55:00.978 INFO:teuthology.orchestra.run.smithi155.stdout: { 2023-08-01T19:55:00.978 INFO:teuthology.orchestra.run.smithi155.stdout: "event": "op_commit", 2023-08-01T19:55:00.978 INFO:teuthology.orchestra.run.smithi155.stdout: "time": "2023-08-01T19:54:50.220467+0000", 2023-08-01T19:55:00.978 INFO:teuthology.orchestra.run.smithi155.stdout: "duration": 0.0027821629999999998 2023-08-01T19:55:00.978 INFO:teuthology.orchestra.run.smithi155.stdout: }, 2023-08-01T19:55:00.978 INFO:teuthology.orchestra.run.smithi155.stdout: { 2023-08-01T19:55:00.979 INFO:teuthology.orchestra.run.smithi155.stdout: "event": "sub_op_commit_rec", 2023-08-01T19:55:00.979 INFO:teuthology.orchestra.run.smithi155.stdout: "time": "2023-08-01T19:54:50.234601+0000", 2023-08-01T19:55:00.979 INFO:teuthology.orchestra.run.smithi155.stdout: "duration": 0.014133949 2023-08-01T19:55:00.979 INFO:teuthology.orchestra.run.smithi155.stdout: }, 2023-08-01T19:55:00.979 INFO:teuthology.orchestra.run.smithi155.stdout: { 2023-08-01T19:55:00.979 INFO:teuthology.orchestra.run.smithi155.stdout: "event": "commit_sent", 2023-08-01T19:55:00.979 INFO:teuthology.orchestra.run.smithi155.stdout: "time": "2023-08-01T19:54:50.234634+0000", 2023-08-01T19:55:00.979 INFO:teuthology.orchestra.run.smithi155.stdout: "duration": 3.3259000000000001e-05 2023-08-01T19:55:00.980 INFO:teuthology.orchestra.run.smithi155.stdout: }, 2023-08-01T19:55:00.980 INFO:teuthology.orchestra.run.smithi155.stdout: { 2023-08-01T19:55:00.980 INFO:teuthology.orchestra.run.smithi155.stdout: "event": "done", 2023-08-01T19:55:00.980 INFO:teuthology.orchestra.run.smithi155.stdout: "time": "2023-08-01T19:54:50.234658+0000", 2023-08-01T19:55:00.980 INFO:teuthology.orchestra.run.smithi155.stdout: "duration": 2.3726999999999998e-05 2023-08-01T19:55:00.980 INFO:teuthology.orchestra.run.smithi155.stdout: } 2023-08-01T19:55:00.980 INFO:teuthology.orchestra.run.smithi155.stdout: ] 2023-08-01T19:55:00.980 INFO:teuthology.orchestra.run.smithi155.stdout: } 2023-08-01T19:55:00.981 INFO:teuthology.orchestra.run.smithi155.stdout: }, 2023-08-01T19:55:00.981 INFO:teuthology.orchestra.run.smithi155.stdout: { 2023-08-01T19:55:00.981 INFO:teuthology.orchestra.run.smithi155.stdout: "description": "osd_op(client.4668.0:71411 5.e 5:7c6c4519:::benchmark_data_smithi006_114134_object71410:head [set-alloc-hint object_size 65536 write_size 65536,write 0~65536] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e30)", 2023-08-01T19:55:00.981 INFO:teuthology.orchestra.run.smithi155.stdout: "initiated_at": "2023-08-01T19:54:50.471084+0000", 2023-08-01T19:55:00.981 INFO:teuthology.orchestra.run.smithi155.stdout: "age": 10.463097529000001, 2023-08-01T19:55:00.981 INFO:teuthology.orchestra.run.smithi155.stdout: "duration": 0.016135705, 2023-08-01T19:55:00.981 INFO:teuthology.orchestra.run.smithi155.stdout: "type_data": { 2023-08-01T19:55:00.982 INFO:teuthology.orchestra.run.smithi155.stdout: "flag_point": "commit sent; apply or cleanup", 2023-08-01T19:55:00.982 INFO:teuthology.orchestra.run.smithi155.stdout: "client_info": { 2023-08-01T19:55:00.982 INFO:teuthology.orchestra.run.smithi155.stdout: "client": "client.4668", 2023-08-01T19:55:00.982 INFO:teuthology.orchestra.run.smithi155.stdout: "client_addr": "172.21.15.6:0/1709472247", 2023-08-01T19:55:00.982 INFO:teuthology.orchestra.run.smithi155.stdout: "tid": 71411 2023-08-01T19:55:00.982 INFO:teuthology.orchestra.run.smithi155.stdout: }, 2023-08-01T19:55:00.982 INFO:teuthology.orchestra.run.smithi155.stdout: "events": [ 2023-08-01T19:55:00.983 INFO:teuthology.orchestra.run.smithi155.stdout: { 2023-08-01T19:55:00.983 INFO:teuthology.orchestra.run.smithi155.stdout: "event": "initiated", 2023-08-01T19:55:00.983 INFO:teuthology.orchestra.run.smithi155.stdout: "time": "2023-08-01T19:54:50.471084+0000", 2023-08-01T19:55:00.983 INFO:teuthology.orchestra.run.smithi155.stdout: "duration": 0 2023-08-01T19:55:00.983 INFO:teuthology.orchestra.run.smithi155.stdout: }, 2023-08-01T19:55:00.983 INFO:teuthology.orchestra.run.smithi155.stdout: { 2023-08-01T19:55:00.983 INFO:teuthology.orchestra.run.smithi155.stdout: "event": "throttled", 2023-08-01T19:55:00.983 INFO:teuthology.orchestra.run.smithi155.stdout: "time": "2023-08-01T19:54:50.471084+0000", 2023-08-01T19:55:00.984 INFO:teuthology.orchestra.run.smithi155.stdout: "duration": 0 2023-08-01T19:55:00.984 INFO:teuthology.orchestra.run.smithi155.stdout: }, 2023-08-01T19:55:00.984 INFO:teuthology.orchestra.run.smithi155.stdout: { 2023-08-01T19:55:00.984 INFO:teuthology.orchestra.run.smithi155.stdout: "event": "header_read", 2023-08-01T19:55:00.984 INFO:teuthology.orchestra.run.smithi155.stdout: "time": "2023-08-01T19:54:50.471084+0000", 2023-08-01T19:55:00.984 INFO:teuthology.orchestra.run.smithi155.stdout: "duration": 4294967295.9999995 2023-08-01T19:55:00.984 INFO:teuthology.orchestra.run.smithi155.stdout: }, 2023-08-01T19:55:00.985 INFO:teuthology.orchestra.run.smithi155.stdout: { 2023-08-01T19:55:00.985 INFO:teuthology.orchestra.run.smithi155.stdout: "event": "all_read", 2023-08-01T19:55:00.985 INFO:teuthology.orchestra.run.smithi155.stdout: "time": "2023-08-01T19:54:50.471159+0000", 2023-08-01T19:55:00.985 INFO:teuthology.orchestra.run.smithi155.stdout: "duration": 7.5179999999999995e-05 2023-08-01T19:55:00.985 INFO:teuthology.orchestra.run.smithi155.stdout: }, 2023-08-01T19:55:00.985 INFO:teuthology.orchestra.run.smithi155.stdout: { 2023-08-01T19:55:00.985 INFO:teuthology.orchestra.run.smithi155.stdout: "event": "dispatched", 2023-08-01T19:55:00.985 INFO:teuthology.orchestra.run.smithi155.stdout: "time": "2023-08-01T19:54:50.471166+0000", 2023-08-01T19:55:00.986 INFO:teuthology.orchestra.run.smithi155.stdout: "duration": 7.0859999999999996e-06 2023-08-01T19:55:00.986 INFO:teuthology.orchestra.run.smithi155.stdout: }, 2023-08-01T19:55:00.986 INFO:teuthology.orchestra.run.smithi155.stdout: { 2023-08-01T19:55:00.986 INFO:teuthology.orchestra.run.smithi155.stdout: "event": "queued_for_pg", 2023-08-01T19:55:00.986 INFO:teuthology.orchestra.run.smithi155.stdout: "time": "2023-08-01T19:54:50.471169+0000", 2023-08-01T19:55:00.986 INFO:teuthology.orchestra.run.smithi155.stdout: "duration": 2.9239999999999999e-06 2023-08-01T19:55:00.986 INFO:teuthology.orchestra.run.smithi155.stdout: }, 2023-08-01T19:55:00.986 INFO:teuthology.orchestra.run.smithi155.stdout: { 2023-08-01T19:55:00.987 INFO:teuthology.orchestra.run.smithi155.stdout: "event": "reached_pg", 2023-08-01T19:55:00.987 INFO:teuthology.orchestra.run.smithi155.stdout: "time": "2023-08-01T19:54:50.476521+0000", 2023-08-01T19:55:00.987 INFO:teuthology.orchestra.run.smithi155.stdout: "duration": 0.0053523900000000003 2023-08-01T19:55:00.987 INFO:teuthology.orchestra.run.smithi155.stdout: }, 2023-08-01T19:55:00.987 INFO:teuthology.orchestra.run.smithi155.stdout: { 2023-08-01T19:55:00.987 INFO:teuthology.orchestra.run.smithi155.stdout: "event": "started", 2023-08-01T19:55:00.987 INFO:teuthology.orchestra.run.smithi155.stdout: "time": "2023-08-01T19:54:50.476637+0000", 2023-08-01T19:55:00.988 INFO:teuthology.orchestra.run.smithi155.stdout: "duration": 0.000115321 2023-08-01T19:55:00.988 INFO:teuthology.orchestra.run.smithi155.stdout: }, 2023-08-01T19:55:00.988 INFO:teuthology.orchestra.run.smithi155.stdout: { 2023-08-01T19:55:00.988 INFO:teuthology.orchestra.run.smithi155.stdout: "event": "waiting for subops from 0", 2023-08-01T19:55:00.988 INFO:teuthology.orchestra.run.smithi155.stdout: "time": "2023-08-01T19:54:50.476777+0000", 2023-08-01T19:55:00.988 INFO:teuthology.orchestra.run.smithi155.stdout: "duration": 0.000140135 2023-08-01T19:55:00.988 INFO:teuthology.orchestra.run.smithi155.stdout: }, 2023-08-01T19:55:00.988 INFO:teuthology.orchestra.run.smithi155.stdout: { 2023-08-01T19:55:00.989 INFO:teuthology.orchestra.run.smithi155.stdout: "event": "op_commit", 2023-08-01T19:55:00.989 INFO:teuthology.orchestra.run.smithi155.stdout: "time": "2023-08-01T19:54:50.479458+0000", 2023-08-01T19:55:00.989 INFO:teuthology.orchestra.run.smithi155.stdout: "duration": 0.0026815530000000001 2023-08-01T19:55:00.989 INFO:teuthology.orchestra.run.smithi155.stdout: }, 2023-08-01T19:55:00.989 INFO:teuthology.orchestra.run.smithi155.stdout: { 2023-08-01T19:55:00.989 INFO:teuthology.orchestra.run.smithi155.stdout: "event": "sub_op_commit_rec", 2023-08-01T19:55:00.989 INFO:teuthology.orchestra.run.smithi155.stdout: "time": "2023-08-01T19:54:50.487118+0000", 2023-08-01T19:55:00.989 INFO:teuthology.orchestra.run.smithi155.stdout: "duration": 0.007659908 2023-08-01T19:55:00.990 INFO:teuthology.orchestra.run.smithi155.stdout: }, 2023-08-01T19:55:00.990 INFO:teuthology.orchestra.run.smithi155.stdout: { 2023-08-01T19:55:00.990 INFO:teuthology.orchestra.run.smithi155.stdout: "event": "commit_sent", 2023-08-01T19:55:00.990 INFO:teuthology.orchestra.run.smithi155.stdout: "time": "2023-08-01T19:54:50.487171+0000", 2023-08-01T19:55:00.990 INFO:teuthology.orchestra.run.smithi155.stdout: "duration": 5.3029000000000003e-05 2023-08-01T19:55:00.990 INFO:teuthology.orchestra.run.smithi155.stdout: }, 2023-08-01T19:55:00.990 INFO:teuthology.orchestra.run.smithi155.stdout: { 2023-08-01T19:55:00.990 INFO:teuthology.orchestra.run.smithi155.stdout: "event": "done", 2023-08-01T19:55:00.991 INFO:teuthology.orchestra.run.smithi155.stdout: "time": "2023-08-01T19:54:50.487220+0000", 2023-08-01T19:55:00.991 INFO:teuthology.orchestra.run.smithi155.stdout: "duration": 4.8535000000000002e-05 2023-08-01T19:55:00.991 INFO:teuthology.orchestra.run.smithi155.stdout: } 2023-08-01T19:55:00.991 INFO:teuthology.orchestra.run.smithi155.stdout: ] 2023-08-01T19:55:00.991 INFO:teuthology.orchestra.run.smithi155.stdout: } 2023-08-01T19:55:00.991 INFO:teuthology.orchestra.run.smithi155.stdout: }, 2023-08-01T19:55:00.991 INFO:teuthology.orchestra.run.smithi155.stdout: { 2023-08-01T19:55:00.992 INFO:teuthology.orchestra.run.smithi155.stdout: "description": "osd_op(client.4668.0:73454 5.8 5:15596b2f:::benchmark_data_smithi006_114134_object73453:head [set-alloc-hint object_size 65536 write_size 65536,write 0~65536] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e31)", 2023-08-01T19:55:00.992 INFO:teuthology.orchestra.run.smithi155.stdout: "initiated_at": "2023-08-01T19:54:51.460020+0000", 2023-08-01T19:55:00.992 INFO:teuthology.orchestra.run.smithi155.stdout: "age": 9.4741620320000006, 2023-08-01T19:55:00.992 INFO:teuthology.orchestra.run.smithi155.stdout: "duration": 0.022889436999999999, 2023-08-01T19:55:00.992 INFO:teuthology.orchestra.run.smithi155.stdout: "type_data": { 2023-08-01T19:55:00.992 INFO:teuthology.orchestra.run.smithi155.stdout: "flag_point": "commit sent; apply or cleanup", 2023-08-01T19:55:00.992 INFO:teuthology.orchestra.run.smithi155.stdout: "client_info": { 2023-08-01T19:55:00.992 INFO:teuthology.orchestra.run.smithi155.stdout: "client": "client.4668", 2023-08-01T19:55:00.993 INFO:teuthology.orchestra.run.smithi155.stdout: "client_addr": "172.21.15.6:0/1709472247", 2023-08-01T19:55:00.993 INFO:teuthology.orchestra.run.smithi155.stdout: "tid": 73454 2023-08-01T19:55:00.993 INFO:teuthology.orchestra.run.smithi155.stdout: }, 2023-08-01T19:55:00.993 INFO:teuthology.orchestra.run.smithi155.stdout: "events": [ 2023-08-01T19:55:00.993 INFO:teuthology.orchestra.run.smithi155.stdout: { 2023-08-01T19:55:00.993 INFO:teuthology.orchestra.run.smithi155.stdout: "event": "initiated", 2023-08-01T19:55:00.993 INFO:teuthology.orchestra.run.smithi155.stdout: "time": "2023-08-01T19:54:51.460020+0000", 2023-08-01T19:55:00.994 INFO:teuthology.orchestra.run.smithi155.stdout: "duration": 0 2023-08-01T19:55:00.994 INFO:teuthology.orchestra.run.smithi155.stdout: }, 2023-08-01T19:55:00.994 INFO:teuthology.orchestra.run.smithi155.stdout: { 2023-08-01T19:55:00.994 INFO:teuthology.orchestra.run.smithi155.stdout: "event": "throttled", 2023-08-01T19:55:00.994 INFO:teuthology.orchestra.run.smithi155.stdout: "time": "2023-08-01T19:54:51.460020+0000", 2023-08-01T19:55:00.994 INFO:teuthology.orchestra.run.smithi155.stdout: "duration": 0 2023-08-01T19:55:00.994 INFO:teuthology.orchestra.run.smithi155.stdout: }, 2023-08-01T19:55:00.994 INFO:teuthology.orchestra.run.smithi155.stdout: { 2023-08-01T19:55:00.995 INFO:teuthology.orchestra.run.smithi155.stdout: "event": "header_read", 2023-08-01T19:55:00.995 INFO:teuthology.orchestra.run.smithi155.stdout: "time": "2023-08-01T19:54:51.460019+0000", 2023-08-01T19:55:00.995 INFO:teuthology.orchestra.run.smithi155.stdout: "duration": 4294967295.9999995 2023-08-01T19:55:00.995 INFO:teuthology.orchestra.run.smithi155.stdout: }, 2023-08-01T19:55:00.995 INFO:teuthology.orchestra.run.smithi155.stdout: { 2023-08-01T19:55:00.995 INFO:teuthology.orchestra.run.smithi155.stdout: "event": "all_read", 2023-08-01T19:55:00.995 INFO:teuthology.orchestra.run.smithi155.stdout: "time": "2023-08-01T19:54:51.460051+0000", 2023-08-01T19:55:00.995 INFO:teuthology.orchestra.run.smithi155.stdout: "duration": 3.1736000000000002e-05 2023-08-01T19:55:00.996 INFO:teuthology.orchestra.run.smithi155.stdout: }, 2023-08-01T19:55:00.996 INFO:teuthology.orchestra.run.smithi155.stdout: { 2023-08-01T19:55:00.996 INFO:teuthology.orchestra.run.smithi155.stdout: "event": "dispatched", 2023-08-01T19:55:00.996 INFO:teuthology.orchestra.run.smithi155.stdout: "time": "2023-08-01T19:54:51.460058+0000", 2023-08-01T19:55:00.996 INFO:teuthology.orchestra.run.smithi155.stdout: "duration": 7.3869999999999997e-06 2023-08-01T19:55:00.996 INFO:teuthology.orchestra.run.smithi155.stdout: }, 2023-08-01T19:55:00.996 INFO:teuthology.orchestra.run.smithi155.stdout: { 2023-08-01T19:55:00.996 INFO:teuthology.orchestra.run.smithi155.stdout: "event": "queued_for_pg", 2023-08-01T19:55:00.997 INFO:teuthology.orchestra.run.smithi155.stdout: "time": "2023-08-01T19:54:51.460062+0000", 2023-08-01T19:55:00.997 INFO:teuthology.orchestra.run.smithi155.stdout: "duration": 4.352e-06 2023-08-01T19:55:00.997 INFO:teuthology.orchestra.run.smithi155.stdout: }, 2023-08-01T19:55:00.997 INFO:teuthology.orchestra.run.smithi155.stdout: { 2023-08-01T19:55:00.997 INFO:teuthology.orchestra.run.smithi155.stdout: "event": "reached_pg", 2023-08-01T19:55:00.997 INFO:teuthology.orchestra.run.smithi155.stdout: "time": "2023-08-01T19:54:51.460101+0000", 2023-08-01T19:55:00.997 INFO:teuthology.orchestra.run.smithi155.stdout: "duration": 3.8705000000000003e-05 2023-08-01T19:55:00.998 INFO:teuthology.orchestra.run.smithi155.stdout: }, 2023-08-01T19:55:00.998 INFO:teuthology.orchestra.run.smithi155.stdout: { 2023-08-01T19:55:00.998 INFO:teuthology.orchestra.run.smithi155.stdout: "event": "started", 2023-08-01T19:55:00.998 INFO:teuthology.orchestra.run.smithi155.stdout: "time": "2023-08-01T19:54:51.460236+0000", 2023-08-01T19:55:00.998 INFO:teuthology.orchestra.run.smithi155.stdout: "duration": 0.00013463599999999999 2023-08-01T19:55:00.998 INFO:teuthology.orchestra.run.smithi155.stdout: }, 2023-08-01T19:55:00.998 INFO:teuthology.orchestra.run.smithi155.stdout: { 2023-08-01T19:55:00.998 INFO:teuthology.orchestra.run.smithi155.stdout: "event": "waiting for subops from 0", 2023-08-01T19:55:00.999 INFO:teuthology.orchestra.run.smithi155.stdout: "time": "2023-08-01T19:54:51.460391+0000", 2023-08-01T19:55:00.999 INFO:teuthology.orchestra.run.smithi155.stdout: "duration": 0.00015525000000000001 2023-08-01T19:55:00.999 INFO:teuthology.orchestra.run.smithi155.stdout: }, 2023-08-01T19:55:00.999 INFO:teuthology.orchestra.run.smithi155.stdout: { 2023-08-01T19:55:00.999 INFO:teuthology.orchestra.run.smithi155.stdout: "event": "sub_op_commit_rec", 2023-08-01T19:55:00.999 INFO:teuthology.orchestra.run.smithi155.stdout: "time": "2023-08-01T19:54:51.468393+0000", 2023-08-01T19:55:00.999 INFO:teuthology.orchestra.run.smithi155.stdout: "duration": 0.00800208 2023-08-01T19:55:00.999 INFO:teuthology.orchestra.run.smithi155.stdout: }, 2023-08-01T19:55:01.000 INFO:teuthology.orchestra.run.smithi155.stdout: { 2023-08-01T19:55:01.000 INFO:teuthology.orchestra.run.smithi155.stdout: "event": "op_commit", 2023-08-01T19:55:01.000 INFO:teuthology.orchestra.run.smithi155.stdout: "time": "2023-08-01T19:54:51.482815+0000", 2023-08-01T19:55:01.000 INFO:teuthology.orchestra.run.smithi155.stdout: "duration": 0.01442148 2023-08-01T19:55:01.000 INFO:teuthology.orchestra.run.smithi155.stdout: }, 2023-08-01T19:55:01.000 INFO:teuthology.orchestra.run.smithi155.stdout: { 2023-08-01T19:55:01.000 INFO:teuthology.orchestra.run.smithi155.stdout: "event": "commit_sent", 2023-08-01T19:55:01.001 INFO:teuthology.orchestra.run.smithi155.stdout: "time": "2023-08-01T19:54:51.482866+0000", 2023-08-01T19:55:01.001 INFO:teuthology.orchestra.run.smithi155.stdout: "duration": 5.1842999999999998e-05 2023-08-01T19:55:01.001 INFO:teuthology.orchestra.run.smithi155.stdout: }, 2023-08-01T19:55:01.001 INFO:teuthology.orchestra.run.smithi155.stdout: { 2023-08-01T19:55:01.001 INFO:teuthology.orchestra.run.smithi155.stdout: "event": "done", 2023-08-01T19:55:01.001 INFO:teuthology.orchestra.run.smithi155.stdout: "time": "2023-08-01T19:54:51.482909+0000", 2023-08-01T19:55:01.001 INFO:teuthology.orchestra.run.smithi155.stdout: "duration": 4.2663000000000001e-05 2023-08-01T19:55:01.001 INFO:teuthology.orchestra.run.smithi155.stdout: } 2023-08-01T19:55:01.002 INFO:teuthology.orchestra.run.smithi155.stdout: ] 2023-08-01T19:55:01.002 INFO:teuthology.orchestra.run.smithi155.stdout: } 2023-08-01T19:55:01.002 INFO:teuthology.orchestra.run.smithi155.stdout: }, 2023-08-01T19:55:01.002 INFO:teuthology.orchestra.run.smithi155.stdout: { 2023-08-01T19:55:01.002 INFO:teuthology.orchestra.run.smithi155.stdout: "description": "osd_op(client.4668.0:73455 5.b 5:de51121e:::benchmark_data_smithi006_114134_object73454:head [set-alloc-hint object_size 65536 write_size 65536,write 0~65536] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e31)", 2023-08-01T19:55:01.002 INFO:teuthology.orchestra.run.smithi155.stdout: "initiated_at": "2023-08-01T19:54:51.460078+0000", 2023-08-01T19:55:01.002 INFO:teuthology.orchestra.run.smithi155.stdout: "age": 9.474104058, 2023-08-01T19:55:01.003 INFO:teuthology.orchestra.run.smithi155.stdout: "duration": 0.022689121999999999, 2023-08-01T19:55:01.003 INFO:teuthology.orchestra.run.smithi155.stdout: "type_data": { 2023-08-01T19:55:01.003 INFO:teuthology.orchestra.run.smithi155.stdout: "flag_point": "commit sent; apply or cleanup", 2023-08-01T19:55:01.003 INFO:teuthology.orchestra.run.smithi155.stdout: "client_info": { 2023-08-01T19:55:01.003 INFO:teuthology.orchestra.run.smithi155.stdout: "client": "client.4668", 2023-08-01T19:55:01.003 INFO:teuthology.orchestra.run.smithi155.stdout: "client_addr": "172.21.15.6:0/1709472247", 2023-08-01T19:55:01.003 INFO:teuthology.orchestra.run.smithi155.stdout: "tid": 73455 2023-08-01T19:55:01.003 INFO:teuthology.orchestra.run.smithi155.stdout: }, 2023-08-01T19:55:01.004 INFO:teuthology.orchestra.run.smithi155.stdout: "events": [ 2023-08-01T19:55:01.004 INFO:teuthology.orchestra.run.smithi155.stdout: { 2023-08-01T19:55:01.004 INFO:teuthology.orchestra.run.smithi155.stdout: "event": "initiated", 2023-08-01T19:55:01.004 INFO:teuthology.orchestra.run.smithi155.stdout: "time": "2023-08-01T19:54:51.460078+0000", 2023-08-01T19:55:01.004 INFO:teuthology.orchestra.run.smithi155.stdout: "duration": 0 2023-08-01T19:55:01.004 INFO:teuthology.orchestra.run.smithi155.stdout: }, 2023-08-01T19:55:01.004 INFO:teuthology.orchestra.run.smithi155.stdout: { 2023-08-01T19:55:01.004 INFO:teuthology.orchestra.run.smithi155.stdout: "event": "throttled", 2023-08-01T19:55:01.005 INFO:teuthology.orchestra.run.smithi155.stdout: "time": "2023-08-01T19:54:51.460078+0000", 2023-08-01T19:55:01.005 INFO:teuthology.orchestra.run.smithi155.stdout: "duration": 0 2023-08-01T19:55:01.005 INFO:teuthology.orchestra.run.smithi155.stdout: }, 2023-08-01T19:55:01.005 INFO:teuthology.orchestra.run.smithi155.stdout: { 2023-08-01T19:55:01.005 INFO:teuthology.orchestra.run.smithi155.stdout: "event": "header_read", 2023-08-01T19:55:01.005 INFO:teuthology.orchestra.run.smithi155.stdout: "time": "2023-08-01T19:54:51.460077+0000", 2023-08-01T19:55:01.005 INFO:teuthology.orchestra.run.smithi155.stdout: "duration": 4294967295.9999995 2023-08-01T19:55:01.006 INFO:teuthology.orchestra.run.smithi155.stdout: }, 2023-08-01T19:55:01.006 INFO:teuthology.orchestra.run.smithi155.stdout: { 2023-08-01T19:55:01.006 INFO:teuthology.orchestra.run.smithi155.stdout: "event": "all_read", 2023-08-01T19:55:01.006 INFO:teuthology.orchestra.run.smithi155.stdout: "time": "2023-08-01T19:54:51.460102+0000", 2023-08-01T19:55:01.006 INFO:teuthology.orchestra.run.smithi155.stdout: "duration": 2.4933e-05 2023-08-01T19:55:01.006 INFO:teuthology.orchestra.run.smithi155.stdout: }, 2023-08-01T19:55:01.006 INFO:teuthology.orchestra.run.smithi155.stdout: { 2023-08-01T19:55:01.006 INFO:teuthology.orchestra.run.smithi155.stdout: "event": "dispatched", 2023-08-01T19:55:01.007 INFO:teuthology.orchestra.run.smithi155.stdout: "time": "2023-08-01T19:54:51.460109+0000", 2023-08-01T19:55:01.007 INFO:teuthology.orchestra.run.smithi155.stdout: "duration": 7.0720000000000002e-06 2023-08-01T19:55:01.007 INFO:teuthology.orchestra.run.smithi155.stdout: }, 2023-08-01T19:55:01.007 INFO:teuthology.orchestra.run.smithi155.stdout: { 2023-08-01T19:55:01.007 INFO:teuthology.orchestra.run.smithi155.stdout: "event": "queued_for_pg", 2023-08-01T19:55:01.007 INFO:teuthology.orchestra.run.smithi155.stdout: "time": "2023-08-01T19:54:51.460113+0000", 2023-08-01T19:55:01.007 INFO:teuthology.orchestra.run.smithi155.stdout: "duration": 4.3220000000000003e-06 2023-08-01T19:55:01.007 INFO:teuthology.orchestra.run.smithi155.stdout: }, 2023-08-01T19:55:01.008 INFO:teuthology.orchestra.run.smithi155.stdout: { 2023-08-01T19:55:01.008 INFO:teuthology.orchestra.run.smithi155.stdout: "event": "reached_pg", 2023-08-01T19:55:01.008 INFO:teuthology.orchestra.run.smithi155.stdout: "time": "2023-08-01T19:54:51.460955+0000", 2023-08-01T19:55:01.008 INFO:teuthology.orchestra.run.smithi155.stdout: "duration": 0.00084142500000000003 2023-08-01T19:55:01.008 INFO:teuthology.orchestra.run.smithi155.stdout: }, 2023-08-01T19:55:01.008 INFO:teuthology.orchestra.run.smithi155.stdout: { 2023-08-01T19:55:01.008 INFO:teuthology.orchestra.run.smithi155.stdout: "event": "started", 2023-08-01T19:55:01.008 INFO:teuthology.orchestra.run.smithi155.stdout: "time": "2023-08-01T19:54:51.461079+0000", 2023-08-01T19:55:01.009 INFO:teuthology.orchestra.run.smithi155.stdout: "duration": 0.000123826 2023-08-01T19:55:01.009 INFO:teuthology.orchestra.run.smithi155.stdout: }, 2023-08-01T19:55:01.009 INFO:teuthology.orchestra.run.smithi155.stdout: { 2023-08-01T19:55:01.009 INFO:teuthology.orchestra.run.smithi155.stdout: "event": "waiting for subops from 0", 2023-08-01T19:55:01.009 INFO:teuthology.orchestra.run.smithi155.stdout: "time": "2023-08-01T19:54:51.461233+0000", 2023-08-01T19:55:01.009 INFO:teuthology.orchestra.run.smithi155.stdout: "duration": 0.00015431900000000001 2023-08-01T19:55:01.009 INFO:teuthology.orchestra.run.smithi155.stdout: }, 2023-08-01T19:55:01.009 INFO:teuthology.orchestra.run.smithi155.stdout: { 2023-08-01T19:55:01.010 INFO:teuthology.orchestra.run.smithi155.stdout: "event": "sub_op_commit_rec", 2023-08-01T19:55:01.010 INFO:teuthology.orchestra.run.smithi155.stdout: "time": "2023-08-01T19:54:51.468509+0000", 2023-08-01T19:55:01.010 INFO:teuthology.orchestra.run.smithi155.stdout: "duration": 0.0072759859999999999 2023-08-01T19:55:01.010 INFO:teuthology.orchestra.run.smithi155.stdout: }, 2023-08-01T19:55:01.010 INFO:teuthology.orchestra.run.smithi155.stdout: { 2023-08-01T19:55:01.010 INFO:teuthology.orchestra.run.smithi155.stdout: "event": "op_commit", 2023-08-01T19:55:01.010 INFO:teuthology.orchestra.run.smithi155.stdout: "time": "2023-08-01T19:54:51.482704+0000", 2023-08-01T19:55:01.010 INFO:teuthology.orchestra.run.smithi155.stdout: "duration": 0.01419545 2023-08-01T19:55:01.011 INFO:teuthology.orchestra.run.smithi155.stdout: }, 2023-08-01T19:55:01.011 INFO:teuthology.orchestra.run.smithi155.stdout: { 2023-08-01T19:55:01.011 INFO:teuthology.orchestra.run.smithi155.stdout: "event": "commit_sent", 2023-08-01T19:55:01.011 INFO:teuthology.orchestra.run.smithi155.stdout: "time": "2023-08-01T19:54:51.482747+0000", 2023-08-01T19:55:01.011 INFO:teuthology.orchestra.run.smithi155.stdout: "duration": 4.2413999999999997e-05 2023-08-01T19:55:01.011 INFO:teuthology.orchestra.run.smithi155.stdout: }, 2023-08-01T19:55:01.011 INFO:teuthology.orchestra.run.smithi155.stdout: { 2023-08-01T19:55:01.012 INFO:teuthology.orchestra.run.smithi155.stdout: "event": "done", 2023-08-01T19:55:01.012 INFO:teuthology.orchestra.run.smithi155.stdout: "time": "2023-08-01T19:54:51.482767+0000", 2023-08-01T19:55:01.012 INFO:teuthology.orchestra.run.smithi155.stdout: "duration": 1.9908999999999999e-05 2023-08-01T19:55:01.012 INFO:teuthology.orchestra.run.smithi155.stdout: } 2023-08-01T19:55:01.012 INFO:teuthology.orchestra.run.smithi155.stdout: ] 2023-08-01T19:55:01.012 INFO:teuthology.orchestra.run.smithi155.stdout: } 2023-08-01T19:55:01.012 INFO:teuthology.orchestra.run.smithi155.stdout: }, 2023-08-01T19:55:01.012 INFO:teuthology.orchestra.run.smithi155.stdout: { 2023-08-01T19:55:01.013 INFO:teuthology.orchestra.run.smithi155.stdout: "description": "osd_op(client.4668.0:73456 5.0 5:0164baf4:::benchmark_data_smithi006_114134_object73455:head [set-alloc-hint object_size 65536 write_size 65536,write 0~65536] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e31)", 2023-08-01T19:55:01.013 INFO:teuthology.orchestra.run.smithi155.stdout: "initiated_at": "2023-08-01T19:54:51.461520+0000", 2023-08-01T19:55:01.013 INFO:teuthology.orchestra.run.smithi155.stdout: "age": 9.472662068, 2023-08-01T19:55:01.013 INFO:teuthology.orchestra.run.smithi155.stdout: "duration": 0.023899916, 2023-08-01T19:55:01.013 INFO:teuthology.orchestra.run.smithi155.stdout: "type_data": { 2023-08-01T19:55:01.013 INFO:teuthology.orchestra.run.smithi155.stdout: "flag_point": "commit sent; apply or cleanup", 2023-08-01T19:55:01.013 INFO:teuthology.orchestra.run.smithi155.stdout: "client_info": { 2023-08-01T19:55:01.013 INFO:teuthology.orchestra.run.smithi155.stdout: "client": "client.4668", 2023-08-01T19:55:01.014 INFO:teuthology.orchestra.run.smithi155.stdout: "client_addr": "172.21.15.6:0/1709472247", 2023-08-01T19:55:01.014 INFO:teuthology.orchestra.run.smithi155.stdout: "tid": 73456 2023-08-01T19:55:01.014 INFO:teuthology.orchestra.run.smithi155.stdout: }, 2023-08-01T19:55:01.014 INFO:teuthology.orchestra.run.smithi155.stdout: "events": [ 2023-08-01T19:55:01.014 INFO:teuthology.orchestra.run.smithi155.stdout: { 2023-08-01T19:55:01.014 INFO:teuthology.orchestra.run.smithi155.stdout: "event": "initiated", 2023-08-01T19:55:01.014 INFO:teuthology.orchestra.run.smithi155.stdout: "time": "2023-08-01T19:54:51.461520+0000", 2023-08-01T19:55:01.014 INFO:teuthology.orchestra.run.smithi155.stdout: "duration": 0 2023-08-01T19:55:01.015 INFO:teuthology.orchestra.run.smithi155.stdout: }, 2023-08-01T19:55:01.015 INFO:teuthology.orchestra.run.smithi155.stdout: { 2023-08-01T19:55:01.015 INFO:teuthology.orchestra.run.smithi155.stdout: "event": "throttled", 2023-08-01T19:55:01.015 INFO:teuthology.orchestra.run.smithi155.stdout: "time": "2023-08-01T19:54:51.461520+0000", 2023-08-01T19:55:01.015 INFO:teuthology.orchestra.run.smithi155.stdout: "duration": 0 2023-08-01T19:55:01.015 INFO:teuthology.orchestra.run.smithi155.stdout: }, 2023-08-01T19:55:01.015 INFO:teuthology.orchestra.run.smithi155.stdout: { 2023-08-01T19:55:01.016 INFO:teuthology.orchestra.run.smithi155.stdout: "event": "header_read", 2023-08-01T19:55:01.016 INFO:teuthology.orchestra.run.smithi155.stdout: "time": "2023-08-01T19:54:51.461519+0000", 2023-08-01T19:55:01.016 INFO:teuthology.orchestra.run.smithi155.stdout: "duration": 4294967295.999999 2023-08-01T19:55:01.016 INFO:teuthology.orchestra.run.smithi155.stdout: }, 2023-08-01T19:55:01.016 INFO:teuthology.orchestra.run.smithi155.stdout: { 2023-08-01T19:55:01.016 INFO:teuthology.orchestra.run.smithi155.stdout: "event": "all_read", 2023-08-01T19:55:01.016 INFO:teuthology.orchestra.run.smithi155.stdout: "time": "2023-08-01T19:54:51.461633+0000", 2023-08-01T19:55:01.016 INFO:teuthology.orchestra.run.smithi155.stdout: "duration": 0.000114015 2023-08-01T19:55:01.017 INFO:teuthology.orchestra.run.smithi155.stdout: }, 2023-08-01T19:55:01.017 INFO:teuthology.orchestra.run.smithi155.stdout: { 2023-08-01T19:55:01.017 INFO:teuthology.orchestra.run.smithi155.stdout: "event": "dispatched", 2023-08-01T19:55:01.017 INFO:teuthology.orchestra.run.smithi155.stdout: "time": "2023-08-01T19:54:51.461643+0000", 2023-08-01T19:55:01.017 INFO:teuthology.orchestra.run.smithi155.stdout: "duration": 1.0217000000000001e-05 2023-08-01T19:55:01.017 INFO:teuthology.orchestra.run.smithi155.stdout: }, 2023-08-01T19:55:01.017 INFO:teuthology.orchestra.run.smithi155.stdout: { 2023-08-01T19:55:01.018 INFO:teuthology.orchestra.run.smithi155.stdout: "event": "queued_for_pg", 2023-08-01T19:55:01.018 INFO:teuthology.orchestra.run.smithi155.stdout: "time": "2023-08-01T19:54:51.461649+0000", 2023-08-01T19:55:01.018 INFO:teuthology.orchestra.run.smithi155.stdout: "duration": 5.8850000000000004e-06 2023-08-01T19:55:01.018 INFO:teuthology.orchestra.run.smithi155.stdout: }, 2023-08-01T19:55:01.018 INFO:teuthology.orchestra.run.smithi155.stdout: { 2023-08-01T19:55:01.018 INFO:teuthology.orchestra.run.smithi155.stdout: "event": "reached_pg", 2023-08-01T19:55:01.018 INFO:teuthology.orchestra.run.smithi155.stdout: "time": "2023-08-01T19:54:51.461686+0000", 2023-08-01T19:55:01.018 INFO:teuthology.orchestra.run.smithi155.stdout: "duration": 3.7319e-05 2023-08-01T19:55:01.019 INFO:teuthology.orchestra.run.smithi155.stdout: }, 2023-08-01T19:55:01.019 INFO:teuthology.orchestra.run.smithi155.stdout: { 2023-08-01T19:55:01.019 INFO:teuthology.orchestra.run.smithi155.stdout: "event": "started", 2023-08-01T19:55:01.019 INFO:teuthology.orchestra.run.smithi155.stdout: "time": "2023-08-01T19:54:51.461802+0000", 2023-08-01T19:55:01.019 INFO:teuthology.orchestra.run.smithi155.stdout: "duration": 0.000115604 2023-08-01T19:55:01.019 INFO:teuthology.orchestra.run.smithi155.stdout: }, 2023-08-01T19:55:01.019 INFO:teuthology.orchestra.run.smithi155.stdout: { 2023-08-01T19:55:01.019 INFO:teuthology.orchestra.run.smithi155.stdout: "event": "waiting for subops from 0", 2023-08-01T19:55:01.020 INFO:teuthology.orchestra.run.smithi155.stdout: "time": "2023-08-01T19:54:51.461933+0000", 2023-08-01T19:55:01.020 INFO:teuthology.orchestra.run.smithi155.stdout: "duration": 0.000131175 2023-08-01T19:55:01.020 INFO:teuthology.orchestra.run.smithi155.stdout: }, 2023-08-01T19:55:01.020 INFO:teuthology.orchestra.run.smithi155.stdout: { 2023-08-01T19:55:01.020 INFO:teuthology.orchestra.run.smithi155.stdout: "event": "sub_op_commit_rec", 2023-08-01T19:55:01.020 INFO:teuthology.orchestra.run.smithi155.stdout: "time": "2023-08-01T19:54:51.468411+0000", 2023-08-01T19:55:01.020 INFO:teuthology.orchestra.run.smithi155.stdout: "duration": 0.0064775850000000001 2023-08-01T19:55:01.020 INFO:teuthology.orchestra.run.smithi155.stdout: }, 2023-08-01T19:55:01.021 INFO:teuthology.orchestra.run.smithi155.stdout: { 2023-08-01T19:55:01.021 INFO:teuthology.orchestra.run.smithi155.stdout: "event": "op_commit", 2023-08-01T19:55:01.021 INFO:teuthology.orchestra.run.smithi155.stdout: "time": "2023-08-01T19:54:51.485340+0000", 2023-08-01T19:55:01.021 INFO:teuthology.orchestra.run.smithi155.stdout: "duration": 0.016928907 2023-08-01T19:55:01.021 INFO:teuthology.orchestra.run.smithi155.stdout: }, 2023-08-01T19:55:01.021 INFO:teuthology.orchestra.run.smithi155.stdout: { 2023-08-01T19:55:01.021 INFO:teuthology.orchestra.run.smithi155.stdout: "event": "commit_sent", 2023-08-01T19:55:01.021 INFO:teuthology.orchestra.run.smithi155.stdout: "time": "2023-08-01T19:54:51.485385+0000", 2023-08-01T19:55:01.022 INFO:teuthology.orchestra.run.smithi155.stdout: "duration": 4.5222000000000002e-05 2023-08-01T19:55:01.022 INFO:teuthology.orchestra.run.smithi155.stdout: }, 2023-08-01T19:55:01.022 INFO:teuthology.orchestra.run.smithi155.stdout: { 2023-08-01T19:55:01.022 INFO:teuthology.orchestra.run.smithi155.stdout: "event": "done", 2023-08-01T19:55:01.022 INFO:teuthology.orchestra.run.smithi155.stdout: "time": "2023-08-01T19:54:51.485420+0000", 2023-08-01T19:55:01.022 INFO:teuthology.orchestra.run.smithi155.stdout: "duration": 3.4717e-05 2023-08-01T19:55:01.022 INFO:teuthology.orchestra.run.smithi155.stdout: } 2023-08-01T19:55:01.023 INFO:teuthology.orchestra.run.smithi155.stdout: ] 2023-08-01T19:55:01.023 INFO:teuthology.orchestra.run.smithi155.stdout: } 2023-08-01T19:55:01.023 INFO:teuthology.orchestra.run.smithi155.stdout: }, 2023-08-01T19:55:01.023 INFO:teuthology.orchestra.run.smithi155.stdout: { 2023-08-01T19:55:01.023 INFO:teuthology.orchestra.run.smithi155.stdout: "description": "osd_op(client.4668.0:73458 5.e 5:7e500c47:::benchmark_data_smithi006_114134_object73457:head [set-alloc-hint object_size 65536 write_size 65536,write 0~65536] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e31)", 2023-08-01T19:55:01.023 INFO:teuthology.orchestra.run.smithi155.stdout: "initiated_at": "2023-08-01T19:54:51.461880+0000", 2023-08-01T19:55:01.023 INFO:teuthology.orchestra.run.smithi155.stdout: "age": 9.4723021200000002, 2023-08-01T19:55:01.023 INFO:teuthology.orchestra.run.smithi155.stdout: "duration": 0.020850289000000001, 2023-08-01T19:55:01.024 INFO:teuthology.orchestra.run.smithi155.stdout: "type_data": { 2023-08-01T19:55:01.024 INFO:teuthology.orchestra.run.smithi155.stdout: "flag_point": "commit sent; apply or cleanup", 2023-08-01T19:55:01.024 INFO:teuthology.orchestra.run.smithi155.stdout: "client_info": { 2023-08-01T19:55:01.024 INFO:teuthology.orchestra.run.smithi155.stdout: "client": "client.4668", 2023-08-01T19:55:01.024 INFO:teuthology.orchestra.run.smithi155.stdout: "client_addr": "172.21.15.6:0/1709472247", 2023-08-01T19:55:01.024 INFO:teuthology.orchestra.run.smithi155.stdout: "tid": 73458 2023-08-01T19:55:01.024 INFO:teuthology.orchestra.run.smithi155.stdout: }, 2023-08-01T19:55:01.025 INFO:teuthology.orchestra.run.smithi155.stdout: "events": [ 2023-08-01T19:55:01.025 INFO:teuthology.orchestra.run.smithi155.stdout: { 2023-08-01T19:55:01.025 INFO:teuthology.orchestra.run.smithi155.stdout: "event": "initiated", 2023-08-01T19:55:01.025 INFO:teuthology.orchestra.run.smithi155.stdout: "time": "2023-08-01T19:54:51.461880+0000", 2023-08-01T19:55:01.025 INFO:teuthology.orchestra.run.smithi155.stdout: "duration": 0 2023-08-01T19:55:01.025 INFO:teuthology.orchestra.run.smithi155.stdout: }, 2023-08-01T19:55:01.025 INFO:teuthology.orchestra.run.smithi155.stdout: { 2023-08-01T19:55:01.025 INFO:teuthology.orchestra.run.smithi155.stdout: "event": "throttled", 2023-08-01T19:55:01.026 INFO:teuthology.orchestra.run.smithi155.stdout: "time": "2023-08-01T19:54:51.461880+0000", 2023-08-01T19:55:01.026 INFO:teuthology.orchestra.run.smithi155.stdout: "duration": 0 2023-08-01T19:55:01.026 INFO:teuthology.orchestra.run.smithi155.stdout: }, 2023-08-01T19:55:01.026 INFO:teuthology.orchestra.run.smithi155.stdout: { 2023-08-01T19:55:01.026 INFO:teuthology.orchestra.run.smithi155.stdout: "event": "header_read", 2023-08-01T19:55:01.026 INFO:teuthology.orchestra.run.smithi155.stdout: "time": "2023-08-01T19:54:51.461879+0000", 2023-08-01T19:55:01.026 INFO:teuthology.orchestra.run.smithi155.stdout: "duration": 4294967295.999999 2023-08-01T19:55:01.026 INFO:teuthology.orchestra.run.smithi155.stdout: }, 2023-08-01T19:55:01.027 INFO:teuthology.orchestra.run.smithi155.stdout: { 2023-08-01T19:55:01.027 INFO:teuthology.orchestra.run.smithi155.stdout: "event": "all_read", 2023-08-01T19:55:01.027 INFO:teuthology.orchestra.run.smithi155.stdout: "time": "2023-08-01T19:54:51.461950+0000", 2023-08-01T19:55:01.027 INFO:teuthology.orchestra.run.smithi155.stdout: "duration": 7.1371999999999994e-05 2023-08-01T19:55:01.027 INFO:teuthology.orchestra.run.smithi155.stdout: }, 2023-08-01T19:55:01.027 INFO:teuthology.orchestra.run.smithi155.stdout: { 2023-08-01T19:55:01.027 INFO:teuthology.orchestra.run.smithi155.stdout: "event": "dispatched", 2023-08-01T19:55:01.028 INFO:teuthology.orchestra.run.smithi155.stdout: "time": "2023-08-01T19:54:51.461962+0000", 2023-08-01T19:55:01.028 INFO:teuthology.orchestra.run.smithi155.stdout: "duration": 1.2193e-05 2023-08-01T19:55:01.028 INFO:teuthology.orchestra.run.smithi155.stdout: }, 2023-08-01T19:55:01.028 INFO:teuthology.orchestra.run.smithi155.stdout: { 2023-08-01T19:55:01.028 INFO:teuthology.orchestra.run.smithi155.stdout: "event": "queued_for_pg", 2023-08-01T19:55:01.028 INFO:teuthology.orchestra.run.smithi155.stdout: "time": "2023-08-01T19:54:51.461969+0000", 2023-08-01T19:55:01.028 INFO:teuthology.orchestra.run.smithi155.stdout: "duration": 6.6880000000000002e-06 2023-08-01T19:55:01.028 INFO:teuthology.orchestra.run.smithi155.stdout: }, 2023-08-01T19:55:01.029 INFO:teuthology.orchestra.run.smithi155.stdout: { 2023-08-01T19:55:01.029 INFO:teuthology.orchestra.run.smithi155.stdout: "event": "reached_pg", 2023-08-01T19:55:01.029 INFO:teuthology.orchestra.run.smithi155.stdout: "time": "2023-08-01T19:54:51.462013+0000", 2023-08-01T19:55:01.029 INFO:teuthology.orchestra.run.smithi155.stdout: "duration": 4.4227999999999997e-05 2023-08-01T19:55:01.029 INFO:teuthology.orchestra.run.smithi155.stdout: }, 2023-08-01T19:55:01.029 INFO:teuthology.orchestra.run.smithi155.stdout: { 2023-08-01T19:55:01.029 INFO:teuthology.orchestra.run.smithi155.stdout: "event": "started", 2023-08-01T19:55:01.029 INFO:teuthology.orchestra.run.smithi155.stdout: "time": "2023-08-01T19:54:51.462144+0000", 2023-08-01T19:55:01.030 INFO:teuthology.orchestra.run.smithi155.stdout: "duration": 0.000130545 2023-08-01T19:55:01.030 INFO:teuthology.orchestra.run.smithi155.stdout: }, 2023-08-01T19:55:01.030 INFO:teuthology.orchestra.run.smithi155.stdout: { 2023-08-01T19:55:01.030 INFO:teuthology.orchestra.run.smithi155.stdout: "event": "waiting for subops from 0", 2023-08-01T19:55:01.030 INFO:teuthology.orchestra.run.smithi155.stdout: "time": "2023-08-01T19:54:51.462334+0000", 2023-08-01T19:55:01.030 INFO:teuthology.orchestra.run.smithi155.stdout: "duration": 0.00019000000000000001 2023-08-01T19:55:01.030 INFO:teuthology.orchestra.run.smithi155.stdout: }, 2023-08-01T19:55:01.030 INFO:teuthology.orchestra.run.smithi155.stdout: { 2023-08-01T19:55:01.031 INFO:teuthology.orchestra.run.smithi155.stdout: "event": "sub_op_commit_rec", 2023-08-01T19:55:01.031 INFO:teuthology.orchestra.run.smithi155.stdout: "time": "2023-08-01T19:54:51.470224+0000", 2023-08-01T19:55:01.031 INFO:teuthology.orchestra.run.smithi155.stdout: "duration": 0.0078904000000000005 2023-08-01T19:55:01.031 INFO:teuthology.orchestra.run.smithi155.stdout: }, 2023-08-01T19:55:01.031 INFO:teuthology.orchestra.run.smithi155.stdout: { 2023-08-01T19:55:01.031 INFO:teuthology.orchestra.run.smithi155.stdout: "event": "op_commit", 2023-08-01T19:55:01.031 INFO:teuthology.orchestra.run.smithi155.stdout: "time": "2023-08-01T19:54:51.482650+0000", 2023-08-01T19:55:01.031 INFO:teuthology.orchestra.run.smithi155.stdout: "duration": 0.012425607 2023-08-01T19:55:01.032 INFO:teuthology.orchestra.run.smithi155.stdout: }, 2023-08-01T19:55:01.032 INFO:teuthology.orchestra.run.smithi155.stdout: { 2023-08-01T19:55:01.032 INFO:teuthology.orchestra.run.smithi155.stdout: "event": "commit_sent", 2023-08-01T19:55:01.032 INFO:teuthology.orchestra.run.smithi155.stdout: "time": "2023-08-01T19:54:51.482692+0000", 2023-08-01T19:55:01.032 INFO:teuthology.orchestra.run.smithi155.stdout: "duration": 4.1844000000000001e-05 2023-08-01T19:55:01.032 INFO:teuthology.orchestra.run.smithi155.stdout: }, 2023-08-01T19:55:01.032 INFO:teuthology.orchestra.run.smithi155.stdout: { 2023-08-01T19:55:01.033 INFO:teuthology.orchestra.run.smithi155.stdout: "event": "done", 2023-08-01T19:55:01.033 INFO:teuthology.orchestra.run.smithi155.stdout: "time": "2023-08-01T19:54:51.482730+0000", 2023-08-01T19:55:01.033 INFO:teuthology.orchestra.run.smithi155.stdout: "duration": 3.8223000000000003e-05 2023-08-01T19:55:01.033 INFO:teuthology.orchestra.run.smithi155.stdout: } 2023-08-01T19:55:01.033 INFO:teuthology.orchestra.run.smithi155.stdout: ] 2023-08-01T19:55:01.033 INFO:teuthology.orchestra.run.smithi155.stdout: } 2023-08-01T19:55:01.033 INFO:teuthology.orchestra.run.smithi155.stdout: }, 2023-08-01T19:55:01.033 INFO:teuthology.orchestra.run.smithi155.stdout: { 2023-08-01T19:55:01.034 INFO:teuthology.orchestra.run.smithi155.stdout: "description": "osd_op(client.4668.0:73461 5.8 5:1836657a:::benchmark_data_smithi006_114134_object73460:head [set-alloc-hint object_size 65536 write_size 65536,write 0~65536] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e31)", 2023-08-01T19:55:01.034 INFO:teuthology.orchestra.run.smithi155.stdout: "initiated_at": "2023-08-01T19:54:51.463336+0000", 2023-08-01T19:55:01.034 INFO:teuthology.orchestra.run.smithi155.stdout: "age": 9.4708458390000008, 2023-08-01T19:55:01.034 INFO:teuthology.orchestra.run.smithi155.stdout: "duration": 0.022268217, 2023-08-01T19:55:01.034 INFO:teuthology.orchestra.run.smithi155.stdout: "type_data": { 2023-08-01T19:55:01.034 INFO:teuthology.orchestra.run.smithi155.stdout: "flag_point": "commit sent; apply or cleanup", 2023-08-01T19:55:01.034 INFO:teuthology.orchestra.run.smithi155.stdout: "client_info": { 2023-08-01T19:55:01.035 INFO:teuthology.orchestra.run.smithi155.stdout: "client": "client.4668", 2023-08-01T19:55:01.035 INFO:teuthology.orchestra.run.smithi155.stdout: "client_addr": "172.21.15.6:0/1709472247", 2023-08-01T19:55:01.035 INFO:teuthology.orchestra.run.smithi155.stdout: "tid": 73461 2023-08-01T19:55:01.035 INFO:teuthology.orchestra.run.smithi155.stdout: }, 2023-08-01T19:55:01.035 INFO:teuthology.orchestra.run.smithi155.stdout: "events": [ 2023-08-01T19:55:01.035 INFO:teuthology.orchestra.run.smithi155.stdout: { 2023-08-01T19:55:01.035 INFO:teuthology.orchestra.run.smithi155.stdout: "event": "initiated", 2023-08-01T19:55:01.036 INFO:teuthology.orchestra.run.smithi155.stdout: "time": "2023-08-01T19:54:51.463336+0000", 2023-08-01T19:55:01.036 INFO:teuthology.orchestra.run.smithi155.stdout: "duration": 0 2023-08-01T19:55:01.036 INFO:teuthology.orchestra.run.smithi155.stdout: }, 2023-08-01T19:55:01.036 INFO:teuthology.orchestra.run.smithi155.stdout: { 2023-08-01T19:55:01.036 INFO:teuthology.orchestra.run.smithi155.stdout: "event": "throttled", 2023-08-01T19:55:01.036 INFO:teuthology.orchestra.run.smithi155.stdout: "time": "2023-08-01T19:54:51.463336+0000", 2023-08-01T19:55:01.036 INFO:teuthology.orchestra.run.smithi155.stdout: "duration": 0 2023-08-01T19:55:01.036 INFO:teuthology.orchestra.run.smithi155.stdout: }, 2023-08-01T19:55:01.037 INFO:teuthology.orchestra.run.smithi155.stdout: { 2023-08-01T19:55:01.037 INFO:teuthology.orchestra.run.smithi155.stdout: "event": "header_read", 2023-08-01T19:55:01.037 INFO:teuthology.orchestra.run.smithi155.stdout: "time": "2023-08-01T19:54:51.463335+0000", 2023-08-01T19:55:01.037 INFO:teuthology.orchestra.run.smithi155.stdout: "duration": 4294967295.999999 2023-08-01T19:55:01.037 INFO:teuthology.orchestra.run.smithi155.stdout: }, 2023-08-01T19:55:01.037 INFO:teuthology.orchestra.run.smithi155.stdout: { 2023-08-01T19:55:01.037 INFO:teuthology.orchestra.run.smithi155.stdout: "event": "all_read", 2023-08-01T19:55:01.037 INFO:teuthology.orchestra.run.smithi155.stdout: "time": "2023-08-01T19:54:51.463437+0000", 2023-08-01T19:55:01.038 INFO:teuthology.orchestra.run.smithi155.stdout: "duration": 0.00010173700000000001 2023-08-01T19:55:01.038 INFO:teuthology.orchestra.run.smithi155.stdout: }, 2023-08-01T19:55:01.038 INFO:teuthology.orchestra.run.smithi155.stdout: { 2023-08-01T19:55:01.038 INFO:teuthology.orchestra.run.smithi155.stdout: "event": "dispatched", 2023-08-01T19:55:01.038 INFO:teuthology.orchestra.run.smithi155.stdout: "time": "2023-08-01T19:54:51.463448+0000", 2023-08-01T19:55:01.038 INFO:teuthology.orchestra.run.smithi155.stdout: "duration": 1.171e-05 2023-08-01T19:55:01.038 INFO:teuthology.orchestra.run.smithi155.stdout: }, 2023-08-01T19:55:01.039 INFO:teuthology.orchestra.run.smithi155.stdout: { 2023-08-01T19:55:01.039 INFO:teuthology.orchestra.run.smithi155.stdout: "event": "queued_for_pg", 2023-08-01T19:55:01.039 INFO:teuthology.orchestra.run.smithi155.stdout: "time": "2023-08-01T19:54:51.463454+0000", 2023-08-01T19:55:01.039 INFO:teuthology.orchestra.run.smithi155.stdout: "duration": 6.0959999999999997e-06 2023-08-01T19:55:01.039 INFO:teuthology.orchestra.run.smithi155.stdout: }, 2023-08-01T19:55:01.039 INFO:teuthology.orchestra.run.smithi155.stdout: { 2023-08-01T19:55:01.039 INFO:teuthology.orchestra.run.smithi155.stdout: "event": "reached_pg", 2023-08-01T19:55:01.039 INFO:teuthology.orchestra.run.smithi155.stdout: "time": "2023-08-01T19:54:51.463491+0000", 2023-08-01T19:55:01.040 INFO:teuthology.orchestra.run.smithi155.stdout: "duration": 3.6365999999999997e-05 2023-08-01T19:55:01.040 INFO:teuthology.orchestra.run.smithi155.stdout: }, 2023-08-01T19:55:01.040 INFO:teuthology.orchestra.run.smithi155.stdout: { 2023-08-01T19:55:01.040 INFO:teuthology.orchestra.run.smithi155.stdout: "event": "started", 2023-08-01T19:55:01.040 INFO:teuthology.orchestra.run.smithi155.stdout: "time": "2023-08-01T19:54:51.463610+0000", 2023-08-01T19:55:01.040 INFO:teuthology.orchestra.run.smithi155.stdout: "duration": 0.000119517 2023-08-01T19:55:01.040 INFO:teuthology.orchestra.run.smithi155.stdout: }, 2023-08-01T19:55:01.040 INFO:teuthology.orchestra.run.smithi155.stdout: { 2023-08-01T19:55:01.041 INFO:teuthology.orchestra.run.smithi155.stdout: "event": "waiting for subops from 0", 2023-08-01T19:55:01.041 INFO:teuthology.orchestra.run.smithi155.stdout: "time": "2023-08-01T19:54:51.463746+0000", 2023-08-01T19:55:01.041 INFO:teuthology.orchestra.run.smithi155.stdout: "duration": 0.000136179 2023-08-01T19:55:01.041 INFO:teuthology.orchestra.run.smithi155.stdout: }, 2023-08-01T19:55:01.041 INFO:teuthology.orchestra.run.smithi155.stdout: { 2023-08-01T19:55:01.041 INFO:teuthology.orchestra.run.smithi155.stdout: "event": "sub_op_commit_rec", 2023-08-01T19:55:01.041 INFO:teuthology.orchestra.run.smithi155.stdout: "time": "2023-08-01T19:54:51.480388+0000", 2023-08-01T19:55:01.041 INFO:teuthology.orchestra.run.smithi155.stdout: "duration": 0.016641810999999999 2023-08-01T19:55:01.042 INFO:teuthology.orchestra.run.smithi155.stdout: }, 2023-08-01T19:55:01.042 INFO:teuthology.orchestra.run.smithi155.stdout: { 2023-08-01T19:55:01.042 INFO:teuthology.orchestra.run.smithi155.stdout: "event": "op_commit", 2023-08-01T19:55:01.042 INFO:teuthology.orchestra.run.smithi155.stdout: "time": "2023-08-01T19:54:51.485526+0000", 2023-08-01T19:55:01.042 INFO:teuthology.orchestra.run.smithi155.stdout: "duration": 0.0051382759999999998 2023-08-01T19:55:01.042 INFO:teuthology.orchestra.run.smithi155.stdout: }, 2023-08-01T19:55:01.042 INFO:teuthology.orchestra.run.smithi155.stdout: { 2023-08-01T19:55:01.042 INFO:teuthology.orchestra.run.smithi155.stdout: "event": "commit_sent", 2023-08-01T19:55:01.043 INFO:teuthology.orchestra.run.smithi155.stdout: "time": "2023-08-01T19:54:51.485569+0000", 2023-08-01T19:55:01.043 INFO:teuthology.orchestra.run.smithi155.stdout: "duration": 4.2840999999999999e-05 2023-08-01T19:55:01.043 INFO:teuthology.orchestra.run.smithi155.stdout: }, 2023-08-01T19:55:01.043 INFO:teuthology.orchestra.run.smithi155.stdout: { 2023-08-01T19:55:01.043 INFO:teuthology.orchestra.run.smithi155.stdout: "event": "done", 2023-08-01T19:55:01.043 INFO:teuthology.orchestra.run.smithi155.stdout: "time": "2023-08-01T19:54:51.485604+0000", 2023-08-01T19:55:01.043 INFO:teuthology.orchestra.run.smithi155.stdout: "duration": 3.4731999999999999e-05 2023-08-01T19:55:01.044 INFO:teuthology.orchestra.run.smithi155.stdout: } 2023-08-01T19:55:01.044 INFO:teuthology.orchestra.run.smithi155.stdout: ] 2023-08-01T19:55:01.044 INFO:teuthology.orchestra.run.smithi155.stdout: } 2023-08-01T19:55:01.044 INFO:teuthology.orchestra.run.smithi155.stdout: }, 2023-08-01T19:55:01.044 INFO:teuthology.orchestra.run.smithi155.stdout: { 2023-08-01T19:55:01.044 INFO:teuthology.orchestra.run.smithi155.stdout: "description": "osd_repop(client.4668.0:73460 5.f e31/19 5:ff4f0704:::benchmark_data_smithi006_114134_object73459:head v 31'4631, mlcod=31'4629)", 2023-08-01T19:55:01.044 INFO:teuthology.orchestra.run.smithi155.stdout: "initiated_at": "2023-08-01T19:54:51.463349+0000", 2023-08-01T19:55:01.044 INFO:teuthology.orchestra.run.smithi155.stdout: "age": 9.4708325739999992, 2023-08-01T19:55:01.045 INFO:teuthology.orchestra.run.smithi155.stdout: "duration": 0.019357510000000001, 2023-08-01T19:55:01.045 INFO:teuthology.orchestra.run.smithi155.stdout: "type_data": { 2023-08-01T19:55:01.045 INFO:teuthology.orchestra.run.smithi155.stdout: "flag_point": "commit sent; apply or cleanup", 2023-08-01T19:55:01.045 INFO:teuthology.orchestra.run.smithi155.stdout: "events": [ 2023-08-01T19:55:01.045 INFO:teuthology.orchestra.run.smithi155.stdout: { 2023-08-01T19:55:01.045 INFO:teuthology.orchestra.run.smithi155.stdout: "event": "initiated", 2023-08-01T19:55:01.045 INFO:teuthology.orchestra.run.smithi155.stdout: "time": "2023-08-01T19:54:51.463349+0000", 2023-08-01T19:55:01.045 INFO:teuthology.orchestra.run.smithi155.stdout: "duration": 0 2023-08-01T19:55:01.046 INFO:teuthology.orchestra.run.smithi155.stdout: }, 2023-08-01T19:55:01.046 INFO:teuthology.orchestra.run.smithi155.stdout: { 2023-08-01T19:55:01.046 INFO:teuthology.orchestra.run.smithi155.stdout: "event": "throttled", 2023-08-01T19:55:01.046 INFO:teuthology.orchestra.run.smithi155.stdout: "time": "2023-08-01T19:54:51.463349+0000", 2023-08-01T19:55:01.046 INFO:teuthology.orchestra.run.smithi155.stdout: "duration": 0 2023-08-01T19:55:01.046 INFO:teuthology.orchestra.run.smithi155.stdout: }, 2023-08-01T19:55:01.046 INFO:teuthology.orchestra.run.smithi155.stdout: { 2023-08-01T19:55:01.046 INFO:teuthology.orchestra.run.smithi155.stdout: "event": "header_read", 2023-08-01T19:55:01.047 INFO:teuthology.orchestra.run.smithi155.stdout: "time": "2023-08-01T19:54:51.463349+0000", 2023-08-01T19:55:01.047 INFO:teuthology.orchestra.run.smithi155.stdout: "duration": 4294967295.9999995 2023-08-01T19:55:01.047 INFO:teuthology.orchestra.run.smithi155.stdout: }, 2023-08-01T19:55:01.047 INFO:teuthology.orchestra.run.smithi155.stdout: { 2023-08-01T19:55:01.047 INFO:teuthology.orchestra.run.smithi155.stdout: "event": "all_read", 2023-08-01T19:55:01.047 INFO:teuthology.orchestra.run.smithi155.stdout: "time": "2023-08-01T19:54:51.463482+0000", 2023-08-01T19:55:01.047 INFO:teuthology.orchestra.run.smithi155.stdout: "duration": 0.00013323 2023-08-01T19:55:01.047 INFO:teuthology.orchestra.run.smithi155.stdout: }, 2023-08-01T19:55:01.048 INFO:teuthology.orchestra.run.smithi155.stdout: { 2023-08-01T19:55:01.048 INFO:teuthology.orchestra.run.smithi155.stdout: "event": "dispatched", 2023-08-01T19:55:01.048 INFO:teuthology.orchestra.run.smithi155.stdout: "time": "2023-08-01T19:54:51.463490+0000", 2023-08-01T19:55:01.048 INFO:teuthology.orchestra.run.smithi155.stdout: "duration": 7.6869999999999994e-06 2023-08-01T19:55:01.048 INFO:teuthology.orchestra.run.smithi155.stdout: }, 2023-08-01T19:55:01.048 INFO:teuthology.orchestra.run.smithi155.stdout: { 2023-08-01T19:55:01.048 INFO:teuthology.orchestra.run.smithi155.stdout: "event": "queued_for_pg", 2023-08-01T19:55:01.049 INFO:teuthology.orchestra.run.smithi155.stdout: "time": "2023-08-01T19:54:51.463494+0000", 2023-08-01T19:55:01.049 INFO:teuthology.orchestra.run.smithi155.stdout: "duration": 4.5220000000000001e-06 2023-08-01T19:55:01.049 INFO:teuthology.orchestra.run.smithi155.stdout: }, 2023-08-01T19:55:01.049 INFO:teuthology.orchestra.run.smithi155.stdout: { 2023-08-01T19:55:01.049 INFO:teuthology.orchestra.run.smithi155.stdout: "event": "reached_pg", 2023-08-01T19:55:01.049 INFO:teuthology.orchestra.run.smithi155.stdout: "time": "2023-08-01T19:54:51.463864+0000", 2023-08-01T19:55:01.049 INFO:teuthology.orchestra.run.smithi155.stdout: "duration": 0.00036956700000000001 2023-08-01T19:55:01.049 INFO:teuthology.orchestra.run.smithi155.stdout: }, 2023-08-01T19:55:01.050 INFO:teuthology.orchestra.run.smithi155.stdout: { 2023-08-01T19:55:01.050 INFO:teuthology.orchestra.run.smithi155.stdout: "event": "started", 2023-08-01T19:55:01.050 INFO:teuthology.orchestra.run.smithi155.stdout: "time": "2023-08-01T19:54:51.463884+0000", 2023-08-01T19:55:01.050 INFO:teuthology.orchestra.run.smithi155.stdout: "duration": 2.0029000000000001e-05 2023-08-01T19:55:01.050 INFO:teuthology.orchestra.run.smithi155.stdout: }, 2023-08-01T19:55:01.050 INFO:teuthology.orchestra.run.smithi155.stdout: { 2023-08-01T19:55:01.050 INFO:teuthology.orchestra.run.smithi155.stdout: "event": "commit_sent", 2023-08-01T19:55:01.051 INFO:teuthology.orchestra.run.smithi155.stdout: "time": "2023-08-01T19:54:51.482669+0000", 2023-08-01T19:55:01.051 INFO:teuthology.orchestra.run.smithi155.stdout: "duration": 0.018784896999999998 2023-08-01T19:55:01.051 INFO:teuthology.orchestra.run.smithi155.stdout: }, 2023-08-01T19:55:01.051 INFO:teuthology.orchestra.run.smithi155.stdout: { 2023-08-01T19:55:01.051 INFO:teuthology.orchestra.run.smithi155.stdout: "event": "done", 2023-08-01T19:55:01.051 INFO:teuthology.orchestra.run.smithi155.stdout: "time": "2023-08-01T19:54:51.482707+0000", 2023-08-01T19:55:01.051 INFO:teuthology.orchestra.run.smithi155.stdout: "duration": 3.7928e-05 2023-08-01T19:55:01.051 INFO:teuthology.orchestra.run.smithi155.stdout: } 2023-08-01T19:55:01.052 INFO:teuthology.orchestra.run.smithi155.stdout: ] 2023-08-01T19:55:01.052 INFO:teuthology.orchestra.run.smithi155.stdout: } 2023-08-01T19:55:01.052 INFO:teuthology.orchestra.run.smithi155.stdout: }, 2023-08-01T19:55:01.052 INFO:teuthology.orchestra.run.smithi155.stdout: { 2023-08-01T19:55:01.052 INFO:teuthology.orchestra.run.smithi155.stdout: "description": "osd_op(client.4668.0:73462 5.0 5:01d74876:::benchmark_data_smithi006_114134_object73461:head [set-alloc-hint object_size 65536 write_size 65536,write 0~65536] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e31)", 2023-08-01T19:55:01.052 INFO:teuthology.orchestra.run.smithi155.stdout: "initiated_at": "2023-08-01T19:54:51.463648+0000", 2023-08-01T19:55:01.052 INFO:teuthology.orchestra.run.smithi155.stdout: "age": 9.4705341409999999, 2023-08-01T19:55:01.053 INFO:teuthology.orchestra.run.smithi155.stdout: "duration": 0.021868533999999999, 2023-08-01T19:55:01.053 INFO:teuthology.orchestra.run.smithi155.stdout: "type_data": { 2023-08-01T19:55:01.053 INFO:teuthology.orchestra.run.smithi155.stdout: "flag_point": "commit sent; apply or cleanup", 2023-08-01T19:55:01.053 INFO:teuthology.orchestra.run.smithi155.stdout: "client_info": { 2023-08-01T19:55:01.053 INFO:teuthology.orchestra.run.smithi155.stdout: "client": "client.4668", 2023-08-01T19:55:01.053 INFO:teuthology.orchestra.run.smithi155.stdout: "client_addr": "172.21.15.6:0/1709472247", 2023-08-01T19:55:01.053 INFO:teuthology.orchestra.run.smithi155.stdout: "tid": 73462 2023-08-01T19:55:01.053 INFO:teuthology.orchestra.run.smithi155.stdout: }, 2023-08-01T19:55:01.054 INFO:teuthology.orchestra.run.smithi155.stdout: "events": [ 2023-08-01T19:55:01.054 INFO:teuthology.orchestra.run.smithi155.stdout: { 2023-08-01T19:55:01.054 INFO:teuthology.orchestra.run.smithi155.stdout: "event": "initiated", 2023-08-01T19:55:01.054 INFO:teuthology.orchestra.run.smithi155.stdout: "time": "2023-08-01T19:54:51.463648+0000", 2023-08-01T19:55:01.054 INFO:teuthology.orchestra.run.smithi155.stdout: "duration": 0 2023-08-01T19:55:01.054 INFO:teuthology.orchestra.run.smithi155.stdout: }, 2023-08-01T19:55:01.054 INFO:teuthology.orchestra.run.smithi155.stdout: { 2023-08-01T19:55:01.055 INFO:teuthology.orchestra.run.smithi155.stdout: "event": "throttled", 2023-08-01T19:55:01.055 INFO:teuthology.orchestra.run.smithi155.stdout: "time": "2023-08-01T19:54:51.463648+0000", 2023-08-01T19:55:01.055 INFO:teuthology.orchestra.run.smithi155.stdout: "duration": 0 2023-08-01T19:55:01.055 INFO:teuthology.orchestra.run.smithi155.stdout: }, 2023-08-01T19:55:01.055 INFO:teuthology.orchestra.run.smithi155.stdout: { 2023-08-01T19:55:01.055 INFO:teuthology.orchestra.run.smithi155.stdout: "event": "header_read", 2023-08-01T19:55:01.055 INFO:teuthology.orchestra.run.smithi155.stdout: "time": "2023-08-01T19:54:51.463646+0000", 2023-08-01T19:55:01.055 INFO:teuthology.orchestra.run.smithi155.stdout: "duration": 4294967295.999999 2023-08-01T19:55:01.056 INFO:teuthology.orchestra.run.smithi155.stdout: }, 2023-08-01T19:55:01.056 INFO:teuthology.orchestra.run.smithi155.stdout: { 2023-08-01T19:55:01.056 INFO:teuthology.orchestra.run.smithi155.stdout: "event": "all_read", 2023-08-01T19:55:01.056 INFO:teuthology.orchestra.run.smithi155.stdout: "time": "2023-08-01T19:54:51.463706+0000", 2023-08-01T19:55:01.056 INFO:teuthology.orchestra.run.smithi155.stdout: "duration": 6.0010000000000003e-05 2023-08-01T19:55:01.056 INFO:teuthology.orchestra.run.smithi155.stdout: }, 2023-08-01T19:55:01.056 INFO:teuthology.orchestra.run.smithi155.stdout: { 2023-08-01T19:55:01.056 INFO:teuthology.orchestra.run.smithi155.stdout: "event": "dispatched", 2023-08-01T19:55:01.057 INFO:teuthology.orchestra.run.smithi155.stdout: "time": "2023-08-01T19:54:51.463715+0000", 2023-08-01T19:55:01.057 INFO:teuthology.orchestra.run.smithi155.stdout: "duration": 8.5089999999999993e-06 2023-08-01T19:55:01.057 INFO:teuthology.orchestra.run.smithi155.stdout: }, 2023-08-01T19:55:01.057 INFO:teuthology.orchestra.run.smithi155.stdout: { 2023-08-01T19:55:01.057 INFO:teuthology.orchestra.run.smithi155.stdout: "event": "queued_for_pg", 2023-08-01T19:55:01.057 INFO:teuthology.orchestra.run.smithi155.stdout: "time": "2023-08-01T19:54:51.463720+0000", 2023-08-01T19:55:01.057 INFO:teuthology.orchestra.run.smithi155.stdout: "duration": 4.95e-06 2023-08-01T19:55:01.057 INFO:teuthology.orchestra.run.smithi155.stdout: }, 2023-08-01T19:55:01.058 INFO:teuthology.orchestra.run.smithi155.stdout: { 2023-08-01T19:55:01.058 INFO:teuthology.orchestra.run.smithi155.stdout: "event": "reached_pg", 2023-08-01T19:55:01.058 INFO:teuthology.orchestra.run.smithi155.stdout: "time": "2023-08-01T19:54:51.468441+0000", 2023-08-01T19:55:01.058 INFO:teuthology.orchestra.run.smithi155.stdout: "duration": 0.0047213819999999997 2023-08-01T19:55:01.058 INFO:teuthology.orchestra.run.smithi155.stdout: }, 2023-08-01T19:55:01.058 INFO:teuthology.orchestra.run.smithi155.stdout: { 2023-08-01T19:55:01.058 INFO:teuthology.orchestra.run.smithi155.stdout: "event": "started", 2023-08-01T19:55:01.058 INFO:teuthology.orchestra.run.smithi155.stdout: "time": "2023-08-01T19:54:51.468553+0000", 2023-08-01T19:55:01.059 INFO:teuthology.orchestra.run.smithi155.stdout: "duration": 0.000111462 2023-08-01T19:55:01.059 INFO:teuthology.orchestra.run.smithi155.stdout: }, 2023-08-01T19:55:01.059 INFO:teuthology.orchestra.run.smithi155.stdout: { 2023-08-01T19:55:01.059 INFO:teuthology.orchestra.run.smithi155.stdout: "event": "waiting for subops from 0", 2023-08-01T19:55:01.059 INFO:teuthology.orchestra.run.smithi155.stdout: "time": "2023-08-01T19:54:51.468697+0000", 2023-08-01T19:55:01.059 INFO:teuthology.orchestra.run.smithi155.stdout: "duration": 0.000144411 2023-08-01T19:55:01.059 INFO:teuthology.orchestra.run.smithi155.stdout: }, 2023-08-01T19:55:01.060 INFO:teuthology.orchestra.run.smithi155.stdout: { 2023-08-01T19:55:01.060 INFO:teuthology.orchestra.run.smithi155.stdout: "event": "sub_op_commit_rec", 2023-08-01T19:55:01.060 INFO:teuthology.orchestra.run.smithi155.stdout: "time": "2023-08-01T19:54:51.480377+0000", 2023-08-01T19:55:01.060 INFO:teuthology.orchestra.run.smithi155.stdout: "duration": 0.011680106000000001 2023-08-01T19:55:01.060 INFO:teuthology.orchestra.run.smithi155.stdout: }, 2023-08-01T19:55:01.060 INFO:teuthology.orchestra.run.smithi155.stdout: { 2023-08-01T19:55:01.060 INFO:teuthology.orchestra.run.smithi155.stdout: "event": "op_commit", 2023-08-01T19:55:01.060 INFO:teuthology.orchestra.run.smithi155.stdout: "time": "2023-08-01T19:54:51.485427+0000", 2023-08-01T19:55:01.061 INFO:teuthology.orchestra.run.smithi155.stdout: "duration": 0.005049998 2023-08-01T19:55:01.061 INFO:teuthology.orchestra.run.smithi155.stdout: }, 2023-08-01T19:55:01.061 INFO:teuthology.orchestra.run.smithi155.stdout: { 2023-08-01T19:55:01.061 INFO:teuthology.orchestra.run.smithi155.stdout: "event": "commit_sent", 2023-08-01T19:55:01.061 INFO:teuthology.orchestra.run.smithi155.stdout: "time": "2023-08-01T19:54:51.485485+0000", 2023-08-01T19:55:01.061 INFO:teuthology.orchestra.run.smithi155.stdout: "duration": 5.8199999999999998e-05 2023-08-01T19:55:01.061 INFO:teuthology.orchestra.run.smithi155.stdout: }, 2023-08-01T19:55:01.062 INFO:teuthology.orchestra.run.smithi155.stdout: { 2023-08-01T19:55:01.062 INFO:teuthology.orchestra.run.smithi155.stdout: "event": "done", 2023-08-01T19:55:01.062 INFO:teuthology.orchestra.run.smithi155.stdout: "time": "2023-08-01T19:54:51.485516+0000", 2023-08-01T19:55:01.062 INFO:teuthology.orchestra.run.smithi155.stdout: "duration": 3.0602999999999998e-05 2023-08-01T19:55:01.062 INFO:teuthology.orchestra.run.smithi155.stdout: } 2023-08-01T19:55:01.062 INFO:teuthology.orchestra.run.smithi155.stdout: ] 2023-08-01T19:55:01.062 INFO:teuthology.orchestra.run.smithi155.stdout: } 2023-08-01T19:55:01.062 INFO:teuthology.orchestra.run.smithi155.stdout: }, 2023-08-01T19:55:01.063 INFO:teuthology.orchestra.run.smithi155.stdout: { 2023-08-01T19:55:01.063 INFO:teuthology.orchestra.run.smithi155.stdout: "description": "osd_op(client.4668.0:73465 5.8 5:1617a69f:::benchmark_data_smithi006_114134_object73464:head [set-alloc-hint object_size 65536 write_size 65536,write 0~65536] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e31)", 2023-08-01T19:55:01.063 INFO:teuthology.orchestra.run.smithi155.stdout: "initiated_at": "2023-08-01T19:54:51.465724+0000", 2023-08-01T19:55:01.063 INFO:teuthology.orchestra.run.smithi155.stdout: "age": 9.4684579089999996, 2023-08-01T19:55:01.063 INFO:teuthology.orchestra.run.smithi155.stdout: "duration": 0.019964584, 2023-08-01T19:55:01.063 INFO:teuthology.orchestra.run.smithi155.stdout: "type_data": { 2023-08-01T19:55:01.063 INFO:teuthology.orchestra.run.smithi155.stdout: "flag_point": "commit sent; apply or cleanup", 2023-08-01T19:55:01.063 INFO:teuthology.orchestra.run.smithi155.stdout: "client_info": { 2023-08-01T19:55:01.064 INFO:teuthology.orchestra.run.smithi155.stdout: "client": "client.4668", 2023-08-01T19:55:01.064 INFO:teuthology.orchestra.run.smithi155.stdout: "client_addr": "172.21.15.6:0/1709472247", 2023-08-01T19:55:01.064 INFO:teuthology.orchestra.run.smithi155.stdout: "tid": 73465 2023-08-01T19:55:01.064 INFO:teuthology.orchestra.run.smithi155.stdout: }, 2023-08-01T19:55:01.064 INFO:teuthology.orchestra.run.smithi155.stdout: "events": [ 2023-08-01T19:55:01.064 INFO:teuthology.orchestra.run.smithi155.stdout: { 2023-08-01T19:55:01.064 INFO:teuthology.orchestra.run.smithi155.stdout: "event": "initiated", 2023-08-01T19:55:01.064 INFO:teuthology.orchestra.run.smithi155.stdout: "time": "2023-08-01T19:54:51.465724+0000", 2023-08-01T19:55:01.065 INFO:teuthology.orchestra.run.smithi155.stdout: "duration": 0 2023-08-01T19:55:01.065 INFO:teuthology.orchestra.run.smithi155.stdout: }, 2023-08-01T19:55:01.065 INFO:teuthology.orchestra.run.smithi155.stdout: { 2023-08-01T19:55:01.065 INFO:teuthology.orchestra.run.smithi155.stdout: "event": "throttled", 2023-08-01T19:55:01.065 INFO:teuthology.orchestra.run.smithi155.stdout: "time": "2023-08-01T19:54:51.465724+0000", 2023-08-01T19:55:01.065 INFO:teuthology.orchestra.run.smithi155.stdout: "duration": 0 2023-08-01T19:55:01.065 INFO:teuthology.orchestra.run.smithi155.stdout: }, 2023-08-01T19:55:01.066 INFO:teuthology.orchestra.run.smithi155.stdout: { 2023-08-01T19:55:01.066 INFO:teuthology.orchestra.run.smithi155.stdout: "event": "header_read", 2023-08-01T19:55:01.066 INFO:teuthology.orchestra.run.smithi155.stdout: "time": "2023-08-01T19:54:51.465723+0000", 2023-08-01T19:55:01.066 INFO:teuthology.orchestra.run.smithi155.stdout: "duration": 4294967295.9999995 2023-08-01T19:55:01.066 INFO:teuthology.orchestra.run.smithi155.stdout: }, 2023-08-01T19:55:01.066 INFO:teuthology.orchestra.run.smithi155.stdout: { 2023-08-01T19:55:01.066 INFO:teuthology.orchestra.run.smithi155.stdout: "event": "all_read", 2023-08-01T19:55:01.066 INFO:teuthology.orchestra.run.smithi155.stdout: "time": "2023-08-01T19:54:51.465868+0000", 2023-08-01T19:55:01.067 INFO:teuthology.orchestra.run.smithi155.stdout: "duration": 0.000145289 2023-08-01T19:55:01.067 INFO:teuthology.orchestra.run.smithi155.stdout: }, 2023-08-01T19:55:01.067 INFO:teuthology.orchestra.run.smithi155.stdout: { 2023-08-01T19:55:01.067 INFO:teuthology.orchestra.run.smithi155.stdout: "event": "dispatched", 2023-08-01T19:55:01.067 INFO:teuthology.orchestra.run.smithi155.stdout: "time": "2023-08-01T19:54:51.465880+0000", 2023-08-01T19:55:01.067 INFO:teuthology.orchestra.run.smithi155.stdout: "duration": 1.1378e-05 2023-08-01T19:55:01.067 INFO:teuthology.orchestra.run.smithi155.stdout: }, 2023-08-01T19:55:01.067 INFO:teuthology.orchestra.run.smithi155.stdout: { 2023-08-01T19:55:01.068 INFO:teuthology.orchestra.run.smithi155.stdout: "event": "queued_for_pg", 2023-08-01T19:55:01.068 INFO:teuthology.orchestra.run.smithi155.stdout: "time": "2023-08-01T19:54:51.465885+0000", 2023-08-01T19:55:01.068 INFO:teuthology.orchestra.run.smithi155.stdout: "duration": 4.7559999999999999e-06 2023-08-01T19:55:01.068 INFO:teuthology.orchestra.run.smithi155.stdout: }, 2023-08-01T19:55:01.068 INFO:teuthology.orchestra.run.smithi155.stdout: { 2023-08-01T19:55:01.068 INFO:teuthology.orchestra.run.smithi155.stdout: "event": "reached_pg", 2023-08-01T19:55:01.068 INFO:teuthology.orchestra.run.smithi155.stdout: "time": "2023-08-01T19:54:51.468434+0000", 2023-08-01T19:55:01.068 INFO:teuthology.orchestra.run.smithi155.stdout: "duration": 0.0025498579999999999 2023-08-01T19:55:01.069 INFO:teuthology.orchestra.run.smithi155.stdout: }, 2023-08-01T19:55:01.069 INFO:teuthology.orchestra.run.smithi155.stdout: { 2023-08-01T19:55:01.069 INFO:teuthology.orchestra.run.smithi155.stdout: "event": "started", 2023-08-01T19:55:01.069 INFO:teuthology.orchestra.run.smithi155.stdout: "time": "2023-08-01T19:54:51.468552+0000", 2023-08-01T19:55:01.069 INFO:teuthology.orchestra.run.smithi155.stdout: "duration": 0.000117992 2023-08-01T19:55:01.069 INFO:teuthology.orchestra.run.smithi155.stdout: }, 2023-08-01T19:55:01.069 INFO:teuthology.orchestra.run.smithi155.stdout: { 2023-08-01T19:55:01.070 INFO:teuthology.orchestra.run.smithi155.stdout: "event": "waiting for subops from 0", 2023-08-01T19:55:01.070 INFO:teuthology.orchestra.run.smithi155.stdout: "time": "2023-08-01T19:54:51.468697+0000", 2023-08-01T19:55:01.070 INFO:teuthology.orchestra.run.smithi155.stdout: "duration": 0.000144769 2023-08-01T19:55:01.070 INFO:teuthology.orchestra.run.smithi155.stdout: }, 2023-08-01T19:55:01.070 INFO:teuthology.orchestra.run.smithi155.stdout: { 2023-08-01T19:55:01.070 INFO:teuthology.orchestra.run.smithi155.stdout: "event": "sub_op_commit_rec", 2023-08-01T19:55:01.070 INFO:teuthology.orchestra.run.smithi155.stdout: "time": "2023-08-01T19:54:51.480446+0000", 2023-08-01T19:55:01.070 INFO:teuthology.orchestra.run.smithi155.stdout: "duration": 0.011749257000000001 2023-08-01T19:55:01.071 INFO:teuthology.orchestra.run.smithi155.stdout: }, 2023-08-01T19:55:01.071 INFO:teuthology.orchestra.run.smithi155.stdout: { 2023-08-01T19:55:01.071 INFO:teuthology.orchestra.run.smithi155.stdout: "event": "op_commit", 2023-08-01T19:55:01.071 INFO:teuthology.orchestra.run.smithi155.stdout: "time": "2023-08-01T19:54:51.485613+0000", 2023-08-01T19:55:01.071 INFO:teuthology.orchestra.run.smithi155.stdout: "duration": 0.0051662269999999998 2023-08-01T19:55:01.071 INFO:teuthology.orchestra.run.smithi155.stdout: }, 2023-08-01T19:55:01.071 INFO:teuthology.orchestra.run.smithi155.stdout: { 2023-08-01T19:55:01.071 INFO:teuthology.orchestra.run.smithi155.stdout: "event": "commit_sent", 2023-08-01T19:55:01.072 INFO:teuthology.orchestra.run.smithi155.stdout: "time": "2023-08-01T19:54:51.485655+0000", 2023-08-01T19:55:01.072 INFO:teuthology.orchestra.run.smithi155.stdout: "duration": 4.1879999999999999e-05 2023-08-01T19:55:01.072 INFO:teuthology.orchestra.run.smithi155.stdout: }, 2023-08-01T19:55:01.072 INFO:teuthology.orchestra.run.smithi155.stdout: { 2023-08-01T19:55:01.072 INFO:teuthology.orchestra.run.smithi155.stdout: "event": "done", 2023-08-01T19:55:01.072 INFO:teuthology.orchestra.run.smithi155.stdout: "time": "2023-08-01T19:54:51.485688+0000", 2023-08-01T19:55:01.072 INFO:teuthology.orchestra.run.smithi155.stdout: "duration": 3.3800999999999997e-05 2023-08-01T19:55:01.072 INFO:teuthology.orchestra.run.smithi155.stdout: } 2023-08-01T19:55:01.073 INFO:teuthology.orchestra.run.smithi155.stdout: ] 2023-08-01T19:55:01.073 INFO:teuthology.orchestra.run.smithi155.stdout: } 2023-08-01T19:55:01.073 INFO:teuthology.orchestra.run.smithi155.stdout: }, 2023-08-01T19:55:01.073 INFO:teuthology.orchestra.run.smithi155.stdout: { 2023-08-01T19:55:01.073 INFO:teuthology.orchestra.run.smithi155.stdout: "description": "osd_repop(client.4668.0:73464 5.f e31/19 5:f261eb35:::benchmark_data_smithi006_114134_object73463:head v 31'4632, mlcod=31'4629)", 2023-08-01T19:55:01.073 INFO:teuthology.orchestra.run.smithi155.stdout: "initiated_at": "2023-08-01T19:54:51.466330+0000", 2023-08-01T19:55:01.073 INFO:teuthology.orchestra.run.smithi155.stdout: "age": 9.4678514590000002, 2023-08-01T19:55:01.073 INFO:teuthology.orchestra.run.smithi155.stdout: "duration": 0.016398626999999999, 2023-08-01T19:55:01.074 INFO:teuthology.orchestra.run.smithi155.stdout: "type_data": { 2023-08-01T19:55:01.074 INFO:teuthology.orchestra.run.smithi155.stdout: "flag_point": "commit sent; apply or cleanup", 2023-08-01T19:55:01.074 INFO:teuthology.orchestra.run.smithi155.stdout: "events": [ 2023-08-01T19:55:01.074 INFO:teuthology.orchestra.run.smithi155.stdout: { 2023-08-01T19:55:01.074 INFO:teuthology.orchestra.run.smithi155.stdout: "event": "initiated", 2023-08-01T19:55:01.074 INFO:teuthology.orchestra.run.smithi155.stdout: "time": "2023-08-01T19:54:51.466330+0000", 2023-08-01T19:55:01.074 INFO:teuthology.orchestra.run.smithi155.stdout: "duration": 0 2023-08-01T19:55:01.075 INFO:teuthology.orchestra.run.smithi155.stdout: }, 2023-08-01T19:55:01.075 INFO:teuthology.orchestra.run.smithi155.stdout: { 2023-08-01T19:55:01.075 INFO:teuthology.orchestra.run.smithi155.stdout: "event": "throttled", 2023-08-01T19:55:01.075 INFO:teuthology.orchestra.run.smithi155.stdout: "time": "2023-08-01T19:54:51.466330+0000", 2023-08-01T19:55:01.075 INFO:teuthology.orchestra.run.smithi155.stdout: "duration": 0 2023-08-01T19:55:01.075 INFO:teuthology.orchestra.run.smithi155.stdout: }, 2023-08-01T19:55:01.075 INFO:teuthology.orchestra.run.smithi155.stdout: { 2023-08-01T19:55:01.075 INFO:teuthology.orchestra.run.smithi155.stdout: "event": "header_read", 2023-08-01T19:55:01.076 INFO:teuthology.orchestra.run.smithi155.stdout: "time": "2023-08-01T19:54:51.466330+0000", 2023-08-01T19:55:01.076 INFO:teuthology.orchestra.run.smithi155.stdout: "duration": 4294967295.9999995 2023-08-01T19:55:01.076 INFO:teuthology.orchestra.run.smithi155.stdout: }, 2023-08-01T19:55:01.076 INFO:teuthology.orchestra.run.smithi155.stdout: { 2023-08-01T19:55:01.076 INFO:teuthology.orchestra.run.smithi155.stdout: "event": "all_read", 2023-08-01T19:55:01.076 INFO:teuthology.orchestra.run.smithi155.stdout: "time": "2023-08-01T19:54:51.466392+0000", 2023-08-01T19:55:01.076 INFO:teuthology.orchestra.run.smithi155.stdout: "duration": 6.2136000000000003e-05 2023-08-01T19:55:01.076 INFO:teuthology.orchestra.run.smithi155.stdout: }, 2023-08-01T19:55:01.077 INFO:teuthology.orchestra.run.smithi155.stdout: { 2023-08-01T19:55:01.077 INFO:teuthology.orchestra.run.smithi155.stdout: "event": "dispatched", 2023-08-01T19:55:01.077 INFO:teuthology.orchestra.run.smithi155.stdout: "time": "2023-08-01T19:54:51.466400+0000", 2023-08-01T19:55:01.077 INFO:teuthology.orchestra.run.smithi155.stdout: "duration": 7.7589999999999997e-06 2023-08-01T19:55:01.077 INFO:teuthology.orchestra.run.smithi155.stdout: }, 2023-08-01T19:55:01.077 INFO:teuthology.orchestra.run.smithi155.stdout: { 2023-08-01T19:55:01.077 INFO:teuthology.orchestra.run.smithi155.stdout: "event": "queued_for_pg", 2023-08-01T19:55:01.077 INFO:teuthology.orchestra.run.smithi155.stdout: "time": "2023-08-01T19:54:51.466404+0000", 2023-08-01T19:55:01.078 INFO:teuthology.orchestra.run.smithi155.stdout: "duration": 4.0810000000000004e-06 2023-08-01T19:55:01.078 INFO:teuthology.orchestra.run.smithi155.stdout: }, 2023-08-01T19:55:01.078 INFO:teuthology.orchestra.run.smithi155.stdout: { 2023-08-01T19:55:01.078 INFO:teuthology.orchestra.run.smithi155.stdout: "event": "reached_pg", 2023-08-01T19:55:01.078 INFO:teuthology.orchestra.run.smithi155.stdout: "time": "2023-08-01T19:54:51.468401+0000", 2023-08-01T19:55:01.078 INFO:teuthology.orchestra.run.smithi155.stdout: "duration": 0.0019972850000000001 2023-08-01T19:55:01.078 INFO:teuthology.orchestra.run.smithi155.stdout: }, 2023-08-01T19:55:01.078 INFO:teuthology.orchestra.run.smithi155.stdout: { 2023-08-01T19:55:01.079 INFO:teuthology.orchestra.run.smithi155.stdout: "event": "started", 2023-08-01T19:55:01.079 INFO:teuthology.orchestra.run.smithi155.stdout: "time": "2023-08-01T19:54:51.468420+0000", 2023-08-01T19:55:01.079 INFO:teuthology.orchestra.run.smithi155.stdout: "duration": 1.8717000000000001e-05 2023-08-01T19:55:01.079 INFO:teuthology.orchestra.run.smithi155.stdout: }, 2023-08-01T19:55:01.079 INFO:teuthology.orchestra.run.smithi155.stdout: { 2023-08-01T19:55:01.079 INFO:teuthology.orchestra.run.smithi155.stdout: "event": "commit_sent", 2023-08-01T19:55:01.079 INFO:teuthology.orchestra.run.smithi155.stdout: "time": "2023-08-01T19:54:51.482709+0000", 2023-08-01T19:55:01.080 INFO:teuthology.orchestra.run.smithi155.stdout: "duration": 0.014289717 2023-08-01T19:55:01.080 INFO:teuthology.orchestra.run.smithi155.stdout: }, 2023-08-01T19:55:01.080 INFO:teuthology.orchestra.run.smithi155.stdout: { 2023-08-01T19:55:01.080 INFO:teuthology.orchestra.run.smithi155.stdout: "event": "done", 2023-08-01T19:55:01.080 INFO:teuthology.orchestra.run.smithi155.stdout: "time": "2023-08-01T19:54:51.482729+0000", 2023-08-01T19:55:01.080 INFO:teuthology.orchestra.run.smithi155.stdout: "duration": 1.944e-05 2023-08-01T19:55:01.080 INFO:teuthology.orchestra.run.smithi155.stdout: } 2023-08-01T19:55:01.080 INFO:teuthology.orchestra.run.smithi155.stdout: ] 2023-08-01T19:55:01.081 INFO:teuthology.orchestra.run.smithi155.stdout: } 2023-08-01T19:55:01.081 INFO:teuthology.orchestra.run.smithi155.stdout: }, 2023-08-01T19:55:01.081 INFO:teuthology.orchestra.run.smithi155.stdout: { 2023-08-01T19:55:01.081 INFO:teuthology.orchestra.run.smithi155.stdout: "description": "osd_op(client.4668.0:75022 5.4 5:20404e0b:::benchmark_data_smithi006_114134_object75021:head [set-alloc-hint object_size 65536 write_size 65536,write 0~65536] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e32)", 2023-08-01T19:55:01.081 INFO:teuthology.orchestra.run.smithi155.stdout: "initiated_at": "2023-08-01T19:54:52.219424+0000", 2023-08-01T19:55:01.081 INFO:teuthology.orchestra.run.smithi155.stdout: "age": 8.7147574120000009, 2023-08-01T19:55:01.081 INFO:teuthology.orchestra.run.smithi155.stdout: "duration": 0.021270407000000002, 2023-08-01T19:55:01.081 INFO:teuthology.orchestra.run.smithi155.stdout: "type_data": { 2023-08-01T19:55:01.082 INFO:teuthology.orchestra.run.smithi155.stdout: "flag_point": "commit sent; apply or cleanup", 2023-08-01T19:55:01.082 INFO:teuthology.orchestra.run.smithi155.stdout: "client_info": { 2023-08-01T19:55:01.082 INFO:teuthology.orchestra.run.smithi155.stdout: "client": "client.4668", 2023-08-01T19:55:01.082 INFO:teuthology.orchestra.run.smithi155.stdout: "client_addr": "172.21.15.6:0/1709472247", 2023-08-01T19:55:01.082 INFO:teuthology.orchestra.run.smithi155.stdout: "tid": 75022 2023-08-01T19:55:01.082 INFO:teuthology.orchestra.run.smithi155.stdout: }, 2023-08-01T19:55:01.082 INFO:teuthology.orchestra.run.smithi155.stdout: "events": [ 2023-08-01T19:55:01.082 INFO:teuthology.orchestra.run.smithi155.stdout: { 2023-08-01T19:55:01.083 INFO:teuthology.orchestra.run.smithi155.stdout: "event": "initiated", 2023-08-01T19:55:01.083 INFO:teuthology.orchestra.run.smithi155.stdout: "time": "2023-08-01T19:54:52.219424+0000", 2023-08-01T19:55:01.083 INFO:teuthology.orchestra.run.smithi155.stdout: "duration": 0 2023-08-01T19:55:01.083 INFO:teuthology.orchestra.run.smithi155.stdout: }, 2023-08-01T19:55:01.083 INFO:teuthology.orchestra.run.smithi155.stdout: { 2023-08-01T19:55:01.083 INFO:teuthology.orchestra.run.smithi155.stdout: "event": "throttled", 2023-08-01T19:55:01.083 INFO:teuthology.orchestra.run.smithi155.stdout: "time": "2023-08-01T19:54:52.219424+0000", 2023-08-01T19:55:01.083 INFO:teuthology.orchestra.run.smithi155.stdout: "duration": 0 2023-08-01T19:55:01.084 INFO:teuthology.orchestra.run.smithi155.stdout: }, 2023-08-01T19:55:01.084 INFO:teuthology.orchestra.run.smithi155.stdout: { 2023-08-01T19:55:01.084 INFO:teuthology.orchestra.run.smithi155.stdout: "event": "header_read", 2023-08-01T19:55:01.084 INFO:teuthology.orchestra.run.smithi155.stdout: "time": "2023-08-01T19:54:52.219424+0000", 2023-08-01T19:55:01.084 INFO:teuthology.orchestra.run.smithi155.stdout: "duration": 4294967295.9999995 2023-08-01T19:55:01.084 INFO:teuthology.orchestra.run.smithi155.stdout: }, 2023-08-01T19:55:01.084 INFO:teuthology.orchestra.run.smithi155.stdout: { 2023-08-01T19:55:01.085 INFO:teuthology.orchestra.run.smithi155.stdout: "event": "all_read", 2023-08-01T19:55:01.085 INFO:teuthology.orchestra.run.smithi155.stdout: "time": "2023-08-01T19:54:52.219562+0000", 2023-08-01T19:55:01.085 INFO:teuthology.orchestra.run.smithi155.stdout: "duration": 0.000137866 2023-08-01T19:55:01.085 INFO:teuthology.orchestra.run.smithi155.stdout: }, 2023-08-01T19:55:01.085 INFO:teuthology.orchestra.run.smithi155.stdout: { 2023-08-01T19:55:01.085 INFO:teuthology.orchestra.run.smithi155.stdout: "event": "dispatched", 2023-08-01T19:55:01.085 INFO:teuthology.orchestra.run.smithi155.stdout: "time": "2023-08-01T19:54:52.219569+0000", 2023-08-01T19:55:01.086 INFO:teuthology.orchestra.run.smithi155.stdout: "duration": 7.3869999999999997e-06 2023-08-01T19:55:01.086 INFO:teuthology.orchestra.run.smithi155.stdout: }, 2023-08-01T19:55:01.086 INFO:teuthology.orchestra.run.smithi155.stdout: { 2023-08-01T19:55:01.086 INFO:teuthology.orchestra.run.smithi155.stdout: "event": "queued_for_pg", 2023-08-01T19:55:01.086 INFO:teuthology.orchestra.run.smithi155.stdout: "time": "2023-08-01T19:54:52.219572+0000", 2023-08-01T19:55:01.086 INFO:teuthology.orchestra.run.smithi155.stdout: "duration": 2.9409999999999999e-06 2023-08-01T19:55:01.086 INFO:teuthology.orchestra.run.smithi155.stdout: }, 2023-08-01T19:55:01.086 INFO:teuthology.orchestra.run.smithi155.stdout: { 2023-08-01T19:55:01.087 INFO:teuthology.orchestra.run.smithi155.stdout: "event": "reached_pg", 2023-08-01T19:55:01.087 INFO:teuthology.orchestra.run.smithi155.stdout: "time": "2023-08-01T19:54:52.221622+0000", 2023-08-01T19:55:01.087 INFO:teuthology.orchestra.run.smithi155.stdout: "duration": 0.0020502910000000001 2023-08-01T19:55:01.087 INFO:teuthology.orchestra.run.smithi155.stdout: }, 2023-08-01T19:55:01.087 INFO:teuthology.orchestra.run.smithi155.stdout: { 2023-08-01T19:55:01.087 INFO:teuthology.orchestra.run.smithi155.stdout: "event": "started", 2023-08-01T19:55:01.087 INFO:teuthology.orchestra.run.smithi155.stdout: "time": "2023-08-01T19:54:52.221708+0000", 2023-08-01T19:55:01.087 INFO:teuthology.orchestra.run.smithi155.stdout: "duration": 8.5958999999999995e-05 2023-08-01T19:55:01.088 INFO:teuthology.orchestra.run.smithi155.stdout: }, 2023-08-01T19:55:01.088 INFO:teuthology.orchestra.run.smithi155.stdout: { 2023-08-01T19:55:01.088 INFO:teuthology.orchestra.run.smithi155.stdout: "event": "waiting for subops from 0", 2023-08-01T19:55:01.088 INFO:teuthology.orchestra.run.smithi155.stdout: "time": "2023-08-01T19:54:52.221802+0000", 2023-08-01T19:55:01.088 INFO:teuthology.orchestra.run.smithi155.stdout: "duration": 9.3521000000000001e-05 2023-08-01T19:55:01.088 INFO:teuthology.orchestra.run.smithi155.stdout: }, 2023-08-01T19:55:01.088 INFO:teuthology.orchestra.run.smithi155.stdout: { 2023-08-01T19:55:01.088 INFO:teuthology.orchestra.run.smithi155.stdout: "event": "op_commit", 2023-08-01T19:55:01.089 INFO:teuthology.orchestra.run.smithi155.stdout: "time": "2023-08-01T19:54:52.224578+0000", 2023-08-01T19:55:01.089 INFO:teuthology.orchestra.run.smithi155.stdout: "duration": 0.0027759659999999999 2023-08-01T19:55:01.089 INFO:teuthology.orchestra.run.smithi155.stdout: }, 2023-08-01T19:55:01.089 INFO:teuthology.orchestra.run.smithi155.stdout: { 2023-08-01T19:55:01.089 INFO:teuthology.orchestra.run.smithi155.stdout: "event": "sub_op_commit_rec", 2023-08-01T19:55:01.089 INFO:teuthology.orchestra.run.smithi155.stdout: "time": "2023-08-01T19:54:52.240611+0000", 2023-08-01T19:55:01.089 INFO:teuthology.orchestra.run.smithi155.stdout: "duration": 0.016033068000000001 2023-08-01T19:55:01.090 INFO:teuthology.orchestra.run.smithi155.stdout: }, 2023-08-01T19:55:01.090 INFO:teuthology.orchestra.run.smithi155.stdout: { 2023-08-01T19:55:01.090 INFO:teuthology.orchestra.run.smithi155.stdout: "event": "commit_sent", 2023-08-01T19:55:01.090 INFO:teuthology.orchestra.run.smithi155.stdout: "time": "2023-08-01T19:54:52.240659+0000", 2023-08-01T19:55:01.090 INFO:teuthology.orchestra.run.smithi155.stdout: "duration": 4.7794999999999999e-05 2023-08-01T19:55:01.090 INFO:teuthology.orchestra.run.smithi155.stdout: }, 2023-08-01T19:55:01.090 INFO:teuthology.orchestra.run.smithi155.stdout: { 2023-08-01T19:55:01.090 INFO:teuthology.orchestra.run.smithi155.stdout: "event": "done", 2023-08-01T19:55:01.091 INFO:teuthology.orchestra.run.smithi155.stdout: "time": "2023-08-01T19:54:52.240695+0000", 2023-08-01T19:55:01.091 INFO:teuthology.orchestra.run.smithi155.stdout: "duration": 3.5942000000000002e-05 2023-08-01T19:55:01.091 INFO:teuthology.orchestra.run.smithi155.stdout: } 2023-08-01T19:55:01.091 INFO:teuthology.orchestra.run.smithi155.stdout: ] 2023-08-01T19:55:01.091 INFO:teuthology.orchestra.run.smithi155.stdout: } 2023-08-01T19:55:01.091 INFO:teuthology.orchestra.run.smithi155.stdout: }, 2023-08-01T19:55:01.091 INFO:teuthology.orchestra.run.smithi155.stdout: { 2023-08-01T19:55:01.091 INFO:teuthology.orchestra.run.smithi155.stdout: "description": "osd_op(client.4668.0:75023 5.4 5:2ff1db38:::benchmark_data_smithi006_114134_object75022:head [set-alloc-hint object_size 65536 write_size 65536,write 0~65536] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e32)", 2023-08-01T19:55:01.092 INFO:teuthology.orchestra.run.smithi155.stdout: "initiated_at": "2023-08-01T19:54:52.219577+0000", 2023-08-01T19:55:01.092 INFO:teuthology.orchestra.run.smithi155.stdout: "age": 8.7146042660000003, 2023-08-01T19:55:01.092 INFO:teuthology.orchestra.run.smithi155.stdout: "duration": 0.021226956000000002, 2023-08-01T19:55:01.092 INFO:teuthology.orchestra.run.smithi155.stdout: "type_data": { 2023-08-01T19:55:01.092 INFO:teuthology.orchestra.run.smithi155.stdout: "flag_point": "commit sent; apply or cleanup", 2023-08-01T19:55:01.092 INFO:teuthology.orchestra.run.smithi155.stdout: "client_info": { 2023-08-01T19:55:01.092 INFO:teuthology.orchestra.run.smithi155.stdout: "client": "client.4668", 2023-08-01T19:55:01.092 INFO:teuthology.orchestra.run.smithi155.stdout: "client_addr": "172.21.15.6:0/1709472247", 2023-08-01T19:55:01.093 INFO:teuthology.orchestra.run.smithi155.stdout: "tid": 75023 2023-08-01T19:55:01.093 INFO:teuthology.orchestra.run.smithi155.stdout: }, 2023-08-01T19:55:01.093 INFO:teuthology.orchestra.run.smithi155.stdout: "events": [ 2023-08-01T19:55:01.093 INFO:teuthology.orchestra.run.smithi155.stdout: { 2023-08-01T19:55:01.093 INFO:teuthology.orchestra.run.smithi155.stdout: "event": "initiated", 2023-08-01T19:55:01.093 INFO:teuthology.orchestra.run.smithi155.stdout: "time": "2023-08-01T19:54:52.219577+0000", 2023-08-01T19:55:01.093 INFO:teuthology.orchestra.run.smithi155.stdout: "duration": 0 2023-08-01T19:55:01.094 INFO:teuthology.orchestra.run.smithi155.stdout: }, 2023-08-01T19:55:01.094 INFO:teuthology.orchestra.run.smithi155.stdout: { 2023-08-01T19:55:01.094 INFO:teuthology.orchestra.run.smithi155.stdout: "event": "throttled", 2023-08-01T19:55:01.094 INFO:teuthology.orchestra.run.smithi155.stdout: "time": "2023-08-01T19:54:52.219577+0000", 2023-08-01T19:55:01.094 INFO:teuthology.orchestra.run.smithi155.stdout: "duration": 0 2023-08-01T19:55:01.094 INFO:teuthology.orchestra.run.smithi155.stdout: }, 2023-08-01T19:55:01.094 INFO:teuthology.orchestra.run.smithi155.stdout: { 2023-08-01T19:55:01.094 INFO:teuthology.orchestra.run.smithi155.stdout: "event": "header_read", 2023-08-01T19:55:01.095 INFO:teuthology.orchestra.run.smithi155.stdout: "time": "2023-08-01T19:54:52.219577+0000", 2023-08-01T19:55:01.095 INFO:teuthology.orchestra.run.smithi155.stdout: "duration": 4294967295.9999995 2023-08-01T19:55:01.095 INFO:teuthology.orchestra.run.smithi155.stdout: }, 2023-08-01T19:55:01.095 INFO:teuthology.orchestra.run.smithi155.stdout: { 2023-08-01T19:55:01.095 INFO:teuthology.orchestra.run.smithi155.stdout: "event": "all_read", 2023-08-01T19:55:01.095 INFO:teuthology.orchestra.run.smithi155.stdout: "time": "2023-08-01T19:54:52.219655+0000", 2023-08-01T19:55:01.095 INFO:teuthology.orchestra.run.smithi155.stdout: "duration": 7.7459999999999994e-05 2023-08-01T19:55:01.096 INFO:teuthology.orchestra.run.smithi155.stdout: }, 2023-08-01T19:55:01.096 INFO:teuthology.orchestra.run.smithi155.stdout: { 2023-08-01T19:55:01.096 INFO:teuthology.orchestra.run.smithi155.stdout: "event": "dispatched", 2023-08-01T19:55:01.096 INFO:teuthology.orchestra.run.smithi155.stdout: "time": "2023-08-01T19:54:52.219660+0000", 2023-08-01T19:55:01.096 INFO:teuthology.orchestra.run.smithi155.stdout: "duration": 5.0719999999999999e-06 2023-08-01T19:55:01.096 INFO:teuthology.orchestra.run.smithi155.stdout: }, 2023-08-01T19:55:01.096 INFO:teuthology.orchestra.run.smithi155.stdout: { 2023-08-01T19:55:01.096 INFO:teuthology.orchestra.run.smithi155.stdout: "event": "queued_for_pg", 2023-08-01T19:55:01.097 INFO:teuthology.orchestra.run.smithi155.stdout: "time": "2023-08-01T19:54:52.219662+0000", 2023-08-01T19:55:01.097 INFO:teuthology.orchestra.run.smithi155.stdout: "duration": 2.706e-06 2023-08-01T19:55:01.097 INFO:teuthology.orchestra.run.smithi155.stdout: }, 2023-08-01T19:55:01.097 INFO:teuthology.orchestra.run.smithi155.stdout: { 2023-08-01T19:55:01.097 INFO:teuthology.orchestra.run.smithi155.stdout: "event": "reached_pg", 2023-08-01T19:55:01.097 INFO:teuthology.orchestra.run.smithi155.stdout: "time": "2023-08-01T19:54:52.223120+0000", 2023-08-01T19:55:01.097 INFO:teuthology.orchestra.run.smithi155.stdout: "duration": 0.0034574699999999998 2023-08-01T19:55:01.098 INFO:teuthology.orchestra.run.smithi155.stdout: }, 2023-08-01T19:55:01.098 INFO:teuthology.orchestra.run.smithi155.stdout: { 2023-08-01T19:55:01.098 INFO:teuthology.orchestra.run.smithi155.stdout: "event": "started", 2023-08-01T19:55:01.098 INFO:teuthology.orchestra.run.smithi155.stdout: "time": "2023-08-01T19:54:52.223250+0000", 2023-08-01T19:55:01.098 INFO:teuthology.orchestra.run.smithi155.stdout: "duration": 0.000129751 2023-08-01T19:55:01.098 INFO:teuthology.orchestra.run.smithi155.stdout: }, 2023-08-01T19:55:01.098 INFO:teuthology.orchestra.run.smithi155.stdout: { 2023-08-01T19:55:01.098 INFO:teuthology.orchestra.run.smithi155.stdout: "event": "waiting for subops from 0", 2023-08-01T19:55:01.099 INFO:teuthology.orchestra.run.smithi155.stdout: "time": "2023-08-01T19:54:52.223406+0000", 2023-08-01T19:55:01.099 INFO:teuthology.orchestra.run.smithi155.stdout: "duration": 0.00015661599999999999 2023-08-01T19:55:01.099 INFO:teuthology.orchestra.run.smithi155.stdout: }, 2023-08-01T19:55:01.099 INFO:teuthology.orchestra.run.smithi155.stdout: { 2023-08-01T19:55:01.099 INFO:teuthology.orchestra.run.smithi155.stdout: "event": "op_commit", 2023-08-01T19:55:01.099 INFO:teuthology.orchestra.run.smithi155.stdout: "time": "2023-08-01T19:54:52.226217+0000", 2023-08-01T19:55:01.099 INFO:teuthology.orchestra.run.smithi155.stdout: "duration": 0.0028110280000000001 2023-08-01T19:55:01.099 INFO:teuthology.orchestra.run.smithi155.stdout: }, 2023-08-01T19:55:01.100 INFO:teuthology.orchestra.run.smithi155.stdout: { 2023-08-01T19:55:01.100 INFO:teuthology.orchestra.run.smithi155.stdout: "event": "sub_op_commit_rec", 2023-08-01T19:55:01.100 INFO:teuthology.orchestra.run.smithi155.stdout: "time": "2023-08-01T19:54:52.240732+0000", 2023-08-01T19:55:01.100 INFO:teuthology.orchestra.run.smithi155.stdout: "duration": 0.014515068000000001 2023-08-01T19:55:01.100 INFO:teuthology.orchestra.run.smithi155.stdout: }, 2023-08-01T19:55:01.100 INFO:teuthology.orchestra.run.smithi155.stdout: { 2023-08-01T19:55:01.100 INFO:teuthology.orchestra.run.smithi155.stdout: "event": "commit_sent", 2023-08-01T19:55:01.101 INFO:teuthology.orchestra.run.smithi155.stdout: "time": "2023-08-01T19:54:52.240766+0000", 2023-08-01T19:55:01.101 INFO:teuthology.orchestra.run.smithi155.stdout: "duration": 3.3689000000000002e-05 2023-08-01T19:55:01.101 INFO:teuthology.orchestra.run.smithi155.stdout: }, 2023-08-01T19:55:01.101 INFO:teuthology.orchestra.run.smithi155.stdout: { 2023-08-01T19:55:01.101 INFO:teuthology.orchestra.run.smithi155.stdout: "event": "done", 2023-08-01T19:55:01.101 INFO:teuthology.orchestra.run.smithi155.stdout: "time": "2023-08-01T19:54:52.240804+0000", 2023-08-01T19:55:01.101 INFO:teuthology.orchestra.run.smithi155.stdout: "duration": 3.841e-05 2023-08-01T19:55:01.101 INFO:teuthology.orchestra.run.smithi155.stdout: } 2023-08-01T19:55:01.102 INFO:teuthology.orchestra.run.smithi155.stdout: ] 2023-08-01T19:55:01.102 INFO:teuthology.orchestra.run.smithi155.stdout: } 2023-08-01T19:55:01.102 INFO:teuthology.orchestra.run.smithi155.stdout: }, 2023-08-01T19:55:01.102 INFO:teuthology.orchestra.run.smithi155.stdout: { 2023-08-01T19:55:01.102 INFO:teuthology.orchestra.run.smithi155.stdout: "description": "osd_op(client.4668.0:75028 5.4 5:2c62c41c:::benchmark_data_smithi006_114134_object75027:head [set-alloc-hint object_size 65536 write_size 65536,write 0~65536] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e32)", 2023-08-01T19:55:01.102 INFO:teuthology.orchestra.run.smithi155.stdout: "initiated_at": "2023-08-01T19:54:52.224915+0000", 2023-08-01T19:55:01.102 INFO:teuthology.orchestra.run.smithi155.stdout: "age": 8.7092661769999999, 2023-08-01T19:55:01.102 INFO:teuthology.orchestra.run.smithi155.stdout: "duration": 0.016009299000000001, 2023-08-01T19:55:01.103 INFO:teuthology.orchestra.run.smithi155.stdout: "type_data": { 2023-08-01T19:55:01.103 INFO:teuthology.orchestra.run.smithi155.stdout: "flag_point": "commit sent; apply or cleanup", 2023-08-01T19:55:01.103 INFO:teuthology.orchestra.run.smithi155.stdout: "client_info": { 2023-08-01T19:55:01.103 INFO:teuthology.orchestra.run.smithi155.stdout: "client": "client.4668", 2023-08-01T19:55:01.103 INFO:teuthology.orchestra.run.smithi155.stdout: "client_addr": "172.21.15.6:0/1709472247", 2023-08-01T19:55:01.103 INFO:teuthology.orchestra.run.smithi155.stdout: "tid": 75028 2023-08-01T19:55:01.103 INFO:teuthology.orchestra.run.smithi155.stdout: }, 2023-08-01T19:55:01.103 INFO:teuthology.orchestra.run.smithi155.stdout: "events": [ 2023-08-01T19:55:01.104 INFO:teuthology.orchestra.run.smithi155.stdout: { 2023-08-01T19:55:01.104 INFO:teuthology.orchestra.run.smithi155.stdout: "event": "initiated", 2023-08-01T19:55:01.104 INFO:teuthology.orchestra.run.smithi155.stdout: "time": "2023-08-01T19:54:52.224915+0000", 2023-08-01T19:55:01.104 INFO:teuthology.orchestra.run.smithi155.stdout: "duration": 0 2023-08-01T19:55:01.104 INFO:teuthology.orchestra.run.smithi155.stdout: }, 2023-08-01T19:55:01.104 INFO:teuthology.orchestra.run.smithi155.stdout: { 2023-08-01T19:55:01.104 INFO:teuthology.orchestra.run.smithi155.stdout: "event": "throttled", 2023-08-01T19:55:01.104 INFO:teuthology.orchestra.run.smithi155.stdout: "time": "2023-08-01T19:54:52.224915+0000", 2023-08-01T19:55:01.105 INFO:teuthology.orchestra.run.smithi155.stdout: "duration": 0 2023-08-01T19:55:01.105 INFO:teuthology.orchestra.run.smithi155.stdout: }, 2023-08-01T19:55:01.105 INFO:teuthology.orchestra.run.smithi155.stdout: { 2023-08-01T19:55:01.105 INFO:teuthology.orchestra.run.smithi155.stdout: "event": "header_read", 2023-08-01T19:55:01.105 INFO:teuthology.orchestra.run.smithi155.stdout: "time": "2023-08-01T19:54:52.224915+0000", 2023-08-01T19:55:01.105 INFO:teuthology.orchestra.run.smithi155.stdout: "duration": 4294967295.9999995 2023-08-01T19:55:01.105 INFO:teuthology.orchestra.run.smithi155.stdout: }, 2023-08-01T19:55:01.106 INFO:teuthology.orchestra.run.smithi155.stdout: { 2023-08-01T19:55:01.106 INFO:teuthology.orchestra.run.smithi155.stdout: "event": "all_read", 2023-08-01T19:55:01.106 INFO:teuthology.orchestra.run.smithi155.stdout: "time": "2023-08-01T19:54:52.224981+0000", 2023-08-01T19:55:01.106 INFO:teuthology.orchestra.run.smithi155.stdout: "duration": 6.5333999999999995e-05 2023-08-01T19:55:01.106 INFO:teuthology.orchestra.run.smithi155.stdout: }, 2023-08-01T19:55:01.106 INFO:teuthology.orchestra.run.smithi155.stdout: { 2023-08-01T19:55:01.106 INFO:teuthology.orchestra.run.smithi155.stdout: "event": "dispatched", 2023-08-01T19:55:01.106 INFO:teuthology.orchestra.run.smithi155.stdout: "time": "2023-08-01T19:54:52.224987+0000", 2023-08-01T19:55:01.107 INFO:teuthology.orchestra.run.smithi155.stdout: "duration": 6.037e-06 2023-08-01T19:55:01.107 INFO:teuthology.orchestra.run.smithi155.stdout: }, 2023-08-01T19:55:01.107 INFO:teuthology.orchestra.run.smithi155.stdout: { 2023-08-01T19:55:01.107 INFO:teuthology.orchestra.run.smithi155.stdout: "event": "queued_for_pg", 2023-08-01T19:55:01.107 INFO:teuthology.orchestra.run.smithi155.stdout: "time": "2023-08-01T19:54:52.224990+0000", 2023-08-01T19:55:01.107 INFO:teuthology.orchestra.run.smithi155.stdout: "duration": 3.4199999999999999e-06 2023-08-01T19:55:01.107 INFO:teuthology.orchestra.run.smithi155.stdout: }, 2023-08-01T19:55:01.107 INFO:teuthology.orchestra.run.smithi155.stdout: { 2023-08-01T19:55:01.108 INFO:teuthology.orchestra.run.smithi155.stdout: "event": "reached_pg", 2023-08-01T19:55:01.108 INFO:teuthology.orchestra.run.smithi155.stdout: "time": "2023-08-01T19:54:52.225029+0000", 2023-08-01T19:55:01.108 INFO:teuthology.orchestra.run.smithi155.stdout: "duration": 3.8850999999999998e-05 2023-08-01T19:55:01.108 INFO:teuthology.orchestra.run.smithi155.stdout: }, 2023-08-01T19:55:01.108 INFO:teuthology.orchestra.run.smithi155.stdout: { 2023-08-01T19:55:01.108 INFO:teuthology.orchestra.run.smithi155.stdout: "event": "started", 2023-08-01T19:55:01.108 INFO:teuthology.orchestra.run.smithi155.stdout: "time": "2023-08-01T19:54:52.225100+0000", 2023-08-01T19:55:01.108 INFO:teuthology.orchestra.run.smithi155.stdout: "duration": 7.1355999999999999e-05 2023-08-01T19:55:01.109 INFO:teuthology.orchestra.run.smithi155.stdout: }, 2023-08-01T19:55:01.109 INFO:teuthology.orchestra.run.smithi155.stdout: { 2023-08-01T19:55:01.109 INFO:teuthology.orchestra.run.smithi155.stdout: "event": "waiting for subops from 0", 2023-08-01T19:55:01.109 INFO:teuthology.orchestra.run.smithi155.stdout: "time": "2023-08-01T19:54:52.225187+0000", 2023-08-01T19:55:01.109 INFO:teuthology.orchestra.run.smithi155.stdout: "duration": 8.7138999999999994e-05 2023-08-01T19:55:01.109 INFO:teuthology.orchestra.run.smithi155.stdout: }, 2023-08-01T19:55:01.109 INFO:teuthology.orchestra.run.smithi155.stdout: { 2023-08-01T19:55:01.109 INFO:teuthology.orchestra.run.smithi155.stdout: "event": "op_commit", 2023-08-01T19:55:01.110 INFO:teuthology.orchestra.run.smithi155.stdout: "time": "2023-08-01T19:54:52.227343+0000", 2023-08-01T19:55:01.110 INFO:teuthology.orchestra.run.smithi155.stdout: "duration": 0.002155784 2023-08-01T19:55:01.110 INFO:teuthology.orchestra.run.smithi155.stdout: }, 2023-08-01T19:55:01.110 INFO:teuthology.orchestra.run.smithi155.stdout: { 2023-08-01T19:55:01.110 INFO:teuthology.orchestra.run.smithi155.stdout: "event": "sub_op_commit_rec", 2023-08-01T19:55:01.110 INFO:teuthology.orchestra.run.smithi155.stdout: "time": "2023-08-01T19:54:52.240839+0000", 2023-08-01T19:55:01.110 INFO:teuthology.orchestra.run.smithi155.stdout: "duration": 0.013496192000000001 2023-08-01T19:55:01.111 INFO:teuthology.orchestra.run.smithi155.stdout: }, 2023-08-01T19:55:01.111 INFO:teuthology.orchestra.run.smithi155.stdout: { 2023-08-01T19:55:01.111 INFO:teuthology.orchestra.run.smithi155.stdout: "event": "commit_sent", 2023-08-01T19:55:01.111 INFO:teuthology.orchestra.run.smithi155.stdout: "time": "2023-08-01T19:54:52.240892+0000", 2023-08-01T19:55:01.111 INFO:teuthology.orchestra.run.smithi155.stdout: "duration": 5.3164000000000001e-05 2023-08-01T19:55:01.111 INFO:teuthology.orchestra.run.smithi155.stdout: }, 2023-08-01T19:55:01.111 INFO:teuthology.orchestra.run.smithi155.stdout: { 2023-08-01T19:55:01.111 INFO:teuthology.orchestra.run.smithi155.stdout: "event": "done", 2023-08-01T19:55:01.112 INFO:teuthology.orchestra.run.smithi155.stdout: "time": "2023-08-01T19:54:52.240925+0000", 2023-08-01T19:55:01.112 INFO:teuthology.orchestra.run.smithi155.stdout: "duration": 3.2323999999999997e-05 2023-08-01T19:55:01.112 INFO:teuthology.orchestra.run.smithi155.stdout: } 2023-08-01T19:55:01.112 INFO:teuthology.orchestra.run.smithi155.stdout: ] 2023-08-01T19:55:01.112 INFO:teuthology.orchestra.run.smithi155.stdout: } 2023-08-01T19:55:01.112 INFO:teuthology.orchestra.run.smithi155.stdout: }, 2023-08-01T19:55:01.112 INFO:teuthology.orchestra.run.smithi155.stdout: { 2023-08-01T19:55:01.112 INFO:teuthology.orchestra.run.smithi155.stdout: "description": "osd_op(client.4668.0:75287 5.0 5:0c891239:::benchmark_data_smithi006_114134_object75286:head [set-alloc-hint object_size 65536 write_size 65536,write 0~65536] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e32)", 2023-08-01T19:55:01.113 INFO:teuthology.orchestra.run.smithi155.stdout: "initiated_at": "2023-08-01T19:54:52.371511+0000", 2023-08-01T19:55:01.113 INFO:teuthology.orchestra.run.smithi155.stdout: "age": 8.5626707460000002, 2023-08-01T19:55:01.113 INFO:teuthology.orchestra.run.smithi155.stdout: "duration": 0.018046647999999998, 2023-08-01T19:55:01.113 INFO:teuthology.orchestra.run.smithi155.stdout: "type_data": { 2023-08-01T19:55:01.113 INFO:teuthology.orchestra.run.smithi155.stdout: "flag_point": "commit sent; apply or cleanup", 2023-08-01T19:55:01.113 INFO:teuthology.orchestra.run.smithi155.stdout: "client_info": { 2023-08-01T19:55:01.113 INFO:teuthology.orchestra.run.smithi155.stdout: "client": "client.4668", 2023-08-01T19:55:01.113 INFO:teuthology.orchestra.run.smithi155.stdout: "client_addr": "172.21.15.6:0/1709472247", 2023-08-01T19:55:01.114 INFO:teuthology.orchestra.run.smithi155.stdout: "tid": 75287 2023-08-01T19:55:01.114 INFO:teuthology.orchestra.run.smithi155.stdout: }, 2023-08-01T19:55:01.114 INFO:teuthology.orchestra.run.smithi155.stdout: "events": [ 2023-08-01T19:55:01.114 INFO:teuthology.orchestra.run.smithi155.stdout: { 2023-08-01T19:55:01.114 INFO:teuthology.orchestra.run.smithi155.stdout: "event": "initiated", 2023-08-01T19:55:01.114 INFO:teuthology.orchestra.run.smithi155.stdout: "time": "2023-08-01T19:54:52.371511+0000", 2023-08-01T19:55:01.114 INFO:teuthology.orchestra.run.smithi155.stdout: "duration": 0 2023-08-01T19:55:01.114 INFO:teuthology.orchestra.run.smithi155.stdout: }, 2023-08-01T19:55:01.115 INFO:teuthology.orchestra.run.smithi155.stdout: { 2023-08-01T19:55:01.115 INFO:teuthology.orchestra.run.smithi155.stdout: "event": "throttled", 2023-08-01T19:55:01.115 INFO:teuthology.orchestra.run.smithi155.stdout: "time": "2023-08-01T19:54:52.371511+0000", 2023-08-01T19:55:01.115 INFO:teuthology.orchestra.run.smithi155.stdout: "duration": 0 2023-08-01T19:55:01.115 INFO:teuthology.orchestra.run.smithi155.stdout: }, 2023-08-01T19:55:01.115 INFO:teuthology.orchestra.run.smithi155.stdout: { 2023-08-01T19:55:01.115 INFO:teuthology.orchestra.run.smithi155.stdout: "event": "header_read", 2023-08-01T19:55:01.115 INFO:teuthology.orchestra.run.smithi155.stdout: "time": "2023-08-01T19:54:52.371510+0000", 2023-08-01T19:55:01.116 INFO:teuthology.orchestra.run.smithi155.stdout: "duration": 4294967295.9999995 2023-08-01T19:55:01.116 INFO:teuthology.orchestra.run.smithi155.stdout: }, 2023-08-01T19:55:01.116 INFO:teuthology.orchestra.run.smithi155.stdout: { 2023-08-01T19:55:01.116 INFO:teuthology.orchestra.run.smithi155.stdout: "event": "all_read", 2023-08-01T19:55:01.116 INFO:teuthology.orchestra.run.smithi155.stdout: "time": "2023-08-01T19:54:52.371540+0000", 2023-08-01T19:55:01.116 INFO:teuthology.orchestra.run.smithi155.stdout: "duration": 2.9526000000000002e-05 2023-08-01T19:55:01.116 INFO:teuthology.orchestra.run.smithi155.stdout: }, 2023-08-01T19:55:01.117 INFO:teuthology.orchestra.run.smithi155.stdout: { 2023-08-01T19:55:01.117 INFO:teuthology.orchestra.run.smithi155.stdout: "event": "dispatched", 2023-08-01T19:55:01.117 INFO:teuthology.orchestra.run.smithi155.stdout: "time": "2023-08-01T19:54:52.371551+0000", 2023-08-01T19:55:01.117 INFO:teuthology.orchestra.run.smithi155.stdout: "duration": 1.1019000000000001e-05 2023-08-01T19:55:01.117 INFO:teuthology.orchestra.run.smithi155.stdout: }, 2023-08-01T19:55:01.117 INFO:teuthology.orchestra.run.smithi155.stdout: { 2023-08-01T19:55:01.117 INFO:teuthology.orchestra.run.smithi155.stdout: "event": "queued_for_pg", 2023-08-01T19:55:01.117 INFO:teuthology.orchestra.run.smithi155.stdout: "time": "2023-08-01T19:54:52.371556+0000", 2023-08-01T19:55:01.118 INFO:teuthology.orchestra.run.smithi155.stdout: "duration": 5.4099999999999999e-06 2023-08-01T19:55:01.118 INFO:teuthology.orchestra.run.smithi155.stdout: }, 2023-08-01T19:55:01.118 INFO:teuthology.orchestra.run.smithi155.stdout: { 2023-08-01T19:55:01.118 INFO:teuthology.orchestra.run.smithi155.stdout: "event": "reached_pg", 2023-08-01T19:55:01.118 INFO:teuthology.orchestra.run.smithi155.stdout: "time": "2023-08-01T19:54:52.373214+0000", 2023-08-01T19:55:01.118 INFO:teuthology.orchestra.run.smithi155.stdout: "duration": 0.0016573239999999999 2023-08-01T19:55:01.118 INFO:teuthology.orchestra.run.smithi155.stdout: }, 2023-08-01T19:55:01.118 INFO:teuthology.orchestra.run.smithi155.stdout: { 2023-08-01T19:55:01.119 INFO:teuthology.orchestra.run.smithi155.stdout: "event": "started", 2023-08-01T19:55:01.119 INFO:teuthology.orchestra.run.smithi155.stdout: "time": "2023-08-01T19:54:52.373297+0000", 2023-08-01T19:55:01.119 INFO:teuthology.orchestra.run.smithi155.stdout: "duration": 8.3440000000000001e-05 2023-08-01T19:55:01.119 INFO:teuthology.orchestra.run.smithi155.stdout: }, 2023-08-01T19:55:01.119 INFO:teuthology.orchestra.run.smithi155.stdout: { 2023-08-01T19:55:01.119 INFO:teuthology.orchestra.run.smithi155.stdout: "event": "waiting for subops from 0", 2023-08-01T19:55:01.119 INFO:teuthology.orchestra.run.smithi155.stdout: "time": "2023-08-01T19:54:52.373381+0000", 2023-08-01T19:55:01.119 INFO:teuthology.orchestra.run.smithi155.stdout: "duration": 8.4172999999999995e-05 2023-08-01T19:55:01.120 INFO:teuthology.orchestra.run.smithi155.stdout: }, 2023-08-01T19:55:01.120 INFO:teuthology.orchestra.run.smithi155.stdout: { 2023-08-01T19:55:01.120 INFO:teuthology.orchestra.run.smithi155.stdout: "event": "op_commit", 2023-08-01T19:55:01.120 INFO:teuthology.orchestra.run.smithi155.stdout: "time": "2023-08-01T19:54:52.375698+0000", 2023-08-01T19:55:01.120 INFO:teuthology.orchestra.run.smithi155.stdout: "duration": 0.0023168889999999999 2023-08-01T19:55:01.120 INFO:teuthology.orchestra.run.smithi155.stdout: }, 2023-08-01T19:55:01.120 INFO:teuthology.orchestra.run.smithi155.stdout: { 2023-08-01T19:55:01.120 INFO:teuthology.orchestra.run.smithi155.stdout: "event": "sub_op_commit_rec", 2023-08-01T19:55:01.121 INFO:teuthology.orchestra.run.smithi155.stdout: "time": "2023-08-01T19:54:52.389493+0000", 2023-08-01T19:55:01.121 INFO:teuthology.orchestra.run.smithi155.stdout: "duration": 0.013794705000000001 2023-08-01T19:55:01.121 INFO:teuthology.orchestra.run.smithi155.stdout: }, 2023-08-01T19:55:01.121 INFO:teuthology.orchestra.run.smithi155.stdout: { 2023-08-01T19:55:01.121 INFO:teuthology.orchestra.run.smithi155.stdout: "event": "commit_sent", 2023-08-01T19:55:01.121 INFO:teuthology.orchestra.run.smithi155.stdout: "time": "2023-08-01T19:54:52.389527+0000", 2023-08-01T19:55:01.121 INFO:teuthology.orchestra.run.smithi155.stdout: "duration": 3.4149000000000001e-05 2023-08-01T19:55:01.121 INFO:teuthology.orchestra.run.smithi155.stdout: }, 2023-08-01T19:55:01.122 INFO:teuthology.orchestra.run.smithi155.stdout: { 2023-08-01T19:55:01.122 INFO:teuthology.orchestra.run.smithi155.stdout: "event": "done", 2023-08-01T19:55:01.122 INFO:teuthology.orchestra.run.smithi155.stdout: "time": "2023-08-01T19:54:52.389558+0000", 2023-08-01T19:55:01.122 INFO:teuthology.orchestra.run.smithi155.stdout: "duration": 3.0590999999999999e-05 2023-08-01T19:55:01.122 INFO:teuthology.orchestra.run.smithi155.stdout: } 2023-08-01T19:55:01.122 INFO:teuthology.orchestra.run.smithi155.stdout: ] 2023-08-01T19:55:01.122 INFO:teuthology.orchestra.run.smithi155.stdout: } 2023-08-01T19:55:01.122 INFO:teuthology.orchestra.run.smithi155.stdout: }, 2023-08-01T19:55:01.123 INFO:teuthology.orchestra.run.smithi155.stdout: { 2023-08-01T19:55:01.123 INFO:teuthology.orchestra.run.smithi155.stdout: "description": "osd_op(client.4668.0:82525 5.d 5:bcfac7fd:::benchmark_data_smithi006_114134_object82524:head [set-alloc-hint object_size 65536 write_size 65536,write 0~65536] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e34)", 2023-08-01T19:55:01.123 INFO:teuthology.orchestra.run.smithi155.stdout: "initiated_at": "2023-08-01T19:54:56.061190+0000", 2023-08-01T19:55:01.123 INFO:teuthology.orchestra.run.smithi155.stdout: "age": 4.8729921049999998, 2023-08-01T19:55:01.123 INFO:teuthology.orchestra.run.smithi155.stdout: "duration": 0.016633917000000002, 2023-08-01T19:55:01.123 INFO:teuthology.orchestra.run.smithi155.stdout: "type_data": { 2023-08-01T19:55:01.123 INFO:teuthology.orchestra.run.smithi155.stdout: "flag_point": "commit sent; apply or cleanup", 2023-08-01T19:55:01.124 INFO:teuthology.orchestra.run.smithi155.stdout: "client_info": { 2023-08-01T19:55:01.124 INFO:teuthology.orchestra.run.smithi155.stdout: "client": "client.4668", 2023-08-01T19:55:01.124 INFO:teuthology.orchestra.run.smithi155.stdout: "client_addr": "172.21.15.6:0/1709472247", 2023-08-01T19:55:01.124 INFO:teuthology.orchestra.run.smithi155.stdout: "tid": 82525 2023-08-01T19:55:01.124 INFO:teuthology.orchestra.run.smithi155.stdout: }, 2023-08-01T19:55:01.124 INFO:teuthology.orchestra.run.smithi155.stdout: "events": [ 2023-08-01T19:55:01.124 INFO:teuthology.orchestra.run.smithi155.stdout: { 2023-08-01T19:55:01.124 INFO:teuthology.orchestra.run.smithi155.stdout: "event": "initiated", 2023-08-01T19:55:01.125 INFO:teuthology.orchestra.run.smithi155.stdout: "time": "2023-08-01T19:54:56.061190+0000", 2023-08-01T19:55:01.125 INFO:teuthology.orchestra.run.smithi155.stdout: "duration": 0 2023-08-01T19:55:01.125 INFO:teuthology.orchestra.run.smithi155.stdout: }, 2023-08-01T19:55:01.125 INFO:teuthology.orchestra.run.smithi155.stdout: { 2023-08-01T19:55:01.125 INFO:teuthology.orchestra.run.smithi155.stdout: "event": "throttled", 2023-08-01T19:55:01.125 INFO:teuthology.orchestra.run.smithi155.stdout: "time": "2023-08-01T19:54:56.061190+0000", 2023-08-01T19:55:01.125 INFO:teuthology.orchestra.run.smithi155.stdout: "duration": 0 2023-08-01T19:55:01.125 INFO:teuthology.orchestra.run.smithi155.stdout: }, 2023-08-01T19:55:01.126 INFO:teuthology.orchestra.run.smithi155.stdout: { 2023-08-01T19:55:01.126 INFO:teuthology.orchestra.run.smithi155.stdout: "event": "header_read", 2023-08-01T19:55:01.126 INFO:teuthology.orchestra.run.smithi155.stdout: "time": "2023-08-01T19:54:56.061189+0000", 2023-08-01T19:55:01.126 INFO:teuthology.orchestra.run.smithi155.stdout: "duration": 4294967295.9999995 2023-08-01T19:55:01.126 INFO:teuthology.orchestra.run.smithi155.stdout: }, 2023-08-01T19:55:01.126 INFO:teuthology.orchestra.run.smithi155.stdout: { 2023-08-01T19:55:01.126 INFO:teuthology.orchestra.run.smithi155.stdout: "event": "all_read", 2023-08-01T19:55:01.126 INFO:teuthology.orchestra.run.smithi155.stdout: "time": "2023-08-01T19:54:56.061240+0000", 2023-08-01T19:55:01.127 INFO:teuthology.orchestra.run.smithi155.stdout: "duration": 5.0995999999999998e-05 2023-08-01T19:55:01.127 INFO:teuthology.orchestra.run.smithi155.stdout: }, 2023-08-01T19:55:01.127 INFO:teuthology.orchestra.run.smithi155.stdout: { 2023-08-01T19:55:01.127 INFO:teuthology.orchestra.run.smithi155.stdout: "event": "dispatched", 2023-08-01T19:55:01.127 INFO:teuthology.orchestra.run.smithi155.stdout: "time": "2023-08-01T19:54:56.061253+0000", 2023-08-01T19:55:01.127 INFO:teuthology.orchestra.run.smithi155.stdout: "duration": 1.2777e-05 2023-08-01T19:55:01.127 INFO:teuthology.orchestra.run.smithi155.stdout: }, 2023-08-01T19:55:01.127 INFO:teuthology.orchestra.run.smithi155.stdout: { 2023-08-01T19:55:01.128 INFO:teuthology.orchestra.run.smithi155.stdout: "event": "queued_for_pg", 2023-08-01T19:55:01.128 INFO:teuthology.orchestra.run.smithi155.stdout: "time": "2023-08-01T19:54:56.061257+0000", 2023-08-01T19:55:01.128 INFO:teuthology.orchestra.run.smithi155.stdout: "duration": 4.5179999999999998e-06 2023-08-01T19:55:01.128 INFO:teuthology.orchestra.run.smithi155.stdout: }, 2023-08-01T19:55:01.128 INFO:teuthology.orchestra.run.smithi155.stdout: { 2023-08-01T19:55:01.128 INFO:teuthology.orchestra.run.smithi155.stdout: "event": "reached_pg", 2023-08-01T19:55:01.128 INFO:teuthology.orchestra.run.smithi155.stdout: "time": "2023-08-01T19:54:56.061300+0000", 2023-08-01T19:55:01.128 INFO:teuthology.orchestra.run.smithi155.stdout: "duration": 4.3183999999999999e-05 2023-08-01T19:55:01.129 INFO:teuthology.orchestra.run.smithi155.stdout: }, 2023-08-01T19:55:01.129 INFO:teuthology.orchestra.run.smithi155.stdout: { 2023-08-01T19:55:01.129 INFO:teuthology.orchestra.run.smithi155.stdout: "event": "started", 2023-08-01T19:55:01.129 INFO:teuthology.orchestra.run.smithi155.stdout: "time": "2023-08-01T19:54:56.061424+0000", 2023-08-01T19:55:01.129 INFO:teuthology.orchestra.run.smithi155.stdout: "duration": 0.00012323 2023-08-01T19:55:01.129 INFO:teuthology.orchestra.run.smithi155.stdout: }, 2023-08-01T19:55:01.129 INFO:teuthology.orchestra.run.smithi155.stdout: { 2023-08-01T19:55:01.130 INFO:teuthology.orchestra.run.smithi155.stdout: "event": "waiting for subops from 1", 2023-08-01T19:55:01.130 INFO:teuthology.orchestra.run.smithi155.stdout: "time": "2023-08-01T19:54:56.061798+0000", 2023-08-01T19:55:01.130 INFO:teuthology.orchestra.run.smithi155.stdout: "duration": 0.000373925 2023-08-01T19:55:01.130 INFO:teuthology.orchestra.run.smithi155.stdout: }, 2023-08-01T19:55:01.130 INFO:teuthology.orchestra.run.smithi155.stdout: { 2023-08-01T19:55:01.130 INFO:teuthology.orchestra.run.smithi155.stdout: "event": "sub_op_commit_rec", 2023-08-01T19:55:01.130 INFO:teuthology.orchestra.run.smithi155.stdout: "time": "2023-08-01T19:54:56.068505+0000", 2023-08-01T19:55:01.130 INFO:teuthology.orchestra.run.smithi155.stdout: "duration": 0.0067069900000000003 2023-08-01T19:55:01.131 INFO:teuthology.orchestra.run.smithi155.stdout: }, 2023-08-01T19:55:01.131 INFO:teuthology.orchestra.run.smithi155.stdout: { 2023-08-01T19:55:01.131 INFO:teuthology.orchestra.run.smithi155.stdout: "event": "op_commit", 2023-08-01T19:55:01.131 INFO:teuthology.orchestra.run.smithi155.stdout: "time": "2023-08-01T19:54:56.077749+0000", 2023-08-01T19:55:01.131 INFO:teuthology.orchestra.run.smithi155.stdout: "duration": 0.0092441490000000001 2023-08-01T19:55:01.131 INFO:teuthology.orchestra.run.smithi155.stdout: }, 2023-08-01T19:55:01.131 INFO:teuthology.orchestra.run.smithi155.stdout: { 2023-08-01T19:55:01.131 INFO:teuthology.orchestra.run.smithi155.stdout: "event": "commit_sent", 2023-08-01T19:55:01.132 INFO:teuthology.orchestra.run.smithi155.stdout: "time": "2023-08-01T19:54:56.077797+0000", 2023-08-01T19:55:01.132 INFO:teuthology.orchestra.run.smithi155.stdout: "duration": 4.7796000000000001e-05 2023-08-01T19:55:01.132 INFO:teuthology.orchestra.run.smithi155.stdout: }, 2023-08-01T19:55:01.132 INFO:teuthology.orchestra.run.smithi155.stdout: { 2023-08-01T19:55:01.132 INFO:teuthology.orchestra.run.smithi155.stdout: "event": "done", 2023-08-01T19:55:01.132 INFO:teuthology.orchestra.run.smithi155.stdout: "time": "2023-08-01T19:54:56.077823+0000", 2023-08-01T19:55:01.132 INFO:teuthology.orchestra.run.smithi155.stdout: "duration": 2.6959000000000001e-05 2023-08-01T19:55:01.132 INFO:teuthology.orchestra.run.smithi155.stdout: } 2023-08-01T19:55:01.133 INFO:teuthology.orchestra.run.smithi155.stdout: ] 2023-08-01T19:55:01.133 INFO:teuthology.orchestra.run.smithi155.stdout: } 2023-08-01T19:55:01.133 INFO:teuthology.orchestra.run.smithi155.stdout: }, 2023-08-01T19:55:01.133 INFO:teuthology.orchestra.run.smithi155.stdout: { 2023-08-01T19:55:01.133 INFO:teuthology.orchestra.run.smithi155.stdout: "description": "osd_op(client.4668.0:82531 5.0 5:062782d2:::benchmark_data_smithi006_114134_object82530:head [set-alloc-hint object_size 65536 write_size 65536,write 0~65536] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e34)", 2023-08-01T19:55:01.133 INFO:teuthology.orchestra.run.smithi155.stdout: "initiated_at": "2023-08-01T19:54:56.064669+0000", 2023-08-01T19:55:01.133 INFO:teuthology.orchestra.run.smithi155.stdout: "age": 4.869512694, 2023-08-01T19:55:01.133 INFO:teuthology.orchestra.run.smithi155.stdout: "duration": 0.017374690000000002, 2023-08-01T19:55:01.134 INFO:teuthology.orchestra.run.smithi155.stdout: "type_data": { 2023-08-01T19:55:01.134 INFO:teuthology.orchestra.run.smithi155.stdout: "flag_point": "commit sent; apply or cleanup", 2023-08-01T19:55:01.134 INFO:teuthology.orchestra.run.smithi155.stdout: "client_info": { 2023-08-01T19:55:01.134 INFO:teuthology.orchestra.run.smithi155.stdout: "client": "client.4668", 2023-08-01T19:55:01.134 INFO:teuthology.orchestra.run.smithi155.stdout: "client_addr": "172.21.15.6:0/1709472247", 2023-08-01T19:55:01.134 INFO:teuthology.orchestra.run.smithi155.stdout: "tid": 82531 2023-08-01T19:55:01.134 INFO:teuthology.orchestra.run.smithi155.stdout: }, 2023-08-01T19:55:01.135 INFO:teuthology.orchestra.run.smithi155.stdout: "events": [ 2023-08-01T19:55:01.135 INFO:teuthology.orchestra.run.smithi155.stdout: { 2023-08-01T19:55:01.135 INFO:teuthology.orchestra.run.smithi155.stdout: "event": "initiated", 2023-08-01T19:55:01.135 INFO:teuthology.orchestra.run.smithi155.stdout: "time": "2023-08-01T19:54:56.064669+0000", 2023-08-01T19:55:01.135 INFO:teuthology.orchestra.run.smithi155.stdout: "duration": 0 2023-08-01T19:55:01.135 INFO:teuthology.orchestra.run.smithi155.stdout: }, 2023-08-01T19:55:01.135 INFO:teuthology.orchestra.run.smithi155.stdout: { 2023-08-01T19:55:01.135 INFO:teuthology.orchestra.run.smithi155.stdout: "event": "throttled", 2023-08-01T19:55:01.136 INFO:teuthology.orchestra.run.smithi155.stdout: "time": "2023-08-01T19:54:56.064669+0000", 2023-08-01T19:55:01.136 INFO:teuthology.orchestra.run.smithi155.stdout: "duration": 0 2023-08-01T19:55:01.136 INFO:teuthology.orchestra.run.smithi155.stdout: }, 2023-08-01T19:55:01.136 INFO:teuthology.orchestra.run.smithi155.stdout: { 2023-08-01T19:55:01.136 INFO:teuthology.orchestra.run.smithi155.stdout: "event": "header_read", 2023-08-01T19:55:01.136 INFO:teuthology.orchestra.run.smithi155.stdout: "time": "2023-08-01T19:54:56.064668+0000", 2023-08-01T19:55:01.136 INFO:teuthology.orchestra.run.smithi155.stdout: "duration": 4294967295.9999986 2023-08-01T19:55:01.136 INFO:teuthology.orchestra.run.smithi155.stdout: }, 2023-08-01T19:55:01.137 INFO:teuthology.orchestra.run.smithi155.stdout: { 2023-08-01T19:55:01.137 INFO:teuthology.orchestra.run.smithi155.stdout: "event": "all_read", 2023-08-01T19:55:01.137 INFO:teuthology.orchestra.run.smithi155.stdout: "time": "2023-08-01T19:54:56.064785+0000", 2023-08-01T19:55:01.137 INFO:teuthology.orchestra.run.smithi155.stdout: "duration": 0.000117064 2023-08-01T19:55:01.137 INFO:teuthology.orchestra.run.smithi155.stdout: }, 2023-08-01T19:55:01.137 INFO:teuthology.orchestra.run.smithi155.stdout: { 2023-08-01T19:55:01.137 INFO:teuthology.orchestra.run.smithi155.stdout: "event": "dispatched", 2023-08-01T19:55:01.137 INFO:teuthology.orchestra.run.smithi155.stdout: "time": "2023-08-01T19:54:56.064797+0000", 2023-08-01T19:55:01.138 INFO:teuthology.orchestra.run.smithi155.stdout: "duration": 1.1963e-05 2023-08-01T19:55:01.138 INFO:teuthology.orchestra.run.smithi155.stdout: }, 2023-08-01T19:55:01.138 INFO:teuthology.orchestra.run.smithi155.stdout: { 2023-08-01T19:55:01.138 INFO:teuthology.orchestra.run.smithi155.stdout: "event": "queued_for_pg", 2023-08-01T19:55:01.138 INFO:teuthology.orchestra.run.smithi155.stdout: "time": "2023-08-01T19:54:56.064804+0000", 2023-08-01T19:55:01.138 INFO:teuthology.orchestra.run.smithi155.stdout: "duration": 7.2710000000000003e-06 2023-08-01T19:55:01.138 INFO:teuthology.orchestra.run.smithi155.stdout: }, 2023-08-01T19:55:01.138 INFO:teuthology.orchestra.run.smithi155.stdout: { 2023-08-01T19:55:01.139 INFO:teuthology.orchestra.run.smithi155.stdout: "event": "reached_pg", 2023-08-01T19:55:01.139 INFO:teuthology.orchestra.run.smithi155.stdout: "time": "2023-08-01T19:54:56.064836+0000", 2023-08-01T19:55:01.139 INFO:teuthology.orchestra.run.smithi155.stdout: "duration": 3.1714999999999997e-05 2023-08-01T19:55:01.139 INFO:teuthology.orchestra.run.smithi155.stdout: }, 2023-08-01T19:55:01.139 INFO:teuthology.orchestra.run.smithi155.stdout: { 2023-08-01T19:55:01.139 INFO:teuthology.orchestra.run.smithi155.stdout: "event": "started", 2023-08-01T19:55:01.139 INFO:teuthology.orchestra.run.smithi155.stdout: "time": "2023-08-01T19:54:56.064928+0000", 2023-08-01T19:55:01.139 INFO:teuthology.orchestra.run.smithi155.stdout: "duration": 9.2335000000000003e-05 2023-08-01T19:55:01.140 INFO:teuthology.orchestra.run.smithi155.stdout: }, 2023-08-01T19:55:01.140 INFO:teuthology.orchestra.run.smithi155.stdout: { 2023-08-01T19:55:01.140 INFO:teuthology.orchestra.run.smithi155.stdout: "event": "waiting for subops from 0", 2023-08-01T19:55:01.140 INFO:teuthology.orchestra.run.smithi155.stdout: "time": "2023-08-01T19:54:56.065019+0000", 2023-08-01T19:55:01.140 INFO:teuthology.orchestra.run.smithi155.stdout: "duration": 9.1176999999999998e-05 2023-08-01T19:55:01.140 INFO:teuthology.orchestra.run.smithi155.stdout: }, 2023-08-01T19:55:01.140 INFO:teuthology.orchestra.run.smithi155.stdout: { 2023-08-01T19:55:01.141 INFO:teuthology.orchestra.run.smithi155.stdout: "event": "sub_op_commit_rec", 2023-08-01T19:55:01.141 INFO:teuthology.orchestra.run.smithi155.stdout: "time": "2023-08-01T19:54:56.069544+0000", 2023-08-01T19:55:01.141 INFO:teuthology.orchestra.run.smithi155.stdout: "duration": 0.0045247000000000004 2023-08-01T19:55:01.141 INFO:teuthology.orchestra.run.smithi155.stdout: }, 2023-08-01T19:55:01.141 INFO:teuthology.orchestra.run.smithi155.stdout: { 2023-08-01T19:55:01.141 INFO:teuthology.orchestra.run.smithi155.stdout: "event": "op_commit", 2023-08-01T19:55:01.141 INFO:teuthology.orchestra.run.smithi155.stdout: "time": "2023-08-01T19:54:56.081961+0000", 2023-08-01T19:55:01.141 INFO:teuthology.orchestra.run.smithi155.stdout: "duration": 0.012416801999999999 2023-08-01T19:55:01.142 INFO:teuthology.orchestra.run.smithi155.stdout: }, 2023-08-01T19:55:01.142 INFO:teuthology.orchestra.run.smithi155.stdout: { 2023-08-01T19:55:01.142 INFO:teuthology.orchestra.run.smithi155.stdout: "event": "commit_sent", 2023-08-01T19:55:01.142 INFO:teuthology.orchestra.run.smithi155.stdout: "time": "2023-08-01T19:54:56.082007+0000", 2023-08-01T19:55:01.142 INFO:teuthology.orchestra.run.smithi155.stdout: "duration": 4.6446999999999998e-05 2023-08-01T19:55:01.142 INFO:teuthology.orchestra.run.smithi155.stdout: }, 2023-08-01T19:55:01.142 INFO:teuthology.orchestra.run.smithi155.stdout: { 2023-08-01T19:55:01.142 INFO:teuthology.orchestra.run.smithi155.stdout: "event": "done", 2023-08-01T19:55:01.143 INFO:teuthology.orchestra.run.smithi155.stdout: "time": "2023-08-01T19:54:56.082044+0000", 2023-08-01T19:55:01.143 INFO:teuthology.orchestra.run.smithi155.stdout: "duration": 3.6427999999999997e-05 2023-08-01T19:55:01.143 INFO:teuthology.orchestra.run.smithi155.stdout: } 2023-08-01T19:55:01.143 INFO:teuthology.orchestra.run.smithi155.stdout: ] 2023-08-01T19:55:01.143 INFO:teuthology.orchestra.run.smithi155.stdout: } 2023-08-01T19:55:01.143 INFO:teuthology.orchestra.run.smithi155.stdout: } 2023-08-01T19:55:01.143 INFO:teuthology.orchestra.run.smithi155.stdout: ] 2023-08-01T19:55:01.143 INFO:teuthology.orchestra.run.smithi155.stdout:} 2023-08-01T19:55:01.145 INFO:tasks.ceph.osd.1.smithi101.stderr:2023-08-01T19:55:01.143+0000 7fb0cb7f6700 -1 received signal: Hangup from /usr/bin/python3 /bin/daemon-helper kill ceph-osd -f --cluster ceph -i 1 (PID: 111141) UID: 0 2023-08-01T19:55:01.146 INFO:teuthology.orchestra.run.smithi006.stderr:nodeep-scrub is set 2023-08-01T19:55:01.146 DEBUG:teuthology.orchestra.run.smithi008:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 30 ceph --cluster ceph --admin-daemon /var/run/ceph/ceph-osd.0.asok dump_ops_in_flight 2023-08-01T19:55:01.182 DEBUG:teuthology.orchestra.run.smithi006:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 120 ceph --cluster ceph -- tell 'osd.*' injectargs --osd_enable_op_tracker=false 2023-08-01T19:55:01.245 INFO:tasks.ceph.osd.2.smithi155.stderr:2023-08-01T19:55:01.243+0000 7faa5c6ac700 -1 received signal: Hangup from /usr/bin/python3 /bin/daemon-helper kill ceph-osd -f --cluster ceph -i 2 (PID: 111337) UID: 0 2023-08-01T19:55:01.315 INFO:tasks.radosbench.radosbench.0.smithi006.stdout: 37 16 92829 92813 156.766 123.938 0.00569003 0.00637601 2023-08-01T19:55:01.332 INFO:teuthology.orchestra.run.smithi008.stdout:{ 2023-08-01T19:55:01.332 INFO:teuthology.orchestra.run.smithi008.stdout: "ops": [ 2023-08-01T19:55:01.332 INFO:teuthology.orchestra.run.smithi008.stdout: { 2023-08-01T19:55:01.333 INFO:teuthology.orchestra.run.smithi008.stdout: "description": "osd_repop(client.4668.0:92853 5.1 e36/19 5:80fef17f:::benchmark_data_smithi006_114134_object92852:head v 36'5749, mlcod=36'5746)", 2023-08-01T19:55:01.333 INFO:teuthology.orchestra.run.smithi008.stdout: "initiated_at": "2023-08-01T19:55:01.328606+0000", 2023-08-01T19:55:01.333 INFO:teuthology.orchestra.run.smithi008.stdout: "age": 0.0022883589999999998, 2023-08-01T19:55:01.333 INFO:teuthology.orchestra.run.smithi008.stdout: "duration": 0.0023118599999999998, 2023-08-01T19:55:01.333 INFO:teuthology.orchestra.run.smithi008.stdout: "type_data": { 2023-08-01T19:55:01.333 INFO:teuthology.orchestra.run.smithi008.stdout: "flag_point": "started", 2023-08-01T19:55:01.333 INFO:teuthology.orchestra.run.smithi008.stdout: "events": [ 2023-08-01T19:55:01.333 INFO:teuthology.orchestra.run.smithi008.stdout: { 2023-08-01T19:55:01.334 INFO:teuthology.orchestra.run.smithi008.stdout: "event": "initiated", 2023-08-01T19:55:01.334 INFO:teuthology.orchestra.run.smithi008.stdout: "time": "2023-08-01T19:55:01.328606+0000", 2023-08-01T19:55:01.334 INFO:teuthology.orchestra.run.smithi008.stdout: "duration": 0 2023-08-01T19:55:01.334 INFO:teuthology.orchestra.run.smithi008.stdout: }, 2023-08-01T19:55:01.334 INFO:teuthology.orchestra.run.smithi008.stdout: { 2023-08-01T19:55:01.334 INFO:teuthology.orchestra.run.smithi008.stdout: "event": "throttled", 2023-08-01T19:55:01.334 INFO:teuthology.orchestra.run.smithi008.stdout: "time": "2023-08-01T19:55:01.328606+0000", 2023-08-01T19:55:01.335 INFO:teuthology.orchestra.run.smithi008.stdout: "duration": 0 2023-08-01T19:55:01.335 INFO:teuthology.orchestra.run.smithi008.stdout: }, 2023-08-01T19:55:01.335 INFO:teuthology.orchestra.run.smithi008.stdout: { 2023-08-01T19:55:01.335 INFO:teuthology.orchestra.run.smithi008.stdout: "event": "header_read", 2023-08-01T19:55:01.335 INFO:teuthology.orchestra.run.smithi008.stdout: "time": "2023-08-01T19:55:01.328600+0000", 2023-08-01T19:55:01.335 INFO:teuthology.orchestra.run.smithi008.stdout: "duration": 4294967295.9999943 2023-08-01T19:55:01.335 INFO:teuthology.orchestra.run.smithi008.stdout: }, 2023-08-01T19:55:01.335 INFO:teuthology.orchestra.run.smithi008.stdout: { 2023-08-01T19:55:01.336 INFO:teuthology.orchestra.run.smithi008.stdout: "event": "all_read", 2023-08-01T19:55:01.336 INFO:teuthology.orchestra.run.smithi008.stdout: "time": "2023-08-01T19:55:01.328657+0000", 2023-08-01T19:55:01.336 INFO:teuthology.orchestra.run.smithi008.stdout: "duration": 5.7018999999999997e-05 2023-08-01T19:55:01.336 INFO:teuthology.orchestra.run.smithi008.stdout: }, 2023-08-01T19:55:01.336 INFO:teuthology.orchestra.run.smithi008.stdout: { 2023-08-01T19:55:01.336 INFO:teuthology.orchestra.run.smithi008.stdout: "event": "dispatched", 2023-08-01T19:55:01.336 INFO:teuthology.orchestra.run.smithi008.stdout: "time": "2023-08-01T19:55:01.328667+0000", 2023-08-01T19:55:01.336 INFO:teuthology.orchestra.run.smithi008.stdout: "duration": 9.9669999999999996e-06 2023-08-01T19:55:01.337 INFO:teuthology.orchestra.run.smithi008.stdout: }, 2023-08-01T19:55:01.337 INFO:teuthology.orchestra.run.smithi008.stdout: { 2023-08-01T19:55:01.337 INFO:teuthology.orchestra.run.smithi008.stdout: "event": "queued_for_pg", 2023-08-01T19:55:01.337 INFO:teuthology.orchestra.run.smithi008.stdout: "time": "2023-08-01T19:55:01.328672+0000", 2023-08-01T19:55:01.337 INFO:teuthology.orchestra.run.smithi008.stdout: "duration": 5.0679999999999996e-06 2023-08-01T19:55:01.337 INFO:teuthology.orchestra.run.smithi008.stdout: }, 2023-08-01T19:55:01.337 INFO:teuthology.orchestra.run.smithi008.stdout: { 2023-08-01T19:55:01.338 INFO:teuthology.orchestra.run.smithi008.stdout: "event": "reached_pg", 2023-08-01T19:55:01.338 INFO:teuthology.orchestra.run.smithi008.stdout: "time": "2023-08-01T19:55:01.328714+0000", 2023-08-01T19:55:01.338 INFO:teuthology.orchestra.run.smithi008.stdout: "duration": 4.1183000000000002e-05 2023-08-01T19:55:01.338 INFO:teuthology.orchestra.run.smithi008.stdout: }, 2023-08-01T19:55:01.338 INFO:teuthology.orchestra.run.smithi008.stdout: { 2023-08-01T19:55:01.338 INFO:teuthology.orchestra.run.smithi008.stdout: "event": "started", 2023-08-01T19:55:01.338 INFO:teuthology.orchestra.run.smithi008.stdout: "time": "2023-08-01T19:55:01.328735+0000", 2023-08-01T19:55:01.338 INFO:teuthology.orchestra.run.smithi008.stdout: "duration": 2.1254999999999999e-05 2023-08-01T19:55:01.339 INFO:teuthology.orchestra.run.smithi008.stdout: } 2023-08-01T19:55:01.339 INFO:teuthology.orchestra.run.smithi008.stdout: ] 2023-08-01T19:55:01.339 INFO:teuthology.orchestra.run.smithi008.stdout: } 2023-08-01T19:55:01.339 INFO:teuthology.orchestra.run.smithi008.stdout: }, 2023-08-01T19:55:01.339 INFO:teuthology.orchestra.run.smithi008.stdout: { 2023-08-01T19:55:01.339 INFO:teuthology.orchestra.run.smithi008.stdout: "description": "osd_op(client.4668.0:92857 5.c 5:31a12110:::benchmark_data_smithi006_114134_object92856:head [set-alloc-hint object_size 65536 write_size 65536,write 0~65536 in=65536b] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e36)", 2023-08-01T19:55:01.339 INFO:teuthology.orchestra.run.smithi008.stdout: "initiated_at": "2023-08-01T19:55:01.328676+0000", 2023-08-01T19:55:01.339 INFO:teuthology.orchestra.run.smithi008.stdout: "age": 0.0022186409999999999, 2023-08-01T19:55:01.340 INFO:teuthology.orchestra.run.smithi008.stdout: "duration": 0.0023231910000000001, 2023-08-01T19:55:01.340 INFO:teuthology.orchestra.run.smithi008.stdout: "type_data": { 2023-08-01T19:55:01.340 INFO:teuthology.orchestra.run.smithi008.stdout: "flag_point": "waiting for sub ops", 2023-08-01T19:55:01.340 INFO:teuthology.orchestra.run.smithi008.stdout: "client_info": { 2023-08-01T19:55:01.340 INFO:teuthology.orchestra.run.smithi008.stdout: "client": "client.4668", 2023-08-01T19:55:01.340 INFO:teuthology.orchestra.run.smithi008.stdout: "client_addr": "172.21.15.6:0/1709472247", 2023-08-01T19:55:01.340 INFO:teuthology.orchestra.run.smithi008.stdout: "tid": 92857 2023-08-01T19:55:01.341 INFO:teuthology.orchestra.run.smithi008.stdout: }, 2023-08-01T19:55:01.341 INFO:teuthology.orchestra.run.smithi008.stdout: "events": [ 2023-08-01T19:55:01.341 INFO:teuthology.orchestra.run.smithi008.stdout: { 2023-08-01T19:55:01.341 INFO:teuthology.orchestra.run.smithi008.stdout: "event": "initiated", 2023-08-01T19:55:01.341 INFO:teuthology.orchestra.run.smithi008.stdout: "time": "2023-08-01T19:55:01.328676+0000", 2023-08-01T19:55:01.341 INFO:teuthology.orchestra.run.smithi008.stdout: "duration": 0 2023-08-01T19:55:01.341 INFO:teuthology.orchestra.run.smithi008.stdout: }, 2023-08-01T19:55:01.341 INFO:teuthology.orchestra.run.smithi008.stdout: { 2023-08-01T19:55:01.342 INFO:teuthology.orchestra.run.smithi008.stdout: "event": "throttled", 2023-08-01T19:55:01.342 INFO:teuthology.orchestra.run.smithi008.stdout: "time": "2023-08-01T19:55:01.328676+0000", 2023-08-01T19:55:01.342 INFO:teuthology.orchestra.run.smithi008.stdout: "duration": 0 2023-08-01T19:55:01.342 INFO:teuthology.orchestra.run.smithi008.stdout: }, 2023-08-01T19:55:01.342 INFO:teuthology.orchestra.run.smithi008.stdout: { 2023-08-01T19:55:01.342 INFO:teuthology.orchestra.run.smithi008.stdout: "event": "header_read", 2023-08-01T19:55:01.342 INFO:teuthology.orchestra.run.smithi008.stdout: "time": "2023-08-01T19:55:01.328675+0000", 2023-08-01T19:55:01.342 INFO:teuthology.orchestra.run.smithi008.stdout: "duration": 4294967295.999999 2023-08-01T19:55:01.343 INFO:teuthology.orchestra.run.smithi008.stdout: }, 2023-08-01T19:55:01.343 INFO:teuthology.orchestra.run.smithi008.stdout: { 2023-08-01T19:55:01.343 INFO:teuthology.orchestra.run.smithi008.stdout: "event": "all_read", 2023-08-01T19:55:01.343 INFO:teuthology.orchestra.run.smithi008.stdout: "time": "2023-08-01T19:55:01.328755+0000", 2023-08-01T19:55:01.343 INFO:teuthology.orchestra.run.smithi008.stdout: "duration": 7.9973000000000002e-05 2023-08-01T19:55:01.343 INFO:teuthology.orchestra.run.smithi008.stdout: }, 2023-08-01T19:55:01.343 INFO:teuthology.orchestra.run.smithi008.stdout: { 2023-08-01T19:55:01.344 INFO:teuthology.orchestra.run.smithi008.stdout: "event": "dispatched", 2023-08-01T19:55:01.344 INFO:teuthology.orchestra.run.smithi008.stdout: "time": "2023-08-01T19:55:01.328764+0000", 2023-08-01T19:55:01.344 INFO:teuthology.orchestra.run.smithi008.stdout: "duration": 9.5370000000000003e-06 2023-08-01T19:55:01.344 INFO:teuthology.orchestra.run.smithi008.stdout: }, 2023-08-01T19:55:01.344 INFO:teuthology.orchestra.run.smithi008.stdout: { 2023-08-01T19:55:01.344 INFO:teuthology.orchestra.run.smithi008.stdout: "event": "queued_for_pg", 2023-08-01T19:55:01.344 INFO:teuthology.orchestra.run.smithi008.stdout: "time": "2023-08-01T19:55:01.328769+0000", 2023-08-01T19:55:01.344 INFO:teuthology.orchestra.run.smithi008.stdout: "duration": 4.6809999999999997e-06 2023-08-01T19:55:01.345 INFO:teuthology.orchestra.run.smithi008.stdout: }, 2023-08-01T19:55:01.345 INFO:teuthology.orchestra.run.smithi008.stdout: { 2023-08-01T19:55:01.345 INFO:teuthology.orchestra.run.smithi008.stdout: "event": "reached_pg", 2023-08-01T19:55:01.345 INFO:teuthology.orchestra.run.smithi008.stdout: "time": "2023-08-01T19:55:01.328797+0000", 2023-08-01T19:55:01.345 INFO:teuthology.orchestra.run.smithi008.stdout: "duration": 2.7946e-05 2023-08-01T19:55:01.345 INFO:teuthology.orchestra.run.smithi008.stdout: }, 2023-08-01T19:55:01.345 INFO:teuthology.orchestra.run.smithi008.stdout: { 2023-08-01T19:55:01.346 INFO:teuthology.orchestra.run.smithi008.stdout: "event": "started", 2023-08-01T19:55:01.346 INFO:teuthology.orchestra.run.smithi008.stdout: "time": "2023-08-01T19:55:01.328874+0000", 2023-08-01T19:55:01.346 INFO:teuthology.orchestra.run.smithi008.stdout: "duration": 7.7049e-05 2023-08-01T19:55:01.346 INFO:teuthology.orchestra.run.smithi008.stdout: }, 2023-08-01T19:55:01.346 INFO:teuthology.orchestra.run.smithi008.stdout: { 2023-08-01T19:55:01.346 INFO:teuthology.orchestra.run.smithi008.stdout: "event": "waiting for subops from 1", 2023-08-01T19:55:01.347 INFO:teuthology.orchestra.run.smithi008.stdout: "time": "2023-08-01T19:55:01.328971+0000", 2023-08-01T19:55:01.347 INFO:teuthology.orchestra.run.smithi008.stdout: "duration": 9.6924999999999998e-05 2023-08-01T19:55:01.347 INFO:teuthology.orchestra.run.smithi008.stdout: } 2023-08-01T19:55:01.347 INFO:teuthology.orchestra.run.smithi008.stdout: ] 2023-08-01T19:55:01.347 INFO:teuthology.orchestra.run.smithi008.stdout: } 2023-08-01T19:55:01.347 INFO:teuthology.orchestra.run.smithi008.stdout: }, 2023-08-01T19:55:01.347 INFO:teuthology.orchestra.run.smithi008.stdout: { 2023-08-01T19:55:01.347 INFO:teuthology.orchestra.run.smithi008.stdout: "description": "osd_repop(client.4668.0:92855 5.b e36/19 5:d0a17ae7:::benchmark_data_smithi006_114134_object92854:head v 36'5751, mlcod=36'5749)", 2023-08-01T19:55:01.348 INFO:teuthology.orchestra.run.smithi008.stdout: "initiated_at": "2023-08-01T19:55:01.328876+0000", 2023-08-01T19:55:01.348 INFO:teuthology.orchestra.run.smithi008.stdout: "age": 0.0020184600000000001, 2023-08-01T19:55:01.348 INFO:teuthology.orchestra.run.smithi008.stdout: "duration": 0.0021869519999999998, 2023-08-01T19:55:01.348 INFO:teuthology.orchestra.run.smithi008.stdout: "type_data": { 2023-08-01T19:55:01.348 INFO:teuthology.orchestra.run.smithi008.stdout: "flag_point": "started", 2023-08-01T19:55:01.348 INFO:teuthology.orchestra.run.smithi008.stdout: "events": [ 2023-08-01T19:55:01.348 INFO:teuthology.orchestra.run.smithi008.stdout: { 2023-08-01T19:55:01.349 INFO:teuthology.orchestra.run.smithi008.stdout: "event": "initiated", 2023-08-01T19:55:01.349 INFO:teuthology.orchestra.run.smithi008.stdout: "time": "2023-08-01T19:55:01.328876+0000", 2023-08-01T19:55:01.349 INFO:teuthology.orchestra.run.smithi008.stdout: "duration": 0 2023-08-01T19:55:01.349 INFO:teuthology.orchestra.run.smithi008.stdout: }, 2023-08-01T19:55:01.349 INFO:teuthology.orchestra.run.smithi008.stdout: { 2023-08-01T19:55:01.349 INFO:teuthology.orchestra.run.smithi008.stdout: "event": "throttled", 2023-08-01T19:55:01.349 INFO:teuthology.orchestra.run.smithi008.stdout: "time": "2023-08-01T19:55:01.328876+0000", 2023-08-01T19:55:01.349 INFO:teuthology.orchestra.run.smithi008.stdout: "duration": 0 2023-08-01T19:55:01.350 INFO:teuthology.orchestra.run.smithi008.stdout: }, 2023-08-01T19:55:01.350 INFO:teuthology.orchestra.run.smithi008.stdout: { 2023-08-01T19:55:01.350 INFO:teuthology.orchestra.run.smithi008.stdout: "event": "header_read", 2023-08-01T19:55:01.350 INFO:teuthology.orchestra.run.smithi008.stdout: "time": "2023-08-01T19:55:01.328876+0000", 2023-08-01T19:55:01.350 INFO:teuthology.orchestra.run.smithi008.stdout: "duration": 4294967295.9999995 2023-08-01T19:55:01.350 INFO:teuthology.orchestra.run.smithi008.stdout: }, 2023-08-01T19:55:01.350 INFO:teuthology.orchestra.run.smithi008.stdout: { 2023-08-01T19:55:01.350 INFO:teuthology.orchestra.run.smithi008.stdout: "event": "all_read", 2023-08-01T19:55:01.351 INFO:teuthology.orchestra.run.smithi008.stdout: "time": "2023-08-01T19:55:01.328935+0000", 2023-08-01T19:55:01.351 INFO:teuthology.orchestra.run.smithi008.stdout: "duration": 5.9342000000000002e-05 2023-08-01T19:55:01.351 INFO:teuthology.orchestra.run.smithi008.stdout: }, 2023-08-01T19:55:01.351 INFO:teuthology.orchestra.run.smithi008.stdout: { 2023-08-01T19:55:01.351 INFO:teuthology.orchestra.run.smithi008.stdout: "event": "dispatched", 2023-08-01T19:55:01.351 INFO:teuthology.orchestra.run.smithi008.stdout: "time": "2023-08-01T19:55:01.328940+0000", 2023-08-01T19:55:01.351 INFO:teuthology.orchestra.run.smithi008.stdout: "duration": 5.1000000000000003e-06 2023-08-01T19:55:01.351 INFO:teuthology.orchestra.run.smithi008.stdout: }, 2023-08-01T19:55:01.352 INFO:teuthology.orchestra.run.smithi008.stdout: { 2023-08-01T19:55:01.352 INFO:teuthology.orchestra.run.smithi008.stdout: "event": "queued_for_pg", 2023-08-01T19:55:01.352 INFO:teuthology.orchestra.run.smithi008.stdout: "time": "2023-08-01T19:55:01.328943+0000", 2023-08-01T19:55:01.352 INFO:teuthology.orchestra.run.smithi008.stdout: "duration": 3.2140000000000001e-06 2023-08-01T19:55:01.352 INFO:teuthology.orchestra.run.smithi008.stdout: }, 2023-08-01T19:55:01.352 INFO:teuthology.orchestra.run.smithi008.stdout: { 2023-08-01T19:55:01.352 INFO:teuthology.orchestra.run.smithi008.stdout: "event": "reached_pg", 2023-08-01T19:55:01.352 INFO:teuthology.orchestra.run.smithi008.stdout: "time": "2023-08-01T19:55:01.328972+0000", 2023-08-01T19:55:01.353 INFO:teuthology.orchestra.run.smithi008.stdout: "duration": 2.8343e-05 2023-08-01T19:55:01.353 INFO:teuthology.orchestra.run.smithi008.stdout: }, 2023-08-01T19:55:01.353 INFO:teuthology.orchestra.run.smithi008.stdout: { 2023-08-01T19:55:01.353 INFO:teuthology.orchestra.run.smithi008.stdout: "event": "started", 2023-08-01T19:55:01.353 INFO:teuthology.orchestra.run.smithi008.stdout: "time": "2023-08-01T19:55:01.328983+0000", 2023-08-01T19:55:01.353 INFO:teuthology.orchestra.run.smithi008.stdout: "duration": 1.1671000000000001e-05 2023-08-01T19:55:01.353 INFO:teuthology.orchestra.run.smithi008.stdout: } 2023-08-01T19:55:01.353 INFO:teuthology.orchestra.run.smithi008.stdout: ] 2023-08-01T19:55:01.354 INFO:teuthology.orchestra.run.smithi008.stdout: } 2023-08-01T19:55:01.354 INFO:teuthology.orchestra.run.smithi008.stdout: }, 2023-08-01T19:55:01.354 INFO:teuthology.orchestra.run.smithi008.stdout: { 2023-08-01T19:55:01.354 INFO:teuthology.orchestra.run.smithi008.stdout: "description": "osd_repop(client.4668.0:92856 5.e e36/19 5:7fa28f23:::benchmark_data_smithi006_114134_object92855:head v 36'5810, mlcod=36'5807)", 2023-08-01T19:55:01.354 INFO:teuthology.orchestra.run.smithi008.stdout: "initiated_at": "2023-08-01T19:55:01.329203+0000", 2023-08-01T19:55:01.354 INFO:teuthology.orchestra.run.smithi008.stdout: "age": 0.001691644, 2023-08-01T19:55:01.354 INFO:teuthology.orchestra.run.smithi008.stdout: "duration": 0.001894326, 2023-08-01T19:55:01.355 INFO:teuthology.orchestra.run.smithi008.stdout: "type_data": { 2023-08-01T19:55:01.355 INFO:teuthology.orchestra.run.smithi008.stdout: "flag_point": "started", 2023-08-01T19:55:01.355 INFO:teuthology.orchestra.run.smithi008.stdout: "events": [ 2023-08-01T19:55:01.355 INFO:teuthology.orchestra.run.smithi008.stdout: { 2023-08-01T19:55:01.355 INFO:teuthology.orchestra.run.smithi008.stdout: "event": "initiated", 2023-08-01T19:55:01.355 INFO:teuthology.orchestra.run.smithi008.stdout: "time": "2023-08-01T19:55:01.329203+0000", 2023-08-01T19:55:01.355 INFO:teuthology.orchestra.run.smithi008.stdout: "duration": 0 2023-08-01T19:55:01.355 INFO:teuthology.orchestra.run.smithi008.stdout: }, 2023-08-01T19:55:01.356 INFO:teuthology.orchestra.run.smithi008.stdout: { 2023-08-01T19:55:01.356 INFO:teuthology.orchestra.run.smithi008.stdout: "event": "throttled", 2023-08-01T19:55:01.356 INFO:teuthology.orchestra.run.smithi008.stdout: "time": "2023-08-01T19:55:01.329203+0000", 2023-08-01T19:55:01.356 INFO:teuthology.orchestra.run.smithi008.stdout: "duration": 0 2023-08-01T19:55:01.356 INFO:teuthology.orchestra.run.smithi008.stdout: }, 2023-08-01T19:55:01.356 INFO:teuthology.orchestra.run.smithi008.stdout: { 2023-08-01T19:55:01.356 INFO:teuthology.orchestra.run.smithi008.stdout: "event": "header_read", 2023-08-01T19:55:01.357 INFO:teuthology.orchestra.run.smithi008.stdout: "time": "2023-08-01T19:55:01.329202+0000", 2023-08-01T19:55:01.357 INFO:teuthology.orchestra.run.smithi008.stdout: "duration": 4294967295.9999995 2023-08-01T19:55:01.357 INFO:teuthology.orchestra.run.smithi008.stdout: }, 2023-08-01T19:55:01.357 INFO:teuthology.orchestra.run.smithi008.stdout: { 2023-08-01T19:55:01.357 INFO:teuthology.orchestra.run.smithi008.stdout: "event": "all_read", 2023-08-01T19:55:01.357 INFO:teuthology.orchestra.run.smithi008.stdout: "time": "2023-08-01T19:55:01.329255+0000", 2023-08-01T19:55:01.357 INFO:teuthology.orchestra.run.smithi008.stdout: "duration": 5.3025999999999997e-05 2023-08-01T19:55:01.357 INFO:teuthology.orchestra.run.smithi008.stdout: }, 2023-08-01T19:55:01.358 INFO:teuthology.orchestra.run.smithi008.stdout: { 2023-08-01T19:55:01.358 INFO:teuthology.orchestra.run.smithi008.stdout: "event": "dispatched", 2023-08-01T19:55:01.358 INFO:teuthology.orchestra.run.smithi008.stdout: "time": "2023-08-01T19:55:01.329267+0000", 2023-08-01T19:55:01.358 INFO:teuthology.orchestra.run.smithi008.stdout: "duration": 1.1226000000000001e-05 2023-08-01T19:55:01.358 INFO:teuthology.orchestra.run.smithi008.stdout: }, 2023-08-01T19:55:01.358 INFO:teuthology.orchestra.run.smithi008.stdout: { 2023-08-01T19:55:01.358 INFO:teuthology.orchestra.run.smithi008.stdout: "event": "queued_for_pg", 2023-08-01T19:55:01.359 INFO:teuthology.orchestra.run.smithi008.stdout: "time": "2023-08-01T19:55:01.329272+0000", 2023-08-01T19:55:01.359 INFO:teuthology.orchestra.run.smithi008.stdout: "duration": 5.1569999999999999e-06 2023-08-01T19:55:01.359 INFO:teuthology.orchestra.run.smithi008.stdout: }, 2023-08-01T19:55:01.359 INFO:teuthology.orchestra.run.smithi008.stdout: { 2023-08-01T19:55:01.359 INFO:teuthology.orchestra.run.smithi008.stdout: "event": "reached_pg", 2023-08-01T19:55:01.359 INFO:teuthology.orchestra.run.smithi008.stdout: "time": "2023-08-01T19:55:01.329311+0000", 2023-08-01T19:55:01.359 INFO:teuthology.orchestra.run.smithi008.stdout: "duration": 3.9613000000000002e-05 2023-08-01T19:55:01.359 INFO:teuthology.orchestra.run.smithi008.stdout: }, 2023-08-01T19:55:01.360 INFO:teuthology.orchestra.run.smithi008.stdout: { 2023-08-01T19:55:01.360 INFO:teuthology.orchestra.run.smithi008.stdout: "event": "started", 2023-08-01T19:55:01.360 INFO:teuthology.orchestra.run.smithi008.stdout: "time": "2023-08-01T19:55:01.329331+0000", 2023-08-01T19:55:01.360 INFO:teuthology.orchestra.run.smithi008.stdout: "duration": 1.9673999999999998e-05 2023-08-01T19:55:01.360 INFO:teuthology.orchestra.run.smithi008.stdout: } 2023-08-01T19:55:01.360 INFO:teuthology.orchestra.run.smithi008.stdout: ] 2023-08-01T19:55:01.360 INFO:teuthology.orchestra.run.smithi008.stdout: } 2023-08-01T19:55:01.361 INFO:teuthology.orchestra.run.smithi008.stdout: }, 2023-08-01T19:55:01.361 INFO:teuthology.orchestra.run.smithi008.stdout: { 2023-08-01T19:55:01.361 INFO:teuthology.orchestra.run.smithi008.stdout: "description": "osd_op(client.4668.0:92843 5.a 5:58dcaaba:::benchmark_data_smithi006_114134_object92842:head [set-alloc-hint object_size 65536 write_size 65536,write 0~65536 in=65536b] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e36)", 2023-08-01T19:55:01.361 INFO:teuthology.orchestra.run.smithi008.stdout: "initiated_at": "2023-08-01T19:55:01.323191+0000", 2023-08-01T19:55:01.361 INFO:teuthology.orchestra.run.smithi008.stdout: "age": 0.0077034030000000002, 2023-08-01T19:55:01.361 INFO:teuthology.orchestra.run.smithi008.stdout: "duration": 0.0079553360000000004, 2023-08-01T19:55:01.361 INFO:teuthology.orchestra.run.smithi008.stdout: "type_data": { 2023-08-01T19:55:01.361 INFO:teuthology.orchestra.run.smithi008.stdout: "flag_point": "waiting for sub ops", 2023-08-01T19:55:01.362 INFO:teuthology.orchestra.run.smithi008.stdout: "client_info": { 2023-08-01T19:55:01.362 INFO:teuthology.orchestra.run.smithi008.stdout: "client": "client.4668", 2023-08-01T19:55:01.362 INFO:teuthology.orchestra.run.smithi008.stdout: "client_addr": "172.21.15.6:0/1709472247", 2023-08-01T19:55:01.362 INFO:teuthology.orchestra.run.smithi008.stdout: "tid": 92843 2023-08-01T19:55:01.362 INFO:teuthology.orchestra.run.smithi008.stdout: }, 2023-08-01T19:55:01.362 INFO:teuthology.orchestra.run.smithi008.stdout: "events": [ 2023-08-01T19:55:01.362 INFO:teuthology.orchestra.run.smithi008.stdout: { 2023-08-01T19:55:01.362 INFO:teuthology.orchestra.run.smithi008.stdout: "event": "initiated", 2023-08-01T19:55:01.363 INFO:teuthology.orchestra.run.smithi008.stdout: "time": "2023-08-01T19:55:01.323191+0000", 2023-08-01T19:55:01.363 INFO:teuthology.orchestra.run.smithi008.stdout: "duration": 0 2023-08-01T19:55:01.363 INFO:teuthology.orchestra.run.smithi008.stdout: }, 2023-08-01T19:55:01.363 INFO:teuthology.orchestra.run.smithi008.stdout: { 2023-08-01T19:55:01.363 INFO:teuthology.orchestra.run.smithi008.stdout: "event": "throttled", 2023-08-01T19:55:01.363 INFO:teuthology.orchestra.run.smithi008.stdout: "time": "2023-08-01T19:55:01.323191+0000", 2023-08-01T19:55:01.363 INFO:teuthology.orchestra.run.smithi008.stdout: "duration": 0 2023-08-01T19:55:01.363 INFO:teuthology.orchestra.run.smithi008.stdout: }, 2023-08-01T19:55:01.364 INFO:teuthology.orchestra.run.smithi008.stdout: { 2023-08-01T19:55:01.364 INFO:teuthology.orchestra.run.smithi008.stdout: "event": "header_read", 2023-08-01T19:55:01.364 INFO:teuthology.orchestra.run.smithi008.stdout: "time": "2023-08-01T19:55:01.323190+0000", 2023-08-01T19:55:01.364 INFO:teuthology.orchestra.run.smithi008.stdout: "duration": 4294967295.9999995 2023-08-01T19:55:01.364 INFO:teuthology.orchestra.run.smithi008.stdout: }, 2023-08-01T19:55:01.364 INFO:teuthology.orchestra.run.smithi008.stdout: { 2023-08-01T19:55:01.364 INFO:teuthology.orchestra.run.smithi008.stdout: "event": "all_read", 2023-08-01T19:55:01.364 INFO:teuthology.orchestra.run.smithi008.stdout: "time": "2023-08-01T19:55:01.323217+0000", 2023-08-01T19:55:01.365 INFO:teuthology.orchestra.run.smithi008.stdout: "duration": 2.6497999999999999e-05 2023-08-01T19:55:01.365 INFO:teuthology.orchestra.run.smithi008.stdout: }, 2023-08-01T19:55:01.365 INFO:teuthology.orchestra.run.smithi008.stdout: { 2023-08-01T19:55:01.365 INFO:teuthology.orchestra.run.smithi008.stdout: "event": "dispatched", 2023-08-01T19:55:01.365 INFO:teuthology.orchestra.run.smithi008.stdout: "time": "2023-08-01T19:55:01.323227+0000", 2023-08-01T19:55:01.365 INFO:teuthology.orchestra.run.smithi008.stdout: "duration": 1.0380000000000001e-05 2023-08-01T19:55:01.365 INFO:teuthology.orchestra.run.smithi008.stdout: }, 2023-08-01T19:55:01.365 INFO:teuthology.orchestra.run.smithi008.stdout: { 2023-08-01T19:55:01.366 INFO:teuthology.orchestra.run.smithi008.stdout: "event": "queued_for_pg", 2023-08-01T19:55:01.366 INFO:teuthology.orchestra.run.smithi008.stdout: "time": "2023-08-01T19:55:01.323234+0000", 2023-08-01T19:55:01.366 INFO:teuthology.orchestra.run.smithi008.stdout: "duration": 6.2559999999999999e-06 2023-08-01T19:55:01.366 INFO:teuthology.orchestra.run.smithi008.stdout: }, 2023-08-01T19:55:01.366 INFO:teuthology.orchestra.run.smithi008.stdout: { 2023-08-01T19:55:01.366 INFO:teuthology.orchestra.run.smithi008.stdout: "event": "reached_pg", 2023-08-01T19:55:01.366 INFO:teuthology.orchestra.run.smithi008.stdout: "time": "2023-08-01T19:55:01.323281+0000", 2023-08-01T19:55:01.367 INFO:teuthology.orchestra.run.smithi008.stdout: "duration": 4.7333999999999998e-05 2023-08-01T19:55:01.367 INFO:teuthology.orchestra.run.smithi008.stdout: }, 2023-08-01T19:55:01.367 INFO:teuthology.orchestra.run.smithi008.stdout: { 2023-08-01T19:55:01.367 INFO:teuthology.orchestra.run.smithi008.stdout: "event": "started", 2023-08-01T19:55:01.367 INFO:teuthology.orchestra.run.smithi008.stdout: "time": "2023-08-01T19:55:01.323419+0000", 2023-08-01T19:55:01.367 INFO:teuthology.orchestra.run.smithi008.stdout: "duration": 0.00013777900000000001 2023-08-01T19:55:01.367 INFO:teuthology.orchestra.run.smithi008.stdout: }, 2023-08-01T19:55:01.367 INFO:teuthology.orchestra.run.smithi008.stdout: { 2023-08-01T19:55:01.368 INFO:teuthology.orchestra.run.smithi008.stdout: "event": "waiting for subops from 2", 2023-08-01T19:55:01.368 INFO:teuthology.orchestra.run.smithi008.stdout: "time": "2023-08-01T19:55:01.323569+0000", 2023-08-01T19:55:01.368 INFO:teuthology.orchestra.run.smithi008.stdout: "duration": 0.00015022899999999999 2023-08-01T19:55:01.368 INFO:teuthology.orchestra.run.smithi008.stdout: } 2023-08-01T19:55:01.368 INFO:teuthology.orchestra.run.smithi008.stdout: ] 2023-08-01T19:55:01.368 INFO:teuthology.orchestra.run.smithi008.stdout: } 2023-08-01T19:55:01.368 INFO:teuthology.orchestra.run.smithi008.stdout: }, 2023-08-01T19:55:01.368 INFO:teuthology.orchestra.run.smithi008.stdout: { 2023-08-01T19:55:01.369 INFO:teuthology.orchestra.run.smithi008.stdout: "description": "osd_repop(client.4668.0:92844 5.e e36/19 5:7b2bafac:::benchmark_data_smithi006_114134_object92843:head v 36'5809, mlcod=36'5807)", 2023-08-01T19:55:01.369 INFO:teuthology.orchestra.run.smithi008.stdout: "initiated_at": "2023-08-01T19:55:01.324439+0000", 2023-08-01T19:55:01.369 INFO:teuthology.orchestra.run.smithi008.stdout: "age": 0.0064553939999999997, 2023-08-01T19:55:01.369 INFO:teuthology.orchestra.run.smithi008.stdout: "duration": 0.0067522529999999997, 2023-08-01T19:55:01.369 INFO:teuthology.orchestra.run.smithi008.stdout: "type_data": { 2023-08-01T19:55:01.369 INFO:teuthology.orchestra.run.smithi008.stdout: "flag_point": "started", 2023-08-01T19:55:01.369 INFO:teuthology.orchestra.run.smithi008.stdout: "events": [ 2023-08-01T19:55:01.369 INFO:teuthology.orchestra.run.smithi008.stdout: { 2023-08-01T19:55:01.370 INFO:teuthology.orchestra.run.smithi008.stdout: "event": "initiated", 2023-08-01T19:55:01.370 INFO:teuthology.orchestra.run.smithi008.stdout: "time": "2023-08-01T19:55:01.324439+0000", 2023-08-01T19:55:01.370 INFO:teuthology.orchestra.run.smithi008.stdout: "duration": 0 2023-08-01T19:55:01.370 INFO:teuthology.orchestra.run.smithi008.stdout: }, 2023-08-01T19:55:01.370 INFO:teuthology.orchestra.run.smithi008.stdout: { 2023-08-01T19:55:01.370 INFO:teuthology.orchestra.run.smithi008.stdout: "event": "throttled", 2023-08-01T19:55:01.370 INFO:teuthology.orchestra.run.smithi008.stdout: "time": "2023-08-01T19:55:01.324439+0000", 2023-08-01T19:55:01.370 INFO:teuthology.orchestra.run.smithi008.stdout: "duration": 0 2023-08-01T19:55:01.371 INFO:teuthology.orchestra.run.smithi008.stdout: }, 2023-08-01T19:55:01.371 INFO:teuthology.orchestra.run.smithi008.stdout: { 2023-08-01T19:55:01.371 INFO:teuthology.orchestra.run.smithi008.stdout: "event": "header_read", 2023-08-01T19:55:01.371 INFO:teuthology.orchestra.run.smithi008.stdout: "time": "2023-08-01T19:55:01.324439+0000", 2023-08-01T19:55:01.371 INFO:teuthology.orchestra.run.smithi008.stdout: "duration": 4294967295.9999995 2023-08-01T19:55:01.371 INFO:teuthology.orchestra.run.smithi008.stdout: }, 2023-08-01T19:55:01.371 INFO:teuthology.orchestra.run.smithi008.stdout: { 2023-08-01T19:55:01.371 INFO:teuthology.orchestra.run.smithi008.stdout: "event": "all_read", 2023-08-01T19:55:01.372 INFO:teuthology.orchestra.run.smithi008.stdout: "time": "2023-08-01T19:55:01.324463+0000", 2023-08-01T19:55:01.372 INFO:teuthology.orchestra.run.smithi008.stdout: "duration": 2.4695999999999999e-05 2023-08-01T19:55:01.372 INFO:teuthology.orchestra.run.smithi008.stdout: }, 2023-08-01T19:55:01.372 INFO:teuthology.orchestra.run.smithi008.stdout: { 2023-08-01T19:55:01.372 INFO:teuthology.orchestra.run.smithi008.stdout: "event": "dispatched", 2023-08-01T19:55:01.372 INFO:teuthology.orchestra.run.smithi008.stdout: "time": "2023-08-01T19:55:01.324472+0000", 2023-08-01T19:55:01.372 INFO:teuthology.orchestra.run.smithi008.stdout: "duration": 8.4619999999999996e-06 2023-08-01T19:55:01.373 INFO:teuthology.orchestra.run.smithi008.stdout: }, 2023-08-01T19:55:01.373 INFO:teuthology.orchestra.run.smithi008.stdout: { 2023-08-01T19:55:01.373 INFO:teuthology.orchestra.run.smithi008.stdout: "event": "queued_for_pg", 2023-08-01T19:55:01.373 INFO:teuthology.orchestra.run.smithi008.stdout: "time": "2023-08-01T19:55:01.324477+0000", 2023-08-01T19:55:01.373 INFO:teuthology.orchestra.run.smithi008.stdout: "duration": 5.3489999999999999e-06 2023-08-01T19:55:01.373 INFO:teuthology.orchestra.run.smithi008.stdout: }, 2023-08-01T19:55:01.373 INFO:teuthology.orchestra.run.smithi008.stdout: { 2023-08-01T19:55:01.373 INFO:teuthology.orchestra.run.smithi008.stdout: "event": "reached_pg", 2023-08-01T19:55:01.374 INFO:teuthology.orchestra.run.smithi008.stdout: "time": "2023-08-01T19:55:01.324513+0000", 2023-08-01T19:55:01.374 INFO:teuthology.orchestra.run.smithi008.stdout: "duration": 3.6202000000000003e-05 2023-08-01T19:55:01.374 INFO:teuthology.orchestra.run.smithi008.stdout: }, 2023-08-01T19:55:01.374 INFO:teuthology.orchestra.run.smithi008.stdout: { 2023-08-01T19:55:01.374 INFO:teuthology.orchestra.run.smithi008.stdout: "event": "started", 2023-08-01T19:55:01.374 INFO:teuthology.orchestra.run.smithi008.stdout: "time": "2023-08-01T19:55:01.324531+0000", 2023-08-01T19:55:01.374 INFO:teuthology.orchestra.run.smithi008.stdout: "duration": 1.7816e-05 2023-08-01T19:55:01.374 INFO:teuthology.orchestra.run.smithi008.stdout: } 2023-08-01T19:55:01.375 INFO:teuthology.orchestra.run.smithi008.stdout: ] 2023-08-01T19:55:01.375 INFO:teuthology.orchestra.run.smithi008.stdout: } 2023-08-01T19:55:01.375 INFO:teuthology.orchestra.run.smithi008.stdout: }, 2023-08-01T19:55:01.375 INFO:teuthology.orchestra.run.smithi008.stdout: { 2023-08-01T19:55:01.375 INFO:teuthology.orchestra.run.smithi008.stdout: "description": "osd_repop(client.4668.0:92847 5.2 e36/19 5:40171d7a:::benchmark_data_smithi006_114134_object92846:head v 36'5974, mlcod=36'5972)", 2023-08-01T19:55:01.375 INFO:teuthology.orchestra.run.smithi008.stdout: "initiated_at": "2023-08-01T19:55:01.325298+0000", 2023-08-01T19:55:01.375 INFO:teuthology.orchestra.run.smithi008.stdout: "age": 0.0055968459999999999, 2023-08-01T19:55:01.375 INFO:teuthology.orchestra.run.smithi008.stdout: "duration": 0.0059290250000000001, 2023-08-01T19:55:01.376 INFO:teuthology.orchestra.run.smithi008.stdout: "type_data": { 2023-08-01T19:55:01.376 INFO:teuthology.orchestra.run.smithi008.stdout: "flag_point": "started", 2023-08-01T19:55:01.376 INFO:teuthology.orchestra.run.smithi008.stdout: "events": [ 2023-08-01T19:55:01.376 INFO:teuthology.orchestra.run.smithi008.stdout: { 2023-08-01T19:55:01.376 INFO:teuthology.orchestra.run.smithi008.stdout: "event": "initiated", 2023-08-01T19:55:01.376 INFO:teuthology.orchestra.run.smithi008.stdout: "time": "2023-08-01T19:55:01.325298+0000", 2023-08-01T19:55:01.376 INFO:teuthology.orchestra.run.smithi008.stdout: "duration": 0 2023-08-01T19:55:01.377 INFO:teuthology.orchestra.run.smithi008.stdout: }, 2023-08-01T19:55:01.377 INFO:teuthology.orchestra.run.smithi008.stdout: { 2023-08-01T19:55:01.377 INFO:teuthology.orchestra.run.smithi008.stdout: "event": "throttled", 2023-08-01T19:55:01.377 INFO:teuthology.orchestra.run.smithi008.stdout: "time": "2023-08-01T19:55:01.325298+0000", 2023-08-01T19:55:01.377 INFO:teuthology.orchestra.run.smithi008.stdout: "duration": 0 2023-08-01T19:55:01.377 INFO:teuthology.orchestra.run.smithi008.stdout: }, 2023-08-01T19:55:01.377 INFO:teuthology.orchestra.run.smithi008.stdout: { 2023-08-01T19:55:01.377 INFO:teuthology.orchestra.run.smithi008.stdout: "event": "header_read", 2023-08-01T19:55:01.378 INFO:teuthology.orchestra.run.smithi008.stdout: "time": "2023-08-01T19:55:01.325297+0000", 2023-08-01T19:55:01.378 INFO:teuthology.orchestra.run.smithi008.stdout: "duration": 4294967295.9999995 2023-08-01T19:55:01.378 INFO:teuthology.orchestra.run.smithi008.stdout: }, 2023-08-01T19:55:01.378 INFO:teuthology.orchestra.run.smithi008.stdout: { 2023-08-01T19:55:01.378 INFO:teuthology.orchestra.run.smithi008.stdout: "event": "all_read", 2023-08-01T19:55:01.378 INFO:teuthology.orchestra.run.smithi008.stdout: "time": "2023-08-01T19:55:01.325356+0000", 2023-08-01T19:55:01.378 INFO:teuthology.orchestra.run.smithi008.stdout: "duration": 5.8640000000000001e-05 2023-08-01T19:55:01.378 INFO:teuthology.orchestra.run.smithi008.stdout: }, 2023-08-01T19:55:01.379 INFO:teuthology.orchestra.run.smithi008.stdout: { 2023-08-01T19:55:01.379 INFO:teuthology.orchestra.run.smithi008.stdout: "event": "dispatched", 2023-08-01T19:55:01.379 INFO:teuthology.orchestra.run.smithi008.stdout: "time": "2023-08-01T19:55:01.325366+0000", 2023-08-01T19:55:01.379 INFO:teuthology.orchestra.run.smithi008.stdout: "duration": 1.0212e-05 2023-08-01T19:55:01.379 INFO:teuthology.orchestra.run.smithi008.stdout: }, 2023-08-01T19:55:01.379 INFO:teuthology.orchestra.run.smithi008.stdout: { 2023-08-01T19:55:01.379 INFO:teuthology.orchestra.run.smithi008.stdout: "event": "queued_for_pg", 2023-08-01T19:55:01.380 INFO:teuthology.orchestra.run.smithi008.stdout: "time": "2023-08-01T19:55:01.325371+0000", 2023-08-01T19:55:01.380 INFO:teuthology.orchestra.run.smithi008.stdout: "duration": 5.5899999999999998e-06 2023-08-01T19:55:01.380 INFO:teuthology.orchestra.run.smithi008.stdout: }, 2023-08-01T19:55:01.380 INFO:teuthology.orchestra.run.smithi008.stdout: { 2023-08-01T19:55:01.380 INFO:teuthology.orchestra.run.smithi008.stdout: "event": "reached_pg", 2023-08-01T19:55:01.380 INFO:teuthology.orchestra.run.smithi008.stdout: "time": "2023-08-01T19:55:01.325486+0000", 2023-08-01T19:55:01.380 INFO:teuthology.orchestra.run.smithi008.stdout: "duration": 0.00011434000000000001 2023-08-01T19:55:01.380 INFO:teuthology.orchestra.run.smithi008.stdout: }, 2023-08-01T19:55:01.381 INFO:teuthology.orchestra.run.smithi008.stdout: { 2023-08-01T19:55:01.381 INFO:teuthology.orchestra.run.smithi008.stdout: "event": "started", 2023-08-01T19:55:01.381 INFO:teuthology.orchestra.run.smithi008.stdout: "time": "2023-08-01T19:55:01.325508+0000", 2023-08-01T19:55:01.381 INFO:teuthology.orchestra.run.smithi008.stdout: "duration": 2.2073999999999999e-05 2023-08-01T19:55:01.381 INFO:teuthology.orchestra.run.smithi008.stdout: } 2023-08-01T19:55:01.381 INFO:teuthology.orchestra.run.smithi008.stdout: ] 2023-08-01T19:55:01.381 INFO:teuthology.orchestra.run.smithi008.stdout: } 2023-08-01T19:55:01.381 INFO:teuthology.orchestra.run.smithi008.stdout: }, 2023-08-01T19:55:01.382 INFO:teuthology.orchestra.run.smithi008.stdout: { 2023-08-01T19:55:01.382 INFO:teuthology.orchestra.run.smithi008.stdout: "description": "osd_op(client.4668.0:92846 5.3 5:c66edc69:::benchmark_data_smithi006_114134_object92845:head [set-alloc-hint object_size 65536 write_size 65536,write 0~65536 in=65536b] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e36)", 2023-08-01T19:55:01.382 INFO:teuthology.orchestra.run.smithi008.stdout: "initiated_at": "2023-08-01T19:55:01.324799+0000", 2023-08-01T19:55:01.382 INFO:teuthology.orchestra.run.smithi008.stdout: "age": 0.0060953800000000001, 2023-08-01T19:55:01.382 INFO:teuthology.orchestra.run.smithi008.stdout: "duration": 0.0064667780000000003, 2023-08-01T19:55:01.382 INFO:teuthology.orchestra.run.smithi008.stdout: "type_data": { 2023-08-01T19:55:01.382 INFO:teuthology.orchestra.run.smithi008.stdout: "flag_point": "waiting for sub ops", 2023-08-01T19:55:01.383 INFO:teuthology.orchestra.run.smithi008.stdout: "client_info": { 2023-08-01T19:55:01.383 INFO:teuthology.orchestra.run.smithi008.stdout: "client": "client.4668", 2023-08-01T19:55:01.383 INFO:teuthology.orchestra.run.smithi008.stdout: "client_addr": "172.21.15.6:0/1709472247", 2023-08-01T19:55:01.383 INFO:teuthology.orchestra.run.smithi008.stdout: "tid": 92846 2023-08-01T19:55:01.383 INFO:teuthology.orchestra.run.smithi008.stdout: }, 2023-08-01T19:55:01.383 INFO:teuthology.orchestra.run.smithi008.stdout: "events": [ 2023-08-01T19:55:01.383 INFO:teuthology.orchestra.run.smithi008.stdout: { 2023-08-01T19:55:01.383 INFO:teuthology.orchestra.run.smithi008.stdout: "event": "initiated", 2023-08-01T19:55:01.384 INFO:teuthology.orchestra.run.smithi008.stdout: "time": "2023-08-01T19:55:01.324799+0000", 2023-08-01T19:55:01.384 INFO:teuthology.orchestra.run.smithi008.stdout: "duration": 0 2023-08-01T19:55:01.384 INFO:teuthology.orchestra.run.smithi008.stdout: }, 2023-08-01T19:55:01.384 INFO:teuthology.orchestra.run.smithi008.stdout: { 2023-08-01T19:55:01.384 INFO:teuthology.orchestra.run.smithi008.stdout: "event": "throttled", 2023-08-01T19:55:01.384 INFO:teuthology.orchestra.run.smithi008.stdout: "time": "2023-08-01T19:55:01.324799+0000", 2023-08-01T19:55:01.384 INFO:teuthology.orchestra.run.smithi008.stdout: "duration": 0 2023-08-01T19:55:01.384 INFO:teuthology.orchestra.run.smithi008.stdout: }, 2023-08-01T19:55:01.385 INFO:teuthology.orchestra.run.smithi008.stdout: { 2023-08-01T19:55:01.385 INFO:teuthology.orchestra.run.smithi008.stdout: "event": "header_read", 2023-08-01T19:55:01.385 INFO:teuthology.orchestra.run.smithi008.stdout: "time": "2023-08-01T19:55:01.324798+0000", 2023-08-01T19:55:01.385 INFO:teuthology.orchestra.run.smithi008.stdout: "duration": 4294967295.999999 2023-08-01T19:55:01.385 INFO:teuthology.orchestra.run.smithi008.stdout: }, 2023-08-01T19:55:01.385 INFO:teuthology.orchestra.run.smithi008.stdout: { 2023-08-01T19:55:01.385 INFO:teuthology.orchestra.run.smithi008.stdout: "event": "all_read", 2023-08-01T19:55:01.386 INFO:teuthology.orchestra.run.smithi008.stdout: "time": "2023-08-01T19:55:01.326186+0000", 2023-08-01T19:55:01.386 INFO:teuthology.orchestra.run.smithi008.stdout: "duration": 0.0013879980000000001 2023-08-01T19:55:01.386 INFO:teuthology.orchestra.run.smithi008.stdout: }, 2023-08-01T19:55:01.386 INFO:teuthology.orchestra.run.smithi008.stdout: { 2023-08-01T19:55:01.386 INFO:teuthology.orchestra.run.smithi008.stdout: "event": "dispatched", 2023-08-01T19:55:01.386 INFO:teuthology.orchestra.run.smithi008.stdout: "time": "2023-08-01T19:55:01.326201+0000", 2023-08-01T19:55:01.386 INFO:teuthology.orchestra.run.smithi008.stdout: "duration": 1.5058000000000001e-05 2023-08-01T19:55:01.386 INFO:teuthology.orchestra.run.smithi008.stdout: }, 2023-08-01T19:55:01.387 INFO:teuthology.orchestra.run.smithi008.stdout: { 2023-08-01T19:55:01.387 INFO:teuthology.orchestra.run.smithi008.stdout: "event": "queued_for_pg", 2023-08-01T19:55:01.387 INFO:teuthology.orchestra.run.smithi008.stdout: "time": "2023-08-01T19:55:01.326209+0000", 2023-08-01T19:55:01.387 INFO:teuthology.orchestra.run.smithi008.stdout: "duration": 7.4800000000000004e-06 2023-08-01T19:55:01.387 INFO:teuthology.orchestra.run.smithi008.stdout: }, 2023-08-01T19:55:01.387 INFO:teuthology.orchestra.run.smithi008.stdout: { 2023-08-01T19:55:01.387 INFO:teuthology.orchestra.run.smithi008.stdout: "event": "reached_pg", 2023-08-01T19:55:01.387 INFO:teuthology.orchestra.run.smithi008.stdout: "time": "2023-08-01T19:55:01.326245+0000", 2023-08-01T19:55:01.388 INFO:teuthology.orchestra.run.smithi008.stdout: "duration": 3.5997000000000001e-05 2023-08-01T19:55:01.388 INFO:teuthology.orchestra.run.smithi008.stdout: }, 2023-08-01T19:55:01.388 INFO:teuthology.orchestra.run.smithi008.stdout: { 2023-08-01T19:55:01.388 INFO:teuthology.orchestra.run.smithi008.stdout: "event": "started", 2023-08-01T19:55:01.388 INFO:teuthology.orchestra.run.smithi008.stdout: "time": "2023-08-01T19:55:01.326389+0000", 2023-08-01T19:55:01.388 INFO:teuthology.orchestra.run.smithi008.stdout: "duration": 0.00014477500000000001 2023-08-01T19:55:01.388 INFO:teuthology.orchestra.run.smithi008.stdout: }, 2023-08-01T19:55:01.388 INFO:teuthology.orchestra.run.smithi008.stdout: { 2023-08-01T19:55:01.389 INFO:teuthology.orchestra.run.smithi008.stdout: "event": "waiting for subops from 1", 2023-08-01T19:55:01.389 INFO:teuthology.orchestra.run.smithi008.stdout: "time": "2023-08-01T19:55:01.326503+0000", 2023-08-01T19:55:01.389 INFO:teuthology.orchestra.run.smithi008.stdout: "duration": 0.00011362399999999999 2023-08-01T19:55:01.389 INFO:teuthology.orchestra.run.smithi008.stdout: } 2023-08-01T19:55:01.389 INFO:teuthology.orchestra.run.smithi008.stdout: ] 2023-08-01T19:55:01.389 INFO:teuthology.orchestra.run.smithi008.stdout: } 2023-08-01T19:55:01.389 INFO:teuthology.orchestra.run.smithi008.stdout: }, 2023-08-01T19:55:01.390 INFO:teuthology.orchestra.run.smithi008.stdout: { 2023-08-01T19:55:01.390 INFO:teuthology.orchestra.run.smithi008.stdout: "description": "osd_op(client.4668.0:92849 5.6 5:6e564a67:::benchmark_data_smithi006_114134_object92848:head [set-alloc-hint object_size 65536 write_size 65536,write 0~65536 in=65536b] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e36)", 2023-08-01T19:55:01.390 INFO:teuthology.orchestra.run.smithi008.stdout: "initiated_at": "2023-08-01T19:55:01.326233+0000", 2023-08-01T19:55:01.390 INFO:teuthology.orchestra.run.smithi008.stdout: "age": 0.0046619410000000002, 2023-08-01T19:55:01.390 INFO:teuthology.orchestra.run.smithi008.stdout: "duration": 0.0050784949999999997, 2023-08-01T19:55:01.390 INFO:teuthology.orchestra.run.smithi008.stdout: "type_data": { 2023-08-01T19:55:01.390 INFO:teuthology.orchestra.run.smithi008.stdout: "flag_point": "waiting for sub ops", 2023-08-01T19:55:01.390 INFO:teuthology.orchestra.run.smithi008.stdout: "client_info": { 2023-08-01T19:55:01.391 INFO:teuthology.orchestra.run.smithi008.stdout: "client": "client.4668", 2023-08-01T19:55:01.391 INFO:teuthology.orchestra.run.smithi008.stdout: "client_addr": "172.21.15.6:0/1709472247", 2023-08-01T19:55:01.391 INFO:teuthology.orchestra.run.smithi008.stdout: "tid": 92849 2023-08-01T19:55:01.391 INFO:teuthology.orchestra.run.smithi008.stdout: }, 2023-08-01T19:55:01.391 INFO:teuthology.orchestra.run.smithi008.stdout: "events": [ 2023-08-01T19:55:01.391 INFO:teuthology.orchestra.run.smithi008.stdout: { 2023-08-01T19:55:01.391 INFO:teuthology.orchestra.run.smithi008.stdout: "event": "initiated", 2023-08-01T19:55:01.392 INFO:teuthology.orchestra.run.smithi008.stdout: "time": "2023-08-01T19:55:01.326233+0000", 2023-08-01T19:55:01.392 INFO:teuthology.orchestra.run.smithi008.stdout: "duration": 0 2023-08-01T19:55:01.392 INFO:teuthology.orchestra.run.smithi008.stdout: }, 2023-08-01T19:55:01.392 INFO:teuthology.orchestra.run.smithi008.stdout: { 2023-08-01T19:55:01.392 INFO:teuthology.orchestra.run.smithi008.stdout: "event": "throttled", 2023-08-01T19:55:01.392 INFO:teuthology.orchestra.run.smithi008.stdout: "time": "2023-08-01T19:55:01.326233+0000", 2023-08-01T19:55:01.392 INFO:teuthology.orchestra.run.smithi008.stdout: "duration": 0 2023-08-01T19:55:01.393 INFO:teuthology.orchestra.run.smithi008.stdout: }, 2023-08-01T19:55:01.393 INFO:teuthology.orchestra.run.smithi008.stdout: { 2023-08-01T19:55:01.393 INFO:teuthology.orchestra.run.smithi008.stdout: "event": "header_read", 2023-08-01T19:55:01.393 INFO:teuthology.orchestra.run.smithi008.stdout: "time": "2023-08-01T19:55:01.326231+0000", 2023-08-01T19:55:01.393 INFO:teuthology.orchestra.run.smithi008.stdout: "duration": 4294967295.999999 2023-08-01T19:55:01.393 INFO:teuthology.orchestra.run.smithi008.stdout: }, 2023-08-01T19:55:01.393 INFO:teuthology.orchestra.run.smithi008.stdout: { 2023-08-01T19:55:01.393 INFO:teuthology.orchestra.run.smithi008.stdout: "event": "all_read", 2023-08-01T19:55:01.394 INFO:teuthology.orchestra.run.smithi008.stdout: "time": "2023-08-01T19:55:01.326262+0000", 2023-08-01T19:55:01.394 INFO:teuthology.orchestra.run.smithi008.stdout: "duration": 3.0524000000000001e-05 2023-08-01T19:55:01.394 INFO:teuthology.orchestra.run.smithi008.stdout: }, 2023-08-01T19:55:01.394 INFO:teuthology.orchestra.run.smithi008.stdout: { 2023-08-01T19:55:01.394 INFO:teuthology.orchestra.run.smithi008.stdout: "event": "dispatched", 2023-08-01T19:55:01.394 INFO:teuthology.orchestra.run.smithi008.stdout: "time": "2023-08-01T19:55:01.326273+0000", 2023-08-01T19:55:01.394 INFO:teuthology.orchestra.run.smithi008.stdout: "duration": 1.0508e-05 2023-08-01T19:55:01.394 INFO:teuthology.orchestra.run.smithi008.stdout: }, 2023-08-01T19:55:01.395 INFO:teuthology.orchestra.run.smithi008.stdout: { 2023-08-01T19:55:01.395 INFO:teuthology.orchestra.run.smithi008.stdout: "event": "queued_for_pg", 2023-08-01T19:55:01.395 INFO:teuthology.orchestra.run.smithi008.stdout: "time": "2023-08-01T19:55:01.326278+0000", 2023-08-01T19:55:01.395 INFO:teuthology.orchestra.run.smithi008.stdout: "duration": 5.9120000000000003e-06 2023-08-01T19:55:01.395 INFO:teuthology.orchestra.run.smithi008.stdout: }, 2023-08-01T19:55:01.395 INFO:teuthology.orchestra.run.smithi008.stdout: { 2023-08-01T19:55:01.395 INFO:teuthology.orchestra.run.smithi008.stdout: "event": "reached_pg", 2023-08-01T19:55:01.395 INFO:teuthology.orchestra.run.smithi008.stdout: "time": "2023-08-01T19:55:01.326390+0000", 2023-08-01T19:55:01.396 INFO:teuthology.orchestra.run.smithi008.stdout: "duration": 0.000111994 2023-08-01T19:55:01.396 INFO:teuthology.orchestra.run.smithi008.stdout: }, 2023-08-01T19:55:01.396 INFO:teuthology.orchestra.run.smithi008.stdout: { 2023-08-01T19:55:01.396 INFO:teuthology.orchestra.run.smithi008.stdout: "event": "started", 2023-08-01T19:55:01.396 INFO:teuthology.orchestra.run.smithi008.stdout: "time": "2023-08-01T19:55:01.326517+0000", 2023-08-01T19:55:01.396 INFO:teuthology.orchestra.run.smithi008.stdout: "duration": 0.00012670300000000001 2023-08-01T19:55:01.396 INFO:teuthology.orchestra.run.smithi008.stdout: }, 2023-08-01T19:55:01.396 INFO:teuthology.orchestra.run.smithi008.stdout: { 2023-08-01T19:55:01.397 INFO:teuthology.orchestra.run.smithi008.stdout: "event": "waiting for subops from 1", 2023-08-01T19:55:01.397 INFO:teuthology.orchestra.run.smithi008.stdout: "time": "2023-08-01T19:55:01.326653+0000", 2023-08-01T19:55:01.397 INFO:teuthology.orchestra.run.smithi008.stdout: "duration": 0.000135425 2023-08-01T19:55:01.397 INFO:teuthology.orchestra.run.smithi008.stdout: } 2023-08-01T19:55:01.397 INFO:teuthology.orchestra.run.smithi008.stdout: ] 2023-08-01T19:55:01.397 INFO:teuthology.orchestra.run.smithi008.stdout: } 2023-08-01T19:55:01.397 INFO:teuthology.orchestra.run.smithi008.stdout: }, 2023-08-01T19:55:01.397 INFO:teuthology.orchestra.run.smithi008.stdout: { 2023-08-01T19:55:01.398 INFO:teuthology.orchestra.run.smithi008.stdout: "description": "osd_op(client.4668.0:92850 5.a 5:5ace6008:::benchmark_data_smithi006_114134_object92849:head [set-alloc-hint object_size 65536 write_size 65536,write 0~65536 in=65536b] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e36)", 2023-08-01T19:55:01.398 INFO:teuthology.orchestra.run.smithi008.stdout: "initiated_at": "2023-08-01T19:55:01.326288+0000", 2023-08-01T19:55:01.398 INFO:teuthology.orchestra.run.smithi008.stdout: "age": 0.0046062430000000003, 2023-08-01T19:55:01.398 INFO:teuthology.orchestra.run.smithi008.stdout: "duration": 0.0050758610000000001, 2023-08-01T19:55:01.398 INFO:teuthology.orchestra.run.smithi008.stdout: "type_data": { 2023-08-01T19:55:01.398 INFO:teuthology.orchestra.run.smithi008.stdout: "flag_point": "waiting for sub ops", 2023-08-01T19:55:01.398 INFO:teuthology.orchestra.run.smithi008.stdout: "client_info": { 2023-08-01T19:55:01.399 INFO:teuthology.orchestra.run.smithi008.stdout: "client": "client.4668", 2023-08-01T19:55:01.399 INFO:teuthology.orchestra.run.smithi008.stdout: "client_addr": "172.21.15.6:0/1709472247", 2023-08-01T19:55:01.399 INFO:teuthology.orchestra.run.smithi008.stdout: "tid": 92850 2023-08-01T19:55:01.399 INFO:teuthology.orchestra.run.smithi008.stdout: }, 2023-08-01T19:55:01.399 INFO:teuthology.orchestra.run.smithi008.stdout: "events": [ 2023-08-01T19:55:01.399 INFO:teuthology.orchestra.run.smithi008.stdout: { 2023-08-01T19:55:01.399 INFO:teuthology.orchestra.run.smithi008.stdout: "event": "initiated", 2023-08-01T19:55:01.399 INFO:teuthology.orchestra.run.smithi008.stdout: "time": "2023-08-01T19:55:01.326288+0000", 2023-08-01T19:55:01.400 INFO:teuthology.orchestra.run.smithi008.stdout: "duration": 0 2023-08-01T19:55:01.400 INFO:teuthology.orchestra.run.smithi008.stdout: }, 2023-08-01T19:55:01.400 INFO:teuthology.orchestra.run.smithi008.stdout: { 2023-08-01T19:55:01.400 INFO:teuthology.orchestra.run.smithi008.stdout: "event": "throttled", 2023-08-01T19:55:01.400 INFO:teuthology.orchestra.run.smithi008.stdout: "time": "2023-08-01T19:55:01.326288+0000", 2023-08-01T19:55:01.400 INFO:teuthology.orchestra.run.smithi008.stdout: "duration": 0 2023-08-01T19:55:01.400 INFO:teuthology.orchestra.run.smithi008.stdout: }, 2023-08-01T19:55:01.400 INFO:teuthology.orchestra.run.smithi008.stdout: { 2023-08-01T19:55:01.401 INFO:teuthology.orchestra.run.smithi008.stdout: "event": "header_read", 2023-08-01T19:55:01.401 INFO:teuthology.orchestra.run.smithi008.stdout: "time": "2023-08-01T19:55:01.326288+0000", 2023-08-01T19:55:01.401 INFO:teuthology.orchestra.run.smithi008.stdout: "duration": 4294967295.9999995 2023-08-01T19:55:01.401 INFO:teuthology.orchestra.run.smithi008.stdout: }, 2023-08-01T19:55:01.401 INFO:teuthology.orchestra.run.smithi008.stdout: { 2023-08-01T19:55:01.401 INFO:teuthology.orchestra.run.smithi008.stdout: "event": "all_read", 2023-08-01T19:55:01.401 INFO:teuthology.orchestra.run.smithi008.stdout: "time": "2023-08-01T19:55:01.326314+0000", 2023-08-01T19:55:01.401 INFO:teuthology.orchestra.run.smithi008.stdout: "duration": 2.5885999999999999e-05 2023-08-01T19:55:01.402 INFO:teuthology.orchestra.run.smithi008.stdout: }, 2023-08-01T19:55:01.402 INFO:teuthology.orchestra.run.smithi008.stdout: { 2023-08-01T19:55:01.402 INFO:teuthology.orchestra.run.smithi008.stdout: "event": "dispatched", 2023-08-01T19:55:01.402 INFO:teuthology.orchestra.run.smithi008.stdout: "time": "2023-08-01T19:55:01.326321+0000", 2023-08-01T19:55:01.402 INFO:teuthology.orchestra.run.smithi008.stdout: "duration": 7.7130000000000005e-06 2023-08-01T19:55:01.402 INFO:teuthology.orchestra.run.smithi008.stdout: }, 2023-08-01T19:55:01.402 INFO:teuthology.orchestra.run.smithi008.stdout: { 2023-08-01T19:55:01.402 INFO:teuthology.orchestra.run.smithi008.stdout: "event": "queued_for_pg", 2023-08-01T19:55:01.403 INFO:teuthology.orchestra.run.smithi008.stdout: "time": "2023-08-01T19:55:01.326326+0000", 2023-08-01T19:55:01.403 INFO:teuthology.orchestra.run.smithi008.stdout: "duration": 4.7829999999999998e-06 2023-08-01T19:55:01.403 INFO:teuthology.orchestra.run.smithi008.stdout: }, 2023-08-01T19:55:01.403 INFO:teuthology.orchestra.run.smithi008.stdout: { 2023-08-01T19:55:01.403 INFO:teuthology.orchestra.run.smithi008.stdout: "event": "reached_pg", 2023-08-01T19:55:01.403 INFO:teuthology.orchestra.run.smithi008.stdout: "time": "2023-08-01T19:55:01.326385+0000", 2023-08-01T19:55:01.403 INFO:teuthology.orchestra.run.smithi008.stdout: "duration": 5.9212999999999997e-05 2023-08-01T19:55:01.403 INFO:teuthology.orchestra.run.smithi008.stdout: }, 2023-08-01T19:55:01.404 INFO:teuthology.orchestra.run.smithi008.stdout: { 2023-08-01T19:55:01.404 INFO:teuthology.orchestra.run.smithi008.stdout: "event": "started", 2023-08-01T19:55:01.404 INFO:teuthology.orchestra.run.smithi008.stdout: "time": "2023-08-01T19:55:01.326491+0000", 2023-08-01T19:55:01.404 INFO:teuthology.orchestra.run.smithi008.stdout: "duration": 0.000105238 2023-08-01T19:55:01.404 INFO:teuthology.orchestra.run.smithi008.stdout: }, 2023-08-01T19:55:01.404 INFO:teuthology.orchestra.run.smithi008.stdout: { 2023-08-01T19:55:01.404 INFO:teuthology.orchestra.run.smithi008.stdout: "event": "waiting for subops from 2", 2023-08-01T19:55:01.404 INFO:teuthology.orchestra.run.smithi008.stdout: "time": "2023-08-01T19:55:01.326593+0000", 2023-08-01T19:55:01.405 INFO:teuthology.orchestra.run.smithi008.stdout: "duration": 0.00010282500000000001 2023-08-01T19:55:01.405 INFO:teuthology.orchestra.run.smithi008.stdout: } 2023-08-01T19:55:01.405 INFO:teuthology.orchestra.run.smithi008.stdout: ] 2023-08-01T19:55:01.405 INFO:teuthology.orchestra.run.smithi008.stdout: } 2023-08-01T19:55:01.405 INFO:teuthology.orchestra.run.smithi008.stdout: } 2023-08-01T19:55:01.405 INFO:teuthology.orchestra.run.smithi008.stdout: ], 2023-08-01T19:55:01.405 INFO:teuthology.orchestra.run.smithi008.stdout: "num_ops": 10 2023-08-01T19:55:01.405 INFO:teuthology.orchestra.run.smithi008.stdout:} 2023-08-01T19:55:01.407 INFO:tasks.ceph.osd.2.smithi155.stderr:2023-08-01T19:55:01.405+0000 7faa5c6ac700 -1 received signal: Hangup from /usr/bin/python3 /bin/daemon-helper kill ceph-osd -f --cluster ceph -i 2 (PID: 111337) UID: 0 2023-08-01T19:55:01.407 INFO:teuthology.orchestra.run.smithi006.stdout:osd.0: {} 2023-08-01T19:55:01.407 INFO:teuthology.orchestra.run.smithi006.stdout:osd.1: {} 2023-08-01T19:55:01.407 INFO:teuthology.orchestra.run.smithi006.stdout:osd.2: {} 2023-08-01T19:55:01.408 DEBUG:teuthology.orchestra.run.smithi008:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 30 ceph --cluster ceph --admin-daemon /var/run/ceph/ceph-osd.0.asok dump_blocked_ops 2023-08-01T19:55:01.409 INFO:teuthology.orchestra.run.smithi006.stderr:osd.0: osd_enable_op_tracker = 'false' 2023-08-01T19:55:01.409 INFO:teuthology.orchestra.run.smithi006.stderr:osd.1: osd_enable_op_tracker = 'false' 2023-08-01T19:55:01.409 INFO:teuthology.orchestra.run.smithi006.stderr:osd.2: osd_enable_op_tracker = 'false' 2023-08-01T19:55:01.508 INFO:tasks.ceph.osd.1.smithi101.stderr:2023-08-01T19:55:01.506+0000 7fb0cb7f6700 -1 received signal: Hangup from /usr/bin/python3 /bin/daemon-helper kill ceph-osd -f --cluster ceph -i 1 (PID: 111141) UID: 0 2023-08-01T19:55:01.591 INFO:teuthology.orchestra.run.smithi008.stdout:ERROR: (22) Invalid argument 2023-08-01T19:55:01.591 INFO:teuthology.orchestra.run.smithi008.stdout:op_tracker tracking is not enabled now, so no ops are tracked currently, even those get stuck. Please enable "osd_enable_op_tracker", and the tracker will start to track new ops received afterwards. 2023-08-01T19:55:01.606 DEBUG:teuthology.orchestra.run.smithi008:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 30 ceph --cluster ceph --admin-daemon /var/run/ceph/ceph-osd.0.asok dump_historic_ops 2023-08-01T19:55:01.608 INFO:tasks.ceph.osd.2.smithi155.stderr:2023-08-01T19:55:01.607+0000 7faa5c6ac700 -1 received signal: Hangup from /usr/bin/python3 /bin/daemon-helper kill ceph-osd -f --cluster ceph -i 2 (PID: 111337) UID: 0 2023-08-01T19:55:01.709 INFO:tasks.ceph.osd.0.smithi008.stderr:2023-08-01T19:55:01.708+0000 7f16a58f4700 -1 received signal: Hangup from /usr/bin/python3 /bin/daemon-helper kill ceph-osd -f --cluster ceph -i 0 (PID: 111179) UID: 0 2023-08-01T19:55:01.797 INFO:teuthology.orchestra.run.smithi008.stdout:ERROR: (22) Invalid argument 2023-08-01T19:55:01.797 INFO:teuthology.orchestra.run.smithi008.stdout:op_tracker tracking is not enabled now, so no ops are tracked currently, even those get stuck. Please enable "osd_enable_op_tracker", and the tracker will start to track new ops received afterwards. 2023-08-01T19:55:01.810 INFO:tasks.ceph.osd.1.smithi101.stderr:2023-08-01T19:55:01.809+0000 7fb0cb7f6700 -1 received signal: Hangup from /usr/bin/python3 /bin/daemon-helper kill ceph-osd -f --cluster ceph -i 1 (PID: 111141) UID: 0 2023-08-01T19:55:01.813 DEBUG:teuthology.orchestra.run.smithi101:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 30 ceph --cluster ceph --admin-daemon /var/run/ceph/ceph-osd.1.asok dump_ops_in_flight 2023-08-01T19:55:01.911 INFO:tasks.ceph.osd.1.smithi101.stderr:2023-08-01T19:55:01.910+0000 7fb0cb7f6700 -1 received signal: Hangup from /usr/bin/python3 /bin/daemon-helper kill ceph-osd -f --cluster ceph -i 1 (PID: 111141) UID: 0 2023-08-01T19:55:01.989 INFO:teuthology.orchestra.run.smithi101.stdout:ERROR: (22) Invalid argument 2023-08-01T19:55:01.989 INFO:teuthology.orchestra.run.smithi101.stdout:op_tracker tracking is not enabled now, so no ops are tracked currently, even those get stuck. Please enable "osd_enable_op_tracker", and the tracker will start to track new ops received afterwards. 2023-08-01T19:55:02.003 DEBUG:teuthology.orchestra.run.smithi101:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 30 ceph --cluster ceph --admin-daemon /var/run/ceph/ceph-osd.1.asok dump_blocked_ops 2023-08-01T19:55:02.014 INFO:tasks.ceph.osd.0.smithi008.stderr:2023-08-01T19:55:02.013+0000 7f16a58f4700 -1 received signal: Hangup from /usr/bin/python3 /bin/daemon-helper kill ceph-osd -f --cluster ceph -i 0 (PID: 111179) UID: 0 2023-08-01T19:55:02.114 INFO:tasks.ceph.osd.0.smithi008.stderr:2023-08-01T19:55:02.114+0000 7f16a58f4700 -1 received signal: Hangup from /usr/bin/python3 /bin/daemon-helper kill ceph-osd -f --cluster ceph -i 0 (PID: 111179) UID: 0 2023-08-01T19:55:02.213 INFO:teuthology.orchestra.run.smithi101.stdout:ERROR: (22) Invalid argument 2023-08-01T19:55:02.213 INFO:teuthology.orchestra.run.smithi101.stdout:op_tracker tracking is not enabled now, so no ops are tracked currently, even those get stuck. Please enable "osd_enable_op_tracker", and the tracker will start to track new ops received afterwards. 2023-08-01T19:55:02.215 INFO:tasks.ceph.osd.2.smithi155.stderr:2023-08-01T19:55:02.213+0000 7faa5c6ac700 -1 received signal: Hangup from /usr/bin/python3 /bin/daemon-helper kill ceph-osd -f --cluster ceph -i 2 (PID: 111337) UID: 0 2023-08-01T19:55:02.228 DEBUG:teuthology.orchestra.run.smithi101:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 30 ceph --cluster ceph --admin-daemon /var/run/ceph/ceph-osd.1.asok dump_historic_ops 2023-08-01T19:55:02.315 INFO:tasks.radosbench.radosbench.0.smithi006.stdout: 38 16 94735 94719 155.775 119.125 0.00778114 0.00641677 2023-08-01T19:55:02.316 INFO:tasks.ceph.osd.2.smithi155.stderr:2023-08-01T19:55:02.314+0000 7faa5c6ac700 -1 received signal: Hangup from /usr/bin/python3 /bin/daemon-helper kill ceph-osd -f --cluster ceph -i 2 (PID: 111337) UID: 0 2023-08-01T19:55:02.394 INFO:teuthology.orchestra.run.smithi101.stdout:ERROR: (22) Invalid argument 2023-08-01T19:55:02.394 INFO:teuthology.orchestra.run.smithi101.stdout:op_tracker tracking is not enabled now, so no ops are tracked currently, even those get stuck. Please enable "osd_enable_op_tracker", and the tracker will start to track new ops received afterwards. 2023-08-01T19:55:02.408 DEBUG:teuthology.orchestra.run.smithi155:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 30 ceph --cluster ceph --admin-daemon /var/run/ceph/ceph-osd.2.asok dump_ops_in_flight 2023-08-01T19:55:02.451 INFO:tasks.ceph.osd.2.smithi155.stderr:2023-08-01T19:55:02.450+0000 7faa5c6ac700 -1 received signal: Hangup from /usr/bin/python3 /bin/daemon-helper kill ceph-osd -f --cluster ceph -i 2 (PID: 111337) UID: 0 2023-08-01T19:55:02.517 INFO:tasks.ceph.osd.1.smithi101.stderr:2023-08-01T19:55:02.515+0000 7fb0cb7f6700 -1 received signal: Hangup from /usr/bin/python3 /bin/daemon-helper kill ceph-osd -f --cluster ceph -i 1 (PID: 111141) UID: 0 2023-08-01T19:55:02.583 INFO:teuthology.orchestra.run.smithi155.stdout:ERROR: (22) Invalid argument 2023-08-01T19:55:02.583 INFO:teuthology.orchestra.run.smithi155.stdout:op_tracker tracking is not enabled now, so no ops are tracked currently, even those get stuck. Please enable "osd_enable_op_tracker", and the tracker will start to track new ops received afterwards. 2023-08-01T19:55:02.598 DEBUG:teuthology.orchestra.run.smithi155:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 30 ceph --cluster ceph --admin-daemon /var/run/ceph/ceph-osd.2.asok dump_blocked_ops 2023-08-01T19:55:02.638 INFO:tasks.ceph.osd.2.smithi155.stderr:2023-08-01T19:55:02.637+0000 7faa5c6ac700 -1 received signal: Hangup from /usr/bin/python3 /bin/daemon-helper kill ceph-osd -f --cluster ceph -i 2 (PID: 111337) UID: 0 2023-08-01T19:55:02.717 INFO:tasks.ceph.osd.1.smithi101.stderr:2023-08-01T19:55:02.716+0000 7fb0cb7f6700 -1 received signal: Hangup from /usr/bin/python3 /bin/daemon-helper kill ceph-osd -f --cluster ceph -i 1 (PID: 111141) UID: 0 2023-08-01T19:55:02.801 INFO:teuthology.orchestra.run.smithi155.stdout:ERROR: (22) Invalid argument 2023-08-01T19:55:02.802 INFO:teuthology.orchestra.run.smithi155.stdout:op_tracker tracking is not enabled now, so no ops are tracked currently, even those get stuck. Please enable "osd_enable_op_tracker", and the tracker will start to track new ops received afterwards. 2023-08-01T19:55:02.815 DEBUG:teuthology.orchestra.run.smithi155:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 30 ceph --cluster ceph --admin-daemon /var/run/ceph/ceph-osd.2.asok dump_historic_ops 2023-08-01T19:55:02.819 INFO:tasks.ceph.osd.0.smithi008.stderr:2023-08-01T19:55:02.819+0000 7f16a58f4700 -1 received signal: Hangup from /usr/bin/python3 /bin/daemon-helper kill ceph-osd -f --cluster ceph -i 0 (PID: 111179) UID: 0 2023-08-01T19:55:02.920 INFO:tasks.ceph.osd.2.smithi155.stderr:2023-08-01T19:55:02.918+0000 7faa5c6ac700 -1 received signal: Hangup from /usr/bin/python3 /bin/daemon-helper kill ceph-osd -f --cluster ceph -i 2 (PID: 111337) UID: 0 2023-08-01T19:55:02.986 INFO:teuthology.orchestra.run.smithi155.stdout:ERROR: (22) Invalid argument 2023-08-01T19:55:02.986 INFO:teuthology.orchestra.run.smithi155.stdout:op_tracker tracking is not enabled now, so no ops are tracked currently, even those get stuck. Please enable "osd_enable_op_tracker", and the tracker will start to track new ops received afterwards. 2023-08-01T19:55:03.000 DEBUG:teuthology.orchestra.run.smithi008:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 30 ceph --cluster ceph --admin-daemon /var/run/ceph/ceph-osd.0.asok dump_ops_in_flight 2023-08-01T19:55:03.041 INFO:tasks.ceph.osd.2.smithi155.stderr:2023-08-01T19:55:03.040+0000 7faa5c6ac700 -1 received signal: Hangup from /usr/bin/python3 /bin/daemon-helper kill ceph-osd -f --cluster ceph -i 2 (PID: 111337) UID: 0 2023-08-01T19:55:03.121 INFO:tasks.ceph.osd.0.smithi008.stderr:2023-08-01T19:55:03.120+0000 7f16a58f4700 -1 received signal: Hangup from /usr/bin/python3 /bin/daemon-helper kill ceph-osd -f --cluster ceph -i 0 (PID: 111179) UID: 0 2023-08-01T19:55:03.146 DEBUG:teuthology.orchestra.run.smithi006:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 120 ceph --cluster ceph osd unset noscrub 2023-08-01T19:55:03.196 INFO:teuthology.orchestra.run.smithi008.stdout:ERROR: (22) Invalid argument 2023-08-01T19:55:03.196 INFO:teuthology.orchestra.run.smithi008.stdout:op_tracker tracking is not enabled now, so no ops are tracked currently, even those get stuck. Please enable "osd_enable_op_tracker", and the tracker will start to track new ops received afterwards. 2023-08-01T19:55:03.215 DEBUG:teuthology.orchestra.run.smithi008:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 30 ceph --cluster ceph --admin-daemon /var/run/ceph/ceph-osd.0.asok dump_blocked_ops 2023-08-01T19:55:03.222 INFO:tasks.ceph.osd.2.smithi155.stderr:2023-08-01T19:55:03.220+0000 7faa5c6ac700 -1 received signal: Hangup from /usr/bin/python3 /bin/daemon-helper kill ceph-osd -f --cluster ceph -i 2 (PID: 111337) UID: 0 2023-08-01T19:55:03.315 INFO:tasks.radosbench.radosbench.0.smithi006.stdout: 39 16 96677 96661 154.893 121.375 0.0113203 0.00645291 2023-08-01T19:55:03.323 INFO:tasks.ceph.osd.2.smithi155.stderr:2023-08-01T19:55:03.322+0000 7faa5c6ac700 -1 received signal: Hangup from /usr/bin/python3 /bin/daemon-helper kill ceph-osd -f --cluster ceph -i 2 (PID: 111337) UID: 0 2023-08-01T19:55:03.410 DEBUG:teuthology.orchestra.run.smithi006:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 120 ceph --cluster ceph -- tell 'osd.*' injectargs --osd_enable_op_tracker=true 2023-08-01T19:55:03.424 INFO:tasks.ceph.osd.0.smithi008.stderr:2023-08-01T19:55:03.424+0000 7f16a58f4700 -1 received signal: Hangup from /usr/bin/python3 /bin/daemon-helper kill ceph-osd -f --cluster ceph -i 0 (PID: 111179) UID: 0 2023-08-01T19:55:03.438 INFO:teuthology.orchestra.run.smithi008.stdout:ERROR: (22) Invalid argument 2023-08-01T19:55:03.438 INFO:teuthology.orchestra.run.smithi008.stdout:op_tracker tracking is not enabled now, so no ops are tracked currently, even those get stuck. Please enable "osd_enable_op_tracker", and the tracker will start to track new ops received afterwards. 2023-08-01T19:55:03.454 DEBUG:teuthology.orchestra.run.smithi008:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 30 ceph --cluster ceph --admin-daemon /var/run/ceph/ceph-osd.0.asok dump_historic_ops 2023-08-01T19:55:03.540 INFO:tasks.ceph.osd.0.smithi008.stderr:2023-08-01T19:55:03.539+0000 7f16a58f4700 -1 received signal: Hangup from /usr/bin/python3 /bin/daemon-helper kill ceph-osd -f --cluster ceph -i 0 (PID: 111179) UID: 0 2023-08-01T19:55:03.554 INFO:teuthology.orchestra.run.smithi006.stderr:noscrub is unset 2023-08-01T19:55:03.568 INFO:teuthology.orchestra.run.smithi006.stdout:osd.0: {} 2023-08-01T19:55:03.588 INFO:teuthology.orchestra.run.smithi006.stdout:osd.1: {} 2023-08-01T19:55:03.609 INFO:teuthology.orchestra.run.smithi006.stdout:osd.2: {} 2023-08-01T19:55:03.610 INFO:teuthology.orchestra.run.smithi006.stderr:osd.0: osd_enable_op_tracker = 'true' 2023-08-01T19:55:03.610 INFO:teuthology.orchestra.run.smithi006.stderr:osd.1: osd_enable_op_tracker = 'true' 2023-08-01T19:55:03.610 INFO:teuthology.orchestra.run.smithi006.stderr:osd.2: osd_enable_op_tracker = 'true' 2023-08-01T19:55:03.625 INFO:tasks.ceph.osd.2.smithi155.stderr:2023-08-01T19:55:03.623+0000 7faa5c6ac700 -1 received signal: Hangup from /usr/bin/python3 /bin/daemon-helper kill ceph-osd -f --cluster ceph -i 2 (PID: 111337) UID: 0 2023-08-01T19:55:03.685 INFO:teuthology.orchestra.run.smithi008.stdout:{ 2023-08-01T19:55:03.685 INFO:teuthology.orchestra.run.smithi008.stdout: "size": 20, 2023-08-01T19:55:03.685 INFO:teuthology.orchestra.run.smithi008.stdout: "duration": 600, 2023-08-01T19:55:03.686 INFO:teuthology.orchestra.run.smithi008.stdout: "ops": [ 2023-08-01T19:55:03.686 INFO:teuthology.orchestra.run.smithi008.stdout: { 2023-08-01T19:55:03.686 INFO:teuthology.orchestra.run.smithi008.stdout: "description": "osd_op(client.4668.0:18360 5.6 5:65d8e237:::benchmark_data_smithi006_114134_object18359:head [set-alloc-hint object_size 65536 write_size 65536,write 0~65536] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e23)", 2023-08-01T19:55:03.686 INFO:teuthology.orchestra.run.smithi008.stdout: "initiated_at": "2023-08-01T19:54:28.994296+0000", 2023-08-01T19:55:03.686 INFO:teuthology.orchestra.run.smithi008.stdout: "age": 34.688041972000001, 2023-08-01T19:55:03.686 INFO:teuthology.orchestra.run.smithi008.stdout: "duration": 0.017459669000000001, 2023-08-01T19:55:03.686 INFO:teuthology.orchestra.run.smithi008.stdout: "type_data": { 2023-08-01T19:55:03.686 INFO:teuthology.orchestra.run.smithi008.stdout: "flag_point": "commit sent; apply or cleanup", 2023-08-01T19:55:03.687 INFO:teuthology.orchestra.run.smithi008.stdout: "client_info": { 2023-08-01T19:55:03.687 INFO:teuthology.orchestra.run.smithi008.stdout: "client": "client.4668", 2023-08-01T19:55:03.687 INFO:teuthology.orchestra.run.smithi008.stdout: "client_addr": "172.21.15.6:0/1709472247", 2023-08-01T19:55:03.687 INFO:teuthology.orchestra.run.smithi008.stdout: "tid": 18360 2023-08-01T19:55:03.687 INFO:teuthology.orchestra.run.smithi008.stdout: }, 2023-08-01T19:55:03.687 INFO:teuthology.orchestra.run.smithi008.stdout: "events": [ 2023-08-01T19:55:03.687 INFO:teuthology.orchestra.run.smithi008.stdout: { 2023-08-01T19:55:03.688 INFO:teuthology.orchestra.run.smithi008.stdout: "event": "initiated", 2023-08-01T19:55:03.688 INFO:teuthology.orchestra.run.smithi008.stdout: "time": "2023-08-01T19:54:28.994296+0000", 2023-08-01T19:55:03.688 INFO:teuthology.orchestra.run.smithi008.stdout: "duration": 0 2023-08-01T19:55:03.688 INFO:teuthology.orchestra.run.smithi008.stdout: }, 2023-08-01T19:55:03.688 INFO:teuthology.orchestra.run.smithi008.stdout: { 2023-08-01T19:55:03.688 INFO:teuthology.orchestra.run.smithi008.stdout: "event": "throttled", 2023-08-01T19:55:03.688 INFO:teuthology.orchestra.run.smithi008.stdout: "time": "2023-08-01T19:54:28.994296+0000", 2023-08-01T19:55:03.688 INFO:teuthology.orchestra.run.smithi008.stdout: "duration": 0 2023-08-01T19:55:03.689 INFO:teuthology.orchestra.run.smithi008.stdout: }, 2023-08-01T19:55:03.689 INFO:teuthology.orchestra.run.smithi008.stdout: { 2023-08-01T19:55:03.689 INFO:teuthology.orchestra.run.smithi008.stdout: "event": "header_read", 2023-08-01T19:55:03.689 INFO:teuthology.orchestra.run.smithi008.stdout: "time": "2023-08-01T19:54:28.994295+0000", 2023-08-01T19:55:03.689 INFO:teuthology.orchestra.run.smithi008.stdout: "duration": 4294967295.9999995 2023-08-01T19:55:03.689 INFO:teuthology.orchestra.run.smithi008.stdout: }, 2023-08-01T19:55:03.689 INFO:teuthology.orchestra.run.smithi008.stdout: { 2023-08-01T19:55:03.689 INFO:teuthology.orchestra.run.smithi008.stdout: "event": "all_read", 2023-08-01T19:55:03.690 INFO:teuthology.orchestra.run.smithi008.stdout: "time": "2023-08-01T19:54:28.994381+0000", 2023-08-01T19:55:03.690 INFO:teuthology.orchestra.run.smithi008.stdout: "duration": 8.6055000000000002e-05 2023-08-01T19:55:03.690 INFO:teuthology.orchestra.run.smithi008.stdout: }, 2023-08-01T19:55:03.690 INFO:teuthology.orchestra.run.smithi008.stdout: { 2023-08-01T19:55:03.690 INFO:teuthology.orchestra.run.smithi008.stdout: "event": "dispatched", 2023-08-01T19:55:03.690 INFO:teuthology.orchestra.run.smithi008.stdout: "time": "2023-08-01T19:54:28.994390+0000", 2023-08-01T19:55:03.690 INFO:teuthology.orchestra.run.smithi008.stdout: "duration": 8.7530000000000007e-06 2023-08-01T19:55:03.690 INFO:teuthology.orchestra.run.smithi008.stdout: }, 2023-08-01T19:55:03.691 INFO:teuthology.orchestra.run.smithi008.stdout: { 2023-08-01T19:55:03.691 INFO:teuthology.orchestra.run.smithi008.stdout: "event": "queued_for_pg", 2023-08-01T19:55:03.691 INFO:teuthology.orchestra.run.smithi008.stdout: "time": "2023-08-01T19:54:28.994394+0000", 2023-08-01T19:55:03.691 INFO:teuthology.orchestra.run.smithi008.stdout: "duration": 3.4929999999999998e-06 2023-08-01T19:55:03.691 INFO:teuthology.orchestra.run.smithi008.stdout: }, 2023-08-01T19:55:03.691 INFO:teuthology.orchestra.run.smithi008.stdout: { 2023-08-01T19:55:03.691 INFO:teuthology.orchestra.run.smithi008.stdout: "event": "reached_pg", 2023-08-01T19:55:03.692 INFO:teuthology.orchestra.run.smithi008.stdout: "time": "2023-08-01T19:54:28.995799+0000", 2023-08-01T19:55:03.692 INFO:teuthology.orchestra.run.smithi008.stdout: "duration": 0.001405779 2023-08-01T19:55:03.692 INFO:teuthology.orchestra.run.smithi008.stdout: }, 2023-08-01T19:55:03.692 INFO:teuthology.orchestra.run.smithi008.stdout: { 2023-08-01T19:55:03.692 INFO:teuthology.orchestra.run.smithi008.stdout: "event": "started", 2023-08-01T19:55:03.692 INFO:teuthology.orchestra.run.smithi008.stdout: "time": "2023-08-01T19:54:28.995896+0000", 2023-08-01T19:55:03.692 INFO:teuthology.orchestra.run.smithi008.stdout: "duration": 9.6597999999999999e-05 2023-08-01T19:55:03.693 INFO:teuthology.orchestra.run.smithi008.stdout: }, 2023-08-01T19:55:03.693 INFO:teuthology.orchestra.run.smithi008.stdout: { 2023-08-01T19:55:03.693 INFO:teuthology.orchestra.run.smithi008.stdout: "event": "waiting for subops from 1", 2023-08-01T19:55:03.693 INFO:teuthology.orchestra.run.smithi008.stdout: "time": "2023-08-01T19:54:28.995985+0000", 2023-08-01T19:55:03.693 INFO:teuthology.orchestra.run.smithi008.stdout: "duration": 8.8479000000000004e-05 2023-08-01T19:55:03.693 INFO:teuthology.orchestra.run.smithi008.stdout: }, 2023-08-01T19:55:03.693 INFO:teuthology.orchestra.run.smithi008.stdout: { 2023-08-01T19:55:03.693 INFO:teuthology.orchestra.run.smithi008.stdout: "event": "op_commit", 2023-08-01T19:55:03.694 INFO:teuthology.orchestra.run.smithi008.stdout: "time": "2023-08-01T19:54:28.997700+0000", 2023-08-01T19:55:03.694 INFO:teuthology.orchestra.run.smithi008.stdout: "duration": 0.001714997 2023-08-01T19:55:03.694 INFO:teuthology.orchestra.run.smithi008.stdout: }, 2023-08-01T19:55:03.694 INFO:teuthology.orchestra.run.smithi008.stdout: { 2023-08-01T19:55:03.694 INFO:teuthology.orchestra.run.smithi008.stdout: "event": "sub_op_commit_rec", 2023-08-01T19:55:03.694 INFO:teuthology.orchestra.run.smithi008.stdout: "time": "2023-08-01T19:54:29.011671+0000", 2023-08-01T19:55:03.694 INFO:teuthology.orchestra.run.smithi008.stdout: "duration": 0.0139712 2023-08-01T19:55:03.694 INFO:teuthology.orchestra.run.smithi008.stdout: }, 2023-08-01T19:55:03.695 INFO:teuthology.orchestra.run.smithi008.stdout: { 2023-08-01T19:55:03.695 INFO:teuthology.orchestra.run.smithi008.stdout: "event": "commit_sent", 2023-08-01T19:55:03.695 INFO:teuthology.orchestra.run.smithi008.stdout: "time": "2023-08-01T19:54:29.011719+0000", 2023-08-01T19:55:03.695 INFO:teuthology.orchestra.run.smithi008.stdout: "duration": 4.8025000000000002e-05 2023-08-01T19:55:03.695 INFO:teuthology.orchestra.run.smithi008.stdout: }, 2023-08-01T19:55:03.695 INFO:teuthology.orchestra.run.smithi008.stdout: { 2023-08-01T19:55:03.695 INFO:teuthology.orchestra.run.smithi008.stdout: "event": "done", 2023-08-01T19:55:03.696 INFO:teuthology.orchestra.run.smithi008.stdout: "time": "2023-08-01T19:54:29.011756+0000", 2023-08-01T19:55:03.696 INFO:teuthology.orchestra.run.smithi008.stdout: "duration": 3.6825000000000001e-05 2023-08-01T19:55:03.696 INFO:teuthology.orchestra.run.smithi008.stdout: } 2023-08-01T19:55:03.696 INFO:teuthology.orchestra.run.smithi008.stdout: ] 2023-08-01T19:55:03.696 INFO:teuthology.orchestra.run.smithi008.stdout: } 2023-08-01T19:55:03.696 INFO:teuthology.orchestra.run.smithi008.stdout: }, 2023-08-01T19:55:03.696 INFO:teuthology.orchestra.run.smithi008.stdout: { 2023-08-01T19:55:03.696 INFO:teuthology.orchestra.run.smithi008.stdout: "description": "osd_op(client.4668.0:18361 5.6 5:65a8a093:::benchmark_data_smithi006_114134_object18360:head [set-alloc-hint object_size 65536 write_size 65536,write 0~65536] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e23)", 2023-08-01T19:55:03.697 INFO:teuthology.orchestra.run.smithi008.stdout: "initiated_at": "2023-08-01T19:54:28.994398+0000", 2023-08-01T19:55:03.697 INFO:teuthology.orchestra.run.smithi008.stdout: "age": 34.687940113000003, 2023-08-01T19:55:03.697 INFO:teuthology.orchestra.run.smithi008.stdout: "duration": 0.017435484000000001, 2023-08-01T19:55:03.697 INFO:teuthology.orchestra.run.smithi008.stdout: "type_data": { 2023-08-01T19:55:03.697 INFO:teuthology.orchestra.run.smithi008.stdout: "flag_point": "commit sent; apply or cleanup", 2023-08-01T19:55:03.697 INFO:teuthology.orchestra.run.smithi008.stdout: "client_info": { 2023-08-01T19:55:03.697 INFO:teuthology.orchestra.run.smithi008.stdout: "client": "client.4668", 2023-08-01T19:55:03.697 INFO:teuthology.orchestra.run.smithi008.stdout: "client_addr": "172.21.15.6:0/1709472247", 2023-08-01T19:55:03.698 INFO:teuthology.orchestra.run.smithi008.stdout: "tid": 18361 2023-08-01T19:55:03.698 INFO:teuthology.orchestra.run.smithi008.stdout: }, 2023-08-01T19:55:03.698 INFO:teuthology.orchestra.run.smithi008.stdout: "events": [ 2023-08-01T19:55:03.698 INFO:teuthology.orchestra.run.smithi008.stdout: { 2023-08-01T19:55:03.698 INFO:teuthology.orchestra.run.smithi008.stdout: "event": "initiated", 2023-08-01T19:55:03.698 INFO:teuthology.orchestra.run.smithi008.stdout: "time": "2023-08-01T19:54:28.994398+0000", 2023-08-01T19:55:03.698 INFO:teuthology.orchestra.run.smithi008.stdout: "duration": 0 2023-08-01T19:55:03.699 INFO:teuthology.orchestra.run.smithi008.stdout: }, 2023-08-01T19:55:03.699 INFO:teuthology.orchestra.run.smithi008.stdout: { 2023-08-01T19:55:03.699 INFO:teuthology.orchestra.run.smithi008.stdout: "event": "throttled", 2023-08-01T19:55:03.699 INFO:teuthology.orchestra.run.smithi008.stdout: "time": "2023-08-01T19:54:28.994398+0000", 2023-08-01T19:55:03.699 INFO:teuthology.orchestra.run.smithi008.stdout: "duration": 0 2023-08-01T19:55:03.699 INFO:teuthology.orchestra.run.smithi008.stdout: }, 2023-08-01T19:55:03.699 INFO:teuthology.orchestra.run.smithi008.stdout: { 2023-08-01T19:55:03.699 INFO:teuthology.orchestra.run.smithi008.stdout: "event": "header_read", 2023-08-01T19:55:03.700 INFO:teuthology.orchestra.run.smithi008.stdout: "time": "2023-08-01T19:54:28.994397+0000", 2023-08-01T19:55:03.700 INFO:teuthology.orchestra.run.smithi008.stdout: "duration": 4294967295.9999995 2023-08-01T19:55:03.700 INFO:teuthology.orchestra.run.smithi008.stdout: }, 2023-08-01T19:55:03.700 INFO:teuthology.orchestra.run.smithi008.stdout: { 2023-08-01T19:55:03.700 INFO:teuthology.orchestra.run.smithi008.stdout: "event": "all_read", 2023-08-01T19:55:03.700 INFO:teuthology.orchestra.run.smithi008.stdout: "time": "2023-08-01T19:54:28.994475+0000", 2023-08-01T19:55:03.700 INFO:teuthology.orchestra.run.smithi008.stdout: "duration": 7.7408000000000002e-05 2023-08-01T19:55:03.700 INFO:teuthology.orchestra.run.smithi008.stdout: }, 2023-08-01T19:55:03.701 INFO:teuthology.orchestra.run.smithi008.stdout: { 2023-08-01T19:55:03.701 INFO:teuthology.orchestra.run.smithi008.stdout: "event": "dispatched", 2023-08-01T19:55:03.701 INFO:teuthology.orchestra.run.smithi008.stdout: "time": "2023-08-01T19:54:28.994480+0000", 2023-08-01T19:55:03.701 INFO:teuthology.orchestra.run.smithi008.stdout: "duration": 5.3589999999999999e-06 2023-08-01T19:55:03.701 INFO:teuthology.orchestra.run.smithi008.stdout: }, 2023-08-01T19:55:03.701 INFO:teuthology.orchestra.run.smithi008.stdout: { 2023-08-01T19:55:03.701 INFO:teuthology.orchestra.run.smithi008.stdout: "event": "queued_for_pg", 2023-08-01T19:55:03.702 INFO:teuthology.orchestra.run.smithi008.stdout: "time": "2023-08-01T19:54:28.994484+0000", 2023-08-01T19:55:03.702 INFO:teuthology.orchestra.run.smithi008.stdout: "duration": 3.9750000000000001e-06 2023-08-01T19:55:03.702 INFO:teuthology.orchestra.run.smithi008.stdout: }, 2023-08-01T19:55:03.702 INFO:teuthology.orchestra.run.smithi008.stdout: { 2023-08-01T19:55:03.702 INFO:teuthology.orchestra.run.smithi008.stdout: "event": "reached_pg", 2023-08-01T19:55:03.702 INFO:teuthology.orchestra.run.smithi008.stdout: "time": "2023-08-01T19:54:28.996504+0000", 2023-08-01T19:55:03.702 INFO:teuthology.orchestra.run.smithi008.stdout: "duration": 0.0020198550000000001 2023-08-01T19:55:03.702 INFO:teuthology.orchestra.run.smithi008.stdout: }, 2023-08-01T19:55:03.703 INFO:teuthology.orchestra.run.smithi008.stdout: { 2023-08-01T19:55:03.703 INFO:teuthology.orchestra.run.smithi008.stdout: "event": "started", 2023-08-01T19:55:03.703 INFO:teuthology.orchestra.run.smithi008.stdout: "time": "2023-08-01T19:54:28.996624+0000", 2023-08-01T19:55:03.703 INFO:teuthology.orchestra.run.smithi008.stdout: "duration": 0.000120118 2023-08-01T19:55:03.703 INFO:teuthology.orchestra.run.smithi008.stdout: }, 2023-08-01T19:55:03.703 INFO:teuthology.orchestra.run.smithi008.stdout: { 2023-08-01T19:55:03.703 INFO:teuthology.orchestra.run.smithi008.stdout: "event": "waiting for subops from 1", 2023-08-01T19:55:03.703 INFO:teuthology.orchestra.run.smithi008.stdout: "time": "2023-08-01T19:54:28.996790+0000", 2023-08-01T19:55:03.704 INFO:teuthology.orchestra.run.smithi008.stdout: "duration": 0.000165398 2023-08-01T19:55:03.704 INFO:teuthology.orchestra.run.smithi008.stdout: }, 2023-08-01T19:55:03.704 INFO:teuthology.orchestra.run.smithi008.stdout: { 2023-08-01T19:55:03.704 INFO:teuthology.orchestra.run.smithi008.stdout: "event": "op_commit", 2023-08-01T19:55:03.704 INFO:teuthology.orchestra.run.smithi008.stdout: "time": "2023-08-01T19:54:28.999061+0000", 2023-08-01T19:55:03.704 INFO:teuthology.orchestra.run.smithi008.stdout: "duration": 0.0022714800000000002 2023-08-01T19:55:03.704 INFO:teuthology.orchestra.run.smithi008.stdout: }, 2023-08-01T19:55:03.704 INFO:teuthology.orchestra.run.smithi008.stdout: { 2023-08-01T19:55:03.705 INFO:teuthology.orchestra.run.smithi008.stdout: "event": "sub_op_commit_rec", 2023-08-01T19:55:03.705 INFO:teuthology.orchestra.run.smithi008.stdout: "time": "2023-08-01T19:54:29.011788+0000", 2023-08-01T19:55:03.705 INFO:teuthology.orchestra.run.smithi008.stdout: "duration": 0.012726774999999999 2023-08-01T19:55:03.705 INFO:teuthology.orchestra.run.smithi008.stdout: }, 2023-08-01T19:55:03.705 INFO:teuthology.orchestra.run.smithi008.stdout: { 2023-08-01T19:55:03.705 INFO:teuthology.orchestra.run.smithi008.stdout: "event": "commit_sent", 2023-08-01T19:55:03.705 INFO:teuthology.orchestra.run.smithi008.stdout: "time": "2023-08-01T19:54:29.011815+0000", 2023-08-01T19:55:03.706 INFO:teuthology.orchestra.run.smithi008.stdout: "duration": 2.7032000000000001e-05 2023-08-01T19:55:03.706 INFO:teuthology.orchestra.run.smithi008.stdout: }, 2023-08-01T19:55:03.706 INFO:teuthology.orchestra.run.smithi008.stdout: { 2023-08-01T19:55:03.706 INFO:teuthology.orchestra.run.smithi008.stdout: "event": "done", 2023-08-01T19:55:03.706 INFO:teuthology.orchestra.run.smithi008.stdout: "time": "2023-08-01T19:54:29.011833+0000", 2023-08-01T19:55:03.706 INFO:teuthology.orchestra.run.smithi008.stdout: "duration": 1.8437e-05 2023-08-01T19:55:03.706 INFO:teuthology.orchestra.run.smithi008.stdout: } 2023-08-01T19:55:03.706 INFO:teuthology.orchestra.run.smithi008.stdout: ] 2023-08-01T19:55:03.707 INFO:teuthology.orchestra.run.smithi008.stdout: } 2023-08-01T19:55:03.707 INFO:teuthology.orchestra.run.smithi008.stdout: }, 2023-08-01T19:55:03.707 INFO:teuthology.orchestra.run.smithi008.stdout: { 2023-08-01T19:55:03.707 INFO:teuthology.orchestra.run.smithi008.stdout: "description": "osd_op(client.4668.0:65870 5.c 5:33dffb88:::benchmark_data_smithi006_114134_object65869:head [set-alloc-hint object_size 65536 write_size 65536,write 0~65536] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e29)", 2023-08-01T19:55:03.707 INFO:teuthology.orchestra.run.smithi008.stdout: "initiated_at": "2023-08-01T19:54:47.659854+0000", 2023-08-01T19:55:03.707 INFO:teuthology.orchestra.run.smithi008.stdout: "age": 16.022484064, 2023-08-01T19:55:03.707 INFO:teuthology.orchestra.run.smithi008.stdout: "duration": 0.018513103999999999, 2023-08-01T19:55:03.707 INFO:teuthology.orchestra.run.smithi008.stdout: "type_data": { 2023-08-01T19:55:03.708 INFO:teuthology.orchestra.run.smithi008.stdout: "flag_point": "commit sent; apply or cleanup", 2023-08-01T19:55:03.708 INFO:teuthology.orchestra.run.smithi008.stdout: "client_info": { 2023-08-01T19:55:03.708 INFO:teuthology.orchestra.run.smithi008.stdout: "client": "client.4668", 2023-08-01T19:55:03.708 INFO:teuthology.orchestra.run.smithi008.stdout: "client_addr": "172.21.15.6:0/1709472247", 2023-08-01T19:55:03.708 INFO:teuthology.orchestra.run.smithi008.stdout: "tid": 65870 2023-08-01T19:55:03.708 INFO:teuthology.orchestra.run.smithi008.stdout: }, 2023-08-01T19:55:03.708 INFO:teuthology.orchestra.run.smithi008.stdout: "events": [ 2023-08-01T19:55:03.708 INFO:teuthology.orchestra.run.smithi008.stdout: { 2023-08-01T19:55:03.709 INFO:teuthology.orchestra.run.smithi008.stdout: "event": "initiated", 2023-08-01T19:55:03.709 INFO:teuthology.orchestra.run.smithi008.stdout: "time": "2023-08-01T19:54:47.659854+0000", 2023-08-01T19:55:03.709 INFO:teuthology.orchestra.run.smithi008.stdout: "duration": 0 2023-08-01T19:55:03.709 INFO:teuthology.orchestra.run.smithi008.stdout: }, 2023-08-01T19:55:03.709 INFO:teuthology.orchestra.run.smithi008.stdout: { 2023-08-01T19:55:03.709 INFO:teuthology.orchestra.run.smithi008.stdout: "event": "throttled", 2023-08-01T19:55:03.709 INFO:teuthology.orchestra.run.smithi008.stdout: "time": "2023-08-01T19:54:47.659854+0000", 2023-08-01T19:55:03.709 INFO:teuthology.orchestra.run.smithi008.stdout: "duration": 0 2023-08-01T19:55:03.710 INFO:teuthology.orchestra.run.smithi008.stdout: }, 2023-08-01T19:55:03.710 INFO:teuthology.orchestra.run.smithi008.stdout: { 2023-08-01T19:55:03.710 INFO:teuthology.orchestra.run.smithi008.stdout: "event": "header_read", 2023-08-01T19:55:03.710 INFO:teuthology.orchestra.run.smithi008.stdout: "time": "2023-08-01T19:54:47.659853+0000", 2023-08-01T19:55:03.710 INFO:teuthology.orchestra.run.smithi008.stdout: "duration": 4294967295.999999 2023-08-01T19:55:03.710 INFO:teuthology.orchestra.run.smithi008.stdout: }, 2023-08-01T19:55:03.710 INFO:teuthology.orchestra.run.smithi008.stdout: { 2023-08-01T19:55:03.711 INFO:teuthology.orchestra.run.smithi008.stdout: "event": "all_read", 2023-08-01T19:55:03.711 INFO:teuthology.orchestra.run.smithi008.stdout: "time": "2023-08-01T19:54:47.660013+0000", 2023-08-01T19:55:03.711 INFO:teuthology.orchestra.run.smithi008.stdout: "duration": 0.00015954900000000001 2023-08-01T19:55:03.711 INFO:teuthology.orchestra.run.smithi008.stdout: }, 2023-08-01T19:55:03.711 INFO:teuthology.orchestra.run.smithi008.stdout: { 2023-08-01T19:55:03.711 INFO:teuthology.orchestra.run.smithi008.stdout: "event": "dispatched", 2023-08-01T19:55:03.711 INFO:teuthology.orchestra.run.smithi008.stdout: "time": "2023-08-01T19:54:47.660023+0000", 2023-08-01T19:55:03.711 INFO:teuthology.orchestra.run.smithi008.stdout: "duration": 1.0327e-05 2023-08-01T19:55:03.712 INFO:teuthology.orchestra.run.smithi008.stdout: }, 2023-08-01T19:55:03.712 INFO:teuthology.orchestra.run.smithi008.stdout: { 2023-08-01T19:55:03.712 INFO:teuthology.orchestra.run.smithi008.stdout: "event": "queued_for_pg", 2023-08-01T19:55:03.712 INFO:teuthology.orchestra.run.smithi008.stdout: "time": "2023-08-01T19:54:47.660039+0000", 2023-08-01T19:55:03.712 INFO:teuthology.orchestra.run.smithi008.stdout: "duration": 1.5829999999999999e-05 2023-08-01T19:55:03.712 INFO:teuthology.orchestra.run.smithi008.stdout: }, 2023-08-01T19:55:03.712 INFO:teuthology.orchestra.run.smithi008.stdout: { 2023-08-01T19:55:03.712 INFO:teuthology.orchestra.run.smithi008.stdout: "event": "reached_pg", 2023-08-01T19:55:03.713 INFO:teuthology.orchestra.run.smithi008.stdout: "time": "2023-08-01T19:54:47.662611+0000", 2023-08-01T19:55:03.713 INFO:teuthology.orchestra.run.smithi008.stdout: "duration": 0.002572319 2023-08-01T19:55:03.713 INFO:teuthology.orchestra.run.smithi008.stdout: }, 2023-08-01T19:55:03.713 INFO:teuthology.orchestra.run.smithi008.stdout: { 2023-08-01T19:55:03.713 INFO:teuthology.orchestra.run.smithi008.stdout: "event": "started", 2023-08-01T19:55:03.713 INFO:teuthology.orchestra.run.smithi008.stdout: "time": "2023-08-01T19:54:47.662767+0000", 2023-08-01T19:55:03.713 INFO:teuthology.orchestra.run.smithi008.stdout: "duration": 0.00015598200000000001 2023-08-01T19:55:03.713 INFO:teuthology.orchestra.run.smithi008.stdout: }, 2023-08-01T19:55:03.714 INFO:teuthology.orchestra.run.smithi008.stdout: { 2023-08-01T19:55:03.714 INFO:teuthology.orchestra.run.smithi008.stdout: "event": "waiting for subops from 1", 2023-08-01T19:55:03.714 INFO:teuthology.orchestra.run.smithi008.stdout: "time": "2023-08-01T19:54:47.662930+0000", 2023-08-01T19:55:03.714 INFO:teuthology.orchestra.run.smithi008.stdout: "duration": 0.000163086 2023-08-01T19:55:03.714 INFO:teuthology.orchestra.run.smithi008.stdout: }, 2023-08-01T19:55:03.714 INFO:teuthology.orchestra.run.smithi008.stdout: { 2023-08-01T19:55:03.714 INFO:teuthology.orchestra.run.smithi008.stdout: "event": "sub_op_commit_rec", 2023-08-01T19:55:03.714 INFO:teuthology.orchestra.run.smithi008.stdout: "time": "2023-08-01T19:54:47.667336+0000", 2023-08-01T19:55:03.715 INFO:teuthology.orchestra.run.smithi008.stdout: "duration": 0.0044062839999999999 2023-08-01T19:55:03.715 INFO:teuthology.orchestra.run.smithi008.stdout: }, 2023-08-01T19:55:03.715 INFO:teuthology.orchestra.run.smithi008.stdout: { 2023-08-01T19:55:03.715 INFO:teuthology.orchestra.run.smithi008.stdout: "event": "op_commit", 2023-08-01T19:55:03.715 INFO:teuthology.orchestra.run.smithi008.stdout: "time": "2023-08-01T19:54:47.678278+0000", 2023-08-01T19:55:03.715 INFO:teuthology.orchestra.run.smithi008.stdout: "duration": 0.010941912999999999 2023-08-01T19:55:03.715 INFO:teuthology.orchestra.run.smithi008.stdout: }, 2023-08-01T19:55:03.715 INFO:teuthology.orchestra.run.smithi008.stdout: { 2023-08-01T19:55:03.716 INFO:teuthology.orchestra.run.smithi008.stdout: "event": "commit_sent", 2023-08-01T19:55:03.716 INFO:teuthology.orchestra.run.smithi008.stdout: "time": "2023-08-01T19:54:47.678325+0000", 2023-08-01T19:55:03.716 INFO:teuthology.orchestra.run.smithi008.stdout: "duration": 4.6449999999999997e-05 2023-08-01T19:55:03.716 INFO:teuthology.orchestra.run.smithi008.stdout: }, 2023-08-01T19:55:03.716 INFO:teuthology.orchestra.run.smithi008.stdout: { 2023-08-01T19:55:03.716 INFO:teuthology.orchestra.run.smithi008.stdout: "event": "done", 2023-08-01T19:55:03.716 INFO:teuthology.orchestra.run.smithi008.stdout: "time": "2023-08-01T19:54:47.678367+0000", 2023-08-01T19:55:03.717 INFO:teuthology.orchestra.run.smithi008.stdout: "duration": 4.2222999999999999e-05 2023-08-01T19:55:03.717 INFO:teuthology.orchestra.run.smithi008.stdout: } 2023-08-01T19:55:03.717 INFO:teuthology.orchestra.run.smithi008.stdout: ] 2023-08-01T19:55:03.717 INFO:teuthology.orchestra.run.smithi008.stdout: } 2023-08-01T19:55:03.717 INFO:teuthology.orchestra.run.smithi008.stdout: }, 2023-08-01T19:55:03.717 INFO:teuthology.orchestra.run.smithi008.stdout: { 2023-08-01T19:55:03.717 INFO:teuthology.orchestra.run.smithi008.stdout: "description": "osd_op(client.4668.0:75014 5.c 5:3d8cba0f:::benchmark_data_smithi006_114134_object75013:head [set-alloc-hint object_size 65536 write_size 65536,write 0~65536] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e32)", 2023-08-01T19:55:03.717 INFO:teuthology.orchestra.run.smithi008.stdout: "initiated_at": "2023-08-01T19:54:52.218900+0000", 2023-08-01T19:55:03.718 INFO:teuthology.orchestra.run.smithi008.stdout: "age": 11.463438084, 2023-08-01T19:55:03.718 INFO:teuthology.orchestra.run.smithi008.stdout: "duration": 0.015819357999999999, 2023-08-01T19:55:03.718 INFO:teuthology.orchestra.run.smithi008.stdout: "type_data": { 2023-08-01T19:55:03.718 INFO:teuthology.orchestra.run.smithi008.stdout: "flag_point": "commit sent; apply or cleanup", 2023-08-01T19:55:03.718 INFO:teuthology.orchestra.run.smithi008.stdout: "client_info": { 2023-08-01T19:55:03.718 INFO:teuthology.orchestra.run.smithi008.stdout: "client": "client.4668", 2023-08-01T19:55:03.718 INFO:teuthology.orchestra.run.smithi008.stdout: "client_addr": "172.21.15.6:0/1709472247", 2023-08-01T19:55:03.718 INFO:teuthology.orchestra.run.smithi008.stdout: "tid": 75014 2023-08-01T19:55:03.719 INFO:teuthology.orchestra.run.smithi008.stdout: }, 2023-08-01T19:55:03.719 INFO:teuthology.orchestra.run.smithi008.stdout: "events": [ 2023-08-01T19:55:03.719 INFO:teuthology.orchestra.run.smithi008.stdout: { 2023-08-01T19:55:03.719 INFO:teuthology.orchestra.run.smithi008.stdout: "event": "initiated", 2023-08-01T19:55:03.719 INFO:teuthology.orchestra.run.smithi008.stdout: "time": "2023-08-01T19:54:52.218900+0000", 2023-08-01T19:55:03.719 INFO:teuthology.orchestra.run.smithi008.stdout: "duration": 0 2023-08-01T19:55:03.719 INFO:teuthology.orchestra.run.smithi008.stdout: }, 2023-08-01T19:55:03.719 INFO:teuthology.orchestra.run.smithi008.stdout: { 2023-08-01T19:55:03.720 INFO:teuthology.orchestra.run.smithi008.stdout: "event": "throttled", 2023-08-01T19:55:03.720 INFO:teuthology.orchestra.run.smithi008.stdout: "time": "2023-08-01T19:54:52.218900+0000", 2023-08-01T19:55:03.720 INFO:teuthology.orchestra.run.smithi008.stdout: "duration": 0 2023-08-01T19:55:03.720 INFO:teuthology.orchestra.run.smithi008.stdout: }, 2023-08-01T19:55:03.720 INFO:teuthology.orchestra.run.smithi008.stdout: { 2023-08-01T19:55:03.720 INFO:teuthology.orchestra.run.smithi008.stdout: "event": "header_read", 2023-08-01T19:55:03.720 INFO:teuthology.orchestra.run.smithi008.stdout: "time": "2023-08-01T19:54:52.218899+0000", 2023-08-01T19:55:03.720 INFO:teuthology.orchestra.run.smithi008.stdout: "duration": 4294967295.999999 2023-08-01T19:55:03.721 INFO:teuthology.orchestra.run.smithi008.stdout: }, 2023-08-01T19:55:03.721 INFO:teuthology.orchestra.run.smithi008.stdout: { 2023-08-01T19:55:03.721 INFO:teuthology.orchestra.run.smithi008.stdout: "event": "all_read", 2023-08-01T19:55:03.721 INFO:teuthology.orchestra.run.smithi008.stdout: "time": "2023-08-01T19:54:52.218930+0000", 2023-08-01T19:55:03.721 INFO:teuthology.orchestra.run.smithi008.stdout: "duration": 3.1211999999999999e-05 2023-08-01T19:55:03.721 INFO:teuthology.orchestra.run.smithi008.stdout: }, 2023-08-01T19:55:03.721 INFO:teuthology.orchestra.run.smithi008.stdout: { 2023-08-01T19:55:03.721 INFO:teuthology.orchestra.run.smithi008.stdout: "event": "dispatched", 2023-08-01T19:55:03.722 INFO:teuthology.orchestra.run.smithi008.stdout: "time": "2023-08-01T19:54:52.218938+0000", 2023-08-01T19:55:03.722 INFO:teuthology.orchestra.run.smithi008.stdout: "duration": 8.1850000000000004e-06 2023-08-01T19:55:03.722 INFO:teuthology.orchestra.run.smithi008.stdout: }, 2023-08-01T19:55:03.722 INFO:teuthology.orchestra.run.smithi008.stdout: { 2023-08-01T19:55:03.722 INFO:teuthology.orchestra.run.smithi008.stdout: "event": "queued_for_pg", 2023-08-01T19:55:03.722 INFO:teuthology.orchestra.run.smithi008.stdout: "time": "2023-08-01T19:54:52.218946+0000", 2023-08-01T19:55:03.722 INFO:teuthology.orchestra.run.smithi008.stdout: "duration": 7.272e-06 2023-08-01T19:55:03.723 INFO:teuthology.orchestra.run.smithi008.stdout: }, 2023-08-01T19:55:03.723 INFO:teuthology.orchestra.run.smithi008.stdout: { 2023-08-01T19:55:03.723 INFO:teuthology.orchestra.run.smithi008.stdout: "event": "reached_pg", 2023-08-01T19:55:03.723 INFO:teuthology.orchestra.run.smithi008.stdout: "time": "2023-08-01T19:54:52.218984+0000", 2023-08-01T19:55:03.723 INFO:teuthology.orchestra.run.smithi008.stdout: "duration": 3.8566000000000003e-05 2023-08-01T19:55:03.723 INFO:teuthology.orchestra.run.smithi008.stdout: }, 2023-08-01T19:55:03.723 INFO:teuthology.orchestra.run.smithi008.stdout: { 2023-08-01T19:55:03.723 INFO:teuthology.orchestra.run.smithi008.stdout: "event": "started", 2023-08-01T19:55:03.724 INFO:teuthology.orchestra.run.smithi008.stdout: "time": "2023-08-01T19:54:52.219093+0000", 2023-08-01T19:55:03.724 INFO:teuthology.orchestra.run.smithi008.stdout: "duration": 0.00010921000000000001 2023-08-01T19:55:03.724 INFO:teuthology.orchestra.run.smithi008.stdout: }, 2023-08-01T19:55:03.724 INFO:teuthology.orchestra.run.smithi008.stdout: { 2023-08-01T19:55:03.724 INFO:teuthology.orchestra.run.smithi008.stdout: "event": "waiting for subops from 1", 2023-08-01T19:55:03.724 INFO:teuthology.orchestra.run.smithi008.stdout: "time": "2023-08-01T19:54:52.219206+0000", 2023-08-01T19:55:03.724 INFO:teuthology.orchestra.run.smithi008.stdout: "duration": 0.00011312299999999999 2023-08-01T19:55:03.725 INFO:teuthology.orchestra.run.smithi008.stdout: }, 2023-08-01T19:55:03.725 INFO:teuthology.orchestra.run.smithi008.stdout: { 2023-08-01T19:55:03.725 INFO:teuthology.orchestra.run.smithi008.stdout: "event": "sub_op_commit_rec", 2023-08-01T19:55:03.725 INFO:teuthology.orchestra.run.smithi008.stdout: "time": "2023-08-01T19:54:52.224966+0000", 2023-08-01T19:55:03.725 INFO:teuthology.orchestra.run.smithi008.stdout: "duration": 0.0057594300000000003 2023-08-01T19:55:03.725 INFO:teuthology.orchestra.run.smithi008.stdout: }, 2023-08-01T19:55:03.725 INFO:teuthology.orchestra.run.smithi008.stdout: { 2023-08-01T19:55:03.725 INFO:teuthology.orchestra.run.smithi008.stdout: "event": "op_commit", 2023-08-01T19:55:03.726 INFO:teuthology.orchestra.run.smithi008.stdout: "time": "2023-08-01T19:54:52.234622+0000", 2023-08-01T19:55:03.726 INFO:teuthology.orchestra.run.smithi008.stdout: "duration": 0.0096563919999999998 2023-08-01T19:55:03.726 INFO:teuthology.orchestra.run.smithi008.stdout: }, 2023-08-01T19:55:03.726 INFO:teuthology.orchestra.run.smithi008.stdout: { 2023-08-01T19:55:03.726 INFO:teuthology.orchestra.run.smithi008.stdout: "event": "commit_sent", 2023-08-01T19:55:03.726 INFO:teuthology.orchestra.run.smithi008.stdout: "time": "2023-08-01T19:54:52.234674+0000", 2023-08-01T19:55:03.726 INFO:teuthology.orchestra.run.smithi008.stdout: "duration": 5.2212000000000001e-05 2023-08-01T19:55:03.727 INFO:teuthology.orchestra.run.smithi008.stdout: }, 2023-08-01T19:55:03.727 INFO:teuthology.orchestra.run.smithi008.stdout: { 2023-08-01T19:55:03.727 INFO:teuthology.orchestra.run.smithi008.stdout: "event": "done", 2023-08-01T19:55:03.727 INFO:teuthology.orchestra.run.smithi008.stdout: "time": "2023-08-01T19:54:52.234719+0000", 2023-08-01T19:55:03.727 INFO:teuthology.orchestra.run.smithi008.stdout: "duration": 4.4666000000000002e-05 2023-08-01T19:55:03.727 INFO:teuthology.orchestra.run.smithi008.stdout: } 2023-08-01T19:55:03.727 INFO:teuthology.orchestra.run.smithi008.stdout: ] 2023-08-01T19:55:03.727 INFO:teuthology.orchestra.run.smithi008.stdout: } 2023-08-01T19:55:03.728 INFO:teuthology.orchestra.run.smithi008.stdout: }, 2023-08-01T19:55:03.728 INFO:teuthology.orchestra.run.smithi008.stdout: { 2023-08-01T19:55:03.728 INFO:teuthology.orchestra.run.smithi008.stdout: "description": "osd_op(client.4668.0:75018 5.c 5:337cd9ad:::benchmark_data_smithi006_114134_object75017:head [set-alloc-hint object_size 65536 write_size 65536,write 0~65536] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e32)", 2023-08-01T19:55:03.728 INFO:teuthology.orchestra.run.smithi008.stdout: "initiated_at": "2023-08-01T19:54:52.219412+0000", 2023-08-01T19:55:03.728 INFO:teuthology.orchestra.run.smithi008.stdout: "age": 11.462925541000001, 2023-08-01T19:55:03.728 INFO:teuthology.orchestra.run.smithi008.stdout: "duration": 0.021247918000000001, 2023-08-01T19:55:03.728 INFO:teuthology.orchestra.run.smithi008.stdout: "type_data": { 2023-08-01T19:55:03.728 INFO:teuthology.orchestra.run.smithi008.stdout: "flag_point": "commit sent; apply or cleanup", 2023-08-01T19:55:03.729 INFO:teuthology.orchestra.run.smithi008.stdout: "client_info": { 2023-08-01T19:55:03.729 INFO:teuthology.orchestra.run.smithi008.stdout: "client": "client.4668", 2023-08-01T19:55:03.729 INFO:teuthology.orchestra.run.smithi008.stdout: "client_addr": "172.21.15.6:0/1709472247", 2023-08-01T19:55:03.729 INFO:teuthology.orchestra.run.smithi008.stdout: "tid": 75018 2023-08-01T19:55:03.729 INFO:teuthology.orchestra.run.smithi008.stdout: }, 2023-08-01T19:55:03.729 INFO:teuthology.orchestra.run.smithi008.stdout: "events": [ 2023-08-01T19:55:03.729 INFO:teuthology.orchestra.run.smithi008.stdout: { 2023-08-01T19:55:03.729 INFO:teuthology.orchestra.run.smithi008.stdout: "event": "initiated", 2023-08-01T19:55:03.730 INFO:teuthology.orchestra.run.smithi008.stdout: "time": "2023-08-01T19:54:52.219412+0000", 2023-08-01T19:55:03.730 INFO:teuthology.orchestra.run.smithi008.stdout: "duration": 0 2023-08-01T19:55:03.730 INFO:teuthology.orchestra.run.smithi008.stdout: }, 2023-08-01T19:55:03.730 INFO:teuthology.orchestra.run.smithi008.stdout: { 2023-08-01T19:55:03.730 INFO:teuthology.orchestra.run.smithi008.stdout: "event": "throttled", 2023-08-01T19:55:03.730 INFO:teuthology.orchestra.run.smithi008.stdout: "time": "2023-08-01T19:54:52.219412+0000", 2023-08-01T19:55:03.730 INFO:teuthology.orchestra.run.smithi008.stdout: "duration": 0 2023-08-01T19:55:03.730 INFO:teuthology.orchestra.run.smithi008.stdout: }, 2023-08-01T19:55:03.731 INFO:teuthology.orchestra.run.smithi008.stdout: { 2023-08-01T19:55:03.731 INFO:teuthology.orchestra.run.smithi008.stdout: "event": "header_read", 2023-08-01T19:55:03.731 INFO:teuthology.orchestra.run.smithi008.stdout: "time": "2023-08-01T19:54:52.219412+0000", 2023-08-01T19:55:03.731 INFO:teuthology.orchestra.run.smithi008.stdout: "duration": 4294967295.999999 2023-08-01T19:55:03.731 INFO:teuthology.orchestra.run.smithi008.stdout: }, 2023-08-01T19:55:03.731 INFO:teuthology.orchestra.run.smithi008.stdout: { 2023-08-01T19:55:03.731 INFO:teuthology.orchestra.run.smithi008.stdout: "event": "all_read", 2023-08-01T19:55:03.731 INFO:teuthology.orchestra.run.smithi008.stdout: "time": "2023-08-01T19:54:52.219529+0000", 2023-08-01T19:55:03.732 INFO:teuthology.orchestra.run.smithi008.stdout: "duration": 0.000117207 2023-08-01T19:55:03.732 INFO:teuthology.orchestra.run.smithi008.stdout: }, 2023-08-01T19:55:03.732 INFO:teuthology.orchestra.run.smithi008.stdout: { 2023-08-01T19:55:03.732 INFO:teuthology.orchestra.run.smithi008.stdout: "event": "dispatched", 2023-08-01T19:55:03.732 INFO:teuthology.orchestra.run.smithi008.stdout: "time": "2023-08-01T19:54:52.219541+0000", 2023-08-01T19:55:03.732 INFO:teuthology.orchestra.run.smithi008.stdout: "duration": 1.2448e-05 2023-08-01T19:55:03.732 INFO:teuthology.orchestra.run.smithi008.stdout: }, 2023-08-01T19:55:03.732 INFO:teuthology.orchestra.run.smithi008.stdout: { 2023-08-01T19:55:03.733 INFO:teuthology.orchestra.run.smithi008.stdout: "event": "queued_for_pg", 2023-08-01T19:55:03.733 INFO:teuthology.orchestra.run.smithi008.stdout: "time": "2023-08-01T19:54:52.219547+0000", 2023-08-01T19:55:03.733 INFO:teuthology.orchestra.run.smithi008.stdout: "duration": 5.7899999999999996e-06 2023-08-01T19:55:03.733 INFO:teuthology.orchestra.run.smithi008.stdout: }, 2023-08-01T19:55:03.733 INFO:teuthology.orchestra.run.smithi008.stdout: { 2023-08-01T19:55:03.733 INFO:teuthology.orchestra.run.smithi008.stdout: "event": "reached_pg", 2023-08-01T19:55:03.733 INFO:teuthology.orchestra.run.smithi008.stdout: "time": "2023-08-01T19:54:52.228949+0000", 2023-08-01T19:55:03.733 INFO:teuthology.orchestra.run.smithi008.stdout: "duration": 0.009401754 2023-08-01T19:55:03.734 INFO:teuthology.orchestra.run.smithi008.stdout: }, 2023-08-01T19:55:03.734 INFO:teuthology.orchestra.run.smithi008.stdout: { 2023-08-01T19:55:03.734 INFO:teuthology.orchestra.run.smithi008.stdout: "event": "started", 2023-08-01T19:55:03.734 INFO:teuthology.orchestra.run.smithi008.stdout: "time": "2023-08-01T19:54:52.229103+0000", 2023-08-01T19:55:03.734 INFO:teuthology.orchestra.run.smithi008.stdout: "duration": 0.00015462399999999999 2023-08-01T19:55:03.734 INFO:teuthology.orchestra.run.smithi008.stdout: }, 2023-08-01T19:55:03.734 INFO:teuthology.orchestra.run.smithi008.stdout: { 2023-08-01T19:55:03.735 INFO:teuthology.orchestra.run.smithi008.stdout: "event": "waiting for subops from 1", 2023-08-01T19:55:03.735 INFO:teuthology.orchestra.run.smithi008.stdout: "time": "2023-08-01T19:54:52.229261+0000", 2023-08-01T19:55:03.735 INFO:teuthology.orchestra.run.smithi008.stdout: "duration": 0.00015758300000000001 2023-08-01T19:55:03.735 INFO:teuthology.orchestra.run.smithi008.stdout: }, 2023-08-01T19:55:03.735 INFO:teuthology.orchestra.run.smithi008.stdout: { 2023-08-01T19:55:03.735 INFO:teuthology.orchestra.run.smithi008.stdout: "event": "sub_op_commit_rec", 2023-08-01T19:55:03.735 INFO:teuthology.orchestra.run.smithi008.stdout: "time": "2023-08-01T19:54:52.234395+0000", 2023-08-01T19:55:03.735 INFO:teuthology.orchestra.run.smithi008.stdout: "duration": 0.0051335080000000002 2023-08-01T19:55:03.736 INFO:teuthology.orchestra.run.smithi008.stdout: }, 2023-08-01T19:55:03.736 INFO:teuthology.orchestra.run.smithi008.stdout: { 2023-08-01T19:55:03.736 INFO:teuthology.orchestra.run.smithi008.stdout: "event": "op_commit", 2023-08-01T19:55:03.736 INFO:teuthology.orchestra.run.smithi008.stdout: "time": "2023-08-01T19:54:52.240575+0000", 2023-08-01T19:55:03.736 INFO:teuthology.orchestra.run.smithi008.stdout: "duration": 0.0061804099999999999 2023-08-01T19:55:03.736 INFO:teuthology.orchestra.run.smithi008.stdout: }, 2023-08-01T19:55:03.736 INFO:teuthology.orchestra.run.smithi008.stdout: { 2023-08-01T19:55:03.736 INFO:teuthology.orchestra.run.smithi008.stdout: "event": "commit_sent", 2023-08-01T19:55:03.737 INFO:teuthology.orchestra.run.smithi008.stdout: "time": "2023-08-01T19:54:52.240620+0000", 2023-08-01T19:55:03.737 INFO:teuthology.orchestra.run.smithi008.stdout: "duration": 4.4972999999999998e-05 2023-08-01T19:55:03.737 INFO:teuthology.orchestra.run.smithi008.stdout: }, 2023-08-01T19:55:03.737 INFO:teuthology.orchestra.run.smithi008.stdout: { 2023-08-01T19:55:03.737 INFO:teuthology.orchestra.run.smithi008.stdout: "event": "done", 2023-08-01T19:55:03.737 INFO:teuthology.orchestra.run.smithi008.stdout: "time": "2023-08-01T19:54:52.240660+0000", 2023-08-01T19:55:03.737 INFO:teuthology.orchestra.run.smithi008.stdout: "duration": 4.0348000000000001e-05 2023-08-01T19:55:03.738 INFO:teuthology.orchestra.run.smithi008.stdout: } 2023-08-01T19:55:03.738 INFO:teuthology.orchestra.run.smithi008.stdout: ] 2023-08-01T19:55:03.738 INFO:teuthology.orchestra.run.smithi008.stdout: } 2023-08-01T19:55:03.738 INFO:teuthology.orchestra.run.smithi008.stdout: }, 2023-08-01T19:55:03.738 INFO:teuthology.orchestra.run.smithi008.stdout: { 2023-08-01T19:55:03.738 INFO:teuthology.orchestra.run.smithi008.stdout: "description": "osd_repop(client.4668.0:75022 5.4 e32/19 5:20404e0b:::benchmark_data_smithi006_114134_object75021:head v 32'4630, mlcod=32'4627)", 2023-08-01T19:55:03.738 INFO:teuthology.orchestra.run.smithi008.stdout: "initiated_at": "2023-08-01T19:54:52.221931+0000", 2023-08-01T19:55:03.738 INFO:teuthology.orchestra.run.smithi008.stdout: "age": 11.460406452000001, 2023-08-01T19:55:03.739 INFO:teuthology.orchestra.run.smithi008.stdout: "duration": 0.018596688, 2023-08-01T19:55:03.739 INFO:teuthology.orchestra.run.smithi008.stdout: "type_data": { 2023-08-01T19:55:03.739 INFO:teuthology.orchestra.run.smithi008.stdout: "flag_point": "commit sent; apply or cleanup", 2023-08-01T19:55:03.739 INFO:teuthology.orchestra.run.smithi008.stdout: "events": [ 2023-08-01T19:55:03.739 INFO:teuthology.orchestra.run.smithi008.stdout: { 2023-08-01T19:55:03.739 INFO:teuthology.orchestra.run.smithi008.stdout: "event": "initiated", 2023-08-01T19:55:03.739 INFO:teuthology.orchestra.run.smithi008.stdout: "time": "2023-08-01T19:54:52.221931+0000", 2023-08-01T19:55:03.739 INFO:teuthology.orchestra.run.smithi008.stdout: "duration": 0 2023-08-01T19:55:03.740 INFO:teuthology.orchestra.run.smithi008.stdout: }, 2023-08-01T19:55:03.740 INFO:teuthology.orchestra.run.smithi008.stdout: { 2023-08-01T19:55:03.740 INFO:teuthology.orchestra.run.smithi008.stdout: "event": "throttled", 2023-08-01T19:55:03.740 INFO:teuthology.orchestra.run.smithi008.stdout: "time": "2023-08-01T19:54:52.221931+0000", 2023-08-01T19:55:03.740 INFO:teuthology.orchestra.run.smithi008.stdout: "duration": 0 2023-08-01T19:55:03.740 INFO:teuthology.orchestra.run.smithi008.stdout: }, 2023-08-01T19:55:03.740 INFO:teuthology.orchestra.run.smithi008.stdout: { 2023-08-01T19:55:03.741 INFO:teuthology.orchestra.run.smithi008.stdout: "event": "header_read", 2023-08-01T19:55:03.741 INFO:teuthology.orchestra.run.smithi008.stdout: "time": "2023-08-01T19:54:52.221931+0000", 2023-08-01T19:55:03.741 INFO:teuthology.orchestra.run.smithi008.stdout: "duration": 4294967295.9999995 2023-08-01T19:55:03.741 INFO:teuthology.orchestra.run.smithi008.stdout: }, 2023-08-01T19:55:03.741 INFO:teuthology.orchestra.run.smithi008.stdout: { 2023-08-01T19:55:03.741 INFO:teuthology.orchestra.run.smithi008.stdout: "event": "all_read", 2023-08-01T19:55:03.741 INFO:teuthology.orchestra.run.smithi008.stdout: "time": "2023-08-01T19:54:52.222002+0000", 2023-08-01T19:55:03.741 INFO:teuthology.orchestra.run.smithi008.stdout: "duration": 7.0870000000000004e-05 2023-08-01T19:55:03.742 INFO:teuthology.orchestra.run.smithi008.stdout: }, 2023-08-01T19:55:03.742 INFO:teuthology.orchestra.run.smithi008.stdout: { 2023-08-01T19:55:03.742 INFO:teuthology.orchestra.run.smithi008.stdout: "event": "dispatched", 2023-08-01T19:55:03.742 INFO:teuthology.orchestra.run.smithi008.stdout: "time": "2023-08-01T19:54:52.222015+0000", 2023-08-01T19:55:03.742 INFO:teuthology.orchestra.run.smithi008.stdout: "duration": 1.327e-05 2023-08-01T19:55:03.742 INFO:teuthology.orchestra.run.smithi008.stdout: }, 2023-08-01T19:55:03.742 INFO:teuthology.orchestra.run.smithi008.stdout: { 2023-08-01T19:55:03.742 INFO:teuthology.orchestra.run.smithi008.stdout: "event": "queued_for_pg", 2023-08-01T19:55:03.743 INFO:teuthology.orchestra.run.smithi008.stdout: "time": "2023-08-01T19:54:52.222022+0000", 2023-08-01T19:55:03.743 INFO:teuthology.orchestra.run.smithi008.stdout: "duration": 7.1729999999999998e-06 2023-08-01T19:55:03.743 INFO:teuthology.orchestra.run.smithi008.stdout: }, 2023-08-01T19:55:03.743 INFO:teuthology.orchestra.run.smithi008.stdout: { 2023-08-01T19:55:03.743 INFO:teuthology.orchestra.run.smithi008.stdout: "event": "reached_pg", 2023-08-01T19:55:03.743 INFO:teuthology.orchestra.run.smithi008.stdout: "time": "2023-08-01T19:54:52.224857+0000", 2023-08-01T19:55:03.743 INFO:teuthology.orchestra.run.smithi008.stdout: "duration": 0.0028351600000000002 2023-08-01T19:55:03.744 INFO:teuthology.orchestra.run.smithi008.stdout: }, 2023-08-01T19:55:03.744 INFO:teuthology.orchestra.run.smithi008.stdout: { 2023-08-01T19:55:03.744 INFO:teuthology.orchestra.run.smithi008.stdout: "event": "started", 2023-08-01T19:55:03.744 INFO:teuthology.orchestra.run.smithi008.stdout: "time": "2023-08-01T19:54:52.224877+0000", 2023-08-01T19:55:03.744 INFO:teuthology.orchestra.run.smithi008.stdout: "duration": 1.9839000000000001e-05 2023-08-01T19:55:03.744 INFO:teuthology.orchestra.run.smithi008.stdout: }, 2023-08-01T19:55:03.744 INFO:teuthology.orchestra.run.smithi008.stdout: { 2023-08-01T19:55:03.744 INFO:teuthology.orchestra.run.smithi008.stdout: "event": "commit_sent", 2023-08-01T19:55:03.745 INFO:teuthology.orchestra.run.smithi008.stdout: "time": "2023-08-01T19:54:52.240497+0000", 2023-08-01T19:55:03.745 INFO:teuthology.orchestra.run.smithi008.stdout: "duration": 0.015619928 2023-08-01T19:55:03.745 INFO:teuthology.orchestra.run.smithi008.stdout: }, 2023-08-01T19:55:03.745 INFO:teuthology.orchestra.run.smithi008.stdout: { 2023-08-01T19:55:03.745 INFO:teuthology.orchestra.run.smithi008.stdout: "event": "done", 2023-08-01T19:55:03.745 INFO:teuthology.orchestra.run.smithi008.stdout: "time": "2023-08-01T19:54:52.240528+0000", 2023-08-01T19:55:03.745 INFO:teuthology.orchestra.run.smithi008.stdout: "duration": 3.1029999999999999e-05 2023-08-01T19:55:03.745 INFO:teuthology.orchestra.run.smithi008.stdout: } 2023-08-01T19:55:03.746 INFO:teuthology.orchestra.run.smithi008.stdout: ] 2023-08-01T19:55:03.746 INFO:teuthology.orchestra.run.smithi008.stdout: } 2023-08-01T19:55:03.746 INFO:teuthology.orchestra.run.smithi008.stdout: }, 2023-08-01T19:55:03.746 INFO:teuthology.orchestra.run.smithi008.stdout: { 2023-08-01T19:55:03.746 INFO:teuthology.orchestra.run.smithi008.stdout: "description": "osd_repop(client.4668.0:75023 5.4 e32/19 5:2ff1db38:::benchmark_data_smithi006_114134_object75022:head v 32'4631, mlcod=32'4627)", 2023-08-01T19:55:03.746 INFO:teuthology.orchestra.run.smithi008.stdout: "initiated_at": "2023-08-01T19:54:52.223928+0000", 2023-08-01T19:55:03.746 INFO:teuthology.orchestra.run.smithi008.stdout: "age": 11.458409869, 2023-08-01T19:55:03.746 INFO:teuthology.orchestra.run.smithi008.stdout: "duration": 0.016622168999999999, 2023-08-01T19:55:03.747 INFO:teuthology.orchestra.run.smithi008.stdout: "type_data": { 2023-08-01T19:55:03.747 INFO:teuthology.orchestra.run.smithi008.stdout: "flag_point": "commit sent; apply or cleanup", 2023-08-01T19:55:03.747 INFO:teuthology.orchestra.run.smithi008.stdout: "events": [ 2023-08-01T19:55:03.747 INFO:teuthology.orchestra.run.smithi008.stdout: { 2023-08-01T19:55:03.747 INFO:teuthology.orchestra.run.smithi008.stdout: "event": "initiated", 2023-08-01T19:55:03.747 INFO:teuthology.orchestra.run.smithi008.stdout: "time": "2023-08-01T19:54:52.223928+0000", 2023-08-01T19:55:03.747 INFO:teuthology.orchestra.run.smithi008.stdout: "duration": 0 2023-08-01T19:55:03.747 INFO:teuthology.orchestra.run.smithi008.stdout: }, 2023-08-01T19:55:03.748 INFO:teuthology.orchestra.run.smithi008.stdout: { 2023-08-01T19:55:03.748 INFO:teuthology.orchestra.run.smithi008.stdout: "event": "throttled", 2023-08-01T19:55:03.748 INFO:teuthology.orchestra.run.smithi008.stdout: "time": "2023-08-01T19:54:52.223928+0000", 2023-08-01T19:55:03.748 INFO:teuthology.orchestra.run.smithi008.stdout: "duration": 0 2023-08-01T19:55:03.748 INFO:teuthology.orchestra.run.smithi008.stdout: }, 2023-08-01T19:55:03.748 INFO:teuthology.orchestra.run.smithi008.stdout: { 2023-08-01T19:55:03.748 INFO:teuthology.orchestra.run.smithi008.stdout: "event": "header_read", 2023-08-01T19:55:03.749 INFO:teuthology.orchestra.run.smithi008.stdout: "time": "2023-08-01T19:54:52.223928+0000", 2023-08-01T19:55:03.749 INFO:teuthology.orchestra.run.smithi008.stdout: "duration": 4294967296 2023-08-01T19:55:03.749 INFO:teuthology.orchestra.run.smithi008.stdout: }, 2023-08-01T19:55:03.749 INFO:teuthology.orchestra.run.smithi008.stdout: { 2023-08-01T19:55:03.749 INFO:teuthology.orchestra.run.smithi008.stdout: "event": "all_read", 2023-08-01T19:55:03.749 INFO:teuthology.orchestra.run.smithi008.stdout: "time": "2023-08-01T19:54:52.223952+0000", 2023-08-01T19:55:03.749 INFO:teuthology.orchestra.run.smithi008.stdout: "duration": 2.4238000000000001e-05 2023-08-01T19:55:03.749 INFO:teuthology.orchestra.run.smithi008.stdout: }, 2023-08-01T19:55:03.750 INFO:teuthology.orchestra.run.smithi008.stdout: { 2023-08-01T19:55:03.750 INFO:teuthology.orchestra.run.smithi008.stdout: "event": "dispatched", 2023-08-01T19:55:03.750 INFO:teuthology.orchestra.run.smithi008.stdout: "time": "2023-08-01T19:54:52.223958+0000", 2023-08-01T19:55:03.750 INFO:teuthology.orchestra.run.smithi008.stdout: "duration": 6.1589999999999998e-06 2023-08-01T19:55:03.750 INFO:teuthology.orchestra.run.smithi008.stdout: }, 2023-08-01T19:55:03.750 INFO:teuthology.orchestra.run.smithi008.stdout: { 2023-08-01T19:55:03.750 INFO:teuthology.orchestra.run.smithi008.stdout: "event": "queued_for_pg", 2023-08-01T19:55:03.750 INFO:teuthology.orchestra.run.smithi008.stdout: "time": "2023-08-01T19:54:52.223962+0000", 2023-08-01T19:55:03.751 INFO:teuthology.orchestra.run.smithi008.stdout: "duration": 3.523e-06 2023-08-01T19:55:03.751 INFO:teuthology.orchestra.run.smithi008.stdout: }, 2023-08-01T19:55:03.751 INFO:teuthology.orchestra.run.smithi008.stdout: { 2023-08-01T19:55:03.751 INFO:teuthology.orchestra.run.smithi008.stdout: "event": "reached_pg", 2023-08-01T19:55:03.751 INFO:teuthology.orchestra.run.smithi008.stdout: "time": "2023-08-01T19:54:52.226856+0000", 2023-08-01T19:55:03.751 INFO:teuthology.orchestra.run.smithi008.stdout: "duration": 0.0028944130000000002 2023-08-01T19:55:03.751 INFO:teuthology.orchestra.run.smithi008.stdout: }, 2023-08-01T19:55:03.751 INFO:teuthology.orchestra.run.smithi008.stdout: { 2023-08-01T19:55:03.752 INFO:teuthology.orchestra.run.smithi008.stdout: "event": "started", 2023-08-01T19:55:03.752 INFO:teuthology.orchestra.run.smithi008.stdout: "time": "2023-08-01T19:54:52.226872+0000", 2023-08-01T19:55:03.752 INFO:teuthology.orchestra.run.smithi008.stdout: "duration": 1.6155e-05 2023-08-01T19:55:03.752 INFO:teuthology.orchestra.run.smithi008.stdout: }, 2023-08-01T19:55:03.752 INFO:teuthology.orchestra.run.smithi008.stdout: { 2023-08-01T19:55:03.752 INFO:teuthology.orchestra.run.smithi008.stdout: "event": "commit_sent", 2023-08-01T19:55:03.752 INFO:teuthology.orchestra.run.smithi008.stdout: "time": "2023-08-01T19:54:52.240533+0000", 2023-08-01T19:55:03.752 INFO:teuthology.orchestra.run.smithi008.stdout: "duration": 0.013660736999999999 2023-08-01T19:55:03.753 INFO:teuthology.orchestra.run.smithi008.stdout: }, 2023-08-01T19:55:03.753 INFO:teuthology.orchestra.run.smithi008.stdout: { 2023-08-01T19:55:03.753 INFO:teuthology.orchestra.run.smithi008.stdout: "event": "done", 2023-08-01T19:55:03.753 INFO:teuthology.orchestra.run.smithi008.stdout: "time": "2023-08-01T19:54:52.240550+0000", 2023-08-01T19:55:03.753 INFO:teuthology.orchestra.run.smithi008.stdout: "duration": 1.7180000000000002e-05 2023-08-01T19:55:03.753 INFO:teuthology.orchestra.run.smithi008.stdout: } 2023-08-01T19:55:03.753 INFO:teuthology.orchestra.run.smithi008.stdout: ] 2023-08-01T19:55:03.754 INFO:teuthology.orchestra.run.smithi008.stdout: } 2023-08-01T19:55:03.754 INFO:teuthology.orchestra.run.smithi008.stdout: }, 2023-08-01T19:55:03.754 INFO:teuthology.orchestra.run.smithi008.stdout: { 2023-08-01T19:55:03.754 INFO:teuthology.orchestra.run.smithi008.stdout: "description": "osd_op(client.4668.0:75029 5.c 5:38b666aa:::benchmark_data_smithi006_114134_object75028:head [set-alloc-hint object_size 65536 write_size 65536,write 0~65536] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e32)", 2023-08-01T19:55:03.754 INFO:teuthology.orchestra.run.smithi008.stdout: "initiated_at": "2023-08-01T19:54:52.224968+0000", 2023-08-01T19:55:03.754 INFO:teuthology.orchestra.run.smithi008.stdout: "age": 11.457369487999999, 2023-08-01T19:55:03.754 INFO:teuthology.orchestra.run.smithi008.stdout: "duration": 0.015765280999999999, 2023-08-01T19:55:03.754 INFO:teuthology.orchestra.run.smithi008.stdout: "type_data": { 2023-08-01T19:55:03.755 INFO:teuthology.orchestra.run.smithi008.stdout: "flag_point": "commit sent; apply or cleanup", 2023-08-01T19:55:03.755 INFO:teuthology.orchestra.run.smithi008.stdout: "client_info": { 2023-08-01T19:55:03.755 INFO:teuthology.orchestra.run.smithi008.stdout: "client": "client.4668", 2023-08-01T19:55:03.755 INFO:teuthology.orchestra.run.smithi008.stdout: "client_addr": "172.21.15.6:0/1709472247", 2023-08-01T19:55:03.755 INFO:teuthology.orchestra.run.smithi008.stdout: "tid": 75029 2023-08-01T19:55:03.755 INFO:teuthology.orchestra.run.smithi008.stdout: }, 2023-08-01T19:55:03.755 INFO:teuthology.orchestra.run.smithi008.stdout: "events": [ 2023-08-01T19:55:03.756 INFO:teuthology.orchestra.run.smithi008.stdout: { 2023-08-01T19:55:03.756 INFO:teuthology.orchestra.run.smithi008.stdout: "event": "initiated", 2023-08-01T19:55:03.756 INFO:teuthology.orchestra.run.smithi008.stdout: "time": "2023-08-01T19:54:52.224968+0000", 2023-08-01T19:55:03.756 INFO:teuthology.orchestra.run.smithi008.stdout: "duration": 0 2023-08-01T19:55:03.756 INFO:teuthology.orchestra.run.smithi008.stdout: }, 2023-08-01T19:55:03.756 INFO:teuthology.orchestra.run.smithi008.stdout: { 2023-08-01T19:55:03.756 INFO:teuthology.orchestra.run.smithi008.stdout: "event": "throttled", 2023-08-01T19:55:03.756 INFO:teuthology.orchestra.run.smithi008.stdout: "time": "2023-08-01T19:54:52.224968+0000", 2023-08-01T19:55:03.757 INFO:teuthology.orchestra.run.smithi008.stdout: "duration": 0 2023-08-01T19:55:03.757 INFO:teuthology.orchestra.run.smithi008.stdout: }, 2023-08-01T19:55:03.757 INFO:teuthology.orchestra.run.smithi008.stdout: { 2023-08-01T19:55:03.757 INFO:teuthology.orchestra.run.smithi008.stdout: "event": "header_read", 2023-08-01T19:55:03.757 INFO:teuthology.orchestra.run.smithi008.stdout: "time": "2023-08-01T19:54:52.224967+0000", 2023-08-01T19:55:03.757 INFO:teuthology.orchestra.run.smithi008.stdout: "duration": 4294967295.999999 2023-08-01T19:55:03.757 INFO:teuthology.orchestra.run.smithi008.stdout: }, 2023-08-01T19:55:03.757 INFO:teuthology.orchestra.run.smithi008.stdout: { 2023-08-01T19:55:03.758 INFO:teuthology.orchestra.run.smithi008.stdout: "event": "all_read", 2023-08-01T19:55:03.758 INFO:teuthology.orchestra.run.smithi008.stdout: "time": "2023-08-01T19:54:52.225054+0000", 2023-08-01T19:55:03.758 INFO:teuthology.orchestra.run.smithi008.stdout: "duration": 8.6403000000000006e-05 2023-08-01T19:55:03.758 INFO:teuthology.orchestra.run.smithi008.stdout: }, 2023-08-01T19:55:03.758 INFO:teuthology.orchestra.run.smithi008.stdout: { 2023-08-01T19:55:03.758 INFO:teuthology.orchestra.run.smithi008.stdout: "event": "dispatched", 2023-08-01T19:55:03.758 INFO:teuthology.orchestra.run.smithi008.stdout: "time": "2023-08-01T19:54:52.225064+0000", 2023-08-01T19:55:03.758 INFO:teuthology.orchestra.run.smithi008.stdout: "duration": 1.0018e-05 2023-08-01T19:55:03.759 INFO:teuthology.orchestra.run.smithi008.stdout: }, 2023-08-01T19:55:03.759 INFO:teuthology.orchestra.run.smithi008.stdout: { 2023-08-01T19:55:03.759 INFO:teuthology.orchestra.run.smithi008.stdout: "event": "queued_for_pg", 2023-08-01T19:55:03.759 INFO:teuthology.orchestra.run.smithi008.stdout: "time": "2023-08-01T19:54:52.225069+0000", 2023-08-01T19:55:03.759 INFO:teuthology.orchestra.run.smithi008.stdout: "duration": 5.0409999999999997e-06 2023-08-01T19:55:03.759 INFO:teuthology.orchestra.run.smithi008.stdout: }, 2023-08-01T19:55:03.759 INFO:teuthology.orchestra.run.smithi008.stdout: { 2023-08-01T19:55:03.760 INFO:teuthology.orchestra.run.smithi008.stdout: "event": "reached_pg", 2023-08-01T19:55:03.760 INFO:teuthology.orchestra.run.smithi008.stdout: "time": "2023-08-01T19:54:52.231919+0000", 2023-08-01T19:55:03.760 INFO:teuthology.orchestra.run.smithi008.stdout: "duration": 0.006849623 2023-08-01T19:55:03.760 INFO:teuthology.orchestra.run.smithi008.stdout: }, 2023-08-01T19:55:03.760 INFO:teuthology.orchestra.run.smithi008.stdout: { 2023-08-01T19:55:03.760 INFO:teuthology.orchestra.run.smithi008.stdout: "event": "started", 2023-08-01T19:55:03.760 INFO:teuthology.orchestra.run.smithi008.stdout: "time": "2023-08-01T19:54:52.232118+0000", 2023-08-01T19:55:03.760 INFO:teuthology.orchestra.run.smithi008.stdout: "duration": 0.00019987100000000001 2023-08-01T19:55:03.761 INFO:teuthology.orchestra.run.smithi008.stdout: }, 2023-08-01T19:55:03.761 INFO:teuthology.orchestra.run.smithi008.stdout: { 2023-08-01T19:55:03.761 INFO:teuthology.orchestra.run.smithi008.stdout: "event": "waiting for subops from 1", 2023-08-01T19:55:03.761 INFO:teuthology.orchestra.run.smithi008.stdout: "time": "2023-08-01T19:54:52.232350+0000", 2023-08-01T19:55:03.761 INFO:teuthology.orchestra.run.smithi008.stdout: "duration": 0.00023154299999999999 2023-08-01T19:55:03.761 INFO:teuthology.orchestra.run.smithi008.stdout: }, 2023-08-01T19:55:03.761 INFO:teuthology.orchestra.run.smithi008.stdout: { 2023-08-01T19:55:03.761 INFO:teuthology.orchestra.run.smithi008.stdout: "event": "sub_op_commit_rec", 2023-08-01T19:55:03.762 INFO:teuthology.orchestra.run.smithi008.stdout: "time": "2023-08-01T19:54:52.234979+0000", 2023-08-01T19:55:03.762 INFO:teuthology.orchestra.run.smithi008.stdout: "duration": 0.002629485 2023-08-01T19:55:03.762 INFO:teuthology.orchestra.run.smithi008.stdout: }, 2023-08-01T19:55:03.762 INFO:teuthology.orchestra.run.smithi008.stdout: { 2023-08-01T19:55:03.762 INFO:teuthology.orchestra.run.smithi008.stdout: "event": "op_commit", 2023-08-01T19:55:03.762 INFO:teuthology.orchestra.run.smithi008.stdout: "time": "2023-08-01T19:54:52.240667+0000", 2023-08-01T19:55:03.762 INFO:teuthology.orchestra.run.smithi008.stdout: "duration": 0.0056880869999999997 2023-08-01T19:55:03.762 INFO:teuthology.orchestra.run.smithi008.stdout: }, 2023-08-01T19:55:03.763 INFO:teuthology.orchestra.run.smithi008.stdout: { 2023-08-01T19:55:03.763 INFO:teuthology.orchestra.run.smithi008.stdout: "event": "commit_sent", 2023-08-01T19:55:03.763 INFO:teuthology.orchestra.run.smithi008.stdout: "time": "2023-08-01T19:54:52.240705+0000", 2023-08-01T19:55:03.763 INFO:teuthology.orchestra.run.smithi008.stdout: "duration": 3.7302000000000003e-05 2023-08-01T19:55:03.763 INFO:teuthology.orchestra.run.smithi008.stdout: }, 2023-08-01T19:55:03.763 INFO:teuthology.orchestra.run.smithi008.stdout: { 2023-08-01T19:55:03.763 INFO:teuthology.orchestra.run.smithi008.stdout: "event": "done", 2023-08-01T19:55:03.764 INFO:teuthology.orchestra.run.smithi008.stdout: "time": "2023-08-01T19:54:52.240734+0000", 2023-08-01T19:55:03.764 INFO:teuthology.orchestra.run.smithi008.stdout: "duration": 2.8887e-05 2023-08-01T19:55:03.764 INFO:teuthology.orchestra.run.smithi008.stdout: } 2023-08-01T19:55:03.764 INFO:teuthology.orchestra.run.smithi008.stdout: ] 2023-08-01T19:55:03.764 INFO:teuthology.orchestra.run.smithi008.stdout: } 2023-08-01T19:55:03.764 INFO:teuthology.orchestra.run.smithi008.stdout: }, 2023-08-01T19:55:03.764 INFO:teuthology.orchestra.run.smithi008.stdout: { 2023-08-01T19:55:03.764 INFO:teuthology.orchestra.run.smithi008.stdout: "description": "osd_op(client.4668.0:75065 5.6 5:6205fb02:::benchmark_data_smithi006_114134_object75064:head [set-alloc-hint object_size 65536 write_size 65536,write 0~65536] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e32)", 2023-08-01T19:55:03.765 INFO:teuthology.orchestra.run.smithi008.stdout: "initiated_at": "2023-08-01T19:54:52.250401+0000", 2023-08-01T19:55:03.765 INFO:teuthology.orchestra.run.smithi008.stdout: "age": 11.431937208000001, 2023-08-01T19:55:03.765 INFO:teuthology.orchestra.run.smithi008.stdout: "duration": 0.01559367, 2023-08-01T19:55:03.765 INFO:teuthology.orchestra.run.smithi008.stdout: "type_data": { 2023-08-01T19:55:03.765 INFO:teuthology.orchestra.run.smithi008.stdout: "flag_point": "commit sent; apply or cleanup", 2023-08-01T19:55:03.765 INFO:teuthology.orchestra.run.smithi008.stdout: "client_info": { 2023-08-01T19:55:03.765 INFO:teuthology.orchestra.run.smithi008.stdout: "client": "client.4668", 2023-08-01T19:55:03.765 INFO:teuthology.orchestra.run.smithi008.stdout: "client_addr": "172.21.15.6:0/1709472247", 2023-08-01T19:55:03.766 INFO:teuthology.orchestra.run.smithi008.stdout: "tid": 75065 2023-08-01T19:55:03.766 INFO:teuthology.orchestra.run.smithi008.stdout: }, 2023-08-01T19:55:03.766 INFO:teuthology.orchestra.run.smithi008.stdout: "events": [ 2023-08-01T19:55:03.766 INFO:teuthology.orchestra.run.smithi008.stdout: { 2023-08-01T19:55:03.766 INFO:teuthology.orchestra.run.smithi008.stdout: "event": "initiated", 2023-08-01T19:55:03.766 INFO:teuthology.orchestra.run.smithi008.stdout: "time": "2023-08-01T19:54:52.250401+0000", 2023-08-01T19:55:03.766 INFO:teuthology.orchestra.run.smithi008.stdout: "duration": 0 2023-08-01T19:55:03.766 INFO:teuthology.orchestra.run.smithi008.stdout: }, 2023-08-01T19:55:03.767 INFO:teuthology.orchestra.run.smithi008.stdout: { 2023-08-01T19:55:03.767 INFO:teuthology.orchestra.run.smithi008.stdout: "event": "throttled", 2023-08-01T19:55:03.767 INFO:teuthology.orchestra.run.smithi008.stdout: "time": "2023-08-01T19:54:52.250401+0000", 2023-08-01T19:55:03.767 INFO:teuthology.orchestra.run.smithi008.stdout: "duration": 0 2023-08-01T19:55:03.767 INFO:teuthology.orchestra.run.smithi008.stdout: }, 2023-08-01T19:55:03.767 INFO:teuthology.orchestra.run.smithi008.stdout: { 2023-08-01T19:55:03.767 INFO:teuthology.orchestra.run.smithi008.stdout: "event": "header_read", 2023-08-01T19:55:03.767 INFO:teuthology.orchestra.run.smithi008.stdout: "time": "2023-08-01T19:54:52.250399+0000", 2023-08-01T19:55:03.768 INFO:teuthology.orchestra.run.smithi008.stdout: "duration": 4294967295.9999986 2023-08-01T19:55:03.768 INFO:teuthology.orchestra.run.smithi008.stdout: }, 2023-08-01T19:55:03.768 INFO:teuthology.orchestra.run.smithi008.stdout: { 2023-08-01T19:55:03.768 INFO:teuthology.orchestra.run.smithi008.stdout: "event": "all_read", 2023-08-01T19:55:03.768 INFO:teuthology.orchestra.run.smithi008.stdout: "time": "2023-08-01T19:54:52.250446+0000", 2023-08-01T19:55:03.768 INFO:teuthology.orchestra.run.smithi008.stdout: "duration": 4.6499999999999999e-05 2023-08-01T19:55:03.768 INFO:teuthology.orchestra.run.smithi008.stdout: }, 2023-08-01T19:55:03.769 INFO:teuthology.orchestra.run.smithi008.stdout: { 2023-08-01T19:55:03.769 INFO:teuthology.orchestra.run.smithi008.stdout: "event": "dispatched", 2023-08-01T19:55:03.769 INFO:teuthology.orchestra.run.smithi008.stdout: "time": "2023-08-01T19:54:52.250458+0000", 2023-08-01T19:55:03.769 INFO:teuthology.orchestra.run.smithi008.stdout: "duration": 1.1933000000000001e-05 2023-08-01T19:55:03.769 INFO:teuthology.orchestra.run.smithi008.stdout: }, 2023-08-01T19:55:03.769 INFO:teuthology.orchestra.run.smithi008.stdout: { 2023-08-01T19:55:03.769 INFO:teuthology.orchestra.run.smithi008.stdout: "event": "queued_for_pg", 2023-08-01T19:55:03.769 INFO:teuthology.orchestra.run.smithi008.stdout: "time": "2023-08-01T19:54:52.250464+0000", 2023-08-01T19:55:03.770 INFO:teuthology.orchestra.run.smithi008.stdout: "duration": 6.8140000000000003e-06 2023-08-01T19:55:03.770 INFO:teuthology.orchestra.run.smithi008.stdout: }, 2023-08-01T19:55:03.770 INFO:teuthology.orchestra.run.smithi008.stdout: { 2023-08-01T19:55:03.770 INFO:teuthology.orchestra.run.smithi008.stdout: "event": "reached_pg", 2023-08-01T19:55:03.770 INFO:teuthology.orchestra.run.smithi008.stdout: "time": "2023-08-01T19:54:52.251070+0000", 2023-08-01T19:55:03.770 INFO:teuthology.orchestra.run.smithi008.stdout: "duration": 0.00060562500000000004 2023-08-01T19:55:03.770 INFO:teuthology.orchestra.run.smithi008.stdout: }, 2023-08-01T19:55:03.770 INFO:teuthology.orchestra.run.smithi008.stdout: { 2023-08-01T19:55:03.771 INFO:teuthology.orchestra.run.smithi008.stdout: "event": "started", 2023-08-01T19:55:03.771 INFO:teuthology.orchestra.run.smithi008.stdout: "time": "2023-08-01T19:54:52.251270+0000", 2023-08-01T19:55:03.771 INFO:teuthology.orchestra.run.smithi008.stdout: "duration": 0.00020012200000000001 2023-08-01T19:55:03.771 INFO:teuthology.orchestra.run.smithi008.stdout: }, 2023-08-01T19:55:03.771 INFO:teuthology.orchestra.run.smithi008.stdout: { 2023-08-01T19:55:03.771 INFO:teuthology.orchestra.run.smithi008.stdout: "event": "waiting for subops from 1", 2023-08-01T19:55:03.771 INFO:teuthology.orchestra.run.smithi008.stdout: "time": "2023-08-01T19:54:52.251448+0000", 2023-08-01T19:55:03.771 INFO:teuthology.orchestra.run.smithi008.stdout: "duration": 0.000177918 2023-08-01T19:55:03.772 INFO:teuthology.orchestra.run.smithi008.stdout: }, 2023-08-01T19:55:03.772 INFO:teuthology.orchestra.run.smithi008.stdout: { 2023-08-01T19:55:03.772 INFO:teuthology.orchestra.run.smithi008.stdout: "event": "sub_op_commit_rec", 2023-08-01T19:55:03.772 INFO:teuthology.orchestra.run.smithi008.stdout: "time": "2023-08-01T19:54:52.257590+0000", 2023-08-01T19:55:03.772 INFO:teuthology.orchestra.run.smithi008.stdout: "duration": 0.0061422450000000002 2023-08-01T19:55:03.772 INFO:teuthology.orchestra.run.smithi008.stdout: }, 2023-08-01T19:55:03.772 INFO:teuthology.orchestra.run.smithi008.stdout: { 2023-08-01T19:55:03.772 INFO:teuthology.orchestra.run.smithi008.stdout: "event": "op_commit", 2023-08-01T19:55:03.773 INFO:teuthology.orchestra.run.smithi008.stdout: "time": "2023-08-01T19:54:52.265910+0000", 2023-08-01T19:55:03.773 INFO:teuthology.orchestra.run.smithi008.stdout: "duration": 0.0083197649999999998 2023-08-01T19:55:03.773 INFO:teuthology.orchestra.run.smithi008.stdout: }, 2023-08-01T19:55:03.773 INFO:teuthology.orchestra.run.smithi008.stdout: { 2023-08-01T19:55:03.773 INFO:teuthology.orchestra.run.smithi008.stdout: "event": "commit_sent", 2023-08-01T19:55:03.773 INFO:teuthology.orchestra.run.smithi008.stdout: "time": "2023-08-01T19:54:52.265958+0000", 2023-08-01T19:55:03.773 INFO:teuthology.orchestra.run.smithi008.stdout: "duration": 4.7559999999999999e-05 2023-08-01T19:55:03.773 INFO:teuthology.orchestra.run.smithi008.stdout: }, 2023-08-01T19:55:03.774 INFO:teuthology.orchestra.run.smithi008.stdout: { 2023-08-01T19:55:03.774 INFO:teuthology.orchestra.run.smithi008.stdout: "event": "done", 2023-08-01T19:55:03.774 INFO:teuthology.orchestra.run.smithi008.stdout: "time": "2023-08-01T19:54:52.265994+0000", 2023-08-01T19:55:03.774 INFO:teuthology.orchestra.run.smithi008.stdout: "duration": 3.6628999999999998e-05 2023-08-01T19:55:03.774 INFO:teuthology.orchestra.run.smithi008.stdout: } 2023-08-01T19:55:03.774 INFO:teuthology.orchestra.run.smithi008.stdout: ] 2023-08-01T19:55:03.774 INFO:teuthology.orchestra.run.smithi008.stdout: } 2023-08-01T19:55:03.774 INFO:teuthology.orchestra.run.smithi008.stdout: }, 2023-08-01T19:55:03.775 INFO:teuthology.orchestra.run.smithi008.stdout: { 2023-08-01T19:55:03.775 INFO:teuthology.orchestra.run.smithi008.stdout: "description": "osd_op(client.4668.0:80520 5.5 5:ab281506:::benchmark_data_smithi006_114134_object80519:head [set-alloc-hint object_size 65536 write_size 65536,write 0~65536] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e34)", 2023-08-01T19:55:03.775 INFO:teuthology.orchestra.run.smithi008.stdout: "initiated_at": "2023-08-01T19:54:55.064206+0000", 2023-08-01T19:55:03.775 INFO:teuthology.orchestra.run.smithi008.stdout: "age": 8.6181323130000003, 2023-08-01T19:55:03.775 INFO:teuthology.orchestra.run.smithi008.stdout: "duration": 0.016529129, 2023-08-01T19:55:03.775 INFO:teuthology.orchestra.run.smithi008.stdout: "type_data": { 2023-08-01T19:55:03.775 INFO:teuthology.orchestra.run.smithi008.stdout: "flag_point": "commit sent; apply or cleanup", 2023-08-01T19:55:03.776 INFO:teuthology.orchestra.run.smithi008.stdout: "client_info": { 2023-08-01T19:55:03.776 INFO:teuthology.orchestra.run.smithi008.stdout: "client": "client.4668", 2023-08-01T19:55:03.776 INFO:teuthology.orchestra.run.smithi008.stdout: "client_addr": "172.21.15.6:0/1709472247", 2023-08-01T19:55:03.776 INFO:teuthology.orchestra.run.smithi008.stdout: "tid": 80520 2023-08-01T19:55:03.776 INFO:teuthology.orchestra.run.smithi008.stdout: }, 2023-08-01T19:55:03.776 INFO:teuthology.orchestra.run.smithi008.stdout: "events": [ 2023-08-01T19:55:03.776 INFO:teuthology.orchestra.run.smithi008.stdout: { 2023-08-01T19:55:03.776 INFO:teuthology.orchestra.run.smithi008.stdout: "event": "initiated", 2023-08-01T19:55:03.777 INFO:teuthology.orchestra.run.smithi008.stdout: "time": "2023-08-01T19:54:55.064206+0000", 2023-08-01T19:55:03.777 INFO:teuthology.orchestra.run.smithi008.stdout: "duration": 0 2023-08-01T19:55:03.777 INFO:teuthology.orchestra.run.smithi008.stdout: }, 2023-08-01T19:55:03.777 INFO:teuthology.orchestra.run.smithi008.stdout: { 2023-08-01T19:55:03.777 INFO:teuthology.orchestra.run.smithi008.stdout: "event": "throttled", 2023-08-01T19:55:03.777 INFO:teuthology.orchestra.run.smithi008.stdout: "time": "2023-08-01T19:54:55.064206+0000", 2023-08-01T19:55:03.777 INFO:teuthology.orchestra.run.smithi008.stdout: "duration": 0 2023-08-01T19:55:03.778 INFO:teuthology.orchestra.run.smithi008.stdout: }, 2023-08-01T19:55:03.778 INFO:teuthology.orchestra.run.smithi008.stdout: { 2023-08-01T19:55:03.778 INFO:teuthology.orchestra.run.smithi008.stdout: "event": "header_read", 2023-08-01T19:55:03.778 INFO:teuthology.orchestra.run.smithi008.stdout: "time": "2023-08-01T19:54:55.064205+0000", 2023-08-01T19:55:03.778 INFO:teuthology.orchestra.run.smithi008.stdout: "duration": 4294967295.999999 2023-08-01T19:55:03.778 INFO:teuthology.orchestra.run.smithi008.stdout: }, 2023-08-01T19:55:03.778 INFO:teuthology.orchestra.run.smithi008.stdout: { 2023-08-01T19:55:03.778 INFO:teuthology.orchestra.run.smithi008.stdout: "event": "all_read", 2023-08-01T19:55:03.779 INFO:teuthology.orchestra.run.smithi008.stdout: "time": "2023-08-01T19:54:55.064295+0000", 2023-08-01T19:55:03.779 INFO:teuthology.orchestra.run.smithi008.stdout: "duration": 9.0132999999999999e-05 2023-08-01T19:55:03.779 INFO:teuthology.orchestra.run.smithi008.stdout: }, 2023-08-01T19:55:03.779 INFO:teuthology.orchestra.run.smithi008.stdout: { 2023-08-01T19:55:03.779 INFO:teuthology.orchestra.run.smithi008.stdout: "event": "dispatched", 2023-08-01T19:55:03.779 INFO:teuthology.orchestra.run.smithi008.stdout: "time": "2023-08-01T19:54:55.064306+0000", 2023-08-01T19:55:03.779 INFO:teuthology.orchestra.run.smithi008.stdout: "duration": 1.0824e-05 2023-08-01T19:55:03.779 INFO:teuthology.orchestra.run.smithi008.stdout: }, 2023-08-01T19:55:03.780 INFO:teuthology.orchestra.run.smithi008.stdout: { 2023-08-01T19:55:03.780 INFO:teuthology.orchestra.run.smithi008.stdout: "event": "queued_for_pg", 2023-08-01T19:55:03.780 INFO:teuthology.orchestra.run.smithi008.stdout: "time": "2023-08-01T19:54:55.064325+0000", 2023-08-01T19:55:03.780 INFO:teuthology.orchestra.run.smithi008.stdout: "duration": 1.9045000000000001e-05 2023-08-01T19:55:03.780 INFO:teuthology.orchestra.run.smithi008.stdout: }, 2023-08-01T19:55:03.780 INFO:teuthology.orchestra.run.smithi008.stdout: { 2023-08-01T19:55:03.780 INFO:teuthology.orchestra.run.smithi008.stdout: "event": "reached_pg", 2023-08-01T19:55:03.780 INFO:teuthology.orchestra.run.smithi008.stdout: "time": "2023-08-01T19:54:55.064371+0000", 2023-08-01T19:55:03.781 INFO:teuthology.orchestra.run.smithi008.stdout: "duration": 4.6254000000000001e-05 2023-08-01T19:55:03.781 INFO:teuthology.orchestra.run.smithi008.stdout: }, 2023-08-01T19:55:03.781 INFO:teuthology.orchestra.run.smithi008.stdout: { 2023-08-01T19:55:03.781 INFO:teuthology.orchestra.run.smithi008.stdout: "event": "op must wait for map", 2023-08-01T19:55:03.781 INFO:teuthology.orchestra.run.smithi008.stdout: "time": "2023-08-01T19:54:55.064375+0000", 2023-08-01T19:55:03.781 INFO:teuthology.orchestra.run.smithi008.stdout: "duration": 3.7749999999999999e-06 2023-08-01T19:55:03.781 INFO:teuthology.orchestra.run.smithi008.stdout: }, 2023-08-01T19:55:03.781 INFO:teuthology.orchestra.run.smithi008.stdout: { 2023-08-01T19:55:03.782 INFO:teuthology.orchestra.run.smithi008.stdout: "event": "reached_pg", 2023-08-01T19:55:03.782 INFO:teuthology.orchestra.run.smithi008.stdout: "time": "2023-08-01T19:54:55.069678+0000", 2023-08-01T19:55:03.782 INFO:teuthology.orchestra.run.smithi008.stdout: "duration": 0.0053035360000000002 2023-08-01T19:55:03.782 INFO:teuthology.orchestra.run.smithi008.stdout: }, 2023-08-01T19:55:03.782 INFO:teuthology.orchestra.run.smithi008.stdout: { 2023-08-01T19:55:03.782 INFO:teuthology.orchestra.run.smithi008.stdout: "event": "started", 2023-08-01T19:55:03.782 INFO:teuthology.orchestra.run.smithi008.stdout: "time": "2023-08-01T19:54:55.069800+0000", 2023-08-01T19:55:03.782 INFO:teuthology.orchestra.run.smithi008.stdout: "duration": 0.00012183799999999999 2023-08-01T19:55:03.783 INFO:teuthology.orchestra.run.smithi008.stdout: }, 2023-08-01T19:55:03.783 INFO:teuthology.orchestra.run.smithi008.stdout: { 2023-08-01T19:55:03.783 INFO:teuthology.orchestra.run.smithi008.stdout: "event": "waiting for subops from 1", 2023-08-01T19:55:03.783 INFO:teuthology.orchestra.run.smithi008.stdout: "time": "2023-08-01T19:54:55.070411+0000", 2023-08-01T19:55:03.783 INFO:teuthology.orchestra.run.smithi008.stdout: "duration": 0.00061113499999999996 2023-08-01T19:55:03.783 INFO:teuthology.orchestra.run.smithi008.stdout: }, 2023-08-01T19:55:03.783 INFO:teuthology.orchestra.run.smithi008.stdout: { 2023-08-01T19:55:03.784 INFO:teuthology.orchestra.run.smithi008.stdout: "event": "op_commit", 2023-08-01T19:55:03.784 INFO:teuthology.orchestra.run.smithi008.stdout: "time": "2023-08-01T19:54:55.077232+0000", 2023-08-01T19:55:03.784 INFO:teuthology.orchestra.run.smithi008.stdout: "duration": 0.006821171 2023-08-01T19:55:03.784 INFO:teuthology.orchestra.run.smithi008.stdout: }, 2023-08-01T19:55:03.784 INFO:teuthology.orchestra.run.smithi008.stdout: { 2023-08-01T19:55:03.784 INFO:teuthology.orchestra.run.smithi008.stdout: "event": "sub_op_commit_rec", 2023-08-01T19:55:03.784 INFO:teuthology.orchestra.run.smithi008.stdout: "time": "2023-08-01T19:54:55.080641+0000", 2023-08-01T19:55:03.784 INFO:teuthology.orchestra.run.smithi008.stdout: "duration": 0.0034086479999999998 2023-08-01T19:55:03.785 INFO:teuthology.orchestra.run.smithi008.stdout: }, 2023-08-01T19:55:03.785 INFO:teuthology.orchestra.run.smithi008.stdout: { 2023-08-01T19:55:03.785 INFO:teuthology.orchestra.run.smithi008.stdout: "event": "commit_sent", 2023-08-01T19:55:03.785 INFO:teuthology.orchestra.run.smithi008.stdout: "time": "2023-08-01T19:54:55.080693+0000", 2023-08-01T19:55:03.785 INFO:teuthology.orchestra.run.smithi008.stdout: "duration": 5.1660999999999999e-05 2023-08-01T19:55:03.785 INFO:teuthology.orchestra.run.smithi008.stdout: }, 2023-08-01T19:55:03.785 INFO:teuthology.orchestra.run.smithi008.stdout: { 2023-08-01T19:55:03.785 INFO:teuthology.orchestra.run.smithi008.stdout: "event": "done", 2023-08-01T19:55:03.786 INFO:teuthology.orchestra.run.smithi008.stdout: "time": "2023-08-01T19:54:55.080735+0000", 2023-08-01T19:55:03.786 INFO:teuthology.orchestra.run.smithi008.stdout: "duration": 4.2002999999999997e-05 2023-08-01T19:55:03.786 INFO:teuthology.orchestra.run.smithi008.stdout: } 2023-08-01T19:55:03.786 INFO:teuthology.orchestra.run.smithi008.stdout: ] 2023-08-01T19:55:03.786 INFO:teuthology.orchestra.run.smithi008.stdout: } 2023-08-01T19:55:03.786 INFO:teuthology.orchestra.run.smithi008.stdout: }, 2023-08-01T19:55:03.786 INFO:teuthology.orchestra.run.smithi008.stdout: { 2023-08-01T19:55:03.787 INFO:teuthology.orchestra.run.smithi008.stdout: "description": "osd_op(client.4668.0:81441 5.5 5:ab200711:::benchmark_data_smithi006_114134_object81440:head [set-alloc-hint object_size 65536 write_size 65536,write 0~65536] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e34)", 2023-08-01T19:55:03.787 INFO:teuthology.orchestra.run.smithi008.stdout: "initiated_at": "2023-08-01T19:54:55.523719+0000", 2023-08-01T19:55:03.787 INFO:teuthology.orchestra.run.smithi008.stdout: "age": 8.1586189440000005, 2023-08-01T19:55:03.787 INFO:teuthology.orchestra.run.smithi008.stdout: "duration": 0.018134344, 2023-08-01T19:55:03.787 INFO:teuthology.orchestra.run.smithi008.stdout: "type_data": { 2023-08-01T19:55:03.787 INFO:teuthology.orchestra.run.smithi008.stdout: "flag_point": "commit sent; apply or cleanup", 2023-08-01T19:55:03.787 INFO:teuthology.orchestra.run.smithi008.stdout: "client_info": { 2023-08-01T19:55:03.787 INFO:teuthology.orchestra.run.smithi008.stdout: "client": "client.4668", 2023-08-01T19:55:03.788 INFO:teuthology.orchestra.run.smithi008.stdout: "client_addr": "172.21.15.6:0/1709472247", 2023-08-01T19:55:03.788 INFO:teuthology.orchestra.run.smithi008.stdout: "tid": 81441 2023-08-01T19:55:03.788 INFO:teuthology.orchestra.run.smithi008.stdout: }, 2023-08-01T19:55:03.788 INFO:teuthology.orchestra.run.smithi008.stdout: "events": [ 2023-08-01T19:55:03.788 INFO:teuthology.orchestra.run.smithi008.stdout: { 2023-08-01T19:55:03.788 INFO:teuthology.orchestra.run.smithi008.stdout: "event": "initiated", 2023-08-01T19:55:03.788 INFO:teuthology.orchestra.run.smithi008.stdout: "time": "2023-08-01T19:54:55.523719+0000", 2023-08-01T19:55:03.788 INFO:teuthology.orchestra.run.smithi008.stdout: "duration": 0 2023-08-01T19:55:03.789 INFO:teuthology.orchestra.run.smithi008.stdout: }, 2023-08-01T19:55:03.789 INFO:teuthology.orchestra.run.smithi008.stdout: { 2023-08-01T19:55:03.789 INFO:teuthology.orchestra.run.smithi008.stdout: "event": "throttled", 2023-08-01T19:55:03.789 INFO:teuthology.orchestra.run.smithi008.stdout: "time": "2023-08-01T19:54:55.523719+0000", 2023-08-01T19:55:03.789 INFO:teuthology.orchestra.run.smithi008.stdout: "duration": 0 2023-08-01T19:55:03.789 INFO:teuthology.orchestra.run.smithi008.stdout: }, 2023-08-01T19:55:03.789 INFO:teuthology.orchestra.run.smithi008.stdout: { 2023-08-01T19:55:03.789 INFO:teuthology.orchestra.run.smithi008.stdout: "event": "header_read", 2023-08-01T19:55:03.790 INFO:teuthology.orchestra.run.smithi008.stdout: "time": "2023-08-01T19:54:55.523718+0000", 2023-08-01T19:55:03.790 INFO:teuthology.orchestra.run.smithi008.stdout: "duration": 4294967295.9999995 2023-08-01T19:55:03.790 INFO:teuthology.orchestra.run.smithi008.stdout: }, 2023-08-01T19:55:03.790 INFO:teuthology.orchestra.run.smithi008.stdout: { 2023-08-01T19:55:03.790 INFO:teuthology.orchestra.run.smithi008.stdout: "event": "all_read", 2023-08-01T19:55:03.790 INFO:teuthology.orchestra.run.smithi008.stdout: "time": "2023-08-01T19:54:55.523792+0000", 2023-08-01T19:55:03.790 INFO:teuthology.orchestra.run.smithi008.stdout: "duration": 7.3818000000000004e-05 2023-08-01T19:55:03.791 INFO:teuthology.orchestra.run.smithi008.stdout: }, 2023-08-01T19:55:03.791 INFO:teuthology.orchestra.run.smithi008.stdout: { 2023-08-01T19:55:03.791 INFO:teuthology.orchestra.run.smithi008.stdout: "event": "dispatched", 2023-08-01T19:55:03.791 INFO:teuthology.orchestra.run.smithi008.stdout: "time": "2023-08-01T19:54:55.523797+0000", 2023-08-01T19:55:03.791 INFO:teuthology.orchestra.run.smithi008.stdout: "duration": 4.6229999999999996e-06 2023-08-01T19:55:03.791 INFO:teuthology.orchestra.run.smithi008.stdout: }, 2023-08-01T19:55:03.791 INFO:teuthology.orchestra.run.smithi008.stdout: { 2023-08-01T19:55:03.791 INFO:teuthology.orchestra.run.smithi008.stdout: "event": "queued_for_pg", 2023-08-01T19:55:03.792 INFO:teuthology.orchestra.run.smithi008.stdout: "time": "2023-08-01T19:54:55.523800+0000", 2023-08-01T19:55:03.792 INFO:teuthology.orchestra.run.smithi008.stdout: "duration": 3.4680000000000001e-06 2023-08-01T19:55:03.792 INFO:teuthology.orchestra.run.smithi008.stdout: }, 2023-08-01T19:55:03.792 INFO:teuthology.orchestra.run.smithi008.stdout: { 2023-08-01T19:55:03.792 INFO:teuthology.orchestra.run.smithi008.stdout: "event": "reached_pg", 2023-08-01T19:55:03.792 INFO:teuthology.orchestra.run.smithi008.stdout: "time": "2023-08-01T19:54:55.530492+0000", 2023-08-01T19:55:03.792 INFO:teuthology.orchestra.run.smithi008.stdout: "duration": 0.0066918050000000003 2023-08-01T19:55:03.792 INFO:teuthology.orchestra.run.smithi008.stdout: }, 2023-08-01T19:55:03.793 INFO:teuthology.orchestra.run.smithi008.stdout: { 2023-08-01T19:55:03.793 INFO:teuthology.orchestra.run.smithi008.stdout: "event": "started", 2023-08-01T19:55:03.793 INFO:teuthology.orchestra.run.smithi008.stdout: "time": "2023-08-01T19:54:55.530631+0000", 2023-08-01T19:55:03.793 INFO:teuthology.orchestra.run.smithi008.stdout: "duration": 0.000138794 2023-08-01T19:55:03.793 INFO:teuthology.orchestra.run.smithi008.stdout: }, 2023-08-01T19:55:03.793 INFO:teuthology.orchestra.run.smithi008.stdout: { 2023-08-01T19:55:03.793 INFO:teuthology.orchestra.run.smithi008.stdout: "event": "waiting for subops from 1", 2023-08-01T19:55:03.794 INFO:teuthology.orchestra.run.smithi008.stdout: "time": "2023-08-01T19:54:55.530792+0000", 2023-08-01T19:55:03.794 INFO:teuthology.orchestra.run.smithi008.stdout: "duration": 0.00016092299999999999 2023-08-01T19:55:03.794 INFO:teuthology.orchestra.run.smithi008.stdout: }, 2023-08-01T19:55:03.794 INFO:teuthology.orchestra.run.smithi008.stdout: { 2023-08-01T19:55:03.794 INFO:teuthology.orchestra.run.smithi008.stdout: "event": "sub_op_commit_rec", 2023-08-01T19:55:03.794 INFO:teuthology.orchestra.run.smithi008.stdout: "time": "2023-08-01T19:54:55.539186+0000", 2023-08-01T19:55:03.794 INFO:teuthology.orchestra.run.smithi008.stdout: "duration": 0.0083942630000000008 2023-08-01T19:55:03.794 INFO:teuthology.orchestra.run.smithi008.stdout: }, 2023-08-01T19:55:03.795 INFO:teuthology.orchestra.run.smithi008.stdout: { 2023-08-01T19:55:03.795 INFO:teuthology.orchestra.run.smithi008.stdout: "event": "op_commit", 2023-08-01T19:55:03.795 INFO:teuthology.orchestra.run.smithi008.stdout: "time": "2023-08-01T19:54:55.541775+0000", 2023-08-01T19:55:03.795 INFO:teuthology.orchestra.run.smithi008.stdout: "duration": 0.0025887530000000001 2023-08-01T19:55:03.795 INFO:teuthology.orchestra.run.smithi008.stdout: }, 2023-08-01T19:55:03.795 INFO:teuthology.orchestra.run.smithi008.stdout: { 2023-08-01T19:55:03.795 INFO:teuthology.orchestra.run.smithi008.stdout: "event": "commit_sent", 2023-08-01T19:55:03.795 INFO:teuthology.orchestra.run.smithi008.stdout: "time": "2023-08-01T19:54:55.541820+0000", 2023-08-01T19:55:03.796 INFO:teuthology.orchestra.run.smithi008.stdout: "duration": 4.4870000000000002e-05 2023-08-01T19:55:03.796 INFO:teuthology.orchestra.run.smithi008.stdout: }, 2023-08-01T19:55:03.796 INFO:teuthology.orchestra.run.smithi008.stdout: { 2023-08-01T19:55:03.796 INFO:teuthology.orchestra.run.smithi008.stdout: "event": "done", 2023-08-01T19:55:03.796 INFO:teuthology.orchestra.run.smithi008.stdout: "time": "2023-08-01T19:54:55.541853+0000", 2023-08-01T19:55:03.796 INFO:teuthology.orchestra.run.smithi008.stdout: "duration": 3.3568000000000001e-05 2023-08-01T19:55:03.796 INFO:teuthology.orchestra.run.smithi008.stdout: } 2023-08-01T19:55:03.797 INFO:teuthology.orchestra.run.smithi008.stdout: ] 2023-08-01T19:55:03.797 INFO:teuthology.orchestra.run.smithi008.stdout: } 2023-08-01T19:55:03.797 INFO:teuthology.orchestra.run.smithi008.stdout: }, 2023-08-01T19:55:03.797 INFO:teuthology.orchestra.run.smithi008.stdout: { 2023-08-01T19:55:03.797 INFO:teuthology.orchestra.run.smithi008.stdout: "description": "osd_op(client.4668.0:83724 5.a 5:51683221:::benchmark_data_smithi006_114134_object83723:head [set-alloc-hint object_size 65536 write_size 65536,write 0~65536] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e34)", 2023-08-01T19:55:03.797 INFO:teuthology.orchestra.run.smithi008.stdout: "initiated_at": "2023-08-01T19:54:56.650569+0000", 2023-08-01T19:55:03.797 INFO:teuthology.orchestra.run.smithi008.stdout: "age": 7.0317692599999999, 2023-08-01T19:55:03.797 INFO:teuthology.orchestra.run.smithi008.stdout: "duration": 0.017545056, 2023-08-01T19:55:03.798 INFO:teuthology.orchestra.run.smithi008.stdout: "type_data": { 2023-08-01T19:55:03.798 INFO:teuthology.orchestra.run.smithi008.stdout: "flag_point": "commit sent; apply or cleanup", 2023-08-01T19:55:03.798 INFO:teuthology.orchestra.run.smithi008.stdout: "client_info": { 2023-08-01T19:55:03.798 INFO:teuthology.orchestra.run.smithi008.stdout: "client": "client.4668", 2023-08-01T19:55:03.798 INFO:teuthology.orchestra.run.smithi008.stdout: "client_addr": "172.21.15.6:0/1709472247", 2023-08-01T19:55:03.798 INFO:teuthology.orchestra.run.smithi008.stdout: "tid": 83724 2023-08-01T19:55:03.798 INFO:teuthology.orchestra.run.smithi008.stdout: }, 2023-08-01T19:55:03.799 INFO:teuthology.orchestra.run.smithi008.stdout: "events": [ 2023-08-01T19:55:03.799 INFO:teuthology.orchestra.run.smithi008.stdout: { 2023-08-01T19:55:03.799 INFO:teuthology.orchestra.run.smithi008.stdout: "event": "initiated", 2023-08-01T19:55:03.799 INFO:teuthology.orchestra.run.smithi008.stdout: "time": "2023-08-01T19:54:56.650569+0000", 2023-08-01T19:55:03.799 INFO:teuthology.orchestra.run.smithi008.stdout: "duration": 0 2023-08-01T19:55:03.799 INFO:teuthology.orchestra.run.smithi008.stdout: }, 2023-08-01T19:55:03.799 INFO:teuthology.orchestra.run.smithi008.stdout: { 2023-08-01T19:55:03.799 INFO:teuthology.orchestra.run.smithi008.stdout: "event": "throttled", 2023-08-01T19:55:03.800 INFO:teuthology.orchestra.run.smithi008.stdout: "time": "2023-08-01T19:54:56.650569+0000", 2023-08-01T19:55:03.800 INFO:teuthology.orchestra.run.smithi008.stdout: "duration": 0 2023-08-01T19:55:03.800 INFO:teuthology.orchestra.run.smithi008.stdout: }, 2023-08-01T19:55:03.800 INFO:teuthology.orchestra.run.smithi008.stdout: { 2023-08-01T19:55:03.800 INFO:teuthology.orchestra.run.smithi008.stdout: "event": "header_read", 2023-08-01T19:55:03.800 INFO:teuthology.orchestra.run.smithi008.stdout: "time": "2023-08-01T19:54:56.650568+0000", 2023-08-01T19:55:03.800 INFO:teuthology.orchestra.run.smithi008.stdout: "duration": 4294967295.999999 2023-08-01T19:55:03.801 INFO:teuthology.orchestra.run.smithi008.stdout: }, 2023-08-01T19:55:03.801 INFO:teuthology.orchestra.run.smithi008.stdout: { 2023-08-01T19:55:03.801 INFO:teuthology.orchestra.run.smithi008.stdout: "event": "all_read", 2023-08-01T19:55:03.801 INFO:teuthology.orchestra.run.smithi008.stdout: "time": "2023-08-01T19:54:56.650642+0000", 2023-08-01T19:55:03.801 INFO:teuthology.orchestra.run.smithi008.stdout: "duration": 7.4239999999999994e-05 2023-08-01T19:55:03.801 INFO:teuthology.orchestra.run.smithi008.stdout: }, 2023-08-01T19:55:03.801 INFO:teuthology.orchestra.run.smithi008.stdout: { 2023-08-01T19:55:03.801 INFO:teuthology.orchestra.run.smithi008.stdout: "event": "dispatched", 2023-08-01T19:55:03.802 INFO:teuthology.orchestra.run.smithi008.stdout: "time": "2023-08-01T19:54:56.650650+0000", 2023-08-01T19:55:03.802 INFO:teuthology.orchestra.run.smithi008.stdout: "duration": 8.2789999999999998e-06 2023-08-01T19:55:03.802 INFO:teuthology.orchestra.run.smithi008.stdout: }, 2023-08-01T19:55:03.802 INFO:teuthology.orchestra.run.smithi008.stdout: { 2023-08-01T19:55:03.802 INFO:teuthology.orchestra.run.smithi008.stdout: "event": "queued_for_pg", 2023-08-01T19:55:03.802 INFO:teuthology.orchestra.run.smithi008.stdout: "time": "2023-08-01T19:54:56.650654+0000", 2023-08-01T19:55:03.802 INFO:teuthology.orchestra.run.smithi008.stdout: "duration": 3.5389999999999999e-06 2023-08-01T19:55:03.802 INFO:teuthology.orchestra.run.smithi008.stdout: }, 2023-08-01T19:55:03.803 INFO:teuthology.orchestra.run.smithi008.stdout: { 2023-08-01T19:55:03.803 INFO:teuthology.orchestra.run.smithi008.stdout: "event": "reached_pg", 2023-08-01T19:55:03.803 INFO:teuthology.orchestra.run.smithi008.stdout: "time": "2023-08-01T19:54:56.654606+0000", 2023-08-01T19:55:03.803 INFO:teuthology.orchestra.run.smithi008.stdout: "duration": 0.003952288 2023-08-01T19:55:03.803 INFO:teuthology.orchestra.run.smithi008.stdout: }, 2023-08-01T19:55:03.803 INFO:teuthology.orchestra.run.smithi008.stdout: { 2023-08-01T19:55:03.803 INFO:teuthology.orchestra.run.smithi008.stdout: "event": "started", 2023-08-01T19:55:03.803 INFO:teuthology.orchestra.run.smithi008.stdout: "time": "2023-08-01T19:54:56.654704+0000", 2023-08-01T19:55:03.804 INFO:teuthology.orchestra.run.smithi008.stdout: "duration": 9.7460000000000005e-05 2023-08-01T19:55:03.804 INFO:teuthology.orchestra.run.smithi008.stdout: }, 2023-08-01T19:55:03.804 INFO:teuthology.orchestra.run.smithi008.stdout: { 2023-08-01T19:55:03.804 INFO:teuthology.orchestra.run.smithi008.stdout: "event": "waiting for subops from 2", 2023-08-01T19:55:03.804 INFO:teuthology.orchestra.run.smithi008.stdout: "time": "2023-08-01T19:54:56.654815+0000", 2023-08-01T19:55:03.805 INFO:teuthology.orchestra.run.smithi008.stdout: "duration": 0.00011138599999999999 2023-08-01T19:55:03.805 INFO:teuthology.orchestra.run.smithi008.stdout: }, 2023-08-01T19:55:03.805 INFO:teuthology.orchestra.run.smithi008.stdout: { 2023-08-01T19:55:03.805 INFO:teuthology.orchestra.run.smithi008.stdout: "event": "sub_op_commit_rec", 2023-08-01T19:55:03.805 INFO:teuthology.orchestra.run.smithi008.stdout: "time": "2023-08-01T19:54:56.662591+0000", 2023-08-01T19:55:03.805 INFO:teuthology.orchestra.run.smithi008.stdout: "duration": 0.0077756869999999999 2023-08-01T19:55:03.805 INFO:teuthology.orchestra.run.smithi008.stdout: }, 2023-08-01T19:55:03.806 INFO:teuthology.orchestra.run.smithi008.stdout: { 2023-08-01T19:55:03.806 INFO:teuthology.orchestra.run.smithi008.stdout: "event": "op_commit", 2023-08-01T19:55:03.806 INFO:teuthology.orchestra.run.smithi008.stdout: "time": "2023-08-01T19:54:56.668029+0000", 2023-08-01T19:55:03.806 INFO:teuthology.orchestra.run.smithi008.stdout: "duration": 0.0054382500000000004 2023-08-01T19:55:03.806 INFO:teuthology.orchestra.run.smithi008.stdout: }, 2023-08-01T19:55:03.806 INFO:teuthology.orchestra.run.smithi008.stdout: { 2023-08-01T19:55:03.806 INFO:teuthology.orchestra.run.smithi008.stdout: "event": "commit_sent", 2023-08-01T19:55:03.806 INFO:teuthology.orchestra.run.smithi008.stdout: "time": "2023-08-01T19:54:56.668070+0000", 2023-08-01T19:55:03.807 INFO:teuthology.orchestra.run.smithi008.stdout: "duration": 4.1625999999999998e-05 2023-08-01T19:55:03.807 INFO:teuthology.orchestra.run.smithi008.stdout: }, 2023-08-01T19:55:03.807 INFO:teuthology.orchestra.run.smithi008.stdout: { 2023-08-01T19:55:03.807 INFO:teuthology.orchestra.run.smithi008.stdout: "event": "done", 2023-08-01T19:55:03.807 INFO:teuthology.orchestra.run.smithi008.stdout: "time": "2023-08-01T19:54:56.668114+0000", 2023-08-01T19:55:03.807 INFO:teuthology.orchestra.run.smithi008.stdout: "duration": 4.3229000000000002e-05 2023-08-01T19:55:03.807 INFO:teuthology.orchestra.run.smithi008.stdout: } 2023-08-01T19:55:03.807 INFO:teuthology.orchestra.run.smithi008.stdout: ] 2023-08-01T19:55:03.808 INFO:teuthology.orchestra.run.smithi008.stdout: } 2023-08-01T19:55:03.808 INFO:teuthology.orchestra.run.smithi008.stdout: }, 2023-08-01T19:55:03.808 INFO:teuthology.orchestra.run.smithi008.stdout: { 2023-08-01T19:55:03.808 INFO:teuthology.orchestra.run.smithi008.stdout: "description": "osd_op(client.4668.0:84109 5.5 5:a84da05f:::benchmark_data_smithi006_114134_object84108:head [set-alloc-hint object_size 65536 write_size 65536,write 0~65536] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e34)", 2023-08-01T19:55:03.808 INFO:teuthology.orchestra.run.smithi008.stdout: "initiated_at": "2023-08-01T19:54:56.853497+0000", 2023-08-01T19:55:03.808 INFO:teuthology.orchestra.run.smithi008.stdout: "age": 6.8288410910000001, 2023-08-01T19:55:03.808 INFO:teuthology.orchestra.run.smithi008.stdout: "duration": 0.017082654999999999, 2023-08-01T19:55:03.809 INFO:teuthology.orchestra.run.smithi008.stdout: "type_data": { 2023-08-01T19:55:03.809 INFO:teuthology.orchestra.run.smithi008.stdout: "flag_point": "commit sent; apply or cleanup", 2023-08-01T19:55:03.809 INFO:teuthology.orchestra.run.smithi008.stdout: "client_info": { 2023-08-01T19:55:03.809 INFO:teuthology.orchestra.run.smithi008.stdout: "client": "client.4668", 2023-08-01T19:55:03.809 INFO:teuthology.orchestra.run.smithi008.stdout: "client_addr": "172.21.15.6:0/1709472247", 2023-08-01T19:55:03.809 INFO:teuthology.orchestra.run.smithi008.stdout: "tid": 84109 2023-08-01T19:55:03.809 INFO:teuthology.orchestra.run.smithi008.stdout: }, 2023-08-01T19:55:03.810 INFO:teuthology.orchestra.run.smithi008.stdout: "events": [ 2023-08-01T19:55:03.810 INFO:teuthology.orchestra.run.smithi008.stdout: { 2023-08-01T19:55:03.810 INFO:teuthology.orchestra.run.smithi008.stdout: "event": "initiated", 2023-08-01T19:55:03.810 INFO:teuthology.orchestra.run.smithi008.stdout: "time": "2023-08-01T19:54:56.853497+0000", 2023-08-01T19:55:03.810 INFO:teuthology.orchestra.run.smithi008.stdout: "duration": 0 2023-08-01T19:55:03.810 INFO:teuthology.orchestra.run.smithi008.stdout: }, 2023-08-01T19:55:03.810 INFO:teuthology.orchestra.run.smithi008.stdout: { 2023-08-01T19:55:03.810 INFO:teuthology.orchestra.run.smithi008.stdout: "event": "throttled", 2023-08-01T19:55:03.811 INFO:teuthology.orchestra.run.smithi008.stdout: "time": "2023-08-01T19:54:56.853497+0000", 2023-08-01T19:55:03.811 INFO:teuthology.orchestra.run.smithi008.stdout: "duration": 0 2023-08-01T19:55:03.811 INFO:teuthology.orchestra.run.smithi008.stdout: }, 2023-08-01T19:55:03.811 INFO:teuthology.orchestra.run.smithi008.stdout: { 2023-08-01T19:55:03.811 INFO:teuthology.orchestra.run.smithi008.stdout: "event": "header_read", 2023-08-01T19:55:03.811 INFO:teuthology.orchestra.run.smithi008.stdout: "time": "2023-08-01T19:54:56.853496+0000", 2023-08-01T19:55:03.811 INFO:teuthology.orchestra.run.smithi008.stdout: "duration": 4294967295.999999 2023-08-01T19:55:03.811 INFO:teuthology.orchestra.run.smithi008.stdout: }, 2023-08-01T19:55:03.812 INFO:teuthology.orchestra.run.smithi008.stdout: { 2023-08-01T19:55:03.812 INFO:teuthology.orchestra.run.smithi008.stdout: "event": "all_read", 2023-08-01T19:55:03.812 INFO:teuthology.orchestra.run.smithi008.stdout: "time": "2023-08-01T19:54:56.853540+0000", 2023-08-01T19:55:03.812 INFO:teuthology.orchestra.run.smithi008.stdout: "duration": 4.4161e-05 2023-08-01T19:55:03.812 INFO:teuthology.orchestra.run.smithi008.stdout: }, 2023-08-01T19:55:03.812 INFO:teuthology.orchestra.run.smithi008.stdout: { 2023-08-01T19:55:03.812 INFO:teuthology.orchestra.run.smithi008.stdout: "event": "dispatched", 2023-08-01T19:55:03.812 INFO:teuthology.orchestra.run.smithi008.stdout: "time": "2023-08-01T19:54:56.853548+0000", 2023-08-01T19:55:03.813 INFO:teuthology.orchestra.run.smithi008.stdout: "duration": 8.1499999999999999e-06 2023-08-01T19:55:03.813 INFO:teuthology.orchestra.run.smithi008.stdout: }, 2023-08-01T19:55:03.813 INFO:teuthology.orchestra.run.smithi008.stdout: { 2023-08-01T19:55:03.813 INFO:teuthology.orchestra.run.smithi008.stdout: "event": "queued_for_pg", 2023-08-01T19:55:03.813 INFO:teuthology.orchestra.run.smithi008.stdout: "time": "2023-08-01T19:54:56.853552+0000", 2023-08-01T19:55:03.813 INFO:teuthology.orchestra.run.smithi008.stdout: "duration": 4.1969999999999998e-06 2023-08-01T19:55:03.813 INFO:teuthology.orchestra.run.smithi008.stdout: }, 2023-08-01T19:55:03.813 INFO:teuthology.orchestra.run.smithi008.stdout: { 2023-08-01T19:55:03.814 INFO:teuthology.orchestra.run.smithi008.stdout: "event": "reached_pg", 2023-08-01T19:55:03.814 INFO:teuthology.orchestra.run.smithi008.stdout: "time": "2023-08-01T19:54:56.854385+0000", 2023-08-01T19:55:03.814 INFO:teuthology.orchestra.run.smithi008.stdout: "duration": 0.00083224500000000001 2023-08-01T19:55:03.814 INFO:teuthology.orchestra.run.smithi008.stdout: }, 2023-08-01T19:55:03.814 INFO:teuthology.orchestra.run.smithi008.stdout: { 2023-08-01T19:55:03.814 INFO:teuthology.orchestra.run.smithi008.stdout: "event": "started", 2023-08-01T19:55:03.814 INFO:teuthology.orchestra.run.smithi008.stdout: "time": "2023-08-01T19:54:56.854546+0000", 2023-08-01T19:55:03.815 INFO:teuthology.orchestra.run.smithi008.stdout: "duration": 0.00016117599999999999 2023-08-01T19:55:03.815 INFO:teuthology.orchestra.run.smithi008.stdout: }, 2023-08-01T19:55:03.815 INFO:teuthology.orchestra.run.smithi008.stdout: { 2023-08-01T19:55:03.815 INFO:teuthology.orchestra.run.smithi008.stdout: "event": "waiting for subops from 1", 2023-08-01T19:55:03.815 INFO:teuthology.orchestra.run.smithi008.stdout: "time": "2023-08-01T19:54:56.854671+0000", 2023-08-01T19:55:03.815 INFO:teuthology.orchestra.run.smithi008.stdout: "duration": 0.000124993 2023-08-01T19:55:03.815 INFO:teuthology.orchestra.run.smithi008.stdout: }, 2023-08-01T19:55:03.816 INFO:teuthology.orchestra.run.smithi008.stdout: { 2023-08-01T19:55:03.816 INFO:teuthology.orchestra.run.smithi008.stdout: "event": "sub_op_commit_rec", 2023-08-01T19:55:03.816 INFO:teuthology.orchestra.run.smithi008.stdout: "time": "2023-08-01T19:54:56.860986+0000", 2023-08-01T19:55:03.816 INFO:teuthology.orchestra.run.smithi008.stdout: "duration": 0.0063150619999999998 2023-08-01T19:55:03.816 INFO:teuthology.orchestra.run.smithi008.stdout: }, 2023-08-01T19:55:03.816 INFO:teuthology.orchestra.run.smithi008.stdout: { 2023-08-01T19:55:03.816 INFO:teuthology.orchestra.run.smithi008.stdout: "event": "op_commit", 2023-08-01T19:55:03.816 INFO:teuthology.orchestra.run.smithi008.stdout: "time": "2023-08-01T19:54:56.870455+0000", 2023-08-01T19:55:03.817 INFO:teuthology.orchestra.run.smithi008.stdout: "duration": 0.0094689349999999995 2023-08-01T19:55:03.817 INFO:teuthology.orchestra.run.smithi008.stdout: }, 2023-08-01T19:55:03.817 INFO:teuthology.orchestra.run.smithi008.stdout: { 2023-08-01T19:55:03.817 INFO:teuthology.orchestra.run.smithi008.stdout: "event": "commit_sent", 2023-08-01T19:55:03.817 INFO:teuthology.orchestra.run.smithi008.stdout: "time": "2023-08-01T19:54:56.870515+0000", 2023-08-01T19:55:03.817 INFO:teuthology.orchestra.run.smithi008.stdout: "duration": 6.0578999999999997e-05 2023-08-01T19:55:03.817 INFO:teuthology.orchestra.run.smithi008.stdout: }, 2023-08-01T19:55:03.818 INFO:teuthology.orchestra.run.smithi008.stdout: { 2023-08-01T19:55:03.818 INFO:teuthology.orchestra.run.smithi008.stdout: "event": "done", 2023-08-01T19:55:03.818 INFO:teuthology.orchestra.run.smithi008.stdout: "time": "2023-08-01T19:54:56.870579+0000", 2023-08-01T19:55:03.818 INFO:teuthology.orchestra.run.smithi008.stdout: "duration": 6.4152999999999994e-05 2023-08-01T19:55:03.818 INFO:teuthology.orchestra.run.smithi008.stdout: } 2023-08-01T19:55:03.818 INFO:teuthology.orchestra.run.smithi008.stdout: ] 2023-08-01T19:55:03.818 INFO:teuthology.orchestra.run.smithi008.stdout: } 2023-08-01T19:55:03.818 INFO:teuthology.orchestra.run.smithi008.stdout: }, 2023-08-01T19:55:03.819 INFO:teuthology.orchestra.run.smithi008.stdout: { 2023-08-01T19:55:03.819 INFO:teuthology.orchestra.run.smithi008.stdout: "description": "osd_op(client.4668.0:92713 5.5 5:af540749:::benchmark_data_smithi006_114134_object92712:head [set-alloc-hint object_size 65536 write_size 65536,write 0~65536] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e36)", 2023-08-01T19:55:03.819 INFO:teuthology.orchestra.run.smithi008.stdout: "initiated_at": "2023-08-01T19:55:01.247090+0000", 2023-08-01T19:55:03.819 INFO:teuthology.orchestra.run.smithi008.stdout: "age": 2.435248074, 2023-08-01T19:55:03.819 INFO:teuthology.orchestra.run.smithi008.stdout: "duration": 0.018244672999999999, 2023-08-01T19:55:03.819 INFO:teuthology.orchestra.run.smithi008.stdout: "type_data": { 2023-08-01T19:55:03.819 INFO:teuthology.orchestra.run.smithi008.stdout: "flag_point": "commit sent; apply or cleanup", 2023-08-01T19:55:03.819 INFO:teuthology.orchestra.run.smithi008.stdout: "client_info": { 2023-08-01T19:55:03.820 INFO:teuthology.orchestra.run.smithi008.stdout: "client": "client.4668", 2023-08-01T19:55:03.820 INFO:teuthology.orchestra.run.smithi008.stdout: "client_addr": "172.21.15.6:0/1709472247", 2023-08-01T19:55:03.820 INFO:teuthology.orchestra.run.smithi008.stdout: "tid": 92713 2023-08-01T19:55:03.820 INFO:teuthology.orchestra.run.smithi008.stdout: }, 2023-08-01T19:55:03.820 INFO:teuthology.orchestra.run.smithi008.stdout: "events": [ 2023-08-01T19:55:03.820 INFO:teuthology.orchestra.run.smithi008.stdout: { 2023-08-01T19:55:03.820 INFO:teuthology.orchestra.run.smithi008.stdout: "event": "initiated", 2023-08-01T19:55:03.820 INFO:teuthology.orchestra.run.smithi008.stdout: "time": "2023-08-01T19:55:01.247090+0000", 2023-08-01T19:55:03.821 INFO:teuthology.orchestra.run.smithi008.stdout: "duration": 0 2023-08-01T19:55:03.821 INFO:teuthology.orchestra.run.smithi008.stdout: }, 2023-08-01T19:55:03.821 INFO:teuthology.orchestra.run.smithi008.stdout: { 2023-08-01T19:55:03.821 INFO:teuthology.orchestra.run.smithi008.stdout: "event": "throttled", 2023-08-01T19:55:03.821 INFO:teuthology.orchestra.run.smithi008.stdout: "time": "2023-08-01T19:55:01.247090+0000", 2023-08-01T19:55:03.821 INFO:teuthology.orchestra.run.smithi008.stdout: "duration": 0 2023-08-01T19:55:03.821 INFO:teuthology.orchestra.run.smithi008.stdout: }, 2023-08-01T19:55:03.822 INFO:teuthology.orchestra.run.smithi008.stdout: { 2023-08-01T19:55:03.822 INFO:teuthology.orchestra.run.smithi008.stdout: "event": "header_read", 2023-08-01T19:55:03.822 INFO:teuthology.orchestra.run.smithi008.stdout: "time": "2023-08-01T19:55:01.247089+0000", 2023-08-01T19:55:03.822 INFO:teuthology.orchestra.run.smithi008.stdout: "duration": 4294967295.999999 2023-08-01T19:55:03.822 INFO:teuthology.orchestra.run.smithi008.stdout: }, 2023-08-01T19:55:03.822 INFO:teuthology.orchestra.run.smithi008.stdout: { 2023-08-01T19:55:03.822 INFO:teuthology.orchestra.run.smithi008.stdout: "event": "all_read", 2023-08-01T19:55:03.822 INFO:teuthology.orchestra.run.smithi008.stdout: "time": "2023-08-01T19:55:01.247120+0000", 2023-08-01T19:55:03.823 INFO:teuthology.orchestra.run.smithi008.stdout: "duration": 3.0880000000000002e-05 2023-08-01T19:55:03.823 INFO:teuthology.orchestra.run.smithi008.stdout: }, 2023-08-01T19:55:03.823 INFO:teuthology.orchestra.run.smithi008.stdout: { 2023-08-01T19:55:03.823 INFO:teuthology.orchestra.run.smithi008.stdout: "event": "dispatched", 2023-08-01T19:55:03.823 INFO:teuthology.orchestra.run.smithi008.stdout: "time": "2023-08-01T19:55:01.247130+0000", 2023-08-01T19:55:03.823 INFO:teuthology.orchestra.run.smithi008.stdout: "duration": 1.0407999999999999e-05 2023-08-01T19:55:03.823 INFO:teuthology.orchestra.run.smithi008.stdout: }, 2023-08-01T19:55:03.823 INFO:teuthology.orchestra.run.smithi008.stdout: { 2023-08-01T19:55:03.824 INFO:teuthology.orchestra.run.smithi008.stdout: "event": "queued_for_pg", 2023-08-01T19:55:03.824 INFO:teuthology.orchestra.run.smithi008.stdout: "time": "2023-08-01T19:55:01.247136+0000", 2023-08-01T19:55:03.824 INFO:teuthology.orchestra.run.smithi008.stdout: "duration": 6.0920000000000003e-06 2023-08-01T19:55:03.824 INFO:teuthology.orchestra.run.smithi008.stdout: }, 2023-08-01T19:55:03.824 INFO:teuthology.orchestra.run.smithi008.stdout: { 2023-08-01T19:55:03.824 INFO:teuthology.orchestra.run.smithi008.stdout: "event": "reached_pg", 2023-08-01T19:55:03.824 INFO:teuthology.orchestra.run.smithi008.stdout: "time": "2023-08-01T19:55:01.249481+0000", 2023-08-01T19:55:03.824 INFO:teuthology.orchestra.run.smithi008.stdout: "duration": 0.0023440919999999999 2023-08-01T19:55:03.825 INFO:teuthology.orchestra.run.smithi008.stdout: }, 2023-08-01T19:55:03.825 INFO:teuthology.orchestra.run.smithi008.stdout: { 2023-08-01T19:55:03.825 INFO:teuthology.orchestra.run.smithi008.stdout: "event": "started", 2023-08-01T19:55:03.825 INFO:teuthology.orchestra.run.smithi008.stdout: "time": "2023-08-01T19:55:01.249606+0000", 2023-08-01T19:55:03.825 INFO:teuthology.orchestra.run.smithi008.stdout: "duration": 0.00012498699999999999 2023-08-01T19:55:03.825 INFO:teuthology.orchestra.run.smithi008.stdout: }, 2023-08-01T19:55:03.825 INFO:teuthology.orchestra.run.smithi008.stdout: { 2023-08-01T19:55:03.825 INFO:teuthology.orchestra.run.smithi008.stdout: "event": "waiting for subops from 1", 2023-08-01T19:55:03.826 INFO:teuthology.orchestra.run.smithi008.stdout: "time": "2023-08-01T19:55:01.249750+0000", 2023-08-01T19:55:03.826 INFO:teuthology.orchestra.run.smithi008.stdout: "duration": 0.00014450800000000001 2023-08-01T19:55:03.826 INFO:teuthology.orchestra.run.smithi008.stdout: }, 2023-08-01T19:55:03.826 INFO:teuthology.orchestra.run.smithi008.stdout: { 2023-08-01T19:55:03.826 INFO:teuthology.orchestra.run.smithi008.stdout: "event": "op_commit", 2023-08-01T19:55:03.826 INFO:teuthology.orchestra.run.smithi008.stdout: "time": "2023-08-01T19:55:01.257366+0000", 2023-08-01T19:55:03.826 INFO:teuthology.orchestra.run.smithi008.stdout: "duration": 0.0076155069999999997 2023-08-01T19:55:03.827 INFO:teuthology.orchestra.run.smithi008.stdout: }, 2023-08-01T19:55:03.827 INFO:teuthology.orchestra.run.smithi008.stdout: { 2023-08-01T19:55:03.827 INFO:teuthology.orchestra.run.smithi008.stdout: "event": "sub_op_commit_rec", 2023-08-01T19:55:03.827 INFO:teuthology.orchestra.run.smithi008.stdout: "time": "2023-08-01T19:55:01.265248+0000", 2023-08-01T19:55:03.827 INFO:teuthology.orchestra.run.smithi008.stdout: "duration": 0.0078820049999999992 2023-08-01T19:55:03.828 INFO:teuthology.orchestra.run.smithi008.stdout: }, 2023-08-01T19:55:03.828 INFO:teuthology.orchestra.run.smithi008.stdout: { 2023-08-01T19:55:03.828 INFO:teuthology.orchestra.run.smithi008.stdout: "event": "commit_sent", 2023-08-01T19:55:03.828 INFO:teuthology.orchestra.run.smithi008.stdout: "time": "2023-08-01T19:55:01.265296+0000", 2023-08-01T19:55:03.828 INFO:teuthology.orchestra.run.smithi008.stdout: "duration": 4.8557999999999998e-05 2023-08-01T19:55:03.828 INFO:teuthology.orchestra.run.smithi008.stdout: }, 2023-08-01T19:55:03.828 INFO:teuthology.orchestra.run.smithi008.stdout: { 2023-08-01T19:55:03.829 INFO:teuthology.orchestra.run.smithi008.stdout: "event": "done", 2023-08-01T19:55:03.829 INFO:teuthology.orchestra.run.smithi008.stdout: "time": "2023-08-01T19:55:01.265334+0000", 2023-08-01T19:55:03.829 INFO:teuthology.orchestra.run.smithi008.stdout: "duration": 3.8352999999999997e-05 2023-08-01T19:55:03.829 INFO:teuthology.orchestra.run.smithi008.stdout: } 2023-08-01T19:55:03.829 INFO:teuthology.orchestra.run.smithi008.stdout: ] 2023-08-01T19:55:03.829 INFO:teuthology.orchestra.run.smithi008.stdout: } 2023-08-01T19:55:03.829 INFO:teuthology.orchestra.run.smithi008.stdout: }, 2023-08-01T19:55:03.829 INFO:teuthology.orchestra.run.smithi008.stdout: { 2023-08-01T19:55:03.830 INFO:teuthology.orchestra.run.smithi008.stdout: "description": "osd_repop(client.4668.0:92726 5.2 e36/19 5:41e18163:::benchmark_data_smithi006_114134_object92725:head v 36'5970, mlcod=36'5967)", 2023-08-01T19:55:03.830 INFO:teuthology.orchestra.run.smithi008.stdout: "initiated_at": "2023-08-01T19:55:01.260461+0000", 2023-08-01T19:55:03.830 INFO:teuthology.orchestra.run.smithi008.stdout: "age": 2.4218768590000002, 2023-08-01T19:55:03.830 INFO:teuthology.orchestra.run.smithi008.stdout: "duration": 0.016125830000000001, 2023-08-01T19:55:03.830 INFO:teuthology.orchestra.run.smithi008.stdout: "type_data": { 2023-08-01T19:55:03.830 INFO:teuthology.orchestra.run.smithi008.stdout: "flag_point": "commit sent; apply or cleanup", 2023-08-01T19:55:03.830 INFO:teuthology.orchestra.run.smithi008.stdout: "events": [ 2023-08-01T19:55:03.831 INFO:teuthology.orchestra.run.smithi008.stdout: { 2023-08-01T19:55:03.831 INFO:teuthology.orchestra.run.smithi008.stdout: "event": "initiated", 2023-08-01T19:55:03.831 INFO:teuthology.orchestra.run.smithi008.stdout: "time": "2023-08-01T19:55:01.260461+0000", 2023-08-01T19:55:03.831 INFO:teuthology.orchestra.run.smithi008.stdout: "duration": 0 2023-08-01T19:55:03.831 INFO:teuthology.orchestra.run.smithi008.stdout: }, 2023-08-01T19:55:03.831 INFO:teuthology.orchestra.run.smithi008.stdout: { 2023-08-01T19:55:03.831 INFO:teuthology.orchestra.run.smithi008.stdout: "event": "throttled", 2023-08-01T19:55:03.831 INFO:teuthology.orchestra.run.smithi008.stdout: "time": "2023-08-01T19:55:01.260461+0000", 2023-08-01T19:55:03.832 INFO:teuthology.orchestra.run.smithi008.stdout: "duration": 0 2023-08-01T19:55:03.832 INFO:teuthology.orchestra.run.smithi008.stdout: }, 2023-08-01T19:55:03.832 INFO:teuthology.orchestra.run.smithi008.stdout: { 2023-08-01T19:55:03.832 INFO:teuthology.orchestra.run.smithi008.stdout: "event": "header_read", 2023-08-01T19:55:03.832 INFO:teuthology.orchestra.run.smithi008.stdout: "time": "2023-08-01T19:55:01.260461+0000", 2023-08-01T19:55:03.832 INFO:teuthology.orchestra.run.smithi008.stdout: "duration": 4294967295.9999995 2023-08-01T19:55:03.832 INFO:teuthology.orchestra.run.smithi008.stdout: }, 2023-08-01T19:55:03.832 INFO:teuthology.orchestra.run.smithi008.stdout: { 2023-08-01T19:55:03.833 INFO:teuthology.orchestra.run.smithi008.stdout: "event": "all_read", 2023-08-01T19:55:03.833 INFO:teuthology.orchestra.run.smithi008.stdout: "time": "2023-08-01T19:55:01.260489+0000", 2023-08-01T19:55:03.833 INFO:teuthology.orchestra.run.smithi008.stdout: "duration": 2.8436e-05 2023-08-01T19:55:03.833 INFO:teuthology.orchestra.run.smithi008.stdout: }, 2023-08-01T19:55:03.833 INFO:teuthology.orchestra.run.smithi008.stdout: { 2023-08-01T19:55:03.833 INFO:teuthology.orchestra.run.smithi008.stdout: "event": "dispatched", 2023-08-01T19:55:03.833 INFO:teuthology.orchestra.run.smithi008.stdout: "time": "2023-08-01T19:55:01.260496+0000", 2023-08-01T19:55:03.833 INFO:teuthology.orchestra.run.smithi008.stdout: "duration": 7.0840000000000003e-06 2023-08-01T19:55:03.834 INFO:teuthology.orchestra.run.smithi008.stdout: }, 2023-08-01T19:55:03.834 INFO:teuthology.orchestra.run.smithi008.stdout: { 2023-08-01T19:55:03.834 INFO:teuthology.orchestra.run.smithi008.stdout: "event": "queued_for_pg", 2023-08-01T19:55:03.834 INFO:teuthology.orchestra.run.smithi008.stdout: "time": "2023-08-01T19:55:01.260500+0000", 2023-08-01T19:55:03.834 INFO:teuthology.orchestra.run.smithi008.stdout: "duration": 4.211e-06 2023-08-01T19:55:03.834 INFO:teuthology.orchestra.run.smithi008.stdout: }, 2023-08-01T19:55:03.834 INFO:teuthology.orchestra.run.smithi008.stdout: { 2023-08-01T19:55:03.835 INFO:teuthology.orchestra.run.smithi008.stdout: "event": "reached_pg", 2023-08-01T19:55:03.835 INFO:teuthology.orchestra.run.smithi008.stdout: "time": "2023-08-01T19:55:01.260537+0000", 2023-08-01T19:55:03.835 INFO:teuthology.orchestra.run.smithi008.stdout: "duration": 3.6089e-05 2023-08-01T19:55:03.835 INFO:teuthology.orchestra.run.smithi008.stdout: }, 2023-08-01T19:55:03.835 INFO:teuthology.orchestra.run.smithi008.stdout: { 2023-08-01T19:55:03.835 INFO:teuthology.orchestra.run.smithi008.stdout: "event": "started", 2023-08-01T19:55:03.835 INFO:teuthology.orchestra.run.smithi008.stdout: "time": "2023-08-01T19:55:01.260555+0000", 2023-08-01T19:55:03.835 INFO:teuthology.orchestra.run.smithi008.stdout: "duration": 1.8921000000000001e-05 2023-08-01T19:55:03.836 INFO:teuthology.orchestra.run.smithi008.stdout: }, 2023-08-01T19:55:03.836 INFO:teuthology.orchestra.run.smithi008.stdout: { 2023-08-01T19:55:03.836 INFO:teuthology.orchestra.run.smithi008.stdout: "event": "commit_sent", 2023-08-01T19:55:03.836 INFO:teuthology.orchestra.run.smithi008.stdout: "time": "2023-08-01T19:55:01.276559+0000", 2023-08-01T19:55:03.836 INFO:teuthology.orchestra.run.smithi008.stdout: "duration": 0.016003685 2023-08-01T19:55:03.836 INFO:teuthology.orchestra.run.smithi008.stdout: }, 2023-08-01T19:55:03.836 INFO:teuthology.orchestra.run.smithi008.stdout: { 2023-08-01T19:55:03.836 INFO:teuthology.orchestra.run.smithi008.stdout: "event": "done", 2023-08-01T19:55:03.837 INFO:teuthology.orchestra.run.smithi008.stdout: "time": "2023-08-01T19:55:01.276587+0000", 2023-08-01T19:55:03.837 INFO:teuthology.orchestra.run.smithi008.stdout: "duration": 2.7684000000000001e-05 2023-08-01T19:55:03.837 INFO:teuthology.orchestra.run.smithi008.stdout: } 2023-08-01T19:55:03.837 INFO:teuthology.orchestra.run.smithi008.stdout: ] 2023-08-01T19:55:03.837 INFO:teuthology.orchestra.run.smithi008.stdout: } 2023-08-01T19:55:03.837 INFO:teuthology.orchestra.run.smithi008.stdout: }, 2023-08-01T19:55:03.837 INFO:teuthology.orchestra.run.smithi008.stdout: { 2023-08-01T19:55:03.837 INFO:teuthology.orchestra.run.smithi008.stdout: "description": "osd_op(client.4668.0:92739 5.a 5:5d823a58:::benchmark_data_smithi006_114134_object92738:head [set-alloc-hint object_size 65536 write_size 65536,write 0~65536] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e36)", 2023-08-01T19:55:03.838 INFO:teuthology.orchestra.run.smithi008.stdout: "initiated_at": "2023-08-01T19:55:01.264460+0000", 2023-08-01T19:55:03.838 INFO:teuthology.orchestra.run.smithi008.stdout: "age": 2.4178775429999999, 2023-08-01T19:55:03.838 INFO:teuthology.orchestra.run.smithi008.stdout: "duration": 0.016773421, 2023-08-01T19:55:03.838 INFO:teuthology.orchestra.run.smithi008.stdout: "type_data": { 2023-08-01T19:55:03.838 INFO:teuthology.orchestra.run.smithi008.stdout: "flag_point": "commit sent; apply or cleanup", 2023-08-01T19:55:03.839 INFO:teuthology.orchestra.run.smithi008.stdout: "client_info": { 2023-08-01T19:55:03.839 INFO:teuthology.orchestra.run.smithi008.stdout: "client": "client.4668", 2023-08-01T19:55:03.839 INFO:teuthology.orchestra.run.smithi008.stdout: "client_addr": "172.21.15.6:0/1709472247", 2023-08-01T19:55:03.839 INFO:teuthology.orchestra.run.smithi008.stdout: "tid": 92739 2023-08-01T19:55:03.839 INFO:teuthology.orchestra.run.smithi008.stdout: }, 2023-08-01T19:55:03.839 INFO:teuthology.orchestra.run.smithi008.stdout: "events": [ 2023-08-01T19:55:03.839 INFO:teuthology.orchestra.run.smithi008.stdout: { 2023-08-01T19:55:03.840 INFO:teuthology.orchestra.run.smithi008.stdout: "event": "initiated", 2023-08-01T19:55:03.840 INFO:teuthology.orchestra.run.smithi008.stdout: "time": "2023-08-01T19:55:01.264460+0000", 2023-08-01T19:55:03.840 INFO:teuthology.orchestra.run.smithi008.stdout: "duration": 0 2023-08-01T19:55:03.840 INFO:teuthology.orchestra.run.smithi008.stdout: }, 2023-08-01T19:55:03.840 INFO:teuthology.orchestra.run.smithi008.stdout: { 2023-08-01T19:55:03.840 INFO:teuthology.orchestra.run.smithi008.stdout: "event": "throttled", 2023-08-01T19:55:03.840 INFO:teuthology.orchestra.run.smithi008.stdout: "time": "2023-08-01T19:55:01.264460+0000", 2023-08-01T19:55:03.841 INFO:teuthology.orchestra.run.smithi008.stdout: "duration": 0 2023-08-01T19:55:03.841 INFO:teuthology.orchestra.run.smithi008.stdout: }, 2023-08-01T19:55:03.841 INFO:teuthology.orchestra.run.smithi008.stdout: { 2023-08-01T19:55:03.841 INFO:teuthology.orchestra.run.smithi008.stdout: "event": "header_read", 2023-08-01T19:55:03.841 INFO:teuthology.orchestra.run.smithi008.stdout: "time": "2023-08-01T19:55:01.264459+0000", 2023-08-01T19:55:03.841 INFO:teuthology.orchestra.run.smithi008.stdout: "duration": 4294967295.999999 2023-08-01T19:55:03.841 INFO:teuthology.orchestra.run.smithi008.stdout: }, 2023-08-01T19:55:03.841 INFO:teuthology.orchestra.run.smithi008.stdout: { 2023-08-01T19:55:03.842 INFO:teuthology.orchestra.run.smithi008.stdout: "event": "all_read", 2023-08-01T19:55:03.842 INFO:teuthology.orchestra.run.smithi008.stdout: "time": "2023-08-01T19:55:01.264524+0000", 2023-08-01T19:55:03.842 INFO:teuthology.orchestra.run.smithi008.stdout: "duration": 6.4654999999999997e-05 2023-08-01T19:55:03.842 INFO:teuthology.orchestra.run.smithi008.stdout: }, 2023-08-01T19:55:03.842 INFO:teuthology.orchestra.run.smithi008.stdout: { 2023-08-01T19:55:03.842 INFO:teuthology.orchestra.run.smithi008.stdout: "event": "dispatched", 2023-08-01T19:55:03.842 INFO:teuthology.orchestra.run.smithi008.stdout: "time": "2023-08-01T19:55:01.264536+0000", 2023-08-01T19:55:03.842 INFO:teuthology.orchestra.run.smithi008.stdout: "duration": 1.2133999999999999e-05 2023-08-01T19:55:03.843 INFO:teuthology.orchestra.run.smithi008.stdout: }, 2023-08-01T19:55:03.843 INFO:teuthology.orchestra.run.smithi008.stdout: { 2023-08-01T19:55:03.843 INFO:teuthology.orchestra.run.smithi008.stdout: "event": "queued_for_pg", 2023-08-01T19:55:03.843 INFO:teuthology.orchestra.run.smithi008.stdout: "time": "2023-08-01T19:55:01.264543+0000", 2023-08-01T19:55:03.843 INFO:teuthology.orchestra.run.smithi008.stdout: "duration": 6.4649999999999999e-06 2023-08-01T19:55:03.843 INFO:teuthology.orchestra.run.smithi008.stdout: }, 2023-08-01T19:55:03.843 INFO:teuthology.orchestra.run.smithi008.stdout: { 2023-08-01T19:55:03.844 INFO:teuthology.orchestra.run.smithi008.stdout: "event": "reached_pg", 2023-08-01T19:55:03.844 INFO:teuthology.orchestra.run.smithi008.stdout: "time": "2023-08-01T19:55:01.264579+0000", 2023-08-01T19:55:03.844 INFO:teuthology.orchestra.run.smithi008.stdout: "duration": 3.6093000000000002e-05 2023-08-01T19:55:03.844 INFO:teuthology.orchestra.run.smithi008.stdout: }, 2023-08-01T19:55:03.844 INFO:teuthology.orchestra.run.smithi008.stdout: { 2023-08-01T19:55:03.844 INFO:teuthology.orchestra.run.smithi008.stdout: "event": "started", 2023-08-01T19:55:03.844 INFO:teuthology.orchestra.run.smithi008.stdout: "time": "2023-08-01T19:55:01.264733+0000", 2023-08-01T19:55:03.844 INFO:teuthology.orchestra.run.smithi008.stdout: "duration": 0.00015456700000000001 2023-08-01T19:55:03.845 INFO:teuthology.orchestra.run.smithi008.stdout: }, 2023-08-01T19:55:03.845 INFO:teuthology.orchestra.run.smithi008.stdout: { 2023-08-01T19:55:03.845 INFO:teuthology.orchestra.run.smithi008.stdout: "event": "waiting for subops from 2", 2023-08-01T19:55:03.845 INFO:teuthology.orchestra.run.smithi008.stdout: "time": "2023-08-01T19:55:01.264884+0000", 2023-08-01T19:55:03.845 INFO:teuthology.orchestra.run.smithi008.stdout: "duration": 0.00015044099999999999 2023-08-01T19:55:03.845 INFO:teuthology.orchestra.run.smithi008.stdout: }, 2023-08-01T19:55:03.845 INFO:teuthology.orchestra.run.smithi008.stdout: { 2023-08-01T19:55:03.845 INFO:teuthology.orchestra.run.smithi008.stdout: "event": "sub_op_commit_rec", 2023-08-01T19:55:03.846 INFO:teuthology.orchestra.run.smithi008.stdout: "time": "2023-08-01T19:55:01.272366+0000", 2023-08-01T19:55:03.846 INFO:teuthology.orchestra.run.smithi008.stdout: "duration": 0.0074822760000000004 2023-08-01T19:55:03.846 INFO:teuthology.orchestra.run.smithi008.stdout: }, 2023-08-01T19:55:03.846 INFO:teuthology.orchestra.run.smithi008.stdout: { 2023-08-01T19:55:03.846 INFO:teuthology.orchestra.run.smithi008.stdout: "event": "op_commit", 2023-08-01T19:55:03.846 INFO:teuthology.orchestra.run.smithi008.stdout: "time": "2023-08-01T19:55:01.281157+0000", 2023-08-01T19:55:03.846 INFO:teuthology.orchestra.run.smithi008.stdout: "duration": 0.0087911399999999994 2023-08-01T19:55:03.847 INFO:teuthology.orchestra.run.smithi008.stdout: }, 2023-08-01T19:55:03.847 INFO:teuthology.orchestra.run.smithi008.stdout: { 2023-08-01T19:55:03.847 INFO:teuthology.orchestra.run.smithi008.stdout: "event": "commit_sent", 2023-08-01T19:55:03.847 INFO:teuthology.orchestra.run.smithi008.stdout: "time": "2023-08-01T19:55:01.281198+0000", 2023-08-01T19:55:03.847 INFO:teuthology.orchestra.run.smithi008.stdout: "duration": 4.0623000000000001e-05 2023-08-01T19:55:03.847 INFO:teuthology.orchestra.run.smithi008.stdout: }, 2023-08-01T19:55:03.847 INFO:teuthology.orchestra.run.smithi008.stdout: { 2023-08-01T19:55:03.847 INFO:teuthology.orchestra.run.smithi008.stdout: "event": "done", 2023-08-01T19:55:03.848 INFO:teuthology.orchestra.run.smithi008.stdout: "time": "2023-08-01T19:55:01.281234+0000", 2023-08-01T19:55:03.848 INFO:teuthology.orchestra.run.smithi008.stdout: "duration": 3.5926000000000001e-05 2023-08-01T19:55:03.848 INFO:teuthology.orchestra.run.smithi008.stdout: } 2023-08-01T19:55:03.848 INFO:teuthology.orchestra.run.smithi008.stdout: ] 2023-08-01T19:55:03.848 INFO:teuthology.orchestra.run.smithi008.stdout: } 2023-08-01T19:55:03.848 INFO:teuthology.orchestra.run.smithi008.stdout: }, 2023-08-01T19:55:03.848 INFO:teuthology.orchestra.run.smithi008.stdout: { 2023-08-01T19:55:03.848 INFO:teuthology.orchestra.run.smithi008.stdout: "description": "osd_op(client.4668.0:92740 5.a 5:5cab8b15:::benchmark_data_smithi006_114134_object92739:head [set-alloc-hint object_size 65536 write_size 65536,write 0~65536] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e36)", 2023-08-01T19:55:03.849 INFO:teuthology.orchestra.run.smithi008.stdout: "initiated_at": "2023-08-01T19:55:01.264553+0000", 2023-08-01T19:55:03.849 INFO:teuthology.orchestra.run.smithi008.stdout: "age": 2.4177844739999999, 2023-08-01T19:55:03.849 INFO:teuthology.orchestra.run.smithi008.stdout: "duration": 0.016847885999999999, 2023-08-01T19:55:03.849 INFO:teuthology.orchestra.run.smithi008.stdout: "type_data": { 2023-08-01T19:55:03.849 INFO:teuthology.orchestra.run.smithi008.stdout: "flag_point": "commit sent; apply or cleanup", 2023-08-01T19:55:03.849 INFO:teuthology.orchestra.run.smithi008.stdout: "client_info": { 2023-08-01T19:55:03.849 INFO:teuthology.orchestra.run.smithi008.stdout: "client": "client.4668", 2023-08-01T19:55:03.849 INFO:teuthology.orchestra.run.smithi008.stdout: "client_addr": "172.21.15.6:0/1709472247", 2023-08-01T19:55:03.850 INFO:teuthology.orchestra.run.smithi008.stdout: "tid": 92740 2023-08-01T19:55:03.850 INFO:teuthology.orchestra.run.smithi008.stdout: }, 2023-08-01T19:55:03.850 INFO:teuthology.orchestra.run.smithi008.stdout: "events": [ 2023-08-01T19:55:03.850 INFO:teuthology.orchestra.run.smithi008.stdout: { 2023-08-01T19:55:03.850 INFO:teuthology.orchestra.run.smithi008.stdout: "event": "initiated", 2023-08-01T19:55:03.850 INFO:teuthology.orchestra.run.smithi008.stdout: "time": "2023-08-01T19:55:01.264553+0000", 2023-08-01T19:55:03.850 INFO:teuthology.orchestra.run.smithi008.stdout: "duration": 0 2023-08-01T19:55:03.851 INFO:teuthology.orchestra.run.smithi008.stdout: }, 2023-08-01T19:55:03.851 INFO:teuthology.orchestra.run.smithi008.stdout: { 2023-08-01T19:55:03.851 INFO:teuthology.orchestra.run.smithi008.stdout: "event": "throttled", 2023-08-01T19:55:03.851 INFO:teuthology.orchestra.run.smithi008.stdout: "time": "2023-08-01T19:55:01.264553+0000", 2023-08-01T19:55:03.851 INFO:teuthology.orchestra.run.smithi008.stdout: "duration": 0 2023-08-01T19:55:03.851 INFO:teuthology.orchestra.run.smithi008.stdout: }, 2023-08-01T19:55:03.851 INFO:teuthology.orchestra.run.smithi008.stdout: { 2023-08-01T19:55:03.851 INFO:teuthology.orchestra.run.smithi008.stdout: "event": "header_read", 2023-08-01T19:55:03.852 INFO:teuthology.orchestra.run.smithi008.stdout: "time": "2023-08-01T19:55:01.264553+0000", 2023-08-01T19:55:03.852 INFO:teuthology.orchestra.run.smithi008.stdout: "duration": 4294967295.9999995 2023-08-01T19:55:03.852 INFO:teuthology.orchestra.run.smithi008.stdout: }, 2023-08-01T19:55:03.852 INFO:teuthology.orchestra.run.smithi008.stdout: { 2023-08-01T19:55:03.852 INFO:teuthology.orchestra.run.smithi008.stdout: "event": "all_read", 2023-08-01T19:55:03.852 INFO:teuthology.orchestra.run.smithi008.stdout: "time": "2023-08-01T19:55:01.264583+0000", 2023-08-01T19:55:03.852 INFO:teuthology.orchestra.run.smithi008.stdout: "duration": 3.0164000000000001e-05 2023-08-01T19:55:03.852 INFO:teuthology.orchestra.run.smithi008.stdout: }, 2023-08-01T19:55:03.853 INFO:teuthology.orchestra.run.smithi008.stdout: { 2023-08-01T19:55:03.853 INFO:teuthology.orchestra.run.smithi008.stdout: "event": "dispatched", 2023-08-01T19:55:03.853 INFO:teuthology.orchestra.run.smithi008.stdout: "time": "2023-08-01T19:55:01.264588+0000", 2023-08-01T19:55:03.853 INFO:teuthology.orchestra.run.smithi008.stdout: "duration": 5.3870000000000003e-06 2023-08-01T19:55:03.853 INFO:teuthology.orchestra.run.smithi008.stdout: }, 2023-08-01T19:55:03.853 INFO:teuthology.orchestra.run.smithi008.stdout: { 2023-08-01T19:55:03.853 INFO:teuthology.orchestra.run.smithi008.stdout: "event": "queued_for_pg", 2023-08-01T19:55:03.853 INFO:teuthology.orchestra.run.smithi008.stdout: "time": "2023-08-01T19:55:01.264592+0000", 2023-08-01T19:55:03.854 INFO:teuthology.orchestra.run.smithi008.stdout: "duration": 3.1889999999999999e-06 2023-08-01T19:55:03.854 INFO:teuthology.orchestra.run.smithi008.stdout: }, 2023-08-01T19:55:03.854 INFO:teuthology.orchestra.run.smithi008.stdout: { 2023-08-01T19:55:03.854 INFO:teuthology.orchestra.run.smithi008.stdout: "event": "reached_pg", 2023-08-01T19:55:03.854 INFO:teuthology.orchestra.run.smithi008.stdout: "time": "2023-08-01T19:55:01.270379+0000", 2023-08-01T19:55:03.854 INFO:teuthology.orchestra.run.smithi008.stdout: "duration": 0.0057870830000000002 2023-08-01T19:55:03.854 INFO:teuthology.orchestra.run.smithi008.stdout: }, 2023-08-01T19:55:03.854 INFO:teuthology.orchestra.run.smithi008.stdout: { 2023-08-01T19:55:03.855 INFO:teuthology.orchestra.run.smithi008.stdout: "event": "started", 2023-08-01T19:55:03.855 INFO:teuthology.orchestra.run.smithi008.stdout: "time": "2023-08-01T19:55:01.270535+0000", 2023-08-01T19:55:03.855 INFO:teuthology.orchestra.run.smithi008.stdout: "duration": 0.00015584600000000001 2023-08-01T19:55:03.855 INFO:teuthology.orchestra.run.smithi008.stdout: }, 2023-08-01T19:55:03.855 INFO:teuthology.orchestra.run.smithi008.stdout: { 2023-08-01T19:55:03.855 INFO:teuthology.orchestra.run.smithi008.stdout: "event": "waiting for subops from 2", 2023-08-01T19:55:03.855 INFO:teuthology.orchestra.run.smithi008.stdout: "time": "2023-08-01T19:55:01.270709+0000", 2023-08-01T19:55:03.856 INFO:teuthology.orchestra.run.smithi008.stdout: "duration": 0.00017476899999999999 2023-08-01T19:55:03.856 INFO:teuthology.orchestra.run.smithi008.stdout: }, 2023-08-01T19:55:03.856 INFO:teuthology.orchestra.run.smithi008.stdout: { 2023-08-01T19:55:03.856 INFO:teuthology.orchestra.run.smithi008.stdout: "event": "sub_op_commit_rec", 2023-08-01T19:55:03.856 INFO:teuthology.orchestra.run.smithi008.stdout: "time": "2023-08-01T19:55:01.281150+0000", 2023-08-01T19:55:03.856 INFO:teuthology.orchestra.run.smithi008.stdout: "duration": 0.010440428999999999 2023-08-01T19:55:03.856 INFO:teuthology.orchestra.run.smithi008.stdout: }, 2023-08-01T19:55:03.856 INFO:teuthology.orchestra.run.smithi008.stdout: { 2023-08-01T19:55:03.857 INFO:teuthology.orchestra.run.smithi008.stdout: "event": "op_commit", 2023-08-01T19:55:03.857 INFO:teuthology.orchestra.run.smithi008.stdout: "time": "2023-08-01T19:55:01.281320+0000", 2023-08-01T19:55:03.857 INFO:teuthology.orchestra.run.smithi008.stdout: "duration": 0.00017024600000000001 2023-08-01T19:55:03.857 INFO:teuthology.orchestra.run.smithi008.stdout: }, 2023-08-01T19:55:03.857 INFO:teuthology.orchestra.run.smithi008.stdout: { 2023-08-01T19:55:03.857 INFO:teuthology.orchestra.run.smithi008.stdout: "event": "commit_sent", 2023-08-01T19:55:03.857 INFO:teuthology.orchestra.run.smithi008.stdout: "time": "2023-08-01T19:55:01.281367+0000", 2023-08-01T19:55:03.858 INFO:teuthology.orchestra.run.smithi008.stdout: "duration": 4.7321999999999999e-05 2023-08-01T19:55:03.858 INFO:teuthology.orchestra.run.smithi008.stdout: }, 2023-08-01T19:55:03.858 INFO:teuthology.orchestra.run.smithi008.stdout: { 2023-08-01T19:55:03.858 INFO:teuthology.orchestra.run.smithi008.stdout: "event": "done", 2023-08-01T19:55:03.858 INFO:teuthology.orchestra.run.smithi008.stdout: "time": "2023-08-01T19:55:01.281401+0000", 2023-08-01T19:55:03.858 INFO:teuthology.orchestra.run.smithi008.stdout: "duration": 3.3982000000000001e-05 2023-08-01T19:55:03.858 INFO:teuthology.orchestra.run.smithi008.stdout: } 2023-08-01T19:55:03.858 INFO:teuthology.orchestra.run.smithi008.stdout: ] 2023-08-01T19:55:03.859 INFO:teuthology.orchestra.run.smithi008.stdout: } 2023-08-01T19:55:03.859 INFO:teuthology.orchestra.run.smithi008.stdout: }, 2023-08-01T19:55:03.859 INFO:teuthology.orchestra.run.smithi008.stdout: { 2023-08-01T19:55:03.859 INFO:teuthology.orchestra.run.smithi008.stdout: "description": "osd_op(client.4668.0:92748 5.a 5:5a6df433:::benchmark_data_smithi006_114134_object92747:head [set-alloc-hint object_size 65536 write_size 65536,write 0~65536] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e36)", 2023-08-01T19:55:03.859 INFO:teuthology.orchestra.run.smithi008.stdout: "initiated_at": "2023-08-01T19:55:01.265831+0000", 2023-08-01T19:55:03.859 INFO:teuthology.orchestra.run.smithi008.stdout: "age": 2.4165066839999998, 2023-08-01T19:55:03.859 INFO:teuthology.orchestra.run.smithi008.stdout: "duration": 0.020344932999999999, 2023-08-01T19:55:03.859 INFO:teuthology.orchestra.run.smithi008.stdout: "type_data": { 2023-08-01T19:55:03.860 INFO:teuthology.orchestra.run.smithi008.stdout: "flag_point": "commit sent; apply or cleanup", 2023-08-01T19:55:03.860 INFO:teuthology.orchestra.run.smithi008.stdout: "client_info": { 2023-08-01T19:55:03.860 INFO:teuthology.orchestra.run.smithi008.stdout: "client": "client.4668", 2023-08-01T19:55:03.860 INFO:teuthology.orchestra.run.smithi008.stdout: "client_addr": "172.21.15.6:0/1709472247", 2023-08-01T19:55:03.860 INFO:teuthology.orchestra.run.smithi008.stdout: "tid": 92748 2023-08-01T19:55:03.860 INFO:teuthology.orchestra.run.smithi008.stdout: }, 2023-08-01T19:55:03.860 INFO:teuthology.orchestra.run.smithi008.stdout: "events": [ 2023-08-01T19:55:03.861 INFO:teuthology.orchestra.run.smithi008.stdout: { 2023-08-01T19:55:03.861 INFO:teuthology.orchestra.run.smithi008.stdout: "event": "initiated", 2023-08-01T19:55:03.861 INFO:teuthology.orchestra.run.smithi008.stdout: "time": "2023-08-01T19:55:01.265831+0000", 2023-08-01T19:55:03.861 INFO:teuthology.orchestra.run.smithi008.stdout: "duration": 0 2023-08-01T19:55:03.861 INFO:teuthology.orchestra.run.smithi008.stdout: }, 2023-08-01T19:55:03.861 INFO:teuthology.orchestra.run.smithi008.stdout: { 2023-08-01T19:55:03.861 INFO:teuthology.orchestra.run.smithi008.stdout: "event": "throttled", 2023-08-01T19:55:03.861 INFO:teuthology.orchestra.run.smithi008.stdout: "time": "2023-08-01T19:55:01.265831+0000", 2023-08-01T19:55:03.862 INFO:teuthology.orchestra.run.smithi008.stdout: "duration": 0 2023-08-01T19:55:03.862 INFO:teuthology.orchestra.run.smithi008.stdout: }, 2023-08-01T19:55:03.862 INFO:teuthology.orchestra.run.smithi008.stdout: { 2023-08-01T19:55:03.862 INFO:teuthology.orchestra.run.smithi008.stdout: "event": "header_read", 2023-08-01T19:55:03.862 INFO:teuthology.orchestra.run.smithi008.stdout: "time": "2023-08-01T19:55:01.265831+0000", 2023-08-01T19:55:03.862 INFO:teuthology.orchestra.run.smithi008.stdout: "duration": 4294967295.9999995 2023-08-01T19:55:03.862 INFO:teuthology.orchestra.run.smithi008.stdout: }, 2023-08-01T19:55:03.862 INFO:teuthology.orchestra.run.smithi008.stdout: { 2023-08-01T19:55:03.863 INFO:teuthology.orchestra.run.smithi008.stdout: "event": "all_read", 2023-08-01T19:55:03.863 INFO:teuthology.orchestra.run.smithi008.stdout: "time": "2023-08-01T19:55:01.265912+0000", 2023-08-01T19:55:03.863 INFO:teuthology.orchestra.run.smithi008.stdout: "duration": 8.1255999999999996e-05 2023-08-01T19:55:03.863 INFO:teuthology.orchestra.run.smithi008.stdout: }, 2023-08-01T19:55:03.863 INFO:teuthology.orchestra.run.smithi008.stdout: { 2023-08-01T19:55:03.863 INFO:teuthology.orchestra.run.smithi008.stdout: "event": "dispatched", 2023-08-01T19:55:03.863 INFO:teuthology.orchestra.run.smithi008.stdout: "time": "2023-08-01T19:55:01.265918+0000", 2023-08-01T19:55:03.864 INFO:teuthology.orchestra.run.smithi008.stdout: "duration": 6.6239999999999996e-06 2023-08-01T19:55:03.864 INFO:teuthology.orchestra.run.smithi008.stdout: }, 2023-08-01T19:55:03.864 INFO:teuthology.orchestra.run.smithi008.stdout: { 2023-08-01T19:55:03.864 INFO:teuthology.orchestra.run.smithi008.stdout: "event": "queued_for_pg", 2023-08-01T19:55:03.864 INFO:teuthology.orchestra.run.smithi008.stdout: "time": "2023-08-01T19:55:01.265922+0000", 2023-08-01T19:55:03.864 INFO:teuthology.orchestra.run.smithi008.stdout: "duration": 4.0500000000000002e-06 2023-08-01T19:55:03.864 INFO:teuthology.orchestra.run.smithi008.stdout: }, 2023-08-01T19:55:03.864 INFO:teuthology.orchestra.run.smithi008.stdout: { 2023-08-01T19:55:03.865 INFO:teuthology.orchestra.run.smithi008.stdout: "event": "reached_pg", 2023-08-01T19:55:03.865 INFO:teuthology.orchestra.run.smithi008.stdout: "time": "2023-08-01T19:55:01.274247+0000", 2023-08-01T19:55:03.865 INFO:teuthology.orchestra.run.smithi008.stdout: "duration": 0.0083243710000000005 2023-08-01T19:55:03.865 INFO:teuthology.orchestra.run.smithi008.stdout: }, 2023-08-01T19:55:03.865 INFO:teuthology.orchestra.run.smithi008.stdout: { 2023-08-01T19:55:03.865 INFO:teuthology.orchestra.run.smithi008.stdout: "event": "started", 2023-08-01T19:55:03.865 INFO:teuthology.orchestra.run.smithi008.stdout: "time": "2023-08-01T19:55:01.274401+0000", 2023-08-01T19:55:03.865 INFO:teuthology.orchestra.run.smithi008.stdout: "duration": 0.00015387800000000001 2023-08-01T19:55:03.866 INFO:teuthology.orchestra.run.smithi008.stdout: }, 2023-08-01T19:55:03.866 INFO:teuthology.orchestra.run.smithi008.stdout: { 2023-08-01T19:55:03.866 INFO:teuthology.orchestra.run.smithi008.stdout: "event": "waiting for subops from 2", 2023-08-01T19:55:03.866 INFO:teuthology.orchestra.run.smithi008.stdout: "time": "2023-08-01T19:55:01.274572+0000", 2023-08-01T19:55:03.866 INFO:teuthology.orchestra.run.smithi008.stdout: "duration": 0.00017160600000000001 2023-08-01T19:55:03.866 INFO:teuthology.orchestra.run.smithi008.stdout: }, 2023-08-01T19:55:03.866 INFO:teuthology.orchestra.run.smithi008.stdout: { 2023-08-01T19:55:03.866 INFO:teuthology.orchestra.run.smithi008.stdout: "event": "sub_op_commit_rec", 2023-08-01T19:55:03.867 INFO:teuthology.orchestra.run.smithi008.stdout: "time": "2023-08-01T19:55:01.281281+0000", 2023-08-01T19:55:03.867 INFO:teuthology.orchestra.run.smithi008.stdout: "duration": 0.0067083200000000003 2023-08-01T19:55:03.867 INFO:teuthology.orchestra.run.smithi008.stdout: }, 2023-08-01T19:55:03.867 INFO:teuthology.orchestra.run.smithi008.stdout: { 2023-08-01T19:55:03.867 INFO:teuthology.orchestra.run.smithi008.stdout: "event": "op_commit", 2023-08-01T19:55:03.867 INFO:teuthology.orchestra.run.smithi008.stdout: "time": "2023-08-01T19:55:01.286090+0000", 2023-08-01T19:55:03.867 INFO:teuthology.orchestra.run.smithi008.stdout: "duration": 0.0048095810000000003 2023-08-01T19:55:03.867 INFO:teuthology.orchestra.run.smithi008.stdout: }, 2023-08-01T19:55:03.868 INFO:teuthology.orchestra.run.smithi008.stdout: { 2023-08-01T19:55:03.868 INFO:teuthology.orchestra.run.smithi008.stdout: "event": "commit_sent", 2023-08-01T19:55:03.868 INFO:teuthology.orchestra.run.smithi008.stdout: "time": "2023-08-01T19:55:01.286138+0000", 2023-08-01T19:55:03.868 INFO:teuthology.orchestra.run.smithi008.stdout: "duration": 4.7899000000000003e-05 2023-08-01T19:55:03.868 INFO:teuthology.orchestra.run.smithi008.stdout: }, 2023-08-01T19:55:03.868 INFO:teuthology.orchestra.run.smithi008.stdout: { 2023-08-01T19:55:03.868 INFO:teuthology.orchestra.run.smithi008.stdout: "event": "done", 2023-08-01T19:55:03.869 INFO:teuthology.orchestra.run.smithi008.stdout: "time": "2023-08-01T19:55:01.286176+0000", 2023-08-01T19:55:03.869 INFO:teuthology.orchestra.run.smithi008.stdout: "duration": 3.8037999999999997e-05 2023-08-01T19:55:03.869 INFO:teuthology.orchestra.run.smithi008.stdout: } 2023-08-01T19:55:03.869 INFO:teuthology.orchestra.run.smithi008.stdout: ] 2023-08-01T19:55:03.869 INFO:teuthology.orchestra.run.smithi008.stdout: } 2023-08-01T19:55:03.869 INFO:teuthology.orchestra.run.smithi008.stdout: }, 2023-08-01T19:55:03.869 INFO:teuthology.orchestra.run.smithi008.stdout: { 2023-08-01T19:55:03.869 INFO:teuthology.orchestra.run.smithi008.stdout: "description": "osd_op(client.4668.0:92751 5.a 5:5ba747f8:::benchmark_data_smithi006_114134_object92750:head [set-alloc-hint object_size 65536 write_size 65536,write 0~65536] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e36)", 2023-08-01T19:55:03.870 INFO:teuthology.orchestra.run.smithi008.stdout: "initiated_at": "2023-08-01T19:55:01.267677+0000", 2023-08-01T19:55:03.870 INFO:teuthology.orchestra.run.smithi008.stdout: "age": 2.41466059, 2023-08-01T19:55:03.870 INFO:teuthology.orchestra.run.smithi008.stdout: "duration": 0.01857607, 2023-08-01T19:55:03.870 INFO:teuthology.orchestra.run.smithi008.stdout: "type_data": { 2023-08-01T19:55:03.870 INFO:teuthology.orchestra.run.smithi008.stdout: "flag_point": "commit sent; apply or cleanup", 2023-08-01T19:55:03.870 INFO:teuthology.orchestra.run.smithi008.stdout: "client_info": { 2023-08-01T19:55:03.870 INFO:teuthology.orchestra.run.smithi008.stdout: "client": "client.4668", 2023-08-01T19:55:03.870 INFO:teuthology.orchestra.run.smithi008.stdout: "client_addr": "172.21.15.6:0/1709472247", 2023-08-01T19:55:03.871 INFO:teuthology.orchestra.run.smithi008.stdout: "tid": 92751 2023-08-01T19:55:03.871 INFO:teuthology.orchestra.run.smithi008.stdout: }, 2023-08-01T19:55:03.871 INFO:teuthology.orchestra.run.smithi008.stdout: "events": [ 2023-08-01T19:55:03.871 INFO:teuthology.orchestra.run.smithi008.stdout: { 2023-08-01T19:55:03.871 INFO:teuthology.orchestra.run.smithi008.stdout: "event": "initiated", 2023-08-01T19:55:03.871 INFO:teuthology.orchestra.run.smithi008.stdout: "time": "2023-08-01T19:55:01.267677+0000", 2023-08-01T19:55:03.871 INFO:teuthology.orchestra.run.smithi008.stdout: "duration": 0 2023-08-01T19:55:03.871 INFO:teuthology.orchestra.run.smithi008.stdout: }, 2023-08-01T19:55:03.872 INFO:teuthology.orchestra.run.smithi008.stdout: { 2023-08-01T19:55:03.872 INFO:teuthology.orchestra.run.smithi008.stdout: "event": "throttled", 2023-08-01T19:55:03.872 INFO:teuthology.orchestra.run.smithi008.stdout: "time": "2023-08-01T19:55:01.267677+0000", 2023-08-01T19:55:03.872 INFO:teuthology.orchestra.run.smithi008.stdout: "duration": 0 2023-08-01T19:55:03.872 INFO:teuthology.orchestra.run.smithi008.stdout: }, 2023-08-01T19:55:03.872 INFO:teuthology.orchestra.run.smithi008.stdout: { 2023-08-01T19:55:03.872 INFO:teuthology.orchestra.run.smithi008.stdout: "event": "header_read", 2023-08-01T19:55:03.873 INFO:teuthology.orchestra.run.smithi008.stdout: "time": "2023-08-01T19:55:01.267676+0000", 2023-08-01T19:55:03.873 INFO:teuthology.orchestra.run.smithi008.stdout: "duration": 4294967295.999999 2023-08-01T19:55:03.873 INFO:teuthology.orchestra.run.smithi008.stdout: }, 2023-08-01T19:55:03.873 INFO:teuthology.orchestra.run.smithi008.stdout: { 2023-08-01T19:55:03.873 INFO:teuthology.orchestra.run.smithi008.stdout: "event": "all_read", 2023-08-01T19:55:03.873 INFO:teuthology.orchestra.run.smithi008.stdout: "time": "2023-08-01T19:55:01.267764+0000", 2023-08-01T19:55:03.873 INFO:teuthology.orchestra.run.smithi008.stdout: "duration": 8.7640999999999997e-05 2023-08-01T19:55:03.873 INFO:teuthology.orchestra.run.smithi008.stdout: }, 2023-08-01T19:55:03.874 INFO:teuthology.orchestra.run.smithi008.stdout: { 2023-08-01T19:55:03.874 INFO:teuthology.orchestra.run.smithi008.stdout: "event": "dispatched", 2023-08-01T19:55:03.874 INFO:teuthology.orchestra.run.smithi008.stdout: "time": "2023-08-01T19:55:01.267777+0000", 2023-08-01T19:55:03.874 INFO:teuthology.orchestra.run.smithi008.stdout: "duration": 1.279e-05 2023-08-01T19:55:03.874 INFO:teuthology.orchestra.run.smithi008.stdout: }, 2023-08-01T19:55:03.874 INFO:teuthology.orchestra.run.smithi008.stdout: { 2023-08-01T19:55:03.874 INFO:teuthology.orchestra.run.smithi008.stdout: "event": "queued_for_pg", 2023-08-01T19:55:03.874 INFO:teuthology.orchestra.run.smithi008.stdout: "time": "2023-08-01T19:55:01.267783+0000", 2023-08-01T19:55:03.875 INFO:teuthology.orchestra.run.smithi008.stdout: "duration": 6.246e-06 2023-08-01T19:55:03.875 INFO:teuthology.orchestra.run.smithi008.stdout: }, 2023-08-01T19:55:03.875 INFO:teuthology.orchestra.run.smithi008.stdout: { 2023-08-01T19:55:03.875 INFO:teuthology.orchestra.run.smithi008.stdout: "event": "reached_pg", 2023-08-01T19:55:03.875 INFO:teuthology.orchestra.run.smithi008.stdout: "time": "2023-08-01T19:55:01.276584+0000", 2023-08-01T19:55:03.875 INFO:teuthology.orchestra.run.smithi008.stdout: "duration": 0.0088004180000000008 2023-08-01T19:55:03.875 INFO:teuthology.orchestra.run.smithi008.stdout: }, 2023-08-01T19:55:03.875 INFO:teuthology.orchestra.run.smithi008.stdout: { 2023-08-01T19:55:03.876 INFO:teuthology.orchestra.run.smithi008.stdout: "event": "started", 2023-08-01T19:55:03.876 INFO:teuthology.orchestra.run.smithi008.stdout: "time": "2023-08-01T19:55:01.276717+0000", 2023-08-01T19:55:03.876 INFO:teuthology.orchestra.run.smithi008.stdout: "duration": 0.000133075 2023-08-01T19:55:03.876 INFO:teuthology.orchestra.run.smithi008.stdout: }, 2023-08-01T19:55:03.876 INFO:teuthology.orchestra.run.smithi008.stdout: { 2023-08-01T19:55:03.876 INFO:teuthology.orchestra.run.smithi008.stdout: "event": "waiting for subops from 2", 2023-08-01T19:55:03.876 INFO:teuthology.orchestra.run.smithi008.stdout: "time": "2023-08-01T19:55:01.276876+0000", 2023-08-01T19:55:03.877 INFO:teuthology.orchestra.run.smithi008.stdout: "duration": 0.000159507 2023-08-01T19:55:03.877 INFO:teuthology.orchestra.run.smithi008.stdout: }, 2023-08-01T19:55:03.877 INFO:teuthology.orchestra.run.smithi008.stdout: { 2023-08-01T19:55:03.877 INFO:teuthology.orchestra.run.smithi008.stdout: "event": "sub_op_commit_rec", 2023-08-01T19:55:03.877 INFO:teuthology.orchestra.run.smithi008.stdout: "time": "2023-08-01T19:55:01.281311+0000", 2023-08-01T19:55:03.877 INFO:teuthology.orchestra.run.smithi008.stdout: "duration": 0.0044348720000000003 2023-08-01T19:55:03.877 INFO:teuthology.orchestra.run.smithi008.stdout: }, 2023-08-01T19:55:03.877 INFO:teuthology.orchestra.run.smithi008.stdout: { 2023-08-01T19:55:03.878 INFO:teuthology.orchestra.run.smithi008.stdout: "event": "op_commit", 2023-08-01T19:55:03.878 INFO:teuthology.orchestra.run.smithi008.stdout: "time": "2023-08-01T19:55:01.286186+0000", 2023-08-01T19:55:03.878 INFO:teuthology.orchestra.run.smithi008.stdout: "duration": 0.0048753190000000004 2023-08-01T19:55:03.878 INFO:teuthology.orchestra.run.smithi008.stdout: }, 2023-08-01T19:55:03.878 INFO:teuthology.orchestra.run.smithi008.stdout: { 2023-08-01T19:55:03.878 INFO:teuthology.orchestra.run.smithi008.stdout: "event": "commit_sent", 2023-08-01T19:55:03.878 INFO:teuthology.orchestra.run.smithi008.stdout: "time": "2023-08-01T19:55:01.286222+0000", 2023-08-01T19:55:03.878 INFO:teuthology.orchestra.run.smithi008.stdout: "duration": 3.5618999999999999e-05 2023-08-01T19:55:03.879 INFO:teuthology.orchestra.run.smithi008.stdout: }, 2023-08-01T19:55:03.879 INFO:teuthology.orchestra.run.smithi008.stdout: { 2023-08-01T19:55:03.879 INFO:teuthology.orchestra.run.smithi008.stdout: "event": "done", 2023-08-01T19:55:03.879 INFO:teuthology.orchestra.run.smithi008.stdout: "time": "2023-08-01T19:55:01.286253+0000", 2023-08-01T19:55:03.879 INFO:teuthology.orchestra.run.smithi008.stdout: "duration": 3.1402999999999997e-05 2023-08-01T19:55:03.879 INFO:teuthology.orchestra.run.smithi008.stdout: } 2023-08-01T19:55:03.879 INFO:teuthology.orchestra.run.smithi008.stdout: ] 2023-08-01T19:55:03.879 INFO:teuthology.orchestra.run.smithi008.stdout: } 2023-08-01T19:55:03.880 INFO:teuthology.orchestra.run.smithi008.stdout: }, 2023-08-01T19:55:03.880 INFO:teuthology.orchestra.run.smithi008.stdout: { 2023-08-01T19:55:03.880 INFO:teuthology.orchestra.run.smithi008.stdout: "description": "osd_op(client.4668.0:92752 5.a 5:5b277e4c:::benchmark_data_smithi006_114134_object92751:head [set-alloc-hint object_size 65536 write_size 65536,write 0~65536] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e36)", 2023-08-01T19:55:03.880 INFO:teuthology.orchestra.run.smithi008.stdout: "initiated_at": "2023-08-01T19:55:01.270482+0000", 2023-08-01T19:55:03.880 INFO:teuthology.orchestra.run.smithi008.stdout: "age": 2.4118563389999998, 2023-08-01T19:55:03.880 INFO:teuthology.orchestra.run.smithi008.stdout: "duration": 0.020253584000000002, 2023-08-01T19:55:03.880 INFO:teuthology.orchestra.run.smithi008.stdout: "type_data": { 2023-08-01T19:55:03.881 INFO:teuthology.orchestra.run.smithi008.stdout: "flag_point": "commit sent; apply or cleanup", 2023-08-01T19:55:03.881 INFO:teuthology.orchestra.run.smithi008.stdout: "client_info": { 2023-08-01T19:55:03.881 INFO:teuthology.orchestra.run.smithi008.stdout: "client": "client.4668", 2023-08-01T19:55:03.881 INFO:teuthology.orchestra.run.smithi008.stdout: "client_addr": "172.21.15.6:0/1709472247", 2023-08-01T19:55:03.881 INFO:teuthology.orchestra.run.smithi008.stdout: "tid": 92752 2023-08-01T19:55:03.881 INFO:teuthology.orchestra.run.smithi008.stdout: }, 2023-08-01T19:55:03.881 INFO:teuthology.orchestra.run.smithi008.stdout: "events": [ 2023-08-01T19:55:03.881 INFO:teuthology.orchestra.run.smithi008.stdout: { 2023-08-01T19:55:03.882 INFO:teuthology.orchestra.run.smithi008.stdout: "event": "initiated", 2023-08-01T19:55:03.882 INFO:teuthology.orchestra.run.smithi008.stdout: "time": "2023-08-01T19:55:01.270482+0000", 2023-08-01T19:55:03.882 INFO:teuthology.orchestra.run.smithi008.stdout: "duration": 0 2023-08-01T19:55:03.882 INFO:teuthology.orchestra.run.smithi008.stdout: }, 2023-08-01T19:55:03.882 INFO:teuthology.orchestra.run.smithi008.stdout: { 2023-08-01T19:55:03.882 INFO:teuthology.orchestra.run.smithi008.stdout: "event": "throttled", 2023-08-01T19:55:03.882 INFO:teuthology.orchestra.run.smithi008.stdout: "time": "2023-08-01T19:55:01.270482+0000", 2023-08-01T19:55:03.882 INFO:teuthology.orchestra.run.smithi008.stdout: "duration": 0 2023-08-01T19:55:03.883 INFO:teuthology.orchestra.run.smithi008.stdout: }, 2023-08-01T19:55:03.883 INFO:teuthology.orchestra.run.smithi008.stdout: { 2023-08-01T19:55:03.883 INFO:teuthology.orchestra.run.smithi008.stdout: "event": "header_read", 2023-08-01T19:55:03.883 INFO:teuthology.orchestra.run.smithi008.stdout: "time": "2023-08-01T19:55:01.270481+0000", 2023-08-01T19:55:03.883 INFO:teuthology.orchestra.run.smithi008.stdout: "duration": 4294967295.999999 2023-08-01T19:55:03.883 INFO:teuthology.orchestra.run.smithi008.stdout: }, 2023-08-01T19:55:03.883 INFO:teuthology.orchestra.run.smithi008.stdout: { 2023-08-01T19:55:03.883 INFO:teuthology.orchestra.run.smithi008.stdout: "event": "all_read", 2023-08-01T19:55:03.884 INFO:teuthology.orchestra.run.smithi008.stdout: "time": "2023-08-01T19:55:01.270530+0000", 2023-08-01T19:55:03.884 INFO:teuthology.orchestra.run.smithi008.stdout: "duration": 4.9066000000000001e-05 2023-08-01T19:55:03.884 INFO:teuthology.orchestra.run.smithi008.stdout: }, 2023-08-01T19:55:03.884 INFO:teuthology.orchestra.run.smithi008.stdout: { 2023-08-01T19:55:03.884 INFO:teuthology.orchestra.run.smithi008.stdout: "event": "dispatched", 2023-08-01T19:55:03.884 INFO:teuthology.orchestra.run.smithi008.stdout: "time": "2023-08-01T19:55:01.270538+0000", 2023-08-01T19:55:03.884 INFO:teuthology.orchestra.run.smithi008.stdout: "duration": 8.1890000000000007e-06 2023-08-01T19:55:03.885 INFO:teuthology.orchestra.run.smithi008.stdout: }, 2023-08-01T19:55:03.885 INFO:teuthology.orchestra.run.smithi008.stdout: { 2023-08-01T19:55:03.885 INFO:teuthology.orchestra.run.smithi008.stdout: "event": "queued_for_pg", 2023-08-01T19:55:03.885 INFO:teuthology.orchestra.run.smithi008.stdout: "time": "2023-08-01T19:55:01.270543+0000", 2023-08-01T19:55:03.885 INFO:teuthology.orchestra.run.smithi008.stdout: "duration": 4.5800000000000002e-06 2023-08-01T19:55:03.885 INFO:teuthology.orchestra.run.smithi008.stdout: }, 2023-08-01T19:55:03.885 INFO:teuthology.orchestra.run.smithi008.stdout: { 2023-08-01T19:55:03.885 INFO:teuthology.orchestra.run.smithi008.stdout: "event": "reached_pg", 2023-08-01T19:55:03.886 INFO:teuthology.orchestra.run.smithi008.stdout: "time": "2023-08-01T19:55:01.281425+0000", 2023-08-01T19:55:03.886 INFO:teuthology.orchestra.run.smithi008.stdout: "duration": 0.010882265 2023-08-01T19:55:03.886 INFO:teuthology.orchestra.run.smithi008.stdout: }, 2023-08-01T19:55:03.886 INFO:teuthology.orchestra.run.smithi008.stdout: { 2023-08-01T19:55:03.886 INFO:teuthology.orchestra.run.smithi008.stdout: "event": "started", 2023-08-01T19:55:03.886 INFO:teuthology.orchestra.run.smithi008.stdout: "time": "2023-08-01T19:55:01.281564+0000", 2023-08-01T19:55:03.886 INFO:teuthology.orchestra.run.smithi008.stdout: "duration": 0.00013942300000000001 2023-08-01T19:55:03.886 INFO:teuthology.orchestra.run.smithi008.stdout: }, 2023-08-01T19:55:03.887 INFO:teuthology.orchestra.run.smithi008.stdout: { 2023-08-01T19:55:03.887 INFO:teuthology.orchestra.run.smithi008.stdout: "event": "waiting for subops from 2", 2023-08-01T19:55:03.887 INFO:teuthology.orchestra.run.smithi008.stdout: "time": "2023-08-01T19:55:01.281718+0000", 2023-08-01T19:55:03.887 INFO:teuthology.orchestra.run.smithi008.stdout: "duration": 0.00015354499999999999 2023-08-01T19:55:03.887 INFO:teuthology.orchestra.run.smithi008.stdout: }, 2023-08-01T19:55:03.887 INFO:teuthology.orchestra.run.smithi008.stdout: { 2023-08-01T19:55:03.887 INFO:teuthology.orchestra.run.smithi008.stdout: "event": "sub_op_commit_rec", 2023-08-01T19:55:03.887 INFO:teuthology.orchestra.run.smithi008.stdout: "time": "2023-08-01T19:55:01.286303+0000", 2023-08-01T19:55:03.888 INFO:teuthology.orchestra.run.smithi008.stdout: "duration": 0.0045851650000000004 2023-08-01T19:55:03.888 INFO:teuthology.orchestra.run.smithi008.stdout: }, 2023-08-01T19:55:03.888 INFO:teuthology.orchestra.run.smithi008.stdout: { 2023-08-01T19:55:03.888 INFO:teuthology.orchestra.run.smithi008.stdout: "event": "op_commit", 2023-08-01T19:55:03.888 INFO:teuthology.orchestra.run.smithi008.stdout: "time": "2023-08-01T19:55:01.290628+0000", 2023-08-01T19:55:03.888 INFO:teuthology.orchestra.run.smithi008.stdout: "duration": 0.004324652 2023-08-01T19:55:03.888 INFO:teuthology.orchestra.run.smithi008.stdout: }, 2023-08-01T19:55:03.888 INFO:teuthology.orchestra.run.smithi008.stdout: { 2023-08-01T19:55:03.889 INFO:teuthology.orchestra.run.smithi008.stdout: "event": "commit_sent", 2023-08-01T19:55:03.889 INFO:teuthology.orchestra.run.smithi008.stdout: "time": "2023-08-01T19:55:01.290697+0000", 2023-08-01T19:55:03.889 INFO:teuthology.orchestra.run.smithi008.stdout: "duration": 6.9231000000000002e-05 2023-08-01T19:55:03.889 INFO:teuthology.orchestra.run.smithi008.stdout: }, 2023-08-01T19:55:03.889 INFO:teuthology.orchestra.run.smithi008.stdout: { 2023-08-01T19:55:03.889 INFO:teuthology.orchestra.run.smithi008.stdout: "event": "done", 2023-08-01T19:55:03.889 INFO:teuthology.orchestra.run.smithi008.stdout: "time": "2023-08-01T19:55:01.290735+0000", 2023-08-01T19:55:03.890 INFO:teuthology.orchestra.run.smithi008.stdout: "duration": 3.8343999999999997e-05 2023-08-01T19:55:03.890 INFO:teuthology.orchestra.run.smithi008.stdout: } 2023-08-01T19:55:03.890 INFO:teuthology.orchestra.run.smithi008.stdout: ] 2023-08-01T19:55:03.890 INFO:teuthology.orchestra.run.smithi008.stdout: } 2023-08-01T19:55:03.890 INFO:teuthology.orchestra.run.smithi008.stdout: } 2023-08-01T19:55:03.890 INFO:teuthology.orchestra.run.smithi008.stdout: ] 2023-08-01T19:55:03.890 INFO:teuthology.orchestra.run.smithi008.stdout:} 2023-08-01T19:55:03.892 DEBUG:teuthology.orchestra.run.smithi101:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 30 ceph --cluster ceph --admin-daemon /var/run/ceph/ceph-osd.1.asok dump_ops_in_flight 2023-08-01T19:55:03.892 INFO:tasks.ceph.osd.0.smithi008.stderr:2023-08-01T19:55:03.890+0000 7f16a58f4700 -1 received signal: Hangup from /usr/bin/python3 /bin/daemon-helper kill ceph-osd -f --cluster ceph -i 0 (PID: 111179) UID: 0 2023-08-01T19:55:03.992 INFO:tasks.ceph.osd.1.smithi101.stderr:2023-08-01T19:55:03.991+0000 7fb0cb7f6700 -1 received signal: Hangup from /usr/bin/python3 /bin/daemon-helper kill ceph-osd -f --cluster ceph -i 1 (PID: 111141) UID: 0 2023-08-01T19:55:04.054 INFO:teuthology.orchestra.run.smithi101.stdout:{ 2023-08-01T19:55:04.055 INFO:teuthology.orchestra.run.smithi101.stdout: "ops": [ 2023-08-01T19:55:04.055 INFO:teuthology.orchestra.run.smithi101.stdout: { 2023-08-01T19:55:04.055 INFO:teuthology.orchestra.run.smithi101.stdout: "description": "osd_repop(client.4668.0:98060 5.3 e37/19 5:ccd2aef5:::benchmark_data_smithi006_114134_object98059:head v 37'6201, mlcod=37'6199)", 2023-08-01T19:55:04.055 INFO:teuthology.orchestra.run.smithi101.stdout: "initiated_at": "2023-08-01T19:55:04.048363+0000", 2023-08-01T19:55:04.055 INFO:teuthology.orchestra.run.smithi101.stdout: "age": 0.0043696259999999997, 2023-08-01T19:55:04.056 INFO:teuthology.orchestra.run.smithi101.stdout: "duration": 0.0043933690000000003, 2023-08-01T19:55:04.056 INFO:teuthology.orchestra.run.smithi101.stdout: "type_data": { 2023-08-01T19:55:04.056 INFO:teuthology.orchestra.run.smithi101.stdout: "flag_point": "started", 2023-08-01T19:55:04.056 INFO:teuthology.orchestra.run.smithi101.stdout: "events": [ 2023-08-01T19:55:04.056 INFO:teuthology.orchestra.run.smithi101.stdout: { 2023-08-01T19:55:04.056 INFO:teuthology.orchestra.run.smithi101.stdout: "event": "initiated", 2023-08-01T19:55:04.056 INFO:teuthology.orchestra.run.smithi101.stdout: "time": "2023-08-01T19:55:04.048363+0000", 2023-08-01T19:55:04.057 INFO:teuthology.orchestra.run.smithi101.stdout: "duration": 0 2023-08-01T19:55:04.057 INFO:teuthology.orchestra.run.smithi101.stdout: }, 2023-08-01T19:55:04.057 INFO:teuthology.orchestra.run.smithi101.stdout: { 2023-08-01T19:55:04.057 INFO:teuthology.orchestra.run.smithi101.stdout: "event": "throttled", 2023-08-01T19:55:04.057 INFO:teuthology.orchestra.run.smithi101.stdout: "time": "2023-08-01T19:55:04.048363+0000", 2023-08-01T19:55:04.057 INFO:teuthology.orchestra.run.smithi101.stdout: "duration": 0 2023-08-01T19:55:04.057 INFO:teuthology.orchestra.run.smithi101.stdout: }, 2023-08-01T19:55:04.057 INFO:teuthology.orchestra.run.smithi101.stdout: { 2023-08-01T19:55:04.058 INFO:teuthology.orchestra.run.smithi101.stdout: "event": "header_read", 2023-08-01T19:55:04.058 INFO:teuthology.orchestra.run.smithi101.stdout: "time": "2023-08-01T19:55:04.048362+0000", 2023-08-01T19:55:04.058 INFO:teuthology.orchestra.run.smithi101.stdout: "duration": 4294967295.9999995 2023-08-01T19:55:04.058 INFO:teuthology.orchestra.run.smithi101.stdout: }, 2023-08-01T19:55:04.058 INFO:teuthology.orchestra.run.smithi101.stdout: { 2023-08-01T19:55:04.058 INFO:teuthology.orchestra.run.smithi101.stdout: "event": "all_read", 2023-08-01T19:55:04.058 INFO:teuthology.orchestra.run.smithi101.stdout: "time": "2023-08-01T19:55:04.048400+0000", 2023-08-01T19:55:04.058 INFO:teuthology.orchestra.run.smithi101.stdout: "duration": 3.8204000000000002e-05 2023-08-01T19:55:04.059 INFO:teuthology.orchestra.run.smithi101.stdout: }, 2023-08-01T19:55:04.059 INFO:teuthology.orchestra.run.smithi101.stdout: { 2023-08-01T19:55:04.059 INFO:teuthology.orchestra.run.smithi101.stdout: "event": "dispatched", 2023-08-01T19:55:04.059 INFO:teuthology.orchestra.run.smithi101.stdout: "time": "2023-08-01T19:55:04.048410+0000", 2023-08-01T19:55:04.059 INFO:teuthology.orchestra.run.smithi101.stdout: "duration": 9.9569999999999997e-06 2023-08-01T19:55:04.059 INFO:teuthology.orchestra.run.smithi101.stdout: }, 2023-08-01T19:55:04.059 INFO:teuthology.orchestra.run.smithi101.stdout: { 2023-08-01T19:55:04.059 INFO:teuthology.orchestra.run.smithi101.stdout: "event": "queued_for_pg", 2023-08-01T19:55:04.060 INFO:teuthology.orchestra.run.smithi101.stdout: "time": "2023-08-01T19:55:04.048415+0000", 2023-08-01T19:55:04.060 INFO:teuthology.orchestra.run.smithi101.stdout: "duration": 5.2190000000000003e-06 2023-08-01T19:55:04.060 INFO:teuthology.orchestra.run.smithi101.stdout: }, 2023-08-01T19:55:04.060 INFO:teuthology.orchestra.run.smithi101.stdout: { 2023-08-01T19:55:04.060 INFO:teuthology.orchestra.run.smithi101.stdout: "event": "reached_pg", 2023-08-01T19:55:04.060 INFO:teuthology.orchestra.run.smithi101.stdout: "time": "2023-08-01T19:55:04.048443+0000", 2023-08-01T19:55:04.060 INFO:teuthology.orchestra.run.smithi101.stdout: "duration": 2.7810999999999999e-05 2023-08-01T19:55:04.061 INFO:teuthology.orchestra.run.smithi101.stdout: }, 2023-08-01T19:55:04.061 INFO:teuthology.orchestra.run.smithi101.stdout: { 2023-08-01T19:55:04.061 INFO:teuthology.orchestra.run.smithi101.stdout: "event": "started", 2023-08-01T19:55:04.061 INFO:teuthology.orchestra.run.smithi101.stdout: "time": "2023-08-01T19:55:04.048455+0000", 2023-08-01T19:55:04.061 INFO:teuthology.orchestra.run.smithi101.stdout: "duration": 1.1959e-05 2023-08-01T19:55:04.061 INFO:teuthology.orchestra.run.smithi101.stdout: } 2023-08-01T19:55:04.061 INFO:teuthology.orchestra.run.smithi101.stdout: ] 2023-08-01T19:55:04.061 INFO:teuthology.orchestra.run.smithi101.stdout: } 2023-08-01T19:55:04.062 INFO:teuthology.orchestra.run.smithi101.stdout: }, 2023-08-01T19:55:04.062 INFO:teuthology.orchestra.run.smithi101.stdout: { 2023-08-01T19:55:04.062 INFO:teuthology.orchestra.run.smithi101.stdout: "description": "osd_repop(client.4668.0:98062 5.6 e37/19 5:6083f1a5:::benchmark_data_smithi006_114134_object98061:head v 37'6079, mlcod=37'6071)", 2023-08-01T19:55:04.062 INFO:teuthology.orchestra.run.smithi101.stdout: "initiated_at": "2023-08-01T19:55:04.048427+0000", 2023-08-01T19:55:04.062 INFO:teuthology.orchestra.run.smithi101.stdout: "age": 0.0043056429999999996, 2023-08-01T19:55:04.062 INFO:teuthology.orchestra.run.smithi101.stdout: "duration": 0.0043935579999999997, 2023-08-01T19:55:04.062 INFO:teuthology.orchestra.run.smithi101.stdout: "type_data": { 2023-08-01T19:55:04.062 INFO:teuthology.orchestra.run.smithi101.stdout: "flag_point": "started", 2023-08-01T19:55:04.063 INFO:teuthology.orchestra.run.smithi101.stdout: "events": [ 2023-08-01T19:55:04.063 INFO:teuthology.orchestra.run.smithi101.stdout: { 2023-08-01T19:55:04.063 INFO:teuthology.orchestra.run.smithi101.stdout: "event": "initiated", 2023-08-01T19:55:04.063 INFO:teuthology.orchestra.run.smithi101.stdout: "time": "2023-08-01T19:55:04.048427+0000", 2023-08-01T19:55:04.063 INFO:teuthology.orchestra.run.smithi101.stdout: "duration": 0 2023-08-01T19:55:04.063 INFO:teuthology.orchestra.run.smithi101.stdout: }, 2023-08-01T19:55:04.063 INFO:teuthology.orchestra.run.smithi101.stdout: { 2023-08-01T19:55:04.063 INFO:teuthology.orchestra.run.smithi101.stdout: "event": "throttled", 2023-08-01T19:55:04.064 INFO:teuthology.orchestra.run.smithi101.stdout: "time": "2023-08-01T19:55:04.048427+0000", 2023-08-01T19:55:04.064 INFO:teuthology.orchestra.run.smithi101.stdout: "duration": 0 2023-08-01T19:55:04.064 INFO:teuthology.orchestra.run.smithi101.stdout: }, 2023-08-01T19:55:04.064 INFO:teuthology.orchestra.run.smithi101.stdout: { 2023-08-01T19:55:04.064 INFO:teuthology.orchestra.run.smithi101.stdout: "event": "header_read", 2023-08-01T19:55:04.064 INFO:teuthology.orchestra.run.smithi101.stdout: "time": "2023-08-01T19:55:04.048426+0000", 2023-08-01T19:55:04.064 INFO:teuthology.orchestra.run.smithi101.stdout: "duration": 4294967296 2023-08-01T19:55:04.065 INFO:teuthology.orchestra.run.smithi101.stdout: }, 2023-08-01T19:55:04.065 INFO:teuthology.orchestra.run.smithi101.stdout: { 2023-08-01T19:55:04.065 INFO:teuthology.orchestra.run.smithi101.stdout: "event": "all_read", 2023-08-01T19:55:04.065 INFO:teuthology.orchestra.run.smithi101.stdout: "time": "2023-08-01T19:55:04.048468+0000", 2023-08-01T19:55:04.065 INFO:teuthology.orchestra.run.smithi101.stdout: "duration": 4.1118999999999997e-05 2023-08-01T19:55:04.065 INFO:teuthology.orchestra.run.smithi101.stdout: }, 2023-08-01T19:55:04.065 INFO:teuthology.orchestra.run.smithi101.stdout: { 2023-08-01T19:55:04.065 INFO:teuthology.orchestra.run.smithi101.stdout: "event": "dispatched", 2023-08-01T19:55:04.066 INFO:teuthology.orchestra.run.smithi101.stdout: "time": "2023-08-01T19:55:04.048474+0000", 2023-08-01T19:55:04.066 INFO:teuthology.orchestra.run.smithi101.stdout: "duration": 6.0920000000000003e-06 2023-08-01T19:55:04.066 INFO:teuthology.orchestra.run.smithi101.stdout: }, 2023-08-01T19:55:04.066 INFO:teuthology.orchestra.run.smithi101.stdout: { 2023-08-01T19:55:04.066 INFO:teuthology.orchestra.run.smithi101.stdout: "event": "queued_for_pg", 2023-08-01T19:55:04.066 INFO:teuthology.orchestra.run.smithi101.stdout: "time": "2023-08-01T19:55:04.048476+0000", 2023-08-01T19:55:04.066 INFO:teuthology.orchestra.run.smithi101.stdout: "duration": 2.751e-06 2023-08-01T19:55:04.066 INFO:teuthology.orchestra.run.smithi101.stdout: }, 2023-08-01T19:55:04.067 INFO:teuthology.orchestra.run.smithi101.stdout: { 2023-08-01T19:55:04.067 INFO:teuthology.orchestra.run.smithi101.stdout: "event": "reached_pg", 2023-08-01T19:55:04.067 INFO:teuthology.orchestra.run.smithi101.stdout: "time": "2023-08-01T19:55:04.048505+0000", 2023-08-01T19:55:04.067 INFO:teuthology.orchestra.run.smithi101.stdout: "duration": 2.8702999999999999e-05 2023-08-01T19:55:04.067 INFO:teuthology.orchestra.run.smithi101.stdout: }, 2023-08-01T19:55:04.067 INFO:teuthology.orchestra.run.smithi101.stdout: { 2023-08-01T19:55:04.067 INFO:teuthology.orchestra.run.smithi101.stdout: "event": "started", 2023-08-01T19:55:04.067 INFO:teuthology.orchestra.run.smithi101.stdout: "time": "2023-08-01T19:55:04.048520+0000", 2023-08-01T19:55:04.068 INFO:teuthology.orchestra.run.smithi101.stdout: "duration": 1.5279000000000001e-05 2023-08-01T19:55:04.068 INFO:teuthology.orchestra.run.smithi101.stdout: } 2023-08-01T19:55:04.068 INFO:teuthology.orchestra.run.smithi101.stdout: ] 2023-08-01T19:55:04.068 INFO:teuthology.orchestra.run.smithi101.stdout: } 2023-08-01T19:55:04.068 INFO:teuthology.orchestra.run.smithi101.stdout: }, 2023-08-01T19:55:04.068 INFO:teuthology.orchestra.run.smithi101.stdout: { 2023-08-01T19:55:04.068 INFO:teuthology.orchestra.run.smithi101.stdout: "description": "osd_repop(client.4668.0:98061 5.3 e37/19 5:ce965876:::benchmark_data_smithi006_114134_object98060:head v 37'6202, mlcod=37'6199)", 2023-08-01T19:55:04.068 INFO:teuthology.orchestra.run.smithi101.stdout: "initiated_at": "2023-08-01T19:55:04.048482+0000", 2023-08-01T19:55:04.069 INFO:teuthology.orchestra.run.smithi101.stdout: "age": 0.0042502260000000002, 2023-08-01T19:55:04.069 INFO:teuthology.orchestra.run.smithi101.stdout: "duration": 0.004410481, 2023-08-01T19:55:04.069 INFO:teuthology.orchestra.run.smithi101.stdout: "type_data": { 2023-08-01T19:55:04.069 INFO:teuthology.orchestra.run.smithi101.stdout: "flag_point": "started", 2023-08-01T19:55:04.069 INFO:teuthology.orchestra.run.smithi101.stdout: "events": [ 2023-08-01T19:55:04.069 INFO:teuthology.orchestra.run.smithi101.stdout: { 2023-08-01T19:55:04.069 INFO:teuthology.orchestra.run.smithi101.stdout: "event": "initiated", 2023-08-01T19:55:04.069 INFO:teuthology.orchestra.run.smithi101.stdout: "time": "2023-08-01T19:55:04.048482+0000", 2023-08-01T19:55:04.070 INFO:teuthology.orchestra.run.smithi101.stdout: "duration": 0 2023-08-01T19:55:04.070 INFO:teuthology.orchestra.run.smithi101.stdout: }, 2023-08-01T19:55:04.070 INFO:teuthology.orchestra.run.smithi101.stdout: { 2023-08-01T19:55:04.070 INFO:teuthology.orchestra.run.smithi101.stdout: "event": "throttled", 2023-08-01T19:55:04.070 INFO:teuthology.orchestra.run.smithi101.stdout: "time": "2023-08-01T19:55:04.048482+0000", 2023-08-01T19:55:04.070 INFO:teuthology.orchestra.run.smithi101.stdout: "duration": 0 2023-08-01T19:55:04.070 INFO:teuthology.orchestra.run.smithi101.stdout: }, 2023-08-01T19:55:04.070 INFO:teuthology.orchestra.run.smithi101.stdout: { 2023-08-01T19:55:04.071 INFO:teuthology.orchestra.run.smithi101.stdout: "event": "header_read", 2023-08-01T19:55:04.071 INFO:teuthology.orchestra.run.smithi101.stdout: "time": "2023-08-01T19:55:04.048482+0000", 2023-08-01T19:55:04.071 INFO:teuthology.orchestra.run.smithi101.stdout: "duration": 4294967295.9999995 2023-08-01T19:55:04.071 INFO:teuthology.orchestra.run.smithi101.stdout: }, 2023-08-01T19:55:04.071 INFO:teuthology.orchestra.run.smithi101.stdout: { 2023-08-01T19:55:04.071 INFO:teuthology.orchestra.run.smithi101.stdout: "event": "all_read", 2023-08-01T19:55:04.071 INFO:teuthology.orchestra.run.smithi101.stdout: "time": "2023-08-01T19:55:04.048523+0000", 2023-08-01T19:55:04.072 INFO:teuthology.orchestra.run.smithi101.stdout: "duration": 4.1025000000000001e-05 2023-08-01T19:55:04.072 INFO:teuthology.orchestra.run.smithi101.stdout: }, 2023-08-01T19:55:04.072 INFO:teuthology.orchestra.run.smithi101.stdout: { 2023-08-01T19:55:04.072 INFO:teuthology.orchestra.run.smithi101.stdout: "event": "dispatched", 2023-08-01T19:55:04.072 INFO:teuthology.orchestra.run.smithi101.stdout: "time": "2023-08-01T19:55:04.048527+0000", 2023-08-01T19:55:04.072 INFO:teuthology.orchestra.run.smithi101.stdout: "duration": 4.5630000000000002e-06 2023-08-01T19:55:04.072 INFO:teuthology.orchestra.run.smithi101.stdout: }, 2023-08-01T19:55:04.072 INFO:teuthology.orchestra.run.smithi101.stdout: { 2023-08-01T19:55:04.073 INFO:teuthology.orchestra.run.smithi101.stdout: "event": "queued_for_pg", 2023-08-01T19:55:04.073 INFO:teuthology.orchestra.run.smithi101.stdout: "time": "2023-08-01T19:55:04.048530+0000", 2023-08-01T19:55:04.073 INFO:teuthology.orchestra.run.smithi101.stdout: "duration": 2.542e-06 2023-08-01T19:55:04.073 INFO:teuthology.orchestra.run.smithi101.stdout: }, 2023-08-01T19:55:04.073 INFO:teuthology.orchestra.run.smithi101.stdout: { 2023-08-01T19:55:04.073 INFO:teuthology.orchestra.run.smithi101.stdout: "event": "reached_pg", 2023-08-01T19:55:04.073 INFO:teuthology.orchestra.run.smithi101.stdout: "time": "2023-08-01T19:55:04.050280+0000", 2023-08-01T19:55:04.073 INFO:teuthology.orchestra.run.smithi101.stdout: "duration": 0.001749633 2023-08-01T19:55:04.074 INFO:teuthology.orchestra.run.smithi101.stdout: }, 2023-08-01T19:55:04.074 INFO:teuthology.orchestra.run.smithi101.stdout: { 2023-08-01T19:55:04.074 INFO:teuthology.orchestra.run.smithi101.stdout: "event": "started", 2023-08-01T19:55:04.074 INFO:teuthology.orchestra.run.smithi101.stdout: "time": "2023-08-01T19:55:04.050299+0000", 2023-08-01T19:55:04.074 INFO:teuthology.orchestra.run.smithi101.stdout: "duration": 1.9015e-05 2023-08-01T19:55:04.074 INFO:teuthology.orchestra.run.smithi101.stdout: } 2023-08-01T19:55:04.074 INFO:teuthology.orchestra.run.smithi101.stdout: ] 2023-08-01T19:55:04.074 INFO:teuthology.orchestra.run.smithi101.stdout: } 2023-08-01T19:55:04.075 INFO:teuthology.orchestra.run.smithi101.stdout: }, 2023-08-01T19:55:04.075 INFO:teuthology.orchestra.run.smithi101.stdout: { 2023-08-01T19:55:04.075 INFO:teuthology.orchestra.run.smithi101.stdout: "description": "osd_op(client.4668.0:98065 5.1 5:8aac9a1b:::benchmark_data_smithi006_114134_object98064:head [set-alloc-hint object_size 65536 write_size 65536,write 0~65536 in=65536b] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e37)", 2023-08-01T19:55:04.075 INFO:teuthology.orchestra.run.smithi101.stdout: "initiated_at": "2023-08-01T19:55:04.049268+0000", 2023-08-01T19:55:04.075 INFO:teuthology.orchestra.run.smithi101.stdout: "age": 0.0034644319999999999, 2023-08-01T19:55:04.075 INFO:teuthology.orchestra.run.smithi101.stdout: "duration": 0.0036973560000000002, 2023-08-01T19:55:04.075 INFO:teuthology.orchestra.run.smithi101.stdout: "type_data": { 2023-08-01T19:55:04.075 INFO:teuthology.orchestra.run.smithi101.stdout: "flag_point": "waiting for sub ops", 2023-08-01T19:55:04.076 INFO:teuthology.orchestra.run.smithi101.stdout: "client_info": { 2023-08-01T19:55:04.076 INFO:teuthology.orchestra.run.smithi101.stdout: "client": "client.4668", 2023-08-01T19:55:04.076 INFO:teuthology.orchestra.run.smithi101.stdout: "client_addr": "172.21.15.6:0/1709472247", 2023-08-01T19:55:04.076 INFO:teuthology.orchestra.run.smithi101.stdout: "tid": 98065 2023-08-01T19:55:04.076 INFO:teuthology.orchestra.run.smithi101.stdout: }, 2023-08-01T19:55:04.076 INFO:teuthology.orchestra.run.smithi101.stdout: "events": [ 2023-08-01T19:55:04.076 INFO:teuthology.orchestra.run.smithi101.stdout: { 2023-08-01T19:55:04.077 INFO:teuthology.orchestra.run.smithi101.stdout: "event": "initiated", 2023-08-01T19:55:04.077 INFO:teuthology.orchestra.run.smithi101.stdout: "time": "2023-08-01T19:55:04.049268+0000", 2023-08-01T19:55:04.077 INFO:teuthology.orchestra.run.smithi101.stdout: "duration": 0 2023-08-01T19:55:04.077 INFO:teuthology.orchestra.run.smithi101.stdout: }, 2023-08-01T19:55:04.077 INFO:teuthology.orchestra.run.smithi101.stdout: { 2023-08-01T19:55:04.077 INFO:teuthology.orchestra.run.smithi101.stdout: "event": "throttled", 2023-08-01T19:55:04.077 INFO:teuthology.orchestra.run.smithi101.stdout: "time": "2023-08-01T19:55:04.049268+0000", 2023-08-01T19:55:04.077 INFO:teuthology.orchestra.run.smithi101.stdout: "duration": 0 2023-08-01T19:55:04.078 INFO:teuthology.orchestra.run.smithi101.stdout: }, 2023-08-01T19:55:04.078 INFO:teuthology.orchestra.run.smithi101.stdout: { 2023-08-01T19:55:04.078 INFO:teuthology.orchestra.run.smithi101.stdout: "event": "header_read", 2023-08-01T19:55:04.078 INFO:teuthology.orchestra.run.smithi101.stdout: "time": "2023-08-01T19:55:04.049267+0000", 2023-08-01T19:55:04.078 INFO:teuthology.orchestra.run.smithi101.stdout: "duration": 4294967295.999999 2023-08-01T19:55:04.078 INFO:teuthology.orchestra.run.smithi101.stdout: }, 2023-08-01T19:55:04.078 INFO:teuthology.orchestra.run.smithi101.stdout: { 2023-08-01T19:55:04.078 INFO:teuthology.orchestra.run.smithi101.stdout: "event": "all_read", 2023-08-01T19:55:04.079 INFO:teuthology.orchestra.run.smithi101.stdout: "time": "2023-08-01T19:55:04.049367+0000", 2023-08-01T19:55:04.079 INFO:teuthology.orchestra.run.smithi101.stdout: "duration": 0.000100312 2023-08-01T19:55:04.079 INFO:teuthology.orchestra.run.smithi101.stdout: }, 2023-08-01T19:55:04.079 INFO:teuthology.orchestra.run.smithi101.stdout: { 2023-08-01T19:55:04.079 INFO:teuthology.orchestra.run.smithi101.stdout: "event": "dispatched", 2023-08-01T19:55:04.079 INFO:teuthology.orchestra.run.smithi101.stdout: "time": "2023-08-01T19:55:04.049376+0000", 2023-08-01T19:55:04.079 INFO:teuthology.orchestra.run.smithi101.stdout: "duration": 9.0469999999999999e-06 2023-08-01T19:55:04.079 INFO:teuthology.orchestra.run.smithi101.stdout: }, 2023-08-01T19:55:04.080 INFO:teuthology.orchestra.run.smithi101.stdout: { 2023-08-01T19:55:04.080 INFO:teuthology.orchestra.run.smithi101.stdout: "event": "queued_for_pg", 2023-08-01T19:55:04.080 INFO:teuthology.orchestra.run.smithi101.stdout: "time": "2023-08-01T19:55:04.049381+0000", 2023-08-01T19:55:04.080 INFO:teuthology.orchestra.run.smithi101.stdout: "duration": 4.2769999999999999e-06 2023-08-01T19:55:04.080 INFO:teuthology.orchestra.run.smithi101.stdout: }, 2023-08-01T19:55:04.080 INFO:teuthology.orchestra.run.smithi101.stdout: { 2023-08-01T19:55:04.080 INFO:teuthology.orchestra.run.smithi101.stdout: "event": "reached_pg", 2023-08-01T19:55:04.081 INFO:teuthology.orchestra.run.smithi101.stdout: "time": "2023-08-01T19:55:04.049407+0000", 2023-08-01T19:55:04.081 INFO:teuthology.orchestra.run.smithi101.stdout: "duration": 2.6543e-05 2023-08-01T19:55:04.081 INFO:teuthology.orchestra.run.smithi101.stdout: }, 2023-08-01T19:55:04.081 INFO:teuthology.orchestra.run.smithi101.stdout: { 2023-08-01T19:55:04.081 INFO:teuthology.orchestra.run.smithi101.stdout: "event": "started", 2023-08-01T19:55:04.081 INFO:teuthology.orchestra.run.smithi101.stdout: "time": "2023-08-01T19:55:04.049508+0000", 2023-08-01T19:55:04.081 INFO:teuthology.orchestra.run.smithi101.stdout: "duration": 0.00010057500000000001 2023-08-01T19:55:04.081 INFO:teuthology.orchestra.run.smithi101.stdout: }, 2023-08-01T19:55:04.082 INFO:teuthology.orchestra.run.smithi101.stdout: { 2023-08-01T19:55:04.082 INFO:teuthology.orchestra.run.smithi101.stdout: "event": "waiting for subops from 0", 2023-08-01T19:55:04.082 INFO:teuthology.orchestra.run.smithi101.stdout: "time": "2023-08-01T19:55:04.049622+0000", 2023-08-01T19:55:04.082 INFO:teuthology.orchestra.run.smithi101.stdout: "duration": 0.00011453100000000001 2023-08-01T19:55:04.082 INFO:teuthology.orchestra.run.smithi101.stdout: } 2023-08-01T19:55:04.082 INFO:teuthology.orchestra.run.smithi101.stdout: ] 2023-08-01T19:55:04.082 INFO:teuthology.orchestra.run.smithi101.stdout: } 2023-08-01T19:55:04.082 INFO:teuthology.orchestra.run.smithi101.stdout: }, 2023-08-01T19:55:04.083 INFO:teuthology.orchestra.run.smithi101.stdout: { 2023-08-01T19:55:04.083 INFO:teuthology.orchestra.run.smithi101.stdout: "description": "osd_op(client.4668.0:98068 5.2 5:4105f93d:::benchmark_data_smithi006_114134_object98067:head [set-alloc-hint object_size 65536 write_size 65536,write 0~65536 in=65536b] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e37)", 2023-08-01T19:55:04.083 INFO:teuthology.orchestra.run.smithi101.stdout: "initiated_at": "2023-08-01T19:55:04.049464+0000", 2023-08-01T19:55:04.083 INFO:teuthology.orchestra.run.smithi101.stdout: "age": 0.0032681099999999999, 2023-08-01T19:55:04.083 INFO:teuthology.orchestra.run.smithi101.stdout: "duration": 0.0036005999999999998, 2023-08-01T19:55:04.083 INFO:teuthology.orchestra.run.smithi101.stdout: "type_data": { 2023-08-01T19:55:04.083 INFO:teuthology.orchestra.run.smithi101.stdout: "flag_point": "waiting for sub ops", 2023-08-01T19:55:04.083 INFO:teuthology.orchestra.run.smithi101.stdout: "client_info": { 2023-08-01T19:55:04.084 INFO:teuthology.orchestra.run.smithi101.stdout: "client": "client.4668", 2023-08-01T19:55:04.084 INFO:teuthology.orchestra.run.smithi101.stdout: "client_addr": "172.21.15.6:0/1709472247", 2023-08-01T19:55:04.084 INFO:teuthology.orchestra.run.smithi101.stdout: "tid": 98068 2023-08-01T19:55:04.084 INFO:teuthology.orchestra.run.smithi101.stdout: }, 2023-08-01T19:55:04.084 INFO:teuthology.orchestra.run.smithi101.stdout: "events": [ 2023-08-01T19:55:04.084 INFO:teuthology.orchestra.run.smithi101.stdout: { 2023-08-01T19:55:04.084 INFO:teuthology.orchestra.run.smithi101.stdout: "event": "initiated", 2023-08-01T19:55:04.085 INFO:teuthology.orchestra.run.smithi101.stdout: "time": "2023-08-01T19:55:04.049464+0000", 2023-08-01T19:55:04.085 INFO:teuthology.orchestra.run.smithi101.stdout: "duration": 0 2023-08-01T19:55:04.085 INFO:teuthology.orchestra.run.smithi101.stdout: }, 2023-08-01T19:55:04.085 INFO:teuthology.orchestra.run.smithi101.stdout: { 2023-08-01T19:55:04.085 INFO:teuthology.orchestra.run.smithi101.stdout: "event": "throttled", 2023-08-01T19:55:04.085 INFO:teuthology.orchestra.run.smithi101.stdout: "time": "2023-08-01T19:55:04.049464+0000", 2023-08-01T19:55:04.085 INFO:teuthology.orchestra.run.smithi101.stdout: "duration": 0 2023-08-01T19:55:04.085 INFO:teuthology.orchestra.run.smithi101.stdout: }, 2023-08-01T19:55:04.086 INFO:teuthology.orchestra.run.smithi101.stdout: { 2023-08-01T19:55:04.086 INFO:teuthology.orchestra.run.smithi101.stdout: "event": "header_read", 2023-08-01T19:55:04.086 INFO:teuthology.orchestra.run.smithi101.stdout: "time": "2023-08-01T19:55:04.049464+0000", 2023-08-01T19:55:04.086 INFO:teuthology.orchestra.run.smithi101.stdout: "duration": 4294967295.9999995 2023-08-01T19:55:04.086 INFO:teuthology.orchestra.run.smithi101.stdout: }, 2023-08-01T19:55:04.086 INFO:teuthology.orchestra.run.smithi101.stdout: { 2023-08-01T19:55:04.086 INFO:teuthology.orchestra.run.smithi101.stdout: "event": "all_read", 2023-08-01T19:55:04.086 INFO:teuthology.orchestra.run.smithi101.stdout: "time": "2023-08-01T19:55:04.049528+0000", 2023-08-01T19:55:04.087 INFO:teuthology.orchestra.run.smithi101.stdout: "duration": 6.4125e-05 2023-08-01T19:55:04.087 INFO:teuthology.orchestra.run.smithi101.stdout: }, 2023-08-01T19:55:04.087 INFO:teuthology.orchestra.run.smithi101.stdout: { 2023-08-01T19:55:04.087 INFO:teuthology.orchestra.run.smithi101.stdout: "event": "dispatched", 2023-08-01T19:55:04.087 INFO:teuthology.orchestra.run.smithi101.stdout: "time": "2023-08-01T19:55:04.049536+0000", 2023-08-01T19:55:04.087 INFO:teuthology.orchestra.run.smithi101.stdout: "duration": 8.2979999999999992e-06 2023-08-01T19:55:04.087 INFO:teuthology.orchestra.run.smithi101.stdout: }, 2023-08-01T19:55:04.087 INFO:teuthology.orchestra.run.smithi101.stdout: { 2023-08-01T19:55:04.088 INFO:teuthology.orchestra.run.smithi101.stdout: "event": "queued_for_pg", 2023-08-01T19:55:04.088 INFO:teuthology.orchestra.run.smithi101.stdout: "time": "2023-08-01T19:55:04.049542+0000", 2023-08-01T19:55:04.088 INFO:teuthology.orchestra.run.smithi101.stdout: "duration": 6.0000000000000002e-06 2023-08-01T19:55:04.088 INFO:teuthology.orchestra.run.smithi101.stdout: }, 2023-08-01T19:55:04.088 INFO:teuthology.orchestra.run.smithi101.stdout: { 2023-08-01T19:55:04.088 INFO:teuthology.orchestra.run.smithi101.stdout: "event": "reached_pg", 2023-08-01T19:55:04.088 INFO:teuthology.orchestra.run.smithi101.stdout: "time": "2023-08-01T19:55:04.049582+0000", 2023-08-01T19:55:04.088 INFO:teuthology.orchestra.run.smithi101.stdout: "duration": 3.9657999999999999e-05 2023-08-01T19:55:04.089 INFO:teuthology.orchestra.run.smithi101.stdout: }, 2023-08-01T19:55:04.089 INFO:teuthology.orchestra.run.smithi101.stdout: { 2023-08-01T19:55:04.089 INFO:teuthology.orchestra.run.smithi101.stdout: "event": "started", 2023-08-01T19:55:04.089 INFO:teuthology.orchestra.run.smithi101.stdout: "time": "2023-08-01T19:55:04.049703+0000", 2023-08-01T19:55:04.089 INFO:teuthology.orchestra.run.smithi101.stdout: "duration": 0.000121748 2023-08-01T19:55:04.089 INFO:teuthology.orchestra.run.smithi101.stdout: }, 2023-08-01T19:55:04.089 INFO:teuthology.orchestra.run.smithi101.stdout: { 2023-08-01T19:55:04.089 INFO:teuthology.orchestra.run.smithi101.stdout: "event": "waiting for subops from 0", 2023-08-01T19:55:04.090 INFO:teuthology.orchestra.run.smithi101.stdout: "time": "2023-08-01T19:55:04.050054+0000", 2023-08-01T19:55:04.090 INFO:teuthology.orchestra.run.smithi101.stdout: "duration": 0.00035072400000000001 2023-08-01T19:55:04.090 INFO:teuthology.orchestra.run.smithi101.stdout: } 2023-08-01T19:55:04.090 INFO:teuthology.orchestra.run.smithi101.stdout: ] 2023-08-01T19:55:04.090 INFO:teuthology.orchestra.run.smithi101.stdout: } 2023-08-01T19:55:04.090 INFO:teuthology.orchestra.run.smithi101.stdout: }, 2023-08-01T19:55:04.090 INFO:teuthology.orchestra.run.smithi101.stdout: { 2023-08-01T19:55:04.090 INFO:teuthology.orchestra.run.smithi101.stdout: "description": "osd_repop(client.4668.0:98066 5.c e37/19 5:3909867a:::benchmark_data_smithi006_114134_object98065:head v 37'6108, mlcod=37'6106)", 2023-08-01T19:55:04.091 INFO:teuthology.orchestra.run.smithi101.stdout: "initiated_at": "2023-08-01T19:55:04.049733+0000", 2023-08-01T19:55:04.091 INFO:teuthology.orchestra.run.smithi101.stdout: "age": 0.0029992119999999998, 2023-08-01T19:55:04.091 INFO:teuthology.orchestra.run.smithi101.stdout: "duration": 0.003417523, 2023-08-01T19:55:04.091 INFO:teuthology.orchestra.run.smithi101.stdout: "type_data": { 2023-08-01T19:55:04.091 INFO:teuthology.orchestra.run.smithi101.stdout: "flag_point": "started", 2023-08-01T19:55:04.091 INFO:teuthology.orchestra.run.smithi101.stdout: "events": [ 2023-08-01T19:55:04.091 INFO:teuthology.orchestra.run.smithi101.stdout: { 2023-08-01T19:55:04.092 INFO:teuthology.orchestra.run.smithi101.stdout: "event": "initiated", 2023-08-01T19:55:04.092 INFO:teuthology.orchestra.run.smithi101.stdout: "time": "2023-08-01T19:55:04.049733+0000", 2023-08-01T19:55:04.092 INFO:teuthology.orchestra.run.smithi101.stdout: "duration": 0 2023-08-01T19:55:04.092 INFO:teuthology.orchestra.run.smithi101.stdout: }, 2023-08-01T19:55:04.092 INFO:teuthology.orchestra.run.smithi101.stdout: { 2023-08-01T19:55:04.092 INFO:teuthology.orchestra.run.smithi101.stdout: "event": "throttled", 2023-08-01T19:55:04.092 INFO:teuthology.orchestra.run.smithi101.stdout: "time": "2023-08-01T19:55:04.049733+0000", 2023-08-01T19:55:04.092 INFO:teuthology.orchestra.run.smithi101.stdout: "duration": 0 2023-08-01T19:55:04.093 INFO:teuthology.orchestra.run.smithi101.stdout: }, 2023-08-01T19:55:04.093 INFO:teuthology.orchestra.run.smithi101.stdout: { 2023-08-01T19:55:04.093 INFO:teuthology.orchestra.run.smithi101.stdout: "event": "header_read", 2023-08-01T19:55:04.093 INFO:teuthology.orchestra.run.smithi101.stdout: "time": "2023-08-01T19:55:04.049733+0000", 2023-08-01T19:55:04.093 INFO:teuthology.orchestra.run.smithi101.stdout: "duration": 4294967295.9999995 2023-08-01T19:55:04.093 INFO:teuthology.orchestra.run.smithi101.stdout: }, 2023-08-01T19:55:04.093 INFO:teuthology.orchestra.run.smithi101.stdout: { 2023-08-01T19:55:04.093 INFO:teuthology.orchestra.run.smithi101.stdout: "event": "all_read", 2023-08-01T19:55:04.094 INFO:teuthology.orchestra.run.smithi101.stdout: "time": "2023-08-01T19:55:04.049799+0000", 2023-08-01T19:55:04.094 INFO:teuthology.orchestra.run.smithi101.stdout: "duration": 6.6044000000000007e-05 2023-08-01T19:55:04.094 INFO:teuthology.orchestra.run.smithi101.stdout: }, 2023-08-01T19:55:04.094 INFO:teuthology.orchestra.run.smithi101.stdout: { 2023-08-01T19:55:04.094 INFO:teuthology.orchestra.run.smithi101.stdout: "event": "dispatched", 2023-08-01T19:55:04.094 INFO:teuthology.orchestra.run.smithi101.stdout: "time": "2023-08-01T19:55:04.049822+0000", 2023-08-01T19:55:04.094 INFO:teuthology.orchestra.run.smithi101.stdout: "duration": 2.3467000000000001e-05 2023-08-01T19:55:04.094 INFO:teuthology.orchestra.run.smithi101.stdout: }, 2023-08-01T19:55:04.095 INFO:teuthology.orchestra.run.smithi101.stdout: { 2023-08-01T19:55:04.095 INFO:teuthology.orchestra.run.smithi101.stdout: "event": "queued_for_pg", 2023-08-01T19:55:04.095 INFO:teuthology.orchestra.run.smithi101.stdout: "time": "2023-08-01T19:55:04.049828+0000", 2023-08-01T19:55:04.095 INFO:teuthology.orchestra.run.smithi101.stdout: "duration": 5.3680000000000001e-06 2023-08-01T19:55:04.095 INFO:teuthology.orchestra.run.smithi101.stdout: }, 2023-08-01T19:55:04.095 INFO:teuthology.orchestra.run.smithi101.stdout: { 2023-08-01T19:55:04.095 INFO:teuthology.orchestra.run.smithi101.stdout: "event": "reached_pg", 2023-08-01T19:55:04.095 INFO:teuthology.orchestra.run.smithi101.stdout: "time": "2023-08-01T19:55:04.049885+0000", 2023-08-01T19:55:04.096 INFO:teuthology.orchestra.run.smithi101.stdout: "duration": 5.7961999999999998e-05 2023-08-01T19:55:04.096 INFO:teuthology.orchestra.run.smithi101.stdout: }, 2023-08-01T19:55:04.096 INFO:teuthology.orchestra.run.smithi101.stdout: { 2023-08-01T19:55:04.096 INFO:teuthology.orchestra.run.smithi101.stdout: "event": "started", 2023-08-01T19:55:04.096 INFO:teuthology.orchestra.run.smithi101.stdout: "time": "2023-08-01T19:55:04.049903+0000", 2023-08-01T19:55:04.096 INFO:teuthology.orchestra.run.smithi101.stdout: "duration": 1.7739000000000001e-05 2023-08-01T19:55:04.096 INFO:teuthology.orchestra.run.smithi101.stdout: } 2023-08-01T19:55:04.097 INFO:teuthology.orchestra.run.smithi101.stdout: ] 2023-08-01T19:55:04.097 INFO:teuthology.orchestra.run.smithi101.stdout: } 2023-08-01T19:55:04.097 INFO:teuthology.orchestra.run.smithi101.stdout: }, 2023-08-01T19:55:04.097 INFO:teuthology.orchestra.run.smithi101.stdout: { 2023-08-01T19:55:04.097 INFO:teuthology.orchestra.run.smithi101.stdout: "description": "osd_repop(client.4668.0:98067 5.d e37/19 5:b8fb7b7f:::benchmark_data_smithi006_114134_object98066:head v 37'5981, mlcod=37'5978)", 2023-08-01T19:55:04.097 INFO:teuthology.orchestra.run.smithi101.stdout: "initiated_at": "2023-08-01T19:55:04.051743+0000", 2023-08-01T19:55:04.097 INFO:teuthology.orchestra.run.smithi101.stdout: "age": 0.00098945700000000001, 2023-08-01T19:55:04.097 INFO:teuthology.orchestra.run.smithi101.stdout: "duration": 0.001485821, 2023-08-01T19:55:04.098 INFO:teuthology.orchestra.run.smithi101.stdout: "type_data": { 2023-08-01T19:55:04.098 INFO:teuthology.orchestra.run.smithi101.stdout: "flag_point": "started", 2023-08-01T19:55:04.098 INFO:teuthology.orchestra.run.smithi101.stdout: "events": [ 2023-08-01T19:55:04.098 INFO:teuthology.orchestra.run.smithi101.stdout: { 2023-08-01T19:55:04.098 INFO:teuthology.orchestra.run.smithi101.stdout: "event": "initiated", 2023-08-01T19:55:04.098 INFO:teuthology.orchestra.run.smithi101.stdout: "time": "2023-08-01T19:55:04.051743+0000", 2023-08-01T19:55:04.098 INFO:teuthology.orchestra.run.smithi101.stdout: "duration": 0 2023-08-01T19:55:04.098 INFO:teuthology.orchestra.run.smithi101.stdout: }, 2023-08-01T19:55:04.099 INFO:teuthology.orchestra.run.smithi101.stdout: { 2023-08-01T19:55:04.099 INFO:teuthology.orchestra.run.smithi101.stdout: "event": "throttled", 2023-08-01T19:55:04.099 INFO:teuthology.orchestra.run.smithi101.stdout: "time": "2023-08-01T19:55:04.051743+0000", 2023-08-01T19:55:04.099 INFO:teuthology.orchestra.run.smithi101.stdout: "duration": 0 2023-08-01T19:55:04.099 INFO:teuthology.orchestra.run.smithi101.stdout: }, 2023-08-01T19:55:04.099 INFO:teuthology.orchestra.run.smithi101.stdout: { 2023-08-01T19:55:04.099 INFO:teuthology.orchestra.run.smithi101.stdout: "event": "header_read", 2023-08-01T19:55:04.099 INFO:teuthology.orchestra.run.smithi101.stdout: "time": "2023-08-01T19:55:04.051742+0000", 2023-08-01T19:55:04.100 INFO:teuthology.orchestra.run.smithi101.stdout: "duration": 4294967295.9999995 2023-08-01T19:55:04.100 INFO:teuthology.orchestra.run.smithi101.stdout: }, 2023-08-01T19:55:04.100 INFO:teuthology.orchestra.run.smithi101.stdout: { 2023-08-01T19:55:04.100 INFO:teuthology.orchestra.run.smithi101.stdout: "event": "all_read", 2023-08-01T19:55:04.100 INFO:teuthology.orchestra.run.smithi101.stdout: "time": "2023-08-01T19:55:04.051766+0000", 2023-08-01T19:55:04.100 INFO:teuthology.orchestra.run.smithi101.stdout: "duration": 2.3467000000000001e-05 2023-08-01T19:55:04.100 INFO:teuthology.orchestra.run.smithi101.stdout: }, 2023-08-01T19:55:04.100 INFO:teuthology.orchestra.run.smithi101.stdout: { 2023-08-01T19:55:04.101 INFO:teuthology.orchestra.run.smithi101.stdout: "event": "dispatched", 2023-08-01T19:55:04.101 INFO:teuthology.orchestra.run.smithi101.stdout: "time": "2023-08-01T19:55:04.051773+0000", 2023-08-01T19:55:04.101 INFO:teuthology.orchestra.run.smithi101.stdout: "duration": 7.2649999999999999e-06 2023-08-01T19:55:04.101 INFO:teuthology.orchestra.run.smithi101.stdout: }, 2023-08-01T19:55:04.101 INFO:teuthology.orchestra.run.smithi101.stdout: { 2023-08-01T19:55:04.101 INFO:teuthology.orchestra.run.smithi101.stdout: "event": "queued_for_pg", 2023-08-01T19:55:04.101 INFO:teuthology.orchestra.run.smithi101.stdout: "time": "2023-08-01T19:55:04.051777+0000", 2023-08-01T19:55:04.101 INFO:teuthology.orchestra.run.smithi101.stdout: "duration": 3.8589999999999998e-06 2023-08-01T19:55:04.102 INFO:teuthology.orchestra.run.smithi101.stdout: }, 2023-08-01T19:55:04.102 INFO:teuthology.orchestra.run.smithi101.stdout: { 2023-08-01T19:55:04.102 INFO:teuthology.orchestra.run.smithi101.stdout: "event": "reached_pg", 2023-08-01T19:55:04.102 INFO:teuthology.orchestra.run.smithi101.stdout: "time": "2023-08-01T19:55:04.051813+0000", 2023-08-01T19:55:04.102 INFO:teuthology.orchestra.run.smithi101.stdout: "duration": 3.6436000000000001e-05 2023-08-01T19:55:04.102 INFO:teuthology.orchestra.run.smithi101.stdout: }, 2023-08-01T19:55:04.102 INFO:teuthology.orchestra.run.smithi101.stdout: { 2023-08-01T19:55:04.102 INFO:teuthology.orchestra.run.smithi101.stdout: "event": "started", 2023-08-01T19:55:04.103 INFO:teuthology.orchestra.run.smithi101.stdout: "time": "2023-08-01T19:55:04.051832+0000", 2023-08-01T19:55:04.103 INFO:teuthology.orchestra.run.smithi101.stdout: "duration": 1.8422000000000001e-05 2023-08-01T19:55:04.103 INFO:teuthology.orchestra.run.smithi101.stdout: } 2023-08-01T19:55:04.103 INFO:teuthology.orchestra.run.smithi101.stdout: ] 2023-08-01T19:55:04.103 INFO:teuthology.orchestra.run.smithi101.stdout: } 2023-08-01T19:55:04.103 INFO:teuthology.orchestra.run.smithi101.stdout: }, 2023-08-01T19:55:04.103 INFO:teuthology.orchestra.run.smithi101.stdout: { 2023-08-01T19:55:04.103 INFO:teuthology.orchestra.run.smithi101.stdout: "description": "osd_repop(client.4668.0:98070 5.3 e37/19 5:c94abb26:::benchmark_data_smithi006_114134_object98069:head v 37'6203, mlcod=37'6199)", 2023-08-01T19:55:04.104 INFO:teuthology.orchestra.run.smithi101.stdout: "initiated_at": "2023-08-01T19:55:04.051902+0000", 2023-08-01T19:55:04.104 INFO:teuthology.orchestra.run.smithi101.stdout: "age": 0.00082995599999999997, 2023-08-01T19:55:04.104 INFO:teuthology.orchestra.run.smithi101.stdout: "duration": 0.001394073, 2023-08-01T19:55:04.104 INFO:teuthology.orchestra.run.smithi101.stdout: "type_data": { 2023-08-01T19:55:04.104 INFO:teuthology.orchestra.run.smithi101.stdout: "flag_point": "started", 2023-08-01T19:55:04.104 INFO:teuthology.orchestra.run.smithi101.stdout: "events": [ 2023-08-01T19:55:04.104 INFO:teuthology.orchestra.run.smithi101.stdout: { 2023-08-01T19:55:04.105 INFO:teuthology.orchestra.run.smithi101.stdout: "event": "initiated", 2023-08-01T19:55:04.105 INFO:teuthology.orchestra.run.smithi101.stdout: "time": "2023-08-01T19:55:04.051902+0000", 2023-08-01T19:55:04.105 INFO:teuthology.orchestra.run.smithi101.stdout: "duration": 0 2023-08-01T19:55:04.105 INFO:teuthology.orchestra.run.smithi101.stdout: }, 2023-08-01T19:55:04.105 INFO:teuthology.orchestra.run.smithi101.stdout: { 2023-08-01T19:55:04.105 INFO:teuthology.orchestra.run.smithi101.stdout: "event": "throttled", 2023-08-01T19:55:04.105 INFO:teuthology.orchestra.run.smithi101.stdout: "time": "2023-08-01T19:55:04.051902+0000", 2023-08-01T19:55:04.105 INFO:teuthology.orchestra.run.smithi101.stdout: "duration": 0 2023-08-01T19:55:04.106 INFO:teuthology.orchestra.run.smithi101.stdout: }, 2023-08-01T19:55:04.106 INFO:teuthology.orchestra.run.smithi101.stdout: { 2023-08-01T19:55:04.106 INFO:teuthology.orchestra.run.smithi101.stdout: "event": "header_read", 2023-08-01T19:55:04.106 INFO:teuthology.orchestra.run.smithi101.stdout: "time": "2023-08-01T19:55:04.051902+0000", 2023-08-01T19:55:04.106 INFO:teuthology.orchestra.run.smithi101.stdout: "duration": 4294967295.9999995 2023-08-01T19:55:04.106 INFO:teuthology.orchestra.run.smithi101.stdout: }, 2023-08-01T19:55:04.106 INFO:teuthology.orchestra.run.smithi101.stdout: { 2023-08-01T19:55:04.106 INFO:teuthology.orchestra.run.smithi101.stdout: "event": "all_read", 2023-08-01T19:55:04.107 INFO:teuthology.orchestra.run.smithi101.stdout: "time": "2023-08-01T19:55:04.051950+0000", 2023-08-01T19:55:04.107 INFO:teuthology.orchestra.run.smithi101.stdout: "duration": 4.8353999999999998e-05 2023-08-01T19:55:04.107 INFO:teuthology.orchestra.run.smithi101.stdout: }, 2023-08-01T19:55:04.107 INFO:teuthology.orchestra.run.smithi101.stdout: { 2023-08-01T19:55:04.107 INFO:teuthology.orchestra.run.smithi101.stdout: "event": "dispatched", 2023-08-01T19:55:04.107 INFO:teuthology.orchestra.run.smithi101.stdout: "time": "2023-08-01T19:55:04.051957+0000", 2023-08-01T19:55:04.107 INFO:teuthology.orchestra.run.smithi101.stdout: "duration": 6.4969999999999998e-06 2023-08-01T19:55:04.107 INFO:teuthology.orchestra.run.smithi101.stdout: }, 2023-08-01T19:55:04.108 INFO:teuthology.orchestra.run.smithi101.stdout: { 2023-08-01T19:55:04.108 INFO:teuthology.orchestra.run.smithi101.stdout: "event": "queued_for_pg", 2023-08-01T19:55:04.108 INFO:teuthology.orchestra.run.smithi101.stdout: "time": "2023-08-01T19:55:04.051960+0000", 2023-08-01T19:55:04.108 INFO:teuthology.orchestra.run.smithi101.stdout: "duration": 2.993e-06 2023-08-01T19:55:04.108 INFO:teuthology.orchestra.run.smithi101.stdout: }, 2023-08-01T19:55:04.108 INFO:teuthology.orchestra.run.smithi101.stdout: { 2023-08-01T19:55:04.108 INFO:teuthology.orchestra.run.smithi101.stdout: "event": "reached_pg", 2023-08-01T19:55:04.109 INFO:teuthology.orchestra.run.smithi101.stdout: "time": "2023-08-01T19:55:04.051988+0000", 2023-08-01T19:55:04.109 INFO:teuthology.orchestra.run.smithi101.stdout: "duration": 2.8654999999999999e-05 2023-08-01T19:55:04.109 INFO:teuthology.orchestra.run.smithi101.stdout: }, 2023-08-01T19:55:04.109 INFO:teuthology.orchestra.run.smithi101.stdout: { 2023-08-01T19:55:04.109 INFO:teuthology.orchestra.run.smithi101.stdout: "event": "started", 2023-08-01T19:55:04.109 INFO:teuthology.orchestra.run.smithi101.stdout: "time": "2023-08-01T19:55:04.052004+0000", 2023-08-01T19:55:04.109 INFO:teuthology.orchestra.run.smithi101.stdout: "duration": 1.5352000000000001e-05 2023-08-01T19:55:04.109 INFO:teuthology.orchestra.run.smithi101.stdout: } 2023-08-01T19:55:04.110 INFO:teuthology.orchestra.run.smithi101.stdout: ] 2023-08-01T19:55:04.110 INFO:teuthology.orchestra.run.smithi101.stdout: } 2023-08-01T19:55:04.110 INFO:teuthology.orchestra.run.smithi101.stdout: }, 2023-08-01T19:55:04.110 INFO:teuthology.orchestra.run.smithi101.stdout: { 2023-08-01T19:55:04.110 INFO:teuthology.orchestra.run.smithi101.stdout: "description": "osd_op(client.4668.0:98072 5.7 5:e906fb02:::benchmark_data_smithi006_114134_object98071:head [set-alloc-hint object_size 65536 write_size 65536,write 0~65536 in=65536b] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e37)", 2023-08-01T19:55:04.110 INFO:teuthology.orchestra.run.smithi101.stdout: "initiated_at": "2023-08-01T19:55:04.052082+0000", 2023-08-01T19:55:04.110 INFO:teuthology.orchestra.run.smithi101.stdout: "age": 0.00065057899999999998, 2023-08-01T19:55:04.110 INFO:teuthology.orchestra.run.smithi101.stdout: "duration": 0.001284072, 2023-08-01T19:55:04.111 INFO:teuthology.orchestra.run.smithi101.stdout: "type_data": { 2023-08-01T19:55:04.111 INFO:teuthology.orchestra.run.smithi101.stdout: "flag_point": "waiting for sub ops", 2023-08-01T19:55:04.111 INFO:teuthology.orchestra.run.smithi101.stdout: "client_info": { 2023-08-01T19:55:04.111 INFO:teuthology.orchestra.run.smithi101.stdout: "client": "client.4668", 2023-08-01T19:55:04.111 INFO:teuthology.orchestra.run.smithi101.stdout: "client_addr": "172.21.15.6:0/1709472247", 2023-08-01T19:55:04.111 INFO:teuthology.orchestra.run.smithi101.stdout: "tid": 98072 2023-08-01T19:55:04.111 INFO:teuthology.orchestra.run.smithi101.stdout: }, 2023-08-01T19:55:04.111 INFO:teuthology.orchestra.run.smithi101.stdout: "events": [ 2023-08-01T19:55:04.112 INFO:teuthology.orchestra.run.smithi101.stdout: { 2023-08-01T19:55:04.112 INFO:teuthology.orchestra.run.smithi101.stdout: "event": "initiated", 2023-08-01T19:55:04.112 INFO:teuthology.orchestra.run.smithi101.stdout: "time": "2023-08-01T19:55:04.052082+0000", 2023-08-01T19:55:04.112 INFO:teuthology.orchestra.run.smithi101.stdout: "duration": 0 2023-08-01T19:55:04.112 INFO:teuthology.orchestra.run.smithi101.stdout: }, 2023-08-01T19:55:04.112 INFO:teuthology.orchestra.run.smithi101.stdout: { 2023-08-01T19:55:04.112 INFO:teuthology.orchestra.run.smithi101.stdout: "event": "throttled", 2023-08-01T19:55:04.113 INFO:teuthology.orchestra.run.smithi101.stdout: "time": "2023-08-01T19:55:04.052082+0000", 2023-08-01T19:55:04.113 INFO:teuthology.orchestra.run.smithi101.stdout: "duration": 0 2023-08-01T19:55:04.113 INFO:teuthology.orchestra.run.smithi101.stdout: }, 2023-08-01T19:55:04.113 INFO:teuthology.orchestra.run.smithi101.stdout: { 2023-08-01T19:55:04.113 INFO:teuthology.orchestra.run.smithi101.stdout: "event": "header_read", 2023-08-01T19:55:04.113 INFO:teuthology.orchestra.run.smithi101.stdout: "time": "2023-08-01T19:55:04.052081+0000", 2023-08-01T19:55:04.113 INFO:teuthology.orchestra.run.smithi101.stdout: "duration": 4294967295.999999 2023-08-01T19:55:04.113 INFO:teuthology.orchestra.run.smithi101.stdout: }, 2023-08-01T19:55:04.114 INFO:teuthology.orchestra.run.smithi101.stdout: { 2023-08-01T19:55:04.114 INFO:teuthology.orchestra.run.smithi101.stdout: "event": "all_read", 2023-08-01T19:55:04.114 INFO:teuthology.orchestra.run.smithi101.stdout: "time": "2023-08-01T19:55:04.052142+0000", 2023-08-01T19:55:04.114 INFO:teuthology.orchestra.run.smithi101.stdout: "duration": 6.1279999999999996e-05 2023-08-01T19:55:04.114 INFO:teuthology.orchestra.run.smithi101.stdout: }, 2023-08-01T19:55:04.114 INFO:teuthology.orchestra.run.smithi101.stdout: { 2023-08-01T19:55:04.114 INFO:teuthology.orchestra.run.smithi101.stdout: "event": "dispatched", 2023-08-01T19:55:04.114 INFO:teuthology.orchestra.run.smithi101.stdout: "time": "2023-08-01T19:55:04.052152+0000", 2023-08-01T19:55:04.115 INFO:teuthology.orchestra.run.smithi101.stdout: "duration": 1.0377000000000001e-05 2023-08-01T19:55:04.115 INFO:teuthology.orchestra.run.smithi101.stdout: }, 2023-08-01T19:55:04.115 INFO:teuthology.orchestra.run.smithi101.stdout: { 2023-08-01T19:55:04.115 INFO:teuthology.orchestra.run.smithi101.stdout: "event": "queued_for_pg", 2023-08-01T19:55:04.115 INFO:teuthology.orchestra.run.smithi101.stdout: "time": "2023-08-01T19:55:04.052158+0000", 2023-08-01T19:55:04.115 INFO:teuthology.orchestra.run.smithi101.stdout: "duration": 5.4469999999999997e-06 2023-08-01T19:55:04.115 INFO:teuthology.orchestra.run.smithi101.stdout: }, 2023-08-01T19:55:04.115 INFO:teuthology.orchestra.run.smithi101.stdout: { 2023-08-01T19:55:04.116 INFO:teuthology.orchestra.run.smithi101.stdout: "event": "reached_pg", 2023-08-01T19:55:04.116 INFO:teuthology.orchestra.run.smithi101.stdout: "time": "2023-08-01T19:55:04.052201+0000", 2023-08-01T19:55:04.116 INFO:teuthology.orchestra.run.smithi101.stdout: "duration": 4.3242999999999999e-05 2023-08-01T19:55:04.116 INFO:teuthology.orchestra.run.smithi101.stdout: }, 2023-08-01T19:55:04.116 INFO:teuthology.orchestra.run.smithi101.stdout: { 2023-08-01T19:55:04.116 INFO:teuthology.orchestra.run.smithi101.stdout: "event": "started", 2023-08-01T19:55:04.116 INFO:teuthology.orchestra.run.smithi101.stdout: "time": "2023-08-01T19:55:04.052346+0000", 2023-08-01T19:55:04.116 INFO:teuthology.orchestra.run.smithi101.stdout: "duration": 0.00014482899999999999 2023-08-01T19:55:04.117 INFO:teuthology.orchestra.run.smithi101.stdout: }, 2023-08-01T19:55:04.117 INFO:teuthology.orchestra.run.smithi101.stdout: { 2023-08-01T19:55:04.117 INFO:teuthology.orchestra.run.smithi101.stdout: "event": "waiting for subops from 0", 2023-08-01T19:55:04.117 INFO:teuthology.orchestra.run.smithi101.stdout: "time": "2023-08-01T19:55:04.052490+0000", 2023-08-01T19:55:04.117 INFO:teuthology.orchestra.run.smithi101.stdout: "duration": 0.000143695 2023-08-01T19:55:04.117 INFO:teuthology.orchestra.run.smithi101.stdout: } 2023-08-01T19:55:04.117 INFO:teuthology.orchestra.run.smithi101.stdout: ] 2023-08-01T19:55:04.117 INFO:teuthology.orchestra.run.smithi101.stdout: } 2023-08-01T19:55:04.118 INFO:teuthology.orchestra.run.smithi101.stdout: }, 2023-08-01T19:55:04.118 INFO:teuthology.orchestra.run.smithi101.stdout: { 2023-08-01T19:55:04.118 INFO:teuthology.orchestra.run.smithi101.stdout: "description": "osd_op(client.4668.0:98073 5.9 5:939d2b6d:::benchmark_data_smithi006_114134_object98072:head [set-alloc-hint object_size 65536 write_size 65536,write 0~65536 in=65536b] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e37)", 2023-08-01T19:55:04.118 INFO:teuthology.orchestra.run.smithi101.stdout: "initiated_at": "2023-08-01T19:55:04.052729+0000", 2023-08-01T19:55:04.118 INFO:teuthology.orchestra.run.smithi101.stdout: "age": 3.3529999999999999e-06, 2023-08-01T19:55:04.118 INFO:teuthology.orchestra.run.smithi101.stdout: "duration": 0.00071819500000000003, 2023-08-01T19:55:04.118 INFO:teuthology.orchestra.run.smithi101.stdout: "type_data": { 2023-08-01T19:55:04.118 INFO:teuthology.orchestra.run.smithi101.stdout: "flag_point": "waiting for sub ops", 2023-08-01T19:55:04.119 INFO:teuthology.orchestra.run.smithi101.stdout: "client_info": { 2023-08-01T19:55:04.119 INFO:teuthology.orchestra.run.smithi101.stdout: "client": "client.4668", 2023-08-01T19:55:04.119 INFO:teuthology.orchestra.run.smithi101.stdout: "client_addr": "172.21.15.6:0/1709472247", 2023-08-01T19:55:04.119 INFO:teuthology.orchestra.run.smithi101.stdout: "tid": 98073 2023-08-01T19:55:04.119 INFO:teuthology.orchestra.run.smithi101.stdout: }, 2023-08-01T19:55:04.119 INFO:teuthology.orchestra.run.smithi101.stdout: "events": [ 2023-08-01T19:55:04.119 INFO:teuthology.orchestra.run.smithi101.stdout: { 2023-08-01T19:55:04.119 INFO:teuthology.orchestra.run.smithi101.stdout: "event": "initiated", 2023-08-01T19:55:04.120 INFO:teuthology.orchestra.run.smithi101.stdout: "time": "2023-08-01T19:55:04.052729+0000", 2023-08-01T19:55:04.120 INFO:teuthology.orchestra.run.smithi101.stdout: "duration": 0 2023-08-01T19:55:04.120 INFO:teuthology.orchestra.run.smithi101.stdout: }, 2023-08-01T19:55:04.120 INFO:teuthology.orchestra.run.smithi101.stdout: { 2023-08-01T19:55:04.120 INFO:teuthology.orchestra.run.smithi101.stdout: "event": "throttled", 2023-08-01T19:55:04.120 INFO:teuthology.orchestra.run.smithi101.stdout: "time": "2023-08-01T19:55:04.052729+0000", 2023-08-01T19:55:04.120 INFO:teuthology.orchestra.run.smithi101.stdout: "duration": 0 2023-08-01T19:55:04.121 INFO:teuthology.orchestra.run.smithi101.stdout: }, 2023-08-01T19:55:04.121 INFO:teuthology.orchestra.run.smithi101.stdout: { 2023-08-01T19:55:04.121 INFO:teuthology.orchestra.run.smithi101.stdout: "event": "header_read", 2023-08-01T19:55:04.121 INFO:teuthology.orchestra.run.smithi101.stdout: "time": "2023-08-01T19:55:04.052728+0000", 2023-08-01T19:55:04.121 INFO:teuthology.orchestra.run.smithi101.stdout: "duration": 4294967295.999999 2023-08-01T19:55:04.121 INFO:teuthology.orchestra.run.smithi101.stdout: }, 2023-08-01T19:55:04.121 INFO:teuthology.orchestra.run.smithi101.stdout: { 2023-08-01T19:55:04.121 INFO:teuthology.orchestra.run.smithi101.stdout: "event": "all_read", 2023-08-01T19:55:04.122 INFO:teuthology.orchestra.run.smithi101.stdout: "time": "2023-08-01T19:55:04.052783+0000", 2023-08-01T19:55:04.122 INFO:teuthology.orchestra.run.smithi101.stdout: "duration": 5.5244000000000002e-05 2023-08-01T19:55:04.122 INFO:teuthology.orchestra.run.smithi101.stdout: }, 2023-08-01T19:55:04.122 INFO:teuthology.orchestra.run.smithi101.stdout: { 2023-08-01T19:55:04.122 INFO:teuthology.orchestra.run.smithi101.stdout: "event": "dispatched", 2023-08-01T19:55:04.122 INFO:teuthology.orchestra.run.smithi101.stdout: "time": "2023-08-01T19:55:04.052795+0000", 2023-08-01T19:55:04.122 INFO:teuthology.orchestra.run.smithi101.stdout: "duration": 1.1610999999999999e-05 2023-08-01T19:55:04.122 INFO:teuthology.orchestra.run.smithi101.stdout: }, 2023-08-01T19:55:04.123 INFO:teuthology.orchestra.run.smithi101.stdout: { 2023-08-01T19:55:04.123 INFO:teuthology.orchestra.run.smithi101.stdout: "event": "queued_for_pg", 2023-08-01T19:55:04.123 INFO:teuthology.orchestra.run.smithi101.stdout: "time": "2023-08-01T19:55:04.052801+0000", 2023-08-01T19:55:04.123 INFO:teuthology.orchestra.run.smithi101.stdout: "duration": 6.4779999999999996e-06 2023-08-01T19:55:04.123 INFO:teuthology.orchestra.run.smithi101.stdout: }, 2023-08-01T19:55:04.123 INFO:teuthology.orchestra.run.smithi101.stdout: { 2023-08-01T19:55:04.123 INFO:teuthology.orchestra.run.smithi101.stdout: "event": "reached_pg", 2023-08-01T19:55:04.123 INFO:teuthology.orchestra.run.smithi101.stdout: "time": "2023-08-01T19:55:04.052845+0000", 2023-08-01T19:55:04.124 INFO:teuthology.orchestra.run.smithi101.stdout: "duration": 4.4008999999999998e-05 2023-08-01T19:55:04.124 INFO:teuthology.orchestra.run.smithi101.stdout: }, 2023-08-01T19:55:04.124 INFO:teuthology.orchestra.run.smithi101.stdout: { 2023-08-01T19:55:04.124 INFO:teuthology.orchestra.run.smithi101.stdout: "event": "started", 2023-08-01T19:55:04.124 INFO:teuthology.orchestra.run.smithi101.stdout: "time": "2023-08-01T19:55:04.052982+0000", 2023-08-01T19:55:04.124 INFO:teuthology.orchestra.run.smithi101.stdout: "duration": 0.00013644899999999999 2023-08-01T19:55:04.124 INFO:teuthology.orchestra.run.smithi101.stdout: }, 2023-08-01T19:55:04.124 INFO:teuthology.orchestra.run.smithi101.stdout: { 2023-08-01T19:55:04.125 INFO:teuthology.orchestra.run.smithi101.stdout: "event": "waiting for subops from 2", 2023-08-01T19:55:04.125 INFO:teuthology.orchestra.run.smithi101.stdout: "time": "2023-08-01T19:55:04.053136+0000", 2023-08-01T19:55:04.125 INFO:teuthology.orchestra.run.smithi101.stdout: "duration": 0.00015441599999999999 2023-08-01T19:55:04.125 INFO:teuthology.orchestra.run.smithi101.stdout: } 2023-08-01T19:55:04.125 INFO:teuthology.orchestra.run.smithi101.stdout: ] 2023-08-01T19:55:04.125 INFO:teuthology.orchestra.run.smithi101.stdout: } 2023-08-01T19:55:04.125 INFO:teuthology.orchestra.run.smithi101.stdout: }, 2023-08-01T19:55:04.125 INFO:teuthology.orchestra.run.smithi101.stdout: { 2023-08-01T19:55:04.126 INFO:teuthology.orchestra.run.smithi101.stdout: "description": "osd_repop(client.4668.0:98063 5.d e37/19 5:b4d5f5df:::benchmark_data_smithi006_114134_object98062:head v 37'5980, mlcod=37'5978)", 2023-08-01T19:55:04.126 INFO:teuthology.orchestra.run.smithi101.stdout: "initiated_at": "2023-08-01T19:55:04.047398+0000", 2023-08-01T19:55:04.126 INFO:teuthology.orchestra.run.smithi101.stdout: "age": 0.0053341650000000001, 2023-08-01T19:55:04.126 INFO:teuthology.orchestra.run.smithi101.stdout: "duration": 0.0061266589999999996, 2023-08-01T19:55:04.126 INFO:teuthology.orchestra.run.smithi101.stdout: "type_data": { 2023-08-01T19:55:04.126 INFO:teuthology.orchestra.run.smithi101.stdout: "flag_point": "started", 2023-08-01T19:55:04.126 INFO:teuthology.orchestra.run.smithi101.stdout: "events": [ 2023-08-01T19:55:04.126 INFO:teuthology.orchestra.run.smithi101.stdout: { 2023-08-01T19:55:04.127 INFO:teuthology.orchestra.run.smithi101.stdout: "event": "initiated", 2023-08-01T19:55:04.127 INFO:teuthology.orchestra.run.smithi101.stdout: "time": "2023-08-01T19:55:04.047398+0000", 2023-08-01T19:55:04.127 INFO:teuthology.orchestra.run.smithi101.stdout: "duration": 0 2023-08-01T19:55:04.127 INFO:teuthology.orchestra.run.smithi101.stdout: }, 2023-08-01T19:55:04.127 INFO:teuthology.orchestra.run.smithi101.stdout: { 2023-08-01T19:55:04.127 INFO:teuthology.orchestra.run.smithi101.stdout: "event": "throttled", 2023-08-01T19:55:04.127 INFO:teuthology.orchestra.run.smithi101.stdout: "time": "2023-08-01T19:55:04.047398+0000", 2023-08-01T19:55:04.127 INFO:teuthology.orchestra.run.smithi101.stdout: "duration": 0 2023-08-01T19:55:04.128 INFO:teuthology.orchestra.run.smithi101.stdout: }, 2023-08-01T19:55:04.128 INFO:teuthology.orchestra.run.smithi101.stdout: { 2023-08-01T19:55:04.128 INFO:teuthology.orchestra.run.smithi101.stdout: "event": "header_read", 2023-08-01T19:55:04.128 INFO:teuthology.orchestra.run.smithi101.stdout: "time": "2023-08-01T19:55:04.047398+0000", 2023-08-01T19:55:04.128 INFO:teuthology.orchestra.run.smithi101.stdout: "duration": 4294967295.9999995 2023-08-01T19:55:04.128 INFO:teuthology.orchestra.run.smithi101.stdout: }, 2023-08-01T19:55:04.128 INFO:teuthology.orchestra.run.smithi101.stdout: { 2023-08-01T19:55:04.129 INFO:teuthology.orchestra.run.smithi101.stdout: "event": "all_read", 2023-08-01T19:55:04.129 INFO:teuthology.orchestra.run.smithi101.stdout: "time": "2023-08-01T19:55:04.047454+0000", 2023-08-01T19:55:04.129 INFO:teuthology.orchestra.run.smithi101.stdout: "duration": 5.6425999999999998e-05 2023-08-01T19:55:04.129 INFO:teuthology.orchestra.run.smithi101.stdout: }, 2023-08-01T19:55:04.129 INFO:teuthology.orchestra.run.smithi101.stdout: { 2023-08-01T19:55:04.129 INFO:teuthology.orchestra.run.smithi101.stdout: "event": "dispatched", 2023-08-01T19:55:04.129 INFO:teuthology.orchestra.run.smithi101.stdout: "time": "2023-08-01T19:55:04.047464+0000", 2023-08-01T19:55:04.129 INFO:teuthology.orchestra.run.smithi101.stdout: "duration": 9.7159999999999998e-06 2023-08-01T19:55:04.130 INFO:teuthology.orchestra.run.smithi101.stdout: }, 2023-08-01T19:55:04.130 INFO:teuthology.orchestra.run.smithi101.stdout: { 2023-08-01T19:55:04.130 INFO:teuthology.orchestra.run.smithi101.stdout: "event": "queued_for_pg", 2023-08-01T19:55:04.130 INFO:teuthology.orchestra.run.smithi101.stdout: "time": "2023-08-01T19:55:04.047469+0000", 2023-08-01T19:55:04.130 INFO:teuthology.orchestra.run.smithi101.stdout: "duration": 4.9099999999999996e-06 2023-08-01T19:55:04.130 INFO:teuthology.orchestra.run.smithi101.stdout: }, 2023-08-01T19:55:04.130 INFO:teuthology.orchestra.run.smithi101.stdout: { 2023-08-01T19:55:04.130 INFO:teuthology.orchestra.run.smithi101.stdout: "event": "reached_pg", 2023-08-01T19:55:04.131 INFO:teuthology.orchestra.run.smithi101.stdout: "time": "2023-08-01T19:55:04.047496+0000", 2023-08-01T19:55:04.131 INFO:teuthology.orchestra.run.smithi101.stdout: "duration": 2.7364000000000001e-05 2023-08-01T19:55:04.131 INFO:teuthology.orchestra.run.smithi101.stdout: }, 2023-08-01T19:55:04.131 INFO:teuthology.orchestra.run.smithi101.stdout: { 2023-08-01T19:55:04.131 INFO:teuthology.orchestra.run.smithi101.stdout: "event": "started", 2023-08-01T19:55:04.131 INFO:teuthology.orchestra.run.smithi101.stdout: "time": "2023-08-01T19:55:04.047507+0000", 2023-08-01T19:55:04.131 INFO:teuthology.orchestra.run.smithi101.stdout: "duration": 1.1172000000000001e-05 2023-08-01T19:55:04.131 INFO:teuthology.orchestra.run.smithi101.stdout: } 2023-08-01T19:55:04.132 INFO:teuthology.orchestra.run.smithi101.stdout: ] 2023-08-01T19:55:04.132 INFO:teuthology.orchestra.run.smithi101.stdout: } 2023-08-01T19:55:04.132 INFO:teuthology.orchestra.run.smithi101.stdout: } 2023-08-01T19:55:04.132 INFO:teuthology.orchestra.run.smithi101.stdout: ], 2023-08-01T19:55:04.132 INFO:teuthology.orchestra.run.smithi101.stdout: "num_ops": 11 2023-08-01T19:55:04.132 INFO:teuthology.orchestra.run.smithi101.stdout:} 2023-08-01T19:55:04.133 INFO:tasks.ceph.osd.2.smithi155.stderr:2023-08-01T19:55:04.132+0000 7faa5c6ac700 -1 received signal: Hangup from /usr/bin/python3 /bin/daemon-helper kill ceph-osd -f --cluster ceph -i 2 (PID: 111337) UID: 0 2023-08-01T19:55:04.134 DEBUG:teuthology.orchestra.run.smithi101:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 30 ceph --cluster ceph --admin-daemon /var/run/ceph/ceph-osd.1.asok dump_blocked_ops 2023-08-01T19:55:04.210 INFO:tasks.thrashosds.thrasher:in_osds: [0, 1, 2] out_osds: [] dead_osds: [] live_osds: [0, 1, 2] 2023-08-01T19:55:04.210 INFO:tasks.thrashosds.thrasher:choose_action: min_in 4 min_out 0 min_live 2 min_dead 0 chance_down 1.00 2023-08-01T19:55:04.210 INFO:tasks.thrashosds.thrasher:thrash_pg_upmap_items 2023-08-01T19:55:04.211 DEBUG:teuthology.orchestra.run.smithi006:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 120 ceph --cluster ceph osd dump -f json-pretty 2023-08-01T19:55:04.235 INFO:tasks.ceph.osd.1.smithi101.stderr:2023-08-01T19:55:04.234+0000 7fb0cb7f6700 -1 received signal: Hangup from /usr/bin/python3 /bin/daemon-helper kill ceph-osd -f --cluster ceph -i 1 (PID: 111141) UID: 0 2023-08-01T19:55:04.315 INFO:tasks.radosbench.radosbench.0.smithi006.stdout:2023-08-01T19:55:04.315215+0000 min lat: 0.00127316 max lat: 0.024042 avg lat: 0.00649017 2023-08-01T19:55:04.316 INFO:tasks.radosbench.radosbench.0.smithi006.stdout: sec Cur ops started finished avg MB/s cur MB/s last lat(s) avg lat(s) 2023-08-01T19:55:04.316 INFO:tasks.radosbench.radosbench.0.smithi006.stdout: 40 16 98592 98576 154.013 119.688 0.0090958 0.00649017 2023-08-01T19:55:04.335 INFO:tasks.ceph.osd.0.smithi008.stderr:2023-08-01T19:55:04.334+0000 7f16a58f4700 -1 received signal: Hangup from /usr/bin/python3 /bin/daemon-helper kill ceph-osd -f --cluster ceph -i 0 (PID: 111179) UID: 0 2023-08-01T19:55:04.340 INFO:teuthology.orchestra.run.smithi101.stdout:{ 2023-08-01T19:55:04.341 INFO:teuthology.orchestra.run.smithi101.stdout: "ops": [], 2023-08-01T19:55:04.341 INFO:teuthology.orchestra.run.smithi101.stdout: "complaint_time": 30, 2023-08-01T19:55:04.341 INFO:teuthology.orchestra.run.smithi101.stdout: "num_blocked_ops": 0 2023-08-01T19:55:04.341 INFO:teuthology.orchestra.run.smithi101.stdout:} 2023-08-01T19:55:04.355 DEBUG:teuthology.orchestra.run.smithi101:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 30 ceph --cluster ceph --admin-daemon /var/run/ceph/ceph-osd.1.asok dump_historic_ops 2023-08-01T19:55:04.438 INFO:tasks.ceph.osd.1.smithi101.stderr:2023-08-01T19:55:04.437+0000 7fb0cb7f6700 -1 received signal: Hangup from /usr/bin/python3 /bin/daemon-helper kill ceph-osd -f --cluster ceph -i 1 (PID: 111141) UID: 0 2023-08-01T19:55:04.536 INFO:tasks.ceph.osd.0.smithi008.stderr:2023-08-01T19:55:04.536+0000 7f16a58f4700 -1 received signal: Hangup from /usr/bin/python3 /bin/daemon-helper kill ceph-osd -f --cluster ceph -i 0 (PID: 111179) UID: 0 2023-08-01T19:55:04.560 INFO:teuthology.orchestra.run.smithi006.stdout: 2023-08-01T19:55:04.560 INFO:teuthology.orchestra.run.smithi006.stdout:{ 2023-08-01T19:55:04.560 INFO:teuthology.orchestra.run.smithi006.stdout: "epoch": 37, 2023-08-01T19:55:04.561 INFO:teuthology.orchestra.run.smithi006.stdout: "fsid": "a0e420cc-4df1-42a5-8bd4-a98c309a9349", 2023-08-01T19:55:04.561 INFO:teuthology.orchestra.run.smithi006.stdout: "created": "2023-08-01T19:53:41.279588+0000", 2023-08-01T19:55:04.561 INFO:teuthology.orchestra.run.smithi006.stdout: "modified": "2023-08-01T19:55:03.543395+0000", 2023-08-01T19:55:04.561 INFO:teuthology.orchestra.run.smithi006.stdout: "last_up_change": "2023-08-01T19:53:50.735626+0000", 2023-08-01T19:55:04.561 INFO:teuthology.orchestra.run.smithi006.stdout: "last_in_change": "2023-08-01T19:53:42.974751+0000", 2023-08-01T19:55:04.561 INFO:teuthology.orchestra.run.smithi006.stdout: "flags": "nodeep-scrub,sortbitwise,recovery_deletes,purged_snapdirs,pglog_hardlimit", 2023-08-01T19:55:04.561 INFO:teuthology.orchestra.run.smithi006.stdout: "flags_num": 5804032, 2023-08-01T19:55:04.561 INFO:teuthology.orchestra.run.smithi006.stdout: "flags_set": [ 2023-08-01T19:55:04.562 INFO:teuthology.orchestra.run.smithi006.stdout: "nodeep-scrub", 2023-08-01T19:55:04.562 INFO:teuthology.orchestra.run.smithi006.stdout: "pglog_hardlimit", 2023-08-01T19:55:04.562 INFO:teuthology.orchestra.run.smithi006.stdout: "purged_snapdirs", 2023-08-01T19:55:04.562 INFO:teuthology.orchestra.run.smithi006.stdout: "recovery_deletes", 2023-08-01T19:55:04.562 INFO:teuthology.orchestra.run.smithi006.stdout: "sortbitwise" 2023-08-01T19:55:04.562 INFO:teuthology.orchestra.run.smithi006.stdout: ], 2023-08-01T19:55:04.562 INFO:teuthology.orchestra.run.smithi006.stdout: "crush_version": 5, 2023-08-01T19:55:04.563 INFO:teuthology.orchestra.run.smithi006.stdout: "full_ratio": 0.94999998807907104, 2023-08-01T19:55:04.563 INFO:teuthology.orchestra.run.smithi006.stdout: "backfillfull_ratio": 0.89999997615814209, 2023-08-01T19:55:04.563 INFO:teuthology.orchestra.run.smithi006.stdout: "nearfull_ratio": 0.85000002384185791, 2023-08-01T19:55:04.563 INFO:teuthology.orchestra.run.smithi006.stdout: "cluster_snapshot": "", 2023-08-01T19:55:04.563 INFO:teuthology.orchestra.run.smithi006.stdout: "pool_max": 5, 2023-08-01T19:55:04.563 INFO:teuthology.orchestra.run.smithi006.stdout: "max_osd": 3, 2023-08-01T19:55:04.563 INFO:teuthology.orchestra.run.smithi006.stdout: "require_min_compat_client": "luminous", 2023-08-01T19:55:04.563 INFO:teuthology.orchestra.run.smithi006.stdout: "min_compat_client": "jewel", 2023-08-01T19:55:04.564 INFO:teuthology.orchestra.run.smithi006.stdout: "require_osd_release": "quincy", 2023-08-01T19:55:04.564 INFO:teuthology.orchestra.run.smithi006.stdout: "pools": [ 2023-08-01T19:55:04.564 INFO:teuthology.orchestra.run.smithi006.stdout: { 2023-08-01T19:55:04.564 INFO:teuthology.orchestra.run.smithi006.stdout: "pool": 1, 2023-08-01T19:55:04.564 INFO:teuthology.orchestra.run.smithi006.stdout: "pool_name": ".mgr", 2023-08-01T19:55:04.564 INFO:teuthology.orchestra.run.smithi006.stdout: "create_time": "2023-08-01T19:53:49.961944+0000", 2023-08-01T19:55:04.564 INFO:teuthology.orchestra.run.smithi006.stdout: "flags": 1, 2023-08-01T19:55:04.564 INFO:teuthology.orchestra.run.smithi006.stdout: "flags_names": "hashpspool", 2023-08-01T19:55:04.565 INFO:teuthology.orchestra.run.smithi006.stdout: "type": 1, 2023-08-01T19:55:04.565 INFO:teuthology.orchestra.run.smithi006.stdout: "size": 2, 2023-08-01T19:55:04.565 INFO:teuthology.orchestra.run.smithi006.stdout: "min_size": 1, 2023-08-01T19:55:04.565 INFO:teuthology.orchestra.run.smithi006.stdout: "crush_rule": 0, 2023-08-01T19:55:04.565 INFO:teuthology.orchestra.run.smithi006.stdout: "peering_crush_bucket_count": 0, 2023-08-01T19:55:04.565 INFO:teuthology.orchestra.run.smithi006.stdout: "peering_crush_bucket_target": 0, 2023-08-01T19:55:04.565 INFO:teuthology.orchestra.run.smithi006.stdout: "peering_crush_bucket_barrier": 0, 2023-08-01T19:55:04.565 INFO:teuthology.orchestra.run.smithi006.stdout: "peering_crush_bucket_mandatory_member": 2147483647, 2023-08-01T19:55:04.566 INFO:teuthology.orchestra.run.smithi006.stdout: "object_hash": 2, 2023-08-01T19:55:04.566 INFO:teuthology.orchestra.run.smithi006.stdout: "pg_autoscale_mode": "off", 2023-08-01T19:55:04.566 INFO:teuthology.orchestra.run.smithi006.stdout: "pg_num": 1, 2023-08-01T19:55:04.566 INFO:teuthology.orchestra.run.smithi006.stdout: "pg_placement_num": 1, 2023-08-01T19:55:04.566 INFO:teuthology.orchestra.run.smithi006.stdout: "pg_placement_num_target": 1, 2023-08-01T19:55:04.566 INFO:teuthology.orchestra.run.smithi006.stdout: "pg_num_target": 1, 2023-08-01T19:55:04.566 INFO:teuthology.orchestra.run.smithi006.stdout: "pg_num_pending": 1, 2023-08-01T19:55:04.567 INFO:teuthology.orchestra.run.smithi006.stdout: "last_pg_merge_meta": { 2023-08-01T19:55:04.567 INFO:teuthology.orchestra.run.smithi006.stdout: "source_pgid": "0.0", 2023-08-01T19:55:04.567 INFO:teuthology.orchestra.run.smithi006.stdout: "ready_epoch": 0, 2023-08-01T19:55:04.567 INFO:teuthology.orchestra.run.smithi006.stdout: "last_epoch_started": 0, 2023-08-01T19:55:04.567 INFO:teuthology.orchestra.run.smithi006.stdout: "last_epoch_clean": 0, 2023-08-01T19:55:04.567 INFO:teuthology.orchestra.run.smithi006.stdout: "source_version": "0'0", 2023-08-01T19:55:04.567 INFO:teuthology.orchestra.run.smithi006.stdout: "target_version": "0'0" 2023-08-01T19:55:04.567 INFO:teuthology.orchestra.run.smithi006.stdout: }, 2023-08-01T19:55:04.568 INFO:teuthology.orchestra.run.smithi006.stdout: "last_change": "11", 2023-08-01T19:55:04.568 INFO:teuthology.orchestra.run.smithi006.stdout: "last_force_op_resend": "0", 2023-08-01T19:55:04.568 INFO:teuthology.orchestra.run.smithi006.stdout: "last_force_op_resend_prenautilus": "0", 2023-08-01T19:55:04.568 INFO:teuthology.orchestra.run.smithi006.stdout: "last_force_op_resend_preluminous": "0", 2023-08-01T19:55:04.568 INFO:teuthology.orchestra.run.smithi006.stdout: "auid": 0, 2023-08-01T19:55:04.568 INFO:teuthology.orchestra.run.smithi006.stdout: "snap_mode": "selfmanaged", 2023-08-01T19:55:04.568 INFO:teuthology.orchestra.run.smithi006.stdout: "snap_seq": 0, 2023-08-01T19:55:04.568 INFO:teuthology.orchestra.run.smithi006.stdout: "snap_epoch": 0, 2023-08-01T19:55:04.569 INFO:teuthology.orchestra.run.smithi006.stdout: "pool_snaps": [], 2023-08-01T19:55:04.569 INFO:teuthology.orchestra.run.smithi006.stdout: "removed_snaps": "[]", 2023-08-01T19:55:04.569 INFO:teuthology.orchestra.run.smithi006.stdout: "quota_max_bytes": 0, 2023-08-01T19:55:04.569 INFO:teuthology.orchestra.run.smithi006.stdout: "quota_max_objects": 0, 2023-08-01T19:55:04.569 INFO:teuthology.orchestra.run.smithi006.stdout: "tiers": [], 2023-08-01T19:55:04.569 INFO:teuthology.orchestra.run.smithi006.stdout: "tier_of": -1, 2023-08-01T19:55:04.569 INFO:teuthology.orchestra.run.smithi006.stdout: "read_tier": -1, 2023-08-01T19:55:04.569 INFO:teuthology.orchestra.run.smithi006.stdout: "write_tier": -1, 2023-08-01T19:55:04.570 INFO:teuthology.orchestra.run.smithi006.stdout: "cache_mode": "none", 2023-08-01T19:55:04.570 INFO:teuthology.orchestra.run.smithi006.stdout: "target_max_bytes": 0, 2023-08-01T19:55:04.570 INFO:teuthology.orchestra.run.smithi006.stdout: "target_max_objects": 0, 2023-08-01T19:55:04.570 INFO:teuthology.orchestra.run.smithi006.stdout: "cache_target_dirty_ratio_micro": 400000, 2023-08-01T19:55:04.570 INFO:teuthology.orchestra.run.smithi006.stdout: "cache_target_dirty_high_ratio_micro": 600000, 2023-08-01T19:55:04.570 INFO:teuthology.orchestra.run.smithi006.stdout: "cache_target_full_ratio_micro": 800000, 2023-08-01T19:55:04.570 INFO:teuthology.orchestra.run.smithi006.stdout: "cache_min_flush_age": 0, 2023-08-01T19:55:04.570 INFO:teuthology.orchestra.run.smithi006.stdout: "cache_min_evict_age": 0, 2023-08-01T19:55:04.571 INFO:teuthology.orchestra.run.smithi006.stdout: "erasure_code_profile": "", 2023-08-01T19:55:04.571 INFO:teuthology.orchestra.run.smithi006.stdout: "hit_set_params": { 2023-08-01T19:55:04.571 INFO:teuthology.orchestra.run.smithi006.stdout: "type": "none" 2023-08-01T19:55:04.571 INFO:teuthology.orchestra.run.smithi006.stdout: }, 2023-08-01T19:55:04.571 INFO:teuthology.orchestra.run.smithi006.stdout: "hit_set_period": 0, 2023-08-01T19:55:04.571 INFO:teuthology.orchestra.run.smithi006.stdout: "hit_set_count": 0, 2023-08-01T19:55:04.571 INFO:teuthology.orchestra.run.smithi006.stdout: "use_gmt_hitset": true, 2023-08-01T19:55:04.571 INFO:teuthology.orchestra.run.smithi006.stdout: "min_read_recency_for_promote": 0, 2023-08-01T19:55:04.572 INFO:teuthology.orchestra.run.smithi006.stdout: "min_write_recency_for_promote": 0, 2023-08-01T19:55:04.572 INFO:teuthology.orchestra.run.smithi006.stdout: "hit_set_grade_decay_rate": 0, 2023-08-01T19:55:04.572 INFO:teuthology.orchestra.run.smithi006.stdout: "hit_set_search_last_n": 0, 2023-08-01T19:55:04.572 INFO:teuthology.orchestra.run.smithi006.stdout: "grade_table": [], 2023-08-01T19:55:04.572 INFO:teuthology.orchestra.run.smithi006.stdout: "stripe_width": 0, 2023-08-01T19:55:04.572 INFO:teuthology.orchestra.run.smithi006.stdout: "expected_num_objects": 0, 2023-08-01T19:55:04.572 INFO:teuthology.orchestra.run.smithi006.stdout: "fast_read": false, 2023-08-01T19:55:04.573 INFO:teuthology.orchestra.run.smithi006.stdout: "options": { 2023-08-01T19:55:04.573 INFO:teuthology.orchestra.run.smithi006.stdout: "pg_num_max": 32, 2023-08-01T19:55:04.573 INFO:teuthology.orchestra.run.smithi006.stdout: "pg_num_min": 1 2023-08-01T19:55:04.573 INFO:teuthology.orchestra.run.smithi006.stdout: }, 2023-08-01T19:55:04.573 INFO:teuthology.orchestra.run.smithi006.stdout: "application_metadata": { 2023-08-01T19:55:04.573 INFO:teuthology.orchestra.run.smithi006.stdout: "mgr": {} 2023-08-01T19:55:04.573 INFO:teuthology.orchestra.run.smithi006.stdout: } 2023-08-01T19:55:04.573 INFO:teuthology.orchestra.run.smithi006.stdout: }, 2023-08-01T19:55:04.574 INFO:teuthology.orchestra.run.smithi006.stdout: { 2023-08-01T19:55:04.574 INFO:teuthology.orchestra.run.smithi006.stdout: "pool": 2, 2023-08-01T19:55:04.574 INFO:teuthology.orchestra.run.smithi006.stdout: "pool_name": "rbd", 2023-08-01T19:55:04.574 INFO:teuthology.orchestra.run.smithi006.stdout: "create_time": "2023-08-01T19:53:57.404091+0000", 2023-08-01T19:55:04.574 INFO:teuthology.orchestra.run.smithi006.stdout: "flags": 1, 2023-08-01T19:55:04.574 INFO:teuthology.orchestra.run.smithi006.stdout: "flags_names": "hashpspool", 2023-08-01T19:55:04.574 INFO:teuthology.orchestra.run.smithi006.stdout: "type": 1, 2023-08-01T19:55:04.574 INFO:teuthology.orchestra.run.smithi006.stdout: "size": 2, 2023-08-01T19:55:04.575 INFO:teuthology.orchestra.run.smithi006.stdout: "min_size": 1, 2023-08-01T19:55:04.575 INFO:teuthology.orchestra.run.smithi006.stdout: "crush_rule": 0, 2023-08-01T19:55:04.575 INFO:teuthology.orchestra.run.smithi006.stdout: "peering_crush_bucket_count": 0, 2023-08-01T19:55:04.575 INFO:teuthology.orchestra.run.smithi006.stdout: "peering_crush_bucket_target": 0, 2023-08-01T19:55:04.575 INFO:teuthology.orchestra.run.smithi006.stdout: "peering_crush_bucket_barrier": 0, 2023-08-01T19:55:04.575 INFO:teuthology.orchestra.run.smithi006.stdout: "peering_crush_bucket_mandatory_member": 2147483647, 2023-08-01T19:55:04.575 INFO:teuthology.orchestra.run.smithi006.stdout: "object_hash": 2, 2023-08-01T19:55:04.575 INFO:teuthology.orchestra.run.smithi006.stdout: "pg_autoscale_mode": "off", 2023-08-01T19:55:04.576 INFO:teuthology.orchestra.run.smithi006.stdout: "pg_num": 8, 2023-08-01T19:55:04.576 INFO:teuthology.orchestra.run.smithi006.stdout: "pg_placement_num": 8, 2023-08-01T19:55:04.576 INFO:teuthology.orchestra.run.smithi006.stdout: "pg_placement_num_target": 8, 2023-08-01T19:55:04.576 INFO:teuthology.orchestra.run.smithi006.stdout: "pg_num_target": 8, 2023-08-01T19:55:04.576 INFO:teuthology.orchestra.run.smithi006.stdout: "pg_num_pending": 8, 2023-08-01T19:55:04.576 INFO:teuthology.orchestra.run.smithi006.stdout: "last_pg_merge_meta": { 2023-08-01T19:55:04.576 INFO:teuthology.orchestra.run.smithi006.stdout: "source_pgid": "0.0", 2023-08-01T19:55:04.577 INFO:teuthology.orchestra.run.smithi006.stdout: "ready_epoch": 0, 2023-08-01T19:55:04.577 INFO:teuthology.orchestra.run.smithi006.stdout: "last_epoch_started": 0, 2023-08-01T19:55:04.577 INFO:teuthology.orchestra.run.smithi006.stdout: "last_epoch_clean": 0, 2023-08-01T19:55:04.577 INFO:teuthology.orchestra.run.smithi006.stdout: "source_version": "0'0", 2023-08-01T19:55:04.577 INFO:teuthology.orchestra.run.smithi006.stdout: "target_version": "0'0" 2023-08-01T19:55:04.577 INFO:teuthology.orchestra.run.smithi006.stdout: }, 2023-08-01T19:55:04.577 INFO:teuthology.orchestra.run.smithi006.stdout: "last_change": "14", 2023-08-01T19:55:04.577 INFO:teuthology.orchestra.run.smithi006.stdout: "last_force_op_resend": "0", 2023-08-01T19:55:04.578 INFO:teuthology.orchestra.run.smithi006.stdout: "last_force_op_resend_prenautilus": "0", 2023-08-01T19:55:04.578 INFO:teuthology.orchestra.run.smithi006.stdout: "last_force_op_resend_preluminous": "0", 2023-08-01T19:55:04.578 INFO:teuthology.orchestra.run.smithi006.stdout: "auid": 0, 2023-08-01T19:55:04.578 INFO:teuthology.orchestra.run.smithi006.stdout: "snap_mode": "selfmanaged", 2023-08-01T19:55:04.578 INFO:teuthology.orchestra.run.smithi006.stdout: "snap_seq": 0, 2023-08-01T19:55:04.578 INFO:teuthology.orchestra.run.smithi006.stdout: "snap_epoch": 0, 2023-08-01T19:55:04.578 INFO:teuthology.orchestra.run.smithi006.stdout: "pool_snaps": [], 2023-08-01T19:55:04.578 INFO:teuthology.orchestra.run.smithi006.stdout: "removed_snaps": "[]", 2023-08-01T19:55:04.579 INFO:teuthology.orchestra.run.smithi006.stdout: "quota_max_bytes": 0, 2023-08-01T19:55:04.579 INFO:teuthology.orchestra.run.smithi006.stdout: "quota_max_objects": 0, 2023-08-01T19:55:04.579 INFO:teuthology.orchestra.run.smithi006.stdout: "tiers": [], 2023-08-01T19:55:04.579 INFO:teuthology.orchestra.run.smithi006.stdout: "tier_of": -1, 2023-08-01T19:55:04.579 INFO:teuthology.orchestra.run.smithi006.stdout: "read_tier": -1, 2023-08-01T19:55:04.579 INFO:teuthology.orchestra.run.smithi006.stdout: "write_tier": -1, 2023-08-01T19:55:04.579 INFO:teuthology.orchestra.run.smithi006.stdout: "cache_mode": "none", 2023-08-01T19:55:04.579 INFO:teuthology.orchestra.run.smithi006.stdout: "target_max_bytes": 0, 2023-08-01T19:55:04.580 INFO:teuthology.orchestra.run.smithi006.stdout: "target_max_objects": 0, 2023-08-01T19:55:04.580 INFO:teuthology.orchestra.run.smithi006.stdout: "cache_target_dirty_ratio_micro": 400000, 2023-08-01T19:55:04.580 INFO:teuthology.orchestra.run.smithi006.stdout: "cache_target_dirty_high_ratio_micro": 600000, 2023-08-01T19:55:04.580 INFO:teuthology.orchestra.run.smithi006.stdout: "cache_target_full_ratio_micro": 800000, 2023-08-01T19:55:04.580 INFO:teuthology.orchestra.run.smithi006.stdout: "cache_min_flush_age": 0, 2023-08-01T19:55:04.580 INFO:teuthology.orchestra.run.smithi006.stdout: "cache_min_evict_age": 0, 2023-08-01T19:55:04.580 INFO:teuthology.orchestra.run.smithi006.stdout: "erasure_code_profile": "", 2023-08-01T19:55:04.580 INFO:teuthology.orchestra.run.smithi006.stdout: "hit_set_params": { 2023-08-01T19:55:04.581 INFO:teuthology.orchestra.run.smithi006.stdout: "type": "none" 2023-08-01T19:55:04.581 INFO:teuthology.orchestra.run.smithi006.stdout: }, 2023-08-01T19:55:04.581 INFO:teuthology.orchestra.run.smithi006.stdout: "hit_set_period": 0, 2023-08-01T19:55:04.581 INFO:teuthology.orchestra.run.smithi006.stdout: "hit_set_count": 0, 2023-08-01T19:55:04.581 INFO:teuthology.orchestra.run.smithi006.stdout: "use_gmt_hitset": true, 2023-08-01T19:55:04.581 INFO:teuthology.orchestra.run.smithi006.stdout: "min_read_recency_for_promote": 0, 2023-08-01T19:55:04.581 INFO:teuthology.orchestra.run.smithi006.stdout: "min_write_recency_for_promote": 0, 2023-08-01T19:55:04.581 INFO:teuthology.orchestra.run.smithi006.stdout: "hit_set_grade_decay_rate": 0, 2023-08-01T19:55:04.582 INFO:teuthology.orchestra.run.smithi006.stdout: "hit_set_search_last_n": 0, 2023-08-01T19:55:04.582 INFO:teuthology.orchestra.run.smithi006.stdout: "grade_table": [], 2023-08-01T19:55:04.582 INFO:teuthology.orchestra.run.smithi006.stdout: "stripe_width": 0, 2023-08-01T19:55:04.582 INFO:teuthology.orchestra.run.smithi006.stdout: "expected_num_objects": 0, 2023-08-01T19:55:04.582 INFO:teuthology.orchestra.run.smithi006.stdout: "fast_read": false, 2023-08-01T19:55:04.582 INFO:teuthology.orchestra.run.smithi006.stdout: "options": {}, 2023-08-01T19:55:04.582 INFO:teuthology.orchestra.run.smithi006.stdout: "application_metadata": { 2023-08-01T19:55:04.582 INFO:teuthology.orchestra.run.smithi006.stdout: "rbd": {} 2023-08-01T19:55:04.583 INFO:teuthology.orchestra.run.smithi006.stdout: } 2023-08-01T19:55:04.583 INFO:teuthology.orchestra.run.smithi006.stdout: }, 2023-08-01T19:55:04.583 INFO:teuthology.orchestra.run.smithi006.stdout: { 2023-08-01T19:55:04.583 INFO:teuthology.orchestra.run.smithi006.stdout: "pool": 3, 2023-08-01T19:55:04.583 INFO:teuthology.orchestra.run.smithi006.stdout: "pool_name": "cephfs_metadata", 2023-08-01T19:55:04.583 INFO:teuthology.orchestra.run.smithi006.stdout: "create_time": "2023-08-01T19:54:02.111247+0000", 2023-08-01T19:55:04.583 INFO:teuthology.orchestra.run.smithi006.stdout: "flags": 1, 2023-08-01T19:55:04.583 INFO:teuthology.orchestra.run.smithi006.stdout: "flags_names": "hashpspool", 2023-08-01T19:55:04.584 INFO:teuthology.orchestra.run.smithi006.stdout: "type": 1, 2023-08-01T19:55:04.584 INFO:teuthology.orchestra.run.smithi006.stdout: "size": 2, 2023-08-01T19:55:04.584 INFO:teuthology.orchestra.run.smithi006.stdout: "min_size": 1, 2023-08-01T19:55:04.584 INFO:teuthology.orchestra.run.smithi006.stdout: "crush_rule": 0, 2023-08-01T19:55:04.584 INFO:teuthology.orchestra.run.smithi006.stdout: "peering_crush_bucket_count": 0, 2023-08-01T19:55:04.584 INFO:teuthology.orchestra.run.smithi006.stdout: "peering_crush_bucket_target": 0, 2023-08-01T19:55:04.584 INFO:teuthology.orchestra.run.smithi006.stdout: "peering_crush_bucket_barrier": 0, 2023-08-01T19:55:04.585 INFO:teuthology.orchestra.run.smithi006.stdout: "peering_crush_bucket_mandatory_member": 2147483647, 2023-08-01T19:55:04.585 INFO:teuthology.orchestra.run.smithi006.stdout: "object_hash": 2, 2023-08-01T19:55:04.585 INFO:teuthology.orchestra.run.smithi006.stdout: "pg_autoscale_mode": "off", 2023-08-01T19:55:04.585 INFO:teuthology.orchestra.run.smithi006.stdout: "pg_num": 32, 2023-08-01T19:55:04.585 INFO:teuthology.orchestra.run.smithi006.stdout: "pg_placement_num": 32, 2023-08-01T19:55:04.585 INFO:teuthology.orchestra.run.smithi006.stdout: "pg_placement_num_target": 32, 2023-08-01T19:55:04.585 INFO:teuthology.orchestra.run.smithi006.stdout: "pg_num_target": 32, 2023-08-01T19:55:04.585 INFO:teuthology.orchestra.run.smithi006.stdout: "pg_num_pending": 32, 2023-08-01T19:55:04.586 INFO:teuthology.orchestra.run.smithi006.stdout: "last_pg_merge_meta": { 2023-08-01T19:55:04.586 INFO:teuthology.orchestra.run.smithi006.stdout: "source_pgid": "0.0", 2023-08-01T19:55:04.586 INFO:teuthology.orchestra.run.smithi006.stdout: "ready_epoch": 0, 2023-08-01T19:55:04.586 INFO:teuthology.orchestra.run.smithi006.stdout: "last_epoch_started": 0, 2023-08-01T19:55:04.586 INFO:teuthology.orchestra.run.smithi006.stdout: "last_epoch_clean": 0, 2023-08-01T19:55:04.586 INFO:teuthology.orchestra.run.smithi006.stdout: "source_version": "0'0", 2023-08-01T19:55:04.586 INFO:teuthology.orchestra.run.smithi006.stdout: "target_version": "0'0" 2023-08-01T19:55:04.586 INFO:teuthology.orchestra.run.smithi006.stdout: }, 2023-08-01T19:55:04.587 INFO:teuthology.orchestra.run.smithi006.stdout: "last_change": "17", 2023-08-01T19:55:04.587 INFO:teuthology.orchestra.run.smithi006.stdout: "last_force_op_resend": "0", 2023-08-01T19:55:04.587 INFO:teuthology.orchestra.run.smithi006.stdout: "last_force_op_resend_prenautilus": "0", 2023-08-01T19:55:04.587 INFO:teuthology.orchestra.run.smithi006.stdout: "last_force_op_resend_preluminous": "0", 2023-08-01T19:55:04.587 INFO:teuthology.orchestra.run.smithi006.stdout: "auid": 0, 2023-08-01T19:55:04.587 INFO:teuthology.orchestra.run.smithi006.stdout: "snap_mode": "selfmanaged", 2023-08-01T19:55:04.587 INFO:teuthology.orchestra.run.smithi006.stdout: "snap_seq": 0, 2023-08-01T19:55:04.587 INFO:teuthology.orchestra.run.smithi006.stdout: "snap_epoch": 0, 2023-08-01T19:55:04.588 INFO:teuthology.orchestra.run.smithi006.stdout: "pool_snaps": [], 2023-08-01T19:55:04.588 INFO:teuthology.orchestra.run.smithi006.stdout: "removed_snaps": "[]", 2023-08-01T19:55:04.588 INFO:teuthology.orchestra.run.smithi006.stdout: "quota_max_bytes": 0, 2023-08-01T19:55:04.588 INFO:teuthology.orchestra.run.smithi006.stdout: "quota_max_objects": 0, 2023-08-01T19:55:04.588 INFO:teuthology.orchestra.run.smithi006.stdout: "tiers": [], 2023-08-01T19:55:04.588 INFO:teuthology.orchestra.run.smithi006.stdout: "tier_of": -1, 2023-08-01T19:55:04.588 INFO:teuthology.orchestra.run.smithi006.stdout: "read_tier": -1, 2023-08-01T19:55:04.588 INFO:teuthology.orchestra.run.smithi006.stdout: "write_tier": -1, 2023-08-01T19:55:04.589 INFO:teuthology.orchestra.run.smithi006.stdout: "cache_mode": "none", 2023-08-01T19:55:04.589 INFO:teuthology.orchestra.run.smithi006.stdout: "target_max_bytes": 0, 2023-08-01T19:55:04.589 INFO:teuthology.orchestra.run.smithi006.stdout: "target_max_objects": 0, 2023-08-01T19:55:04.589 INFO:teuthology.orchestra.run.smithi006.stdout: "cache_target_dirty_ratio_micro": 400000, 2023-08-01T19:55:04.589 INFO:teuthology.orchestra.run.smithi006.stdout: "cache_target_dirty_high_ratio_micro": 600000, 2023-08-01T19:55:04.589 INFO:teuthology.orchestra.run.smithi006.stdout: "cache_target_full_ratio_micro": 800000, 2023-08-01T19:55:04.589 INFO:teuthology.orchestra.run.smithi006.stdout: "cache_min_flush_age": 0, 2023-08-01T19:55:04.589 INFO:teuthology.orchestra.run.smithi006.stdout: "cache_min_evict_age": 0, 2023-08-01T19:55:04.590 INFO:teuthology.orchestra.run.smithi006.stdout: "erasure_code_profile": "", 2023-08-01T19:55:04.590 INFO:teuthology.orchestra.run.smithi006.stdout: "hit_set_params": { 2023-08-01T19:55:04.590 INFO:teuthology.orchestra.run.smithi006.stdout: "type": "none" 2023-08-01T19:55:04.590 INFO:teuthology.orchestra.run.smithi006.stdout: }, 2023-08-01T19:55:04.590 INFO:teuthology.orchestra.run.smithi006.stdout: "hit_set_period": 0, 2023-08-01T19:55:04.590 INFO:teuthology.orchestra.run.smithi006.stdout: "hit_set_count": 0, 2023-08-01T19:55:04.590 INFO:teuthology.orchestra.run.smithi006.stdout: "use_gmt_hitset": true, 2023-08-01T19:55:04.591 INFO:teuthology.orchestra.run.smithi006.stdout: "min_read_recency_for_promote": 0, 2023-08-01T19:55:04.591 INFO:teuthology.orchestra.run.smithi006.stdout: "min_write_recency_for_promote": 0, 2023-08-01T19:55:04.591 INFO:teuthology.orchestra.run.smithi006.stdout: "hit_set_grade_decay_rate": 0, 2023-08-01T19:55:04.591 INFO:teuthology.orchestra.run.smithi006.stdout: "hit_set_search_last_n": 0, 2023-08-01T19:55:04.591 INFO:teuthology.orchestra.run.smithi006.stdout: "grade_table": [], 2023-08-01T19:55:04.591 INFO:teuthology.orchestra.run.smithi006.stdout: "stripe_width": 0, 2023-08-01T19:55:04.591 INFO:teuthology.orchestra.run.smithi006.stdout: "expected_num_objects": 0, 2023-08-01T19:55:04.591 INFO:teuthology.orchestra.run.smithi006.stdout: "fast_read": false, 2023-08-01T19:55:04.592 INFO:teuthology.orchestra.run.smithi006.stdout: "options": { 2023-08-01T19:55:04.592 INFO:teuthology.orchestra.run.smithi006.stdout: "pg_autoscale_bias": 4, 2023-08-01T19:55:04.592 INFO:teuthology.orchestra.run.smithi006.stdout: "pg_num_min": 16, 2023-08-01T19:55:04.592 INFO:teuthology.orchestra.run.smithi006.stdout: "recovery_priority": 5 2023-08-01T19:55:04.592 INFO:teuthology.orchestra.run.smithi006.stdout: }, 2023-08-01T19:55:04.592 INFO:teuthology.orchestra.run.smithi006.stdout: "application_metadata": { 2023-08-01T19:55:04.592 INFO:teuthology.orchestra.run.smithi006.stdout: "cephfs": { 2023-08-01T19:55:04.592 INFO:teuthology.orchestra.run.smithi006.stdout: "metadata": "cephfs" 2023-08-01T19:55:04.593 INFO:teuthology.orchestra.run.smithi006.stdout: } 2023-08-01T19:55:04.593 INFO:teuthology.orchestra.run.smithi006.stdout: } 2023-08-01T19:55:04.593 INFO:teuthology.orchestra.run.smithi006.stdout: }, 2023-08-01T19:55:04.593 INFO:teuthology.orchestra.run.smithi006.stdout: { 2023-08-01T19:55:04.593 INFO:teuthology.orchestra.run.smithi006.stdout: "pool": 4, 2023-08-01T19:55:04.593 INFO:teuthology.orchestra.run.smithi006.stdout: "pool_name": "cephfs_data", 2023-08-01T19:55:04.593 INFO:teuthology.orchestra.run.smithi006.stdout: "create_time": "2023-08-01T19:54:03.430277+0000", 2023-08-01T19:55:04.593 INFO:teuthology.orchestra.run.smithi006.stdout: "flags": 1, 2023-08-01T19:55:04.594 INFO:teuthology.orchestra.run.smithi006.stdout: "flags_names": "hashpspool", 2023-08-01T19:55:04.594 INFO:teuthology.orchestra.run.smithi006.stdout: "type": 1, 2023-08-01T19:55:04.594 INFO:teuthology.orchestra.run.smithi006.stdout: "size": 2, 2023-08-01T19:55:04.594 INFO:teuthology.orchestra.run.smithi006.stdout: "min_size": 1, 2023-08-01T19:55:04.594 INFO:teuthology.orchestra.run.smithi006.stdout: "crush_rule": 0, 2023-08-01T19:55:04.594 INFO:teuthology.orchestra.run.smithi006.stdout: "peering_crush_bucket_count": 0, 2023-08-01T19:55:04.594 INFO:teuthology.orchestra.run.smithi006.stdout: "peering_crush_bucket_target": 0, 2023-08-01T19:55:04.594 INFO:teuthology.orchestra.run.smithi006.stdout: "peering_crush_bucket_barrier": 0, 2023-08-01T19:55:04.595 INFO:teuthology.orchestra.run.smithi006.stdout: "peering_crush_bucket_mandatory_member": 2147483647, 2023-08-01T19:55:04.595 INFO:teuthology.orchestra.run.smithi006.stdout: "object_hash": 2, 2023-08-01T19:55:04.595 INFO:teuthology.orchestra.run.smithi006.stdout: "pg_autoscale_mode": "off", 2023-08-01T19:55:04.595 INFO:teuthology.orchestra.run.smithi006.stdout: "pg_num": 64, 2023-08-01T19:55:04.595 INFO:teuthology.orchestra.run.smithi006.stdout: "pg_placement_num": 64, 2023-08-01T19:55:04.595 INFO:teuthology.orchestra.run.smithi006.stdout: "pg_placement_num_target": 64, 2023-08-01T19:55:04.595 INFO:teuthology.orchestra.run.smithi006.stdout: "pg_num_target": 64, 2023-08-01T19:55:04.596 INFO:teuthology.orchestra.run.smithi006.stdout: "pg_num_pending": 64, 2023-08-01T19:55:04.596 INFO:teuthology.orchestra.run.smithi006.stdout: "last_pg_merge_meta": { 2023-08-01T19:55:04.596 INFO:teuthology.orchestra.run.smithi006.stdout: "source_pgid": "0.0", 2023-08-01T19:55:04.596 INFO:teuthology.orchestra.run.smithi006.stdout: "ready_epoch": 0, 2023-08-01T19:55:04.596 INFO:teuthology.orchestra.run.smithi006.stdout: "last_epoch_started": 0, 2023-08-01T19:55:04.596 INFO:teuthology.orchestra.run.smithi006.stdout: "last_epoch_clean": 0, 2023-08-01T19:55:04.596 INFO:teuthology.orchestra.run.smithi006.stdout: "source_version": "0'0", 2023-08-01T19:55:04.596 INFO:teuthology.orchestra.run.smithi006.stdout: "target_version": "0'0" 2023-08-01T19:55:04.597 INFO:teuthology.orchestra.run.smithi006.stdout: }, 2023-08-01T19:55:04.597 INFO:teuthology.orchestra.run.smithi006.stdout: "last_change": "18", 2023-08-01T19:55:04.597 INFO:teuthology.orchestra.run.smithi006.stdout: "last_force_op_resend": "0", 2023-08-01T19:55:04.597 INFO:teuthology.orchestra.run.smithi006.stdout: "last_force_op_resend_prenautilus": "0", 2023-08-01T19:55:04.597 INFO:teuthology.orchestra.run.smithi006.stdout: "last_force_op_resend_preluminous": "0", 2023-08-01T19:55:04.597 INFO:teuthology.orchestra.run.smithi006.stdout: "auid": 0, 2023-08-01T19:55:04.597 INFO:teuthology.orchestra.run.smithi006.stdout: "snap_mode": "selfmanaged", 2023-08-01T19:55:04.597 INFO:teuthology.orchestra.run.smithi006.stdout: "snap_seq": 0, 2023-08-01T19:55:04.598 INFO:teuthology.orchestra.run.smithi006.stdout: "snap_epoch": 0, 2023-08-01T19:55:04.598 INFO:teuthology.orchestra.run.smithi006.stdout: "pool_snaps": [], 2023-08-01T19:55:04.598 INFO:teuthology.orchestra.run.smithi006.stdout: "removed_snaps": "[]", 2023-08-01T19:55:04.598 INFO:teuthology.orchestra.run.smithi006.stdout: "quota_max_bytes": 0, 2023-08-01T19:55:04.598 INFO:teuthology.orchestra.run.smithi006.stdout: "quota_max_objects": 0, 2023-08-01T19:55:04.598 INFO:teuthology.orchestra.run.smithi006.stdout: "tiers": [], 2023-08-01T19:55:04.598 INFO:teuthology.orchestra.run.smithi006.stdout: "tier_of": -1, 2023-08-01T19:55:04.598 INFO:teuthology.orchestra.run.smithi006.stdout: "read_tier": -1, 2023-08-01T19:55:04.599 INFO:teuthology.orchestra.run.smithi006.stdout: "write_tier": -1, 2023-08-01T19:55:04.599 INFO:teuthology.orchestra.run.smithi006.stdout: "cache_mode": "none", 2023-08-01T19:55:04.599 INFO:teuthology.orchestra.run.smithi006.stdout: "target_max_bytes": 0, 2023-08-01T19:55:04.599 INFO:teuthology.orchestra.run.smithi006.stdout: "target_max_objects": 0, 2023-08-01T19:55:04.599 INFO:teuthology.orchestra.run.smithi006.stdout: "cache_target_dirty_ratio_micro": 400000, 2023-08-01T19:55:04.599 INFO:teuthology.orchestra.run.smithi006.stdout: "cache_target_dirty_high_ratio_micro": 600000, 2023-08-01T19:55:04.599 INFO:teuthology.orchestra.run.smithi006.stdout: "cache_target_full_ratio_micro": 800000, 2023-08-01T19:55:04.599 INFO:teuthology.orchestra.run.smithi006.stdout: "cache_min_flush_age": 0, 2023-08-01T19:55:04.600 INFO:teuthology.orchestra.run.smithi006.stdout: "cache_min_evict_age": 0, 2023-08-01T19:55:04.600 INFO:teuthology.orchestra.run.smithi006.stdout: "erasure_code_profile": "", 2023-08-01T19:55:04.600 INFO:teuthology.orchestra.run.smithi006.stdout: "hit_set_params": { 2023-08-01T19:55:04.600 INFO:teuthology.orchestra.run.smithi006.stdout: "type": "none" 2023-08-01T19:55:04.600 INFO:teuthology.orchestra.run.smithi006.stdout: }, 2023-08-01T19:55:04.600 INFO:teuthology.orchestra.run.smithi006.stdout: "hit_set_period": 0, 2023-08-01T19:55:04.600 INFO:teuthology.orchestra.run.smithi006.stdout: "hit_set_count": 0, 2023-08-01T19:55:04.601 INFO:teuthology.orchestra.run.smithi006.stdout: "use_gmt_hitset": true, 2023-08-01T19:55:04.601 INFO:teuthology.orchestra.run.smithi006.stdout: "min_read_recency_for_promote": 0, 2023-08-01T19:55:04.601 INFO:teuthology.orchestra.run.smithi006.stdout: "min_write_recency_for_promote": 0, 2023-08-01T19:55:04.601 INFO:teuthology.orchestra.run.smithi006.stdout: "hit_set_grade_decay_rate": 0, 2023-08-01T19:55:04.601 INFO:teuthology.orchestra.run.smithi006.stdout: "hit_set_search_last_n": 0, 2023-08-01T19:55:04.601 INFO:teuthology.orchestra.run.smithi006.stdout: "grade_table": [], 2023-08-01T19:55:04.601 INFO:teuthology.orchestra.run.smithi006.stdout: "stripe_width": 0, 2023-08-01T19:55:04.601 INFO:teuthology.orchestra.run.smithi006.stdout: "expected_num_objects": 0, 2023-08-01T19:55:04.602 INFO:teuthology.orchestra.run.smithi006.stdout: "fast_read": false, 2023-08-01T19:55:04.602 INFO:teuthology.orchestra.run.smithi006.stdout: "options": { 2023-08-01T19:55:04.602 INFO:teuthology.orchestra.run.smithi006.stdout: "pg_num_min": 64, 2023-08-01T19:55:04.602 INFO:teuthology.orchestra.run.smithi006.stdout: "target_size_ratio": 0.89999997615814209 2023-08-01T19:55:04.602 INFO:teuthology.orchestra.run.smithi006.stdout: }, 2023-08-01T19:55:04.602 INFO:teuthology.orchestra.run.smithi006.stdout: "application_metadata": { 2023-08-01T19:55:04.602 INFO:teuthology.orchestra.run.smithi006.stdout: "cephfs": { 2023-08-01T19:55:04.602 INFO:teuthology.orchestra.run.smithi006.stdout: "data": "cephfs" 2023-08-01T19:55:04.603 INFO:teuthology.orchestra.run.smithi006.stdout: } 2023-08-01T19:55:04.603 INFO:teuthology.orchestra.run.smithi006.stdout: } 2023-08-01T19:55:04.603 INFO:teuthology.orchestra.run.smithi006.stdout: }, 2023-08-01T19:55:04.603 INFO:teuthology.orchestra.run.smithi006.stdout: { 2023-08-01T19:55:04.603 INFO:teuthology.orchestra.run.smithi006.stdout: "pool": 5, 2023-08-01T19:55:04.603 INFO:teuthology.orchestra.run.smithi006.stdout: "pool_name": "unique_pool_0", 2023-08-01T19:55:04.603 INFO:teuthology.orchestra.run.smithi006.stdout: "create_time": "2023-08-01T19:54:21.165668+0000", 2023-08-01T19:55:04.603 INFO:teuthology.orchestra.run.smithi006.stdout: "flags": 1, 2023-08-01T19:55:04.604 INFO:teuthology.orchestra.run.smithi006.stdout: "flags_names": "hashpspool", 2023-08-01T19:55:04.604 INFO:teuthology.orchestra.run.smithi006.stdout: "type": 1, 2023-08-01T19:55:04.604 INFO:teuthology.orchestra.run.smithi006.stdout: "size": 2, 2023-08-01T19:55:04.604 INFO:teuthology.orchestra.run.smithi006.stdout: "min_size": 1, 2023-08-01T19:55:04.604 INFO:teuthology.orchestra.run.smithi006.stdout: "crush_rule": 0, 2023-08-01T19:55:04.604 INFO:teuthology.orchestra.run.smithi006.stdout: "peering_crush_bucket_count": 0, 2023-08-01T19:55:04.604 INFO:teuthology.orchestra.run.smithi006.stdout: "peering_crush_bucket_target": 0, 2023-08-01T19:55:04.604 INFO:teuthology.orchestra.run.smithi006.stdout: "peering_crush_bucket_barrier": 0, 2023-08-01T19:55:04.605 INFO:teuthology.orchestra.run.smithi006.stdout: "peering_crush_bucket_mandatory_member": 2147483647, 2023-08-01T19:55:04.605 INFO:teuthology.orchestra.run.smithi006.stdout: "object_hash": 2, 2023-08-01T19:55:04.605 INFO:teuthology.orchestra.run.smithi006.stdout: "pg_autoscale_mode": "off", 2023-08-01T19:55:04.605 INFO:teuthology.orchestra.run.smithi006.stdout: "pg_num": 16, 2023-08-01T19:55:04.605 INFO:teuthology.orchestra.run.smithi006.stdout: "pg_placement_num": 16, 2023-08-01T19:55:04.605 INFO:teuthology.orchestra.run.smithi006.stdout: "pg_placement_num_target": 16, 2023-08-01T19:55:04.605 INFO:teuthology.orchestra.run.smithi006.stdout: "pg_num_target": 16, 2023-08-01T19:55:04.605 INFO:teuthology.orchestra.run.smithi006.stdout: "pg_num_pending": 16, 2023-08-01T19:55:04.606 INFO:teuthology.orchestra.run.smithi006.stdout: "last_pg_merge_meta": { 2023-08-01T19:55:04.606 INFO:teuthology.orchestra.run.smithi006.stdout: "source_pgid": "0.0", 2023-08-01T19:55:04.606 INFO:teuthology.orchestra.run.smithi006.stdout: "ready_epoch": 0, 2023-08-01T19:55:04.606 INFO:teuthology.orchestra.run.smithi006.stdout: "last_epoch_started": 0, 2023-08-01T19:55:04.606 INFO:teuthology.orchestra.run.smithi006.stdout: "last_epoch_clean": 0, 2023-08-01T19:55:04.606 INFO:teuthology.orchestra.run.smithi006.stdout: "source_version": "0'0", 2023-08-01T19:55:04.606 INFO:teuthology.orchestra.run.smithi006.stdout: "target_version": "0'0" 2023-08-01T19:55:04.607 INFO:teuthology.orchestra.run.smithi006.stdout: }, 2023-08-01T19:55:04.607 INFO:teuthology.orchestra.run.smithi006.stdout: "last_change": "21", 2023-08-01T19:55:04.607 INFO:teuthology.orchestra.run.smithi006.stdout: "last_force_op_resend": "0", 2023-08-01T19:55:04.607 INFO:teuthology.orchestra.run.smithi006.stdout: "last_force_op_resend_prenautilus": "0", 2023-08-01T19:55:04.607 INFO:teuthology.orchestra.run.smithi006.stdout: "last_force_op_resend_preluminous": "0", 2023-08-01T19:55:04.607 INFO:teuthology.orchestra.run.smithi006.stdout: "auid": 0, 2023-08-01T19:55:04.607 INFO:teuthology.orchestra.run.smithi006.stdout: "snap_mode": "selfmanaged", 2023-08-01T19:55:04.607 INFO:teuthology.orchestra.run.smithi006.stdout: "snap_seq": 0, 2023-08-01T19:55:04.608 INFO:teuthology.orchestra.run.smithi006.stdout: "snap_epoch": 0, 2023-08-01T19:55:04.608 INFO:teuthology.orchestra.run.smithi006.stdout: "pool_snaps": [], 2023-08-01T19:55:04.608 INFO:teuthology.orchestra.run.smithi006.stdout: "removed_snaps": "[]", 2023-08-01T19:55:04.608 INFO:teuthology.orchestra.run.smithi006.stdout: "quota_max_bytes": 0, 2023-08-01T19:55:04.608 INFO:teuthology.orchestra.run.smithi006.stdout: "quota_max_objects": 0, 2023-08-01T19:55:04.608 INFO:teuthology.orchestra.run.smithi006.stdout: "tiers": [], 2023-08-01T19:55:04.608 INFO:teuthology.orchestra.run.smithi006.stdout: "tier_of": -1, 2023-08-01T19:55:04.608 INFO:teuthology.orchestra.run.smithi006.stdout: "read_tier": -1, 2023-08-01T19:55:04.609 INFO:teuthology.orchestra.run.smithi006.stdout: "write_tier": -1, 2023-08-01T19:55:04.609 INFO:teuthology.orchestra.run.smithi006.stdout: "cache_mode": "none", 2023-08-01T19:55:04.609 INFO:teuthology.orchestra.run.smithi006.stdout: "target_max_bytes": 0, 2023-08-01T19:55:04.609 INFO:teuthology.orchestra.run.smithi006.stdout: "target_max_objects": 0, 2023-08-01T19:55:04.609 INFO:teuthology.orchestra.run.smithi006.stdout: "cache_target_dirty_ratio_micro": 400000, 2023-08-01T19:55:04.609 INFO:teuthology.orchestra.run.smithi006.stdout: "cache_target_dirty_high_ratio_micro": 600000, 2023-08-01T19:55:04.609 INFO:teuthology.orchestra.run.smithi006.stdout: "cache_target_full_ratio_micro": 800000, 2023-08-01T19:55:04.609 INFO:teuthology.orchestra.run.smithi006.stdout: "cache_min_flush_age": 0, 2023-08-01T19:55:04.610 INFO:teuthology.orchestra.run.smithi006.stdout: "cache_min_evict_age": 0, 2023-08-01T19:55:04.610 INFO:teuthology.orchestra.run.smithi006.stdout: "erasure_code_profile": "", 2023-08-01T19:55:04.610 INFO:teuthology.orchestra.run.smithi006.stdout: "hit_set_params": { 2023-08-01T19:55:04.610 INFO:teuthology.orchestra.run.smithi006.stdout: "type": "none" 2023-08-01T19:55:04.610 INFO:teuthology.orchestra.run.smithi006.stdout: }, 2023-08-01T19:55:04.610 INFO:teuthology.orchestra.run.smithi006.stdout: "hit_set_period": 0, 2023-08-01T19:55:04.610 INFO:teuthology.orchestra.run.smithi006.stdout: "hit_set_count": 0, 2023-08-01T19:55:04.610 INFO:teuthology.orchestra.run.smithi006.stdout: "use_gmt_hitset": true, 2023-08-01T19:55:04.611 INFO:teuthology.orchestra.run.smithi006.stdout: "min_read_recency_for_promote": 0, 2023-08-01T19:55:04.611 INFO:teuthology.orchestra.run.smithi006.stdout: "min_write_recency_for_promote": 0, 2023-08-01T19:55:04.611 INFO:teuthology.orchestra.run.smithi006.stdout: "hit_set_grade_decay_rate": 0, 2023-08-01T19:55:04.611 INFO:teuthology.orchestra.run.smithi006.stdout: "hit_set_search_last_n": 0, 2023-08-01T19:55:04.611 INFO:teuthology.orchestra.run.smithi006.stdout: "grade_table": [], 2023-08-01T19:55:04.611 INFO:teuthology.orchestra.run.smithi006.stdout: "stripe_width": 0, 2023-08-01T19:55:04.611 INFO:teuthology.orchestra.run.smithi006.stdout: "expected_num_objects": 0, 2023-08-01T19:55:04.611 INFO:teuthology.orchestra.run.smithi006.stdout: "fast_read": false, 2023-08-01T19:55:04.612 INFO:teuthology.orchestra.run.smithi006.stdout: "options": {}, 2023-08-01T19:55:04.612 INFO:teuthology.orchestra.run.smithi006.stdout: "application_metadata": { 2023-08-01T19:55:04.612 INFO:teuthology.orchestra.run.smithi006.stdout: "rados": {} 2023-08-01T19:55:04.612 INFO:teuthology.orchestra.run.smithi006.stdout: } 2023-08-01T19:55:04.612 INFO:teuthology.orchestra.run.smithi006.stdout: } 2023-08-01T19:55:04.612 INFO:teuthology.orchestra.run.smithi006.stdout: ], 2023-08-01T19:55:04.612 INFO:teuthology.orchestra.run.smithi006.stdout: "osds": [ 2023-08-01T19:55:04.613 INFO:teuthology.orchestra.run.smithi006.stdout: { 2023-08-01T19:55:04.613 INFO:teuthology.orchestra.run.smithi006.stdout: "osd": 0, 2023-08-01T19:55:04.613 INFO:teuthology.orchestra.run.smithi006.stdout: "uuid": "5dd675c7-2777-48f2-8009-ff0e0d4c7086", 2023-08-01T19:55:04.613 INFO:teuthology.orchestra.run.smithi006.stdout: "up": 1, 2023-08-01T19:55:04.613 INFO:teuthology.orchestra.run.smithi006.stdout: "in": 1, 2023-08-01T19:55:04.613 INFO:teuthology.orchestra.run.smithi006.stdout: "weight": 1, 2023-08-01T19:55:04.613 INFO:teuthology.orchestra.run.smithi006.stdout: "primary_affinity": 1, 2023-08-01T19:55:04.613 INFO:teuthology.orchestra.run.smithi006.stdout: "last_clean_begin": 0, 2023-08-01T19:55:04.614 INFO:teuthology.orchestra.run.smithi006.stdout: "last_clean_end": 0, 2023-08-01T19:55:04.614 INFO:teuthology.orchestra.run.smithi006.stdout: "up_from": 8, 2023-08-01T19:55:04.614 INFO:teuthology.orchestra.run.smithi006.stdout: "up_thru": 19, 2023-08-01T19:55:04.614 INFO:teuthology.orchestra.run.smithi006.stdout: "down_at": 0, 2023-08-01T19:55:04.614 INFO:teuthology.orchestra.run.smithi006.stdout: "lost_at": 0, 2023-08-01T19:55:04.614 INFO:teuthology.orchestra.run.smithi006.stdout: "public_addrs": { 2023-08-01T19:55:04.614 INFO:teuthology.orchestra.run.smithi006.stdout: "addrvec": [ 2023-08-01T19:55:04.614 INFO:teuthology.orchestra.run.smithi006.stdout: { 2023-08-01T19:55:04.615 INFO:teuthology.orchestra.run.smithi006.stdout: "type": "v2", 2023-08-01T19:55:04.615 INFO:teuthology.orchestra.run.smithi006.stdout: "addr": "172.21.15.8:6800", 2023-08-01T19:55:04.615 INFO:teuthology.orchestra.run.smithi006.stdout: "nonce": 111181 2023-08-01T19:55:04.615 INFO:teuthology.orchestra.run.smithi006.stdout: }, 2023-08-01T19:55:04.615 INFO:teuthology.orchestra.run.smithi006.stdout: { 2023-08-01T19:55:04.615 INFO:teuthology.orchestra.run.smithi006.stdout: "type": "v1", 2023-08-01T19:55:04.615 INFO:teuthology.orchestra.run.smithi006.stdout: "addr": "172.21.15.8:6801", 2023-08-01T19:55:04.615 INFO:teuthology.orchestra.run.smithi006.stdout: "nonce": 111181 2023-08-01T19:55:04.616 INFO:teuthology.orchestra.run.smithi006.stdout: } 2023-08-01T19:55:04.616 INFO:teuthology.orchestra.run.smithi006.stdout: ] 2023-08-01T19:55:04.616 INFO:teuthology.orchestra.run.smithi006.stdout: }, 2023-08-01T19:55:04.616 INFO:teuthology.orchestra.run.smithi006.stdout: "cluster_addrs": { 2023-08-01T19:55:04.616 INFO:teuthology.orchestra.run.smithi006.stdout: "addrvec": [ 2023-08-01T19:55:04.616 INFO:teuthology.orchestra.run.smithi006.stdout: { 2023-08-01T19:55:04.616 INFO:teuthology.orchestra.run.smithi006.stdout: "type": "v2", 2023-08-01T19:55:04.616 INFO:teuthology.orchestra.run.smithi006.stdout: "addr": "172.21.15.8:6802", 2023-08-01T19:55:04.617 INFO:teuthology.orchestra.run.smithi006.stdout: "nonce": 111181 2023-08-01T19:55:04.617 INFO:teuthology.orchestra.run.smithi006.stdout: }, 2023-08-01T19:55:04.617 INFO:teuthology.orchestra.run.smithi006.stdout: { 2023-08-01T19:55:04.617 INFO:teuthology.orchestra.run.smithi006.stdout: "type": "v1", 2023-08-01T19:55:04.617 INFO:teuthology.orchestra.run.smithi006.stdout: "addr": "172.21.15.8:6803", 2023-08-01T19:55:04.617 INFO:teuthology.orchestra.run.smithi006.stdout: "nonce": 111181 2023-08-01T19:55:04.617 INFO:teuthology.orchestra.run.smithi006.stdout: } 2023-08-01T19:55:04.617 INFO:teuthology.orchestra.run.smithi006.stdout: ] 2023-08-01T19:55:04.618 INFO:teuthology.orchestra.run.smithi006.stdout: }, 2023-08-01T19:55:04.618 INFO:teuthology.orchestra.run.smithi006.stdout: "heartbeat_back_addrs": { 2023-08-01T19:55:04.618 INFO:teuthology.orchestra.run.smithi006.stdout: "addrvec": [ 2023-08-01T19:55:04.618 INFO:teuthology.orchestra.run.smithi006.stdout: { 2023-08-01T19:55:04.618 INFO:teuthology.orchestra.run.smithi006.stdout: "type": "v2", 2023-08-01T19:55:04.618 INFO:teuthology.orchestra.run.smithi006.stdout: "addr": "172.21.15.8:6806", 2023-08-01T19:55:04.618 INFO:teuthology.orchestra.run.smithi006.stdout: "nonce": 111181 2023-08-01T19:55:04.618 INFO:teuthology.orchestra.run.smithi006.stdout: }, 2023-08-01T19:55:04.619 INFO:teuthology.orchestra.run.smithi006.stdout: { 2023-08-01T19:55:04.619 INFO:teuthology.orchestra.run.smithi006.stdout: "type": "v1", 2023-08-01T19:55:04.619 INFO:teuthology.orchestra.run.smithi006.stdout: "addr": "172.21.15.8:6807", 2023-08-01T19:55:04.619 INFO:teuthology.orchestra.run.smithi006.stdout: "nonce": 111181 2023-08-01T19:55:04.619 INFO:teuthology.orchestra.run.smithi006.stdout: } 2023-08-01T19:55:04.619 INFO:teuthology.orchestra.run.smithi006.stdout: ] 2023-08-01T19:55:04.619 INFO:teuthology.orchestra.run.smithi006.stdout: }, 2023-08-01T19:55:04.619 INFO:teuthology.orchestra.run.smithi006.stdout: "heartbeat_front_addrs": { 2023-08-01T19:55:04.620 INFO:teuthology.orchestra.run.smithi006.stdout: "addrvec": [ 2023-08-01T19:55:04.620 INFO:teuthology.orchestra.run.smithi006.stdout: { 2023-08-01T19:55:04.620 INFO:teuthology.orchestra.run.smithi006.stdout: "type": "v2", 2023-08-01T19:55:04.620 INFO:teuthology.orchestra.run.smithi006.stdout: "addr": "172.21.15.8:6804", 2023-08-01T19:55:04.620 INFO:teuthology.orchestra.run.smithi006.stdout: "nonce": 111181 2023-08-01T19:55:04.620 INFO:teuthology.orchestra.run.smithi006.stdout: }, 2023-08-01T19:55:04.620 INFO:teuthology.orchestra.run.smithi006.stdout: { 2023-08-01T19:55:04.621 INFO:teuthology.orchestra.run.smithi006.stdout: "type": "v1", 2023-08-01T19:55:04.621 INFO:teuthology.orchestra.run.smithi006.stdout: "addr": "172.21.15.8:6805", 2023-08-01T19:55:04.621 INFO:teuthology.orchestra.run.smithi006.stdout: "nonce": 111181 2023-08-01T19:55:04.621 INFO:teuthology.orchestra.run.smithi006.stdout: } 2023-08-01T19:55:04.621 INFO:teuthology.orchestra.run.smithi006.stdout: ] 2023-08-01T19:55:04.621 INFO:teuthology.orchestra.run.smithi006.stdout: }, 2023-08-01T19:55:04.621 INFO:teuthology.orchestra.run.smithi006.stdout: "public_addr": "172.21.15.8:6801/111181", 2023-08-01T19:55:04.621 INFO:teuthology.orchestra.run.smithi006.stdout: "cluster_addr": "172.21.15.8:6803/111181", 2023-08-01T19:55:04.622 INFO:teuthology.orchestra.run.smithi006.stdout: "heartbeat_back_addr": "172.21.15.8:6807/111181", 2023-08-01T19:55:04.622 INFO:teuthology.orchestra.run.smithi006.stdout: "heartbeat_front_addr": "172.21.15.8:6805/111181", 2023-08-01T19:55:04.622 INFO:teuthology.orchestra.run.smithi006.stdout: "state": [ 2023-08-01T19:55:04.622 INFO:teuthology.orchestra.run.smithi006.stdout: "exists", 2023-08-01T19:55:04.622 INFO:teuthology.orchestra.run.smithi006.stdout: "up" 2023-08-01T19:55:04.622 INFO:teuthology.orchestra.run.smithi006.stdout: ] 2023-08-01T19:55:04.622 INFO:teuthology.orchestra.run.smithi006.stdout: }, 2023-08-01T19:55:04.622 INFO:teuthology.orchestra.run.smithi006.stdout: { 2023-08-01T19:55:04.623 INFO:teuthology.orchestra.run.smithi006.stdout: "osd": 1, 2023-08-01T19:55:04.623 INFO:teuthology.orchestra.run.smithi006.stdout: "uuid": "7fc612c4-33ba-4a33-bca8-1f42ee8ed548", 2023-08-01T19:55:04.623 INFO:teuthology.orchestra.run.smithi006.stdout: "up": 1, 2023-08-01T19:55:04.623 INFO:teuthology.orchestra.run.smithi006.stdout: "in": 1, 2023-08-01T19:55:04.623 INFO:teuthology.orchestra.run.smithi006.stdout: "weight": 1, 2023-08-01T19:55:04.623 INFO:teuthology.orchestra.run.smithi006.stdout: "primary_affinity": 1, 2023-08-01T19:55:04.623 INFO:teuthology.orchestra.run.smithi006.stdout: "last_clean_begin": 0, 2023-08-01T19:55:04.623 INFO:teuthology.orchestra.run.smithi006.stdout: "last_clean_end": 0, 2023-08-01T19:55:04.624 INFO:teuthology.orchestra.run.smithi006.stdout: "up_from": 8, 2023-08-01T19:55:04.624 INFO:teuthology.orchestra.run.smithi006.stdout: "up_thru": 19, 2023-08-01T19:55:04.624 INFO:teuthology.orchestra.run.smithi006.stdout: "down_at": 0, 2023-08-01T19:55:04.624 INFO:teuthology.orchestra.run.smithi006.stdout: "lost_at": 0, 2023-08-01T19:55:04.624 INFO:teuthology.orchestra.run.smithi006.stdout: "public_addrs": { 2023-08-01T19:55:04.624 INFO:teuthology.orchestra.run.smithi006.stdout: "addrvec": [ 2023-08-01T19:55:04.624 INFO:teuthology.orchestra.run.smithi006.stdout: { 2023-08-01T19:55:04.625 INFO:teuthology.orchestra.run.smithi006.stdout: "type": "v2", 2023-08-01T19:55:04.625 INFO:teuthology.orchestra.run.smithi006.stdout: "addr": "172.21.15.101:6800", 2023-08-01T19:55:04.625 INFO:teuthology.orchestra.run.smithi006.stdout: "nonce": 111143 2023-08-01T19:55:04.625 INFO:teuthology.orchestra.run.smithi006.stdout: }, 2023-08-01T19:55:04.625 INFO:teuthology.orchestra.run.smithi006.stdout: { 2023-08-01T19:55:04.625 INFO:teuthology.orchestra.run.smithi006.stdout: "type": "v1", 2023-08-01T19:55:04.625 INFO:teuthology.orchestra.run.smithi006.stdout: "addr": "172.21.15.101:6801", 2023-08-01T19:55:04.625 INFO:teuthology.orchestra.run.smithi006.stdout: "nonce": 111143 2023-08-01T19:55:04.626 INFO:teuthology.orchestra.run.smithi006.stdout: } 2023-08-01T19:55:04.626 INFO:teuthology.orchestra.run.smithi006.stdout: ] 2023-08-01T19:55:04.626 INFO:teuthology.orchestra.run.smithi006.stdout: }, 2023-08-01T19:55:04.626 INFO:teuthology.orchestra.run.smithi006.stdout: "cluster_addrs": { 2023-08-01T19:55:04.626 INFO:teuthology.orchestra.run.smithi006.stdout: "addrvec": [ 2023-08-01T19:55:04.626 INFO:teuthology.orchestra.run.smithi006.stdout: { 2023-08-01T19:55:04.626 INFO:teuthology.orchestra.run.smithi006.stdout: "type": "v2", 2023-08-01T19:55:04.626 INFO:teuthology.orchestra.run.smithi006.stdout: "addr": "172.21.15.101:6802", 2023-08-01T19:55:04.627 INFO:teuthology.orchestra.run.smithi006.stdout: "nonce": 111143 2023-08-01T19:55:04.627 INFO:teuthology.orchestra.run.smithi006.stdout: }, 2023-08-01T19:55:04.627 INFO:teuthology.orchestra.run.smithi006.stdout: { 2023-08-01T19:55:04.627 INFO:teuthology.orchestra.run.smithi006.stdout: "type": "v1", 2023-08-01T19:55:04.627 INFO:teuthology.orchestra.run.smithi006.stdout: "addr": "172.21.15.101:6803", 2023-08-01T19:55:04.627 INFO:teuthology.orchestra.run.smithi006.stdout: "nonce": 111143 2023-08-01T19:55:04.627 INFO:teuthology.orchestra.run.smithi006.stdout: } 2023-08-01T19:55:04.627 INFO:teuthology.orchestra.run.smithi006.stdout: ] 2023-08-01T19:55:04.628 INFO:teuthology.orchestra.run.smithi006.stdout: }, 2023-08-01T19:55:04.628 INFO:teuthology.orchestra.run.smithi006.stdout: "heartbeat_back_addrs": { 2023-08-01T19:55:04.628 INFO:teuthology.orchestra.run.smithi006.stdout: "addrvec": [ 2023-08-01T19:55:04.628 INFO:teuthology.orchestra.run.smithi006.stdout: { 2023-08-01T19:55:04.628 INFO:teuthology.orchestra.run.smithi006.stdout: "type": "v2", 2023-08-01T19:55:04.628 INFO:teuthology.orchestra.run.smithi006.stdout: "addr": "172.21.15.101:6806", 2023-08-01T19:55:04.628 INFO:teuthology.orchestra.run.smithi006.stdout: "nonce": 111143 2023-08-01T19:55:04.628 INFO:teuthology.orchestra.run.smithi006.stdout: }, 2023-08-01T19:55:04.629 INFO:teuthology.orchestra.run.smithi006.stdout: { 2023-08-01T19:55:04.629 INFO:teuthology.orchestra.run.smithi006.stdout: "type": "v1", 2023-08-01T19:55:04.629 INFO:teuthology.orchestra.run.smithi006.stdout: "addr": "172.21.15.101:6807", 2023-08-01T19:55:04.629 INFO:teuthology.orchestra.run.smithi006.stdout: "nonce": 111143 2023-08-01T19:55:04.629 INFO:teuthology.orchestra.run.smithi006.stdout: } 2023-08-01T19:55:04.629 INFO:teuthology.orchestra.run.smithi006.stdout: ] 2023-08-01T19:55:04.629 INFO:teuthology.orchestra.run.smithi006.stdout: }, 2023-08-01T19:55:04.629 INFO:teuthology.orchestra.run.smithi006.stdout: "heartbeat_front_addrs": { 2023-08-01T19:55:04.630 INFO:teuthology.orchestra.run.smithi006.stdout: "addrvec": [ 2023-08-01T19:55:04.630 INFO:teuthology.orchestra.run.smithi006.stdout: { 2023-08-01T19:55:04.630 INFO:teuthology.orchestra.run.smithi006.stdout: "type": "v2", 2023-08-01T19:55:04.630 INFO:teuthology.orchestra.run.smithi006.stdout: "addr": "172.21.15.101:6804", 2023-08-01T19:55:04.630 INFO:teuthology.orchestra.run.smithi006.stdout: "nonce": 111143 2023-08-01T19:55:04.630 INFO:teuthology.orchestra.run.smithi006.stdout: }, 2023-08-01T19:55:04.630 INFO:teuthology.orchestra.run.smithi006.stdout: { 2023-08-01T19:55:04.630 INFO:teuthology.orchestra.run.smithi006.stdout: "type": "v1", 2023-08-01T19:55:04.631 INFO:teuthology.orchestra.run.smithi006.stdout: "addr": "172.21.15.101:6805", 2023-08-01T19:55:04.631 INFO:teuthology.orchestra.run.smithi006.stdout: "nonce": 111143 2023-08-01T19:55:04.631 INFO:teuthology.orchestra.run.smithi006.stdout: } 2023-08-01T19:55:04.631 INFO:teuthology.orchestra.run.smithi006.stdout: ] 2023-08-01T19:55:04.631 INFO:teuthology.orchestra.run.smithi006.stdout: }, 2023-08-01T19:55:04.631 INFO:teuthology.orchestra.run.smithi006.stdout: "public_addr": "172.21.15.101:6801/111143", 2023-08-01T19:55:04.631 INFO:teuthology.orchestra.run.smithi006.stdout: "cluster_addr": "172.21.15.101:6803/111143", 2023-08-01T19:55:04.632 INFO:teuthology.orchestra.run.smithi006.stdout: "heartbeat_back_addr": "172.21.15.101:6807/111143", 2023-08-01T19:55:04.632 INFO:teuthology.orchestra.run.smithi006.stdout: "heartbeat_front_addr": "172.21.15.101:6805/111143", 2023-08-01T19:55:04.632 INFO:teuthology.orchestra.run.smithi006.stdout: "state": [ 2023-08-01T19:55:04.632 INFO:teuthology.orchestra.run.smithi006.stdout: "exists", 2023-08-01T19:55:04.632 INFO:teuthology.orchestra.run.smithi006.stdout: "up" 2023-08-01T19:55:04.632 INFO:teuthology.orchestra.run.smithi006.stdout: ] 2023-08-01T19:55:04.632 INFO:teuthology.orchestra.run.smithi006.stdout: }, 2023-08-01T19:55:04.632 INFO:teuthology.orchestra.run.smithi006.stdout: { 2023-08-01T19:55:04.633 INFO:teuthology.orchestra.run.smithi006.stdout: "osd": 2, 2023-08-01T19:55:04.633 INFO:teuthology.orchestra.run.smithi006.stdout: "uuid": "f85cadbc-4230-4772-8f39-62ed52e220b1", 2023-08-01T19:55:04.633 INFO:teuthology.orchestra.run.smithi006.stdout: "up": 1, 2023-08-01T19:55:04.633 INFO:teuthology.orchestra.run.smithi006.stdout: "in": 1, 2023-08-01T19:55:04.633 INFO:teuthology.orchestra.run.smithi006.stdout: "weight": 1, 2023-08-01T19:55:04.633 INFO:teuthology.orchestra.run.smithi006.stdout: "primary_affinity": 1, 2023-08-01T19:55:04.633 INFO:teuthology.orchestra.run.smithi006.stdout: "last_clean_begin": 0, 2023-08-01T19:55:04.633 INFO:teuthology.orchestra.run.smithi006.stdout: "last_clean_end": 0, 2023-08-01T19:55:04.634 INFO:teuthology.orchestra.run.smithi006.stdout: "up_from": 9, 2023-08-01T19:55:04.634 INFO:teuthology.orchestra.run.smithi006.stdout: "up_thru": 19, 2023-08-01T19:55:04.634 INFO:teuthology.orchestra.run.smithi006.stdout: "down_at": 0, 2023-08-01T19:55:04.634 INFO:teuthology.orchestra.run.smithi006.stdout: "lost_at": 0, 2023-08-01T19:55:04.634 INFO:teuthology.orchestra.run.smithi006.stdout: "public_addrs": { 2023-08-01T19:55:04.634 INFO:teuthology.orchestra.run.smithi006.stdout: "addrvec": [ 2023-08-01T19:55:04.634 INFO:teuthology.orchestra.run.smithi006.stdout: { 2023-08-01T19:55:04.634 INFO:teuthology.orchestra.run.smithi006.stdout: "type": "v2", 2023-08-01T19:55:04.635 INFO:teuthology.orchestra.run.smithi006.stdout: "addr": "172.21.15.155:6800", 2023-08-01T19:55:04.635 INFO:teuthology.orchestra.run.smithi006.stdout: "nonce": 111339 2023-08-01T19:55:04.635 INFO:teuthology.orchestra.run.smithi006.stdout: }, 2023-08-01T19:55:04.635 INFO:teuthology.orchestra.run.smithi006.stdout: { 2023-08-01T19:55:04.635 INFO:teuthology.orchestra.run.smithi006.stdout: "type": "v1", 2023-08-01T19:55:04.635 INFO:teuthology.orchestra.run.smithi006.stdout: "addr": "172.21.15.155:6801", 2023-08-01T19:55:04.635 INFO:teuthology.orchestra.run.smithi006.stdout: "nonce": 111339 2023-08-01T19:55:04.635 INFO:teuthology.orchestra.run.smithi006.stdout: } 2023-08-01T19:55:04.636 INFO:teuthology.orchestra.run.smithi006.stdout: ] 2023-08-01T19:55:04.636 INFO:teuthology.orchestra.run.smithi006.stdout: }, 2023-08-01T19:55:04.636 INFO:teuthology.orchestra.run.smithi006.stdout: "cluster_addrs": { 2023-08-01T19:55:04.636 INFO:teuthology.orchestra.run.smithi006.stdout: "addrvec": [ 2023-08-01T19:55:04.636 INFO:teuthology.orchestra.run.smithi006.stdout: { 2023-08-01T19:55:04.636 INFO:teuthology.orchestra.run.smithi006.stdout: "type": "v2", 2023-08-01T19:55:04.636 INFO:teuthology.orchestra.run.smithi006.stdout: "addr": "172.21.15.155:6802", 2023-08-01T19:55:04.636 INFO:teuthology.orchestra.run.smithi006.stdout: "nonce": 111339 2023-08-01T19:55:04.637 INFO:teuthology.orchestra.run.smithi006.stdout: }, 2023-08-01T19:55:04.637 INFO:teuthology.orchestra.run.smithi006.stdout: { 2023-08-01T19:55:04.637 INFO:teuthology.orchestra.run.smithi006.stdout: "type": "v1", 2023-08-01T19:55:04.637 INFO:teuthology.orchestra.run.smithi006.stdout: "addr": "172.21.15.155:6803", 2023-08-01T19:55:04.637 INFO:teuthology.orchestra.run.smithi006.stdout: "nonce": 111339 2023-08-01T19:55:04.637 INFO:teuthology.orchestra.run.smithi006.stdout: } 2023-08-01T19:55:04.637 INFO:teuthology.orchestra.run.smithi006.stdout: ] 2023-08-01T19:55:04.638 INFO:teuthology.orchestra.run.smithi006.stdout: }, 2023-08-01T19:55:04.638 INFO:teuthology.orchestra.run.smithi006.stdout: "heartbeat_back_addrs": { 2023-08-01T19:55:04.638 INFO:teuthology.orchestra.run.smithi006.stdout: "addrvec": [ 2023-08-01T19:55:04.638 INFO:teuthology.orchestra.run.smithi006.stdout: { 2023-08-01T19:55:04.638 INFO:teuthology.orchestra.run.smithi006.stdout: "type": "v2", 2023-08-01T19:55:04.638 INFO:teuthology.orchestra.run.smithi006.stdout: "addr": "172.21.15.155:6806", 2023-08-01T19:55:04.638 INFO:teuthology.orchestra.run.smithi006.stdout: "nonce": 111339 2023-08-01T19:55:04.638 INFO:teuthology.orchestra.run.smithi006.stdout: }, 2023-08-01T19:55:04.639 INFO:teuthology.orchestra.run.smithi006.stdout: { 2023-08-01T19:55:04.639 INFO:teuthology.orchestra.run.smithi006.stdout: "type": "v1", 2023-08-01T19:55:04.639 INFO:teuthology.orchestra.run.smithi006.stdout: "addr": "172.21.15.155:6807", 2023-08-01T19:55:04.639 INFO:teuthology.orchestra.run.smithi006.stdout: "nonce": 111339 2023-08-01T19:55:04.639 INFO:teuthology.orchestra.run.smithi006.stdout: } 2023-08-01T19:55:04.639 INFO:teuthology.orchestra.run.smithi006.stdout: ] 2023-08-01T19:55:04.639 INFO:teuthology.orchestra.run.smithi006.stdout: }, 2023-08-01T19:55:04.639 INFO:teuthology.orchestra.run.smithi006.stdout: "heartbeat_front_addrs": { 2023-08-01T19:55:04.640 INFO:teuthology.orchestra.run.smithi006.stdout: "addrvec": [ 2023-08-01T19:55:04.640 INFO:teuthology.orchestra.run.smithi006.stdout: { 2023-08-01T19:55:04.640 INFO:teuthology.orchestra.run.smithi006.stdout: "type": "v2", 2023-08-01T19:55:04.640 INFO:teuthology.orchestra.run.smithi006.stdout: "addr": "172.21.15.155:6804", 2023-08-01T19:55:04.640 INFO:teuthology.orchestra.run.smithi006.stdout: "nonce": 111339 2023-08-01T19:55:04.640 INFO:teuthology.orchestra.run.smithi006.stdout: }, 2023-08-01T19:55:04.640 INFO:teuthology.orchestra.run.smithi006.stdout: { 2023-08-01T19:55:04.640 INFO:teuthology.orchestra.run.smithi006.stdout: "type": "v1", 2023-08-01T19:55:04.641 INFO:teuthology.orchestra.run.smithi006.stdout: "addr": "172.21.15.155:6805", 2023-08-01T19:55:04.641 INFO:teuthology.orchestra.run.smithi006.stdout: "nonce": 111339 2023-08-01T19:55:04.641 INFO:teuthology.orchestra.run.smithi006.stdout: } 2023-08-01T19:55:04.641 INFO:teuthology.orchestra.run.smithi006.stdout: ] 2023-08-01T19:55:04.641 INFO:teuthology.orchestra.run.smithi006.stdout: }, 2023-08-01T19:55:04.641 INFO:teuthology.orchestra.run.smithi006.stdout: "public_addr": "172.21.15.155:6801/111339", 2023-08-01T19:55:04.641 INFO:teuthology.orchestra.run.smithi006.stdout: "cluster_addr": "172.21.15.155:6803/111339", 2023-08-01T19:55:04.641 INFO:teuthology.orchestra.run.smithi006.stdout: "heartbeat_back_addr": "172.21.15.155:6807/111339", 2023-08-01T19:55:04.642 INFO:teuthology.orchestra.run.smithi006.stdout: "heartbeat_front_addr": "172.21.15.155:6805/111339", 2023-08-01T19:55:04.642 INFO:teuthology.orchestra.run.smithi006.stdout: "state": [ 2023-08-01T19:55:04.642 INFO:teuthology.orchestra.run.smithi006.stdout: "exists", 2023-08-01T19:55:04.642 INFO:teuthology.orchestra.run.smithi006.stdout: "up" 2023-08-01T19:55:04.642 INFO:teuthology.orchestra.run.smithi006.stdout: ] 2023-08-01T19:55:04.642 INFO:teuthology.orchestra.run.smithi006.stdout: } 2023-08-01T19:55:04.642 INFO:teuthology.orchestra.run.smithi006.stdout: ], 2023-08-01T19:55:04.642 INFO:teuthology.orchestra.run.smithi006.stdout: "osd_xinfo": [ 2023-08-01T19:55:04.643 INFO:teuthology.orchestra.run.smithi006.stdout: { 2023-08-01T19:55:04.643 INFO:teuthology.orchestra.run.smithi006.stdout: "osd": 0, 2023-08-01T19:55:04.643 INFO:teuthology.orchestra.run.smithi006.stdout: "down_stamp": "0.000000", 2023-08-01T19:55:04.643 INFO:teuthology.orchestra.run.smithi006.stdout: "laggy_probability": 0, 2023-08-01T19:55:04.643 INFO:teuthology.orchestra.run.smithi006.stdout: "laggy_interval": 0, 2023-08-01T19:55:04.643 INFO:teuthology.orchestra.run.smithi006.stdout: "features": 4540138320759226367, 2023-08-01T19:55:04.643 INFO:teuthology.orchestra.run.smithi006.stdout: "old_weight": 0, 2023-08-01T19:55:04.643 INFO:teuthology.orchestra.run.smithi006.stdout: "last_purged_snaps_scrub": "2023-08-01T19:53:48.018154+0000", 2023-08-01T19:55:04.644 INFO:teuthology.orchestra.run.smithi006.stdout: "dead_epoch": 0 2023-08-01T19:55:04.644 INFO:teuthology.orchestra.run.smithi006.stdout: }, 2023-08-01T19:55:04.644 INFO:teuthology.orchestra.run.smithi006.stdout: { 2023-08-01T19:55:04.644 INFO:teuthology.orchestra.run.smithi006.stdout: "osd": 1, 2023-08-01T19:55:04.644 INFO:teuthology.orchestra.run.smithi006.stdout: "down_stamp": "0.000000", 2023-08-01T19:55:04.644 INFO:teuthology.orchestra.run.smithi006.stdout: "laggy_probability": 0, 2023-08-01T19:55:04.644 INFO:teuthology.orchestra.run.smithi006.stdout: "laggy_interval": 0, 2023-08-01T19:55:04.644 INFO:teuthology.orchestra.run.smithi006.stdout: "features": 4540138320759226367, 2023-08-01T19:55:04.645 INFO:teuthology.orchestra.run.smithi006.stdout: "old_weight": 0, 2023-08-01T19:55:04.645 INFO:teuthology.orchestra.run.smithi006.stdout: "last_purged_snaps_scrub": "2023-08-01T19:53:48.000488+0000", 2023-08-01T19:55:04.645 INFO:teuthology.orchestra.run.smithi006.stdout: "dead_epoch": 0 2023-08-01T19:55:04.645 INFO:teuthology.orchestra.run.smithi006.stdout: }, 2023-08-01T19:55:04.645 INFO:teuthology.orchestra.run.smithi006.stdout: { 2023-08-01T19:55:04.645 INFO:teuthology.orchestra.run.smithi006.stdout: "osd": 2, 2023-08-01T19:55:04.645 INFO:teuthology.orchestra.run.smithi006.stdout: "down_stamp": "0.000000", 2023-08-01T19:55:04.645 INFO:teuthology.orchestra.run.smithi006.stdout: "laggy_probability": 0, 2023-08-01T19:55:04.646 INFO:teuthology.orchestra.run.smithi006.stdout: "laggy_interval": 0, 2023-08-01T19:55:04.646 INFO:teuthology.orchestra.run.smithi006.stdout: "features": 4540138320759226367, 2023-08-01T19:55:04.646 INFO:teuthology.orchestra.run.smithi006.stdout: "old_weight": 0, 2023-08-01T19:55:04.646 INFO:teuthology.orchestra.run.smithi006.stdout: "last_purged_snaps_scrub": "2023-08-01T19:53:48.072529+0000", 2023-08-01T19:55:04.646 INFO:teuthology.orchestra.run.smithi006.stdout: "dead_epoch": 0 2023-08-01T19:55:04.646 INFO:teuthology.orchestra.run.smithi006.stdout: } 2023-08-01T19:55:04.646 INFO:teuthology.orchestra.run.smithi006.stdout: ], 2023-08-01T19:55:04.646 INFO:teuthology.orchestra.run.smithi006.stdout: "pg_upmap": [], 2023-08-01T19:55:04.647 INFO:teuthology.orchestra.run.smithi006.stdout: "pg_upmap_items": [], 2023-08-01T19:55:04.647 INFO:teuthology.orchestra.run.smithi006.stdout: "pg_temp": [], 2023-08-01T19:55:04.647 INFO:teuthology.orchestra.run.smithi006.stdout: "primary_temp": [], 2023-08-01T19:55:04.647 INFO:teuthology.orchestra.run.smithi006.stdout: "blocklist": {}, 2023-08-01T19:55:04.647 INFO:teuthology.orchestra.run.smithi006.stdout: "range_blocklist": {}, 2023-08-01T19:55:04.647 INFO:teuthology.orchestra.run.smithi006.stdout: "erasure_code_profiles": { 2023-08-01T19:55:04.647 INFO:teuthology.orchestra.run.smithi006.stdout: "default": { 2023-08-01T19:55:04.647 INFO:teuthology.orchestra.run.smithi006.stdout: "crush-failure-domain": "osd", 2023-08-01T19:55:04.648 INFO:teuthology.orchestra.run.smithi006.stdout: "k": "2", 2023-08-01T19:55:04.648 INFO:teuthology.orchestra.run.smithi006.stdout: "m": "1", 2023-08-01T19:55:04.648 INFO:teuthology.orchestra.run.smithi006.stdout: "plugin": "jerasure", 2023-08-01T19:55:04.648 INFO:teuthology.orchestra.run.smithi006.stdout: "technique": "reed_sol_van" 2023-08-01T19:55:04.648 INFO:teuthology.orchestra.run.smithi006.stdout: } 2023-08-01T19:55:04.648 INFO:teuthology.orchestra.run.smithi006.stdout: }, 2023-08-01T19:55:04.648 INFO:teuthology.orchestra.run.smithi006.stdout: "removed_snaps_queue": [], 2023-08-01T19:55:04.648 INFO:teuthology.orchestra.run.smithi006.stdout: "new_removed_snaps": [], 2023-08-01T19:55:04.649 INFO:teuthology.orchestra.run.smithi006.stdout: "new_purged_snaps": [], 2023-08-01T19:55:04.649 INFO:teuthology.orchestra.run.smithi006.stdout: "crush_node_flags": {}, 2023-08-01T19:55:04.649 INFO:teuthology.orchestra.run.smithi006.stdout: "device_class_flags": {}, 2023-08-01T19:55:04.649 INFO:teuthology.orchestra.run.smithi006.stdout: "stretch_mode": { 2023-08-01T19:55:04.649 INFO:teuthology.orchestra.run.smithi006.stdout: "stretch_mode_enabled": false, 2023-08-01T19:55:04.649 INFO:teuthology.orchestra.run.smithi006.stdout: "stretch_bucket_count": 0, 2023-08-01T19:55:04.649 INFO:teuthology.orchestra.run.smithi006.stdout: "degraded_stretch_mode": 0, 2023-08-01T19:55:04.650 INFO:teuthology.orchestra.run.smithi006.stdout: "recovering_stretch_mode": 0, 2023-08-01T19:55:04.650 INFO:teuthology.orchestra.run.smithi006.stdout: "stretch_mode_bucket": 0 2023-08-01T19:55:04.650 INFO:teuthology.orchestra.run.smithi006.stdout: } 2023-08-01T19:55:04.650 INFO:teuthology.orchestra.run.smithi006.stdout:} 2023-08-01T19:55:04.652 INFO:tasks.thrashosds.thrasher:j is {'epoch': 37, 'fsid': 'a0e420cc-4df1-42a5-8bd4-a98c309a9349', 'created': '2023-08-01T19:53:41.279588+0000', 'modified': '2023-08-01T19:55:03.543395+0000', 'last_up_change': '2023-08-01T19:53:50.735626+0000', 'last_in_change': '2023-08-01T19:53:42.974751+0000', 'flags': 'nodeep-scrub,sortbitwise,recovery_deletes,purged_snapdirs,pglog_hardlimit', 'flags_num': 5804032, 'flags_set': ['nodeep-scrub', 'pglog_hardlimit', 'purged_snapdirs', 'recovery_deletes', 'sortbitwise'], 'crush_version': 5, 'full_ratio': 0.949999988079071, 'backfillfull_ratio': 0.8999999761581421, 'nearfull_ratio': 0.8500000238418579, 'cluster_snapshot': '', 'pool_max': 5, 'max_osd': 3, 'require_min_compat_client': 'luminous', 'min_compat_client': 'jewel', 'require_osd_release': 'quincy', 'pools': [{'pool': 1, 'pool_name': '.mgr', 'create_time': '2023-08-01T19:53:49.961944+0000', 'flags': 1, 'flags_names': 'hashpspool', 'type': 1, 'size': 2, 'min_size': 1, 'crush_rule': 0, 'peering_crush_bucket_count': 0, 'peering_crush_bucket_target': 0, 'peering_crush_bucket_barrier': 0, 'peering_crush_bucket_mandatory_member': 2147483647, 'object_hash': 2, 'pg_autoscale_mode': 'off', 'pg_num': 1, 'pg_placement_num': 1, 'pg_placement_num_target': 1, 'pg_num_target': 1, 'pg_num_pending': 1, 'last_pg_merge_meta': {'source_pgid': '0.0', 'ready_epoch': 0, 'last_epoch_started': 0, 'last_epoch_clean': 0, 'source_version': "0'0", 'target_version': "0'0"}, 'last_change': '11', 'last_force_op_resend': '0', 'last_force_op_resend_prenautilus': '0', 'last_force_op_resend_preluminous': '0', 'auid': 0, 'snap_mode': 'selfmanaged', 'snap_seq': 0, 'snap_epoch': 0, 'pool_snaps': [], 'removed_snaps': '[]', 'quota_max_bytes': 0, 'quota_max_objects': 0, 'tiers': [], 'tier_of': -1, 'read_tier': -1, 'write_tier': -1, 'cache_mode': 'none', 'target_max_bytes': 0, 'target_max_objects': 0, 'cache_target_dirty_ratio_micro': 400000, 'cache_target_dirty_high_ratio_micro': 600000, 'cache_target_full_ratio_micro': 800000, 'cache_min_flush_age': 0, 'cache_min_evict_age': 0, 'erasure_code_profile': '', 'hit_set_params': {'type': 'none'}, 'hit_set_period': 0, 'hit_set_count': 0, 'use_gmt_hitset': True, 'min_read_recency_for_promote': 0, 'min_write_recency_for_promote': 0, 'hit_set_grade_decay_rate': 0, 'hit_set_search_last_n': 0, 'grade_table': [], 'stripe_width': 0, 'expected_num_objects': 0, 'fast_read': False, 'options': {'pg_num_max': 32, 'pg_num_min': 1}, 'application_metadata': {'mgr': {}}}, {'pool': 2, 'pool_name': 'rbd', 'create_time': '2023-08-01T19:53:57.404091+0000', 'flags': 1, 'flags_names': 'hashpspool', 'type': 1, 'size': 2, 'min_size': 1, 'crush_rule': 0, 'peering_crush_bucket_count': 0, 'peering_crush_bucket_target': 0, 'peering_crush_bucket_barrier': 0, 'peering_crush_bucket_mandatory_member': 2147483647, 'object_hash': 2, 'pg_autoscale_mode': 'off', 'pg_num': 8, 'pg_placement_num': 8, 'pg_placement_num_target': 8, 'pg_num_target': 8, 'pg_num_pending': 8, 'last_pg_merge_meta': {'source_pgid': '0.0', 'ready_epoch': 0, 'last_epoch_started': 0, 'last_epoch_clean': 0, 'source_version': "0'0", 'target_version': "0'0"}, 'last_change': '14', 'last_force_op_resend': '0', 'last_force_op_resend_prenautilus': '0', 'last_force_op_resend_preluminous': '0', 'auid': 0, 'snap_mode': 'selfmanaged', 'snap_seq': 0, 'snap_epoch': 0, 'pool_snaps': [], 'removed_snaps': '[]', 'quota_max_bytes': 0, 'quota_max_objects': 0, 'tiers': [], 'tier_of': -1, 'read_tier': -1, 'write_tier': -1, 'cache_mode': 'none', 'target_max_bytes': 0, 'target_max_objects': 0, 'cache_target_dirty_ratio_micro': 400000, 'cache_target_dirty_high_ratio_micro': 600000, 'cache_target_full_ratio_micro': 800000, 'cache_min_flush_age': 0, 'cache_min_evict_age': 0, 'erasure_code_profile': '', 'hit_set_params': {'type': 'none'}, 'hit_set_period': 0, 'hit_set_count': 0, 'use_gmt_hitset': True, 'min_read_recency_for_promote': 0, 'min_write_recency_for_promote': 0, 'hit_set_grade_decay_rate': 0, 'hit_set_search_last_n': 0, 'grade_table': [], 'stripe_width': 0, 'expected_num_objects': 0, 'fast_read': False, 'options': {}, 'application_metadata': {'rbd': {}}}, {'pool': 3, 'pool_name': 'cephfs_metadata', 'create_time': '2023-08-01T19:54:02.111247+0000', 'flags': 1, 'flags_names': 'hashpspool', 'type': 1, 'size': 2, 'min_size': 1, 'crush_rule': 0, 'peering_crush_bucket_count': 0, 'peering_crush_bucket_target': 0, 'peering_crush_bucket_barrier': 0, 'peering_crush_bucket_mandatory_member': 2147483647, 'object_hash': 2, 'pg_autoscale_mode': 'off', 'pg_num': 32, 'pg_placement_num': 32, 'pg_placement_num_target': 32, 'pg_num_target': 32, 'pg_num_pending': 32, 'last_pg_merge_meta': {'source_pgid': '0.0', 'ready_epoch': 0, 'last_epoch_started': 0, 'last_epoch_clean': 0, 'source_version': "0'0", 'target_version': "0'0"}, 'last_change': '17', 'last_force_op_resend': '0', 'last_force_op_resend_prenautilus': '0', 'last_force_op_resend_preluminous': '0', 'auid': 0, 'snap_mode': 'selfmanaged', 'snap_seq': 0, 'snap_epoch': 0, 'pool_snaps': [], 'removed_snaps': '[]', 'quota_max_bytes': 0, 'quota_max_objects': 0, 'tiers': [], 'tier_of': -1, 'read_tier': -1, 'write_tier': -1, 'cache_mode': 'none', 'target_max_bytes': 0, 'target_max_objects': 0, 'cache_target_dirty_ratio_micro': 400000, 'cache_target_dirty_high_ratio_micro': 600000, 'cache_target_full_ratio_micro': 800000, 'cache_min_flush_age': 0, 'cache_min_evict_age': 0, 'erasure_code_profile': '', 'hit_set_params': {'type': 'none'}, 'hit_set_period': 0, 'hit_set_count': 0, 'use_gmt_hitset': True, 'min_read_recency_for_promote': 0, 'min_write_recency_for_promote': 0, 'hit_set_grade_decay_rate': 0, 'hit_set_search_last_n': 0, 'grade_table': [], 'stripe_width': 0, 'expected_num_objects': 0, 'fast_read': False, 'options': {'pg_autoscale_bias': 4, 'pg_num_min': 16, 'recovery_priority': 5}, 'application_metadata': {'cephfs': {'metadata': 'cephfs'}}}, {'pool': 4, 'pool_name': 'cephfs_data', 'create_time': '2023-08-01T19:54:03.430277+0000', 'flags': 1, 'flags_names': 'hashpspool', 'type': 1, 'size': 2, 'min_size': 1, 'crush_rule': 0, 'peering_crush_bucket_count': 0, 'peering_crush_bucket_target': 0, 'peering_crush_bucket_barrier': 0, 'peering_crush_bucket_mandatory_member': 2147483647, 'object_hash': 2, 'pg_autoscale_mode': 'off', 'pg_num': 64, 'pg_placement_num': 64, 'pg_placement_num_target': 64, 'pg_num_target': 64, 'pg_num_pending': 64, 'last_pg_merge_meta': {'source_pgid': '0.0', 'ready_epoch': 0, 'last_epoch_started': 0, 'last_epoch_clean': 0, 'source_version': "0'0", 'target_version': "0'0"}, 'last_change': '18', 'last_force_op_resend': '0', 'last_force_op_resend_prenautilus': '0', 'last_force_op_resend_preluminous': '0', 'auid': 0, 'snap_mode': 'selfmanaged', 'snap_seq': 0, 'snap_epoch': 0, 'pool_snaps': [], 'removed_snaps': '[]', 'quota_max_bytes': 0, 'quota_max_objects': 0, 'tiers': [], 'tier_of': -1, 'read_tier': -1, 'write_tier': -1, 'cache_mode': 'none', 'target_max_bytes': 0, 'target_max_objects': 0, 'cache_target_dirty_ratio_micro': 400000, 'cache_target_dirty_high_ratio_micro': 600000, 'cache_target_full_ratio_micro': 800000, 'cache_min_flush_age': 0, 'cache_min_evict_age': 0, 'erasure_code_profile': '', 'hit_set_params': {'type': 'none'}, 'hit_set_period': 0, 'hit_set_count': 0, 'use_gmt_hitset': True, 'min_read_recency_for_promote': 0, 'min_write_recency_for_promote': 0, 'hit_set_grade_decay_rate': 0, 'hit_set_search_last_n': 0, 'grade_table': [], 'stripe_width': 0, 'expected_num_objects': 0, 'fast_read': False, 'options': {'pg_num_min': 64, 'target_size_ratio': 0.8999999761581421}, 'application_metadata': {'cephfs': {'data': 'cephfs'}}}, {'pool': 5, 'pool_name': 'unique_pool_0', 'create_time': '2023-08-01T19:54:21.165668+0000', 'flags': 1, 'flags_names': 'hashpspool', 'type': 1, 'size': 2, 'min_size': 1, 'crush_rule': 0, 'peering_crush_bucket_count': 0, 'peering_crush_bucket_target': 0, 'peering_crush_bucket_barrier': 0, 'peering_crush_bucket_mandatory_member': 2147483647, 'object_hash': 2, 'pg_autoscale_mode': 'off', 'pg_num': 16, 'pg_placement_num': 16, 'pg_placement_num_target': 16, 'pg_num_target': 16, 'pg_num_pending': 16, 'last_pg_merge_meta': {'source_pgid': '0.0', 'ready_epoch': 0, 'last_epoch_started': 0, 'last_epoch_clean': 0, 'source_version': "0'0", 'target_version': "0'0"}, 'last_change': '21', 'last_force_op_resend': '0', 'last_force_op_resend_prenautilus': '0', 'last_force_op_resend_preluminous': '0', 'auid': 0, 'snap_mode': 'selfmanaged', 'snap_seq': 0, 'snap_epoch': 0, 'pool_snaps': [], 'removed_snaps': '[]', 'quota_max_bytes': 0, 'quota_max_objects': 0, 'tiers': [], 'tier_of': -1, 'read_tier': -1, 'write_tier': -1, 'cache_mode': 'none', 'target_max_bytes': 0, 'target_max_objects': 0, 'cache_target_dirty_ratio_micro': 400000, 'cache_target_dirty_high_ratio_micro': 600000, 'cache_target_full_ratio_micro': 800000, 'cache_min_flush_age': 0, 'cache_min_evict_age': 0, 'erasure_code_profile': '', 'hit_set_params': {'type': 'none'}, 'hit_set_period': 0, 'hit_set_count': 0, 'use_gmt_hitset': True, 'min_read_recency_for_promote': 0, 'min_write_recency_for_promote': 0, 'hit_set_grade_decay_rate': 0, 'hit_set_search_last_n': 0, 'grade_table': [], 'stripe_width': 0, 'expected_num_objects': 0, 'fast_read': False, 'options': {}, 'application_metadata': {'rados': {}}}], 'osds': [{'osd': 0, 'uuid': '5dd675c7-2777-48f2-8009-ff0e0d4c7086', 'up': 1, 'in': 1, 'weight': 1, 'primary_affinity': 1, 'last_clean_begin': 0, 'last_clean_end': 0, 'up_from': 8, 'up_thru': 19, 'down_at': 0, 'lost_at': 0, 'public_addrs': {'addrvec': [{'type': 'v2', 'addr': '172.21.15.8:6800', 'nonce': 111181}, {'type': 'v1', 'addr': '172.21.15.8:6801', 'nonce': 111181}]}, 'cluster_addrs': {'addrvec': [{'type': 'v2', 'addr': '172.21.15.8:6802', 'nonce': 111181}, {'type': 'v1', 'addr': '172.21.15.8:6803', 'nonce': 111181}]}, 'heartbeat_back_addrs': {'addrvec': [{'type': 'v2', 'addr': '172.21.15.8:6806', 'nonce': 111181}, {'type': 'v1', 'addr': '172.21.15.8:6807', 'nonce': 111181}]}, 'heartbeat_front_addrs': {'addrvec': [{'type': 'v2', 'addr': '172.21.15.8:6804', 'nonce': 111181}, {'type': 'v1', 'addr': '172.21.15.8:6805', 'nonce': 111181}]}, 'public_addr': '172.21.15.8:6801/111181', 'cluster_addr': '172.21.15.8:6803/111181', 'heartbeat_back_addr': '172.21.15.8:6807/111181', 'heartbeat_front_addr': '172.21.15.8:6805/111181', 'state': ['exists', 'up']}, {'osd': 1, 'uuid': '7fc612c4-33ba-4a33-bca8-1f42ee8ed548', 'up': 1, 'in': 1, 'weight': 1, 'primary_affinity': 1, 'last_clean_begin': 0, 'last_clean_end': 0, 'up_from': 8, 'up_thru': 19, 'down_at': 0, 'lost_at': 0, 'public_addrs': {'addrvec': [{'type': 'v2', 'addr': '172.21.15.101:6800', 'nonce': 111143}, {'type': 'v1', 'addr': '172.21.15.101:6801', 'nonce': 111143}]}, 'cluster_addrs': {'addrvec': [{'type': 'v2', 'addr': '172.21.15.101:6802', 'nonce': 111143}, {'type': 'v1', 'addr': '172.21.15.101:6803', 'nonce': 111143}]}, 'heartbeat_back_addrs': {'addrvec': [{'type': 'v2', 'addr': '172.21.15.101:6806', 'nonce': 111143}, {'type': 'v1', 'addr': '172.21.15.101:6807', 'nonce': 111143}]}, 'heartbeat_front_addrs': {'addrvec': [{'type': 'v2', 'addr': '172.21.15.101:6804', 'nonce': 111143}, {'type': 'v1', 'addr': '172.21.15.101:6805', 'nonce': 111143}]}, 'public_addr': '172.21.15.101:6801/111143', 'cluster_addr': '172.21.15.101:6803/111143', 'heartbeat_back_addr': '172.21.15.101:6807/111143', 'heartbeat_front_addr': '172.21.15.101:6805/111143', 'state': ['exists', 'up']}, {'osd': 2, 'uuid': 'f85cadbc-4230-4772-8f39-62ed52e220b1', 'up': 1, 'in': 1, 'weight': 1, 'primary_affinity': 1, 'last_clean_begin': 0, 'last_clean_end': 0, 'up_from': 9, 'up_thru': 19, 'down_at': 0, 'lost_at': 0, 'public_addrs': {'addrvec': [{'type': 'v2', 'addr': '172.21.15.155:6800', 'nonce': 111339}, {'type': 'v1', 'addr': '172.21.15.155:6801', 'nonce': 111339}]}, 'cluster_addrs': {'addrvec': [{'type': 'v2', 'addr': '172.21.15.155:6802', 'nonce': 111339}, {'type': 'v1', 'addr': '172.21.15.155:6803', 'nonce': 111339}]}, 'heartbeat_back_addrs': {'addrvec': [{'type': 'v2', 'addr': '172.21.15.155:6806', 'nonce': 111339}, {'type': 'v1', 'addr': '172.21.15.155:6807', 'nonce': 111339}]}, 'heartbeat_front_addrs': {'addrvec': [{'type': 'v2', 'addr': '172.21.15.155:6804', 'nonce': 111339}, {'type': 'v1', 'addr': '172.21.15.155:6805', 'nonce': 111339}]}, 'public_addr': '172.21.15.155:6801/111339', 'cluster_addr': '172.21.15.155:6803/111339', 'heartbeat_back_addr': '172.21.15.155:6807/111339', 'heartbeat_front_addr': '172.21.15.155:6805/111339', 'state': ['exists', 'up']}], 'osd_xinfo': [{'osd': 0, 'down_stamp': '0.000000', 'laggy_probability': 0, 'laggy_interval': 0, 'features': 4540138320759226367, 'old_weight': 0, 'last_purged_snaps_scrub': '2023-08-01T19:53:48.018154+0000', 'dead_epoch': 0}, {'osd': 1, 'down_stamp': '0.000000', 'laggy_probability': 0, 'laggy_interval': 0, 'features': 4540138320759226367, 'old_weight': 0, 'last_purged_snaps_scrub': '2023-08-01T19:53:48.000488+0000', 'dead_epoch': 0}, {'osd': 2, 'down_stamp': '0.000000', 'laggy_probability': 0, 'laggy_interval': 0, 'features': 4540138320759226367, 'old_weight': 0, 'last_purged_snaps_scrub': '2023-08-01T19:53:48.072529+0000', 'dead_epoch': 0}], 'pg_upmap': [], 'pg_upmap_items': [], 'pg_temp': [], 'primary_temp': [], 'blocklist': {}, 'range_blocklist': {}, 'erasure_code_profiles': {'default': {'crush-failure-domain': 'osd', 'k': '2', 'm': '1', 'plugin': 'jerasure', 'technique': 'reed_sol_van'}}, 'removed_snaps_queue': [], 'new_removed_snaps': [], 'new_purged_snaps': [], 'crush_node_flags': {}, 'device_class_flags': {}, 'stretch_mode': {'stretch_mode_enabled': False, 'stretch_bucket_count': 0, 'degraded_stretch_mode': 0, 'recovering_stretch_mode': 0, 'stretch_mode_bucket': 0}} 2023-08-01T19:55:04.653 INFO:tasks.thrashosds.thrasher:No pg_upmap entries; doing nothing 2023-08-01T19:55:04.653 INFO:teuthology.orchestra.run.smithi101.stdout:{ 2023-08-01T19:55:04.653 INFO:teuthology.orchestra.run.smithi101.stdout: "size": 20, 2023-08-01T19:55:04.653 INFO:teuthology.orchestra.run.smithi101.stdout: "duration": 600, 2023-08-01T19:55:04.654 INFO:teuthology.orchestra.run.smithi101.stdout: "ops": [ 2023-08-01T19:55:04.654 INFO:teuthology.orchestra.run.smithi101.stdout: { 2023-08-01T19:55:04.654 INFO:teuthology.orchestra.run.smithi101.stdout: "description": "osd_op(mds.0.3:6 3.10 3:0d82a743:::600.00000000:head [omap-set-header] snapc 0=[] ondisk+write+known_if_redirected+full_force+supports_pool_eio e17)", 2023-08-01T19:55:04.654 INFO:teuthology.orchestra.run.smithi101.stdout: "initiated_at": "2023-08-01T19:54:04.458774+0000", 2023-08-01T19:55:04.654 INFO:teuthology.orchestra.run.smithi101.stdout: "age": 60.102106421999999, 2023-08-01T19:55:04.654 INFO:teuthology.orchestra.run.smithi101.stdout: "duration": 0.017582611000000001, 2023-08-01T19:55:04.654 INFO:teuthology.orchestra.run.smithi101.stdout: "type_data": { 2023-08-01T19:55:04.655 INFO:teuthology.orchestra.run.smithi101.stdout: "flag_point": "commit sent; apply or cleanup", 2023-08-01T19:55:04.655 INFO:teuthology.orchestra.run.smithi101.stdout: "events": [ 2023-08-01T19:55:04.655 INFO:teuthology.orchestra.run.smithi101.stdout: { 2023-08-01T19:55:04.655 INFO:teuthology.orchestra.run.smithi101.stdout: "event": "initiated", 2023-08-01T19:55:04.655 INFO:teuthology.orchestra.run.smithi101.stdout: "time": "2023-08-01T19:54:04.458774+0000", 2023-08-01T19:55:04.655 INFO:teuthology.orchestra.run.smithi101.stdout: "duration": 0 2023-08-01T19:55:04.655 INFO:teuthology.orchestra.run.smithi101.stdout: }, 2023-08-01T19:55:04.655 INFO:teuthology.orchestra.run.smithi101.stdout: { 2023-08-01T19:55:04.656 INFO:teuthology.orchestra.run.smithi101.stdout: "event": "throttled", 2023-08-01T19:55:04.656 INFO:teuthology.orchestra.run.smithi101.stdout: "time": "2023-08-01T19:54:04.458774+0000", 2023-08-01T19:55:04.656 INFO:teuthology.orchestra.run.smithi101.stdout: "duration": 0 2023-08-01T19:55:04.656 INFO:teuthology.orchestra.run.smithi101.stdout: }, 2023-08-01T19:55:04.656 INFO:teuthology.orchestra.run.smithi101.stdout: { 2023-08-01T19:55:04.656 INFO:teuthology.orchestra.run.smithi101.stdout: "event": "header_read", 2023-08-01T19:55:04.656 INFO:teuthology.orchestra.run.smithi101.stdout: "time": "2023-08-01T19:54:04.458772+0000", 2023-08-01T19:55:04.657 INFO:teuthology.orchestra.run.smithi101.stdout: "duration": 4294967295.9999981 2023-08-01T19:55:04.657 INFO:teuthology.orchestra.run.smithi101.stdout: }, 2023-08-01T19:55:04.657 INFO:teuthology.orchestra.run.smithi101.stdout: { 2023-08-01T19:55:04.657 INFO:teuthology.orchestra.run.smithi101.stdout: "event": "all_read", 2023-08-01T19:55:04.657 INFO:teuthology.orchestra.run.smithi101.stdout: "time": "2023-08-01T19:54:04.458781+0000", 2023-08-01T19:55:04.657 INFO:teuthology.orchestra.run.smithi101.stdout: "duration": 8.6670000000000002e-06 2023-08-01T19:55:04.657 INFO:teuthology.orchestra.run.smithi101.stdout: }, 2023-08-01T19:55:04.658 INFO:teuthology.orchestra.run.smithi101.stdout: { 2023-08-01T19:55:04.658 INFO:teuthology.orchestra.run.smithi101.stdout: "event": "dispatched", 2023-08-01T19:55:04.658 INFO:teuthology.orchestra.run.smithi101.stdout: "time": "2023-08-01T19:54:04.458797+0000", 2023-08-01T19:55:04.658 INFO:teuthology.orchestra.run.smithi101.stdout: "duration": 1.6463000000000001e-05 2023-08-01T19:55:04.658 INFO:teuthology.orchestra.run.smithi101.stdout: }, 2023-08-01T19:55:04.658 INFO:teuthology.orchestra.run.smithi101.stdout: { 2023-08-01T19:55:04.658 INFO:teuthology.orchestra.run.smithi101.stdout: "event": "queued_for_pg", 2023-08-01T19:55:04.658 INFO:teuthology.orchestra.run.smithi101.stdout: "time": "2023-08-01T19:54:04.458810+0000", 2023-08-01T19:55:04.659 INFO:teuthology.orchestra.run.smithi101.stdout: "duration": 1.2753e-05 2023-08-01T19:55:04.659 INFO:teuthology.orchestra.run.smithi101.stdout: }, 2023-08-01T19:55:04.659 INFO:teuthology.orchestra.run.smithi101.stdout: { 2023-08-01T19:55:04.659 INFO:teuthology.orchestra.run.smithi101.stdout: "event": "reached_pg", 2023-08-01T19:55:04.659 INFO:teuthology.orchestra.run.smithi101.stdout: "time": "2023-08-01T19:54:04.458866+0000", 2023-08-01T19:55:04.659 INFO:teuthology.orchestra.run.smithi101.stdout: "duration": 5.6625000000000001e-05 2023-08-01T19:55:04.659 INFO:teuthology.orchestra.run.smithi101.stdout: }, 2023-08-01T19:55:04.659 INFO:teuthology.orchestra.run.smithi101.stdout: { 2023-08-01T19:55:04.660 INFO:teuthology.orchestra.run.smithi101.stdout: "event": "op must wait for map", 2023-08-01T19:55:04.660 INFO:teuthology.orchestra.run.smithi101.stdout: "time": "2023-08-01T19:54:04.458873+0000", 2023-08-01T19:55:04.660 INFO:teuthology.orchestra.run.smithi101.stdout: "duration": 6.9110000000000004e-06 2023-08-01T19:55:04.660 INFO:teuthology.orchestra.run.smithi101.stdout: }, 2023-08-01T19:55:04.660 INFO:teuthology.orchestra.run.smithi101.stdout: { 2023-08-01T19:55:04.660 INFO:teuthology.orchestra.run.smithi101.stdout: "event": "reached_pg", 2023-08-01T19:55:04.660 INFO:teuthology.orchestra.run.smithi101.stdout: "time": "2023-08-01T19:54:04.466999+0000", 2023-08-01T19:55:04.660 INFO:teuthology.orchestra.run.smithi101.stdout: "duration": 0.0081256550000000007 2023-08-01T19:55:04.661 INFO:teuthology.orchestra.run.smithi101.stdout: }, 2023-08-01T19:55:04.661 INFO:teuthology.orchestra.run.smithi101.stdout: { 2023-08-01T19:55:04.661 INFO:teuthology.orchestra.run.smithi101.stdout: "event": "started", 2023-08-01T19:55:04.661 INFO:teuthology.orchestra.run.smithi101.stdout: "time": "2023-08-01T19:54:04.467201+0000", 2023-08-01T19:55:04.661 INFO:teuthology.orchestra.run.smithi101.stdout: "duration": 0.00020166199999999999 2023-08-01T19:55:04.661 INFO:teuthology.orchestra.run.smithi101.stdout: }, 2023-08-01T19:55:04.661 INFO:teuthology.orchestra.run.smithi101.stdout: { 2023-08-01T19:55:04.661 INFO:teuthology.orchestra.run.smithi101.stdout: "event": "waiting for subops from 2", 2023-08-01T19:55:04.662 INFO:teuthology.orchestra.run.smithi101.stdout: "time": "2023-08-01T19:54:04.467350+0000", 2023-08-01T19:55:04.662 INFO:teuthology.orchestra.run.smithi101.stdout: "duration": 0.000149173 2023-08-01T19:55:04.662 INFO:teuthology.orchestra.run.smithi101.stdout: }, 2023-08-01T19:55:04.662 INFO:teuthology.orchestra.run.smithi101.stdout: { 2023-08-01T19:55:04.662 INFO:teuthology.orchestra.run.smithi101.stdout: "event": "op_commit", 2023-08-01T19:55:04.662 INFO:teuthology.orchestra.run.smithi101.stdout: "time": "2023-08-01T19:54:04.476168+0000", 2023-08-01T19:55:04.662 INFO:teuthology.orchestra.run.smithi101.stdout: "duration": 0.0088183250000000001 2023-08-01T19:55:04.662 INFO:teuthology.orchestra.run.smithi101.stdout: }, 2023-08-01T19:55:04.663 INFO:teuthology.orchestra.run.smithi101.stdout: { 2023-08-01T19:55:04.663 INFO:teuthology.orchestra.run.smithi101.stdout: "event": "sub_op_commit_rec", 2023-08-01T19:55:04.663 INFO:teuthology.orchestra.run.smithi101.stdout: "time": "2023-08-01T19:54:04.476239+0000", 2023-08-01T19:55:04.663 INFO:teuthology.orchestra.run.smithi101.stdout: "duration": 7.1296000000000003e-05 2023-08-01T19:55:04.663 INFO:teuthology.orchestra.run.smithi101.stdout: }, 2023-08-01T19:55:04.663 INFO:teuthology.orchestra.run.smithi101.stdout: { 2023-08-01T19:55:04.663 INFO:teuthology.orchestra.run.smithi101.stdout: "event": "commit_sent", 2023-08-01T19:55:04.663 INFO:teuthology.orchestra.run.smithi101.stdout: "time": "2023-08-01T19:54:04.476290+0000", 2023-08-01T19:55:04.664 INFO:teuthology.orchestra.run.smithi101.stdout: "duration": 5.0423999999999997e-05 2023-08-01T19:55:04.664 INFO:teuthology.orchestra.run.smithi101.stdout: }, 2023-08-01T19:55:04.664 INFO:teuthology.orchestra.run.smithi101.stdout: { 2023-08-01T19:55:04.664 INFO:teuthology.orchestra.run.smithi101.stdout: "event": "done", 2023-08-01T19:55:04.664 INFO:teuthology.orchestra.run.smithi101.stdout: "time": "2023-08-01T19:54:04.476356+0000", 2023-08-01T19:55:04.664 INFO:teuthology.orchestra.run.smithi101.stdout: "duration": 6.6439000000000005e-05 2023-08-01T19:55:04.664 INFO:teuthology.orchestra.run.smithi101.stdout: } 2023-08-01T19:55:04.665 INFO:teuthology.orchestra.run.smithi101.stdout: ] 2023-08-01T19:55:04.665 INFO:teuthology.orchestra.run.smithi101.stdout: } 2023-08-01T19:55:04.665 INFO:teuthology.orchestra.run.smithi101.stdout: }, 2023-08-01T19:55:04.665 INFO:teuthology.orchestra.run.smithi101.stdout: { 2023-08-01T19:55:04.665 INFO:teuthology.orchestra.run.smithi101.stdout: "description": "osd_op(mds.0.3:7 3.10 3:0d82a743:::600.00000000:head [create,setxattr parent (62) in=6b,setxattr layout (30) in=6b] snapc 0=[] ondisk+write+known_if_redirected+full_force+supports_pool_eio e17)", 2023-08-01T19:55:04.665 INFO:teuthology.orchestra.run.smithi101.stdout: "initiated_at": "2023-08-01T19:54:04.458830+0000", 2023-08-01T19:55:04.665 INFO:teuthology.orchestra.run.smithi101.stdout: "age": 60.102050034999998, 2023-08-01T19:55:04.665 INFO:teuthology.orchestra.run.smithi101.stdout: "duration": 0.018463726, 2023-08-01T19:55:04.666 INFO:teuthology.orchestra.run.smithi101.stdout: "type_data": { 2023-08-01T19:55:04.666 INFO:teuthology.orchestra.run.smithi101.stdout: "flag_point": "commit sent; apply or cleanup", 2023-08-01T19:55:04.666 INFO:teuthology.orchestra.run.smithi101.stdout: "events": [ 2023-08-01T19:55:04.666 INFO:teuthology.orchestra.run.smithi101.stdout: { 2023-08-01T19:55:04.666 INFO:teuthology.orchestra.run.smithi101.stdout: "event": "initiated", 2023-08-01T19:55:04.666 INFO:teuthology.orchestra.run.smithi101.stdout: "time": "2023-08-01T19:54:04.458830+0000", 2023-08-01T19:55:04.666 INFO:teuthology.orchestra.run.smithi101.stdout: "duration": 0 2023-08-01T19:55:04.666 INFO:teuthology.orchestra.run.smithi101.stdout: }, 2023-08-01T19:55:04.667 INFO:teuthology.orchestra.run.smithi101.stdout: { 2023-08-01T19:55:04.667 INFO:teuthology.orchestra.run.smithi101.stdout: "event": "throttled", 2023-08-01T19:55:04.667 INFO:teuthology.orchestra.run.smithi101.stdout: "time": "2023-08-01T19:54:04.458830+0000", 2023-08-01T19:55:04.667 INFO:teuthology.orchestra.run.smithi101.stdout: "duration": 0 2023-08-01T19:55:04.667 INFO:teuthology.orchestra.run.smithi101.stdout: }, 2023-08-01T19:55:04.667 INFO:teuthology.orchestra.run.smithi101.stdout: { 2023-08-01T19:55:04.667 INFO:teuthology.orchestra.run.smithi101.stdout: "event": "header_read", 2023-08-01T19:55:04.667 INFO:teuthology.orchestra.run.smithi101.stdout: "time": "2023-08-01T19:54:04.458829+0000", 2023-08-01T19:55:04.668 INFO:teuthology.orchestra.run.smithi101.stdout: "duration": 4294967295.999999 2023-08-01T19:55:04.668 INFO:teuthology.orchestra.run.smithi101.stdout: }, 2023-08-01T19:55:04.668 INFO:teuthology.orchestra.run.smithi101.stdout: { 2023-08-01T19:55:04.668 INFO:teuthology.orchestra.run.smithi101.stdout: "event": "all_read", 2023-08-01T19:55:04.668 INFO:teuthology.orchestra.run.smithi101.stdout: "time": "2023-08-01T19:54:04.458838+0000", 2023-08-01T19:55:04.668 INFO:teuthology.orchestra.run.smithi101.stdout: "duration": 8.5369999999999997e-06 2023-08-01T19:55:04.668 INFO:teuthology.orchestra.run.smithi101.stdout: }, 2023-08-01T19:55:04.668 INFO:teuthology.orchestra.run.smithi101.stdout: { 2023-08-01T19:55:04.669 INFO:teuthology.orchestra.run.smithi101.stdout: "event": "dispatched", 2023-08-01T19:55:04.669 INFO:teuthology.orchestra.run.smithi101.stdout: "time": "2023-08-01T19:54:04.458850+0000", 2023-08-01T19:55:04.669 INFO:teuthology.orchestra.run.smithi101.stdout: "duration": 1.203e-05 2023-08-01T19:55:04.669 INFO:teuthology.orchestra.run.smithi101.stdout: }, 2023-08-01T19:55:04.669 INFO:teuthology.orchestra.run.smithi101.stdout: { 2023-08-01T19:55:04.669 INFO:teuthology.orchestra.run.smithi101.stdout: "event": "queued_for_pg", 2023-08-01T19:55:04.669 INFO:teuthology.orchestra.run.smithi101.stdout: "time": "2023-08-01T19:54:04.458859+0000", 2023-08-01T19:55:04.669 INFO:teuthology.orchestra.run.smithi101.stdout: "duration": 8.9889999999999998e-06 2023-08-01T19:55:04.670 INFO:teuthology.orchestra.run.smithi101.stdout: }, 2023-08-01T19:55:04.670 INFO:teuthology.orchestra.run.smithi101.stdout: { 2023-08-01T19:55:04.670 INFO:teuthology.orchestra.run.smithi101.stdout: "event": "reached_pg", 2023-08-01T19:55:04.670 INFO:teuthology.orchestra.run.smithi101.stdout: "time": "2023-08-01T19:54:04.458926+0000", 2023-08-01T19:55:04.670 INFO:teuthology.orchestra.run.smithi101.stdout: "duration": 6.6741000000000004e-05 2023-08-01T19:55:04.670 INFO:teuthology.orchestra.run.smithi101.stdout: }, 2023-08-01T19:55:04.670 INFO:teuthology.orchestra.run.smithi101.stdout: { 2023-08-01T19:55:04.670 INFO:teuthology.orchestra.run.smithi101.stdout: "event": "waiting_for_map not empty", 2023-08-01T19:55:04.671 INFO:teuthology.orchestra.run.smithi101.stdout: "time": "2023-08-01T19:54:04.458929+0000", 2023-08-01T19:55:04.671 INFO:teuthology.orchestra.run.smithi101.stdout: "duration": 3.303e-06 2023-08-01T19:55:04.671 INFO:teuthology.orchestra.run.smithi101.stdout: }, 2023-08-01T19:55:04.671 INFO:teuthology.orchestra.run.smithi101.stdout: { 2023-08-01T19:55:04.671 INFO:teuthology.orchestra.run.smithi101.stdout: "event": "reached_pg", 2023-08-01T19:55:04.671 INFO:teuthology.orchestra.run.smithi101.stdout: "time": "2023-08-01T19:54:04.468692+0000", 2023-08-01T19:55:04.671 INFO:teuthology.orchestra.run.smithi101.stdout: "duration": 0.0097635910000000003 2023-08-01T19:55:04.671 INFO:teuthology.orchestra.run.smithi101.stdout: }, 2023-08-01T19:55:04.672 INFO:teuthology.orchestra.run.smithi101.stdout: { 2023-08-01T19:55:04.672 INFO:teuthology.orchestra.run.smithi101.stdout: "event": "started", 2023-08-01T19:55:04.672 INFO:teuthology.orchestra.run.smithi101.stdout: "time": "2023-08-01T19:54:04.468774+0000", 2023-08-01T19:55:04.672 INFO:teuthology.orchestra.run.smithi101.stdout: "duration": 8.1092000000000002e-05 2023-08-01T19:55:04.672 INFO:teuthology.orchestra.run.smithi101.stdout: }, 2023-08-01T19:55:04.672 INFO:teuthology.orchestra.run.smithi101.stdout: { 2023-08-01T19:55:04.672 INFO:teuthology.orchestra.run.smithi101.stdout: "event": "waiting for subops from 2", 2023-08-01T19:55:04.673 INFO:teuthology.orchestra.run.smithi101.stdout: "time": "2023-08-01T19:54:04.468934+0000", 2023-08-01T19:55:04.673 INFO:teuthology.orchestra.run.smithi101.stdout: "duration": 0.000160027 2023-08-01T19:55:04.673 INFO:teuthology.orchestra.run.smithi101.stdout: }, 2023-08-01T19:55:04.673 INFO:teuthology.orchestra.run.smithi101.stdout: { 2023-08-01T19:55:04.673 INFO:teuthology.orchestra.run.smithi101.stdout: "event": "op_commit", 2023-08-01T19:55:04.673 INFO:teuthology.orchestra.run.smithi101.stdout: "time": "2023-08-01T19:54:04.476174+0000", 2023-08-01T19:55:04.673 INFO:teuthology.orchestra.run.smithi101.stdout: "duration": 0.0072400479999999998 2023-08-01T19:55:04.673 INFO:teuthology.orchestra.run.smithi101.stdout: }, 2023-08-01T19:55:04.674 INFO:teuthology.orchestra.run.smithi101.stdout: { 2023-08-01T19:55:04.674 INFO:teuthology.orchestra.run.smithi101.stdout: "event": "sub_op_commit_rec", 2023-08-01T19:55:04.674 INFO:teuthology.orchestra.run.smithi101.stdout: "time": "2023-08-01T19:54:04.477206+0000", 2023-08-01T19:55:04.674 INFO:teuthology.orchestra.run.smithi101.stdout: "duration": 0.0010318969999999999 2023-08-01T19:55:04.674 INFO:teuthology.orchestra.run.smithi101.stdout: }, 2023-08-01T19:55:04.674 INFO:teuthology.orchestra.run.smithi101.stdout: { 2023-08-01T19:55:04.674 INFO:teuthology.orchestra.run.smithi101.stdout: "event": "commit_sent", 2023-08-01T19:55:04.674 INFO:teuthology.orchestra.run.smithi101.stdout: "time": "2023-08-01T19:54:04.477257+0000", 2023-08-01T19:55:04.675 INFO:teuthology.orchestra.run.smithi101.stdout: "duration": 5.1156000000000003e-05 2023-08-01T19:55:04.675 INFO:teuthology.orchestra.run.smithi101.stdout: }, 2023-08-01T19:55:04.675 INFO:teuthology.orchestra.run.smithi101.stdout: { 2023-08-01T19:55:04.675 INFO:teuthology.orchestra.run.smithi101.stdout: "event": "done", 2023-08-01T19:55:04.675 INFO:teuthology.orchestra.run.smithi101.stdout: "time": "2023-08-01T19:54:04.477294+0000", 2023-08-01T19:55:04.675 INFO:teuthology.orchestra.run.smithi101.stdout: "duration": 3.7150000000000002e-05 2023-08-01T19:55:04.675 INFO:teuthology.orchestra.run.smithi101.stdout: } 2023-08-01T19:55:04.675 INFO:teuthology.orchestra.run.smithi101.stdout: ] 2023-08-01T19:55:04.676 INFO:teuthology.orchestra.run.smithi101.stdout: } 2023-08-01T19:55:04.676 INFO:teuthology.orchestra.run.smithi101.stdout: }, 2023-08-01T19:55:04.676 INFO:teuthology.orchestra.run.smithi101.stdout: { 2023-08-01T19:55:04.676 INFO:teuthology.orchestra.run.smithi101.stdout: "description": "osd_op(mds.0.3:8 3.10 3:09401a81:::601.00000000:head [omap-set-header] snapc 0=[] ondisk+write+known_if_redirected+full_force+supports_pool_eio e17)", 2023-08-01T19:55:04.676 INFO:teuthology.orchestra.run.smithi101.stdout: "initiated_at": "2023-08-01T19:54:04.458869+0000", 2023-08-01T19:55:04.676 INFO:teuthology.orchestra.run.smithi101.stdout: "age": 60.102010899, 2023-08-01T19:55:04.676 INFO:teuthology.orchestra.run.smithi101.stdout: "duration": 0.018528932000000001, 2023-08-01T19:55:04.676 INFO:teuthology.orchestra.run.smithi101.stdout: "type_data": { 2023-08-01T19:55:04.677 INFO:teuthology.orchestra.run.smithi101.stdout: "flag_point": "commit sent; apply or cleanup", 2023-08-01T19:55:04.677 INFO:teuthology.orchestra.run.smithi101.stdout: "events": [ 2023-08-01T19:55:04.677 INFO:teuthology.orchestra.run.smithi101.stdout: { 2023-08-01T19:55:04.677 INFO:teuthology.orchestra.run.smithi101.stdout: "event": "initiated", 2023-08-01T19:55:04.677 INFO:teuthology.orchestra.run.smithi101.stdout: "time": "2023-08-01T19:54:04.458869+0000", 2023-08-01T19:55:04.677 INFO:teuthology.orchestra.run.smithi101.stdout: "duration": 0 2023-08-01T19:55:04.677 INFO:teuthology.orchestra.run.smithi101.stdout: }, 2023-08-01T19:55:04.677 INFO:teuthology.orchestra.run.smithi101.stdout: { 2023-08-01T19:55:04.678 INFO:teuthology.orchestra.run.smithi101.stdout: "event": "throttled", 2023-08-01T19:55:04.678 INFO:teuthology.orchestra.run.smithi101.stdout: "time": "2023-08-01T19:54:04.458869+0000", 2023-08-01T19:55:04.678 INFO:teuthology.orchestra.run.smithi101.stdout: "duration": 0 2023-08-01T19:55:04.678 INFO:teuthology.orchestra.run.smithi101.stdout: }, 2023-08-01T19:55:04.678 INFO:teuthology.orchestra.run.smithi101.stdout: { 2023-08-01T19:55:04.678 INFO:teuthology.orchestra.run.smithi101.stdout: "event": "header_read", 2023-08-01T19:55:04.678 INFO:teuthology.orchestra.run.smithi101.stdout: "time": "2023-08-01T19:54:04.458869+0000", 2023-08-01T19:55:04.678 INFO:teuthology.orchestra.run.smithi101.stdout: "duration": 4294967295.9999995 2023-08-01T19:55:04.679 INFO:teuthology.orchestra.run.smithi101.stdout: }, 2023-08-01T19:55:04.679 INFO:teuthology.orchestra.run.smithi101.stdout: { 2023-08-01T19:55:04.679 INFO:teuthology.orchestra.run.smithi101.stdout: "event": "all_read", 2023-08-01T19:55:04.679 INFO:teuthology.orchestra.run.smithi101.stdout: "time": "2023-08-01T19:54:04.458878+0000", 2023-08-01T19:55:04.679 INFO:teuthology.orchestra.run.smithi101.stdout: "duration": 9.4110000000000002e-06 2023-08-01T19:55:04.679 INFO:teuthology.orchestra.run.smithi101.stdout: }, 2023-08-01T19:55:04.679 INFO:teuthology.orchestra.run.smithi101.stdout: { 2023-08-01T19:55:04.680 INFO:teuthology.orchestra.run.smithi101.stdout: "event": "dispatched", 2023-08-01T19:55:04.680 INFO:teuthology.orchestra.run.smithi101.stdout: "time": "2023-08-01T19:54:04.458886+0000", 2023-08-01T19:55:04.680 INFO:teuthology.orchestra.run.smithi101.stdout: "duration": 7.6090000000000003e-06 2023-08-01T19:55:04.680 INFO:teuthology.orchestra.run.smithi101.stdout: }, 2023-08-01T19:55:04.680 INFO:teuthology.orchestra.run.smithi101.stdout: { 2023-08-01T19:55:04.680 INFO:teuthology.orchestra.run.smithi101.stdout: "event": "queued_for_pg", 2023-08-01T19:55:04.680 INFO:teuthology.orchestra.run.smithi101.stdout: "time": "2023-08-01T19:54:04.458890+0000", 2023-08-01T19:55:04.680 INFO:teuthology.orchestra.run.smithi101.stdout: "duration": 4.8470000000000003e-06 2023-08-01T19:55:04.681 INFO:teuthology.orchestra.run.smithi101.stdout: }, 2023-08-01T19:55:04.681 INFO:teuthology.orchestra.run.smithi101.stdout: { 2023-08-01T19:55:04.681 INFO:teuthology.orchestra.run.smithi101.stdout: "event": "reached_pg", 2023-08-01T19:55:04.681 INFO:teuthology.orchestra.run.smithi101.stdout: "time": "2023-08-01T19:54:04.458957+0000", 2023-08-01T19:55:04.681 INFO:teuthology.orchestra.run.smithi101.stdout: "duration": 6.6502999999999997e-05 2023-08-01T19:55:04.681 INFO:teuthology.orchestra.run.smithi101.stdout: }, 2023-08-01T19:55:04.681 INFO:teuthology.orchestra.run.smithi101.stdout: { 2023-08-01T19:55:04.681 INFO:teuthology.orchestra.run.smithi101.stdout: "event": "waiting_for_map not empty", 2023-08-01T19:55:04.682 INFO:teuthology.orchestra.run.smithi101.stdout: "time": "2023-08-01T19:54:04.458959+0000", 2023-08-01T19:55:04.682 INFO:teuthology.orchestra.run.smithi101.stdout: "duration": 2.3989999999999998e-06 2023-08-01T19:55:04.682 INFO:teuthology.orchestra.run.smithi101.stdout: }, 2023-08-01T19:55:04.682 INFO:teuthology.orchestra.run.smithi101.stdout: { 2023-08-01T19:55:04.682 INFO:teuthology.orchestra.run.smithi101.stdout: "event": "reached_pg", 2023-08-01T19:55:04.682 INFO:teuthology.orchestra.run.smithi101.stdout: "time": "2023-08-01T19:54:04.469554+0000", 2023-08-01T19:55:04.682 INFO:teuthology.orchestra.run.smithi101.stdout: "duration": 0.010594404 2023-08-01T19:55:04.682 INFO:teuthology.orchestra.run.smithi101.stdout: }, 2023-08-01T19:55:04.683 INFO:teuthology.orchestra.run.smithi101.stdout: { 2023-08-01T19:55:04.683 INFO:teuthology.orchestra.run.smithi101.stdout: "event": "started", 2023-08-01T19:55:04.683 INFO:teuthology.orchestra.run.smithi101.stdout: "time": "2023-08-01T19:54:04.469694+0000", 2023-08-01T19:55:04.683 INFO:teuthology.orchestra.run.smithi101.stdout: "duration": 0.00014006899999999999 2023-08-01T19:55:04.683 INFO:teuthology.orchestra.run.smithi101.stdout: }, 2023-08-01T19:55:04.683 INFO:teuthology.orchestra.run.smithi101.stdout: { 2023-08-01T19:55:04.683 INFO:teuthology.orchestra.run.smithi101.stdout: "event": "waiting for subops from 2", 2023-08-01T19:55:04.683 INFO:teuthology.orchestra.run.smithi101.stdout: "time": "2023-08-01T19:54:04.469826+0000", 2023-08-01T19:55:04.684 INFO:teuthology.orchestra.run.smithi101.stdout: "duration": 0.000132285 2023-08-01T19:55:04.684 INFO:teuthology.orchestra.run.smithi101.stdout: }, 2023-08-01T19:55:04.684 INFO:teuthology.orchestra.run.smithi101.stdout: { 2023-08-01T19:55:04.684 INFO:teuthology.orchestra.run.smithi101.stdout: "event": "op_commit", 2023-08-01T19:55:04.684 INFO:teuthology.orchestra.run.smithi101.stdout: "time": "2023-08-01T19:54:04.476179+0000", 2023-08-01T19:55:04.684 INFO:teuthology.orchestra.run.smithi101.stdout: "duration": 0.0063524289999999997 2023-08-01T19:55:04.684 INFO:teuthology.orchestra.run.smithi101.stdout: }, 2023-08-01T19:55:04.685 INFO:teuthology.orchestra.run.smithi101.stdout: { 2023-08-01T19:55:04.685 INFO:teuthology.orchestra.run.smithi101.stdout: "event": "sub_op_commit_rec", 2023-08-01T19:55:04.685 INFO:teuthology.orchestra.run.smithi101.stdout: "time": "2023-08-01T19:54:04.477334+0000", 2023-08-01T19:55:04.685 INFO:teuthology.orchestra.run.smithi101.stdout: "duration": 0.0011551070000000001 2023-08-01T19:55:04.685 INFO:teuthology.orchestra.run.smithi101.stdout: }, 2023-08-01T19:55:04.685 INFO:teuthology.orchestra.run.smithi101.stdout: { 2023-08-01T19:55:04.685 INFO:teuthology.orchestra.run.smithi101.stdout: "event": "commit_sent", 2023-08-01T19:55:04.685 INFO:teuthology.orchestra.run.smithi101.stdout: "time": "2023-08-01T19:54:04.477371+0000", 2023-08-01T19:55:04.686 INFO:teuthology.orchestra.run.smithi101.stdout: "duration": 3.7425000000000002e-05 2023-08-01T19:55:04.686 INFO:teuthology.orchestra.run.smithi101.stdout: }, 2023-08-01T19:55:04.686 INFO:teuthology.orchestra.run.smithi101.stdout: { 2023-08-01T19:55:04.686 INFO:teuthology.orchestra.run.smithi101.stdout: "event": "done", 2023-08-01T19:55:04.686 INFO:teuthology.orchestra.run.smithi101.stdout: "time": "2023-08-01T19:54:04.477398+0000", 2023-08-01T19:55:04.686 INFO:teuthology.orchestra.run.smithi101.stdout: "duration": 2.7078000000000001e-05 2023-08-01T19:55:04.686 INFO:teuthology.orchestra.run.smithi101.stdout: } 2023-08-01T19:55:04.686 INFO:teuthology.orchestra.run.smithi101.stdout: ] 2023-08-01T19:55:04.687 INFO:teuthology.orchestra.run.smithi101.stdout: } 2023-08-01T19:55:04.687 INFO:teuthology.orchestra.run.smithi101.stdout: }, 2023-08-01T19:55:04.687 INFO:teuthology.orchestra.run.smithi101.stdout: { 2023-08-01T19:55:04.687 INFO:teuthology.orchestra.run.smithi101.stdout: "description": "osd_op(mds.0.3:9 3.10 3:09401a81:::601.00000000:head [create,setxattr parent (62) in=6b,setxattr layout (30) in=6b] snapc 0=[] ondisk+write+known_if_redirected+full_force+supports_pool_eio e17)", 2023-08-01T19:55:04.687 INFO:teuthology.orchestra.run.smithi101.stdout: "initiated_at": "2023-08-01T19:54:04.458896+0000", 2023-08-01T19:55:04.687 INFO:teuthology.orchestra.run.smithi101.stdout: "age": 60.101983732000001, 2023-08-01T19:55:04.687 INFO:teuthology.orchestra.run.smithi101.stdout: "duration": 0.018577215000000001, 2023-08-01T19:55:04.687 INFO:teuthology.orchestra.run.smithi101.stdout: "type_data": { 2023-08-01T19:55:04.688 INFO:teuthology.orchestra.run.smithi101.stdout: "flag_point": "commit sent; apply or cleanup", 2023-08-01T19:55:04.688 INFO:teuthology.orchestra.run.smithi101.stdout: "events": [ 2023-08-01T19:55:04.688 INFO:teuthology.orchestra.run.smithi101.stdout: { 2023-08-01T19:55:04.688 INFO:teuthology.orchestra.run.smithi101.stdout: "event": "initiated", 2023-08-01T19:55:04.688 INFO:teuthology.orchestra.run.smithi101.stdout: "time": "2023-08-01T19:54:04.458896+0000", 2023-08-01T19:55:04.688 INFO:teuthology.orchestra.run.smithi101.stdout: "duration": 0 2023-08-01T19:55:04.688 INFO:teuthology.orchestra.run.smithi101.stdout: }, 2023-08-01T19:55:04.689 INFO:teuthology.orchestra.run.smithi101.stdout: { 2023-08-01T19:55:04.689 INFO:teuthology.orchestra.run.smithi101.stdout: "event": "throttled", 2023-08-01T19:55:04.689 INFO:teuthology.orchestra.run.smithi101.stdout: "time": "2023-08-01T19:54:04.458896+0000", 2023-08-01T19:55:04.689 INFO:teuthology.orchestra.run.smithi101.stdout: "duration": 0 2023-08-01T19:55:04.689 INFO:teuthology.orchestra.run.smithi101.stdout: }, 2023-08-01T19:55:04.689 INFO:teuthology.orchestra.run.smithi101.stdout: { 2023-08-01T19:55:04.689 INFO:teuthology.orchestra.run.smithi101.stdout: "event": "header_read", 2023-08-01T19:55:04.689 INFO:teuthology.orchestra.run.smithi101.stdout: "time": "2023-08-01T19:54:04.458896+0000", 2023-08-01T19:55:04.690 INFO:teuthology.orchestra.run.smithi101.stdout: "duration": 4294967295.9999995 2023-08-01T19:55:04.690 INFO:teuthology.orchestra.run.smithi101.stdout: }, 2023-08-01T19:55:04.690 INFO:teuthology.orchestra.run.smithi101.stdout: { 2023-08-01T19:55:04.690 INFO:teuthology.orchestra.run.smithi101.stdout: "event": "all_read", 2023-08-01T19:55:04.690 INFO:teuthology.orchestra.run.smithi101.stdout: "time": "2023-08-01T19:54:04.458900+0000", 2023-08-01T19:55:04.690 INFO:teuthology.orchestra.run.smithi101.stdout: "duration": 4.0829999999999997e-06 2023-08-01T19:55:04.690 INFO:teuthology.orchestra.run.smithi101.stdout: }, 2023-08-01T19:55:04.690 INFO:teuthology.orchestra.run.smithi101.stdout: { 2023-08-01T19:55:04.691 INFO:teuthology.orchestra.run.smithi101.stdout: "event": "dispatched", 2023-08-01T19:55:04.691 INFO:teuthology.orchestra.run.smithi101.stdout: "time": "2023-08-01T19:54:04.458906+0000", 2023-08-01T19:55:04.691 INFO:teuthology.orchestra.run.smithi101.stdout: "duration": 6.4099999999999996e-06 2023-08-01T19:55:04.691 INFO:teuthology.orchestra.run.smithi101.stdout: }, 2023-08-01T19:55:04.691 INFO:teuthology.orchestra.run.smithi101.stdout: { 2023-08-01T19:55:04.691 INFO:teuthology.orchestra.run.smithi101.stdout: "event": "queued_for_pg", 2023-08-01T19:55:04.691 INFO:teuthology.orchestra.run.smithi101.stdout: "time": "2023-08-01T19:54:04.458911+0000", 2023-08-01T19:55:04.691 INFO:teuthology.orchestra.run.smithi101.stdout: "duration": 4.0500000000000002e-06 2023-08-01T19:55:04.692 INFO:teuthology.orchestra.run.smithi101.stdout: }, 2023-08-01T19:55:04.692 INFO:teuthology.orchestra.run.smithi101.stdout: { 2023-08-01T19:55:04.692 INFO:teuthology.orchestra.run.smithi101.stdout: "event": "reached_pg", 2023-08-01T19:55:04.692 INFO:teuthology.orchestra.run.smithi101.stdout: "time": "2023-08-01T19:54:04.458981+0000", 2023-08-01T19:55:04.692 INFO:teuthology.orchestra.run.smithi101.stdout: "duration": 7.0121000000000002e-05 2023-08-01T19:55:04.692 INFO:teuthology.orchestra.run.smithi101.stdout: }, 2023-08-01T19:55:04.692 INFO:teuthology.orchestra.run.smithi101.stdout: { 2023-08-01T19:55:04.693 INFO:teuthology.orchestra.run.smithi101.stdout: "event": "waiting_for_map not empty", 2023-08-01T19:55:04.693 INFO:teuthology.orchestra.run.smithi101.stdout: "time": "2023-08-01T19:54:04.458983+0000", 2023-08-01T19:55:04.693 INFO:teuthology.orchestra.run.smithi101.stdout: "duration": 2.2299999999999998e-06 2023-08-01T19:55:04.693 INFO:teuthology.orchestra.run.smithi101.stdout: }, 2023-08-01T19:55:04.693 INFO:teuthology.orchestra.run.smithi101.stdout: { 2023-08-01T19:55:04.693 INFO:teuthology.orchestra.run.smithi101.stdout: "event": "reached_pg", 2023-08-01T19:55:04.693 INFO:teuthology.orchestra.run.smithi101.stdout: "time": "2023-08-01T19:54:04.470122+0000", 2023-08-01T19:55:04.693 INFO:teuthology.orchestra.run.smithi101.stdout: "duration": 0.011139593999999999 2023-08-01T19:55:04.694 INFO:teuthology.orchestra.run.smithi101.stdout: }, 2023-08-01T19:55:04.694 INFO:teuthology.orchestra.run.smithi101.stdout: { 2023-08-01T19:55:04.694 INFO:teuthology.orchestra.run.smithi101.stdout: "event": "started", 2023-08-01T19:55:04.694 INFO:teuthology.orchestra.run.smithi101.stdout: "time": "2023-08-01T19:54:04.470217+0000", 2023-08-01T19:55:04.694 INFO:teuthology.orchestra.run.smithi101.stdout: "duration": 9.4388000000000005e-05 2023-08-01T19:55:04.694 INFO:teuthology.orchestra.run.smithi101.stdout: }, 2023-08-01T19:55:04.694 INFO:teuthology.orchestra.run.smithi101.stdout: { 2023-08-01T19:55:04.694 INFO:teuthology.orchestra.run.smithi101.stdout: "event": "waiting for subops from 2", 2023-08-01T19:55:04.695 INFO:teuthology.orchestra.run.smithi101.stdout: "time": "2023-08-01T19:54:04.470714+0000", 2023-08-01T19:55:04.695 INFO:teuthology.orchestra.run.smithi101.stdout: "duration": 0.00049680999999999998 2023-08-01T19:55:04.695 INFO:teuthology.orchestra.run.smithi101.stdout: }, 2023-08-01T19:55:04.695 INFO:teuthology.orchestra.run.smithi101.stdout: { 2023-08-01T19:55:04.695 INFO:teuthology.orchestra.run.smithi101.stdout: "event": "op_commit", 2023-08-01T19:55:04.695 INFO:teuthology.orchestra.run.smithi101.stdout: "time": "2023-08-01T19:54:04.476183+0000", 2023-08-01T19:55:04.695 INFO:teuthology.orchestra.run.smithi101.stdout: "duration": 0.0054695880000000001 2023-08-01T19:55:04.695 INFO:teuthology.orchestra.run.smithi101.stdout: }, 2023-08-01T19:55:04.696 INFO:teuthology.orchestra.run.smithi101.stdout: { 2023-08-01T19:55:04.696 INFO:teuthology.orchestra.run.smithi101.stdout: "event": "sub_op_commit_rec", 2023-08-01T19:55:04.696 INFO:teuthology.orchestra.run.smithi101.stdout: "time": "2023-08-01T19:54:04.477428+0000", 2023-08-01T19:55:04.696 INFO:teuthology.orchestra.run.smithi101.stdout: "duration": 0.001244843 2023-08-01T19:55:04.696 INFO:teuthology.orchestra.run.smithi101.stdout: }, 2023-08-01T19:55:04.696 INFO:teuthology.orchestra.run.smithi101.stdout: { 2023-08-01T19:55:04.696 INFO:teuthology.orchestra.run.smithi101.stdout: "event": "commit_sent", 2023-08-01T19:55:04.696 INFO:teuthology.orchestra.run.smithi101.stdout: "time": "2023-08-01T19:54:04.477456+0000", 2023-08-01T19:55:04.697 INFO:teuthology.orchestra.run.smithi101.stdout: "duration": 2.7538e-05 2023-08-01T19:55:04.697 INFO:teuthology.orchestra.run.smithi101.stdout: }, 2023-08-01T19:55:04.697 INFO:teuthology.orchestra.run.smithi101.stdout: { 2023-08-01T19:55:04.697 INFO:teuthology.orchestra.run.smithi101.stdout: "event": "done", 2023-08-01T19:55:04.697 INFO:teuthology.orchestra.run.smithi101.stdout: "time": "2023-08-01T19:54:04.477474+0000", 2023-08-01T19:55:04.697 INFO:teuthology.orchestra.run.smithi101.stdout: "duration": 1.7974000000000001e-05 2023-08-01T19:55:04.697 INFO:teuthology.orchestra.run.smithi101.stdout: } 2023-08-01T19:55:04.697 INFO:teuthology.orchestra.run.smithi101.stdout: ] 2023-08-01T19:55:04.698 INFO:teuthology.orchestra.run.smithi101.stdout: } 2023-08-01T19:55:04.698 INFO:teuthology.orchestra.run.smithi101.stdout: }, 2023-08-01T19:55:04.698 INFO:teuthology.orchestra.run.smithi101.stdout: { 2023-08-01T19:55:04.698 INFO:teuthology.orchestra.run.smithi101.stdout: "description": "osd_op(mds.0.3:10 3.10 3:0bd6d154:::602.00000000:head [omap-set-header] snapc 0=[] ondisk+write+known_if_redirected+full_force+supports_pool_eio e17)", 2023-08-01T19:55:04.698 INFO:teuthology.orchestra.run.smithi101.stdout: "initiated_at": "2023-08-01T19:54:04.458927+0000", 2023-08-01T19:55:04.698 INFO:teuthology.orchestra.run.smithi101.stdout: "age": 60.101952754000003, 2023-08-01T19:55:04.698 INFO:teuthology.orchestra.run.smithi101.stdout: "duration": 0.019574352, 2023-08-01T19:55:04.698 INFO:teuthology.orchestra.run.smithi101.stdout: "type_data": { 2023-08-01T19:55:04.699 INFO:teuthology.orchestra.run.smithi101.stdout: "flag_point": "commit sent; apply or cleanup", 2023-08-01T19:55:04.699 INFO:teuthology.orchestra.run.smithi101.stdout: "events": [ 2023-08-01T19:55:04.699 INFO:teuthology.orchestra.run.smithi101.stdout: { 2023-08-01T19:55:04.699 INFO:teuthology.orchestra.run.smithi101.stdout: "event": "initiated", 2023-08-01T19:55:04.699 INFO:teuthology.orchestra.run.smithi101.stdout: "time": "2023-08-01T19:54:04.458927+0000", 2023-08-01T19:55:04.699 INFO:teuthology.orchestra.run.smithi101.stdout: "duration": 0 2023-08-01T19:55:04.699 INFO:teuthology.orchestra.run.smithi101.stdout: }, 2023-08-01T19:55:04.699 INFO:teuthology.orchestra.run.smithi101.stdout: { 2023-08-01T19:55:04.700 INFO:teuthology.orchestra.run.smithi101.stdout: "event": "throttled", 2023-08-01T19:55:04.700 INFO:teuthology.orchestra.run.smithi101.stdout: "time": "2023-08-01T19:54:04.458927+0000", 2023-08-01T19:55:04.700 INFO:teuthology.orchestra.run.smithi101.stdout: "duration": 0 2023-08-01T19:55:04.700 INFO:teuthology.orchestra.run.smithi101.stdout: }, 2023-08-01T19:55:04.700 INFO:teuthology.orchestra.run.smithi101.stdout: { 2023-08-01T19:55:04.700 INFO:teuthology.orchestra.run.smithi101.stdout: "event": "header_read", 2023-08-01T19:55:04.700 INFO:teuthology.orchestra.run.smithi101.stdout: "time": "2023-08-01T19:54:04.458927+0000", 2023-08-01T19:55:04.700 INFO:teuthology.orchestra.run.smithi101.stdout: "duration": 4294967295.9999995 2023-08-01T19:55:04.701 INFO:teuthology.orchestra.run.smithi101.stdout: }, 2023-08-01T19:55:04.701 INFO:teuthology.orchestra.run.smithi101.stdout: { 2023-08-01T19:55:04.701 INFO:teuthology.orchestra.run.smithi101.stdout: "event": "all_read", 2023-08-01T19:55:04.701 INFO:teuthology.orchestra.run.smithi101.stdout: "time": "2023-08-01T19:54:04.458931+0000", 2023-08-01T19:55:04.701 INFO:teuthology.orchestra.run.smithi101.stdout: "duration": 4.3000000000000003e-06 2023-08-01T19:55:04.701 INFO:teuthology.orchestra.run.smithi101.stdout: }, 2023-08-01T19:55:04.701 INFO:teuthology.orchestra.run.smithi101.stdout: { 2023-08-01T19:55:04.702 INFO:teuthology.orchestra.run.smithi101.stdout: "event": "dispatched", 2023-08-01T19:55:04.702 INFO:teuthology.orchestra.run.smithi101.stdout: "time": "2023-08-01T19:54:04.458938+0000", 2023-08-01T19:55:04.702 INFO:teuthology.orchestra.run.smithi101.stdout: "duration": 7.3220000000000004e-06 2023-08-01T19:55:04.702 INFO:teuthology.orchestra.run.smithi101.stdout: }, 2023-08-01T19:55:04.702 INFO:teuthology.orchestra.run.smithi101.stdout: { 2023-08-01T19:55:04.702 INFO:teuthology.orchestra.run.smithi101.stdout: "event": "queued_for_pg", 2023-08-01T19:55:04.702 INFO:teuthology.orchestra.run.smithi101.stdout: "time": "2023-08-01T19:54:04.458944+0000", 2023-08-01T19:55:04.702 INFO:teuthology.orchestra.run.smithi101.stdout: "duration": 5.3040000000000004e-06 2023-08-01T19:55:04.703 INFO:teuthology.orchestra.run.smithi101.stdout: }, 2023-08-01T19:55:04.703 INFO:teuthology.orchestra.run.smithi101.stdout: { 2023-08-01T19:55:04.703 INFO:teuthology.orchestra.run.smithi101.stdout: "event": "reached_pg", 2023-08-01T19:55:04.703 INFO:teuthology.orchestra.run.smithi101.stdout: "time": "2023-08-01T19:54:04.459006+0000", 2023-08-01T19:55:04.703 INFO:teuthology.orchestra.run.smithi101.stdout: "duration": 6.2081000000000004e-05 2023-08-01T19:55:04.703 INFO:teuthology.orchestra.run.smithi101.stdout: }, 2023-08-01T19:55:04.703 INFO:teuthology.orchestra.run.smithi101.stdout: { 2023-08-01T19:55:04.703 INFO:teuthology.orchestra.run.smithi101.stdout: "event": "waiting_for_map not empty", 2023-08-01T19:55:04.704 INFO:teuthology.orchestra.run.smithi101.stdout: "time": "2023-08-01T19:54:04.459008+0000", 2023-08-01T19:55:04.704 INFO:teuthology.orchestra.run.smithi101.stdout: "duration": 2.2500000000000001e-06 2023-08-01T19:55:04.704 INFO:teuthology.orchestra.run.smithi101.stdout: }, 2023-08-01T19:55:04.704 INFO:teuthology.orchestra.run.smithi101.stdout: { 2023-08-01T19:55:04.704 INFO:teuthology.orchestra.run.smithi101.stdout: "event": "reached_pg", 2023-08-01T19:55:04.704 INFO:teuthology.orchestra.run.smithi101.stdout: "time": "2023-08-01T19:54:04.470946+0000", 2023-08-01T19:55:04.704 INFO:teuthology.orchestra.run.smithi101.stdout: "duration": 0.011938347 2023-08-01T19:55:04.704 INFO:teuthology.orchestra.run.smithi101.stdout: }, 2023-08-01T19:55:04.705 INFO:teuthology.orchestra.run.smithi101.stdout: { 2023-08-01T19:55:04.705 INFO:teuthology.orchestra.run.smithi101.stdout: "event": "started", 2023-08-01T19:55:04.705 INFO:teuthology.orchestra.run.smithi101.stdout: "time": "2023-08-01T19:54:04.471071+0000", 2023-08-01T19:55:04.705 INFO:teuthology.orchestra.run.smithi101.stdout: "duration": 0.00012470299999999999 2023-08-01T19:55:04.705 INFO:teuthology.orchestra.run.smithi101.stdout: }, 2023-08-01T19:55:04.705 INFO:teuthology.orchestra.run.smithi101.stdout: { 2023-08-01T19:55:04.705 INFO:teuthology.orchestra.run.smithi101.stdout: "event": "waiting for subops from 2", 2023-08-01T19:55:04.706 INFO:teuthology.orchestra.run.smithi101.stdout: "time": "2023-08-01T19:54:04.471205+0000", 2023-08-01T19:55:04.706 INFO:teuthology.orchestra.run.smithi101.stdout: "duration": 0.000133891 2023-08-01T19:55:04.706 INFO:teuthology.orchestra.run.smithi101.stdout: }, 2023-08-01T19:55:04.706 INFO:teuthology.orchestra.run.smithi101.stdout: { 2023-08-01T19:55:04.706 INFO:teuthology.orchestra.run.smithi101.stdout: "event": "op_commit", 2023-08-01T19:55:04.706 INFO:teuthology.orchestra.run.smithi101.stdout: "time": "2023-08-01T19:54:04.477042+0000", 2023-08-01T19:55:04.706 INFO:teuthology.orchestra.run.smithi101.stdout: "duration": 0.0058374849999999999 2023-08-01T19:55:04.706 INFO:teuthology.orchestra.run.smithi101.stdout: }, 2023-08-01T19:55:04.707 INFO:teuthology.orchestra.run.smithi101.stdout: { 2023-08-01T19:55:04.707 INFO:teuthology.orchestra.run.smithi101.stdout: "event": "sub_op_commit_rec", 2023-08-01T19:55:04.707 INFO:teuthology.orchestra.run.smithi101.stdout: "time": "2023-08-01T19:54:04.478445+0000", 2023-08-01T19:55:04.707 INFO:teuthology.orchestra.run.smithi101.stdout: "duration": 0.0014023239999999999 2023-08-01T19:55:04.707 INFO:teuthology.orchestra.run.smithi101.stdout: }, 2023-08-01T19:55:04.707 INFO:teuthology.orchestra.run.smithi101.stdout: { 2023-08-01T19:55:04.707 INFO:teuthology.orchestra.run.smithi101.stdout: "event": "commit_sent", 2023-08-01T19:55:04.707 INFO:teuthology.orchestra.run.smithi101.stdout: "time": "2023-08-01T19:54:04.478478+0000", 2023-08-01T19:55:04.708 INFO:teuthology.orchestra.run.smithi101.stdout: "duration": 3.3503000000000001e-05 2023-08-01T19:55:04.708 INFO:teuthology.orchestra.run.smithi101.stdout: }, 2023-08-01T19:55:04.708 INFO:teuthology.orchestra.run.smithi101.stdout: { 2023-08-01T19:55:04.708 INFO:teuthology.orchestra.run.smithi101.stdout: "event": "done", 2023-08-01T19:55:04.708 INFO:teuthology.orchestra.run.smithi101.stdout: "time": "2023-08-01T19:54:04.478502+0000", 2023-08-01T19:55:04.708 INFO:teuthology.orchestra.run.smithi101.stdout: "duration": 2.3402000000000001e-05 2023-08-01T19:55:04.708 INFO:teuthology.orchestra.run.smithi101.stdout: } 2023-08-01T19:55:04.708 INFO:teuthology.orchestra.run.smithi101.stdout: ] 2023-08-01T19:55:04.709 INFO:teuthology.orchestra.run.smithi101.stdout: } 2023-08-01T19:55:04.709 INFO:teuthology.orchestra.run.smithi101.stdout: }, 2023-08-01T19:55:04.709 INFO:teuthology.orchestra.run.smithi101.stdout: { 2023-08-01T19:55:04.709 INFO:teuthology.orchestra.run.smithi101.stdout: "description": "osd_op(mds.0.3:11 3.10 3:0bd6d154:::602.00000000:head [create,setxattr parent (62) in=6b,setxattr layout (30) in=6b] snapc 0=[] ondisk+write+known_if_redirected+full_force+supports_pool_eio e17)", 2023-08-01T19:55:04.709 INFO:teuthology.orchestra.run.smithi101.stdout: "initiated_at": "2023-08-01T19:54:04.458960+0000", 2023-08-01T19:55:04.709 INFO:teuthology.orchestra.run.smithi101.stdout: "age": 60.101920305999997, 2023-08-01T19:55:04.709 INFO:teuthology.orchestra.run.smithi101.stdout: "duration": 0.019645459000000001, 2023-08-01T19:55:04.709 INFO:teuthology.orchestra.run.smithi101.stdout: "type_data": { 2023-08-01T19:55:04.710 INFO:teuthology.orchestra.run.smithi101.stdout: "flag_point": "commit sent; apply or cleanup", 2023-08-01T19:55:04.710 INFO:teuthology.orchestra.run.smithi101.stdout: "events": [ 2023-08-01T19:55:04.710 INFO:teuthology.orchestra.run.smithi101.stdout: { 2023-08-01T19:55:04.710 INFO:teuthology.orchestra.run.smithi101.stdout: "event": "initiated", 2023-08-01T19:55:04.710 INFO:teuthology.orchestra.run.smithi101.stdout: "time": "2023-08-01T19:54:04.458960+0000", 2023-08-01T19:55:04.710 INFO:teuthology.orchestra.run.smithi101.stdout: "duration": 0 2023-08-01T19:55:04.710 INFO:teuthology.orchestra.run.smithi101.stdout: }, 2023-08-01T19:55:04.710 INFO:teuthology.orchestra.run.smithi101.stdout: { 2023-08-01T19:55:04.711 INFO:teuthology.orchestra.run.smithi101.stdout: "event": "throttled", 2023-08-01T19:55:04.711 INFO:teuthology.orchestra.run.smithi101.stdout: "time": "2023-08-01T19:54:04.458960+0000", 2023-08-01T19:55:04.711 INFO:teuthology.orchestra.run.smithi101.stdout: "duration": 0 2023-08-01T19:55:04.711 INFO:teuthology.orchestra.run.smithi101.stdout: }, 2023-08-01T19:55:04.711 INFO:teuthology.orchestra.run.smithi101.stdout: { 2023-08-01T19:55:04.711 INFO:teuthology.orchestra.run.smithi101.stdout: "event": "header_read", 2023-08-01T19:55:04.711 INFO:teuthology.orchestra.run.smithi101.stdout: "time": "2023-08-01T19:54:04.458959+0000", 2023-08-01T19:55:04.711 INFO:teuthology.orchestra.run.smithi101.stdout: "duration": 4294967295.9999995 2023-08-01T19:55:04.712 INFO:teuthology.orchestra.run.smithi101.stdout: }, 2023-08-01T19:55:04.712 INFO:teuthology.orchestra.run.smithi101.stdout: { 2023-08-01T19:55:04.712 INFO:teuthology.orchestra.run.smithi101.stdout: "event": "all_read", 2023-08-01T19:55:04.712 INFO:teuthology.orchestra.run.smithi101.stdout: "time": "2023-08-01T19:54:04.458963+0000", 2023-08-01T19:55:04.712 INFO:teuthology.orchestra.run.smithi101.stdout: "duration": 3.9199999999999997e-06 2023-08-01T19:55:04.712 INFO:teuthology.orchestra.run.smithi101.stdout: }, 2023-08-01T19:55:04.712 INFO:teuthology.orchestra.run.smithi101.stdout: { 2023-08-01T19:55:04.713 INFO:teuthology.orchestra.run.smithi101.stdout: "event": "dispatched", 2023-08-01T19:55:04.713 INFO:teuthology.orchestra.run.smithi101.stdout: "time": "2023-08-01T19:54:04.458970+0000", 2023-08-01T19:55:04.713 INFO:teuthology.orchestra.run.smithi101.stdout: "duration": 7.0439999999999998e-06 2023-08-01T19:55:04.713 INFO:teuthology.orchestra.run.smithi101.stdout: }, 2023-08-01T19:55:04.713 INFO:teuthology.orchestra.run.smithi101.stdout: { 2023-08-01T19:55:04.713 INFO:teuthology.orchestra.run.smithi101.stdout: "event": "queued_for_pg", 2023-08-01T19:55:04.713 INFO:teuthology.orchestra.run.smithi101.stdout: "time": "2023-08-01T19:54:04.458976+0000", 2023-08-01T19:55:04.713 INFO:teuthology.orchestra.run.smithi101.stdout: "duration": 5.9540000000000001e-06 2023-08-01T19:55:04.714 INFO:teuthology.orchestra.run.smithi101.stdout: }, 2023-08-01T19:55:04.714 INFO:teuthology.orchestra.run.smithi101.stdout: { 2023-08-01T19:55:04.714 INFO:teuthology.orchestra.run.smithi101.stdout: "event": "reached_pg", 2023-08-01T19:55:04.714 INFO:teuthology.orchestra.run.smithi101.stdout: "time": "2023-08-01T19:54:04.459035+0000", 2023-08-01T19:55:04.714 INFO:teuthology.orchestra.run.smithi101.stdout: "duration": 5.8924e-05 2023-08-01T19:55:04.714 INFO:teuthology.orchestra.run.smithi101.stdout: }, 2023-08-01T19:55:04.714 INFO:teuthology.orchestra.run.smithi101.stdout: { 2023-08-01T19:55:04.714 INFO:teuthology.orchestra.run.smithi101.stdout: "event": "waiting_for_map not empty", 2023-08-01T19:55:04.715 INFO:teuthology.orchestra.run.smithi101.stdout: "time": "2023-08-01T19:54:04.459038+0000", 2023-08-01T19:55:04.715 INFO:teuthology.orchestra.run.smithi101.stdout: "duration": 3.2760000000000001e-06 2023-08-01T19:55:04.715 INFO:teuthology.orchestra.run.smithi101.stdout: }, 2023-08-01T19:55:04.715 INFO:teuthology.orchestra.run.smithi101.stdout: { 2023-08-01T19:55:04.715 INFO:teuthology.orchestra.run.smithi101.stdout: "event": "reached_pg", 2023-08-01T19:55:04.715 INFO:teuthology.orchestra.run.smithi101.stdout: "time": "2023-08-01T19:54:04.471511+0000", 2023-08-01T19:55:04.715 INFO:teuthology.orchestra.run.smithi101.stdout: "duration": 0.012473039999999999 2023-08-01T19:55:04.715 INFO:teuthology.orchestra.run.smithi101.stdout: }, 2023-08-01T19:55:04.716 INFO:teuthology.orchestra.run.smithi101.stdout: { 2023-08-01T19:55:04.716 INFO:teuthology.orchestra.run.smithi101.stdout: "event": "started", 2023-08-01T19:55:04.716 INFO:teuthology.orchestra.run.smithi101.stdout: "time": "2023-08-01T19:54:04.472086+0000", 2023-08-01T19:55:04.716 INFO:teuthology.orchestra.run.smithi101.stdout: "duration": 0.00057491699999999998 2023-08-01T19:55:04.716 INFO:teuthology.orchestra.run.smithi101.stdout: }, 2023-08-01T19:55:04.716 INFO:teuthology.orchestra.run.smithi101.stdout: { 2023-08-01T19:55:04.716 INFO:teuthology.orchestra.run.smithi101.stdout: "event": "waiting for subops from 2", 2023-08-01T19:55:04.716 INFO:teuthology.orchestra.run.smithi101.stdout: "time": "2023-08-01T19:54:04.472310+0000", 2023-08-01T19:55:04.717 INFO:teuthology.orchestra.run.smithi101.stdout: "duration": 0.00022396499999999999 2023-08-01T19:55:04.717 INFO:teuthology.orchestra.run.smithi101.stdout: }, 2023-08-01T19:55:04.717 INFO:teuthology.orchestra.run.smithi101.stdout: { 2023-08-01T19:55:04.717 INFO:teuthology.orchestra.run.smithi101.stdout: "event": "op_commit", 2023-08-01T19:55:04.717 INFO:teuthology.orchestra.run.smithi101.stdout: "time": "2023-08-01T19:54:04.478141+0000", 2023-08-01T19:55:04.717 INFO:teuthology.orchestra.run.smithi101.stdout: "duration": 0.0058312320000000004 2023-08-01T19:55:04.717 INFO:teuthology.orchestra.run.smithi101.stdout: }, 2023-08-01T19:55:04.717 INFO:teuthology.orchestra.run.smithi101.stdout: { 2023-08-01T19:55:04.718 INFO:teuthology.orchestra.run.smithi101.stdout: "event": "sub_op_commit_rec", 2023-08-01T19:55:04.718 INFO:teuthology.orchestra.run.smithi101.stdout: "time": "2023-08-01T19:54:04.478543+0000", 2023-08-01T19:55:04.718 INFO:teuthology.orchestra.run.smithi101.stdout: "duration": 0.00040160800000000002 2023-08-01T19:55:04.718 INFO:teuthology.orchestra.run.smithi101.stdout: }, 2023-08-01T19:55:04.718 INFO:teuthology.orchestra.run.smithi101.stdout: { 2023-08-01T19:55:04.718 INFO:teuthology.orchestra.run.smithi101.stdout: "event": "commit_sent", 2023-08-01T19:55:04.718 INFO:teuthology.orchestra.run.smithi101.stdout: "time": "2023-08-01T19:54:04.478584+0000", 2023-08-01T19:55:04.718 INFO:teuthology.orchestra.run.smithi101.stdout: "duration": 4.0989999999999999e-05 2023-08-01T19:55:04.719 INFO:teuthology.orchestra.run.smithi101.stdout: }, 2023-08-01T19:55:04.719 INFO:teuthology.orchestra.run.smithi101.stdout: { 2023-08-01T19:55:04.719 INFO:teuthology.orchestra.run.smithi101.stdout: "event": "done", 2023-08-01T19:55:04.719 INFO:teuthology.orchestra.run.smithi101.stdout: "time": "2023-08-01T19:54:04.478605+0000", 2023-08-01T19:55:04.719 INFO:teuthology.orchestra.run.smithi101.stdout: "duration": 2.1178e-05 2023-08-01T19:55:04.719 INFO:teuthology.orchestra.run.smithi101.stdout: } 2023-08-01T19:55:04.719 INFO:teuthology.orchestra.run.smithi101.stdout: ] 2023-08-01T19:55:04.719 INFO:teuthology.orchestra.run.smithi101.stdout: } 2023-08-01T19:55:04.720 INFO:teuthology.orchestra.run.smithi101.stdout: }, 2023-08-01T19:55:04.720 INFO:teuthology.orchestra.run.smithi101.stdout: { 2023-08-01T19:55:04.720 INFO:teuthology.orchestra.run.smithi101.stdout: "description": "osd_op(mds.0.3:12 3.10 3:0d89b25e:::603.00000000:head [omap-set-header] snapc 0=[] ondisk+write+known_if_redirected+full_force+supports_pool_eio e17)", 2023-08-01T19:55:04.720 INFO:teuthology.orchestra.run.smithi101.stdout: "initiated_at": "2023-08-01T19:54:04.458982+0000", 2023-08-01T19:55:04.720 INFO:teuthology.orchestra.run.smithi101.stdout: "age": 60.101898077999998, 2023-08-01T19:55:04.720 INFO:teuthology.orchestra.run.smithi101.stdout: "duration": 0.021266334000000001, 2023-08-01T19:55:04.720 INFO:teuthology.orchestra.run.smithi101.stdout: "type_data": { 2023-08-01T19:55:04.720 INFO:teuthology.orchestra.run.smithi101.stdout: "flag_point": "commit sent; apply or cleanup", 2023-08-01T19:55:04.721 INFO:teuthology.orchestra.run.smithi101.stdout: "events": [ 2023-08-01T19:55:04.721 INFO:teuthology.orchestra.run.smithi101.stdout: { 2023-08-01T19:55:04.721 INFO:teuthology.orchestra.run.smithi101.stdout: "event": "initiated", 2023-08-01T19:55:04.721 INFO:teuthology.orchestra.run.smithi101.stdout: "time": "2023-08-01T19:54:04.458982+0000", 2023-08-01T19:55:04.721 INFO:teuthology.orchestra.run.smithi101.stdout: "duration": 0 2023-08-01T19:55:04.721 INFO:teuthology.orchestra.run.smithi101.stdout: }, 2023-08-01T19:55:04.721 INFO:teuthology.orchestra.run.smithi101.stdout: { 2023-08-01T19:55:04.722 INFO:teuthology.orchestra.run.smithi101.stdout: "event": "throttled", 2023-08-01T19:55:04.722 INFO:teuthology.orchestra.run.smithi101.stdout: "time": "2023-08-01T19:54:04.458982+0000", 2023-08-01T19:55:04.722 INFO:teuthology.orchestra.run.smithi101.stdout: "duration": 0 2023-08-01T19:55:04.722 INFO:teuthology.orchestra.run.smithi101.stdout: }, 2023-08-01T19:55:04.722 INFO:teuthology.orchestra.run.smithi101.stdout: { 2023-08-01T19:55:04.722 INFO:teuthology.orchestra.run.smithi101.stdout: "event": "header_read", 2023-08-01T19:55:04.722 INFO:teuthology.orchestra.run.smithi101.stdout: "time": "2023-08-01T19:54:04.458982+0000", 2023-08-01T19:55:04.722 INFO:teuthology.orchestra.run.smithi101.stdout: "duration": 4294967295.9999995 2023-08-01T19:55:04.723 INFO:teuthology.orchestra.run.smithi101.stdout: }, 2023-08-01T19:55:04.723 INFO:teuthology.orchestra.run.smithi101.stdout: { 2023-08-01T19:55:04.723 INFO:teuthology.orchestra.run.smithi101.stdout: "event": "all_read", 2023-08-01T19:55:04.723 INFO:teuthology.orchestra.run.smithi101.stdout: "time": "2023-08-01T19:54:04.458985+0000", 2023-08-01T19:55:04.723 INFO:teuthology.orchestra.run.smithi101.stdout: "duration": 3.4800000000000001e-06 2023-08-01T19:55:04.723 INFO:teuthology.orchestra.run.smithi101.stdout: }, 2023-08-01T19:55:04.723 INFO:teuthology.orchestra.run.smithi101.stdout: { 2023-08-01T19:55:04.723 INFO:teuthology.orchestra.run.smithi101.stdout: "event": "dispatched", 2023-08-01T19:55:04.724 INFO:teuthology.orchestra.run.smithi101.stdout: "time": "2023-08-01T19:54:04.458992+0000", 2023-08-01T19:55:04.724 INFO:teuthology.orchestra.run.smithi101.stdout: "duration": 7.306e-06 2023-08-01T19:55:04.724 INFO:teuthology.orchestra.run.smithi101.stdout: }, 2023-08-01T19:55:04.724 INFO:teuthology.orchestra.run.smithi101.stdout: { 2023-08-01T19:55:04.724 INFO:teuthology.orchestra.run.smithi101.stdout: "event": "queued_for_pg", 2023-08-01T19:55:04.724 INFO:teuthology.orchestra.run.smithi101.stdout: "time": "2023-08-01T19:54:04.458997+0000", 2023-08-01T19:55:04.724 INFO:teuthology.orchestra.run.smithi101.stdout: "duration": 4.4530000000000004e-06 2023-08-01T19:55:04.724 INFO:teuthology.orchestra.run.smithi101.stdout: }, 2023-08-01T19:55:04.725 INFO:teuthology.orchestra.run.smithi101.stdout: { 2023-08-01T19:55:04.725 INFO:teuthology.orchestra.run.smithi101.stdout: "event": "reached_pg", 2023-08-01T19:55:04.725 INFO:teuthology.orchestra.run.smithi101.stdout: "time": "2023-08-01T19:54:04.459060+0000", 2023-08-01T19:55:04.725 INFO:teuthology.orchestra.run.smithi101.stdout: "duration": 6.3249000000000004e-05 2023-08-01T19:55:04.725 INFO:teuthology.orchestra.run.smithi101.stdout: }, 2023-08-01T19:55:04.725 INFO:teuthology.orchestra.run.smithi101.stdout: { 2023-08-01T19:55:04.725 INFO:teuthology.orchestra.run.smithi101.stdout: "event": "waiting_for_map not empty", 2023-08-01T19:55:04.726 INFO:teuthology.orchestra.run.smithi101.stdout: "time": "2023-08-01T19:54:04.459063+0000", 2023-08-01T19:55:04.726 INFO:teuthology.orchestra.run.smithi101.stdout: "duration": 2.717e-06 2023-08-01T19:55:04.726 INFO:teuthology.orchestra.run.smithi101.stdout: }, 2023-08-01T19:55:04.726 INFO:teuthology.orchestra.run.smithi101.stdout: { 2023-08-01T19:55:04.726 INFO:teuthology.orchestra.run.smithi101.stdout: "event": "reached_pg", 2023-08-01T19:55:04.726 INFO:teuthology.orchestra.run.smithi101.stdout: "time": "2023-08-01T19:54:04.473625+0000", 2023-08-01T19:55:04.726 INFO:teuthology.orchestra.run.smithi101.stdout: "duration": 0.014562007 2023-08-01T19:55:04.726 INFO:teuthology.orchestra.run.smithi101.stdout: }, 2023-08-01T19:55:04.727 INFO:teuthology.orchestra.run.smithi101.stdout: { 2023-08-01T19:55:04.727 INFO:teuthology.orchestra.run.smithi101.stdout: "event": "started", 2023-08-01T19:55:04.727 INFO:teuthology.orchestra.run.smithi101.stdout: "time": "2023-08-01T19:54:04.473757+0000", 2023-08-01T19:55:04.727 INFO:teuthology.orchestra.run.smithi101.stdout: "duration": 0.00013238599999999999 2023-08-01T19:55:04.727 INFO:teuthology.orchestra.run.smithi101.stdout: }, 2023-08-01T19:55:04.727 INFO:teuthology.orchestra.run.smithi101.stdout: { 2023-08-01T19:55:04.727 INFO:teuthology.orchestra.run.smithi101.stdout: "event": "waiting for subops from 2", 2023-08-01T19:55:04.727 INFO:teuthology.orchestra.run.smithi101.stdout: "time": "2023-08-01T19:54:04.473898+0000", 2023-08-01T19:55:04.728 INFO:teuthology.orchestra.run.smithi101.stdout: "duration": 0.00014039 2023-08-01T19:55:04.728 INFO:teuthology.orchestra.run.smithi101.stdout: }, 2023-08-01T19:55:04.728 INFO:teuthology.orchestra.run.smithi101.stdout: { 2023-08-01T19:55:04.728 INFO:teuthology.orchestra.run.smithi101.stdout: "event": "op_commit", 2023-08-01T19:55:04.728 INFO:teuthology.orchestra.run.smithi101.stdout: "time": "2023-08-01T19:54:04.478380+0000", 2023-08-01T19:55:04.728 INFO:teuthology.orchestra.run.smithi101.stdout: "duration": 0.0044827449999999998 2023-08-01T19:55:04.728 INFO:teuthology.orchestra.run.smithi101.stdout: }, 2023-08-01T19:55:04.728 INFO:teuthology.orchestra.run.smithi101.stdout: { 2023-08-01T19:55:04.729 INFO:teuthology.orchestra.run.smithi101.stdout: "event": "sub_op_commit_rec", 2023-08-01T19:55:04.729 INFO:teuthology.orchestra.run.smithi101.stdout: "time": "2023-08-01T19:54:04.480169+0000", 2023-08-01T19:55:04.729 INFO:teuthology.orchestra.run.smithi101.stdout: "duration": 0.0017886040000000001 2023-08-01T19:55:04.729 INFO:teuthology.orchestra.run.smithi101.stdout: }, 2023-08-01T19:55:04.729 INFO:teuthology.orchestra.run.smithi101.stdout: { 2023-08-01T19:55:04.729 INFO:teuthology.orchestra.run.smithi101.stdout: "event": "commit_sent", 2023-08-01T19:55:04.729 INFO:teuthology.orchestra.run.smithi101.stdout: "time": "2023-08-01T19:54:04.480212+0000", 2023-08-01T19:55:04.729 INFO:teuthology.orchestra.run.smithi101.stdout: "duration": 4.2687e-05 2023-08-01T19:55:04.730 INFO:teuthology.orchestra.run.smithi101.stdout: }, 2023-08-01T19:55:04.730 INFO:teuthology.orchestra.run.smithi101.stdout: { 2023-08-01T19:55:04.730 INFO:teuthology.orchestra.run.smithi101.stdout: "event": "done", 2023-08-01T19:55:04.730 INFO:teuthology.orchestra.run.smithi101.stdout: "time": "2023-08-01T19:54:04.480248+0000", 2023-08-01T19:55:04.730 INFO:teuthology.orchestra.run.smithi101.stdout: "duration": 3.6743999999999999e-05 2023-08-01T19:55:04.730 INFO:teuthology.orchestra.run.smithi101.stdout: } 2023-08-01T19:55:04.730 INFO:teuthology.orchestra.run.smithi101.stdout: ] 2023-08-01T19:55:04.731 INFO:teuthology.orchestra.run.smithi101.stdout: } 2023-08-01T19:55:04.731 INFO:teuthology.orchestra.run.smithi101.stdout: }, 2023-08-01T19:55:04.731 INFO:teuthology.orchestra.run.smithi101.stdout: { 2023-08-01T19:55:04.731 INFO:teuthology.orchestra.run.smithi101.stdout: "description": "osd_op(mds.0.3:13 3.10 3:0d89b25e:::603.00000000:head [create,setxattr parent (62) in=6b,setxattr layout (30) in=6b] snapc 0=[] ondisk+write+known_if_redirected+full_force+supports_pool_eio e17)", 2023-08-01T19:55:04.731 INFO:teuthology.orchestra.run.smithi101.stdout: "initiated_at": "2023-08-01T19:54:04.459010+0000", 2023-08-01T19:55:04.731 INFO:teuthology.orchestra.run.smithi101.stdout: "age": 60.101870357999999, 2023-08-01T19:55:04.731 INFO:teuthology.orchestra.run.smithi101.stdout: "duration": 0.021327220000000001, 2023-08-01T19:55:04.731 INFO:teuthology.orchestra.run.smithi101.stdout: "type_data": { 2023-08-01T19:55:04.732 INFO:teuthology.orchestra.run.smithi101.stdout: "flag_point": "commit sent; apply or cleanup", 2023-08-01T19:55:04.732 INFO:teuthology.orchestra.run.smithi101.stdout: "events": [ 2023-08-01T19:55:04.732 INFO:teuthology.orchestra.run.smithi101.stdout: { 2023-08-01T19:55:04.732 INFO:teuthology.orchestra.run.smithi101.stdout: "event": "initiated", 2023-08-01T19:55:04.732 INFO:teuthology.orchestra.run.smithi101.stdout: "time": "2023-08-01T19:54:04.459010+0000", 2023-08-01T19:55:04.732 INFO:teuthology.orchestra.run.smithi101.stdout: "duration": 0 2023-08-01T19:55:04.732 INFO:teuthology.orchestra.run.smithi101.stdout: }, 2023-08-01T19:55:04.733 INFO:teuthology.orchestra.run.smithi101.stdout: { 2023-08-01T19:55:04.733 INFO:teuthology.orchestra.run.smithi101.stdout: "event": "throttled", 2023-08-01T19:55:04.733 INFO:teuthology.orchestra.run.smithi101.stdout: "time": "2023-08-01T19:54:04.459010+0000", 2023-08-01T19:55:04.733 INFO:teuthology.orchestra.run.smithi101.stdout: "duration": 0 2023-08-01T19:55:04.733 INFO:teuthology.orchestra.run.smithi101.stdout: }, 2023-08-01T19:55:04.733 INFO:teuthology.orchestra.run.smithi101.stdout: { 2023-08-01T19:55:04.733 INFO:teuthology.orchestra.run.smithi101.stdout: "event": "header_read", 2023-08-01T19:55:04.733 INFO:teuthology.orchestra.run.smithi101.stdout: "time": "2023-08-01T19:54:04.459009+0000", 2023-08-01T19:55:04.734 INFO:teuthology.orchestra.run.smithi101.stdout: "duration": 4294967295.9999995 2023-08-01T19:55:04.734 INFO:teuthology.orchestra.run.smithi101.stdout: }, 2023-08-01T19:55:04.734 INFO:teuthology.orchestra.run.smithi101.stdout: { 2023-08-01T19:55:04.734 INFO:teuthology.orchestra.run.smithi101.stdout: "event": "all_read", 2023-08-01T19:55:04.734 INFO:teuthology.orchestra.run.smithi101.stdout: "time": "2023-08-01T19:54:04.459013+0000", 2023-08-01T19:55:04.734 INFO:teuthology.orchestra.run.smithi101.stdout: "duration": 3.8929999999999998e-06 2023-08-01T19:55:04.734 INFO:teuthology.orchestra.run.smithi101.stdout: }, 2023-08-01T19:55:04.734 INFO:teuthology.orchestra.run.smithi101.stdout: { 2023-08-01T19:55:04.735 INFO:teuthology.orchestra.run.smithi101.stdout: "event": "dispatched", 2023-08-01T19:55:04.735 INFO:teuthology.orchestra.run.smithi101.stdout: "time": "2023-08-01T19:54:04.459027+0000", 2023-08-01T19:55:04.735 INFO:teuthology.orchestra.run.smithi101.stdout: "duration": 1.3416e-05 2023-08-01T19:55:04.735 INFO:teuthology.orchestra.run.smithi101.stdout: }, 2023-08-01T19:55:04.735 INFO:teuthology.orchestra.run.smithi101.stdout: { 2023-08-01T19:55:04.735 INFO:teuthology.orchestra.run.smithi101.stdout: "event": "queued_for_pg", 2023-08-01T19:55:04.735 INFO:teuthology.orchestra.run.smithi101.stdout: "time": "2023-08-01T19:54:04.459033+0000", 2023-08-01T19:55:04.735 INFO:teuthology.orchestra.run.smithi101.stdout: "duration": 5.9800000000000003e-06 2023-08-01T19:55:04.736 INFO:teuthology.orchestra.run.smithi101.stdout: }, 2023-08-01T19:55:04.736 INFO:teuthology.orchestra.run.smithi101.stdout: { 2023-08-01T19:55:04.736 INFO:teuthology.orchestra.run.smithi101.stdout: "event": "reached_pg", 2023-08-01T19:55:04.736 INFO:teuthology.orchestra.run.smithi101.stdout: "time": "2023-08-01T19:54:04.459099+0000", 2023-08-01T19:55:04.736 INFO:teuthology.orchestra.run.smithi101.stdout: "duration": 6.6192999999999995e-05 2023-08-01T19:55:04.736 INFO:teuthology.orchestra.run.smithi101.stdout: }, 2023-08-01T19:55:04.736 INFO:teuthology.orchestra.run.smithi101.stdout: { 2023-08-01T19:55:04.736 INFO:teuthology.orchestra.run.smithi101.stdout: "event": "waiting_for_map not empty", 2023-08-01T19:55:04.737 INFO:teuthology.orchestra.run.smithi101.stdout: "time": "2023-08-01T19:54:04.459106+0000", 2023-08-01T19:55:04.737 INFO:teuthology.orchestra.run.smithi101.stdout: "duration": 6.8619999999999997e-06 2023-08-01T19:55:04.737 INFO:teuthology.orchestra.run.smithi101.stdout: }, 2023-08-01T19:55:04.737 INFO:teuthology.orchestra.run.smithi101.stdout: { 2023-08-01T19:55:04.737 INFO:teuthology.orchestra.run.smithi101.stdout: "event": "reached_pg", 2023-08-01T19:55:04.737 INFO:teuthology.orchestra.run.smithi101.stdout: "time": "2023-08-01T19:54:04.475182+0000", 2023-08-01T19:55:04.737 INFO:teuthology.orchestra.run.smithi101.stdout: "duration": 0.016076333000000002 2023-08-01T19:55:04.737 INFO:teuthology.orchestra.run.smithi101.stdout: }, 2023-08-01T19:55:04.738 INFO:teuthology.orchestra.run.smithi101.stdout: { 2023-08-01T19:55:04.738 INFO:teuthology.orchestra.run.smithi101.stdout: "event": "started", 2023-08-01T19:55:04.738 INFO:teuthology.orchestra.run.smithi101.stdout: "time": "2023-08-01T19:54:04.475353+0000", 2023-08-01T19:55:04.738 INFO:teuthology.orchestra.run.smithi101.stdout: "duration": 0.000171378 2023-08-01T19:55:04.738 INFO:teuthology.orchestra.run.smithi101.stdout: }, 2023-08-01T19:55:04.738 INFO:teuthology.orchestra.run.smithi101.stdout: { 2023-08-01T19:55:04.738 INFO:teuthology.orchestra.run.smithi101.stdout: "event": "waiting for subops from 2", 2023-08-01T19:55:04.738 INFO:teuthology.orchestra.run.smithi101.stdout: "time": "2023-08-01T19:54:04.475793+0000", 2023-08-01T19:55:04.739 INFO:teuthology.orchestra.run.smithi101.stdout: "duration": 0.000440123 2023-08-01T19:55:04.739 INFO:teuthology.orchestra.run.smithi101.stdout: }, 2023-08-01T19:55:04.739 INFO:teuthology.orchestra.run.smithi101.stdout: { 2023-08-01T19:55:04.739 INFO:teuthology.orchestra.run.smithi101.stdout: "event": "op_commit", 2023-08-01T19:55:04.739 INFO:teuthology.orchestra.run.smithi101.stdout: "time": "2023-08-01T19:54:04.478624+0000", 2023-08-01T19:55:04.739 INFO:teuthology.orchestra.run.smithi101.stdout: "duration": 0.0028305000000000001 2023-08-01T19:55:04.739 INFO:teuthology.orchestra.run.smithi101.stdout: }, 2023-08-01T19:55:04.739 INFO:teuthology.orchestra.run.smithi101.stdout: { 2023-08-01T19:55:04.740 INFO:teuthology.orchestra.run.smithi101.stdout: "event": "sub_op_commit_rec", 2023-08-01T19:55:04.740 INFO:teuthology.orchestra.run.smithi101.stdout: "time": "2023-08-01T19:54:04.480291+0000", 2023-08-01T19:55:04.740 INFO:teuthology.orchestra.run.smithi101.stdout: "duration": 0.0016670000000000001 2023-08-01T19:55:04.740 INFO:teuthology.orchestra.run.smithi101.stdout: }, 2023-08-01T19:55:04.740 INFO:teuthology.orchestra.run.smithi101.stdout: { 2023-08-01T19:55:04.740 INFO:teuthology.orchestra.run.smithi101.stdout: "event": "commit_sent", 2023-08-01T19:55:04.740 INFO:teuthology.orchestra.run.smithi101.stdout: "time": "2023-08-01T19:54:04.480318+0000", 2023-08-01T19:55:04.741 INFO:teuthology.orchestra.run.smithi101.stdout: "duration": 2.6815e-05 2023-08-01T19:55:04.741 INFO:teuthology.orchestra.run.smithi101.stdout: }, 2023-08-01T19:55:04.741 INFO:teuthology.orchestra.run.smithi101.stdout: { 2023-08-01T19:55:04.741 INFO:teuthology.orchestra.run.smithi101.stdout: "event": "done", 2023-08-01T19:55:04.741 INFO:teuthology.orchestra.run.smithi101.stdout: "time": "2023-08-01T19:54:04.480337+0000", 2023-08-01T19:55:04.741 INFO:teuthology.orchestra.run.smithi101.stdout: "duration": 1.9241000000000001e-05 2023-08-01T19:55:04.741 INFO:teuthology.orchestra.run.smithi101.stdout: } 2023-08-01T19:55:04.741 INFO:teuthology.orchestra.run.smithi101.stdout: ] 2023-08-01T19:55:04.742 INFO:teuthology.orchestra.run.smithi101.stdout: } 2023-08-01T19:55:04.742 INFO:teuthology.orchestra.run.smithi101.stdout: }, 2023-08-01T19:55:04.742 INFO:teuthology.orchestra.run.smithi101.stdout: { 2023-08-01T19:55:04.742 INFO:teuthology.orchestra.run.smithi101.stdout: "description": "osd_op(mds.0.3:18 3.14 3:2f55791f:::606.00000000:head [omap-set-header] snapc 0=[] ondisk+write+known_if_redirected+full_force+supports_pool_eio e17)", 2023-08-01T19:55:04.742 INFO:teuthology.orchestra.run.smithi101.stdout: "initiated_at": "2023-08-01T19:54:04.459039+0000", 2023-08-01T19:55:04.742 INFO:teuthology.orchestra.run.smithi101.stdout: "age": 60.101841063999998, 2023-08-01T19:55:04.742 INFO:teuthology.orchestra.run.smithi101.stdout: "duration": 0.018756419, 2023-08-01T19:55:04.742 INFO:teuthology.orchestra.run.smithi101.stdout: "type_data": { 2023-08-01T19:55:04.743 INFO:teuthology.orchestra.run.smithi101.stdout: "flag_point": "commit sent; apply or cleanup", 2023-08-01T19:55:04.743 INFO:teuthology.orchestra.run.smithi101.stdout: "events": [ 2023-08-01T19:55:04.743 INFO:teuthology.orchestra.run.smithi101.stdout: { 2023-08-01T19:55:04.743 INFO:teuthology.orchestra.run.smithi101.stdout: "event": "initiated", 2023-08-01T19:55:04.743 INFO:teuthology.orchestra.run.smithi101.stdout: "time": "2023-08-01T19:54:04.459039+0000", 2023-08-01T19:55:04.743 INFO:teuthology.orchestra.run.smithi101.stdout: "duration": 0 2023-08-01T19:55:04.743 INFO:teuthology.orchestra.run.smithi101.stdout: }, 2023-08-01T19:55:04.743 INFO:teuthology.orchestra.run.smithi101.stdout: { 2023-08-01T19:55:04.744 INFO:teuthology.orchestra.run.smithi101.stdout: "event": "throttled", 2023-08-01T19:55:04.744 INFO:teuthology.orchestra.run.smithi101.stdout: "time": "2023-08-01T19:54:04.459039+0000", 2023-08-01T19:55:04.744 INFO:teuthology.orchestra.run.smithi101.stdout: "duration": 0 2023-08-01T19:55:04.744 INFO:teuthology.orchestra.run.smithi101.stdout: }, 2023-08-01T19:55:04.744 INFO:teuthology.orchestra.run.smithi101.stdout: { 2023-08-01T19:55:04.744 INFO:teuthology.orchestra.run.smithi101.stdout: "event": "header_read", 2023-08-01T19:55:04.744 INFO:teuthology.orchestra.run.smithi101.stdout: "time": "2023-08-01T19:54:04.459039+0000", 2023-08-01T19:55:04.744 INFO:teuthology.orchestra.run.smithi101.stdout: "duration": 4294967295.9999995 2023-08-01T19:55:04.745 INFO:teuthology.orchestra.run.smithi101.stdout: }, 2023-08-01T19:55:04.745 INFO:teuthology.orchestra.run.smithi101.stdout: { 2023-08-01T19:55:04.745 INFO:teuthology.orchestra.run.smithi101.stdout: "event": "all_read", 2023-08-01T19:55:04.745 INFO:teuthology.orchestra.run.smithi101.stdout: "time": "2023-08-01T19:54:04.459043+0000", 2023-08-01T19:55:04.745 INFO:teuthology.orchestra.run.smithi101.stdout: "duration": 4.1500000000000001e-06 2023-08-01T19:55:04.745 INFO:teuthology.orchestra.run.smithi101.stdout: }, 2023-08-01T19:55:04.745 INFO:teuthology.orchestra.run.smithi101.stdout: { 2023-08-01T19:55:04.745 INFO:teuthology.orchestra.run.smithi101.stdout: "event": "dispatched", 2023-08-01T19:55:04.746 INFO:teuthology.orchestra.run.smithi101.stdout: "time": "2023-08-01T19:54:04.459051+0000", 2023-08-01T19:55:04.746 INFO:teuthology.orchestra.run.smithi101.stdout: "duration": 8.4190000000000002e-06 2023-08-01T19:55:04.746 INFO:teuthology.orchestra.run.smithi101.stdout: }, 2023-08-01T19:55:04.746 INFO:teuthology.orchestra.run.smithi101.stdout: { 2023-08-01T19:55:04.746 INFO:teuthology.orchestra.run.smithi101.stdout: "event": "queued_for_pg", 2023-08-01T19:55:04.746 INFO:teuthology.orchestra.run.smithi101.stdout: "time": "2023-08-01T19:54:04.459056+0000", 2023-08-01T19:55:04.746 INFO:teuthology.orchestra.run.smithi101.stdout: "duration": 5.339e-06 2023-08-01T19:55:04.746 INFO:teuthology.orchestra.run.smithi101.stdout: }, 2023-08-01T19:55:04.747 INFO:teuthology.orchestra.run.smithi101.stdout: { 2023-08-01T19:55:04.747 INFO:teuthology.orchestra.run.smithi101.stdout: "event": "reached_pg", 2023-08-01T19:55:04.747 INFO:teuthology.orchestra.run.smithi101.stdout: "time": "2023-08-01T19:54:04.459091+0000", 2023-08-01T19:55:04.747 INFO:teuthology.orchestra.run.smithi101.stdout: "duration": 3.4090000000000001e-05 2023-08-01T19:55:04.747 INFO:teuthology.orchestra.run.smithi101.stdout: }, 2023-08-01T19:55:04.747 INFO:teuthology.orchestra.run.smithi101.stdout: { 2023-08-01T19:55:04.747 INFO:teuthology.orchestra.run.smithi101.stdout: "event": "op must wait for map", 2023-08-01T19:55:04.747 INFO:teuthology.orchestra.run.smithi101.stdout: "time": "2023-08-01T19:54:04.459094+0000", 2023-08-01T19:55:04.748 INFO:teuthology.orchestra.run.smithi101.stdout: "duration": 3.303e-06 2023-08-01T19:55:04.748 INFO:teuthology.orchestra.run.smithi101.stdout: }, 2023-08-01T19:55:04.748 INFO:teuthology.orchestra.run.smithi101.stdout: { 2023-08-01T19:55:04.748 INFO:teuthology.orchestra.run.smithi101.stdout: "event": "reached_pg", 2023-08-01T19:55:04.748 INFO:teuthology.orchestra.run.smithi101.stdout: "time": "2023-08-01T19:54:04.469860+0000", 2023-08-01T19:55:04.748 INFO:teuthology.orchestra.run.smithi101.stdout: "duration": 0.010765749 2023-08-01T19:55:04.748 INFO:teuthology.orchestra.run.smithi101.stdout: }, 2023-08-01T19:55:04.749 INFO:teuthology.orchestra.run.smithi101.stdout: { 2023-08-01T19:55:04.749 INFO:teuthology.orchestra.run.smithi101.stdout: "event": "started", 2023-08-01T19:55:04.749 INFO:teuthology.orchestra.run.smithi101.stdout: "time": "2023-08-01T19:54:04.470008+0000", 2023-08-01T19:55:04.749 INFO:teuthology.orchestra.run.smithi101.stdout: "duration": 0.000148367 2023-08-01T19:55:04.749 INFO:teuthology.orchestra.run.smithi101.stdout: }, 2023-08-01T19:55:04.749 INFO:teuthology.orchestra.run.smithi101.stdout: { 2023-08-01T19:55:04.749 INFO:teuthology.orchestra.run.smithi101.stdout: "event": "waiting for subops from 2", 2023-08-01T19:55:04.749 INFO:teuthology.orchestra.run.smithi101.stdout: "time": "2023-08-01T19:54:04.470136+0000", 2023-08-01T19:55:04.750 INFO:teuthology.orchestra.run.smithi101.stdout: "duration": 0.000128329 2023-08-01T19:55:04.750 INFO:teuthology.orchestra.run.smithi101.stdout: }, 2023-08-01T19:55:04.750 INFO:teuthology.orchestra.run.smithi101.stdout: { 2023-08-01T19:55:04.750 INFO:teuthology.orchestra.run.smithi101.stdout: "event": "op_commit", 2023-08-01T19:55:04.750 INFO:teuthology.orchestra.run.smithi101.stdout: "time": "2023-08-01T19:54:04.476399+0000", 2023-08-01T19:55:04.750 INFO:teuthology.orchestra.run.smithi101.stdout: "duration": 0.0062627259999999997 2023-08-01T19:55:04.750 INFO:teuthology.orchestra.run.smithi101.stdout: }, 2023-08-01T19:55:04.750 INFO:teuthology.orchestra.run.smithi101.stdout: { 2023-08-01T19:55:04.751 INFO:teuthology.orchestra.run.smithi101.stdout: "event": "sub_op_commit_rec", 2023-08-01T19:55:04.751 INFO:teuthology.orchestra.run.smithi101.stdout: "time": "2023-08-01T19:54:04.477726+0000", 2023-08-01T19:55:04.751 INFO:teuthology.orchestra.run.smithi101.stdout: "duration": 0.001327103 2023-08-01T19:55:04.751 INFO:teuthology.orchestra.run.smithi101.stdout: }, 2023-08-01T19:55:04.751 INFO:teuthology.orchestra.run.smithi101.stdout: { 2023-08-01T19:55:04.751 INFO:teuthology.orchestra.run.smithi101.stdout: "event": "commit_sent", 2023-08-01T19:55:04.751 INFO:teuthology.orchestra.run.smithi101.stdout: "time": "2023-08-01T19:54:04.477771+0000", 2023-08-01T19:55:04.751 INFO:teuthology.orchestra.run.smithi101.stdout: "duration": 4.5232000000000003e-05 2023-08-01T19:55:04.752 INFO:teuthology.orchestra.run.smithi101.stdout: }, 2023-08-01T19:55:04.752 INFO:teuthology.orchestra.run.smithi101.stdout: { 2023-08-01T19:55:04.752 INFO:teuthology.orchestra.run.smithi101.stdout: "event": "done", 2023-08-01T19:55:04.752 INFO:teuthology.orchestra.run.smithi101.stdout: "time": "2023-08-01T19:54:04.477795+0000", 2023-08-01T19:55:04.752 INFO:teuthology.orchestra.run.smithi101.stdout: "duration": 2.4134999999999998e-05 2023-08-01T19:55:04.752 INFO:teuthology.orchestra.run.smithi101.stdout: } 2023-08-01T19:55:04.752 INFO:teuthology.orchestra.run.smithi101.stdout: ] 2023-08-01T19:55:04.752 INFO:teuthology.orchestra.run.smithi101.stdout: } 2023-08-01T19:55:04.753 INFO:teuthology.orchestra.run.smithi101.stdout: }, 2023-08-01T19:55:04.753 INFO:teuthology.orchestra.run.smithi101.stdout: { 2023-08-01T19:55:04.753 INFO:teuthology.orchestra.run.smithi101.stdout: "description": "osd_op(mds.0.3:19 3.14 3:2f55791f:::606.00000000:head [create,setxattr parent (62) in=6b,setxattr layout (30) in=6b] snapc 0=[] ondisk+write+known_if_redirected+full_force+supports_pool_eio e17)", 2023-08-01T19:55:04.753 INFO:teuthology.orchestra.run.smithi101.stdout: "initiated_at": "2023-08-01T19:54:04.459069+0000", 2023-08-01T19:55:04.753 INFO:teuthology.orchestra.run.smithi101.stdout: "age": 60.101811028999997, 2023-08-01T19:55:04.753 INFO:teuthology.orchestra.run.smithi101.stdout: "duration": 0.019523045999999999, 2023-08-01T19:55:04.753 INFO:teuthology.orchestra.run.smithi101.stdout: "type_data": { 2023-08-01T19:55:04.753 INFO:teuthology.orchestra.run.smithi101.stdout: "flag_point": "commit sent; apply or cleanup", 2023-08-01T19:55:04.754 INFO:teuthology.orchestra.run.smithi101.stdout: "events": [ 2023-08-01T19:55:04.754 INFO:teuthology.orchestra.run.smithi101.stdout: { 2023-08-01T19:55:04.754 INFO:teuthology.orchestra.run.smithi101.stdout: "event": "initiated", 2023-08-01T19:55:04.754 INFO:teuthology.orchestra.run.smithi101.stdout: "time": "2023-08-01T19:54:04.459069+0000", 2023-08-01T19:55:04.754 INFO:teuthology.orchestra.run.smithi101.stdout: "duration": 0 2023-08-01T19:55:04.754 INFO:teuthology.orchestra.run.smithi101.stdout: }, 2023-08-01T19:55:04.754 INFO:teuthology.orchestra.run.smithi101.stdout: { 2023-08-01T19:55:04.755 INFO:teuthology.orchestra.run.smithi101.stdout: "event": "throttled", 2023-08-01T19:55:04.755 INFO:teuthology.orchestra.run.smithi101.stdout: "time": "2023-08-01T19:54:04.459069+0000", 2023-08-01T19:55:04.755 INFO:teuthology.orchestra.run.smithi101.stdout: "duration": 0 2023-08-01T19:55:04.755 INFO:teuthology.orchestra.run.smithi101.stdout: }, 2023-08-01T19:55:04.755 INFO:teuthology.orchestra.run.smithi101.stdout: { 2023-08-01T19:55:04.755 INFO:teuthology.orchestra.run.smithi101.stdout: "event": "header_read", 2023-08-01T19:55:04.755 INFO:teuthology.orchestra.run.smithi101.stdout: "time": "2023-08-01T19:54:04.459069+0000", 2023-08-01T19:55:04.755 INFO:teuthology.orchestra.run.smithi101.stdout: "duration": 4294967295.9999995 2023-08-01T19:55:04.756 INFO:teuthology.orchestra.run.smithi101.stdout: }, 2023-08-01T19:55:04.756 INFO:teuthology.orchestra.run.smithi101.stdout: { 2023-08-01T19:55:04.756 INFO:teuthology.orchestra.run.smithi101.stdout: "event": "all_read", 2023-08-01T19:55:04.756 INFO:teuthology.orchestra.run.smithi101.stdout: "time": "2023-08-01T19:54:04.459072+0000", 2023-08-01T19:55:04.756 INFO:teuthology.orchestra.run.smithi101.stdout: "duration": 3.4570000000000001e-06 2023-08-01T19:55:04.756 INFO:teuthology.orchestra.run.smithi101.stdout: }, 2023-08-01T19:55:04.756 INFO:teuthology.orchestra.run.smithi101.stdout: { 2023-08-01T19:55:04.756 INFO:teuthology.orchestra.run.smithi101.stdout: "event": "dispatched", 2023-08-01T19:55:04.757 INFO:teuthology.orchestra.run.smithi101.stdout: "time": "2023-08-01T19:54:04.459080+0000", 2023-08-01T19:55:04.757 INFO:teuthology.orchestra.run.smithi101.stdout: "duration": 7.6009999999999997e-06 2023-08-01T19:55:04.757 INFO:teuthology.orchestra.run.smithi101.stdout: }, 2023-08-01T19:55:04.757 INFO:teuthology.orchestra.run.smithi101.stdout: { 2023-08-01T19:55:04.757 INFO:teuthology.orchestra.run.smithi101.stdout: "event": "queued_for_pg", 2023-08-01T19:55:04.757 INFO:teuthology.orchestra.run.smithi101.stdout: "time": "2023-08-01T19:54:04.459088+0000", 2023-08-01T19:55:04.757 INFO:teuthology.orchestra.run.smithi101.stdout: "duration": 8.0509999999999997e-06 2023-08-01T19:55:04.757 INFO:teuthology.orchestra.run.smithi101.stdout: }, 2023-08-01T19:55:04.758 INFO:teuthology.orchestra.run.smithi101.stdout: { 2023-08-01T19:55:04.758 INFO:teuthology.orchestra.run.smithi101.stdout: "event": "reached_pg", 2023-08-01T19:55:04.758 INFO:teuthology.orchestra.run.smithi101.stdout: "time": "2023-08-01T19:54:04.459120+0000", 2023-08-01T19:55:04.758 INFO:teuthology.orchestra.run.smithi101.stdout: "duration": 3.2078e-05 2023-08-01T19:55:04.758 INFO:teuthology.orchestra.run.smithi101.stdout: }, 2023-08-01T19:55:04.758 INFO:teuthology.orchestra.run.smithi101.stdout: { 2023-08-01T19:55:04.758 INFO:teuthology.orchestra.run.smithi101.stdout: "event": "waiting_for_map not empty", 2023-08-01T19:55:04.758 INFO:teuthology.orchestra.run.smithi101.stdout: "time": "2023-08-01T19:54:04.459123+0000", 2023-08-01T19:55:04.759 INFO:teuthology.orchestra.run.smithi101.stdout: "duration": 3.4699999999999998e-06 2023-08-01T19:55:04.759 INFO:teuthology.orchestra.run.smithi101.stdout: }, 2023-08-01T19:55:04.759 INFO:teuthology.orchestra.run.smithi101.stdout: { 2023-08-01T19:55:04.759 INFO:teuthology.orchestra.run.smithi101.stdout: "event": "reached_pg", 2023-08-01T19:55:04.759 INFO:teuthology.orchestra.run.smithi101.stdout: "time": "2023-08-01T19:54:04.471352+0000", 2023-08-01T19:55:04.759 INFO:teuthology.orchestra.run.smithi101.stdout: "duration": 0.01222926 2023-08-01T19:55:04.759 INFO:teuthology.orchestra.run.smithi101.stdout: }, 2023-08-01T19:55:04.759 INFO:teuthology.orchestra.run.smithi101.stdout: { 2023-08-01T19:55:04.760 INFO:teuthology.orchestra.run.smithi101.stdout: "event": "started", 2023-08-01T19:55:04.760 INFO:teuthology.orchestra.run.smithi101.stdout: "time": "2023-08-01T19:54:04.471495+0000", 2023-08-01T19:55:04.760 INFO:teuthology.orchestra.run.smithi101.stdout: "duration": 0.00014263899999999999 2023-08-01T19:55:04.760 INFO:teuthology.orchestra.run.smithi101.stdout: }, 2023-08-01T19:55:04.760 INFO:teuthology.orchestra.run.smithi101.stdout: { 2023-08-01T19:55:04.760 INFO:teuthology.orchestra.run.smithi101.stdout: "event": "waiting for subops from 2", 2023-08-01T19:55:04.760 INFO:teuthology.orchestra.run.smithi101.stdout: "time": "2023-08-01T19:54:04.472368+0000", 2023-08-01T19:55:04.760 INFO:teuthology.orchestra.run.smithi101.stdout: "duration": 0.00087245300000000003 2023-08-01T19:55:04.761 INFO:teuthology.orchestra.run.smithi101.stdout: }, 2023-08-01T19:55:04.761 INFO:teuthology.orchestra.run.smithi101.stdout: { 2023-08-01T19:55:04.761 INFO:teuthology.orchestra.run.smithi101.stdout: "event": "op_commit", 2023-08-01T19:55:04.761 INFO:teuthology.orchestra.run.smithi101.stdout: "time": "2023-08-01T19:54:04.477612+0000", 2023-08-01T19:55:04.761 INFO:teuthology.orchestra.run.smithi101.stdout: "duration": 0.0052442809999999999 2023-08-01T19:55:04.761 INFO:teuthology.orchestra.run.smithi101.stdout: }, 2023-08-01T19:55:04.761 INFO:teuthology.orchestra.run.smithi101.stdout: { 2023-08-01T19:55:04.761 INFO:teuthology.orchestra.run.smithi101.stdout: "event": "sub_op_commit_rec", 2023-08-01T19:55:04.762 INFO:teuthology.orchestra.run.smithi101.stdout: "time": "2023-08-01T19:54:04.478516+0000", 2023-08-01T19:55:04.762 INFO:teuthology.orchestra.run.smithi101.stdout: "duration": 0.00090399800000000004 2023-08-01T19:55:04.762 INFO:teuthology.orchestra.run.smithi101.stdout: }, 2023-08-01T19:55:04.762 INFO:teuthology.orchestra.run.smithi101.stdout: { 2023-08-01T19:55:04.762 INFO:teuthology.orchestra.run.smithi101.stdout: "event": "commit_sent", 2023-08-01T19:55:04.762 INFO:teuthology.orchestra.run.smithi101.stdout: "time": "2023-08-01T19:54:04.478555+0000", 2023-08-01T19:55:04.762 INFO:teuthology.orchestra.run.smithi101.stdout: "duration": 3.8977000000000003e-05 2023-08-01T19:55:04.763 INFO:teuthology.orchestra.run.smithi101.stdout: }, 2023-08-01T19:55:04.763 INFO:teuthology.orchestra.run.smithi101.stdout: { 2023-08-01T19:55:04.763 INFO:teuthology.orchestra.run.smithi101.stdout: "event": "done", 2023-08-01T19:55:04.763 INFO:teuthology.orchestra.run.smithi101.stdout: "time": "2023-08-01T19:54:04.478592+0000", 2023-08-01T19:55:04.763 INFO:teuthology.orchestra.run.smithi101.stdout: "duration": 3.7287999999999999e-05 2023-08-01T19:55:04.763 INFO:teuthology.orchestra.run.smithi101.stdout: } 2023-08-01T19:55:04.763 INFO:teuthology.orchestra.run.smithi101.stdout: ] 2023-08-01T19:55:04.763 INFO:teuthology.orchestra.run.smithi101.stdout: } 2023-08-01T19:55:04.764 INFO:teuthology.orchestra.run.smithi101.stdout: }, 2023-08-01T19:55:04.764 INFO:teuthology.orchestra.run.smithi101.stdout: { 2023-08-01T19:55:04.764 INFO:teuthology.orchestra.run.smithi101.stdout: "description": "osd_op(mds.0.3:20 3.1c 3:3ed09add:::607.00000000:head [omap-set-header] snapc 0=[] ondisk+write+known_if_redirected+full_force+supports_pool_eio e17)", 2023-08-01T19:55:04.764 INFO:teuthology.orchestra.run.smithi101.stdout: "initiated_at": "2023-08-01T19:54:04.459097+0000", 2023-08-01T19:55:04.764 INFO:teuthology.orchestra.run.smithi101.stdout: "age": 60.101783325, 2023-08-01T19:55:04.764 INFO:teuthology.orchestra.run.smithi101.stdout: "duration": 0.018578978999999999, 2023-08-01T19:55:04.764 INFO:teuthology.orchestra.run.smithi101.stdout: "type_data": { 2023-08-01T19:55:04.764 INFO:teuthology.orchestra.run.smithi101.stdout: "flag_point": "commit sent; apply or cleanup", 2023-08-01T19:55:04.765 INFO:teuthology.orchestra.run.smithi101.stdout: "events": [ 2023-08-01T19:55:04.765 INFO:teuthology.orchestra.run.smithi101.stdout: { 2023-08-01T19:55:04.765 INFO:teuthology.orchestra.run.smithi101.stdout: "event": "initiated", 2023-08-01T19:55:04.765 INFO:teuthology.orchestra.run.smithi101.stdout: "time": "2023-08-01T19:54:04.459097+0000", 2023-08-01T19:55:04.765 INFO:teuthology.orchestra.run.smithi101.stdout: "duration": 0 2023-08-01T19:55:04.765 INFO:teuthology.orchestra.run.smithi101.stdout: }, 2023-08-01T19:55:04.765 INFO:teuthology.orchestra.run.smithi101.stdout: { 2023-08-01T19:55:04.765 INFO:teuthology.orchestra.run.smithi101.stdout: "event": "throttled", 2023-08-01T19:55:04.766 INFO:teuthology.orchestra.run.smithi101.stdout: "time": "2023-08-01T19:54:04.459097+0000", 2023-08-01T19:55:04.766 INFO:teuthology.orchestra.run.smithi101.stdout: "duration": 0 2023-08-01T19:55:04.766 INFO:teuthology.orchestra.run.smithi101.stdout: }, 2023-08-01T19:55:04.766 INFO:teuthology.orchestra.run.smithi101.stdout: { 2023-08-01T19:55:04.766 INFO:teuthology.orchestra.run.smithi101.stdout: "event": "header_read", 2023-08-01T19:55:04.766 INFO:teuthology.orchestra.run.smithi101.stdout: "time": "2023-08-01T19:54:04.459096+0000", 2023-08-01T19:55:04.766 INFO:teuthology.orchestra.run.smithi101.stdout: "duration": 4294967295.9999995 2023-08-01T19:55:04.766 INFO:teuthology.orchestra.run.smithi101.stdout: }, 2023-08-01T19:55:04.767 INFO:teuthology.orchestra.run.smithi101.stdout: { 2023-08-01T19:55:04.767 INFO:teuthology.orchestra.run.smithi101.stdout: "event": "all_read", 2023-08-01T19:55:04.767 INFO:teuthology.orchestra.run.smithi101.stdout: "time": "2023-08-01T19:54:04.459105+0000", 2023-08-01T19:55:04.767 INFO:teuthology.orchestra.run.smithi101.stdout: "duration": 8.8259999999999999e-06 2023-08-01T19:55:04.767 INFO:teuthology.orchestra.run.smithi101.stdout: }, 2023-08-01T19:55:04.767 INFO:teuthology.orchestra.run.smithi101.stdout: { 2023-08-01T19:55:04.767 INFO:teuthology.orchestra.run.smithi101.stdout: "event": "dispatched", 2023-08-01T19:55:04.767 INFO:teuthology.orchestra.run.smithi101.stdout: "time": "2023-08-01T19:54:04.459112+0000", 2023-08-01T19:55:04.768 INFO:teuthology.orchestra.run.smithi101.stdout: "duration": 6.6660000000000002e-06 2023-08-01T19:55:04.768 INFO:teuthology.orchestra.run.smithi101.stdout: }, 2023-08-01T19:55:04.768 INFO:teuthology.orchestra.run.smithi101.stdout: { 2023-08-01T19:55:04.768 INFO:teuthology.orchestra.run.smithi101.stdout: "event": "queued_for_pg", 2023-08-01T19:55:04.768 INFO:teuthology.orchestra.run.smithi101.stdout: "time": "2023-08-01T19:54:04.459116+0000", 2023-08-01T19:55:04.768 INFO:teuthology.orchestra.run.smithi101.stdout: "duration": 4.2209999999999999e-06 2023-08-01T19:55:04.768 INFO:teuthology.orchestra.run.smithi101.stdout: }, 2023-08-01T19:55:04.769 INFO:teuthology.orchestra.run.smithi101.stdout: { 2023-08-01T19:55:04.769 INFO:teuthology.orchestra.run.smithi101.stdout: "event": "reached_pg", 2023-08-01T19:55:04.769 INFO:teuthology.orchestra.run.smithi101.stdout: "time": "2023-08-01T19:54:04.459141+0000", 2023-08-01T19:55:04.769 INFO:teuthology.orchestra.run.smithi101.stdout: "duration": 2.4627e-05 2023-08-01T19:55:04.769 INFO:teuthology.orchestra.run.smithi101.stdout: }, 2023-08-01T19:55:04.769 INFO:teuthology.orchestra.run.smithi101.stdout: { 2023-08-01T19:55:04.769 INFO:teuthology.orchestra.run.smithi101.stdout: "event": "op must wait for map", 2023-08-01T19:55:04.769 INFO:teuthology.orchestra.run.smithi101.stdout: "time": "2023-08-01T19:54:04.459144+0000", 2023-08-01T19:55:04.770 INFO:teuthology.orchestra.run.smithi101.stdout: "duration": 3.6559999999999998e-06 2023-08-01T19:55:04.770 INFO:teuthology.orchestra.run.smithi101.stdout: }, 2023-08-01T19:55:04.770 INFO:teuthology.orchestra.run.smithi101.stdout: { 2023-08-01T19:55:04.770 INFO:teuthology.orchestra.run.smithi101.stdout: "event": "reached_pg", 2023-08-01T19:55:04.770 INFO:teuthology.orchestra.run.smithi101.stdout: "time": "2023-08-01T19:54:04.468086+0000", 2023-08-01T19:55:04.770 INFO:teuthology.orchestra.run.smithi101.stdout: "duration": 0.0089415569999999993 2023-08-01T19:55:04.770 INFO:teuthology.orchestra.run.smithi101.stdout: }, 2023-08-01T19:55:04.770 INFO:teuthology.orchestra.run.smithi101.stdout: { 2023-08-01T19:55:04.771 INFO:teuthology.orchestra.run.smithi101.stdout: "event": "started", 2023-08-01T19:55:04.771 INFO:teuthology.orchestra.run.smithi101.stdout: "time": "2023-08-01T19:54:04.468204+0000", 2023-08-01T19:55:04.771 INFO:teuthology.orchestra.run.smithi101.stdout: "duration": 0.00011806700000000001 2023-08-01T19:55:04.771 INFO:teuthology.orchestra.run.smithi101.stdout: }, 2023-08-01T19:55:04.771 INFO:teuthology.orchestra.run.smithi101.stdout: { 2023-08-01T19:55:04.771 INFO:teuthology.orchestra.run.smithi101.stdout: "event": "waiting for subops from 0", 2023-08-01T19:55:04.771 INFO:teuthology.orchestra.run.smithi101.stdout: "time": "2023-08-01T19:54:04.468342+0000", 2023-08-01T19:55:04.771 INFO:teuthology.orchestra.run.smithi101.stdout: "duration": 0.000138269 2023-08-01T19:55:04.772 INFO:teuthology.orchestra.run.smithi101.stdout: }, 2023-08-01T19:55:04.772 INFO:teuthology.orchestra.run.smithi101.stdout: { 2023-08-01T19:55:04.772 INFO:teuthology.orchestra.run.smithi101.stdout: "event": "op_commit", 2023-08-01T19:55:04.772 INFO:teuthology.orchestra.run.smithi101.stdout: "time": "2023-08-01T19:54:04.474028+0000", 2023-08-01T19:55:04.772 INFO:teuthology.orchestra.run.smithi101.stdout: "duration": 0.005685458 2023-08-01T19:55:04.772 INFO:teuthology.orchestra.run.smithi101.stdout: }, 2023-08-01T19:55:04.772 INFO:teuthology.orchestra.run.smithi101.stdout: { 2023-08-01T19:55:04.772 INFO:teuthology.orchestra.run.smithi101.stdout: "event": "sub_op_commit_rec", 2023-08-01T19:55:04.773 INFO:teuthology.orchestra.run.smithi101.stdout: "time": "2023-08-01T19:54:04.477581+0000", 2023-08-01T19:55:04.773 INFO:teuthology.orchestra.run.smithi101.stdout: "duration": 0.0035531109999999999 2023-08-01T19:55:04.773 INFO:teuthology.orchestra.run.smithi101.stdout: }, 2023-08-01T19:55:04.773 INFO:teuthology.orchestra.run.smithi101.stdout: { 2023-08-01T19:55:04.773 INFO:teuthology.orchestra.run.smithi101.stdout: "event": "commit_sent", 2023-08-01T19:55:04.773 INFO:teuthology.orchestra.run.smithi101.stdout: "time": "2023-08-01T19:54:04.477635+0000", 2023-08-01T19:55:04.773 INFO:teuthology.orchestra.run.smithi101.stdout: "duration": 5.3769e-05 2023-08-01T19:55:04.773 INFO:teuthology.orchestra.run.smithi101.stdout: }, 2023-08-01T19:55:04.774 INFO:teuthology.orchestra.run.smithi101.stdout: { 2023-08-01T19:55:04.774 INFO:teuthology.orchestra.run.smithi101.stdout: "event": "done", 2023-08-01T19:55:04.774 INFO:teuthology.orchestra.run.smithi101.stdout: "time": "2023-08-01T19:54:04.477676+0000", 2023-08-01T19:55:04.774 INFO:teuthology.orchestra.run.smithi101.stdout: "duration": 4.1148e-05 2023-08-01T19:55:04.774 INFO:teuthology.orchestra.run.smithi101.stdout: } 2023-08-01T19:55:04.774 INFO:teuthology.orchestra.run.smithi101.stdout: ] 2023-08-01T19:55:04.774 INFO:teuthology.orchestra.run.smithi101.stdout: } 2023-08-01T19:55:04.774 INFO:teuthology.orchestra.run.smithi101.stdout: }, 2023-08-01T19:55:04.775 INFO:teuthology.orchestra.run.smithi101.stdout: { 2023-08-01T19:55:04.775 INFO:teuthology.orchestra.run.smithi101.stdout: "description": "osd_op(mds.0.3:21 3.1c 3:3ed09add:::607.00000000:head [create,setxattr parent (62) in=6b,setxattr layout (30) in=6b] snapc 0=[] ondisk+write+known_if_redirected+full_force+supports_pool_eio e17)", 2023-08-01T19:55:04.775 INFO:teuthology.orchestra.run.smithi101.stdout: "initiated_at": "2023-08-01T19:54:04.459123+0000", 2023-08-01T19:55:04.775 INFO:teuthology.orchestra.run.smithi101.stdout: "age": 60.101757167999999, 2023-08-01T19:55:04.775 INFO:teuthology.orchestra.run.smithi101.stdout: "duration": 0.018736452000000001, 2023-08-01T19:55:04.775 INFO:teuthology.orchestra.run.smithi101.stdout: "type_data": { 2023-08-01T19:55:04.775 INFO:teuthology.orchestra.run.smithi101.stdout: "flag_point": "commit sent; apply or cleanup", 2023-08-01T19:55:04.775 INFO:teuthology.orchestra.run.smithi101.stdout: "events": [ 2023-08-01T19:55:04.776 INFO:teuthology.orchestra.run.smithi101.stdout: { 2023-08-01T19:55:04.776 INFO:teuthology.orchestra.run.smithi101.stdout: "event": "initiated", 2023-08-01T19:55:04.776 INFO:teuthology.orchestra.run.smithi101.stdout: "time": "2023-08-01T19:54:04.459123+0000", 2023-08-01T19:55:04.776 INFO:teuthology.orchestra.run.smithi101.stdout: "duration": 0 2023-08-01T19:55:04.776 INFO:teuthology.orchestra.run.smithi101.stdout: }, 2023-08-01T19:55:04.776 INFO:teuthology.orchestra.run.smithi101.stdout: { 2023-08-01T19:55:04.776 INFO:teuthology.orchestra.run.smithi101.stdout: "event": "throttled", 2023-08-01T19:55:04.777 INFO:teuthology.orchestra.run.smithi101.stdout: "time": "2023-08-01T19:54:04.459123+0000", 2023-08-01T19:55:04.777 INFO:teuthology.orchestra.run.smithi101.stdout: "duration": 0 2023-08-01T19:55:04.777 INFO:teuthology.orchestra.run.smithi101.stdout: }, 2023-08-01T19:55:04.777 INFO:teuthology.orchestra.run.smithi101.stdout: { 2023-08-01T19:55:04.777 INFO:teuthology.orchestra.run.smithi101.stdout: "event": "header_read", 2023-08-01T19:55:04.777 INFO:teuthology.orchestra.run.smithi101.stdout: "time": "2023-08-01T19:54:04.459123+0000", 2023-08-01T19:55:04.777 INFO:teuthology.orchestra.run.smithi101.stdout: "duration": 4294967295.9999995 2023-08-01T19:55:04.777 INFO:teuthology.orchestra.run.smithi101.stdout: }, 2023-08-01T19:55:04.778 INFO:teuthology.orchestra.run.smithi101.stdout: { 2023-08-01T19:55:04.778 INFO:teuthology.orchestra.run.smithi101.stdout: "event": "all_read", 2023-08-01T19:55:04.778 INFO:teuthology.orchestra.run.smithi101.stdout: "time": "2023-08-01T19:54:04.459127+0000", 2023-08-01T19:55:04.778 INFO:teuthology.orchestra.run.smithi101.stdout: "duration": 4.5770000000000004e-06 2023-08-01T19:55:04.778 INFO:teuthology.orchestra.run.smithi101.stdout: }, 2023-08-01T19:55:04.778 INFO:teuthology.orchestra.run.smithi101.stdout: { 2023-08-01T19:55:04.778 INFO:teuthology.orchestra.run.smithi101.stdout: "event": "dispatched", 2023-08-01T19:55:04.778 INFO:teuthology.orchestra.run.smithi101.stdout: "time": "2023-08-01T19:54:04.459134+0000", 2023-08-01T19:55:04.779 INFO:teuthology.orchestra.run.smithi101.stdout: "duration": 6.5080000000000002e-06 2023-08-01T19:55:04.779 INFO:teuthology.orchestra.run.smithi101.stdout: }, 2023-08-01T19:55:04.779 INFO:teuthology.orchestra.run.smithi101.stdout: { 2023-08-01T19:55:04.779 INFO:teuthology.orchestra.run.smithi101.stdout: "event": "queued_for_pg", 2023-08-01T19:55:04.779 INFO:teuthology.orchestra.run.smithi101.stdout: "time": "2023-08-01T19:54:04.459138+0000", 2023-08-01T19:55:04.779 INFO:teuthology.orchestra.run.smithi101.stdout: "duration": 4.6249999999999998e-06 2023-08-01T19:55:04.779 INFO:teuthology.orchestra.run.smithi101.stdout: }, 2023-08-01T19:55:04.779 INFO:teuthology.orchestra.run.smithi101.stdout: { 2023-08-01T19:55:04.780 INFO:teuthology.orchestra.run.smithi101.stdout: "event": "reached_pg", 2023-08-01T19:55:04.780 INFO:teuthology.orchestra.run.smithi101.stdout: "time": "2023-08-01T19:54:04.459158+0000", 2023-08-01T19:55:04.780 INFO:teuthology.orchestra.run.smithi101.stdout: "duration": 1.9354000000000001e-05 2023-08-01T19:55:04.780 INFO:teuthology.orchestra.run.smithi101.stdout: }, 2023-08-01T19:55:04.780 INFO:teuthology.orchestra.run.smithi101.stdout: { 2023-08-01T19:55:04.780 INFO:teuthology.orchestra.run.smithi101.stdout: "event": "waiting_for_map not empty", 2023-08-01T19:55:04.780 INFO:teuthology.orchestra.run.smithi101.stdout: "time": "2023-08-01T19:54:04.459160+0000", 2023-08-01T19:55:04.780 INFO:teuthology.orchestra.run.smithi101.stdout: "duration": 2.2740000000000002e-06 2023-08-01T19:55:04.781 INFO:teuthology.orchestra.run.smithi101.stdout: }, 2023-08-01T19:55:04.781 INFO:teuthology.orchestra.run.smithi101.stdout: { 2023-08-01T19:55:04.781 INFO:teuthology.orchestra.run.smithi101.stdout: "event": "reached_pg", 2023-08-01T19:55:04.781 INFO:teuthology.orchestra.run.smithi101.stdout: "time": "2023-08-01T19:54:04.468839+0000", 2023-08-01T19:55:04.781 INFO:teuthology.orchestra.run.smithi101.stdout: "duration": 0.0096787109999999996 2023-08-01T19:55:04.781 INFO:teuthology.orchestra.run.smithi101.stdout: }, 2023-08-01T19:55:04.781 INFO:teuthology.orchestra.run.smithi101.stdout: { 2023-08-01T19:55:04.782 INFO:teuthology.orchestra.run.smithi101.stdout: "event": "started", 2023-08-01T19:55:04.782 INFO:teuthology.orchestra.run.smithi101.stdout: "time": "2023-08-01T19:54:04.469446+0000", 2023-08-01T19:55:04.782 INFO:teuthology.orchestra.run.smithi101.stdout: "duration": 0.00060714899999999997 2023-08-01T19:55:04.782 INFO:teuthology.orchestra.run.smithi101.stdout: }, 2023-08-01T19:55:04.782 INFO:teuthology.orchestra.run.smithi101.stdout: { 2023-08-01T19:55:04.782 INFO:teuthology.orchestra.run.smithi101.stdout: "event": "waiting for subops from 0", 2023-08-01T19:55:04.782 INFO:teuthology.orchestra.run.smithi101.stdout: "time": "2023-08-01T19:54:04.470133+0000", 2023-08-01T19:55:04.782 INFO:teuthology.orchestra.run.smithi101.stdout: "duration": 0.00068691900000000003 2023-08-01T19:55:04.783 INFO:teuthology.orchestra.run.smithi101.stdout: }, 2023-08-01T19:55:04.783 INFO:teuthology.orchestra.run.smithi101.stdout: { 2023-08-01T19:55:04.783 INFO:teuthology.orchestra.run.smithi101.stdout: "event": "op_commit", 2023-08-01T19:55:04.783 INFO:teuthology.orchestra.run.smithi101.stdout: "time": "2023-08-01T19:54:04.475933+0000", 2023-08-01T19:55:04.783 INFO:teuthology.orchestra.run.smithi101.stdout: "duration": 0.0058002560000000002 2023-08-01T19:55:04.783 INFO:teuthology.orchestra.run.smithi101.stdout: }, 2023-08-01T19:55:04.783 INFO:teuthology.orchestra.run.smithi101.stdout: { 2023-08-01T19:55:04.783 INFO:teuthology.orchestra.run.smithi101.stdout: "event": "sub_op_commit_rec", 2023-08-01T19:55:04.784 INFO:teuthology.orchestra.run.smithi101.stdout: "time": "2023-08-01T19:54:04.477749+0000", 2023-08-01T19:55:04.784 INFO:teuthology.orchestra.run.smithi101.stdout: "duration": 0.00181584 2023-08-01T19:55:04.784 INFO:teuthology.orchestra.run.smithi101.stdout: }, 2023-08-01T19:55:04.784 INFO:teuthology.orchestra.run.smithi101.stdout: { 2023-08-01T19:55:04.784 INFO:teuthology.orchestra.run.smithi101.stdout: "event": "commit_sent", 2023-08-01T19:55:04.784 INFO:teuthology.orchestra.run.smithi101.stdout: "time": "2023-08-01T19:54:04.477823+0000", 2023-08-01T19:55:04.784 INFO:teuthology.orchestra.run.smithi101.stdout: "duration": 7.4405000000000003e-05 2023-08-01T19:55:04.784 INFO:teuthology.orchestra.run.smithi101.stdout: }, 2023-08-01T19:55:04.785 INFO:teuthology.orchestra.run.smithi101.stdout: { 2023-08-01T19:55:04.785 INFO:teuthology.orchestra.run.smithi101.stdout: "event": "done", 2023-08-01T19:55:04.785 INFO:teuthology.orchestra.run.smithi101.stdout: "time": "2023-08-01T19:54:04.477859+0000", 2023-08-01T19:55:04.785 INFO:teuthology.orchestra.run.smithi101.stdout: "duration": 3.6211000000000003e-05 2023-08-01T19:55:04.785 INFO:teuthology.orchestra.run.smithi101.stdout: } 2023-08-01T19:55:04.785 INFO:teuthology.orchestra.run.smithi101.stdout: ] 2023-08-01T19:55:04.785 INFO:teuthology.orchestra.run.smithi101.stdout: } 2023-08-01T19:55:04.785 INFO:teuthology.orchestra.run.smithi101.stdout: }, 2023-08-01T19:55:04.786 INFO:teuthology.orchestra.run.smithi101.stdout: { 2023-08-01T19:55:04.786 INFO:teuthology.orchestra.run.smithi101.stdout: "description": "osd_op(mds.0.3:1 3.14 3:292cf221:::200.00000000:head [writefull 0~90] snapc 0=[] ondisk+write+known_if_redirected+full_force+supports_pool_eio e17)", 2023-08-01T19:55:04.786 INFO:teuthology.orchestra.run.smithi101.stdout: "initiated_at": "2023-08-01T19:54:04.459177+0000", 2023-08-01T19:55:04.786 INFO:teuthology.orchestra.run.smithi101.stdout: "age": 60.101703458999999, 2023-08-01T19:55:04.786 INFO:teuthology.orchestra.run.smithi101.stdout: "duration": 0.021067196, 2023-08-01T19:55:04.786 INFO:teuthology.orchestra.run.smithi101.stdout: "type_data": { 2023-08-01T19:55:04.786 INFO:teuthology.orchestra.run.smithi101.stdout: "flag_point": "commit sent; apply or cleanup", 2023-08-01T19:55:04.786 INFO:teuthology.orchestra.run.smithi101.stdout: "events": [ 2023-08-01T19:55:04.787 INFO:teuthology.orchestra.run.smithi101.stdout: { 2023-08-01T19:55:04.787 INFO:teuthology.orchestra.run.smithi101.stdout: "event": "initiated", 2023-08-01T19:55:04.787 INFO:teuthology.orchestra.run.smithi101.stdout: "time": "2023-08-01T19:54:04.459177+0000", 2023-08-01T19:55:04.787 INFO:teuthology.orchestra.run.smithi101.stdout: "duration": 0 2023-08-01T19:55:04.787 INFO:teuthology.orchestra.run.smithi101.stdout: }, 2023-08-01T19:55:04.787 INFO:teuthology.orchestra.run.smithi101.stdout: { 2023-08-01T19:55:04.787 INFO:teuthology.orchestra.run.smithi101.stdout: "event": "throttled", 2023-08-01T19:55:04.787 INFO:teuthology.orchestra.run.smithi101.stdout: "time": "2023-08-01T19:54:04.459177+0000", 2023-08-01T19:55:04.788 INFO:teuthology.orchestra.run.smithi101.stdout: "duration": 0 2023-08-01T19:55:04.788 INFO:teuthology.orchestra.run.smithi101.stdout: }, 2023-08-01T19:55:04.788 INFO:teuthology.orchestra.run.smithi101.stdout: { 2023-08-01T19:55:04.788 INFO:teuthology.orchestra.run.smithi101.stdout: "event": "header_read", 2023-08-01T19:55:04.788 INFO:teuthology.orchestra.run.smithi101.stdout: "time": "2023-08-01T19:54:04.459176+0000", 2023-08-01T19:55:04.788 INFO:teuthology.orchestra.run.smithi101.stdout: "duration": 4294967295.9999995 2023-08-01T19:55:04.788 INFO:teuthology.orchestra.run.smithi101.stdout: }, 2023-08-01T19:55:04.788 INFO:teuthology.orchestra.run.smithi101.stdout: { 2023-08-01T19:55:04.789 INFO:teuthology.orchestra.run.smithi101.stdout: "event": "all_read", 2023-08-01T19:55:04.789 INFO:teuthology.orchestra.run.smithi101.stdout: "time": "2023-08-01T19:54:04.459181+0000", 2023-08-01T19:55:04.789 INFO:teuthology.orchestra.run.smithi101.stdout: "duration": 5.2109999999999997e-06 2023-08-01T19:55:04.789 INFO:teuthology.orchestra.run.smithi101.stdout: }, 2023-08-01T19:55:04.789 INFO:teuthology.orchestra.run.smithi101.stdout: { 2023-08-01T19:55:04.789 INFO:teuthology.orchestra.run.smithi101.stdout: "event": "dispatched", 2023-08-01T19:55:04.789 INFO:teuthology.orchestra.run.smithi101.stdout: "time": "2023-08-01T19:54:04.459188+0000", 2023-08-01T19:55:04.789 INFO:teuthology.orchestra.run.smithi101.stdout: "duration": 6.6680000000000004e-06 2023-08-01T19:55:04.790 INFO:teuthology.orchestra.run.smithi101.stdout: }, 2023-08-01T19:55:04.790 INFO:teuthology.orchestra.run.smithi101.stdout: { 2023-08-01T19:55:04.790 INFO:teuthology.orchestra.run.smithi101.stdout: "event": "queued_for_pg", 2023-08-01T19:55:04.790 INFO:teuthology.orchestra.run.smithi101.stdout: "time": "2023-08-01T19:54:04.459192+0000", 2023-08-01T19:55:04.790 INFO:teuthology.orchestra.run.smithi101.stdout: "duration": 4.228e-06 2023-08-01T19:55:04.790 INFO:teuthology.orchestra.run.smithi101.stdout: }, 2023-08-01T19:55:04.790 INFO:teuthology.orchestra.run.smithi101.stdout: { 2023-08-01T19:55:04.790 INFO:teuthology.orchestra.run.smithi101.stdout: "event": "reached_pg", 2023-08-01T19:55:04.791 INFO:teuthology.orchestra.run.smithi101.stdout: "time": "2023-08-01T19:54:04.459219+0000", 2023-08-01T19:55:04.791 INFO:teuthology.orchestra.run.smithi101.stdout: "duration": 2.6930000000000001e-05 2023-08-01T19:55:04.791 INFO:teuthology.orchestra.run.smithi101.stdout: }, 2023-08-01T19:55:04.791 INFO:teuthology.orchestra.run.smithi101.stdout: { 2023-08-01T19:55:04.791 INFO:teuthology.orchestra.run.smithi101.stdout: "event": "waiting_for_map not empty", 2023-08-01T19:55:04.791 INFO:teuthology.orchestra.run.smithi101.stdout: "time": "2023-08-01T19:54:04.459223+0000", 2023-08-01T19:55:04.791 INFO:teuthology.orchestra.run.smithi101.stdout: "duration": 3.8469999999999998e-06 2023-08-01T19:55:04.791 INFO:teuthology.orchestra.run.smithi101.stdout: }, 2023-08-01T19:55:04.792 INFO:teuthology.orchestra.run.smithi101.stdout: { 2023-08-01T19:55:04.792 INFO:teuthology.orchestra.run.smithi101.stdout: "event": "reached_pg", 2023-08-01T19:55:04.792 INFO:teuthology.orchestra.run.smithi101.stdout: "time": "2023-08-01T19:54:04.473347+0000", 2023-08-01T19:55:04.792 INFO:teuthology.orchestra.run.smithi101.stdout: "duration": 0.014124319 2023-08-01T19:55:04.792 INFO:teuthology.orchestra.run.smithi101.stdout: }, 2023-08-01T19:55:04.792 INFO:teuthology.orchestra.run.smithi101.stdout: { 2023-08-01T19:55:04.792 INFO:teuthology.orchestra.run.smithi101.stdout: "event": "started", 2023-08-01T19:55:04.793 INFO:teuthology.orchestra.run.smithi101.stdout: "time": "2023-08-01T19:54:04.473480+0000", 2023-08-01T19:55:04.793 INFO:teuthology.orchestra.run.smithi101.stdout: "duration": 0.00013276799999999999 2023-08-01T19:55:04.793 INFO:teuthology.orchestra.run.smithi101.stdout: }, 2023-08-01T19:55:04.793 INFO:teuthology.orchestra.run.smithi101.stdout: { 2023-08-01T19:55:04.793 INFO:teuthology.orchestra.run.smithi101.stdout: "event": "waiting for subops from 2", 2023-08-01T19:55:04.793 INFO:teuthology.orchestra.run.smithi101.stdout: "time": "2023-08-01T19:54:04.473622+0000", 2023-08-01T19:55:04.793 INFO:teuthology.orchestra.run.smithi101.stdout: "duration": 0.00014154799999999999 2023-08-01T19:55:04.793 INFO:teuthology.orchestra.run.smithi101.stdout: }, 2023-08-01T19:55:04.794 INFO:teuthology.orchestra.run.smithi101.stdout: { 2023-08-01T19:55:04.794 INFO:teuthology.orchestra.run.smithi101.stdout: "event": "op_commit", 2023-08-01T19:55:04.794 INFO:teuthology.orchestra.run.smithi101.stdout: "time": "2023-08-01T19:54:04.478281+0000", 2023-08-01T19:55:04.794 INFO:teuthology.orchestra.run.smithi101.stdout: "duration": 0.004659252 2023-08-01T19:55:04.794 INFO:teuthology.orchestra.run.smithi101.stdout: }, 2023-08-01T19:55:04.794 INFO:teuthology.orchestra.run.smithi101.stdout: { 2023-08-01T19:55:04.794 INFO:teuthology.orchestra.run.smithi101.stdout: "event": "sub_op_commit_rec", 2023-08-01T19:55:04.794 INFO:teuthology.orchestra.run.smithi101.stdout: "time": "2023-08-01T19:54:04.480180+0000", 2023-08-01T19:55:04.795 INFO:teuthology.orchestra.run.smithi101.stdout: "duration": 0.0018986859999999999 2023-08-01T19:55:04.795 INFO:teuthology.orchestra.run.smithi101.stdout: }, 2023-08-01T19:55:04.795 INFO:teuthology.orchestra.run.smithi101.stdout: { 2023-08-01T19:55:04.795 INFO:teuthology.orchestra.run.smithi101.stdout: "event": "commit_sent", 2023-08-01T19:55:04.795 INFO:teuthology.orchestra.run.smithi101.stdout: "time": "2023-08-01T19:54:04.480209+0000", 2023-08-01T19:55:04.795 INFO:teuthology.orchestra.run.smithi101.stdout: "duration": 2.9244999999999999e-05 2023-08-01T19:55:04.795 INFO:teuthology.orchestra.run.smithi101.stdout: }, 2023-08-01T19:55:04.795 INFO:teuthology.orchestra.run.smithi101.stdout: { 2023-08-01T19:55:04.796 INFO:teuthology.orchestra.run.smithi101.stdout: "event": "done", 2023-08-01T19:55:04.796 INFO:teuthology.orchestra.run.smithi101.stdout: "time": "2023-08-01T19:54:04.480244+0000", 2023-08-01T19:55:04.796 INFO:teuthology.orchestra.run.smithi101.stdout: "duration": 3.4875000000000001e-05 2023-08-01T19:55:04.796 INFO:teuthology.orchestra.run.smithi101.stdout: } 2023-08-01T19:55:04.796 INFO:teuthology.orchestra.run.smithi101.stdout: ] 2023-08-01T19:55:04.796 INFO:teuthology.orchestra.run.smithi101.stdout: } 2023-08-01T19:55:04.796 INFO:teuthology.orchestra.run.smithi101.stdout: }, 2023-08-01T19:55:04.796 INFO:teuthology.orchestra.run.smithi101.stdout: { 2023-08-01T19:55:04.797 INFO:teuthology.orchestra.run.smithi101.stdout: "description": "osd_op(mds.0.3:3 3.14 3:287034c4:::1.00000000.inode:head [writefull 0~554] snapc 0=[] ondisk+write+known_if_redirected+full_force+supports_pool_eio e17)", 2023-08-01T19:55:04.797 INFO:teuthology.orchestra.run.smithi101.stdout: "initiated_at": "2023-08-01T19:54:04.459226+0000", 2023-08-01T19:55:04.797 INFO:teuthology.orchestra.run.smithi101.stdout: "age": 60.101654379999999, 2023-08-01T19:55:04.797 INFO:teuthology.orchestra.run.smithi101.stdout: "duration": 0.021104531999999999, 2023-08-01T19:55:04.797 INFO:teuthology.orchestra.run.smithi101.stdout: "type_data": { 2023-08-01T19:55:04.797 INFO:teuthology.orchestra.run.smithi101.stdout: "flag_point": "commit sent; apply or cleanup", 2023-08-01T19:55:04.797 INFO:teuthology.orchestra.run.smithi101.stdout: "events": [ 2023-08-01T19:55:04.797 INFO:teuthology.orchestra.run.smithi101.stdout: { 2023-08-01T19:55:04.798 INFO:teuthology.orchestra.run.smithi101.stdout: "event": "initiated", 2023-08-01T19:55:04.798 INFO:teuthology.orchestra.run.smithi101.stdout: "time": "2023-08-01T19:54:04.459226+0000", 2023-08-01T19:55:04.798 INFO:teuthology.orchestra.run.smithi101.stdout: "duration": 0 2023-08-01T19:55:04.798 INFO:teuthology.orchestra.run.smithi101.stdout: }, 2023-08-01T19:55:04.798 INFO:teuthology.orchestra.run.smithi101.stdout: { 2023-08-01T19:55:04.798 INFO:teuthology.orchestra.run.smithi101.stdout: "event": "throttled", 2023-08-01T19:55:04.798 INFO:teuthology.orchestra.run.smithi101.stdout: "time": "2023-08-01T19:54:04.459226+0000", 2023-08-01T19:55:04.798 INFO:teuthology.orchestra.run.smithi101.stdout: "duration": 0 2023-08-01T19:55:04.799 INFO:teuthology.orchestra.run.smithi101.stdout: }, 2023-08-01T19:55:04.799 INFO:teuthology.orchestra.run.smithi101.stdout: { 2023-08-01T19:55:04.799 INFO:teuthology.orchestra.run.smithi101.stdout: "event": "header_read", 2023-08-01T19:55:04.799 INFO:teuthology.orchestra.run.smithi101.stdout: "time": "2023-08-01T19:54:04.459225+0000", 2023-08-01T19:55:04.799 INFO:teuthology.orchestra.run.smithi101.stdout: "duration": 4294967295.9999995 2023-08-01T19:55:04.799 INFO:teuthology.orchestra.run.smithi101.stdout: }, 2023-08-01T19:55:04.799 INFO:teuthology.orchestra.run.smithi101.stdout: { 2023-08-01T19:55:04.799 INFO:teuthology.orchestra.run.smithi101.stdout: "event": "all_read", 2023-08-01T19:55:04.800 INFO:teuthology.orchestra.run.smithi101.stdout: "time": "2023-08-01T19:54:04.459238+0000", 2023-08-01T19:55:04.800 INFO:teuthology.orchestra.run.smithi101.stdout: "duration": 1.2809000000000001e-05 2023-08-01T19:55:04.800 INFO:teuthology.orchestra.run.smithi101.stdout: }, 2023-08-01T19:55:04.800 INFO:teuthology.orchestra.run.smithi101.stdout: { 2023-08-01T19:55:04.800 INFO:teuthology.orchestra.run.smithi101.stdout: "event": "dispatched", 2023-08-01T19:55:04.800 INFO:teuthology.orchestra.run.smithi101.stdout: "time": "2023-08-01T19:54:04.459245+0000", 2023-08-01T19:55:04.800 INFO:teuthology.orchestra.run.smithi101.stdout: "duration": 6.6540000000000002e-06 2023-08-01T19:55:04.801 INFO:teuthology.orchestra.run.smithi101.stdout: }, 2023-08-01T19:55:04.801 INFO:teuthology.orchestra.run.smithi101.stdout: { 2023-08-01T19:55:04.801 INFO:teuthology.orchestra.run.smithi101.stdout: "event": "queued_for_pg", 2023-08-01T19:55:04.801 INFO:teuthology.orchestra.run.smithi101.stdout: "time": "2023-08-01T19:54:04.459249+0000", 2023-08-01T19:55:04.801 INFO:teuthology.orchestra.run.smithi101.stdout: "duration": 4.6e-06 2023-08-01T19:55:04.801 INFO:teuthology.orchestra.run.smithi101.stdout: }, 2023-08-01T19:55:04.801 INFO:teuthology.orchestra.run.smithi101.stdout: { 2023-08-01T19:55:04.801 INFO:teuthology.orchestra.run.smithi101.stdout: "event": "reached_pg", 2023-08-01T19:55:04.802 INFO:teuthology.orchestra.run.smithi101.stdout: "time": "2023-08-01T19:54:04.459276+0000", 2023-08-01T19:55:04.802 INFO:teuthology.orchestra.run.smithi101.stdout: "duration": 2.6373999999999999e-05 2023-08-01T19:55:04.802 INFO:teuthology.orchestra.run.smithi101.stdout: }, 2023-08-01T19:55:04.802 INFO:teuthology.orchestra.run.smithi101.stdout: { 2023-08-01T19:55:04.802 INFO:teuthology.orchestra.run.smithi101.stdout: "event": "waiting_for_map not empty", 2023-08-01T19:55:04.802 INFO:teuthology.orchestra.run.smithi101.stdout: "time": "2023-08-01T19:54:04.459278+0000", 2023-08-01T19:55:04.802 INFO:teuthology.orchestra.run.smithi101.stdout: "duration": 2.4980000000000001e-06 2023-08-01T19:55:04.802 INFO:teuthology.orchestra.run.smithi101.stdout: }, 2023-08-01T19:55:04.803 INFO:teuthology.orchestra.run.smithi101.stdout: { 2023-08-01T19:55:04.803 INFO:teuthology.orchestra.run.smithi101.stdout: "event": "reached_pg", 2023-08-01T19:55:04.803 INFO:teuthology.orchestra.run.smithi101.stdout: "time": "2023-08-01T19:54:04.474058+0000", 2023-08-01T19:55:04.803 INFO:teuthology.orchestra.run.smithi101.stdout: "duration": 0.014779979 2023-08-01T19:55:04.803 INFO:teuthology.orchestra.run.smithi101.stdout: }, 2023-08-01T19:55:04.803 INFO:teuthology.orchestra.run.smithi101.stdout: { 2023-08-01T19:55:04.803 INFO:teuthology.orchestra.run.smithi101.stdout: "event": "started", 2023-08-01T19:55:04.803 INFO:teuthology.orchestra.run.smithi101.stdout: "time": "2023-08-01T19:54:04.474614+0000", 2023-08-01T19:55:04.804 INFO:teuthology.orchestra.run.smithi101.stdout: "duration": 0.00055546899999999995 2023-08-01T19:55:04.804 INFO:teuthology.orchestra.run.smithi101.stdout: }, 2023-08-01T19:55:04.804 INFO:teuthology.orchestra.run.smithi101.stdout: { 2023-08-01T19:55:04.804 INFO:teuthology.orchestra.run.smithi101.stdout: "event": "waiting for subops from 2", 2023-08-01T19:55:04.804 INFO:teuthology.orchestra.run.smithi101.stdout: "time": "2023-08-01T19:54:04.474720+0000", 2023-08-01T19:55:04.804 INFO:teuthology.orchestra.run.smithi101.stdout: "duration": 0.00010645300000000001 2023-08-01T19:55:04.804 INFO:teuthology.orchestra.run.smithi101.stdout: }, 2023-08-01T19:55:04.804 INFO:teuthology.orchestra.run.smithi101.stdout: { 2023-08-01T19:55:04.805 INFO:teuthology.orchestra.run.smithi101.stdout: "event": "op_commit", 2023-08-01T19:55:04.805 INFO:teuthology.orchestra.run.smithi101.stdout: "time": "2023-08-01T19:54:04.478480+0000", 2023-08-01T19:55:04.805 INFO:teuthology.orchestra.run.smithi101.stdout: "duration": 0.0037600279999999999 2023-08-01T19:55:04.805 INFO:teuthology.orchestra.run.smithi101.stdout: }, 2023-08-01T19:55:04.805 INFO:teuthology.orchestra.run.smithi101.stdout: { 2023-08-01T19:55:04.805 INFO:teuthology.orchestra.run.smithi101.stdout: "event": "sub_op_commit_rec", 2023-08-01T19:55:04.805 INFO:teuthology.orchestra.run.smithi101.stdout: "time": "2023-08-01T19:54:04.480273+0000", 2023-08-01T19:55:04.805 INFO:teuthology.orchestra.run.smithi101.stdout: "duration": 0.001792465 2023-08-01T19:55:04.806 INFO:teuthology.orchestra.run.smithi101.stdout: }, 2023-08-01T19:55:04.806 INFO:teuthology.orchestra.run.smithi101.stdout: { 2023-08-01T19:55:04.806 INFO:teuthology.orchestra.run.smithi101.stdout: "event": "commit_sent", 2023-08-01T19:55:04.806 INFO:teuthology.orchestra.run.smithi101.stdout: "time": "2023-08-01T19:54:04.480304+0000", 2023-08-01T19:55:04.806 INFO:teuthology.orchestra.run.smithi101.stdout: "duration": 3.1708999999999997e-05 2023-08-01T19:55:04.806 INFO:teuthology.orchestra.run.smithi101.stdout: }, 2023-08-01T19:55:04.806 INFO:teuthology.orchestra.run.smithi101.stdout: { 2023-08-01T19:55:04.806 INFO:teuthology.orchestra.run.smithi101.stdout: "event": "done", 2023-08-01T19:55:04.807 INFO:teuthology.orchestra.run.smithi101.stdout: "time": "2023-08-01T19:54:04.480330+0000", 2023-08-01T19:55:04.807 INFO:teuthology.orchestra.run.smithi101.stdout: "duration": 2.5860999999999999e-05 2023-08-01T19:55:04.807 INFO:teuthology.orchestra.run.smithi101.stdout: } 2023-08-01T19:55:04.807 INFO:teuthology.orchestra.run.smithi101.stdout: ] 2023-08-01T19:55:04.807 INFO:teuthology.orchestra.run.smithi101.stdout: } 2023-08-01T19:55:04.807 INFO:teuthology.orchestra.run.smithi101.stdout: }, 2023-08-01T19:55:04.807 INFO:teuthology.orchestra.run.smithi101.stdout: { 2023-08-01T19:55:04.807 INFO:teuthology.orchestra.run.smithi101.stdout: "description": "osd_op(mds.0.3:32 3.14 3:2e2fa760:::200.00000001:head [delete] snapc 0=[] ondisk+write+known_if_redirected+full_force+supports_pool_eio e17)", 2023-08-01T19:55:04.808 INFO:teuthology.orchestra.run.smithi101.stdout: "initiated_at": "2023-08-01T19:54:04.459304+0000", 2023-08-01T19:55:04.808 INFO:teuthology.orchestra.run.smithi101.stdout: "age": 60.101575719000003, 2023-08-01T19:55:04.808 INFO:teuthology.orchestra.run.smithi101.stdout: "duration": 0.021110606000000001, 2023-08-01T19:55:04.808 INFO:teuthology.orchestra.run.smithi101.stdout: "type_data": { 2023-08-01T19:55:04.808 INFO:teuthology.orchestra.run.smithi101.stdout: "flag_point": "started", 2023-08-01T19:55:04.808 INFO:teuthology.orchestra.run.smithi101.stdout: "events": [ 2023-08-01T19:55:04.808 INFO:teuthology.orchestra.run.smithi101.stdout: { 2023-08-01T19:55:04.808 INFO:teuthology.orchestra.run.smithi101.stdout: "event": "initiated", 2023-08-01T19:55:04.809 INFO:teuthology.orchestra.run.smithi101.stdout: "time": "2023-08-01T19:54:04.459304+0000", 2023-08-01T19:55:04.809 INFO:teuthology.orchestra.run.smithi101.stdout: "duration": 0 2023-08-01T19:55:04.809 INFO:teuthology.orchestra.run.smithi101.stdout: }, 2023-08-01T19:55:04.809 INFO:teuthology.orchestra.run.smithi101.stdout: { 2023-08-01T19:55:04.809 INFO:teuthology.orchestra.run.smithi101.stdout: "event": "throttled", 2023-08-01T19:55:04.809 INFO:teuthology.orchestra.run.smithi101.stdout: "time": "2023-08-01T19:54:04.459304+0000", 2023-08-01T19:55:04.809 INFO:teuthology.orchestra.run.smithi101.stdout: "duration": 0 2023-08-01T19:55:04.809 INFO:teuthology.orchestra.run.smithi101.stdout: }, 2023-08-01T19:55:04.810 INFO:teuthology.orchestra.run.smithi101.stdout: { 2023-08-01T19:55:04.810 INFO:teuthology.orchestra.run.smithi101.stdout: "event": "header_read", 2023-08-01T19:55:04.810 INFO:teuthology.orchestra.run.smithi101.stdout: "time": "2023-08-01T19:54:04.459304+0000", 2023-08-01T19:55:04.810 INFO:teuthology.orchestra.run.smithi101.stdout: "duration": 4294967295.9999995 2023-08-01T19:55:04.810 INFO:teuthology.orchestra.run.smithi101.stdout: }, 2023-08-01T19:55:04.810 INFO:teuthology.orchestra.run.smithi101.stdout: { 2023-08-01T19:55:04.810 INFO:teuthology.orchestra.run.smithi101.stdout: "event": "all_read", 2023-08-01T19:55:04.810 INFO:teuthology.orchestra.run.smithi101.stdout: "time": "2023-08-01T19:54:04.459306+0000", 2023-08-01T19:55:04.811 INFO:teuthology.orchestra.run.smithi101.stdout: "duration": 2.3889999999999999e-06 2023-08-01T19:55:04.811 INFO:teuthology.orchestra.run.smithi101.stdout: }, 2023-08-01T19:55:04.811 INFO:teuthology.orchestra.run.smithi101.stdout: { 2023-08-01T19:55:04.811 INFO:teuthology.orchestra.run.smithi101.stdout: "event": "dispatched", 2023-08-01T19:55:04.811 INFO:teuthology.orchestra.run.smithi101.stdout: "time": "2023-08-01T19:54:04.459314+0000", 2023-08-01T19:55:04.811 INFO:teuthology.orchestra.run.smithi101.stdout: "duration": 7.1180000000000003e-06 2023-08-01T19:55:04.811 INFO:teuthology.orchestra.run.smithi101.stdout: }, 2023-08-01T19:55:04.811 INFO:teuthology.orchestra.run.smithi101.stdout: { 2023-08-01T19:55:04.812 INFO:teuthology.orchestra.run.smithi101.stdout: "event": "queued_for_pg", 2023-08-01T19:55:04.812 INFO:teuthology.orchestra.run.smithi101.stdout: "time": "2023-08-01T19:54:04.459318+0000", 2023-08-01T19:55:04.812 INFO:teuthology.orchestra.run.smithi101.stdout: "duration": 4.0239999999999999e-06 2023-08-01T19:55:04.812 INFO:teuthology.orchestra.run.smithi101.stdout: }, 2023-08-01T19:55:04.812 INFO:teuthology.orchestra.run.smithi101.stdout: { 2023-08-01T19:55:04.812 INFO:teuthology.orchestra.run.smithi101.stdout: "event": "reached_pg", 2023-08-01T19:55:04.812 INFO:teuthology.orchestra.run.smithi101.stdout: "time": "2023-08-01T19:54:04.459340+0000", 2023-08-01T19:55:04.813 INFO:teuthology.orchestra.run.smithi101.stdout: "duration": 2.2476e-05 2023-08-01T19:55:04.813 INFO:teuthology.orchestra.run.smithi101.stdout: }, 2023-08-01T19:55:04.813 INFO:teuthology.orchestra.run.smithi101.stdout: { 2023-08-01T19:55:04.813 INFO:teuthology.orchestra.run.smithi101.stdout: "event": "waiting_for_map not empty", 2023-08-01T19:55:04.813 INFO:teuthology.orchestra.run.smithi101.stdout: "time": "2023-08-01T19:54:04.459342+0000", 2023-08-01T19:55:04.813 INFO:teuthology.orchestra.run.smithi101.stdout: "duration": 2.272e-06 2023-08-01T19:55:04.813 INFO:teuthology.orchestra.run.smithi101.stdout: }, 2023-08-01T19:55:04.813 INFO:teuthology.orchestra.run.smithi101.stdout: { 2023-08-01T19:55:04.814 INFO:teuthology.orchestra.run.smithi101.stdout: "event": "reached_pg", 2023-08-01T19:55:04.814 INFO:teuthology.orchestra.run.smithi101.stdout: "time": "2023-08-01T19:54:04.475922+0000", 2023-08-01T19:55:04.814 INFO:teuthology.orchestra.run.smithi101.stdout: "duration": 0.016579388 2023-08-01T19:55:04.814 INFO:teuthology.orchestra.run.smithi101.stdout: }, 2023-08-01T19:55:04.814 INFO:teuthology.orchestra.run.smithi101.stdout: { 2023-08-01T19:55:04.814 INFO:teuthology.orchestra.run.smithi101.stdout: "event": "started", 2023-08-01T19:55:04.814 INFO:teuthology.orchestra.run.smithi101.stdout: "time": "2023-08-01T19:54:04.476107+0000", 2023-08-01T19:55:04.814 INFO:teuthology.orchestra.run.smithi101.stdout: "duration": 0.00018486300000000001 2023-08-01T19:55:04.815 INFO:teuthology.orchestra.run.smithi101.stdout: }, 2023-08-01T19:55:04.815 INFO:teuthology.orchestra.run.smithi101.stdout: { 2023-08-01T19:55:04.815 INFO:teuthology.orchestra.run.smithi101.stdout: "event": "done", 2023-08-01T19:55:04.815 INFO:teuthology.orchestra.run.smithi101.stdout: "time": "2023-08-01T19:54:04.480415+0000", 2023-08-01T19:55:04.815 INFO:teuthology.orchestra.run.smithi101.stdout: "duration": 0.0043084589999999997 2023-08-01T19:55:04.815 INFO:teuthology.orchestra.run.smithi101.stdout: } 2023-08-01T19:55:04.815 INFO:teuthology.orchestra.run.smithi101.stdout: ] 2023-08-01T19:55:04.815 INFO:teuthology.orchestra.run.smithi101.stdout: } 2023-08-01T19:55:04.816 INFO:teuthology.orchestra.run.smithi101.stdout: }, 2023-08-01T19:55:04.816 INFO:teuthology.orchestra.run.smithi101.stdout: { 2023-08-01T19:55:04.816 INFO:teuthology.orchestra.run.smithi101.stdout: "description": "osd_op(client.4668.0:62896 5.f 5:f59d90d6:::benchmark_data_smithi006_114134_object62895:head [set-alloc-hint object_size 65536 write_size 65536,write 0~65536] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e29)", 2023-08-01T19:55:04.816 INFO:teuthology.orchestra.run.smithi101.stdout: "initiated_at": "2023-08-01T19:54:46.254123+0000", 2023-08-01T19:55:04.816 INFO:teuthology.orchestra.run.smithi101.stdout: "age": 18.306756825000001, 2023-08-01T19:55:04.816 INFO:teuthology.orchestra.run.smithi101.stdout: "duration": 0.018097106000000002, 2023-08-01T19:55:04.816 INFO:teuthology.orchestra.run.smithi101.stdout: "type_data": { 2023-08-01T19:55:04.816 INFO:teuthology.orchestra.run.smithi101.stdout: "flag_point": "commit sent; apply or cleanup", 2023-08-01T19:55:04.817 INFO:teuthology.orchestra.run.smithi101.stdout: "client_info": { 2023-08-01T19:55:04.817 INFO:teuthology.orchestra.run.smithi101.stdout: "client": "client.4668", 2023-08-01T19:55:04.817 INFO:teuthology.orchestra.run.smithi101.stdout: "client_addr": "172.21.15.6:0/1709472247", 2023-08-01T19:55:04.817 INFO:teuthology.orchestra.run.smithi101.stdout: "tid": 62896 2023-08-01T19:55:04.817 INFO:teuthology.orchestra.run.smithi101.stdout: }, 2023-08-01T19:55:04.817 INFO:teuthology.orchestra.run.smithi101.stdout: "events": [ 2023-08-01T19:55:04.817 INFO:teuthology.orchestra.run.smithi101.stdout: { 2023-08-01T19:55:04.817 INFO:teuthology.orchestra.run.smithi101.stdout: "event": "initiated", 2023-08-01T19:55:04.818 INFO:teuthology.orchestra.run.smithi101.stdout: "time": "2023-08-01T19:54:46.254123+0000", 2023-08-01T19:55:04.818 INFO:teuthology.orchestra.run.smithi101.stdout: "duration": 0 2023-08-01T19:55:04.818 INFO:teuthology.orchestra.run.smithi101.stdout: }, 2023-08-01T19:55:04.818 INFO:teuthology.orchestra.run.smithi101.stdout: { 2023-08-01T19:55:04.818 INFO:teuthology.orchestra.run.smithi101.stdout: "event": "throttled", 2023-08-01T19:55:04.818 INFO:teuthology.orchestra.run.smithi101.stdout: "time": "2023-08-01T19:54:46.254123+0000", 2023-08-01T19:55:04.818 INFO:teuthology.orchestra.run.smithi101.stdout: "duration": 0 2023-08-01T19:55:04.818 INFO:teuthology.orchestra.run.smithi101.stdout: }, 2023-08-01T19:55:04.819 INFO:teuthology.orchestra.run.smithi101.stdout: { 2023-08-01T19:55:04.819 INFO:teuthology.orchestra.run.smithi101.stdout: "event": "header_read", 2023-08-01T19:55:04.819 INFO:teuthology.orchestra.run.smithi101.stdout: "time": "2023-08-01T19:54:46.254122+0000", 2023-08-01T19:55:04.819 INFO:teuthology.orchestra.run.smithi101.stdout: "duration": 4294967295.999999 2023-08-01T19:55:04.819 INFO:teuthology.orchestra.run.smithi101.stdout: }, 2023-08-01T19:55:04.819 INFO:teuthology.orchestra.run.smithi101.stdout: { 2023-08-01T19:55:04.819 INFO:teuthology.orchestra.run.smithi101.stdout: "event": "all_read", 2023-08-01T19:55:04.819 INFO:teuthology.orchestra.run.smithi101.stdout: "time": "2023-08-01T19:54:46.254214+0000", 2023-08-01T19:55:04.820 INFO:teuthology.orchestra.run.smithi101.stdout: "duration": 9.1421000000000004e-05 2023-08-01T19:55:04.820 INFO:teuthology.orchestra.run.smithi101.stdout: }, 2023-08-01T19:55:04.820 INFO:teuthology.orchestra.run.smithi101.stdout: { 2023-08-01T19:55:04.820 INFO:teuthology.orchestra.run.smithi101.stdout: "event": "dispatched", 2023-08-01T19:55:04.820 INFO:teuthology.orchestra.run.smithi101.stdout: "time": "2023-08-01T19:54:46.254222+0000", 2023-08-01T19:55:04.820 INFO:teuthology.orchestra.run.smithi101.stdout: "duration": 8.6100000000000006e-06 2023-08-01T19:55:04.820 INFO:teuthology.orchestra.run.smithi101.stdout: }, 2023-08-01T19:55:04.820 INFO:teuthology.orchestra.run.smithi101.stdout: { 2023-08-01T19:55:04.821 INFO:teuthology.orchestra.run.smithi101.stdout: "event": "queued_for_pg", 2023-08-01T19:55:04.821 INFO:teuthology.orchestra.run.smithi101.stdout: "time": "2023-08-01T19:54:46.254228+0000", 2023-08-01T19:55:04.821 INFO:teuthology.orchestra.run.smithi101.stdout: "duration": 5.5840000000000002e-06 2023-08-01T19:55:04.821 INFO:teuthology.orchestra.run.smithi101.stdout: }, 2023-08-01T19:55:04.821 INFO:teuthology.orchestra.run.smithi101.stdout: { 2023-08-01T19:55:04.821 INFO:teuthology.orchestra.run.smithi101.stdout: "event": "reached_pg", 2023-08-01T19:55:04.821 INFO:teuthology.orchestra.run.smithi101.stdout: "time": "2023-08-01T19:54:46.254259+0000", 2023-08-01T19:55:04.821 INFO:teuthology.orchestra.run.smithi101.stdout: "duration": 3.0580999999999997e-05 2023-08-01T19:55:04.822 INFO:teuthology.orchestra.run.smithi101.stdout: }, 2023-08-01T19:55:04.822 INFO:teuthology.orchestra.run.smithi101.stdout: { 2023-08-01T19:55:04.822 INFO:teuthology.orchestra.run.smithi101.stdout: "event": "started", 2023-08-01T19:55:04.822 INFO:teuthology.orchestra.run.smithi101.stdout: "time": "2023-08-01T19:54:46.254342+0000", 2023-08-01T19:55:04.822 INFO:teuthology.orchestra.run.smithi101.stdout: "duration": 8.3183999999999995e-05 2023-08-01T19:55:04.822 INFO:teuthology.orchestra.run.smithi101.stdout: }, 2023-08-01T19:55:04.822 INFO:teuthology.orchestra.run.smithi101.stdout: { 2023-08-01T19:55:04.823 INFO:teuthology.orchestra.run.smithi101.stdout: "event": "waiting for subops from 2", 2023-08-01T19:55:04.823 INFO:teuthology.orchestra.run.smithi101.stdout: "time": "2023-08-01T19:54:46.254422+0000", 2023-08-01T19:55:04.823 INFO:teuthology.orchestra.run.smithi101.stdout: "duration": 7.9703000000000006e-05 2023-08-01T19:55:04.823 INFO:teuthology.orchestra.run.smithi101.stdout: }, 2023-08-01T19:55:04.823 INFO:teuthology.orchestra.run.smithi101.stdout: { 2023-08-01T19:55:04.823 INFO:teuthology.orchestra.run.smithi101.stdout: "event": "sub_op_commit_rec", 2023-08-01T19:55:04.823 INFO:teuthology.orchestra.run.smithi101.stdout: "time": "2023-08-01T19:54:46.259940+0000", 2023-08-01T19:55:04.823 INFO:teuthology.orchestra.run.smithi101.stdout: "duration": 0.0055188650000000004 2023-08-01T19:55:04.824 INFO:teuthology.orchestra.run.smithi101.stdout: }, 2023-08-01T19:55:04.824 INFO:teuthology.orchestra.run.smithi101.stdout: { 2023-08-01T19:55:04.824 INFO:teuthology.orchestra.run.smithi101.stdout: "event": "op_commit", 2023-08-01T19:55:04.824 INFO:teuthology.orchestra.run.smithi101.stdout: "time": "2023-08-01T19:54:46.272127+0000", 2023-08-01T19:55:04.824 INFO:teuthology.orchestra.run.smithi101.stdout: "duration": 0.012186463 2023-08-01T19:55:04.824 INFO:teuthology.orchestra.run.smithi101.stdout: }, 2023-08-01T19:55:04.824 INFO:teuthology.orchestra.run.smithi101.stdout: { 2023-08-01T19:55:04.824 INFO:teuthology.orchestra.run.smithi101.stdout: "event": "commit_sent", 2023-08-01T19:55:04.825 INFO:teuthology.orchestra.run.smithi101.stdout: "time": "2023-08-01T19:54:46.272178+0000", 2023-08-01T19:55:04.825 INFO:teuthology.orchestra.run.smithi101.stdout: "duration": 5.1332000000000003e-05 2023-08-01T19:55:04.825 INFO:teuthology.orchestra.run.smithi101.stdout: }, 2023-08-01T19:55:04.825 INFO:teuthology.orchestra.run.smithi101.stdout: { 2023-08-01T19:55:04.825 INFO:teuthology.orchestra.run.smithi101.stdout: "event": "done", 2023-08-01T19:55:04.825 INFO:teuthology.orchestra.run.smithi101.stdout: "time": "2023-08-01T19:54:46.272220+0000", 2023-08-01T19:55:04.825 INFO:teuthology.orchestra.run.smithi101.stdout: "duration": 4.2227000000000001e-05 2023-08-01T19:55:04.825 INFO:teuthology.orchestra.run.smithi101.stdout: } 2023-08-01T19:55:04.826 INFO:teuthology.orchestra.run.smithi101.stdout: ] 2023-08-01T19:55:04.826 INFO:teuthology.orchestra.run.smithi101.stdout: } 2023-08-01T19:55:04.826 INFO:teuthology.orchestra.run.smithi101.stdout: }, 2023-08-01T19:55:04.826 INFO:teuthology.orchestra.run.smithi101.stdout: { 2023-08-01T19:55:04.826 INFO:teuthology.orchestra.run.smithi101.stdout: "description": "osd_op(client.4668.0:62898 5.f 5:fa45093a:::benchmark_data_smithi006_114134_object62897:head [set-alloc-hint object_size 65536 write_size 65536,write 0~65536] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e29)", 2023-08-01T19:55:04.826 INFO:teuthology.orchestra.run.smithi101.stdout: "initiated_at": "2023-08-01T19:54:46.254356+0000", 2023-08-01T19:55:04.826 INFO:teuthology.orchestra.run.smithi101.stdout: "age": 18.306524, 2023-08-01T19:55:04.826 INFO:teuthology.orchestra.run.smithi101.stdout: "duration": 0.017950870000000001, 2023-08-01T19:55:04.827 INFO:teuthology.orchestra.run.smithi101.stdout: "type_data": { 2023-08-01T19:55:04.827 INFO:teuthology.orchestra.run.smithi101.stdout: "flag_point": "commit sent; apply or cleanup", 2023-08-01T19:55:04.827 INFO:teuthology.orchestra.run.smithi101.stdout: "client_info": { 2023-08-01T19:55:04.827 INFO:teuthology.orchestra.run.smithi101.stdout: "client": "client.4668", 2023-08-01T19:55:04.827 INFO:teuthology.orchestra.run.smithi101.stdout: "client_addr": "172.21.15.6:0/1709472247", 2023-08-01T19:55:04.827 INFO:teuthology.orchestra.run.smithi101.stdout: "tid": 62898 2023-08-01T19:55:04.827 INFO:teuthology.orchestra.run.smithi101.stdout: }, 2023-08-01T19:55:04.827 INFO:teuthology.orchestra.run.smithi101.stdout: "events": [ 2023-08-01T19:55:04.828 INFO:teuthology.orchestra.run.smithi101.stdout: { 2023-08-01T19:55:04.828 INFO:teuthology.orchestra.run.smithi101.stdout: "event": "initiated", 2023-08-01T19:55:04.828 INFO:teuthology.orchestra.run.smithi101.stdout: "time": "2023-08-01T19:54:46.254356+0000", 2023-08-01T19:55:04.828 INFO:teuthology.orchestra.run.smithi101.stdout: "duration": 0 2023-08-01T19:55:04.828 INFO:teuthology.orchestra.run.smithi101.stdout: }, 2023-08-01T19:55:04.828 INFO:teuthology.orchestra.run.smithi101.stdout: { 2023-08-01T19:55:04.828 INFO:teuthology.orchestra.run.smithi101.stdout: "event": "throttled", 2023-08-01T19:55:04.828 INFO:teuthology.orchestra.run.smithi101.stdout: "time": "2023-08-01T19:54:46.254356+0000", 2023-08-01T19:55:04.829 INFO:teuthology.orchestra.run.smithi101.stdout: "duration": 0 2023-08-01T19:55:04.829 INFO:teuthology.orchestra.run.smithi101.stdout: }, 2023-08-01T19:55:04.829 INFO:teuthology.orchestra.run.smithi101.stdout: { 2023-08-01T19:55:04.829 INFO:teuthology.orchestra.run.smithi101.stdout: "event": "header_read", 2023-08-01T19:55:04.829 INFO:teuthology.orchestra.run.smithi101.stdout: "time": "2023-08-01T19:54:46.254355+0000", 2023-08-01T19:55:04.829 INFO:teuthology.orchestra.run.smithi101.stdout: "duration": 4294967295.9999995 2023-08-01T19:55:04.829 INFO:teuthology.orchestra.run.smithi101.stdout: }, 2023-08-01T19:55:04.829 INFO:teuthology.orchestra.run.smithi101.stdout: { 2023-08-01T19:55:04.830 INFO:teuthology.orchestra.run.smithi101.stdout: "event": "all_read", 2023-08-01T19:55:04.830 INFO:teuthology.orchestra.run.smithi101.stdout: "time": "2023-08-01T19:54:46.254415+0000", 2023-08-01T19:55:04.830 INFO:teuthology.orchestra.run.smithi101.stdout: "duration": 5.9713999999999998e-05 2023-08-01T19:55:04.830 INFO:teuthology.orchestra.run.smithi101.stdout: }, 2023-08-01T19:55:04.830 INFO:teuthology.orchestra.run.smithi101.stdout: { 2023-08-01T19:55:04.830 INFO:teuthology.orchestra.run.smithi101.stdout: "event": "dispatched", 2023-08-01T19:55:04.830 INFO:teuthology.orchestra.run.smithi101.stdout: "time": "2023-08-01T19:54:46.254423+0000", 2023-08-01T19:55:04.830 INFO:teuthology.orchestra.run.smithi101.stdout: "duration": 7.8399999999999995e-06 2023-08-01T19:55:04.831 INFO:teuthology.orchestra.run.smithi101.stdout: }, 2023-08-01T19:55:04.831 INFO:teuthology.orchestra.run.smithi101.stdout: { 2023-08-01T19:55:04.831 INFO:teuthology.orchestra.run.smithi101.stdout: "event": "queued_for_pg", 2023-08-01T19:55:04.831 INFO:teuthology.orchestra.run.smithi101.stdout: "time": "2023-08-01T19:54:46.254428+0000", 2023-08-01T19:55:04.831 INFO:teuthology.orchestra.run.smithi101.stdout: "duration": 4.5040000000000004e-06 2023-08-01T19:55:04.831 INFO:teuthology.orchestra.run.smithi101.stdout: }, 2023-08-01T19:55:04.831 INFO:teuthology.orchestra.run.smithi101.stdout: { 2023-08-01T19:55:04.831 INFO:teuthology.orchestra.run.smithi101.stdout: "event": "reached_pg", 2023-08-01T19:55:04.832 INFO:teuthology.orchestra.run.smithi101.stdout: "time": "2023-08-01T19:54:46.255926+0000", 2023-08-01T19:55:04.832 INFO:teuthology.orchestra.run.smithi101.stdout: "duration": 0.001498741 2023-08-01T19:55:04.832 INFO:teuthology.orchestra.run.smithi101.stdout: }, 2023-08-01T19:55:04.832 INFO:teuthology.orchestra.run.smithi101.stdout: { 2023-08-01T19:55:04.832 INFO:teuthology.orchestra.run.smithi101.stdout: "event": "started", 2023-08-01T19:55:04.832 INFO:teuthology.orchestra.run.smithi101.stdout: "time": "2023-08-01T19:54:46.256006+0000", 2023-08-01T19:55:04.832 INFO:teuthology.orchestra.run.smithi101.stdout: "duration": 8.0185000000000006e-05 2023-08-01T19:55:04.833 INFO:teuthology.orchestra.run.smithi101.stdout: }, 2023-08-01T19:55:04.833 INFO:teuthology.orchestra.run.smithi101.stdout: { 2023-08-01T19:55:04.833 INFO:teuthology.orchestra.run.smithi101.stdout: "event": "waiting for subops from 2", 2023-08-01T19:55:04.833 INFO:teuthology.orchestra.run.smithi101.stdout: "time": "2023-08-01T19:54:46.256158+0000", 2023-08-01T19:55:04.833 INFO:teuthology.orchestra.run.smithi101.stdout: "duration": 0.00015124 2023-08-01T19:55:04.833 INFO:teuthology.orchestra.run.smithi101.stdout: }, 2023-08-01T19:55:04.833 INFO:teuthology.orchestra.run.smithi101.stdout: { 2023-08-01T19:55:04.833 INFO:teuthology.orchestra.run.smithi101.stdout: "event": "sub_op_commit_rec", 2023-08-01T19:55:04.834 INFO:teuthology.orchestra.run.smithi101.stdout: "time": "2023-08-01T19:54:46.260449+0000", 2023-08-01T19:55:04.834 INFO:teuthology.orchestra.run.smithi101.stdout: "duration": 0.0042917179999999999 2023-08-01T19:55:04.834 INFO:teuthology.orchestra.run.smithi101.stdout: }, 2023-08-01T19:55:04.834 INFO:teuthology.orchestra.run.smithi101.stdout: { 2023-08-01T19:55:04.834 INFO:teuthology.orchestra.run.smithi101.stdout: "event": "op_commit", 2023-08-01T19:55:04.834 INFO:teuthology.orchestra.run.smithi101.stdout: "time": "2023-08-01T19:54:46.272229+0000", 2023-08-01T19:55:04.834 INFO:teuthology.orchestra.run.smithi101.stdout: "duration": 0.011779243999999999 2023-08-01T19:55:04.834 INFO:teuthology.orchestra.run.smithi101.stdout: }, 2023-08-01T19:55:04.835 INFO:teuthology.orchestra.run.smithi101.stdout: { 2023-08-01T19:55:04.835 INFO:teuthology.orchestra.run.smithi101.stdout: "event": "commit_sent", 2023-08-01T19:55:04.835 INFO:teuthology.orchestra.run.smithi101.stdout: "time": "2023-08-01T19:54:46.272270+0000", 2023-08-01T19:55:04.835 INFO:teuthology.orchestra.run.smithi101.stdout: "duration": 4.1516e-05 2023-08-01T19:55:04.835 INFO:teuthology.orchestra.run.smithi101.stdout: }, 2023-08-01T19:55:04.835 INFO:teuthology.orchestra.run.smithi101.stdout: { 2023-08-01T19:55:04.835 INFO:teuthology.orchestra.run.smithi101.stdout: "event": "done", 2023-08-01T19:55:04.835 INFO:teuthology.orchestra.run.smithi101.stdout: "time": "2023-08-01T19:54:46.272307+0000", 2023-08-01T19:55:04.836 INFO:teuthology.orchestra.run.smithi101.stdout: "duration": 3.6813000000000001e-05 2023-08-01T19:55:04.836 INFO:teuthology.orchestra.run.smithi101.stdout: } 2023-08-01T19:55:04.836 INFO:teuthology.orchestra.run.smithi101.stdout: ] 2023-08-01T19:55:04.836 INFO:teuthology.orchestra.run.smithi101.stdout: } 2023-08-01T19:55:04.836 INFO:teuthology.orchestra.run.smithi101.stdout: }, 2023-08-01T19:55:04.836 INFO:teuthology.orchestra.run.smithi101.stdout: { 2023-08-01T19:55:04.836 INFO:teuthology.orchestra.run.smithi101.stdout: "description": "osd_op(client.4668.0:70878 5.2 5:49b7d2be:::benchmark_data_smithi006_114134_object70877:head [set-alloc-hint object_size 65536 write_size 65536,write 0~65536] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e30)", 2023-08-01T19:55:04.836 INFO:teuthology.orchestra.run.smithi101.stdout: "initiated_at": "2023-08-01T19:54:50.210223+0000", 2023-08-01T19:55:04.837 INFO:teuthology.orchestra.run.smithi101.stdout: "age": 14.350657149, 2023-08-01T19:55:04.837 INFO:teuthology.orchestra.run.smithi101.stdout: "duration": 0.019884895, 2023-08-01T19:55:04.837 INFO:teuthology.orchestra.run.smithi101.stdout: "type_data": { 2023-08-01T19:55:04.837 INFO:teuthology.orchestra.run.smithi101.stdout: "flag_point": "commit sent; apply or cleanup", 2023-08-01T19:55:04.837 INFO:teuthology.orchestra.run.smithi101.stdout: "client_info": { 2023-08-01T19:55:04.837 INFO:teuthology.orchestra.run.smithi101.stdout: "client": "client.4668", 2023-08-01T19:55:04.837 INFO:teuthology.orchestra.run.smithi101.stdout: "client_addr": "172.21.15.6:0/1709472247", 2023-08-01T19:55:04.837 INFO:teuthology.orchestra.run.smithi101.stdout: "tid": 70878 2023-08-01T19:55:04.838 INFO:teuthology.orchestra.run.smithi101.stdout: }, 2023-08-01T19:55:04.838 INFO:teuthology.orchestra.run.smithi101.stdout: "events": [ 2023-08-01T19:55:04.838 INFO:teuthology.orchestra.run.smithi101.stdout: { 2023-08-01T19:55:04.838 INFO:teuthology.orchestra.run.smithi101.stdout: "event": "initiated", 2023-08-01T19:55:04.838 INFO:teuthology.orchestra.run.smithi101.stdout: "time": "2023-08-01T19:54:50.210223+0000", 2023-08-01T19:55:04.838 INFO:teuthology.orchestra.run.smithi101.stdout: "duration": 0 2023-08-01T19:55:04.838 INFO:teuthology.orchestra.run.smithi101.stdout: }, 2023-08-01T19:55:04.838 INFO:teuthology.orchestra.run.smithi101.stdout: { 2023-08-01T19:55:04.839 INFO:teuthology.orchestra.run.smithi101.stdout: "event": "throttled", 2023-08-01T19:55:04.839 INFO:teuthology.orchestra.run.smithi101.stdout: "time": "2023-08-01T19:54:50.210223+0000", 2023-08-01T19:55:04.839 INFO:teuthology.orchestra.run.smithi101.stdout: "duration": 0 2023-08-01T19:55:04.839 INFO:teuthology.orchestra.run.smithi101.stdout: }, 2023-08-01T19:55:04.839 INFO:teuthology.orchestra.run.smithi101.stdout: { 2023-08-01T19:55:04.839 INFO:teuthology.orchestra.run.smithi101.stdout: "event": "header_read", 2023-08-01T19:55:04.839 INFO:teuthology.orchestra.run.smithi101.stdout: "time": "2023-08-01T19:54:50.210222+0000", 2023-08-01T19:55:04.839 INFO:teuthology.orchestra.run.smithi101.stdout: "duration": 4294967295.999999 2023-08-01T19:55:04.840 INFO:teuthology.orchestra.run.smithi101.stdout: }, 2023-08-01T19:55:04.840 INFO:teuthology.orchestra.run.smithi101.stdout: { 2023-08-01T19:55:04.840 INFO:teuthology.orchestra.run.smithi101.stdout: "event": "all_read", 2023-08-01T19:55:04.840 INFO:teuthology.orchestra.run.smithi101.stdout: "time": "2023-08-01T19:54:50.210315+0000", 2023-08-01T19:55:04.840 INFO:teuthology.orchestra.run.smithi101.stdout: "duration": 9.2567999999999999e-05 2023-08-01T19:55:04.840 INFO:teuthology.orchestra.run.smithi101.stdout: }, 2023-08-01T19:55:04.840 INFO:teuthology.orchestra.run.smithi101.stdout: { 2023-08-01T19:55:04.840 INFO:teuthology.orchestra.run.smithi101.stdout: "event": "dispatched", 2023-08-01T19:55:04.841 INFO:teuthology.orchestra.run.smithi101.stdout: "time": "2023-08-01T19:54:50.210326+0000", 2023-08-01T19:55:04.841 INFO:teuthology.orchestra.run.smithi101.stdout: "duration": 1.1430000000000001e-05 2023-08-01T19:55:04.841 INFO:teuthology.orchestra.run.smithi101.stdout: }, 2023-08-01T19:55:04.841 INFO:teuthology.orchestra.run.smithi101.stdout: { 2023-08-01T19:55:04.841 INFO:teuthology.orchestra.run.smithi101.stdout: "event": "queued_for_pg", 2023-08-01T19:55:04.841 INFO:teuthology.orchestra.run.smithi101.stdout: "time": "2023-08-01T19:54:50.210332+0000", 2023-08-01T19:55:04.841 INFO:teuthology.orchestra.run.smithi101.stdout: "duration": 5.8479999999999997e-06 2023-08-01T19:55:04.841 INFO:teuthology.orchestra.run.smithi101.stdout: }, 2023-08-01T19:55:04.842 INFO:teuthology.orchestra.run.smithi101.stdout: { 2023-08-01T19:55:04.842 INFO:teuthology.orchestra.run.smithi101.stdout: "event": "reached_pg", 2023-08-01T19:55:04.842 INFO:teuthology.orchestra.run.smithi101.stdout: "time": "2023-08-01T19:54:50.214259+0000", 2023-08-01T19:55:04.842 INFO:teuthology.orchestra.run.smithi101.stdout: "duration": 0.003926789 2023-08-01T19:55:04.842 INFO:teuthology.orchestra.run.smithi101.stdout: }, 2023-08-01T19:55:04.842 INFO:teuthology.orchestra.run.smithi101.stdout: { 2023-08-01T19:55:04.842 INFO:teuthology.orchestra.run.smithi101.stdout: "event": "started", 2023-08-01T19:55:04.842 INFO:teuthology.orchestra.run.smithi101.stdout: "time": "2023-08-01T19:54:50.214387+0000", 2023-08-01T19:55:04.843 INFO:teuthology.orchestra.run.smithi101.stdout: "duration": 0.00012787599999999999 2023-08-01T19:55:04.843 INFO:teuthology.orchestra.run.smithi101.stdout: }, 2023-08-01T19:55:04.843 INFO:teuthology.orchestra.run.smithi101.stdout: { 2023-08-01T19:55:04.843 INFO:teuthology.orchestra.run.smithi101.stdout: "event": "waiting for subops from 0", 2023-08-01T19:55:04.843 INFO:teuthology.orchestra.run.smithi101.stdout: "time": "2023-08-01T19:54:50.214536+0000", 2023-08-01T19:55:04.843 INFO:teuthology.orchestra.run.smithi101.stdout: "duration": 0.00014935299999999999 2023-08-01T19:55:04.843 INFO:teuthology.orchestra.run.smithi101.stdout: }, 2023-08-01T19:55:04.843 INFO:teuthology.orchestra.run.smithi101.stdout: { 2023-08-01T19:55:04.844 INFO:teuthology.orchestra.run.smithi101.stdout: "event": "op_commit", 2023-08-01T19:55:04.844 INFO:teuthology.orchestra.run.smithi101.stdout: "time": "2023-08-01T19:54:50.217739+0000", 2023-08-01T19:55:04.844 INFO:teuthology.orchestra.run.smithi101.stdout: "duration": 0.0032034619999999998 2023-08-01T19:55:04.844 INFO:teuthology.orchestra.run.smithi101.stdout: }, 2023-08-01T19:55:04.844 INFO:teuthology.orchestra.run.smithi101.stdout: { 2023-08-01T19:55:04.844 INFO:teuthology.orchestra.run.smithi101.stdout: "event": "sub_op_commit_rec", 2023-08-01T19:55:04.844 INFO:teuthology.orchestra.run.smithi101.stdout: "time": "2023-08-01T19:54:50.230032+0000", 2023-08-01T19:55:04.845 INFO:teuthology.orchestra.run.smithi101.stdout: "duration": 0.012293068000000001 2023-08-01T19:55:04.845 INFO:teuthology.orchestra.run.smithi101.stdout: }, 2023-08-01T19:55:04.845 INFO:teuthology.orchestra.run.smithi101.stdout: { 2023-08-01T19:55:04.845 INFO:teuthology.orchestra.run.smithi101.stdout: "event": "commit_sent", 2023-08-01T19:55:04.845 INFO:teuthology.orchestra.run.smithi101.stdout: "time": "2023-08-01T19:54:50.230075+0000", 2023-08-01T19:55:04.845 INFO:teuthology.orchestra.run.smithi101.stdout: "duration": 4.3062999999999997e-05 2023-08-01T19:55:04.845 INFO:teuthology.orchestra.run.smithi101.stdout: }, 2023-08-01T19:55:04.845 INFO:teuthology.orchestra.run.smithi101.stdout: { 2023-08-01T19:55:04.846 INFO:teuthology.orchestra.run.smithi101.stdout: "event": "done", 2023-08-01T19:55:04.846 INFO:teuthology.orchestra.run.smithi101.stdout: "time": "2023-08-01T19:54:50.230108+0000", 2023-08-01T19:55:04.846 INFO:teuthology.orchestra.run.smithi101.stdout: "duration": 3.2366999999999997e-05 2023-08-01T19:55:04.846 INFO:teuthology.orchestra.run.smithi101.stdout: } 2023-08-01T19:55:04.846 INFO:teuthology.orchestra.run.smithi101.stdout: ] 2023-08-01T19:55:04.846 INFO:teuthology.orchestra.run.smithi101.stdout: } 2023-08-01T19:55:04.846 INFO:teuthology.orchestra.run.smithi101.stdout: }, 2023-08-01T19:55:04.846 INFO:teuthology.orchestra.run.smithi101.stdout: { 2023-08-01T19:55:04.847 INFO:teuthology.orchestra.run.smithi101.stdout: "description": "osd_op(client.4668.0:73460 5.f 5:ff4f0704:::benchmark_data_smithi006_114134_object73459:head [set-alloc-hint object_size 65536 write_size 65536,write 0~65536] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e31)", 2023-08-01T19:55:04.847 INFO:teuthology.orchestra.run.smithi101.stdout: "initiated_at": "2023-08-01T19:54:51.462968+0000", 2023-08-01T19:55:04.847 INFO:teuthology.orchestra.run.smithi101.stdout: "age": 13.09791227, 2023-08-01T19:55:04.847 INFO:teuthology.orchestra.run.smithi101.stdout: "duration": 0.020056502, 2023-08-01T19:55:04.847 INFO:teuthology.orchestra.run.smithi101.stdout: "type_data": { 2023-08-01T19:55:04.847 INFO:teuthology.orchestra.run.smithi101.stdout: "flag_point": "commit sent; apply or cleanup", 2023-08-01T19:55:04.847 INFO:teuthology.orchestra.run.smithi101.stdout: "client_info": { 2023-08-01T19:55:04.847 INFO:teuthology.orchestra.run.smithi101.stdout: "client": "client.4668", 2023-08-01T19:55:04.848 INFO:teuthology.orchestra.run.smithi101.stdout: "client_addr": "172.21.15.6:0/1709472247", 2023-08-01T19:55:04.848 INFO:teuthology.orchestra.run.smithi101.stdout: "tid": 73460 2023-08-01T19:55:04.848 INFO:teuthology.orchestra.run.smithi101.stdout: }, 2023-08-01T19:55:04.848 INFO:teuthology.orchestra.run.smithi101.stdout: "events": [ 2023-08-01T19:55:04.848 INFO:teuthology.orchestra.run.smithi101.stdout: { 2023-08-01T19:55:04.848 INFO:teuthology.orchestra.run.smithi101.stdout: "event": "initiated", 2023-08-01T19:55:04.848 INFO:teuthology.orchestra.run.smithi101.stdout: "time": "2023-08-01T19:54:51.462968+0000", 2023-08-01T19:55:04.848 INFO:teuthology.orchestra.run.smithi101.stdout: "duration": 0 2023-08-01T19:55:04.849 INFO:teuthology.orchestra.run.smithi101.stdout: }, 2023-08-01T19:55:04.849 INFO:teuthology.orchestra.run.smithi101.stdout: { 2023-08-01T19:55:04.849 INFO:teuthology.orchestra.run.smithi101.stdout: "event": "throttled", 2023-08-01T19:55:04.849 INFO:teuthology.orchestra.run.smithi101.stdout: "time": "2023-08-01T19:54:51.462968+0000", 2023-08-01T19:55:04.849 INFO:teuthology.orchestra.run.smithi101.stdout: "duration": 0 2023-08-01T19:55:04.849 INFO:teuthology.orchestra.run.smithi101.stdout: }, 2023-08-01T19:55:04.849 INFO:teuthology.orchestra.run.smithi101.stdout: { 2023-08-01T19:55:04.849 INFO:teuthology.orchestra.run.smithi101.stdout: "event": "header_read", 2023-08-01T19:55:04.850 INFO:teuthology.orchestra.run.smithi101.stdout: "time": "2023-08-01T19:54:51.462967+0000", 2023-08-01T19:55:04.850 INFO:teuthology.orchestra.run.smithi101.stdout: "duration": 4294967295.999999 2023-08-01T19:55:04.850 INFO:teuthology.orchestra.run.smithi101.stdout: }, 2023-08-01T19:55:04.850 INFO:teuthology.orchestra.run.smithi101.stdout: { 2023-08-01T19:55:04.850 INFO:teuthology.orchestra.run.smithi101.stdout: "event": "all_read", 2023-08-01T19:55:04.850 INFO:teuthology.orchestra.run.smithi101.stdout: "time": "2023-08-01T19:54:51.463009+0000", 2023-08-01T19:55:04.850 INFO:teuthology.orchestra.run.smithi101.stdout: "duration": 4.2106e-05 2023-08-01T19:55:04.850 INFO:teuthology.orchestra.run.smithi101.stdout: }, 2023-08-01T19:55:04.851 INFO:teuthology.orchestra.run.smithi101.stdout: { 2023-08-01T19:55:04.851 INFO:teuthology.orchestra.run.smithi101.stdout: "event": "dispatched", 2023-08-01T19:55:04.851 INFO:teuthology.orchestra.run.smithi101.stdout: "time": "2023-08-01T19:54:51.463017+0000", 2023-08-01T19:55:04.851 INFO:teuthology.orchestra.run.smithi101.stdout: "duration": 8.1529999999999997e-06 2023-08-01T19:55:04.851 INFO:teuthology.orchestra.run.smithi101.stdout: }, 2023-08-01T19:55:04.851 INFO:teuthology.orchestra.run.smithi101.stdout: { 2023-08-01T19:55:04.851 INFO:teuthology.orchestra.run.smithi101.stdout: "event": "queued_for_pg", 2023-08-01T19:55:04.851 INFO:teuthology.orchestra.run.smithi101.stdout: "time": "2023-08-01T19:54:51.463027+0000", 2023-08-01T19:55:04.852 INFO:teuthology.orchestra.run.smithi101.stdout: "duration": 9.5659999999999996e-06 2023-08-01T19:55:04.852 INFO:teuthology.orchestra.run.smithi101.stdout: }, 2023-08-01T19:55:04.852 INFO:teuthology.orchestra.run.smithi101.stdout: { 2023-08-01T19:55:04.852 INFO:teuthology.orchestra.run.smithi101.stdout: "event": "reached_pg", 2023-08-01T19:55:04.852 INFO:teuthology.orchestra.run.smithi101.stdout: "time": "2023-08-01T19:54:51.463062+0000", 2023-08-01T19:55:04.852 INFO:teuthology.orchestra.run.smithi101.stdout: "duration": 3.5442999999999999e-05 2023-08-01T19:55:04.852 INFO:teuthology.orchestra.run.smithi101.stdout: }, 2023-08-01T19:55:04.853 INFO:teuthology.orchestra.run.smithi101.stdout: { 2023-08-01T19:55:04.853 INFO:teuthology.orchestra.run.smithi101.stdout: "event": "started", 2023-08-01T19:55:04.853 INFO:teuthology.orchestra.run.smithi101.stdout: "time": "2023-08-01T19:54:51.463198+0000", 2023-08-01T19:55:04.853 INFO:teuthology.orchestra.run.smithi101.stdout: "duration": 0.000135628 2023-08-01T19:55:04.853 INFO:teuthology.orchestra.run.smithi101.stdout: }, 2023-08-01T19:55:04.853 INFO:teuthology.orchestra.run.smithi101.stdout: { 2023-08-01T19:55:04.853 INFO:teuthology.orchestra.run.smithi101.stdout: "event": "waiting for subops from 2", 2023-08-01T19:55:04.853 INFO:teuthology.orchestra.run.smithi101.stdout: "time": "2023-08-01T19:54:51.463341+0000", 2023-08-01T19:55:04.854 INFO:teuthology.orchestra.run.smithi101.stdout: "duration": 0.00014346500000000001 2023-08-01T19:55:04.854 INFO:teuthology.orchestra.run.smithi101.stdout: }, 2023-08-01T19:55:04.854 INFO:teuthology.orchestra.run.smithi101.stdout: { 2023-08-01T19:55:04.854 INFO:teuthology.orchestra.run.smithi101.stdout: "event": "op_commit", 2023-08-01T19:55:04.854 INFO:teuthology.orchestra.run.smithi101.stdout: "time": "2023-08-01T19:54:51.472684+0000", 2023-08-01T19:55:04.854 INFO:teuthology.orchestra.run.smithi101.stdout: "duration": 0.0093427900000000001 2023-08-01T19:55:04.854 INFO:teuthology.orchestra.run.smithi101.stdout: }, 2023-08-01T19:55:04.854 INFO:teuthology.orchestra.run.smithi101.stdout: { 2023-08-01T19:55:04.855 INFO:teuthology.orchestra.run.smithi101.stdout: "event": "sub_op_commit_rec", 2023-08-01T19:55:04.855 INFO:teuthology.orchestra.run.smithi101.stdout: "time": "2023-08-01T19:54:51.482937+0000", 2023-08-01T19:55:04.855 INFO:teuthology.orchestra.run.smithi101.stdout: "duration": 0.010252557000000001 2023-08-01T19:55:04.855 INFO:teuthology.orchestra.run.smithi101.stdout: }, 2023-08-01T19:55:04.855 INFO:teuthology.orchestra.run.smithi101.stdout: { 2023-08-01T19:55:04.855 INFO:teuthology.orchestra.run.smithi101.stdout: "event": "commit_sent", 2023-08-01T19:55:04.855 INFO:teuthology.orchestra.run.smithi101.stdout: "time": "2023-08-01T19:54:51.482984+0000", 2023-08-01T19:55:04.855 INFO:teuthology.orchestra.run.smithi101.stdout: "duration": 4.7394000000000001e-05 2023-08-01T19:55:04.856 INFO:teuthology.orchestra.run.smithi101.stdout: }, 2023-08-01T19:55:04.856 INFO:teuthology.orchestra.run.smithi101.stdout: { 2023-08-01T19:55:04.856 INFO:teuthology.orchestra.run.smithi101.stdout: "event": "done", 2023-08-01T19:55:04.856 INFO:teuthology.orchestra.run.smithi101.stdout: "time": "2023-08-01T19:54:51.483024+0000", 2023-08-01T19:55:04.856 INFO:teuthology.orchestra.run.smithi101.stdout: "duration": 4.0159e-05 2023-08-01T19:55:04.856 INFO:teuthology.orchestra.run.smithi101.stdout: } 2023-08-01T19:55:04.856 INFO:teuthology.orchestra.run.smithi101.stdout: ] 2023-08-01T19:55:04.856 INFO:teuthology.orchestra.run.smithi101.stdout: } 2023-08-01T19:55:04.857 INFO:teuthology.orchestra.run.smithi101.stdout: }, 2023-08-01T19:55:04.857 INFO:teuthology.orchestra.run.smithi101.stdout: { 2023-08-01T19:55:04.857 INFO:teuthology.orchestra.run.smithi101.stdout: "description": "osd_op(client.4668.0:92726 5.2 5:41e18163:::benchmark_data_smithi006_114134_object92725:head [set-alloc-hint object_size 65536 write_size 65536,write 0~65536] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e36)", 2023-08-01T19:55:04.857 INFO:teuthology.orchestra.run.smithi101.stdout: "initiated_at": "2023-08-01T19:55:01.256971+0000", 2023-08-01T19:55:04.857 INFO:teuthology.orchestra.run.smithi101.stdout: "age": 3.3039091909999998, 2023-08-01T19:55:04.857 INFO:teuthology.orchestra.run.smithi101.stdout: "duration": 0.019854296, 2023-08-01T19:55:04.857 INFO:teuthology.orchestra.run.smithi101.stdout: "type_data": { 2023-08-01T19:55:04.857 INFO:teuthology.orchestra.run.smithi101.stdout: "flag_point": "commit sent; apply or cleanup", 2023-08-01T19:55:04.858 INFO:teuthology.orchestra.run.smithi101.stdout: "client_info": { 2023-08-01T19:55:04.858 INFO:teuthology.orchestra.run.smithi101.stdout: "client": "client.4668", 2023-08-01T19:55:04.858 INFO:teuthology.orchestra.run.smithi101.stdout: "client_addr": "172.21.15.6:0/1709472247", 2023-08-01T19:55:04.858 INFO:teuthology.orchestra.run.smithi101.stdout: "tid": 92726 2023-08-01T19:55:04.858 INFO:teuthology.orchestra.run.smithi101.stdout: }, 2023-08-01T19:55:04.858 INFO:teuthology.orchestra.run.smithi101.stdout: "events": [ 2023-08-01T19:55:04.858 INFO:teuthology.orchestra.run.smithi101.stdout: { 2023-08-01T19:55:04.858 INFO:teuthology.orchestra.run.smithi101.stdout: "event": "initiated", 2023-08-01T19:55:04.859 INFO:teuthology.orchestra.run.smithi101.stdout: "time": "2023-08-01T19:55:01.256971+0000", 2023-08-01T19:55:04.859 INFO:teuthology.orchestra.run.smithi101.stdout: "duration": 0 2023-08-01T19:55:04.859 INFO:teuthology.orchestra.run.smithi101.stdout: }, 2023-08-01T19:55:04.859 INFO:teuthology.orchestra.run.smithi101.stdout: { 2023-08-01T19:55:04.859 INFO:teuthology.orchestra.run.smithi101.stdout: "event": "throttled", 2023-08-01T19:55:04.859 INFO:teuthology.orchestra.run.smithi101.stdout: "time": "2023-08-01T19:55:01.256971+0000", 2023-08-01T19:55:04.859 INFO:teuthology.orchestra.run.smithi101.stdout: "duration": 0 2023-08-01T19:55:04.859 INFO:teuthology.orchestra.run.smithi101.stdout: }, 2023-08-01T19:55:04.860 INFO:teuthology.orchestra.run.smithi101.stdout: { 2023-08-01T19:55:04.860 INFO:teuthology.orchestra.run.smithi101.stdout: "event": "header_read", 2023-08-01T19:55:04.860 INFO:teuthology.orchestra.run.smithi101.stdout: "time": "2023-08-01T19:55:01.256970+0000", 2023-08-01T19:55:04.860 INFO:teuthology.orchestra.run.smithi101.stdout: "duration": 4294967295.9999995 2023-08-01T19:55:04.860 INFO:teuthology.orchestra.run.smithi101.stdout: }, 2023-08-01T19:55:04.860 INFO:teuthology.orchestra.run.smithi101.stdout: { 2023-08-01T19:55:04.860 INFO:teuthology.orchestra.run.smithi101.stdout: "event": "all_read", 2023-08-01T19:55:04.860 INFO:teuthology.orchestra.run.smithi101.stdout: "time": "2023-08-01T19:55:01.257057+0000", 2023-08-01T19:55:04.861 INFO:teuthology.orchestra.run.smithi101.stdout: "duration": 8.6627999999999998e-05 2023-08-01T19:55:04.861 INFO:teuthology.orchestra.run.smithi101.stdout: }, 2023-08-01T19:55:04.861 INFO:teuthology.orchestra.run.smithi101.stdout: { 2023-08-01T19:55:04.861 INFO:teuthology.orchestra.run.smithi101.stdout: "event": "dispatched", 2023-08-01T19:55:04.861 INFO:teuthology.orchestra.run.smithi101.stdout: "time": "2023-08-01T19:55:01.257063+0000", 2023-08-01T19:55:04.861 INFO:teuthology.orchestra.run.smithi101.stdout: "duration": 6.528e-06 2023-08-01T19:55:04.861 INFO:teuthology.orchestra.run.smithi101.stdout: }, 2023-08-01T19:55:04.861 INFO:teuthology.orchestra.run.smithi101.stdout: { 2023-08-01T19:55:04.862 INFO:teuthology.orchestra.run.smithi101.stdout: "event": "queued_for_pg", 2023-08-01T19:55:04.862 INFO:teuthology.orchestra.run.smithi101.stdout: "time": "2023-08-01T19:55:01.257067+0000", 2023-08-01T19:55:04.862 INFO:teuthology.orchestra.run.smithi101.stdout: "duration": 3.2739999999999999e-06 2023-08-01T19:55:04.862 INFO:teuthology.orchestra.run.smithi101.stdout: }, 2023-08-01T19:55:04.862 INFO:teuthology.orchestra.run.smithi101.stdout: { 2023-08-01T19:55:04.862 INFO:teuthology.orchestra.run.smithi101.stdout: "event": "reached_pg", 2023-08-01T19:55:04.862 INFO:teuthology.orchestra.run.smithi101.stdout: "time": "2023-08-01T19:55:01.259714+0000", 2023-08-01T19:55:04.862 INFO:teuthology.orchestra.run.smithi101.stdout: "duration": 0.0026476709999999999 2023-08-01T19:55:04.863 INFO:teuthology.orchestra.run.smithi101.stdout: }, 2023-08-01T19:55:04.863 INFO:teuthology.orchestra.run.smithi101.stdout: { 2023-08-01T19:55:04.863 INFO:teuthology.orchestra.run.smithi101.stdout: "event": "started", 2023-08-01T19:55:04.863 INFO:teuthology.orchestra.run.smithi101.stdout: "time": "2023-08-01T19:55:01.259829+0000", 2023-08-01T19:55:04.863 INFO:teuthology.orchestra.run.smithi101.stdout: "duration": 0.000114471 2023-08-01T19:55:04.863 INFO:teuthology.orchestra.run.smithi101.stdout: }, 2023-08-01T19:55:04.863 INFO:teuthology.orchestra.run.smithi101.stdout: { 2023-08-01T19:55:04.863 INFO:teuthology.orchestra.run.smithi101.stdout: "event": "waiting for subops from 0", 2023-08-01T19:55:04.864 INFO:teuthology.orchestra.run.smithi101.stdout: "time": "2023-08-01T19:55:01.259965+0000", 2023-08-01T19:55:04.864 INFO:teuthology.orchestra.run.smithi101.stdout: "duration": 0.00013597300000000001 2023-08-01T19:55:04.864 INFO:teuthology.orchestra.run.smithi101.stdout: }, 2023-08-01T19:55:04.864 INFO:teuthology.orchestra.run.smithi101.stdout: { 2023-08-01T19:55:04.864 INFO:teuthology.orchestra.run.smithi101.stdout: "event": "op_commit", 2023-08-01T19:55:04.864 INFO:teuthology.orchestra.run.smithi101.stdout: "time": "2023-08-01T19:55:01.264360+0000", 2023-08-01T19:55:04.864 INFO:teuthology.orchestra.run.smithi101.stdout: "duration": 0.0043956619999999998 2023-08-01T19:55:04.864 INFO:teuthology.orchestra.run.smithi101.stdout: }, 2023-08-01T19:55:04.865 INFO:teuthology.orchestra.run.smithi101.stdout: { 2023-08-01T19:55:04.865 INFO:teuthology.orchestra.run.smithi101.stdout: "event": "sub_op_commit_rec", 2023-08-01T19:55:04.865 INFO:teuthology.orchestra.run.smithi101.stdout: "time": "2023-08-01T19:55:01.276766+0000", 2023-08-01T19:55:04.865 INFO:teuthology.orchestra.run.smithi101.stdout: "duration": 0.012405736000000001 2023-08-01T19:55:04.865 INFO:teuthology.orchestra.run.smithi101.stdout: }, 2023-08-01T19:55:04.865 INFO:teuthology.orchestra.run.smithi101.stdout: { 2023-08-01T19:55:04.865 INFO:teuthology.orchestra.run.smithi101.stdout: "event": "commit_sent", 2023-08-01T19:55:04.866 INFO:teuthology.orchestra.run.smithi101.stdout: "time": "2023-08-01T19:55:01.276804+0000", 2023-08-01T19:55:04.866 INFO:teuthology.orchestra.run.smithi101.stdout: "duration": 3.7759999999999998e-05 2023-08-01T19:55:04.866 INFO:teuthology.orchestra.run.smithi101.stdout: }, 2023-08-01T19:55:04.866 INFO:teuthology.orchestra.run.smithi101.stdout: { 2023-08-01T19:55:04.866 INFO:teuthology.orchestra.run.smithi101.stdout: "event": "done", 2023-08-01T19:55:04.866 INFO:teuthology.orchestra.run.smithi101.stdout: "time": "2023-08-01T19:55:01.276825+0000", 2023-08-01T19:55:04.866 INFO:teuthology.orchestra.run.smithi101.stdout: "duration": 2.1299000000000001e-05 2023-08-01T19:55:04.866 INFO:teuthology.orchestra.run.smithi101.stdout: } 2023-08-01T19:55:04.867 INFO:teuthology.orchestra.run.smithi101.stdout: ] 2023-08-01T19:55:04.867 INFO:teuthology.orchestra.run.smithi101.stdout: } 2023-08-01T19:55:04.867 INFO:teuthology.orchestra.run.smithi101.stdout: } 2023-08-01T19:55:04.867 INFO:teuthology.orchestra.run.smithi101.stdout: ] 2023-08-01T19:55:04.867 INFO:teuthology.orchestra.run.smithi101.stdout:} 2023-08-01T19:55:04.867 DEBUG:teuthology.orchestra.run.smithi155:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 30 ceph --cluster ceph --admin-daemon /var/run/ceph/ceph-osd.2.asok dump_ops_in_flight 2023-08-01T19:55:04.868 INFO:tasks.ceph.osd.1.smithi101.stderr:2023-08-01T19:55:04.649+0000 7fb0cb7f6700 -1 received signal: Hangup from /usr/bin/python3 /bin/daemon-helper kill ceph-osd -f --cluster ceph -i 1 (PID: 111141) UID: 0 2023-08-01T19:55:04.870 INFO:tasks.ceph.osd.0.smithi008.stderr:2023-08-01T19:55:04.868+0000 7f16a58f4700 -1 received signal: Hangup from /usr/bin/python3 /bin/daemon-helper kill ceph-osd -f --cluster ceph -i 0 (PID: 111179) UID: 0 2023-08-01T19:55:04.970 INFO:tasks.ceph.osd.2.smithi155.stderr:2023-08-01T19:55:04.968+0000 7faa5c6ac700 -1 received signal: Hangup from /usr/bin/python3 /bin/daemon-helper kill ceph-osd -f --cluster ceph -i 2 (PID: 111337) UID: 0 2023-08-01T19:55:05.036 INFO:teuthology.orchestra.run.smithi155.stdout:{ 2023-08-01T19:55:05.036 INFO:teuthology.orchestra.run.smithi155.stdout: "ops": [ 2023-08-01T19:55:05.037 INFO:teuthology.orchestra.run.smithi155.stdout: { 2023-08-01T19:55:05.037 INFO:teuthology.orchestra.run.smithi155.stdout: "description": "osd_repop_reply(client.4668.0:99991 5.b e37/19)", 2023-08-01T19:55:05.037 INFO:teuthology.orchestra.run.smithi155.stdout: "initiated_at": "2023-08-01T19:55:05.030710+0000", 2023-08-01T19:55:05.037 INFO:teuthology.orchestra.run.smithi155.stdout: "age": 0.0022770189999999999, 2023-08-01T19:55:05.037 INFO:teuthology.orchestra.run.smithi155.stdout: "duration": 0.0023003049999999999, 2023-08-01T19:55:05.037 INFO:teuthology.orchestra.run.smithi155.stdout: "type_data": { 2023-08-01T19:55:05.037 INFO:teuthology.orchestra.run.smithi155.stdout: "flag_point": "queued for pg", 2023-08-01T19:55:05.037 INFO:teuthology.orchestra.run.smithi155.stdout: "events": [ 2023-08-01T19:55:05.038 INFO:teuthology.orchestra.run.smithi155.stdout: { 2023-08-01T19:55:05.038 INFO:teuthology.orchestra.run.smithi155.stdout: "event": "initiated", 2023-08-01T19:55:05.038 INFO:teuthology.orchestra.run.smithi155.stdout: "time": "2023-08-01T19:55:05.030710+0000", 2023-08-01T19:55:05.038 INFO:teuthology.orchestra.run.smithi155.stdout: "duration": 0 2023-08-01T19:55:05.038 INFO:teuthology.orchestra.run.smithi155.stdout: }, 2023-08-01T19:55:05.038 INFO:teuthology.orchestra.run.smithi155.stdout: { 2023-08-01T19:55:05.038 INFO:teuthology.orchestra.run.smithi155.stdout: "event": "throttled", 2023-08-01T19:55:05.039 INFO:teuthology.orchestra.run.smithi155.stdout: "time": "2023-08-01T19:55:05.030710+0000", 2023-08-01T19:55:05.039 INFO:teuthology.orchestra.run.smithi155.stdout: "duration": 0 2023-08-01T19:55:05.039 INFO:teuthology.orchestra.run.smithi155.stdout: }, 2023-08-01T19:55:05.039 INFO:teuthology.orchestra.run.smithi155.stdout: { 2023-08-01T19:55:05.039 INFO:teuthology.orchestra.run.smithi155.stdout: "event": "header_read", 2023-08-01T19:55:05.039 INFO:teuthology.orchestra.run.smithi155.stdout: "time": "2023-08-01T19:55:05.030710+0000", 2023-08-01T19:55:05.039 INFO:teuthology.orchestra.run.smithi155.stdout: "duration": 4294967295.9999995 2023-08-01T19:55:05.039 INFO:teuthology.orchestra.run.smithi155.stdout: }, 2023-08-01T19:55:05.040 INFO:teuthology.orchestra.run.smithi155.stdout: { 2023-08-01T19:55:05.040 INFO:teuthology.orchestra.run.smithi155.stdout: "event": "all_read", 2023-08-01T19:55:05.040 INFO:teuthology.orchestra.run.smithi155.stdout: "time": "2023-08-01T19:55:05.030714+0000", 2023-08-01T19:55:05.040 INFO:teuthology.orchestra.run.smithi155.stdout: "duration": 4.2560000000000004e-06 2023-08-01T19:55:05.040 INFO:teuthology.orchestra.run.smithi155.stdout: }, 2023-08-01T19:55:05.040 INFO:teuthology.orchestra.run.smithi155.stdout: { 2023-08-01T19:55:05.040 INFO:teuthology.orchestra.run.smithi155.stdout: "event": "dispatched", 2023-08-01T19:55:05.040 INFO:teuthology.orchestra.run.smithi155.stdout: "time": "2023-08-01T19:55:05.030725+0000", 2023-08-01T19:55:05.041 INFO:teuthology.orchestra.run.smithi155.stdout: "duration": 1.0727000000000001e-05 2023-08-01T19:55:05.041 INFO:teuthology.orchestra.run.smithi155.stdout: }, 2023-08-01T19:55:05.041 INFO:teuthology.orchestra.run.smithi155.stdout: { 2023-08-01T19:55:05.041 INFO:teuthology.orchestra.run.smithi155.stdout: "event": "queued_for_pg", 2023-08-01T19:55:05.041 INFO:teuthology.orchestra.run.smithi155.stdout: "time": "2023-08-01T19:55:05.030730+0000", 2023-08-01T19:55:05.041 INFO:teuthology.orchestra.run.smithi155.stdout: "duration": 4.7389999999999999e-06 2023-08-01T19:55:05.041 INFO:teuthology.orchestra.run.smithi155.stdout: } 2023-08-01T19:55:05.042 INFO:teuthology.orchestra.run.smithi155.stdout: ] 2023-08-01T19:55:05.042 INFO:teuthology.orchestra.run.smithi155.stdout: } 2023-08-01T19:55:05.042 INFO:teuthology.orchestra.run.smithi155.stdout: }, 2023-08-01T19:55:05.042 INFO:teuthology.orchestra.run.smithi155.stdout: { 2023-08-01T19:55:05.042 INFO:teuthology.orchestra.run.smithi155.stdout: "description": "osd_repop(client.4668.0:100004 5.9 e37/19 5:9bde6f2b:::benchmark_data_smithi006_114134_object100003:head v 37'6277, mlcod=37'6274)", 2023-08-01T19:55:05.042 INFO:teuthology.orchestra.run.smithi155.stdout: "initiated_at": "2023-08-01T19:55:05.031025+0000", 2023-08-01T19:55:05.042 INFO:teuthology.orchestra.run.smithi155.stdout: "age": 0.0019625340000000002, 2023-08-01T19:55:05.042 INFO:teuthology.orchestra.run.smithi155.stdout: "duration": 0.0020531030000000001, 2023-08-01T19:55:05.043 INFO:teuthology.orchestra.run.smithi155.stdout: "type_data": { 2023-08-01T19:55:05.043 INFO:teuthology.orchestra.run.smithi155.stdout: "flag_point": "started", 2023-08-01T19:55:05.043 INFO:teuthology.orchestra.run.smithi155.stdout: "events": [ 2023-08-01T19:55:05.043 INFO:teuthology.orchestra.run.smithi155.stdout: { 2023-08-01T19:55:05.043 INFO:teuthology.orchestra.run.smithi155.stdout: "event": "initiated", 2023-08-01T19:55:05.043 INFO:teuthology.orchestra.run.smithi155.stdout: "time": "2023-08-01T19:55:05.031025+0000", 2023-08-01T19:55:05.043 INFO:teuthology.orchestra.run.smithi155.stdout: "duration": 0 2023-08-01T19:55:05.043 INFO:teuthology.orchestra.run.smithi155.stdout: }, 2023-08-01T19:55:05.044 INFO:teuthology.orchestra.run.smithi155.stdout: { 2023-08-01T19:55:05.044 INFO:teuthology.orchestra.run.smithi155.stdout: "event": "throttled", 2023-08-01T19:55:05.044 INFO:teuthology.orchestra.run.smithi155.stdout: "time": "2023-08-01T19:55:05.031025+0000", 2023-08-01T19:55:05.044 INFO:teuthology.orchestra.run.smithi155.stdout: "duration": 0 2023-08-01T19:55:05.044 INFO:teuthology.orchestra.run.smithi155.stdout: }, 2023-08-01T19:55:05.044 INFO:teuthology.orchestra.run.smithi155.stdout: { 2023-08-01T19:55:05.044 INFO:teuthology.orchestra.run.smithi155.stdout: "event": "header_read", 2023-08-01T19:55:05.045 INFO:teuthology.orchestra.run.smithi155.stdout: "time": "2023-08-01T19:55:05.031024+0000", 2023-08-01T19:55:05.045 INFO:teuthology.orchestra.run.smithi155.stdout: "duration": 4294967295.9999995 2023-08-01T19:55:05.045 INFO:teuthology.orchestra.run.smithi155.stdout: }, 2023-08-01T19:55:05.045 INFO:teuthology.orchestra.run.smithi155.stdout: { 2023-08-01T19:55:05.045 INFO:teuthology.orchestra.run.smithi155.stdout: "event": "all_read", 2023-08-01T19:55:05.045 INFO:teuthology.orchestra.run.smithi155.stdout: "time": "2023-08-01T19:55:05.031096+0000", 2023-08-01T19:55:05.045 INFO:teuthology.orchestra.run.smithi155.stdout: "duration": 7.1307e-05 2023-08-01T19:55:05.045 INFO:teuthology.orchestra.run.smithi155.stdout: }, 2023-08-01T19:55:05.046 INFO:teuthology.orchestra.run.smithi155.stdout: { 2023-08-01T19:55:05.046 INFO:teuthology.orchestra.run.smithi155.stdout: "event": "dispatched", 2023-08-01T19:55:05.046 INFO:teuthology.orchestra.run.smithi155.stdout: "time": "2023-08-01T19:55:05.031107+0000", 2023-08-01T19:55:05.046 INFO:teuthology.orchestra.run.smithi155.stdout: "duration": 1.1005999999999999e-05 2023-08-01T19:55:05.046 INFO:teuthology.orchestra.run.smithi155.stdout: }, 2023-08-01T19:55:05.046 INFO:teuthology.orchestra.run.smithi155.stdout: { 2023-08-01T19:55:05.046 INFO:teuthology.orchestra.run.smithi155.stdout: "event": "queued_for_pg", 2023-08-01T19:55:05.046 INFO:teuthology.orchestra.run.smithi155.stdout: "time": "2023-08-01T19:55:05.031110+0000", 2023-08-01T19:55:05.047 INFO:teuthology.orchestra.run.smithi155.stdout: "duration": 3.856e-06 2023-08-01T19:55:05.047 INFO:teuthology.orchestra.run.smithi155.stdout: }, 2023-08-01T19:55:05.047 INFO:teuthology.orchestra.run.smithi155.stdout: { 2023-08-01T19:55:05.047 INFO:teuthology.orchestra.run.smithi155.stdout: "event": "reached_pg", 2023-08-01T19:55:05.047 INFO:teuthology.orchestra.run.smithi155.stdout: "time": "2023-08-01T19:55:05.031145+0000", 2023-08-01T19:55:05.047 INFO:teuthology.orchestra.run.smithi155.stdout: "duration": 3.4632999999999999e-05 2023-08-01T19:55:05.047 INFO:teuthology.orchestra.run.smithi155.stdout: }, 2023-08-01T19:55:05.047 INFO:teuthology.orchestra.run.smithi155.stdout: { 2023-08-01T19:55:05.048 INFO:teuthology.orchestra.run.smithi155.stdout: "event": "started", 2023-08-01T19:55:05.048 INFO:teuthology.orchestra.run.smithi155.stdout: "time": "2023-08-01T19:55:05.031158+0000", 2023-08-01T19:55:05.048 INFO:teuthology.orchestra.run.smithi155.stdout: "duration": 1.3113e-05 2023-08-01T19:55:05.048 INFO:teuthology.orchestra.run.smithi155.stdout: } 2023-08-01T19:55:05.048 INFO:teuthology.orchestra.run.smithi155.stdout: ] 2023-08-01T19:55:05.048 INFO:teuthology.orchestra.run.smithi155.stdout: } 2023-08-01T19:55:05.048 INFO:teuthology.orchestra.run.smithi155.stdout: }, 2023-08-01T19:55:05.048 INFO:teuthology.orchestra.run.smithi155.stdout: { 2023-08-01T19:55:05.049 INFO:teuthology.orchestra.run.smithi155.stdout: "description": "osd_op(client.4668.0:100008 5.d 5:b4ad954b:::benchmark_data_smithi006_114134_object100007:head [set-alloc-hint object_size 65536 write_size 65536,write 0~65536 in=65536b] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e37)", 2023-08-01T19:55:05.049 INFO:teuthology.orchestra.run.smithi155.stdout: "initiated_at": "2023-08-01T19:55:05.032205+0000", 2023-08-01T19:55:05.049 INFO:teuthology.orchestra.run.smithi155.stdout: "age": 0.00078224000000000002, 2023-08-01T19:55:05.049 INFO:teuthology.orchestra.run.smithi155.stdout: "duration": 0.00096001599999999995, 2023-08-01T19:55:05.049 INFO:teuthology.orchestra.run.smithi155.stdout: "type_data": { 2023-08-01T19:55:05.049 INFO:teuthology.orchestra.run.smithi155.stdout: "flag_point": "waiting for sub ops", 2023-08-01T19:55:05.049 INFO:teuthology.orchestra.run.smithi155.stdout: "client_info": { 2023-08-01T19:55:05.049 INFO:teuthology.orchestra.run.smithi155.stdout: "client": "client.4668", 2023-08-01T19:55:05.050 INFO:teuthology.orchestra.run.smithi155.stdout: "client_addr": "172.21.15.6:0/1709472247", 2023-08-01T19:55:05.050 INFO:teuthology.orchestra.run.smithi155.stdout: "tid": 100008 2023-08-01T19:55:05.050 INFO:teuthology.orchestra.run.smithi155.stdout: }, 2023-08-01T19:55:05.050 INFO:teuthology.orchestra.run.smithi155.stdout: "events": [ 2023-08-01T19:55:05.050 INFO:teuthology.orchestra.run.smithi155.stdout: { 2023-08-01T19:55:05.050 INFO:teuthology.orchestra.run.smithi155.stdout: "event": "initiated", 2023-08-01T19:55:05.050 INFO:teuthology.orchestra.run.smithi155.stdout: "time": "2023-08-01T19:55:05.032205+0000", 2023-08-01T19:55:05.051 INFO:teuthology.orchestra.run.smithi155.stdout: "duration": 0 2023-08-01T19:55:05.051 INFO:teuthology.orchestra.run.smithi155.stdout: }, 2023-08-01T19:55:05.051 INFO:teuthology.orchestra.run.smithi155.stdout: { 2023-08-01T19:55:05.051 INFO:teuthology.orchestra.run.smithi155.stdout: "event": "throttled", 2023-08-01T19:55:05.051 INFO:teuthology.orchestra.run.smithi155.stdout: "time": "2023-08-01T19:55:05.032205+0000", 2023-08-01T19:55:05.051 INFO:teuthology.orchestra.run.smithi155.stdout: "duration": 0 2023-08-01T19:55:05.051 INFO:teuthology.orchestra.run.smithi155.stdout: }, 2023-08-01T19:55:05.051 INFO:teuthology.orchestra.run.smithi155.stdout: { 2023-08-01T19:55:05.052 INFO:teuthology.orchestra.run.smithi155.stdout: "event": "header_read", 2023-08-01T19:55:05.052 INFO:teuthology.orchestra.run.smithi155.stdout: "time": "2023-08-01T19:55:05.032204+0000", 2023-08-01T19:55:05.052 INFO:teuthology.orchestra.run.smithi155.stdout: "duration": 4294967295.999999 2023-08-01T19:55:05.052 INFO:teuthology.orchestra.run.smithi155.stdout: }, 2023-08-01T19:55:05.052 INFO:teuthology.orchestra.run.smithi155.stdout: { 2023-08-01T19:55:05.052 INFO:teuthology.orchestra.run.smithi155.stdout: "event": "all_read", 2023-08-01T19:55:05.052 INFO:teuthology.orchestra.run.smithi155.stdout: "time": "2023-08-01T19:55:05.032258+0000", 2023-08-01T19:55:05.052 INFO:teuthology.orchestra.run.smithi155.stdout: "duration": 5.4274000000000002e-05 2023-08-01T19:55:05.053 INFO:teuthology.orchestra.run.smithi155.stdout: }, 2023-08-01T19:55:05.053 INFO:teuthology.orchestra.run.smithi155.stdout: { 2023-08-01T19:55:05.053 INFO:teuthology.orchestra.run.smithi155.stdout: "event": "dispatched", 2023-08-01T19:55:05.053 INFO:teuthology.orchestra.run.smithi155.stdout: "time": "2023-08-01T19:55:05.032270+0000", 2023-08-01T19:55:05.053 INFO:teuthology.orchestra.run.smithi155.stdout: "duration": 1.1365999999999999e-05 2023-08-01T19:55:05.053 INFO:teuthology.orchestra.run.smithi155.stdout: }, 2023-08-01T19:55:05.053 INFO:teuthology.orchestra.run.smithi155.stdout: { 2023-08-01T19:55:05.053 INFO:teuthology.orchestra.run.smithi155.stdout: "event": "queued_for_pg", 2023-08-01T19:55:05.054 INFO:teuthology.orchestra.run.smithi155.stdout: "time": "2023-08-01T19:55:05.032275+0000", 2023-08-01T19:55:05.054 INFO:teuthology.orchestra.run.smithi155.stdout: "duration": 5.5300000000000004e-06 2023-08-01T19:55:05.054 INFO:teuthology.orchestra.run.smithi155.stdout: }, 2023-08-01T19:55:05.054 INFO:teuthology.orchestra.run.smithi155.stdout: { 2023-08-01T19:55:05.054 INFO:teuthology.orchestra.run.smithi155.stdout: "event": "reached_pg", 2023-08-01T19:55:05.054 INFO:teuthology.orchestra.run.smithi155.stdout: "time": "2023-08-01T19:55:05.032319+0000", 2023-08-01T19:55:05.054 INFO:teuthology.orchestra.run.smithi155.stdout: "duration": 4.3219000000000001e-05 2023-08-01T19:55:05.054 INFO:teuthology.orchestra.run.smithi155.stdout: }, 2023-08-01T19:55:05.055 INFO:teuthology.orchestra.run.smithi155.stdout: { 2023-08-01T19:55:05.055 INFO:teuthology.orchestra.run.smithi155.stdout: "event": "started", 2023-08-01T19:55:05.055 INFO:teuthology.orchestra.run.smithi155.stdout: "time": "2023-08-01T19:55:05.032449+0000", 2023-08-01T19:55:05.055 INFO:teuthology.orchestra.run.smithi155.stdout: "duration": 0.00013062800000000001 2023-08-01T19:55:05.055 INFO:teuthology.orchestra.run.smithi155.stdout: }, 2023-08-01T19:55:05.055 INFO:teuthology.orchestra.run.smithi155.stdout: { 2023-08-01T19:55:05.055 INFO:teuthology.orchestra.run.smithi155.stdout: "event": "waiting for subops from 1", 2023-08-01T19:55:05.055 INFO:teuthology.orchestra.run.smithi155.stdout: "time": "2023-08-01T19:55:05.032599+0000", 2023-08-01T19:55:05.056 INFO:teuthology.orchestra.run.smithi155.stdout: "duration": 0.00014966 2023-08-01T19:55:05.056 INFO:teuthology.orchestra.run.smithi155.stdout: } 2023-08-01T19:55:05.056 INFO:teuthology.orchestra.run.smithi155.stdout: ] 2023-08-01T19:55:05.056 INFO:teuthology.orchestra.run.smithi155.stdout: } 2023-08-01T19:55:05.056 INFO:teuthology.orchestra.run.smithi155.stdout: }, 2023-08-01T19:55:05.056 INFO:teuthology.orchestra.run.smithi155.stdout: { 2023-08-01T19:55:05.056 INFO:teuthology.orchestra.run.smithi155.stdout: "description": "osd_op(client.4668.0:100009 5.4 5:22ec47dc:::benchmark_data_smithi006_114134_object100008:head [set-alloc-hint object_size 65536 write_size 65536,write 0~65536 in=65536b] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e37)", 2023-08-01T19:55:05.056 INFO:teuthology.orchestra.run.smithi155.stdout: "initiated_at": "2023-08-01T19:55:05.032640+0000", 2023-08-01T19:55:05.057 INFO:teuthology.orchestra.run.smithi155.stdout: "age": 0.00034765700000000002, 2023-08-01T19:55:05.057 INFO:teuthology.orchestra.run.smithi155.stdout: "duration": 0.00063919900000000002, 2023-08-01T19:55:05.057 INFO:teuthology.orchestra.run.smithi155.stdout: "type_data": { 2023-08-01T19:55:05.057 INFO:teuthology.orchestra.run.smithi155.stdout: "flag_point": "waiting for sub ops", 2023-08-01T19:55:05.057 INFO:teuthology.orchestra.run.smithi155.stdout: "client_info": { 2023-08-01T19:55:05.057 INFO:teuthology.orchestra.run.smithi155.stdout: "client": "client.4668", 2023-08-01T19:55:05.057 INFO:teuthology.orchestra.run.smithi155.stdout: "client_addr": "172.21.15.6:0/1709472247", 2023-08-01T19:55:05.058 INFO:teuthology.orchestra.run.smithi155.stdout: "tid": 100009 2023-08-01T19:55:05.058 INFO:teuthology.orchestra.run.smithi155.stdout: }, 2023-08-01T19:55:05.058 INFO:teuthology.orchestra.run.smithi155.stdout: "events": [ 2023-08-01T19:55:05.058 INFO:teuthology.orchestra.run.smithi155.stdout: { 2023-08-01T19:55:05.058 INFO:teuthology.orchestra.run.smithi155.stdout: "event": "initiated", 2023-08-01T19:55:05.058 INFO:teuthology.orchestra.run.smithi155.stdout: "time": "2023-08-01T19:55:05.032640+0000", 2023-08-01T19:55:05.058 INFO:teuthology.orchestra.run.smithi155.stdout: "duration": 0 2023-08-01T19:55:05.058 INFO:teuthology.orchestra.run.smithi155.stdout: }, 2023-08-01T19:55:05.059 INFO:teuthology.orchestra.run.smithi155.stdout: { 2023-08-01T19:55:05.059 INFO:teuthology.orchestra.run.smithi155.stdout: "event": "throttled", 2023-08-01T19:55:05.059 INFO:teuthology.orchestra.run.smithi155.stdout: "time": "2023-08-01T19:55:05.032640+0000", 2023-08-01T19:55:05.059 INFO:teuthology.orchestra.run.smithi155.stdout: "duration": 0 2023-08-01T19:55:05.059 INFO:teuthology.orchestra.run.smithi155.stdout: }, 2023-08-01T19:55:05.059 INFO:teuthology.orchestra.run.smithi155.stdout: { 2023-08-01T19:55:05.059 INFO:teuthology.orchestra.run.smithi155.stdout: "event": "header_read", 2023-08-01T19:55:05.059 INFO:teuthology.orchestra.run.smithi155.stdout: "time": "2023-08-01T19:55:05.032639+0000", 2023-08-01T19:55:05.060 INFO:teuthology.orchestra.run.smithi155.stdout: "duration": 4294967295.9999995 2023-08-01T19:55:05.060 INFO:teuthology.orchestra.run.smithi155.stdout: }, 2023-08-01T19:55:05.060 INFO:teuthology.orchestra.run.smithi155.stdout: { 2023-08-01T19:55:05.060 INFO:teuthology.orchestra.run.smithi155.stdout: "event": "all_read", 2023-08-01T19:55:05.060 INFO:teuthology.orchestra.run.smithi155.stdout: "time": "2023-08-01T19:55:05.032699+0000", 2023-08-01T19:55:05.060 INFO:teuthology.orchestra.run.smithi155.stdout: "duration": 6.0112000000000003e-05 2023-08-01T19:55:05.060 INFO:teuthology.orchestra.run.smithi155.stdout: }, 2023-08-01T19:55:05.060 INFO:teuthology.orchestra.run.smithi155.stdout: { 2023-08-01T19:55:05.061 INFO:teuthology.orchestra.run.smithi155.stdout: "event": "dispatched", 2023-08-01T19:55:05.061 INFO:teuthology.orchestra.run.smithi155.stdout: "time": "2023-08-01T19:55:05.032707+0000", 2023-08-01T19:55:05.061 INFO:teuthology.orchestra.run.smithi155.stdout: "duration": 8.2290000000000003e-06 2023-08-01T19:55:05.061 INFO:teuthology.orchestra.run.smithi155.stdout: }, 2023-08-01T19:55:05.061 INFO:teuthology.orchestra.run.smithi155.stdout: { 2023-08-01T19:55:05.061 INFO:teuthology.orchestra.run.smithi155.stdout: "event": "queued_for_pg", 2023-08-01T19:55:05.061 INFO:teuthology.orchestra.run.smithi155.stdout: "time": "2023-08-01T19:55:05.032717+0000", 2023-08-01T19:55:05.062 INFO:teuthology.orchestra.run.smithi155.stdout: "duration": 9.2199999999999998e-06 2023-08-01T19:55:05.062 INFO:teuthology.orchestra.run.smithi155.stdout: }, 2023-08-01T19:55:05.062 INFO:teuthology.orchestra.run.smithi155.stdout: { 2023-08-01T19:55:05.062 INFO:teuthology.orchestra.run.smithi155.stdout: "event": "reached_pg", 2023-08-01T19:55:05.062 INFO:teuthology.orchestra.run.smithi155.stdout: "time": "2023-08-01T19:55:05.032784+0000", 2023-08-01T19:55:05.062 INFO:teuthology.orchestra.run.smithi155.stdout: "duration": 6.7452000000000004e-05 2023-08-01T19:55:05.062 INFO:teuthology.orchestra.run.smithi155.stdout: }, 2023-08-01T19:55:05.062 INFO:teuthology.orchestra.run.smithi155.stdout: { 2023-08-01T19:55:05.063 INFO:teuthology.orchestra.run.smithi155.stdout: "event": "started", 2023-08-01T19:55:05.063 INFO:teuthology.orchestra.run.smithi155.stdout: "time": "2023-08-01T19:55:05.032942+0000", 2023-08-01T19:55:05.063 INFO:teuthology.orchestra.run.smithi155.stdout: "duration": 0.000157594 2023-08-01T19:55:05.063 INFO:teuthology.orchestra.run.smithi155.stdout: }, 2023-08-01T19:55:05.063 INFO:teuthology.orchestra.run.smithi155.stdout: { 2023-08-01T19:55:05.063 INFO:teuthology.orchestra.run.smithi155.stdout: "event": "waiting for subops from 0", 2023-08-01T19:55:05.063 INFO:teuthology.orchestra.run.smithi155.stdout: "time": "2023-08-01T19:55:05.033093+0000", 2023-08-01T19:55:05.063 INFO:teuthology.orchestra.run.smithi155.stdout: "duration": 0.00015109800000000001 2023-08-01T19:55:05.064 INFO:teuthology.orchestra.run.smithi155.stdout: } 2023-08-01T19:55:05.064 INFO:teuthology.orchestra.run.smithi155.stdout: ] 2023-08-01T19:55:05.064 INFO:teuthology.orchestra.run.smithi155.stdout: } 2023-08-01T19:55:05.064 INFO:teuthology.orchestra.run.smithi155.stdout: }, 2023-08-01T19:55:05.064 INFO:teuthology.orchestra.run.smithi155.stdout: { 2023-08-01T19:55:05.064 INFO:teuthology.orchestra.run.smithi155.stdout: "description": "osd_op(client.4668.0:100011 5.d 5.679ae20d (undecoded) ondisk+write+known_if_redirected+supports_pool_eio e37)", 2023-08-01T19:55:05.064 INFO:teuthology.orchestra.run.smithi155.stdout: "initiated_at": "2023-08-01T19:55:05.032753+0000", 2023-08-01T19:55:05.064 INFO:teuthology.orchestra.run.smithi155.stdout: "age": 0.00023447799999999999, 2023-08-01T19:55:05.065 INFO:teuthology.orchestra.run.smithi155.stdout: "duration": 0.00060203700000000004, 2023-08-01T19:55:05.065 INFO:teuthology.orchestra.run.smithi155.stdout: "type_data": { 2023-08-01T19:55:05.065 INFO:teuthology.orchestra.run.smithi155.stdout: "flag_point": "queued for pg", 2023-08-01T19:55:05.065 INFO:teuthology.orchestra.run.smithi155.stdout: "client_info": { 2023-08-01T19:55:05.065 INFO:teuthology.orchestra.run.smithi155.stdout: "client": "client.4668", 2023-08-01T19:55:05.065 INFO:teuthology.orchestra.run.smithi155.stdout: "client_addr": "172.21.15.6:0/1709472247", 2023-08-01T19:55:05.065 INFO:teuthology.orchestra.run.smithi155.stdout: "tid": 100011 2023-08-01T19:55:05.065 INFO:teuthology.orchestra.run.smithi155.stdout: }, 2023-08-01T19:55:05.066 INFO:teuthology.orchestra.run.smithi155.stdout: "events": [ 2023-08-01T19:55:05.066 INFO:teuthology.orchestra.run.smithi155.stdout: { 2023-08-01T19:55:05.066 INFO:teuthology.orchestra.run.smithi155.stdout: "event": "initiated", 2023-08-01T19:55:05.066 INFO:teuthology.orchestra.run.smithi155.stdout: "time": "2023-08-01T19:55:05.032753+0000", 2023-08-01T19:55:05.066 INFO:teuthology.orchestra.run.smithi155.stdout: "duration": 0 2023-08-01T19:55:05.066 INFO:teuthology.orchestra.run.smithi155.stdout: }, 2023-08-01T19:55:05.066 INFO:teuthology.orchestra.run.smithi155.stdout: { 2023-08-01T19:55:05.066 INFO:teuthology.orchestra.run.smithi155.stdout: "event": "throttled", 2023-08-01T19:55:05.067 INFO:teuthology.orchestra.run.smithi155.stdout: "time": "2023-08-01T19:55:05.032753+0000", 2023-08-01T19:55:05.067 INFO:teuthology.orchestra.run.smithi155.stdout: "duration": 0 2023-08-01T19:55:05.067 INFO:teuthology.orchestra.run.smithi155.stdout: }, 2023-08-01T19:55:05.067 INFO:teuthology.orchestra.run.smithi155.stdout: { 2023-08-01T19:55:05.067 INFO:teuthology.orchestra.run.smithi155.stdout: "event": "header_read", 2023-08-01T19:55:05.067 INFO:teuthology.orchestra.run.smithi155.stdout: "time": "2023-08-01T19:55:05.032752+0000", 2023-08-01T19:55:05.067 INFO:teuthology.orchestra.run.smithi155.stdout: "duration": 4294967295.9999995 2023-08-01T19:55:05.068 INFO:teuthology.orchestra.run.smithi155.stdout: }, 2023-08-01T19:55:05.068 INFO:teuthology.orchestra.run.smithi155.stdout: { 2023-08-01T19:55:05.068 INFO:teuthology.orchestra.run.smithi155.stdout: "event": "all_read", 2023-08-01T19:55:05.068 INFO:teuthology.orchestra.run.smithi155.stdout: "time": "2023-08-01T19:55:05.032841+0000", 2023-08-01T19:55:05.068 INFO:teuthology.orchestra.run.smithi155.stdout: "duration": 8.8571000000000003e-05 2023-08-01T19:55:05.068 INFO:teuthology.orchestra.run.smithi155.stdout: }, 2023-08-01T19:55:05.068 INFO:teuthology.orchestra.run.smithi155.stdout: { 2023-08-01T19:55:05.068 INFO:teuthology.orchestra.run.smithi155.stdout: "event": "dispatched", 2023-08-01T19:55:05.069 INFO:teuthology.orchestra.run.smithi155.stdout: "time": "2023-08-01T19:55:05.032853+0000", 2023-08-01T19:55:05.069 INFO:teuthology.orchestra.run.smithi155.stdout: "duration": 1.1895e-05 2023-08-01T19:55:05.069 INFO:teuthology.orchestra.run.smithi155.stdout: }, 2023-08-01T19:55:05.069 INFO:teuthology.orchestra.run.smithi155.stdout: { 2023-08-01T19:55:05.069 INFO:teuthology.orchestra.run.smithi155.stdout: "event": "queued_for_pg", 2023-08-01T19:55:05.069 INFO:teuthology.orchestra.run.smithi155.stdout: "time": "2023-08-01T19:55:05.032861+0000", 2023-08-01T19:55:05.069 INFO:teuthology.orchestra.run.smithi155.stdout: "duration": 8.4999999999999999e-06 2023-08-01T19:55:05.069 INFO:teuthology.orchestra.run.smithi155.stdout: } 2023-08-01T19:55:05.070 INFO:teuthology.orchestra.run.smithi155.stdout: ] 2023-08-01T19:55:05.070 INFO:teuthology.orchestra.run.smithi155.stdout: } 2023-08-01T19:55:05.070 INFO:teuthology.orchestra.run.smithi155.stdout: }, 2023-08-01T19:55:05.070 INFO:teuthology.orchestra.run.smithi155.stdout: { 2023-08-01T19:55:05.070 INFO:teuthology.orchestra.run.smithi155.stdout: "description": "osd_op(client.4668.0:99994 5.e 5:74694b47:::benchmark_data_smithi006_114134_object99993:head [set-alloc-hint object_size 65536 write_size 65536,write 0~65536 in=65536b] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e37)", 2023-08-01T19:55:05.070 INFO:teuthology.orchestra.run.smithi155.stdout: "initiated_at": "2023-08-01T19:55:05.026217+0000", 2023-08-01T19:55:05.070 INFO:teuthology.orchestra.run.smithi155.stdout: "age": 0.0067708400000000002, 2023-08-01T19:55:05.070 INFO:teuthology.orchestra.run.smithi155.stdout: "duration": 0.0072082600000000002, 2023-08-01T19:55:05.071 INFO:teuthology.orchestra.run.smithi155.stdout: "type_data": { 2023-08-01T19:55:05.071 INFO:teuthology.orchestra.run.smithi155.stdout: "flag_point": "waiting for sub ops", 2023-08-01T19:55:05.071 INFO:teuthology.orchestra.run.smithi155.stdout: "client_info": { 2023-08-01T19:55:05.071 INFO:teuthology.orchestra.run.smithi155.stdout: "client": "client.4668", 2023-08-01T19:55:05.071 INFO:teuthology.orchestra.run.smithi155.stdout: "client_addr": "172.21.15.6:0/1709472247", 2023-08-01T19:55:05.071 INFO:teuthology.orchestra.run.smithi155.stdout: "tid": 99994 2023-08-01T19:55:05.071 INFO:teuthology.orchestra.run.smithi155.stdout: }, 2023-08-01T19:55:05.071 INFO:teuthology.orchestra.run.smithi155.stdout: "events": [ 2023-08-01T19:55:05.072 INFO:teuthology.orchestra.run.smithi155.stdout: { 2023-08-01T19:55:05.072 INFO:teuthology.orchestra.run.smithi155.stdout: "event": "initiated", 2023-08-01T19:55:05.072 INFO:teuthology.orchestra.run.smithi155.stdout: "time": "2023-08-01T19:55:05.026217+0000", 2023-08-01T19:55:05.072 INFO:teuthology.orchestra.run.smithi155.stdout: "duration": 0 2023-08-01T19:55:05.072 INFO:teuthology.orchestra.run.smithi155.stdout: }, 2023-08-01T19:55:05.072 INFO:teuthology.orchestra.run.smithi155.stdout: { 2023-08-01T19:55:05.072 INFO:teuthology.orchestra.run.smithi155.stdout: "event": "throttled", 2023-08-01T19:55:05.073 INFO:teuthology.orchestra.run.smithi155.stdout: "time": "2023-08-01T19:55:05.026217+0000", 2023-08-01T19:55:05.073 INFO:teuthology.orchestra.run.smithi155.stdout: "duration": 0 2023-08-01T19:55:05.073 INFO:teuthology.orchestra.run.smithi155.stdout: }, 2023-08-01T19:55:05.073 INFO:teuthology.orchestra.run.smithi155.stdout: { 2023-08-01T19:55:05.073 INFO:teuthology.orchestra.run.smithi155.stdout: "event": "header_read", 2023-08-01T19:55:05.073 INFO:teuthology.orchestra.run.smithi155.stdout: "time": "2023-08-01T19:55:05.026216+0000", 2023-08-01T19:55:05.073 INFO:teuthology.orchestra.run.smithi155.stdout: "duration": 4294967295.999999 2023-08-01T19:55:05.073 INFO:teuthology.orchestra.run.smithi155.stdout: }, 2023-08-01T19:55:05.074 INFO:teuthology.orchestra.run.smithi155.stdout: { 2023-08-01T19:55:05.074 INFO:teuthology.orchestra.run.smithi155.stdout: "event": "all_read", 2023-08-01T19:55:05.074 INFO:teuthology.orchestra.run.smithi155.stdout: "time": "2023-08-01T19:55:05.026286+0000", 2023-08-01T19:55:05.074 INFO:teuthology.orchestra.run.smithi155.stdout: "duration": 7.0487999999999993e-05 2023-08-01T19:55:05.074 INFO:teuthology.orchestra.run.smithi155.stdout: }, 2023-08-01T19:55:05.074 INFO:teuthology.orchestra.run.smithi155.stdout: { 2023-08-01T19:55:05.074 INFO:teuthology.orchestra.run.smithi155.stdout: "event": "dispatched", 2023-08-01T19:55:05.074 INFO:teuthology.orchestra.run.smithi155.stdout: "time": "2023-08-01T19:55:05.026297+0000", 2023-08-01T19:55:05.075 INFO:teuthology.orchestra.run.smithi155.stdout: "duration": 1.0919e-05 2023-08-01T19:55:05.075 INFO:teuthology.orchestra.run.smithi155.stdout: }, 2023-08-01T19:55:05.075 INFO:teuthology.orchestra.run.smithi155.stdout: { 2023-08-01T19:55:05.075 INFO:teuthology.orchestra.run.smithi155.stdout: "event": "queued_for_pg", 2023-08-01T19:55:05.075 INFO:teuthology.orchestra.run.smithi155.stdout: "time": "2023-08-01T19:55:05.026302+0000", 2023-08-01T19:55:05.075 INFO:teuthology.orchestra.run.smithi155.stdout: "duration": 5.1329999999999998e-06 2023-08-01T19:55:05.075 INFO:teuthology.orchestra.run.smithi155.stdout: }, 2023-08-01T19:55:05.075 INFO:teuthology.orchestra.run.smithi155.stdout: { 2023-08-01T19:55:05.076 INFO:teuthology.orchestra.run.smithi155.stdout: "event": "reached_pg", 2023-08-01T19:55:05.076 INFO:teuthology.orchestra.run.smithi155.stdout: "time": "2023-08-01T19:55:05.027229+0000", 2023-08-01T19:55:05.076 INFO:teuthology.orchestra.run.smithi155.stdout: "duration": 0.00092697400000000001 2023-08-01T19:55:05.076 INFO:teuthology.orchestra.run.smithi155.stdout: }, 2023-08-01T19:55:05.076 INFO:teuthology.orchestra.run.smithi155.stdout: { 2023-08-01T19:55:05.076 INFO:teuthology.orchestra.run.smithi155.stdout: "event": "started", 2023-08-01T19:55:05.076 INFO:teuthology.orchestra.run.smithi155.stdout: "time": "2023-08-01T19:55:05.027331+0000", 2023-08-01T19:55:05.076 INFO:teuthology.orchestra.run.smithi155.stdout: "duration": 0.000101735 2023-08-01T19:55:05.077 INFO:teuthology.orchestra.run.smithi155.stdout: }, 2023-08-01T19:55:05.077 INFO:teuthology.orchestra.run.smithi155.stdout: { 2023-08-01T19:55:05.077 INFO:teuthology.orchestra.run.smithi155.stdout: "event": "waiting for subops from 0", 2023-08-01T19:55:05.077 INFO:teuthology.orchestra.run.smithi155.stdout: "time": "2023-08-01T19:55:05.027419+0000", 2023-08-01T19:55:05.077 INFO:teuthology.orchestra.run.smithi155.stdout: "duration": 8.7905000000000006e-05 2023-08-01T19:55:05.077 INFO:teuthology.orchestra.run.smithi155.stdout: }, 2023-08-01T19:55:05.077 INFO:teuthology.orchestra.run.smithi155.stdout: { 2023-08-01T19:55:05.077 INFO:teuthology.orchestra.run.smithi155.stdout: "event": "op_commit", 2023-08-01T19:55:05.078 INFO:teuthology.orchestra.run.smithi155.stdout: "time": "2023-08-01T19:55:05.030707+0000", 2023-08-01T19:55:05.078 INFO:teuthology.orchestra.run.smithi155.stdout: "duration": 0.003288404 2023-08-01T19:55:05.078 INFO:teuthology.orchestra.run.smithi155.stdout: } 2023-08-01T19:55:05.078 INFO:teuthology.orchestra.run.smithi155.stdout: ] 2023-08-01T19:55:05.078 INFO:teuthology.orchestra.run.smithi155.stdout: } 2023-08-01T19:55:05.078 INFO:teuthology.orchestra.run.smithi155.stdout: }, 2023-08-01T19:55:05.078 INFO:teuthology.orchestra.run.smithi155.stdout: { 2023-08-01T19:55:05.078 INFO:teuthology.orchestra.run.smithi155.stdout: "description": "osd_op(client.4668.0:99999 5.8 5:1052cc1c:::benchmark_data_smithi006_114134_object99998:head [set-alloc-hint object_size 65536 write_size 65536,write 0~65536 in=65536b] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e37)", 2023-08-01T19:55:05.079 INFO:teuthology.orchestra.run.smithi155.stdout: "initiated_at": "2023-08-01T19:55:05.029949+0000", 2023-08-01T19:55:05.079 INFO:teuthology.orchestra.run.smithi155.stdout: "age": 0.0030387249999999999, 2023-08-01T19:55:05.079 INFO:teuthology.orchestra.run.smithi155.stdout: "duration": 0.003592292, 2023-08-01T19:55:05.079 INFO:teuthology.orchestra.run.smithi155.stdout: "type_data": { 2023-08-01T19:55:05.079 INFO:teuthology.orchestra.run.smithi155.stdout: "flag_point": "waiting for sub ops", 2023-08-01T19:55:05.079 INFO:teuthology.orchestra.run.smithi155.stdout: "client_info": { 2023-08-01T19:55:05.079 INFO:teuthology.orchestra.run.smithi155.stdout: "client": "client.4668", 2023-08-01T19:55:05.079 INFO:teuthology.orchestra.run.smithi155.stdout: "client_addr": "172.21.15.6:0/1709472247", 2023-08-01T19:55:05.080 INFO:teuthology.orchestra.run.smithi155.stdout: "tid": 99999 2023-08-01T19:55:05.080 INFO:teuthology.orchestra.run.smithi155.stdout: }, 2023-08-01T19:55:05.080 INFO:teuthology.orchestra.run.smithi155.stdout: "events": [ 2023-08-01T19:55:05.080 INFO:teuthology.orchestra.run.smithi155.stdout: { 2023-08-01T19:55:05.080 INFO:teuthology.orchestra.run.smithi155.stdout: "event": "initiated", 2023-08-01T19:55:05.080 INFO:teuthology.orchestra.run.smithi155.stdout: "time": "2023-08-01T19:55:05.029949+0000", 2023-08-01T19:55:05.080 INFO:teuthology.orchestra.run.smithi155.stdout: "duration": 0 2023-08-01T19:55:05.081 INFO:teuthology.orchestra.run.smithi155.stdout: }, 2023-08-01T19:55:05.081 INFO:teuthology.orchestra.run.smithi155.stdout: { 2023-08-01T19:55:05.081 INFO:teuthology.orchestra.run.smithi155.stdout: "event": "throttled", 2023-08-01T19:55:05.081 INFO:teuthology.orchestra.run.smithi155.stdout: "time": "2023-08-01T19:55:05.029949+0000", 2023-08-01T19:55:05.081 INFO:teuthology.orchestra.run.smithi155.stdout: "duration": 0 2023-08-01T19:55:05.081 INFO:teuthology.orchestra.run.smithi155.stdout: }, 2023-08-01T19:55:05.081 INFO:teuthology.orchestra.run.smithi155.stdout: { 2023-08-01T19:55:05.081 INFO:teuthology.orchestra.run.smithi155.stdout: "event": "header_read", 2023-08-01T19:55:05.082 INFO:teuthology.orchestra.run.smithi155.stdout: "time": "2023-08-01T19:55:05.029948+0000", 2023-08-01T19:55:05.082 INFO:teuthology.orchestra.run.smithi155.stdout: "duration": 4294967295.999999 2023-08-01T19:55:05.082 INFO:teuthology.orchestra.run.smithi155.stdout: }, 2023-08-01T19:55:05.082 INFO:teuthology.orchestra.run.smithi155.stdout: { 2023-08-01T19:55:05.082 INFO:teuthology.orchestra.run.smithi155.stdout: "event": "all_read", 2023-08-01T19:55:05.082 INFO:teuthology.orchestra.run.smithi155.stdout: "time": "2023-08-01T19:55:05.029980+0000", 2023-08-01T19:55:05.082 INFO:teuthology.orchestra.run.smithi155.stdout: "duration": 3.2626999999999998e-05 2023-08-01T19:55:05.082 INFO:teuthology.orchestra.run.smithi155.stdout: }, 2023-08-01T19:55:05.083 INFO:teuthology.orchestra.run.smithi155.stdout: { 2023-08-01T19:55:05.083 INFO:teuthology.orchestra.run.smithi155.stdout: "event": "dispatched", 2023-08-01T19:55:05.083 INFO:teuthology.orchestra.run.smithi155.stdout: "time": "2023-08-01T19:55:05.029990+0000", 2023-08-01T19:55:05.083 INFO:teuthology.orchestra.run.smithi155.stdout: "duration": 9.6749999999999997e-06 2023-08-01T19:55:05.083 INFO:teuthology.orchestra.run.smithi155.stdout: }, 2023-08-01T19:55:05.083 INFO:teuthology.orchestra.run.smithi155.stdout: { 2023-08-01T19:55:05.083 INFO:teuthology.orchestra.run.smithi155.stdout: "event": "queued_for_pg", 2023-08-01T19:55:05.083 INFO:teuthology.orchestra.run.smithi155.stdout: "time": "2023-08-01T19:55:05.029994+0000", 2023-08-01T19:55:05.084 INFO:teuthology.orchestra.run.smithi155.stdout: "duration": 4.2679999999999996e-06 2023-08-01T19:55:05.084 INFO:teuthology.orchestra.run.smithi155.stdout: }, 2023-08-01T19:55:05.084 INFO:teuthology.orchestra.run.smithi155.stdout: { 2023-08-01T19:55:05.084 INFO:teuthology.orchestra.run.smithi155.stdout: "event": "reached_pg", 2023-08-01T19:55:05.084 INFO:teuthology.orchestra.run.smithi155.stdout: "time": "2023-08-01T19:55:05.030521+0000", 2023-08-01T19:55:05.084 INFO:teuthology.orchestra.run.smithi155.stdout: "duration": 0.00052702100000000002 2023-08-01T19:55:05.084 INFO:teuthology.orchestra.run.smithi155.stdout: }, 2023-08-01T19:55:05.084 INFO:teuthology.orchestra.run.smithi155.stdout: { 2023-08-01T19:55:05.085 INFO:teuthology.orchestra.run.smithi155.stdout: "event": "started", 2023-08-01T19:55:05.085 INFO:teuthology.orchestra.run.smithi155.stdout: "time": "2023-08-01T19:55:05.030622+0000", 2023-08-01T19:55:05.085 INFO:teuthology.orchestra.run.smithi155.stdout: "duration": 0.00010085399999999999 2023-08-01T19:55:05.085 INFO:teuthology.orchestra.run.smithi155.stdout: }, 2023-08-01T19:55:05.085 INFO:teuthology.orchestra.run.smithi155.stdout: { 2023-08-01T19:55:05.085 INFO:teuthology.orchestra.run.smithi155.stdout: "event": "waiting for subops from 0", 2023-08-01T19:55:05.085 INFO:teuthology.orchestra.run.smithi155.stdout: "time": "2023-08-01T19:55:05.030761+0000", 2023-08-01T19:55:05.085 INFO:teuthology.orchestra.run.smithi155.stdout: "duration": 0.00013881000000000001 2023-08-01T19:55:05.086 INFO:teuthology.orchestra.run.smithi155.stdout: } 2023-08-01T19:55:05.086 INFO:teuthology.orchestra.run.smithi155.stdout: ] 2023-08-01T19:55:05.086 INFO:teuthology.orchestra.run.smithi155.stdout: } 2023-08-01T19:55:05.086 INFO:teuthology.orchestra.run.smithi155.stdout: }, 2023-08-01T19:55:05.086 INFO:teuthology.orchestra.run.smithi155.stdout: { 2023-08-01T19:55:05.086 INFO:teuthology.orchestra.run.smithi155.stdout: "description": "osd_op(client.4668.0:100001 5.8 5:12c7383c:::benchmark_data_smithi006_114134_object100000:head [set-alloc-hint object_size 65536 write_size 65536,write 0~65536 in=65536b] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e37)", 2023-08-01T19:55:05.086 INFO:teuthology.orchestra.run.smithi155.stdout: "initiated_at": "2023-08-01T19:55:05.030479+0000", 2023-08-01T19:55:05.087 INFO:teuthology.orchestra.run.smithi155.stdout: "age": 0.002508714, 2023-08-01T19:55:05.087 INFO:teuthology.orchestra.run.smithi155.stdout: "duration": 0.003152087, 2023-08-01T19:55:05.087 INFO:teuthology.orchestra.run.smithi155.stdout: "type_data": { 2023-08-01T19:55:05.087 INFO:teuthology.orchestra.run.smithi155.stdout: "flag_point": "waiting for sub ops", 2023-08-01T19:55:05.087 INFO:teuthology.orchestra.run.smithi155.stdout: "client_info": { 2023-08-01T19:55:05.087 INFO:teuthology.orchestra.run.smithi155.stdout: "client": "client.4668", 2023-08-01T19:55:05.087 INFO:teuthology.orchestra.run.smithi155.stdout: "client_addr": "172.21.15.6:0/1709472247", 2023-08-01T19:55:05.087 INFO:teuthology.orchestra.run.smithi155.stdout: "tid": 100001 2023-08-01T19:55:05.088 INFO:teuthology.orchestra.run.smithi155.stdout: }, 2023-08-01T19:55:05.088 INFO:teuthology.orchestra.run.smithi155.stdout: "events": [ 2023-08-01T19:55:05.088 INFO:teuthology.orchestra.run.smithi155.stdout: { 2023-08-01T19:55:05.088 INFO:teuthology.orchestra.run.smithi155.stdout: "event": "initiated", 2023-08-01T19:55:05.088 INFO:teuthology.orchestra.run.smithi155.stdout: "time": "2023-08-01T19:55:05.030479+0000", 2023-08-01T19:55:05.088 INFO:teuthology.orchestra.run.smithi155.stdout: "duration": 0 2023-08-01T19:55:05.088 INFO:teuthology.orchestra.run.smithi155.stdout: }, 2023-08-01T19:55:05.088 INFO:teuthology.orchestra.run.smithi155.stdout: { 2023-08-01T19:55:05.089 INFO:teuthology.orchestra.run.smithi155.stdout: "event": "throttled", 2023-08-01T19:55:05.089 INFO:teuthology.orchestra.run.smithi155.stdout: "time": "2023-08-01T19:55:05.030479+0000", 2023-08-01T19:55:05.089 INFO:teuthology.orchestra.run.smithi155.stdout: "duration": 0 2023-08-01T19:55:05.089 INFO:teuthology.orchestra.run.smithi155.stdout: }, 2023-08-01T19:55:05.089 INFO:teuthology.orchestra.run.smithi155.stdout: { 2023-08-01T19:55:05.089 INFO:teuthology.orchestra.run.smithi155.stdout: "event": "header_read", 2023-08-01T19:55:05.089 INFO:teuthology.orchestra.run.smithi155.stdout: "time": "2023-08-01T19:55:05.030478+0000", 2023-08-01T19:55:05.089 INFO:teuthology.orchestra.run.smithi155.stdout: "duration": 4294967295.999999 2023-08-01T19:55:05.090 INFO:teuthology.orchestra.run.smithi155.stdout: }, 2023-08-01T19:55:05.090 INFO:teuthology.orchestra.run.smithi155.stdout: { 2023-08-01T19:55:05.090 INFO:teuthology.orchestra.run.smithi155.stdout: "event": "all_read", 2023-08-01T19:55:05.090 INFO:teuthology.orchestra.run.smithi155.stdout: "time": "2023-08-01T19:55:05.030539+0000", 2023-08-01T19:55:05.090 INFO:teuthology.orchestra.run.smithi155.stdout: "duration": 6.1620999999999998e-05 2023-08-01T19:55:05.090 INFO:teuthology.orchestra.run.smithi155.stdout: }, 2023-08-01T19:55:05.090 INFO:teuthology.orchestra.run.smithi155.stdout: { 2023-08-01T19:55:05.090 INFO:teuthology.orchestra.run.smithi155.stdout: "event": "dispatched", 2023-08-01T19:55:05.091 INFO:teuthology.orchestra.run.smithi155.stdout: "time": "2023-08-01T19:55:05.030549+0000", 2023-08-01T19:55:05.091 INFO:teuthology.orchestra.run.smithi155.stdout: "duration": 9.4210000000000001e-06 2023-08-01T19:55:05.091 INFO:teuthology.orchestra.run.smithi155.stdout: }, 2023-08-01T19:55:05.091 INFO:teuthology.orchestra.run.smithi155.stdout: { 2023-08-01T19:55:05.091 INFO:teuthology.orchestra.run.smithi155.stdout: "event": "queued_for_pg", 2023-08-01T19:55:05.091 INFO:teuthology.orchestra.run.smithi155.stdout: "time": "2023-08-01T19:55:05.030555+0000", 2023-08-01T19:55:05.091 INFO:teuthology.orchestra.run.smithi155.stdout: "duration": 5.998e-06 2023-08-01T19:55:05.091 INFO:teuthology.orchestra.run.smithi155.stdout: }, 2023-08-01T19:55:05.092 INFO:teuthology.orchestra.run.smithi155.stdout: { 2023-08-01T19:55:05.092 INFO:teuthology.orchestra.run.smithi155.stdout: "event": "reached_pg", 2023-08-01T19:55:05.092 INFO:teuthology.orchestra.run.smithi155.stdout: "time": "2023-08-01T19:55:05.033292+0000", 2023-08-01T19:55:05.092 INFO:teuthology.orchestra.run.smithi155.stdout: "duration": 0.002736638 2023-08-01T19:55:05.092 INFO:teuthology.orchestra.run.smithi155.stdout: }, 2023-08-01T19:55:05.092 INFO:teuthology.orchestra.run.smithi155.stdout: { 2023-08-01T19:55:05.092 INFO:teuthology.orchestra.run.smithi155.stdout: "event": "started", 2023-08-01T19:55:05.093 INFO:teuthology.orchestra.run.smithi155.stdout: "time": "2023-08-01T19:55:05.033433+0000", 2023-08-01T19:55:05.093 INFO:teuthology.orchestra.run.smithi155.stdout: "duration": 0.00014171299999999999 2023-08-01T19:55:05.093 INFO:teuthology.orchestra.run.smithi155.stdout: }, 2023-08-01T19:55:05.093 INFO:teuthology.orchestra.run.smithi155.stdout: { 2023-08-01T19:55:05.093 INFO:teuthology.orchestra.run.smithi155.stdout: "event": "waiting for subops from 0", 2023-08-01T19:55:05.093 INFO:teuthology.orchestra.run.smithi155.stdout: "time": "2023-08-01T19:55:05.033582+0000", 2023-08-01T19:55:05.093 INFO:teuthology.orchestra.run.smithi155.stdout: "duration": 0.00014874500000000001 2023-08-01T19:55:05.093 INFO:teuthology.orchestra.run.smithi155.stdout: } 2023-08-01T19:55:05.094 INFO:teuthology.orchestra.run.smithi155.stdout: ] 2023-08-01T19:55:05.094 INFO:teuthology.orchestra.run.smithi155.stdout: } 2023-08-01T19:55:05.094 INFO:teuthology.orchestra.run.smithi155.stdout: }, 2023-08-01T19:55:05.094 INFO:teuthology.orchestra.run.smithi155.stdout: { 2023-08-01T19:55:05.094 INFO:teuthology.orchestra.run.smithi155.stdout: "description": "osd_op(client.4668.0:100002 5.0 5:01d5ac74:::benchmark_data_smithi006_114134_object100001:head [set-alloc-hint object_size 65536 write_size 65536,write 0~65536 in=65536b] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e37)", 2023-08-01T19:55:05.094 INFO:teuthology.orchestra.run.smithi155.stdout: "initiated_at": "2023-08-01T19:55:05.030564+0000", 2023-08-01T19:55:05.094 INFO:teuthology.orchestra.run.smithi155.stdout: "age": 0.0024234909999999998, 2023-08-01T19:55:05.094 INFO:teuthology.orchestra.run.smithi155.stdout: "duration": 0.0031527439999999999, 2023-08-01T19:55:05.095 INFO:teuthology.orchestra.run.smithi155.stdout: "type_data": { 2023-08-01T19:55:05.095 INFO:teuthology.orchestra.run.smithi155.stdout: "flag_point": "waiting for sub ops", 2023-08-01T19:55:05.095 INFO:teuthology.orchestra.run.smithi155.stdout: "client_info": { 2023-08-01T19:55:05.095 INFO:teuthology.orchestra.run.smithi155.stdout: "client": "client.4668", 2023-08-01T19:55:05.095 INFO:teuthology.orchestra.run.smithi155.stdout: "client_addr": "172.21.15.6:0/1709472247", 2023-08-01T19:55:05.095 INFO:teuthology.orchestra.run.smithi155.stdout: "tid": 100002 2023-08-01T19:55:05.095 INFO:teuthology.orchestra.run.smithi155.stdout: }, 2023-08-01T19:55:05.095 INFO:teuthology.orchestra.run.smithi155.stdout: "events": [ 2023-08-01T19:55:05.096 INFO:teuthology.orchestra.run.smithi155.stdout: { 2023-08-01T19:55:05.096 INFO:teuthology.orchestra.run.smithi155.stdout: "event": "initiated", 2023-08-01T19:55:05.096 INFO:teuthology.orchestra.run.smithi155.stdout: "time": "2023-08-01T19:55:05.030564+0000", 2023-08-01T19:55:05.096 INFO:teuthology.orchestra.run.smithi155.stdout: "duration": 0 2023-08-01T19:55:05.096 INFO:teuthology.orchestra.run.smithi155.stdout: }, 2023-08-01T19:55:05.096 INFO:teuthology.orchestra.run.smithi155.stdout: { 2023-08-01T19:55:05.096 INFO:teuthology.orchestra.run.smithi155.stdout: "event": "throttled", 2023-08-01T19:55:05.096 INFO:teuthology.orchestra.run.smithi155.stdout: "time": "2023-08-01T19:55:05.030564+0000", 2023-08-01T19:55:05.097 INFO:teuthology.orchestra.run.smithi155.stdout: "duration": 0 2023-08-01T19:55:05.097 INFO:teuthology.orchestra.run.smithi155.stdout: }, 2023-08-01T19:55:05.097 INFO:teuthology.orchestra.run.smithi155.stdout: { 2023-08-01T19:55:05.097 INFO:teuthology.orchestra.run.smithi155.stdout: "event": "header_read", 2023-08-01T19:55:05.097 INFO:teuthology.orchestra.run.smithi155.stdout: "time": "2023-08-01T19:55:05.030563+0000", 2023-08-01T19:55:05.097 INFO:teuthology.orchestra.run.smithi155.stdout: "duration": 4294967295.9999995 2023-08-01T19:55:05.097 INFO:teuthology.orchestra.run.smithi155.stdout: }, 2023-08-01T19:55:05.097 INFO:teuthology.orchestra.run.smithi155.stdout: { 2023-08-01T19:55:05.098 INFO:teuthology.orchestra.run.smithi155.stdout: "event": "all_read", 2023-08-01T19:55:05.098 INFO:teuthology.orchestra.run.smithi155.stdout: "time": "2023-08-01T19:55:05.030598+0000", 2023-08-01T19:55:05.098 INFO:teuthology.orchestra.run.smithi155.stdout: "duration": 3.4975000000000003e-05 2023-08-01T19:55:05.098 INFO:teuthology.orchestra.run.smithi155.stdout: }, 2023-08-01T19:55:05.098 INFO:teuthology.orchestra.run.smithi155.stdout: { 2023-08-01T19:55:05.098 INFO:teuthology.orchestra.run.smithi155.stdout: "event": "dispatched", 2023-08-01T19:55:05.098 INFO:teuthology.orchestra.run.smithi155.stdout: "time": "2023-08-01T19:55:05.030606+0000", 2023-08-01T19:55:05.099 INFO:teuthology.orchestra.run.smithi155.stdout: "duration": 7.323e-06 2023-08-01T19:55:05.099 INFO:teuthology.orchestra.run.smithi155.stdout: }, 2023-08-01T19:55:05.099 INFO:teuthology.orchestra.run.smithi155.stdout: { 2023-08-01T19:55:05.099 INFO:teuthology.orchestra.run.smithi155.stdout: "event": "queued_for_pg", 2023-08-01T19:55:05.099 INFO:teuthology.orchestra.run.smithi155.stdout: "time": "2023-08-01T19:55:05.030609+0000", 2023-08-01T19:55:05.099 INFO:teuthology.orchestra.run.smithi155.stdout: "duration": 3.1319999999999998e-06 2023-08-01T19:55:05.099 INFO:teuthology.orchestra.run.smithi155.stdout: }, 2023-08-01T19:55:05.099 INFO:teuthology.orchestra.run.smithi155.stdout: { 2023-08-01T19:55:05.100 INFO:teuthology.orchestra.run.smithi155.stdout: "event": "reached_pg", 2023-08-01T19:55:05.100 INFO:teuthology.orchestra.run.smithi155.stdout: "time": "2023-08-01T19:55:05.033276+0000", 2023-08-01T19:55:05.100 INFO:teuthology.orchestra.run.smithi155.stdout: "duration": 0.002667717 2023-08-01T19:55:05.100 INFO:teuthology.orchestra.run.smithi155.stdout: }, 2023-08-01T19:55:05.100 INFO:teuthology.orchestra.run.smithi155.stdout: { 2023-08-01T19:55:05.100 INFO:teuthology.orchestra.run.smithi155.stdout: "event": "started", 2023-08-01T19:55:05.100 INFO:teuthology.orchestra.run.smithi155.stdout: "time": "2023-08-01T19:55:05.033428+0000", 2023-08-01T19:55:05.100 INFO:teuthology.orchestra.run.smithi155.stdout: "duration": 0.00015151499999999999 2023-08-01T19:55:05.101 INFO:teuthology.orchestra.run.smithi155.stdout: }, 2023-08-01T19:55:05.101 INFO:teuthology.orchestra.run.smithi155.stdout: { 2023-08-01T19:55:05.101 INFO:teuthology.orchestra.run.smithi155.stdout: "event": "waiting for subops from 0", 2023-08-01T19:55:05.101 INFO:teuthology.orchestra.run.smithi155.stdout: "time": "2023-08-01T19:55:05.033563+0000", 2023-08-01T19:55:05.101 INFO:teuthology.orchestra.run.smithi155.stdout: "duration": 0.00013532799999999999 2023-08-01T19:55:05.101 INFO:teuthology.orchestra.run.smithi155.stdout: } 2023-08-01T19:55:05.101 INFO:teuthology.orchestra.run.smithi155.stdout: ] 2023-08-01T19:55:05.101 INFO:teuthology.orchestra.run.smithi155.stdout: } 2023-08-01T19:55:05.102 INFO:teuthology.orchestra.run.smithi155.stdout: }, 2023-08-01T19:55:05.102 INFO:teuthology.orchestra.run.smithi155.stdout: { 2023-08-01T19:55:05.102 INFO:teuthology.orchestra.run.smithi155.stdout: "description": "osd_op(client.4668.0:100003 5.b 5:d7899ba8:::benchmark_data_smithi006_114134_object100002:head [set-alloc-hint object_size 65536 write_size 65536,write 0~65536 in=65536b] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e37)", 2023-08-01T19:55:05.102 INFO:teuthology.orchestra.run.smithi155.stdout: "initiated_at": "2023-08-01T19:55:05.030613+0000", 2023-08-01T19:55:05.102 INFO:teuthology.orchestra.run.smithi155.stdout: "age": 0.002374812, 2023-08-01T19:55:05.102 INFO:teuthology.orchestra.run.smithi155.stdout: "duration": 0.0031806859999999998, 2023-08-01T19:55:05.102 INFO:teuthology.orchestra.run.smithi155.stdout: "type_data": { 2023-08-01T19:55:05.102 INFO:teuthology.orchestra.run.smithi155.stdout: "flag_point": "waiting for sub ops", 2023-08-01T19:55:05.103 INFO:teuthology.orchestra.run.smithi155.stdout: "client_info": { 2023-08-01T19:55:05.103 INFO:teuthology.orchestra.run.smithi155.stdout: "client": "client.4668", 2023-08-01T19:55:05.103 INFO:teuthology.orchestra.run.smithi155.stdout: "client_addr": "172.21.15.6:0/1709472247", 2023-08-01T19:55:05.103 INFO:teuthology.orchestra.run.smithi155.stdout: "tid": 100003 2023-08-01T19:55:05.103 INFO:teuthology.orchestra.run.smithi155.stdout: }, 2023-08-01T19:55:05.103 INFO:teuthology.orchestra.run.smithi155.stdout: "events": [ 2023-08-01T19:55:05.103 INFO:teuthology.orchestra.run.smithi155.stdout: { 2023-08-01T19:55:05.103 INFO:teuthology.orchestra.run.smithi155.stdout: "event": "initiated", 2023-08-01T19:55:05.104 INFO:teuthology.orchestra.run.smithi155.stdout: "time": "2023-08-01T19:55:05.030613+0000", 2023-08-01T19:55:05.104 INFO:teuthology.orchestra.run.smithi155.stdout: "duration": 0 2023-08-01T19:55:05.104 INFO:teuthology.orchestra.run.smithi155.stdout: }, 2023-08-01T19:55:05.104 INFO:teuthology.orchestra.run.smithi155.stdout: { 2023-08-01T19:55:05.104 INFO:teuthology.orchestra.run.smithi155.stdout: "event": "throttled", 2023-08-01T19:55:05.104 INFO:teuthology.orchestra.run.smithi155.stdout: "time": "2023-08-01T19:55:05.030613+0000", 2023-08-01T19:55:05.104 INFO:teuthology.orchestra.run.smithi155.stdout: "duration": 0 2023-08-01T19:55:05.105 INFO:teuthology.orchestra.run.smithi155.stdout: }, 2023-08-01T19:55:05.105 INFO:teuthology.orchestra.run.smithi155.stdout: { 2023-08-01T19:55:05.105 INFO:teuthology.orchestra.run.smithi155.stdout: "event": "header_read", 2023-08-01T19:55:05.105 INFO:teuthology.orchestra.run.smithi155.stdout: "time": "2023-08-01T19:55:05.030612+0000", 2023-08-01T19:55:05.105 INFO:teuthology.orchestra.run.smithi155.stdout: "duration": 4294967295.9999995 2023-08-01T19:55:05.105 INFO:teuthology.orchestra.run.smithi155.stdout: }, 2023-08-01T19:55:05.105 INFO:teuthology.orchestra.run.smithi155.stdout: { 2023-08-01T19:55:05.105 INFO:teuthology.orchestra.run.smithi155.stdout: "event": "all_read", 2023-08-01T19:55:05.106 INFO:teuthology.orchestra.run.smithi155.stdout: "time": "2023-08-01T19:55:05.030637+0000", 2023-08-01T19:55:05.106 INFO:teuthology.orchestra.run.smithi155.stdout: "duration": 2.4411000000000001e-05 2023-08-01T19:55:05.106 INFO:teuthology.orchestra.run.smithi155.stdout: }, 2023-08-01T19:55:05.106 INFO:teuthology.orchestra.run.smithi155.stdout: { 2023-08-01T19:55:05.106 INFO:teuthology.orchestra.run.smithi155.stdout: "event": "dispatched", 2023-08-01T19:55:05.106 INFO:teuthology.orchestra.run.smithi155.stdout: "time": "2023-08-01T19:55:05.030643+0000", 2023-08-01T19:55:05.106 INFO:teuthology.orchestra.run.smithi155.stdout: "duration": 6.5889999999999999e-06 2023-08-01T19:55:05.106 INFO:teuthology.orchestra.run.smithi155.stdout: }, 2023-08-01T19:55:05.107 INFO:teuthology.orchestra.run.smithi155.stdout: { 2023-08-01T19:55:05.107 INFO:teuthology.orchestra.run.smithi155.stdout: "event": "queued_for_pg", 2023-08-01T19:55:05.107 INFO:teuthology.orchestra.run.smithi155.stdout: "time": "2023-08-01T19:55:05.030648+0000", 2023-08-01T19:55:05.107 INFO:teuthology.orchestra.run.smithi155.stdout: "duration": 4.2429999999999999e-06 2023-08-01T19:55:05.107 INFO:teuthology.orchestra.run.smithi155.stdout: }, 2023-08-01T19:55:05.107 INFO:teuthology.orchestra.run.smithi155.stdout: { 2023-08-01T19:55:05.107 INFO:teuthology.orchestra.run.smithi155.stdout: "event": "reached_pg", 2023-08-01T19:55:05.107 INFO:teuthology.orchestra.run.smithi155.stdout: "time": "2023-08-01T19:55:05.030682+0000", 2023-08-01T19:55:05.108 INFO:teuthology.orchestra.run.smithi155.stdout: "duration": 3.4277999999999999e-05 2023-08-01T19:55:05.108 INFO:teuthology.orchestra.run.smithi155.stdout: }, 2023-08-01T19:55:05.108 INFO:teuthology.orchestra.run.smithi155.stdout: { 2023-08-01T19:55:05.108 INFO:teuthology.orchestra.run.smithi155.stdout: "event": "started", 2023-08-01T19:55:05.108 INFO:teuthology.orchestra.run.smithi155.stdout: "time": "2023-08-01T19:55:05.030803+0000", 2023-08-01T19:55:05.108 INFO:teuthology.orchestra.run.smithi155.stdout: "duration": 0.000121699 2023-08-01T19:55:05.108 INFO:teuthology.orchestra.run.smithi155.stdout: }, 2023-08-01T19:55:05.108 INFO:teuthology.orchestra.run.smithi155.stdout: { 2023-08-01T19:55:05.109 INFO:teuthology.orchestra.run.smithi155.stdout: "event": "waiting for subops from 0", 2023-08-01T19:55:05.109 INFO:teuthology.orchestra.run.smithi155.stdout: "time": "2023-08-01T19:55:05.030938+0000", 2023-08-01T19:55:05.109 INFO:teuthology.orchestra.run.smithi155.stdout: "duration": 0.000134583 2023-08-01T19:55:05.109 INFO:teuthology.orchestra.run.smithi155.stdout: } 2023-08-01T19:55:05.109 INFO:teuthology.orchestra.run.smithi155.stdout: ] 2023-08-01T19:55:05.109 INFO:teuthology.orchestra.run.smithi155.stdout: } 2023-08-01T19:55:05.109 INFO:teuthology.orchestra.run.smithi155.stdout: } 2023-08-01T19:55:05.109 INFO:teuthology.orchestra.run.smithi155.stdout: ], 2023-08-01T19:55:05.110 INFO:teuthology.orchestra.run.smithi155.stdout: "num_ops": 10 2023-08-01T19:55:05.110 INFO:teuthology.orchestra.run.smithi155.stdout:} 2023-08-01T19:55:05.111 DEBUG:teuthology.orchestra.run.smithi155:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 30 ceph --cluster ceph --admin-daemon /var/run/ceph/ceph-osd.2.asok dump_blocked_ops 2023-08-01T19:55:05.111 INFO:tasks.ceph.osd.1.smithi101.stderr:2023-08-01T19:55:05.109+0000 7fb0cb7f6700 -1 received signal: Hangup from /usr/bin/python3 /bin/daemon-helper kill ceph-osd -f --cluster ceph -i 1 (PID: 111141) UID: 0 2023-08-01T19:55:05.212 INFO:tasks.ceph.osd.1.smithi101.stderr:2023-08-01T19:55:05.210+0000 7fb0cb7f6700 -1 received signal: Hangup from /usr/bin/python3 /bin/daemon-helper kill ceph-osd -f --cluster ceph -i 1 (PID: 111141) UID: 0 2023-08-01T19:55:05.298 INFO:teuthology.orchestra.run.smithi155.stdout:{ 2023-08-01T19:55:05.298 INFO:teuthology.orchestra.run.smithi155.stdout: "ops": [], 2023-08-01T19:55:05.299 INFO:teuthology.orchestra.run.smithi155.stdout: "complaint_time": 30, 2023-08-01T19:55:05.299 INFO:teuthology.orchestra.run.smithi155.stdout: "num_blocked_ops": 0 2023-08-01T19:55:05.299 INFO:teuthology.orchestra.run.smithi155.stdout:} 2023-08-01T19:55:05.311 DEBUG:teuthology.orchestra.run.smithi155:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 30 ceph --cluster ceph --admin-daemon /var/run/ceph/ceph-osd.2.asok dump_historic_ops 2023-08-01T19:55:05.312 INFO:tasks.ceph.osd.0.smithi008.stderr:2023-08-01T19:55:05.311+0000 7f16a58f4700 -1 received signal: Hangup from /usr/bin/python3 /bin/daemon-helper kill ceph-osd -f --cluster ceph -i 0 (PID: 111179) UID: 0 2023-08-01T19:55:05.315 INFO:tasks.radosbench.radosbench.0.smithi006.stdout: 41 16 100440 100424 153.073 115.5 0.00522458 0.00652996 2023-08-01T19:55:05.413 INFO:tasks.ceph.osd.2.smithi155.stderr:2023-08-01T19:55:05.411+0000 7faa5c6ac700 -1 received signal: Hangup from /usr/bin/python3 /bin/daemon-helper kill ceph-osd -f --cluster ceph -i 2 (PID: 111337) UID: 0 2023-08-01T19:55:05.478 INFO:teuthology.orchestra.run.smithi155.stdout:{ 2023-08-01T19:55:05.478 INFO:teuthology.orchestra.run.smithi155.stdout: "size": 20, 2023-08-01T19:55:05.478 INFO:teuthology.orchestra.run.smithi155.stdout: "duration": 600, 2023-08-01T19:55:05.478 INFO:teuthology.orchestra.run.smithi155.stdout: "ops": [ 2023-08-01T19:55:05.478 INFO:teuthology.orchestra.run.smithi155.stdout: { 2023-08-01T19:55:05.479 INFO:teuthology.orchestra.run.smithi155.stdout: "description": "osd_op(client.4668.0:73454 5.8 5:15596b2f:::benchmark_data_smithi006_114134_object73453:head [set-alloc-hint object_size 65536 write_size 65536,write 0~65536] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e31)", 2023-08-01T19:55:05.479 INFO:teuthology.orchestra.run.smithi155.stdout: "initiated_at": "2023-08-01T19:54:51.460020+0000", 2023-08-01T19:55:05.479 INFO:teuthology.orchestra.run.smithi155.stdout: "age": 14.014578816, 2023-08-01T19:55:05.479 INFO:teuthology.orchestra.run.smithi155.stdout: "duration": 0.022889436999999999, 2023-08-01T19:55:05.479 INFO:teuthology.orchestra.run.smithi155.stdout: "type_data": { 2023-08-01T19:55:05.479 INFO:teuthology.orchestra.run.smithi155.stdout: "flag_point": "commit sent; apply or cleanup", 2023-08-01T19:55:05.479 INFO:teuthology.orchestra.run.smithi155.stdout: "client_info": { 2023-08-01T19:55:05.480 INFO:teuthology.orchestra.run.smithi155.stdout: "client": "client.4668", 2023-08-01T19:55:05.480 INFO:teuthology.orchestra.run.smithi155.stdout: "client_addr": "172.21.15.6:0/1709472247", 2023-08-01T19:55:05.480 INFO:teuthology.orchestra.run.smithi155.stdout: "tid": 73454 2023-08-01T19:55:05.480 INFO:teuthology.orchestra.run.smithi155.stdout: }, 2023-08-01T19:55:05.480 INFO:teuthology.orchestra.run.smithi155.stdout: "events": [ 2023-08-01T19:55:05.480 INFO:teuthology.orchestra.run.smithi155.stdout: { 2023-08-01T19:55:05.480 INFO:teuthology.orchestra.run.smithi155.stdout: "event": "initiated", 2023-08-01T19:55:05.480 INFO:teuthology.orchestra.run.smithi155.stdout: "time": "2023-08-01T19:54:51.460020+0000", 2023-08-01T19:55:05.481 INFO:teuthology.orchestra.run.smithi155.stdout: "duration": 0 2023-08-01T19:55:05.481 INFO:teuthology.orchestra.run.smithi155.stdout: }, 2023-08-01T19:55:05.481 INFO:teuthology.orchestra.run.smithi155.stdout: { 2023-08-01T19:55:05.481 INFO:teuthology.orchestra.run.smithi155.stdout: "event": "throttled", 2023-08-01T19:55:05.481 INFO:teuthology.orchestra.run.smithi155.stdout: "time": "2023-08-01T19:54:51.460020+0000", 2023-08-01T19:55:05.481 INFO:teuthology.orchestra.run.smithi155.stdout: "duration": 0 2023-08-01T19:55:05.481 INFO:teuthology.orchestra.run.smithi155.stdout: }, 2023-08-01T19:55:05.481 INFO:teuthology.orchestra.run.smithi155.stdout: { 2023-08-01T19:55:05.482 INFO:teuthology.orchestra.run.smithi155.stdout: "event": "header_read", 2023-08-01T19:55:05.482 INFO:teuthology.orchestra.run.smithi155.stdout: "time": "2023-08-01T19:54:51.460019+0000", 2023-08-01T19:55:05.482 INFO:teuthology.orchestra.run.smithi155.stdout: "duration": 4294967295.9999995 2023-08-01T19:55:05.482 INFO:teuthology.orchestra.run.smithi155.stdout: }, 2023-08-01T19:55:05.482 INFO:teuthology.orchestra.run.smithi155.stdout: { 2023-08-01T19:55:05.482 INFO:teuthology.orchestra.run.smithi155.stdout: "event": "all_read", 2023-08-01T19:55:05.482 INFO:teuthology.orchestra.run.smithi155.stdout: "time": "2023-08-01T19:54:51.460051+0000", 2023-08-01T19:55:05.483 INFO:teuthology.orchestra.run.smithi155.stdout: "duration": 3.1736000000000002e-05 2023-08-01T19:55:05.483 INFO:teuthology.orchestra.run.smithi155.stdout: }, 2023-08-01T19:55:05.483 INFO:teuthology.orchestra.run.smithi155.stdout: { 2023-08-01T19:55:05.483 INFO:teuthology.orchestra.run.smithi155.stdout: "event": "dispatched", 2023-08-01T19:55:05.483 INFO:teuthology.orchestra.run.smithi155.stdout: "time": "2023-08-01T19:54:51.460058+0000", 2023-08-01T19:55:05.483 INFO:teuthology.orchestra.run.smithi155.stdout: "duration": 7.3869999999999997e-06 2023-08-01T19:55:05.483 INFO:teuthology.orchestra.run.smithi155.stdout: }, 2023-08-01T19:55:05.483 INFO:teuthology.orchestra.run.smithi155.stdout: { 2023-08-01T19:55:05.484 INFO:teuthology.orchestra.run.smithi155.stdout: "event": "queued_for_pg", 2023-08-01T19:55:05.484 INFO:teuthology.orchestra.run.smithi155.stdout: "time": "2023-08-01T19:54:51.460062+0000", 2023-08-01T19:55:05.484 INFO:teuthology.orchestra.run.smithi155.stdout: "duration": 4.352e-06 2023-08-01T19:55:05.484 INFO:teuthology.orchestra.run.smithi155.stdout: }, 2023-08-01T19:55:05.484 INFO:teuthology.orchestra.run.smithi155.stdout: { 2023-08-01T19:55:05.484 INFO:teuthology.orchestra.run.smithi155.stdout: "event": "reached_pg", 2023-08-01T19:55:05.484 INFO:teuthology.orchestra.run.smithi155.stdout: "time": "2023-08-01T19:54:51.460101+0000", 2023-08-01T19:55:05.484 INFO:teuthology.orchestra.run.smithi155.stdout: "duration": 3.8705000000000003e-05 2023-08-01T19:55:05.485 INFO:teuthology.orchestra.run.smithi155.stdout: }, 2023-08-01T19:55:05.485 INFO:teuthology.orchestra.run.smithi155.stdout: { 2023-08-01T19:55:05.485 INFO:teuthology.orchestra.run.smithi155.stdout: "event": "started", 2023-08-01T19:55:05.485 INFO:teuthology.orchestra.run.smithi155.stdout: "time": "2023-08-01T19:54:51.460236+0000", 2023-08-01T19:55:05.485 INFO:teuthology.orchestra.run.smithi155.stdout: "duration": 0.00013463599999999999 2023-08-01T19:55:05.485 INFO:teuthology.orchestra.run.smithi155.stdout: }, 2023-08-01T19:55:05.485 INFO:teuthology.orchestra.run.smithi155.stdout: { 2023-08-01T19:55:05.485 INFO:teuthology.orchestra.run.smithi155.stdout: "event": "waiting for subops from 0", 2023-08-01T19:55:05.486 INFO:teuthology.orchestra.run.smithi155.stdout: "time": "2023-08-01T19:54:51.460391+0000", 2023-08-01T19:55:05.486 INFO:teuthology.orchestra.run.smithi155.stdout: "duration": 0.00015525000000000001 2023-08-01T19:55:05.486 INFO:teuthology.orchestra.run.smithi155.stdout: }, 2023-08-01T19:55:05.486 INFO:teuthology.orchestra.run.smithi155.stdout: { 2023-08-01T19:55:05.486 INFO:teuthology.orchestra.run.smithi155.stdout: "event": "sub_op_commit_rec", 2023-08-01T19:55:05.486 INFO:teuthology.orchestra.run.smithi155.stdout: "time": "2023-08-01T19:54:51.468393+0000", 2023-08-01T19:55:05.486 INFO:teuthology.orchestra.run.smithi155.stdout: "duration": 0.00800208 2023-08-01T19:55:05.486 INFO:teuthology.orchestra.run.smithi155.stdout: }, 2023-08-01T19:55:05.487 INFO:teuthology.orchestra.run.smithi155.stdout: { 2023-08-01T19:55:05.487 INFO:teuthology.orchestra.run.smithi155.stdout: "event": "op_commit", 2023-08-01T19:55:05.487 INFO:teuthology.orchestra.run.smithi155.stdout: "time": "2023-08-01T19:54:51.482815+0000", 2023-08-01T19:55:05.487 INFO:teuthology.orchestra.run.smithi155.stdout: "duration": 0.01442148 2023-08-01T19:55:05.487 INFO:teuthology.orchestra.run.smithi155.stdout: }, 2023-08-01T19:55:05.487 INFO:teuthology.orchestra.run.smithi155.stdout: { 2023-08-01T19:55:05.487 INFO:teuthology.orchestra.run.smithi155.stdout: "event": "commit_sent", 2023-08-01T19:55:05.488 INFO:teuthology.orchestra.run.smithi155.stdout: "time": "2023-08-01T19:54:51.482866+0000", 2023-08-01T19:55:05.488 INFO:teuthology.orchestra.run.smithi155.stdout: "duration": 5.1842999999999998e-05 2023-08-01T19:55:05.488 INFO:teuthology.orchestra.run.smithi155.stdout: }, 2023-08-01T19:55:05.488 INFO:teuthology.orchestra.run.smithi155.stdout: { 2023-08-01T19:55:05.488 INFO:teuthology.orchestra.run.smithi155.stdout: "event": "done", 2023-08-01T19:55:05.488 INFO:teuthology.orchestra.run.smithi155.stdout: "time": "2023-08-01T19:54:51.482909+0000", 2023-08-01T19:55:05.488 INFO:teuthology.orchestra.run.smithi155.stdout: "duration": 4.2663000000000001e-05 2023-08-01T19:55:05.488 INFO:teuthology.orchestra.run.smithi155.stdout: } 2023-08-01T19:55:05.489 INFO:teuthology.orchestra.run.smithi155.stdout: ] 2023-08-01T19:55:05.489 INFO:teuthology.orchestra.run.smithi155.stdout: } 2023-08-01T19:55:05.489 INFO:teuthology.orchestra.run.smithi155.stdout: }, 2023-08-01T19:55:05.489 INFO:teuthology.orchestra.run.smithi155.stdout: { 2023-08-01T19:55:05.489 INFO:teuthology.orchestra.run.smithi155.stdout: "description": "osd_op(client.4668.0:73455 5.b 5:de51121e:::benchmark_data_smithi006_114134_object73454:head [set-alloc-hint object_size 65536 write_size 65536,write 0~65536] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e31)", 2023-08-01T19:55:05.489 INFO:teuthology.orchestra.run.smithi155.stdout: "initiated_at": "2023-08-01T19:54:51.460078+0000", 2023-08-01T19:55:05.489 INFO:teuthology.orchestra.run.smithi155.stdout: "age": 14.014520842, 2023-08-01T19:55:05.489 INFO:teuthology.orchestra.run.smithi155.stdout: "duration": 0.022689121999999999, 2023-08-01T19:55:05.490 INFO:teuthology.orchestra.run.smithi155.stdout: "type_data": { 2023-08-01T19:55:05.490 INFO:teuthology.orchestra.run.smithi155.stdout: "flag_point": "commit sent; apply or cleanup", 2023-08-01T19:55:05.490 INFO:teuthology.orchestra.run.smithi155.stdout: "client_info": { 2023-08-01T19:55:05.490 INFO:teuthology.orchestra.run.smithi155.stdout: "client": "client.4668", 2023-08-01T19:55:05.490 INFO:teuthology.orchestra.run.smithi155.stdout: "client_addr": "172.21.15.6:0/1709472247", 2023-08-01T19:55:05.490 INFO:teuthology.orchestra.run.smithi155.stdout: "tid": 73455 2023-08-01T19:55:05.490 INFO:teuthology.orchestra.run.smithi155.stdout: }, 2023-08-01T19:55:05.490 INFO:teuthology.orchestra.run.smithi155.stdout: "events": [ 2023-08-01T19:55:05.491 INFO:teuthology.orchestra.run.smithi155.stdout: { 2023-08-01T19:55:05.491 INFO:teuthology.orchestra.run.smithi155.stdout: "event": "initiated", 2023-08-01T19:55:05.491 INFO:teuthology.orchestra.run.smithi155.stdout: "time": "2023-08-01T19:54:51.460078+0000", 2023-08-01T19:55:05.491 INFO:teuthology.orchestra.run.smithi155.stdout: "duration": 0 2023-08-01T19:55:05.491 INFO:teuthology.orchestra.run.smithi155.stdout: }, 2023-08-01T19:55:05.491 INFO:teuthology.orchestra.run.smithi155.stdout: { 2023-08-01T19:55:05.491 INFO:teuthology.orchestra.run.smithi155.stdout: "event": "throttled", 2023-08-01T19:55:05.491 INFO:teuthology.orchestra.run.smithi155.stdout: "time": "2023-08-01T19:54:51.460078+0000", 2023-08-01T19:55:05.492 INFO:teuthology.orchestra.run.smithi155.stdout: "duration": 0 2023-08-01T19:55:05.492 INFO:teuthology.orchestra.run.smithi155.stdout: }, 2023-08-01T19:55:05.492 INFO:teuthology.orchestra.run.smithi155.stdout: { 2023-08-01T19:55:05.492 INFO:teuthology.orchestra.run.smithi155.stdout: "event": "header_read", 2023-08-01T19:55:05.492 INFO:teuthology.orchestra.run.smithi155.stdout: "time": "2023-08-01T19:54:51.460077+0000", 2023-08-01T19:55:05.492 INFO:teuthology.orchestra.run.smithi155.stdout: "duration": 4294967295.9999995 2023-08-01T19:55:05.492 INFO:teuthology.orchestra.run.smithi155.stdout: }, 2023-08-01T19:55:05.493 INFO:teuthology.orchestra.run.smithi155.stdout: { 2023-08-01T19:55:05.493 INFO:teuthology.orchestra.run.smithi155.stdout: "event": "all_read", 2023-08-01T19:55:05.493 INFO:teuthology.orchestra.run.smithi155.stdout: "time": "2023-08-01T19:54:51.460102+0000", 2023-08-01T19:55:05.493 INFO:teuthology.orchestra.run.smithi155.stdout: "duration": 2.4933e-05 2023-08-01T19:55:05.493 INFO:teuthology.orchestra.run.smithi155.stdout: }, 2023-08-01T19:55:05.493 INFO:teuthology.orchestra.run.smithi155.stdout: { 2023-08-01T19:55:05.493 INFO:teuthology.orchestra.run.smithi155.stdout: "event": "dispatched", 2023-08-01T19:55:05.493 INFO:teuthology.orchestra.run.smithi155.stdout: "time": "2023-08-01T19:54:51.460109+0000", 2023-08-01T19:55:05.494 INFO:teuthology.orchestra.run.smithi155.stdout: "duration": 7.0720000000000002e-06 2023-08-01T19:55:05.494 INFO:teuthology.orchestra.run.smithi155.stdout: }, 2023-08-01T19:55:05.494 INFO:teuthology.orchestra.run.smithi155.stdout: { 2023-08-01T19:55:05.494 INFO:teuthology.orchestra.run.smithi155.stdout: "event": "queued_for_pg", 2023-08-01T19:55:05.494 INFO:teuthology.orchestra.run.smithi155.stdout: "time": "2023-08-01T19:54:51.460113+0000", 2023-08-01T19:55:05.494 INFO:teuthology.orchestra.run.smithi155.stdout: "duration": 4.3220000000000003e-06 2023-08-01T19:55:05.494 INFO:teuthology.orchestra.run.smithi155.stdout: }, 2023-08-01T19:55:05.494 INFO:teuthology.orchestra.run.smithi155.stdout: { 2023-08-01T19:55:05.495 INFO:teuthology.orchestra.run.smithi155.stdout: "event": "reached_pg", 2023-08-01T19:55:05.495 INFO:teuthology.orchestra.run.smithi155.stdout: "time": "2023-08-01T19:54:51.460955+0000", 2023-08-01T19:55:05.495 INFO:teuthology.orchestra.run.smithi155.stdout: "duration": 0.00084142500000000003 2023-08-01T19:55:05.495 INFO:teuthology.orchestra.run.smithi155.stdout: }, 2023-08-01T19:55:05.495 INFO:teuthology.orchestra.run.smithi155.stdout: { 2023-08-01T19:55:05.495 INFO:teuthology.orchestra.run.smithi155.stdout: "event": "started", 2023-08-01T19:55:05.495 INFO:teuthology.orchestra.run.smithi155.stdout: "time": "2023-08-01T19:54:51.461079+0000", 2023-08-01T19:55:05.495 INFO:teuthology.orchestra.run.smithi155.stdout: "duration": 0.000123826 2023-08-01T19:55:05.496 INFO:teuthology.orchestra.run.smithi155.stdout: }, 2023-08-01T19:55:05.496 INFO:teuthology.orchestra.run.smithi155.stdout: { 2023-08-01T19:55:05.496 INFO:teuthology.orchestra.run.smithi155.stdout: "event": "waiting for subops from 0", 2023-08-01T19:55:05.496 INFO:teuthology.orchestra.run.smithi155.stdout: "time": "2023-08-01T19:54:51.461233+0000", 2023-08-01T19:55:05.496 INFO:teuthology.orchestra.run.smithi155.stdout: "duration": 0.00015431900000000001 2023-08-01T19:55:05.496 INFO:teuthology.orchestra.run.smithi155.stdout: }, 2023-08-01T19:55:05.496 INFO:teuthology.orchestra.run.smithi155.stdout: { 2023-08-01T19:55:05.496 INFO:teuthology.orchestra.run.smithi155.stdout: "event": "sub_op_commit_rec", 2023-08-01T19:55:05.497 INFO:teuthology.orchestra.run.smithi155.stdout: "time": "2023-08-01T19:54:51.468509+0000", 2023-08-01T19:55:05.497 INFO:teuthology.orchestra.run.smithi155.stdout: "duration": 0.0072759859999999999 2023-08-01T19:55:05.497 INFO:teuthology.orchestra.run.smithi155.stdout: }, 2023-08-01T19:55:05.497 INFO:teuthology.orchestra.run.smithi155.stdout: { 2023-08-01T19:55:05.497 INFO:teuthology.orchestra.run.smithi155.stdout: "event": "op_commit", 2023-08-01T19:55:05.497 INFO:teuthology.orchestra.run.smithi155.stdout: "time": "2023-08-01T19:54:51.482704+0000", 2023-08-01T19:55:05.497 INFO:teuthology.orchestra.run.smithi155.stdout: "duration": 0.01419545 2023-08-01T19:55:05.498 INFO:teuthology.orchestra.run.smithi155.stdout: }, 2023-08-01T19:55:05.498 INFO:teuthology.orchestra.run.smithi155.stdout: { 2023-08-01T19:55:05.498 INFO:teuthology.orchestra.run.smithi155.stdout: "event": "commit_sent", 2023-08-01T19:55:05.498 INFO:teuthology.orchestra.run.smithi155.stdout: "time": "2023-08-01T19:54:51.482747+0000", 2023-08-01T19:55:05.498 INFO:teuthology.orchestra.run.smithi155.stdout: "duration": 4.2413999999999997e-05 2023-08-01T19:55:05.498 INFO:teuthology.orchestra.run.smithi155.stdout: }, 2023-08-01T19:55:05.498 INFO:teuthology.orchestra.run.smithi155.stdout: { 2023-08-01T19:55:05.498 INFO:teuthology.orchestra.run.smithi155.stdout: "event": "done", 2023-08-01T19:55:05.499 INFO:teuthology.orchestra.run.smithi155.stdout: "time": "2023-08-01T19:54:51.482767+0000", 2023-08-01T19:55:05.499 INFO:teuthology.orchestra.run.smithi155.stdout: "duration": 1.9908999999999999e-05 2023-08-01T19:55:05.499 INFO:teuthology.orchestra.run.smithi155.stdout: } 2023-08-01T19:55:05.499 INFO:teuthology.orchestra.run.smithi155.stdout: ] 2023-08-01T19:55:05.499 INFO:teuthology.orchestra.run.smithi155.stdout: } 2023-08-01T19:55:05.499 INFO:teuthology.orchestra.run.smithi155.stdout: }, 2023-08-01T19:55:05.499 INFO:teuthology.orchestra.run.smithi155.stdout: { 2023-08-01T19:55:05.499 INFO:teuthology.orchestra.run.smithi155.stdout: "description": "osd_op(client.4668.0:73456 5.0 5:0164baf4:::benchmark_data_smithi006_114134_object73455:head [set-alloc-hint object_size 65536 write_size 65536,write 0~65536] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e31)", 2023-08-01T19:55:05.500 INFO:teuthology.orchestra.run.smithi155.stdout: "initiated_at": "2023-08-01T19:54:51.461520+0000", 2023-08-01T19:55:05.500 INFO:teuthology.orchestra.run.smithi155.stdout: "age": 14.013078852, 2023-08-01T19:55:05.500 INFO:teuthology.orchestra.run.smithi155.stdout: "duration": 0.023899916, 2023-08-01T19:55:05.500 INFO:teuthology.orchestra.run.smithi155.stdout: "type_data": { 2023-08-01T19:55:05.500 INFO:teuthology.orchestra.run.smithi155.stdout: "flag_point": "commit sent; apply or cleanup", 2023-08-01T19:55:05.500 INFO:teuthology.orchestra.run.smithi155.stdout: "client_info": { 2023-08-01T19:55:05.500 INFO:teuthology.orchestra.run.smithi155.stdout: "client": "client.4668", 2023-08-01T19:55:05.500 INFO:teuthology.orchestra.run.smithi155.stdout: "client_addr": "172.21.15.6:0/1709472247", 2023-08-01T19:55:05.501 INFO:teuthology.orchestra.run.smithi155.stdout: "tid": 73456 2023-08-01T19:55:05.501 INFO:teuthology.orchestra.run.smithi155.stdout: }, 2023-08-01T19:55:05.501 INFO:teuthology.orchestra.run.smithi155.stdout: "events": [ 2023-08-01T19:55:05.501 INFO:teuthology.orchestra.run.smithi155.stdout: { 2023-08-01T19:55:05.501 INFO:teuthology.orchestra.run.smithi155.stdout: "event": "initiated", 2023-08-01T19:55:05.501 INFO:teuthology.orchestra.run.smithi155.stdout: "time": "2023-08-01T19:54:51.461520+0000", 2023-08-01T19:55:05.501 INFO:teuthology.orchestra.run.smithi155.stdout: "duration": 0 2023-08-01T19:55:05.501 INFO:teuthology.orchestra.run.smithi155.stdout: }, 2023-08-01T19:55:05.502 INFO:teuthology.orchestra.run.smithi155.stdout: { 2023-08-01T19:55:05.502 INFO:teuthology.orchestra.run.smithi155.stdout: "event": "throttled", 2023-08-01T19:55:05.502 INFO:teuthology.orchestra.run.smithi155.stdout: "time": "2023-08-01T19:54:51.461520+0000", 2023-08-01T19:55:05.502 INFO:teuthology.orchestra.run.smithi155.stdout: "duration": 0 2023-08-01T19:55:05.502 INFO:teuthology.orchestra.run.smithi155.stdout: }, 2023-08-01T19:55:05.502 INFO:teuthology.orchestra.run.smithi155.stdout: { 2023-08-01T19:55:05.502 INFO:teuthology.orchestra.run.smithi155.stdout: "event": "header_read", 2023-08-01T19:55:05.503 INFO:teuthology.orchestra.run.smithi155.stdout: "time": "2023-08-01T19:54:51.461519+0000", 2023-08-01T19:55:05.503 INFO:teuthology.orchestra.run.smithi155.stdout: "duration": 4294967295.999999 2023-08-01T19:55:05.503 INFO:teuthology.orchestra.run.smithi155.stdout: }, 2023-08-01T19:55:05.503 INFO:teuthology.orchestra.run.smithi155.stdout: { 2023-08-01T19:55:05.503 INFO:teuthology.orchestra.run.smithi155.stdout: "event": "all_read", 2023-08-01T19:55:05.503 INFO:teuthology.orchestra.run.smithi155.stdout: "time": "2023-08-01T19:54:51.461633+0000", 2023-08-01T19:55:05.503 INFO:teuthology.orchestra.run.smithi155.stdout: "duration": 0.000114015 2023-08-01T19:55:05.503 INFO:teuthology.orchestra.run.smithi155.stdout: }, 2023-08-01T19:55:05.504 INFO:teuthology.orchestra.run.smithi155.stdout: { 2023-08-01T19:55:05.504 INFO:teuthology.orchestra.run.smithi155.stdout: "event": "dispatched", 2023-08-01T19:55:05.504 INFO:teuthology.orchestra.run.smithi155.stdout: "time": "2023-08-01T19:54:51.461643+0000", 2023-08-01T19:55:05.504 INFO:teuthology.orchestra.run.smithi155.stdout: "duration": 1.0217000000000001e-05 2023-08-01T19:55:05.504 INFO:teuthology.orchestra.run.smithi155.stdout: }, 2023-08-01T19:55:05.504 INFO:teuthology.orchestra.run.smithi155.stdout: { 2023-08-01T19:55:05.504 INFO:teuthology.orchestra.run.smithi155.stdout: "event": "queued_for_pg", 2023-08-01T19:55:05.504 INFO:teuthology.orchestra.run.smithi155.stdout: "time": "2023-08-01T19:54:51.461649+0000", 2023-08-01T19:55:05.505 INFO:teuthology.orchestra.run.smithi155.stdout: "duration": 5.8850000000000004e-06 2023-08-01T19:55:05.505 INFO:teuthology.orchestra.run.smithi155.stdout: }, 2023-08-01T19:55:05.505 INFO:teuthology.orchestra.run.smithi155.stdout: { 2023-08-01T19:55:05.505 INFO:teuthology.orchestra.run.smithi155.stdout: "event": "reached_pg", 2023-08-01T19:55:05.505 INFO:teuthology.orchestra.run.smithi155.stdout: "time": "2023-08-01T19:54:51.461686+0000", 2023-08-01T19:55:05.505 INFO:teuthology.orchestra.run.smithi155.stdout: "duration": 3.7319e-05 2023-08-01T19:55:05.505 INFO:teuthology.orchestra.run.smithi155.stdout: }, 2023-08-01T19:55:05.505 INFO:teuthology.orchestra.run.smithi155.stdout: { 2023-08-01T19:55:05.506 INFO:teuthology.orchestra.run.smithi155.stdout: "event": "started", 2023-08-01T19:55:05.506 INFO:teuthology.orchestra.run.smithi155.stdout: "time": "2023-08-01T19:54:51.461802+0000", 2023-08-01T19:55:05.506 INFO:teuthology.orchestra.run.smithi155.stdout: "duration": 0.000115604 2023-08-01T19:55:05.506 INFO:teuthology.orchestra.run.smithi155.stdout: }, 2023-08-01T19:55:05.506 INFO:teuthology.orchestra.run.smithi155.stdout: { 2023-08-01T19:55:05.506 INFO:teuthology.orchestra.run.smithi155.stdout: "event": "waiting for subops from 0", 2023-08-01T19:55:05.506 INFO:teuthology.orchestra.run.smithi155.stdout: "time": "2023-08-01T19:54:51.461933+0000", 2023-08-01T19:55:05.506 INFO:teuthology.orchestra.run.smithi155.stdout: "duration": 0.000131175 2023-08-01T19:55:05.507 INFO:teuthology.orchestra.run.smithi155.stdout: }, 2023-08-01T19:55:05.507 INFO:teuthology.orchestra.run.smithi155.stdout: { 2023-08-01T19:55:05.507 INFO:teuthology.orchestra.run.smithi155.stdout: "event": "sub_op_commit_rec", 2023-08-01T19:55:05.507 INFO:teuthology.orchestra.run.smithi155.stdout: "time": "2023-08-01T19:54:51.468411+0000", 2023-08-01T19:55:05.507 INFO:teuthology.orchestra.run.smithi155.stdout: "duration": 0.0064775850000000001 2023-08-01T19:55:05.507 INFO:teuthology.orchestra.run.smithi155.stdout: }, 2023-08-01T19:55:05.507 INFO:teuthology.orchestra.run.smithi155.stdout: { 2023-08-01T19:55:05.508 INFO:teuthology.orchestra.run.smithi155.stdout: "event": "op_commit", 2023-08-01T19:55:05.508 INFO:teuthology.orchestra.run.smithi155.stdout: "time": "2023-08-01T19:54:51.485340+0000", 2023-08-01T19:55:05.508 INFO:teuthology.orchestra.run.smithi155.stdout: "duration": 0.016928907 2023-08-01T19:55:05.508 INFO:teuthology.orchestra.run.smithi155.stdout: }, 2023-08-01T19:55:05.508 INFO:teuthology.orchestra.run.smithi155.stdout: { 2023-08-01T19:55:05.508 INFO:teuthology.orchestra.run.smithi155.stdout: "event": "commit_sent", 2023-08-01T19:55:05.508 INFO:teuthology.orchestra.run.smithi155.stdout: "time": "2023-08-01T19:54:51.485385+0000", 2023-08-01T19:55:05.508 INFO:teuthology.orchestra.run.smithi155.stdout: "duration": 4.5222000000000002e-05 2023-08-01T19:55:05.509 INFO:teuthology.orchestra.run.smithi155.stdout: }, 2023-08-01T19:55:05.509 INFO:teuthology.orchestra.run.smithi155.stdout: { 2023-08-01T19:55:05.509 INFO:teuthology.orchestra.run.smithi155.stdout: "event": "done", 2023-08-01T19:55:05.509 INFO:teuthology.orchestra.run.smithi155.stdout: "time": "2023-08-01T19:54:51.485420+0000", 2023-08-01T19:55:05.509 INFO:teuthology.orchestra.run.smithi155.stdout: "duration": 3.4717e-05 2023-08-01T19:55:05.509 INFO:teuthology.orchestra.run.smithi155.stdout: } 2023-08-01T19:55:05.509 INFO:teuthology.orchestra.run.smithi155.stdout: ] 2023-08-01T19:55:05.509 INFO:teuthology.orchestra.run.smithi155.stdout: } 2023-08-01T19:55:05.510 INFO:teuthology.orchestra.run.smithi155.stdout: }, 2023-08-01T19:55:05.510 INFO:teuthology.orchestra.run.smithi155.stdout: { 2023-08-01T19:55:05.510 INFO:teuthology.orchestra.run.smithi155.stdout: "description": "osd_op(client.4668.0:73458 5.e 5:7e500c47:::benchmark_data_smithi006_114134_object73457:head [set-alloc-hint object_size 65536 write_size 65536,write 0~65536] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e31)", 2023-08-01T19:55:05.510 INFO:teuthology.orchestra.run.smithi155.stdout: "initiated_at": "2023-08-01T19:54:51.461880+0000", 2023-08-01T19:55:05.510 INFO:teuthology.orchestra.run.smithi155.stdout: "age": 14.012718904, 2023-08-01T19:55:05.510 INFO:teuthology.orchestra.run.smithi155.stdout: "duration": 0.020850289000000001, 2023-08-01T19:55:05.510 INFO:teuthology.orchestra.run.smithi155.stdout: "type_data": { 2023-08-01T19:55:05.510 INFO:teuthology.orchestra.run.smithi155.stdout: "flag_point": "commit sent; apply or cleanup", 2023-08-01T19:55:05.511 INFO:teuthology.orchestra.run.smithi155.stdout: "client_info": { 2023-08-01T19:55:05.511 INFO:teuthology.orchestra.run.smithi155.stdout: "client": "client.4668", 2023-08-01T19:55:05.511 INFO:teuthology.orchestra.run.smithi155.stdout: "client_addr": "172.21.15.6:0/1709472247", 2023-08-01T19:55:05.511 INFO:teuthology.orchestra.run.smithi155.stdout: "tid": 73458 2023-08-01T19:55:05.511 INFO:teuthology.orchestra.run.smithi155.stdout: }, 2023-08-01T19:55:05.511 INFO:teuthology.orchestra.run.smithi155.stdout: "events": [ 2023-08-01T19:55:05.511 INFO:teuthology.orchestra.run.smithi155.stdout: { 2023-08-01T19:55:05.511 INFO:teuthology.orchestra.run.smithi155.stdout: "event": "initiated", 2023-08-01T19:55:05.512 INFO:teuthology.orchestra.run.smithi155.stdout: "time": "2023-08-01T19:54:51.461880+0000", 2023-08-01T19:55:05.512 INFO:teuthology.orchestra.run.smithi155.stdout: "duration": 0 2023-08-01T19:55:05.512 INFO:teuthology.orchestra.run.smithi155.stdout: }, 2023-08-01T19:55:05.512 INFO:teuthology.orchestra.run.smithi155.stdout: { 2023-08-01T19:55:05.512 INFO:teuthology.orchestra.run.smithi155.stdout: "event": "throttled", 2023-08-01T19:55:05.512 INFO:teuthology.orchestra.run.smithi155.stdout: "time": "2023-08-01T19:54:51.461880+0000", 2023-08-01T19:55:05.512 INFO:teuthology.orchestra.run.smithi155.stdout: "duration": 0 2023-08-01T19:55:05.513 INFO:teuthology.orchestra.run.smithi155.stdout: }, 2023-08-01T19:55:05.513 INFO:teuthology.orchestra.run.smithi155.stdout: { 2023-08-01T19:55:05.513 INFO:teuthology.orchestra.run.smithi155.stdout: "event": "header_read", 2023-08-01T19:55:05.513 INFO:teuthology.orchestra.run.smithi155.stdout: "time": "2023-08-01T19:54:51.461879+0000", 2023-08-01T19:55:05.513 INFO:teuthology.orchestra.run.smithi155.stdout: "duration": 4294967295.999999 2023-08-01T19:55:05.513 INFO:teuthology.orchestra.run.smithi155.stdout: }, 2023-08-01T19:55:05.513 INFO:teuthology.orchestra.run.smithi155.stdout: { 2023-08-01T19:55:05.513 INFO:teuthology.orchestra.run.smithi155.stdout: "event": "all_read", 2023-08-01T19:55:05.514 INFO:teuthology.orchestra.run.smithi155.stdout: "time": "2023-08-01T19:54:51.461950+0000", 2023-08-01T19:55:05.514 INFO:teuthology.orchestra.run.smithi155.stdout: "duration": 7.1371999999999994e-05 2023-08-01T19:55:05.514 INFO:teuthology.orchestra.run.smithi155.stdout: }, 2023-08-01T19:55:05.514 INFO:teuthology.orchestra.run.smithi155.stdout: { 2023-08-01T19:55:05.514 INFO:teuthology.orchestra.run.smithi155.stdout: "event": "dispatched", 2023-08-01T19:55:05.514 INFO:teuthology.orchestra.run.smithi155.stdout: "time": "2023-08-01T19:54:51.461962+0000", 2023-08-01T19:55:05.514 INFO:teuthology.orchestra.run.smithi155.stdout: "duration": 1.2193e-05 2023-08-01T19:55:05.514 INFO:teuthology.orchestra.run.smithi155.stdout: }, 2023-08-01T19:55:05.515 INFO:teuthology.orchestra.run.smithi155.stdout: { 2023-08-01T19:55:05.515 INFO:teuthology.orchestra.run.smithi155.stdout: "event": "queued_for_pg", 2023-08-01T19:55:05.515 INFO:teuthology.orchestra.run.smithi155.stdout: "time": "2023-08-01T19:54:51.461969+0000", 2023-08-01T19:55:05.515 INFO:teuthology.orchestra.run.smithi155.stdout: "duration": 6.6880000000000002e-06 2023-08-01T19:55:05.515 INFO:teuthology.orchestra.run.smithi155.stdout: }, 2023-08-01T19:55:05.515 INFO:teuthology.orchestra.run.smithi155.stdout: { 2023-08-01T19:55:05.515 INFO:teuthology.orchestra.run.smithi155.stdout: "event": "reached_pg", 2023-08-01T19:55:05.515 INFO:teuthology.orchestra.run.smithi155.stdout: "time": "2023-08-01T19:54:51.462013+0000", 2023-08-01T19:55:05.516 INFO:teuthology.orchestra.run.smithi155.stdout: "duration": 4.4227999999999997e-05 2023-08-01T19:55:05.516 INFO:teuthology.orchestra.run.smithi155.stdout: }, 2023-08-01T19:55:05.516 INFO:teuthology.orchestra.run.smithi155.stdout: { 2023-08-01T19:55:05.516 INFO:teuthology.orchestra.run.smithi155.stdout: "event": "started", 2023-08-01T19:55:05.516 INFO:teuthology.orchestra.run.smithi155.stdout: "time": "2023-08-01T19:54:51.462144+0000", 2023-08-01T19:55:05.516 INFO:teuthology.orchestra.run.smithi155.stdout: "duration": 0.000130545 2023-08-01T19:55:05.516 INFO:teuthology.orchestra.run.smithi155.stdout: }, 2023-08-01T19:55:05.516 INFO:teuthology.orchestra.run.smithi155.stdout: { 2023-08-01T19:55:05.517 INFO:teuthology.orchestra.run.smithi155.stdout: "event": "waiting for subops from 0", 2023-08-01T19:55:05.517 INFO:teuthology.orchestra.run.smithi155.stdout: "time": "2023-08-01T19:54:51.462334+0000", 2023-08-01T19:55:05.517 INFO:teuthology.orchestra.run.smithi155.stdout: "duration": 0.00019000000000000001 2023-08-01T19:55:05.517 INFO:teuthology.orchestra.run.smithi155.stdout: }, 2023-08-01T19:55:05.517 INFO:teuthology.orchestra.run.smithi155.stdout: { 2023-08-01T19:55:05.517 INFO:teuthology.orchestra.run.smithi155.stdout: "event": "sub_op_commit_rec", 2023-08-01T19:55:05.517 INFO:teuthology.orchestra.run.smithi155.stdout: "time": "2023-08-01T19:54:51.470224+0000", 2023-08-01T19:55:05.517 INFO:teuthology.orchestra.run.smithi155.stdout: "duration": 0.0078904000000000005 2023-08-01T19:55:05.518 INFO:teuthology.orchestra.run.smithi155.stdout: }, 2023-08-01T19:55:05.518 INFO:teuthology.orchestra.run.smithi155.stdout: { 2023-08-01T19:55:05.518 INFO:teuthology.orchestra.run.smithi155.stdout: "event": "op_commit", 2023-08-01T19:55:05.518 INFO:teuthology.orchestra.run.smithi155.stdout: "time": "2023-08-01T19:54:51.482650+0000", 2023-08-01T19:55:05.518 INFO:teuthology.orchestra.run.smithi155.stdout: "duration": 0.012425607 2023-08-01T19:55:05.518 INFO:teuthology.orchestra.run.smithi155.stdout: }, 2023-08-01T19:55:05.518 INFO:teuthology.orchestra.run.smithi155.stdout: { 2023-08-01T19:55:05.518 INFO:teuthology.orchestra.run.smithi155.stdout: "event": "commit_sent", 2023-08-01T19:55:05.519 INFO:teuthology.orchestra.run.smithi155.stdout: "time": "2023-08-01T19:54:51.482692+0000", 2023-08-01T19:55:05.519 INFO:teuthology.orchestra.run.smithi155.stdout: "duration": 4.1844000000000001e-05 2023-08-01T19:55:05.519 INFO:teuthology.orchestra.run.smithi155.stdout: }, 2023-08-01T19:55:05.519 INFO:teuthology.orchestra.run.smithi155.stdout: { 2023-08-01T19:55:05.519 INFO:teuthology.orchestra.run.smithi155.stdout: "event": "done", 2023-08-01T19:55:05.519 INFO:teuthology.orchestra.run.smithi155.stdout: "time": "2023-08-01T19:54:51.482730+0000", 2023-08-01T19:55:05.519 INFO:teuthology.orchestra.run.smithi155.stdout: "duration": 3.8223000000000003e-05 2023-08-01T19:55:05.520 INFO:teuthology.orchestra.run.smithi155.stdout: } 2023-08-01T19:55:05.520 INFO:teuthology.orchestra.run.smithi155.stdout: ] 2023-08-01T19:55:05.520 INFO:teuthology.orchestra.run.smithi155.stdout: } 2023-08-01T19:55:05.520 INFO:teuthology.orchestra.run.smithi155.stdout: }, 2023-08-01T19:55:05.520 INFO:teuthology.orchestra.run.smithi155.stdout: { 2023-08-01T19:55:05.520 INFO:teuthology.orchestra.run.smithi155.stdout: "description": "osd_op(client.4668.0:73461 5.8 5:1836657a:::benchmark_data_smithi006_114134_object73460:head [set-alloc-hint object_size 65536 write_size 65536,write 0~65536] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e31)", 2023-08-01T19:55:05.520 INFO:teuthology.orchestra.run.smithi155.stdout: "initiated_at": "2023-08-01T19:54:51.463336+0000", 2023-08-01T19:55:05.520 INFO:teuthology.orchestra.run.smithi155.stdout: "age": 14.011262623, 2023-08-01T19:55:05.521 INFO:teuthology.orchestra.run.smithi155.stdout: "duration": 0.022268217, 2023-08-01T19:55:05.521 INFO:teuthology.orchestra.run.smithi155.stdout: "type_data": { 2023-08-01T19:55:05.521 INFO:teuthology.orchestra.run.smithi155.stdout: "flag_point": "commit sent; apply or cleanup", 2023-08-01T19:55:05.521 INFO:teuthology.orchestra.run.smithi155.stdout: "client_info": { 2023-08-01T19:55:05.521 INFO:teuthology.orchestra.run.smithi155.stdout: "client": "client.4668", 2023-08-01T19:55:05.521 INFO:teuthology.orchestra.run.smithi155.stdout: "client_addr": "172.21.15.6:0/1709472247", 2023-08-01T19:55:05.521 INFO:teuthology.orchestra.run.smithi155.stdout: "tid": 73461 2023-08-01T19:55:05.521 INFO:teuthology.orchestra.run.smithi155.stdout: }, 2023-08-01T19:55:05.522 INFO:teuthology.orchestra.run.smithi155.stdout: "events": [ 2023-08-01T19:55:05.522 INFO:teuthology.orchestra.run.smithi155.stdout: { 2023-08-01T19:55:05.522 INFO:teuthology.orchestra.run.smithi155.stdout: "event": "initiated", 2023-08-01T19:55:05.522 INFO:teuthology.orchestra.run.smithi155.stdout: "time": "2023-08-01T19:54:51.463336+0000", 2023-08-01T19:55:05.522 INFO:teuthology.orchestra.run.smithi155.stdout: "duration": 0 2023-08-01T19:55:05.522 INFO:teuthology.orchestra.run.smithi155.stdout: }, 2023-08-01T19:55:05.522 INFO:teuthology.orchestra.run.smithi155.stdout: { 2023-08-01T19:55:05.522 INFO:teuthology.orchestra.run.smithi155.stdout: "event": "throttled", 2023-08-01T19:55:05.523 INFO:teuthology.orchestra.run.smithi155.stdout: "time": "2023-08-01T19:54:51.463336+0000", 2023-08-01T19:55:05.523 INFO:teuthology.orchestra.run.smithi155.stdout: "duration": 0 2023-08-01T19:55:05.523 INFO:teuthology.orchestra.run.smithi155.stdout: }, 2023-08-01T19:55:05.523 INFO:teuthology.orchestra.run.smithi155.stdout: { 2023-08-01T19:55:05.523 INFO:teuthology.orchestra.run.smithi155.stdout: "event": "header_read", 2023-08-01T19:55:05.523 INFO:teuthology.orchestra.run.smithi155.stdout: "time": "2023-08-01T19:54:51.463335+0000", 2023-08-01T19:55:05.523 INFO:teuthology.orchestra.run.smithi155.stdout: "duration": 4294967295.999999 2023-08-01T19:55:05.523 INFO:teuthology.orchestra.run.smithi155.stdout: }, 2023-08-01T19:55:05.524 INFO:teuthology.orchestra.run.smithi155.stdout: { 2023-08-01T19:55:05.524 INFO:teuthology.orchestra.run.smithi155.stdout: "event": "all_read", 2023-08-01T19:55:05.524 INFO:teuthology.orchestra.run.smithi155.stdout: "time": "2023-08-01T19:54:51.463437+0000", 2023-08-01T19:55:05.524 INFO:teuthology.orchestra.run.smithi155.stdout: "duration": 0.00010173700000000001 2023-08-01T19:55:05.524 INFO:teuthology.orchestra.run.smithi155.stdout: }, 2023-08-01T19:55:05.524 INFO:teuthology.orchestra.run.smithi155.stdout: { 2023-08-01T19:55:05.524 INFO:teuthology.orchestra.run.smithi155.stdout: "event": "dispatched", 2023-08-01T19:55:05.525 INFO:teuthology.orchestra.run.smithi155.stdout: "time": "2023-08-01T19:54:51.463448+0000", 2023-08-01T19:55:05.525 INFO:teuthology.orchestra.run.smithi155.stdout: "duration": 1.171e-05 2023-08-01T19:55:05.525 INFO:teuthology.orchestra.run.smithi155.stdout: }, 2023-08-01T19:55:05.525 INFO:teuthology.orchestra.run.smithi155.stdout: { 2023-08-01T19:55:05.525 INFO:teuthology.orchestra.run.smithi155.stdout: "event": "queued_for_pg", 2023-08-01T19:55:05.525 INFO:teuthology.orchestra.run.smithi155.stdout: "time": "2023-08-01T19:54:51.463454+0000", 2023-08-01T19:55:05.525 INFO:teuthology.orchestra.run.smithi155.stdout: "duration": 6.0959999999999997e-06 2023-08-01T19:55:05.525 INFO:teuthology.orchestra.run.smithi155.stdout: }, 2023-08-01T19:55:05.526 INFO:teuthology.orchestra.run.smithi155.stdout: { 2023-08-01T19:55:05.526 INFO:teuthology.orchestra.run.smithi155.stdout: "event": "reached_pg", 2023-08-01T19:55:05.526 INFO:teuthology.orchestra.run.smithi155.stdout: "time": "2023-08-01T19:54:51.463491+0000", 2023-08-01T19:55:05.526 INFO:teuthology.orchestra.run.smithi155.stdout: "duration": 3.6365999999999997e-05 2023-08-01T19:55:05.526 INFO:teuthology.orchestra.run.smithi155.stdout: }, 2023-08-01T19:55:05.526 INFO:teuthology.orchestra.run.smithi155.stdout: { 2023-08-01T19:55:05.526 INFO:teuthology.orchestra.run.smithi155.stdout: "event": "started", 2023-08-01T19:55:05.526 INFO:teuthology.orchestra.run.smithi155.stdout: "time": "2023-08-01T19:54:51.463610+0000", 2023-08-01T19:55:05.527 INFO:teuthology.orchestra.run.smithi155.stdout: "duration": 0.000119517 2023-08-01T19:55:05.527 INFO:teuthology.orchestra.run.smithi155.stdout: }, 2023-08-01T19:55:05.527 INFO:teuthology.orchestra.run.smithi155.stdout: { 2023-08-01T19:55:05.527 INFO:teuthology.orchestra.run.smithi155.stdout: "event": "waiting for subops from 0", 2023-08-01T19:55:05.527 INFO:teuthology.orchestra.run.smithi155.stdout: "time": "2023-08-01T19:54:51.463746+0000", 2023-08-01T19:55:05.527 INFO:teuthology.orchestra.run.smithi155.stdout: "duration": 0.000136179 2023-08-01T19:55:05.527 INFO:teuthology.orchestra.run.smithi155.stdout: }, 2023-08-01T19:55:05.527 INFO:teuthology.orchestra.run.smithi155.stdout: { 2023-08-01T19:55:05.528 INFO:teuthology.orchestra.run.smithi155.stdout: "event": "sub_op_commit_rec", 2023-08-01T19:55:05.528 INFO:teuthology.orchestra.run.smithi155.stdout: "time": "2023-08-01T19:54:51.480388+0000", 2023-08-01T19:55:05.528 INFO:teuthology.orchestra.run.smithi155.stdout: "duration": 0.016641810999999999 2023-08-01T19:55:05.528 INFO:teuthology.orchestra.run.smithi155.stdout: }, 2023-08-01T19:55:05.528 INFO:teuthology.orchestra.run.smithi155.stdout: { 2023-08-01T19:55:05.528 INFO:teuthology.orchestra.run.smithi155.stdout: "event": "op_commit", 2023-08-01T19:55:05.528 INFO:teuthology.orchestra.run.smithi155.stdout: "time": "2023-08-01T19:54:51.485526+0000", 2023-08-01T19:55:05.529 INFO:teuthology.orchestra.run.smithi155.stdout: "duration": 0.0051382759999999998 2023-08-01T19:55:05.529 INFO:teuthology.orchestra.run.smithi155.stdout: }, 2023-08-01T19:55:05.529 INFO:teuthology.orchestra.run.smithi155.stdout: { 2023-08-01T19:55:05.529 INFO:teuthology.orchestra.run.smithi155.stdout: "event": "commit_sent", 2023-08-01T19:55:05.529 INFO:teuthology.orchestra.run.smithi155.stdout: "time": "2023-08-01T19:54:51.485569+0000", 2023-08-01T19:55:05.529 INFO:teuthology.orchestra.run.smithi155.stdout: "duration": 4.2840999999999999e-05 2023-08-01T19:55:05.529 INFO:teuthology.orchestra.run.smithi155.stdout: }, 2023-08-01T19:55:05.529 INFO:teuthology.orchestra.run.smithi155.stdout: { 2023-08-01T19:55:05.530 INFO:teuthology.orchestra.run.smithi155.stdout: "event": "done", 2023-08-01T19:55:05.530 INFO:teuthology.orchestra.run.smithi155.stdout: "time": "2023-08-01T19:54:51.485604+0000", 2023-08-01T19:55:05.530 INFO:teuthology.orchestra.run.smithi155.stdout: "duration": 3.4731999999999999e-05 2023-08-01T19:55:05.530 INFO:teuthology.orchestra.run.smithi155.stdout: } 2023-08-01T19:55:05.530 INFO:teuthology.orchestra.run.smithi155.stdout: ] 2023-08-01T19:55:05.530 INFO:teuthology.orchestra.run.smithi155.stdout: } 2023-08-01T19:55:05.530 INFO:teuthology.orchestra.run.smithi155.stdout: }, 2023-08-01T19:55:05.530 INFO:teuthology.orchestra.run.smithi155.stdout: { 2023-08-01T19:55:05.531 INFO:teuthology.orchestra.run.smithi155.stdout: "description": "osd_op(client.4668.0:73462 5.0 5:01d74876:::benchmark_data_smithi006_114134_object73461:head [set-alloc-hint object_size 65536 write_size 65536,write 0~65536] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e31)", 2023-08-01T19:55:05.531 INFO:teuthology.orchestra.run.smithi155.stdout: "initiated_at": "2023-08-01T19:54:51.463648+0000", 2023-08-01T19:55:05.531 INFO:teuthology.orchestra.run.smithi155.stdout: "age": 14.010950925, 2023-08-01T19:55:05.531 INFO:teuthology.orchestra.run.smithi155.stdout: "duration": 0.021868533999999999, 2023-08-01T19:55:05.531 INFO:teuthology.orchestra.run.smithi155.stdout: "type_data": { 2023-08-01T19:55:05.531 INFO:teuthology.orchestra.run.smithi155.stdout: "flag_point": "commit sent; apply or cleanup", 2023-08-01T19:55:05.531 INFO:teuthology.orchestra.run.smithi155.stdout: "client_info": { 2023-08-01T19:55:05.531 INFO:teuthology.orchestra.run.smithi155.stdout: "client": "client.4668", 2023-08-01T19:55:05.532 INFO:teuthology.orchestra.run.smithi155.stdout: "client_addr": "172.21.15.6:0/1709472247", 2023-08-01T19:55:05.532 INFO:teuthology.orchestra.run.smithi155.stdout: "tid": 73462 2023-08-01T19:55:05.532 INFO:teuthology.orchestra.run.smithi155.stdout: }, 2023-08-01T19:55:05.532 INFO:teuthology.orchestra.run.smithi155.stdout: "events": [ 2023-08-01T19:55:05.532 INFO:teuthology.orchestra.run.smithi155.stdout: { 2023-08-01T19:55:05.532 INFO:teuthology.orchestra.run.smithi155.stdout: "event": "initiated", 2023-08-01T19:55:05.532 INFO:teuthology.orchestra.run.smithi155.stdout: "time": "2023-08-01T19:54:51.463648+0000", 2023-08-01T19:55:05.533 INFO:teuthology.orchestra.run.smithi155.stdout: "duration": 0 2023-08-01T19:55:05.533 INFO:teuthology.orchestra.run.smithi155.stdout: }, 2023-08-01T19:55:05.533 INFO:teuthology.orchestra.run.smithi155.stdout: { 2023-08-01T19:55:05.533 INFO:teuthology.orchestra.run.smithi155.stdout: "event": "throttled", 2023-08-01T19:55:05.533 INFO:teuthology.orchestra.run.smithi155.stdout: "time": "2023-08-01T19:54:51.463648+0000", 2023-08-01T19:55:05.533 INFO:teuthology.orchestra.run.smithi155.stdout: "duration": 0 2023-08-01T19:55:05.533 INFO:teuthology.orchestra.run.smithi155.stdout: }, 2023-08-01T19:55:05.533 INFO:teuthology.orchestra.run.smithi155.stdout: { 2023-08-01T19:55:05.534 INFO:teuthology.orchestra.run.smithi155.stdout: "event": "header_read", 2023-08-01T19:55:05.534 INFO:teuthology.orchestra.run.smithi155.stdout: "time": "2023-08-01T19:54:51.463646+0000", 2023-08-01T19:55:05.534 INFO:teuthology.orchestra.run.smithi155.stdout: "duration": 4294967295.999999 2023-08-01T19:55:05.534 INFO:teuthology.orchestra.run.smithi155.stdout: }, 2023-08-01T19:55:05.534 INFO:teuthology.orchestra.run.smithi155.stdout: { 2023-08-01T19:55:05.534 INFO:teuthology.orchestra.run.smithi155.stdout: "event": "all_read", 2023-08-01T19:55:05.534 INFO:teuthology.orchestra.run.smithi155.stdout: "time": "2023-08-01T19:54:51.463706+0000", 2023-08-01T19:55:05.534 INFO:teuthology.orchestra.run.smithi155.stdout: "duration": 6.0010000000000003e-05 2023-08-01T19:55:05.535 INFO:teuthology.orchestra.run.smithi155.stdout: }, 2023-08-01T19:55:05.535 INFO:teuthology.orchestra.run.smithi155.stdout: { 2023-08-01T19:55:05.535 INFO:teuthology.orchestra.run.smithi155.stdout: "event": "dispatched", 2023-08-01T19:55:05.535 INFO:teuthology.orchestra.run.smithi155.stdout: "time": "2023-08-01T19:54:51.463715+0000", 2023-08-01T19:55:05.535 INFO:teuthology.orchestra.run.smithi155.stdout: "duration": 8.5089999999999993e-06 2023-08-01T19:55:05.535 INFO:teuthology.orchestra.run.smithi155.stdout: }, 2023-08-01T19:55:05.535 INFO:teuthology.orchestra.run.smithi155.stdout: { 2023-08-01T19:55:05.535 INFO:teuthology.orchestra.run.smithi155.stdout: "event": "queued_for_pg", 2023-08-01T19:55:05.536 INFO:teuthology.orchestra.run.smithi155.stdout: "time": "2023-08-01T19:54:51.463720+0000", 2023-08-01T19:55:05.536 INFO:teuthology.orchestra.run.smithi155.stdout: "duration": 4.95e-06 2023-08-01T19:55:05.536 INFO:teuthology.orchestra.run.smithi155.stdout: }, 2023-08-01T19:55:05.536 INFO:teuthology.orchestra.run.smithi155.stdout: { 2023-08-01T19:55:05.536 INFO:teuthology.orchestra.run.smithi155.stdout: "event": "reached_pg", 2023-08-01T19:55:05.536 INFO:teuthology.orchestra.run.smithi155.stdout: "time": "2023-08-01T19:54:51.468441+0000", 2023-08-01T19:55:05.536 INFO:teuthology.orchestra.run.smithi155.stdout: "duration": 0.0047213819999999997 2023-08-01T19:55:05.536 INFO:teuthology.orchestra.run.smithi155.stdout: }, 2023-08-01T19:55:05.537 INFO:teuthology.orchestra.run.smithi155.stdout: { 2023-08-01T19:55:05.537 INFO:teuthology.orchestra.run.smithi155.stdout: "event": "started", 2023-08-01T19:55:05.537 INFO:teuthology.orchestra.run.smithi155.stdout: "time": "2023-08-01T19:54:51.468553+0000", 2023-08-01T19:55:05.537 INFO:teuthology.orchestra.run.smithi155.stdout: "duration": 0.000111462 2023-08-01T19:55:05.537 INFO:teuthology.orchestra.run.smithi155.stdout: }, 2023-08-01T19:55:05.537 INFO:teuthology.orchestra.run.smithi155.stdout: { 2023-08-01T19:55:05.537 INFO:teuthology.orchestra.run.smithi155.stdout: "event": "waiting for subops from 0", 2023-08-01T19:55:05.538 INFO:teuthology.orchestra.run.smithi155.stdout: "time": "2023-08-01T19:54:51.468697+0000", 2023-08-01T19:55:05.538 INFO:teuthology.orchestra.run.smithi155.stdout: "duration": 0.000144411 2023-08-01T19:55:05.538 INFO:teuthology.orchestra.run.smithi155.stdout: }, 2023-08-01T19:55:05.538 INFO:teuthology.orchestra.run.smithi155.stdout: { 2023-08-01T19:55:05.538 INFO:teuthology.orchestra.run.smithi155.stdout: "event": "sub_op_commit_rec", 2023-08-01T19:55:05.538 INFO:teuthology.orchestra.run.smithi155.stdout: "time": "2023-08-01T19:54:51.480377+0000", 2023-08-01T19:55:05.538 INFO:teuthology.orchestra.run.smithi155.stdout: "duration": 0.011680106000000001 2023-08-01T19:55:05.538 INFO:teuthology.orchestra.run.smithi155.stdout: }, 2023-08-01T19:55:05.539 INFO:teuthology.orchestra.run.smithi155.stdout: { 2023-08-01T19:55:05.539 INFO:teuthology.orchestra.run.smithi155.stdout: "event": "op_commit", 2023-08-01T19:55:05.539 INFO:teuthology.orchestra.run.smithi155.stdout: "time": "2023-08-01T19:54:51.485427+0000", 2023-08-01T19:55:05.539 INFO:teuthology.orchestra.run.smithi155.stdout: "duration": 0.005049998 2023-08-01T19:55:05.539 INFO:teuthology.orchestra.run.smithi155.stdout: }, 2023-08-01T19:55:05.539 INFO:teuthology.orchestra.run.smithi155.stdout: { 2023-08-01T19:55:05.539 INFO:teuthology.orchestra.run.smithi155.stdout: "event": "commit_sent", 2023-08-01T19:55:05.539 INFO:teuthology.orchestra.run.smithi155.stdout: "time": "2023-08-01T19:54:51.485485+0000", 2023-08-01T19:55:05.540 INFO:teuthology.orchestra.run.smithi155.stdout: "duration": 5.8199999999999998e-05 2023-08-01T19:55:05.540 INFO:teuthology.orchestra.run.smithi155.stdout: }, 2023-08-01T19:55:05.540 INFO:teuthology.orchestra.run.smithi155.stdout: { 2023-08-01T19:55:05.540 INFO:teuthology.orchestra.run.smithi155.stdout: "event": "done", 2023-08-01T19:55:05.540 INFO:teuthology.orchestra.run.smithi155.stdout: "time": "2023-08-01T19:54:51.485516+0000", 2023-08-01T19:55:05.540 INFO:teuthology.orchestra.run.smithi155.stdout: "duration": 3.0602999999999998e-05 2023-08-01T19:55:05.540 INFO:teuthology.orchestra.run.smithi155.stdout: } 2023-08-01T19:55:05.540 INFO:teuthology.orchestra.run.smithi155.stdout: ] 2023-08-01T19:55:05.541 INFO:teuthology.orchestra.run.smithi155.stdout: } 2023-08-01T19:55:05.541 INFO:teuthology.orchestra.run.smithi155.stdout: }, 2023-08-01T19:55:05.541 INFO:teuthology.orchestra.run.smithi155.stdout: { 2023-08-01T19:55:05.541 INFO:teuthology.orchestra.run.smithi155.stdout: "description": "osd_op(client.4668.0:73465 5.8 5:1617a69f:::benchmark_data_smithi006_114134_object73464:head [set-alloc-hint object_size 65536 write_size 65536,write 0~65536] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e31)", 2023-08-01T19:55:05.541 INFO:teuthology.orchestra.run.smithi155.stdout: "initiated_at": "2023-08-01T19:54:51.465724+0000", 2023-08-01T19:55:05.541 INFO:teuthology.orchestra.run.smithi155.stdout: "age": 14.008874692999999, 2023-08-01T19:55:05.541 INFO:teuthology.orchestra.run.smithi155.stdout: "duration": 0.019964584, 2023-08-01T19:55:05.541 INFO:teuthology.orchestra.run.smithi155.stdout: "type_data": { 2023-08-01T19:55:05.542 INFO:teuthology.orchestra.run.smithi155.stdout: "flag_point": "commit sent; apply or cleanup", 2023-08-01T19:55:05.542 INFO:teuthology.orchestra.run.smithi155.stdout: "client_info": { 2023-08-01T19:55:05.542 INFO:teuthology.orchestra.run.smithi155.stdout: "client": "client.4668", 2023-08-01T19:55:05.542 INFO:teuthology.orchestra.run.smithi155.stdout: "client_addr": "172.21.15.6:0/1709472247", 2023-08-01T19:55:05.542 INFO:teuthology.orchestra.run.smithi155.stdout: "tid": 73465 2023-08-01T19:55:05.542 INFO:teuthology.orchestra.run.smithi155.stdout: }, 2023-08-01T19:55:05.542 INFO:teuthology.orchestra.run.smithi155.stdout: "events": [ 2023-08-01T19:55:05.542 INFO:teuthology.orchestra.run.smithi155.stdout: { 2023-08-01T19:55:05.543 INFO:teuthology.orchestra.run.smithi155.stdout: "event": "initiated", 2023-08-01T19:55:05.543 INFO:teuthology.orchestra.run.smithi155.stdout: "time": "2023-08-01T19:54:51.465724+0000", 2023-08-01T19:55:05.543 INFO:teuthology.orchestra.run.smithi155.stdout: "duration": 0 2023-08-01T19:55:05.543 INFO:teuthology.orchestra.run.smithi155.stdout: }, 2023-08-01T19:55:05.543 INFO:teuthology.orchestra.run.smithi155.stdout: { 2023-08-01T19:55:05.543 INFO:teuthology.orchestra.run.smithi155.stdout: "event": "throttled", 2023-08-01T19:55:05.543 INFO:teuthology.orchestra.run.smithi155.stdout: "time": "2023-08-01T19:54:51.465724+0000", 2023-08-01T19:55:05.544 INFO:teuthology.orchestra.run.smithi155.stdout: "duration": 0 2023-08-01T19:55:05.544 INFO:teuthology.orchestra.run.smithi155.stdout: }, 2023-08-01T19:55:05.544 INFO:teuthology.orchestra.run.smithi155.stdout: { 2023-08-01T19:55:05.544 INFO:teuthology.orchestra.run.smithi155.stdout: "event": "header_read", 2023-08-01T19:55:05.544 INFO:teuthology.orchestra.run.smithi155.stdout: "time": "2023-08-01T19:54:51.465723+0000", 2023-08-01T19:55:05.544 INFO:teuthology.orchestra.run.smithi155.stdout: "duration": 4294967295.9999995 2023-08-01T19:55:05.544 INFO:teuthology.orchestra.run.smithi155.stdout: }, 2023-08-01T19:55:05.544 INFO:teuthology.orchestra.run.smithi155.stdout: { 2023-08-01T19:55:05.545 INFO:teuthology.orchestra.run.smithi155.stdout: "event": "all_read", 2023-08-01T19:55:05.545 INFO:teuthology.orchestra.run.smithi155.stdout: "time": "2023-08-01T19:54:51.465868+0000", 2023-08-01T19:55:05.545 INFO:teuthology.orchestra.run.smithi155.stdout: "duration": 0.000145289 2023-08-01T19:55:05.545 INFO:teuthology.orchestra.run.smithi155.stdout: }, 2023-08-01T19:55:05.545 INFO:teuthology.orchestra.run.smithi155.stdout: { 2023-08-01T19:55:05.545 INFO:teuthology.orchestra.run.smithi155.stdout: "event": "dispatched", 2023-08-01T19:55:05.545 INFO:teuthology.orchestra.run.smithi155.stdout: "time": "2023-08-01T19:54:51.465880+0000", 2023-08-01T19:55:05.545 INFO:teuthology.orchestra.run.smithi155.stdout: "duration": 1.1378e-05 2023-08-01T19:55:05.546 INFO:teuthology.orchestra.run.smithi155.stdout: }, 2023-08-01T19:55:05.546 INFO:teuthology.orchestra.run.smithi155.stdout: { 2023-08-01T19:55:05.546 INFO:teuthology.orchestra.run.smithi155.stdout: "event": "queued_for_pg", 2023-08-01T19:55:05.546 INFO:teuthology.orchestra.run.smithi155.stdout: "time": "2023-08-01T19:54:51.465885+0000", 2023-08-01T19:55:05.546 INFO:teuthology.orchestra.run.smithi155.stdout: "duration": 4.7559999999999999e-06 2023-08-01T19:55:05.546 INFO:teuthology.orchestra.run.smithi155.stdout: }, 2023-08-01T19:55:05.546 INFO:teuthology.orchestra.run.smithi155.stdout: { 2023-08-01T19:55:05.546 INFO:teuthology.orchestra.run.smithi155.stdout: "event": "reached_pg", 2023-08-01T19:55:05.547 INFO:teuthology.orchestra.run.smithi155.stdout: "time": "2023-08-01T19:54:51.468434+0000", 2023-08-01T19:55:05.547 INFO:teuthology.orchestra.run.smithi155.stdout: "duration": 0.0025498579999999999 2023-08-01T19:55:05.547 INFO:teuthology.orchestra.run.smithi155.stdout: }, 2023-08-01T19:55:05.547 INFO:teuthology.orchestra.run.smithi155.stdout: { 2023-08-01T19:55:05.547 INFO:teuthology.orchestra.run.smithi155.stdout: "event": "started", 2023-08-01T19:55:05.547 INFO:teuthology.orchestra.run.smithi155.stdout: "time": "2023-08-01T19:54:51.468552+0000", 2023-08-01T19:55:05.547 INFO:teuthology.orchestra.run.smithi155.stdout: "duration": 0.000117992 2023-08-01T19:55:05.547 INFO:teuthology.orchestra.run.smithi155.stdout: }, 2023-08-01T19:55:05.548 INFO:teuthology.orchestra.run.smithi155.stdout: { 2023-08-01T19:55:05.548 INFO:teuthology.orchestra.run.smithi155.stdout: "event": "waiting for subops from 0", 2023-08-01T19:55:05.548 INFO:teuthology.orchestra.run.smithi155.stdout: "time": "2023-08-01T19:54:51.468697+0000", 2023-08-01T19:55:05.548 INFO:teuthology.orchestra.run.smithi155.stdout: "duration": 0.000144769 2023-08-01T19:55:05.548 INFO:teuthology.orchestra.run.smithi155.stdout: }, 2023-08-01T19:55:05.548 INFO:teuthology.orchestra.run.smithi155.stdout: { 2023-08-01T19:55:05.548 INFO:teuthology.orchestra.run.smithi155.stdout: "event": "sub_op_commit_rec", 2023-08-01T19:55:05.548 INFO:teuthology.orchestra.run.smithi155.stdout: "time": "2023-08-01T19:54:51.480446+0000", 2023-08-01T19:55:05.549 INFO:teuthology.orchestra.run.smithi155.stdout: "duration": 0.011749257000000001 2023-08-01T19:55:05.549 INFO:teuthology.orchestra.run.smithi155.stdout: }, 2023-08-01T19:55:05.549 INFO:teuthology.orchestra.run.smithi155.stdout: { 2023-08-01T19:55:05.549 INFO:teuthology.orchestra.run.smithi155.stdout: "event": "op_commit", 2023-08-01T19:55:05.549 INFO:teuthology.orchestra.run.smithi155.stdout: "time": "2023-08-01T19:54:51.485613+0000", 2023-08-01T19:55:05.549 INFO:teuthology.orchestra.run.smithi155.stdout: "duration": 0.0051662269999999998 2023-08-01T19:55:05.549 INFO:teuthology.orchestra.run.smithi155.stdout: }, 2023-08-01T19:55:05.550 INFO:teuthology.orchestra.run.smithi155.stdout: { 2023-08-01T19:55:05.550 INFO:teuthology.orchestra.run.smithi155.stdout: "event": "commit_sent", 2023-08-01T19:55:05.550 INFO:teuthology.orchestra.run.smithi155.stdout: "time": "2023-08-01T19:54:51.485655+0000", 2023-08-01T19:55:05.550 INFO:teuthology.orchestra.run.smithi155.stdout: "duration": 4.1879999999999999e-05 2023-08-01T19:55:05.550 INFO:teuthology.orchestra.run.smithi155.stdout: }, 2023-08-01T19:55:05.550 INFO:teuthology.orchestra.run.smithi155.stdout: { 2023-08-01T19:55:05.550 INFO:teuthology.orchestra.run.smithi155.stdout: "event": "done", 2023-08-01T19:55:05.550 INFO:teuthology.orchestra.run.smithi155.stdout: "time": "2023-08-01T19:54:51.485688+0000", 2023-08-01T19:55:05.551 INFO:teuthology.orchestra.run.smithi155.stdout: "duration": 3.3800999999999997e-05 2023-08-01T19:55:05.551 INFO:teuthology.orchestra.run.smithi155.stdout: } 2023-08-01T19:55:05.551 INFO:teuthology.orchestra.run.smithi155.stdout: ] 2023-08-01T19:55:05.551 INFO:teuthology.orchestra.run.smithi155.stdout: } 2023-08-01T19:55:05.551 INFO:teuthology.orchestra.run.smithi155.stdout: }, 2023-08-01T19:55:05.551 INFO:teuthology.orchestra.run.smithi155.stdout: { 2023-08-01T19:55:05.551 INFO:teuthology.orchestra.run.smithi155.stdout: "description": "osd_op(client.4668.0:75022 5.4 5:20404e0b:::benchmark_data_smithi006_114134_object75021:head [set-alloc-hint object_size 65536 write_size 65536,write 0~65536] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e32)", 2023-08-01T19:55:05.551 INFO:teuthology.orchestra.run.smithi155.stdout: "initiated_at": "2023-08-01T19:54:52.219424+0000", 2023-08-01T19:55:05.552 INFO:teuthology.orchestra.run.smithi155.stdout: "age": 13.255174196, 2023-08-01T19:55:05.552 INFO:teuthology.orchestra.run.smithi155.stdout: "duration": 0.021270407000000002, 2023-08-01T19:55:05.552 INFO:teuthology.orchestra.run.smithi155.stdout: "type_data": { 2023-08-01T19:55:05.552 INFO:teuthology.orchestra.run.smithi155.stdout: "flag_point": "commit sent; apply or cleanup", 2023-08-01T19:55:05.552 INFO:teuthology.orchestra.run.smithi155.stdout: "client_info": { 2023-08-01T19:55:05.552 INFO:teuthology.orchestra.run.smithi155.stdout: "client": "client.4668", 2023-08-01T19:55:05.552 INFO:teuthology.orchestra.run.smithi155.stdout: "client_addr": "172.21.15.6:0/1709472247", 2023-08-01T19:55:05.553 INFO:teuthology.orchestra.run.smithi155.stdout: "tid": 75022 2023-08-01T19:55:05.553 INFO:teuthology.orchestra.run.smithi155.stdout: }, 2023-08-01T19:55:05.553 INFO:teuthology.orchestra.run.smithi155.stdout: "events": [ 2023-08-01T19:55:05.553 INFO:teuthology.orchestra.run.smithi155.stdout: { 2023-08-01T19:55:05.553 INFO:teuthology.orchestra.run.smithi155.stdout: "event": "initiated", 2023-08-01T19:55:05.553 INFO:teuthology.orchestra.run.smithi155.stdout: "time": "2023-08-01T19:54:52.219424+0000", 2023-08-01T19:55:05.553 INFO:teuthology.orchestra.run.smithi155.stdout: "duration": 0 2023-08-01T19:55:05.553 INFO:teuthology.orchestra.run.smithi155.stdout: }, 2023-08-01T19:55:05.554 INFO:teuthology.orchestra.run.smithi155.stdout: { 2023-08-01T19:55:05.554 INFO:teuthology.orchestra.run.smithi155.stdout: "event": "throttled", 2023-08-01T19:55:05.554 INFO:teuthology.orchestra.run.smithi155.stdout: "time": "2023-08-01T19:54:52.219424+0000", 2023-08-01T19:55:05.554 INFO:teuthology.orchestra.run.smithi155.stdout: "duration": 0 2023-08-01T19:55:05.554 INFO:teuthology.orchestra.run.smithi155.stdout: }, 2023-08-01T19:55:05.554 INFO:teuthology.orchestra.run.smithi155.stdout: { 2023-08-01T19:55:05.554 INFO:teuthology.orchestra.run.smithi155.stdout: "event": "header_read", 2023-08-01T19:55:05.554 INFO:teuthology.orchestra.run.smithi155.stdout: "time": "2023-08-01T19:54:52.219424+0000", 2023-08-01T19:55:05.555 INFO:teuthology.orchestra.run.smithi155.stdout: "duration": 4294967295.9999995 2023-08-01T19:55:05.555 INFO:teuthology.orchestra.run.smithi155.stdout: }, 2023-08-01T19:55:05.555 INFO:teuthology.orchestra.run.smithi155.stdout: { 2023-08-01T19:55:05.555 INFO:teuthology.orchestra.run.smithi155.stdout: "event": "all_read", 2023-08-01T19:55:05.555 INFO:teuthology.orchestra.run.smithi155.stdout: "time": "2023-08-01T19:54:52.219562+0000", 2023-08-01T19:55:05.555 INFO:teuthology.orchestra.run.smithi155.stdout: "duration": 0.000137866 2023-08-01T19:55:05.555 INFO:teuthology.orchestra.run.smithi155.stdout: }, 2023-08-01T19:55:05.555 INFO:teuthology.orchestra.run.smithi155.stdout: { 2023-08-01T19:55:05.556 INFO:teuthology.orchestra.run.smithi155.stdout: "event": "dispatched", 2023-08-01T19:55:05.556 INFO:teuthology.orchestra.run.smithi155.stdout: "time": "2023-08-01T19:54:52.219569+0000", 2023-08-01T19:55:05.556 INFO:teuthology.orchestra.run.smithi155.stdout: "duration": 7.3869999999999997e-06 2023-08-01T19:55:05.556 INFO:teuthology.orchestra.run.smithi155.stdout: }, 2023-08-01T19:55:05.556 INFO:teuthology.orchestra.run.smithi155.stdout: { 2023-08-01T19:55:05.556 INFO:teuthology.orchestra.run.smithi155.stdout: "event": "queued_for_pg", 2023-08-01T19:55:05.556 INFO:teuthology.orchestra.run.smithi155.stdout: "time": "2023-08-01T19:54:52.219572+0000", 2023-08-01T19:55:05.556 INFO:teuthology.orchestra.run.smithi155.stdout: "duration": 2.9409999999999999e-06 2023-08-01T19:55:05.557 INFO:teuthology.orchestra.run.smithi155.stdout: }, 2023-08-01T19:55:05.557 INFO:teuthology.orchestra.run.smithi155.stdout: { 2023-08-01T19:55:05.557 INFO:teuthology.orchestra.run.smithi155.stdout: "event": "reached_pg", 2023-08-01T19:55:05.557 INFO:teuthology.orchestra.run.smithi155.stdout: "time": "2023-08-01T19:54:52.221622+0000", 2023-08-01T19:55:05.557 INFO:teuthology.orchestra.run.smithi155.stdout: "duration": 0.0020502910000000001 2023-08-01T19:55:05.557 INFO:teuthology.orchestra.run.smithi155.stdout: }, 2023-08-01T19:55:05.557 INFO:teuthology.orchestra.run.smithi155.stdout: { 2023-08-01T19:55:05.557 INFO:teuthology.orchestra.run.smithi155.stdout: "event": "started", 2023-08-01T19:55:05.558 INFO:teuthology.orchestra.run.smithi155.stdout: "time": "2023-08-01T19:54:52.221708+0000", 2023-08-01T19:55:05.558 INFO:teuthology.orchestra.run.smithi155.stdout: "duration": 8.5958999999999995e-05 2023-08-01T19:55:05.558 INFO:teuthology.orchestra.run.smithi155.stdout: }, 2023-08-01T19:55:05.558 INFO:teuthology.orchestra.run.smithi155.stdout: { 2023-08-01T19:55:05.558 INFO:teuthology.orchestra.run.smithi155.stdout: "event": "waiting for subops from 0", 2023-08-01T19:55:05.558 INFO:teuthology.orchestra.run.smithi155.stdout: "time": "2023-08-01T19:54:52.221802+0000", 2023-08-01T19:55:05.558 INFO:teuthology.orchestra.run.smithi155.stdout: "duration": 9.3521000000000001e-05 2023-08-01T19:55:05.559 INFO:teuthology.orchestra.run.smithi155.stdout: }, 2023-08-01T19:55:05.559 INFO:teuthology.orchestra.run.smithi155.stdout: { 2023-08-01T19:55:05.559 INFO:teuthology.orchestra.run.smithi155.stdout: "event": "op_commit", 2023-08-01T19:55:05.559 INFO:teuthology.orchestra.run.smithi155.stdout: "time": "2023-08-01T19:54:52.224578+0000", 2023-08-01T19:55:05.559 INFO:teuthology.orchestra.run.smithi155.stdout: "duration": 0.0027759659999999999 2023-08-01T19:55:05.559 INFO:teuthology.orchestra.run.smithi155.stdout: }, 2023-08-01T19:55:05.559 INFO:teuthology.orchestra.run.smithi155.stdout: { 2023-08-01T19:55:05.559 INFO:teuthology.orchestra.run.smithi155.stdout: "event": "sub_op_commit_rec", 2023-08-01T19:55:05.560 INFO:teuthology.orchestra.run.smithi155.stdout: "time": "2023-08-01T19:54:52.240611+0000", 2023-08-01T19:55:05.560 INFO:teuthology.orchestra.run.smithi155.stdout: "duration": 0.016033068000000001 2023-08-01T19:55:05.560 INFO:teuthology.orchestra.run.smithi155.stdout: }, 2023-08-01T19:55:05.560 INFO:teuthology.orchestra.run.smithi155.stdout: { 2023-08-01T19:55:05.560 INFO:teuthology.orchestra.run.smithi155.stdout: "event": "commit_sent", 2023-08-01T19:55:05.560 INFO:teuthology.orchestra.run.smithi155.stdout: "time": "2023-08-01T19:54:52.240659+0000", 2023-08-01T19:55:05.560 INFO:teuthology.orchestra.run.smithi155.stdout: "duration": 4.7794999999999999e-05 2023-08-01T19:55:05.560 INFO:teuthology.orchestra.run.smithi155.stdout: }, 2023-08-01T19:55:05.561 INFO:teuthology.orchestra.run.smithi155.stdout: { 2023-08-01T19:55:05.561 INFO:teuthology.orchestra.run.smithi155.stdout: "event": "done", 2023-08-01T19:55:05.561 INFO:teuthology.orchestra.run.smithi155.stdout: "time": "2023-08-01T19:54:52.240695+0000", 2023-08-01T19:55:05.561 INFO:teuthology.orchestra.run.smithi155.stdout: "duration": 3.5942000000000002e-05 2023-08-01T19:55:05.561 INFO:teuthology.orchestra.run.smithi155.stdout: } 2023-08-01T19:55:05.561 INFO:teuthology.orchestra.run.smithi155.stdout: ] 2023-08-01T19:55:05.561 INFO:teuthology.orchestra.run.smithi155.stdout: } 2023-08-01T19:55:05.561 INFO:teuthology.orchestra.run.smithi155.stdout: }, 2023-08-01T19:55:05.562 INFO:teuthology.orchestra.run.smithi155.stdout: { 2023-08-01T19:55:05.562 INFO:teuthology.orchestra.run.smithi155.stdout: "description": "osd_op(client.4668.0:75023 5.4 5:2ff1db38:::benchmark_data_smithi006_114134_object75022:head [set-alloc-hint object_size 65536 write_size 65536,write 0~65536] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e32)", 2023-08-01T19:55:05.562 INFO:teuthology.orchestra.run.smithi155.stdout: "initiated_at": "2023-08-01T19:54:52.219577+0000", 2023-08-01T19:55:05.562 INFO:teuthology.orchestra.run.smithi155.stdout: "age": 13.25502105, 2023-08-01T19:55:05.562 INFO:teuthology.orchestra.run.smithi155.stdout: "duration": 0.021226956000000002, 2023-08-01T19:55:05.562 INFO:teuthology.orchestra.run.smithi155.stdout: "type_data": { 2023-08-01T19:55:05.562 INFO:teuthology.orchestra.run.smithi155.stdout: "flag_point": "commit sent; apply or cleanup", 2023-08-01T19:55:05.563 INFO:teuthology.orchestra.run.smithi155.stdout: "client_info": { 2023-08-01T19:55:05.563 INFO:teuthology.orchestra.run.smithi155.stdout: "client": "client.4668", 2023-08-01T19:55:05.563 INFO:teuthology.orchestra.run.smithi155.stdout: "client_addr": "172.21.15.6:0/1709472247", 2023-08-01T19:55:05.563 INFO:teuthology.orchestra.run.smithi155.stdout: "tid": 75023 2023-08-01T19:55:05.563 INFO:teuthology.orchestra.run.smithi155.stdout: }, 2023-08-01T19:55:05.563 INFO:teuthology.orchestra.run.smithi155.stdout: "events": [ 2023-08-01T19:55:05.563 INFO:teuthology.orchestra.run.smithi155.stdout: { 2023-08-01T19:55:05.563 INFO:teuthology.orchestra.run.smithi155.stdout: "event": "initiated", 2023-08-01T19:55:05.564 INFO:teuthology.orchestra.run.smithi155.stdout: "time": "2023-08-01T19:54:52.219577+0000", 2023-08-01T19:55:05.564 INFO:teuthology.orchestra.run.smithi155.stdout: "duration": 0 2023-08-01T19:55:05.564 INFO:teuthology.orchestra.run.smithi155.stdout: }, 2023-08-01T19:55:05.564 INFO:teuthology.orchestra.run.smithi155.stdout: { 2023-08-01T19:55:05.564 INFO:teuthology.orchestra.run.smithi155.stdout: "event": "throttled", 2023-08-01T19:55:05.564 INFO:teuthology.orchestra.run.smithi155.stdout: "time": "2023-08-01T19:54:52.219577+0000", 2023-08-01T19:55:05.564 INFO:teuthology.orchestra.run.smithi155.stdout: "duration": 0 2023-08-01T19:55:05.564 INFO:teuthology.orchestra.run.smithi155.stdout: }, 2023-08-01T19:55:05.565 INFO:teuthology.orchestra.run.smithi155.stdout: { 2023-08-01T19:55:05.565 INFO:teuthology.orchestra.run.smithi155.stdout: "event": "header_read", 2023-08-01T19:55:05.565 INFO:teuthology.orchestra.run.smithi155.stdout: "time": "2023-08-01T19:54:52.219577+0000", 2023-08-01T19:55:05.565 INFO:teuthology.orchestra.run.smithi155.stdout: "duration": 4294967295.9999995 2023-08-01T19:55:05.565 INFO:teuthology.orchestra.run.smithi155.stdout: }, 2023-08-01T19:55:05.565 INFO:teuthology.orchestra.run.smithi155.stdout: { 2023-08-01T19:55:05.565 INFO:teuthology.orchestra.run.smithi155.stdout: "event": "all_read", 2023-08-01T19:55:05.565 INFO:teuthology.orchestra.run.smithi155.stdout: "time": "2023-08-01T19:54:52.219655+0000", 2023-08-01T19:55:05.566 INFO:teuthology.orchestra.run.smithi155.stdout: "duration": 7.7459999999999994e-05 2023-08-01T19:55:05.566 INFO:teuthology.orchestra.run.smithi155.stdout: }, 2023-08-01T19:55:05.566 INFO:teuthology.orchestra.run.smithi155.stdout: { 2023-08-01T19:55:05.566 INFO:teuthology.orchestra.run.smithi155.stdout: "event": "dispatched", 2023-08-01T19:55:05.566 INFO:teuthology.orchestra.run.smithi155.stdout: "time": "2023-08-01T19:54:52.219660+0000", 2023-08-01T19:55:05.566 INFO:teuthology.orchestra.run.smithi155.stdout: "duration": 5.0719999999999999e-06 2023-08-01T19:55:05.566 INFO:teuthology.orchestra.run.smithi155.stdout: }, 2023-08-01T19:55:05.566 INFO:teuthology.orchestra.run.smithi155.stdout: { 2023-08-01T19:55:05.567 INFO:teuthology.orchestra.run.smithi155.stdout: "event": "queued_for_pg", 2023-08-01T19:55:05.567 INFO:teuthology.orchestra.run.smithi155.stdout: "time": "2023-08-01T19:54:52.219662+0000", 2023-08-01T19:55:05.567 INFO:teuthology.orchestra.run.smithi155.stdout: "duration": 2.706e-06 2023-08-01T19:55:05.567 INFO:teuthology.orchestra.run.smithi155.stdout: }, 2023-08-01T19:55:05.567 INFO:teuthology.orchestra.run.smithi155.stdout: { 2023-08-01T19:55:05.567 INFO:teuthology.orchestra.run.smithi155.stdout: "event": "reached_pg", 2023-08-01T19:55:05.567 INFO:teuthology.orchestra.run.smithi155.stdout: "time": "2023-08-01T19:54:52.223120+0000", 2023-08-01T19:55:05.567 INFO:teuthology.orchestra.run.smithi155.stdout: "duration": 0.0034574699999999998 2023-08-01T19:55:05.568 INFO:teuthology.orchestra.run.smithi155.stdout: }, 2023-08-01T19:55:05.568 INFO:teuthology.orchestra.run.smithi155.stdout: { 2023-08-01T19:55:05.568 INFO:teuthology.orchestra.run.smithi155.stdout: "event": "started", 2023-08-01T19:55:05.568 INFO:teuthology.orchestra.run.smithi155.stdout: "time": "2023-08-01T19:54:52.223250+0000", 2023-08-01T19:55:05.568 INFO:teuthology.orchestra.run.smithi155.stdout: "duration": 0.000129751 2023-08-01T19:55:05.568 INFO:teuthology.orchestra.run.smithi155.stdout: }, 2023-08-01T19:55:05.568 INFO:teuthology.orchestra.run.smithi155.stdout: { 2023-08-01T19:55:05.569 INFO:teuthology.orchestra.run.smithi155.stdout: "event": "waiting for subops from 0", 2023-08-01T19:55:05.569 INFO:teuthology.orchestra.run.smithi155.stdout: "time": "2023-08-01T19:54:52.223406+0000", 2023-08-01T19:55:05.569 INFO:teuthology.orchestra.run.smithi155.stdout: "duration": 0.00015661599999999999 2023-08-01T19:55:05.569 INFO:teuthology.orchestra.run.smithi155.stdout: }, 2023-08-01T19:55:05.569 INFO:teuthology.orchestra.run.smithi155.stdout: { 2023-08-01T19:55:05.569 INFO:teuthology.orchestra.run.smithi155.stdout: "event": "op_commit", 2023-08-01T19:55:05.569 INFO:teuthology.orchestra.run.smithi155.stdout: "time": "2023-08-01T19:54:52.226217+0000", 2023-08-01T19:55:05.569 INFO:teuthology.orchestra.run.smithi155.stdout: "duration": 0.0028110280000000001 2023-08-01T19:55:05.570 INFO:teuthology.orchestra.run.smithi155.stdout: }, 2023-08-01T19:55:05.570 INFO:teuthology.orchestra.run.smithi155.stdout: { 2023-08-01T19:55:05.570 INFO:teuthology.orchestra.run.smithi155.stdout: "event": "sub_op_commit_rec", 2023-08-01T19:55:05.570 INFO:teuthology.orchestra.run.smithi155.stdout: "time": "2023-08-01T19:54:52.240732+0000", 2023-08-01T19:55:05.570 INFO:teuthology.orchestra.run.smithi155.stdout: "duration": 0.014515068000000001 2023-08-01T19:55:05.570 INFO:teuthology.orchestra.run.smithi155.stdout: }, 2023-08-01T19:55:05.570 INFO:teuthology.orchestra.run.smithi155.stdout: { 2023-08-01T19:55:05.570 INFO:teuthology.orchestra.run.smithi155.stdout: "event": "commit_sent", 2023-08-01T19:55:05.571 INFO:teuthology.orchestra.run.smithi155.stdout: "time": "2023-08-01T19:54:52.240766+0000", 2023-08-01T19:55:05.571 INFO:teuthology.orchestra.run.smithi155.stdout: "duration": 3.3689000000000002e-05 2023-08-01T19:55:05.571 INFO:teuthology.orchestra.run.smithi155.stdout: }, 2023-08-01T19:55:05.571 INFO:teuthology.orchestra.run.smithi155.stdout: { 2023-08-01T19:55:05.571 INFO:teuthology.orchestra.run.smithi155.stdout: "event": "done", 2023-08-01T19:55:05.571 INFO:teuthology.orchestra.run.smithi155.stdout: "time": "2023-08-01T19:54:52.240804+0000", 2023-08-01T19:55:05.571 INFO:teuthology.orchestra.run.smithi155.stdout: "duration": 3.841e-05 2023-08-01T19:55:05.571 INFO:teuthology.orchestra.run.smithi155.stdout: } 2023-08-01T19:55:05.572 INFO:teuthology.orchestra.run.smithi155.stdout: ] 2023-08-01T19:55:05.572 INFO:teuthology.orchestra.run.smithi155.stdout: } 2023-08-01T19:55:05.572 INFO:teuthology.orchestra.run.smithi155.stdout: }, 2023-08-01T19:55:05.572 INFO:teuthology.orchestra.run.smithi155.stdout: { 2023-08-01T19:55:05.572 INFO:teuthology.orchestra.run.smithi155.stdout: "description": "osd_op(client.4668.0:100237 5.4 5:2d68bec9:::benchmark_data_smithi006_114134_object100236:head [set-alloc-hint object_size 65536 write_size 65536,write 0~65536] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e37)", 2023-08-01T19:55:05.572 INFO:teuthology.orchestra.run.smithi155.stdout: "initiated_at": "2023-08-01T19:55:05.147736+0000", 2023-08-01T19:55:05.572 INFO:teuthology.orchestra.run.smithi155.stdout: "age": 0.326862139, 2023-08-01T19:55:05.572 INFO:teuthology.orchestra.run.smithi155.stdout: "duration": 0.071299464000000007, 2023-08-01T19:55:05.573 INFO:teuthology.orchestra.run.smithi155.stdout: "type_data": { 2023-08-01T19:55:05.573 INFO:teuthology.orchestra.run.smithi155.stdout: "flag_point": "commit sent; apply or cleanup", 2023-08-01T19:55:05.573 INFO:teuthology.orchestra.run.smithi155.stdout: "client_info": { 2023-08-01T19:55:05.573 INFO:teuthology.orchestra.run.smithi155.stdout: "client": "client.4668", 2023-08-01T19:55:05.573 INFO:teuthology.orchestra.run.smithi155.stdout: "client_addr": "172.21.15.6:0/1709472247", 2023-08-01T19:55:05.573 INFO:teuthology.orchestra.run.smithi155.stdout: "tid": 100237 2023-08-01T19:55:05.573 INFO:teuthology.orchestra.run.smithi155.stdout: }, 2023-08-01T19:55:05.574 INFO:teuthology.orchestra.run.smithi155.stdout: "events": [ 2023-08-01T19:55:05.574 INFO:teuthology.orchestra.run.smithi155.stdout: { 2023-08-01T19:55:05.574 INFO:teuthology.orchestra.run.smithi155.stdout: "event": "initiated", 2023-08-01T19:55:05.574 INFO:teuthology.orchestra.run.smithi155.stdout: "time": "2023-08-01T19:55:05.147736+0000", 2023-08-01T19:55:05.574 INFO:teuthology.orchestra.run.smithi155.stdout: "duration": 0 2023-08-01T19:55:05.574 INFO:teuthology.orchestra.run.smithi155.stdout: }, 2023-08-01T19:55:05.574 INFO:teuthology.orchestra.run.smithi155.stdout: { 2023-08-01T19:55:05.574 INFO:teuthology.orchestra.run.smithi155.stdout: "event": "throttled", 2023-08-01T19:55:05.575 INFO:teuthology.orchestra.run.smithi155.stdout: "time": "2023-08-01T19:55:05.147736+0000", 2023-08-01T19:55:05.575 INFO:teuthology.orchestra.run.smithi155.stdout: "duration": 0 2023-08-01T19:55:05.575 INFO:teuthology.orchestra.run.smithi155.stdout: }, 2023-08-01T19:55:05.575 INFO:teuthology.orchestra.run.smithi155.stdout: { 2023-08-01T19:55:05.575 INFO:teuthology.orchestra.run.smithi155.stdout: "event": "header_read", 2023-08-01T19:55:05.575 INFO:teuthology.orchestra.run.smithi155.stdout: "time": "2023-08-01T19:55:05.147736+0000", 2023-08-01T19:55:05.575 INFO:teuthology.orchestra.run.smithi155.stdout: "duration": 4294967295.9999995 2023-08-01T19:55:05.575 INFO:teuthology.orchestra.run.smithi155.stdout: }, 2023-08-01T19:55:05.576 INFO:teuthology.orchestra.run.smithi155.stdout: { 2023-08-01T19:55:05.576 INFO:teuthology.orchestra.run.smithi155.stdout: "event": "all_read", 2023-08-01T19:55:05.576 INFO:teuthology.orchestra.run.smithi155.stdout: "time": "2023-08-01T19:55:05.147766+0000", 2023-08-01T19:55:05.576 INFO:teuthology.orchestra.run.smithi155.stdout: "duration": 3.0394000000000001e-05 2023-08-01T19:55:05.576 INFO:teuthology.orchestra.run.smithi155.stdout: }, 2023-08-01T19:55:05.576 INFO:teuthology.orchestra.run.smithi155.stdout: { 2023-08-01T19:55:05.576 INFO:teuthology.orchestra.run.smithi155.stdout: "event": "dispatched", 2023-08-01T19:55:05.576 INFO:teuthology.orchestra.run.smithi155.stdout: "time": "2023-08-01T19:55:05.147771+0000", 2023-08-01T19:55:05.577 INFO:teuthology.orchestra.run.smithi155.stdout: "duration": 4.25e-06 2023-08-01T19:55:05.577 INFO:teuthology.orchestra.run.smithi155.stdout: }, 2023-08-01T19:55:05.577 INFO:teuthology.orchestra.run.smithi155.stdout: { 2023-08-01T19:55:05.577 INFO:teuthology.orchestra.run.smithi155.stdout: "event": "queued_for_pg", 2023-08-01T19:55:05.577 INFO:teuthology.orchestra.run.smithi155.stdout: "time": "2023-08-01T19:55:05.147773+0000", 2023-08-01T19:55:05.577 INFO:teuthology.orchestra.run.smithi155.stdout: "duration": 2.4159999999999998e-06 2023-08-01T19:55:05.577 INFO:teuthology.orchestra.run.smithi155.stdout: }, 2023-08-01T19:55:05.578 INFO:teuthology.orchestra.run.smithi155.stdout: { 2023-08-01T19:55:05.578 INFO:teuthology.orchestra.run.smithi155.stdout: "event": "reached_pg", 2023-08-01T19:55:05.578 INFO:teuthology.orchestra.run.smithi155.stdout: "time": "2023-08-01T19:55:05.149903+0000", 2023-08-01T19:55:05.578 INFO:teuthology.orchestra.run.smithi155.stdout: "duration": 0.002129948 2023-08-01T19:55:05.578 INFO:teuthology.orchestra.run.smithi155.stdout: }, 2023-08-01T19:55:05.578 INFO:teuthology.orchestra.run.smithi155.stdout: { 2023-08-01T19:55:05.578 INFO:teuthology.orchestra.run.smithi155.stdout: "event": "started", 2023-08-01T19:55:05.578 INFO:teuthology.orchestra.run.smithi155.stdout: "time": "2023-08-01T19:55:05.149982+0000", 2023-08-01T19:55:05.579 INFO:teuthology.orchestra.run.smithi155.stdout: "duration": 7.8706000000000002e-05 2023-08-01T19:55:05.579 INFO:teuthology.orchestra.run.smithi155.stdout: }, 2023-08-01T19:55:05.579 INFO:teuthology.orchestra.run.smithi155.stdout: { 2023-08-01T19:55:05.579 INFO:teuthology.orchestra.run.smithi155.stdout: "event": "waiting for subops from 0", 2023-08-01T19:55:05.579 INFO:teuthology.orchestra.run.smithi155.stdout: "time": "2023-08-01T19:55:05.150066+0000", 2023-08-01T19:55:05.579 INFO:teuthology.orchestra.run.smithi155.stdout: "duration": 8.4241999999999997e-05 2023-08-01T19:55:05.579 INFO:teuthology.orchestra.run.smithi155.stdout: }, 2023-08-01T19:55:05.579 INFO:teuthology.orchestra.run.smithi155.stdout: { 2023-08-01T19:55:05.580 INFO:teuthology.orchestra.run.smithi155.stdout: "event": "op_commit", 2023-08-01T19:55:05.580 INFO:teuthology.orchestra.run.smithi155.stdout: "time": "2023-08-01T19:55:05.154994+0000", 2023-08-01T19:55:05.580 INFO:teuthology.orchestra.run.smithi155.stdout: "duration": 0.0049277050000000001 2023-08-01T19:55:05.580 INFO:teuthology.orchestra.run.smithi155.stdout: }, 2023-08-01T19:55:05.580 INFO:teuthology.orchestra.run.smithi155.stdout: { 2023-08-01T19:55:05.580 INFO:teuthology.orchestra.run.smithi155.stdout: "event": "sub_op_commit_rec", 2023-08-01T19:55:05.580 INFO:teuthology.orchestra.run.smithi155.stdout: "time": "2023-08-01T19:55:05.218933+0000", 2023-08-01T19:55:05.580 INFO:teuthology.orchestra.run.smithi155.stdout: "duration": 0.063939916999999999 2023-08-01T19:55:05.581 INFO:teuthology.orchestra.run.smithi155.stdout: }, 2023-08-01T19:55:05.581 INFO:teuthology.orchestra.run.smithi155.stdout: { 2023-08-01T19:55:05.581 INFO:teuthology.orchestra.run.smithi155.stdout: "event": "commit_sent", 2023-08-01T19:55:05.581 INFO:teuthology.orchestra.run.smithi155.stdout: "time": "2023-08-01T19:55:05.218989+0000", 2023-08-01T19:55:05.581 INFO:teuthology.orchestra.run.smithi155.stdout: "duration": 5.5772000000000001e-05 2023-08-01T19:55:05.581 INFO:teuthology.orchestra.run.smithi155.stdout: }, 2023-08-01T19:55:05.581 INFO:teuthology.orchestra.run.smithi155.stdout: { 2023-08-01T19:55:05.582 INFO:teuthology.orchestra.run.smithi155.stdout: "event": "done", 2023-08-01T19:55:05.582 INFO:teuthology.orchestra.run.smithi155.stdout: "time": "2023-08-01T19:55:05.219036+0000", 2023-08-01T19:55:05.582 INFO:teuthology.orchestra.run.smithi155.stdout: "duration": 4.6526000000000001e-05 2023-08-01T19:55:05.582 INFO:teuthology.orchestra.run.smithi155.stdout: } 2023-08-01T19:55:05.582 INFO:teuthology.orchestra.run.smithi155.stdout: ] 2023-08-01T19:55:05.582 INFO:teuthology.orchestra.run.smithi155.stdout: } 2023-08-01T19:55:05.582 INFO:teuthology.orchestra.run.smithi155.stdout: }, 2023-08-01T19:55:05.582 INFO:teuthology.orchestra.run.smithi155.stdout: { 2023-08-01T19:55:05.583 INFO:teuthology.orchestra.run.smithi155.stdout: "description": "osd_op(client.4668.0:100242 5.8 5:16a314b8:::benchmark_data_smithi006_114134_object100241:head [set-alloc-hint object_size 65536 write_size 65536,write 0~65536] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e37)", 2023-08-01T19:55:05.583 INFO:teuthology.orchestra.run.smithi155.stdout: "initiated_at": "2023-08-01T19:55:05.150616+0000", 2023-08-01T19:55:05.583 INFO:teuthology.orchestra.run.smithi155.stdout: "age": 0.32398250899999997, 2023-08-01T19:55:05.583 INFO:teuthology.orchestra.run.smithi155.stdout: "duration": 0.071105065999999995, 2023-08-01T19:55:05.583 INFO:teuthology.orchestra.run.smithi155.stdout: "type_data": { 2023-08-01T19:55:05.583 INFO:teuthology.orchestra.run.smithi155.stdout: "flag_point": "commit sent; apply or cleanup", 2023-08-01T19:55:05.583 INFO:teuthology.orchestra.run.smithi155.stdout: "client_info": { 2023-08-01T19:55:05.583 INFO:teuthology.orchestra.run.smithi155.stdout: "client": "client.4668", 2023-08-01T19:55:05.584 INFO:teuthology.orchestra.run.smithi155.stdout: "client_addr": "172.21.15.6:0/1709472247", 2023-08-01T19:55:05.584 INFO:teuthology.orchestra.run.smithi155.stdout: "tid": 100242 2023-08-01T19:55:05.584 INFO:teuthology.orchestra.run.smithi155.stdout: }, 2023-08-01T19:55:05.584 INFO:teuthology.orchestra.run.smithi155.stdout: "events": [ 2023-08-01T19:55:05.584 INFO:teuthology.orchestra.run.smithi155.stdout: { 2023-08-01T19:55:05.584 INFO:teuthology.orchestra.run.smithi155.stdout: "event": "initiated", 2023-08-01T19:55:05.584 INFO:teuthology.orchestra.run.smithi155.stdout: "time": "2023-08-01T19:55:05.150616+0000", 2023-08-01T19:55:05.584 INFO:teuthology.orchestra.run.smithi155.stdout: "duration": 0 2023-08-01T19:55:05.585 INFO:teuthology.orchestra.run.smithi155.stdout: }, 2023-08-01T19:55:05.585 INFO:teuthology.orchestra.run.smithi155.stdout: { 2023-08-01T19:55:05.585 INFO:teuthology.orchestra.run.smithi155.stdout: "event": "throttled", 2023-08-01T19:55:05.585 INFO:teuthology.orchestra.run.smithi155.stdout: "time": "2023-08-01T19:55:05.150616+0000", 2023-08-01T19:55:05.585 INFO:teuthology.orchestra.run.smithi155.stdout: "duration": 0 2023-08-01T19:55:05.585 INFO:teuthology.orchestra.run.smithi155.stdout: }, 2023-08-01T19:55:05.585 INFO:teuthology.orchestra.run.smithi155.stdout: { 2023-08-01T19:55:05.585 INFO:teuthology.orchestra.run.smithi155.stdout: "event": "header_read", 2023-08-01T19:55:05.586 INFO:teuthology.orchestra.run.smithi155.stdout: "time": "2023-08-01T19:55:05.150615+0000", 2023-08-01T19:55:05.586 INFO:teuthology.orchestra.run.smithi155.stdout: "duration": 4294967295.999999 2023-08-01T19:55:05.586 INFO:teuthology.orchestra.run.smithi155.stdout: }, 2023-08-01T19:55:05.586 INFO:teuthology.orchestra.run.smithi155.stdout: { 2023-08-01T19:55:05.586 INFO:teuthology.orchestra.run.smithi155.stdout: "event": "all_read", 2023-08-01T19:55:05.586 INFO:teuthology.orchestra.run.smithi155.stdout: "time": "2023-08-01T19:55:05.150696+0000", 2023-08-01T19:55:05.586 INFO:teuthology.orchestra.run.smithi155.stdout: "duration": 8.0852000000000004e-05 2023-08-01T19:55:05.587 INFO:teuthology.orchestra.run.smithi155.stdout: }, 2023-08-01T19:55:05.587 INFO:teuthology.orchestra.run.smithi155.stdout: { 2023-08-01T19:55:05.587 INFO:teuthology.orchestra.run.smithi155.stdout: "event": "dispatched", 2023-08-01T19:55:05.587 INFO:teuthology.orchestra.run.smithi155.stdout: "time": "2023-08-01T19:55:05.150708+0000", 2023-08-01T19:55:05.587 INFO:teuthology.orchestra.run.smithi155.stdout: "duration": 1.2116999999999999e-05 2023-08-01T19:55:05.587 INFO:teuthology.orchestra.run.smithi155.stdout: }, 2023-08-01T19:55:05.587 INFO:teuthology.orchestra.run.smithi155.stdout: { 2023-08-01T19:55:05.587 INFO:teuthology.orchestra.run.smithi155.stdout: "event": "queued_for_pg", 2023-08-01T19:55:05.588 INFO:teuthology.orchestra.run.smithi155.stdout: "time": "2023-08-01T19:55:05.150713+0000", 2023-08-01T19:55:05.588 INFO:teuthology.orchestra.run.smithi155.stdout: "duration": 5.4620000000000004e-06 2023-08-01T19:55:05.588 INFO:teuthology.orchestra.run.smithi155.stdout: }, 2023-08-01T19:55:05.588 INFO:teuthology.orchestra.run.smithi155.stdout: { 2023-08-01T19:55:05.588 INFO:teuthology.orchestra.run.smithi155.stdout: "event": "reached_pg", 2023-08-01T19:55:05.588 INFO:teuthology.orchestra.run.smithi155.stdout: "time": "2023-08-01T19:55:05.150761+0000", 2023-08-01T19:55:05.588 INFO:teuthology.orchestra.run.smithi155.stdout: "duration": 4.7429000000000003e-05 2023-08-01T19:55:05.588 INFO:teuthology.orchestra.run.smithi155.stdout: }, 2023-08-01T19:55:05.589 INFO:teuthology.orchestra.run.smithi155.stdout: { 2023-08-01T19:55:05.589 INFO:teuthology.orchestra.run.smithi155.stdout: "event": "started", 2023-08-01T19:55:05.589 INFO:teuthology.orchestra.run.smithi155.stdout: "time": "2023-08-01T19:55:05.150856+0000", 2023-08-01T19:55:05.589 INFO:teuthology.orchestra.run.smithi155.stdout: "duration": 9.5356e-05 2023-08-01T19:55:05.589 INFO:teuthology.orchestra.run.smithi155.stdout: }, 2023-08-01T19:55:05.589 INFO:teuthology.orchestra.run.smithi155.stdout: { 2023-08-01T19:55:05.589 INFO:teuthology.orchestra.run.smithi155.stdout: "event": "waiting for subops from 0", 2023-08-01T19:55:05.589 INFO:teuthology.orchestra.run.smithi155.stdout: "time": "2023-08-01T19:55:05.150999+0000", 2023-08-01T19:55:05.590 INFO:teuthology.orchestra.run.smithi155.stdout: "duration": 0.00014234499999999999 2023-08-01T19:55:05.590 INFO:teuthology.orchestra.run.smithi155.stdout: }, 2023-08-01T19:55:05.590 INFO:teuthology.orchestra.run.smithi155.stdout: { 2023-08-01T19:55:05.590 INFO:teuthology.orchestra.run.smithi155.stdout: "event": "sub_op_commit_rec", 2023-08-01T19:55:05.590 INFO:teuthology.orchestra.run.smithi155.stdout: "time": "2023-08-01T19:55:05.219001+0000", 2023-08-01T19:55:05.590 INFO:teuthology.orchestra.run.smithi155.stdout: "duration": 0.068002776000000001 2023-08-01T19:55:05.590 INFO:teuthology.orchestra.run.smithi155.stdout: }, 2023-08-01T19:55:05.590 INFO:teuthology.orchestra.run.smithi155.stdout: { 2023-08-01T19:55:05.591 INFO:teuthology.orchestra.run.smithi155.stdout: "event": "op_commit", 2023-08-01T19:55:05.591 INFO:teuthology.orchestra.run.smithi155.stdout: "time": "2023-08-01T19:55:05.221635+0000", 2023-08-01T19:55:05.591 INFO:teuthology.orchestra.run.smithi155.stdout: "duration": 0.0026340579999999999 2023-08-01T19:55:05.591 INFO:teuthology.orchestra.run.smithi155.stdout: }, 2023-08-01T19:55:05.591 INFO:teuthology.orchestra.run.smithi155.stdout: { 2023-08-01T19:55:05.591 INFO:teuthology.orchestra.run.smithi155.stdout: "event": "commit_sent", 2023-08-01T19:55:05.591 INFO:teuthology.orchestra.run.smithi155.stdout: "time": "2023-08-01T19:55:05.221682+0000", 2023-08-01T19:55:05.592 INFO:teuthology.orchestra.run.smithi155.stdout: "duration": 4.7123999999999998e-05 2023-08-01T19:55:05.592 INFO:teuthology.orchestra.run.smithi155.stdout: }, 2023-08-01T19:55:05.592 INFO:teuthology.orchestra.run.smithi155.stdout: { 2023-08-01T19:55:05.592 INFO:teuthology.orchestra.run.smithi155.stdout: "event": "done", 2023-08-01T19:55:05.592 INFO:teuthology.orchestra.run.smithi155.stdout: "time": "2023-08-01T19:55:05.221721+0000", 2023-08-01T19:55:05.592 INFO:teuthology.orchestra.run.smithi155.stdout: "duration": 3.8529999999999999e-05 2023-08-01T19:55:05.592 INFO:teuthology.orchestra.run.smithi155.stdout: } 2023-08-01T19:55:05.592 INFO:teuthology.orchestra.run.smithi155.stdout: ] 2023-08-01T19:55:05.593 INFO:teuthology.orchestra.run.smithi155.stdout: } 2023-08-01T19:55:05.593 INFO:teuthology.orchestra.run.smithi155.stdout: }, 2023-08-01T19:55:05.593 INFO:teuthology.orchestra.run.smithi155.stdout: { 2023-08-01T19:55:05.593 INFO:teuthology.orchestra.run.smithi155.stdout: "description": "osd_repop(client.4668.0:100240 5.a e37/19 5:5313c5b9:::benchmark_data_smithi006_114134_object100239:head v 37'6227, mlcod=37'6225)", 2023-08-01T19:55:05.593 INFO:teuthology.orchestra.run.smithi155.stdout: "initiated_at": "2023-08-01T19:55:05.150778+0000", 2023-08-01T19:55:05.593 INFO:teuthology.orchestra.run.smithi155.stdout: "age": 0.323820308, 2023-08-01T19:55:05.593 INFO:teuthology.orchestra.run.smithi155.stdout: "duration": 0.073362533999999993, 2023-08-01T19:55:05.593 INFO:teuthology.orchestra.run.smithi155.stdout: "type_data": { 2023-08-01T19:55:05.594 INFO:teuthology.orchestra.run.smithi155.stdout: "flag_point": "commit sent; apply or cleanup", 2023-08-01T19:55:05.594 INFO:teuthology.orchestra.run.smithi155.stdout: "events": [ 2023-08-01T19:55:05.594 INFO:teuthology.orchestra.run.smithi155.stdout: { 2023-08-01T19:55:05.594 INFO:teuthology.orchestra.run.smithi155.stdout: "event": "initiated", 2023-08-01T19:55:05.594 INFO:teuthology.orchestra.run.smithi155.stdout: "time": "2023-08-01T19:55:05.150778+0000", 2023-08-01T19:55:05.594 INFO:teuthology.orchestra.run.smithi155.stdout: "duration": 0 2023-08-01T19:55:05.594 INFO:teuthology.orchestra.run.smithi155.stdout: }, 2023-08-01T19:55:05.594 INFO:teuthology.orchestra.run.smithi155.stdout: { 2023-08-01T19:55:05.595 INFO:teuthology.orchestra.run.smithi155.stdout: "event": "throttled", 2023-08-01T19:55:05.595 INFO:teuthology.orchestra.run.smithi155.stdout: "time": "2023-08-01T19:55:05.150778+0000", 2023-08-01T19:55:05.595 INFO:teuthology.orchestra.run.smithi155.stdout: "duration": 0 2023-08-01T19:55:05.595 INFO:teuthology.orchestra.run.smithi155.stdout: }, 2023-08-01T19:55:05.595 INFO:teuthology.orchestra.run.smithi155.stdout: { 2023-08-01T19:55:05.595 INFO:teuthology.orchestra.run.smithi155.stdout: "event": "header_read", 2023-08-01T19:55:05.595 INFO:teuthology.orchestra.run.smithi155.stdout: "time": "2023-08-01T19:55:05.150778+0000", 2023-08-01T19:55:05.595 INFO:teuthology.orchestra.run.smithi155.stdout: "duration": 4294967295.9999995 2023-08-01T19:55:05.596 INFO:teuthology.orchestra.run.smithi155.stdout: }, 2023-08-01T19:55:05.596 INFO:teuthology.orchestra.run.smithi155.stdout: { 2023-08-01T19:55:05.596 INFO:teuthology.orchestra.run.smithi155.stdout: "event": "all_read", 2023-08-01T19:55:05.596 INFO:teuthology.orchestra.run.smithi155.stdout: "time": "2023-08-01T19:55:05.150811+0000", 2023-08-01T19:55:05.596 INFO:teuthology.orchestra.run.smithi155.stdout: "duration": 3.3664000000000002e-05 2023-08-01T19:55:05.596 INFO:teuthology.orchestra.run.smithi155.stdout: }, 2023-08-01T19:55:05.596 INFO:teuthology.orchestra.run.smithi155.stdout: { 2023-08-01T19:55:05.597 INFO:teuthology.orchestra.run.smithi155.stdout: "event": "dispatched", 2023-08-01T19:55:05.597 INFO:teuthology.orchestra.run.smithi155.stdout: "time": "2023-08-01T19:55:05.150818+0000", 2023-08-01T19:55:05.597 INFO:teuthology.orchestra.run.smithi155.stdout: "duration": 6.5769999999999999e-06 2023-08-01T19:55:05.597 INFO:teuthology.orchestra.run.smithi155.stdout: }, 2023-08-01T19:55:05.597 INFO:teuthology.orchestra.run.smithi155.stdout: { 2023-08-01T19:55:05.597 INFO:teuthology.orchestra.run.smithi155.stdout: "event": "queued_for_pg", 2023-08-01T19:55:05.597 INFO:teuthology.orchestra.run.smithi155.stdout: "time": "2023-08-01T19:55:05.150822+0000", 2023-08-01T19:55:05.597 INFO:teuthology.orchestra.run.smithi155.stdout: "duration": 4.0060000000000003e-06 2023-08-01T19:55:05.598 INFO:teuthology.orchestra.run.smithi155.stdout: }, 2023-08-01T19:55:05.598 INFO:teuthology.orchestra.run.smithi155.stdout: { 2023-08-01T19:55:05.598 INFO:teuthology.orchestra.run.smithi155.stdout: "event": "reached_pg", 2023-08-01T19:55:05.598 INFO:teuthology.orchestra.run.smithi155.stdout: "time": "2023-08-01T19:55:05.150855+0000", 2023-08-01T19:55:05.598 INFO:teuthology.orchestra.run.smithi155.stdout: "duration": 3.3204999999999998e-05 2023-08-01T19:55:05.598 INFO:teuthology.orchestra.run.smithi155.stdout: }, 2023-08-01T19:55:05.598 INFO:teuthology.orchestra.run.smithi155.stdout: { 2023-08-01T19:55:05.598 INFO:teuthology.orchestra.run.smithi155.stdout: "event": "started", 2023-08-01T19:55:05.599 INFO:teuthology.orchestra.run.smithi155.stdout: "time": "2023-08-01T19:55:05.150873+0000", 2023-08-01T19:55:05.599 INFO:teuthology.orchestra.run.smithi155.stdout: "duration": 1.8139999999999999e-05 2023-08-01T19:55:05.599 INFO:teuthology.orchestra.run.smithi155.stdout: }, 2023-08-01T19:55:05.599 INFO:teuthology.orchestra.run.smithi155.stdout: { 2023-08-01T19:55:05.599 INFO:teuthology.orchestra.run.smithi155.stdout: "event": "commit_sent", 2023-08-01T19:55:05.599 INFO:teuthology.orchestra.run.smithi155.stdout: "time": "2023-08-01T19:55:05.224095+0000", 2023-08-01T19:55:05.599 INFO:teuthology.orchestra.run.smithi155.stdout: "duration": 0.073221895999999995 2023-08-01T19:55:05.600 INFO:teuthology.orchestra.run.smithi155.stdout: }, 2023-08-01T19:55:05.600 INFO:teuthology.orchestra.run.smithi155.stdout: { 2023-08-01T19:55:05.600 INFO:teuthology.orchestra.run.smithi155.stdout: "event": "done", 2023-08-01T19:55:05.600 INFO:teuthology.orchestra.run.smithi155.stdout: "time": "2023-08-01T19:55:05.224141+0000", 2023-08-01T19:55:05.600 INFO:teuthology.orchestra.run.smithi155.stdout: "duration": 4.5385e-05 2023-08-01T19:55:05.600 INFO:teuthology.orchestra.run.smithi155.stdout: } 2023-08-01T19:55:05.600 INFO:teuthology.orchestra.run.smithi155.stdout: ] 2023-08-01T19:55:05.600 INFO:teuthology.orchestra.run.smithi155.stdout: } 2023-08-01T19:55:05.601 INFO:teuthology.orchestra.run.smithi155.stdout: }, 2023-08-01T19:55:05.601 INFO:teuthology.orchestra.run.smithi155.stdout: { 2023-08-01T19:55:05.601 INFO:teuthology.orchestra.run.smithi155.stdout: "description": "osd_op(client.4668.0:100245 5.e 5:71869c66:::benchmark_data_smithi006_114134_object100244:head [set-alloc-hint object_size 65536 write_size 65536,write 0~65536] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e37)", 2023-08-01T19:55:05.601 INFO:teuthology.orchestra.run.smithi155.stdout: "initiated_at": "2023-08-01T19:55:05.150991+0000", 2023-08-01T19:55:05.601 INFO:teuthology.orchestra.run.smithi155.stdout: "age": 0.32360752100000001, 2023-08-01T19:55:05.601 INFO:teuthology.orchestra.run.smithi155.stdout: "duration": 0.070734490999999997, 2023-08-01T19:55:05.601 INFO:teuthology.orchestra.run.smithi155.stdout: "type_data": { 2023-08-01T19:55:05.601 INFO:teuthology.orchestra.run.smithi155.stdout: "flag_point": "commit sent; apply or cleanup", 2023-08-01T19:55:05.602 INFO:teuthology.orchestra.run.smithi155.stdout: "client_info": { 2023-08-01T19:55:05.602 INFO:teuthology.orchestra.run.smithi155.stdout: "client": "client.4668", 2023-08-01T19:55:05.602 INFO:teuthology.orchestra.run.smithi155.stdout: "client_addr": "172.21.15.6:0/1709472247", 2023-08-01T19:55:05.602 INFO:teuthology.orchestra.run.smithi155.stdout: "tid": 100245 2023-08-01T19:55:05.602 INFO:teuthology.orchestra.run.smithi155.stdout: }, 2023-08-01T19:55:05.602 INFO:teuthology.orchestra.run.smithi155.stdout: "events": [ 2023-08-01T19:55:05.602 INFO:teuthology.orchestra.run.smithi155.stdout: { 2023-08-01T19:55:05.602 INFO:teuthology.orchestra.run.smithi155.stdout: "event": "initiated", 2023-08-01T19:55:05.603 INFO:teuthology.orchestra.run.smithi155.stdout: "time": "2023-08-01T19:55:05.150991+0000", 2023-08-01T19:55:05.603 INFO:teuthology.orchestra.run.smithi155.stdout: "duration": 0 2023-08-01T19:55:05.603 INFO:teuthology.orchestra.run.smithi155.stdout: }, 2023-08-01T19:55:05.603 INFO:teuthology.orchestra.run.smithi155.stdout: { 2023-08-01T19:55:05.603 INFO:teuthology.orchestra.run.smithi155.stdout: "event": "throttled", 2023-08-01T19:55:05.603 INFO:teuthology.orchestra.run.smithi155.stdout: "time": "2023-08-01T19:55:05.150991+0000", 2023-08-01T19:55:05.603 INFO:teuthology.orchestra.run.smithi155.stdout: "duration": 0 2023-08-01T19:55:05.604 INFO:teuthology.orchestra.run.smithi155.stdout: }, 2023-08-01T19:55:05.604 INFO:teuthology.orchestra.run.smithi155.stdout: { 2023-08-01T19:55:05.604 INFO:teuthology.orchestra.run.smithi155.stdout: "event": "header_read", 2023-08-01T19:55:05.604 INFO:teuthology.orchestra.run.smithi155.stdout: "time": "2023-08-01T19:55:05.150990+0000", 2023-08-01T19:55:05.604 INFO:teuthology.orchestra.run.smithi155.stdout: "duration": 4294967295.999999 2023-08-01T19:55:05.604 INFO:teuthology.orchestra.run.smithi155.stdout: }, 2023-08-01T19:55:05.604 INFO:teuthology.orchestra.run.smithi155.stdout: { 2023-08-01T19:55:05.604 INFO:teuthology.orchestra.run.smithi155.stdout: "event": "all_read", 2023-08-01T19:55:05.605 INFO:teuthology.orchestra.run.smithi155.stdout: "time": "2023-08-01T19:55:05.151108+0000", 2023-08-01T19:55:05.605 INFO:teuthology.orchestra.run.smithi155.stdout: "duration": 0.00011849300000000001 2023-08-01T19:55:05.605 INFO:teuthology.orchestra.run.smithi155.stdout: }, 2023-08-01T19:55:05.605 INFO:teuthology.orchestra.run.smithi155.stdout: { 2023-08-01T19:55:05.605 INFO:teuthology.orchestra.run.smithi155.stdout: "event": "dispatched", 2023-08-01T19:55:05.605 INFO:teuthology.orchestra.run.smithi155.stdout: "time": "2023-08-01T19:55:05.151117+0000", 2023-08-01T19:55:05.605 INFO:teuthology.orchestra.run.smithi155.stdout: "duration": 8.1040000000000007e-06 2023-08-01T19:55:05.605 INFO:teuthology.orchestra.run.smithi155.stdout: }, 2023-08-01T19:55:05.606 INFO:teuthology.orchestra.run.smithi155.stdout: { 2023-08-01T19:55:05.606 INFO:teuthology.orchestra.run.smithi155.stdout: "event": "queued_for_pg", 2023-08-01T19:55:05.606 INFO:teuthology.orchestra.run.smithi155.stdout: "time": "2023-08-01T19:55:05.151121+0000", 2023-08-01T19:55:05.606 INFO:teuthology.orchestra.run.smithi155.stdout: "duration": 4.2019999999999997e-06 2023-08-01T19:55:05.606 INFO:teuthology.orchestra.run.smithi155.stdout: }, 2023-08-01T19:55:05.606 INFO:teuthology.orchestra.run.smithi155.stdout: { 2023-08-01T19:55:05.606 INFO:teuthology.orchestra.run.smithi155.stdout: "event": "reached_pg", 2023-08-01T19:55:05.606 INFO:teuthology.orchestra.run.smithi155.stdout: "time": "2023-08-01T19:55:05.151162+0000", 2023-08-01T19:55:05.607 INFO:teuthology.orchestra.run.smithi155.stdout: "duration": 4.1448e-05 2023-08-01T19:55:05.607 INFO:teuthology.orchestra.run.smithi155.stdout: }, 2023-08-01T19:55:05.607 INFO:teuthology.orchestra.run.smithi155.stdout: { 2023-08-01T19:55:05.607 INFO:teuthology.orchestra.run.smithi155.stdout: "event": "started", 2023-08-01T19:55:05.607 INFO:teuthology.orchestra.run.smithi155.stdout: "time": "2023-08-01T19:55:05.151281+0000", 2023-08-01T19:55:05.607 INFO:teuthology.orchestra.run.smithi155.stdout: "duration": 0.000119141 2023-08-01T19:55:05.607 INFO:teuthology.orchestra.run.smithi155.stdout: }, 2023-08-01T19:55:05.607 INFO:teuthology.orchestra.run.smithi155.stdout: { 2023-08-01T19:55:05.608 INFO:teuthology.orchestra.run.smithi155.stdout: "event": "waiting for subops from 0", 2023-08-01T19:55:05.608 INFO:teuthology.orchestra.run.smithi155.stdout: "time": "2023-08-01T19:55:05.151443+0000", 2023-08-01T19:55:05.608 INFO:teuthology.orchestra.run.smithi155.stdout: "duration": 0.00016181600000000001 2023-08-01T19:55:05.608 INFO:teuthology.orchestra.run.smithi155.stdout: }, 2023-08-01T19:55:05.608 INFO:teuthology.orchestra.run.smithi155.stdout: { 2023-08-01T19:55:05.608 INFO:teuthology.orchestra.run.smithi155.stdout: "event": "sub_op_commit_rec", 2023-08-01T19:55:05.608 INFO:teuthology.orchestra.run.smithi155.stdout: "time": "2023-08-01T19:55:05.219101+0000", 2023-08-01T19:55:05.609 INFO:teuthology.orchestra.run.smithi155.stdout: "duration": 0.067658037000000004 2023-08-01T19:55:05.609 INFO:teuthology.orchestra.run.smithi155.stdout: }, 2023-08-01T19:55:05.609 INFO:teuthology.orchestra.run.smithi155.stdout: { 2023-08-01T19:55:05.609 INFO:teuthology.orchestra.run.smithi155.stdout: "event": "op_commit", 2023-08-01T19:55:05.609 INFO:teuthology.orchestra.run.smithi155.stdout: "time": "2023-08-01T19:55:05.221646+0000", 2023-08-01T19:55:05.609 INFO:teuthology.orchestra.run.smithi155.stdout: "duration": 0.0025450540000000002 2023-08-01T19:55:05.609 INFO:teuthology.orchestra.run.smithi155.stdout: }, 2023-08-01T19:55:05.609 INFO:teuthology.orchestra.run.smithi155.stdout: { 2023-08-01T19:55:05.610 INFO:teuthology.orchestra.run.smithi155.stdout: "event": "commit_sent", 2023-08-01T19:55:05.610 INFO:teuthology.orchestra.run.smithi155.stdout: "time": "2023-08-01T19:55:05.221689+0000", 2023-08-01T19:55:05.610 INFO:teuthology.orchestra.run.smithi155.stdout: "duration": 4.3078999999999999e-05 2023-08-01T19:55:05.610 INFO:teuthology.orchestra.run.smithi155.stdout: }, 2023-08-01T19:55:05.610 INFO:teuthology.orchestra.run.smithi155.stdout: { 2023-08-01T19:55:05.610 INFO:teuthology.orchestra.run.smithi155.stdout: "event": "done", 2023-08-01T19:55:05.610 INFO:teuthology.orchestra.run.smithi155.stdout: "time": "2023-08-01T19:55:05.221725+0000", 2023-08-01T19:55:05.610 INFO:teuthology.orchestra.run.smithi155.stdout: "duration": 3.6137999999999999e-05 2023-08-01T19:55:05.611 INFO:teuthology.orchestra.run.smithi155.stdout: } 2023-08-01T19:55:05.611 INFO:teuthology.orchestra.run.smithi155.stdout: ] 2023-08-01T19:55:05.611 INFO:teuthology.orchestra.run.smithi155.stdout: } 2023-08-01T19:55:05.611 INFO:teuthology.orchestra.run.smithi155.stdout: }, 2023-08-01T19:55:05.611 INFO:teuthology.orchestra.run.smithi155.stdout: { 2023-08-01T19:55:05.611 INFO:teuthology.orchestra.run.smithi155.stdout: "description": "osd_repop(client.4668.0:100243 5.a e37/19 5:5e8193b6:::benchmark_data_smithi006_114134_object100242:head v 37'6228, mlcod=37'6225)", 2023-08-01T19:55:05.611 INFO:teuthology.orchestra.run.smithi155.stdout: "initiated_at": "2023-08-01T19:55:05.151148+0000", 2023-08-01T19:55:05.611 INFO:teuthology.orchestra.run.smithi155.stdout: "age": 0.32345051000000002, 2023-08-01T19:55:05.612 INFO:teuthology.orchestra.run.smithi155.stdout: "duration": 0.073020370000000001, 2023-08-01T19:55:05.612 INFO:teuthology.orchestra.run.smithi155.stdout: "type_data": { 2023-08-01T19:55:05.612 INFO:teuthology.orchestra.run.smithi155.stdout: "flag_point": "commit sent; apply or cleanup", 2023-08-01T19:55:05.612 INFO:teuthology.orchestra.run.smithi155.stdout: "events": [ 2023-08-01T19:55:05.612 INFO:teuthology.orchestra.run.smithi155.stdout: { 2023-08-01T19:55:05.612 INFO:teuthology.orchestra.run.smithi155.stdout: "event": "initiated", 2023-08-01T19:55:05.612 INFO:teuthology.orchestra.run.smithi155.stdout: "time": "2023-08-01T19:55:05.151148+0000", 2023-08-01T19:55:05.613 INFO:teuthology.orchestra.run.smithi155.stdout: "duration": 0 2023-08-01T19:55:05.613 INFO:teuthology.orchestra.run.smithi155.stdout: }, 2023-08-01T19:55:05.613 INFO:teuthology.orchestra.run.smithi155.stdout: { 2023-08-01T19:55:05.613 INFO:teuthology.orchestra.run.smithi155.stdout: "event": "throttled", 2023-08-01T19:55:05.613 INFO:teuthology.orchestra.run.smithi155.stdout: "time": "2023-08-01T19:55:05.151148+0000", 2023-08-01T19:55:05.613 INFO:teuthology.orchestra.run.smithi155.stdout: "duration": 0 2023-08-01T19:55:05.613 INFO:teuthology.orchestra.run.smithi155.stdout: }, 2023-08-01T19:55:05.613 INFO:teuthology.orchestra.run.smithi155.stdout: { 2023-08-01T19:55:05.614 INFO:teuthology.orchestra.run.smithi155.stdout: "event": "header_read", 2023-08-01T19:55:05.614 INFO:teuthology.orchestra.run.smithi155.stdout: "time": "2023-08-01T19:55:05.151147+0000", 2023-08-01T19:55:05.614 INFO:teuthology.orchestra.run.smithi155.stdout: "duration": 4294967295.9999995 2023-08-01T19:55:05.614 INFO:teuthology.orchestra.run.smithi155.stdout: }, 2023-08-01T19:55:05.614 INFO:teuthology.orchestra.run.smithi155.stdout: { 2023-08-01T19:55:05.614 INFO:teuthology.orchestra.run.smithi155.stdout: "event": "all_read", 2023-08-01T19:55:05.614 INFO:teuthology.orchestra.run.smithi155.stdout: "time": "2023-08-01T19:55:05.151231+0000", 2023-08-01T19:55:05.614 INFO:teuthology.orchestra.run.smithi155.stdout: "duration": 8.3135999999999998e-05 2023-08-01T19:55:05.615 INFO:teuthology.orchestra.run.smithi155.stdout: }, 2023-08-01T19:55:05.615 INFO:teuthology.orchestra.run.smithi155.stdout: { 2023-08-01T19:55:05.615 INFO:teuthology.orchestra.run.smithi155.stdout: "event": "dispatched", 2023-08-01T19:55:05.615 INFO:teuthology.orchestra.run.smithi155.stdout: "time": "2023-08-01T19:55:05.151239+0000", 2023-08-01T19:55:05.615 INFO:teuthology.orchestra.run.smithi155.stdout: "duration": 8.7469999999999994e-06 2023-08-01T19:55:05.615 INFO:teuthology.orchestra.run.smithi155.stdout: }, 2023-08-01T19:55:05.615 INFO:teuthology.orchestra.run.smithi155.stdout: { 2023-08-01T19:55:05.615 INFO:teuthology.orchestra.run.smithi155.stdout: "event": "queued_for_pg", 2023-08-01T19:55:05.616 INFO:teuthology.orchestra.run.smithi155.stdout: "time": "2023-08-01T19:55:05.151244+0000", 2023-08-01T19:55:05.616 INFO:teuthology.orchestra.run.smithi155.stdout: "duration": 4.4800000000000003e-06 2023-08-01T19:55:05.616 INFO:teuthology.orchestra.run.smithi155.stdout: }, 2023-08-01T19:55:05.616 INFO:teuthology.orchestra.run.smithi155.stdout: { 2023-08-01T19:55:05.616 INFO:teuthology.orchestra.run.smithi155.stdout: "event": "reached_pg", 2023-08-01T19:55:05.616 INFO:teuthology.orchestra.run.smithi155.stdout: "time": "2023-08-01T19:55:05.152938+0000", 2023-08-01T19:55:05.616 INFO:teuthology.orchestra.run.smithi155.stdout: "duration": 0.001693824 2023-08-01T19:55:05.616 INFO:teuthology.orchestra.run.smithi155.stdout: }, 2023-08-01T19:55:05.617 INFO:teuthology.orchestra.run.smithi155.stdout: { 2023-08-01T19:55:05.617 INFO:teuthology.orchestra.run.smithi155.stdout: "event": "started", 2023-08-01T19:55:05.617 INFO:teuthology.orchestra.run.smithi155.stdout: "time": "2023-08-01T19:55:05.152956+0000", 2023-08-01T19:55:05.617 INFO:teuthology.orchestra.run.smithi155.stdout: "duration": 1.8287e-05 2023-08-01T19:55:05.617 INFO:teuthology.orchestra.run.smithi155.stdout: }, 2023-08-01T19:55:05.617 INFO:teuthology.orchestra.run.smithi155.stdout: { 2023-08-01T19:55:05.617 INFO:teuthology.orchestra.run.smithi155.stdout: "event": "commit_sent", 2023-08-01T19:55:05.618 INFO:teuthology.orchestra.run.smithi155.stdout: "time": "2023-08-01T19:55:05.224145+0000", 2023-08-01T19:55:05.618 INFO:teuthology.orchestra.run.smithi155.stdout: "duration": 0.071189447000000003 2023-08-01T19:55:05.618 INFO:teuthology.orchestra.run.smithi155.stdout: }, 2023-08-01T19:55:05.618 INFO:teuthology.orchestra.run.smithi155.stdout: { 2023-08-01T19:55:05.618 INFO:teuthology.orchestra.run.smithi155.stdout: "event": "done", 2023-08-01T19:55:05.618 INFO:teuthology.orchestra.run.smithi155.stdout: "time": "2023-08-01T19:55:05.224168+0000", 2023-08-01T19:55:05.618 INFO:teuthology.orchestra.run.smithi155.stdout: "duration": 2.3008999999999999e-05 2023-08-01T19:55:05.618 INFO:teuthology.orchestra.run.smithi155.stdout: } 2023-08-01T19:55:05.619 INFO:teuthology.orchestra.run.smithi155.stdout: ] 2023-08-01T19:55:05.619 INFO:teuthology.orchestra.run.smithi155.stdout: } 2023-08-01T19:55:05.619 INFO:teuthology.orchestra.run.smithi155.stdout: }, 2023-08-01T19:55:05.619 INFO:teuthology.orchestra.run.smithi155.stdout: { 2023-08-01T19:55:05.619 INFO:teuthology.orchestra.run.smithi155.stdout: "description": "osd_repop(client.4668.0:100244 5.9 e37/19 5:92f56a12:::benchmark_data_smithi006_114134_object100243:head v 37'6294, mlcod=37'6292)", 2023-08-01T19:55:05.619 INFO:teuthology.orchestra.run.smithi155.stdout: "initiated_at": "2023-08-01T19:55:05.151325+0000", 2023-08-01T19:55:05.619 INFO:teuthology.orchestra.run.smithi155.stdout: "age": 0.32327316499999997, 2023-08-01T19:55:05.619 INFO:teuthology.orchestra.run.smithi155.stdout: "duration": 0.071883673999999995, 2023-08-01T19:55:05.620 INFO:teuthology.orchestra.run.smithi155.stdout: "type_data": { 2023-08-01T19:55:05.620 INFO:teuthology.orchestra.run.smithi155.stdout: "flag_point": "commit sent; apply or cleanup", 2023-08-01T19:55:05.620 INFO:teuthology.orchestra.run.smithi155.stdout: "events": [ 2023-08-01T19:55:05.620 INFO:teuthology.orchestra.run.smithi155.stdout: { 2023-08-01T19:55:05.620 INFO:teuthology.orchestra.run.smithi155.stdout: "event": "initiated", 2023-08-01T19:55:05.620 INFO:teuthology.orchestra.run.smithi155.stdout: "time": "2023-08-01T19:55:05.151325+0000", 2023-08-01T19:55:05.620 INFO:teuthology.orchestra.run.smithi155.stdout: "duration": 0 2023-08-01T19:55:05.620 INFO:teuthology.orchestra.run.smithi155.stdout: }, 2023-08-01T19:55:05.621 INFO:teuthology.orchestra.run.smithi155.stdout: { 2023-08-01T19:55:05.621 INFO:teuthology.orchestra.run.smithi155.stdout: "event": "throttled", 2023-08-01T19:55:05.621 INFO:teuthology.orchestra.run.smithi155.stdout: "time": "2023-08-01T19:55:05.151325+0000", 2023-08-01T19:55:05.621 INFO:teuthology.orchestra.run.smithi155.stdout: "duration": 0 2023-08-01T19:55:05.621 INFO:teuthology.orchestra.run.smithi155.stdout: }, 2023-08-01T19:55:05.621 INFO:teuthology.orchestra.run.smithi155.stdout: { 2023-08-01T19:55:05.621 INFO:teuthology.orchestra.run.smithi155.stdout: "event": "header_read", 2023-08-01T19:55:05.621 INFO:teuthology.orchestra.run.smithi155.stdout: "time": "2023-08-01T19:55:05.151325+0000", 2023-08-01T19:55:05.622 INFO:teuthology.orchestra.run.smithi155.stdout: "duration": 4294967295.9999995 2023-08-01T19:55:05.622 INFO:teuthology.orchestra.run.smithi155.stdout: }, 2023-08-01T19:55:05.622 INFO:teuthology.orchestra.run.smithi155.stdout: { 2023-08-01T19:55:05.622 INFO:teuthology.orchestra.run.smithi155.stdout: "event": "all_read", 2023-08-01T19:55:05.622 INFO:teuthology.orchestra.run.smithi155.stdout: "time": "2023-08-01T19:55:05.151390+0000", 2023-08-01T19:55:05.622 INFO:teuthology.orchestra.run.smithi155.stdout: "duration": 6.5456999999999993e-05 2023-08-01T19:55:05.622 INFO:teuthology.orchestra.run.smithi155.stdout: }, 2023-08-01T19:55:05.622 INFO:teuthology.orchestra.run.smithi155.stdout: { 2023-08-01T19:55:05.623 INFO:teuthology.orchestra.run.smithi155.stdout: "event": "dispatched", 2023-08-01T19:55:05.623 INFO:teuthology.orchestra.run.smithi155.stdout: "time": "2023-08-01T19:55:05.151396+0000", 2023-08-01T19:55:05.623 INFO:teuthology.orchestra.run.smithi155.stdout: "duration": 5.9190000000000004e-06 2023-08-01T19:55:05.623 INFO:teuthology.orchestra.run.smithi155.stdout: }, 2023-08-01T19:55:05.623 INFO:teuthology.orchestra.run.smithi155.stdout: { 2023-08-01T19:55:05.623 INFO:teuthology.orchestra.run.smithi155.stdout: "event": "queued_for_pg", 2023-08-01T19:55:05.623 INFO:teuthology.orchestra.run.smithi155.stdout: "time": "2023-08-01T19:55:05.151400+0000", 2023-08-01T19:55:05.624 INFO:teuthology.orchestra.run.smithi155.stdout: "duration": 4.1030000000000004e-06 2023-08-01T19:55:05.624 INFO:teuthology.orchestra.run.smithi155.stdout: }, 2023-08-01T19:55:05.624 INFO:teuthology.orchestra.run.smithi155.stdout: { 2023-08-01T19:55:05.624 INFO:teuthology.orchestra.run.smithi155.stdout: "event": "reached_pg", 2023-08-01T19:55:05.624 INFO:teuthology.orchestra.run.smithi155.stdout: "time": "2023-08-01T19:55:05.151452+0000", 2023-08-01T19:55:05.624 INFO:teuthology.orchestra.run.smithi155.stdout: "duration": 5.2136999999999999e-05 2023-08-01T19:55:05.624 INFO:teuthology.orchestra.run.smithi155.stdout: }, 2023-08-01T19:55:05.624 INFO:teuthology.orchestra.run.smithi155.stdout: { 2023-08-01T19:55:05.625 INFO:teuthology.orchestra.run.smithi155.stdout: "event": "started", 2023-08-01T19:55:05.625 INFO:teuthology.orchestra.run.smithi155.stdout: "time": "2023-08-01T19:55:05.151470+0000", 2023-08-01T19:55:05.625 INFO:teuthology.orchestra.run.smithi155.stdout: "duration": 1.8e-05 2023-08-01T19:55:05.625 INFO:teuthology.orchestra.run.smithi155.stdout: }, 2023-08-01T19:55:05.625 INFO:teuthology.orchestra.run.smithi155.stdout: { 2023-08-01T19:55:05.625 INFO:teuthology.orchestra.run.smithi155.stdout: "event": "commit_sent", 2023-08-01T19:55:05.625 INFO:teuthology.orchestra.run.smithi155.stdout: "time": "2023-08-01T19:55:05.223183+0000", 2023-08-01T19:55:05.625 INFO:teuthology.orchestra.run.smithi155.stdout: "duration": 0.071712622000000004 2023-08-01T19:55:05.626 INFO:teuthology.orchestra.run.smithi155.stdout: }, 2023-08-01T19:55:05.626 INFO:teuthology.orchestra.run.smithi155.stdout: { 2023-08-01T19:55:05.626 INFO:teuthology.orchestra.run.smithi155.stdout: "event": "done", 2023-08-01T19:55:05.626 INFO:teuthology.orchestra.run.smithi155.stdout: "time": "2023-08-01T19:55:05.223209+0000", 2023-08-01T19:55:05.626 INFO:teuthology.orchestra.run.smithi155.stdout: "duration": 2.5956e-05 2023-08-01T19:55:05.626 INFO:teuthology.orchestra.run.smithi155.stdout: } 2023-08-01T19:55:05.626 INFO:teuthology.orchestra.run.smithi155.stdout: ] 2023-08-01T19:55:05.626 INFO:teuthology.orchestra.run.smithi155.stdout: } 2023-08-01T19:55:05.627 INFO:teuthology.orchestra.run.smithi155.stdout: }, 2023-08-01T19:55:05.627 INFO:teuthology.orchestra.run.smithi155.stdout: { 2023-08-01T19:55:05.627 INFO:teuthology.orchestra.run.smithi155.stdout: "description": "osd_op(client.4668.0:100249 5.b 5:d0666827:::benchmark_data_smithi006_114134_object100248:head [set-alloc-hint object_size 65536 write_size 65536,write 0~65536] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e37)", 2023-08-01T19:55:05.627 INFO:teuthology.orchestra.run.smithi155.stdout: "initiated_at": "2023-08-01T19:55:05.153614+0000", 2023-08-01T19:55:05.627 INFO:teuthology.orchestra.run.smithi155.stdout: "age": 0.32098473999999999, 2023-08-01T19:55:05.627 INFO:teuthology.orchestra.run.smithi155.stdout: "duration": 0.069286118999999993, 2023-08-01T19:55:05.627 INFO:teuthology.orchestra.run.smithi155.stdout: "type_data": { 2023-08-01T19:55:05.628 INFO:teuthology.orchestra.run.smithi155.stdout: "flag_point": "commit sent; apply or cleanup", 2023-08-01T19:55:05.628 INFO:teuthology.orchestra.run.smithi155.stdout: "client_info": { 2023-08-01T19:55:05.628 INFO:teuthology.orchestra.run.smithi155.stdout: "client": "client.4668", 2023-08-01T19:55:05.628 INFO:teuthology.orchestra.run.smithi155.stdout: "client_addr": "172.21.15.6:0/1709472247", 2023-08-01T19:55:05.628 INFO:teuthology.orchestra.run.smithi155.stdout: "tid": 100249 2023-08-01T19:55:05.628 INFO:teuthology.orchestra.run.smithi155.stdout: }, 2023-08-01T19:55:05.628 INFO:teuthology.orchestra.run.smithi155.stdout: "events": [ 2023-08-01T19:55:05.628 INFO:teuthology.orchestra.run.smithi155.stdout: { 2023-08-01T19:55:05.629 INFO:teuthology.orchestra.run.smithi155.stdout: "event": "initiated", 2023-08-01T19:55:05.629 INFO:teuthology.orchestra.run.smithi155.stdout: "time": "2023-08-01T19:55:05.153614+0000", 2023-08-01T19:55:05.629 INFO:teuthology.orchestra.run.smithi155.stdout: "duration": 0 2023-08-01T19:55:05.629 INFO:teuthology.orchestra.run.smithi155.stdout: }, 2023-08-01T19:55:05.629 INFO:teuthology.orchestra.run.smithi155.stdout: { 2023-08-01T19:55:05.629 INFO:teuthology.orchestra.run.smithi155.stdout: "event": "throttled", 2023-08-01T19:55:05.629 INFO:teuthology.orchestra.run.smithi155.stdout: "time": "2023-08-01T19:55:05.153614+0000", 2023-08-01T19:55:05.629 INFO:teuthology.orchestra.run.smithi155.stdout: "duration": 0 2023-08-01T19:55:05.630 INFO:teuthology.orchestra.run.smithi155.stdout: }, 2023-08-01T19:55:05.630 INFO:teuthology.orchestra.run.smithi155.stdout: { 2023-08-01T19:55:05.630 INFO:teuthology.orchestra.run.smithi155.stdout: "event": "header_read", 2023-08-01T19:55:05.630 INFO:teuthology.orchestra.run.smithi155.stdout: "time": "2023-08-01T19:55:05.153612+0000", 2023-08-01T19:55:05.630 INFO:teuthology.orchestra.run.smithi155.stdout: "duration": 4294967295.9999986 2023-08-01T19:55:05.630 INFO:teuthology.orchestra.run.smithi155.stdout: }, 2023-08-01T19:55:05.630 INFO:teuthology.orchestra.run.smithi155.stdout: { 2023-08-01T19:55:05.630 INFO:teuthology.orchestra.run.smithi155.stdout: "event": "all_read", 2023-08-01T19:55:05.631 INFO:teuthology.orchestra.run.smithi155.stdout: "time": "2023-08-01T19:55:05.153694+0000", 2023-08-01T19:55:05.631 INFO:teuthology.orchestra.run.smithi155.stdout: "duration": 8.1618000000000004e-05 2023-08-01T19:55:05.631 INFO:teuthology.orchestra.run.smithi155.stdout: }, 2023-08-01T19:55:05.631 INFO:teuthology.orchestra.run.smithi155.stdout: { 2023-08-01T19:55:05.631 INFO:teuthology.orchestra.run.smithi155.stdout: "event": "dispatched", 2023-08-01T19:55:05.631 INFO:teuthology.orchestra.run.smithi155.stdout: "time": "2023-08-01T19:55:05.153713+0000", 2023-08-01T19:55:05.631 INFO:teuthology.orchestra.run.smithi155.stdout: "duration": 1.9069999999999999e-05 2023-08-01T19:55:05.631 INFO:teuthology.orchestra.run.smithi155.stdout: }, 2023-08-01T19:55:05.632 INFO:teuthology.orchestra.run.smithi155.stdout: { 2023-08-01T19:55:05.632 INFO:teuthology.orchestra.run.smithi155.stdout: "event": "queued_for_pg", 2023-08-01T19:55:05.632 INFO:teuthology.orchestra.run.smithi155.stdout: "time": "2023-08-01T19:55:05.153726+0000", 2023-08-01T19:55:05.632 INFO:teuthology.orchestra.run.smithi155.stdout: "duration": 1.238e-05 2023-08-01T19:55:05.632 INFO:teuthology.orchestra.run.smithi155.stdout: }, 2023-08-01T19:55:05.632 INFO:teuthology.orchestra.run.smithi155.stdout: { 2023-08-01T19:55:05.632 INFO:teuthology.orchestra.run.smithi155.stdout: "event": "reached_pg", 2023-08-01T19:55:05.633 INFO:teuthology.orchestra.run.smithi155.stdout: "time": "2023-08-01T19:55:05.153761+0000", 2023-08-01T19:55:05.633 INFO:teuthology.orchestra.run.smithi155.stdout: "duration": 3.5046999999999998e-05 2023-08-01T19:55:05.633 INFO:teuthology.orchestra.run.smithi155.stdout: }, 2023-08-01T19:55:05.633 INFO:teuthology.orchestra.run.smithi155.stdout: { 2023-08-01T19:55:05.633 INFO:teuthology.orchestra.run.smithi155.stdout: "event": "started", 2023-08-01T19:55:05.633 INFO:teuthology.orchestra.run.smithi155.stdout: "time": "2023-08-01T19:55:05.153896+0000", 2023-08-01T19:55:05.633 INFO:teuthology.orchestra.run.smithi155.stdout: "duration": 0.00013575800000000001 2023-08-01T19:55:05.633 INFO:teuthology.orchestra.run.smithi155.stdout: }, 2023-08-01T19:55:05.634 INFO:teuthology.orchestra.run.smithi155.stdout: { 2023-08-01T19:55:05.634 INFO:teuthology.orchestra.run.smithi155.stdout: "event": "waiting for subops from 0", 2023-08-01T19:55:05.634 INFO:teuthology.orchestra.run.smithi155.stdout: "time": "2023-08-01T19:55:05.154043+0000", 2023-08-01T19:55:05.634 INFO:teuthology.orchestra.run.smithi155.stdout: "duration": 0.00014650700000000001 2023-08-01T19:55:05.634 INFO:teuthology.orchestra.run.smithi155.stdout: }, 2023-08-01T19:55:05.634 INFO:teuthology.orchestra.run.smithi155.stdout: { 2023-08-01T19:55:05.634 INFO:teuthology.orchestra.run.smithi155.stdout: "event": "sub_op_commit_rec", 2023-08-01T19:55:05.634 INFO:teuthology.orchestra.run.smithi155.stdout: "time": "2023-08-01T19:55:05.221876+0000", 2023-08-01T19:55:05.635 INFO:teuthology.orchestra.run.smithi155.stdout: "duration": 0.067832796000000001 2023-08-01T19:55:05.635 INFO:teuthology.orchestra.run.smithi155.stdout: }, 2023-08-01T19:55:05.635 INFO:teuthology.orchestra.run.smithi155.stdout: { 2023-08-01T19:55:05.635 INFO:teuthology.orchestra.run.smithi155.stdout: "event": "op_commit", 2023-08-01T19:55:05.635 INFO:teuthology.orchestra.run.smithi155.stdout: "time": "2023-08-01T19:55:05.222813+0000", 2023-08-01T19:55:05.635 INFO:teuthology.orchestra.run.smithi155.stdout: "duration": 0.00093755300000000004 2023-08-01T19:55:05.635 INFO:teuthology.orchestra.run.smithi155.stdout: }, 2023-08-01T19:55:05.635 INFO:teuthology.orchestra.run.smithi155.stdout: { 2023-08-01T19:55:05.636 INFO:teuthology.orchestra.run.smithi155.stdout: "event": "commit_sent", 2023-08-01T19:55:05.636 INFO:teuthology.orchestra.run.smithi155.stdout: "time": "2023-08-01T19:55:05.222861+0000", 2023-08-01T19:55:05.636 INFO:teuthology.orchestra.run.smithi155.stdout: "duration": 4.8013999999999998e-05 2023-08-01T19:55:05.636 INFO:teuthology.orchestra.run.smithi155.stdout: }, 2023-08-01T19:55:05.636 INFO:teuthology.orchestra.run.smithi155.stdout: { 2023-08-01T19:55:05.636 INFO:teuthology.orchestra.run.smithi155.stdout: "event": "done", 2023-08-01T19:55:05.636 INFO:teuthology.orchestra.run.smithi155.stdout: "time": "2023-08-01T19:55:05.222900+0000", 2023-08-01T19:55:05.636 INFO:teuthology.orchestra.run.smithi155.stdout: "duration": 3.8634999999999999e-05 2023-08-01T19:55:05.637 INFO:teuthology.orchestra.run.smithi155.stdout: } 2023-08-01T19:55:05.637 INFO:teuthology.orchestra.run.smithi155.stdout: ] 2023-08-01T19:55:05.637 INFO:teuthology.orchestra.run.smithi155.stdout: } 2023-08-01T19:55:05.637 INFO:teuthology.orchestra.run.smithi155.stdout: }, 2023-08-01T19:55:05.637 INFO:teuthology.orchestra.run.smithi155.stdout: { 2023-08-01T19:55:05.637 INFO:teuthology.orchestra.run.smithi155.stdout: "description": "osd_op(client.4668.0:100251 5.b 5:d853df24:::benchmark_data_smithi006_114134_object100250:head [set-alloc-hint object_size 65536 write_size 65536,write 0~65536] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e37)", 2023-08-01T19:55:05.637 INFO:teuthology.orchestra.run.smithi155.stdout: "initiated_at": "2023-08-01T19:55:05.153737+0000", 2023-08-01T19:55:05.637 INFO:teuthology.orchestra.run.smithi155.stdout: "age": 0.32086172600000001, 2023-08-01T19:55:05.638 INFO:teuthology.orchestra.run.smithi155.stdout: "duration": 0.071366545000000003, 2023-08-01T19:55:05.638 INFO:teuthology.orchestra.run.smithi155.stdout: "type_data": { 2023-08-01T19:55:05.638 INFO:teuthology.orchestra.run.smithi155.stdout: "flag_point": "commit sent; apply or cleanup", 2023-08-01T19:55:05.638 INFO:teuthology.orchestra.run.smithi155.stdout: "client_info": { 2023-08-01T19:55:05.638 INFO:teuthology.orchestra.run.smithi155.stdout: "client": "client.4668", 2023-08-01T19:55:05.638 INFO:teuthology.orchestra.run.smithi155.stdout: "client_addr": "172.21.15.6:0/1709472247", 2023-08-01T19:55:05.638 INFO:teuthology.orchestra.run.smithi155.stdout: "tid": 100251 2023-08-01T19:55:05.638 INFO:teuthology.orchestra.run.smithi155.stdout: }, 2023-08-01T19:55:05.639 INFO:teuthology.orchestra.run.smithi155.stdout: "events": [ 2023-08-01T19:55:05.639 INFO:teuthology.orchestra.run.smithi155.stdout: { 2023-08-01T19:55:05.639 INFO:teuthology.orchestra.run.smithi155.stdout: "event": "initiated", 2023-08-01T19:55:05.639 INFO:teuthology.orchestra.run.smithi155.stdout: "time": "2023-08-01T19:55:05.153737+0000", 2023-08-01T19:55:05.639 INFO:teuthology.orchestra.run.smithi155.stdout: "duration": 0 2023-08-01T19:55:05.639 INFO:teuthology.orchestra.run.smithi155.stdout: }, 2023-08-01T19:55:05.639 INFO:teuthology.orchestra.run.smithi155.stdout: { 2023-08-01T19:55:05.640 INFO:teuthology.orchestra.run.smithi155.stdout: "event": "throttled", 2023-08-01T19:55:05.640 INFO:teuthology.orchestra.run.smithi155.stdout: "time": "2023-08-01T19:55:05.153737+0000", 2023-08-01T19:55:05.640 INFO:teuthology.orchestra.run.smithi155.stdout: "duration": 0 2023-08-01T19:55:05.640 INFO:teuthology.orchestra.run.smithi155.stdout: }, 2023-08-01T19:55:05.640 INFO:teuthology.orchestra.run.smithi155.stdout: { 2023-08-01T19:55:05.640 INFO:teuthology.orchestra.run.smithi155.stdout: "event": "header_read", 2023-08-01T19:55:05.640 INFO:teuthology.orchestra.run.smithi155.stdout: "time": "2023-08-01T19:55:05.153736+0000", 2023-08-01T19:55:05.640 INFO:teuthology.orchestra.run.smithi155.stdout: "duration": 4294967295.9999995 2023-08-01T19:55:05.641 INFO:teuthology.orchestra.run.smithi155.stdout: }, 2023-08-01T19:55:05.641 INFO:teuthology.orchestra.run.smithi155.stdout: { 2023-08-01T19:55:05.641 INFO:teuthology.orchestra.run.smithi155.stdout: "event": "all_read", 2023-08-01T19:55:05.641 INFO:teuthology.orchestra.run.smithi155.stdout: "time": "2023-08-01T19:55:05.153784+0000", 2023-08-01T19:55:05.641 INFO:teuthology.orchestra.run.smithi155.stdout: "duration": 4.7660000000000001e-05 2023-08-01T19:55:05.641 INFO:teuthology.orchestra.run.smithi155.stdout: }, 2023-08-01T19:55:05.641 INFO:teuthology.orchestra.run.smithi155.stdout: { 2023-08-01T19:55:05.641 INFO:teuthology.orchestra.run.smithi155.stdout: "event": "dispatched", 2023-08-01T19:55:05.642 INFO:teuthology.orchestra.run.smithi155.stdout: "time": "2023-08-01T19:55:05.153793+0000", 2023-08-01T19:55:05.642 INFO:teuthology.orchestra.run.smithi155.stdout: "duration": 8.7150000000000004e-06 2023-08-01T19:55:05.642 INFO:teuthology.orchestra.run.smithi155.stdout: }, 2023-08-01T19:55:05.642 INFO:teuthology.orchestra.run.smithi155.stdout: { 2023-08-01T19:55:05.642 INFO:teuthology.orchestra.run.smithi155.stdout: "event": "queued_for_pg", 2023-08-01T19:55:05.642 INFO:teuthology.orchestra.run.smithi155.stdout: "time": "2023-08-01T19:55:05.153800+0000", 2023-08-01T19:55:05.642 INFO:teuthology.orchestra.run.smithi155.stdout: "duration": 7.2459999999999997e-06 2023-08-01T19:55:05.642 INFO:teuthology.orchestra.run.smithi155.stdout: }, 2023-08-01T19:55:05.643 INFO:teuthology.orchestra.run.smithi155.stdout: { 2023-08-01T19:55:05.643 INFO:teuthology.orchestra.run.smithi155.stdout: "event": "reached_pg", 2023-08-01T19:55:05.643 INFO:teuthology.orchestra.run.smithi155.stdout: "time": "2023-08-01T19:55:05.156241+0000", 2023-08-01T19:55:05.643 INFO:teuthology.orchestra.run.smithi155.stdout: "duration": 0.0024415359999999998 2023-08-01T19:55:05.643 INFO:teuthology.orchestra.run.smithi155.stdout: }, 2023-08-01T19:55:05.643 INFO:teuthology.orchestra.run.smithi155.stdout: { 2023-08-01T19:55:05.643 INFO:teuthology.orchestra.run.smithi155.stdout: "event": "started", 2023-08-01T19:55:05.643 INFO:teuthology.orchestra.run.smithi155.stdout: "time": "2023-08-01T19:55:05.219045+0000", 2023-08-01T19:55:05.644 INFO:teuthology.orchestra.run.smithi155.stdout: "duration": 0.062803855000000006 2023-08-01T19:55:05.644 INFO:teuthology.orchestra.run.smithi155.stdout: }, 2023-08-01T19:55:05.644 INFO:teuthology.orchestra.run.smithi155.stdout: { 2023-08-01T19:55:05.644 INFO:teuthology.orchestra.run.smithi155.stdout: "event": "waiting for subops from 0", 2023-08-01T19:55:05.644 INFO:teuthology.orchestra.run.smithi155.stdout: "time": "2023-08-01T19:55:05.219238+0000", 2023-08-01T19:55:05.644 INFO:teuthology.orchestra.run.smithi155.stdout: "duration": 0.00019241500000000001 2023-08-01T19:55:05.644 INFO:teuthology.orchestra.run.smithi155.stdout: }, 2023-08-01T19:55:05.644 INFO:teuthology.orchestra.run.smithi155.stdout: { 2023-08-01T19:55:05.645 INFO:teuthology.orchestra.run.smithi155.stdout: "event": "sub_op_commit_rec", 2023-08-01T19:55:05.645 INFO:teuthology.orchestra.run.smithi155.stdout: "time": "2023-08-01T19:55:05.223300+0000", 2023-08-01T19:55:05.645 INFO:teuthology.orchestra.run.smithi155.stdout: "duration": 0.0040626509999999996 2023-08-01T19:55:05.645 INFO:teuthology.orchestra.run.smithi155.stdout: }, 2023-08-01T19:55:05.645 INFO:teuthology.orchestra.run.smithi155.stdout: { 2023-08-01T19:55:05.645 INFO:teuthology.orchestra.run.smithi155.stdout: "event": "op_commit", 2023-08-01T19:55:05.645 INFO:teuthology.orchestra.run.smithi155.stdout: "time": "2023-08-01T19:55:05.225020+0000", 2023-08-01T19:55:05.646 INFO:teuthology.orchestra.run.smithi155.stdout: "duration": 0.0017201 2023-08-01T19:55:05.646 INFO:teuthology.orchestra.run.smithi155.stdout: }, 2023-08-01T19:55:05.646 INFO:teuthology.orchestra.run.smithi155.stdout: { 2023-08-01T19:55:05.646 INFO:teuthology.orchestra.run.smithi155.stdout: "event": "commit_sent", 2023-08-01T19:55:05.646 INFO:teuthology.orchestra.run.smithi155.stdout: "time": "2023-08-01T19:55:05.225066+0000", 2023-08-01T19:55:05.646 INFO:teuthology.orchestra.run.smithi155.stdout: "duration": 4.6143000000000002e-05 2023-08-01T19:55:05.646 INFO:teuthology.orchestra.run.smithi155.stdout: }, 2023-08-01T19:55:05.646 INFO:teuthology.orchestra.run.smithi155.stdout: { 2023-08-01T19:55:05.647 INFO:teuthology.orchestra.run.smithi155.stdout: "event": "done", 2023-08-01T19:55:05.647 INFO:teuthology.orchestra.run.smithi155.stdout: "time": "2023-08-01T19:55:05.225103+0000", 2023-08-01T19:55:05.647 INFO:teuthology.orchestra.run.smithi155.stdout: "duration": 3.6789999999999998e-05 2023-08-01T19:55:05.647 INFO:teuthology.orchestra.run.smithi155.stdout: } 2023-08-01T19:55:05.647 INFO:teuthology.orchestra.run.smithi155.stdout: ] 2023-08-01T19:55:05.647 INFO:teuthology.orchestra.run.smithi155.stdout: } 2023-08-01T19:55:05.647 INFO:teuthology.orchestra.run.smithi155.stdout: }, 2023-08-01T19:55:05.647 INFO:teuthology.orchestra.run.smithi155.stdout: { 2023-08-01T19:55:05.648 INFO:teuthology.orchestra.run.smithi155.stdout: "description": "osd_op(client.4668.0:100252 5.0 5:01f90c3c:::benchmark_data_smithi006_114134_object100251:head [set-alloc-hint object_size 65536 write_size 65536,write 0~65536] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e37)", 2023-08-01T19:55:05.648 INFO:teuthology.orchestra.run.smithi155.stdout: "initiated_at": "2023-08-01T19:55:05.154048+0000", 2023-08-01T19:55:05.648 INFO:teuthology.orchestra.run.smithi155.stdout: "age": 0.320550479, 2023-08-01T19:55:05.648 INFO:teuthology.orchestra.run.smithi155.stdout: "duration": 0.070156683999999997, 2023-08-01T19:55:05.648 INFO:teuthology.orchestra.run.smithi155.stdout: "type_data": { 2023-08-01T19:55:05.648 INFO:teuthology.orchestra.run.smithi155.stdout: "flag_point": "commit sent; apply or cleanup", 2023-08-01T19:55:05.648 INFO:teuthology.orchestra.run.smithi155.stdout: "client_info": { 2023-08-01T19:55:05.649 INFO:teuthology.orchestra.run.smithi155.stdout: "client": "client.4668", 2023-08-01T19:55:05.649 INFO:teuthology.orchestra.run.smithi155.stdout: "client_addr": "172.21.15.6:0/1709472247", 2023-08-01T19:55:05.649 INFO:teuthology.orchestra.run.smithi155.stdout: "tid": 100252 2023-08-01T19:55:05.649 INFO:teuthology.orchestra.run.smithi155.stdout: }, 2023-08-01T19:55:05.649 INFO:teuthology.orchestra.run.smithi155.stdout: "events": [ 2023-08-01T19:55:05.649 INFO:teuthology.orchestra.run.smithi155.stdout: { 2023-08-01T19:55:05.649 INFO:teuthology.orchestra.run.smithi155.stdout: "event": "initiated", 2023-08-01T19:55:05.649 INFO:teuthology.orchestra.run.smithi155.stdout: "time": "2023-08-01T19:55:05.154048+0000", 2023-08-01T19:55:05.650 INFO:teuthology.orchestra.run.smithi155.stdout: "duration": 0 2023-08-01T19:55:05.650 INFO:teuthology.orchestra.run.smithi155.stdout: }, 2023-08-01T19:55:05.650 INFO:teuthology.orchestra.run.smithi155.stdout: { 2023-08-01T19:55:05.650 INFO:teuthology.orchestra.run.smithi155.stdout: "event": "throttled", 2023-08-01T19:55:05.650 INFO:teuthology.orchestra.run.smithi155.stdout: "time": "2023-08-01T19:55:05.154048+0000", 2023-08-01T19:55:05.650 INFO:teuthology.orchestra.run.smithi155.stdout: "duration": 0 2023-08-01T19:55:05.650 INFO:teuthology.orchestra.run.smithi155.stdout: }, 2023-08-01T19:55:05.651 INFO:teuthology.orchestra.run.smithi155.stdout: { 2023-08-01T19:55:05.651 INFO:teuthology.orchestra.run.smithi155.stdout: "event": "header_read", 2023-08-01T19:55:05.651 INFO:teuthology.orchestra.run.smithi155.stdout: "time": "2023-08-01T19:55:05.154047+0000", 2023-08-01T19:55:05.651 INFO:teuthology.orchestra.run.smithi155.stdout: "duration": 4294967295.999999 2023-08-01T19:55:05.651 INFO:teuthology.orchestra.run.smithi155.stdout: }, 2023-08-01T19:55:05.651 INFO:teuthology.orchestra.run.smithi155.stdout: { 2023-08-01T19:55:05.651 INFO:teuthology.orchestra.run.smithi155.stdout: "event": "all_read", 2023-08-01T19:55:05.651 INFO:teuthology.orchestra.run.smithi155.stdout: "time": "2023-08-01T19:55:05.154115+0000", 2023-08-01T19:55:05.652 INFO:teuthology.orchestra.run.smithi155.stdout: "duration": 6.7545999999999993e-05 2023-08-01T19:55:05.652 INFO:teuthology.orchestra.run.smithi155.stdout: }, 2023-08-01T19:55:05.652 INFO:teuthology.orchestra.run.smithi155.stdout: { 2023-08-01T19:55:05.652 INFO:teuthology.orchestra.run.smithi155.stdout: "event": "dispatched", 2023-08-01T19:55:05.652 INFO:teuthology.orchestra.run.smithi155.stdout: "time": "2023-08-01T19:55:05.154125+0000", 2023-08-01T19:55:05.652 INFO:teuthology.orchestra.run.smithi155.stdout: "duration": 1.0669000000000001e-05 2023-08-01T19:55:05.652 INFO:teuthology.orchestra.run.smithi155.stdout: }, 2023-08-01T19:55:05.652 INFO:teuthology.orchestra.run.smithi155.stdout: { 2023-08-01T19:55:05.653 INFO:teuthology.orchestra.run.smithi155.stdout: "event": "queued_for_pg", 2023-08-01T19:55:05.653 INFO:teuthology.orchestra.run.smithi155.stdout: "time": "2023-08-01T19:55:05.154131+0000", 2023-08-01T19:55:05.653 INFO:teuthology.orchestra.run.smithi155.stdout: "duration": 6.0349999999999998e-06 2023-08-01T19:55:05.653 INFO:teuthology.orchestra.run.smithi155.stdout: }, 2023-08-01T19:55:05.653 INFO:teuthology.orchestra.run.smithi155.stdout: { 2023-08-01T19:55:05.653 INFO:teuthology.orchestra.run.smithi155.stdout: "event": "reached_pg", 2023-08-01T19:55:05.653 INFO:teuthology.orchestra.run.smithi155.stdout: "time": "2023-08-01T19:55:05.154174+0000", 2023-08-01T19:55:05.653 INFO:teuthology.orchestra.run.smithi155.stdout: "duration": 4.2429000000000003e-05 2023-08-01T19:55:05.654 INFO:teuthology.orchestra.run.smithi155.stdout: }, 2023-08-01T19:55:05.654 INFO:teuthology.orchestra.run.smithi155.stdout: { 2023-08-01T19:55:05.654 INFO:teuthology.orchestra.run.smithi155.stdout: "event": "started", 2023-08-01T19:55:05.654 INFO:teuthology.orchestra.run.smithi155.stdout: "time": "2023-08-01T19:55:05.154287+0000", 2023-08-01T19:55:05.654 INFO:teuthology.orchestra.run.smithi155.stdout: "duration": 0.000113138 2023-08-01T19:55:05.654 INFO:teuthology.orchestra.run.smithi155.stdout: }, 2023-08-01T19:55:05.654 INFO:teuthology.orchestra.run.smithi155.stdout: { 2023-08-01T19:55:05.654 INFO:teuthology.orchestra.run.smithi155.stdout: "event": "waiting for subops from 0", 2023-08-01T19:55:05.655 INFO:teuthology.orchestra.run.smithi155.stdout: "time": "2023-08-01T19:55:05.154420+0000", 2023-08-01T19:55:05.655 INFO:teuthology.orchestra.run.smithi155.stdout: "duration": 0.000133292 2023-08-01T19:55:05.655 INFO:teuthology.orchestra.run.smithi155.stdout: }, 2023-08-01T19:55:05.655 INFO:teuthology.orchestra.run.smithi155.stdout: { 2023-08-01T19:55:05.655 INFO:teuthology.orchestra.run.smithi155.stdout: "event": "sub_op_commit_rec", 2023-08-01T19:55:05.655 INFO:teuthology.orchestra.run.smithi155.stdout: "time": "2023-08-01T19:55:05.219034+0000", 2023-08-01T19:55:05.655 INFO:teuthology.orchestra.run.smithi155.stdout: "duration": 0.064613429999999999 2023-08-01T19:55:05.656 INFO:teuthology.orchestra.run.smithi155.stdout: }, 2023-08-01T19:55:05.656 INFO:teuthology.orchestra.run.smithi155.stdout: { 2023-08-01T19:55:05.656 INFO:teuthology.orchestra.run.smithi155.stdout: "event": "op_commit", 2023-08-01T19:55:05.656 INFO:teuthology.orchestra.run.smithi155.stdout: "time": "2023-08-01T19:55:05.224138+0000", 2023-08-01T19:55:05.656 INFO:teuthology.orchestra.run.smithi155.stdout: "duration": 0.0051041999999999997 2023-08-01T19:55:05.656 INFO:teuthology.orchestra.run.smithi155.stdout: }, 2023-08-01T19:55:05.656 INFO:teuthology.orchestra.run.smithi155.stdout: { 2023-08-01T19:55:05.656 INFO:teuthology.orchestra.run.smithi155.stdout: "event": "commit_sent", 2023-08-01T19:55:05.657 INFO:teuthology.orchestra.run.smithi155.stdout: "time": "2023-08-01T19:55:05.224171+0000", 2023-08-01T19:55:05.657 INFO:teuthology.orchestra.run.smithi155.stdout: "duration": 3.3345e-05 2023-08-01T19:55:05.657 INFO:teuthology.orchestra.run.smithi155.stdout: }, 2023-08-01T19:55:05.657 INFO:teuthology.orchestra.run.smithi155.stdout: { 2023-08-01T19:55:05.657 INFO:teuthology.orchestra.run.smithi155.stdout: "event": "done", 2023-08-01T19:55:05.657 INFO:teuthology.orchestra.run.smithi155.stdout: "time": "2023-08-01T19:55:05.224205+0000", 2023-08-01T19:55:05.657 INFO:teuthology.orchestra.run.smithi155.stdout: "duration": 3.3525999999999997e-05 2023-08-01T19:55:05.657 INFO:teuthology.orchestra.run.smithi155.stdout: } 2023-08-01T19:55:05.658 INFO:teuthology.orchestra.run.smithi155.stdout: ] 2023-08-01T19:55:05.658 INFO:teuthology.orchestra.run.smithi155.stdout: } 2023-08-01T19:55:05.658 INFO:teuthology.orchestra.run.smithi155.stdout: }, 2023-08-01T19:55:05.658 INFO:teuthology.orchestra.run.smithi155.stdout: { 2023-08-01T19:55:05.658 INFO:teuthology.orchestra.run.smithi155.stdout: "description": "osd_repop_reply(client.4668.0:100237 5.4 e37/19 ondisk, result = 0)", 2023-08-01T19:55:05.658 INFO:teuthology.orchestra.run.smithi155.stdout: "initiated_at": "2023-08-01T19:55:05.156249+0000", 2023-08-01T19:55:05.658 INFO:teuthology.orchestra.run.smithi155.stdout: "age": 0.31834953399999999, 2023-08-01T19:55:05.658 INFO:teuthology.orchestra.run.smithi155.stdout: "duration": 0.062792549000000003, 2023-08-01T19:55:05.659 INFO:teuthology.orchestra.run.smithi155.stdout: "type_data": { 2023-08-01T19:55:05.659 INFO:teuthology.orchestra.run.smithi155.stdout: "flag_point": "started", 2023-08-01T19:55:05.659 INFO:teuthology.orchestra.run.smithi155.stdout: "events": [ 2023-08-01T19:55:05.659 INFO:teuthology.orchestra.run.smithi155.stdout: { 2023-08-01T19:55:05.659 INFO:teuthology.orchestra.run.smithi155.stdout: "event": "initiated", 2023-08-01T19:55:05.659 INFO:teuthology.orchestra.run.smithi155.stdout: "time": "2023-08-01T19:55:05.156249+0000", 2023-08-01T19:55:05.659 INFO:teuthology.orchestra.run.smithi155.stdout: "duration": 0 2023-08-01T19:55:05.659 INFO:teuthology.orchestra.run.smithi155.stdout: }, 2023-08-01T19:55:05.660 INFO:teuthology.orchestra.run.smithi155.stdout: { 2023-08-01T19:55:05.660 INFO:teuthology.orchestra.run.smithi155.stdout: "event": "throttled", 2023-08-01T19:55:05.660 INFO:teuthology.orchestra.run.smithi155.stdout: "time": "2023-08-01T19:55:05.156249+0000", 2023-08-01T19:55:05.660 INFO:teuthology.orchestra.run.smithi155.stdout: "duration": 0 2023-08-01T19:55:05.660 INFO:teuthology.orchestra.run.smithi155.stdout: }, 2023-08-01T19:55:05.660 INFO:teuthology.orchestra.run.smithi155.stdout: { 2023-08-01T19:55:05.660 INFO:teuthology.orchestra.run.smithi155.stdout: "event": "header_read", 2023-08-01T19:55:05.661 INFO:teuthology.orchestra.run.smithi155.stdout: "time": "2023-08-01T19:55:05.156248+0000", 2023-08-01T19:55:05.661 INFO:teuthology.orchestra.run.smithi155.stdout: "duration": 4294967295.9999995 2023-08-01T19:55:05.661 INFO:teuthology.orchestra.run.smithi155.stdout: }, 2023-08-01T19:55:05.661 INFO:teuthology.orchestra.run.smithi155.stdout: { 2023-08-01T19:55:05.661 INFO:teuthology.orchestra.run.smithi155.stdout: "event": "all_read", 2023-08-01T19:55:05.661 INFO:teuthology.orchestra.run.smithi155.stdout: "time": "2023-08-01T19:55:05.156252+0000", 2023-08-01T19:55:05.661 INFO:teuthology.orchestra.run.smithi155.stdout: "duration": 3.9999999999999998e-06 2023-08-01T19:55:05.661 INFO:teuthology.orchestra.run.smithi155.stdout: }, 2023-08-01T19:55:05.662 INFO:teuthology.orchestra.run.smithi155.stdout: { 2023-08-01T19:55:05.662 INFO:teuthology.orchestra.run.smithi155.stdout: "event": "dispatched", 2023-08-01T19:55:05.662 INFO:teuthology.orchestra.run.smithi155.stdout: "time": "2023-08-01T19:55:05.218844+0000", 2023-08-01T19:55:05.662 INFO:teuthology.orchestra.run.smithi155.stdout: "duration": 0.062591516999999999 2023-08-01T19:55:05.662 INFO:teuthology.orchestra.run.smithi155.stdout: }, 2023-08-01T19:55:05.662 INFO:teuthology.orchestra.run.smithi155.stdout: { 2023-08-01T19:55:05.662 INFO:teuthology.orchestra.run.smithi155.stdout: "event": "queued_for_pg", 2023-08-01T19:55:05.662 INFO:teuthology.orchestra.run.smithi155.stdout: "time": "2023-08-01T19:55:05.218862+0000", 2023-08-01T19:55:05.663 INFO:teuthology.orchestra.run.smithi155.stdout: "duration": 1.7666e-05 2023-08-01T19:55:05.663 INFO:teuthology.orchestra.run.smithi155.stdout: }, 2023-08-01T19:55:05.663 INFO:teuthology.orchestra.run.smithi155.stdout: { 2023-08-01T19:55:05.663 INFO:teuthology.orchestra.run.smithi155.stdout: "event": "reached_pg", 2023-08-01T19:55:05.663 INFO:teuthology.orchestra.run.smithi155.stdout: "time": "2023-08-01T19:55:05.218914+0000", 2023-08-01T19:55:05.663 INFO:teuthology.orchestra.run.smithi155.stdout: "duration": 5.2565999999999998e-05 2023-08-01T19:55:05.663 INFO:teuthology.orchestra.run.smithi155.stdout: }, 2023-08-01T19:55:05.663 INFO:teuthology.orchestra.run.smithi155.stdout: { 2023-08-01T19:55:05.664 INFO:teuthology.orchestra.run.smithi155.stdout: "event": "started", 2023-08-01T19:55:05.664 INFO:teuthology.orchestra.run.smithi155.stdout: "time": "2023-08-01T19:55:05.218925+0000", 2023-08-01T19:55:05.664 INFO:teuthology.orchestra.run.smithi155.stdout: "duration": 1.1375e-05 2023-08-01T19:55:05.664 INFO:teuthology.orchestra.run.smithi155.stdout: }, 2023-08-01T19:55:05.664 INFO:teuthology.orchestra.run.smithi155.stdout: { 2023-08-01T19:55:05.664 INFO:teuthology.orchestra.run.smithi155.stdout: "event": "done", 2023-08-01T19:55:05.664 INFO:teuthology.orchestra.run.smithi155.stdout: "time": "2023-08-01T19:55:05.219041+0000", 2023-08-01T19:55:05.664 INFO:teuthology.orchestra.run.smithi155.stdout: "duration": 0.000115977 2023-08-01T19:55:05.665 INFO:teuthology.orchestra.run.smithi155.stdout: } 2023-08-01T19:55:05.665 INFO:teuthology.orchestra.run.smithi155.stdout: ] 2023-08-01T19:55:05.665 INFO:teuthology.orchestra.run.smithi155.stdout: } 2023-08-01T19:55:05.665 INFO:teuthology.orchestra.run.smithi155.stdout: }, 2023-08-01T19:55:05.665 INFO:teuthology.orchestra.run.smithi155.stdout: { 2023-08-01T19:55:05.665 INFO:teuthology.orchestra.run.smithi155.stdout: "description": "osd_repop(client.4668.0:100253 5.f e37/19 5:f7bbce05:::benchmark_data_smithi006_114134_object100252:head v 37'6323, mlcod=37'6321)", 2023-08-01T19:55:05.665 INFO:teuthology.orchestra.run.smithi155.stdout: "initiated_at": "2023-08-01T19:55:05.156952+0000", 2023-08-01T19:55:05.666 INFO:teuthology.orchestra.run.smithi155.stdout: "age": 0.31764647099999999, 2023-08-01T19:55:05.666 INFO:teuthology.orchestra.run.smithi155.stdout: "duration": 0.068018577999999996, 2023-08-01T19:55:05.666 INFO:teuthology.orchestra.run.smithi155.stdout: "type_data": { 2023-08-01T19:55:05.666 INFO:teuthology.orchestra.run.smithi155.stdout: "flag_point": "commit sent; apply or cleanup", 2023-08-01T19:55:05.666 INFO:teuthology.orchestra.run.smithi155.stdout: "events": [ 2023-08-01T19:55:05.666 INFO:teuthology.orchestra.run.smithi155.stdout: { 2023-08-01T19:55:05.666 INFO:teuthology.orchestra.run.smithi155.stdout: "event": "initiated", 2023-08-01T19:55:05.666 INFO:teuthology.orchestra.run.smithi155.stdout: "time": "2023-08-01T19:55:05.156952+0000", 2023-08-01T19:55:05.667 INFO:teuthology.orchestra.run.smithi155.stdout: "duration": 0 2023-08-01T19:55:05.667 INFO:teuthology.orchestra.run.smithi155.stdout: }, 2023-08-01T19:55:05.667 INFO:teuthology.orchestra.run.smithi155.stdout: { 2023-08-01T19:55:05.667 INFO:teuthology.orchestra.run.smithi155.stdout: "event": "throttled", 2023-08-01T19:55:05.667 INFO:teuthology.orchestra.run.smithi155.stdout: "time": "2023-08-01T19:55:05.156952+0000", 2023-08-01T19:55:05.667 INFO:teuthology.orchestra.run.smithi155.stdout: "duration": 0 2023-08-01T19:55:05.667 INFO:teuthology.orchestra.run.smithi155.stdout: }, 2023-08-01T19:55:05.667 INFO:teuthology.orchestra.run.smithi155.stdout: { 2023-08-01T19:55:05.668 INFO:teuthology.orchestra.run.smithi155.stdout: "event": "header_read", 2023-08-01T19:55:05.668 INFO:teuthology.orchestra.run.smithi155.stdout: "time": "2023-08-01T19:55:05.156951+0000", 2023-08-01T19:55:05.668 INFO:teuthology.orchestra.run.smithi155.stdout: "duration": 4294967295.999999 2023-08-01T19:55:05.668 INFO:teuthology.orchestra.run.smithi155.stdout: }, 2023-08-01T19:55:05.668 INFO:teuthology.orchestra.run.smithi155.stdout: { 2023-08-01T19:55:05.668 INFO:teuthology.orchestra.run.smithi155.stdout: "event": "all_read", 2023-08-01T19:55:05.668 INFO:teuthology.orchestra.run.smithi155.stdout: "time": "2023-08-01T19:55:05.156989+0000", 2023-08-01T19:55:05.668 INFO:teuthology.orchestra.run.smithi155.stdout: "duration": 3.8175e-05 2023-08-01T19:55:05.669 INFO:teuthology.orchestra.run.smithi155.stdout: }, 2023-08-01T19:55:05.669 INFO:teuthology.orchestra.run.smithi155.stdout: { 2023-08-01T19:55:05.669 INFO:teuthology.orchestra.run.smithi155.stdout: "event": "dispatched", 2023-08-01T19:55:05.669 INFO:teuthology.orchestra.run.smithi155.stdout: "time": "2023-08-01T19:55:05.218842+0000", 2023-08-01T19:55:05.669 INFO:teuthology.orchestra.run.smithi155.stdout: "duration": 0.061852299999999999 2023-08-01T19:55:05.669 INFO:teuthology.orchestra.run.smithi155.stdout: }, 2023-08-01T19:55:05.669 INFO:teuthology.orchestra.run.smithi155.stdout: { 2023-08-01T19:55:05.669 INFO:teuthology.orchestra.run.smithi155.stdout: "event": "queued_for_pg", 2023-08-01T19:55:05.670 INFO:teuthology.orchestra.run.smithi155.stdout: "time": "2023-08-01T19:55:05.218862+0000", 2023-08-01T19:55:05.670 INFO:teuthology.orchestra.run.smithi155.stdout: "duration": 1.9854999999999999e-05 2023-08-01T19:55:05.670 INFO:teuthology.orchestra.run.smithi155.stdout: }, 2023-08-01T19:55:05.670 INFO:teuthology.orchestra.run.smithi155.stdout: { 2023-08-01T19:55:05.670 INFO:teuthology.orchestra.run.smithi155.stdout: "event": "reached_pg", 2023-08-01T19:55:05.670 INFO:teuthology.orchestra.run.smithi155.stdout: "time": "2023-08-01T19:55:05.218918+0000", 2023-08-01T19:55:05.670 INFO:teuthology.orchestra.run.smithi155.stdout: "duration": 5.6570000000000002e-05 2023-08-01T19:55:05.670 INFO:teuthology.orchestra.run.smithi155.stdout: }, 2023-08-01T19:55:05.671 INFO:teuthology.orchestra.run.smithi155.stdout: { 2023-08-01T19:55:05.671 INFO:teuthology.orchestra.run.smithi155.stdout: "event": "started", 2023-08-01T19:55:05.671 INFO:teuthology.orchestra.run.smithi155.stdout: "time": "2023-08-01T19:55:05.218940+0000", 2023-08-01T19:55:05.671 INFO:teuthology.orchestra.run.smithi155.stdout: "duration": 2.1804e-05 2023-08-01T19:55:05.671 INFO:teuthology.orchestra.run.smithi155.stdout: }, 2023-08-01T19:55:05.671 INFO:teuthology.orchestra.run.smithi155.stdout: { 2023-08-01T19:55:05.671 INFO:teuthology.orchestra.run.smithi155.stdout: "event": "commit_sent", 2023-08-01T19:55:05.671 INFO:teuthology.orchestra.run.smithi155.stdout: "time": "2023-08-01T19:55:05.224928+0000", 2023-08-01T19:55:05.672 INFO:teuthology.orchestra.run.smithi155.stdout: "duration": 0.0059876759999999999 2023-08-01T19:55:05.672 INFO:teuthology.orchestra.run.smithi155.stdout: }, 2023-08-01T19:55:05.672 INFO:teuthology.orchestra.run.smithi155.stdout: { 2023-08-01T19:55:05.672 INFO:teuthology.orchestra.run.smithi155.stdout: "event": "done", 2023-08-01T19:55:05.672 INFO:teuthology.orchestra.run.smithi155.stdout: "time": "2023-08-01T19:55:05.224971+0000", 2023-08-01T19:55:05.672 INFO:teuthology.orchestra.run.smithi155.stdout: "duration": 4.2929999999999997e-05 2023-08-01T19:55:05.672 INFO:teuthology.orchestra.run.smithi155.stdout: } 2023-08-01T19:55:05.673 INFO:teuthology.orchestra.run.smithi155.stdout: ] 2023-08-01T19:55:05.673 INFO:teuthology.orchestra.run.smithi155.stdout: } 2023-08-01T19:55:05.673 INFO:teuthology.orchestra.run.smithi155.stdout: } 2023-08-01T19:55:05.673 INFO:teuthology.orchestra.run.smithi155.stdout: ] 2023-08-01T19:55:05.673 INFO:teuthology.orchestra.run.smithi155.stdout:} 2023-08-01T19:55:05.674 DEBUG:teuthology.orchestra.run.smithi006:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 120 ceph --cluster ceph osd unset nodeep-scrub 2023-08-01T19:55:05.674 DEBUG:teuthology.orchestra.run.smithi006:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 120 ceph --cluster ceph -- tell 'osd.*' injectargs --osd_enable_op_tracker=false 2023-08-01T19:55:05.675 INFO:tasks.ceph.osd.0.smithi008.stderr:2023-08-01T19:55:05.673+0000 7f16a58f4700 -1 received signal: Hangup from /usr/bin/python3 /bin/daemon-helper kill ceph-osd -f --cluster ceph -i 0 (PID: 111179) UID: 0 2023-08-01T19:55:05.676 DEBUG:teuthology.orchestra.run.smithi008:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 30 ceph --cluster ceph --admin-daemon /var/run/ceph/ceph-osd.0.asok dump_ops_in_flight 2023-08-01T19:55:05.774 INFO:tasks.ceph.osd.1.smithi101.stderr:2023-08-01T19:55:05.773+0000 7fb0cb7f6700 -1 received signal: Hangup from /usr/bin/python3 /bin/daemon-helper kill ceph-osd -f --cluster ceph -i 1 (PID: 111141) UID: 0 2023-08-01T19:55:05.828 INFO:teuthology.orchestra.run.smithi006.stdout:osd.0: {} 2023-08-01T19:55:05.848 INFO:teuthology.orchestra.run.smithi006.stdout:osd.1: {} 2023-08-01T19:55:05.868 INFO:teuthology.orchestra.run.smithi006.stdout:osd.2: {} 2023-08-01T19:55:05.869 INFO:teuthology.orchestra.run.smithi008.stdout:ERROR: (22) Invalid argument 2023-08-01T19:55:05.869 INFO:teuthology.orchestra.run.smithi008.stdout:op_tracker tracking is not enabled now, so no ops are tracked currently, even those get stuck. Please enable "osd_enable_op_tracker", and the tracker will start to track new ops received afterwards. 2023-08-01T19:55:05.869 INFO:teuthology.orchestra.run.smithi006.stderr:osd.0: osd_enable_op_tracker = 'false' 2023-08-01T19:55:05.870 INFO:teuthology.orchestra.run.smithi006.stderr:osd.1: osd_enable_op_tracker = 'false' 2023-08-01T19:55:05.870 INFO:teuthology.orchestra.run.smithi006.stderr:osd.2: osd_enable_op_tracker = 'false' 2023-08-01T19:55:05.876 INFO:tasks.ceph.osd.0.smithi008.stderr:2023-08-01T19:55:05.874+0000 7f16a58f4700 -1 received signal: Hangup from /usr/bin/python3 /bin/daemon-helper kill ceph-osd -f --cluster ceph -i 0 (PID: 111179) UID: 0 2023-08-01T19:55:05.884 DEBUG:teuthology.orchestra.run.smithi008:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 30 ceph --cluster ceph --admin-daemon /var/run/ceph/ceph-osd.0.asok dump_blocked_ops 2023-08-01T19:55:05.975 INFO:tasks.ceph.osd.0.smithi008.stderr:2023-08-01T19:55:05.975+0000 7f16a58f4700 -1 received signal: Hangup from /usr/bin/python3 /bin/daemon-helper kill ceph-osd -f --cluster ceph -i 0 (PID: 111179) UID: 0 2023-08-01T19:55:06.076 INFO:tasks.ceph.osd.0.smithi008.stderr:2023-08-01T19:55:06.075+0000 7f16a58f4700 -1 received signal: Hangup from /usr/bin/python3 /bin/daemon-helper kill ceph-osd -f --cluster ceph -i 0 (PID: 111179) UID: 0 2023-08-01T19:55:06.116 INFO:teuthology.orchestra.run.smithi008.stdout:ERROR: (22) Invalid argument 2023-08-01T19:55:06.117 INFO:teuthology.orchestra.run.smithi008.stdout:op_tracker tracking is not enabled now, so no ops are tracked currently, even those get stuck. Please enable "osd_enable_op_tracker", and the tracker will start to track new ops received afterwards. 2023-08-01T19:55:06.132 DEBUG:teuthology.orchestra.run.smithi008:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 30 ceph --cluster ceph --admin-daemon /var/run/ceph/ceph-osd.0.asok dump_historic_ops 2023-08-01T19:55:06.177 INFO:tasks.ceph.osd.2.smithi155.stderr:2023-08-01T19:55:06.175+0000 7faa5c6ac700 -1 received signal: Hangup from /usr/bin/python3 /bin/daemon-helper kill ceph-osd -f --cluster ceph -i 2 (PID: 111337) UID: 0 2023-08-01T19:55:06.277 INFO:tasks.ceph.osd.1.smithi101.stderr:2023-08-01T19:55:06.276+0000 7fb0cb7f6700 -1 received signal: Hangup from /usr/bin/python3 /bin/daemon-helper kill ceph-osd -f --cluster ceph -i 1 (PID: 111141) UID: 0 2023-08-01T19:55:06.316 INFO:tasks.radosbench.radosbench.0.smithi006.stdout: 42 16 102190 102174 152.032 109.375 0.00694829 0.00657463 2023-08-01T19:55:06.367 INFO:teuthology.orchestra.run.smithi008.stdout:ERROR: (22) Invalid argument 2023-08-01T19:55:06.368 INFO:teuthology.orchestra.run.smithi008.stdout:op_tracker tracking is not enabled now, so no ops are tracked currently, even those get stuck. Please enable "osd_enable_op_tracker", and the tracker will start to track new ops received afterwards. 2023-08-01T19:55:06.378 INFO:tasks.ceph.osd.1.smithi101.stderr:2023-08-01T19:55:06.377+0000 7fb0cb7f6700 -1 received signal: Hangup from /usr/bin/python3 /bin/daemon-helper kill ceph-osd -f --cluster ceph -i 1 (PID: 111141) UID: 0 2023-08-01T19:55:06.381 DEBUG:teuthology.orchestra.run.smithi101:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 30 ceph --cluster ceph --admin-daemon /var/run/ceph/ceph-osd.1.asok dump_ops_in_flight 2023-08-01T19:55:06.479 INFO:tasks.ceph.osd.0.smithi008.stderr:2023-08-01T19:55:06.478+0000 7f16a58f4700 -1 received signal: Hangup from /usr/bin/python3 /bin/daemon-helper kill ceph-osd -f --cluster ceph -i 0 (PID: 111179) UID: 0 2023-08-01T19:55:06.550 INFO:teuthology.orchestra.run.smithi101.stdout:ERROR: (22) Invalid argument 2023-08-01T19:55:06.550 INFO:teuthology.orchestra.run.smithi101.stdout:op_tracker tracking is not enabled now, so no ops are tracked currently, even those get stuck. Please enable "osd_enable_op_tracker", and the tracker will start to track new ops received afterwards. 2023-08-01T19:55:06.563 DEBUG:teuthology.orchestra.run.smithi101:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 30 ceph --cluster ceph --admin-daemon /var/run/ceph/ceph-osd.1.asok dump_blocked_ops 2023-08-01T19:55:06.565 INFO:teuthology.orchestra.run.smithi006.stderr:nodeep-scrub is unset 2023-08-01T19:55:06.580 INFO:tasks.ceph.osd.2.smithi155.stderr:2023-08-01T19:55:06.578+0000 7faa5c6ac700 -1 received signal: Hangup from /usr/bin/python3 /bin/daemon-helper kill ceph-osd -f --cluster ceph -i 2 (PID: 111337) UID: 0 2023-08-01T19:55:06.680 INFO:tasks.ceph.osd.2.smithi155.stderr:2023-08-01T19:55:06.679+0000 7faa5c6ac700 -1 received signal: Hangup from /usr/bin/python3 /bin/daemon-helper kill ceph-osd -f --cluster ceph -i 2 (PID: 111337) UID: 0 2023-08-01T19:55:06.729 INFO:teuthology.orchestra.run.smithi101.stdout:ERROR: (22) Invalid argument 2023-08-01T19:55:06.729 INFO:teuthology.orchestra.run.smithi101.stdout:op_tracker tracking is not enabled now, so no ops are tracked currently, even those get stuck. Please enable "osd_enable_op_tracker", and the tracker will start to track new ops received afterwards. 2023-08-01T19:55:06.743 DEBUG:teuthology.orchestra.run.smithi101:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 30 ceph --cluster ceph --admin-daemon /var/run/ceph/ceph-osd.1.asok dump_historic_ops 2023-08-01T19:55:06.781 INFO:tasks.ceph.osd.0.smithi008.stderr:2023-08-01T19:55:06.780+0000 7f16a58f4700 -1 received signal: Hangup from /usr/bin/python3 /bin/daemon-helper kill ceph-osd -f --cluster ceph -i 0 (PID: 111179) UID: 0 2023-08-01T19:55:06.882 INFO:tasks.ceph.osd.1.smithi101.stderr:2023-08-01T19:55:06.880+0000 7fb0cb7f6700 -1 received signal: Hangup from /usr/bin/python3 /bin/daemon-helper kill ceph-osd -f --cluster ceph -i 1 (PID: 111141) UID: 0 2023-08-01T19:55:06.919 INFO:teuthology.orchestra.run.smithi101.stdout:ERROR: (22) Invalid argument 2023-08-01T19:55:06.919 INFO:teuthology.orchestra.run.smithi101.stdout:op_tracker tracking is not enabled now, so no ops are tracked currently, even those get stuck. Please enable "osd_enable_op_tracker", and the tracker will start to track new ops received afterwards. 2023-08-01T19:55:06.933 DEBUG:teuthology.orchestra.run.smithi155:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 30 ceph --cluster ceph --admin-daemon /var/run/ceph/ceph-osd.2.asok dump_ops_in_flight 2023-08-01T19:55:06.983 INFO:tasks.ceph.osd.1.smithi101.stderr:2023-08-01T19:55:06.981+0000 7fb0cb7f6700 -1 received signal: Hangup from /usr/bin/python3 /bin/daemon-helper kill ceph-osd -f --cluster ceph -i 1 (PID: 111141) UID: 0 2023-08-01T19:55:07.085 INFO:tasks.ceph.osd.0.smithi008.stderr:2023-08-01T19:55:07.085+0000 7f16a58f4700 -1 received signal: Hangup from /usr/bin/python3 /bin/daemon-helper kill ceph-osd -f --cluster ceph -i 0 (PID: 111179) UID: 0 2023-08-01T19:55:07.099 INFO:teuthology.orchestra.run.smithi155.stdout:ERROR: (22) Invalid argument 2023-08-01T19:55:07.099 INFO:teuthology.orchestra.run.smithi155.stdout:op_tracker tracking is not enabled now, so no ops are tracked currently, even those get stuck. Please enable "osd_enable_op_tracker", and the tracker will start to track new ops received afterwards. 2023-08-01T19:55:07.111 DEBUG:teuthology.orchestra.run.smithi155:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 30 ceph --cluster ceph --admin-daemon /var/run/ceph/ceph-osd.2.asok dump_blocked_ops 2023-08-01T19:55:07.185 INFO:tasks.ceph.osd.0.smithi008.stderr:2023-08-01T19:55:07.184+0000 7f16a58f4700 -1 received signal: Hangup from /usr/bin/python3 /bin/daemon-helper kill ceph-osd -f --cluster ceph -i 0 (PID: 111179) UID: 0 2023-08-01T19:55:07.277 INFO:teuthology.orchestra.run.smithi155.stdout:ERROR: (22) Invalid argument 2023-08-01T19:55:07.278 INFO:teuthology.orchestra.run.smithi155.stdout:op_tracker tracking is not enabled now, so no ops are tracked currently, even those get stuck. Please enable "osd_enable_op_tracker", and the tracker will start to track new ops received afterwards. 2023-08-01T19:55:07.286 INFO:tasks.ceph.osd.0.smithi008.stderr:2023-08-01T19:55:07.285+0000 7f16a58f4700 -1 received signal: Hangup from /usr/bin/python3 /bin/daemon-helper kill ceph-osd -f --cluster ceph -i 0 (PID: 111179) UID: 0 2023-08-01T19:55:07.292 DEBUG:teuthology.orchestra.run.smithi155:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 30 ceph --cluster ceph --admin-daemon /var/run/ceph/ceph-osd.2.asok dump_historic_ops 2023-08-01T19:55:07.316 INFO:tasks.radosbench.radosbench.0.smithi006.stdout: 43 16 104112 104096 151.29 120.125 0.0108744 0.00660673 2023-08-01T19:55:07.387 INFO:tasks.ceph.osd.1.smithi101.stderr:2023-08-01T19:55:07.385+0000 7fb0cb7f6700 -1 received signal: Hangup from /usr/bin/python3 /bin/daemon-helper kill ceph-osd -f --cluster ceph -i 1 (PID: 111141) UID: 0 2023-08-01T19:55:07.453 INFO:teuthology.orchestra.run.smithi155.stdout:ERROR: (22) Invalid argument 2023-08-01T19:55:07.454 INFO:teuthology.orchestra.run.smithi155.stdout:op_tracker tracking is not enabled now, so no ops are tracked currently, even those get stuck. Please enable "osd_enable_op_tracker", and the tracker will start to track new ops received afterwards. 2023-08-01T19:55:07.467 DEBUG:teuthology.orchestra.run.smithi008:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 30 ceph --cluster ceph --admin-daemon /var/run/ceph/ceph-osd.0.asok dump_ops_in_flight 2023-08-01T19:55:07.512 INFO:tasks.ceph.osd.0.smithi008.stderr:2023-08-01T19:55:07.511+0000 7f16a58f4700 -1 received signal: Hangup from /usr/bin/python3 /bin/daemon-helper kill ceph-osd -f --cluster ceph -i 0 (PID: 111179) UID: 0 2023-08-01T19:55:07.589 INFO:tasks.ceph.osd.0.smithi008.stderr:2023-08-01T19:55:07.588+0000 7f16a58f4700 -1 received signal: Hangup from /usr/bin/python3 /bin/daemon-helper kill ceph-osd -f --cluster ceph -i 0 (PID: 111179) UID: 0 2023-08-01T19:55:07.658 INFO:teuthology.orchestra.run.smithi008.stdout:ERROR: (22) Invalid argument 2023-08-01T19:55:07.658 INFO:teuthology.orchestra.run.smithi008.stdout:op_tracker tracking is not enabled now, so no ops are tracked currently, even those get stuck. Please enable "osd_enable_op_tracker", and the tracker will start to track new ops received afterwards. 2023-08-01T19:55:07.673 DEBUG:teuthology.orchestra.run.smithi008:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 30 ceph --cluster ceph --admin-daemon /var/run/ceph/ceph-osd.0.asok dump_blocked_ops 2023-08-01T19:55:07.715 INFO:tasks.ceph.osd.0.smithi008.stderr:2023-08-01T19:55:07.714+0000 7f16a58f4700 -1 received signal: Hangup from /usr/bin/python3 /bin/daemon-helper kill ceph-osd -f --cluster ceph -i 0 (PID: 111179) UID: 0 2023-08-01T19:55:07.791 INFO:tasks.ceph.osd.1.smithi101.stderr:2023-08-01T19:55:07.789+0000 7fb0cb7f6700 -1 received signal: Hangup from /usr/bin/python3 /bin/daemon-helper kill ceph-osd -f --cluster ceph -i 1 (PID: 111141) UID: 0 2023-08-01T19:55:07.882 DEBUG:teuthology.orchestra.run.smithi006:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 120 ceph --cluster ceph -- tell 'osd.*' injectargs --osd_enable_op_tracker=true 2023-08-01T19:55:07.891 INFO:tasks.ceph.osd.0.smithi008.stderr:2023-08-01T19:55:07.891+0000 7f16a58f4700 -1 received signal: Hangup from /usr/bin/python3 /bin/daemon-helper kill ceph-osd -f --cluster ceph -i 0 (PID: 111179) UID: 0 2023-08-01T19:55:07.911 INFO:teuthology.orchestra.run.smithi008.stdout:ERROR: (22) Invalid argument 2023-08-01T19:55:07.911 INFO:teuthology.orchestra.run.smithi008.stdout:op_tracker tracking is not enabled now, so no ops are tracked currently, even those get stuck. Please enable "osd_enable_op_tracker", and the tracker will start to track new ops received afterwards. 2023-08-01T19:55:07.927 DEBUG:teuthology.orchestra.run.smithi008:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 30 ceph --cluster ceph --admin-daemon /var/run/ceph/ceph-osd.0.asok dump_historic_ops 2023-08-01T19:55:07.992 INFO:tasks.ceph.osd.1.smithi101.stderr:2023-08-01T19:55:07.990+0000 7fb0cb7f6700 -1 received signal: Hangup from /usr/bin/python3 /bin/daemon-helper kill ceph-osd -f --cluster ceph -i 1 (PID: 111141) UID: 0 2023-08-01T19:55:08.035 INFO:teuthology.orchestra.run.smithi006.stdout:osd.0: {} 2023-08-01T19:55:08.056 INFO:teuthology.orchestra.run.smithi006.stdout:osd.1: {} 2023-08-01T19:55:08.076 INFO:teuthology.orchestra.run.smithi006.stdout:osd.2: {} 2023-08-01T19:55:08.077 INFO:teuthology.orchestra.run.smithi006.stderr:osd.0: osd_enable_op_tracker = 'true' 2023-08-01T19:55:08.077 INFO:teuthology.orchestra.run.smithi006.stderr:osd.1: osd_enable_op_tracker = 'true' 2023-08-01T19:55:08.077 INFO:teuthology.orchestra.run.smithi006.stderr:osd.2: osd_enable_op_tracker = 'true' 2023-08-01T19:55:08.092 INFO:tasks.ceph.osd.1.smithi101.stderr:2023-08-01T19:55:08.091+0000 7fb0cb7f6700 -1 received signal: Hangup from /usr/bin/python3 /bin/daemon-helper kill ceph-osd -f --cluster ceph -i 1 (PID: 111141) UID: 0 2023-08-01T19:55:08.161 INFO:teuthology.orchestra.run.smithi008.stdout:{ 2023-08-01T19:55:08.161 INFO:teuthology.orchestra.run.smithi008.stdout: "size": 20, 2023-08-01T19:55:08.162 INFO:teuthology.orchestra.run.smithi008.stdout: "duration": 600, 2023-08-01T19:55:08.162 INFO:teuthology.orchestra.run.smithi008.stdout: "ops": [ 2023-08-01T19:55:08.162 INFO:teuthology.orchestra.run.smithi008.stdout: { 2023-08-01T19:55:08.163 INFO:teuthology.orchestra.run.smithi008.stdout: "description": "osd_op(client.4668.0:65870 5.c 5:33dffb88:::benchmark_data_smithi006_114134_object65869:head [set-alloc-hint object_size 65536 write_size 65536,write 0~65536] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e29)", 2023-08-01T19:55:08.163 INFO:teuthology.orchestra.run.smithi008.stdout: "initiated_at": "2023-08-01T19:54:47.659854+0000", 2023-08-01T19:55:08.163 INFO:teuthology.orchestra.run.smithi008.stdout: "age": 20.49636108, 2023-08-01T19:55:08.163 INFO:teuthology.orchestra.run.smithi008.stdout: "duration": 0.018513103999999999, 2023-08-01T19:55:08.164 INFO:teuthology.orchestra.run.smithi008.stdout: "type_data": { 2023-08-01T19:55:08.164 INFO:teuthology.orchestra.run.smithi008.stdout: "flag_point": "commit sent; apply or cleanup", 2023-08-01T19:55:08.164 INFO:teuthology.orchestra.run.smithi008.stdout: "client_info": { 2023-08-01T19:55:08.164 INFO:teuthology.orchestra.run.smithi008.stdout: "client": "client.4668", 2023-08-01T19:55:08.165 INFO:teuthology.orchestra.run.smithi008.stdout: "client_addr": "172.21.15.6:0/1709472247", 2023-08-01T19:55:08.165 INFO:teuthology.orchestra.run.smithi008.stdout: "tid": 65870 2023-08-01T19:55:08.165 INFO:teuthology.orchestra.run.smithi008.stdout: }, 2023-08-01T19:55:08.165 INFO:teuthology.orchestra.run.smithi008.stdout: "events": [ 2023-08-01T19:55:08.165 INFO:teuthology.orchestra.run.smithi008.stdout: { 2023-08-01T19:55:08.165 INFO:teuthology.orchestra.run.smithi008.stdout: "event": "initiated", 2023-08-01T19:55:08.166 INFO:teuthology.orchestra.run.smithi008.stdout: "time": "2023-08-01T19:54:47.659854+0000", 2023-08-01T19:55:08.166 INFO:teuthology.orchestra.run.smithi008.stdout: "duration": 0 2023-08-01T19:55:08.166 INFO:teuthology.orchestra.run.smithi008.stdout: }, 2023-08-01T19:55:08.166 INFO:teuthology.orchestra.run.smithi008.stdout: { 2023-08-01T19:55:08.166 INFO:teuthology.orchestra.run.smithi008.stdout: "event": "throttled", 2023-08-01T19:55:08.166 INFO:teuthology.orchestra.run.smithi008.stdout: "time": "2023-08-01T19:54:47.659854+0000", 2023-08-01T19:55:08.167 INFO:teuthology.orchestra.run.smithi008.stdout: "duration": 0 2023-08-01T19:55:08.167 INFO:teuthology.orchestra.run.smithi008.stdout: }, 2023-08-01T19:55:08.167 INFO:teuthology.orchestra.run.smithi008.stdout: { 2023-08-01T19:55:08.167 INFO:teuthology.orchestra.run.smithi008.stdout: "event": "header_read", 2023-08-01T19:55:08.167 INFO:teuthology.orchestra.run.smithi008.stdout: "time": "2023-08-01T19:54:47.659853+0000", 2023-08-01T19:55:08.167 INFO:teuthology.orchestra.run.smithi008.stdout: "duration": 4294967295.999999 2023-08-01T19:55:08.167 INFO:teuthology.orchestra.run.smithi008.stdout: }, 2023-08-01T19:55:08.168 INFO:teuthology.orchestra.run.smithi008.stdout: { 2023-08-01T19:55:08.168 INFO:teuthology.orchestra.run.smithi008.stdout: "event": "all_read", 2023-08-01T19:55:08.168 INFO:teuthology.orchestra.run.smithi008.stdout: "time": "2023-08-01T19:54:47.660013+0000", 2023-08-01T19:55:08.168 INFO:teuthology.orchestra.run.smithi008.stdout: "duration": 0.00015954900000000001 2023-08-01T19:55:08.168 INFO:teuthology.orchestra.run.smithi008.stdout: }, 2023-08-01T19:55:08.168 INFO:teuthology.orchestra.run.smithi008.stdout: { 2023-08-01T19:55:08.168 INFO:teuthology.orchestra.run.smithi008.stdout: "event": "dispatched", 2023-08-01T19:55:08.168 INFO:teuthology.orchestra.run.smithi008.stdout: "time": "2023-08-01T19:54:47.660023+0000", 2023-08-01T19:55:08.169 INFO:teuthology.orchestra.run.smithi008.stdout: "duration": 1.0327e-05 2023-08-01T19:55:08.169 INFO:teuthology.orchestra.run.smithi008.stdout: }, 2023-08-01T19:55:08.169 INFO:teuthology.orchestra.run.smithi008.stdout: { 2023-08-01T19:55:08.169 INFO:teuthology.orchestra.run.smithi008.stdout: "event": "queued_for_pg", 2023-08-01T19:55:08.169 INFO:teuthology.orchestra.run.smithi008.stdout: "time": "2023-08-01T19:54:47.660039+0000", 2023-08-01T19:55:08.169 INFO:teuthology.orchestra.run.smithi008.stdout: "duration": 1.5829999999999999e-05 2023-08-01T19:55:08.169 INFO:teuthology.orchestra.run.smithi008.stdout: }, 2023-08-01T19:55:08.170 INFO:teuthology.orchestra.run.smithi008.stdout: { 2023-08-01T19:55:08.170 INFO:teuthology.orchestra.run.smithi008.stdout: "event": "reached_pg", 2023-08-01T19:55:08.170 INFO:teuthology.orchestra.run.smithi008.stdout: "time": "2023-08-01T19:54:47.662611+0000", 2023-08-01T19:55:08.170 INFO:teuthology.orchestra.run.smithi008.stdout: "duration": 0.002572319 2023-08-01T19:55:08.170 INFO:teuthology.orchestra.run.smithi008.stdout: }, 2023-08-01T19:55:08.170 INFO:teuthology.orchestra.run.smithi008.stdout: { 2023-08-01T19:55:08.170 INFO:teuthology.orchestra.run.smithi008.stdout: "event": "started", 2023-08-01T19:55:08.170 INFO:teuthology.orchestra.run.smithi008.stdout: "time": "2023-08-01T19:54:47.662767+0000", 2023-08-01T19:55:08.171 INFO:teuthology.orchestra.run.smithi008.stdout: "duration": 0.00015598200000000001 2023-08-01T19:55:08.171 INFO:teuthology.orchestra.run.smithi008.stdout: }, 2023-08-01T19:55:08.171 INFO:teuthology.orchestra.run.smithi008.stdout: { 2023-08-01T19:55:08.171 INFO:teuthology.orchestra.run.smithi008.stdout: "event": "waiting for subops from 1", 2023-08-01T19:55:08.171 INFO:teuthology.orchestra.run.smithi008.stdout: "time": "2023-08-01T19:54:47.662930+0000", 2023-08-01T19:55:08.171 INFO:teuthology.orchestra.run.smithi008.stdout: "duration": 0.000163086 2023-08-01T19:55:08.171 INFO:teuthology.orchestra.run.smithi008.stdout: }, 2023-08-01T19:55:08.171 INFO:teuthology.orchestra.run.smithi008.stdout: { 2023-08-01T19:55:08.172 INFO:teuthology.orchestra.run.smithi008.stdout: "event": "sub_op_commit_rec", 2023-08-01T19:55:08.172 INFO:teuthology.orchestra.run.smithi008.stdout: "time": "2023-08-01T19:54:47.667336+0000", 2023-08-01T19:55:08.172 INFO:teuthology.orchestra.run.smithi008.stdout: "duration": 0.0044062839999999999 2023-08-01T19:55:08.172 INFO:teuthology.orchestra.run.smithi008.stdout: }, 2023-08-01T19:55:08.172 INFO:teuthology.orchestra.run.smithi008.stdout: { 2023-08-01T19:55:08.172 INFO:teuthology.orchestra.run.smithi008.stdout: "event": "op_commit", 2023-08-01T19:55:08.172 INFO:teuthology.orchestra.run.smithi008.stdout: "time": "2023-08-01T19:54:47.678278+0000", 2023-08-01T19:55:08.172 INFO:teuthology.orchestra.run.smithi008.stdout: "duration": 0.010941912999999999 2023-08-01T19:55:08.173 INFO:teuthology.orchestra.run.smithi008.stdout: }, 2023-08-01T19:55:08.173 INFO:teuthology.orchestra.run.smithi008.stdout: { 2023-08-01T19:55:08.173 INFO:teuthology.orchestra.run.smithi008.stdout: "event": "commit_sent", 2023-08-01T19:55:08.173 INFO:teuthology.orchestra.run.smithi008.stdout: "time": "2023-08-01T19:54:47.678325+0000", 2023-08-01T19:55:08.173 INFO:teuthology.orchestra.run.smithi008.stdout: "duration": 4.6449999999999997e-05 2023-08-01T19:55:08.173 INFO:teuthology.orchestra.run.smithi008.stdout: }, 2023-08-01T19:55:08.173 INFO:teuthology.orchestra.run.smithi008.stdout: { 2023-08-01T19:55:08.174 INFO:teuthology.orchestra.run.smithi008.stdout: "event": "done", 2023-08-01T19:55:08.174 INFO:teuthology.orchestra.run.smithi008.stdout: "time": "2023-08-01T19:54:47.678367+0000", 2023-08-01T19:55:08.174 INFO:teuthology.orchestra.run.smithi008.stdout: "duration": 4.2222999999999999e-05 2023-08-01T19:55:08.174 INFO:teuthology.orchestra.run.smithi008.stdout: } 2023-08-01T19:55:08.174 INFO:teuthology.orchestra.run.smithi008.stdout: ] 2023-08-01T19:55:08.174 INFO:teuthology.orchestra.run.smithi008.stdout: } 2023-08-01T19:55:08.174 INFO:teuthology.orchestra.run.smithi008.stdout: }, 2023-08-01T19:55:08.174 INFO:teuthology.orchestra.run.smithi008.stdout: { 2023-08-01T19:55:08.175 INFO:teuthology.orchestra.run.smithi008.stdout: "description": "osd_op(client.4668.0:75018 5.c 5:337cd9ad:::benchmark_data_smithi006_114134_object75017:head [set-alloc-hint object_size 65536 write_size 65536,write 0~65536] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e32)", 2023-08-01T19:55:08.175 INFO:teuthology.orchestra.run.smithi008.stdout: "initiated_at": "2023-08-01T19:54:52.219412+0000", 2023-08-01T19:55:08.175 INFO:teuthology.orchestra.run.smithi008.stdout: "age": 15.936802557, 2023-08-01T19:55:08.175 INFO:teuthology.orchestra.run.smithi008.stdout: "duration": 0.021247918000000001, 2023-08-01T19:55:08.175 INFO:teuthology.orchestra.run.smithi008.stdout: "type_data": { 2023-08-01T19:55:08.175 INFO:teuthology.orchestra.run.smithi008.stdout: "flag_point": "commit sent; apply or cleanup", 2023-08-01T19:55:08.175 INFO:teuthology.orchestra.run.smithi008.stdout: "client_info": { 2023-08-01T19:55:08.175 INFO:teuthology.orchestra.run.smithi008.stdout: "client": "client.4668", 2023-08-01T19:55:08.176 INFO:teuthology.orchestra.run.smithi008.stdout: "client_addr": "172.21.15.6:0/1709472247", 2023-08-01T19:55:08.176 INFO:teuthology.orchestra.run.smithi008.stdout: "tid": 75018 2023-08-01T19:55:08.176 INFO:teuthology.orchestra.run.smithi008.stdout: }, 2023-08-01T19:55:08.176 INFO:teuthology.orchestra.run.smithi008.stdout: "events": [ 2023-08-01T19:55:08.176 INFO:teuthology.orchestra.run.smithi008.stdout: { 2023-08-01T19:55:08.176 INFO:teuthology.orchestra.run.smithi008.stdout: "event": "initiated", 2023-08-01T19:55:08.176 INFO:teuthology.orchestra.run.smithi008.stdout: "time": "2023-08-01T19:54:52.219412+0000", 2023-08-01T19:55:08.176 INFO:teuthology.orchestra.run.smithi008.stdout: "duration": 0 2023-08-01T19:55:08.177 INFO:teuthology.orchestra.run.smithi008.stdout: }, 2023-08-01T19:55:08.177 INFO:teuthology.orchestra.run.smithi008.stdout: { 2023-08-01T19:55:08.177 INFO:teuthology.orchestra.run.smithi008.stdout: "event": "throttled", 2023-08-01T19:55:08.177 INFO:teuthology.orchestra.run.smithi008.stdout: "time": "2023-08-01T19:54:52.219412+0000", 2023-08-01T19:55:08.177 INFO:teuthology.orchestra.run.smithi008.stdout: "duration": 0 2023-08-01T19:55:08.177 INFO:teuthology.orchestra.run.smithi008.stdout: }, 2023-08-01T19:55:08.177 INFO:teuthology.orchestra.run.smithi008.stdout: { 2023-08-01T19:55:08.177 INFO:teuthology.orchestra.run.smithi008.stdout: "event": "header_read", 2023-08-01T19:55:08.178 INFO:teuthology.orchestra.run.smithi008.stdout: "time": "2023-08-01T19:54:52.219412+0000", 2023-08-01T19:55:08.178 INFO:teuthology.orchestra.run.smithi008.stdout: "duration": 4294967295.999999 2023-08-01T19:55:08.178 INFO:teuthology.orchestra.run.smithi008.stdout: }, 2023-08-01T19:55:08.178 INFO:teuthology.orchestra.run.smithi008.stdout: { 2023-08-01T19:55:08.178 INFO:teuthology.orchestra.run.smithi008.stdout: "event": "all_read", 2023-08-01T19:55:08.178 INFO:teuthology.orchestra.run.smithi008.stdout: "time": "2023-08-01T19:54:52.219529+0000", 2023-08-01T19:55:08.178 INFO:teuthology.orchestra.run.smithi008.stdout: "duration": 0.000117207 2023-08-01T19:55:08.178 INFO:teuthology.orchestra.run.smithi008.stdout: }, 2023-08-01T19:55:08.179 INFO:teuthology.orchestra.run.smithi008.stdout: { 2023-08-01T19:55:08.179 INFO:teuthology.orchestra.run.smithi008.stdout: "event": "dispatched", 2023-08-01T19:55:08.179 INFO:teuthology.orchestra.run.smithi008.stdout: "time": "2023-08-01T19:54:52.219541+0000", 2023-08-01T19:55:08.179 INFO:teuthology.orchestra.run.smithi008.stdout: "duration": 1.2448e-05 2023-08-01T19:55:08.179 INFO:teuthology.orchestra.run.smithi008.stdout: }, 2023-08-01T19:55:08.179 INFO:teuthology.orchestra.run.smithi008.stdout: { 2023-08-01T19:55:08.179 INFO:teuthology.orchestra.run.smithi008.stdout: "event": "queued_for_pg", 2023-08-01T19:55:08.180 INFO:teuthology.orchestra.run.smithi008.stdout: "time": "2023-08-01T19:54:52.219547+0000", 2023-08-01T19:55:08.180 INFO:teuthology.orchestra.run.smithi008.stdout: "duration": 5.7899999999999996e-06 2023-08-01T19:55:08.180 INFO:teuthology.orchestra.run.smithi008.stdout: }, 2023-08-01T19:55:08.180 INFO:teuthology.orchestra.run.smithi008.stdout: { 2023-08-01T19:55:08.180 INFO:teuthology.orchestra.run.smithi008.stdout: "event": "reached_pg", 2023-08-01T19:55:08.180 INFO:teuthology.orchestra.run.smithi008.stdout: "time": "2023-08-01T19:54:52.228949+0000", 2023-08-01T19:55:08.180 INFO:teuthology.orchestra.run.smithi008.stdout: "duration": 0.009401754 2023-08-01T19:55:08.180 INFO:teuthology.orchestra.run.smithi008.stdout: }, 2023-08-01T19:55:08.181 INFO:teuthology.orchestra.run.smithi008.stdout: { 2023-08-01T19:55:08.181 INFO:teuthology.orchestra.run.smithi008.stdout: "event": "started", 2023-08-01T19:55:08.181 INFO:teuthology.orchestra.run.smithi008.stdout: "time": "2023-08-01T19:54:52.229103+0000", 2023-08-01T19:55:08.181 INFO:teuthology.orchestra.run.smithi008.stdout: "duration": 0.00015462399999999999 2023-08-01T19:55:08.181 INFO:teuthology.orchestra.run.smithi008.stdout: }, 2023-08-01T19:55:08.181 INFO:teuthology.orchestra.run.smithi008.stdout: { 2023-08-01T19:55:08.181 INFO:teuthology.orchestra.run.smithi008.stdout: "event": "waiting for subops from 1", 2023-08-01T19:55:08.181 INFO:teuthology.orchestra.run.smithi008.stdout: "time": "2023-08-01T19:54:52.229261+0000", 2023-08-01T19:55:08.182 INFO:teuthology.orchestra.run.smithi008.stdout: "duration": 0.00015758300000000001 2023-08-01T19:55:08.182 INFO:teuthology.orchestra.run.smithi008.stdout: }, 2023-08-01T19:55:08.182 INFO:teuthology.orchestra.run.smithi008.stdout: { 2023-08-01T19:55:08.182 INFO:teuthology.orchestra.run.smithi008.stdout: "event": "sub_op_commit_rec", 2023-08-01T19:55:08.182 INFO:teuthology.orchestra.run.smithi008.stdout: "time": "2023-08-01T19:54:52.234395+0000", 2023-08-01T19:55:08.182 INFO:teuthology.orchestra.run.smithi008.stdout: "duration": 0.0051335080000000002 2023-08-01T19:55:08.182 INFO:teuthology.orchestra.run.smithi008.stdout: }, 2023-08-01T19:55:08.182 INFO:teuthology.orchestra.run.smithi008.stdout: { 2023-08-01T19:55:08.183 INFO:teuthology.orchestra.run.smithi008.stdout: "event": "op_commit", 2023-08-01T19:55:08.183 INFO:teuthology.orchestra.run.smithi008.stdout: "time": "2023-08-01T19:54:52.240575+0000", 2023-08-01T19:55:08.183 INFO:teuthology.orchestra.run.smithi008.stdout: "duration": 0.0061804099999999999 2023-08-01T19:55:08.183 INFO:teuthology.orchestra.run.smithi008.stdout: }, 2023-08-01T19:55:08.183 INFO:teuthology.orchestra.run.smithi008.stdout: { 2023-08-01T19:55:08.183 INFO:teuthology.orchestra.run.smithi008.stdout: "event": "commit_sent", 2023-08-01T19:55:08.183 INFO:teuthology.orchestra.run.smithi008.stdout: "time": "2023-08-01T19:54:52.240620+0000", 2023-08-01T19:55:08.183 INFO:teuthology.orchestra.run.smithi008.stdout: "duration": 4.4972999999999998e-05 2023-08-01T19:55:08.184 INFO:teuthology.orchestra.run.smithi008.stdout: }, 2023-08-01T19:55:08.184 INFO:teuthology.orchestra.run.smithi008.stdout: { 2023-08-01T19:55:08.184 INFO:teuthology.orchestra.run.smithi008.stdout: "event": "done", 2023-08-01T19:55:08.184 INFO:teuthology.orchestra.run.smithi008.stdout: "time": "2023-08-01T19:54:52.240660+0000", 2023-08-01T19:55:08.184 INFO:teuthology.orchestra.run.smithi008.stdout: "duration": 4.0348000000000001e-05 2023-08-01T19:55:08.184 INFO:teuthology.orchestra.run.smithi008.stdout: } 2023-08-01T19:55:08.185 INFO:teuthology.orchestra.run.smithi008.stdout: ] 2023-08-01T19:55:08.185 INFO:teuthology.orchestra.run.smithi008.stdout: } 2023-08-01T19:55:08.185 INFO:teuthology.orchestra.run.smithi008.stdout: }, 2023-08-01T19:55:08.185 INFO:teuthology.orchestra.run.smithi008.stdout: { 2023-08-01T19:55:08.185 INFO:teuthology.orchestra.run.smithi008.stdout: "description": "osd_repop(client.4668.0:75022 5.4 e32/19 5:20404e0b:::benchmark_data_smithi006_114134_object75021:head v 32'4630, mlcod=32'4627)", 2023-08-01T19:55:08.186 INFO:teuthology.orchestra.run.smithi008.stdout: "initiated_at": "2023-08-01T19:54:52.221931+0000", 2023-08-01T19:55:08.186 INFO:teuthology.orchestra.run.smithi008.stdout: "age": 15.934283468, 2023-08-01T19:55:08.186 INFO:teuthology.orchestra.run.smithi008.stdout: "duration": 0.018596688, 2023-08-01T19:55:08.186 INFO:teuthology.orchestra.run.smithi008.stdout: "type_data": { 2023-08-01T19:55:08.187 INFO:teuthology.orchestra.run.smithi008.stdout: "flag_point": "commit sent; apply or cleanup", 2023-08-01T19:55:08.187 INFO:teuthology.orchestra.run.smithi008.stdout: "events": [ 2023-08-01T19:55:08.187 INFO:teuthology.orchestra.run.smithi008.stdout: { 2023-08-01T19:55:08.187 INFO:teuthology.orchestra.run.smithi008.stdout: "event": "initiated", 2023-08-01T19:55:08.188 INFO:teuthology.orchestra.run.smithi008.stdout: "time": "2023-08-01T19:54:52.221931+0000", 2023-08-01T19:55:08.188 INFO:teuthology.orchestra.run.smithi008.stdout: "duration": 0 2023-08-01T19:55:08.188 INFO:teuthology.orchestra.run.smithi008.stdout: }, 2023-08-01T19:55:08.188 INFO:teuthology.orchestra.run.smithi008.stdout: { 2023-08-01T19:55:08.189 INFO:teuthology.orchestra.run.smithi008.stdout: "event": "throttled", 2023-08-01T19:55:08.189 INFO:teuthology.orchestra.run.smithi008.stdout: "time": "2023-08-01T19:54:52.221931+0000", 2023-08-01T19:55:08.189 INFO:teuthology.orchestra.run.smithi008.stdout: "duration": 0 2023-08-01T19:55:08.189 INFO:teuthology.orchestra.run.smithi008.stdout: }, 2023-08-01T19:55:08.190 INFO:teuthology.orchestra.run.smithi008.stdout: { 2023-08-01T19:55:08.190 INFO:teuthology.orchestra.run.smithi008.stdout: "event": "header_read", 2023-08-01T19:55:08.190 INFO:teuthology.orchestra.run.smithi008.stdout: "time": "2023-08-01T19:54:52.221931+0000", 2023-08-01T19:55:08.190 INFO:teuthology.orchestra.run.smithi008.stdout: "duration": 4294967295.9999995 2023-08-01T19:55:08.191 INFO:teuthology.orchestra.run.smithi008.stdout: }, 2023-08-01T19:55:08.191 INFO:teuthology.orchestra.run.smithi008.stdout: { 2023-08-01T19:55:08.191 INFO:teuthology.orchestra.run.smithi008.stdout: "event": "all_read", 2023-08-01T19:55:08.191 INFO:teuthology.orchestra.run.smithi008.stdout: "time": "2023-08-01T19:54:52.222002+0000", 2023-08-01T19:55:08.192 INFO:teuthology.orchestra.run.smithi008.stdout: "duration": 7.0870000000000004e-05 2023-08-01T19:55:08.192 INFO:teuthology.orchestra.run.smithi008.stdout: }, 2023-08-01T19:55:08.192 INFO:teuthology.orchestra.run.smithi008.stdout: { 2023-08-01T19:55:08.192 INFO:teuthology.orchestra.run.smithi008.stdout: "event": "dispatched", 2023-08-01T19:55:08.193 INFO:teuthology.orchestra.run.smithi008.stdout: "time": "2023-08-01T19:54:52.222015+0000", 2023-08-01T19:55:08.193 INFO:teuthology.orchestra.run.smithi008.stdout: "duration": 1.327e-05 2023-08-01T19:55:08.193 INFO:teuthology.orchestra.run.smithi008.stdout: }, 2023-08-01T19:55:08.193 INFO:teuthology.orchestra.run.smithi008.stdout: { 2023-08-01T19:55:08.193 INFO:teuthology.orchestra.run.smithi008.stdout: "event": "queued_for_pg", 2023-08-01T19:55:08.194 INFO:teuthology.orchestra.run.smithi008.stdout: "time": "2023-08-01T19:54:52.222022+0000", 2023-08-01T19:55:08.194 INFO:teuthology.orchestra.run.smithi008.stdout: "duration": 7.1729999999999998e-06 2023-08-01T19:55:08.194 INFO:teuthology.orchestra.run.smithi008.stdout: }, 2023-08-01T19:55:08.194 INFO:teuthology.orchestra.run.smithi008.stdout: { 2023-08-01T19:55:08.195 INFO:teuthology.orchestra.run.smithi008.stdout: "event": "reached_pg", 2023-08-01T19:55:08.195 INFO:teuthology.orchestra.run.smithi008.stdout: "time": "2023-08-01T19:54:52.224857+0000", 2023-08-01T19:55:08.195 INFO:teuthology.orchestra.run.smithi008.stdout: "duration": 0.0028351600000000002 2023-08-01T19:55:08.195 INFO:teuthology.orchestra.run.smithi008.stdout: }, 2023-08-01T19:55:08.196 INFO:teuthology.orchestra.run.smithi008.stdout: { 2023-08-01T19:55:08.196 INFO:teuthology.orchestra.run.smithi008.stdout: "event": "started", 2023-08-01T19:55:08.196 INFO:teuthology.orchestra.run.smithi008.stdout: "time": "2023-08-01T19:54:52.224877+0000", 2023-08-01T19:55:08.196 INFO:teuthology.orchestra.run.smithi008.stdout: "duration": 1.9839000000000001e-05 2023-08-01T19:55:08.197 INFO:teuthology.orchestra.run.smithi008.stdout: }, 2023-08-01T19:55:08.197 INFO:teuthology.orchestra.run.smithi008.stdout: { 2023-08-01T19:55:08.197 INFO:teuthology.orchestra.run.smithi008.stdout: "event": "commit_sent", 2023-08-01T19:55:08.197 INFO:teuthology.orchestra.run.smithi008.stdout: "time": "2023-08-01T19:54:52.240497+0000", 2023-08-01T19:55:08.198 INFO:teuthology.orchestra.run.smithi008.stdout: "duration": 0.015619928 2023-08-01T19:55:08.198 INFO:teuthology.orchestra.run.smithi008.stdout: }, 2023-08-01T19:55:08.198 INFO:teuthology.orchestra.run.smithi008.stdout: { 2023-08-01T19:55:08.198 INFO:teuthology.orchestra.run.smithi008.stdout: "event": "done", 2023-08-01T19:55:08.198 INFO:teuthology.orchestra.run.smithi008.stdout: "time": "2023-08-01T19:54:52.240528+0000", 2023-08-01T19:55:08.199 INFO:teuthology.orchestra.run.smithi008.stdout: "duration": 3.1029999999999999e-05 2023-08-01T19:55:08.199 INFO:teuthology.orchestra.run.smithi008.stdout: } 2023-08-01T19:55:08.199 INFO:teuthology.orchestra.run.smithi008.stdout: ] 2023-08-01T19:55:08.199 INFO:teuthology.orchestra.run.smithi008.stdout: } 2023-08-01T19:55:08.200 INFO:teuthology.orchestra.run.smithi008.stdout: }, 2023-08-01T19:55:08.200 INFO:teuthology.orchestra.run.smithi008.stdout: { 2023-08-01T19:55:08.200 INFO:teuthology.orchestra.run.smithi008.stdout: "description": "osd_op(client.4668.0:92748 5.a 5:5a6df433:::benchmark_data_smithi006_114134_object92747:head [set-alloc-hint object_size 65536 write_size 65536,write 0~65536] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e36)", 2023-08-01T19:55:08.200 INFO:teuthology.orchestra.run.smithi008.stdout: "initiated_at": "2023-08-01T19:55:01.265831+0000", 2023-08-01T19:55:08.200 INFO:teuthology.orchestra.run.smithi008.stdout: "age": 6.8903837000000001, 2023-08-01T19:55:08.201 INFO:teuthology.orchestra.run.smithi008.stdout: "duration": 0.020344932999999999, 2023-08-01T19:55:08.201 INFO:teuthology.orchestra.run.smithi008.stdout: "type_data": { 2023-08-01T19:55:08.201 INFO:teuthology.orchestra.run.smithi008.stdout: "flag_point": "commit sent; apply or cleanup", 2023-08-01T19:55:08.201 INFO:teuthology.orchestra.run.smithi008.stdout: "client_info": { 2023-08-01T19:55:08.202 INFO:teuthology.orchestra.run.smithi008.stdout: "client": "client.4668", 2023-08-01T19:55:08.202 INFO:teuthology.orchestra.run.smithi008.stdout: "client_addr": "172.21.15.6:0/1709472247", 2023-08-01T19:55:08.202 INFO:teuthology.orchestra.run.smithi008.stdout: "tid": 92748 2023-08-01T19:55:08.202 INFO:teuthology.orchestra.run.smithi008.stdout: }, 2023-08-01T19:55:08.202 INFO:teuthology.orchestra.run.smithi008.stdout: "events": [ 2023-08-01T19:55:08.203 INFO:teuthology.orchestra.run.smithi008.stdout: { 2023-08-01T19:55:08.203 INFO:teuthology.orchestra.run.smithi008.stdout: "event": "initiated", 2023-08-01T19:55:08.203 INFO:teuthology.orchestra.run.smithi008.stdout: "time": "2023-08-01T19:55:01.265831+0000", 2023-08-01T19:55:08.203 INFO:teuthology.orchestra.run.smithi008.stdout: "duration": 0 2023-08-01T19:55:08.203 INFO:teuthology.orchestra.run.smithi008.stdout: }, 2023-08-01T19:55:08.203 INFO:teuthology.orchestra.run.smithi008.stdout: { 2023-08-01T19:55:08.203 INFO:teuthology.orchestra.run.smithi008.stdout: "event": "throttled", 2023-08-01T19:55:08.203 INFO:teuthology.orchestra.run.smithi008.stdout: "time": "2023-08-01T19:55:01.265831+0000", 2023-08-01T19:55:08.204 INFO:teuthology.orchestra.run.smithi008.stdout: "duration": 0 2023-08-01T19:55:08.204 INFO:teuthology.orchestra.run.smithi008.stdout: }, 2023-08-01T19:55:08.204 INFO:teuthology.orchestra.run.smithi008.stdout: { 2023-08-01T19:55:08.204 INFO:teuthology.orchestra.run.smithi008.stdout: "event": "header_read", 2023-08-01T19:55:08.204 INFO:teuthology.orchestra.run.smithi008.stdout: "time": "2023-08-01T19:55:01.265831+0000", 2023-08-01T19:55:08.204 INFO:teuthology.orchestra.run.smithi008.stdout: "duration": 4294967295.9999995 2023-08-01T19:55:08.205 INFO:teuthology.orchestra.run.smithi008.stdout: }, 2023-08-01T19:55:08.205 INFO:teuthology.orchestra.run.smithi008.stdout: { 2023-08-01T19:55:08.205 INFO:teuthology.orchestra.run.smithi008.stdout: "event": "all_read", 2023-08-01T19:55:08.205 INFO:teuthology.orchestra.run.smithi008.stdout: "time": "2023-08-01T19:55:01.265912+0000", 2023-08-01T19:55:08.205 INFO:teuthology.orchestra.run.smithi008.stdout: "duration": 8.1255999999999996e-05 2023-08-01T19:55:08.205 INFO:teuthology.orchestra.run.smithi008.stdout: }, 2023-08-01T19:55:08.205 INFO:teuthology.orchestra.run.smithi008.stdout: { 2023-08-01T19:55:08.205 INFO:teuthology.orchestra.run.smithi008.stdout: "event": "dispatched", 2023-08-01T19:55:08.206 INFO:teuthology.orchestra.run.smithi008.stdout: "time": "2023-08-01T19:55:01.265918+0000", 2023-08-01T19:55:08.206 INFO:teuthology.orchestra.run.smithi008.stdout: "duration": 6.6239999999999996e-06 2023-08-01T19:55:08.206 INFO:teuthology.orchestra.run.smithi008.stdout: }, 2023-08-01T19:55:08.206 INFO:teuthology.orchestra.run.smithi008.stdout: { 2023-08-01T19:55:08.206 INFO:teuthology.orchestra.run.smithi008.stdout: "event": "queued_for_pg", 2023-08-01T19:55:08.206 INFO:teuthology.orchestra.run.smithi008.stdout: "time": "2023-08-01T19:55:01.265922+0000", 2023-08-01T19:55:08.207 INFO:teuthology.orchestra.run.smithi008.stdout: "duration": 4.0500000000000002e-06 2023-08-01T19:55:08.207 INFO:teuthology.orchestra.run.smithi008.stdout: }, 2023-08-01T19:55:08.207 INFO:teuthology.orchestra.run.smithi008.stdout: { 2023-08-01T19:55:08.207 INFO:teuthology.orchestra.run.smithi008.stdout: "event": "reached_pg", 2023-08-01T19:55:08.207 INFO:teuthology.orchestra.run.smithi008.stdout: "time": "2023-08-01T19:55:01.274247+0000", 2023-08-01T19:55:08.207 INFO:teuthology.orchestra.run.smithi008.stdout: "duration": 0.0083243710000000005 2023-08-01T19:55:08.208 INFO:teuthology.orchestra.run.smithi008.stdout: }, 2023-08-01T19:55:08.208 INFO:teuthology.orchestra.run.smithi008.stdout: { 2023-08-01T19:55:08.208 INFO:teuthology.orchestra.run.smithi008.stdout: "event": "started", 2023-08-01T19:55:08.208 INFO:teuthology.orchestra.run.smithi008.stdout: "time": "2023-08-01T19:55:01.274401+0000", 2023-08-01T19:55:08.208 INFO:teuthology.orchestra.run.smithi008.stdout: "duration": 0.00015387800000000001 2023-08-01T19:55:08.208 INFO:teuthology.orchestra.run.smithi008.stdout: }, 2023-08-01T19:55:08.208 INFO:teuthology.orchestra.run.smithi008.stdout: { 2023-08-01T19:55:08.209 INFO:teuthology.orchestra.run.smithi008.stdout: "event": "waiting for subops from 2", 2023-08-01T19:55:08.209 INFO:teuthology.orchestra.run.smithi008.stdout: "time": "2023-08-01T19:55:01.274572+0000", 2023-08-01T19:55:08.209 INFO:teuthology.orchestra.run.smithi008.stdout: "duration": 0.00017160600000000001 2023-08-01T19:55:08.209 INFO:teuthology.orchestra.run.smithi008.stdout: }, 2023-08-01T19:55:08.209 INFO:teuthology.orchestra.run.smithi008.stdout: { 2023-08-01T19:55:08.209 INFO:teuthology.orchestra.run.smithi008.stdout: "event": "sub_op_commit_rec", 2023-08-01T19:55:08.209 INFO:teuthology.orchestra.run.smithi008.stdout: "time": "2023-08-01T19:55:01.281281+0000", 2023-08-01T19:55:08.209 INFO:teuthology.orchestra.run.smithi008.stdout: "duration": 0.0067083200000000003 2023-08-01T19:55:08.210 INFO:teuthology.orchestra.run.smithi008.stdout: }, 2023-08-01T19:55:08.210 INFO:teuthology.orchestra.run.smithi008.stdout: { 2023-08-01T19:55:08.210 INFO:teuthology.orchestra.run.smithi008.stdout: "event": "op_commit", 2023-08-01T19:55:08.210 INFO:teuthology.orchestra.run.smithi008.stdout: "time": "2023-08-01T19:55:01.286090+0000", 2023-08-01T19:55:08.210 INFO:teuthology.orchestra.run.smithi008.stdout: "duration": 0.0048095810000000003 2023-08-01T19:55:08.210 INFO:teuthology.orchestra.run.smithi008.stdout: }, 2023-08-01T19:55:08.210 INFO:teuthology.orchestra.run.smithi008.stdout: { 2023-08-01T19:55:08.210 INFO:teuthology.orchestra.run.smithi008.stdout: "event": "commit_sent", 2023-08-01T19:55:08.211 INFO:teuthology.orchestra.run.smithi008.stdout: "time": "2023-08-01T19:55:01.286138+0000", 2023-08-01T19:55:08.211 INFO:teuthology.orchestra.run.smithi008.stdout: "duration": 4.7899000000000003e-05 2023-08-01T19:55:08.211 INFO:teuthology.orchestra.run.smithi008.stdout: }, 2023-08-01T19:55:08.211 INFO:teuthology.orchestra.run.smithi008.stdout: { 2023-08-01T19:55:08.211 INFO:teuthology.orchestra.run.smithi008.stdout: "event": "done", 2023-08-01T19:55:08.211 INFO:teuthology.orchestra.run.smithi008.stdout: "time": "2023-08-01T19:55:01.286176+0000", 2023-08-01T19:55:08.211 INFO:teuthology.orchestra.run.smithi008.stdout: "duration": 3.8037999999999997e-05 2023-08-01T19:55:08.211 INFO:teuthology.orchestra.run.smithi008.stdout: } 2023-08-01T19:55:08.212 INFO:teuthology.orchestra.run.smithi008.stdout: ] 2023-08-01T19:55:08.212 INFO:teuthology.orchestra.run.smithi008.stdout: } 2023-08-01T19:55:08.212 INFO:teuthology.orchestra.run.smithi008.stdout: }, 2023-08-01T19:55:08.212 INFO:teuthology.orchestra.run.smithi008.stdout: { 2023-08-01T19:55:08.212 INFO:teuthology.orchestra.run.smithi008.stdout: "description": "osd_op(client.4668.0:92751 5.a 5:5ba747f8:::benchmark_data_smithi006_114134_object92750:head [set-alloc-hint object_size 65536 write_size 65536,write 0~65536] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e36)", 2023-08-01T19:55:08.212 INFO:teuthology.orchestra.run.smithi008.stdout: "initiated_at": "2023-08-01T19:55:01.267677+0000", 2023-08-01T19:55:08.212 INFO:teuthology.orchestra.run.smithi008.stdout: "age": 6.8885376059999999, 2023-08-01T19:55:08.213 INFO:teuthology.orchestra.run.smithi008.stdout: "duration": 0.01857607, 2023-08-01T19:55:08.213 INFO:teuthology.orchestra.run.smithi008.stdout: "type_data": { 2023-08-01T19:55:08.213 INFO:teuthology.orchestra.run.smithi008.stdout: "flag_point": "commit sent; apply or cleanup", 2023-08-01T19:55:08.213 INFO:teuthology.orchestra.run.smithi008.stdout: "client_info": { 2023-08-01T19:55:08.213 INFO:teuthology.orchestra.run.smithi008.stdout: "client": "client.4668", 2023-08-01T19:55:08.213 INFO:teuthology.orchestra.run.smithi008.stdout: "client_addr": "172.21.15.6:0/1709472247", 2023-08-01T19:55:08.213 INFO:teuthology.orchestra.run.smithi008.stdout: "tid": 92751 2023-08-01T19:55:08.213 INFO:teuthology.orchestra.run.smithi008.stdout: }, 2023-08-01T19:55:08.214 INFO:teuthology.orchestra.run.smithi008.stdout: "events": [ 2023-08-01T19:55:08.214 INFO:teuthology.orchestra.run.smithi008.stdout: { 2023-08-01T19:55:08.214 INFO:teuthology.orchestra.run.smithi008.stdout: "event": "initiated", 2023-08-01T19:55:08.214 INFO:teuthology.orchestra.run.smithi008.stdout: "time": "2023-08-01T19:55:01.267677+0000", 2023-08-01T19:55:08.214 INFO:teuthology.orchestra.run.smithi008.stdout: "duration": 0 2023-08-01T19:55:08.214 INFO:teuthology.orchestra.run.smithi008.stdout: }, 2023-08-01T19:55:08.214 INFO:teuthology.orchestra.run.smithi008.stdout: { 2023-08-01T19:55:08.215 INFO:teuthology.orchestra.run.smithi008.stdout: "event": "throttled", 2023-08-01T19:55:08.215 INFO:teuthology.orchestra.run.smithi008.stdout: "time": "2023-08-01T19:55:01.267677+0000", 2023-08-01T19:55:08.215 INFO:teuthology.orchestra.run.smithi008.stdout: "duration": 0 2023-08-01T19:55:08.215 INFO:teuthology.orchestra.run.smithi008.stdout: }, 2023-08-01T19:55:08.215 INFO:teuthology.orchestra.run.smithi008.stdout: { 2023-08-01T19:55:08.215 INFO:teuthology.orchestra.run.smithi008.stdout: "event": "header_read", 2023-08-01T19:55:08.215 INFO:teuthology.orchestra.run.smithi008.stdout: "time": "2023-08-01T19:55:01.267676+0000", 2023-08-01T19:55:08.216 INFO:teuthology.orchestra.run.smithi008.stdout: "duration": 4294967295.999999 2023-08-01T19:55:08.216 INFO:teuthology.orchestra.run.smithi008.stdout: }, 2023-08-01T19:55:08.216 INFO:teuthology.orchestra.run.smithi008.stdout: { 2023-08-01T19:55:08.216 INFO:teuthology.orchestra.run.smithi008.stdout: "event": "all_read", 2023-08-01T19:55:08.216 INFO:teuthology.orchestra.run.smithi008.stdout: "time": "2023-08-01T19:55:01.267764+0000", 2023-08-01T19:55:08.216 INFO:teuthology.orchestra.run.smithi008.stdout: "duration": 8.7640999999999997e-05 2023-08-01T19:55:08.216 INFO:teuthology.orchestra.run.smithi008.stdout: }, 2023-08-01T19:55:08.217 INFO:teuthology.orchestra.run.smithi008.stdout: { 2023-08-01T19:55:08.217 INFO:teuthology.orchestra.run.smithi008.stdout: "event": "dispatched", 2023-08-01T19:55:08.217 INFO:teuthology.orchestra.run.smithi008.stdout: "time": "2023-08-01T19:55:01.267777+0000", 2023-08-01T19:55:08.217 INFO:teuthology.orchestra.run.smithi008.stdout: "duration": 1.279e-05 2023-08-01T19:55:08.217 INFO:teuthology.orchestra.run.smithi008.stdout: }, 2023-08-01T19:55:08.217 INFO:teuthology.orchestra.run.smithi008.stdout: { 2023-08-01T19:55:08.217 INFO:teuthology.orchestra.run.smithi008.stdout: "event": "queued_for_pg", 2023-08-01T19:55:08.218 INFO:teuthology.orchestra.run.smithi008.stdout: "time": "2023-08-01T19:55:01.267783+0000", 2023-08-01T19:55:08.218 INFO:teuthology.orchestra.run.smithi008.stdout: "duration": 6.246e-06 2023-08-01T19:55:08.218 INFO:teuthology.orchestra.run.smithi008.stdout: }, 2023-08-01T19:55:08.218 INFO:teuthology.orchestra.run.smithi008.stdout: { 2023-08-01T19:55:08.218 INFO:teuthology.orchestra.run.smithi008.stdout: "event": "reached_pg", 2023-08-01T19:55:08.218 INFO:teuthology.orchestra.run.smithi008.stdout: "time": "2023-08-01T19:55:01.276584+0000", 2023-08-01T19:55:08.218 INFO:teuthology.orchestra.run.smithi008.stdout: "duration": 0.0088004180000000008 2023-08-01T19:55:08.218 INFO:teuthology.orchestra.run.smithi008.stdout: }, 2023-08-01T19:55:08.219 INFO:teuthology.orchestra.run.smithi008.stdout: { 2023-08-01T19:55:08.219 INFO:teuthology.orchestra.run.smithi008.stdout: "event": "started", 2023-08-01T19:55:08.219 INFO:teuthology.orchestra.run.smithi008.stdout: "time": "2023-08-01T19:55:01.276717+0000", 2023-08-01T19:55:08.219 INFO:teuthology.orchestra.run.smithi008.stdout: "duration": 0.000133075 2023-08-01T19:55:08.219 INFO:teuthology.orchestra.run.smithi008.stdout: }, 2023-08-01T19:55:08.219 INFO:teuthology.orchestra.run.smithi008.stdout: { 2023-08-01T19:55:08.219 INFO:teuthology.orchestra.run.smithi008.stdout: "event": "waiting for subops from 2", 2023-08-01T19:55:08.220 INFO:teuthology.orchestra.run.smithi008.stdout: "time": "2023-08-01T19:55:01.276876+0000", 2023-08-01T19:55:08.220 INFO:teuthology.orchestra.run.smithi008.stdout: "duration": 0.000159507 2023-08-01T19:55:08.220 INFO:teuthology.orchestra.run.smithi008.stdout: }, 2023-08-01T19:55:08.220 INFO:teuthology.orchestra.run.smithi008.stdout: { 2023-08-01T19:55:08.220 INFO:teuthology.orchestra.run.smithi008.stdout: "event": "sub_op_commit_rec", 2023-08-01T19:55:08.220 INFO:teuthology.orchestra.run.smithi008.stdout: "time": "2023-08-01T19:55:01.281311+0000", 2023-08-01T19:55:08.220 INFO:teuthology.orchestra.run.smithi008.stdout: "duration": 0.0044348720000000003 2023-08-01T19:55:08.221 INFO:teuthology.orchestra.run.smithi008.stdout: }, 2023-08-01T19:55:08.221 INFO:teuthology.orchestra.run.smithi008.stdout: { 2023-08-01T19:55:08.221 INFO:teuthology.orchestra.run.smithi008.stdout: "event": "op_commit", 2023-08-01T19:55:08.221 INFO:teuthology.orchestra.run.smithi008.stdout: "time": "2023-08-01T19:55:01.286186+0000", 2023-08-01T19:55:08.221 INFO:teuthology.orchestra.run.smithi008.stdout: "duration": 0.0048753190000000004 2023-08-01T19:55:08.221 INFO:teuthology.orchestra.run.smithi008.stdout: }, 2023-08-01T19:55:08.221 INFO:teuthology.orchestra.run.smithi008.stdout: { 2023-08-01T19:55:08.221 INFO:teuthology.orchestra.run.smithi008.stdout: "event": "commit_sent", 2023-08-01T19:55:08.222 INFO:teuthology.orchestra.run.smithi008.stdout: "time": "2023-08-01T19:55:01.286222+0000", 2023-08-01T19:55:08.222 INFO:teuthology.orchestra.run.smithi008.stdout: "duration": 3.5618999999999999e-05 2023-08-01T19:55:08.222 INFO:teuthology.orchestra.run.smithi008.stdout: }, 2023-08-01T19:55:08.222 INFO:teuthology.orchestra.run.smithi008.stdout: { 2023-08-01T19:55:08.222 INFO:teuthology.orchestra.run.smithi008.stdout: "event": "done", 2023-08-01T19:55:08.222 INFO:teuthology.orchestra.run.smithi008.stdout: "time": "2023-08-01T19:55:01.286253+0000", 2023-08-01T19:55:08.222 INFO:teuthology.orchestra.run.smithi008.stdout: "duration": 3.1402999999999997e-05 2023-08-01T19:55:08.222 INFO:teuthology.orchestra.run.smithi008.stdout: } 2023-08-01T19:55:08.223 INFO:teuthology.orchestra.run.smithi008.stdout: ] 2023-08-01T19:55:08.223 INFO:teuthology.orchestra.run.smithi008.stdout: } 2023-08-01T19:55:08.223 INFO:teuthology.orchestra.run.smithi008.stdout: }, 2023-08-01T19:55:08.223 INFO:teuthology.orchestra.run.smithi008.stdout: { 2023-08-01T19:55:08.223 INFO:teuthology.orchestra.run.smithi008.stdout: "description": "osd_op(client.4668.0:92752 5.a 5:5b277e4c:::benchmark_data_smithi006_114134_object92751:head [set-alloc-hint object_size 65536 write_size 65536,write 0~65536] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e36)", 2023-08-01T19:55:08.223 INFO:teuthology.orchestra.run.smithi008.stdout: "initiated_at": "2023-08-01T19:55:01.270482+0000", 2023-08-01T19:55:08.223 INFO:teuthology.orchestra.run.smithi008.stdout: "age": 6.8857333550000002, 2023-08-01T19:55:08.223 INFO:teuthology.orchestra.run.smithi008.stdout: "duration": 0.020253584000000002, 2023-08-01T19:55:08.224 INFO:teuthology.orchestra.run.smithi008.stdout: "type_data": { 2023-08-01T19:55:08.224 INFO:teuthology.orchestra.run.smithi008.stdout: "flag_point": "commit sent; apply or cleanup", 2023-08-01T19:55:08.224 INFO:teuthology.orchestra.run.smithi008.stdout: "client_info": { 2023-08-01T19:55:08.224 INFO:teuthology.orchestra.run.smithi008.stdout: "client": "client.4668", 2023-08-01T19:55:08.224 INFO:teuthology.orchestra.run.smithi008.stdout: "client_addr": "172.21.15.6:0/1709472247", 2023-08-01T19:55:08.224 INFO:teuthology.orchestra.run.smithi008.stdout: "tid": 92752 2023-08-01T19:55:08.224 INFO:teuthology.orchestra.run.smithi008.stdout: }, 2023-08-01T19:55:08.225 INFO:teuthology.orchestra.run.smithi008.stdout: "events": [ 2023-08-01T19:55:08.225 INFO:teuthology.orchestra.run.smithi008.stdout: { 2023-08-01T19:55:08.225 INFO:teuthology.orchestra.run.smithi008.stdout: "event": "initiated", 2023-08-01T19:55:08.225 INFO:teuthology.orchestra.run.smithi008.stdout: "time": "2023-08-01T19:55:01.270482+0000", 2023-08-01T19:55:08.225 INFO:teuthology.orchestra.run.smithi008.stdout: "duration": 0 2023-08-01T19:55:08.225 INFO:teuthology.orchestra.run.smithi008.stdout: }, 2023-08-01T19:55:08.225 INFO:teuthology.orchestra.run.smithi008.stdout: { 2023-08-01T19:55:08.225 INFO:teuthology.orchestra.run.smithi008.stdout: "event": "throttled", 2023-08-01T19:55:08.226 INFO:teuthology.orchestra.run.smithi008.stdout: "time": "2023-08-01T19:55:01.270482+0000", 2023-08-01T19:55:08.226 INFO:teuthology.orchestra.run.smithi008.stdout: "duration": 0 2023-08-01T19:55:08.226 INFO:teuthology.orchestra.run.smithi008.stdout: }, 2023-08-01T19:55:08.226 INFO:teuthology.orchestra.run.smithi008.stdout: { 2023-08-01T19:55:08.226 INFO:teuthology.orchestra.run.smithi008.stdout: "event": "header_read", 2023-08-01T19:55:08.226 INFO:teuthology.orchestra.run.smithi008.stdout: "time": "2023-08-01T19:55:01.270481+0000", 2023-08-01T19:55:08.226 INFO:teuthology.orchestra.run.smithi008.stdout: "duration": 4294967295.999999 2023-08-01T19:55:08.226 INFO:teuthology.orchestra.run.smithi008.stdout: }, 2023-08-01T19:55:08.227 INFO:teuthology.orchestra.run.smithi008.stdout: { 2023-08-01T19:55:08.227 INFO:teuthology.orchestra.run.smithi008.stdout: "event": "all_read", 2023-08-01T19:55:08.227 INFO:teuthology.orchestra.run.smithi008.stdout: "time": "2023-08-01T19:55:01.270530+0000", 2023-08-01T19:55:08.227 INFO:teuthology.orchestra.run.smithi008.stdout: "duration": 4.9066000000000001e-05 2023-08-01T19:55:08.227 INFO:teuthology.orchestra.run.smithi008.stdout: }, 2023-08-01T19:55:08.227 INFO:teuthology.orchestra.run.smithi008.stdout: { 2023-08-01T19:55:08.227 INFO:teuthology.orchestra.run.smithi008.stdout: "event": "dispatched", 2023-08-01T19:55:08.227 INFO:teuthology.orchestra.run.smithi008.stdout: "time": "2023-08-01T19:55:01.270538+0000", 2023-08-01T19:55:08.228 INFO:teuthology.orchestra.run.smithi008.stdout: "duration": 8.1890000000000007e-06 2023-08-01T19:55:08.228 INFO:teuthology.orchestra.run.smithi008.stdout: }, 2023-08-01T19:55:08.228 INFO:teuthology.orchestra.run.smithi008.stdout: { 2023-08-01T19:55:08.228 INFO:teuthology.orchestra.run.smithi008.stdout: "event": "queued_for_pg", 2023-08-01T19:55:08.228 INFO:teuthology.orchestra.run.smithi008.stdout: "time": "2023-08-01T19:55:01.270543+0000", 2023-08-01T19:55:08.228 INFO:teuthology.orchestra.run.smithi008.stdout: "duration": 4.5800000000000002e-06 2023-08-01T19:55:08.228 INFO:teuthology.orchestra.run.smithi008.stdout: }, 2023-08-01T19:55:08.229 INFO:teuthology.orchestra.run.smithi008.stdout: { 2023-08-01T19:55:08.229 INFO:teuthology.orchestra.run.smithi008.stdout: "event": "reached_pg", 2023-08-01T19:55:08.229 INFO:teuthology.orchestra.run.smithi008.stdout: "time": "2023-08-01T19:55:01.281425+0000", 2023-08-01T19:55:08.229 INFO:teuthology.orchestra.run.smithi008.stdout: "duration": 0.010882265 2023-08-01T19:55:08.229 INFO:teuthology.orchestra.run.smithi008.stdout: }, 2023-08-01T19:55:08.229 INFO:teuthology.orchestra.run.smithi008.stdout: { 2023-08-01T19:55:08.229 INFO:teuthology.orchestra.run.smithi008.stdout: "event": "started", 2023-08-01T19:55:08.229 INFO:teuthology.orchestra.run.smithi008.stdout: "time": "2023-08-01T19:55:01.281564+0000", 2023-08-01T19:55:08.230 INFO:teuthology.orchestra.run.smithi008.stdout: "duration": 0.00013942300000000001 2023-08-01T19:55:08.230 INFO:teuthology.orchestra.run.smithi008.stdout: }, 2023-08-01T19:55:08.230 INFO:teuthology.orchestra.run.smithi008.stdout: { 2023-08-01T19:55:08.230 INFO:teuthology.orchestra.run.smithi008.stdout: "event": "waiting for subops from 2", 2023-08-01T19:55:08.230 INFO:teuthology.orchestra.run.smithi008.stdout: "time": "2023-08-01T19:55:01.281718+0000", 2023-08-01T19:55:08.230 INFO:teuthology.orchestra.run.smithi008.stdout: "duration": 0.00015354499999999999 2023-08-01T19:55:08.230 INFO:teuthology.orchestra.run.smithi008.stdout: }, 2023-08-01T19:55:08.230 INFO:teuthology.orchestra.run.smithi008.stdout: { 2023-08-01T19:55:08.231 INFO:teuthology.orchestra.run.smithi008.stdout: "event": "sub_op_commit_rec", 2023-08-01T19:55:08.231 INFO:teuthology.orchestra.run.smithi008.stdout: "time": "2023-08-01T19:55:01.286303+0000", 2023-08-01T19:55:08.231 INFO:teuthology.orchestra.run.smithi008.stdout: "duration": 0.0045851650000000004 2023-08-01T19:55:08.231 INFO:teuthology.orchestra.run.smithi008.stdout: }, 2023-08-01T19:55:08.231 INFO:teuthology.orchestra.run.smithi008.stdout: { 2023-08-01T19:55:08.231 INFO:teuthology.orchestra.run.smithi008.stdout: "event": "op_commit", 2023-08-01T19:55:08.231 INFO:teuthology.orchestra.run.smithi008.stdout: "time": "2023-08-01T19:55:01.290628+0000", 2023-08-01T19:55:08.231 INFO:teuthology.orchestra.run.smithi008.stdout: "duration": 0.004324652 2023-08-01T19:55:08.232 INFO:teuthology.orchestra.run.smithi008.stdout: }, 2023-08-01T19:55:08.232 INFO:teuthology.orchestra.run.smithi008.stdout: { 2023-08-01T19:55:08.232 INFO:teuthology.orchestra.run.smithi008.stdout: "event": "commit_sent", 2023-08-01T19:55:08.232 INFO:teuthology.orchestra.run.smithi008.stdout: "time": "2023-08-01T19:55:01.290697+0000", 2023-08-01T19:55:08.232 INFO:teuthology.orchestra.run.smithi008.stdout: "duration": 6.9231000000000002e-05 2023-08-01T19:55:08.232 INFO:teuthology.orchestra.run.smithi008.stdout: }, 2023-08-01T19:55:08.232 INFO:teuthology.orchestra.run.smithi008.stdout: { 2023-08-01T19:55:08.233 INFO:teuthology.orchestra.run.smithi008.stdout: "event": "done", 2023-08-01T19:55:08.233 INFO:teuthology.orchestra.run.smithi008.stdout: "time": "2023-08-01T19:55:01.290735+0000", 2023-08-01T19:55:08.233 INFO:teuthology.orchestra.run.smithi008.stdout: "duration": 3.8343999999999997e-05 2023-08-01T19:55:08.233 INFO:teuthology.orchestra.run.smithi008.stdout: } 2023-08-01T19:55:08.233 INFO:teuthology.orchestra.run.smithi008.stdout: ] 2023-08-01T19:55:08.233 INFO:teuthology.orchestra.run.smithi008.stdout: } 2023-08-01T19:55:08.233 INFO:teuthology.orchestra.run.smithi008.stdout: }, 2023-08-01T19:55:08.233 INFO:teuthology.orchestra.run.smithi008.stdout: { 2023-08-01T19:55:08.234 INFO:teuthology.orchestra.run.smithi008.stdout: "description": "osd_op(client.4668.0:100240 5.a 5:5313c5b9:::benchmark_data_smithi006_114134_object100239:head [set-alloc-hint object_size 65536 write_size 65536,write 0~65536] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e37)", 2023-08-01T19:55:08.234 INFO:teuthology.orchestra.run.smithi008.stdout: "initiated_at": "2023-08-01T19:55:05.148399+0000", 2023-08-01T19:55:08.234 INFO:teuthology.orchestra.run.smithi008.stdout: "age": 3.007816338, 2023-08-01T19:55:08.234 INFO:teuthology.orchestra.run.smithi008.stdout: "duration": 0.077278904999999995, 2023-08-01T19:55:08.234 INFO:teuthology.orchestra.run.smithi008.stdout: "type_data": { 2023-08-01T19:55:08.234 INFO:teuthology.orchestra.run.smithi008.stdout: "flag_point": "commit sent; apply or cleanup", 2023-08-01T19:55:08.234 INFO:teuthology.orchestra.run.smithi008.stdout: "client_info": { 2023-08-01T19:55:08.234 INFO:teuthology.orchestra.run.smithi008.stdout: "client": "client.4668", 2023-08-01T19:55:08.235 INFO:teuthology.orchestra.run.smithi008.stdout: "client_addr": "172.21.15.6:0/1709472247", 2023-08-01T19:55:08.235 INFO:teuthology.orchestra.run.smithi008.stdout: "tid": 100240 2023-08-01T19:55:08.235 INFO:teuthology.orchestra.run.smithi008.stdout: }, 2023-08-01T19:55:08.235 INFO:teuthology.orchestra.run.smithi008.stdout: "events": [ 2023-08-01T19:55:08.235 INFO:teuthology.orchestra.run.smithi008.stdout: { 2023-08-01T19:55:08.235 INFO:teuthology.orchestra.run.smithi008.stdout: "event": "initiated", 2023-08-01T19:55:08.235 INFO:teuthology.orchestra.run.smithi008.stdout: "time": "2023-08-01T19:55:05.148399+0000", 2023-08-01T19:55:08.235 INFO:teuthology.orchestra.run.smithi008.stdout: "duration": 0 2023-08-01T19:55:08.236 INFO:teuthology.orchestra.run.smithi008.stdout: }, 2023-08-01T19:55:08.236 INFO:teuthology.orchestra.run.smithi008.stdout: { 2023-08-01T19:55:08.236 INFO:teuthology.orchestra.run.smithi008.stdout: "event": "throttled", 2023-08-01T19:55:08.236 INFO:teuthology.orchestra.run.smithi008.stdout: "time": "2023-08-01T19:55:05.148399+0000", 2023-08-01T19:55:08.236 INFO:teuthology.orchestra.run.smithi008.stdout: "duration": 0 2023-08-01T19:55:08.236 INFO:teuthology.orchestra.run.smithi008.stdout: }, 2023-08-01T19:55:08.236 INFO:teuthology.orchestra.run.smithi008.stdout: { 2023-08-01T19:55:08.237 INFO:teuthology.orchestra.run.smithi008.stdout: "event": "header_read", 2023-08-01T19:55:08.237 INFO:teuthology.orchestra.run.smithi008.stdout: "time": "2023-08-01T19:55:05.148398+0000", 2023-08-01T19:55:08.237 INFO:teuthology.orchestra.run.smithi008.stdout: "duration": 4294967295.999999 2023-08-01T19:55:08.237 INFO:teuthology.orchestra.run.smithi008.stdout: }, 2023-08-01T19:55:08.237 INFO:teuthology.orchestra.run.smithi008.stdout: { 2023-08-01T19:55:08.237 INFO:teuthology.orchestra.run.smithi008.stdout: "event": "all_read", 2023-08-01T19:55:08.237 INFO:teuthology.orchestra.run.smithi008.stdout: "time": "2023-08-01T19:55:05.148492+0000", 2023-08-01T19:55:08.237 INFO:teuthology.orchestra.run.smithi008.stdout: "duration": 9.3892000000000002e-05 2023-08-01T19:55:08.238 INFO:teuthology.orchestra.run.smithi008.stdout: }, 2023-08-01T19:55:08.238 INFO:teuthology.orchestra.run.smithi008.stdout: { 2023-08-01T19:55:08.238 INFO:teuthology.orchestra.run.smithi008.stdout: "event": "dispatched", 2023-08-01T19:55:08.238 INFO:teuthology.orchestra.run.smithi008.stdout: "time": "2023-08-01T19:55:05.148503+0000", 2023-08-01T19:55:08.238 INFO:teuthology.orchestra.run.smithi008.stdout: "duration": 1.0951000000000001e-05 2023-08-01T19:55:08.238 INFO:teuthology.orchestra.run.smithi008.stdout: }, 2023-08-01T19:55:08.238 INFO:teuthology.orchestra.run.smithi008.stdout: { 2023-08-01T19:55:08.238 INFO:teuthology.orchestra.run.smithi008.stdout: "event": "queued_for_pg", 2023-08-01T19:55:08.239 INFO:teuthology.orchestra.run.smithi008.stdout: "time": "2023-08-01T19:55:05.148508+0000", 2023-08-01T19:55:08.239 INFO:teuthology.orchestra.run.smithi008.stdout: "duration": 5.0080000000000002e-06 2023-08-01T19:55:08.239 INFO:teuthology.orchestra.run.smithi008.stdout: }, 2023-08-01T19:55:08.239 INFO:teuthology.orchestra.run.smithi008.stdout: { 2023-08-01T19:55:08.239 INFO:teuthology.orchestra.run.smithi008.stdout: "event": "reached_pg", 2023-08-01T19:55:08.239 INFO:teuthology.orchestra.run.smithi008.stdout: "time": "2023-08-01T19:55:05.148548+0000", 2023-08-01T19:55:08.239 INFO:teuthology.orchestra.run.smithi008.stdout: "duration": 4.0358999999999998e-05 2023-08-01T19:55:08.239 INFO:teuthology.orchestra.run.smithi008.stdout: }, 2023-08-01T19:55:08.240 INFO:teuthology.orchestra.run.smithi008.stdout: { 2023-08-01T19:55:08.240 INFO:teuthology.orchestra.run.smithi008.stdout: "event": "started", 2023-08-01T19:55:08.240 INFO:teuthology.orchestra.run.smithi008.stdout: "time": "2023-08-01T19:55:05.148666+0000", 2023-08-01T19:55:08.240 INFO:teuthology.orchestra.run.smithi008.stdout: "duration": 0.000117621 2023-08-01T19:55:08.240 INFO:teuthology.orchestra.run.smithi008.stdout: }, 2023-08-01T19:55:08.240 INFO:teuthology.orchestra.run.smithi008.stdout: { 2023-08-01T19:55:08.240 INFO:teuthology.orchestra.run.smithi008.stdout: "event": "waiting for subops from 2", 2023-08-01T19:55:08.240 INFO:teuthology.orchestra.run.smithi008.stdout: "time": "2023-08-01T19:55:05.148805+0000", 2023-08-01T19:55:08.241 INFO:teuthology.orchestra.run.smithi008.stdout: "duration": 0.000139176 2023-08-01T19:55:08.241 INFO:teuthology.orchestra.run.smithi008.stdout: }, 2023-08-01T19:55:08.241 INFO:teuthology.orchestra.run.smithi008.stdout: { 2023-08-01T19:55:08.241 INFO:teuthology.orchestra.run.smithi008.stdout: "event": "op_commit", 2023-08-01T19:55:08.241 INFO:teuthology.orchestra.run.smithi008.stdout: "time": "2023-08-01T19:55:05.156143+0000", 2023-08-01T19:55:08.241 INFO:teuthology.orchestra.run.smithi008.stdout: "duration": 0.007338041 2023-08-01T19:55:08.241 INFO:teuthology.orchestra.run.smithi008.stdout: }, 2023-08-01T19:55:08.242 INFO:teuthology.orchestra.run.smithi008.stdout: { 2023-08-01T19:55:08.242 INFO:teuthology.orchestra.run.smithi008.stdout: "event": "sub_op_commit_rec", 2023-08-01T19:55:08.242 INFO:teuthology.orchestra.run.smithi008.stdout: "time": "2023-08-01T19:55:05.225581+0000", 2023-08-01T19:55:08.242 INFO:teuthology.orchestra.run.smithi008.stdout: "duration": 0.069438402999999996 2023-08-01T19:55:08.242 INFO:teuthology.orchestra.run.smithi008.stdout: }, 2023-08-01T19:55:08.242 INFO:teuthology.orchestra.run.smithi008.stdout: { 2023-08-01T19:55:08.242 INFO:teuthology.orchestra.run.smithi008.stdout: "event": "commit_sent", 2023-08-01T19:55:08.242 INFO:teuthology.orchestra.run.smithi008.stdout: "time": "2023-08-01T19:55:05.225632+0000", 2023-08-01T19:55:08.243 INFO:teuthology.orchestra.run.smithi008.stdout: "duration": 5.0382e-05 2023-08-01T19:55:08.243 INFO:teuthology.orchestra.run.smithi008.stdout: }, 2023-08-01T19:55:08.243 INFO:teuthology.orchestra.run.smithi008.stdout: { 2023-08-01T19:55:08.243 INFO:teuthology.orchestra.run.smithi008.stdout: "event": "done", 2023-08-01T19:55:08.243 INFO:teuthology.orchestra.run.smithi008.stdout: "time": "2023-08-01T19:55:05.225677+0000", 2023-08-01T19:55:08.243 INFO:teuthology.orchestra.run.smithi008.stdout: "duration": 4.5893000000000003e-05 2023-08-01T19:55:08.243 INFO:teuthology.orchestra.run.smithi008.stdout: } 2023-08-01T19:55:08.243 INFO:teuthology.orchestra.run.smithi008.stdout: ] 2023-08-01T19:55:08.244 INFO:teuthology.orchestra.run.smithi008.stdout: } 2023-08-01T19:55:08.244 INFO:teuthology.orchestra.run.smithi008.stdout: }, 2023-08-01T19:55:08.244 INFO:teuthology.orchestra.run.smithi008.stdout: { 2023-08-01T19:55:08.244 INFO:teuthology.orchestra.run.smithi008.stdout: "description": "osd_op(client.4668.0:100243 5.a 5:5e8193b6:::benchmark_data_smithi006_114134_object100242:head [set-alloc-hint object_size 65536 write_size 65536,write 0~65536] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e37)", 2023-08-01T19:55:08.244 INFO:teuthology.orchestra.run.smithi008.stdout: "initiated_at": "2023-08-01T19:55:05.150737+0000", 2023-08-01T19:55:08.244 INFO:teuthology.orchestra.run.smithi008.stdout: "age": 3.0054778830000002, 2023-08-01T19:55:08.244 INFO:teuthology.orchestra.run.smithi008.stdout: "duration": 0.075019885999999994, 2023-08-01T19:55:08.245 INFO:teuthology.orchestra.run.smithi008.stdout: "type_data": { 2023-08-01T19:55:08.245 INFO:teuthology.orchestra.run.smithi008.stdout: "flag_point": "commit sent; apply or cleanup", 2023-08-01T19:55:08.245 INFO:teuthology.orchestra.run.smithi008.stdout: "client_info": { 2023-08-01T19:55:08.245 INFO:teuthology.orchestra.run.smithi008.stdout: "client": "client.4668", 2023-08-01T19:55:08.245 INFO:teuthology.orchestra.run.smithi008.stdout: "client_addr": "172.21.15.6:0/1709472247", 2023-08-01T19:55:08.245 INFO:teuthology.orchestra.run.smithi008.stdout: "tid": 100243 2023-08-01T19:55:08.245 INFO:teuthology.orchestra.run.smithi008.stdout: }, 2023-08-01T19:55:08.245 INFO:teuthology.orchestra.run.smithi008.stdout: "events": [ 2023-08-01T19:55:08.246 INFO:teuthology.orchestra.run.smithi008.stdout: { 2023-08-01T19:55:08.246 INFO:teuthology.orchestra.run.smithi008.stdout: "event": "initiated", 2023-08-01T19:55:08.246 INFO:teuthology.orchestra.run.smithi008.stdout: "time": "2023-08-01T19:55:05.150737+0000", 2023-08-01T19:55:08.246 INFO:teuthology.orchestra.run.smithi008.stdout: "duration": 0 2023-08-01T19:55:08.246 INFO:teuthology.orchestra.run.smithi008.stdout: }, 2023-08-01T19:55:08.246 INFO:teuthology.orchestra.run.smithi008.stdout: { 2023-08-01T19:55:08.246 INFO:teuthology.orchestra.run.smithi008.stdout: "event": "throttled", 2023-08-01T19:55:08.246 INFO:teuthology.orchestra.run.smithi008.stdout: "time": "2023-08-01T19:55:05.150737+0000", 2023-08-01T19:55:08.247 INFO:teuthology.orchestra.run.smithi008.stdout: "duration": 0 2023-08-01T19:55:08.247 INFO:teuthology.orchestra.run.smithi008.stdout: }, 2023-08-01T19:55:08.247 INFO:teuthology.orchestra.run.smithi008.stdout: { 2023-08-01T19:55:08.247 INFO:teuthology.orchestra.run.smithi008.stdout: "event": "header_read", 2023-08-01T19:55:08.247 INFO:teuthology.orchestra.run.smithi008.stdout: "time": "2023-08-01T19:55:05.150736+0000", 2023-08-01T19:55:08.247 INFO:teuthology.orchestra.run.smithi008.stdout: "duration": 4294967295.999999 2023-08-01T19:55:08.247 INFO:teuthology.orchestra.run.smithi008.stdout: }, 2023-08-01T19:55:08.247 INFO:teuthology.orchestra.run.smithi008.stdout: { 2023-08-01T19:55:08.248 INFO:teuthology.orchestra.run.smithi008.stdout: "event": "all_read", 2023-08-01T19:55:08.248 INFO:teuthology.orchestra.run.smithi008.stdout: "time": "2023-08-01T19:55:05.150780+0000", 2023-08-01T19:55:08.248 INFO:teuthology.orchestra.run.smithi008.stdout: "duration": 4.3578999999999997e-05 2023-08-01T19:55:08.248 INFO:teuthology.orchestra.run.smithi008.stdout: }, 2023-08-01T19:55:08.248 INFO:teuthology.orchestra.run.smithi008.stdout: { 2023-08-01T19:55:08.248 INFO:teuthology.orchestra.run.smithi008.stdout: "event": "dispatched", 2023-08-01T19:55:08.249 INFO:teuthology.orchestra.run.smithi008.stdout: "time": "2023-08-01T19:55:05.150791+0000", 2023-08-01T19:55:08.249 INFO:teuthology.orchestra.run.smithi008.stdout: "duration": 1.0963e-05 2023-08-01T19:55:08.249 INFO:teuthology.orchestra.run.smithi008.stdout: }, 2023-08-01T19:55:08.249 INFO:teuthology.orchestra.run.smithi008.stdout: { 2023-08-01T19:55:08.249 INFO:teuthology.orchestra.run.smithi008.stdout: "event": "queued_for_pg", 2023-08-01T19:55:08.249 INFO:teuthology.orchestra.run.smithi008.stdout: "time": "2023-08-01T19:55:05.150797+0000", 2023-08-01T19:55:08.249 INFO:teuthology.orchestra.run.smithi008.stdout: "duration": 5.9780000000000002e-06 2023-08-01T19:55:08.249 INFO:teuthology.orchestra.run.smithi008.stdout: }, 2023-08-01T19:55:08.250 INFO:teuthology.orchestra.run.smithi008.stdout: { 2023-08-01T19:55:08.250 INFO:teuthology.orchestra.run.smithi008.stdout: "event": "reached_pg", 2023-08-01T19:55:08.250 INFO:teuthology.orchestra.run.smithi008.stdout: "time": "2023-08-01T19:55:05.150833+0000", 2023-08-01T19:55:08.250 INFO:teuthology.orchestra.run.smithi008.stdout: "duration": 3.6000000000000001e-05 2023-08-01T19:55:08.250 INFO:teuthology.orchestra.run.smithi008.stdout: }, 2023-08-01T19:55:08.250 INFO:teuthology.orchestra.run.smithi008.stdout: { 2023-08-01T19:55:08.250 INFO:teuthology.orchestra.run.smithi008.stdout: "event": "started", 2023-08-01T19:55:08.250 INFO:teuthology.orchestra.run.smithi008.stdout: "time": "2023-08-01T19:55:05.150951+0000", 2023-08-01T19:55:08.251 INFO:teuthology.orchestra.run.smithi008.stdout: "duration": 0.00011827799999999999 2023-08-01T19:55:08.251 INFO:teuthology.orchestra.run.smithi008.stdout: }, 2023-08-01T19:55:08.251 INFO:teuthology.orchestra.run.smithi008.stdout: { 2023-08-01T19:55:08.251 INFO:teuthology.orchestra.run.smithi008.stdout: "event": "waiting for subops from 2", 2023-08-01T19:55:08.251 INFO:teuthology.orchestra.run.smithi008.stdout: "time": "2023-08-01T19:55:05.151111+0000", 2023-08-01T19:55:08.251 INFO:teuthology.orchestra.run.smithi008.stdout: "duration": 0.00015961299999999999 2023-08-01T19:55:08.251 INFO:teuthology.orchestra.run.smithi008.stdout: }, 2023-08-01T19:55:08.251 INFO:teuthology.orchestra.run.smithi008.stdout: { 2023-08-01T19:55:08.252 INFO:teuthology.orchestra.run.smithi008.stdout: "event": "op_commit", 2023-08-01T19:55:08.252 INFO:teuthology.orchestra.run.smithi008.stdout: "time": "2023-08-01T19:55:05.156247+0000", 2023-08-01T19:55:08.252 INFO:teuthology.orchestra.run.smithi008.stdout: "duration": 0.005136524 2023-08-01T19:55:08.252 INFO:teuthology.orchestra.run.smithi008.stdout: }, 2023-08-01T19:55:08.252 INFO:teuthology.orchestra.run.smithi008.stdout: { 2023-08-01T19:55:08.252 INFO:teuthology.orchestra.run.smithi008.stdout: "event": "sub_op_commit_rec", 2023-08-01T19:55:08.252 INFO:teuthology.orchestra.run.smithi008.stdout: "time": "2023-08-01T19:55:05.225705+0000", 2023-08-01T19:55:08.253 INFO:teuthology.orchestra.run.smithi008.stdout: "duration": 0.069458377000000002 2023-08-01T19:55:08.253 INFO:teuthology.orchestra.run.smithi008.stdout: }, 2023-08-01T19:55:08.253 INFO:teuthology.orchestra.run.smithi008.stdout: { 2023-08-01T19:55:08.253 INFO:teuthology.orchestra.run.smithi008.stdout: "event": "commit_sent", 2023-08-01T19:55:08.253 INFO:teuthology.orchestra.run.smithi008.stdout: "time": "2023-08-01T19:55:05.225736+0000", 2023-08-01T19:55:08.253 INFO:teuthology.orchestra.run.smithi008.stdout: "duration": 3.0388000000000001e-05 2023-08-01T19:55:08.253 INFO:teuthology.orchestra.run.smithi008.stdout: }, 2023-08-01T19:55:08.253 INFO:teuthology.orchestra.run.smithi008.stdout: { 2023-08-01T19:55:08.254 INFO:teuthology.orchestra.run.smithi008.stdout: "event": "done", 2023-08-01T19:55:08.254 INFO:teuthology.orchestra.run.smithi008.stdout: "time": "2023-08-01T19:55:05.225757+0000", 2023-08-01T19:55:08.254 INFO:teuthology.orchestra.run.smithi008.stdout: "duration": 2.1090999999999998e-05 2023-08-01T19:55:08.254 INFO:teuthology.orchestra.run.smithi008.stdout: } 2023-08-01T19:55:08.254 INFO:teuthology.orchestra.run.smithi008.stdout: ] 2023-08-01T19:55:08.254 INFO:teuthology.orchestra.run.smithi008.stdout: } 2023-08-01T19:55:08.254 INFO:teuthology.orchestra.run.smithi008.stdout: }, 2023-08-01T19:55:08.254 INFO:teuthology.orchestra.run.smithi008.stdout: { 2023-08-01T19:55:08.255 INFO:teuthology.orchestra.run.smithi008.stdout: "description": "osd_op(client.4668.0:100261 5.a 5:562deedb:::benchmark_data_smithi006_114134_object100260:head [set-alloc-hint object_size 65536 write_size 65536,write 0~65536] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e37)", 2023-08-01T19:55:08.255 INFO:teuthology.orchestra.run.smithi008.stdout: "initiated_at": "2023-08-01T19:55:05.163316+0000", 2023-08-01T19:55:08.255 INFO:teuthology.orchestra.run.smithi008.stdout: "age": 2.9928984669999998, 2023-08-01T19:55:08.255 INFO:teuthology.orchestra.run.smithi008.stdout: "duration": 0.063073012999999997, 2023-08-01T19:55:08.255 INFO:teuthology.orchestra.run.smithi008.stdout: "type_data": { 2023-08-01T19:55:08.255 INFO:teuthology.orchestra.run.smithi008.stdout: "flag_point": "commit sent; apply or cleanup", 2023-08-01T19:55:08.255 INFO:teuthology.orchestra.run.smithi008.stdout: "client_info": { 2023-08-01T19:55:08.255 INFO:teuthology.orchestra.run.smithi008.stdout: "client": "client.4668", 2023-08-01T19:55:08.256 INFO:teuthology.orchestra.run.smithi008.stdout: "client_addr": "172.21.15.6:0/1709472247", 2023-08-01T19:55:08.256 INFO:teuthology.orchestra.run.smithi008.stdout: "tid": 100261 2023-08-01T19:55:08.256 INFO:teuthology.orchestra.run.smithi008.stdout: }, 2023-08-01T19:55:08.256 INFO:teuthology.orchestra.run.smithi008.stdout: "events": [ 2023-08-01T19:55:08.256 INFO:teuthology.orchestra.run.smithi008.stdout: { 2023-08-01T19:55:08.256 INFO:teuthology.orchestra.run.smithi008.stdout: "event": "initiated", 2023-08-01T19:55:08.256 INFO:teuthology.orchestra.run.smithi008.stdout: "time": "2023-08-01T19:55:05.163316+0000", 2023-08-01T19:55:08.257 INFO:teuthology.orchestra.run.smithi008.stdout: "duration": 0 2023-08-01T19:55:08.257 INFO:teuthology.orchestra.run.smithi008.stdout: }, 2023-08-01T19:55:08.257 INFO:teuthology.orchestra.run.smithi008.stdout: { 2023-08-01T19:55:08.257 INFO:teuthology.orchestra.run.smithi008.stdout: "event": "throttled", 2023-08-01T19:55:08.257 INFO:teuthology.orchestra.run.smithi008.stdout: "time": "2023-08-01T19:55:05.163316+0000", 2023-08-01T19:55:08.257 INFO:teuthology.orchestra.run.smithi008.stdout: "duration": 0 2023-08-01T19:55:08.257 INFO:teuthology.orchestra.run.smithi008.stdout: }, 2023-08-01T19:55:08.257 INFO:teuthology.orchestra.run.smithi008.stdout: { 2023-08-01T19:55:08.258 INFO:teuthology.orchestra.run.smithi008.stdout: "event": "header_read", 2023-08-01T19:55:08.258 INFO:teuthology.orchestra.run.smithi008.stdout: "time": "2023-08-01T19:55:05.163316+0000", 2023-08-01T19:55:08.258 INFO:teuthology.orchestra.run.smithi008.stdout: "duration": 4294967295.999999 2023-08-01T19:55:08.258 INFO:teuthology.orchestra.run.smithi008.stdout: }, 2023-08-01T19:55:08.258 INFO:teuthology.orchestra.run.smithi008.stdout: { 2023-08-01T19:55:08.258 INFO:teuthology.orchestra.run.smithi008.stdout: "event": "all_read", 2023-08-01T19:55:08.258 INFO:teuthology.orchestra.run.smithi008.stdout: "time": "2023-08-01T19:55:05.163380+0000", 2023-08-01T19:55:08.258 INFO:teuthology.orchestra.run.smithi008.stdout: "duration": 6.4395999999999998e-05 2023-08-01T19:55:08.259 INFO:teuthology.orchestra.run.smithi008.stdout: }, 2023-08-01T19:55:08.259 INFO:teuthology.orchestra.run.smithi008.stdout: { 2023-08-01T19:55:08.259 INFO:teuthology.orchestra.run.smithi008.stdout: "event": "dispatched", 2023-08-01T19:55:08.259 INFO:teuthology.orchestra.run.smithi008.stdout: "time": "2023-08-01T19:55:05.163390+0000", 2023-08-01T19:55:08.259 INFO:teuthology.orchestra.run.smithi008.stdout: "duration": 1.0189e-05 2023-08-01T19:55:08.259 INFO:teuthology.orchestra.run.smithi008.stdout: }, 2023-08-01T19:55:08.259 INFO:teuthology.orchestra.run.smithi008.stdout: { 2023-08-01T19:55:08.259 INFO:teuthology.orchestra.run.smithi008.stdout: "event": "queued_for_pg", 2023-08-01T19:55:08.260 INFO:teuthology.orchestra.run.smithi008.stdout: "time": "2023-08-01T19:55:05.163395+0000", 2023-08-01T19:55:08.260 INFO:teuthology.orchestra.run.smithi008.stdout: "duration": 4.4059999999999998e-06 2023-08-01T19:55:08.260 INFO:teuthology.orchestra.run.smithi008.stdout: }, 2023-08-01T19:55:08.260 INFO:teuthology.orchestra.run.smithi008.stdout: { 2023-08-01T19:55:08.260 INFO:teuthology.orchestra.run.smithi008.stdout: "event": "reached_pg", 2023-08-01T19:55:08.261 INFO:teuthology.orchestra.run.smithi008.stdout: "time": "2023-08-01T19:55:05.163429+0000", 2023-08-01T19:55:08.261 INFO:teuthology.orchestra.run.smithi008.stdout: "duration": 3.4900000000000001e-05 2023-08-01T19:55:08.261 INFO:teuthology.orchestra.run.smithi008.stdout: }, 2023-08-01T19:55:08.261 INFO:teuthology.orchestra.run.smithi008.stdout: { 2023-08-01T19:55:08.261 INFO:teuthology.orchestra.run.smithi008.stdout: "event": "started", 2023-08-01T19:55:08.261 INFO:teuthology.orchestra.run.smithi008.stdout: "time": "2023-08-01T19:55:05.163512+0000", 2023-08-01T19:55:08.262 INFO:teuthology.orchestra.run.smithi008.stdout: "duration": 8.2987999999999999e-05 2023-08-01T19:55:08.262 INFO:teuthology.orchestra.run.smithi008.stdout: }, 2023-08-01T19:55:08.262 INFO:teuthology.orchestra.run.smithi008.stdout: { 2023-08-01T19:55:08.262 INFO:teuthology.orchestra.run.smithi008.stdout: "event": "waiting for subops from 2", 2023-08-01T19:55:08.262 INFO:teuthology.orchestra.run.smithi008.stdout: "time": "2023-08-01T19:55:05.163596+0000", 2023-08-01T19:55:08.262 INFO:teuthology.orchestra.run.smithi008.stdout: "duration": 8.3783999999999996e-05 2023-08-01T19:55:08.263 INFO:teuthology.orchestra.run.smithi008.stdout: }, 2023-08-01T19:55:08.263 INFO:teuthology.orchestra.run.smithi008.stdout: { 2023-08-01T19:55:08.263 INFO:teuthology.orchestra.run.smithi008.stdout: "event": "op_commit", 2023-08-01T19:55:08.263 INFO:teuthology.orchestra.run.smithi008.stdout: "time": "2023-08-01T19:55:05.167129+0000", 2023-08-01T19:55:08.264 INFO:teuthology.orchestra.run.smithi008.stdout: "duration": 0.0035328709999999999 2023-08-01T19:55:08.264 INFO:teuthology.orchestra.run.smithi008.stdout: }, 2023-08-01T19:55:08.264 INFO:teuthology.orchestra.run.smithi008.stdout: { 2023-08-01T19:55:08.264 INFO:teuthology.orchestra.run.smithi008.stdout: "event": "sub_op_commit_rec", 2023-08-01T19:55:08.265 INFO:teuthology.orchestra.run.smithi008.stdout: "time": "2023-08-01T19:55:05.226302+0000", 2023-08-01T19:55:08.265 INFO:teuthology.orchestra.run.smithi008.stdout: "duration": 0.059172711000000003 2023-08-01T19:55:08.265 INFO:teuthology.orchestra.run.smithi008.stdout: }, 2023-08-01T19:55:08.265 INFO:teuthology.orchestra.run.smithi008.stdout: { 2023-08-01T19:55:08.265 INFO:teuthology.orchestra.run.smithi008.stdout: "event": "commit_sent", 2023-08-01T19:55:08.266 INFO:teuthology.orchestra.run.smithi008.stdout: "time": "2023-08-01T19:55:05.226351+0000", 2023-08-01T19:55:08.266 INFO:teuthology.orchestra.run.smithi008.stdout: "duration": 4.969e-05 2023-08-01T19:55:08.266 INFO:teuthology.orchestra.run.smithi008.stdout: }, 2023-08-01T19:55:08.266 INFO:teuthology.orchestra.run.smithi008.stdout: { 2023-08-01T19:55:08.267 INFO:teuthology.orchestra.run.smithi008.stdout: "event": "done", 2023-08-01T19:55:08.267 INFO:teuthology.orchestra.run.smithi008.stdout: "time": "2023-08-01T19:55:05.226389+0000", 2023-08-01T19:55:08.267 INFO:teuthology.orchestra.run.smithi008.stdout: "duration": 3.7978000000000001e-05 2023-08-01T19:55:08.267 INFO:teuthology.orchestra.run.smithi008.stdout: } 2023-08-01T19:55:08.267 INFO:teuthology.orchestra.run.smithi008.stdout: ] 2023-08-01T19:55:08.267 INFO:teuthology.orchestra.run.smithi008.stdout: } 2023-08-01T19:55:08.267 INFO:teuthology.orchestra.run.smithi008.stdout: }, 2023-08-01T19:55:08.268 INFO:teuthology.orchestra.run.smithi008.stdout: { 2023-08-01T19:55:08.268 INFO:teuthology.orchestra.run.smithi008.stdout: "description": "osd_op(client.4668.0:100262 5.a 5:5c636b5d:::benchmark_data_smithi006_114134_object100261:head [set-alloc-hint object_size 65536 write_size 65536,write 0~65536] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e37)", 2023-08-01T19:55:08.268 INFO:teuthology.orchestra.run.smithi008.stdout: "initiated_at": "2023-08-01T19:55:05.165068+0000", 2023-08-01T19:55:08.268 INFO:teuthology.orchestra.run.smithi008.stdout: "age": 2.9911468139999999, 2023-08-01T19:55:08.268 INFO:teuthology.orchestra.run.smithi008.stdout: "duration": 0.063919403, 2023-08-01T19:55:08.268 INFO:teuthology.orchestra.run.smithi008.stdout: "type_data": { 2023-08-01T19:55:08.268 INFO:teuthology.orchestra.run.smithi008.stdout: "flag_point": "commit sent; apply or cleanup", 2023-08-01T19:55:08.269 INFO:teuthology.orchestra.run.smithi008.stdout: "client_info": { 2023-08-01T19:55:08.269 INFO:teuthology.orchestra.run.smithi008.stdout: "client": "client.4668", 2023-08-01T19:55:08.269 INFO:teuthology.orchestra.run.smithi008.stdout: "client_addr": "172.21.15.6:0/1709472247", 2023-08-01T19:55:08.269 INFO:teuthology.orchestra.run.smithi008.stdout: "tid": 100262 2023-08-01T19:55:08.269 INFO:teuthology.orchestra.run.smithi008.stdout: }, 2023-08-01T19:55:08.269 INFO:teuthology.orchestra.run.smithi008.stdout: "events": [ 2023-08-01T19:55:08.269 INFO:teuthology.orchestra.run.smithi008.stdout: { 2023-08-01T19:55:08.269 INFO:teuthology.orchestra.run.smithi008.stdout: "event": "initiated", 2023-08-01T19:55:08.270 INFO:teuthology.orchestra.run.smithi008.stdout: "time": "2023-08-01T19:55:05.165068+0000", 2023-08-01T19:55:08.270 INFO:teuthology.orchestra.run.smithi008.stdout: "duration": 0 2023-08-01T19:55:08.270 INFO:teuthology.orchestra.run.smithi008.stdout: }, 2023-08-01T19:55:08.270 INFO:teuthology.orchestra.run.smithi008.stdout: { 2023-08-01T19:55:08.270 INFO:teuthology.orchestra.run.smithi008.stdout: "event": "throttled", 2023-08-01T19:55:08.270 INFO:teuthology.orchestra.run.smithi008.stdout: "time": "2023-08-01T19:55:05.165068+0000", 2023-08-01T19:55:08.270 INFO:teuthology.orchestra.run.smithi008.stdout: "duration": 0 2023-08-01T19:55:08.270 INFO:teuthology.orchestra.run.smithi008.stdout: }, 2023-08-01T19:55:08.271 INFO:teuthology.orchestra.run.smithi008.stdout: { 2023-08-01T19:55:08.271 INFO:teuthology.orchestra.run.smithi008.stdout: "event": "header_read", 2023-08-01T19:55:08.271 INFO:teuthology.orchestra.run.smithi008.stdout: "time": "2023-08-01T19:55:05.165067+0000", 2023-08-01T19:55:08.271 INFO:teuthology.orchestra.run.smithi008.stdout: "duration": 4294967295.999999 2023-08-01T19:55:08.271 INFO:teuthology.orchestra.run.smithi008.stdout: }, 2023-08-01T19:55:08.271 INFO:teuthology.orchestra.run.smithi008.stdout: { 2023-08-01T19:55:08.271 INFO:teuthology.orchestra.run.smithi008.stdout: "event": "all_read", 2023-08-01T19:55:08.271 INFO:teuthology.orchestra.run.smithi008.stdout: "time": "2023-08-01T19:55:05.165126+0000", 2023-08-01T19:55:08.272 INFO:teuthology.orchestra.run.smithi008.stdout: "duration": 5.9116000000000001e-05 2023-08-01T19:55:08.272 INFO:teuthology.orchestra.run.smithi008.stdout: }, 2023-08-01T19:55:08.272 INFO:teuthology.orchestra.run.smithi008.stdout: { 2023-08-01T19:55:08.272 INFO:teuthology.orchestra.run.smithi008.stdout: "event": "dispatched", 2023-08-01T19:55:08.272 INFO:teuthology.orchestra.run.smithi008.stdout: "time": "2023-08-01T19:55:05.165134+0000", 2023-08-01T19:55:08.272 INFO:teuthology.orchestra.run.smithi008.stdout: "duration": 7.9820000000000008e-06 2023-08-01T19:55:08.272 INFO:teuthology.orchestra.run.smithi008.stdout: }, 2023-08-01T19:55:08.273 INFO:teuthology.orchestra.run.smithi008.stdout: { 2023-08-01T19:55:08.273 INFO:teuthology.orchestra.run.smithi008.stdout: "event": "queued_for_pg", 2023-08-01T19:55:08.273 INFO:teuthology.orchestra.run.smithi008.stdout: "time": "2023-08-01T19:55:05.165139+0000", 2023-08-01T19:55:08.273 INFO:teuthology.orchestra.run.smithi008.stdout: "duration": 4.2560000000000004e-06 2023-08-01T19:55:08.273 INFO:teuthology.orchestra.run.smithi008.stdout: }, 2023-08-01T19:55:08.273 INFO:teuthology.orchestra.run.smithi008.stdout: { 2023-08-01T19:55:08.273 INFO:teuthology.orchestra.run.smithi008.stdout: "event": "reached_pg", 2023-08-01T19:55:08.274 INFO:teuthology.orchestra.run.smithi008.stdout: "time": "2023-08-01T19:55:05.165165+0000", 2023-08-01T19:55:08.274 INFO:teuthology.orchestra.run.smithi008.stdout: "duration": 2.6554e-05 2023-08-01T19:55:08.274 INFO:teuthology.orchestra.run.smithi008.stdout: }, 2023-08-01T19:55:08.274 INFO:teuthology.orchestra.run.smithi008.stdout: { 2023-08-01T19:55:08.274 INFO:teuthology.orchestra.run.smithi008.stdout: "event": "started", 2023-08-01T19:55:08.274 INFO:teuthology.orchestra.run.smithi008.stdout: "time": "2023-08-01T19:55:05.165243+0000", 2023-08-01T19:55:08.274 INFO:teuthology.orchestra.run.smithi008.stdout: "duration": 7.7877e-05 2023-08-01T19:55:08.274 INFO:teuthology.orchestra.run.smithi008.stdout: }, 2023-08-01T19:55:08.275 INFO:teuthology.orchestra.run.smithi008.stdout: { 2023-08-01T19:55:08.275 INFO:teuthology.orchestra.run.smithi008.stdout: "event": "waiting for subops from 2", 2023-08-01T19:55:08.275 INFO:teuthology.orchestra.run.smithi008.stdout: "time": "2023-08-01T19:55:05.165450+0000", 2023-08-01T19:55:08.275 INFO:teuthology.orchestra.run.smithi008.stdout: "duration": 0.00020655599999999999 2023-08-01T19:55:08.275 INFO:teuthology.orchestra.run.smithi008.stdout: }, 2023-08-01T19:55:08.275 INFO:teuthology.orchestra.run.smithi008.stdout: { 2023-08-01T19:55:08.275 INFO:teuthology.orchestra.run.smithi008.stdout: "event": "op_commit", 2023-08-01T19:55:08.275 INFO:teuthology.orchestra.run.smithi008.stdout: "time": "2023-08-01T19:55:05.168883+0000", 2023-08-01T19:55:08.276 INFO:teuthology.orchestra.run.smithi008.stdout: "duration": 0.0034333279999999998 2023-08-01T19:55:08.276 INFO:teuthology.orchestra.run.smithi008.stdout: }, 2023-08-01T19:55:08.276 INFO:teuthology.orchestra.run.smithi008.stdout: { 2023-08-01T19:55:08.276 INFO:teuthology.orchestra.run.smithi008.stdout: "event": "sub_op_commit_rec", 2023-08-01T19:55:08.276 INFO:teuthology.orchestra.run.smithi008.stdout: "time": "2023-08-01T19:55:05.228904+0000", 2023-08-01T19:55:08.276 INFO:teuthology.orchestra.run.smithi008.stdout: "duration": 0.060021370999999997 2023-08-01T19:55:08.276 INFO:teuthology.orchestra.run.smithi008.stdout: }, 2023-08-01T19:55:08.277 INFO:teuthology.orchestra.run.smithi008.stdout: { 2023-08-01T19:55:08.277 INFO:teuthology.orchestra.run.smithi008.stdout: "event": "commit_sent", 2023-08-01T19:55:08.277 INFO:teuthology.orchestra.run.smithi008.stdout: "time": "2023-08-01T19:55:05.228952+0000", 2023-08-01T19:55:08.277 INFO:teuthology.orchestra.run.smithi008.stdout: "duration": 4.8056999999999997e-05 2023-08-01T19:55:08.277 INFO:teuthology.orchestra.run.smithi008.stdout: }, 2023-08-01T19:55:08.277 INFO:teuthology.orchestra.run.smithi008.stdout: { 2023-08-01T19:55:08.277 INFO:teuthology.orchestra.run.smithi008.stdout: "event": "done", 2023-08-01T19:55:08.277 INFO:teuthology.orchestra.run.smithi008.stdout: "time": "2023-08-01T19:55:05.228987+0000", 2023-08-01T19:55:08.278 INFO:teuthology.orchestra.run.smithi008.stdout: "duration": 3.5083000000000003e-05 2023-08-01T19:55:08.278 INFO:teuthology.orchestra.run.smithi008.stdout: } 2023-08-01T19:55:08.278 INFO:teuthology.orchestra.run.smithi008.stdout: ] 2023-08-01T19:55:08.278 INFO:teuthology.orchestra.run.smithi008.stdout: } 2023-08-01T19:55:08.278 INFO:teuthology.orchestra.run.smithi008.stdout: }, 2023-08-01T19:55:08.278 INFO:teuthology.orchestra.run.smithi008.stdout: { 2023-08-01T19:55:08.278 INFO:teuthology.orchestra.run.smithi008.stdout: "description": "osd_op(client.4668.0:100929 5.3 5:c29f4adb:::benchmark_data_smithi006_114134_object100928:head [set-alloc-hint object_size 65536 write_size 65536,write 0~65536] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e37)", 2023-08-01T19:55:08.278 INFO:teuthology.orchestra.run.smithi008.stdout: "initiated_at": "2023-08-01T19:55:05.564759+0000", 2023-08-01T19:55:08.279 INFO:teuthology.orchestra.run.smithi008.stdout: "age": 2.5914561750000003, 2023-08-01T19:55:08.279 INFO:teuthology.orchestra.run.smithi008.stdout: "duration": 0.062544635000000001, 2023-08-01T19:55:08.279 INFO:teuthology.orchestra.run.smithi008.stdout: "type_data": { 2023-08-01T19:55:08.279 INFO:teuthology.orchestra.run.smithi008.stdout: "flag_point": "commit sent; apply or cleanup", 2023-08-01T19:55:08.279 INFO:teuthology.orchestra.run.smithi008.stdout: "client_info": { 2023-08-01T19:55:08.279 INFO:teuthology.orchestra.run.smithi008.stdout: "client": "client.4668", 2023-08-01T19:55:08.279 INFO:teuthology.orchestra.run.smithi008.stdout: "client_addr": "172.21.15.6:0/1709472247", 2023-08-01T19:55:08.280 INFO:teuthology.orchestra.run.smithi008.stdout: "tid": 100929 2023-08-01T19:55:08.280 INFO:teuthology.orchestra.run.smithi008.stdout: }, 2023-08-01T19:55:08.280 INFO:teuthology.orchestra.run.smithi008.stdout: "events": [ 2023-08-01T19:55:08.280 INFO:teuthology.orchestra.run.smithi008.stdout: { 2023-08-01T19:55:08.280 INFO:teuthology.orchestra.run.smithi008.stdout: "event": "initiated", 2023-08-01T19:55:08.280 INFO:teuthology.orchestra.run.smithi008.stdout: "time": "2023-08-01T19:55:05.564759+0000", 2023-08-01T19:55:08.280 INFO:teuthology.orchestra.run.smithi008.stdout: "duration": 0 2023-08-01T19:55:08.280 INFO:teuthology.orchestra.run.smithi008.stdout: }, 2023-08-01T19:55:08.281 INFO:teuthology.orchestra.run.smithi008.stdout: { 2023-08-01T19:55:08.281 INFO:teuthology.orchestra.run.smithi008.stdout: "event": "throttled", 2023-08-01T19:55:08.281 INFO:teuthology.orchestra.run.smithi008.stdout: "time": "2023-08-01T19:55:05.564759+0000", 2023-08-01T19:55:08.281 INFO:teuthology.orchestra.run.smithi008.stdout: "duration": 0 2023-08-01T19:55:08.281 INFO:teuthology.orchestra.run.smithi008.stdout: }, 2023-08-01T19:55:08.281 INFO:teuthology.orchestra.run.smithi008.stdout: { 2023-08-01T19:55:08.281 INFO:teuthology.orchestra.run.smithi008.stdout: "event": "header_read", 2023-08-01T19:55:08.281 INFO:teuthology.orchestra.run.smithi008.stdout: "time": "2023-08-01T19:55:05.564758+0000", 2023-08-01T19:55:08.282 INFO:teuthology.orchestra.run.smithi008.stdout: "duration": 4294967295.999999 2023-08-01T19:55:08.282 INFO:teuthology.orchestra.run.smithi008.stdout: }, 2023-08-01T19:55:08.282 INFO:teuthology.orchestra.run.smithi008.stdout: { 2023-08-01T19:55:08.282 INFO:teuthology.orchestra.run.smithi008.stdout: "event": "all_read", 2023-08-01T19:55:08.282 INFO:teuthology.orchestra.run.smithi008.stdout: "time": "2023-08-01T19:55:05.564815+0000", 2023-08-01T19:55:08.282 INFO:teuthology.orchestra.run.smithi008.stdout: "duration": 5.7757000000000003e-05 2023-08-01T19:55:08.282 INFO:teuthology.orchestra.run.smithi008.stdout: }, 2023-08-01T19:55:08.282 INFO:teuthology.orchestra.run.smithi008.stdout: { 2023-08-01T19:55:08.283 INFO:teuthology.orchestra.run.smithi008.stdout: "event": "dispatched", 2023-08-01T19:55:08.283 INFO:teuthology.orchestra.run.smithi008.stdout: "time": "2023-08-01T19:55:05.564824+0000", 2023-08-01T19:55:08.283 INFO:teuthology.orchestra.run.smithi008.stdout: "duration": 8.6559999999999998e-06 2023-08-01T19:55:08.283 INFO:teuthology.orchestra.run.smithi008.stdout: }, 2023-08-01T19:55:08.283 INFO:teuthology.orchestra.run.smithi008.stdout: { 2023-08-01T19:55:08.283 INFO:teuthology.orchestra.run.smithi008.stdout: "event": "queued_for_pg", 2023-08-01T19:55:08.283 INFO:teuthology.orchestra.run.smithi008.stdout: "time": "2023-08-01T19:55:05.564829+0000", 2023-08-01T19:55:08.283 INFO:teuthology.orchestra.run.smithi008.stdout: "duration": 4.6160000000000004e-06 2023-08-01T19:55:08.284 INFO:teuthology.orchestra.run.smithi008.stdout: }, 2023-08-01T19:55:08.284 INFO:teuthology.orchestra.run.smithi008.stdout: { 2023-08-01T19:55:08.284 INFO:teuthology.orchestra.run.smithi008.stdout: "event": "reached_pg", 2023-08-01T19:55:08.284 INFO:teuthology.orchestra.run.smithi008.stdout: "time": "2023-08-01T19:55:05.564871+0000", 2023-08-01T19:55:08.284 INFO:teuthology.orchestra.run.smithi008.stdout: "duration": 4.2206000000000002e-05 2023-08-01T19:55:08.284 INFO:teuthology.orchestra.run.smithi008.stdout: }, 2023-08-01T19:55:08.285 INFO:teuthology.orchestra.run.smithi008.stdout: { 2023-08-01T19:55:08.285 INFO:teuthology.orchestra.run.smithi008.stdout: "event": "started", 2023-08-01T19:55:08.285 INFO:teuthology.orchestra.run.smithi008.stdout: "time": "2023-08-01T19:55:05.565011+0000", 2023-08-01T19:55:08.285 INFO:teuthology.orchestra.run.smithi008.stdout: "duration": 0.000140469 2023-08-01T19:55:08.285 INFO:teuthology.orchestra.run.smithi008.stdout: }, 2023-08-01T19:55:08.285 INFO:teuthology.orchestra.run.smithi008.stdout: { 2023-08-01T19:55:08.285 INFO:teuthology.orchestra.run.smithi008.stdout: "event": "waiting for subops from 1", 2023-08-01T19:55:08.285 INFO:teuthology.orchestra.run.smithi008.stdout: "time": "2023-08-01T19:55:05.565212+0000", 2023-08-01T19:55:08.286 INFO:teuthology.orchestra.run.smithi008.stdout: "duration": 0.00020106599999999999 2023-08-01T19:55:08.286 INFO:teuthology.orchestra.run.smithi008.stdout: }, 2023-08-01T19:55:08.286 INFO:teuthology.orchestra.run.smithi008.stdout: { 2023-08-01T19:55:08.286 INFO:teuthology.orchestra.run.smithi008.stdout: "event": "sub_op_commit_rec", 2023-08-01T19:55:08.286 INFO:teuthology.orchestra.run.smithi008.stdout: "time": "2023-08-01T19:55:05.626925+0000", 2023-08-01T19:55:08.286 INFO:teuthology.orchestra.run.smithi008.stdout: "duration": 0.061712111 2023-08-01T19:55:08.286 INFO:teuthology.orchestra.run.smithi008.stdout: }, 2023-08-01T19:55:08.287 INFO:teuthology.orchestra.run.smithi008.stdout: { 2023-08-01T19:55:08.287 INFO:teuthology.orchestra.run.smithi008.stdout: "event": "op_commit", 2023-08-01T19:55:08.287 INFO:teuthology.orchestra.run.smithi008.stdout: "time": "2023-08-01T19:55:05.627217+0000", 2023-08-01T19:55:08.287 INFO:teuthology.orchestra.run.smithi008.stdout: "duration": 0.00029265999999999998 2023-08-01T19:55:08.287 INFO:teuthology.orchestra.run.smithi008.stdout: }, 2023-08-01T19:55:08.287 INFO:teuthology.orchestra.run.smithi008.stdout: { 2023-08-01T19:55:08.287 INFO:teuthology.orchestra.run.smithi008.stdout: "event": "commit_sent", 2023-08-01T19:55:08.287 INFO:teuthology.orchestra.run.smithi008.stdout: "time": "2023-08-01T19:55:05.627264+0000", 2023-08-01T19:55:08.288 INFO:teuthology.orchestra.run.smithi008.stdout: "duration": 4.6260000000000001e-05 2023-08-01T19:55:08.288 INFO:teuthology.orchestra.run.smithi008.stdout: }, 2023-08-01T19:55:08.288 INFO:teuthology.orchestra.run.smithi008.stdout: { 2023-08-01T19:55:08.288 INFO:teuthology.orchestra.run.smithi008.stdout: "event": "done", 2023-08-01T19:55:08.288 INFO:teuthology.orchestra.run.smithi008.stdout: "time": "2023-08-01T19:55:05.627303+0000", 2023-08-01T19:55:08.288 INFO:teuthology.orchestra.run.smithi008.stdout: "duration": 3.9839999999999998e-05 2023-08-01T19:55:08.288 INFO:teuthology.orchestra.run.smithi008.stdout: } 2023-08-01T19:55:08.288 INFO:teuthology.orchestra.run.smithi008.stdout: ] 2023-08-01T19:55:08.289 INFO:teuthology.orchestra.run.smithi008.stdout: } 2023-08-01T19:55:08.289 INFO:teuthology.orchestra.run.smithi008.stdout: }, 2023-08-01T19:55:08.289 INFO:teuthology.orchestra.run.smithi008.stdout: { 2023-08-01T19:55:08.289 INFO:teuthology.orchestra.run.smithi008.stdout: "description": "osd_repop(client.4668.0:100928 5.7 e37/19 5:e61a7dfa:::benchmark_data_smithi006_114134_object100927:head v 37'6273, mlcod=37'6270)", 2023-08-01T19:55:08.289 INFO:teuthology.orchestra.run.smithi008.stdout: "initiated_at": "2023-08-01T19:55:05.565106+0000", 2023-08-01T19:55:08.289 INFO:teuthology.orchestra.run.smithi008.stdout: "age": 2.591109077, 2023-08-01T19:55:08.289 INFO:teuthology.orchestra.run.smithi008.stdout: "duration": 0.064091282999999999, 2023-08-01T19:55:08.289 INFO:teuthology.orchestra.run.smithi008.stdout: "type_data": { 2023-08-01T19:55:08.290 INFO:teuthology.orchestra.run.smithi008.stdout: "flag_point": "commit sent; apply or cleanup", 2023-08-01T19:55:08.290 INFO:teuthology.orchestra.run.smithi008.stdout: "events": [ 2023-08-01T19:55:08.290 INFO:teuthology.orchestra.run.smithi008.stdout: { 2023-08-01T19:55:08.290 INFO:teuthology.orchestra.run.smithi008.stdout: "event": "initiated", 2023-08-01T19:55:08.290 INFO:teuthology.orchestra.run.smithi008.stdout: "time": "2023-08-01T19:55:05.565106+0000", 2023-08-01T19:55:08.290 INFO:teuthology.orchestra.run.smithi008.stdout: "duration": 0 2023-08-01T19:55:08.291 INFO:teuthology.orchestra.run.smithi008.stdout: }, 2023-08-01T19:55:08.291 INFO:teuthology.orchestra.run.smithi008.stdout: { 2023-08-01T19:55:08.291 INFO:teuthology.orchestra.run.smithi008.stdout: "event": "throttled", 2023-08-01T19:55:08.291 INFO:teuthology.orchestra.run.smithi008.stdout: "time": "2023-08-01T19:55:05.565106+0000", 2023-08-01T19:55:08.291 INFO:teuthology.orchestra.run.smithi008.stdout: "duration": 0 2023-08-01T19:55:08.291 INFO:teuthology.orchestra.run.smithi008.stdout: }, 2023-08-01T19:55:08.291 INFO:teuthology.orchestra.run.smithi008.stdout: { 2023-08-01T19:55:08.291 INFO:teuthology.orchestra.run.smithi008.stdout: "event": "header_read", 2023-08-01T19:55:08.292 INFO:teuthology.orchestra.run.smithi008.stdout: "time": "2023-08-01T19:55:05.565105+0000", 2023-08-01T19:55:08.292 INFO:teuthology.orchestra.run.smithi008.stdout: "duration": 4294967295.9999995 2023-08-01T19:55:08.292 INFO:teuthology.orchestra.run.smithi008.stdout: }, 2023-08-01T19:55:08.292 INFO:teuthology.orchestra.run.smithi008.stdout: { 2023-08-01T19:55:08.292 INFO:teuthology.orchestra.run.smithi008.stdout: "event": "all_read", 2023-08-01T19:55:08.292 INFO:teuthology.orchestra.run.smithi008.stdout: "time": "2023-08-01T19:55:05.565173+0000", 2023-08-01T19:55:08.292 INFO:teuthology.orchestra.run.smithi008.stdout: "duration": 6.8186000000000001e-05 2023-08-01T19:55:08.292 INFO:teuthology.orchestra.run.smithi008.stdout: }, 2023-08-01T19:55:08.293 INFO:teuthology.orchestra.run.smithi008.stdout: { 2023-08-01T19:55:08.293 INFO:teuthology.orchestra.run.smithi008.stdout: "event": "dispatched", 2023-08-01T19:55:08.293 INFO:teuthology.orchestra.run.smithi008.stdout: "time": "2023-08-01T19:55:05.565182+0000", 2023-08-01T19:55:08.293 INFO:teuthology.orchestra.run.smithi008.stdout: "duration": 8.3620000000000006e-06 2023-08-01T19:55:08.293 INFO:teuthology.orchestra.run.smithi008.stdout: }, 2023-08-01T19:55:08.293 INFO:teuthology.orchestra.run.smithi008.stdout: { 2023-08-01T19:55:08.293 INFO:teuthology.orchestra.run.smithi008.stdout: "event": "queued_for_pg", 2023-08-01T19:55:08.293 INFO:teuthology.orchestra.run.smithi008.stdout: "time": "2023-08-01T19:55:05.565186+0000", 2023-08-01T19:55:08.294 INFO:teuthology.orchestra.run.smithi008.stdout: "duration": 3.7680000000000002e-06 2023-08-01T19:55:08.294 INFO:teuthology.orchestra.run.smithi008.stdout: }, 2023-08-01T19:55:08.294 INFO:teuthology.orchestra.run.smithi008.stdout: { 2023-08-01T19:55:08.294 INFO:teuthology.orchestra.run.smithi008.stdout: "event": "reached_pg", 2023-08-01T19:55:08.294 INFO:teuthology.orchestra.run.smithi008.stdout: "time": "2023-08-01T19:55:05.565212+0000", 2023-08-01T19:55:08.294 INFO:teuthology.orchestra.run.smithi008.stdout: "duration": 2.6230000000000001e-05 2023-08-01T19:55:08.294 INFO:teuthology.orchestra.run.smithi008.stdout: }, 2023-08-01T19:55:08.295 INFO:teuthology.orchestra.run.smithi008.stdout: { 2023-08-01T19:55:08.295 INFO:teuthology.orchestra.run.smithi008.stdout: "event": "started", 2023-08-01T19:55:08.295 INFO:teuthology.orchestra.run.smithi008.stdout: "time": "2023-08-01T19:55:05.565224+0000", 2023-08-01T19:55:08.295 INFO:teuthology.orchestra.run.smithi008.stdout: "duration": 1.2033e-05 2023-08-01T19:55:08.295 INFO:teuthology.orchestra.run.smithi008.stdout: }, 2023-08-01T19:55:08.295 INFO:teuthology.orchestra.run.smithi008.stdout: { 2023-08-01T19:55:08.295 INFO:teuthology.orchestra.run.smithi008.stdout: "event": "commit_sent", 2023-08-01T19:55:08.295 INFO:teuthology.orchestra.run.smithi008.stdout: "time": "2023-08-01T19:55:05.629152+0000", 2023-08-01T19:55:08.296 INFO:teuthology.orchestra.run.smithi008.stdout: "duration": 0.063928378999999994 2023-08-01T19:55:08.296 INFO:teuthology.orchestra.run.smithi008.stdout: }, 2023-08-01T19:55:08.296 INFO:teuthology.orchestra.run.smithi008.stdout: { 2023-08-01T19:55:08.296 INFO:teuthology.orchestra.run.smithi008.stdout: "event": "done", 2023-08-01T19:55:08.296 INFO:teuthology.orchestra.run.smithi008.stdout: "time": "2023-08-01T19:55:05.629197+0000", 2023-08-01T19:55:08.296 INFO:teuthology.orchestra.run.smithi008.stdout: "duration": 4.4894000000000001e-05 2023-08-01T19:55:08.296 INFO:teuthology.orchestra.run.smithi008.stdout: } 2023-08-01T19:55:08.296 INFO:teuthology.orchestra.run.smithi008.stdout: ] 2023-08-01T19:55:08.297 INFO:teuthology.orchestra.run.smithi008.stdout: } 2023-08-01T19:55:08.297 INFO:teuthology.orchestra.run.smithi008.stdout: }, 2023-08-01T19:55:08.297 INFO:teuthology.orchestra.run.smithi008.stdout: { 2023-08-01T19:55:08.297 INFO:teuthology.orchestra.run.smithi008.stdout: "description": "osd_repop(client.4668.0:100927 5.0 e37/19 5:00608ec6:::benchmark_data_smithi006_114134_object100926:head v 37'6408, mlcod=37'6403)", 2023-08-01T19:55:08.297 INFO:teuthology.orchestra.run.smithi008.stdout: "initiated_at": "2023-08-01T19:55:05.565153+0000", 2023-08-01T19:55:08.297 INFO:teuthology.orchestra.run.smithi008.stdout: "age": 2.5910623400000001, 2023-08-01T19:55:08.297 INFO:teuthology.orchestra.run.smithi008.stdout: "duration": 0.062202714999999999, 2023-08-01T19:55:08.297 INFO:teuthology.orchestra.run.smithi008.stdout: "type_data": { 2023-08-01T19:55:08.298 INFO:teuthology.orchestra.run.smithi008.stdout: "flag_point": "commit sent; apply or cleanup", 2023-08-01T19:55:08.298 INFO:teuthology.orchestra.run.smithi008.stdout: "events": [ 2023-08-01T19:55:08.298 INFO:teuthology.orchestra.run.smithi008.stdout: { 2023-08-01T19:55:08.298 INFO:teuthology.orchestra.run.smithi008.stdout: "event": "initiated", 2023-08-01T19:55:08.298 INFO:teuthology.orchestra.run.smithi008.stdout: "time": "2023-08-01T19:55:05.565153+0000", 2023-08-01T19:55:08.298 INFO:teuthology.orchestra.run.smithi008.stdout: "duration": 0 2023-08-01T19:55:08.298 INFO:teuthology.orchestra.run.smithi008.stdout: }, 2023-08-01T19:55:08.298 INFO:teuthology.orchestra.run.smithi008.stdout: { 2023-08-01T19:55:08.299 INFO:teuthology.orchestra.run.smithi008.stdout: "event": "throttled", 2023-08-01T19:55:08.299 INFO:teuthology.orchestra.run.smithi008.stdout: "time": "2023-08-01T19:55:05.565153+0000", 2023-08-01T19:55:08.299 INFO:teuthology.orchestra.run.smithi008.stdout: "duration": 0 2023-08-01T19:55:08.299 INFO:teuthology.orchestra.run.smithi008.stdout: }, 2023-08-01T19:55:08.299 INFO:teuthology.orchestra.run.smithi008.stdout: { 2023-08-01T19:55:08.299 INFO:teuthology.orchestra.run.smithi008.stdout: "event": "header_read", 2023-08-01T19:55:08.299 INFO:teuthology.orchestra.run.smithi008.stdout: "time": "2023-08-01T19:55:05.565152+0000", 2023-08-01T19:55:08.300 INFO:teuthology.orchestra.run.smithi008.stdout: "duration": 4294967295.9999995 2023-08-01T19:55:08.300 INFO:teuthology.orchestra.run.smithi008.stdout: }, 2023-08-01T19:55:08.300 INFO:teuthology.orchestra.run.smithi008.stdout: { 2023-08-01T19:55:08.300 INFO:teuthology.orchestra.run.smithi008.stdout: "event": "all_read", 2023-08-01T19:55:08.301 INFO:teuthology.orchestra.run.smithi008.stdout: "time": "2023-08-01T19:55:05.565225+0000", 2023-08-01T19:55:08.301 INFO:teuthology.orchestra.run.smithi008.stdout: "duration": 7.2471000000000005e-05 2023-08-01T19:55:08.301 INFO:teuthology.orchestra.run.smithi008.stdout: }, 2023-08-01T19:55:08.302 INFO:teuthology.orchestra.run.smithi008.stdout: { 2023-08-01T19:55:08.302 INFO:teuthology.orchestra.run.smithi008.stdout: "event": "dispatched", 2023-08-01T19:55:08.302 INFO:teuthology.orchestra.run.smithi008.stdout: "time": "2023-08-01T19:55:05.565229+0000", 2023-08-01T19:55:08.302 INFO:teuthology.orchestra.run.smithi008.stdout: "duration": 4.5600000000000004e-06 2023-08-01T19:55:08.303 INFO:teuthology.orchestra.run.smithi008.stdout: }, 2023-08-01T19:55:08.303 INFO:teuthology.orchestra.run.smithi008.stdout: { 2023-08-01T19:55:08.303 INFO:teuthology.orchestra.run.smithi008.stdout: "event": "queued_for_pg", 2023-08-01T19:55:08.303 INFO:teuthology.orchestra.run.smithi008.stdout: "time": "2023-08-01T19:55:05.565232+0000", 2023-08-01T19:55:08.304 INFO:teuthology.orchestra.run.smithi008.stdout: "duration": 2.6900000000000001e-06 2023-08-01T19:55:08.304 INFO:teuthology.orchestra.run.smithi008.stdout: }, 2023-08-01T19:55:08.304 INFO:teuthology.orchestra.run.smithi008.stdout: { 2023-08-01T19:55:08.304 INFO:teuthology.orchestra.run.smithi008.stdout: "event": "reached_pg", 2023-08-01T19:55:08.305 INFO:teuthology.orchestra.run.smithi008.stdout: "time": "2023-08-01T19:55:05.565283+0000", 2023-08-01T19:55:08.305 INFO:teuthology.orchestra.run.smithi008.stdout: "duration": 5.1442e-05 2023-08-01T19:55:08.305 INFO:teuthology.orchestra.run.smithi008.stdout: }, 2023-08-01T19:55:08.305 INFO:teuthology.orchestra.run.smithi008.stdout: { 2023-08-01T19:55:08.306 INFO:teuthology.orchestra.run.smithi008.stdout: "event": "started", 2023-08-01T19:55:08.306 INFO:teuthology.orchestra.run.smithi008.stdout: "time": "2023-08-01T19:55:05.565301+0000", 2023-08-01T19:55:08.306 INFO:teuthology.orchestra.run.smithi008.stdout: "duration": 1.8029e-05 2023-08-01T19:55:08.306 INFO:teuthology.orchestra.run.smithi008.stdout: }, 2023-08-01T19:55:08.307 INFO:teuthology.orchestra.run.smithi008.stdout: { 2023-08-01T19:55:08.307 INFO:teuthology.orchestra.run.smithi008.stdout: "event": "commit_sent", 2023-08-01T19:55:08.307 INFO:teuthology.orchestra.run.smithi008.stdout: "time": "2023-08-01T19:55:05.627318+0000", 2023-08-01T19:55:08.307 INFO:teuthology.orchestra.run.smithi008.stdout: "duration": 0.062016763000000003 2023-08-01T19:55:08.307 INFO:teuthology.orchestra.run.smithi008.stdout: }, 2023-08-01T19:55:08.308 INFO:teuthology.orchestra.run.smithi008.stdout: { 2023-08-01T19:55:08.308 INFO:teuthology.orchestra.run.smithi008.stdout: "event": "done", 2023-08-01T19:55:08.308 INFO:teuthology.orchestra.run.smithi008.stdout: "time": "2023-08-01T19:55:05.627355+0000", 2023-08-01T19:55:08.308 INFO:teuthology.orchestra.run.smithi008.stdout: "duration": 3.7258999999999997e-05 2023-08-01T19:55:08.309 INFO:teuthology.orchestra.run.smithi008.stdout: } 2023-08-01T19:55:08.309 INFO:teuthology.orchestra.run.smithi008.stdout: ] 2023-08-01T19:55:08.309 INFO:teuthology.orchestra.run.smithi008.stdout: } 2023-08-01T19:55:08.309 INFO:teuthology.orchestra.run.smithi008.stdout: }, 2023-08-01T19:55:08.310 INFO:teuthology.orchestra.run.smithi008.stdout: { 2023-08-01T19:55:08.310 INFO:teuthology.orchestra.run.smithi008.stdout: "description": "osd_op(client.4668.0:100930 5.5 5:a7b64eb3:::benchmark_data_smithi006_114134_object100929:head [set-alloc-hint object_size 65536 write_size 65536,write 0~65536] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e37)", 2023-08-01T19:55:08.310 INFO:teuthology.orchestra.run.smithi008.stdout: "initiated_at": "2023-08-01T19:55:05.565766+0000", 2023-08-01T19:55:08.310 INFO:teuthology.orchestra.run.smithi008.stdout: "age": 2.590448555, 2023-08-01T19:55:08.311 INFO:teuthology.orchestra.run.smithi008.stdout: "duration": 0.063668735000000004, 2023-08-01T19:55:08.311 INFO:teuthology.orchestra.run.smithi008.stdout: "type_data": { 2023-08-01T19:55:08.311 INFO:teuthology.orchestra.run.smithi008.stdout: "flag_point": "commit sent; apply or cleanup", 2023-08-01T19:55:08.311 INFO:teuthology.orchestra.run.smithi008.stdout: "client_info": { 2023-08-01T19:55:08.311 INFO:teuthology.orchestra.run.smithi008.stdout: "client": "client.4668", 2023-08-01T19:55:08.312 INFO:teuthology.orchestra.run.smithi008.stdout: "client_addr": "172.21.15.6:0/1709472247", 2023-08-01T19:55:08.312 INFO:teuthology.orchestra.run.smithi008.stdout: "tid": 100930 2023-08-01T19:55:08.312 INFO:teuthology.orchestra.run.smithi008.stdout: }, 2023-08-01T19:55:08.312 INFO:teuthology.orchestra.run.smithi008.stdout: "events": [ 2023-08-01T19:55:08.313 INFO:teuthology.orchestra.run.smithi008.stdout: { 2023-08-01T19:55:08.313 INFO:teuthology.orchestra.run.smithi008.stdout: "event": "initiated", 2023-08-01T19:55:08.313 INFO:teuthology.orchestra.run.smithi008.stdout: "time": "2023-08-01T19:55:05.565766+0000", 2023-08-01T19:55:08.313 INFO:teuthology.orchestra.run.smithi008.stdout: "duration": 0 2023-08-01T19:55:08.314 INFO:teuthology.orchestra.run.smithi008.stdout: }, 2023-08-01T19:55:08.314 INFO:teuthology.orchestra.run.smithi008.stdout: { 2023-08-01T19:55:08.314 INFO:teuthology.orchestra.run.smithi008.stdout: "event": "throttled", 2023-08-01T19:55:08.314 INFO:teuthology.orchestra.run.smithi008.stdout: "time": "2023-08-01T19:55:05.565766+0000", 2023-08-01T19:55:08.315 INFO:teuthology.orchestra.run.smithi008.stdout: "duration": 0 2023-08-01T19:55:08.315 INFO:teuthology.orchestra.run.smithi008.stdout: }, 2023-08-01T19:55:08.315 INFO:teuthology.orchestra.run.smithi008.stdout: { 2023-08-01T19:55:08.315 INFO:teuthology.orchestra.run.smithi008.stdout: "event": "header_read", 2023-08-01T19:55:08.315 INFO:teuthology.orchestra.run.smithi008.stdout: "time": "2023-08-01T19:55:05.565766+0000", 2023-08-01T19:55:08.316 INFO:teuthology.orchestra.run.smithi008.stdout: "duration": 4294967295.999999 2023-08-01T19:55:08.316 INFO:teuthology.orchestra.run.smithi008.stdout: }, 2023-08-01T19:55:08.316 INFO:teuthology.orchestra.run.smithi008.stdout: { 2023-08-01T19:55:08.316 INFO:teuthology.orchestra.run.smithi008.stdout: "event": "all_read", 2023-08-01T19:55:08.317 INFO:teuthology.orchestra.run.smithi008.stdout: "time": "2023-08-01T19:55:05.565855+0000", 2023-08-01T19:55:08.317 INFO:teuthology.orchestra.run.smithi008.stdout: "duration": 8.9166999999999995e-05 2023-08-01T19:55:08.317 INFO:teuthology.orchestra.run.smithi008.stdout: }, 2023-08-01T19:55:08.317 INFO:teuthology.orchestra.run.smithi008.stdout: { 2023-08-01T19:55:08.317 INFO:teuthology.orchestra.run.smithi008.stdout: "event": "dispatched", 2023-08-01T19:55:08.317 INFO:teuthology.orchestra.run.smithi008.stdout: "time": "2023-08-01T19:55:05.565862+0000", 2023-08-01T19:55:08.318 INFO:teuthology.orchestra.run.smithi008.stdout: "duration": 7.4549999999999998e-06 2023-08-01T19:55:08.318 INFO:teuthology.orchestra.run.smithi008.stdout: }, 2023-08-01T19:55:08.318 INFO:teuthology.orchestra.run.smithi008.stdout: { 2023-08-01T19:55:08.318 INFO:teuthology.orchestra.run.smithi008.stdout: "event": "queued_for_pg", 2023-08-01T19:55:08.318 INFO:teuthology.orchestra.run.smithi008.stdout: "time": "2023-08-01T19:55:05.565866+0000", 2023-08-01T19:55:08.318 INFO:teuthology.orchestra.run.smithi008.stdout: "duration": 3.8060000000000001e-06 2023-08-01T19:55:08.318 INFO:teuthology.orchestra.run.smithi008.stdout: }, 2023-08-01T19:55:08.318 INFO:teuthology.orchestra.run.smithi008.stdout: { 2023-08-01T19:55:08.319 INFO:teuthology.orchestra.run.smithi008.stdout: "event": "reached_pg", 2023-08-01T19:55:08.319 INFO:teuthology.orchestra.run.smithi008.stdout: "time": "2023-08-01T19:55:05.565901+0000", 2023-08-01T19:55:08.319 INFO:teuthology.orchestra.run.smithi008.stdout: "duration": 3.5063e-05 2023-08-01T19:55:08.319 INFO:teuthology.orchestra.run.smithi008.stdout: }, 2023-08-01T19:55:08.319 INFO:teuthology.orchestra.run.smithi008.stdout: { 2023-08-01T19:55:08.319 INFO:teuthology.orchestra.run.smithi008.stdout: "event": "started", 2023-08-01T19:55:08.319 INFO:teuthology.orchestra.run.smithi008.stdout: "time": "2023-08-01T19:55:05.566016+0000", 2023-08-01T19:55:08.320 INFO:teuthology.orchestra.run.smithi008.stdout: "duration": 0.00011509400000000001 2023-08-01T19:55:08.320 INFO:teuthology.orchestra.run.smithi008.stdout: }, 2023-08-01T19:55:08.320 INFO:teuthology.orchestra.run.smithi008.stdout: { 2023-08-01T19:55:08.320 INFO:teuthology.orchestra.run.smithi008.stdout: "event": "waiting for subops from 1", 2023-08-01T19:55:08.320 INFO:teuthology.orchestra.run.smithi008.stdout: "time": "2023-08-01T19:55:05.566154+0000", 2023-08-01T19:55:08.321 INFO:teuthology.orchestra.run.smithi008.stdout: "duration": 0.000138052 2023-08-01T19:55:08.321 INFO:teuthology.orchestra.run.smithi008.stdout: }, 2023-08-01T19:55:08.321 INFO:teuthology.orchestra.run.smithi008.stdout: { 2023-08-01T19:55:08.321 INFO:teuthology.orchestra.run.smithi008.stdout: "event": "sub_op_commit_rec", 2023-08-01T19:55:08.321 INFO:teuthology.orchestra.run.smithi008.stdout: "time": "2023-08-01T19:55:05.629279+0000", 2023-08-01T19:55:08.321 INFO:teuthology.orchestra.run.smithi008.stdout: "duration": 0.063124531999999997 2023-08-01T19:55:08.321 INFO:teuthology.orchestra.run.smithi008.stdout: }, 2023-08-01T19:55:08.321 INFO:teuthology.orchestra.run.smithi008.stdout: { 2023-08-01T19:55:08.322 INFO:teuthology.orchestra.run.smithi008.stdout: "event": "op_commit", 2023-08-01T19:55:08.322 INFO:teuthology.orchestra.run.smithi008.stdout: "time": "2023-08-01T19:55:05.629333+0000", 2023-08-01T19:55:08.322 INFO:teuthology.orchestra.run.smithi008.stdout: "duration": 5.4694999999999997e-05 2023-08-01T19:55:08.322 INFO:teuthology.orchestra.run.smithi008.stdout: }, 2023-08-01T19:55:08.322 INFO:teuthology.orchestra.run.smithi008.stdout: { 2023-08-01T19:55:08.322 INFO:teuthology.orchestra.run.smithi008.stdout: "event": "commit_sent", 2023-08-01T19:55:08.322 INFO:teuthology.orchestra.run.smithi008.stdout: "time": "2023-08-01T19:55:05.629390+0000", 2023-08-01T19:55:08.322 INFO:teuthology.orchestra.run.smithi008.stdout: "duration": 5.6416000000000003e-05 2023-08-01T19:55:08.323 INFO:teuthology.orchestra.run.smithi008.stdout: }, 2023-08-01T19:55:08.323 INFO:teuthology.orchestra.run.smithi008.stdout: { 2023-08-01T19:55:08.323 INFO:teuthology.orchestra.run.smithi008.stdout: "event": "done", 2023-08-01T19:55:08.323 INFO:teuthology.orchestra.run.smithi008.stdout: "time": "2023-08-01T19:55:05.629435+0000", 2023-08-01T19:55:08.323 INFO:teuthology.orchestra.run.smithi008.stdout: "duration": 4.5170999999999998e-05 2023-08-01T19:55:08.323 INFO:teuthology.orchestra.run.smithi008.stdout: } 2023-08-01T19:55:08.323 INFO:teuthology.orchestra.run.smithi008.stdout: ] 2023-08-01T19:55:08.324 INFO:teuthology.orchestra.run.smithi008.stdout: } 2023-08-01T19:55:08.324 INFO:teuthology.orchestra.run.smithi008.stdout: }, 2023-08-01T19:55:08.324 INFO:teuthology.orchestra.run.smithi008.stdout: { 2023-08-01T19:55:08.324 INFO:teuthology.orchestra.run.smithi008.stdout: "description": "osd_op(client.4668.0:100933 5.5 5:af92e9f2:::benchmark_data_smithi006_114134_object100932:head [set-alloc-hint object_size 65536 write_size 65536,write 0~65536] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e37)", 2023-08-01T19:55:08.324 INFO:teuthology.orchestra.run.smithi008.stdout: "initiated_at": "2023-08-01T19:55:05.566634+0000", 2023-08-01T19:55:08.324 INFO:teuthology.orchestra.run.smithi008.stdout: "age": 2.589581012, 2023-08-01T19:55:08.324 INFO:teuthology.orchestra.run.smithi008.stdout: "duration": 0.065909364999999998, 2023-08-01T19:55:08.325 INFO:teuthology.orchestra.run.smithi008.stdout: "type_data": { 2023-08-01T19:55:08.325 INFO:teuthology.orchestra.run.smithi008.stdout: "flag_point": "commit sent; apply or cleanup", 2023-08-01T19:55:08.325 INFO:teuthology.orchestra.run.smithi008.stdout: "client_info": { 2023-08-01T19:55:08.325 INFO:teuthology.orchestra.run.smithi008.stdout: "client": "client.4668", 2023-08-01T19:55:08.325 INFO:teuthology.orchestra.run.smithi008.stdout: "client_addr": "172.21.15.6:0/1709472247", 2023-08-01T19:55:08.325 INFO:teuthology.orchestra.run.smithi008.stdout: "tid": 100933 2023-08-01T19:55:08.325 INFO:teuthology.orchestra.run.smithi008.stdout: }, 2023-08-01T19:55:08.325 INFO:teuthology.orchestra.run.smithi008.stdout: "events": [ 2023-08-01T19:55:08.326 INFO:teuthology.orchestra.run.smithi008.stdout: { 2023-08-01T19:55:08.326 INFO:teuthology.orchestra.run.smithi008.stdout: "event": "initiated", 2023-08-01T19:55:08.326 INFO:teuthology.orchestra.run.smithi008.stdout: "time": "2023-08-01T19:55:05.566634+0000", 2023-08-01T19:55:08.326 INFO:teuthology.orchestra.run.smithi008.stdout: "duration": 0 2023-08-01T19:55:08.326 INFO:teuthology.orchestra.run.smithi008.stdout: }, 2023-08-01T19:55:08.326 INFO:teuthology.orchestra.run.smithi008.stdout: { 2023-08-01T19:55:08.326 INFO:teuthology.orchestra.run.smithi008.stdout: "event": "throttled", 2023-08-01T19:55:08.326 INFO:teuthology.orchestra.run.smithi008.stdout: "time": "2023-08-01T19:55:05.566634+0000", 2023-08-01T19:55:08.327 INFO:teuthology.orchestra.run.smithi008.stdout: "duration": 0 2023-08-01T19:55:08.327 INFO:teuthology.orchestra.run.smithi008.stdout: }, 2023-08-01T19:55:08.327 INFO:teuthology.orchestra.run.smithi008.stdout: { 2023-08-01T19:55:08.327 INFO:teuthology.orchestra.run.smithi008.stdout: "event": "header_read", 2023-08-01T19:55:08.327 INFO:teuthology.orchestra.run.smithi008.stdout: "time": "2023-08-01T19:55:05.566630+0000", 2023-08-01T19:55:08.327 INFO:teuthology.orchestra.run.smithi008.stdout: "duration": 4294967295.9999962 2023-08-01T19:55:08.327 INFO:teuthology.orchestra.run.smithi008.stdout: }, 2023-08-01T19:55:08.327 INFO:teuthology.orchestra.run.smithi008.stdout: { 2023-08-01T19:55:08.328 INFO:teuthology.orchestra.run.smithi008.stdout: "event": "all_read", 2023-08-01T19:55:08.328 INFO:teuthology.orchestra.run.smithi008.stdout: "time": "2023-08-01T19:55:05.566736+0000", 2023-08-01T19:55:08.328 INFO:teuthology.orchestra.run.smithi008.stdout: "duration": 0.000105752 2023-08-01T19:55:08.328 INFO:teuthology.orchestra.run.smithi008.stdout: }, 2023-08-01T19:55:08.328 INFO:teuthology.orchestra.run.smithi008.stdout: { 2023-08-01T19:55:08.328 INFO:teuthology.orchestra.run.smithi008.stdout: "event": "dispatched", 2023-08-01T19:55:08.328 INFO:teuthology.orchestra.run.smithi008.stdout: "time": "2023-08-01T19:55:05.566742+0000", 2023-08-01T19:55:08.329 INFO:teuthology.orchestra.run.smithi008.stdout: "duration": 5.8209999999999998e-06 2023-08-01T19:55:08.329 INFO:teuthology.orchestra.run.smithi008.stdout: }, 2023-08-01T19:55:08.329 INFO:teuthology.orchestra.run.smithi008.stdout: { 2023-08-01T19:55:08.329 INFO:teuthology.orchestra.run.smithi008.stdout: "event": "queued_for_pg", 2023-08-01T19:55:08.329 INFO:teuthology.orchestra.run.smithi008.stdout: "time": "2023-08-01T19:55:05.566745+0000", 2023-08-01T19:55:08.329 INFO:teuthology.orchestra.run.smithi008.stdout: "duration": 3.337e-06 2023-08-01T19:55:08.329 INFO:teuthology.orchestra.run.smithi008.stdout: }, 2023-08-01T19:55:08.329 INFO:teuthology.orchestra.run.smithi008.stdout: { 2023-08-01T19:55:08.330 INFO:teuthology.orchestra.run.smithi008.stdout: "event": "reached_pg", 2023-08-01T19:55:08.330 INFO:teuthology.orchestra.run.smithi008.stdout: "time": "2023-08-01T19:55:05.568175+0000", 2023-08-01T19:55:08.330 INFO:teuthology.orchestra.run.smithi008.stdout: "duration": 0.001429647 2023-08-01T19:55:08.330 INFO:teuthology.orchestra.run.smithi008.stdout: }, 2023-08-01T19:55:08.330 INFO:teuthology.orchestra.run.smithi008.stdout: { 2023-08-01T19:55:08.331 INFO:teuthology.orchestra.run.smithi008.stdout: "event": "started", 2023-08-01T19:55:08.331 INFO:teuthology.orchestra.run.smithi008.stdout: "time": "2023-08-01T19:55:05.568288+0000", 2023-08-01T19:55:08.331 INFO:teuthology.orchestra.run.smithi008.stdout: "duration": 0.000113353 2023-08-01T19:55:08.331 INFO:teuthology.orchestra.run.smithi008.stdout: }, 2023-08-01T19:55:08.331 INFO:teuthology.orchestra.run.smithi008.stdout: { 2023-08-01T19:55:08.331 INFO:teuthology.orchestra.run.smithi008.stdout: "event": "waiting for subops from 1", 2023-08-01T19:55:08.331 INFO:teuthology.orchestra.run.smithi008.stdout: "time": "2023-08-01T19:55:05.568425+0000", 2023-08-01T19:55:08.331 INFO:teuthology.orchestra.run.smithi008.stdout: "duration": 0.000137346 2023-08-01T19:55:08.332 INFO:teuthology.orchestra.run.smithi008.stdout: }, 2023-08-01T19:55:08.332 INFO:teuthology.orchestra.run.smithi008.stdout: { 2023-08-01T19:55:08.332 INFO:teuthology.orchestra.run.smithi008.stdout: "event": "sub_op_commit_rec", 2023-08-01T19:55:08.332 INFO:teuthology.orchestra.run.smithi008.stdout: "time": "2023-08-01T19:55:05.629320+0000", 2023-08-01T19:55:08.332 INFO:teuthology.orchestra.run.smithi008.stdout: "duration": 0.060894491000000002 2023-08-01T19:55:08.332 INFO:teuthology.orchestra.run.smithi008.stdout: }, 2023-08-01T19:55:08.332 INFO:teuthology.orchestra.run.smithi008.stdout: { 2023-08-01T19:55:08.333 INFO:teuthology.orchestra.run.smithi008.stdout: "event": "op_commit", 2023-08-01T19:55:08.333 INFO:teuthology.orchestra.run.smithi008.stdout: "time": "2023-08-01T19:55:05.632452+0000", 2023-08-01T19:55:08.333 INFO:teuthology.orchestra.run.smithi008.stdout: "duration": 0.003131909 2023-08-01T19:55:08.333 INFO:teuthology.orchestra.run.smithi008.stdout: }, 2023-08-01T19:55:08.333 INFO:teuthology.orchestra.run.smithi008.stdout: { 2023-08-01T19:55:08.333 INFO:teuthology.orchestra.run.smithi008.stdout: "event": "commit_sent", 2023-08-01T19:55:08.333 INFO:teuthology.orchestra.run.smithi008.stdout: "time": "2023-08-01T19:55:05.632503+0000", 2023-08-01T19:55:08.333 INFO:teuthology.orchestra.run.smithi008.stdout: "duration": 5.1295000000000003e-05 2023-08-01T19:55:08.334 INFO:teuthology.orchestra.run.smithi008.stdout: }, 2023-08-01T19:55:08.334 INFO:teuthology.orchestra.run.smithi008.stdout: { 2023-08-01T19:55:08.334 INFO:teuthology.orchestra.run.smithi008.stdout: "event": "done", 2023-08-01T19:55:08.334 INFO:teuthology.orchestra.run.smithi008.stdout: "time": "2023-08-01T19:55:05.632543+0000", 2023-08-01T19:55:08.334 INFO:teuthology.orchestra.run.smithi008.stdout: "duration": 4.0234000000000001e-05 2023-08-01T19:55:08.334 INFO:teuthology.orchestra.run.smithi008.stdout: } 2023-08-01T19:55:08.334 INFO:teuthology.orchestra.run.smithi008.stdout: ] 2023-08-01T19:55:08.335 INFO:teuthology.orchestra.run.smithi008.stdout: } 2023-08-01T19:55:08.335 INFO:teuthology.orchestra.run.smithi008.stdout: }, 2023-08-01T19:55:08.335 INFO:teuthology.orchestra.run.smithi008.stdout: { 2023-08-01T19:55:08.335 INFO:teuthology.orchestra.run.smithi008.stdout: "description": "osd_repop(client.4668.0:100935 5.e e37/19 5:7895b14e:::benchmark_data_smithi006_114134_object100934:head v 37'6305, mlcod=37'6303)", 2023-08-01T19:55:08.335 INFO:teuthology.orchestra.run.smithi008.stdout: "initiated_at": "2023-08-01T19:55:05.567118+0000", 2023-08-01T19:55:08.335 INFO:teuthology.orchestra.run.smithi008.stdout: "age": 2.5890967690000002, 2023-08-01T19:55:08.335 INFO:teuthology.orchestra.run.smithi008.stdout: "duration": 0.063691180999999999, 2023-08-01T19:55:08.335 INFO:teuthology.orchestra.run.smithi008.stdout: "type_data": { 2023-08-01T19:55:08.336 INFO:teuthology.orchestra.run.smithi008.stdout: "flag_point": "commit sent; apply or cleanup", 2023-08-01T19:55:08.336 INFO:teuthology.orchestra.run.smithi008.stdout: "events": [ 2023-08-01T19:55:08.336 INFO:teuthology.orchestra.run.smithi008.stdout: { 2023-08-01T19:55:08.336 INFO:teuthology.orchestra.run.smithi008.stdout: "event": "initiated", 2023-08-01T19:55:08.336 INFO:teuthology.orchestra.run.smithi008.stdout: "time": "2023-08-01T19:55:05.567118+0000", 2023-08-01T19:55:08.336 INFO:teuthology.orchestra.run.smithi008.stdout: "duration": 0 2023-08-01T19:55:08.336 INFO:teuthology.orchestra.run.smithi008.stdout: }, 2023-08-01T19:55:08.336 INFO:teuthology.orchestra.run.smithi008.stdout: { 2023-08-01T19:55:08.337 INFO:teuthology.orchestra.run.smithi008.stdout: "event": "throttled", 2023-08-01T19:55:08.337 INFO:teuthology.orchestra.run.smithi008.stdout: "time": "2023-08-01T19:55:05.567118+0000", 2023-08-01T19:55:08.337 INFO:teuthology.orchestra.run.smithi008.stdout: "duration": 0 2023-08-01T19:55:08.337 INFO:teuthology.orchestra.run.smithi008.stdout: }, 2023-08-01T19:55:08.337 INFO:teuthology.orchestra.run.smithi008.stdout: { 2023-08-01T19:55:08.337 INFO:teuthology.orchestra.run.smithi008.stdout: "event": "header_read", 2023-08-01T19:55:08.337 INFO:teuthology.orchestra.run.smithi008.stdout: "time": "2023-08-01T19:55:05.567117+0000", 2023-08-01T19:55:08.337 INFO:teuthology.orchestra.run.smithi008.stdout: "duration": 4294967295.999999 2023-08-01T19:55:08.338 INFO:teuthology.orchestra.run.smithi008.stdout: }, 2023-08-01T19:55:08.338 INFO:teuthology.orchestra.run.smithi008.stdout: { 2023-08-01T19:55:08.338 INFO:teuthology.orchestra.run.smithi008.stdout: "event": "all_read", 2023-08-01T19:55:08.338 INFO:teuthology.orchestra.run.smithi008.stdout: "time": "2023-08-01T19:55:05.567168+0000", 2023-08-01T19:55:08.338 INFO:teuthology.orchestra.run.smithi008.stdout: "duration": 5.0353999999999999e-05 2023-08-01T19:55:08.338 INFO:teuthology.orchestra.run.smithi008.stdout: }, 2023-08-01T19:55:08.338 INFO:teuthology.orchestra.run.smithi008.stdout: { 2023-08-01T19:55:08.339 INFO:teuthology.orchestra.run.smithi008.stdout: "event": "dispatched", 2023-08-01T19:55:08.339 INFO:teuthology.orchestra.run.smithi008.stdout: "time": "2023-08-01T19:55:05.567175+0000", 2023-08-01T19:55:08.339 INFO:teuthology.orchestra.run.smithi008.stdout: "duration": 7.3919999999999997e-06 2023-08-01T19:55:08.339 INFO:teuthology.orchestra.run.smithi008.stdout: }, 2023-08-01T19:55:08.339 INFO:teuthology.orchestra.run.smithi008.stdout: { 2023-08-01T19:55:08.339 INFO:teuthology.orchestra.run.smithi008.stdout: "event": "queued_for_pg", 2023-08-01T19:55:08.339 INFO:teuthology.orchestra.run.smithi008.stdout: "time": "2023-08-01T19:55:05.567180+0000", 2023-08-01T19:55:08.339 INFO:teuthology.orchestra.run.smithi008.stdout: "duration": 5.3090000000000003e-06 2023-08-01T19:55:08.340 INFO:teuthology.orchestra.run.smithi008.stdout: }, 2023-08-01T19:55:08.340 INFO:teuthology.orchestra.run.smithi008.stdout: { 2023-08-01T19:55:08.340 INFO:teuthology.orchestra.run.smithi008.stdout: "event": "reached_pg", 2023-08-01T19:55:08.340 INFO:teuthology.orchestra.run.smithi008.stdout: "time": "2023-08-01T19:55:05.567210+0000", 2023-08-01T19:55:08.340 INFO:teuthology.orchestra.run.smithi008.stdout: "duration": 3.0001999999999998e-05 2023-08-01T19:55:08.340 INFO:teuthology.orchestra.run.smithi008.stdout: }, 2023-08-01T19:55:08.340 INFO:teuthology.orchestra.run.smithi008.stdout: { 2023-08-01T19:55:08.340 INFO:teuthology.orchestra.run.smithi008.stdout: "event": "started", 2023-08-01T19:55:08.341 INFO:teuthology.orchestra.run.smithi008.stdout: "time": "2023-08-01T19:55:05.567222+0000", 2023-08-01T19:55:08.341 INFO:teuthology.orchestra.run.smithi008.stdout: "duration": 1.1499e-05 2023-08-01T19:55:08.341 INFO:teuthology.orchestra.run.smithi008.stdout: }, 2023-08-01T19:55:08.341 INFO:teuthology.orchestra.run.smithi008.stdout: { 2023-08-01T19:55:08.341 INFO:teuthology.orchestra.run.smithi008.stdout: "event": "commit_sent", 2023-08-01T19:55:08.341 INFO:teuthology.orchestra.run.smithi008.stdout: "time": "2023-08-01T19:55:05.630772+0000", 2023-08-01T19:55:08.341 INFO:teuthology.orchestra.run.smithi008.stdout: "duration": 0.063550572999999999 2023-08-01T19:55:08.341 INFO:teuthology.orchestra.run.smithi008.stdout: }, 2023-08-01T19:55:08.342 INFO:teuthology.orchestra.run.smithi008.stdout: { 2023-08-01T19:55:08.342 INFO:teuthology.orchestra.run.smithi008.stdout: "event": "done", 2023-08-01T19:55:08.342 INFO:teuthology.orchestra.run.smithi008.stdout: "time": "2023-08-01T19:55:05.630809+0000", 2023-08-01T19:55:08.342 INFO:teuthology.orchestra.run.smithi008.stdout: "duration": 3.7033000000000003e-05 2023-08-01T19:55:08.342 INFO:teuthology.orchestra.run.smithi008.stdout: } 2023-08-01T19:55:08.342 INFO:teuthology.orchestra.run.smithi008.stdout: ] 2023-08-01T19:55:08.342 INFO:teuthology.orchestra.run.smithi008.stdout: } 2023-08-01T19:55:08.342 INFO:teuthology.orchestra.run.smithi008.stdout: }, 2023-08-01T19:55:08.343 INFO:teuthology.orchestra.run.smithi008.stdout: { 2023-08-01T19:55:08.343 INFO:teuthology.orchestra.run.smithi008.stdout: "description": "osd_repop(client.4668.0:100936 5.1 e37/19 5:8f4e3576:::benchmark_data_smithi006_114134_object100935:head v 37'6263, mlcod=37'6261)", 2023-08-01T19:55:08.343 INFO:teuthology.orchestra.run.smithi008.stdout: "initiated_at": "2023-08-01T19:55:05.567617+0000", 2023-08-01T19:55:08.343 INFO:teuthology.orchestra.run.smithi008.stdout: "age": 2.5885975060000002, 2023-08-01T19:55:08.343 INFO:teuthology.orchestra.run.smithi008.stdout: "duration": 0.062773918999999997, 2023-08-01T19:55:08.343 INFO:teuthology.orchestra.run.smithi008.stdout: "type_data": { 2023-08-01T19:55:08.343 INFO:teuthology.orchestra.run.smithi008.stdout: "flag_point": "commit sent; apply or cleanup", 2023-08-01T19:55:08.344 INFO:teuthology.orchestra.run.smithi008.stdout: "events": [ 2023-08-01T19:55:08.344 INFO:teuthology.orchestra.run.smithi008.stdout: { 2023-08-01T19:55:08.344 INFO:teuthology.orchestra.run.smithi008.stdout: "event": "initiated", 2023-08-01T19:55:08.344 INFO:teuthology.orchestra.run.smithi008.stdout: "time": "2023-08-01T19:55:05.567617+0000", 2023-08-01T19:55:08.344 INFO:teuthology.orchestra.run.smithi008.stdout: "duration": 0 2023-08-01T19:55:08.344 INFO:teuthology.orchestra.run.smithi008.stdout: }, 2023-08-01T19:55:08.344 INFO:teuthology.orchestra.run.smithi008.stdout: { 2023-08-01T19:55:08.344 INFO:teuthology.orchestra.run.smithi008.stdout: "event": "throttled", 2023-08-01T19:55:08.345 INFO:teuthology.orchestra.run.smithi008.stdout: "time": "2023-08-01T19:55:05.567617+0000", 2023-08-01T19:55:08.345 INFO:teuthology.orchestra.run.smithi008.stdout: "duration": 0 2023-08-01T19:55:08.345 INFO:teuthology.orchestra.run.smithi008.stdout: }, 2023-08-01T19:55:08.345 INFO:teuthology.orchestra.run.smithi008.stdout: { 2023-08-01T19:55:08.345 INFO:teuthology.orchestra.run.smithi008.stdout: "event": "header_read", 2023-08-01T19:55:08.345 INFO:teuthology.orchestra.run.smithi008.stdout: "time": "2023-08-01T19:55:05.567617+0000", 2023-08-01T19:55:08.345 INFO:teuthology.orchestra.run.smithi008.stdout: "duration": 4294967295.9999995 2023-08-01T19:55:08.346 INFO:teuthology.orchestra.run.smithi008.stdout: }, 2023-08-01T19:55:08.346 INFO:teuthology.orchestra.run.smithi008.stdout: { 2023-08-01T19:55:08.346 INFO:teuthology.orchestra.run.smithi008.stdout: "event": "all_read", 2023-08-01T19:55:08.346 INFO:teuthology.orchestra.run.smithi008.stdout: "time": "2023-08-01T19:55:05.567700+0000", 2023-08-01T19:55:08.346 INFO:teuthology.orchestra.run.smithi008.stdout: "duration": 8.3363999999999997e-05 2023-08-01T19:55:08.346 INFO:teuthology.orchestra.run.smithi008.stdout: }, 2023-08-01T19:55:08.346 INFO:teuthology.orchestra.run.smithi008.stdout: { 2023-08-01T19:55:08.346 INFO:teuthology.orchestra.run.smithi008.stdout: "event": "dispatched", 2023-08-01T19:55:08.347 INFO:teuthology.orchestra.run.smithi008.stdout: "time": "2023-08-01T19:55:05.567706+0000", 2023-08-01T19:55:08.347 INFO:teuthology.orchestra.run.smithi008.stdout: "duration": 5.9739999999999999e-06 2023-08-01T19:55:08.347 INFO:teuthology.orchestra.run.smithi008.stdout: }, 2023-08-01T19:55:08.347 INFO:teuthology.orchestra.run.smithi008.stdout: { 2023-08-01T19:55:08.347 INFO:teuthology.orchestra.run.smithi008.stdout: "event": "queued_for_pg", 2023-08-01T19:55:08.347 INFO:teuthology.orchestra.run.smithi008.stdout: "time": "2023-08-01T19:55:05.567709+0000", 2023-08-01T19:55:08.347 INFO:teuthology.orchestra.run.smithi008.stdout: "duration": 3.1420000000000002e-06 2023-08-01T19:55:08.347 INFO:teuthology.orchestra.run.smithi008.stdout: }, 2023-08-01T19:55:08.348 INFO:teuthology.orchestra.run.smithi008.stdout: { 2023-08-01T19:55:08.348 INFO:teuthology.orchestra.run.smithi008.stdout: "event": "reached_pg", 2023-08-01T19:55:08.348 INFO:teuthology.orchestra.run.smithi008.stdout: "time": "2023-08-01T19:55:05.567741+0000", 2023-08-01T19:55:08.348 INFO:teuthology.orchestra.run.smithi008.stdout: "duration": 3.1532999999999998e-05 2023-08-01T19:55:08.348 INFO:teuthology.orchestra.run.smithi008.stdout: }, 2023-08-01T19:55:08.348 INFO:teuthology.orchestra.run.smithi008.stdout: { 2023-08-01T19:55:08.348 INFO:teuthology.orchestra.run.smithi008.stdout: "event": "started", 2023-08-01T19:55:08.348 INFO:teuthology.orchestra.run.smithi008.stdout: "time": "2023-08-01T19:55:05.567752+0000", 2023-08-01T19:55:08.349 INFO:teuthology.orchestra.run.smithi008.stdout: "duration": 1.1266e-05 2023-08-01T19:55:08.349 INFO:teuthology.orchestra.run.smithi008.stdout: }, 2023-08-01T19:55:08.349 INFO:teuthology.orchestra.run.smithi008.stdout: { 2023-08-01T19:55:08.349 INFO:teuthology.orchestra.run.smithi008.stdout: "event": "commit_sent", 2023-08-01T19:55:08.349 INFO:teuthology.orchestra.run.smithi008.stdout: "time": "2023-08-01T19:55:05.630357+0000", 2023-08-01T19:55:08.349 INFO:teuthology.orchestra.run.smithi008.stdout: "duration": 0.062604554000000007 2023-08-01T19:55:08.349 INFO:teuthology.orchestra.run.smithi008.stdout: }, 2023-08-01T19:55:08.349 INFO:teuthology.orchestra.run.smithi008.stdout: { 2023-08-01T19:55:08.350 INFO:teuthology.orchestra.run.smithi008.stdout: "event": "done", 2023-08-01T19:55:08.350 INFO:teuthology.orchestra.run.smithi008.stdout: "time": "2023-08-01T19:55:05.630391+0000", 2023-08-01T19:55:08.350 INFO:teuthology.orchestra.run.smithi008.stdout: "duration": 3.4619000000000002e-05 2023-08-01T19:55:08.350 INFO:teuthology.orchestra.run.smithi008.stdout: } 2023-08-01T19:55:08.350 INFO:teuthology.orchestra.run.smithi008.stdout: ] 2023-08-01T19:55:08.350 INFO:teuthology.orchestra.run.smithi008.stdout: } 2023-08-01T19:55:08.350 INFO:teuthology.orchestra.run.smithi008.stdout: }, 2023-08-01T19:55:08.350 INFO:teuthology.orchestra.run.smithi008.stdout: { 2023-08-01T19:55:08.351 INFO:teuthology.orchestra.run.smithi008.stdout: "description": "osd_op(client.4668.0:100937 5.c 5:34445fc3:::benchmark_data_smithi006_114134_object100936:head [set-alloc-hint object_size 65536 write_size 65536,write 0~65536] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e37)", 2023-08-01T19:55:08.351 INFO:teuthology.orchestra.run.smithi008.stdout: "initiated_at": "2023-08-01T19:55:05.569198+0000", 2023-08-01T19:55:08.351 INFO:teuthology.orchestra.run.smithi008.stdout: "age": 2.587016883, 2023-08-01T19:55:08.351 INFO:teuthology.orchestra.run.smithi008.stdout: "duration": 0.063349390000000005, 2023-08-01T19:55:08.351 INFO:teuthology.orchestra.run.smithi008.stdout: "type_data": { 2023-08-01T19:55:08.351 INFO:teuthology.orchestra.run.smithi008.stdout: "flag_point": "commit sent; apply or cleanup", 2023-08-01T19:55:08.351 INFO:teuthology.orchestra.run.smithi008.stdout: "client_info": { 2023-08-01T19:55:08.351 INFO:teuthology.orchestra.run.smithi008.stdout: "client": "client.4668", 2023-08-01T19:55:08.352 INFO:teuthology.orchestra.run.smithi008.stdout: "client_addr": "172.21.15.6:0/1709472247", 2023-08-01T19:55:08.352 INFO:teuthology.orchestra.run.smithi008.stdout: "tid": 100937 2023-08-01T19:55:08.352 INFO:teuthology.orchestra.run.smithi008.stdout: }, 2023-08-01T19:55:08.352 INFO:teuthology.orchestra.run.smithi008.stdout: "events": [ 2023-08-01T19:55:08.352 INFO:teuthology.orchestra.run.smithi008.stdout: { 2023-08-01T19:55:08.352 INFO:teuthology.orchestra.run.smithi008.stdout: "event": "initiated", 2023-08-01T19:55:08.352 INFO:teuthology.orchestra.run.smithi008.stdout: "time": "2023-08-01T19:55:05.569198+0000", 2023-08-01T19:55:08.353 INFO:teuthology.orchestra.run.smithi008.stdout: "duration": 0 2023-08-01T19:55:08.353 INFO:teuthology.orchestra.run.smithi008.stdout: }, 2023-08-01T19:55:08.353 INFO:teuthology.orchestra.run.smithi008.stdout: { 2023-08-01T19:55:08.353 INFO:teuthology.orchestra.run.smithi008.stdout: "event": "throttled", 2023-08-01T19:55:08.353 INFO:teuthology.orchestra.run.smithi008.stdout: "time": "2023-08-01T19:55:05.569198+0000", 2023-08-01T19:55:08.353 INFO:teuthology.orchestra.run.smithi008.stdout: "duration": 0 2023-08-01T19:55:08.353 INFO:teuthology.orchestra.run.smithi008.stdout: }, 2023-08-01T19:55:08.353 INFO:teuthology.orchestra.run.smithi008.stdout: { 2023-08-01T19:55:08.354 INFO:teuthology.orchestra.run.smithi008.stdout: "event": "header_read", 2023-08-01T19:55:08.354 INFO:teuthology.orchestra.run.smithi008.stdout: "time": "2023-08-01T19:55:05.569197+0000", 2023-08-01T19:55:08.354 INFO:teuthology.orchestra.run.smithi008.stdout: "duration": 4294967295.999999 2023-08-01T19:55:08.354 INFO:teuthology.orchestra.run.smithi008.stdout: }, 2023-08-01T19:55:08.354 INFO:teuthology.orchestra.run.smithi008.stdout: { 2023-08-01T19:55:08.354 INFO:teuthology.orchestra.run.smithi008.stdout: "event": "all_read", 2023-08-01T19:55:08.354 INFO:teuthology.orchestra.run.smithi008.stdout: "time": "2023-08-01T19:55:05.569250+0000", 2023-08-01T19:55:08.354 INFO:teuthology.orchestra.run.smithi008.stdout: "duration": 5.3106000000000003e-05 2023-08-01T19:55:08.355 INFO:teuthology.orchestra.run.smithi008.stdout: }, 2023-08-01T19:55:08.355 INFO:teuthology.orchestra.run.smithi008.stdout: { 2023-08-01T19:55:08.355 INFO:teuthology.orchestra.run.smithi008.stdout: "event": "dispatched", 2023-08-01T19:55:08.355 INFO:teuthology.orchestra.run.smithi008.stdout: "time": "2023-08-01T19:55:05.569260+0000", 2023-08-01T19:55:08.355 INFO:teuthology.orchestra.run.smithi008.stdout: "duration": 9.533e-06 2023-08-01T19:55:08.355 INFO:teuthology.orchestra.run.smithi008.stdout: }, 2023-08-01T19:55:08.355 INFO:teuthology.orchestra.run.smithi008.stdout: { 2023-08-01T19:55:08.355 INFO:teuthology.orchestra.run.smithi008.stdout: "event": "queued_for_pg", 2023-08-01T19:55:08.356 INFO:teuthology.orchestra.run.smithi008.stdout: "time": "2023-08-01T19:55:05.569264+0000", 2023-08-01T19:55:08.356 INFO:teuthology.orchestra.run.smithi008.stdout: "duration": 4.6099999999999999e-06 2023-08-01T19:55:08.356 INFO:teuthology.orchestra.run.smithi008.stdout: }, 2023-08-01T19:55:08.356 INFO:teuthology.orchestra.run.smithi008.stdout: { 2023-08-01T19:55:08.356 INFO:teuthology.orchestra.run.smithi008.stdout: "event": "reached_pg", 2023-08-01T19:55:08.356 INFO:teuthology.orchestra.run.smithi008.stdout: "time": "2023-08-01T19:55:05.569293+0000", 2023-08-01T19:55:08.356 INFO:teuthology.orchestra.run.smithi008.stdout: "duration": 2.8181999999999999e-05 2023-08-01T19:55:08.356 INFO:teuthology.orchestra.run.smithi008.stdout: }, 2023-08-01T19:55:08.357 INFO:teuthology.orchestra.run.smithi008.stdout: { 2023-08-01T19:55:08.357 INFO:teuthology.orchestra.run.smithi008.stdout: "event": "started", 2023-08-01T19:55:08.357 INFO:teuthology.orchestra.run.smithi008.stdout: "time": "2023-08-01T19:55:05.569401+0000", 2023-08-01T19:55:08.357 INFO:teuthology.orchestra.run.smithi008.stdout: "duration": 0.000108065 2023-08-01T19:55:08.357 INFO:teuthology.orchestra.run.smithi008.stdout: }, 2023-08-01T19:55:08.357 INFO:teuthology.orchestra.run.smithi008.stdout: { 2023-08-01T19:55:08.357 INFO:teuthology.orchestra.run.smithi008.stdout: "event": "waiting for subops from 1", 2023-08-01T19:55:08.358 INFO:teuthology.orchestra.run.smithi008.stdout: "time": "2023-08-01T19:55:05.569521+0000", 2023-08-01T19:55:08.358 INFO:teuthology.orchestra.run.smithi008.stdout: "duration": 0.00012006900000000001 2023-08-01T19:55:08.358 INFO:teuthology.orchestra.run.smithi008.stdout: }, 2023-08-01T19:55:08.358 INFO:teuthology.orchestra.run.smithi008.stdout: { 2023-08-01T19:55:08.358 INFO:teuthology.orchestra.run.smithi008.stdout: "event": "sub_op_commit_rec", 2023-08-01T19:55:08.358 INFO:teuthology.orchestra.run.smithi008.stdout: "time": "2023-08-01T19:55:05.629421+0000", 2023-08-01T19:55:08.358 INFO:teuthology.orchestra.run.smithi008.stdout: "duration": 0.059900525000000003 2023-08-01T19:55:08.358 INFO:teuthology.orchestra.run.smithi008.stdout: }, 2023-08-01T19:55:08.359 INFO:teuthology.orchestra.run.smithi008.stdout: { 2023-08-01T19:55:08.359 INFO:teuthology.orchestra.run.smithi008.stdout: "event": "op_commit", 2023-08-01T19:55:08.359 INFO:teuthology.orchestra.run.smithi008.stdout: "time": "2023-08-01T19:55:05.632461+0000", 2023-08-01T19:55:08.359 INFO:teuthology.orchestra.run.smithi008.stdout: "duration": 0.0030401220000000001 2023-08-01T19:55:08.359 INFO:teuthology.orchestra.run.smithi008.stdout: }, 2023-08-01T19:55:08.359 INFO:teuthology.orchestra.run.smithi008.stdout: { 2023-08-01T19:55:08.359 INFO:teuthology.orchestra.run.smithi008.stdout: "event": "commit_sent", 2023-08-01T19:55:08.359 INFO:teuthology.orchestra.run.smithi008.stdout: "time": "2023-08-01T19:55:05.632507+0000", 2023-08-01T19:55:08.360 INFO:teuthology.orchestra.run.smithi008.stdout: "duration": 4.5361999999999997e-05 2023-08-01T19:55:08.360 INFO:teuthology.orchestra.run.smithi008.stdout: }, 2023-08-01T19:55:08.360 INFO:teuthology.orchestra.run.smithi008.stdout: { 2023-08-01T19:55:08.360 INFO:teuthology.orchestra.run.smithi008.stdout: "event": "done", 2023-08-01T19:55:08.360 INFO:teuthology.orchestra.run.smithi008.stdout: "time": "2023-08-01T19:55:05.632547+0000", 2023-08-01T19:55:08.360 INFO:teuthology.orchestra.run.smithi008.stdout: "duration": 4.0760999999999998e-05 2023-08-01T19:55:08.360 INFO:teuthology.orchestra.run.smithi008.stdout: } 2023-08-01T19:55:08.360 INFO:teuthology.orchestra.run.smithi008.stdout: ] 2023-08-01T19:55:08.361 INFO:teuthology.orchestra.run.smithi008.stdout: } 2023-08-01T19:55:08.361 INFO:teuthology.orchestra.run.smithi008.stdout: }, 2023-08-01T19:55:08.361 INFO:teuthology.orchestra.run.smithi008.stdout: { 2023-08-01T19:55:08.361 INFO:teuthology.orchestra.run.smithi008.stdout: "description": "osd_op(client.4668.0:100939 5.5 5:a75fa6e3:::benchmark_data_smithi006_114134_object100938:head [set-alloc-hint object_size 65536 write_size 65536,write 0~65536] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e37)", 2023-08-01T19:55:08.361 INFO:teuthology.orchestra.run.smithi008.stdout: "initiated_at": "2023-08-01T19:55:05.569740+0000", 2023-08-01T19:55:08.361 INFO:teuthology.orchestra.run.smithi008.stdout: "age": 2.5864753409999999, 2023-08-01T19:55:08.361 INFO:teuthology.orchestra.run.smithi008.stdout: "duration": 0.067753412999999998, 2023-08-01T19:55:08.361 INFO:teuthology.orchestra.run.smithi008.stdout: "type_data": { 2023-08-01T19:55:08.362 INFO:teuthology.orchestra.run.smithi008.stdout: "flag_point": "commit sent; apply or cleanup", 2023-08-01T19:55:08.362 INFO:teuthology.orchestra.run.smithi008.stdout: "client_info": { 2023-08-01T19:55:08.362 INFO:teuthology.orchestra.run.smithi008.stdout: "client": "client.4668", 2023-08-01T19:55:08.362 INFO:teuthology.orchestra.run.smithi008.stdout: "client_addr": "172.21.15.6:0/1709472247", 2023-08-01T19:55:08.362 INFO:teuthology.orchestra.run.smithi008.stdout: "tid": 100939 2023-08-01T19:55:08.362 INFO:teuthology.orchestra.run.smithi008.stdout: }, 2023-08-01T19:55:08.362 INFO:teuthology.orchestra.run.smithi008.stdout: "events": [ 2023-08-01T19:55:08.362 INFO:teuthology.orchestra.run.smithi008.stdout: { 2023-08-01T19:55:08.363 INFO:teuthology.orchestra.run.smithi008.stdout: "event": "initiated", 2023-08-01T19:55:08.363 INFO:teuthology.orchestra.run.smithi008.stdout: "time": "2023-08-01T19:55:05.569740+0000", 2023-08-01T19:55:08.363 INFO:teuthology.orchestra.run.smithi008.stdout: "duration": 0 2023-08-01T19:55:08.363 INFO:teuthology.orchestra.run.smithi008.stdout: }, 2023-08-01T19:55:08.363 INFO:teuthology.orchestra.run.smithi008.stdout: { 2023-08-01T19:55:08.363 INFO:teuthology.orchestra.run.smithi008.stdout: "event": "throttled", 2023-08-01T19:55:08.363 INFO:teuthology.orchestra.run.smithi008.stdout: "time": "2023-08-01T19:55:05.569740+0000", 2023-08-01T19:55:08.363 INFO:teuthology.orchestra.run.smithi008.stdout: "duration": 0 2023-08-01T19:55:08.364 INFO:teuthology.orchestra.run.smithi008.stdout: }, 2023-08-01T19:55:08.364 INFO:teuthology.orchestra.run.smithi008.stdout: { 2023-08-01T19:55:08.364 INFO:teuthology.orchestra.run.smithi008.stdout: "event": "header_read", 2023-08-01T19:55:08.364 INFO:teuthology.orchestra.run.smithi008.stdout: "time": "2023-08-01T19:55:05.569739+0000", 2023-08-01T19:55:08.364 INFO:teuthology.orchestra.run.smithi008.stdout: "duration": 4294967295.9999995 2023-08-01T19:55:08.364 INFO:teuthology.orchestra.run.smithi008.stdout: }, 2023-08-01T19:55:08.364 INFO:teuthology.orchestra.run.smithi008.stdout: { 2023-08-01T19:55:08.365 INFO:teuthology.orchestra.run.smithi008.stdout: "event": "all_read", 2023-08-01T19:55:08.365 INFO:teuthology.orchestra.run.smithi008.stdout: "time": "2023-08-01T19:55:05.569839+0000", 2023-08-01T19:55:08.365 INFO:teuthology.orchestra.run.smithi008.stdout: "duration": 0.000100219 2023-08-01T19:55:08.365 INFO:teuthology.orchestra.run.smithi008.stdout: }, 2023-08-01T19:55:08.365 INFO:teuthology.orchestra.run.smithi008.stdout: { 2023-08-01T19:55:08.365 INFO:teuthology.orchestra.run.smithi008.stdout: "event": "dispatched", 2023-08-01T19:55:08.365 INFO:teuthology.orchestra.run.smithi008.stdout: "time": "2023-08-01T19:55:05.569846+0000", 2023-08-01T19:55:08.365 INFO:teuthology.orchestra.run.smithi008.stdout: "duration": 7.3150000000000003e-06 2023-08-01T19:55:08.366 INFO:teuthology.orchestra.run.smithi008.stdout: }, 2023-08-01T19:55:08.366 INFO:teuthology.orchestra.run.smithi008.stdout: { 2023-08-01T19:55:08.366 INFO:teuthology.orchestra.run.smithi008.stdout: "event": "queued_for_pg", 2023-08-01T19:55:08.366 INFO:teuthology.orchestra.run.smithi008.stdout: "time": "2023-08-01T19:55:05.569850+0000", 2023-08-01T19:55:08.366 INFO:teuthology.orchestra.run.smithi008.stdout: "duration": 3.3299999999999999e-06 2023-08-01T19:55:08.366 INFO:teuthology.orchestra.run.smithi008.stdout: }, 2023-08-01T19:55:08.366 INFO:teuthology.orchestra.run.smithi008.stdout: { 2023-08-01T19:55:08.366 INFO:teuthology.orchestra.run.smithi008.stdout: "event": "reached_pg", 2023-08-01T19:55:08.367 INFO:teuthology.orchestra.run.smithi008.stdout: "time": "2023-08-01T19:55:05.626991+0000", 2023-08-01T19:55:08.367 INFO:teuthology.orchestra.run.smithi008.stdout: "duration": 0.057141585000000002 2023-08-01T19:55:08.367 INFO:teuthology.orchestra.run.smithi008.stdout: }, 2023-08-01T19:55:08.367 INFO:teuthology.orchestra.run.smithi008.stdout: { 2023-08-01T19:55:08.367 INFO:teuthology.orchestra.run.smithi008.stdout: "event": "started", 2023-08-01T19:55:08.367 INFO:teuthology.orchestra.run.smithi008.stdout: "time": "2023-08-01T19:55:05.627111+0000", 2023-08-01T19:55:08.367 INFO:teuthology.orchestra.run.smithi008.stdout: "duration": 0.000119238 2023-08-01T19:55:08.367 INFO:teuthology.orchestra.run.smithi008.stdout: }, 2023-08-01T19:55:08.368 INFO:teuthology.orchestra.run.smithi008.stdout: { 2023-08-01T19:55:08.368 INFO:teuthology.orchestra.run.smithi008.stdout: "event": "waiting for subops from 1", 2023-08-01T19:55:08.368 INFO:teuthology.orchestra.run.smithi008.stdout: "time": "2023-08-01T19:55:05.627253+0000", 2023-08-01T19:55:08.368 INFO:teuthology.orchestra.run.smithi008.stdout: "duration": 0.000142822 2023-08-01T19:55:08.368 INFO:teuthology.orchestra.run.smithi008.stdout: }, 2023-08-01T19:55:08.368 INFO:teuthology.orchestra.run.smithi008.stdout: { 2023-08-01T19:55:08.368 INFO:teuthology.orchestra.run.smithi008.stdout: "event": "op_commit", 2023-08-01T19:55:08.369 INFO:teuthology.orchestra.run.smithi008.stdout: "time": "2023-08-01T19:55:05.632555+0000", 2023-08-01T19:55:08.369 INFO:teuthology.orchestra.run.smithi008.stdout: "duration": 0.0053012449999999996 2023-08-01T19:55:08.369 INFO:teuthology.orchestra.run.smithi008.stdout: }, 2023-08-01T19:55:08.369 INFO:teuthology.orchestra.run.smithi008.stdout: { 2023-08-01T19:55:08.369 INFO:teuthology.orchestra.run.smithi008.stdout: "event": "sub_op_commit_rec", 2023-08-01T19:55:08.369 INFO:teuthology.orchestra.run.smithi008.stdout: "time": "2023-08-01T19:55:05.637380+0000", 2023-08-01T19:55:08.369 INFO:teuthology.orchestra.run.smithi008.stdout: "duration": 0.0048257639999999997 2023-08-01T19:55:08.369 INFO:teuthology.orchestra.run.smithi008.stdout: }, 2023-08-01T19:55:08.370 INFO:teuthology.orchestra.run.smithi008.stdout: { 2023-08-01T19:55:08.370 INFO:teuthology.orchestra.run.smithi008.stdout: "event": "commit_sent", 2023-08-01T19:55:08.370 INFO:teuthology.orchestra.run.smithi008.stdout: "time": "2023-08-01T19:55:05.637454+0000", 2023-08-01T19:55:08.370 INFO:teuthology.orchestra.run.smithi008.stdout: "duration": 7.3578999999999995e-05 2023-08-01T19:55:08.370 INFO:teuthology.orchestra.run.smithi008.stdout: }, 2023-08-01T19:55:08.370 INFO:teuthology.orchestra.run.smithi008.stdout: { 2023-08-01T19:55:08.370 INFO:teuthology.orchestra.run.smithi008.stdout: "event": "done", 2023-08-01T19:55:08.370 INFO:teuthology.orchestra.run.smithi008.stdout: "time": "2023-08-01T19:55:05.637493+0000", 2023-08-01T19:55:08.371 INFO:teuthology.orchestra.run.smithi008.stdout: "duration": 3.8986999999999998e-05 2023-08-01T19:55:08.371 INFO:teuthology.orchestra.run.smithi008.stdout: } 2023-08-01T19:55:08.371 INFO:teuthology.orchestra.run.smithi008.stdout: ] 2023-08-01T19:55:08.371 INFO:teuthology.orchestra.run.smithi008.stdout: } 2023-08-01T19:55:08.371 INFO:teuthology.orchestra.run.smithi008.stdout: }, 2023-08-01T19:55:08.371 INFO:teuthology.orchestra.run.smithi008.stdout: { 2023-08-01T19:55:08.371 INFO:teuthology.orchestra.run.smithi008.stdout: "description": "osd_repop(client.4668.0:100941 5.e e37/19 5:736a6ac6:::benchmark_data_smithi006_114134_object100940:head v 37'6306, mlcod=37'6303)", 2023-08-01T19:55:08.371 INFO:teuthology.orchestra.run.smithi008.stdout: "initiated_at": "2023-08-01T19:55:05.570237+0000", 2023-08-01T19:55:08.372 INFO:teuthology.orchestra.run.smithi008.stdout: "age": 2.5859780309999998, 2023-08-01T19:55:08.372 INFO:teuthology.orchestra.run.smithi008.stdout: "duration": 0.064830421999999999, 2023-08-01T19:55:08.372 INFO:teuthology.orchestra.run.smithi008.stdout: "type_data": { 2023-08-01T19:55:08.372 INFO:teuthology.orchestra.run.smithi008.stdout: "flag_point": "commit sent; apply or cleanup", 2023-08-01T19:55:08.372 INFO:teuthology.orchestra.run.smithi008.stdout: "events": [ 2023-08-01T19:55:08.372 INFO:teuthology.orchestra.run.smithi008.stdout: { 2023-08-01T19:55:08.372 INFO:teuthology.orchestra.run.smithi008.stdout: "event": "initiated", 2023-08-01T19:55:08.372 INFO:teuthology.orchestra.run.smithi008.stdout: "time": "2023-08-01T19:55:05.570237+0000", 2023-08-01T19:55:08.373 INFO:teuthology.orchestra.run.smithi008.stdout: "duration": 0 2023-08-01T19:55:08.373 INFO:teuthology.orchestra.run.smithi008.stdout: }, 2023-08-01T19:55:08.373 INFO:teuthology.orchestra.run.smithi008.stdout: { 2023-08-01T19:55:08.373 INFO:teuthology.orchestra.run.smithi008.stdout: "event": "throttled", 2023-08-01T19:55:08.373 INFO:teuthology.orchestra.run.smithi008.stdout: "time": "2023-08-01T19:55:05.570237+0000", 2023-08-01T19:55:08.373 INFO:teuthology.orchestra.run.smithi008.stdout: "duration": 0 2023-08-01T19:55:08.373 INFO:teuthology.orchestra.run.smithi008.stdout: }, 2023-08-01T19:55:08.373 INFO:teuthology.orchestra.run.smithi008.stdout: { 2023-08-01T19:55:08.374 INFO:teuthology.orchestra.run.smithi008.stdout: "event": "header_read", 2023-08-01T19:55:08.374 INFO:teuthology.orchestra.run.smithi008.stdout: "time": "2023-08-01T19:55:05.570236+0000", 2023-08-01T19:55:08.374 INFO:teuthology.orchestra.run.smithi008.stdout: "duration": 4294967295.9999995 2023-08-01T19:55:08.374 INFO:teuthology.orchestra.run.smithi008.stdout: }, 2023-08-01T19:55:08.374 INFO:teuthology.orchestra.run.smithi008.stdout: { 2023-08-01T19:55:08.374 INFO:teuthology.orchestra.run.smithi008.stdout: "event": "all_read", 2023-08-01T19:55:08.374 INFO:teuthology.orchestra.run.smithi008.stdout: "time": "2023-08-01T19:55:05.570354+0000", 2023-08-01T19:55:08.375 INFO:teuthology.orchestra.run.smithi008.stdout: "duration": 0.000118029 2023-08-01T19:55:08.375 INFO:teuthology.orchestra.run.smithi008.stdout: }, 2023-08-01T19:55:08.375 INFO:teuthology.orchestra.run.smithi008.stdout: { 2023-08-01T19:55:08.375 INFO:teuthology.orchestra.run.smithi008.stdout: "event": "dispatched", 2023-08-01T19:55:08.375 INFO:teuthology.orchestra.run.smithi008.stdout: "time": "2023-08-01T19:55:05.626649+0000", 2023-08-01T19:55:08.375 INFO:teuthology.orchestra.run.smithi008.stdout: "duration": 0.056294489000000003 2023-08-01T19:55:08.375 INFO:teuthology.orchestra.run.smithi008.stdout: }, 2023-08-01T19:55:08.375 INFO:teuthology.orchestra.run.smithi008.stdout: { 2023-08-01T19:55:08.376 INFO:teuthology.orchestra.run.smithi008.stdout: "event": "queued_for_pg", 2023-08-01T19:55:08.376 INFO:teuthology.orchestra.run.smithi008.stdout: "time": "2023-08-01T19:55:05.626676+0000", 2023-08-01T19:55:08.376 INFO:teuthology.orchestra.run.smithi008.stdout: "duration": 2.7228000000000001e-05 2023-08-01T19:55:08.376 INFO:teuthology.orchestra.run.smithi008.stdout: }, 2023-08-01T19:55:08.376 INFO:teuthology.orchestra.run.smithi008.stdout: { 2023-08-01T19:55:08.376 INFO:teuthology.orchestra.run.smithi008.stdout: "event": "reached_pg", 2023-08-01T19:55:08.376 INFO:teuthology.orchestra.run.smithi008.stdout: "time": "2023-08-01T19:55:05.626717+0000", 2023-08-01T19:55:08.376 INFO:teuthology.orchestra.run.smithi008.stdout: "duration": 4.1318e-05 2023-08-01T19:55:08.377 INFO:teuthology.orchestra.run.smithi008.stdout: }, 2023-08-01T19:55:08.377 INFO:teuthology.orchestra.run.smithi008.stdout: { 2023-08-01T19:55:08.377 INFO:teuthology.orchestra.run.smithi008.stdout: "event": "started", 2023-08-01T19:55:08.377 INFO:teuthology.orchestra.run.smithi008.stdout: "time": "2023-08-01T19:55:05.626737+0000", 2023-08-01T19:55:08.377 INFO:teuthology.orchestra.run.smithi008.stdout: "duration": 1.9415e-05 2023-08-01T19:55:08.377 INFO:teuthology.orchestra.run.smithi008.stdout: }, 2023-08-01T19:55:08.377 INFO:teuthology.orchestra.run.smithi008.stdout: { 2023-08-01T19:55:08.377 INFO:teuthology.orchestra.run.smithi008.stdout: "event": "commit_sent", 2023-08-01T19:55:08.378 INFO:teuthology.orchestra.run.smithi008.stdout: "time": "2023-08-01T19:55:05.635036+0000", 2023-08-01T19:55:08.378 INFO:teuthology.orchestra.run.smithi008.stdout: "duration": 0.0082987700000000005 2023-08-01T19:55:08.378 INFO:teuthology.orchestra.run.smithi008.stdout: }, 2023-08-01T19:55:08.378 INFO:teuthology.orchestra.run.smithi008.stdout: { 2023-08-01T19:55:08.378 INFO:teuthology.orchestra.run.smithi008.stdout: "event": "done", 2023-08-01T19:55:08.378 INFO:teuthology.orchestra.run.smithi008.stdout: "time": "2023-08-01T19:55:05.635067+0000", 2023-08-01T19:55:08.378 INFO:teuthology.orchestra.run.smithi008.stdout: "duration": 3.1786999999999999e-05 2023-08-01T19:55:08.378 INFO:teuthology.orchestra.run.smithi008.stdout: } 2023-08-01T19:55:08.379 INFO:teuthology.orchestra.run.smithi008.stdout: ] 2023-08-01T19:55:08.379 INFO:teuthology.orchestra.run.smithi008.stdout: } 2023-08-01T19:55:08.379 INFO:teuthology.orchestra.run.smithi008.stdout: } 2023-08-01T19:55:08.379 INFO:teuthology.orchestra.run.smithi008.stdout: ] 2023-08-01T19:55:08.379 INFO:teuthology.orchestra.run.smithi008.stdout:} 2023-08-01T19:55:08.380 INFO:tasks.radosbench.radosbench.0.smithi006.stdout: 44 16 105989 105973 150.518 117.312 0.00511896 0.00664088 2023-08-01T19:55:08.381 DEBUG:teuthology.orchestra.run.smithi101:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 30 ceph --cluster ceph --admin-daemon /var/run/ceph/ceph-osd.1.asok dump_ops_in_flight 2023-08-01T19:55:08.382 INFO:tasks.ceph.osd.0.smithi008.stderr:2023-08-01T19:55:08.379+0000 7f16a58f4700 -1 received signal: Hangup from /usr/bin/python3 /bin/daemon-helper kill ceph-osd -f --cluster ceph -i 0 (PID: 111179) UID: 0 2023-08-01T19:55:08.481 INFO:tasks.ceph.osd.1.smithi101.stderr:2023-08-01T19:55:08.480+0000 7fb0cb7f6700 -1 received signal: Hangup from /usr/bin/python3 /bin/daemon-helper kill ceph-osd -f --cluster ceph -i 1 (PID: 111141) UID: 0 2023-08-01T19:55:08.553 INFO:teuthology.orchestra.run.smithi101.stdout:{ 2023-08-01T19:55:08.553 INFO:teuthology.orchestra.run.smithi101.stdout: "ops": [ 2023-08-01T19:55:08.554 INFO:teuthology.orchestra.run.smithi101.stdout: { 2023-08-01T19:55:08.554 INFO:teuthology.orchestra.run.smithi101.stdout: "description": "osd_op(client.4668.0:106413 5.7 5:e39ff626:::benchmark_data_smithi006_114134_object106412:head [set-alloc-hint object_size 65536 write_size 65536,write 0~65536 in=65536b] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e38)", 2023-08-01T19:55:08.554 INFO:teuthology.orchestra.run.smithi101.stdout: "initiated_at": "2023-08-01T19:55:08.541090+0000", 2023-08-01T19:55:08.554 INFO:teuthology.orchestra.run.smithi101.stdout: "age": 0.010570506, 2023-08-01T19:55:08.554 INFO:teuthology.orchestra.run.smithi101.stdout: "duration": 0.010598155, 2023-08-01T19:55:08.554 INFO:teuthology.orchestra.run.smithi101.stdout: "type_data": { 2023-08-01T19:55:08.554 INFO:teuthology.orchestra.run.smithi101.stdout: "flag_point": "waiting for sub ops", 2023-08-01T19:55:08.555 INFO:teuthology.orchestra.run.smithi101.stdout: "client_info": { 2023-08-01T19:55:08.555 INFO:teuthology.orchestra.run.smithi101.stdout: "client": "client.4668", 2023-08-01T19:55:08.555 INFO:teuthology.orchestra.run.smithi101.stdout: "client_addr": "172.21.15.6:0/1709472247", 2023-08-01T19:55:08.555 INFO:teuthology.orchestra.run.smithi101.stdout: "tid": 106413 2023-08-01T19:55:08.555 INFO:teuthology.orchestra.run.smithi101.stdout: }, 2023-08-01T19:55:08.555 INFO:teuthology.orchestra.run.smithi101.stdout: "events": [ 2023-08-01T19:55:08.555 INFO:teuthology.orchestra.run.smithi101.stdout: { 2023-08-01T19:55:08.556 INFO:teuthology.orchestra.run.smithi101.stdout: "event": "initiated", 2023-08-01T19:55:08.556 INFO:teuthology.orchestra.run.smithi101.stdout: "time": "2023-08-01T19:55:08.541090+0000", 2023-08-01T19:55:08.556 INFO:teuthology.orchestra.run.smithi101.stdout: "duration": 0 2023-08-01T19:55:08.556 INFO:teuthology.orchestra.run.smithi101.stdout: }, 2023-08-01T19:55:08.556 INFO:teuthology.orchestra.run.smithi101.stdout: { 2023-08-01T19:55:08.556 INFO:teuthology.orchestra.run.smithi101.stdout: "event": "throttled", 2023-08-01T19:55:08.556 INFO:teuthology.orchestra.run.smithi101.stdout: "time": "2023-08-01T19:55:08.541090+0000", 2023-08-01T19:55:08.556 INFO:teuthology.orchestra.run.smithi101.stdout: "duration": 0 2023-08-01T19:55:08.557 INFO:teuthology.orchestra.run.smithi101.stdout: }, 2023-08-01T19:55:08.557 INFO:teuthology.orchestra.run.smithi101.stdout: { 2023-08-01T19:55:08.557 INFO:teuthology.orchestra.run.smithi101.stdout: "event": "header_read", 2023-08-01T19:55:08.557 INFO:teuthology.orchestra.run.smithi101.stdout: "time": "2023-08-01T19:55:08.541089+0000", 2023-08-01T19:55:08.557 INFO:teuthology.orchestra.run.smithi101.stdout: "duration": 4294967295.999999 2023-08-01T19:55:08.557 INFO:teuthology.orchestra.run.smithi101.stdout: }, 2023-08-01T19:55:08.557 INFO:teuthology.orchestra.run.smithi101.stdout: { 2023-08-01T19:55:08.558 INFO:teuthology.orchestra.run.smithi101.stdout: "event": "all_read", 2023-08-01T19:55:08.558 INFO:teuthology.orchestra.run.smithi101.stdout: "time": "2023-08-01T19:55:08.541139+0000", 2023-08-01T19:55:08.558 INFO:teuthology.orchestra.run.smithi101.stdout: "duration": 5.0278999999999998e-05 2023-08-01T19:55:08.558 INFO:teuthology.orchestra.run.smithi101.stdout: }, 2023-08-01T19:55:08.558 INFO:teuthology.orchestra.run.smithi101.stdout: { 2023-08-01T19:55:08.558 INFO:teuthology.orchestra.run.smithi101.stdout: "event": "dispatched", 2023-08-01T19:55:08.558 INFO:teuthology.orchestra.run.smithi101.stdout: "time": "2023-08-01T19:55:08.541151+0000", 2023-08-01T19:55:08.558 INFO:teuthology.orchestra.run.smithi101.stdout: "duration": 1.1711e-05 2023-08-01T19:55:08.559 INFO:teuthology.orchestra.run.smithi101.stdout: }, 2023-08-01T19:55:08.559 INFO:teuthology.orchestra.run.smithi101.stdout: { 2023-08-01T19:55:08.559 INFO:teuthology.orchestra.run.smithi101.stdout: "event": "queued_for_pg", 2023-08-01T19:55:08.559 INFO:teuthology.orchestra.run.smithi101.stdout: "time": "2023-08-01T19:55:08.541157+0000", 2023-08-01T19:55:08.559 INFO:teuthology.orchestra.run.smithi101.stdout: "duration": 6.178e-06 2023-08-01T19:55:08.559 INFO:teuthology.orchestra.run.smithi101.stdout: }, 2023-08-01T19:55:08.559 INFO:teuthology.orchestra.run.smithi101.stdout: { 2023-08-01T19:55:08.559 INFO:teuthology.orchestra.run.smithi101.stdout: "event": "reached_pg", 2023-08-01T19:55:08.560 INFO:teuthology.orchestra.run.smithi101.stdout: "time": "2023-08-01T19:55:08.541196+0000", 2023-08-01T19:55:08.560 INFO:teuthology.orchestra.run.smithi101.stdout: "duration": 3.8832999999999999e-05 2023-08-01T19:55:08.560 INFO:teuthology.orchestra.run.smithi101.stdout: }, 2023-08-01T19:55:08.560 INFO:teuthology.orchestra.run.smithi101.stdout: { 2023-08-01T19:55:08.560 INFO:teuthology.orchestra.run.smithi101.stdout: "event": "started", 2023-08-01T19:55:08.560 INFO:teuthology.orchestra.run.smithi101.stdout: "time": "2023-08-01T19:55:08.541293+0000", 2023-08-01T19:55:08.560 INFO:teuthology.orchestra.run.smithi101.stdout: "duration": 9.6693000000000004e-05 2023-08-01T19:55:08.560 INFO:teuthology.orchestra.run.smithi101.stdout: }, 2023-08-01T19:55:08.561 INFO:teuthology.orchestra.run.smithi101.stdout: { 2023-08-01T19:55:08.561 INFO:teuthology.orchestra.run.smithi101.stdout: "event": "waiting for subops from 0", 2023-08-01T19:55:08.561 INFO:teuthology.orchestra.run.smithi101.stdout: "time": "2023-08-01T19:55:08.541379+0000", 2023-08-01T19:55:08.561 INFO:teuthology.orchestra.run.smithi101.stdout: "duration": 8.6953999999999995e-05 2023-08-01T19:55:08.561 INFO:teuthology.orchestra.run.smithi101.stdout: }, 2023-08-01T19:55:08.561 INFO:teuthology.orchestra.run.smithi101.stdout: { 2023-08-01T19:55:08.561 INFO:teuthology.orchestra.run.smithi101.stdout: "event": "op_commit", 2023-08-01T19:55:08.562 INFO:teuthology.orchestra.run.smithi101.stdout: "time": "2023-08-01T19:55:08.548870+0000", 2023-08-01T19:55:08.562 INFO:teuthology.orchestra.run.smithi101.stdout: "duration": 0.0074904960000000001 2023-08-01T19:55:08.562 INFO:teuthology.orchestra.run.smithi101.stdout: } 2023-08-01T19:55:08.562 INFO:teuthology.orchestra.run.smithi101.stdout: ] 2023-08-01T19:55:08.562 INFO:teuthology.orchestra.run.smithi101.stdout: } 2023-08-01T19:55:08.562 INFO:teuthology.orchestra.run.smithi101.stdout: }, 2023-08-01T19:55:08.562 INFO:teuthology.orchestra.run.smithi101.stdout: { 2023-08-01T19:55:08.562 INFO:teuthology.orchestra.run.smithi101.stdout: "description": "osd_op(client.4668.0:106423 5.f 5:fdff5210:::benchmark_data_smithi006_114134_object106422:head [set-alloc-hint object_size 65536 write_size 65536,write 0~65536 in=65536b] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e38)", 2023-08-01T19:55:08.563 INFO:teuthology.orchestra.run.smithi101.stdout: "initiated_at": "2023-08-01T19:55:08.544620+0000", 2023-08-01T19:55:08.563 INFO:teuthology.orchestra.run.smithi101.stdout: "age": 0.0070410079999999996, 2023-08-01T19:55:08.563 INFO:teuthology.orchestra.run.smithi101.stdout: "duration": 0.0071351039999999998, 2023-08-01T19:55:08.563 INFO:teuthology.orchestra.run.smithi101.stdout: "type_data": { 2023-08-01T19:55:08.563 INFO:teuthology.orchestra.run.smithi101.stdout: "flag_point": "waiting for sub ops", 2023-08-01T19:55:08.563 INFO:teuthology.orchestra.run.smithi101.stdout: "client_info": { 2023-08-01T19:55:08.563 INFO:teuthology.orchestra.run.smithi101.stdout: "client": "client.4668", 2023-08-01T19:55:08.563 INFO:teuthology.orchestra.run.smithi101.stdout: "client_addr": "172.21.15.6:0/1709472247", 2023-08-01T19:55:08.564 INFO:teuthology.orchestra.run.smithi101.stdout: "tid": 106423 2023-08-01T19:55:08.564 INFO:teuthology.orchestra.run.smithi101.stdout: }, 2023-08-01T19:55:08.564 INFO:teuthology.orchestra.run.smithi101.stdout: "events": [ 2023-08-01T19:55:08.564 INFO:teuthology.orchestra.run.smithi101.stdout: { 2023-08-01T19:55:08.564 INFO:teuthology.orchestra.run.smithi101.stdout: "event": "initiated", 2023-08-01T19:55:08.564 INFO:teuthology.orchestra.run.smithi101.stdout: "time": "2023-08-01T19:55:08.544620+0000", 2023-08-01T19:55:08.564 INFO:teuthology.orchestra.run.smithi101.stdout: "duration": 0 2023-08-01T19:55:08.564 INFO:teuthology.orchestra.run.smithi101.stdout: }, 2023-08-01T19:55:08.565 INFO:teuthology.orchestra.run.smithi101.stdout: { 2023-08-01T19:55:08.565 INFO:teuthology.orchestra.run.smithi101.stdout: "event": "throttled", 2023-08-01T19:55:08.565 INFO:teuthology.orchestra.run.smithi101.stdout: "time": "2023-08-01T19:55:08.544620+0000", 2023-08-01T19:55:08.565 INFO:teuthology.orchestra.run.smithi101.stdout: "duration": 0 2023-08-01T19:55:08.565 INFO:teuthology.orchestra.run.smithi101.stdout: }, 2023-08-01T19:55:08.565 INFO:teuthology.orchestra.run.smithi101.stdout: { 2023-08-01T19:55:08.565 INFO:teuthology.orchestra.run.smithi101.stdout: "event": "header_read", 2023-08-01T19:55:08.565 INFO:teuthology.orchestra.run.smithi101.stdout: "time": "2023-08-01T19:55:08.544619+0000", 2023-08-01T19:55:08.566 INFO:teuthology.orchestra.run.smithi101.stdout: "duration": 4294967295.999999 2023-08-01T19:55:08.566 INFO:teuthology.orchestra.run.smithi101.stdout: }, 2023-08-01T19:55:08.566 INFO:teuthology.orchestra.run.smithi101.stdout: { 2023-08-01T19:55:08.566 INFO:teuthology.orchestra.run.smithi101.stdout: "event": "all_read", 2023-08-01T19:55:08.566 INFO:teuthology.orchestra.run.smithi101.stdout: "time": "2023-08-01T19:55:08.544709+0000", 2023-08-01T19:55:08.566 INFO:teuthology.orchestra.run.smithi101.stdout: "duration": 9.0444000000000003e-05 2023-08-01T19:55:08.566 INFO:teuthology.orchestra.run.smithi101.stdout: }, 2023-08-01T19:55:08.567 INFO:teuthology.orchestra.run.smithi101.stdout: { 2023-08-01T19:55:08.567 INFO:teuthology.orchestra.run.smithi101.stdout: "event": "dispatched", 2023-08-01T19:55:08.567 INFO:teuthology.orchestra.run.smithi101.stdout: "time": "2023-08-01T19:55:08.544722+0000", 2023-08-01T19:55:08.567 INFO:teuthology.orchestra.run.smithi101.stdout: "duration": 1.2515e-05 2023-08-01T19:55:08.567 INFO:teuthology.orchestra.run.smithi101.stdout: }, 2023-08-01T19:55:08.567 INFO:teuthology.orchestra.run.smithi101.stdout: { 2023-08-01T19:55:08.567 INFO:teuthology.orchestra.run.smithi101.stdout: "event": "queued_for_pg", 2023-08-01T19:55:08.567 INFO:teuthology.orchestra.run.smithi101.stdout: "time": "2023-08-01T19:55:08.544730+0000", 2023-08-01T19:55:08.568 INFO:teuthology.orchestra.run.smithi101.stdout: "duration": 7.8939999999999993e-06 2023-08-01T19:55:08.568 INFO:teuthology.orchestra.run.smithi101.stdout: }, 2023-08-01T19:55:08.568 INFO:teuthology.orchestra.run.smithi101.stdout: { 2023-08-01T19:55:08.568 INFO:teuthology.orchestra.run.smithi101.stdout: "event": "reached_pg", 2023-08-01T19:55:08.568 INFO:teuthology.orchestra.run.smithi101.stdout: "time": "2023-08-01T19:55:08.544765+0000", 2023-08-01T19:55:08.568 INFO:teuthology.orchestra.run.smithi101.stdout: "duration": 3.5794999999999999e-05 2023-08-01T19:55:08.568 INFO:teuthology.orchestra.run.smithi101.stdout: }, 2023-08-01T19:55:08.568 INFO:teuthology.orchestra.run.smithi101.stdout: { 2023-08-01T19:55:08.569 INFO:teuthology.orchestra.run.smithi101.stdout: "event": "started", 2023-08-01T19:55:08.569 INFO:teuthology.orchestra.run.smithi101.stdout: "time": "2023-08-01T19:55:08.544885+0000", 2023-08-01T19:55:08.569 INFO:teuthology.orchestra.run.smithi101.stdout: "duration": 0.000119772 2023-08-01T19:55:08.569 INFO:teuthology.orchestra.run.smithi101.stdout: }, 2023-08-01T19:55:08.569 INFO:teuthology.orchestra.run.smithi101.stdout: { 2023-08-01T19:55:08.569 INFO:teuthology.orchestra.run.smithi101.stdout: "event": "waiting for subops from 2", 2023-08-01T19:55:08.569 INFO:teuthology.orchestra.run.smithi101.stdout: "time": "2023-08-01T19:55:08.545038+0000", 2023-08-01T19:55:08.569 INFO:teuthology.orchestra.run.smithi101.stdout: "duration": 0.000152793 2023-08-01T19:55:08.570 INFO:teuthology.orchestra.run.smithi101.stdout: }, 2023-08-01T19:55:08.570 INFO:teuthology.orchestra.run.smithi101.stdout: { 2023-08-01T19:55:08.570 INFO:teuthology.orchestra.run.smithi101.stdout: "event": "op_commit", 2023-08-01T19:55:08.570 INFO:teuthology.orchestra.run.smithi101.stdout: "time": "2023-08-01T19:55:08.548892+0000", 2023-08-01T19:55:08.570 INFO:teuthology.orchestra.run.smithi101.stdout: "duration": 0.0038535269999999998 2023-08-01T19:55:08.570 INFO:teuthology.orchestra.run.smithi101.stdout: } 2023-08-01T19:55:08.570 INFO:teuthology.orchestra.run.smithi101.stdout: ] 2023-08-01T19:55:08.570 INFO:teuthology.orchestra.run.smithi101.stdout: } 2023-08-01T19:55:08.571 INFO:teuthology.orchestra.run.smithi101.stdout: }, 2023-08-01T19:55:08.571 INFO:teuthology.orchestra.run.smithi101.stdout: { 2023-08-01T19:55:08.571 INFO:teuthology.orchestra.run.smithi101.stdout: "description": "osd_op(client.4668.0:106424 5.7 5:e3a286cb:::benchmark_data_smithi006_114134_object106423:head [set-alloc-hint object_size 65536 write_size 65536,write 0~65536 in=65536b] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e38)", 2023-08-01T19:55:08.571 INFO:teuthology.orchestra.run.smithi101.stdout: "initiated_at": "2023-08-01T19:55:08.546556+0000", 2023-08-01T19:55:08.571 INFO:teuthology.orchestra.run.smithi101.stdout: "age": 0.0051045819999999999, 2023-08-01T19:55:08.571 INFO:teuthology.orchestra.run.smithi101.stdout: "duration": 0.0052611580000000002, 2023-08-01T19:55:08.571 INFO:teuthology.orchestra.run.smithi101.stdout: "type_data": { 2023-08-01T19:55:08.571 INFO:teuthology.orchestra.run.smithi101.stdout: "flag_point": "waiting for sub ops", 2023-08-01T19:55:08.572 INFO:teuthology.orchestra.run.smithi101.stdout: "client_info": { 2023-08-01T19:55:08.572 INFO:teuthology.orchestra.run.smithi101.stdout: "client": "client.4668", 2023-08-01T19:55:08.572 INFO:teuthology.orchestra.run.smithi101.stdout: "client_addr": "172.21.15.6:0/1709472247", 2023-08-01T19:55:08.572 INFO:teuthology.orchestra.run.smithi101.stdout: "tid": 106424 2023-08-01T19:55:08.572 INFO:teuthology.orchestra.run.smithi101.stdout: }, 2023-08-01T19:55:08.572 INFO:teuthology.orchestra.run.smithi101.stdout: "events": [ 2023-08-01T19:55:08.572 INFO:teuthology.orchestra.run.smithi101.stdout: { 2023-08-01T19:55:08.573 INFO:teuthology.orchestra.run.smithi101.stdout: "event": "initiated", 2023-08-01T19:55:08.573 INFO:teuthology.orchestra.run.smithi101.stdout: "time": "2023-08-01T19:55:08.546556+0000", 2023-08-01T19:55:08.573 INFO:teuthology.orchestra.run.smithi101.stdout: "duration": 0 2023-08-01T19:55:08.573 INFO:teuthology.orchestra.run.smithi101.stdout: }, 2023-08-01T19:55:08.573 INFO:teuthology.orchestra.run.smithi101.stdout: { 2023-08-01T19:55:08.573 INFO:teuthology.orchestra.run.smithi101.stdout: "event": "throttled", 2023-08-01T19:55:08.573 INFO:teuthology.orchestra.run.smithi101.stdout: "time": "2023-08-01T19:55:08.546556+0000", 2023-08-01T19:55:08.573 INFO:teuthology.orchestra.run.smithi101.stdout: "duration": 0 2023-08-01T19:55:08.574 INFO:teuthology.orchestra.run.smithi101.stdout: }, 2023-08-01T19:55:08.574 INFO:teuthology.orchestra.run.smithi101.stdout: { 2023-08-01T19:55:08.574 INFO:teuthology.orchestra.run.smithi101.stdout: "event": "header_read", 2023-08-01T19:55:08.574 INFO:teuthology.orchestra.run.smithi101.stdout: "time": "2023-08-01T19:55:08.546555+0000", 2023-08-01T19:55:08.574 INFO:teuthology.orchestra.run.smithi101.stdout: "duration": 4294967295.999999 2023-08-01T19:55:08.574 INFO:teuthology.orchestra.run.smithi101.stdout: }, 2023-08-01T19:55:08.574 INFO:teuthology.orchestra.run.smithi101.stdout: { 2023-08-01T19:55:08.574 INFO:teuthology.orchestra.run.smithi101.stdout: "event": "all_read", 2023-08-01T19:55:08.575 INFO:teuthology.orchestra.run.smithi101.stdout: "time": "2023-08-01T19:55:08.546625+0000", 2023-08-01T19:55:08.575 INFO:teuthology.orchestra.run.smithi101.stdout: "duration": 7.0528e-05 2023-08-01T19:55:08.575 INFO:teuthology.orchestra.run.smithi101.stdout: }, 2023-08-01T19:55:08.575 INFO:teuthology.orchestra.run.smithi101.stdout: { 2023-08-01T19:55:08.575 INFO:teuthology.orchestra.run.smithi101.stdout: "event": "dispatched", 2023-08-01T19:55:08.575 INFO:teuthology.orchestra.run.smithi101.stdout: "time": "2023-08-01T19:55:08.546643+0000", 2023-08-01T19:55:08.575 INFO:teuthology.orchestra.run.smithi101.stdout: "duration": 1.7757999999999998e-05 2023-08-01T19:55:08.575 INFO:teuthology.orchestra.run.smithi101.stdout: }, 2023-08-01T19:55:08.576 INFO:teuthology.orchestra.run.smithi101.stdout: { 2023-08-01T19:55:08.576 INFO:teuthology.orchestra.run.smithi101.stdout: "event": "queued_for_pg", 2023-08-01T19:55:08.576 INFO:teuthology.orchestra.run.smithi101.stdout: "time": "2023-08-01T19:55:08.546651+0000", 2023-08-01T19:55:08.576 INFO:teuthology.orchestra.run.smithi101.stdout: "duration": 7.8220000000000007e-06 2023-08-01T19:55:08.576 INFO:teuthology.orchestra.run.smithi101.stdout: }, 2023-08-01T19:55:08.576 INFO:teuthology.orchestra.run.smithi101.stdout: { 2023-08-01T19:55:08.576 INFO:teuthology.orchestra.run.smithi101.stdout: "event": "reached_pg", 2023-08-01T19:55:08.576 INFO:teuthology.orchestra.run.smithi101.stdout: "time": "2023-08-01T19:55:08.546694+0000", 2023-08-01T19:55:08.577 INFO:teuthology.orchestra.run.smithi101.stdout: "duration": 4.2781000000000003e-05 2023-08-01T19:55:08.577 INFO:teuthology.orchestra.run.smithi101.stdout: }, 2023-08-01T19:55:08.577 INFO:teuthology.orchestra.run.smithi101.stdout: { 2023-08-01T19:55:08.577 INFO:teuthology.orchestra.run.smithi101.stdout: "event": "started", 2023-08-01T19:55:08.577 INFO:teuthology.orchestra.run.smithi101.stdout: "time": "2023-08-01T19:55:08.546844+0000", 2023-08-01T19:55:08.577 INFO:teuthology.orchestra.run.smithi101.stdout: "duration": 0.00015051299999999999 2023-08-01T19:55:08.577 INFO:teuthology.orchestra.run.smithi101.stdout: }, 2023-08-01T19:55:08.578 INFO:teuthology.orchestra.run.smithi101.stdout: { 2023-08-01T19:55:08.578 INFO:teuthology.orchestra.run.smithi101.stdout: "event": "waiting for subops from 0", 2023-08-01T19:55:08.578 INFO:teuthology.orchestra.run.smithi101.stdout: "time": "2023-08-01T19:55:08.546988+0000", 2023-08-01T19:55:08.578 INFO:teuthology.orchestra.run.smithi101.stdout: "duration": 0.00014381600000000001 2023-08-01T19:55:08.578 INFO:teuthology.orchestra.run.smithi101.stdout: } 2023-08-01T19:55:08.578 INFO:teuthology.orchestra.run.smithi101.stdout: ] 2023-08-01T19:55:08.578 INFO:teuthology.orchestra.run.smithi101.stdout: } 2023-08-01T19:55:08.578 INFO:teuthology.orchestra.run.smithi101.stdout: }, 2023-08-01T19:55:08.579 INFO:teuthology.orchestra.run.smithi101.stdout: { 2023-08-01T19:55:08.579 INFO:teuthology.orchestra.run.smithi101.stdout: "description": "osd_repop(client.4668.0:106419 5.6 e38/19 5:6784cf2b:::benchmark_data_smithi006_114134_object106418:head v 38'6598, mlcod=38'6595)", 2023-08-01T19:55:08.579 INFO:teuthology.orchestra.run.smithi101.stdout: "initiated_at": "2023-08-01T19:55:08.546791+0000", 2023-08-01T19:55:08.579 INFO:teuthology.orchestra.run.smithi101.stdout: "age": 0.0048690920000000002, 2023-08-01T19:55:08.579 INFO:teuthology.orchestra.run.smithi101.stdout: "duration": 0.0051034970000000002, 2023-08-01T19:55:08.579 INFO:teuthology.orchestra.run.smithi101.stdout: "type_data": { 2023-08-01T19:55:08.579 INFO:teuthology.orchestra.run.smithi101.stdout: "flag_point": "started", 2023-08-01T19:55:08.579 INFO:teuthology.orchestra.run.smithi101.stdout: "events": [ 2023-08-01T19:55:08.580 INFO:teuthology.orchestra.run.smithi101.stdout: { 2023-08-01T19:55:08.580 INFO:teuthology.orchestra.run.smithi101.stdout: "event": "initiated", 2023-08-01T19:55:08.580 INFO:teuthology.orchestra.run.smithi101.stdout: "time": "2023-08-01T19:55:08.546791+0000", 2023-08-01T19:55:08.580 INFO:teuthology.orchestra.run.smithi101.stdout: "duration": 0 2023-08-01T19:55:08.580 INFO:teuthology.orchestra.run.smithi101.stdout: }, 2023-08-01T19:55:08.580 INFO:teuthology.orchestra.run.smithi101.stdout: { 2023-08-01T19:55:08.580 INFO:teuthology.orchestra.run.smithi101.stdout: "event": "throttled", 2023-08-01T19:55:08.580 INFO:teuthology.orchestra.run.smithi101.stdout: "time": "2023-08-01T19:55:08.546791+0000", 2023-08-01T19:55:08.581 INFO:teuthology.orchestra.run.smithi101.stdout: "duration": 0 2023-08-01T19:55:08.581 INFO:teuthology.orchestra.run.smithi101.stdout: }, 2023-08-01T19:55:08.581 INFO:teuthology.orchestra.run.smithi101.stdout: { 2023-08-01T19:55:08.581 INFO:teuthology.orchestra.run.smithi101.stdout: "event": "header_read", 2023-08-01T19:55:08.581 INFO:teuthology.orchestra.run.smithi101.stdout: "time": "2023-08-01T19:55:08.546791+0000", 2023-08-01T19:55:08.581 INFO:teuthology.orchestra.run.smithi101.stdout: "duration": 4294967295.999999 2023-08-01T19:55:08.581 INFO:teuthology.orchestra.run.smithi101.stdout: }, 2023-08-01T19:55:08.582 INFO:teuthology.orchestra.run.smithi101.stdout: { 2023-08-01T19:55:08.582 INFO:teuthology.orchestra.run.smithi101.stdout: "event": "all_read", 2023-08-01T19:55:08.582 INFO:teuthology.orchestra.run.smithi101.stdout: "time": "2023-08-01T19:55:08.546844+0000", 2023-08-01T19:55:08.582 INFO:teuthology.orchestra.run.smithi101.stdout: "duration": 5.2948999999999997e-05 2023-08-01T19:55:08.582 INFO:teuthology.orchestra.run.smithi101.stdout: }, 2023-08-01T19:55:08.582 INFO:teuthology.orchestra.run.smithi101.stdout: { 2023-08-01T19:55:08.582 INFO:teuthology.orchestra.run.smithi101.stdout: "event": "dispatched", 2023-08-01T19:55:08.582 INFO:teuthology.orchestra.run.smithi101.stdout: "time": "2023-08-01T19:55:08.546853+0000", 2023-08-01T19:55:08.583 INFO:teuthology.orchestra.run.smithi101.stdout: "duration": 9.0469999999999999e-06 2023-08-01T19:55:08.583 INFO:teuthology.orchestra.run.smithi101.stdout: }, 2023-08-01T19:55:08.583 INFO:teuthology.orchestra.run.smithi101.stdout: { 2023-08-01T19:55:08.583 INFO:teuthology.orchestra.run.smithi101.stdout: "event": "queued_for_pg", 2023-08-01T19:55:08.583 INFO:teuthology.orchestra.run.smithi101.stdout: "time": "2023-08-01T19:55:08.546858+0000", 2023-08-01T19:55:08.583 INFO:teuthology.orchestra.run.smithi101.stdout: "duration": 5.2220000000000001e-06 2023-08-01T19:55:08.583 INFO:teuthology.orchestra.run.smithi101.stdout: }, 2023-08-01T19:55:08.583 INFO:teuthology.orchestra.run.smithi101.stdout: { 2023-08-01T19:55:08.584 INFO:teuthology.orchestra.run.smithi101.stdout: "event": "reached_pg", 2023-08-01T19:55:08.584 INFO:teuthology.orchestra.run.smithi101.stdout: "time": "2023-08-01T19:55:08.546884+0000", 2023-08-01T19:55:08.584 INFO:teuthology.orchestra.run.smithi101.stdout: "duration": 2.6308e-05 2023-08-01T19:55:08.584 INFO:teuthology.orchestra.run.smithi101.stdout: }, 2023-08-01T19:55:08.584 INFO:teuthology.orchestra.run.smithi101.stdout: { 2023-08-01T19:55:08.584 INFO:teuthology.orchestra.run.smithi101.stdout: "event": "started", 2023-08-01T19:55:08.584 INFO:teuthology.orchestra.run.smithi101.stdout: "time": "2023-08-01T19:55:08.546896+0000", 2023-08-01T19:55:08.584 INFO:teuthology.orchestra.run.smithi101.stdout: "duration": 1.2068e-05 2023-08-01T19:55:08.585 INFO:teuthology.orchestra.run.smithi101.stdout: } 2023-08-01T19:55:08.585 INFO:teuthology.orchestra.run.smithi101.stdout: ] 2023-08-01T19:55:08.585 INFO:teuthology.orchestra.run.smithi101.stdout: } 2023-08-01T19:55:08.585 INFO:teuthology.orchestra.run.smithi101.stdout: }, 2023-08-01T19:55:08.585 INFO:teuthology.orchestra.run.smithi101.stdout: { 2023-08-01T19:55:08.585 INFO:teuthology.orchestra.run.smithi101.stdout: "description": "osd_repop(client.4668.0:106425 5.c e38/19 5:33c17a0c:::benchmark_data_smithi006_114134_object106424:head v 38'6674, mlcod=38'6672)", 2023-08-01T19:55:08.585 INFO:teuthology.orchestra.run.smithi101.stdout: "initiated_at": "2023-08-01T19:55:08.547242+0000", 2023-08-01T19:55:08.585 INFO:teuthology.orchestra.run.smithi101.stdout: "age": 0.0044187330000000002, 2023-08-01T19:55:08.586 INFO:teuthology.orchestra.run.smithi101.stdout: "duration": 0.0047154759999999997, 2023-08-01T19:55:08.586 INFO:teuthology.orchestra.run.smithi101.stdout: "type_data": { 2023-08-01T19:55:08.586 INFO:teuthology.orchestra.run.smithi101.stdout: "flag_point": "started", 2023-08-01T19:55:08.586 INFO:teuthology.orchestra.run.smithi101.stdout: "events": [ 2023-08-01T19:55:08.586 INFO:teuthology.orchestra.run.smithi101.stdout: { 2023-08-01T19:55:08.586 INFO:teuthology.orchestra.run.smithi101.stdout: "event": "initiated", 2023-08-01T19:55:08.586 INFO:teuthology.orchestra.run.smithi101.stdout: "time": "2023-08-01T19:55:08.547242+0000", 2023-08-01T19:55:08.586 INFO:teuthology.orchestra.run.smithi101.stdout: "duration": 0 2023-08-01T19:55:08.587 INFO:teuthology.orchestra.run.smithi101.stdout: }, 2023-08-01T19:55:08.587 INFO:teuthology.orchestra.run.smithi101.stdout: { 2023-08-01T19:55:08.587 INFO:teuthology.orchestra.run.smithi101.stdout: "event": "throttled", 2023-08-01T19:55:08.587 INFO:teuthology.orchestra.run.smithi101.stdout: "time": "2023-08-01T19:55:08.547242+0000", 2023-08-01T19:55:08.587 INFO:teuthology.orchestra.run.smithi101.stdout: "duration": 0 2023-08-01T19:55:08.587 INFO:teuthology.orchestra.run.smithi101.stdout: }, 2023-08-01T19:55:08.587 INFO:teuthology.orchestra.run.smithi101.stdout: { 2023-08-01T19:55:08.587 INFO:teuthology.orchestra.run.smithi101.stdout: "event": "header_read", 2023-08-01T19:55:08.588 INFO:teuthology.orchestra.run.smithi101.stdout: "time": "2023-08-01T19:55:08.547241+0000", 2023-08-01T19:55:08.588 INFO:teuthology.orchestra.run.smithi101.stdout: "duration": 4294967295.9999995 2023-08-01T19:55:08.588 INFO:teuthology.orchestra.run.smithi101.stdout: }, 2023-08-01T19:55:08.588 INFO:teuthology.orchestra.run.smithi101.stdout: { 2023-08-01T19:55:08.588 INFO:teuthology.orchestra.run.smithi101.stdout: "event": "all_read", 2023-08-01T19:55:08.588 INFO:teuthology.orchestra.run.smithi101.stdout: "time": "2023-08-01T19:55:08.547308+0000", 2023-08-01T19:55:08.588 INFO:teuthology.orchestra.run.smithi101.stdout: "duration": 6.6372999999999996e-05 2023-08-01T19:55:08.589 INFO:teuthology.orchestra.run.smithi101.stdout: }, 2023-08-01T19:55:08.589 INFO:teuthology.orchestra.run.smithi101.stdout: { 2023-08-01T19:55:08.589 INFO:teuthology.orchestra.run.smithi101.stdout: "event": "dispatched", 2023-08-01T19:55:08.589 INFO:teuthology.orchestra.run.smithi101.stdout: "time": "2023-08-01T19:55:08.547316+0000", 2023-08-01T19:55:08.589 INFO:teuthology.orchestra.run.smithi101.stdout: "duration": 8.6780000000000006e-06 2023-08-01T19:55:08.589 INFO:teuthology.orchestra.run.smithi101.stdout: }, 2023-08-01T19:55:08.589 INFO:teuthology.orchestra.run.smithi101.stdout: { 2023-08-01T19:55:08.589 INFO:teuthology.orchestra.run.smithi101.stdout: "event": "queued_for_pg", 2023-08-01T19:55:08.590 INFO:teuthology.orchestra.run.smithi101.stdout: "time": "2023-08-01T19:55:08.547321+0000", 2023-08-01T19:55:08.590 INFO:teuthology.orchestra.run.smithi101.stdout: "duration": 5.1649999999999997e-06 2023-08-01T19:55:08.590 INFO:teuthology.orchestra.run.smithi101.stdout: }, 2023-08-01T19:55:08.590 INFO:teuthology.orchestra.run.smithi101.stdout: { 2023-08-01T19:55:08.590 INFO:teuthology.orchestra.run.smithi101.stdout: "event": "reached_pg", 2023-08-01T19:55:08.590 INFO:teuthology.orchestra.run.smithi101.stdout: "time": "2023-08-01T19:55:08.547362+0000", 2023-08-01T19:55:08.590 INFO:teuthology.orchestra.run.smithi101.stdout: "duration": 4.0559000000000002e-05 2023-08-01T19:55:08.590 INFO:teuthology.orchestra.run.smithi101.stdout: }, 2023-08-01T19:55:08.591 INFO:teuthology.orchestra.run.smithi101.stdout: { 2023-08-01T19:55:08.591 INFO:teuthology.orchestra.run.smithi101.stdout: "event": "started", 2023-08-01T19:55:08.591 INFO:teuthology.orchestra.run.smithi101.stdout: "time": "2023-08-01T19:55:08.547384+0000", 2023-08-01T19:55:08.591 INFO:teuthology.orchestra.run.smithi101.stdout: "duration": 2.1750999999999999e-05 2023-08-01T19:55:08.591 INFO:teuthology.orchestra.run.smithi101.stdout: } 2023-08-01T19:55:08.591 INFO:teuthology.orchestra.run.smithi101.stdout: ] 2023-08-01T19:55:08.591 INFO:teuthology.orchestra.run.smithi101.stdout: } 2023-08-01T19:55:08.591 INFO:teuthology.orchestra.run.smithi101.stdout: }, 2023-08-01T19:55:08.592 INFO:teuthology.orchestra.run.smithi101.stdout: { 2023-08-01T19:55:08.592 INFO:teuthology.orchestra.run.smithi101.stdout: "description": "osd_repop(client.4668.0:106426 5.d e38/19 5:bbaf5f0e:::benchmark_data_smithi006_114134_object106425:head v 38'6536, mlcod=38'6534)", 2023-08-01T19:55:08.592 INFO:teuthology.orchestra.run.smithi101.stdout: "initiated_at": "2023-08-01T19:55:08.547375+0000", 2023-08-01T19:55:08.592 INFO:teuthology.orchestra.run.smithi101.stdout: "age": 0.0042858740000000003, 2023-08-01T19:55:08.592 INFO:teuthology.orchestra.run.smithi101.stdout: "duration": 0.0046537139999999998, 2023-08-01T19:55:08.592 INFO:teuthology.orchestra.run.smithi101.stdout: "type_data": { 2023-08-01T19:55:08.592 INFO:teuthology.orchestra.run.smithi101.stdout: "flag_point": "started", 2023-08-01T19:55:08.592 INFO:teuthology.orchestra.run.smithi101.stdout: "events": [ 2023-08-01T19:55:08.593 INFO:teuthology.orchestra.run.smithi101.stdout: { 2023-08-01T19:55:08.593 INFO:teuthology.orchestra.run.smithi101.stdout: "event": "initiated", 2023-08-01T19:55:08.593 INFO:teuthology.orchestra.run.smithi101.stdout: "time": "2023-08-01T19:55:08.547375+0000", 2023-08-01T19:55:08.593 INFO:teuthology.orchestra.run.smithi101.stdout: "duration": 0 2023-08-01T19:55:08.593 INFO:teuthology.orchestra.run.smithi101.stdout: }, 2023-08-01T19:55:08.593 INFO:teuthology.orchestra.run.smithi101.stdout: { 2023-08-01T19:55:08.593 INFO:teuthology.orchestra.run.smithi101.stdout: "event": "throttled", 2023-08-01T19:55:08.593 INFO:teuthology.orchestra.run.smithi101.stdout: "time": "2023-08-01T19:55:08.547375+0000", 2023-08-01T19:55:08.594 INFO:teuthology.orchestra.run.smithi101.stdout: "duration": 0 2023-08-01T19:55:08.594 INFO:teuthology.orchestra.run.smithi101.stdout: }, 2023-08-01T19:55:08.594 INFO:teuthology.orchestra.run.smithi101.stdout: { 2023-08-01T19:55:08.594 INFO:teuthology.orchestra.run.smithi101.stdout: "event": "header_read", 2023-08-01T19:55:08.594 INFO:teuthology.orchestra.run.smithi101.stdout: "time": "2023-08-01T19:55:08.547374+0000", 2023-08-01T19:55:08.594 INFO:teuthology.orchestra.run.smithi101.stdout: "duration": 4294967295.9999995 2023-08-01T19:55:08.594 INFO:teuthology.orchestra.run.smithi101.stdout: }, 2023-08-01T19:55:08.594 INFO:teuthology.orchestra.run.smithi101.stdout: { 2023-08-01T19:55:08.595 INFO:teuthology.orchestra.run.smithi101.stdout: "event": "all_read", 2023-08-01T19:55:08.595 INFO:teuthology.orchestra.run.smithi101.stdout: "time": "2023-08-01T19:55:08.547432+0000", 2023-08-01T19:55:08.595 INFO:teuthology.orchestra.run.smithi101.stdout: "duration": 5.7534000000000002e-05 2023-08-01T19:55:08.595 INFO:teuthology.orchestra.run.smithi101.stdout: }, 2023-08-01T19:55:08.595 INFO:teuthology.orchestra.run.smithi101.stdout: { 2023-08-01T19:55:08.595 INFO:teuthology.orchestra.run.smithi101.stdout: "event": "dispatched", 2023-08-01T19:55:08.595 INFO:teuthology.orchestra.run.smithi101.stdout: "time": "2023-08-01T19:55:08.547441+0000", 2023-08-01T19:55:08.596 INFO:teuthology.orchestra.run.smithi101.stdout: "duration": 9.6579999999999997e-06 2023-08-01T19:55:08.596 INFO:teuthology.orchestra.run.smithi101.stdout: }, 2023-08-01T19:55:08.596 INFO:teuthology.orchestra.run.smithi101.stdout: { 2023-08-01T19:55:08.596 INFO:teuthology.orchestra.run.smithi101.stdout: "event": "queued_for_pg", 2023-08-01T19:55:08.596 INFO:teuthology.orchestra.run.smithi101.stdout: "time": "2023-08-01T19:55:08.547447+0000", 2023-08-01T19:55:08.596 INFO:teuthology.orchestra.run.smithi101.stdout: "duration": 6.0399999999999998e-06 2023-08-01T19:55:08.596 INFO:teuthology.orchestra.run.smithi101.stdout: }, 2023-08-01T19:55:08.596 INFO:teuthology.orchestra.run.smithi101.stdout: { 2023-08-01T19:55:08.597 INFO:teuthology.orchestra.run.smithi101.stdout: "event": "reached_pg", 2023-08-01T19:55:08.597 INFO:teuthology.orchestra.run.smithi101.stdout: "time": "2023-08-01T19:55:08.547533+0000", 2023-08-01T19:55:08.597 INFO:teuthology.orchestra.run.smithi101.stdout: "duration": 8.5811999999999998e-05 2023-08-01T19:55:08.597 INFO:teuthology.orchestra.run.smithi101.stdout: }, 2023-08-01T19:55:08.597 INFO:teuthology.orchestra.run.smithi101.stdout: { 2023-08-01T19:55:08.597 INFO:teuthology.orchestra.run.smithi101.stdout: "event": "started", 2023-08-01T19:55:08.597 INFO:teuthology.orchestra.run.smithi101.stdout: "time": "2023-08-01T19:55:08.547552+0000", 2023-08-01T19:55:08.597 INFO:teuthology.orchestra.run.smithi101.stdout: "duration": 1.8819999999999999e-05 2023-08-01T19:55:08.598 INFO:teuthology.orchestra.run.smithi101.stdout: } 2023-08-01T19:55:08.598 INFO:teuthology.orchestra.run.smithi101.stdout: ] 2023-08-01T19:55:08.598 INFO:teuthology.orchestra.run.smithi101.stdout: } 2023-08-01T19:55:08.598 INFO:teuthology.orchestra.run.smithi101.stdout: }, 2023-08-01T19:55:08.598 INFO:teuthology.orchestra.run.smithi101.stdout: { 2023-08-01T19:55:08.598 INFO:teuthology.orchestra.run.smithi101.stdout: "description": "osd_op(client.4668.0:106429 5.7 5:e7b59929:::benchmark_data_smithi006_114134_object106428:head [set-alloc-hint object_size 65536 write_size 65536,write 0~65536 in=65536b] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e38)", 2023-08-01T19:55:08.598 INFO:teuthology.orchestra.run.smithi101.stdout: "initiated_at": "2023-08-01T19:55:08.548004+0000", 2023-08-01T19:55:08.598 INFO:teuthology.orchestra.run.smithi101.stdout: "age": 0.0036566070000000001, 2023-08-01T19:55:08.599 INFO:teuthology.orchestra.run.smithi101.stdout: "duration": 0.0040877489999999999, 2023-08-01T19:55:08.599 INFO:teuthology.orchestra.run.smithi101.stdout: "type_data": { 2023-08-01T19:55:08.599 INFO:teuthology.orchestra.run.smithi101.stdout: "flag_point": "waiting for sub ops", 2023-08-01T19:55:08.599 INFO:teuthology.orchestra.run.smithi101.stdout: "client_info": { 2023-08-01T19:55:08.599 INFO:teuthology.orchestra.run.smithi101.stdout: "client": "client.4668", 2023-08-01T19:55:08.599 INFO:teuthology.orchestra.run.smithi101.stdout: "client_addr": "172.21.15.6:0/1709472247", 2023-08-01T19:55:08.599 INFO:teuthology.orchestra.run.smithi101.stdout: "tid": 106429 2023-08-01T19:55:08.599 INFO:teuthology.orchestra.run.smithi101.stdout: }, 2023-08-01T19:55:08.600 INFO:teuthology.orchestra.run.smithi101.stdout: "events": [ 2023-08-01T19:55:08.600 INFO:teuthology.orchestra.run.smithi101.stdout: { 2023-08-01T19:55:08.600 INFO:teuthology.orchestra.run.smithi101.stdout: "event": "initiated", 2023-08-01T19:55:08.600 INFO:teuthology.orchestra.run.smithi101.stdout: "time": "2023-08-01T19:55:08.548004+0000", 2023-08-01T19:55:08.600 INFO:teuthology.orchestra.run.smithi101.stdout: "duration": 0 2023-08-01T19:55:08.600 INFO:teuthology.orchestra.run.smithi101.stdout: }, 2023-08-01T19:55:08.600 INFO:teuthology.orchestra.run.smithi101.stdout: { 2023-08-01T19:55:08.601 INFO:teuthology.orchestra.run.smithi101.stdout: "event": "throttled", 2023-08-01T19:55:08.601 INFO:teuthology.orchestra.run.smithi101.stdout: "time": "2023-08-01T19:55:08.548004+0000", 2023-08-01T19:55:08.601 INFO:teuthology.orchestra.run.smithi101.stdout: "duration": 0 2023-08-01T19:55:08.601 INFO:teuthology.orchestra.run.smithi101.stdout: }, 2023-08-01T19:55:08.601 INFO:teuthology.orchestra.run.smithi101.stdout: { 2023-08-01T19:55:08.601 INFO:teuthology.orchestra.run.smithi101.stdout: "event": "header_read", 2023-08-01T19:55:08.601 INFO:teuthology.orchestra.run.smithi101.stdout: "time": "2023-08-01T19:55:08.548003+0000", 2023-08-01T19:55:08.601 INFO:teuthology.orchestra.run.smithi101.stdout: "duration": 4294967295.999999 2023-08-01T19:55:08.602 INFO:teuthology.orchestra.run.smithi101.stdout: }, 2023-08-01T19:55:08.602 INFO:teuthology.orchestra.run.smithi101.stdout: { 2023-08-01T19:55:08.602 INFO:teuthology.orchestra.run.smithi101.stdout: "event": "all_read", 2023-08-01T19:55:08.602 INFO:teuthology.orchestra.run.smithi101.stdout: "time": "2023-08-01T19:55:08.548054+0000", 2023-08-01T19:55:08.602 INFO:teuthology.orchestra.run.smithi101.stdout: "duration": 5.1060999999999998e-05 2023-08-01T19:55:08.602 INFO:teuthology.orchestra.run.smithi101.stdout: }, 2023-08-01T19:55:08.602 INFO:teuthology.orchestra.run.smithi101.stdout: { 2023-08-01T19:55:08.602 INFO:teuthology.orchestra.run.smithi101.stdout: "event": "dispatched", 2023-08-01T19:55:08.603 INFO:teuthology.orchestra.run.smithi101.stdout: "time": "2023-08-01T19:55:08.548063+0000", 2023-08-01T19:55:08.603 INFO:teuthology.orchestra.run.smithi101.stdout: "duration": 9.1749999999999994e-06 2023-08-01T19:55:08.603 INFO:teuthology.orchestra.run.smithi101.stdout: }, 2023-08-01T19:55:08.603 INFO:teuthology.orchestra.run.smithi101.stdout: { 2023-08-01T19:55:08.603 INFO:teuthology.orchestra.run.smithi101.stdout: "event": "queued_for_pg", 2023-08-01T19:55:08.603 INFO:teuthology.orchestra.run.smithi101.stdout: "time": "2023-08-01T19:55:08.548069+0000", 2023-08-01T19:55:08.603 INFO:teuthology.orchestra.run.smithi101.stdout: "duration": 5.3720000000000004e-06 2023-08-01T19:55:08.603 INFO:teuthology.orchestra.run.smithi101.stdout: }, 2023-08-01T19:55:08.604 INFO:teuthology.orchestra.run.smithi101.stdout: { 2023-08-01T19:55:08.604 INFO:teuthology.orchestra.run.smithi101.stdout: "event": "reached_pg", 2023-08-01T19:55:08.604 INFO:teuthology.orchestra.run.smithi101.stdout: "time": "2023-08-01T19:55:08.548895+0000", 2023-08-01T19:55:08.604 INFO:teuthology.orchestra.run.smithi101.stdout: "duration": 0.00082638099999999995 2023-08-01T19:55:08.604 INFO:teuthology.orchestra.run.smithi101.stdout: }, 2023-08-01T19:55:08.604 INFO:teuthology.orchestra.run.smithi101.stdout: { 2023-08-01T19:55:08.604 INFO:teuthology.orchestra.run.smithi101.stdout: "event": "started", 2023-08-01T19:55:08.605 INFO:teuthology.orchestra.run.smithi101.stdout: "time": "2023-08-01T19:55:08.549032+0000", 2023-08-01T19:55:08.605 INFO:teuthology.orchestra.run.smithi101.stdout: "duration": 0.000137403 2023-08-01T19:55:08.605 INFO:teuthology.orchestra.run.smithi101.stdout: }, 2023-08-01T19:55:08.605 INFO:teuthology.orchestra.run.smithi101.stdout: { 2023-08-01T19:55:08.605 INFO:teuthology.orchestra.run.smithi101.stdout: "event": "waiting for subops from 0", 2023-08-01T19:55:08.605 INFO:teuthology.orchestra.run.smithi101.stdout: "time": "2023-08-01T19:55:08.549180+0000", 2023-08-01T19:55:08.605 INFO:teuthology.orchestra.run.smithi101.stdout: "duration": 0.000148083 2023-08-01T19:55:08.605 INFO:teuthology.orchestra.run.smithi101.stdout: } 2023-08-01T19:55:08.606 INFO:teuthology.orchestra.run.smithi101.stdout: ] 2023-08-01T19:55:08.606 INFO:teuthology.orchestra.run.smithi101.stdout: } 2023-08-01T19:55:08.606 INFO:teuthology.orchestra.run.smithi101.stdout: }, 2023-08-01T19:55:08.606 INFO:teuthology.orchestra.run.smithi101.stdout: { 2023-08-01T19:55:08.606 INFO:teuthology.orchestra.run.smithi101.stdout: "description": "osd_repop(client.4668.0:106427 5.6 e38/19 5:6196523b:::benchmark_data_smithi006_114134_object106426:head v 38'6599, mlcod=38'6595)", 2023-08-01T19:55:08.606 INFO:teuthology.orchestra.run.smithi101.stdout: "initiated_at": "2023-08-01T19:55:08.549046+0000", 2023-08-01T19:55:08.606 INFO:teuthology.orchestra.run.smithi101.stdout: "age": 0.0026143970000000001, 2023-08-01T19:55:08.606 INFO:teuthology.orchestra.run.smithi101.stdout: "duration": 0.003093583, 2023-08-01T19:55:08.607 INFO:teuthology.orchestra.run.smithi101.stdout: "type_data": { 2023-08-01T19:55:08.607 INFO:teuthology.orchestra.run.smithi101.stdout: "flag_point": "started", 2023-08-01T19:55:08.607 INFO:teuthology.orchestra.run.smithi101.stdout: "events": [ 2023-08-01T19:55:08.607 INFO:teuthology.orchestra.run.smithi101.stdout: { 2023-08-01T19:55:08.607 INFO:teuthology.orchestra.run.smithi101.stdout: "event": "initiated", 2023-08-01T19:55:08.607 INFO:teuthology.orchestra.run.smithi101.stdout: "time": "2023-08-01T19:55:08.549046+0000", 2023-08-01T19:55:08.607 INFO:teuthology.orchestra.run.smithi101.stdout: "duration": 0 2023-08-01T19:55:08.607 INFO:teuthology.orchestra.run.smithi101.stdout: }, 2023-08-01T19:55:08.608 INFO:teuthology.orchestra.run.smithi101.stdout: { 2023-08-01T19:55:08.608 INFO:teuthology.orchestra.run.smithi101.stdout: "event": "throttled", 2023-08-01T19:55:08.608 INFO:teuthology.orchestra.run.smithi101.stdout: "time": "2023-08-01T19:55:08.549046+0000", 2023-08-01T19:55:08.608 INFO:teuthology.orchestra.run.smithi101.stdout: "duration": 0 2023-08-01T19:55:08.608 INFO:teuthology.orchestra.run.smithi101.stdout: }, 2023-08-01T19:55:08.608 INFO:teuthology.orchestra.run.smithi101.stdout: { 2023-08-01T19:55:08.608 INFO:teuthology.orchestra.run.smithi101.stdout: "event": "header_read", 2023-08-01T19:55:08.608 INFO:teuthology.orchestra.run.smithi101.stdout: "time": "2023-08-01T19:55:08.549046+0000", 2023-08-01T19:55:08.609 INFO:teuthology.orchestra.run.smithi101.stdout: "duration": 4294967295.9999995 2023-08-01T19:55:08.609 INFO:teuthology.orchestra.run.smithi101.stdout: }, 2023-08-01T19:55:08.609 INFO:teuthology.orchestra.run.smithi101.stdout: { 2023-08-01T19:55:08.609 INFO:teuthology.orchestra.run.smithi101.stdout: "event": "all_read", 2023-08-01T19:55:08.609 INFO:teuthology.orchestra.run.smithi101.stdout: "time": "2023-08-01T19:55:08.549070+0000", 2023-08-01T19:55:08.609 INFO:teuthology.orchestra.run.smithi101.stdout: "duration": 2.4148999999999999e-05 2023-08-01T19:55:08.609 INFO:teuthology.orchestra.run.smithi101.stdout: }, 2023-08-01T19:55:08.609 INFO:teuthology.orchestra.run.smithi101.stdout: { 2023-08-01T19:55:08.610 INFO:teuthology.orchestra.run.smithi101.stdout: "event": "dispatched", 2023-08-01T19:55:08.610 INFO:teuthology.orchestra.run.smithi101.stdout: "time": "2023-08-01T19:55:08.549080+0000", 2023-08-01T19:55:08.610 INFO:teuthology.orchestra.run.smithi101.stdout: "duration": 1.0642000000000001e-05 2023-08-01T19:55:08.610 INFO:teuthology.orchestra.run.smithi101.stdout: }, 2023-08-01T19:55:08.610 INFO:teuthology.orchestra.run.smithi101.stdout: { 2023-08-01T19:55:08.610 INFO:teuthology.orchestra.run.smithi101.stdout: "event": "queued_for_pg", 2023-08-01T19:55:08.610 INFO:teuthology.orchestra.run.smithi101.stdout: "time": "2023-08-01T19:55:08.549086+0000", 2023-08-01T19:55:08.610 INFO:teuthology.orchestra.run.smithi101.stdout: "duration": 5.2039999999999996e-06 2023-08-01T19:55:08.611 INFO:teuthology.orchestra.run.smithi101.stdout: }, 2023-08-01T19:55:08.611 INFO:teuthology.orchestra.run.smithi101.stdout: { 2023-08-01T19:55:08.611 INFO:teuthology.orchestra.run.smithi101.stdout: "event": "reached_pg", 2023-08-01T19:55:08.611 INFO:teuthology.orchestra.run.smithi101.stdout: "time": "2023-08-01T19:55:08.549136+0000", 2023-08-01T19:55:08.611 INFO:teuthology.orchestra.run.smithi101.stdout: "duration": 5.0645e-05 2023-08-01T19:55:08.611 INFO:teuthology.orchestra.run.smithi101.stdout: }, 2023-08-01T19:55:08.611 INFO:teuthology.orchestra.run.smithi101.stdout: { 2023-08-01T19:55:08.611 INFO:teuthology.orchestra.run.smithi101.stdout: "event": "started", 2023-08-01T19:55:08.612 INFO:teuthology.orchestra.run.smithi101.stdout: "time": "2023-08-01T19:55:08.549154+0000", 2023-08-01T19:55:08.612 INFO:teuthology.orchestra.run.smithi101.stdout: "duration": 1.7533e-05 2023-08-01T19:55:08.612 INFO:teuthology.orchestra.run.smithi101.stdout: } 2023-08-01T19:55:08.612 INFO:teuthology.orchestra.run.smithi101.stdout: ] 2023-08-01T19:55:08.612 INFO:teuthology.orchestra.run.smithi101.stdout: } 2023-08-01T19:55:08.612 INFO:teuthology.orchestra.run.smithi101.stdout: }, 2023-08-01T19:55:08.612 INFO:teuthology.orchestra.run.smithi101.stdout: { 2023-08-01T19:55:08.613 INFO:teuthology.orchestra.run.smithi101.stdout: "description": "osd_repop_reply(client.4668.0:106413 5.7 e38/19 ondisk, result = 0)", 2023-08-01T19:55:08.613 INFO:teuthology.orchestra.run.smithi101.stdout: "initiated_at": "2023-08-01T19:55:08.549264+0000", 2023-08-01T19:55:08.613 INFO:teuthology.orchestra.run.smithi101.stdout: "age": 0.0023968739999999998, 2023-08-01T19:55:08.613 INFO:teuthology.orchestra.run.smithi101.stdout: "duration": 0.0029172379999999999, 2023-08-01T19:55:08.613 INFO:teuthology.orchestra.run.smithi101.stdout: "type_data": { 2023-08-01T19:55:08.613 INFO:teuthology.orchestra.run.smithi101.stdout: "flag_point": "started", 2023-08-01T19:55:08.613 INFO:teuthology.orchestra.run.smithi101.stdout: "events": [ 2023-08-01T19:55:08.613 INFO:teuthology.orchestra.run.smithi101.stdout: { 2023-08-01T19:55:08.614 INFO:teuthology.orchestra.run.smithi101.stdout: "event": "initiated", 2023-08-01T19:55:08.614 INFO:teuthology.orchestra.run.smithi101.stdout: "time": "2023-08-01T19:55:08.549264+0000", 2023-08-01T19:55:08.614 INFO:teuthology.orchestra.run.smithi101.stdout: "duration": 0 2023-08-01T19:55:08.614 INFO:teuthology.orchestra.run.smithi101.stdout: }, 2023-08-01T19:55:08.614 INFO:teuthology.orchestra.run.smithi101.stdout: { 2023-08-01T19:55:08.614 INFO:teuthology.orchestra.run.smithi101.stdout: "event": "throttled", 2023-08-01T19:55:08.614 INFO:teuthology.orchestra.run.smithi101.stdout: "time": "2023-08-01T19:55:08.549264+0000", 2023-08-01T19:55:08.614 INFO:teuthology.orchestra.run.smithi101.stdout: "duration": 0 2023-08-01T19:55:08.615 INFO:teuthology.orchestra.run.smithi101.stdout: }, 2023-08-01T19:55:08.615 INFO:teuthology.orchestra.run.smithi101.stdout: { 2023-08-01T19:55:08.615 INFO:teuthology.orchestra.run.smithi101.stdout: "event": "header_read", 2023-08-01T19:55:08.615 INFO:teuthology.orchestra.run.smithi101.stdout: "time": "2023-08-01T19:55:08.549263+0000", 2023-08-01T19:55:08.615 INFO:teuthology.orchestra.run.smithi101.stdout: "duration": 4294967295.9999995 2023-08-01T19:55:08.615 INFO:teuthology.orchestra.run.smithi101.stdout: }, 2023-08-01T19:55:08.615 INFO:teuthology.orchestra.run.smithi101.stdout: { 2023-08-01T19:55:08.615 INFO:teuthology.orchestra.run.smithi101.stdout: "event": "all_read", 2023-08-01T19:55:08.616 INFO:teuthology.orchestra.run.smithi101.stdout: "time": "2023-08-01T19:55:08.549267+0000", 2023-08-01T19:55:08.616 INFO:teuthology.orchestra.run.smithi101.stdout: "duration": 3.8340000000000001e-06 2023-08-01T19:55:08.616 INFO:teuthology.orchestra.run.smithi101.stdout: }, 2023-08-01T19:55:08.616 INFO:teuthology.orchestra.run.smithi101.stdout: { 2023-08-01T19:55:08.616 INFO:teuthology.orchestra.run.smithi101.stdout: "event": "dispatched", 2023-08-01T19:55:08.616 INFO:teuthology.orchestra.run.smithi101.stdout: "time": "2023-08-01T19:55:08.549275+0000", 2023-08-01T19:55:08.616 INFO:teuthology.orchestra.run.smithi101.stdout: "duration": 8.0960000000000001e-06 2023-08-01T19:55:08.616 INFO:teuthology.orchestra.run.smithi101.stdout: }, 2023-08-01T19:55:08.617 INFO:teuthology.orchestra.run.smithi101.stdout: { 2023-08-01T19:55:08.617 INFO:teuthology.orchestra.run.smithi101.stdout: "event": "queued_for_pg", 2023-08-01T19:55:08.617 INFO:teuthology.orchestra.run.smithi101.stdout: "time": "2023-08-01T19:55:08.549280+0000", 2023-08-01T19:55:08.617 INFO:teuthology.orchestra.run.smithi101.stdout: "duration": 4.9030000000000003e-06 2023-08-01T19:55:08.617 INFO:teuthology.orchestra.run.smithi101.stdout: }, 2023-08-01T19:55:08.617 INFO:teuthology.orchestra.run.smithi101.stdout: { 2023-08-01T19:55:08.617 INFO:teuthology.orchestra.run.smithi101.stdout: "event": "reached_pg", 2023-08-01T19:55:08.617 INFO:teuthology.orchestra.run.smithi101.stdout: "time": "2023-08-01T19:55:08.552165+0000", 2023-08-01T19:55:08.618 INFO:teuthology.orchestra.run.smithi101.stdout: "duration": 0.0028854699999999998 2023-08-01T19:55:08.618 INFO:teuthology.orchestra.run.smithi101.stdout: }, 2023-08-01T19:55:08.618 INFO:teuthology.orchestra.run.smithi101.stdout: { 2023-08-01T19:55:08.618 INFO:teuthology.orchestra.run.smithi101.stdout: "event": "started", 2023-08-01T19:55:08.618 INFO:teuthology.orchestra.run.smithi101.stdout: "time": "2023-08-01T19:55:08.552169+0000", 2023-08-01T19:55:08.618 INFO:teuthology.orchestra.run.smithi101.stdout: "duration": 3.8800000000000001e-06 2023-08-01T19:55:08.618 INFO:teuthology.orchestra.run.smithi101.stdout: } 2023-08-01T19:55:08.619 INFO:teuthology.orchestra.run.smithi101.stdout: ] 2023-08-01T19:55:08.619 INFO:teuthology.orchestra.run.smithi101.stdout: } 2023-08-01T19:55:08.619 INFO:teuthology.orchestra.run.smithi101.stdout: }, 2023-08-01T19:55:08.619 INFO:teuthology.orchestra.run.smithi101.stdout: { 2023-08-01T19:55:08.619 INFO:teuthology.orchestra.run.smithi101.stdout: "description": "osd_repop(client.4668.0:106428 5.5 e38/19 5:afdc1192:::benchmark_data_smithi006_114134_object106427:head v 38'6611, mlcod=38'6609)", 2023-08-01T19:55:08.619 INFO:teuthology.orchestra.run.smithi101.stdout: "initiated_at": "2023-08-01T19:55:08.549561+0000", 2023-08-01T19:55:08.619 INFO:teuthology.orchestra.run.smithi101.stdout: "age": 0.0020998760000000001, 2023-08-01T19:55:08.619 INFO:teuthology.orchestra.run.smithi101.stdout: "duration": 0.0026563810000000002, 2023-08-01T19:55:08.620 INFO:teuthology.orchestra.run.smithi101.stdout: "type_data": { 2023-08-01T19:55:08.620 INFO:teuthology.orchestra.run.smithi101.stdout: "flag_point": "started", 2023-08-01T19:55:08.620 INFO:teuthology.orchestra.run.smithi101.stdout: "events": [ 2023-08-01T19:55:08.620 INFO:teuthology.orchestra.run.smithi101.stdout: { 2023-08-01T19:55:08.620 INFO:teuthology.orchestra.run.smithi101.stdout: "event": "initiated", 2023-08-01T19:55:08.620 INFO:teuthology.orchestra.run.smithi101.stdout: "time": "2023-08-01T19:55:08.549561+0000", 2023-08-01T19:55:08.620 INFO:teuthology.orchestra.run.smithi101.stdout: "duration": 0 2023-08-01T19:55:08.620 INFO:teuthology.orchestra.run.smithi101.stdout: }, 2023-08-01T19:55:08.621 INFO:teuthology.orchestra.run.smithi101.stdout: { 2023-08-01T19:55:08.621 INFO:teuthology.orchestra.run.smithi101.stdout: "event": "throttled", 2023-08-01T19:55:08.621 INFO:teuthology.orchestra.run.smithi101.stdout: "time": "2023-08-01T19:55:08.549561+0000", 2023-08-01T19:55:08.621 INFO:teuthology.orchestra.run.smithi101.stdout: "duration": 0 2023-08-01T19:55:08.621 INFO:teuthology.orchestra.run.smithi101.stdout: }, 2023-08-01T19:55:08.621 INFO:teuthology.orchestra.run.smithi101.stdout: { 2023-08-01T19:55:08.621 INFO:teuthology.orchestra.run.smithi101.stdout: "event": "header_read", 2023-08-01T19:55:08.621 INFO:teuthology.orchestra.run.smithi101.stdout: "time": "2023-08-01T19:55:08.549560+0000", 2023-08-01T19:55:08.622 INFO:teuthology.orchestra.run.smithi101.stdout: "duration": 4294967295.9999995 2023-08-01T19:55:08.622 INFO:teuthology.orchestra.run.smithi101.stdout: }, 2023-08-01T19:55:08.622 INFO:teuthology.orchestra.run.smithi101.stdout: { 2023-08-01T19:55:08.622 INFO:teuthology.orchestra.run.smithi101.stdout: "event": "all_read", 2023-08-01T19:55:08.622 INFO:teuthology.orchestra.run.smithi101.stdout: "time": "2023-08-01T19:55:08.549629+0000", 2023-08-01T19:55:08.622 INFO:teuthology.orchestra.run.smithi101.stdout: "duration": 6.8932999999999999e-05 2023-08-01T19:55:08.622 INFO:teuthology.orchestra.run.smithi101.stdout: }, 2023-08-01T19:55:08.622 INFO:teuthology.orchestra.run.smithi101.stdout: { 2023-08-01T19:55:08.623 INFO:teuthology.orchestra.run.smithi101.stdout: "event": "dispatched", 2023-08-01T19:55:08.623 INFO:teuthology.orchestra.run.smithi101.stdout: "time": "2023-08-01T19:55:08.549638+0000", 2023-08-01T19:55:08.623 INFO:teuthology.orchestra.run.smithi101.stdout: "duration": 8.7930000000000003e-06 2023-08-01T19:55:08.623 INFO:teuthology.orchestra.run.smithi101.stdout: }, 2023-08-01T19:55:08.623 INFO:teuthology.orchestra.run.smithi101.stdout: { 2023-08-01T19:55:08.623 INFO:teuthology.orchestra.run.smithi101.stdout: "event": "queued_for_pg", 2023-08-01T19:55:08.623 INFO:teuthology.orchestra.run.smithi101.stdout: "time": "2023-08-01T19:55:08.549642+0000", 2023-08-01T19:55:08.623 INFO:teuthology.orchestra.run.smithi101.stdout: "duration": 4.4259999999999996e-06 2023-08-01T19:55:08.624 INFO:teuthology.orchestra.run.smithi101.stdout: }, 2023-08-01T19:55:08.624 INFO:teuthology.orchestra.run.smithi101.stdout: { 2023-08-01T19:55:08.624 INFO:teuthology.orchestra.run.smithi101.stdout: "event": "reached_pg", 2023-08-01T19:55:08.624 INFO:teuthology.orchestra.run.smithi101.stdout: "time": "2023-08-01T19:55:08.549678+0000", 2023-08-01T19:55:08.624 INFO:teuthology.orchestra.run.smithi101.stdout: "duration": 3.5666e-05 2023-08-01T19:55:08.624 INFO:teuthology.orchestra.run.smithi101.stdout: }, 2023-08-01T19:55:08.624 INFO:teuthology.orchestra.run.smithi101.stdout: { 2023-08-01T19:55:08.624 INFO:teuthology.orchestra.run.smithi101.stdout: "event": "started", 2023-08-01T19:55:08.625 INFO:teuthology.orchestra.run.smithi101.stdout: "time": "2023-08-01T19:55:08.549695+0000", 2023-08-01T19:55:08.625 INFO:teuthology.orchestra.run.smithi101.stdout: "duration": 1.6765e-05 2023-08-01T19:55:08.625 INFO:teuthology.orchestra.run.smithi101.stdout: } 2023-08-01T19:55:08.625 INFO:teuthology.orchestra.run.smithi101.stdout: ] 2023-08-01T19:55:08.625 INFO:teuthology.orchestra.run.smithi101.stdout: } 2023-08-01T19:55:08.625 INFO:teuthology.orchestra.run.smithi101.stdout: }, 2023-08-01T19:55:08.625 INFO:teuthology.orchestra.run.smithi101.stdout: { 2023-08-01T19:55:08.625 INFO:teuthology.orchestra.run.smithi101.stdout: "description": "osd_repop(client.4668.0:106430 5.d e38/19 5:b2d862d7:::benchmark_data_smithi006_114134_object106429:head v 38'6537, mlcod=38'6534)", 2023-08-01T19:55:08.626 INFO:teuthology.orchestra.run.smithi101.stdout: "initiated_at": "2023-08-01T19:55:08.549790+0000", 2023-08-01T19:55:08.626 INFO:teuthology.orchestra.run.smithi101.stdout: "age": 0.001870584, 2023-08-01T19:55:08.626 INFO:teuthology.orchestra.run.smithi101.stdout: "duration": 0.0025036770000000002, 2023-08-01T19:55:08.626 INFO:teuthology.orchestra.run.smithi101.stdout: "type_data": { 2023-08-01T19:55:08.626 INFO:teuthology.orchestra.run.smithi101.stdout: "flag_point": "started", 2023-08-01T19:55:08.626 INFO:teuthology.orchestra.run.smithi101.stdout: "events": [ 2023-08-01T19:55:08.626 INFO:teuthology.orchestra.run.smithi101.stdout: { 2023-08-01T19:55:08.627 INFO:teuthology.orchestra.run.smithi101.stdout: "event": "initiated", 2023-08-01T19:55:08.627 INFO:teuthology.orchestra.run.smithi101.stdout: "time": "2023-08-01T19:55:08.549790+0000", 2023-08-01T19:55:08.627 INFO:teuthology.orchestra.run.smithi101.stdout: "duration": 0 2023-08-01T19:55:08.627 INFO:teuthology.orchestra.run.smithi101.stdout: }, 2023-08-01T19:55:08.627 INFO:teuthology.orchestra.run.smithi101.stdout: { 2023-08-01T19:55:08.627 INFO:teuthology.orchestra.run.smithi101.stdout: "event": "throttled", 2023-08-01T19:55:08.627 INFO:teuthology.orchestra.run.smithi101.stdout: "time": "2023-08-01T19:55:08.549790+0000", 2023-08-01T19:55:08.627 INFO:teuthology.orchestra.run.smithi101.stdout: "duration": 0 2023-08-01T19:55:08.628 INFO:teuthology.orchestra.run.smithi101.stdout: }, 2023-08-01T19:55:08.628 INFO:teuthology.orchestra.run.smithi101.stdout: { 2023-08-01T19:55:08.628 INFO:teuthology.orchestra.run.smithi101.stdout: "event": "header_read", 2023-08-01T19:55:08.628 INFO:teuthology.orchestra.run.smithi101.stdout: "time": "2023-08-01T19:55:08.549790+0000", 2023-08-01T19:55:08.628 INFO:teuthology.orchestra.run.smithi101.stdout: "duration": 4294967295.9999995 2023-08-01T19:55:08.628 INFO:teuthology.orchestra.run.smithi101.stdout: }, 2023-08-01T19:55:08.628 INFO:teuthology.orchestra.run.smithi101.stdout: { 2023-08-01T19:55:08.628 INFO:teuthology.orchestra.run.smithi101.stdout: "event": "all_read", 2023-08-01T19:55:08.629 INFO:teuthology.orchestra.run.smithi101.stdout: "time": "2023-08-01T19:55:08.549856+0000", 2023-08-01T19:55:08.629 INFO:teuthology.orchestra.run.smithi101.stdout: "duration": 6.6278000000000005e-05 2023-08-01T19:55:08.629 INFO:teuthology.orchestra.run.smithi101.stdout: }, 2023-08-01T19:55:08.629 INFO:teuthology.orchestra.run.smithi101.stdout: { 2023-08-01T19:55:08.629 INFO:teuthology.orchestra.run.smithi101.stdout: "event": "dispatched", 2023-08-01T19:55:08.629 INFO:teuthology.orchestra.run.smithi101.stdout: "time": "2023-08-01T19:55:08.549865+0000", 2023-08-01T19:55:08.629 INFO:teuthology.orchestra.run.smithi101.stdout: "duration": 9.3389999999999999e-06 2023-08-01T19:55:08.629 INFO:teuthology.orchestra.run.smithi101.stdout: }, 2023-08-01T19:55:08.630 INFO:teuthology.orchestra.run.smithi101.stdout: { 2023-08-01T19:55:08.630 INFO:teuthology.orchestra.run.smithi101.stdout: "event": "queued_for_pg", 2023-08-01T19:55:08.630 INFO:teuthology.orchestra.run.smithi101.stdout: "time": "2023-08-01T19:55:08.549870+0000", 2023-08-01T19:55:08.630 INFO:teuthology.orchestra.run.smithi101.stdout: "duration": 4.702e-06 2023-08-01T19:55:08.630 INFO:teuthology.orchestra.run.smithi101.stdout: }, 2023-08-01T19:55:08.630 INFO:teuthology.orchestra.run.smithi101.stdout: { 2023-08-01T19:55:08.630 INFO:teuthology.orchestra.run.smithi101.stdout: "event": "reached_pg", 2023-08-01T19:55:08.630 INFO:teuthology.orchestra.run.smithi101.stdout: "time": "2023-08-01T19:55:08.549908+0000", 2023-08-01T19:55:08.631 INFO:teuthology.orchestra.run.smithi101.stdout: "duration": 3.8027e-05 2023-08-01T19:55:08.631 INFO:teuthology.orchestra.run.smithi101.stdout: }, 2023-08-01T19:55:08.631 INFO:teuthology.orchestra.run.smithi101.stdout: { 2023-08-01T19:55:08.631 INFO:teuthology.orchestra.run.smithi101.stdout: "event": "started", 2023-08-01T19:55:08.631 INFO:teuthology.orchestra.run.smithi101.stdout: "time": "2023-08-01T19:55:08.549932+0000", 2023-08-01T19:55:08.631 INFO:teuthology.orchestra.run.smithi101.stdout: "duration": 2.4341999999999998e-05 2023-08-01T19:55:08.631 INFO:teuthology.orchestra.run.smithi101.stdout: } 2023-08-01T19:55:08.631 INFO:teuthology.orchestra.run.smithi101.stdout: ] 2023-08-01T19:55:08.632 INFO:teuthology.orchestra.run.smithi101.stdout: } 2023-08-01T19:55:08.632 INFO:teuthology.orchestra.run.smithi101.stdout: }, 2023-08-01T19:55:08.632 INFO:teuthology.orchestra.run.smithi101.stdout: { 2023-08-01T19:55:08.632 INFO:teuthology.orchestra.run.smithi101.stdout: "description": "osd_op(client.4668.0:106433 5.1 5:83602aee:::benchmark_data_smithi006_114134_object106432:head [set-alloc-hint object_size 65536 write_size 65536,write 0~65536 in=65536b] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e38)", 2023-08-01T19:55:08.632 INFO:teuthology.orchestra.run.smithi101.stdout: "initiated_at": "2023-08-01T19:55:08.550355+0000", 2023-08-01T19:55:08.632 INFO:teuthology.orchestra.run.smithi101.stdout: "age": 0.001305924, 2023-08-01T19:55:08.632 INFO:teuthology.orchestra.run.smithi101.stdout: "duration": 0.002013889, 2023-08-01T19:55:08.633 INFO:teuthology.orchestra.run.smithi101.stdout: "type_data": { 2023-08-01T19:55:08.633 INFO:teuthology.orchestra.run.smithi101.stdout: "flag_point": "waiting for sub ops", 2023-08-01T19:55:08.633 INFO:teuthology.orchestra.run.smithi101.stdout: "client_info": { 2023-08-01T19:55:08.633 INFO:teuthology.orchestra.run.smithi101.stdout: "client": "client.4668", 2023-08-01T19:55:08.633 INFO:teuthology.orchestra.run.smithi101.stdout: "client_addr": "172.21.15.6:0/1709472247", 2023-08-01T19:55:08.633 INFO:teuthology.orchestra.run.smithi101.stdout: "tid": 106433 2023-08-01T19:55:08.633 INFO:teuthology.orchestra.run.smithi101.stdout: }, 2023-08-01T19:55:08.633 INFO:teuthology.orchestra.run.smithi101.stdout: "events": [ 2023-08-01T19:55:08.634 INFO:teuthology.orchestra.run.smithi101.stdout: { 2023-08-01T19:55:08.634 INFO:teuthology.orchestra.run.smithi101.stdout: "event": "initiated", 2023-08-01T19:55:08.634 INFO:teuthology.orchestra.run.smithi101.stdout: "time": "2023-08-01T19:55:08.550355+0000", 2023-08-01T19:55:08.634 INFO:teuthology.orchestra.run.smithi101.stdout: "duration": 0 2023-08-01T19:55:08.634 INFO:teuthology.orchestra.run.smithi101.stdout: }, 2023-08-01T19:55:08.634 INFO:teuthology.orchestra.run.smithi101.stdout: { 2023-08-01T19:55:08.634 INFO:teuthology.orchestra.run.smithi101.stdout: "event": "throttled", 2023-08-01T19:55:08.634 INFO:teuthology.orchestra.run.smithi101.stdout: "time": "2023-08-01T19:55:08.550355+0000", 2023-08-01T19:55:08.635 INFO:teuthology.orchestra.run.smithi101.stdout: "duration": 0 2023-08-01T19:55:08.635 INFO:teuthology.orchestra.run.smithi101.stdout: }, 2023-08-01T19:55:08.635 INFO:teuthology.orchestra.run.smithi101.stdout: { 2023-08-01T19:55:08.635 INFO:teuthology.orchestra.run.smithi101.stdout: "event": "header_read", 2023-08-01T19:55:08.635 INFO:teuthology.orchestra.run.smithi101.stdout: "time": "2023-08-01T19:55:08.550354+0000", 2023-08-01T19:55:08.635 INFO:teuthology.orchestra.run.smithi101.stdout: "duration": 4294967295.999999 2023-08-01T19:55:08.635 INFO:teuthology.orchestra.run.smithi101.stdout: }, 2023-08-01T19:55:08.635 INFO:teuthology.orchestra.run.smithi101.stdout: { 2023-08-01T19:55:08.636 INFO:teuthology.orchestra.run.smithi101.stdout: "event": "all_read", 2023-08-01T19:55:08.636 INFO:teuthology.orchestra.run.smithi101.stdout: "time": "2023-08-01T19:55:08.550455+0000", 2023-08-01T19:55:08.636 INFO:teuthology.orchestra.run.smithi101.stdout: "duration": 0.00010118700000000001 2023-08-01T19:55:08.636 INFO:teuthology.orchestra.run.smithi101.stdout: }, 2023-08-01T19:55:08.636 INFO:teuthology.orchestra.run.smithi101.stdout: { 2023-08-01T19:55:08.636 INFO:teuthology.orchestra.run.smithi101.stdout: "event": "dispatched", 2023-08-01T19:55:08.636 INFO:teuthology.orchestra.run.smithi101.stdout: "time": "2023-08-01T19:55:08.550466+0000", 2023-08-01T19:55:08.636 INFO:teuthology.orchestra.run.smithi101.stdout: "duration": 1.0713999999999999e-05 2023-08-01T19:55:08.637 INFO:teuthology.orchestra.run.smithi101.stdout: }, 2023-08-01T19:55:08.637 INFO:teuthology.orchestra.run.smithi101.stdout: { 2023-08-01T19:55:08.637 INFO:teuthology.orchestra.run.smithi101.stdout: "event": "queued_for_pg", 2023-08-01T19:55:08.637 INFO:teuthology.orchestra.run.smithi101.stdout: "time": "2023-08-01T19:55:08.550471+0000", 2023-08-01T19:55:08.637 INFO:teuthology.orchestra.run.smithi101.stdout: "duration": 5.48e-06 2023-08-01T19:55:08.637 INFO:teuthology.orchestra.run.smithi101.stdout: }, 2023-08-01T19:55:08.637 INFO:teuthology.orchestra.run.smithi101.stdout: { 2023-08-01T19:55:08.637 INFO:teuthology.orchestra.run.smithi101.stdout: "event": "reached_pg", 2023-08-01T19:55:08.638 INFO:teuthology.orchestra.run.smithi101.stdout: "time": "2023-08-01T19:55:08.550506+0000", 2023-08-01T19:55:08.638 INFO:teuthology.orchestra.run.smithi101.stdout: "duration": 3.5256000000000003e-05 2023-08-01T19:55:08.638 INFO:teuthology.orchestra.run.smithi101.stdout: }, 2023-08-01T19:55:08.638 INFO:teuthology.orchestra.run.smithi101.stdout: { 2023-08-01T19:55:08.638 INFO:teuthology.orchestra.run.smithi101.stdout: "event": "started", 2023-08-01T19:55:08.638 INFO:teuthology.orchestra.run.smithi101.stdout: "time": "2023-08-01T19:55:08.550638+0000", 2023-08-01T19:55:08.638 INFO:teuthology.orchestra.run.smithi101.stdout: "duration": 0.00013145600000000001 2023-08-01T19:55:08.638 INFO:teuthology.orchestra.run.smithi101.stdout: }, 2023-08-01T19:55:08.639 INFO:teuthology.orchestra.run.smithi101.stdout: { 2023-08-01T19:55:08.639 INFO:teuthology.orchestra.run.smithi101.stdout: "event": "waiting for subops from 0", 2023-08-01T19:55:08.639 INFO:teuthology.orchestra.run.smithi101.stdout: "time": "2023-08-01T19:55:08.550770+0000", 2023-08-01T19:55:08.639 INFO:teuthology.orchestra.run.smithi101.stdout: "duration": 0.00013246699999999999 2023-08-01T19:55:08.639 INFO:teuthology.orchestra.run.smithi101.stdout: } 2023-08-01T19:55:08.639 INFO:teuthology.orchestra.run.smithi101.stdout: ] 2023-08-01T19:55:08.639 INFO:teuthology.orchestra.run.smithi101.stdout: } 2023-08-01T19:55:08.639 INFO:teuthology.orchestra.run.smithi101.stdout: }, 2023-08-01T19:55:08.640 INFO:teuthology.orchestra.run.smithi101.stdout: { 2023-08-01T19:55:08.640 INFO:teuthology.orchestra.run.smithi101.stdout: "description": "osd_repop(client.4668.0:106434 5.5 e38/19 5:add7af35:::benchmark_data_smithi006_114134_object106433:head v 38'6612, mlcod=38'6609)", 2023-08-01T19:55:08.640 INFO:teuthology.orchestra.run.smithi101.stdout: "initiated_at": "2023-08-01T19:55:08.551831+0000", 2023-08-01T19:55:08.640 INFO:teuthology.orchestra.run.smithi101.stdout: "age": 4294967295.9998293, 2023-08-01T19:55:08.640 INFO:teuthology.orchestra.run.smithi101.stdout: "duration": 0.000614037, 2023-08-01T19:55:08.640 INFO:teuthology.orchestra.run.smithi101.stdout: "type_data": { 2023-08-01T19:55:08.640 INFO:teuthology.orchestra.run.smithi101.stdout: "flag_point": "started", 2023-08-01T19:55:08.641 INFO:teuthology.orchestra.run.smithi101.stdout: "events": [ 2023-08-01T19:55:08.641 INFO:teuthology.orchestra.run.smithi101.stdout: { 2023-08-01T19:55:08.641 INFO:teuthology.orchestra.run.smithi101.stdout: "event": "initiated", 2023-08-01T19:55:08.641 INFO:teuthology.orchestra.run.smithi101.stdout: "time": "2023-08-01T19:55:08.551831+0000", 2023-08-01T19:55:08.641 INFO:teuthology.orchestra.run.smithi101.stdout: "duration": 0 2023-08-01T19:55:08.641 INFO:teuthology.orchestra.run.smithi101.stdout: }, 2023-08-01T19:55:08.641 INFO:teuthology.orchestra.run.smithi101.stdout: { 2023-08-01T19:55:08.641 INFO:teuthology.orchestra.run.smithi101.stdout: "event": "throttled", 2023-08-01T19:55:08.642 INFO:teuthology.orchestra.run.smithi101.stdout: "time": "2023-08-01T19:55:08.551831+0000", 2023-08-01T19:55:08.642 INFO:teuthology.orchestra.run.smithi101.stdout: "duration": 0 2023-08-01T19:55:08.642 INFO:teuthology.orchestra.run.smithi101.stdout: }, 2023-08-01T19:55:08.642 INFO:teuthology.orchestra.run.smithi101.stdout: { 2023-08-01T19:55:08.642 INFO:teuthology.orchestra.run.smithi101.stdout: "event": "header_read", 2023-08-01T19:55:08.642 INFO:teuthology.orchestra.run.smithi101.stdout: "time": "2023-08-01T19:55:08.551831+0000", 2023-08-01T19:55:08.642 INFO:teuthology.orchestra.run.smithi101.stdout: "duration": 4294967295.9999995 2023-08-01T19:55:08.642 INFO:teuthology.orchestra.run.smithi101.stdout: }, 2023-08-01T19:55:08.643 INFO:teuthology.orchestra.run.smithi101.stdout: { 2023-08-01T19:55:08.643 INFO:teuthology.orchestra.run.smithi101.stdout: "event": "all_read", 2023-08-01T19:55:08.643 INFO:teuthology.orchestra.run.smithi101.stdout: "time": "2023-08-01T19:55:08.551886+0000", 2023-08-01T19:55:08.643 INFO:teuthology.orchestra.run.smithi101.stdout: "duration": 5.4694000000000002e-05 2023-08-01T19:55:08.643 INFO:teuthology.orchestra.run.smithi101.stdout: }, 2023-08-01T19:55:08.643 INFO:teuthology.orchestra.run.smithi101.stdout: { 2023-08-01T19:55:08.643 INFO:teuthology.orchestra.run.smithi101.stdout: "event": "dispatched", 2023-08-01T19:55:08.643 INFO:teuthology.orchestra.run.smithi101.stdout: "time": "2023-08-01T19:55:08.551892+0000", 2023-08-01T19:55:08.644 INFO:teuthology.orchestra.run.smithi101.stdout: "duration": 6.6229999999999999e-06 2023-08-01T19:55:08.644 INFO:teuthology.orchestra.run.smithi101.stdout: }, 2023-08-01T19:55:08.644 INFO:teuthology.orchestra.run.smithi101.stdout: { 2023-08-01T19:55:08.644 INFO:teuthology.orchestra.run.smithi101.stdout: "event": "queued_for_pg", 2023-08-01T19:55:08.644 INFO:teuthology.orchestra.run.smithi101.stdout: "time": "2023-08-01T19:55:08.551895+0000", 2023-08-01T19:55:08.644 INFO:teuthology.orchestra.run.smithi101.stdout: "duration": 2.8849999999999999e-06 2023-08-01T19:55:08.644 INFO:teuthology.orchestra.run.smithi101.stdout: }, 2023-08-01T19:55:08.644 INFO:teuthology.orchestra.run.smithi101.stdout: { 2023-08-01T19:55:08.645 INFO:teuthology.orchestra.run.smithi101.stdout: "event": "reached_pg", 2023-08-01T19:55:08.645 INFO:teuthology.orchestra.run.smithi101.stdout: "time": "2023-08-01T19:55:08.552083+0000", 2023-08-01T19:55:08.645 INFO:teuthology.orchestra.run.smithi101.stdout: "duration": 0.00018753800000000001 2023-08-01T19:55:08.645 INFO:teuthology.orchestra.run.smithi101.stdout: }, 2023-08-01T19:55:08.645 INFO:teuthology.orchestra.run.smithi101.stdout: { 2023-08-01T19:55:08.645 INFO:teuthology.orchestra.run.smithi101.stdout: "event": "started", 2023-08-01T19:55:08.645 INFO:teuthology.orchestra.run.smithi101.stdout: "time": "2023-08-01T19:55:08.552095+0000", 2023-08-01T19:55:08.645 INFO:teuthology.orchestra.run.smithi101.stdout: "duration": 1.1946e-05 2023-08-01T19:55:08.646 INFO:teuthology.orchestra.run.smithi101.stdout: } 2023-08-01T19:55:08.646 INFO:teuthology.orchestra.run.smithi101.stdout: ] 2023-08-01T19:55:08.646 INFO:teuthology.orchestra.run.smithi101.stdout: } 2023-08-01T19:55:08.646 INFO:teuthology.orchestra.run.smithi101.stdout: } 2023-08-01T19:55:08.646 INFO:teuthology.orchestra.run.smithi101.stdout: ], 2023-08-01T19:55:08.646 INFO:teuthology.orchestra.run.smithi101.stdout: "num_ops": 13 2023-08-01T19:55:08.646 INFO:teuthology.orchestra.run.smithi101.stdout:} 2023-08-01T19:55:08.647 DEBUG:teuthology.orchestra.run.smithi006:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 120 ceph --cluster ceph osd set noscrub 2023-08-01T19:55:08.648 DEBUG:teuthology.orchestra.run.smithi101:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 30 ceph --cluster ceph --admin-daemon /var/run/ceph/ceph-osd.1.asok dump_blocked_ops 2023-08-01T19:55:08.649 INFO:tasks.ceph.osd.2.smithi155.stderr:2023-08-01T19:55:08.646+0000 7faa5c6ac700 -1 received signal: Hangup from /usr/bin/python3 /bin/daemon-helper kill ceph-osd -f --cluster ceph -i 2 (PID: 111337) UID: 0 2023-08-01T19:55:08.748 INFO:tasks.ceph.osd.0.smithi008.stderr:2023-08-01T19:55:08.748+0000 7f16a58f4700 -1 received signal: Hangup from /usr/bin/python3 /bin/daemon-helper kill ceph-osd -f --cluster ceph -i 0 (PID: 111179) UID: 0 2023-08-01T19:55:08.849 INFO:tasks.ceph.osd.2.smithi155.stderr:2023-08-01T19:55:08.847+0000 7faa5c6ac700 -1 received signal: Hangup from /usr/bin/python3 /bin/daemon-helper kill ceph-osd -f --cluster ceph -i 2 (PID: 111337) UID: 0 2023-08-01T19:55:08.855 INFO:teuthology.orchestra.run.smithi101.stdout:{ 2023-08-01T19:55:08.855 INFO:teuthology.orchestra.run.smithi101.stdout: "ops": [], 2023-08-01T19:55:08.856 INFO:teuthology.orchestra.run.smithi101.stdout: "complaint_time": 30, 2023-08-01T19:55:08.856 INFO:teuthology.orchestra.run.smithi101.stdout: "num_blocked_ops": 0 2023-08-01T19:55:08.856 INFO:teuthology.orchestra.run.smithi101.stdout:} 2023-08-01T19:55:08.867 DEBUG:teuthology.orchestra.run.smithi101:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 30 ceph --cluster ceph --admin-daemon /var/run/ceph/ceph-osd.1.asok dump_historic_ops 2023-08-01T19:55:08.951 INFO:tasks.ceph.osd.0.smithi008.stderr:2023-08-01T19:55:08.950+0000 7f16a58f4700 -1 received signal: Hangup from /usr/bin/python3 /bin/daemon-helper kill ceph-osd -f --cluster ceph -i 0 (PID: 111179) UID: 0 2023-08-01T19:55:09.044 INFO:teuthology.orchestra.run.smithi101.stdout:{ 2023-08-01T19:55:09.044 INFO:teuthology.orchestra.run.smithi101.stdout: "size": 20, 2023-08-01T19:55:09.045 INFO:teuthology.orchestra.run.smithi101.stdout: "duration": 600, 2023-08-01T19:55:09.045 INFO:teuthology.orchestra.run.smithi101.stdout: "ops": [ 2023-08-01T19:55:09.045 INFO:teuthology.orchestra.run.smithi101.stdout: { 2023-08-01T19:55:09.045 INFO:teuthology.orchestra.run.smithi101.stdout: "description": "osd_op(mds.0.3:9 3.10 3:09401a81:::601.00000000:head [create,setxattr parent (62) in=6b,setxattr layout (30) in=6b] snapc 0=[] ondisk+write+known_if_redirected+full_force+supports_pool_eio e17)", 2023-08-01T19:55:09.045 INFO:teuthology.orchestra.run.smithi101.stdout: "initiated_at": "2023-08-01T19:54:04.458896+0000", 2023-08-01T19:55:09.045 INFO:teuthology.orchestra.run.smithi101.stdout: "age": 64.581680657999996, 2023-08-01T19:55:09.045 INFO:teuthology.orchestra.run.smithi101.stdout: "duration": 0.018577215000000001, 2023-08-01T19:55:09.045 INFO:teuthology.orchestra.run.smithi101.stdout: "type_data": { 2023-08-01T19:55:09.046 INFO:teuthology.orchestra.run.smithi101.stdout: "flag_point": "commit sent; apply or cleanup", 2023-08-01T19:55:09.046 INFO:teuthology.orchestra.run.smithi101.stdout: "events": [ 2023-08-01T19:55:09.046 INFO:teuthology.orchestra.run.smithi101.stdout: { 2023-08-01T19:55:09.046 INFO:teuthology.orchestra.run.smithi101.stdout: "event": "initiated", 2023-08-01T19:55:09.046 INFO:teuthology.orchestra.run.smithi101.stdout: "time": "2023-08-01T19:54:04.458896+0000", 2023-08-01T19:55:09.046 INFO:teuthology.orchestra.run.smithi101.stdout: "duration": 0 2023-08-01T19:55:09.046 INFO:teuthology.orchestra.run.smithi101.stdout: }, 2023-08-01T19:55:09.046 INFO:teuthology.orchestra.run.smithi101.stdout: { 2023-08-01T19:55:09.047 INFO:teuthology.orchestra.run.smithi101.stdout: "event": "throttled", 2023-08-01T19:55:09.047 INFO:teuthology.orchestra.run.smithi101.stdout: "time": "2023-08-01T19:54:04.458896+0000", 2023-08-01T19:55:09.047 INFO:teuthology.orchestra.run.smithi101.stdout: "duration": 0 2023-08-01T19:55:09.047 INFO:teuthology.orchestra.run.smithi101.stdout: }, 2023-08-01T19:55:09.047 INFO:teuthology.orchestra.run.smithi101.stdout: { 2023-08-01T19:55:09.047 INFO:teuthology.orchestra.run.smithi101.stdout: "event": "header_read", 2023-08-01T19:55:09.047 INFO:teuthology.orchestra.run.smithi101.stdout: "time": "2023-08-01T19:54:04.458896+0000", 2023-08-01T19:55:09.048 INFO:teuthology.orchestra.run.smithi101.stdout: "duration": 4294967295.9999995 2023-08-01T19:55:09.048 INFO:teuthology.orchestra.run.smithi101.stdout: }, 2023-08-01T19:55:09.048 INFO:teuthology.orchestra.run.smithi101.stdout: { 2023-08-01T19:55:09.048 INFO:teuthology.orchestra.run.smithi101.stdout: "event": "all_read", 2023-08-01T19:55:09.048 INFO:teuthology.orchestra.run.smithi101.stdout: "time": "2023-08-01T19:54:04.458900+0000", 2023-08-01T19:55:09.048 INFO:teuthology.orchestra.run.smithi101.stdout: "duration": 4.0829999999999997e-06 2023-08-01T19:55:09.048 INFO:teuthology.orchestra.run.smithi101.stdout: }, 2023-08-01T19:55:09.048 INFO:teuthology.orchestra.run.smithi101.stdout: { 2023-08-01T19:55:09.049 INFO:teuthology.orchestra.run.smithi101.stdout: "event": "dispatched", 2023-08-01T19:55:09.049 INFO:teuthology.orchestra.run.smithi101.stdout: "time": "2023-08-01T19:54:04.458906+0000", 2023-08-01T19:55:09.049 INFO:teuthology.orchestra.run.smithi101.stdout: "duration": 6.4099999999999996e-06 2023-08-01T19:55:09.049 INFO:teuthology.orchestra.run.smithi101.stdout: }, 2023-08-01T19:55:09.049 INFO:teuthology.orchestra.run.smithi101.stdout: { 2023-08-01T19:55:09.049 INFO:teuthology.orchestra.run.smithi101.stdout: "event": "queued_for_pg", 2023-08-01T19:55:09.049 INFO:teuthology.orchestra.run.smithi101.stdout: "time": "2023-08-01T19:54:04.458911+0000", 2023-08-01T19:55:09.049 INFO:teuthology.orchestra.run.smithi101.stdout: "duration": 4.0500000000000002e-06 2023-08-01T19:55:09.050 INFO:teuthology.orchestra.run.smithi101.stdout: }, 2023-08-01T19:55:09.050 INFO:teuthology.orchestra.run.smithi101.stdout: { 2023-08-01T19:55:09.050 INFO:teuthology.orchestra.run.smithi101.stdout: "event": "reached_pg", 2023-08-01T19:55:09.050 INFO:teuthology.orchestra.run.smithi101.stdout: "time": "2023-08-01T19:54:04.458981+0000", 2023-08-01T19:55:09.050 INFO:teuthology.orchestra.run.smithi101.stdout: "duration": 7.0121000000000002e-05 2023-08-01T19:55:09.050 INFO:teuthology.orchestra.run.smithi101.stdout: }, 2023-08-01T19:55:09.050 INFO:teuthology.orchestra.run.smithi101.stdout: { 2023-08-01T19:55:09.050 INFO:teuthology.orchestra.run.smithi101.stdout: "event": "waiting_for_map not empty", 2023-08-01T19:55:09.051 INFO:teuthology.orchestra.run.smithi101.stdout: "time": "2023-08-01T19:54:04.458983+0000", 2023-08-01T19:55:09.051 INFO:teuthology.orchestra.run.smithi101.stdout: "duration": 2.2299999999999998e-06 2023-08-01T19:55:09.051 INFO:teuthology.orchestra.run.smithi101.stdout: }, 2023-08-01T19:55:09.051 INFO:teuthology.orchestra.run.smithi101.stdout: { 2023-08-01T19:55:09.051 INFO:teuthology.orchestra.run.smithi101.stdout: "event": "reached_pg", 2023-08-01T19:55:09.051 INFO:teuthology.orchestra.run.smithi101.stdout: "time": "2023-08-01T19:54:04.470122+0000", 2023-08-01T19:55:09.051 INFO:teuthology.orchestra.run.smithi101.stdout: "duration": 0.011139593999999999 2023-08-01T19:55:09.051 INFO:teuthology.orchestra.run.smithi101.stdout: }, 2023-08-01T19:55:09.052 INFO:teuthology.orchestra.run.smithi101.stdout: { 2023-08-01T19:55:09.052 INFO:teuthology.orchestra.run.smithi101.stdout: "event": "started", 2023-08-01T19:55:09.052 INFO:teuthology.orchestra.run.smithi101.stdout: "time": "2023-08-01T19:54:04.470217+0000", 2023-08-01T19:55:09.052 INFO:teuthology.orchestra.run.smithi101.stdout: "duration": 9.4388000000000005e-05 2023-08-01T19:55:09.052 INFO:teuthology.orchestra.run.smithi101.stdout: }, 2023-08-01T19:55:09.052 INFO:teuthology.orchestra.run.smithi101.stdout: { 2023-08-01T19:55:09.052 INFO:teuthology.orchestra.run.smithi101.stdout: "event": "waiting for subops from 2", 2023-08-01T19:55:09.053 INFO:teuthology.orchestra.run.smithi101.stdout: "time": "2023-08-01T19:54:04.470714+0000", 2023-08-01T19:55:09.053 INFO:teuthology.orchestra.run.smithi101.stdout: "duration": 0.00049680999999999998 2023-08-01T19:55:09.053 INFO:teuthology.orchestra.run.smithi101.stdout: }, 2023-08-01T19:55:09.053 INFO:teuthology.orchestra.run.smithi101.stdout: { 2023-08-01T19:55:09.053 INFO:teuthology.orchestra.run.smithi101.stdout: "event": "op_commit", 2023-08-01T19:55:09.053 INFO:teuthology.orchestra.run.smithi101.stdout: "time": "2023-08-01T19:54:04.476183+0000", 2023-08-01T19:55:09.053 INFO:teuthology.orchestra.run.smithi101.stdout: "duration": 0.0054695880000000001 2023-08-01T19:55:09.053 INFO:teuthology.orchestra.run.smithi101.stdout: }, 2023-08-01T19:55:09.054 INFO:teuthology.orchestra.run.smithi101.stdout: { 2023-08-01T19:55:09.054 INFO:teuthology.orchestra.run.smithi101.stdout: "event": "sub_op_commit_rec", 2023-08-01T19:55:09.054 INFO:teuthology.orchestra.run.smithi101.stdout: "time": "2023-08-01T19:54:04.477428+0000", 2023-08-01T19:55:09.054 INFO:teuthology.orchestra.run.smithi101.stdout: "duration": 0.001244843 2023-08-01T19:55:09.054 INFO:teuthology.orchestra.run.smithi101.stdout: }, 2023-08-01T19:55:09.054 INFO:teuthology.orchestra.run.smithi101.stdout: { 2023-08-01T19:55:09.054 INFO:teuthology.orchestra.run.smithi101.stdout: "event": "commit_sent", 2023-08-01T19:55:09.054 INFO:teuthology.orchestra.run.smithi101.stdout: "time": "2023-08-01T19:54:04.477456+0000", 2023-08-01T19:55:09.055 INFO:teuthology.orchestra.run.smithi101.stdout: "duration": 2.7538e-05 2023-08-01T19:55:09.055 INFO:teuthology.orchestra.run.smithi101.stdout: }, 2023-08-01T19:55:09.055 INFO:teuthology.orchestra.run.smithi101.stdout: { 2023-08-01T19:55:09.055 INFO:teuthology.orchestra.run.smithi101.stdout: "event": "done", 2023-08-01T19:55:09.055 INFO:teuthology.orchestra.run.smithi101.stdout: "time": "2023-08-01T19:54:04.477474+0000", 2023-08-01T19:55:09.055 INFO:teuthology.orchestra.run.smithi101.stdout: "duration": 1.7974000000000001e-05 2023-08-01T19:55:09.055 INFO:teuthology.orchestra.run.smithi101.stdout: } 2023-08-01T19:55:09.055 INFO:teuthology.orchestra.run.smithi101.stdout: ] 2023-08-01T19:55:09.056 INFO:teuthology.orchestra.run.smithi101.stdout: } 2023-08-01T19:55:09.056 INFO:teuthology.orchestra.run.smithi101.stdout: }, 2023-08-01T19:55:09.056 INFO:teuthology.orchestra.run.smithi101.stdout: { 2023-08-01T19:55:09.056 INFO:teuthology.orchestra.run.smithi101.stdout: "description": "osd_op(mds.0.3:10 3.10 3:0bd6d154:::602.00000000:head [omap-set-header] snapc 0=[] ondisk+write+known_if_redirected+full_force+supports_pool_eio e17)", 2023-08-01T19:55:09.056 INFO:teuthology.orchestra.run.smithi101.stdout: "initiated_at": "2023-08-01T19:54:04.458927+0000", 2023-08-01T19:55:09.056 INFO:teuthology.orchestra.run.smithi101.stdout: "age": 64.581649679999998, 2023-08-01T19:55:09.056 INFO:teuthology.orchestra.run.smithi101.stdout: "duration": 0.019574352, 2023-08-01T19:55:09.057 INFO:teuthology.orchestra.run.smithi101.stdout: "type_data": { 2023-08-01T19:55:09.057 INFO:teuthology.orchestra.run.smithi101.stdout: "flag_point": "commit sent; apply or cleanup", 2023-08-01T19:55:09.057 INFO:teuthology.orchestra.run.smithi101.stdout: "events": [ 2023-08-01T19:55:09.057 INFO:teuthology.orchestra.run.smithi101.stdout: { 2023-08-01T19:55:09.057 INFO:teuthology.orchestra.run.smithi101.stdout: "event": "initiated", 2023-08-01T19:55:09.057 INFO:teuthology.orchestra.run.smithi101.stdout: "time": "2023-08-01T19:54:04.458927+0000", 2023-08-01T19:55:09.057 INFO:teuthology.orchestra.run.smithi101.stdout: "duration": 0 2023-08-01T19:55:09.057 INFO:teuthology.orchestra.run.smithi101.stdout: }, 2023-08-01T19:55:09.058 INFO:teuthology.orchestra.run.smithi101.stdout: { 2023-08-01T19:55:09.058 INFO:teuthology.orchestra.run.smithi101.stdout: "event": "throttled", 2023-08-01T19:55:09.058 INFO:teuthology.orchestra.run.smithi101.stdout: "time": "2023-08-01T19:54:04.458927+0000", 2023-08-01T19:55:09.058 INFO:teuthology.orchestra.run.smithi101.stdout: "duration": 0 2023-08-01T19:55:09.058 INFO:teuthology.orchestra.run.smithi101.stdout: }, 2023-08-01T19:55:09.058 INFO:teuthology.orchestra.run.smithi101.stdout: { 2023-08-01T19:55:09.058 INFO:teuthology.orchestra.run.smithi101.stdout: "event": "header_read", 2023-08-01T19:55:09.058 INFO:teuthology.orchestra.run.smithi101.stdout: "time": "2023-08-01T19:54:04.458927+0000", 2023-08-01T19:55:09.059 INFO:teuthology.orchestra.run.smithi101.stdout: "duration": 4294967295.9999995 2023-08-01T19:55:09.059 INFO:teuthology.orchestra.run.smithi101.stdout: }, 2023-08-01T19:55:09.059 INFO:teuthology.orchestra.run.smithi101.stdout: { 2023-08-01T19:55:09.059 INFO:teuthology.orchestra.run.smithi101.stdout: "event": "all_read", 2023-08-01T19:55:09.059 INFO:teuthology.orchestra.run.smithi101.stdout: "time": "2023-08-01T19:54:04.458931+0000", 2023-08-01T19:55:09.059 INFO:teuthology.orchestra.run.smithi101.stdout: "duration": 4.3000000000000003e-06 2023-08-01T19:55:09.059 INFO:teuthology.orchestra.run.smithi101.stdout: }, 2023-08-01T19:55:09.059 INFO:teuthology.orchestra.run.smithi101.stdout: { 2023-08-01T19:55:09.060 INFO:teuthology.orchestra.run.smithi101.stdout: "event": "dispatched", 2023-08-01T19:55:09.060 INFO:teuthology.orchestra.run.smithi101.stdout: "time": "2023-08-01T19:54:04.458938+0000", 2023-08-01T19:55:09.060 INFO:teuthology.orchestra.run.smithi101.stdout: "duration": 7.3220000000000004e-06 2023-08-01T19:55:09.060 INFO:teuthology.orchestra.run.smithi101.stdout: }, 2023-08-01T19:55:09.060 INFO:teuthology.orchestra.run.smithi101.stdout: { 2023-08-01T19:55:09.060 INFO:teuthology.orchestra.run.smithi101.stdout: "event": "queued_for_pg", 2023-08-01T19:55:09.060 INFO:teuthology.orchestra.run.smithi101.stdout: "time": "2023-08-01T19:54:04.458944+0000", 2023-08-01T19:55:09.060 INFO:teuthology.orchestra.run.smithi101.stdout: "duration": 5.3040000000000004e-06 2023-08-01T19:55:09.061 INFO:teuthology.orchestra.run.smithi101.stdout: }, 2023-08-01T19:55:09.061 INFO:teuthology.orchestra.run.smithi101.stdout: { 2023-08-01T19:55:09.061 INFO:teuthology.orchestra.run.smithi101.stdout: "event": "reached_pg", 2023-08-01T19:55:09.061 INFO:teuthology.orchestra.run.smithi101.stdout: "time": "2023-08-01T19:54:04.459006+0000", 2023-08-01T19:55:09.061 INFO:teuthology.orchestra.run.smithi101.stdout: "duration": 6.2081000000000004e-05 2023-08-01T19:55:09.061 INFO:teuthology.orchestra.run.smithi101.stdout: }, 2023-08-01T19:55:09.061 INFO:teuthology.orchestra.run.smithi101.stdout: { 2023-08-01T19:55:09.061 INFO:teuthology.orchestra.run.smithi101.stdout: "event": "waiting_for_map not empty", 2023-08-01T19:55:09.062 INFO:teuthology.orchestra.run.smithi101.stdout: "time": "2023-08-01T19:54:04.459008+0000", 2023-08-01T19:55:09.062 INFO:teuthology.orchestra.run.smithi101.stdout: "duration": 2.2500000000000001e-06 2023-08-01T19:55:09.062 INFO:teuthology.orchestra.run.smithi101.stdout: }, 2023-08-01T19:55:09.062 INFO:teuthology.orchestra.run.smithi101.stdout: { 2023-08-01T19:55:09.062 INFO:teuthology.orchestra.run.smithi101.stdout: "event": "reached_pg", 2023-08-01T19:55:09.062 INFO:teuthology.orchestra.run.smithi101.stdout: "time": "2023-08-01T19:54:04.470946+0000", 2023-08-01T19:55:09.062 INFO:teuthology.orchestra.run.smithi101.stdout: "duration": 0.011938347 2023-08-01T19:55:09.062 INFO:teuthology.orchestra.run.smithi101.stdout: }, 2023-08-01T19:55:09.063 INFO:teuthology.orchestra.run.smithi101.stdout: { 2023-08-01T19:55:09.063 INFO:teuthology.orchestra.run.smithi101.stdout: "event": "started", 2023-08-01T19:55:09.063 INFO:teuthology.orchestra.run.smithi101.stdout: "time": "2023-08-01T19:54:04.471071+0000", 2023-08-01T19:55:09.063 INFO:teuthology.orchestra.run.smithi101.stdout: "duration": 0.00012470299999999999 2023-08-01T19:55:09.063 INFO:teuthology.orchestra.run.smithi101.stdout: }, 2023-08-01T19:55:09.063 INFO:teuthology.orchestra.run.smithi101.stdout: { 2023-08-01T19:55:09.063 INFO:teuthology.orchestra.run.smithi101.stdout: "event": "waiting for subops from 2", 2023-08-01T19:55:09.064 INFO:teuthology.orchestra.run.smithi101.stdout: "time": "2023-08-01T19:54:04.471205+0000", 2023-08-01T19:55:09.064 INFO:teuthology.orchestra.run.smithi101.stdout: "duration": 0.000133891 2023-08-01T19:55:09.064 INFO:teuthology.orchestra.run.smithi101.stdout: }, 2023-08-01T19:55:09.064 INFO:teuthology.orchestra.run.smithi101.stdout: { 2023-08-01T19:55:09.064 INFO:teuthology.orchestra.run.smithi101.stdout: "event": "op_commit", 2023-08-01T19:55:09.064 INFO:teuthology.orchestra.run.smithi101.stdout: "time": "2023-08-01T19:54:04.477042+0000", 2023-08-01T19:55:09.064 INFO:teuthology.orchestra.run.smithi101.stdout: "duration": 0.0058374849999999999 2023-08-01T19:55:09.064 INFO:teuthology.orchestra.run.smithi101.stdout: }, 2023-08-01T19:55:09.065 INFO:teuthology.orchestra.run.smithi101.stdout: { 2023-08-01T19:55:09.065 INFO:teuthology.orchestra.run.smithi101.stdout: "event": "sub_op_commit_rec", 2023-08-01T19:55:09.065 INFO:teuthology.orchestra.run.smithi101.stdout: "time": "2023-08-01T19:54:04.478445+0000", 2023-08-01T19:55:09.065 INFO:teuthology.orchestra.run.smithi101.stdout: "duration": 0.0014023239999999999 2023-08-01T19:55:09.065 INFO:teuthology.orchestra.run.smithi101.stdout: }, 2023-08-01T19:55:09.065 INFO:teuthology.orchestra.run.smithi101.stdout: { 2023-08-01T19:55:09.065 INFO:teuthology.orchestra.run.smithi101.stdout: "event": "commit_sent", 2023-08-01T19:55:09.065 INFO:teuthology.orchestra.run.smithi101.stdout: "time": "2023-08-01T19:54:04.478478+0000", 2023-08-01T19:55:09.066 INFO:teuthology.orchestra.run.smithi101.stdout: "duration": 3.3503000000000001e-05 2023-08-01T19:55:09.066 INFO:teuthology.orchestra.run.smithi101.stdout: }, 2023-08-01T19:55:09.066 INFO:teuthology.orchestra.run.smithi101.stdout: { 2023-08-01T19:55:09.066 INFO:teuthology.orchestra.run.smithi101.stdout: "event": "done", 2023-08-01T19:55:09.066 INFO:teuthology.orchestra.run.smithi101.stdout: "time": "2023-08-01T19:54:04.478502+0000", 2023-08-01T19:55:09.066 INFO:teuthology.orchestra.run.smithi101.stdout: "duration": 2.3402000000000001e-05 2023-08-01T19:55:09.066 INFO:teuthology.orchestra.run.smithi101.stdout: } 2023-08-01T19:55:09.066 INFO:teuthology.orchestra.run.smithi101.stdout: ] 2023-08-01T19:55:09.067 INFO:teuthology.orchestra.run.smithi101.stdout: } 2023-08-01T19:55:09.067 INFO:teuthology.orchestra.run.smithi101.stdout: }, 2023-08-01T19:55:09.067 INFO:teuthology.orchestra.run.smithi101.stdout: { 2023-08-01T19:55:09.067 INFO:teuthology.orchestra.run.smithi101.stdout: "description": "osd_op(mds.0.3:11 3.10 3:0bd6d154:::602.00000000:head [create,setxattr parent (62) in=6b,setxattr layout (30) in=6b] snapc 0=[] ondisk+write+known_if_redirected+full_force+supports_pool_eio e17)", 2023-08-01T19:55:09.067 INFO:teuthology.orchestra.run.smithi101.stdout: "initiated_at": "2023-08-01T19:54:04.458960+0000", 2023-08-01T19:55:09.067 INFO:teuthology.orchestra.run.smithi101.stdout: "age": 64.581617231999999, 2023-08-01T19:55:09.067 INFO:teuthology.orchestra.run.smithi101.stdout: "duration": 0.019645459000000001, 2023-08-01T19:55:09.067 INFO:teuthology.orchestra.run.smithi101.stdout: "type_data": { 2023-08-01T19:55:09.068 INFO:teuthology.orchestra.run.smithi101.stdout: "flag_point": "commit sent; apply or cleanup", 2023-08-01T19:55:09.068 INFO:teuthology.orchestra.run.smithi101.stdout: "events": [ 2023-08-01T19:55:09.068 INFO:teuthology.orchestra.run.smithi101.stdout: { 2023-08-01T19:55:09.068 INFO:teuthology.orchestra.run.smithi101.stdout: "event": "initiated", 2023-08-01T19:55:09.068 INFO:teuthology.orchestra.run.smithi101.stdout: "time": "2023-08-01T19:54:04.458960+0000", 2023-08-01T19:55:09.068 INFO:teuthology.orchestra.run.smithi101.stdout: "duration": 0 2023-08-01T19:55:09.068 INFO:teuthology.orchestra.run.smithi101.stdout: }, 2023-08-01T19:55:09.069 INFO:teuthology.orchestra.run.smithi101.stdout: { 2023-08-01T19:55:09.069 INFO:teuthology.orchestra.run.smithi101.stdout: "event": "throttled", 2023-08-01T19:55:09.069 INFO:teuthology.orchestra.run.smithi101.stdout: "time": "2023-08-01T19:54:04.458960+0000", 2023-08-01T19:55:09.069 INFO:teuthology.orchestra.run.smithi101.stdout: "duration": 0 2023-08-01T19:55:09.069 INFO:teuthology.orchestra.run.smithi101.stdout: }, 2023-08-01T19:55:09.069 INFO:teuthology.orchestra.run.smithi101.stdout: { 2023-08-01T19:55:09.069 INFO:teuthology.orchestra.run.smithi101.stdout: "event": "header_read", 2023-08-01T19:55:09.069 INFO:teuthology.orchestra.run.smithi101.stdout: "time": "2023-08-01T19:54:04.458959+0000", 2023-08-01T19:55:09.070 INFO:teuthology.orchestra.run.smithi101.stdout: "duration": 4294967295.9999995 2023-08-01T19:55:09.070 INFO:teuthology.orchestra.run.smithi101.stdout: }, 2023-08-01T19:55:09.070 INFO:teuthology.orchestra.run.smithi101.stdout: { 2023-08-01T19:55:09.070 INFO:teuthology.orchestra.run.smithi101.stdout: "event": "all_read", 2023-08-01T19:55:09.070 INFO:teuthology.orchestra.run.smithi101.stdout: "time": "2023-08-01T19:54:04.458963+0000", 2023-08-01T19:55:09.070 INFO:teuthology.orchestra.run.smithi101.stdout: "duration": 3.9199999999999997e-06 2023-08-01T19:55:09.070 INFO:teuthology.orchestra.run.smithi101.stdout: }, 2023-08-01T19:55:09.070 INFO:teuthology.orchestra.run.smithi101.stdout: { 2023-08-01T19:55:09.071 INFO:teuthology.orchestra.run.smithi101.stdout: "event": "dispatched", 2023-08-01T19:55:09.071 INFO:teuthology.orchestra.run.smithi101.stdout: "time": "2023-08-01T19:54:04.458970+0000", 2023-08-01T19:55:09.071 INFO:teuthology.orchestra.run.smithi101.stdout: "duration": 7.0439999999999998e-06 2023-08-01T19:55:09.071 INFO:teuthology.orchestra.run.smithi101.stdout: }, 2023-08-01T19:55:09.071 INFO:teuthology.orchestra.run.smithi101.stdout: { 2023-08-01T19:55:09.071 INFO:teuthology.orchestra.run.smithi101.stdout: "event": "queued_for_pg", 2023-08-01T19:55:09.071 INFO:teuthology.orchestra.run.smithi101.stdout: "time": "2023-08-01T19:54:04.458976+0000", 2023-08-01T19:55:09.071 INFO:teuthology.orchestra.run.smithi101.stdout: "duration": 5.9540000000000001e-06 2023-08-01T19:55:09.072 INFO:teuthology.orchestra.run.smithi101.stdout: }, 2023-08-01T19:55:09.072 INFO:teuthology.orchestra.run.smithi101.stdout: { 2023-08-01T19:55:09.072 INFO:teuthology.orchestra.run.smithi101.stdout: "event": "reached_pg", 2023-08-01T19:55:09.072 INFO:teuthology.orchestra.run.smithi101.stdout: "time": "2023-08-01T19:54:04.459035+0000", 2023-08-01T19:55:09.072 INFO:teuthology.orchestra.run.smithi101.stdout: "duration": 5.8924e-05 2023-08-01T19:55:09.072 INFO:teuthology.orchestra.run.smithi101.stdout: }, 2023-08-01T19:55:09.072 INFO:teuthology.orchestra.run.smithi101.stdout: { 2023-08-01T19:55:09.073 INFO:teuthology.orchestra.run.smithi101.stdout: "event": "waiting_for_map not empty", 2023-08-01T19:55:09.073 INFO:teuthology.orchestra.run.smithi101.stdout: "time": "2023-08-01T19:54:04.459038+0000", 2023-08-01T19:55:09.073 INFO:teuthology.orchestra.run.smithi101.stdout: "duration": 3.2760000000000001e-06 2023-08-01T19:55:09.073 INFO:teuthology.orchestra.run.smithi101.stdout: }, 2023-08-01T19:55:09.073 INFO:teuthology.orchestra.run.smithi101.stdout: { 2023-08-01T19:55:09.073 INFO:teuthology.orchestra.run.smithi101.stdout: "event": "reached_pg", 2023-08-01T19:55:09.073 INFO:teuthology.orchestra.run.smithi101.stdout: "time": "2023-08-01T19:54:04.471511+0000", 2023-08-01T19:55:09.073 INFO:teuthology.orchestra.run.smithi101.stdout: "duration": 0.012473039999999999 2023-08-01T19:55:09.074 INFO:teuthology.orchestra.run.smithi101.stdout: }, 2023-08-01T19:55:09.074 INFO:teuthology.orchestra.run.smithi101.stdout: { 2023-08-01T19:55:09.074 INFO:teuthology.orchestra.run.smithi101.stdout: "event": "started", 2023-08-01T19:55:09.074 INFO:teuthology.orchestra.run.smithi101.stdout: "time": "2023-08-01T19:54:04.472086+0000", 2023-08-01T19:55:09.074 INFO:teuthology.orchestra.run.smithi101.stdout: "duration": 0.00057491699999999998 2023-08-01T19:55:09.074 INFO:teuthology.orchestra.run.smithi101.stdout: }, 2023-08-01T19:55:09.074 INFO:teuthology.orchestra.run.smithi101.stdout: { 2023-08-01T19:55:09.074 INFO:teuthology.orchestra.run.smithi101.stdout: "event": "waiting for subops from 2", 2023-08-01T19:55:09.075 INFO:teuthology.orchestra.run.smithi101.stdout: "time": "2023-08-01T19:54:04.472310+0000", 2023-08-01T19:55:09.075 INFO:teuthology.orchestra.run.smithi101.stdout: "duration": 0.00022396499999999999 2023-08-01T19:55:09.075 INFO:teuthology.orchestra.run.smithi101.stdout: }, 2023-08-01T19:55:09.075 INFO:teuthology.orchestra.run.smithi101.stdout: { 2023-08-01T19:55:09.075 INFO:teuthology.orchestra.run.smithi101.stdout: "event": "op_commit", 2023-08-01T19:55:09.075 INFO:teuthology.orchestra.run.smithi101.stdout: "time": "2023-08-01T19:54:04.478141+0000", 2023-08-01T19:55:09.075 INFO:teuthology.orchestra.run.smithi101.stdout: "duration": 0.0058312320000000004 2023-08-01T19:55:09.075 INFO:teuthology.orchestra.run.smithi101.stdout: }, 2023-08-01T19:55:09.076 INFO:teuthology.orchestra.run.smithi101.stdout: { 2023-08-01T19:55:09.076 INFO:teuthology.orchestra.run.smithi101.stdout: "event": "sub_op_commit_rec", 2023-08-01T19:55:09.076 INFO:teuthology.orchestra.run.smithi101.stdout: "time": "2023-08-01T19:54:04.478543+0000", 2023-08-01T19:55:09.076 INFO:teuthology.orchestra.run.smithi101.stdout: "duration": 0.00040160800000000002 2023-08-01T19:55:09.076 INFO:teuthology.orchestra.run.smithi101.stdout: }, 2023-08-01T19:55:09.076 INFO:teuthology.orchestra.run.smithi101.stdout: { 2023-08-01T19:55:09.076 INFO:teuthology.orchestra.run.smithi101.stdout: "event": "commit_sent", 2023-08-01T19:55:09.076 INFO:teuthology.orchestra.run.smithi101.stdout: "time": "2023-08-01T19:54:04.478584+0000", 2023-08-01T19:55:09.077 INFO:teuthology.orchestra.run.smithi101.stdout: "duration": 4.0989999999999999e-05 2023-08-01T19:55:09.077 INFO:teuthology.orchestra.run.smithi101.stdout: }, 2023-08-01T19:55:09.077 INFO:teuthology.orchestra.run.smithi101.stdout: { 2023-08-01T19:55:09.077 INFO:teuthology.orchestra.run.smithi101.stdout: "event": "done", 2023-08-01T19:55:09.077 INFO:teuthology.orchestra.run.smithi101.stdout: "time": "2023-08-01T19:54:04.478605+0000", 2023-08-01T19:55:09.077 INFO:teuthology.orchestra.run.smithi101.stdout: "duration": 2.1178e-05 2023-08-01T19:55:09.077 INFO:teuthology.orchestra.run.smithi101.stdout: } 2023-08-01T19:55:09.077 INFO:teuthology.orchestra.run.smithi101.stdout: ] 2023-08-01T19:55:09.078 INFO:teuthology.orchestra.run.smithi101.stdout: } 2023-08-01T19:55:09.078 INFO:teuthology.orchestra.run.smithi101.stdout: }, 2023-08-01T19:55:09.078 INFO:teuthology.orchestra.run.smithi101.stdout: { 2023-08-01T19:55:09.078 INFO:teuthology.orchestra.run.smithi101.stdout: "description": "osd_op(mds.0.3:12 3.10 3:0d89b25e:::603.00000000:head [omap-set-header] snapc 0=[] ondisk+write+known_if_redirected+full_force+supports_pool_eio e17)", 2023-08-01T19:55:09.078 INFO:teuthology.orchestra.run.smithi101.stdout: "initiated_at": "2023-08-01T19:54:04.458982+0000", 2023-08-01T19:55:09.078 INFO:teuthology.orchestra.run.smithi101.stdout: "age": 64.581595003999993, 2023-08-01T19:55:09.078 INFO:teuthology.orchestra.run.smithi101.stdout: "duration": 0.021266334000000001, 2023-08-01T19:55:09.079 INFO:teuthology.orchestra.run.smithi101.stdout: "type_data": { 2023-08-01T19:55:09.079 INFO:teuthology.orchestra.run.smithi101.stdout: "flag_point": "commit sent; apply or cleanup", 2023-08-01T19:55:09.079 INFO:teuthology.orchestra.run.smithi101.stdout: "events": [ 2023-08-01T19:55:09.079 INFO:teuthology.orchestra.run.smithi101.stdout: { 2023-08-01T19:55:09.079 INFO:teuthology.orchestra.run.smithi101.stdout: "event": "initiated", 2023-08-01T19:55:09.079 INFO:teuthology.orchestra.run.smithi101.stdout: "time": "2023-08-01T19:54:04.458982+0000", 2023-08-01T19:55:09.079 INFO:teuthology.orchestra.run.smithi101.stdout: "duration": 0 2023-08-01T19:55:09.079 INFO:teuthology.orchestra.run.smithi101.stdout: }, 2023-08-01T19:55:09.080 INFO:teuthology.orchestra.run.smithi101.stdout: { 2023-08-01T19:55:09.080 INFO:teuthology.orchestra.run.smithi101.stdout: "event": "throttled", 2023-08-01T19:55:09.080 INFO:teuthology.orchestra.run.smithi101.stdout: "time": "2023-08-01T19:54:04.458982+0000", 2023-08-01T19:55:09.080 INFO:teuthology.orchestra.run.smithi101.stdout: "duration": 0 2023-08-01T19:55:09.080 INFO:teuthology.orchestra.run.smithi101.stdout: }, 2023-08-01T19:55:09.080 INFO:teuthology.orchestra.run.smithi101.stdout: { 2023-08-01T19:55:09.080 INFO:teuthology.orchestra.run.smithi101.stdout: "event": "header_read", 2023-08-01T19:55:09.080 INFO:teuthology.orchestra.run.smithi101.stdout: "time": "2023-08-01T19:54:04.458982+0000", 2023-08-01T19:55:09.081 INFO:teuthology.orchestra.run.smithi101.stdout: "duration": 4294967295.9999995 2023-08-01T19:55:09.081 INFO:teuthology.orchestra.run.smithi101.stdout: }, 2023-08-01T19:55:09.081 INFO:teuthology.orchestra.run.smithi101.stdout: { 2023-08-01T19:55:09.081 INFO:teuthology.orchestra.run.smithi101.stdout: "event": "all_read", 2023-08-01T19:55:09.081 INFO:teuthology.orchestra.run.smithi101.stdout: "time": "2023-08-01T19:54:04.458985+0000", 2023-08-01T19:55:09.081 INFO:teuthology.orchestra.run.smithi101.stdout: "duration": 3.4800000000000001e-06 2023-08-01T19:55:09.081 INFO:teuthology.orchestra.run.smithi101.stdout: }, 2023-08-01T19:55:09.081 INFO:teuthology.orchestra.run.smithi101.stdout: { 2023-08-01T19:55:09.082 INFO:teuthology.orchestra.run.smithi101.stdout: "event": "dispatched", 2023-08-01T19:55:09.082 INFO:teuthology.orchestra.run.smithi101.stdout: "time": "2023-08-01T19:54:04.458992+0000", 2023-08-01T19:55:09.082 INFO:teuthology.orchestra.run.smithi101.stdout: "duration": 7.306e-06 2023-08-01T19:55:09.082 INFO:teuthology.orchestra.run.smithi101.stdout: }, 2023-08-01T19:55:09.082 INFO:teuthology.orchestra.run.smithi101.stdout: { 2023-08-01T19:55:09.082 INFO:teuthology.orchestra.run.smithi101.stdout: "event": "queued_for_pg", 2023-08-01T19:55:09.082 INFO:teuthology.orchestra.run.smithi101.stdout: "time": "2023-08-01T19:54:04.458997+0000", 2023-08-01T19:55:09.082 INFO:teuthology.orchestra.run.smithi101.stdout: "duration": 4.4530000000000004e-06 2023-08-01T19:55:09.083 INFO:teuthology.orchestra.run.smithi101.stdout: }, 2023-08-01T19:55:09.083 INFO:teuthology.orchestra.run.smithi101.stdout: { 2023-08-01T19:55:09.083 INFO:teuthology.orchestra.run.smithi101.stdout: "event": "reached_pg", 2023-08-01T19:55:09.083 INFO:teuthology.orchestra.run.smithi101.stdout: "time": "2023-08-01T19:54:04.459060+0000", 2023-08-01T19:55:09.083 INFO:teuthology.orchestra.run.smithi101.stdout: "duration": 6.3249000000000004e-05 2023-08-01T19:55:09.083 INFO:teuthology.orchestra.run.smithi101.stdout: }, 2023-08-01T19:55:09.083 INFO:teuthology.orchestra.run.smithi101.stdout: { 2023-08-01T19:55:09.083 INFO:teuthology.orchestra.run.smithi101.stdout: "event": "waiting_for_map not empty", 2023-08-01T19:55:09.084 INFO:teuthology.orchestra.run.smithi101.stdout: "time": "2023-08-01T19:54:04.459063+0000", 2023-08-01T19:55:09.084 INFO:teuthology.orchestra.run.smithi101.stdout: "duration": 2.717e-06 2023-08-01T19:55:09.084 INFO:teuthology.orchestra.run.smithi101.stdout: }, 2023-08-01T19:55:09.084 INFO:teuthology.orchestra.run.smithi101.stdout: { 2023-08-01T19:55:09.084 INFO:teuthology.orchestra.run.smithi101.stdout: "event": "reached_pg", 2023-08-01T19:55:09.084 INFO:teuthology.orchestra.run.smithi101.stdout: "time": "2023-08-01T19:54:04.473625+0000", 2023-08-01T19:55:09.084 INFO:teuthology.orchestra.run.smithi101.stdout: "duration": 0.014562007 2023-08-01T19:55:09.085 INFO:teuthology.orchestra.run.smithi101.stdout: }, 2023-08-01T19:55:09.085 INFO:teuthology.orchestra.run.smithi101.stdout: { 2023-08-01T19:55:09.085 INFO:teuthology.orchestra.run.smithi101.stdout: "event": "started", 2023-08-01T19:55:09.085 INFO:teuthology.orchestra.run.smithi101.stdout: "time": "2023-08-01T19:54:04.473757+0000", 2023-08-01T19:55:09.085 INFO:teuthology.orchestra.run.smithi101.stdout: "duration": 0.00013238599999999999 2023-08-01T19:55:09.085 INFO:teuthology.orchestra.run.smithi101.stdout: }, 2023-08-01T19:55:09.085 INFO:teuthology.orchestra.run.smithi101.stdout: { 2023-08-01T19:55:09.085 INFO:teuthology.orchestra.run.smithi101.stdout: "event": "waiting for subops from 2", 2023-08-01T19:55:09.086 INFO:teuthology.orchestra.run.smithi101.stdout: "time": "2023-08-01T19:54:04.473898+0000", 2023-08-01T19:55:09.086 INFO:teuthology.orchestra.run.smithi101.stdout: "duration": 0.00014039 2023-08-01T19:55:09.086 INFO:teuthology.orchestra.run.smithi101.stdout: }, 2023-08-01T19:55:09.086 INFO:teuthology.orchestra.run.smithi101.stdout: { 2023-08-01T19:55:09.086 INFO:teuthology.orchestra.run.smithi101.stdout: "event": "op_commit", 2023-08-01T19:55:09.086 INFO:teuthology.orchestra.run.smithi101.stdout: "time": "2023-08-01T19:54:04.478380+0000", 2023-08-01T19:55:09.086 INFO:teuthology.orchestra.run.smithi101.stdout: "duration": 0.0044827449999999998 2023-08-01T19:55:09.086 INFO:teuthology.orchestra.run.smithi101.stdout: }, 2023-08-01T19:55:09.087 INFO:teuthology.orchestra.run.smithi101.stdout: { 2023-08-01T19:55:09.087 INFO:teuthology.orchestra.run.smithi101.stdout: "event": "sub_op_commit_rec", 2023-08-01T19:55:09.087 INFO:teuthology.orchestra.run.smithi101.stdout: "time": "2023-08-01T19:54:04.480169+0000", 2023-08-01T19:55:09.087 INFO:teuthology.orchestra.run.smithi101.stdout: "duration": 0.0017886040000000001 2023-08-01T19:55:09.087 INFO:teuthology.orchestra.run.smithi101.stdout: }, 2023-08-01T19:55:09.087 INFO:teuthology.orchestra.run.smithi101.stdout: { 2023-08-01T19:55:09.087 INFO:teuthology.orchestra.run.smithi101.stdout: "event": "commit_sent", 2023-08-01T19:55:09.087 INFO:teuthology.orchestra.run.smithi101.stdout: "time": "2023-08-01T19:54:04.480212+0000", 2023-08-01T19:55:09.088 INFO:teuthology.orchestra.run.smithi101.stdout: "duration": 4.2687e-05 2023-08-01T19:55:09.088 INFO:teuthology.orchestra.run.smithi101.stdout: }, 2023-08-01T19:55:09.088 INFO:teuthology.orchestra.run.smithi101.stdout: { 2023-08-01T19:55:09.088 INFO:teuthology.orchestra.run.smithi101.stdout: "event": "done", 2023-08-01T19:55:09.088 INFO:teuthology.orchestra.run.smithi101.stdout: "time": "2023-08-01T19:54:04.480248+0000", 2023-08-01T19:55:09.088 INFO:teuthology.orchestra.run.smithi101.stdout: "duration": 3.6743999999999999e-05 2023-08-01T19:55:09.088 INFO:teuthology.orchestra.run.smithi101.stdout: } 2023-08-01T19:55:09.088 INFO:teuthology.orchestra.run.smithi101.stdout: ] 2023-08-01T19:55:09.089 INFO:teuthology.orchestra.run.smithi101.stdout: } 2023-08-01T19:55:09.089 INFO:teuthology.orchestra.run.smithi101.stdout: }, 2023-08-01T19:55:09.089 INFO:teuthology.orchestra.run.smithi101.stdout: { 2023-08-01T19:55:09.089 INFO:teuthology.orchestra.run.smithi101.stdout: "description": "osd_op(mds.0.3:13 3.10 3:0d89b25e:::603.00000000:head [create,setxattr parent (62) in=6b,setxattr layout (30) in=6b] snapc 0=[] ondisk+write+known_if_redirected+full_force+supports_pool_eio e17)", 2023-08-01T19:55:09.089 INFO:teuthology.orchestra.run.smithi101.stdout: "initiated_at": "2023-08-01T19:54:04.459010+0000", 2023-08-01T19:55:09.089 INFO:teuthology.orchestra.run.smithi101.stdout: "age": 64.581567284000002, 2023-08-01T19:55:09.089 INFO:teuthology.orchestra.run.smithi101.stdout: "duration": 0.021327220000000001, 2023-08-01T19:55:09.089 INFO:teuthology.orchestra.run.smithi101.stdout: "type_data": { 2023-08-01T19:55:09.090 INFO:teuthology.orchestra.run.smithi101.stdout: "flag_point": "commit sent; apply or cleanup", 2023-08-01T19:55:09.090 INFO:teuthology.orchestra.run.smithi101.stdout: "events": [ 2023-08-01T19:55:09.090 INFO:teuthology.orchestra.run.smithi101.stdout: { 2023-08-01T19:55:09.090 INFO:teuthology.orchestra.run.smithi101.stdout: "event": "initiated", 2023-08-01T19:55:09.090 INFO:teuthology.orchestra.run.smithi101.stdout: "time": "2023-08-01T19:54:04.459010+0000", 2023-08-01T19:55:09.090 INFO:teuthology.orchestra.run.smithi101.stdout: "duration": 0 2023-08-01T19:55:09.090 INFO:teuthology.orchestra.run.smithi101.stdout: }, 2023-08-01T19:55:09.091 INFO:teuthology.orchestra.run.smithi101.stdout: { 2023-08-01T19:55:09.091 INFO:teuthology.orchestra.run.smithi101.stdout: "event": "throttled", 2023-08-01T19:55:09.091 INFO:teuthology.orchestra.run.smithi101.stdout: "time": "2023-08-01T19:54:04.459010+0000", 2023-08-01T19:55:09.091 INFO:teuthology.orchestra.run.smithi101.stdout: "duration": 0 2023-08-01T19:55:09.091 INFO:teuthology.orchestra.run.smithi101.stdout: }, 2023-08-01T19:55:09.091 INFO:teuthology.orchestra.run.smithi101.stdout: { 2023-08-01T19:55:09.091 INFO:teuthology.orchestra.run.smithi101.stdout: "event": "header_read", 2023-08-01T19:55:09.091 INFO:teuthology.orchestra.run.smithi101.stdout: "time": "2023-08-01T19:54:04.459009+0000", 2023-08-01T19:55:09.092 INFO:teuthology.orchestra.run.smithi101.stdout: "duration": 4294967295.9999995 2023-08-01T19:55:09.092 INFO:teuthology.orchestra.run.smithi101.stdout: }, 2023-08-01T19:55:09.092 INFO:teuthology.orchestra.run.smithi101.stdout: { 2023-08-01T19:55:09.092 INFO:teuthology.orchestra.run.smithi101.stdout: "event": "all_read", 2023-08-01T19:55:09.092 INFO:teuthology.orchestra.run.smithi101.stdout: "time": "2023-08-01T19:54:04.459013+0000", 2023-08-01T19:55:09.092 INFO:teuthology.orchestra.run.smithi101.stdout: "duration": 3.8929999999999998e-06 2023-08-01T19:55:09.092 INFO:teuthology.orchestra.run.smithi101.stdout: }, 2023-08-01T19:55:09.092 INFO:teuthology.orchestra.run.smithi101.stdout: { 2023-08-01T19:55:09.093 INFO:teuthology.orchestra.run.smithi101.stdout: "event": "dispatched", 2023-08-01T19:55:09.093 INFO:teuthology.orchestra.run.smithi101.stdout: "time": "2023-08-01T19:54:04.459027+0000", 2023-08-01T19:55:09.093 INFO:teuthology.orchestra.run.smithi101.stdout: "duration": 1.3416e-05 2023-08-01T19:55:09.093 INFO:teuthology.orchestra.run.smithi101.stdout: }, 2023-08-01T19:55:09.093 INFO:teuthology.orchestra.run.smithi101.stdout: { 2023-08-01T19:55:09.093 INFO:teuthology.orchestra.run.smithi101.stdout: "event": "queued_for_pg", 2023-08-01T19:55:09.093 INFO:teuthology.orchestra.run.smithi101.stdout: "time": "2023-08-01T19:54:04.459033+0000", 2023-08-01T19:55:09.093 INFO:teuthology.orchestra.run.smithi101.stdout: "duration": 5.9800000000000003e-06 2023-08-01T19:55:09.094 INFO:teuthology.orchestra.run.smithi101.stdout: }, 2023-08-01T19:55:09.094 INFO:teuthology.orchestra.run.smithi101.stdout: { 2023-08-01T19:55:09.094 INFO:teuthology.orchestra.run.smithi101.stdout: "event": "reached_pg", 2023-08-01T19:55:09.094 INFO:teuthology.orchestra.run.smithi101.stdout: "time": "2023-08-01T19:54:04.459099+0000", 2023-08-01T19:55:09.094 INFO:teuthology.orchestra.run.smithi101.stdout: "duration": 6.6192999999999995e-05 2023-08-01T19:55:09.094 INFO:teuthology.orchestra.run.smithi101.stdout: }, 2023-08-01T19:55:09.094 INFO:teuthology.orchestra.run.smithi101.stdout: { 2023-08-01T19:55:09.094 INFO:teuthology.orchestra.run.smithi101.stdout: "event": "waiting_for_map not empty", 2023-08-01T19:55:09.095 INFO:teuthology.orchestra.run.smithi101.stdout: "time": "2023-08-01T19:54:04.459106+0000", 2023-08-01T19:55:09.095 INFO:teuthology.orchestra.run.smithi101.stdout: "duration": 6.8619999999999997e-06 2023-08-01T19:55:09.095 INFO:teuthology.orchestra.run.smithi101.stdout: }, 2023-08-01T19:55:09.095 INFO:teuthology.orchestra.run.smithi101.stdout: { 2023-08-01T19:55:09.095 INFO:teuthology.orchestra.run.smithi101.stdout: "event": "reached_pg", 2023-08-01T19:55:09.095 INFO:teuthology.orchestra.run.smithi101.stdout: "time": "2023-08-01T19:54:04.475182+0000", 2023-08-01T19:55:09.095 INFO:teuthology.orchestra.run.smithi101.stdout: "duration": 0.016076333000000002 2023-08-01T19:55:09.095 INFO:teuthology.orchestra.run.smithi101.stdout: }, 2023-08-01T19:55:09.096 INFO:teuthology.orchestra.run.smithi101.stdout: { 2023-08-01T19:55:09.096 INFO:teuthology.orchestra.run.smithi101.stdout: "event": "started", 2023-08-01T19:55:09.096 INFO:teuthology.orchestra.run.smithi101.stdout: "time": "2023-08-01T19:54:04.475353+0000", 2023-08-01T19:55:09.096 INFO:teuthology.orchestra.run.smithi101.stdout: "duration": 0.000171378 2023-08-01T19:55:09.096 INFO:teuthology.orchestra.run.smithi101.stdout: }, 2023-08-01T19:55:09.096 INFO:teuthology.orchestra.run.smithi101.stdout: { 2023-08-01T19:55:09.096 INFO:teuthology.orchestra.run.smithi101.stdout: "event": "waiting for subops from 2", 2023-08-01T19:55:09.097 INFO:teuthology.orchestra.run.smithi101.stdout: "time": "2023-08-01T19:54:04.475793+0000", 2023-08-01T19:55:09.097 INFO:teuthology.orchestra.run.smithi101.stdout: "duration": 0.000440123 2023-08-01T19:55:09.097 INFO:teuthology.orchestra.run.smithi101.stdout: }, 2023-08-01T19:55:09.097 INFO:teuthology.orchestra.run.smithi101.stdout: { 2023-08-01T19:55:09.097 INFO:teuthology.orchestra.run.smithi101.stdout: "event": "op_commit", 2023-08-01T19:55:09.097 INFO:teuthology.orchestra.run.smithi101.stdout: "time": "2023-08-01T19:54:04.478624+0000", 2023-08-01T19:55:09.097 INFO:teuthology.orchestra.run.smithi101.stdout: "duration": 0.0028305000000000001 2023-08-01T19:55:09.097 INFO:teuthology.orchestra.run.smithi101.stdout: }, 2023-08-01T19:55:09.098 INFO:teuthology.orchestra.run.smithi101.stdout: { 2023-08-01T19:55:09.098 INFO:teuthology.orchestra.run.smithi101.stdout: "event": "sub_op_commit_rec", 2023-08-01T19:55:09.098 INFO:teuthology.orchestra.run.smithi101.stdout: "time": "2023-08-01T19:54:04.480291+0000", 2023-08-01T19:55:09.098 INFO:teuthology.orchestra.run.smithi101.stdout: "duration": 0.0016670000000000001 2023-08-01T19:55:09.098 INFO:teuthology.orchestra.run.smithi101.stdout: }, 2023-08-01T19:55:09.098 INFO:teuthology.orchestra.run.smithi101.stdout: { 2023-08-01T19:55:09.098 INFO:teuthology.orchestra.run.smithi101.stdout: "event": "commit_sent", 2023-08-01T19:55:09.098 INFO:teuthology.orchestra.run.smithi101.stdout: "time": "2023-08-01T19:54:04.480318+0000", 2023-08-01T19:55:09.099 INFO:teuthology.orchestra.run.smithi101.stdout: "duration": 2.6815e-05 2023-08-01T19:55:09.099 INFO:teuthology.orchestra.run.smithi101.stdout: }, 2023-08-01T19:55:09.099 INFO:teuthology.orchestra.run.smithi101.stdout: { 2023-08-01T19:55:09.099 INFO:teuthology.orchestra.run.smithi101.stdout: "event": "done", 2023-08-01T19:55:09.099 INFO:teuthology.orchestra.run.smithi101.stdout: "time": "2023-08-01T19:54:04.480337+0000", 2023-08-01T19:55:09.099 INFO:teuthology.orchestra.run.smithi101.stdout: "duration": 1.9241000000000001e-05 2023-08-01T19:55:09.099 INFO:teuthology.orchestra.run.smithi101.stdout: } 2023-08-01T19:55:09.099 INFO:teuthology.orchestra.run.smithi101.stdout: ] 2023-08-01T19:55:09.100 INFO:teuthology.orchestra.run.smithi101.stdout: } 2023-08-01T19:55:09.100 INFO:teuthology.orchestra.run.smithi101.stdout: }, 2023-08-01T19:55:09.100 INFO:teuthology.orchestra.run.smithi101.stdout: { 2023-08-01T19:55:09.100 INFO:teuthology.orchestra.run.smithi101.stdout: "description": "osd_op(mds.0.3:18 3.14 3:2f55791f:::606.00000000:head [omap-set-header] snapc 0=[] ondisk+write+known_if_redirected+full_force+supports_pool_eio e17)", 2023-08-01T19:55:09.100 INFO:teuthology.orchestra.run.smithi101.stdout: "initiated_at": "2023-08-01T19:54:04.459039+0000", 2023-08-01T19:55:09.100 INFO:teuthology.orchestra.run.smithi101.stdout: "age": 64.581537990000001, 2023-08-01T19:55:09.100 INFO:teuthology.orchestra.run.smithi101.stdout: "duration": 0.018756419, 2023-08-01T19:55:09.101 INFO:teuthology.orchestra.run.smithi101.stdout: "type_data": { 2023-08-01T19:55:09.101 INFO:teuthology.orchestra.run.smithi101.stdout: "flag_point": "commit sent; apply or cleanup", 2023-08-01T19:55:09.101 INFO:teuthology.orchestra.run.smithi101.stdout: "events": [ 2023-08-01T19:55:09.101 INFO:teuthology.orchestra.run.smithi101.stdout: { 2023-08-01T19:55:09.101 INFO:teuthology.orchestra.run.smithi101.stdout: "event": "initiated", 2023-08-01T19:55:09.101 INFO:teuthology.orchestra.run.smithi101.stdout: "time": "2023-08-01T19:54:04.459039+0000", 2023-08-01T19:55:09.101 INFO:teuthology.orchestra.run.smithi101.stdout: "duration": 0 2023-08-01T19:55:09.101 INFO:teuthology.orchestra.run.smithi101.stdout: }, 2023-08-01T19:55:09.102 INFO:teuthology.orchestra.run.smithi101.stdout: { 2023-08-01T19:55:09.102 INFO:teuthology.orchestra.run.smithi101.stdout: "event": "throttled", 2023-08-01T19:55:09.102 INFO:teuthology.orchestra.run.smithi101.stdout: "time": "2023-08-01T19:54:04.459039+0000", 2023-08-01T19:55:09.102 INFO:teuthology.orchestra.run.smithi101.stdout: "duration": 0 2023-08-01T19:55:09.102 INFO:teuthology.orchestra.run.smithi101.stdout: }, 2023-08-01T19:55:09.102 INFO:teuthology.orchestra.run.smithi101.stdout: { 2023-08-01T19:55:09.102 INFO:teuthology.orchestra.run.smithi101.stdout: "event": "header_read", 2023-08-01T19:55:09.102 INFO:teuthology.orchestra.run.smithi101.stdout: "time": "2023-08-01T19:54:04.459039+0000", 2023-08-01T19:55:09.103 INFO:teuthology.orchestra.run.smithi101.stdout: "duration": 4294967295.9999995 2023-08-01T19:55:09.103 INFO:teuthology.orchestra.run.smithi101.stdout: }, 2023-08-01T19:55:09.103 INFO:teuthology.orchestra.run.smithi101.stdout: { 2023-08-01T19:55:09.103 INFO:teuthology.orchestra.run.smithi101.stdout: "event": "all_read", 2023-08-01T19:55:09.103 INFO:teuthology.orchestra.run.smithi101.stdout: "time": "2023-08-01T19:54:04.459043+0000", 2023-08-01T19:55:09.103 INFO:teuthology.orchestra.run.smithi101.stdout: "duration": 4.1500000000000001e-06 2023-08-01T19:55:09.103 INFO:teuthology.orchestra.run.smithi101.stdout: }, 2023-08-01T19:55:09.103 INFO:teuthology.orchestra.run.smithi101.stdout: { 2023-08-01T19:55:09.104 INFO:teuthology.orchestra.run.smithi101.stdout: "event": "dispatched", 2023-08-01T19:55:09.104 INFO:teuthology.orchestra.run.smithi101.stdout: "time": "2023-08-01T19:54:04.459051+0000", 2023-08-01T19:55:09.104 INFO:teuthology.orchestra.run.smithi101.stdout: "duration": 8.4190000000000002e-06 2023-08-01T19:55:09.104 INFO:teuthology.orchestra.run.smithi101.stdout: }, 2023-08-01T19:55:09.104 INFO:teuthology.orchestra.run.smithi101.stdout: { 2023-08-01T19:55:09.104 INFO:teuthology.orchestra.run.smithi101.stdout: "event": "queued_for_pg", 2023-08-01T19:55:09.104 INFO:teuthology.orchestra.run.smithi101.stdout: "time": "2023-08-01T19:54:04.459056+0000", 2023-08-01T19:55:09.104 INFO:teuthology.orchestra.run.smithi101.stdout: "duration": 5.339e-06 2023-08-01T19:55:09.105 INFO:teuthology.orchestra.run.smithi101.stdout: }, 2023-08-01T19:55:09.105 INFO:teuthology.orchestra.run.smithi101.stdout: { 2023-08-01T19:55:09.105 INFO:teuthology.orchestra.run.smithi101.stdout: "event": "reached_pg", 2023-08-01T19:55:09.105 INFO:teuthology.orchestra.run.smithi101.stdout: "time": "2023-08-01T19:54:04.459091+0000", 2023-08-01T19:55:09.105 INFO:teuthology.orchestra.run.smithi101.stdout: "duration": 3.4090000000000001e-05 2023-08-01T19:55:09.105 INFO:teuthology.orchestra.run.smithi101.stdout: }, 2023-08-01T19:55:09.105 INFO:teuthology.orchestra.run.smithi101.stdout: { 2023-08-01T19:55:09.105 INFO:teuthology.orchestra.run.smithi101.stdout: "event": "op must wait for map", 2023-08-01T19:55:09.106 INFO:teuthology.orchestra.run.smithi101.stdout: "time": "2023-08-01T19:54:04.459094+0000", 2023-08-01T19:55:09.106 INFO:teuthology.orchestra.run.smithi101.stdout: "duration": 3.303e-06 2023-08-01T19:55:09.106 INFO:teuthology.orchestra.run.smithi101.stdout: }, 2023-08-01T19:55:09.106 INFO:teuthology.orchestra.run.smithi101.stdout: { 2023-08-01T19:55:09.106 INFO:teuthology.orchestra.run.smithi101.stdout: "event": "reached_pg", 2023-08-01T19:55:09.106 INFO:teuthology.orchestra.run.smithi101.stdout: "time": "2023-08-01T19:54:04.469860+0000", 2023-08-01T19:55:09.106 INFO:teuthology.orchestra.run.smithi101.stdout: "duration": 0.010765749 2023-08-01T19:55:09.106 INFO:teuthology.orchestra.run.smithi101.stdout: }, 2023-08-01T19:55:09.107 INFO:teuthology.orchestra.run.smithi101.stdout: { 2023-08-01T19:55:09.107 INFO:teuthology.orchestra.run.smithi101.stdout: "event": "started", 2023-08-01T19:55:09.107 INFO:teuthology.orchestra.run.smithi101.stdout: "time": "2023-08-01T19:54:04.470008+0000", 2023-08-01T19:55:09.107 INFO:teuthology.orchestra.run.smithi101.stdout: "duration": 0.000148367 2023-08-01T19:55:09.107 INFO:teuthology.orchestra.run.smithi101.stdout: }, 2023-08-01T19:55:09.107 INFO:teuthology.orchestra.run.smithi101.stdout: { 2023-08-01T19:55:09.107 INFO:teuthology.orchestra.run.smithi101.stdout: "event": "waiting for subops from 2", 2023-08-01T19:55:09.107 INFO:teuthology.orchestra.run.smithi101.stdout: "time": "2023-08-01T19:54:04.470136+0000", 2023-08-01T19:55:09.108 INFO:teuthology.orchestra.run.smithi101.stdout: "duration": 0.000128329 2023-08-01T19:55:09.108 INFO:teuthology.orchestra.run.smithi101.stdout: }, 2023-08-01T19:55:09.108 INFO:teuthology.orchestra.run.smithi101.stdout: { 2023-08-01T19:55:09.108 INFO:teuthology.orchestra.run.smithi101.stdout: "event": "op_commit", 2023-08-01T19:55:09.108 INFO:teuthology.orchestra.run.smithi101.stdout: "time": "2023-08-01T19:54:04.476399+0000", 2023-08-01T19:55:09.108 INFO:teuthology.orchestra.run.smithi101.stdout: "duration": 0.0062627259999999997 2023-08-01T19:55:09.108 INFO:teuthology.orchestra.run.smithi101.stdout: }, 2023-08-01T19:55:09.109 INFO:teuthology.orchestra.run.smithi101.stdout: { 2023-08-01T19:55:09.109 INFO:teuthology.orchestra.run.smithi101.stdout: "event": "sub_op_commit_rec", 2023-08-01T19:55:09.109 INFO:teuthology.orchestra.run.smithi101.stdout: "time": "2023-08-01T19:54:04.477726+0000", 2023-08-01T19:55:09.109 INFO:teuthology.orchestra.run.smithi101.stdout: "duration": 0.001327103 2023-08-01T19:55:09.109 INFO:teuthology.orchestra.run.smithi101.stdout: }, 2023-08-01T19:55:09.109 INFO:teuthology.orchestra.run.smithi101.stdout: { 2023-08-01T19:55:09.109 INFO:teuthology.orchestra.run.smithi101.stdout: "event": "commit_sent", 2023-08-01T19:55:09.109 INFO:teuthology.orchestra.run.smithi101.stdout: "time": "2023-08-01T19:54:04.477771+0000", 2023-08-01T19:55:09.110 INFO:teuthology.orchestra.run.smithi101.stdout: "duration": 4.5232000000000003e-05 2023-08-01T19:55:09.110 INFO:teuthology.orchestra.run.smithi101.stdout: }, 2023-08-01T19:55:09.110 INFO:teuthology.orchestra.run.smithi101.stdout: { 2023-08-01T19:55:09.110 INFO:teuthology.orchestra.run.smithi101.stdout: "event": "done", 2023-08-01T19:55:09.110 INFO:teuthology.orchestra.run.smithi101.stdout: "time": "2023-08-01T19:54:04.477795+0000", 2023-08-01T19:55:09.110 INFO:teuthology.orchestra.run.smithi101.stdout: "duration": 2.4134999999999998e-05 2023-08-01T19:55:09.110 INFO:teuthology.orchestra.run.smithi101.stdout: } 2023-08-01T19:55:09.110 INFO:teuthology.orchestra.run.smithi101.stdout: ] 2023-08-01T19:55:09.111 INFO:teuthology.orchestra.run.smithi101.stdout: } 2023-08-01T19:55:09.111 INFO:teuthology.orchestra.run.smithi101.stdout: }, 2023-08-01T19:55:09.111 INFO:teuthology.orchestra.run.smithi101.stdout: { 2023-08-01T19:55:09.111 INFO:teuthology.orchestra.run.smithi101.stdout: "description": "osd_op(mds.0.3:19 3.14 3:2f55791f:::606.00000000:head [create,setxattr parent (62) in=6b,setxattr layout (30) in=6b] snapc 0=[] ondisk+write+known_if_redirected+full_force+supports_pool_eio e17)", 2023-08-01T19:55:09.111 INFO:teuthology.orchestra.run.smithi101.stdout: "initiated_at": "2023-08-01T19:54:04.459069+0000", 2023-08-01T19:55:09.111 INFO:teuthology.orchestra.run.smithi101.stdout: "age": 64.581507955000006, 2023-08-01T19:55:09.111 INFO:teuthology.orchestra.run.smithi101.stdout: "duration": 0.019523045999999999, 2023-08-01T19:55:09.111 INFO:teuthology.orchestra.run.smithi101.stdout: "type_data": { 2023-08-01T19:55:09.112 INFO:teuthology.orchestra.run.smithi101.stdout: "flag_point": "commit sent; apply or cleanup", 2023-08-01T19:55:09.112 INFO:teuthology.orchestra.run.smithi101.stdout: "events": [ 2023-08-01T19:55:09.112 INFO:teuthology.orchestra.run.smithi101.stdout: { 2023-08-01T19:55:09.112 INFO:teuthology.orchestra.run.smithi101.stdout: "event": "initiated", 2023-08-01T19:55:09.112 INFO:teuthology.orchestra.run.smithi101.stdout: "time": "2023-08-01T19:54:04.459069+0000", 2023-08-01T19:55:09.112 INFO:teuthology.orchestra.run.smithi101.stdout: "duration": 0 2023-08-01T19:55:09.112 INFO:teuthology.orchestra.run.smithi101.stdout: }, 2023-08-01T19:55:09.112 INFO:teuthology.orchestra.run.smithi101.stdout: { 2023-08-01T19:55:09.113 INFO:teuthology.orchestra.run.smithi101.stdout: "event": "throttled", 2023-08-01T19:55:09.113 INFO:teuthology.orchestra.run.smithi101.stdout: "time": "2023-08-01T19:54:04.459069+0000", 2023-08-01T19:55:09.113 INFO:teuthology.orchestra.run.smithi101.stdout: "duration": 0 2023-08-01T19:55:09.113 INFO:teuthology.orchestra.run.smithi101.stdout: }, 2023-08-01T19:55:09.113 INFO:teuthology.orchestra.run.smithi101.stdout: { 2023-08-01T19:55:09.113 INFO:teuthology.orchestra.run.smithi101.stdout: "event": "header_read", 2023-08-01T19:55:09.113 INFO:teuthology.orchestra.run.smithi101.stdout: "time": "2023-08-01T19:54:04.459069+0000", 2023-08-01T19:55:09.113 INFO:teuthology.orchestra.run.smithi101.stdout: "duration": 4294967295.9999995 2023-08-01T19:55:09.114 INFO:teuthology.orchestra.run.smithi101.stdout: }, 2023-08-01T19:55:09.114 INFO:teuthology.orchestra.run.smithi101.stdout: { 2023-08-01T19:55:09.114 INFO:teuthology.orchestra.run.smithi101.stdout: "event": "all_read", 2023-08-01T19:55:09.114 INFO:teuthology.orchestra.run.smithi101.stdout: "time": "2023-08-01T19:54:04.459072+0000", 2023-08-01T19:55:09.114 INFO:teuthology.orchestra.run.smithi101.stdout: "duration": 3.4570000000000001e-06 2023-08-01T19:55:09.114 INFO:teuthology.orchestra.run.smithi101.stdout: }, 2023-08-01T19:55:09.114 INFO:teuthology.orchestra.run.smithi101.stdout: { 2023-08-01T19:55:09.114 INFO:teuthology.orchestra.run.smithi101.stdout: "event": "dispatched", 2023-08-01T19:55:09.115 INFO:teuthology.orchestra.run.smithi101.stdout: "time": "2023-08-01T19:54:04.459080+0000", 2023-08-01T19:55:09.115 INFO:teuthology.orchestra.run.smithi101.stdout: "duration": 7.6009999999999997e-06 2023-08-01T19:55:09.115 INFO:teuthology.orchestra.run.smithi101.stdout: }, 2023-08-01T19:55:09.115 INFO:teuthology.orchestra.run.smithi101.stdout: { 2023-08-01T19:55:09.115 INFO:teuthology.orchestra.run.smithi101.stdout: "event": "queued_for_pg", 2023-08-01T19:55:09.115 INFO:teuthology.orchestra.run.smithi101.stdout: "time": "2023-08-01T19:54:04.459088+0000", 2023-08-01T19:55:09.115 INFO:teuthology.orchestra.run.smithi101.stdout: "duration": 8.0509999999999997e-06 2023-08-01T19:55:09.115 INFO:teuthology.orchestra.run.smithi101.stdout: }, 2023-08-01T19:55:09.116 INFO:teuthology.orchestra.run.smithi101.stdout: { 2023-08-01T19:55:09.116 INFO:teuthology.orchestra.run.smithi101.stdout: "event": "reached_pg", 2023-08-01T19:55:09.116 INFO:teuthology.orchestra.run.smithi101.stdout: "time": "2023-08-01T19:54:04.459120+0000", 2023-08-01T19:55:09.116 INFO:teuthology.orchestra.run.smithi101.stdout: "duration": 3.2078e-05 2023-08-01T19:55:09.116 INFO:teuthology.orchestra.run.smithi101.stdout: }, 2023-08-01T19:55:09.116 INFO:teuthology.orchestra.run.smithi101.stdout: { 2023-08-01T19:55:09.116 INFO:teuthology.orchestra.run.smithi101.stdout: "event": "waiting_for_map not empty", 2023-08-01T19:55:09.117 INFO:teuthology.orchestra.run.smithi101.stdout: "time": "2023-08-01T19:54:04.459123+0000", 2023-08-01T19:55:09.117 INFO:teuthology.orchestra.run.smithi101.stdout: "duration": 3.4699999999999998e-06 2023-08-01T19:55:09.117 INFO:teuthology.orchestra.run.smithi101.stdout: }, 2023-08-01T19:55:09.117 INFO:teuthology.orchestra.run.smithi101.stdout: { 2023-08-01T19:55:09.117 INFO:teuthology.orchestra.run.smithi101.stdout: "event": "reached_pg", 2023-08-01T19:55:09.117 INFO:teuthology.orchestra.run.smithi101.stdout: "time": "2023-08-01T19:54:04.471352+0000", 2023-08-01T19:55:09.117 INFO:teuthology.orchestra.run.smithi101.stdout: "duration": 0.01222926 2023-08-01T19:55:09.117 INFO:teuthology.orchestra.run.smithi101.stdout: }, 2023-08-01T19:55:09.118 INFO:teuthology.orchestra.run.smithi101.stdout: { 2023-08-01T19:55:09.118 INFO:teuthology.orchestra.run.smithi101.stdout: "event": "started", 2023-08-01T19:55:09.118 INFO:teuthology.orchestra.run.smithi101.stdout: "time": "2023-08-01T19:54:04.471495+0000", 2023-08-01T19:55:09.118 INFO:teuthology.orchestra.run.smithi101.stdout: "duration": 0.00014263899999999999 2023-08-01T19:55:09.118 INFO:teuthology.orchestra.run.smithi101.stdout: }, 2023-08-01T19:55:09.118 INFO:teuthology.orchestra.run.smithi101.stdout: { 2023-08-01T19:55:09.118 INFO:teuthology.orchestra.run.smithi101.stdout: "event": "waiting for subops from 2", 2023-08-01T19:55:09.118 INFO:teuthology.orchestra.run.smithi101.stdout: "time": "2023-08-01T19:54:04.472368+0000", 2023-08-01T19:55:09.119 INFO:teuthology.orchestra.run.smithi101.stdout: "duration": 0.00087245300000000003 2023-08-01T19:55:09.119 INFO:teuthology.orchestra.run.smithi101.stdout: }, 2023-08-01T19:55:09.119 INFO:teuthology.orchestra.run.smithi101.stdout: { 2023-08-01T19:55:09.119 INFO:teuthology.orchestra.run.smithi101.stdout: "event": "op_commit", 2023-08-01T19:55:09.119 INFO:teuthology.orchestra.run.smithi101.stdout: "time": "2023-08-01T19:54:04.477612+0000", 2023-08-01T19:55:09.119 INFO:teuthology.orchestra.run.smithi101.stdout: "duration": 0.0052442809999999999 2023-08-01T19:55:09.119 INFO:teuthology.orchestra.run.smithi101.stdout: }, 2023-08-01T19:55:09.119 INFO:teuthology.orchestra.run.smithi101.stdout: { 2023-08-01T19:55:09.120 INFO:teuthology.orchestra.run.smithi101.stdout: "event": "sub_op_commit_rec", 2023-08-01T19:55:09.120 INFO:teuthology.orchestra.run.smithi101.stdout: "time": "2023-08-01T19:54:04.478516+0000", 2023-08-01T19:55:09.120 INFO:teuthology.orchestra.run.smithi101.stdout: "duration": 0.00090399800000000004 2023-08-01T19:55:09.120 INFO:teuthology.orchestra.run.smithi101.stdout: }, 2023-08-01T19:55:09.120 INFO:teuthology.orchestra.run.smithi101.stdout: { 2023-08-01T19:55:09.120 INFO:teuthology.orchestra.run.smithi101.stdout: "event": "commit_sent", 2023-08-01T19:55:09.120 INFO:teuthology.orchestra.run.smithi101.stdout: "time": "2023-08-01T19:54:04.478555+0000", 2023-08-01T19:55:09.120 INFO:teuthology.orchestra.run.smithi101.stdout: "duration": 3.8977000000000003e-05 2023-08-01T19:55:09.121 INFO:teuthology.orchestra.run.smithi101.stdout: }, 2023-08-01T19:55:09.121 INFO:teuthology.orchestra.run.smithi101.stdout: { 2023-08-01T19:55:09.121 INFO:teuthology.orchestra.run.smithi101.stdout: "event": "done", 2023-08-01T19:55:09.121 INFO:teuthology.orchestra.run.smithi101.stdout: "time": "2023-08-01T19:54:04.478592+0000", 2023-08-01T19:55:09.121 INFO:teuthology.orchestra.run.smithi101.stdout: "duration": 3.7287999999999999e-05 2023-08-01T19:55:09.121 INFO:teuthology.orchestra.run.smithi101.stdout: } 2023-08-01T19:55:09.121 INFO:teuthology.orchestra.run.smithi101.stdout: ] 2023-08-01T19:55:09.121 INFO:teuthology.orchestra.run.smithi101.stdout: } 2023-08-01T19:55:09.122 INFO:teuthology.orchestra.run.smithi101.stdout: }, 2023-08-01T19:55:09.122 INFO:teuthology.orchestra.run.smithi101.stdout: { 2023-08-01T19:55:09.122 INFO:teuthology.orchestra.run.smithi101.stdout: "description": "osd_op(mds.0.3:20 3.1c 3:3ed09add:::607.00000000:head [omap-set-header] snapc 0=[] ondisk+write+known_if_redirected+full_force+supports_pool_eio e17)", 2023-08-01T19:55:09.122 INFO:teuthology.orchestra.run.smithi101.stdout: "initiated_at": "2023-08-01T19:54:04.459097+0000", 2023-08-01T19:55:09.122 INFO:teuthology.orchestra.run.smithi101.stdout: "age": 64.581480251000002, 2023-08-01T19:55:09.122 INFO:teuthology.orchestra.run.smithi101.stdout: "duration": 0.018578978999999999, 2023-08-01T19:55:09.122 INFO:teuthology.orchestra.run.smithi101.stdout: "type_data": { 2023-08-01T19:55:09.122 INFO:teuthology.orchestra.run.smithi101.stdout: "flag_point": "commit sent; apply or cleanup", 2023-08-01T19:55:09.123 INFO:teuthology.orchestra.run.smithi101.stdout: "events": [ 2023-08-01T19:55:09.123 INFO:teuthology.orchestra.run.smithi101.stdout: { 2023-08-01T19:55:09.123 INFO:teuthology.orchestra.run.smithi101.stdout: "event": "initiated", 2023-08-01T19:55:09.123 INFO:teuthology.orchestra.run.smithi101.stdout: "time": "2023-08-01T19:54:04.459097+0000", 2023-08-01T19:55:09.123 INFO:teuthology.orchestra.run.smithi101.stdout: "duration": 0 2023-08-01T19:55:09.123 INFO:teuthology.orchestra.run.smithi101.stdout: }, 2023-08-01T19:55:09.123 INFO:teuthology.orchestra.run.smithi101.stdout: { 2023-08-01T19:55:09.123 INFO:teuthology.orchestra.run.smithi101.stdout: "event": "throttled", 2023-08-01T19:55:09.124 INFO:teuthology.orchestra.run.smithi101.stdout: "time": "2023-08-01T19:54:04.459097+0000", 2023-08-01T19:55:09.124 INFO:teuthology.orchestra.run.smithi101.stdout: "duration": 0 2023-08-01T19:55:09.124 INFO:teuthology.orchestra.run.smithi101.stdout: }, 2023-08-01T19:55:09.124 INFO:teuthology.orchestra.run.smithi101.stdout: { 2023-08-01T19:55:09.124 INFO:teuthology.orchestra.run.smithi101.stdout: "event": "header_read", 2023-08-01T19:55:09.124 INFO:teuthology.orchestra.run.smithi101.stdout: "time": "2023-08-01T19:54:04.459096+0000", 2023-08-01T19:55:09.124 INFO:teuthology.orchestra.run.smithi101.stdout: "duration": 4294967295.9999995 2023-08-01T19:55:09.125 INFO:teuthology.orchestra.run.smithi101.stdout: }, 2023-08-01T19:55:09.125 INFO:teuthology.orchestra.run.smithi101.stdout: { 2023-08-01T19:55:09.125 INFO:teuthology.orchestra.run.smithi101.stdout: "event": "all_read", 2023-08-01T19:55:09.125 INFO:teuthology.orchestra.run.smithi101.stdout: "time": "2023-08-01T19:54:04.459105+0000", 2023-08-01T19:55:09.125 INFO:teuthology.orchestra.run.smithi101.stdout: "duration": 8.8259999999999999e-06 2023-08-01T19:55:09.125 INFO:teuthology.orchestra.run.smithi101.stdout: }, 2023-08-01T19:55:09.125 INFO:teuthology.orchestra.run.smithi101.stdout: { 2023-08-01T19:55:09.125 INFO:teuthology.orchestra.run.smithi101.stdout: "event": "dispatched", 2023-08-01T19:55:09.126 INFO:teuthology.orchestra.run.smithi101.stdout: "time": "2023-08-01T19:54:04.459112+0000", 2023-08-01T19:55:09.126 INFO:teuthology.orchestra.run.smithi101.stdout: "duration": 6.6660000000000002e-06 2023-08-01T19:55:09.126 INFO:teuthology.orchestra.run.smithi101.stdout: }, 2023-08-01T19:55:09.126 INFO:teuthology.orchestra.run.smithi101.stdout: { 2023-08-01T19:55:09.126 INFO:teuthology.orchestra.run.smithi101.stdout: "event": "queued_for_pg", 2023-08-01T19:55:09.126 INFO:teuthology.orchestra.run.smithi101.stdout: "time": "2023-08-01T19:54:04.459116+0000", 2023-08-01T19:55:09.126 INFO:teuthology.orchestra.run.smithi101.stdout: "duration": 4.2209999999999999e-06 2023-08-01T19:55:09.126 INFO:teuthology.orchestra.run.smithi101.stdout: }, 2023-08-01T19:55:09.127 INFO:teuthology.orchestra.run.smithi101.stdout: { 2023-08-01T19:55:09.127 INFO:teuthology.orchestra.run.smithi101.stdout: "event": "reached_pg", 2023-08-01T19:55:09.127 INFO:teuthology.orchestra.run.smithi101.stdout: "time": "2023-08-01T19:54:04.459141+0000", 2023-08-01T19:55:09.127 INFO:teuthology.orchestra.run.smithi101.stdout: "duration": 2.4627e-05 2023-08-01T19:55:09.127 INFO:teuthology.orchestra.run.smithi101.stdout: }, 2023-08-01T19:55:09.127 INFO:teuthology.orchestra.run.smithi101.stdout: { 2023-08-01T19:55:09.127 INFO:teuthology.orchestra.run.smithi101.stdout: "event": "op must wait for map", 2023-08-01T19:55:09.127 INFO:teuthology.orchestra.run.smithi101.stdout: "time": "2023-08-01T19:54:04.459144+0000", 2023-08-01T19:55:09.128 INFO:teuthology.orchestra.run.smithi101.stdout: "duration": 3.6559999999999998e-06 2023-08-01T19:55:09.128 INFO:teuthology.orchestra.run.smithi101.stdout: }, 2023-08-01T19:55:09.128 INFO:teuthology.orchestra.run.smithi101.stdout: { 2023-08-01T19:55:09.128 INFO:teuthology.orchestra.run.smithi101.stdout: "event": "reached_pg", 2023-08-01T19:55:09.128 INFO:teuthology.orchestra.run.smithi101.stdout: "time": "2023-08-01T19:54:04.468086+0000", 2023-08-01T19:55:09.128 INFO:teuthology.orchestra.run.smithi101.stdout: "duration": 0.0089415569999999993 2023-08-01T19:55:09.128 INFO:teuthology.orchestra.run.smithi101.stdout: }, 2023-08-01T19:55:09.128 INFO:teuthology.orchestra.run.smithi101.stdout: { 2023-08-01T19:55:09.129 INFO:teuthology.orchestra.run.smithi101.stdout: "event": "started", 2023-08-01T19:55:09.129 INFO:teuthology.orchestra.run.smithi101.stdout: "time": "2023-08-01T19:54:04.468204+0000", 2023-08-01T19:55:09.129 INFO:teuthology.orchestra.run.smithi101.stdout: "duration": 0.00011806700000000001 2023-08-01T19:55:09.129 INFO:teuthology.orchestra.run.smithi101.stdout: }, 2023-08-01T19:55:09.129 INFO:teuthology.orchestra.run.smithi101.stdout: { 2023-08-01T19:55:09.129 INFO:teuthology.orchestra.run.smithi101.stdout: "event": "waiting for subops from 0", 2023-08-01T19:55:09.129 INFO:teuthology.orchestra.run.smithi101.stdout: "time": "2023-08-01T19:54:04.468342+0000", 2023-08-01T19:55:09.129 INFO:teuthology.orchestra.run.smithi101.stdout: "duration": 0.000138269 2023-08-01T19:55:09.130 INFO:teuthology.orchestra.run.smithi101.stdout: }, 2023-08-01T19:55:09.130 INFO:teuthology.orchestra.run.smithi101.stdout: { 2023-08-01T19:55:09.130 INFO:teuthology.orchestra.run.smithi101.stdout: "event": "op_commit", 2023-08-01T19:55:09.130 INFO:teuthology.orchestra.run.smithi101.stdout: "time": "2023-08-01T19:54:04.474028+0000", 2023-08-01T19:55:09.130 INFO:teuthology.orchestra.run.smithi101.stdout: "duration": 0.005685458 2023-08-01T19:55:09.130 INFO:teuthology.orchestra.run.smithi101.stdout: }, 2023-08-01T19:55:09.130 INFO:teuthology.orchestra.run.smithi101.stdout: { 2023-08-01T19:55:09.130 INFO:teuthology.orchestra.run.smithi101.stdout: "event": "sub_op_commit_rec", 2023-08-01T19:55:09.131 INFO:teuthology.orchestra.run.smithi101.stdout: "time": "2023-08-01T19:54:04.477581+0000", 2023-08-01T19:55:09.131 INFO:teuthology.orchestra.run.smithi101.stdout: "duration": 0.0035531109999999999 2023-08-01T19:55:09.131 INFO:teuthology.orchestra.run.smithi101.stdout: }, 2023-08-01T19:55:09.131 INFO:teuthology.orchestra.run.smithi101.stdout: { 2023-08-01T19:55:09.131 INFO:teuthology.orchestra.run.smithi101.stdout: "event": "commit_sent", 2023-08-01T19:55:09.131 INFO:teuthology.orchestra.run.smithi101.stdout: "time": "2023-08-01T19:54:04.477635+0000", 2023-08-01T19:55:09.131 INFO:teuthology.orchestra.run.smithi101.stdout: "duration": 5.3769e-05 2023-08-01T19:55:09.131 INFO:teuthology.orchestra.run.smithi101.stdout: }, 2023-08-01T19:55:09.132 INFO:teuthology.orchestra.run.smithi101.stdout: { 2023-08-01T19:55:09.132 INFO:teuthology.orchestra.run.smithi101.stdout: "event": "done", 2023-08-01T19:55:09.132 INFO:teuthology.orchestra.run.smithi101.stdout: "time": "2023-08-01T19:54:04.477676+0000", 2023-08-01T19:55:09.132 INFO:teuthology.orchestra.run.smithi101.stdout: "duration": 4.1148e-05 2023-08-01T19:55:09.132 INFO:teuthology.orchestra.run.smithi101.stdout: } 2023-08-01T19:55:09.132 INFO:teuthology.orchestra.run.smithi101.stdout: ] 2023-08-01T19:55:09.132 INFO:teuthology.orchestra.run.smithi101.stdout: } 2023-08-01T19:55:09.133 INFO:teuthology.orchestra.run.smithi101.stdout: }, 2023-08-01T19:55:09.133 INFO:teuthology.orchestra.run.smithi101.stdout: { 2023-08-01T19:55:09.133 INFO:teuthology.orchestra.run.smithi101.stdout: "description": "osd_op(mds.0.3:21 3.1c 3:3ed09add:::607.00000000:head [create,setxattr parent (62) in=6b,setxattr layout (30) in=6b] snapc 0=[] ondisk+write+known_if_redirected+full_force+supports_pool_eio e17)", 2023-08-01T19:55:09.133 INFO:teuthology.orchestra.run.smithi101.stdout: "initiated_at": "2023-08-01T19:54:04.459123+0000", 2023-08-01T19:55:09.133 INFO:teuthology.orchestra.run.smithi101.stdout: "age": 64.581454093999994, 2023-08-01T19:55:09.133 INFO:teuthology.orchestra.run.smithi101.stdout: "duration": 0.018736452000000001, 2023-08-01T19:55:09.133 INFO:teuthology.orchestra.run.smithi101.stdout: "type_data": { 2023-08-01T19:55:09.133 INFO:teuthology.orchestra.run.smithi101.stdout: "flag_point": "commit sent; apply or cleanup", 2023-08-01T19:55:09.134 INFO:teuthology.orchestra.run.smithi101.stdout: "events": [ 2023-08-01T19:55:09.134 INFO:teuthology.orchestra.run.smithi101.stdout: { 2023-08-01T19:55:09.134 INFO:teuthology.orchestra.run.smithi101.stdout: "event": "initiated", 2023-08-01T19:55:09.134 INFO:teuthology.orchestra.run.smithi101.stdout: "time": "2023-08-01T19:54:04.459123+0000", 2023-08-01T19:55:09.134 INFO:teuthology.orchestra.run.smithi101.stdout: "duration": 0 2023-08-01T19:55:09.134 INFO:teuthology.orchestra.run.smithi101.stdout: }, 2023-08-01T19:55:09.134 INFO:teuthology.orchestra.run.smithi101.stdout: { 2023-08-01T19:55:09.134 INFO:teuthology.orchestra.run.smithi101.stdout: "event": "throttled", 2023-08-01T19:55:09.135 INFO:teuthology.orchestra.run.smithi101.stdout: "time": "2023-08-01T19:54:04.459123+0000", 2023-08-01T19:55:09.135 INFO:teuthology.orchestra.run.smithi101.stdout: "duration": 0 2023-08-01T19:55:09.135 INFO:teuthology.orchestra.run.smithi101.stdout: }, 2023-08-01T19:55:09.135 INFO:teuthology.orchestra.run.smithi101.stdout: { 2023-08-01T19:55:09.135 INFO:teuthology.orchestra.run.smithi101.stdout: "event": "header_read", 2023-08-01T19:55:09.135 INFO:teuthology.orchestra.run.smithi101.stdout: "time": "2023-08-01T19:54:04.459123+0000", 2023-08-01T19:55:09.135 INFO:teuthology.orchestra.run.smithi101.stdout: "duration": 4294967295.9999995 2023-08-01T19:55:09.135 INFO:teuthology.orchestra.run.smithi101.stdout: }, 2023-08-01T19:55:09.136 INFO:teuthology.orchestra.run.smithi101.stdout: { 2023-08-01T19:55:09.136 INFO:teuthology.orchestra.run.smithi101.stdout: "event": "all_read", 2023-08-01T19:55:09.136 INFO:teuthology.orchestra.run.smithi101.stdout: "time": "2023-08-01T19:54:04.459127+0000", 2023-08-01T19:55:09.136 INFO:teuthology.orchestra.run.smithi101.stdout: "duration": 4.5770000000000004e-06 2023-08-01T19:55:09.136 INFO:teuthology.orchestra.run.smithi101.stdout: }, 2023-08-01T19:55:09.136 INFO:teuthology.orchestra.run.smithi101.stdout: { 2023-08-01T19:55:09.136 INFO:teuthology.orchestra.run.smithi101.stdout: "event": "dispatched", 2023-08-01T19:55:09.136 INFO:teuthology.orchestra.run.smithi101.stdout: "time": "2023-08-01T19:54:04.459134+0000", 2023-08-01T19:55:09.137 INFO:teuthology.orchestra.run.smithi101.stdout: "duration": 6.5080000000000002e-06 2023-08-01T19:55:09.137 INFO:teuthology.orchestra.run.smithi101.stdout: }, 2023-08-01T19:55:09.137 INFO:teuthology.orchestra.run.smithi101.stdout: { 2023-08-01T19:55:09.137 INFO:teuthology.orchestra.run.smithi101.stdout: "event": "queued_for_pg", 2023-08-01T19:55:09.137 INFO:teuthology.orchestra.run.smithi101.stdout: "time": "2023-08-01T19:54:04.459138+0000", 2023-08-01T19:55:09.137 INFO:teuthology.orchestra.run.smithi101.stdout: "duration": 4.6249999999999998e-06 2023-08-01T19:55:09.137 INFO:teuthology.orchestra.run.smithi101.stdout: }, 2023-08-01T19:55:09.137 INFO:teuthology.orchestra.run.smithi101.stdout: { 2023-08-01T19:55:09.138 INFO:teuthology.orchestra.run.smithi101.stdout: "event": "reached_pg", 2023-08-01T19:55:09.138 INFO:teuthology.orchestra.run.smithi101.stdout: "time": "2023-08-01T19:54:04.459158+0000", 2023-08-01T19:55:09.138 INFO:teuthology.orchestra.run.smithi101.stdout: "duration": 1.9354000000000001e-05 2023-08-01T19:55:09.138 INFO:teuthology.orchestra.run.smithi101.stdout: }, 2023-08-01T19:55:09.138 INFO:teuthology.orchestra.run.smithi101.stdout: { 2023-08-01T19:55:09.138 INFO:teuthology.orchestra.run.smithi101.stdout: "event": "waiting_for_map not empty", 2023-08-01T19:55:09.138 INFO:teuthology.orchestra.run.smithi101.stdout: "time": "2023-08-01T19:54:04.459160+0000", 2023-08-01T19:55:09.138 INFO:teuthology.orchestra.run.smithi101.stdout: "duration": 2.2740000000000002e-06 2023-08-01T19:55:09.139 INFO:teuthology.orchestra.run.smithi101.stdout: }, 2023-08-01T19:55:09.139 INFO:teuthology.orchestra.run.smithi101.stdout: { 2023-08-01T19:55:09.139 INFO:teuthology.orchestra.run.smithi101.stdout: "event": "reached_pg", 2023-08-01T19:55:09.139 INFO:teuthology.orchestra.run.smithi101.stdout: "time": "2023-08-01T19:54:04.468839+0000", 2023-08-01T19:55:09.139 INFO:teuthology.orchestra.run.smithi101.stdout: "duration": 0.0096787109999999996 2023-08-01T19:55:09.139 INFO:teuthology.orchestra.run.smithi101.stdout: }, 2023-08-01T19:55:09.139 INFO:teuthology.orchestra.run.smithi101.stdout: { 2023-08-01T19:55:09.139 INFO:teuthology.orchestra.run.smithi101.stdout: "event": "started", 2023-08-01T19:55:09.140 INFO:teuthology.orchestra.run.smithi101.stdout: "time": "2023-08-01T19:54:04.469446+0000", 2023-08-01T19:55:09.140 INFO:teuthology.orchestra.run.smithi101.stdout: "duration": 0.00060714899999999997 2023-08-01T19:55:09.140 INFO:teuthology.orchestra.run.smithi101.stdout: }, 2023-08-01T19:55:09.140 INFO:teuthology.orchestra.run.smithi101.stdout: { 2023-08-01T19:55:09.140 INFO:teuthology.orchestra.run.smithi101.stdout: "event": "waiting for subops from 0", 2023-08-01T19:55:09.140 INFO:teuthology.orchestra.run.smithi101.stdout: "time": "2023-08-01T19:54:04.470133+0000", 2023-08-01T19:55:09.140 INFO:teuthology.orchestra.run.smithi101.stdout: "duration": 0.00068691900000000003 2023-08-01T19:55:09.141 INFO:teuthology.orchestra.run.smithi101.stdout: }, 2023-08-01T19:55:09.141 INFO:teuthology.orchestra.run.smithi101.stdout: { 2023-08-01T19:55:09.141 INFO:teuthology.orchestra.run.smithi101.stdout: "event": "op_commit", 2023-08-01T19:55:09.141 INFO:teuthology.orchestra.run.smithi101.stdout: "time": "2023-08-01T19:54:04.475933+0000", 2023-08-01T19:55:09.141 INFO:teuthology.orchestra.run.smithi101.stdout: "duration": 0.0058002560000000002 2023-08-01T19:55:09.141 INFO:teuthology.orchestra.run.smithi101.stdout: }, 2023-08-01T19:55:09.141 INFO:teuthology.orchestra.run.smithi101.stdout: { 2023-08-01T19:55:09.141 INFO:teuthology.orchestra.run.smithi101.stdout: "event": "sub_op_commit_rec", 2023-08-01T19:55:09.142 INFO:teuthology.orchestra.run.smithi101.stdout: "time": "2023-08-01T19:54:04.477749+0000", 2023-08-01T19:55:09.142 INFO:teuthology.orchestra.run.smithi101.stdout: "duration": 0.00181584 2023-08-01T19:55:09.142 INFO:teuthology.orchestra.run.smithi101.stdout: }, 2023-08-01T19:55:09.142 INFO:teuthology.orchestra.run.smithi101.stdout: { 2023-08-01T19:55:09.142 INFO:teuthology.orchestra.run.smithi101.stdout: "event": "commit_sent", 2023-08-01T19:55:09.142 INFO:teuthology.orchestra.run.smithi101.stdout: "time": "2023-08-01T19:54:04.477823+0000", 2023-08-01T19:55:09.142 INFO:teuthology.orchestra.run.smithi101.stdout: "duration": 7.4405000000000003e-05 2023-08-01T19:55:09.142 INFO:teuthology.orchestra.run.smithi101.stdout: }, 2023-08-01T19:55:09.143 INFO:teuthology.orchestra.run.smithi101.stdout: { 2023-08-01T19:55:09.143 INFO:teuthology.orchestra.run.smithi101.stdout: "event": "done", 2023-08-01T19:55:09.143 INFO:teuthology.orchestra.run.smithi101.stdout: "time": "2023-08-01T19:54:04.477859+0000", 2023-08-01T19:55:09.143 INFO:teuthology.orchestra.run.smithi101.stdout: "duration": 3.6211000000000003e-05 2023-08-01T19:55:09.143 INFO:teuthology.orchestra.run.smithi101.stdout: } 2023-08-01T19:55:09.143 INFO:teuthology.orchestra.run.smithi101.stdout: ] 2023-08-01T19:55:09.143 INFO:teuthology.orchestra.run.smithi101.stdout: } 2023-08-01T19:55:09.143 INFO:teuthology.orchestra.run.smithi101.stdout: }, 2023-08-01T19:55:09.144 INFO:teuthology.orchestra.run.smithi101.stdout: { 2023-08-01T19:55:09.144 INFO:teuthology.orchestra.run.smithi101.stdout: "description": "osd_op(mds.0.3:1 3.14 3:292cf221:::200.00000000:head [writefull 0~90] snapc 0=[] ondisk+write+known_if_redirected+full_force+supports_pool_eio e17)", 2023-08-01T19:55:09.144 INFO:teuthology.orchestra.run.smithi101.stdout: "initiated_at": "2023-08-01T19:54:04.459177+0000", 2023-08-01T19:55:09.144 INFO:teuthology.orchestra.run.smithi101.stdout: "age": 64.581400384999995, 2023-08-01T19:55:09.144 INFO:teuthology.orchestra.run.smithi101.stdout: "duration": 0.021067196, 2023-08-01T19:55:09.144 INFO:teuthology.orchestra.run.smithi101.stdout: "type_data": { 2023-08-01T19:55:09.144 INFO:teuthology.orchestra.run.smithi101.stdout: "flag_point": "commit sent; apply or cleanup", 2023-08-01T19:55:09.145 INFO:teuthology.orchestra.run.smithi101.stdout: "events": [ 2023-08-01T19:55:09.145 INFO:teuthology.orchestra.run.smithi101.stdout: { 2023-08-01T19:55:09.145 INFO:teuthology.orchestra.run.smithi101.stdout: "event": "initiated", 2023-08-01T19:55:09.145 INFO:teuthology.orchestra.run.smithi101.stdout: "time": "2023-08-01T19:54:04.459177+0000", 2023-08-01T19:55:09.145 INFO:teuthology.orchestra.run.smithi101.stdout: "duration": 0 2023-08-01T19:55:09.145 INFO:teuthology.orchestra.run.smithi101.stdout: }, 2023-08-01T19:55:09.145 INFO:teuthology.orchestra.run.smithi101.stdout: { 2023-08-01T19:55:09.145 INFO:teuthology.orchestra.run.smithi101.stdout: "event": "throttled", 2023-08-01T19:55:09.146 INFO:teuthology.orchestra.run.smithi101.stdout: "time": "2023-08-01T19:54:04.459177+0000", 2023-08-01T19:55:09.146 INFO:teuthology.orchestra.run.smithi101.stdout: "duration": 0 2023-08-01T19:55:09.146 INFO:teuthology.orchestra.run.smithi101.stdout: }, 2023-08-01T19:55:09.146 INFO:teuthology.orchestra.run.smithi101.stdout: { 2023-08-01T19:55:09.146 INFO:teuthology.orchestra.run.smithi101.stdout: "event": "header_read", 2023-08-01T19:55:09.146 INFO:teuthology.orchestra.run.smithi101.stdout: "time": "2023-08-01T19:54:04.459176+0000", 2023-08-01T19:55:09.146 INFO:teuthology.orchestra.run.smithi101.stdout: "duration": 4294967295.9999995 2023-08-01T19:55:09.146 INFO:teuthology.orchestra.run.smithi101.stdout: }, 2023-08-01T19:55:09.147 INFO:teuthology.orchestra.run.smithi101.stdout: { 2023-08-01T19:55:09.147 INFO:teuthology.orchestra.run.smithi101.stdout: "event": "all_read", 2023-08-01T19:55:09.147 INFO:teuthology.orchestra.run.smithi101.stdout: "time": "2023-08-01T19:54:04.459181+0000", 2023-08-01T19:55:09.147 INFO:teuthology.orchestra.run.smithi101.stdout: "duration": 5.2109999999999997e-06 2023-08-01T19:55:09.147 INFO:teuthology.orchestra.run.smithi101.stdout: }, 2023-08-01T19:55:09.147 INFO:teuthology.orchestra.run.smithi101.stdout: { 2023-08-01T19:55:09.147 INFO:teuthology.orchestra.run.smithi101.stdout: "event": "dispatched", 2023-08-01T19:55:09.147 INFO:teuthology.orchestra.run.smithi101.stdout: "time": "2023-08-01T19:54:04.459188+0000", 2023-08-01T19:55:09.148 INFO:teuthology.orchestra.run.smithi101.stdout: "duration": 6.6680000000000004e-06 2023-08-01T19:55:09.148 INFO:teuthology.orchestra.run.smithi101.stdout: }, 2023-08-01T19:55:09.148 INFO:teuthology.orchestra.run.smithi101.stdout: { 2023-08-01T19:55:09.148 INFO:teuthology.orchestra.run.smithi101.stdout: "event": "queued_for_pg", 2023-08-01T19:55:09.148 INFO:teuthology.orchestra.run.smithi101.stdout: "time": "2023-08-01T19:54:04.459192+0000", 2023-08-01T19:55:09.148 INFO:teuthology.orchestra.run.smithi101.stdout: "duration": 4.228e-06 2023-08-01T19:55:09.148 INFO:teuthology.orchestra.run.smithi101.stdout: }, 2023-08-01T19:55:09.148 INFO:teuthology.orchestra.run.smithi101.stdout: { 2023-08-01T19:55:09.149 INFO:teuthology.orchestra.run.smithi101.stdout: "event": "reached_pg", 2023-08-01T19:55:09.149 INFO:teuthology.orchestra.run.smithi101.stdout: "time": "2023-08-01T19:54:04.459219+0000", 2023-08-01T19:55:09.149 INFO:teuthology.orchestra.run.smithi101.stdout: "duration": 2.6930000000000001e-05 2023-08-01T19:55:09.149 INFO:teuthology.orchestra.run.smithi101.stdout: }, 2023-08-01T19:55:09.149 INFO:teuthology.orchestra.run.smithi101.stdout: { 2023-08-01T19:55:09.149 INFO:teuthology.orchestra.run.smithi101.stdout: "event": "waiting_for_map not empty", 2023-08-01T19:55:09.149 INFO:teuthology.orchestra.run.smithi101.stdout: "time": "2023-08-01T19:54:04.459223+0000", 2023-08-01T19:55:09.149 INFO:teuthology.orchestra.run.smithi101.stdout: "duration": 3.8469999999999998e-06 2023-08-01T19:55:09.150 INFO:teuthology.orchestra.run.smithi101.stdout: }, 2023-08-01T19:55:09.150 INFO:teuthology.orchestra.run.smithi101.stdout: { 2023-08-01T19:55:09.150 INFO:teuthology.orchestra.run.smithi101.stdout: "event": "reached_pg", 2023-08-01T19:55:09.150 INFO:teuthology.orchestra.run.smithi101.stdout: "time": "2023-08-01T19:54:04.473347+0000", 2023-08-01T19:55:09.150 INFO:teuthology.orchestra.run.smithi101.stdout: "duration": 0.014124319 2023-08-01T19:55:09.150 INFO:teuthology.orchestra.run.smithi101.stdout: }, 2023-08-01T19:55:09.150 INFO:teuthology.orchestra.run.smithi101.stdout: { 2023-08-01T19:55:09.150 INFO:teuthology.orchestra.run.smithi101.stdout: "event": "started", 2023-08-01T19:55:09.151 INFO:teuthology.orchestra.run.smithi101.stdout: "time": "2023-08-01T19:54:04.473480+0000", 2023-08-01T19:55:09.151 INFO:teuthology.orchestra.run.smithi101.stdout: "duration": 0.00013276799999999999 2023-08-01T19:55:09.151 INFO:teuthology.orchestra.run.smithi101.stdout: }, 2023-08-01T19:55:09.151 INFO:teuthology.orchestra.run.smithi101.stdout: { 2023-08-01T19:55:09.151 INFO:teuthology.orchestra.run.smithi101.stdout: "event": "waiting for subops from 2", 2023-08-01T19:55:09.151 INFO:teuthology.orchestra.run.smithi101.stdout: "time": "2023-08-01T19:54:04.473622+0000", 2023-08-01T19:55:09.151 INFO:teuthology.orchestra.run.smithi101.stdout: "duration": 0.00014154799999999999 2023-08-01T19:55:09.152 INFO:teuthology.orchestra.run.smithi101.stdout: }, 2023-08-01T19:55:09.152 INFO:teuthology.orchestra.run.smithi101.stdout: { 2023-08-01T19:55:09.152 INFO:teuthology.orchestra.run.smithi101.stdout: "event": "op_commit", 2023-08-01T19:55:09.152 INFO:teuthology.orchestra.run.smithi101.stdout: "time": "2023-08-01T19:54:04.478281+0000", 2023-08-01T19:55:09.152 INFO:teuthology.orchestra.run.smithi101.stdout: "duration": 0.004659252 2023-08-01T19:55:09.152 INFO:teuthology.orchestra.run.smithi101.stdout: }, 2023-08-01T19:55:09.152 INFO:teuthology.orchestra.run.smithi101.stdout: { 2023-08-01T19:55:09.152 INFO:teuthology.orchestra.run.smithi101.stdout: "event": "sub_op_commit_rec", 2023-08-01T19:55:09.153 INFO:teuthology.orchestra.run.smithi101.stdout: "time": "2023-08-01T19:54:04.480180+0000", 2023-08-01T19:55:09.153 INFO:teuthology.orchestra.run.smithi101.stdout: "duration": 0.0018986859999999999 2023-08-01T19:55:09.153 INFO:teuthology.orchestra.run.smithi101.stdout: }, 2023-08-01T19:55:09.153 INFO:teuthology.orchestra.run.smithi101.stdout: { 2023-08-01T19:55:09.153 INFO:teuthology.orchestra.run.smithi101.stdout: "event": "commit_sent", 2023-08-01T19:55:09.153 INFO:teuthology.orchestra.run.smithi101.stdout: "time": "2023-08-01T19:54:04.480209+0000", 2023-08-01T19:55:09.153 INFO:teuthology.orchestra.run.smithi101.stdout: "duration": 2.9244999999999999e-05 2023-08-01T19:55:09.153 INFO:teuthology.orchestra.run.smithi101.stdout: }, 2023-08-01T19:55:09.154 INFO:teuthology.orchestra.run.smithi101.stdout: { 2023-08-01T19:55:09.154 INFO:teuthology.orchestra.run.smithi101.stdout: "event": "done", 2023-08-01T19:55:09.154 INFO:teuthology.orchestra.run.smithi101.stdout: "time": "2023-08-01T19:54:04.480244+0000", 2023-08-01T19:55:09.154 INFO:teuthology.orchestra.run.smithi101.stdout: "duration": 3.4875000000000001e-05 2023-08-01T19:55:09.154 INFO:teuthology.orchestra.run.smithi101.stdout: } 2023-08-01T19:55:09.154 INFO:teuthology.orchestra.run.smithi101.stdout: ] 2023-08-01T19:55:09.154 INFO:teuthology.orchestra.run.smithi101.stdout: } 2023-08-01T19:55:09.154 INFO:teuthology.orchestra.run.smithi101.stdout: }, 2023-08-01T19:55:09.155 INFO:teuthology.orchestra.run.smithi101.stdout: { 2023-08-01T19:55:09.155 INFO:teuthology.orchestra.run.smithi101.stdout: "description": "osd_op(mds.0.3:3 3.14 3:287034c4:::1.00000000.inode:head [writefull 0~554] snapc 0=[] ondisk+write+known_if_redirected+full_force+supports_pool_eio e17)", 2023-08-01T19:55:09.155 INFO:teuthology.orchestra.run.smithi101.stdout: "initiated_at": "2023-08-01T19:54:04.459226+0000", 2023-08-01T19:55:09.155 INFO:teuthology.orchestra.run.smithi101.stdout: "age": 64.581351306000002, 2023-08-01T19:55:09.155 INFO:teuthology.orchestra.run.smithi101.stdout: "duration": 0.021104531999999999, 2023-08-01T19:55:09.155 INFO:teuthology.orchestra.run.smithi101.stdout: "type_data": { 2023-08-01T19:55:09.155 INFO:teuthology.orchestra.run.smithi101.stdout: "flag_point": "commit sent; apply or cleanup", 2023-08-01T19:55:09.155 INFO:teuthology.orchestra.run.smithi101.stdout: "events": [ 2023-08-01T19:55:09.156 INFO:teuthology.orchestra.run.smithi101.stdout: { 2023-08-01T19:55:09.156 INFO:teuthology.orchestra.run.smithi101.stdout: "event": "initiated", 2023-08-01T19:55:09.156 INFO:teuthology.orchestra.run.smithi101.stdout: "time": "2023-08-01T19:54:04.459226+0000", 2023-08-01T19:55:09.156 INFO:teuthology.orchestra.run.smithi101.stdout: "duration": 0 2023-08-01T19:55:09.156 INFO:teuthology.orchestra.run.smithi101.stdout: }, 2023-08-01T19:55:09.156 INFO:teuthology.orchestra.run.smithi101.stdout: { 2023-08-01T19:55:09.156 INFO:teuthology.orchestra.run.smithi101.stdout: "event": "throttled", 2023-08-01T19:55:09.157 INFO:teuthology.orchestra.run.smithi101.stdout: "time": "2023-08-01T19:54:04.459226+0000", 2023-08-01T19:55:09.157 INFO:teuthology.orchestra.run.smithi101.stdout: "duration": 0 2023-08-01T19:55:09.157 INFO:teuthology.orchestra.run.smithi101.stdout: }, 2023-08-01T19:55:09.157 INFO:teuthology.orchestra.run.smithi101.stdout: { 2023-08-01T19:55:09.157 INFO:teuthology.orchestra.run.smithi101.stdout: "event": "header_read", 2023-08-01T19:55:09.157 INFO:teuthology.orchestra.run.smithi101.stdout: "time": "2023-08-01T19:54:04.459225+0000", 2023-08-01T19:55:09.157 INFO:teuthology.orchestra.run.smithi101.stdout: "duration": 4294967295.9999995 2023-08-01T19:55:09.157 INFO:teuthology.orchestra.run.smithi101.stdout: }, 2023-08-01T19:55:09.158 INFO:teuthology.orchestra.run.smithi101.stdout: { 2023-08-01T19:55:09.158 INFO:teuthology.orchestra.run.smithi101.stdout: "event": "all_read", 2023-08-01T19:55:09.158 INFO:teuthology.orchestra.run.smithi101.stdout: "time": "2023-08-01T19:54:04.459238+0000", 2023-08-01T19:55:09.158 INFO:teuthology.orchestra.run.smithi101.stdout: "duration": 1.2809000000000001e-05 2023-08-01T19:55:09.158 INFO:teuthology.orchestra.run.smithi101.stdout: }, 2023-08-01T19:55:09.158 INFO:teuthology.orchestra.run.smithi101.stdout: { 2023-08-01T19:55:09.158 INFO:teuthology.orchestra.run.smithi101.stdout: "event": "dispatched", 2023-08-01T19:55:09.158 INFO:teuthology.orchestra.run.smithi101.stdout: "time": "2023-08-01T19:54:04.459245+0000", 2023-08-01T19:55:09.159 INFO:teuthology.orchestra.run.smithi101.stdout: "duration": 6.6540000000000002e-06 2023-08-01T19:55:09.159 INFO:teuthology.orchestra.run.smithi101.stdout: }, 2023-08-01T19:55:09.159 INFO:teuthology.orchestra.run.smithi101.stdout: { 2023-08-01T19:55:09.159 INFO:teuthology.orchestra.run.smithi101.stdout: "event": "queued_for_pg", 2023-08-01T19:55:09.159 INFO:teuthology.orchestra.run.smithi101.stdout: "time": "2023-08-01T19:54:04.459249+0000", 2023-08-01T19:55:09.159 INFO:teuthology.orchestra.run.smithi101.stdout: "duration": 4.6e-06 2023-08-01T19:55:09.159 INFO:teuthology.orchestra.run.smithi101.stdout: }, 2023-08-01T19:55:09.159 INFO:teuthology.orchestra.run.smithi101.stdout: { 2023-08-01T19:55:09.160 INFO:teuthology.orchestra.run.smithi101.stdout: "event": "reached_pg", 2023-08-01T19:55:09.160 INFO:teuthology.orchestra.run.smithi101.stdout: "time": "2023-08-01T19:54:04.459276+0000", 2023-08-01T19:55:09.160 INFO:teuthology.orchestra.run.smithi101.stdout: "duration": 2.6373999999999999e-05 2023-08-01T19:55:09.160 INFO:teuthology.orchestra.run.smithi101.stdout: }, 2023-08-01T19:55:09.160 INFO:teuthology.orchestra.run.smithi101.stdout: { 2023-08-01T19:55:09.160 INFO:teuthology.orchestra.run.smithi101.stdout: "event": "waiting_for_map not empty", 2023-08-01T19:55:09.160 INFO:teuthology.orchestra.run.smithi101.stdout: "time": "2023-08-01T19:54:04.459278+0000", 2023-08-01T19:55:09.160 INFO:teuthology.orchestra.run.smithi101.stdout: "duration": 2.4980000000000001e-06 2023-08-01T19:55:09.161 INFO:teuthology.orchestra.run.smithi101.stdout: }, 2023-08-01T19:55:09.161 INFO:teuthology.orchestra.run.smithi101.stdout: { 2023-08-01T19:55:09.161 INFO:teuthology.orchestra.run.smithi101.stdout: "event": "reached_pg", 2023-08-01T19:55:09.161 INFO:teuthology.orchestra.run.smithi101.stdout: "time": "2023-08-01T19:54:04.474058+0000", 2023-08-01T19:55:09.161 INFO:teuthology.orchestra.run.smithi101.stdout: "duration": 0.014779979 2023-08-01T19:55:09.161 INFO:teuthology.orchestra.run.smithi101.stdout: }, 2023-08-01T19:55:09.161 INFO:teuthology.orchestra.run.smithi101.stdout: { 2023-08-01T19:55:09.161 INFO:teuthology.orchestra.run.smithi101.stdout: "event": "started", 2023-08-01T19:55:09.162 INFO:teuthology.orchestra.run.smithi101.stdout: "time": "2023-08-01T19:54:04.474614+0000", 2023-08-01T19:55:09.162 INFO:teuthology.orchestra.run.smithi101.stdout: "duration": 0.00055546899999999995 2023-08-01T19:55:09.162 INFO:teuthology.orchestra.run.smithi101.stdout: }, 2023-08-01T19:55:09.162 INFO:teuthology.orchestra.run.smithi101.stdout: { 2023-08-01T19:55:09.162 INFO:teuthology.orchestra.run.smithi101.stdout: "event": "waiting for subops from 2", 2023-08-01T19:55:09.162 INFO:teuthology.orchestra.run.smithi101.stdout: "time": "2023-08-01T19:54:04.474720+0000", 2023-08-01T19:55:09.162 INFO:teuthology.orchestra.run.smithi101.stdout: "duration": 0.00010645300000000001 2023-08-01T19:55:09.162 INFO:teuthology.orchestra.run.smithi101.stdout: }, 2023-08-01T19:55:09.163 INFO:teuthology.orchestra.run.smithi101.stdout: { 2023-08-01T19:55:09.163 INFO:teuthology.orchestra.run.smithi101.stdout: "event": "op_commit", 2023-08-01T19:55:09.163 INFO:teuthology.orchestra.run.smithi101.stdout: "time": "2023-08-01T19:54:04.478480+0000", 2023-08-01T19:55:09.163 INFO:teuthology.orchestra.run.smithi101.stdout: "duration": 0.0037600279999999999 2023-08-01T19:55:09.163 INFO:teuthology.orchestra.run.smithi101.stdout: }, 2023-08-01T19:55:09.163 INFO:teuthology.orchestra.run.smithi101.stdout: { 2023-08-01T19:55:09.163 INFO:teuthology.orchestra.run.smithi101.stdout: "event": "sub_op_commit_rec", 2023-08-01T19:55:09.163 INFO:teuthology.orchestra.run.smithi101.stdout: "time": "2023-08-01T19:54:04.480273+0000", 2023-08-01T19:55:09.164 INFO:teuthology.orchestra.run.smithi101.stdout: "duration": 0.001792465 2023-08-01T19:55:09.164 INFO:teuthology.orchestra.run.smithi101.stdout: }, 2023-08-01T19:55:09.164 INFO:teuthology.orchestra.run.smithi101.stdout: { 2023-08-01T19:55:09.164 INFO:teuthology.orchestra.run.smithi101.stdout: "event": "commit_sent", 2023-08-01T19:55:09.164 INFO:teuthology.orchestra.run.smithi101.stdout: "time": "2023-08-01T19:54:04.480304+0000", 2023-08-01T19:55:09.164 INFO:teuthology.orchestra.run.smithi101.stdout: "duration": 3.1708999999999997e-05 2023-08-01T19:55:09.164 INFO:teuthology.orchestra.run.smithi101.stdout: }, 2023-08-01T19:55:09.165 INFO:teuthology.orchestra.run.smithi101.stdout: { 2023-08-01T19:55:09.165 INFO:teuthology.orchestra.run.smithi101.stdout: "event": "done", 2023-08-01T19:55:09.165 INFO:teuthology.orchestra.run.smithi101.stdout: "time": "2023-08-01T19:54:04.480330+0000", 2023-08-01T19:55:09.165 INFO:teuthology.orchestra.run.smithi101.stdout: "duration": 2.5860999999999999e-05 2023-08-01T19:55:09.165 INFO:teuthology.orchestra.run.smithi101.stdout: } 2023-08-01T19:55:09.165 INFO:teuthology.orchestra.run.smithi101.stdout: ] 2023-08-01T19:55:09.165 INFO:teuthology.orchestra.run.smithi101.stdout: } 2023-08-01T19:55:09.165 INFO:teuthology.orchestra.run.smithi101.stdout: }, 2023-08-01T19:55:09.166 INFO:teuthology.orchestra.run.smithi101.stdout: { 2023-08-01T19:55:09.166 INFO:teuthology.orchestra.run.smithi101.stdout: "description": "osd_op(mds.0.3:32 3.14 3:2e2fa760:::200.00000001:head [delete] snapc 0=[] ondisk+write+known_if_redirected+full_force+supports_pool_eio e17)", 2023-08-01T19:55:09.166 INFO:teuthology.orchestra.run.smithi101.stdout: "initiated_at": "2023-08-01T19:54:04.459304+0000", 2023-08-01T19:55:09.166 INFO:teuthology.orchestra.run.smithi101.stdout: "age": 64.581272644999999, 2023-08-01T19:55:09.166 INFO:teuthology.orchestra.run.smithi101.stdout: "duration": 0.021110606000000001, 2023-08-01T19:55:09.166 INFO:teuthology.orchestra.run.smithi101.stdout: "type_data": { 2023-08-01T19:55:09.166 INFO:teuthology.orchestra.run.smithi101.stdout: "flag_point": "started", 2023-08-01T19:55:09.166 INFO:teuthology.orchestra.run.smithi101.stdout: "events": [ 2023-08-01T19:55:09.167 INFO:teuthology.orchestra.run.smithi101.stdout: { 2023-08-01T19:55:09.167 INFO:teuthology.orchestra.run.smithi101.stdout: "event": "initiated", 2023-08-01T19:55:09.167 INFO:teuthology.orchestra.run.smithi101.stdout: "time": "2023-08-01T19:54:04.459304+0000", 2023-08-01T19:55:09.167 INFO:teuthology.orchestra.run.smithi101.stdout: "duration": 0 2023-08-01T19:55:09.167 INFO:teuthology.orchestra.run.smithi101.stdout: }, 2023-08-01T19:55:09.167 INFO:teuthology.orchestra.run.smithi101.stdout: { 2023-08-01T19:55:09.167 INFO:teuthology.orchestra.run.smithi101.stdout: "event": "throttled", 2023-08-01T19:55:09.167 INFO:teuthology.orchestra.run.smithi101.stdout: "time": "2023-08-01T19:54:04.459304+0000", 2023-08-01T19:55:09.168 INFO:teuthology.orchestra.run.smithi101.stdout: "duration": 0 2023-08-01T19:55:09.168 INFO:teuthology.orchestra.run.smithi101.stdout: }, 2023-08-01T19:55:09.168 INFO:teuthology.orchestra.run.smithi101.stdout: { 2023-08-01T19:55:09.168 INFO:teuthology.orchestra.run.smithi101.stdout: "event": "header_read", 2023-08-01T19:55:09.168 INFO:teuthology.orchestra.run.smithi101.stdout: "time": "2023-08-01T19:54:04.459304+0000", 2023-08-01T19:55:09.168 INFO:teuthology.orchestra.run.smithi101.stdout: "duration": 4294967295.9999995 2023-08-01T19:55:09.168 INFO:teuthology.orchestra.run.smithi101.stdout: }, 2023-08-01T19:55:09.168 INFO:teuthology.orchestra.run.smithi101.stdout: { 2023-08-01T19:55:09.169 INFO:teuthology.orchestra.run.smithi101.stdout: "event": "all_read", 2023-08-01T19:55:09.169 INFO:teuthology.orchestra.run.smithi101.stdout: "time": "2023-08-01T19:54:04.459306+0000", 2023-08-01T19:55:09.169 INFO:teuthology.orchestra.run.smithi101.stdout: "duration": 2.3889999999999999e-06 2023-08-01T19:55:09.169 INFO:teuthology.orchestra.run.smithi101.stdout: }, 2023-08-01T19:55:09.169 INFO:teuthology.orchestra.run.smithi101.stdout: { 2023-08-01T19:55:09.169 INFO:teuthology.orchestra.run.smithi101.stdout: "event": "dispatched", 2023-08-01T19:55:09.169 INFO:teuthology.orchestra.run.smithi101.stdout: "time": "2023-08-01T19:54:04.459314+0000", 2023-08-01T19:55:09.170 INFO:teuthology.orchestra.run.smithi101.stdout: "duration": 7.1180000000000003e-06 2023-08-01T19:55:09.170 INFO:teuthology.orchestra.run.smithi101.stdout: }, 2023-08-01T19:55:09.170 INFO:teuthology.orchestra.run.smithi101.stdout: { 2023-08-01T19:55:09.170 INFO:teuthology.orchestra.run.smithi101.stdout: "event": "queued_for_pg", 2023-08-01T19:55:09.170 INFO:teuthology.orchestra.run.smithi101.stdout: "time": "2023-08-01T19:54:04.459318+0000", 2023-08-01T19:55:09.170 INFO:teuthology.orchestra.run.smithi101.stdout: "duration": 4.0239999999999999e-06 2023-08-01T19:55:09.170 INFO:teuthology.orchestra.run.smithi101.stdout: }, 2023-08-01T19:55:09.170 INFO:teuthology.orchestra.run.smithi101.stdout: { 2023-08-01T19:55:09.171 INFO:teuthology.orchestra.run.smithi101.stdout: "event": "reached_pg", 2023-08-01T19:55:09.171 INFO:teuthology.orchestra.run.smithi101.stdout: "time": "2023-08-01T19:54:04.459340+0000", 2023-08-01T19:55:09.171 INFO:teuthology.orchestra.run.smithi101.stdout: "duration": 2.2476e-05 2023-08-01T19:55:09.171 INFO:teuthology.orchestra.run.smithi101.stdout: }, 2023-08-01T19:55:09.171 INFO:teuthology.orchestra.run.smithi101.stdout: { 2023-08-01T19:55:09.171 INFO:teuthology.orchestra.run.smithi101.stdout: "event": "waiting_for_map not empty", 2023-08-01T19:55:09.171 INFO:teuthology.orchestra.run.smithi101.stdout: "time": "2023-08-01T19:54:04.459342+0000", 2023-08-01T19:55:09.171 INFO:teuthology.orchestra.run.smithi101.stdout: "duration": 2.272e-06 2023-08-01T19:55:09.172 INFO:teuthology.orchestra.run.smithi101.stdout: }, 2023-08-01T19:55:09.172 INFO:teuthology.orchestra.run.smithi101.stdout: { 2023-08-01T19:55:09.172 INFO:teuthology.orchestra.run.smithi101.stdout: "event": "reached_pg", 2023-08-01T19:55:09.172 INFO:teuthology.orchestra.run.smithi101.stdout: "time": "2023-08-01T19:54:04.475922+0000", 2023-08-01T19:55:09.172 INFO:teuthology.orchestra.run.smithi101.stdout: "duration": 0.016579388 2023-08-01T19:55:09.172 INFO:teuthology.orchestra.run.smithi101.stdout: }, 2023-08-01T19:55:09.172 INFO:teuthology.orchestra.run.smithi101.stdout: { 2023-08-01T19:55:09.172 INFO:teuthology.orchestra.run.smithi101.stdout: "event": "started", 2023-08-01T19:55:09.173 INFO:teuthology.orchestra.run.smithi101.stdout: "time": "2023-08-01T19:54:04.476107+0000", 2023-08-01T19:55:09.173 INFO:teuthology.orchestra.run.smithi101.stdout: "duration": 0.00018486300000000001 2023-08-01T19:55:09.173 INFO:teuthology.orchestra.run.smithi101.stdout: }, 2023-08-01T19:55:09.173 INFO:teuthology.orchestra.run.smithi101.stdout: { 2023-08-01T19:55:09.173 INFO:teuthology.orchestra.run.smithi101.stdout: "event": "done", 2023-08-01T19:55:09.173 INFO:teuthology.orchestra.run.smithi101.stdout: "time": "2023-08-01T19:54:04.480415+0000", 2023-08-01T19:55:09.173 INFO:teuthology.orchestra.run.smithi101.stdout: "duration": 0.0043084589999999997 2023-08-01T19:55:09.173 INFO:teuthology.orchestra.run.smithi101.stdout: } 2023-08-01T19:55:09.174 INFO:teuthology.orchestra.run.smithi101.stdout: ] 2023-08-01T19:55:09.174 INFO:teuthology.orchestra.run.smithi101.stdout: } 2023-08-01T19:55:09.174 INFO:teuthology.orchestra.run.smithi101.stdout: }, 2023-08-01T19:55:09.174 INFO:teuthology.orchestra.run.smithi101.stdout: { 2023-08-01T19:55:09.174 INFO:teuthology.orchestra.run.smithi101.stdout: "description": "osd_op(client.4668.0:70878 5.2 5:49b7d2be:::benchmark_data_smithi006_114134_object70877:head [set-alloc-hint object_size 65536 write_size 65536,write 0~65536] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e30)", 2023-08-01T19:55:09.174 INFO:teuthology.orchestra.run.smithi101.stdout: "initiated_at": "2023-08-01T19:54:50.210223+0000", 2023-08-01T19:55:09.174 INFO:teuthology.orchestra.run.smithi101.stdout: "age": 18.830354074999999, 2023-08-01T19:55:09.174 INFO:teuthology.orchestra.run.smithi101.stdout: "duration": 0.019884895, 2023-08-01T19:55:09.175 INFO:teuthology.orchestra.run.smithi101.stdout: "type_data": { 2023-08-01T19:55:09.175 INFO:teuthology.orchestra.run.smithi101.stdout: "flag_point": "commit sent; apply or cleanup", 2023-08-01T19:55:09.175 INFO:teuthology.orchestra.run.smithi101.stdout: "client_info": { 2023-08-01T19:55:09.175 INFO:teuthology.orchestra.run.smithi101.stdout: "client": "client.4668", 2023-08-01T19:55:09.175 INFO:teuthology.orchestra.run.smithi101.stdout: "client_addr": "172.21.15.6:0/1709472247", 2023-08-01T19:55:09.175 INFO:teuthology.orchestra.run.smithi101.stdout: "tid": 70878 2023-08-01T19:55:09.175 INFO:teuthology.orchestra.run.smithi101.stdout: }, 2023-08-01T19:55:09.175 INFO:teuthology.orchestra.run.smithi101.stdout: "events": [ 2023-08-01T19:55:09.176 INFO:teuthology.orchestra.run.smithi101.stdout: { 2023-08-01T19:55:09.176 INFO:teuthology.orchestra.run.smithi101.stdout: "event": "initiated", 2023-08-01T19:55:09.176 INFO:teuthology.orchestra.run.smithi101.stdout: "time": "2023-08-01T19:54:50.210223+0000", 2023-08-01T19:55:09.176 INFO:teuthology.orchestra.run.smithi101.stdout: "duration": 0 2023-08-01T19:55:09.176 INFO:teuthology.orchestra.run.smithi101.stdout: }, 2023-08-01T19:55:09.176 INFO:teuthology.orchestra.run.smithi101.stdout: { 2023-08-01T19:55:09.176 INFO:teuthology.orchestra.run.smithi101.stdout: "event": "throttled", 2023-08-01T19:55:09.177 INFO:teuthology.orchestra.run.smithi101.stdout: "time": "2023-08-01T19:54:50.210223+0000", 2023-08-01T19:55:09.177 INFO:teuthology.orchestra.run.smithi101.stdout: "duration": 0 2023-08-01T19:55:09.177 INFO:teuthology.orchestra.run.smithi101.stdout: }, 2023-08-01T19:55:09.177 INFO:teuthology.orchestra.run.smithi101.stdout: { 2023-08-01T19:55:09.177 INFO:teuthology.orchestra.run.smithi101.stdout: "event": "header_read", 2023-08-01T19:55:09.177 INFO:teuthology.orchestra.run.smithi101.stdout: "time": "2023-08-01T19:54:50.210222+0000", 2023-08-01T19:55:09.177 INFO:teuthology.orchestra.run.smithi101.stdout: "duration": 4294967295.999999 2023-08-01T19:55:09.177 INFO:teuthology.orchestra.run.smithi101.stdout: }, 2023-08-01T19:55:09.178 INFO:teuthology.orchestra.run.smithi101.stdout: { 2023-08-01T19:55:09.178 INFO:teuthology.orchestra.run.smithi101.stdout: "event": "all_read", 2023-08-01T19:55:09.178 INFO:teuthology.orchestra.run.smithi101.stdout: "time": "2023-08-01T19:54:50.210315+0000", 2023-08-01T19:55:09.178 INFO:teuthology.orchestra.run.smithi101.stdout: "duration": 9.2567999999999999e-05 2023-08-01T19:55:09.178 INFO:teuthology.orchestra.run.smithi101.stdout: }, 2023-08-01T19:55:09.178 INFO:teuthology.orchestra.run.smithi101.stdout: { 2023-08-01T19:55:09.178 INFO:teuthology.orchestra.run.smithi101.stdout: "event": "dispatched", 2023-08-01T19:55:09.178 INFO:teuthology.orchestra.run.smithi101.stdout: "time": "2023-08-01T19:54:50.210326+0000", 2023-08-01T19:55:09.179 INFO:teuthology.orchestra.run.smithi101.stdout: "duration": 1.1430000000000001e-05 2023-08-01T19:55:09.179 INFO:teuthology.orchestra.run.smithi101.stdout: }, 2023-08-01T19:55:09.179 INFO:teuthology.orchestra.run.smithi101.stdout: { 2023-08-01T19:55:09.179 INFO:teuthology.orchestra.run.smithi101.stdout: "event": "queued_for_pg", 2023-08-01T19:55:09.179 INFO:teuthology.orchestra.run.smithi101.stdout: "time": "2023-08-01T19:54:50.210332+0000", 2023-08-01T19:55:09.179 INFO:teuthology.orchestra.run.smithi101.stdout: "duration": 5.8479999999999997e-06 2023-08-01T19:55:09.179 INFO:teuthology.orchestra.run.smithi101.stdout: }, 2023-08-01T19:55:09.179 INFO:teuthology.orchestra.run.smithi101.stdout: { 2023-08-01T19:55:09.180 INFO:teuthology.orchestra.run.smithi101.stdout: "event": "reached_pg", 2023-08-01T19:55:09.180 INFO:teuthology.orchestra.run.smithi101.stdout: "time": "2023-08-01T19:54:50.214259+0000", 2023-08-01T19:55:09.180 INFO:teuthology.orchestra.run.smithi101.stdout: "duration": 0.003926789 2023-08-01T19:55:09.180 INFO:teuthology.orchestra.run.smithi101.stdout: }, 2023-08-01T19:55:09.180 INFO:teuthology.orchestra.run.smithi101.stdout: { 2023-08-01T19:55:09.180 INFO:teuthology.orchestra.run.smithi101.stdout: "event": "started", 2023-08-01T19:55:09.180 INFO:teuthology.orchestra.run.smithi101.stdout: "time": "2023-08-01T19:54:50.214387+0000", 2023-08-01T19:55:09.180 INFO:teuthology.orchestra.run.smithi101.stdout: "duration": 0.00012787599999999999 2023-08-01T19:55:09.181 INFO:teuthology.orchestra.run.smithi101.stdout: }, 2023-08-01T19:55:09.181 INFO:teuthology.orchestra.run.smithi101.stdout: { 2023-08-01T19:55:09.181 INFO:teuthology.orchestra.run.smithi101.stdout: "event": "waiting for subops from 0", 2023-08-01T19:55:09.181 INFO:teuthology.orchestra.run.smithi101.stdout: "time": "2023-08-01T19:54:50.214536+0000", 2023-08-01T19:55:09.181 INFO:teuthology.orchestra.run.smithi101.stdout: "duration": 0.00014935299999999999 2023-08-01T19:55:09.181 INFO:teuthology.orchestra.run.smithi101.stdout: }, 2023-08-01T19:55:09.181 INFO:teuthology.orchestra.run.smithi101.stdout: { 2023-08-01T19:55:09.181 INFO:teuthology.orchestra.run.smithi101.stdout: "event": "op_commit", 2023-08-01T19:55:09.182 INFO:teuthology.orchestra.run.smithi101.stdout: "time": "2023-08-01T19:54:50.217739+0000", 2023-08-01T19:55:09.182 INFO:teuthology.orchestra.run.smithi101.stdout: "duration": 0.0032034619999999998 2023-08-01T19:55:09.182 INFO:teuthology.orchestra.run.smithi101.stdout: }, 2023-08-01T19:55:09.182 INFO:teuthology.orchestra.run.smithi101.stdout: { 2023-08-01T19:55:09.182 INFO:teuthology.orchestra.run.smithi101.stdout: "event": "sub_op_commit_rec", 2023-08-01T19:55:09.182 INFO:teuthology.orchestra.run.smithi101.stdout: "time": "2023-08-01T19:54:50.230032+0000", 2023-08-01T19:55:09.182 INFO:teuthology.orchestra.run.smithi101.stdout: "duration": 0.012293068000000001 2023-08-01T19:55:09.182 INFO:teuthology.orchestra.run.smithi101.stdout: }, 2023-08-01T19:55:09.183 INFO:teuthology.orchestra.run.smithi101.stdout: { 2023-08-01T19:55:09.183 INFO:teuthology.orchestra.run.smithi101.stdout: "event": "commit_sent", 2023-08-01T19:55:09.183 INFO:teuthology.orchestra.run.smithi101.stdout: "time": "2023-08-01T19:54:50.230075+0000", 2023-08-01T19:55:09.183 INFO:teuthology.orchestra.run.smithi101.stdout: "duration": 4.3062999999999997e-05 2023-08-01T19:55:09.183 INFO:teuthology.orchestra.run.smithi101.stdout: }, 2023-08-01T19:55:09.183 INFO:teuthology.orchestra.run.smithi101.stdout: { 2023-08-01T19:55:09.183 INFO:teuthology.orchestra.run.smithi101.stdout: "event": "done", 2023-08-01T19:55:09.184 INFO:teuthology.orchestra.run.smithi101.stdout: "time": "2023-08-01T19:54:50.230108+0000", 2023-08-01T19:55:09.184 INFO:teuthology.orchestra.run.smithi101.stdout: "duration": 3.2366999999999997e-05 2023-08-01T19:55:09.184 INFO:teuthology.orchestra.run.smithi101.stdout: } 2023-08-01T19:55:09.184 INFO:teuthology.orchestra.run.smithi101.stdout: ] 2023-08-01T19:55:09.184 INFO:teuthology.orchestra.run.smithi101.stdout: } 2023-08-01T19:55:09.184 INFO:teuthology.orchestra.run.smithi101.stdout: }, 2023-08-01T19:55:09.184 INFO:teuthology.orchestra.run.smithi101.stdout: { 2023-08-01T19:55:09.184 INFO:teuthology.orchestra.run.smithi101.stdout: "description": "osd_op(client.4668.0:73460 5.f 5:ff4f0704:::benchmark_data_smithi006_114134_object73459:head [set-alloc-hint object_size 65536 write_size 65536,write 0~65536] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e31)", 2023-08-01T19:55:09.185 INFO:teuthology.orchestra.run.smithi101.stdout: "initiated_at": "2023-08-01T19:54:51.462968+0000", 2023-08-01T19:55:09.185 INFO:teuthology.orchestra.run.smithi101.stdout: "age": 17.577609196000001, 2023-08-01T19:55:09.185 INFO:teuthology.orchestra.run.smithi101.stdout: "duration": 0.020056502, 2023-08-01T19:55:09.185 INFO:teuthology.orchestra.run.smithi101.stdout: "type_data": { 2023-08-01T19:55:09.185 INFO:teuthology.orchestra.run.smithi101.stdout: "flag_point": "commit sent; apply or cleanup", 2023-08-01T19:55:09.185 INFO:teuthology.orchestra.run.smithi101.stdout: "client_info": { 2023-08-01T19:55:09.185 INFO:teuthology.orchestra.run.smithi101.stdout: "client": "client.4668", 2023-08-01T19:55:09.185 INFO:teuthology.orchestra.run.smithi101.stdout: "client_addr": "172.21.15.6:0/1709472247", 2023-08-01T19:55:09.186 INFO:teuthology.orchestra.run.smithi101.stdout: "tid": 73460 2023-08-01T19:55:09.186 INFO:teuthology.orchestra.run.smithi101.stdout: }, 2023-08-01T19:55:09.186 INFO:teuthology.orchestra.run.smithi101.stdout: "events": [ 2023-08-01T19:55:09.186 INFO:teuthology.orchestra.run.smithi101.stdout: { 2023-08-01T19:55:09.186 INFO:teuthology.orchestra.run.smithi101.stdout: "event": "initiated", 2023-08-01T19:55:09.186 INFO:teuthology.orchestra.run.smithi101.stdout: "time": "2023-08-01T19:54:51.462968+0000", 2023-08-01T19:55:09.186 INFO:teuthology.orchestra.run.smithi101.stdout: "duration": 0 2023-08-01T19:55:09.186 INFO:teuthology.orchestra.run.smithi101.stdout: }, 2023-08-01T19:55:09.187 INFO:teuthology.orchestra.run.smithi101.stdout: { 2023-08-01T19:55:09.187 INFO:teuthology.orchestra.run.smithi101.stdout: "event": "throttled", 2023-08-01T19:55:09.187 INFO:teuthology.orchestra.run.smithi101.stdout: "time": "2023-08-01T19:54:51.462968+0000", 2023-08-01T19:55:09.187 INFO:teuthology.orchestra.run.smithi101.stdout: "duration": 0 2023-08-01T19:55:09.187 INFO:teuthology.orchestra.run.smithi101.stdout: }, 2023-08-01T19:55:09.187 INFO:teuthology.orchestra.run.smithi101.stdout: { 2023-08-01T19:55:09.187 INFO:teuthology.orchestra.run.smithi101.stdout: "event": "header_read", 2023-08-01T19:55:09.187 INFO:teuthology.orchestra.run.smithi101.stdout: "time": "2023-08-01T19:54:51.462967+0000", 2023-08-01T19:55:09.188 INFO:teuthology.orchestra.run.smithi101.stdout: "duration": 4294967295.999999 2023-08-01T19:55:09.188 INFO:teuthology.orchestra.run.smithi101.stdout: }, 2023-08-01T19:55:09.188 INFO:teuthology.orchestra.run.smithi101.stdout: { 2023-08-01T19:55:09.188 INFO:teuthology.orchestra.run.smithi101.stdout: "event": "all_read", 2023-08-01T19:55:09.188 INFO:teuthology.orchestra.run.smithi101.stdout: "time": "2023-08-01T19:54:51.463009+0000", 2023-08-01T19:55:09.188 INFO:teuthology.orchestra.run.smithi101.stdout: "duration": 4.2106e-05 2023-08-01T19:55:09.188 INFO:teuthology.orchestra.run.smithi101.stdout: }, 2023-08-01T19:55:09.188 INFO:teuthology.orchestra.run.smithi101.stdout: { 2023-08-01T19:55:09.189 INFO:teuthology.orchestra.run.smithi101.stdout: "event": "dispatched", 2023-08-01T19:55:09.189 INFO:teuthology.orchestra.run.smithi101.stdout: "time": "2023-08-01T19:54:51.463017+0000", 2023-08-01T19:55:09.189 INFO:teuthology.orchestra.run.smithi101.stdout: "duration": 8.1529999999999997e-06 2023-08-01T19:55:09.189 INFO:teuthology.orchestra.run.smithi101.stdout: }, 2023-08-01T19:55:09.189 INFO:teuthology.orchestra.run.smithi101.stdout: { 2023-08-01T19:55:09.189 INFO:teuthology.orchestra.run.smithi101.stdout: "event": "queued_for_pg", 2023-08-01T19:55:09.189 INFO:teuthology.orchestra.run.smithi101.stdout: "time": "2023-08-01T19:54:51.463027+0000", 2023-08-01T19:55:09.190 INFO:teuthology.orchestra.run.smithi101.stdout: "duration": 9.5659999999999996e-06 2023-08-01T19:55:09.190 INFO:teuthology.orchestra.run.smithi101.stdout: }, 2023-08-01T19:55:09.190 INFO:teuthology.orchestra.run.smithi101.stdout: { 2023-08-01T19:55:09.190 INFO:teuthology.orchestra.run.smithi101.stdout: "event": "reached_pg", 2023-08-01T19:55:09.190 INFO:teuthology.orchestra.run.smithi101.stdout: "time": "2023-08-01T19:54:51.463062+0000", 2023-08-01T19:55:09.190 INFO:teuthology.orchestra.run.smithi101.stdout: "duration": 3.5442999999999999e-05 2023-08-01T19:55:09.190 INFO:teuthology.orchestra.run.smithi101.stdout: }, 2023-08-01T19:55:09.190 INFO:teuthology.orchestra.run.smithi101.stdout: { 2023-08-01T19:55:09.191 INFO:teuthology.orchestra.run.smithi101.stdout: "event": "started", 2023-08-01T19:55:09.191 INFO:teuthology.orchestra.run.smithi101.stdout: "time": "2023-08-01T19:54:51.463198+0000", 2023-08-01T19:55:09.191 INFO:teuthology.orchestra.run.smithi101.stdout: "duration": 0.000135628 2023-08-01T19:55:09.191 INFO:teuthology.orchestra.run.smithi101.stdout: }, 2023-08-01T19:55:09.191 INFO:teuthology.orchestra.run.smithi101.stdout: { 2023-08-01T19:55:09.191 INFO:teuthology.orchestra.run.smithi101.stdout: "event": "waiting for subops from 2", 2023-08-01T19:55:09.191 INFO:teuthology.orchestra.run.smithi101.stdout: "time": "2023-08-01T19:54:51.463341+0000", 2023-08-01T19:55:09.191 INFO:teuthology.orchestra.run.smithi101.stdout: "duration": 0.00014346500000000001 2023-08-01T19:55:09.192 INFO:teuthology.orchestra.run.smithi101.stdout: }, 2023-08-01T19:55:09.192 INFO:teuthology.orchestra.run.smithi101.stdout: { 2023-08-01T19:55:09.192 INFO:teuthology.orchestra.run.smithi101.stdout: "event": "op_commit", 2023-08-01T19:55:09.192 INFO:teuthology.orchestra.run.smithi101.stdout: "time": "2023-08-01T19:54:51.472684+0000", 2023-08-01T19:55:09.192 INFO:teuthology.orchestra.run.smithi101.stdout: "duration": 0.0093427900000000001 2023-08-01T19:55:09.192 INFO:teuthology.orchestra.run.smithi101.stdout: }, 2023-08-01T19:55:09.192 INFO:teuthology.orchestra.run.smithi101.stdout: { 2023-08-01T19:55:09.192 INFO:teuthology.orchestra.run.smithi101.stdout: "event": "sub_op_commit_rec", 2023-08-01T19:55:09.193 INFO:teuthology.orchestra.run.smithi101.stdout: "time": "2023-08-01T19:54:51.482937+0000", 2023-08-01T19:55:09.193 INFO:teuthology.orchestra.run.smithi101.stdout: "duration": 0.010252557000000001 2023-08-01T19:55:09.193 INFO:teuthology.orchestra.run.smithi101.stdout: }, 2023-08-01T19:55:09.193 INFO:teuthology.orchestra.run.smithi101.stdout: { 2023-08-01T19:55:09.193 INFO:teuthology.orchestra.run.smithi101.stdout: "event": "commit_sent", 2023-08-01T19:55:09.193 INFO:teuthology.orchestra.run.smithi101.stdout: "time": "2023-08-01T19:54:51.482984+0000", 2023-08-01T19:55:09.193 INFO:teuthology.orchestra.run.smithi101.stdout: "duration": 4.7394000000000001e-05 2023-08-01T19:55:09.193 INFO:teuthology.orchestra.run.smithi101.stdout: }, 2023-08-01T19:55:09.194 INFO:teuthology.orchestra.run.smithi101.stdout: { 2023-08-01T19:55:09.194 INFO:teuthology.orchestra.run.smithi101.stdout: "event": "done", 2023-08-01T19:55:09.194 INFO:teuthology.orchestra.run.smithi101.stdout: "time": "2023-08-01T19:54:51.483024+0000", 2023-08-01T19:55:09.194 INFO:teuthology.orchestra.run.smithi101.stdout: "duration": 4.0159e-05 2023-08-01T19:55:09.194 INFO:teuthology.orchestra.run.smithi101.stdout: } 2023-08-01T19:55:09.194 INFO:teuthology.orchestra.run.smithi101.stdout: ] 2023-08-01T19:55:09.194 INFO:teuthology.orchestra.run.smithi101.stdout: } 2023-08-01T19:55:09.194 INFO:teuthology.orchestra.run.smithi101.stdout: }, 2023-08-01T19:55:09.195 INFO:teuthology.orchestra.run.smithi101.stdout: { 2023-08-01T19:55:09.195 INFO:teuthology.orchestra.run.smithi101.stdout: "description": "osd_op(client.4668.0:92726 5.2 5:41e18163:::benchmark_data_smithi006_114134_object92725:head [set-alloc-hint object_size 65536 write_size 65536,write 0~65536] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e36)", 2023-08-01T19:55:09.195 INFO:teuthology.orchestra.run.smithi101.stdout: "initiated_at": "2023-08-01T19:55:01.256971+0000", 2023-08-01T19:55:09.195 INFO:teuthology.orchestra.run.smithi101.stdout: "age": 7.7836061169999997, 2023-08-01T19:55:09.195 INFO:teuthology.orchestra.run.smithi101.stdout: "duration": 0.019854296, 2023-08-01T19:55:09.195 INFO:teuthology.orchestra.run.smithi101.stdout: "type_data": { 2023-08-01T19:55:09.195 INFO:teuthology.orchestra.run.smithi101.stdout: "flag_point": "commit sent; apply or cleanup", 2023-08-01T19:55:09.195 INFO:teuthology.orchestra.run.smithi101.stdout: "client_info": { 2023-08-01T19:55:09.196 INFO:teuthology.orchestra.run.smithi101.stdout: "client": "client.4668", 2023-08-01T19:55:09.196 INFO:teuthology.orchestra.run.smithi101.stdout: "client_addr": "172.21.15.6:0/1709472247", 2023-08-01T19:55:09.196 INFO:teuthology.orchestra.run.smithi101.stdout: "tid": 92726 2023-08-01T19:55:09.196 INFO:teuthology.orchestra.run.smithi101.stdout: }, 2023-08-01T19:55:09.196 INFO:teuthology.orchestra.run.smithi101.stdout: "events": [ 2023-08-01T19:55:09.196 INFO:teuthology.orchestra.run.smithi101.stdout: { 2023-08-01T19:55:09.196 INFO:teuthology.orchestra.run.smithi101.stdout: "event": "initiated", 2023-08-01T19:55:09.197 INFO:teuthology.orchestra.run.smithi101.stdout: "time": "2023-08-01T19:55:01.256971+0000", 2023-08-01T19:55:09.197 INFO:teuthology.orchestra.run.smithi101.stdout: "duration": 0 2023-08-01T19:55:09.197 INFO:teuthology.orchestra.run.smithi101.stdout: }, 2023-08-01T19:55:09.197 INFO:teuthology.orchestra.run.smithi101.stdout: { 2023-08-01T19:55:09.197 INFO:teuthology.orchestra.run.smithi101.stdout: "event": "throttled", 2023-08-01T19:55:09.197 INFO:teuthology.orchestra.run.smithi101.stdout: "time": "2023-08-01T19:55:01.256971+0000", 2023-08-01T19:55:09.197 INFO:teuthology.orchestra.run.smithi101.stdout: "duration": 0 2023-08-01T19:55:09.197 INFO:teuthology.orchestra.run.smithi101.stdout: }, 2023-08-01T19:55:09.198 INFO:teuthology.orchestra.run.smithi101.stdout: { 2023-08-01T19:55:09.198 INFO:teuthology.orchestra.run.smithi101.stdout: "event": "header_read", 2023-08-01T19:55:09.198 INFO:teuthology.orchestra.run.smithi101.stdout: "time": "2023-08-01T19:55:01.256970+0000", 2023-08-01T19:55:09.198 INFO:teuthology.orchestra.run.smithi101.stdout: "duration": 4294967295.9999995 2023-08-01T19:55:09.198 INFO:teuthology.orchestra.run.smithi101.stdout: }, 2023-08-01T19:55:09.198 INFO:teuthology.orchestra.run.smithi101.stdout: { 2023-08-01T19:55:09.198 INFO:teuthology.orchestra.run.smithi101.stdout: "event": "all_read", 2023-08-01T19:55:09.198 INFO:teuthology.orchestra.run.smithi101.stdout: "time": "2023-08-01T19:55:01.257057+0000", 2023-08-01T19:55:09.199 INFO:teuthology.orchestra.run.smithi101.stdout: "duration": 8.6627999999999998e-05 2023-08-01T19:55:09.199 INFO:teuthology.orchestra.run.smithi101.stdout: }, 2023-08-01T19:55:09.199 INFO:teuthology.orchestra.run.smithi101.stdout: { 2023-08-01T19:55:09.199 INFO:teuthology.orchestra.run.smithi101.stdout: "event": "dispatched", 2023-08-01T19:55:09.199 INFO:teuthology.orchestra.run.smithi101.stdout: "time": "2023-08-01T19:55:01.257063+0000", 2023-08-01T19:55:09.199 INFO:teuthology.orchestra.run.smithi101.stdout: "duration": 6.528e-06 2023-08-01T19:55:09.199 INFO:teuthology.orchestra.run.smithi101.stdout: }, 2023-08-01T19:55:09.199 INFO:teuthology.orchestra.run.smithi101.stdout: { 2023-08-01T19:55:09.200 INFO:teuthology.orchestra.run.smithi101.stdout: "event": "queued_for_pg", 2023-08-01T19:55:09.200 INFO:teuthology.orchestra.run.smithi101.stdout: "time": "2023-08-01T19:55:01.257067+0000", 2023-08-01T19:55:09.200 INFO:teuthology.orchestra.run.smithi101.stdout: "duration": 3.2739999999999999e-06 2023-08-01T19:55:09.200 INFO:teuthology.orchestra.run.smithi101.stdout: }, 2023-08-01T19:55:09.200 INFO:teuthology.orchestra.run.smithi101.stdout: { 2023-08-01T19:55:09.200 INFO:teuthology.orchestra.run.smithi101.stdout: "event": "reached_pg", 2023-08-01T19:55:09.200 INFO:teuthology.orchestra.run.smithi101.stdout: "time": "2023-08-01T19:55:01.259714+0000", 2023-08-01T19:55:09.200 INFO:teuthology.orchestra.run.smithi101.stdout: "duration": 0.0026476709999999999 2023-08-01T19:55:09.201 INFO:teuthology.orchestra.run.smithi101.stdout: }, 2023-08-01T19:55:09.201 INFO:teuthology.orchestra.run.smithi101.stdout: { 2023-08-01T19:55:09.201 INFO:teuthology.orchestra.run.smithi101.stdout: "event": "started", 2023-08-01T19:55:09.201 INFO:teuthology.orchestra.run.smithi101.stdout: "time": "2023-08-01T19:55:01.259829+0000", 2023-08-01T19:55:09.201 INFO:teuthology.orchestra.run.smithi101.stdout: "duration": 0.000114471 2023-08-01T19:55:09.201 INFO:teuthology.orchestra.run.smithi101.stdout: }, 2023-08-01T19:55:09.201 INFO:teuthology.orchestra.run.smithi101.stdout: { 2023-08-01T19:55:09.201 INFO:teuthology.orchestra.run.smithi101.stdout: "event": "waiting for subops from 0", 2023-08-01T19:55:09.202 INFO:teuthology.orchestra.run.smithi101.stdout: "time": "2023-08-01T19:55:01.259965+0000", 2023-08-01T19:55:09.202 INFO:teuthology.orchestra.run.smithi101.stdout: "duration": 0.00013597300000000001 2023-08-01T19:55:09.202 INFO:teuthology.orchestra.run.smithi101.stdout: }, 2023-08-01T19:55:09.202 INFO:teuthology.orchestra.run.smithi101.stdout: { 2023-08-01T19:55:09.202 INFO:teuthology.orchestra.run.smithi101.stdout: "event": "op_commit", 2023-08-01T19:55:09.202 INFO:teuthology.orchestra.run.smithi101.stdout: "time": "2023-08-01T19:55:01.264360+0000", 2023-08-01T19:55:09.202 INFO:teuthology.orchestra.run.smithi101.stdout: "duration": 0.0043956619999999998 2023-08-01T19:55:09.202 INFO:teuthology.orchestra.run.smithi101.stdout: }, 2023-08-01T19:55:09.203 INFO:teuthology.orchestra.run.smithi101.stdout: { 2023-08-01T19:55:09.203 INFO:teuthology.orchestra.run.smithi101.stdout: "event": "sub_op_commit_rec", 2023-08-01T19:55:09.203 INFO:teuthology.orchestra.run.smithi101.stdout: "time": "2023-08-01T19:55:01.276766+0000", 2023-08-01T19:55:09.203 INFO:teuthology.orchestra.run.smithi101.stdout: "duration": 0.012405736000000001 2023-08-01T19:55:09.203 INFO:teuthology.orchestra.run.smithi101.stdout: }, 2023-08-01T19:55:09.203 INFO:teuthology.orchestra.run.smithi101.stdout: { 2023-08-01T19:55:09.203 INFO:teuthology.orchestra.run.smithi101.stdout: "event": "commit_sent", 2023-08-01T19:55:09.203 INFO:teuthology.orchestra.run.smithi101.stdout: "time": "2023-08-01T19:55:01.276804+0000", 2023-08-01T19:55:09.204 INFO:teuthology.orchestra.run.smithi101.stdout: "duration": 3.7759999999999998e-05 2023-08-01T19:55:09.204 INFO:teuthology.orchestra.run.smithi101.stdout: }, 2023-08-01T19:55:09.204 INFO:teuthology.orchestra.run.smithi101.stdout: { 2023-08-01T19:55:09.204 INFO:teuthology.orchestra.run.smithi101.stdout: "event": "done", 2023-08-01T19:55:09.204 INFO:teuthology.orchestra.run.smithi101.stdout: "time": "2023-08-01T19:55:01.276825+0000", 2023-08-01T19:55:09.204 INFO:teuthology.orchestra.run.smithi101.stdout: "duration": 2.1299000000000001e-05 2023-08-01T19:55:09.204 INFO:teuthology.orchestra.run.smithi101.stdout: } 2023-08-01T19:55:09.205 INFO:teuthology.orchestra.run.smithi101.stdout: ] 2023-08-01T19:55:09.205 INFO:teuthology.orchestra.run.smithi101.stdout: } 2023-08-01T19:55:09.205 INFO:teuthology.orchestra.run.smithi101.stdout: }, 2023-08-01T19:55:09.205 INFO:teuthology.orchestra.run.smithi101.stdout: { 2023-08-01T19:55:09.205 INFO:teuthology.orchestra.run.smithi101.stdout: "description": "osd_op(client.4668.0:100244 5.9 5:92f56a12:::benchmark_data_smithi006_114134_object100243:head [set-alloc-hint object_size 65536 write_size 65536,write 0~65536] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e37)", 2023-08-01T19:55:09.205 INFO:teuthology.orchestra.run.smithi101.stdout: "initiated_at": "2023-08-01T19:55:05.150910+0000", 2023-08-01T19:55:09.205 INFO:teuthology.orchestra.run.smithi101.stdout: "age": 3.8896673010000002, 2023-08-01T19:55:09.205 INFO:teuthology.orchestra.run.smithi101.stdout: "duration": 0.072864287, 2023-08-01T19:55:09.206 INFO:teuthology.orchestra.run.smithi101.stdout: "type_data": { 2023-08-01T19:55:09.206 INFO:teuthology.orchestra.run.smithi101.stdout: "flag_point": "commit sent; apply or cleanup", 2023-08-01T19:55:09.206 INFO:teuthology.orchestra.run.smithi101.stdout: "client_info": { 2023-08-01T19:55:09.206 INFO:teuthology.orchestra.run.smithi101.stdout: "client": "client.4668", 2023-08-01T19:55:09.206 INFO:teuthology.orchestra.run.smithi101.stdout: "client_addr": "172.21.15.6:0/1709472247", 2023-08-01T19:55:09.206 INFO:teuthology.orchestra.run.smithi101.stdout: "tid": 100244 2023-08-01T19:55:09.206 INFO:teuthology.orchestra.run.smithi101.stdout: }, 2023-08-01T19:55:09.206 INFO:teuthology.orchestra.run.smithi101.stdout: "events": [ 2023-08-01T19:55:09.207 INFO:teuthology.orchestra.run.smithi101.stdout: { 2023-08-01T19:55:09.207 INFO:teuthology.orchestra.run.smithi101.stdout: "event": "initiated", 2023-08-01T19:55:09.207 INFO:teuthology.orchestra.run.smithi101.stdout: "time": "2023-08-01T19:55:05.150910+0000", 2023-08-01T19:55:09.207 INFO:teuthology.orchestra.run.smithi101.stdout: "duration": 0 2023-08-01T19:55:09.207 INFO:teuthology.orchestra.run.smithi101.stdout: }, 2023-08-01T19:55:09.207 INFO:teuthology.orchestra.run.smithi101.stdout: { 2023-08-01T19:55:09.207 INFO:teuthology.orchestra.run.smithi101.stdout: "event": "throttled", 2023-08-01T19:55:09.207 INFO:teuthology.orchestra.run.smithi101.stdout: "time": "2023-08-01T19:55:05.150910+0000", 2023-08-01T19:55:09.208 INFO:teuthology.orchestra.run.smithi101.stdout: "duration": 0 2023-08-01T19:55:09.208 INFO:teuthology.orchestra.run.smithi101.stdout: }, 2023-08-01T19:55:09.208 INFO:teuthology.orchestra.run.smithi101.stdout: { 2023-08-01T19:55:09.208 INFO:teuthology.orchestra.run.smithi101.stdout: "event": "header_read", 2023-08-01T19:55:09.208 INFO:teuthology.orchestra.run.smithi101.stdout: "time": "2023-08-01T19:55:05.150909+0000", 2023-08-01T19:55:09.208 INFO:teuthology.orchestra.run.smithi101.stdout: "duration": 4294967295.999999 2023-08-01T19:55:09.208 INFO:teuthology.orchestra.run.smithi101.stdout: }, 2023-08-01T19:55:09.208 INFO:teuthology.orchestra.run.smithi101.stdout: { 2023-08-01T19:55:09.209 INFO:teuthology.orchestra.run.smithi101.stdout: "event": "all_read", 2023-08-01T19:55:09.209 INFO:teuthology.orchestra.run.smithi101.stdout: "time": "2023-08-01T19:55:05.150973+0000", 2023-08-01T19:55:09.209 INFO:teuthology.orchestra.run.smithi101.stdout: "duration": 6.4531999999999998e-05 2023-08-01T19:55:09.209 INFO:teuthology.orchestra.run.smithi101.stdout: }, 2023-08-01T19:55:09.209 INFO:teuthology.orchestra.run.smithi101.stdout: { 2023-08-01T19:55:09.209 INFO:teuthology.orchestra.run.smithi101.stdout: "event": "dispatched", 2023-08-01T19:55:09.209 INFO:teuthology.orchestra.run.smithi101.stdout: "time": "2023-08-01T19:55:05.150984+0000", 2023-08-01T19:55:09.209 INFO:teuthology.orchestra.run.smithi101.stdout: "duration": 1.0287e-05 2023-08-01T19:55:09.210 INFO:teuthology.orchestra.run.smithi101.stdout: }, 2023-08-01T19:55:09.210 INFO:teuthology.orchestra.run.smithi101.stdout: { 2023-08-01T19:55:09.210 INFO:teuthology.orchestra.run.smithi101.stdout: "event": "queued_for_pg", 2023-08-01T19:55:09.210 INFO:teuthology.orchestra.run.smithi101.stdout: "time": "2023-08-01T19:55:05.150989+0000", 2023-08-01T19:55:09.210 INFO:teuthology.orchestra.run.smithi101.stdout: "duration": 5.3929999999999999e-06 2023-08-01T19:55:09.210 INFO:teuthology.orchestra.run.smithi101.stdout: }, 2023-08-01T19:55:09.210 INFO:teuthology.orchestra.run.smithi101.stdout: { 2023-08-01T19:55:09.210 INFO:teuthology.orchestra.run.smithi101.stdout: "event": "reached_pg", 2023-08-01T19:55:09.211 INFO:teuthology.orchestra.run.smithi101.stdout: "time": "2023-08-01T19:55:05.151034+0000", 2023-08-01T19:55:09.211 INFO:teuthology.orchestra.run.smithi101.stdout: "duration": 4.4336999999999999e-05 2023-08-01T19:55:09.211 INFO:teuthology.orchestra.run.smithi101.stdout: }, 2023-08-01T19:55:09.211 INFO:teuthology.orchestra.run.smithi101.stdout: { 2023-08-01T19:55:09.211 INFO:teuthology.orchestra.run.smithi101.stdout: "event": "started", 2023-08-01T19:55:09.211 INFO:teuthology.orchestra.run.smithi101.stdout: "time": "2023-08-01T19:55:05.151167+0000", 2023-08-01T19:55:09.211 INFO:teuthology.orchestra.run.smithi101.stdout: "duration": 0.00013368899999999999 2023-08-01T19:55:09.211 INFO:teuthology.orchestra.run.smithi101.stdout: }, 2023-08-01T19:55:09.212 INFO:teuthology.orchestra.run.smithi101.stdout: { 2023-08-01T19:55:09.212 INFO:teuthology.orchestra.run.smithi101.stdout: "event": "waiting for subops from 2", 2023-08-01T19:55:09.212 INFO:teuthology.orchestra.run.smithi101.stdout: "time": "2023-08-01T19:55:05.151328+0000", 2023-08-01T19:55:09.212 INFO:teuthology.orchestra.run.smithi101.stdout: "duration": 0.00016122700000000001 2023-08-01T19:55:09.212 INFO:teuthology.orchestra.run.smithi101.stdout: }, 2023-08-01T19:55:09.212 INFO:teuthology.orchestra.run.smithi101.stdout: { 2023-08-01T19:55:09.212 INFO:teuthology.orchestra.run.smithi101.stdout: "event": "op_commit", 2023-08-01T19:55:09.213 INFO:teuthology.orchestra.run.smithi101.stdout: "time": "2023-08-01T19:55:05.156101+0000", 2023-08-01T19:55:09.213 INFO:teuthology.orchestra.run.smithi101.stdout: "duration": 0.0047724100000000004 2023-08-01T19:55:09.213 INFO:teuthology.orchestra.run.smithi101.stdout: }, 2023-08-01T19:55:09.213 INFO:teuthology.orchestra.run.smithi101.stdout: { 2023-08-01T19:55:09.213 INFO:teuthology.orchestra.run.smithi101.stdout: "event": "sub_op_commit_rec", 2023-08-01T19:55:09.213 INFO:teuthology.orchestra.run.smithi101.stdout: "time": "2023-08-01T19:55:05.223688+0000", 2023-08-01T19:55:09.213 INFO:teuthology.orchestra.run.smithi101.stdout: "duration": 0.067586937999999999 2023-08-01T19:55:09.213 INFO:teuthology.orchestra.run.smithi101.stdout: }, 2023-08-01T19:55:09.214 INFO:teuthology.orchestra.run.smithi101.stdout: { 2023-08-01T19:55:09.214 INFO:teuthology.orchestra.run.smithi101.stdout: "event": "commit_sent", 2023-08-01T19:55:09.214 INFO:teuthology.orchestra.run.smithi101.stdout: "time": "2023-08-01T19:55:05.223737+0000", 2023-08-01T19:55:09.214 INFO:teuthology.orchestra.run.smithi101.stdout: "duration": 4.8921999999999997e-05 2023-08-01T19:55:09.214 INFO:teuthology.orchestra.run.smithi101.stdout: }, 2023-08-01T19:55:09.214 INFO:teuthology.orchestra.run.smithi101.stdout: { 2023-08-01T19:55:09.214 INFO:teuthology.orchestra.run.smithi101.stdout: "event": "done", 2023-08-01T19:55:09.214 INFO:teuthology.orchestra.run.smithi101.stdout: "time": "2023-08-01T19:55:05.223774+0000", 2023-08-01T19:55:09.215 INFO:teuthology.orchestra.run.smithi101.stdout: "duration": 3.7342999999999998e-05 2023-08-01T19:55:09.215 INFO:teuthology.orchestra.run.smithi101.stdout: } 2023-08-01T19:55:09.215 INFO:teuthology.orchestra.run.smithi101.stdout: ] 2023-08-01T19:55:09.215 INFO:teuthology.orchestra.run.smithi101.stdout: } 2023-08-01T19:55:09.215 INFO:teuthology.orchestra.run.smithi101.stdout: }, 2023-08-01T19:55:09.215 INFO:teuthology.orchestra.run.smithi101.stdout: { 2023-08-01T19:55:09.215 INFO:teuthology.orchestra.run.smithi101.stdout: "description": "osd_op(client.4668.0:100253 5.f 5:f7bbce05:::benchmark_data_smithi006_114134_object100252:head [set-alloc-hint object_size 65536 write_size 65536,write 0~65536] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e37)", 2023-08-01T19:55:09.215 INFO:teuthology.orchestra.run.smithi101.stdout: "initiated_at": "2023-08-01T19:55:05.156562+0000", 2023-08-01T19:55:09.216 INFO:teuthology.orchestra.run.smithi101.stdout: "age": 3.8840152679999997, 2023-08-01T19:55:09.216 INFO:teuthology.orchestra.run.smithi101.stdout: "duration": 0.068677503000000001, 2023-08-01T19:55:09.216 INFO:teuthology.orchestra.run.smithi101.stdout: "type_data": { 2023-08-01T19:55:09.216 INFO:teuthology.orchestra.run.smithi101.stdout: "flag_point": "commit sent; apply or cleanup", 2023-08-01T19:55:09.216 INFO:teuthology.orchestra.run.smithi101.stdout: "client_info": { 2023-08-01T19:55:09.216 INFO:teuthology.orchestra.run.smithi101.stdout: "client": "client.4668", 2023-08-01T19:55:09.216 INFO:teuthology.orchestra.run.smithi101.stdout: "client_addr": "172.21.15.6:0/1709472247", 2023-08-01T19:55:09.217 INFO:teuthology.orchestra.run.smithi101.stdout: "tid": 100253 2023-08-01T19:55:09.217 INFO:teuthology.orchestra.run.smithi101.stdout: }, 2023-08-01T19:55:09.217 INFO:teuthology.orchestra.run.smithi101.stdout: "events": [ 2023-08-01T19:55:09.217 INFO:teuthology.orchestra.run.smithi101.stdout: { 2023-08-01T19:55:09.217 INFO:teuthology.orchestra.run.smithi101.stdout: "event": "initiated", 2023-08-01T19:55:09.217 INFO:teuthology.orchestra.run.smithi101.stdout: "time": "2023-08-01T19:55:05.156562+0000", 2023-08-01T19:55:09.217 INFO:teuthology.orchestra.run.smithi101.stdout: "duration": 0 2023-08-01T19:55:09.217 INFO:teuthology.orchestra.run.smithi101.stdout: }, 2023-08-01T19:55:09.218 INFO:teuthology.orchestra.run.smithi101.stdout: { 2023-08-01T19:55:09.218 INFO:teuthology.orchestra.run.smithi101.stdout: "event": "throttled", 2023-08-01T19:55:09.218 INFO:teuthology.orchestra.run.smithi101.stdout: "time": "2023-08-01T19:55:05.156562+0000", 2023-08-01T19:55:09.218 INFO:teuthology.orchestra.run.smithi101.stdout: "duration": 0 2023-08-01T19:55:09.218 INFO:teuthology.orchestra.run.smithi101.stdout: }, 2023-08-01T19:55:09.218 INFO:teuthology.orchestra.run.smithi101.stdout: { 2023-08-01T19:55:09.218 INFO:teuthology.orchestra.run.smithi101.stdout: "event": "header_read", 2023-08-01T19:55:09.218 INFO:teuthology.orchestra.run.smithi101.stdout: "time": "2023-08-01T19:55:05.156561+0000", 2023-08-01T19:55:09.219 INFO:teuthology.orchestra.run.smithi101.stdout: "duration": 4294967295.999999 2023-08-01T19:55:09.219 INFO:teuthology.orchestra.run.smithi101.stdout: }, 2023-08-01T19:55:09.219 INFO:teuthology.orchestra.run.smithi101.stdout: { 2023-08-01T19:55:09.219 INFO:teuthology.orchestra.run.smithi101.stdout: "event": "all_read", 2023-08-01T19:55:09.219 INFO:teuthology.orchestra.run.smithi101.stdout: "time": "2023-08-01T19:55:05.156655+0000", 2023-08-01T19:55:09.219 INFO:teuthology.orchestra.run.smithi101.stdout: "duration": 9.4018999999999995e-05 2023-08-01T19:55:09.219 INFO:teuthology.orchestra.run.smithi101.stdout: }, 2023-08-01T19:55:09.219 INFO:teuthology.orchestra.run.smithi101.stdout: { 2023-08-01T19:55:09.220 INFO:teuthology.orchestra.run.smithi101.stdout: "event": "dispatched", 2023-08-01T19:55:09.220 INFO:teuthology.orchestra.run.smithi101.stdout: "time": "2023-08-01T19:55:05.156664+0000", 2023-08-01T19:55:09.220 INFO:teuthology.orchestra.run.smithi101.stdout: "duration": 9.4970000000000007e-06 2023-08-01T19:55:09.220 INFO:teuthology.orchestra.run.smithi101.stdout: }, 2023-08-01T19:55:09.220 INFO:teuthology.orchestra.run.smithi101.stdout: { 2023-08-01T19:55:09.220 INFO:teuthology.orchestra.run.smithi101.stdout: "event": "queued_for_pg", 2023-08-01T19:55:09.220 INFO:teuthology.orchestra.run.smithi101.stdout: "time": "2023-08-01T19:55:05.156671+0000", 2023-08-01T19:55:09.220 INFO:teuthology.orchestra.run.smithi101.stdout: "duration": 6.1929999999999998e-06 2023-08-01T19:55:09.221 INFO:teuthology.orchestra.run.smithi101.stdout: }, 2023-08-01T19:55:09.221 INFO:teuthology.orchestra.run.smithi101.stdout: { 2023-08-01T19:55:09.221 INFO:teuthology.orchestra.run.smithi101.stdout: "event": "reached_pg", 2023-08-01T19:55:09.221 INFO:teuthology.orchestra.run.smithi101.stdout: "time": "2023-08-01T19:55:05.156742+0000", 2023-08-01T19:55:09.221 INFO:teuthology.orchestra.run.smithi101.stdout: "duration": 7.1181999999999997e-05 2023-08-01T19:55:09.221 INFO:teuthology.orchestra.run.smithi101.stdout: }, 2023-08-01T19:55:09.221 INFO:teuthology.orchestra.run.smithi101.stdout: { 2023-08-01T19:55:09.221 INFO:teuthology.orchestra.run.smithi101.stdout: "event": "started", 2023-08-01T19:55:09.222 INFO:teuthology.orchestra.run.smithi101.stdout: "time": "2023-08-01T19:55:05.156839+0000", 2023-08-01T19:55:09.222 INFO:teuthology.orchestra.run.smithi101.stdout: "duration": 9.7182000000000006e-05 2023-08-01T19:55:09.222 INFO:teuthology.orchestra.run.smithi101.stdout: }, 2023-08-01T19:55:09.222 INFO:teuthology.orchestra.run.smithi101.stdout: { 2023-08-01T19:55:09.222 INFO:teuthology.orchestra.run.smithi101.stdout: "event": "waiting for subops from 2", 2023-08-01T19:55:09.222 INFO:teuthology.orchestra.run.smithi101.stdout: "time": "2023-08-01T19:55:05.156925+0000", 2023-08-01T19:55:09.222 INFO:teuthology.orchestra.run.smithi101.stdout: "duration": 8.5816000000000006e-05 2023-08-01T19:55:09.222 INFO:teuthology.orchestra.run.smithi101.stdout: }, 2023-08-01T19:55:09.223 INFO:teuthology.orchestra.run.smithi101.stdout: { 2023-08-01T19:55:09.223 INFO:teuthology.orchestra.run.smithi101.stdout: "event": "op_commit", 2023-08-01T19:55:09.223 INFO:teuthology.orchestra.run.smithi101.stdout: "time": "2023-08-01T19:55:05.160082+0000", 2023-08-01T19:55:09.223 INFO:teuthology.orchestra.run.smithi101.stdout: "duration": 0.0031573959999999998 2023-08-01T19:55:09.223 INFO:teuthology.orchestra.run.smithi101.stdout: }, 2023-08-01T19:55:09.223 INFO:teuthology.orchestra.run.smithi101.stdout: { 2023-08-01T19:55:09.223 INFO:teuthology.orchestra.run.smithi101.stdout: "event": "sub_op_commit_rec", 2023-08-01T19:55:09.223 INFO:teuthology.orchestra.run.smithi101.stdout: "time": "2023-08-01T19:55:05.225162+0000", 2023-08-01T19:55:09.224 INFO:teuthology.orchestra.run.smithi101.stdout: "duration": 0.065079466000000002 2023-08-01T19:55:09.224 INFO:teuthology.orchestra.run.smithi101.stdout: }, 2023-08-01T19:55:09.224 INFO:teuthology.orchestra.run.smithi101.stdout: { 2023-08-01T19:55:09.224 INFO:teuthology.orchestra.run.smithi101.stdout: "event": "commit_sent", 2023-08-01T19:55:09.224 INFO:teuthology.orchestra.run.smithi101.stdout: "time": "2023-08-01T19:55:05.225205+0000", 2023-08-01T19:55:09.224 INFO:teuthology.orchestra.run.smithi101.stdout: "duration": 4.3446999999999999e-05 2023-08-01T19:55:09.224 INFO:teuthology.orchestra.run.smithi101.stdout: }, 2023-08-01T19:55:09.225 INFO:teuthology.orchestra.run.smithi101.stdout: { 2023-08-01T19:55:09.225 INFO:teuthology.orchestra.run.smithi101.stdout: "event": "done", 2023-08-01T19:55:09.225 INFO:teuthology.orchestra.run.smithi101.stdout: "time": "2023-08-01T19:55:05.225239+0000", 2023-08-01T19:55:09.225 INFO:teuthology.orchestra.run.smithi101.stdout: "duration": 3.4121000000000001e-05 2023-08-01T19:55:09.225 INFO:teuthology.orchestra.run.smithi101.stdout: } 2023-08-01T19:55:09.225 INFO:teuthology.orchestra.run.smithi101.stdout: ] 2023-08-01T19:55:09.225 INFO:teuthology.orchestra.run.smithi101.stdout: } 2023-08-01T19:55:09.225 INFO:teuthology.orchestra.run.smithi101.stdout: }, 2023-08-01T19:55:09.226 INFO:teuthology.orchestra.run.smithi101.stdout: { 2023-08-01T19:55:09.226 INFO:teuthology.orchestra.run.smithi101.stdout: "description": "osd_op(client.4668.0:100928 5.7 5:e61a7dfa:::benchmark_data_smithi006_114134_object100927:head [set-alloc-hint object_size 65536 write_size 65536,write 0~65536] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e37)", 2023-08-01T19:55:09.226 INFO:teuthology.orchestra.run.smithi101.stdout: "initiated_at": "2023-08-01T19:55:05.564731+0000", 2023-08-01T19:55:09.226 INFO:teuthology.orchestra.run.smithi101.stdout: "age": 3.4758457759999999, 2023-08-01T19:55:09.226 INFO:teuthology.orchestra.run.smithi101.stdout: "duration": 0.064686603999999995, 2023-08-01T19:55:09.226 INFO:teuthology.orchestra.run.smithi101.stdout: "type_data": { 2023-08-01T19:55:09.226 INFO:teuthology.orchestra.run.smithi101.stdout: "flag_point": "commit sent; apply or cleanup", 2023-08-01T19:55:09.226 INFO:teuthology.orchestra.run.smithi101.stdout: "client_info": { 2023-08-01T19:55:09.227 INFO:teuthology.orchestra.run.smithi101.stdout: "client": "client.4668", 2023-08-01T19:55:09.227 INFO:teuthology.orchestra.run.smithi101.stdout: "client_addr": "172.21.15.6:0/1709472247", 2023-08-01T19:55:09.227 INFO:teuthology.orchestra.run.smithi101.stdout: "tid": 100928 2023-08-01T19:55:09.227 INFO:teuthology.orchestra.run.smithi101.stdout: }, 2023-08-01T19:55:09.227 INFO:teuthology.orchestra.run.smithi101.stdout: "events": [ 2023-08-01T19:55:09.227 INFO:teuthology.orchestra.run.smithi101.stdout: { 2023-08-01T19:55:09.227 INFO:teuthology.orchestra.run.smithi101.stdout: "event": "initiated", 2023-08-01T19:55:09.227 INFO:teuthology.orchestra.run.smithi101.stdout: "time": "2023-08-01T19:55:05.564731+0000", 2023-08-01T19:55:09.228 INFO:teuthology.orchestra.run.smithi101.stdout: "duration": 0 2023-08-01T19:55:09.228 INFO:teuthology.orchestra.run.smithi101.stdout: }, 2023-08-01T19:55:09.228 INFO:teuthology.orchestra.run.smithi101.stdout: { 2023-08-01T19:55:09.228 INFO:teuthology.orchestra.run.smithi101.stdout: "event": "throttled", 2023-08-01T19:55:09.228 INFO:teuthology.orchestra.run.smithi101.stdout: "time": "2023-08-01T19:55:05.564731+0000", 2023-08-01T19:55:09.228 INFO:teuthology.orchestra.run.smithi101.stdout: "duration": 0 2023-08-01T19:55:09.228 INFO:teuthology.orchestra.run.smithi101.stdout: }, 2023-08-01T19:55:09.228 INFO:teuthology.orchestra.run.smithi101.stdout: { 2023-08-01T19:55:09.229 INFO:teuthology.orchestra.run.smithi101.stdout: "event": "header_read", 2023-08-01T19:55:09.229 INFO:teuthology.orchestra.run.smithi101.stdout: "time": "2023-08-01T19:55:05.564731+0000", 2023-08-01T19:55:09.229 INFO:teuthology.orchestra.run.smithi101.stdout: "duration": 4294967295.999999 2023-08-01T19:55:09.229 INFO:teuthology.orchestra.run.smithi101.stdout: }, 2023-08-01T19:55:09.229 INFO:teuthology.orchestra.run.smithi101.stdout: { 2023-08-01T19:55:09.229 INFO:teuthology.orchestra.run.smithi101.stdout: "event": "all_read", 2023-08-01T19:55:09.229 INFO:teuthology.orchestra.run.smithi101.stdout: "time": "2023-08-01T19:55:05.564832+0000", 2023-08-01T19:55:09.229 INFO:teuthology.orchestra.run.smithi101.stdout: "duration": 0.000101752 2023-08-01T19:55:09.230 INFO:teuthology.orchestra.run.smithi101.stdout: }, 2023-08-01T19:55:09.230 INFO:teuthology.orchestra.run.smithi101.stdout: { 2023-08-01T19:55:09.230 INFO:teuthology.orchestra.run.smithi101.stdout: "event": "dispatched", 2023-08-01T19:55:09.230 INFO:teuthology.orchestra.run.smithi101.stdout: "time": "2023-08-01T19:55:05.564840+0000", 2023-08-01T19:55:09.230 INFO:teuthology.orchestra.run.smithi101.stdout: "duration": 7.8590000000000005e-06 2023-08-01T19:55:09.230 INFO:teuthology.orchestra.run.smithi101.stdout: }, 2023-08-01T19:55:09.230 INFO:teuthology.orchestra.run.smithi101.stdout: { 2023-08-01T19:55:09.230 INFO:teuthology.orchestra.run.smithi101.stdout: "event": "queued_for_pg", 2023-08-01T19:55:09.231 INFO:teuthology.orchestra.run.smithi101.stdout: "time": "2023-08-01T19:55:05.564845+0000", 2023-08-01T19:55:09.231 INFO:teuthology.orchestra.run.smithi101.stdout: "duration": 4.9189999999999998e-06 2023-08-01T19:55:09.231 INFO:teuthology.orchestra.run.smithi101.stdout: }, 2023-08-01T19:55:09.231 INFO:teuthology.orchestra.run.smithi101.stdout: { 2023-08-01T19:55:09.231 INFO:teuthology.orchestra.run.smithi101.stdout: "event": "reached_pg", 2023-08-01T19:55:09.231 INFO:teuthology.orchestra.run.smithi101.stdout: "time": "2023-08-01T19:55:05.564883+0000", 2023-08-01T19:55:09.231 INFO:teuthology.orchestra.run.smithi101.stdout: "duration": 3.7481999999999998e-05 2023-08-01T19:55:09.231 INFO:teuthology.orchestra.run.smithi101.stdout: }, 2023-08-01T19:55:09.232 INFO:teuthology.orchestra.run.smithi101.stdout: { 2023-08-01T19:55:09.232 INFO:teuthology.orchestra.run.smithi101.stdout: "event": "started", 2023-08-01T19:55:09.232 INFO:teuthology.orchestra.run.smithi101.stdout: "time": "2023-08-01T19:55:05.564968+0000", 2023-08-01T19:55:09.232 INFO:teuthology.orchestra.run.smithi101.stdout: "duration": 8.5494999999999994e-05 2023-08-01T19:55:09.232 INFO:teuthology.orchestra.run.smithi101.stdout: }, 2023-08-01T19:55:09.232 INFO:teuthology.orchestra.run.smithi101.stdout: { 2023-08-01T19:55:09.232 INFO:teuthology.orchestra.run.smithi101.stdout: "event": "waiting for subops from 0", 2023-08-01T19:55:09.232 INFO:teuthology.orchestra.run.smithi101.stdout: "time": "2023-08-01T19:55:05.565062+0000", 2023-08-01T19:55:09.233 INFO:teuthology.orchestra.run.smithi101.stdout: "duration": 9.3478000000000002e-05 2023-08-01T19:55:09.233 INFO:teuthology.orchestra.run.smithi101.stdout: }, 2023-08-01T19:55:09.238 INFO:teuthology.orchestra.run.smithi101.stdout: { 2023-08-01T19:55:09.238 INFO:teuthology.orchestra.run.smithi101.stdout: "event": "op_commit", 2023-08-01T19:55:09.238 INFO:teuthology.orchestra.run.smithi101.stdout: "time": "2023-08-01T19:55:05.572061+0000", 2023-08-01T19:55:09.239 INFO:teuthology.orchestra.run.smithi101.stdout: "duration": 0.0069998250000000003 2023-08-01T19:55:09.239 INFO:teuthology.orchestra.run.smithi101.stdout: }, 2023-08-01T19:55:09.239 INFO:teuthology.orchestra.run.smithi101.stdout: { 2023-08-01T19:55:09.239 INFO:teuthology.orchestra.run.smithi101.stdout: "event": "sub_op_commit_rec", 2023-08-01T19:55:09.239 INFO:teuthology.orchestra.run.smithi101.stdout: "time": "2023-08-01T19:55:05.629362+0000", 2023-08-01T19:55:09.239 INFO:teuthology.orchestra.run.smithi101.stdout: "duration": 0.057300691000000001 2023-08-01T19:55:09.239 INFO:teuthology.orchestra.run.smithi101.stdout: }, 2023-08-01T19:55:09.240 INFO:teuthology.orchestra.run.smithi101.stdout: { 2023-08-01T19:55:09.240 INFO:teuthology.orchestra.run.smithi101.stdout: "event": "commit_sent", 2023-08-01T19:55:09.240 INFO:teuthology.orchestra.run.smithi101.stdout: "time": "2023-08-01T19:55:05.629395+0000", 2023-08-01T19:55:09.240 INFO:teuthology.orchestra.run.smithi101.stdout: "duration": 3.3124000000000003e-05 2023-08-01T19:55:09.240 INFO:teuthology.orchestra.run.smithi101.stdout: }, 2023-08-01T19:55:09.240 INFO:teuthology.orchestra.run.smithi101.stdout: { 2023-08-01T19:55:09.240 INFO:teuthology.orchestra.run.smithi101.stdout: "event": "done", 2023-08-01T19:55:09.240 INFO:teuthology.orchestra.run.smithi101.stdout: "time": "2023-08-01T19:55:05.629418+0000", 2023-08-01T19:55:09.241 INFO:teuthology.orchestra.run.smithi101.stdout: "duration": 2.2697999999999999e-05 2023-08-01T19:55:09.241 INFO:teuthology.orchestra.run.smithi101.stdout: } 2023-08-01T19:55:09.241 INFO:teuthology.orchestra.run.smithi101.stdout: ] 2023-08-01T19:55:09.241 INFO:teuthology.orchestra.run.smithi101.stdout: } 2023-08-01T19:55:09.241 INFO:teuthology.orchestra.run.smithi101.stdout: }, 2023-08-01T19:55:09.241 INFO:teuthology.orchestra.run.smithi101.stdout: { 2023-08-01T19:55:09.241 INFO:teuthology.orchestra.run.smithi101.stdout: "description": "osd_op(client.4668.0:100936 5.1 5:8f4e3576:::benchmark_data_smithi006_114134_object100935:head [set-alloc-hint object_size 65536 write_size 65536,write 0~65536] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e37)", 2023-08-01T19:55:09.241 INFO:teuthology.orchestra.run.smithi101.stdout: "initiated_at": "2023-08-01T19:55:05.567147+0000", 2023-08-01T19:55:09.242 INFO:teuthology.orchestra.run.smithi101.stdout: "age": 3.4734302499999998, 2023-08-01T19:55:09.242 INFO:teuthology.orchestra.run.smithi101.stdout: "duration": 0.063466380000000003, 2023-08-01T19:55:09.242 INFO:teuthology.orchestra.run.smithi101.stdout: "type_data": { 2023-08-01T19:55:09.242 INFO:teuthology.orchestra.run.smithi101.stdout: "flag_point": "commit sent; apply or cleanup", 2023-08-01T19:55:09.242 INFO:teuthology.orchestra.run.smithi101.stdout: "client_info": { 2023-08-01T19:55:09.242 INFO:teuthology.orchestra.run.smithi101.stdout: "client": "client.4668", 2023-08-01T19:55:09.242 INFO:teuthology.orchestra.run.smithi101.stdout: "client_addr": "172.21.15.6:0/1709472247", 2023-08-01T19:55:09.242 INFO:teuthology.orchestra.run.smithi101.stdout: "tid": 100936 2023-08-01T19:55:09.243 INFO:teuthology.orchestra.run.smithi101.stdout: }, 2023-08-01T19:55:09.243 INFO:teuthology.orchestra.run.smithi101.stdout: "events": [ 2023-08-01T19:55:09.243 INFO:teuthology.orchestra.run.smithi101.stdout: { 2023-08-01T19:55:09.243 INFO:teuthology.orchestra.run.smithi101.stdout: "event": "initiated", 2023-08-01T19:55:09.243 INFO:teuthology.orchestra.run.smithi101.stdout: "time": "2023-08-01T19:55:05.567147+0000", 2023-08-01T19:55:09.243 INFO:teuthology.orchestra.run.smithi101.stdout: "duration": 0 2023-08-01T19:55:09.243 INFO:teuthology.orchestra.run.smithi101.stdout: }, 2023-08-01T19:55:09.243 INFO:teuthology.orchestra.run.smithi101.stdout: { 2023-08-01T19:55:09.244 INFO:teuthology.orchestra.run.smithi101.stdout: "event": "throttled", 2023-08-01T19:55:09.244 INFO:teuthology.orchestra.run.smithi101.stdout: "time": "2023-08-01T19:55:05.567147+0000", 2023-08-01T19:55:09.244 INFO:teuthology.orchestra.run.smithi101.stdout: "duration": 0 2023-08-01T19:55:09.244 INFO:teuthology.orchestra.run.smithi101.stdout: }, 2023-08-01T19:55:09.244 INFO:teuthology.orchestra.run.smithi101.stdout: { 2023-08-01T19:55:09.244 INFO:teuthology.orchestra.run.smithi101.stdout: "event": "header_read", 2023-08-01T19:55:09.244 INFO:teuthology.orchestra.run.smithi101.stdout: "time": "2023-08-01T19:55:05.567146+0000", 2023-08-01T19:55:09.245 INFO:teuthology.orchestra.run.smithi101.stdout: "duration": 4294967295.999999 2023-08-01T19:55:09.245 INFO:teuthology.orchestra.run.smithi101.stdout: }, 2023-08-01T19:55:09.245 INFO:teuthology.orchestra.run.smithi101.stdout: { 2023-08-01T19:55:09.245 INFO:teuthology.orchestra.run.smithi101.stdout: "event": "all_read", 2023-08-01T19:55:09.245 INFO:teuthology.orchestra.run.smithi101.stdout: "time": "2023-08-01T19:55:05.567224+0000", 2023-08-01T19:55:09.245 INFO:teuthology.orchestra.run.smithi101.stdout: "duration": 7.8460000000000004e-05 2023-08-01T19:55:09.245 INFO:teuthology.orchestra.run.smithi101.stdout: }, 2023-08-01T19:55:09.245 INFO:teuthology.orchestra.run.smithi101.stdout: { 2023-08-01T19:55:09.246 INFO:teuthology.orchestra.run.smithi101.stdout: "event": "dispatched", 2023-08-01T19:55:09.246 INFO:teuthology.orchestra.run.smithi101.stdout: "time": "2023-08-01T19:55:05.567234+0000", 2023-08-01T19:55:09.246 INFO:teuthology.orchestra.run.smithi101.stdout: "duration": 9.7110000000000007e-06 2023-08-01T19:55:09.246 INFO:teuthology.orchestra.run.smithi101.stdout: }, 2023-08-01T19:55:09.246 INFO:teuthology.orchestra.run.smithi101.stdout: { 2023-08-01T19:55:09.246 INFO:teuthology.orchestra.run.smithi101.stdout: "event": "queued_for_pg", 2023-08-01T19:55:09.246 INFO:teuthology.orchestra.run.smithi101.stdout: "time": "2023-08-01T19:55:05.567239+0000", 2023-08-01T19:55:09.246 INFO:teuthology.orchestra.run.smithi101.stdout: "duration": 5.237e-06 2023-08-01T19:55:09.247 INFO:teuthology.orchestra.run.smithi101.stdout: }, 2023-08-01T19:55:09.247 INFO:teuthology.orchestra.run.smithi101.stdout: { 2023-08-01T19:55:09.247 INFO:teuthology.orchestra.run.smithi101.stdout: "event": "reached_pg", 2023-08-01T19:55:09.247 INFO:teuthology.orchestra.run.smithi101.stdout: "time": "2023-08-01T19:55:05.567278+0000", 2023-08-01T19:55:09.247 INFO:teuthology.orchestra.run.smithi101.stdout: "duration": 3.9069999999999997e-05 2023-08-01T19:55:09.247 INFO:teuthology.orchestra.run.smithi101.stdout: }, 2023-08-01T19:55:09.247 INFO:teuthology.orchestra.run.smithi101.stdout: { 2023-08-01T19:55:09.247 INFO:teuthology.orchestra.run.smithi101.stdout: "event": "started", 2023-08-01T19:55:09.248 INFO:teuthology.orchestra.run.smithi101.stdout: "time": "2023-08-01T19:55:05.567402+0000", 2023-08-01T19:55:09.248 INFO:teuthology.orchestra.run.smithi101.stdout: "duration": 0.00012348700000000001 2023-08-01T19:55:09.248 INFO:teuthology.orchestra.run.smithi101.stdout: }, 2023-08-01T19:55:09.248 INFO:teuthology.orchestra.run.smithi101.stdout: { 2023-08-01T19:55:09.248 INFO:teuthology.orchestra.run.smithi101.stdout: "event": "waiting for subops from 0", 2023-08-01T19:55:09.248 INFO:teuthology.orchestra.run.smithi101.stdout: "time": "2023-08-01T19:55:05.567558+0000", 2023-08-01T19:55:09.248 INFO:teuthology.orchestra.run.smithi101.stdout: "duration": 0.000156179 2023-08-01T19:55:09.248 INFO:teuthology.orchestra.run.smithi101.stdout: }, 2023-08-01T19:55:09.249 INFO:teuthology.orchestra.run.smithi101.stdout: { 2023-08-01T19:55:09.249 INFO:teuthology.orchestra.run.smithi101.stdout: "event": "op_commit", 2023-08-01T19:55:09.249 INFO:teuthology.orchestra.run.smithi101.stdout: "time": "2023-08-01T19:55:05.573767+0000", 2023-08-01T19:55:09.249 INFO:teuthology.orchestra.run.smithi101.stdout: "duration": 0.0062092409999999999 2023-08-01T19:55:09.249 INFO:teuthology.orchestra.run.smithi101.stdout: }, 2023-08-01T19:55:09.249 INFO:teuthology.orchestra.run.smithi101.stdout: { 2023-08-01T19:55:09.249 INFO:teuthology.orchestra.run.smithi101.stdout: "event": "sub_op_commit_rec", 2023-08-01T19:55:09.249 INFO:teuthology.orchestra.run.smithi101.stdout: "time": "2023-08-01T19:55:05.630531+0000", 2023-08-01T19:55:09.250 INFO:teuthology.orchestra.run.smithi101.stdout: "duration": 0.056763409000000001 2023-08-01T19:55:09.250 INFO:teuthology.orchestra.run.smithi101.stdout: }, 2023-08-01T19:55:09.250 INFO:teuthology.orchestra.run.smithi101.stdout: { 2023-08-01T19:55:09.250 INFO:teuthology.orchestra.run.smithi101.stdout: "event": "commit_sent", 2023-08-01T19:55:09.250 INFO:teuthology.orchestra.run.smithi101.stdout: "time": "2023-08-01T19:55:05.630577+0000", 2023-08-01T19:55:09.250 INFO:teuthology.orchestra.run.smithi101.stdout: "duration": 4.6588000000000002e-05 2023-08-01T19:55:09.250 INFO:teuthology.orchestra.run.smithi101.stdout: }, 2023-08-01T19:55:09.250 INFO:teuthology.orchestra.run.smithi101.stdout: { 2023-08-01T19:55:09.251 INFO:teuthology.orchestra.run.smithi101.stdout: "event": "done", 2023-08-01T19:55:09.251 INFO:teuthology.orchestra.run.smithi101.stdout: "time": "2023-08-01T19:55:05.630613+0000", 2023-08-01T19:55:09.251 INFO:teuthology.orchestra.run.smithi101.stdout: "duration": 3.5802e-05 2023-08-01T19:55:09.251 INFO:teuthology.orchestra.run.smithi101.stdout: } 2023-08-01T19:55:09.251 INFO:teuthology.orchestra.run.smithi101.stdout: ] 2023-08-01T19:55:09.251 INFO:teuthology.orchestra.run.smithi101.stdout: } 2023-08-01T19:55:09.251 INFO:teuthology.orchestra.run.smithi101.stdout: }, 2023-08-01T19:55:09.251 INFO:teuthology.orchestra.run.smithi101.stdout: { 2023-08-01T19:55:09.252 INFO:teuthology.orchestra.run.smithi101.stdout: "description": "osd_op(client.4668.0:100943 5.7 5:e01743fe:::benchmark_data_smithi006_114134_object100942:head [set-alloc-hint object_size 65536 write_size 65536,write 0~65536] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e37)", 2023-08-01T19:55:09.252 INFO:teuthology.orchestra.run.smithi101.stdout: "initiated_at": "2023-08-01T19:55:05.574724+0000", 2023-08-01T19:55:09.252 INFO:teuthology.orchestra.run.smithi101.stdout: "age": 3.4658531570000002, 2023-08-01T19:55:09.252 INFO:teuthology.orchestra.run.smithi101.stdout: "duration": 0.058761188999999998, 2023-08-01T19:55:09.252 INFO:teuthology.orchestra.run.smithi101.stdout: "type_data": { 2023-08-01T19:55:09.252 INFO:teuthology.orchestra.run.smithi101.stdout: "flag_point": "commit sent; apply or cleanup", 2023-08-01T19:55:09.252 INFO:teuthology.orchestra.run.smithi101.stdout: "client_info": { 2023-08-01T19:55:09.253 INFO:teuthology.orchestra.run.smithi101.stdout: "client": "client.4668", 2023-08-01T19:55:09.253 INFO:teuthology.orchestra.run.smithi101.stdout: "client_addr": "172.21.15.6:0/1709472247", 2023-08-01T19:55:09.253 INFO:teuthology.orchestra.run.smithi101.stdout: "tid": 100943 2023-08-01T19:55:09.253 INFO:teuthology.orchestra.run.smithi101.stdout: }, 2023-08-01T19:55:09.253 INFO:teuthology.orchestra.run.smithi101.stdout: "events": [ 2023-08-01T19:55:09.253 INFO:teuthology.orchestra.run.smithi101.stdout: { 2023-08-01T19:55:09.253 INFO:teuthology.orchestra.run.smithi101.stdout: "event": "initiated", 2023-08-01T19:55:09.253 INFO:teuthology.orchestra.run.smithi101.stdout: "time": "2023-08-01T19:55:05.574724+0000", 2023-08-01T19:55:09.254 INFO:teuthology.orchestra.run.smithi101.stdout: "duration": 0 2023-08-01T19:55:09.254 INFO:teuthology.orchestra.run.smithi101.stdout: }, 2023-08-01T19:55:09.254 INFO:teuthology.orchestra.run.smithi101.stdout: { 2023-08-01T19:55:09.254 INFO:teuthology.orchestra.run.smithi101.stdout: "event": "throttled", 2023-08-01T19:55:09.254 INFO:teuthology.orchestra.run.smithi101.stdout: "time": "2023-08-01T19:55:05.574724+0000", 2023-08-01T19:55:09.254 INFO:teuthology.orchestra.run.smithi101.stdout: "duration": 0 2023-08-01T19:55:09.254 INFO:teuthology.orchestra.run.smithi101.stdout: }, 2023-08-01T19:55:09.254 INFO:teuthology.orchestra.run.smithi101.stdout: { 2023-08-01T19:55:09.255 INFO:teuthology.orchestra.run.smithi101.stdout: "event": "header_read", 2023-08-01T19:55:09.255 INFO:teuthology.orchestra.run.smithi101.stdout: "time": "2023-08-01T19:55:05.574723+0000", 2023-08-01T19:55:09.255 INFO:teuthology.orchestra.run.smithi101.stdout: "duration": 4294967295.999999 2023-08-01T19:55:09.255 INFO:teuthology.orchestra.run.smithi101.stdout: }, 2023-08-01T19:55:09.255 INFO:teuthology.orchestra.run.smithi101.stdout: { 2023-08-01T19:55:09.255 INFO:teuthology.orchestra.run.smithi101.stdout: "event": "all_read", 2023-08-01T19:55:09.255 INFO:teuthology.orchestra.run.smithi101.stdout: "time": "2023-08-01T19:55:05.574773+0000", 2023-08-01T19:55:09.255 INFO:teuthology.orchestra.run.smithi101.stdout: "duration": 4.9469999999999999e-05 2023-08-01T19:55:09.256 INFO:teuthology.orchestra.run.smithi101.stdout: }, 2023-08-01T19:55:09.256 INFO:teuthology.orchestra.run.smithi101.stdout: { 2023-08-01T19:55:09.256 INFO:teuthology.orchestra.run.smithi101.stdout: "event": "dispatched", 2023-08-01T19:55:09.256 INFO:teuthology.orchestra.run.smithi101.stdout: "time": "2023-08-01T19:55:05.574780+0000", 2023-08-01T19:55:09.256 INFO:teuthology.orchestra.run.smithi101.stdout: "duration": 7.5059999999999998e-06 2023-08-01T19:55:09.256 INFO:teuthology.orchestra.run.smithi101.stdout: }, 2023-08-01T19:55:09.256 INFO:teuthology.orchestra.run.smithi101.stdout: { 2023-08-01T19:55:09.256 INFO:teuthology.orchestra.run.smithi101.stdout: "event": "queued_for_pg", 2023-08-01T19:55:09.257 INFO:teuthology.orchestra.run.smithi101.stdout: "time": "2023-08-01T19:55:05.574784+0000", 2023-08-01T19:55:09.257 INFO:teuthology.orchestra.run.smithi101.stdout: "duration": 3.5540000000000002e-06 2023-08-01T19:55:09.257 INFO:teuthology.orchestra.run.smithi101.stdout: }, 2023-08-01T19:55:09.257 INFO:teuthology.orchestra.run.smithi101.stdout: { 2023-08-01T19:55:09.257 INFO:teuthology.orchestra.run.smithi101.stdout: "event": "reached_pg", 2023-08-01T19:55:09.257 INFO:teuthology.orchestra.run.smithi101.stdout: "time": "2023-08-01T19:55:05.574805+0000", 2023-08-01T19:55:09.257 INFO:teuthology.orchestra.run.smithi101.stdout: "duration": 2.1257999999999999e-05 2023-08-01T19:55:09.257 INFO:teuthology.orchestra.run.smithi101.stdout: }, 2023-08-01T19:55:09.258 INFO:teuthology.orchestra.run.smithi101.stdout: { 2023-08-01T19:55:09.258 INFO:teuthology.orchestra.run.smithi101.stdout: "event": "started", 2023-08-01T19:55:09.258 INFO:teuthology.orchestra.run.smithi101.stdout: "time": "2023-08-01T19:55:05.574886+0000", 2023-08-01T19:55:09.258 INFO:teuthology.orchestra.run.smithi101.stdout: "duration": 8.1545999999999995e-05 2023-08-01T19:55:09.258 INFO:teuthology.orchestra.run.smithi101.stdout: }, 2023-08-01T19:55:09.258 INFO:teuthology.orchestra.run.smithi101.stdout: { 2023-08-01T19:55:09.258 INFO:teuthology.orchestra.run.smithi101.stdout: "event": "waiting for subops from 0", 2023-08-01T19:55:09.258 INFO:teuthology.orchestra.run.smithi101.stdout: "time": "2023-08-01T19:55:05.574973+0000", 2023-08-01T19:55:09.259 INFO:teuthology.orchestra.run.smithi101.stdout: "duration": 8.6998999999999998e-05 2023-08-01T19:55:09.259 INFO:teuthology.orchestra.run.smithi101.stdout: }, 2023-08-01T19:55:09.259 INFO:teuthology.orchestra.run.smithi101.stdout: { 2023-08-01T19:55:09.259 INFO:teuthology.orchestra.run.smithi101.stdout: "event": "op_commit", 2023-08-01T19:55:09.259 INFO:teuthology.orchestra.run.smithi101.stdout: "time": "2023-08-01T19:55:05.581580+0000", 2023-08-01T19:55:09.259 INFO:teuthology.orchestra.run.smithi101.stdout: "duration": 0.0066068790000000004 2023-08-01T19:55:09.259 INFO:teuthology.orchestra.run.smithi101.stdout: }, 2023-08-01T19:55:09.259 INFO:teuthology.orchestra.run.smithi101.stdout: { 2023-08-01T19:55:09.260 INFO:teuthology.orchestra.run.smithi101.stdout: "event": "sub_op_commit_rec", 2023-08-01T19:55:09.260 INFO:teuthology.orchestra.run.smithi101.stdout: "time": "2023-08-01T19:55:05.633422+0000", 2023-08-01T19:55:09.260 INFO:teuthology.orchestra.run.smithi101.stdout: "duration": 0.051841992000000003 2023-08-01T19:55:09.260 INFO:teuthology.orchestra.run.smithi101.stdout: }, 2023-08-01T19:55:09.260 INFO:teuthology.orchestra.run.smithi101.stdout: { 2023-08-01T19:55:09.260 INFO:teuthology.orchestra.run.smithi101.stdout: "event": "commit_sent", 2023-08-01T19:55:09.260 INFO:teuthology.orchestra.run.smithi101.stdout: "time": "2023-08-01T19:55:05.633461+0000", 2023-08-01T19:55:09.260 INFO:teuthology.orchestra.run.smithi101.stdout: "duration": 3.8330000000000001e-05 2023-08-01T19:55:09.261 INFO:teuthology.orchestra.run.smithi101.stdout: }, 2023-08-01T19:55:09.261 INFO:teuthology.orchestra.run.smithi101.stdout: { 2023-08-01T19:55:09.261 INFO:teuthology.orchestra.run.smithi101.stdout: "event": "done", 2023-08-01T19:55:09.261 INFO:teuthology.orchestra.run.smithi101.stdout: "time": "2023-08-01T19:55:05.633485+0000", 2023-08-01T19:55:09.261 INFO:teuthology.orchestra.run.smithi101.stdout: "duration": 2.4451e-05 2023-08-01T19:55:09.261 INFO:teuthology.orchestra.run.smithi101.stdout: } 2023-08-01T19:55:09.261 INFO:teuthology.orchestra.run.smithi101.stdout: ] 2023-08-01T19:55:09.261 INFO:teuthology.orchestra.run.smithi101.stdout: } 2023-08-01T19:55:09.262 INFO:teuthology.orchestra.run.smithi101.stdout: } 2023-08-01T19:55:09.262 INFO:teuthology.orchestra.run.smithi101.stdout: ] 2023-08-01T19:55:09.262 INFO:teuthology.orchestra.run.smithi101.stdout:} 2023-08-01T19:55:09.263 DEBUG:teuthology.orchestra.run.smithi155:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 30 ceph --cluster ceph --admin-daemon /var/run/ceph/ceph-osd.2.asok dump_ops_in_flight 2023-08-01T19:55:09.264 INFO:tasks.ceph.osd.2.smithi155.stderr:2023-08-01T19:55:09.261+0000 7faa5c6ac700 -1 received signal: Hangup from /usr/bin/python3 /bin/daemon-helper kill ceph-osd -f --cluster ceph -i 2 (PID: 111337) UID: 0 2023-08-01T19:55:09.316 INFO:tasks.radosbench.radosbench.0.smithi006.stdout: 45 16 107893 107877 149.817 119 0.00674543 0.00666898 2023-08-01T19:55:09.364 INFO:tasks.ceph.osd.0.smithi008.stderr:2023-08-01T19:55:09.363+0000 7f16a58f4700 -1 received signal: Hangup from /usr/bin/python3 /bin/daemon-helper kill ceph-osd -f --cluster ceph -i 0 (PID: 111179) UID: 0 2023-08-01T19:55:09.425 INFO:teuthology.orchestra.run.smithi155.stdout:{ 2023-08-01T19:55:09.425 INFO:teuthology.orchestra.run.smithi155.stdout: "ops": [ 2023-08-01T19:55:09.426 INFO:teuthology.orchestra.run.smithi155.stdout: { 2023-08-01T19:55:09.426 INFO:teuthology.orchestra.run.smithi155.stdout: "description": "osd_op(client.4668.0:108021 5.b 5:d53c9c12:::benchmark_data_smithi006_114134_object108020:head [set-alloc-hint object_size 65536 write_size 65536,write 0~65536 in=65536b] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e38)", 2023-08-01T19:55:09.426 INFO:teuthology.orchestra.run.smithi155.stdout: "initiated_at": "2023-08-01T19:55:09.416280+0000", 2023-08-01T19:55:09.426 INFO:teuthology.orchestra.run.smithi155.stdout: "age": 0.0071260589999999997, 2023-08-01T19:55:09.426 INFO:teuthology.orchestra.run.smithi155.stdout: "duration": 0.0071474080000000001, 2023-08-01T19:55:09.426 INFO:teuthology.orchestra.run.smithi155.stdout: "type_data": { 2023-08-01T19:55:09.426 INFO:teuthology.orchestra.run.smithi155.stdout: "flag_point": "waiting for sub ops", 2023-08-01T19:55:09.427 INFO:teuthology.orchestra.run.smithi155.stdout: "client_info": { 2023-08-01T19:55:09.427 INFO:teuthology.orchestra.run.smithi155.stdout: "client": "client.4668", 2023-08-01T19:55:09.427 INFO:teuthology.orchestra.run.smithi155.stdout: "client_addr": "172.21.15.6:0/1709472247", 2023-08-01T19:55:09.427 INFO:teuthology.orchestra.run.smithi155.stdout: "tid": 108021 2023-08-01T19:55:09.427 INFO:teuthology.orchestra.run.smithi155.stdout: }, 2023-08-01T19:55:09.427 INFO:teuthology.orchestra.run.smithi155.stdout: "events": [ 2023-08-01T19:55:09.427 INFO:teuthology.orchestra.run.smithi155.stdout: { 2023-08-01T19:55:09.427 INFO:teuthology.orchestra.run.smithi155.stdout: "event": "initiated", 2023-08-01T19:55:09.428 INFO:teuthology.orchestra.run.smithi155.stdout: "time": "2023-08-01T19:55:09.416280+0000", 2023-08-01T19:55:09.428 INFO:teuthology.orchestra.run.smithi155.stdout: "duration": 0 2023-08-01T19:55:09.428 INFO:teuthology.orchestra.run.smithi155.stdout: }, 2023-08-01T19:55:09.428 INFO:teuthology.orchestra.run.smithi155.stdout: { 2023-08-01T19:55:09.428 INFO:teuthology.orchestra.run.smithi155.stdout: "event": "throttled", 2023-08-01T19:55:09.428 INFO:teuthology.orchestra.run.smithi155.stdout: "time": "2023-08-01T19:55:09.416280+0000", 2023-08-01T19:55:09.428 INFO:teuthology.orchestra.run.smithi155.stdout: "duration": 0 2023-08-01T19:55:09.429 INFO:teuthology.orchestra.run.smithi155.stdout: }, 2023-08-01T19:55:09.429 INFO:teuthology.orchestra.run.smithi155.stdout: { 2023-08-01T19:55:09.429 INFO:teuthology.orchestra.run.smithi155.stdout: "event": "header_read", 2023-08-01T19:55:09.429 INFO:teuthology.orchestra.run.smithi155.stdout: "time": "2023-08-01T19:55:09.416279+0000", 2023-08-01T19:55:09.429 INFO:teuthology.orchestra.run.smithi155.stdout: "duration": 4294967295.999999 2023-08-01T19:55:09.429 INFO:teuthology.orchestra.run.smithi155.stdout: }, 2023-08-01T19:55:09.429 INFO:teuthology.orchestra.run.smithi155.stdout: { 2023-08-01T19:55:09.429 INFO:teuthology.orchestra.run.smithi155.stdout: "event": "all_read", 2023-08-01T19:55:09.430 INFO:teuthology.orchestra.run.smithi155.stdout: "time": "2023-08-01T19:55:09.416346+0000", 2023-08-01T19:55:09.430 INFO:teuthology.orchestra.run.smithi155.stdout: "duration": 6.6575000000000005e-05 2023-08-01T19:55:09.430 INFO:teuthology.orchestra.run.smithi155.stdout: }, 2023-08-01T19:55:09.430 INFO:teuthology.orchestra.run.smithi155.stdout: { 2023-08-01T19:55:09.430 INFO:teuthology.orchestra.run.smithi155.stdout: "event": "dispatched", 2023-08-01T19:55:09.430 INFO:teuthology.orchestra.run.smithi155.stdout: "time": "2023-08-01T19:55:09.416357+0000", 2023-08-01T19:55:09.430 INFO:teuthology.orchestra.run.smithi155.stdout: "duration": 1.0852999999999999e-05 2023-08-01T19:55:09.430 INFO:teuthology.orchestra.run.smithi155.stdout: }, 2023-08-01T19:55:09.431 INFO:teuthology.orchestra.run.smithi155.stdout: { 2023-08-01T19:55:09.431 INFO:teuthology.orchestra.run.smithi155.stdout: "event": "queued_for_pg", 2023-08-01T19:55:09.431 INFO:teuthology.orchestra.run.smithi155.stdout: "time": "2023-08-01T19:55:09.416362+0000", 2023-08-01T19:55:09.431 INFO:teuthology.orchestra.run.smithi155.stdout: "duration": 5.5060000000000003e-06 2023-08-01T19:55:09.431 INFO:teuthology.orchestra.run.smithi155.stdout: }, 2023-08-01T19:55:09.431 INFO:teuthology.orchestra.run.smithi155.stdout: { 2023-08-01T19:55:09.431 INFO:teuthology.orchestra.run.smithi155.stdout: "event": "reached_pg", 2023-08-01T19:55:09.431 INFO:teuthology.orchestra.run.smithi155.stdout: "time": "2023-08-01T19:55:09.416415+0000", 2023-08-01T19:55:09.432 INFO:teuthology.orchestra.run.smithi155.stdout: "duration": 5.3139000000000001e-05 2023-08-01T19:55:09.432 INFO:teuthology.orchestra.run.smithi155.stdout: }, 2023-08-01T19:55:09.432 INFO:teuthology.orchestra.run.smithi155.stdout: { 2023-08-01T19:55:09.432 INFO:teuthology.orchestra.run.smithi155.stdout: "event": "started", 2023-08-01T19:55:09.432 INFO:teuthology.orchestra.run.smithi155.stdout: "time": "2023-08-01T19:55:09.416550+0000", 2023-08-01T19:55:09.432 INFO:teuthology.orchestra.run.smithi155.stdout: "duration": 0.00013406799999999999 2023-08-01T19:55:09.432 INFO:teuthology.orchestra.run.smithi155.stdout: }, 2023-08-01T19:55:09.433 INFO:teuthology.orchestra.run.smithi155.stdout: { 2023-08-01T19:55:09.433 INFO:teuthology.orchestra.run.smithi155.stdout: "event": "waiting for subops from 0", 2023-08-01T19:55:09.433 INFO:teuthology.orchestra.run.smithi155.stdout: "time": "2023-08-01T19:55:09.416706+0000", 2023-08-01T19:55:09.433 INFO:teuthology.orchestra.run.smithi155.stdout: "duration": 0.00015602500000000001 2023-08-01T19:55:09.433 INFO:teuthology.orchestra.run.smithi155.stdout: }, 2023-08-01T19:55:09.433 INFO:teuthology.orchestra.run.smithi155.stdout: { 2023-08-01T19:55:09.433 INFO:teuthology.orchestra.run.smithi155.stdout: "event": "op_commit", 2023-08-01T19:55:09.433 INFO:teuthology.orchestra.run.smithi155.stdout: "time": "2023-08-01T19:55:09.422989+0000", 2023-08-01T19:55:09.434 INFO:teuthology.orchestra.run.smithi155.stdout: "duration": 0.0062836699999999999 2023-08-01T19:55:09.434 INFO:teuthology.orchestra.run.smithi155.stdout: } 2023-08-01T19:55:09.434 INFO:teuthology.orchestra.run.smithi155.stdout: ] 2023-08-01T19:55:09.434 INFO:teuthology.orchestra.run.smithi155.stdout: } 2023-08-01T19:55:09.434 INFO:teuthology.orchestra.run.smithi155.stdout: }, 2023-08-01T19:55:09.434 INFO:teuthology.orchestra.run.smithi155.stdout: { 2023-08-01T19:55:09.434 INFO:teuthology.orchestra.run.smithi155.stdout: "description": "osd_op(client.4668.0:108022 5.8 5:1764785e:::benchmark_data_smithi006_114134_object108021:head [set-alloc-hint object_size 65536 write_size 65536,write 0~65536 in=65536b] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e38)", 2023-08-01T19:55:09.435 INFO:teuthology.orchestra.run.smithi155.stdout: "initiated_at": "2023-08-01T19:55:09.417940+0000", 2023-08-01T19:55:09.435 INFO:teuthology.orchestra.run.smithi155.stdout: "age": 0.0054663969999999996, 2023-08-01T19:55:09.435 INFO:teuthology.orchestra.run.smithi155.stdout: "duration": 0.0055514680000000004, 2023-08-01T19:55:09.435 INFO:teuthology.orchestra.run.smithi155.stdout: "type_data": { 2023-08-01T19:55:09.435 INFO:teuthology.orchestra.run.smithi155.stdout: "flag_point": "waiting for sub ops", 2023-08-01T19:55:09.435 INFO:teuthology.orchestra.run.smithi155.stdout: "client_info": { 2023-08-01T19:55:09.435 INFO:teuthology.orchestra.run.smithi155.stdout: "client": "client.4668", 2023-08-01T19:55:09.435 INFO:teuthology.orchestra.run.smithi155.stdout: "client_addr": "172.21.15.6:0/1709472247", 2023-08-01T19:55:09.436 INFO:teuthology.orchestra.run.smithi155.stdout: "tid": 108022 2023-08-01T19:55:09.436 INFO:teuthology.orchestra.run.smithi155.stdout: }, 2023-08-01T19:55:09.436 INFO:teuthology.orchestra.run.smithi155.stdout: "events": [ 2023-08-01T19:55:09.436 INFO:teuthology.orchestra.run.smithi155.stdout: { 2023-08-01T19:55:09.436 INFO:teuthology.orchestra.run.smithi155.stdout: "event": "initiated", 2023-08-01T19:55:09.436 INFO:teuthology.orchestra.run.smithi155.stdout: "time": "2023-08-01T19:55:09.417940+0000", 2023-08-01T19:55:09.436 INFO:teuthology.orchestra.run.smithi155.stdout: "duration": 0 2023-08-01T19:55:09.436 INFO:teuthology.orchestra.run.smithi155.stdout: }, 2023-08-01T19:55:09.437 INFO:teuthology.orchestra.run.smithi155.stdout: { 2023-08-01T19:55:09.437 INFO:teuthology.orchestra.run.smithi155.stdout: "event": "throttled", 2023-08-01T19:55:09.437 INFO:teuthology.orchestra.run.smithi155.stdout: "time": "2023-08-01T19:55:09.417940+0000", 2023-08-01T19:55:09.437 INFO:teuthology.orchestra.run.smithi155.stdout: "duration": 0 2023-08-01T19:55:09.437 INFO:teuthology.orchestra.run.smithi155.stdout: }, 2023-08-01T19:55:09.437 INFO:teuthology.orchestra.run.smithi155.stdout: { 2023-08-01T19:55:09.437 INFO:teuthology.orchestra.run.smithi155.stdout: "event": "header_read", 2023-08-01T19:55:09.438 INFO:teuthology.orchestra.run.smithi155.stdout: "time": "2023-08-01T19:55:09.417939+0000", 2023-08-01T19:55:09.438 INFO:teuthology.orchestra.run.smithi155.stdout: "duration": 4294967295.999999 2023-08-01T19:55:09.438 INFO:teuthology.orchestra.run.smithi155.stdout: }, 2023-08-01T19:55:09.438 INFO:teuthology.orchestra.run.smithi155.stdout: { 2023-08-01T19:55:09.438 INFO:teuthology.orchestra.run.smithi155.stdout: "event": "all_read", 2023-08-01T19:55:09.438 INFO:teuthology.orchestra.run.smithi155.stdout: "time": "2023-08-01T19:55:09.417994+0000", 2023-08-01T19:55:09.438 INFO:teuthology.orchestra.run.smithi155.stdout: "duration": 5.5337999999999998e-05 2023-08-01T19:55:09.438 INFO:teuthology.orchestra.run.smithi155.stdout: }, 2023-08-01T19:55:09.439 INFO:teuthology.orchestra.run.smithi155.stdout: { 2023-08-01T19:55:09.439 INFO:teuthology.orchestra.run.smithi155.stdout: "event": "dispatched", 2023-08-01T19:55:09.439 INFO:teuthology.orchestra.run.smithi155.stdout: "time": "2023-08-01T19:55:09.418005+0000", 2023-08-01T19:55:09.439 INFO:teuthology.orchestra.run.smithi155.stdout: "duration": 1.0599e-05 2023-08-01T19:55:09.439 INFO:teuthology.orchestra.run.smithi155.stdout: }, 2023-08-01T19:55:09.439 INFO:teuthology.orchestra.run.smithi155.stdout: { 2023-08-01T19:55:09.439 INFO:teuthology.orchestra.run.smithi155.stdout: "event": "queued_for_pg", 2023-08-01T19:55:09.439 INFO:teuthology.orchestra.run.smithi155.stdout: "time": "2023-08-01T19:55:09.418012+0000", 2023-08-01T19:55:09.440 INFO:teuthology.orchestra.run.smithi155.stdout: "duration": 7.7519999999999996e-06 2023-08-01T19:55:09.440 INFO:teuthology.orchestra.run.smithi155.stdout: }, 2023-08-01T19:55:09.440 INFO:teuthology.orchestra.run.smithi155.stdout: { 2023-08-01T19:55:09.440 INFO:teuthology.orchestra.run.smithi155.stdout: "event": "reached_pg", 2023-08-01T19:55:09.440 INFO:teuthology.orchestra.run.smithi155.stdout: "time": "2023-08-01T19:55:09.418103+0000", 2023-08-01T19:55:09.440 INFO:teuthology.orchestra.run.smithi155.stdout: "duration": 9.0475000000000004e-05 2023-08-01T19:55:09.441 INFO:teuthology.orchestra.run.smithi155.stdout: }, 2023-08-01T19:55:09.441 INFO:teuthology.orchestra.run.smithi155.stdout: { 2023-08-01T19:55:09.441 INFO:teuthology.orchestra.run.smithi155.stdout: "event": "started", 2023-08-01T19:55:09.441 INFO:teuthology.orchestra.run.smithi155.stdout: "time": "2023-08-01T19:55:09.418243+0000", 2023-08-01T19:55:09.441 INFO:teuthology.orchestra.run.smithi155.stdout: "duration": 0.000139553 2023-08-01T19:55:09.441 INFO:teuthology.orchestra.run.smithi155.stdout: }, 2023-08-01T19:55:09.441 INFO:teuthology.orchestra.run.smithi155.stdout: { 2023-08-01T19:55:09.441 INFO:teuthology.orchestra.run.smithi155.stdout: "event": "waiting for subops from 0", 2023-08-01T19:55:09.442 INFO:teuthology.orchestra.run.smithi155.stdout: "time": "2023-08-01T19:55:09.418375+0000", 2023-08-01T19:55:09.442 INFO:teuthology.orchestra.run.smithi155.stdout: "duration": 0.000132426 2023-08-01T19:55:09.442 INFO:teuthology.orchestra.run.smithi155.stdout: } 2023-08-01T19:55:09.442 INFO:teuthology.orchestra.run.smithi155.stdout: ] 2023-08-01T19:55:09.442 INFO:teuthology.orchestra.run.smithi155.stdout: } 2023-08-01T19:55:09.442 INFO:teuthology.orchestra.run.smithi155.stdout: }, 2023-08-01T19:55:09.442 INFO:teuthology.orchestra.run.smithi155.stdout: { 2023-08-01T19:55:09.442 INFO:teuthology.orchestra.run.smithi155.stdout: "description": "osd_op(client.4668.0:108023 5.e 5:70276b83:::benchmark_data_smithi006_114134_object108022:head [set-alloc-hint object_size 65536 write_size 65536,write 0~65536 in=65536b] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e38)", 2023-08-01T19:55:09.443 INFO:teuthology.orchestra.run.smithi155.stdout: "initiated_at": "2023-08-01T19:55:09.418244+0000", 2023-08-01T19:55:09.443 INFO:teuthology.orchestra.run.smithi155.stdout: "age": 0.0051618239999999998, 2023-08-01T19:55:09.443 INFO:teuthology.orchestra.run.smithi155.stdout: "duration": 0.0053223519999999998, 2023-08-01T19:55:09.443 INFO:teuthology.orchestra.run.smithi155.stdout: "type_data": { 2023-08-01T19:55:09.443 INFO:teuthology.orchestra.run.smithi155.stdout: "flag_point": "waiting for sub ops", 2023-08-01T19:55:09.443 INFO:teuthology.orchestra.run.smithi155.stdout: "client_info": { 2023-08-01T19:55:09.443 INFO:teuthology.orchestra.run.smithi155.stdout: "client": "client.4668", 2023-08-01T19:55:09.443 INFO:teuthology.orchestra.run.smithi155.stdout: "client_addr": "172.21.15.6:0/1709472247", 2023-08-01T19:55:09.444 INFO:teuthology.orchestra.run.smithi155.stdout: "tid": 108023 2023-08-01T19:55:09.444 INFO:teuthology.orchestra.run.smithi155.stdout: }, 2023-08-01T19:55:09.444 INFO:teuthology.orchestra.run.smithi155.stdout: "events": [ 2023-08-01T19:55:09.444 INFO:teuthology.orchestra.run.smithi155.stdout: { 2023-08-01T19:55:09.444 INFO:teuthology.orchestra.run.smithi155.stdout: "event": "initiated", 2023-08-01T19:55:09.444 INFO:teuthology.orchestra.run.smithi155.stdout: "time": "2023-08-01T19:55:09.418244+0000", 2023-08-01T19:55:09.444 INFO:teuthology.orchestra.run.smithi155.stdout: "duration": 0 2023-08-01T19:55:09.445 INFO:teuthology.orchestra.run.smithi155.stdout: }, 2023-08-01T19:55:09.445 INFO:teuthology.orchestra.run.smithi155.stdout: { 2023-08-01T19:55:09.445 INFO:teuthology.orchestra.run.smithi155.stdout: "event": "throttled", 2023-08-01T19:55:09.445 INFO:teuthology.orchestra.run.smithi155.stdout: "time": "2023-08-01T19:55:09.418244+0000", 2023-08-01T19:55:09.445 INFO:teuthology.orchestra.run.smithi155.stdout: "duration": 0 2023-08-01T19:55:09.445 INFO:teuthology.orchestra.run.smithi155.stdout: }, 2023-08-01T19:55:09.445 INFO:teuthology.orchestra.run.smithi155.stdout: { 2023-08-01T19:55:09.445 INFO:teuthology.orchestra.run.smithi155.stdout: "event": "header_read", 2023-08-01T19:55:09.446 INFO:teuthology.orchestra.run.smithi155.stdout: "time": "2023-08-01T19:55:09.418244+0000", 2023-08-01T19:55:09.446 INFO:teuthology.orchestra.run.smithi155.stdout: "duration": 4294967295.999999 2023-08-01T19:55:09.446 INFO:teuthology.orchestra.run.smithi155.stdout: }, 2023-08-01T19:55:09.446 INFO:teuthology.orchestra.run.smithi155.stdout: { 2023-08-01T19:55:09.446 INFO:teuthology.orchestra.run.smithi155.stdout: "event": "all_read", 2023-08-01T19:55:09.446 INFO:teuthology.orchestra.run.smithi155.stdout: "time": "2023-08-01T19:55:09.418310+0000", 2023-08-01T19:55:09.446 INFO:teuthology.orchestra.run.smithi155.stdout: "duration": 6.6843999999999999e-05 2023-08-01T19:55:09.446 INFO:teuthology.orchestra.run.smithi155.stdout: }, 2023-08-01T19:55:09.447 INFO:teuthology.orchestra.run.smithi155.stdout: { 2023-08-01T19:55:09.447 INFO:teuthology.orchestra.run.smithi155.stdout: "event": "dispatched", 2023-08-01T19:55:09.447 INFO:teuthology.orchestra.run.smithi155.stdout: "time": "2023-08-01T19:55:09.418320+0000", 2023-08-01T19:55:09.447 INFO:teuthology.orchestra.run.smithi155.stdout: "duration": 9.5599999999999999e-06 2023-08-01T19:55:09.447 INFO:teuthology.orchestra.run.smithi155.stdout: }, 2023-08-01T19:55:09.447 INFO:teuthology.orchestra.run.smithi155.stdout: { 2023-08-01T19:55:09.447 INFO:teuthology.orchestra.run.smithi155.stdout: "event": "queued_for_pg", 2023-08-01T19:55:09.447 INFO:teuthology.orchestra.run.smithi155.stdout: "time": "2023-08-01T19:55:09.418326+0000", 2023-08-01T19:55:09.448 INFO:teuthology.orchestra.run.smithi155.stdout: "duration": 6.2779999999999999e-06 2023-08-01T19:55:09.448 INFO:teuthology.orchestra.run.smithi155.stdout: }, 2023-08-01T19:55:09.448 INFO:teuthology.orchestra.run.smithi155.stdout: { 2023-08-01T19:55:09.448 INFO:teuthology.orchestra.run.smithi155.stdout: "event": "reached_pg", 2023-08-01T19:55:09.448 INFO:teuthology.orchestra.run.smithi155.stdout: "time": "2023-08-01T19:55:09.418360+0000", 2023-08-01T19:55:09.448 INFO:teuthology.orchestra.run.smithi155.stdout: "duration": 3.3534000000000001e-05 2023-08-01T19:55:09.448 INFO:teuthology.orchestra.run.smithi155.stdout: }, 2023-08-01T19:55:09.449 INFO:teuthology.orchestra.run.smithi155.stdout: { 2023-08-01T19:55:09.449 INFO:teuthology.orchestra.run.smithi155.stdout: "event": "started", 2023-08-01T19:55:09.449 INFO:teuthology.orchestra.run.smithi155.stdout: "time": "2023-08-01T19:55:09.418507+0000", 2023-08-01T19:55:09.449 INFO:teuthology.orchestra.run.smithi155.stdout: "duration": 0.000147322 2023-08-01T19:55:09.449 INFO:teuthology.orchestra.run.smithi155.stdout: }, 2023-08-01T19:55:09.449 INFO:teuthology.orchestra.run.smithi155.stdout: { 2023-08-01T19:55:09.449 INFO:teuthology.orchestra.run.smithi155.stdout: "event": "waiting for subops from 0", 2023-08-01T19:55:09.449 INFO:teuthology.orchestra.run.smithi155.stdout: "time": "2023-08-01T19:55:09.418651+0000", 2023-08-01T19:55:09.450 INFO:teuthology.orchestra.run.smithi155.stdout: "duration": 0.00014351300000000001 2023-08-01T19:55:09.450 INFO:teuthology.orchestra.run.smithi155.stdout: }, 2023-08-01T19:55:09.450 INFO:teuthology.orchestra.run.smithi155.stdout: { 2023-08-01T19:55:09.450 INFO:teuthology.orchestra.run.smithi155.stdout: "event": "op_commit", 2023-08-01T19:55:09.450 INFO:teuthology.orchestra.run.smithi155.stdout: "time": "2023-08-01T19:55:09.422554+0000", 2023-08-01T19:55:09.450 INFO:teuthology.orchestra.run.smithi155.stdout: "duration": 0.0039035680000000001 2023-08-01T19:55:09.450 INFO:teuthology.orchestra.run.smithi155.stdout: } 2023-08-01T19:55:09.450 INFO:teuthology.orchestra.run.smithi155.stdout: ] 2023-08-01T19:55:09.451 INFO:teuthology.orchestra.run.smithi155.stdout: } 2023-08-01T19:55:09.451 INFO:teuthology.orchestra.run.smithi155.stdout: }, 2023-08-01T19:55:09.451 INFO:teuthology.orchestra.run.smithi155.stdout: { 2023-08-01T19:55:09.451 INFO:teuthology.orchestra.run.smithi155.stdout: "description": "osd_op(client.4668.0:108024 5.e 5:7dd5b5a0:::benchmark_data_smithi006_114134_object108023:head [set-alloc-hint object_size 65536 write_size 65536,write 0~65536 in=65536b] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e38)", 2023-08-01T19:55:09.451 INFO:teuthology.orchestra.run.smithi155.stdout: "initiated_at": "2023-08-01T19:55:09.418419+0000", 2023-08-01T19:55:09.451 INFO:teuthology.orchestra.run.smithi155.stdout: "age": 0.0049869190000000002, 2023-08-01T19:55:09.451 INFO:teuthology.orchestra.run.smithi155.stdout: "duration": 0.0052502169999999997, 2023-08-01T19:55:09.452 INFO:teuthology.orchestra.run.smithi155.stdout: "type_data": { 2023-08-01T19:55:09.452 INFO:teuthology.orchestra.run.smithi155.stdout: "flag_point": "waiting for sub ops", 2023-08-01T19:55:09.452 INFO:teuthology.orchestra.run.smithi155.stdout: "client_info": { 2023-08-01T19:55:09.452 INFO:teuthology.orchestra.run.smithi155.stdout: "client": "client.4668", 2023-08-01T19:55:09.452 INFO:teuthology.orchestra.run.smithi155.stdout: "client_addr": "172.21.15.6:0/1709472247", 2023-08-01T19:55:09.452 INFO:teuthology.orchestra.run.smithi155.stdout: "tid": 108024 2023-08-01T19:55:09.452 INFO:teuthology.orchestra.run.smithi155.stdout: }, 2023-08-01T19:55:09.452 INFO:teuthology.orchestra.run.smithi155.stdout: "events": [ 2023-08-01T19:55:09.453 INFO:teuthology.orchestra.run.smithi155.stdout: { 2023-08-01T19:55:09.453 INFO:teuthology.orchestra.run.smithi155.stdout: "event": "initiated", 2023-08-01T19:55:09.453 INFO:teuthology.orchestra.run.smithi155.stdout: "time": "2023-08-01T19:55:09.418419+0000", 2023-08-01T19:55:09.453 INFO:teuthology.orchestra.run.smithi155.stdout: "duration": 0 2023-08-01T19:55:09.453 INFO:teuthology.orchestra.run.smithi155.stdout: }, 2023-08-01T19:55:09.453 INFO:teuthology.orchestra.run.smithi155.stdout: { 2023-08-01T19:55:09.453 INFO:teuthology.orchestra.run.smithi155.stdout: "event": "throttled", 2023-08-01T19:55:09.453 INFO:teuthology.orchestra.run.smithi155.stdout: "time": "2023-08-01T19:55:09.418419+0000", 2023-08-01T19:55:09.454 INFO:teuthology.orchestra.run.smithi155.stdout: "duration": 0 2023-08-01T19:55:09.454 INFO:teuthology.orchestra.run.smithi155.stdout: }, 2023-08-01T19:55:09.454 INFO:teuthology.orchestra.run.smithi155.stdout: { 2023-08-01T19:55:09.454 INFO:teuthology.orchestra.run.smithi155.stdout: "event": "header_read", 2023-08-01T19:55:09.454 INFO:teuthology.orchestra.run.smithi155.stdout: "time": "2023-08-01T19:55:09.418419+0000", 2023-08-01T19:55:09.454 INFO:teuthology.orchestra.run.smithi155.stdout: "duration": 4294967295.999999 2023-08-01T19:55:09.454 INFO:teuthology.orchestra.run.smithi155.stdout: }, 2023-08-01T19:55:09.455 INFO:teuthology.orchestra.run.smithi155.stdout: { 2023-08-01T19:55:09.455 INFO:teuthology.orchestra.run.smithi155.stdout: "event": "all_read", 2023-08-01T19:55:09.455 INFO:teuthology.orchestra.run.smithi155.stdout: "time": "2023-08-01T19:55:09.418449+0000", 2023-08-01T19:55:09.455 INFO:teuthology.orchestra.run.smithi155.stdout: "duration": 3.0759000000000001e-05 2023-08-01T19:55:09.455 INFO:teuthology.orchestra.run.smithi155.stdout: }, 2023-08-01T19:55:09.455 INFO:teuthology.orchestra.run.smithi155.stdout: { 2023-08-01T19:55:09.455 INFO:teuthology.orchestra.run.smithi155.stdout: "event": "dispatched", 2023-08-01T19:55:09.456 INFO:teuthology.orchestra.run.smithi155.stdout: "time": "2023-08-01T19:55:09.418458+0000", 2023-08-01T19:55:09.456 INFO:teuthology.orchestra.run.smithi155.stdout: "duration": 9.1479999999999995e-06 2023-08-01T19:55:09.456 INFO:teuthology.orchestra.run.smithi155.stdout: }, 2023-08-01T19:55:09.456 INFO:teuthology.orchestra.run.smithi155.stdout: { 2023-08-01T19:55:09.456 INFO:teuthology.orchestra.run.smithi155.stdout: "event": "queued_for_pg", 2023-08-01T19:55:09.456 INFO:teuthology.orchestra.run.smithi155.stdout: "time": "2023-08-01T19:55:09.418464+0000", 2023-08-01T19:55:09.456 INFO:teuthology.orchestra.run.smithi155.stdout: "duration": 5.5790000000000003e-06 2023-08-01T19:55:09.456 INFO:teuthology.orchestra.run.smithi155.stdout: }, 2023-08-01T19:55:09.457 INFO:teuthology.orchestra.run.smithi155.stdout: { 2023-08-01T19:55:09.457 INFO:teuthology.orchestra.run.smithi155.stdout: "event": "reached_pg", 2023-08-01T19:55:09.457 INFO:teuthology.orchestra.run.smithi155.stdout: "time": "2023-08-01T19:55:09.420438+0000", 2023-08-01T19:55:09.457 INFO:teuthology.orchestra.run.smithi155.stdout: "duration": 0.001973617 2023-08-01T19:55:09.457 INFO:teuthology.orchestra.run.smithi155.stdout: }, 2023-08-01T19:55:09.457 INFO:teuthology.orchestra.run.smithi155.stdout: { 2023-08-01T19:55:09.457 INFO:teuthology.orchestra.run.smithi155.stdout: "event": "started", 2023-08-01T19:55:09.457 INFO:teuthology.orchestra.run.smithi155.stdout: "time": "2023-08-01T19:55:09.420556+0000", 2023-08-01T19:55:09.458 INFO:teuthology.orchestra.run.smithi155.stdout: "duration": 0.000117951 2023-08-01T19:55:09.458 INFO:teuthology.orchestra.run.smithi155.stdout: }, 2023-08-01T19:55:09.458 INFO:teuthology.orchestra.run.smithi155.stdout: { 2023-08-01T19:55:09.458 INFO:teuthology.orchestra.run.smithi155.stdout: "event": "waiting for subops from 0", 2023-08-01T19:55:09.458 INFO:teuthology.orchestra.run.smithi155.stdout: "time": "2023-08-01T19:55:09.420697+0000", 2023-08-01T19:55:09.458 INFO:teuthology.orchestra.run.smithi155.stdout: "duration": 0.00014191299999999999 2023-08-01T19:55:09.458 INFO:teuthology.orchestra.run.smithi155.stdout: } 2023-08-01T19:55:09.458 INFO:teuthology.orchestra.run.smithi155.stdout: ] 2023-08-01T19:55:09.459 INFO:teuthology.orchestra.run.smithi155.stdout: } 2023-08-01T19:55:09.459 INFO:teuthology.orchestra.run.smithi155.stdout: }, 2023-08-01T19:55:09.459 INFO:teuthology.orchestra.run.smithi155.stdout: { 2023-08-01T19:55:09.459 INFO:teuthology.orchestra.run.smithi155.stdout: "description": "osd_repop(client.4668.0:108027 5.9 e38/19 5:9e64c2c6:::benchmark_data_smithi006_114134_object108026:head v 38'6762, mlcod=38'6758)", 2023-08-01T19:55:09.459 INFO:teuthology.orchestra.run.smithi155.stdout: "initiated_at": "2023-08-01T19:55:09.419271+0000", 2023-08-01T19:55:09.459 INFO:teuthology.orchestra.run.smithi155.stdout: "age": 0.0041349129999999996, 2023-08-01T19:55:09.459 INFO:teuthology.orchestra.run.smithi155.stdout: "duration": 0.0044858750000000003, 2023-08-01T19:55:09.459 INFO:teuthology.orchestra.run.smithi155.stdout: "type_data": { 2023-08-01T19:55:09.460 INFO:teuthology.orchestra.run.smithi155.stdout: "flag_point": "started", 2023-08-01T19:55:09.460 INFO:teuthology.orchestra.run.smithi155.stdout: "events": [ 2023-08-01T19:55:09.460 INFO:teuthology.orchestra.run.smithi155.stdout: { 2023-08-01T19:55:09.460 INFO:teuthology.orchestra.run.smithi155.stdout: "event": "initiated", 2023-08-01T19:55:09.460 INFO:teuthology.orchestra.run.smithi155.stdout: "time": "2023-08-01T19:55:09.419271+0000", 2023-08-01T19:55:09.460 INFO:teuthology.orchestra.run.smithi155.stdout: "duration": 0 2023-08-01T19:55:09.460 INFO:teuthology.orchestra.run.smithi155.stdout: }, 2023-08-01T19:55:09.461 INFO:teuthology.orchestra.run.smithi155.stdout: { 2023-08-01T19:55:09.461 INFO:teuthology.orchestra.run.smithi155.stdout: "event": "throttled", 2023-08-01T19:55:09.461 INFO:teuthology.orchestra.run.smithi155.stdout: "time": "2023-08-01T19:55:09.419271+0000", 2023-08-01T19:55:09.461 INFO:teuthology.orchestra.run.smithi155.stdout: "duration": 0 2023-08-01T19:55:09.461 INFO:teuthology.orchestra.run.smithi155.stdout: }, 2023-08-01T19:55:09.461 INFO:teuthology.orchestra.run.smithi155.stdout: { 2023-08-01T19:55:09.461 INFO:teuthology.orchestra.run.smithi155.stdout: "event": "header_read", 2023-08-01T19:55:09.461 INFO:teuthology.orchestra.run.smithi155.stdout: "time": "2023-08-01T19:55:09.419271+0000", 2023-08-01T19:55:09.462 INFO:teuthology.orchestra.run.smithi155.stdout: "duration": 4294967295.9999995 2023-08-01T19:55:09.462 INFO:teuthology.orchestra.run.smithi155.stdout: }, 2023-08-01T19:55:09.462 INFO:teuthology.orchestra.run.smithi155.stdout: { 2023-08-01T19:55:09.462 INFO:teuthology.orchestra.run.smithi155.stdout: "event": "all_read", 2023-08-01T19:55:09.462 INFO:teuthology.orchestra.run.smithi155.stdout: "time": "2023-08-01T19:55:09.419337+0000", 2023-08-01T19:55:09.462 INFO:teuthology.orchestra.run.smithi155.stdout: "duration": 6.6643999999999994e-05 2023-08-01T19:55:09.462 INFO:teuthology.orchestra.run.smithi155.stdout: }, 2023-08-01T19:55:09.462 INFO:teuthology.orchestra.run.smithi155.stdout: { 2023-08-01T19:55:09.463 INFO:teuthology.orchestra.run.smithi155.stdout: "event": "dispatched", 2023-08-01T19:55:09.463 INFO:teuthology.orchestra.run.smithi155.stdout: "time": "2023-08-01T19:55:09.419348+0000", 2023-08-01T19:55:09.463 INFO:teuthology.orchestra.run.smithi155.stdout: "duration": 1.0951999999999999e-05 2023-08-01T19:55:09.463 INFO:teuthology.orchestra.run.smithi155.stdout: }, 2023-08-01T19:55:09.463 INFO:teuthology.orchestra.run.smithi155.stdout: { 2023-08-01T19:55:09.463 INFO:teuthology.orchestra.run.smithi155.stdout: "event": "queued_for_pg", 2023-08-01T19:55:09.463 INFO:teuthology.orchestra.run.smithi155.stdout: "time": "2023-08-01T19:55:09.419354+0000", 2023-08-01T19:55:09.463 INFO:teuthology.orchestra.run.smithi155.stdout: "duration": 5.5180000000000004e-06 2023-08-01T19:55:09.464 INFO:teuthology.orchestra.run.smithi155.stdout: }, 2023-08-01T19:55:09.464 INFO:teuthology.orchestra.run.smithi155.stdout: { 2023-08-01T19:55:09.464 INFO:teuthology.orchestra.run.smithi155.stdout: "event": "reached_pg", 2023-08-01T19:55:09.464 INFO:teuthology.orchestra.run.smithi155.stdout: "time": "2023-08-01T19:55:09.419893+0000", 2023-08-01T19:55:09.464 INFO:teuthology.orchestra.run.smithi155.stdout: "duration": 0.00053911400000000004 2023-08-01T19:55:09.464 INFO:teuthology.orchestra.run.smithi155.stdout: }, 2023-08-01T19:55:09.464 INFO:teuthology.orchestra.run.smithi155.stdout: { 2023-08-01T19:55:09.464 INFO:teuthology.orchestra.run.smithi155.stdout: "event": "started", 2023-08-01T19:55:09.465 INFO:teuthology.orchestra.run.smithi155.stdout: "time": "2023-08-01T19:55:09.419912+0000", 2023-08-01T19:55:09.465 INFO:teuthology.orchestra.run.smithi155.stdout: "duration": 1.9539e-05 2023-08-01T19:55:09.465 INFO:teuthology.orchestra.run.smithi155.stdout: } 2023-08-01T19:55:09.465 INFO:teuthology.orchestra.run.smithi155.stdout: ] 2023-08-01T19:55:09.465 INFO:teuthology.orchestra.run.smithi155.stdout: } 2023-08-01T19:55:09.465 INFO:teuthology.orchestra.run.smithi155.stdout: }, 2023-08-01T19:55:09.466 INFO:teuthology.orchestra.run.smithi155.stdout: { 2023-08-01T19:55:09.466 INFO:teuthology.orchestra.run.smithi155.stdout: "description": "osd_op(client.4668.0:108029 5.b 5:dd22ba73:::benchmark_data_smithi006_114134_object108028:head [set-alloc-hint object_size 65536 write_size 65536,write 0~65536 in=65536b] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e38)", 2023-08-01T19:55:09.466 INFO:teuthology.orchestra.run.smithi155.stdout: "initiated_at": "2023-08-01T19:55:09.420534+0000", 2023-08-01T19:55:09.466 INFO:teuthology.orchestra.run.smithi155.stdout: "age": 0.0028724060000000001, 2023-08-01T19:55:09.466 INFO:teuthology.orchestra.run.smithi155.stdout: "duration": 0.0032923079999999999, 2023-08-01T19:55:09.466 INFO:teuthology.orchestra.run.smithi155.stdout: "type_data": { 2023-08-01T19:55:09.466 INFO:teuthology.orchestra.run.smithi155.stdout: "flag_point": "waiting for sub ops", 2023-08-01T19:55:09.466 INFO:teuthology.orchestra.run.smithi155.stdout: "client_info": { 2023-08-01T19:55:09.467 INFO:teuthology.orchestra.run.smithi155.stdout: "client": "client.4668", 2023-08-01T19:55:09.467 INFO:teuthology.orchestra.run.smithi155.stdout: "client_addr": "172.21.15.6:0/1709472247", 2023-08-01T19:55:09.467 INFO:teuthology.orchestra.run.smithi155.stdout: "tid": 108029 2023-08-01T19:55:09.467 INFO:teuthology.orchestra.run.smithi155.stdout: }, 2023-08-01T19:55:09.467 INFO:teuthology.orchestra.run.smithi155.stdout: "events": [ 2023-08-01T19:55:09.467 INFO:teuthology.orchestra.run.smithi155.stdout: { 2023-08-01T19:55:09.467 INFO:teuthology.orchestra.run.smithi155.stdout: "event": "initiated", 2023-08-01T19:55:09.467 INFO:teuthology.orchestra.run.smithi155.stdout: "time": "2023-08-01T19:55:09.420534+0000", 2023-08-01T19:55:09.468 INFO:teuthology.orchestra.run.smithi155.stdout: "duration": 0 2023-08-01T19:55:09.468 INFO:teuthology.orchestra.run.smithi155.stdout: }, 2023-08-01T19:55:09.468 INFO:teuthology.orchestra.run.smithi155.stdout: { 2023-08-01T19:55:09.468 INFO:teuthology.orchestra.run.smithi155.stdout: "event": "throttled", 2023-08-01T19:55:09.468 INFO:teuthology.orchestra.run.smithi155.stdout: "time": "2023-08-01T19:55:09.420534+0000", 2023-08-01T19:55:09.468 INFO:teuthology.orchestra.run.smithi155.stdout: "duration": 0 2023-08-01T19:55:09.468 INFO:teuthology.orchestra.run.smithi155.stdout: }, 2023-08-01T19:55:09.468 INFO:teuthology.orchestra.run.smithi155.stdout: { 2023-08-01T19:55:09.469 INFO:teuthology.orchestra.run.smithi155.stdout: "event": "header_read", 2023-08-01T19:55:09.469 INFO:teuthology.orchestra.run.smithi155.stdout: "time": "2023-08-01T19:55:09.420533+0000", 2023-08-01T19:55:09.469 INFO:teuthology.orchestra.run.smithi155.stdout: "duration": 4294967295.999999 2023-08-01T19:55:09.469 INFO:teuthology.orchestra.run.smithi155.stdout: }, 2023-08-01T19:55:09.469 INFO:teuthology.orchestra.run.smithi155.stdout: { 2023-08-01T19:55:09.469 INFO:teuthology.orchestra.run.smithi155.stdout: "event": "all_read", 2023-08-01T19:55:09.469 INFO:teuthology.orchestra.run.smithi155.stdout: "time": "2023-08-01T19:55:09.420592+0000", 2023-08-01T19:55:09.469 INFO:teuthology.orchestra.run.smithi155.stdout: "duration": 5.9444000000000002e-05 2023-08-01T19:55:09.470 INFO:teuthology.orchestra.run.smithi155.stdout: }, 2023-08-01T19:55:09.470 INFO:teuthology.orchestra.run.smithi155.stdout: { 2023-08-01T19:55:09.470 INFO:teuthology.orchestra.run.smithi155.stdout: "event": "dispatched", 2023-08-01T19:55:09.470 INFO:teuthology.orchestra.run.smithi155.stdout: "time": "2023-08-01T19:55:09.420600+0000", 2023-08-01T19:55:09.470 INFO:teuthology.orchestra.run.smithi155.stdout: "duration": 7.4730000000000003e-06 2023-08-01T19:55:09.470 INFO:teuthology.orchestra.run.smithi155.stdout: }, 2023-08-01T19:55:09.470 INFO:teuthology.orchestra.run.smithi155.stdout: { 2023-08-01T19:55:09.470 INFO:teuthology.orchestra.run.smithi155.stdout: "event": "queued_for_pg", 2023-08-01T19:55:09.471 INFO:teuthology.orchestra.run.smithi155.stdout: "time": "2023-08-01T19:55:09.420604+0000", 2023-08-01T19:55:09.471 INFO:teuthology.orchestra.run.smithi155.stdout: "duration": 4.0520000000000003e-06 2023-08-01T19:55:09.471 INFO:teuthology.orchestra.run.smithi155.stdout: }, 2023-08-01T19:55:09.471 INFO:teuthology.orchestra.run.smithi155.stdout: { 2023-08-01T19:55:09.471 INFO:teuthology.orchestra.run.smithi155.stdout: "event": "reached_pg", 2023-08-01T19:55:09.471 INFO:teuthology.orchestra.run.smithi155.stdout: "time": "2023-08-01T19:55:09.420642+0000", 2023-08-01T19:55:09.471 INFO:teuthology.orchestra.run.smithi155.stdout: "duration": 3.7800999999999999e-05 2023-08-01T19:55:09.472 INFO:teuthology.orchestra.run.smithi155.stdout: }, 2023-08-01T19:55:09.472 INFO:teuthology.orchestra.run.smithi155.stdout: { 2023-08-01T19:55:09.472 INFO:teuthology.orchestra.run.smithi155.stdout: "event": "started", 2023-08-01T19:55:09.472 INFO:teuthology.orchestra.run.smithi155.stdout: "time": "2023-08-01T19:55:09.420763+0000", 2023-08-01T19:55:09.472 INFO:teuthology.orchestra.run.smithi155.stdout: "duration": 0.00012155 2023-08-01T19:55:09.472 INFO:teuthology.orchestra.run.smithi155.stdout: }, 2023-08-01T19:55:09.472 INFO:teuthology.orchestra.run.smithi155.stdout: { 2023-08-01T19:55:09.472 INFO:teuthology.orchestra.run.smithi155.stdout: "event": "waiting for subops from 0", 2023-08-01T19:55:09.473 INFO:teuthology.orchestra.run.smithi155.stdout: "time": "2023-08-01T19:55:09.420908+0000", 2023-08-01T19:55:09.473 INFO:teuthology.orchestra.run.smithi155.stdout: "duration": 0.00014480600000000001 2023-08-01T19:55:09.473 INFO:teuthology.orchestra.run.smithi155.stdout: } 2023-08-01T19:55:09.473 INFO:teuthology.orchestra.run.smithi155.stdout: ] 2023-08-01T19:55:09.473 INFO:teuthology.orchestra.run.smithi155.stdout: } 2023-08-01T19:55:09.473 INFO:teuthology.orchestra.run.smithi155.stdout: }, 2023-08-01T19:55:09.473 INFO:teuthology.orchestra.run.smithi155.stdout: { 2023-08-01T19:55:09.473 INFO:teuthology.orchestra.run.smithi155.stdout: "description": "osd_repop(client.4668.0:108031 5.9 e38/19 5:9b7b8f76:::benchmark_data_smithi006_114134_object108030:head v 38'6763, mlcod=38'6758)", 2023-08-01T19:55:09.474 INFO:teuthology.orchestra.run.smithi155.stdout: "initiated_at": "2023-08-01T19:55:09.421064+0000", 2023-08-01T19:55:09.474 INFO:teuthology.orchestra.run.smithi155.stdout: "age": 0.0023417780000000001, 2023-08-01T19:55:09.474 INFO:teuthology.orchestra.run.smithi155.stdout: "duration": 0.0028404799999999998, 2023-08-01T19:55:09.474 INFO:teuthology.orchestra.run.smithi155.stdout: "type_data": { 2023-08-01T19:55:09.474 INFO:teuthology.orchestra.run.smithi155.stdout: "flag_point": "started", 2023-08-01T19:55:09.474 INFO:teuthology.orchestra.run.smithi155.stdout: "events": [ 2023-08-01T19:55:09.474 INFO:teuthology.orchestra.run.smithi155.stdout: { 2023-08-01T19:55:09.474 INFO:teuthology.orchestra.run.smithi155.stdout: "event": "initiated", 2023-08-01T19:55:09.475 INFO:teuthology.orchestra.run.smithi155.stdout: "time": "2023-08-01T19:55:09.421064+0000", 2023-08-01T19:55:09.475 INFO:teuthology.orchestra.run.smithi155.stdout: "duration": 0 2023-08-01T19:55:09.475 INFO:teuthology.orchestra.run.smithi155.stdout: }, 2023-08-01T19:55:09.475 INFO:teuthology.orchestra.run.smithi155.stdout: { 2023-08-01T19:55:09.475 INFO:teuthology.orchestra.run.smithi155.stdout: "event": "throttled", 2023-08-01T19:55:09.475 INFO:teuthology.orchestra.run.smithi155.stdout: "time": "2023-08-01T19:55:09.421064+0000", 2023-08-01T19:55:09.475 INFO:teuthology.orchestra.run.smithi155.stdout: "duration": 0 2023-08-01T19:55:09.475 INFO:teuthology.orchestra.run.smithi155.stdout: }, 2023-08-01T19:55:09.476 INFO:teuthology.orchestra.run.smithi155.stdout: { 2023-08-01T19:55:09.476 INFO:teuthology.orchestra.run.smithi155.stdout: "event": "header_read", 2023-08-01T19:55:09.476 INFO:teuthology.orchestra.run.smithi155.stdout: "time": "2023-08-01T19:55:09.421064+0000", 2023-08-01T19:55:09.476 INFO:teuthology.orchestra.run.smithi155.stdout: "duration": 4294967295.9999995 2023-08-01T19:55:09.476 INFO:teuthology.orchestra.run.smithi155.stdout: }, 2023-08-01T19:55:09.476 INFO:teuthology.orchestra.run.smithi155.stdout: { 2023-08-01T19:55:09.476 INFO:teuthology.orchestra.run.smithi155.stdout: "event": "all_read", 2023-08-01T19:55:09.477 INFO:teuthology.orchestra.run.smithi155.stdout: "time": "2023-08-01T19:55:09.421131+0000", 2023-08-01T19:55:09.477 INFO:teuthology.orchestra.run.smithi155.stdout: "duration": 6.6737999999999997e-05 2023-08-01T19:55:09.477 INFO:teuthology.orchestra.run.smithi155.stdout: }, 2023-08-01T19:55:09.477 INFO:teuthology.orchestra.run.smithi155.stdout: { 2023-08-01T19:55:09.477 INFO:teuthology.orchestra.run.smithi155.stdout: "event": "dispatched", 2023-08-01T19:55:09.477 INFO:teuthology.orchestra.run.smithi155.stdout: "time": "2023-08-01T19:55:09.421138+0000", 2023-08-01T19:55:09.477 INFO:teuthology.orchestra.run.smithi155.stdout: "duration": 7.8499999999999994e-06 2023-08-01T19:55:09.477 INFO:teuthology.orchestra.run.smithi155.stdout: }, 2023-08-01T19:55:09.478 INFO:teuthology.orchestra.run.smithi155.stdout: { 2023-08-01T19:55:09.478 INFO:teuthology.orchestra.run.smithi155.stdout: "event": "queued_for_pg", 2023-08-01T19:55:09.478 INFO:teuthology.orchestra.run.smithi155.stdout: "time": "2023-08-01T19:55:09.421142+0000", 2023-08-01T19:55:09.478 INFO:teuthology.orchestra.run.smithi155.stdout: "duration": 3.4699999999999998e-06 2023-08-01T19:55:09.478 INFO:teuthology.orchestra.run.smithi155.stdout: }, 2023-08-01T19:55:09.478 INFO:teuthology.orchestra.run.smithi155.stdout: { 2023-08-01T19:55:09.478 INFO:teuthology.orchestra.run.smithi155.stdout: "event": "reached_pg", 2023-08-01T19:55:09.478 INFO:teuthology.orchestra.run.smithi155.stdout: "time": "2023-08-01T19:55:09.421768+0000", 2023-08-01T19:55:09.479 INFO:teuthology.orchestra.run.smithi155.stdout: "duration": 0.00062603400000000003 2023-08-01T19:55:09.479 INFO:teuthology.orchestra.run.smithi155.stdout: }, 2023-08-01T19:55:09.479 INFO:teuthology.orchestra.run.smithi155.stdout: { 2023-08-01T19:55:09.479 INFO:teuthology.orchestra.run.smithi155.stdout: "event": "started", 2023-08-01T19:55:09.479 INFO:teuthology.orchestra.run.smithi155.stdout: "time": "2023-08-01T19:55:09.421783+0000", 2023-08-01T19:55:09.479 INFO:teuthology.orchestra.run.smithi155.stdout: "duration": 1.5248e-05 2023-08-01T19:55:09.479 INFO:teuthology.orchestra.run.smithi155.stdout: } 2023-08-01T19:55:09.479 INFO:teuthology.orchestra.run.smithi155.stdout: ] 2023-08-01T19:55:09.480 INFO:teuthology.orchestra.run.smithi155.stdout: } 2023-08-01T19:55:09.480 INFO:teuthology.orchestra.run.smithi155.stdout: }, 2023-08-01T19:55:09.480 INFO:teuthology.orchestra.run.smithi155.stdout: { 2023-08-01T19:55:09.480 INFO:teuthology.orchestra.run.smithi155.stdout: "description": "osd_op(client.4668.0:108033 5.4 5:255639df:::benchmark_data_smithi006_114134_object108032:head [set-alloc-hint object_size 65536 write_size 65536,write 0~65536 in=65536b] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e38)", 2023-08-01T19:55:09.480 INFO:teuthology.orchestra.run.smithi155.stdout: "initiated_at": "2023-08-01T19:55:09.422711+0000", 2023-08-01T19:55:09.480 INFO:teuthology.orchestra.run.smithi155.stdout: "age": 0.000695738, 2023-08-01T19:55:09.480 INFO:teuthology.orchestra.run.smithi155.stdout: "duration": 0.0012981550000000001, 2023-08-01T19:55:09.480 INFO:teuthology.orchestra.run.smithi155.stdout: "type_data": { 2023-08-01T19:55:09.481 INFO:teuthology.orchestra.run.smithi155.stdout: "flag_point": "waiting for sub ops", 2023-08-01T19:55:09.481 INFO:teuthology.orchestra.run.smithi155.stdout: "client_info": { 2023-08-01T19:55:09.481 INFO:teuthology.orchestra.run.smithi155.stdout: "client": "client.4668", 2023-08-01T19:55:09.481 INFO:teuthology.orchestra.run.smithi155.stdout: "client_addr": "172.21.15.6:0/1709472247", 2023-08-01T19:55:09.481 INFO:teuthology.orchestra.run.smithi155.stdout: "tid": 108033 2023-08-01T19:55:09.481 INFO:teuthology.orchestra.run.smithi155.stdout: }, 2023-08-01T19:55:09.481 INFO:teuthology.orchestra.run.smithi155.stdout: "events": [ 2023-08-01T19:55:09.482 INFO:teuthology.orchestra.run.smithi155.stdout: { 2023-08-01T19:55:09.482 INFO:teuthology.orchestra.run.smithi155.stdout: "event": "initiated", 2023-08-01T19:55:09.482 INFO:teuthology.orchestra.run.smithi155.stdout: "time": "2023-08-01T19:55:09.422711+0000", 2023-08-01T19:55:09.482 INFO:teuthology.orchestra.run.smithi155.stdout: "duration": 0 2023-08-01T19:55:09.482 INFO:teuthology.orchestra.run.smithi155.stdout: }, 2023-08-01T19:55:09.482 INFO:teuthology.orchestra.run.smithi155.stdout: { 2023-08-01T19:55:09.482 INFO:teuthology.orchestra.run.smithi155.stdout: "event": "throttled", 2023-08-01T19:55:09.482 INFO:teuthology.orchestra.run.smithi155.stdout: "time": "2023-08-01T19:55:09.422711+0000", 2023-08-01T19:55:09.483 INFO:teuthology.orchestra.run.smithi155.stdout: "duration": 0 2023-08-01T19:55:09.483 INFO:teuthology.orchestra.run.smithi155.stdout: }, 2023-08-01T19:55:09.483 INFO:teuthology.orchestra.run.smithi155.stdout: { 2023-08-01T19:55:09.483 INFO:teuthology.orchestra.run.smithi155.stdout: "event": "header_read", 2023-08-01T19:55:09.483 INFO:teuthology.orchestra.run.smithi155.stdout: "time": "2023-08-01T19:55:09.422709+0000", 2023-08-01T19:55:09.483 INFO:teuthology.orchestra.run.smithi155.stdout: "duration": 4294967295.999999 2023-08-01T19:55:09.483 INFO:teuthology.orchestra.run.smithi155.stdout: }, 2023-08-01T19:55:09.483 INFO:teuthology.orchestra.run.smithi155.stdout: { 2023-08-01T19:55:09.484 INFO:teuthology.orchestra.run.smithi155.stdout: "event": "all_read", 2023-08-01T19:55:09.484 INFO:teuthology.orchestra.run.smithi155.stdout: "time": "2023-08-01T19:55:09.422808+0000", 2023-08-01T19:55:09.484 INFO:teuthology.orchestra.run.smithi155.stdout: "duration": 9.8688000000000001e-05 2023-08-01T19:55:09.484 INFO:teuthology.orchestra.run.smithi155.stdout: }, 2023-08-01T19:55:09.484 INFO:teuthology.orchestra.run.smithi155.stdout: { 2023-08-01T19:55:09.484 INFO:teuthology.orchestra.run.smithi155.stdout: "event": "dispatched", 2023-08-01T19:55:09.484 INFO:teuthology.orchestra.run.smithi155.stdout: "time": "2023-08-01T19:55:09.422820+0000", 2023-08-01T19:55:09.484 INFO:teuthology.orchestra.run.smithi155.stdout: "duration": 1.1582e-05 2023-08-01T19:55:09.485 INFO:teuthology.orchestra.run.smithi155.stdout: }, 2023-08-01T19:55:09.485 INFO:teuthology.orchestra.run.smithi155.stdout: { 2023-08-01T19:55:09.485 INFO:teuthology.orchestra.run.smithi155.stdout: "event": "queued_for_pg", 2023-08-01T19:55:09.485 INFO:teuthology.orchestra.run.smithi155.stdout: "time": "2023-08-01T19:55:09.422826+0000", 2023-08-01T19:55:09.485 INFO:teuthology.orchestra.run.smithi155.stdout: "duration": 6.6680000000000004e-06 2023-08-01T19:55:09.485 INFO:teuthology.orchestra.run.smithi155.stdout: }, 2023-08-01T19:55:09.485 INFO:teuthology.orchestra.run.smithi155.stdout: { 2023-08-01T19:55:09.485 INFO:teuthology.orchestra.run.smithi155.stdout: "event": "reached_pg", 2023-08-01T19:55:09.486 INFO:teuthology.orchestra.run.smithi155.stdout: "time": "2023-08-01T19:55:09.422859+0000", 2023-08-01T19:55:09.486 INFO:teuthology.orchestra.run.smithi155.stdout: "duration": 3.3077999999999997e-05 2023-08-01T19:55:09.486 INFO:teuthology.orchestra.run.smithi155.stdout: }, 2023-08-01T19:55:09.486 INFO:teuthology.orchestra.run.smithi155.stdout: { 2023-08-01T19:55:09.486 INFO:teuthology.orchestra.run.smithi155.stdout: "event": "started", 2023-08-01T19:55:09.486 INFO:teuthology.orchestra.run.smithi155.stdout: "time": "2023-08-01T19:55:09.422952+0000", 2023-08-01T19:55:09.486 INFO:teuthology.orchestra.run.smithi155.stdout: "duration": 9.2142e-05 2023-08-01T19:55:09.486 INFO:teuthology.orchestra.run.smithi155.stdout: }, 2023-08-01T19:55:09.487 INFO:teuthology.orchestra.run.smithi155.stdout: { 2023-08-01T19:55:09.487 INFO:teuthology.orchestra.run.smithi155.stdout: "event": "waiting for subops from 0", 2023-08-01T19:55:09.487 INFO:teuthology.orchestra.run.smithi155.stdout: "time": "2023-08-01T19:55:09.423036+0000", 2023-08-01T19:55:09.487 INFO:teuthology.orchestra.run.smithi155.stdout: "duration": 8.4275000000000002e-05 2023-08-01T19:55:09.487 INFO:teuthology.orchestra.run.smithi155.stdout: } 2023-08-01T19:55:09.487 INFO:teuthology.orchestra.run.smithi155.stdout: ] 2023-08-01T19:55:09.487 INFO:teuthology.orchestra.run.smithi155.stdout: } 2023-08-01T19:55:09.487 INFO:teuthology.orchestra.run.smithi155.stdout: }, 2023-08-01T19:55:09.488 INFO:teuthology.orchestra.run.smithi155.stdout: { 2023-08-01T19:55:09.488 INFO:teuthology.orchestra.run.smithi155.stdout: "description": "osd_op(client.4668.0:108035 5.8 5:195ee312:::benchmark_data_smithi006_114134_object108034:head [set-alloc-hint object_size 65536 write_size 65536,write 0~65536 in=65536b] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e38)", 2023-08-01T19:55:09.488 INFO:teuthology.orchestra.run.smithi155.stdout: "initiated_at": "2023-08-01T19:55:09.423434+0000", 2023-08-01T19:55:09.488 INFO:teuthology.orchestra.run.smithi155.stdout: "age": 4294967295.9999723, 2023-08-01T19:55:09.488 INFO:teuthology.orchestra.run.smithi155.stdout: "duration": 0.00066762400000000002, 2023-08-01T19:55:09.488 INFO:teuthology.orchestra.run.smithi155.stdout: "type_data": { 2023-08-01T19:55:09.488 INFO:teuthology.orchestra.run.smithi155.stdout: "flag_point": "waiting for sub ops", 2023-08-01T19:55:09.489 INFO:teuthology.orchestra.run.smithi155.stdout: "client_info": { 2023-08-01T19:55:09.489 INFO:teuthology.orchestra.run.smithi155.stdout: "client": "client.4668", 2023-08-01T19:55:09.489 INFO:teuthology.orchestra.run.smithi155.stdout: "client_addr": "172.21.15.6:0/1709472247", 2023-08-01T19:55:09.489 INFO:teuthology.orchestra.run.smithi155.stdout: "tid": 108035 2023-08-01T19:55:09.489 INFO:teuthology.orchestra.run.smithi155.stdout: }, 2023-08-01T19:55:09.489 INFO:teuthology.orchestra.run.smithi155.stdout: "events": [ 2023-08-01T19:55:09.489 INFO:teuthology.orchestra.run.smithi155.stdout: { 2023-08-01T19:55:09.489 INFO:teuthology.orchestra.run.smithi155.stdout: "event": "initiated", 2023-08-01T19:55:09.490 INFO:teuthology.orchestra.run.smithi155.stdout: "time": "2023-08-01T19:55:09.423434+0000", 2023-08-01T19:55:09.490 INFO:teuthology.orchestra.run.smithi155.stdout: "duration": 0 2023-08-01T19:55:09.490 INFO:teuthology.orchestra.run.smithi155.stdout: }, 2023-08-01T19:55:09.490 INFO:teuthology.orchestra.run.smithi155.stdout: { 2023-08-01T19:55:09.490 INFO:teuthology.orchestra.run.smithi155.stdout: "event": "throttled", 2023-08-01T19:55:09.490 INFO:teuthology.orchestra.run.smithi155.stdout: "time": "2023-08-01T19:55:09.423434+0000", 2023-08-01T19:55:09.490 INFO:teuthology.orchestra.run.smithi155.stdout: "duration": 0 2023-08-01T19:55:09.490 INFO:teuthology.orchestra.run.smithi155.stdout: }, 2023-08-01T19:55:09.491 INFO:teuthology.orchestra.run.smithi155.stdout: { 2023-08-01T19:55:09.491 INFO:teuthology.orchestra.run.smithi155.stdout: "event": "header_read", 2023-08-01T19:55:09.491 INFO:teuthology.orchestra.run.smithi155.stdout: "time": "2023-08-01T19:55:09.423433+0000", 2023-08-01T19:55:09.491 INFO:teuthology.orchestra.run.smithi155.stdout: "duration": 4294967295.999999 2023-08-01T19:55:09.491 INFO:teuthology.orchestra.run.smithi155.stdout: }, 2023-08-01T19:55:09.491 INFO:teuthology.orchestra.run.smithi155.stdout: { 2023-08-01T19:55:09.491 INFO:teuthology.orchestra.run.smithi155.stdout: "event": "all_read", 2023-08-01T19:55:09.492 INFO:teuthology.orchestra.run.smithi155.stdout: "time": "2023-08-01T19:55:09.423504+0000", 2023-08-01T19:55:09.492 INFO:teuthology.orchestra.run.smithi155.stdout: "duration": 7.1239e-05 2023-08-01T19:55:09.492 INFO:teuthology.orchestra.run.smithi155.stdout: }, 2023-08-01T19:55:09.492 INFO:teuthology.orchestra.run.smithi155.stdout: { 2023-08-01T19:55:09.492 INFO:teuthology.orchestra.run.smithi155.stdout: "event": "dispatched", 2023-08-01T19:55:09.492 INFO:teuthology.orchestra.run.smithi155.stdout: "time": "2023-08-01T19:55:09.423515+0000", 2023-08-01T19:55:09.492 INFO:teuthology.orchestra.run.smithi155.stdout: "duration": 1.0583e-05 2023-08-01T19:55:09.492 INFO:teuthology.orchestra.run.smithi155.stdout: }, 2023-08-01T19:55:09.493 INFO:teuthology.orchestra.run.smithi155.stdout: { 2023-08-01T19:55:09.493 INFO:teuthology.orchestra.run.smithi155.stdout: "event": "queued_for_pg", 2023-08-01T19:55:09.493 INFO:teuthology.orchestra.run.smithi155.stdout: "time": "2023-08-01T19:55:09.423519+0000", 2023-08-01T19:55:09.493 INFO:teuthology.orchestra.run.smithi155.stdout: "duration": 4.5290000000000002e-06 2023-08-01T19:55:09.493 INFO:teuthology.orchestra.run.smithi155.stdout: }, 2023-08-01T19:55:09.493 INFO:teuthology.orchestra.run.smithi155.stdout: { 2023-08-01T19:55:09.493 INFO:teuthology.orchestra.run.smithi155.stdout: "event": "reached_pg", 2023-08-01T19:55:09.494 INFO:teuthology.orchestra.run.smithi155.stdout: "time": "2023-08-01T19:55:09.423559+0000", 2023-08-01T19:55:09.494 INFO:teuthology.orchestra.run.smithi155.stdout: "duration": 3.9504e-05 2023-08-01T19:55:09.494 INFO:teuthology.orchestra.run.smithi155.stdout: }, 2023-08-01T19:55:09.494 INFO:teuthology.orchestra.run.smithi155.stdout: { 2023-08-01T19:55:09.494 INFO:teuthology.orchestra.run.smithi155.stdout: "event": "started", 2023-08-01T19:55:09.494 INFO:teuthology.orchestra.run.smithi155.stdout: "time": "2023-08-01T19:55:09.423678+0000", 2023-08-01T19:55:09.494 INFO:teuthology.orchestra.run.smithi155.stdout: "duration": 0.000119467 2023-08-01T19:55:09.494 INFO:teuthology.orchestra.run.smithi155.stdout: }, 2023-08-01T19:55:09.495 INFO:teuthology.orchestra.run.smithi155.stdout: { 2023-08-01T19:55:09.495 INFO:teuthology.orchestra.run.smithi155.stdout: "event": "waiting for subops from 0", 2023-08-01T19:55:09.495 INFO:teuthology.orchestra.run.smithi155.stdout: "time": "2023-08-01T19:55:09.423822+0000", 2023-08-01T19:55:09.495 INFO:teuthology.orchestra.run.smithi155.stdout: "duration": 0.00014334300000000001 2023-08-01T19:55:09.495 INFO:teuthology.orchestra.run.smithi155.stdout: } 2023-08-01T19:55:09.496 INFO:teuthology.orchestra.run.smithi155.stdout: ] 2023-08-01T19:55:09.496 INFO:teuthology.orchestra.run.smithi155.stdout: } 2023-08-01T19:55:09.496 INFO:teuthology.orchestra.run.smithi155.stdout: }, 2023-08-01T19:55:09.496 INFO:teuthology.orchestra.run.smithi155.stdout: { 2023-08-01T19:55:09.496 INFO:teuthology.orchestra.run.smithi155.stdout: "description": "osd_repop(client.4668.0:108034 5.9 e38/19 5:956648c6:::benchmark_data_smithi006_114134_object108033:head v 38'6764, mlcod=38'6760)", 2023-08-01T19:55:09.496 INFO:teuthology.orchestra.run.smithi155.stdout: "initiated_at": "2023-08-01T19:55:09.423766+0000", 2023-08-01T19:55:09.496 INFO:teuthology.orchestra.run.smithi155.stdout: "age": 4294967295.99964, 2023-08-01T19:55:09.497 INFO:teuthology.orchestra.run.smithi155.stdout: "duration": 0.00042166300000000002, 2023-08-01T19:55:09.497 INFO:teuthology.orchestra.run.smithi155.stdout: "type_data": { 2023-08-01T19:55:09.497 INFO:teuthology.orchestra.run.smithi155.stdout: "flag_point": "started", 2023-08-01T19:55:09.497 INFO:teuthology.orchestra.run.smithi155.stdout: "events": [ 2023-08-01T19:55:09.497 INFO:teuthology.orchestra.run.smithi155.stdout: { 2023-08-01T19:55:09.498 INFO:teuthology.orchestra.run.smithi155.stdout: "event": "initiated", 2023-08-01T19:55:09.498 INFO:teuthology.orchestra.run.smithi155.stdout: "time": "2023-08-01T19:55:09.423766+0000", 2023-08-01T19:55:09.498 INFO:teuthology.orchestra.run.smithi155.stdout: "duration": 0 2023-08-01T19:55:09.498 INFO:teuthology.orchestra.run.smithi155.stdout: }, 2023-08-01T19:55:09.499 INFO:teuthology.orchestra.run.smithi155.stdout: { 2023-08-01T19:55:09.499 INFO:teuthology.orchestra.run.smithi155.stdout: "event": "throttled", 2023-08-01T19:55:09.499 INFO:teuthology.orchestra.run.smithi155.stdout: "time": "2023-08-01T19:55:09.423766+0000", 2023-08-01T19:55:09.499 INFO:teuthology.orchestra.run.smithi155.stdout: "duration": 0 2023-08-01T19:55:09.500 INFO:teuthology.orchestra.run.smithi155.stdout: }, 2023-08-01T19:55:09.500 INFO:teuthology.orchestra.run.smithi155.stdout: { 2023-08-01T19:55:09.500 INFO:teuthology.orchestra.run.smithi155.stdout: "event": "header_read", 2023-08-01T19:55:09.500 INFO:teuthology.orchestra.run.smithi155.stdout: "time": "2023-08-01T19:55:09.423766+0000", 2023-08-01T19:55:09.500 INFO:teuthology.orchestra.run.smithi155.stdout: "duration": 4294967295.9999995 2023-08-01T19:55:09.500 INFO:teuthology.orchestra.run.smithi155.stdout: }, 2023-08-01T19:55:09.501 INFO:teuthology.orchestra.run.smithi155.stdout: { 2023-08-01T19:55:09.501 INFO:teuthology.orchestra.run.smithi155.stdout: "event": "all_read", 2023-08-01T19:55:09.501 INFO:teuthology.orchestra.run.smithi155.stdout: "time": "2023-08-01T19:55:09.423845+0000", 2023-08-01T19:55:09.501 INFO:teuthology.orchestra.run.smithi155.stdout: "duration": 7.9135999999999996e-05 2023-08-01T19:55:09.502 INFO:teuthology.orchestra.run.smithi155.stdout: }, 2023-08-01T19:55:09.502 INFO:teuthology.orchestra.run.smithi155.stdout: { 2023-08-01T19:55:09.502 INFO:teuthology.orchestra.run.smithi155.stdout: "event": "dispatched", 2023-08-01T19:55:09.502 INFO:teuthology.orchestra.run.smithi155.stdout: "time": "2023-08-01T19:55:09.423855+0000", 2023-08-01T19:55:09.502 INFO:teuthology.orchestra.run.smithi155.stdout: "duration": 9.6590000000000002e-06 2023-08-01T19:55:09.502 INFO:teuthology.orchestra.run.smithi155.stdout: }, 2023-08-01T19:55:09.502 INFO:teuthology.orchestra.run.smithi155.stdout: { 2023-08-01T19:55:09.502 INFO:teuthology.orchestra.run.smithi155.stdout: "event": "queued_for_pg", 2023-08-01T19:55:09.503 INFO:teuthology.orchestra.run.smithi155.stdout: "time": "2023-08-01T19:55:09.423860+0000", 2023-08-01T19:55:09.503 INFO:teuthology.orchestra.run.smithi155.stdout: "duration": 5.2530000000000004e-06 2023-08-01T19:55:09.503 INFO:teuthology.orchestra.run.smithi155.stdout: }, 2023-08-01T19:55:09.503 INFO:teuthology.orchestra.run.smithi155.stdout: { 2023-08-01T19:55:09.503 INFO:teuthology.orchestra.run.smithi155.stdout: "event": "reached_pg", 2023-08-01T19:55:09.503 INFO:teuthology.orchestra.run.smithi155.stdout: "time": "2023-08-01T19:55:09.423891+0000", 2023-08-01T19:55:09.503 INFO:teuthology.orchestra.run.smithi155.stdout: "duration": 3.0982000000000003e-05 2023-08-01T19:55:09.503 INFO:teuthology.orchestra.run.smithi155.stdout: }, 2023-08-01T19:55:09.504 INFO:teuthology.orchestra.run.smithi155.stdout: { 2023-08-01T19:55:09.504 INFO:teuthology.orchestra.run.smithi155.stdout: "event": "started", 2023-08-01T19:55:09.504 INFO:teuthology.orchestra.run.smithi155.stdout: "time": "2023-08-01T19:55:09.423903+0000", 2023-08-01T19:55:09.504 INFO:teuthology.orchestra.run.smithi155.stdout: "duration": 1.236e-05 2023-08-01T19:55:09.504 INFO:teuthology.orchestra.run.smithi155.stdout: } 2023-08-01T19:55:09.504 INFO:teuthology.orchestra.run.smithi155.stdout: ] 2023-08-01T19:55:09.504 INFO:teuthology.orchestra.run.smithi155.stdout: } 2023-08-01T19:55:09.505 INFO:teuthology.orchestra.run.smithi155.stdout: }, 2023-08-01T19:55:09.505 INFO:teuthology.orchestra.run.smithi155.stdout: { 2023-08-01T19:55:09.505 INFO:teuthology.orchestra.run.smithi155.stdout: "description": "osd_repop_reply(client.4668.0:108022 5.8 e38/19)", 2023-08-01T19:55:09.505 INFO:teuthology.orchestra.run.smithi155.stdout: "initiated_at": "2023-08-01T19:55:09.423982+0000", 2023-08-01T19:55:09.505 INFO:teuthology.orchestra.run.smithi155.stdout: "age": 4294967295.9994245, 2023-08-01T19:55:09.505 INFO:teuthology.orchestra.run.smithi155.stdout: "duration": 0.00027049099999999998, 2023-08-01T19:55:09.505 INFO:teuthology.orchestra.run.smithi155.stdout: "type_data": { 2023-08-01T19:55:09.505 INFO:teuthology.orchestra.run.smithi155.stdout: "flag_point": "queued for pg", 2023-08-01T19:55:09.506 INFO:teuthology.orchestra.run.smithi155.stdout: "events": [ 2023-08-01T19:55:09.506 INFO:teuthology.orchestra.run.smithi155.stdout: { 2023-08-01T19:55:09.506 INFO:teuthology.orchestra.run.smithi155.stdout: "event": "initiated", 2023-08-01T19:55:09.506 INFO:teuthology.orchestra.run.smithi155.stdout: "time": "2023-08-01T19:55:09.423982+0000", 2023-08-01T19:55:09.506 INFO:teuthology.orchestra.run.smithi155.stdout: "duration": 0 2023-08-01T19:55:09.506 INFO:teuthology.orchestra.run.smithi155.stdout: }, 2023-08-01T19:55:09.506 INFO:teuthology.orchestra.run.smithi155.stdout: { 2023-08-01T19:55:09.506 INFO:teuthology.orchestra.run.smithi155.stdout: "event": "throttled", 2023-08-01T19:55:09.507 INFO:teuthology.orchestra.run.smithi155.stdout: "time": "2023-08-01T19:55:09.423982+0000", 2023-08-01T19:55:09.507 INFO:teuthology.orchestra.run.smithi155.stdout: "duration": 0 2023-08-01T19:55:09.507 INFO:teuthology.orchestra.run.smithi155.stdout: }, 2023-08-01T19:55:09.507 INFO:teuthology.orchestra.run.smithi155.stdout: { 2023-08-01T19:55:09.507 INFO:teuthology.orchestra.run.smithi155.stdout: "event": "header_read", 2023-08-01T19:55:09.507 INFO:teuthology.orchestra.run.smithi155.stdout: "time": "2023-08-01T19:55:09.423981+0000", 2023-08-01T19:55:09.507 INFO:teuthology.orchestra.run.smithi155.stdout: "duration": 4294967295.9999995 2023-08-01T19:55:09.507 INFO:teuthology.orchestra.run.smithi155.stdout: }, 2023-08-01T19:55:09.508 INFO:teuthology.orchestra.run.smithi155.stdout: { 2023-08-01T19:55:09.508 INFO:teuthology.orchestra.run.smithi155.stdout: "event": "all_read", 2023-08-01T19:55:09.508 INFO:teuthology.orchestra.run.smithi155.stdout: "time": "2023-08-01T19:55:09.423983+0000", 2023-08-01T19:55:09.508 INFO:teuthology.orchestra.run.smithi155.stdout: "duration": 1.979e-06 2023-08-01T19:55:09.508 INFO:teuthology.orchestra.run.smithi155.stdout: }, 2023-08-01T19:55:09.508 INFO:teuthology.orchestra.run.smithi155.stdout: { 2023-08-01T19:55:09.508 INFO:teuthology.orchestra.run.smithi155.stdout: "event": "dispatched", 2023-08-01T19:55:09.509 INFO:teuthology.orchestra.run.smithi155.stdout: "time": "2023-08-01T19:55:09.423989+0000", 2023-08-01T19:55:09.509 INFO:teuthology.orchestra.run.smithi155.stdout: "duration": 5.322e-06 2023-08-01T19:55:09.509 INFO:teuthology.orchestra.run.smithi155.stdout: }, 2023-08-01T19:55:09.509 INFO:teuthology.orchestra.run.smithi155.stdout: { 2023-08-01T19:55:09.509 INFO:teuthology.orchestra.run.smithi155.stdout: "event": "queued_for_pg", 2023-08-01T19:55:09.509 INFO:teuthology.orchestra.run.smithi155.stdout: "time": "2023-08-01T19:55:09.423992+0000", 2023-08-01T19:55:09.509 INFO:teuthology.orchestra.run.smithi155.stdout: "duration": 3.2229999999999999e-06 2023-08-01T19:55:09.509 INFO:teuthology.orchestra.run.smithi155.stdout: } 2023-08-01T19:55:09.510 INFO:teuthology.orchestra.run.smithi155.stdout: ] 2023-08-01T19:55:09.510 INFO:teuthology.orchestra.run.smithi155.stdout: } 2023-08-01T19:55:09.510 INFO:teuthology.orchestra.run.smithi155.stdout: }, 2023-08-01T19:55:09.510 INFO:teuthology.orchestra.run.smithi155.stdout: { 2023-08-01T19:55:09.510 INFO:teuthology.orchestra.run.smithi155.stdout: "description": "osd_repop_reply(client.4668.0:108023 5.e e38/19 ondisk, result = 0)", 2023-08-01T19:55:09.510 INFO:teuthology.orchestra.run.smithi155.stdout: "initiated_at": "2023-08-01T19:55:09.424089+0000", 2023-08-01T19:55:09.510 INFO:teuthology.orchestra.run.smithi155.stdout: "age": 4294967295.9993176, 2023-08-01T19:55:09.510 INFO:teuthology.orchestra.run.smithi155.stdout: "duration": 0.000215102, 2023-08-01T19:55:09.511 INFO:teuthology.orchestra.run.smithi155.stdout: "type_data": { 2023-08-01T19:55:09.511 INFO:teuthology.orchestra.run.smithi155.stdout: "flag_point": "started", 2023-08-01T19:55:09.511 INFO:teuthology.orchestra.run.smithi155.stdout: "events": [ 2023-08-01T19:55:09.511 INFO:teuthology.orchestra.run.smithi155.stdout: { 2023-08-01T19:55:09.511 INFO:teuthology.orchestra.run.smithi155.stdout: "event": "initiated", 2023-08-01T19:55:09.511 INFO:teuthology.orchestra.run.smithi155.stdout: "time": "2023-08-01T19:55:09.424089+0000", 2023-08-01T19:55:09.511 INFO:teuthology.orchestra.run.smithi155.stdout: "duration": 0 2023-08-01T19:55:09.511 INFO:teuthology.orchestra.run.smithi155.stdout: }, 2023-08-01T19:55:09.512 INFO:teuthology.orchestra.run.smithi155.stdout: { 2023-08-01T19:55:09.512 INFO:teuthology.orchestra.run.smithi155.stdout: "event": "throttled", 2023-08-01T19:55:09.512 INFO:teuthology.orchestra.run.smithi155.stdout: "time": "2023-08-01T19:55:09.424089+0000", 2023-08-01T19:55:09.512 INFO:teuthology.orchestra.run.smithi155.stdout: "duration": 0 2023-08-01T19:55:09.512 INFO:teuthology.orchestra.run.smithi155.stdout: }, 2023-08-01T19:55:09.512 INFO:teuthology.orchestra.run.smithi155.stdout: { 2023-08-01T19:55:09.512 INFO:teuthology.orchestra.run.smithi155.stdout: "event": "header_read", 2023-08-01T19:55:09.512 INFO:teuthology.orchestra.run.smithi155.stdout: "time": "2023-08-01T19:55:09.424088+0000", 2023-08-01T19:55:09.513 INFO:teuthology.orchestra.run.smithi155.stdout: "duration": 4294967295.9999995 2023-08-01T19:55:09.513 INFO:teuthology.orchestra.run.smithi155.stdout: }, 2023-08-01T19:55:09.513 INFO:teuthology.orchestra.run.smithi155.stdout: { 2023-08-01T19:55:09.513 INFO:teuthology.orchestra.run.smithi155.stdout: "event": "all_read", 2023-08-01T19:55:09.513 INFO:teuthology.orchestra.run.smithi155.stdout: "time": "2023-08-01T19:55:09.424093+0000", 2023-08-01T19:55:09.513 INFO:teuthology.orchestra.run.smithi155.stdout: "duration": 4.7219999999999999e-06 2023-08-01T19:55:09.513 INFO:teuthology.orchestra.run.smithi155.stdout: }, 2023-08-01T19:55:09.513 INFO:teuthology.orchestra.run.smithi155.stdout: { 2023-08-01T19:55:09.514 INFO:teuthology.orchestra.run.smithi155.stdout: "event": "dispatched", 2023-08-01T19:55:09.514 INFO:teuthology.orchestra.run.smithi155.stdout: "time": "2023-08-01T19:55:09.424101+0000", 2023-08-01T19:55:09.514 INFO:teuthology.orchestra.run.smithi155.stdout: "duration": 8.0180000000000001e-06 2023-08-01T19:55:09.514 INFO:teuthology.orchestra.run.smithi155.stdout: }, 2023-08-01T19:55:09.514 INFO:teuthology.orchestra.run.smithi155.stdout: { 2023-08-01T19:55:09.514 INFO:teuthology.orchestra.run.smithi155.stdout: "event": "queued_for_pg", 2023-08-01T19:55:09.514 INFO:teuthology.orchestra.run.smithi155.stdout: "time": "2023-08-01T19:55:09.424106+0000", 2023-08-01T19:55:09.514 INFO:teuthology.orchestra.run.smithi155.stdout: "duration": 5.6720000000000001e-06 2023-08-01T19:55:09.515 INFO:teuthology.orchestra.run.smithi155.stdout: }, 2023-08-01T19:55:09.515 INFO:teuthology.orchestra.run.smithi155.stdout: { 2023-08-01T19:55:09.515 INFO:teuthology.orchestra.run.smithi155.stdout: "event": "reached_pg", 2023-08-01T19:55:09.515 INFO:teuthology.orchestra.run.smithi155.stdout: "time": "2023-08-01T19:55:09.424211+0000", 2023-08-01T19:55:09.515 INFO:teuthology.orchestra.run.smithi155.stdout: "duration": 0.000105004 2023-08-01T19:55:09.515 INFO:teuthology.orchestra.run.smithi155.stdout: }, 2023-08-01T19:55:09.515 INFO:teuthology.orchestra.run.smithi155.stdout: { 2023-08-01T19:55:09.515 INFO:teuthology.orchestra.run.smithi155.stdout: "event": "started", 2023-08-01T19:55:09.516 INFO:teuthology.orchestra.run.smithi155.stdout: "time": "2023-08-01T19:55:09.424218+0000", 2023-08-01T19:55:09.516 INFO:teuthology.orchestra.run.smithi155.stdout: "duration": 6.4529999999999999e-06 2023-08-01T19:55:09.516 INFO:teuthology.orchestra.run.smithi155.stdout: } 2023-08-01T19:55:09.516 INFO:teuthology.orchestra.run.smithi155.stdout: ] 2023-08-01T19:55:09.516 INFO:teuthology.orchestra.run.smithi155.stdout: } 2023-08-01T19:55:09.516 INFO:teuthology.orchestra.run.smithi155.stdout: } 2023-08-01T19:55:09.516 INFO:teuthology.orchestra.run.smithi155.stdout: ], 2023-08-01T19:55:09.517 INFO:teuthology.orchestra.run.smithi155.stdout: "num_ops": 12 2023-08-01T19:55:09.517 INFO:teuthology.orchestra.run.smithi155.stdout:} 2023-08-01T19:55:09.518 DEBUG:teuthology.orchestra.run.smithi155:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 30 ceph --cluster ceph --admin-daemon /var/run/ceph/ceph-osd.2.asok dump_blocked_ops 2023-08-01T19:55:09.519 INFO:tasks.ceph.osd.1.smithi101.stderr:2023-08-01T19:55:09.516+0000 7fb0cb7f6700 -1 received signal: Hangup from /usr/bin/python3 /bin/daemon-helper kill ceph-osd -f --cluster ceph -i 1 (PID: 111141) UID: 0 2023-08-01T19:55:09.575 INFO:teuthology.orchestra.run.smithi006.stderr:noscrub is set 2023-08-01T19:55:09.619 INFO:tasks.ceph.osd.0.smithi008.stderr:2023-08-01T19:55:09.618+0000 7f16a58f4700 -1 received signal: Hangup from /usr/bin/python3 /bin/daemon-helper kill ceph-osd -f --cluster ceph -i 0 (PID: 111179) UID: 0 2023-08-01T19:55:09.653 INFO:tasks.thrashosds.thrasher:in_osds: [0, 1, 2] out_osds: [] dead_osds: [] live_osds: [0, 1, 2] 2023-08-01T19:55:09.654 INFO:tasks.thrashosds.thrasher:choose_action: min_in 4 min_out 0 min_live 2 min_dead 0 chance_down 1.00 2023-08-01T19:55:09.654 INFO:tasks.thrashosds.thrasher:primary_affinity 2023-08-01T19:55:09.654 INFO:tasks.thrashosds.thrasher:Setting osd 1 primary_affinity to 0.337637 2023-08-01T19:55:09.654 DEBUG:teuthology.orchestra.run.smithi006:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 120 ceph --cluster ceph osd primary-affinity 1 0.3376369531375635 2023-08-01T19:55:09.682 INFO:teuthology.orchestra.run.smithi155.stdout:{ 2023-08-01T19:55:09.682 INFO:teuthology.orchestra.run.smithi155.stdout: "ops": [], 2023-08-01T19:55:09.682 INFO:teuthology.orchestra.run.smithi155.stdout: "complaint_time": 30, 2023-08-01T19:55:09.683 INFO:teuthology.orchestra.run.smithi155.stdout: "num_blocked_ops": 0 2023-08-01T19:55:09.683 INFO:teuthology.orchestra.run.smithi155.stdout:} 2023-08-01T19:55:09.697 DEBUG:teuthology.orchestra.run.smithi155:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 30 ceph --cluster ceph --admin-daemon /var/run/ceph/ceph-osd.2.asok dump_historic_ops 2023-08-01T19:55:09.740 INFO:tasks.ceph.osd.2.smithi155.stderr:2023-08-01T19:55:09.739+0000 7faa5c6ac700 -1 received signal: Hangup from /usr/bin/python3 /bin/daemon-helper kill ceph-osd -f --cluster ceph -i 2 (PID: 111337) UID: 0 2023-08-01T19:55:09.820 INFO:tasks.ceph.osd.1.smithi101.stderr:2023-08-01T19:55:09.818+0000 7fb0cb7f6700 -1 received signal: Hangup from /usr/bin/python3 /bin/daemon-helper kill ceph-osd -f --cluster ceph -i 1 (PID: 111141) UID: 0 2023-08-01T19:55:09.879 INFO:teuthology.orchestra.run.smithi155.stdout:{ 2023-08-01T19:55:09.880 INFO:teuthology.orchestra.run.smithi155.stdout: "size": 20, 2023-08-01T19:55:09.880 INFO:teuthology.orchestra.run.smithi155.stdout: "duration": 600, 2023-08-01T19:55:09.880 INFO:teuthology.orchestra.run.smithi155.stdout: "ops": [ 2023-08-01T19:55:09.880 INFO:teuthology.orchestra.run.smithi155.stdout: { 2023-08-01T19:55:09.880 INFO:teuthology.orchestra.run.smithi155.stdout: "description": "osd_op(client.4668.0:73454 5.8 5:15596b2f:::benchmark_data_smithi006_114134_object73453:head [set-alloc-hint object_size 65536 write_size 65536,write 0~65536] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e31)", 2023-08-01T19:55:09.881 INFO:teuthology.orchestra.run.smithi155.stdout: "initiated_at": "2023-08-01T19:54:51.460020+0000", 2023-08-01T19:55:09.881 INFO:teuthology.orchestra.run.smithi155.stdout: "age": 18.416328686, 2023-08-01T19:55:09.881 INFO:teuthology.orchestra.run.smithi155.stdout: "duration": 0.022889436999999999, 2023-08-01T19:55:09.881 INFO:teuthology.orchestra.run.smithi155.stdout: "type_data": { 2023-08-01T19:55:09.881 INFO:teuthology.orchestra.run.smithi155.stdout: "flag_point": "commit sent; apply or cleanup", 2023-08-01T19:55:09.881 INFO:teuthology.orchestra.run.smithi155.stdout: "client_info": { 2023-08-01T19:55:09.881 INFO:teuthology.orchestra.run.smithi155.stdout: "client": "client.4668", 2023-08-01T19:55:09.881 INFO:teuthology.orchestra.run.smithi155.stdout: "client_addr": "172.21.15.6:0/1709472247", 2023-08-01T19:55:09.882 INFO:teuthology.orchestra.run.smithi155.stdout: "tid": 73454 2023-08-01T19:55:09.882 INFO:teuthology.orchestra.run.smithi155.stdout: }, 2023-08-01T19:55:09.882 INFO:teuthology.orchestra.run.smithi155.stdout: "events": [ 2023-08-01T19:55:09.882 INFO:teuthology.orchestra.run.smithi155.stdout: { 2023-08-01T19:55:09.882 INFO:teuthology.orchestra.run.smithi155.stdout: "event": "initiated", 2023-08-01T19:55:09.882 INFO:teuthology.orchestra.run.smithi155.stdout: "time": "2023-08-01T19:54:51.460020+0000", 2023-08-01T19:55:09.882 INFO:teuthology.orchestra.run.smithi155.stdout: "duration": 0 2023-08-01T19:55:09.883 INFO:teuthology.orchestra.run.smithi155.stdout: }, 2023-08-01T19:55:09.883 INFO:teuthology.orchestra.run.smithi155.stdout: { 2023-08-01T19:55:09.883 INFO:teuthology.orchestra.run.smithi155.stdout: "event": "throttled", 2023-08-01T19:55:09.883 INFO:teuthology.orchestra.run.smithi155.stdout: "time": "2023-08-01T19:54:51.460020+0000", 2023-08-01T19:55:09.883 INFO:teuthology.orchestra.run.smithi155.stdout: "duration": 0 2023-08-01T19:55:09.883 INFO:teuthology.orchestra.run.smithi155.stdout: }, 2023-08-01T19:55:09.883 INFO:teuthology.orchestra.run.smithi155.stdout: { 2023-08-01T19:55:09.883 INFO:teuthology.orchestra.run.smithi155.stdout: "event": "header_read", 2023-08-01T19:55:09.884 INFO:teuthology.orchestra.run.smithi155.stdout: "time": "2023-08-01T19:54:51.460019+0000", 2023-08-01T19:55:09.884 INFO:teuthology.orchestra.run.smithi155.stdout: "duration": 4294967295.9999995 2023-08-01T19:55:09.884 INFO:teuthology.orchestra.run.smithi155.stdout: }, 2023-08-01T19:55:09.884 INFO:teuthology.orchestra.run.smithi155.stdout: { 2023-08-01T19:55:09.884 INFO:teuthology.orchestra.run.smithi155.stdout: "event": "all_read", 2023-08-01T19:55:09.884 INFO:teuthology.orchestra.run.smithi155.stdout: "time": "2023-08-01T19:54:51.460051+0000", 2023-08-01T19:55:09.884 INFO:teuthology.orchestra.run.smithi155.stdout: "duration": 3.1736000000000002e-05 2023-08-01T19:55:09.884 INFO:teuthology.orchestra.run.smithi155.stdout: }, 2023-08-01T19:55:09.885 INFO:teuthology.orchestra.run.smithi155.stdout: { 2023-08-01T19:55:09.885 INFO:teuthology.orchestra.run.smithi155.stdout: "event": "dispatched", 2023-08-01T19:55:09.885 INFO:teuthology.orchestra.run.smithi155.stdout: "time": "2023-08-01T19:54:51.460058+0000", 2023-08-01T19:55:09.885 INFO:teuthology.orchestra.run.smithi155.stdout: "duration": 7.3869999999999997e-06 2023-08-01T19:55:09.885 INFO:teuthology.orchestra.run.smithi155.stdout: }, 2023-08-01T19:55:09.886 INFO:teuthology.orchestra.run.smithi155.stdout: { 2023-08-01T19:55:09.886 INFO:teuthology.orchestra.run.smithi155.stdout: "event": "queued_for_pg", 2023-08-01T19:55:09.886 INFO:teuthology.orchestra.run.smithi155.stdout: "time": "2023-08-01T19:54:51.460062+0000", 2023-08-01T19:55:09.886 INFO:teuthology.orchestra.run.smithi155.stdout: "duration": 4.352e-06 2023-08-01T19:55:09.886 INFO:teuthology.orchestra.run.smithi155.stdout: }, 2023-08-01T19:55:09.886 INFO:teuthology.orchestra.run.smithi155.stdout: { 2023-08-01T19:55:09.887 INFO:teuthology.orchestra.run.smithi155.stdout: "event": "reached_pg", 2023-08-01T19:55:09.887 INFO:teuthology.orchestra.run.smithi155.stdout: "time": "2023-08-01T19:54:51.460101+0000", 2023-08-01T19:55:09.887 INFO:teuthology.orchestra.run.smithi155.stdout: "duration": 3.8705000000000003e-05 2023-08-01T19:55:09.887 INFO:teuthology.orchestra.run.smithi155.stdout: }, 2023-08-01T19:55:09.887 INFO:teuthology.orchestra.run.smithi155.stdout: { 2023-08-01T19:55:09.888 INFO:teuthology.orchestra.run.smithi155.stdout: "event": "started", 2023-08-01T19:55:09.888 INFO:teuthology.orchestra.run.smithi155.stdout: "time": "2023-08-01T19:54:51.460236+0000", 2023-08-01T19:55:09.888 INFO:teuthology.orchestra.run.smithi155.stdout: "duration": 0.00013463599999999999 2023-08-01T19:55:09.888 INFO:teuthology.orchestra.run.smithi155.stdout: }, 2023-08-01T19:55:09.889 INFO:teuthology.orchestra.run.smithi155.stdout: { 2023-08-01T19:55:09.889 INFO:teuthology.orchestra.run.smithi155.stdout: "event": "waiting for subops from 0", 2023-08-01T19:55:09.889 INFO:teuthology.orchestra.run.smithi155.stdout: "time": "2023-08-01T19:54:51.460391+0000", 2023-08-01T19:55:09.889 INFO:teuthology.orchestra.run.smithi155.stdout: "duration": 0.00015525000000000001 2023-08-01T19:55:09.890 INFO:teuthology.orchestra.run.smithi155.stdout: }, 2023-08-01T19:55:09.890 INFO:teuthology.orchestra.run.smithi155.stdout: { 2023-08-01T19:55:09.890 INFO:teuthology.orchestra.run.smithi155.stdout: "event": "sub_op_commit_rec", 2023-08-01T19:55:09.890 INFO:teuthology.orchestra.run.smithi155.stdout: "time": "2023-08-01T19:54:51.468393+0000", 2023-08-01T19:55:09.890 INFO:teuthology.orchestra.run.smithi155.stdout: "duration": 0.00800208 2023-08-01T19:55:09.890 INFO:teuthology.orchestra.run.smithi155.stdout: }, 2023-08-01T19:55:09.891 INFO:teuthology.orchestra.run.smithi155.stdout: { 2023-08-01T19:55:09.891 INFO:teuthology.orchestra.run.smithi155.stdout: "event": "op_commit", 2023-08-01T19:55:09.891 INFO:teuthology.orchestra.run.smithi155.stdout: "time": "2023-08-01T19:54:51.482815+0000", 2023-08-01T19:55:09.891 INFO:teuthology.orchestra.run.smithi155.stdout: "duration": 0.01442148 2023-08-01T19:55:09.892 INFO:teuthology.orchestra.run.smithi155.stdout: }, 2023-08-01T19:55:09.892 INFO:teuthology.orchestra.run.smithi155.stdout: { 2023-08-01T19:55:09.892 INFO:teuthology.orchestra.run.smithi155.stdout: "event": "commit_sent", 2023-08-01T19:55:09.892 INFO:teuthology.orchestra.run.smithi155.stdout: "time": "2023-08-01T19:54:51.482866+0000", 2023-08-01T19:55:09.892 INFO:teuthology.orchestra.run.smithi155.stdout: "duration": 5.1842999999999998e-05 2023-08-01T19:55:09.892 INFO:teuthology.orchestra.run.smithi155.stdout: }, 2023-08-01T19:55:09.892 INFO:teuthology.orchestra.run.smithi155.stdout: { 2023-08-01T19:55:09.893 INFO:teuthology.orchestra.run.smithi155.stdout: "event": "done", 2023-08-01T19:55:09.893 INFO:teuthology.orchestra.run.smithi155.stdout: "time": "2023-08-01T19:54:51.482909+0000", 2023-08-01T19:55:09.893 INFO:teuthology.orchestra.run.smithi155.stdout: "duration": 4.2663000000000001e-05 2023-08-01T19:55:09.893 INFO:teuthology.orchestra.run.smithi155.stdout: } 2023-08-01T19:55:09.893 INFO:teuthology.orchestra.run.smithi155.stdout: ] 2023-08-01T19:55:09.893 INFO:teuthology.orchestra.run.smithi155.stdout: } 2023-08-01T19:55:09.893 INFO:teuthology.orchestra.run.smithi155.stdout: }, 2023-08-01T19:55:09.893 INFO:teuthology.orchestra.run.smithi155.stdout: { 2023-08-01T19:55:09.894 INFO:teuthology.orchestra.run.smithi155.stdout: "description": "osd_op(client.4668.0:73455 5.b 5:de51121e:::benchmark_data_smithi006_114134_object73454:head [set-alloc-hint object_size 65536 write_size 65536,write 0~65536] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e31)", 2023-08-01T19:55:09.894 INFO:teuthology.orchestra.run.smithi155.stdout: "initiated_at": "2023-08-01T19:54:51.460078+0000", 2023-08-01T19:55:09.894 INFO:teuthology.orchestra.run.smithi155.stdout: "age": 18.416270711999999, 2023-08-01T19:55:09.894 INFO:teuthology.orchestra.run.smithi155.stdout: "duration": 0.022689121999999999, 2023-08-01T19:55:09.894 INFO:teuthology.orchestra.run.smithi155.stdout: "type_data": { 2023-08-01T19:55:09.894 INFO:teuthology.orchestra.run.smithi155.stdout: "flag_point": "commit sent; apply or cleanup", 2023-08-01T19:55:09.894 INFO:teuthology.orchestra.run.smithi155.stdout: "client_info": { 2023-08-01T19:55:09.894 INFO:teuthology.orchestra.run.smithi155.stdout: "client": "client.4668", 2023-08-01T19:55:09.895 INFO:teuthology.orchestra.run.smithi155.stdout: "client_addr": "172.21.15.6:0/1709472247", 2023-08-01T19:55:09.895 INFO:teuthology.orchestra.run.smithi155.stdout: "tid": 73455 2023-08-01T19:55:09.895 INFO:teuthology.orchestra.run.smithi155.stdout: }, 2023-08-01T19:55:09.895 INFO:teuthology.orchestra.run.smithi155.stdout: "events": [ 2023-08-01T19:55:09.895 INFO:teuthology.orchestra.run.smithi155.stdout: { 2023-08-01T19:55:09.895 INFO:teuthology.orchestra.run.smithi155.stdout: "event": "initiated", 2023-08-01T19:55:09.895 INFO:teuthology.orchestra.run.smithi155.stdout: "time": "2023-08-01T19:54:51.460078+0000", 2023-08-01T19:55:09.896 INFO:teuthology.orchestra.run.smithi155.stdout: "duration": 0 2023-08-01T19:55:09.896 INFO:teuthology.orchestra.run.smithi155.stdout: }, 2023-08-01T19:55:09.896 INFO:teuthology.orchestra.run.smithi155.stdout: { 2023-08-01T19:55:09.896 INFO:teuthology.orchestra.run.smithi155.stdout: "event": "throttled", 2023-08-01T19:55:09.896 INFO:teuthology.orchestra.run.smithi155.stdout: "time": "2023-08-01T19:54:51.460078+0000", 2023-08-01T19:55:09.896 INFO:teuthology.orchestra.run.smithi155.stdout: "duration": 0 2023-08-01T19:55:09.896 INFO:teuthology.orchestra.run.smithi155.stdout: }, 2023-08-01T19:55:09.896 INFO:teuthology.orchestra.run.smithi155.stdout: { 2023-08-01T19:55:09.897 INFO:teuthology.orchestra.run.smithi155.stdout: "event": "header_read", 2023-08-01T19:55:09.897 INFO:teuthology.orchestra.run.smithi155.stdout: "time": "2023-08-01T19:54:51.460077+0000", 2023-08-01T19:55:09.897 INFO:teuthology.orchestra.run.smithi155.stdout: "duration": 4294967295.9999995 2023-08-01T19:55:09.897 INFO:teuthology.orchestra.run.smithi155.stdout: }, 2023-08-01T19:55:09.897 INFO:teuthology.orchestra.run.smithi155.stdout: { 2023-08-01T19:55:09.897 INFO:teuthology.orchestra.run.smithi155.stdout: "event": "all_read", 2023-08-01T19:55:09.897 INFO:teuthology.orchestra.run.smithi155.stdout: "time": "2023-08-01T19:54:51.460102+0000", 2023-08-01T19:55:09.897 INFO:teuthology.orchestra.run.smithi155.stdout: "duration": 2.4933e-05 2023-08-01T19:55:09.898 INFO:teuthology.orchestra.run.smithi155.stdout: }, 2023-08-01T19:55:09.898 INFO:teuthology.orchestra.run.smithi155.stdout: { 2023-08-01T19:55:09.898 INFO:teuthology.orchestra.run.smithi155.stdout: "event": "dispatched", 2023-08-01T19:55:09.898 INFO:teuthology.orchestra.run.smithi155.stdout: "time": "2023-08-01T19:54:51.460109+0000", 2023-08-01T19:55:09.898 INFO:teuthology.orchestra.run.smithi155.stdout: "duration": 7.0720000000000002e-06 2023-08-01T19:55:09.898 INFO:teuthology.orchestra.run.smithi155.stdout: }, 2023-08-01T19:55:09.898 INFO:teuthology.orchestra.run.smithi155.stdout: { 2023-08-01T19:55:09.898 INFO:teuthology.orchestra.run.smithi155.stdout: "event": "queued_for_pg", 2023-08-01T19:55:09.899 INFO:teuthology.orchestra.run.smithi155.stdout: "time": "2023-08-01T19:54:51.460113+0000", 2023-08-01T19:55:09.899 INFO:teuthology.orchestra.run.smithi155.stdout: "duration": 4.3220000000000003e-06 2023-08-01T19:55:09.899 INFO:teuthology.orchestra.run.smithi155.stdout: }, 2023-08-01T19:55:09.899 INFO:teuthology.orchestra.run.smithi155.stdout: { 2023-08-01T19:55:09.899 INFO:teuthology.orchestra.run.smithi155.stdout: "event": "reached_pg", 2023-08-01T19:55:09.899 INFO:teuthology.orchestra.run.smithi155.stdout: "time": "2023-08-01T19:54:51.460955+0000", 2023-08-01T19:55:09.899 INFO:teuthology.orchestra.run.smithi155.stdout: "duration": 0.00084142500000000003 2023-08-01T19:55:09.899 INFO:teuthology.orchestra.run.smithi155.stdout: }, 2023-08-01T19:55:09.900 INFO:teuthology.orchestra.run.smithi155.stdout: { 2023-08-01T19:55:09.900 INFO:teuthology.orchestra.run.smithi155.stdout: "event": "started", 2023-08-01T19:55:09.900 INFO:teuthology.orchestra.run.smithi155.stdout: "time": "2023-08-01T19:54:51.461079+0000", 2023-08-01T19:55:09.900 INFO:teuthology.orchestra.run.smithi155.stdout: "duration": 0.000123826 2023-08-01T19:55:09.900 INFO:teuthology.orchestra.run.smithi155.stdout: }, 2023-08-01T19:55:09.900 INFO:teuthology.orchestra.run.smithi155.stdout: { 2023-08-01T19:55:09.900 INFO:teuthology.orchestra.run.smithi155.stdout: "event": "waiting for subops from 0", 2023-08-01T19:55:09.901 INFO:teuthology.orchestra.run.smithi155.stdout: "time": "2023-08-01T19:54:51.461233+0000", 2023-08-01T19:55:09.901 INFO:teuthology.orchestra.run.smithi155.stdout: "duration": 0.00015431900000000001 2023-08-01T19:55:09.901 INFO:teuthology.orchestra.run.smithi155.stdout: }, 2023-08-01T19:55:09.901 INFO:teuthology.orchestra.run.smithi155.stdout: { 2023-08-01T19:55:09.901 INFO:teuthology.orchestra.run.smithi155.stdout: "event": "sub_op_commit_rec", 2023-08-01T19:55:09.901 INFO:teuthology.orchestra.run.smithi155.stdout: "time": "2023-08-01T19:54:51.468509+0000", 2023-08-01T19:55:09.901 INFO:teuthology.orchestra.run.smithi155.stdout: "duration": 0.0072759859999999999 2023-08-01T19:55:09.901 INFO:teuthology.orchestra.run.smithi155.stdout: }, 2023-08-01T19:55:09.902 INFO:teuthology.orchestra.run.smithi155.stdout: { 2023-08-01T19:55:09.902 INFO:teuthology.orchestra.run.smithi155.stdout: "event": "op_commit", 2023-08-01T19:55:09.902 INFO:teuthology.orchestra.run.smithi155.stdout: "time": "2023-08-01T19:54:51.482704+0000", 2023-08-01T19:55:09.902 INFO:teuthology.orchestra.run.smithi155.stdout: "duration": 0.01419545 2023-08-01T19:55:09.902 INFO:teuthology.orchestra.run.smithi155.stdout: }, 2023-08-01T19:55:09.902 INFO:teuthology.orchestra.run.smithi155.stdout: { 2023-08-01T19:55:09.902 INFO:teuthology.orchestra.run.smithi155.stdout: "event": "commit_sent", 2023-08-01T19:55:09.902 INFO:teuthology.orchestra.run.smithi155.stdout: "time": "2023-08-01T19:54:51.482747+0000", 2023-08-01T19:55:09.903 INFO:teuthology.orchestra.run.smithi155.stdout: "duration": 4.2413999999999997e-05 2023-08-01T19:55:09.903 INFO:teuthology.orchestra.run.smithi155.stdout: }, 2023-08-01T19:55:09.903 INFO:teuthology.orchestra.run.smithi155.stdout: { 2023-08-01T19:55:09.903 INFO:teuthology.orchestra.run.smithi155.stdout: "event": "done", 2023-08-01T19:55:09.903 INFO:teuthology.orchestra.run.smithi155.stdout: "time": "2023-08-01T19:54:51.482767+0000", 2023-08-01T19:55:09.903 INFO:teuthology.orchestra.run.smithi155.stdout: "duration": 1.9908999999999999e-05 2023-08-01T19:55:09.903 INFO:teuthology.orchestra.run.smithi155.stdout: } 2023-08-01T19:55:09.903 INFO:teuthology.orchestra.run.smithi155.stdout: ] 2023-08-01T19:55:09.904 INFO:teuthology.orchestra.run.smithi155.stdout: } 2023-08-01T19:55:09.904 INFO:teuthology.orchestra.run.smithi155.stdout: }, 2023-08-01T19:55:09.904 INFO:teuthology.orchestra.run.smithi155.stdout: { 2023-08-01T19:55:09.904 INFO:teuthology.orchestra.run.smithi155.stdout: "description": "osd_op(client.4668.0:73456 5.0 5:0164baf4:::benchmark_data_smithi006_114134_object73455:head [set-alloc-hint object_size 65536 write_size 65536,write 0~65536] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e31)", 2023-08-01T19:55:09.904 INFO:teuthology.orchestra.run.smithi155.stdout: "initiated_at": "2023-08-01T19:54:51.461520+0000", 2023-08-01T19:55:09.904 INFO:teuthology.orchestra.run.smithi155.stdout: "age": 18.414828721999999, 2023-08-01T19:55:09.904 INFO:teuthology.orchestra.run.smithi155.stdout: "duration": 0.023899916, 2023-08-01T19:55:09.904 INFO:teuthology.orchestra.run.smithi155.stdout: "type_data": { 2023-08-01T19:55:09.905 INFO:teuthology.orchestra.run.smithi155.stdout: "flag_point": "commit sent; apply or cleanup", 2023-08-01T19:55:09.905 INFO:teuthology.orchestra.run.smithi155.stdout: "client_info": { 2023-08-01T19:55:09.905 INFO:teuthology.orchestra.run.smithi155.stdout: "client": "client.4668", 2023-08-01T19:55:09.905 INFO:teuthology.orchestra.run.smithi155.stdout: "client_addr": "172.21.15.6:0/1709472247", 2023-08-01T19:55:09.905 INFO:teuthology.orchestra.run.smithi155.stdout: "tid": 73456 2023-08-01T19:55:09.905 INFO:teuthology.orchestra.run.smithi155.stdout: }, 2023-08-01T19:55:09.905 INFO:teuthology.orchestra.run.smithi155.stdout: "events": [ 2023-08-01T19:55:09.905 INFO:teuthology.orchestra.run.smithi155.stdout: { 2023-08-01T19:55:09.906 INFO:teuthology.orchestra.run.smithi155.stdout: "event": "initiated", 2023-08-01T19:55:09.906 INFO:teuthology.orchestra.run.smithi155.stdout: "time": "2023-08-01T19:54:51.461520+0000", 2023-08-01T19:55:09.906 INFO:teuthology.orchestra.run.smithi155.stdout: "duration": 0 2023-08-01T19:55:09.906 INFO:teuthology.orchestra.run.smithi155.stdout: }, 2023-08-01T19:55:09.906 INFO:teuthology.orchestra.run.smithi155.stdout: { 2023-08-01T19:55:09.906 INFO:teuthology.orchestra.run.smithi155.stdout: "event": "throttled", 2023-08-01T19:55:09.906 INFO:teuthology.orchestra.run.smithi155.stdout: "time": "2023-08-01T19:54:51.461520+0000", 2023-08-01T19:55:09.907 INFO:teuthology.orchestra.run.smithi155.stdout: "duration": 0 2023-08-01T19:55:09.907 INFO:teuthology.orchestra.run.smithi155.stdout: }, 2023-08-01T19:55:09.907 INFO:teuthology.orchestra.run.smithi155.stdout: { 2023-08-01T19:55:09.907 INFO:teuthology.orchestra.run.smithi155.stdout: "event": "header_read", 2023-08-01T19:55:09.907 INFO:teuthology.orchestra.run.smithi155.stdout: "time": "2023-08-01T19:54:51.461519+0000", 2023-08-01T19:55:09.907 INFO:teuthology.orchestra.run.smithi155.stdout: "duration": 4294967295.999999 2023-08-01T19:55:09.907 INFO:teuthology.orchestra.run.smithi155.stdout: }, 2023-08-01T19:55:09.907 INFO:teuthology.orchestra.run.smithi155.stdout: { 2023-08-01T19:55:09.908 INFO:teuthology.orchestra.run.smithi155.stdout: "event": "all_read", 2023-08-01T19:55:09.908 INFO:teuthology.orchestra.run.smithi155.stdout: "time": "2023-08-01T19:54:51.461633+0000", 2023-08-01T19:55:09.908 INFO:teuthology.orchestra.run.smithi155.stdout: "duration": 0.000114015 2023-08-01T19:55:09.908 INFO:teuthology.orchestra.run.smithi155.stdout: }, 2023-08-01T19:55:09.908 INFO:teuthology.orchestra.run.smithi155.stdout: { 2023-08-01T19:55:09.908 INFO:teuthology.orchestra.run.smithi155.stdout: "event": "dispatched", 2023-08-01T19:55:09.908 INFO:teuthology.orchestra.run.smithi155.stdout: "time": "2023-08-01T19:54:51.461643+0000", 2023-08-01T19:55:09.908 INFO:teuthology.orchestra.run.smithi155.stdout: "duration": 1.0217000000000001e-05 2023-08-01T19:55:09.909 INFO:teuthology.orchestra.run.smithi155.stdout: }, 2023-08-01T19:55:09.909 INFO:teuthology.orchestra.run.smithi155.stdout: { 2023-08-01T19:55:09.909 INFO:teuthology.orchestra.run.smithi155.stdout: "event": "queued_for_pg", 2023-08-01T19:55:09.909 INFO:teuthology.orchestra.run.smithi155.stdout: "time": "2023-08-01T19:54:51.461649+0000", 2023-08-01T19:55:09.909 INFO:teuthology.orchestra.run.smithi155.stdout: "duration": 5.8850000000000004e-06 2023-08-01T19:55:09.909 INFO:teuthology.orchestra.run.smithi155.stdout: }, 2023-08-01T19:55:09.909 INFO:teuthology.orchestra.run.smithi155.stdout: { 2023-08-01T19:55:09.909 INFO:teuthology.orchestra.run.smithi155.stdout: "event": "reached_pg", 2023-08-01T19:55:09.910 INFO:teuthology.orchestra.run.smithi155.stdout: "time": "2023-08-01T19:54:51.461686+0000", 2023-08-01T19:55:09.910 INFO:teuthology.orchestra.run.smithi155.stdout: "duration": 3.7319e-05 2023-08-01T19:55:09.910 INFO:teuthology.orchestra.run.smithi155.stdout: }, 2023-08-01T19:55:09.910 INFO:teuthology.orchestra.run.smithi155.stdout: { 2023-08-01T19:55:09.910 INFO:teuthology.orchestra.run.smithi155.stdout: "event": "started", 2023-08-01T19:55:09.910 INFO:teuthology.orchestra.run.smithi155.stdout: "time": "2023-08-01T19:54:51.461802+0000", 2023-08-01T19:55:09.910 INFO:teuthology.orchestra.run.smithi155.stdout: "duration": 0.000115604 2023-08-01T19:55:09.911 INFO:teuthology.orchestra.run.smithi155.stdout: }, 2023-08-01T19:55:09.911 INFO:teuthology.orchestra.run.smithi155.stdout: { 2023-08-01T19:55:09.911 INFO:teuthology.orchestra.run.smithi155.stdout: "event": "waiting for subops from 0", 2023-08-01T19:55:09.911 INFO:teuthology.orchestra.run.smithi155.stdout: "time": "2023-08-01T19:54:51.461933+0000", 2023-08-01T19:55:09.911 INFO:teuthology.orchestra.run.smithi155.stdout: "duration": 0.000131175 2023-08-01T19:55:09.911 INFO:teuthology.orchestra.run.smithi155.stdout: }, 2023-08-01T19:55:09.911 INFO:teuthology.orchestra.run.smithi155.stdout: { 2023-08-01T19:55:09.911 INFO:teuthology.orchestra.run.smithi155.stdout: "event": "sub_op_commit_rec", 2023-08-01T19:55:09.912 INFO:teuthology.orchestra.run.smithi155.stdout: "time": "2023-08-01T19:54:51.468411+0000", 2023-08-01T19:55:09.912 INFO:teuthology.orchestra.run.smithi155.stdout: "duration": 0.0064775850000000001 2023-08-01T19:55:09.912 INFO:teuthology.orchestra.run.smithi155.stdout: }, 2023-08-01T19:55:09.912 INFO:teuthology.orchestra.run.smithi155.stdout: { 2023-08-01T19:55:09.912 INFO:teuthology.orchestra.run.smithi155.stdout: "event": "op_commit", 2023-08-01T19:55:09.912 INFO:teuthology.orchestra.run.smithi155.stdout: "time": "2023-08-01T19:54:51.485340+0000", 2023-08-01T19:55:09.912 INFO:teuthology.orchestra.run.smithi155.stdout: "duration": 0.016928907 2023-08-01T19:55:09.912 INFO:teuthology.orchestra.run.smithi155.stdout: }, 2023-08-01T19:55:09.913 INFO:teuthology.orchestra.run.smithi155.stdout: { 2023-08-01T19:55:09.913 INFO:teuthology.orchestra.run.smithi155.stdout: "event": "commit_sent", 2023-08-01T19:55:09.913 INFO:teuthology.orchestra.run.smithi155.stdout: "time": "2023-08-01T19:54:51.485385+0000", 2023-08-01T19:55:09.913 INFO:teuthology.orchestra.run.smithi155.stdout: "duration": 4.5222000000000002e-05 2023-08-01T19:55:09.913 INFO:teuthology.orchestra.run.smithi155.stdout: }, 2023-08-01T19:55:09.913 INFO:teuthology.orchestra.run.smithi155.stdout: { 2023-08-01T19:55:09.913 INFO:teuthology.orchestra.run.smithi155.stdout: "event": "done", 2023-08-01T19:55:09.913 INFO:teuthology.orchestra.run.smithi155.stdout: "time": "2023-08-01T19:54:51.485420+0000", 2023-08-01T19:55:09.914 INFO:teuthology.orchestra.run.smithi155.stdout: "duration": 3.4717e-05 2023-08-01T19:55:09.914 INFO:teuthology.orchestra.run.smithi155.stdout: } 2023-08-01T19:55:09.914 INFO:teuthology.orchestra.run.smithi155.stdout: ] 2023-08-01T19:55:09.914 INFO:teuthology.orchestra.run.smithi155.stdout: } 2023-08-01T19:55:09.914 INFO:teuthology.orchestra.run.smithi155.stdout: }, 2023-08-01T19:55:09.914 INFO:teuthology.orchestra.run.smithi155.stdout: { 2023-08-01T19:55:09.914 INFO:teuthology.orchestra.run.smithi155.stdout: "description": "osd_op(client.4668.0:100237 5.4 5:2d68bec9:::benchmark_data_smithi006_114134_object100236:head [set-alloc-hint object_size 65536 write_size 65536,write 0~65536] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e37)", 2023-08-01T19:55:09.914 INFO:teuthology.orchestra.run.smithi155.stdout: "initiated_at": "2023-08-01T19:55:05.147736+0000", 2023-08-01T19:55:09.915 INFO:teuthology.orchestra.run.smithi155.stdout: "age": 4.7286120089999999, 2023-08-01T19:55:09.915 INFO:teuthology.orchestra.run.smithi155.stdout: "duration": 0.071299464000000007, 2023-08-01T19:55:09.915 INFO:teuthology.orchestra.run.smithi155.stdout: "type_data": { 2023-08-01T19:55:09.915 INFO:teuthology.orchestra.run.smithi155.stdout: "flag_point": "commit sent; apply or cleanup", 2023-08-01T19:55:09.915 INFO:teuthology.orchestra.run.smithi155.stdout: "client_info": { 2023-08-01T19:55:09.915 INFO:teuthology.orchestra.run.smithi155.stdout: "client": "client.4668", 2023-08-01T19:55:09.915 INFO:teuthology.orchestra.run.smithi155.stdout: "client_addr": "172.21.15.6:0/1709472247", 2023-08-01T19:55:09.915 INFO:teuthology.orchestra.run.smithi155.stdout: "tid": 100237 2023-08-01T19:55:09.916 INFO:teuthology.orchestra.run.smithi155.stdout: }, 2023-08-01T19:55:09.916 INFO:teuthology.orchestra.run.smithi155.stdout: "events": [ 2023-08-01T19:55:09.916 INFO:teuthology.orchestra.run.smithi155.stdout: { 2023-08-01T19:55:09.916 INFO:teuthology.orchestra.run.smithi155.stdout: "event": "initiated", 2023-08-01T19:55:09.916 INFO:teuthology.orchestra.run.smithi155.stdout: "time": "2023-08-01T19:55:05.147736+0000", 2023-08-01T19:55:09.916 INFO:teuthology.orchestra.run.smithi155.stdout: "duration": 0 2023-08-01T19:55:09.916 INFO:teuthology.orchestra.run.smithi155.stdout: }, 2023-08-01T19:55:09.917 INFO:teuthology.orchestra.run.smithi155.stdout: { 2023-08-01T19:55:09.917 INFO:teuthology.orchestra.run.smithi155.stdout: "event": "throttled", 2023-08-01T19:55:09.917 INFO:teuthology.orchestra.run.smithi155.stdout: "time": "2023-08-01T19:55:05.147736+0000", 2023-08-01T19:55:09.917 INFO:teuthology.orchestra.run.smithi155.stdout: "duration": 0 2023-08-01T19:55:09.917 INFO:teuthology.orchestra.run.smithi155.stdout: }, 2023-08-01T19:55:09.917 INFO:teuthology.orchestra.run.smithi155.stdout: { 2023-08-01T19:55:09.917 INFO:teuthology.orchestra.run.smithi155.stdout: "event": "header_read", 2023-08-01T19:55:09.917 INFO:teuthology.orchestra.run.smithi155.stdout: "time": "2023-08-01T19:55:05.147736+0000", 2023-08-01T19:55:09.918 INFO:teuthology.orchestra.run.smithi155.stdout: "duration": 4294967295.9999995 2023-08-01T19:55:09.918 INFO:teuthology.orchestra.run.smithi155.stdout: }, 2023-08-01T19:55:09.918 INFO:teuthology.orchestra.run.smithi155.stdout: { 2023-08-01T19:55:09.918 INFO:teuthology.orchestra.run.smithi155.stdout: "event": "all_read", 2023-08-01T19:55:09.918 INFO:teuthology.orchestra.run.smithi155.stdout: "time": "2023-08-01T19:55:05.147766+0000", 2023-08-01T19:55:09.918 INFO:teuthology.orchestra.run.smithi155.stdout: "duration": 3.0394000000000001e-05 2023-08-01T19:55:09.918 INFO:teuthology.orchestra.run.smithi155.stdout: }, 2023-08-01T19:55:09.918 INFO:teuthology.orchestra.run.smithi155.stdout: { 2023-08-01T19:55:09.919 INFO:teuthology.orchestra.run.smithi155.stdout: "event": "dispatched", 2023-08-01T19:55:09.919 INFO:teuthology.orchestra.run.smithi155.stdout: "time": "2023-08-01T19:55:05.147771+0000", 2023-08-01T19:55:09.919 INFO:teuthology.orchestra.run.smithi155.stdout: "duration": 4.25e-06 2023-08-01T19:55:09.919 INFO:teuthology.orchestra.run.smithi155.stdout: }, 2023-08-01T19:55:09.919 INFO:teuthology.orchestra.run.smithi155.stdout: { 2023-08-01T19:55:09.919 INFO:teuthology.orchestra.run.smithi155.stdout: "event": "queued_for_pg", 2023-08-01T19:55:09.919 INFO:teuthology.orchestra.run.smithi155.stdout: "time": "2023-08-01T19:55:05.147773+0000", 2023-08-01T19:55:09.919 INFO:teuthology.orchestra.run.smithi155.stdout: "duration": 2.4159999999999998e-06 2023-08-01T19:55:09.920 INFO:teuthology.orchestra.run.smithi155.stdout: }, 2023-08-01T19:55:09.920 INFO:teuthology.orchestra.run.smithi155.stdout: { 2023-08-01T19:55:09.920 INFO:teuthology.orchestra.run.smithi155.stdout: "event": "reached_pg", 2023-08-01T19:55:09.920 INFO:teuthology.orchestra.run.smithi155.stdout: "time": "2023-08-01T19:55:05.149903+0000", 2023-08-01T19:55:09.920 INFO:teuthology.orchestra.run.smithi155.stdout: "duration": 0.002129948 2023-08-01T19:55:09.920 INFO:teuthology.orchestra.run.smithi155.stdout: }, 2023-08-01T19:55:09.920 INFO:teuthology.orchestra.run.smithi155.stdout: { 2023-08-01T19:55:09.920 INFO:teuthology.orchestra.run.smithi155.stdout: "event": "started", 2023-08-01T19:55:09.921 INFO:teuthology.orchestra.run.smithi155.stdout: "time": "2023-08-01T19:55:05.149982+0000", 2023-08-01T19:55:09.921 INFO:teuthology.orchestra.run.smithi155.stdout: "duration": 7.8706000000000002e-05 2023-08-01T19:55:09.921 INFO:teuthology.orchestra.run.smithi155.stdout: }, 2023-08-01T19:55:09.921 INFO:teuthology.orchestra.run.smithi155.stdout: { 2023-08-01T19:55:09.921 INFO:teuthology.orchestra.run.smithi155.stdout: "event": "waiting for subops from 0", 2023-08-01T19:55:09.921 INFO:teuthology.orchestra.run.smithi155.stdout: "time": "2023-08-01T19:55:05.150066+0000", 2023-08-01T19:55:09.921 INFO:teuthology.orchestra.run.smithi155.stdout: "duration": 8.4241999999999997e-05 2023-08-01T19:55:09.922 INFO:teuthology.orchestra.run.smithi155.stdout: }, 2023-08-01T19:55:09.922 INFO:teuthology.orchestra.run.smithi155.stdout: { 2023-08-01T19:55:09.922 INFO:teuthology.orchestra.run.smithi155.stdout: "event": "op_commit", 2023-08-01T19:55:09.922 INFO:teuthology.orchestra.run.smithi155.stdout: "time": "2023-08-01T19:55:05.154994+0000", 2023-08-01T19:55:09.922 INFO:teuthology.orchestra.run.smithi155.stdout: "duration": 0.0049277050000000001 2023-08-01T19:55:09.922 INFO:teuthology.orchestra.run.smithi155.stdout: }, 2023-08-01T19:55:09.922 INFO:teuthology.orchestra.run.smithi155.stdout: { 2023-08-01T19:55:09.922 INFO:teuthology.orchestra.run.smithi155.stdout: "event": "sub_op_commit_rec", 2023-08-01T19:55:09.923 INFO:teuthology.orchestra.run.smithi155.stdout: "time": "2023-08-01T19:55:05.218933+0000", 2023-08-01T19:55:09.923 INFO:teuthology.orchestra.run.smithi155.stdout: "duration": 0.063939916999999999 2023-08-01T19:55:09.923 INFO:teuthology.orchestra.run.smithi155.stdout: }, 2023-08-01T19:55:09.923 INFO:teuthology.orchestra.run.smithi155.stdout: { 2023-08-01T19:55:09.923 INFO:teuthology.orchestra.run.smithi155.stdout: "event": "commit_sent", 2023-08-01T19:55:09.923 INFO:teuthology.orchestra.run.smithi155.stdout: "time": "2023-08-01T19:55:05.218989+0000", 2023-08-01T19:55:09.923 INFO:teuthology.orchestra.run.smithi155.stdout: "duration": 5.5772000000000001e-05 2023-08-01T19:55:09.923 INFO:teuthology.orchestra.run.smithi155.stdout: }, 2023-08-01T19:55:09.924 INFO:teuthology.orchestra.run.smithi155.stdout: { 2023-08-01T19:55:09.924 INFO:teuthology.orchestra.run.smithi155.stdout: "event": "done", 2023-08-01T19:55:09.924 INFO:teuthology.orchestra.run.smithi155.stdout: "time": "2023-08-01T19:55:05.219036+0000", 2023-08-01T19:55:09.924 INFO:teuthology.orchestra.run.smithi155.stdout: "duration": 4.6526000000000001e-05 2023-08-01T19:55:09.924 INFO:teuthology.orchestra.run.smithi155.stdout: } 2023-08-01T19:55:09.924 INFO:teuthology.orchestra.run.smithi155.stdout: ] 2023-08-01T19:55:09.924 INFO:teuthology.orchestra.run.smithi155.stdout: } 2023-08-01T19:55:09.924 INFO:teuthology.orchestra.run.smithi155.stdout: }, 2023-08-01T19:55:09.925 INFO:teuthology.orchestra.run.smithi155.stdout: { 2023-08-01T19:55:09.925 INFO:teuthology.orchestra.run.smithi155.stdout: "description": "osd_op(client.4668.0:100242 5.8 5:16a314b8:::benchmark_data_smithi006_114134_object100241:head [set-alloc-hint object_size 65536 write_size 65536,write 0~65536] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e37)", 2023-08-01T19:55:09.925 INFO:teuthology.orchestra.run.smithi155.stdout: "initiated_at": "2023-08-01T19:55:05.150616+0000", 2023-08-01T19:55:09.925 INFO:teuthology.orchestra.run.smithi155.stdout: "age": 4.7257323790000001, 2023-08-01T19:55:09.925 INFO:teuthology.orchestra.run.smithi155.stdout: "duration": 0.071105065999999995, 2023-08-01T19:55:09.925 INFO:teuthology.orchestra.run.smithi155.stdout: "type_data": { 2023-08-01T19:55:09.925 INFO:teuthology.orchestra.run.smithi155.stdout: "flag_point": "commit sent; apply or cleanup", 2023-08-01T19:55:09.925 INFO:teuthology.orchestra.run.smithi155.stdout: "client_info": { 2023-08-01T19:55:09.926 INFO:teuthology.orchestra.run.smithi155.stdout: "client": "client.4668", 2023-08-01T19:55:09.926 INFO:teuthology.orchestra.run.smithi155.stdout: "client_addr": "172.21.15.6:0/1709472247", 2023-08-01T19:55:09.926 INFO:teuthology.orchestra.run.smithi155.stdout: "tid": 100242 2023-08-01T19:55:09.926 INFO:teuthology.orchestra.run.smithi155.stdout: }, 2023-08-01T19:55:09.926 INFO:teuthology.orchestra.run.smithi155.stdout: "events": [ 2023-08-01T19:55:09.926 INFO:teuthology.orchestra.run.smithi155.stdout: { 2023-08-01T19:55:09.926 INFO:teuthology.orchestra.run.smithi155.stdout: "event": "initiated", 2023-08-01T19:55:09.927 INFO:teuthology.orchestra.run.smithi155.stdout: "time": "2023-08-01T19:55:05.150616+0000", 2023-08-01T19:55:09.927 INFO:teuthology.orchestra.run.smithi155.stdout: "duration": 0 2023-08-01T19:55:09.927 INFO:teuthology.orchestra.run.smithi155.stdout: }, 2023-08-01T19:55:09.927 INFO:teuthology.orchestra.run.smithi155.stdout: { 2023-08-01T19:55:09.927 INFO:teuthology.orchestra.run.smithi155.stdout: "event": "throttled", 2023-08-01T19:55:09.928 INFO:teuthology.orchestra.run.smithi155.stdout: "time": "2023-08-01T19:55:05.150616+0000", 2023-08-01T19:55:09.928 INFO:teuthology.orchestra.run.smithi155.stdout: "duration": 0 2023-08-01T19:55:09.928 INFO:teuthology.orchestra.run.smithi155.stdout: }, 2023-08-01T19:55:09.928 INFO:teuthology.orchestra.run.smithi155.stdout: { 2023-08-01T19:55:09.928 INFO:teuthology.orchestra.run.smithi155.stdout: "event": "header_read", 2023-08-01T19:55:09.928 INFO:teuthology.orchestra.run.smithi155.stdout: "time": "2023-08-01T19:55:05.150615+0000", 2023-08-01T19:55:09.928 INFO:teuthology.orchestra.run.smithi155.stdout: "duration": 4294967295.999999 2023-08-01T19:55:09.929 INFO:teuthology.orchestra.run.smithi155.stdout: }, 2023-08-01T19:55:09.929 INFO:teuthology.orchestra.run.smithi155.stdout: { 2023-08-01T19:55:09.929 INFO:teuthology.orchestra.run.smithi155.stdout: "event": "all_read", 2023-08-01T19:55:09.929 INFO:teuthology.orchestra.run.smithi155.stdout: "time": "2023-08-01T19:55:05.150696+0000", 2023-08-01T19:55:09.929 INFO:teuthology.orchestra.run.smithi155.stdout: "duration": 8.0852000000000004e-05 2023-08-01T19:55:09.929 INFO:teuthology.orchestra.run.smithi155.stdout: }, 2023-08-01T19:55:09.929 INFO:teuthology.orchestra.run.smithi155.stdout: { 2023-08-01T19:55:09.929 INFO:teuthology.orchestra.run.smithi155.stdout: "event": "dispatched", 2023-08-01T19:55:09.930 INFO:teuthology.orchestra.run.smithi155.stdout: "time": "2023-08-01T19:55:05.150708+0000", 2023-08-01T19:55:09.930 INFO:teuthology.orchestra.run.smithi155.stdout: "duration": 1.2116999999999999e-05 2023-08-01T19:55:09.930 INFO:teuthology.orchestra.run.smithi155.stdout: }, 2023-08-01T19:55:09.930 INFO:teuthology.orchestra.run.smithi155.stdout: { 2023-08-01T19:55:09.930 INFO:teuthology.orchestra.run.smithi155.stdout: "event": "queued_for_pg", 2023-08-01T19:55:09.930 INFO:teuthology.orchestra.run.smithi155.stdout: "time": "2023-08-01T19:55:05.150713+0000", 2023-08-01T19:55:09.930 INFO:teuthology.orchestra.run.smithi155.stdout: "duration": 5.4620000000000004e-06 2023-08-01T19:55:09.930 INFO:teuthology.orchestra.run.smithi155.stdout: }, 2023-08-01T19:55:09.931 INFO:teuthology.orchestra.run.smithi155.stdout: { 2023-08-01T19:55:09.931 INFO:teuthology.orchestra.run.smithi155.stdout: "event": "reached_pg", 2023-08-01T19:55:09.931 INFO:teuthology.orchestra.run.smithi155.stdout: "time": "2023-08-01T19:55:05.150761+0000", 2023-08-01T19:55:09.931 INFO:teuthology.orchestra.run.smithi155.stdout: "duration": 4.7429000000000003e-05 2023-08-01T19:55:09.931 INFO:teuthology.orchestra.run.smithi155.stdout: }, 2023-08-01T19:55:09.931 INFO:teuthology.orchestra.run.smithi155.stdout: { 2023-08-01T19:55:09.931 INFO:teuthology.orchestra.run.smithi155.stdout: "event": "started", 2023-08-01T19:55:09.931 INFO:teuthology.orchestra.run.smithi155.stdout: "time": "2023-08-01T19:55:05.150856+0000", 2023-08-01T19:55:09.932 INFO:teuthology.orchestra.run.smithi155.stdout: "duration": 9.5356e-05 2023-08-01T19:55:09.932 INFO:teuthology.orchestra.run.smithi155.stdout: }, 2023-08-01T19:55:09.932 INFO:teuthology.orchestra.run.smithi155.stdout: { 2023-08-01T19:55:09.932 INFO:teuthology.orchestra.run.smithi155.stdout: "event": "waiting for subops from 0", 2023-08-01T19:55:09.932 INFO:teuthology.orchestra.run.smithi155.stdout: "time": "2023-08-01T19:55:05.150999+0000", 2023-08-01T19:55:09.932 INFO:teuthology.orchestra.run.smithi155.stdout: "duration": 0.00014234499999999999 2023-08-01T19:55:09.932 INFO:teuthology.orchestra.run.smithi155.stdout: }, 2023-08-01T19:55:09.933 INFO:teuthology.orchestra.run.smithi155.stdout: { 2023-08-01T19:55:09.933 INFO:teuthology.orchestra.run.smithi155.stdout: "event": "sub_op_commit_rec", 2023-08-01T19:55:09.933 INFO:teuthology.orchestra.run.smithi155.stdout: "time": "2023-08-01T19:55:05.219001+0000", 2023-08-01T19:55:09.933 INFO:teuthology.orchestra.run.smithi155.stdout: "duration": 0.068002776000000001 2023-08-01T19:55:09.933 INFO:teuthology.orchestra.run.smithi155.stdout: }, 2023-08-01T19:55:09.933 INFO:teuthology.orchestra.run.smithi155.stdout: { 2023-08-01T19:55:09.933 INFO:teuthology.orchestra.run.smithi155.stdout: "event": "op_commit", 2023-08-01T19:55:09.934 INFO:teuthology.orchestra.run.smithi155.stdout: "time": "2023-08-01T19:55:05.221635+0000", 2023-08-01T19:55:09.934 INFO:teuthology.orchestra.run.smithi155.stdout: "duration": 0.0026340579999999999 2023-08-01T19:55:09.934 INFO:teuthology.orchestra.run.smithi155.stdout: }, 2023-08-01T19:55:09.934 INFO:teuthology.orchestra.run.smithi155.stdout: { 2023-08-01T19:55:09.934 INFO:teuthology.orchestra.run.smithi155.stdout: "event": "commit_sent", 2023-08-01T19:55:09.935 INFO:teuthology.orchestra.run.smithi155.stdout: "time": "2023-08-01T19:55:05.221682+0000", 2023-08-01T19:55:09.935 INFO:teuthology.orchestra.run.smithi155.stdout: "duration": 4.7123999999999998e-05 2023-08-01T19:55:09.935 INFO:teuthology.orchestra.run.smithi155.stdout: }, 2023-08-01T19:55:09.935 INFO:teuthology.orchestra.run.smithi155.stdout: { 2023-08-01T19:55:09.935 INFO:teuthology.orchestra.run.smithi155.stdout: "event": "done", 2023-08-01T19:55:09.935 INFO:teuthology.orchestra.run.smithi155.stdout: "time": "2023-08-01T19:55:05.221721+0000", 2023-08-01T19:55:09.935 INFO:teuthology.orchestra.run.smithi155.stdout: "duration": 3.8529999999999999e-05 2023-08-01T19:55:09.935 INFO:teuthology.orchestra.run.smithi155.stdout: } 2023-08-01T19:55:09.936 INFO:teuthology.orchestra.run.smithi155.stdout: ] 2023-08-01T19:55:09.936 INFO:teuthology.orchestra.run.smithi155.stdout: } 2023-08-01T19:55:09.936 INFO:teuthology.orchestra.run.smithi155.stdout: }, 2023-08-01T19:55:09.936 INFO:teuthology.orchestra.run.smithi155.stdout: { 2023-08-01T19:55:09.936 INFO:teuthology.orchestra.run.smithi155.stdout: "description": "osd_repop(client.4668.0:100240 5.a e37/19 5:5313c5b9:::benchmark_data_smithi006_114134_object100239:head v 37'6227, mlcod=37'6225)", 2023-08-01T19:55:09.936 INFO:teuthology.orchestra.run.smithi155.stdout: "initiated_at": "2023-08-01T19:55:05.150778+0000", 2023-08-01T19:55:09.936 INFO:teuthology.orchestra.run.smithi155.stdout: "age": 4.7255701779999999, 2023-08-01T19:55:09.936 INFO:teuthology.orchestra.run.smithi155.stdout: "duration": 0.073362533999999993, 2023-08-01T19:55:09.937 INFO:teuthology.orchestra.run.smithi155.stdout: "type_data": { 2023-08-01T19:55:09.937 INFO:teuthology.orchestra.run.smithi155.stdout: "flag_point": "commit sent; apply or cleanup", 2023-08-01T19:55:09.937 INFO:teuthology.orchestra.run.smithi155.stdout: "events": [ 2023-08-01T19:55:09.937 INFO:teuthology.orchestra.run.smithi155.stdout: { 2023-08-01T19:55:09.937 INFO:teuthology.orchestra.run.smithi155.stdout: "event": "initiated", 2023-08-01T19:55:09.937 INFO:teuthology.orchestra.run.smithi155.stdout: "time": "2023-08-01T19:55:05.150778+0000", 2023-08-01T19:55:09.937 INFO:teuthology.orchestra.run.smithi155.stdout: "duration": 0 2023-08-01T19:55:09.938 INFO:teuthology.orchestra.run.smithi155.stdout: }, 2023-08-01T19:55:09.938 INFO:teuthology.orchestra.run.smithi155.stdout: { 2023-08-01T19:55:09.938 INFO:teuthology.orchestra.run.smithi155.stdout: "event": "throttled", 2023-08-01T19:55:09.938 INFO:teuthology.orchestra.run.smithi155.stdout: "time": "2023-08-01T19:55:05.150778+0000", 2023-08-01T19:55:09.938 INFO:teuthology.orchestra.run.smithi155.stdout: "duration": 0 2023-08-01T19:55:09.938 INFO:teuthology.orchestra.run.smithi155.stdout: }, 2023-08-01T19:55:09.938 INFO:teuthology.orchestra.run.smithi155.stdout: { 2023-08-01T19:55:09.938 INFO:teuthology.orchestra.run.smithi155.stdout: "event": "header_read", 2023-08-01T19:55:09.939 INFO:teuthology.orchestra.run.smithi155.stdout: "time": "2023-08-01T19:55:05.150778+0000", 2023-08-01T19:55:09.939 INFO:teuthology.orchestra.run.smithi155.stdout: "duration": 4294967295.9999995 2023-08-01T19:55:09.939 INFO:teuthology.orchestra.run.smithi155.stdout: }, 2023-08-01T19:55:09.939 INFO:teuthology.orchestra.run.smithi155.stdout: { 2023-08-01T19:55:09.939 INFO:teuthology.orchestra.run.smithi155.stdout: "event": "all_read", 2023-08-01T19:55:09.939 INFO:teuthology.orchestra.run.smithi155.stdout: "time": "2023-08-01T19:55:05.150811+0000", 2023-08-01T19:55:09.939 INFO:teuthology.orchestra.run.smithi155.stdout: "duration": 3.3664000000000002e-05 2023-08-01T19:55:09.939 INFO:teuthology.orchestra.run.smithi155.stdout: }, 2023-08-01T19:55:09.940 INFO:teuthology.orchestra.run.smithi155.stdout: { 2023-08-01T19:55:09.940 INFO:teuthology.orchestra.run.smithi155.stdout: "event": "dispatched", 2023-08-01T19:55:09.940 INFO:teuthology.orchestra.run.smithi155.stdout: "time": "2023-08-01T19:55:05.150818+0000", 2023-08-01T19:55:09.940 INFO:teuthology.orchestra.run.smithi155.stdout: "duration": 6.5769999999999999e-06 2023-08-01T19:55:09.940 INFO:teuthology.orchestra.run.smithi155.stdout: }, 2023-08-01T19:55:09.940 INFO:teuthology.orchestra.run.smithi155.stdout: { 2023-08-01T19:55:09.940 INFO:teuthology.orchestra.run.smithi155.stdout: "event": "queued_for_pg", 2023-08-01T19:55:09.940 INFO:teuthology.orchestra.run.smithi155.stdout: "time": "2023-08-01T19:55:05.150822+0000", 2023-08-01T19:55:09.941 INFO:teuthology.orchestra.run.smithi155.stdout: "duration": 4.0060000000000003e-06 2023-08-01T19:55:09.941 INFO:teuthology.orchestra.run.smithi155.stdout: }, 2023-08-01T19:55:09.941 INFO:teuthology.orchestra.run.smithi155.stdout: { 2023-08-01T19:55:09.941 INFO:teuthology.orchestra.run.smithi155.stdout: "event": "reached_pg", 2023-08-01T19:55:09.941 INFO:teuthology.orchestra.run.smithi155.stdout: "time": "2023-08-01T19:55:05.150855+0000", 2023-08-01T19:55:09.941 INFO:teuthology.orchestra.run.smithi155.stdout: "duration": 3.3204999999999998e-05 2023-08-01T19:55:09.941 INFO:teuthology.orchestra.run.smithi155.stdout: }, 2023-08-01T19:55:09.941 INFO:teuthology.orchestra.run.smithi155.stdout: { 2023-08-01T19:55:09.942 INFO:teuthology.orchestra.run.smithi155.stdout: "event": "started", 2023-08-01T19:55:09.942 INFO:teuthology.orchestra.run.smithi155.stdout: "time": "2023-08-01T19:55:05.150873+0000", 2023-08-01T19:55:09.942 INFO:teuthology.orchestra.run.smithi155.stdout: "duration": 1.8139999999999999e-05 2023-08-01T19:55:09.942 INFO:teuthology.orchestra.run.smithi155.stdout: }, 2023-08-01T19:55:09.942 INFO:teuthology.orchestra.run.smithi155.stdout: { 2023-08-01T19:55:09.942 INFO:teuthology.orchestra.run.smithi155.stdout: "event": "commit_sent", 2023-08-01T19:55:09.942 INFO:teuthology.orchestra.run.smithi155.stdout: "time": "2023-08-01T19:55:05.224095+0000", 2023-08-01T19:55:09.943 INFO:teuthology.orchestra.run.smithi155.stdout: "duration": 0.073221895999999995 2023-08-01T19:55:09.943 INFO:teuthology.orchestra.run.smithi155.stdout: }, 2023-08-01T19:55:09.943 INFO:teuthology.orchestra.run.smithi155.stdout: { 2023-08-01T19:55:09.943 INFO:teuthology.orchestra.run.smithi155.stdout: "event": "done", 2023-08-01T19:55:09.943 INFO:teuthology.orchestra.run.smithi155.stdout: "time": "2023-08-01T19:55:05.224141+0000", 2023-08-01T19:55:09.943 INFO:teuthology.orchestra.run.smithi155.stdout: "duration": 4.5385e-05 2023-08-01T19:55:09.943 INFO:teuthology.orchestra.run.smithi155.stdout: } 2023-08-01T19:55:09.943 INFO:teuthology.orchestra.run.smithi155.stdout: ] 2023-08-01T19:55:09.944 INFO:teuthology.orchestra.run.smithi155.stdout: } 2023-08-01T19:55:09.944 INFO:teuthology.orchestra.run.smithi155.stdout: }, 2023-08-01T19:55:09.944 INFO:teuthology.orchestra.run.smithi155.stdout: { 2023-08-01T19:55:09.944 INFO:teuthology.orchestra.run.smithi155.stdout: "description": "osd_op(client.4668.0:100245 5.e 5:71869c66:::benchmark_data_smithi006_114134_object100244:head [set-alloc-hint object_size 65536 write_size 65536,write 0~65536] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e37)", 2023-08-01T19:55:09.944 INFO:teuthology.orchestra.run.smithi155.stdout: "initiated_at": "2023-08-01T19:55:05.150991+0000", 2023-08-01T19:55:09.944 INFO:teuthology.orchestra.run.smithi155.stdout: "age": 4.7253573910000002, 2023-08-01T19:55:09.944 INFO:teuthology.orchestra.run.smithi155.stdout: "duration": 0.070734490999999997, 2023-08-01T19:55:09.944 INFO:teuthology.orchestra.run.smithi155.stdout: "type_data": { 2023-08-01T19:55:09.945 INFO:teuthology.orchestra.run.smithi155.stdout: "flag_point": "commit sent; apply or cleanup", 2023-08-01T19:55:09.945 INFO:teuthology.orchestra.run.smithi155.stdout: "client_info": { 2023-08-01T19:55:09.945 INFO:teuthology.orchestra.run.smithi155.stdout: "client": "client.4668", 2023-08-01T19:55:09.945 INFO:teuthology.orchestra.run.smithi155.stdout: "client_addr": "172.21.15.6:0/1709472247", 2023-08-01T19:55:09.945 INFO:teuthology.orchestra.run.smithi155.stdout: "tid": 100245 2023-08-01T19:55:09.945 INFO:teuthology.orchestra.run.smithi155.stdout: }, 2023-08-01T19:55:09.945 INFO:teuthology.orchestra.run.smithi155.stdout: "events": [ 2023-08-01T19:55:09.945 INFO:teuthology.orchestra.run.smithi155.stdout: { 2023-08-01T19:55:09.946 INFO:teuthology.orchestra.run.smithi155.stdout: "event": "initiated", 2023-08-01T19:55:09.946 INFO:teuthology.orchestra.run.smithi155.stdout: "time": "2023-08-01T19:55:05.150991+0000", 2023-08-01T19:55:09.946 INFO:teuthology.orchestra.run.smithi155.stdout: "duration": 0 2023-08-01T19:55:09.946 INFO:teuthology.orchestra.run.smithi155.stdout: }, 2023-08-01T19:55:09.946 INFO:teuthology.orchestra.run.smithi155.stdout: { 2023-08-01T19:55:09.946 INFO:teuthology.orchestra.run.smithi155.stdout: "event": "throttled", 2023-08-01T19:55:09.946 INFO:teuthology.orchestra.run.smithi155.stdout: "time": "2023-08-01T19:55:05.150991+0000", 2023-08-01T19:55:09.947 INFO:teuthology.orchestra.run.smithi155.stdout: "duration": 0 2023-08-01T19:55:09.947 INFO:teuthology.orchestra.run.smithi155.stdout: }, 2023-08-01T19:55:09.947 INFO:teuthology.orchestra.run.smithi155.stdout: { 2023-08-01T19:55:09.947 INFO:teuthology.orchestra.run.smithi155.stdout: "event": "header_read", 2023-08-01T19:55:09.947 INFO:teuthology.orchestra.run.smithi155.stdout: "time": "2023-08-01T19:55:05.150990+0000", 2023-08-01T19:55:09.947 INFO:teuthology.orchestra.run.smithi155.stdout: "duration": 4294967295.999999 2023-08-01T19:55:09.947 INFO:teuthology.orchestra.run.smithi155.stdout: }, 2023-08-01T19:55:09.947 INFO:teuthology.orchestra.run.smithi155.stdout: { 2023-08-01T19:55:09.948 INFO:teuthology.orchestra.run.smithi155.stdout: "event": "all_read", 2023-08-01T19:55:09.948 INFO:teuthology.orchestra.run.smithi155.stdout: "time": "2023-08-01T19:55:05.151108+0000", 2023-08-01T19:55:09.948 INFO:teuthology.orchestra.run.smithi155.stdout: "duration": 0.00011849300000000001 2023-08-01T19:55:09.948 INFO:teuthology.orchestra.run.smithi155.stdout: }, 2023-08-01T19:55:09.948 INFO:teuthology.orchestra.run.smithi155.stdout: { 2023-08-01T19:55:09.948 INFO:teuthology.orchestra.run.smithi155.stdout: "event": "dispatched", 2023-08-01T19:55:09.948 INFO:teuthology.orchestra.run.smithi155.stdout: "time": "2023-08-01T19:55:05.151117+0000", 2023-08-01T19:55:09.948 INFO:teuthology.orchestra.run.smithi155.stdout: "duration": 8.1040000000000007e-06 2023-08-01T19:55:09.949 INFO:teuthology.orchestra.run.smithi155.stdout: }, 2023-08-01T19:55:09.949 INFO:teuthology.orchestra.run.smithi155.stdout: { 2023-08-01T19:55:09.949 INFO:teuthology.orchestra.run.smithi155.stdout: "event": "queued_for_pg", 2023-08-01T19:55:09.949 INFO:teuthology.orchestra.run.smithi155.stdout: "time": "2023-08-01T19:55:05.151121+0000", 2023-08-01T19:55:09.949 INFO:teuthology.orchestra.run.smithi155.stdout: "duration": 4.2019999999999997e-06 2023-08-01T19:55:09.949 INFO:teuthology.orchestra.run.smithi155.stdout: }, 2023-08-01T19:55:09.949 INFO:teuthology.orchestra.run.smithi155.stdout: { 2023-08-01T19:55:09.949 INFO:teuthology.orchestra.run.smithi155.stdout: "event": "reached_pg", 2023-08-01T19:55:09.950 INFO:teuthology.orchestra.run.smithi155.stdout: "time": "2023-08-01T19:55:05.151162+0000", 2023-08-01T19:55:09.950 INFO:teuthology.orchestra.run.smithi155.stdout: "duration": 4.1448e-05 2023-08-01T19:55:09.950 INFO:teuthology.orchestra.run.smithi155.stdout: }, 2023-08-01T19:55:09.950 INFO:teuthology.orchestra.run.smithi155.stdout: { 2023-08-01T19:55:09.950 INFO:teuthology.orchestra.run.smithi155.stdout: "event": "started", 2023-08-01T19:55:09.950 INFO:teuthology.orchestra.run.smithi155.stdout: "time": "2023-08-01T19:55:05.151281+0000", 2023-08-01T19:55:09.950 INFO:teuthology.orchestra.run.smithi155.stdout: "duration": 0.000119141 2023-08-01T19:55:09.950 INFO:teuthology.orchestra.run.smithi155.stdout: }, 2023-08-01T19:55:09.951 INFO:teuthology.orchestra.run.smithi155.stdout: { 2023-08-01T19:55:09.951 INFO:teuthology.orchestra.run.smithi155.stdout: "event": "waiting for subops from 0", 2023-08-01T19:55:09.951 INFO:teuthology.orchestra.run.smithi155.stdout: "time": "2023-08-01T19:55:05.151443+0000", 2023-08-01T19:55:09.951 INFO:teuthology.orchestra.run.smithi155.stdout: "duration": 0.00016181600000000001 2023-08-01T19:55:09.951 INFO:teuthology.orchestra.run.smithi155.stdout: }, 2023-08-01T19:55:09.951 INFO:teuthology.orchestra.run.smithi155.stdout: { 2023-08-01T19:55:09.951 INFO:teuthology.orchestra.run.smithi155.stdout: "event": "sub_op_commit_rec", 2023-08-01T19:55:09.951 INFO:teuthology.orchestra.run.smithi155.stdout: "time": "2023-08-01T19:55:05.219101+0000", 2023-08-01T19:55:09.952 INFO:teuthology.orchestra.run.smithi155.stdout: "duration": 0.067658037000000004 2023-08-01T19:55:09.952 INFO:teuthology.orchestra.run.smithi155.stdout: }, 2023-08-01T19:55:09.952 INFO:teuthology.orchestra.run.smithi155.stdout: { 2023-08-01T19:55:09.952 INFO:teuthology.orchestra.run.smithi155.stdout: "event": "op_commit", 2023-08-01T19:55:09.952 INFO:teuthology.orchestra.run.smithi155.stdout: "time": "2023-08-01T19:55:05.221646+0000", 2023-08-01T19:55:09.952 INFO:teuthology.orchestra.run.smithi155.stdout: "duration": 0.0025450540000000002 2023-08-01T19:55:09.952 INFO:teuthology.orchestra.run.smithi155.stdout: }, 2023-08-01T19:55:09.953 INFO:teuthology.orchestra.run.smithi155.stdout: { 2023-08-01T19:55:09.953 INFO:teuthology.orchestra.run.smithi155.stdout: "event": "commit_sent", 2023-08-01T19:55:09.953 INFO:teuthology.orchestra.run.smithi155.stdout: "time": "2023-08-01T19:55:05.221689+0000", 2023-08-01T19:55:09.953 INFO:teuthology.orchestra.run.smithi155.stdout: "duration": 4.3078999999999999e-05 2023-08-01T19:55:09.953 INFO:teuthology.orchestra.run.smithi155.stdout: }, 2023-08-01T19:55:09.953 INFO:teuthology.orchestra.run.smithi155.stdout: { 2023-08-01T19:55:09.953 INFO:teuthology.orchestra.run.smithi155.stdout: "event": "done", 2023-08-01T19:55:09.953 INFO:teuthology.orchestra.run.smithi155.stdout: "time": "2023-08-01T19:55:05.221725+0000", 2023-08-01T19:55:09.954 INFO:teuthology.orchestra.run.smithi155.stdout: "duration": 3.6137999999999999e-05 2023-08-01T19:55:09.954 INFO:teuthology.orchestra.run.smithi155.stdout: } 2023-08-01T19:55:09.954 INFO:teuthology.orchestra.run.smithi155.stdout: ] 2023-08-01T19:55:09.954 INFO:teuthology.orchestra.run.smithi155.stdout: } 2023-08-01T19:55:09.954 INFO:teuthology.orchestra.run.smithi155.stdout: }, 2023-08-01T19:55:09.954 INFO:teuthology.orchestra.run.smithi155.stdout: { 2023-08-01T19:55:09.954 INFO:teuthology.orchestra.run.smithi155.stdout: "description": "osd_repop(client.4668.0:100243 5.a e37/19 5:5e8193b6:::benchmark_data_smithi006_114134_object100242:head v 37'6228, mlcod=37'6225)", 2023-08-01T19:55:09.954 INFO:teuthology.orchestra.run.smithi155.stdout: "initiated_at": "2023-08-01T19:55:05.151148+0000", 2023-08-01T19:55:09.955 INFO:teuthology.orchestra.run.smithi155.stdout: "age": 4.7252003800000004, 2023-08-01T19:55:09.955 INFO:teuthology.orchestra.run.smithi155.stdout: "duration": 0.073020370000000001, 2023-08-01T19:55:09.955 INFO:teuthology.orchestra.run.smithi155.stdout: "type_data": { 2023-08-01T19:55:09.955 INFO:teuthology.orchestra.run.smithi155.stdout: "flag_point": "commit sent; apply or cleanup", 2023-08-01T19:55:09.955 INFO:teuthology.orchestra.run.smithi155.stdout: "events": [ 2023-08-01T19:55:09.955 INFO:teuthology.orchestra.run.smithi155.stdout: { 2023-08-01T19:55:09.955 INFO:teuthology.orchestra.run.smithi155.stdout: "event": "initiated", 2023-08-01T19:55:09.955 INFO:teuthology.orchestra.run.smithi155.stdout: "time": "2023-08-01T19:55:05.151148+0000", 2023-08-01T19:55:09.956 INFO:teuthology.orchestra.run.smithi155.stdout: "duration": 0 2023-08-01T19:55:09.956 INFO:teuthology.orchestra.run.smithi155.stdout: }, 2023-08-01T19:55:09.956 INFO:teuthology.orchestra.run.smithi155.stdout: { 2023-08-01T19:55:09.956 INFO:teuthology.orchestra.run.smithi155.stdout: "event": "throttled", 2023-08-01T19:55:09.956 INFO:teuthology.orchestra.run.smithi155.stdout: "time": "2023-08-01T19:55:05.151148+0000", 2023-08-01T19:55:09.956 INFO:teuthology.orchestra.run.smithi155.stdout: "duration": 0 2023-08-01T19:55:09.956 INFO:teuthology.orchestra.run.smithi155.stdout: }, 2023-08-01T19:55:09.956 INFO:teuthology.orchestra.run.smithi155.stdout: { 2023-08-01T19:55:09.957 INFO:teuthology.orchestra.run.smithi155.stdout: "event": "header_read", 2023-08-01T19:55:09.957 INFO:teuthology.orchestra.run.smithi155.stdout: "time": "2023-08-01T19:55:05.151147+0000", 2023-08-01T19:55:09.957 INFO:teuthology.orchestra.run.smithi155.stdout: "duration": 4294967295.9999995 2023-08-01T19:55:09.957 INFO:teuthology.orchestra.run.smithi155.stdout: }, 2023-08-01T19:55:09.957 INFO:teuthology.orchestra.run.smithi155.stdout: { 2023-08-01T19:55:09.957 INFO:teuthology.orchestra.run.smithi155.stdout: "event": "all_read", 2023-08-01T19:55:09.957 INFO:teuthology.orchestra.run.smithi155.stdout: "time": "2023-08-01T19:55:05.151231+0000", 2023-08-01T19:55:09.958 INFO:teuthology.orchestra.run.smithi155.stdout: "duration": 8.3135999999999998e-05 2023-08-01T19:55:09.958 INFO:teuthology.orchestra.run.smithi155.stdout: }, 2023-08-01T19:55:09.958 INFO:teuthology.orchestra.run.smithi155.stdout: { 2023-08-01T19:55:09.958 INFO:teuthology.orchestra.run.smithi155.stdout: "event": "dispatched", 2023-08-01T19:55:09.958 INFO:teuthology.orchestra.run.smithi155.stdout: "time": "2023-08-01T19:55:05.151239+0000", 2023-08-01T19:55:09.958 INFO:teuthology.orchestra.run.smithi155.stdout: "duration": 8.7469999999999994e-06 2023-08-01T19:55:09.958 INFO:teuthology.orchestra.run.smithi155.stdout: }, 2023-08-01T19:55:09.958 INFO:teuthology.orchestra.run.smithi155.stdout: { 2023-08-01T19:55:09.959 INFO:teuthology.orchestra.run.smithi155.stdout: "event": "queued_for_pg", 2023-08-01T19:55:09.959 INFO:teuthology.orchestra.run.smithi155.stdout: "time": "2023-08-01T19:55:05.151244+0000", 2023-08-01T19:55:09.959 INFO:teuthology.orchestra.run.smithi155.stdout: "duration": 4.4800000000000003e-06 2023-08-01T19:55:09.959 INFO:teuthology.orchestra.run.smithi155.stdout: }, 2023-08-01T19:55:09.959 INFO:teuthology.orchestra.run.smithi155.stdout: { 2023-08-01T19:55:09.959 INFO:teuthology.orchestra.run.smithi155.stdout: "event": "reached_pg", 2023-08-01T19:55:09.959 INFO:teuthology.orchestra.run.smithi155.stdout: "time": "2023-08-01T19:55:05.152938+0000", 2023-08-01T19:55:09.959 INFO:teuthology.orchestra.run.smithi155.stdout: "duration": 0.001693824 2023-08-01T19:55:09.960 INFO:teuthology.orchestra.run.smithi155.stdout: }, 2023-08-01T19:55:09.960 INFO:teuthology.orchestra.run.smithi155.stdout: { 2023-08-01T19:55:09.960 INFO:teuthology.orchestra.run.smithi155.stdout: "event": "started", 2023-08-01T19:55:09.960 INFO:teuthology.orchestra.run.smithi155.stdout: "time": "2023-08-01T19:55:05.152956+0000", 2023-08-01T19:55:09.960 INFO:teuthology.orchestra.run.smithi155.stdout: "duration": 1.8287e-05 2023-08-01T19:55:09.960 INFO:teuthology.orchestra.run.smithi155.stdout: }, 2023-08-01T19:55:09.960 INFO:teuthology.orchestra.run.smithi155.stdout: { 2023-08-01T19:55:09.960 INFO:teuthology.orchestra.run.smithi155.stdout: "event": "commit_sent", 2023-08-01T19:55:09.961 INFO:teuthology.orchestra.run.smithi155.stdout: "time": "2023-08-01T19:55:05.224145+0000", 2023-08-01T19:55:09.961 INFO:teuthology.orchestra.run.smithi155.stdout: "duration": 0.071189447000000003 2023-08-01T19:55:09.961 INFO:teuthology.orchestra.run.smithi155.stdout: }, 2023-08-01T19:55:09.961 INFO:teuthology.orchestra.run.smithi155.stdout: { 2023-08-01T19:55:09.961 INFO:teuthology.orchestra.run.smithi155.stdout: "event": "done", 2023-08-01T19:55:09.961 INFO:teuthology.orchestra.run.smithi155.stdout: "time": "2023-08-01T19:55:05.224168+0000", 2023-08-01T19:55:09.961 INFO:teuthology.orchestra.run.smithi155.stdout: "duration": 2.3008999999999999e-05 2023-08-01T19:55:09.961 INFO:teuthology.orchestra.run.smithi155.stdout: } 2023-08-01T19:55:09.962 INFO:teuthology.orchestra.run.smithi155.stdout: ] 2023-08-01T19:55:09.962 INFO:teuthology.orchestra.run.smithi155.stdout: } 2023-08-01T19:55:09.962 INFO:teuthology.orchestra.run.smithi155.stdout: }, 2023-08-01T19:55:09.962 INFO:teuthology.orchestra.run.smithi155.stdout: { 2023-08-01T19:55:09.962 INFO:teuthology.orchestra.run.smithi155.stdout: "description": "osd_repop(client.4668.0:100244 5.9 e37/19 5:92f56a12:::benchmark_data_smithi006_114134_object100243:head v 37'6294, mlcod=37'6292)", 2023-08-01T19:55:09.962 INFO:teuthology.orchestra.run.smithi155.stdout: "initiated_at": "2023-08-01T19:55:05.151325+0000", 2023-08-01T19:55:09.962 INFO:teuthology.orchestra.run.smithi155.stdout: "age": 4.7250230349999995, 2023-08-01T19:55:09.962 INFO:teuthology.orchestra.run.smithi155.stdout: "duration": 0.071883673999999995, 2023-08-01T19:55:09.963 INFO:teuthology.orchestra.run.smithi155.stdout: "type_data": { 2023-08-01T19:55:09.963 INFO:teuthology.orchestra.run.smithi155.stdout: "flag_point": "commit sent; apply or cleanup", 2023-08-01T19:55:09.963 INFO:teuthology.orchestra.run.smithi155.stdout: "events": [ 2023-08-01T19:55:09.963 INFO:teuthology.orchestra.run.smithi155.stdout: { 2023-08-01T19:55:09.963 INFO:teuthology.orchestra.run.smithi155.stdout: "event": "initiated", 2023-08-01T19:55:09.963 INFO:teuthology.orchestra.run.smithi155.stdout: "time": "2023-08-01T19:55:05.151325+0000", 2023-08-01T19:55:09.963 INFO:teuthology.orchestra.run.smithi155.stdout: "duration": 0 2023-08-01T19:55:09.963 INFO:teuthology.orchestra.run.smithi155.stdout: }, 2023-08-01T19:55:09.964 INFO:teuthology.orchestra.run.smithi155.stdout: { 2023-08-01T19:55:09.964 INFO:teuthology.orchestra.run.smithi155.stdout: "event": "throttled", 2023-08-01T19:55:09.964 INFO:teuthology.orchestra.run.smithi155.stdout: "time": "2023-08-01T19:55:05.151325+0000", 2023-08-01T19:55:09.964 INFO:teuthology.orchestra.run.smithi155.stdout: "duration": 0 2023-08-01T19:55:09.964 INFO:teuthology.orchestra.run.smithi155.stdout: }, 2023-08-01T19:55:09.964 INFO:teuthology.orchestra.run.smithi155.stdout: { 2023-08-01T19:55:09.964 INFO:teuthology.orchestra.run.smithi155.stdout: "event": "header_read", 2023-08-01T19:55:09.965 INFO:teuthology.orchestra.run.smithi155.stdout: "time": "2023-08-01T19:55:05.151325+0000", 2023-08-01T19:55:09.965 INFO:teuthology.orchestra.run.smithi155.stdout: "duration": 4294967295.9999995 2023-08-01T19:55:09.965 INFO:teuthology.orchestra.run.smithi155.stdout: }, 2023-08-01T19:55:09.965 INFO:teuthology.orchestra.run.smithi155.stdout: { 2023-08-01T19:55:09.965 INFO:teuthology.orchestra.run.smithi155.stdout: "event": "all_read", 2023-08-01T19:55:09.965 INFO:teuthology.orchestra.run.smithi155.stdout: "time": "2023-08-01T19:55:05.151390+0000", 2023-08-01T19:55:09.965 INFO:teuthology.orchestra.run.smithi155.stdout: "duration": 6.5456999999999993e-05 2023-08-01T19:55:09.965 INFO:teuthology.orchestra.run.smithi155.stdout: }, 2023-08-01T19:55:09.966 INFO:teuthology.orchestra.run.smithi155.stdout: { 2023-08-01T19:55:09.966 INFO:teuthology.orchestra.run.smithi155.stdout: "event": "dispatched", 2023-08-01T19:55:09.966 INFO:teuthology.orchestra.run.smithi155.stdout: "time": "2023-08-01T19:55:05.151396+0000", 2023-08-01T19:55:09.966 INFO:teuthology.orchestra.run.smithi155.stdout: "duration": 5.9190000000000004e-06 2023-08-01T19:55:09.966 INFO:teuthology.orchestra.run.smithi155.stdout: }, 2023-08-01T19:55:09.966 INFO:teuthology.orchestra.run.smithi155.stdout: { 2023-08-01T19:55:09.966 INFO:teuthology.orchestra.run.smithi155.stdout: "event": "queued_for_pg", 2023-08-01T19:55:09.966 INFO:teuthology.orchestra.run.smithi155.stdout: "time": "2023-08-01T19:55:05.151400+0000", 2023-08-01T19:55:09.967 INFO:teuthology.orchestra.run.smithi155.stdout: "duration": 4.1030000000000004e-06 2023-08-01T19:55:09.967 INFO:teuthology.orchestra.run.smithi155.stdout: }, 2023-08-01T19:55:09.967 INFO:teuthology.orchestra.run.smithi155.stdout: { 2023-08-01T19:55:09.967 INFO:teuthology.orchestra.run.smithi155.stdout: "event": "reached_pg", 2023-08-01T19:55:09.967 INFO:teuthology.orchestra.run.smithi155.stdout: "time": "2023-08-01T19:55:05.151452+0000", 2023-08-01T19:55:09.967 INFO:teuthology.orchestra.run.smithi155.stdout: "duration": 5.2136999999999999e-05 2023-08-01T19:55:09.967 INFO:teuthology.orchestra.run.smithi155.stdout: }, 2023-08-01T19:55:09.967 INFO:teuthology.orchestra.run.smithi155.stdout: { 2023-08-01T19:55:09.968 INFO:teuthology.orchestra.run.smithi155.stdout: "event": "started", 2023-08-01T19:55:09.968 INFO:teuthology.orchestra.run.smithi155.stdout: "time": "2023-08-01T19:55:05.151470+0000", 2023-08-01T19:55:09.968 INFO:teuthology.orchestra.run.smithi155.stdout: "duration": 1.8e-05 2023-08-01T19:55:09.968 INFO:teuthology.orchestra.run.smithi155.stdout: }, 2023-08-01T19:55:09.968 INFO:teuthology.orchestra.run.smithi155.stdout: { 2023-08-01T19:55:09.968 INFO:teuthology.orchestra.run.smithi155.stdout: "event": "commit_sent", 2023-08-01T19:55:09.968 INFO:teuthology.orchestra.run.smithi155.stdout: "time": "2023-08-01T19:55:05.223183+0000", 2023-08-01T19:55:09.968 INFO:teuthology.orchestra.run.smithi155.stdout: "duration": 0.071712622000000004 2023-08-01T19:55:09.969 INFO:teuthology.orchestra.run.smithi155.stdout: }, 2023-08-01T19:55:09.969 INFO:teuthology.orchestra.run.smithi155.stdout: { 2023-08-01T19:55:09.969 INFO:teuthology.orchestra.run.smithi155.stdout: "event": "done", 2023-08-01T19:55:09.969 INFO:teuthology.orchestra.run.smithi155.stdout: "time": "2023-08-01T19:55:05.223209+0000", 2023-08-01T19:55:09.969 INFO:teuthology.orchestra.run.smithi155.stdout: "duration": 2.5956e-05 2023-08-01T19:55:09.969 INFO:teuthology.orchestra.run.smithi155.stdout: } 2023-08-01T19:55:09.969 INFO:teuthology.orchestra.run.smithi155.stdout: ] 2023-08-01T19:55:09.969 INFO:teuthology.orchestra.run.smithi155.stdout: } 2023-08-01T19:55:09.970 INFO:teuthology.orchestra.run.smithi155.stdout: }, 2023-08-01T19:55:09.970 INFO:teuthology.orchestra.run.smithi155.stdout: { 2023-08-01T19:55:09.970 INFO:teuthology.orchestra.run.smithi155.stdout: "description": "osd_op(client.4668.0:100249 5.b 5:d0666827:::benchmark_data_smithi006_114134_object100248:head [set-alloc-hint object_size 65536 write_size 65536,write 0~65536] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e37)", 2023-08-01T19:55:09.970 INFO:teuthology.orchestra.run.smithi155.stdout: "initiated_at": "2023-08-01T19:55:05.153614+0000", 2023-08-01T19:55:09.970 INFO:teuthology.orchestra.run.smithi155.stdout: "age": 4.7227346099999998, 2023-08-01T19:55:09.970 INFO:teuthology.orchestra.run.smithi155.stdout: "duration": 0.069286118999999993, 2023-08-01T19:55:09.970 INFO:teuthology.orchestra.run.smithi155.stdout: "type_data": { 2023-08-01T19:55:09.970 INFO:teuthology.orchestra.run.smithi155.stdout: "flag_point": "commit sent; apply or cleanup", 2023-08-01T19:55:09.971 INFO:teuthology.orchestra.run.smithi155.stdout: "client_info": { 2023-08-01T19:55:09.971 INFO:teuthology.orchestra.run.smithi155.stdout: "client": "client.4668", 2023-08-01T19:55:09.971 INFO:teuthology.orchestra.run.smithi155.stdout: "client_addr": "172.21.15.6:0/1709472247", 2023-08-01T19:55:09.971 INFO:teuthology.orchestra.run.smithi155.stdout: "tid": 100249 2023-08-01T19:55:09.971 INFO:teuthology.orchestra.run.smithi155.stdout: }, 2023-08-01T19:55:09.971 INFO:teuthology.orchestra.run.smithi155.stdout: "events": [ 2023-08-01T19:55:09.971 INFO:teuthology.orchestra.run.smithi155.stdout: { 2023-08-01T19:55:09.971 INFO:teuthology.orchestra.run.smithi155.stdout: "event": "initiated", 2023-08-01T19:55:09.972 INFO:teuthology.orchestra.run.smithi155.stdout: "time": "2023-08-01T19:55:05.153614+0000", 2023-08-01T19:55:09.972 INFO:teuthology.orchestra.run.smithi155.stdout: "duration": 0 2023-08-01T19:55:09.972 INFO:teuthology.orchestra.run.smithi155.stdout: }, 2023-08-01T19:55:09.972 INFO:teuthology.orchestra.run.smithi155.stdout: { 2023-08-01T19:55:09.972 INFO:teuthology.orchestra.run.smithi155.stdout: "event": "throttled", 2023-08-01T19:55:09.972 INFO:teuthology.orchestra.run.smithi155.stdout: "time": "2023-08-01T19:55:05.153614+0000", 2023-08-01T19:55:09.972 INFO:teuthology.orchestra.run.smithi155.stdout: "duration": 0 2023-08-01T19:55:09.973 INFO:teuthology.orchestra.run.smithi155.stdout: }, 2023-08-01T19:55:09.973 INFO:teuthology.orchestra.run.smithi155.stdout: { 2023-08-01T19:55:09.973 INFO:teuthology.orchestra.run.smithi155.stdout: "event": "header_read", 2023-08-01T19:55:09.973 INFO:teuthology.orchestra.run.smithi155.stdout: "time": "2023-08-01T19:55:05.153612+0000", 2023-08-01T19:55:09.973 INFO:teuthology.orchestra.run.smithi155.stdout: "duration": 4294967295.9999986 2023-08-01T19:55:09.973 INFO:teuthology.orchestra.run.smithi155.stdout: }, 2023-08-01T19:55:09.973 INFO:teuthology.orchestra.run.smithi155.stdout: { 2023-08-01T19:55:09.973 INFO:teuthology.orchestra.run.smithi155.stdout: "event": "all_read", 2023-08-01T19:55:09.974 INFO:teuthology.orchestra.run.smithi155.stdout: "time": "2023-08-01T19:55:05.153694+0000", 2023-08-01T19:55:09.974 INFO:teuthology.orchestra.run.smithi155.stdout: "duration": 8.1618000000000004e-05 2023-08-01T19:55:09.974 INFO:teuthology.orchestra.run.smithi155.stdout: }, 2023-08-01T19:55:09.974 INFO:teuthology.orchestra.run.smithi155.stdout: { 2023-08-01T19:55:09.974 INFO:teuthology.orchestra.run.smithi155.stdout: "event": "dispatched", 2023-08-01T19:55:09.974 INFO:teuthology.orchestra.run.smithi155.stdout: "time": "2023-08-01T19:55:05.153713+0000", 2023-08-01T19:55:09.974 INFO:teuthology.orchestra.run.smithi155.stdout: "duration": 1.9069999999999999e-05 2023-08-01T19:55:09.974 INFO:teuthology.orchestra.run.smithi155.stdout: }, 2023-08-01T19:55:09.975 INFO:teuthology.orchestra.run.smithi155.stdout: { 2023-08-01T19:55:09.975 INFO:teuthology.orchestra.run.smithi155.stdout: "event": "queued_for_pg", 2023-08-01T19:55:09.975 INFO:teuthology.orchestra.run.smithi155.stdout: "time": "2023-08-01T19:55:05.153726+0000", 2023-08-01T19:55:09.975 INFO:teuthology.orchestra.run.smithi155.stdout: "duration": 1.238e-05 2023-08-01T19:55:09.975 INFO:teuthology.orchestra.run.smithi155.stdout: }, 2023-08-01T19:55:09.975 INFO:teuthology.orchestra.run.smithi155.stdout: { 2023-08-01T19:55:09.975 INFO:teuthology.orchestra.run.smithi155.stdout: "event": "reached_pg", 2023-08-01T19:55:09.975 INFO:teuthology.orchestra.run.smithi155.stdout: "time": "2023-08-01T19:55:05.153761+0000", 2023-08-01T19:55:09.976 INFO:teuthology.orchestra.run.smithi155.stdout: "duration": 3.5046999999999998e-05 2023-08-01T19:55:09.976 INFO:teuthology.orchestra.run.smithi155.stdout: }, 2023-08-01T19:55:09.976 INFO:teuthology.orchestra.run.smithi155.stdout: { 2023-08-01T19:55:09.976 INFO:teuthology.orchestra.run.smithi155.stdout: "event": "started", 2023-08-01T19:55:09.976 INFO:teuthology.orchestra.run.smithi155.stdout: "time": "2023-08-01T19:55:05.153896+0000", 2023-08-01T19:55:09.976 INFO:teuthology.orchestra.run.smithi155.stdout: "duration": 0.00013575800000000001 2023-08-01T19:55:09.976 INFO:teuthology.orchestra.run.smithi155.stdout: }, 2023-08-01T19:55:09.976 INFO:teuthology.orchestra.run.smithi155.stdout: { 2023-08-01T19:55:09.977 INFO:teuthology.orchestra.run.smithi155.stdout: "event": "waiting for subops from 0", 2023-08-01T19:55:09.977 INFO:teuthology.orchestra.run.smithi155.stdout: "time": "2023-08-01T19:55:05.154043+0000", 2023-08-01T19:55:09.977 INFO:teuthology.orchestra.run.smithi155.stdout: "duration": 0.00014650700000000001 2023-08-01T19:55:09.977 INFO:teuthology.orchestra.run.smithi155.stdout: }, 2023-08-01T19:55:09.977 INFO:teuthology.orchestra.run.smithi155.stdout: { 2023-08-01T19:55:09.977 INFO:teuthology.orchestra.run.smithi155.stdout: "event": "sub_op_commit_rec", 2023-08-01T19:55:09.977 INFO:teuthology.orchestra.run.smithi155.stdout: "time": "2023-08-01T19:55:05.221876+0000", 2023-08-01T19:55:09.977 INFO:teuthology.orchestra.run.smithi155.stdout: "duration": 0.067832796000000001 2023-08-01T19:55:09.978 INFO:teuthology.orchestra.run.smithi155.stdout: }, 2023-08-01T19:55:09.978 INFO:teuthology.orchestra.run.smithi155.stdout: { 2023-08-01T19:55:09.978 INFO:teuthology.orchestra.run.smithi155.stdout: "event": "op_commit", 2023-08-01T19:55:09.978 INFO:teuthology.orchestra.run.smithi155.stdout: "time": "2023-08-01T19:55:05.222813+0000", 2023-08-01T19:55:09.978 INFO:teuthology.orchestra.run.smithi155.stdout: "duration": 0.00093755300000000004 2023-08-01T19:55:09.978 INFO:teuthology.orchestra.run.smithi155.stdout: }, 2023-08-01T19:55:09.978 INFO:teuthology.orchestra.run.smithi155.stdout: { 2023-08-01T19:55:09.978 INFO:teuthology.orchestra.run.smithi155.stdout: "event": "commit_sent", 2023-08-01T19:55:09.979 INFO:teuthology.orchestra.run.smithi155.stdout: "time": "2023-08-01T19:55:05.222861+0000", 2023-08-01T19:55:09.979 INFO:teuthology.orchestra.run.smithi155.stdout: "duration": 4.8013999999999998e-05 2023-08-01T19:55:09.979 INFO:teuthology.orchestra.run.smithi155.stdout: }, 2023-08-01T19:55:09.979 INFO:teuthology.orchestra.run.smithi155.stdout: { 2023-08-01T19:55:09.979 INFO:teuthology.orchestra.run.smithi155.stdout: "event": "done", 2023-08-01T19:55:09.979 INFO:teuthology.orchestra.run.smithi155.stdout: "time": "2023-08-01T19:55:05.222900+0000", 2023-08-01T19:55:09.979 INFO:teuthology.orchestra.run.smithi155.stdout: "duration": 3.8634999999999999e-05 2023-08-01T19:55:09.979 INFO:teuthology.orchestra.run.smithi155.stdout: } 2023-08-01T19:55:09.980 INFO:teuthology.orchestra.run.smithi155.stdout: ] 2023-08-01T19:55:09.980 INFO:teuthology.orchestra.run.smithi155.stdout: } 2023-08-01T19:55:09.980 INFO:teuthology.orchestra.run.smithi155.stdout: }, 2023-08-01T19:55:09.980 INFO:teuthology.orchestra.run.smithi155.stdout: { 2023-08-01T19:55:09.980 INFO:teuthology.orchestra.run.smithi155.stdout: "description": "osd_op(client.4668.0:100251 5.b 5:d853df24:::benchmark_data_smithi006_114134_object100250:head [set-alloc-hint object_size 65536 write_size 65536,write 0~65536] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e37)", 2023-08-01T19:55:09.980 INFO:teuthology.orchestra.run.smithi155.stdout: "initiated_at": "2023-08-01T19:55:05.153737+0000", 2023-08-01T19:55:09.980 INFO:teuthology.orchestra.run.smithi155.stdout: "age": 4.7226115960000001, 2023-08-01T19:55:09.981 INFO:teuthology.orchestra.run.smithi155.stdout: "duration": 0.071366545000000003, 2023-08-01T19:55:09.981 INFO:teuthology.orchestra.run.smithi155.stdout: "type_data": { 2023-08-01T19:55:09.981 INFO:teuthology.orchestra.run.smithi155.stdout: "flag_point": "commit sent; apply or cleanup", 2023-08-01T19:55:09.981 INFO:teuthology.orchestra.run.smithi155.stdout: "client_info": { 2023-08-01T19:55:09.981 INFO:teuthology.orchestra.run.smithi155.stdout: "client": "client.4668", 2023-08-01T19:55:09.981 INFO:teuthology.orchestra.run.smithi155.stdout: "client_addr": "172.21.15.6:0/1709472247", 2023-08-01T19:55:09.981 INFO:teuthology.orchestra.run.smithi155.stdout: "tid": 100251 2023-08-01T19:55:09.981 INFO:teuthology.orchestra.run.smithi155.stdout: }, 2023-08-01T19:55:09.982 INFO:teuthology.orchestra.run.smithi155.stdout: "events": [ 2023-08-01T19:55:09.982 INFO:teuthology.orchestra.run.smithi155.stdout: { 2023-08-01T19:55:09.982 INFO:teuthology.orchestra.run.smithi155.stdout: "event": "initiated", 2023-08-01T19:55:09.982 INFO:teuthology.orchestra.run.smithi155.stdout: "time": "2023-08-01T19:55:05.153737+0000", 2023-08-01T19:55:09.982 INFO:teuthology.orchestra.run.smithi155.stdout: "duration": 0 2023-08-01T19:55:09.982 INFO:teuthology.orchestra.run.smithi155.stdout: }, 2023-08-01T19:55:09.982 INFO:teuthology.orchestra.run.smithi155.stdout: { 2023-08-01T19:55:09.982 INFO:teuthology.orchestra.run.smithi155.stdout: "event": "throttled", 2023-08-01T19:55:09.983 INFO:teuthology.orchestra.run.smithi155.stdout: "time": "2023-08-01T19:55:05.153737+0000", 2023-08-01T19:55:09.983 INFO:teuthology.orchestra.run.smithi155.stdout: "duration": 0 2023-08-01T19:55:09.983 INFO:teuthology.orchestra.run.smithi155.stdout: }, 2023-08-01T19:55:09.983 INFO:teuthology.orchestra.run.smithi155.stdout: { 2023-08-01T19:55:09.983 INFO:teuthology.orchestra.run.smithi155.stdout: "event": "header_read", 2023-08-01T19:55:09.983 INFO:teuthology.orchestra.run.smithi155.stdout: "time": "2023-08-01T19:55:05.153736+0000", 2023-08-01T19:55:09.983 INFO:teuthology.orchestra.run.smithi155.stdout: "duration": 4294967295.9999995 2023-08-01T19:55:09.983 INFO:teuthology.orchestra.run.smithi155.stdout: }, 2023-08-01T19:55:09.984 INFO:teuthology.orchestra.run.smithi155.stdout: { 2023-08-01T19:55:09.984 INFO:teuthology.orchestra.run.smithi155.stdout: "event": "all_read", 2023-08-01T19:55:09.984 INFO:teuthology.orchestra.run.smithi155.stdout: "time": "2023-08-01T19:55:05.153784+0000", 2023-08-01T19:55:09.984 INFO:teuthology.orchestra.run.smithi155.stdout: "duration": 4.7660000000000001e-05 2023-08-01T19:55:09.984 INFO:teuthology.orchestra.run.smithi155.stdout: }, 2023-08-01T19:55:09.984 INFO:teuthology.orchestra.run.smithi155.stdout: { 2023-08-01T19:55:09.984 INFO:teuthology.orchestra.run.smithi155.stdout: "event": "dispatched", 2023-08-01T19:55:09.985 INFO:teuthology.orchestra.run.smithi155.stdout: "time": "2023-08-01T19:55:05.153793+0000", 2023-08-01T19:55:09.985 INFO:teuthology.orchestra.run.smithi155.stdout: "duration": 8.7150000000000004e-06 2023-08-01T19:55:09.985 INFO:teuthology.orchestra.run.smithi155.stdout: }, 2023-08-01T19:55:09.985 INFO:teuthology.orchestra.run.smithi155.stdout: { 2023-08-01T19:55:09.985 INFO:teuthology.orchestra.run.smithi155.stdout: "event": "queued_for_pg", 2023-08-01T19:55:09.985 INFO:teuthology.orchestra.run.smithi155.stdout: "time": "2023-08-01T19:55:05.153800+0000", 2023-08-01T19:55:09.985 INFO:teuthology.orchestra.run.smithi155.stdout: "duration": 7.2459999999999997e-06 2023-08-01T19:55:09.985 INFO:teuthology.orchestra.run.smithi155.stdout: }, 2023-08-01T19:55:09.986 INFO:teuthology.orchestra.run.smithi155.stdout: { 2023-08-01T19:55:09.986 INFO:teuthology.orchestra.run.smithi155.stdout: "event": "reached_pg", 2023-08-01T19:55:09.986 INFO:teuthology.orchestra.run.smithi155.stdout: "time": "2023-08-01T19:55:05.156241+0000", 2023-08-01T19:55:09.986 INFO:teuthology.orchestra.run.smithi155.stdout: "duration": 0.0024415359999999998 2023-08-01T19:55:09.986 INFO:teuthology.orchestra.run.smithi155.stdout: }, 2023-08-01T19:55:09.986 INFO:teuthology.orchestra.run.smithi155.stdout: { 2023-08-01T19:55:09.986 INFO:teuthology.orchestra.run.smithi155.stdout: "event": "started", 2023-08-01T19:55:09.986 INFO:teuthology.orchestra.run.smithi155.stdout: "time": "2023-08-01T19:55:05.219045+0000", 2023-08-01T19:55:09.987 INFO:teuthology.orchestra.run.smithi155.stdout: "duration": 0.062803855000000006 2023-08-01T19:55:09.987 INFO:teuthology.orchestra.run.smithi155.stdout: }, 2023-08-01T19:55:09.987 INFO:teuthology.orchestra.run.smithi155.stdout: { 2023-08-01T19:55:09.987 INFO:teuthology.orchestra.run.smithi155.stdout: "event": "waiting for subops from 0", 2023-08-01T19:55:09.987 INFO:teuthology.orchestra.run.smithi155.stdout: "time": "2023-08-01T19:55:05.219238+0000", 2023-08-01T19:55:09.987 INFO:teuthology.orchestra.run.smithi155.stdout: "duration": 0.00019241500000000001 2023-08-01T19:55:09.987 INFO:teuthology.orchestra.run.smithi155.stdout: }, 2023-08-01T19:55:09.988 INFO:teuthology.orchestra.run.smithi155.stdout: { 2023-08-01T19:55:09.988 INFO:teuthology.orchestra.run.smithi155.stdout: "event": "sub_op_commit_rec", 2023-08-01T19:55:09.988 INFO:teuthology.orchestra.run.smithi155.stdout: "time": "2023-08-01T19:55:05.223300+0000", 2023-08-01T19:55:09.988 INFO:teuthology.orchestra.run.smithi155.stdout: "duration": 0.0040626509999999996 2023-08-01T19:55:09.988 INFO:teuthology.orchestra.run.smithi155.stdout: }, 2023-08-01T19:55:09.989 INFO:teuthology.orchestra.run.smithi155.stdout: { 2023-08-01T19:55:09.989 INFO:teuthology.orchestra.run.smithi155.stdout: "event": "op_commit", 2023-08-01T19:55:09.989 INFO:teuthology.orchestra.run.smithi155.stdout: "time": "2023-08-01T19:55:05.225020+0000", 2023-08-01T19:55:09.989 INFO:teuthology.orchestra.run.smithi155.stdout: "duration": 0.0017201 2023-08-01T19:55:09.989 INFO:teuthology.orchestra.run.smithi155.stdout: }, 2023-08-01T19:55:09.989 INFO:teuthology.orchestra.run.smithi155.stdout: { 2023-08-01T19:55:09.989 INFO:teuthology.orchestra.run.smithi155.stdout: "event": "commit_sent", 2023-08-01T19:55:09.990 INFO:teuthology.orchestra.run.smithi155.stdout: "time": "2023-08-01T19:55:05.225066+0000", 2023-08-01T19:55:09.990 INFO:teuthology.orchestra.run.smithi155.stdout: "duration": 4.6143000000000002e-05 2023-08-01T19:55:09.990 INFO:teuthology.orchestra.run.smithi155.stdout: }, 2023-08-01T19:55:09.990 INFO:teuthology.orchestra.run.smithi155.stdout: { 2023-08-01T19:55:09.991 INFO:teuthology.orchestra.run.smithi155.stdout: "event": "done", 2023-08-01T19:55:09.991 INFO:teuthology.orchestra.run.smithi155.stdout: "time": "2023-08-01T19:55:05.225103+0000", 2023-08-01T19:55:09.991 INFO:teuthology.orchestra.run.smithi155.stdout: "duration": 3.6789999999999998e-05 2023-08-01T19:55:09.991 INFO:teuthology.orchestra.run.smithi155.stdout: } 2023-08-01T19:55:09.992 INFO:teuthology.orchestra.run.smithi155.stdout: ] 2023-08-01T19:55:09.992 INFO:teuthology.orchestra.run.smithi155.stdout: } 2023-08-01T19:55:09.992 INFO:teuthology.orchestra.run.smithi155.stdout: }, 2023-08-01T19:55:09.992 INFO:teuthology.orchestra.run.smithi155.stdout: { 2023-08-01T19:55:09.993 INFO:teuthology.orchestra.run.smithi155.stdout: "description": "osd_op(client.4668.0:100252 5.0 5:01f90c3c:::benchmark_data_smithi006_114134_object100251:head [set-alloc-hint object_size 65536 write_size 65536,write 0~65536] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e37)", 2023-08-01T19:55:09.993 INFO:teuthology.orchestra.run.smithi155.stdout: "initiated_at": "2023-08-01T19:55:05.154048+0000", 2023-08-01T19:55:09.993 INFO:teuthology.orchestra.run.smithi155.stdout: "age": 4.7223003490000002, 2023-08-01T19:55:09.993 INFO:teuthology.orchestra.run.smithi155.stdout: "duration": 0.070156683999999997, 2023-08-01T19:55:09.993 INFO:teuthology.orchestra.run.smithi155.stdout: "type_data": { 2023-08-01T19:55:09.993 INFO:teuthology.orchestra.run.smithi155.stdout: "flag_point": "commit sent; apply or cleanup", 2023-08-01T19:55:09.994 INFO:teuthology.orchestra.run.smithi155.stdout: "client_info": { 2023-08-01T19:55:09.994 INFO:teuthology.orchestra.run.smithi155.stdout: "client": "client.4668", 2023-08-01T19:55:09.994 INFO:teuthology.orchestra.run.smithi155.stdout: "client_addr": "172.21.15.6:0/1709472247", 2023-08-01T19:55:09.994 INFO:teuthology.orchestra.run.smithi155.stdout: "tid": 100252 2023-08-01T19:55:09.994 INFO:teuthology.orchestra.run.smithi155.stdout: }, 2023-08-01T19:55:09.994 INFO:teuthology.orchestra.run.smithi155.stdout: "events": [ 2023-08-01T19:55:09.995 INFO:teuthology.orchestra.run.smithi155.stdout: { 2023-08-01T19:55:09.995 INFO:teuthology.orchestra.run.smithi155.stdout: "event": "initiated", 2023-08-01T19:55:09.995 INFO:teuthology.orchestra.run.smithi155.stdout: "time": "2023-08-01T19:55:05.154048+0000", 2023-08-01T19:55:09.995 INFO:teuthology.orchestra.run.smithi155.stdout: "duration": 0 2023-08-01T19:55:09.995 INFO:teuthology.orchestra.run.smithi155.stdout: }, 2023-08-01T19:55:09.995 INFO:teuthology.orchestra.run.smithi155.stdout: { 2023-08-01T19:55:09.995 INFO:teuthology.orchestra.run.smithi155.stdout: "event": "throttled", 2023-08-01T19:55:09.996 INFO:teuthology.orchestra.run.smithi155.stdout: "time": "2023-08-01T19:55:05.154048+0000", 2023-08-01T19:55:09.996 INFO:teuthology.orchestra.run.smithi155.stdout: "duration": 0 2023-08-01T19:55:09.996 INFO:teuthology.orchestra.run.smithi155.stdout: }, 2023-08-01T19:55:09.996 INFO:teuthology.orchestra.run.smithi155.stdout: { 2023-08-01T19:55:09.996 INFO:teuthology.orchestra.run.smithi155.stdout: "event": "header_read", 2023-08-01T19:55:09.996 INFO:teuthology.orchestra.run.smithi155.stdout: "time": "2023-08-01T19:55:05.154047+0000", 2023-08-01T19:55:09.996 INFO:teuthology.orchestra.run.smithi155.stdout: "duration": 4294967295.999999 2023-08-01T19:55:09.996 INFO:teuthology.orchestra.run.smithi155.stdout: }, 2023-08-01T19:55:09.997 INFO:teuthology.orchestra.run.smithi155.stdout: { 2023-08-01T19:55:09.997 INFO:teuthology.orchestra.run.smithi155.stdout: "event": "all_read", 2023-08-01T19:55:09.997 INFO:teuthology.orchestra.run.smithi155.stdout: "time": "2023-08-01T19:55:05.154115+0000", 2023-08-01T19:55:09.997 INFO:teuthology.orchestra.run.smithi155.stdout: "duration": 6.7545999999999993e-05 2023-08-01T19:55:09.997 INFO:teuthology.orchestra.run.smithi155.stdout: }, 2023-08-01T19:55:09.997 INFO:teuthology.orchestra.run.smithi155.stdout: { 2023-08-01T19:55:09.997 INFO:teuthology.orchestra.run.smithi155.stdout: "event": "dispatched", 2023-08-01T19:55:09.997 INFO:teuthology.orchestra.run.smithi155.stdout: "time": "2023-08-01T19:55:05.154125+0000", 2023-08-01T19:55:09.998 INFO:teuthology.orchestra.run.smithi155.stdout: "duration": 1.0669000000000001e-05 2023-08-01T19:55:09.998 INFO:teuthology.orchestra.run.smithi155.stdout: }, 2023-08-01T19:55:09.998 INFO:teuthology.orchestra.run.smithi155.stdout: { 2023-08-01T19:55:09.998 INFO:teuthology.orchestra.run.smithi155.stdout: "event": "queued_for_pg", 2023-08-01T19:55:09.998 INFO:teuthology.orchestra.run.smithi155.stdout: "time": "2023-08-01T19:55:05.154131+0000", 2023-08-01T19:55:09.998 INFO:teuthology.orchestra.run.smithi155.stdout: "duration": 6.0349999999999998e-06 2023-08-01T19:55:09.998 INFO:teuthology.orchestra.run.smithi155.stdout: }, 2023-08-01T19:55:09.998 INFO:teuthology.orchestra.run.smithi155.stdout: { 2023-08-01T19:55:09.999 INFO:teuthology.orchestra.run.smithi155.stdout: "event": "reached_pg", 2023-08-01T19:55:09.999 INFO:teuthology.orchestra.run.smithi155.stdout: "time": "2023-08-01T19:55:05.154174+0000", 2023-08-01T19:55:09.999 INFO:teuthology.orchestra.run.smithi155.stdout: "duration": 4.2429000000000003e-05 2023-08-01T19:55:09.999 INFO:teuthology.orchestra.run.smithi155.stdout: }, 2023-08-01T19:55:09.999 INFO:teuthology.orchestra.run.smithi155.stdout: { 2023-08-01T19:55:09.999 INFO:teuthology.orchestra.run.smithi155.stdout: "event": "started", 2023-08-01T19:55:09.999 INFO:teuthology.orchestra.run.smithi155.stdout: "time": "2023-08-01T19:55:05.154287+0000", 2023-08-01T19:55:09.999 INFO:teuthology.orchestra.run.smithi155.stdout: "duration": 0.000113138 2023-08-01T19:55:10.000 INFO:teuthology.orchestra.run.smithi155.stdout: }, 2023-08-01T19:55:10.000 INFO:teuthology.orchestra.run.smithi155.stdout: { 2023-08-01T19:55:10.000 INFO:teuthology.orchestra.run.smithi155.stdout: "event": "waiting for subops from 0", 2023-08-01T19:55:10.000 INFO:teuthology.orchestra.run.smithi155.stdout: "time": "2023-08-01T19:55:05.154420+0000", 2023-08-01T19:55:10.000 INFO:teuthology.orchestra.run.smithi155.stdout: "duration": 0.000133292 2023-08-01T19:55:10.000 INFO:teuthology.orchestra.run.smithi155.stdout: }, 2023-08-01T19:55:10.000 INFO:teuthology.orchestra.run.smithi155.stdout: { 2023-08-01T19:55:10.001 INFO:teuthology.orchestra.run.smithi155.stdout: "event": "sub_op_commit_rec", 2023-08-01T19:55:10.001 INFO:teuthology.orchestra.run.smithi155.stdout: "time": "2023-08-01T19:55:05.219034+0000", 2023-08-01T19:55:10.001 INFO:teuthology.orchestra.run.smithi155.stdout: "duration": 0.064613429999999999 2023-08-01T19:55:10.001 INFO:teuthology.orchestra.run.smithi155.stdout: }, 2023-08-01T19:55:10.001 INFO:teuthology.orchestra.run.smithi155.stdout: { 2023-08-01T19:55:10.001 INFO:teuthology.orchestra.run.smithi155.stdout: "event": "op_commit", 2023-08-01T19:55:10.001 INFO:teuthology.orchestra.run.smithi155.stdout: "time": "2023-08-01T19:55:05.224138+0000", 2023-08-01T19:55:10.001 INFO:teuthology.orchestra.run.smithi155.stdout: "duration": 0.0051041999999999997 2023-08-01T19:55:10.002 INFO:teuthology.orchestra.run.smithi155.stdout: }, 2023-08-01T19:55:10.002 INFO:teuthology.orchestra.run.smithi155.stdout: { 2023-08-01T19:55:10.002 INFO:teuthology.orchestra.run.smithi155.stdout: "event": "commit_sent", 2023-08-01T19:55:10.002 INFO:teuthology.orchestra.run.smithi155.stdout: "time": "2023-08-01T19:55:05.224171+0000", 2023-08-01T19:55:10.002 INFO:teuthology.orchestra.run.smithi155.stdout: "duration": 3.3345e-05 2023-08-01T19:55:10.002 INFO:teuthology.orchestra.run.smithi155.stdout: }, 2023-08-01T19:55:10.002 INFO:teuthology.orchestra.run.smithi155.stdout: { 2023-08-01T19:55:10.002 INFO:teuthology.orchestra.run.smithi155.stdout: "event": "done", 2023-08-01T19:55:10.003 INFO:teuthology.orchestra.run.smithi155.stdout: "time": "2023-08-01T19:55:05.224205+0000", 2023-08-01T19:55:10.003 INFO:teuthology.orchestra.run.smithi155.stdout: "duration": 3.3525999999999997e-05 2023-08-01T19:55:10.003 INFO:teuthology.orchestra.run.smithi155.stdout: } 2023-08-01T19:55:10.003 INFO:teuthology.orchestra.run.smithi155.stdout: ] 2023-08-01T19:55:10.003 INFO:teuthology.orchestra.run.smithi155.stdout: } 2023-08-01T19:55:10.003 INFO:teuthology.orchestra.run.smithi155.stdout: }, 2023-08-01T19:55:10.003 INFO:teuthology.orchestra.run.smithi155.stdout: { 2023-08-01T19:55:10.003 INFO:teuthology.orchestra.run.smithi155.stdout: "description": "osd_repop_reply(client.4668.0:100237 5.4 e37/19 ondisk, result = 0)", 2023-08-01T19:55:10.004 INFO:teuthology.orchestra.run.smithi155.stdout: "initiated_at": "2023-08-01T19:55:05.156249+0000", 2023-08-01T19:55:10.004 INFO:teuthology.orchestra.run.smithi155.stdout: "age": 4.7200994039999999, 2023-08-01T19:55:10.004 INFO:teuthology.orchestra.run.smithi155.stdout: "duration": 0.062792549000000003, 2023-08-01T19:55:10.004 INFO:teuthology.orchestra.run.smithi155.stdout: "type_data": { 2023-08-01T19:55:10.004 INFO:teuthology.orchestra.run.smithi155.stdout: "flag_point": "started", 2023-08-01T19:55:10.004 INFO:teuthology.orchestra.run.smithi155.stdout: "events": [ 2023-08-01T19:55:10.004 INFO:teuthology.orchestra.run.smithi155.stdout: { 2023-08-01T19:55:10.004 INFO:teuthology.orchestra.run.smithi155.stdout: "event": "initiated", 2023-08-01T19:55:10.005 INFO:teuthology.orchestra.run.smithi155.stdout: "time": "2023-08-01T19:55:05.156249+0000", 2023-08-01T19:55:10.005 INFO:teuthology.orchestra.run.smithi155.stdout: "duration": 0 2023-08-01T19:55:10.005 INFO:teuthology.orchestra.run.smithi155.stdout: }, 2023-08-01T19:55:10.005 INFO:teuthology.orchestra.run.smithi155.stdout: { 2023-08-01T19:55:10.005 INFO:teuthology.orchestra.run.smithi155.stdout: "event": "throttled", 2023-08-01T19:55:10.005 INFO:teuthology.orchestra.run.smithi155.stdout: "time": "2023-08-01T19:55:05.156249+0000", 2023-08-01T19:55:10.005 INFO:teuthology.orchestra.run.smithi155.stdout: "duration": 0 2023-08-01T19:55:10.006 INFO:teuthology.orchestra.run.smithi155.stdout: }, 2023-08-01T19:55:10.006 INFO:teuthology.orchestra.run.smithi155.stdout: { 2023-08-01T19:55:10.006 INFO:teuthology.orchestra.run.smithi155.stdout: "event": "header_read", 2023-08-01T19:55:10.006 INFO:teuthology.orchestra.run.smithi155.stdout: "time": "2023-08-01T19:55:05.156248+0000", 2023-08-01T19:55:10.006 INFO:teuthology.orchestra.run.smithi155.stdout: "duration": 4294967295.9999995 2023-08-01T19:55:10.006 INFO:teuthology.orchestra.run.smithi155.stdout: }, 2023-08-01T19:55:10.006 INFO:teuthology.orchestra.run.smithi155.stdout: { 2023-08-01T19:55:10.006 INFO:teuthology.orchestra.run.smithi155.stdout: "event": "all_read", 2023-08-01T19:55:10.007 INFO:teuthology.orchestra.run.smithi155.stdout: "time": "2023-08-01T19:55:05.156252+0000", 2023-08-01T19:55:10.007 INFO:teuthology.orchestra.run.smithi155.stdout: "duration": 3.9999999999999998e-06 2023-08-01T19:55:10.007 INFO:teuthology.orchestra.run.smithi155.stdout: }, 2023-08-01T19:55:10.007 INFO:teuthology.orchestra.run.smithi155.stdout: { 2023-08-01T19:55:10.007 INFO:teuthology.orchestra.run.smithi155.stdout: "event": "dispatched", 2023-08-01T19:55:10.007 INFO:teuthology.orchestra.run.smithi155.stdout: "time": "2023-08-01T19:55:05.218844+0000", 2023-08-01T19:55:10.007 INFO:teuthology.orchestra.run.smithi155.stdout: "duration": 0.062591516999999999 2023-08-01T19:55:10.007 INFO:teuthology.orchestra.run.smithi155.stdout: }, 2023-08-01T19:55:10.008 INFO:teuthology.orchestra.run.smithi155.stdout: { 2023-08-01T19:55:10.008 INFO:teuthology.orchestra.run.smithi155.stdout: "event": "queued_for_pg", 2023-08-01T19:55:10.008 INFO:teuthology.orchestra.run.smithi155.stdout: "time": "2023-08-01T19:55:05.218862+0000", 2023-08-01T19:55:10.008 INFO:teuthology.orchestra.run.smithi155.stdout: "duration": 1.7666e-05 2023-08-01T19:55:10.008 INFO:teuthology.orchestra.run.smithi155.stdout: }, 2023-08-01T19:55:10.008 INFO:teuthology.orchestra.run.smithi155.stdout: { 2023-08-01T19:55:10.008 INFO:teuthology.orchestra.run.smithi155.stdout: "event": "reached_pg", 2023-08-01T19:55:10.008 INFO:teuthology.orchestra.run.smithi155.stdout: "time": "2023-08-01T19:55:05.218914+0000", 2023-08-01T19:55:10.009 INFO:teuthology.orchestra.run.smithi155.stdout: "duration": 5.2565999999999998e-05 2023-08-01T19:55:10.009 INFO:teuthology.orchestra.run.smithi155.stdout: }, 2023-08-01T19:55:10.009 INFO:teuthology.orchestra.run.smithi155.stdout: { 2023-08-01T19:55:10.009 INFO:teuthology.orchestra.run.smithi155.stdout: "event": "started", 2023-08-01T19:55:10.009 INFO:teuthology.orchestra.run.smithi155.stdout: "time": "2023-08-01T19:55:05.218925+0000", 2023-08-01T19:55:10.009 INFO:teuthology.orchestra.run.smithi155.stdout: "duration": 1.1375e-05 2023-08-01T19:55:10.009 INFO:teuthology.orchestra.run.smithi155.stdout: }, 2023-08-01T19:55:10.009 INFO:teuthology.orchestra.run.smithi155.stdout: { 2023-08-01T19:55:10.010 INFO:teuthology.orchestra.run.smithi155.stdout: "event": "done", 2023-08-01T19:55:10.010 INFO:teuthology.orchestra.run.smithi155.stdout: "time": "2023-08-01T19:55:05.219041+0000", 2023-08-01T19:55:10.010 INFO:teuthology.orchestra.run.smithi155.stdout: "duration": 0.000115977 2023-08-01T19:55:10.010 INFO:teuthology.orchestra.run.smithi155.stdout: } 2023-08-01T19:55:10.010 INFO:teuthology.orchestra.run.smithi155.stdout: ] 2023-08-01T19:55:10.010 INFO:teuthology.orchestra.run.smithi155.stdout: } 2023-08-01T19:55:10.010 INFO:teuthology.orchestra.run.smithi155.stdout: }, 2023-08-01T19:55:10.011 INFO:teuthology.orchestra.run.smithi155.stdout: { 2023-08-01T19:55:10.011 INFO:teuthology.orchestra.run.smithi155.stdout: "description": "osd_repop(client.4668.0:100253 5.f e37/19 5:f7bbce05:::benchmark_data_smithi006_114134_object100252:head v 37'6323, mlcod=37'6321)", 2023-08-01T19:55:10.011 INFO:teuthology.orchestra.run.smithi155.stdout: "initiated_at": "2023-08-01T19:55:05.156952+0000", 2023-08-01T19:55:10.011 INFO:teuthology.orchestra.run.smithi155.stdout: "age": 4.7193963410000004, 2023-08-01T19:55:10.011 INFO:teuthology.orchestra.run.smithi155.stdout: "duration": 0.068018577999999996, 2023-08-01T19:55:10.011 INFO:teuthology.orchestra.run.smithi155.stdout: "type_data": { 2023-08-01T19:55:10.011 INFO:teuthology.orchestra.run.smithi155.stdout: "flag_point": "commit sent; apply or cleanup", 2023-08-01T19:55:10.011 INFO:teuthology.orchestra.run.smithi155.stdout: "events": [ 2023-08-01T19:55:10.012 INFO:teuthology.orchestra.run.smithi155.stdout: { 2023-08-01T19:55:10.012 INFO:teuthology.orchestra.run.smithi155.stdout: "event": "initiated", 2023-08-01T19:55:10.012 INFO:teuthology.orchestra.run.smithi155.stdout: "time": "2023-08-01T19:55:05.156952+0000", 2023-08-01T19:55:10.012 INFO:teuthology.orchestra.run.smithi155.stdout: "duration": 0 2023-08-01T19:55:10.012 INFO:teuthology.orchestra.run.smithi155.stdout: }, 2023-08-01T19:55:10.012 INFO:teuthology.orchestra.run.smithi155.stdout: { 2023-08-01T19:55:10.012 INFO:teuthology.orchestra.run.smithi155.stdout: "event": "throttled", 2023-08-01T19:55:10.012 INFO:teuthology.orchestra.run.smithi155.stdout: "time": "2023-08-01T19:55:05.156952+0000", 2023-08-01T19:55:10.013 INFO:teuthology.orchestra.run.smithi155.stdout: "duration": 0 2023-08-01T19:55:10.013 INFO:teuthology.orchestra.run.smithi155.stdout: }, 2023-08-01T19:55:10.013 INFO:teuthology.orchestra.run.smithi155.stdout: { 2023-08-01T19:55:10.013 INFO:teuthology.orchestra.run.smithi155.stdout: "event": "header_read", 2023-08-01T19:55:10.013 INFO:teuthology.orchestra.run.smithi155.stdout: "time": "2023-08-01T19:55:05.156951+0000", 2023-08-01T19:55:10.013 INFO:teuthology.orchestra.run.smithi155.stdout: "duration": 4294967295.999999 2023-08-01T19:55:10.013 INFO:teuthology.orchestra.run.smithi155.stdout: }, 2023-08-01T19:55:10.013 INFO:teuthology.orchestra.run.smithi155.stdout: { 2023-08-01T19:55:10.014 INFO:teuthology.orchestra.run.smithi155.stdout: "event": "all_read", 2023-08-01T19:55:10.014 INFO:teuthology.orchestra.run.smithi155.stdout: "time": "2023-08-01T19:55:05.156989+0000", 2023-08-01T19:55:10.014 INFO:teuthology.orchestra.run.smithi155.stdout: "duration": 3.8175e-05 2023-08-01T19:55:10.014 INFO:teuthology.orchestra.run.smithi155.stdout: }, 2023-08-01T19:55:10.014 INFO:teuthology.orchestra.run.smithi155.stdout: { 2023-08-01T19:55:10.014 INFO:teuthology.orchestra.run.smithi155.stdout: "event": "dispatched", 2023-08-01T19:55:10.014 INFO:teuthology.orchestra.run.smithi155.stdout: "time": "2023-08-01T19:55:05.218842+0000", 2023-08-01T19:55:10.014 INFO:teuthology.orchestra.run.smithi155.stdout: "duration": 0.061852299999999999 2023-08-01T19:55:10.015 INFO:teuthology.orchestra.run.smithi155.stdout: }, 2023-08-01T19:55:10.015 INFO:teuthology.orchestra.run.smithi155.stdout: { 2023-08-01T19:55:10.015 INFO:teuthology.orchestra.run.smithi155.stdout: "event": "queued_for_pg", 2023-08-01T19:55:10.015 INFO:teuthology.orchestra.run.smithi155.stdout: "time": "2023-08-01T19:55:05.218862+0000", 2023-08-01T19:55:10.015 INFO:teuthology.orchestra.run.smithi155.stdout: "duration": 1.9854999999999999e-05 2023-08-01T19:55:10.015 INFO:teuthology.orchestra.run.smithi155.stdout: }, 2023-08-01T19:55:10.015 INFO:teuthology.orchestra.run.smithi155.stdout: { 2023-08-01T19:55:10.015 INFO:teuthology.orchestra.run.smithi155.stdout: "event": "reached_pg", 2023-08-01T19:55:10.016 INFO:teuthology.orchestra.run.smithi155.stdout: "time": "2023-08-01T19:55:05.218918+0000", 2023-08-01T19:55:10.016 INFO:teuthology.orchestra.run.smithi155.stdout: "duration": 5.6570000000000002e-05 2023-08-01T19:55:10.016 INFO:teuthology.orchestra.run.smithi155.stdout: }, 2023-08-01T19:55:10.016 INFO:teuthology.orchestra.run.smithi155.stdout: { 2023-08-01T19:55:10.016 INFO:teuthology.orchestra.run.smithi155.stdout: "event": "started", 2023-08-01T19:55:10.016 INFO:teuthology.orchestra.run.smithi155.stdout: "time": "2023-08-01T19:55:05.218940+0000", 2023-08-01T19:55:10.016 INFO:teuthology.orchestra.run.smithi155.stdout: "duration": 2.1804e-05 2023-08-01T19:55:10.017 INFO:teuthology.orchestra.run.smithi155.stdout: }, 2023-08-01T19:55:10.017 INFO:teuthology.orchestra.run.smithi155.stdout: { 2023-08-01T19:55:10.017 INFO:teuthology.orchestra.run.smithi155.stdout: "event": "commit_sent", 2023-08-01T19:55:10.017 INFO:teuthology.orchestra.run.smithi155.stdout: "time": "2023-08-01T19:55:05.224928+0000", 2023-08-01T19:55:10.017 INFO:teuthology.orchestra.run.smithi155.stdout: "duration": 0.0059876759999999999 2023-08-01T19:55:10.017 INFO:teuthology.orchestra.run.smithi155.stdout: }, 2023-08-01T19:55:10.017 INFO:teuthology.orchestra.run.smithi155.stdout: { 2023-08-01T19:55:10.017 INFO:teuthology.orchestra.run.smithi155.stdout: "event": "done", 2023-08-01T19:55:10.018 INFO:teuthology.orchestra.run.smithi155.stdout: "time": "2023-08-01T19:55:05.224971+0000", 2023-08-01T19:55:10.018 INFO:teuthology.orchestra.run.smithi155.stdout: "duration": 4.2929999999999997e-05 2023-08-01T19:55:10.018 INFO:teuthology.orchestra.run.smithi155.stdout: } 2023-08-01T19:55:10.018 INFO:teuthology.orchestra.run.smithi155.stdout: ] 2023-08-01T19:55:10.018 INFO:teuthology.orchestra.run.smithi155.stdout: } 2023-08-01T19:55:10.018 INFO:teuthology.orchestra.run.smithi155.stdout: }, 2023-08-01T19:55:10.018 INFO:teuthology.orchestra.run.smithi155.stdout: { 2023-08-01T19:55:10.018 INFO:teuthology.orchestra.run.smithi155.stdout: "description": "osd_op(client.4668.0:100927 5.0 5:00608ec6:::benchmark_data_smithi006_114134_object100926:head [set-alloc-hint object_size 65536 write_size 65536,write 0~65536] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e37)", 2023-08-01T19:55:10.019 INFO:teuthology.orchestra.run.smithi155.stdout: "initiated_at": "2023-08-01T19:55:05.561169+0000", 2023-08-01T19:55:10.019 INFO:teuthology.orchestra.run.smithi155.stdout: "age": 4.3151794380000004, 2023-08-01T19:55:10.019 INFO:teuthology.orchestra.run.smithi155.stdout: "duration": 0.066411687999999997, 2023-08-01T19:55:10.019 INFO:teuthology.orchestra.run.smithi155.stdout: "type_data": { 2023-08-01T19:55:10.019 INFO:teuthology.orchestra.run.smithi155.stdout: "flag_point": "commit sent; apply or cleanup", 2023-08-01T19:55:10.019 INFO:teuthology.orchestra.run.smithi155.stdout: "client_info": { 2023-08-01T19:55:10.019 INFO:teuthology.orchestra.run.smithi155.stdout: "client": "client.4668", 2023-08-01T19:55:10.019 INFO:teuthology.orchestra.run.smithi155.stdout: "client_addr": "172.21.15.6:0/1709472247", 2023-08-01T19:55:10.020 INFO:teuthology.orchestra.run.smithi155.stdout: "tid": 100927 2023-08-01T19:55:10.020 INFO:teuthology.orchestra.run.smithi155.stdout: }, 2023-08-01T19:55:10.020 INFO:teuthology.orchestra.run.smithi155.stdout: "events": [ 2023-08-01T19:55:10.020 INFO:teuthology.orchestra.run.smithi155.stdout: { 2023-08-01T19:55:10.020 INFO:teuthology.orchestra.run.smithi155.stdout: "event": "initiated", 2023-08-01T19:55:10.020 INFO:teuthology.orchestra.run.smithi155.stdout: "time": "2023-08-01T19:55:05.561169+0000", 2023-08-01T19:55:10.020 INFO:teuthology.orchestra.run.smithi155.stdout: "duration": 0 2023-08-01T19:55:10.021 INFO:teuthology.orchestra.run.smithi155.stdout: }, 2023-08-01T19:55:10.021 INFO:teuthology.orchestra.run.smithi155.stdout: { 2023-08-01T19:55:10.021 INFO:teuthology.orchestra.run.smithi155.stdout: "event": "throttled", 2023-08-01T19:55:10.021 INFO:teuthology.orchestra.run.smithi155.stdout: "time": "2023-08-01T19:55:05.561169+0000", 2023-08-01T19:55:10.021 INFO:teuthology.orchestra.run.smithi155.stdout: "duration": 0 2023-08-01T19:55:10.021 INFO:teuthology.orchestra.run.smithi155.stdout: }, 2023-08-01T19:55:10.021 INFO:teuthology.orchestra.run.smithi155.stdout: { 2023-08-01T19:55:10.021 INFO:teuthology.orchestra.run.smithi155.stdout: "event": "header_read", 2023-08-01T19:55:10.022 INFO:teuthology.orchestra.run.smithi155.stdout: "time": "2023-08-01T19:55:05.561168+0000", 2023-08-01T19:55:10.022 INFO:teuthology.orchestra.run.smithi155.stdout: "duration": 4294967295.9999995 2023-08-01T19:55:10.022 INFO:teuthology.orchestra.run.smithi155.stdout: }, 2023-08-01T19:55:10.022 INFO:teuthology.orchestra.run.smithi155.stdout: { 2023-08-01T19:55:10.022 INFO:teuthology.orchestra.run.smithi155.stdout: "event": "all_read", 2023-08-01T19:55:10.022 INFO:teuthology.orchestra.run.smithi155.stdout: "time": "2023-08-01T19:55:05.561218+0000", 2023-08-01T19:55:10.022 INFO:teuthology.orchestra.run.smithi155.stdout: "duration": 4.9379999999999998e-05 2023-08-01T19:55:10.022 INFO:teuthology.orchestra.run.smithi155.stdout: }, 2023-08-01T19:55:10.023 INFO:teuthology.orchestra.run.smithi155.stdout: { 2023-08-01T19:55:10.023 INFO:teuthology.orchestra.run.smithi155.stdout: "event": "dispatched", 2023-08-01T19:55:10.023 INFO:teuthology.orchestra.run.smithi155.stdout: "time": "2023-08-01T19:55:05.561225+0000", 2023-08-01T19:55:10.023 INFO:teuthology.orchestra.run.smithi155.stdout: "duration": 7.114e-06 2023-08-01T19:55:10.023 INFO:teuthology.orchestra.run.smithi155.stdout: }, 2023-08-01T19:55:10.023 INFO:teuthology.orchestra.run.smithi155.stdout: { 2023-08-01T19:55:10.023 INFO:teuthology.orchestra.run.smithi155.stdout: "event": "queued_for_pg", 2023-08-01T19:55:10.023 INFO:teuthology.orchestra.run.smithi155.stdout: "time": "2023-08-01T19:55:05.561229+0000", 2023-08-01T19:55:10.024 INFO:teuthology.orchestra.run.smithi155.stdout: "duration": 4.2180000000000001e-06 2023-08-01T19:55:10.024 INFO:teuthology.orchestra.run.smithi155.stdout: }, 2023-08-01T19:55:10.024 INFO:teuthology.orchestra.run.smithi155.stdout: { 2023-08-01T19:55:10.024 INFO:teuthology.orchestra.run.smithi155.stdout: "event": "reached_pg", 2023-08-01T19:55:10.024 INFO:teuthology.orchestra.run.smithi155.stdout: "time": "2023-08-01T19:55:05.564737+0000", 2023-08-01T19:55:10.024 INFO:teuthology.orchestra.run.smithi155.stdout: "duration": 0.0035081869999999999 2023-08-01T19:55:10.024 INFO:teuthology.orchestra.run.smithi155.stdout: }, 2023-08-01T19:55:10.024 INFO:teuthology.orchestra.run.smithi155.stdout: { 2023-08-01T19:55:10.025 INFO:teuthology.orchestra.run.smithi155.stdout: "event": "started", 2023-08-01T19:55:10.025 INFO:teuthology.orchestra.run.smithi155.stdout: "time": "2023-08-01T19:55:05.564859+0000", 2023-08-01T19:55:10.025 INFO:teuthology.orchestra.run.smithi155.stdout: "duration": 0.00012165800000000001 2023-08-01T19:55:10.025 INFO:teuthology.orchestra.run.smithi155.stdout: }, 2023-08-01T19:55:10.025 INFO:teuthology.orchestra.run.smithi155.stdout: { 2023-08-01T19:55:10.025 INFO:teuthology.orchestra.run.smithi155.stdout: "event": "waiting for subops from 0", 2023-08-01T19:55:10.025 INFO:teuthology.orchestra.run.smithi155.stdout: "time": "2023-08-01T19:55:05.565009+0000", 2023-08-01T19:55:10.025 INFO:teuthology.orchestra.run.smithi155.stdout: "duration": 0.00014979699999999999 2023-08-01T19:55:10.026 INFO:teuthology.orchestra.run.smithi155.stdout: }, 2023-08-01T19:55:10.026 INFO:teuthology.orchestra.run.smithi155.stdout: { 2023-08-01T19:55:10.026 INFO:teuthology.orchestra.run.smithi155.stdout: "event": "op_commit", 2023-08-01T19:55:10.026 INFO:teuthology.orchestra.run.smithi155.stdout: "time": "2023-08-01T19:55:05.568007+0000", 2023-08-01T19:55:10.026 INFO:teuthology.orchestra.run.smithi155.stdout: "duration": 0.00299796 2023-08-01T19:55:10.026 INFO:teuthology.orchestra.run.smithi155.stdout: }, 2023-08-01T19:55:10.026 INFO:teuthology.orchestra.run.smithi155.stdout: { 2023-08-01T19:55:10.026 INFO:teuthology.orchestra.run.smithi155.stdout: "event": "sub_op_commit_rec", 2023-08-01T19:55:10.027 INFO:teuthology.orchestra.run.smithi155.stdout: "time": "2023-08-01T19:55:05.627520+0000", 2023-08-01T19:55:10.027 INFO:teuthology.orchestra.run.smithi155.stdout: "duration": 0.059513636000000002 2023-08-01T19:55:10.027 INFO:teuthology.orchestra.run.smithi155.stdout: }, 2023-08-01T19:55:10.027 INFO:teuthology.orchestra.run.smithi155.stdout: { 2023-08-01T19:55:10.027 INFO:teuthology.orchestra.run.smithi155.stdout: "event": "commit_sent", 2023-08-01T19:55:10.027 INFO:teuthology.orchestra.run.smithi155.stdout: "time": "2023-08-01T19:55:05.627553+0000", 2023-08-01T19:55:10.027 INFO:teuthology.orchestra.run.smithi155.stdout: "duration": 3.2635999999999997e-05 2023-08-01T19:55:10.027 INFO:teuthology.orchestra.run.smithi155.stdout: }, 2023-08-01T19:55:10.028 INFO:teuthology.orchestra.run.smithi155.stdout: { 2023-08-01T19:55:10.028 INFO:teuthology.orchestra.run.smithi155.stdout: "event": "done", 2023-08-01T19:55:10.028 INFO:teuthology.orchestra.run.smithi155.stdout: "time": "2023-08-01T19:55:05.627581+0000", 2023-08-01T19:55:10.028 INFO:teuthology.orchestra.run.smithi155.stdout: "duration": 2.7681000000000001e-05 2023-08-01T19:55:10.028 INFO:teuthology.orchestra.run.smithi155.stdout: } 2023-08-01T19:55:10.029 INFO:teuthology.orchestra.run.smithi155.stdout: ] 2023-08-01T19:55:10.029 INFO:teuthology.orchestra.run.smithi155.stdout: } 2023-08-01T19:55:10.029 INFO:teuthology.orchestra.run.smithi155.stdout: }, 2023-08-01T19:55:10.029 INFO:teuthology.orchestra.run.smithi155.stdout: { 2023-08-01T19:55:10.029 INFO:teuthology.orchestra.run.smithi155.stdout: "description": "osd_op(client.4668.0:100935 5.e 5:7895b14e:::benchmark_data_smithi006_114134_object100934:head [set-alloc-hint object_size 65536 write_size 65536,write 0~65536] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e37)", 2023-08-01T19:55:10.029 INFO:teuthology.orchestra.run.smithi155.stdout: "initiated_at": "2023-08-01T19:55:05.566666+0000", 2023-08-01T19:55:10.030 INFO:teuthology.orchestra.run.smithi155.stdout: "age": 4.3096821380000003, 2023-08-01T19:55:10.030 INFO:teuthology.orchestra.run.smithi155.stdout: "duration": 0.064309016999999996, 2023-08-01T19:55:10.030 INFO:teuthology.orchestra.run.smithi155.stdout: "type_data": { 2023-08-01T19:55:10.030 INFO:teuthology.orchestra.run.smithi155.stdout: "flag_point": "commit sent; apply or cleanup", 2023-08-01T19:55:10.030 INFO:teuthology.orchestra.run.smithi155.stdout: "client_info": { 2023-08-01T19:55:10.030 INFO:teuthology.orchestra.run.smithi155.stdout: "client": "client.4668", 2023-08-01T19:55:10.030 INFO:teuthology.orchestra.run.smithi155.stdout: "client_addr": "172.21.15.6:0/1709472247", 2023-08-01T19:55:10.030 INFO:teuthology.orchestra.run.smithi155.stdout: "tid": 100935 2023-08-01T19:55:10.031 INFO:teuthology.orchestra.run.smithi155.stdout: }, 2023-08-01T19:55:10.031 INFO:teuthology.orchestra.run.smithi155.stdout: "events": [ 2023-08-01T19:55:10.031 INFO:teuthology.orchestra.run.smithi155.stdout: { 2023-08-01T19:55:10.031 INFO:teuthology.orchestra.run.smithi155.stdout: "event": "initiated", 2023-08-01T19:55:10.031 INFO:teuthology.orchestra.run.smithi155.stdout: "time": "2023-08-01T19:55:05.566666+0000", 2023-08-01T19:55:10.031 INFO:teuthology.orchestra.run.smithi155.stdout: "duration": 0 2023-08-01T19:55:10.031 INFO:teuthology.orchestra.run.smithi155.stdout: }, 2023-08-01T19:55:10.031 INFO:teuthology.orchestra.run.smithi155.stdout: { 2023-08-01T19:55:10.032 INFO:teuthology.orchestra.run.smithi155.stdout: "event": "throttled", 2023-08-01T19:55:10.032 INFO:teuthology.orchestra.run.smithi155.stdout: "time": "2023-08-01T19:55:05.566666+0000", 2023-08-01T19:55:10.032 INFO:teuthology.orchestra.run.smithi155.stdout: "duration": 0 2023-08-01T19:55:10.032 INFO:teuthology.orchestra.run.smithi155.stdout: }, 2023-08-01T19:55:10.032 INFO:teuthology.orchestra.run.smithi155.stdout: { 2023-08-01T19:55:10.032 INFO:teuthology.orchestra.run.smithi155.stdout: "event": "header_read", 2023-08-01T19:55:10.032 INFO:teuthology.orchestra.run.smithi155.stdout: "time": "2023-08-01T19:55:05.566665+0000", 2023-08-01T19:55:10.032 INFO:teuthology.orchestra.run.smithi155.stdout: "duration": 4294967295.9999986 2023-08-01T19:55:10.033 INFO:teuthology.orchestra.run.smithi155.stdout: }, 2023-08-01T19:55:10.033 INFO:teuthology.orchestra.run.smithi155.stdout: { 2023-08-01T19:55:10.033 INFO:teuthology.orchestra.run.smithi155.stdout: "event": "all_read", 2023-08-01T19:55:10.033 INFO:teuthology.orchestra.run.smithi155.stdout: "time": "2023-08-01T19:55:05.566754+0000", 2023-08-01T19:55:10.033 INFO:teuthology.orchestra.run.smithi155.stdout: "duration": 8.9425999999999994e-05 2023-08-01T19:55:10.033 INFO:teuthology.orchestra.run.smithi155.stdout: }, 2023-08-01T19:55:10.033 INFO:teuthology.orchestra.run.smithi155.stdout: { 2023-08-01T19:55:10.034 INFO:teuthology.orchestra.run.smithi155.stdout: "event": "dispatched", 2023-08-01T19:55:10.034 INFO:teuthology.orchestra.run.smithi155.stdout: "time": "2023-08-01T19:55:05.566766+0000", 2023-08-01T19:55:10.034 INFO:teuthology.orchestra.run.smithi155.stdout: "duration": 1.2018000000000001e-05 2023-08-01T19:55:10.034 INFO:teuthology.orchestra.run.smithi155.stdout: }, 2023-08-01T19:55:10.034 INFO:teuthology.orchestra.run.smithi155.stdout: { 2023-08-01T19:55:10.034 INFO:teuthology.orchestra.run.smithi155.stdout: "event": "queued_for_pg", 2023-08-01T19:55:10.034 INFO:teuthology.orchestra.run.smithi155.stdout: "time": "2023-08-01T19:55:05.566772+0000", 2023-08-01T19:55:10.035 INFO:teuthology.orchestra.run.smithi155.stdout: "duration": 6.0190000000000003e-06 2023-08-01T19:55:10.035 INFO:teuthology.orchestra.run.smithi155.stdout: }, 2023-08-01T19:55:10.035 INFO:teuthology.orchestra.run.smithi155.stdout: { 2023-08-01T19:55:10.035 INFO:teuthology.orchestra.run.smithi155.stdout: "event": "reached_pg", 2023-08-01T19:55:10.035 INFO:teuthology.orchestra.run.smithi155.stdout: "time": "2023-08-01T19:55:05.566800+0000", 2023-08-01T19:55:10.035 INFO:teuthology.orchestra.run.smithi155.stdout: "duration": 2.7835999999999999e-05 2023-08-01T19:55:10.035 INFO:teuthology.orchestra.run.smithi155.stdout: }, 2023-08-01T19:55:10.035 INFO:teuthology.orchestra.run.smithi155.stdout: { 2023-08-01T19:55:10.036 INFO:teuthology.orchestra.run.smithi155.stdout: "event": "started", 2023-08-01T19:55:10.036 INFO:teuthology.orchestra.run.smithi155.stdout: "time": "2023-08-01T19:55:05.566879+0000", 2023-08-01T19:55:10.036 INFO:teuthology.orchestra.run.smithi155.stdout: "duration": 7.9105999999999998e-05 2023-08-01T19:55:10.036 INFO:teuthology.orchestra.run.smithi155.stdout: }, 2023-08-01T19:55:10.036 INFO:teuthology.orchestra.run.smithi155.stdout: { 2023-08-01T19:55:10.036 INFO:teuthology.orchestra.run.smithi155.stdout: "event": "waiting for subops from 0", 2023-08-01T19:55:10.036 INFO:teuthology.orchestra.run.smithi155.stdout: "time": "2023-08-01T19:55:05.566971+0000", 2023-08-01T19:55:10.037 INFO:teuthology.orchestra.run.smithi155.stdout: "duration": 9.1817999999999994e-05 2023-08-01T19:55:10.037 INFO:teuthology.orchestra.run.smithi155.stdout: }, 2023-08-01T19:55:10.037 INFO:teuthology.orchestra.run.smithi155.stdout: { 2023-08-01T19:55:10.037 INFO:teuthology.orchestra.run.smithi155.stdout: "event": "op_commit", 2023-08-01T19:55:10.037 INFO:teuthology.orchestra.run.smithi155.stdout: "time": "2023-08-01T19:55:05.571475+0000", 2023-08-01T19:55:10.037 INFO:teuthology.orchestra.run.smithi155.stdout: "duration": 0.0045039499999999996 2023-08-01T19:55:10.037 INFO:teuthology.orchestra.run.smithi155.stdout: }, 2023-08-01T19:55:10.037 INFO:teuthology.orchestra.run.smithi155.stdout: { 2023-08-01T19:55:10.038 INFO:teuthology.orchestra.run.smithi155.stdout: "event": "sub_op_commit_rec", 2023-08-01T19:55:10.038 INFO:teuthology.orchestra.run.smithi155.stdout: "time": "2023-08-01T19:55:05.630884+0000", 2023-08-01T19:55:10.038 INFO:teuthology.orchestra.run.smithi155.stdout: "duration": 0.059409181999999998 2023-08-01T19:55:10.038 INFO:teuthology.orchestra.run.smithi155.stdout: }, 2023-08-01T19:55:10.038 INFO:teuthology.orchestra.run.smithi155.stdout: { 2023-08-01T19:55:10.038 INFO:teuthology.orchestra.run.smithi155.stdout: "event": "commit_sent", 2023-08-01T19:55:10.038 INFO:teuthology.orchestra.run.smithi155.stdout: "time": "2023-08-01T19:55:05.630930+0000", 2023-08-01T19:55:10.038 INFO:teuthology.orchestra.run.smithi155.stdout: "duration": 4.5507999999999999e-05 2023-08-01T19:55:10.039 INFO:teuthology.orchestra.run.smithi155.stdout: }, 2023-08-01T19:55:10.039 INFO:teuthology.orchestra.run.smithi155.stdout: { 2023-08-01T19:55:10.039 INFO:teuthology.orchestra.run.smithi155.stdout: "event": "done", 2023-08-01T19:55:10.039 INFO:teuthology.orchestra.run.smithi155.stdout: "time": "2023-08-01T19:55:05.630975+0000", 2023-08-01T19:55:10.039 INFO:teuthology.orchestra.run.smithi155.stdout: "duration": 4.5441000000000001e-05 2023-08-01T19:55:10.039 INFO:teuthology.orchestra.run.smithi155.stdout: } 2023-08-01T19:55:10.039 INFO:teuthology.orchestra.run.smithi155.stdout: ] 2023-08-01T19:55:10.039 INFO:teuthology.orchestra.run.smithi155.stdout: } 2023-08-01T19:55:10.040 INFO:teuthology.orchestra.run.smithi155.stdout: }, 2023-08-01T19:55:10.040 INFO:teuthology.orchestra.run.smithi155.stdout: { 2023-08-01T19:55:10.040 INFO:teuthology.orchestra.run.smithi155.stdout: "description": "osd_op(client.4668.0:100941 5.e 5:736a6ac6:::benchmark_data_smithi006_114134_object100940:head [set-alloc-hint object_size 65536 write_size 65536,write 0~65536] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e37)", 2023-08-01T19:55:10.040 INFO:teuthology.orchestra.run.smithi155.stdout: "initiated_at": "2023-08-01T19:55:05.569750+0000", 2023-08-01T19:55:10.040 INFO:teuthology.orchestra.run.smithi155.stdout: "age": 4.306598245, 2023-08-01T19:55:10.040 INFO:teuthology.orchestra.run.smithi155.stdout: "duration": 0.065431331999999995, 2023-08-01T19:55:10.040 INFO:teuthology.orchestra.run.smithi155.stdout: "type_data": { 2023-08-01T19:55:10.040 INFO:teuthology.orchestra.run.smithi155.stdout: "flag_point": "commit sent; apply or cleanup", 2023-08-01T19:55:10.041 INFO:teuthology.orchestra.run.smithi155.stdout: "client_info": { 2023-08-01T19:55:10.041 INFO:teuthology.orchestra.run.smithi155.stdout: "client": "client.4668", 2023-08-01T19:55:10.041 INFO:teuthology.orchestra.run.smithi155.stdout: "client_addr": "172.21.15.6:0/1709472247", 2023-08-01T19:55:10.041 INFO:teuthology.orchestra.run.smithi155.stdout: "tid": 100941 2023-08-01T19:55:10.041 INFO:teuthology.orchestra.run.smithi155.stdout: }, 2023-08-01T19:55:10.041 INFO:teuthology.orchestra.run.smithi155.stdout: "events": [ 2023-08-01T19:55:10.041 INFO:teuthology.orchestra.run.smithi155.stdout: { 2023-08-01T19:55:10.042 INFO:teuthology.orchestra.run.smithi155.stdout: "event": "initiated", 2023-08-01T19:55:10.042 INFO:teuthology.orchestra.run.smithi155.stdout: "time": "2023-08-01T19:55:05.569750+0000", 2023-08-01T19:55:10.042 INFO:teuthology.orchestra.run.smithi155.stdout: "duration": 0 2023-08-01T19:55:10.042 INFO:teuthology.orchestra.run.smithi155.stdout: }, 2023-08-01T19:55:10.042 INFO:teuthology.orchestra.run.smithi155.stdout: { 2023-08-01T19:55:10.042 INFO:teuthology.orchestra.run.smithi155.stdout: "event": "throttled", 2023-08-01T19:55:10.042 INFO:teuthology.orchestra.run.smithi155.stdout: "time": "2023-08-01T19:55:05.569750+0000", 2023-08-01T19:55:10.042 INFO:teuthology.orchestra.run.smithi155.stdout: "duration": 0 2023-08-01T19:55:10.043 INFO:teuthology.orchestra.run.smithi155.stdout: }, 2023-08-01T19:55:10.043 INFO:teuthology.orchestra.run.smithi155.stdout: { 2023-08-01T19:55:10.043 INFO:teuthology.orchestra.run.smithi155.stdout: "event": "header_read", 2023-08-01T19:55:10.043 INFO:teuthology.orchestra.run.smithi155.stdout: "time": "2023-08-01T19:55:05.569749+0000", 2023-08-01T19:55:10.043 INFO:teuthology.orchestra.run.smithi155.stdout: "duration": 4294967295.999999 2023-08-01T19:55:10.043 INFO:teuthology.orchestra.run.smithi155.stdout: }, 2023-08-01T19:55:10.043 INFO:teuthology.orchestra.run.smithi155.stdout: { 2023-08-01T19:55:10.043 INFO:teuthology.orchestra.run.smithi155.stdout: "event": "all_read", 2023-08-01T19:55:10.044 INFO:teuthology.orchestra.run.smithi155.stdout: "time": "2023-08-01T19:55:05.569861+0000", 2023-08-01T19:55:10.044 INFO:teuthology.orchestra.run.smithi155.stdout: "duration": 0.000111333 2023-08-01T19:55:10.044 INFO:teuthology.orchestra.run.smithi155.stdout: }, 2023-08-01T19:55:10.044 INFO:teuthology.orchestra.run.smithi155.stdout: { 2023-08-01T19:55:10.044 INFO:teuthology.orchestra.run.smithi155.stdout: "event": "dispatched", 2023-08-01T19:55:10.044 INFO:teuthology.orchestra.run.smithi155.stdout: "time": "2023-08-01T19:55:05.569869+0000", 2023-08-01T19:55:10.044 INFO:teuthology.orchestra.run.smithi155.stdout: "duration": 8.8589999999999994e-06 2023-08-01T19:55:10.044 INFO:teuthology.orchestra.run.smithi155.stdout: }, 2023-08-01T19:55:10.045 INFO:teuthology.orchestra.run.smithi155.stdout: { 2023-08-01T19:55:10.045 INFO:teuthology.orchestra.run.smithi155.stdout: "event": "queued_for_pg", 2023-08-01T19:55:10.045 INFO:teuthology.orchestra.run.smithi155.stdout: "time": "2023-08-01T19:55:05.569874+0000", 2023-08-01T19:55:10.045 INFO:teuthology.orchestra.run.smithi155.stdout: "duration": 4.1679999999999997e-06 2023-08-01T19:55:10.045 INFO:teuthology.orchestra.run.smithi155.stdout: }, 2023-08-01T19:55:10.045 INFO:teuthology.orchestra.run.smithi155.stdout: { 2023-08-01T19:55:10.045 INFO:teuthology.orchestra.run.smithi155.stdout: "event": "reached_pg", 2023-08-01T19:55:10.045 INFO:teuthology.orchestra.run.smithi155.stdout: "time": "2023-08-01T19:55:05.569904+0000", 2023-08-01T19:55:10.046 INFO:teuthology.orchestra.run.smithi155.stdout: "duration": 3.0920999999999998e-05 2023-08-01T19:55:10.046 INFO:teuthology.orchestra.run.smithi155.stdout: }, 2023-08-01T19:55:10.046 INFO:teuthology.orchestra.run.smithi155.stdout: { 2023-08-01T19:55:10.046 INFO:teuthology.orchestra.run.smithi155.stdout: "event": "started", 2023-08-01T19:55:10.046 INFO:teuthology.orchestra.run.smithi155.stdout: "time": "2023-08-01T19:55:05.569998+0000", 2023-08-01T19:55:10.046 INFO:teuthology.orchestra.run.smithi155.stdout: "duration": 9.3086999999999998e-05 2023-08-01T19:55:10.046 INFO:teuthology.orchestra.run.smithi155.stdout: }, 2023-08-01T19:55:10.046 INFO:teuthology.orchestra.run.smithi155.stdout: { 2023-08-01T19:55:10.047 INFO:teuthology.orchestra.run.smithi155.stdout: "event": "waiting for subops from 0", 2023-08-01T19:55:10.047 INFO:teuthology.orchestra.run.smithi155.stdout: "time": "2023-08-01T19:55:05.570093+0000", 2023-08-01T19:55:10.047 INFO:teuthology.orchestra.run.smithi155.stdout: "duration": 9.5768999999999997e-05 2023-08-01T19:55:10.047 INFO:teuthology.orchestra.run.smithi155.stdout: }, 2023-08-01T19:55:10.047 INFO:teuthology.orchestra.run.smithi155.stdout: { 2023-08-01T19:55:10.047 INFO:teuthology.orchestra.run.smithi155.stdout: "event": "op_commit", 2023-08-01T19:55:10.047 INFO:teuthology.orchestra.run.smithi155.stdout: "time": "2023-08-01T19:55:05.572839+0000", 2023-08-01T19:55:10.048 INFO:teuthology.orchestra.run.smithi155.stdout: "duration": 0.0027460050000000001 2023-08-01T19:55:10.048 INFO:teuthology.orchestra.run.smithi155.stdout: }, 2023-08-01T19:55:10.048 INFO:teuthology.orchestra.run.smithi155.stdout: { 2023-08-01T19:55:10.048 INFO:teuthology.orchestra.run.smithi155.stdout: "event": "sub_op_commit_rec", 2023-08-01T19:55:10.048 INFO:teuthology.orchestra.run.smithi155.stdout: "time": "2023-08-01T19:55:05.635114+0000", 2023-08-01T19:55:10.048 INFO:teuthology.orchestra.run.smithi155.stdout: "duration": 0.062274297999999999 2023-08-01T19:55:10.048 INFO:teuthology.orchestra.run.smithi155.stdout: }, 2023-08-01T19:55:10.048 INFO:teuthology.orchestra.run.smithi155.stdout: { 2023-08-01T19:55:10.049 INFO:teuthology.orchestra.run.smithi155.stdout: "event": "commit_sent", 2023-08-01T19:55:10.049 INFO:teuthology.orchestra.run.smithi155.stdout: "time": "2023-08-01T19:55:05.635143+0000", 2023-08-01T19:55:10.049 INFO:teuthology.orchestra.run.smithi155.stdout: "duration": 2.9430000000000001e-05 2023-08-01T19:55:10.049 INFO:teuthology.orchestra.run.smithi155.stdout: }, 2023-08-01T19:55:10.049 INFO:teuthology.orchestra.run.smithi155.stdout: { 2023-08-01T19:55:10.049 INFO:teuthology.orchestra.run.smithi155.stdout: "event": "done", 2023-08-01T19:55:10.049 INFO:teuthology.orchestra.run.smithi155.stdout: "time": "2023-08-01T19:55:05.635181+0000", 2023-08-01T19:55:10.050 INFO:teuthology.orchestra.run.smithi155.stdout: "duration": 3.8352000000000001e-05 2023-08-01T19:55:10.050 INFO:teuthology.orchestra.run.smithi155.stdout: } 2023-08-01T19:55:10.050 INFO:teuthology.orchestra.run.smithi155.stdout: ] 2023-08-01T19:55:10.050 INFO:teuthology.orchestra.run.smithi155.stdout: } 2023-08-01T19:55:10.050 INFO:teuthology.orchestra.run.smithi155.stdout: }, 2023-08-01T19:55:10.050 INFO:teuthology.orchestra.run.smithi155.stdout: { 2023-08-01T19:55:10.050 INFO:teuthology.orchestra.run.smithi155.stdout: "description": "osd_op(client.4668.0:100944 5.4 5:25fae865:::benchmark_data_smithi006_114134_object100943:head [set-alloc-hint object_size 65536 write_size 65536,write 0~65536] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e37)", 2023-08-01T19:55:10.050 INFO:teuthology.orchestra.run.smithi155.stdout: "initiated_at": "2023-08-01T19:55:05.576662+0000", 2023-08-01T19:55:10.051 INFO:teuthology.orchestra.run.smithi155.stdout: "age": 4.2996865480000004, 2023-08-01T19:55:10.051 INFO:teuthology.orchestra.run.smithi155.stdout: "duration": 0.056054925999999998, 2023-08-01T19:55:10.051 INFO:teuthology.orchestra.run.smithi155.stdout: "type_data": { 2023-08-01T19:55:10.051 INFO:teuthology.orchestra.run.smithi155.stdout: "flag_point": "commit sent; apply or cleanup", 2023-08-01T19:55:10.051 INFO:teuthology.orchestra.run.smithi155.stdout: "client_info": { 2023-08-01T19:55:10.051 INFO:teuthology.orchestra.run.smithi155.stdout: "client": "client.4668", 2023-08-01T19:55:10.051 INFO:teuthology.orchestra.run.smithi155.stdout: "client_addr": "172.21.15.6:0/1709472247", 2023-08-01T19:55:10.052 INFO:teuthology.orchestra.run.smithi155.stdout: "tid": 100944 2023-08-01T19:55:10.052 INFO:teuthology.orchestra.run.smithi155.stdout: }, 2023-08-01T19:55:10.052 INFO:teuthology.orchestra.run.smithi155.stdout: "events": [ 2023-08-01T19:55:10.052 INFO:teuthology.orchestra.run.smithi155.stdout: { 2023-08-01T19:55:10.052 INFO:teuthology.orchestra.run.smithi155.stdout: "event": "initiated", 2023-08-01T19:55:10.052 INFO:teuthology.orchestra.run.smithi155.stdout: "time": "2023-08-01T19:55:05.576662+0000", 2023-08-01T19:55:10.052 INFO:teuthology.orchestra.run.smithi155.stdout: "duration": 0 2023-08-01T19:55:10.052 INFO:teuthology.orchestra.run.smithi155.stdout: }, 2023-08-01T19:55:10.053 INFO:teuthology.orchestra.run.smithi155.stdout: { 2023-08-01T19:55:10.053 INFO:teuthology.orchestra.run.smithi155.stdout: "event": "throttled", 2023-08-01T19:55:10.053 INFO:teuthology.orchestra.run.smithi155.stdout: "time": "2023-08-01T19:55:05.576662+0000", 2023-08-01T19:55:10.053 INFO:teuthology.orchestra.run.smithi155.stdout: "duration": 0 2023-08-01T19:55:10.053 INFO:teuthology.orchestra.run.smithi155.stdout: }, 2023-08-01T19:55:10.053 INFO:teuthology.orchestra.run.smithi155.stdout: { 2023-08-01T19:55:10.053 INFO:teuthology.orchestra.run.smithi155.stdout: "event": "header_read", 2023-08-01T19:55:10.053 INFO:teuthology.orchestra.run.smithi155.stdout: "time": "2023-08-01T19:55:05.576661+0000", 2023-08-01T19:55:10.054 INFO:teuthology.orchestra.run.smithi155.stdout: "duration": 4294967295.999999 2023-08-01T19:55:10.054 INFO:teuthology.orchestra.run.smithi155.stdout: }, 2023-08-01T19:55:10.054 INFO:teuthology.orchestra.run.smithi155.stdout: { 2023-08-01T19:55:10.054 INFO:teuthology.orchestra.run.smithi155.stdout: "event": "all_read", 2023-08-01T19:55:10.054 INFO:teuthology.orchestra.run.smithi155.stdout: "time": "2023-08-01T19:55:05.576725+0000", 2023-08-01T19:55:10.054 INFO:teuthology.orchestra.run.smithi155.stdout: "duration": 6.4435000000000002e-05 2023-08-01T19:55:10.054 INFO:teuthology.orchestra.run.smithi155.stdout: }, 2023-08-01T19:55:10.054 INFO:teuthology.orchestra.run.smithi155.stdout: { 2023-08-01T19:55:10.055 INFO:teuthology.orchestra.run.smithi155.stdout: "event": "dispatched", 2023-08-01T19:55:10.055 INFO:teuthology.orchestra.run.smithi155.stdout: "time": "2023-08-01T19:55:05.576744+0000", 2023-08-01T19:55:10.055 INFO:teuthology.orchestra.run.smithi155.stdout: "duration": 1.8502999999999999e-05 2023-08-01T19:55:10.055 INFO:teuthology.orchestra.run.smithi155.stdout: }, 2023-08-01T19:55:10.055 INFO:teuthology.orchestra.run.smithi155.stdout: { 2023-08-01T19:55:10.055 INFO:teuthology.orchestra.run.smithi155.stdout: "event": "queued_for_pg", 2023-08-01T19:55:10.055 INFO:teuthology.orchestra.run.smithi155.stdout: "time": "2023-08-01T19:55:05.576772+0000", 2023-08-01T19:55:10.055 INFO:teuthology.orchestra.run.smithi155.stdout: "duration": 2.8354999999999999e-05 2023-08-01T19:55:10.056 INFO:teuthology.orchestra.run.smithi155.stdout: }, 2023-08-01T19:55:10.056 INFO:teuthology.orchestra.run.smithi155.stdout: { 2023-08-01T19:55:10.056 INFO:teuthology.orchestra.run.smithi155.stdout: "event": "reached_pg", 2023-08-01T19:55:10.056 INFO:teuthology.orchestra.run.smithi155.stdout: "time": "2023-08-01T19:55:05.576815+0000", 2023-08-01T19:55:10.056 INFO:teuthology.orchestra.run.smithi155.stdout: "duration": 4.3223999999999998e-05 2023-08-01T19:55:10.056 INFO:teuthology.orchestra.run.smithi155.stdout: }, 2023-08-01T19:55:10.056 INFO:teuthology.orchestra.run.smithi155.stdout: { 2023-08-01T19:55:10.057 INFO:teuthology.orchestra.run.smithi155.stdout: "event": "started", 2023-08-01T19:55:10.057 INFO:teuthology.orchestra.run.smithi155.stdout: "time": "2023-08-01T19:55:05.576961+0000", 2023-08-01T19:55:10.057 INFO:teuthology.orchestra.run.smithi155.stdout: "duration": 0.000145043 2023-08-01T19:55:10.057 INFO:teuthology.orchestra.run.smithi155.stdout: }, 2023-08-01T19:55:10.057 INFO:teuthology.orchestra.run.smithi155.stdout: { 2023-08-01T19:55:10.057 INFO:teuthology.orchestra.run.smithi155.stdout: "event": "waiting for subops from 0", 2023-08-01T19:55:10.057 INFO:teuthology.orchestra.run.smithi155.stdout: "time": "2023-08-01T19:55:05.577343+0000", 2023-08-01T19:55:10.057 INFO:teuthology.orchestra.run.smithi155.stdout: "duration": 0.00038249699999999998 2023-08-01T19:55:10.058 INFO:teuthology.orchestra.run.smithi155.stdout: }, 2023-08-01T19:55:10.058 INFO:teuthology.orchestra.run.smithi155.stdout: { 2023-08-01T19:55:10.058 INFO:teuthology.orchestra.run.smithi155.stdout: "event": "op_commit", 2023-08-01T19:55:10.058 INFO:teuthology.orchestra.run.smithi155.stdout: "time": "2023-08-01T19:55:05.582349+0000", 2023-08-01T19:55:10.058 INFO:teuthology.orchestra.run.smithi155.stdout: "duration": 0.0050062880000000002 2023-08-01T19:55:10.058 INFO:teuthology.orchestra.run.smithi155.stdout: }, 2023-08-01T19:55:10.058 INFO:teuthology.orchestra.run.smithi155.stdout: { 2023-08-01T19:55:10.058 INFO:teuthology.orchestra.run.smithi155.stdout: "event": "sub_op_commit_rec", 2023-08-01T19:55:10.059 INFO:teuthology.orchestra.run.smithi155.stdout: "time": "2023-08-01T19:55:05.632659+0000", 2023-08-01T19:55:10.059 INFO:teuthology.orchestra.run.smithi155.stdout: "duration": 0.050309185999999999 2023-08-01T19:55:10.059 INFO:teuthology.orchestra.run.smithi155.stdout: }, 2023-08-01T19:55:10.059 INFO:teuthology.orchestra.run.smithi155.stdout: { 2023-08-01T19:55:10.059 INFO:teuthology.orchestra.run.smithi155.stdout: "event": "commit_sent", 2023-08-01T19:55:10.059 INFO:teuthology.orchestra.run.smithi155.stdout: "time": "2023-08-01T19:55:05.632692+0000", 2023-08-01T19:55:10.059 INFO:teuthology.orchestra.run.smithi155.stdout: "duration": 3.3077999999999997e-05 2023-08-01T19:55:10.060 INFO:teuthology.orchestra.run.smithi155.stdout: }, 2023-08-01T19:55:10.060 INFO:teuthology.orchestra.run.smithi155.stdout: { 2023-08-01T19:55:10.060 INFO:teuthology.orchestra.run.smithi155.stdout: "event": "done", 2023-08-01T19:55:10.060 INFO:teuthology.orchestra.run.smithi155.stdout: "time": "2023-08-01T19:55:05.632717+0000", 2023-08-01T19:55:10.060 INFO:teuthology.orchestra.run.smithi155.stdout: "duration": 2.5119000000000001e-05 2023-08-01T19:55:10.060 INFO:teuthology.orchestra.run.smithi155.stdout: } 2023-08-01T19:55:10.060 INFO:teuthology.orchestra.run.smithi155.stdout: ] 2023-08-01T19:55:10.061 INFO:teuthology.orchestra.run.smithi155.stdout: } 2023-08-01T19:55:10.061 INFO:teuthology.orchestra.run.smithi155.stdout: }, 2023-08-01T19:55:10.061 INFO:teuthology.orchestra.run.smithi155.stdout: { 2023-08-01T19:55:10.061 INFO:teuthology.orchestra.run.smithi155.stdout: "description": "osd_op(client.4668.0:100945 5.e 5:73df68dd:::benchmark_data_smithi006_114134_object100944:head [set-alloc-hint object_size 65536 write_size 65536,write 0~65536] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e37)", 2023-08-01T19:55:10.061 INFO:teuthology.orchestra.run.smithi155.stdout: "initiated_at": "2023-08-01T19:55:05.576784+0000", 2023-08-01T19:55:10.061 INFO:teuthology.orchestra.run.smithi155.stdout: "age": 4.2995646599999997, 2023-08-01T19:55:10.061 INFO:teuthology.orchestra.run.smithi155.stdout: "duration": 0.058512994999999998, 2023-08-01T19:55:10.061 INFO:teuthology.orchestra.run.smithi155.stdout: "type_data": { 2023-08-01T19:55:10.062 INFO:teuthology.orchestra.run.smithi155.stdout: "flag_point": "commit sent; apply or cleanup", 2023-08-01T19:55:10.062 INFO:teuthology.orchestra.run.smithi155.stdout: "client_info": { 2023-08-01T19:55:10.062 INFO:teuthology.orchestra.run.smithi155.stdout: "client": "client.4668", 2023-08-01T19:55:10.062 INFO:teuthology.orchestra.run.smithi155.stdout: "client_addr": "172.21.15.6:0/1709472247", 2023-08-01T19:55:10.062 INFO:teuthology.orchestra.run.smithi155.stdout: "tid": 100945 2023-08-01T19:55:10.062 INFO:teuthology.orchestra.run.smithi155.stdout: }, 2023-08-01T19:55:10.062 INFO:teuthology.orchestra.run.smithi155.stdout: "events": [ 2023-08-01T19:55:10.062 INFO:teuthology.orchestra.run.smithi155.stdout: { 2023-08-01T19:55:10.063 INFO:teuthology.orchestra.run.smithi155.stdout: "event": "initiated", 2023-08-01T19:55:10.063 INFO:teuthology.orchestra.run.smithi155.stdout: "time": "2023-08-01T19:55:05.576784+0000", 2023-08-01T19:55:10.063 INFO:teuthology.orchestra.run.smithi155.stdout: "duration": 0 2023-08-01T19:55:10.063 INFO:teuthology.orchestra.run.smithi155.stdout: }, 2023-08-01T19:55:10.063 INFO:teuthology.orchestra.run.smithi155.stdout: { 2023-08-01T19:55:10.063 INFO:teuthology.orchestra.run.smithi155.stdout: "event": "throttled", 2023-08-01T19:55:10.063 INFO:teuthology.orchestra.run.smithi155.stdout: "time": "2023-08-01T19:55:05.576784+0000", 2023-08-01T19:55:10.064 INFO:teuthology.orchestra.run.smithi155.stdout: "duration": 0 2023-08-01T19:55:10.064 INFO:teuthology.orchestra.run.smithi155.stdout: }, 2023-08-01T19:55:10.064 INFO:teuthology.orchestra.run.smithi155.stdout: { 2023-08-01T19:55:10.064 INFO:teuthology.orchestra.run.smithi155.stdout: "event": "header_read", 2023-08-01T19:55:10.064 INFO:teuthology.orchestra.run.smithi155.stdout: "time": "2023-08-01T19:55:05.576783+0000", 2023-08-01T19:55:10.064 INFO:teuthology.orchestra.run.smithi155.stdout: "duration": 4294967295.9999995 2023-08-01T19:55:10.064 INFO:teuthology.orchestra.run.smithi155.stdout: }, 2023-08-01T19:55:10.064 INFO:teuthology.orchestra.run.smithi155.stdout: { 2023-08-01T19:55:10.065 INFO:teuthology.orchestra.run.smithi155.stdout: "event": "all_read", 2023-08-01T19:55:10.065 INFO:teuthology.orchestra.run.smithi155.stdout: "time": "2023-08-01T19:55:05.576807+0000", 2023-08-01T19:55:10.065 INFO:teuthology.orchestra.run.smithi155.stdout: "duration": 2.3651000000000001e-05 2023-08-01T19:55:10.065 INFO:teuthology.orchestra.run.smithi155.stdout: }, 2023-08-01T19:55:10.065 INFO:teuthology.orchestra.run.smithi155.stdout: { 2023-08-01T19:55:10.065 INFO:teuthology.orchestra.run.smithi155.stdout: "event": "dispatched", 2023-08-01T19:55:10.065 INFO:teuthology.orchestra.run.smithi155.stdout: "time": "2023-08-01T19:55:05.576817+0000", 2023-08-01T19:55:10.065 INFO:teuthology.orchestra.run.smithi155.stdout: "duration": 9.9389999999999992e-06 2023-08-01T19:55:10.066 INFO:teuthology.orchestra.run.smithi155.stdout: }, 2023-08-01T19:55:10.066 INFO:teuthology.orchestra.run.smithi155.stdout: { 2023-08-01T19:55:10.066 INFO:teuthology.orchestra.run.smithi155.stdout: "event": "queued_for_pg", 2023-08-01T19:55:10.066 INFO:teuthology.orchestra.run.smithi155.stdout: "time": "2023-08-01T19:55:05.576820+0000", 2023-08-01T19:55:10.066 INFO:teuthology.orchestra.run.smithi155.stdout: "duration": 3.2619999999999999e-06 2023-08-01T19:55:10.066 INFO:teuthology.orchestra.run.smithi155.stdout: }, 2023-08-01T19:55:10.066 INFO:teuthology.orchestra.run.smithi155.stdout: { 2023-08-01T19:55:10.066 INFO:teuthology.orchestra.run.smithi155.stdout: "event": "reached_pg", 2023-08-01T19:55:10.067 INFO:teuthology.orchestra.run.smithi155.stdout: "time": "2023-08-01T19:55:05.576849+0000", 2023-08-01T19:55:10.067 INFO:teuthology.orchestra.run.smithi155.stdout: "duration": 2.8880000000000001e-05 2023-08-01T19:55:10.067 INFO:teuthology.orchestra.run.smithi155.stdout: }, 2023-08-01T19:55:10.067 INFO:teuthology.orchestra.run.smithi155.stdout: { 2023-08-01T19:55:10.067 INFO:teuthology.orchestra.run.smithi155.stdout: "event": "started", 2023-08-01T19:55:10.067 INFO:teuthology.orchestra.run.smithi155.stdout: "time": "2023-08-01T19:55:05.576940+0000", 2023-08-01T19:55:10.067 INFO:teuthology.orchestra.run.smithi155.stdout: "duration": 9.0570999999999997e-05 2023-08-01T19:55:10.067 INFO:teuthology.orchestra.run.smithi155.stdout: }, 2023-08-01T19:55:10.068 INFO:teuthology.orchestra.run.smithi155.stdout: { 2023-08-01T19:55:10.068 INFO:teuthology.orchestra.run.smithi155.stdout: "event": "waiting for subops from 0", 2023-08-01T19:55:10.068 INFO:teuthology.orchestra.run.smithi155.stdout: "time": "2023-08-01T19:55:05.577027+0000", 2023-08-01T19:55:10.068 INFO:teuthology.orchestra.run.smithi155.stdout: "duration": 8.7237999999999994e-05 2023-08-01T19:55:10.068 INFO:teuthology.orchestra.run.smithi155.stdout: }, 2023-08-01T19:55:10.068 INFO:teuthology.orchestra.run.smithi155.stdout: { 2023-08-01T19:55:10.068 INFO:teuthology.orchestra.run.smithi155.stdout: "event": "op_commit", 2023-08-01T19:55:10.069 INFO:teuthology.orchestra.run.smithi155.stdout: "time": "2023-08-01T19:55:05.579624+0000", 2023-08-01T19:55:10.069 INFO:teuthology.orchestra.run.smithi155.stdout: "duration": 0.0025971200000000001 2023-08-01T19:55:10.069 INFO:teuthology.orchestra.run.smithi155.stdout: }, 2023-08-01T19:55:10.069 INFO:teuthology.orchestra.run.smithi155.stdout: { 2023-08-01T19:55:10.069 INFO:teuthology.orchestra.run.smithi155.stdout: "event": "sub_op_commit_rec", 2023-08-01T19:55:10.069 INFO:teuthology.orchestra.run.smithi155.stdout: "time": "2023-08-01T19:55:05.635218+0000", 2023-08-01T19:55:10.069 INFO:teuthology.orchestra.run.smithi155.stdout: "duration": 0.055594487999999997 2023-08-01T19:55:10.070 INFO:teuthology.orchestra.run.smithi155.stdout: }, 2023-08-01T19:55:10.070 INFO:teuthology.orchestra.run.smithi155.stdout: { 2023-08-01T19:55:10.070 INFO:teuthology.orchestra.run.smithi155.stdout: "event": "commit_sent", 2023-08-01T19:55:10.070 INFO:teuthology.orchestra.run.smithi155.stdout: "time": "2023-08-01T19:55:05.635262+0000", 2023-08-01T19:55:10.070 INFO:teuthology.orchestra.run.smithi155.stdout: "duration": 4.3380999999999997e-05 2023-08-01T19:55:10.070 INFO:teuthology.orchestra.run.smithi155.stdout: }, 2023-08-01T19:55:10.070 INFO:teuthology.orchestra.run.smithi155.stdout: { 2023-08-01T19:55:10.070 INFO:teuthology.orchestra.run.smithi155.stdout: "event": "done", 2023-08-01T19:55:10.071 INFO:teuthology.orchestra.run.smithi155.stdout: "time": "2023-08-01T19:55:05.635297+0000", 2023-08-01T19:55:10.071 INFO:teuthology.orchestra.run.smithi155.stdout: "duration": 3.4842000000000003e-05 2023-08-01T19:55:10.071 INFO:teuthology.orchestra.run.smithi155.stdout: } 2023-08-01T19:55:10.071 INFO:teuthology.orchestra.run.smithi155.stdout: ] 2023-08-01T19:55:10.071 INFO:teuthology.orchestra.run.smithi155.stdout: } 2023-08-01T19:55:10.071 INFO:teuthology.orchestra.run.smithi155.stdout: }, 2023-08-01T19:55:10.071 INFO:teuthology.orchestra.run.smithi155.stdout: { 2023-08-01T19:55:10.071 INFO:teuthology.orchestra.run.smithi155.stdout: "description": "osd_op(client.4668.0:100947 5.4 5:23e8fc27:::benchmark_data_smithi006_114134_object100946:head [set-alloc-hint object_size 65536 write_size 65536,write 0~65536] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e37)", 2023-08-01T19:55:10.072 INFO:teuthology.orchestra.run.smithi155.stdout: "initiated_at": "2023-08-01T19:55:05.576840+0000", 2023-08-01T19:55:10.072 INFO:teuthology.orchestra.run.smithi155.stdout: "age": 4.2995086049999998, 2023-08-01T19:55:10.072 INFO:teuthology.orchestra.run.smithi155.stdout: "duration": 0.058423127999999998, 2023-08-01T19:55:10.072 INFO:teuthology.orchestra.run.smithi155.stdout: "type_data": { 2023-08-01T19:55:10.072 INFO:teuthology.orchestra.run.smithi155.stdout: "flag_point": "commit sent; apply or cleanup", 2023-08-01T19:55:10.072 INFO:teuthology.orchestra.run.smithi155.stdout: "client_info": { 2023-08-01T19:55:10.072 INFO:teuthology.orchestra.run.smithi155.stdout: "client": "client.4668", 2023-08-01T19:55:10.073 INFO:teuthology.orchestra.run.smithi155.stdout: "client_addr": "172.21.15.6:0/1709472247", 2023-08-01T19:55:10.073 INFO:teuthology.orchestra.run.smithi155.stdout: "tid": 100947 2023-08-01T19:55:10.073 INFO:teuthology.orchestra.run.smithi155.stdout: }, 2023-08-01T19:55:10.073 INFO:teuthology.orchestra.run.smithi155.stdout: "events": [ 2023-08-01T19:55:10.073 INFO:teuthology.orchestra.run.smithi155.stdout: { 2023-08-01T19:55:10.073 INFO:teuthology.orchestra.run.smithi155.stdout: "event": "initiated", 2023-08-01T19:55:10.073 INFO:teuthology.orchestra.run.smithi155.stdout: "time": "2023-08-01T19:55:05.576840+0000", 2023-08-01T19:55:10.073 INFO:teuthology.orchestra.run.smithi155.stdout: "duration": 0 2023-08-01T19:55:10.074 INFO:teuthology.orchestra.run.smithi155.stdout: }, 2023-08-01T19:55:10.074 INFO:teuthology.orchestra.run.smithi155.stdout: { 2023-08-01T19:55:10.074 INFO:teuthology.orchestra.run.smithi155.stdout: "event": "throttled", 2023-08-01T19:55:10.074 INFO:teuthology.orchestra.run.smithi155.stdout: "time": "2023-08-01T19:55:05.576840+0000", 2023-08-01T19:55:10.074 INFO:teuthology.orchestra.run.smithi155.stdout: "duration": 0 2023-08-01T19:55:10.074 INFO:teuthology.orchestra.run.smithi155.stdout: }, 2023-08-01T19:55:10.074 INFO:teuthology.orchestra.run.smithi155.stdout: { 2023-08-01T19:55:10.074 INFO:teuthology.orchestra.run.smithi155.stdout: "event": "header_read", 2023-08-01T19:55:10.075 INFO:teuthology.orchestra.run.smithi155.stdout: "time": "2023-08-01T19:55:05.576839+0000", 2023-08-01T19:55:10.075 INFO:teuthology.orchestra.run.smithi155.stdout: "duration": 4294967295.9999995 2023-08-01T19:55:10.075 INFO:teuthology.orchestra.run.smithi155.stdout: }, 2023-08-01T19:55:10.075 INFO:teuthology.orchestra.run.smithi155.stdout: { 2023-08-01T19:55:10.075 INFO:teuthology.orchestra.run.smithi155.stdout: "event": "all_read", 2023-08-01T19:55:10.075 INFO:teuthology.orchestra.run.smithi155.stdout: "time": "2023-08-01T19:55:05.576893+0000", 2023-08-01T19:55:10.075 INFO:teuthology.orchestra.run.smithi155.stdout: "duration": 5.3893000000000001e-05 2023-08-01T19:55:10.075 INFO:teuthology.orchestra.run.smithi155.stdout: }, 2023-08-01T19:55:10.076 INFO:teuthology.orchestra.run.smithi155.stdout: { 2023-08-01T19:55:10.076 INFO:teuthology.orchestra.run.smithi155.stdout: "event": "dispatched", 2023-08-01T19:55:10.076 INFO:teuthology.orchestra.run.smithi155.stdout: "time": "2023-08-01T19:55:05.576902+0000", 2023-08-01T19:55:10.076 INFO:teuthology.orchestra.run.smithi155.stdout: "duration": 8.7520000000000002e-06 2023-08-01T19:55:10.076 INFO:teuthology.orchestra.run.smithi155.stdout: }, 2023-08-01T19:55:10.076 INFO:teuthology.orchestra.run.smithi155.stdout: { 2023-08-01T19:55:10.076 INFO:teuthology.orchestra.run.smithi155.stdout: "event": "queued_for_pg", 2023-08-01T19:55:10.076 INFO:teuthology.orchestra.run.smithi155.stdout: "time": "2023-08-01T19:55:05.576905+0000", 2023-08-01T19:55:10.077 INFO:teuthology.orchestra.run.smithi155.stdout: "duration": 3.01e-06 2023-08-01T19:55:10.077 INFO:teuthology.orchestra.run.smithi155.stdout: }, 2023-08-01T19:55:10.077 INFO:teuthology.orchestra.run.smithi155.stdout: { 2023-08-01T19:55:10.077 INFO:teuthology.orchestra.run.smithi155.stdout: "event": "reached_pg", 2023-08-01T19:55:10.077 INFO:teuthology.orchestra.run.smithi155.stdout: "time": "2023-08-01T19:55:05.579641+0000", 2023-08-01T19:55:10.077 INFO:teuthology.orchestra.run.smithi155.stdout: "duration": 0.0027366880000000001 2023-08-01T19:55:10.077 INFO:teuthology.orchestra.run.smithi155.stdout: }, 2023-08-01T19:55:10.078 INFO:teuthology.orchestra.run.smithi155.stdout: { 2023-08-01T19:55:10.078 INFO:teuthology.orchestra.run.smithi155.stdout: "event": "started", 2023-08-01T19:55:10.078 INFO:teuthology.orchestra.run.smithi155.stdout: "time": "2023-08-01T19:55:05.579734+0000", 2023-08-01T19:55:10.078 INFO:teuthology.orchestra.run.smithi155.stdout: "duration": 9.2590000000000006e-05 2023-08-01T19:55:10.078 INFO:teuthology.orchestra.run.smithi155.stdout: }, 2023-08-01T19:55:10.078 INFO:teuthology.orchestra.run.smithi155.stdout: { 2023-08-01T19:55:10.078 INFO:teuthology.orchestra.run.smithi155.stdout: "event": "waiting for subops from 0", 2023-08-01T19:55:10.078 INFO:teuthology.orchestra.run.smithi155.stdout: "time": "2023-08-01T19:55:05.579825+0000", 2023-08-01T19:55:10.079 INFO:teuthology.orchestra.run.smithi155.stdout: "duration": 9.0964999999999994e-05 2023-08-01T19:55:10.079 INFO:teuthology.orchestra.run.smithi155.stdout: }, 2023-08-01T19:55:10.079 INFO:teuthology.orchestra.run.smithi155.stdout: { 2023-08-01T19:55:10.079 INFO:teuthology.orchestra.run.smithi155.stdout: "event": "op_commit", 2023-08-01T19:55:10.079 INFO:teuthology.orchestra.run.smithi155.stdout: "time": "2023-08-01T19:55:05.585041+0000", 2023-08-01T19:55:10.079 INFO:teuthology.orchestra.run.smithi155.stdout: "duration": 0.0052159670000000002 2023-08-01T19:55:10.079 INFO:teuthology.orchestra.run.smithi155.stdout: }, 2023-08-01T19:55:10.079 INFO:teuthology.orchestra.run.smithi155.stdout: { 2023-08-01T19:55:10.080 INFO:teuthology.orchestra.run.smithi155.stdout: "event": "sub_op_commit_rec", 2023-08-01T19:55:10.080 INFO:teuthology.orchestra.run.smithi155.stdout: "time": "2023-08-01T19:55:05.635199+0000", 2023-08-01T19:55:10.080 INFO:teuthology.orchestra.run.smithi155.stdout: "duration": 0.050158023000000003 2023-08-01T19:55:10.080 INFO:teuthology.orchestra.run.smithi155.stdout: }, 2023-08-01T19:55:10.080 INFO:teuthology.orchestra.run.smithi155.stdout: { 2023-08-01T19:55:10.080 INFO:teuthology.orchestra.run.smithi155.stdout: "event": "commit_sent", 2023-08-01T19:55:10.080 INFO:teuthology.orchestra.run.smithi155.stdout: "time": "2023-08-01T19:55:05.635227+0000", 2023-08-01T19:55:10.081 INFO:teuthology.orchestra.run.smithi155.stdout: "duration": 2.7821e-05 2023-08-01T19:55:10.081 INFO:teuthology.orchestra.run.smithi155.stdout: }, 2023-08-01T19:55:10.081 INFO:teuthology.orchestra.run.smithi155.stdout: { 2023-08-01T19:55:10.081 INFO:teuthology.orchestra.run.smithi155.stdout: "event": "done", 2023-08-01T19:55:10.081 INFO:teuthology.orchestra.run.smithi155.stdout: "time": "2023-08-01T19:55:05.635263+0000", 2023-08-01T19:55:10.081 INFO:teuthology.orchestra.run.smithi155.stdout: "duration": 3.6081000000000002e-05 2023-08-01T19:55:10.081 INFO:teuthology.orchestra.run.smithi155.stdout: } 2023-08-01T19:55:10.082 INFO:teuthology.orchestra.run.smithi155.stdout: ] 2023-08-01T19:55:10.082 INFO:teuthology.orchestra.run.smithi155.stdout: } 2023-08-01T19:55:10.082 INFO:teuthology.orchestra.run.smithi155.stdout: } 2023-08-01T19:55:10.082 INFO:teuthology.orchestra.run.smithi155.stdout: ] 2023-08-01T19:55:10.082 INFO:teuthology.orchestra.run.smithi155.stdout:} 2023-08-01T19:55:10.083 DEBUG:teuthology.orchestra.run.smithi008:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 30 ceph --cluster ceph --admin-daemon /var/run/ceph/ceph-osd.0.asok dump_ops_in_flight 2023-08-01T19:55:10.084 INFO:tasks.ceph.osd.1.smithi101.stderr:2023-08-01T19:55:10.082+0000 7fb0cb7f6700 -1 received signal: Hangup from /usr/bin/python3 /bin/daemon-helper kill ceph-osd -f --cluster ceph -i 1 (PID: 111141) UID: 0 2023-08-01T19:55:10.088 DEBUG:teuthology.orchestra.run.smithi006:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 120 ceph --cluster ceph -- tell 'osd.*' injectargs --osd_enable_op_tracker=false 2023-08-01T19:55:10.184 INFO:tasks.ceph.osd.0.smithi008.stderr:2023-08-01T19:55:10.183+0000 7f16a58f4700 -1 received signal: Hangup from /usr/bin/python3 /bin/daemon-helper kill ceph-osd -f --cluster ceph -i 0 (PID: 111179) UID: 0 2023-08-01T19:55:10.238 INFO:teuthology.orchestra.run.smithi006.stdout:osd.0: {} 2023-08-01T19:55:10.258 INFO:teuthology.orchestra.run.smithi006.stdout:osd.1: {} 2023-08-01T19:55:10.276 INFO:teuthology.orchestra.run.smithi006.stdout:osd.2: {} 2023-08-01T19:55:10.277 INFO:teuthology.orchestra.run.smithi006.stderr:osd.0: osd_enable_op_tracker = 'false' 2023-08-01T19:55:10.278 INFO:teuthology.orchestra.run.smithi006.stderr:osd.1: osd_enable_op_tracker = 'false' 2023-08-01T19:55:10.278 INFO:teuthology.orchestra.run.smithi006.stderr:osd.2: osd_enable_op_tracker = 'false' 2023-08-01T19:55:10.282 INFO:teuthology.orchestra.run.smithi008.stdout:ERROR: (22) Invalid argument 2023-08-01T19:55:10.282 INFO:teuthology.orchestra.run.smithi008.stdout:op_tracker tracking is not enabled now, so no ops are tracked currently, even those get stuck. Please enable "osd_enable_op_tracker", and the tracker will start to track new ops received afterwards. 2023-08-01T19:55:10.284 INFO:tasks.ceph.osd.0.smithi008.stderr:2023-08-01T19:55:10.284+0000 7f16a58f4700 -1 received signal: Hangup from /usr/bin/python3 /bin/daemon-helper kill ceph-osd -f --cluster ceph -i 0 (PID: 111179) UID: 0 2023-08-01T19:55:10.293 DEBUG:teuthology.orchestra.run.smithi008:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 30 ceph --cluster ceph --admin-daemon /var/run/ceph/ceph-osd.0.asok dump_blocked_ops 2023-08-01T19:55:10.316 INFO:tasks.radosbench.radosbench.0.smithi006.stdout: 46 16 109741 109725 149.071 115.5 0.00598749 0.00670559 2023-08-01T19:55:10.386 INFO:tasks.ceph.osd.2.smithi155.stderr:2023-08-01T19:55:10.384+0000 7faa5c6ac700 -1 received signal: Hangup from /usr/bin/python3 /bin/daemon-helper kill ceph-osd -f --cluster ceph -i 2 (PID: 111337) UID: 0 2023-08-01T19:55:10.486 INFO:tasks.ceph.osd.0.smithi008.stderr:2023-08-01T19:55:10.485+0000 7f16a58f4700 -1 received signal: Hangup from /usr/bin/python3 /bin/daemon-helper kill ceph-osd -f --cluster ceph -i 0 (PID: 111179) UID: 0 2023-08-01T19:55:10.526 INFO:teuthology.orchestra.run.smithi008.stdout:ERROR: (22) Invalid argument 2023-08-01T19:55:10.526 INFO:teuthology.orchestra.run.smithi008.stdout:op_tracker tracking is not enabled now, so no ops are tracked currently, even those get stuck. Please enable "osd_enable_op_tracker", and the tracker will start to track new ops received afterwards. 2023-08-01T19:55:10.542 DEBUG:teuthology.orchestra.run.smithi008:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 30 ceph --cluster ceph --admin-daemon /var/run/ceph/ceph-osd.0.asok dump_historic_ops 2023-08-01T19:55:10.577 INFO:teuthology.orchestra.run.smithi006.stderr:set osd.1 primary-affinity to 0.337637 (8221272) 2023-08-01T19:55:10.625 INFO:tasks.ceph.osd.0.smithi008.stderr:2023-08-01T19:55:10.624+0000 7f16a58f4700 -1 received signal: Hangup from /usr/bin/python3 /bin/daemon-helper kill ceph-osd -f --cluster ceph -i 0 (PID: 111179) UID: 0 2023-08-01T19:55:10.688 INFO:tasks.ceph.osd.0.smithi008.stderr:2023-08-01T19:55:10.687+0000 7f16a58f4700 -1 received signal: Hangup from /usr/bin/python3 /bin/daemon-helper kill ceph-osd -f --cluster ceph -i 0 (PID: 111179) UID: 0 2023-08-01T19:55:10.716 INFO:teuthology.orchestra.run.smithi008.stdout:ERROR: (22) Invalid argument 2023-08-01T19:55:10.716 INFO:teuthology.orchestra.run.smithi008.stdout:op_tracker tracking is not enabled now, so no ops are tracked currently, even those get stuck. Please enable "osd_enable_op_tracker", and the tracker will start to track new ops received afterwards. 2023-08-01T19:55:10.726 DEBUG:teuthology.orchestra.run.smithi101:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 30 ceph --cluster ceph --admin-daemon /var/run/ceph/ceph-osd.1.asok dump_ops_in_flight 2023-08-01T19:55:10.789 INFO:tasks.ceph.osd.0.smithi008.stderr:2023-08-01T19:55:10.788+0000 7f16a58f4700 -1 received signal: Hangup from /usr/bin/python3 /bin/daemon-helper kill ceph-osd -f --cluster ceph -i 0 (PID: 111179) UID: 0 2023-08-01T19:55:10.850 INFO:teuthology.orchestra.run.smithi101.stdout:ERROR: (22) Invalid argument 2023-08-01T19:55:10.850 INFO:teuthology.orchestra.run.smithi101.stdout:op_tracker tracking is not enabled now, so no ops are tracked currently, even those get stuck. Please enable "osd_enable_op_tracker", and the tracker will start to track new ops received afterwards. 2023-08-01T19:55:10.859 DEBUG:teuthology.orchestra.run.smithi101:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 30 ceph --cluster ceph --admin-daemon /var/run/ceph/ceph-osd.1.asok dump_blocked_ops 2023-08-01T19:55:10.902 INFO:tasks.ceph.osd.1.smithi101.stderr:2023-08-01T19:55:10.901+0000 7fb0cb7f6700 -1 received signal: Hangup from /usr/bin/python3 /bin/daemon-helper kill ceph-osd -f --cluster ceph -i 1 (PID: 111141) UID: 0 2023-08-01T19:55:10.982 INFO:teuthology.orchestra.run.smithi101.stdout:ERROR: (22) Invalid argument 2023-08-01T19:55:10.982 INFO:teuthology.orchestra.run.smithi101.stdout:op_tracker tracking is not enabled now, so no ops are tracked currently, even those get stuck. Please enable "osd_enable_op_tracker", and the tracker will start to track new ops received afterwards. 2023-08-01T19:55:10.992 DEBUG:teuthology.orchestra.run.smithi101:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 30 ceph --cluster ceph --admin-daemon /var/run/ceph/ceph-osd.1.asok dump_historic_ops 2023-08-01T19:55:10.992 INFO:tasks.ceph.osd.2.smithi155.stderr:2023-08-01T19:55:10.991+0000 7faa5c6ac700 -1 received signal: Hangup from /usr/bin/python3 /bin/daemon-helper kill ceph-osd -f --cluster ceph -i 2 (PID: 111337) UID: 0 2023-08-01T19:55:11.092 INFO:tasks.ceph.osd.0.smithi008.stderr:2023-08-01T19:55:11.091+0000 7f16a58f4700 -1 received signal: Hangup from /usr/bin/python3 /bin/daemon-helper kill ceph-osd -f --cluster ceph -i 0 (PID: 111179) UID: 0 2023-08-01T19:55:11.155 INFO:teuthology.orchestra.run.smithi101.stdout:ERROR: (22) Invalid argument 2023-08-01T19:55:11.156 INFO:teuthology.orchestra.run.smithi101.stdout:op_tracker tracking is not enabled now, so no ops are tracked currently, even those get stuck. Please enable "osd_enable_op_tracker", and the tracker will start to track new ops received afterwards. 2023-08-01T19:55:11.165 DEBUG:teuthology.orchestra.run.smithi155:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 30 ceph --cluster ceph --admin-daemon /var/run/ceph/ceph-osd.2.asok dump_ops_in_flight 2023-08-01T19:55:11.193 INFO:tasks.ceph.osd.0.smithi008.stderr:2023-08-01T19:55:11.192+0000 7f16a58f4700 -1 received signal: Hangup from /usr/bin/python3 /bin/daemon-helper kill ceph-osd -f --cluster ceph -i 0 (PID: 111179) UID: 0 2023-08-01T19:55:11.294 INFO:teuthology.orchestra.run.smithi155.stdout:ERROR: (22) Invalid argument 2023-08-01T19:55:11.294 INFO:teuthology.orchestra.run.smithi155.stdout:op_tracker tracking is not enabled now, so no ops are tracked currently, even those get stuck. Please enable "osd_enable_op_tracker", and the tracker will start to track new ops received afterwards. 2023-08-01T19:55:11.294 INFO:tasks.ceph.osd.2.smithi155.stderr:2023-08-01T19:55:11.292+0000 7faa5c6ac700 -1 received signal: Hangup from /usr/bin/python3 /bin/daemon-helper kill ceph-osd -f --cluster ceph -i 2 (PID: 111337) UID: 0 2023-08-01T19:55:11.303 DEBUG:teuthology.orchestra.run.smithi155:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 30 ceph --cluster ceph --admin-daemon /var/run/ceph/ceph-osd.2.asok dump_blocked_ops 2023-08-01T19:55:11.316 INFO:tasks.radosbench.radosbench.0.smithi006.stdout: 47 16 110252 110236 146.578 31.9375 0.00437461 0.00671536 2023-08-01T19:55:11.395 INFO:tasks.ceph.osd.2.smithi155.stderr:2023-08-01T19:55:11.393+0000 7faa5c6ac700 -1 received signal: Hangup from /usr/bin/python3 /bin/daemon-helper kill ceph-osd -f --cluster ceph -i 2 (PID: 111337) UID: 0 2023-08-01T19:55:11.467 INFO:teuthology.orchestra.run.smithi155.stdout:ERROR: (22) Invalid argument 2023-08-01T19:55:11.468 INFO:teuthology.orchestra.run.smithi155.stdout:op_tracker tracking is not enabled now, so no ops are tracked currently, even those get stuck. Please enable "osd_enable_op_tracker", and the tracker will start to track new ops received afterwards. 2023-08-01T19:55:11.477 DEBUG:teuthology.orchestra.run.smithi155:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 30 ceph --cluster ceph --admin-daemon /var/run/ceph/ceph-osd.2.asok dump_historic_ops 2023-08-01T19:55:11.495 INFO:tasks.ceph.osd.1.smithi101.stderr:2023-08-01T19:55:11.494+0000 7fb0cb7f6700 -1 received signal: Hangup from /usr/bin/python3 /bin/daemon-helper kill ceph-osd -f --cluster ceph -i 1 (PID: 111141) UID: 0 2023-08-01T19:55:11.587 DEBUG:teuthology.orchestra.run.smithi006:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 120 ceph --cluster ceph osd set nodeep-scrub 2023-08-01T19:55:11.596 INFO:tasks.ceph.osd.1.smithi101.stderr:2023-08-01T19:55:11.595+0000 7fb0cb7f6700 -1 received signal: Hangup from /usr/bin/python3 /bin/daemon-helper kill ceph-osd -f --cluster ceph -i 1 (PID: 111141) UID: 0 2023-08-01T19:55:11.662 INFO:teuthology.orchestra.run.smithi155.stdout:ERROR: (22) Invalid argument 2023-08-01T19:55:11.662 INFO:teuthology.orchestra.run.smithi155.stdout:op_tracker tracking is not enabled now, so no ops are tracked currently, even those get stuck. Please enable "osd_enable_op_tracker", and the tracker will start to track new ops received afterwards. 2023-08-01T19:55:11.675 DEBUG:teuthology.orchestra.run.smithi008:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 30 ceph --cluster ceph --admin-daemon /var/run/ceph/ceph-osd.0.asok dump_ops_in_flight 2023-08-01T19:55:11.718 INFO:tasks.ceph.osd.0.smithi008.stderr:2023-08-01T19:55:11.718+0000 7f16a58f4700 -1 received signal: Hangup from /usr/bin/python3 /bin/daemon-helper kill ceph-osd -f --cluster ceph -i 0 (PID: 111179) UID: 0 2023-08-01T19:55:11.797 INFO:tasks.ceph.osd.2.smithi155.stderr:2023-08-01T19:55:11.795+0000 7faa5c6ac700 -1 received signal: Hangup from /usr/bin/python3 /bin/daemon-helper kill ceph-osd -f --cluster ceph -i 2 (PID: 111337) UID: 0 2023-08-01T19:55:11.866 INFO:teuthology.orchestra.run.smithi008.stdout:ERROR: (22) Invalid argument 2023-08-01T19:55:11.866 INFO:teuthology.orchestra.run.smithi008.stdout:op_tracker tracking is not enabled now, so no ops are tracked currently, even those get stuck. Please enable "osd_enable_op_tracker", and the tracker will start to track new ops received afterwards. 2023-08-01T19:55:11.881 DEBUG:teuthology.orchestra.run.smithi008:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 30 ceph --cluster ceph --admin-daemon /var/run/ceph/ceph-osd.0.asok dump_blocked_ops 2023-08-01T19:55:11.922 INFO:tasks.ceph.osd.0.smithi008.stderr:2023-08-01T19:55:11.921+0000 7f16a58f4700 -1 received signal: Hangup from /usr/bin/python3 /bin/daemon-helper kill ceph-osd -f --cluster ceph -i 0 (PID: 111179) UID: 0 2023-08-01T19:55:12.003 INFO:tasks.ceph.osd.0.smithi008.stderr:2023-08-01T19:55:11.998+0000 7f16a58f4700 -1 received signal: Hangup from /usr/bin/python3 /bin/daemon-helper kill ceph-osd -f --cluster ceph -i 0 (PID: 111179) UID: 0 2023-08-01T19:55:12.099 INFO:tasks.ceph.osd.2.smithi155.stderr:2023-08-01T19:55:12.097+0000 7faa5c6ac700 -1 received signal: Hangup from /usr/bin/python3 /bin/daemon-helper kill ceph-osd -f --cluster ceph -i 2 (PID: 111337) UID: 0 2023-08-01T19:55:12.119 INFO:teuthology.orchestra.run.smithi008.stdout:ERROR: (22) Invalid argument 2023-08-01T19:55:12.120 INFO:teuthology.orchestra.run.smithi008.stdout:op_tracker tracking is not enabled now, so no ops are tracked currently, even those get stuck. Please enable "osd_enable_op_tracker", and the tracker will start to track new ops received afterwards. 2023-08-01T19:55:12.134 DEBUG:teuthology.orchestra.run.smithi008:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 30 ceph --cluster ceph --admin-daemon /var/run/ceph/ceph-osd.0.asok dump_historic_ops 2023-08-01T19:55:12.219 INFO:tasks.ceph.osd.0.smithi008.stderr:2023-08-01T19:55:12.218+0000 7f16a58f4700 -1 received signal: Hangup from /usr/bin/python3 /bin/daemon-helper kill ceph-osd -f --cluster ceph -i 0 (PID: 111179) UID: 0 2023-08-01T19:55:12.289 DEBUG:teuthology.orchestra.run.smithi006:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 120 ceph --cluster ceph -- tell 'osd.*' injectargs --osd_enable_op_tracker=true 2023-08-01T19:55:12.301 INFO:tasks.ceph.osd.1.smithi101.stderr:2023-08-01T19:55:12.299+0000 7fb0cb7f6700 -1 received signal: Hangup from /usr/bin/python3 /bin/daemon-helper kill ceph-osd -f --cluster ceph -i 1 (PID: 111141) UID: 0 2023-08-01T19:55:12.316 INFO:tasks.radosbench.radosbench.0.smithi006.stdout: 48 16 111509 111493 145.161 78.5625 0.00924059 0.00688605 2023-08-01T19:55:12.361 INFO:teuthology.orchestra.run.smithi008.stdout:ERROR: (22) Invalid argument 2023-08-01T19:55:12.361 INFO:teuthology.orchestra.run.smithi008.stdout:op_tracker tracking is not enabled now, so no ops are tracked currently, even those get stuck. Please enable "osd_enable_op_tracker", and the tracker will start to track new ops received afterwards. 2023-08-01T19:55:12.376 DEBUG:teuthology.orchestra.run.smithi101:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 30 ceph --cluster ceph --admin-daemon /var/run/ceph/ceph-osd.1.asok dump_ops_in_flight 2023-08-01T19:55:12.422 INFO:tasks.ceph.osd.1.smithi101.stderr:2023-08-01T19:55:12.419+0000 7fb0cb7f6700 -1 received signal: Hangup from /usr/bin/python3 /bin/daemon-helper kill ceph-osd -f --cluster ceph -i 1 (PID: 111141) UID: 0 2023-08-01T19:55:12.437 INFO:teuthology.orchestra.run.smithi006.stdout:osd.0: {} 2023-08-01T19:55:12.456 INFO:teuthology.orchestra.run.smithi006.stdout:osd.1: {} 2023-08-01T19:55:12.476 INFO:teuthology.orchestra.run.smithi006.stdout:osd.2: {} 2023-08-01T19:55:12.477 INFO:teuthology.orchestra.run.smithi006.stderr:osd.0: osd_enable_op_tracker = 'true' 2023-08-01T19:55:12.477 INFO:teuthology.orchestra.run.smithi006.stderr:osd.1: osd_enable_op_tracker = 'true' 2023-08-01T19:55:12.477 INFO:teuthology.orchestra.run.smithi006.stderr:osd.2: osd_enable_op_tracker = 'true' 2023-08-01T19:55:12.501 INFO:tasks.ceph.osd.1.smithi101.stderr:2023-08-01T19:55:12.500+0000 7fb0cb7f6700 -1 received signal: Hangup from /usr/bin/python3 /bin/daemon-helper kill ceph-osd -f --cluster ceph -i 1 (PID: 111141) UID: 0 2023-08-01T19:55:12.550 INFO:teuthology.orchestra.run.smithi101.stdout:{ 2023-08-01T19:55:12.550 INFO:teuthology.orchestra.run.smithi101.stdout: "ops": [ 2023-08-01T19:55:12.550 INFO:teuthology.orchestra.run.smithi101.stdout: { 2023-08-01T19:55:12.550 INFO:teuthology.orchestra.run.smithi101.stdout: "description": "osd_repop(client.4668.0:111930 5.2 e41/40 5:4f1cd87f:::benchmark_data_smithi006_114134_object111929:head v 41'7193, mlcod=41'7189)", 2023-08-01T19:55:12.551 INFO:teuthology.orchestra.run.smithi101.stdout: "initiated_at": "2023-08-01T19:55:12.544801+0000", 2023-08-01T19:55:12.551 INFO:teuthology.orchestra.run.smithi101.stdout: "age": 0.0042953840000000002, 2023-08-01T19:55:12.551 INFO:teuthology.orchestra.run.smithi101.stdout: "duration": 0.0043138860000000003, 2023-08-01T19:55:12.551 INFO:teuthology.orchestra.run.smithi101.stdout: "type_data": { 2023-08-01T19:55:12.551 INFO:teuthology.orchestra.run.smithi101.stdout: "flag_point": "started", 2023-08-01T19:55:12.551 INFO:teuthology.orchestra.run.smithi101.stdout: "events": [ 2023-08-01T19:55:12.551 INFO:teuthology.orchestra.run.smithi101.stdout: { 2023-08-01T19:55:12.552 INFO:teuthology.orchestra.run.smithi101.stdout: "event": "initiated", 2023-08-01T19:55:12.552 INFO:teuthology.orchestra.run.smithi101.stdout: "time": "2023-08-01T19:55:12.544801+0000", 2023-08-01T19:55:12.552 INFO:teuthology.orchestra.run.smithi101.stdout: "duration": 0 2023-08-01T19:55:12.552 INFO:teuthology.orchestra.run.smithi101.stdout: }, 2023-08-01T19:55:12.552 INFO:teuthology.orchestra.run.smithi101.stdout: { 2023-08-01T19:55:12.552 INFO:teuthology.orchestra.run.smithi101.stdout: "event": "throttled", 2023-08-01T19:55:12.552 INFO:teuthology.orchestra.run.smithi101.stdout: "time": "2023-08-01T19:55:12.544801+0000", 2023-08-01T19:55:12.553 INFO:teuthology.orchestra.run.smithi101.stdout: "duration": 0 2023-08-01T19:55:12.553 INFO:teuthology.orchestra.run.smithi101.stdout: }, 2023-08-01T19:55:12.553 INFO:teuthology.orchestra.run.smithi101.stdout: { 2023-08-01T19:55:12.553 INFO:teuthology.orchestra.run.smithi101.stdout: "event": "header_read", 2023-08-01T19:55:12.553 INFO:teuthology.orchestra.run.smithi101.stdout: "time": "2023-08-01T19:55:12.544801+0000", 2023-08-01T19:55:12.553 INFO:teuthology.orchestra.run.smithi101.stdout: "duration": 4294967295.9999995 2023-08-01T19:55:12.553 INFO:teuthology.orchestra.run.smithi101.stdout: }, 2023-08-01T19:55:12.553 INFO:teuthology.orchestra.run.smithi101.stdout: { 2023-08-01T19:55:12.554 INFO:teuthology.orchestra.run.smithi101.stdout: "event": "all_read", 2023-08-01T19:55:12.554 INFO:teuthology.orchestra.run.smithi101.stdout: "time": "2023-08-01T19:55:12.544860+0000", 2023-08-01T19:55:12.554 INFO:teuthology.orchestra.run.smithi101.stdout: "duration": 5.8891000000000002e-05 2023-08-01T19:55:12.554 INFO:teuthology.orchestra.run.smithi101.stdout: }, 2023-08-01T19:55:12.554 INFO:teuthology.orchestra.run.smithi101.stdout: { 2023-08-01T19:55:12.554 INFO:teuthology.orchestra.run.smithi101.stdout: "event": "dispatched", 2023-08-01T19:55:12.554 INFO:teuthology.orchestra.run.smithi101.stdout: "time": "2023-08-01T19:55:12.544882+0000", 2023-08-01T19:55:12.555 INFO:teuthology.orchestra.run.smithi101.stdout: "duration": 2.2225000000000002e-05 2023-08-01T19:55:12.555 INFO:teuthology.orchestra.run.smithi101.stdout: }, 2023-08-01T19:55:12.555 INFO:teuthology.orchestra.run.smithi101.stdout: { 2023-08-01T19:55:12.555 INFO:teuthology.orchestra.run.smithi101.stdout: "event": "queued_for_pg", 2023-08-01T19:55:12.555 INFO:teuthology.orchestra.run.smithi101.stdout: "time": "2023-08-01T19:55:12.544887+0000", 2023-08-01T19:55:12.555 INFO:teuthology.orchestra.run.smithi101.stdout: "duration": 5.0939999999999998e-06 2023-08-01T19:55:12.555 INFO:teuthology.orchestra.run.smithi101.stdout: }, 2023-08-01T19:55:12.556 INFO:teuthology.orchestra.run.smithi101.stdout: { 2023-08-01T19:55:12.556 INFO:teuthology.orchestra.run.smithi101.stdout: "event": "reached_pg", 2023-08-01T19:55:12.556 INFO:teuthology.orchestra.run.smithi101.stdout: "time": "2023-08-01T19:55:12.544922+0000", 2023-08-01T19:55:12.556 INFO:teuthology.orchestra.run.smithi101.stdout: "duration": 3.4866000000000001e-05 2023-08-01T19:55:12.556 INFO:teuthology.orchestra.run.smithi101.stdout: }, 2023-08-01T19:55:12.556 INFO:teuthology.orchestra.run.smithi101.stdout: { 2023-08-01T19:55:12.556 INFO:teuthology.orchestra.run.smithi101.stdout: "event": "started", 2023-08-01T19:55:12.557 INFO:teuthology.orchestra.run.smithi101.stdout: "time": "2023-08-01T19:55:12.544941+0000", 2023-08-01T19:55:12.557 INFO:teuthology.orchestra.run.smithi101.stdout: "duration": 1.9468999999999999e-05 2023-08-01T19:55:12.557 INFO:teuthology.orchestra.run.smithi101.stdout: } 2023-08-01T19:55:12.557 INFO:teuthology.orchestra.run.smithi101.stdout: ] 2023-08-01T19:55:12.557 INFO:teuthology.orchestra.run.smithi101.stdout: } 2023-08-01T19:55:12.557 INFO:teuthology.orchestra.run.smithi101.stdout: }, 2023-08-01T19:55:12.557 INFO:teuthology.orchestra.run.smithi101.stdout: { 2023-08-01T19:55:12.557 INFO:teuthology.orchestra.run.smithi101.stdout: "description": "osd_repop(client.4668.0:111932 5.9 e41/40 5:9246f9d8:::benchmark_data_smithi006_114134_object111931:head v 41'7010, mlcod=41'7008)", 2023-08-01T19:55:12.558 INFO:teuthology.orchestra.run.smithi101.stdout: "initiated_at": "2023-08-01T19:55:12.546307+0000", 2023-08-01T19:55:12.558 INFO:teuthology.orchestra.run.smithi101.stdout: "age": 0.0027901330000000002, 2023-08-01T19:55:12.558 INFO:teuthology.orchestra.run.smithi101.stdout: "duration": 0.0028928819999999998, 2023-08-01T19:55:12.558 INFO:teuthology.orchestra.run.smithi101.stdout: "type_data": { 2023-08-01T19:55:12.558 INFO:teuthology.orchestra.run.smithi101.stdout: "flag_point": "started", 2023-08-01T19:55:12.558 INFO:teuthology.orchestra.run.smithi101.stdout: "events": [ 2023-08-01T19:55:12.558 INFO:teuthology.orchestra.run.smithi101.stdout: { 2023-08-01T19:55:12.558 INFO:teuthology.orchestra.run.smithi101.stdout: "event": "initiated", 2023-08-01T19:55:12.559 INFO:teuthology.orchestra.run.smithi101.stdout: "time": "2023-08-01T19:55:12.546307+0000", 2023-08-01T19:55:12.559 INFO:teuthology.orchestra.run.smithi101.stdout: "duration": 0 2023-08-01T19:55:12.559 INFO:teuthology.orchestra.run.smithi101.stdout: }, 2023-08-01T19:55:12.559 INFO:teuthology.orchestra.run.smithi101.stdout: { 2023-08-01T19:55:12.559 INFO:teuthology.orchestra.run.smithi101.stdout: "event": "throttled", 2023-08-01T19:55:12.559 INFO:teuthology.orchestra.run.smithi101.stdout: "time": "2023-08-01T19:55:12.546307+0000", 2023-08-01T19:55:12.559 INFO:teuthology.orchestra.run.smithi101.stdout: "duration": 0 2023-08-01T19:55:12.560 INFO:teuthology.orchestra.run.smithi101.stdout: }, 2023-08-01T19:55:12.560 INFO:teuthology.orchestra.run.smithi101.stdout: { 2023-08-01T19:55:12.560 INFO:teuthology.orchestra.run.smithi101.stdout: "event": "header_read", 2023-08-01T19:55:12.560 INFO:teuthology.orchestra.run.smithi101.stdout: "time": "2023-08-01T19:55:12.546306+0000", 2023-08-01T19:55:12.560 INFO:teuthology.orchestra.run.smithi101.stdout: "duration": 4294967295.9999995 2023-08-01T19:55:12.560 INFO:teuthology.orchestra.run.smithi101.stdout: }, 2023-08-01T19:55:12.560 INFO:teuthology.orchestra.run.smithi101.stdout: { 2023-08-01T19:55:12.560 INFO:teuthology.orchestra.run.smithi101.stdout: "event": "all_read", 2023-08-01T19:55:12.561 INFO:teuthology.orchestra.run.smithi101.stdout: "time": "2023-08-01T19:55:12.546357+0000", 2023-08-01T19:55:12.561 INFO:teuthology.orchestra.run.smithi101.stdout: "duration": 5.0720999999999998e-05 2023-08-01T19:55:12.561 INFO:teuthology.orchestra.run.smithi101.stdout: }, 2023-08-01T19:55:12.561 INFO:teuthology.orchestra.run.smithi101.stdout: { 2023-08-01T19:55:12.561 INFO:teuthology.orchestra.run.smithi101.stdout: "event": "dispatched", 2023-08-01T19:55:12.561 INFO:teuthology.orchestra.run.smithi101.stdout: "time": "2023-08-01T19:55:12.546365+0000", 2023-08-01T19:55:12.561 INFO:teuthology.orchestra.run.smithi101.stdout: "duration": 8.4780000000000008e-06 2023-08-01T19:55:12.561 INFO:teuthology.orchestra.run.smithi101.stdout: }, 2023-08-01T19:55:12.562 INFO:teuthology.orchestra.run.smithi101.stdout: { 2023-08-01T19:55:12.562 INFO:teuthology.orchestra.run.smithi101.stdout: "event": "queued_for_pg", 2023-08-01T19:55:12.562 INFO:teuthology.orchestra.run.smithi101.stdout: "time": "2023-08-01T19:55:12.546369+0000", 2023-08-01T19:55:12.562 INFO:teuthology.orchestra.run.smithi101.stdout: "duration": 3.9700000000000001e-06 2023-08-01T19:55:12.562 INFO:teuthology.orchestra.run.smithi101.stdout: }, 2023-08-01T19:55:12.562 INFO:teuthology.orchestra.run.smithi101.stdout: { 2023-08-01T19:55:12.562 INFO:teuthology.orchestra.run.smithi101.stdout: "event": "reached_pg", 2023-08-01T19:55:12.562 INFO:teuthology.orchestra.run.smithi101.stdout: "time": "2023-08-01T19:55:12.546397+0000", 2023-08-01T19:55:12.563 INFO:teuthology.orchestra.run.smithi101.stdout: "duration": 2.7608999999999999e-05 2023-08-01T19:55:12.563 INFO:teuthology.orchestra.run.smithi101.stdout: }, 2023-08-01T19:55:12.563 INFO:teuthology.orchestra.run.smithi101.stdout: { 2023-08-01T19:55:12.563 INFO:teuthology.orchestra.run.smithi101.stdout: "event": "started", 2023-08-01T19:55:12.563 INFO:teuthology.orchestra.run.smithi101.stdout: "time": "2023-08-01T19:55:12.546409+0000", 2023-08-01T19:55:12.563 INFO:teuthology.orchestra.run.smithi101.stdout: "duration": 1.234e-05 2023-08-01T19:55:12.563 INFO:teuthology.orchestra.run.smithi101.stdout: } 2023-08-01T19:55:12.563 INFO:teuthology.orchestra.run.smithi101.stdout: ] 2023-08-01T19:55:12.564 INFO:teuthology.orchestra.run.smithi101.stdout: } 2023-08-01T19:55:12.564 INFO:teuthology.orchestra.run.smithi101.stdout: }, 2023-08-01T19:55:12.564 INFO:teuthology.orchestra.run.smithi101.stdout: { 2023-08-01T19:55:12.564 INFO:teuthology.orchestra.run.smithi101.stdout: "description": "osd_repop(client.4668.0:111933 5.d e41/19 5:be762cd4:::benchmark_data_smithi006_114134_object111932:head v 41'6864, mlcod=41'6862)", 2023-08-01T19:55:12.565 INFO:teuthology.orchestra.run.smithi101.stdout: "initiated_at": "2023-08-01T19:55:12.546426+0000", 2023-08-01T19:55:12.565 INFO:teuthology.orchestra.run.smithi101.stdout: "age": 0.002670567, 2023-08-01T19:55:12.565 INFO:teuthology.orchestra.run.smithi101.stdout: "duration": 0.0028479519999999999, 2023-08-01T19:55:12.565 INFO:teuthology.orchestra.run.smithi101.stdout: "type_data": { 2023-08-01T19:55:12.565 INFO:teuthology.orchestra.run.smithi101.stdout: "flag_point": "started", 2023-08-01T19:55:12.565 INFO:teuthology.orchestra.run.smithi101.stdout: "events": [ 2023-08-01T19:55:12.565 INFO:teuthology.orchestra.run.smithi101.stdout: { 2023-08-01T19:55:12.566 INFO:teuthology.orchestra.run.smithi101.stdout: "event": "initiated", 2023-08-01T19:55:12.566 INFO:teuthology.orchestra.run.smithi101.stdout: "time": "2023-08-01T19:55:12.546426+0000", 2023-08-01T19:55:12.566 INFO:teuthology.orchestra.run.smithi101.stdout: "duration": 0 2023-08-01T19:55:12.566 INFO:teuthology.orchestra.run.smithi101.stdout: }, 2023-08-01T19:55:12.566 INFO:teuthology.orchestra.run.smithi101.stdout: { 2023-08-01T19:55:12.566 INFO:teuthology.orchestra.run.smithi101.stdout: "event": "throttled", 2023-08-01T19:55:12.566 INFO:teuthology.orchestra.run.smithi101.stdout: "time": "2023-08-01T19:55:12.546426+0000", 2023-08-01T19:55:12.566 INFO:teuthology.orchestra.run.smithi101.stdout: "duration": 0 2023-08-01T19:55:12.567 INFO:teuthology.orchestra.run.smithi101.stdout: }, 2023-08-01T19:55:12.567 INFO:teuthology.orchestra.run.smithi101.stdout: { 2023-08-01T19:55:12.567 INFO:teuthology.orchestra.run.smithi101.stdout: "event": "header_read", 2023-08-01T19:55:12.567 INFO:teuthology.orchestra.run.smithi101.stdout: "time": "2023-08-01T19:55:12.546426+0000", 2023-08-01T19:55:12.567 INFO:teuthology.orchestra.run.smithi101.stdout: "duration": 4294967295.9999995 2023-08-01T19:55:12.567 INFO:teuthology.orchestra.run.smithi101.stdout: }, 2023-08-01T19:55:12.567 INFO:teuthology.orchestra.run.smithi101.stdout: { 2023-08-01T19:55:12.567 INFO:teuthology.orchestra.run.smithi101.stdout: "event": "all_read", 2023-08-01T19:55:12.568 INFO:teuthology.orchestra.run.smithi101.stdout: "time": "2023-08-01T19:55:12.546523+0000", 2023-08-01T19:55:12.568 INFO:teuthology.orchestra.run.smithi101.stdout: "duration": 9.7769999999999994e-05 2023-08-01T19:55:12.568 INFO:teuthology.orchestra.run.smithi101.stdout: }, 2023-08-01T19:55:12.568 INFO:teuthology.orchestra.run.smithi101.stdout: { 2023-08-01T19:55:12.568 INFO:teuthology.orchestra.run.smithi101.stdout: "event": "dispatched", 2023-08-01T19:55:12.568 INFO:teuthology.orchestra.run.smithi101.stdout: "time": "2023-08-01T19:55:12.546532+0000", 2023-08-01T19:55:12.568 INFO:teuthology.orchestra.run.smithi101.stdout: "duration": 8.8629999999999997e-06 2023-08-01T19:55:12.568 INFO:teuthology.orchestra.run.smithi101.stdout: }, 2023-08-01T19:55:12.569 INFO:teuthology.orchestra.run.smithi101.stdout: { 2023-08-01T19:55:12.569 INFO:teuthology.orchestra.run.smithi101.stdout: "event": "queued_for_pg", 2023-08-01T19:55:12.569 INFO:teuthology.orchestra.run.smithi101.stdout: "time": "2023-08-01T19:55:12.546537+0000", 2023-08-01T19:55:12.569 INFO:teuthology.orchestra.run.smithi101.stdout: "duration": 4.6689999999999997e-06 2023-08-01T19:55:12.569 INFO:teuthology.orchestra.run.smithi101.stdout: }, 2023-08-01T19:55:12.569 INFO:teuthology.orchestra.run.smithi101.stdout: { 2023-08-01T19:55:12.569 INFO:teuthology.orchestra.run.smithi101.stdout: "event": "reached_pg", 2023-08-01T19:55:12.570 INFO:teuthology.orchestra.run.smithi101.stdout: "time": "2023-08-01T19:55:12.546560+0000", 2023-08-01T19:55:12.570 INFO:teuthology.orchestra.run.smithi101.stdout: "duration": 2.3209000000000001e-05 2023-08-01T19:55:12.570 INFO:teuthology.orchestra.run.smithi101.stdout: }, 2023-08-01T19:55:12.570 INFO:teuthology.orchestra.run.smithi101.stdout: { 2023-08-01T19:55:12.570 INFO:teuthology.orchestra.run.smithi101.stdout: "event": "started", 2023-08-01T19:55:12.570 INFO:teuthology.orchestra.run.smithi101.stdout: "time": "2023-08-01T19:55:12.546572+0000", 2023-08-01T19:55:12.570 INFO:teuthology.orchestra.run.smithi101.stdout: "duration": 1.1996e-05 2023-08-01T19:55:12.570 INFO:teuthology.orchestra.run.smithi101.stdout: } 2023-08-01T19:55:12.571 INFO:teuthology.orchestra.run.smithi101.stdout: ] 2023-08-01T19:55:12.571 INFO:teuthology.orchestra.run.smithi101.stdout: } 2023-08-01T19:55:12.571 INFO:teuthology.orchestra.run.smithi101.stdout: }, 2023-08-01T19:55:12.571 INFO:teuthology.orchestra.run.smithi101.stdout: { 2023-08-01T19:55:12.571 INFO:teuthology.orchestra.run.smithi101.stdout: "description": "osd_repop(client.4668.0:111934 5.f e41/40 5:faa35923:::benchmark_data_smithi006_114134_object111933:head v 41'7025, mlcod=41'7023)", 2023-08-01T19:55:12.571 INFO:teuthology.orchestra.run.smithi101.stdout: "initiated_at": "2023-08-01T19:55:12.546948+0000", 2023-08-01T19:55:12.571 INFO:teuthology.orchestra.run.smithi101.stdout: "age": 0.002149013, 2023-08-01T19:55:12.571 INFO:teuthology.orchestra.run.smithi101.stdout: "duration": 0.0023883910000000001, 2023-08-01T19:55:12.572 INFO:teuthology.orchestra.run.smithi101.stdout: "type_data": { 2023-08-01T19:55:12.572 INFO:teuthology.orchestra.run.smithi101.stdout: "flag_point": "started", 2023-08-01T19:55:12.572 INFO:teuthology.orchestra.run.smithi101.stdout: "events": [ 2023-08-01T19:55:12.572 INFO:teuthology.orchestra.run.smithi101.stdout: { 2023-08-01T19:55:12.572 INFO:teuthology.orchestra.run.smithi101.stdout: "event": "initiated", 2023-08-01T19:55:12.572 INFO:teuthology.orchestra.run.smithi101.stdout: "time": "2023-08-01T19:55:12.546948+0000", 2023-08-01T19:55:12.572 INFO:teuthology.orchestra.run.smithi101.stdout: "duration": 0 2023-08-01T19:55:12.573 INFO:teuthology.orchestra.run.smithi101.stdout: }, 2023-08-01T19:55:12.573 INFO:teuthology.orchestra.run.smithi101.stdout: { 2023-08-01T19:55:12.573 INFO:teuthology.orchestra.run.smithi101.stdout: "event": "throttled", 2023-08-01T19:55:12.573 INFO:teuthology.orchestra.run.smithi101.stdout: "time": "2023-08-01T19:55:12.546948+0000", 2023-08-01T19:55:12.573 INFO:teuthology.orchestra.run.smithi101.stdout: "duration": 0 2023-08-01T19:55:12.573 INFO:teuthology.orchestra.run.smithi101.stdout: }, 2023-08-01T19:55:12.573 INFO:teuthology.orchestra.run.smithi101.stdout: { 2023-08-01T19:55:12.574 INFO:teuthology.orchestra.run.smithi101.stdout: "event": "header_read", 2023-08-01T19:55:12.574 INFO:teuthology.orchestra.run.smithi101.stdout: "time": "2023-08-01T19:55:12.546947+0000", 2023-08-01T19:55:12.574 INFO:teuthology.orchestra.run.smithi101.stdout: "duration": 4294967295.9999995 2023-08-01T19:55:12.574 INFO:teuthology.orchestra.run.smithi101.stdout: }, 2023-08-01T19:55:12.574 INFO:teuthology.orchestra.run.smithi101.stdout: { 2023-08-01T19:55:12.575 INFO:teuthology.orchestra.run.smithi101.stdout: "event": "all_read", 2023-08-01T19:55:12.575 INFO:teuthology.orchestra.run.smithi101.stdout: "time": "2023-08-01T19:55:12.547016+0000", 2023-08-01T19:55:12.575 INFO:teuthology.orchestra.run.smithi101.stdout: "duration": 6.9250000000000003e-05 2023-08-01T19:55:12.575 INFO:teuthology.orchestra.run.smithi101.stdout: }, 2023-08-01T19:55:12.575 INFO:teuthology.orchestra.run.smithi101.stdout: { 2023-08-01T19:55:12.575 INFO:teuthology.orchestra.run.smithi101.stdout: "event": "dispatched", 2023-08-01T19:55:12.575 INFO:teuthology.orchestra.run.smithi101.stdout: "time": "2023-08-01T19:55:12.547029+0000", 2023-08-01T19:55:12.575 INFO:teuthology.orchestra.run.smithi101.stdout: "duration": 1.26e-05 2023-08-01T19:55:12.576 INFO:teuthology.orchestra.run.smithi101.stdout: }, 2023-08-01T19:55:12.576 INFO:teuthology.orchestra.run.smithi101.stdout: { 2023-08-01T19:55:12.576 INFO:teuthology.orchestra.run.smithi101.stdout: "event": "queued_for_pg", 2023-08-01T19:55:12.576 INFO:teuthology.orchestra.run.smithi101.stdout: "time": "2023-08-01T19:55:12.547033+0000", 2023-08-01T19:55:12.577 INFO:teuthology.orchestra.run.smithi101.stdout: "duration": 4.0629999999999999e-06 2023-08-01T19:55:12.577 INFO:teuthology.orchestra.run.smithi101.stdout: }, 2023-08-01T19:55:12.577 INFO:teuthology.orchestra.run.smithi101.stdout: { 2023-08-01T19:55:12.577 INFO:teuthology.orchestra.run.smithi101.stdout: "event": "reached_pg", 2023-08-01T19:55:12.578 INFO:teuthology.orchestra.run.smithi101.stdout: "time": "2023-08-01T19:55:12.547068+0000", 2023-08-01T19:55:12.578 INFO:teuthology.orchestra.run.smithi101.stdout: "duration": 3.5367999999999997e-05 2023-08-01T19:55:12.578 INFO:teuthology.orchestra.run.smithi101.stdout: }, 2023-08-01T19:55:12.578 INFO:teuthology.orchestra.run.smithi101.stdout: { 2023-08-01T19:55:12.579 INFO:teuthology.orchestra.run.smithi101.stdout: "event": "started", 2023-08-01T19:55:12.579 INFO:teuthology.orchestra.run.smithi101.stdout: "time": "2023-08-01T19:55:12.547087+0000", 2023-08-01T19:55:12.579 INFO:teuthology.orchestra.run.smithi101.stdout: "duration": 1.8233999999999999e-05 2023-08-01T19:55:12.579 INFO:teuthology.orchestra.run.smithi101.stdout: } 2023-08-01T19:55:12.579 INFO:teuthology.orchestra.run.smithi101.stdout: ] 2023-08-01T19:55:12.579 INFO:teuthology.orchestra.run.smithi101.stdout: } 2023-08-01T19:55:12.580 INFO:teuthology.orchestra.run.smithi101.stdout: }, 2023-08-01T19:55:12.580 INFO:teuthology.orchestra.run.smithi101.stdout: { 2023-08-01T19:55:12.580 INFO:teuthology.orchestra.run.smithi101.stdout: "description": "osd_repop(client.4668.0:111937 5.3 e41/19 5:c41530d7:::benchmark_data_smithi006_114134_object111936:head v 41'7075, mlcod=41'7073)", 2023-08-01T19:55:12.580 INFO:teuthology.orchestra.run.smithi101.stdout: "initiated_at": "2023-08-01T19:55:12.549049+0000", 2023-08-01T19:55:12.580 INFO:teuthology.orchestra.run.smithi101.stdout: "age": 4.8161000000000002e-05, 2023-08-01T19:55:12.581 INFO:teuthology.orchestra.run.smithi101.stdout: "duration": 0.00032749800000000001, 2023-08-01T19:55:12.581 INFO:teuthology.orchestra.run.smithi101.stdout: "type_data": { 2023-08-01T19:55:12.581 INFO:teuthology.orchestra.run.smithi101.stdout: "flag_point": "started", 2023-08-01T19:55:12.581 INFO:teuthology.orchestra.run.smithi101.stdout: "events": [ 2023-08-01T19:55:12.581 INFO:teuthology.orchestra.run.smithi101.stdout: { 2023-08-01T19:55:12.581 INFO:teuthology.orchestra.run.smithi101.stdout: "event": "initiated", 2023-08-01T19:55:12.581 INFO:teuthology.orchestra.run.smithi101.stdout: "time": "2023-08-01T19:55:12.549049+0000", 2023-08-01T19:55:12.582 INFO:teuthology.orchestra.run.smithi101.stdout: "duration": 0 2023-08-01T19:55:12.582 INFO:teuthology.orchestra.run.smithi101.stdout: }, 2023-08-01T19:55:12.582 INFO:teuthology.orchestra.run.smithi101.stdout: { 2023-08-01T19:55:12.582 INFO:teuthology.orchestra.run.smithi101.stdout: "event": "throttled", 2023-08-01T19:55:12.582 INFO:teuthology.orchestra.run.smithi101.stdout: "time": "2023-08-01T19:55:12.549049+0000", 2023-08-01T19:55:12.582 INFO:teuthology.orchestra.run.smithi101.stdout: "duration": 0 2023-08-01T19:55:12.582 INFO:teuthology.orchestra.run.smithi101.stdout: }, 2023-08-01T19:55:12.582 INFO:teuthology.orchestra.run.smithi101.stdout: { 2023-08-01T19:55:12.583 INFO:teuthology.orchestra.run.smithi101.stdout: "event": "header_read", 2023-08-01T19:55:12.583 INFO:teuthology.orchestra.run.smithi101.stdout: "time": "2023-08-01T19:55:12.549048+0000", 2023-08-01T19:55:12.583 INFO:teuthology.orchestra.run.smithi101.stdout: "duration": 4294967295.9999995 2023-08-01T19:55:12.583 INFO:teuthology.orchestra.run.smithi101.stdout: }, 2023-08-01T19:55:12.583 INFO:teuthology.orchestra.run.smithi101.stdout: { 2023-08-01T19:55:12.583 INFO:teuthology.orchestra.run.smithi101.stdout: "event": "all_read", 2023-08-01T19:55:12.583 INFO:teuthology.orchestra.run.smithi101.stdout: "time": "2023-08-01T19:55:12.549121+0000", 2023-08-01T19:55:12.584 INFO:teuthology.orchestra.run.smithi101.stdout: "duration": 7.3318000000000005e-05 2023-08-01T19:55:12.584 INFO:teuthology.orchestra.run.smithi101.stdout: }, 2023-08-01T19:55:12.584 INFO:teuthology.orchestra.run.smithi101.stdout: { 2023-08-01T19:55:12.584 INFO:teuthology.orchestra.run.smithi101.stdout: "event": "dispatched", 2023-08-01T19:55:12.584 INFO:teuthology.orchestra.run.smithi101.stdout: "time": "2023-08-01T19:55:12.549133+0000", 2023-08-01T19:55:12.584 INFO:teuthology.orchestra.run.smithi101.stdout: "duration": 1.1593000000000001e-05 2023-08-01T19:55:12.584 INFO:teuthology.orchestra.run.smithi101.stdout: }, 2023-08-01T19:55:12.584 INFO:teuthology.orchestra.run.smithi101.stdout: { 2023-08-01T19:55:12.585 INFO:teuthology.orchestra.run.smithi101.stdout: "event": "queued_for_pg", 2023-08-01T19:55:12.585 INFO:teuthology.orchestra.run.smithi101.stdout: "time": "2023-08-01T19:55:12.549139+0000", 2023-08-01T19:55:12.585 INFO:teuthology.orchestra.run.smithi101.stdout: "duration": 5.7230000000000001e-06 2023-08-01T19:55:12.585 INFO:teuthology.orchestra.run.smithi101.stdout: }, 2023-08-01T19:55:12.585 INFO:teuthology.orchestra.run.smithi101.stdout: { 2023-08-01T19:55:12.585 INFO:teuthology.orchestra.run.smithi101.stdout: "event": "reached_pg", 2023-08-01T19:55:12.585 INFO:teuthology.orchestra.run.smithi101.stdout: "time": "2023-08-01T19:55:12.549173+0000", 2023-08-01T19:55:12.586 INFO:teuthology.orchestra.run.smithi101.stdout: "duration": 3.3964999999999998e-05 2023-08-01T19:55:12.586 INFO:teuthology.orchestra.run.smithi101.stdout: }, 2023-08-01T19:55:12.586 INFO:teuthology.orchestra.run.smithi101.stdout: { 2023-08-01T19:55:12.586 INFO:teuthology.orchestra.run.smithi101.stdout: "event": "started", 2023-08-01T19:55:12.586 INFO:teuthology.orchestra.run.smithi101.stdout: "time": "2023-08-01T19:55:12.549184+0000", 2023-08-01T19:55:12.586 INFO:teuthology.orchestra.run.smithi101.stdout: "duration": 1.1593999999999999e-05 2023-08-01T19:55:12.586 INFO:teuthology.orchestra.run.smithi101.stdout: } 2023-08-01T19:55:12.586 INFO:teuthology.orchestra.run.smithi101.stdout: ] 2023-08-01T19:55:12.587 INFO:teuthology.orchestra.run.smithi101.stdout: } 2023-08-01T19:55:12.587 INFO:teuthology.orchestra.run.smithi101.stdout: }, 2023-08-01T19:55:12.587 INFO:teuthology.orchestra.run.smithi101.stdout: { 2023-08-01T19:55:12.587 INFO:teuthology.orchestra.run.smithi101.stdout: "description": "osd_repop(client.4668.0:111936 5.9 e41/40 5:9877126d:::benchmark_data_smithi006_114134_object111935:head v 41'7011, mlcod=41'7008)", 2023-08-01T19:55:12.587 INFO:teuthology.orchestra.run.smithi101.stdout: "initiated_at": "2023-08-01T19:55:12.549098+0000", 2023-08-01T19:55:12.587 INFO:teuthology.orchestra.run.smithi101.stdout: "age": 4294967295.9999986, 2023-08-01T19:55:12.587 INFO:teuthology.orchestra.run.smithi101.stdout: "duration": 0.00031395899999999999, 2023-08-01T19:55:12.587 INFO:teuthology.orchestra.run.smithi101.stdout: "type_data": { 2023-08-01T19:55:12.588 INFO:teuthology.orchestra.run.smithi101.stdout: "flag_point": "started", 2023-08-01T19:55:12.588 INFO:teuthology.orchestra.run.smithi101.stdout: "events": [ 2023-08-01T19:55:12.588 INFO:teuthology.orchestra.run.smithi101.stdout: { 2023-08-01T19:55:12.588 INFO:teuthology.orchestra.run.smithi101.stdout: "event": "initiated", 2023-08-01T19:55:12.588 INFO:teuthology.orchestra.run.smithi101.stdout: "time": "2023-08-01T19:55:12.549098+0000", 2023-08-01T19:55:12.588 INFO:teuthology.orchestra.run.smithi101.stdout: "duration": 0 2023-08-01T19:55:12.588 INFO:teuthology.orchestra.run.smithi101.stdout: }, 2023-08-01T19:55:12.589 INFO:teuthology.orchestra.run.smithi101.stdout: { 2023-08-01T19:55:12.589 INFO:teuthology.orchestra.run.smithi101.stdout: "event": "throttled", 2023-08-01T19:55:12.589 INFO:teuthology.orchestra.run.smithi101.stdout: "time": "2023-08-01T19:55:12.549098+0000", 2023-08-01T19:55:12.589 INFO:teuthology.orchestra.run.smithi101.stdout: "duration": 0 2023-08-01T19:55:12.589 INFO:teuthology.orchestra.run.smithi101.stdout: }, 2023-08-01T19:55:12.589 INFO:teuthology.orchestra.run.smithi101.stdout: { 2023-08-01T19:55:12.589 INFO:teuthology.orchestra.run.smithi101.stdout: "event": "header_read", 2023-08-01T19:55:12.590 INFO:teuthology.orchestra.run.smithi101.stdout: "time": "2023-08-01T19:55:12.549098+0000", 2023-08-01T19:55:12.590 INFO:teuthology.orchestra.run.smithi101.stdout: "duration": 4294967295.9999995 2023-08-01T19:55:12.590 INFO:teuthology.orchestra.run.smithi101.stdout: }, 2023-08-01T19:55:12.590 INFO:teuthology.orchestra.run.smithi101.stdout: { 2023-08-01T19:55:12.590 INFO:teuthology.orchestra.run.smithi101.stdout: "event": "all_read", 2023-08-01T19:55:12.590 INFO:teuthology.orchestra.run.smithi101.stdout: "time": "2023-08-01T19:55:12.549205+0000", 2023-08-01T19:55:12.590 INFO:teuthology.orchestra.run.smithi101.stdout: "duration": 0.000107148 2023-08-01T19:55:12.590 INFO:teuthology.orchestra.run.smithi101.stdout: }, 2023-08-01T19:55:12.591 INFO:teuthology.orchestra.run.smithi101.stdout: { 2023-08-01T19:55:12.591 INFO:teuthology.orchestra.run.smithi101.stdout: "event": "dispatched", 2023-08-01T19:55:12.591 INFO:teuthology.orchestra.run.smithi101.stdout: "time": "2023-08-01T19:55:12.549216+0000", 2023-08-01T19:55:12.591 INFO:teuthology.orchestra.run.smithi101.stdout: "duration": 1.1110999999999999e-05 2023-08-01T19:55:12.591 INFO:teuthology.orchestra.run.smithi101.stdout: }, 2023-08-01T19:55:12.591 INFO:teuthology.orchestra.run.smithi101.stdout: { 2023-08-01T19:55:12.591 INFO:teuthology.orchestra.run.smithi101.stdout: "event": "queued_for_pg", 2023-08-01T19:55:12.591 INFO:teuthology.orchestra.run.smithi101.stdout: "time": "2023-08-01T19:55:12.549222+0000", 2023-08-01T19:55:12.592 INFO:teuthology.orchestra.run.smithi101.stdout: "duration": 6.015e-06 2023-08-01T19:55:12.592 INFO:teuthology.orchestra.run.smithi101.stdout: }, 2023-08-01T19:55:12.592 INFO:teuthology.orchestra.run.smithi101.stdout: { 2023-08-01T19:55:12.592 INFO:teuthology.orchestra.run.smithi101.stdout: "event": "reached_pg", 2023-08-01T19:55:12.592 INFO:teuthology.orchestra.run.smithi101.stdout: "time": "2023-08-01T19:55:12.549248+0000", 2023-08-01T19:55:12.592 INFO:teuthology.orchestra.run.smithi101.stdout: "duration": 2.5986000000000002e-05 2023-08-01T19:55:12.592 INFO:teuthology.orchestra.run.smithi101.stdout: }, 2023-08-01T19:55:12.592 INFO:teuthology.orchestra.run.smithi101.stdout: { 2023-08-01T19:55:12.593 INFO:teuthology.orchestra.run.smithi101.stdout: "event": "started", 2023-08-01T19:55:12.593 INFO:teuthology.orchestra.run.smithi101.stdout: "time": "2023-08-01T19:55:12.549260+0000", 2023-08-01T19:55:12.593 INFO:teuthology.orchestra.run.smithi101.stdout: "duration": 1.1918e-05 2023-08-01T19:55:12.593 INFO:teuthology.orchestra.run.smithi101.stdout: } 2023-08-01T19:55:12.593 INFO:teuthology.orchestra.run.smithi101.stdout: ] 2023-08-01T19:55:12.593 INFO:teuthology.orchestra.run.smithi101.stdout: } 2023-08-01T19:55:12.593 INFO:teuthology.orchestra.run.smithi101.stdout: }, 2023-08-01T19:55:12.593 INFO:teuthology.orchestra.run.smithi101.stdout: { 2023-08-01T19:55:12.594 INFO:teuthology.orchestra.run.smithi101.stdout: "description": "osd_repop(client.4668.0:111926 5.1 e41/40 5:8ab07617:::benchmark_data_smithi006_114134_object111925:head v 41'6908, mlcod=41'6906)", 2023-08-01T19:55:12.594 INFO:teuthology.orchestra.run.smithi101.stdout: "initiated_at": "2023-08-01T19:55:12.543764+0000", 2023-08-01T19:55:12.594 INFO:teuthology.orchestra.run.smithi101.stdout: "age": 0.0053327380000000001, 2023-08-01T19:55:12.594 INFO:teuthology.orchestra.run.smithi101.stdout: "duration": 0.0056879180000000001, 2023-08-01T19:55:12.594 INFO:teuthology.orchestra.run.smithi101.stdout: "type_data": { 2023-08-01T19:55:12.594 INFO:teuthology.orchestra.run.smithi101.stdout: "flag_point": "started", 2023-08-01T19:55:12.594 INFO:teuthology.orchestra.run.smithi101.stdout: "events": [ 2023-08-01T19:55:12.594 INFO:teuthology.orchestra.run.smithi101.stdout: { 2023-08-01T19:55:12.595 INFO:teuthology.orchestra.run.smithi101.stdout: "event": "initiated", 2023-08-01T19:55:12.595 INFO:teuthology.orchestra.run.smithi101.stdout: "time": "2023-08-01T19:55:12.543764+0000", 2023-08-01T19:55:12.595 INFO:teuthology.orchestra.run.smithi101.stdout: "duration": 0 2023-08-01T19:55:12.595 INFO:teuthology.orchestra.run.smithi101.stdout: }, 2023-08-01T19:55:12.595 INFO:teuthology.orchestra.run.smithi101.stdout: { 2023-08-01T19:55:12.595 INFO:teuthology.orchestra.run.smithi101.stdout: "event": "throttled", 2023-08-01T19:55:12.595 INFO:teuthology.orchestra.run.smithi101.stdout: "time": "2023-08-01T19:55:12.543764+0000", 2023-08-01T19:55:12.596 INFO:teuthology.orchestra.run.smithi101.stdout: "duration": 0 2023-08-01T19:55:12.596 INFO:teuthology.orchestra.run.smithi101.stdout: }, 2023-08-01T19:55:12.596 INFO:teuthology.orchestra.run.smithi101.stdout: { 2023-08-01T19:55:12.596 INFO:teuthology.orchestra.run.smithi101.stdout: "event": "header_read", 2023-08-01T19:55:12.596 INFO:teuthology.orchestra.run.smithi101.stdout: "time": "2023-08-01T19:55:12.543763+0000", 2023-08-01T19:55:12.596 INFO:teuthology.orchestra.run.smithi101.stdout: "duration": 4294967295.9999995 2023-08-01T19:55:12.596 INFO:teuthology.orchestra.run.smithi101.stdout: }, 2023-08-01T19:55:12.596 INFO:teuthology.orchestra.run.smithi101.stdout: { 2023-08-01T19:55:12.597 INFO:teuthology.orchestra.run.smithi101.stdout: "event": "all_read", 2023-08-01T19:55:12.597 INFO:teuthology.orchestra.run.smithi101.stdout: "time": "2023-08-01T19:55:12.543797+0000", 2023-08-01T19:55:12.597 INFO:teuthology.orchestra.run.smithi101.stdout: "duration": 3.3568000000000001e-05 2023-08-01T19:55:12.597 INFO:teuthology.orchestra.run.smithi101.stdout: }, 2023-08-01T19:55:12.597 INFO:teuthology.orchestra.run.smithi101.stdout: { 2023-08-01T19:55:12.597 INFO:teuthology.orchestra.run.smithi101.stdout: "event": "dispatched", 2023-08-01T19:55:12.597 INFO:teuthology.orchestra.run.smithi101.stdout: "time": "2023-08-01T19:55:12.543805+0000", 2023-08-01T19:55:12.597 INFO:teuthology.orchestra.run.smithi101.stdout: "duration": 7.7330000000000003e-06 2023-08-01T19:55:12.598 INFO:teuthology.orchestra.run.smithi101.stdout: }, 2023-08-01T19:55:12.598 INFO:teuthology.orchestra.run.smithi101.stdout: { 2023-08-01T19:55:12.598 INFO:teuthology.orchestra.run.smithi101.stdout: "event": "queued_for_pg", 2023-08-01T19:55:12.598 INFO:teuthology.orchestra.run.smithi101.stdout: "time": "2023-08-01T19:55:12.543810+0000", 2023-08-01T19:55:12.598 INFO:teuthology.orchestra.run.smithi101.stdout: "duration": 5.3240000000000002e-06 2023-08-01T19:55:12.598 INFO:teuthology.orchestra.run.smithi101.stdout: }, 2023-08-01T19:55:12.598 INFO:teuthology.orchestra.run.smithi101.stdout: { 2023-08-01T19:55:12.599 INFO:teuthology.orchestra.run.smithi101.stdout: "event": "reached_pg", 2023-08-01T19:55:12.599 INFO:teuthology.orchestra.run.smithi101.stdout: "time": "2023-08-01T19:55:12.543844+0000", 2023-08-01T19:55:12.599 INFO:teuthology.orchestra.run.smithi101.stdout: "duration": 3.3633000000000001e-05 2023-08-01T19:55:12.599 INFO:teuthology.orchestra.run.smithi101.stdout: }, 2023-08-01T19:55:12.599 INFO:teuthology.orchestra.run.smithi101.stdout: { 2023-08-01T19:55:12.599 INFO:teuthology.orchestra.run.smithi101.stdout: "event": "started", 2023-08-01T19:55:12.600 INFO:teuthology.orchestra.run.smithi101.stdout: "time": "2023-08-01T19:55:12.543861+0000", 2023-08-01T19:55:12.600 INFO:teuthology.orchestra.run.smithi101.stdout: "duration": 1.6901999999999998e-05 2023-08-01T19:55:12.600 INFO:teuthology.orchestra.run.smithi101.stdout: } 2023-08-01T19:55:12.600 INFO:teuthology.orchestra.run.smithi101.stdout: ] 2023-08-01T19:55:12.600 INFO:teuthology.orchestra.run.smithi101.stdout: } 2023-08-01T19:55:12.600 INFO:teuthology.orchestra.run.smithi101.stdout: } 2023-08-01T19:55:12.601 INFO:teuthology.orchestra.run.smithi101.stdout: ], 2023-08-01T19:55:12.601 INFO:teuthology.orchestra.run.smithi101.stdout: "num_ops": 7 2023-08-01T19:55:12.601 INFO:teuthology.orchestra.run.smithi101.stdout:} 2023-08-01T19:55:12.602 INFO:teuthology.orchestra.run.smithi006.stderr:nodeep-scrub is set 2023-08-01T19:55:12.602 DEBUG:teuthology.orchestra.run.smithi101:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 30 ceph --cluster ceph --admin-daemon /var/run/ceph/ceph-osd.1.asok dump_blocked_ops 2023-08-01T19:55:12.603 INFO:tasks.ceph.osd.1.smithi101.stderr:2023-08-01T19:55:12.600+0000 7fb0cb7f6700 -1 received signal: Hangup from /usr/bin/python3 /bin/daemon-helper kill ceph-osd -f --cluster ceph -i 1 (PID: 111141) UID: 0 2023-08-01T19:55:12.702 INFO:tasks.ceph.osd.1.smithi101.stderr:2023-08-01T19:55:12.701+0000 7fb0cb7f6700 -1 received signal: Hangup from /usr/bin/python3 /bin/daemon-helper kill ceph-osd -f --cluster ceph -i 1 (PID: 111141) UID: 0 2023-08-01T19:55:12.795 INFO:teuthology.orchestra.run.smithi101.stdout:{ 2023-08-01T19:55:12.796 INFO:teuthology.orchestra.run.smithi101.stdout: "ops": [], 2023-08-01T19:55:12.796 INFO:teuthology.orchestra.run.smithi101.stdout: "complaint_time": 30, 2023-08-01T19:55:12.796 INFO:teuthology.orchestra.run.smithi101.stdout: "num_blocked_ops": 0 2023-08-01T19:55:12.796 INFO:teuthology.orchestra.run.smithi101.stdout:} 2023-08-01T19:55:12.803 INFO:tasks.ceph.osd.1.smithi101.stderr:2023-08-01T19:55:12.802+0000 7fb0cb7f6700 -1 received signal: Hangup from /usr/bin/python3 /bin/daemon-helper kill ceph-osd -f --cluster ceph -i 1 (PID: 111141) UID: 0 2023-08-01T19:55:12.808 DEBUG:teuthology.orchestra.run.smithi101:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 30 ceph --cluster ceph --admin-daemon /var/run/ceph/ceph-osd.1.asok dump_historic_ops 2023-08-01T19:55:12.904 INFO:tasks.ceph.osd.2.smithi155.stderr:2023-08-01T19:55:12.903+0000 7faa5c6ac700 -1 received signal: Hangup from /usr/bin/python3 /bin/daemon-helper kill ceph-osd -f --cluster ceph -i 2 (PID: 111337) UID: 0 2023-08-01T19:55:13.004 INFO:tasks.ceph.osd.2.smithi155.stderr:2023-08-01T19:55:13.003+0000 7faa5c6ac700 -1 received signal: Hangup from /usr/bin/python3 /bin/daemon-helper kill ceph-osd -f --cluster ceph -i 2 (PID: 111337) UID: 0 2023-08-01T19:55:13.006 INFO:teuthology.orchestra.run.smithi101.stdout:{ 2023-08-01T19:55:13.006 INFO:teuthology.orchestra.run.smithi101.stdout: "size": 20, 2023-08-01T19:55:13.006 INFO:teuthology.orchestra.run.smithi101.stdout: "duration": 600, 2023-08-01T19:55:13.006 INFO:teuthology.orchestra.run.smithi101.stdout: "ops": [ 2023-08-01T19:55:13.006 INFO:teuthology.orchestra.run.smithi101.stdout: { 2023-08-01T19:55:13.006 INFO:teuthology.orchestra.run.smithi101.stdout: "description": "osd_op(mds.0.3:11 3.10 3:0bd6d154:::602.00000000:head [create,setxattr parent (62) in=6b,setxattr layout (30) in=6b] snapc 0=[] ondisk+write+known_if_redirected+full_force+supports_pool_eio e17)", 2023-08-01T19:55:13.007 INFO:teuthology.orchestra.run.smithi101.stdout: "initiated_at": "2023-08-01T19:54:04.458960+0000", 2023-08-01T19:55:13.007 INFO:teuthology.orchestra.run.smithi101.stdout: "age": 68.544457190000003, 2023-08-01T19:55:13.007 INFO:teuthology.orchestra.run.smithi101.stdout: "duration": 0.019645459000000001, 2023-08-01T19:55:13.007 INFO:teuthology.orchestra.run.smithi101.stdout: "type_data": { 2023-08-01T19:55:13.007 INFO:teuthology.orchestra.run.smithi101.stdout: "flag_point": "commit sent; apply or cleanup", 2023-08-01T19:55:13.007 INFO:teuthology.orchestra.run.smithi101.stdout: "events": [ 2023-08-01T19:55:13.007 INFO:teuthology.orchestra.run.smithi101.stdout: { 2023-08-01T19:55:13.008 INFO:teuthology.orchestra.run.smithi101.stdout: "event": "initiated", 2023-08-01T19:55:13.008 INFO:teuthology.orchestra.run.smithi101.stdout: "time": "2023-08-01T19:54:04.458960+0000", 2023-08-01T19:55:13.008 INFO:teuthology.orchestra.run.smithi101.stdout: "duration": 0 2023-08-01T19:55:13.008 INFO:teuthology.orchestra.run.smithi101.stdout: }, 2023-08-01T19:55:13.008 INFO:teuthology.orchestra.run.smithi101.stdout: { 2023-08-01T19:55:13.008 INFO:teuthology.orchestra.run.smithi101.stdout: "event": "throttled", 2023-08-01T19:55:13.009 INFO:teuthology.orchestra.run.smithi101.stdout: "time": "2023-08-01T19:54:04.458960+0000", 2023-08-01T19:55:13.009 INFO:teuthology.orchestra.run.smithi101.stdout: "duration": 0 2023-08-01T19:55:13.009 INFO:teuthology.orchestra.run.smithi101.stdout: }, 2023-08-01T19:55:13.009 INFO:teuthology.orchestra.run.smithi101.stdout: { 2023-08-01T19:55:13.009 INFO:teuthology.orchestra.run.smithi101.stdout: "event": "header_read", 2023-08-01T19:55:13.009 INFO:teuthology.orchestra.run.smithi101.stdout: "time": "2023-08-01T19:54:04.458959+0000", 2023-08-01T19:55:13.009 INFO:teuthology.orchestra.run.smithi101.stdout: "duration": 4294967295.9999995 2023-08-01T19:55:13.010 INFO:teuthology.orchestra.run.smithi101.stdout: }, 2023-08-01T19:55:13.010 INFO:teuthology.orchestra.run.smithi101.stdout: { 2023-08-01T19:55:13.010 INFO:teuthology.orchestra.run.smithi101.stdout: "event": "all_read", 2023-08-01T19:55:13.010 INFO:teuthology.orchestra.run.smithi101.stdout: "time": "2023-08-01T19:54:04.458963+0000", 2023-08-01T19:55:13.010 INFO:teuthology.orchestra.run.smithi101.stdout: "duration": 3.9199999999999997e-06 2023-08-01T19:55:13.010 INFO:teuthology.orchestra.run.smithi101.stdout: }, 2023-08-01T19:55:13.011 INFO:teuthology.orchestra.run.smithi101.stdout: { 2023-08-01T19:55:13.011 INFO:teuthology.orchestra.run.smithi101.stdout: "event": "dispatched", 2023-08-01T19:55:13.011 INFO:teuthology.orchestra.run.smithi101.stdout: "time": "2023-08-01T19:54:04.458970+0000", 2023-08-01T19:55:13.011 INFO:teuthology.orchestra.run.smithi101.stdout: "duration": 7.0439999999999998e-06 2023-08-01T19:55:13.011 INFO:teuthology.orchestra.run.smithi101.stdout: }, 2023-08-01T19:55:13.012 INFO:teuthology.orchestra.run.smithi101.stdout: { 2023-08-01T19:55:13.012 INFO:teuthology.orchestra.run.smithi101.stdout: "event": "queued_for_pg", 2023-08-01T19:55:13.012 INFO:teuthology.orchestra.run.smithi101.stdout: "time": "2023-08-01T19:54:04.458976+0000", 2023-08-01T19:55:13.012 INFO:teuthology.orchestra.run.smithi101.stdout: "duration": 5.9540000000000001e-06 2023-08-01T19:55:13.012 INFO:teuthology.orchestra.run.smithi101.stdout: }, 2023-08-01T19:55:13.012 INFO:teuthology.orchestra.run.smithi101.stdout: { 2023-08-01T19:55:13.013 INFO:teuthology.orchestra.run.smithi101.stdout: "event": "reached_pg", 2023-08-01T19:55:13.013 INFO:teuthology.orchestra.run.smithi101.stdout: "time": "2023-08-01T19:54:04.459035+0000", 2023-08-01T19:55:13.013 INFO:teuthology.orchestra.run.smithi101.stdout: "duration": 5.8924e-05 2023-08-01T19:55:13.013 INFO:teuthology.orchestra.run.smithi101.stdout: }, 2023-08-01T19:55:13.014 INFO:teuthology.orchestra.run.smithi101.stdout: { 2023-08-01T19:55:13.014 INFO:teuthology.orchestra.run.smithi101.stdout: "event": "waiting_for_map not empty", 2023-08-01T19:55:13.014 INFO:teuthology.orchestra.run.smithi101.stdout: "time": "2023-08-01T19:54:04.459038+0000", 2023-08-01T19:55:13.014 INFO:teuthology.orchestra.run.smithi101.stdout: "duration": 3.2760000000000001e-06 2023-08-01T19:55:13.015 INFO:teuthology.orchestra.run.smithi101.stdout: }, 2023-08-01T19:55:13.015 INFO:teuthology.orchestra.run.smithi101.stdout: { 2023-08-01T19:55:13.015 INFO:teuthology.orchestra.run.smithi101.stdout: "event": "reached_pg", 2023-08-01T19:55:13.015 INFO:teuthology.orchestra.run.smithi101.stdout: "time": "2023-08-01T19:54:04.471511+0000", 2023-08-01T19:55:13.015 INFO:teuthology.orchestra.run.smithi101.stdout: "duration": 0.012473039999999999 2023-08-01T19:55:13.015 INFO:teuthology.orchestra.run.smithi101.stdout: }, 2023-08-01T19:55:13.016 INFO:teuthology.orchestra.run.smithi101.stdout: { 2023-08-01T19:55:13.016 INFO:teuthology.orchestra.run.smithi101.stdout: "event": "started", 2023-08-01T19:55:13.016 INFO:teuthology.orchestra.run.smithi101.stdout: "time": "2023-08-01T19:54:04.472086+0000", 2023-08-01T19:55:13.016 INFO:teuthology.orchestra.run.smithi101.stdout: "duration": 0.00057491699999999998 2023-08-01T19:55:13.017 INFO:teuthology.orchestra.run.smithi101.stdout: }, 2023-08-01T19:55:13.017 INFO:teuthology.orchestra.run.smithi101.stdout: { 2023-08-01T19:55:13.017 INFO:teuthology.orchestra.run.smithi101.stdout: "event": "waiting for subops from 2", 2023-08-01T19:55:13.017 INFO:teuthology.orchestra.run.smithi101.stdout: "time": "2023-08-01T19:54:04.472310+0000", 2023-08-01T19:55:13.017 INFO:teuthology.orchestra.run.smithi101.stdout: "duration": 0.00022396499999999999 2023-08-01T19:55:13.017 INFO:teuthology.orchestra.run.smithi101.stdout: }, 2023-08-01T19:55:13.017 INFO:teuthology.orchestra.run.smithi101.stdout: { 2023-08-01T19:55:13.018 INFO:teuthology.orchestra.run.smithi101.stdout: "event": "op_commit", 2023-08-01T19:55:13.018 INFO:teuthology.orchestra.run.smithi101.stdout: "time": "2023-08-01T19:54:04.478141+0000", 2023-08-01T19:55:13.018 INFO:teuthology.orchestra.run.smithi101.stdout: "duration": 0.0058312320000000004 2023-08-01T19:55:13.018 INFO:teuthology.orchestra.run.smithi101.stdout: }, 2023-08-01T19:55:13.018 INFO:teuthology.orchestra.run.smithi101.stdout: { 2023-08-01T19:55:13.018 INFO:teuthology.orchestra.run.smithi101.stdout: "event": "sub_op_commit_rec", 2023-08-01T19:55:13.018 INFO:teuthology.orchestra.run.smithi101.stdout: "time": "2023-08-01T19:54:04.478543+0000", 2023-08-01T19:55:13.019 INFO:teuthology.orchestra.run.smithi101.stdout: "duration": 0.00040160800000000002 2023-08-01T19:55:13.019 INFO:teuthology.orchestra.run.smithi101.stdout: }, 2023-08-01T19:55:13.019 INFO:teuthology.orchestra.run.smithi101.stdout: { 2023-08-01T19:55:13.019 INFO:teuthology.orchestra.run.smithi101.stdout: "event": "commit_sent", 2023-08-01T19:55:13.019 INFO:teuthology.orchestra.run.smithi101.stdout: "time": "2023-08-01T19:54:04.478584+0000", 2023-08-01T19:55:13.019 INFO:teuthology.orchestra.run.smithi101.stdout: "duration": 4.0989999999999999e-05 2023-08-01T19:55:13.019 INFO:teuthology.orchestra.run.smithi101.stdout: }, 2023-08-01T19:55:13.019 INFO:teuthology.orchestra.run.smithi101.stdout: { 2023-08-01T19:55:13.020 INFO:teuthology.orchestra.run.smithi101.stdout: "event": "done", 2023-08-01T19:55:13.020 INFO:teuthology.orchestra.run.smithi101.stdout: "time": "2023-08-01T19:54:04.478605+0000", 2023-08-01T19:55:13.020 INFO:teuthology.orchestra.run.smithi101.stdout: "duration": 2.1178e-05 2023-08-01T19:55:13.020 INFO:teuthology.orchestra.run.smithi101.stdout: } 2023-08-01T19:55:13.020 INFO:teuthology.orchestra.run.smithi101.stdout: ] 2023-08-01T19:55:13.020 INFO:teuthology.orchestra.run.smithi101.stdout: } 2023-08-01T19:55:13.020 INFO:teuthology.orchestra.run.smithi101.stdout: }, 2023-08-01T19:55:13.021 INFO:teuthology.orchestra.run.smithi101.stdout: { 2023-08-01T19:55:13.021 INFO:teuthology.orchestra.run.smithi101.stdout: "description": "osd_op(mds.0.3:12 3.10 3:0d89b25e:::603.00000000:head [omap-set-header] snapc 0=[] ondisk+write+known_if_redirected+full_force+supports_pool_eio e17)", 2023-08-01T19:55:13.021 INFO:teuthology.orchestra.run.smithi101.stdout: "initiated_at": "2023-08-01T19:54:04.458982+0000", 2023-08-01T19:55:13.021 INFO:teuthology.orchestra.run.smithi101.stdout: "age": 68.544434961999997, 2023-08-01T19:55:13.021 INFO:teuthology.orchestra.run.smithi101.stdout: "duration": 0.021266334000000001, 2023-08-01T19:55:13.021 INFO:teuthology.orchestra.run.smithi101.stdout: "type_data": { 2023-08-01T19:55:13.021 INFO:teuthology.orchestra.run.smithi101.stdout: "flag_point": "commit sent; apply or cleanup", 2023-08-01T19:55:13.021 INFO:teuthology.orchestra.run.smithi101.stdout: "events": [ 2023-08-01T19:55:13.022 INFO:teuthology.orchestra.run.smithi101.stdout: { 2023-08-01T19:55:13.022 INFO:teuthology.orchestra.run.smithi101.stdout: "event": "initiated", 2023-08-01T19:55:13.022 INFO:teuthology.orchestra.run.smithi101.stdout: "time": "2023-08-01T19:54:04.458982+0000", 2023-08-01T19:55:13.022 INFO:teuthology.orchestra.run.smithi101.stdout: "duration": 0 2023-08-01T19:55:13.022 INFO:teuthology.orchestra.run.smithi101.stdout: }, 2023-08-01T19:55:13.022 INFO:teuthology.orchestra.run.smithi101.stdout: { 2023-08-01T19:55:13.022 INFO:teuthology.orchestra.run.smithi101.stdout: "event": "throttled", 2023-08-01T19:55:13.022 INFO:teuthology.orchestra.run.smithi101.stdout: "time": "2023-08-01T19:54:04.458982+0000", 2023-08-01T19:55:13.023 INFO:teuthology.orchestra.run.smithi101.stdout: "duration": 0 2023-08-01T19:55:13.023 INFO:teuthology.orchestra.run.smithi101.stdout: }, 2023-08-01T19:55:13.023 INFO:teuthology.orchestra.run.smithi101.stdout: { 2023-08-01T19:55:13.023 INFO:teuthology.orchestra.run.smithi101.stdout: "event": "header_read", 2023-08-01T19:55:13.023 INFO:teuthology.orchestra.run.smithi101.stdout: "time": "2023-08-01T19:54:04.458982+0000", 2023-08-01T19:55:13.023 INFO:teuthology.orchestra.run.smithi101.stdout: "duration": 4294967295.9999995 2023-08-01T19:55:13.023 INFO:teuthology.orchestra.run.smithi101.stdout: }, 2023-08-01T19:55:13.023 INFO:teuthology.orchestra.run.smithi101.stdout: { 2023-08-01T19:55:13.024 INFO:teuthology.orchestra.run.smithi101.stdout: "event": "all_read", 2023-08-01T19:55:13.024 INFO:teuthology.orchestra.run.smithi101.stdout: "time": "2023-08-01T19:54:04.458985+0000", 2023-08-01T19:55:13.024 INFO:teuthology.orchestra.run.smithi101.stdout: "duration": 3.4800000000000001e-06 2023-08-01T19:55:13.024 INFO:teuthology.orchestra.run.smithi101.stdout: }, 2023-08-01T19:55:13.024 INFO:teuthology.orchestra.run.smithi101.stdout: { 2023-08-01T19:55:13.024 INFO:teuthology.orchestra.run.smithi101.stdout: "event": "dispatched", 2023-08-01T19:55:13.024 INFO:teuthology.orchestra.run.smithi101.stdout: "time": "2023-08-01T19:54:04.458992+0000", 2023-08-01T19:55:13.025 INFO:teuthology.orchestra.run.smithi101.stdout: "duration": 7.306e-06 2023-08-01T19:55:13.025 INFO:teuthology.orchestra.run.smithi101.stdout: }, 2023-08-01T19:55:13.025 INFO:teuthology.orchestra.run.smithi101.stdout: { 2023-08-01T19:55:13.025 INFO:teuthology.orchestra.run.smithi101.stdout: "event": "queued_for_pg", 2023-08-01T19:55:13.025 INFO:teuthology.orchestra.run.smithi101.stdout: "time": "2023-08-01T19:54:04.458997+0000", 2023-08-01T19:55:13.025 INFO:teuthology.orchestra.run.smithi101.stdout: "duration": 4.4530000000000004e-06 2023-08-01T19:55:13.025 INFO:teuthology.orchestra.run.smithi101.stdout: }, 2023-08-01T19:55:13.025 INFO:teuthology.orchestra.run.smithi101.stdout: { 2023-08-01T19:55:13.026 INFO:teuthology.orchestra.run.smithi101.stdout: "event": "reached_pg", 2023-08-01T19:55:13.026 INFO:teuthology.orchestra.run.smithi101.stdout: "time": "2023-08-01T19:54:04.459060+0000", 2023-08-01T19:55:13.026 INFO:teuthology.orchestra.run.smithi101.stdout: "duration": 6.3249000000000004e-05 2023-08-01T19:55:13.026 INFO:teuthology.orchestra.run.smithi101.stdout: }, 2023-08-01T19:55:13.026 INFO:teuthology.orchestra.run.smithi101.stdout: { 2023-08-01T19:55:13.026 INFO:teuthology.orchestra.run.smithi101.stdout: "event": "waiting_for_map not empty", 2023-08-01T19:55:13.026 INFO:teuthology.orchestra.run.smithi101.stdout: "time": "2023-08-01T19:54:04.459063+0000", 2023-08-01T19:55:13.026 INFO:teuthology.orchestra.run.smithi101.stdout: "duration": 2.717e-06 2023-08-01T19:55:13.027 INFO:teuthology.orchestra.run.smithi101.stdout: }, 2023-08-01T19:55:13.027 INFO:teuthology.orchestra.run.smithi101.stdout: { 2023-08-01T19:55:13.027 INFO:teuthology.orchestra.run.smithi101.stdout: "event": "reached_pg", 2023-08-01T19:55:13.027 INFO:teuthology.orchestra.run.smithi101.stdout: "time": "2023-08-01T19:54:04.473625+0000", 2023-08-01T19:55:13.027 INFO:teuthology.orchestra.run.smithi101.stdout: "duration": 0.014562007 2023-08-01T19:55:13.027 INFO:teuthology.orchestra.run.smithi101.stdout: }, 2023-08-01T19:55:13.027 INFO:teuthology.orchestra.run.smithi101.stdout: { 2023-08-01T19:55:13.027 INFO:teuthology.orchestra.run.smithi101.stdout: "event": "started", 2023-08-01T19:55:13.028 INFO:teuthology.orchestra.run.smithi101.stdout: "time": "2023-08-01T19:54:04.473757+0000", 2023-08-01T19:55:13.028 INFO:teuthology.orchestra.run.smithi101.stdout: "duration": 0.00013238599999999999 2023-08-01T19:55:13.028 INFO:teuthology.orchestra.run.smithi101.stdout: }, 2023-08-01T19:55:13.028 INFO:teuthology.orchestra.run.smithi101.stdout: { 2023-08-01T19:55:13.028 INFO:teuthology.orchestra.run.smithi101.stdout: "event": "waiting for subops from 2", 2023-08-01T19:55:13.028 INFO:teuthology.orchestra.run.smithi101.stdout: "time": "2023-08-01T19:54:04.473898+0000", 2023-08-01T19:55:13.029 INFO:teuthology.orchestra.run.smithi101.stdout: "duration": 0.00014039 2023-08-01T19:55:13.029 INFO:teuthology.orchestra.run.smithi101.stdout: }, 2023-08-01T19:55:13.029 INFO:teuthology.orchestra.run.smithi101.stdout: { 2023-08-01T19:55:13.029 INFO:teuthology.orchestra.run.smithi101.stdout: "event": "op_commit", 2023-08-01T19:55:13.029 INFO:teuthology.orchestra.run.smithi101.stdout: "time": "2023-08-01T19:54:04.478380+0000", 2023-08-01T19:55:13.029 INFO:teuthology.orchestra.run.smithi101.stdout: "duration": 0.0044827449999999998 2023-08-01T19:55:13.029 INFO:teuthology.orchestra.run.smithi101.stdout: }, 2023-08-01T19:55:13.030 INFO:teuthology.orchestra.run.smithi101.stdout: { 2023-08-01T19:55:13.030 INFO:teuthology.orchestra.run.smithi101.stdout: "event": "sub_op_commit_rec", 2023-08-01T19:55:13.030 INFO:teuthology.orchestra.run.smithi101.stdout: "time": "2023-08-01T19:54:04.480169+0000", 2023-08-01T19:55:13.030 INFO:teuthology.orchestra.run.smithi101.stdout: "duration": 0.0017886040000000001 2023-08-01T19:55:13.030 INFO:teuthology.orchestra.run.smithi101.stdout: }, 2023-08-01T19:55:13.030 INFO:teuthology.orchestra.run.smithi101.stdout: { 2023-08-01T19:55:13.030 INFO:teuthology.orchestra.run.smithi101.stdout: "event": "commit_sent", 2023-08-01T19:55:13.031 INFO:teuthology.orchestra.run.smithi101.stdout: "time": "2023-08-01T19:54:04.480212+0000", 2023-08-01T19:55:13.031 INFO:teuthology.orchestra.run.smithi101.stdout: "duration": 4.2687e-05 2023-08-01T19:55:13.031 INFO:teuthology.orchestra.run.smithi101.stdout: }, 2023-08-01T19:55:13.031 INFO:teuthology.orchestra.run.smithi101.stdout: { 2023-08-01T19:55:13.031 INFO:teuthology.orchestra.run.smithi101.stdout: "event": "done", 2023-08-01T19:55:13.031 INFO:teuthology.orchestra.run.smithi101.stdout: "time": "2023-08-01T19:54:04.480248+0000", 2023-08-01T19:55:13.031 INFO:teuthology.orchestra.run.smithi101.stdout: "duration": 3.6743999999999999e-05 2023-08-01T19:55:13.031 INFO:teuthology.orchestra.run.smithi101.stdout: } 2023-08-01T19:55:13.032 INFO:teuthology.orchestra.run.smithi101.stdout: ] 2023-08-01T19:55:13.032 INFO:teuthology.orchestra.run.smithi101.stdout: } 2023-08-01T19:55:13.032 INFO:teuthology.orchestra.run.smithi101.stdout: }, 2023-08-01T19:55:13.032 INFO:teuthology.orchestra.run.smithi101.stdout: { 2023-08-01T19:55:13.032 INFO:teuthology.orchestra.run.smithi101.stdout: "description": "osd_op(mds.0.3:13 3.10 3:0d89b25e:::603.00000000:head [create,setxattr parent (62) in=6b,setxattr layout (30) in=6b] snapc 0=[] ondisk+write+known_if_redirected+full_force+supports_pool_eio e17)", 2023-08-01T19:55:13.032 INFO:teuthology.orchestra.run.smithi101.stdout: "initiated_at": "2023-08-01T19:54:04.459010+0000", 2023-08-01T19:55:13.032 INFO:teuthology.orchestra.run.smithi101.stdout: "age": 68.544407242000005, 2023-08-01T19:55:13.033 INFO:teuthology.orchestra.run.smithi101.stdout: "duration": 0.021327220000000001, 2023-08-01T19:55:13.033 INFO:teuthology.orchestra.run.smithi101.stdout: "type_data": { 2023-08-01T19:55:13.033 INFO:teuthology.orchestra.run.smithi101.stdout: "flag_point": "commit sent; apply or cleanup", 2023-08-01T19:55:13.033 INFO:teuthology.orchestra.run.smithi101.stdout: "events": [ 2023-08-01T19:55:13.033 INFO:teuthology.orchestra.run.smithi101.stdout: { 2023-08-01T19:55:13.033 INFO:teuthology.orchestra.run.smithi101.stdout: "event": "initiated", 2023-08-01T19:55:13.033 INFO:teuthology.orchestra.run.smithi101.stdout: "time": "2023-08-01T19:54:04.459010+0000", 2023-08-01T19:55:13.033 INFO:teuthology.orchestra.run.smithi101.stdout: "duration": 0 2023-08-01T19:55:13.034 INFO:teuthology.orchestra.run.smithi101.stdout: }, 2023-08-01T19:55:13.034 INFO:teuthology.orchestra.run.smithi101.stdout: { 2023-08-01T19:55:13.034 INFO:teuthology.orchestra.run.smithi101.stdout: "event": "throttled", 2023-08-01T19:55:13.034 INFO:teuthology.orchestra.run.smithi101.stdout: "time": "2023-08-01T19:54:04.459010+0000", 2023-08-01T19:55:13.034 INFO:teuthology.orchestra.run.smithi101.stdout: "duration": 0 2023-08-01T19:55:13.034 INFO:teuthology.orchestra.run.smithi101.stdout: }, 2023-08-01T19:55:13.034 INFO:teuthology.orchestra.run.smithi101.stdout: { 2023-08-01T19:55:13.034 INFO:teuthology.orchestra.run.smithi101.stdout: "event": "header_read", 2023-08-01T19:55:13.035 INFO:teuthology.orchestra.run.smithi101.stdout: "time": "2023-08-01T19:54:04.459009+0000", 2023-08-01T19:55:13.035 INFO:teuthology.orchestra.run.smithi101.stdout: "duration": 4294967295.9999995 2023-08-01T19:55:13.035 INFO:teuthology.orchestra.run.smithi101.stdout: }, 2023-08-01T19:55:13.035 INFO:teuthology.orchestra.run.smithi101.stdout: { 2023-08-01T19:55:13.035 INFO:teuthology.orchestra.run.smithi101.stdout: "event": "all_read", 2023-08-01T19:55:13.035 INFO:teuthology.orchestra.run.smithi101.stdout: "time": "2023-08-01T19:54:04.459013+0000", 2023-08-01T19:55:13.035 INFO:teuthology.orchestra.run.smithi101.stdout: "duration": 3.8929999999999998e-06 2023-08-01T19:55:13.035 INFO:teuthology.orchestra.run.smithi101.stdout: }, 2023-08-01T19:55:13.036 INFO:teuthology.orchestra.run.smithi101.stdout: { 2023-08-01T19:55:13.036 INFO:teuthology.orchestra.run.smithi101.stdout: "event": "dispatched", 2023-08-01T19:55:13.036 INFO:teuthology.orchestra.run.smithi101.stdout: "time": "2023-08-01T19:54:04.459027+0000", 2023-08-01T19:55:13.036 INFO:teuthology.orchestra.run.smithi101.stdout: "duration": 1.3416e-05 2023-08-01T19:55:13.036 INFO:teuthology.orchestra.run.smithi101.stdout: }, 2023-08-01T19:55:13.037 INFO:teuthology.orchestra.run.smithi101.stdout: { 2023-08-01T19:55:13.037 INFO:teuthology.orchestra.run.smithi101.stdout: "event": "queued_for_pg", 2023-08-01T19:55:13.037 INFO:teuthology.orchestra.run.smithi101.stdout: "time": "2023-08-01T19:54:04.459033+0000", 2023-08-01T19:55:13.037 INFO:teuthology.orchestra.run.smithi101.stdout: "duration": 5.9800000000000003e-06 2023-08-01T19:55:13.037 INFO:teuthology.orchestra.run.smithi101.stdout: }, 2023-08-01T19:55:13.037 INFO:teuthology.orchestra.run.smithi101.stdout: { 2023-08-01T19:55:13.037 INFO:teuthology.orchestra.run.smithi101.stdout: "event": "reached_pg", 2023-08-01T19:55:13.037 INFO:teuthology.orchestra.run.smithi101.stdout: "time": "2023-08-01T19:54:04.459099+0000", 2023-08-01T19:55:13.038 INFO:teuthology.orchestra.run.smithi101.stdout: "duration": 6.6192999999999995e-05 2023-08-01T19:55:13.038 INFO:teuthology.orchestra.run.smithi101.stdout: }, 2023-08-01T19:55:13.038 INFO:teuthology.orchestra.run.smithi101.stdout: { 2023-08-01T19:55:13.038 INFO:teuthology.orchestra.run.smithi101.stdout: "event": "waiting_for_map not empty", 2023-08-01T19:55:13.038 INFO:teuthology.orchestra.run.smithi101.stdout: "time": "2023-08-01T19:54:04.459106+0000", 2023-08-01T19:55:13.038 INFO:teuthology.orchestra.run.smithi101.stdout: "duration": 6.8619999999999997e-06 2023-08-01T19:55:13.038 INFO:teuthology.orchestra.run.smithi101.stdout: }, 2023-08-01T19:55:13.039 INFO:teuthology.orchestra.run.smithi101.stdout: { 2023-08-01T19:55:13.039 INFO:teuthology.orchestra.run.smithi101.stdout: "event": "reached_pg", 2023-08-01T19:55:13.039 INFO:teuthology.orchestra.run.smithi101.stdout: "time": "2023-08-01T19:54:04.475182+0000", 2023-08-01T19:55:13.039 INFO:teuthology.orchestra.run.smithi101.stdout: "duration": 0.016076333000000002 2023-08-01T19:55:13.039 INFO:teuthology.orchestra.run.smithi101.stdout: }, 2023-08-01T19:55:13.039 INFO:teuthology.orchestra.run.smithi101.stdout: { 2023-08-01T19:55:13.039 INFO:teuthology.orchestra.run.smithi101.stdout: "event": "started", 2023-08-01T19:55:13.039 INFO:teuthology.orchestra.run.smithi101.stdout: "time": "2023-08-01T19:54:04.475353+0000", 2023-08-01T19:55:13.040 INFO:teuthology.orchestra.run.smithi101.stdout: "duration": 0.000171378 2023-08-01T19:55:13.040 INFO:teuthology.orchestra.run.smithi101.stdout: }, 2023-08-01T19:55:13.040 INFO:teuthology.orchestra.run.smithi101.stdout: { 2023-08-01T19:55:13.040 INFO:teuthology.orchestra.run.smithi101.stdout: "event": "waiting for subops from 2", 2023-08-01T19:55:13.040 INFO:teuthology.orchestra.run.smithi101.stdout: "time": "2023-08-01T19:54:04.475793+0000", 2023-08-01T19:55:13.040 INFO:teuthology.orchestra.run.smithi101.stdout: "duration": 0.000440123 2023-08-01T19:55:13.040 INFO:teuthology.orchestra.run.smithi101.stdout: }, 2023-08-01T19:55:13.040 INFO:teuthology.orchestra.run.smithi101.stdout: { 2023-08-01T19:55:13.041 INFO:teuthology.orchestra.run.smithi101.stdout: "event": "op_commit", 2023-08-01T19:55:13.041 INFO:teuthology.orchestra.run.smithi101.stdout: "time": "2023-08-01T19:54:04.478624+0000", 2023-08-01T19:55:13.041 INFO:teuthology.orchestra.run.smithi101.stdout: "duration": 0.0028305000000000001 2023-08-01T19:55:13.041 INFO:teuthology.orchestra.run.smithi101.stdout: }, 2023-08-01T19:55:13.041 INFO:teuthology.orchestra.run.smithi101.stdout: { 2023-08-01T19:55:13.041 INFO:teuthology.orchestra.run.smithi101.stdout: "event": "sub_op_commit_rec", 2023-08-01T19:55:13.041 INFO:teuthology.orchestra.run.smithi101.stdout: "time": "2023-08-01T19:54:04.480291+0000", 2023-08-01T19:55:13.042 INFO:teuthology.orchestra.run.smithi101.stdout: "duration": 0.0016670000000000001 2023-08-01T19:55:13.042 INFO:teuthology.orchestra.run.smithi101.stdout: }, 2023-08-01T19:55:13.042 INFO:teuthology.orchestra.run.smithi101.stdout: { 2023-08-01T19:55:13.042 INFO:teuthology.orchestra.run.smithi101.stdout: "event": "commit_sent", 2023-08-01T19:55:13.042 INFO:teuthology.orchestra.run.smithi101.stdout: "time": "2023-08-01T19:54:04.480318+0000", 2023-08-01T19:55:13.042 INFO:teuthology.orchestra.run.smithi101.stdout: "duration": 2.6815e-05 2023-08-01T19:55:13.042 INFO:teuthology.orchestra.run.smithi101.stdout: }, 2023-08-01T19:55:13.042 INFO:teuthology.orchestra.run.smithi101.stdout: { 2023-08-01T19:55:13.043 INFO:teuthology.orchestra.run.smithi101.stdout: "event": "done", 2023-08-01T19:55:13.043 INFO:teuthology.orchestra.run.smithi101.stdout: "time": "2023-08-01T19:54:04.480337+0000", 2023-08-01T19:55:13.043 INFO:teuthology.orchestra.run.smithi101.stdout: "duration": 1.9241000000000001e-05 2023-08-01T19:55:13.043 INFO:teuthology.orchestra.run.smithi101.stdout: } 2023-08-01T19:55:13.043 INFO:teuthology.orchestra.run.smithi101.stdout: ] 2023-08-01T19:55:13.043 INFO:teuthology.orchestra.run.smithi101.stdout: } 2023-08-01T19:55:13.043 INFO:teuthology.orchestra.run.smithi101.stdout: }, 2023-08-01T19:55:13.044 INFO:teuthology.orchestra.run.smithi101.stdout: { 2023-08-01T19:55:13.044 INFO:teuthology.orchestra.run.smithi101.stdout: "description": "osd_op(mds.0.3:1 3.14 3:292cf221:::200.00000000:head [writefull 0~90] snapc 0=[] ondisk+write+known_if_redirected+full_force+supports_pool_eio e17)", 2023-08-01T19:55:13.044 INFO:teuthology.orchestra.run.smithi101.stdout: "initiated_at": "2023-08-01T19:54:04.459177+0000", 2023-08-01T19:55:13.044 INFO:teuthology.orchestra.run.smithi101.stdout: "age": 68.544240342999998, 2023-08-01T19:55:13.044 INFO:teuthology.orchestra.run.smithi101.stdout: "duration": 0.021067196, 2023-08-01T19:55:13.044 INFO:teuthology.orchestra.run.smithi101.stdout: "type_data": { 2023-08-01T19:55:13.044 INFO:teuthology.orchestra.run.smithi101.stdout: "flag_point": "commit sent; apply or cleanup", 2023-08-01T19:55:13.045 INFO:teuthology.orchestra.run.smithi101.stdout: "events": [ 2023-08-01T19:55:13.045 INFO:teuthology.orchestra.run.smithi101.stdout: { 2023-08-01T19:55:13.045 INFO:teuthology.orchestra.run.smithi101.stdout: "event": "initiated", 2023-08-01T19:55:13.045 INFO:teuthology.orchestra.run.smithi101.stdout: "time": "2023-08-01T19:54:04.459177+0000", 2023-08-01T19:55:13.045 INFO:teuthology.orchestra.run.smithi101.stdout: "duration": 0 2023-08-01T19:55:13.045 INFO:teuthology.orchestra.run.smithi101.stdout: }, 2023-08-01T19:55:13.045 INFO:teuthology.orchestra.run.smithi101.stdout: { 2023-08-01T19:55:13.045 INFO:teuthology.orchestra.run.smithi101.stdout: "event": "throttled", 2023-08-01T19:55:13.046 INFO:teuthology.orchestra.run.smithi101.stdout: "time": "2023-08-01T19:54:04.459177+0000", 2023-08-01T19:55:13.046 INFO:teuthology.orchestra.run.smithi101.stdout: "duration": 0 2023-08-01T19:55:13.046 INFO:teuthology.orchestra.run.smithi101.stdout: }, 2023-08-01T19:55:13.046 INFO:teuthology.orchestra.run.smithi101.stdout: { 2023-08-01T19:55:13.046 INFO:teuthology.orchestra.run.smithi101.stdout: "event": "header_read", 2023-08-01T19:55:13.046 INFO:teuthology.orchestra.run.smithi101.stdout: "time": "2023-08-01T19:54:04.459176+0000", 2023-08-01T19:55:13.046 INFO:teuthology.orchestra.run.smithi101.stdout: "duration": 4294967295.9999995 2023-08-01T19:55:13.046 INFO:teuthology.orchestra.run.smithi101.stdout: }, 2023-08-01T19:55:13.047 INFO:teuthology.orchestra.run.smithi101.stdout: { 2023-08-01T19:55:13.047 INFO:teuthology.orchestra.run.smithi101.stdout: "event": "all_read", 2023-08-01T19:55:13.047 INFO:teuthology.orchestra.run.smithi101.stdout: "time": "2023-08-01T19:54:04.459181+0000", 2023-08-01T19:55:13.047 INFO:teuthology.orchestra.run.smithi101.stdout: "duration": 5.2109999999999997e-06 2023-08-01T19:55:13.047 INFO:teuthology.orchestra.run.smithi101.stdout: }, 2023-08-01T19:55:13.047 INFO:teuthology.orchestra.run.smithi101.stdout: { 2023-08-01T19:55:13.047 INFO:teuthology.orchestra.run.smithi101.stdout: "event": "dispatched", 2023-08-01T19:55:13.047 INFO:teuthology.orchestra.run.smithi101.stdout: "time": "2023-08-01T19:54:04.459188+0000", 2023-08-01T19:55:13.048 INFO:teuthology.orchestra.run.smithi101.stdout: "duration": 6.6680000000000004e-06 2023-08-01T19:55:13.048 INFO:teuthology.orchestra.run.smithi101.stdout: }, 2023-08-01T19:55:13.048 INFO:teuthology.orchestra.run.smithi101.stdout: { 2023-08-01T19:55:13.048 INFO:teuthology.orchestra.run.smithi101.stdout: "event": "queued_for_pg", 2023-08-01T19:55:13.048 INFO:teuthology.orchestra.run.smithi101.stdout: "time": "2023-08-01T19:54:04.459192+0000", 2023-08-01T19:55:13.048 INFO:teuthology.orchestra.run.smithi101.stdout: "duration": 4.228e-06 2023-08-01T19:55:13.048 INFO:teuthology.orchestra.run.smithi101.stdout: }, 2023-08-01T19:55:13.048 INFO:teuthology.orchestra.run.smithi101.stdout: { 2023-08-01T19:55:13.049 INFO:teuthology.orchestra.run.smithi101.stdout: "event": "reached_pg", 2023-08-01T19:55:13.049 INFO:teuthology.orchestra.run.smithi101.stdout: "time": "2023-08-01T19:54:04.459219+0000", 2023-08-01T19:55:13.049 INFO:teuthology.orchestra.run.smithi101.stdout: "duration": 2.6930000000000001e-05 2023-08-01T19:55:13.049 INFO:teuthology.orchestra.run.smithi101.stdout: }, 2023-08-01T19:55:13.049 INFO:teuthology.orchestra.run.smithi101.stdout: { 2023-08-01T19:55:13.049 INFO:teuthology.orchestra.run.smithi101.stdout: "event": "waiting_for_map not empty", 2023-08-01T19:55:13.049 INFO:teuthology.orchestra.run.smithi101.stdout: "time": "2023-08-01T19:54:04.459223+0000", 2023-08-01T19:55:13.050 INFO:teuthology.orchestra.run.smithi101.stdout: "duration": 3.8469999999999998e-06 2023-08-01T19:55:13.050 INFO:teuthology.orchestra.run.smithi101.stdout: }, 2023-08-01T19:55:13.050 INFO:teuthology.orchestra.run.smithi101.stdout: { 2023-08-01T19:55:13.050 INFO:teuthology.orchestra.run.smithi101.stdout: "event": "reached_pg", 2023-08-01T19:55:13.050 INFO:teuthology.orchestra.run.smithi101.stdout: "time": "2023-08-01T19:54:04.473347+0000", 2023-08-01T19:55:13.050 INFO:teuthology.orchestra.run.smithi101.stdout: "duration": 0.014124319 2023-08-01T19:55:13.050 INFO:teuthology.orchestra.run.smithi101.stdout: }, 2023-08-01T19:55:13.050 INFO:teuthology.orchestra.run.smithi101.stdout: { 2023-08-01T19:55:13.051 INFO:teuthology.orchestra.run.smithi101.stdout: "event": "started", 2023-08-01T19:55:13.051 INFO:teuthology.orchestra.run.smithi101.stdout: "time": "2023-08-01T19:54:04.473480+0000", 2023-08-01T19:55:13.051 INFO:teuthology.orchestra.run.smithi101.stdout: "duration": 0.00013276799999999999 2023-08-01T19:55:13.051 INFO:teuthology.orchestra.run.smithi101.stdout: }, 2023-08-01T19:55:13.051 INFO:teuthology.orchestra.run.smithi101.stdout: { 2023-08-01T19:55:13.051 INFO:teuthology.orchestra.run.smithi101.stdout: "event": "waiting for subops from 2", 2023-08-01T19:55:13.051 INFO:teuthology.orchestra.run.smithi101.stdout: "time": "2023-08-01T19:54:04.473622+0000", 2023-08-01T19:55:13.051 INFO:teuthology.orchestra.run.smithi101.stdout: "duration": 0.00014154799999999999 2023-08-01T19:55:13.052 INFO:teuthology.orchestra.run.smithi101.stdout: }, 2023-08-01T19:55:13.052 INFO:teuthology.orchestra.run.smithi101.stdout: { 2023-08-01T19:55:13.052 INFO:teuthology.orchestra.run.smithi101.stdout: "event": "op_commit", 2023-08-01T19:55:13.052 INFO:teuthology.orchestra.run.smithi101.stdout: "time": "2023-08-01T19:54:04.478281+0000", 2023-08-01T19:55:13.052 INFO:teuthology.orchestra.run.smithi101.stdout: "duration": 0.004659252 2023-08-01T19:55:13.052 INFO:teuthology.orchestra.run.smithi101.stdout: }, 2023-08-01T19:55:13.052 INFO:teuthology.orchestra.run.smithi101.stdout: { 2023-08-01T19:55:13.052 INFO:teuthology.orchestra.run.smithi101.stdout: "event": "sub_op_commit_rec", 2023-08-01T19:55:13.053 INFO:teuthology.orchestra.run.smithi101.stdout: "time": "2023-08-01T19:54:04.480180+0000", 2023-08-01T19:55:13.053 INFO:teuthology.orchestra.run.smithi101.stdout: "duration": 0.0018986859999999999 2023-08-01T19:55:13.053 INFO:teuthology.orchestra.run.smithi101.stdout: }, 2023-08-01T19:55:13.053 INFO:teuthology.orchestra.run.smithi101.stdout: { 2023-08-01T19:55:13.053 INFO:teuthology.orchestra.run.smithi101.stdout: "event": "commit_sent", 2023-08-01T19:55:13.053 INFO:teuthology.orchestra.run.smithi101.stdout: "time": "2023-08-01T19:54:04.480209+0000", 2023-08-01T19:55:13.053 INFO:teuthology.orchestra.run.smithi101.stdout: "duration": 2.9244999999999999e-05 2023-08-01T19:55:13.053 INFO:teuthology.orchestra.run.smithi101.stdout: }, 2023-08-01T19:55:13.054 INFO:teuthology.orchestra.run.smithi101.stdout: { 2023-08-01T19:55:13.054 INFO:teuthology.orchestra.run.smithi101.stdout: "event": "done", 2023-08-01T19:55:13.054 INFO:teuthology.orchestra.run.smithi101.stdout: "time": "2023-08-01T19:54:04.480244+0000", 2023-08-01T19:55:13.054 INFO:teuthology.orchestra.run.smithi101.stdout: "duration": 3.4875000000000001e-05 2023-08-01T19:55:13.054 INFO:teuthology.orchestra.run.smithi101.stdout: } 2023-08-01T19:55:13.054 INFO:teuthology.orchestra.run.smithi101.stdout: ] 2023-08-01T19:55:13.054 INFO:teuthology.orchestra.run.smithi101.stdout: } 2023-08-01T19:55:13.054 INFO:teuthology.orchestra.run.smithi101.stdout: }, 2023-08-01T19:55:13.055 INFO:teuthology.orchestra.run.smithi101.stdout: { 2023-08-01T19:55:13.055 INFO:teuthology.orchestra.run.smithi101.stdout: "description": "osd_op(mds.0.3:3 3.14 3:287034c4:::1.00000000.inode:head [writefull 0~554] snapc 0=[] ondisk+write+known_if_redirected+full_force+supports_pool_eio e17)", 2023-08-01T19:55:13.055 INFO:teuthology.orchestra.run.smithi101.stdout: "initiated_at": "2023-08-01T19:54:04.459226+0000", 2023-08-01T19:55:13.055 INFO:teuthology.orchestra.run.smithi101.stdout: "age": 68.544191264000006, 2023-08-01T19:55:13.055 INFO:teuthology.orchestra.run.smithi101.stdout: "duration": 0.021104531999999999, 2023-08-01T19:55:13.055 INFO:teuthology.orchestra.run.smithi101.stdout: "type_data": { 2023-08-01T19:55:13.055 INFO:teuthology.orchestra.run.smithi101.stdout: "flag_point": "commit sent; apply or cleanup", 2023-08-01T19:55:13.055 INFO:teuthology.orchestra.run.smithi101.stdout: "events": [ 2023-08-01T19:55:13.056 INFO:teuthology.orchestra.run.smithi101.stdout: { 2023-08-01T19:55:13.056 INFO:teuthology.orchestra.run.smithi101.stdout: "event": "initiated", 2023-08-01T19:55:13.056 INFO:teuthology.orchestra.run.smithi101.stdout: "time": "2023-08-01T19:54:04.459226+0000", 2023-08-01T19:55:13.056 INFO:teuthology.orchestra.run.smithi101.stdout: "duration": 0 2023-08-01T19:55:13.056 INFO:teuthology.orchestra.run.smithi101.stdout: }, 2023-08-01T19:55:13.056 INFO:teuthology.orchestra.run.smithi101.stdout: { 2023-08-01T19:55:13.056 INFO:teuthology.orchestra.run.smithi101.stdout: "event": "throttled", 2023-08-01T19:55:13.057 INFO:teuthology.orchestra.run.smithi101.stdout: "time": "2023-08-01T19:54:04.459226+0000", 2023-08-01T19:55:13.057 INFO:teuthology.orchestra.run.smithi101.stdout: "duration": 0 2023-08-01T19:55:13.057 INFO:teuthology.orchestra.run.smithi101.stdout: }, 2023-08-01T19:55:13.057 INFO:teuthology.orchestra.run.smithi101.stdout: { 2023-08-01T19:55:13.057 INFO:teuthology.orchestra.run.smithi101.stdout: "event": "header_read", 2023-08-01T19:55:13.057 INFO:teuthology.orchestra.run.smithi101.stdout: "time": "2023-08-01T19:54:04.459225+0000", 2023-08-01T19:55:13.057 INFO:teuthology.orchestra.run.smithi101.stdout: "duration": 4294967295.9999995 2023-08-01T19:55:13.058 INFO:teuthology.orchestra.run.smithi101.stdout: }, 2023-08-01T19:55:13.058 INFO:teuthology.orchestra.run.smithi101.stdout: { 2023-08-01T19:55:13.058 INFO:teuthology.orchestra.run.smithi101.stdout: "event": "all_read", 2023-08-01T19:55:13.058 INFO:teuthology.orchestra.run.smithi101.stdout: "time": "2023-08-01T19:54:04.459238+0000", 2023-08-01T19:55:13.058 INFO:teuthology.orchestra.run.smithi101.stdout: "duration": 1.2809000000000001e-05 2023-08-01T19:55:13.058 INFO:teuthology.orchestra.run.smithi101.stdout: }, 2023-08-01T19:55:13.058 INFO:teuthology.orchestra.run.smithi101.stdout: { 2023-08-01T19:55:13.058 INFO:teuthology.orchestra.run.smithi101.stdout: "event": "dispatched", 2023-08-01T19:55:13.059 INFO:teuthology.orchestra.run.smithi101.stdout: "time": "2023-08-01T19:54:04.459245+0000", 2023-08-01T19:55:13.059 INFO:teuthology.orchestra.run.smithi101.stdout: "duration": 6.6540000000000002e-06 2023-08-01T19:55:13.059 INFO:teuthology.orchestra.run.smithi101.stdout: }, 2023-08-01T19:55:13.059 INFO:teuthology.orchestra.run.smithi101.stdout: { 2023-08-01T19:55:13.059 INFO:teuthology.orchestra.run.smithi101.stdout: "event": "queued_for_pg", 2023-08-01T19:55:13.059 INFO:teuthology.orchestra.run.smithi101.stdout: "time": "2023-08-01T19:54:04.459249+0000", 2023-08-01T19:55:13.059 INFO:teuthology.orchestra.run.smithi101.stdout: "duration": 4.6e-06 2023-08-01T19:55:13.059 INFO:teuthology.orchestra.run.smithi101.stdout: }, 2023-08-01T19:55:13.060 INFO:teuthology.orchestra.run.smithi101.stdout: { 2023-08-01T19:55:13.060 INFO:teuthology.orchestra.run.smithi101.stdout: "event": "reached_pg", 2023-08-01T19:55:13.060 INFO:teuthology.orchestra.run.smithi101.stdout: "time": "2023-08-01T19:54:04.459276+0000", 2023-08-01T19:55:13.060 INFO:teuthology.orchestra.run.smithi101.stdout: "duration": 2.6373999999999999e-05 2023-08-01T19:55:13.060 INFO:teuthology.orchestra.run.smithi101.stdout: }, 2023-08-01T19:55:13.060 INFO:teuthology.orchestra.run.smithi101.stdout: { 2023-08-01T19:55:13.060 INFO:teuthology.orchestra.run.smithi101.stdout: "event": "waiting_for_map not empty", 2023-08-01T19:55:13.061 INFO:teuthology.orchestra.run.smithi101.stdout: "time": "2023-08-01T19:54:04.459278+0000", 2023-08-01T19:55:13.061 INFO:teuthology.orchestra.run.smithi101.stdout: "duration": 2.4980000000000001e-06 2023-08-01T19:55:13.061 INFO:teuthology.orchestra.run.smithi101.stdout: }, 2023-08-01T19:55:13.061 INFO:teuthology.orchestra.run.smithi101.stdout: { 2023-08-01T19:55:13.061 INFO:teuthology.orchestra.run.smithi101.stdout: "event": "reached_pg", 2023-08-01T19:55:13.061 INFO:teuthology.orchestra.run.smithi101.stdout: "time": "2023-08-01T19:54:04.474058+0000", 2023-08-01T19:55:13.061 INFO:teuthology.orchestra.run.smithi101.stdout: "duration": 0.014779979 2023-08-01T19:55:13.061 INFO:teuthology.orchestra.run.smithi101.stdout: }, 2023-08-01T19:55:13.062 INFO:teuthology.orchestra.run.smithi101.stdout: { 2023-08-01T19:55:13.062 INFO:teuthology.orchestra.run.smithi101.stdout: "event": "started", 2023-08-01T19:55:13.062 INFO:teuthology.orchestra.run.smithi101.stdout: "time": "2023-08-01T19:54:04.474614+0000", 2023-08-01T19:55:13.062 INFO:teuthology.orchestra.run.smithi101.stdout: "duration": 0.00055546899999999995 2023-08-01T19:55:13.062 INFO:teuthology.orchestra.run.smithi101.stdout: }, 2023-08-01T19:55:13.062 INFO:teuthology.orchestra.run.smithi101.stdout: { 2023-08-01T19:55:13.062 INFO:teuthology.orchestra.run.smithi101.stdout: "event": "waiting for subops from 2", 2023-08-01T19:55:13.062 INFO:teuthology.orchestra.run.smithi101.stdout: "time": "2023-08-01T19:54:04.474720+0000", 2023-08-01T19:55:13.063 INFO:teuthology.orchestra.run.smithi101.stdout: "duration": 0.00010645300000000001 2023-08-01T19:55:13.063 INFO:teuthology.orchestra.run.smithi101.stdout: }, 2023-08-01T19:55:13.063 INFO:teuthology.orchestra.run.smithi101.stdout: { 2023-08-01T19:55:13.063 INFO:teuthology.orchestra.run.smithi101.stdout: "event": "op_commit", 2023-08-01T19:55:13.063 INFO:teuthology.orchestra.run.smithi101.stdout: "time": "2023-08-01T19:54:04.478480+0000", 2023-08-01T19:55:13.063 INFO:teuthology.orchestra.run.smithi101.stdout: "duration": 0.0037600279999999999 2023-08-01T19:55:13.063 INFO:teuthology.orchestra.run.smithi101.stdout: }, 2023-08-01T19:55:13.064 INFO:teuthology.orchestra.run.smithi101.stdout: { 2023-08-01T19:55:13.064 INFO:teuthology.orchestra.run.smithi101.stdout: "event": "sub_op_commit_rec", 2023-08-01T19:55:13.064 INFO:teuthology.orchestra.run.smithi101.stdout: "time": "2023-08-01T19:54:04.480273+0000", 2023-08-01T19:55:13.064 INFO:teuthology.orchestra.run.smithi101.stdout: "duration": 0.001792465 2023-08-01T19:55:13.064 INFO:teuthology.orchestra.run.smithi101.stdout: }, 2023-08-01T19:55:13.064 INFO:teuthology.orchestra.run.smithi101.stdout: { 2023-08-01T19:55:13.064 INFO:teuthology.orchestra.run.smithi101.stdout: "event": "commit_sent", 2023-08-01T19:55:13.064 INFO:teuthology.orchestra.run.smithi101.stdout: "time": "2023-08-01T19:54:04.480304+0000", 2023-08-01T19:55:13.065 INFO:teuthology.orchestra.run.smithi101.stdout: "duration": 3.1708999999999997e-05 2023-08-01T19:55:13.065 INFO:teuthology.orchestra.run.smithi101.stdout: }, 2023-08-01T19:55:13.065 INFO:teuthology.orchestra.run.smithi101.stdout: { 2023-08-01T19:55:13.065 INFO:teuthology.orchestra.run.smithi101.stdout: "event": "done", 2023-08-01T19:55:13.065 INFO:teuthology.orchestra.run.smithi101.stdout: "time": "2023-08-01T19:54:04.480330+0000", 2023-08-01T19:55:13.065 INFO:teuthology.orchestra.run.smithi101.stdout: "duration": 2.5860999999999999e-05 2023-08-01T19:55:13.065 INFO:teuthology.orchestra.run.smithi101.stdout: } 2023-08-01T19:55:13.065 INFO:teuthology.orchestra.run.smithi101.stdout: ] 2023-08-01T19:55:13.066 INFO:teuthology.orchestra.run.smithi101.stdout: } 2023-08-01T19:55:13.066 INFO:teuthology.orchestra.run.smithi101.stdout: }, 2023-08-01T19:55:13.066 INFO:teuthology.orchestra.run.smithi101.stdout: { 2023-08-01T19:55:13.066 INFO:teuthology.orchestra.run.smithi101.stdout: "description": "osd_op(mds.0.3:32 3.14 3:2e2fa760:::200.00000001:head [delete] snapc 0=[] ondisk+write+known_if_redirected+full_force+supports_pool_eio e17)", 2023-08-01T19:55:13.066 INFO:teuthology.orchestra.run.smithi101.stdout: "initiated_at": "2023-08-01T19:54:04.459304+0000", 2023-08-01T19:55:13.066 INFO:teuthology.orchestra.run.smithi101.stdout: "age": 68.544112603000002, 2023-08-01T19:55:13.066 INFO:teuthology.orchestra.run.smithi101.stdout: "duration": 0.021110606000000001, 2023-08-01T19:55:13.066 INFO:teuthology.orchestra.run.smithi101.stdout: "type_data": { 2023-08-01T19:55:13.067 INFO:teuthology.orchestra.run.smithi101.stdout: "flag_point": "started", 2023-08-01T19:55:13.067 INFO:teuthology.orchestra.run.smithi101.stdout: "events": [ 2023-08-01T19:55:13.067 INFO:teuthology.orchestra.run.smithi101.stdout: { 2023-08-01T19:55:13.067 INFO:teuthology.orchestra.run.smithi101.stdout: "event": "initiated", 2023-08-01T19:55:13.067 INFO:teuthology.orchestra.run.smithi101.stdout: "time": "2023-08-01T19:54:04.459304+0000", 2023-08-01T19:55:13.067 INFO:teuthology.orchestra.run.smithi101.stdout: "duration": 0 2023-08-01T19:55:13.067 INFO:teuthology.orchestra.run.smithi101.stdout: }, 2023-08-01T19:55:13.067 INFO:teuthology.orchestra.run.smithi101.stdout: { 2023-08-01T19:55:13.068 INFO:teuthology.orchestra.run.smithi101.stdout: "event": "throttled", 2023-08-01T19:55:13.068 INFO:teuthology.orchestra.run.smithi101.stdout: "time": "2023-08-01T19:54:04.459304+0000", 2023-08-01T19:55:13.068 INFO:teuthology.orchestra.run.smithi101.stdout: "duration": 0 2023-08-01T19:55:13.068 INFO:teuthology.orchestra.run.smithi101.stdout: }, 2023-08-01T19:55:13.068 INFO:teuthology.orchestra.run.smithi101.stdout: { 2023-08-01T19:55:13.068 INFO:teuthology.orchestra.run.smithi101.stdout: "event": "header_read", 2023-08-01T19:55:13.068 INFO:teuthology.orchestra.run.smithi101.stdout: "time": "2023-08-01T19:54:04.459304+0000", 2023-08-01T19:55:13.069 INFO:teuthology.orchestra.run.smithi101.stdout: "duration": 4294967295.9999995 2023-08-01T19:55:13.069 INFO:teuthology.orchestra.run.smithi101.stdout: }, 2023-08-01T19:55:13.069 INFO:teuthology.orchestra.run.smithi101.stdout: { 2023-08-01T19:55:13.069 INFO:teuthology.orchestra.run.smithi101.stdout: "event": "all_read", 2023-08-01T19:55:13.069 INFO:teuthology.orchestra.run.smithi101.stdout: "time": "2023-08-01T19:54:04.459306+0000", 2023-08-01T19:55:13.069 INFO:teuthology.orchestra.run.smithi101.stdout: "duration": 2.3889999999999999e-06 2023-08-01T19:55:13.069 INFO:teuthology.orchestra.run.smithi101.stdout: }, 2023-08-01T19:55:13.070 INFO:teuthology.orchestra.run.smithi101.stdout: { 2023-08-01T19:55:13.070 INFO:teuthology.orchestra.run.smithi101.stdout: "event": "dispatched", 2023-08-01T19:55:13.070 INFO:teuthology.orchestra.run.smithi101.stdout: "time": "2023-08-01T19:54:04.459314+0000", 2023-08-01T19:55:13.070 INFO:teuthology.orchestra.run.smithi101.stdout: "duration": 7.1180000000000003e-06 2023-08-01T19:55:13.070 INFO:teuthology.orchestra.run.smithi101.stdout: }, 2023-08-01T19:55:13.070 INFO:teuthology.orchestra.run.smithi101.stdout: { 2023-08-01T19:55:13.070 INFO:teuthology.orchestra.run.smithi101.stdout: "event": "queued_for_pg", 2023-08-01T19:55:13.070 INFO:teuthology.orchestra.run.smithi101.stdout: "time": "2023-08-01T19:54:04.459318+0000", 2023-08-01T19:55:13.071 INFO:teuthology.orchestra.run.smithi101.stdout: "duration": 4.0239999999999999e-06 2023-08-01T19:55:13.071 INFO:teuthology.orchestra.run.smithi101.stdout: }, 2023-08-01T19:55:13.071 INFO:teuthology.orchestra.run.smithi101.stdout: { 2023-08-01T19:55:13.071 INFO:teuthology.orchestra.run.smithi101.stdout: "event": "reached_pg", 2023-08-01T19:55:13.071 INFO:teuthology.orchestra.run.smithi101.stdout: "time": "2023-08-01T19:54:04.459340+0000", 2023-08-01T19:55:13.071 INFO:teuthology.orchestra.run.smithi101.stdout: "duration": 2.2476e-05 2023-08-01T19:55:13.071 INFO:teuthology.orchestra.run.smithi101.stdout: }, 2023-08-01T19:55:13.072 INFO:teuthology.orchestra.run.smithi101.stdout: { 2023-08-01T19:55:13.072 INFO:teuthology.orchestra.run.smithi101.stdout: "event": "waiting_for_map not empty", 2023-08-01T19:55:13.072 INFO:teuthology.orchestra.run.smithi101.stdout: "time": "2023-08-01T19:54:04.459342+0000", 2023-08-01T19:55:13.072 INFO:teuthology.orchestra.run.smithi101.stdout: "duration": 2.272e-06 2023-08-01T19:55:13.072 INFO:teuthology.orchestra.run.smithi101.stdout: }, 2023-08-01T19:55:13.072 INFO:teuthology.orchestra.run.smithi101.stdout: { 2023-08-01T19:55:13.072 INFO:teuthology.orchestra.run.smithi101.stdout: "event": "reached_pg", 2023-08-01T19:55:13.072 INFO:teuthology.orchestra.run.smithi101.stdout: "time": "2023-08-01T19:54:04.475922+0000", 2023-08-01T19:55:13.073 INFO:teuthology.orchestra.run.smithi101.stdout: "duration": 0.016579388 2023-08-01T19:55:13.073 INFO:teuthology.orchestra.run.smithi101.stdout: }, 2023-08-01T19:55:13.073 INFO:teuthology.orchestra.run.smithi101.stdout: { 2023-08-01T19:55:13.073 INFO:teuthology.orchestra.run.smithi101.stdout: "event": "started", 2023-08-01T19:55:13.073 INFO:teuthology.orchestra.run.smithi101.stdout: "time": "2023-08-01T19:54:04.476107+0000", 2023-08-01T19:55:13.073 INFO:teuthology.orchestra.run.smithi101.stdout: "duration": 0.00018486300000000001 2023-08-01T19:55:13.073 INFO:teuthology.orchestra.run.smithi101.stdout: }, 2023-08-01T19:55:13.073 INFO:teuthology.orchestra.run.smithi101.stdout: { 2023-08-01T19:55:13.074 INFO:teuthology.orchestra.run.smithi101.stdout: "event": "done", 2023-08-01T19:55:13.074 INFO:teuthology.orchestra.run.smithi101.stdout: "time": "2023-08-01T19:54:04.480415+0000", 2023-08-01T19:55:13.074 INFO:teuthology.orchestra.run.smithi101.stdout: "duration": 0.0043084589999999997 2023-08-01T19:55:13.074 INFO:teuthology.orchestra.run.smithi101.stdout: } 2023-08-01T19:55:13.074 INFO:teuthology.orchestra.run.smithi101.stdout: ] 2023-08-01T19:55:13.074 INFO:teuthology.orchestra.run.smithi101.stdout: } 2023-08-01T19:55:13.074 INFO:teuthology.orchestra.run.smithi101.stdout: }, 2023-08-01T19:55:13.074 INFO:teuthology.orchestra.run.smithi101.stdout: { 2023-08-01T19:55:13.075 INFO:teuthology.orchestra.run.smithi101.stdout: "description": "osd_op(client.4668.0:70878 5.2 5:49b7d2be:::benchmark_data_smithi006_114134_object70877:head [set-alloc-hint object_size 65536 write_size 65536,write 0~65536] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e30)", 2023-08-01T19:55:13.075 INFO:teuthology.orchestra.run.smithi101.stdout: "initiated_at": "2023-08-01T19:54:50.210223+0000", 2023-08-01T19:55:13.075 INFO:teuthology.orchestra.run.smithi101.stdout: "age": 22.793194032999999, 2023-08-01T19:55:13.075 INFO:teuthology.orchestra.run.smithi101.stdout: "duration": 0.019884895, 2023-08-01T19:55:13.075 INFO:teuthology.orchestra.run.smithi101.stdout: "type_data": { 2023-08-01T19:55:13.075 INFO:teuthology.orchestra.run.smithi101.stdout: "flag_point": "commit sent; apply or cleanup", 2023-08-01T19:55:13.075 INFO:teuthology.orchestra.run.smithi101.stdout: "client_info": { 2023-08-01T19:55:13.076 INFO:teuthology.orchestra.run.smithi101.stdout: "client": "client.4668", 2023-08-01T19:55:13.076 INFO:teuthology.orchestra.run.smithi101.stdout: "client_addr": "172.21.15.6:0/1709472247", 2023-08-01T19:55:13.076 INFO:teuthology.orchestra.run.smithi101.stdout: "tid": 70878 2023-08-01T19:55:13.076 INFO:teuthology.orchestra.run.smithi101.stdout: }, 2023-08-01T19:55:13.076 INFO:teuthology.orchestra.run.smithi101.stdout: "events": [ 2023-08-01T19:55:13.076 INFO:teuthology.orchestra.run.smithi101.stdout: { 2023-08-01T19:55:13.076 INFO:teuthology.orchestra.run.smithi101.stdout: "event": "initiated", 2023-08-01T19:55:13.076 INFO:teuthology.orchestra.run.smithi101.stdout: "time": "2023-08-01T19:54:50.210223+0000", 2023-08-01T19:55:13.077 INFO:teuthology.orchestra.run.smithi101.stdout: "duration": 0 2023-08-01T19:55:13.077 INFO:teuthology.orchestra.run.smithi101.stdout: }, 2023-08-01T19:55:13.077 INFO:teuthology.orchestra.run.smithi101.stdout: { 2023-08-01T19:55:13.077 INFO:teuthology.orchestra.run.smithi101.stdout: "event": "throttled", 2023-08-01T19:55:13.077 INFO:teuthology.orchestra.run.smithi101.stdout: "time": "2023-08-01T19:54:50.210223+0000", 2023-08-01T19:55:13.077 INFO:teuthology.orchestra.run.smithi101.stdout: "duration": 0 2023-08-01T19:55:13.077 INFO:teuthology.orchestra.run.smithi101.stdout: }, 2023-08-01T19:55:13.077 INFO:teuthology.orchestra.run.smithi101.stdout: { 2023-08-01T19:55:13.078 INFO:teuthology.orchestra.run.smithi101.stdout: "event": "header_read", 2023-08-01T19:55:13.078 INFO:teuthology.orchestra.run.smithi101.stdout: "time": "2023-08-01T19:54:50.210222+0000", 2023-08-01T19:55:13.078 INFO:teuthology.orchestra.run.smithi101.stdout: "duration": 4294967295.999999 2023-08-01T19:55:13.078 INFO:teuthology.orchestra.run.smithi101.stdout: }, 2023-08-01T19:55:13.078 INFO:teuthology.orchestra.run.smithi101.stdout: { 2023-08-01T19:55:13.078 INFO:teuthology.orchestra.run.smithi101.stdout: "event": "all_read", 2023-08-01T19:55:13.078 INFO:teuthology.orchestra.run.smithi101.stdout: "time": "2023-08-01T19:54:50.210315+0000", 2023-08-01T19:55:13.078 INFO:teuthology.orchestra.run.smithi101.stdout: "duration": 9.2567999999999999e-05 2023-08-01T19:55:13.079 INFO:teuthology.orchestra.run.smithi101.stdout: }, 2023-08-01T19:55:13.079 INFO:teuthology.orchestra.run.smithi101.stdout: { 2023-08-01T19:55:13.079 INFO:teuthology.orchestra.run.smithi101.stdout: "event": "dispatched", 2023-08-01T19:55:13.079 INFO:teuthology.orchestra.run.smithi101.stdout: "time": "2023-08-01T19:54:50.210326+0000", 2023-08-01T19:55:13.079 INFO:teuthology.orchestra.run.smithi101.stdout: "duration": 1.1430000000000001e-05 2023-08-01T19:55:13.079 INFO:teuthology.orchestra.run.smithi101.stdout: }, 2023-08-01T19:55:13.079 INFO:teuthology.orchestra.run.smithi101.stdout: { 2023-08-01T19:55:13.079 INFO:teuthology.orchestra.run.smithi101.stdout: "event": "queued_for_pg", 2023-08-01T19:55:13.080 INFO:teuthology.orchestra.run.smithi101.stdout: "time": "2023-08-01T19:54:50.210332+0000", 2023-08-01T19:55:13.080 INFO:teuthology.orchestra.run.smithi101.stdout: "duration": 5.8479999999999997e-06 2023-08-01T19:55:13.080 INFO:teuthology.orchestra.run.smithi101.stdout: }, 2023-08-01T19:55:13.080 INFO:teuthology.orchestra.run.smithi101.stdout: { 2023-08-01T19:55:13.080 INFO:teuthology.orchestra.run.smithi101.stdout: "event": "reached_pg", 2023-08-01T19:55:13.080 INFO:teuthology.orchestra.run.smithi101.stdout: "time": "2023-08-01T19:54:50.214259+0000", 2023-08-01T19:55:13.080 INFO:teuthology.orchestra.run.smithi101.stdout: "duration": 0.003926789 2023-08-01T19:55:13.081 INFO:teuthology.orchestra.run.smithi101.stdout: }, 2023-08-01T19:55:13.081 INFO:teuthology.orchestra.run.smithi101.stdout: { 2023-08-01T19:55:13.081 INFO:teuthology.orchestra.run.smithi101.stdout: "event": "started", 2023-08-01T19:55:13.081 INFO:teuthology.orchestra.run.smithi101.stdout: "time": "2023-08-01T19:54:50.214387+0000", 2023-08-01T19:55:13.081 INFO:teuthology.orchestra.run.smithi101.stdout: "duration": 0.00012787599999999999 2023-08-01T19:55:13.081 INFO:teuthology.orchestra.run.smithi101.stdout: }, 2023-08-01T19:55:13.081 INFO:teuthology.orchestra.run.smithi101.stdout: { 2023-08-01T19:55:13.081 INFO:teuthology.orchestra.run.smithi101.stdout: "event": "waiting for subops from 0", 2023-08-01T19:55:13.082 INFO:teuthology.orchestra.run.smithi101.stdout: "time": "2023-08-01T19:54:50.214536+0000", 2023-08-01T19:55:13.082 INFO:teuthology.orchestra.run.smithi101.stdout: "duration": 0.00014935299999999999 2023-08-01T19:55:13.082 INFO:teuthology.orchestra.run.smithi101.stdout: }, 2023-08-01T19:55:13.082 INFO:teuthology.orchestra.run.smithi101.stdout: { 2023-08-01T19:55:13.082 INFO:teuthology.orchestra.run.smithi101.stdout: "event": "op_commit", 2023-08-01T19:55:13.082 INFO:teuthology.orchestra.run.smithi101.stdout: "time": "2023-08-01T19:54:50.217739+0000", 2023-08-01T19:55:13.082 INFO:teuthology.orchestra.run.smithi101.stdout: "duration": 0.0032034619999999998 2023-08-01T19:55:13.082 INFO:teuthology.orchestra.run.smithi101.stdout: }, 2023-08-01T19:55:13.083 INFO:teuthology.orchestra.run.smithi101.stdout: { 2023-08-01T19:55:13.083 INFO:teuthology.orchestra.run.smithi101.stdout: "event": "sub_op_commit_rec", 2023-08-01T19:55:13.083 INFO:teuthology.orchestra.run.smithi101.stdout: "time": "2023-08-01T19:54:50.230032+0000", 2023-08-01T19:55:13.083 INFO:teuthology.orchestra.run.smithi101.stdout: "duration": 0.012293068000000001 2023-08-01T19:55:13.083 INFO:teuthology.orchestra.run.smithi101.stdout: }, 2023-08-01T19:55:13.083 INFO:teuthology.orchestra.run.smithi101.stdout: { 2023-08-01T19:55:13.083 INFO:teuthology.orchestra.run.smithi101.stdout: "event": "commit_sent", 2023-08-01T19:55:13.084 INFO:teuthology.orchestra.run.smithi101.stdout: "time": "2023-08-01T19:54:50.230075+0000", 2023-08-01T19:55:13.084 INFO:teuthology.orchestra.run.smithi101.stdout: "duration": 4.3062999999999997e-05 2023-08-01T19:55:13.084 INFO:teuthology.orchestra.run.smithi101.stdout: }, 2023-08-01T19:55:13.084 INFO:teuthology.orchestra.run.smithi101.stdout: { 2023-08-01T19:55:13.084 INFO:teuthology.orchestra.run.smithi101.stdout: "event": "done", 2023-08-01T19:55:13.084 INFO:teuthology.orchestra.run.smithi101.stdout: "time": "2023-08-01T19:54:50.230108+0000", 2023-08-01T19:55:13.084 INFO:teuthology.orchestra.run.smithi101.stdout: "duration": 3.2366999999999997e-05 2023-08-01T19:55:13.084 INFO:teuthology.orchestra.run.smithi101.stdout: } 2023-08-01T19:55:13.085 INFO:teuthology.orchestra.run.smithi101.stdout: ] 2023-08-01T19:55:13.085 INFO:teuthology.orchestra.run.smithi101.stdout: } 2023-08-01T19:55:13.085 INFO:teuthology.orchestra.run.smithi101.stdout: }, 2023-08-01T19:55:13.085 INFO:teuthology.orchestra.run.smithi101.stdout: { 2023-08-01T19:55:13.085 INFO:teuthology.orchestra.run.smithi101.stdout: "description": "osd_op(client.4668.0:73460 5.f 5:ff4f0704:::benchmark_data_smithi006_114134_object73459:head [set-alloc-hint object_size 65536 write_size 65536,write 0~65536] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e31)", 2023-08-01T19:55:13.085 INFO:teuthology.orchestra.run.smithi101.stdout: "initiated_at": "2023-08-01T19:54:51.462968+0000", 2023-08-01T19:55:13.085 INFO:teuthology.orchestra.run.smithi101.stdout: "age": 21.540449154000001, 2023-08-01T19:55:13.085 INFO:teuthology.orchestra.run.smithi101.stdout: "duration": 0.020056502, 2023-08-01T19:55:13.086 INFO:teuthology.orchestra.run.smithi101.stdout: "type_data": { 2023-08-01T19:55:13.086 INFO:teuthology.orchestra.run.smithi101.stdout: "flag_point": "commit sent; apply or cleanup", 2023-08-01T19:55:13.086 INFO:teuthology.orchestra.run.smithi101.stdout: "client_info": { 2023-08-01T19:55:13.086 INFO:teuthology.orchestra.run.smithi101.stdout: "client": "client.4668", 2023-08-01T19:55:13.086 INFO:teuthology.orchestra.run.smithi101.stdout: "client_addr": "172.21.15.6:0/1709472247", 2023-08-01T19:55:13.086 INFO:teuthology.orchestra.run.smithi101.stdout: "tid": 73460 2023-08-01T19:55:13.086 INFO:teuthology.orchestra.run.smithi101.stdout: }, 2023-08-01T19:55:13.087 INFO:teuthology.orchestra.run.smithi101.stdout: "events": [ 2023-08-01T19:55:13.087 INFO:teuthology.orchestra.run.smithi101.stdout: { 2023-08-01T19:55:13.087 INFO:teuthology.orchestra.run.smithi101.stdout: "event": "initiated", 2023-08-01T19:55:13.087 INFO:teuthology.orchestra.run.smithi101.stdout: "time": "2023-08-01T19:54:51.462968+0000", 2023-08-01T19:55:13.087 INFO:teuthology.orchestra.run.smithi101.stdout: "duration": 0 2023-08-01T19:55:13.087 INFO:teuthology.orchestra.run.smithi101.stdout: }, 2023-08-01T19:55:13.087 INFO:teuthology.orchestra.run.smithi101.stdout: { 2023-08-01T19:55:13.087 INFO:teuthology.orchestra.run.smithi101.stdout: "event": "throttled", 2023-08-01T19:55:13.088 INFO:teuthology.orchestra.run.smithi101.stdout: "time": "2023-08-01T19:54:51.462968+0000", 2023-08-01T19:55:13.088 INFO:teuthology.orchestra.run.smithi101.stdout: "duration": 0 2023-08-01T19:55:13.088 INFO:teuthology.orchestra.run.smithi101.stdout: }, 2023-08-01T19:55:13.088 INFO:teuthology.orchestra.run.smithi101.stdout: { 2023-08-01T19:55:13.088 INFO:teuthology.orchestra.run.smithi101.stdout: "event": "header_read", 2023-08-01T19:55:13.088 INFO:teuthology.orchestra.run.smithi101.stdout: "time": "2023-08-01T19:54:51.462967+0000", 2023-08-01T19:55:13.088 INFO:teuthology.orchestra.run.smithi101.stdout: "duration": 4294967295.999999 2023-08-01T19:55:13.088 INFO:teuthology.orchestra.run.smithi101.stdout: }, 2023-08-01T19:55:13.089 INFO:teuthology.orchestra.run.smithi101.stdout: { 2023-08-01T19:55:13.089 INFO:teuthology.orchestra.run.smithi101.stdout: "event": "all_read", 2023-08-01T19:55:13.089 INFO:teuthology.orchestra.run.smithi101.stdout: "time": "2023-08-01T19:54:51.463009+0000", 2023-08-01T19:55:13.089 INFO:teuthology.orchestra.run.smithi101.stdout: "duration": 4.2106e-05 2023-08-01T19:55:13.089 INFO:teuthology.orchestra.run.smithi101.stdout: }, 2023-08-01T19:55:13.089 INFO:teuthology.orchestra.run.smithi101.stdout: { 2023-08-01T19:55:13.089 INFO:teuthology.orchestra.run.smithi101.stdout: "event": "dispatched", 2023-08-01T19:55:13.089 INFO:teuthology.orchestra.run.smithi101.stdout: "time": "2023-08-01T19:54:51.463017+0000", 2023-08-01T19:55:13.090 INFO:teuthology.orchestra.run.smithi101.stdout: "duration": 8.1529999999999997e-06 2023-08-01T19:55:13.090 INFO:teuthology.orchestra.run.smithi101.stdout: }, 2023-08-01T19:55:13.090 INFO:teuthology.orchestra.run.smithi101.stdout: { 2023-08-01T19:55:13.090 INFO:teuthology.orchestra.run.smithi101.stdout: "event": "queued_for_pg", 2023-08-01T19:55:13.090 INFO:teuthology.orchestra.run.smithi101.stdout: "time": "2023-08-01T19:54:51.463027+0000", 2023-08-01T19:55:13.090 INFO:teuthology.orchestra.run.smithi101.stdout: "duration": 9.5659999999999996e-06 2023-08-01T19:55:13.090 INFO:teuthology.orchestra.run.smithi101.stdout: }, 2023-08-01T19:55:13.090 INFO:teuthology.orchestra.run.smithi101.stdout: { 2023-08-01T19:55:13.091 INFO:teuthology.orchestra.run.smithi101.stdout: "event": "reached_pg", 2023-08-01T19:55:13.091 INFO:teuthology.orchestra.run.smithi101.stdout: "time": "2023-08-01T19:54:51.463062+0000", 2023-08-01T19:55:13.091 INFO:teuthology.orchestra.run.smithi101.stdout: "duration": 3.5442999999999999e-05 2023-08-01T19:55:13.091 INFO:teuthology.orchestra.run.smithi101.stdout: }, 2023-08-01T19:55:13.091 INFO:teuthology.orchestra.run.smithi101.stdout: { 2023-08-01T19:55:13.091 INFO:teuthology.orchestra.run.smithi101.stdout: "event": "started", 2023-08-01T19:55:13.091 INFO:teuthology.orchestra.run.smithi101.stdout: "time": "2023-08-01T19:54:51.463198+0000", 2023-08-01T19:55:13.091 INFO:teuthology.orchestra.run.smithi101.stdout: "duration": 0.000135628 2023-08-01T19:55:13.092 INFO:teuthology.orchestra.run.smithi101.stdout: }, 2023-08-01T19:55:13.092 INFO:teuthology.orchestra.run.smithi101.stdout: { 2023-08-01T19:55:13.092 INFO:teuthology.orchestra.run.smithi101.stdout: "event": "waiting for subops from 2", 2023-08-01T19:55:13.092 INFO:teuthology.orchestra.run.smithi101.stdout: "time": "2023-08-01T19:54:51.463341+0000", 2023-08-01T19:55:13.092 INFO:teuthology.orchestra.run.smithi101.stdout: "duration": 0.00014346500000000001 2023-08-01T19:55:13.092 INFO:teuthology.orchestra.run.smithi101.stdout: }, 2023-08-01T19:55:13.092 INFO:teuthology.orchestra.run.smithi101.stdout: { 2023-08-01T19:55:13.093 INFO:teuthology.orchestra.run.smithi101.stdout: "event": "op_commit", 2023-08-01T19:55:13.093 INFO:teuthology.orchestra.run.smithi101.stdout: "time": "2023-08-01T19:54:51.472684+0000", 2023-08-01T19:55:13.093 INFO:teuthology.orchestra.run.smithi101.stdout: "duration": 0.0093427900000000001 2023-08-01T19:55:13.093 INFO:teuthology.orchestra.run.smithi101.stdout: }, 2023-08-01T19:55:13.093 INFO:teuthology.orchestra.run.smithi101.stdout: { 2023-08-01T19:55:13.093 INFO:teuthology.orchestra.run.smithi101.stdout: "event": "sub_op_commit_rec", 2023-08-01T19:55:13.093 INFO:teuthology.orchestra.run.smithi101.stdout: "time": "2023-08-01T19:54:51.482937+0000", 2023-08-01T19:55:13.093 INFO:teuthology.orchestra.run.smithi101.stdout: "duration": 0.010252557000000001 2023-08-01T19:55:13.094 INFO:teuthology.orchestra.run.smithi101.stdout: }, 2023-08-01T19:55:13.094 INFO:teuthology.orchestra.run.smithi101.stdout: { 2023-08-01T19:55:13.094 INFO:teuthology.orchestra.run.smithi101.stdout: "event": "commit_sent", 2023-08-01T19:55:13.094 INFO:teuthology.orchestra.run.smithi101.stdout: "time": "2023-08-01T19:54:51.482984+0000", 2023-08-01T19:55:13.094 INFO:teuthology.orchestra.run.smithi101.stdout: "duration": 4.7394000000000001e-05 2023-08-01T19:55:13.094 INFO:teuthology.orchestra.run.smithi101.stdout: }, 2023-08-01T19:55:13.094 INFO:teuthology.orchestra.run.smithi101.stdout: { 2023-08-01T19:55:13.094 INFO:teuthology.orchestra.run.smithi101.stdout: "event": "done", 2023-08-01T19:55:13.095 INFO:teuthology.orchestra.run.smithi101.stdout: "time": "2023-08-01T19:54:51.483024+0000", 2023-08-01T19:55:13.095 INFO:teuthology.orchestra.run.smithi101.stdout: "duration": 4.0159e-05 2023-08-01T19:55:13.095 INFO:teuthology.orchestra.run.smithi101.stdout: } 2023-08-01T19:55:13.095 INFO:teuthology.orchestra.run.smithi101.stdout: ] 2023-08-01T19:55:13.095 INFO:teuthology.orchestra.run.smithi101.stdout: } 2023-08-01T19:55:13.095 INFO:teuthology.orchestra.run.smithi101.stdout: }, 2023-08-01T19:55:13.095 INFO:teuthology.orchestra.run.smithi101.stdout: { 2023-08-01T19:55:13.095 INFO:teuthology.orchestra.run.smithi101.stdout: "description": "osd_op(client.4668.0:92726 5.2 5:41e18163:::benchmark_data_smithi006_114134_object92725:head [set-alloc-hint object_size 65536 write_size 65536,write 0~65536] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e36)", 2023-08-01T19:55:13.096 INFO:teuthology.orchestra.run.smithi101.stdout: "initiated_at": "2023-08-01T19:55:01.256971+0000", 2023-08-01T19:55:13.096 INFO:teuthology.orchestra.run.smithi101.stdout: "age": 11.746446075, 2023-08-01T19:55:13.096 INFO:teuthology.orchestra.run.smithi101.stdout: "duration": 0.019854296, 2023-08-01T19:55:13.096 INFO:teuthology.orchestra.run.smithi101.stdout: "type_data": { 2023-08-01T19:55:13.096 INFO:teuthology.orchestra.run.smithi101.stdout: "flag_point": "commit sent; apply or cleanup", 2023-08-01T19:55:13.096 INFO:teuthology.orchestra.run.smithi101.stdout: "client_info": { 2023-08-01T19:55:13.096 INFO:teuthology.orchestra.run.smithi101.stdout: "client": "client.4668", 2023-08-01T19:55:13.096 INFO:teuthology.orchestra.run.smithi101.stdout: "client_addr": "172.21.15.6:0/1709472247", 2023-08-01T19:55:13.097 INFO:teuthology.orchestra.run.smithi101.stdout: "tid": 92726 2023-08-01T19:55:13.097 INFO:teuthology.orchestra.run.smithi101.stdout: }, 2023-08-01T19:55:13.097 INFO:teuthology.orchestra.run.smithi101.stdout: "events": [ 2023-08-01T19:55:13.097 INFO:teuthology.orchestra.run.smithi101.stdout: { 2023-08-01T19:55:13.097 INFO:teuthology.orchestra.run.smithi101.stdout: "event": "initiated", 2023-08-01T19:55:13.097 INFO:teuthology.orchestra.run.smithi101.stdout: "time": "2023-08-01T19:55:01.256971+0000", 2023-08-01T19:55:13.097 INFO:teuthology.orchestra.run.smithi101.stdout: "duration": 0 2023-08-01T19:55:13.097 INFO:teuthology.orchestra.run.smithi101.stdout: }, 2023-08-01T19:55:13.098 INFO:teuthology.orchestra.run.smithi101.stdout: { 2023-08-01T19:55:13.098 INFO:teuthology.orchestra.run.smithi101.stdout: "event": "throttled", 2023-08-01T19:55:13.098 INFO:teuthology.orchestra.run.smithi101.stdout: "time": "2023-08-01T19:55:01.256971+0000", 2023-08-01T19:55:13.098 INFO:teuthology.orchestra.run.smithi101.stdout: "duration": 0 2023-08-01T19:55:13.098 INFO:teuthology.orchestra.run.smithi101.stdout: }, 2023-08-01T19:55:13.098 INFO:teuthology.orchestra.run.smithi101.stdout: { 2023-08-01T19:55:13.098 INFO:teuthology.orchestra.run.smithi101.stdout: "event": "header_read", 2023-08-01T19:55:13.098 INFO:teuthology.orchestra.run.smithi101.stdout: "time": "2023-08-01T19:55:01.256970+0000", 2023-08-01T19:55:13.099 INFO:teuthology.orchestra.run.smithi101.stdout: "duration": 4294967295.9999995 2023-08-01T19:55:13.099 INFO:teuthology.orchestra.run.smithi101.stdout: }, 2023-08-01T19:55:13.099 INFO:teuthology.orchestra.run.smithi101.stdout: { 2023-08-01T19:55:13.099 INFO:teuthology.orchestra.run.smithi101.stdout: "event": "all_read", 2023-08-01T19:55:13.099 INFO:teuthology.orchestra.run.smithi101.stdout: "time": "2023-08-01T19:55:01.257057+0000", 2023-08-01T19:55:13.099 INFO:teuthology.orchestra.run.smithi101.stdout: "duration": 8.6627999999999998e-05 2023-08-01T19:55:13.099 INFO:teuthology.orchestra.run.smithi101.stdout: }, 2023-08-01T19:55:13.100 INFO:teuthology.orchestra.run.smithi101.stdout: { 2023-08-01T19:55:13.100 INFO:teuthology.orchestra.run.smithi101.stdout: "event": "dispatched", 2023-08-01T19:55:13.100 INFO:teuthology.orchestra.run.smithi101.stdout: "time": "2023-08-01T19:55:01.257063+0000", 2023-08-01T19:55:13.100 INFO:teuthology.orchestra.run.smithi101.stdout: "duration": 6.528e-06 2023-08-01T19:55:13.100 INFO:teuthology.orchestra.run.smithi101.stdout: }, 2023-08-01T19:55:13.100 INFO:teuthology.orchestra.run.smithi101.stdout: { 2023-08-01T19:55:13.100 INFO:teuthology.orchestra.run.smithi101.stdout: "event": "queued_for_pg", 2023-08-01T19:55:13.100 INFO:teuthology.orchestra.run.smithi101.stdout: "time": "2023-08-01T19:55:01.257067+0000", 2023-08-01T19:55:13.101 INFO:teuthology.orchestra.run.smithi101.stdout: "duration": 3.2739999999999999e-06 2023-08-01T19:55:13.101 INFO:teuthology.orchestra.run.smithi101.stdout: }, 2023-08-01T19:55:13.101 INFO:teuthology.orchestra.run.smithi101.stdout: { 2023-08-01T19:55:13.101 INFO:teuthology.orchestra.run.smithi101.stdout: "event": "reached_pg", 2023-08-01T19:55:13.101 INFO:teuthology.orchestra.run.smithi101.stdout: "time": "2023-08-01T19:55:01.259714+0000", 2023-08-01T19:55:13.101 INFO:teuthology.orchestra.run.smithi101.stdout: "duration": 0.0026476709999999999 2023-08-01T19:55:13.101 INFO:teuthology.orchestra.run.smithi101.stdout: }, 2023-08-01T19:55:13.101 INFO:teuthology.orchestra.run.smithi101.stdout: { 2023-08-01T19:55:13.102 INFO:teuthology.orchestra.run.smithi101.stdout: "event": "started", 2023-08-01T19:55:13.102 INFO:teuthology.orchestra.run.smithi101.stdout: "time": "2023-08-01T19:55:01.259829+0000", 2023-08-01T19:55:13.102 INFO:teuthology.orchestra.run.smithi101.stdout: "duration": 0.000114471 2023-08-01T19:55:13.102 INFO:teuthology.orchestra.run.smithi101.stdout: }, 2023-08-01T19:55:13.102 INFO:teuthology.orchestra.run.smithi101.stdout: { 2023-08-01T19:55:13.102 INFO:teuthology.orchestra.run.smithi101.stdout: "event": "waiting for subops from 0", 2023-08-01T19:55:13.102 INFO:teuthology.orchestra.run.smithi101.stdout: "time": "2023-08-01T19:55:01.259965+0000", 2023-08-01T19:55:13.102 INFO:teuthology.orchestra.run.smithi101.stdout: "duration": 0.00013597300000000001 2023-08-01T19:55:13.103 INFO:teuthology.orchestra.run.smithi101.stdout: }, 2023-08-01T19:55:13.103 INFO:teuthology.orchestra.run.smithi101.stdout: { 2023-08-01T19:55:13.103 INFO:teuthology.orchestra.run.smithi101.stdout: "event": "op_commit", 2023-08-01T19:55:13.103 INFO:teuthology.orchestra.run.smithi101.stdout: "time": "2023-08-01T19:55:01.264360+0000", 2023-08-01T19:55:13.104 INFO:teuthology.orchestra.run.smithi101.stdout: "duration": 0.0043956619999999998 2023-08-01T19:55:13.104 INFO:teuthology.orchestra.run.smithi101.stdout: }, 2023-08-01T19:55:13.104 INFO:teuthology.orchestra.run.smithi101.stdout: { 2023-08-01T19:55:13.104 INFO:teuthology.orchestra.run.smithi101.stdout: "event": "sub_op_commit_rec", 2023-08-01T19:55:13.104 INFO:teuthology.orchestra.run.smithi101.stdout: "time": "2023-08-01T19:55:01.276766+0000", 2023-08-01T19:55:13.104 INFO:teuthology.orchestra.run.smithi101.stdout: "duration": 0.012405736000000001 2023-08-01T19:55:13.105 INFO:teuthology.orchestra.run.smithi101.stdout: }, 2023-08-01T19:55:13.105 INFO:teuthology.orchestra.run.smithi101.stdout: { 2023-08-01T19:55:13.105 INFO:teuthology.orchestra.run.smithi101.stdout: "event": "commit_sent", 2023-08-01T19:55:13.105 INFO:teuthology.orchestra.run.smithi101.stdout: "time": "2023-08-01T19:55:01.276804+0000", 2023-08-01T19:55:13.105 INFO:teuthology.orchestra.run.smithi101.stdout: "duration": 3.7759999999999998e-05 2023-08-01T19:55:13.105 INFO:teuthology.orchestra.run.smithi101.stdout: }, 2023-08-01T19:55:13.105 INFO:teuthology.orchestra.run.smithi101.stdout: { 2023-08-01T19:55:13.105 INFO:teuthology.orchestra.run.smithi101.stdout: "event": "done", 2023-08-01T19:55:13.106 INFO:teuthology.orchestra.run.smithi101.stdout: "time": "2023-08-01T19:55:01.276825+0000", 2023-08-01T19:55:13.106 INFO:teuthology.orchestra.run.smithi101.stdout: "duration": 2.1299000000000001e-05 2023-08-01T19:55:13.106 INFO:teuthology.orchestra.run.smithi101.stdout: } 2023-08-01T19:55:13.106 INFO:teuthology.orchestra.run.smithi101.stdout: ] 2023-08-01T19:55:13.106 INFO:teuthology.orchestra.run.smithi101.stdout: } 2023-08-01T19:55:13.106 INFO:teuthology.orchestra.run.smithi101.stdout: }, 2023-08-01T19:55:13.106 INFO:teuthology.orchestra.run.smithi101.stdout: { 2023-08-01T19:55:13.106 INFO:teuthology.orchestra.run.smithi101.stdout: "description": "osd_op(client.4668.0:100244 5.9 5:92f56a12:::benchmark_data_smithi006_114134_object100243:head [set-alloc-hint object_size 65536 write_size 65536,write 0~65536] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e37)", 2023-08-01T19:55:13.107 INFO:teuthology.orchestra.run.smithi101.stdout: "initiated_at": "2023-08-01T19:55:05.150910+0000", 2023-08-01T19:55:13.107 INFO:teuthology.orchestra.run.smithi101.stdout: "age": 7.8525072590000002, 2023-08-01T19:55:13.107 INFO:teuthology.orchestra.run.smithi101.stdout: "duration": 0.072864287, 2023-08-01T19:55:13.107 INFO:teuthology.orchestra.run.smithi101.stdout: "type_data": { 2023-08-01T19:55:13.107 INFO:teuthology.orchestra.run.smithi101.stdout: "flag_point": "commit sent; apply or cleanup", 2023-08-01T19:55:13.107 INFO:teuthology.orchestra.run.smithi101.stdout: "client_info": { 2023-08-01T19:55:13.107 INFO:teuthology.orchestra.run.smithi101.stdout: "client": "client.4668", 2023-08-01T19:55:13.108 INFO:teuthology.orchestra.run.smithi101.stdout: "client_addr": "172.21.15.6:0/1709472247", 2023-08-01T19:55:13.108 INFO:teuthology.orchestra.run.smithi101.stdout: "tid": 100244 2023-08-01T19:55:13.108 INFO:teuthology.orchestra.run.smithi101.stdout: }, 2023-08-01T19:55:13.108 INFO:teuthology.orchestra.run.smithi101.stdout: "events": [ 2023-08-01T19:55:13.108 INFO:teuthology.orchestra.run.smithi101.stdout: { 2023-08-01T19:55:13.108 INFO:teuthology.orchestra.run.smithi101.stdout: "event": "initiated", 2023-08-01T19:55:13.108 INFO:teuthology.orchestra.run.smithi101.stdout: "time": "2023-08-01T19:55:05.150910+0000", 2023-08-01T19:55:13.109 INFO:teuthology.orchestra.run.smithi101.stdout: "duration": 0 2023-08-01T19:55:13.109 INFO:teuthology.orchestra.run.smithi101.stdout: }, 2023-08-01T19:55:13.109 INFO:teuthology.orchestra.run.smithi101.stdout: { 2023-08-01T19:55:13.109 INFO:teuthology.orchestra.run.smithi101.stdout: "event": "throttled", 2023-08-01T19:55:13.109 INFO:teuthology.orchestra.run.smithi101.stdout: "time": "2023-08-01T19:55:05.150910+0000", 2023-08-01T19:55:13.109 INFO:teuthology.orchestra.run.smithi101.stdout: "duration": 0 2023-08-01T19:55:13.109 INFO:teuthology.orchestra.run.smithi101.stdout: }, 2023-08-01T19:55:13.109 INFO:teuthology.orchestra.run.smithi101.stdout: { 2023-08-01T19:55:13.110 INFO:teuthology.orchestra.run.smithi101.stdout: "event": "header_read", 2023-08-01T19:55:13.110 INFO:teuthology.orchestra.run.smithi101.stdout: "time": "2023-08-01T19:55:05.150909+0000", 2023-08-01T19:55:13.110 INFO:teuthology.orchestra.run.smithi101.stdout: "duration": 4294967295.999999 2023-08-01T19:55:13.110 INFO:teuthology.orchestra.run.smithi101.stdout: }, 2023-08-01T19:55:13.110 INFO:teuthology.orchestra.run.smithi101.stdout: { 2023-08-01T19:55:13.110 INFO:teuthology.orchestra.run.smithi101.stdout: "event": "all_read", 2023-08-01T19:55:13.110 INFO:teuthology.orchestra.run.smithi101.stdout: "time": "2023-08-01T19:55:05.150973+0000", 2023-08-01T19:55:13.110 INFO:teuthology.orchestra.run.smithi101.stdout: "duration": 6.4531999999999998e-05 2023-08-01T19:55:13.111 INFO:teuthology.orchestra.run.smithi101.stdout: }, 2023-08-01T19:55:13.111 INFO:teuthology.orchestra.run.smithi101.stdout: { 2023-08-01T19:55:13.111 INFO:teuthology.orchestra.run.smithi101.stdout: "event": "dispatched", 2023-08-01T19:55:13.111 INFO:teuthology.orchestra.run.smithi101.stdout: "time": "2023-08-01T19:55:05.150984+0000", 2023-08-01T19:55:13.111 INFO:teuthology.orchestra.run.smithi101.stdout: "duration": 1.0287e-05 2023-08-01T19:55:13.111 INFO:teuthology.orchestra.run.smithi101.stdout: }, 2023-08-01T19:55:13.111 INFO:teuthology.orchestra.run.smithi101.stdout: { 2023-08-01T19:55:13.111 INFO:teuthology.orchestra.run.smithi101.stdout: "event": "queued_for_pg", 2023-08-01T19:55:13.112 INFO:teuthology.orchestra.run.smithi101.stdout: "time": "2023-08-01T19:55:05.150989+0000", 2023-08-01T19:55:13.112 INFO:teuthology.orchestra.run.smithi101.stdout: "duration": 5.3929999999999999e-06 2023-08-01T19:55:13.112 INFO:teuthology.orchestra.run.smithi101.stdout: }, 2023-08-01T19:55:13.112 INFO:teuthology.orchestra.run.smithi101.stdout: { 2023-08-01T19:55:13.112 INFO:teuthology.orchestra.run.smithi101.stdout: "event": "reached_pg", 2023-08-01T19:55:13.112 INFO:teuthology.orchestra.run.smithi101.stdout: "time": "2023-08-01T19:55:05.151034+0000", 2023-08-01T19:55:13.112 INFO:teuthology.orchestra.run.smithi101.stdout: "duration": 4.4336999999999999e-05 2023-08-01T19:55:13.113 INFO:teuthology.orchestra.run.smithi101.stdout: }, 2023-08-01T19:55:13.113 INFO:teuthology.orchestra.run.smithi101.stdout: { 2023-08-01T19:55:13.113 INFO:teuthology.orchestra.run.smithi101.stdout: "event": "started", 2023-08-01T19:55:13.113 INFO:teuthology.orchestra.run.smithi101.stdout: "time": "2023-08-01T19:55:05.151167+0000", 2023-08-01T19:55:13.113 INFO:teuthology.orchestra.run.smithi101.stdout: "duration": 0.00013368899999999999 2023-08-01T19:55:13.113 INFO:teuthology.orchestra.run.smithi101.stdout: }, 2023-08-01T19:55:13.113 INFO:teuthology.orchestra.run.smithi101.stdout: { 2023-08-01T19:55:13.114 INFO:teuthology.orchestra.run.smithi101.stdout: "event": "waiting for subops from 2", 2023-08-01T19:55:13.114 INFO:teuthology.orchestra.run.smithi101.stdout: "time": "2023-08-01T19:55:05.151328+0000", 2023-08-01T19:55:13.114 INFO:teuthology.orchestra.run.smithi101.stdout: "duration": 0.00016122700000000001 2023-08-01T19:55:13.114 INFO:teuthology.orchestra.run.smithi101.stdout: }, 2023-08-01T19:55:13.114 INFO:teuthology.orchestra.run.smithi101.stdout: { 2023-08-01T19:55:13.114 INFO:teuthology.orchestra.run.smithi101.stdout: "event": "op_commit", 2023-08-01T19:55:13.114 INFO:teuthology.orchestra.run.smithi101.stdout: "time": "2023-08-01T19:55:05.156101+0000", 2023-08-01T19:55:13.114 INFO:teuthology.orchestra.run.smithi101.stdout: "duration": 0.0047724100000000004 2023-08-01T19:55:13.115 INFO:teuthology.orchestra.run.smithi101.stdout: }, 2023-08-01T19:55:13.115 INFO:teuthology.orchestra.run.smithi101.stdout: { 2023-08-01T19:55:13.115 INFO:teuthology.orchestra.run.smithi101.stdout: "event": "sub_op_commit_rec", 2023-08-01T19:55:13.115 INFO:teuthology.orchestra.run.smithi101.stdout: "time": "2023-08-01T19:55:05.223688+0000", 2023-08-01T19:55:13.115 INFO:teuthology.orchestra.run.smithi101.stdout: "duration": 0.067586937999999999 2023-08-01T19:55:13.115 INFO:teuthology.orchestra.run.smithi101.stdout: }, 2023-08-01T19:55:13.115 INFO:teuthology.orchestra.run.smithi101.stdout: { 2023-08-01T19:55:13.116 INFO:teuthology.orchestra.run.smithi101.stdout: "event": "commit_sent", 2023-08-01T19:55:13.116 INFO:teuthology.orchestra.run.smithi101.stdout: "time": "2023-08-01T19:55:05.223737+0000", 2023-08-01T19:55:13.116 INFO:teuthology.orchestra.run.smithi101.stdout: "duration": 4.8921999999999997e-05 2023-08-01T19:55:13.116 INFO:teuthology.orchestra.run.smithi101.stdout: }, 2023-08-01T19:55:13.116 INFO:teuthology.orchestra.run.smithi101.stdout: { 2023-08-01T19:55:13.116 INFO:teuthology.orchestra.run.smithi101.stdout: "event": "done", 2023-08-01T19:55:13.116 INFO:teuthology.orchestra.run.smithi101.stdout: "time": "2023-08-01T19:55:05.223774+0000", 2023-08-01T19:55:13.116 INFO:teuthology.orchestra.run.smithi101.stdout: "duration": 3.7342999999999998e-05 2023-08-01T19:55:13.117 INFO:teuthology.orchestra.run.smithi101.stdout: } 2023-08-01T19:55:13.117 INFO:teuthology.orchestra.run.smithi101.stdout: ] 2023-08-01T19:55:13.117 INFO:teuthology.orchestra.run.smithi101.stdout: } 2023-08-01T19:55:13.117 INFO:teuthology.orchestra.run.smithi101.stdout: }, 2023-08-01T19:55:13.117 INFO:teuthology.orchestra.run.smithi101.stdout: { 2023-08-01T19:55:13.117 INFO:teuthology.orchestra.run.smithi101.stdout: "description": "osd_op(client.4668.0:100253 5.f 5:f7bbce05:::benchmark_data_smithi006_114134_object100252:head [set-alloc-hint object_size 65536 write_size 65536,write 0~65536] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e37)", 2023-08-01T19:55:13.117 INFO:teuthology.orchestra.run.smithi101.stdout: "initiated_at": "2023-08-01T19:55:05.156562+0000", 2023-08-01T19:55:13.118 INFO:teuthology.orchestra.run.smithi101.stdout: "age": 7.8468552259999997, 2023-08-01T19:55:13.118 INFO:teuthology.orchestra.run.smithi101.stdout: "duration": 0.068677503000000001, 2023-08-01T19:55:13.118 INFO:teuthology.orchestra.run.smithi101.stdout: "type_data": { 2023-08-01T19:55:13.118 INFO:teuthology.orchestra.run.smithi101.stdout: "flag_point": "commit sent; apply or cleanup", 2023-08-01T19:55:13.118 INFO:teuthology.orchestra.run.smithi101.stdout: "client_info": { 2023-08-01T19:55:13.118 INFO:teuthology.orchestra.run.smithi101.stdout: "client": "client.4668", 2023-08-01T19:55:13.118 INFO:teuthology.orchestra.run.smithi101.stdout: "client_addr": "172.21.15.6:0/1709472247", 2023-08-01T19:55:13.118 INFO:teuthology.orchestra.run.smithi101.stdout: "tid": 100253 2023-08-01T19:55:13.119 INFO:teuthology.orchestra.run.smithi101.stdout: }, 2023-08-01T19:55:13.119 INFO:teuthology.orchestra.run.smithi101.stdout: "events": [ 2023-08-01T19:55:13.119 INFO:teuthology.orchestra.run.smithi101.stdout: { 2023-08-01T19:55:13.119 INFO:teuthology.orchestra.run.smithi101.stdout: "event": "initiated", 2023-08-01T19:55:13.119 INFO:teuthology.orchestra.run.smithi101.stdout: "time": "2023-08-01T19:55:05.156562+0000", 2023-08-01T19:55:13.119 INFO:teuthology.orchestra.run.smithi101.stdout: "duration": 0 2023-08-01T19:55:13.119 INFO:teuthology.orchestra.run.smithi101.stdout: }, 2023-08-01T19:55:13.119 INFO:teuthology.orchestra.run.smithi101.stdout: { 2023-08-01T19:55:13.120 INFO:teuthology.orchestra.run.smithi101.stdout: "event": "throttled", 2023-08-01T19:55:13.120 INFO:teuthology.orchestra.run.smithi101.stdout: "time": "2023-08-01T19:55:05.156562+0000", 2023-08-01T19:55:13.120 INFO:teuthology.orchestra.run.smithi101.stdout: "duration": 0 2023-08-01T19:55:13.120 INFO:teuthology.orchestra.run.smithi101.stdout: }, 2023-08-01T19:55:13.120 INFO:teuthology.orchestra.run.smithi101.stdout: { 2023-08-01T19:55:13.120 INFO:teuthology.orchestra.run.smithi101.stdout: "event": "header_read", 2023-08-01T19:55:13.120 INFO:teuthology.orchestra.run.smithi101.stdout: "time": "2023-08-01T19:55:05.156561+0000", 2023-08-01T19:55:13.121 INFO:teuthology.orchestra.run.smithi101.stdout: "duration": 4294967295.999999 2023-08-01T19:55:13.121 INFO:teuthology.orchestra.run.smithi101.stdout: }, 2023-08-01T19:55:13.121 INFO:teuthology.orchestra.run.smithi101.stdout: { 2023-08-01T19:55:13.121 INFO:teuthology.orchestra.run.smithi101.stdout: "event": "all_read", 2023-08-01T19:55:13.121 INFO:teuthology.orchestra.run.smithi101.stdout: "time": "2023-08-01T19:55:05.156655+0000", 2023-08-01T19:55:13.121 INFO:teuthology.orchestra.run.smithi101.stdout: "duration": 9.4018999999999995e-05 2023-08-01T19:55:13.121 INFO:teuthology.orchestra.run.smithi101.stdout: }, 2023-08-01T19:55:13.121 INFO:teuthology.orchestra.run.smithi101.stdout: { 2023-08-01T19:55:13.122 INFO:teuthology.orchestra.run.smithi101.stdout: "event": "dispatched", 2023-08-01T19:55:13.122 INFO:teuthology.orchestra.run.smithi101.stdout: "time": "2023-08-01T19:55:05.156664+0000", 2023-08-01T19:55:13.122 INFO:teuthology.orchestra.run.smithi101.stdout: "duration": 9.4970000000000007e-06 2023-08-01T19:55:13.122 INFO:teuthology.orchestra.run.smithi101.stdout: }, 2023-08-01T19:55:13.122 INFO:teuthology.orchestra.run.smithi101.stdout: { 2023-08-01T19:55:13.122 INFO:teuthology.orchestra.run.smithi101.stdout: "event": "queued_for_pg", 2023-08-01T19:55:13.122 INFO:teuthology.orchestra.run.smithi101.stdout: "time": "2023-08-01T19:55:05.156671+0000", 2023-08-01T19:55:13.122 INFO:teuthology.orchestra.run.smithi101.stdout: "duration": 6.1929999999999998e-06 2023-08-01T19:55:13.123 INFO:teuthology.orchestra.run.smithi101.stdout: }, 2023-08-01T19:55:13.123 INFO:teuthology.orchestra.run.smithi101.stdout: { 2023-08-01T19:55:13.123 INFO:teuthology.orchestra.run.smithi101.stdout: "event": "reached_pg", 2023-08-01T19:55:13.123 INFO:teuthology.orchestra.run.smithi101.stdout: "time": "2023-08-01T19:55:05.156742+0000", 2023-08-01T19:55:13.123 INFO:teuthology.orchestra.run.smithi101.stdout: "duration": 7.1181999999999997e-05 2023-08-01T19:55:13.123 INFO:teuthology.orchestra.run.smithi101.stdout: }, 2023-08-01T19:55:13.123 INFO:teuthology.orchestra.run.smithi101.stdout: { 2023-08-01T19:55:13.123 INFO:teuthology.orchestra.run.smithi101.stdout: "event": "started", 2023-08-01T19:55:13.124 INFO:teuthology.orchestra.run.smithi101.stdout: "time": "2023-08-01T19:55:05.156839+0000", 2023-08-01T19:55:13.124 INFO:teuthology.orchestra.run.smithi101.stdout: "duration": 9.7182000000000006e-05 2023-08-01T19:55:13.124 INFO:teuthology.orchestra.run.smithi101.stdout: }, 2023-08-01T19:55:13.124 INFO:teuthology.orchestra.run.smithi101.stdout: { 2023-08-01T19:55:13.124 INFO:teuthology.orchestra.run.smithi101.stdout: "event": "waiting for subops from 2", 2023-08-01T19:55:13.124 INFO:teuthology.orchestra.run.smithi101.stdout: "time": "2023-08-01T19:55:05.156925+0000", 2023-08-01T19:55:13.124 INFO:teuthology.orchestra.run.smithi101.stdout: "duration": 8.5816000000000006e-05 2023-08-01T19:55:13.125 INFO:teuthology.orchestra.run.smithi101.stdout: }, 2023-08-01T19:55:13.125 INFO:teuthology.orchestra.run.smithi101.stdout: { 2023-08-01T19:55:13.125 INFO:teuthology.orchestra.run.smithi101.stdout: "event": "op_commit", 2023-08-01T19:55:13.125 INFO:teuthology.orchestra.run.smithi101.stdout: "time": "2023-08-01T19:55:05.160082+0000", 2023-08-01T19:55:13.125 INFO:teuthology.orchestra.run.smithi101.stdout: "duration": 0.0031573959999999998 2023-08-01T19:55:13.125 INFO:teuthology.orchestra.run.smithi101.stdout: }, 2023-08-01T19:55:13.125 INFO:teuthology.orchestra.run.smithi101.stdout: { 2023-08-01T19:55:13.125 INFO:teuthology.orchestra.run.smithi101.stdout: "event": "sub_op_commit_rec", 2023-08-01T19:55:13.126 INFO:teuthology.orchestra.run.smithi101.stdout: "time": "2023-08-01T19:55:05.225162+0000", 2023-08-01T19:55:13.126 INFO:teuthology.orchestra.run.smithi101.stdout: "duration": 0.065079466000000002 2023-08-01T19:55:13.126 INFO:teuthology.orchestra.run.smithi101.stdout: }, 2023-08-01T19:55:13.126 INFO:teuthology.orchestra.run.smithi101.stdout: { 2023-08-01T19:55:13.126 INFO:teuthology.orchestra.run.smithi101.stdout: "event": "commit_sent", 2023-08-01T19:55:13.126 INFO:teuthology.orchestra.run.smithi101.stdout: "time": "2023-08-01T19:55:05.225205+0000", 2023-08-01T19:55:13.126 INFO:teuthology.orchestra.run.smithi101.stdout: "duration": 4.3446999999999999e-05 2023-08-01T19:55:13.126 INFO:teuthology.orchestra.run.smithi101.stdout: }, 2023-08-01T19:55:13.127 INFO:teuthology.orchestra.run.smithi101.stdout: { 2023-08-01T19:55:13.127 INFO:teuthology.orchestra.run.smithi101.stdout: "event": "done", 2023-08-01T19:55:13.127 INFO:teuthology.orchestra.run.smithi101.stdout: "time": "2023-08-01T19:55:05.225239+0000", 2023-08-01T19:55:13.127 INFO:teuthology.orchestra.run.smithi101.stdout: "duration": 3.4121000000000001e-05 2023-08-01T19:55:13.127 INFO:teuthology.orchestra.run.smithi101.stdout: } 2023-08-01T19:55:13.127 INFO:teuthology.orchestra.run.smithi101.stdout: ] 2023-08-01T19:55:13.127 INFO:teuthology.orchestra.run.smithi101.stdout: } 2023-08-01T19:55:13.127 INFO:teuthology.orchestra.run.smithi101.stdout: }, 2023-08-01T19:55:13.128 INFO:teuthology.orchestra.run.smithi101.stdout: { 2023-08-01T19:55:13.128 INFO:teuthology.orchestra.run.smithi101.stdout: "description": "osd_op(client.4668.0:100928 5.7 5:e61a7dfa:::benchmark_data_smithi006_114134_object100927:head [set-alloc-hint object_size 65536 write_size 65536,write 0~65536] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e37)", 2023-08-01T19:55:13.128 INFO:teuthology.orchestra.run.smithi101.stdout: "initiated_at": "2023-08-01T19:55:05.564731+0000", 2023-08-01T19:55:13.128 INFO:teuthology.orchestra.run.smithi101.stdout: "age": 7.4386857339999999, 2023-08-01T19:55:13.128 INFO:teuthology.orchestra.run.smithi101.stdout: "duration": 0.064686603999999995, 2023-08-01T19:55:13.128 INFO:teuthology.orchestra.run.smithi101.stdout: "type_data": { 2023-08-01T19:55:13.128 INFO:teuthology.orchestra.run.smithi101.stdout: "flag_point": "commit sent; apply or cleanup", 2023-08-01T19:55:13.128 INFO:teuthology.orchestra.run.smithi101.stdout: "client_info": { 2023-08-01T19:55:13.129 INFO:teuthology.orchestra.run.smithi101.stdout: "client": "client.4668", 2023-08-01T19:55:13.129 INFO:teuthology.orchestra.run.smithi101.stdout: "client_addr": "172.21.15.6:0/1709472247", 2023-08-01T19:55:13.129 INFO:teuthology.orchestra.run.smithi101.stdout: "tid": 100928 2023-08-01T19:55:13.129 INFO:teuthology.orchestra.run.smithi101.stdout: }, 2023-08-01T19:55:13.129 INFO:teuthology.orchestra.run.smithi101.stdout: "events": [ 2023-08-01T19:55:13.129 INFO:teuthology.orchestra.run.smithi101.stdout: { 2023-08-01T19:55:13.129 INFO:teuthology.orchestra.run.smithi101.stdout: "event": "initiated", 2023-08-01T19:55:13.130 INFO:teuthology.orchestra.run.smithi101.stdout: "time": "2023-08-01T19:55:05.564731+0000", 2023-08-01T19:55:13.130 INFO:teuthology.orchestra.run.smithi101.stdout: "duration": 0 2023-08-01T19:55:13.130 INFO:teuthology.orchestra.run.smithi101.stdout: }, 2023-08-01T19:55:13.130 INFO:teuthology.orchestra.run.smithi101.stdout: { 2023-08-01T19:55:13.130 INFO:teuthology.orchestra.run.smithi101.stdout: "event": "throttled", 2023-08-01T19:55:13.130 INFO:teuthology.orchestra.run.smithi101.stdout: "time": "2023-08-01T19:55:05.564731+0000", 2023-08-01T19:55:13.130 INFO:teuthology.orchestra.run.smithi101.stdout: "duration": 0 2023-08-01T19:55:13.130 INFO:teuthology.orchestra.run.smithi101.stdout: }, 2023-08-01T19:55:13.131 INFO:teuthology.orchestra.run.smithi101.stdout: { 2023-08-01T19:55:13.131 INFO:teuthology.orchestra.run.smithi101.stdout: "event": "header_read", 2023-08-01T19:55:13.131 INFO:teuthology.orchestra.run.smithi101.stdout: "time": "2023-08-01T19:55:05.564731+0000", 2023-08-01T19:55:13.131 INFO:teuthology.orchestra.run.smithi101.stdout: "duration": 4294967295.999999 2023-08-01T19:55:13.131 INFO:teuthology.orchestra.run.smithi101.stdout: }, 2023-08-01T19:55:13.131 INFO:teuthology.orchestra.run.smithi101.stdout: { 2023-08-01T19:55:13.131 INFO:teuthology.orchestra.run.smithi101.stdout: "event": "all_read", 2023-08-01T19:55:13.131 INFO:teuthology.orchestra.run.smithi101.stdout: "time": "2023-08-01T19:55:05.564832+0000", 2023-08-01T19:55:13.132 INFO:teuthology.orchestra.run.smithi101.stdout: "duration": 0.000101752 2023-08-01T19:55:13.132 INFO:teuthology.orchestra.run.smithi101.stdout: }, 2023-08-01T19:55:13.132 INFO:teuthology.orchestra.run.smithi101.stdout: { 2023-08-01T19:55:13.132 INFO:teuthology.orchestra.run.smithi101.stdout: "event": "dispatched", 2023-08-01T19:55:13.132 INFO:teuthology.orchestra.run.smithi101.stdout: "time": "2023-08-01T19:55:05.564840+0000", 2023-08-01T19:55:13.132 INFO:teuthology.orchestra.run.smithi101.stdout: "duration": 7.8590000000000005e-06 2023-08-01T19:55:13.132 INFO:teuthology.orchestra.run.smithi101.stdout: }, 2023-08-01T19:55:13.132 INFO:teuthology.orchestra.run.smithi101.stdout: { 2023-08-01T19:55:13.133 INFO:teuthology.orchestra.run.smithi101.stdout: "event": "queued_for_pg", 2023-08-01T19:55:13.133 INFO:teuthology.orchestra.run.smithi101.stdout: "time": "2023-08-01T19:55:05.564845+0000", 2023-08-01T19:55:13.133 INFO:teuthology.orchestra.run.smithi101.stdout: "duration": 4.9189999999999998e-06 2023-08-01T19:55:13.133 INFO:teuthology.orchestra.run.smithi101.stdout: }, 2023-08-01T19:55:13.133 INFO:teuthology.orchestra.run.smithi101.stdout: { 2023-08-01T19:55:13.133 INFO:teuthology.orchestra.run.smithi101.stdout: "event": "reached_pg", 2023-08-01T19:55:13.133 INFO:teuthology.orchestra.run.smithi101.stdout: "time": "2023-08-01T19:55:05.564883+0000", 2023-08-01T19:55:13.134 INFO:teuthology.orchestra.run.smithi101.stdout: "duration": 3.7481999999999998e-05 2023-08-01T19:55:13.134 INFO:teuthology.orchestra.run.smithi101.stdout: }, 2023-08-01T19:55:13.134 INFO:teuthology.orchestra.run.smithi101.stdout: { 2023-08-01T19:55:13.134 INFO:teuthology.orchestra.run.smithi101.stdout: "event": "started", 2023-08-01T19:55:13.134 INFO:teuthology.orchestra.run.smithi101.stdout: "time": "2023-08-01T19:55:05.564968+0000", 2023-08-01T19:55:13.134 INFO:teuthology.orchestra.run.smithi101.stdout: "duration": 8.5494999999999994e-05 2023-08-01T19:55:13.134 INFO:teuthology.orchestra.run.smithi101.stdout: }, 2023-08-01T19:55:13.134 INFO:teuthology.orchestra.run.smithi101.stdout: { 2023-08-01T19:55:13.135 INFO:teuthology.orchestra.run.smithi101.stdout: "event": "waiting for subops from 0", 2023-08-01T19:55:13.135 INFO:teuthology.orchestra.run.smithi101.stdout: "time": "2023-08-01T19:55:05.565062+0000", 2023-08-01T19:55:13.135 INFO:teuthology.orchestra.run.smithi101.stdout: "duration": 9.3478000000000002e-05 2023-08-01T19:55:13.135 INFO:teuthology.orchestra.run.smithi101.stdout: }, 2023-08-01T19:55:13.135 INFO:teuthology.orchestra.run.smithi101.stdout: { 2023-08-01T19:55:13.135 INFO:teuthology.orchestra.run.smithi101.stdout: "event": "op_commit", 2023-08-01T19:55:13.135 INFO:teuthology.orchestra.run.smithi101.stdout: "time": "2023-08-01T19:55:05.572061+0000", 2023-08-01T19:55:13.135 INFO:teuthology.orchestra.run.smithi101.stdout: "duration": 0.0069998250000000003 2023-08-01T19:55:13.136 INFO:teuthology.orchestra.run.smithi101.stdout: }, 2023-08-01T19:55:13.136 INFO:teuthology.orchestra.run.smithi101.stdout: { 2023-08-01T19:55:13.136 INFO:teuthology.orchestra.run.smithi101.stdout: "event": "sub_op_commit_rec", 2023-08-01T19:55:13.136 INFO:teuthology.orchestra.run.smithi101.stdout: "time": "2023-08-01T19:55:05.629362+0000", 2023-08-01T19:55:13.136 INFO:teuthology.orchestra.run.smithi101.stdout: "duration": 0.057300691000000001 2023-08-01T19:55:13.136 INFO:teuthology.orchestra.run.smithi101.stdout: }, 2023-08-01T19:55:13.136 INFO:teuthology.orchestra.run.smithi101.stdout: { 2023-08-01T19:55:13.136 INFO:teuthology.orchestra.run.smithi101.stdout: "event": "commit_sent", 2023-08-01T19:55:13.137 INFO:teuthology.orchestra.run.smithi101.stdout: "time": "2023-08-01T19:55:05.629395+0000", 2023-08-01T19:55:13.137 INFO:teuthology.orchestra.run.smithi101.stdout: "duration": 3.3124000000000003e-05 2023-08-01T19:55:13.137 INFO:teuthology.orchestra.run.smithi101.stdout: }, 2023-08-01T19:55:13.137 INFO:teuthology.orchestra.run.smithi101.stdout: { 2023-08-01T19:55:13.137 INFO:teuthology.orchestra.run.smithi101.stdout: "event": "done", 2023-08-01T19:55:13.137 INFO:teuthology.orchestra.run.smithi101.stdout: "time": "2023-08-01T19:55:05.629418+0000", 2023-08-01T19:55:13.137 INFO:teuthology.orchestra.run.smithi101.stdout: "duration": 2.2697999999999999e-05 2023-08-01T19:55:13.137 INFO:teuthology.orchestra.run.smithi101.stdout: } 2023-08-01T19:55:13.138 INFO:teuthology.orchestra.run.smithi101.stdout: ] 2023-08-01T19:55:13.138 INFO:teuthology.orchestra.run.smithi101.stdout: } 2023-08-01T19:55:13.138 INFO:teuthology.orchestra.run.smithi101.stdout: }, 2023-08-01T19:55:13.138 INFO:teuthology.orchestra.run.smithi101.stdout: { 2023-08-01T19:55:13.138 INFO:teuthology.orchestra.run.smithi101.stdout: "description": "osd_op(client.4668.0:100936 5.1 5:8f4e3576:::benchmark_data_smithi006_114134_object100935:head [set-alloc-hint object_size 65536 write_size 65536,write 0~65536] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e37)", 2023-08-01T19:55:13.138 INFO:teuthology.orchestra.run.smithi101.stdout: "initiated_at": "2023-08-01T19:55:05.567147+0000", 2023-08-01T19:55:13.138 INFO:teuthology.orchestra.run.smithi101.stdout: "age": 7.4362702079999998, 2023-08-01T19:55:13.139 INFO:teuthology.orchestra.run.smithi101.stdout: "duration": 0.063466380000000003, 2023-08-01T19:55:13.139 INFO:teuthology.orchestra.run.smithi101.stdout: "type_data": { 2023-08-01T19:55:13.139 INFO:teuthology.orchestra.run.smithi101.stdout: "flag_point": "commit sent; apply or cleanup", 2023-08-01T19:55:13.139 INFO:teuthology.orchestra.run.smithi101.stdout: "client_info": { 2023-08-01T19:55:13.139 INFO:teuthology.orchestra.run.smithi101.stdout: "client": "client.4668", 2023-08-01T19:55:13.139 INFO:teuthology.orchestra.run.smithi101.stdout: "client_addr": "172.21.15.6:0/1709472247", 2023-08-01T19:55:13.139 INFO:teuthology.orchestra.run.smithi101.stdout: "tid": 100936 2023-08-01T19:55:13.139 INFO:teuthology.orchestra.run.smithi101.stdout: }, 2023-08-01T19:55:13.140 INFO:teuthology.orchestra.run.smithi101.stdout: "events": [ 2023-08-01T19:55:13.140 INFO:teuthology.orchestra.run.smithi101.stdout: { 2023-08-01T19:55:13.140 INFO:teuthology.orchestra.run.smithi101.stdout: "event": "initiated", 2023-08-01T19:55:13.140 INFO:teuthology.orchestra.run.smithi101.stdout: "time": "2023-08-01T19:55:05.567147+0000", 2023-08-01T19:55:13.140 INFO:teuthology.orchestra.run.smithi101.stdout: "duration": 0 2023-08-01T19:55:13.140 INFO:teuthology.orchestra.run.smithi101.stdout: }, 2023-08-01T19:55:13.140 INFO:teuthology.orchestra.run.smithi101.stdout: { 2023-08-01T19:55:13.140 INFO:teuthology.orchestra.run.smithi101.stdout: "event": "throttled", 2023-08-01T19:55:13.141 INFO:teuthology.orchestra.run.smithi101.stdout: "time": "2023-08-01T19:55:05.567147+0000", 2023-08-01T19:55:13.141 INFO:teuthology.orchestra.run.smithi101.stdout: "duration": 0 2023-08-01T19:55:13.141 INFO:teuthology.orchestra.run.smithi101.stdout: }, 2023-08-01T19:55:13.141 INFO:teuthology.orchestra.run.smithi101.stdout: { 2023-08-01T19:55:13.141 INFO:teuthology.orchestra.run.smithi101.stdout: "event": "header_read", 2023-08-01T19:55:13.141 INFO:teuthology.orchestra.run.smithi101.stdout: "time": "2023-08-01T19:55:05.567146+0000", 2023-08-01T19:55:13.141 INFO:teuthology.orchestra.run.smithi101.stdout: "duration": 4294967295.999999 2023-08-01T19:55:13.141 INFO:teuthology.orchestra.run.smithi101.stdout: }, 2023-08-01T19:55:13.142 INFO:teuthology.orchestra.run.smithi101.stdout: { 2023-08-01T19:55:13.142 INFO:teuthology.orchestra.run.smithi101.stdout: "event": "all_read", 2023-08-01T19:55:13.142 INFO:teuthology.orchestra.run.smithi101.stdout: "time": "2023-08-01T19:55:05.567224+0000", 2023-08-01T19:55:13.142 INFO:teuthology.orchestra.run.smithi101.stdout: "duration": 7.8460000000000004e-05 2023-08-01T19:55:13.142 INFO:teuthology.orchestra.run.smithi101.stdout: }, 2023-08-01T19:55:13.142 INFO:teuthology.orchestra.run.smithi101.stdout: { 2023-08-01T19:55:13.142 INFO:teuthology.orchestra.run.smithi101.stdout: "event": "dispatched", 2023-08-01T19:55:13.142 INFO:teuthology.orchestra.run.smithi101.stdout: "time": "2023-08-01T19:55:05.567234+0000", 2023-08-01T19:55:13.143 INFO:teuthology.orchestra.run.smithi101.stdout: "duration": 9.7110000000000007e-06 2023-08-01T19:55:13.143 INFO:teuthology.orchestra.run.smithi101.stdout: }, 2023-08-01T19:55:13.143 INFO:teuthology.orchestra.run.smithi101.stdout: { 2023-08-01T19:55:13.143 INFO:teuthology.orchestra.run.smithi101.stdout: "event": "queued_for_pg", 2023-08-01T19:55:13.143 INFO:teuthology.orchestra.run.smithi101.stdout: "time": "2023-08-01T19:55:05.567239+0000", 2023-08-01T19:55:13.143 INFO:teuthology.orchestra.run.smithi101.stdout: "duration": 5.237e-06 2023-08-01T19:55:13.143 INFO:teuthology.orchestra.run.smithi101.stdout: }, 2023-08-01T19:55:13.143 INFO:teuthology.orchestra.run.smithi101.stdout: { 2023-08-01T19:55:13.144 INFO:teuthology.orchestra.run.smithi101.stdout: "event": "reached_pg", 2023-08-01T19:55:13.144 INFO:teuthology.orchestra.run.smithi101.stdout: "time": "2023-08-01T19:55:05.567278+0000", 2023-08-01T19:55:13.144 INFO:teuthology.orchestra.run.smithi101.stdout: "duration": 3.9069999999999997e-05 2023-08-01T19:55:13.144 INFO:teuthology.orchestra.run.smithi101.stdout: }, 2023-08-01T19:55:13.144 INFO:teuthology.orchestra.run.smithi101.stdout: { 2023-08-01T19:55:13.144 INFO:teuthology.orchestra.run.smithi101.stdout: "event": "started", 2023-08-01T19:55:13.144 INFO:teuthology.orchestra.run.smithi101.stdout: "time": "2023-08-01T19:55:05.567402+0000", 2023-08-01T19:55:13.145 INFO:teuthology.orchestra.run.smithi101.stdout: "duration": 0.00012348700000000001 2023-08-01T19:55:13.145 INFO:teuthology.orchestra.run.smithi101.stdout: }, 2023-08-01T19:55:13.145 INFO:teuthology.orchestra.run.smithi101.stdout: { 2023-08-01T19:55:13.145 INFO:teuthology.orchestra.run.smithi101.stdout: "event": "waiting for subops from 0", 2023-08-01T19:55:13.145 INFO:teuthology.orchestra.run.smithi101.stdout: "time": "2023-08-01T19:55:05.567558+0000", 2023-08-01T19:55:13.145 INFO:teuthology.orchestra.run.smithi101.stdout: "duration": 0.000156179 2023-08-01T19:55:13.145 INFO:teuthology.orchestra.run.smithi101.stdout: }, 2023-08-01T19:55:13.145 INFO:teuthology.orchestra.run.smithi101.stdout: { 2023-08-01T19:55:13.146 INFO:teuthology.orchestra.run.smithi101.stdout: "event": "op_commit", 2023-08-01T19:55:13.146 INFO:teuthology.orchestra.run.smithi101.stdout: "time": "2023-08-01T19:55:05.573767+0000", 2023-08-01T19:55:13.146 INFO:teuthology.orchestra.run.smithi101.stdout: "duration": 0.0062092409999999999 2023-08-01T19:55:13.146 INFO:teuthology.orchestra.run.smithi101.stdout: }, 2023-08-01T19:55:13.146 INFO:teuthology.orchestra.run.smithi101.stdout: { 2023-08-01T19:55:13.146 INFO:teuthology.orchestra.run.smithi101.stdout: "event": "sub_op_commit_rec", 2023-08-01T19:55:13.146 INFO:teuthology.orchestra.run.smithi101.stdout: "time": "2023-08-01T19:55:05.630531+0000", 2023-08-01T19:55:13.146 INFO:teuthology.orchestra.run.smithi101.stdout: "duration": 0.056763409000000001 2023-08-01T19:55:13.147 INFO:teuthology.orchestra.run.smithi101.stdout: }, 2023-08-01T19:55:13.147 INFO:teuthology.orchestra.run.smithi101.stdout: { 2023-08-01T19:55:13.147 INFO:teuthology.orchestra.run.smithi101.stdout: "event": "commit_sent", 2023-08-01T19:55:13.147 INFO:teuthology.orchestra.run.smithi101.stdout: "time": "2023-08-01T19:55:05.630577+0000", 2023-08-01T19:55:13.147 INFO:teuthology.orchestra.run.smithi101.stdout: "duration": 4.6588000000000002e-05 2023-08-01T19:55:13.147 INFO:teuthology.orchestra.run.smithi101.stdout: }, 2023-08-01T19:55:13.147 INFO:teuthology.orchestra.run.smithi101.stdout: { 2023-08-01T19:55:13.147 INFO:teuthology.orchestra.run.smithi101.stdout: "event": "done", 2023-08-01T19:55:13.148 INFO:teuthology.orchestra.run.smithi101.stdout: "time": "2023-08-01T19:55:05.630613+0000", 2023-08-01T19:55:13.148 INFO:teuthology.orchestra.run.smithi101.stdout: "duration": 3.5802e-05 2023-08-01T19:55:13.148 INFO:teuthology.orchestra.run.smithi101.stdout: } 2023-08-01T19:55:13.148 INFO:teuthology.orchestra.run.smithi101.stdout: ] 2023-08-01T19:55:13.148 INFO:teuthology.orchestra.run.smithi101.stdout: } 2023-08-01T19:55:13.148 INFO:teuthology.orchestra.run.smithi101.stdout: }, 2023-08-01T19:55:13.148 INFO:teuthology.orchestra.run.smithi101.stdout: { 2023-08-01T19:55:13.148 INFO:teuthology.orchestra.run.smithi101.stdout: "description": "osd_op(client.4668.0:100943 5.7 5:e01743fe:::benchmark_data_smithi006_114134_object100942:head [set-alloc-hint object_size 65536 write_size 65536,write 0~65536] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e37)", 2023-08-01T19:55:13.149 INFO:teuthology.orchestra.run.smithi101.stdout: "initiated_at": "2023-08-01T19:55:05.574724+0000", 2023-08-01T19:55:13.149 INFO:teuthology.orchestra.run.smithi101.stdout: "age": 7.4286931149999997, 2023-08-01T19:55:13.149 INFO:teuthology.orchestra.run.smithi101.stdout: "duration": 0.058761188999999998, 2023-08-01T19:55:13.149 INFO:teuthology.orchestra.run.smithi101.stdout: "type_data": { 2023-08-01T19:55:13.149 INFO:teuthology.orchestra.run.smithi101.stdout: "flag_point": "commit sent; apply or cleanup", 2023-08-01T19:55:13.149 INFO:teuthology.orchestra.run.smithi101.stdout: "client_info": { 2023-08-01T19:55:13.149 INFO:teuthology.orchestra.run.smithi101.stdout: "client": "client.4668", 2023-08-01T19:55:13.150 INFO:teuthology.orchestra.run.smithi101.stdout: "client_addr": "172.21.15.6:0/1709472247", 2023-08-01T19:55:13.150 INFO:teuthology.orchestra.run.smithi101.stdout: "tid": 100943 2023-08-01T19:55:13.150 INFO:teuthology.orchestra.run.smithi101.stdout: }, 2023-08-01T19:55:13.150 INFO:teuthology.orchestra.run.smithi101.stdout: "events": [ 2023-08-01T19:55:13.150 INFO:teuthology.orchestra.run.smithi101.stdout: { 2023-08-01T19:55:13.150 INFO:teuthology.orchestra.run.smithi101.stdout: "event": "initiated", 2023-08-01T19:55:13.150 INFO:teuthology.orchestra.run.smithi101.stdout: "time": "2023-08-01T19:55:05.574724+0000", 2023-08-01T19:55:13.150 INFO:teuthology.orchestra.run.smithi101.stdout: "duration": 0 2023-08-01T19:55:13.151 INFO:teuthology.orchestra.run.smithi101.stdout: }, 2023-08-01T19:55:13.151 INFO:teuthology.orchestra.run.smithi101.stdout: { 2023-08-01T19:55:13.151 INFO:teuthology.orchestra.run.smithi101.stdout: "event": "throttled", 2023-08-01T19:55:13.151 INFO:teuthology.orchestra.run.smithi101.stdout: "time": "2023-08-01T19:55:05.574724+0000", 2023-08-01T19:55:13.151 INFO:teuthology.orchestra.run.smithi101.stdout: "duration": 0 2023-08-01T19:55:13.151 INFO:teuthology.orchestra.run.smithi101.stdout: }, 2023-08-01T19:55:13.151 INFO:teuthology.orchestra.run.smithi101.stdout: { 2023-08-01T19:55:13.152 INFO:teuthology.orchestra.run.smithi101.stdout: "event": "header_read", 2023-08-01T19:55:13.152 INFO:teuthology.orchestra.run.smithi101.stdout: "time": "2023-08-01T19:55:05.574723+0000", 2023-08-01T19:55:13.152 INFO:teuthology.orchestra.run.smithi101.stdout: "duration": 4294967295.999999 2023-08-01T19:55:13.152 INFO:teuthology.orchestra.run.smithi101.stdout: }, 2023-08-01T19:55:13.152 INFO:teuthology.orchestra.run.smithi101.stdout: { 2023-08-01T19:55:13.152 INFO:teuthology.orchestra.run.smithi101.stdout: "event": "all_read", 2023-08-01T19:55:13.152 INFO:teuthology.orchestra.run.smithi101.stdout: "time": "2023-08-01T19:55:05.574773+0000", 2023-08-01T19:55:13.152 INFO:teuthology.orchestra.run.smithi101.stdout: "duration": 4.9469999999999999e-05 2023-08-01T19:55:13.153 INFO:teuthology.orchestra.run.smithi101.stdout: }, 2023-08-01T19:55:13.153 INFO:teuthology.orchestra.run.smithi101.stdout: { 2023-08-01T19:55:13.153 INFO:teuthology.orchestra.run.smithi101.stdout: "event": "dispatched", 2023-08-01T19:55:13.153 INFO:teuthology.orchestra.run.smithi101.stdout: "time": "2023-08-01T19:55:05.574780+0000", 2023-08-01T19:55:13.153 INFO:teuthology.orchestra.run.smithi101.stdout: "duration": 7.5059999999999998e-06 2023-08-01T19:55:13.153 INFO:teuthology.orchestra.run.smithi101.stdout: }, 2023-08-01T19:55:13.153 INFO:teuthology.orchestra.run.smithi101.stdout: { 2023-08-01T19:55:13.153 INFO:teuthology.orchestra.run.smithi101.stdout: "event": "queued_for_pg", 2023-08-01T19:55:13.154 INFO:teuthology.orchestra.run.smithi101.stdout: "time": "2023-08-01T19:55:05.574784+0000", 2023-08-01T19:55:13.154 INFO:teuthology.orchestra.run.smithi101.stdout: "duration": 3.5540000000000002e-06 2023-08-01T19:55:13.154 INFO:teuthology.orchestra.run.smithi101.stdout: }, 2023-08-01T19:55:13.154 INFO:teuthology.orchestra.run.smithi101.stdout: { 2023-08-01T19:55:13.154 INFO:teuthology.orchestra.run.smithi101.stdout: "event": "reached_pg", 2023-08-01T19:55:13.154 INFO:teuthology.orchestra.run.smithi101.stdout: "time": "2023-08-01T19:55:05.574805+0000", 2023-08-01T19:55:13.154 INFO:teuthology.orchestra.run.smithi101.stdout: "duration": 2.1257999999999999e-05 2023-08-01T19:55:13.154 INFO:teuthology.orchestra.run.smithi101.stdout: }, 2023-08-01T19:55:13.155 INFO:teuthology.orchestra.run.smithi101.stdout: { 2023-08-01T19:55:13.155 INFO:teuthology.orchestra.run.smithi101.stdout: "event": "started", 2023-08-01T19:55:13.155 INFO:teuthology.orchestra.run.smithi101.stdout: "time": "2023-08-01T19:55:05.574886+0000", 2023-08-01T19:55:13.155 INFO:teuthology.orchestra.run.smithi101.stdout: "duration": 8.1545999999999995e-05 2023-08-01T19:55:13.155 INFO:teuthology.orchestra.run.smithi101.stdout: }, 2023-08-01T19:55:13.155 INFO:teuthology.orchestra.run.smithi101.stdout: { 2023-08-01T19:55:13.155 INFO:teuthology.orchestra.run.smithi101.stdout: "event": "waiting for subops from 0", 2023-08-01T19:55:13.155 INFO:teuthology.orchestra.run.smithi101.stdout: "time": "2023-08-01T19:55:05.574973+0000", 2023-08-01T19:55:13.156 INFO:teuthology.orchestra.run.smithi101.stdout: "duration": 8.6998999999999998e-05 2023-08-01T19:55:13.156 INFO:teuthology.orchestra.run.smithi101.stdout: }, 2023-08-01T19:55:13.156 INFO:teuthology.orchestra.run.smithi101.stdout: { 2023-08-01T19:55:13.156 INFO:teuthology.orchestra.run.smithi101.stdout: "event": "op_commit", 2023-08-01T19:55:13.156 INFO:teuthology.orchestra.run.smithi101.stdout: "time": "2023-08-01T19:55:05.581580+0000", 2023-08-01T19:55:13.156 INFO:teuthology.orchestra.run.smithi101.stdout: "duration": 0.0066068790000000004 2023-08-01T19:55:13.156 INFO:teuthology.orchestra.run.smithi101.stdout: }, 2023-08-01T19:55:13.157 INFO:teuthology.orchestra.run.smithi101.stdout: { 2023-08-01T19:55:13.157 INFO:teuthology.orchestra.run.smithi101.stdout: "event": "sub_op_commit_rec", 2023-08-01T19:55:13.157 INFO:teuthology.orchestra.run.smithi101.stdout: "time": "2023-08-01T19:55:05.633422+0000", 2023-08-01T19:55:13.157 INFO:teuthology.orchestra.run.smithi101.stdout: "duration": 0.051841992000000003 2023-08-01T19:55:13.157 INFO:teuthology.orchestra.run.smithi101.stdout: }, 2023-08-01T19:55:13.157 INFO:teuthology.orchestra.run.smithi101.stdout: { 2023-08-01T19:55:13.157 INFO:teuthology.orchestra.run.smithi101.stdout: "event": "commit_sent", 2023-08-01T19:55:13.157 INFO:teuthology.orchestra.run.smithi101.stdout: "time": "2023-08-01T19:55:05.633461+0000", 2023-08-01T19:55:13.158 INFO:teuthology.orchestra.run.smithi101.stdout: "duration": 3.8330000000000001e-05 2023-08-01T19:55:13.158 INFO:teuthology.orchestra.run.smithi101.stdout: }, 2023-08-01T19:55:13.158 INFO:teuthology.orchestra.run.smithi101.stdout: { 2023-08-01T19:55:13.158 INFO:teuthology.orchestra.run.smithi101.stdout: "event": "done", 2023-08-01T19:55:13.158 INFO:teuthology.orchestra.run.smithi101.stdout: "time": "2023-08-01T19:55:05.633485+0000", 2023-08-01T19:55:13.158 INFO:teuthology.orchestra.run.smithi101.stdout: "duration": 2.4451e-05 2023-08-01T19:55:13.158 INFO:teuthology.orchestra.run.smithi101.stdout: } 2023-08-01T19:55:13.158 INFO:teuthology.orchestra.run.smithi101.stdout: ] 2023-08-01T19:55:13.159 INFO:teuthology.orchestra.run.smithi101.stdout: } 2023-08-01T19:55:13.159 INFO:teuthology.orchestra.run.smithi101.stdout: }, 2023-08-01T19:55:13.159 INFO:teuthology.orchestra.run.smithi101.stdout: { 2023-08-01T19:55:13.159 INFO:teuthology.orchestra.run.smithi101.stdout: "description": "osd_op(client.4668.0:107866 5.f 5:ffcbf9c4:::benchmark_data_smithi006_114134_object107865:head [set-alloc-hint object_size 65536 write_size 65536,write 0~65536] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e38)", 2023-08-01T19:55:13.159 INFO:teuthology.orchestra.run.smithi101.stdout: "initiated_at": "2023-08-01T19:55:09.280625+0000", 2023-08-01T19:55:13.159 INFO:teuthology.orchestra.run.smithi101.stdout: "age": 3.7227917769999999, 2023-08-01T19:55:13.159 INFO:teuthology.orchestra.run.smithi101.stdout: "duration": 0.069869799999999996, 2023-08-01T19:55:13.160 INFO:teuthology.orchestra.run.smithi101.stdout: "type_data": { 2023-08-01T19:55:13.160 INFO:teuthology.orchestra.run.smithi101.stdout: "flag_point": "commit sent; apply or cleanup", 2023-08-01T19:55:13.160 INFO:teuthology.orchestra.run.smithi101.stdout: "client_info": { 2023-08-01T19:55:13.160 INFO:teuthology.orchestra.run.smithi101.stdout: "client": "client.4668", 2023-08-01T19:55:13.160 INFO:teuthology.orchestra.run.smithi101.stdout: "client_addr": "172.21.15.6:0/1709472247", 2023-08-01T19:55:13.160 INFO:teuthology.orchestra.run.smithi101.stdout: "tid": 107866 2023-08-01T19:55:13.160 INFO:teuthology.orchestra.run.smithi101.stdout: }, 2023-08-01T19:55:13.160 INFO:teuthology.orchestra.run.smithi101.stdout: "events": [ 2023-08-01T19:55:13.161 INFO:teuthology.orchestra.run.smithi101.stdout: { 2023-08-01T19:55:13.161 INFO:teuthology.orchestra.run.smithi101.stdout: "event": "initiated", 2023-08-01T19:55:13.161 INFO:teuthology.orchestra.run.smithi101.stdout: "time": "2023-08-01T19:55:09.280625+0000", 2023-08-01T19:55:13.161 INFO:teuthology.orchestra.run.smithi101.stdout: "duration": 0 2023-08-01T19:55:13.161 INFO:teuthology.orchestra.run.smithi101.stdout: }, 2023-08-01T19:55:13.161 INFO:teuthology.orchestra.run.smithi101.stdout: { 2023-08-01T19:55:13.161 INFO:teuthology.orchestra.run.smithi101.stdout: "event": "throttled", 2023-08-01T19:55:13.161 INFO:teuthology.orchestra.run.smithi101.stdout: "time": "2023-08-01T19:55:09.280625+0000", 2023-08-01T19:55:13.162 INFO:teuthology.orchestra.run.smithi101.stdout: "duration": 0 2023-08-01T19:55:13.162 INFO:teuthology.orchestra.run.smithi101.stdout: }, 2023-08-01T19:55:13.162 INFO:teuthology.orchestra.run.smithi101.stdout: { 2023-08-01T19:55:13.162 INFO:teuthology.orchestra.run.smithi101.stdout: "event": "header_read", 2023-08-01T19:55:13.162 INFO:teuthology.orchestra.run.smithi101.stdout: "time": "2023-08-01T19:55:09.280624+0000", 2023-08-01T19:55:13.162 INFO:teuthology.orchestra.run.smithi101.stdout: "duration": 4294967295.999999 2023-08-01T19:55:13.162 INFO:teuthology.orchestra.run.smithi101.stdout: }, 2023-08-01T19:55:13.162 INFO:teuthology.orchestra.run.smithi101.stdout: { 2023-08-01T19:55:13.163 INFO:teuthology.orchestra.run.smithi101.stdout: "event": "all_read", 2023-08-01T19:55:13.163 INFO:teuthology.orchestra.run.smithi101.stdout: "time": "2023-08-01T19:55:09.280648+0000", 2023-08-01T19:55:13.163 INFO:teuthology.orchestra.run.smithi101.stdout: "duration": 2.3521999999999999e-05 2023-08-01T19:55:13.163 INFO:teuthology.orchestra.run.smithi101.stdout: }, 2023-08-01T19:55:13.163 INFO:teuthology.orchestra.run.smithi101.stdout: { 2023-08-01T19:55:13.163 INFO:teuthology.orchestra.run.smithi101.stdout: "event": "dispatched", 2023-08-01T19:55:13.163 INFO:teuthology.orchestra.run.smithi101.stdout: "time": "2023-08-01T19:55:09.280658+0000", 2023-08-01T19:55:13.163 INFO:teuthology.orchestra.run.smithi101.stdout: "duration": 9.8660000000000001e-06 2023-08-01T19:55:13.164 INFO:teuthology.orchestra.run.smithi101.stdout: }, 2023-08-01T19:55:13.164 INFO:teuthology.orchestra.run.smithi101.stdout: { 2023-08-01T19:55:13.164 INFO:teuthology.orchestra.run.smithi101.stdout: "event": "queued_for_pg", 2023-08-01T19:55:13.164 INFO:teuthology.orchestra.run.smithi101.stdout: "time": "2023-08-01T19:55:09.280663+0000", 2023-08-01T19:55:13.164 INFO:teuthology.orchestra.run.smithi101.stdout: "duration": 4.8369999999999996e-06 2023-08-01T19:55:13.164 INFO:teuthology.orchestra.run.smithi101.stdout: }, 2023-08-01T19:55:13.164 INFO:teuthology.orchestra.run.smithi101.stdout: { 2023-08-01T19:55:13.165 INFO:teuthology.orchestra.run.smithi101.stdout: "event": "reached_pg", 2023-08-01T19:55:13.165 INFO:teuthology.orchestra.run.smithi101.stdout: "time": "2023-08-01T19:55:09.280690+0000", 2023-08-01T19:55:13.165 INFO:teuthology.orchestra.run.smithi101.stdout: "duration": 2.7534000000000001e-05 2023-08-01T19:55:13.165 INFO:teuthology.orchestra.run.smithi101.stdout: }, 2023-08-01T19:55:13.165 INFO:teuthology.orchestra.run.smithi101.stdout: { 2023-08-01T19:55:13.165 INFO:teuthology.orchestra.run.smithi101.stdout: "event": "started", 2023-08-01T19:55:13.165 INFO:teuthology.orchestra.run.smithi101.stdout: "time": "2023-08-01T19:55:09.280825+0000", 2023-08-01T19:55:13.165 INFO:teuthology.orchestra.run.smithi101.stdout: "duration": 0.000135399 2023-08-01T19:55:13.166 INFO:teuthology.orchestra.run.smithi101.stdout: }, 2023-08-01T19:55:13.166 INFO:teuthology.orchestra.run.smithi101.stdout: { 2023-08-01T19:55:13.166 INFO:teuthology.orchestra.run.smithi101.stdout: "event": "waiting for subops from 2", 2023-08-01T19:55:13.166 INFO:teuthology.orchestra.run.smithi101.stdout: "time": "2023-08-01T19:55:09.280929+0000", 2023-08-01T19:55:13.166 INFO:teuthology.orchestra.run.smithi101.stdout: "duration": 0.000103328 2023-08-01T19:55:13.166 INFO:teuthology.orchestra.run.smithi101.stdout: }, 2023-08-01T19:55:13.166 INFO:teuthology.orchestra.run.smithi101.stdout: { 2023-08-01T19:55:13.166 INFO:teuthology.orchestra.run.smithi101.stdout: "event": "sub_op_commit_rec", 2023-08-01T19:55:13.167 INFO:teuthology.orchestra.run.smithi101.stdout: "time": "2023-08-01T19:55:09.348321+0000", 2023-08-01T19:55:13.167 INFO:teuthology.orchestra.run.smithi101.stdout: "duration": 0.067392176999999998 2023-08-01T19:55:13.167 INFO:teuthology.orchestra.run.smithi101.stdout: }, 2023-08-01T19:55:13.167 INFO:teuthology.orchestra.run.smithi101.stdout: { 2023-08-01T19:55:13.167 INFO:teuthology.orchestra.run.smithi101.stdout: "event": "op_commit", 2023-08-01T19:55:13.167 INFO:teuthology.orchestra.run.smithi101.stdout: "time": "2023-08-01T19:55:09.350431+0000", 2023-08-01T19:55:13.167 INFO:teuthology.orchestra.run.smithi101.stdout: "duration": 0.0021096980000000001 2023-08-01T19:55:13.168 INFO:teuthology.orchestra.run.smithi101.stdout: }, 2023-08-01T19:55:13.168 INFO:teuthology.orchestra.run.smithi101.stdout: { 2023-08-01T19:55:13.168 INFO:teuthology.orchestra.run.smithi101.stdout: "event": "commit_sent", 2023-08-01T19:55:13.168 INFO:teuthology.orchestra.run.smithi101.stdout: "time": "2023-08-01T19:55:09.350469+0000", 2023-08-01T19:55:13.168 INFO:teuthology.orchestra.run.smithi101.stdout: "duration": 3.8625999999999999e-05 2023-08-01T19:55:13.168 INFO:teuthology.orchestra.run.smithi101.stdout: }, 2023-08-01T19:55:13.168 INFO:teuthology.orchestra.run.smithi101.stdout: { 2023-08-01T19:55:13.168 INFO:teuthology.orchestra.run.smithi101.stdout: "event": "done", 2023-08-01T19:55:13.169 INFO:teuthology.orchestra.run.smithi101.stdout: "time": "2023-08-01T19:55:09.350495+0000", 2023-08-01T19:55:13.169 INFO:teuthology.orchestra.run.smithi101.stdout: "duration": 2.5698999999999999e-05 2023-08-01T19:55:13.169 INFO:teuthology.orchestra.run.smithi101.stdout: } 2023-08-01T19:55:13.169 INFO:teuthology.orchestra.run.smithi101.stdout: ] 2023-08-01T19:55:13.169 INFO:teuthology.orchestra.run.smithi101.stdout: } 2023-08-01T19:55:13.169 INFO:teuthology.orchestra.run.smithi101.stdout: }, 2023-08-01T19:55:13.169 INFO:teuthology.orchestra.run.smithi101.stdout: { 2023-08-01T19:55:13.170 INFO:teuthology.orchestra.run.smithi101.stdout: "description": "osd_op(client.4668.0:107867 5.f 5:ff29bbf7:::benchmark_data_smithi006_114134_object107866:head [set-alloc-hint object_size 65536 write_size 65536,write 0~65536] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e38)", 2023-08-01T19:55:13.170 INFO:teuthology.orchestra.run.smithi101.stdout: "initiated_at": "2023-08-01T19:55:09.280670+0000", 2023-08-01T19:55:13.170 INFO:teuthology.orchestra.run.smithi101.stdout: "age": 3.7227468429999999, 2023-08-01T19:55:13.170 INFO:teuthology.orchestra.run.smithi101.stdout: "duration": 0.069898092999999994, 2023-08-01T19:55:13.170 INFO:teuthology.orchestra.run.smithi101.stdout: "type_data": { 2023-08-01T19:55:13.170 INFO:teuthology.orchestra.run.smithi101.stdout: "flag_point": "commit sent; apply or cleanup", 2023-08-01T19:55:13.170 INFO:teuthology.orchestra.run.smithi101.stdout: "client_info": { 2023-08-01T19:55:13.170 INFO:teuthology.orchestra.run.smithi101.stdout: "client": "client.4668", 2023-08-01T19:55:13.171 INFO:teuthology.orchestra.run.smithi101.stdout: "client_addr": "172.21.15.6:0/1709472247", 2023-08-01T19:55:13.171 INFO:teuthology.orchestra.run.smithi101.stdout: "tid": 107867 2023-08-01T19:55:13.171 INFO:teuthology.orchestra.run.smithi101.stdout: }, 2023-08-01T19:55:13.171 INFO:teuthology.orchestra.run.smithi101.stdout: "events": [ 2023-08-01T19:55:13.171 INFO:teuthology.orchestra.run.smithi101.stdout: { 2023-08-01T19:55:13.171 INFO:teuthology.orchestra.run.smithi101.stdout: "event": "initiated", 2023-08-01T19:55:13.171 INFO:teuthology.orchestra.run.smithi101.stdout: "time": "2023-08-01T19:55:09.280670+0000", 2023-08-01T19:55:13.171 INFO:teuthology.orchestra.run.smithi101.stdout: "duration": 0 2023-08-01T19:55:13.172 INFO:teuthology.orchestra.run.smithi101.stdout: }, 2023-08-01T19:55:13.172 INFO:teuthology.orchestra.run.smithi101.stdout: { 2023-08-01T19:55:13.172 INFO:teuthology.orchestra.run.smithi101.stdout: "event": "throttled", 2023-08-01T19:55:13.172 INFO:teuthology.orchestra.run.smithi101.stdout: "time": "2023-08-01T19:55:09.280670+0000", 2023-08-01T19:55:13.172 INFO:teuthology.orchestra.run.smithi101.stdout: "duration": 0 2023-08-01T19:55:13.172 INFO:teuthology.orchestra.run.smithi101.stdout: }, 2023-08-01T19:55:13.172 INFO:teuthology.orchestra.run.smithi101.stdout: { 2023-08-01T19:55:13.172 INFO:teuthology.orchestra.run.smithi101.stdout: "event": "header_read", 2023-08-01T19:55:13.173 INFO:teuthology.orchestra.run.smithi101.stdout: "time": "2023-08-01T19:55:09.280670+0000", 2023-08-01T19:55:13.173 INFO:teuthology.orchestra.run.smithi101.stdout: "duration": 4294967295.9999995 2023-08-01T19:55:13.173 INFO:teuthology.orchestra.run.smithi101.stdout: }, 2023-08-01T19:55:13.173 INFO:teuthology.orchestra.run.smithi101.stdout: { 2023-08-01T19:55:13.173 INFO:teuthology.orchestra.run.smithi101.stdout: "event": "all_read", 2023-08-01T19:55:13.173 INFO:teuthology.orchestra.run.smithi101.stdout: "time": "2023-08-01T19:55:09.280690+0000", 2023-08-01T19:55:13.173 INFO:teuthology.orchestra.run.smithi101.stdout: "duration": 2.0526e-05 2023-08-01T19:55:13.174 INFO:teuthology.orchestra.run.smithi101.stdout: }, 2023-08-01T19:55:13.174 INFO:teuthology.orchestra.run.smithi101.stdout: { 2023-08-01T19:55:13.174 INFO:teuthology.orchestra.run.smithi101.stdout: "event": "dispatched", 2023-08-01T19:55:13.174 INFO:teuthology.orchestra.run.smithi101.stdout: "time": "2023-08-01T19:55:09.280695+0000", 2023-08-01T19:55:13.174 INFO:teuthology.orchestra.run.smithi101.stdout: "duration": 4.5140000000000003e-06 2023-08-01T19:55:13.174 INFO:teuthology.orchestra.run.smithi101.stdout: }, 2023-08-01T19:55:13.174 INFO:teuthology.orchestra.run.smithi101.stdout: { 2023-08-01T19:55:13.174 INFO:teuthology.orchestra.run.smithi101.stdout: "event": "queued_for_pg", 2023-08-01T19:55:13.175 INFO:teuthology.orchestra.run.smithi101.stdout: "time": "2023-08-01T19:55:09.280697+0000", 2023-08-01T19:55:13.175 INFO:teuthology.orchestra.run.smithi101.stdout: "duration": 2.6290000000000002e-06 2023-08-01T19:55:13.175 INFO:teuthology.orchestra.run.smithi101.stdout: }, 2023-08-01T19:55:13.175 INFO:teuthology.orchestra.run.smithi101.stdout: { 2023-08-01T19:55:13.175 INFO:teuthology.orchestra.run.smithi101.stdout: "event": "reached_pg", 2023-08-01T19:55:13.175 INFO:teuthology.orchestra.run.smithi101.stdout: "time": "2023-08-01T19:55:09.282392+0000", 2023-08-01T19:55:13.175 INFO:teuthology.orchestra.run.smithi101.stdout: "duration": 0.0016948709999999999 2023-08-01T19:55:13.175 INFO:teuthology.orchestra.run.smithi101.stdout: }, 2023-08-01T19:55:13.176 INFO:teuthology.orchestra.run.smithi101.stdout: { 2023-08-01T19:55:13.176 INFO:teuthology.orchestra.run.smithi101.stdout: "event": "started", 2023-08-01T19:55:13.176 INFO:teuthology.orchestra.run.smithi101.stdout: "time": "2023-08-01T19:55:09.282514+0000", 2023-08-01T19:55:13.176 INFO:teuthology.orchestra.run.smithi101.stdout: "duration": 0.000121839 2023-08-01T19:55:13.176 INFO:teuthology.orchestra.run.smithi101.stdout: }, 2023-08-01T19:55:13.176 INFO:teuthology.orchestra.run.smithi101.stdout: { 2023-08-01T19:55:13.176 INFO:teuthology.orchestra.run.smithi101.stdout: "event": "waiting for subops from 2", 2023-08-01T19:55:13.176 INFO:teuthology.orchestra.run.smithi101.stdout: "time": "2023-08-01T19:55:09.282664+0000", 2023-08-01T19:55:13.177 INFO:teuthology.orchestra.run.smithi101.stdout: "duration": 0.00014968699999999999 2023-08-01T19:55:13.177 INFO:teuthology.orchestra.run.smithi101.stdout: }, 2023-08-01T19:55:13.177 INFO:teuthology.orchestra.run.smithi101.stdout: { 2023-08-01T19:55:13.177 INFO:teuthology.orchestra.run.smithi101.stdout: "event": "sub_op_commit_rec", 2023-08-01T19:55:13.177 INFO:teuthology.orchestra.run.smithi101.stdout: "time": "2023-08-01T19:55:09.348344+0000", 2023-08-01T19:55:13.177 INFO:teuthology.orchestra.run.smithi101.stdout: "duration": 0.065680247999999997 2023-08-01T19:55:13.177 INFO:teuthology.orchestra.run.smithi101.stdout: }, 2023-08-01T19:55:13.178 INFO:teuthology.orchestra.run.smithi101.stdout: { 2023-08-01T19:55:13.178 INFO:teuthology.orchestra.run.smithi101.stdout: "event": "op_commit", 2023-08-01T19:55:13.178 INFO:teuthology.orchestra.run.smithi101.stdout: "time": "2023-08-01T19:55:09.350502+0000", 2023-08-01T19:55:13.178 INFO:teuthology.orchestra.run.smithi101.stdout: "duration": 0.0021578140000000001 2023-08-01T19:55:13.178 INFO:teuthology.orchestra.run.smithi101.stdout: }, 2023-08-01T19:55:13.178 INFO:teuthology.orchestra.run.smithi101.stdout: { 2023-08-01T19:55:13.178 INFO:teuthology.orchestra.run.smithi101.stdout: "event": "commit_sent", 2023-08-01T19:55:13.179 INFO:teuthology.orchestra.run.smithi101.stdout: "time": "2023-08-01T19:55:09.350529+0000", 2023-08-01T19:55:13.179 INFO:teuthology.orchestra.run.smithi101.stdout: "duration": 2.6838e-05 2023-08-01T19:55:13.179 INFO:teuthology.orchestra.run.smithi101.stdout: }, 2023-08-01T19:55:13.179 INFO:teuthology.orchestra.run.smithi101.stdout: { 2023-08-01T19:55:13.179 INFO:teuthology.orchestra.run.smithi101.stdout: "event": "done", 2023-08-01T19:55:13.179 INFO:teuthology.orchestra.run.smithi101.stdout: "time": "2023-08-01T19:55:09.350568+0000", 2023-08-01T19:55:13.179 INFO:teuthology.orchestra.run.smithi101.stdout: "duration": 3.9477000000000002e-05 2023-08-01T19:55:13.179 INFO:teuthology.orchestra.run.smithi101.stdout: } 2023-08-01T19:55:13.180 INFO:teuthology.orchestra.run.smithi101.stdout: ] 2023-08-01T19:55:13.180 INFO:teuthology.orchestra.run.smithi101.stdout: } 2023-08-01T19:55:13.180 INFO:teuthology.orchestra.run.smithi101.stdout: }, 2023-08-01T19:55:13.180 INFO:teuthology.orchestra.run.smithi101.stdout: { 2023-08-01T19:55:13.180 INFO:teuthology.orchestra.run.smithi101.stdout: "description": "osd_repop(client.4668.0:107863 5.3 e38/19 5:cbdd875a:::benchmark_data_smithi006_114134_object107862:head v 38'6829, mlcod=38'6826)", 2023-08-01T19:55:13.180 INFO:teuthology.orchestra.run.smithi101.stdout: "initiated_at": "2023-08-01T19:55:09.280747+0000", 2023-08-01T19:55:13.180 INFO:teuthology.orchestra.run.smithi101.stdout: "age": 3.722669894, 2023-08-01T19:55:13.181 INFO:teuthology.orchestra.run.smithi101.stdout: "duration": 0.069343305999999993, 2023-08-01T19:55:13.181 INFO:teuthology.orchestra.run.smithi101.stdout: "type_data": { 2023-08-01T19:55:13.181 INFO:teuthology.orchestra.run.smithi101.stdout: "flag_point": "commit sent; apply or cleanup", 2023-08-01T19:55:13.181 INFO:teuthology.orchestra.run.smithi101.stdout: "events": [ 2023-08-01T19:55:13.181 INFO:teuthology.orchestra.run.smithi101.stdout: { 2023-08-01T19:55:13.181 INFO:teuthology.orchestra.run.smithi101.stdout: "event": "initiated", 2023-08-01T19:55:13.181 INFO:teuthology.orchestra.run.smithi101.stdout: "time": "2023-08-01T19:55:09.280747+0000", 2023-08-01T19:55:13.181 INFO:teuthology.orchestra.run.smithi101.stdout: "duration": 0 2023-08-01T19:55:13.182 INFO:teuthology.orchestra.run.smithi101.stdout: }, 2023-08-01T19:55:13.182 INFO:teuthology.orchestra.run.smithi101.stdout: { 2023-08-01T19:55:13.182 INFO:teuthology.orchestra.run.smithi101.stdout: "event": "throttled", 2023-08-01T19:55:13.182 INFO:teuthology.orchestra.run.smithi101.stdout: "time": "2023-08-01T19:55:09.280747+0000", 2023-08-01T19:55:13.182 INFO:teuthology.orchestra.run.smithi101.stdout: "duration": 0 2023-08-01T19:55:13.182 INFO:teuthology.orchestra.run.smithi101.stdout: }, 2023-08-01T19:55:13.182 INFO:teuthology.orchestra.run.smithi101.stdout: { 2023-08-01T19:55:13.182 INFO:teuthology.orchestra.run.smithi101.stdout: "event": "header_read", 2023-08-01T19:55:13.183 INFO:teuthology.orchestra.run.smithi101.stdout: "time": "2023-08-01T19:55:09.280746+0000", 2023-08-01T19:55:13.183 INFO:teuthology.orchestra.run.smithi101.stdout: "duration": 4294967295.9999995 2023-08-01T19:55:13.183 INFO:teuthology.orchestra.run.smithi101.stdout: }, 2023-08-01T19:55:13.183 INFO:teuthology.orchestra.run.smithi101.stdout: { 2023-08-01T19:55:13.183 INFO:teuthology.orchestra.run.smithi101.stdout: "event": "all_read", 2023-08-01T19:55:13.183 INFO:teuthology.orchestra.run.smithi101.stdout: "time": "2023-08-01T19:55:09.280798+0000", 2023-08-01T19:55:13.183 INFO:teuthology.orchestra.run.smithi101.stdout: "duration": 5.1706000000000003e-05 2023-08-01T19:55:13.184 INFO:teuthology.orchestra.run.smithi101.stdout: }, 2023-08-01T19:55:13.184 INFO:teuthology.orchestra.run.smithi101.stdout: { 2023-08-01T19:55:13.184 INFO:teuthology.orchestra.run.smithi101.stdout: "event": "dispatched", 2023-08-01T19:55:13.184 INFO:teuthology.orchestra.run.smithi101.stdout: "time": "2023-08-01T19:55:09.280807+0000", 2023-08-01T19:55:13.184 INFO:teuthology.orchestra.run.smithi101.stdout: "duration": 8.4889999999999995e-06 2023-08-01T19:55:13.184 INFO:teuthology.orchestra.run.smithi101.stdout: }, 2023-08-01T19:55:13.184 INFO:teuthology.orchestra.run.smithi101.stdout: { 2023-08-01T19:55:13.185 INFO:teuthology.orchestra.run.smithi101.stdout: "event": "queued_for_pg", 2023-08-01T19:55:13.185 INFO:teuthology.orchestra.run.smithi101.stdout: "time": "2023-08-01T19:55:09.280812+0000", 2023-08-01T19:55:13.185 INFO:teuthology.orchestra.run.smithi101.stdout: "duration": 5.2120000000000002e-06 2023-08-01T19:55:13.185 INFO:teuthology.orchestra.run.smithi101.stdout: }, 2023-08-01T19:55:13.185 INFO:teuthology.orchestra.run.smithi101.stdout: { 2023-08-01T19:55:13.185 INFO:teuthology.orchestra.run.smithi101.stdout: "event": "reached_pg", 2023-08-01T19:55:13.185 INFO:teuthology.orchestra.run.smithi101.stdout: "time": "2023-08-01T19:55:09.280843+0000", 2023-08-01T19:55:13.185 INFO:teuthology.orchestra.run.smithi101.stdout: "duration": 3.1406999999999999e-05 2023-08-01T19:55:13.186 INFO:teuthology.orchestra.run.smithi101.stdout: }, 2023-08-01T19:55:13.186 INFO:teuthology.orchestra.run.smithi101.stdout: { 2023-08-01T19:55:13.186 INFO:teuthology.orchestra.run.smithi101.stdout: "event": "started", 2023-08-01T19:55:13.186 INFO:teuthology.orchestra.run.smithi101.stdout: "time": "2023-08-01T19:55:09.280860+0000", 2023-08-01T19:55:13.186 INFO:teuthology.orchestra.run.smithi101.stdout: "duration": 1.6283999999999999e-05 2023-08-01T19:55:13.186 INFO:teuthology.orchestra.run.smithi101.stdout: }, 2023-08-01T19:55:13.186 INFO:teuthology.orchestra.run.smithi101.stdout: { 2023-08-01T19:55:13.186 INFO:teuthology.orchestra.run.smithi101.stdout: "event": "commit_sent", 2023-08-01T19:55:13.187 INFO:teuthology.orchestra.run.smithi101.stdout: "time": "2023-08-01T19:55:09.350059+0000", 2023-08-01T19:55:13.187 INFO:teuthology.orchestra.run.smithi101.stdout: "duration": 0.069199094000000003 2023-08-01T19:55:13.187 INFO:teuthology.orchestra.run.smithi101.stdout: }, 2023-08-01T19:55:13.187 INFO:teuthology.orchestra.run.smithi101.stdout: { 2023-08-01T19:55:13.187 INFO:teuthology.orchestra.run.smithi101.stdout: "event": "done", 2023-08-01T19:55:13.187 INFO:teuthology.orchestra.run.smithi101.stdout: "time": "2023-08-01T19:55:09.350090+0000", 2023-08-01T19:55:13.187 INFO:teuthology.orchestra.run.smithi101.stdout: "duration": 3.1736000000000002e-05 2023-08-01T19:55:13.187 INFO:teuthology.orchestra.run.smithi101.stdout: } 2023-08-01T19:55:13.188 INFO:teuthology.orchestra.run.smithi101.stdout: ] 2023-08-01T19:55:13.188 INFO:teuthology.orchestra.run.smithi101.stdout: } 2023-08-01T19:55:13.188 INFO:teuthology.orchestra.run.smithi101.stdout: }, 2023-08-01T19:55:13.188 INFO:teuthology.orchestra.run.smithi101.stdout: { 2023-08-01T19:55:13.188 INFO:teuthology.orchestra.run.smithi101.stdout: "description": "osd_repop(client.4668.0:107865 5.3 e38/19 5:c2ebb96d:::benchmark_data_smithi006_114134_object107864:head v 38'6830, mlcod=38'6826)", 2023-08-01T19:55:13.188 INFO:teuthology.orchestra.run.smithi101.stdout: "initiated_at": "2023-08-01T19:55:09.283182+0000", 2023-08-01T19:55:13.188 INFO:teuthology.orchestra.run.smithi101.stdout: "age": 3.7202345860000001, 2023-08-01T19:55:13.189 INFO:teuthology.orchestra.run.smithi101.stdout: "duration": 0.068554793000000003, 2023-08-01T19:55:13.189 INFO:teuthology.orchestra.run.smithi101.stdout: "type_data": { 2023-08-01T19:55:13.189 INFO:teuthology.orchestra.run.smithi101.stdout: "flag_point": "commit sent; apply or cleanup", 2023-08-01T19:55:13.189 INFO:teuthology.orchestra.run.smithi101.stdout: "events": [ 2023-08-01T19:55:13.189 INFO:teuthology.orchestra.run.smithi101.stdout: { 2023-08-01T19:55:13.189 INFO:teuthology.orchestra.run.smithi101.stdout: "event": "initiated", 2023-08-01T19:55:13.189 INFO:teuthology.orchestra.run.smithi101.stdout: "time": "2023-08-01T19:55:09.283182+0000", 2023-08-01T19:55:13.189 INFO:teuthology.orchestra.run.smithi101.stdout: "duration": 0 2023-08-01T19:55:13.190 INFO:teuthology.orchestra.run.smithi101.stdout: }, 2023-08-01T19:55:13.190 INFO:teuthology.orchestra.run.smithi101.stdout: { 2023-08-01T19:55:13.190 INFO:teuthology.orchestra.run.smithi101.stdout: "event": "throttled", 2023-08-01T19:55:13.190 INFO:teuthology.orchestra.run.smithi101.stdout: "time": "2023-08-01T19:55:09.283182+0000", 2023-08-01T19:55:13.190 INFO:teuthology.orchestra.run.smithi101.stdout: "duration": 0 2023-08-01T19:55:13.190 INFO:teuthology.orchestra.run.smithi101.stdout: }, 2023-08-01T19:55:13.190 INFO:teuthology.orchestra.run.smithi101.stdout: { 2023-08-01T19:55:13.190 INFO:teuthology.orchestra.run.smithi101.stdout: "event": "header_read", 2023-08-01T19:55:13.191 INFO:teuthology.orchestra.run.smithi101.stdout: "time": "2023-08-01T19:55:09.283182+0000", 2023-08-01T19:55:13.191 INFO:teuthology.orchestra.run.smithi101.stdout: "duration": 4294967295.9999995 2023-08-01T19:55:13.191 INFO:teuthology.orchestra.run.smithi101.stdout: }, 2023-08-01T19:55:13.191 INFO:teuthology.orchestra.run.smithi101.stdout: { 2023-08-01T19:55:13.191 INFO:teuthology.orchestra.run.smithi101.stdout: "event": "all_read", 2023-08-01T19:55:13.191 INFO:teuthology.orchestra.run.smithi101.stdout: "time": "2023-08-01T19:55:09.283233+0000", 2023-08-01T19:55:13.191 INFO:teuthology.orchestra.run.smithi101.stdout: "duration": 5.1511999999999997e-05 2023-08-01T19:55:13.191 INFO:teuthology.orchestra.run.smithi101.stdout: }, 2023-08-01T19:55:13.192 INFO:teuthology.orchestra.run.smithi101.stdout: { 2023-08-01T19:55:13.192 INFO:teuthology.orchestra.run.smithi101.stdout: "event": "dispatched", 2023-08-01T19:55:13.192 INFO:teuthology.orchestra.run.smithi101.stdout: "time": "2023-08-01T19:55:09.283239+0000", 2023-08-01T19:55:13.192 INFO:teuthology.orchestra.run.smithi101.stdout: "duration": 5.6640000000000003e-06 2023-08-01T19:55:13.192 INFO:teuthology.orchestra.run.smithi101.stdout: }, 2023-08-01T19:55:13.192 INFO:teuthology.orchestra.run.smithi101.stdout: { 2023-08-01T19:55:13.192 INFO:teuthology.orchestra.run.smithi101.stdout: "event": "queued_for_pg", 2023-08-01T19:55:13.193 INFO:teuthology.orchestra.run.smithi101.stdout: "time": "2023-08-01T19:55:09.283242+0000", 2023-08-01T19:55:13.193 INFO:teuthology.orchestra.run.smithi101.stdout: "duration": 2.9639999999999999e-06 2023-08-01T19:55:13.193 INFO:teuthology.orchestra.run.smithi101.stdout: }, 2023-08-01T19:55:13.193 INFO:teuthology.orchestra.run.smithi101.stdout: { 2023-08-01T19:55:13.193 INFO:teuthology.orchestra.run.smithi101.stdout: "event": "reached_pg", 2023-08-01T19:55:13.193 INFO:teuthology.orchestra.run.smithi101.stdout: "time": "2023-08-01T19:55:09.283276+0000", 2023-08-01T19:55:13.193 INFO:teuthology.orchestra.run.smithi101.stdout: "duration": 3.3631999999999999e-05 2023-08-01T19:55:13.193 INFO:teuthology.orchestra.run.smithi101.stdout: }, 2023-08-01T19:55:13.194 INFO:teuthology.orchestra.run.smithi101.stdout: { 2023-08-01T19:55:13.194 INFO:teuthology.orchestra.run.smithi101.stdout: "event": "started", 2023-08-01T19:55:13.194 INFO:teuthology.orchestra.run.smithi101.stdout: "time": "2023-08-01T19:55:09.283288+0000", 2023-08-01T19:55:13.194 INFO:teuthology.orchestra.run.smithi101.stdout: "duration": 1.1816e-05 2023-08-01T19:55:13.194 INFO:teuthology.orchestra.run.smithi101.stdout: }, 2023-08-01T19:55:13.194 INFO:teuthology.orchestra.run.smithi101.stdout: { 2023-08-01T19:55:13.194 INFO:teuthology.orchestra.run.smithi101.stdout: "event": "commit_sent", 2023-08-01T19:55:13.194 INFO:teuthology.orchestra.run.smithi101.stdout: "time": "2023-08-01T19:55:09.351712+0000", 2023-08-01T19:55:13.195 INFO:teuthology.orchestra.run.smithi101.stdout: "duration": 0.068424311000000002 2023-08-01T19:55:13.195 INFO:teuthology.orchestra.run.smithi101.stdout: }, 2023-08-01T19:55:13.195 INFO:teuthology.orchestra.run.smithi101.stdout: { 2023-08-01T19:55:13.195 INFO:teuthology.orchestra.run.smithi101.stdout: "event": "done", 2023-08-01T19:55:13.195 INFO:teuthology.orchestra.run.smithi101.stdout: "time": "2023-08-01T19:55:09.351737+0000", 2023-08-01T19:55:13.195 INFO:teuthology.orchestra.run.smithi101.stdout: "duration": 2.5364999999999999e-05 2023-08-01T19:55:13.195 INFO:teuthology.orchestra.run.smithi101.stdout: } 2023-08-01T19:55:13.195 INFO:teuthology.orchestra.run.smithi101.stdout: ] 2023-08-01T19:55:13.196 INFO:teuthology.orchestra.run.smithi101.stdout: } 2023-08-01T19:55:13.196 INFO:teuthology.orchestra.run.smithi101.stdout: }, 2023-08-01T19:55:13.196 INFO:teuthology.orchestra.run.smithi101.stdout: { 2023-08-01T19:55:13.196 INFO:teuthology.orchestra.run.smithi101.stdout: "description": "osd_repop(client.4668.0:107869 5.c e38/19 5:31910384:::benchmark_data_smithi006_114134_object107868:head v 38'6761, mlcod=38'6759)", 2023-08-01T19:55:13.196 INFO:teuthology.orchestra.run.smithi101.stdout: "initiated_at": "2023-08-01T19:55:09.283762+0000", 2023-08-01T19:55:13.196 INFO:teuthology.orchestra.run.smithi101.stdout: "age": 3.7196552499999997, 2023-08-01T19:55:13.196 INFO:teuthology.orchestra.run.smithi101.stdout: "duration": 0.067877541, 2023-08-01T19:55:13.197 INFO:teuthology.orchestra.run.smithi101.stdout: "type_data": { 2023-08-01T19:55:13.197 INFO:teuthology.orchestra.run.smithi101.stdout: "flag_point": "commit sent; apply or cleanup", 2023-08-01T19:55:13.197 INFO:teuthology.orchestra.run.smithi101.stdout: "events": [ 2023-08-01T19:55:13.197 INFO:teuthology.orchestra.run.smithi101.stdout: { 2023-08-01T19:55:13.197 INFO:teuthology.orchestra.run.smithi101.stdout: "event": "initiated", 2023-08-01T19:55:13.197 INFO:teuthology.orchestra.run.smithi101.stdout: "time": "2023-08-01T19:55:09.283762+0000", 2023-08-01T19:55:13.197 INFO:teuthology.orchestra.run.smithi101.stdout: "duration": 0 2023-08-01T19:55:13.197 INFO:teuthology.orchestra.run.smithi101.stdout: }, 2023-08-01T19:55:13.198 INFO:teuthology.orchestra.run.smithi101.stdout: { 2023-08-01T19:55:13.198 INFO:teuthology.orchestra.run.smithi101.stdout: "event": "throttled", 2023-08-01T19:55:13.198 INFO:teuthology.orchestra.run.smithi101.stdout: "time": "2023-08-01T19:55:09.283762+0000", 2023-08-01T19:55:13.198 INFO:teuthology.orchestra.run.smithi101.stdout: "duration": 0 2023-08-01T19:55:13.198 INFO:teuthology.orchestra.run.smithi101.stdout: }, 2023-08-01T19:55:13.198 INFO:teuthology.orchestra.run.smithi101.stdout: { 2023-08-01T19:55:13.198 INFO:teuthology.orchestra.run.smithi101.stdout: "event": "header_read", 2023-08-01T19:55:13.198 INFO:teuthology.orchestra.run.smithi101.stdout: "time": "2023-08-01T19:55:09.283761+0000", 2023-08-01T19:55:13.199 INFO:teuthology.orchestra.run.smithi101.stdout: "duration": 4294967295.9999995 2023-08-01T19:55:13.199 INFO:teuthology.orchestra.run.smithi101.stdout: }, 2023-08-01T19:55:13.199 INFO:teuthology.orchestra.run.smithi101.stdout: { 2023-08-01T19:55:13.199 INFO:teuthology.orchestra.run.smithi101.stdout: "event": "all_read", 2023-08-01T19:55:13.199 INFO:teuthology.orchestra.run.smithi101.stdout: "time": "2023-08-01T19:55:09.283825+0000", 2023-08-01T19:55:13.199 INFO:teuthology.orchestra.run.smithi101.stdout: "duration": 6.3200000000000005e-05 2023-08-01T19:55:13.199 INFO:teuthology.orchestra.run.smithi101.stdout: }, 2023-08-01T19:55:13.199 INFO:teuthology.orchestra.run.smithi101.stdout: { 2023-08-01T19:55:13.200 INFO:teuthology.orchestra.run.smithi101.stdout: "event": "dispatched", 2023-08-01T19:55:13.200 INFO:teuthology.orchestra.run.smithi101.stdout: "time": "2023-08-01T19:55:09.345759+0000", 2023-08-01T19:55:13.200 INFO:teuthology.orchestra.run.smithi101.stdout: "duration": 0.061934221999999997 2023-08-01T19:55:13.200 INFO:teuthology.orchestra.run.smithi101.stdout: }, 2023-08-01T19:55:13.200 INFO:teuthology.orchestra.run.smithi101.stdout: { 2023-08-01T19:55:13.200 INFO:teuthology.orchestra.run.smithi101.stdout: "event": "queued_for_pg", 2023-08-01T19:55:13.200 INFO:teuthology.orchestra.run.smithi101.stdout: "time": "2023-08-01T19:55:09.345768+0000", 2023-08-01T19:55:13.201 INFO:teuthology.orchestra.run.smithi101.stdout: "duration": 8.7099999999999996e-06 2023-08-01T19:55:13.201 INFO:teuthology.orchestra.run.smithi101.stdout: }, 2023-08-01T19:55:13.201 INFO:teuthology.orchestra.run.smithi101.stdout: { 2023-08-01T19:55:13.201 INFO:teuthology.orchestra.run.smithi101.stdout: "event": "reached_pg", 2023-08-01T19:55:13.201 INFO:teuthology.orchestra.run.smithi101.stdout: "time": "2023-08-01T19:55:09.345832+0000", 2023-08-01T19:55:13.201 INFO:teuthology.orchestra.run.smithi101.stdout: "duration": 6.4769000000000003e-05 2023-08-01T19:55:13.201 INFO:teuthology.orchestra.run.smithi101.stdout: }, 2023-08-01T19:55:13.201 INFO:teuthology.orchestra.run.smithi101.stdout: { 2023-08-01T19:55:13.202 INFO:teuthology.orchestra.run.smithi101.stdout: "event": "started", 2023-08-01T19:55:13.202 INFO:teuthology.orchestra.run.smithi101.stdout: "time": "2023-08-01T19:55:09.345851+0000", 2023-08-01T19:55:13.202 INFO:teuthology.orchestra.run.smithi101.stdout: "duration": 1.9049e-05 2023-08-01T19:55:13.202 INFO:teuthology.orchestra.run.smithi101.stdout: }, 2023-08-01T19:55:13.202 INFO:teuthology.orchestra.run.smithi101.stdout: { 2023-08-01T19:55:13.202 INFO:teuthology.orchestra.run.smithi101.stdout: "event": "commit_sent", 2023-08-01T19:55:13.202 INFO:teuthology.orchestra.run.smithi101.stdout: "time": "2023-08-01T19:55:09.351601+0000", 2023-08-01T19:55:13.202 INFO:teuthology.orchestra.run.smithi101.stdout: "duration": 0.0057499930000000001 2023-08-01T19:55:13.203 INFO:teuthology.orchestra.run.smithi101.stdout: }, 2023-08-01T19:55:13.203 INFO:teuthology.orchestra.run.smithi101.stdout: { 2023-08-01T19:55:13.203 INFO:teuthology.orchestra.run.smithi101.stdout: "event": "done", 2023-08-01T19:55:13.203 INFO:teuthology.orchestra.run.smithi101.stdout: "time": "2023-08-01T19:55:09.351639+0000", 2023-08-01T19:55:13.203 INFO:teuthology.orchestra.run.smithi101.stdout: "duration": 3.7941000000000001e-05 2023-08-01T19:55:13.203 INFO:teuthology.orchestra.run.smithi101.stdout: } 2023-08-01T19:55:13.203 INFO:teuthology.orchestra.run.smithi101.stdout: ] 2023-08-01T19:55:13.203 INFO:teuthology.orchestra.run.smithi101.stdout: } 2023-08-01T19:55:13.204 INFO:teuthology.orchestra.run.smithi101.stdout: }, 2023-08-01T19:55:13.204 INFO:teuthology.orchestra.run.smithi101.stdout: { 2023-08-01T19:55:13.204 INFO:teuthology.orchestra.run.smithi101.stdout: "description": "osd_op(client.4668.0:107876 5.1 5:8d2344a3:::benchmark_data_smithi006_114134_object107875:head [set-alloc-hint object_size 65536 write_size 65536,write 0~65536] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e38)", 2023-08-01T19:55:13.204 INFO:teuthology.orchestra.run.smithi101.stdout: "initiated_at": "2023-08-01T19:55:09.287802+0000", 2023-08-01T19:55:13.204 INFO:teuthology.orchestra.run.smithi101.stdout: "age": 3.7156149300000001, 2023-08-01T19:55:13.204 INFO:teuthology.orchestra.run.smithi101.stdout: "duration": 0.066738461999999998, 2023-08-01T19:55:13.204 INFO:teuthology.orchestra.run.smithi101.stdout: "type_data": { 2023-08-01T19:55:13.204 INFO:teuthology.orchestra.run.smithi101.stdout: "flag_point": "commit sent; apply or cleanup", 2023-08-01T19:55:13.205 INFO:teuthology.orchestra.run.smithi101.stdout: "client_info": { 2023-08-01T19:55:13.205 INFO:teuthology.orchestra.run.smithi101.stdout: "client": "client.4668", 2023-08-01T19:55:13.205 INFO:teuthology.orchestra.run.smithi101.stdout: "client_addr": "172.21.15.6:0/1709472247", 2023-08-01T19:55:13.205 INFO:teuthology.orchestra.run.smithi101.stdout: "tid": 107876 2023-08-01T19:55:13.205 INFO:teuthology.orchestra.run.smithi101.stdout: }, 2023-08-01T19:55:13.205 INFO:teuthology.orchestra.run.smithi101.stdout: "events": [ 2023-08-01T19:55:13.205 INFO:teuthology.orchestra.run.smithi101.stdout: { 2023-08-01T19:55:13.206 INFO:teuthology.orchestra.run.smithi101.stdout: "event": "initiated", 2023-08-01T19:55:13.206 INFO:teuthology.orchestra.run.smithi101.stdout: "time": "2023-08-01T19:55:09.287802+0000", 2023-08-01T19:55:13.206 INFO:teuthology.orchestra.run.smithi101.stdout: "duration": 0 2023-08-01T19:55:13.206 INFO:teuthology.orchestra.run.smithi101.stdout: }, 2023-08-01T19:55:13.206 INFO:teuthology.orchestra.run.smithi101.stdout: { 2023-08-01T19:55:13.206 INFO:teuthology.orchestra.run.smithi101.stdout: "event": "throttled", 2023-08-01T19:55:13.206 INFO:teuthology.orchestra.run.smithi101.stdout: "time": "2023-08-01T19:55:09.287802+0000", 2023-08-01T19:55:13.206 INFO:teuthology.orchestra.run.smithi101.stdout: "duration": 0 2023-08-01T19:55:13.207 INFO:teuthology.orchestra.run.smithi101.stdout: }, 2023-08-01T19:55:13.207 INFO:teuthology.orchestra.run.smithi101.stdout: { 2023-08-01T19:55:13.207 INFO:teuthology.orchestra.run.smithi101.stdout: "event": "header_read", 2023-08-01T19:55:13.207 INFO:teuthology.orchestra.run.smithi101.stdout: "time": "2023-08-01T19:55:09.287800+0000", 2023-08-01T19:55:13.207 INFO:teuthology.orchestra.run.smithi101.stdout: "duration": 4294967295.9999981 2023-08-01T19:55:13.207 INFO:teuthology.orchestra.run.smithi101.stdout: }, 2023-08-01T19:55:13.207 INFO:teuthology.orchestra.run.smithi101.stdout: { 2023-08-01T19:55:13.207 INFO:teuthology.orchestra.run.smithi101.stdout: "event": "all_read", 2023-08-01T19:55:13.208 INFO:teuthology.orchestra.run.smithi101.stdout: "time": "2023-08-01T19:55:09.287847+0000", 2023-08-01T19:55:13.208 INFO:teuthology.orchestra.run.smithi101.stdout: "duration": 4.6455999999999997e-05 2023-08-01T19:55:13.208 INFO:teuthology.orchestra.run.smithi101.stdout: }, 2023-08-01T19:55:13.208 INFO:teuthology.orchestra.run.smithi101.stdout: { 2023-08-01T19:55:13.208 INFO:teuthology.orchestra.run.smithi101.stdout: "event": "dispatched", 2023-08-01T19:55:13.208 INFO:teuthology.orchestra.run.smithi101.stdout: "time": "2023-08-01T19:55:09.345732+0000", 2023-08-01T19:55:13.208 INFO:teuthology.orchestra.run.smithi101.stdout: "duration": 0.057885955000000003 2023-08-01T19:55:13.209 INFO:teuthology.orchestra.run.smithi101.stdout: }, 2023-08-01T19:55:13.209 INFO:teuthology.orchestra.run.smithi101.stdout: { 2023-08-01T19:55:13.209 INFO:teuthology.orchestra.run.smithi101.stdout: "event": "queued_for_pg", 2023-08-01T19:55:13.209 INFO:teuthology.orchestra.run.smithi101.stdout: "time": "2023-08-01T19:55:09.345802+0000", 2023-08-01T19:55:13.209 INFO:teuthology.orchestra.run.smithi101.stdout: "duration": 6.9845000000000006e-05 2023-08-01T19:55:13.209 INFO:teuthology.orchestra.run.smithi101.stdout: }, 2023-08-01T19:55:13.209 INFO:teuthology.orchestra.run.smithi101.stdout: { 2023-08-01T19:55:13.209 INFO:teuthology.orchestra.run.smithi101.stdout: "event": "reached_pg", 2023-08-01T19:55:13.210 INFO:teuthology.orchestra.run.smithi101.stdout: "time": "2023-08-01T19:55:09.345841+0000", 2023-08-01T19:55:13.210 INFO:teuthology.orchestra.run.smithi101.stdout: "duration": 3.8719e-05 2023-08-01T19:55:13.210 INFO:teuthology.orchestra.run.smithi101.stdout: }, 2023-08-01T19:55:13.210 INFO:teuthology.orchestra.run.smithi101.stdout: { 2023-08-01T19:55:13.210 INFO:teuthology.orchestra.run.smithi101.stdout: "event": "started", 2023-08-01T19:55:13.210 INFO:teuthology.orchestra.run.smithi101.stdout: "time": "2023-08-01T19:55:09.345965+0000", 2023-08-01T19:55:13.210 INFO:teuthology.orchestra.run.smithi101.stdout: "duration": 0.00012353099999999999 2023-08-01T19:55:13.210 INFO:teuthology.orchestra.run.smithi101.stdout: }, 2023-08-01T19:55:13.211 INFO:teuthology.orchestra.run.smithi101.stdout: { 2023-08-01T19:55:13.211 INFO:teuthology.orchestra.run.smithi101.stdout: "event": "waiting for subops from 0", 2023-08-01T19:55:13.211 INFO:teuthology.orchestra.run.smithi101.stdout: "time": "2023-08-01T19:55:09.346113+0000", 2023-08-01T19:55:13.211 INFO:teuthology.orchestra.run.smithi101.stdout: "duration": 0.000148496 2023-08-01T19:55:13.211 INFO:teuthology.orchestra.run.smithi101.stdout: }, 2023-08-01T19:55:13.211 INFO:teuthology.orchestra.run.smithi101.stdout: { 2023-08-01T19:55:13.211 INFO:teuthology.orchestra.run.smithi101.stdout: "event": "sub_op_commit_rec", 2023-08-01T19:55:13.211 INFO:teuthology.orchestra.run.smithi101.stdout: "time": "2023-08-01T19:55:09.352561+0000", 2023-08-01T19:55:13.212 INFO:teuthology.orchestra.run.smithi101.stdout: "duration": 0.0064478890000000001 2023-08-01T19:55:13.212 INFO:teuthology.orchestra.run.smithi101.stdout: }, 2023-08-01T19:55:13.212 INFO:teuthology.orchestra.run.smithi101.stdout: { 2023-08-01T19:55:13.212 INFO:teuthology.orchestra.run.smithi101.stdout: "event": "op_commit", 2023-08-01T19:55:13.212 INFO:teuthology.orchestra.run.smithi101.stdout: "time": "2023-08-01T19:55:09.354475+0000", 2023-08-01T19:55:13.212 INFO:teuthology.orchestra.run.smithi101.stdout: "duration": 0.001913903 2023-08-01T19:55:13.212 INFO:teuthology.orchestra.run.smithi101.stdout: }, 2023-08-01T19:55:13.212 INFO:teuthology.orchestra.run.smithi101.stdout: { 2023-08-01T19:55:13.213 INFO:teuthology.orchestra.run.smithi101.stdout: "event": "commit_sent", 2023-08-01T19:55:13.213 INFO:teuthology.orchestra.run.smithi101.stdout: "time": "2023-08-01T19:55:09.354514+0000", 2023-08-01T19:55:13.213 INFO:teuthology.orchestra.run.smithi101.stdout: "duration": 3.8680999999999998e-05 2023-08-01T19:55:13.213 INFO:teuthology.orchestra.run.smithi101.stdout: }, 2023-08-01T19:55:13.213 INFO:teuthology.orchestra.run.smithi101.stdout: { 2023-08-01T19:55:13.213 INFO:teuthology.orchestra.run.smithi101.stdout: "event": "done", 2023-08-01T19:55:13.213 INFO:teuthology.orchestra.run.smithi101.stdout: "time": "2023-08-01T19:55:09.354541+0000", 2023-08-01T19:55:13.213 INFO:teuthology.orchestra.run.smithi101.stdout: "duration": 2.6976999999999999e-05 2023-08-01T19:55:13.214 INFO:teuthology.orchestra.run.smithi101.stdout: } 2023-08-01T19:55:13.214 INFO:teuthology.orchestra.run.smithi101.stdout: ] 2023-08-01T19:55:13.214 INFO:teuthology.orchestra.run.smithi101.stdout: } 2023-08-01T19:55:13.214 INFO:teuthology.orchestra.run.smithi101.stdout: } 2023-08-01T19:55:13.214 INFO:teuthology.orchestra.run.smithi101.stdout: ] 2023-08-01T19:55:13.214 INFO:teuthology.orchestra.run.smithi101.stdout:} 2023-08-01T19:55:13.216 DEBUG:teuthology.orchestra.run.smithi155:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 30 ceph --cluster ceph --admin-daemon /var/run/ceph/ceph-osd.2.asok dump_ops_in_flight 2023-08-01T19:55:13.216 INFO:tasks.ceph.osd.2.smithi155.stderr:2023-08-01T19:55:13.214+0000 7faa5c6ac700 -1 received signal: Hangup from /usr/bin/python3 /bin/daemon-helper kill ceph-osd -f --cluster ceph -i 2 (PID: 111337) UID: 0 2023-08-01T19:55:13.316 INFO:tasks.ceph.osd.1.smithi101.stderr:2023-08-01T19:55:13.315+0000 7fb0cb7f6700 -1 received signal: Hangup from /usr/bin/python3 /bin/daemon-helper kill ceph-osd -f --cluster ceph -i 1 (PID: 111141) UID: 0 2023-08-01T19:55:13.317 INFO:tasks.radosbench.radosbench.0.smithi006.stdout: 49 16 113421 113405 144.637 119.5 0.00883731 0.00691116 2023-08-01T19:55:13.388 INFO:teuthology.orchestra.run.smithi155.stdout:{ 2023-08-01T19:55:13.388 INFO:teuthology.orchestra.run.smithi155.stdout: "ops": [ 2023-08-01T19:55:13.388 INFO:teuthology.orchestra.run.smithi155.stdout: { 2023-08-01T19:55:13.388 INFO:teuthology.orchestra.run.smithi155.stdout: "description": "osd_op(client.4668.0:113539 5.b 5:d223a164:::benchmark_data_smithi006_114134_object113538:head [set-alloc-hint object_size 65536 write_size 65536,write 0~65536 in=65536b] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e42)", 2023-08-01T19:55:13.388 INFO:teuthology.orchestra.run.smithi155.stdout: "initiated_at": "2023-08-01T19:55:13.378214+0000", 2023-08-01T19:55:13.388 INFO:teuthology.orchestra.run.smithi155.stdout: "age": 0.007802481, 2023-08-01T19:55:13.389 INFO:teuthology.orchestra.run.smithi155.stdout: "duration": 0.0078315280000000008, 2023-08-01T19:55:13.389 INFO:teuthology.orchestra.run.smithi155.stdout: "type_data": { 2023-08-01T19:55:13.389 INFO:teuthology.orchestra.run.smithi155.stdout: "flag_point": "waiting for sub ops", 2023-08-01T19:55:13.389 INFO:teuthology.orchestra.run.smithi155.stdout: "client_info": { 2023-08-01T19:55:13.389 INFO:teuthology.orchestra.run.smithi155.stdout: "client": "client.4668", 2023-08-01T19:55:13.389 INFO:teuthology.orchestra.run.smithi155.stdout: "client_addr": "172.21.15.6:0/1709472247", 2023-08-01T19:55:13.389 INFO:teuthology.orchestra.run.smithi155.stdout: "tid": 113539 2023-08-01T19:55:13.390 INFO:teuthology.orchestra.run.smithi155.stdout: }, 2023-08-01T19:55:13.390 INFO:teuthology.orchestra.run.smithi155.stdout: "events": [ 2023-08-01T19:55:13.390 INFO:teuthology.orchestra.run.smithi155.stdout: { 2023-08-01T19:55:13.390 INFO:teuthology.orchestra.run.smithi155.stdout: "event": "initiated", 2023-08-01T19:55:13.390 INFO:teuthology.orchestra.run.smithi155.stdout: "time": "2023-08-01T19:55:13.378214+0000", 2023-08-01T19:55:13.390 INFO:teuthology.orchestra.run.smithi155.stdout: "duration": 0 2023-08-01T19:55:13.390 INFO:teuthology.orchestra.run.smithi155.stdout: }, 2023-08-01T19:55:13.390 INFO:teuthology.orchestra.run.smithi155.stdout: { 2023-08-01T19:55:13.391 INFO:teuthology.orchestra.run.smithi155.stdout: "event": "throttled", 2023-08-01T19:55:13.391 INFO:teuthology.orchestra.run.smithi155.stdout: "time": "2023-08-01T19:55:13.378214+0000", 2023-08-01T19:55:13.391 INFO:teuthology.orchestra.run.smithi155.stdout: "duration": 0 2023-08-01T19:55:13.391 INFO:teuthology.orchestra.run.smithi155.stdout: }, 2023-08-01T19:55:13.391 INFO:teuthology.orchestra.run.smithi155.stdout: { 2023-08-01T19:55:13.391 INFO:teuthology.orchestra.run.smithi155.stdout: "event": "header_read", 2023-08-01T19:55:13.391 INFO:teuthology.orchestra.run.smithi155.stdout: "time": "2023-08-01T19:55:13.378213+0000", 2023-08-01T19:55:13.392 INFO:teuthology.orchestra.run.smithi155.stdout: "duration": 4294967295.9999995 2023-08-01T19:55:13.392 INFO:teuthology.orchestra.run.smithi155.stdout: }, 2023-08-01T19:55:13.392 INFO:teuthology.orchestra.run.smithi155.stdout: { 2023-08-01T19:55:13.392 INFO:teuthology.orchestra.run.smithi155.stdout: "event": "all_read", 2023-08-01T19:55:13.392 INFO:teuthology.orchestra.run.smithi155.stdout: "time": "2023-08-01T19:55:13.378264+0000", 2023-08-01T19:55:13.392 INFO:teuthology.orchestra.run.smithi155.stdout: "duration": 5.1085999999999998e-05 2023-08-01T19:55:13.392 INFO:teuthology.orchestra.run.smithi155.stdout: }, 2023-08-01T19:55:13.393 INFO:teuthology.orchestra.run.smithi155.stdout: { 2023-08-01T19:55:13.393 INFO:teuthology.orchestra.run.smithi155.stdout: "event": "dispatched", 2023-08-01T19:55:13.393 INFO:teuthology.orchestra.run.smithi155.stdout: "time": "2023-08-01T19:55:13.378284+0000", 2023-08-01T19:55:13.393 INFO:teuthology.orchestra.run.smithi155.stdout: "duration": 1.9908999999999999e-05 2023-08-01T19:55:13.394 INFO:teuthology.orchestra.run.smithi155.stdout: }, 2023-08-01T19:55:13.394 INFO:teuthology.orchestra.run.smithi155.stdout: { 2023-08-01T19:55:13.394 INFO:teuthology.orchestra.run.smithi155.stdout: "event": "queued_for_pg", 2023-08-01T19:55:13.394 INFO:teuthology.orchestra.run.smithi155.stdout: "time": "2023-08-01T19:55:13.378289+0000", 2023-08-01T19:55:13.394 INFO:teuthology.orchestra.run.smithi155.stdout: "duration": 4.6890000000000003e-06 2023-08-01T19:55:13.394 INFO:teuthology.orchestra.run.smithi155.stdout: }, 2023-08-01T19:55:13.394 INFO:teuthology.orchestra.run.smithi155.stdout: { 2023-08-01T19:55:13.395 INFO:teuthology.orchestra.run.smithi155.stdout: "event": "reached_pg", 2023-08-01T19:55:13.395 INFO:teuthology.orchestra.run.smithi155.stdout: "time": "2023-08-01T19:55:13.378325+0000", 2023-08-01T19:55:13.395 INFO:teuthology.orchestra.run.smithi155.stdout: "duration": 3.5914000000000002e-05 2023-08-01T19:55:13.395 INFO:teuthology.orchestra.run.smithi155.stdout: }, 2023-08-01T19:55:13.395 INFO:teuthology.orchestra.run.smithi155.stdout: { 2023-08-01T19:55:13.395 INFO:teuthology.orchestra.run.smithi155.stdout: "event": "started", 2023-08-01T19:55:13.395 INFO:teuthology.orchestra.run.smithi155.stdout: "time": "2023-08-01T19:55:13.378442+0000", 2023-08-01T19:55:13.396 INFO:teuthology.orchestra.run.smithi155.stdout: "duration": 0.000117298 2023-08-01T19:55:13.396 INFO:teuthology.orchestra.run.smithi155.stdout: }, 2023-08-01T19:55:13.396 INFO:teuthology.orchestra.run.smithi155.stdout: { 2023-08-01T19:55:13.396 INFO:teuthology.orchestra.run.smithi155.stdout: "event": "waiting for subops from 0", 2023-08-01T19:55:13.396 INFO:teuthology.orchestra.run.smithi155.stdout: "time": "2023-08-01T19:55:13.378574+0000", 2023-08-01T19:55:13.396 INFO:teuthology.orchestra.run.smithi155.stdout: "duration": 0.00013223400000000001 2023-08-01T19:55:13.396 INFO:teuthology.orchestra.run.smithi155.stdout: }, 2023-08-01T19:55:13.396 INFO:teuthology.orchestra.run.smithi155.stdout: { 2023-08-01T19:55:13.397 INFO:teuthology.orchestra.run.smithi155.stdout: "event": "op_commit", 2023-08-01T19:55:13.397 INFO:teuthology.orchestra.run.smithi155.stdout: "time": "2023-08-01T19:55:13.383914+0000", 2023-08-01T19:55:13.397 INFO:teuthology.orchestra.run.smithi155.stdout: "duration": 0.0053401059999999998 2023-08-01T19:55:13.397 INFO:teuthology.orchestra.run.smithi155.stdout: } 2023-08-01T19:55:13.397 INFO:teuthology.orchestra.run.smithi155.stdout: ] 2023-08-01T19:55:13.397 INFO:teuthology.orchestra.run.smithi155.stdout: } 2023-08-01T19:55:13.398 INFO:teuthology.orchestra.run.smithi155.stdout: }, 2023-08-01T19:55:13.398 INFO:teuthology.orchestra.run.smithi155.stdout: { 2023-08-01T19:55:13.398 INFO:teuthology.orchestra.run.smithi155.stdout: "description": "osd_op(client.4668.0:113542 5.8 5:114e83f2:::benchmark_data_smithi006_114134_object113541:head [set-alloc-hint object_size 65536 write_size 65536,write 0~65536 in=65536b] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e42)", 2023-08-01T19:55:13.398 INFO:teuthology.orchestra.run.smithi155.stdout: "initiated_at": "2023-08-01T19:55:13.378961+0000", 2023-08-01T19:55:13.398 INFO:teuthology.orchestra.run.smithi155.stdout: "age": 0.0070550960000000003, 2023-08-01T19:55:13.398 INFO:teuthology.orchestra.run.smithi155.stdout: "duration": 0.0071783719999999997, 2023-08-01T19:55:13.398 INFO:teuthology.orchestra.run.smithi155.stdout: "type_data": { 2023-08-01T19:55:13.398 INFO:teuthology.orchestra.run.smithi155.stdout: "flag_point": "waiting for sub ops", 2023-08-01T19:55:13.399 INFO:teuthology.orchestra.run.smithi155.stdout: "client_info": { 2023-08-01T19:55:13.399 INFO:teuthology.orchestra.run.smithi155.stdout: "client": "client.4668", 2023-08-01T19:55:13.399 INFO:teuthology.orchestra.run.smithi155.stdout: "client_addr": "172.21.15.6:0/1709472247", 2023-08-01T19:55:13.399 INFO:teuthology.orchestra.run.smithi155.stdout: "tid": 113542 2023-08-01T19:55:13.399 INFO:teuthology.orchestra.run.smithi155.stdout: }, 2023-08-01T19:55:13.399 INFO:teuthology.orchestra.run.smithi155.stdout: "events": [ 2023-08-01T19:55:13.399 INFO:teuthology.orchestra.run.smithi155.stdout: { 2023-08-01T19:55:13.400 INFO:teuthology.orchestra.run.smithi155.stdout: "event": "initiated", 2023-08-01T19:55:13.400 INFO:teuthology.orchestra.run.smithi155.stdout: "time": "2023-08-01T19:55:13.378961+0000", 2023-08-01T19:55:13.400 INFO:teuthology.orchestra.run.smithi155.stdout: "duration": 0 2023-08-01T19:55:13.400 INFO:teuthology.orchestra.run.smithi155.stdout: }, 2023-08-01T19:55:13.400 INFO:teuthology.orchestra.run.smithi155.stdout: { 2023-08-01T19:55:13.400 INFO:teuthology.orchestra.run.smithi155.stdout: "event": "throttled", 2023-08-01T19:55:13.400 INFO:teuthology.orchestra.run.smithi155.stdout: "time": "2023-08-01T19:55:13.378961+0000", 2023-08-01T19:55:13.400 INFO:teuthology.orchestra.run.smithi155.stdout: "duration": 0 2023-08-01T19:55:13.401 INFO:teuthology.orchestra.run.smithi155.stdout: }, 2023-08-01T19:55:13.401 INFO:teuthology.orchestra.run.smithi155.stdout: { 2023-08-01T19:55:13.401 INFO:teuthology.orchestra.run.smithi155.stdout: "event": "header_read", 2023-08-01T19:55:13.401 INFO:teuthology.orchestra.run.smithi155.stdout: "time": "2023-08-01T19:55:13.378960+0000", 2023-08-01T19:55:13.401 INFO:teuthology.orchestra.run.smithi155.stdout: "duration": 4294967295.9999995 2023-08-01T19:55:13.401 INFO:teuthology.orchestra.run.smithi155.stdout: }, 2023-08-01T19:55:13.401 INFO:teuthology.orchestra.run.smithi155.stdout: { 2023-08-01T19:55:13.401 INFO:teuthology.orchestra.run.smithi155.stdout: "event": "all_read", 2023-08-01T19:55:13.402 INFO:teuthology.orchestra.run.smithi155.stdout: "time": "2023-08-01T19:55:13.378997+0000", 2023-08-01T19:55:13.402 INFO:teuthology.orchestra.run.smithi155.stdout: "duration": 3.6680000000000001e-05 2023-08-01T19:55:13.402 INFO:teuthology.orchestra.run.smithi155.stdout: }, 2023-08-01T19:55:13.402 INFO:teuthology.orchestra.run.smithi155.stdout: { 2023-08-01T19:55:13.402 INFO:teuthology.orchestra.run.smithi155.stdout: "event": "dispatched", 2023-08-01T19:55:13.402 INFO:teuthology.orchestra.run.smithi155.stdout: "time": "2023-08-01T19:55:13.379006+0000", 2023-08-01T19:55:13.402 INFO:teuthology.orchestra.run.smithi155.stdout: "duration": 9.0739999999999999e-06 2023-08-01T19:55:13.403 INFO:teuthology.orchestra.run.smithi155.stdout: }, 2023-08-01T19:55:13.403 INFO:teuthology.orchestra.run.smithi155.stdout: { 2023-08-01T19:55:13.403 INFO:teuthology.orchestra.run.smithi155.stdout: "event": "queued_for_pg", 2023-08-01T19:55:13.403 INFO:teuthology.orchestra.run.smithi155.stdout: "time": "2023-08-01T19:55:13.379012+0000", 2023-08-01T19:55:13.403 INFO:teuthology.orchestra.run.smithi155.stdout: "duration": 5.4530000000000001e-06 2023-08-01T19:55:13.403 INFO:teuthology.orchestra.run.smithi155.stdout: }, 2023-08-01T19:55:13.403 INFO:teuthology.orchestra.run.smithi155.stdout: { 2023-08-01T19:55:13.403 INFO:teuthology.orchestra.run.smithi155.stdout: "event": "reached_pg", 2023-08-01T19:55:13.404 INFO:teuthology.orchestra.run.smithi155.stdout: "time": "2023-08-01T19:55:13.379061+0000", 2023-08-01T19:55:13.404 INFO:teuthology.orchestra.run.smithi155.stdout: "duration": 4.9937e-05 2023-08-01T19:55:13.404 INFO:teuthology.orchestra.run.smithi155.stdout: }, 2023-08-01T19:55:13.404 INFO:teuthology.orchestra.run.smithi155.stdout: { 2023-08-01T19:55:13.404 INFO:teuthology.orchestra.run.smithi155.stdout: "event": "started", 2023-08-01T19:55:13.404 INFO:teuthology.orchestra.run.smithi155.stdout: "time": "2023-08-01T19:55:13.379197+0000", 2023-08-01T19:55:13.404 INFO:teuthology.orchestra.run.smithi155.stdout: "duration": 0.00013539100000000001 2023-08-01T19:55:13.404 INFO:teuthology.orchestra.run.smithi155.stdout: }, 2023-08-01T19:55:13.405 INFO:teuthology.orchestra.run.smithi155.stdout: { 2023-08-01T19:55:13.405 INFO:teuthology.orchestra.run.smithi155.stdout: "event": "waiting for subops from 0", 2023-08-01T19:55:13.405 INFO:teuthology.orchestra.run.smithi155.stdout: "time": "2023-08-01T19:55:13.379343+0000", 2023-08-01T19:55:13.405 INFO:teuthology.orchestra.run.smithi155.stdout: "duration": 0.000146525 2023-08-01T19:55:13.405 INFO:teuthology.orchestra.run.smithi155.stdout: }, 2023-08-01T19:55:13.405 INFO:teuthology.orchestra.run.smithi155.stdout: { 2023-08-01T19:55:13.405 INFO:teuthology.orchestra.run.smithi155.stdout: "event": "op_commit", 2023-08-01T19:55:13.406 INFO:teuthology.orchestra.run.smithi155.stdout: "time": "2023-08-01T19:55:13.383942+0000", 2023-08-01T19:55:13.406 INFO:teuthology.orchestra.run.smithi155.stdout: "duration": 0.0045984600000000004 2023-08-01T19:55:13.406 INFO:teuthology.orchestra.run.smithi155.stdout: } 2023-08-01T19:55:13.406 INFO:teuthology.orchestra.run.smithi155.stdout: ] 2023-08-01T19:55:13.406 INFO:teuthology.orchestra.run.smithi155.stdout: } 2023-08-01T19:55:13.406 INFO:teuthology.orchestra.run.smithi155.stdout: }, 2023-08-01T19:55:13.406 INFO:teuthology.orchestra.run.smithi155.stdout: { 2023-08-01T19:55:13.406 INFO:teuthology.orchestra.run.smithi155.stdout: "description": "osd_op(client.4668.0:113543 5.d 5:ba377af6:::benchmark_data_smithi006_114134_object113542:head [set-alloc-hint object_size 65536 write_size 65536,write 0~65536 in=65536b] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e42)", 2023-08-01T19:55:13.407 INFO:teuthology.orchestra.run.smithi155.stdout: "initiated_at": "2023-08-01T19:55:13.379024+0000", 2023-08-01T19:55:13.407 INFO:teuthology.orchestra.run.smithi155.stdout: "age": 0.0069926040000000004, 2023-08-01T19:55:13.407 INFO:teuthology.orchestra.run.smithi155.stdout: "duration": 0.0072118939999999999, 2023-08-01T19:55:13.407 INFO:teuthology.orchestra.run.smithi155.stdout: "type_data": { 2023-08-01T19:55:13.407 INFO:teuthology.orchestra.run.smithi155.stdout: "flag_point": "waiting for sub ops", 2023-08-01T19:55:13.407 INFO:teuthology.orchestra.run.smithi155.stdout: "client_info": { 2023-08-01T19:55:13.407 INFO:teuthology.orchestra.run.smithi155.stdout: "client": "client.4668", 2023-08-01T19:55:13.407 INFO:teuthology.orchestra.run.smithi155.stdout: "client_addr": "172.21.15.6:0/1709472247", 2023-08-01T19:55:13.408 INFO:teuthology.orchestra.run.smithi155.stdout: "tid": 113543 2023-08-01T19:55:13.408 INFO:teuthology.orchestra.run.smithi155.stdout: }, 2023-08-01T19:55:13.408 INFO:teuthology.orchestra.run.smithi155.stdout: "events": [ 2023-08-01T19:55:13.408 INFO:teuthology.orchestra.run.smithi155.stdout: { 2023-08-01T19:55:13.408 INFO:teuthology.orchestra.run.smithi155.stdout: "event": "initiated", 2023-08-01T19:55:13.408 INFO:teuthology.orchestra.run.smithi155.stdout: "time": "2023-08-01T19:55:13.379024+0000", 2023-08-01T19:55:13.408 INFO:teuthology.orchestra.run.smithi155.stdout: "duration": 0 2023-08-01T19:55:13.408 INFO:teuthology.orchestra.run.smithi155.stdout: }, 2023-08-01T19:55:13.409 INFO:teuthology.orchestra.run.smithi155.stdout: { 2023-08-01T19:55:13.409 INFO:teuthology.orchestra.run.smithi155.stdout: "event": "throttled", 2023-08-01T19:55:13.409 INFO:teuthology.orchestra.run.smithi155.stdout: "time": "2023-08-01T19:55:13.379024+0000", 2023-08-01T19:55:13.409 INFO:teuthology.orchestra.run.smithi155.stdout: "duration": 0 2023-08-01T19:55:13.409 INFO:teuthology.orchestra.run.smithi155.stdout: }, 2023-08-01T19:55:13.409 INFO:teuthology.orchestra.run.smithi155.stdout: { 2023-08-01T19:55:13.409 INFO:teuthology.orchestra.run.smithi155.stdout: "event": "header_read", 2023-08-01T19:55:13.410 INFO:teuthology.orchestra.run.smithi155.stdout: "time": "2023-08-01T19:55:13.379023+0000", 2023-08-01T19:55:13.410 INFO:teuthology.orchestra.run.smithi155.stdout: "duration": 4294967295.9999995 2023-08-01T19:55:13.410 INFO:teuthology.orchestra.run.smithi155.stdout: }, 2023-08-01T19:55:13.410 INFO:teuthology.orchestra.run.smithi155.stdout: { 2023-08-01T19:55:13.410 INFO:teuthology.orchestra.run.smithi155.stdout: "event": "all_read", 2023-08-01T19:55:13.410 INFO:teuthology.orchestra.run.smithi155.stdout: "time": "2023-08-01T19:55:13.379063+0000", 2023-08-01T19:55:13.410 INFO:teuthology.orchestra.run.smithi155.stdout: "duration": 3.9946e-05 2023-08-01T19:55:13.410 INFO:teuthology.orchestra.run.smithi155.stdout: }, 2023-08-01T19:55:13.411 INFO:teuthology.orchestra.run.smithi155.stdout: { 2023-08-01T19:55:13.411 INFO:teuthology.orchestra.run.smithi155.stdout: "event": "dispatched", 2023-08-01T19:55:13.411 INFO:teuthology.orchestra.run.smithi155.stdout: "time": "2023-08-01T19:55:13.379071+0000", 2023-08-01T19:55:13.411 INFO:teuthology.orchestra.run.smithi155.stdout: "duration": 7.7200000000000006e-06 2023-08-01T19:55:13.411 INFO:teuthology.orchestra.run.smithi155.stdout: }, 2023-08-01T19:55:13.411 INFO:teuthology.orchestra.run.smithi155.stdout: { 2023-08-01T19:55:13.411 INFO:teuthology.orchestra.run.smithi155.stdout: "event": "queued_for_pg", 2023-08-01T19:55:13.411 INFO:teuthology.orchestra.run.smithi155.stdout: "time": "2023-08-01T19:55:13.379076+0000", 2023-08-01T19:55:13.412 INFO:teuthology.orchestra.run.smithi155.stdout: "duration": 4.848e-06 2023-08-01T19:55:13.412 INFO:teuthology.orchestra.run.smithi155.stdout: }, 2023-08-01T19:55:13.412 INFO:teuthology.orchestra.run.smithi155.stdout: { 2023-08-01T19:55:13.412 INFO:teuthology.orchestra.run.smithi155.stdout: "event": "reached_pg", 2023-08-01T19:55:13.412 INFO:teuthology.orchestra.run.smithi155.stdout: "time": "2023-08-01T19:55:13.379236+0000", 2023-08-01T19:55:13.412 INFO:teuthology.orchestra.run.smithi155.stdout: "duration": 0.00016090000000000001 2023-08-01T19:55:13.412 INFO:teuthology.orchestra.run.smithi155.stdout: }, 2023-08-01T19:55:13.412 INFO:teuthology.orchestra.run.smithi155.stdout: { 2023-08-01T19:55:13.413 INFO:teuthology.orchestra.run.smithi155.stdout: "event": "started", 2023-08-01T19:55:13.413 INFO:teuthology.orchestra.run.smithi155.stdout: "time": "2023-08-01T19:55:13.379344+0000", 2023-08-01T19:55:13.413 INFO:teuthology.orchestra.run.smithi155.stdout: "duration": 0.000107545 2023-08-01T19:55:13.413 INFO:teuthology.orchestra.run.smithi155.stdout: }, 2023-08-01T19:55:13.413 INFO:teuthology.orchestra.run.smithi155.stdout: { 2023-08-01T19:55:13.413 INFO:teuthology.orchestra.run.smithi155.stdout: "event": "waiting for subops from 1", 2023-08-01T19:55:13.413 INFO:teuthology.orchestra.run.smithi155.stdout: "time": "2023-08-01T19:55:13.379470+0000", 2023-08-01T19:55:13.414 INFO:teuthology.orchestra.run.smithi155.stdout: "duration": 0.00012618899999999999 2023-08-01T19:55:13.414 INFO:teuthology.orchestra.run.smithi155.stdout: }, 2023-08-01T19:55:13.414 INFO:teuthology.orchestra.run.smithi155.stdout: { 2023-08-01T19:55:13.414 INFO:teuthology.orchestra.run.smithi155.stdout: "event": "op_commit", 2023-08-01T19:55:13.414 INFO:teuthology.orchestra.run.smithi155.stdout: "time": "2023-08-01T19:55:13.384032+0000", 2023-08-01T19:55:13.414 INFO:teuthology.orchestra.run.smithi155.stdout: "duration": 0.0045614139999999997 2023-08-01T19:55:13.414 INFO:teuthology.orchestra.run.smithi155.stdout: } 2023-08-01T19:55:13.414 INFO:teuthology.orchestra.run.smithi155.stdout: ] 2023-08-01T19:55:13.415 INFO:teuthology.orchestra.run.smithi155.stdout: } 2023-08-01T19:55:13.415 INFO:teuthology.orchestra.run.smithi155.stdout: }, 2023-08-01T19:55:13.415 INFO:teuthology.orchestra.run.smithi155.stdout: { 2023-08-01T19:55:13.415 INFO:teuthology.orchestra.run.smithi155.stdout: "description": "osd_op(client.4668.0:113544 5.f 5:fc7580e1:::benchmark_data_smithi006_114134_object113543:head [set-alloc-hint object_size 65536 write_size 65536,write 0~65536 in=65536b] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e42)", 2023-08-01T19:55:13.415 INFO:teuthology.orchestra.run.smithi155.stdout: "initiated_at": "2023-08-01T19:55:13.379087+0000", 2023-08-01T19:55:13.415 INFO:teuthology.orchestra.run.smithi155.stdout: "age": 0.0069291379999999996, 2023-08-01T19:55:13.415 INFO:teuthology.orchestra.run.smithi155.stdout: "duration": 0.0072344519999999997, 2023-08-01T19:55:13.416 INFO:teuthology.orchestra.run.smithi155.stdout: "type_data": { 2023-08-01T19:55:13.416 INFO:teuthology.orchestra.run.smithi155.stdout: "flag_point": "waiting for sub ops", 2023-08-01T19:55:13.416 INFO:teuthology.orchestra.run.smithi155.stdout: "client_info": { 2023-08-01T19:55:13.416 INFO:teuthology.orchestra.run.smithi155.stdout: "client": "client.4668", 2023-08-01T19:55:13.416 INFO:teuthology.orchestra.run.smithi155.stdout: "client_addr": "172.21.15.6:0/1709472247", 2023-08-01T19:55:13.416 INFO:teuthology.orchestra.run.smithi155.stdout: "tid": 113544 2023-08-01T19:55:13.416 INFO:teuthology.orchestra.run.smithi155.stdout: }, 2023-08-01T19:55:13.417 INFO:teuthology.orchestra.run.smithi155.stdout: "events": [ 2023-08-01T19:55:13.417 INFO:teuthology.orchestra.run.smithi155.stdout: { 2023-08-01T19:55:13.417 INFO:teuthology.orchestra.run.smithi155.stdout: "event": "initiated", 2023-08-01T19:55:13.417 INFO:teuthology.orchestra.run.smithi155.stdout: "time": "2023-08-01T19:55:13.379087+0000", 2023-08-01T19:55:13.417 INFO:teuthology.orchestra.run.smithi155.stdout: "duration": 0 2023-08-01T19:55:13.417 INFO:teuthology.orchestra.run.smithi155.stdout: }, 2023-08-01T19:55:13.417 INFO:teuthology.orchestra.run.smithi155.stdout: { 2023-08-01T19:55:13.417 INFO:teuthology.orchestra.run.smithi155.stdout: "event": "throttled", 2023-08-01T19:55:13.418 INFO:teuthology.orchestra.run.smithi155.stdout: "time": "2023-08-01T19:55:13.379087+0000", 2023-08-01T19:55:13.418 INFO:teuthology.orchestra.run.smithi155.stdout: "duration": 0 2023-08-01T19:55:13.418 INFO:teuthology.orchestra.run.smithi155.stdout: }, 2023-08-01T19:55:13.418 INFO:teuthology.orchestra.run.smithi155.stdout: { 2023-08-01T19:55:13.418 INFO:teuthology.orchestra.run.smithi155.stdout: "event": "header_read", 2023-08-01T19:55:13.418 INFO:teuthology.orchestra.run.smithi155.stdout: "time": "2023-08-01T19:55:13.379086+0000", 2023-08-01T19:55:13.418 INFO:teuthology.orchestra.run.smithi155.stdout: "duration": 4294967295.9999995 2023-08-01T19:55:13.418 INFO:teuthology.orchestra.run.smithi155.stdout: }, 2023-08-01T19:55:13.419 INFO:teuthology.orchestra.run.smithi155.stdout: { 2023-08-01T19:55:13.419 INFO:teuthology.orchestra.run.smithi155.stdout: "event": "all_read", 2023-08-01T19:55:13.419 INFO:teuthology.orchestra.run.smithi155.stdout: "time": "2023-08-01T19:55:13.379136+0000", 2023-08-01T19:55:13.419 INFO:teuthology.orchestra.run.smithi155.stdout: "duration": 4.9848000000000001e-05 2023-08-01T19:55:13.419 INFO:teuthology.orchestra.run.smithi155.stdout: }, 2023-08-01T19:55:13.419 INFO:teuthology.orchestra.run.smithi155.stdout: { 2023-08-01T19:55:13.419 INFO:teuthology.orchestra.run.smithi155.stdout: "event": "dispatched", 2023-08-01T19:55:13.419 INFO:teuthology.orchestra.run.smithi155.stdout: "time": "2023-08-01T19:55:13.379144+0000", 2023-08-01T19:55:13.420 INFO:teuthology.orchestra.run.smithi155.stdout: "duration": 7.6580000000000002e-06 2023-08-01T19:55:13.420 INFO:teuthology.orchestra.run.smithi155.stdout: }, 2023-08-01T19:55:13.420 INFO:teuthology.orchestra.run.smithi155.stdout: { 2023-08-01T19:55:13.420 INFO:teuthology.orchestra.run.smithi155.stdout: "event": "queued_for_pg", 2023-08-01T19:55:13.420 INFO:teuthology.orchestra.run.smithi155.stdout: "time": "2023-08-01T19:55:13.379149+0000", 2023-08-01T19:55:13.420 INFO:teuthology.orchestra.run.smithi155.stdout: "duration": 4.7489999999999998e-06 2023-08-01T19:55:13.420 INFO:teuthology.orchestra.run.smithi155.stdout: }, 2023-08-01T19:55:13.421 INFO:teuthology.orchestra.run.smithi155.stdout: { 2023-08-01T19:55:13.421 INFO:teuthology.orchestra.run.smithi155.stdout: "event": "reached_pg", 2023-08-01T19:55:13.421 INFO:teuthology.orchestra.run.smithi155.stdout: "time": "2023-08-01T19:55:13.381379+0000", 2023-08-01T19:55:13.421 INFO:teuthology.orchestra.run.smithi155.stdout: "duration": 0.0022300530000000001 2023-08-01T19:55:13.421 INFO:teuthology.orchestra.run.smithi155.stdout: }, 2023-08-01T19:55:13.421 INFO:teuthology.orchestra.run.smithi155.stdout: { 2023-08-01T19:55:13.421 INFO:teuthology.orchestra.run.smithi155.stdout: "event": "started", 2023-08-01T19:55:13.422 INFO:teuthology.orchestra.run.smithi155.stdout: "time": "2023-08-01T19:55:13.381574+0000", 2023-08-01T19:55:13.422 INFO:teuthology.orchestra.run.smithi155.stdout: "duration": 0.000195754 2023-08-01T19:55:13.422 INFO:teuthology.orchestra.run.smithi155.stdout: }, 2023-08-01T19:55:13.422 INFO:teuthology.orchestra.run.smithi155.stdout: { 2023-08-01T19:55:13.422 INFO:teuthology.orchestra.run.smithi155.stdout: "event": "waiting for subops from 1", 2023-08-01T19:55:13.422 INFO:teuthology.orchestra.run.smithi155.stdout: "time": "2023-08-01T19:55:13.381697+0000", 2023-08-01T19:55:13.422 INFO:teuthology.orchestra.run.smithi155.stdout: "duration": 0.00012259799999999999 2023-08-01T19:55:13.423 INFO:teuthology.orchestra.run.smithi155.stdout: }, 2023-08-01T19:55:13.423 INFO:teuthology.orchestra.run.smithi155.stdout: { 2023-08-01T19:55:13.423 INFO:teuthology.orchestra.run.smithi155.stdout: "event": "op_commit", 2023-08-01T19:55:13.423 INFO:teuthology.orchestra.run.smithi155.stdout: "time": "2023-08-01T19:55:13.385243+0000", 2023-08-01T19:55:13.423 INFO:teuthology.orchestra.run.smithi155.stdout: "duration": 0.0035456419999999999 2023-08-01T19:55:13.423 INFO:teuthology.orchestra.run.smithi155.stdout: } 2023-08-01T19:55:13.423 INFO:teuthology.orchestra.run.smithi155.stdout: ] 2023-08-01T19:55:13.423 INFO:teuthology.orchestra.run.smithi155.stdout: } 2023-08-01T19:55:13.424 INFO:teuthology.orchestra.run.smithi155.stdout: }, 2023-08-01T19:55:13.424 INFO:teuthology.orchestra.run.smithi155.stdout: { 2023-08-01T19:55:13.424 INFO:teuthology.orchestra.run.smithi155.stdout: "description": "osd_op(client.4668.0:113545 5.8 5:1bc399eb:::benchmark_data_smithi006_114134_object113544:head [set-alloc-hint object_size 65536 write_size 65536,write 0~65536 in=65536b] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e42)", 2023-08-01T19:55:13.424 INFO:teuthology.orchestra.run.smithi155.stdout: "initiated_at": "2023-08-01T19:55:13.379158+0000", 2023-08-01T19:55:13.424 INFO:teuthology.orchestra.run.smithi155.stdout: "age": 0.0068584989999999997, 2023-08-01T19:55:13.424 INFO:teuthology.orchestra.run.smithi155.stdout: "duration": 0.0072847980000000003, 2023-08-01T19:55:13.424 INFO:teuthology.orchestra.run.smithi155.stdout: "type_data": { 2023-08-01T19:55:13.424 INFO:teuthology.orchestra.run.smithi155.stdout: "flag_point": "waiting for sub ops", 2023-08-01T19:55:13.425 INFO:teuthology.orchestra.run.smithi155.stdout: "client_info": { 2023-08-01T19:55:13.425 INFO:teuthology.orchestra.run.smithi155.stdout: "client": "client.4668", 2023-08-01T19:55:13.425 INFO:teuthology.orchestra.run.smithi155.stdout: "client_addr": "172.21.15.6:0/1709472247", 2023-08-01T19:55:13.425 INFO:teuthology.orchestra.run.smithi155.stdout: "tid": 113545 2023-08-01T19:55:13.425 INFO:teuthology.orchestra.run.smithi155.stdout: }, 2023-08-01T19:55:13.425 INFO:teuthology.orchestra.run.smithi155.stdout: "events": [ 2023-08-01T19:55:13.425 INFO:teuthology.orchestra.run.smithi155.stdout: { 2023-08-01T19:55:13.425 INFO:teuthology.orchestra.run.smithi155.stdout: "event": "initiated", 2023-08-01T19:55:13.426 INFO:teuthology.orchestra.run.smithi155.stdout: "time": "2023-08-01T19:55:13.379158+0000", 2023-08-01T19:55:13.426 INFO:teuthology.orchestra.run.smithi155.stdout: "duration": 0 2023-08-01T19:55:13.426 INFO:teuthology.orchestra.run.smithi155.stdout: }, 2023-08-01T19:55:13.426 INFO:teuthology.orchestra.run.smithi155.stdout: { 2023-08-01T19:55:13.426 INFO:teuthology.orchestra.run.smithi155.stdout: "event": "throttled", 2023-08-01T19:55:13.426 INFO:teuthology.orchestra.run.smithi155.stdout: "time": "2023-08-01T19:55:13.379158+0000", 2023-08-01T19:55:13.426 INFO:teuthology.orchestra.run.smithi155.stdout: "duration": 0 2023-08-01T19:55:13.427 INFO:teuthology.orchestra.run.smithi155.stdout: }, 2023-08-01T19:55:13.427 INFO:teuthology.orchestra.run.smithi155.stdout: { 2023-08-01T19:55:13.427 INFO:teuthology.orchestra.run.smithi155.stdout: "event": "header_read", 2023-08-01T19:55:13.427 INFO:teuthology.orchestra.run.smithi155.stdout: "time": "2023-08-01T19:55:13.379157+0000", 2023-08-01T19:55:13.427 INFO:teuthology.orchestra.run.smithi155.stdout: "duration": 4294967295.9999995 2023-08-01T19:55:13.427 INFO:teuthology.orchestra.run.smithi155.stdout: }, 2023-08-01T19:55:13.427 INFO:teuthology.orchestra.run.smithi155.stdout: { 2023-08-01T19:55:13.427 INFO:teuthology.orchestra.run.smithi155.stdout: "event": "all_read", 2023-08-01T19:55:13.428 INFO:teuthology.orchestra.run.smithi155.stdout: "time": "2023-08-01T19:55:13.379190+0000", 2023-08-01T19:55:13.428 INFO:teuthology.orchestra.run.smithi155.stdout: "duration": 3.3300000000000003e-05 2023-08-01T19:55:13.428 INFO:teuthology.orchestra.run.smithi155.stdout: }, 2023-08-01T19:55:13.428 INFO:teuthology.orchestra.run.smithi155.stdout: { 2023-08-01T19:55:13.428 INFO:teuthology.orchestra.run.smithi155.stdout: "event": "dispatched", 2023-08-01T19:55:13.428 INFO:teuthology.orchestra.run.smithi155.stdout: "time": "2023-08-01T19:55:13.379198+0000", 2023-08-01T19:55:13.428 INFO:teuthology.orchestra.run.smithi155.stdout: "duration": 7.4229999999999999e-06 2023-08-01T19:55:13.428 INFO:teuthology.orchestra.run.smithi155.stdout: }, 2023-08-01T19:55:13.429 INFO:teuthology.orchestra.run.smithi155.stdout: { 2023-08-01T19:55:13.429 INFO:teuthology.orchestra.run.smithi155.stdout: "event": "queued_for_pg", 2023-08-01T19:55:13.429 INFO:teuthology.orchestra.run.smithi155.stdout: "time": "2023-08-01T19:55:13.379203+0000", 2023-08-01T19:55:13.429 INFO:teuthology.orchestra.run.smithi155.stdout: "duration": 4.7709999999999997e-06 2023-08-01T19:55:13.429 INFO:teuthology.orchestra.run.smithi155.stdout: }, 2023-08-01T19:55:13.429 INFO:teuthology.orchestra.run.smithi155.stdout: { 2023-08-01T19:55:13.429 INFO:teuthology.orchestra.run.smithi155.stdout: "event": "reached_pg", 2023-08-01T19:55:13.429 INFO:teuthology.orchestra.run.smithi155.stdout: "time": "2023-08-01T19:55:13.381134+0000", 2023-08-01T19:55:13.430 INFO:teuthology.orchestra.run.smithi155.stdout: "duration": 0.0019311899999999999 2023-08-01T19:55:13.430 INFO:teuthology.orchestra.run.smithi155.stdout: }, 2023-08-01T19:55:13.430 INFO:teuthology.orchestra.run.smithi155.stdout: { 2023-08-01T19:55:13.430 INFO:teuthology.orchestra.run.smithi155.stdout: "event": "started", 2023-08-01T19:55:13.430 INFO:teuthology.orchestra.run.smithi155.stdout: "time": "2023-08-01T19:55:13.381232+0000", 2023-08-01T19:55:13.430 INFO:teuthology.orchestra.run.smithi155.stdout: "duration": 9.7893000000000006e-05 2023-08-01T19:55:13.430 INFO:teuthology.orchestra.run.smithi155.stdout: }, 2023-08-01T19:55:13.431 INFO:teuthology.orchestra.run.smithi155.stdout: { 2023-08-01T19:55:13.431 INFO:teuthology.orchestra.run.smithi155.stdout: "event": "waiting for subops from 0", 2023-08-01T19:55:13.431 INFO:teuthology.orchestra.run.smithi155.stdout: "time": "2023-08-01T19:55:13.381323+0000", 2023-08-01T19:55:13.431 INFO:teuthology.orchestra.run.smithi155.stdout: "duration": 9.1351e-05 2023-08-01T19:55:13.431 INFO:teuthology.orchestra.run.smithi155.stdout: }, 2023-08-01T19:55:13.431 INFO:teuthology.orchestra.run.smithi155.stdout: { 2023-08-01T19:55:13.431 INFO:teuthology.orchestra.run.smithi155.stdout: "event": "op_commit", 2023-08-01T19:55:13.431 INFO:teuthology.orchestra.run.smithi155.stdout: "time": "2023-08-01T19:55:13.385218+0000", 2023-08-01T19:55:13.432 INFO:teuthology.orchestra.run.smithi155.stdout: "duration": 0.0038949010000000001 2023-08-01T19:55:13.432 INFO:teuthology.orchestra.run.smithi155.stdout: } 2023-08-01T19:55:13.432 INFO:teuthology.orchestra.run.smithi155.stdout: ] 2023-08-01T19:55:13.432 INFO:teuthology.orchestra.run.smithi155.stdout: } 2023-08-01T19:55:13.432 INFO:teuthology.orchestra.run.smithi155.stdout: }, 2023-08-01T19:55:13.432 INFO:teuthology.orchestra.run.smithi155.stdout: { 2023-08-01T19:55:13.432 INFO:teuthology.orchestra.run.smithi155.stdout: "description": "osd_op(client.4668.0:113547 5.d 5:b87230df:::benchmark_data_smithi006_114134_object113546:head [set-alloc-hint object_size 65536 write_size 65536,write 0~65536 in=65536b] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e42)", 2023-08-01T19:55:13.432 INFO:teuthology.orchestra.run.smithi155.stdout: "initiated_at": "2023-08-01T19:55:13.381213+0000", 2023-08-01T19:55:13.433 INFO:teuthology.orchestra.run.smithi155.stdout: "age": 0.0048036270000000004, 2023-08-01T19:55:13.433 INFO:teuthology.orchestra.run.smithi155.stdout: "duration": 0.0053201810000000002, 2023-08-01T19:55:13.433 INFO:teuthology.orchestra.run.smithi155.stdout: "type_data": { 2023-08-01T19:55:13.433 INFO:teuthology.orchestra.run.smithi155.stdout: "flag_point": "waiting for sub ops", 2023-08-01T19:55:13.433 INFO:teuthology.orchestra.run.smithi155.stdout: "client_info": { 2023-08-01T19:55:13.433 INFO:teuthology.orchestra.run.smithi155.stdout: "client": "client.4668", 2023-08-01T19:55:13.433 INFO:teuthology.orchestra.run.smithi155.stdout: "client_addr": "172.21.15.6:0/1709472247", 2023-08-01T19:55:13.434 INFO:teuthology.orchestra.run.smithi155.stdout: "tid": 113547 2023-08-01T19:55:13.434 INFO:teuthology.orchestra.run.smithi155.stdout: }, 2023-08-01T19:55:13.434 INFO:teuthology.orchestra.run.smithi155.stdout: "events": [ 2023-08-01T19:55:13.434 INFO:teuthology.orchestra.run.smithi155.stdout: { 2023-08-01T19:55:13.434 INFO:teuthology.orchestra.run.smithi155.stdout: "event": "initiated", 2023-08-01T19:55:13.434 INFO:teuthology.orchestra.run.smithi155.stdout: "time": "2023-08-01T19:55:13.381213+0000", 2023-08-01T19:55:13.434 INFO:teuthology.orchestra.run.smithi155.stdout: "duration": 0 2023-08-01T19:55:13.434 INFO:teuthology.orchestra.run.smithi155.stdout: }, 2023-08-01T19:55:13.435 INFO:teuthology.orchestra.run.smithi155.stdout: { 2023-08-01T19:55:13.435 INFO:teuthology.orchestra.run.smithi155.stdout: "event": "throttled", 2023-08-01T19:55:13.435 INFO:teuthology.orchestra.run.smithi155.stdout: "time": "2023-08-01T19:55:13.381213+0000", 2023-08-01T19:55:13.435 INFO:teuthology.orchestra.run.smithi155.stdout: "duration": 0 2023-08-01T19:55:13.435 INFO:teuthology.orchestra.run.smithi155.stdout: }, 2023-08-01T19:55:13.435 INFO:teuthology.orchestra.run.smithi155.stdout: { 2023-08-01T19:55:13.435 INFO:teuthology.orchestra.run.smithi155.stdout: "event": "header_read", 2023-08-01T19:55:13.436 INFO:teuthology.orchestra.run.smithi155.stdout: "time": "2023-08-01T19:55:13.381211+0000", 2023-08-01T19:55:13.436 INFO:teuthology.orchestra.run.smithi155.stdout: "duration": 4294967295.999999 2023-08-01T19:55:13.436 INFO:teuthology.orchestra.run.smithi155.stdout: }, 2023-08-01T19:55:13.436 INFO:teuthology.orchestra.run.smithi155.stdout: { 2023-08-01T19:55:13.436 INFO:teuthology.orchestra.run.smithi155.stdout: "event": "all_read", 2023-08-01T19:55:13.436 INFO:teuthology.orchestra.run.smithi155.stdout: "time": "2023-08-01T19:55:13.381242+0000", 2023-08-01T19:55:13.436 INFO:teuthology.orchestra.run.smithi155.stdout: "duration": 3.1034999999999997e-05 2023-08-01T19:55:13.436 INFO:teuthology.orchestra.run.smithi155.stdout: }, 2023-08-01T19:55:13.437 INFO:teuthology.orchestra.run.smithi155.stdout: { 2023-08-01T19:55:13.437 INFO:teuthology.orchestra.run.smithi155.stdout: "event": "dispatched", 2023-08-01T19:55:13.437 INFO:teuthology.orchestra.run.smithi155.stdout: "time": "2023-08-01T19:55:13.381253+0000", 2023-08-01T19:55:13.437 INFO:teuthology.orchestra.run.smithi155.stdout: "duration": 1.0648999999999999e-05 2023-08-01T19:55:13.437 INFO:teuthology.orchestra.run.smithi155.stdout: }, 2023-08-01T19:55:13.437 INFO:teuthology.orchestra.run.smithi155.stdout: { 2023-08-01T19:55:13.437 INFO:teuthology.orchestra.run.smithi155.stdout: "event": "queued_for_pg", 2023-08-01T19:55:13.437 INFO:teuthology.orchestra.run.smithi155.stdout: "time": "2023-08-01T19:55:13.381259+0000", 2023-08-01T19:55:13.438 INFO:teuthology.orchestra.run.smithi155.stdout: "duration": 5.8030000000000002e-06 2023-08-01T19:55:13.438 INFO:teuthology.orchestra.run.smithi155.stdout: }, 2023-08-01T19:55:13.438 INFO:teuthology.orchestra.run.smithi155.stdout: { 2023-08-01T19:55:13.438 INFO:teuthology.orchestra.run.smithi155.stdout: "event": "reached_pg", 2023-08-01T19:55:13.438 INFO:teuthology.orchestra.run.smithi155.stdout: "time": "2023-08-01T19:55:13.381694+0000", 2023-08-01T19:55:13.438 INFO:teuthology.orchestra.run.smithi155.stdout: "duration": 0.00043476399999999997 2023-08-01T19:55:13.438 INFO:teuthology.orchestra.run.smithi155.stdout: }, 2023-08-01T19:55:13.439 INFO:teuthology.orchestra.run.smithi155.stdout: { 2023-08-01T19:55:13.439 INFO:teuthology.orchestra.run.smithi155.stdout: "event": "started", 2023-08-01T19:55:13.439 INFO:teuthology.orchestra.run.smithi155.stdout: "time": "2023-08-01T19:55:13.381802+0000", 2023-08-01T19:55:13.439 INFO:teuthology.orchestra.run.smithi155.stdout: "duration": 0.000107829 2023-08-01T19:55:13.439 INFO:teuthology.orchestra.run.smithi155.stdout: }, 2023-08-01T19:55:13.439 INFO:teuthology.orchestra.run.smithi155.stdout: { 2023-08-01T19:55:13.439 INFO:teuthology.orchestra.run.smithi155.stdout: "event": "waiting for subops from 1", 2023-08-01T19:55:13.440 INFO:teuthology.orchestra.run.smithi155.stdout: "time": "2023-08-01T19:55:13.381945+0000", 2023-08-01T19:55:13.440 INFO:teuthology.orchestra.run.smithi155.stdout: "duration": 0.00014354299999999999 2023-08-01T19:55:13.440 INFO:teuthology.orchestra.run.smithi155.stdout: }, 2023-08-01T19:55:13.440 INFO:teuthology.orchestra.run.smithi155.stdout: { 2023-08-01T19:55:13.440 INFO:teuthology.orchestra.run.smithi155.stdout: "event": "op_commit", 2023-08-01T19:55:13.440 INFO:teuthology.orchestra.run.smithi155.stdout: "time": "2023-08-01T19:55:13.385261+0000", 2023-08-01T19:55:13.440 INFO:teuthology.orchestra.run.smithi155.stdout: "duration": 0.003315929 2023-08-01T19:55:13.440 INFO:teuthology.orchestra.run.smithi155.stdout: } 2023-08-01T19:55:13.441 INFO:teuthology.orchestra.run.smithi155.stdout: ] 2023-08-01T19:55:13.441 INFO:teuthology.orchestra.run.smithi155.stdout: } 2023-08-01T19:55:13.441 INFO:teuthology.orchestra.run.smithi155.stdout: }, 2023-08-01T19:55:13.441 INFO:teuthology.orchestra.run.smithi155.stdout: { 2023-08-01T19:55:13.441 INFO:teuthology.orchestra.run.smithi155.stdout: "description": "osd_op(client.4668.0:113550 5.4 5:2dfd8c4f:::benchmark_data_smithi006_114134_object113549:head [set-alloc-hint object_size 65536 write_size 65536,write 0~65536 in=65536b] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e42)", 2023-08-01T19:55:13.441 INFO:teuthology.orchestra.run.smithi155.stdout: "initiated_at": "2023-08-01T19:55:13.382512+0000", 2023-08-01T19:55:13.441 INFO:teuthology.orchestra.run.smithi155.stdout: "age": 0.0035045559999999998, 2023-08-01T19:55:13.441 INFO:teuthology.orchestra.run.smithi155.stdout: "duration": 0.0041019289999999998, 2023-08-01T19:55:13.442 INFO:teuthology.orchestra.run.smithi155.stdout: "type_data": { 2023-08-01T19:55:13.442 INFO:teuthology.orchestra.run.smithi155.stdout: "flag_point": "waiting for sub ops", 2023-08-01T19:55:13.442 INFO:teuthology.orchestra.run.smithi155.stdout: "client_info": { 2023-08-01T19:55:13.442 INFO:teuthology.orchestra.run.smithi155.stdout: "client": "client.4668", 2023-08-01T19:55:13.442 INFO:teuthology.orchestra.run.smithi155.stdout: "client_addr": "172.21.15.6:0/1709472247", 2023-08-01T19:55:13.442 INFO:teuthology.orchestra.run.smithi155.stdout: "tid": 113550 2023-08-01T19:55:13.442 INFO:teuthology.orchestra.run.smithi155.stdout: }, 2023-08-01T19:55:13.443 INFO:teuthology.orchestra.run.smithi155.stdout: "events": [ 2023-08-01T19:55:13.443 INFO:teuthology.orchestra.run.smithi155.stdout: { 2023-08-01T19:55:13.443 INFO:teuthology.orchestra.run.smithi155.stdout: "event": "initiated", 2023-08-01T19:55:13.443 INFO:teuthology.orchestra.run.smithi155.stdout: "time": "2023-08-01T19:55:13.382512+0000", 2023-08-01T19:55:13.443 INFO:teuthology.orchestra.run.smithi155.stdout: "duration": 0 2023-08-01T19:55:13.443 INFO:teuthology.orchestra.run.smithi155.stdout: }, 2023-08-01T19:55:13.443 INFO:teuthology.orchestra.run.smithi155.stdout: { 2023-08-01T19:55:13.444 INFO:teuthology.orchestra.run.smithi155.stdout: "event": "throttled", 2023-08-01T19:55:13.444 INFO:teuthology.orchestra.run.smithi155.stdout: "time": "2023-08-01T19:55:13.382512+0000", 2023-08-01T19:55:13.444 INFO:teuthology.orchestra.run.smithi155.stdout: "duration": 0 2023-08-01T19:55:13.444 INFO:teuthology.orchestra.run.smithi155.stdout: }, 2023-08-01T19:55:13.444 INFO:teuthology.orchestra.run.smithi155.stdout: { 2023-08-01T19:55:13.444 INFO:teuthology.orchestra.run.smithi155.stdout: "event": "header_read", 2023-08-01T19:55:13.444 INFO:teuthology.orchestra.run.smithi155.stdout: "time": "2023-08-01T19:55:13.382511+0000", 2023-08-01T19:55:13.445 INFO:teuthology.orchestra.run.smithi155.stdout: "duration": 4294967295.999999 2023-08-01T19:55:13.445 INFO:teuthology.orchestra.run.smithi155.stdout: }, 2023-08-01T19:55:13.445 INFO:teuthology.orchestra.run.smithi155.stdout: { 2023-08-01T19:55:13.445 INFO:teuthology.orchestra.run.smithi155.stdout: "event": "all_read", 2023-08-01T19:55:13.445 INFO:teuthology.orchestra.run.smithi155.stdout: "time": "2023-08-01T19:55:13.382583+0000", 2023-08-01T19:55:13.445 INFO:teuthology.orchestra.run.smithi155.stdout: "duration": 7.2117000000000001e-05 2023-08-01T19:55:13.445 INFO:teuthology.orchestra.run.smithi155.stdout: }, 2023-08-01T19:55:13.445 INFO:teuthology.orchestra.run.smithi155.stdout: { 2023-08-01T19:55:13.446 INFO:teuthology.orchestra.run.smithi155.stdout: "event": "dispatched", 2023-08-01T19:55:13.446 INFO:teuthology.orchestra.run.smithi155.stdout: "time": "2023-08-01T19:55:13.382594+0000", 2023-08-01T19:55:13.446 INFO:teuthology.orchestra.run.smithi155.stdout: "duration": 1.1178999999999999e-05 2023-08-01T19:55:13.446 INFO:teuthology.orchestra.run.smithi155.stdout: }, 2023-08-01T19:55:13.446 INFO:teuthology.orchestra.run.smithi155.stdout: { 2023-08-01T19:55:13.446 INFO:teuthology.orchestra.run.smithi155.stdout: "event": "queued_for_pg", 2023-08-01T19:55:13.446 INFO:teuthology.orchestra.run.smithi155.stdout: "time": "2023-08-01T19:55:13.382600+0000", 2023-08-01T19:55:13.446 INFO:teuthology.orchestra.run.smithi155.stdout: "duration": 5.6230000000000002e-06 2023-08-01T19:55:13.447 INFO:teuthology.orchestra.run.smithi155.stdout: }, 2023-08-01T19:55:13.447 INFO:teuthology.orchestra.run.smithi155.stdout: { 2023-08-01T19:55:13.447 INFO:teuthology.orchestra.run.smithi155.stdout: "event": "reached_pg", 2023-08-01T19:55:13.447 INFO:teuthology.orchestra.run.smithi155.stdout: "time": "2023-08-01T19:55:13.382650+0000", 2023-08-01T19:55:13.447 INFO:teuthology.orchestra.run.smithi155.stdout: "duration": 4.9942999999999999e-05 2023-08-01T19:55:13.447 INFO:teuthology.orchestra.run.smithi155.stdout: }, 2023-08-01T19:55:13.447 INFO:teuthology.orchestra.run.smithi155.stdout: { 2023-08-01T19:55:13.447 INFO:teuthology.orchestra.run.smithi155.stdout: "event": "started", 2023-08-01T19:55:13.448 INFO:teuthology.orchestra.run.smithi155.stdout: "time": "2023-08-01T19:55:13.382789+0000", 2023-08-01T19:55:13.448 INFO:teuthology.orchestra.run.smithi155.stdout: "duration": 0.00013935799999999999 2023-08-01T19:55:13.448 INFO:teuthology.orchestra.run.smithi155.stdout: }, 2023-08-01T19:55:13.448 INFO:teuthology.orchestra.run.smithi155.stdout: { 2023-08-01T19:55:13.448 INFO:teuthology.orchestra.run.smithi155.stdout: "event": "waiting for subops from 0", 2023-08-01T19:55:13.448 INFO:teuthology.orchestra.run.smithi155.stdout: "time": "2023-08-01T19:55:13.382943+0000", 2023-08-01T19:55:13.448 INFO:teuthology.orchestra.run.smithi155.stdout: "duration": 0.00015453900000000001 2023-08-01T19:55:13.448 INFO:teuthology.orchestra.run.smithi155.stdout: } 2023-08-01T19:55:13.449 INFO:teuthology.orchestra.run.smithi155.stdout: ] 2023-08-01T19:55:13.449 INFO:teuthology.orchestra.run.smithi155.stdout: } 2023-08-01T19:55:13.449 INFO:teuthology.orchestra.run.smithi155.stdout: }, 2023-08-01T19:55:13.449 INFO:teuthology.orchestra.run.smithi155.stdout: { 2023-08-01T19:55:13.449 INFO:teuthology.orchestra.run.smithi155.stdout: "description": "osd_op(client.4668.0:113551 5.0 5:095d49d3:::benchmark_data_smithi006_114134_object113550:head [set-alloc-hint object_size 65536 write_size 65536,write 0~65536 in=65536b] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e42)", 2023-08-01T19:55:13.449 INFO:teuthology.orchestra.run.smithi155.stdout: "initiated_at": "2023-08-01T19:55:13.383641+0000", 2023-08-01T19:55:13.449 INFO:teuthology.orchestra.run.smithi155.stdout: "age": 0.0023748329999999998, 2023-08-01T19:55:13.450 INFO:teuthology.orchestra.run.smithi155.stdout: "duration": 0.003057817, 2023-08-01T19:55:13.450 INFO:teuthology.orchestra.run.smithi155.stdout: "type_data": { 2023-08-01T19:55:13.450 INFO:teuthology.orchestra.run.smithi155.stdout: "flag_point": "waiting for sub ops", 2023-08-01T19:55:13.450 INFO:teuthology.orchestra.run.smithi155.stdout: "client_info": { 2023-08-01T19:55:13.450 INFO:teuthology.orchestra.run.smithi155.stdout: "client": "client.4668", 2023-08-01T19:55:13.450 INFO:teuthology.orchestra.run.smithi155.stdout: "client_addr": "172.21.15.6:0/1709472247", 2023-08-01T19:55:13.450 INFO:teuthology.orchestra.run.smithi155.stdout: "tid": 113551 2023-08-01T19:55:13.450 INFO:teuthology.orchestra.run.smithi155.stdout: }, 2023-08-01T19:55:13.451 INFO:teuthology.orchestra.run.smithi155.stdout: "events": [ 2023-08-01T19:55:13.451 INFO:teuthology.orchestra.run.smithi155.stdout: { 2023-08-01T19:55:13.451 INFO:teuthology.orchestra.run.smithi155.stdout: "event": "initiated", 2023-08-01T19:55:13.451 INFO:teuthology.orchestra.run.smithi155.stdout: "time": "2023-08-01T19:55:13.383641+0000", 2023-08-01T19:55:13.451 INFO:teuthology.orchestra.run.smithi155.stdout: "duration": 0 2023-08-01T19:55:13.451 INFO:teuthology.orchestra.run.smithi155.stdout: }, 2023-08-01T19:55:13.451 INFO:teuthology.orchestra.run.smithi155.stdout: { 2023-08-01T19:55:13.451 INFO:teuthology.orchestra.run.smithi155.stdout: "event": "throttled", 2023-08-01T19:55:13.452 INFO:teuthology.orchestra.run.smithi155.stdout: "time": "2023-08-01T19:55:13.383641+0000", 2023-08-01T19:55:13.452 INFO:teuthology.orchestra.run.smithi155.stdout: "duration": 0 2023-08-01T19:55:13.452 INFO:teuthology.orchestra.run.smithi155.stdout: }, 2023-08-01T19:55:13.452 INFO:teuthology.orchestra.run.smithi155.stdout: { 2023-08-01T19:55:13.452 INFO:teuthology.orchestra.run.smithi155.stdout: "event": "header_read", 2023-08-01T19:55:13.452 INFO:teuthology.orchestra.run.smithi155.stdout: "time": "2023-08-01T19:55:13.383641+0000", 2023-08-01T19:55:13.452 INFO:teuthology.orchestra.run.smithi155.stdout: "duration": 4294967295.9999995 2023-08-01T19:55:13.452 INFO:teuthology.orchestra.run.smithi155.stdout: }, 2023-08-01T19:55:13.453 INFO:teuthology.orchestra.run.smithi155.stdout: { 2023-08-01T19:55:13.453 INFO:teuthology.orchestra.run.smithi155.stdout: "event": "all_read", 2023-08-01T19:55:13.453 INFO:teuthology.orchestra.run.smithi155.stdout: "time": "2023-08-01T19:55:13.383768+0000", 2023-08-01T19:55:13.453 INFO:teuthology.orchestra.run.smithi155.stdout: "duration": 0.00012757099999999999 2023-08-01T19:55:13.453 INFO:teuthology.orchestra.run.smithi155.stdout: }, 2023-08-01T19:55:13.453 INFO:teuthology.orchestra.run.smithi155.stdout: { 2023-08-01T19:55:13.453 INFO:teuthology.orchestra.run.smithi155.stdout: "event": "dispatched", 2023-08-01T19:55:13.454 INFO:teuthology.orchestra.run.smithi155.stdout: "time": "2023-08-01T19:55:13.383778+0000", 2023-08-01T19:55:13.454 INFO:teuthology.orchestra.run.smithi155.stdout: "duration": 9.781e-06 2023-08-01T19:55:13.454 INFO:teuthology.orchestra.run.smithi155.stdout: }, 2023-08-01T19:55:13.454 INFO:teuthology.orchestra.run.smithi155.stdout: { 2023-08-01T19:55:13.454 INFO:teuthology.orchestra.run.smithi155.stdout: "event": "queued_for_pg", 2023-08-01T19:55:13.454 INFO:teuthology.orchestra.run.smithi155.stdout: "time": "2023-08-01T19:55:13.383784+0000", 2023-08-01T19:55:13.454 INFO:teuthology.orchestra.run.smithi155.stdout: "duration": 5.7899999999999996e-06 2023-08-01T19:55:13.455 INFO:teuthology.orchestra.run.smithi155.stdout: }, 2023-08-01T19:55:13.455 INFO:teuthology.orchestra.run.smithi155.stdout: { 2023-08-01T19:55:13.455 INFO:teuthology.orchestra.run.smithi155.stdout: "event": "reached_pg", 2023-08-01T19:55:13.455 INFO:teuthology.orchestra.run.smithi155.stdout: "time": "2023-08-01T19:55:13.383822+0000", 2023-08-01T19:55:13.455 INFO:teuthology.orchestra.run.smithi155.stdout: "duration": 3.8312999999999997e-05 2023-08-01T19:55:13.455 INFO:teuthology.orchestra.run.smithi155.stdout: }, 2023-08-01T19:55:13.455 INFO:teuthology.orchestra.run.smithi155.stdout: { 2023-08-01T19:55:13.455 INFO:teuthology.orchestra.run.smithi155.stdout: "event": "started", 2023-08-01T19:55:13.456 INFO:teuthology.orchestra.run.smithi155.stdout: "time": "2023-08-01T19:55:13.383935+0000", 2023-08-01T19:55:13.456 INFO:teuthology.orchestra.run.smithi155.stdout: "duration": 0.00011248599999999999 2023-08-01T19:55:13.456 INFO:teuthology.orchestra.run.smithi155.stdout: }, 2023-08-01T19:55:13.456 INFO:teuthology.orchestra.run.smithi155.stdout: { 2023-08-01T19:55:13.456 INFO:teuthology.orchestra.run.smithi155.stdout: "event": "waiting for subops from 0", 2023-08-01T19:55:13.456 INFO:teuthology.orchestra.run.smithi155.stdout: "time": "2023-08-01T19:55:13.384069+0000", 2023-08-01T19:55:13.456 INFO:teuthology.orchestra.run.smithi155.stdout: "duration": 0.000134614 2023-08-01T19:55:13.456 INFO:teuthology.orchestra.run.smithi155.stdout: } 2023-08-01T19:55:13.457 INFO:teuthology.orchestra.run.smithi155.stdout: ] 2023-08-01T19:55:13.457 INFO:teuthology.orchestra.run.smithi155.stdout: } 2023-08-01T19:55:13.457 INFO:teuthology.orchestra.run.smithi155.stdout: }, 2023-08-01T19:55:13.457 INFO:teuthology.orchestra.run.smithi155.stdout: { 2023-08-01T19:55:13.457 INFO:teuthology.orchestra.run.smithi155.stdout: "description": "osd_op(client.4668.0:113554 5.f 5:f0f7bc09:::benchmark_data_smithi006_114134_object113553:head [set-alloc-hint object_size 65536 write_size 65536,write 0~65536 in=65536b] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e42)", 2023-08-01T19:55:13.457 INFO:teuthology.orchestra.run.smithi155.stdout: "initiated_at": "2023-08-01T19:55:13.385664+0000", 2023-08-01T19:55:13.457 INFO:teuthology.orchestra.run.smithi155.stdout: "age": 0.00035209999999999999, 2023-08-01T19:55:13.457 INFO:teuthology.orchestra.run.smithi155.stdout: "duration": 0.0010848640000000001, 2023-08-01T19:55:13.458 INFO:teuthology.orchestra.run.smithi155.stdout: "type_data": { 2023-08-01T19:55:13.458 INFO:teuthology.orchestra.run.smithi155.stdout: "flag_point": "waiting for sub ops", 2023-08-01T19:55:13.458 INFO:teuthology.orchestra.run.smithi155.stdout: "client_info": { 2023-08-01T19:55:13.458 INFO:teuthology.orchestra.run.smithi155.stdout: "client": "client.4668", 2023-08-01T19:55:13.458 INFO:teuthology.orchestra.run.smithi155.stdout: "client_addr": "172.21.15.6:0/1709472247", 2023-08-01T19:55:13.458 INFO:teuthology.orchestra.run.smithi155.stdout: "tid": 113554 2023-08-01T19:55:13.458 INFO:teuthology.orchestra.run.smithi155.stdout: }, 2023-08-01T19:55:13.458 INFO:teuthology.orchestra.run.smithi155.stdout: "events": [ 2023-08-01T19:55:13.459 INFO:teuthology.orchestra.run.smithi155.stdout: { 2023-08-01T19:55:13.459 INFO:teuthology.orchestra.run.smithi155.stdout: "event": "initiated", 2023-08-01T19:55:13.459 INFO:teuthology.orchestra.run.smithi155.stdout: "time": "2023-08-01T19:55:13.385664+0000", 2023-08-01T19:55:13.459 INFO:teuthology.orchestra.run.smithi155.stdout: "duration": 0 2023-08-01T19:55:13.459 INFO:teuthology.orchestra.run.smithi155.stdout: }, 2023-08-01T19:55:13.459 INFO:teuthology.orchestra.run.smithi155.stdout: { 2023-08-01T19:55:13.459 INFO:teuthology.orchestra.run.smithi155.stdout: "event": "throttled", 2023-08-01T19:55:13.459 INFO:teuthology.orchestra.run.smithi155.stdout: "time": "2023-08-01T19:55:13.385664+0000", 2023-08-01T19:55:13.460 INFO:teuthology.orchestra.run.smithi155.stdout: "duration": 0 2023-08-01T19:55:13.460 INFO:teuthology.orchestra.run.smithi155.stdout: }, 2023-08-01T19:55:13.460 INFO:teuthology.orchestra.run.smithi155.stdout: { 2023-08-01T19:55:13.460 INFO:teuthology.orchestra.run.smithi155.stdout: "event": "header_read", 2023-08-01T19:55:13.460 INFO:teuthology.orchestra.run.smithi155.stdout: "time": "2023-08-01T19:55:13.385663+0000", 2023-08-01T19:55:13.460 INFO:teuthology.orchestra.run.smithi155.stdout: "duration": 4294967295.999999 2023-08-01T19:55:13.460 INFO:teuthology.orchestra.run.smithi155.stdout: }, 2023-08-01T19:55:13.461 INFO:teuthology.orchestra.run.smithi155.stdout: { 2023-08-01T19:55:13.461 INFO:teuthology.orchestra.run.smithi155.stdout: "event": "all_read", 2023-08-01T19:55:13.461 INFO:teuthology.orchestra.run.smithi155.stdout: "time": "2023-08-01T19:55:13.385726+0000", 2023-08-01T19:55:13.461 INFO:teuthology.orchestra.run.smithi155.stdout: "duration": 6.2657000000000007e-05 2023-08-01T19:55:13.461 INFO:teuthology.orchestra.run.smithi155.stdout: }, 2023-08-01T19:55:13.461 INFO:teuthology.orchestra.run.smithi155.stdout: { 2023-08-01T19:55:13.461 INFO:teuthology.orchestra.run.smithi155.stdout: "event": "dispatched", 2023-08-01T19:55:13.461 INFO:teuthology.orchestra.run.smithi155.stdout: "time": "2023-08-01T19:55:13.385736+0000", 2023-08-01T19:55:13.462 INFO:teuthology.orchestra.run.smithi155.stdout: "duration": 9.6719999999999999e-06 2023-08-01T19:55:13.462 INFO:teuthology.orchestra.run.smithi155.stdout: }, 2023-08-01T19:55:13.462 INFO:teuthology.orchestra.run.smithi155.stdout: { 2023-08-01T19:55:13.462 INFO:teuthology.orchestra.run.smithi155.stdout: "event": "queued_for_pg", 2023-08-01T19:55:13.462 INFO:teuthology.orchestra.run.smithi155.stdout: "time": "2023-08-01T19:55:13.385742+0000", 2023-08-01T19:55:13.462 INFO:teuthology.orchestra.run.smithi155.stdout: "duration": 6.4729999999999997e-06 2023-08-01T19:55:13.462 INFO:teuthology.orchestra.run.smithi155.stdout: }, 2023-08-01T19:55:13.462 INFO:teuthology.orchestra.run.smithi155.stdout: { 2023-08-01T19:55:13.463 INFO:teuthology.orchestra.run.smithi155.stdout: "event": "reached_pg", 2023-08-01T19:55:13.463 INFO:teuthology.orchestra.run.smithi155.stdout: "time": "2023-08-01T19:55:13.385766+0000", 2023-08-01T19:55:13.463 INFO:teuthology.orchestra.run.smithi155.stdout: "duration": 2.3998999999999998e-05 2023-08-01T19:55:13.463 INFO:teuthology.orchestra.run.smithi155.stdout: }, 2023-08-01T19:55:13.463 INFO:teuthology.orchestra.run.smithi155.stdout: { 2023-08-01T19:55:13.463 INFO:teuthology.orchestra.run.smithi155.stdout: "event": "started", 2023-08-01T19:55:13.463 INFO:teuthology.orchestra.run.smithi155.stdout: "time": "2023-08-01T19:55:13.385840+0000", 2023-08-01T19:55:13.463 INFO:teuthology.orchestra.run.smithi155.stdout: "duration": 7.3894999999999996e-05 2023-08-01T19:55:13.464 INFO:teuthology.orchestra.run.smithi155.stdout: }, 2023-08-01T19:55:13.464 INFO:teuthology.orchestra.run.smithi155.stdout: { 2023-08-01T19:55:13.464 INFO:teuthology.orchestra.run.smithi155.stdout: "event": "waiting for subops from 1", 2023-08-01T19:55:13.464 INFO:teuthology.orchestra.run.smithi155.stdout: "time": "2023-08-01T19:55:13.385940+0000", 2023-08-01T19:55:13.464 INFO:teuthology.orchestra.run.smithi155.stdout: "duration": 0.000100326 2023-08-01T19:55:13.464 INFO:teuthology.orchestra.run.smithi155.stdout: } 2023-08-01T19:55:13.464 INFO:teuthology.orchestra.run.smithi155.stdout: ] 2023-08-01T19:55:13.465 INFO:teuthology.orchestra.run.smithi155.stdout: } 2023-08-01T19:55:13.465 INFO:teuthology.orchestra.run.smithi155.stdout: } 2023-08-01T19:55:13.465 INFO:teuthology.orchestra.run.smithi155.stdout: ], 2023-08-01T19:55:13.465 INFO:teuthology.orchestra.run.smithi155.stdout: "num_ops": 9 2023-08-01T19:55:13.465 INFO:teuthology.orchestra.run.smithi155.stdout:} 2023-08-01T19:55:13.466 DEBUG:teuthology.orchestra.run.smithi155:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 30 ceph --cluster ceph --admin-daemon /var/run/ceph/ceph-osd.2.asok dump_blocked_ops 2023-08-01T19:55:13.467 INFO:tasks.ceph.osd.0.smithi008.stderr:2023-08-01T19:55:13.465+0000 7f16a58f4700 -1 received signal: Hangup from /usr/bin/python3 /bin/daemon-helper kill ceph-osd -f --cluster ceph -i 0 (PID: 111179) UID: 0 2023-08-01T19:55:13.567 INFO:tasks.ceph.osd.0.smithi008.stderr:2023-08-01T19:55:13.566+0000 7f16a58f4700 -1 received signal: Hangup from /usr/bin/python3 /bin/daemon-helper kill ceph-osd -f --cluster ceph -i 0 (PID: 111179) UID: 0 2023-08-01T19:55:13.648 INFO:teuthology.orchestra.run.smithi155.stdout:{ 2023-08-01T19:55:13.648 INFO:teuthology.orchestra.run.smithi155.stdout: "ops": [], 2023-08-01T19:55:13.649 INFO:teuthology.orchestra.run.smithi155.stdout: "complaint_time": 30, 2023-08-01T19:55:13.649 INFO:teuthology.orchestra.run.smithi155.stdout: "num_blocked_ops": 0 2023-08-01T19:55:13.649 INFO:teuthology.orchestra.run.smithi155.stdout:} 2023-08-01T19:55:13.663 DEBUG:teuthology.orchestra.run.smithi155:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 30 ceph --cluster ceph --admin-daemon /var/run/ceph/ceph-osd.2.asok dump_historic_ops 2023-08-01T19:55:13.706 INFO:tasks.ceph.osd.2.smithi155.stderr:2023-08-01T19:55:13.705+0000 7faa5c6ac700 -1 received signal: Hangup from /usr/bin/python3 /bin/daemon-helper kill ceph-osd -f --cluster ceph -i 2 (PID: 111337) UID: 0 2023-08-01T19:55:13.770 INFO:tasks.ceph.osd.0.smithi008.stderr:2023-08-01T19:55:13.767+0000 7f16a58f4700 -1 received signal: Hangup from /usr/bin/python3 /bin/daemon-helper kill ceph-osd -f --cluster ceph -i 0 (PID: 111179) UID: 0 2023-08-01T19:55:13.840 INFO:teuthology.orchestra.run.smithi155.stdout:{ 2023-08-01T19:55:13.841 INFO:teuthology.orchestra.run.smithi155.stdout: "size": 20, 2023-08-01T19:55:13.841 INFO:teuthology.orchestra.run.smithi155.stdout: "duration": 600, 2023-08-01T19:55:13.841 INFO:teuthology.orchestra.run.smithi155.stdout: "ops": [ 2023-08-01T19:55:13.841 INFO:teuthology.orchestra.run.smithi155.stdout: { 2023-08-01T19:55:13.841 INFO:teuthology.orchestra.run.smithi155.stdout: "description": "osd_op(client.4668.0:73454 5.8 5:15596b2f:::benchmark_data_smithi006_114134_object73453:head [set-alloc-hint object_size 65536 write_size 65536,write 0~65536] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e31)", 2023-08-01T19:55:13.842 INFO:teuthology.orchestra.run.smithi155.stdout: "initiated_at": "2023-08-01T19:54:51.460020+0000", 2023-08-01T19:55:13.842 INFO:teuthology.orchestra.run.smithi155.stdout: "age": 22.377466526999999, 2023-08-01T19:55:13.842 INFO:teuthology.orchestra.run.smithi155.stdout: "duration": 0.022889436999999999, 2023-08-01T19:55:13.842 INFO:teuthology.orchestra.run.smithi155.stdout: "type_data": { 2023-08-01T19:55:13.842 INFO:teuthology.orchestra.run.smithi155.stdout: "flag_point": "commit sent; apply or cleanup", 2023-08-01T19:55:13.842 INFO:teuthology.orchestra.run.smithi155.stdout: "client_info": { 2023-08-01T19:55:13.842 INFO:teuthology.orchestra.run.smithi155.stdout: "client": "client.4668", 2023-08-01T19:55:13.843 INFO:teuthology.orchestra.run.smithi155.stdout: "client_addr": "172.21.15.6:0/1709472247", 2023-08-01T19:55:13.843 INFO:teuthology.orchestra.run.smithi155.stdout: "tid": 73454 2023-08-01T19:55:13.843 INFO:teuthology.orchestra.run.smithi155.stdout: }, 2023-08-01T19:55:13.843 INFO:teuthology.orchestra.run.smithi155.stdout: "events": [ 2023-08-01T19:55:13.843 INFO:teuthology.orchestra.run.smithi155.stdout: { 2023-08-01T19:55:13.843 INFO:teuthology.orchestra.run.smithi155.stdout: "event": "initiated", 2023-08-01T19:55:13.843 INFO:teuthology.orchestra.run.smithi155.stdout: "time": "2023-08-01T19:54:51.460020+0000", 2023-08-01T19:55:13.843 INFO:teuthology.orchestra.run.smithi155.stdout: "duration": 0 2023-08-01T19:55:13.844 INFO:teuthology.orchestra.run.smithi155.stdout: }, 2023-08-01T19:55:13.844 INFO:teuthology.orchestra.run.smithi155.stdout: { 2023-08-01T19:55:13.844 INFO:teuthology.orchestra.run.smithi155.stdout: "event": "throttled", 2023-08-01T19:55:13.844 INFO:teuthology.orchestra.run.smithi155.stdout: "time": "2023-08-01T19:54:51.460020+0000", 2023-08-01T19:55:13.844 INFO:teuthology.orchestra.run.smithi155.stdout: "duration": 0 2023-08-01T19:55:13.844 INFO:teuthology.orchestra.run.smithi155.stdout: }, 2023-08-01T19:55:13.844 INFO:teuthology.orchestra.run.smithi155.stdout: { 2023-08-01T19:55:13.844 INFO:teuthology.orchestra.run.smithi155.stdout: "event": "header_read", 2023-08-01T19:55:13.845 INFO:teuthology.orchestra.run.smithi155.stdout: "time": "2023-08-01T19:54:51.460019+0000", 2023-08-01T19:55:13.845 INFO:teuthology.orchestra.run.smithi155.stdout: "duration": 4294967295.9999995 2023-08-01T19:55:13.845 INFO:teuthology.orchestra.run.smithi155.stdout: }, 2023-08-01T19:55:13.845 INFO:teuthology.orchestra.run.smithi155.stdout: { 2023-08-01T19:55:13.845 INFO:teuthology.orchestra.run.smithi155.stdout: "event": "all_read", 2023-08-01T19:55:13.845 INFO:teuthology.orchestra.run.smithi155.stdout: "time": "2023-08-01T19:54:51.460051+0000", 2023-08-01T19:55:13.845 INFO:teuthology.orchestra.run.smithi155.stdout: "duration": 3.1736000000000002e-05 2023-08-01T19:55:13.846 INFO:teuthology.orchestra.run.smithi155.stdout: }, 2023-08-01T19:55:13.846 INFO:teuthology.orchestra.run.smithi155.stdout: { 2023-08-01T19:55:13.846 INFO:teuthology.orchestra.run.smithi155.stdout: "event": "dispatched", 2023-08-01T19:55:13.846 INFO:teuthology.orchestra.run.smithi155.stdout: "time": "2023-08-01T19:54:51.460058+0000", 2023-08-01T19:55:13.846 INFO:teuthology.orchestra.run.smithi155.stdout: "duration": 7.3869999999999997e-06 2023-08-01T19:55:13.846 INFO:teuthology.orchestra.run.smithi155.stdout: }, 2023-08-01T19:55:13.846 INFO:teuthology.orchestra.run.smithi155.stdout: { 2023-08-01T19:55:13.846 INFO:teuthology.orchestra.run.smithi155.stdout: "event": "queued_for_pg", 2023-08-01T19:55:13.847 INFO:teuthology.orchestra.run.smithi155.stdout: "time": "2023-08-01T19:54:51.460062+0000", 2023-08-01T19:55:13.847 INFO:teuthology.orchestra.run.smithi155.stdout: "duration": 4.352e-06 2023-08-01T19:55:13.847 INFO:teuthology.orchestra.run.smithi155.stdout: }, 2023-08-01T19:55:13.847 INFO:teuthology.orchestra.run.smithi155.stdout: { 2023-08-01T19:55:13.847 INFO:teuthology.orchestra.run.smithi155.stdout: "event": "reached_pg", 2023-08-01T19:55:13.847 INFO:teuthology.orchestra.run.smithi155.stdout: "time": "2023-08-01T19:54:51.460101+0000", 2023-08-01T19:55:13.847 INFO:teuthology.orchestra.run.smithi155.stdout: "duration": 3.8705000000000003e-05 2023-08-01T19:55:13.848 INFO:teuthology.orchestra.run.smithi155.stdout: }, 2023-08-01T19:55:13.848 INFO:teuthology.orchestra.run.smithi155.stdout: { 2023-08-01T19:55:13.848 INFO:teuthology.orchestra.run.smithi155.stdout: "event": "started", 2023-08-01T19:55:13.848 INFO:teuthology.orchestra.run.smithi155.stdout: "time": "2023-08-01T19:54:51.460236+0000", 2023-08-01T19:55:13.848 INFO:teuthology.orchestra.run.smithi155.stdout: "duration": 0.00013463599999999999 2023-08-01T19:55:13.848 INFO:teuthology.orchestra.run.smithi155.stdout: }, 2023-08-01T19:55:13.848 INFO:teuthology.orchestra.run.smithi155.stdout: { 2023-08-01T19:55:13.848 INFO:teuthology.orchestra.run.smithi155.stdout: "event": "waiting for subops from 0", 2023-08-01T19:55:13.849 INFO:teuthology.orchestra.run.smithi155.stdout: "time": "2023-08-01T19:54:51.460391+0000", 2023-08-01T19:55:13.849 INFO:teuthology.orchestra.run.smithi155.stdout: "duration": 0.00015525000000000001 2023-08-01T19:55:13.849 INFO:teuthology.orchestra.run.smithi155.stdout: }, 2023-08-01T19:55:13.849 INFO:teuthology.orchestra.run.smithi155.stdout: { 2023-08-01T19:55:13.849 INFO:teuthology.orchestra.run.smithi155.stdout: "event": "sub_op_commit_rec", 2023-08-01T19:55:13.849 INFO:teuthology.orchestra.run.smithi155.stdout: "time": "2023-08-01T19:54:51.468393+0000", 2023-08-01T19:55:13.849 INFO:teuthology.orchestra.run.smithi155.stdout: "duration": 0.00800208 2023-08-01T19:55:13.849 INFO:teuthology.orchestra.run.smithi155.stdout: }, 2023-08-01T19:55:13.850 INFO:teuthology.orchestra.run.smithi155.stdout: { 2023-08-01T19:55:13.850 INFO:teuthology.orchestra.run.smithi155.stdout: "event": "op_commit", 2023-08-01T19:55:13.850 INFO:teuthology.orchestra.run.smithi155.stdout: "time": "2023-08-01T19:54:51.482815+0000", 2023-08-01T19:55:13.850 INFO:teuthology.orchestra.run.smithi155.stdout: "duration": 0.01442148 2023-08-01T19:55:13.850 INFO:teuthology.orchestra.run.smithi155.stdout: }, 2023-08-01T19:55:13.850 INFO:teuthology.orchestra.run.smithi155.stdout: { 2023-08-01T19:55:13.850 INFO:teuthology.orchestra.run.smithi155.stdout: "event": "commit_sent", 2023-08-01T19:55:13.850 INFO:teuthology.orchestra.run.smithi155.stdout: "time": "2023-08-01T19:54:51.482866+0000", 2023-08-01T19:55:13.851 INFO:teuthology.orchestra.run.smithi155.stdout: "duration": 5.1842999999999998e-05 2023-08-01T19:55:13.851 INFO:teuthology.orchestra.run.smithi155.stdout: }, 2023-08-01T19:55:13.851 INFO:teuthology.orchestra.run.smithi155.stdout: { 2023-08-01T19:55:13.851 INFO:teuthology.orchestra.run.smithi155.stdout: "event": "done", 2023-08-01T19:55:13.851 INFO:teuthology.orchestra.run.smithi155.stdout: "time": "2023-08-01T19:54:51.482909+0000", 2023-08-01T19:55:13.851 INFO:teuthology.orchestra.run.smithi155.stdout: "duration": 4.2663000000000001e-05 2023-08-01T19:55:13.851 INFO:teuthology.orchestra.run.smithi155.stdout: } 2023-08-01T19:55:13.852 INFO:teuthology.orchestra.run.smithi155.stdout: ] 2023-08-01T19:55:13.852 INFO:teuthology.orchestra.run.smithi155.stdout: } 2023-08-01T19:55:13.852 INFO:teuthology.orchestra.run.smithi155.stdout: }, 2023-08-01T19:55:13.852 INFO:teuthology.orchestra.run.smithi155.stdout: { 2023-08-01T19:55:13.852 INFO:teuthology.orchestra.run.smithi155.stdout: "description": "osd_op(client.4668.0:73455 5.b 5:de51121e:::benchmark_data_smithi006_114134_object73454:head [set-alloc-hint object_size 65536 write_size 65536,write 0~65536] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e31)", 2023-08-01T19:55:13.852 INFO:teuthology.orchestra.run.smithi155.stdout: "initiated_at": "2023-08-01T19:54:51.460078+0000", 2023-08-01T19:55:13.852 INFO:teuthology.orchestra.run.smithi155.stdout: "age": 22.377408552999999, 2023-08-01T19:55:13.853 INFO:teuthology.orchestra.run.smithi155.stdout: "duration": 0.022689121999999999, 2023-08-01T19:55:13.853 INFO:teuthology.orchestra.run.smithi155.stdout: "type_data": { 2023-08-01T19:55:13.853 INFO:teuthology.orchestra.run.smithi155.stdout: "flag_point": "commit sent; apply or cleanup", 2023-08-01T19:55:13.853 INFO:teuthology.orchestra.run.smithi155.stdout: "client_info": { 2023-08-01T19:55:13.853 INFO:teuthology.orchestra.run.smithi155.stdout: "client": "client.4668", 2023-08-01T19:55:13.853 INFO:teuthology.orchestra.run.smithi155.stdout: "client_addr": "172.21.15.6:0/1709472247", 2023-08-01T19:55:13.853 INFO:teuthology.orchestra.run.smithi155.stdout: "tid": 73455 2023-08-01T19:55:13.853 INFO:teuthology.orchestra.run.smithi155.stdout: }, 2023-08-01T19:55:13.854 INFO:teuthology.orchestra.run.smithi155.stdout: "events": [ 2023-08-01T19:55:13.854 INFO:teuthology.orchestra.run.smithi155.stdout: { 2023-08-01T19:55:13.854 INFO:teuthology.orchestra.run.smithi155.stdout: "event": "initiated", 2023-08-01T19:55:13.854 INFO:teuthology.orchestra.run.smithi155.stdout: "time": "2023-08-01T19:54:51.460078+0000", 2023-08-01T19:55:13.854 INFO:teuthology.orchestra.run.smithi155.stdout: "duration": 0 2023-08-01T19:55:13.854 INFO:teuthology.orchestra.run.smithi155.stdout: }, 2023-08-01T19:55:13.854 INFO:teuthology.orchestra.run.smithi155.stdout: { 2023-08-01T19:55:13.855 INFO:teuthology.orchestra.run.smithi155.stdout: "event": "throttled", 2023-08-01T19:55:13.855 INFO:teuthology.orchestra.run.smithi155.stdout: "time": "2023-08-01T19:54:51.460078+0000", 2023-08-01T19:55:13.855 INFO:teuthology.orchestra.run.smithi155.stdout: "duration": 0 2023-08-01T19:55:13.855 INFO:teuthology.orchestra.run.smithi155.stdout: }, 2023-08-01T19:55:13.855 INFO:teuthology.orchestra.run.smithi155.stdout: { 2023-08-01T19:55:13.855 INFO:teuthology.orchestra.run.smithi155.stdout: "event": "header_read", 2023-08-01T19:55:13.855 INFO:teuthology.orchestra.run.smithi155.stdout: "time": "2023-08-01T19:54:51.460077+0000", 2023-08-01T19:55:13.855 INFO:teuthology.orchestra.run.smithi155.stdout: "duration": 4294967295.9999995 2023-08-01T19:55:13.856 INFO:teuthology.orchestra.run.smithi155.stdout: }, 2023-08-01T19:55:13.856 INFO:teuthology.orchestra.run.smithi155.stdout: { 2023-08-01T19:55:13.856 INFO:teuthology.orchestra.run.smithi155.stdout: "event": "all_read", 2023-08-01T19:55:13.856 INFO:teuthology.orchestra.run.smithi155.stdout: "time": "2023-08-01T19:54:51.460102+0000", 2023-08-01T19:55:13.856 INFO:teuthology.orchestra.run.smithi155.stdout: "duration": 2.4933e-05 2023-08-01T19:55:13.856 INFO:teuthology.orchestra.run.smithi155.stdout: }, 2023-08-01T19:55:13.856 INFO:teuthology.orchestra.run.smithi155.stdout: { 2023-08-01T19:55:13.857 INFO:teuthology.orchestra.run.smithi155.stdout: "event": "dispatched", 2023-08-01T19:55:13.857 INFO:teuthology.orchestra.run.smithi155.stdout: "time": "2023-08-01T19:54:51.460109+0000", 2023-08-01T19:55:13.857 INFO:teuthology.orchestra.run.smithi155.stdout: "duration": 7.0720000000000002e-06 2023-08-01T19:55:13.857 INFO:teuthology.orchestra.run.smithi155.stdout: }, 2023-08-01T19:55:13.857 INFO:teuthology.orchestra.run.smithi155.stdout: { 2023-08-01T19:55:13.857 INFO:teuthology.orchestra.run.smithi155.stdout: "event": "queued_for_pg", 2023-08-01T19:55:13.857 INFO:teuthology.orchestra.run.smithi155.stdout: "time": "2023-08-01T19:54:51.460113+0000", 2023-08-01T19:55:13.858 INFO:teuthology.orchestra.run.smithi155.stdout: "duration": 4.3220000000000003e-06 2023-08-01T19:55:13.858 INFO:teuthology.orchestra.run.smithi155.stdout: }, 2023-08-01T19:55:13.858 INFO:teuthology.orchestra.run.smithi155.stdout: { 2023-08-01T19:55:13.858 INFO:teuthology.orchestra.run.smithi155.stdout: "event": "reached_pg", 2023-08-01T19:55:13.858 INFO:teuthology.orchestra.run.smithi155.stdout: "time": "2023-08-01T19:54:51.460955+0000", 2023-08-01T19:55:13.858 INFO:teuthology.orchestra.run.smithi155.stdout: "duration": 0.00084142500000000003 2023-08-01T19:55:13.858 INFO:teuthology.orchestra.run.smithi155.stdout: }, 2023-08-01T19:55:13.859 INFO:teuthology.orchestra.run.smithi155.stdout: { 2023-08-01T19:55:13.859 INFO:teuthology.orchestra.run.smithi155.stdout: "event": "started", 2023-08-01T19:55:13.859 INFO:teuthology.orchestra.run.smithi155.stdout: "time": "2023-08-01T19:54:51.461079+0000", 2023-08-01T19:55:13.859 INFO:teuthology.orchestra.run.smithi155.stdout: "duration": 0.000123826 2023-08-01T19:55:13.859 INFO:teuthology.orchestra.run.smithi155.stdout: }, 2023-08-01T19:55:13.859 INFO:teuthology.orchestra.run.smithi155.stdout: { 2023-08-01T19:55:13.859 INFO:teuthology.orchestra.run.smithi155.stdout: "event": "waiting for subops from 0", 2023-08-01T19:55:13.860 INFO:teuthology.orchestra.run.smithi155.stdout: "time": "2023-08-01T19:54:51.461233+0000", 2023-08-01T19:55:13.860 INFO:teuthology.orchestra.run.smithi155.stdout: "duration": 0.00015431900000000001 2023-08-01T19:55:13.860 INFO:teuthology.orchestra.run.smithi155.stdout: }, 2023-08-01T19:55:13.860 INFO:teuthology.orchestra.run.smithi155.stdout: { 2023-08-01T19:55:13.860 INFO:teuthology.orchestra.run.smithi155.stdout: "event": "sub_op_commit_rec", 2023-08-01T19:55:13.860 INFO:teuthology.orchestra.run.smithi155.stdout: "time": "2023-08-01T19:54:51.468509+0000", 2023-08-01T19:55:13.860 INFO:teuthology.orchestra.run.smithi155.stdout: "duration": 0.0072759859999999999 2023-08-01T19:55:13.860 INFO:teuthology.orchestra.run.smithi155.stdout: }, 2023-08-01T19:55:13.861 INFO:teuthology.orchestra.run.smithi155.stdout: { 2023-08-01T19:55:13.861 INFO:teuthology.orchestra.run.smithi155.stdout: "event": "op_commit", 2023-08-01T19:55:13.861 INFO:teuthology.orchestra.run.smithi155.stdout: "time": "2023-08-01T19:54:51.482704+0000", 2023-08-01T19:55:13.861 INFO:teuthology.orchestra.run.smithi155.stdout: "duration": 0.01419545 2023-08-01T19:55:13.861 INFO:teuthology.orchestra.run.smithi155.stdout: }, 2023-08-01T19:55:13.861 INFO:teuthology.orchestra.run.smithi155.stdout: { 2023-08-01T19:55:13.861 INFO:teuthology.orchestra.run.smithi155.stdout: "event": "commit_sent", 2023-08-01T19:55:13.862 INFO:teuthology.orchestra.run.smithi155.stdout: "time": "2023-08-01T19:54:51.482747+0000", 2023-08-01T19:55:13.862 INFO:teuthology.orchestra.run.smithi155.stdout: "duration": 4.2413999999999997e-05 2023-08-01T19:55:13.862 INFO:teuthology.orchestra.run.smithi155.stdout: }, 2023-08-01T19:55:13.862 INFO:teuthology.orchestra.run.smithi155.stdout: { 2023-08-01T19:55:13.862 INFO:teuthology.orchestra.run.smithi155.stdout: "event": "done", 2023-08-01T19:55:13.862 INFO:teuthology.orchestra.run.smithi155.stdout: "time": "2023-08-01T19:54:51.482767+0000", 2023-08-01T19:55:13.862 INFO:teuthology.orchestra.run.smithi155.stdout: "duration": 1.9908999999999999e-05 2023-08-01T19:55:13.862 INFO:teuthology.orchestra.run.smithi155.stdout: } 2023-08-01T19:55:13.863 INFO:teuthology.orchestra.run.smithi155.stdout: ] 2023-08-01T19:55:13.863 INFO:teuthology.orchestra.run.smithi155.stdout: } 2023-08-01T19:55:13.863 INFO:teuthology.orchestra.run.smithi155.stdout: }, 2023-08-01T19:55:13.863 INFO:teuthology.orchestra.run.smithi155.stdout: { 2023-08-01T19:55:13.863 INFO:teuthology.orchestra.run.smithi155.stdout: "description": "osd_op(client.4668.0:73456 5.0 5:0164baf4:::benchmark_data_smithi006_114134_object73455:head [set-alloc-hint object_size 65536 write_size 65536,write 0~65536] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e31)", 2023-08-01T19:55:13.863 INFO:teuthology.orchestra.run.smithi155.stdout: "initiated_at": "2023-08-01T19:54:51.461520+0000", 2023-08-01T19:55:13.863 INFO:teuthology.orchestra.run.smithi155.stdout: "age": 22.375966562999999, 2023-08-01T19:55:13.863 INFO:teuthology.orchestra.run.smithi155.stdout: "duration": 0.023899916, 2023-08-01T19:55:13.864 INFO:teuthology.orchestra.run.smithi155.stdout: "type_data": { 2023-08-01T19:55:13.864 INFO:teuthology.orchestra.run.smithi155.stdout: "flag_point": "commit sent; apply or cleanup", 2023-08-01T19:55:13.864 INFO:teuthology.orchestra.run.smithi155.stdout: "client_info": { 2023-08-01T19:55:13.864 INFO:teuthology.orchestra.run.smithi155.stdout: "client": "client.4668", 2023-08-01T19:55:13.864 INFO:teuthology.orchestra.run.smithi155.stdout: "client_addr": "172.21.15.6:0/1709472247", 2023-08-01T19:55:13.864 INFO:teuthology.orchestra.run.smithi155.stdout: "tid": 73456 2023-08-01T19:55:13.864 INFO:teuthology.orchestra.run.smithi155.stdout: }, 2023-08-01T19:55:13.864 INFO:teuthology.orchestra.run.smithi155.stdout: "events": [ 2023-08-01T19:55:13.865 INFO:teuthology.orchestra.run.smithi155.stdout: { 2023-08-01T19:55:13.865 INFO:teuthology.orchestra.run.smithi155.stdout: "event": "initiated", 2023-08-01T19:55:13.865 INFO:teuthology.orchestra.run.smithi155.stdout: "time": "2023-08-01T19:54:51.461520+0000", 2023-08-01T19:55:13.865 INFO:teuthology.orchestra.run.smithi155.stdout: "duration": 0 2023-08-01T19:55:13.865 INFO:teuthology.orchestra.run.smithi155.stdout: }, 2023-08-01T19:55:13.865 INFO:teuthology.orchestra.run.smithi155.stdout: { 2023-08-01T19:55:13.865 INFO:teuthology.orchestra.run.smithi155.stdout: "event": "throttled", 2023-08-01T19:55:13.866 INFO:teuthology.orchestra.run.smithi155.stdout: "time": "2023-08-01T19:54:51.461520+0000", 2023-08-01T19:55:13.866 INFO:teuthology.orchestra.run.smithi155.stdout: "duration": 0 2023-08-01T19:55:13.866 INFO:teuthology.orchestra.run.smithi155.stdout: }, 2023-08-01T19:55:13.866 INFO:teuthology.orchestra.run.smithi155.stdout: { 2023-08-01T19:55:13.866 INFO:teuthology.orchestra.run.smithi155.stdout: "event": "header_read", 2023-08-01T19:55:13.866 INFO:teuthology.orchestra.run.smithi155.stdout: "time": "2023-08-01T19:54:51.461519+0000", 2023-08-01T19:55:13.866 INFO:teuthology.orchestra.run.smithi155.stdout: "duration": 4294967295.999999 2023-08-01T19:55:13.867 INFO:teuthology.orchestra.run.smithi155.stdout: }, 2023-08-01T19:55:13.867 INFO:teuthology.orchestra.run.smithi155.stdout: { 2023-08-01T19:55:13.867 INFO:teuthology.orchestra.run.smithi155.stdout: "event": "all_read", 2023-08-01T19:55:13.867 INFO:teuthology.orchestra.run.smithi155.stdout: "time": "2023-08-01T19:54:51.461633+0000", 2023-08-01T19:55:13.867 INFO:teuthology.orchestra.run.smithi155.stdout: "duration": 0.000114015 2023-08-01T19:55:13.867 INFO:teuthology.orchestra.run.smithi155.stdout: }, 2023-08-01T19:55:13.867 INFO:teuthology.orchestra.run.smithi155.stdout: { 2023-08-01T19:55:13.867 INFO:teuthology.orchestra.run.smithi155.stdout: "event": "dispatched", 2023-08-01T19:55:13.868 INFO:teuthology.orchestra.run.smithi155.stdout: "time": "2023-08-01T19:54:51.461643+0000", 2023-08-01T19:55:13.868 INFO:teuthology.orchestra.run.smithi155.stdout: "duration": 1.0217000000000001e-05 2023-08-01T19:55:13.868 INFO:teuthology.orchestra.run.smithi155.stdout: }, 2023-08-01T19:55:13.868 INFO:teuthology.orchestra.run.smithi155.stdout: { 2023-08-01T19:55:13.868 INFO:teuthology.orchestra.run.smithi155.stdout: "event": "queued_for_pg", 2023-08-01T19:55:13.868 INFO:teuthology.orchestra.run.smithi155.stdout: "time": "2023-08-01T19:54:51.461649+0000", 2023-08-01T19:55:13.868 INFO:teuthology.orchestra.run.smithi155.stdout: "duration": 5.8850000000000004e-06 2023-08-01T19:55:13.868 INFO:teuthology.orchestra.run.smithi155.stdout: }, 2023-08-01T19:55:13.869 INFO:teuthology.orchestra.run.smithi155.stdout: { 2023-08-01T19:55:13.869 INFO:teuthology.orchestra.run.smithi155.stdout: "event": "reached_pg", 2023-08-01T19:55:13.869 INFO:teuthology.orchestra.run.smithi155.stdout: "time": "2023-08-01T19:54:51.461686+0000", 2023-08-01T19:55:13.869 INFO:teuthology.orchestra.run.smithi155.stdout: "duration": 3.7319e-05 2023-08-01T19:55:13.869 INFO:teuthology.orchestra.run.smithi155.stdout: }, 2023-08-01T19:55:13.869 INFO:teuthology.orchestra.run.smithi155.stdout: { 2023-08-01T19:55:13.869 INFO:teuthology.orchestra.run.smithi155.stdout: "event": "started", 2023-08-01T19:55:13.869 INFO:teuthology.orchestra.run.smithi155.stdout: "time": "2023-08-01T19:54:51.461802+0000", 2023-08-01T19:55:13.870 INFO:teuthology.orchestra.run.smithi155.stdout: "duration": 0.000115604 2023-08-01T19:55:13.870 INFO:teuthology.orchestra.run.smithi155.stdout: }, 2023-08-01T19:55:13.870 INFO:teuthology.orchestra.run.smithi155.stdout: { 2023-08-01T19:55:13.870 INFO:teuthology.orchestra.run.smithi155.stdout: "event": "waiting for subops from 0", 2023-08-01T19:55:13.870 INFO:teuthology.orchestra.run.smithi155.stdout: "time": "2023-08-01T19:54:51.461933+0000", 2023-08-01T19:55:13.870 INFO:teuthology.orchestra.run.smithi155.stdout: "duration": 0.000131175 2023-08-01T19:55:13.870 INFO:teuthology.orchestra.run.smithi155.stdout: }, 2023-08-01T19:55:13.870 INFO:teuthology.orchestra.run.smithi155.stdout: { 2023-08-01T19:55:13.871 INFO:teuthology.orchestra.run.smithi155.stdout: "event": "sub_op_commit_rec", 2023-08-01T19:55:13.871 INFO:teuthology.orchestra.run.smithi155.stdout: "time": "2023-08-01T19:54:51.468411+0000", 2023-08-01T19:55:13.871 INFO:teuthology.orchestra.run.smithi155.stdout: "duration": 0.0064775850000000001 2023-08-01T19:55:13.871 INFO:teuthology.orchestra.run.smithi155.stdout: }, 2023-08-01T19:55:13.871 INFO:teuthology.orchestra.run.smithi155.stdout: { 2023-08-01T19:55:13.871 INFO:teuthology.orchestra.run.smithi155.stdout: "event": "op_commit", 2023-08-01T19:55:13.871 INFO:teuthology.orchestra.run.smithi155.stdout: "time": "2023-08-01T19:54:51.485340+0000", 2023-08-01T19:55:13.871 INFO:teuthology.orchestra.run.smithi155.stdout: "duration": 0.016928907 2023-08-01T19:55:13.872 INFO:teuthology.orchestra.run.smithi155.stdout: }, 2023-08-01T19:55:13.872 INFO:teuthology.orchestra.run.smithi155.stdout: { 2023-08-01T19:55:13.872 INFO:teuthology.orchestra.run.smithi155.stdout: "event": "commit_sent", 2023-08-01T19:55:13.872 INFO:teuthology.orchestra.run.smithi155.stdout: "time": "2023-08-01T19:54:51.485385+0000", 2023-08-01T19:55:13.872 INFO:teuthology.orchestra.run.smithi155.stdout: "duration": 4.5222000000000002e-05 2023-08-01T19:55:13.872 INFO:teuthology.orchestra.run.smithi155.stdout: }, 2023-08-01T19:55:13.872 INFO:teuthology.orchestra.run.smithi155.stdout: { 2023-08-01T19:55:13.873 INFO:teuthology.orchestra.run.smithi155.stdout: "event": "done", 2023-08-01T19:55:13.873 INFO:teuthology.orchestra.run.smithi155.stdout: "time": "2023-08-01T19:54:51.485420+0000", 2023-08-01T19:55:13.873 INFO:teuthology.orchestra.run.smithi155.stdout: "duration": 3.4717e-05 2023-08-01T19:55:13.873 INFO:teuthology.orchestra.run.smithi155.stdout: } 2023-08-01T19:55:13.873 INFO:teuthology.orchestra.run.smithi155.stdout: ] 2023-08-01T19:55:13.873 INFO:teuthology.orchestra.run.smithi155.stdout: } 2023-08-01T19:55:13.873 INFO:teuthology.orchestra.run.smithi155.stdout: }, 2023-08-01T19:55:13.873 INFO:teuthology.orchestra.run.smithi155.stdout: { 2023-08-01T19:55:13.874 INFO:teuthology.orchestra.run.smithi155.stdout: "description": "osd_op(client.4668.0:100237 5.4 5:2d68bec9:::benchmark_data_smithi006_114134_object100236:head [set-alloc-hint object_size 65536 write_size 65536,write 0~65536] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e37)", 2023-08-01T19:55:13.874 INFO:teuthology.orchestra.run.smithi155.stdout: "initiated_at": "2023-08-01T19:55:05.147736+0000", 2023-08-01T19:55:13.874 INFO:teuthology.orchestra.run.smithi155.stdout: "age": 8.6897498500000001, 2023-08-01T19:55:13.874 INFO:teuthology.orchestra.run.smithi155.stdout: "duration": 0.071299464000000007, 2023-08-01T19:55:13.874 INFO:teuthology.orchestra.run.smithi155.stdout: "type_data": { 2023-08-01T19:55:13.874 INFO:teuthology.orchestra.run.smithi155.stdout: "flag_point": "commit sent; apply or cleanup", 2023-08-01T19:55:13.874 INFO:teuthology.orchestra.run.smithi155.stdout: "client_info": { 2023-08-01T19:55:13.874 INFO:teuthology.orchestra.run.smithi155.stdout: "client": "client.4668", 2023-08-01T19:55:13.875 INFO:teuthology.orchestra.run.smithi155.stdout: "client_addr": "172.21.15.6:0/1709472247", 2023-08-01T19:55:13.875 INFO:teuthology.orchestra.run.smithi155.stdout: "tid": 100237 2023-08-01T19:55:13.875 INFO:teuthology.orchestra.run.smithi155.stdout: }, 2023-08-01T19:55:13.875 INFO:teuthology.orchestra.run.smithi155.stdout: "events": [ 2023-08-01T19:55:13.875 INFO:teuthology.orchestra.run.smithi155.stdout: { 2023-08-01T19:55:13.875 INFO:teuthology.orchestra.run.smithi155.stdout: "event": "initiated", 2023-08-01T19:55:13.875 INFO:teuthology.orchestra.run.smithi155.stdout: "time": "2023-08-01T19:55:05.147736+0000", 2023-08-01T19:55:13.875 INFO:teuthology.orchestra.run.smithi155.stdout: "duration": 0 2023-08-01T19:55:13.876 INFO:teuthology.orchestra.run.smithi155.stdout: }, 2023-08-01T19:55:13.876 INFO:teuthology.orchestra.run.smithi155.stdout: { 2023-08-01T19:55:13.876 INFO:teuthology.orchestra.run.smithi155.stdout: "event": "throttled", 2023-08-01T19:55:13.876 INFO:teuthology.orchestra.run.smithi155.stdout: "time": "2023-08-01T19:55:05.147736+0000", 2023-08-01T19:55:13.876 INFO:teuthology.orchestra.run.smithi155.stdout: "duration": 0 2023-08-01T19:55:13.876 INFO:teuthology.orchestra.run.smithi155.stdout: }, 2023-08-01T19:55:13.876 INFO:teuthology.orchestra.run.smithi155.stdout: { 2023-08-01T19:55:13.877 INFO:teuthology.orchestra.run.smithi155.stdout: "event": "header_read", 2023-08-01T19:55:13.877 INFO:teuthology.orchestra.run.smithi155.stdout: "time": "2023-08-01T19:55:05.147736+0000", 2023-08-01T19:55:13.877 INFO:teuthology.orchestra.run.smithi155.stdout: "duration": 4294967295.9999995 2023-08-01T19:55:13.877 INFO:teuthology.orchestra.run.smithi155.stdout: }, 2023-08-01T19:55:13.877 INFO:teuthology.orchestra.run.smithi155.stdout: { 2023-08-01T19:55:13.877 INFO:teuthology.orchestra.run.smithi155.stdout: "event": "all_read", 2023-08-01T19:55:13.877 INFO:teuthology.orchestra.run.smithi155.stdout: "time": "2023-08-01T19:55:05.147766+0000", 2023-08-01T19:55:13.877 INFO:teuthology.orchestra.run.smithi155.stdout: "duration": 3.0394000000000001e-05 2023-08-01T19:55:13.878 INFO:teuthology.orchestra.run.smithi155.stdout: }, 2023-08-01T19:55:13.878 INFO:teuthology.orchestra.run.smithi155.stdout: { 2023-08-01T19:55:13.878 INFO:teuthology.orchestra.run.smithi155.stdout: "event": "dispatched", 2023-08-01T19:55:13.878 INFO:teuthology.orchestra.run.smithi155.stdout: "time": "2023-08-01T19:55:05.147771+0000", 2023-08-01T19:55:13.878 INFO:teuthology.orchestra.run.smithi155.stdout: "duration": 4.25e-06 2023-08-01T19:55:13.878 INFO:teuthology.orchestra.run.smithi155.stdout: }, 2023-08-01T19:55:13.878 INFO:teuthology.orchestra.run.smithi155.stdout: { 2023-08-01T19:55:13.878 INFO:teuthology.orchestra.run.smithi155.stdout: "event": "queued_for_pg", 2023-08-01T19:55:13.879 INFO:teuthology.orchestra.run.smithi155.stdout: "time": "2023-08-01T19:55:05.147773+0000", 2023-08-01T19:55:13.879 INFO:teuthology.orchestra.run.smithi155.stdout: "duration": 2.4159999999999998e-06 2023-08-01T19:55:13.879 INFO:teuthology.orchestra.run.smithi155.stdout: }, 2023-08-01T19:55:13.879 INFO:teuthology.orchestra.run.smithi155.stdout: { 2023-08-01T19:55:13.879 INFO:teuthology.orchestra.run.smithi155.stdout: "event": "reached_pg", 2023-08-01T19:55:13.879 INFO:teuthology.orchestra.run.smithi155.stdout: "time": "2023-08-01T19:55:05.149903+0000", 2023-08-01T19:55:13.879 INFO:teuthology.orchestra.run.smithi155.stdout: "duration": 0.002129948 2023-08-01T19:55:13.879 INFO:teuthology.orchestra.run.smithi155.stdout: }, 2023-08-01T19:55:13.880 INFO:teuthology.orchestra.run.smithi155.stdout: { 2023-08-01T19:55:13.880 INFO:teuthology.orchestra.run.smithi155.stdout: "event": "started", 2023-08-01T19:55:13.880 INFO:teuthology.orchestra.run.smithi155.stdout: "time": "2023-08-01T19:55:05.149982+0000", 2023-08-01T19:55:13.880 INFO:teuthology.orchestra.run.smithi155.stdout: "duration": 7.8706000000000002e-05 2023-08-01T19:55:13.880 INFO:teuthology.orchestra.run.smithi155.stdout: }, 2023-08-01T19:55:13.880 INFO:teuthology.orchestra.run.smithi155.stdout: { 2023-08-01T19:55:13.880 INFO:teuthology.orchestra.run.smithi155.stdout: "event": "waiting for subops from 0", 2023-08-01T19:55:13.880 INFO:teuthology.orchestra.run.smithi155.stdout: "time": "2023-08-01T19:55:05.150066+0000", 2023-08-01T19:55:13.881 INFO:teuthology.orchestra.run.smithi155.stdout: "duration": 8.4241999999999997e-05 2023-08-01T19:55:13.881 INFO:teuthology.orchestra.run.smithi155.stdout: }, 2023-08-01T19:55:13.881 INFO:teuthology.orchestra.run.smithi155.stdout: { 2023-08-01T19:55:13.881 INFO:teuthology.orchestra.run.smithi155.stdout: "event": "op_commit", 2023-08-01T19:55:13.881 INFO:teuthology.orchestra.run.smithi155.stdout: "time": "2023-08-01T19:55:05.154994+0000", 2023-08-01T19:55:13.881 INFO:teuthology.orchestra.run.smithi155.stdout: "duration": 0.0049277050000000001 2023-08-01T19:55:13.881 INFO:teuthology.orchestra.run.smithi155.stdout: }, 2023-08-01T19:55:13.882 INFO:teuthology.orchestra.run.smithi155.stdout: { 2023-08-01T19:55:13.882 INFO:teuthology.orchestra.run.smithi155.stdout: "event": "sub_op_commit_rec", 2023-08-01T19:55:13.882 INFO:teuthology.orchestra.run.smithi155.stdout: "time": "2023-08-01T19:55:05.218933+0000", 2023-08-01T19:55:13.882 INFO:teuthology.orchestra.run.smithi155.stdout: "duration": 0.063939916999999999 2023-08-01T19:55:13.882 INFO:teuthology.orchestra.run.smithi155.stdout: }, 2023-08-01T19:55:13.882 INFO:teuthology.orchestra.run.smithi155.stdout: { 2023-08-01T19:55:13.882 INFO:teuthology.orchestra.run.smithi155.stdout: "event": "commit_sent", 2023-08-01T19:55:13.882 INFO:teuthology.orchestra.run.smithi155.stdout: "time": "2023-08-01T19:55:05.218989+0000", 2023-08-01T19:55:13.883 INFO:teuthology.orchestra.run.smithi155.stdout: "duration": 5.5772000000000001e-05 2023-08-01T19:55:13.883 INFO:teuthology.orchestra.run.smithi155.stdout: }, 2023-08-01T19:55:13.883 INFO:teuthology.orchestra.run.smithi155.stdout: { 2023-08-01T19:55:13.883 INFO:teuthology.orchestra.run.smithi155.stdout: "event": "done", 2023-08-01T19:55:13.883 INFO:teuthology.orchestra.run.smithi155.stdout: "time": "2023-08-01T19:55:05.219036+0000", 2023-08-01T19:55:13.883 INFO:teuthology.orchestra.run.smithi155.stdout: "duration": 4.6526000000000001e-05 2023-08-01T19:55:13.883 INFO:teuthology.orchestra.run.smithi155.stdout: } 2023-08-01T19:55:13.883 INFO:teuthology.orchestra.run.smithi155.stdout: ] 2023-08-01T19:55:13.884 INFO:teuthology.orchestra.run.smithi155.stdout: } 2023-08-01T19:55:13.884 INFO:teuthology.orchestra.run.smithi155.stdout: }, 2023-08-01T19:55:13.884 INFO:teuthology.orchestra.run.smithi155.stdout: { 2023-08-01T19:55:13.884 INFO:teuthology.orchestra.run.smithi155.stdout: "description": "osd_op(client.4668.0:100242 5.8 5:16a314b8:::benchmark_data_smithi006_114134_object100241:head [set-alloc-hint object_size 65536 write_size 65536,write 0~65536] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e37)", 2023-08-01T19:55:13.884 INFO:teuthology.orchestra.run.smithi155.stdout: "initiated_at": "2023-08-01T19:55:05.150616+0000", 2023-08-01T19:55:13.884 INFO:teuthology.orchestra.run.smithi155.stdout: "age": 8.6868702199999994, 2023-08-01T19:55:13.884 INFO:teuthology.orchestra.run.smithi155.stdout: "duration": 0.071105065999999995, 2023-08-01T19:55:13.885 INFO:teuthology.orchestra.run.smithi155.stdout: "type_data": { 2023-08-01T19:55:13.885 INFO:teuthology.orchestra.run.smithi155.stdout: "flag_point": "commit sent; apply or cleanup", 2023-08-01T19:55:13.885 INFO:teuthology.orchestra.run.smithi155.stdout: "client_info": { 2023-08-01T19:55:13.885 INFO:teuthology.orchestra.run.smithi155.stdout: "client": "client.4668", 2023-08-01T19:55:13.885 INFO:teuthology.orchestra.run.smithi155.stdout: "client_addr": "172.21.15.6:0/1709472247", 2023-08-01T19:55:13.885 INFO:teuthology.orchestra.run.smithi155.stdout: "tid": 100242 2023-08-01T19:55:13.885 INFO:teuthology.orchestra.run.smithi155.stdout: }, 2023-08-01T19:55:13.885 INFO:teuthology.orchestra.run.smithi155.stdout: "events": [ 2023-08-01T19:55:13.886 INFO:teuthology.orchestra.run.smithi155.stdout: { 2023-08-01T19:55:13.886 INFO:teuthology.orchestra.run.smithi155.stdout: "event": "initiated", 2023-08-01T19:55:13.886 INFO:teuthology.orchestra.run.smithi155.stdout: "time": "2023-08-01T19:55:05.150616+0000", 2023-08-01T19:55:13.886 INFO:teuthology.orchestra.run.smithi155.stdout: "duration": 0 2023-08-01T19:55:13.886 INFO:teuthology.orchestra.run.smithi155.stdout: }, 2023-08-01T19:55:13.886 INFO:teuthology.orchestra.run.smithi155.stdout: { 2023-08-01T19:55:13.886 INFO:teuthology.orchestra.run.smithi155.stdout: "event": "throttled", 2023-08-01T19:55:13.886 INFO:teuthology.orchestra.run.smithi155.stdout: "time": "2023-08-01T19:55:05.150616+0000", 2023-08-01T19:55:13.887 INFO:teuthology.orchestra.run.smithi155.stdout: "duration": 0 2023-08-01T19:55:13.887 INFO:teuthology.orchestra.run.smithi155.stdout: }, 2023-08-01T19:55:13.887 INFO:teuthology.orchestra.run.smithi155.stdout: { 2023-08-01T19:55:13.887 INFO:teuthology.orchestra.run.smithi155.stdout: "event": "header_read", 2023-08-01T19:55:13.887 INFO:teuthology.orchestra.run.smithi155.stdout: "time": "2023-08-01T19:55:05.150615+0000", 2023-08-01T19:55:13.887 INFO:teuthology.orchestra.run.smithi155.stdout: "duration": 4294967295.999999 2023-08-01T19:55:13.887 INFO:teuthology.orchestra.run.smithi155.stdout: }, 2023-08-01T19:55:13.887 INFO:teuthology.orchestra.run.smithi155.stdout: { 2023-08-01T19:55:13.888 INFO:teuthology.orchestra.run.smithi155.stdout: "event": "all_read", 2023-08-01T19:55:13.888 INFO:teuthology.orchestra.run.smithi155.stdout: "time": "2023-08-01T19:55:05.150696+0000", 2023-08-01T19:55:13.888 INFO:teuthology.orchestra.run.smithi155.stdout: "duration": 8.0852000000000004e-05 2023-08-01T19:55:13.888 INFO:teuthology.orchestra.run.smithi155.stdout: }, 2023-08-01T19:55:13.888 INFO:teuthology.orchestra.run.smithi155.stdout: { 2023-08-01T19:55:13.888 INFO:teuthology.orchestra.run.smithi155.stdout: "event": "dispatched", 2023-08-01T19:55:13.888 INFO:teuthology.orchestra.run.smithi155.stdout: "time": "2023-08-01T19:55:05.150708+0000", 2023-08-01T19:55:13.888 INFO:teuthology.orchestra.run.smithi155.stdout: "duration": 1.2116999999999999e-05 2023-08-01T19:55:13.889 INFO:teuthology.orchestra.run.smithi155.stdout: }, 2023-08-01T19:55:13.889 INFO:teuthology.orchestra.run.smithi155.stdout: { 2023-08-01T19:55:13.889 INFO:teuthology.orchestra.run.smithi155.stdout: "event": "queued_for_pg", 2023-08-01T19:55:13.889 INFO:teuthology.orchestra.run.smithi155.stdout: "time": "2023-08-01T19:55:05.150713+0000", 2023-08-01T19:55:13.889 INFO:teuthology.orchestra.run.smithi155.stdout: "duration": 5.4620000000000004e-06 2023-08-01T19:55:13.889 INFO:teuthology.orchestra.run.smithi155.stdout: }, 2023-08-01T19:55:13.889 INFO:teuthology.orchestra.run.smithi155.stdout: { 2023-08-01T19:55:13.889 INFO:teuthology.orchestra.run.smithi155.stdout: "event": "reached_pg", 2023-08-01T19:55:13.890 INFO:teuthology.orchestra.run.smithi155.stdout: "time": "2023-08-01T19:55:05.150761+0000", 2023-08-01T19:55:13.890 INFO:teuthology.orchestra.run.smithi155.stdout: "duration": 4.7429000000000003e-05 2023-08-01T19:55:13.890 INFO:teuthology.orchestra.run.smithi155.stdout: }, 2023-08-01T19:55:13.890 INFO:teuthology.orchestra.run.smithi155.stdout: { 2023-08-01T19:55:13.890 INFO:teuthology.orchestra.run.smithi155.stdout: "event": "started", 2023-08-01T19:55:13.890 INFO:teuthology.orchestra.run.smithi155.stdout: "time": "2023-08-01T19:55:05.150856+0000", 2023-08-01T19:55:13.890 INFO:teuthology.orchestra.run.smithi155.stdout: "duration": 9.5356e-05 2023-08-01T19:55:13.890 INFO:teuthology.orchestra.run.smithi155.stdout: }, 2023-08-01T19:55:13.891 INFO:teuthology.orchestra.run.smithi155.stdout: { 2023-08-01T19:55:13.891 INFO:teuthology.orchestra.run.smithi155.stdout: "event": "waiting for subops from 0", 2023-08-01T19:55:13.891 INFO:teuthology.orchestra.run.smithi155.stdout: "time": "2023-08-01T19:55:05.150999+0000", 2023-08-01T19:55:13.891 INFO:teuthology.orchestra.run.smithi155.stdout: "duration": 0.00014234499999999999 2023-08-01T19:55:13.891 INFO:teuthology.orchestra.run.smithi155.stdout: }, 2023-08-01T19:55:13.891 INFO:teuthology.orchestra.run.smithi155.stdout: { 2023-08-01T19:55:13.891 INFO:teuthology.orchestra.run.smithi155.stdout: "event": "sub_op_commit_rec", 2023-08-01T19:55:13.892 INFO:teuthology.orchestra.run.smithi155.stdout: "time": "2023-08-01T19:55:05.219001+0000", 2023-08-01T19:55:13.892 INFO:teuthology.orchestra.run.smithi155.stdout: "duration": 0.068002776000000001 2023-08-01T19:55:13.892 INFO:teuthology.orchestra.run.smithi155.stdout: }, 2023-08-01T19:55:13.892 INFO:teuthology.orchestra.run.smithi155.stdout: { 2023-08-01T19:55:13.892 INFO:teuthology.orchestra.run.smithi155.stdout: "event": "op_commit", 2023-08-01T19:55:13.892 INFO:teuthology.orchestra.run.smithi155.stdout: "time": "2023-08-01T19:55:05.221635+0000", 2023-08-01T19:55:13.892 INFO:teuthology.orchestra.run.smithi155.stdout: "duration": 0.0026340579999999999 2023-08-01T19:55:13.892 INFO:teuthology.orchestra.run.smithi155.stdout: }, 2023-08-01T19:55:13.893 INFO:teuthology.orchestra.run.smithi155.stdout: { 2023-08-01T19:55:13.893 INFO:teuthology.orchestra.run.smithi155.stdout: "event": "commit_sent", 2023-08-01T19:55:13.893 INFO:teuthology.orchestra.run.smithi155.stdout: "time": "2023-08-01T19:55:05.221682+0000", 2023-08-01T19:55:13.893 INFO:teuthology.orchestra.run.smithi155.stdout: "duration": 4.7123999999999998e-05 2023-08-01T19:55:13.893 INFO:teuthology.orchestra.run.smithi155.stdout: }, 2023-08-01T19:55:13.893 INFO:teuthology.orchestra.run.smithi155.stdout: { 2023-08-01T19:55:13.893 INFO:teuthology.orchestra.run.smithi155.stdout: "event": "done", 2023-08-01T19:55:13.893 INFO:teuthology.orchestra.run.smithi155.stdout: "time": "2023-08-01T19:55:05.221721+0000", 2023-08-01T19:55:13.894 INFO:teuthology.orchestra.run.smithi155.stdout: "duration": 3.8529999999999999e-05 2023-08-01T19:55:13.894 INFO:teuthology.orchestra.run.smithi155.stdout: } 2023-08-01T19:55:13.894 INFO:teuthology.orchestra.run.smithi155.stdout: ] 2023-08-01T19:55:13.894 INFO:teuthology.orchestra.run.smithi155.stdout: } 2023-08-01T19:55:13.894 INFO:teuthology.orchestra.run.smithi155.stdout: }, 2023-08-01T19:55:13.894 INFO:teuthology.orchestra.run.smithi155.stdout: { 2023-08-01T19:55:13.894 INFO:teuthology.orchestra.run.smithi155.stdout: "description": "osd_repop(client.4668.0:100240 5.a e37/19 5:5313c5b9:::benchmark_data_smithi006_114134_object100239:head v 37'6227, mlcod=37'6225)", 2023-08-01T19:55:13.894 INFO:teuthology.orchestra.run.smithi155.stdout: "initiated_at": "2023-08-01T19:55:05.150778+0000", 2023-08-01T19:55:13.895 INFO:teuthology.orchestra.run.smithi155.stdout: "age": 8.6867080189999992, 2023-08-01T19:55:13.895 INFO:teuthology.orchestra.run.smithi155.stdout: "duration": 0.073362533999999993, 2023-08-01T19:55:13.895 INFO:teuthology.orchestra.run.smithi155.stdout: "type_data": { 2023-08-01T19:55:13.895 INFO:teuthology.orchestra.run.smithi155.stdout: "flag_point": "commit sent; apply or cleanup", 2023-08-01T19:55:13.895 INFO:teuthology.orchestra.run.smithi155.stdout: "events": [ 2023-08-01T19:55:13.895 INFO:teuthology.orchestra.run.smithi155.stdout: { 2023-08-01T19:55:13.895 INFO:teuthology.orchestra.run.smithi155.stdout: "event": "initiated", 2023-08-01T19:55:13.896 INFO:teuthology.orchestra.run.smithi155.stdout: "time": "2023-08-01T19:55:05.150778+0000", 2023-08-01T19:55:13.896 INFO:teuthology.orchestra.run.smithi155.stdout: "duration": 0 2023-08-01T19:55:13.896 INFO:teuthology.orchestra.run.smithi155.stdout: }, 2023-08-01T19:55:13.896 INFO:teuthology.orchestra.run.smithi155.stdout: { 2023-08-01T19:55:13.896 INFO:teuthology.orchestra.run.smithi155.stdout: "event": "throttled", 2023-08-01T19:55:13.896 INFO:teuthology.orchestra.run.smithi155.stdout: "time": "2023-08-01T19:55:05.150778+0000", 2023-08-01T19:55:13.896 INFO:teuthology.orchestra.run.smithi155.stdout: "duration": 0 2023-08-01T19:55:13.896 INFO:teuthology.orchestra.run.smithi155.stdout: }, 2023-08-01T19:55:13.897 INFO:teuthology.orchestra.run.smithi155.stdout: { 2023-08-01T19:55:13.897 INFO:teuthology.orchestra.run.smithi155.stdout: "event": "header_read", 2023-08-01T19:55:13.897 INFO:teuthology.orchestra.run.smithi155.stdout: "time": "2023-08-01T19:55:05.150778+0000", 2023-08-01T19:55:13.897 INFO:teuthology.orchestra.run.smithi155.stdout: "duration": 4294967295.9999995 2023-08-01T19:55:13.897 INFO:teuthology.orchestra.run.smithi155.stdout: }, 2023-08-01T19:55:13.897 INFO:teuthology.orchestra.run.smithi155.stdout: { 2023-08-01T19:55:13.897 INFO:teuthology.orchestra.run.smithi155.stdout: "event": "all_read", 2023-08-01T19:55:13.897 INFO:teuthology.orchestra.run.smithi155.stdout: "time": "2023-08-01T19:55:05.150811+0000", 2023-08-01T19:55:13.898 INFO:teuthology.orchestra.run.smithi155.stdout: "duration": 3.3664000000000002e-05 2023-08-01T19:55:13.898 INFO:teuthology.orchestra.run.smithi155.stdout: }, 2023-08-01T19:55:13.898 INFO:teuthology.orchestra.run.smithi155.stdout: { 2023-08-01T19:55:13.898 INFO:teuthology.orchestra.run.smithi155.stdout: "event": "dispatched", 2023-08-01T19:55:13.898 INFO:teuthology.orchestra.run.smithi155.stdout: "time": "2023-08-01T19:55:05.150818+0000", 2023-08-01T19:55:13.898 INFO:teuthology.orchestra.run.smithi155.stdout: "duration": 6.5769999999999999e-06 2023-08-01T19:55:13.898 INFO:teuthology.orchestra.run.smithi155.stdout: }, 2023-08-01T19:55:13.898 INFO:teuthology.orchestra.run.smithi155.stdout: { 2023-08-01T19:55:13.899 INFO:teuthology.orchestra.run.smithi155.stdout: "event": "queued_for_pg", 2023-08-01T19:55:13.899 INFO:teuthology.orchestra.run.smithi155.stdout: "time": "2023-08-01T19:55:05.150822+0000", 2023-08-01T19:55:13.899 INFO:teuthology.orchestra.run.smithi155.stdout: "duration": 4.0060000000000003e-06 2023-08-01T19:55:13.899 INFO:teuthology.orchestra.run.smithi155.stdout: }, 2023-08-01T19:55:13.899 INFO:teuthology.orchestra.run.smithi155.stdout: { 2023-08-01T19:55:13.899 INFO:teuthology.orchestra.run.smithi155.stdout: "event": "reached_pg", 2023-08-01T19:55:13.899 INFO:teuthology.orchestra.run.smithi155.stdout: "time": "2023-08-01T19:55:05.150855+0000", 2023-08-01T19:55:13.899 INFO:teuthology.orchestra.run.smithi155.stdout: "duration": 3.3204999999999998e-05 2023-08-01T19:55:13.900 INFO:teuthology.orchestra.run.smithi155.stdout: }, 2023-08-01T19:55:13.900 INFO:teuthology.orchestra.run.smithi155.stdout: { 2023-08-01T19:55:13.900 INFO:teuthology.orchestra.run.smithi155.stdout: "event": "started", 2023-08-01T19:55:13.900 INFO:teuthology.orchestra.run.smithi155.stdout: "time": "2023-08-01T19:55:05.150873+0000", 2023-08-01T19:55:13.900 INFO:teuthology.orchestra.run.smithi155.stdout: "duration": 1.8139999999999999e-05 2023-08-01T19:55:13.900 INFO:teuthology.orchestra.run.smithi155.stdout: }, 2023-08-01T19:55:13.900 INFO:teuthology.orchestra.run.smithi155.stdout: { 2023-08-01T19:55:13.901 INFO:teuthology.orchestra.run.smithi155.stdout: "event": "commit_sent", 2023-08-01T19:55:13.901 INFO:teuthology.orchestra.run.smithi155.stdout: "time": "2023-08-01T19:55:05.224095+0000", 2023-08-01T19:55:13.901 INFO:teuthology.orchestra.run.smithi155.stdout: "duration": 0.073221895999999995 2023-08-01T19:55:13.901 INFO:teuthology.orchestra.run.smithi155.stdout: }, 2023-08-01T19:55:13.901 INFO:teuthology.orchestra.run.smithi155.stdout: { 2023-08-01T19:55:13.901 INFO:teuthology.orchestra.run.smithi155.stdout: "event": "done", 2023-08-01T19:55:13.901 INFO:teuthology.orchestra.run.smithi155.stdout: "time": "2023-08-01T19:55:05.224141+0000", 2023-08-01T19:55:13.901 INFO:teuthology.orchestra.run.smithi155.stdout: "duration": 4.5385e-05 2023-08-01T19:55:13.902 INFO:teuthology.orchestra.run.smithi155.stdout: } 2023-08-01T19:55:13.902 INFO:teuthology.orchestra.run.smithi155.stdout: ] 2023-08-01T19:55:13.902 INFO:teuthology.orchestra.run.smithi155.stdout: } 2023-08-01T19:55:13.902 INFO:teuthology.orchestra.run.smithi155.stdout: }, 2023-08-01T19:55:13.902 INFO:teuthology.orchestra.run.smithi155.stdout: { 2023-08-01T19:55:13.902 INFO:teuthology.orchestra.run.smithi155.stdout: "description": "osd_op(client.4668.0:100245 5.e 5:71869c66:::benchmark_data_smithi006_114134_object100244:head [set-alloc-hint object_size 65536 write_size 65536,write 0~65536] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e37)", 2023-08-01T19:55:13.902 INFO:teuthology.orchestra.run.smithi155.stdout: "initiated_at": "2023-08-01T19:55:05.150991+0000", 2023-08-01T19:55:13.902 INFO:teuthology.orchestra.run.smithi155.stdout: "age": 8.6864952320000004, 2023-08-01T19:55:13.903 INFO:teuthology.orchestra.run.smithi155.stdout: "duration": 0.070734490999999997, 2023-08-01T19:55:13.903 INFO:teuthology.orchestra.run.smithi155.stdout: "type_data": { 2023-08-01T19:55:13.903 INFO:teuthology.orchestra.run.smithi155.stdout: "flag_point": "commit sent; apply or cleanup", 2023-08-01T19:55:13.903 INFO:teuthology.orchestra.run.smithi155.stdout: "client_info": { 2023-08-01T19:55:13.903 INFO:teuthology.orchestra.run.smithi155.stdout: "client": "client.4668", 2023-08-01T19:55:13.903 INFO:teuthology.orchestra.run.smithi155.stdout: "client_addr": "172.21.15.6:0/1709472247", 2023-08-01T19:55:13.903 INFO:teuthology.orchestra.run.smithi155.stdout: "tid": 100245 2023-08-01T19:55:13.903 INFO:teuthology.orchestra.run.smithi155.stdout: }, 2023-08-01T19:55:13.904 INFO:teuthology.orchestra.run.smithi155.stdout: "events": [ 2023-08-01T19:55:13.904 INFO:teuthology.orchestra.run.smithi155.stdout: { 2023-08-01T19:55:13.904 INFO:teuthology.orchestra.run.smithi155.stdout: "event": "initiated", 2023-08-01T19:55:13.904 INFO:teuthology.orchestra.run.smithi155.stdout: "time": "2023-08-01T19:55:05.150991+0000", 2023-08-01T19:55:13.904 INFO:teuthology.orchestra.run.smithi155.stdout: "duration": 0 2023-08-01T19:55:13.904 INFO:teuthology.orchestra.run.smithi155.stdout: }, 2023-08-01T19:55:13.904 INFO:teuthology.orchestra.run.smithi155.stdout: { 2023-08-01T19:55:13.905 INFO:teuthology.orchestra.run.smithi155.stdout: "event": "throttled", 2023-08-01T19:55:13.905 INFO:teuthology.orchestra.run.smithi155.stdout: "time": "2023-08-01T19:55:05.150991+0000", 2023-08-01T19:55:13.905 INFO:teuthology.orchestra.run.smithi155.stdout: "duration": 0 2023-08-01T19:55:13.905 INFO:teuthology.orchestra.run.smithi155.stdout: }, 2023-08-01T19:55:13.905 INFO:teuthology.orchestra.run.smithi155.stdout: { 2023-08-01T19:55:13.905 INFO:teuthology.orchestra.run.smithi155.stdout: "event": "header_read", 2023-08-01T19:55:13.905 INFO:teuthology.orchestra.run.smithi155.stdout: "time": "2023-08-01T19:55:05.150990+0000", 2023-08-01T19:55:13.905 INFO:teuthology.orchestra.run.smithi155.stdout: "duration": 4294967295.999999 2023-08-01T19:55:13.906 INFO:teuthology.orchestra.run.smithi155.stdout: }, 2023-08-01T19:55:13.906 INFO:teuthology.orchestra.run.smithi155.stdout: { 2023-08-01T19:55:13.906 INFO:teuthology.orchestra.run.smithi155.stdout: "event": "all_read", 2023-08-01T19:55:13.906 INFO:teuthology.orchestra.run.smithi155.stdout: "time": "2023-08-01T19:55:05.151108+0000", 2023-08-01T19:55:13.906 INFO:teuthology.orchestra.run.smithi155.stdout: "duration": 0.00011849300000000001 2023-08-01T19:55:13.906 INFO:teuthology.orchestra.run.smithi155.stdout: }, 2023-08-01T19:55:13.906 INFO:teuthology.orchestra.run.smithi155.stdout: { 2023-08-01T19:55:13.906 INFO:teuthology.orchestra.run.smithi155.stdout: "event": "dispatched", 2023-08-01T19:55:13.907 INFO:teuthology.orchestra.run.smithi155.stdout: "time": "2023-08-01T19:55:05.151117+0000", 2023-08-01T19:55:13.907 INFO:teuthology.orchestra.run.smithi155.stdout: "duration": 8.1040000000000007e-06 2023-08-01T19:55:13.907 INFO:teuthology.orchestra.run.smithi155.stdout: }, 2023-08-01T19:55:13.907 INFO:teuthology.orchestra.run.smithi155.stdout: { 2023-08-01T19:55:13.907 INFO:teuthology.orchestra.run.smithi155.stdout: "event": "queued_for_pg", 2023-08-01T19:55:13.907 INFO:teuthology.orchestra.run.smithi155.stdout: "time": "2023-08-01T19:55:05.151121+0000", 2023-08-01T19:55:13.907 INFO:teuthology.orchestra.run.smithi155.stdout: "duration": 4.2019999999999997e-06 2023-08-01T19:55:13.907 INFO:teuthology.orchestra.run.smithi155.stdout: }, 2023-08-01T19:55:13.908 INFO:teuthology.orchestra.run.smithi155.stdout: { 2023-08-01T19:55:13.908 INFO:teuthology.orchestra.run.smithi155.stdout: "event": "reached_pg", 2023-08-01T19:55:13.908 INFO:teuthology.orchestra.run.smithi155.stdout: "time": "2023-08-01T19:55:05.151162+0000", 2023-08-01T19:55:13.908 INFO:teuthology.orchestra.run.smithi155.stdout: "duration": 4.1448e-05 2023-08-01T19:55:13.908 INFO:teuthology.orchestra.run.smithi155.stdout: }, 2023-08-01T19:55:13.908 INFO:teuthology.orchestra.run.smithi155.stdout: { 2023-08-01T19:55:13.908 INFO:teuthology.orchestra.run.smithi155.stdout: "event": "started", 2023-08-01T19:55:13.908 INFO:teuthology.orchestra.run.smithi155.stdout: "time": "2023-08-01T19:55:05.151281+0000", 2023-08-01T19:55:13.909 INFO:teuthology.orchestra.run.smithi155.stdout: "duration": 0.000119141 2023-08-01T19:55:13.909 INFO:teuthology.orchestra.run.smithi155.stdout: }, 2023-08-01T19:55:13.909 INFO:teuthology.orchestra.run.smithi155.stdout: { 2023-08-01T19:55:13.909 INFO:teuthology.orchestra.run.smithi155.stdout: "event": "waiting for subops from 0", 2023-08-01T19:55:13.909 INFO:teuthology.orchestra.run.smithi155.stdout: "time": "2023-08-01T19:55:05.151443+0000", 2023-08-01T19:55:13.909 INFO:teuthology.orchestra.run.smithi155.stdout: "duration": 0.00016181600000000001 2023-08-01T19:55:13.909 INFO:teuthology.orchestra.run.smithi155.stdout: }, 2023-08-01T19:55:13.909 INFO:teuthology.orchestra.run.smithi155.stdout: { 2023-08-01T19:55:13.910 INFO:teuthology.orchestra.run.smithi155.stdout: "event": "sub_op_commit_rec", 2023-08-01T19:55:13.910 INFO:teuthology.orchestra.run.smithi155.stdout: "time": "2023-08-01T19:55:05.219101+0000", 2023-08-01T19:55:13.910 INFO:teuthology.orchestra.run.smithi155.stdout: "duration": 0.067658037000000004 2023-08-01T19:55:13.910 INFO:teuthology.orchestra.run.smithi155.stdout: }, 2023-08-01T19:55:13.910 INFO:teuthology.orchestra.run.smithi155.stdout: { 2023-08-01T19:55:13.910 INFO:teuthology.orchestra.run.smithi155.stdout: "event": "op_commit", 2023-08-01T19:55:13.910 INFO:teuthology.orchestra.run.smithi155.stdout: "time": "2023-08-01T19:55:05.221646+0000", 2023-08-01T19:55:13.910 INFO:teuthology.orchestra.run.smithi155.stdout: "duration": 0.0025450540000000002 2023-08-01T19:55:13.911 INFO:teuthology.orchestra.run.smithi155.stdout: }, 2023-08-01T19:55:13.911 INFO:teuthology.orchestra.run.smithi155.stdout: { 2023-08-01T19:55:13.911 INFO:teuthology.orchestra.run.smithi155.stdout: "event": "commit_sent", 2023-08-01T19:55:13.911 INFO:teuthology.orchestra.run.smithi155.stdout: "time": "2023-08-01T19:55:05.221689+0000", 2023-08-01T19:55:13.911 INFO:teuthology.orchestra.run.smithi155.stdout: "duration": 4.3078999999999999e-05 2023-08-01T19:55:13.911 INFO:teuthology.orchestra.run.smithi155.stdout: }, 2023-08-01T19:55:13.911 INFO:teuthology.orchestra.run.smithi155.stdout: { 2023-08-01T19:55:13.912 INFO:teuthology.orchestra.run.smithi155.stdout: "event": "done", 2023-08-01T19:55:13.912 INFO:teuthology.orchestra.run.smithi155.stdout: "time": "2023-08-01T19:55:05.221725+0000", 2023-08-01T19:55:13.912 INFO:teuthology.orchestra.run.smithi155.stdout: "duration": 3.6137999999999999e-05 2023-08-01T19:55:13.912 INFO:teuthology.orchestra.run.smithi155.stdout: } 2023-08-01T19:55:13.912 INFO:teuthology.orchestra.run.smithi155.stdout: ] 2023-08-01T19:55:13.912 INFO:teuthology.orchestra.run.smithi155.stdout: } 2023-08-01T19:55:13.912 INFO:teuthology.orchestra.run.smithi155.stdout: }, 2023-08-01T19:55:13.912 INFO:teuthology.orchestra.run.smithi155.stdout: { 2023-08-01T19:55:13.913 INFO:teuthology.orchestra.run.smithi155.stdout: "description": "osd_repop(client.4668.0:100243 5.a e37/19 5:5e8193b6:::benchmark_data_smithi006_114134_object100242:head v 37'6228, mlcod=37'6225)", 2023-08-01T19:55:13.913 INFO:teuthology.orchestra.run.smithi155.stdout: "initiated_at": "2023-08-01T19:55:05.151148+0000", 2023-08-01T19:55:13.913 INFO:teuthology.orchestra.run.smithi155.stdout: "age": 8.6863382209999997, 2023-08-01T19:55:13.913 INFO:teuthology.orchestra.run.smithi155.stdout: "duration": 0.073020370000000001, 2023-08-01T19:55:13.913 INFO:teuthology.orchestra.run.smithi155.stdout: "type_data": { 2023-08-01T19:55:13.913 INFO:teuthology.orchestra.run.smithi155.stdout: "flag_point": "commit sent; apply or cleanup", 2023-08-01T19:55:13.913 INFO:teuthology.orchestra.run.smithi155.stdout: "events": [ 2023-08-01T19:55:13.913 INFO:teuthology.orchestra.run.smithi155.stdout: { 2023-08-01T19:55:13.914 INFO:teuthology.orchestra.run.smithi155.stdout: "event": "initiated", 2023-08-01T19:55:13.914 INFO:teuthology.orchestra.run.smithi155.stdout: "time": "2023-08-01T19:55:05.151148+0000", 2023-08-01T19:55:13.914 INFO:teuthology.orchestra.run.smithi155.stdout: "duration": 0 2023-08-01T19:55:13.914 INFO:teuthology.orchestra.run.smithi155.stdout: }, 2023-08-01T19:55:13.914 INFO:teuthology.orchestra.run.smithi155.stdout: { 2023-08-01T19:55:13.914 INFO:teuthology.orchestra.run.smithi155.stdout: "event": "throttled", 2023-08-01T19:55:13.914 INFO:teuthology.orchestra.run.smithi155.stdout: "time": "2023-08-01T19:55:05.151148+0000", 2023-08-01T19:55:13.914 INFO:teuthology.orchestra.run.smithi155.stdout: "duration": 0 2023-08-01T19:55:13.915 INFO:teuthology.orchestra.run.smithi155.stdout: }, 2023-08-01T19:55:13.915 INFO:teuthology.orchestra.run.smithi155.stdout: { 2023-08-01T19:55:13.915 INFO:teuthology.orchestra.run.smithi155.stdout: "event": "header_read", 2023-08-01T19:55:13.915 INFO:teuthology.orchestra.run.smithi155.stdout: "time": "2023-08-01T19:55:05.151147+0000", 2023-08-01T19:55:13.915 INFO:teuthology.orchestra.run.smithi155.stdout: "duration": 4294967295.9999995 2023-08-01T19:55:13.915 INFO:teuthology.orchestra.run.smithi155.stdout: }, 2023-08-01T19:55:13.915 INFO:teuthology.orchestra.run.smithi155.stdout: { 2023-08-01T19:55:13.915 INFO:teuthology.orchestra.run.smithi155.stdout: "event": "all_read", 2023-08-01T19:55:13.916 INFO:teuthology.orchestra.run.smithi155.stdout: "time": "2023-08-01T19:55:05.151231+0000", 2023-08-01T19:55:13.916 INFO:teuthology.orchestra.run.smithi155.stdout: "duration": 8.3135999999999998e-05 2023-08-01T19:55:13.916 INFO:teuthology.orchestra.run.smithi155.stdout: }, 2023-08-01T19:55:13.916 INFO:teuthology.orchestra.run.smithi155.stdout: { 2023-08-01T19:55:13.916 INFO:teuthology.orchestra.run.smithi155.stdout: "event": "dispatched", 2023-08-01T19:55:13.916 INFO:teuthology.orchestra.run.smithi155.stdout: "time": "2023-08-01T19:55:05.151239+0000", 2023-08-01T19:55:13.916 INFO:teuthology.orchestra.run.smithi155.stdout: "duration": 8.7469999999999994e-06 2023-08-01T19:55:13.917 INFO:teuthology.orchestra.run.smithi155.stdout: }, 2023-08-01T19:55:13.917 INFO:teuthology.orchestra.run.smithi155.stdout: { 2023-08-01T19:55:13.917 INFO:teuthology.orchestra.run.smithi155.stdout: "event": "queued_for_pg", 2023-08-01T19:55:13.917 INFO:teuthology.orchestra.run.smithi155.stdout: "time": "2023-08-01T19:55:05.151244+0000", 2023-08-01T19:55:13.917 INFO:teuthology.orchestra.run.smithi155.stdout: "duration": 4.4800000000000003e-06 2023-08-01T19:55:13.917 INFO:teuthology.orchestra.run.smithi155.stdout: }, 2023-08-01T19:55:13.917 INFO:teuthology.orchestra.run.smithi155.stdout: { 2023-08-01T19:55:13.917 INFO:teuthology.orchestra.run.smithi155.stdout: "event": "reached_pg", 2023-08-01T19:55:13.918 INFO:teuthology.orchestra.run.smithi155.stdout: "time": "2023-08-01T19:55:05.152938+0000", 2023-08-01T19:55:13.918 INFO:teuthology.orchestra.run.smithi155.stdout: "duration": 0.001693824 2023-08-01T19:55:13.918 INFO:teuthology.orchestra.run.smithi155.stdout: }, 2023-08-01T19:55:13.918 INFO:teuthology.orchestra.run.smithi155.stdout: { 2023-08-01T19:55:13.918 INFO:teuthology.orchestra.run.smithi155.stdout: "event": "started", 2023-08-01T19:55:13.918 INFO:teuthology.orchestra.run.smithi155.stdout: "time": "2023-08-01T19:55:05.152956+0000", 2023-08-01T19:55:13.918 INFO:teuthology.orchestra.run.smithi155.stdout: "duration": 1.8287e-05 2023-08-01T19:55:13.918 INFO:teuthology.orchestra.run.smithi155.stdout: }, 2023-08-01T19:55:13.919 INFO:teuthology.orchestra.run.smithi155.stdout: { 2023-08-01T19:55:13.919 INFO:teuthology.orchestra.run.smithi155.stdout: "event": "commit_sent", 2023-08-01T19:55:13.919 INFO:teuthology.orchestra.run.smithi155.stdout: "time": "2023-08-01T19:55:05.224145+0000", 2023-08-01T19:55:13.919 INFO:teuthology.orchestra.run.smithi155.stdout: "duration": 0.071189447000000003 2023-08-01T19:55:13.919 INFO:teuthology.orchestra.run.smithi155.stdout: }, 2023-08-01T19:55:13.919 INFO:teuthology.orchestra.run.smithi155.stdout: { 2023-08-01T19:55:13.919 INFO:teuthology.orchestra.run.smithi155.stdout: "event": "done", 2023-08-01T19:55:13.920 INFO:teuthology.orchestra.run.smithi155.stdout: "time": "2023-08-01T19:55:05.224168+0000", 2023-08-01T19:55:13.920 INFO:teuthology.orchestra.run.smithi155.stdout: "duration": 2.3008999999999999e-05 2023-08-01T19:55:13.920 INFO:teuthology.orchestra.run.smithi155.stdout: } 2023-08-01T19:55:13.920 INFO:teuthology.orchestra.run.smithi155.stdout: ] 2023-08-01T19:55:13.920 INFO:teuthology.orchestra.run.smithi155.stdout: } 2023-08-01T19:55:13.920 INFO:teuthology.orchestra.run.smithi155.stdout: }, 2023-08-01T19:55:13.920 INFO:teuthology.orchestra.run.smithi155.stdout: { 2023-08-01T19:55:13.920 INFO:teuthology.orchestra.run.smithi155.stdout: "description": "osd_repop(client.4668.0:100244 5.9 e37/19 5:92f56a12:::benchmark_data_smithi006_114134_object100243:head v 37'6294, mlcod=37'6292)", 2023-08-01T19:55:13.921 INFO:teuthology.orchestra.run.smithi155.stdout: "initiated_at": "2023-08-01T19:55:05.151325+0000", 2023-08-01T19:55:13.921 INFO:teuthology.orchestra.run.smithi155.stdout: "age": 8.6861608760000006, 2023-08-01T19:55:13.921 INFO:teuthology.orchestra.run.smithi155.stdout: "duration": 0.071883673999999995, 2023-08-01T19:55:13.921 INFO:teuthology.orchestra.run.smithi155.stdout: "type_data": { 2023-08-01T19:55:13.921 INFO:teuthology.orchestra.run.smithi155.stdout: "flag_point": "commit sent; apply or cleanup", 2023-08-01T19:55:13.921 INFO:teuthology.orchestra.run.smithi155.stdout: "events": [ 2023-08-01T19:55:13.921 INFO:teuthology.orchestra.run.smithi155.stdout: { 2023-08-01T19:55:13.921 INFO:teuthology.orchestra.run.smithi155.stdout: "event": "initiated", 2023-08-01T19:55:13.922 INFO:teuthology.orchestra.run.smithi155.stdout: "time": "2023-08-01T19:55:05.151325+0000", 2023-08-01T19:55:13.922 INFO:teuthology.orchestra.run.smithi155.stdout: "duration": 0 2023-08-01T19:55:13.922 INFO:teuthology.orchestra.run.smithi155.stdout: }, 2023-08-01T19:55:13.922 INFO:teuthology.orchestra.run.smithi155.stdout: { 2023-08-01T19:55:13.922 INFO:teuthology.orchestra.run.smithi155.stdout: "event": "throttled", 2023-08-01T19:55:13.922 INFO:teuthology.orchestra.run.smithi155.stdout: "time": "2023-08-01T19:55:05.151325+0000", 2023-08-01T19:55:13.922 INFO:teuthology.orchestra.run.smithi155.stdout: "duration": 0 2023-08-01T19:55:13.922 INFO:teuthology.orchestra.run.smithi155.stdout: }, 2023-08-01T19:55:13.923 INFO:teuthology.orchestra.run.smithi155.stdout: { 2023-08-01T19:55:13.923 INFO:teuthology.orchestra.run.smithi155.stdout: "event": "header_read", 2023-08-01T19:55:13.923 INFO:teuthology.orchestra.run.smithi155.stdout: "time": "2023-08-01T19:55:05.151325+0000", 2023-08-01T19:55:13.923 INFO:teuthology.orchestra.run.smithi155.stdout: "duration": 4294967295.9999995 2023-08-01T19:55:13.923 INFO:teuthology.orchestra.run.smithi155.stdout: }, 2023-08-01T19:55:13.923 INFO:teuthology.orchestra.run.smithi155.stdout: { 2023-08-01T19:55:13.923 INFO:teuthology.orchestra.run.smithi155.stdout: "event": "all_read", 2023-08-01T19:55:13.924 INFO:teuthology.orchestra.run.smithi155.stdout: "time": "2023-08-01T19:55:05.151390+0000", 2023-08-01T19:55:13.924 INFO:teuthology.orchestra.run.smithi155.stdout: "duration": 6.5456999999999993e-05 2023-08-01T19:55:13.924 INFO:teuthology.orchestra.run.smithi155.stdout: }, 2023-08-01T19:55:13.924 INFO:teuthology.orchestra.run.smithi155.stdout: { 2023-08-01T19:55:13.924 INFO:teuthology.orchestra.run.smithi155.stdout: "event": "dispatched", 2023-08-01T19:55:13.924 INFO:teuthology.orchestra.run.smithi155.stdout: "time": "2023-08-01T19:55:05.151396+0000", 2023-08-01T19:55:13.924 INFO:teuthology.orchestra.run.smithi155.stdout: "duration": 5.9190000000000004e-06 2023-08-01T19:55:13.925 INFO:teuthology.orchestra.run.smithi155.stdout: }, 2023-08-01T19:55:13.925 INFO:teuthology.orchestra.run.smithi155.stdout: { 2023-08-01T19:55:13.925 INFO:teuthology.orchestra.run.smithi155.stdout: "event": "queued_for_pg", 2023-08-01T19:55:13.925 INFO:teuthology.orchestra.run.smithi155.stdout: "time": "2023-08-01T19:55:05.151400+0000", 2023-08-01T19:55:13.925 INFO:teuthology.orchestra.run.smithi155.stdout: "duration": 4.1030000000000004e-06 2023-08-01T19:55:13.925 INFO:teuthology.orchestra.run.smithi155.stdout: }, 2023-08-01T19:55:13.925 INFO:teuthology.orchestra.run.smithi155.stdout: { 2023-08-01T19:55:13.925 INFO:teuthology.orchestra.run.smithi155.stdout: "event": "reached_pg", 2023-08-01T19:55:13.926 INFO:teuthology.orchestra.run.smithi155.stdout: "time": "2023-08-01T19:55:05.151452+0000", 2023-08-01T19:55:13.926 INFO:teuthology.orchestra.run.smithi155.stdout: "duration": 5.2136999999999999e-05 2023-08-01T19:55:13.926 INFO:teuthology.orchestra.run.smithi155.stdout: }, 2023-08-01T19:55:13.926 INFO:teuthology.orchestra.run.smithi155.stdout: { 2023-08-01T19:55:13.926 INFO:teuthology.orchestra.run.smithi155.stdout: "event": "started", 2023-08-01T19:55:13.926 INFO:teuthology.orchestra.run.smithi155.stdout: "time": "2023-08-01T19:55:05.151470+0000", 2023-08-01T19:55:13.926 INFO:teuthology.orchestra.run.smithi155.stdout: "duration": 1.8e-05 2023-08-01T19:55:13.926 INFO:teuthology.orchestra.run.smithi155.stdout: }, 2023-08-01T19:55:13.927 INFO:teuthology.orchestra.run.smithi155.stdout: { 2023-08-01T19:55:13.927 INFO:teuthology.orchestra.run.smithi155.stdout: "event": "commit_sent", 2023-08-01T19:55:13.927 INFO:teuthology.orchestra.run.smithi155.stdout: "time": "2023-08-01T19:55:05.223183+0000", 2023-08-01T19:55:13.927 INFO:teuthology.orchestra.run.smithi155.stdout: "duration": 0.071712622000000004 2023-08-01T19:55:13.927 INFO:teuthology.orchestra.run.smithi155.stdout: }, 2023-08-01T19:55:13.927 INFO:teuthology.orchestra.run.smithi155.stdout: { 2023-08-01T19:55:13.927 INFO:teuthology.orchestra.run.smithi155.stdout: "event": "done", 2023-08-01T19:55:13.927 INFO:teuthology.orchestra.run.smithi155.stdout: "time": "2023-08-01T19:55:05.223209+0000", 2023-08-01T19:55:13.928 INFO:teuthology.orchestra.run.smithi155.stdout: "duration": 2.5956e-05 2023-08-01T19:55:13.928 INFO:teuthology.orchestra.run.smithi155.stdout: } 2023-08-01T19:55:13.928 INFO:teuthology.orchestra.run.smithi155.stdout: ] 2023-08-01T19:55:13.928 INFO:teuthology.orchestra.run.smithi155.stdout: } 2023-08-01T19:55:13.928 INFO:teuthology.orchestra.run.smithi155.stdout: }, 2023-08-01T19:55:13.928 INFO:teuthology.orchestra.run.smithi155.stdout: { 2023-08-01T19:55:13.928 INFO:teuthology.orchestra.run.smithi155.stdout: "description": "osd_op(client.4668.0:100249 5.b 5:d0666827:::benchmark_data_smithi006_114134_object100248:head [set-alloc-hint object_size 65536 write_size 65536,write 0~65536] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e37)", 2023-08-01T19:55:13.929 INFO:teuthology.orchestra.run.smithi155.stdout: "initiated_at": "2023-08-01T19:55:05.153614+0000", 2023-08-01T19:55:13.929 INFO:teuthology.orchestra.run.smithi155.stdout: "age": 8.6838724509999992, 2023-08-01T19:55:13.929 INFO:teuthology.orchestra.run.smithi155.stdout: "duration": 0.069286118999999993, 2023-08-01T19:55:13.929 INFO:teuthology.orchestra.run.smithi155.stdout: "type_data": { 2023-08-01T19:55:13.929 INFO:teuthology.orchestra.run.smithi155.stdout: "flag_point": "commit sent; apply or cleanup", 2023-08-01T19:55:13.929 INFO:teuthology.orchestra.run.smithi155.stdout: "client_info": { 2023-08-01T19:55:13.929 INFO:teuthology.orchestra.run.smithi155.stdout: "client": "client.4668", 2023-08-01T19:55:13.929 INFO:teuthology.orchestra.run.smithi155.stdout: "client_addr": "172.21.15.6:0/1709472247", 2023-08-01T19:55:13.930 INFO:teuthology.orchestra.run.smithi155.stdout: "tid": 100249 2023-08-01T19:55:13.930 INFO:teuthology.orchestra.run.smithi155.stdout: }, 2023-08-01T19:55:13.930 INFO:teuthology.orchestra.run.smithi155.stdout: "events": [ 2023-08-01T19:55:13.930 INFO:teuthology.orchestra.run.smithi155.stdout: { 2023-08-01T19:55:13.930 INFO:teuthology.orchestra.run.smithi155.stdout: "event": "initiated", 2023-08-01T19:55:13.930 INFO:teuthology.orchestra.run.smithi155.stdout: "time": "2023-08-01T19:55:05.153614+0000", 2023-08-01T19:55:13.930 INFO:teuthology.orchestra.run.smithi155.stdout: "duration": 0 2023-08-01T19:55:13.931 INFO:teuthology.orchestra.run.smithi155.stdout: }, 2023-08-01T19:55:13.931 INFO:teuthology.orchestra.run.smithi155.stdout: { 2023-08-01T19:55:13.931 INFO:teuthology.orchestra.run.smithi155.stdout: "event": "throttled", 2023-08-01T19:55:13.931 INFO:teuthology.orchestra.run.smithi155.stdout: "time": "2023-08-01T19:55:05.153614+0000", 2023-08-01T19:55:13.931 INFO:teuthology.orchestra.run.smithi155.stdout: "duration": 0 2023-08-01T19:55:13.931 INFO:teuthology.orchestra.run.smithi155.stdout: }, 2023-08-01T19:55:13.931 INFO:teuthology.orchestra.run.smithi155.stdout: { 2023-08-01T19:55:13.932 INFO:teuthology.orchestra.run.smithi155.stdout: "event": "header_read", 2023-08-01T19:55:13.932 INFO:teuthology.orchestra.run.smithi155.stdout: "time": "2023-08-01T19:55:05.153612+0000", 2023-08-01T19:55:13.932 INFO:teuthology.orchestra.run.smithi155.stdout: "duration": 4294967295.9999986 2023-08-01T19:55:13.932 INFO:teuthology.orchestra.run.smithi155.stdout: }, 2023-08-01T19:55:13.932 INFO:teuthology.orchestra.run.smithi155.stdout: { 2023-08-01T19:55:13.932 INFO:teuthology.orchestra.run.smithi155.stdout: "event": "all_read", 2023-08-01T19:55:13.932 INFO:teuthology.orchestra.run.smithi155.stdout: "time": "2023-08-01T19:55:05.153694+0000", 2023-08-01T19:55:13.932 INFO:teuthology.orchestra.run.smithi155.stdout: "duration": 8.1618000000000004e-05 2023-08-01T19:55:13.933 INFO:teuthology.orchestra.run.smithi155.stdout: }, 2023-08-01T19:55:13.933 INFO:teuthology.orchestra.run.smithi155.stdout: { 2023-08-01T19:55:13.933 INFO:teuthology.orchestra.run.smithi155.stdout: "event": "dispatched", 2023-08-01T19:55:13.933 INFO:teuthology.orchestra.run.smithi155.stdout: "time": "2023-08-01T19:55:05.153713+0000", 2023-08-01T19:55:13.933 INFO:teuthology.orchestra.run.smithi155.stdout: "duration": 1.9069999999999999e-05 2023-08-01T19:55:13.933 INFO:teuthology.orchestra.run.smithi155.stdout: }, 2023-08-01T19:55:13.933 INFO:teuthology.orchestra.run.smithi155.stdout: { 2023-08-01T19:55:13.933 INFO:teuthology.orchestra.run.smithi155.stdout: "event": "queued_for_pg", 2023-08-01T19:55:13.934 INFO:teuthology.orchestra.run.smithi155.stdout: "time": "2023-08-01T19:55:05.153726+0000", 2023-08-01T19:55:13.934 INFO:teuthology.orchestra.run.smithi155.stdout: "duration": 1.238e-05 2023-08-01T19:55:13.934 INFO:teuthology.orchestra.run.smithi155.stdout: }, 2023-08-01T19:55:13.934 INFO:teuthology.orchestra.run.smithi155.stdout: { 2023-08-01T19:55:13.934 INFO:teuthology.orchestra.run.smithi155.stdout: "event": "reached_pg", 2023-08-01T19:55:13.934 INFO:teuthology.orchestra.run.smithi155.stdout: "time": "2023-08-01T19:55:05.153761+0000", 2023-08-01T19:55:13.934 INFO:teuthology.orchestra.run.smithi155.stdout: "duration": 3.5046999999999998e-05 2023-08-01T19:55:13.935 INFO:teuthology.orchestra.run.smithi155.stdout: }, 2023-08-01T19:55:13.935 INFO:teuthology.orchestra.run.smithi155.stdout: { 2023-08-01T19:55:13.935 INFO:teuthology.orchestra.run.smithi155.stdout: "event": "started", 2023-08-01T19:55:13.935 INFO:teuthology.orchestra.run.smithi155.stdout: "time": "2023-08-01T19:55:05.153896+0000", 2023-08-01T19:55:13.935 INFO:teuthology.orchestra.run.smithi155.stdout: "duration": 0.00013575800000000001 2023-08-01T19:55:13.935 INFO:teuthology.orchestra.run.smithi155.stdout: }, 2023-08-01T19:55:13.935 INFO:teuthology.orchestra.run.smithi155.stdout: { 2023-08-01T19:55:13.935 INFO:teuthology.orchestra.run.smithi155.stdout: "event": "waiting for subops from 0", 2023-08-01T19:55:13.936 INFO:teuthology.orchestra.run.smithi155.stdout: "time": "2023-08-01T19:55:05.154043+0000", 2023-08-01T19:55:13.936 INFO:teuthology.orchestra.run.smithi155.stdout: "duration": 0.00014650700000000001 2023-08-01T19:55:13.936 INFO:teuthology.orchestra.run.smithi155.stdout: }, 2023-08-01T19:55:13.936 INFO:teuthology.orchestra.run.smithi155.stdout: { 2023-08-01T19:55:13.936 INFO:teuthology.orchestra.run.smithi155.stdout: "event": "sub_op_commit_rec", 2023-08-01T19:55:13.936 INFO:teuthology.orchestra.run.smithi155.stdout: "time": "2023-08-01T19:55:05.221876+0000", 2023-08-01T19:55:13.936 INFO:teuthology.orchestra.run.smithi155.stdout: "duration": 0.067832796000000001 2023-08-01T19:55:13.937 INFO:teuthology.orchestra.run.smithi155.stdout: }, 2023-08-01T19:55:13.937 INFO:teuthology.orchestra.run.smithi155.stdout: { 2023-08-01T19:55:13.937 INFO:teuthology.orchestra.run.smithi155.stdout: "event": "op_commit", 2023-08-01T19:55:13.937 INFO:teuthology.orchestra.run.smithi155.stdout: "time": "2023-08-01T19:55:05.222813+0000", 2023-08-01T19:55:13.937 INFO:teuthology.orchestra.run.smithi155.stdout: "duration": 0.00093755300000000004 2023-08-01T19:55:13.937 INFO:teuthology.orchestra.run.smithi155.stdout: }, 2023-08-01T19:55:13.937 INFO:teuthology.orchestra.run.smithi155.stdout: { 2023-08-01T19:55:13.938 INFO:teuthology.orchestra.run.smithi155.stdout: "event": "commit_sent", 2023-08-01T19:55:13.938 INFO:teuthology.orchestra.run.smithi155.stdout: "time": "2023-08-01T19:55:05.222861+0000", 2023-08-01T19:55:13.938 INFO:teuthology.orchestra.run.smithi155.stdout: "duration": 4.8013999999999998e-05 2023-08-01T19:55:13.938 INFO:teuthology.orchestra.run.smithi155.stdout: }, 2023-08-01T19:55:13.938 INFO:teuthology.orchestra.run.smithi155.stdout: { 2023-08-01T19:55:13.938 INFO:teuthology.orchestra.run.smithi155.stdout: "event": "done", 2023-08-01T19:55:13.938 INFO:teuthology.orchestra.run.smithi155.stdout: "time": "2023-08-01T19:55:05.222900+0000", 2023-08-01T19:55:13.939 INFO:teuthology.orchestra.run.smithi155.stdout: "duration": 3.8634999999999999e-05 2023-08-01T19:55:13.939 INFO:teuthology.orchestra.run.smithi155.stdout: } 2023-08-01T19:55:13.939 INFO:teuthology.orchestra.run.smithi155.stdout: ] 2023-08-01T19:55:13.939 INFO:teuthology.orchestra.run.smithi155.stdout: } 2023-08-01T19:55:13.939 INFO:teuthology.orchestra.run.smithi155.stdout: }, 2023-08-01T19:55:13.939 INFO:teuthology.orchestra.run.smithi155.stdout: { 2023-08-01T19:55:13.939 INFO:teuthology.orchestra.run.smithi155.stdout: "description": "osd_op(client.4668.0:100251 5.b 5:d853df24:::benchmark_data_smithi006_114134_object100250:head [set-alloc-hint object_size 65536 write_size 65536,write 0~65536] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e37)", 2023-08-01T19:55:13.939 INFO:teuthology.orchestra.run.smithi155.stdout: "initiated_at": "2023-08-01T19:55:05.153737+0000", 2023-08-01T19:55:13.940 INFO:teuthology.orchestra.run.smithi155.stdout: "age": 8.6837494369999995, 2023-08-01T19:55:13.940 INFO:teuthology.orchestra.run.smithi155.stdout: "duration": 0.071366545000000003, 2023-08-01T19:55:13.940 INFO:teuthology.orchestra.run.smithi155.stdout: "type_data": { 2023-08-01T19:55:13.940 INFO:teuthology.orchestra.run.smithi155.stdout: "flag_point": "commit sent; apply or cleanup", 2023-08-01T19:55:13.940 INFO:teuthology.orchestra.run.smithi155.stdout: "client_info": { 2023-08-01T19:55:13.940 INFO:teuthology.orchestra.run.smithi155.stdout: "client": "client.4668", 2023-08-01T19:55:13.940 INFO:teuthology.orchestra.run.smithi155.stdout: "client_addr": "172.21.15.6:0/1709472247", 2023-08-01T19:55:13.941 INFO:teuthology.orchestra.run.smithi155.stdout: "tid": 100251 2023-08-01T19:55:13.941 INFO:teuthology.orchestra.run.smithi155.stdout: }, 2023-08-01T19:55:13.941 INFO:teuthology.orchestra.run.smithi155.stdout: "events": [ 2023-08-01T19:55:13.941 INFO:teuthology.orchestra.run.smithi155.stdout: { 2023-08-01T19:55:13.941 INFO:teuthology.orchestra.run.smithi155.stdout: "event": "initiated", 2023-08-01T19:55:13.941 INFO:teuthology.orchestra.run.smithi155.stdout: "time": "2023-08-01T19:55:05.153737+0000", 2023-08-01T19:55:13.941 INFO:teuthology.orchestra.run.smithi155.stdout: "duration": 0 2023-08-01T19:55:13.941 INFO:teuthology.orchestra.run.smithi155.stdout: }, 2023-08-01T19:55:13.942 INFO:teuthology.orchestra.run.smithi155.stdout: { 2023-08-01T19:55:13.942 INFO:teuthology.orchestra.run.smithi155.stdout: "event": "throttled", 2023-08-01T19:55:13.942 INFO:teuthology.orchestra.run.smithi155.stdout: "time": "2023-08-01T19:55:05.153737+0000", 2023-08-01T19:55:13.942 INFO:teuthology.orchestra.run.smithi155.stdout: "duration": 0 2023-08-01T19:55:13.942 INFO:teuthology.orchestra.run.smithi155.stdout: }, 2023-08-01T19:55:13.942 INFO:teuthology.orchestra.run.smithi155.stdout: { 2023-08-01T19:55:13.942 INFO:teuthology.orchestra.run.smithi155.stdout: "event": "header_read", 2023-08-01T19:55:13.942 INFO:teuthology.orchestra.run.smithi155.stdout: "time": "2023-08-01T19:55:05.153736+0000", 2023-08-01T19:55:13.943 INFO:teuthology.orchestra.run.smithi155.stdout: "duration": 4294967295.9999995 2023-08-01T19:55:13.943 INFO:teuthology.orchestra.run.smithi155.stdout: }, 2023-08-01T19:55:13.943 INFO:teuthology.orchestra.run.smithi155.stdout: { 2023-08-01T19:55:13.943 INFO:teuthology.orchestra.run.smithi155.stdout: "event": "all_read", 2023-08-01T19:55:13.943 INFO:teuthology.orchestra.run.smithi155.stdout: "time": "2023-08-01T19:55:05.153784+0000", 2023-08-01T19:55:13.943 INFO:teuthology.orchestra.run.smithi155.stdout: "duration": 4.7660000000000001e-05 2023-08-01T19:55:13.943 INFO:teuthology.orchestra.run.smithi155.stdout: }, 2023-08-01T19:55:13.943 INFO:teuthology.orchestra.run.smithi155.stdout: { 2023-08-01T19:55:13.944 INFO:teuthology.orchestra.run.smithi155.stdout: "event": "dispatched", 2023-08-01T19:55:13.944 INFO:teuthology.orchestra.run.smithi155.stdout: "time": "2023-08-01T19:55:05.153793+0000", 2023-08-01T19:55:13.944 INFO:teuthology.orchestra.run.smithi155.stdout: "duration": 8.7150000000000004e-06 2023-08-01T19:55:13.944 INFO:teuthology.orchestra.run.smithi155.stdout: }, 2023-08-01T19:55:13.944 INFO:teuthology.orchestra.run.smithi155.stdout: { 2023-08-01T19:55:13.944 INFO:teuthology.orchestra.run.smithi155.stdout: "event": "queued_for_pg", 2023-08-01T19:55:13.944 INFO:teuthology.orchestra.run.smithi155.stdout: "time": "2023-08-01T19:55:05.153800+0000", 2023-08-01T19:55:13.945 INFO:teuthology.orchestra.run.smithi155.stdout: "duration": 7.2459999999999997e-06 2023-08-01T19:55:13.945 INFO:teuthology.orchestra.run.smithi155.stdout: }, 2023-08-01T19:55:13.945 INFO:teuthology.orchestra.run.smithi155.stdout: { 2023-08-01T19:55:13.945 INFO:teuthology.orchestra.run.smithi155.stdout: "event": "reached_pg", 2023-08-01T19:55:13.945 INFO:teuthology.orchestra.run.smithi155.stdout: "time": "2023-08-01T19:55:05.156241+0000", 2023-08-01T19:55:13.945 INFO:teuthology.orchestra.run.smithi155.stdout: "duration": 0.0024415359999999998 2023-08-01T19:55:13.945 INFO:teuthology.orchestra.run.smithi155.stdout: }, 2023-08-01T19:55:13.945 INFO:teuthology.orchestra.run.smithi155.stdout: { 2023-08-01T19:55:13.946 INFO:teuthology.orchestra.run.smithi155.stdout: "event": "started", 2023-08-01T19:55:13.946 INFO:teuthology.orchestra.run.smithi155.stdout: "time": "2023-08-01T19:55:05.219045+0000", 2023-08-01T19:55:13.946 INFO:teuthology.orchestra.run.smithi155.stdout: "duration": 0.062803855000000006 2023-08-01T19:55:13.946 INFO:teuthology.orchestra.run.smithi155.stdout: }, 2023-08-01T19:55:13.946 INFO:teuthology.orchestra.run.smithi155.stdout: { 2023-08-01T19:55:13.946 INFO:teuthology.orchestra.run.smithi155.stdout: "event": "waiting for subops from 0", 2023-08-01T19:55:13.946 INFO:teuthology.orchestra.run.smithi155.stdout: "time": "2023-08-01T19:55:05.219238+0000", 2023-08-01T19:55:13.947 INFO:teuthology.orchestra.run.smithi155.stdout: "duration": 0.00019241500000000001 2023-08-01T19:55:13.947 INFO:teuthology.orchestra.run.smithi155.stdout: }, 2023-08-01T19:55:13.947 INFO:teuthology.orchestra.run.smithi155.stdout: { 2023-08-01T19:55:13.947 INFO:teuthology.orchestra.run.smithi155.stdout: "event": "sub_op_commit_rec", 2023-08-01T19:55:13.947 INFO:teuthology.orchestra.run.smithi155.stdout: "time": "2023-08-01T19:55:05.223300+0000", 2023-08-01T19:55:13.947 INFO:teuthology.orchestra.run.smithi155.stdout: "duration": 0.0040626509999999996 2023-08-01T19:55:13.947 INFO:teuthology.orchestra.run.smithi155.stdout: }, 2023-08-01T19:55:13.947 INFO:teuthology.orchestra.run.smithi155.stdout: { 2023-08-01T19:55:13.948 INFO:teuthology.orchestra.run.smithi155.stdout: "event": "op_commit", 2023-08-01T19:55:13.948 INFO:teuthology.orchestra.run.smithi155.stdout: "time": "2023-08-01T19:55:05.225020+0000", 2023-08-01T19:55:13.948 INFO:teuthology.orchestra.run.smithi155.stdout: "duration": 0.0017201 2023-08-01T19:55:13.948 INFO:teuthology.orchestra.run.smithi155.stdout: }, 2023-08-01T19:55:13.948 INFO:teuthology.orchestra.run.smithi155.stdout: { 2023-08-01T19:55:13.948 INFO:teuthology.orchestra.run.smithi155.stdout: "event": "commit_sent", 2023-08-01T19:55:13.948 INFO:teuthology.orchestra.run.smithi155.stdout: "time": "2023-08-01T19:55:05.225066+0000", 2023-08-01T19:55:13.949 INFO:teuthology.orchestra.run.smithi155.stdout: "duration": 4.6143000000000002e-05 2023-08-01T19:55:13.949 INFO:teuthology.orchestra.run.smithi155.stdout: }, 2023-08-01T19:55:13.949 INFO:teuthology.orchestra.run.smithi155.stdout: { 2023-08-01T19:55:13.949 INFO:teuthology.orchestra.run.smithi155.stdout: "event": "done", 2023-08-01T19:55:13.949 INFO:teuthology.orchestra.run.smithi155.stdout: "time": "2023-08-01T19:55:05.225103+0000", 2023-08-01T19:55:13.949 INFO:teuthology.orchestra.run.smithi155.stdout: "duration": 3.6789999999999998e-05 2023-08-01T19:55:13.949 INFO:teuthology.orchestra.run.smithi155.stdout: } 2023-08-01T19:55:13.949 INFO:teuthology.orchestra.run.smithi155.stdout: ] 2023-08-01T19:55:13.950 INFO:teuthology.orchestra.run.smithi155.stdout: } 2023-08-01T19:55:13.950 INFO:teuthology.orchestra.run.smithi155.stdout: }, 2023-08-01T19:55:13.950 INFO:teuthology.orchestra.run.smithi155.stdout: { 2023-08-01T19:55:13.950 INFO:teuthology.orchestra.run.smithi155.stdout: "description": "osd_op(client.4668.0:100252 5.0 5:01f90c3c:::benchmark_data_smithi006_114134_object100251:head [set-alloc-hint object_size 65536 write_size 65536,write 0~65536] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e37)", 2023-08-01T19:55:13.950 INFO:teuthology.orchestra.run.smithi155.stdout: "initiated_at": "2023-08-01T19:55:05.154048+0000", 2023-08-01T19:55:13.950 INFO:teuthology.orchestra.run.smithi155.stdout: "age": 8.6834381900000004, 2023-08-01T19:55:13.950 INFO:teuthology.orchestra.run.smithi155.stdout: "duration": 0.070156683999999997, 2023-08-01T19:55:13.951 INFO:teuthology.orchestra.run.smithi155.stdout: "type_data": { 2023-08-01T19:55:13.951 INFO:teuthology.orchestra.run.smithi155.stdout: "flag_point": "commit sent; apply or cleanup", 2023-08-01T19:55:13.951 INFO:teuthology.orchestra.run.smithi155.stdout: "client_info": { 2023-08-01T19:55:13.951 INFO:teuthology.orchestra.run.smithi155.stdout: "client": "client.4668", 2023-08-01T19:55:13.951 INFO:teuthology.orchestra.run.smithi155.stdout: "client_addr": "172.21.15.6:0/1709472247", 2023-08-01T19:55:13.951 INFO:teuthology.orchestra.run.smithi155.stdout: "tid": 100252 2023-08-01T19:55:13.951 INFO:teuthology.orchestra.run.smithi155.stdout: }, 2023-08-01T19:55:13.951 INFO:teuthology.orchestra.run.smithi155.stdout: "events": [ 2023-08-01T19:55:13.952 INFO:teuthology.orchestra.run.smithi155.stdout: { 2023-08-01T19:55:13.952 INFO:teuthology.orchestra.run.smithi155.stdout: "event": "initiated", 2023-08-01T19:55:13.952 INFO:teuthology.orchestra.run.smithi155.stdout: "time": "2023-08-01T19:55:05.154048+0000", 2023-08-01T19:55:13.952 INFO:teuthology.orchestra.run.smithi155.stdout: "duration": 0 2023-08-01T19:55:13.952 INFO:teuthology.orchestra.run.smithi155.stdout: }, 2023-08-01T19:55:13.952 INFO:teuthology.orchestra.run.smithi155.stdout: { 2023-08-01T19:55:13.952 INFO:teuthology.orchestra.run.smithi155.stdout: "event": "throttled", 2023-08-01T19:55:13.953 INFO:teuthology.orchestra.run.smithi155.stdout: "time": "2023-08-01T19:55:05.154048+0000", 2023-08-01T19:55:13.953 INFO:teuthology.orchestra.run.smithi155.stdout: "duration": 0 2023-08-01T19:55:13.953 INFO:teuthology.orchestra.run.smithi155.stdout: }, 2023-08-01T19:55:13.953 INFO:teuthology.orchestra.run.smithi155.stdout: { 2023-08-01T19:55:13.953 INFO:teuthology.orchestra.run.smithi155.stdout: "event": "header_read", 2023-08-01T19:55:13.953 INFO:teuthology.orchestra.run.smithi155.stdout: "time": "2023-08-01T19:55:05.154047+0000", 2023-08-01T19:55:13.953 INFO:teuthology.orchestra.run.smithi155.stdout: "duration": 4294967295.999999 2023-08-01T19:55:13.954 INFO:teuthology.orchestra.run.smithi155.stdout: }, 2023-08-01T19:55:13.954 INFO:teuthology.orchestra.run.smithi155.stdout: { 2023-08-01T19:55:13.954 INFO:teuthology.orchestra.run.smithi155.stdout: "event": "all_read", 2023-08-01T19:55:13.954 INFO:teuthology.orchestra.run.smithi155.stdout: "time": "2023-08-01T19:55:05.154115+0000", 2023-08-01T19:55:13.954 INFO:teuthology.orchestra.run.smithi155.stdout: "duration": 6.7545999999999993e-05 2023-08-01T19:55:13.954 INFO:teuthology.orchestra.run.smithi155.stdout: }, 2023-08-01T19:55:13.954 INFO:teuthology.orchestra.run.smithi155.stdout: { 2023-08-01T19:55:13.955 INFO:teuthology.orchestra.run.smithi155.stdout: "event": "dispatched", 2023-08-01T19:55:13.955 INFO:teuthology.orchestra.run.smithi155.stdout: "time": "2023-08-01T19:55:05.154125+0000", 2023-08-01T19:55:13.955 INFO:teuthology.orchestra.run.smithi155.stdout: "duration": 1.0669000000000001e-05 2023-08-01T19:55:13.955 INFO:teuthology.orchestra.run.smithi155.stdout: }, 2023-08-01T19:55:13.955 INFO:teuthology.orchestra.run.smithi155.stdout: { 2023-08-01T19:55:13.955 INFO:teuthology.orchestra.run.smithi155.stdout: "event": "queued_for_pg", 2023-08-01T19:55:13.955 INFO:teuthology.orchestra.run.smithi155.stdout: "time": "2023-08-01T19:55:05.154131+0000", 2023-08-01T19:55:13.955 INFO:teuthology.orchestra.run.smithi155.stdout: "duration": 6.0349999999999998e-06 2023-08-01T19:55:13.956 INFO:teuthology.orchestra.run.smithi155.stdout: }, 2023-08-01T19:55:13.956 INFO:teuthology.orchestra.run.smithi155.stdout: { 2023-08-01T19:55:13.956 INFO:teuthology.orchestra.run.smithi155.stdout: "event": "reached_pg", 2023-08-01T19:55:13.956 INFO:teuthology.orchestra.run.smithi155.stdout: "time": "2023-08-01T19:55:05.154174+0000", 2023-08-01T19:55:13.956 INFO:teuthology.orchestra.run.smithi155.stdout: "duration": 4.2429000000000003e-05 2023-08-01T19:55:13.956 INFO:teuthology.orchestra.run.smithi155.stdout: }, 2023-08-01T19:55:13.956 INFO:teuthology.orchestra.run.smithi155.stdout: { 2023-08-01T19:55:13.957 INFO:teuthology.orchestra.run.smithi155.stdout: "event": "started", 2023-08-01T19:55:13.957 INFO:teuthology.orchestra.run.smithi155.stdout: "time": "2023-08-01T19:55:05.154287+0000", 2023-08-01T19:55:13.957 INFO:teuthology.orchestra.run.smithi155.stdout: "duration": 0.000113138 2023-08-01T19:55:13.957 INFO:teuthology.orchestra.run.smithi155.stdout: }, 2023-08-01T19:55:13.957 INFO:teuthology.orchestra.run.smithi155.stdout: { 2023-08-01T19:55:13.957 INFO:teuthology.orchestra.run.smithi155.stdout: "event": "waiting for subops from 0", 2023-08-01T19:55:13.957 INFO:teuthology.orchestra.run.smithi155.stdout: "time": "2023-08-01T19:55:05.154420+0000", 2023-08-01T19:55:13.957 INFO:teuthology.orchestra.run.smithi155.stdout: "duration": 0.000133292 2023-08-01T19:55:13.958 INFO:teuthology.orchestra.run.smithi155.stdout: }, 2023-08-01T19:55:13.958 INFO:teuthology.orchestra.run.smithi155.stdout: { 2023-08-01T19:55:13.958 INFO:teuthology.orchestra.run.smithi155.stdout: "event": "sub_op_commit_rec", 2023-08-01T19:55:13.958 INFO:teuthology.orchestra.run.smithi155.stdout: "time": "2023-08-01T19:55:05.219034+0000", 2023-08-01T19:55:13.958 INFO:teuthology.orchestra.run.smithi155.stdout: "duration": 0.064613429999999999 2023-08-01T19:55:13.958 INFO:teuthology.orchestra.run.smithi155.stdout: }, 2023-08-01T19:55:13.958 INFO:teuthology.orchestra.run.smithi155.stdout: { 2023-08-01T19:55:13.959 INFO:teuthology.orchestra.run.smithi155.stdout: "event": "op_commit", 2023-08-01T19:55:13.959 INFO:teuthology.orchestra.run.smithi155.stdout: "time": "2023-08-01T19:55:05.224138+0000", 2023-08-01T19:55:13.959 INFO:teuthology.orchestra.run.smithi155.stdout: "duration": 0.0051041999999999997 2023-08-01T19:55:13.959 INFO:teuthology.orchestra.run.smithi155.stdout: }, 2023-08-01T19:55:13.959 INFO:teuthology.orchestra.run.smithi155.stdout: { 2023-08-01T19:55:13.959 INFO:teuthology.orchestra.run.smithi155.stdout: "event": "commit_sent", 2023-08-01T19:55:13.959 INFO:teuthology.orchestra.run.smithi155.stdout: "time": "2023-08-01T19:55:05.224171+0000", 2023-08-01T19:55:13.959 INFO:teuthology.orchestra.run.smithi155.stdout: "duration": 3.3345e-05 2023-08-01T19:55:13.960 INFO:teuthology.orchestra.run.smithi155.stdout: }, 2023-08-01T19:55:13.960 INFO:teuthology.orchestra.run.smithi155.stdout: { 2023-08-01T19:55:13.960 INFO:teuthology.orchestra.run.smithi155.stdout: "event": "done", 2023-08-01T19:55:13.960 INFO:teuthology.orchestra.run.smithi155.stdout: "time": "2023-08-01T19:55:05.224205+0000", 2023-08-01T19:55:13.960 INFO:teuthology.orchestra.run.smithi155.stdout: "duration": 3.3525999999999997e-05 2023-08-01T19:55:13.960 INFO:teuthology.orchestra.run.smithi155.stdout: } 2023-08-01T19:55:13.960 INFO:teuthology.orchestra.run.smithi155.stdout: ] 2023-08-01T19:55:13.961 INFO:teuthology.orchestra.run.smithi155.stdout: } 2023-08-01T19:55:13.961 INFO:teuthology.orchestra.run.smithi155.stdout: }, 2023-08-01T19:55:13.961 INFO:teuthology.orchestra.run.smithi155.stdout: { 2023-08-01T19:55:13.961 INFO:teuthology.orchestra.run.smithi155.stdout: "description": "osd_repop_reply(client.4668.0:100237 5.4 e37/19 ondisk, result = 0)", 2023-08-01T19:55:13.961 INFO:teuthology.orchestra.run.smithi155.stdout: "initiated_at": "2023-08-01T19:55:05.156249+0000", 2023-08-01T19:55:13.961 INFO:teuthology.orchestra.run.smithi155.stdout: "age": 8.6812372450000002, 2023-08-01T19:55:13.961 INFO:teuthology.orchestra.run.smithi155.stdout: "duration": 0.062792549000000003, 2023-08-01T19:55:13.962 INFO:teuthology.orchestra.run.smithi155.stdout: "type_data": { 2023-08-01T19:55:13.962 INFO:teuthology.orchestra.run.smithi155.stdout: "flag_point": "started", 2023-08-01T19:55:13.962 INFO:teuthology.orchestra.run.smithi155.stdout: "events": [ 2023-08-01T19:55:13.962 INFO:teuthology.orchestra.run.smithi155.stdout: { 2023-08-01T19:55:13.962 INFO:teuthology.orchestra.run.smithi155.stdout: "event": "initiated", 2023-08-01T19:55:13.962 INFO:teuthology.orchestra.run.smithi155.stdout: "time": "2023-08-01T19:55:05.156249+0000", 2023-08-01T19:55:13.962 INFO:teuthology.orchestra.run.smithi155.stdout: "duration": 0 2023-08-01T19:55:13.962 INFO:teuthology.orchestra.run.smithi155.stdout: }, 2023-08-01T19:55:13.963 INFO:teuthology.orchestra.run.smithi155.stdout: { 2023-08-01T19:55:13.963 INFO:teuthology.orchestra.run.smithi155.stdout: "event": "throttled", 2023-08-01T19:55:13.963 INFO:teuthology.orchestra.run.smithi155.stdout: "time": "2023-08-01T19:55:05.156249+0000", 2023-08-01T19:55:13.963 INFO:teuthology.orchestra.run.smithi155.stdout: "duration": 0 2023-08-01T19:55:13.963 INFO:teuthology.orchestra.run.smithi155.stdout: }, 2023-08-01T19:55:13.963 INFO:teuthology.orchestra.run.smithi155.stdout: { 2023-08-01T19:55:13.963 INFO:teuthology.orchestra.run.smithi155.stdout: "event": "header_read", 2023-08-01T19:55:13.963 INFO:teuthology.orchestra.run.smithi155.stdout: "time": "2023-08-01T19:55:05.156248+0000", 2023-08-01T19:55:13.964 INFO:teuthology.orchestra.run.smithi155.stdout: "duration": 4294967295.9999995 2023-08-01T19:55:13.964 INFO:teuthology.orchestra.run.smithi155.stdout: }, 2023-08-01T19:55:13.964 INFO:teuthology.orchestra.run.smithi155.stdout: { 2023-08-01T19:55:13.964 INFO:teuthology.orchestra.run.smithi155.stdout: "event": "all_read", 2023-08-01T19:55:13.964 INFO:teuthology.orchestra.run.smithi155.stdout: "time": "2023-08-01T19:55:05.156252+0000", 2023-08-01T19:55:13.964 INFO:teuthology.orchestra.run.smithi155.stdout: "duration": 3.9999999999999998e-06 2023-08-01T19:55:13.964 INFO:teuthology.orchestra.run.smithi155.stdout: }, 2023-08-01T19:55:13.965 INFO:teuthology.orchestra.run.smithi155.stdout: { 2023-08-01T19:55:13.965 INFO:teuthology.orchestra.run.smithi155.stdout: "event": "dispatched", 2023-08-01T19:55:13.965 INFO:teuthology.orchestra.run.smithi155.stdout: "time": "2023-08-01T19:55:05.218844+0000", 2023-08-01T19:55:13.965 INFO:teuthology.orchestra.run.smithi155.stdout: "duration": 0.062591516999999999 2023-08-01T19:55:13.965 INFO:teuthology.orchestra.run.smithi155.stdout: }, 2023-08-01T19:55:13.965 INFO:teuthology.orchestra.run.smithi155.stdout: { 2023-08-01T19:55:13.965 INFO:teuthology.orchestra.run.smithi155.stdout: "event": "queued_for_pg", 2023-08-01T19:55:13.965 INFO:teuthology.orchestra.run.smithi155.stdout: "time": "2023-08-01T19:55:05.218862+0000", 2023-08-01T19:55:13.966 INFO:teuthology.orchestra.run.smithi155.stdout: "duration": 1.7666e-05 2023-08-01T19:55:13.966 INFO:teuthology.orchestra.run.smithi155.stdout: }, 2023-08-01T19:55:13.966 INFO:teuthology.orchestra.run.smithi155.stdout: { 2023-08-01T19:55:13.966 INFO:teuthology.orchestra.run.smithi155.stdout: "event": "reached_pg", 2023-08-01T19:55:13.966 INFO:teuthology.orchestra.run.smithi155.stdout: "time": "2023-08-01T19:55:05.218914+0000", 2023-08-01T19:55:13.966 INFO:teuthology.orchestra.run.smithi155.stdout: "duration": 5.2565999999999998e-05 2023-08-01T19:55:13.966 INFO:teuthology.orchestra.run.smithi155.stdout: }, 2023-08-01T19:55:13.967 INFO:teuthology.orchestra.run.smithi155.stdout: { 2023-08-01T19:55:13.967 INFO:teuthology.orchestra.run.smithi155.stdout: "event": "started", 2023-08-01T19:55:13.967 INFO:teuthology.orchestra.run.smithi155.stdout: "time": "2023-08-01T19:55:05.218925+0000", 2023-08-01T19:55:13.967 INFO:teuthology.orchestra.run.smithi155.stdout: "duration": 1.1375e-05 2023-08-01T19:55:13.967 INFO:teuthology.orchestra.run.smithi155.stdout: }, 2023-08-01T19:55:13.967 INFO:teuthology.orchestra.run.smithi155.stdout: { 2023-08-01T19:55:13.967 INFO:teuthology.orchestra.run.smithi155.stdout: "event": "done", 2023-08-01T19:55:13.968 INFO:teuthology.orchestra.run.smithi155.stdout: "time": "2023-08-01T19:55:05.219041+0000", 2023-08-01T19:55:13.968 INFO:teuthology.orchestra.run.smithi155.stdout: "duration": 0.000115977 2023-08-01T19:55:13.968 INFO:teuthology.orchestra.run.smithi155.stdout: } 2023-08-01T19:55:13.968 INFO:teuthology.orchestra.run.smithi155.stdout: ] 2023-08-01T19:55:13.968 INFO:teuthology.orchestra.run.smithi155.stdout: } 2023-08-01T19:55:13.968 INFO:teuthology.orchestra.run.smithi155.stdout: }, 2023-08-01T19:55:13.968 INFO:teuthology.orchestra.run.smithi155.stdout: { 2023-08-01T19:55:13.969 INFO:teuthology.orchestra.run.smithi155.stdout: "description": "osd_repop(client.4668.0:100253 5.f e37/19 5:f7bbce05:::benchmark_data_smithi006_114134_object100252:head v 37'6323, mlcod=37'6321)", 2023-08-01T19:55:13.969 INFO:teuthology.orchestra.run.smithi155.stdout: "initiated_at": "2023-08-01T19:55:05.156952+0000", 2023-08-01T19:55:13.969 INFO:teuthology.orchestra.run.smithi155.stdout: "age": 8.6805341820000006, 2023-08-01T19:55:13.969 INFO:teuthology.orchestra.run.smithi155.stdout: "duration": 0.068018577999999996, 2023-08-01T19:55:13.969 INFO:teuthology.orchestra.run.smithi155.stdout: "type_data": { 2023-08-01T19:55:13.969 INFO:teuthology.orchestra.run.smithi155.stdout: "flag_point": "commit sent; apply or cleanup", 2023-08-01T19:55:13.969 INFO:teuthology.orchestra.run.smithi155.stdout: "events": [ 2023-08-01T19:55:13.969 INFO:teuthology.orchestra.run.smithi155.stdout: { 2023-08-01T19:55:13.970 INFO:teuthology.orchestra.run.smithi155.stdout: "event": "initiated", 2023-08-01T19:55:13.970 INFO:teuthology.orchestra.run.smithi155.stdout: "time": "2023-08-01T19:55:05.156952+0000", 2023-08-01T19:55:13.970 INFO:teuthology.orchestra.run.smithi155.stdout: "duration": 0 2023-08-01T19:55:13.970 INFO:teuthology.orchestra.run.smithi155.stdout: }, 2023-08-01T19:55:13.970 INFO:teuthology.orchestra.run.smithi155.stdout: { 2023-08-01T19:55:13.970 INFO:teuthology.orchestra.run.smithi155.stdout: "event": "throttled", 2023-08-01T19:55:13.970 INFO:teuthology.orchestra.run.smithi155.stdout: "time": "2023-08-01T19:55:05.156952+0000", 2023-08-01T19:55:13.970 INFO:teuthology.orchestra.run.smithi155.stdout: "duration": 0 2023-08-01T19:55:13.971 INFO:teuthology.orchestra.run.smithi155.stdout: }, 2023-08-01T19:55:13.971 INFO:teuthology.orchestra.run.smithi155.stdout: { 2023-08-01T19:55:13.971 INFO:teuthology.orchestra.run.smithi155.stdout: "event": "header_read", 2023-08-01T19:55:13.971 INFO:teuthology.orchestra.run.smithi155.stdout: "time": "2023-08-01T19:55:05.156951+0000", 2023-08-01T19:55:13.971 INFO:teuthology.orchestra.run.smithi155.stdout: "duration": 4294967295.999999 2023-08-01T19:55:13.971 INFO:teuthology.orchestra.run.smithi155.stdout: }, 2023-08-01T19:55:13.971 INFO:teuthology.orchestra.run.smithi155.stdout: { 2023-08-01T19:55:13.971 INFO:teuthology.orchestra.run.smithi155.stdout: "event": "all_read", 2023-08-01T19:55:13.972 INFO:teuthology.orchestra.run.smithi155.stdout: "time": "2023-08-01T19:55:05.156989+0000", 2023-08-01T19:55:13.972 INFO:teuthology.orchestra.run.smithi155.stdout: "duration": 3.8175e-05 2023-08-01T19:55:13.972 INFO:teuthology.orchestra.run.smithi155.stdout: }, 2023-08-01T19:55:13.972 INFO:teuthology.orchestra.run.smithi155.stdout: { 2023-08-01T19:55:13.972 INFO:teuthology.orchestra.run.smithi155.stdout: "event": "dispatched", 2023-08-01T19:55:13.972 INFO:teuthology.orchestra.run.smithi155.stdout: "time": "2023-08-01T19:55:05.218842+0000", 2023-08-01T19:55:13.972 INFO:teuthology.orchestra.run.smithi155.stdout: "duration": 0.061852299999999999 2023-08-01T19:55:13.973 INFO:teuthology.orchestra.run.smithi155.stdout: }, 2023-08-01T19:55:13.973 INFO:teuthology.orchestra.run.smithi155.stdout: { 2023-08-01T19:55:13.973 INFO:teuthology.orchestra.run.smithi155.stdout: "event": "queued_for_pg", 2023-08-01T19:55:13.973 INFO:teuthology.orchestra.run.smithi155.stdout: "time": "2023-08-01T19:55:05.218862+0000", 2023-08-01T19:55:13.973 INFO:teuthology.orchestra.run.smithi155.stdout: "duration": 1.9854999999999999e-05 2023-08-01T19:55:13.973 INFO:teuthology.orchestra.run.smithi155.stdout: }, 2023-08-01T19:55:13.973 INFO:teuthology.orchestra.run.smithi155.stdout: { 2023-08-01T19:55:13.973 INFO:teuthology.orchestra.run.smithi155.stdout: "event": "reached_pg", 2023-08-01T19:55:13.974 INFO:teuthology.orchestra.run.smithi155.stdout: "time": "2023-08-01T19:55:05.218918+0000", 2023-08-01T19:55:13.974 INFO:teuthology.orchestra.run.smithi155.stdout: "duration": 5.6570000000000002e-05 2023-08-01T19:55:13.974 INFO:teuthology.orchestra.run.smithi155.stdout: }, 2023-08-01T19:55:13.974 INFO:teuthology.orchestra.run.smithi155.stdout: { 2023-08-01T19:55:13.974 INFO:teuthology.orchestra.run.smithi155.stdout: "event": "started", 2023-08-01T19:55:13.974 INFO:teuthology.orchestra.run.smithi155.stdout: "time": "2023-08-01T19:55:05.218940+0000", 2023-08-01T19:55:13.974 INFO:teuthology.orchestra.run.smithi155.stdout: "duration": 2.1804e-05 2023-08-01T19:55:13.974 INFO:teuthology.orchestra.run.smithi155.stdout: }, 2023-08-01T19:55:13.975 INFO:teuthology.orchestra.run.smithi155.stdout: { 2023-08-01T19:55:13.975 INFO:teuthology.orchestra.run.smithi155.stdout: "event": "commit_sent", 2023-08-01T19:55:13.975 INFO:teuthology.orchestra.run.smithi155.stdout: "time": "2023-08-01T19:55:05.224928+0000", 2023-08-01T19:55:13.975 INFO:teuthology.orchestra.run.smithi155.stdout: "duration": 0.0059876759999999999 2023-08-01T19:55:13.975 INFO:teuthology.orchestra.run.smithi155.stdout: }, 2023-08-01T19:55:13.975 INFO:teuthology.orchestra.run.smithi155.stdout: { 2023-08-01T19:55:13.975 INFO:teuthology.orchestra.run.smithi155.stdout: "event": "done", 2023-08-01T19:55:13.975 INFO:teuthology.orchestra.run.smithi155.stdout: "time": "2023-08-01T19:55:05.224971+0000", 2023-08-01T19:55:13.976 INFO:teuthology.orchestra.run.smithi155.stdout: "duration": 4.2929999999999997e-05 2023-08-01T19:55:13.976 INFO:teuthology.orchestra.run.smithi155.stdout: } 2023-08-01T19:55:13.976 INFO:teuthology.orchestra.run.smithi155.stdout: ] 2023-08-01T19:55:13.976 INFO:teuthology.orchestra.run.smithi155.stdout: } 2023-08-01T19:55:13.976 INFO:teuthology.orchestra.run.smithi155.stdout: }, 2023-08-01T19:55:13.976 INFO:teuthology.orchestra.run.smithi155.stdout: { 2023-08-01T19:55:13.976 INFO:teuthology.orchestra.run.smithi155.stdout: "description": "osd_op(client.4668.0:100927 5.0 5:00608ec6:::benchmark_data_smithi006_114134_object100926:head [set-alloc-hint object_size 65536 write_size 65536,write 0~65536] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e37)", 2023-08-01T19:55:13.976 INFO:teuthology.orchestra.run.smithi155.stdout: "initiated_at": "2023-08-01T19:55:05.561169+0000", 2023-08-01T19:55:13.977 INFO:teuthology.orchestra.run.smithi155.stdout: "age": 8.2763172790000006, 2023-08-01T19:55:13.977 INFO:teuthology.orchestra.run.smithi155.stdout: "duration": 0.066411687999999997, 2023-08-01T19:55:13.977 INFO:teuthology.orchestra.run.smithi155.stdout: "type_data": { 2023-08-01T19:55:13.977 INFO:teuthology.orchestra.run.smithi155.stdout: "flag_point": "commit sent; apply or cleanup", 2023-08-01T19:55:13.977 INFO:teuthology.orchestra.run.smithi155.stdout: "client_info": { 2023-08-01T19:55:13.977 INFO:teuthology.orchestra.run.smithi155.stdout: "client": "client.4668", 2023-08-01T19:55:13.977 INFO:teuthology.orchestra.run.smithi155.stdout: "client_addr": "172.21.15.6:0/1709472247", 2023-08-01T19:55:13.978 INFO:teuthology.orchestra.run.smithi155.stdout: "tid": 100927 2023-08-01T19:55:13.978 INFO:teuthology.orchestra.run.smithi155.stdout: }, 2023-08-01T19:55:13.978 INFO:teuthology.orchestra.run.smithi155.stdout: "events": [ 2023-08-01T19:55:13.978 INFO:teuthology.orchestra.run.smithi155.stdout: { 2023-08-01T19:55:13.978 INFO:teuthology.orchestra.run.smithi155.stdout: "event": "initiated", 2023-08-01T19:55:13.978 INFO:teuthology.orchestra.run.smithi155.stdout: "time": "2023-08-01T19:55:05.561169+0000", 2023-08-01T19:55:13.978 INFO:teuthology.orchestra.run.smithi155.stdout: "duration": 0 2023-08-01T19:55:13.978 INFO:teuthology.orchestra.run.smithi155.stdout: }, 2023-08-01T19:55:13.979 INFO:teuthology.orchestra.run.smithi155.stdout: { 2023-08-01T19:55:13.979 INFO:teuthology.orchestra.run.smithi155.stdout: "event": "throttled", 2023-08-01T19:55:13.979 INFO:teuthology.orchestra.run.smithi155.stdout: "time": "2023-08-01T19:55:05.561169+0000", 2023-08-01T19:55:13.979 INFO:teuthology.orchestra.run.smithi155.stdout: "duration": 0 2023-08-01T19:55:13.979 INFO:teuthology.orchestra.run.smithi155.stdout: }, 2023-08-01T19:55:13.979 INFO:teuthology.orchestra.run.smithi155.stdout: { 2023-08-01T19:55:13.979 INFO:teuthology.orchestra.run.smithi155.stdout: "event": "header_read", 2023-08-01T19:55:13.980 INFO:teuthology.orchestra.run.smithi155.stdout: "time": "2023-08-01T19:55:05.561168+0000", 2023-08-01T19:55:13.980 INFO:teuthology.orchestra.run.smithi155.stdout: "duration": 4294967295.9999995 2023-08-01T19:55:13.980 INFO:teuthology.orchestra.run.smithi155.stdout: }, 2023-08-01T19:55:13.980 INFO:teuthology.orchestra.run.smithi155.stdout: { 2023-08-01T19:55:13.980 INFO:teuthology.orchestra.run.smithi155.stdout: "event": "all_read", 2023-08-01T19:55:13.980 INFO:teuthology.orchestra.run.smithi155.stdout: "time": "2023-08-01T19:55:05.561218+0000", 2023-08-01T19:55:13.980 INFO:teuthology.orchestra.run.smithi155.stdout: "duration": 4.9379999999999998e-05 2023-08-01T19:55:13.981 INFO:teuthology.orchestra.run.smithi155.stdout: }, 2023-08-01T19:55:13.981 INFO:teuthology.orchestra.run.smithi155.stdout: { 2023-08-01T19:55:13.981 INFO:teuthology.orchestra.run.smithi155.stdout: "event": "dispatched", 2023-08-01T19:55:13.981 INFO:teuthology.orchestra.run.smithi155.stdout: "time": "2023-08-01T19:55:05.561225+0000", 2023-08-01T19:55:13.981 INFO:teuthology.orchestra.run.smithi155.stdout: "duration": 7.114e-06 2023-08-01T19:55:13.981 INFO:teuthology.orchestra.run.smithi155.stdout: }, 2023-08-01T19:55:13.981 INFO:teuthology.orchestra.run.smithi155.stdout: { 2023-08-01T19:55:13.982 INFO:teuthology.orchestra.run.smithi155.stdout: "event": "queued_for_pg", 2023-08-01T19:55:13.982 INFO:teuthology.orchestra.run.smithi155.stdout: "time": "2023-08-01T19:55:05.561229+0000", 2023-08-01T19:55:13.982 INFO:teuthology.orchestra.run.smithi155.stdout: "duration": 4.2180000000000001e-06 2023-08-01T19:55:13.982 INFO:teuthology.orchestra.run.smithi155.stdout: }, 2023-08-01T19:55:13.982 INFO:teuthology.orchestra.run.smithi155.stdout: { 2023-08-01T19:55:13.982 INFO:teuthology.orchestra.run.smithi155.stdout: "event": "reached_pg", 2023-08-01T19:55:13.982 INFO:teuthology.orchestra.run.smithi155.stdout: "time": "2023-08-01T19:55:05.564737+0000", 2023-08-01T19:55:13.982 INFO:teuthology.orchestra.run.smithi155.stdout: "duration": 0.0035081869999999999 2023-08-01T19:55:13.983 INFO:teuthology.orchestra.run.smithi155.stdout: }, 2023-08-01T19:55:13.983 INFO:teuthology.orchestra.run.smithi155.stdout: { 2023-08-01T19:55:13.983 INFO:teuthology.orchestra.run.smithi155.stdout: "event": "started", 2023-08-01T19:55:13.983 INFO:teuthology.orchestra.run.smithi155.stdout: "time": "2023-08-01T19:55:05.564859+0000", 2023-08-01T19:55:13.983 INFO:teuthology.orchestra.run.smithi155.stdout: "duration": 0.00012165800000000001 2023-08-01T19:55:13.983 INFO:teuthology.orchestra.run.smithi155.stdout: }, 2023-08-01T19:55:13.983 INFO:teuthology.orchestra.run.smithi155.stdout: { 2023-08-01T19:55:13.983 INFO:teuthology.orchestra.run.smithi155.stdout: "event": "waiting for subops from 0", 2023-08-01T19:55:13.984 INFO:teuthology.orchestra.run.smithi155.stdout: "time": "2023-08-01T19:55:05.565009+0000", 2023-08-01T19:55:13.984 INFO:teuthology.orchestra.run.smithi155.stdout: "duration": 0.00014979699999999999 2023-08-01T19:55:13.984 INFO:teuthology.orchestra.run.smithi155.stdout: }, 2023-08-01T19:55:13.984 INFO:teuthology.orchestra.run.smithi155.stdout: { 2023-08-01T19:55:13.984 INFO:teuthology.orchestra.run.smithi155.stdout: "event": "op_commit", 2023-08-01T19:55:13.984 INFO:teuthology.orchestra.run.smithi155.stdout: "time": "2023-08-01T19:55:05.568007+0000", 2023-08-01T19:55:13.984 INFO:teuthology.orchestra.run.smithi155.stdout: "duration": 0.00299796 2023-08-01T19:55:13.985 INFO:teuthology.orchestra.run.smithi155.stdout: }, 2023-08-01T19:55:13.985 INFO:teuthology.orchestra.run.smithi155.stdout: { 2023-08-01T19:55:13.985 INFO:teuthology.orchestra.run.smithi155.stdout: "event": "sub_op_commit_rec", 2023-08-01T19:55:13.985 INFO:teuthology.orchestra.run.smithi155.stdout: "time": "2023-08-01T19:55:05.627520+0000", 2023-08-01T19:55:13.985 INFO:teuthology.orchestra.run.smithi155.stdout: "duration": 0.059513636000000002 2023-08-01T19:55:13.985 INFO:teuthology.orchestra.run.smithi155.stdout: }, 2023-08-01T19:55:13.985 INFO:teuthology.orchestra.run.smithi155.stdout: { 2023-08-01T19:55:13.985 INFO:teuthology.orchestra.run.smithi155.stdout: "event": "commit_sent", 2023-08-01T19:55:13.986 INFO:teuthology.orchestra.run.smithi155.stdout: "time": "2023-08-01T19:55:05.627553+0000", 2023-08-01T19:55:13.986 INFO:teuthology.orchestra.run.smithi155.stdout: "duration": 3.2635999999999997e-05 2023-08-01T19:55:13.986 INFO:teuthology.orchestra.run.smithi155.stdout: }, 2023-08-01T19:55:13.986 INFO:teuthology.orchestra.run.smithi155.stdout: { 2023-08-01T19:55:13.986 INFO:teuthology.orchestra.run.smithi155.stdout: "event": "done", 2023-08-01T19:55:13.986 INFO:teuthology.orchestra.run.smithi155.stdout: "time": "2023-08-01T19:55:05.627581+0000", 2023-08-01T19:55:13.986 INFO:teuthology.orchestra.run.smithi155.stdout: "duration": 2.7681000000000001e-05 2023-08-01T19:55:13.986 INFO:teuthology.orchestra.run.smithi155.stdout: } 2023-08-01T19:55:13.987 INFO:teuthology.orchestra.run.smithi155.stdout: ] 2023-08-01T19:55:13.987 INFO:teuthology.orchestra.run.smithi155.stdout: } 2023-08-01T19:55:13.987 INFO:teuthology.orchestra.run.smithi155.stdout: }, 2023-08-01T19:55:13.987 INFO:teuthology.orchestra.run.smithi155.stdout: { 2023-08-01T19:55:13.987 INFO:teuthology.orchestra.run.smithi155.stdout: "description": "osd_op(client.4668.0:100935 5.e 5:7895b14e:::benchmark_data_smithi006_114134_object100934:head [set-alloc-hint object_size 65536 write_size 65536,write 0~65536] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e37)", 2023-08-01T19:55:13.987 INFO:teuthology.orchestra.run.smithi155.stdout: "initiated_at": "2023-08-01T19:55:05.566666+0000", 2023-08-01T19:55:13.987 INFO:teuthology.orchestra.run.smithi155.stdout: "age": 8.2708199790000005, 2023-08-01T19:55:13.987 INFO:teuthology.orchestra.run.smithi155.stdout: "duration": 0.064309016999999996, 2023-08-01T19:55:13.988 INFO:teuthology.orchestra.run.smithi155.stdout: "type_data": { 2023-08-01T19:55:13.988 INFO:teuthology.orchestra.run.smithi155.stdout: "flag_point": "commit sent; apply or cleanup", 2023-08-01T19:55:13.988 INFO:teuthology.orchestra.run.smithi155.stdout: "client_info": { 2023-08-01T19:55:13.988 INFO:teuthology.orchestra.run.smithi155.stdout: "client": "client.4668", 2023-08-01T19:55:13.988 INFO:teuthology.orchestra.run.smithi155.stdout: "client_addr": "172.21.15.6:0/1709472247", 2023-08-01T19:55:13.988 INFO:teuthology.orchestra.run.smithi155.stdout: "tid": 100935 2023-08-01T19:55:13.988 INFO:teuthology.orchestra.run.smithi155.stdout: }, 2023-08-01T19:55:13.989 INFO:teuthology.orchestra.run.smithi155.stdout: "events": [ 2023-08-01T19:55:13.989 INFO:teuthology.orchestra.run.smithi155.stdout: { 2023-08-01T19:55:13.989 INFO:teuthology.orchestra.run.smithi155.stdout: "event": "initiated", 2023-08-01T19:55:13.989 INFO:teuthology.orchestra.run.smithi155.stdout: "time": "2023-08-01T19:55:05.566666+0000", 2023-08-01T19:55:13.989 INFO:teuthology.orchestra.run.smithi155.stdout: "duration": 0 2023-08-01T19:55:13.989 INFO:teuthology.orchestra.run.smithi155.stdout: }, 2023-08-01T19:55:13.989 INFO:teuthology.orchestra.run.smithi155.stdout: { 2023-08-01T19:55:13.989 INFO:teuthology.orchestra.run.smithi155.stdout: "event": "throttled", 2023-08-01T19:55:13.990 INFO:teuthology.orchestra.run.smithi155.stdout: "time": "2023-08-01T19:55:05.566666+0000", 2023-08-01T19:55:13.990 INFO:teuthology.orchestra.run.smithi155.stdout: "duration": 0 2023-08-01T19:55:13.990 INFO:teuthology.orchestra.run.smithi155.stdout: }, 2023-08-01T19:55:13.990 INFO:teuthology.orchestra.run.smithi155.stdout: { 2023-08-01T19:55:13.990 INFO:teuthology.orchestra.run.smithi155.stdout: "event": "header_read", 2023-08-01T19:55:13.990 INFO:teuthology.orchestra.run.smithi155.stdout: "time": "2023-08-01T19:55:05.566665+0000", 2023-08-01T19:55:13.990 INFO:teuthology.orchestra.run.smithi155.stdout: "duration": 4294967295.9999986 2023-08-01T19:55:13.991 INFO:teuthology.orchestra.run.smithi155.stdout: }, 2023-08-01T19:55:13.991 INFO:teuthology.orchestra.run.smithi155.stdout: { 2023-08-01T19:55:13.991 INFO:teuthology.orchestra.run.smithi155.stdout: "event": "all_read", 2023-08-01T19:55:13.991 INFO:teuthology.orchestra.run.smithi155.stdout: "time": "2023-08-01T19:55:05.566754+0000", 2023-08-01T19:55:13.991 INFO:teuthology.orchestra.run.smithi155.stdout: "duration": 8.9425999999999994e-05 2023-08-01T19:55:13.991 INFO:teuthology.orchestra.run.smithi155.stdout: }, 2023-08-01T19:55:13.991 INFO:teuthology.orchestra.run.smithi155.stdout: { 2023-08-01T19:55:13.991 INFO:teuthology.orchestra.run.smithi155.stdout: "event": "dispatched", 2023-08-01T19:55:13.992 INFO:teuthology.orchestra.run.smithi155.stdout: "time": "2023-08-01T19:55:05.566766+0000", 2023-08-01T19:55:13.992 INFO:teuthology.orchestra.run.smithi155.stdout: "duration": 1.2018000000000001e-05 2023-08-01T19:55:13.992 INFO:teuthology.orchestra.run.smithi155.stdout: }, 2023-08-01T19:55:13.992 INFO:teuthology.orchestra.run.smithi155.stdout: { 2023-08-01T19:55:13.992 INFO:teuthology.orchestra.run.smithi155.stdout: "event": "queued_for_pg", 2023-08-01T19:55:13.992 INFO:teuthology.orchestra.run.smithi155.stdout: "time": "2023-08-01T19:55:05.566772+0000", 2023-08-01T19:55:13.992 INFO:teuthology.orchestra.run.smithi155.stdout: "duration": 6.0190000000000003e-06 2023-08-01T19:55:13.992 INFO:teuthology.orchestra.run.smithi155.stdout: }, 2023-08-01T19:55:13.993 INFO:teuthology.orchestra.run.smithi155.stdout: { 2023-08-01T19:55:13.993 INFO:teuthology.orchestra.run.smithi155.stdout: "event": "reached_pg", 2023-08-01T19:55:13.993 INFO:teuthology.orchestra.run.smithi155.stdout: "time": "2023-08-01T19:55:05.566800+0000", 2023-08-01T19:55:13.993 INFO:teuthology.orchestra.run.smithi155.stdout: "duration": 2.7835999999999999e-05 2023-08-01T19:55:13.993 INFO:teuthology.orchestra.run.smithi155.stdout: }, 2023-08-01T19:55:13.993 INFO:teuthology.orchestra.run.smithi155.stdout: { 2023-08-01T19:55:13.993 INFO:teuthology.orchestra.run.smithi155.stdout: "event": "started", 2023-08-01T19:55:13.993 INFO:teuthology.orchestra.run.smithi155.stdout: "time": "2023-08-01T19:55:05.566879+0000", 2023-08-01T19:55:13.994 INFO:teuthology.orchestra.run.smithi155.stdout: "duration": 7.9105999999999998e-05 2023-08-01T19:55:13.994 INFO:teuthology.orchestra.run.smithi155.stdout: }, 2023-08-01T19:55:13.994 INFO:teuthology.orchestra.run.smithi155.stdout: { 2023-08-01T19:55:13.994 INFO:teuthology.orchestra.run.smithi155.stdout: "event": "waiting for subops from 0", 2023-08-01T19:55:13.994 INFO:teuthology.orchestra.run.smithi155.stdout: "time": "2023-08-01T19:55:05.566971+0000", 2023-08-01T19:55:13.994 INFO:teuthology.orchestra.run.smithi155.stdout: "duration": 9.1817999999999994e-05 2023-08-01T19:55:13.994 INFO:teuthology.orchestra.run.smithi155.stdout: }, 2023-08-01T19:55:13.995 INFO:teuthology.orchestra.run.smithi155.stdout: { 2023-08-01T19:55:13.995 INFO:teuthology.orchestra.run.smithi155.stdout: "event": "op_commit", 2023-08-01T19:55:13.995 INFO:teuthology.orchestra.run.smithi155.stdout: "time": "2023-08-01T19:55:05.571475+0000", 2023-08-01T19:55:13.995 INFO:teuthology.orchestra.run.smithi155.stdout: "duration": 0.0045039499999999996 2023-08-01T19:55:13.995 INFO:teuthology.orchestra.run.smithi155.stdout: }, 2023-08-01T19:55:13.995 INFO:teuthology.orchestra.run.smithi155.stdout: { 2023-08-01T19:55:13.995 INFO:teuthology.orchestra.run.smithi155.stdout: "event": "sub_op_commit_rec", 2023-08-01T19:55:13.995 INFO:teuthology.orchestra.run.smithi155.stdout: "time": "2023-08-01T19:55:05.630884+0000", 2023-08-01T19:55:13.996 INFO:teuthology.orchestra.run.smithi155.stdout: "duration": 0.059409181999999998 2023-08-01T19:55:13.996 INFO:teuthology.orchestra.run.smithi155.stdout: }, 2023-08-01T19:55:13.996 INFO:teuthology.orchestra.run.smithi155.stdout: { 2023-08-01T19:55:13.996 INFO:teuthology.orchestra.run.smithi155.stdout: "event": "commit_sent", 2023-08-01T19:55:13.996 INFO:teuthology.orchestra.run.smithi155.stdout: "time": "2023-08-01T19:55:05.630930+0000", 2023-08-01T19:55:13.996 INFO:teuthology.orchestra.run.smithi155.stdout: "duration": 4.5507999999999999e-05 2023-08-01T19:55:13.996 INFO:teuthology.orchestra.run.smithi155.stdout: }, 2023-08-01T19:55:13.996 INFO:teuthology.orchestra.run.smithi155.stdout: { 2023-08-01T19:55:13.997 INFO:teuthology.orchestra.run.smithi155.stdout: "event": "done", 2023-08-01T19:55:13.997 INFO:teuthology.orchestra.run.smithi155.stdout: "time": "2023-08-01T19:55:05.630975+0000", 2023-08-01T19:55:13.997 INFO:teuthology.orchestra.run.smithi155.stdout: "duration": 4.5441000000000001e-05 2023-08-01T19:55:13.997 INFO:teuthology.orchestra.run.smithi155.stdout: } 2023-08-01T19:55:13.997 INFO:teuthology.orchestra.run.smithi155.stdout: ] 2023-08-01T19:55:13.997 INFO:teuthology.orchestra.run.smithi155.stdout: } 2023-08-01T19:55:13.997 INFO:teuthology.orchestra.run.smithi155.stdout: }, 2023-08-01T19:55:13.998 INFO:teuthology.orchestra.run.smithi155.stdout: { 2023-08-01T19:55:13.998 INFO:teuthology.orchestra.run.smithi155.stdout: "description": "osd_op(client.4668.0:100941 5.e 5:736a6ac6:::benchmark_data_smithi006_114134_object100940:head [set-alloc-hint object_size 65536 write_size 65536,write 0~65536] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e37)", 2023-08-01T19:55:13.998 INFO:teuthology.orchestra.run.smithi155.stdout: "initiated_at": "2023-08-01T19:55:05.569750+0000", 2023-08-01T19:55:13.998 INFO:teuthology.orchestra.run.smithi155.stdout: "age": 8.2677360859999993, 2023-08-01T19:55:13.998 INFO:teuthology.orchestra.run.smithi155.stdout: "duration": 0.065431331999999995, 2023-08-01T19:55:13.998 INFO:teuthology.orchestra.run.smithi155.stdout: "type_data": { 2023-08-01T19:55:13.998 INFO:teuthology.orchestra.run.smithi155.stdout: "flag_point": "commit sent; apply or cleanup", 2023-08-01T19:55:13.998 INFO:teuthology.orchestra.run.smithi155.stdout: "client_info": { 2023-08-01T19:55:13.999 INFO:teuthology.orchestra.run.smithi155.stdout: "client": "client.4668", 2023-08-01T19:55:13.999 INFO:teuthology.orchestra.run.smithi155.stdout: "client_addr": "172.21.15.6:0/1709472247", 2023-08-01T19:55:13.999 INFO:teuthology.orchestra.run.smithi155.stdout: "tid": 100941 2023-08-01T19:55:13.999 INFO:teuthology.orchestra.run.smithi155.stdout: }, 2023-08-01T19:55:13.999 INFO:teuthology.orchestra.run.smithi155.stdout: "events": [ 2023-08-01T19:55:13.999 INFO:teuthology.orchestra.run.smithi155.stdout: { 2023-08-01T19:55:13.999 INFO:teuthology.orchestra.run.smithi155.stdout: "event": "initiated", 2023-08-01T19:55:13.999 INFO:teuthology.orchestra.run.smithi155.stdout: "time": "2023-08-01T19:55:05.569750+0000", 2023-08-01T19:55:14.000 INFO:teuthology.orchestra.run.smithi155.stdout: "duration": 0 2023-08-01T19:55:14.000 INFO:teuthology.orchestra.run.smithi155.stdout: }, 2023-08-01T19:55:14.000 INFO:teuthology.orchestra.run.smithi155.stdout: { 2023-08-01T19:55:14.000 INFO:teuthology.orchestra.run.smithi155.stdout: "event": "throttled", 2023-08-01T19:55:14.000 INFO:teuthology.orchestra.run.smithi155.stdout: "time": "2023-08-01T19:55:05.569750+0000", 2023-08-01T19:55:14.000 INFO:teuthology.orchestra.run.smithi155.stdout: "duration": 0 2023-08-01T19:55:14.000 INFO:teuthology.orchestra.run.smithi155.stdout: }, 2023-08-01T19:55:14.000 INFO:teuthology.orchestra.run.smithi155.stdout: { 2023-08-01T19:55:14.001 INFO:teuthology.orchestra.run.smithi155.stdout: "event": "header_read", 2023-08-01T19:55:14.001 INFO:teuthology.orchestra.run.smithi155.stdout: "time": "2023-08-01T19:55:05.569749+0000", 2023-08-01T19:55:14.001 INFO:teuthology.orchestra.run.smithi155.stdout: "duration": 4294967295.999999 2023-08-01T19:55:14.001 INFO:teuthology.orchestra.run.smithi155.stdout: }, 2023-08-01T19:55:14.001 INFO:teuthology.orchestra.run.smithi155.stdout: { 2023-08-01T19:55:14.001 INFO:teuthology.orchestra.run.smithi155.stdout: "event": "all_read", 2023-08-01T19:55:14.001 INFO:teuthology.orchestra.run.smithi155.stdout: "time": "2023-08-01T19:55:05.569861+0000", 2023-08-01T19:55:14.001 INFO:teuthology.orchestra.run.smithi155.stdout: "duration": 0.000111333 2023-08-01T19:55:14.002 INFO:teuthology.orchestra.run.smithi155.stdout: }, 2023-08-01T19:55:14.002 INFO:teuthology.orchestra.run.smithi155.stdout: { 2023-08-01T19:55:14.002 INFO:teuthology.orchestra.run.smithi155.stdout: "event": "dispatched", 2023-08-01T19:55:14.002 INFO:teuthology.orchestra.run.smithi155.stdout: "time": "2023-08-01T19:55:05.569869+0000", 2023-08-01T19:55:14.002 INFO:teuthology.orchestra.run.smithi155.stdout: "duration": 8.8589999999999994e-06 2023-08-01T19:55:14.002 INFO:teuthology.orchestra.run.smithi155.stdout: }, 2023-08-01T19:55:14.002 INFO:teuthology.orchestra.run.smithi155.stdout: { 2023-08-01T19:55:14.003 INFO:teuthology.orchestra.run.smithi155.stdout: "event": "queued_for_pg", 2023-08-01T19:55:14.003 INFO:teuthology.orchestra.run.smithi155.stdout: "time": "2023-08-01T19:55:05.569874+0000", 2023-08-01T19:55:14.003 INFO:teuthology.orchestra.run.smithi155.stdout: "duration": 4.1679999999999997e-06 2023-08-01T19:55:14.003 INFO:teuthology.orchestra.run.smithi155.stdout: }, 2023-08-01T19:55:14.003 INFO:teuthology.orchestra.run.smithi155.stdout: { 2023-08-01T19:55:14.003 INFO:teuthology.orchestra.run.smithi155.stdout: "event": "reached_pg", 2023-08-01T19:55:14.003 INFO:teuthology.orchestra.run.smithi155.stdout: "time": "2023-08-01T19:55:05.569904+0000", 2023-08-01T19:55:14.003 INFO:teuthology.orchestra.run.smithi155.stdout: "duration": 3.0920999999999998e-05 2023-08-01T19:55:14.004 INFO:teuthology.orchestra.run.smithi155.stdout: }, 2023-08-01T19:55:14.004 INFO:teuthology.orchestra.run.smithi155.stdout: { 2023-08-01T19:55:14.004 INFO:teuthology.orchestra.run.smithi155.stdout: "event": "started", 2023-08-01T19:55:14.004 INFO:teuthology.orchestra.run.smithi155.stdout: "time": "2023-08-01T19:55:05.569998+0000", 2023-08-01T19:55:14.004 INFO:teuthology.orchestra.run.smithi155.stdout: "duration": 9.3086999999999998e-05 2023-08-01T19:55:14.004 INFO:teuthology.orchestra.run.smithi155.stdout: }, 2023-08-01T19:55:14.004 INFO:teuthology.orchestra.run.smithi155.stdout: { 2023-08-01T19:55:14.004 INFO:teuthology.orchestra.run.smithi155.stdout: "event": "waiting for subops from 0", 2023-08-01T19:55:14.005 INFO:teuthology.orchestra.run.smithi155.stdout: "time": "2023-08-01T19:55:05.570093+0000", 2023-08-01T19:55:14.005 INFO:teuthology.orchestra.run.smithi155.stdout: "duration": 9.5768999999999997e-05 2023-08-01T19:55:14.005 INFO:teuthology.orchestra.run.smithi155.stdout: }, 2023-08-01T19:55:14.005 INFO:teuthology.orchestra.run.smithi155.stdout: { 2023-08-01T19:55:14.005 INFO:teuthology.orchestra.run.smithi155.stdout: "event": "op_commit", 2023-08-01T19:55:14.005 INFO:teuthology.orchestra.run.smithi155.stdout: "time": "2023-08-01T19:55:05.572839+0000", 2023-08-01T19:55:14.005 INFO:teuthology.orchestra.run.smithi155.stdout: "duration": 0.0027460050000000001 2023-08-01T19:55:14.005 INFO:teuthology.orchestra.run.smithi155.stdout: }, 2023-08-01T19:55:14.006 INFO:teuthology.orchestra.run.smithi155.stdout: { 2023-08-01T19:55:14.006 INFO:teuthology.orchestra.run.smithi155.stdout: "event": "sub_op_commit_rec", 2023-08-01T19:55:14.006 INFO:teuthology.orchestra.run.smithi155.stdout: "time": "2023-08-01T19:55:05.635114+0000", 2023-08-01T19:55:14.006 INFO:teuthology.orchestra.run.smithi155.stdout: "duration": 0.062274297999999999 2023-08-01T19:55:14.006 INFO:teuthology.orchestra.run.smithi155.stdout: }, 2023-08-01T19:55:14.006 INFO:teuthology.orchestra.run.smithi155.stdout: { 2023-08-01T19:55:14.006 INFO:teuthology.orchestra.run.smithi155.stdout: "event": "commit_sent", 2023-08-01T19:55:14.007 INFO:teuthology.orchestra.run.smithi155.stdout: "time": "2023-08-01T19:55:05.635143+0000", 2023-08-01T19:55:14.007 INFO:teuthology.orchestra.run.smithi155.stdout: "duration": 2.9430000000000001e-05 2023-08-01T19:55:14.007 INFO:teuthology.orchestra.run.smithi155.stdout: }, 2023-08-01T19:55:14.007 INFO:teuthology.orchestra.run.smithi155.stdout: { 2023-08-01T19:55:14.007 INFO:teuthology.orchestra.run.smithi155.stdout: "event": "done", 2023-08-01T19:55:14.007 INFO:teuthology.orchestra.run.smithi155.stdout: "time": "2023-08-01T19:55:05.635181+0000", 2023-08-01T19:55:14.007 INFO:teuthology.orchestra.run.smithi155.stdout: "duration": 3.8352000000000001e-05 2023-08-01T19:55:14.007 INFO:teuthology.orchestra.run.smithi155.stdout: } 2023-08-01T19:55:14.008 INFO:teuthology.orchestra.run.smithi155.stdout: ] 2023-08-01T19:55:14.008 INFO:teuthology.orchestra.run.smithi155.stdout: } 2023-08-01T19:55:14.008 INFO:teuthology.orchestra.run.smithi155.stdout: }, 2023-08-01T19:55:14.008 INFO:teuthology.orchestra.run.smithi155.stdout: { 2023-08-01T19:55:14.008 INFO:teuthology.orchestra.run.smithi155.stdout: "description": "osd_op(client.4668.0:100944 5.4 5:25fae865:::benchmark_data_smithi006_114134_object100943:head [set-alloc-hint object_size 65536 write_size 65536,write 0~65536] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e37)", 2023-08-01T19:55:14.008 INFO:teuthology.orchestra.run.smithi155.stdout: "initiated_at": "2023-08-01T19:55:05.576662+0000", 2023-08-01T19:55:14.008 INFO:teuthology.orchestra.run.smithi155.stdout: "age": 8.2608243889999997, 2023-08-01T19:55:14.008 INFO:teuthology.orchestra.run.smithi155.stdout: "duration": 0.056054925999999998, 2023-08-01T19:55:14.009 INFO:teuthology.orchestra.run.smithi155.stdout: "type_data": { 2023-08-01T19:55:14.009 INFO:teuthology.orchestra.run.smithi155.stdout: "flag_point": "commit sent; apply or cleanup", 2023-08-01T19:55:14.009 INFO:teuthology.orchestra.run.smithi155.stdout: "client_info": { 2023-08-01T19:55:14.009 INFO:teuthology.orchestra.run.smithi155.stdout: "client": "client.4668", 2023-08-01T19:55:14.009 INFO:teuthology.orchestra.run.smithi155.stdout: "client_addr": "172.21.15.6:0/1709472247", 2023-08-01T19:55:14.009 INFO:teuthology.orchestra.run.smithi155.stdout: "tid": 100944 2023-08-01T19:55:14.009 INFO:teuthology.orchestra.run.smithi155.stdout: }, 2023-08-01T19:55:14.010 INFO:teuthology.orchestra.run.smithi155.stdout: "events": [ 2023-08-01T19:55:14.010 INFO:teuthology.orchestra.run.smithi155.stdout: { 2023-08-01T19:55:14.010 INFO:teuthology.orchestra.run.smithi155.stdout: "event": "initiated", 2023-08-01T19:55:14.010 INFO:teuthology.orchestra.run.smithi155.stdout: "time": "2023-08-01T19:55:05.576662+0000", 2023-08-01T19:55:14.010 INFO:teuthology.orchestra.run.smithi155.stdout: "duration": 0 2023-08-01T19:55:14.010 INFO:teuthology.orchestra.run.smithi155.stdout: }, 2023-08-01T19:55:14.010 INFO:teuthology.orchestra.run.smithi155.stdout: { 2023-08-01T19:55:14.010 INFO:teuthology.orchestra.run.smithi155.stdout: "event": "throttled", 2023-08-01T19:55:14.011 INFO:teuthology.orchestra.run.smithi155.stdout: "time": "2023-08-01T19:55:05.576662+0000", 2023-08-01T19:55:14.011 INFO:teuthology.orchestra.run.smithi155.stdout: "duration": 0 2023-08-01T19:55:14.011 INFO:teuthology.orchestra.run.smithi155.stdout: }, 2023-08-01T19:55:14.011 INFO:teuthology.orchestra.run.smithi155.stdout: { 2023-08-01T19:55:14.011 INFO:teuthology.orchestra.run.smithi155.stdout: "event": "header_read", 2023-08-01T19:55:14.011 INFO:teuthology.orchestra.run.smithi155.stdout: "time": "2023-08-01T19:55:05.576661+0000", 2023-08-01T19:55:14.011 INFO:teuthology.orchestra.run.smithi155.stdout: "duration": 4294967295.999999 2023-08-01T19:55:14.011 INFO:teuthology.orchestra.run.smithi155.stdout: }, 2023-08-01T19:55:14.012 INFO:teuthology.orchestra.run.smithi155.stdout: { 2023-08-01T19:55:14.012 INFO:teuthology.orchestra.run.smithi155.stdout: "event": "all_read", 2023-08-01T19:55:14.012 INFO:teuthology.orchestra.run.smithi155.stdout: "time": "2023-08-01T19:55:05.576725+0000", 2023-08-01T19:55:14.012 INFO:teuthology.orchestra.run.smithi155.stdout: "duration": 6.4435000000000002e-05 2023-08-01T19:55:14.012 INFO:teuthology.orchestra.run.smithi155.stdout: }, 2023-08-01T19:55:14.012 INFO:teuthology.orchestra.run.smithi155.stdout: { 2023-08-01T19:55:14.012 INFO:teuthology.orchestra.run.smithi155.stdout: "event": "dispatched", 2023-08-01T19:55:14.012 INFO:teuthology.orchestra.run.smithi155.stdout: "time": "2023-08-01T19:55:05.576744+0000", 2023-08-01T19:55:14.013 INFO:teuthology.orchestra.run.smithi155.stdout: "duration": 1.8502999999999999e-05 2023-08-01T19:55:14.013 INFO:teuthology.orchestra.run.smithi155.stdout: }, 2023-08-01T19:55:14.013 INFO:teuthology.orchestra.run.smithi155.stdout: { 2023-08-01T19:55:14.013 INFO:teuthology.orchestra.run.smithi155.stdout: "event": "queued_for_pg", 2023-08-01T19:55:14.013 INFO:teuthology.orchestra.run.smithi155.stdout: "time": "2023-08-01T19:55:05.576772+0000", 2023-08-01T19:55:14.013 INFO:teuthology.orchestra.run.smithi155.stdout: "duration": 2.8354999999999999e-05 2023-08-01T19:55:14.013 INFO:teuthology.orchestra.run.smithi155.stdout: }, 2023-08-01T19:55:14.013 INFO:teuthology.orchestra.run.smithi155.stdout: { 2023-08-01T19:55:14.014 INFO:teuthology.orchestra.run.smithi155.stdout: "event": "reached_pg", 2023-08-01T19:55:14.014 INFO:teuthology.orchestra.run.smithi155.stdout: "time": "2023-08-01T19:55:05.576815+0000", 2023-08-01T19:55:14.014 INFO:teuthology.orchestra.run.smithi155.stdout: "duration": 4.3223999999999998e-05 2023-08-01T19:55:14.014 INFO:teuthology.orchestra.run.smithi155.stdout: }, 2023-08-01T19:55:14.014 INFO:teuthology.orchestra.run.smithi155.stdout: { 2023-08-01T19:55:14.014 INFO:teuthology.orchestra.run.smithi155.stdout: "event": "started", 2023-08-01T19:55:14.014 INFO:teuthology.orchestra.run.smithi155.stdout: "time": "2023-08-01T19:55:05.576961+0000", 2023-08-01T19:55:14.014 INFO:teuthology.orchestra.run.smithi155.stdout: "duration": 0.000145043 2023-08-01T19:55:14.015 INFO:teuthology.orchestra.run.smithi155.stdout: }, 2023-08-01T19:55:14.015 INFO:teuthology.orchestra.run.smithi155.stdout: { 2023-08-01T19:55:14.015 INFO:teuthology.orchestra.run.smithi155.stdout: "event": "waiting for subops from 0", 2023-08-01T19:55:14.015 INFO:teuthology.orchestra.run.smithi155.stdout: "time": "2023-08-01T19:55:05.577343+0000", 2023-08-01T19:55:14.015 INFO:teuthology.orchestra.run.smithi155.stdout: "duration": 0.00038249699999999998 2023-08-01T19:55:14.015 INFO:teuthology.orchestra.run.smithi155.stdout: }, 2023-08-01T19:55:14.015 INFO:teuthology.orchestra.run.smithi155.stdout: { 2023-08-01T19:55:14.016 INFO:teuthology.orchestra.run.smithi155.stdout: "event": "op_commit", 2023-08-01T19:55:14.016 INFO:teuthology.orchestra.run.smithi155.stdout: "time": "2023-08-01T19:55:05.582349+0000", 2023-08-01T19:55:14.016 INFO:teuthology.orchestra.run.smithi155.stdout: "duration": 0.0050062880000000002 2023-08-01T19:55:14.016 INFO:teuthology.orchestra.run.smithi155.stdout: }, 2023-08-01T19:55:14.016 INFO:teuthology.orchestra.run.smithi155.stdout: { 2023-08-01T19:55:14.016 INFO:teuthology.orchestra.run.smithi155.stdout: "event": "sub_op_commit_rec", 2023-08-01T19:55:14.016 INFO:teuthology.orchestra.run.smithi155.stdout: "time": "2023-08-01T19:55:05.632659+0000", 2023-08-01T19:55:14.016 INFO:teuthology.orchestra.run.smithi155.stdout: "duration": 0.050309185999999999 2023-08-01T19:55:14.017 INFO:teuthology.orchestra.run.smithi155.stdout: }, 2023-08-01T19:55:14.017 INFO:teuthology.orchestra.run.smithi155.stdout: { 2023-08-01T19:55:14.017 INFO:teuthology.orchestra.run.smithi155.stdout: "event": "commit_sent", 2023-08-01T19:55:14.017 INFO:teuthology.orchestra.run.smithi155.stdout: "time": "2023-08-01T19:55:05.632692+0000", 2023-08-01T19:55:14.017 INFO:teuthology.orchestra.run.smithi155.stdout: "duration": 3.3077999999999997e-05 2023-08-01T19:55:14.017 INFO:teuthology.orchestra.run.smithi155.stdout: }, 2023-08-01T19:55:14.017 INFO:teuthology.orchestra.run.smithi155.stdout: { 2023-08-01T19:55:14.017 INFO:teuthology.orchestra.run.smithi155.stdout: "event": "done", 2023-08-01T19:55:14.018 INFO:teuthology.orchestra.run.smithi155.stdout: "time": "2023-08-01T19:55:05.632717+0000", 2023-08-01T19:55:14.018 INFO:teuthology.orchestra.run.smithi155.stdout: "duration": 2.5119000000000001e-05 2023-08-01T19:55:14.018 INFO:teuthology.orchestra.run.smithi155.stdout: } 2023-08-01T19:55:14.018 INFO:teuthology.orchestra.run.smithi155.stdout: ] 2023-08-01T19:55:14.018 INFO:teuthology.orchestra.run.smithi155.stdout: } 2023-08-01T19:55:14.018 INFO:teuthology.orchestra.run.smithi155.stdout: }, 2023-08-01T19:55:14.018 INFO:teuthology.orchestra.run.smithi155.stdout: { 2023-08-01T19:55:14.018 INFO:teuthology.orchestra.run.smithi155.stdout: "description": "osd_op(client.4668.0:100945 5.e 5:73df68dd:::benchmark_data_smithi006_114134_object100944:head [set-alloc-hint object_size 65536 write_size 65536,write 0~65536] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e37)", 2023-08-01T19:55:14.019 INFO:teuthology.orchestra.run.smithi155.stdout: "initiated_at": "2023-08-01T19:55:05.576784+0000", 2023-08-01T19:55:14.019 INFO:teuthology.orchestra.run.smithi155.stdout: "age": 8.2607025010000008, 2023-08-01T19:55:14.019 INFO:teuthology.orchestra.run.smithi155.stdout: "duration": 0.058512994999999998, 2023-08-01T19:55:14.019 INFO:teuthology.orchestra.run.smithi155.stdout: "type_data": { 2023-08-01T19:55:14.019 INFO:teuthology.orchestra.run.smithi155.stdout: "flag_point": "commit sent; apply or cleanup", 2023-08-01T19:55:14.019 INFO:teuthology.orchestra.run.smithi155.stdout: "client_info": { 2023-08-01T19:55:14.019 INFO:teuthology.orchestra.run.smithi155.stdout: "client": "client.4668", 2023-08-01T19:55:14.019 INFO:teuthology.orchestra.run.smithi155.stdout: "client_addr": "172.21.15.6:0/1709472247", 2023-08-01T19:55:14.020 INFO:teuthology.orchestra.run.smithi155.stdout: "tid": 100945 2023-08-01T19:55:14.020 INFO:teuthology.orchestra.run.smithi155.stdout: }, 2023-08-01T19:55:14.020 INFO:teuthology.orchestra.run.smithi155.stdout: "events": [ 2023-08-01T19:55:14.020 INFO:teuthology.orchestra.run.smithi155.stdout: { 2023-08-01T19:55:14.020 INFO:teuthology.orchestra.run.smithi155.stdout: "event": "initiated", 2023-08-01T19:55:14.020 INFO:teuthology.orchestra.run.smithi155.stdout: "time": "2023-08-01T19:55:05.576784+0000", 2023-08-01T19:55:14.020 INFO:teuthology.orchestra.run.smithi155.stdout: "duration": 0 2023-08-01T19:55:14.021 INFO:teuthology.orchestra.run.smithi155.stdout: }, 2023-08-01T19:55:14.021 INFO:teuthology.orchestra.run.smithi155.stdout: { 2023-08-01T19:55:14.021 INFO:teuthology.orchestra.run.smithi155.stdout: "event": "throttled", 2023-08-01T19:55:14.021 INFO:teuthology.orchestra.run.smithi155.stdout: "time": "2023-08-01T19:55:05.576784+0000", 2023-08-01T19:55:14.021 INFO:teuthology.orchestra.run.smithi155.stdout: "duration": 0 2023-08-01T19:55:14.021 INFO:teuthology.orchestra.run.smithi155.stdout: }, 2023-08-01T19:55:14.021 INFO:teuthology.orchestra.run.smithi155.stdout: { 2023-08-01T19:55:14.021 INFO:teuthology.orchestra.run.smithi155.stdout: "event": "header_read", 2023-08-01T19:55:14.022 INFO:teuthology.orchestra.run.smithi155.stdout: "time": "2023-08-01T19:55:05.576783+0000", 2023-08-01T19:55:14.022 INFO:teuthology.orchestra.run.smithi155.stdout: "duration": 4294967295.9999995 2023-08-01T19:55:14.022 INFO:teuthology.orchestra.run.smithi155.stdout: }, 2023-08-01T19:55:14.022 INFO:teuthology.orchestra.run.smithi155.stdout: { 2023-08-01T19:55:14.022 INFO:teuthology.orchestra.run.smithi155.stdout: "event": "all_read", 2023-08-01T19:55:14.022 INFO:teuthology.orchestra.run.smithi155.stdout: "time": "2023-08-01T19:55:05.576807+0000", 2023-08-01T19:55:14.022 INFO:teuthology.orchestra.run.smithi155.stdout: "duration": 2.3651000000000001e-05 2023-08-01T19:55:14.022 INFO:teuthology.orchestra.run.smithi155.stdout: }, 2023-08-01T19:55:14.023 INFO:teuthology.orchestra.run.smithi155.stdout: { 2023-08-01T19:55:14.023 INFO:teuthology.orchestra.run.smithi155.stdout: "event": "dispatched", 2023-08-01T19:55:14.023 INFO:teuthology.orchestra.run.smithi155.stdout: "time": "2023-08-01T19:55:05.576817+0000", 2023-08-01T19:55:14.023 INFO:teuthology.orchestra.run.smithi155.stdout: "duration": 9.9389999999999992e-06 2023-08-01T19:55:14.023 INFO:teuthology.orchestra.run.smithi155.stdout: }, 2023-08-01T19:55:14.023 INFO:teuthology.orchestra.run.smithi155.stdout: { 2023-08-01T19:55:14.023 INFO:teuthology.orchestra.run.smithi155.stdout: "event": "queued_for_pg", 2023-08-01T19:55:14.023 INFO:teuthology.orchestra.run.smithi155.stdout: "time": "2023-08-01T19:55:05.576820+0000", 2023-08-01T19:55:14.024 INFO:teuthology.orchestra.run.smithi155.stdout: "duration": 3.2619999999999999e-06 2023-08-01T19:55:14.024 INFO:teuthology.orchestra.run.smithi155.stdout: }, 2023-08-01T19:55:14.024 INFO:teuthology.orchestra.run.smithi155.stdout: { 2023-08-01T19:55:14.024 INFO:teuthology.orchestra.run.smithi155.stdout: "event": "reached_pg", 2023-08-01T19:55:14.024 INFO:teuthology.orchestra.run.smithi155.stdout: "time": "2023-08-01T19:55:05.576849+0000", 2023-08-01T19:55:14.024 INFO:teuthology.orchestra.run.smithi155.stdout: "duration": 2.8880000000000001e-05 2023-08-01T19:55:14.024 INFO:teuthology.orchestra.run.smithi155.stdout: }, 2023-08-01T19:55:14.024 INFO:teuthology.orchestra.run.smithi155.stdout: { 2023-08-01T19:55:14.025 INFO:teuthology.orchestra.run.smithi155.stdout: "event": "started", 2023-08-01T19:55:14.025 INFO:teuthology.orchestra.run.smithi155.stdout: "time": "2023-08-01T19:55:05.576940+0000", 2023-08-01T19:55:14.025 INFO:teuthology.orchestra.run.smithi155.stdout: "duration": 9.0570999999999997e-05 2023-08-01T19:55:14.025 INFO:teuthology.orchestra.run.smithi155.stdout: }, 2023-08-01T19:55:14.025 INFO:teuthology.orchestra.run.smithi155.stdout: { 2023-08-01T19:55:14.025 INFO:teuthology.orchestra.run.smithi155.stdout: "event": "waiting for subops from 0", 2023-08-01T19:55:14.025 INFO:teuthology.orchestra.run.smithi155.stdout: "time": "2023-08-01T19:55:05.577027+0000", 2023-08-01T19:55:14.026 INFO:teuthology.orchestra.run.smithi155.stdout: "duration": 8.7237999999999994e-05 2023-08-01T19:55:14.026 INFO:teuthology.orchestra.run.smithi155.stdout: }, 2023-08-01T19:55:14.026 INFO:teuthology.orchestra.run.smithi155.stdout: { 2023-08-01T19:55:14.026 INFO:teuthology.orchestra.run.smithi155.stdout: "event": "op_commit", 2023-08-01T19:55:14.026 INFO:teuthology.orchestra.run.smithi155.stdout: "time": "2023-08-01T19:55:05.579624+0000", 2023-08-01T19:55:14.026 INFO:teuthology.orchestra.run.smithi155.stdout: "duration": 0.0025971200000000001 2023-08-01T19:55:14.026 INFO:teuthology.orchestra.run.smithi155.stdout: }, 2023-08-01T19:55:14.026 INFO:teuthology.orchestra.run.smithi155.stdout: { 2023-08-01T19:55:14.027 INFO:teuthology.orchestra.run.smithi155.stdout: "event": "sub_op_commit_rec", 2023-08-01T19:55:14.027 INFO:teuthology.orchestra.run.smithi155.stdout: "time": "2023-08-01T19:55:05.635218+0000", 2023-08-01T19:55:14.027 INFO:teuthology.orchestra.run.smithi155.stdout: "duration": 0.055594487999999997 2023-08-01T19:55:14.027 INFO:teuthology.orchestra.run.smithi155.stdout: }, 2023-08-01T19:55:14.027 INFO:teuthology.orchestra.run.smithi155.stdout: { 2023-08-01T19:55:14.027 INFO:teuthology.orchestra.run.smithi155.stdout: "event": "commit_sent", 2023-08-01T19:55:14.027 INFO:teuthology.orchestra.run.smithi155.stdout: "time": "2023-08-01T19:55:05.635262+0000", 2023-08-01T19:55:14.027 INFO:teuthology.orchestra.run.smithi155.stdout: "duration": 4.3380999999999997e-05 2023-08-01T19:55:14.028 INFO:teuthology.orchestra.run.smithi155.stdout: }, 2023-08-01T19:55:14.028 INFO:teuthology.orchestra.run.smithi155.stdout: { 2023-08-01T19:55:14.028 INFO:teuthology.orchestra.run.smithi155.stdout: "event": "done", 2023-08-01T19:55:14.028 INFO:teuthology.orchestra.run.smithi155.stdout: "time": "2023-08-01T19:55:05.635297+0000", 2023-08-01T19:55:14.028 INFO:teuthology.orchestra.run.smithi155.stdout: "duration": 3.4842000000000003e-05 2023-08-01T19:55:14.028 INFO:teuthology.orchestra.run.smithi155.stdout: } 2023-08-01T19:55:14.028 INFO:teuthology.orchestra.run.smithi155.stdout: ] 2023-08-01T19:55:14.029 INFO:teuthology.orchestra.run.smithi155.stdout: } 2023-08-01T19:55:14.029 INFO:teuthology.orchestra.run.smithi155.stdout: }, 2023-08-01T19:55:14.029 INFO:teuthology.orchestra.run.smithi155.stdout: { 2023-08-01T19:55:14.029 INFO:teuthology.orchestra.run.smithi155.stdout: "description": "osd_op(client.4668.0:100947 5.4 5:23e8fc27:::benchmark_data_smithi006_114134_object100946:head [set-alloc-hint object_size 65536 write_size 65536,write 0~65536] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e37)", 2023-08-01T19:55:14.029 INFO:teuthology.orchestra.run.smithi155.stdout: "initiated_at": "2023-08-01T19:55:05.576840+0000", 2023-08-01T19:55:14.029 INFO:teuthology.orchestra.run.smithi155.stdout: "age": 8.2606464459999991, 2023-08-01T19:55:14.029 INFO:teuthology.orchestra.run.smithi155.stdout: "duration": 0.058423127999999998, 2023-08-01T19:55:14.029 INFO:teuthology.orchestra.run.smithi155.stdout: "type_data": { 2023-08-01T19:55:14.030 INFO:teuthology.orchestra.run.smithi155.stdout: "flag_point": "commit sent; apply or cleanup", 2023-08-01T19:55:14.030 INFO:teuthology.orchestra.run.smithi155.stdout: "client_info": { 2023-08-01T19:55:14.030 INFO:teuthology.orchestra.run.smithi155.stdout: "client": "client.4668", 2023-08-01T19:55:14.030 INFO:teuthology.orchestra.run.smithi155.stdout: "client_addr": "172.21.15.6:0/1709472247", 2023-08-01T19:55:14.030 INFO:teuthology.orchestra.run.smithi155.stdout: "tid": 100947 2023-08-01T19:55:14.030 INFO:teuthology.orchestra.run.smithi155.stdout: }, 2023-08-01T19:55:14.030 INFO:teuthology.orchestra.run.smithi155.stdout: "events": [ 2023-08-01T19:55:14.030 INFO:teuthology.orchestra.run.smithi155.stdout: { 2023-08-01T19:55:14.031 INFO:teuthology.orchestra.run.smithi155.stdout: "event": "initiated", 2023-08-01T19:55:14.031 INFO:teuthology.orchestra.run.smithi155.stdout: "time": "2023-08-01T19:55:05.576840+0000", 2023-08-01T19:55:14.031 INFO:teuthology.orchestra.run.smithi155.stdout: "duration": 0 2023-08-01T19:55:14.031 INFO:teuthology.orchestra.run.smithi155.stdout: }, 2023-08-01T19:55:14.031 INFO:teuthology.orchestra.run.smithi155.stdout: { 2023-08-01T19:55:14.031 INFO:teuthology.orchestra.run.smithi155.stdout: "event": "throttled", 2023-08-01T19:55:14.031 INFO:teuthology.orchestra.run.smithi155.stdout: "time": "2023-08-01T19:55:05.576840+0000", 2023-08-01T19:55:14.031 INFO:teuthology.orchestra.run.smithi155.stdout: "duration": 0 2023-08-01T19:55:14.032 INFO:teuthology.orchestra.run.smithi155.stdout: }, 2023-08-01T19:55:14.032 INFO:teuthology.orchestra.run.smithi155.stdout: { 2023-08-01T19:55:14.032 INFO:teuthology.orchestra.run.smithi155.stdout: "event": "header_read", 2023-08-01T19:55:14.032 INFO:teuthology.orchestra.run.smithi155.stdout: "time": "2023-08-01T19:55:05.576839+0000", 2023-08-01T19:55:14.032 INFO:teuthology.orchestra.run.smithi155.stdout: "duration": 4294967295.9999995 2023-08-01T19:55:14.032 INFO:teuthology.orchestra.run.smithi155.stdout: }, 2023-08-01T19:55:14.032 INFO:teuthology.orchestra.run.smithi155.stdout: { 2023-08-01T19:55:14.033 INFO:teuthology.orchestra.run.smithi155.stdout: "event": "all_read", 2023-08-01T19:55:14.033 INFO:teuthology.orchestra.run.smithi155.stdout: "time": "2023-08-01T19:55:05.576893+0000", 2023-08-01T19:55:14.033 INFO:teuthology.orchestra.run.smithi155.stdout: "duration": 5.3893000000000001e-05 2023-08-01T19:55:14.033 INFO:teuthology.orchestra.run.smithi155.stdout: }, 2023-08-01T19:55:14.033 INFO:teuthology.orchestra.run.smithi155.stdout: { 2023-08-01T19:55:14.033 INFO:teuthology.orchestra.run.smithi155.stdout: "event": "dispatched", 2023-08-01T19:55:14.033 INFO:teuthology.orchestra.run.smithi155.stdout: "time": "2023-08-01T19:55:05.576902+0000", 2023-08-01T19:55:14.033 INFO:teuthology.orchestra.run.smithi155.stdout: "duration": 8.7520000000000002e-06 2023-08-01T19:55:14.034 INFO:teuthology.orchestra.run.smithi155.stdout: }, 2023-08-01T19:55:14.034 INFO:teuthology.orchestra.run.smithi155.stdout: { 2023-08-01T19:55:14.034 INFO:teuthology.orchestra.run.smithi155.stdout: "event": "queued_for_pg", 2023-08-01T19:55:14.034 INFO:teuthology.orchestra.run.smithi155.stdout: "time": "2023-08-01T19:55:05.576905+0000", 2023-08-01T19:55:14.034 INFO:teuthology.orchestra.run.smithi155.stdout: "duration": 3.01e-06 2023-08-01T19:55:14.034 INFO:teuthology.orchestra.run.smithi155.stdout: }, 2023-08-01T19:55:14.034 INFO:teuthology.orchestra.run.smithi155.stdout: { 2023-08-01T19:55:14.035 INFO:teuthology.orchestra.run.smithi155.stdout: "event": "reached_pg", 2023-08-01T19:55:14.035 INFO:teuthology.orchestra.run.smithi155.stdout: "time": "2023-08-01T19:55:05.579641+0000", 2023-08-01T19:55:14.035 INFO:teuthology.orchestra.run.smithi155.stdout: "duration": 0.0027366880000000001 2023-08-01T19:55:14.035 INFO:teuthology.orchestra.run.smithi155.stdout: }, 2023-08-01T19:55:14.035 INFO:teuthology.orchestra.run.smithi155.stdout: { 2023-08-01T19:55:14.035 INFO:teuthology.orchestra.run.smithi155.stdout: "event": "started", 2023-08-01T19:55:14.035 INFO:teuthology.orchestra.run.smithi155.stdout: "time": "2023-08-01T19:55:05.579734+0000", 2023-08-01T19:55:14.035 INFO:teuthology.orchestra.run.smithi155.stdout: "duration": 9.2590000000000006e-05 2023-08-01T19:55:14.036 INFO:teuthology.orchestra.run.smithi155.stdout: }, 2023-08-01T19:55:14.036 INFO:teuthology.orchestra.run.smithi155.stdout: { 2023-08-01T19:55:14.036 INFO:teuthology.orchestra.run.smithi155.stdout: "event": "waiting for subops from 0", 2023-08-01T19:55:14.036 INFO:teuthology.orchestra.run.smithi155.stdout: "time": "2023-08-01T19:55:05.579825+0000", 2023-08-01T19:55:14.036 INFO:teuthology.orchestra.run.smithi155.stdout: "duration": 9.0964999999999994e-05 2023-08-01T19:55:14.036 INFO:teuthology.orchestra.run.smithi155.stdout: }, 2023-08-01T19:55:14.036 INFO:teuthology.orchestra.run.smithi155.stdout: { 2023-08-01T19:55:14.037 INFO:teuthology.orchestra.run.smithi155.stdout: "event": "op_commit", 2023-08-01T19:55:14.037 INFO:teuthology.orchestra.run.smithi155.stdout: "time": "2023-08-01T19:55:05.585041+0000", 2023-08-01T19:55:14.037 INFO:teuthology.orchestra.run.smithi155.stdout: "duration": 0.0052159670000000002 2023-08-01T19:55:14.037 INFO:teuthology.orchestra.run.smithi155.stdout: }, 2023-08-01T19:55:14.037 INFO:teuthology.orchestra.run.smithi155.stdout: { 2023-08-01T19:55:14.037 INFO:teuthology.orchestra.run.smithi155.stdout: "event": "sub_op_commit_rec", 2023-08-01T19:55:14.037 INFO:teuthology.orchestra.run.smithi155.stdout: "time": "2023-08-01T19:55:05.635199+0000", 2023-08-01T19:55:14.038 INFO:teuthology.orchestra.run.smithi155.stdout: "duration": 0.050158023000000003 2023-08-01T19:55:14.038 INFO:teuthology.orchestra.run.smithi155.stdout: }, 2023-08-01T19:55:14.038 INFO:teuthology.orchestra.run.smithi155.stdout: { 2023-08-01T19:55:14.038 INFO:teuthology.orchestra.run.smithi155.stdout: "event": "commit_sent", 2023-08-01T19:55:14.038 INFO:teuthology.orchestra.run.smithi155.stdout: "time": "2023-08-01T19:55:05.635227+0000", 2023-08-01T19:55:14.038 INFO:teuthology.orchestra.run.smithi155.stdout: "duration": 2.7821e-05 2023-08-01T19:55:14.038 INFO:teuthology.orchestra.run.smithi155.stdout: }, 2023-08-01T19:55:14.039 INFO:teuthology.orchestra.run.smithi155.stdout: { 2023-08-01T19:55:14.039 INFO:teuthology.orchestra.run.smithi155.stdout: "event": "done", 2023-08-01T19:55:14.039 INFO:teuthology.orchestra.run.smithi155.stdout: "time": "2023-08-01T19:55:05.635263+0000", 2023-08-01T19:55:14.039 INFO:teuthology.orchestra.run.smithi155.stdout: "duration": 3.6081000000000002e-05 2023-08-01T19:55:14.039 INFO:teuthology.orchestra.run.smithi155.stdout: } 2023-08-01T19:55:14.039 INFO:teuthology.orchestra.run.smithi155.stdout: ] 2023-08-01T19:55:14.039 INFO:teuthology.orchestra.run.smithi155.stdout: } 2023-08-01T19:55:14.040 INFO:teuthology.orchestra.run.smithi155.stdout: } 2023-08-01T19:55:14.040 INFO:teuthology.orchestra.run.smithi155.stdout: ] 2023-08-01T19:55:14.040 INFO:teuthology.orchestra.run.smithi155.stdout:} 2023-08-01T19:55:14.041 INFO:tasks.ceph.osd.2.smithi155.stderr:2023-08-01T19:55:14.039+0000 7faa5c6ac700 -1 received signal: Hangup from /usr/bin/python3 /bin/daemon-helper kill ceph-osd -f --cluster ceph -i 2 (PID: 111337) UID: 0 2023-08-01T19:55:14.042 DEBUG:teuthology.orchestra.run.smithi008:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 30 ceph --cluster ceph --admin-daemon /var/run/ceph/ceph-osd.0.asok dump_ops_in_flight 2023-08-01T19:55:14.142 INFO:tasks.ceph.osd.0.smithi008.stderr:2023-08-01T19:55:14.140+0000 7f16a58f4700 -1 received signal: Hangup from /usr/bin/python3 /bin/daemon-helper kill ceph-osd -f --cluster ceph -i 0 (PID: 111179) UID: 0 2023-08-01T19:55:14.239 INFO:teuthology.orchestra.run.smithi008.stdout:{ 2023-08-01T19:55:14.240 INFO:teuthology.orchestra.run.smithi008.stdout: "ops": [ 2023-08-01T19:55:14.240 INFO:teuthology.orchestra.run.smithi008.stdout: { 2023-08-01T19:55:14.240 INFO:teuthology.orchestra.run.smithi008.stdout: "description": "osd_op(client.4668.0:115143 5.6 5:6b2001d3:::benchmark_data_smithi006_114134_object115142:head [set-alloc-hint object_size 65536 write_size 65536,write 0~65536 in=65536b] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e42)", 2023-08-01T19:55:14.240 INFO:teuthology.orchestra.run.smithi008.stdout: "initiated_at": "2023-08-01T19:55:14.225526+0000", 2023-08-01T19:55:14.240 INFO:teuthology.orchestra.run.smithi008.stdout: "age": 0.011789554000000001, 2023-08-01T19:55:14.241 INFO:teuthology.orchestra.run.smithi008.stdout: "duration": 0.011827476, 2023-08-01T19:55:14.241 INFO:teuthology.orchestra.run.smithi008.stdout: "type_data": { 2023-08-01T19:55:14.241 INFO:teuthology.orchestra.run.smithi008.stdout: "flag_point": "waiting for sub ops", 2023-08-01T19:55:14.241 INFO:teuthology.orchestra.run.smithi008.stdout: "client_info": { 2023-08-01T19:55:14.241 INFO:teuthology.orchestra.run.smithi008.stdout: "client": "client.4668", 2023-08-01T19:55:14.241 INFO:teuthology.orchestra.run.smithi008.stdout: "client_addr": "172.21.15.6:0/1709472247", 2023-08-01T19:55:14.241 INFO:teuthology.orchestra.run.smithi008.stdout: "tid": 115143 2023-08-01T19:55:14.241 INFO:teuthology.orchestra.run.smithi008.stdout: }, 2023-08-01T19:55:14.242 INFO:teuthology.orchestra.run.smithi008.stdout: "events": [ 2023-08-01T19:55:14.242 INFO:teuthology.orchestra.run.smithi008.stdout: { 2023-08-01T19:55:14.242 INFO:teuthology.orchestra.run.smithi008.stdout: "event": "initiated", 2023-08-01T19:55:14.242 INFO:teuthology.orchestra.run.smithi008.stdout: "time": "2023-08-01T19:55:14.225526+0000", 2023-08-01T19:55:14.242 INFO:teuthology.orchestra.run.smithi008.stdout: "duration": 0 2023-08-01T19:55:14.242 INFO:teuthology.orchestra.run.smithi008.stdout: }, 2023-08-01T19:55:14.242 INFO:teuthology.orchestra.run.smithi008.stdout: { 2023-08-01T19:55:14.242 INFO:teuthology.orchestra.run.smithi008.stdout: "event": "throttled", 2023-08-01T19:55:14.243 INFO:teuthology.orchestra.run.smithi008.stdout: "time": "2023-08-01T19:55:14.225526+0000", 2023-08-01T19:55:14.243 INFO:teuthology.orchestra.run.smithi008.stdout: "duration": 0 2023-08-01T19:55:14.243 INFO:teuthology.orchestra.run.smithi008.stdout: }, 2023-08-01T19:55:14.243 INFO:teuthology.orchestra.run.smithi008.stdout: { 2023-08-01T19:55:14.243 INFO:teuthology.orchestra.run.smithi008.stdout: "event": "header_read", 2023-08-01T19:55:14.243 INFO:teuthology.orchestra.run.smithi008.stdout: "time": "2023-08-01T19:55:14.225525+0000", 2023-08-01T19:55:14.243 INFO:teuthology.orchestra.run.smithi008.stdout: "duration": 4294967295.9999995 2023-08-01T19:55:14.244 INFO:teuthology.orchestra.run.smithi008.stdout: }, 2023-08-01T19:55:14.244 INFO:teuthology.orchestra.run.smithi008.stdout: { 2023-08-01T19:55:14.244 INFO:teuthology.orchestra.run.smithi008.stdout: "event": "all_read", 2023-08-01T19:55:14.244 INFO:teuthology.orchestra.run.smithi008.stdout: "time": "2023-08-01T19:55:14.225574+0000", 2023-08-01T19:55:14.244 INFO:teuthology.orchestra.run.smithi008.stdout: "duration": 4.9333999999999999e-05 2023-08-01T19:55:14.244 INFO:teuthology.orchestra.run.smithi008.stdout: }, 2023-08-01T19:55:14.244 INFO:teuthology.orchestra.run.smithi008.stdout: { 2023-08-01T19:55:14.244 INFO:teuthology.orchestra.run.smithi008.stdout: "event": "dispatched", 2023-08-01T19:55:14.245 INFO:teuthology.orchestra.run.smithi008.stdout: "time": "2023-08-01T19:55:14.225584+0000", 2023-08-01T19:55:14.245 INFO:teuthology.orchestra.run.smithi008.stdout: "duration": 9.8840000000000006e-06 2023-08-01T19:55:14.245 INFO:teuthology.orchestra.run.smithi008.stdout: }, 2023-08-01T19:55:14.245 INFO:teuthology.orchestra.run.smithi008.stdout: { 2023-08-01T19:55:14.245 INFO:teuthology.orchestra.run.smithi008.stdout: "event": "queued_for_pg", 2023-08-01T19:55:14.245 INFO:teuthology.orchestra.run.smithi008.stdout: "time": "2023-08-01T19:55:14.225589+0000", 2023-08-01T19:55:14.245 INFO:teuthology.orchestra.run.smithi008.stdout: "duration": 4.9350000000000002e-06 2023-08-01T19:55:14.245 INFO:teuthology.orchestra.run.smithi008.stdout: }, 2023-08-01T19:55:14.246 INFO:teuthology.orchestra.run.smithi008.stdout: { 2023-08-01T19:55:14.246 INFO:teuthology.orchestra.run.smithi008.stdout: "event": "reached_pg", 2023-08-01T19:55:14.246 INFO:teuthology.orchestra.run.smithi008.stdout: "time": "2023-08-01T19:55:14.225630+0000", 2023-08-01T19:55:14.246 INFO:teuthology.orchestra.run.smithi008.stdout: "duration": 4.0694e-05 2023-08-01T19:55:14.246 INFO:teuthology.orchestra.run.smithi008.stdout: }, 2023-08-01T19:55:14.246 INFO:teuthology.orchestra.run.smithi008.stdout: { 2023-08-01T19:55:14.246 INFO:teuthology.orchestra.run.smithi008.stdout: "event": "started", 2023-08-01T19:55:14.246 INFO:teuthology.orchestra.run.smithi008.stdout: "time": "2023-08-01T19:55:14.225755+0000", 2023-08-01T19:55:14.247 INFO:teuthology.orchestra.run.smithi008.stdout: "duration": 0.000124836 2023-08-01T19:55:14.247 INFO:teuthology.orchestra.run.smithi008.stdout: }, 2023-08-01T19:55:14.247 INFO:teuthology.orchestra.run.smithi008.stdout: { 2023-08-01T19:55:14.247 INFO:teuthology.orchestra.run.smithi008.stdout: "event": "waiting for subops from 1", 2023-08-01T19:55:14.247 INFO:teuthology.orchestra.run.smithi008.stdout: "time": "2023-08-01T19:55:14.225916+0000", 2023-08-01T19:55:14.247 INFO:teuthology.orchestra.run.smithi008.stdout: "duration": 0.00016164099999999999 2023-08-01T19:55:14.247 INFO:teuthology.orchestra.run.smithi008.stdout: }, 2023-08-01T19:55:14.248 INFO:teuthology.orchestra.run.smithi008.stdout: { 2023-08-01T19:55:14.248 INFO:teuthology.orchestra.run.smithi008.stdout: "event": "sub_op_commit_rec", 2023-08-01T19:55:14.248 INFO:teuthology.orchestra.run.smithi008.stdout: "time": "2023-08-01T19:55:14.230101+0000", 2023-08-01T19:55:14.248 INFO:teuthology.orchestra.run.smithi008.stdout: "duration": 0.0041843280000000002 2023-08-01T19:55:14.248 INFO:teuthology.orchestra.run.smithi008.stdout: } 2023-08-01T19:55:14.248 INFO:teuthology.orchestra.run.smithi008.stdout: ] 2023-08-01T19:55:14.248 INFO:teuthology.orchestra.run.smithi008.stdout: } 2023-08-01T19:55:14.248 INFO:teuthology.orchestra.run.smithi008.stdout: }, 2023-08-01T19:55:14.249 INFO:teuthology.orchestra.run.smithi008.stdout: { 2023-08-01T19:55:14.249 INFO:teuthology.orchestra.run.smithi008.stdout: "description": "osd_op(client.4668.0:115146 5.3 5:cd152cd2:::benchmark_data_smithi006_114134_object115145:head [set-alloc-hint object_size 65536 write_size 65536,write 0~65536 in=65536b] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e42)", 2023-08-01T19:55:14.249 INFO:teuthology.orchestra.run.smithi008.stdout: "initiated_at": "2023-08-01T19:55:14.227437+0000", 2023-08-01T19:55:14.249 INFO:teuthology.orchestra.run.smithi008.stdout: "age": 0.0098777069999999995, 2023-08-01T19:55:14.249 INFO:teuthology.orchestra.run.smithi008.stdout: "duration": 0.010030581, 2023-08-01T19:55:14.249 INFO:teuthology.orchestra.run.smithi008.stdout: "type_data": { 2023-08-01T19:55:14.249 INFO:teuthology.orchestra.run.smithi008.stdout: "flag_point": "waiting for sub ops", 2023-08-01T19:55:14.249 INFO:teuthology.orchestra.run.smithi008.stdout: "client_info": { 2023-08-01T19:55:14.250 INFO:teuthology.orchestra.run.smithi008.stdout: "client": "client.4668", 2023-08-01T19:55:14.250 INFO:teuthology.orchestra.run.smithi008.stdout: "client_addr": "172.21.15.6:0/1709472247", 2023-08-01T19:55:14.250 INFO:teuthology.orchestra.run.smithi008.stdout: "tid": 115146 2023-08-01T19:55:14.250 INFO:teuthology.orchestra.run.smithi008.stdout: }, 2023-08-01T19:55:14.250 INFO:teuthology.orchestra.run.smithi008.stdout: "events": [ 2023-08-01T19:55:14.250 INFO:teuthology.orchestra.run.smithi008.stdout: { 2023-08-01T19:55:14.250 INFO:teuthology.orchestra.run.smithi008.stdout: "event": "initiated", 2023-08-01T19:55:14.251 INFO:teuthology.orchestra.run.smithi008.stdout: "time": "2023-08-01T19:55:14.227437+0000", 2023-08-01T19:55:14.251 INFO:teuthology.orchestra.run.smithi008.stdout: "duration": 0 2023-08-01T19:55:14.251 INFO:teuthology.orchestra.run.smithi008.stdout: }, 2023-08-01T19:55:14.251 INFO:teuthology.orchestra.run.smithi008.stdout: { 2023-08-01T19:55:14.251 INFO:teuthology.orchestra.run.smithi008.stdout: "event": "throttled", 2023-08-01T19:55:14.251 INFO:teuthology.orchestra.run.smithi008.stdout: "time": "2023-08-01T19:55:14.227437+0000", 2023-08-01T19:55:14.251 INFO:teuthology.orchestra.run.smithi008.stdout: "duration": 0 2023-08-01T19:55:14.251 INFO:teuthology.orchestra.run.smithi008.stdout: }, 2023-08-01T19:55:14.252 INFO:teuthology.orchestra.run.smithi008.stdout: { 2023-08-01T19:55:14.252 INFO:teuthology.orchestra.run.smithi008.stdout: "event": "header_read", 2023-08-01T19:55:14.252 INFO:teuthology.orchestra.run.smithi008.stdout: "time": "2023-08-01T19:55:14.227437+0000", 2023-08-01T19:55:14.252 INFO:teuthology.orchestra.run.smithi008.stdout: "duration": 4294967295.9999995 2023-08-01T19:55:14.252 INFO:teuthology.orchestra.run.smithi008.stdout: }, 2023-08-01T19:55:14.252 INFO:teuthology.orchestra.run.smithi008.stdout: { 2023-08-01T19:55:14.252 INFO:teuthology.orchestra.run.smithi008.stdout: "event": "all_read", 2023-08-01T19:55:14.252 INFO:teuthology.orchestra.run.smithi008.stdout: "time": "2023-08-01T19:55:14.227469+0000", 2023-08-01T19:55:14.253 INFO:teuthology.orchestra.run.smithi008.stdout: "duration": 3.1995000000000001e-05 2023-08-01T19:55:14.253 INFO:teuthology.orchestra.run.smithi008.stdout: }, 2023-08-01T19:55:14.253 INFO:teuthology.orchestra.run.smithi008.stdout: { 2023-08-01T19:55:14.253 INFO:teuthology.orchestra.run.smithi008.stdout: "event": "dispatched", 2023-08-01T19:55:14.253 INFO:teuthology.orchestra.run.smithi008.stdout: "time": "2023-08-01T19:55:14.227480+0000", 2023-08-01T19:55:14.253 INFO:teuthology.orchestra.run.smithi008.stdout: "duration": 1.0854e-05 2023-08-01T19:55:14.254 INFO:teuthology.orchestra.run.smithi008.stdout: }, 2023-08-01T19:55:14.254 INFO:teuthology.orchestra.run.smithi008.stdout: { 2023-08-01T19:55:14.254 INFO:teuthology.orchestra.run.smithi008.stdout: "event": "queued_for_pg", 2023-08-01T19:55:14.254 INFO:teuthology.orchestra.run.smithi008.stdout: "time": "2023-08-01T19:55:14.227485+0000", 2023-08-01T19:55:14.254 INFO:teuthology.orchestra.run.smithi008.stdout: "duration": 5.5450000000000003e-06 2023-08-01T19:55:14.254 INFO:teuthology.orchestra.run.smithi008.stdout: }, 2023-08-01T19:55:14.254 INFO:teuthology.orchestra.run.smithi008.stdout: { 2023-08-01T19:55:14.254 INFO:teuthology.orchestra.run.smithi008.stdout: "event": "reached_pg", 2023-08-01T19:55:14.255 INFO:teuthology.orchestra.run.smithi008.stdout: "time": "2023-08-01T19:55:14.230269+0000", 2023-08-01T19:55:14.255 INFO:teuthology.orchestra.run.smithi008.stdout: "duration": 0.0027836559999999998 2023-08-01T19:55:14.255 INFO:teuthology.orchestra.run.smithi008.stdout: }, 2023-08-01T19:55:14.255 INFO:teuthology.orchestra.run.smithi008.stdout: { 2023-08-01T19:55:14.255 INFO:teuthology.orchestra.run.smithi008.stdout: "event": "started", 2023-08-01T19:55:14.255 INFO:teuthology.orchestra.run.smithi008.stdout: "time": "2023-08-01T19:55:14.230397+0000", 2023-08-01T19:55:14.255 INFO:teuthology.orchestra.run.smithi008.stdout: "duration": 0.000128171 2023-08-01T19:55:14.255 INFO:teuthology.orchestra.run.smithi008.stdout: }, 2023-08-01T19:55:14.256 INFO:teuthology.orchestra.run.smithi008.stdout: { 2023-08-01T19:55:14.256 INFO:teuthology.orchestra.run.smithi008.stdout: "event": "waiting for subops from 1", 2023-08-01T19:55:14.256 INFO:teuthology.orchestra.run.smithi008.stdout: "time": "2023-08-01T19:55:14.230500+0000", 2023-08-01T19:55:14.256 INFO:teuthology.orchestra.run.smithi008.stdout: "duration": 0.000102837 2023-08-01T19:55:14.256 INFO:teuthology.orchestra.run.smithi008.stdout: }, 2023-08-01T19:55:14.256 INFO:teuthology.orchestra.run.smithi008.stdout: { 2023-08-01T19:55:14.256 INFO:teuthology.orchestra.run.smithi008.stdout: "event": "op_commit", 2023-08-01T19:55:14.257 INFO:teuthology.orchestra.run.smithi008.stdout: "time": "2023-08-01T19:55:14.234593+0000", 2023-08-01T19:55:14.257 INFO:teuthology.orchestra.run.smithi008.stdout: "duration": 0.0040933840000000003 2023-08-01T19:55:14.257 INFO:teuthology.orchestra.run.smithi008.stdout: } 2023-08-01T19:55:14.257 INFO:teuthology.orchestra.run.smithi008.stdout: ] 2023-08-01T19:55:14.257 INFO:teuthology.orchestra.run.smithi008.stdout: } 2023-08-01T19:55:14.257 INFO:teuthology.orchestra.run.smithi008.stdout: }, 2023-08-01T19:55:14.257 INFO:teuthology.orchestra.run.smithi008.stdout: { 2023-08-01T19:55:14.257 INFO:teuthology.orchestra.run.smithi008.stdout: "description": "osd_op(client.4668.0:115150 5.3 5:cb3a6b09:::benchmark_data_smithi006_114134_object115149:head [set-alloc-hint object_size 65536 write_size 65536,write 0~65536 in=65536b] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e42)", 2023-08-01T19:55:14.258 INFO:teuthology.orchestra.run.smithi008.stdout: "initiated_at": "2023-08-01T19:55:14.230322+0000", 2023-08-01T19:55:14.258 INFO:teuthology.orchestra.run.smithi008.stdout: "age": 0.0069929730000000004, 2023-08-01T19:55:14.258 INFO:teuthology.orchestra.run.smithi008.stdout: "duration": 0.0072347449999999999, 2023-08-01T19:55:14.258 INFO:teuthology.orchestra.run.smithi008.stdout: "type_data": { 2023-08-01T19:55:14.258 INFO:teuthology.orchestra.run.smithi008.stdout: "flag_point": "waiting for sub ops", 2023-08-01T19:55:14.258 INFO:teuthology.orchestra.run.smithi008.stdout: "client_info": { 2023-08-01T19:55:14.258 INFO:teuthology.orchestra.run.smithi008.stdout: "client": "client.4668", 2023-08-01T19:55:14.258 INFO:teuthology.orchestra.run.smithi008.stdout: "client_addr": "172.21.15.6:0/1709472247", 2023-08-01T19:55:14.259 INFO:teuthology.orchestra.run.smithi008.stdout: "tid": 115150 2023-08-01T19:55:14.259 INFO:teuthology.orchestra.run.smithi008.stdout: }, 2023-08-01T19:55:14.259 INFO:teuthology.orchestra.run.smithi008.stdout: "events": [ 2023-08-01T19:55:14.259 INFO:teuthology.orchestra.run.smithi008.stdout: { 2023-08-01T19:55:14.259 INFO:teuthology.orchestra.run.smithi008.stdout: "event": "initiated", 2023-08-01T19:55:14.259 INFO:teuthology.orchestra.run.smithi008.stdout: "time": "2023-08-01T19:55:14.230322+0000", 2023-08-01T19:55:14.259 INFO:teuthology.orchestra.run.smithi008.stdout: "duration": 0 2023-08-01T19:55:14.259 INFO:teuthology.orchestra.run.smithi008.stdout: }, 2023-08-01T19:55:14.260 INFO:teuthology.orchestra.run.smithi008.stdout: { 2023-08-01T19:55:14.260 INFO:teuthology.orchestra.run.smithi008.stdout: "event": "throttled", 2023-08-01T19:55:14.260 INFO:teuthology.orchestra.run.smithi008.stdout: "time": "2023-08-01T19:55:14.230322+0000", 2023-08-01T19:55:14.260 INFO:teuthology.orchestra.run.smithi008.stdout: "duration": 0 2023-08-01T19:55:14.260 INFO:teuthology.orchestra.run.smithi008.stdout: }, 2023-08-01T19:55:14.260 INFO:teuthology.orchestra.run.smithi008.stdout: { 2023-08-01T19:55:14.260 INFO:teuthology.orchestra.run.smithi008.stdout: "event": "header_read", 2023-08-01T19:55:14.261 INFO:teuthology.orchestra.run.smithi008.stdout: "time": "2023-08-01T19:55:14.230321+0000", 2023-08-01T19:55:14.261 INFO:teuthology.orchestra.run.smithi008.stdout: "duration": 4294967295.999999 2023-08-01T19:55:14.261 INFO:teuthology.orchestra.run.smithi008.stdout: }, 2023-08-01T19:55:14.261 INFO:teuthology.orchestra.run.smithi008.stdout: { 2023-08-01T19:55:14.261 INFO:teuthology.orchestra.run.smithi008.stdout: "event": "all_read", 2023-08-01T19:55:14.261 INFO:teuthology.orchestra.run.smithi008.stdout: "time": "2023-08-01T19:55:14.230400+0000", 2023-08-01T19:55:14.261 INFO:teuthology.orchestra.run.smithi008.stdout: "duration": 7.8495e-05 2023-08-01T19:55:14.261 INFO:teuthology.orchestra.run.smithi008.stdout: }, 2023-08-01T19:55:14.262 INFO:teuthology.orchestra.run.smithi008.stdout: { 2023-08-01T19:55:14.262 INFO:teuthology.orchestra.run.smithi008.stdout: "event": "dispatched", 2023-08-01T19:55:14.262 INFO:teuthology.orchestra.run.smithi008.stdout: "time": "2023-08-01T19:55:14.230411+0000", 2023-08-01T19:55:14.262 INFO:teuthology.orchestra.run.smithi008.stdout: "duration": 1.1069e-05 2023-08-01T19:55:14.262 INFO:teuthology.orchestra.run.smithi008.stdout: }, 2023-08-01T19:55:14.262 INFO:teuthology.orchestra.run.smithi008.stdout: { 2023-08-01T19:55:14.262 INFO:teuthology.orchestra.run.smithi008.stdout: "event": "queued_for_pg", 2023-08-01T19:55:14.262 INFO:teuthology.orchestra.run.smithi008.stdout: "time": "2023-08-01T19:55:14.230417+0000", 2023-08-01T19:55:14.263 INFO:teuthology.orchestra.run.smithi008.stdout: "duration": 6.4139999999999999e-06 2023-08-01T19:55:14.263 INFO:teuthology.orchestra.run.smithi008.stdout: }, 2023-08-01T19:55:14.263 INFO:teuthology.orchestra.run.smithi008.stdout: { 2023-08-01T19:55:14.263 INFO:teuthology.orchestra.run.smithi008.stdout: "event": "reached_pg", 2023-08-01T19:55:14.263 INFO:teuthology.orchestra.run.smithi008.stdout: "time": "2023-08-01T19:55:14.231979+0000", 2023-08-01T19:55:14.263 INFO:teuthology.orchestra.run.smithi008.stdout: "duration": 0.0015623919999999999 2023-08-01T19:55:14.263 INFO:teuthology.orchestra.run.smithi008.stdout: }, 2023-08-01T19:55:14.263 INFO:teuthology.orchestra.run.smithi008.stdout: { 2023-08-01T19:55:14.264 INFO:teuthology.orchestra.run.smithi008.stdout: "event": "started", 2023-08-01T19:55:14.264 INFO:teuthology.orchestra.run.smithi008.stdout: "time": "2023-08-01T19:55:14.232127+0000", 2023-08-01T19:55:14.264 INFO:teuthology.orchestra.run.smithi008.stdout: "duration": 0.00014767400000000001 2023-08-01T19:55:14.264 INFO:teuthology.orchestra.run.smithi008.stdout: }, 2023-08-01T19:55:14.264 INFO:teuthology.orchestra.run.smithi008.stdout: { 2023-08-01T19:55:14.264 INFO:teuthology.orchestra.run.smithi008.stdout: "event": "waiting for subops from 1", 2023-08-01T19:55:14.264 INFO:teuthology.orchestra.run.smithi008.stdout: "time": "2023-08-01T19:55:14.232298+0000", 2023-08-01T19:55:14.265 INFO:teuthology.orchestra.run.smithi008.stdout: "duration": 0.00017093800000000001 2023-08-01T19:55:14.265 INFO:teuthology.orchestra.run.smithi008.stdout: } 2023-08-01T19:55:14.265 INFO:teuthology.orchestra.run.smithi008.stdout: ] 2023-08-01T19:55:14.265 INFO:teuthology.orchestra.run.smithi008.stdout: } 2023-08-01T19:55:14.265 INFO:teuthology.orchestra.run.smithi008.stdout: }, 2023-08-01T19:55:14.265 INFO:teuthology.orchestra.run.smithi008.stdout: { 2023-08-01T19:55:14.265 INFO:teuthology.orchestra.run.smithi008.stdout: "description": "osd_repop(client.4668.0:115149 5.0 e42/19 5:0d83da4d:::benchmark_data_smithi006_114134_object115148:head v 42'7287, mlcod=42'7284)", 2023-08-01T19:55:14.265 INFO:teuthology.orchestra.run.smithi008.stdout: "initiated_at": "2023-08-01T19:55:14.231051+0000", 2023-08-01T19:55:14.266 INFO:teuthology.orchestra.run.smithi008.stdout: "age": 0.0062639480000000001, 2023-08-01T19:55:14.266 INFO:teuthology.orchestra.run.smithi008.stdout: "duration": 0.0065817339999999997, 2023-08-01T19:55:14.266 INFO:teuthology.orchestra.run.smithi008.stdout: "type_data": { 2023-08-01T19:55:14.266 INFO:teuthology.orchestra.run.smithi008.stdout: "flag_point": "started", 2023-08-01T19:55:14.266 INFO:teuthology.orchestra.run.smithi008.stdout: "events": [ 2023-08-01T19:55:14.266 INFO:teuthology.orchestra.run.smithi008.stdout: { 2023-08-01T19:55:14.266 INFO:teuthology.orchestra.run.smithi008.stdout: "event": "initiated", 2023-08-01T19:55:14.267 INFO:teuthology.orchestra.run.smithi008.stdout: "time": "2023-08-01T19:55:14.231051+0000", 2023-08-01T19:55:14.267 INFO:teuthology.orchestra.run.smithi008.stdout: "duration": 0 2023-08-01T19:55:14.267 INFO:teuthology.orchestra.run.smithi008.stdout: }, 2023-08-01T19:55:14.267 INFO:teuthology.orchestra.run.smithi008.stdout: { 2023-08-01T19:55:14.267 INFO:teuthology.orchestra.run.smithi008.stdout: "event": "throttled", 2023-08-01T19:55:14.267 INFO:teuthology.orchestra.run.smithi008.stdout: "time": "2023-08-01T19:55:14.231051+0000", 2023-08-01T19:55:14.267 INFO:teuthology.orchestra.run.smithi008.stdout: "duration": 0 2023-08-01T19:55:14.267 INFO:teuthology.orchestra.run.smithi008.stdout: }, 2023-08-01T19:55:14.268 INFO:teuthology.orchestra.run.smithi008.stdout: { 2023-08-01T19:55:14.268 INFO:teuthology.orchestra.run.smithi008.stdout: "event": "header_read", 2023-08-01T19:55:14.268 INFO:teuthology.orchestra.run.smithi008.stdout: "time": "2023-08-01T19:55:14.231051+0000", 2023-08-01T19:55:14.268 INFO:teuthology.orchestra.run.smithi008.stdout: "duration": 4294967295.9999995 2023-08-01T19:55:14.268 INFO:teuthology.orchestra.run.smithi008.stdout: }, 2023-08-01T19:55:14.268 INFO:teuthology.orchestra.run.smithi008.stdout: { 2023-08-01T19:55:14.268 INFO:teuthology.orchestra.run.smithi008.stdout: "event": "all_read", 2023-08-01T19:55:14.269 INFO:teuthology.orchestra.run.smithi008.stdout: "time": "2023-08-01T19:55:14.231113+0000", 2023-08-01T19:55:14.269 INFO:teuthology.orchestra.run.smithi008.stdout: "duration": 6.1988000000000003e-05 2023-08-01T19:55:14.269 INFO:teuthology.orchestra.run.smithi008.stdout: }, 2023-08-01T19:55:14.269 INFO:teuthology.orchestra.run.smithi008.stdout: { 2023-08-01T19:55:14.269 INFO:teuthology.orchestra.run.smithi008.stdout: "event": "dispatched", 2023-08-01T19:55:14.269 INFO:teuthology.orchestra.run.smithi008.stdout: "time": "2023-08-01T19:55:14.231123+0000", 2023-08-01T19:55:14.269 INFO:teuthology.orchestra.run.smithi008.stdout: "duration": 1.0784e-05 2023-08-01T19:55:14.270 INFO:teuthology.orchestra.run.smithi008.stdout: }, 2023-08-01T19:55:14.270 INFO:teuthology.orchestra.run.smithi008.stdout: { 2023-08-01T19:55:14.270 INFO:teuthology.orchestra.run.smithi008.stdout: "event": "queued_for_pg", 2023-08-01T19:55:14.270 INFO:teuthology.orchestra.run.smithi008.stdout: "time": "2023-08-01T19:55:14.231129+0000", 2023-08-01T19:55:14.270 INFO:teuthology.orchestra.run.smithi008.stdout: "duration": 5.434e-06 2023-08-01T19:55:14.270 INFO:teuthology.orchestra.run.smithi008.stdout: }, 2023-08-01T19:55:14.270 INFO:teuthology.orchestra.run.smithi008.stdout: { 2023-08-01T19:55:14.270 INFO:teuthology.orchestra.run.smithi008.stdout: "event": "reached_pg", 2023-08-01T19:55:14.271 INFO:teuthology.orchestra.run.smithi008.stdout: "time": "2023-08-01T19:55:14.231178+0000", 2023-08-01T19:55:14.271 INFO:teuthology.orchestra.run.smithi008.stdout: "duration": 4.8891000000000003e-05 2023-08-01T19:55:14.271 INFO:teuthology.orchestra.run.smithi008.stdout: }, 2023-08-01T19:55:14.271 INFO:teuthology.orchestra.run.smithi008.stdout: { 2023-08-01T19:55:14.271 INFO:teuthology.orchestra.run.smithi008.stdout: "event": "started", 2023-08-01T19:55:14.271 INFO:teuthology.orchestra.run.smithi008.stdout: "time": "2023-08-01T19:55:14.231197+0000", 2023-08-01T19:55:14.271 INFO:teuthology.orchestra.run.smithi008.stdout: "duration": 1.9347999999999998e-05 2023-08-01T19:55:14.271 INFO:teuthology.orchestra.run.smithi008.stdout: } 2023-08-01T19:55:14.272 INFO:teuthology.orchestra.run.smithi008.stdout: ] 2023-08-01T19:55:14.272 INFO:teuthology.orchestra.run.smithi008.stdout: } 2023-08-01T19:55:14.272 INFO:teuthology.orchestra.run.smithi008.stdout: }, 2023-08-01T19:55:14.272 INFO:teuthology.orchestra.run.smithi008.stdout: { 2023-08-01T19:55:14.272 INFO:teuthology.orchestra.run.smithi008.stdout: "description": "osd_repop(client.4668.0:115154 5.e e42/19 5:7bbeb981:::benchmark_data_smithi006_114134_object115153:head v 42'7222, mlcod=42'7220)", 2023-08-01T19:55:14.272 INFO:teuthology.orchestra.run.smithi008.stdout: "initiated_at": "2023-08-01T19:55:14.233472+0000", 2023-08-01T19:55:14.272 INFO:teuthology.orchestra.run.smithi008.stdout: "age": 0.0038431170000000001, 2023-08-01T19:55:14.273 INFO:teuthology.orchestra.run.smithi008.stdout: "duration": 0.0042206650000000002, 2023-08-01T19:55:14.273 INFO:teuthology.orchestra.run.smithi008.stdout: "type_data": { 2023-08-01T19:55:14.273 INFO:teuthology.orchestra.run.smithi008.stdout: "flag_point": "started", 2023-08-01T19:55:14.273 INFO:teuthology.orchestra.run.smithi008.stdout: "events": [ 2023-08-01T19:55:14.273 INFO:teuthology.orchestra.run.smithi008.stdout: { 2023-08-01T19:55:14.273 INFO:teuthology.orchestra.run.smithi008.stdout: "event": "initiated", 2023-08-01T19:55:14.273 INFO:teuthology.orchestra.run.smithi008.stdout: "time": "2023-08-01T19:55:14.233472+0000", 2023-08-01T19:55:14.273 INFO:teuthology.orchestra.run.smithi008.stdout: "duration": 0 2023-08-01T19:55:14.274 INFO:teuthology.orchestra.run.smithi008.stdout: }, 2023-08-01T19:55:14.274 INFO:teuthology.orchestra.run.smithi008.stdout: { 2023-08-01T19:55:14.274 INFO:teuthology.orchestra.run.smithi008.stdout: "event": "throttled", 2023-08-01T19:55:14.274 INFO:teuthology.orchestra.run.smithi008.stdout: "time": "2023-08-01T19:55:14.233472+0000", 2023-08-01T19:55:14.274 INFO:teuthology.orchestra.run.smithi008.stdout: "duration": 0 2023-08-01T19:55:14.274 INFO:teuthology.orchestra.run.smithi008.stdout: }, 2023-08-01T19:55:14.274 INFO:teuthology.orchestra.run.smithi008.stdout: { 2023-08-01T19:55:14.274 INFO:teuthology.orchestra.run.smithi008.stdout: "event": "header_read", 2023-08-01T19:55:14.275 INFO:teuthology.orchestra.run.smithi008.stdout: "time": "2023-08-01T19:55:14.233471+0000", 2023-08-01T19:55:14.275 INFO:teuthology.orchestra.run.smithi008.stdout: "duration": 4294967295.9999995 2023-08-01T19:55:14.275 INFO:teuthology.orchestra.run.smithi008.stdout: }, 2023-08-01T19:55:14.275 INFO:teuthology.orchestra.run.smithi008.stdout: { 2023-08-01T19:55:14.275 INFO:teuthology.orchestra.run.smithi008.stdout: "event": "all_read", 2023-08-01T19:55:14.275 INFO:teuthology.orchestra.run.smithi008.stdout: "time": "2023-08-01T19:55:14.233531+0000", 2023-08-01T19:55:14.275 INFO:teuthology.orchestra.run.smithi008.stdout: "duration": 5.9151999999999999e-05 2023-08-01T19:55:14.275 INFO:teuthology.orchestra.run.smithi008.stdout: }, 2023-08-01T19:55:14.276 INFO:teuthology.orchestra.run.smithi008.stdout: { 2023-08-01T19:55:14.276 INFO:teuthology.orchestra.run.smithi008.stdout: "event": "dispatched", 2023-08-01T19:55:14.276 INFO:teuthology.orchestra.run.smithi008.stdout: "time": "2023-08-01T19:55:14.233540+0000", 2023-08-01T19:55:14.276 INFO:teuthology.orchestra.run.smithi008.stdout: "duration": 9.1449999999999997e-06 2023-08-01T19:55:14.276 INFO:teuthology.orchestra.run.smithi008.stdout: }, 2023-08-01T19:55:14.276 INFO:teuthology.orchestra.run.smithi008.stdout: { 2023-08-01T19:55:14.276 INFO:teuthology.orchestra.run.smithi008.stdout: "event": "queued_for_pg", 2023-08-01T19:55:14.277 INFO:teuthology.orchestra.run.smithi008.stdout: "time": "2023-08-01T19:55:14.233544+0000", 2023-08-01T19:55:14.277 INFO:teuthology.orchestra.run.smithi008.stdout: "duration": 4.1309999999999999e-06 2023-08-01T19:55:14.277 INFO:teuthology.orchestra.run.smithi008.stdout: }, 2023-08-01T19:55:14.277 INFO:teuthology.orchestra.run.smithi008.stdout: { 2023-08-01T19:55:14.277 INFO:teuthology.orchestra.run.smithi008.stdout: "event": "reached_pg", 2023-08-01T19:55:14.277 INFO:teuthology.orchestra.run.smithi008.stdout: "time": "2023-08-01T19:55:14.233576+0000", 2023-08-01T19:55:14.277 INFO:teuthology.orchestra.run.smithi008.stdout: "duration": 3.2530000000000002e-05 2023-08-01T19:55:14.278 INFO:teuthology.orchestra.run.smithi008.stdout: }, 2023-08-01T19:55:14.278 INFO:teuthology.orchestra.run.smithi008.stdout: { 2023-08-01T19:55:14.278 INFO:teuthology.orchestra.run.smithi008.stdout: "event": "started", 2023-08-01T19:55:14.278 INFO:teuthology.orchestra.run.smithi008.stdout: "time": "2023-08-01T19:55:14.233589+0000", 2023-08-01T19:55:14.278 INFO:teuthology.orchestra.run.smithi008.stdout: "duration": 1.3037000000000001e-05 2023-08-01T19:55:14.278 INFO:teuthology.orchestra.run.smithi008.stdout: } 2023-08-01T19:55:14.278 INFO:teuthology.orchestra.run.smithi008.stdout: ] 2023-08-01T19:55:14.278 INFO:teuthology.orchestra.run.smithi008.stdout: } 2023-08-01T19:55:14.279 INFO:teuthology.orchestra.run.smithi008.stdout: }, 2023-08-01T19:55:14.279 INFO:teuthology.orchestra.run.smithi008.stdout: { 2023-08-01T19:55:14.279 INFO:teuthology.orchestra.run.smithi008.stdout: "description": "osd_op(client.4668.0:115156 5.3 5:c9a517df:::benchmark_data_smithi006_114134_object115155:head [set-alloc-hint object_size 65536 write_size 65536,write 0~65536 in=65536b] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e42)", 2023-08-01T19:55:14.279 INFO:teuthology.orchestra.run.smithi008.stdout: "initiated_at": "2023-08-01T19:55:14.234751+0000", 2023-08-01T19:55:14.279 INFO:teuthology.orchestra.run.smithi008.stdout: "age": 0.002564499, 2023-08-01T19:55:14.279 INFO:teuthology.orchestra.run.smithi008.stdout: "duration": 0.003007614, 2023-08-01T19:55:14.279 INFO:teuthology.orchestra.run.smithi008.stdout: "type_data": { 2023-08-01T19:55:14.279 INFO:teuthology.orchestra.run.smithi008.stdout: "flag_point": "waiting for sub ops", 2023-08-01T19:55:14.280 INFO:teuthology.orchestra.run.smithi008.stdout: "client_info": { 2023-08-01T19:55:14.280 INFO:teuthology.orchestra.run.smithi008.stdout: "client": "client.4668", 2023-08-01T19:55:14.280 INFO:teuthology.orchestra.run.smithi008.stdout: "client_addr": "172.21.15.6:0/1709472247", 2023-08-01T19:55:14.280 INFO:teuthology.orchestra.run.smithi008.stdout: "tid": 115156 2023-08-01T19:55:14.280 INFO:teuthology.orchestra.run.smithi008.stdout: }, 2023-08-01T19:55:14.280 INFO:teuthology.orchestra.run.smithi008.stdout: "events": [ 2023-08-01T19:55:14.280 INFO:teuthology.orchestra.run.smithi008.stdout: { 2023-08-01T19:55:14.280 INFO:teuthology.orchestra.run.smithi008.stdout: "event": "initiated", 2023-08-01T19:55:14.281 INFO:teuthology.orchestra.run.smithi008.stdout: "time": "2023-08-01T19:55:14.234751+0000", 2023-08-01T19:55:14.281 INFO:teuthology.orchestra.run.smithi008.stdout: "duration": 0 2023-08-01T19:55:14.281 INFO:teuthology.orchestra.run.smithi008.stdout: }, 2023-08-01T19:55:14.281 INFO:teuthology.orchestra.run.smithi008.stdout: { 2023-08-01T19:55:14.281 INFO:teuthology.orchestra.run.smithi008.stdout: "event": "throttled", 2023-08-01T19:55:14.281 INFO:teuthology.orchestra.run.smithi008.stdout: "time": "2023-08-01T19:55:14.234751+0000", 2023-08-01T19:55:14.281 INFO:teuthology.orchestra.run.smithi008.stdout: "duration": 0 2023-08-01T19:55:14.282 INFO:teuthology.orchestra.run.smithi008.stdout: }, 2023-08-01T19:55:14.282 INFO:teuthology.orchestra.run.smithi008.stdout: { 2023-08-01T19:55:14.282 INFO:teuthology.orchestra.run.smithi008.stdout: "event": "header_read", 2023-08-01T19:55:14.282 INFO:teuthology.orchestra.run.smithi008.stdout: "time": "2023-08-01T19:55:14.234750+0000", 2023-08-01T19:55:14.282 INFO:teuthology.orchestra.run.smithi008.stdout: "duration": 4294967295.999999 2023-08-01T19:55:14.282 INFO:teuthology.orchestra.run.smithi008.stdout: }, 2023-08-01T19:55:14.282 INFO:teuthology.orchestra.run.smithi008.stdout: { 2023-08-01T19:55:14.282 INFO:teuthology.orchestra.run.smithi008.stdout: "event": "all_read", 2023-08-01T19:55:14.283 INFO:teuthology.orchestra.run.smithi008.stdout: "time": "2023-08-01T19:55:14.234832+0000", 2023-08-01T19:55:14.283 INFO:teuthology.orchestra.run.smithi008.stdout: "duration": 8.2189999999999997e-05 2023-08-01T19:55:14.283 INFO:teuthology.orchestra.run.smithi008.stdout: }, 2023-08-01T19:55:14.283 INFO:teuthology.orchestra.run.smithi008.stdout: { 2023-08-01T19:55:14.283 INFO:teuthology.orchestra.run.smithi008.stdout: "event": "dispatched", 2023-08-01T19:55:14.283 INFO:teuthology.orchestra.run.smithi008.stdout: "time": "2023-08-01T19:55:14.234842+0000", 2023-08-01T19:55:14.283 INFO:teuthology.orchestra.run.smithi008.stdout: "duration": 9.7799999999999995e-06 2023-08-01T19:55:14.283 INFO:teuthology.orchestra.run.smithi008.stdout: }, 2023-08-01T19:55:14.284 INFO:teuthology.orchestra.run.smithi008.stdout: { 2023-08-01T19:55:14.284 INFO:teuthology.orchestra.run.smithi008.stdout: "event": "queued_for_pg", 2023-08-01T19:55:14.284 INFO:teuthology.orchestra.run.smithi008.stdout: "time": "2023-08-01T19:55:14.234846+0000", 2023-08-01T19:55:14.284 INFO:teuthology.orchestra.run.smithi008.stdout: "duration": 4.3000000000000003e-06 2023-08-01T19:55:14.284 INFO:teuthology.orchestra.run.smithi008.stdout: }, 2023-08-01T19:55:14.284 INFO:teuthology.orchestra.run.smithi008.stdout: { 2023-08-01T19:55:14.284 INFO:teuthology.orchestra.run.smithi008.stdout: "event": "reached_pg", 2023-08-01T19:55:14.284 INFO:teuthology.orchestra.run.smithi008.stdout: "time": "2023-08-01T19:55:14.234883+0000", 2023-08-01T19:55:14.285 INFO:teuthology.orchestra.run.smithi008.stdout: "duration": 3.6640999999999997e-05 2023-08-01T19:55:14.285 INFO:teuthology.orchestra.run.smithi008.stdout: }, 2023-08-01T19:55:14.285 INFO:teuthology.orchestra.run.smithi008.stdout: { 2023-08-01T19:55:14.285 INFO:teuthology.orchestra.run.smithi008.stdout: "event": "started", 2023-08-01T19:55:14.285 INFO:teuthology.orchestra.run.smithi008.stdout: "time": "2023-08-01T19:55:14.235007+0000", 2023-08-01T19:55:14.285 INFO:teuthology.orchestra.run.smithi008.stdout: "duration": 0.00012392800000000001 2023-08-01T19:55:14.285 INFO:teuthology.orchestra.run.smithi008.stdout: }, 2023-08-01T19:55:14.285 INFO:teuthology.orchestra.run.smithi008.stdout: { 2023-08-01T19:55:14.286 INFO:teuthology.orchestra.run.smithi008.stdout: "event": "waiting for subops from 1", 2023-08-01T19:55:14.286 INFO:teuthology.orchestra.run.smithi008.stdout: "time": "2023-08-01T19:55:14.235164+0000", 2023-08-01T19:55:14.286 INFO:teuthology.orchestra.run.smithi008.stdout: "duration": 0.000157174 2023-08-01T19:55:14.286 INFO:teuthology.orchestra.run.smithi008.stdout: } 2023-08-01T19:55:14.286 INFO:teuthology.orchestra.run.smithi008.stdout: ] 2023-08-01T19:55:14.286 INFO:teuthology.orchestra.run.smithi008.stdout: } 2023-08-01T19:55:14.286 INFO:teuthology.orchestra.run.smithi008.stdout: }, 2023-08-01T19:55:14.286 INFO:teuthology.orchestra.run.smithi008.stdout: { 2023-08-01T19:55:14.287 INFO:teuthology.orchestra.run.smithi008.stdout: "description": "osd_op(client.4668.0:115157 5.c 5:34e650f9:::benchmark_data_smithi006_114134_object115156:head [set-alloc-hint object_size 65536 write_size 65536,write 0~65536 in=65536b] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e42)", 2023-08-01T19:55:14.287 INFO:teuthology.orchestra.run.smithi008.stdout: "initiated_at": "2023-08-01T19:55:14.234853+0000", 2023-08-01T19:55:14.287 INFO:teuthology.orchestra.run.smithi008.stdout: "age": 0.0024625239999999998, 2023-08-01T19:55:14.287 INFO:teuthology.orchestra.run.smithi008.stdout: "duration": 0.0029876299999999998, 2023-08-01T19:55:14.287 INFO:teuthology.orchestra.run.smithi008.stdout: "type_data": { 2023-08-01T19:55:14.287 INFO:teuthology.orchestra.run.smithi008.stdout: "flag_point": "waiting for sub ops", 2023-08-01T19:55:14.287 INFO:teuthology.orchestra.run.smithi008.stdout: "client_info": { 2023-08-01T19:55:14.287 INFO:teuthology.orchestra.run.smithi008.stdout: "client": "client.4668", 2023-08-01T19:55:14.288 INFO:teuthology.orchestra.run.smithi008.stdout: "client_addr": "172.21.15.6:0/1709472247", 2023-08-01T19:55:14.288 INFO:teuthology.orchestra.run.smithi008.stdout: "tid": 115157 2023-08-01T19:55:14.288 INFO:teuthology.orchestra.run.smithi008.stdout: }, 2023-08-01T19:55:14.288 INFO:teuthology.orchestra.run.smithi008.stdout: "events": [ 2023-08-01T19:55:14.288 INFO:teuthology.orchestra.run.smithi008.stdout: { 2023-08-01T19:55:14.288 INFO:teuthology.orchestra.run.smithi008.stdout: "event": "initiated", 2023-08-01T19:55:14.288 INFO:teuthology.orchestra.run.smithi008.stdout: "time": "2023-08-01T19:55:14.234853+0000", 2023-08-01T19:55:14.288 INFO:teuthology.orchestra.run.smithi008.stdout: "duration": 0 2023-08-01T19:55:14.289 INFO:teuthology.orchestra.run.smithi008.stdout: }, 2023-08-01T19:55:14.289 INFO:teuthology.orchestra.run.smithi008.stdout: { 2023-08-01T19:55:14.289 INFO:teuthology.orchestra.run.smithi008.stdout: "event": "throttled", 2023-08-01T19:55:14.289 INFO:teuthology.orchestra.run.smithi008.stdout: "time": "2023-08-01T19:55:14.234853+0000", 2023-08-01T19:55:14.289 INFO:teuthology.orchestra.run.smithi008.stdout: "duration": 0 2023-08-01T19:55:14.289 INFO:teuthology.orchestra.run.smithi008.stdout: }, 2023-08-01T19:55:14.289 INFO:teuthology.orchestra.run.smithi008.stdout: { 2023-08-01T19:55:14.290 INFO:teuthology.orchestra.run.smithi008.stdout: "event": "header_read", 2023-08-01T19:55:14.290 INFO:teuthology.orchestra.run.smithi008.stdout: "time": "2023-08-01T19:55:14.234852+0000", 2023-08-01T19:55:14.290 INFO:teuthology.orchestra.run.smithi008.stdout: "duration": 4294967295.9999995 2023-08-01T19:55:14.290 INFO:teuthology.orchestra.run.smithi008.stdout: }, 2023-08-01T19:55:14.290 INFO:teuthology.orchestra.run.smithi008.stdout: { 2023-08-01T19:55:14.290 INFO:teuthology.orchestra.run.smithi008.stdout: "event": "all_read", 2023-08-01T19:55:14.290 INFO:teuthology.orchestra.run.smithi008.stdout: "time": "2023-08-01T19:55:14.234938+0000", 2023-08-01T19:55:14.290 INFO:teuthology.orchestra.run.smithi008.stdout: "duration": 8.5945000000000005e-05 2023-08-01T19:55:14.291 INFO:teuthology.orchestra.run.smithi008.stdout: }, 2023-08-01T19:55:14.291 INFO:teuthology.orchestra.run.smithi008.stdout: { 2023-08-01T19:55:14.291 INFO:teuthology.orchestra.run.smithi008.stdout: "event": "dispatched", 2023-08-01T19:55:14.291 INFO:teuthology.orchestra.run.smithi008.stdout: "time": "2023-08-01T19:55:14.234945+0000", 2023-08-01T19:55:14.291 INFO:teuthology.orchestra.run.smithi008.stdout: "duration": 6.5030000000000002e-06 2023-08-01T19:55:14.291 INFO:teuthology.orchestra.run.smithi008.stdout: }, 2023-08-01T19:55:14.291 INFO:teuthology.orchestra.run.smithi008.stdout: { 2023-08-01T19:55:14.291 INFO:teuthology.orchestra.run.smithi008.stdout: "event": "queued_for_pg", 2023-08-01T19:55:14.292 INFO:teuthology.orchestra.run.smithi008.stdout: "time": "2023-08-01T19:55:14.234948+0000", 2023-08-01T19:55:14.292 INFO:teuthology.orchestra.run.smithi008.stdout: "duration": 3.2229999999999999e-06 2023-08-01T19:55:14.292 INFO:teuthology.orchestra.run.smithi008.stdout: }, 2023-08-01T19:55:14.292 INFO:teuthology.orchestra.run.smithi008.stdout: { 2023-08-01T19:55:14.292 INFO:teuthology.orchestra.run.smithi008.stdout: "event": "reached_pg", 2023-08-01T19:55:14.292 INFO:teuthology.orchestra.run.smithi008.stdout: "time": "2023-08-01T19:55:14.234980+0000", 2023-08-01T19:55:14.292 INFO:teuthology.orchestra.run.smithi008.stdout: "duration": 3.2196000000000001e-05 2023-08-01T19:55:14.292 INFO:teuthology.orchestra.run.smithi008.stdout: }, 2023-08-01T19:55:14.293 INFO:teuthology.orchestra.run.smithi008.stdout: { 2023-08-01T19:55:14.293 INFO:teuthology.orchestra.run.smithi008.stdout: "event": "started", 2023-08-01T19:55:14.293 INFO:teuthology.orchestra.run.smithi008.stdout: "time": "2023-08-01T19:55:14.235086+0000", 2023-08-01T19:55:14.293 INFO:teuthology.orchestra.run.smithi008.stdout: "duration": 0.00010543300000000001 2023-08-01T19:55:14.293 INFO:teuthology.orchestra.run.smithi008.stdout: }, 2023-08-01T19:55:14.293 INFO:teuthology.orchestra.run.smithi008.stdout: { 2023-08-01T19:55:14.293 INFO:teuthology.orchestra.run.smithi008.stdout: "event": "waiting for subops from 1", 2023-08-01T19:55:14.293 INFO:teuthology.orchestra.run.smithi008.stdout: "time": "2023-08-01T19:55:14.235193+0000", 2023-08-01T19:55:14.294 INFO:teuthology.orchestra.run.smithi008.stdout: "duration": 0.00010755300000000001 2023-08-01T19:55:14.294 INFO:teuthology.orchestra.run.smithi008.stdout: } 2023-08-01T19:55:14.294 INFO:teuthology.orchestra.run.smithi008.stdout: ] 2023-08-01T19:55:14.294 INFO:teuthology.orchestra.run.smithi008.stdout: } 2023-08-01T19:55:14.294 INFO:teuthology.orchestra.run.smithi008.stdout: }, 2023-08-01T19:55:14.294 INFO:teuthology.orchestra.run.smithi008.stdout: { 2023-08-01T19:55:14.294 INFO:teuthology.orchestra.run.smithi008.stdout: "description": "osd_op(client.4668.0:115160 5.6 5:6c658087:::benchmark_data_smithi006_114134_object115159:head [set-alloc-hint object_size 65536 write_size 65536,write 0~65536 in=65536b] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e42)", 2023-08-01T19:55:14.295 INFO:teuthology.orchestra.run.smithi008.stdout: "initiated_at": "2023-08-01T19:55:14.234960+0000", 2023-08-01T19:55:14.295 INFO:teuthology.orchestra.run.smithi008.stdout: "age": 0.0023553770000000001, 2023-08-01T19:55:14.295 INFO:teuthology.orchestra.run.smithi008.stdout: "duration": 0.0029656249999999999, 2023-08-01T19:55:14.295 INFO:teuthology.orchestra.run.smithi008.stdout: "type_data": { 2023-08-01T19:55:14.295 INFO:teuthology.orchestra.run.smithi008.stdout: "flag_point": "waiting for sub ops", 2023-08-01T19:55:14.295 INFO:teuthology.orchestra.run.smithi008.stdout: "client_info": { 2023-08-01T19:55:14.295 INFO:teuthology.orchestra.run.smithi008.stdout: "client": "client.4668", 2023-08-01T19:55:14.295 INFO:teuthology.orchestra.run.smithi008.stdout: "client_addr": "172.21.15.6:0/1709472247", 2023-08-01T19:55:14.296 INFO:teuthology.orchestra.run.smithi008.stdout: "tid": 115160 2023-08-01T19:55:14.296 INFO:teuthology.orchestra.run.smithi008.stdout: }, 2023-08-01T19:55:14.296 INFO:teuthology.orchestra.run.smithi008.stdout: "events": [ 2023-08-01T19:55:14.296 INFO:teuthology.orchestra.run.smithi008.stdout: { 2023-08-01T19:55:14.296 INFO:teuthology.orchestra.run.smithi008.stdout: "event": "initiated", 2023-08-01T19:55:14.296 INFO:teuthology.orchestra.run.smithi008.stdout: "time": "2023-08-01T19:55:14.234960+0000", 2023-08-01T19:55:14.296 INFO:teuthology.orchestra.run.smithi008.stdout: "duration": 0 2023-08-01T19:55:14.296 INFO:teuthology.orchestra.run.smithi008.stdout: }, 2023-08-01T19:55:14.297 INFO:teuthology.orchestra.run.smithi008.stdout: { 2023-08-01T19:55:14.297 INFO:teuthology.orchestra.run.smithi008.stdout: "event": "throttled", 2023-08-01T19:55:14.297 INFO:teuthology.orchestra.run.smithi008.stdout: "time": "2023-08-01T19:55:14.234960+0000", 2023-08-01T19:55:14.297 INFO:teuthology.orchestra.run.smithi008.stdout: "duration": 0 2023-08-01T19:55:14.297 INFO:teuthology.orchestra.run.smithi008.stdout: }, 2023-08-01T19:55:14.297 INFO:teuthology.orchestra.run.smithi008.stdout: { 2023-08-01T19:55:14.297 INFO:teuthology.orchestra.run.smithi008.stdout: "event": "header_read", 2023-08-01T19:55:14.297 INFO:teuthology.orchestra.run.smithi008.stdout: "time": "2023-08-01T19:55:14.234959+0000", 2023-08-01T19:55:14.298 INFO:teuthology.orchestra.run.smithi008.stdout: "duration": 4294967295.9999995 2023-08-01T19:55:14.298 INFO:teuthology.orchestra.run.smithi008.stdout: }, 2023-08-01T19:55:14.298 INFO:teuthology.orchestra.run.smithi008.stdout: { 2023-08-01T19:55:14.298 INFO:teuthology.orchestra.run.smithi008.stdout: "event": "all_read", 2023-08-01T19:55:14.298 INFO:teuthology.orchestra.run.smithi008.stdout: "time": "2023-08-01T19:55:14.235082+0000", 2023-08-01T19:55:14.298 INFO:teuthology.orchestra.run.smithi008.stdout: "duration": 0.000123132 2023-08-01T19:55:14.298 INFO:teuthology.orchestra.run.smithi008.stdout: }, 2023-08-01T19:55:14.298 INFO:teuthology.orchestra.run.smithi008.stdout: { 2023-08-01T19:55:14.299 INFO:teuthology.orchestra.run.smithi008.stdout: "event": "dispatched", 2023-08-01T19:55:14.299 INFO:teuthology.orchestra.run.smithi008.stdout: "time": "2023-08-01T19:55:14.235092+0000", 2023-08-01T19:55:14.299 INFO:teuthology.orchestra.run.smithi008.stdout: "duration": 9.4020000000000008e-06 2023-08-01T19:55:14.299 INFO:teuthology.orchestra.run.smithi008.stdout: }, 2023-08-01T19:55:14.299 INFO:teuthology.orchestra.run.smithi008.stdout: { 2023-08-01T19:55:14.299 INFO:teuthology.orchestra.run.smithi008.stdout: "event": "queued_for_pg", 2023-08-01T19:55:14.299 INFO:teuthology.orchestra.run.smithi008.stdout: "time": "2023-08-01T19:55:14.235097+0000", 2023-08-01T19:55:14.300 INFO:teuthology.orchestra.run.smithi008.stdout: "duration": 5.5040000000000002e-06 2023-08-01T19:55:14.300 INFO:teuthology.orchestra.run.smithi008.stdout: }, 2023-08-01T19:55:14.300 INFO:teuthology.orchestra.run.smithi008.stdout: { 2023-08-01T19:55:14.300 INFO:teuthology.orchestra.run.smithi008.stdout: "event": "reached_pg", 2023-08-01T19:55:14.300 INFO:teuthology.orchestra.run.smithi008.stdout: "time": "2023-08-01T19:55:14.235136+0000", 2023-08-01T19:55:14.300 INFO:teuthology.orchestra.run.smithi008.stdout: "duration": 3.9183000000000001e-05 2023-08-01T19:55:14.300 INFO:teuthology.orchestra.run.smithi008.stdout: }, 2023-08-01T19:55:14.300 INFO:teuthology.orchestra.run.smithi008.stdout: { 2023-08-01T19:55:14.301 INFO:teuthology.orchestra.run.smithi008.stdout: "event": "started", 2023-08-01T19:55:14.301 INFO:teuthology.orchestra.run.smithi008.stdout: "time": "2023-08-01T19:55:14.235287+0000", 2023-08-01T19:55:14.301 INFO:teuthology.orchestra.run.smithi008.stdout: "duration": 0.00015038000000000001 2023-08-01T19:55:14.301 INFO:teuthology.orchestra.run.smithi008.stdout: }, 2023-08-01T19:55:14.301 INFO:teuthology.orchestra.run.smithi008.stdout: { 2023-08-01T19:55:14.301 INFO:teuthology.orchestra.run.smithi008.stdout: "event": "waiting for subops from 1", 2023-08-01T19:55:14.301 INFO:teuthology.orchestra.run.smithi008.stdout: "time": "2023-08-01T19:55:14.235498+0000", 2023-08-01T19:55:14.301 INFO:teuthology.orchestra.run.smithi008.stdout: "duration": 0.000210867 2023-08-01T19:55:14.302 INFO:teuthology.orchestra.run.smithi008.stdout: } 2023-08-01T19:55:14.302 INFO:teuthology.orchestra.run.smithi008.stdout: ] 2023-08-01T19:55:14.302 INFO:teuthology.orchestra.run.smithi008.stdout: } 2023-08-01T19:55:14.302 INFO:teuthology.orchestra.run.smithi008.stdout: }, 2023-08-01T19:55:14.302 INFO:teuthology.orchestra.run.smithi008.stdout: { 2023-08-01T19:55:14.302 INFO:teuthology.orchestra.run.smithi008.stdout: "description": "osd_repop(client.4668.0:115155 5.0 e42/19 5:02ddb2d3:::benchmark_data_smithi006_114134_object115154:head v 42'7288, mlcod=42'7285)", 2023-08-01T19:55:14.302 INFO:teuthology.orchestra.run.smithi008.stdout: "initiated_at": "2023-08-01T19:55:14.235328+0000", 2023-08-01T19:55:14.303 INFO:teuthology.orchestra.run.smithi008.stdout: "age": 0.001986818, 2023-08-01T19:55:14.303 INFO:teuthology.orchestra.run.smithi008.stdout: "duration": 0.002670132, 2023-08-01T19:55:14.303 INFO:teuthology.orchestra.run.smithi008.stdout: "type_data": { 2023-08-01T19:55:14.303 INFO:teuthology.orchestra.run.smithi008.stdout: "flag_point": "started", 2023-08-01T19:55:14.303 INFO:teuthology.orchestra.run.smithi008.stdout: "events": [ 2023-08-01T19:55:14.303 INFO:teuthology.orchestra.run.smithi008.stdout: { 2023-08-01T19:55:14.303 INFO:teuthology.orchestra.run.smithi008.stdout: "event": "initiated", 2023-08-01T19:55:14.304 INFO:teuthology.orchestra.run.smithi008.stdout: "time": "2023-08-01T19:55:14.235328+0000", 2023-08-01T19:55:14.304 INFO:teuthology.orchestra.run.smithi008.stdout: "duration": 0 2023-08-01T19:55:14.304 INFO:teuthology.orchestra.run.smithi008.stdout: }, 2023-08-01T19:55:14.304 INFO:teuthology.orchestra.run.smithi008.stdout: { 2023-08-01T19:55:14.304 INFO:teuthology.orchestra.run.smithi008.stdout: "event": "throttled", 2023-08-01T19:55:14.304 INFO:teuthology.orchestra.run.smithi008.stdout: "time": "2023-08-01T19:55:14.235328+0000", 2023-08-01T19:55:14.304 INFO:teuthology.orchestra.run.smithi008.stdout: "duration": 0 2023-08-01T19:55:14.305 INFO:teuthology.orchestra.run.smithi008.stdout: }, 2023-08-01T19:55:14.305 INFO:teuthology.orchestra.run.smithi008.stdout: { 2023-08-01T19:55:14.305 INFO:teuthology.orchestra.run.smithi008.stdout: "event": "header_read", 2023-08-01T19:55:14.305 INFO:teuthology.orchestra.run.smithi008.stdout: "time": "2023-08-01T19:55:14.235328+0000", 2023-08-01T19:55:14.305 INFO:teuthology.orchestra.run.smithi008.stdout: "duration": 4294967295.999999 2023-08-01T19:55:14.305 INFO:teuthology.orchestra.run.smithi008.stdout: }, 2023-08-01T19:55:14.305 INFO:teuthology.orchestra.run.smithi008.stdout: { 2023-08-01T19:55:14.305 INFO:teuthology.orchestra.run.smithi008.stdout: "event": "all_read", 2023-08-01T19:55:14.306 INFO:teuthology.orchestra.run.smithi008.stdout: "time": "2023-08-01T19:55:14.235379+0000", 2023-08-01T19:55:14.306 INFO:teuthology.orchestra.run.smithi008.stdout: "duration": 5.1513e-05 2023-08-01T19:55:14.306 INFO:teuthology.orchestra.run.smithi008.stdout: }, 2023-08-01T19:55:14.306 INFO:teuthology.orchestra.run.smithi008.stdout: { 2023-08-01T19:55:14.306 INFO:teuthology.orchestra.run.smithi008.stdout: "event": "dispatched", 2023-08-01T19:55:14.306 INFO:teuthology.orchestra.run.smithi008.stdout: "time": "2023-08-01T19:55:14.235392+0000", 2023-08-01T19:55:14.306 INFO:teuthology.orchestra.run.smithi008.stdout: "duration": 1.3084e-05 2023-08-01T19:55:14.306 INFO:teuthology.orchestra.run.smithi008.stdout: }, 2023-08-01T19:55:14.307 INFO:teuthology.orchestra.run.smithi008.stdout: { 2023-08-01T19:55:14.307 INFO:teuthology.orchestra.run.smithi008.stdout: "event": "queued_for_pg", 2023-08-01T19:55:14.307 INFO:teuthology.orchestra.run.smithi008.stdout: "time": "2023-08-01T19:55:14.235397+0000", 2023-08-01T19:55:14.307 INFO:teuthology.orchestra.run.smithi008.stdout: "duration": 5.2530000000000004e-06 2023-08-01T19:55:14.307 INFO:teuthology.orchestra.run.smithi008.stdout: }, 2023-08-01T19:55:14.307 INFO:teuthology.orchestra.run.smithi008.stdout: { 2023-08-01T19:55:14.307 INFO:teuthology.orchestra.run.smithi008.stdout: "event": "reached_pg", 2023-08-01T19:55:14.307 INFO:teuthology.orchestra.run.smithi008.stdout: "time": "2023-08-01T19:55:14.236900+0000", 2023-08-01T19:55:14.308 INFO:teuthology.orchestra.run.smithi008.stdout: "duration": 0.001502628 2023-08-01T19:55:14.308 INFO:teuthology.orchestra.run.smithi008.stdout: }, 2023-08-01T19:55:14.308 INFO:teuthology.orchestra.run.smithi008.stdout: { 2023-08-01T19:55:14.308 INFO:teuthology.orchestra.run.smithi008.stdout: "event": "started", 2023-08-01T19:55:14.308 INFO:teuthology.orchestra.run.smithi008.stdout: "time": "2023-08-01T19:55:14.236919+0000", 2023-08-01T19:55:14.308 INFO:teuthology.orchestra.run.smithi008.stdout: "duration": 1.8610999999999999e-05 2023-08-01T19:55:14.308 INFO:teuthology.orchestra.run.smithi008.stdout: } 2023-08-01T19:55:14.308 INFO:teuthology.orchestra.run.smithi008.stdout: ] 2023-08-01T19:55:14.309 INFO:teuthology.orchestra.run.smithi008.stdout: } 2023-08-01T19:55:14.309 INFO:teuthology.orchestra.run.smithi008.stdout: }, 2023-08-01T19:55:14.309 INFO:teuthology.orchestra.run.smithi008.stdout: { 2023-08-01T19:55:14.309 INFO:teuthology.orchestra.run.smithi008.stdout: "description": "osd_repop(client.4668.0:115158 5.e e42/19 5:79ee7ba1:::benchmark_data_smithi006_114134_object115157:head v 42'7223, mlcod=42'7220)", 2023-08-01T19:55:14.309 INFO:teuthology.orchestra.run.smithi008.stdout: "initiated_at": "2023-08-01T19:55:14.235408+0000", 2023-08-01T19:55:14.309 INFO:teuthology.orchestra.run.smithi008.stdout: "age": 0.001907522, 2023-08-01T19:55:14.309 INFO:teuthology.orchestra.run.smithi008.stdout: "duration": 0.0026525989999999998, 2023-08-01T19:55:14.310 INFO:teuthology.orchestra.run.smithi008.stdout: "type_data": { 2023-08-01T19:55:14.310 INFO:teuthology.orchestra.run.smithi008.stdout: "flag_point": "started", 2023-08-01T19:55:14.310 INFO:teuthology.orchestra.run.smithi008.stdout: "events": [ 2023-08-01T19:55:14.310 INFO:teuthology.orchestra.run.smithi008.stdout: { 2023-08-01T19:55:14.310 INFO:teuthology.orchestra.run.smithi008.stdout: "event": "initiated", 2023-08-01T19:55:14.310 INFO:teuthology.orchestra.run.smithi008.stdout: "time": "2023-08-01T19:55:14.235408+0000", 2023-08-01T19:55:14.310 INFO:teuthology.orchestra.run.smithi008.stdout: "duration": 0 2023-08-01T19:55:14.310 INFO:teuthology.orchestra.run.smithi008.stdout: }, 2023-08-01T19:55:14.311 INFO:teuthology.orchestra.run.smithi008.stdout: { 2023-08-01T19:55:14.311 INFO:teuthology.orchestra.run.smithi008.stdout: "event": "throttled", 2023-08-01T19:55:14.311 INFO:teuthology.orchestra.run.smithi008.stdout: "time": "2023-08-01T19:55:14.235408+0000", 2023-08-01T19:55:14.311 INFO:teuthology.orchestra.run.smithi008.stdout: "duration": 0 2023-08-01T19:55:14.311 INFO:teuthology.orchestra.run.smithi008.stdout: }, 2023-08-01T19:55:14.311 INFO:teuthology.orchestra.run.smithi008.stdout: { 2023-08-01T19:55:14.311 INFO:teuthology.orchestra.run.smithi008.stdout: "event": "header_read", 2023-08-01T19:55:14.311 INFO:teuthology.orchestra.run.smithi008.stdout: "time": "2023-08-01T19:55:14.235407+0000", 2023-08-01T19:55:14.312 INFO:teuthology.orchestra.run.smithi008.stdout: "duration": 4294967295.9999995 2023-08-01T19:55:14.312 INFO:teuthology.orchestra.run.smithi008.stdout: }, 2023-08-01T19:55:14.312 INFO:teuthology.orchestra.run.smithi008.stdout: { 2023-08-01T19:55:14.312 INFO:teuthology.orchestra.run.smithi008.stdout: "event": "all_read", 2023-08-01T19:55:14.312 INFO:teuthology.orchestra.run.smithi008.stdout: "time": "2023-08-01T19:55:14.235454+0000", 2023-08-01T19:55:14.312 INFO:teuthology.orchestra.run.smithi008.stdout: "duration": 4.6288999999999997e-05 2023-08-01T19:55:14.312 INFO:teuthology.orchestra.run.smithi008.stdout: }, 2023-08-01T19:55:14.312 INFO:teuthology.orchestra.run.smithi008.stdout: { 2023-08-01T19:55:14.313 INFO:teuthology.orchestra.run.smithi008.stdout: "event": "dispatched", 2023-08-01T19:55:14.313 INFO:teuthology.orchestra.run.smithi008.stdout: "time": "2023-08-01T19:55:14.235461+0000", 2023-08-01T19:55:14.313 INFO:teuthology.orchestra.run.smithi008.stdout: "duration": 7.6499999999999996e-06 2023-08-01T19:55:14.313 INFO:teuthology.orchestra.run.smithi008.stdout: }, 2023-08-01T19:55:14.313 INFO:teuthology.orchestra.run.smithi008.stdout: { 2023-08-01T19:55:14.313 INFO:teuthology.orchestra.run.smithi008.stdout: "event": "queued_for_pg", 2023-08-01T19:55:14.313 INFO:teuthology.orchestra.run.smithi008.stdout: "time": "2023-08-01T19:55:14.235465+0000", 2023-08-01T19:55:14.313 INFO:teuthology.orchestra.run.smithi008.stdout: "duration": 4.0339999999999998e-06 2023-08-01T19:55:14.314 INFO:teuthology.orchestra.run.smithi008.stdout: }, 2023-08-01T19:55:14.314 INFO:teuthology.orchestra.run.smithi008.stdout: { 2023-08-01T19:55:14.314 INFO:teuthology.orchestra.run.smithi008.stdout: "event": "reached_pg", 2023-08-01T19:55:14.314 INFO:teuthology.orchestra.run.smithi008.stdout: "time": "2023-08-01T19:55:14.235635+0000", 2023-08-01T19:55:14.314 INFO:teuthology.orchestra.run.smithi008.stdout: "duration": 0.000169572 2023-08-01T19:55:14.314 INFO:teuthology.orchestra.run.smithi008.stdout: }, 2023-08-01T19:55:14.314 INFO:teuthology.orchestra.run.smithi008.stdout: { 2023-08-01T19:55:14.314 INFO:teuthology.orchestra.run.smithi008.stdout: "event": "started", 2023-08-01T19:55:14.315 INFO:teuthology.orchestra.run.smithi008.stdout: "time": "2023-08-01T19:55:14.235653+0000", 2023-08-01T19:55:14.315 INFO:teuthology.orchestra.run.smithi008.stdout: "duration": 1.8025000000000001e-05 2023-08-01T19:55:14.315 INFO:teuthology.orchestra.run.smithi008.stdout: } 2023-08-01T19:55:14.315 INFO:teuthology.orchestra.run.smithi008.stdout: ] 2023-08-01T19:55:14.315 INFO:teuthology.orchestra.run.smithi008.stdout: } 2023-08-01T19:55:14.315 INFO:teuthology.orchestra.run.smithi008.stdout: }, 2023-08-01T19:55:14.315 INFO:teuthology.orchestra.run.smithi008.stdout: { 2023-08-01T19:55:14.315 INFO:teuthology.orchestra.run.smithi008.stdout: "description": "osd_repop(client.4668.0:115159 5.4 e42/19 5:2873b2df:::benchmark_data_smithi006_114134_object115158:head v 42'7085, mlcod=42'7083)", 2023-08-01T19:55:14.316 INFO:teuthology.orchestra.run.smithi008.stdout: "initiated_at": "2023-08-01T19:55:14.235473+0000", 2023-08-01T19:55:14.316 INFO:teuthology.orchestra.run.smithi008.stdout: "age": 0.001842593, 2023-08-01T19:55:14.316 INFO:teuthology.orchestra.run.smithi008.stdout: "duration": 0.0026507200000000001, 2023-08-01T19:55:14.316 INFO:teuthology.orchestra.run.smithi008.stdout: "type_data": { 2023-08-01T19:55:14.316 INFO:teuthology.orchestra.run.smithi008.stdout: "flag_point": "started", 2023-08-01T19:55:14.316 INFO:teuthology.orchestra.run.smithi008.stdout: "events": [ 2023-08-01T19:55:14.316 INFO:teuthology.orchestra.run.smithi008.stdout: { 2023-08-01T19:55:14.317 INFO:teuthology.orchestra.run.smithi008.stdout: "event": "initiated", 2023-08-01T19:55:14.317 INFO:teuthology.orchestra.run.smithi008.stdout: "time": "2023-08-01T19:55:14.235473+0000", 2023-08-01T19:55:14.317 INFO:teuthology.orchestra.run.smithi008.stdout: "duration": 0 2023-08-01T19:55:14.317 INFO:teuthology.orchestra.run.smithi008.stdout: }, 2023-08-01T19:55:14.317 INFO:teuthology.orchestra.run.smithi008.stdout: { 2023-08-01T19:55:14.317 INFO:teuthology.orchestra.run.smithi008.stdout: "event": "throttled", 2023-08-01T19:55:14.317 INFO:teuthology.orchestra.run.smithi008.stdout: "time": "2023-08-01T19:55:14.235473+0000", 2023-08-01T19:55:14.317 INFO:teuthology.orchestra.run.smithi008.stdout: "duration": 0 2023-08-01T19:55:14.318 INFO:teuthology.orchestra.run.smithi008.stdout: }, 2023-08-01T19:55:14.318 INFO:teuthology.orchestra.run.smithi008.stdout: { 2023-08-01T19:55:14.318 INFO:teuthology.orchestra.run.smithi008.stdout: "event": "header_read", 2023-08-01T19:55:14.318 INFO:teuthology.orchestra.run.smithi008.stdout: "time": "2023-08-01T19:55:14.235472+0000", 2023-08-01T19:55:14.318 INFO:teuthology.orchestra.run.smithi008.stdout: "duration": 4294967295.9999995 2023-08-01T19:55:14.318 INFO:teuthology.orchestra.run.smithi008.stdout: }, 2023-08-01T19:55:14.318 INFO:teuthology.orchestra.run.smithi008.stdout: { 2023-08-01T19:55:14.319 INFO:teuthology.orchestra.run.smithi008.stdout: "event": "all_read", 2023-08-01T19:55:14.319 INFO:teuthology.orchestra.run.smithi008.stdout: "time": "2023-08-01T19:55:14.235536+0000", 2023-08-01T19:55:14.319 INFO:teuthology.orchestra.run.smithi008.stdout: "duration": 6.4141999999999997e-05 2023-08-01T19:55:14.319 INFO:teuthology.orchestra.run.smithi008.stdout: }, 2023-08-01T19:55:14.319 INFO:teuthology.orchestra.run.smithi008.stdout: { 2023-08-01T19:55:14.319 INFO:teuthology.orchestra.run.smithi008.stdout: "event": "dispatched", 2023-08-01T19:55:14.319 INFO:teuthology.orchestra.run.smithi008.stdout: "time": "2023-08-01T19:55:14.235546+0000", 2023-08-01T19:55:14.319 INFO:teuthology.orchestra.run.smithi008.stdout: "duration": 9.1849999999999993e-06 2023-08-01T19:55:14.320 INFO:teuthology.orchestra.run.smithi008.stdout: }, 2023-08-01T19:55:14.320 INFO:teuthology.orchestra.run.smithi008.stdout: { 2023-08-01T19:55:14.320 INFO:teuthology.orchestra.run.smithi008.stdout: "event": "queued_for_pg", 2023-08-01T19:55:14.320 INFO:teuthology.orchestra.run.smithi008.stdout: "time": "2023-08-01T19:55:14.235550+0000", 2023-08-01T19:55:14.320 INFO:teuthology.orchestra.run.smithi008.stdout: "duration": 4.0929999999999996e-06 2023-08-01T19:55:14.320 INFO:teuthology.orchestra.run.smithi008.stdout: }, 2023-08-01T19:55:14.320 INFO:teuthology.orchestra.run.smithi008.stdout: { 2023-08-01T19:55:14.320 INFO:teuthology.orchestra.run.smithi008.stdout: "event": "reached_pg", 2023-08-01T19:55:14.321 INFO:teuthology.orchestra.run.smithi008.stdout: "time": "2023-08-01T19:55:14.235638+0000", 2023-08-01T19:55:14.321 INFO:teuthology.orchestra.run.smithi008.stdout: "duration": 8.8319999999999995e-05 2023-08-01T19:55:14.321 INFO:teuthology.orchestra.run.smithi008.stdout: }, 2023-08-01T19:55:14.321 INFO:teuthology.orchestra.run.smithi008.stdout: { 2023-08-01T19:55:14.321 INFO:teuthology.orchestra.run.smithi008.stdout: "event": "started", 2023-08-01T19:55:14.321 INFO:teuthology.orchestra.run.smithi008.stdout: "time": "2023-08-01T19:55:14.235654+0000", 2023-08-01T19:55:14.321 INFO:teuthology.orchestra.run.smithi008.stdout: "duration": 1.6398000000000001e-05 2023-08-01T19:55:14.321 INFO:teuthology.orchestra.run.smithi008.stdout: } 2023-08-01T19:55:14.322 INFO:teuthology.orchestra.run.smithi008.stdout: ] 2023-08-01T19:55:14.322 INFO:teuthology.orchestra.run.smithi008.stdout: } 2023-08-01T19:55:14.322 INFO:teuthology.orchestra.run.smithi008.stdout: }, 2023-08-01T19:55:14.322 INFO:teuthology.orchestra.run.smithi008.stdout: { 2023-08-01T19:55:14.322 INFO:teuthology.orchestra.run.smithi008.stdout: "description": "osd_repop(client.4668.0:115161 5.7 e42/19 5:e8624f59:::benchmark_data_smithi006_114134_object115160:head v 42'7143, mlcod=42'7141)", 2023-08-01T19:55:14.322 INFO:teuthology.orchestra.run.smithi008.stdout: "initiated_at": "2023-08-01T19:55:14.235593+0000", 2023-08-01T19:55:14.322 INFO:teuthology.orchestra.run.smithi008.stdout: "age": 0.001722672, 2023-08-01T19:55:14.322 INFO:teuthology.orchestra.run.smithi008.stdout: "duration": 0.0025923109999999999, 2023-08-01T19:55:14.323 INFO:teuthology.orchestra.run.smithi008.stdout: "type_data": { 2023-08-01T19:55:14.323 INFO:teuthology.orchestra.run.smithi008.stdout: "flag_point": "started", 2023-08-01T19:55:14.323 INFO:teuthology.orchestra.run.smithi008.stdout: "events": [ 2023-08-01T19:55:14.323 INFO:teuthology.orchestra.run.smithi008.stdout: { 2023-08-01T19:55:14.323 INFO:teuthology.orchestra.run.smithi008.stdout: "event": "initiated", 2023-08-01T19:55:14.323 INFO:teuthology.orchestra.run.smithi008.stdout: "time": "2023-08-01T19:55:14.235593+0000", 2023-08-01T19:55:14.323 INFO:teuthology.orchestra.run.smithi008.stdout: "duration": 0 2023-08-01T19:55:14.323 INFO:teuthology.orchestra.run.smithi008.stdout: }, 2023-08-01T19:55:14.324 INFO:teuthology.orchestra.run.smithi008.stdout: { 2023-08-01T19:55:14.324 INFO:teuthology.orchestra.run.smithi008.stdout: "event": "throttled", 2023-08-01T19:55:14.324 INFO:teuthology.orchestra.run.smithi008.stdout: "time": "2023-08-01T19:55:14.235593+0000", 2023-08-01T19:55:14.324 INFO:teuthology.orchestra.run.smithi008.stdout: "duration": 0 2023-08-01T19:55:14.324 INFO:teuthology.orchestra.run.smithi008.stdout: }, 2023-08-01T19:55:14.324 INFO:teuthology.orchestra.run.smithi008.stdout: { 2023-08-01T19:55:14.324 INFO:teuthology.orchestra.run.smithi008.stdout: "event": "header_read", 2023-08-01T19:55:14.325 INFO:teuthology.orchestra.run.smithi008.stdout: "time": "2023-08-01T19:55:14.235592+0000", 2023-08-01T19:55:14.325 INFO:teuthology.orchestra.run.smithi008.stdout: "duration": 4294967295.9999995 2023-08-01T19:55:14.325 INFO:teuthology.orchestra.run.smithi008.stdout: }, 2023-08-01T19:55:14.325 INFO:teuthology.orchestra.run.smithi008.stdout: { 2023-08-01T19:55:14.325 INFO:teuthology.orchestra.run.smithi008.stdout: "event": "all_read", 2023-08-01T19:55:14.325 INFO:teuthology.orchestra.run.smithi008.stdout: "time": "2023-08-01T19:55:14.235687+0000", 2023-08-01T19:55:14.325 INFO:teuthology.orchestra.run.smithi008.stdout: "duration": 9.4401000000000006e-05 2023-08-01T19:55:14.325 INFO:teuthology.orchestra.run.smithi008.stdout: }, 2023-08-01T19:55:14.326 INFO:teuthology.orchestra.run.smithi008.stdout: { 2023-08-01T19:55:14.326 INFO:teuthology.orchestra.run.smithi008.stdout: "event": "dispatched", 2023-08-01T19:55:14.326 INFO:teuthology.orchestra.run.smithi008.stdout: "time": "2023-08-01T19:55:14.235693+0000", 2023-08-01T19:55:14.326 INFO:teuthology.orchestra.run.smithi008.stdout: "duration": 6.8569999999999997e-06 2023-08-01T19:55:14.326 INFO:teuthology.orchestra.run.smithi008.stdout: }, 2023-08-01T19:55:14.326 INFO:teuthology.orchestra.run.smithi008.stdout: { 2023-08-01T19:55:14.326 INFO:teuthology.orchestra.run.smithi008.stdout: "event": "queued_for_pg", 2023-08-01T19:55:14.326 INFO:teuthology.orchestra.run.smithi008.stdout: "time": "2023-08-01T19:55:14.235698+0000", 2023-08-01T19:55:14.327 INFO:teuthology.orchestra.run.smithi008.stdout: "duration": 4.2420000000000002e-06 2023-08-01T19:55:14.327 INFO:teuthology.orchestra.run.smithi008.stdout: }, 2023-08-01T19:55:14.327 INFO:teuthology.orchestra.run.smithi008.stdout: { 2023-08-01T19:55:14.327 INFO:teuthology.orchestra.run.smithi008.stdout: "event": "reached_pg", 2023-08-01T19:55:14.327 INFO:teuthology.orchestra.run.smithi008.stdout: "time": "2023-08-01T19:55:14.237178+0000", 2023-08-01T19:55:14.327 INFO:teuthology.orchestra.run.smithi008.stdout: "duration": 0.0014801930000000001 2023-08-01T19:55:14.327 INFO:teuthology.orchestra.run.smithi008.stdout: }, 2023-08-01T19:55:14.327 INFO:teuthology.orchestra.run.smithi008.stdout: { 2023-08-01T19:55:14.328 INFO:teuthology.orchestra.run.smithi008.stdout: "event": "started", 2023-08-01T19:55:14.328 INFO:teuthology.orchestra.run.smithi008.stdout: "time": "2023-08-01T19:55:14.237189+0000", 2023-08-01T19:55:14.328 INFO:teuthology.orchestra.run.smithi008.stdout: "duration": 1.1588e-05 2023-08-01T19:55:14.328 INFO:teuthology.orchestra.run.smithi008.stdout: } 2023-08-01T19:55:14.328 INFO:teuthology.orchestra.run.smithi008.stdout: ] 2023-08-01T19:55:14.328 INFO:teuthology.orchestra.run.smithi008.stdout: } 2023-08-01T19:55:14.328 INFO:teuthology.orchestra.run.smithi008.stdout: }, 2023-08-01T19:55:14.329 INFO:teuthology.orchestra.run.smithi008.stdout: { 2023-08-01T19:55:14.329 INFO:teuthology.orchestra.run.smithi008.stdout: "description": "osd_repop(client.4668.0:115162 5.8 e42/19 5:14bf8a54:::benchmark_data_smithi006_114134_object115161:head v 42'7235, mlcod=42'7233)", 2023-08-01T19:55:14.329 INFO:teuthology.orchestra.run.smithi008.stdout: "initiated_at": "2023-08-01T19:55:14.237749+0000", 2023-08-01T19:55:14.329 INFO:teuthology.orchestra.run.smithi008.stdout: "age": 4294967295.9995656, 2023-08-01T19:55:14.329 INFO:teuthology.orchestra.run.smithi008.stdout: "duration": 0.00050161300000000004, 2023-08-01T19:55:14.329 INFO:teuthology.orchestra.run.smithi008.stdout: "type_data": { 2023-08-01T19:55:14.329 INFO:teuthology.orchestra.run.smithi008.stdout: "flag_point": "started", 2023-08-01T19:55:14.329 INFO:teuthology.orchestra.run.smithi008.stdout: "events": [ 2023-08-01T19:55:14.330 INFO:teuthology.orchestra.run.smithi008.stdout: { 2023-08-01T19:55:14.330 INFO:teuthology.orchestra.run.smithi008.stdout: "event": "initiated", 2023-08-01T19:55:14.330 INFO:teuthology.orchestra.run.smithi008.stdout: "time": "2023-08-01T19:55:14.237749+0000", 2023-08-01T19:55:14.330 INFO:teuthology.orchestra.run.smithi008.stdout: "duration": 0 2023-08-01T19:55:14.330 INFO:teuthology.orchestra.run.smithi008.stdout: }, 2023-08-01T19:55:14.330 INFO:teuthology.orchestra.run.smithi008.stdout: { 2023-08-01T19:55:14.330 INFO:teuthology.orchestra.run.smithi008.stdout: "event": "throttled", 2023-08-01T19:55:14.330 INFO:teuthology.orchestra.run.smithi008.stdout: "time": "2023-08-01T19:55:14.237749+0000", 2023-08-01T19:55:14.331 INFO:teuthology.orchestra.run.smithi008.stdout: "duration": 0 2023-08-01T19:55:14.331 INFO:teuthology.orchestra.run.smithi008.stdout: }, 2023-08-01T19:55:14.331 INFO:teuthology.orchestra.run.smithi008.stdout: { 2023-08-01T19:55:14.331 INFO:teuthology.orchestra.run.smithi008.stdout: "event": "header_read", 2023-08-01T19:55:14.331 INFO:teuthology.orchestra.run.smithi008.stdout: "time": "2023-08-01T19:55:14.237749+0000", 2023-08-01T19:55:14.331 INFO:teuthology.orchestra.run.smithi008.stdout: "duration": 4294967295.9999995 2023-08-01T19:55:14.331 INFO:teuthology.orchestra.run.smithi008.stdout: }, 2023-08-01T19:55:14.331 INFO:teuthology.orchestra.run.smithi008.stdout: { 2023-08-01T19:55:14.332 INFO:teuthology.orchestra.run.smithi008.stdout: "event": "all_read", 2023-08-01T19:55:14.332 INFO:teuthology.orchestra.run.smithi008.stdout: "time": "2023-08-01T19:55:14.237771+0000", 2023-08-01T19:55:14.332 INFO:teuthology.orchestra.run.smithi008.stdout: "duration": 2.2048999999999998e-05 2023-08-01T19:55:14.332 INFO:teuthology.orchestra.run.smithi008.stdout: }, 2023-08-01T19:55:14.332 INFO:teuthology.orchestra.run.smithi008.stdout: { 2023-08-01T19:55:14.332 INFO:teuthology.orchestra.run.smithi008.stdout: "event": "dispatched", 2023-08-01T19:55:14.332 INFO:teuthology.orchestra.run.smithi008.stdout: "time": "2023-08-01T19:55:14.237777+0000", 2023-08-01T19:55:14.333 INFO:teuthology.orchestra.run.smithi008.stdout: "duration": 5.4219999999999999e-06 2023-08-01T19:55:14.333 INFO:teuthology.orchestra.run.smithi008.stdout: }, 2023-08-01T19:55:14.333 INFO:teuthology.orchestra.run.smithi008.stdout: { 2023-08-01T19:55:14.333 INFO:teuthology.orchestra.run.smithi008.stdout: "event": "queued_for_pg", 2023-08-01T19:55:14.333 INFO:teuthology.orchestra.run.smithi008.stdout: "time": "2023-08-01T19:55:14.237780+0000", 2023-08-01T19:55:14.333 INFO:teuthology.orchestra.run.smithi008.stdout: "duration": 3.0539999999999999e-06 2023-08-01T19:55:14.333 INFO:teuthology.orchestra.run.smithi008.stdout: }, 2023-08-01T19:55:14.333 INFO:teuthology.orchestra.run.smithi008.stdout: { 2023-08-01T19:55:14.334 INFO:teuthology.orchestra.run.smithi008.stdout: "event": "reached_pg", 2023-08-01T19:55:14.334 INFO:teuthology.orchestra.run.smithi008.stdout: "time": "2023-08-01T19:55:14.237810+0000", 2023-08-01T19:55:14.334 INFO:teuthology.orchestra.run.smithi008.stdout: "duration": 3.0405000000000001e-05 2023-08-01T19:55:14.334 INFO:teuthology.orchestra.run.smithi008.stdout: }, 2023-08-01T19:55:14.334 INFO:teuthology.orchestra.run.smithi008.stdout: { 2023-08-01T19:55:14.334 INFO:teuthology.orchestra.run.smithi008.stdout: "event": "started", 2023-08-01T19:55:14.334 INFO:teuthology.orchestra.run.smithi008.stdout: "time": "2023-08-01T19:55:14.237822+0000", 2023-08-01T19:55:14.334 INFO:teuthology.orchestra.run.smithi008.stdout: "duration": 1.1855000000000001e-05 2023-08-01T19:55:14.335 INFO:teuthology.orchestra.run.smithi008.stdout: } 2023-08-01T19:55:14.335 INFO:teuthology.orchestra.run.smithi008.stdout: ] 2023-08-01T19:55:14.335 INFO:teuthology.orchestra.run.smithi008.stdout: } 2023-08-01T19:55:14.335 INFO:teuthology.orchestra.run.smithi008.stdout: }, 2023-08-01T19:55:14.335 INFO:teuthology.orchestra.run.smithi008.stdout: { 2023-08-01T19:55:14.335 INFO:teuthology.orchestra.run.smithi008.stdout: "description": "osd_op(client.4668.0:115164 5.5 5:a00b9001:::benchmark_data_smithi006_114134_object115163:head [set-alloc-hint object_size 65536 write_size 65536,write 0~65536 in=65536b] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e42)", 2023-08-01T19:55:14.335 INFO:teuthology.orchestra.run.smithi008.stdout: "initiated_at": "2023-08-01T19:55:14.237959+0000", 2023-08-01T19:55:14.335 INFO:teuthology.orchestra.run.smithi008.stdout: "age": 4294967295.9993558, 2023-08-01T19:55:14.336 INFO:teuthology.orchestra.run.smithi008.stdout: "duration": 0.00035990399999999997, 2023-08-01T19:55:14.336 INFO:teuthology.orchestra.run.smithi008.stdout: "type_data": { 2023-08-01T19:55:14.336 INFO:teuthology.orchestra.run.smithi008.stdout: "flag_point": "waiting for sub ops", 2023-08-01T19:55:14.336 INFO:teuthology.orchestra.run.smithi008.stdout: "client_info": { 2023-08-01T19:55:14.336 INFO:teuthology.orchestra.run.smithi008.stdout: "client": "client.4668", 2023-08-01T19:55:14.336 INFO:teuthology.orchestra.run.smithi008.stdout: "client_addr": "172.21.15.6:0/1709472247", 2023-08-01T19:55:14.336 INFO:teuthology.orchestra.run.smithi008.stdout: "tid": 115164 2023-08-01T19:55:14.337 INFO:teuthology.orchestra.run.smithi008.stdout: }, 2023-08-01T19:55:14.337 INFO:teuthology.orchestra.run.smithi008.stdout: "events": [ 2023-08-01T19:55:14.337 INFO:teuthology.orchestra.run.smithi008.stdout: { 2023-08-01T19:55:14.337 INFO:teuthology.orchestra.run.smithi008.stdout: "event": "initiated", 2023-08-01T19:55:14.337 INFO:teuthology.orchestra.run.smithi008.stdout: "time": "2023-08-01T19:55:14.237959+0000", 2023-08-01T19:55:14.337 INFO:teuthology.orchestra.run.smithi008.stdout: "duration": 0 2023-08-01T19:55:14.337 INFO:teuthology.orchestra.run.smithi008.stdout: }, 2023-08-01T19:55:14.337 INFO:teuthology.orchestra.run.smithi008.stdout: { 2023-08-01T19:55:14.338 INFO:teuthology.orchestra.run.smithi008.stdout: "event": "throttled", 2023-08-01T19:55:14.338 INFO:teuthology.orchestra.run.smithi008.stdout: "time": "2023-08-01T19:55:14.237959+0000", 2023-08-01T19:55:14.338 INFO:teuthology.orchestra.run.smithi008.stdout: "duration": 0 2023-08-01T19:55:14.338 INFO:teuthology.orchestra.run.smithi008.stdout: }, 2023-08-01T19:55:14.338 INFO:teuthology.orchestra.run.smithi008.stdout: { 2023-08-01T19:55:14.338 INFO:teuthology.orchestra.run.smithi008.stdout: "event": "header_read", 2023-08-01T19:55:14.338 INFO:teuthology.orchestra.run.smithi008.stdout: "time": "2023-08-01T19:55:14.237958+0000", 2023-08-01T19:55:14.338 INFO:teuthology.orchestra.run.smithi008.stdout: "duration": 4294967295.9999986 2023-08-01T19:55:14.339 INFO:teuthology.orchestra.run.smithi008.stdout: }, 2023-08-01T19:55:14.339 INFO:teuthology.orchestra.run.smithi008.stdout: { 2023-08-01T19:55:14.339 INFO:teuthology.orchestra.run.smithi008.stdout: "event": "all_read", 2023-08-01T19:55:14.339 INFO:teuthology.orchestra.run.smithi008.stdout: "time": "2023-08-01T19:55:14.238020+0000", 2023-08-01T19:55:14.339 INFO:teuthology.orchestra.run.smithi008.stdout: "duration": 6.2169999999999996e-05 2023-08-01T19:55:14.339 INFO:teuthology.orchestra.run.smithi008.stdout: }, 2023-08-01T19:55:14.339 INFO:teuthology.orchestra.run.smithi008.stdout: { 2023-08-01T19:55:14.339 INFO:teuthology.orchestra.run.smithi008.stdout: "event": "dispatched", 2023-08-01T19:55:14.340 INFO:teuthology.orchestra.run.smithi008.stdout: "time": "2023-08-01T19:55:14.238030+0000", 2023-08-01T19:55:14.340 INFO:teuthology.orchestra.run.smithi008.stdout: "duration": 1.0125999999999999e-05 2023-08-01T19:55:14.340 INFO:teuthology.orchestra.run.smithi008.stdout: }, 2023-08-01T19:55:14.340 INFO:teuthology.orchestra.run.smithi008.stdout: { 2023-08-01T19:55:14.340 INFO:teuthology.orchestra.run.smithi008.stdout: "event": "queued_for_pg", 2023-08-01T19:55:14.340 INFO:teuthology.orchestra.run.smithi008.stdout: "time": "2023-08-01T19:55:14.238035+0000", 2023-08-01T19:55:14.340 INFO:teuthology.orchestra.run.smithi008.stdout: "duration": 4.7450000000000003e-06 2023-08-01T19:55:14.340 INFO:teuthology.orchestra.run.smithi008.stdout: }, 2023-08-01T19:55:14.341 INFO:teuthology.orchestra.run.smithi008.stdout: { 2023-08-01T19:55:14.341 INFO:teuthology.orchestra.run.smithi008.stdout: "event": "reached_pg", 2023-08-01T19:55:14.341 INFO:teuthology.orchestra.run.smithi008.stdout: "time": "2023-08-01T19:55:14.238069+0000", 2023-08-01T19:55:14.341 INFO:teuthology.orchestra.run.smithi008.stdout: "duration": 3.4217999999999997e-05 2023-08-01T19:55:14.341 INFO:teuthology.orchestra.run.smithi008.stdout: }, 2023-08-01T19:55:14.341 INFO:teuthology.orchestra.run.smithi008.stdout: { 2023-08-01T19:55:14.341 INFO:teuthology.orchestra.run.smithi008.stdout: "event": "started", 2023-08-01T19:55:14.341 INFO:teuthology.orchestra.run.smithi008.stdout: "time": "2023-08-01T19:55:14.238163+0000", 2023-08-01T19:55:14.342 INFO:teuthology.orchestra.run.smithi008.stdout: "duration": 9.3640999999999993e-05 2023-08-01T19:55:14.342 INFO:teuthology.orchestra.run.smithi008.stdout: }, 2023-08-01T19:55:14.342 INFO:teuthology.orchestra.run.smithi008.stdout: { 2023-08-01T19:55:14.342 INFO:teuthology.orchestra.run.smithi008.stdout: "event": "waiting for subops from 1", 2023-08-01T19:55:14.342 INFO:teuthology.orchestra.run.smithi008.stdout: "time": "2023-08-01T19:55:14.238252+0000", 2023-08-01T19:55:14.342 INFO:teuthology.orchestra.run.smithi008.stdout: "duration": 8.9481000000000006e-05 2023-08-01T19:55:14.342 INFO:teuthology.orchestra.run.smithi008.stdout: } 2023-08-01T19:55:14.342 INFO:teuthology.orchestra.run.smithi008.stdout: ] 2023-08-01T19:55:14.343 INFO:teuthology.orchestra.run.smithi008.stdout: } 2023-08-01T19:55:14.343 INFO:teuthology.orchestra.run.smithi008.stdout: } 2023-08-01T19:55:14.343 INFO:teuthology.orchestra.run.smithi008.stdout: ], 2023-08-01T19:55:14.343 INFO:teuthology.orchestra.run.smithi008.stdout: "num_ops": 14 2023-08-01T19:55:14.343 INFO:teuthology.orchestra.run.smithi008.stdout:} 2023-08-01T19:55:14.344 INFO:tasks.radosbench.radosbench.0.smithi006.stdout: 50 16 115307 115291 144.102 117.875 0.0104954 0.00693643 2023-08-01T19:55:14.345 DEBUG:teuthology.orchestra.run.smithi008:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 30 ceph --cluster ceph --admin-daemon /var/run/ceph/ceph-osd.0.asok dump_blocked_ops 2023-08-01T19:55:14.345 INFO:tasks.ceph.osd.0.smithi008.stderr:2023-08-01T19:55:14.342+0000 7f16a58f4700 -1 received signal: Hangup from /usr/bin/python3 /bin/daemon-helper kill ceph-osd -f --cluster ceph -i 0 (PID: 111179) UID: 0 2023-08-01T19:55:14.445 INFO:tasks.ceph.osd.1.smithi101.stderr:2023-08-01T19:55:14.443+0000 7fb0cb7f6700 -1 received signal: Hangup from /usr/bin/python3 /bin/daemon-helper kill ceph-osd -f --cluster ceph -i 1 (PID: 111141) UID: 0 2023-08-01T19:55:14.488 DEBUG:teuthology.orchestra.run.smithi006:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 120 ceph --cluster ceph -- tell 'osd.*' injectargs --osd_enable_op_tracker=false 2023-08-01T19:55:14.545 INFO:tasks.ceph.osd.1.smithi101.stderr:2023-08-01T19:55:14.544+0000 7fb0cb7f6700 -1 received signal: Hangup from /usr/bin/python3 /bin/daemon-helper kill ceph-osd -f --cluster ceph -i 1 (PID: 111141) UID: 0 2023-08-01T19:55:14.578 INFO:teuthology.orchestra.run.smithi008.stdout:{ 2023-08-01T19:55:14.578 INFO:teuthology.orchestra.run.smithi008.stdout: "ops": [], 2023-08-01T19:55:14.578 INFO:teuthology.orchestra.run.smithi008.stdout: "complaint_time": 30, 2023-08-01T19:55:14.579 INFO:teuthology.orchestra.run.smithi008.stdout: "num_blocked_ops": 0 2023-08-01T19:55:14.579 INFO:teuthology.orchestra.run.smithi008.stdout:} 2023-08-01T19:55:14.594 DEBUG:teuthology.orchestra.run.smithi008:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 30 ceph --cluster ceph --admin-daemon /var/run/ceph/ceph-osd.0.asok dump_historic_ops 2023-08-01T19:55:14.606 DEBUG:teuthology.orchestra.run.smithi006:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 120 ceph --cluster ceph osd unset noscrub 2023-08-01T19:55:14.643 INFO:teuthology.orchestra.run.smithi006.stdout:osd.0: {} 2023-08-01T19:55:14.646 INFO:tasks.ceph.osd.2.smithi155.stderr:2023-08-01T19:55:14.645+0000 7faa5c6ac700 -1 received signal: Hangup from /usr/bin/python3 /bin/daemon-helper kill ceph-osd -f --cluster ceph -i 2 (PID: 111337) UID: 0 2023-08-01T19:55:14.663 INFO:teuthology.orchestra.run.smithi006.stdout:osd.1: {} 2023-08-01T19:55:14.683 INFO:teuthology.orchestra.run.smithi006.stdout:osd.2: {} 2023-08-01T19:55:14.684 INFO:teuthology.orchestra.run.smithi006.stderr:osd.0: osd_enable_op_tracker = 'false' 2023-08-01T19:55:14.685 INFO:teuthology.orchestra.run.smithi006.stderr:osd.1: osd_enable_op_tracker = 'false' 2023-08-01T19:55:14.685 INFO:teuthology.orchestra.run.smithi006.stderr:osd.2: osd_enable_op_tracker = 'false' 2023-08-01T19:55:14.747 INFO:tasks.ceph.osd.1.smithi101.stderr:2023-08-01T19:55:14.746+0000 7fb0cb7f6700 -1 received signal: Hangup from /usr/bin/python3 /bin/daemon-helper kill ceph-osd -f --cluster ceph -i 1 (PID: 111141) UID: 0 2023-08-01T19:55:14.785 INFO:teuthology.orchestra.run.smithi008.stdout:ERROR: (22) Invalid argument 2023-08-01T19:55:14.786 INFO:teuthology.orchestra.run.smithi008.stdout:op_tracker tracking is not enabled now, so no ops are tracked currently, even those get stuck. Please enable "osd_enable_op_tracker", and the tracker will start to track new ops received afterwards. 2023-08-01T19:55:14.797 DEBUG:teuthology.orchestra.run.smithi101:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 30 ceph --cluster ceph --admin-daemon /var/run/ceph/ceph-osd.1.asok dump_ops_in_flight 2023-08-01T19:55:14.847 INFO:tasks.ceph.osd.2.smithi155.stderr:2023-08-01T19:55:14.846+0000 7faa5c6ac700 -1 received signal: Hangup from /usr/bin/python3 /bin/daemon-helper kill ceph-osd -f --cluster ceph -i 2 (PID: 111337) UID: 0 2023-08-01T19:55:14.948 INFO:tasks.ceph.osd.1.smithi101.stderr:2023-08-01T19:55:14.946+0000 7fb0cb7f6700 -1 received signal: Hangup from /usr/bin/python3 /bin/daemon-helper kill ceph-osd -f --cluster ceph -i 1 (PID: 111141) UID: 0 2023-08-01T19:55:14.965 INFO:teuthology.orchestra.run.smithi101.stdout:ERROR: (22) Invalid argument 2023-08-01T19:55:14.965 INFO:teuthology.orchestra.run.smithi101.stdout:op_tracker tracking is not enabled now, so no ops are tracked currently, even those get stuck. Please enable "osd_enable_op_tracker", and the tracker will start to track new ops received afterwards. 2023-08-01T19:55:14.980 DEBUG:teuthology.orchestra.run.smithi101:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 30 ceph --cluster ceph --admin-daemon /var/run/ceph/ceph-osd.1.asok dump_blocked_ops 2023-08-01T19:55:15.063 INFO:tasks.ceph.osd.1.smithi101.stderr:2023-08-01T19:55:15.062+0000 7fb0cb7f6700 -1 received signal: Hangup from /usr/bin/python3 /bin/daemon-helper kill ceph-osd -f --cluster ceph -i 1 (PID: 111141) UID: 0 2023-08-01T19:55:15.149 INFO:tasks.ceph.osd.1.smithi101.stderr:2023-08-01T19:55:15.148+0000 7fb0cb7f6700 -1 received signal: Hangup from /usr/bin/python3 /bin/daemon-helper kill ceph-osd -f --cluster ceph -i 1 (PID: 111141) UID: 0 2023-08-01T19:55:15.182 INFO:teuthology.orchestra.run.smithi101.stdout:ERROR: (22) Invalid argument 2023-08-01T19:55:15.182 INFO:teuthology.orchestra.run.smithi101.stdout:op_tracker tracking is not enabled now, so no ops are tracked currently, even those get stuck. Please enable "osd_enable_op_tracker", and the tracker will start to track new ops received afterwards. 2023-08-01T19:55:15.195 DEBUG:teuthology.orchestra.run.smithi101:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 30 ceph --cluster ceph --admin-daemon /var/run/ceph/ceph-osd.1.asok dump_historic_ops 2023-08-01T19:55:15.250 INFO:tasks.ceph.osd.2.smithi155.stderr:2023-08-01T19:55:15.248+0000 7faa5c6ac700 -1 received signal: Hangup from /usr/bin/python3 /bin/daemon-helper kill ceph-osd -f --cluster ceph -i 2 (PID: 111337) UID: 0 2023-08-01T19:55:15.316 INFO:tasks.radosbench.radosbench.0.smithi006.stdout: 51 16 117159 117143 143.546 115.75 0.00782013 0.00696352 2023-08-01T19:55:15.351 INFO:tasks.ceph.osd.0.smithi008.stderr:2023-08-01T19:55:15.349+0000 7f16a58f4700 -1 received signal: Hangup from /usr/bin/python3 /bin/daemon-helper kill ceph-osd -f --cluster ceph -i 0 (PID: 111179) UID: 0 2023-08-01T19:55:15.405 INFO:teuthology.orchestra.run.smithi101.stdout:ERROR: (22) Invalid argument 2023-08-01T19:55:15.405 INFO:teuthology.orchestra.run.smithi101.stdout:op_tracker tracking is not enabled now, so no ops are tracked currently, even those get stuck. Please enable "osd_enable_op_tracker", and the tracker will start to track new ops received afterwards. 2023-08-01T19:55:15.419 DEBUG:teuthology.orchestra.run.smithi155:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 30 ceph --cluster ceph --admin-daemon /var/run/ceph/ceph-osd.2.asok dump_ops_in_flight 2023-08-01T19:55:15.452 INFO:tasks.ceph.osd.0.smithi008.stderr:2023-08-01T19:55:15.450+0000 7f16a58f4700 -1 received signal: Hangup from /usr/bin/python3 /bin/daemon-helper kill ceph-osd -f --cluster ceph -i 0 (PID: 111179) UID: 0 2023-08-01T19:55:15.552 INFO:tasks.ceph.osd.1.smithi101.stderr:2023-08-01T19:55:15.551+0000 7fb0cb7f6700 -1 received signal: Hangup from /usr/bin/python3 /bin/daemon-helper kill ceph-osd -f --cluster ceph -i 1 (PID: 111141) UID: 0 2023-08-01T19:55:15.590 INFO:tasks.thrashosds.thrasher:in_osds: [0, 1, 2] out_osds: [] dead_osds: [] live_osds: [0, 1, 2] 2023-08-01T19:55:15.590 INFO:tasks.thrashosds.thrasher:choose_action: min_in 4 min_out 0 min_live 2 min_dead 0 chance_down 1.00 2023-08-01T19:55:15.590 INFO:tasks.thrashosds.thrasher:inject_pause on osd.1 2023-08-01T19:55:15.590 INFO:tasks.thrashosds.thrasher:Testing filestore_inject_stall pause injection for duration 3 2023-08-01T19:55:15.591 INFO:tasks.thrashosds.thrasher:Checking after 0, should_be_down=False 2023-08-01T19:55:15.591 DEBUG:teuthology.orchestra.run.smithi101:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 0 ceph --cluster ceph --admin-daemon /var/run/ceph/ceph-osd.1.asok config set filestore_inject_stall 3 2023-08-01T19:55:15.592 INFO:teuthology.orchestra.run.smithi155.stdout:ERROR: (22) Invalid argument 2023-08-01T19:55:15.592 INFO:teuthology.orchestra.run.smithi155.stdout:op_tracker tracking is not enabled now, so no ops are tracked currently, even those get stuck. Please enable "osd_enable_op_tracker", and the tracker will start to track new ops received afterwards. 2023-08-01T19:55:15.600 INFO:teuthology.orchestra.run.smithi006.stderr:noscrub is unset 2023-08-01T19:55:15.607 DEBUG:teuthology.orchestra.run.smithi155:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 30 ceph --cluster ceph --admin-daemon /var/run/ceph/ceph-osd.2.asok dump_blocked_ops 2023-08-01T19:55:15.653 INFO:tasks.ceph.osd.1.smithi101.stderr:2023-08-01T19:55:15.651+0000 7fb0cb7f6700 -1 received signal: Hangup from /usr/bin/python3 /bin/daemon-helper kill ceph-osd -f --cluster ceph -i 1 (PID: 111141) UID: 0 2023-08-01T19:55:15.753 INFO:tasks.ceph.osd.1.smithi101.stderr:2023-08-01T19:55:15.752+0000 7fb0cb7f6700 -1 received signal: Hangup from /usr/bin/python3 /bin/daemon-helper kill ceph-osd -f --cluster ceph -i 1 (PID: 111141) UID: 0 2023-08-01T19:55:15.754 INFO:teuthology.orchestra.run.smithi101.stdout:{ 2023-08-01T19:55:15.754 INFO:teuthology.orchestra.run.smithi101.stdout: "success": "" 2023-08-01T19:55:15.754 INFO:teuthology.orchestra.run.smithi101.stdout:} 2023-08-01T19:55:15.783 INFO:teuthology.orchestra.run.smithi155.stdout:ERROR: (22) Invalid argument 2023-08-01T19:55:15.783 INFO:teuthology.orchestra.run.smithi155.stdout:op_tracker tracking is not enabled now, so no ops are tracked currently, even those get stuck. Please enable "osd_enable_op_tracker", and the tracker will start to track new ops received afterwards. 2023-08-01T19:55:15.794 DEBUG:teuthology.orchestra.run.smithi155:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 30 ceph --cluster ceph --admin-daemon /var/run/ceph/ceph-osd.2.asok dump_historic_ops 2023-08-01T19:55:15.854 INFO:tasks.ceph.osd.0.smithi008.stderr:2023-08-01T19:55:15.852+0000 7f16a58f4700 -1 received signal: Hangup from /usr/bin/python3 /bin/daemon-helper kill ceph-osd -f --cluster ceph -i 0 (PID: 111179) UID: 0 2023-08-01T19:55:15.954 INFO:tasks.ceph.osd.1.smithi101.stderr:2023-08-01T19:55:15.953+0000 7fb0cb7f6700 -1 received signal: Hangup from /usr/bin/python3 /bin/daemon-helper kill ceph-osd -f --cluster ceph -i 1 (PID: 111141) UID: 0 2023-08-01T19:55:15.955 INFO:teuthology.orchestra.run.smithi155.stdout:ERROR: (22) Invalid argument 2023-08-01T19:55:15.956 INFO:teuthology.orchestra.run.smithi155.stdout:op_tracker tracking is not enabled now, so no ops are tracked currently, even those get stuck. Please enable "osd_enable_op_tracker", and the tracker will start to track new ops received afterwards. 2023-08-01T19:55:15.969 DEBUG:teuthology.orchestra.run.smithi008:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 30 ceph --cluster ceph --admin-daemon /var/run/ceph/ceph-osd.0.asok dump_ops_in_flight 2023-08-01T19:55:16.055 INFO:tasks.ceph.osd.1.smithi101.stderr:2023-08-01T19:55:16.054+0000 7fb0cb7f6700 -1 received signal: Hangup from /usr/bin/python3 /bin/daemon-helper kill ceph-osd -f --cluster ceph -i 1 (PID: 111141) UID: 0 2023-08-01T19:55:16.156 INFO:tasks.ceph.osd.1.smithi101.stderr:2023-08-01T19:55:16.155+0000 7fb0cb7f6700 -1 received signal: Hangup from /usr/bin/python3 /bin/daemon-helper kill ceph-osd -f --cluster ceph -i 1 (PID: 111141) UID: 0 2023-08-01T19:55:16.158 INFO:teuthology.orchestra.run.smithi008.stdout:ERROR: (22) Invalid argument 2023-08-01T19:55:16.159 INFO:teuthology.orchestra.run.smithi008.stdout:op_tracker tracking is not enabled now, so no ops are tracked currently, even those get stuck. Please enable "osd_enable_op_tracker", and the tracker will start to track new ops received afterwards. 2023-08-01T19:55:16.173 DEBUG:teuthology.orchestra.run.smithi008:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 30 ceph --cluster ceph --admin-daemon /var/run/ceph/ceph-osd.0.asok dump_blocked_ops 2023-08-01T19:55:16.257 INFO:tasks.ceph.osd.2.smithi155.stderr:2023-08-01T19:55:16.255+0000 7faa5c6ac700 -1 received signal: Hangup from /usr/bin/python3 /bin/daemon-helper kill ceph-osd -f --cluster ceph -i 2 (PID: 111337) UID: 0 2023-08-01T19:55:16.317 INFO:tasks.radosbench.radosbench.0.smithi006.stdout: 52 16 118982 118966 142.976 113.938 0.0119154 0.00699116 2023-08-01T19:55:16.357 INFO:tasks.ceph.osd.1.smithi101.stderr:2023-08-01T19:55:16.356+0000 7fb0cb7f6700 -1 received signal: Hangup from /usr/bin/python3 /bin/daemon-helper kill ceph-osd -f --cluster ceph -i 1 (PID: 111141) UID: 0 2023-08-01T19:55:16.368 INFO:teuthology.orchestra.run.smithi008.stdout:ERROR: (22) Invalid argument 2023-08-01T19:55:16.368 INFO:teuthology.orchestra.run.smithi008.stdout:op_tracker tracking is not enabled now, so no ops are tracked currently, even those get stuck. Please enable "osd_enable_op_tracker", and the tracker will start to track new ops received afterwards. 2023-08-01T19:55:16.384 DEBUG:teuthology.orchestra.run.smithi008:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 30 ceph --cluster ceph --admin-daemon /var/run/ceph/ceph-osd.0.asok dump_historic_ops 2023-08-01T19:55:16.459 INFO:tasks.ceph.osd.0.smithi008.stderr:2023-08-01T19:55:16.458+0000 7f16a58f4700 -1 received signal: Hangup from /usr/bin/python3 /bin/daemon-helper kill ceph-osd -f --cluster ceph -i 0 (PID: 111179) UID: 0 2023-08-01T19:55:16.560 INFO:tasks.ceph.osd.0.smithi008.stderr:2023-08-01T19:55:16.559+0000 7f16a58f4700 -1 received signal: Hangup from /usr/bin/python3 /bin/daemon-helper kill ceph-osd -f --cluster ceph -i 0 (PID: 111179) UID: 0 2023-08-01T19:55:16.579 INFO:teuthology.orchestra.run.smithi008.stdout:ERROR: (22) Invalid argument 2023-08-01T19:55:16.579 INFO:teuthology.orchestra.run.smithi008.stdout:op_tracker tracking is not enabled now, so no ops are tracked currently, even those get stuck. Please enable "osd_enable_op_tracker", and the tracker will start to track new ops received afterwards. 2023-08-01T19:55:16.594 DEBUG:teuthology.orchestra.run.smithi101:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 30 ceph --cluster ceph --admin-daemon /var/run/ceph/ceph-osd.1.asok dump_ops_in_flight 2023-08-01T19:55:16.659 INFO:tasks.ceph.osd.2.smithi155.stderr:2023-08-01T19:55:16.658+0000 7faa5c6ac700 -1 received signal: Hangup from /usr/bin/python3 /bin/daemon-helper kill ceph-osd -f --cluster ceph -i 2 (PID: 111337) UID: 0 2023-08-01T19:55:16.697 DEBUG:teuthology.orchestra.run.smithi006:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 120 ceph --cluster ceph -- tell 'osd.*' injectargs --osd_enable_op_tracker=true 2023-08-01T19:55:16.760 INFO:tasks.ceph.osd.1.smithi101.stderr:2023-08-01T19:55:16.759+0000 7fb0cb7f6700 -1 received signal: Hangup from /usr/bin/python3 /bin/daemon-helper kill ceph-osd -f --cluster ceph -i 1 (PID: 111141) UID: 0 2023-08-01T19:55:16.761 INFO:teuthology.orchestra.run.smithi101.stdout:ERROR: (22) Invalid argument 2023-08-01T19:55:16.762 INFO:teuthology.orchestra.run.smithi101.stdout:op_tracker tracking is not enabled now, so no ops are tracked currently, even those get stuck. Please enable "osd_enable_op_tracker", and the tracker will start to track new ops received afterwards. 2023-08-01T19:55:16.777 DEBUG:teuthology.orchestra.run.smithi101:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 30 ceph --cluster ceph --admin-daemon /var/run/ceph/ceph-osd.1.asok dump_blocked_ops 2023-08-01T19:55:16.847 INFO:teuthology.orchestra.run.smithi006.stdout:osd.0: {} 2023-08-01T19:55:16.861 INFO:tasks.ceph.osd.1.smithi101.stderr:2023-08-01T19:55:16.860+0000 7fb0cb7f6700 -1 received signal: Hangup from /usr/bin/python3 /bin/daemon-helper kill ceph-osd -f --cluster ceph -i 1 (PID: 111141) UID: 0 2023-08-01T19:55:16.867 INFO:teuthology.orchestra.run.smithi006.stdout:osd.1: {} 2023-08-01T19:55:16.886 INFO:teuthology.orchestra.run.smithi006.stdout:osd.2: {} 2023-08-01T19:55:16.888 INFO:teuthology.orchestra.run.smithi006.stderr:osd.0: osd_enable_op_tracker = 'true' 2023-08-01T19:55:16.888 INFO:teuthology.orchestra.run.smithi006.stderr:osd.1: osd_enable_op_tracker = 'true' 2023-08-01T19:55:16.888 INFO:teuthology.orchestra.run.smithi006.stderr:osd.2: osd_enable_op_tracker = 'true' 2023-08-01T19:55:16.963 INFO:tasks.ceph.osd.1.smithi101.stderr:2023-08-01T19:55:16.962+0000 7fb0cb7f6700 -1 received signal: Hangup from /usr/bin/python3 /bin/daemon-helper kill ceph-osd -f --cluster ceph -i 1 (PID: 111141) UID: 0 2023-08-01T19:55:16.995 INFO:teuthology.orchestra.run.smithi101.stdout:{ 2023-08-01T19:55:16.995 INFO:teuthology.orchestra.run.smithi101.stdout: "ops": [], 2023-08-01T19:55:16.996 INFO:teuthology.orchestra.run.smithi101.stdout: "complaint_time": 30, 2023-08-01T19:55:16.996 INFO:teuthology.orchestra.run.smithi101.stdout: "num_blocked_ops": 0 2023-08-01T19:55:16.996 INFO:teuthology.orchestra.run.smithi101.stdout:} 2023-08-01T19:55:17.009 DEBUG:teuthology.orchestra.run.smithi101:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 30 ceph --cluster ceph --admin-daemon /var/run/ceph/ceph-osd.1.asok dump_historic_ops 2023-08-01T19:55:17.092 INFO:tasks.ceph.osd.1.smithi101.stderr:2023-08-01T19:55:17.091+0000 7fb0cb7f6700 -1 received signal: Hangup from /usr/bin/python3 /bin/daemon-helper kill ceph-osd -f --cluster ceph -i 1 (PID: 111141) UID: 0 2023-08-01T19:55:17.162 INFO:tasks.ceph.osd.1.smithi101.stderr:2023-08-01T19:55:17.161+0000 7fb0cb7f6700 -1 received signal: Hangup from /usr/bin/python3 /bin/daemon-helper kill ceph-osd -f --cluster ceph -i 1 (PID: 111141) UID: 0 2023-08-01T19:55:17.218 INFO:teuthology.orchestra.run.smithi101.stdout:{ 2023-08-01T19:55:17.218 INFO:teuthology.orchestra.run.smithi101.stdout: "size": 20, 2023-08-01T19:55:17.218 INFO:teuthology.orchestra.run.smithi101.stdout: "duration": 600, 2023-08-01T19:55:17.218 INFO:teuthology.orchestra.run.smithi101.stdout: "ops": [ 2023-08-01T19:55:17.218 INFO:teuthology.orchestra.run.smithi101.stdout: { 2023-08-01T19:55:17.218 INFO:teuthology.orchestra.run.smithi101.stdout: "description": "osd_op(mds.0.3:11 3.10 3:0bd6d154:::602.00000000:head [create,setxattr parent (62) in=6b,setxattr layout (30) in=6b] snapc 0=[] ondisk+write+known_if_redirected+full_force+supports_pool_eio e17)", 2023-08-01T19:55:17.219 INFO:teuthology.orchestra.run.smithi101.stdout: "initiated_at": "2023-08-01T19:54:04.458960+0000", 2023-08-01T19:55:17.219 INFO:teuthology.orchestra.run.smithi101.stdout: "age": 72.755614312999995, 2023-08-01T19:55:17.219 INFO:teuthology.orchestra.run.smithi101.stdout: "duration": 0.019645459000000001, 2023-08-01T19:55:17.219 INFO:teuthology.orchestra.run.smithi101.stdout: "type_data": { 2023-08-01T19:55:17.219 INFO:teuthology.orchestra.run.smithi101.stdout: "flag_point": "commit sent; apply or cleanup", 2023-08-01T19:55:17.219 INFO:teuthology.orchestra.run.smithi101.stdout: "events": [ 2023-08-01T19:55:17.219 INFO:teuthology.orchestra.run.smithi101.stdout: { 2023-08-01T19:55:17.220 INFO:teuthology.orchestra.run.smithi101.stdout: "event": "initiated", 2023-08-01T19:55:17.220 INFO:teuthology.orchestra.run.smithi101.stdout: "time": "2023-08-01T19:54:04.458960+0000", 2023-08-01T19:55:17.220 INFO:teuthology.orchestra.run.smithi101.stdout: "duration": 0 2023-08-01T19:55:17.220 INFO:teuthology.orchestra.run.smithi101.stdout: }, 2023-08-01T19:55:17.220 INFO:teuthology.orchestra.run.smithi101.stdout: { 2023-08-01T19:55:17.220 INFO:teuthology.orchestra.run.smithi101.stdout: "event": "throttled", 2023-08-01T19:55:17.220 INFO:teuthology.orchestra.run.smithi101.stdout: "time": "2023-08-01T19:54:04.458960+0000", 2023-08-01T19:55:17.221 INFO:teuthology.orchestra.run.smithi101.stdout: "duration": 0 2023-08-01T19:55:17.221 INFO:teuthology.orchestra.run.smithi101.stdout: }, 2023-08-01T19:55:17.221 INFO:teuthology.orchestra.run.smithi101.stdout: { 2023-08-01T19:55:17.221 INFO:teuthology.orchestra.run.smithi101.stdout: "event": "header_read", 2023-08-01T19:55:17.221 INFO:teuthology.orchestra.run.smithi101.stdout: "time": "2023-08-01T19:54:04.458959+0000", 2023-08-01T19:55:17.221 INFO:teuthology.orchestra.run.smithi101.stdout: "duration": 4294967295.9999995 2023-08-01T19:55:17.221 INFO:teuthology.orchestra.run.smithi101.stdout: }, 2023-08-01T19:55:17.222 INFO:teuthology.orchestra.run.smithi101.stdout: { 2023-08-01T19:55:17.222 INFO:teuthology.orchestra.run.smithi101.stdout: "event": "all_read", 2023-08-01T19:55:17.222 INFO:teuthology.orchestra.run.smithi101.stdout: "time": "2023-08-01T19:54:04.458963+0000", 2023-08-01T19:55:17.222 INFO:teuthology.orchestra.run.smithi101.stdout: "duration": 3.9199999999999997e-06 2023-08-01T19:55:17.222 INFO:teuthology.orchestra.run.smithi101.stdout: }, 2023-08-01T19:55:17.222 INFO:teuthology.orchestra.run.smithi101.stdout: { 2023-08-01T19:55:17.222 INFO:teuthology.orchestra.run.smithi101.stdout: "event": "dispatched", 2023-08-01T19:55:17.222 INFO:teuthology.orchestra.run.smithi101.stdout: "time": "2023-08-01T19:54:04.458970+0000", 2023-08-01T19:55:17.223 INFO:teuthology.orchestra.run.smithi101.stdout: "duration": 7.0439999999999998e-06 2023-08-01T19:55:17.223 INFO:teuthology.orchestra.run.smithi101.stdout: }, 2023-08-01T19:55:17.223 INFO:teuthology.orchestra.run.smithi101.stdout: { 2023-08-01T19:55:17.223 INFO:teuthology.orchestra.run.smithi101.stdout: "event": "queued_for_pg", 2023-08-01T19:55:17.223 INFO:teuthology.orchestra.run.smithi101.stdout: "time": "2023-08-01T19:54:04.458976+0000", 2023-08-01T19:55:17.223 INFO:teuthology.orchestra.run.smithi101.stdout: "duration": 5.9540000000000001e-06 2023-08-01T19:55:17.223 INFO:teuthology.orchestra.run.smithi101.stdout: }, 2023-08-01T19:55:17.223 INFO:teuthology.orchestra.run.smithi101.stdout: { 2023-08-01T19:55:17.224 INFO:teuthology.orchestra.run.smithi101.stdout: "event": "reached_pg", 2023-08-01T19:55:17.224 INFO:teuthology.orchestra.run.smithi101.stdout: "time": "2023-08-01T19:54:04.459035+0000", 2023-08-01T19:55:17.224 INFO:teuthology.orchestra.run.smithi101.stdout: "duration": 5.8924e-05 2023-08-01T19:55:17.224 INFO:teuthology.orchestra.run.smithi101.stdout: }, 2023-08-01T19:55:17.224 INFO:teuthology.orchestra.run.smithi101.stdout: { 2023-08-01T19:55:17.224 INFO:teuthology.orchestra.run.smithi101.stdout: "event": "waiting_for_map not empty", 2023-08-01T19:55:17.224 INFO:teuthology.orchestra.run.smithi101.stdout: "time": "2023-08-01T19:54:04.459038+0000", 2023-08-01T19:55:17.225 INFO:teuthology.orchestra.run.smithi101.stdout: "duration": 3.2760000000000001e-06 2023-08-01T19:55:17.225 INFO:teuthology.orchestra.run.smithi101.stdout: }, 2023-08-01T19:55:17.225 INFO:teuthology.orchestra.run.smithi101.stdout: { 2023-08-01T19:55:17.225 INFO:teuthology.orchestra.run.smithi101.stdout: "event": "reached_pg", 2023-08-01T19:55:17.225 INFO:teuthology.orchestra.run.smithi101.stdout: "time": "2023-08-01T19:54:04.471511+0000", 2023-08-01T19:55:17.225 INFO:teuthology.orchestra.run.smithi101.stdout: "duration": 0.012473039999999999 2023-08-01T19:55:17.225 INFO:teuthology.orchestra.run.smithi101.stdout: }, 2023-08-01T19:55:17.225 INFO:teuthology.orchestra.run.smithi101.stdout: { 2023-08-01T19:55:17.226 INFO:teuthology.orchestra.run.smithi101.stdout: "event": "started", 2023-08-01T19:55:17.226 INFO:teuthology.orchestra.run.smithi101.stdout: "time": "2023-08-01T19:54:04.472086+0000", 2023-08-01T19:55:17.226 INFO:teuthology.orchestra.run.smithi101.stdout: "duration": 0.00057491699999999998 2023-08-01T19:55:17.226 INFO:teuthology.orchestra.run.smithi101.stdout: }, 2023-08-01T19:55:17.226 INFO:teuthology.orchestra.run.smithi101.stdout: { 2023-08-01T19:55:17.226 INFO:teuthology.orchestra.run.smithi101.stdout: "event": "waiting for subops from 2", 2023-08-01T19:55:17.226 INFO:teuthology.orchestra.run.smithi101.stdout: "time": "2023-08-01T19:54:04.472310+0000", 2023-08-01T19:55:17.226 INFO:teuthology.orchestra.run.smithi101.stdout: "duration": 0.00022396499999999999 2023-08-01T19:55:17.227 INFO:teuthology.orchestra.run.smithi101.stdout: }, 2023-08-01T19:55:17.227 INFO:teuthology.orchestra.run.smithi101.stdout: { 2023-08-01T19:55:17.227 INFO:teuthology.orchestra.run.smithi101.stdout: "event": "op_commit", 2023-08-01T19:55:17.227 INFO:teuthology.orchestra.run.smithi101.stdout: "time": "2023-08-01T19:54:04.478141+0000", 2023-08-01T19:55:17.227 INFO:teuthology.orchestra.run.smithi101.stdout: "duration": 0.0058312320000000004 2023-08-01T19:55:17.227 INFO:teuthology.orchestra.run.smithi101.stdout: }, 2023-08-01T19:55:17.227 INFO:teuthology.orchestra.run.smithi101.stdout: { 2023-08-01T19:55:17.227 INFO:teuthology.orchestra.run.smithi101.stdout: "event": "sub_op_commit_rec", 2023-08-01T19:55:17.228 INFO:teuthology.orchestra.run.smithi101.stdout: "time": "2023-08-01T19:54:04.478543+0000", 2023-08-01T19:55:17.228 INFO:teuthology.orchestra.run.smithi101.stdout: "duration": 0.00040160800000000002 2023-08-01T19:55:17.228 INFO:teuthology.orchestra.run.smithi101.stdout: }, 2023-08-01T19:55:17.228 INFO:teuthology.orchestra.run.smithi101.stdout: { 2023-08-01T19:55:17.228 INFO:teuthology.orchestra.run.smithi101.stdout: "event": "commit_sent", 2023-08-01T19:55:17.228 INFO:teuthology.orchestra.run.smithi101.stdout: "time": "2023-08-01T19:54:04.478584+0000", 2023-08-01T19:55:17.228 INFO:teuthology.orchestra.run.smithi101.stdout: "duration": 4.0989999999999999e-05 2023-08-01T19:55:17.229 INFO:teuthology.orchestra.run.smithi101.stdout: }, 2023-08-01T19:55:17.229 INFO:teuthology.orchestra.run.smithi101.stdout: { 2023-08-01T19:55:17.229 INFO:teuthology.orchestra.run.smithi101.stdout: "event": "done", 2023-08-01T19:55:17.229 INFO:teuthology.orchestra.run.smithi101.stdout: "time": "2023-08-01T19:54:04.478605+0000", 2023-08-01T19:55:17.229 INFO:teuthology.orchestra.run.smithi101.stdout: "duration": 2.1178e-05 2023-08-01T19:55:17.229 INFO:teuthology.orchestra.run.smithi101.stdout: } 2023-08-01T19:55:17.229 INFO:teuthology.orchestra.run.smithi101.stdout: ] 2023-08-01T19:55:17.229 INFO:teuthology.orchestra.run.smithi101.stdout: } 2023-08-01T19:55:17.230 INFO:teuthology.orchestra.run.smithi101.stdout: }, 2023-08-01T19:55:17.230 INFO:teuthology.orchestra.run.smithi101.stdout: { 2023-08-01T19:55:17.230 INFO:teuthology.orchestra.run.smithi101.stdout: "description": "osd_op(mds.0.3:12 3.10 3:0d89b25e:::603.00000000:head [omap-set-header] snapc 0=[] ondisk+write+known_if_redirected+full_force+supports_pool_eio e17)", 2023-08-01T19:55:17.230 INFO:teuthology.orchestra.run.smithi101.stdout: "initiated_at": "2023-08-01T19:54:04.458982+0000", 2023-08-01T19:55:17.230 INFO:teuthology.orchestra.run.smithi101.stdout: "age": 72.755592085000004, 2023-08-01T19:55:17.230 INFO:teuthology.orchestra.run.smithi101.stdout: "duration": 0.021266334000000001, 2023-08-01T19:55:17.230 INFO:teuthology.orchestra.run.smithi101.stdout: "type_data": { 2023-08-01T19:55:17.230 INFO:teuthology.orchestra.run.smithi101.stdout: "flag_point": "commit sent; apply or cleanup", 2023-08-01T19:55:17.231 INFO:teuthology.orchestra.run.smithi101.stdout: "events": [ 2023-08-01T19:55:17.231 INFO:teuthology.orchestra.run.smithi101.stdout: { 2023-08-01T19:55:17.231 INFO:teuthology.orchestra.run.smithi101.stdout: "event": "initiated", 2023-08-01T19:55:17.231 INFO:teuthology.orchestra.run.smithi101.stdout: "time": "2023-08-01T19:54:04.458982+0000", 2023-08-01T19:55:17.231 INFO:teuthology.orchestra.run.smithi101.stdout: "duration": 0 2023-08-01T19:55:17.231 INFO:teuthology.orchestra.run.smithi101.stdout: }, 2023-08-01T19:55:17.231 INFO:teuthology.orchestra.run.smithi101.stdout: { 2023-08-01T19:55:17.231 INFO:teuthology.orchestra.run.smithi101.stdout: "event": "throttled", 2023-08-01T19:55:17.232 INFO:teuthology.orchestra.run.smithi101.stdout: "time": "2023-08-01T19:54:04.458982+0000", 2023-08-01T19:55:17.232 INFO:teuthology.orchestra.run.smithi101.stdout: "duration": 0 2023-08-01T19:55:17.232 INFO:teuthology.orchestra.run.smithi101.stdout: }, 2023-08-01T19:55:17.232 INFO:teuthology.orchestra.run.smithi101.stdout: { 2023-08-01T19:55:17.232 INFO:teuthology.orchestra.run.smithi101.stdout: "event": "header_read", 2023-08-01T19:55:17.232 INFO:teuthology.orchestra.run.smithi101.stdout: "time": "2023-08-01T19:54:04.458982+0000", 2023-08-01T19:55:17.232 INFO:teuthology.orchestra.run.smithi101.stdout: "duration": 4294967295.9999995 2023-08-01T19:55:17.233 INFO:teuthology.orchestra.run.smithi101.stdout: }, 2023-08-01T19:55:17.233 INFO:teuthology.orchestra.run.smithi101.stdout: { 2023-08-01T19:55:17.233 INFO:teuthology.orchestra.run.smithi101.stdout: "event": "all_read", 2023-08-01T19:55:17.233 INFO:teuthology.orchestra.run.smithi101.stdout: "time": "2023-08-01T19:54:04.458985+0000", 2023-08-01T19:55:17.233 INFO:teuthology.orchestra.run.smithi101.stdout: "duration": 3.4800000000000001e-06 2023-08-01T19:55:17.233 INFO:teuthology.orchestra.run.smithi101.stdout: }, 2023-08-01T19:55:17.233 INFO:teuthology.orchestra.run.smithi101.stdout: { 2023-08-01T19:55:17.233 INFO:teuthology.orchestra.run.smithi101.stdout: "event": "dispatched", 2023-08-01T19:55:17.234 INFO:teuthology.orchestra.run.smithi101.stdout: "time": "2023-08-01T19:54:04.458992+0000", 2023-08-01T19:55:17.234 INFO:teuthology.orchestra.run.smithi101.stdout: "duration": 7.306e-06 2023-08-01T19:55:17.234 INFO:teuthology.orchestra.run.smithi101.stdout: }, 2023-08-01T19:55:17.234 INFO:teuthology.orchestra.run.smithi101.stdout: { 2023-08-01T19:55:17.234 INFO:teuthology.orchestra.run.smithi101.stdout: "event": "queued_for_pg", 2023-08-01T19:55:17.234 INFO:teuthology.orchestra.run.smithi101.stdout: "time": "2023-08-01T19:54:04.458997+0000", 2023-08-01T19:55:17.234 INFO:teuthology.orchestra.run.smithi101.stdout: "duration": 4.4530000000000004e-06 2023-08-01T19:55:17.235 INFO:teuthology.orchestra.run.smithi101.stdout: }, 2023-08-01T19:55:17.235 INFO:teuthology.orchestra.run.smithi101.stdout: { 2023-08-01T19:55:17.235 INFO:teuthology.orchestra.run.smithi101.stdout: "event": "reached_pg", 2023-08-01T19:55:17.235 INFO:teuthology.orchestra.run.smithi101.stdout: "time": "2023-08-01T19:54:04.459060+0000", 2023-08-01T19:55:17.235 INFO:teuthology.orchestra.run.smithi101.stdout: "duration": 6.3249000000000004e-05 2023-08-01T19:55:17.235 INFO:teuthology.orchestra.run.smithi101.stdout: }, 2023-08-01T19:55:17.235 INFO:teuthology.orchestra.run.smithi101.stdout: { 2023-08-01T19:55:17.235 INFO:teuthology.orchestra.run.smithi101.stdout: "event": "waiting_for_map not empty", 2023-08-01T19:55:17.236 INFO:teuthology.orchestra.run.smithi101.stdout: "time": "2023-08-01T19:54:04.459063+0000", 2023-08-01T19:55:17.236 INFO:teuthology.orchestra.run.smithi101.stdout: "duration": 2.717e-06 2023-08-01T19:55:17.236 INFO:teuthology.orchestra.run.smithi101.stdout: }, 2023-08-01T19:55:17.236 INFO:teuthology.orchestra.run.smithi101.stdout: { 2023-08-01T19:55:17.236 INFO:teuthology.orchestra.run.smithi101.stdout: "event": "reached_pg", 2023-08-01T19:55:17.236 INFO:teuthology.orchestra.run.smithi101.stdout: "time": "2023-08-01T19:54:04.473625+0000", 2023-08-01T19:55:17.236 INFO:teuthology.orchestra.run.smithi101.stdout: "duration": 0.014562007 2023-08-01T19:55:17.236 INFO:teuthology.orchestra.run.smithi101.stdout: }, 2023-08-01T19:55:17.237 INFO:teuthology.orchestra.run.smithi101.stdout: { 2023-08-01T19:55:17.237 INFO:teuthology.orchestra.run.smithi101.stdout: "event": "started", 2023-08-01T19:55:17.237 INFO:teuthology.orchestra.run.smithi101.stdout: "time": "2023-08-01T19:54:04.473757+0000", 2023-08-01T19:55:17.237 INFO:teuthology.orchestra.run.smithi101.stdout: "duration": 0.00013238599999999999 2023-08-01T19:55:17.237 INFO:teuthology.orchestra.run.smithi101.stdout: }, 2023-08-01T19:55:17.237 INFO:teuthology.orchestra.run.smithi101.stdout: { 2023-08-01T19:55:17.237 INFO:teuthology.orchestra.run.smithi101.stdout: "event": "waiting for subops from 2", 2023-08-01T19:55:17.238 INFO:teuthology.orchestra.run.smithi101.stdout: "time": "2023-08-01T19:54:04.473898+0000", 2023-08-01T19:55:17.238 INFO:teuthology.orchestra.run.smithi101.stdout: "duration": 0.00014039 2023-08-01T19:55:17.238 INFO:teuthology.orchestra.run.smithi101.stdout: }, 2023-08-01T19:55:17.238 INFO:teuthology.orchestra.run.smithi101.stdout: { 2023-08-01T19:55:17.238 INFO:teuthology.orchestra.run.smithi101.stdout: "event": "op_commit", 2023-08-01T19:55:17.238 INFO:teuthology.orchestra.run.smithi101.stdout: "time": "2023-08-01T19:54:04.478380+0000", 2023-08-01T19:55:17.238 INFO:teuthology.orchestra.run.smithi101.stdout: "duration": 0.0044827449999999998 2023-08-01T19:55:17.238 INFO:teuthology.orchestra.run.smithi101.stdout: }, 2023-08-01T19:55:17.239 INFO:teuthology.orchestra.run.smithi101.stdout: { 2023-08-01T19:55:17.239 INFO:teuthology.orchestra.run.smithi101.stdout: "event": "sub_op_commit_rec", 2023-08-01T19:55:17.239 INFO:teuthology.orchestra.run.smithi101.stdout: "time": "2023-08-01T19:54:04.480169+0000", 2023-08-01T19:55:17.239 INFO:teuthology.orchestra.run.smithi101.stdout: "duration": 0.0017886040000000001 2023-08-01T19:55:17.239 INFO:teuthology.orchestra.run.smithi101.stdout: }, 2023-08-01T19:55:17.239 INFO:teuthology.orchestra.run.smithi101.stdout: { 2023-08-01T19:55:17.239 INFO:teuthology.orchestra.run.smithi101.stdout: "event": "commit_sent", 2023-08-01T19:55:17.239 INFO:teuthology.orchestra.run.smithi101.stdout: "time": "2023-08-01T19:54:04.480212+0000", 2023-08-01T19:55:17.240 INFO:teuthology.orchestra.run.smithi101.stdout: "duration": 4.2687e-05 2023-08-01T19:55:17.240 INFO:teuthology.orchestra.run.smithi101.stdout: }, 2023-08-01T19:55:17.240 INFO:teuthology.orchestra.run.smithi101.stdout: { 2023-08-01T19:55:17.240 INFO:teuthology.orchestra.run.smithi101.stdout: "event": "done", 2023-08-01T19:55:17.240 INFO:teuthology.orchestra.run.smithi101.stdout: "time": "2023-08-01T19:54:04.480248+0000", 2023-08-01T19:55:17.240 INFO:teuthology.orchestra.run.smithi101.stdout: "duration": 3.6743999999999999e-05 2023-08-01T19:55:17.240 INFO:teuthology.orchestra.run.smithi101.stdout: } 2023-08-01T19:55:17.240 INFO:teuthology.orchestra.run.smithi101.stdout: ] 2023-08-01T19:55:17.241 INFO:teuthology.orchestra.run.smithi101.stdout: } 2023-08-01T19:55:17.241 INFO:teuthology.orchestra.run.smithi101.stdout: }, 2023-08-01T19:55:17.241 INFO:teuthology.orchestra.run.smithi101.stdout: { 2023-08-01T19:55:17.241 INFO:teuthology.orchestra.run.smithi101.stdout: "description": "osd_op(mds.0.3:13 3.10 3:0d89b25e:::603.00000000:head [create,setxattr parent (62) in=6b,setxattr layout (30) in=6b] snapc 0=[] ondisk+write+known_if_redirected+full_force+supports_pool_eio e17)", 2023-08-01T19:55:17.241 INFO:teuthology.orchestra.run.smithi101.stdout: "initiated_at": "2023-08-01T19:54:04.459010+0000", 2023-08-01T19:55:17.241 INFO:teuthology.orchestra.run.smithi101.stdout: "age": 72.755564364999998, 2023-08-01T19:55:17.241 INFO:teuthology.orchestra.run.smithi101.stdout: "duration": 0.021327220000000001, 2023-08-01T19:55:17.241 INFO:teuthology.orchestra.run.smithi101.stdout: "type_data": { 2023-08-01T19:55:17.242 INFO:teuthology.orchestra.run.smithi101.stdout: "flag_point": "commit sent; apply or cleanup", 2023-08-01T19:55:17.242 INFO:teuthology.orchestra.run.smithi101.stdout: "events": [ 2023-08-01T19:55:17.242 INFO:teuthology.orchestra.run.smithi101.stdout: { 2023-08-01T19:55:17.242 INFO:teuthology.orchestra.run.smithi101.stdout: "event": "initiated", 2023-08-01T19:55:17.242 INFO:teuthology.orchestra.run.smithi101.stdout: "time": "2023-08-01T19:54:04.459010+0000", 2023-08-01T19:55:17.242 INFO:teuthology.orchestra.run.smithi101.stdout: "duration": 0 2023-08-01T19:55:17.242 INFO:teuthology.orchestra.run.smithi101.stdout: }, 2023-08-01T19:55:17.242 INFO:teuthology.orchestra.run.smithi101.stdout: { 2023-08-01T19:55:17.243 INFO:teuthology.orchestra.run.smithi101.stdout: "event": "throttled", 2023-08-01T19:55:17.243 INFO:teuthology.orchestra.run.smithi101.stdout: "time": "2023-08-01T19:54:04.459010+0000", 2023-08-01T19:55:17.243 INFO:teuthology.orchestra.run.smithi101.stdout: "duration": 0 2023-08-01T19:55:17.243 INFO:teuthology.orchestra.run.smithi101.stdout: }, 2023-08-01T19:55:17.243 INFO:teuthology.orchestra.run.smithi101.stdout: { 2023-08-01T19:55:17.243 INFO:teuthology.orchestra.run.smithi101.stdout: "event": "header_read", 2023-08-01T19:55:17.243 INFO:teuthology.orchestra.run.smithi101.stdout: "time": "2023-08-01T19:54:04.459009+0000", 2023-08-01T19:55:17.244 INFO:teuthology.orchestra.run.smithi101.stdout: "duration": 4294967295.9999995 2023-08-01T19:55:17.244 INFO:teuthology.orchestra.run.smithi101.stdout: }, 2023-08-01T19:55:17.244 INFO:teuthology.orchestra.run.smithi101.stdout: { 2023-08-01T19:55:17.244 INFO:teuthology.orchestra.run.smithi101.stdout: "event": "all_read", 2023-08-01T19:55:17.244 INFO:teuthology.orchestra.run.smithi101.stdout: "time": "2023-08-01T19:54:04.459013+0000", 2023-08-01T19:55:17.244 INFO:teuthology.orchestra.run.smithi101.stdout: "duration": 3.8929999999999998e-06 2023-08-01T19:55:17.244 INFO:teuthology.orchestra.run.smithi101.stdout: }, 2023-08-01T19:55:17.244 INFO:teuthology.orchestra.run.smithi101.stdout: { 2023-08-01T19:55:17.245 INFO:teuthology.orchestra.run.smithi101.stdout: "event": "dispatched", 2023-08-01T19:55:17.245 INFO:teuthology.orchestra.run.smithi101.stdout: "time": "2023-08-01T19:54:04.459027+0000", 2023-08-01T19:55:17.245 INFO:teuthology.orchestra.run.smithi101.stdout: "duration": 1.3416e-05 2023-08-01T19:55:17.245 INFO:teuthology.orchestra.run.smithi101.stdout: }, 2023-08-01T19:55:17.245 INFO:teuthology.orchestra.run.smithi101.stdout: { 2023-08-01T19:55:17.245 INFO:teuthology.orchestra.run.smithi101.stdout: "event": "queued_for_pg", 2023-08-01T19:55:17.245 INFO:teuthology.orchestra.run.smithi101.stdout: "time": "2023-08-01T19:54:04.459033+0000", 2023-08-01T19:55:17.245 INFO:teuthology.orchestra.run.smithi101.stdout: "duration": 5.9800000000000003e-06 2023-08-01T19:55:17.246 INFO:teuthology.orchestra.run.smithi101.stdout: }, 2023-08-01T19:55:17.246 INFO:teuthology.orchestra.run.smithi101.stdout: { 2023-08-01T19:55:17.246 INFO:teuthology.orchestra.run.smithi101.stdout: "event": "reached_pg", 2023-08-01T19:55:17.246 INFO:teuthology.orchestra.run.smithi101.stdout: "time": "2023-08-01T19:54:04.459099+0000", 2023-08-01T19:55:17.246 INFO:teuthology.orchestra.run.smithi101.stdout: "duration": 6.6192999999999995e-05 2023-08-01T19:55:17.246 INFO:teuthology.orchestra.run.smithi101.stdout: }, 2023-08-01T19:55:17.246 INFO:teuthology.orchestra.run.smithi101.stdout: { 2023-08-01T19:55:17.246 INFO:teuthology.orchestra.run.smithi101.stdout: "event": "waiting_for_map not empty", 2023-08-01T19:55:17.247 INFO:teuthology.orchestra.run.smithi101.stdout: "time": "2023-08-01T19:54:04.459106+0000", 2023-08-01T19:55:17.247 INFO:teuthology.orchestra.run.smithi101.stdout: "duration": 6.8619999999999997e-06 2023-08-01T19:55:17.247 INFO:teuthology.orchestra.run.smithi101.stdout: }, 2023-08-01T19:55:17.247 INFO:teuthology.orchestra.run.smithi101.stdout: { 2023-08-01T19:55:17.247 INFO:teuthology.orchestra.run.smithi101.stdout: "event": "reached_pg", 2023-08-01T19:55:17.247 INFO:teuthology.orchestra.run.smithi101.stdout: "time": "2023-08-01T19:54:04.475182+0000", 2023-08-01T19:55:17.247 INFO:teuthology.orchestra.run.smithi101.stdout: "duration": 0.016076333000000002 2023-08-01T19:55:17.247 INFO:teuthology.orchestra.run.smithi101.stdout: }, 2023-08-01T19:55:17.248 INFO:teuthology.orchestra.run.smithi101.stdout: { 2023-08-01T19:55:17.248 INFO:teuthology.orchestra.run.smithi101.stdout: "event": "started", 2023-08-01T19:55:17.248 INFO:teuthology.orchestra.run.smithi101.stdout: "time": "2023-08-01T19:54:04.475353+0000", 2023-08-01T19:55:17.248 INFO:teuthology.orchestra.run.smithi101.stdout: "duration": 0.000171378 2023-08-01T19:55:17.248 INFO:teuthology.orchestra.run.smithi101.stdout: }, 2023-08-01T19:55:17.248 INFO:teuthology.orchestra.run.smithi101.stdout: { 2023-08-01T19:55:17.248 INFO:teuthology.orchestra.run.smithi101.stdout: "event": "waiting for subops from 2", 2023-08-01T19:55:17.249 INFO:teuthology.orchestra.run.smithi101.stdout: "time": "2023-08-01T19:54:04.475793+0000", 2023-08-01T19:55:17.249 INFO:teuthology.orchestra.run.smithi101.stdout: "duration": 0.000440123 2023-08-01T19:55:17.249 INFO:teuthology.orchestra.run.smithi101.stdout: }, 2023-08-01T19:55:17.249 INFO:teuthology.orchestra.run.smithi101.stdout: { 2023-08-01T19:55:17.249 INFO:teuthology.orchestra.run.smithi101.stdout: "event": "op_commit", 2023-08-01T19:55:17.249 INFO:teuthology.orchestra.run.smithi101.stdout: "time": "2023-08-01T19:54:04.478624+0000", 2023-08-01T19:55:17.249 INFO:teuthology.orchestra.run.smithi101.stdout: "duration": 0.0028305000000000001 2023-08-01T19:55:17.249 INFO:teuthology.orchestra.run.smithi101.stdout: }, 2023-08-01T19:55:17.250 INFO:teuthology.orchestra.run.smithi101.stdout: { 2023-08-01T19:55:17.250 INFO:teuthology.orchestra.run.smithi101.stdout: "event": "sub_op_commit_rec", 2023-08-01T19:55:17.250 INFO:teuthology.orchestra.run.smithi101.stdout: "time": "2023-08-01T19:54:04.480291+0000", 2023-08-01T19:55:17.250 INFO:teuthology.orchestra.run.smithi101.stdout: "duration": 0.0016670000000000001 2023-08-01T19:55:17.250 INFO:teuthology.orchestra.run.smithi101.stdout: }, 2023-08-01T19:55:17.250 INFO:teuthology.orchestra.run.smithi101.stdout: { 2023-08-01T19:55:17.250 INFO:teuthology.orchestra.run.smithi101.stdout: "event": "commit_sent", 2023-08-01T19:55:17.250 INFO:teuthology.orchestra.run.smithi101.stdout: "time": "2023-08-01T19:54:04.480318+0000", 2023-08-01T19:55:17.251 INFO:teuthology.orchestra.run.smithi101.stdout: "duration": 2.6815e-05 2023-08-01T19:55:17.251 INFO:teuthology.orchestra.run.smithi101.stdout: }, 2023-08-01T19:55:17.251 INFO:teuthology.orchestra.run.smithi101.stdout: { 2023-08-01T19:55:17.251 INFO:teuthology.orchestra.run.smithi101.stdout: "event": "done", 2023-08-01T19:55:17.251 INFO:teuthology.orchestra.run.smithi101.stdout: "time": "2023-08-01T19:54:04.480337+0000", 2023-08-01T19:55:17.251 INFO:teuthology.orchestra.run.smithi101.stdout: "duration": 1.9241000000000001e-05 2023-08-01T19:55:17.251 INFO:teuthology.orchestra.run.smithi101.stdout: } 2023-08-01T19:55:17.251 INFO:teuthology.orchestra.run.smithi101.stdout: ] 2023-08-01T19:55:17.252 INFO:teuthology.orchestra.run.smithi101.stdout: } 2023-08-01T19:55:17.252 INFO:teuthology.orchestra.run.smithi101.stdout: }, 2023-08-01T19:55:17.252 INFO:teuthology.orchestra.run.smithi101.stdout: { 2023-08-01T19:55:17.252 INFO:teuthology.orchestra.run.smithi101.stdout: "description": "osd_op(mds.0.3:1 3.14 3:292cf221:::200.00000000:head [writefull 0~90] snapc 0=[] ondisk+write+known_if_redirected+full_force+supports_pool_eio e17)", 2023-08-01T19:55:17.252 INFO:teuthology.orchestra.run.smithi101.stdout: "initiated_at": "2023-08-01T19:54:04.459177+0000", 2023-08-01T19:55:17.252 INFO:teuthology.orchestra.run.smithi101.stdout: "age": 72.755397466000005, 2023-08-01T19:55:17.252 INFO:teuthology.orchestra.run.smithi101.stdout: "duration": 0.021067196, 2023-08-01T19:55:17.252 INFO:teuthology.orchestra.run.smithi101.stdout: "type_data": { 2023-08-01T19:55:17.253 INFO:teuthology.orchestra.run.smithi101.stdout: "flag_point": "commit sent; apply or cleanup", 2023-08-01T19:55:17.253 INFO:teuthology.orchestra.run.smithi101.stdout: "events": [ 2023-08-01T19:55:17.253 INFO:teuthology.orchestra.run.smithi101.stdout: { 2023-08-01T19:55:17.253 INFO:teuthology.orchestra.run.smithi101.stdout: "event": "initiated", 2023-08-01T19:55:17.253 INFO:teuthology.orchestra.run.smithi101.stdout: "time": "2023-08-01T19:54:04.459177+0000", 2023-08-01T19:55:17.253 INFO:teuthology.orchestra.run.smithi101.stdout: "duration": 0 2023-08-01T19:55:17.253 INFO:teuthology.orchestra.run.smithi101.stdout: }, 2023-08-01T19:55:17.253 INFO:teuthology.orchestra.run.smithi101.stdout: { 2023-08-01T19:55:17.254 INFO:teuthology.orchestra.run.smithi101.stdout: "event": "throttled", 2023-08-01T19:55:17.254 INFO:teuthology.orchestra.run.smithi101.stdout: "time": "2023-08-01T19:54:04.459177+0000", 2023-08-01T19:55:17.254 INFO:teuthology.orchestra.run.smithi101.stdout: "duration": 0 2023-08-01T19:55:17.254 INFO:teuthology.orchestra.run.smithi101.stdout: }, 2023-08-01T19:55:17.254 INFO:teuthology.orchestra.run.smithi101.stdout: { 2023-08-01T19:55:17.254 INFO:teuthology.orchestra.run.smithi101.stdout: "event": "header_read", 2023-08-01T19:55:17.254 INFO:teuthology.orchestra.run.smithi101.stdout: "time": "2023-08-01T19:54:04.459176+0000", 2023-08-01T19:55:17.255 INFO:teuthology.orchestra.run.smithi101.stdout: "duration": 4294967295.9999995 2023-08-01T19:55:17.255 INFO:teuthology.orchestra.run.smithi101.stdout: }, 2023-08-01T19:55:17.255 INFO:teuthology.orchestra.run.smithi101.stdout: { 2023-08-01T19:55:17.255 INFO:teuthology.orchestra.run.smithi101.stdout: "event": "all_read", 2023-08-01T19:55:17.255 INFO:teuthology.orchestra.run.smithi101.stdout: "time": "2023-08-01T19:54:04.459181+0000", 2023-08-01T19:55:17.255 INFO:teuthology.orchestra.run.smithi101.stdout: "duration": 5.2109999999999997e-06 2023-08-01T19:55:17.255 INFO:teuthology.orchestra.run.smithi101.stdout: }, 2023-08-01T19:55:17.256 INFO:teuthology.orchestra.run.smithi101.stdout: { 2023-08-01T19:55:17.256 INFO:teuthology.orchestra.run.smithi101.stdout: "event": "dispatched", 2023-08-01T19:55:17.256 INFO:teuthology.orchestra.run.smithi101.stdout: "time": "2023-08-01T19:54:04.459188+0000", 2023-08-01T19:55:17.256 INFO:teuthology.orchestra.run.smithi101.stdout: "duration": 6.6680000000000004e-06 2023-08-01T19:55:17.256 INFO:teuthology.orchestra.run.smithi101.stdout: }, 2023-08-01T19:55:17.256 INFO:teuthology.orchestra.run.smithi101.stdout: { 2023-08-01T19:55:17.256 INFO:teuthology.orchestra.run.smithi101.stdout: "event": "queued_for_pg", 2023-08-01T19:55:17.256 INFO:teuthology.orchestra.run.smithi101.stdout: "time": "2023-08-01T19:54:04.459192+0000", 2023-08-01T19:55:17.257 INFO:teuthology.orchestra.run.smithi101.stdout: "duration": 4.228e-06 2023-08-01T19:55:17.257 INFO:teuthology.orchestra.run.smithi101.stdout: }, 2023-08-01T19:55:17.257 INFO:teuthology.orchestra.run.smithi101.stdout: { 2023-08-01T19:55:17.257 INFO:teuthology.orchestra.run.smithi101.stdout: "event": "reached_pg", 2023-08-01T19:55:17.257 INFO:teuthology.orchestra.run.smithi101.stdout: "time": "2023-08-01T19:54:04.459219+0000", 2023-08-01T19:55:17.257 INFO:teuthology.orchestra.run.smithi101.stdout: "duration": 2.6930000000000001e-05 2023-08-01T19:55:17.257 INFO:teuthology.orchestra.run.smithi101.stdout: }, 2023-08-01T19:55:17.258 INFO:teuthology.orchestra.run.smithi101.stdout: { 2023-08-01T19:55:17.258 INFO:teuthology.orchestra.run.smithi101.stdout: "event": "waiting_for_map not empty", 2023-08-01T19:55:17.258 INFO:teuthology.orchestra.run.smithi101.stdout: "time": "2023-08-01T19:54:04.459223+0000", 2023-08-01T19:55:17.258 INFO:teuthology.orchestra.run.smithi101.stdout: "duration": 3.8469999999999998e-06 2023-08-01T19:55:17.258 INFO:teuthology.orchestra.run.smithi101.stdout: }, 2023-08-01T19:55:17.258 INFO:teuthology.orchestra.run.smithi101.stdout: { 2023-08-01T19:55:17.258 INFO:teuthology.orchestra.run.smithi101.stdout: "event": "reached_pg", 2023-08-01T19:55:17.259 INFO:teuthology.orchestra.run.smithi101.stdout: "time": "2023-08-01T19:54:04.473347+0000", 2023-08-01T19:55:17.259 INFO:teuthology.orchestra.run.smithi101.stdout: "duration": 0.014124319 2023-08-01T19:55:17.259 INFO:teuthology.orchestra.run.smithi101.stdout: }, 2023-08-01T19:55:17.259 INFO:teuthology.orchestra.run.smithi101.stdout: { 2023-08-01T19:55:17.259 INFO:teuthology.orchestra.run.smithi101.stdout: "event": "started", 2023-08-01T19:55:17.259 INFO:teuthology.orchestra.run.smithi101.stdout: "time": "2023-08-01T19:54:04.473480+0000", 2023-08-01T19:55:17.259 INFO:teuthology.orchestra.run.smithi101.stdout: "duration": 0.00013276799999999999 2023-08-01T19:55:17.259 INFO:teuthology.orchestra.run.smithi101.stdout: }, 2023-08-01T19:55:17.260 INFO:teuthology.orchestra.run.smithi101.stdout: { 2023-08-01T19:55:17.260 INFO:teuthology.orchestra.run.smithi101.stdout: "event": "waiting for subops from 2", 2023-08-01T19:55:17.260 INFO:teuthology.orchestra.run.smithi101.stdout: "time": "2023-08-01T19:54:04.473622+0000", 2023-08-01T19:55:17.260 INFO:teuthology.orchestra.run.smithi101.stdout: "duration": 0.00014154799999999999 2023-08-01T19:55:17.260 INFO:teuthology.orchestra.run.smithi101.stdout: }, 2023-08-01T19:55:17.260 INFO:teuthology.orchestra.run.smithi101.stdout: { 2023-08-01T19:55:17.260 INFO:teuthology.orchestra.run.smithi101.stdout: "event": "op_commit", 2023-08-01T19:55:17.261 INFO:teuthology.orchestra.run.smithi101.stdout: "time": "2023-08-01T19:54:04.478281+0000", 2023-08-01T19:55:17.261 INFO:teuthology.orchestra.run.smithi101.stdout: "duration": 0.004659252 2023-08-01T19:55:17.261 INFO:teuthology.orchestra.run.smithi101.stdout: }, 2023-08-01T19:55:17.261 INFO:teuthology.orchestra.run.smithi101.stdout: { 2023-08-01T19:55:17.261 INFO:teuthology.orchestra.run.smithi101.stdout: "event": "sub_op_commit_rec", 2023-08-01T19:55:17.261 INFO:teuthology.orchestra.run.smithi101.stdout: "time": "2023-08-01T19:54:04.480180+0000", 2023-08-01T19:55:17.261 INFO:teuthology.orchestra.run.smithi101.stdout: "duration": 0.0018986859999999999 2023-08-01T19:55:17.261 INFO:teuthology.orchestra.run.smithi101.stdout: }, 2023-08-01T19:55:17.262 INFO:teuthology.orchestra.run.smithi101.stdout: { 2023-08-01T19:55:17.262 INFO:teuthology.orchestra.run.smithi101.stdout: "event": "commit_sent", 2023-08-01T19:55:17.262 INFO:teuthology.orchestra.run.smithi101.stdout: "time": "2023-08-01T19:54:04.480209+0000", 2023-08-01T19:55:17.262 INFO:teuthology.orchestra.run.smithi101.stdout: "duration": 2.9244999999999999e-05 2023-08-01T19:55:17.262 INFO:teuthology.orchestra.run.smithi101.stdout: }, 2023-08-01T19:55:17.262 INFO:teuthology.orchestra.run.smithi101.stdout: { 2023-08-01T19:55:17.262 INFO:teuthology.orchestra.run.smithi101.stdout: "event": "done", 2023-08-01T19:55:17.262 INFO:teuthology.orchestra.run.smithi101.stdout: "time": "2023-08-01T19:54:04.480244+0000", 2023-08-01T19:55:17.263 INFO:teuthology.orchestra.run.smithi101.stdout: "duration": 3.4875000000000001e-05 2023-08-01T19:55:17.263 INFO:teuthology.orchestra.run.smithi101.stdout: } 2023-08-01T19:55:17.263 INFO:teuthology.orchestra.run.smithi101.stdout: ] 2023-08-01T19:55:17.263 INFO:teuthology.orchestra.run.smithi101.stdout: } 2023-08-01T19:55:17.263 INFO:teuthology.orchestra.run.smithi101.stdout: }, 2023-08-01T19:55:17.263 INFO:teuthology.orchestra.run.smithi101.stdout: { 2023-08-01T19:55:17.263 INFO:teuthology.orchestra.run.smithi101.stdout: "description": "osd_op(mds.0.3:3 3.14 3:287034c4:::1.00000000.inode:head [writefull 0~554] snapc 0=[] ondisk+write+known_if_redirected+full_force+supports_pool_eio e17)", 2023-08-01T19:55:17.264 INFO:teuthology.orchestra.run.smithi101.stdout: "initiated_at": "2023-08-01T19:54:04.459226+0000", 2023-08-01T19:55:17.264 INFO:teuthology.orchestra.run.smithi101.stdout: "age": 72.755348386999998, 2023-08-01T19:55:17.264 INFO:teuthology.orchestra.run.smithi101.stdout: "duration": 0.021104531999999999, 2023-08-01T19:55:17.264 INFO:teuthology.orchestra.run.smithi101.stdout: "type_data": { 2023-08-01T19:55:17.264 INFO:teuthology.orchestra.run.smithi101.stdout: "flag_point": "commit sent; apply or cleanup", 2023-08-01T19:55:17.264 INFO:teuthology.orchestra.run.smithi101.stdout: "events": [ 2023-08-01T19:55:17.264 INFO:teuthology.orchestra.run.smithi101.stdout: { 2023-08-01T19:55:17.264 INFO:teuthology.orchestra.run.smithi101.stdout: "event": "initiated", 2023-08-01T19:55:17.265 INFO:teuthology.orchestra.run.smithi101.stdout: "time": "2023-08-01T19:54:04.459226+0000", 2023-08-01T19:55:17.265 INFO:teuthology.orchestra.run.smithi101.stdout: "duration": 0 2023-08-01T19:55:17.265 INFO:teuthology.orchestra.run.smithi101.stdout: }, 2023-08-01T19:55:17.265 INFO:teuthology.orchestra.run.smithi101.stdout: { 2023-08-01T19:55:17.265 INFO:teuthology.orchestra.run.smithi101.stdout: "event": "throttled", 2023-08-01T19:55:17.265 INFO:teuthology.orchestra.run.smithi101.stdout: "time": "2023-08-01T19:54:04.459226+0000", 2023-08-01T19:55:17.265 INFO:teuthology.orchestra.run.smithi101.stdout: "duration": 0 2023-08-01T19:55:17.265 INFO:teuthology.orchestra.run.smithi101.stdout: }, 2023-08-01T19:55:17.266 INFO:teuthology.orchestra.run.smithi101.stdout: { 2023-08-01T19:55:17.266 INFO:teuthology.orchestra.run.smithi101.stdout: "event": "header_read", 2023-08-01T19:55:17.266 INFO:teuthology.orchestra.run.smithi101.stdout: "time": "2023-08-01T19:54:04.459225+0000", 2023-08-01T19:55:17.266 INFO:teuthology.orchestra.run.smithi101.stdout: "duration": 4294967295.9999995 2023-08-01T19:55:17.266 INFO:teuthology.orchestra.run.smithi101.stdout: }, 2023-08-01T19:55:17.266 INFO:teuthology.orchestra.run.smithi101.stdout: { 2023-08-01T19:55:17.266 INFO:teuthology.orchestra.run.smithi101.stdout: "event": "all_read", 2023-08-01T19:55:17.266 INFO:teuthology.orchestra.run.smithi101.stdout: "time": "2023-08-01T19:54:04.459238+0000", 2023-08-01T19:55:17.267 INFO:teuthology.orchestra.run.smithi101.stdout: "duration": 1.2809000000000001e-05 2023-08-01T19:55:17.267 INFO:teuthology.orchestra.run.smithi101.stdout: }, 2023-08-01T19:55:17.267 INFO:teuthology.orchestra.run.smithi101.stdout: { 2023-08-01T19:55:17.267 INFO:teuthology.orchestra.run.smithi101.stdout: "event": "dispatched", 2023-08-01T19:55:17.267 INFO:teuthology.orchestra.run.smithi101.stdout: "time": "2023-08-01T19:54:04.459245+0000", 2023-08-01T19:55:17.267 INFO:teuthology.orchestra.run.smithi101.stdout: "duration": 6.6540000000000002e-06 2023-08-01T19:55:17.267 INFO:teuthology.orchestra.run.smithi101.stdout: }, 2023-08-01T19:55:17.268 INFO:teuthology.orchestra.run.smithi101.stdout: { 2023-08-01T19:55:17.268 INFO:teuthology.orchestra.run.smithi101.stdout: "event": "queued_for_pg", 2023-08-01T19:55:17.268 INFO:teuthology.orchestra.run.smithi101.stdout: "time": "2023-08-01T19:54:04.459249+0000", 2023-08-01T19:55:17.268 INFO:teuthology.orchestra.run.smithi101.stdout: "duration": 4.6e-06 2023-08-01T19:55:17.268 INFO:teuthology.orchestra.run.smithi101.stdout: }, 2023-08-01T19:55:17.268 INFO:teuthology.orchestra.run.smithi101.stdout: { 2023-08-01T19:55:17.268 INFO:teuthology.orchestra.run.smithi101.stdout: "event": "reached_pg", 2023-08-01T19:55:17.268 INFO:teuthology.orchestra.run.smithi101.stdout: "time": "2023-08-01T19:54:04.459276+0000", 2023-08-01T19:55:17.269 INFO:teuthology.orchestra.run.smithi101.stdout: "duration": 2.6373999999999999e-05 2023-08-01T19:55:17.269 INFO:teuthology.orchestra.run.smithi101.stdout: }, 2023-08-01T19:55:17.269 INFO:teuthology.orchestra.run.smithi101.stdout: { 2023-08-01T19:55:17.269 INFO:teuthology.orchestra.run.smithi101.stdout: "event": "waiting_for_map not empty", 2023-08-01T19:55:17.269 INFO:teuthology.orchestra.run.smithi101.stdout: "time": "2023-08-01T19:54:04.459278+0000", 2023-08-01T19:55:17.269 INFO:teuthology.orchestra.run.smithi101.stdout: "duration": 2.4980000000000001e-06 2023-08-01T19:55:17.269 INFO:teuthology.orchestra.run.smithi101.stdout: }, 2023-08-01T19:55:17.269 INFO:teuthology.orchestra.run.smithi101.stdout: { 2023-08-01T19:55:17.270 INFO:teuthology.orchestra.run.smithi101.stdout: "event": "reached_pg", 2023-08-01T19:55:17.270 INFO:teuthology.orchestra.run.smithi101.stdout: "time": "2023-08-01T19:54:04.474058+0000", 2023-08-01T19:55:17.270 INFO:teuthology.orchestra.run.smithi101.stdout: "duration": 0.014779979 2023-08-01T19:55:17.270 INFO:teuthology.orchestra.run.smithi101.stdout: }, 2023-08-01T19:55:17.270 INFO:teuthology.orchestra.run.smithi101.stdout: { 2023-08-01T19:55:17.270 INFO:teuthology.orchestra.run.smithi101.stdout: "event": "started", 2023-08-01T19:55:17.270 INFO:teuthology.orchestra.run.smithi101.stdout: "time": "2023-08-01T19:54:04.474614+0000", 2023-08-01T19:55:17.271 INFO:teuthology.orchestra.run.smithi101.stdout: "duration": 0.00055546899999999995 2023-08-01T19:55:17.271 INFO:teuthology.orchestra.run.smithi101.stdout: }, 2023-08-01T19:55:17.271 INFO:teuthology.orchestra.run.smithi101.stdout: { 2023-08-01T19:55:17.271 INFO:teuthology.orchestra.run.smithi101.stdout: "event": "waiting for subops from 2", 2023-08-01T19:55:17.271 INFO:teuthology.orchestra.run.smithi101.stdout: "time": "2023-08-01T19:54:04.474720+0000", 2023-08-01T19:55:17.271 INFO:teuthology.orchestra.run.smithi101.stdout: "duration": 0.00010645300000000001 2023-08-01T19:55:17.271 INFO:teuthology.orchestra.run.smithi101.stdout: }, 2023-08-01T19:55:17.271 INFO:teuthology.orchestra.run.smithi101.stdout: { 2023-08-01T19:55:17.272 INFO:teuthology.orchestra.run.smithi101.stdout: "event": "op_commit", 2023-08-01T19:55:17.272 INFO:teuthology.orchestra.run.smithi101.stdout: "time": "2023-08-01T19:54:04.478480+0000", 2023-08-01T19:55:17.272 INFO:teuthology.orchestra.run.smithi101.stdout: "duration": 0.0037600279999999999 2023-08-01T19:55:17.272 INFO:teuthology.orchestra.run.smithi101.stdout: }, 2023-08-01T19:55:17.272 INFO:teuthology.orchestra.run.smithi101.stdout: { 2023-08-01T19:55:17.272 INFO:teuthology.orchestra.run.smithi101.stdout: "event": "sub_op_commit_rec", 2023-08-01T19:55:17.272 INFO:teuthology.orchestra.run.smithi101.stdout: "time": "2023-08-01T19:54:04.480273+0000", 2023-08-01T19:55:17.273 INFO:teuthology.orchestra.run.smithi101.stdout: "duration": 0.001792465 2023-08-01T19:55:17.273 INFO:teuthology.orchestra.run.smithi101.stdout: }, 2023-08-01T19:55:17.273 INFO:teuthology.orchestra.run.smithi101.stdout: { 2023-08-01T19:55:17.273 INFO:teuthology.orchestra.run.smithi101.stdout: "event": "commit_sent", 2023-08-01T19:55:17.273 INFO:teuthology.orchestra.run.smithi101.stdout: "time": "2023-08-01T19:54:04.480304+0000", 2023-08-01T19:55:17.273 INFO:teuthology.orchestra.run.smithi101.stdout: "duration": 3.1708999999999997e-05 2023-08-01T19:55:17.273 INFO:teuthology.orchestra.run.smithi101.stdout: }, 2023-08-01T19:55:17.274 INFO:teuthology.orchestra.run.smithi101.stdout: { 2023-08-01T19:55:17.274 INFO:teuthology.orchestra.run.smithi101.stdout: "event": "done", 2023-08-01T19:55:17.274 INFO:teuthology.orchestra.run.smithi101.stdout: "time": "2023-08-01T19:54:04.480330+0000", 2023-08-01T19:55:17.274 INFO:teuthology.orchestra.run.smithi101.stdout: "duration": 2.5860999999999999e-05 2023-08-01T19:55:17.274 INFO:teuthology.orchestra.run.smithi101.stdout: } 2023-08-01T19:55:17.274 INFO:teuthology.orchestra.run.smithi101.stdout: ] 2023-08-01T19:55:17.274 INFO:teuthology.orchestra.run.smithi101.stdout: } 2023-08-01T19:55:17.274 INFO:teuthology.orchestra.run.smithi101.stdout: }, 2023-08-01T19:55:17.275 INFO:teuthology.orchestra.run.smithi101.stdout: { 2023-08-01T19:55:17.275 INFO:teuthology.orchestra.run.smithi101.stdout: "description": "osd_op(mds.0.3:32 3.14 3:2e2fa760:::200.00000001:head [delete] snapc 0=[] ondisk+write+known_if_redirected+full_force+supports_pool_eio e17)", 2023-08-01T19:55:17.275 INFO:teuthology.orchestra.run.smithi101.stdout: "initiated_at": "2023-08-01T19:54:04.459304+0000", 2023-08-01T19:55:17.275 INFO:teuthology.orchestra.run.smithi101.stdout: "age": 72.755269725999995, 2023-08-01T19:55:17.275 INFO:teuthology.orchestra.run.smithi101.stdout: "duration": 0.021110606000000001, 2023-08-01T19:55:17.275 INFO:teuthology.orchestra.run.smithi101.stdout: "type_data": { 2023-08-01T19:55:17.275 INFO:teuthology.orchestra.run.smithi101.stdout: "flag_point": "started", 2023-08-01T19:55:17.275 INFO:teuthology.orchestra.run.smithi101.stdout: "events": [ 2023-08-01T19:55:17.276 INFO:teuthology.orchestra.run.smithi101.stdout: { 2023-08-01T19:55:17.276 INFO:teuthology.orchestra.run.smithi101.stdout: "event": "initiated", 2023-08-01T19:55:17.276 INFO:teuthology.orchestra.run.smithi101.stdout: "time": "2023-08-01T19:54:04.459304+0000", 2023-08-01T19:55:17.276 INFO:teuthology.orchestra.run.smithi101.stdout: "duration": 0 2023-08-01T19:55:17.276 INFO:teuthology.orchestra.run.smithi101.stdout: }, 2023-08-01T19:55:17.276 INFO:teuthology.orchestra.run.smithi101.stdout: { 2023-08-01T19:55:17.276 INFO:teuthology.orchestra.run.smithi101.stdout: "event": "throttled", 2023-08-01T19:55:17.277 INFO:teuthology.orchestra.run.smithi101.stdout: "time": "2023-08-01T19:54:04.459304+0000", 2023-08-01T19:55:17.277 INFO:teuthology.orchestra.run.smithi101.stdout: "duration": 0 2023-08-01T19:55:17.277 INFO:teuthology.orchestra.run.smithi101.stdout: }, 2023-08-01T19:55:17.277 INFO:teuthology.orchestra.run.smithi101.stdout: { 2023-08-01T19:55:17.277 INFO:teuthology.orchestra.run.smithi101.stdout: "event": "header_read", 2023-08-01T19:55:17.277 INFO:teuthology.orchestra.run.smithi101.stdout: "time": "2023-08-01T19:54:04.459304+0000", 2023-08-01T19:55:17.277 INFO:teuthology.orchestra.run.smithi101.stdout: "duration": 4294967295.9999995 2023-08-01T19:55:17.277 INFO:teuthology.orchestra.run.smithi101.stdout: }, 2023-08-01T19:55:17.278 INFO:teuthology.orchestra.run.smithi101.stdout: { 2023-08-01T19:55:17.278 INFO:teuthology.orchestra.run.smithi101.stdout: "event": "all_read", 2023-08-01T19:55:17.278 INFO:teuthology.orchestra.run.smithi101.stdout: "time": "2023-08-01T19:54:04.459306+0000", 2023-08-01T19:55:17.278 INFO:teuthology.orchestra.run.smithi101.stdout: "duration": 2.3889999999999999e-06 2023-08-01T19:55:17.278 INFO:teuthology.orchestra.run.smithi101.stdout: }, 2023-08-01T19:55:17.278 INFO:teuthology.orchestra.run.smithi101.stdout: { 2023-08-01T19:55:17.278 INFO:teuthology.orchestra.run.smithi101.stdout: "event": "dispatched", 2023-08-01T19:55:17.278 INFO:teuthology.orchestra.run.smithi101.stdout: "time": "2023-08-01T19:54:04.459314+0000", 2023-08-01T19:55:17.279 INFO:teuthology.orchestra.run.smithi101.stdout: "duration": 7.1180000000000003e-06 2023-08-01T19:55:17.279 INFO:teuthology.orchestra.run.smithi101.stdout: }, 2023-08-01T19:55:17.279 INFO:teuthology.orchestra.run.smithi101.stdout: { 2023-08-01T19:55:17.279 INFO:teuthology.orchestra.run.smithi101.stdout: "event": "queued_for_pg", 2023-08-01T19:55:17.279 INFO:teuthology.orchestra.run.smithi101.stdout: "time": "2023-08-01T19:54:04.459318+0000", 2023-08-01T19:55:17.279 INFO:teuthology.orchestra.run.smithi101.stdout: "duration": 4.0239999999999999e-06 2023-08-01T19:55:17.279 INFO:teuthology.orchestra.run.smithi101.stdout: }, 2023-08-01T19:55:17.279 INFO:teuthology.orchestra.run.smithi101.stdout: { 2023-08-01T19:55:17.280 INFO:teuthology.orchestra.run.smithi101.stdout: "event": "reached_pg", 2023-08-01T19:55:17.280 INFO:teuthology.orchestra.run.smithi101.stdout: "time": "2023-08-01T19:54:04.459340+0000", 2023-08-01T19:55:17.280 INFO:teuthology.orchestra.run.smithi101.stdout: "duration": 2.2476e-05 2023-08-01T19:55:17.280 INFO:teuthology.orchestra.run.smithi101.stdout: }, 2023-08-01T19:55:17.280 INFO:teuthology.orchestra.run.smithi101.stdout: { 2023-08-01T19:55:17.280 INFO:teuthology.orchestra.run.smithi101.stdout: "event": "waiting_for_map not empty", 2023-08-01T19:55:17.280 INFO:teuthology.orchestra.run.smithi101.stdout: "time": "2023-08-01T19:54:04.459342+0000", 2023-08-01T19:55:17.281 INFO:teuthology.orchestra.run.smithi101.stdout: "duration": 2.272e-06 2023-08-01T19:55:17.281 INFO:teuthology.orchestra.run.smithi101.stdout: }, 2023-08-01T19:55:17.281 INFO:teuthology.orchestra.run.smithi101.stdout: { 2023-08-01T19:55:17.281 INFO:teuthology.orchestra.run.smithi101.stdout: "event": "reached_pg", 2023-08-01T19:55:17.281 INFO:teuthology.orchestra.run.smithi101.stdout: "time": "2023-08-01T19:54:04.475922+0000", 2023-08-01T19:55:17.281 INFO:teuthology.orchestra.run.smithi101.stdout: "duration": 0.016579388 2023-08-01T19:55:17.281 INFO:teuthology.orchestra.run.smithi101.stdout: }, 2023-08-01T19:55:17.282 INFO:teuthology.orchestra.run.smithi101.stdout: { 2023-08-01T19:55:17.282 INFO:teuthology.orchestra.run.smithi101.stdout: "event": "started", 2023-08-01T19:55:17.282 INFO:teuthology.orchestra.run.smithi101.stdout: "time": "2023-08-01T19:54:04.476107+0000", 2023-08-01T19:55:17.282 INFO:teuthology.orchestra.run.smithi101.stdout: "duration": 0.00018486300000000001 2023-08-01T19:55:17.282 INFO:teuthology.orchestra.run.smithi101.stdout: }, 2023-08-01T19:55:17.282 INFO:teuthology.orchestra.run.smithi101.stdout: { 2023-08-01T19:55:17.282 INFO:teuthology.orchestra.run.smithi101.stdout: "event": "done", 2023-08-01T19:55:17.282 INFO:teuthology.orchestra.run.smithi101.stdout: "time": "2023-08-01T19:54:04.480415+0000", 2023-08-01T19:55:17.283 INFO:teuthology.orchestra.run.smithi101.stdout: "duration": 0.0043084589999999997 2023-08-01T19:55:17.283 INFO:teuthology.orchestra.run.smithi101.stdout: } 2023-08-01T19:55:17.283 INFO:teuthology.orchestra.run.smithi101.stdout: ] 2023-08-01T19:55:17.283 INFO:teuthology.orchestra.run.smithi101.stdout: } 2023-08-01T19:55:17.283 INFO:teuthology.orchestra.run.smithi101.stdout: }, 2023-08-01T19:55:17.283 INFO:teuthology.orchestra.run.smithi101.stdout: { 2023-08-01T19:55:17.283 INFO:teuthology.orchestra.run.smithi101.stdout: "description": "osd_op(client.4668.0:70878 5.2 5:49b7d2be:::benchmark_data_smithi006_114134_object70877:head [set-alloc-hint object_size 65536 write_size 65536,write 0~65536] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e30)", 2023-08-01T19:55:17.283 INFO:teuthology.orchestra.run.smithi101.stdout: "initiated_at": "2023-08-01T19:54:50.210223+0000", 2023-08-01T19:55:17.284 INFO:teuthology.orchestra.run.smithi101.stdout: "age": 27.004351155999998, 2023-08-01T19:55:17.284 INFO:teuthology.orchestra.run.smithi101.stdout: "duration": 0.019884895, 2023-08-01T19:55:17.284 INFO:teuthology.orchestra.run.smithi101.stdout: "type_data": { 2023-08-01T19:55:17.284 INFO:teuthology.orchestra.run.smithi101.stdout: "flag_point": "commit sent; apply or cleanup", 2023-08-01T19:55:17.284 INFO:teuthology.orchestra.run.smithi101.stdout: "client_info": { 2023-08-01T19:55:17.284 INFO:teuthology.orchestra.run.smithi101.stdout: "client": "client.4668", 2023-08-01T19:55:17.284 INFO:teuthology.orchestra.run.smithi101.stdout: "client_addr": "172.21.15.6:0/1709472247", 2023-08-01T19:55:17.285 INFO:teuthology.orchestra.run.smithi101.stdout: "tid": 70878 2023-08-01T19:55:17.285 INFO:teuthology.orchestra.run.smithi101.stdout: }, 2023-08-01T19:55:17.285 INFO:teuthology.orchestra.run.smithi101.stdout: "events": [ 2023-08-01T19:55:17.285 INFO:teuthology.orchestra.run.smithi101.stdout: { 2023-08-01T19:55:17.285 INFO:teuthology.orchestra.run.smithi101.stdout: "event": "initiated", 2023-08-01T19:55:17.285 INFO:teuthology.orchestra.run.smithi101.stdout: "time": "2023-08-01T19:54:50.210223+0000", 2023-08-01T19:55:17.285 INFO:teuthology.orchestra.run.smithi101.stdout: "duration": 0 2023-08-01T19:55:17.285 INFO:teuthology.orchestra.run.smithi101.stdout: }, 2023-08-01T19:55:17.286 INFO:teuthology.orchestra.run.smithi101.stdout: { 2023-08-01T19:55:17.286 INFO:teuthology.orchestra.run.smithi101.stdout: "event": "throttled", 2023-08-01T19:55:17.286 INFO:teuthology.orchestra.run.smithi101.stdout: "time": "2023-08-01T19:54:50.210223+0000", 2023-08-01T19:55:17.286 INFO:teuthology.orchestra.run.smithi101.stdout: "duration": 0 2023-08-01T19:55:17.286 INFO:teuthology.orchestra.run.smithi101.stdout: }, 2023-08-01T19:55:17.286 INFO:teuthology.orchestra.run.smithi101.stdout: { 2023-08-01T19:55:17.286 INFO:teuthology.orchestra.run.smithi101.stdout: "event": "header_read", 2023-08-01T19:55:17.286 INFO:teuthology.orchestra.run.smithi101.stdout: "time": "2023-08-01T19:54:50.210222+0000", 2023-08-01T19:55:17.287 INFO:teuthology.orchestra.run.smithi101.stdout: "duration": 4294967295.999999 2023-08-01T19:55:17.287 INFO:teuthology.orchestra.run.smithi101.stdout: }, 2023-08-01T19:55:17.287 INFO:teuthology.orchestra.run.smithi101.stdout: { 2023-08-01T19:55:17.287 INFO:teuthology.orchestra.run.smithi101.stdout: "event": "all_read", 2023-08-01T19:55:17.287 INFO:teuthology.orchestra.run.smithi101.stdout: "time": "2023-08-01T19:54:50.210315+0000", 2023-08-01T19:55:17.287 INFO:teuthology.orchestra.run.smithi101.stdout: "duration": 9.2567999999999999e-05 2023-08-01T19:55:17.287 INFO:teuthology.orchestra.run.smithi101.stdout: }, 2023-08-01T19:55:17.287 INFO:teuthology.orchestra.run.smithi101.stdout: { 2023-08-01T19:55:17.288 INFO:teuthology.orchestra.run.smithi101.stdout: "event": "dispatched", 2023-08-01T19:55:17.288 INFO:teuthology.orchestra.run.smithi101.stdout: "time": "2023-08-01T19:54:50.210326+0000", 2023-08-01T19:55:17.288 INFO:teuthology.orchestra.run.smithi101.stdout: "duration": 1.1430000000000001e-05 2023-08-01T19:55:17.288 INFO:teuthology.orchestra.run.smithi101.stdout: }, 2023-08-01T19:55:17.288 INFO:teuthology.orchestra.run.smithi101.stdout: { 2023-08-01T19:55:17.288 INFO:teuthology.orchestra.run.smithi101.stdout: "event": "queued_for_pg", 2023-08-01T19:55:17.288 INFO:teuthology.orchestra.run.smithi101.stdout: "time": "2023-08-01T19:54:50.210332+0000", 2023-08-01T19:55:17.289 INFO:teuthology.orchestra.run.smithi101.stdout: "duration": 5.8479999999999997e-06 2023-08-01T19:55:17.289 INFO:teuthology.orchestra.run.smithi101.stdout: }, 2023-08-01T19:55:17.289 INFO:teuthology.orchestra.run.smithi101.stdout: { 2023-08-01T19:55:17.289 INFO:teuthology.orchestra.run.smithi101.stdout: "event": "reached_pg", 2023-08-01T19:55:17.289 INFO:teuthology.orchestra.run.smithi101.stdout: "time": "2023-08-01T19:54:50.214259+0000", 2023-08-01T19:55:17.289 INFO:teuthology.orchestra.run.smithi101.stdout: "duration": 0.003926789 2023-08-01T19:55:17.289 INFO:teuthology.orchestra.run.smithi101.stdout: }, 2023-08-01T19:55:17.289 INFO:teuthology.orchestra.run.smithi101.stdout: { 2023-08-01T19:55:17.290 INFO:teuthology.orchestra.run.smithi101.stdout: "event": "started", 2023-08-01T19:55:17.290 INFO:teuthology.orchestra.run.smithi101.stdout: "time": "2023-08-01T19:54:50.214387+0000", 2023-08-01T19:55:17.290 INFO:teuthology.orchestra.run.smithi101.stdout: "duration": 0.00012787599999999999 2023-08-01T19:55:17.290 INFO:teuthology.orchestra.run.smithi101.stdout: }, 2023-08-01T19:55:17.290 INFO:teuthology.orchestra.run.smithi101.stdout: { 2023-08-01T19:55:17.290 INFO:teuthology.orchestra.run.smithi101.stdout: "event": "waiting for subops from 0", 2023-08-01T19:55:17.290 INFO:teuthology.orchestra.run.smithi101.stdout: "time": "2023-08-01T19:54:50.214536+0000", 2023-08-01T19:55:17.290 INFO:teuthology.orchestra.run.smithi101.stdout: "duration": 0.00014935299999999999 2023-08-01T19:55:17.291 INFO:teuthology.orchestra.run.smithi101.stdout: }, 2023-08-01T19:55:17.291 INFO:teuthology.orchestra.run.smithi101.stdout: { 2023-08-01T19:55:17.291 INFO:teuthology.orchestra.run.smithi101.stdout: "event": "op_commit", 2023-08-01T19:55:17.291 INFO:teuthology.orchestra.run.smithi101.stdout: "time": "2023-08-01T19:54:50.217739+0000", 2023-08-01T19:55:17.291 INFO:teuthology.orchestra.run.smithi101.stdout: "duration": 0.0032034619999999998 2023-08-01T19:55:17.291 INFO:teuthology.orchestra.run.smithi101.stdout: }, 2023-08-01T19:55:17.291 INFO:teuthology.orchestra.run.smithi101.stdout: { 2023-08-01T19:55:17.291 INFO:teuthology.orchestra.run.smithi101.stdout: "event": "sub_op_commit_rec", 2023-08-01T19:55:17.292 INFO:teuthology.orchestra.run.smithi101.stdout: "time": "2023-08-01T19:54:50.230032+0000", 2023-08-01T19:55:17.292 INFO:teuthology.orchestra.run.smithi101.stdout: "duration": 0.012293068000000001 2023-08-01T19:55:17.292 INFO:teuthology.orchestra.run.smithi101.stdout: }, 2023-08-01T19:55:17.292 INFO:teuthology.orchestra.run.smithi101.stdout: { 2023-08-01T19:55:17.292 INFO:teuthology.orchestra.run.smithi101.stdout: "event": "commit_sent", 2023-08-01T19:55:17.292 INFO:teuthology.orchestra.run.smithi101.stdout: "time": "2023-08-01T19:54:50.230075+0000", 2023-08-01T19:55:17.292 INFO:teuthology.orchestra.run.smithi101.stdout: "duration": 4.3062999999999997e-05 2023-08-01T19:55:17.292 INFO:teuthology.orchestra.run.smithi101.stdout: }, 2023-08-01T19:55:17.293 INFO:teuthology.orchestra.run.smithi101.stdout: { 2023-08-01T19:55:17.293 INFO:teuthology.orchestra.run.smithi101.stdout: "event": "done", 2023-08-01T19:55:17.293 INFO:teuthology.orchestra.run.smithi101.stdout: "time": "2023-08-01T19:54:50.230108+0000", 2023-08-01T19:55:17.293 INFO:teuthology.orchestra.run.smithi101.stdout: "duration": 3.2366999999999997e-05 2023-08-01T19:55:17.293 INFO:teuthology.orchestra.run.smithi101.stdout: } 2023-08-01T19:55:17.293 INFO:teuthology.orchestra.run.smithi101.stdout: ] 2023-08-01T19:55:17.293 INFO:teuthology.orchestra.run.smithi101.stdout: } 2023-08-01T19:55:17.294 INFO:teuthology.orchestra.run.smithi101.stdout: }, 2023-08-01T19:55:17.294 INFO:teuthology.orchestra.run.smithi101.stdout: { 2023-08-01T19:55:17.294 INFO:teuthology.orchestra.run.smithi101.stdout: "description": "osd_op(client.4668.0:73460 5.f 5:ff4f0704:::benchmark_data_smithi006_114134_object73459:head [set-alloc-hint object_size 65536 write_size 65536,write 0~65536] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e31)", 2023-08-01T19:55:17.294 INFO:teuthology.orchestra.run.smithi101.stdout: "initiated_at": "2023-08-01T19:54:51.462968+0000", 2023-08-01T19:55:17.294 INFO:teuthology.orchestra.run.smithi101.stdout: "age": 25.751606277, 2023-08-01T19:55:17.294 INFO:teuthology.orchestra.run.smithi101.stdout: "duration": 0.020056502, 2023-08-01T19:55:17.294 INFO:teuthology.orchestra.run.smithi101.stdout: "type_data": { 2023-08-01T19:55:17.294 INFO:teuthology.orchestra.run.smithi101.stdout: "flag_point": "commit sent; apply or cleanup", 2023-08-01T19:55:17.295 INFO:teuthology.orchestra.run.smithi101.stdout: "client_info": { 2023-08-01T19:55:17.295 INFO:teuthology.orchestra.run.smithi101.stdout: "client": "client.4668", 2023-08-01T19:55:17.295 INFO:teuthology.orchestra.run.smithi101.stdout: "client_addr": "172.21.15.6:0/1709472247", 2023-08-01T19:55:17.295 INFO:teuthology.orchestra.run.smithi101.stdout: "tid": 73460 2023-08-01T19:55:17.295 INFO:teuthology.orchestra.run.smithi101.stdout: }, 2023-08-01T19:55:17.295 INFO:teuthology.orchestra.run.smithi101.stdout: "events": [ 2023-08-01T19:55:17.295 INFO:teuthology.orchestra.run.smithi101.stdout: { 2023-08-01T19:55:17.295 INFO:teuthology.orchestra.run.smithi101.stdout: "event": "initiated", 2023-08-01T19:55:17.296 INFO:teuthology.orchestra.run.smithi101.stdout: "time": "2023-08-01T19:54:51.462968+0000", 2023-08-01T19:55:17.296 INFO:teuthology.orchestra.run.smithi101.stdout: "duration": 0 2023-08-01T19:55:17.296 INFO:teuthology.orchestra.run.smithi101.stdout: }, 2023-08-01T19:55:17.296 INFO:teuthology.orchestra.run.smithi101.stdout: { 2023-08-01T19:55:17.296 INFO:teuthology.orchestra.run.smithi101.stdout: "event": "throttled", 2023-08-01T19:55:17.296 INFO:teuthology.orchestra.run.smithi101.stdout: "time": "2023-08-01T19:54:51.462968+0000", 2023-08-01T19:55:17.296 INFO:teuthology.orchestra.run.smithi101.stdout: "duration": 0 2023-08-01T19:55:17.297 INFO:teuthology.orchestra.run.smithi101.stdout: }, 2023-08-01T19:55:17.297 INFO:teuthology.orchestra.run.smithi101.stdout: { 2023-08-01T19:55:17.297 INFO:teuthology.orchestra.run.smithi101.stdout: "event": "header_read", 2023-08-01T19:55:17.301 INFO:teuthology.orchestra.run.smithi101.stdout: "time": "2023-08-01T19:54:51.462967+0000", 2023-08-01T19:55:17.301 INFO:teuthology.orchestra.run.smithi101.stdout: "duration": 4294967295.999999 2023-08-01T19:55:17.301 INFO:teuthology.orchestra.run.smithi101.stdout: }, 2023-08-01T19:55:17.301 INFO:teuthology.orchestra.run.smithi101.stdout: { 2023-08-01T19:55:17.301 INFO:teuthology.orchestra.run.smithi101.stdout: "event": "all_read", 2023-08-01T19:55:17.301 INFO:teuthology.orchestra.run.smithi101.stdout: "time": "2023-08-01T19:54:51.463009+0000", 2023-08-01T19:55:17.301 INFO:teuthology.orchestra.run.smithi101.stdout: "duration": 4.2106e-05 2023-08-01T19:55:17.302 INFO:teuthology.orchestra.run.smithi101.stdout: }, 2023-08-01T19:55:17.302 INFO:teuthology.orchestra.run.smithi101.stdout: { 2023-08-01T19:55:17.302 INFO:teuthology.orchestra.run.smithi101.stdout: "event": "dispatched", 2023-08-01T19:55:17.302 INFO:teuthology.orchestra.run.smithi101.stdout: "time": "2023-08-01T19:54:51.463017+0000", 2023-08-01T19:55:17.302 INFO:teuthology.orchestra.run.smithi101.stdout: "duration": 8.1529999999999997e-06 2023-08-01T19:55:17.302 INFO:teuthology.orchestra.run.smithi101.stdout: }, 2023-08-01T19:55:17.302 INFO:teuthology.orchestra.run.smithi101.stdout: { 2023-08-01T19:55:17.303 INFO:teuthology.orchestra.run.smithi101.stdout: "event": "queued_for_pg", 2023-08-01T19:55:17.303 INFO:teuthology.orchestra.run.smithi101.stdout: "time": "2023-08-01T19:54:51.463027+0000", 2023-08-01T19:55:17.303 INFO:teuthology.orchestra.run.smithi101.stdout: "duration": 9.5659999999999996e-06 2023-08-01T19:55:17.303 INFO:teuthology.orchestra.run.smithi101.stdout: }, 2023-08-01T19:55:17.303 INFO:teuthology.orchestra.run.smithi101.stdout: { 2023-08-01T19:55:17.303 INFO:teuthology.orchestra.run.smithi101.stdout: "event": "reached_pg", 2023-08-01T19:55:17.303 INFO:teuthology.orchestra.run.smithi101.stdout: "time": "2023-08-01T19:54:51.463062+0000", 2023-08-01T19:55:17.303 INFO:teuthology.orchestra.run.smithi101.stdout: "duration": 3.5442999999999999e-05 2023-08-01T19:55:17.304 INFO:teuthology.orchestra.run.smithi101.stdout: }, 2023-08-01T19:55:17.304 INFO:teuthology.orchestra.run.smithi101.stdout: { 2023-08-01T19:55:17.304 INFO:teuthology.orchestra.run.smithi101.stdout: "event": "started", 2023-08-01T19:55:17.304 INFO:teuthology.orchestra.run.smithi101.stdout: "time": "2023-08-01T19:54:51.463198+0000", 2023-08-01T19:55:17.304 INFO:teuthology.orchestra.run.smithi101.stdout: "duration": 0.000135628 2023-08-01T19:55:17.304 INFO:teuthology.orchestra.run.smithi101.stdout: }, 2023-08-01T19:55:17.304 INFO:teuthology.orchestra.run.smithi101.stdout: { 2023-08-01T19:55:17.305 INFO:teuthology.orchestra.run.smithi101.stdout: "event": "waiting for subops from 2", 2023-08-01T19:55:17.305 INFO:teuthology.orchestra.run.smithi101.stdout: "time": "2023-08-01T19:54:51.463341+0000", 2023-08-01T19:55:17.305 INFO:teuthology.orchestra.run.smithi101.stdout: "duration": 0.00014346500000000001 2023-08-01T19:55:17.305 INFO:teuthology.orchestra.run.smithi101.stdout: }, 2023-08-01T19:55:17.305 INFO:teuthology.orchestra.run.smithi101.stdout: { 2023-08-01T19:55:17.305 INFO:teuthology.orchestra.run.smithi101.stdout: "event": "op_commit", 2023-08-01T19:55:17.305 INFO:teuthology.orchestra.run.smithi101.stdout: "time": "2023-08-01T19:54:51.472684+0000", 2023-08-01T19:55:17.305 INFO:teuthology.orchestra.run.smithi101.stdout: "duration": 0.0093427900000000001 2023-08-01T19:55:17.306 INFO:teuthology.orchestra.run.smithi101.stdout: }, 2023-08-01T19:55:17.306 INFO:teuthology.orchestra.run.smithi101.stdout: { 2023-08-01T19:55:17.306 INFO:teuthology.orchestra.run.smithi101.stdout: "event": "sub_op_commit_rec", 2023-08-01T19:55:17.306 INFO:teuthology.orchestra.run.smithi101.stdout: "time": "2023-08-01T19:54:51.482937+0000", 2023-08-01T19:55:17.306 INFO:teuthology.orchestra.run.smithi101.stdout: "duration": 0.010252557000000001 2023-08-01T19:55:17.306 INFO:teuthology.orchestra.run.smithi101.stdout: }, 2023-08-01T19:55:17.306 INFO:teuthology.orchestra.run.smithi101.stdout: { 2023-08-01T19:55:17.306 INFO:teuthology.orchestra.run.smithi101.stdout: "event": "commit_sent", 2023-08-01T19:55:17.307 INFO:teuthology.orchestra.run.smithi101.stdout: "time": "2023-08-01T19:54:51.482984+0000", 2023-08-01T19:55:17.307 INFO:teuthology.orchestra.run.smithi101.stdout: "duration": 4.7394000000000001e-05 2023-08-01T19:55:17.307 INFO:teuthology.orchestra.run.smithi101.stdout: }, 2023-08-01T19:55:17.307 INFO:teuthology.orchestra.run.smithi101.stdout: { 2023-08-01T19:55:17.307 INFO:teuthology.orchestra.run.smithi101.stdout: "event": "done", 2023-08-01T19:55:17.307 INFO:teuthology.orchestra.run.smithi101.stdout: "time": "2023-08-01T19:54:51.483024+0000", 2023-08-01T19:55:17.307 INFO:teuthology.orchestra.run.smithi101.stdout: "duration": 4.0159e-05 2023-08-01T19:55:17.307 INFO:teuthology.orchestra.run.smithi101.stdout: } 2023-08-01T19:55:17.308 INFO:teuthology.orchestra.run.smithi101.stdout: ] 2023-08-01T19:55:17.308 INFO:teuthology.orchestra.run.smithi101.stdout: } 2023-08-01T19:55:17.308 INFO:teuthology.orchestra.run.smithi101.stdout: }, 2023-08-01T19:55:17.308 INFO:teuthology.orchestra.run.smithi101.stdout: { 2023-08-01T19:55:17.308 INFO:teuthology.orchestra.run.smithi101.stdout: "description": "osd_op(client.4668.0:92726 5.2 5:41e18163:::benchmark_data_smithi006_114134_object92725:head [set-alloc-hint object_size 65536 write_size 65536,write 0~65536] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e36)", 2023-08-01T19:55:17.308 INFO:teuthology.orchestra.run.smithi101.stdout: "initiated_at": "2023-08-01T19:55:01.256971+0000", 2023-08-01T19:55:17.308 INFO:teuthology.orchestra.run.smithi101.stdout: "age": 15.957603197999999, 2023-08-01T19:55:17.309 INFO:teuthology.orchestra.run.smithi101.stdout: "duration": 0.019854296, 2023-08-01T19:55:17.309 INFO:teuthology.orchestra.run.smithi101.stdout: "type_data": { 2023-08-01T19:55:17.309 INFO:teuthology.orchestra.run.smithi101.stdout: "flag_point": "commit sent; apply or cleanup", 2023-08-01T19:55:17.309 INFO:teuthology.orchestra.run.smithi101.stdout: "client_info": { 2023-08-01T19:55:17.309 INFO:teuthology.orchestra.run.smithi101.stdout: "client": "client.4668", 2023-08-01T19:55:17.309 INFO:teuthology.orchestra.run.smithi101.stdout: "client_addr": "172.21.15.6:0/1709472247", 2023-08-01T19:55:17.309 INFO:teuthology.orchestra.run.smithi101.stdout: "tid": 92726 2023-08-01T19:55:17.309 INFO:teuthology.orchestra.run.smithi101.stdout: }, 2023-08-01T19:55:17.310 INFO:teuthology.orchestra.run.smithi101.stdout: "events": [ 2023-08-01T19:55:17.310 INFO:teuthology.orchestra.run.smithi101.stdout: { 2023-08-01T19:55:17.310 INFO:teuthology.orchestra.run.smithi101.stdout: "event": "initiated", 2023-08-01T19:55:17.310 INFO:teuthology.orchestra.run.smithi101.stdout: "time": "2023-08-01T19:55:01.256971+0000", 2023-08-01T19:55:17.310 INFO:teuthology.orchestra.run.smithi101.stdout: "duration": 0 2023-08-01T19:55:17.310 INFO:teuthology.orchestra.run.smithi101.stdout: }, 2023-08-01T19:55:17.310 INFO:teuthology.orchestra.run.smithi101.stdout: { 2023-08-01T19:55:17.310 INFO:teuthology.orchestra.run.smithi101.stdout: "event": "throttled", 2023-08-01T19:55:17.311 INFO:teuthology.orchestra.run.smithi101.stdout: "time": "2023-08-01T19:55:01.256971+0000", 2023-08-01T19:55:17.311 INFO:teuthology.orchestra.run.smithi101.stdout: "duration": 0 2023-08-01T19:55:17.311 INFO:teuthology.orchestra.run.smithi101.stdout: }, 2023-08-01T19:55:17.311 INFO:teuthology.orchestra.run.smithi101.stdout: { 2023-08-01T19:55:17.311 INFO:teuthology.orchestra.run.smithi101.stdout: "event": "header_read", 2023-08-01T19:55:17.311 INFO:teuthology.orchestra.run.smithi101.stdout: "time": "2023-08-01T19:55:01.256970+0000", 2023-08-01T19:55:17.311 INFO:teuthology.orchestra.run.smithi101.stdout: "duration": 4294967295.9999995 2023-08-01T19:55:17.312 INFO:teuthology.orchestra.run.smithi101.stdout: }, 2023-08-01T19:55:17.312 INFO:teuthology.orchestra.run.smithi101.stdout: { 2023-08-01T19:55:17.312 INFO:teuthology.orchestra.run.smithi101.stdout: "event": "all_read", 2023-08-01T19:55:17.312 INFO:teuthology.orchestra.run.smithi101.stdout: "time": "2023-08-01T19:55:01.257057+0000", 2023-08-01T19:55:17.312 INFO:teuthology.orchestra.run.smithi101.stdout: "duration": 8.6627999999999998e-05 2023-08-01T19:55:17.313 INFO:teuthology.orchestra.run.smithi101.stdout: }, 2023-08-01T19:55:17.313 INFO:teuthology.orchestra.run.smithi101.stdout: { 2023-08-01T19:55:17.313 INFO:teuthology.orchestra.run.smithi101.stdout: "event": "dispatched", 2023-08-01T19:55:17.313 INFO:teuthology.orchestra.run.smithi101.stdout: "time": "2023-08-01T19:55:01.257063+0000", 2023-08-01T19:55:17.313 INFO:teuthology.orchestra.run.smithi101.stdout: "duration": 6.528e-06 2023-08-01T19:55:17.313 INFO:teuthology.orchestra.run.smithi101.stdout: }, 2023-08-01T19:55:17.313 INFO:teuthology.orchestra.run.smithi101.stdout: { 2023-08-01T19:55:17.313 INFO:teuthology.orchestra.run.smithi101.stdout: "event": "queued_for_pg", 2023-08-01T19:55:17.314 INFO:teuthology.orchestra.run.smithi101.stdout: "time": "2023-08-01T19:55:01.257067+0000", 2023-08-01T19:55:17.314 INFO:teuthology.orchestra.run.smithi101.stdout: "duration": 3.2739999999999999e-06 2023-08-01T19:55:17.314 INFO:teuthology.orchestra.run.smithi101.stdout: }, 2023-08-01T19:55:17.314 INFO:teuthology.orchestra.run.smithi101.stdout: { 2023-08-01T19:55:17.314 INFO:teuthology.orchestra.run.smithi101.stdout: "event": "reached_pg", 2023-08-01T19:55:17.314 INFO:teuthology.orchestra.run.smithi101.stdout: "time": "2023-08-01T19:55:01.259714+0000", 2023-08-01T19:55:17.314 INFO:teuthology.orchestra.run.smithi101.stdout: "duration": 0.0026476709999999999 2023-08-01T19:55:17.315 INFO:teuthology.orchestra.run.smithi101.stdout: }, 2023-08-01T19:55:17.315 INFO:teuthology.orchestra.run.smithi101.stdout: { 2023-08-01T19:55:17.315 INFO:teuthology.orchestra.run.smithi101.stdout: "event": "started", 2023-08-01T19:55:17.315 INFO:teuthology.orchestra.run.smithi101.stdout: "time": "2023-08-01T19:55:01.259829+0000", 2023-08-01T19:55:17.315 INFO:teuthology.orchestra.run.smithi101.stdout: "duration": 0.000114471 2023-08-01T19:55:17.315 INFO:teuthology.orchestra.run.smithi101.stdout: }, 2023-08-01T19:55:17.315 INFO:teuthology.orchestra.run.smithi101.stdout: { 2023-08-01T19:55:17.316 INFO:teuthology.orchestra.run.smithi101.stdout: "event": "waiting for subops from 0", 2023-08-01T19:55:17.316 INFO:teuthology.orchestra.run.smithi101.stdout: "time": "2023-08-01T19:55:01.259965+0000", 2023-08-01T19:55:17.316 INFO:teuthology.orchestra.run.smithi101.stdout: "duration": 0.00013597300000000001 2023-08-01T19:55:17.316 INFO:teuthology.orchestra.run.smithi101.stdout: }, 2023-08-01T19:55:17.316 INFO:teuthology.orchestra.run.smithi101.stdout: { 2023-08-01T19:55:17.316 INFO:teuthology.orchestra.run.smithi101.stdout: "event": "op_commit", 2023-08-01T19:55:17.316 INFO:teuthology.orchestra.run.smithi101.stdout: "time": "2023-08-01T19:55:01.264360+0000", 2023-08-01T19:55:17.317 INFO:teuthology.orchestra.run.smithi101.stdout: "duration": 0.0043956619999999998 2023-08-01T19:55:17.317 INFO:teuthology.orchestra.run.smithi101.stdout: }, 2023-08-01T19:55:17.317 INFO:teuthology.orchestra.run.smithi101.stdout: { 2023-08-01T19:55:17.317 INFO:teuthology.orchestra.run.smithi101.stdout: "event": "sub_op_commit_rec", 2023-08-01T19:55:17.317 INFO:teuthology.orchestra.run.smithi101.stdout: "time": "2023-08-01T19:55:01.276766+0000", 2023-08-01T19:55:17.317 INFO:teuthology.orchestra.run.smithi101.stdout: "duration": 0.012405736000000001 2023-08-01T19:55:17.317 INFO:teuthology.orchestra.run.smithi101.stdout: }, 2023-08-01T19:55:17.317 INFO:teuthology.orchestra.run.smithi101.stdout: { 2023-08-01T19:55:17.318 INFO:teuthology.orchestra.run.smithi101.stdout: "event": "commit_sent", 2023-08-01T19:55:17.318 INFO:teuthology.orchestra.run.smithi101.stdout: "time": "2023-08-01T19:55:01.276804+0000", 2023-08-01T19:55:17.318 INFO:teuthology.orchestra.run.smithi101.stdout: "duration": 3.7759999999999998e-05 2023-08-01T19:55:17.318 INFO:teuthology.orchestra.run.smithi101.stdout: }, 2023-08-01T19:55:17.318 INFO:teuthology.orchestra.run.smithi101.stdout: { 2023-08-01T19:55:17.318 INFO:teuthology.orchestra.run.smithi101.stdout: "event": "done", 2023-08-01T19:55:17.318 INFO:teuthology.orchestra.run.smithi101.stdout: "time": "2023-08-01T19:55:01.276825+0000", 2023-08-01T19:55:17.318 INFO:teuthology.orchestra.run.smithi101.stdout: "duration": 2.1299000000000001e-05 2023-08-01T19:55:17.319 INFO:teuthology.orchestra.run.smithi101.stdout: } 2023-08-01T19:55:17.319 INFO:teuthology.orchestra.run.smithi101.stdout: ] 2023-08-01T19:55:17.319 INFO:teuthology.orchestra.run.smithi101.stdout: } 2023-08-01T19:55:17.319 INFO:teuthology.orchestra.run.smithi101.stdout: }, 2023-08-01T19:55:17.319 INFO:teuthology.orchestra.run.smithi101.stdout: { 2023-08-01T19:55:17.319 INFO:teuthology.orchestra.run.smithi101.stdout: "description": "osd_op(client.4668.0:100244 5.9 5:92f56a12:::benchmark_data_smithi006_114134_object100243:head [set-alloc-hint object_size 65536 write_size 65536,write 0~65536] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e37)", 2023-08-01T19:55:17.319 INFO:teuthology.orchestra.run.smithi101.stdout: "initiated_at": "2023-08-01T19:55:05.150910+0000", 2023-08-01T19:55:17.320 INFO:teuthology.orchestra.run.smithi101.stdout: "age": 12.063664382000001, 2023-08-01T19:55:17.320 INFO:teuthology.orchestra.run.smithi101.stdout: "duration": 0.072864287, 2023-08-01T19:55:17.320 INFO:teuthology.orchestra.run.smithi101.stdout: "type_data": { 2023-08-01T19:55:17.320 INFO:teuthology.orchestra.run.smithi101.stdout: "flag_point": "commit sent; apply or cleanup", 2023-08-01T19:55:17.320 INFO:teuthology.orchestra.run.smithi101.stdout: "client_info": { 2023-08-01T19:55:17.320 INFO:teuthology.orchestra.run.smithi101.stdout: "client": "client.4668", 2023-08-01T19:55:17.320 INFO:teuthology.orchestra.run.smithi101.stdout: "client_addr": "172.21.15.6:0/1709472247", 2023-08-01T19:55:17.320 INFO:teuthology.orchestra.run.smithi101.stdout: "tid": 100244 2023-08-01T19:55:17.321 INFO:teuthology.orchestra.run.smithi101.stdout: }, 2023-08-01T19:55:17.321 INFO:teuthology.orchestra.run.smithi101.stdout: "events": [ 2023-08-01T19:55:17.321 INFO:teuthology.orchestra.run.smithi101.stdout: { 2023-08-01T19:55:17.321 INFO:teuthology.orchestra.run.smithi101.stdout: "event": "initiated", 2023-08-01T19:55:17.321 INFO:teuthology.orchestra.run.smithi101.stdout: "time": "2023-08-01T19:55:05.150910+0000", 2023-08-01T19:55:17.321 INFO:teuthology.orchestra.run.smithi101.stdout: "duration": 0 2023-08-01T19:55:17.321 INFO:teuthology.orchestra.run.smithi101.stdout: }, 2023-08-01T19:55:17.322 INFO:teuthology.orchestra.run.smithi101.stdout: { 2023-08-01T19:55:17.322 INFO:teuthology.orchestra.run.smithi101.stdout: "event": "throttled", 2023-08-01T19:55:17.322 INFO:teuthology.orchestra.run.smithi101.stdout: "time": "2023-08-01T19:55:05.150910+0000", 2023-08-01T19:55:17.322 INFO:teuthology.orchestra.run.smithi101.stdout: "duration": 0 2023-08-01T19:55:17.322 INFO:teuthology.orchestra.run.smithi101.stdout: }, 2023-08-01T19:55:17.322 INFO:teuthology.orchestra.run.smithi101.stdout: { 2023-08-01T19:55:17.322 INFO:teuthology.orchestra.run.smithi101.stdout: "event": "header_read", 2023-08-01T19:55:17.322 INFO:teuthology.orchestra.run.smithi101.stdout: "time": "2023-08-01T19:55:05.150909+0000", 2023-08-01T19:55:17.323 INFO:teuthology.orchestra.run.smithi101.stdout: "duration": 4294967295.999999 2023-08-01T19:55:17.323 INFO:teuthology.orchestra.run.smithi101.stdout: }, 2023-08-01T19:55:17.323 INFO:teuthology.orchestra.run.smithi101.stdout: { 2023-08-01T19:55:17.323 INFO:teuthology.orchestra.run.smithi101.stdout: "event": "all_read", 2023-08-01T19:55:17.323 INFO:teuthology.orchestra.run.smithi101.stdout: "time": "2023-08-01T19:55:05.150973+0000", 2023-08-01T19:55:17.323 INFO:teuthology.orchestra.run.smithi101.stdout: "duration": 6.4531999999999998e-05 2023-08-01T19:55:17.323 INFO:teuthology.orchestra.run.smithi101.stdout: }, 2023-08-01T19:55:17.324 INFO:teuthology.orchestra.run.smithi101.stdout: { 2023-08-01T19:55:17.324 INFO:teuthology.orchestra.run.smithi101.stdout: "event": "dispatched", 2023-08-01T19:55:17.324 INFO:teuthology.orchestra.run.smithi101.stdout: "time": "2023-08-01T19:55:05.150984+0000", 2023-08-01T19:55:17.324 INFO:teuthology.orchestra.run.smithi101.stdout: "duration": 1.0287e-05 2023-08-01T19:55:17.324 INFO:teuthology.orchestra.run.smithi101.stdout: }, 2023-08-01T19:55:17.324 INFO:teuthology.orchestra.run.smithi101.stdout: { 2023-08-01T19:55:17.324 INFO:teuthology.orchestra.run.smithi101.stdout: "event": "queued_for_pg", 2023-08-01T19:55:17.324 INFO:teuthology.orchestra.run.smithi101.stdout: "time": "2023-08-01T19:55:05.150989+0000", 2023-08-01T19:55:17.325 INFO:teuthology.orchestra.run.smithi101.stdout: "duration": 5.3929999999999999e-06 2023-08-01T19:55:17.325 INFO:teuthology.orchestra.run.smithi101.stdout: }, 2023-08-01T19:55:17.325 INFO:teuthology.orchestra.run.smithi101.stdout: { 2023-08-01T19:55:17.325 INFO:teuthology.orchestra.run.smithi101.stdout: "event": "reached_pg", 2023-08-01T19:55:17.325 INFO:teuthology.orchestra.run.smithi101.stdout: "time": "2023-08-01T19:55:05.151034+0000", 2023-08-01T19:55:17.325 INFO:teuthology.orchestra.run.smithi101.stdout: "duration": 4.4336999999999999e-05 2023-08-01T19:55:17.325 INFO:teuthology.orchestra.run.smithi101.stdout: }, 2023-08-01T19:55:17.325 INFO:teuthology.orchestra.run.smithi101.stdout: { 2023-08-01T19:55:17.326 INFO:teuthology.orchestra.run.smithi101.stdout: "event": "started", 2023-08-01T19:55:17.326 INFO:teuthology.orchestra.run.smithi101.stdout: "time": "2023-08-01T19:55:05.151167+0000", 2023-08-01T19:55:17.326 INFO:teuthology.orchestra.run.smithi101.stdout: "duration": 0.00013368899999999999 2023-08-01T19:55:17.326 INFO:teuthology.orchestra.run.smithi101.stdout: }, 2023-08-01T19:55:17.326 INFO:teuthology.orchestra.run.smithi101.stdout: { 2023-08-01T19:55:17.326 INFO:teuthology.orchestra.run.smithi101.stdout: "event": "waiting for subops from 2", 2023-08-01T19:55:17.326 INFO:teuthology.orchestra.run.smithi101.stdout: "time": "2023-08-01T19:55:05.151328+0000", 2023-08-01T19:55:17.327 INFO:teuthology.orchestra.run.smithi101.stdout: "duration": 0.00016122700000000001 2023-08-01T19:55:17.327 INFO:teuthology.orchestra.run.smithi101.stdout: }, 2023-08-01T19:55:17.327 INFO:teuthology.orchestra.run.smithi101.stdout: { 2023-08-01T19:55:17.327 INFO:teuthology.orchestra.run.smithi101.stdout: "event": "op_commit", 2023-08-01T19:55:17.327 INFO:teuthology.orchestra.run.smithi101.stdout: "time": "2023-08-01T19:55:05.156101+0000", 2023-08-01T19:55:17.327 INFO:teuthology.orchestra.run.smithi101.stdout: "duration": 0.0047724100000000004 2023-08-01T19:55:17.327 INFO:teuthology.orchestra.run.smithi101.stdout: }, 2023-08-01T19:55:17.328 INFO:teuthology.orchestra.run.smithi101.stdout: { 2023-08-01T19:55:17.328 INFO:teuthology.orchestra.run.smithi101.stdout: "event": "sub_op_commit_rec", 2023-08-01T19:55:17.328 INFO:teuthology.orchestra.run.smithi101.stdout: "time": "2023-08-01T19:55:05.223688+0000", 2023-08-01T19:55:17.328 INFO:teuthology.orchestra.run.smithi101.stdout: "duration": 0.067586937999999999 2023-08-01T19:55:17.328 INFO:teuthology.orchestra.run.smithi101.stdout: }, 2023-08-01T19:55:17.328 INFO:teuthology.orchestra.run.smithi101.stdout: { 2023-08-01T19:55:17.328 INFO:teuthology.orchestra.run.smithi101.stdout: "event": "commit_sent", 2023-08-01T19:55:17.328 INFO:teuthology.orchestra.run.smithi101.stdout: "time": "2023-08-01T19:55:05.223737+0000", 2023-08-01T19:55:17.329 INFO:teuthology.orchestra.run.smithi101.stdout: "duration": 4.8921999999999997e-05 2023-08-01T19:55:17.329 INFO:teuthology.orchestra.run.smithi101.stdout: }, 2023-08-01T19:55:17.329 INFO:teuthology.orchestra.run.smithi101.stdout: { 2023-08-01T19:55:17.329 INFO:teuthology.orchestra.run.smithi101.stdout: "event": "done", 2023-08-01T19:55:17.329 INFO:teuthology.orchestra.run.smithi101.stdout: "time": "2023-08-01T19:55:05.223774+0000", 2023-08-01T19:55:17.329 INFO:teuthology.orchestra.run.smithi101.stdout: "duration": 3.7342999999999998e-05 2023-08-01T19:55:17.329 INFO:teuthology.orchestra.run.smithi101.stdout: } 2023-08-01T19:55:17.329 INFO:teuthology.orchestra.run.smithi101.stdout: ] 2023-08-01T19:55:17.330 INFO:teuthology.orchestra.run.smithi101.stdout: } 2023-08-01T19:55:17.330 INFO:teuthology.orchestra.run.smithi101.stdout: }, 2023-08-01T19:55:17.330 INFO:teuthology.orchestra.run.smithi101.stdout: { 2023-08-01T19:55:17.330 INFO:teuthology.orchestra.run.smithi101.stdout: "description": "osd_op(client.4668.0:100253 5.f 5:f7bbce05:::benchmark_data_smithi006_114134_object100252:head [set-alloc-hint object_size 65536 write_size 65536,write 0~65536] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e37)", 2023-08-01T19:55:17.330 INFO:teuthology.orchestra.run.smithi101.stdout: "initiated_at": "2023-08-01T19:55:05.156562+0000", 2023-08-01T19:55:17.330 INFO:teuthology.orchestra.run.smithi101.stdout: "age": 12.058012349, 2023-08-01T19:55:17.330 INFO:teuthology.orchestra.run.smithi101.stdout: "duration": 0.068677503000000001, 2023-08-01T19:55:17.330 INFO:teuthology.orchestra.run.smithi101.stdout: "type_data": { 2023-08-01T19:55:17.331 INFO:teuthology.orchestra.run.smithi101.stdout: "flag_point": "commit sent; apply or cleanup", 2023-08-01T19:55:17.331 INFO:teuthology.orchestra.run.smithi101.stdout: "client_info": { 2023-08-01T19:55:17.331 INFO:teuthology.orchestra.run.smithi101.stdout: "client": "client.4668", 2023-08-01T19:55:17.331 INFO:teuthology.orchestra.run.smithi101.stdout: "client_addr": "172.21.15.6:0/1709472247", 2023-08-01T19:55:17.331 INFO:teuthology.orchestra.run.smithi101.stdout: "tid": 100253 2023-08-01T19:55:17.331 INFO:teuthology.orchestra.run.smithi101.stdout: }, 2023-08-01T19:55:17.331 INFO:teuthology.orchestra.run.smithi101.stdout: "events": [ 2023-08-01T19:55:17.332 INFO:teuthology.orchestra.run.smithi101.stdout: { 2023-08-01T19:55:17.332 INFO:teuthology.orchestra.run.smithi101.stdout: "event": "initiated", 2023-08-01T19:55:17.332 INFO:teuthology.orchestra.run.smithi101.stdout: "time": "2023-08-01T19:55:05.156562+0000", 2023-08-01T19:55:17.332 INFO:teuthology.orchestra.run.smithi101.stdout: "duration": 0 2023-08-01T19:55:17.332 INFO:teuthology.orchestra.run.smithi101.stdout: }, 2023-08-01T19:55:17.332 INFO:teuthology.orchestra.run.smithi101.stdout: { 2023-08-01T19:55:17.332 INFO:teuthology.orchestra.run.smithi101.stdout: "event": "throttled", 2023-08-01T19:55:17.332 INFO:teuthology.orchestra.run.smithi101.stdout: "time": "2023-08-01T19:55:05.156562+0000", 2023-08-01T19:55:17.333 INFO:teuthology.orchestra.run.smithi101.stdout: "duration": 0 2023-08-01T19:55:17.333 INFO:teuthology.orchestra.run.smithi101.stdout: }, 2023-08-01T19:55:17.333 INFO:teuthology.orchestra.run.smithi101.stdout: { 2023-08-01T19:55:17.333 INFO:teuthology.orchestra.run.smithi101.stdout: "event": "header_read", 2023-08-01T19:55:17.333 INFO:teuthology.orchestra.run.smithi101.stdout: "time": "2023-08-01T19:55:05.156561+0000", 2023-08-01T19:55:17.333 INFO:teuthology.orchestra.run.smithi101.stdout: "duration": 4294967295.999999 2023-08-01T19:55:17.333 INFO:teuthology.orchestra.run.smithi101.stdout: }, 2023-08-01T19:55:17.333 INFO:teuthology.orchestra.run.smithi101.stdout: { 2023-08-01T19:55:17.334 INFO:teuthology.orchestra.run.smithi101.stdout: "event": "all_read", 2023-08-01T19:55:17.334 INFO:teuthology.orchestra.run.smithi101.stdout: "time": "2023-08-01T19:55:05.156655+0000", 2023-08-01T19:55:17.334 INFO:teuthology.orchestra.run.smithi101.stdout: "duration": 9.4018999999999995e-05 2023-08-01T19:55:17.334 INFO:teuthology.orchestra.run.smithi101.stdout: }, 2023-08-01T19:55:17.334 INFO:teuthology.orchestra.run.smithi101.stdout: { 2023-08-01T19:55:17.334 INFO:teuthology.orchestra.run.smithi101.stdout: "event": "dispatched", 2023-08-01T19:55:17.334 INFO:teuthology.orchestra.run.smithi101.stdout: "time": "2023-08-01T19:55:05.156664+0000", 2023-08-01T19:55:17.335 INFO:teuthology.orchestra.run.smithi101.stdout: "duration": 9.4970000000000007e-06 2023-08-01T19:55:17.335 INFO:teuthology.orchestra.run.smithi101.stdout: }, 2023-08-01T19:55:17.335 INFO:teuthology.orchestra.run.smithi101.stdout: { 2023-08-01T19:55:17.335 INFO:teuthology.orchestra.run.smithi101.stdout: "event": "queued_for_pg", 2023-08-01T19:55:17.335 INFO:teuthology.orchestra.run.smithi101.stdout: "time": "2023-08-01T19:55:05.156671+0000", 2023-08-01T19:55:17.335 INFO:teuthology.orchestra.run.smithi101.stdout: "duration": 6.1929999999999998e-06 2023-08-01T19:55:17.335 INFO:teuthology.orchestra.run.smithi101.stdout: }, 2023-08-01T19:55:17.335 INFO:teuthology.orchestra.run.smithi101.stdout: { 2023-08-01T19:55:17.336 INFO:teuthology.orchestra.run.smithi101.stdout: "event": "reached_pg", 2023-08-01T19:55:17.336 INFO:teuthology.orchestra.run.smithi101.stdout: "time": "2023-08-01T19:55:05.156742+0000", 2023-08-01T19:55:17.336 INFO:teuthology.orchestra.run.smithi101.stdout: "duration": 7.1181999999999997e-05 2023-08-01T19:55:17.336 INFO:teuthology.orchestra.run.smithi101.stdout: }, 2023-08-01T19:55:17.336 INFO:teuthology.orchestra.run.smithi101.stdout: { 2023-08-01T19:55:17.336 INFO:teuthology.orchestra.run.smithi101.stdout: "event": "started", 2023-08-01T19:55:17.336 INFO:teuthology.orchestra.run.smithi101.stdout: "time": "2023-08-01T19:55:05.156839+0000", 2023-08-01T19:55:17.336 INFO:teuthology.orchestra.run.smithi101.stdout: "duration": 9.7182000000000006e-05 2023-08-01T19:55:17.337 INFO:teuthology.orchestra.run.smithi101.stdout: }, 2023-08-01T19:55:17.337 INFO:teuthology.orchestra.run.smithi101.stdout: { 2023-08-01T19:55:17.337 INFO:teuthology.orchestra.run.smithi101.stdout: "event": "waiting for subops from 2", 2023-08-01T19:55:17.337 INFO:teuthology.orchestra.run.smithi101.stdout: "time": "2023-08-01T19:55:05.156925+0000", 2023-08-01T19:55:17.337 INFO:teuthology.orchestra.run.smithi101.stdout: "duration": 8.5816000000000006e-05 2023-08-01T19:55:17.337 INFO:teuthology.orchestra.run.smithi101.stdout: }, 2023-08-01T19:55:17.337 INFO:teuthology.orchestra.run.smithi101.stdout: { 2023-08-01T19:55:17.337 INFO:teuthology.orchestra.run.smithi101.stdout: "event": "op_commit", 2023-08-01T19:55:17.338 INFO:teuthology.orchestra.run.smithi101.stdout: "time": "2023-08-01T19:55:05.160082+0000", 2023-08-01T19:55:17.338 INFO:teuthology.orchestra.run.smithi101.stdout: "duration": 0.0031573959999999998 2023-08-01T19:55:17.338 INFO:teuthology.orchestra.run.smithi101.stdout: }, 2023-08-01T19:55:17.338 INFO:teuthology.orchestra.run.smithi101.stdout: { 2023-08-01T19:55:17.338 INFO:teuthology.orchestra.run.smithi101.stdout: "event": "sub_op_commit_rec", 2023-08-01T19:55:17.338 INFO:teuthology.orchestra.run.smithi101.stdout: "time": "2023-08-01T19:55:05.225162+0000", 2023-08-01T19:55:17.338 INFO:teuthology.orchestra.run.smithi101.stdout: "duration": 0.065079466000000002 2023-08-01T19:55:17.338 INFO:teuthology.orchestra.run.smithi101.stdout: }, 2023-08-01T19:55:17.339 INFO:teuthology.orchestra.run.smithi101.stdout: { 2023-08-01T19:55:17.339 INFO:teuthology.orchestra.run.smithi101.stdout: "event": "commit_sent", 2023-08-01T19:55:17.339 INFO:teuthology.orchestra.run.smithi101.stdout: "time": "2023-08-01T19:55:05.225205+0000", 2023-08-01T19:55:17.339 INFO:teuthology.orchestra.run.smithi101.stdout: "duration": 4.3446999999999999e-05 2023-08-01T19:55:17.339 INFO:teuthology.orchestra.run.smithi101.stdout: }, 2023-08-01T19:55:17.339 INFO:teuthology.orchestra.run.smithi101.stdout: { 2023-08-01T19:55:17.339 INFO:teuthology.orchestra.run.smithi101.stdout: "event": "done", 2023-08-01T19:55:17.339 INFO:teuthology.orchestra.run.smithi101.stdout: "time": "2023-08-01T19:55:05.225239+0000", 2023-08-01T19:55:17.340 INFO:teuthology.orchestra.run.smithi101.stdout: "duration": 3.4121000000000001e-05 2023-08-01T19:55:17.340 INFO:teuthology.orchestra.run.smithi101.stdout: } 2023-08-01T19:55:17.340 INFO:teuthology.orchestra.run.smithi101.stdout: ] 2023-08-01T19:55:17.340 INFO:teuthology.orchestra.run.smithi101.stdout: } 2023-08-01T19:55:17.340 INFO:teuthology.orchestra.run.smithi101.stdout: }, 2023-08-01T19:55:17.340 INFO:teuthology.orchestra.run.smithi101.stdout: { 2023-08-01T19:55:17.340 INFO:teuthology.orchestra.run.smithi101.stdout: "description": "osd_op(client.4668.0:100928 5.7 5:e61a7dfa:::benchmark_data_smithi006_114134_object100927:head [set-alloc-hint object_size 65536 write_size 65536,write 0~65536] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e37)", 2023-08-01T19:55:17.340 INFO:teuthology.orchestra.run.smithi101.stdout: "initiated_at": "2023-08-01T19:55:05.564731+0000", 2023-08-01T19:55:17.341 INFO:teuthology.orchestra.run.smithi101.stdout: "age": 11.649842856999999, 2023-08-01T19:55:17.341 INFO:teuthology.orchestra.run.smithi101.stdout: "duration": 0.064686603999999995, 2023-08-01T19:55:17.341 INFO:teuthology.orchestra.run.smithi101.stdout: "type_data": { 2023-08-01T19:55:17.341 INFO:teuthology.orchestra.run.smithi101.stdout: "flag_point": "commit sent; apply or cleanup", 2023-08-01T19:55:17.341 INFO:teuthology.orchestra.run.smithi101.stdout: "client_info": { 2023-08-01T19:55:17.341 INFO:teuthology.orchestra.run.smithi101.stdout: "client": "client.4668", 2023-08-01T19:55:17.341 INFO:teuthology.orchestra.run.smithi101.stdout: "client_addr": "172.21.15.6:0/1709472247", 2023-08-01T19:55:17.342 INFO:teuthology.orchestra.run.smithi101.stdout: "tid": 100928 2023-08-01T19:55:17.342 INFO:teuthology.orchestra.run.smithi101.stdout: }, 2023-08-01T19:55:17.342 INFO:teuthology.orchestra.run.smithi101.stdout: "events": [ 2023-08-01T19:55:17.342 INFO:teuthology.orchestra.run.smithi101.stdout: { 2023-08-01T19:55:17.342 INFO:teuthology.orchestra.run.smithi101.stdout: "event": "initiated", 2023-08-01T19:55:17.342 INFO:teuthology.orchestra.run.smithi101.stdout: "time": "2023-08-01T19:55:05.564731+0000", 2023-08-01T19:55:17.342 INFO:teuthology.orchestra.run.smithi101.stdout: "duration": 0 2023-08-01T19:55:17.342 INFO:teuthology.orchestra.run.smithi101.stdout: }, 2023-08-01T19:55:17.343 INFO:teuthology.orchestra.run.smithi101.stdout: { 2023-08-01T19:55:17.343 INFO:teuthology.orchestra.run.smithi101.stdout: "event": "throttled", 2023-08-01T19:55:17.343 INFO:teuthology.orchestra.run.smithi101.stdout: "time": "2023-08-01T19:55:05.564731+0000", 2023-08-01T19:55:17.343 INFO:teuthology.orchestra.run.smithi101.stdout: "duration": 0 2023-08-01T19:55:17.343 INFO:teuthology.orchestra.run.smithi101.stdout: }, 2023-08-01T19:55:17.343 INFO:teuthology.orchestra.run.smithi101.stdout: { 2023-08-01T19:55:17.343 INFO:teuthology.orchestra.run.smithi101.stdout: "event": "header_read", 2023-08-01T19:55:17.343 INFO:teuthology.orchestra.run.smithi101.stdout: "time": "2023-08-01T19:55:05.564731+0000", 2023-08-01T19:55:17.344 INFO:teuthology.orchestra.run.smithi101.stdout: "duration": 4294967295.999999 2023-08-01T19:55:17.344 INFO:teuthology.orchestra.run.smithi101.stdout: }, 2023-08-01T19:55:17.344 INFO:teuthology.orchestra.run.smithi101.stdout: { 2023-08-01T19:55:17.344 INFO:teuthology.orchestra.run.smithi101.stdout: "event": "all_read", 2023-08-01T19:55:17.344 INFO:teuthology.orchestra.run.smithi101.stdout: "time": "2023-08-01T19:55:05.564832+0000", 2023-08-01T19:55:17.344 INFO:teuthology.orchestra.run.smithi101.stdout: "duration": 0.000101752 2023-08-01T19:55:17.344 INFO:teuthology.orchestra.run.smithi101.stdout: }, 2023-08-01T19:55:17.344 INFO:teuthology.orchestra.run.smithi101.stdout: { 2023-08-01T19:55:17.345 INFO:teuthology.orchestra.run.smithi101.stdout: "event": "dispatched", 2023-08-01T19:55:17.345 INFO:teuthology.orchestra.run.smithi101.stdout: "time": "2023-08-01T19:55:05.564840+0000", 2023-08-01T19:55:17.345 INFO:teuthology.orchestra.run.smithi101.stdout: "duration": 7.8590000000000005e-06 2023-08-01T19:55:17.345 INFO:teuthology.orchestra.run.smithi101.stdout: }, 2023-08-01T19:55:17.345 INFO:teuthology.orchestra.run.smithi101.stdout: { 2023-08-01T19:55:17.345 INFO:teuthology.orchestra.run.smithi101.stdout: "event": "queued_for_pg", 2023-08-01T19:55:17.345 INFO:teuthology.orchestra.run.smithi101.stdout: "time": "2023-08-01T19:55:05.564845+0000", 2023-08-01T19:55:17.346 INFO:teuthology.orchestra.run.smithi101.stdout: "duration": 4.9189999999999998e-06 2023-08-01T19:55:17.346 INFO:teuthology.orchestra.run.smithi101.stdout: }, 2023-08-01T19:55:17.346 INFO:teuthology.orchestra.run.smithi101.stdout: { 2023-08-01T19:55:17.346 INFO:teuthology.orchestra.run.smithi101.stdout: "event": "reached_pg", 2023-08-01T19:55:17.346 INFO:teuthology.orchestra.run.smithi101.stdout: "time": "2023-08-01T19:55:05.564883+0000", 2023-08-01T19:55:17.346 INFO:teuthology.orchestra.run.smithi101.stdout: "duration": 3.7481999999999998e-05 2023-08-01T19:55:17.346 INFO:teuthology.orchestra.run.smithi101.stdout: }, 2023-08-01T19:55:17.346 INFO:teuthology.orchestra.run.smithi101.stdout: { 2023-08-01T19:55:17.347 INFO:teuthology.orchestra.run.smithi101.stdout: "event": "started", 2023-08-01T19:55:17.347 INFO:teuthology.orchestra.run.smithi101.stdout: "time": "2023-08-01T19:55:05.564968+0000", 2023-08-01T19:55:17.347 INFO:teuthology.orchestra.run.smithi101.stdout: "duration": 8.5494999999999994e-05 2023-08-01T19:55:17.347 INFO:teuthology.orchestra.run.smithi101.stdout: }, 2023-08-01T19:55:17.347 INFO:teuthology.orchestra.run.smithi101.stdout: { 2023-08-01T19:55:17.347 INFO:teuthology.orchestra.run.smithi101.stdout: "event": "waiting for subops from 0", 2023-08-01T19:55:17.347 INFO:teuthology.orchestra.run.smithi101.stdout: "time": "2023-08-01T19:55:05.565062+0000", 2023-08-01T19:55:17.348 INFO:teuthology.orchestra.run.smithi101.stdout: "duration": 9.3478000000000002e-05 2023-08-01T19:55:17.348 INFO:teuthology.orchestra.run.smithi101.stdout: }, 2023-08-01T19:55:17.348 INFO:teuthology.orchestra.run.smithi101.stdout: { 2023-08-01T19:55:17.348 INFO:teuthology.orchestra.run.smithi101.stdout: "event": "op_commit", 2023-08-01T19:55:17.348 INFO:teuthology.orchestra.run.smithi101.stdout: "time": "2023-08-01T19:55:05.572061+0000", 2023-08-01T19:55:17.348 INFO:teuthology.orchestra.run.smithi101.stdout: "duration": 0.0069998250000000003 2023-08-01T19:55:17.348 INFO:teuthology.orchestra.run.smithi101.stdout: }, 2023-08-01T19:55:17.348 INFO:teuthology.orchestra.run.smithi101.stdout: { 2023-08-01T19:55:17.349 INFO:teuthology.orchestra.run.smithi101.stdout: "event": "sub_op_commit_rec", 2023-08-01T19:55:17.349 INFO:teuthology.orchestra.run.smithi101.stdout: "time": "2023-08-01T19:55:05.629362+0000", 2023-08-01T19:55:17.349 INFO:teuthology.orchestra.run.smithi101.stdout: "duration": 0.057300691000000001 2023-08-01T19:55:17.349 INFO:teuthology.orchestra.run.smithi101.stdout: }, 2023-08-01T19:55:17.349 INFO:teuthology.orchestra.run.smithi101.stdout: { 2023-08-01T19:55:17.349 INFO:teuthology.orchestra.run.smithi101.stdout: "event": "commit_sent", 2023-08-01T19:55:17.349 INFO:teuthology.orchestra.run.smithi101.stdout: "time": "2023-08-01T19:55:05.629395+0000", 2023-08-01T19:55:17.349 INFO:teuthology.orchestra.run.smithi101.stdout: "duration": 3.3124000000000003e-05 2023-08-01T19:55:17.350 INFO:teuthology.orchestra.run.smithi101.stdout: }, 2023-08-01T19:55:17.350 INFO:teuthology.orchestra.run.smithi101.stdout: { 2023-08-01T19:55:17.350 INFO:teuthology.orchestra.run.smithi101.stdout: "event": "done", 2023-08-01T19:55:17.350 INFO:teuthology.orchestra.run.smithi101.stdout: "time": "2023-08-01T19:55:05.629418+0000", 2023-08-01T19:55:17.350 INFO:teuthology.orchestra.run.smithi101.stdout: "duration": 2.2697999999999999e-05 2023-08-01T19:55:17.350 INFO:teuthology.orchestra.run.smithi101.stdout: } 2023-08-01T19:55:17.350 INFO:teuthology.orchestra.run.smithi101.stdout: ] 2023-08-01T19:55:17.350 INFO:teuthology.orchestra.run.smithi101.stdout: } 2023-08-01T19:55:17.351 INFO:teuthology.orchestra.run.smithi101.stdout: }, 2023-08-01T19:55:17.351 INFO:teuthology.orchestra.run.smithi101.stdout: { 2023-08-01T19:55:17.351 INFO:teuthology.orchestra.run.smithi101.stdout: "description": "osd_op(client.4668.0:100936 5.1 5:8f4e3576:::benchmark_data_smithi006_114134_object100935:head [set-alloc-hint object_size 65536 write_size 65536,write 0~65536] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e37)", 2023-08-01T19:55:17.351 INFO:teuthology.orchestra.run.smithi101.stdout: "initiated_at": "2023-08-01T19:55:05.567147+0000", 2023-08-01T19:55:17.351 INFO:teuthology.orchestra.run.smithi101.stdout: "age": 11.647427330999999, 2023-08-01T19:55:17.351 INFO:teuthology.orchestra.run.smithi101.stdout: "duration": 0.063466380000000003, 2023-08-01T19:55:17.351 INFO:teuthology.orchestra.run.smithi101.stdout: "type_data": { 2023-08-01T19:55:17.351 INFO:teuthology.orchestra.run.smithi101.stdout: "flag_point": "commit sent; apply or cleanup", 2023-08-01T19:55:17.352 INFO:teuthology.orchestra.run.smithi101.stdout: "client_info": { 2023-08-01T19:55:17.352 INFO:teuthology.orchestra.run.smithi101.stdout: "client": "client.4668", 2023-08-01T19:55:17.352 INFO:teuthology.orchestra.run.smithi101.stdout: "client_addr": "172.21.15.6:0/1709472247", 2023-08-01T19:55:17.352 INFO:teuthology.orchestra.run.smithi101.stdout: "tid": 100936 2023-08-01T19:55:17.352 INFO:teuthology.orchestra.run.smithi101.stdout: }, 2023-08-01T19:55:17.352 INFO:teuthology.orchestra.run.smithi101.stdout: "events": [ 2023-08-01T19:55:17.352 INFO:teuthology.orchestra.run.smithi101.stdout: { 2023-08-01T19:55:17.353 INFO:teuthology.orchestra.run.smithi101.stdout: "event": "initiated", 2023-08-01T19:55:17.353 INFO:teuthology.orchestra.run.smithi101.stdout: "time": "2023-08-01T19:55:05.567147+0000", 2023-08-01T19:55:17.353 INFO:teuthology.orchestra.run.smithi101.stdout: "duration": 0 2023-08-01T19:55:17.353 INFO:teuthology.orchestra.run.smithi101.stdout: }, 2023-08-01T19:55:17.353 INFO:teuthology.orchestra.run.smithi101.stdout: { 2023-08-01T19:55:17.353 INFO:teuthology.orchestra.run.smithi101.stdout: "event": "throttled", 2023-08-01T19:55:17.353 INFO:teuthology.orchestra.run.smithi101.stdout: "time": "2023-08-01T19:55:05.567147+0000", 2023-08-01T19:55:17.353 INFO:teuthology.orchestra.run.smithi101.stdout: "duration": 0 2023-08-01T19:55:17.354 INFO:teuthology.orchestra.run.smithi101.stdout: }, 2023-08-01T19:55:17.354 INFO:teuthology.orchestra.run.smithi101.stdout: { 2023-08-01T19:55:17.354 INFO:teuthology.orchestra.run.smithi101.stdout: "event": "header_read", 2023-08-01T19:55:17.354 INFO:teuthology.orchestra.run.smithi101.stdout: "time": "2023-08-01T19:55:05.567146+0000", 2023-08-01T19:55:17.354 INFO:teuthology.orchestra.run.smithi101.stdout: "duration": 4294967295.999999 2023-08-01T19:55:17.354 INFO:teuthology.orchestra.run.smithi101.stdout: }, 2023-08-01T19:55:17.354 INFO:teuthology.orchestra.run.smithi101.stdout: { 2023-08-01T19:55:17.354 INFO:teuthology.orchestra.run.smithi101.stdout: "event": "all_read", 2023-08-01T19:55:17.355 INFO:teuthology.orchestra.run.smithi101.stdout: "time": "2023-08-01T19:55:05.567224+0000", 2023-08-01T19:55:17.355 INFO:teuthology.orchestra.run.smithi101.stdout: "duration": 7.8460000000000004e-05 2023-08-01T19:55:17.355 INFO:teuthology.orchestra.run.smithi101.stdout: }, 2023-08-01T19:55:17.355 INFO:teuthology.orchestra.run.smithi101.stdout: { 2023-08-01T19:55:17.355 INFO:teuthology.orchestra.run.smithi101.stdout: "event": "dispatched", 2023-08-01T19:55:17.355 INFO:teuthology.orchestra.run.smithi101.stdout: "time": "2023-08-01T19:55:05.567234+0000", 2023-08-01T19:55:17.355 INFO:teuthology.orchestra.run.smithi101.stdout: "duration": 9.7110000000000007e-06 2023-08-01T19:55:17.355 INFO:teuthology.orchestra.run.smithi101.stdout: }, 2023-08-01T19:55:17.356 INFO:teuthology.orchestra.run.smithi101.stdout: { 2023-08-01T19:55:17.356 INFO:teuthology.orchestra.run.smithi101.stdout: "event": "queued_for_pg", 2023-08-01T19:55:17.356 INFO:teuthology.orchestra.run.smithi101.stdout: "time": "2023-08-01T19:55:05.567239+0000", 2023-08-01T19:55:17.356 INFO:teuthology.orchestra.run.smithi101.stdout: "duration": 5.237e-06 2023-08-01T19:55:17.356 INFO:teuthology.orchestra.run.smithi101.stdout: }, 2023-08-01T19:55:17.356 INFO:teuthology.orchestra.run.smithi101.stdout: { 2023-08-01T19:55:17.356 INFO:teuthology.orchestra.run.smithi101.stdout: "event": "reached_pg", 2023-08-01T19:55:17.357 INFO:teuthology.orchestra.run.smithi101.stdout: "time": "2023-08-01T19:55:05.567278+0000", 2023-08-01T19:55:17.357 INFO:teuthology.orchestra.run.smithi101.stdout: "duration": 3.9069999999999997e-05 2023-08-01T19:55:17.357 INFO:teuthology.orchestra.run.smithi101.stdout: }, 2023-08-01T19:55:17.357 INFO:teuthology.orchestra.run.smithi101.stdout: { 2023-08-01T19:55:17.357 INFO:teuthology.orchestra.run.smithi101.stdout: "event": "started", 2023-08-01T19:55:17.357 INFO:teuthology.orchestra.run.smithi101.stdout: "time": "2023-08-01T19:55:05.567402+0000", 2023-08-01T19:55:17.357 INFO:teuthology.orchestra.run.smithi101.stdout: "duration": 0.00012348700000000001 2023-08-01T19:55:17.358 INFO:teuthology.orchestra.run.smithi101.stdout: }, 2023-08-01T19:55:17.358 INFO:teuthology.orchestra.run.smithi101.stdout: { 2023-08-01T19:55:17.358 INFO:teuthology.orchestra.run.smithi101.stdout: "event": "waiting for subops from 0", 2023-08-01T19:55:17.358 INFO:teuthology.orchestra.run.smithi101.stdout: "time": "2023-08-01T19:55:05.567558+0000", 2023-08-01T19:55:17.358 INFO:teuthology.orchestra.run.smithi101.stdout: "duration": 0.000156179 2023-08-01T19:55:17.358 INFO:teuthology.orchestra.run.smithi101.stdout: }, 2023-08-01T19:55:17.358 INFO:teuthology.orchestra.run.smithi101.stdout: { 2023-08-01T19:55:17.358 INFO:teuthology.orchestra.run.smithi101.stdout: "event": "op_commit", 2023-08-01T19:55:17.359 INFO:teuthology.orchestra.run.smithi101.stdout: "time": "2023-08-01T19:55:05.573767+0000", 2023-08-01T19:55:17.359 INFO:teuthology.orchestra.run.smithi101.stdout: "duration": 0.0062092409999999999 2023-08-01T19:55:17.359 INFO:teuthology.orchestra.run.smithi101.stdout: }, 2023-08-01T19:55:17.359 INFO:teuthology.orchestra.run.smithi101.stdout: { 2023-08-01T19:55:17.359 INFO:teuthology.orchestra.run.smithi101.stdout: "event": "sub_op_commit_rec", 2023-08-01T19:55:17.359 INFO:teuthology.orchestra.run.smithi101.stdout: "time": "2023-08-01T19:55:05.630531+0000", 2023-08-01T19:55:17.359 INFO:teuthology.orchestra.run.smithi101.stdout: "duration": 0.056763409000000001 2023-08-01T19:55:17.360 INFO:teuthology.orchestra.run.smithi101.stdout: }, 2023-08-01T19:55:17.360 INFO:teuthology.orchestra.run.smithi101.stdout: { 2023-08-01T19:55:17.360 INFO:teuthology.orchestra.run.smithi101.stdout: "event": "commit_sent", 2023-08-01T19:55:17.360 INFO:teuthology.orchestra.run.smithi101.stdout: "time": "2023-08-01T19:55:05.630577+0000", 2023-08-01T19:55:17.360 INFO:teuthology.orchestra.run.smithi101.stdout: "duration": 4.6588000000000002e-05 2023-08-01T19:55:17.360 INFO:teuthology.orchestra.run.smithi101.stdout: }, 2023-08-01T19:55:17.360 INFO:teuthology.orchestra.run.smithi101.stdout: { 2023-08-01T19:55:17.360 INFO:teuthology.orchestra.run.smithi101.stdout: "event": "done", 2023-08-01T19:55:17.361 INFO:teuthology.orchestra.run.smithi101.stdout: "time": "2023-08-01T19:55:05.630613+0000", 2023-08-01T19:55:17.361 INFO:teuthology.orchestra.run.smithi101.stdout: "duration": 3.5802e-05 2023-08-01T19:55:17.361 INFO:teuthology.orchestra.run.smithi101.stdout: } 2023-08-01T19:55:17.361 INFO:teuthology.orchestra.run.smithi101.stdout: ] 2023-08-01T19:55:17.361 INFO:teuthology.orchestra.run.smithi101.stdout: } 2023-08-01T19:55:17.361 INFO:teuthology.orchestra.run.smithi101.stdout: }, 2023-08-01T19:55:17.361 INFO:teuthology.orchestra.run.smithi101.stdout: { 2023-08-01T19:55:17.361 INFO:teuthology.orchestra.run.smithi101.stdout: "description": "osd_op(client.4668.0:100943 5.7 5:e01743fe:::benchmark_data_smithi006_114134_object100942:head [set-alloc-hint object_size 65536 write_size 65536,write 0~65536] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e37)", 2023-08-01T19:55:17.362 INFO:teuthology.orchestra.run.smithi101.stdout: "initiated_at": "2023-08-01T19:55:05.574724+0000", 2023-08-01T19:55:17.362 INFO:teuthology.orchestra.run.smithi101.stdout: "age": 11.639850237999999, 2023-08-01T19:55:17.362 INFO:teuthology.orchestra.run.smithi101.stdout: "duration": 0.058761188999999998, 2023-08-01T19:55:17.362 INFO:teuthology.orchestra.run.smithi101.stdout: "type_data": { 2023-08-01T19:55:17.362 INFO:teuthology.orchestra.run.smithi101.stdout: "flag_point": "commit sent; apply or cleanup", 2023-08-01T19:55:17.362 INFO:teuthology.orchestra.run.smithi101.stdout: "client_info": { 2023-08-01T19:55:17.362 INFO:teuthology.orchestra.run.smithi101.stdout: "client": "client.4668", 2023-08-01T19:55:17.363 INFO:teuthology.orchestra.run.smithi101.stdout: "client_addr": "172.21.15.6:0/1709472247", 2023-08-01T19:55:17.363 INFO:teuthology.orchestra.run.smithi101.stdout: "tid": 100943 2023-08-01T19:55:17.363 INFO:teuthology.orchestra.run.smithi101.stdout: }, 2023-08-01T19:55:17.363 INFO:teuthology.orchestra.run.smithi101.stdout: "events": [ 2023-08-01T19:55:17.363 INFO:teuthology.orchestra.run.smithi101.stdout: { 2023-08-01T19:55:17.363 INFO:teuthology.orchestra.run.smithi101.stdout: "event": "initiated", 2023-08-01T19:55:17.363 INFO:teuthology.orchestra.run.smithi101.stdout: "time": "2023-08-01T19:55:05.574724+0000", 2023-08-01T19:55:17.363 INFO:teuthology.orchestra.run.smithi101.stdout: "duration": 0 2023-08-01T19:55:17.364 INFO:teuthology.orchestra.run.smithi101.stdout: }, 2023-08-01T19:55:17.364 INFO:teuthology.orchestra.run.smithi101.stdout: { 2023-08-01T19:55:17.364 INFO:teuthology.orchestra.run.smithi101.stdout: "event": "throttled", 2023-08-01T19:55:17.364 INFO:teuthology.orchestra.run.smithi101.stdout: "time": "2023-08-01T19:55:05.574724+0000", 2023-08-01T19:55:17.364 INFO:teuthology.orchestra.run.smithi101.stdout: "duration": 0 2023-08-01T19:55:17.364 INFO:teuthology.orchestra.run.smithi101.stdout: }, 2023-08-01T19:55:17.364 INFO:teuthology.orchestra.run.smithi101.stdout: { 2023-08-01T19:55:17.364 INFO:teuthology.orchestra.run.smithi101.stdout: "event": "header_read", 2023-08-01T19:55:17.365 INFO:teuthology.orchestra.run.smithi101.stdout: "time": "2023-08-01T19:55:05.574723+0000", 2023-08-01T19:55:17.365 INFO:teuthology.orchestra.run.smithi101.stdout: "duration": 4294967295.999999 2023-08-01T19:55:17.365 INFO:teuthology.orchestra.run.smithi101.stdout: }, 2023-08-01T19:55:17.365 INFO:teuthology.orchestra.run.smithi101.stdout: { 2023-08-01T19:55:17.365 INFO:teuthology.orchestra.run.smithi101.stdout: "event": "all_read", 2023-08-01T19:55:17.365 INFO:teuthology.orchestra.run.smithi101.stdout: "time": "2023-08-01T19:55:05.574773+0000", 2023-08-01T19:55:17.365 INFO:teuthology.orchestra.run.smithi101.stdout: "duration": 4.9469999999999999e-05 2023-08-01T19:55:17.366 INFO:teuthology.orchestra.run.smithi101.stdout: }, 2023-08-01T19:55:17.366 INFO:teuthology.orchestra.run.smithi101.stdout: { 2023-08-01T19:55:17.366 INFO:teuthology.orchestra.run.smithi101.stdout: "event": "dispatched", 2023-08-01T19:55:17.366 INFO:teuthology.orchestra.run.smithi101.stdout: "time": "2023-08-01T19:55:05.574780+0000", 2023-08-01T19:55:17.366 INFO:teuthology.orchestra.run.smithi101.stdout: "duration": 7.5059999999999998e-06 2023-08-01T19:55:17.366 INFO:teuthology.orchestra.run.smithi101.stdout: }, 2023-08-01T19:55:17.366 INFO:teuthology.orchestra.run.smithi101.stdout: { 2023-08-01T19:55:17.366 INFO:teuthology.orchestra.run.smithi101.stdout: "event": "queued_for_pg", 2023-08-01T19:55:17.367 INFO:teuthology.orchestra.run.smithi101.stdout: "time": "2023-08-01T19:55:05.574784+0000", 2023-08-01T19:55:17.367 INFO:teuthology.orchestra.run.smithi101.stdout: "duration": 3.5540000000000002e-06 2023-08-01T19:55:17.367 INFO:teuthology.orchestra.run.smithi101.stdout: }, 2023-08-01T19:55:17.367 INFO:teuthology.orchestra.run.smithi101.stdout: { 2023-08-01T19:55:17.367 INFO:teuthology.orchestra.run.smithi101.stdout: "event": "reached_pg", 2023-08-01T19:55:17.367 INFO:teuthology.orchestra.run.smithi101.stdout: "time": "2023-08-01T19:55:05.574805+0000", 2023-08-01T19:55:17.367 INFO:teuthology.orchestra.run.smithi101.stdout: "duration": 2.1257999999999999e-05 2023-08-01T19:55:17.368 INFO:teuthology.orchestra.run.smithi101.stdout: }, 2023-08-01T19:55:17.368 INFO:teuthology.orchestra.run.smithi101.stdout: { 2023-08-01T19:55:17.368 INFO:teuthology.orchestra.run.smithi101.stdout: "event": "started", 2023-08-01T19:55:17.368 INFO:teuthology.orchestra.run.smithi101.stdout: "time": "2023-08-01T19:55:05.574886+0000", 2023-08-01T19:55:17.368 INFO:teuthology.orchestra.run.smithi101.stdout: "duration": 8.1545999999999995e-05 2023-08-01T19:55:17.368 INFO:teuthology.orchestra.run.smithi101.stdout: }, 2023-08-01T19:55:17.368 INFO:teuthology.orchestra.run.smithi101.stdout: { 2023-08-01T19:55:17.368 INFO:teuthology.orchestra.run.smithi101.stdout: "event": "waiting for subops from 0", 2023-08-01T19:55:17.369 INFO:teuthology.orchestra.run.smithi101.stdout: "time": "2023-08-01T19:55:05.574973+0000", 2023-08-01T19:55:17.369 INFO:teuthology.orchestra.run.smithi101.stdout: "duration": 8.6998999999999998e-05 2023-08-01T19:55:17.369 INFO:teuthology.orchestra.run.smithi101.stdout: }, 2023-08-01T19:55:17.369 INFO:teuthology.orchestra.run.smithi101.stdout: { 2023-08-01T19:55:17.369 INFO:teuthology.orchestra.run.smithi101.stdout: "event": "op_commit", 2023-08-01T19:55:17.369 INFO:teuthology.orchestra.run.smithi101.stdout: "time": "2023-08-01T19:55:05.581580+0000", 2023-08-01T19:55:17.369 INFO:teuthology.orchestra.run.smithi101.stdout: "duration": 0.0066068790000000004 2023-08-01T19:55:17.370 INFO:teuthology.orchestra.run.smithi101.stdout: }, 2023-08-01T19:55:17.370 INFO:teuthology.orchestra.run.smithi101.stdout: { 2023-08-01T19:55:17.370 INFO:teuthology.orchestra.run.smithi101.stdout: "event": "sub_op_commit_rec", 2023-08-01T19:55:17.370 INFO:teuthology.orchestra.run.smithi101.stdout: "time": "2023-08-01T19:55:05.633422+0000", 2023-08-01T19:55:17.370 INFO:teuthology.orchestra.run.smithi101.stdout: "duration": 0.051841992000000003 2023-08-01T19:55:17.370 INFO:teuthology.orchestra.run.smithi101.stdout: }, 2023-08-01T19:55:17.370 INFO:teuthology.orchestra.run.smithi101.stdout: { 2023-08-01T19:55:17.370 INFO:teuthology.orchestra.run.smithi101.stdout: "event": "commit_sent", 2023-08-01T19:55:17.371 INFO:teuthology.orchestra.run.smithi101.stdout: "time": "2023-08-01T19:55:05.633461+0000", 2023-08-01T19:55:17.371 INFO:teuthology.orchestra.run.smithi101.stdout: "duration": 3.8330000000000001e-05 2023-08-01T19:55:17.371 INFO:teuthology.orchestra.run.smithi101.stdout: }, 2023-08-01T19:55:17.371 INFO:teuthology.orchestra.run.smithi101.stdout: { 2023-08-01T19:55:17.371 INFO:teuthology.orchestra.run.smithi101.stdout: "event": "done", 2023-08-01T19:55:17.371 INFO:teuthology.orchestra.run.smithi101.stdout: "time": "2023-08-01T19:55:05.633485+0000", 2023-08-01T19:55:17.371 INFO:teuthology.orchestra.run.smithi101.stdout: "duration": 2.4451e-05 2023-08-01T19:55:17.372 INFO:teuthology.orchestra.run.smithi101.stdout: } 2023-08-01T19:55:17.372 INFO:teuthology.orchestra.run.smithi101.stdout: ] 2023-08-01T19:55:17.372 INFO:teuthology.orchestra.run.smithi101.stdout: } 2023-08-01T19:55:17.372 INFO:teuthology.orchestra.run.smithi101.stdout: }, 2023-08-01T19:55:17.372 INFO:teuthology.orchestra.run.smithi101.stdout: { 2023-08-01T19:55:17.372 INFO:teuthology.orchestra.run.smithi101.stdout: "description": "osd_op(client.4668.0:107866 5.f 5:ffcbf9c4:::benchmark_data_smithi006_114134_object107865:head [set-alloc-hint object_size 65536 write_size 65536,write 0~65536] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e38)", 2023-08-01T19:55:17.372 INFO:teuthology.orchestra.run.smithi101.stdout: "initiated_at": "2023-08-01T19:55:09.280625+0000", 2023-08-01T19:55:17.372 INFO:teuthology.orchestra.run.smithi101.stdout: "age": 7.9339488999999999, 2023-08-01T19:55:17.373 INFO:teuthology.orchestra.run.smithi101.stdout: "duration": 0.069869799999999996, 2023-08-01T19:55:17.373 INFO:teuthology.orchestra.run.smithi101.stdout: "type_data": { 2023-08-01T19:55:17.373 INFO:teuthology.orchestra.run.smithi101.stdout: "flag_point": "commit sent; apply or cleanup", 2023-08-01T19:55:17.373 INFO:teuthology.orchestra.run.smithi101.stdout: "client_info": { 2023-08-01T19:55:17.373 INFO:teuthology.orchestra.run.smithi101.stdout: "client": "client.4668", 2023-08-01T19:55:17.374 INFO:teuthology.orchestra.run.smithi101.stdout: "client_addr": "172.21.15.6:0/1709472247", 2023-08-01T19:55:17.374 INFO:teuthology.orchestra.run.smithi101.stdout: "tid": 107866 2023-08-01T19:55:17.374 INFO:teuthology.orchestra.run.smithi101.stdout: }, 2023-08-01T19:55:17.374 INFO:teuthology.orchestra.run.smithi101.stdout: "events": [ 2023-08-01T19:55:17.374 INFO:teuthology.orchestra.run.smithi101.stdout: { 2023-08-01T19:55:17.374 INFO:teuthology.orchestra.run.smithi101.stdout: "event": "initiated", 2023-08-01T19:55:17.374 INFO:teuthology.orchestra.run.smithi101.stdout: "time": "2023-08-01T19:55:09.280625+0000", 2023-08-01T19:55:17.374 INFO:teuthology.orchestra.run.smithi101.stdout: "duration": 0 2023-08-01T19:55:17.375 INFO:teuthology.orchestra.run.smithi101.stdout: }, 2023-08-01T19:55:17.375 INFO:teuthology.orchestra.run.smithi101.stdout: { 2023-08-01T19:55:17.375 INFO:teuthology.orchestra.run.smithi101.stdout: "event": "throttled", 2023-08-01T19:55:17.375 INFO:teuthology.orchestra.run.smithi101.stdout: "time": "2023-08-01T19:55:09.280625+0000", 2023-08-01T19:55:17.375 INFO:teuthology.orchestra.run.smithi101.stdout: "duration": 0 2023-08-01T19:55:17.375 INFO:teuthology.orchestra.run.smithi101.stdout: }, 2023-08-01T19:55:17.375 INFO:teuthology.orchestra.run.smithi101.stdout: { 2023-08-01T19:55:17.376 INFO:teuthology.orchestra.run.smithi101.stdout: "event": "header_read", 2023-08-01T19:55:17.376 INFO:teuthology.orchestra.run.smithi101.stdout: "time": "2023-08-01T19:55:09.280624+0000", 2023-08-01T19:55:17.376 INFO:teuthology.orchestra.run.smithi101.stdout: "duration": 4294967295.999999 2023-08-01T19:55:17.376 INFO:teuthology.orchestra.run.smithi101.stdout: }, 2023-08-01T19:55:17.376 INFO:teuthology.orchestra.run.smithi101.stdout: { 2023-08-01T19:55:17.376 INFO:teuthology.orchestra.run.smithi101.stdout: "event": "all_read", 2023-08-01T19:55:17.376 INFO:teuthology.orchestra.run.smithi101.stdout: "time": "2023-08-01T19:55:09.280648+0000", 2023-08-01T19:55:17.376 INFO:teuthology.orchestra.run.smithi101.stdout: "duration": 2.3521999999999999e-05 2023-08-01T19:55:17.377 INFO:teuthology.orchestra.run.smithi101.stdout: }, 2023-08-01T19:55:17.377 INFO:teuthology.orchestra.run.smithi101.stdout: { 2023-08-01T19:55:17.377 INFO:teuthology.orchestra.run.smithi101.stdout: "event": "dispatched", 2023-08-01T19:55:17.377 INFO:teuthology.orchestra.run.smithi101.stdout: "time": "2023-08-01T19:55:09.280658+0000", 2023-08-01T19:55:17.377 INFO:teuthology.orchestra.run.smithi101.stdout: "duration": 9.8660000000000001e-06 2023-08-01T19:55:17.377 INFO:teuthology.orchestra.run.smithi101.stdout: }, 2023-08-01T19:55:17.377 INFO:teuthology.orchestra.run.smithi101.stdout: { 2023-08-01T19:55:17.377 INFO:teuthology.orchestra.run.smithi101.stdout: "event": "queued_for_pg", 2023-08-01T19:55:17.378 INFO:teuthology.orchestra.run.smithi101.stdout: "time": "2023-08-01T19:55:09.280663+0000", 2023-08-01T19:55:17.378 INFO:teuthology.orchestra.run.smithi101.stdout: "duration": 4.8369999999999996e-06 2023-08-01T19:55:17.378 INFO:teuthology.orchestra.run.smithi101.stdout: }, 2023-08-01T19:55:17.378 INFO:teuthology.orchestra.run.smithi101.stdout: { 2023-08-01T19:55:17.378 INFO:teuthology.orchestra.run.smithi101.stdout: "event": "reached_pg", 2023-08-01T19:55:17.378 INFO:teuthology.orchestra.run.smithi101.stdout: "time": "2023-08-01T19:55:09.280690+0000", 2023-08-01T19:55:17.378 INFO:teuthology.orchestra.run.smithi101.stdout: "duration": 2.7534000000000001e-05 2023-08-01T19:55:17.378 INFO:teuthology.orchestra.run.smithi101.stdout: }, 2023-08-01T19:55:17.379 INFO:teuthology.orchestra.run.smithi101.stdout: { 2023-08-01T19:55:17.379 INFO:teuthology.orchestra.run.smithi101.stdout: "event": "started", 2023-08-01T19:55:17.379 INFO:teuthology.orchestra.run.smithi101.stdout: "time": "2023-08-01T19:55:09.280825+0000", 2023-08-01T19:55:17.379 INFO:teuthology.orchestra.run.smithi101.stdout: "duration": 0.000135399 2023-08-01T19:55:17.379 INFO:teuthology.orchestra.run.smithi101.stdout: }, 2023-08-01T19:55:17.379 INFO:teuthology.orchestra.run.smithi101.stdout: { 2023-08-01T19:55:17.379 INFO:teuthology.orchestra.run.smithi101.stdout: "event": "waiting for subops from 2", 2023-08-01T19:55:17.379 INFO:teuthology.orchestra.run.smithi101.stdout: "time": "2023-08-01T19:55:09.280929+0000", 2023-08-01T19:55:17.380 INFO:teuthology.orchestra.run.smithi101.stdout: "duration": 0.000103328 2023-08-01T19:55:17.380 INFO:teuthology.orchestra.run.smithi101.stdout: }, 2023-08-01T19:55:17.380 INFO:teuthology.orchestra.run.smithi101.stdout: { 2023-08-01T19:55:17.380 INFO:teuthology.orchestra.run.smithi101.stdout: "event": "sub_op_commit_rec", 2023-08-01T19:55:17.380 INFO:teuthology.orchestra.run.smithi101.stdout: "time": "2023-08-01T19:55:09.348321+0000", 2023-08-01T19:55:17.380 INFO:teuthology.orchestra.run.smithi101.stdout: "duration": 0.067392176999999998 2023-08-01T19:55:17.380 INFO:teuthology.orchestra.run.smithi101.stdout: }, 2023-08-01T19:55:17.381 INFO:teuthology.orchestra.run.smithi101.stdout: { 2023-08-01T19:55:17.381 INFO:teuthology.orchestra.run.smithi101.stdout: "event": "op_commit", 2023-08-01T19:55:17.381 INFO:teuthology.orchestra.run.smithi101.stdout: "time": "2023-08-01T19:55:09.350431+0000", 2023-08-01T19:55:17.381 INFO:teuthology.orchestra.run.smithi101.stdout: "duration": 0.0021096980000000001 2023-08-01T19:55:17.381 INFO:teuthology.orchestra.run.smithi101.stdout: }, 2023-08-01T19:55:17.381 INFO:teuthology.orchestra.run.smithi101.stdout: { 2023-08-01T19:55:17.381 INFO:teuthology.orchestra.run.smithi101.stdout: "event": "commit_sent", 2023-08-01T19:55:17.381 INFO:teuthology.orchestra.run.smithi101.stdout: "time": "2023-08-01T19:55:09.350469+0000", 2023-08-01T19:55:17.382 INFO:teuthology.orchestra.run.smithi101.stdout: "duration": 3.8625999999999999e-05 2023-08-01T19:55:17.382 INFO:teuthology.orchestra.run.smithi101.stdout: }, 2023-08-01T19:55:17.382 INFO:teuthology.orchestra.run.smithi101.stdout: { 2023-08-01T19:55:17.382 INFO:teuthology.orchestra.run.smithi101.stdout: "event": "done", 2023-08-01T19:55:17.382 INFO:teuthology.orchestra.run.smithi101.stdout: "time": "2023-08-01T19:55:09.350495+0000", 2023-08-01T19:55:17.382 INFO:teuthology.orchestra.run.smithi101.stdout: "duration": 2.5698999999999999e-05 2023-08-01T19:55:17.382 INFO:teuthology.orchestra.run.smithi101.stdout: } 2023-08-01T19:55:17.382 INFO:teuthology.orchestra.run.smithi101.stdout: ] 2023-08-01T19:55:17.383 INFO:teuthology.orchestra.run.smithi101.stdout: } 2023-08-01T19:55:17.383 INFO:teuthology.orchestra.run.smithi101.stdout: }, 2023-08-01T19:55:17.383 INFO:teuthology.orchestra.run.smithi101.stdout: { 2023-08-01T19:55:17.383 INFO:teuthology.orchestra.run.smithi101.stdout: "description": "osd_op(client.4668.0:107867 5.f 5:ff29bbf7:::benchmark_data_smithi006_114134_object107866:head [set-alloc-hint object_size 65536 write_size 65536,write 0~65536] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e38)", 2023-08-01T19:55:17.383 INFO:teuthology.orchestra.run.smithi101.stdout: "initiated_at": "2023-08-01T19:55:09.280670+0000", 2023-08-01T19:55:17.383 INFO:teuthology.orchestra.run.smithi101.stdout: "age": 7.9339039659999999, 2023-08-01T19:55:17.383 INFO:teuthology.orchestra.run.smithi101.stdout: "duration": 0.069898092999999994, 2023-08-01T19:55:17.383 INFO:teuthology.orchestra.run.smithi101.stdout: "type_data": { 2023-08-01T19:55:17.384 INFO:teuthology.orchestra.run.smithi101.stdout: "flag_point": "commit sent; apply or cleanup", 2023-08-01T19:55:17.384 INFO:teuthology.orchestra.run.smithi101.stdout: "client_info": { 2023-08-01T19:55:17.384 INFO:teuthology.orchestra.run.smithi101.stdout: "client": "client.4668", 2023-08-01T19:55:17.384 INFO:teuthology.orchestra.run.smithi101.stdout: "client_addr": "172.21.15.6:0/1709472247", 2023-08-01T19:55:17.384 INFO:teuthology.orchestra.run.smithi101.stdout: "tid": 107867 2023-08-01T19:55:17.384 INFO:teuthology.orchestra.run.smithi101.stdout: }, 2023-08-01T19:55:17.384 INFO:teuthology.orchestra.run.smithi101.stdout: "events": [ 2023-08-01T19:55:17.384 INFO:teuthology.orchestra.run.smithi101.stdout: { 2023-08-01T19:55:17.385 INFO:teuthology.orchestra.run.smithi101.stdout: "event": "initiated", 2023-08-01T19:55:17.385 INFO:teuthology.orchestra.run.smithi101.stdout: "time": "2023-08-01T19:55:09.280670+0000", 2023-08-01T19:55:17.385 INFO:teuthology.orchestra.run.smithi101.stdout: "duration": 0 2023-08-01T19:55:17.385 INFO:teuthology.orchestra.run.smithi101.stdout: }, 2023-08-01T19:55:17.385 INFO:teuthology.orchestra.run.smithi101.stdout: { 2023-08-01T19:55:17.385 INFO:teuthology.orchestra.run.smithi101.stdout: "event": "throttled", 2023-08-01T19:55:17.385 INFO:teuthology.orchestra.run.smithi101.stdout: "time": "2023-08-01T19:55:09.280670+0000", 2023-08-01T19:55:17.386 INFO:teuthology.orchestra.run.smithi101.stdout: "duration": 0 2023-08-01T19:55:17.386 INFO:teuthology.orchestra.run.smithi101.stdout: }, 2023-08-01T19:55:17.386 INFO:teuthology.orchestra.run.smithi101.stdout: { 2023-08-01T19:55:17.386 INFO:teuthology.orchestra.run.smithi101.stdout: "event": "header_read", 2023-08-01T19:55:17.386 INFO:teuthology.orchestra.run.smithi101.stdout: "time": "2023-08-01T19:55:09.280670+0000", 2023-08-01T19:55:17.386 INFO:teuthology.orchestra.run.smithi101.stdout: "duration": 4294967295.9999995 2023-08-01T19:55:17.386 INFO:teuthology.orchestra.run.smithi101.stdout: }, 2023-08-01T19:55:17.386 INFO:teuthology.orchestra.run.smithi101.stdout: { 2023-08-01T19:55:17.387 INFO:teuthology.orchestra.run.smithi101.stdout: "event": "all_read", 2023-08-01T19:55:17.387 INFO:teuthology.orchestra.run.smithi101.stdout: "time": "2023-08-01T19:55:09.280690+0000", 2023-08-01T19:55:17.387 INFO:teuthology.orchestra.run.smithi101.stdout: "duration": 2.0526e-05 2023-08-01T19:55:17.387 INFO:teuthology.orchestra.run.smithi101.stdout: }, 2023-08-01T19:55:17.387 INFO:teuthology.orchestra.run.smithi101.stdout: { 2023-08-01T19:55:17.387 INFO:teuthology.orchestra.run.smithi101.stdout: "event": "dispatched", 2023-08-01T19:55:17.387 INFO:teuthology.orchestra.run.smithi101.stdout: "time": "2023-08-01T19:55:09.280695+0000", 2023-08-01T19:55:17.387 INFO:teuthology.orchestra.run.smithi101.stdout: "duration": 4.5140000000000003e-06 2023-08-01T19:55:17.388 INFO:teuthology.orchestra.run.smithi101.stdout: }, 2023-08-01T19:55:17.388 INFO:teuthology.orchestra.run.smithi101.stdout: { 2023-08-01T19:55:17.388 INFO:teuthology.orchestra.run.smithi101.stdout: "event": "queued_for_pg", 2023-08-01T19:55:17.388 INFO:teuthology.orchestra.run.smithi101.stdout: "time": "2023-08-01T19:55:09.280697+0000", 2023-08-01T19:55:17.388 INFO:teuthology.orchestra.run.smithi101.stdout: "duration": 2.6290000000000002e-06 2023-08-01T19:55:17.388 INFO:teuthology.orchestra.run.smithi101.stdout: }, 2023-08-01T19:55:17.388 INFO:teuthology.orchestra.run.smithi101.stdout: { 2023-08-01T19:55:17.389 INFO:teuthology.orchestra.run.smithi101.stdout: "event": "reached_pg", 2023-08-01T19:55:17.389 INFO:teuthology.orchestra.run.smithi101.stdout: "time": "2023-08-01T19:55:09.282392+0000", 2023-08-01T19:55:17.389 INFO:teuthology.orchestra.run.smithi101.stdout: "duration": 0.0016948709999999999 2023-08-01T19:55:17.389 INFO:teuthology.orchestra.run.smithi101.stdout: }, 2023-08-01T19:55:17.389 INFO:teuthology.orchestra.run.smithi101.stdout: { 2023-08-01T19:55:17.389 INFO:teuthology.orchestra.run.smithi101.stdout: "event": "started", 2023-08-01T19:55:17.389 INFO:teuthology.orchestra.run.smithi101.stdout: "time": "2023-08-01T19:55:09.282514+0000", 2023-08-01T19:55:17.389 INFO:teuthology.orchestra.run.smithi101.stdout: "duration": 0.000121839 2023-08-01T19:55:17.390 INFO:teuthology.orchestra.run.smithi101.stdout: }, 2023-08-01T19:55:17.390 INFO:teuthology.orchestra.run.smithi101.stdout: { 2023-08-01T19:55:17.390 INFO:teuthology.orchestra.run.smithi101.stdout: "event": "waiting for subops from 2", 2023-08-01T19:55:17.390 INFO:teuthology.orchestra.run.smithi101.stdout: "time": "2023-08-01T19:55:09.282664+0000", 2023-08-01T19:55:17.390 INFO:teuthology.orchestra.run.smithi101.stdout: "duration": 0.00014968699999999999 2023-08-01T19:55:17.390 INFO:teuthology.orchestra.run.smithi101.stdout: }, 2023-08-01T19:55:17.390 INFO:teuthology.orchestra.run.smithi101.stdout: { 2023-08-01T19:55:17.391 INFO:teuthology.orchestra.run.smithi101.stdout: "event": "sub_op_commit_rec", 2023-08-01T19:55:17.391 INFO:teuthology.orchestra.run.smithi101.stdout: "time": "2023-08-01T19:55:09.348344+0000", 2023-08-01T19:55:17.391 INFO:teuthology.orchestra.run.smithi101.stdout: "duration": 0.065680247999999997 2023-08-01T19:55:17.391 INFO:teuthology.orchestra.run.smithi101.stdout: }, 2023-08-01T19:55:17.391 INFO:teuthology.orchestra.run.smithi101.stdout: { 2023-08-01T19:55:17.391 INFO:teuthology.orchestra.run.smithi101.stdout: "event": "op_commit", 2023-08-01T19:55:17.391 INFO:teuthology.orchestra.run.smithi101.stdout: "time": "2023-08-01T19:55:09.350502+0000", 2023-08-01T19:55:17.391 INFO:teuthology.orchestra.run.smithi101.stdout: "duration": 0.0021578140000000001 2023-08-01T19:55:17.392 INFO:teuthology.orchestra.run.smithi101.stdout: }, 2023-08-01T19:55:17.392 INFO:teuthology.orchestra.run.smithi101.stdout: { 2023-08-01T19:55:17.392 INFO:teuthology.orchestra.run.smithi101.stdout: "event": "commit_sent", 2023-08-01T19:55:17.392 INFO:teuthology.orchestra.run.smithi101.stdout: "time": "2023-08-01T19:55:09.350529+0000", 2023-08-01T19:55:17.392 INFO:teuthology.orchestra.run.smithi101.stdout: "duration": 2.6838e-05 2023-08-01T19:55:17.392 INFO:teuthology.orchestra.run.smithi101.stdout: }, 2023-08-01T19:55:17.392 INFO:teuthology.orchestra.run.smithi101.stdout: { 2023-08-01T19:55:17.393 INFO:teuthology.orchestra.run.smithi101.stdout: "event": "done", 2023-08-01T19:55:17.393 INFO:teuthology.orchestra.run.smithi101.stdout: "time": "2023-08-01T19:55:09.350568+0000", 2023-08-01T19:55:17.393 INFO:teuthology.orchestra.run.smithi101.stdout: "duration": 3.9477000000000002e-05 2023-08-01T19:55:17.393 INFO:teuthology.orchestra.run.smithi101.stdout: } 2023-08-01T19:55:17.393 INFO:teuthology.orchestra.run.smithi101.stdout: ] 2023-08-01T19:55:17.393 INFO:teuthology.orchestra.run.smithi101.stdout: } 2023-08-01T19:55:17.393 INFO:teuthology.orchestra.run.smithi101.stdout: }, 2023-08-01T19:55:17.393 INFO:teuthology.orchestra.run.smithi101.stdout: { 2023-08-01T19:55:17.394 INFO:teuthology.orchestra.run.smithi101.stdout: "description": "osd_repop(client.4668.0:107863 5.3 e38/19 5:cbdd875a:::benchmark_data_smithi006_114134_object107862:head v 38'6829, mlcod=38'6826)", 2023-08-01T19:55:17.394 INFO:teuthology.orchestra.run.smithi101.stdout: "initiated_at": "2023-08-01T19:55:09.280747+0000", 2023-08-01T19:55:17.394 INFO:teuthology.orchestra.run.smithi101.stdout: "age": 7.9338270170000005, 2023-08-01T19:55:17.394 INFO:teuthology.orchestra.run.smithi101.stdout: "duration": 0.069343305999999993, 2023-08-01T19:55:17.394 INFO:teuthology.orchestra.run.smithi101.stdout: "type_data": { 2023-08-01T19:55:17.394 INFO:teuthology.orchestra.run.smithi101.stdout: "flag_point": "commit sent; apply or cleanup", 2023-08-01T19:55:17.394 INFO:teuthology.orchestra.run.smithi101.stdout: "events": [ 2023-08-01T19:55:17.394 INFO:teuthology.orchestra.run.smithi101.stdout: { 2023-08-01T19:55:17.395 INFO:teuthology.orchestra.run.smithi101.stdout: "event": "initiated", 2023-08-01T19:55:17.395 INFO:teuthology.orchestra.run.smithi101.stdout: "time": "2023-08-01T19:55:09.280747+0000", 2023-08-01T19:55:17.395 INFO:teuthology.orchestra.run.smithi101.stdout: "duration": 0 2023-08-01T19:55:17.395 INFO:teuthology.orchestra.run.smithi101.stdout: }, 2023-08-01T19:55:17.395 INFO:teuthology.orchestra.run.smithi101.stdout: { 2023-08-01T19:55:17.395 INFO:teuthology.orchestra.run.smithi101.stdout: "event": "throttled", 2023-08-01T19:55:17.395 INFO:teuthology.orchestra.run.smithi101.stdout: "time": "2023-08-01T19:55:09.280747+0000", 2023-08-01T19:55:17.396 INFO:teuthology.orchestra.run.smithi101.stdout: "duration": 0 2023-08-01T19:55:17.396 INFO:teuthology.orchestra.run.smithi101.stdout: }, 2023-08-01T19:55:17.396 INFO:teuthology.orchestra.run.smithi101.stdout: { 2023-08-01T19:55:17.396 INFO:teuthology.orchestra.run.smithi101.stdout: "event": "header_read", 2023-08-01T19:55:17.396 INFO:teuthology.orchestra.run.smithi101.stdout: "time": "2023-08-01T19:55:09.280746+0000", 2023-08-01T19:55:17.396 INFO:teuthology.orchestra.run.smithi101.stdout: "duration": 4294967295.9999995 2023-08-01T19:55:17.396 INFO:teuthology.orchestra.run.smithi101.stdout: }, 2023-08-01T19:55:17.396 INFO:teuthology.orchestra.run.smithi101.stdout: { 2023-08-01T19:55:17.397 INFO:teuthology.orchestra.run.smithi101.stdout: "event": "all_read", 2023-08-01T19:55:17.397 INFO:teuthology.orchestra.run.smithi101.stdout: "time": "2023-08-01T19:55:09.280798+0000", 2023-08-01T19:55:17.397 INFO:teuthology.orchestra.run.smithi101.stdout: "duration": 5.1706000000000003e-05 2023-08-01T19:55:17.397 INFO:teuthology.orchestra.run.smithi101.stdout: }, 2023-08-01T19:55:17.397 INFO:teuthology.orchestra.run.smithi101.stdout: { 2023-08-01T19:55:17.397 INFO:teuthology.orchestra.run.smithi101.stdout: "event": "dispatched", 2023-08-01T19:55:17.397 INFO:teuthology.orchestra.run.smithi101.stdout: "time": "2023-08-01T19:55:09.280807+0000", 2023-08-01T19:55:17.397 INFO:teuthology.orchestra.run.smithi101.stdout: "duration": 8.4889999999999995e-06 2023-08-01T19:55:17.398 INFO:teuthology.orchestra.run.smithi101.stdout: }, 2023-08-01T19:55:17.398 INFO:teuthology.orchestra.run.smithi101.stdout: { 2023-08-01T19:55:17.398 INFO:teuthology.orchestra.run.smithi101.stdout: "event": "queued_for_pg", 2023-08-01T19:55:17.398 INFO:teuthology.orchestra.run.smithi101.stdout: "time": "2023-08-01T19:55:09.280812+0000", 2023-08-01T19:55:17.398 INFO:teuthology.orchestra.run.smithi101.stdout: "duration": 5.2120000000000002e-06 2023-08-01T19:55:17.398 INFO:teuthology.orchestra.run.smithi101.stdout: }, 2023-08-01T19:55:17.398 INFO:teuthology.orchestra.run.smithi101.stdout: { 2023-08-01T19:55:17.398 INFO:teuthology.orchestra.run.smithi101.stdout: "event": "reached_pg", 2023-08-01T19:55:17.399 INFO:teuthology.orchestra.run.smithi101.stdout: "time": "2023-08-01T19:55:09.280843+0000", 2023-08-01T19:55:17.399 INFO:teuthology.orchestra.run.smithi101.stdout: "duration": 3.1406999999999999e-05 2023-08-01T19:55:17.399 INFO:teuthology.orchestra.run.smithi101.stdout: }, 2023-08-01T19:55:17.399 INFO:teuthology.orchestra.run.smithi101.stdout: { 2023-08-01T19:55:17.399 INFO:teuthology.orchestra.run.smithi101.stdout: "event": "started", 2023-08-01T19:55:17.399 INFO:teuthology.orchestra.run.smithi101.stdout: "time": "2023-08-01T19:55:09.280860+0000", 2023-08-01T19:55:17.399 INFO:teuthology.orchestra.run.smithi101.stdout: "duration": 1.6283999999999999e-05 2023-08-01T19:55:17.399 INFO:teuthology.orchestra.run.smithi101.stdout: }, 2023-08-01T19:55:17.400 INFO:teuthology.orchestra.run.smithi101.stdout: { 2023-08-01T19:55:17.400 INFO:teuthology.orchestra.run.smithi101.stdout: "event": "commit_sent", 2023-08-01T19:55:17.400 INFO:teuthology.orchestra.run.smithi101.stdout: "time": "2023-08-01T19:55:09.350059+0000", 2023-08-01T19:55:17.400 INFO:teuthology.orchestra.run.smithi101.stdout: "duration": 0.069199094000000003 2023-08-01T19:55:17.400 INFO:teuthology.orchestra.run.smithi101.stdout: }, 2023-08-01T19:55:17.400 INFO:teuthology.orchestra.run.smithi101.stdout: { 2023-08-01T19:55:17.400 INFO:teuthology.orchestra.run.smithi101.stdout: "event": "done", 2023-08-01T19:55:17.401 INFO:teuthology.orchestra.run.smithi101.stdout: "time": "2023-08-01T19:55:09.350090+0000", 2023-08-01T19:55:17.401 INFO:teuthology.orchestra.run.smithi101.stdout: "duration": 3.1736000000000002e-05 2023-08-01T19:55:17.401 INFO:teuthology.orchestra.run.smithi101.stdout: } 2023-08-01T19:55:17.401 INFO:teuthology.orchestra.run.smithi101.stdout: ] 2023-08-01T19:55:17.401 INFO:teuthology.orchestra.run.smithi101.stdout: } 2023-08-01T19:55:17.401 INFO:teuthology.orchestra.run.smithi101.stdout: }, 2023-08-01T19:55:17.401 INFO:teuthology.orchestra.run.smithi101.stdout: { 2023-08-01T19:55:17.401 INFO:teuthology.orchestra.run.smithi101.stdout: "description": "osd_repop(client.4668.0:107865 5.3 e38/19 5:c2ebb96d:::benchmark_data_smithi006_114134_object107864:head v 38'6830, mlcod=38'6826)", 2023-08-01T19:55:17.402 INFO:teuthology.orchestra.run.smithi101.stdout: "initiated_at": "2023-08-01T19:55:09.283182+0000", 2023-08-01T19:55:17.402 INFO:teuthology.orchestra.run.smithi101.stdout: "age": 7.9313917089999997, 2023-08-01T19:55:17.402 INFO:teuthology.orchestra.run.smithi101.stdout: "duration": 0.068554793000000003, 2023-08-01T19:55:17.402 INFO:teuthology.orchestra.run.smithi101.stdout: "type_data": { 2023-08-01T19:55:17.402 INFO:teuthology.orchestra.run.smithi101.stdout: "flag_point": "commit sent; apply or cleanup", 2023-08-01T19:55:17.402 INFO:teuthology.orchestra.run.smithi101.stdout: "events": [ 2023-08-01T19:55:17.402 INFO:teuthology.orchestra.run.smithi101.stdout: { 2023-08-01T19:55:17.402 INFO:teuthology.orchestra.run.smithi101.stdout: "event": "initiated", 2023-08-01T19:55:17.403 INFO:teuthology.orchestra.run.smithi101.stdout: "time": "2023-08-01T19:55:09.283182+0000", 2023-08-01T19:55:17.403 INFO:teuthology.orchestra.run.smithi101.stdout: "duration": 0 2023-08-01T19:55:17.403 INFO:teuthology.orchestra.run.smithi101.stdout: }, 2023-08-01T19:55:17.403 INFO:teuthology.orchestra.run.smithi101.stdout: { 2023-08-01T19:55:17.403 INFO:teuthology.orchestra.run.smithi101.stdout: "event": "throttled", 2023-08-01T19:55:17.403 INFO:teuthology.orchestra.run.smithi101.stdout: "time": "2023-08-01T19:55:09.283182+0000", 2023-08-01T19:55:17.403 INFO:teuthology.orchestra.run.smithi101.stdout: "duration": 0 2023-08-01T19:55:17.403 INFO:teuthology.orchestra.run.smithi101.stdout: }, 2023-08-01T19:55:17.404 INFO:teuthology.orchestra.run.smithi101.stdout: { 2023-08-01T19:55:17.404 INFO:teuthology.orchestra.run.smithi101.stdout: "event": "header_read", 2023-08-01T19:55:17.404 INFO:teuthology.orchestra.run.smithi101.stdout: "time": "2023-08-01T19:55:09.283182+0000", 2023-08-01T19:55:17.404 INFO:teuthology.orchestra.run.smithi101.stdout: "duration": 4294967295.9999995 2023-08-01T19:55:17.404 INFO:teuthology.orchestra.run.smithi101.stdout: }, 2023-08-01T19:55:17.404 INFO:teuthology.orchestra.run.smithi101.stdout: { 2023-08-01T19:55:17.404 INFO:teuthology.orchestra.run.smithi101.stdout: "event": "all_read", 2023-08-01T19:55:17.405 INFO:teuthology.orchestra.run.smithi101.stdout: "time": "2023-08-01T19:55:09.283233+0000", 2023-08-01T19:55:17.405 INFO:teuthology.orchestra.run.smithi101.stdout: "duration": 5.1511999999999997e-05 2023-08-01T19:55:17.405 INFO:teuthology.orchestra.run.smithi101.stdout: }, 2023-08-01T19:55:17.405 INFO:teuthology.orchestra.run.smithi101.stdout: { 2023-08-01T19:55:17.405 INFO:teuthology.orchestra.run.smithi101.stdout: "event": "dispatched", 2023-08-01T19:55:17.405 INFO:teuthology.orchestra.run.smithi101.stdout: "time": "2023-08-01T19:55:09.283239+0000", 2023-08-01T19:55:17.405 INFO:teuthology.orchestra.run.smithi101.stdout: "duration": 5.6640000000000003e-06 2023-08-01T19:55:17.406 INFO:teuthology.orchestra.run.smithi101.stdout: }, 2023-08-01T19:55:17.406 INFO:teuthology.orchestra.run.smithi101.stdout: { 2023-08-01T19:55:17.406 INFO:teuthology.orchestra.run.smithi101.stdout: "event": "queued_for_pg", 2023-08-01T19:55:17.406 INFO:teuthology.orchestra.run.smithi101.stdout: "time": "2023-08-01T19:55:09.283242+0000", 2023-08-01T19:55:17.406 INFO:teuthology.orchestra.run.smithi101.stdout: "duration": 2.9639999999999999e-06 2023-08-01T19:55:17.406 INFO:teuthology.orchestra.run.smithi101.stdout: }, 2023-08-01T19:55:17.406 INFO:teuthology.orchestra.run.smithi101.stdout: { 2023-08-01T19:55:17.406 INFO:teuthology.orchestra.run.smithi101.stdout: "event": "reached_pg", 2023-08-01T19:55:17.407 INFO:teuthology.orchestra.run.smithi101.stdout: "time": "2023-08-01T19:55:09.283276+0000", 2023-08-01T19:55:17.407 INFO:teuthology.orchestra.run.smithi101.stdout: "duration": 3.3631999999999999e-05 2023-08-01T19:55:17.407 INFO:teuthology.orchestra.run.smithi101.stdout: }, 2023-08-01T19:55:17.407 INFO:teuthology.orchestra.run.smithi101.stdout: { 2023-08-01T19:55:17.407 INFO:teuthology.orchestra.run.smithi101.stdout: "event": "started", 2023-08-01T19:55:17.407 INFO:teuthology.orchestra.run.smithi101.stdout: "time": "2023-08-01T19:55:09.283288+0000", 2023-08-01T19:55:17.407 INFO:teuthology.orchestra.run.smithi101.stdout: "duration": 1.1816e-05 2023-08-01T19:55:17.407 INFO:teuthology.orchestra.run.smithi101.stdout: }, 2023-08-01T19:55:17.408 INFO:teuthology.orchestra.run.smithi101.stdout: { 2023-08-01T19:55:17.408 INFO:teuthology.orchestra.run.smithi101.stdout: "event": "commit_sent", 2023-08-01T19:55:17.408 INFO:teuthology.orchestra.run.smithi101.stdout: "time": "2023-08-01T19:55:09.351712+0000", 2023-08-01T19:55:17.408 INFO:teuthology.orchestra.run.smithi101.stdout: "duration": 0.068424311000000002 2023-08-01T19:55:17.408 INFO:teuthology.orchestra.run.smithi101.stdout: }, 2023-08-01T19:55:17.408 INFO:teuthology.orchestra.run.smithi101.stdout: { 2023-08-01T19:55:17.408 INFO:teuthology.orchestra.run.smithi101.stdout: "event": "done", 2023-08-01T19:55:17.409 INFO:teuthology.orchestra.run.smithi101.stdout: "time": "2023-08-01T19:55:09.351737+0000", 2023-08-01T19:55:17.409 INFO:teuthology.orchestra.run.smithi101.stdout: "duration": 2.5364999999999999e-05 2023-08-01T19:55:17.409 INFO:teuthology.orchestra.run.smithi101.stdout: } 2023-08-01T19:55:17.409 INFO:teuthology.orchestra.run.smithi101.stdout: ] 2023-08-01T19:55:17.409 INFO:teuthology.orchestra.run.smithi101.stdout: } 2023-08-01T19:55:17.409 INFO:teuthology.orchestra.run.smithi101.stdout: }, 2023-08-01T19:55:17.409 INFO:teuthology.orchestra.run.smithi101.stdout: { 2023-08-01T19:55:17.409 INFO:teuthology.orchestra.run.smithi101.stdout: "description": "osd_repop(client.4668.0:107869 5.c e38/19 5:31910384:::benchmark_data_smithi006_114134_object107868:head v 38'6761, mlcod=38'6759)", 2023-08-01T19:55:17.410 INFO:teuthology.orchestra.run.smithi101.stdout: "initiated_at": "2023-08-01T19:55:09.283762+0000", 2023-08-01T19:55:17.410 INFO:teuthology.orchestra.run.smithi101.stdout: "age": 7.9308123730000002, 2023-08-01T19:55:17.410 INFO:teuthology.orchestra.run.smithi101.stdout: "duration": 0.067877541, 2023-08-01T19:55:17.410 INFO:teuthology.orchestra.run.smithi101.stdout: "type_data": { 2023-08-01T19:55:17.410 INFO:teuthology.orchestra.run.smithi101.stdout: "flag_point": "commit sent; apply or cleanup", 2023-08-01T19:55:17.410 INFO:teuthology.orchestra.run.smithi101.stdout: "events": [ 2023-08-01T19:55:17.410 INFO:teuthology.orchestra.run.smithi101.stdout: { 2023-08-01T19:55:17.411 INFO:teuthology.orchestra.run.smithi101.stdout: "event": "initiated", 2023-08-01T19:55:17.411 INFO:teuthology.orchestra.run.smithi101.stdout: "time": "2023-08-01T19:55:09.283762+0000", 2023-08-01T19:55:17.411 INFO:teuthology.orchestra.run.smithi101.stdout: "duration": 0 2023-08-01T19:55:17.411 INFO:teuthology.orchestra.run.smithi101.stdout: }, 2023-08-01T19:55:17.411 INFO:teuthology.orchestra.run.smithi101.stdout: { 2023-08-01T19:55:17.411 INFO:teuthology.orchestra.run.smithi101.stdout: "event": "throttled", 2023-08-01T19:55:17.411 INFO:teuthology.orchestra.run.smithi101.stdout: "time": "2023-08-01T19:55:09.283762+0000", 2023-08-01T19:55:17.411 INFO:teuthology.orchestra.run.smithi101.stdout: "duration": 0 2023-08-01T19:55:17.412 INFO:teuthology.orchestra.run.smithi101.stdout: }, 2023-08-01T19:55:17.412 INFO:teuthology.orchestra.run.smithi101.stdout: { 2023-08-01T19:55:17.412 INFO:teuthology.orchestra.run.smithi101.stdout: "event": "header_read", 2023-08-01T19:55:17.412 INFO:teuthology.orchestra.run.smithi101.stdout: "time": "2023-08-01T19:55:09.283761+0000", 2023-08-01T19:55:17.412 INFO:teuthology.orchestra.run.smithi101.stdout: "duration": 4294967295.9999995 2023-08-01T19:55:17.412 INFO:teuthology.orchestra.run.smithi101.stdout: }, 2023-08-01T19:55:17.412 INFO:teuthology.orchestra.run.smithi101.stdout: { 2023-08-01T19:55:17.413 INFO:teuthology.orchestra.run.smithi101.stdout: "event": "all_read", 2023-08-01T19:55:17.413 INFO:teuthology.orchestra.run.smithi101.stdout: "time": "2023-08-01T19:55:09.283825+0000", 2023-08-01T19:55:17.413 INFO:teuthology.orchestra.run.smithi101.stdout: "duration": 6.3200000000000005e-05 2023-08-01T19:55:17.413 INFO:teuthology.orchestra.run.smithi101.stdout: }, 2023-08-01T19:55:17.413 INFO:teuthology.orchestra.run.smithi101.stdout: { 2023-08-01T19:55:17.413 INFO:teuthology.orchestra.run.smithi101.stdout: "event": "dispatched", 2023-08-01T19:55:17.413 INFO:teuthology.orchestra.run.smithi101.stdout: "time": "2023-08-01T19:55:09.345759+0000", 2023-08-01T19:55:17.413 INFO:teuthology.orchestra.run.smithi101.stdout: "duration": 0.061934221999999997 2023-08-01T19:55:17.414 INFO:teuthology.orchestra.run.smithi101.stdout: }, 2023-08-01T19:55:17.414 INFO:teuthology.orchestra.run.smithi101.stdout: { 2023-08-01T19:55:17.414 INFO:teuthology.orchestra.run.smithi101.stdout: "event": "queued_for_pg", 2023-08-01T19:55:17.414 INFO:teuthology.orchestra.run.smithi101.stdout: "time": "2023-08-01T19:55:09.345768+0000", 2023-08-01T19:55:17.414 INFO:teuthology.orchestra.run.smithi101.stdout: "duration": 8.7099999999999996e-06 2023-08-01T19:55:17.414 INFO:teuthology.orchestra.run.smithi101.stdout: }, 2023-08-01T19:55:17.414 INFO:teuthology.orchestra.run.smithi101.stdout: { 2023-08-01T19:55:17.414 INFO:teuthology.orchestra.run.smithi101.stdout: "event": "reached_pg", 2023-08-01T19:55:17.415 INFO:teuthology.orchestra.run.smithi101.stdout: "time": "2023-08-01T19:55:09.345832+0000", 2023-08-01T19:55:17.415 INFO:teuthology.orchestra.run.smithi101.stdout: "duration": 6.4769000000000003e-05 2023-08-01T19:55:17.415 INFO:teuthology.orchestra.run.smithi101.stdout: }, 2023-08-01T19:55:17.415 INFO:teuthology.orchestra.run.smithi101.stdout: { 2023-08-01T19:55:17.415 INFO:teuthology.orchestra.run.smithi101.stdout: "event": "started", 2023-08-01T19:55:17.415 INFO:teuthology.orchestra.run.smithi101.stdout: "time": "2023-08-01T19:55:09.345851+0000", 2023-08-01T19:55:17.415 INFO:teuthology.orchestra.run.smithi101.stdout: "duration": 1.9049e-05 2023-08-01T19:55:17.415 INFO:teuthology.orchestra.run.smithi101.stdout: }, 2023-08-01T19:55:17.416 INFO:teuthology.orchestra.run.smithi101.stdout: { 2023-08-01T19:55:17.416 INFO:teuthology.orchestra.run.smithi101.stdout: "event": "commit_sent", 2023-08-01T19:55:17.416 INFO:teuthology.orchestra.run.smithi101.stdout: "time": "2023-08-01T19:55:09.351601+0000", 2023-08-01T19:55:17.416 INFO:teuthology.orchestra.run.smithi101.stdout: "duration": 0.0057499930000000001 2023-08-01T19:55:17.416 INFO:teuthology.orchestra.run.smithi101.stdout: }, 2023-08-01T19:55:17.416 INFO:teuthology.orchestra.run.smithi101.stdout: { 2023-08-01T19:55:17.416 INFO:teuthology.orchestra.run.smithi101.stdout: "event": "done", 2023-08-01T19:55:17.417 INFO:teuthology.orchestra.run.smithi101.stdout: "time": "2023-08-01T19:55:09.351639+0000", 2023-08-01T19:55:17.417 INFO:teuthology.orchestra.run.smithi101.stdout: "duration": 3.7941000000000001e-05 2023-08-01T19:55:17.417 INFO:teuthology.orchestra.run.smithi101.stdout: } 2023-08-01T19:55:17.417 INFO:teuthology.orchestra.run.smithi101.stdout: ] 2023-08-01T19:55:17.417 INFO:teuthology.orchestra.run.smithi101.stdout: } 2023-08-01T19:55:17.417 INFO:teuthology.orchestra.run.smithi101.stdout: }, 2023-08-01T19:55:17.417 INFO:teuthology.orchestra.run.smithi101.stdout: { 2023-08-01T19:55:17.417 INFO:teuthology.orchestra.run.smithi101.stdout: "description": "osd_op(client.4668.0:107876 5.1 5:8d2344a3:::benchmark_data_smithi006_114134_object107875:head [set-alloc-hint object_size 65536 write_size 65536,write 0~65536] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e38)", 2023-08-01T19:55:17.418 INFO:teuthology.orchestra.run.smithi101.stdout: "initiated_at": "2023-08-01T19:55:09.287802+0000", 2023-08-01T19:55:17.418 INFO:teuthology.orchestra.run.smithi101.stdout: "age": 7.9267720529999997, 2023-08-01T19:55:17.418 INFO:teuthology.orchestra.run.smithi101.stdout: "duration": 0.066738461999999998, 2023-08-01T19:55:17.418 INFO:teuthology.orchestra.run.smithi101.stdout: "type_data": { 2023-08-01T19:55:17.418 INFO:teuthology.orchestra.run.smithi101.stdout: "flag_point": "commit sent; apply or cleanup", 2023-08-01T19:55:17.418 INFO:teuthology.orchestra.run.smithi101.stdout: "client_info": { 2023-08-01T19:55:17.418 INFO:teuthology.orchestra.run.smithi101.stdout: "client": "client.4668", 2023-08-01T19:55:17.418 INFO:teuthology.orchestra.run.smithi101.stdout: "client_addr": "172.21.15.6:0/1709472247", 2023-08-01T19:55:17.419 INFO:teuthology.orchestra.run.smithi101.stdout: "tid": 107876 2023-08-01T19:55:17.419 INFO:teuthology.orchestra.run.smithi101.stdout: }, 2023-08-01T19:55:17.419 INFO:teuthology.orchestra.run.smithi101.stdout: "events": [ 2023-08-01T19:55:17.419 INFO:teuthology.orchestra.run.smithi101.stdout: { 2023-08-01T19:55:17.419 INFO:teuthology.orchestra.run.smithi101.stdout: "event": "initiated", 2023-08-01T19:55:17.419 INFO:teuthology.orchestra.run.smithi101.stdout: "time": "2023-08-01T19:55:09.287802+0000", 2023-08-01T19:55:17.419 INFO:teuthology.orchestra.run.smithi101.stdout: "duration": 0 2023-08-01T19:55:17.419 INFO:teuthology.orchestra.run.smithi101.stdout: }, 2023-08-01T19:55:17.420 INFO:teuthology.orchestra.run.smithi101.stdout: { 2023-08-01T19:55:17.420 INFO:teuthology.orchestra.run.smithi101.stdout: "event": "throttled", 2023-08-01T19:55:17.420 INFO:teuthology.orchestra.run.smithi101.stdout: "time": "2023-08-01T19:55:09.287802+0000", 2023-08-01T19:55:17.420 INFO:teuthology.orchestra.run.smithi101.stdout: "duration": 0 2023-08-01T19:55:17.420 INFO:teuthology.orchestra.run.smithi101.stdout: }, 2023-08-01T19:55:17.420 INFO:teuthology.orchestra.run.smithi101.stdout: { 2023-08-01T19:55:17.420 INFO:teuthology.orchestra.run.smithi101.stdout: "event": "header_read", 2023-08-01T19:55:17.421 INFO:teuthology.orchestra.run.smithi101.stdout: "time": "2023-08-01T19:55:09.287800+0000", 2023-08-01T19:55:17.421 INFO:teuthology.orchestra.run.smithi101.stdout: "duration": 4294967295.9999981 2023-08-01T19:55:17.421 INFO:teuthology.orchestra.run.smithi101.stdout: }, 2023-08-01T19:55:17.421 INFO:teuthology.orchestra.run.smithi101.stdout: { 2023-08-01T19:55:17.421 INFO:teuthology.orchestra.run.smithi101.stdout: "event": "all_read", 2023-08-01T19:55:17.421 INFO:teuthology.orchestra.run.smithi101.stdout: "time": "2023-08-01T19:55:09.287847+0000", 2023-08-01T19:55:17.421 INFO:teuthology.orchestra.run.smithi101.stdout: "duration": 4.6455999999999997e-05 2023-08-01T19:55:17.421 INFO:teuthology.orchestra.run.smithi101.stdout: }, 2023-08-01T19:55:17.422 INFO:teuthology.orchestra.run.smithi101.stdout: { 2023-08-01T19:55:17.422 INFO:teuthology.orchestra.run.smithi101.stdout: "event": "dispatched", 2023-08-01T19:55:17.422 INFO:teuthology.orchestra.run.smithi101.stdout: "time": "2023-08-01T19:55:09.345732+0000", 2023-08-01T19:55:17.422 INFO:teuthology.orchestra.run.smithi101.stdout: "duration": 0.057885955000000003 2023-08-01T19:55:17.422 INFO:teuthology.orchestra.run.smithi101.stdout: }, 2023-08-01T19:55:17.422 INFO:teuthology.orchestra.run.smithi101.stdout: { 2023-08-01T19:55:17.422 INFO:teuthology.orchestra.run.smithi101.stdout: "event": "queued_for_pg", 2023-08-01T19:55:17.423 INFO:teuthology.orchestra.run.smithi101.stdout: "time": "2023-08-01T19:55:09.345802+0000", 2023-08-01T19:55:17.423 INFO:teuthology.orchestra.run.smithi101.stdout: "duration": 6.9845000000000006e-05 2023-08-01T19:55:17.423 INFO:teuthology.orchestra.run.smithi101.stdout: }, 2023-08-01T19:55:17.423 INFO:teuthology.orchestra.run.smithi101.stdout: { 2023-08-01T19:55:17.423 INFO:teuthology.orchestra.run.smithi101.stdout: "event": "reached_pg", 2023-08-01T19:55:17.423 INFO:teuthology.orchestra.run.smithi101.stdout: "time": "2023-08-01T19:55:09.345841+0000", 2023-08-01T19:55:17.423 INFO:teuthology.orchestra.run.smithi101.stdout: "duration": 3.8719e-05 2023-08-01T19:55:17.424 INFO:teuthology.orchestra.run.smithi101.stdout: }, 2023-08-01T19:55:17.424 INFO:teuthology.orchestra.run.smithi101.stdout: { 2023-08-01T19:55:17.424 INFO:teuthology.orchestra.run.smithi101.stdout: "event": "started", 2023-08-01T19:55:17.424 INFO:teuthology.orchestra.run.smithi101.stdout: "time": "2023-08-01T19:55:09.345965+0000", 2023-08-01T19:55:17.424 INFO:teuthology.orchestra.run.smithi101.stdout: "duration": 0.00012353099999999999 2023-08-01T19:55:17.424 INFO:teuthology.orchestra.run.smithi101.stdout: }, 2023-08-01T19:55:17.424 INFO:teuthology.orchestra.run.smithi101.stdout: { 2023-08-01T19:55:17.424 INFO:teuthology.orchestra.run.smithi101.stdout: "event": "waiting for subops from 0", 2023-08-01T19:55:17.425 INFO:teuthology.orchestra.run.smithi101.stdout: "time": "2023-08-01T19:55:09.346113+0000", 2023-08-01T19:55:17.425 INFO:teuthology.orchestra.run.smithi101.stdout: "duration": 0.000148496 2023-08-01T19:55:17.425 INFO:teuthology.orchestra.run.smithi101.stdout: }, 2023-08-01T19:55:17.425 INFO:teuthology.orchestra.run.smithi101.stdout: { 2023-08-01T19:55:17.425 INFO:teuthology.orchestra.run.smithi101.stdout: "event": "sub_op_commit_rec", 2023-08-01T19:55:17.425 INFO:teuthology.orchestra.run.smithi101.stdout: "time": "2023-08-01T19:55:09.352561+0000", 2023-08-01T19:55:17.425 INFO:teuthology.orchestra.run.smithi101.stdout: "duration": 0.0064478890000000001 2023-08-01T19:55:17.425 INFO:teuthology.orchestra.run.smithi101.stdout: }, 2023-08-01T19:55:17.426 INFO:teuthology.orchestra.run.smithi101.stdout: { 2023-08-01T19:55:17.426 INFO:teuthology.orchestra.run.smithi101.stdout: "event": "op_commit", 2023-08-01T19:55:17.426 INFO:teuthology.orchestra.run.smithi101.stdout: "time": "2023-08-01T19:55:09.354475+0000", 2023-08-01T19:55:17.426 INFO:teuthology.orchestra.run.smithi101.stdout: "duration": 0.001913903 2023-08-01T19:55:17.426 INFO:teuthology.orchestra.run.smithi101.stdout: }, 2023-08-01T19:55:17.426 INFO:teuthology.orchestra.run.smithi101.stdout: { 2023-08-01T19:55:17.426 INFO:teuthology.orchestra.run.smithi101.stdout: "event": "commit_sent", 2023-08-01T19:55:17.426 INFO:teuthology.orchestra.run.smithi101.stdout: "time": "2023-08-01T19:55:09.354514+0000", 2023-08-01T19:55:17.427 INFO:teuthology.orchestra.run.smithi101.stdout: "duration": 3.8680999999999998e-05 2023-08-01T19:55:17.427 INFO:teuthology.orchestra.run.smithi101.stdout: }, 2023-08-01T19:55:17.427 INFO:teuthology.orchestra.run.smithi101.stdout: { 2023-08-01T19:55:17.427 INFO:teuthology.orchestra.run.smithi101.stdout: "event": "done", 2023-08-01T19:55:17.427 INFO:teuthology.orchestra.run.smithi101.stdout: "time": "2023-08-01T19:55:09.354541+0000", 2023-08-01T19:55:17.427 INFO:teuthology.orchestra.run.smithi101.stdout: "duration": 2.6976999999999999e-05 2023-08-01T19:55:17.427 INFO:teuthology.orchestra.run.smithi101.stdout: } 2023-08-01T19:55:17.427 INFO:teuthology.orchestra.run.smithi101.stdout: ] 2023-08-01T19:55:17.428 INFO:teuthology.orchestra.run.smithi101.stdout: } 2023-08-01T19:55:17.428 INFO:teuthology.orchestra.run.smithi101.stdout: } 2023-08-01T19:55:17.428 INFO:teuthology.orchestra.run.smithi101.stdout: ] 2023-08-01T19:55:17.428 INFO:teuthology.orchestra.run.smithi101.stdout:} 2023-08-01T19:55:17.429 INFO:tasks.radosbench.radosbench.0.smithi006.stdout: 53 16 120817 120801 142.442 114.688 0.00908386 0.00701764 2023-08-01T19:55:17.430 INFO:tasks.ceph.osd.2.smithi155.stderr:2023-08-01T19:55:17.427+0000 7faa5c6ac700 -1 received signal: Hangup from /usr/bin/python3 /bin/daemon-helper kill ceph-osd -f --cluster ceph -i 2 (PID: 111337) UID: 0 2023-08-01T19:55:17.430 DEBUG:teuthology.orchestra.run.smithi155:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 30 ceph --cluster ceph --admin-daemon /var/run/ceph/ceph-osd.2.asok dump_ops_in_flight 2023-08-01T19:55:17.531 INFO:tasks.ceph.osd.0.smithi008.stderr:2023-08-01T19:55:17.529+0000 7f16a58f4700 -1 received signal: Hangup from /usr/bin/python3 /bin/daemon-helper kill ceph-osd -f --cluster ceph -i 0 (PID: 111179) UID: 0 2023-08-01T19:55:17.603 INFO:teuthology.orchestra.run.smithi155.stdout:{ 2023-08-01T19:55:17.604 INFO:teuthology.orchestra.run.smithi155.stdout: "ops": [ 2023-08-01T19:55:17.604 INFO:teuthology.orchestra.run.smithi155.stdout: { 2023-08-01T19:55:17.604 INFO:teuthology.orchestra.run.smithi155.stdout: "description": "osd_op(client.4668.0:121343 5.d 5:bf7d0226:::benchmark_data_smithi006_114134_object121342:head [set-alloc-hint object_size 65536 write_size 65536,write 0~65536 in=65536b] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e43)", 2023-08-01T19:55:17.604 INFO:teuthology.orchestra.run.smithi155.stdout: "initiated_at": "2023-08-01T19:55:17.593917+0000", 2023-08-01T19:55:17.604 INFO:teuthology.orchestra.run.smithi155.stdout: "age": 0.0079589099999999996, 2023-08-01T19:55:17.604 INFO:teuthology.orchestra.run.smithi155.stdout: "duration": 0.0079867270000000008, 2023-08-01T19:55:17.604 INFO:teuthology.orchestra.run.smithi155.stdout: "type_data": { 2023-08-01T19:55:17.605 INFO:teuthology.orchestra.run.smithi155.stdout: "flag_point": "waiting for sub ops", 2023-08-01T19:55:17.605 INFO:teuthology.orchestra.run.smithi155.stdout: "client_info": { 2023-08-01T19:55:17.605 INFO:teuthology.orchestra.run.smithi155.stdout: "client": "client.4668", 2023-08-01T19:55:17.605 INFO:teuthology.orchestra.run.smithi155.stdout: "client_addr": "172.21.15.6:0/1709472247", 2023-08-01T19:55:17.605 INFO:teuthology.orchestra.run.smithi155.stdout: "tid": 121343 2023-08-01T19:55:17.605 INFO:teuthology.orchestra.run.smithi155.stdout: }, 2023-08-01T19:55:17.605 INFO:teuthology.orchestra.run.smithi155.stdout: "events": [ 2023-08-01T19:55:17.606 INFO:teuthology.orchestra.run.smithi155.stdout: { 2023-08-01T19:55:17.606 INFO:teuthology.orchestra.run.smithi155.stdout: "event": "initiated", 2023-08-01T19:55:17.606 INFO:teuthology.orchestra.run.smithi155.stdout: "time": "2023-08-01T19:55:17.593917+0000", 2023-08-01T19:55:17.606 INFO:teuthology.orchestra.run.smithi155.stdout: "duration": 0 2023-08-01T19:55:17.606 INFO:teuthology.orchestra.run.smithi155.stdout: }, 2023-08-01T19:55:17.606 INFO:teuthology.orchestra.run.smithi155.stdout: { 2023-08-01T19:55:17.606 INFO:teuthology.orchestra.run.smithi155.stdout: "event": "throttled", 2023-08-01T19:55:17.607 INFO:teuthology.orchestra.run.smithi155.stdout: "time": "2023-08-01T19:55:17.593917+0000", 2023-08-01T19:55:17.607 INFO:teuthology.orchestra.run.smithi155.stdout: "duration": 0 2023-08-01T19:55:17.607 INFO:teuthology.orchestra.run.smithi155.stdout: }, 2023-08-01T19:55:17.607 INFO:teuthology.orchestra.run.smithi155.stdout: { 2023-08-01T19:55:17.607 INFO:teuthology.orchestra.run.smithi155.stdout: "event": "header_read", 2023-08-01T19:55:17.607 INFO:teuthology.orchestra.run.smithi155.stdout: "time": "2023-08-01T19:55:17.593916+0000", 2023-08-01T19:55:17.608 INFO:teuthology.orchestra.run.smithi155.stdout: "duration": 4294967295.999999 2023-08-01T19:55:17.608 INFO:teuthology.orchestra.run.smithi155.stdout: }, 2023-08-01T19:55:17.608 INFO:teuthology.orchestra.run.smithi155.stdout: { 2023-08-01T19:55:17.608 INFO:teuthology.orchestra.run.smithi155.stdout: "event": "all_read", 2023-08-01T19:55:17.608 INFO:teuthology.orchestra.run.smithi155.stdout: "time": "2023-08-01T19:55:17.593973+0000", 2023-08-01T19:55:17.609 INFO:teuthology.orchestra.run.smithi155.stdout: "duration": 5.6552000000000003e-05 2023-08-01T19:55:17.609 INFO:teuthology.orchestra.run.smithi155.stdout: }, 2023-08-01T19:55:17.609 INFO:teuthology.orchestra.run.smithi155.stdout: { 2023-08-01T19:55:17.609 INFO:teuthology.orchestra.run.smithi155.stdout: "event": "dispatched", 2023-08-01T19:55:17.609 INFO:teuthology.orchestra.run.smithi155.stdout: "time": "2023-08-01T19:55:17.593983+0000", 2023-08-01T19:55:17.609 INFO:teuthology.orchestra.run.smithi155.stdout: "duration": 1.0532e-05 2023-08-01T19:55:17.609 INFO:teuthology.orchestra.run.smithi155.stdout: }, 2023-08-01T19:55:17.610 INFO:teuthology.orchestra.run.smithi155.stdout: { 2023-08-01T19:55:17.610 INFO:teuthology.orchestra.run.smithi155.stdout: "event": "queued_for_pg", 2023-08-01T19:55:17.611 INFO:teuthology.orchestra.run.smithi155.stdout: "time": "2023-08-01T19:55:17.593989+0000", 2023-08-01T19:55:17.611 INFO:teuthology.orchestra.run.smithi155.stdout: "duration": 5.1959999999999999e-06 2023-08-01T19:55:17.611 INFO:teuthology.orchestra.run.smithi155.stdout: }, 2023-08-01T19:55:17.611 INFO:teuthology.orchestra.run.smithi155.stdout: { 2023-08-01T19:55:17.611 INFO:teuthology.orchestra.run.smithi155.stdout: "event": "reached_pg", 2023-08-01T19:55:17.611 INFO:teuthology.orchestra.run.smithi155.stdout: "time": "2023-08-01T19:55:17.594031+0000", 2023-08-01T19:55:17.611 INFO:teuthology.orchestra.run.smithi155.stdout: "duration": 4.2771000000000001e-05 2023-08-01T19:55:17.612 INFO:teuthology.orchestra.run.smithi155.stdout: }, 2023-08-01T19:55:17.612 INFO:teuthology.orchestra.run.smithi155.stdout: { 2023-08-01T19:55:17.612 INFO:teuthology.orchestra.run.smithi155.stdout: "event": "started", 2023-08-01T19:55:17.612 INFO:teuthology.orchestra.run.smithi155.stdout: "time": "2023-08-01T19:55:17.594182+0000", 2023-08-01T19:55:17.612 INFO:teuthology.orchestra.run.smithi155.stdout: "duration": 0.00015055600000000001 2023-08-01T19:55:17.612 INFO:teuthology.orchestra.run.smithi155.stdout: }, 2023-08-01T19:55:17.612 INFO:teuthology.orchestra.run.smithi155.stdout: { 2023-08-01T19:55:17.613 INFO:teuthology.orchestra.run.smithi155.stdout: "event": "waiting for subops from 1", 2023-08-01T19:55:17.613 INFO:teuthology.orchestra.run.smithi155.stdout: "time": "2023-08-01T19:55:17.594330+0000", 2023-08-01T19:55:17.613 INFO:teuthology.orchestra.run.smithi155.stdout: "duration": 0.00014769100000000001 2023-08-01T19:55:17.613 INFO:teuthology.orchestra.run.smithi155.stdout: }, 2023-08-01T19:55:17.613 INFO:teuthology.orchestra.run.smithi155.stdout: { 2023-08-01T19:55:17.613 INFO:teuthology.orchestra.run.smithi155.stdout: "event": "op_commit", 2023-08-01T19:55:17.613 INFO:teuthology.orchestra.run.smithi155.stdout: "time": "2023-08-01T19:55:17.600458+0000", 2023-08-01T19:55:17.614 INFO:teuthology.orchestra.run.smithi155.stdout: "duration": 0.006128568 2023-08-01T19:55:17.614 INFO:teuthology.orchestra.run.smithi155.stdout: } 2023-08-01T19:55:17.614 INFO:teuthology.orchestra.run.smithi155.stdout: ] 2023-08-01T19:55:17.614 INFO:teuthology.orchestra.run.smithi155.stdout: } 2023-08-01T19:55:17.614 INFO:teuthology.orchestra.run.smithi155.stdout: }, 2023-08-01T19:55:17.614 INFO:teuthology.orchestra.run.smithi155.stdout: { 2023-08-01T19:55:17.614 INFO:teuthology.orchestra.run.smithi155.stdout: "description": "osd_op(client.4668.0:121350 5.d 5:bb0f3bcc:::benchmark_data_smithi006_114134_object121349:head [set-alloc-hint object_size 65536 write_size 65536,write 0~65536 in=65536b] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e43)", 2023-08-01T19:55:17.614 INFO:teuthology.orchestra.run.smithi155.stdout: "initiated_at": "2023-08-01T19:55:17.598035+0000", 2023-08-01T19:55:17.615 INFO:teuthology.orchestra.run.smithi155.stdout: "age": 0.003841358, 2023-08-01T19:55:17.615 INFO:teuthology.orchestra.run.smithi155.stdout: "duration": 0.0039622729999999997, 2023-08-01T19:55:17.615 INFO:teuthology.orchestra.run.smithi155.stdout: "type_data": { 2023-08-01T19:55:17.615 INFO:teuthology.orchestra.run.smithi155.stdout: "flag_point": "waiting for sub ops", 2023-08-01T19:55:17.615 INFO:teuthology.orchestra.run.smithi155.stdout: "client_info": { 2023-08-01T19:55:17.615 INFO:teuthology.orchestra.run.smithi155.stdout: "client": "client.4668", 2023-08-01T19:55:17.615 INFO:teuthology.orchestra.run.smithi155.stdout: "client_addr": "172.21.15.6:0/1709472247", 2023-08-01T19:55:17.615 INFO:teuthology.orchestra.run.smithi155.stdout: "tid": 121350 2023-08-01T19:55:17.616 INFO:teuthology.orchestra.run.smithi155.stdout: }, 2023-08-01T19:55:17.616 INFO:teuthology.orchestra.run.smithi155.stdout: "events": [ 2023-08-01T19:55:17.616 INFO:teuthology.orchestra.run.smithi155.stdout: { 2023-08-01T19:55:17.616 INFO:teuthology.orchestra.run.smithi155.stdout: "event": "initiated", 2023-08-01T19:55:17.616 INFO:teuthology.orchestra.run.smithi155.stdout: "time": "2023-08-01T19:55:17.598035+0000", 2023-08-01T19:55:17.616 INFO:teuthology.orchestra.run.smithi155.stdout: "duration": 0 2023-08-01T19:55:17.616 INFO:teuthology.orchestra.run.smithi155.stdout: }, 2023-08-01T19:55:17.616 INFO:teuthology.orchestra.run.smithi155.stdout: { 2023-08-01T19:55:17.617 INFO:teuthology.orchestra.run.smithi155.stdout: "event": "throttled", 2023-08-01T19:55:17.617 INFO:teuthology.orchestra.run.smithi155.stdout: "time": "2023-08-01T19:55:17.598035+0000", 2023-08-01T19:55:17.617 INFO:teuthology.orchestra.run.smithi155.stdout: "duration": 0 2023-08-01T19:55:17.617 INFO:teuthology.orchestra.run.smithi155.stdout: }, 2023-08-01T19:55:17.617 INFO:teuthology.orchestra.run.smithi155.stdout: { 2023-08-01T19:55:17.617 INFO:teuthology.orchestra.run.smithi155.stdout: "event": "header_read", 2023-08-01T19:55:17.617 INFO:teuthology.orchestra.run.smithi155.stdout: "time": "2023-08-01T19:55:17.598034+0000", 2023-08-01T19:55:17.618 INFO:teuthology.orchestra.run.smithi155.stdout: "duration": 4294967295.999999 2023-08-01T19:55:17.618 INFO:teuthology.orchestra.run.smithi155.stdout: }, 2023-08-01T19:55:17.618 INFO:teuthology.orchestra.run.smithi155.stdout: { 2023-08-01T19:55:17.618 INFO:teuthology.orchestra.run.smithi155.stdout: "event": "all_read", 2023-08-01T19:55:17.618 INFO:teuthology.orchestra.run.smithi155.stdout: "time": "2023-08-01T19:55:17.598098+0000", 2023-08-01T19:55:17.618 INFO:teuthology.orchestra.run.smithi155.stdout: "duration": 6.3652000000000007e-05 2023-08-01T19:55:17.618 INFO:teuthology.orchestra.run.smithi155.stdout: }, 2023-08-01T19:55:17.618 INFO:teuthology.orchestra.run.smithi155.stdout: { 2023-08-01T19:55:17.619 INFO:teuthology.orchestra.run.smithi155.stdout: "event": "dispatched", 2023-08-01T19:55:17.619 INFO:teuthology.orchestra.run.smithi155.stdout: "time": "2023-08-01T19:55:17.598106+0000", 2023-08-01T19:55:17.619 INFO:teuthology.orchestra.run.smithi155.stdout: "duration": 8.0940000000000008e-06 2023-08-01T19:55:17.619 INFO:teuthology.orchestra.run.smithi155.stdout: }, 2023-08-01T19:55:17.619 INFO:teuthology.orchestra.run.smithi155.stdout: { 2023-08-01T19:55:17.619 INFO:teuthology.orchestra.run.smithi155.stdout: "event": "queued_for_pg", 2023-08-01T19:55:17.619 INFO:teuthology.orchestra.run.smithi155.stdout: "time": "2023-08-01T19:55:17.598110+0000", 2023-08-01T19:55:17.619 INFO:teuthology.orchestra.run.smithi155.stdout: "duration": 3.9169999999999999e-06 2023-08-01T19:55:17.620 INFO:teuthology.orchestra.run.smithi155.stdout: }, 2023-08-01T19:55:17.620 INFO:teuthology.orchestra.run.smithi155.stdout: { 2023-08-01T19:55:17.620 INFO:teuthology.orchestra.run.smithi155.stdout: "event": "reached_pg", 2023-08-01T19:55:17.620 INFO:teuthology.orchestra.run.smithi155.stdout: "time": "2023-08-01T19:55:17.598143+0000", 2023-08-01T19:55:17.620 INFO:teuthology.orchestra.run.smithi155.stdout: "duration": 3.2907999999999997e-05 2023-08-01T19:55:17.620 INFO:teuthology.orchestra.run.smithi155.stdout: }, 2023-08-01T19:55:17.620 INFO:teuthology.orchestra.run.smithi155.stdout: { 2023-08-01T19:55:17.621 INFO:teuthology.orchestra.run.smithi155.stdout: "event": "started", 2023-08-01T19:55:17.621 INFO:teuthology.orchestra.run.smithi155.stdout: "time": "2023-08-01T19:55:17.598270+0000", 2023-08-01T19:55:17.621 INFO:teuthology.orchestra.run.smithi155.stdout: "duration": 0.000127804 2023-08-01T19:55:17.621 INFO:teuthology.orchestra.run.smithi155.stdout: }, 2023-08-01T19:55:17.621 INFO:teuthology.orchestra.run.smithi155.stdout: { 2023-08-01T19:55:17.621 INFO:teuthology.orchestra.run.smithi155.stdout: "event": "waiting for subops from 1", 2023-08-01T19:55:17.621 INFO:teuthology.orchestra.run.smithi155.stdout: "time": "2023-08-01T19:55:17.598409+0000", 2023-08-01T19:55:17.621 INFO:teuthology.orchestra.run.smithi155.stdout: "duration": 0.00013873600000000001 2023-08-01T19:55:17.622 INFO:teuthology.orchestra.run.smithi155.stdout: } 2023-08-01T19:55:17.622 INFO:teuthology.orchestra.run.smithi155.stdout: ] 2023-08-01T19:55:17.622 INFO:teuthology.orchestra.run.smithi155.stdout: } 2023-08-01T19:55:17.622 INFO:teuthology.orchestra.run.smithi155.stdout: }, 2023-08-01T19:55:17.622 INFO:teuthology.orchestra.run.smithi155.stdout: { 2023-08-01T19:55:17.622 INFO:teuthology.orchestra.run.smithi155.stdout: "description": "osd_op(client.4668.0:121351 5.e 5:75a6dac6:::benchmark_data_smithi006_114134_object121350:head [set-alloc-hint object_size 65536 write_size 65536,write 0~65536 in=65536b] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e43)", 2023-08-01T19:55:17.622 INFO:teuthology.orchestra.run.smithi155.stdout: "initiated_at": "2023-08-01T19:55:17.598117+0000", 2023-08-01T19:55:17.622 INFO:teuthology.orchestra.run.smithi155.stdout: "age": 0.0037595039999999999, 2023-08-01T19:55:17.623 INFO:teuthology.orchestra.run.smithi155.stdout: "duration": 0.0039595000000000003, 2023-08-01T19:55:17.623 INFO:teuthology.orchestra.run.smithi155.stdout: "type_data": { 2023-08-01T19:55:17.623 INFO:teuthology.orchestra.run.smithi155.stdout: "flag_point": "waiting for sub ops", 2023-08-01T19:55:17.623 INFO:teuthology.orchestra.run.smithi155.stdout: "client_info": { 2023-08-01T19:55:17.623 INFO:teuthology.orchestra.run.smithi155.stdout: "client": "client.4668", 2023-08-01T19:55:17.623 INFO:teuthology.orchestra.run.smithi155.stdout: "client_addr": "172.21.15.6:0/1709472247", 2023-08-01T19:55:17.623 INFO:teuthology.orchestra.run.smithi155.stdout: "tid": 121351 2023-08-01T19:55:17.624 INFO:teuthology.orchestra.run.smithi155.stdout: }, 2023-08-01T19:55:17.624 INFO:teuthology.orchestra.run.smithi155.stdout: "events": [ 2023-08-01T19:55:17.624 INFO:teuthology.orchestra.run.smithi155.stdout: { 2023-08-01T19:55:17.624 INFO:teuthology.orchestra.run.smithi155.stdout: "event": "initiated", 2023-08-01T19:55:17.624 INFO:teuthology.orchestra.run.smithi155.stdout: "time": "2023-08-01T19:55:17.598117+0000", 2023-08-01T19:55:17.624 INFO:teuthology.orchestra.run.smithi155.stdout: "duration": 0 2023-08-01T19:55:17.624 INFO:teuthology.orchestra.run.smithi155.stdout: }, 2023-08-01T19:55:17.624 INFO:teuthology.orchestra.run.smithi155.stdout: { 2023-08-01T19:55:17.625 INFO:teuthology.orchestra.run.smithi155.stdout: "event": "throttled", 2023-08-01T19:55:17.625 INFO:teuthology.orchestra.run.smithi155.stdout: "time": "2023-08-01T19:55:17.598117+0000", 2023-08-01T19:55:17.625 INFO:teuthology.orchestra.run.smithi155.stdout: "duration": 0 2023-08-01T19:55:17.625 INFO:teuthology.orchestra.run.smithi155.stdout: }, 2023-08-01T19:55:17.625 INFO:teuthology.orchestra.run.smithi155.stdout: { 2023-08-01T19:55:17.625 INFO:teuthology.orchestra.run.smithi155.stdout: "event": "header_read", 2023-08-01T19:55:17.625 INFO:teuthology.orchestra.run.smithi155.stdout: "time": "2023-08-01T19:55:17.598116+0000", 2023-08-01T19:55:17.625 INFO:teuthology.orchestra.run.smithi155.stdout: "duration": 4294967295.9999995 2023-08-01T19:55:17.626 INFO:teuthology.orchestra.run.smithi155.stdout: }, 2023-08-01T19:55:17.626 INFO:teuthology.orchestra.run.smithi155.stdout: { 2023-08-01T19:55:17.626 INFO:teuthology.orchestra.run.smithi155.stdout: "event": "all_read", 2023-08-01T19:55:17.626 INFO:teuthology.orchestra.run.smithi155.stdout: "time": "2023-08-01T19:55:17.598161+0000", 2023-08-01T19:55:17.626 INFO:teuthology.orchestra.run.smithi155.stdout: "duration": 4.4134999999999997e-05 2023-08-01T19:55:17.626 INFO:teuthology.orchestra.run.smithi155.stdout: }, 2023-08-01T19:55:17.626 INFO:teuthology.orchestra.run.smithi155.stdout: { 2023-08-01T19:55:17.627 INFO:teuthology.orchestra.run.smithi155.stdout: "event": "dispatched", 2023-08-01T19:55:17.627 INFO:teuthology.orchestra.run.smithi155.stdout: "time": "2023-08-01T19:55:17.598169+0000", 2023-08-01T19:55:17.627 INFO:teuthology.orchestra.run.smithi155.stdout: "duration": 8.8279999999999992e-06 2023-08-01T19:55:17.627 INFO:teuthology.orchestra.run.smithi155.stdout: }, 2023-08-01T19:55:17.627 INFO:teuthology.orchestra.run.smithi155.stdout: { 2023-08-01T19:55:17.627 INFO:teuthology.orchestra.run.smithi155.stdout: "event": "queued_for_pg", 2023-08-01T19:55:17.627 INFO:teuthology.orchestra.run.smithi155.stdout: "time": "2023-08-01T19:55:17.598172+0000", 2023-08-01T19:55:17.627 INFO:teuthology.orchestra.run.smithi155.stdout: "duration": 2.9160000000000001e-06 2023-08-01T19:55:17.628 INFO:teuthology.orchestra.run.smithi155.stdout: }, 2023-08-01T19:55:17.628 INFO:teuthology.orchestra.run.smithi155.stdout: { 2023-08-01T19:55:17.628 INFO:teuthology.orchestra.run.smithi155.stdout: "event": "reached_pg", 2023-08-01T19:55:17.628 INFO:teuthology.orchestra.run.smithi155.stdout: "time": "2023-08-01T19:55:17.598219+0000", 2023-08-01T19:55:17.628 INFO:teuthology.orchestra.run.smithi155.stdout: "duration": 4.6724999999999997e-05 2023-08-01T19:55:17.628 INFO:teuthology.orchestra.run.smithi155.stdout: }, 2023-08-01T19:55:17.628 INFO:teuthology.orchestra.run.smithi155.stdout: { 2023-08-01T19:55:17.629 INFO:teuthology.orchestra.run.smithi155.stdout: "event": "started", 2023-08-01T19:55:17.629 INFO:teuthology.orchestra.run.smithi155.stdout: "time": "2023-08-01T19:55:17.598328+0000", 2023-08-01T19:55:17.629 INFO:teuthology.orchestra.run.smithi155.stdout: "duration": 0.000109163 2023-08-01T19:55:17.629 INFO:teuthology.orchestra.run.smithi155.stdout: }, 2023-08-01T19:55:17.629 INFO:teuthology.orchestra.run.smithi155.stdout: { 2023-08-01T19:55:17.629 INFO:teuthology.orchestra.run.smithi155.stdout: "event": "waiting for subops from 0", 2023-08-01T19:55:17.629 INFO:teuthology.orchestra.run.smithi155.stdout: "time": "2023-08-01T19:55:17.598454+0000", 2023-08-01T19:55:17.629 INFO:teuthology.orchestra.run.smithi155.stdout: "duration": 0.00012568200000000001 2023-08-01T19:55:17.630 INFO:teuthology.orchestra.run.smithi155.stdout: } 2023-08-01T19:55:17.630 INFO:teuthology.orchestra.run.smithi155.stdout: ] 2023-08-01T19:55:17.630 INFO:teuthology.orchestra.run.smithi155.stdout: } 2023-08-01T19:55:17.630 INFO:teuthology.orchestra.run.smithi155.stdout: }, 2023-08-01T19:55:17.630 INFO:teuthology.orchestra.run.smithi155.stdout: { 2023-08-01T19:55:17.630 INFO:teuthology.orchestra.run.smithi155.stdout: "description": "osd_op(client.4668.0:121352 5.4 5:2d950841:::benchmark_data_smithi006_114134_object121351:head [set-alloc-hint object_size 65536 write_size 65536,write 0~65536 in=65536b] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e43)", 2023-08-01T19:55:17.630 INFO:teuthology.orchestra.run.smithi155.stdout: "initiated_at": "2023-08-01T19:55:17.598185+0000", 2023-08-01T19:55:17.631 INFO:teuthology.orchestra.run.smithi155.stdout: "age": 0.0036910599999999999, 2023-08-01T19:55:17.631 INFO:teuthology.orchestra.run.smithi155.stdout: "duration": 0.0039695049999999999, 2023-08-01T19:55:17.631 INFO:teuthology.orchestra.run.smithi155.stdout: "type_data": { 2023-08-01T19:55:17.631 INFO:teuthology.orchestra.run.smithi155.stdout: "flag_point": "waiting for sub ops", 2023-08-01T19:55:17.631 INFO:teuthology.orchestra.run.smithi155.stdout: "client_info": { 2023-08-01T19:55:17.631 INFO:teuthology.orchestra.run.smithi155.stdout: "client": "client.4668", 2023-08-01T19:55:17.631 INFO:teuthology.orchestra.run.smithi155.stdout: "client_addr": "172.21.15.6:0/1709472247", 2023-08-01T19:55:17.631 INFO:teuthology.orchestra.run.smithi155.stdout: "tid": 121352 2023-08-01T19:55:17.632 INFO:teuthology.orchestra.run.smithi155.stdout: }, 2023-08-01T19:55:17.632 INFO:teuthology.orchestra.run.smithi155.stdout: "events": [ 2023-08-01T19:55:17.632 INFO:teuthology.orchestra.run.smithi155.stdout: { 2023-08-01T19:55:17.632 INFO:teuthology.orchestra.run.smithi155.stdout: "event": "initiated", 2023-08-01T19:55:17.632 INFO:teuthology.orchestra.run.smithi155.stdout: "time": "2023-08-01T19:55:17.598185+0000", 2023-08-01T19:55:17.632 INFO:teuthology.orchestra.run.smithi155.stdout: "duration": 0 2023-08-01T19:55:17.632 INFO:teuthology.orchestra.run.smithi155.stdout: }, 2023-08-01T19:55:17.632 INFO:teuthology.orchestra.run.smithi155.stdout: { 2023-08-01T19:55:17.633 INFO:teuthology.orchestra.run.smithi155.stdout: "event": "throttled", 2023-08-01T19:55:17.633 INFO:teuthology.orchestra.run.smithi155.stdout: "time": "2023-08-01T19:55:17.598185+0000", 2023-08-01T19:55:17.633 INFO:teuthology.orchestra.run.smithi155.stdout: "duration": 0 2023-08-01T19:55:17.633 INFO:teuthology.orchestra.run.smithi155.stdout: }, 2023-08-01T19:55:17.633 INFO:teuthology.orchestra.run.smithi155.stdout: { 2023-08-01T19:55:17.633 INFO:teuthology.orchestra.run.smithi155.stdout: "event": "header_read", 2023-08-01T19:55:17.633 INFO:teuthology.orchestra.run.smithi155.stdout: "time": "2023-08-01T19:55:17.598185+0000", 2023-08-01T19:55:17.633 INFO:teuthology.orchestra.run.smithi155.stdout: "duration": 4294967295.9999995 2023-08-01T19:55:17.634 INFO:teuthology.orchestra.run.smithi155.stdout: }, 2023-08-01T19:55:17.634 INFO:teuthology.orchestra.run.smithi155.stdout: { 2023-08-01T19:55:17.634 INFO:teuthology.orchestra.run.smithi155.stdout: "event": "all_read", 2023-08-01T19:55:17.634 INFO:teuthology.orchestra.run.smithi155.stdout: "time": "2023-08-01T19:55:17.598223+0000", 2023-08-01T19:55:17.634 INFO:teuthology.orchestra.run.smithi155.stdout: "duration": 3.8080000000000001e-05 2023-08-01T19:55:17.634 INFO:teuthology.orchestra.run.smithi155.stdout: }, 2023-08-01T19:55:17.634 INFO:teuthology.orchestra.run.smithi155.stdout: { 2023-08-01T19:55:17.635 INFO:teuthology.orchestra.run.smithi155.stdout: "event": "dispatched", 2023-08-01T19:55:17.635 INFO:teuthology.orchestra.run.smithi155.stdout: "time": "2023-08-01T19:55:17.598228+0000", 2023-08-01T19:55:17.635 INFO:teuthology.orchestra.run.smithi155.stdout: "duration": 5.2349999999999999e-06 2023-08-01T19:55:17.635 INFO:teuthology.orchestra.run.smithi155.stdout: }, 2023-08-01T19:55:17.635 INFO:teuthology.orchestra.run.smithi155.stdout: { 2023-08-01T19:55:17.635 INFO:teuthology.orchestra.run.smithi155.stdout: "event": "queued_for_pg", 2023-08-01T19:55:17.635 INFO:teuthology.orchestra.run.smithi155.stdout: "time": "2023-08-01T19:55:17.598231+0000", 2023-08-01T19:55:17.635 INFO:teuthology.orchestra.run.smithi155.stdout: "duration": 2.7750000000000001e-06 2023-08-01T19:55:17.636 INFO:teuthology.orchestra.run.smithi155.stdout: }, 2023-08-01T19:55:17.636 INFO:teuthology.orchestra.run.smithi155.stdout: { 2023-08-01T19:55:17.636 INFO:teuthology.orchestra.run.smithi155.stdout: "event": "reached_pg", 2023-08-01T19:55:17.636 INFO:teuthology.orchestra.run.smithi155.stdout: "time": "2023-08-01T19:55:17.598259+0000", 2023-08-01T19:55:17.636 INFO:teuthology.orchestra.run.smithi155.stdout: "duration": 2.7903999999999999e-05 2023-08-01T19:55:17.636 INFO:teuthology.orchestra.run.smithi155.stdout: }, 2023-08-01T19:55:17.636 INFO:teuthology.orchestra.run.smithi155.stdout: { 2023-08-01T19:55:17.636 INFO:teuthology.orchestra.run.smithi155.stdout: "event": "started", 2023-08-01T19:55:17.637 INFO:teuthology.orchestra.run.smithi155.stdout: "time": "2023-08-01T19:55:17.598344+0000", 2023-08-01T19:55:17.637 INFO:teuthology.orchestra.run.smithi155.stdout: "duration": 8.5345000000000004e-05 2023-08-01T19:55:17.637 INFO:teuthology.orchestra.run.smithi155.stdout: }, 2023-08-01T19:55:17.637 INFO:teuthology.orchestra.run.smithi155.stdout: { 2023-08-01T19:55:17.637 INFO:teuthology.orchestra.run.smithi155.stdout: "event": "waiting for subops from 0", 2023-08-01T19:55:17.637 INFO:teuthology.orchestra.run.smithi155.stdout: "time": "2023-08-01T19:55:17.598428+0000", 2023-08-01T19:55:17.637 INFO:teuthology.orchestra.run.smithi155.stdout: "duration": 8.4117999999999997e-05 2023-08-01T19:55:17.637 INFO:teuthology.orchestra.run.smithi155.stdout: } 2023-08-01T19:55:17.638 INFO:teuthology.orchestra.run.smithi155.stdout: ] 2023-08-01T19:55:17.638 INFO:teuthology.orchestra.run.smithi155.stdout: } 2023-08-01T19:55:17.638 INFO:teuthology.orchestra.run.smithi155.stdout: }, 2023-08-01T19:55:17.638 INFO:teuthology.orchestra.run.smithi155.stdout: { 2023-08-01T19:55:17.638 INFO:teuthology.orchestra.run.smithi155.stdout: "description": "osd_op(client.4668.0:121353 5.d 5:b38d4fff:::benchmark_data_smithi006_114134_object121352:head [set-alloc-hint object_size 65536 write_size 65536,write 0~65536 in=65536b] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e43)", 2023-08-01T19:55:17.638 INFO:teuthology.orchestra.run.smithi155.stdout: "initiated_at": "2023-08-01T19:55:17.600434+0000", 2023-08-01T19:55:17.638 INFO:teuthology.orchestra.run.smithi155.stdout: "age": 0.0014420570000000001, 2023-08-01T19:55:17.638 INFO:teuthology.orchestra.run.smithi155.stdout: "duration": 0.001805631, 2023-08-01T19:55:17.639 INFO:teuthology.orchestra.run.smithi155.stdout: "type_data": { 2023-08-01T19:55:17.639 INFO:teuthology.orchestra.run.smithi155.stdout: "flag_point": "waiting for sub ops", 2023-08-01T19:55:17.639 INFO:teuthology.orchestra.run.smithi155.stdout: "client_info": { 2023-08-01T19:55:17.639 INFO:teuthology.orchestra.run.smithi155.stdout: "client": "client.4668", 2023-08-01T19:55:17.639 INFO:teuthology.orchestra.run.smithi155.stdout: "client_addr": "172.21.15.6:0/1709472247", 2023-08-01T19:55:17.639 INFO:teuthology.orchestra.run.smithi155.stdout: "tid": 121353 2023-08-01T19:55:17.639 INFO:teuthology.orchestra.run.smithi155.stdout: }, 2023-08-01T19:55:17.639 INFO:teuthology.orchestra.run.smithi155.stdout: "events": [ 2023-08-01T19:55:17.640 INFO:teuthology.orchestra.run.smithi155.stdout: { 2023-08-01T19:55:17.640 INFO:teuthology.orchestra.run.smithi155.stdout: "event": "initiated", 2023-08-01T19:55:17.640 INFO:teuthology.orchestra.run.smithi155.stdout: "time": "2023-08-01T19:55:17.600434+0000", 2023-08-01T19:55:17.640 INFO:teuthology.orchestra.run.smithi155.stdout: "duration": 0 2023-08-01T19:55:17.640 INFO:teuthology.orchestra.run.smithi155.stdout: }, 2023-08-01T19:55:17.640 INFO:teuthology.orchestra.run.smithi155.stdout: { 2023-08-01T19:55:17.640 INFO:teuthology.orchestra.run.smithi155.stdout: "event": "throttled", 2023-08-01T19:55:17.641 INFO:teuthology.orchestra.run.smithi155.stdout: "time": "2023-08-01T19:55:17.600434+0000", 2023-08-01T19:55:17.641 INFO:teuthology.orchestra.run.smithi155.stdout: "duration": 0 2023-08-01T19:55:17.641 INFO:teuthology.orchestra.run.smithi155.stdout: }, 2023-08-01T19:55:17.641 INFO:teuthology.orchestra.run.smithi155.stdout: { 2023-08-01T19:55:17.641 INFO:teuthology.orchestra.run.smithi155.stdout: "event": "header_read", 2023-08-01T19:55:17.641 INFO:teuthology.orchestra.run.smithi155.stdout: "time": "2023-08-01T19:55:17.600433+0000", 2023-08-01T19:55:17.641 INFO:teuthology.orchestra.run.smithi155.stdout: "duration": 4294967295.999999 2023-08-01T19:55:17.641 INFO:teuthology.orchestra.run.smithi155.stdout: }, 2023-08-01T19:55:17.642 INFO:teuthology.orchestra.run.smithi155.stdout: { 2023-08-01T19:55:17.642 INFO:teuthology.orchestra.run.smithi155.stdout: "event": "all_read", 2023-08-01T19:55:17.642 INFO:teuthology.orchestra.run.smithi155.stdout: "time": "2023-08-01T19:55:17.600501+0000", 2023-08-01T19:55:17.642 INFO:teuthology.orchestra.run.smithi155.stdout: "duration": 6.7589000000000006e-05 2023-08-01T19:55:17.642 INFO:teuthology.orchestra.run.smithi155.stdout: }, 2023-08-01T19:55:17.642 INFO:teuthology.orchestra.run.smithi155.stdout: { 2023-08-01T19:55:17.642 INFO:teuthology.orchestra.run.smithi155.stdout: "event": "dispatched", 2023-08-01T19:55:17.642 INFO:teuthology.orchestra.run.smithi155.stdout: "time": "2023-08-01T19:55:17.600513+0000", 2023-08-01T19:55:17.643 INFO:teuthology.orchestra.run.smithi155.stdout: "duration": 1.206e-05 2023-08-01T19:55:17.643 INFO:teuthology.orchestra.run.smithi155.stdout: }, 2023-08-01T19:55:17.643 INFO:teuthology.orchestra.run.smithi155.stdout: { 2023-08-01T19:55:17.643 INFO:teuthology.orchestra.run.smithi155.stdout: "event": "queued_for_pg", 2023-08-01T19:55:17.643 INFO:teuthology.orchestra.run.smithi155.stdout: "time": "2023-08-01T19:55:17.600519+0000", 2023-08-01T19:55:17.643 INFO:teuthology.orchestra.run.smithi155.stdout: "duration": 6.5749999999999997e-06 2023-08-01T19:55:17.643 INFO:teuthology.orchestra.run.smithi155.stdout: }, 2023-08-01T19:55:17.643 INFO:teuthology.orchestra.run.smithi155.stdout: { 2023-08-01T19:55:17.644 INFO:teuthology.orchestra.run.smithi155.stdout: "event": "reached_pg", 2023-08-01T19:55:17.644 INFO:teuthology.orchestra.run.smithi155.stdout: "time": "2023-08-01T19:55:17.600550+0000", 2023-08-01T19:55:17.644 INFO:teuthology.orchestra.run.smithi155.stdout: "duration": 3.0505e-05 2023-08-01T19:55:17.644 INFO:teuthology.orchestra.run.smithi155.stdout: }, 2023-08-01T19:55:17.644 INFO:teuthology.orchestra.run.smithi155.stdout: { 2023-08-01T19:55:17.644 INFO:teuthology.orchestra.run.smithi155.stdout: "event": "started", 2023-08-01T19:55:17.644 INFO:teuthology.orchestra.run.smithi155.stdout: "time": "2023-08-01T19:55:17.600642+0000", 2023-08-01T19:55:17.645 INFO:teuthology.orchestra.run.smithi155.stdout: "duration": 9.2362999999999996e-05 2023-08-01T19:55:17.645 INFO:teuthology.orchestra.run.smithi155.stdout: }, 2023-08-01T19:55:17.645 INFO:teuthology.orchestra.run.smithi155.stdout: { 2023-08-01T19:55:17.645 INFO:teuthology.orchestra.run.smithi155.stdout: "event": "waiting for subops from 1", 2023-08-01T19:55:17.645 INFO:teuthology.orchestra.run.smithi155.stdout: "time": "2023-08-01T19:55:17.600793+0000", 2023-08-01T19:55:17.645 INFO:teuthology.orchestra.run.smithi155.stdout: "duration": 0.00015100399999999999 2023-08-01T19:55:17.645 INFO:teuthology.orchestra.run.smithi155.stdout: } 2023-08-01T19:55:17.645 INFO:teuthology.orchestra.run.smithi155.stdout: ] 2023-08-01T19:55:17.646 INFO:teuthology.orchestra.run.smithi155.stdout: } 2023-08-01T19:55:17.646 INFO:teuthology.orchestra.run.smithi155.stdout: }, 2023-08-01T19:55:17.646 INFO:teuthology.orchestra.run.smithi155.stdout: { 2023-08-01T19:55:17.646 INFO:teuthology.orchestra.run.smithi155.stdout: "description": "osd_op(client.4668.0:121355 5.0 5:06291f44:::benchmark_data_smithi006_114134_object121354:head [set-alloc-hint object_size 65536 write_size 65536,write 0~65536 in=65536b] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e43)", 2023-08-01T19:55:17.646 INFO:teuthology.orchestra.run.smithi155.stdout: "initiated_at": "2023-08-01T19:55:17.600532+0000", 2023-08-01T19:55:17.646 INFO:teuthology.orchestra.run.smithi155.stdout: "age": 0.0013445919999999999, 2023-08-01T19:55:17.646 INFO:teuthology.orchestra.run.smithi155.stdout: "duration": 0.0017845070000000001, 2023-08-01T19:55:17.646 INFO:teuthology.orchestra.run.smithi155.stdout: "type_data": { 2023-08-01T19:55:17.647 INFO:teuthology.orchestra.run.smithi155.stdout: "flag_point": "waiting for sub ops", 2023-08-01T19:55:17.647 INFO:teuthology.orchestra.run.smithi155.stdout: "client_info": { 2023-08-01T19:55:17.647 INFO:teuthology.orchestra.run.smithi155.stdout: "client": "client.4668", 2023-08-01T19:55:17.647 INFO:teuthology.orchestra.run.smithi155.stdout: "client_addr": "172.21.15.6:0/1709472247", 2023-08-01T19:55:17.647 INFO:teuthology.orchestra.run.smithi155.stdout: "tid": 121355 2023-08-01T19:55:17.647 INFO:teuthology.orchestra.run.smithi155.stdout: }, 2023-08-01T19:55:17.647 INFO:teuthology.orchestra.run.smithi155.stdout: "events": [ 2023-08-01T19:55:17.647 INFO:teuthology.orchestra.run.smithi155.stdout: { 2023-08-01T19:55:17.648 INFO:teuthology.orchestra.run.smithi155.stdout: "event": "initiated", 2023-08-01T19:55:17.648 INFO:teuthology.orchestra.run.smithi155.stdout: "time": "2023-08-01T19:55:17.600532+0000", 2023-08-01T19:55:17.648 INFO:teuthology.orchestra.run.smithi155.stdout: "duration": 0 2023-08-01T19:55:17.648 INFO:teuthology.orchestra.run.smithi155.stdout: }, 2023-08-01T19:55:17.648 INFO:teuthology.orchestra.run.smithi155.stdout: { 2023-08-01T19:55:17.648 INFO:teuthology.orchestra.run.smithi155.stdout: "event": "throttled", 2023-08-01T19:55:17.648 INFO:teuthology.orchestra.run.smithi155.stdout: "time": "2023-08-01T19:55:17.600532+0000", 2023-08-01T19:55:17.648 INFO:teuthology.orchestra.run.smithi155.stdout: "duration": 0 2023-08-01T19:55:17.649 INFO:teuthology.orchestra.run.smithi155.stdout: }, 2023-08-01T19:55:17.649 INFO:teuthology.orchestra.run.smithi155.stdout: { 2023-08-01T19:55:17.649 INFO:teuthology.orchestra.run.smithi155.stdout: "event": "header_read", 2023-08-01T19:55:17.649 INFO:teuthology.orchestra.run.smithi155.stdout: "time": "2023-08-01T19:55:17.600531+0000", 2023-08-01T19:55:17.649 INFO:teuthology.orchestra.run.smithi155.stdout: "duration": 4294967295.9999995 2023-08-01T19:55:17.649 INFO:teuthology.orchestra.run.smithi155.stdout: }, 2023-08-01T19:55:17.649 INFO:teuthology.orchestra.run.smithi155.stdout: { 2023-08-01T19:55:17.649 INFO:teuthology.orchestra.run.smithi155.stdout: "event": "all_read", 2023-08-01T19:55:17.650 INFO:teuthology.orchestra.run.smithi155.stdout: "time": "2023-08-01T19:55:17.600593+0000", 2023-08-01T19:55:17.650 INFO:teuthology.orchestra.run.smithi155.stdout: "duration": 6.1855999999999999e-05 2023-08-01T19:55:17.650 INFO:teuthology.orchestra.run.smithi155.stdout: }, 2023-08-01T19:55:17.650 INFO:teuthology.orchestra.run.smithi155.stdout: { 2023-08-01T19:55:17.650 INFO:teuthology.orchestra.run.smithi155.stdout: "event": "dispatched", 2023-08-01T19:55:17.650 INFO:teuthology.orchestra.run.smithi155.stdout: "time": "2023-08-01T19:55:17.600604+0000", 2023-08-01T19:55:17.650 INFO:teuthology.orchestra.run.smithi155.stdout: "duration": 1.0844e-05 2023-08-01T19:55:17.651 INFO:teuthology.orchestra.run.smithi155.stdout: }, 2023-08-01T19:55:17.651 INFO:teuthology.orchestra.run.smithi155.stdout: { 2023-08-01T19:55:17.651 INFO:teuthology.orchestra.run.smithi155.stdout: "event": "queued_for_pg", 2023-08-01T19:55:17.651 INFO:teuthology.orchestra.run.smithi155.stdout: "time": "2023-08-01T19:55:17.600611+0000", 2023-08-01T19:55:17.651 INFO:teuthology.orchestra.run.smithi155.stdout: "duration": 7.3030000000000002e-06 2023-08-01T19:55:17.651 INFO:teuthology.orchestra.run.smithi155.stdout: }, 2023-08-01T19:55:17.651 INFO:teuthology.orchestra.run.smithi155.stdout: { 2023-08-01T19:55:17.651 INFO:teuthology.orchestra.run.smithi155.stdout: "event": "reached_pg", 2023-08-01T19:55:17.652 INFO:teuthology.orchestra.run.smithi155.stdout: "time": "2023-08-01T19:55:17.600645+0000", 2023-08-01T19:55:17.652 INFO:teuthology.orchestra.run.smithi155.stdout: "duration": 3.3717000000000003e-05 2023-08-01T19:55:17.652 INFO:teuthology.orchestra.run.smithi155.stdout: }, 2023-08-01T19:55:17.652 INFO:teuthology.orchestra.run.smithi155.stdout: { 2023-08-01T19:55:17.652 INFO:teuthology.orchestra.run.smithi155.stdout: "event": "started", 2023-08-01T19:55:17.652 INFO:teuthology.orchestra.run.smithi155.stdout: "time": "2023-08-01T19:55:17.600773+0000", 2023-08-01T19:55:17.652 INFO:teuthology.orchestra.run.smithi155.stdout: "duration": 0.000128114 2023-08-01T19:55:17.653 INFO:teuthology.orchestra.run.smithi155.stdout: }, 2023-08-01T19:55:17.653 INFO:teuthology.orchestra.run.smithi155.stdout: { 2023-08-01T19:55:17.653 INFO:teuthology.orchestra.run.smithi155.stdout: "event": "waiting for subops from 0", 2023-08-01T19:55:17.653 INFO:teuthology.orchestra.run.smithi155.stdout: "time": "2023-08-01T19:55:17.600901+0000", 2023-08-01T19:55:17.653 INFO:teuthology.orchestra.run.smithi155.stdout: "duration": 0.000128052 2023-08-01T19:55:17.653 INFO:teuthology.orchestra.run.smithi155.stdout: } 2023-08-01T19:55:17.653 INFO:teuthology.orchestra.run.smithi155.stdout: ] 2023-08-01T19:55:17.653 INFO:teuthology.orchestra.run.smithi155.stdout: } 2023-08-01T19:55:17.654 INFO:teuthology.orchestra.run.smithi155.stdout: }, 2023-08-01T19:55:17.654 INFO:teuthology.orchestra.run.smithi155.stdout: { 2023-08-01T19:55:17.654 INFO:teuthology.orchestra.run.smithi155.stdout: "description": "osd_repop_reply(client.4668.0:121343 5.d e43/19)", 2023-08-01T19:55:17.654 INFO:teuthology.orchestra.run.smithi155.stdout: "initiated_at": "2023-08-01T19:55:17.600700+0000", 2023-08-01T19:55:17.654 INFO:teuthology.orchestra.run.smithi155.stdout: "age": 0.0011758090000000001, 2023-08-01T19:55:17.654 INFO:teuthology.orchestra.run.smithi155.stdout: "duration": 0.0016849969999999999, 2023-08-01T19:55:17.654 INFO:teuthology.orchestra.run.smithi155.stdout: "type_data": { 2023-08-01T19:55:17.654 INFO:teuthology.orchestra.run.smithi155.stdout: "flag_point": "queued for pg", 2023-08-01T19:55:17.655 INFO:teuthology.orchestra.run.smithi155.stdout: "events": [ 2023-08-01T19:55:17.655 INFO:teuthology.orchestra.run.smithi155.stdout: { 2023-08-01T19:55:17.655 INFO:teuthology.orchestra.run.smithi155.stdout: "event": "initiated", 2023-08-01T19:55:17.655 INFO:teuthology.orchestra.run.smithi155.stdout: "time": "2023-08-01T19:55:17.600700+0000", 2023-08-01T19:55:17.655 INFO:teuthology.orchestra.run.smithi155.stdout: "duration": 0 2023-08-01T19:55:17.655 INFO:teuthology.orchestra.run.smithi155.stdout: }, 2023-08-01T19:55:17.655 INFO:teuthology.orchestra.run.smithi155.stdout: { 2023-08-01T19:55:17.655 INFO:teuthology.orchestra.run.smithi155.stdout: "event": "throttled", 2023-08-01T19:55:17.656 INFO:teuthology.orchestra.run.smithi155.stdout: "time": "2023-08-01T19:55:17.600700+0000", 2023-08-01T19:55:17.656 INFO:teuthology.orchestra.run.smithi155.stdout: "duration": 0 2023-08-01T19:55:17.656 INFO:teuthology.orchestra.run.smithi155.stdout: }, 2023-08-01T19:55:17.656 INFO:teuthology.orchestra.run.smithi155.stdout: { 2023-08-01T19:55:17.656 INFO:teuthology.orchestra.run.smithi155.stdout: "event": "header_read", 2023-08-01T19:55:17.656 INFO:teuthology.orchestra.run.smithi155.stdout: "time": "2023-08-01T19:55:17.600700+0000", 2023-08-01T19:55:17.656 INFO:teuthology.orchestra.run.smithi155.stdout: "duration": 4294967295.9999995 2023-08-01T19:55:17.656 INFO:teuthology.orchestra.run.smithi155.stdout: }, 2023-08-01T19:55:17.657 INFO:teuthology.orchestra.run.smithi155.stdout: { 2023-08-01T19:55:17.657 INFO:teuthology.orchestra.run.smithi155.stdout: "event": "all_read", 2023-08-01T19:55:17.657 INFO:teuthology.orchestra.run.smithi155.stdout: "time": "2023-08-01T19:55:17.600710+0000", 2023-08-01T19:55:17.657 INFO:teuthology.orchestra.run.smithi155.stdout: "duration": 1.0118e-05 2023-08-01T19:55:17.657 INFO:teuthology.orchestra.run.smithi155.stdout: }, 2023-08-01T19:55:17.657 INFO:teuthology.orchestra.run.smithi155.stdout: { 2023-08-01T19:55:17.657 INFO:teuthology.orchestra.run.smithi155.stdout: "event": "dispatched", 2023-08-01T19:55:17.657 INFO:teuthology.orchestra.run.smithi155.stdout: "time": "2023-08-01T19:55:17.600727+0000", 2023-08-01T19:55:17.658 INFO:teuthology.orchestra.run.smithi155.stdout: "duration": 1.7433999999999999e-05 2023-08-01T19:55:17.658 INFO:teuthology.orchestra.run.smithi155.stdout: }, 2023-08-01T19:55:17.658 INFO:teuthology.orchestra.run.smithi155.stdout: { 2023-08-01T19:55:17.658 INFO:teuthology.orchestra.run.smithi155.stdout: "event": "queued_for_pg", 2023-08-01T19:55:17.658 INFO:teuthology.orchestra.run.smithi155.stdout: "time": "2023-08-01T19:55:17.600738+0000", 2023-08-01T19:55:17.658 INFO:teuthology.orchestra.run.smithi155.stdout: "duration": 1.0961000000000001e-05 2023-08-01T19:55:17.658 INFO:teuthology.orchestra.run.smithi155.stdout: } 2023-08-01T19:55:17.659 INFO:teuthology.orchestra.run.smithi155.stdout: ] 2023-08-01T19:55:17.659 INFO:teuthology.orchestra.run.smithi155.stdout: } 2023-08-01T19:55:17.659 INFO:teuthology.orchestra.run.smithi155.stdout: }, 2023-08-01T19:55:17.659 INFO:teuthology.orchestra.run.smithi155.stdout: { 2023-08-01T19:55:17.659 INFO:teuthology.orchestra.run.smithi155.stdout: "description": "osd_op(client.4668.0:121357 5.f 5:f24cedd9:::benchmark_data_smithi006_114134_object121356:head [set-alloc-hint object_size 65536 write_size 65536,write 0~65536 in=65536b] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e43)", 2023-08-01T19:55:17.659 INFO:teuthology.orchestra.run.smithi155.stdout: "initiated_at": "2023-08-01T19:55:17.600781+0000", 2023-08-01T19:55:17.659 INFO:teuthology.orchestra.run.smithi155.stdout: "age": 0.0010954929999999999, 2023-08-01T19:55:17.659 INFO:teuthology.orchestra.run.smithi155.stdout: "duration": 0.0016555999999999999, 2023-08-01T19:55:17.660 INFO:teuthology.orchestra.run.smithi155.stdout: "type_data": { 2023-08-01T19:55:17.660 INFO:teuthology.orchestra.run.smithi155.stdout: "flag_point": "waiting for sub ops", 2023-08-01T19:55:17.660 INFO:teuthology.orchestra.run.smithi155.stdout: "client_info": { 2023-08-01T19:55:17.660 INFO:teuthology.orchestra.run.smithi155.stdout: "client": "client.4668", 2023-08-01T19:55:17.660 INFO:teuthology.orchestra.run.smithi155.stdout: "client_addr": "172.21.15.6:0/1709472247", 2023-08-01T19:55:17.660 INFO:teuthology.orchestra.run.smithi155.stdout: "tid": 121357 2023-08-01T19:55:17.660 INFO:teuthology.orchestra.run.smithi155.stdout: }, 2023-08-01T19:55:17.660 INFO:teuthology.orchestra.run.smithi155.stdout: "events": [ 2023-08-01T19:55:17.661 INFO:teuthology.orchestra.run.smithi155.stdout: { 2023-08-01T19:55:17.661 INFO:teuthology.orchestra.run.smithi155.stdout: "event": "initiated", 2023-08-01T19:55:17.661 INFO:teuthology.orchestra.run.smithi155.stdout: "time": "2023-08-01T19:55:17.600781+0000", 2023-08-01T19:55:17.661 INFO:teuthology.orchestra.run.smithi155.stdout: "duration": 0 2023-08-01T19:55:17.661 INFO:teuthology.orchestra.run.smithi155.stdout: }, 2023-08-01T19:55:17.661 INFO:teuthology.orchestra.run.smithi155.stdout: { 2023-08-01T19:55:17.661 INFO:teuthology.orchestra.run.smithi155.stdout: "event": "throttled", 2023-08-01T19:55:17.661 INFO:teuthology.orchestra.run.smithi155.stdout: "time": "2023-08-01T19:55:17.600781+0000", 2023-08-01T19:55:17.662 INFO:teuthology.orchestra.run.smithi155.stdout: "duration": 0 2023-08-01T19:55:17.662 INFO:teuthology.orchestra.run.smithi155.stdout: }, 2023-08-01T19:55:17.662 INFO:teuthology.orchestra.run.smithi155.stdout: { 2023-08-01T19:55:17.662 INFO:teuthology.orchestra.run.smithi155.stdout: "event": "header_read", 2023-08-01T19:55:17.662 INFO:teuthology.orchestra.run.smithi155.stdout: "time": "2023-08-01T19:55:17.600780+0000", 2023-08-01T19:55:17.662 INFO:teuthology.orchestra.run.smithi155.stdout: "duration": 4294967295.9999995 2023-08-01T19:55:17.662 INFO:teuthology.orchestra.run.smithi155.stdout: }, 2023-08-01T19:55:17.662 INFO:teuthology.orchestra.run.smithi155.stdout: { 2023-08-01T19:55:17.663 INFO:teuthology.orchestra.run.smithi155.stdout: "event": "all_read", 2023-08-01T19:55:17.663 INFO:teuthology.orchestra.run.smithi155.stdout: "time": "2023-08-01T19:55:17.600806+0000", 2023-08-01T19:55:17.663 INFO:teuthology.orchestra.run.smithi155.stdout: "duration": 2.5630999999999999e-05 2023-08-01T19:55:17.663 INFO:teuthology.orchestra.run.smithi155.stdout: }, 2023-08-01T19:55:17.663 INFO:teuthology.orchestra.run.smithi155.stdout: { 2023-08-01T19:55:17.663 INFO:teuthology.orchestra.run.smithi155.stdout: "event": "dispatched", 2023-08-01T19:55:17.663 INFO:teuthology.orchestra.run.smithi155.stdout: "time": "2023-08-01T19:55:17.600814+0000", 2023-08-01T19:55:17.663 INFO:teuthology.orchestra.run.smithi155.stdout: "duration": 8.8230000000000001e-06 2023-08-01T19:55:17.664 INFO:teuthology.orchestra.run.smithi155.stdout: }, 2023-08-01T19:55:17.664 INFO:teuthology.orchestra.run.smithi155.stdout: { 2023-08-01T19:55:17.664 INFO:teuthology.orchestra.run.smithi155.stdout: "event": "queued_for_pg", 2023-08-01T19:55:17.664 INFO:teuthology.orchestra.run.smithi155.stdout: "time": "2023-08-01T19:55:17.600820+0000", 2023-08-01T19:55:17.664 INFO:teuthology.orchestra.run.smithi155.stdout: "duration": 5.0540000000000002e-06 2023-08-01T19:55:17.664 INFO:teuthology.orchestra.run.smithi155.stdout: }, 2023-08-01T19:55:17.664 INFO:teuthology.orchestra.run.smithi155.stdout: { 2023-08-01T19:55:17.664 INFO:teuthology.orchestra.run.smithi155.stdout: "event": "reached_pg", 2023-08-01T19:55:17.665 INFO:teuthology.orchestra.run.smithi155.stdout: "time": "2023-08-01T19:55:17.600850+0000", 2023-08-01T19:55:17.665 INFO:teuthology.orchestra.run.smithi155.stdout: "duration": 3.0275000000000001e-05 2023-08-01T19:55:17.665 INFO:teuthology.orchestra.run.smithi155.stdout: }, 2023-08-01T19:55:17.665 INFO:teuthology.orchestra.run.smithi155.stdout: { 2023-08-01T19:55:17.665 INFO:teuthology.orchestra.run.smithi155.stdout: "event": "started", 2023-08-01T19:55:17.665 INFO:teuthology.orchestra.run.smithi155.stdout: "time": "2023-08-01T19:55:17.600922+0000", 2023-08-01T19:55:17.665 INFO:teuthology.orchestra.run.smithi155.stdout: "duration": 7.2216000000000001e-05 2023-08-01T19:55:17.666 INFO:teuthology.orchestra.run.smithi155.stdout: }, 2023-08-01T19:55:17.666 INFO:teuthology.orchestra.run.smithi155.stdout: { 2023-08-01T19:55:17.666 INFO:teuthology.orchestra.run.smithi155.stdout: "event": "waiting for subops from 1", 2023-08-01T19:55:17.666 INFO:teuthology.orchestra.run.smithi155.stdout: "time": "2023-08-01T19:55:17.601029+0000", 2023-08-01T19:55:17.666 INFO:teuthology.orchestra.run.smithi155.stdout: "duration": 0.00010666399999999999 2023-08-01T19:55:17.666 INFO:teuthology.orchestra.run.smithi155.stdout: } 2023-08-01T19:55:17.666 INFO:teuthology.orchestra.run.smithi155.stdout: ] 2023-08-01T19:55:17.666 INFO:teuthology.orchestra.run.smithi155.stdout: } 2023-08-01T19:55:17.667 INFO:teuthology.orchestra.run.smithi155.stdout: }, 2023-08-01T19:55:17.667 INFO:teuthology.orchestra.run.smithi155.stdout: { 2023-08-01T19:55:17.667 INFO:teuthology.orchestra.run.smithi155.stdout: "description": "osd_op(client.4668.0:121358 5.f 5.a0d0754f (undecoded) ondisk+write+known_if_redirected+supports_pool_eio e43)", 2023-08-01T19:55:17.667 INFO:teuthology.orchestra.run.smithi155.stdout: "initiated_at": "2023-08-01T19:55:17.600937+0000", 2023-08-01T19:55:17.667 INFO:teuthology.orchestra.run.smithi155.stdout: "age": 0.00093963200000000003, 2023-08-01T19:55:17.667 INFO:teuthology.orchestra.run.smithi155.stdout: "duration": 0.0015678840000000001, 2023-08-01T19:55:17.667 INFO:teuthology.orchestra.run.smithi155.stdout: "type_data": { 2023-08-01T19:55:17.667 INFO:teuthology.orchestra.run.smithi155.stdout: "flag_point": "queued for pg", 2023-08-01T19:55:17.668 INFO:teuthology.orchestra.run.smithi155.stdout: "client_info": { 2023-08-01T19:55:17.668 INFO:teuthology.orchestra.run.smithi155.stdout: "client": "client.4668", 2023-08-01T19:55:17.668 INFO:teuthology.orchestra.run.smithi155.stdout: "client_addr": "172.21.15.6:0/1709472247", 2023-08-01T19:55:17.668 INFO:teuthology.orchestra.run.smithi155.stdout: "tid": 121358 2023-08-01T19:55:17.668 INFO:teuthology.orchestra.run.smithi155.stdout: }, 2023-08-01T19:55:17.668 INFO:teuthology.orchestra.run.smithi155.stdout: "events": [ 2023-08-01T19:55:17.668 INFO:teuthology.orchestra.run.smithi155.stdout: { 2023-08-01T19:55:17.668 INFO:teuthology.orchestra.run.smithi155.stdout: "event": "initiated", 2023-08-01T19:55:17.669 INFO:teuthology.orchestra.run.smithi155.stdout: "time": "2023-08-01T19:55:17.600937+0000", 2023-08-01T19:55:17.669 INFO:teuthology.orchestra.run.smithi155.stdout: "duration": 0 2023-08-01T19:55:17.669 INFO:teuthology.orchestra.run.smithi155.stdout: }, 2023-08-01T19:55:17.669 INFO:teuthology.orchestra.run.smithi155.stdout: { 2023-08-01T19:55:17.669 INFO:teuthology.orchestra.run.smithi155.stdout: "event": "throttled", 2023-08-01T19:55:17.669 INFO:teuthology.orchestra.run.smithi155.stdout: "time": "2023-08-01T19:55:17.600937+0000", 2023-08-01T19:55:17.669 INFO:teuthology.orchestra.run.smithi155.stdout: "duration": 0 2023-08-01T19:55:17.670 INFO:teuthology.orchestra.run.smithi155.stdout: }, 2023-08-01T19:55:17.670 INFO:teuthology.orchestra.run.smithi155.stdout: { 2023-08-01T19:55:17.670 INFO:teuthology.orchestra.run.smithi155.stdout: "event": "header_read", 2023-08-01T19:55:17.670 INFO:teuthology.orchestra.run.smithi155.stdout: "time": "2023-08-01T19:55:17.600936+0000", 2023-08-01T19:55:17.670 INFO:teuthology.orchestra.run.smithi155.stdout: "duration": 4294967295.999999 2023-08-01T19:55:17.670 INFO:teuthology.orchestra.run.smithi155.stdout: }, 2023-08-01T19:55:17.670 INFO:teuthology.orchestra.run.smithi155.stdout: { 2023-08-01T19:55:17.670 INFO:teuthology.orchestra.run.smithi155.stdout: "event": "all_read", 2023-08-01T19:55:17.671 INFO:teuthology.orchestra.run.smithi155.stdout: "time": "2023-08-01T19:55:17.600988+0000", 2023-08-01T19:55:17.671 INFO:teuthology.orchestra.run.smithi155.stdout: "duration": 5.2283000000000001e-05 2023-08-01T19:55:17.671 INFO:teuthology.orchestra.run.smithi155.stdout: }, 2023-08-01T19:55:17.671 INFO:teuthology.orchestra.run.smithi155.stdout: { 2023-08-01T19:55:17.671 INFO:teuthology.orchestra.run.smithi155.stdout: "event": "dispatched", 2023-08-01T19:55:17.671 INFO:teuthology.orchestra.run.smithi155.stdout: "time": "2023-08-01T19:55:17.600998+0000", 2023-08-01T19:55:17.671 INFO:teuthology.orchestra.run.smithi155.stdout: "duration": 1.0328e-05 2023-08-01T19:55:17.671 INFO:teuthology.orchestra.run.smithi155.stdout: }, 2023-08-01T19:55:17.672 INFO:teuthology.orchestra.run.smithi155.stdout: { 2023-08-01T19:55:17.672 INFO:teuthology.orchestra.run.smithi155.stdout: "event": "queued_for_pg", 2023-08-01T19:55:17.672 INFO:teuthology.orchestra.run.smithi155.stdout: "time": "2023-08-01T19:55:17.601007+0000", 2023-08-01T19:55:17.672 INFO:teuthology.orchestra.run.smithi155.stdout: "duration": 8.5180000000000004e-06 2023-08-01T19:55:17.672 INFO:teuthology.orchestra.run.smithi155.stdout: } 2023-08-01T19:55:17.672 INFO:teuthology.orchestra.run.smithi155.stdout: ] 2023-08-01T19:55:17.672 INFO:teuthology.orchestra.run.smithi155.stdout: } 2023-08-01T19:55:17.672 INFO:teuthology.orchestra.run.smithi155.stdout: } 2023-08-01T19:55:17.673 INFO:teuthology.orchestra.run.smithi155.stdout: ], 2023-08-01T19:55:17.673 INFO:teuthology.orchestra.run.smithi155.stdout: "num_ops": 9 2023-08-01T19:55:17.673 INFO:teuthology.orchestra.run.smithi155.stdout:} 2023-08-01T19:55:17.673 DEBUG:teuthology.orchestra.run.smithi006:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 120 ceph --cluster ceph osd unset nodeep-scrub 2023-08-01T19:55:17.675 DEBUG:teuthology.orchestra.run.smithi155:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 30 ceph --cluster ceph --admin-daemon /var/run/ceph/ceph-osd.2.asok dump_blocked_ops 2023-08-01T19:55:17.675 INFO:tasks.ceph.osd.2.smithi155.stderr:2023-08-01T19:55:17.673+0000 7faa5c6ac700 -1 received signal: Hangup from /usr/bin/python3 /bin/daemon-helper kill ceph-osd -f --cluster ceph -i 2 (PID: 111337) UID: 0 2023-08-01T19:55:17.775 INFO:tasks.ceph.osd.1.smithi101.stderr:2023-08-01T19:55:17.773+0000 7fb0cb7f6700 -1 received signal: Hangup from /usr/bin/python3 /bin/daemon-helper kill ceph-osd -f --cluster ceph -i 1 (PID: 111141) UID: 0 2023-08-01T19:55:17.875 INFO:tasks.ceph.osd.2.smithi155.stderr:2023-08-01T19:55:17.874+0000 7faa5c6ac700 -1 received signal: Hangup from /usr/bin/python3 /bin/daemon-helper kill ceph-osd -f --cluster ceph -i 2 (PID: 111337) UID: 0 2023-08-01T19:55:17.881 INFO:teuthology.orchestra.run.smithi155.stdout:{ 2023-08-01T19:55:17.881 INFO:teuthology.orchestra.run.smithi155.stdout: "ops": [], 2023-08-01T19:55:17.882 INFO:teuthology.orchestra.run.smithi155.stdout: "complaint_time": 30, 2023-08-01T19:55:17.882 INFO:teuthology.orchestra.run.smithi155.stdout: "num_blocked_ops": 0 2023-08-01T19:55:17.882 INFO:teuthology.orchestra.run.smithi155.stdout:} 2023-08-01T19:55:17.896 DEBUG:teuthology.orchestra.run.smithi155:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 30 ceph --cluster ceph --admin-daemon /var/run/ceph/ceph-osd.2.asok dump_historic_ops 2023-08-01T19:55:17.977 INFO:tasks.ceph.osd.0.smithi008.stderr:2023-08-01T19:55:17.975+0000 7f16a58f4700 -1 received signal: Hangup from /usr/bin/python3 /bin/daemon-helper kill ceph-osd -f --cluster ceph -i 0 (PID: 111179) UID: 0 2023-08-01T19:55:18.077 INFO:tasks.ceph.osd.2.smithi155.stderr:2023-08-01T19:55:18.076+0000 7faa5c6ac700 -1 received signal: Hangup from /usr/bin/python3 /bin/daemon-helper kill ceph-osd -f --cluster ceph -i 2 (PID: 111337) UID: 0 2023-08-01T19:55:18.110 INFO:teuthology.orchestra.run.smithi155.stdout:{ 2023-08-01T19:55:18.111 INFO:teuthology.orchestra.run.smithi155.stdout: "size": 20, 2023-08-01T19:55:18.111 INFO:teuthology.orchestra.run.smithi155.stdout: "duration": 600, 2023-08-01T19:55:18.111 INFO:teuthology.orchestra.run.smithi155.stdout: "ops": [ 2023-08-01T19:55:18.111 INFO:teuthology.orchestra.run.smithi155.stdout: { 2023-08-01T19:55:18.111 INFO:teuthology.orchestra.run.smithi155.stdout: "description": "osd_op(client.4668.0:73454 5.8 5:15596b2f:::benchmark_data_smithi006_114134_object73453:head [set-alloc-hint object_size 65536 write_size 65536,write 0~65536] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e31)", 2023-08-01T19:55:18.111 INFO:teuthology.orchestra.run.smithi155.stdout: "initiated_at": "2023-08-01T19:54:51.460020+0000", 2023-08-01T19:55:18.112 INFO:teuthology.orchestra.run.smithi155.stdout: "age": 26.647556950999999, 2023-08-01T19:55:18.112 INFO:teuthology.orchestra.run.smithi155.stdout: "duration": 0.022889436999999999, 2023-08-01T19:55:18.112 INFO:teuthology.orchestra.run.smithi155.stdout: "type_data": { 2023-08-01T19:55:18.112 INFO:teuthology.orchestra.run.smithi155.stdout: "flag_point": "commit sent; apply or cleanup", 2023-08-01T19:55:18.112 INFO:teuthology.orchestra.run.smithi155.stdout: "client_info": { 2023-08-01T19:55:18.112 INFO:teuthology.orchestra.run.smithi155.stdout: "client": "client.4668", 2023-08-01T19:55:18.113 INFO:teuthology.orchestra.run.smithi155.stdout: "client_addr": "172.21.15.6:0/1709472247", 2023-08-01T19:55:18.113 INFO:teuthology.orchestra.run.smithi155.stdout: "tid": 73454 2023-08-01T19:55:18.113 INFO:teuthology.orchestra.run.smithi155.stdout: }, 2023-08-01T19:55:18.113 INFO:teuthology.orchestra.run.smithi155.stdout: "events": [ 2023-08-01T19:55:18.113 INFO:teuthology.orchestra.run.smithi155.stdout: { 2023-08-01T19:55:18.113 INFO:teuthology.orchestra.run.smithi155.stdout: "event": "initiated", 2023-08-01T19:55:18.113 INFO:teuthology.orchestra.run.smithi155.stdout: "time": "2023-08-01T19:54:51.460020+0000", 2023-08-01T19:55:18.113 INFO:teuthology.orchestra.run.smithi155.stdout: "duration": 0 2023-08-01T19:55:18.114 INFO:teuthology.orchestra.run.smithi155.stdout: }, 2023-08-01T19:55:18.114 INFO:teuthology.orchestra.run.smithi155.stdout: { 2023-08-01T19:55:18.114 INFO:teuthology.orchestra.run.smithi155.stdout: "event": "throttled", 2023-08-01T19:55:18.114 INFO:teuthology.orchestra.run.smithi155.stdout: "time": "2023-08-01T19:54:51.460020+0000", 2023-08-01T19:55:18.114 INFO:teuthology.orchestra.run.smithi155.stdout: "duration": 0 2023-08-01T19:55:18.114 INFO:teuthology.orchestra.run.smithi155.stdout: }, 2023-08-01T19:55:18.114 INFO:teuthology.orchestra.run.smithi155.stdout: { 2023-08-01T19:55:18.114 INFO:teuthology.orchestra.run.smithi155.stdout: "event": "header_read", 2023-08-01T19:55:18.115 INFO:teuthology.orchestra.run.smithi155.stdout: "time": "2023-08-01T19:54:51.460019+0000", 2023-08-01T19:55:18.115 INFO:teuthology.orchestra.run.smithi155.stdout: "duration": 4294967295.9999995 2023-08-01T19:55:18.115 INFO:teuthology.orchestra.run.smithi155.stdout: }, 2023-08-01T19:55:18.115 INFO:teuthology.orchestra.run.smithi155.stdout: { 2023-08-01T19:55:18.115 INFO:teuthology.orchestra.run.smithi155.stdout: "event": "all_read", 2023-08-01T19:55:18.115 INFO:teuthology.orchestra.run.smithi155.stdout: "time": "2023-08-01T19:54:51.460051+0000", 2023-08-01T19:55:18.115 INFO:teuthology.orchestra.run.smithi155.stdout: "duration": 3.1736000000000002e-05 2023-08-01T19:55:18.116 INFO:teuthology.orchestra.run.smithi155.stdout: }, 2023-08-01T19:55:18.116 INFO:teuthology.orchestra.run.smithi155.stdout: { 2023-08-01T19:55:18.116 INFO:teuthology.orchestra.run.smithi155.stdout: "event": "dispatched", 2023-08-01T19:55:18.116 INFO:teuthology.orchestra.run.smithi155.stdout: "time": "2023-08-01T19:54:51.460058+0000", 2023-08-01T19:55:18.116 INFO:teuthology.orchestra.run.smithi155.stdout: "duration": 7.3869999999999997e-06 2023-08-01T19:55:18.116 INFO:teuthology.orchestra.run.smithi155.stdout: }, 2023-08-01T19:55:18.116 INFO:teuthology.orchestra.run.smithi155.stdout: { 2023-08-01T19:55:18.116 INFO:teuthology.orchestra.run.smithi155.stdout: "event": "queued_for_pg", 2023-08-01T19:55:18.117 INFO:teuthology.orchestra.run.smithi155.stdout: "time": "2023-08-01T19:54:51.460062+0000", 2023-08-01T19:55:18.117 INFO:teuthology.orchestra.run.smithi155.stdout: "duration": 4.352e-06 2023-08-01T19:55:18.117 INFO:teuthology.orchestra.run.smithi155.stdout: }, 2023-08-01T19:55:18.117 INFO:teuthology.orchestra.run.smithi155.stdout: { 2023-08-01T19:55:18.117 INFO:teuthology.orchestra.run.smithi155.stdout: "event": "reached_pg", 2023-08-01T19:55:18.117 INFO:teuthology.orchestra.run.smithi155.stdout: "time": "2023-08-01T19:54:51.460101+0000", 2023-08-01T19:55:18.117 INFO:teuthology.orchestra.run.smithi155.stdout: "duration": 3.8705000000000003e-05 2023-08-01T19:55:18.118 INFO:teuthology.orchestra.run.smithi155.stdout: }, 2023-08-01T19:55:18.118 INFO:teuthology.orchestra.run.smithi155.stdout: { 2023-08-01T19:55:18.118 INFO:teuthology.orchestra.run.smithi155.stdout: "event": "started", 2023-08-01T19:55:18.118 INFO:teuthology.orchestra.run.smithi155.stdout: "time": "2023-08-01T19:54:51.460236+0000", 2023-08-01T19:55:18.118 INFO:teuthology.orchestra.run.smithi155.stdout: "duration": 0.00013463599999999999 2023-08-01T19:55:18.118 INFO:teuthology.orchestra.run.smithi155.stdout: }, 2023-08-01T19:55:18.118 INFO:teuthology.orchestra.run.smithi155.stdout: { 2023-08-01T19:55:18.118 INFO:teuthology.orchestra.run.smithi155.stdout: "event": "waiting for subops from 0", 2023-08-01T19:55:18.119 INFO:teuthology.orchestra.run.smithi155.stdout: "time": "2023-08-01T19:54:51.460391+0000", 2023-08-01T19:55:18.119 INFO:teuthology.orchestra.run.smithi155.stdout: "duration": 0.00015525000000000001 2023-08-01T19:55:18.119 INFO:teuthology.orchestra.run.smithi155.stdout: }, 2023-08-01T19:55:18.119 INFO:teuthology.orchestra.run.smithi155.stdout: { 2023-08-01T19:55:18.119 INFO:teuthology.orchestra.run.smithi155.stdout: "event": "sub_op_commit_rec", 2023-08-01T19:55:18.119 INFO:teuthology.orchestra.run.smithi155.stdout: "time": "2023-08-01T19:54:51.468393+0000", 2023-08-01T19:55:18.119 INFO:teuthology.orchestra.run.smithi155.stdout: "duration": 0.00800208 2023-08-01T19:55:18.119 INFO:teuthology.orchestra.run.smithi155.stdout: }, 2023-08-01T19:55:18.120 INFO:teuthology.orchestra.run.smithi155.stdout: { 2023-08-01T19:55:18.120 INFO:teuthology.orchestra.run.smithi155.stdout: "event": "op_commit", 2023-08-01T19:55:18.120 INFO:teuthology.orchestra.run.smithi155.stdout: "time": "2023-08-01T19:54:51.482815+0000", 2023-08-01T19:55:18.120 INFO:teuthology.orchestra.run.smithi155.stdout: "duration": 0.01442148 2023-08-01T19:55:18.120 INFO:teuthology.orchestra.run.smithi155.stdout: }, 2023-08-01T19:55:18.120 INFO:teuthology.orchestra.run.smithi155.stdout: { 2023-08-01T19:55:18.120 INFO:teuthology.orchestra.run.smithi155.stdout: "event": "commit_sent", 2023-08-01T19:55:18.120 INFO:teuthology.orchestra.run.smithi155.stdout: "time": "2023-08-01T19:54:51.482866+0000", 2023-08-01T19:55:18.121 INFO:teuthology.orchestra.run.smithi155.stdout: "duration": 5.1842999999999998e-05 2023-08-01T19:55:18.121 INFO:teuthology.orchestra.run.smithi155.stdout: }, 2023-08-01T19:55:18.121 INFO:teuthology.orchestra.run.smithi155.stdout: { 2023-08-01T19:55:18.121 INFO:teuthology.orchestra.run.smithi155.stdout: "event": "done", 2023-08-01T19:55:18.121 INFO:teuthology.orchestra.run.smithi155.stdout: "time": "2023-08-01T19:54:51.482909+0000", 2023-08-01T19:55:18.121 INFO:teuthology.orchestra.run.smithi155.stdout: "duration": 4.2663000000000001e-05 2023-08-01T19:55:18.121 INFO:teuthology.orchestra.run.smithi155.stdout: } 2023-08-01T19:55:18.121 INFO:teuthology.orchestra.run.smithi155.stdout: ] 2023-08-01T19:55:18.122 INFO:teuthology.orchestra.run.smithi155.stdout: } 2023-08-01T19:55:18.122 INFO:teuthology.orchestra.run.smithi155.stdout: }, 2023-08-01T19:55:18.122 INFO:teuthology.orchestra.run.smithi155.stdout: { 2023-08-01T19:55:18.122 INFO:teuthology.orchestra.run.smithi155.stdout: "description": "osd_op(client.4668.0:73455 5.b 5:de51121e:::benchmark_data_smithi006_114134_object73454:head [set-alloc-hint object_size 65536 write_size 65536,write 0~65536] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e31)", 2023-08-01T19:55:18.122 INFO:teuthology.orchestra.run.smithi155.stdout: "initiated_at": "2023-08-01T19:54:51.460078+0000", 2023-08-01T19:55:18.122 INFO:teuthology.orchestra.run.smithi155.stdout: "age": 26.647498977000001, 2023-08-01T19:55:18.122 INFO:teuthology.orchestra.run.smithi155.stdout: "duration": 0.022689121999999999, 2023-08-01T19:55:18.123 INFO:teuthology.orchestra.run.smithi155.stdout: "type_data": { 2023-08-01T19:55:18.123 INFO:teuthology.orchestra.run.smithi155.stdout: "flag_point": "commit sent; apply or cleanup", 2023-08-01T19:55:18.123 INFO:teuthology.orchestra.run.smithi155.stdout: "client_info": { 2023-08-01T19:55:18.123 INFO:teuthology.orchestra.run.smithi155.stdout: "client": "client.4668", 2023-08-01T19:55:18.123 INFO:teuthology.orchestra.run.smithi155.stdout: "client_addr": "172.21.15.6:0/1709472247", 2023-08-01T19:55:18.123 INFO:teuthology.orchestra.run.smithi155.stdout: "tid": 73455 2023-08-01T19:55:18.123 INFO:teuthology.orchestra.run.smithi155.stdout: }, 2023-08-01T19:55:18.123 INFO:teuthology.orchestra.run.smithi155.stdout: "events": [ 2023-08-01T19:55:18.124 INFO:teuthology.orchestra.run.smithi155.stdout: { 2023-08-01T19:55:18.124 INFO:teuthology.orchestra.run.smithi155.stdout: "event": "initiated", 2023-08-01T19:55:18.124 INFO:teuthology.orchestra.run.smithi155.stdout: "time": "2023-08-01T19:54:51.460078+0000", 2023-08-01T19:55:18.124 INFO:teuthology.orchestra.run.smithi155.stdout: "duration": 0 2023-08-01T19:55:18.124 INFO:teuthology.orchestra.run.smithi155.stdout: }, 2023-08-01T19:55:18.124 INFO:teuthology.orchestra.run.smithi155.stdout: { 2023-08-01T19:55:18.124 INFO:teuthology.orchestra.run.smithi155.stdout: "event": "throttled", 2023-08-01T19:55:18.124 INFO:teuthology.orchestra.run.smithi155.stdout: "time": "2023-08-01T19:54:51.460078+0000", 2023-08-01T19:55:18.125 INFO:teuthology.orchestra.run.smithi155.stdout: "duration": 0 2023-08-01T19:55:18.125 INFO:teuthology.orchestra.run.smithi155.stdout: }, 2023-08-01T19:55:18.125 INFO:teuthology.orchestra.run.smithi155.stdout: { 2023-08-01T19:55:18.125 INFO:teuthology.orchestra.run.smithi155.stdout: "event": "header_read", 2023-08-01T19:55:18.125 INFO:teuthology.orchestra.run.smithi155.stdout: "time": "2023-08-01T19:54:51.460077+0000", 2023-08-01T19:55:18.125 INFO:teuthology.orchestra.run.smithi155.stdout: "duration": 4294967295.9999995 2023-08-01T19:55:18.125 INFO:teuthology.orchestra.run.smithi155.stdout: }, 2023-08-01T19:55:18.125 INFO:teuthology.orchestra.run.smithi155.stdout: { 2023-08-01T19:55:18.126 INFO:teuthology.orchestra.run.smithi155.stdout: "event": "all_read", 2023-08-01T19:55:18.126 INFO:teuthology.orchestra.run.smithi155.stdout: "time": "2023-08-01T19:54:51.460102+0000", 2023-08-01T19:55:18.126 INFO:teuthology.orchestra.run.smithi155.stdout: "duration": 2.4933e-05 2023-08-01T19:55:18.126 INFO:teuthology.orchestra.run.smithi155.stdout: }, 2023-08-01T19:55:18.126 INFO:teuthology.orchestra.run.smithi155.stdout: { 2023-08-01T19:55:18.126 INFO:teuthology.orchestra.run.smithi155.stdout: "event": "dispatched", 2023-08-01T19:55:18.126 INFO:teuthology.orchestra.run.smithi155.stdout: "time": "2023-08-01T19:54:51.460109+0000", 2023-08-01T19:55:18.126 INFO:teuthology.orchestra.run.smithi155.stdout: "duration": 7.0720000000000002e-06 2023-08-01T19:55:18.127 INFO:teuthology.orchestra.run.smithi155.stdout: }, 2023-08-01T19:55:18.127 INFO:teuthology.orchestra.run.smithi155.stdout: { 2023-08-01T19:55:18.127 INFO:teuthology.orchestra.run.smithi155.stdout: "event": "queued_for_pg", 2023-08-01T19:55:18.127 INFO:teuthology.orchestra.run.smithi155.stdout: "time": "2023-08-01T19:54:51.460113+0000", 2023-08-01T19:55:18.127 INFO:teuthology.orchestra.run.smithi155.stdout: "duration": 4.3220000000000003e-06 2023-08-01T19:55:18.127 INFO:teuthology.orchestra.run.smithi155.stdout: }, 2023-08-01T19:55:18.127 INFO:teuthology.orchestra.run.smithi155.stdout: { 2023-08-01T19:55:18.127 INFO:teuthology.orchestra.run.smithi155.stdout: "event": "reached_pg", 2023-08-01T19:55:18.128 INFO:teuthology.orchestra.run.smithi155.stdout: "time": "2023-08-01T19:54:51.460955+0000", 2023-08-01T19:55:18.128 INFO:teuthology.orchestra.run.smithi155.stdout: "duration": 0.00084142500000000003 2023-08-01T19:55:18.128 INFO:teuthology.orchestra.run.smithi155.stdout: }, 2023-08-01T19:55:18.128 INFO:teuthology.orchestra.run.smithi155.stdout: { 2023-08-01T19:55:18.128 INFO:teuthology.orchestra.run.smithi155.stdout: "event": "started", 2023-08-01T19:55:18.128 INFO:teuthology.orchestra.run.smithi155.stdout: "time": "2023-08-01T19:54:51.461079+0000", 2023-08-01T19:55:18.128 INFO:teuthology.orchestra.run.smithi155.stdout: "duration": 0.000123826 2023-08-01T19:55:18.129 INFO:teuthology.orchestra.run.smithi155.stdout: }, 2023-08-01T19:55:18.129 INFO:teuthology.orchestra.run.smithi155.stdout: { 2023-08-01T19:55:18.129 INFO:teuthology.orchestra.run.smithi155.stdout: "event": "waiting for subops from 0", 2023-08-01T19:55:18.129 INFO:teuthology.orchestra.run.smithi155.stdout: "time": "2023-08-01T19:54:51.461233+0000", 2023-08-01T19:55:18.129 INFO:teuthology.orchestra.run.smithi155.stdout: "duration": 0.00015431900000000001 2023-08-01T19:55:18.129 INFO:teuthology.orchestra.run.smithi155.stdout: }, 2023-08-01T19:55:18.129 INFO:teuthology.orchestra.run.smithi155.stdout: { 2023-08-01T19:55:18.129 INFO:teuthology.orchestra.run.smithi155.stdout: "event": "sub_op_commit_rec", 2023-08-01T19:55:18.130 INFO:teuthology.orchestra.run.smithi155.stdout: "time": "2023-08-01T19:54:51.468509+0000", 2023-08-01T19:55:18.130 INFO:teuthology.orchestra.run.smithi155.stdout: "duration": 0.0072759859999999999 2023-08-01T19:55:18.130 INFO:teuthology.orchestra.run.smithi155.stdout: }, 2023-08-01T19:55:18.130 INFO:teuthology.orchestra.run.smithi155.stdout: { 2023-08-01T19:55:18.130 INFO:teuthology.orchestra.run.smithi155.stdout: "event": "op_commit", 2023-08-01T19:55:18.130 INFO:teuthology.orchestra.run.smithi155.stdout: "time": "2023-08-01T19:54:51.482704+0000", 2023-08-01T19:55:18.130 INFO:teuthology.orchestra.run.smithi155.stdout: "duration": 0.01419545 2023-08-01T19:55:18.130 INFO:teuthology.orchestra.run.smithi155.stdout: }, 2023-08-01T19:55:18.131 INFO:teuthology.orchestra.run.smithi155.stdout: { 2023-08-01T19:55:18.131 INFO:teuthology.orchestra.run.smithi155.stdout: "event": "commit_sent", 2023-08-01T19:55:18.131 INFO:teuthology.orchestra.run.smithi155.stdout: "time": "2023-08-01T19:54:51.482747+0000", 2023-08-01T19:55:18.131 INFO:teuthology.orchestra.run.smithi155.stdout: "duration": 4.2413999999999997e-05 2023-08-01T19:55:18.131 INFO:teuthology.orchestra.run.smithi155.stdout: }, 2023-08-01T19:55:18.131 INFO:teuthology.orchestra.run.smithi155.stdout: { 2023-08-01T19:55:18.131 INFO:teuthology.orchestra.run.smithi155.stdout: "event": "done", 2023-08-01T19:55:18.131 INFO:teuthology.orchestra.run.smithi155.stdout: "time": "2023-08-01T19:54:51.482767+0000", 2023-08-01T19:55:18.132 INFO:teuthology.orchestra.run.smithi155.stdout: "duration": 1.9908999999999999e-05 2023-08-01T19:55:18.132 INFO:teuthology.orchestra.run.smithi155.stdout: } 2023-08-01T19:55:18.132 INFO:teuthology.orchestra.run.smithi155.stdout: ] 2023-08-01T19:55:18.132 INFO:teuthology.orchestra.run.smithi155.stdout: } 2023-08-01T19:55:18.132 INFO:teuthology.orchestra.run.smithi155.stdout: }, 2023-08-01T19:55:18.132 INFO:teuthology.orchestra.run.smithi155.stdout: { 2023-08-01T19:55:18.132 INFO:teuthology.orchestra.run.smithi155.stdout: "description": "osd_op(client.4668.0:73456 5.0 5:0164baf4:::benchmark_data_smithi006_114134_object73455:head [set-alloc-hint object_size 65536 write_size 65536,write 0~65536] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e31)", 2023-08-01T19:55:18.133 INFO:teuthology.orchestra.run.smithi155.stdout: "initiated_at": "2023-08-01T19:54:51.461520+0000", 2023-08-01T19:55:18.133 INFO:teuthology.orchestra.run.smithi155.stdout: "age": 26.646056987000001, 2023-08-01T19:55:18.133 INFO:teuthology.orchestra.run.smithi155.stdout: "duration": 0.023899916, 2023-08-01T19:55:18.133 INFO:teuthology.orchestra.run.smithi155.stdout: "type_data": { 2023-08-01T19:55:18.133 INFO:teuthology.orchestra.run.smithi155.stdout: "flag_point": "commit sent; apply or cleanup", 2023-08-01T19:55:18.133 INFO:teuthology.orchestra.run.smithi155.stdout: "client_info": { 2023-08-01T19:55:18.133 INFO:teuthology.orchestra.run.smithi155.stdout: "client": "client.4668", 2023-08-01T19:55:18.133 INFO:teuthology.orchestra.run.smithi155.stdout: "client_addr": "172.21.15.6:0/1709472247", 2023-08-01T19:55:18.134 INFO:teuthology.orchestra.run.smithi155.stdout: "tid": 73456 2023-08-01T19:55:18.134 INFO:teuthology.orchestra.run.smithi155.stdout: }, 2023-08-01T19:55:18.134 INFO:teuthology.orchestra.run.smithi155.stdout: "events": [ 2023-08-01T19:55:18.134 INFO:teuthology.orchestra.run.smithi155.stdout: { 2023-08-01T19:55:18.134 INFO:teuthology.orchestra.run.smithi155.stdout: "event": "initiated", 2023-08-01T19:55:18.134 INFO:teuthology.orchestra.run.smithi155.stdout: "time": "2023-08-01T19:54:51.461520+0000", 2023-08-01T19:55:18.134 INFO:teuthology.orchestra.run.smithi155.stdout: "duration": 0 2023-08-01T19:55:18.135 INFO:teuthology.orchestra.run.smithi155.stdout: }, 2023-08-01T19:55:18.135 INFO:teuthology.orchestra.run.smithi155.stdout: { 2023-08-01T19:55:18.135 INFO:teuthology.orchestra.run.smithi155.stdout: "event": "throttled", 2023-08-01T19:55:18.135 INFO:teuthology.orchestra.run.smithi155.stdout: "time": "2023-08-01T19:54:51.461520+0000", 2023-08-01T19:55:18.135 INFO:teuthology.orchestra.run.smithi155.stdout: "duration": 0 2023-08-01T19:55:18.135 INFO:teuthology.orchestra.run.smithi155.stdout: }, 2023-08-01T19:55:18.135 INFO:teuthology.orchestra.run.smithi155.stdout: { 2023-08-01T19:55:18.135 INFO:teuthology.orchestra.run.smithi155.stdout: "event": "header_read", 2023-08-01T19:55:18.136 INFO:teuthology.orchestra.run.smithi155.stdout: "time": "2023-08-01T19:54:51.461519+0000", 2023-08-01T19:55:18.136 INFO:teuthology.orchestra.run.smithi155.stdout: "duration": 4294967295.999999 2023-08-01T19:55:18.136 INFO:teuthology.orchestra.run.smithi155.stdout: }, 2023-08-01T19:55:18.136 INFO:teuthology.orchestra.run.smithi155.stdout: { 2023-08-01T19:55:18.136 INFO:teuthology.orchestra.run.smithi155.stdout: "event": "all_read", 2023-08-01T19:55:18.136 INFO:teuthology.orchestra.run.smithi155.stdout: "time": "2023-08-01T19:54:51.461633+0000", 2023-08-01T19:55:18.136 INFO:teuthology.orchestra.run.smithi155.stdout: "duration": 0.000114015 2023-08-01T19:55:18.136 INFO:teuthology.orchestra.run.smithi155.stdout: }, 2023-08-01T19:55:18.137 INFO:teuthology.orchestra.run.smithi155.stdout: { 2023-08-01T19:55:18.137 INFO:teuthology.orchestra.run.smithi155.stdout: "event": "dispatched", 2023-08-01T19:55:18.137 INFO:teuthology.orchestra.run.smithi155.stdout: "time": "2023-08-01T19:54:51.461643+0000", 2023-08-01T19:55:18.137 INFO:teuthology.orchestra.run.smithi155.stdout: "duration": 1.0217000000000001e-05 2023-08-01T19:55:18.137 INFO:teuthology.orchestra.run.smithi155.stdout: }, 2023-08-01T19:55:18.137 INFO:teuthology.orchestra.run.smithi155.stdout: { 2023-08-01T19:55:18.137 INFO:teuthology.orchestra.run.smithi155.stdout: "event": "queued_for_pg", 2023-08-01T19:55:18.137 INFO:teuthology.orchestra.run.smithi155.stdout: "time": "2023-08-01T19:54:51.461649+0000", 2023-08-01T19:55:18.138 INFO:teuthology.orchestra.run.smithi155.stdout: "duration": 5.8850000000000004e-06 2023-08-01T19:55:18.138 INFO:teuthology.orchestra.run.smithi155.stdout: }, 2023-08-01T19:55:18.138 INFO:teuthology.orchestra.run.smithi155.stdout: { 2023-08-01T19:55:18.138 INFO:teuthology.orchestra.run.smithi155.stdout: "event": "reached_pg", 2023-08-01T19:55:18.138 INFO:teuthology.orchestra.run.smithi155.stdout: "time": "2023-08-01T19:54:51.461686+0000", 2023-08-01T19:55:18.138 INFO:teuthology.orchestra.run.smithi155.stdout: "duration": 3.7319e-05 2023-08-01T19:55:18.138 INFO:teuthology.orchestra.run.smithi155.stdout: }, 2023-08-01T19:55:18.139 INFO:teuthology.orchestra.run.smithi155.stdout: { 2023-08-01T19:55:18.139 INFO:teuthology.orchestra.run.smithi155.stdout: "event": "started", 2023-08-01T19:55:18.139 INFO:teuthology.orchestra.run.smithi155.stdout: "time": "2023-08-01T19:54:51.461802+0000", 2023-08-01T19:55:18.139 INFO:teuthology.orchestra.run.smithi155.stdout: "duration": 0.000115604 2023-08-01T19:55:18.139 INFO:teuthology.orchestra.run.smithi155.stdout: }, 2023-08-01T19:55:18.139 INFO:teuthology.orchestra.run.smithi155.stdout: { 2023-08-01T19:55:18.139 INFO:teuthology.orchestra.run.smithi155.stdout: "event": "waiting for subops from 0", 2023-08-01T19:55:18.139 INFO:teuthology.orchestra.run.smithi155.stdout: "time": "2023-08-01T19:54:51.461933+0000", 2023-08-01T19:55:18.140 INFO:teuthology.orchestra.run.smithi155.stdout: "duration": 0.000131175 2023-08-01T19:55:18.140 INFO:teuthology.orchestra.run.smithi155.stdout: }, 2023-08-01T19:55:18.140 INFO:teuthology.orchestra.run.smithi155.stdout: { 2023-08-01T19:55:18.140 INFO:teuthology.orchestra.run.smithi155.stdout: "event": "sub_op_commit_rec", 2023-08-01T19:55:18.140 INFO:teuthology.orchestra.run.smithi155.stdout: "time": "2023-08-01T19:54:51.468411+0000", 2023-08-01T19:55:18.140 INFO:teuthology.orchestra.run.smithi155.stdout: "duration": 0.0064775850000000001 2023-08-01T19:55:18.140 INFO:teuthology.orchestra.run.smithi155.stdout: }, 2023-08-01T19:55:18.140 INFO:teuthology.orchestra.run.smithi155.stdout: { 2023-08-01T19:55:18.141 INFO:teuthology.orchestra.run.smithi155.stdout: "event": "op_commit", 2023-08-01T19:55:18.141 INFO:teuthology.orchestra.run.smithi155.stdout: "time": "2023-08-01T19:54:51.485340+0000", 2023-08-01T19:55:18.141 INFO:teuthology.orchestra.run.smithi155.stdout: "duration": 0.016928907 2023-08-01T19:55:18.141 INFO:teuthology.orchestra.run.smithi155.stdout: }, 2023-08-01T19:55:18.141 INFO:teuthology.orchestra.run.smithi155.stdout: { 2023-08-01T19:55:18.141 INFO:teuthology.orchestra.run.smithi155.stdout: "event": "commit_sent", 2023-08-01T19:55:18.141 INFO:teuthology.orchestra.run.smithi155.stdout: "time": "2023-08-01T19:54:51.485385+0000", 2023-08-01T19:55:18.141 INFO:teuthology.orchestra.run.smithi155.stdout: "duration": 4.5222000000000002e-05 2023-08-01T19:55:18.142 INFO:teuthology.orchestra.run.smithi155.stdout: }, 2023-08-01T19:55:18.142 INFO:teuthology.orchestra.run.smithi155.stdout: { 2023-08-01T19:55:18.142 INFO:teuthology.orchestra.run.smithi155.stdout: "event": "done", 2023-08-01T19:55:18.142 INFO:teuthology.orchestra.run.smithi155.stdout: "time": "2023-08-01T19:54:51.485420+0000", 2023-08-01T19:55:18.142 INFO:teuthology.orchestra.run.smithi155.stdout: "duration": 3.4717e-05 2023-08-01T19:55:18.142 INFO:teuthology.orchestra.run.smithi155.stdout: } 2023-08-01T19:55:18.142 INFO:teuthology.orchestra.run.smithi155.stdout: ] 2023-08-01T19:55:18.143 INFO:teuthology.orchestra.run.smithi155.stdout: } 2023-08-01T19:55:18.143 INFO:teuthology.orchestra.run.smithi155.stdout: }, 2023-08-01T19:55:18.143 INFO:teuthology.orchestra.run.smithi155.stdout: { 2023-08-01T19:55:18.143 INFO:teuthology.orchestra.run.smithi155.stdout: "description": "osd_op(client.4668.0:100237 5.4 5:2d68bec9:::benchmark_data_smithi006_114134_object100236:head [set-alloc-hint object_size 65536 write_size 65536,write 0~65536] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e37)", 2023-08-01T19:55:18.143 INFO:teuthology.orchestra.run.smithi155.stdout: "initiated_at": "2023-08-01T19:55:05.147736+0000", 2023-08-01T19:55:18.143 INFO:teuthology.orchestra.run.smithi155.stdout: "age": 12.959840273999999, 2023-08-01T19:55:18.143 INFO:teuthology.orchestra.run.smithi155.stdout: "duration": 0.071299464000000007, 2023-08-01T19:55:18.143 INFO:teuthology.orchestra.run.smithi155.stdout: "type_data": { 2023-08-01T19:55:18.144 INFO:teuthology.orchestra.run.smithi155.stdout: "flag_point": "commit sent; apply or cleanup", 2023-08-01T19:55:18.144 INFO:teuthology.orchestra.run.smithi155.stdout: "client_info": { 2023-08-01T19:55:18.144 INFO:teuthology.orchestra.run.smithi155.stdout: "client": "client.4668", 2023-08-01T19:55:18.144 INFO:teuthology.orchestra.run.smithi155.stdout: "client_addr": "172.21.15.6:0/1709472247", 2023-08-01T19:55:18.144 INFO:teuthology.orchestra.run.smithi155.stdout: "tid": 100237 2023-08-01T19:55:18.144 INFO:teuthology.orchestra.run.smithi155.stdout: }, 2023-08-01T19:55:18.144 INFO:teuthology.orchestra.run.smithi155.stdout: "events": [ 2023-08-01T19:55:18.145 INFO:teuthology.orchestra.run.smithi155.stdout: { 2023-08-01T19:55:18.145 INFO:teuthology.orchestra.run.smithi155.stdout: "event": "initiated", 2023-08-01T19:55:18.145 INFO:teuthology.orchestra.run.smithi155.stdout: "time": "2023-08-01T19:55:05.147736+0000", 2023-08-01T19:55:18.145 INFO:teuthology.orchestra.run.smithi155.stdout: "duration": 0 2023-08-01T19:55:18.145 INFO:teuthology.orchestra.run.smithi155.stdout: }, 2023-08-01T19:55:18.145 INFO:teuthology.orchestra.run.smithi155.stdout: { 2023-08-01T19:55:18.145 INFO:teuthology.orchestra.run.smithi155.stdout: "event": "throttled", 2023-08-01T19:55:18.145 INFO:teuthology.orchestra.run.smithi155.stdout: "time": "2023-08-01T19:55:05.147736+0000", 2023-08-01T19:55:18.146 INFO:teuthology.orchestra.run.smithi155.stdout: "duration": 0 2023-08-01T19:55:18.146 INFO:teuthology.orchestra.run.smithi155.stdout: }, 2023-08-01T19:55:18.146 INFO:teuthology.orchestra.run.smithi155.stdout: { 2023-08-01T19:55:18.146 INFO:teuthology.orchestra.run.smithi155.stdout: "event": "header_read", 2023-08-01T19:55:18.146 INFO:teuthology.orchestra.run.smithi155.stdout: "time": "2023-08-01T19:55:05.147736+0000", 2023-08-01T19:55:18.146 INFO:teuthology.orchestra.run.smithi155.stdout: "duration": 4294967295.9999995 2023-08-01T19:55:18.146 INFO:teuthology.orchestra.run.smithi155.stdout: }, 2023-08-01T19:55:18.146 INFO:teuthology.orchestra.run.smithi155.stdout: { 2023-08-01T19:55:18.147 INFO:teuthology.orchestra.run.smithi155.stdout: "event": "all_read", 2023-08-01T19:55:18.147 INFO:teuthology.orchestra.run.smithi155.stdout: "time": "2023-08-01T19:55:05.147766+0000", 2023-08-01T19:55:18.147 INFO:teuthology.orchestra.run.smithi155.stdout: "duration": 3.0394000000000001e-05 2023-08-01T19:55:18.147 INFO:teuthology.orchestra.run.smithi155.stdout: }, 2023-08-01T19:55:18.147 INFO:teuthology.orchestra.run.smithi155.stdout: { 2023-08-01T19:55:18.147 INFO:teuthology.orchestra.run.smithi155.stdout: "event": "dispatched", 2023-08-01T19:55:18.147 INFO:teuthology.orchestra.run.smithi155.stdout: "time": "2023-08-01T19:55:05.147771+0000", 2023-08-01T19:55:18.147 INFO:teuthology.orchestra.run.smithi155.stdout: "duration": 4.25e-06 2023-08-01T19:55:18.148 INFO:teuthology.orchestra.run.smithi155.stdout: }, 2023-08-01T19:55:18.148 INFO:teuthology.orchestra.run.smithi155.stdout: { 2023-08-01T19:55:18.148 INFO:teuthology.orchestra.run.smithi155.stdout: "event": "queued_for_pg", 2023-08-01T19:55:18.148 INFO:teuthology.orchestra.run.smithi155.stdout: "time": "2023-08-01T19:55:05.147773+0000", 2023-08-01T19:55:18.148 INFO:teuthology.orchestra.run.smithi155.stdout: "duration": 2.4159999999999998e-06 2023-08-01T19:55:18.148 INFO:teuthology.orchestra.run.smithi155.stdout: }, 2023-08-01T19:55:18.148 INFO:teuthology.orchestra.run.smithi155.stdout: { 2023-08-01T19:55:18.149 INFO:teuthology.orchestra.run.smithi155.stdout: "event": "reached_pg", 2023-08-01T19:55:18.149 INFO:teuthology.orchestra.run.smithi155.stdout: "time": "2023-08-01T19:55:05.149903+0000", 2023-08-01T19:55:18.149 INFO:teuthology.orchestra.run.smithi155.stdout: "duration": 0.002129948 2023-08-01T19:55:18.149 INFO:teuthology.orchestra.run.smithi155.stdout: }, 2023-08-01T19:55:18.149 INFO:teuthology.orchestra.run.smithi155.stdout: { 2023-08-01T19:55:18.149 INFO:teuthology.orchestra.run.smithi155.stdout: "event": "started", 2023-08-01T19:55:18.149 INFO:teuthology.orchestra.run.smithi155.stdout: "time": "2023-08-01T19:55:05.149982+0000", 2023-08-01T19:55:18.150 INFO:teuthology.orchestra.run.smithi155.stdout: "duration": 7.8706000000000002e-05 2023-08-01T19:55:18.150 INFO:teuthology.orchestra.run.smithi155.stdout: }, 2023-08-01T19:55:18.150 INFO:teuthology.orchestra.run.smithi155.stdout: { 2023-08-01T19:55:18.150 INFO:teuthology.orchestra.run.smithi155.stdout: "event": "waiting for subops from 0", 2023-08-01T19:55:18.150 INFO:teuthology.orchestra.run.smithi155.stdout: "time": "2023-08-01T19:55:05.150066+0000", 2023-08-01T19:55:18.150 INFO:teuthology.orchestra.run.smithi155.stdout: "duration": 8.4241999999999997e-05 2023-08-01T19:55:18.150 INFO:teuthology.orchestra.run.smithi155.stdout: }, 2023-08-01T19:55:18.150 INFO:teuthology.orchestra.run.smithi155.stdout: { 2023-08-01T19:55:18.151 INFO:teuthology.orchestra.run.smithi155.stdout: "event": "op_commit", 2023-08-01T19:55:18.151 INFO:teuthology.orchestra.run.smithi155.stdout: "time": "2023-08-01T19:55:05.154994+0000", 2023-08-01T19:55:18.151 INFO:teuthology.orchestra.run.smithi155.stdout: "duration": 0.0049277050000000001 2023-08-01T19:55:18.151 INFO:teuthology.orchestra.run.smithi155.stdout: }, 2023-08-01T19:55:18.151 INFO:teuthology.orchestra.run.smithi155.stdout: { 2023-08-01T19:55:18.151 INFO:teuthology.orchestra.run.smithi155.stdout: "event": "sub_op_commit_rec", 2023-08-01T19:55:18.151 INFO:teuthology.orchestra.run.smithi155.stdout: "time": "2023-08-01T19:55:05.218933+0000", 2023-08-01T19:55:18.151 INFO:teuthology.orchestra.run.smithi155.stdout: "duration": 0.063939916999999999 2023-08-01T19:55:18.152 INFO:teuthology.orchestra.run.smithi155.stdout: }, 2023-08-01T19:55:18.152 INFO:teuthology.orchestra.run.smithi155.stdout: { 2023-08-01T19:55:18.152 INFO:teuthology.orchestra.run.smithi155.stdout: "event": "commit_sent", 2023-08-01T19:55:18.152 INFO:teuthology.orchestra.run.smithi155.stdout: "time": "2023-08-01T19:55:05.218989+0000", 2023-08-01T19:55:18.152 INFO:teuthology.orchestra.run.smithi155.stdout: "duration": 5.5772000000000001e-05 2023-08-01T19:55:18.152 INFO:teuthology.orchestra.run.smithi155.stdout: }, 2023-08-01T19:55:18.152 INFO:teuthology.orchestra.run.smithi155.stdout: { 2023-08-01T19:55:18.152 INFO:teuthology.orchestra.run.smithi155.stdout: "event": "done", 2023-08-01T19:55:18.153 INFO:teuthology.orchestra.run.smithi155.stdout: "time": "2023-08-01T19:55:05.219036+0000", 2023-08-01T19:55:18.153 INFO:teuthology.orchestra.run.smithi155.stdout: "duration": 4.6526000000000001e-05 2023-08-01T19:55:18.153 INFO:teuthology.orchestra.run.smithi155.stdout: } 2023-08-01T19:55:18.153 INFO:teuthology.orchestra.run.smithi155.stdout: ] 2023-08-01T19:55:18.153 INFO:teuthology.orchestra.run.smithi155.stdout: } 2023-08-01T19:55:18.153 INFO:teuthology.orchestra.run.smithi155.stdout: }, 2023-08-01T19:55:18.153 INFO:teuthology.orchestra.run.smithi155.stdout: { 2023-08-01T19:55:18.154 INFO:teuthology.orchestra.run.smithi155.stdout: "description": "osd_op(client.4668.0:100242 5.8 5:16a314b8:::benchmark_data_smithi006_114134_object100241:head [set-alloc-hint object_size 65536 write_size 65536,write 0~65536] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e37)", 2023-08-01T19:55:18.154 INFO:teuthology.orchestra.run.smithi155.stdout: "initiated_at": "2023-08-01T19:55:05.150616+0000", 2023-08-01T19:55:18.154 INFO:teuthology.orchestra.run.smithi155.stdout: "age": 12.956960644, 2023-08-01T19:55:18.154 INFO:teuthology.orchestra.run.smithi155.stdout: "duration": 0.071105065999999995, 2023-08-01T19:55:18.154 INFO:teuthology.orchestra.run.smithi155.stdout: "type_data": { 2023-08-01T19:55:18.154 INFO:teuthology.orchestra.run.smithi155.stdout: "flag_point": "commit sent; apply or cleanup", 2023-08-01T19:55:18.154 INFO:teuthology.orchestra.run.smithi155.stdout: "client_info": { 2023-08-01T19:55:18.154 INFO:teuthology.orchestra.run.smithi155.stdout: "client": "client.4668", 2023-08-01T19:55:18.155 INFO:teuthology.orchestra.run.smithi155.stdout: "client_addr": "172.21.15.6:0/1709472247", 2023-08-01T19:55:18.155 INFO:teuthology.orchestra.run.smithi155.stdout: "tid": 100242 2023-08-01T19:55:18.155 INFO:teuthology.orchestra.run.smithi155.stdout: }, 2023-08-01T19:55:18.155 INFO:teuthology.orchestra.run.smithi155.stdout: "events": [ 2023-08-01T19:55:18.155 INFO:teuthology.orchestra.run.smithi155.stdout: { 2023-08-01T19:55:18.155 INFO:teuthology.orchestra.run.smithi155.stdout: "event": "initiated", 2023-08-01T19:55:18.155 INFO:teuthology.orchestra.run.smithi155.stdout: "time": "2023-08-01T19:55:05.150616+0000", 2023-08-01T19:55:18.156 INFO:teuthology.orchestra.run.smithi155.stdout: "duration": 0 2023-08-01T19:55:18.156 INFO:teuthology.orchestra.run.smithi155.stdout: }, 2023-08-01T19:55:18.156 INFO:teuthology.orchestra.run.smithi155.stdout: { 2023-08-01T19:55:18.156 INFO:teuthology.orchestra.run.smithi155.stdout: "event": "throttled", 2023-08-01T19:55:18.156 INFO:teuthology.orchestra.run.smithi155.stdout: "time": "2023-08-01T19:55:05.150616+0000", 2023-08-01T19:55:18.156 INFO:teuthology.orchestra.run.smithi155.stdout: "duration": 0 2023-08-01T19:55:18.156 INFO:teuthology.orchestra.run.smithi155.stdout: }, 2023-08-01T19:55:18.156 INFO:teuthology.orchestra.run.smithi155.stdout: { 2023-08-01T19:55:18.157 INFO:teuthology.orchestra.run.smithi155.stdout: "event": "header_read", 2023-08-01T19:55:18.157 INFO:teuthology.orchestra.run.smithi155.stdout: "time": "2023-08-01T19:55:05.150615+0000", 2023-08-01T19:55:18.157 INFO:teuthology.orchestra.run.smithi155.stdout: "duration": 4294967295.999999 2023-08-01T19:55:18.157 INFO:teuthology.orchestra.run.smithi155.stdout: }, 2023-08-01T19:55:18.157 INFO:teuthology.orchestra.run.smithi155.stdout: { 2023-08-01T19:55:18.157 INFO:teuthology.orchestra.run.smithi155.stdout: "event": "all_read", 2023-08-01T19:55:18.157 INFO:teuthology.orchestra.run.smithi155.stdout: "time": "2023-08-01T19:55:05.150696+0000", 2023-08-01T19:55:18.157 INFO:teuthology.orchestra.run.smithi155.stdout: "duration": 8.0852000000000004e-05 2023-08-01T19:55:18.158 INFO:teuthology.orchestra.run.smithi155.stdout: }, 2023-08-01T19:55:18.158 INFO:teuthology.orchestra.run.smithi155.stdout: { 2023-08-01T19:55:18.158 INFO:teuthology.orchestra.run.smithi155.stdout: "event": "dispatched", 2023-08-01T19:55:18.158 INFO:teuthology.orchestra.run.smithi155.stdout: "time": "2023-08-01T19:55:05.150708+0000", 2023-08-01T19:55:18.158 INFO:teuthology.orchestra.run.smithi155.stdout: "duration": 1.2116999999999999e-05 2023-08-01T19:55:18.158 INFO:teuthology.orchestra.run.smithi155.stdout: }, 2023-08-01T19:55:18.158 INFO:teuthology.orchestra.run.smithi155.stdout: { 2023-08-01T19:55:18.158 INFO:teuthology.orchestra.run.smithi155.stdout: "event": "queued_for_pg", 2023-08-01T19:55:18.159 INFO:teuthology.orchestra.run.smithi155.stdout: "time": "2023-08-01T19:55:05.150713+0000", 2023-08-01T19:55:18.159 INFO:teuthology.orchestra.run.smithi155.stdout: "duration": 5.4620000000000004e-06 2023-08-01T19:55:18.159 INFO:teuthology.orchestra.run.smithi155.stdout: }, 2023-08-01T19:55:18.159 INFO:teuthology.orchestra.run.smithi155.stdout: { 2023-08-01T19:55:18.159 INFO:teuthology.orchestra.run.smithi155.stdout: "event": "reached_pg", 2023-08-01T19:55:18.159 INFO:teuthology.orchestra.run.smithi155.stdout: "time": "2023-08-01T19:55:05.150761+0000", 2023-08-01T19:55:18.159 INFO:teuthology.orchestra.run.smithi155.stdout: "duration": 4.7429000000000003e-05 2023-08-01T19:55:18.159 INFO:teuthology.orchestra.run.smithi155.stdout: }, 2023-08-01T19:55:18.160 INFO:teuthology.orchestra.run.smithi155.stdout: { 2023-08-01T19:55:18.160 INFO:teuthology.orchestra.run.smithi155.stdout: "event": "started", 2023-08-01T19:55:18.160 INFO:teuthology.orchestra.run.smithi155.stdout: "time": "2023-08-01T19:55:05.150856+0000", 2023-08-01T19:55:18.160 INFO:teuthology.orchestra.run.smithi155.stdout: "duration": 9.5356e-05 2023-08-01T19:55:18.160 INFO:teuthology.orchestra.run.smithi155.stdout: }, 2023-08-01T19:55:18.160 INFO:teuthology.orchestra.run.smithi155.stdout: { 2023-08-01T19:55:18.160 INFO:teuthology.orchestra.run.smithi155.stdout: "event": "waiting for subops from 0", 2023-08-01T19:55:18.161 INFO:teuthology.orchestra.run.smithi155.stdout: "time": "2023-08-01T19:55:05.150999+0000", 2023-08-01T19:55:18.161 INFO:teuthology.orchestra.run.smithi155.stdout: "duration": 0.00014234499999999999 2023-08-01T19:55:18.161 INFO:teuthology.orchestra.run.smithi155.stdout: }, 2023-08-01T19:55:18.161 INFO:teuthology.orchestra.run.smithi155.stdout: { 2023-08-01T19:55:18.161 INFO:teuthology.orchestra.run.smithi155.stdout: "event": "sub_op_commit_rec", 2023-08-01T19:55:18.161 INFO:teuthology.orchestra.run.smithi155.stdout: "time": "2023-08-01T19:55:05.219001+0000", 2023-08-01T19:55:18.161 INFO:teuthology.orchestra.run.smithi155.stdout: "duration": 0.068002776000000001 2023-08-01T19:55:18.161 INFO:teuthology.orchestra.run.smithi155.stdout: }, 2023-08-01T19:55:18.162 INFO:teuthology.orchestra.run.smithi155.stdout: { 2023-08-01T19:55:18.162 INFO:teuthology.orchestra.run.smithi155.stdout: "event": "op_commit", 2023-08-01T19:55:18.162 INFO:teuthology.orchestra.run.smithi155.stdout: "time": "2023-08-01T19:55:05.221635+0000", 2023-08-01T19:55:18.162 INFO:teuthology.orchestra.run.smithi155.stdout: "duration": 0.0026340579999999999 2023-08-01T19:55:18.162 INFO:teuthology.orchestra.run.smithi155.stdout: }, 2023-08-01T19:55:18.162 INFO:teuthology.orchestra.run.smithi155.stdout: { 2023-08-01T19:55:18.162 INFO:teuthology.orchestra.run.smithi155.stdout: "event": "commit_sent", 2023-08-01T19:55:18.162 INFO:teuthology.orchestra.run.smithi155.stdout: "time": "2023-08-01T19:55:05.221682+0000", 2023-08-01T19:55:18.163 INFO:teuthology.orchestra.run.smithi155.stdout: "duration": 4.7123999999999998e-05 2023-08-01T19:55:18.163 INFO:teuthology.orchestra.run.smithi155.stdout: }, 2023-08-01T19:55:18.163 INFO:teuthology.orchestra.run.smithi155.stdout: { 2023-08-01T19:55:18.163 INFO:teuthology.orchestra.run.smithi155.stdout: "event": "done", 2023-08-01T19:55:18.163 INFO:teuthology.orchestra.run.smithi155.stdout: "time": "2023-08-01T19:55:05.221721+0000", 2023-08-01T19:55:18.163 INFO:teuthology.orchestra.run.smithi155.stdout: "duration": 3.8529999999999999e-05 2023-08-01T19:55:18.163 INFO:teuthology.orchestra.run.smithi155.stdout: } 2023-08-01T19:55:18.163 INFO:teuthology.orchestra.run.smithi155.stdout: ] 2023-08-01T19:55:18.164 INFO:teuthology.orchestra.run.smithi155.stdout: } 2023-08-01T19:55:18.164 INFO:teuthology.orchestra.run.smithi155.stdout: }, 2023-08-01T19:55:18.164 INFO:teuthology.orchestra.run.smithi155.stdout: { 2023-08-01T19:55:18.164 INFO:teuthology.orchestra.run.smithi155.stdout: "description": "osd_repop(client.4668.0:100240 5.a e37/19 5:5313c5b9:::benchmark_data_smithi006_114134_object100239:head v 37'6227, mlcod=37'6225)", 2023-08-01T19:55:18.164 INFO:teuthology.orchestra.run.smithi155.stdout: "initiated_at": "2023-08-01T19:55:05.150778+0000", 2023-08-01T19:55:18.164 INFO:teuthology.orchestra.run.smithi155.stdout: "age": 12.956798443, 2023-08-01T19:55:18.164 INFO:teuthology.orchestra.run.smithi155.stdout: "duration": 0.073362533999999993, 2023-08-01T19:55:18.165 INFO:teuthology.orchestra.run.smithi155.stdout: "type_data": { 2023-08-01T19:55:18.165 INFO:teuthology.orchestra.run.smithi155.stdout: "flag_point": "commit sent; apply or cleanup", 2023-08-01T19:55:18.165 INFO:teuthology.orchestra.run.smithi155.stdout: "events": [ 2023-08-01T19:55:18.165 INFO:teuthology.orchestra.run.smithi155.stdout: { 2023-08-01T19:55:18.165 INFO:teuthology.orchestra.run.smithi155.stdout: "event": "initiated", 2023-08-01T19:55:18.165 INFO:teuthology.orchestra.run.smithi155.stdout: "time": "2023-08-01T19:55:05.150778+0000", 2023-08-01T19:55:18.165 INFO:teuthology.orchestra.run.smithi155.stdout: "duration": 0 2023-08-01T19:55:18.165 INFO:teuthology.orchestra.run.smithi155.stdout: }, 2023-08-01T19:55:18.166 INFO:teuthology.orchestra.run.smithi155.stdout: { 2023-08-01T19:55:18.166 INFO:teuthology.orchestra.run.smithi155.stdout: "event": "throttled", 2023-08-01T19:55:18.166 INFO:teuthology.orchestra.run.smithi155.stdout: "time": "2023-08-01T19:55:05.150778+0000", 2023-08-01T19:55:18.166 INFO:teuthology.orchestra.run.smithi155.stdout: "duration": 0 2023-08-01T19:55:18.166 INFO:teuthology.orchestra.run.smithi155.stdout: }, 2023-08-01T19:55:18.166 INFO:teuthology.orchestra.run.smithi155.stdout: { 2023-08-01T19:55:18.166 INFO:teuthology.orchestra.run.smithi155.stdout: "event": "header_read", 2023-08-01T19:55:18.166 INFO:teuthology.orchestra.run.smithi155.stdout: "time": "2023-08-01T19:55:05.150778+0000", 2023-08-01T19:55:18.167 INFO:teuthology.orchestra.run.smithi155.stdout: "duration": 4294967295.9999995 2023-08-01T19:55:18.167 INFO:teuthology.orchestra.run.smithi155.stdout: }, 2023-08-01T19:55:18.167 INFO:teuthology.orchestra.run.smithi155.stdout: { 2023-08-01T19:55:18.167 INFO:teuthology.orchestra.run.smithi155.stdout: "event": "all_read", 2023-08-01T19:55:18.167 INFO:teuthology.orchestra.run.smithi155.stdout: "time": "2023-08-01T19:55:05.150811+0000", 2023-08-01T19:55:18.167 INFO:teuthology.orchestra.run.smithi155.stdout: "duration": 3.3664000000000002e-05 2023-08-01T19:55:18.167 INFO:teuthology.orchestra.run.smithi155.stdout: }, 2023-08-01T19:55:18.167 INFO:teuthology.orchestra.run.smithi155.stdout: { 2023-08-01T19:55:18.168 INFO:teuthology.orchestra.run.smithi155.stdout: "event": "dispatched", 2023-08-01T19:55:18.168 INFO:teuthology.orchestra.run.smithi155.stdout: "time": "2023-08-01T19:55:05.150818+0000", 2023-08-01T19:55:18.168 INFO:teuthology.orchestra.run.smithi155.stdout: "duration": 6.5769999999999999e-06 2023-08-01T19:55:18.168 INFO:teuthology.orchestra.run.smithi155.stdout: }, 2023-08-01T19:55:18.168 INFO:teuthology.orchestra.run.smithi155.stdout: { 2023-08-01T19:55:18.168 INFO:teuthology.orchestra.run.smithi155.stdout: "event": "queued_for_pg", 2023-08-01T19:55:18.168 INFO:teuthology.orchestra.run.smithi155.stdout: "time": "2023-08-01T19:55:05.150822+0000", 2023-08-01T19:55:18.168 INFO:teuthology.orchestra.run.smithi155.stdout: "duration": 4.0060000000000003e-06 2023-08-01T19:55:18.169 INFO:teuthology.orchestra.run.smithi155.stdout: }, 2023-08-01T19:55:18.169 INFO:teuthology.orchestra.run.smithi155.stdout: { 2023-08-01T19:55:18.169 INFO:teuthology.orchestra.run.smithi155.stdout: "event": "reached_pg", 2023-08-01T19:55:18.169 INFO:teuthology.orchestra.run.smithi155.stdout: "time": "2023-08-01T19:55:05.150855+0000", 2023-08-01T19:55:18.169 INFO:teuthology.orchestra.run.smithi155.stdout: "duration": 3.3204999999999998e-05 2023-08-01T19:55:18.169 INFO:teuthology.orchestra.run.smithi155.stdout: }, 2023-08-01T19:55:18.169 INFO:teuthology.orchestra.run.smithi155.stdout: { 2023-08-01T19:55:18.169 INFO:teuthology.orchestra.run.smithi155.stdout: "event": "started", 2023-08-01T19:55:18.170 INFO:teuthology.orchestra.run.smithi155.stdout: "time": "2023-08-01T19:55:05.150873+0000", 2023-08-01T19:55:18.170 INFO:teuthology.orchestra.run.smithi155.stdout: "duration": 1.8139999999999999e-05 2023-08-01T19:55:18.170 INFO:teuthology.orchestra.run.smithi155.stdout: }, 2023-08-01T19:55:18.170 INFO:teuthology.orchestra.run.smithi155.stdout: { 2023-08-01T19:55:18.170 INFO:teuthology.orchestra.run.smithi155.stdout: "event": "commit_sent", 2023-08-01T19:55:18.170 INFO:teuthology.orchestra.run.smithi155.stdout: "time": "2023-08-01T19:55:05.224095+0000", 2023-08-01T19:55:18.170 INFO:teuthology.orchestra.run.smithi155.stdout: "duration": 0.073221895999999995 2023-08-01T19:55:18.171 INFO:teuthology.orchestra.run.smithi155.stdout: }, 2023-08-01T19:55:18.171 INFO:teuthology.orchestra.run.smithi155.stdout: { 2023-08-01T19:55:18.171 INFO:teuthology.orchestra.run.smithi155.stdout: "event": "done", 2023-08-01T19:55:18.171 INFO:teuthology.orchestra.run.smithi155.stdout: "time": "2023-08-01T19:55:05.224141+0000", 2023-08-01T19:55:18.171 INFO:teuthology.orchestra.run.smithi155.stdout: "duration": 4.5385e-05 2023-08-01T19:55:18.171 INFO:teuthology.orchestra.run.smithi155.stdout: } 2023-08-01T19:55:18.171 INFO:teuthology.orchestra.run.smithi155.stdout: ] 2023-08-01T19:55:18.171 INFO:teuthology.orchestra.run.smithi155.stdout: } 2023-08-01T19:55:18.172 INFO:teuthology.orchestra.run.smithi155.stdout: }, 2023-08-01T19:55:18.172 INFO:teuthology.orchestra.run.smithi155.stdout: { 2023-08-01T19:55:18.172 INFO:teuthology.orchestra.run.smithi155.stdout: "description": "osd_op(client.4668.0:100245 5.e 5:71869c66:::benchmark_data_smithi006_114134_object100244:head [set-alloc-hint object_size 65536 write_size 65536,write 0~65536] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e37)", 2023-08-01T19:55:18.172 INFO:teuthology.orchestra.run.smithi155.stdout: "initiated_at": "2023-08-01T19:55:05.150991+0000", 2023-08-01T19:55:18.172 INFO:teuthology.orchestra.run.smithi155.stdout: "age": 12.956585656, 2023-08-01T19:55:18.172 INFO:teuthology.orchestra.run.smithi155.stdout: "duration": 0.070734490999999997, 2023-08-01T19:55:18.172 INFO:teuthology.orchestra.run.smithi155.stdout: "type_data": { 2023-08-01T19:55:18.172 INFO:teuthology.orchestra.run.smithi155.stdout: "flag_point": "commit sent; apply or cleanup", 2023-08-01T19:55:18.173 INFO:teuthology.orchestra.run.smithi155.stdout: "client_info": { 2023-08-01T19:55:18.173 INFO:teuthology.orchestra.run.smithi155.stdout: "client": "client.4668", 2023-08-01T19:55:18.173 INFO:teuthology.orchestra.run.smithi155.stdout: "client_addr": "172.21.15.6:0/1709472247", 2023-08-01T19:55:18.173 INFO:teuthology.orchestra.run.smithi155.stdout: "tid": 100245 2023-08-01T19:55:18.173 INFO:teuthology.orchestra.run.smithi155.stdout: }, 2023-08-01T19:55:18.173 INFO:teuthology.orchestra.run.smithi155.stdout: "events": [ 2023-08-01T19:55:18.173 INFO:teuthology.orchestra.run.smithi155.stdout: { 2023-08-01T19:55:18.173 INFO:teuthology.orchestra.run.smithi155.stdout: "event": "initiated", 2023-08-01T19:55:18.174 INFO:teuthology.orchestra.run.smithi155.stdout: "time": "2023-08-01T19:55:05.150991+0000", 2023-08-01T19:55:18.174 INFO:teuthology.orchestra.run.smithi155.stdout: "duration": 0 2023-08-01T19:55:18.174 INFO:teuthology.orchestra.run.smithi155.stdout: }, 2023-08-01T19:55:18.174 INFO:teuthology.orchestra.run.smithi155.stdout: { 2023-08-01T19:55:18.174 INFO:teuthology.orchestra.run.smithi155.stdout: "event": "throttled", 2023-08-01T19:55:18.174 INFO:teuthology.orchestra.run.smithi155.stdout: "time": "2023-08-01T19:55:05.150991+0000", 2023-08-01T19:55:18.174 INFO:teuthology.orchestra.run.smithi155.stdout: "duration": 0 2023-08-01T19:55:18.174 INFO:teuthology.orchestra.run.smithi155.stdout: }, 2023-08-01T19:55:18.175 INFO:teuthology.orchestra.run.smithi155.stdout: { 2023-08-01T19:55:18.175 INFO:teuthology.orchestra.run.smithi155.stdout: "event": "header_read", 2023-08-01T19:55:18.175 INFO:teuthology.orchestra.run.smithi155.stdout: "time": "2023-08-01T19:55:05.150990+0000", 2023-08-01T19:55:18.175 INFO:teuthology.orchestra.run.smithi155.stdout: "duration": 4294967295.999999 2023-08-01T19:55:18.175 INFO:teuthology.orchestra.run.smithi155.stdout: }, 2023-08-01T19:55:18.175 INFO:teuthology.orchestra.run.smithi155.stdout: { 2023-08-01T19:55:18.175 INFO:teuthology.orchestra.run.smithi155.stdout: "event": "all_read", 2023-08-01T19:55:18.175 INFO:teuthology.orchestra.run.smithi155.stdout: "time": "2023-08-01T19:55:05.151108+0000", 2023-08-01T19:55:18.176 INFO:teuthology.orchestra.run.smithi155.stdout: "duration": 0.00011849300000000001 2023-08-01T19:55:18.176 INFO:teuthology.orchestra.run.smithi155.stdout: }, 2023-08-01T19:55:18.176 INFO:teuthology.orchestra.run.smithi155.stdout: { 2023-08-01T19:55:18.176 INFO:teuthology.orchestra.run.smithi155.stdout: "event": "dispatched", 2023-08-01T19:55:18.176 INFO:teuthology.orchestra.run.smithi155.stdout: "time": "2023-08-01T19:55:05.151117+0000", 2023-08-01T19:55:18.176 INFO:teuthology.orchestra.run.smithi155.stdout: "duration": 8.1040000000000007e-06 2023-08-01T19:55:18.176 INFO:teuthology.orchestra.run.smithi155.stdout: }, 2023-08-01T19:55:18.176 INFO:teuthology.orchestra.run.smithi155.stdout: { 2023-08-01T19:55:18.177 INFO:teuthology.orchestra.run.smithi155.stdout: "event": "queued_for_pg", 2023-08-01T19:55:18.177 INFO:teuthology.orchestra.run.smithi155.stdout: "time": "2023-08-01T19:55:05.151121+0000", 2023-08-01T19:55:18.177 INFO:teuthology.orchestra.run.smithi155.stdout: "duration": 4.2019999999999997e-06 2023-08-01T19:55:18.177 INFO:teuthology.orchestra.run.smithi155.stdout: }, 2023-08-01T19:55:18.177 INFO:teuthology.orchestra.run.smithi155.stdout: { 2023-08-01T19:55:18.177 INFO:teuthology.orchestra.run.smithi155.stdout: "event": "reached_pg", 2023-08-01T19:55:18.177 INFO:teuthology.orchestra.run.smithi155.stdout: "time": "2023-08-01T19:55:05.151162+0000", 2023-08-01T19:55:18.178 INFO:teuthology.orchestra.run.smithi155.stdout: "duration": 4.1448e-05 2023-08-01T19:55:18.178 INFO:teuthology.orchestra.run.smithi155.stdout: }, 2023-08-01T19:55:18.178 INFO:teuthology.orchestra.run.smithi155.stdout: { 2023-08-01T19:55:18.178 INFO:teuthology.orchestra.run.smithi155.stdout: "event": "started", 2023-08-01T19:55:18.178 INFO:teuthology.orchestra.run.smithi155.stdout: "time": "2023-08-01T19:55:05.151281+0000", 2023-08-01T19:55:18.178 INFO:teuthology.orchestra.run.smithi155.stdout: "duration": 0.000119141 2023-08-01T19:55:18.178 INFO:teuthology.orchestra.run.smithi155.stdout: }, 2023-08-01T19:55:18.178 INFO:teuthology.orchestra.run.smithi155.stdout: { 2023-08-01T19:55:18.179 INFO:teuthology.orchestra.run.smithi155.stdout: "event": "waiting for subops from 0", 2023-08-01T19:55:18.179 INFO:teuthology.orchestra.run.smithi155.stdout: "time": "2023-08-01T19:55:05.151443+0000", 2023-08-01T19:55:18.179 INFO:teuthology.orchestra.run.smithi155.stdout: "duration": 0.00016181600000000001 2023-08-01T19:55:18.179 INFO:teuthology.orchestra.run.smithi155.stdout: }, 2023-08-01T19:55:18.179 INFO:teuthology.orchestra.run.smithi155.stdout: { 2023-08-01T19:55:18.179 INFO:teuthology.orchestra.run.smithi155.stdout: "event": "sub_op_commit_rec", 2023-08-01T19:55:18.179 INFO:teuthology.orchestra.run.smithi155.stdout: "time": "2023-08-01T19:55:05.219101+0000", 2023-08-01T19:55:18.179 INFO:teuthology.orchestra.run.smithi155.stdout: "duration": 0.067658037000000004 2023-08-01T19:55:18.180 INFO:teuthology.orchestra.run.smithi155.stdout: }, 2023-08-01T19:55:18.180 INFO:teuthology.orchestra.run.smithi155.stdout: { 2023-08-01T19:55:18.180 INFO:teuthology.orchestra.run.smithi155.stdout: "event": "op_commit", 2023-08-01T19:55:18.180 INFO:teuthology.orchestra.run.smithi155.stdout: "time": "2023-08-01T19:55:05.221646+0000", 2023-08-01T19:55:18.180 INFO:teuthology.orchestra.run.smithi155.stdout: "duration": 0.0025450540000000002 2023-08-01T19:55:18.180 INFO:teuthology.orchestra.run.smithi155.stdout: }, 2023-08-01T19:55:18.180 INFO:teuthology.orchestra.run.smithi155.stdout: { 2023-08-01T19:55:18.180 INFO:teuthology.orchestra.run.smithi155.stdout: "event": "commit_sent", 2023-08-01T19:55:18.181 INFO:teuthology.orchestra.run.smithi155.stdout: "time": "2023-08-01T19:55:05.221689+0000", 2023-08-01T19:55:18.181 INFO:teuthology.orchestra.run.smithi155.stdout: "duration": 4.3078999999999999e-05 2023-08-01T19:55:18.181 INFO:teuthology.orchestra.run.smithi155.stdout: }, 2023-08-01T19:55:18.181 INFO:teuthology.orchestra.run.smithi155.stdout: { 2023-08-01T19:55:18.181 INFO:teuthology.orchestra.run.smithi155.stdout: "event": "done", 2023-08-01T19:55:18.181 INFO:teuthology.orchestra.run.smithi155.stdout: "time": "2023-08-01T19:55:05.221725+0000", 2023-08-01T19:55:18.181 INFO:teuthology.orchestra.run.smithi155.stdout: "duration": 3.6137999999999999e-05 2023-08-01T19:55:18.181 INFO:teuthology.orchestra.run.smithi155.stdout: } 2023-08-01T19:55:18.182 INFO:teuthology.orchestra.run.smithi155.stdout: ] 2023-08-01T19:55:18.182 INFO:teuthology.orchestra.run.smithi155.stdout: } 2023-08-01T19:55:18.182 INFO:teuthology.orchestra.run.smithi155.stdout: }, 2023-08-01T19:55:18.182 INFO:teuthology.orchestra.run.smithi155.stdout: { 2023-08-01T19:55:18.182 INFO:teuthology.orchestra.run.smithi155.stdout: "description": "osd_repop(client.4668.0:100243 5.a e37/19 5:5e8193b6:::benchmark_data_smithi006_114134_object100242:head v 37'6228, mlcod=37'6225)", 2023-08-01T19:55:18.182 INFO:teuthology.orchestra.run.smithi155.stdout: "initiated_at": "2023-08-01T19:55:05.151148+0000", 2023-08-01T19:55:18.182 INFO:teuthology.orchestra.run.smithi155.stdout: "age": 12.956428645000001, 2023-08-01T19:55:18.182 INFO:teuthology.orchestra.run.smithi155.stdout: "duration": 0.073020370000000001, 2023-08-01T19:55:18.183 INFO:teuthology.orchestra.run.smithi155.stdout: "type_data": { 2023-08-01T19:55:18.183 INFO:teuthology.orchestra.run.smithi155.stdout: "flag_point": "commit sent; apply or cleanup", 2023-08-01T19:55:18.183 INFO:teuthology.orchestra.run.smithi155.stdout: "events": [ 2023-08-01T19:55:18.183 INFO:teuthology.orchestra.run.smithi155.stdout: { 2023-08-01T19:55:18.183 INFO:teuthology.orchestra.run.smithi155.stdout: "event": "initiated", 2023-08-01T19:55:18.183 INFO:teuthology.orchestra.run.smithi155.stdout: "time": "2023-08-01T19:55:05.151148+0000", 2023-08-01T19:55:18.183 INFO:teuthology.orchestra.run.smithi155.stdout: "duration": 0 2023-08-01T19:55:18.183 INFO:teuthology.orchestra.run.smithi155.stdout: }, 2023-08-01T19:55:18.184 INFO:teuthology.orchestra.run.smithi155.stdout: { 2023-08-01T19:55:18.184 INFO:teuthology.orchestra.run.smithi155.stdout: "event": "throttled", 2023-08-01T19:55:18.184 INFO:teuthology.orchestra.run.smithi155.stdout: "time": "2023-08-01T19:55:05.151148+0000", 2023-08-01T19:55:18.184 INFO:teuthology.orchestra.run.smithi155.stdout: "duration": 0 2023-08-01T19:55:18.184 INFO:teuthology.orchestra.run.smithi155.stdout: }, 2023-08-01T19:55:18.184 INFO:teuthology.orchestra.run.smithi155.stdout: { 2023-08-01T19:55:18.184 INFO:teuthology.orchestra.run.smithi155.stdout: "event": "header_read", 2023-08-01T19:55:18.185 INFO:teuthology.orchestra.run.smithi155.stdout: "time": "2023-08-01T19:55:05.151147+0000", 2023-08-01T19:55:18.185 INFO:teuthology.orchestra.run.smithi155.stdout: "duration": 4294967295.9999995 2023-08-01T19:55:18.185 INFO:teuthology.orchestra.run.smithi155.stdout: }, 2023-08-01T19:55:18.185 INFO:teuthology.orchestra.run.smithi155.stdout: { 2023-08-01T19:55:18.185 INFO:teuthology.orchestra.run.smithi155.stdout: "event": "all_read", 2023-08-01T19:55:18.185 INFO:teuthology.orchestra.run.smithi155.stdout: "time": "2023-08-01T19:55:05.151231+0000", 2023-08-01T19:55:18.185 INFO:teuthology.orchestra.run.smithi155.stdout: "duration": 8.3135999999999998e-05 2023-08-01T19:55:18.185 INFO:teuthology.orchestra.run.smithi155.stdout: }, 2023-08-01T19:55:18.186 INFO:teuthology.orchestra.run.smithi155.stdout: { 2023-08-01T19:55:18.186 INFO:teuthology.orchestra.run.smithi155.stdout: "event": "dispatched", 2023-08-01T19:55:18.186 INFO:teuthology.orchestra.run.smithi155.stdout: "time": "2023-08-01T19:55:05.151239+0000", 2023-08-01T19:55:18.186 INFO:teuthology.orchestra.run.smithi155.stdout: "duration": 8.7469999999999994e-06 2023-08-01T19:55:18.186 INFO:teuthology.orchestra.run.smithi155.stdout: }, 2023-08-01T19:55:18.186 INFO:teuthology.orchestra.run.smithi155.stdout: { 2023-08-01T19:55:18.186 INFO:teuthology.orchestra.run.smithi155.stdout: "event": "queued_for_pg", 2023-08-01T19:55:18.186 INFO:teuthology.orchestra.run.smithi155.stdout: "time": "2023-08-01T19:55:05.151244+0000", 2023-08-01T19:55:18.187 INFO:teuthology.orchestra.run.smithi155.stdout: "duration": 4.4800000000000003e-06 2023-08-01T19:55:18.187 INFO:teuthology.orchestra.run.smithi155.stdout: }, 2023-08-01T19:55:18.187 INFO:teuthology.orchestra.run.smithi155.stdout: { 2023-08-01T19:55:18.187 INFO:teuthology.orchestra.run.smithi155.stdout: "event": "reached_pg", 2023-08-01T19:55:18.187 INFO:teuthology.orchestra.run.smithi155.stdout: "time": "2023-08-01T19:55:05.152938+0000", 2023-08-01T19:55:18.187 INFO:teuthology.orchestra.run.smithi155.stdout: "duration": 0.001693824 2023-08-01T19:55:18.187 INFO:teuthology.orchestra.run.smithi155.stdout: }, 2023-08-01T19:55:18.187 INFO:teuthology.orchestra.run.smithi155.stdout: { 2023-08-01T19:55:18.188 INFO:teuthology.orchestra.run.smithi155.stdout: "event": "started", 2023-08-01T19:55:18.188 INFO:teuthology.orchestra.run.smithi155.stdout: "time": "2023-08-01T19:55:05.152956+0000", 2023-08-01T19:55:18.188 INFO:teuthology.orchestra.run.smithi155.stdout: "duration": 1.8287e-05 2023-08-01T19:55:18.188 INFO:teuthology.orchestra.run.smithi155.stdout: }, 2023-08-01T19:55:18.188 INFO:teuthology.orchestra.run.smithi155.stdout: { 2023-08-01T19:55:18.188 INFO:teuthology.orchestra.run.smithi155.stdout: "event": "commit_sent", 2023-08-01T19:55:18.188 INFO:teuthology.orchestra.run.smithi155.stdout: "time": "2023-08-01T19:55:05.224145+0000", 2023-08-01T19:55:18.189 INFO:teuthology.orchestra.run.smithi155.stdout: "duration": 0.071189447000000003 2023-08-01T19:55:18.189 INFO:teuthology.orchestra.run.smithi155.stdout: }, 2023-08-01T19:55:18.189 INFO:teuthology.orchestra.run.smithi155.stdout: { 2023-08-01T19:55:18.189 INFO:teuthology.orchestra.run.smithi155.stdout: "event": "done", 2023-08-01T19:55:18.189 INFO:teuthology.orchestra.run.smithi155.stdout: "time": "2023-08-01T19:55:05.224168+0000", 2023-08-01T19:55:18.189 INFO:teuthology.orchestra.run.smithi155.stdout: "duration": 2.3008999999999999e-05 2023-08-01T19:55:18.189 INFO:teuthology.orchestra.run.smithi155.stdout: } 2023-08-01T19:55:18.189 INFO:teuthology.orchestra.run.smithi155.stdout: ] 2023-08-01T19:55:18.190 INFO:teuthology.orchestra.run.smithi155.stdout: } 2023-08-01T19:55:18.190 INFO:teuthology.orchestra.run.smithi155.stdout: }, 2023-08-01T19:55:18.190 INFO:teuthology.orchestra.run.smithi155.stdout: { 2023-08-01T19:55:18.190 INFO:teuthology.orchestra.run.smithi155.stdout: "description": "osd_repop(client.4668.0:100244 5.9 e37/19 5:92f56a12:::benchmark_data_smithi006_114134_object100243:head v 37'6294, mlcod=37'6292)", 2023-08-01T19:55:18.190 INFO:teuthology.orchestra.run.smithi155.stdout: "initiated_at": "2023-08-01T19:55:05.151325+0000", 2023-08-01T19:55:18.190 INFO:teuthology.orchestra.run.smithi155.stdout: "age": 12.9562513, 2023-08-01T19:55:18.190 INFO:teuthology.orchestra.run.smithi155.stdout: "duration": 0.071883673999999995, 2023-08-01T19:55:18.190 INFO:teuthology.orchestra.run.smithi155.stdout: "type_data": { 2023-08-01T19:55:18.191 INFO:teuthology.orchestra.run.smithi155.stdout: "flag_point": "commit sent; apply or cleanup", 2023-08-01T19:55:18.191 INFO:teuthology.orchestra.run.smithi155.stdout: "events": [ 2023-08-01T19:55:18.191 INFO:teuthology.orchestra.run.smithi155.stdout: { 2023-08-01T19:55:18.191 INFO:teuthology.orchestra.run.smithi155.stdout: "event": "initiated", 2023-08-01T19:55:18.191 INFO:teuthology.orchestra.run.smithi155.stdout: "time": "2023-08-01T19:55:05.151325+0000", 2023-08-01T19:55:18.191 INFO:teuthology.orchestra.run.smithi155.stdout: "duration": 0 2023-08-01T19:55:18.191 INFO:teuthology.orchestra.run.smithi155.stdout: }, 2023-08-01T19:55:18.191 INFO:teuthology.orchestra.run.smithi155.stdout: { 2023-08-01T19:55:18.192 INFO:teuthology.orchestra.run.smithi155.stdout: "event": "throttled", 2023-08-01T19:55:18.192 INFO:teuthology.orchestra.run.smithi155.stdout: "time": "2023-08-01T19:55:05.151325+0000", 2023-08-01T19:55:18.192 INFO:teuthology.orchestra.run.smithi155.stdout: "duration": 0 2023-08-01T19:55:18.192 INFO:teuthology.orchestra.run.smithi155.stdout: }, 2023-08-01T19:55:18.192 INFO:teuthology.orchestra.run.smithi155.stdout: { 2023-08-01T19:55:18.192 INFO:teuthology.orchestra.run.smithi155.stdout: "event": "header_read", 2023-08-01T19:55:18.192 INFO:teuthology.orchestra.run.smithi155.stdout: "time": "2023-08-01T19:55:05.151325+0000", 2023-08-01T19:55:18.193 INFO:teuthology.orchestra.run.smithi155.stdout: "duration": 4294967295.9999995 2023-08-01T19:55:18.193 INFO:teuthology.orchestra.run.smithi155.stdout: }, 2023-08-01T19:55:18.193 INFO:teuthology.orchestra.run.smithi155.stdout: { 2023-08-01T19:55:18.193 INFO:teuthology.orchestra.run.smithi155.stdout: "event": "all_read", 2023-08-01T19:55:18.193 INFO:teuthology.orchestra.run.smithi155.stdout: "time": "2023-08-01T19:55:05.151390+0000", 2023-08-01T19:55:18.193 INFO:teuthology.orchestra.run.smithi155.stdout: "duration": 6.5456999999999993e-05 2023-08-01T19:55:18.193 INFO:teuthology.orchestra.run.smithi155.stdout: }, 2023-08-01T19:55:18.193 INFO:teuthology.orchestra.run.smithi155.stdout: { 2023-08-01T19:55:18.194 INFO:teuthology.orchestra.run.smithi155.stdout: "event": "dispatched", 2023-08-01T19:55:18.194 INFO:teuthology.orchestra.run.smithi155.stdout: "time": "2023-08-01T19:55:05.151396+0000", 2023-08-01T19:55:18.194 INFO:teuthology.orchestra.run.smithi155.stdout: "duration": 5.9190000000000004e-06 2023-08-01T19:55:18.194 INFO:teuthology.orchestra.run.smithi155.stdout: }, 2023-08-01T19:55:18.194 INFO:teuthology.orchestra.run.smithi155.stdout: { 2023-08-01T19:55:18.194 INFO:teuthology.orchestra.run.smithi155.stdout: "event": "queued_for_pg", 2023-08-01T19:55:18.194 INFO:teuthology.orchestra.run.smithi155.stdout: "time": "2023-08-01T19:55:05.151400+0000", 2023-08-01T19:55:18.195 INFO:teuthology.orchestra.run.smithi155.stdout: "duration": 4.1030000000000004e-06 2023-08-01T19:55:18.195 INFO:teuthology.orchestra.run.smithi155.stdout: }, 2023-08-01T19:55:18.195 INFO:teuthology.orchestra.run.smithi155.stdout: { 2023-08-01T19:55:18.195 INFO:teuthology.orchestra.run.smithi155.stdout: "event": "reached_pg", 2023-08-01T19:55:18.195 INFO:teuthology.orchestra.run.smithi155.stdout: "time": "2023-08-01T19:55:05.151452+0000", 2023-08-01T19:55:18.195 INFO:teuthology.orchestra.run.smithi155.stdout: "duration": 5.2136999999999999e-05 2023-08-01T19:55:18.195 INFO:teuthology.orchestra.run.smithi155.stdout: }, 2023-08-01T19:55:18.195 INFO:teuthology.orchestra.run.smithi155.stdout: { 2023-08-01T19:55:18.196 INFO:teuthology.orchestra.run.smithi155.stdout: "event": "started", 2023-08-01T19:55:18.196 INFO:teuthology.orchestra.run.smithi155.stdout: "time": "2023-08-01T19:55:05.151470+0000", 2023-08-01T19:55:18.196 INFO:teuthology.orchestra.run.smithi155.stdout: "duration": 1.8e-05 2023-08-01T19:55:18.196 INFO:teuthology.orchestra.run.smithi155.stdout: }, 2023-08-01T19:55:18.196 INFO:teuthology.orchestra.run.smithi155.stdout: { 2023-08-01T19:55:18.196 INFO:teuthology.orchestra.run.smithi155.stdout: "event": "commit_sent", 2023-08-01T19:55:18.196 INFO:teuthology.orchestra.run.smithi155.stdout: "time": "2023-08-01T19:55:05.223183+0000", 2023-08-01T19:55:18.196 INFO:teuthology.orchestra.run.smithi155.stdout: "duration": 0.071712622000000004 2023-08-01T19:55:18.197 INFO:teuthology.orchestra.run.smithi155.stdout: }, 2023-08-01T19:55:18.197 INFO:teuthology.orchestra.run.smithi155.stdout: { 2023-08-01T19:55:18.197 INFO:teuthology.orchestra.run.smithi155.stdout: "event": "done", 2023-08-01T19:55:18.197 INFO:teuthology.orchestra.run.smithi155.stdout: "time": "2023-08-01T19:55:05.223209+0000", 2023-08-01T19:55:18.197 INFO:teuthology.orchestra.run.smithi155.stdout: "duration": 2.5956e-05 2023-08-01T19:55:18.197 INFO:teuthology.orchestra.run.smithi155.stdout: } 2023-08-01T19:55:18.197 INFO:teuthology.orchestra.run.smithi155.stdout: ] 2023-08-01T19:55:18.197 INFO:teuthology.orchestra.run.smithi155.stdout: } 2023-08-01T19:55:18.198 INFO:teuthology.orchestra.run.smithi155.stdout: }, 2023-08-01T19:55:18.198 INFO:teuthology.orchestra.run.smithi155.stdout: { 2023-08-01T19:55:18.198 INFO:teuthology.orchestra.run.smithi155.stdout: "description": "osd_op(client.4668.0:100249 5.b 5:d0666827:::benchmark_data_smithi006_114134_object100248:head [set-alloc-hint object_size 65536 write_size 65536,write 0~65536] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e37)", 2023-08-01T19:55:18.198 INFO:teuthology.orchestra.run.smithi155.stdout: "initiated_at": "2023-08-01T19:55:05.153614+0000", 2023-08-01T19:55:18.198 INFO:teuthology.orchestra.run.smithi155.stdout: "age": 12.953962875, 2023-08-01T19:55:18.198 INFO:teuthology.orchestra.run.smithi155.stdout: "duration": 0.069286118999999993, 2023-08-01T19:55:18.198 INFO:teuthology.orchestra.run.smithi155.stdout: "type_data": { 2023-08-01T19:55:18.198 INFO:teuthology.orchestra.run.smithi155.stdout: "flag_point": "commit sent; apply or cleanup", 2023-08-01T19:55:18.199 INFO:teuthology.orchestra.run.smithi155.stdout: "client_info": { 2023-08-01T19:55:18.199 INFO:teuthology.orchestra.run.smithi155.stdout: "client": "client.4668", 2023-08-01T19:55:18.199 INFO:teuthology.orchestra.run.smithi155.stdout: "client_addr": "172.21.15.6:0/1709472247", 2023-08-01T19:55:18.199 INFO:teuthology.orchestra.run.smithi155.stdout: "tid": 100249 2023-08-01T19:55:18.199 INFO:teuthology.orchestra.run.smithi155.stdout: }, 2023-08-01T19:55:18.199 INFO:teuthology.orchestra.run.smithi155.stdout: "events": [ 2023-08-01T19:55:18.199 INFO:teuthology.orchestra.run.smithi155.stdout: { 2023-08-01T19:55:18.199 INFO:teuthology.orchestra.run.smithi155.stdout: "event": "initiated", 2023-08-01T19:55:18.200 INFO:teuthology.orchestra.run.smithi155.stdout: "time": "2023-08-01T19:55:05.153614+0000", 2023-08-01T19:55:18.200 INFO:teuthology.orchestra.run.smithi155.stdout: "duration": 0 2023-08-01T19:55:18.200 INFO:teuthology.orchestra.run.smithi155.stdout: }, 2023-08-01T19:55:18.200 INFO:teuthology.orchestra.run.smithi155.stdout: { 2023-08-01T19:55:18.200 INFO:teuthology.orchestra.run.smithi155.stdout: "event": "throttled", 2023-08-01T19:55:18.200 INFO:teuthology.orchestra.run.smithi155.stdout: "time": "2023-08-01T19:55:05.153614+0000", 2023-08-01T19:55:18.200 INFO:teuthology.orchestra.run.smithi155.stdout: "duration": 0 2023-08-01T19:55:18.201 INFO:teuthology.orchestra.run.smithi155.stdout: }, 2023-08-01T19:55:18.201 INFO:teuthology.orchestra.run.smithi155.stdout: { 2023-08-01T19:55:18.201 INFO:teuthology.orchestra.run.smithi155.stdout: "event": "header_read", 2023-08-01T19:55:18.201 INFO:teuthology.orchestra.run.smithi155.stdout: "time": "2023-08-01T19:55:05.153612+0000", 2023-08-01T19:55:18.201 INFO:teuthology.orchestra.run.smithi155.stdout: "duration": 4294967295.9999986 2023-08-01T19:55:18.201 INFO:teuthology.orchestra.run.smithi155.stdout: }, 2023-08-01T19:55:18.201 INFO:teuthology.orchestra.run.smithi155.stdout: { 2023-08-01T19:55:18.201 INFO:teuthology.orchestra.run.smithi155.stdout: "event": "all_read", 2023-08-01T19:55:18.202 INFO:teuthology.orchestra.run.smithi155.stdout: "time": "2023-08-01T19:55:05.153694+0000", 2023-08-01T19:55:18.202 INFO:teuthology.orchestra.run.smithi155.stdout: "duration": 8.1618000000000004e-05 2023-08-01T19:55:18.202 INFO:teuthology.orchestra.run.smithi155.stdout: }, 2023-08-01T19:55:18.202 INFO:teuthology.orchestra.run.smithi155.stdout: { 2023-08-01T19:55:18.202 INFO:teuthology.orchestra.run.smithi155.stdout: "event": "dispatched", 2023-08-01T19:55:18.202 INFO:teuthology.orchestra.run.smithi155.stdout: "time": "2023-08-01T19:55:05.153713+0000", 2023-08-01T19:55:18.202 INFO:teuthology.orchestra.run.smithi155.stdout: "duration": 1.9069999999999999e-05 2023-08-01T19:55:18.202 INFO:teuthology.orchestra.run.smithi155.stdout: }, 2023-08-01T19:55:18.203 INFO:teuthology.orchestra.run.smithi155.stdout: { 2023-08-01T19:55:18.203 INFO:teuthology.orchestra.run.smithi155.stdout: "event": "queued_for_pg", 2023-08-01T19:55:18.203 INFO:teuthology.orchestra.run.smithi155.stdout: "time": "2023-08-01T19:55:05.153726+0000", 2023-08-01T19:55:18.203 INFO:teuthology.orchestra.run.smithi155.stdout: "duration": 1.238e-05 2023-08-01T19:55:18.203 INFO:teuthology.orchestra.run.smithi155.stdout: }, 2023-08-01T19:55:18.203 INFO:teuthology.orchestra.run.smithi155.stdout: { 2023-08-01T19:55:18.203 INFO:teuthology.orchestra.run.smithi155.stdout: "event": "reached_pg", 2023-08-01T19:55:18.203 INFO:teuthology.orchestra.run.smithi155.stdout: "time": "2023-08-01T19:55:05.153761+0000", 2023-08-01T19:55:18.204 INFO:teuthology.orchestra.run.smithi155.stdout: "duration": 3.5046999999999998e-05 2023-08-01T19:55:18.204 INFO:teuthology.orchestra.run.smithi155.stdout: }, 2023-08-01T19:55:18.204 INFO:teuthology.orchestra.run.smithi155.stdout: { 2023-08-01T19:55:18.204 INFO:teuthology.orchestra.run.smithi155.stdout: "event": "started", 2023-08-01T19:55:18.204 INFO:teuthology.orchestra.run.smithi155.stdout: "time": "2023-08-01T19:55:05.153896+0000", 2023-08-01T19:55:18.204 INFO:teuthology.orchestra.run.smithi155.stdout: "duration": 0.00013575800000000001 2023-08-01T19:55:18.204 INFO:teuthology.orchestra.run.smithi155.stdout: }, 2023-08-01T19:55:18.204 INFO:teuthology.orchestra.run.smithi155.stdout: { 2023-08-01T19:55:18.205 INFO:teuthology.orchestra.run.smithi155.stdout: "event": "waiting for subops from 0", 2023-08-01T19:55:18.205 INFO:teuthology.orchestra.run.smithi155.stdout: "time": "2023-08-01T19:55:05.154043+0000", 2023-08-01T19:55:18.205 INFO:teuthology.orchestra.run.smithi155.stdout: "duration": 0.00014650700000000001 2023-08-01T19:55:18.205 INFO:teuthology.orchestra.run.smithi155.stdout: }, 2023-08-01T19:55:18.205 INFO:teuthology.orchestra.run.smithi155.stdout: { 2023-08-01T19:55:18.205 INFO:teuthology.orchestra.run.smithi155.stdout: "event": "sub_op_commit_rec", 2023-08-01T19:55:18.205 INFO:teuthology.orchestra.run.smithi155.stdout: "time": "2023-08-01T19:55:05.221876+0000", 2023-08-01T19:55:18.205 INFO:teuthology.orchestra.run.smithi155.stdout: "duration": 0.067832796000000001 2023-08-01T19:55:18.206 INFO:teuthology.orchestra.run.smithi155.stdout: }, 2023-08-01T19:55:18.206 INFO:teuthology.orchestra.run.smithi155.stdout: { 2023-08-01T19:55:18.206 INFO:teuthology.orchestra.run.smithi155.stdout: "event": "op_commit", 2023-08-01T19:55:18.206 INFO:teuthology.orchestra.run.smithi155.stdout: "time": "2023-08-01T19:55:05.222813+0000", 2023-08-01T19:55:18.206 INFO:teuthology.orchestra.run.smithi155.stdout: "duration": 0.00093755300000000004 2023-08-01T19:55:18.206 INFO:teuthology.orchestra.run.smithi155.stdout: }, 2023-08-01T19:55:18.206 INFO:teuthology.orchestra.run.smithi155.stdout: { 2023-08-01T19:55:18.206 INFO:teuthology.orchestra.run.smithi155.stdout: "event": "commit_sent", 2023-08-01T19:55:18.207 INFO:teuthology.orchestra.run.smithi155.stdout: "time": "2023-08-01T19:55:05.222861+0000", 2023-08-01T19:55:18.207 INFO:teuthology.orchestra.run.smithi155.stdout: "duration": 4.8013999999999998e-05 2023-08-01T19:55:18.207 INFO:teuthology.orchestra.run.smithi155.stdout: }, 2023-08-01T19:55:18.207 INFO:teuthology.orchestra.run.smithi155.stdout: { 2023-08-01T19:55:18.207 INFO:teuthology.orchestra.run.smithi155.stdout: "event": "done", 2023-08-01T19:55:18.207 INFO:teuthology.orchestra.run.smithi155.stdout: "time": "2023-08-01T19:55:05.222900+0000", 2023-08-01T19:55:18.207 INFO:teuthology.orchestra.run.smithi155.stdout: "duration": 3.8634999999999999e-05 2023-08-01T19:55:18.207 INFO:teuthology.orchestra.run.smithi155.stdout: } 2023-08-01T19:55:18.208 INFO:teuthology.orchestra.run.smithi155.stdout: ] 2023-08-01T19:55:18.208 INFO:teuthology.orchestra.run.smithi155.stdout: } 2023-08-01T19:55:18.208 INFO:teuthology.orchestra.run.smithi155.stdout: }, 2023-08-01T19:55:18.208 INFO:teuthology.orchestra.run.smithi155.stdout: { 2023-08-01T19:55:18.208 INFO:teuthology.orchestra.run.smithi155.stdout: "description": "osd_op(client.4668.0:100251 5.b 5:d853df24:::benchmark_data_smithi006_114134_object100250:head [set-alloc-hint object_size 65536 write_size 65536,write 0~65536] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e37)", 2023-08-01T19:55:18.208 INFO:teuthology.orchestra.run.smithi155.stdout: "initiated_at": "2023-08-01T19:55:05.153737+0000", 2023-08-01T19:55:18.208 INFO:teuthology.orchestra.run.smithi155.stdout: "age": 12.953839861000001, 2023-08-01T19:55:18.209 INFO:teuthology.orchestra.run.smithi155.stdout: "duration": 0.071366545000000003, 2023-08-01T19:55:18.209 INFO:teuthology.orchestra.run.smithi155.stdout: "type_data": { 2023-08-01T19:55:18.209 INFO:teuthology.orchestra.run.smithi155.stdout: "flag_point": "commit sent; apply or cleanup", 2023-08-01T19:55:18.209 INFO:teuthology.orchestra.run.smithi155.stdout: "client_info": { 2023-08-01T19:55:18.209 INFO:teuthology.orchestra.run.smithi155.stdout: "client": "client.4668", 2023-08-01T19:55:18.209 INFO:teuthology.orchestra.run.smithi155.stdout: "client_addr": "172.21.15.6:0/1709472247", 2023-08-01T19:55:18.209 INFO:teuthology.orchestra.run.smithi155.stdout: "tid": 100251 2023-08-01T19:55:18.209 INFO:teuthology.orchestra.run.smithi155.stdout: }, 2023-08-01T19:55:18.210 INFO:teuthology.orchestra.run.smithi155.stdout: "events": [ 2023-08-01T19:55:18.210 INFO:teuthology.orchestra.run.smithi155.stdout: { 2023-08-01T19:55:18.210 INFO:teuthology.orchestra.run.smithi155.stdout: "event": "initiated", 2023-08-01T19:55:18.210 INFO:teuthology.orchestra.run.smithi155.stdout: "time": "2023-08-01T19:55:05.153737+0000", 2023-08-01T19:55:18.210 INFO:teuthology.orchestra.run.smithi155.stdout: "duration": 0 2023-08-01T19:55:18.210 INFO:teuthology.orchestra.run.smithi155.stdout: }, 2023-08-01T19:55:18.210 INFO:teuthology.orchestra.run.smithi155.stdout: { 2023-08-01T19:55:18.210 INFO:teuthology.orchestra.run.smithi155.stdout: "event": "throttled", 2023-08-01T19:55:18.211 INFO:teuthology.orchestra.run.smithi155.stdout: "time": "2023-08-01T19:55:05.153737+0000", 2023-08-01T19:55:18.211 INFO:teuthology.orchestra.run.smithi155.stdout: "duration": 0 2023-08-01T19:55:18.211 INFO:teuthology.orchestra.run.smithi155.stdout: }, 2023-08-01T19:55:18.211 INFO:teuthology.orchestra.run.smithi155.stdout: { 2023-08-01T19:55:18.211 INFO:teuthology.orchestra.run.smithi155.stdout: "event": "header_read", 2023-08-01T19:55:18.211 INFO:teuthology.orchestra.run.smithi155.stdout: "time": "2023-08-01T19:55:05.153736+0000", 2023-08-01T19:55:18.211 INFO:teuthology.orchestra.run.smithi155.stdout: "duration": 4294967295.9999995 2023-08-01T19:55:18.211 INFO:teuthology.orchestra.run.smithi155.stdout: }, 2023-08-01T19:55:18.212 INFO:teuthology.orchestra.run.smithi155.stdout: { 2023-08-01T19:55:18.212 INFO:teuthology.orchestra.run.smithi155.stdout: "event": "all_read", 2023-08-01T19:55:18.212 INFO:teuthology.orchestra.run.smithi155.stdout: "time": "2023-08-01T19:55:05.153784+0000", 2023-08-01T19:55:18.212 INFO:teuthology.orchestra.run.smithi155.stdout: "duration": 4.7660000000000001e-05 2023-08-01T19:55:18.212 INFO:teuthology.orchestra.run.smithi155.stdout: }, 2023-08-01T19:55:18.212 INFO:teuthology.orchestra.run.smithi155.stdout: { 2023-08-01T19:55:18.212 INFO:teuthology.orchestra.run.smithi155.stdout: "event": "dispatched", 2023-08-01T19:55:18.213 INFO:teuthology.orchestra.run.smithi155.stdout: "time": "2023-08-01T19:55:05.153793+0000", 2023-08-01T19:55:18.213 INFO:teuthology.orchestra.run.smithi155.stdout: "duration": 8.7150000000000004e-06 2023-08-01T19:55:18.213 INFO:teuthology.orchestra.run.smithi155.stdout: }, 2023-08-01T19:55:18.213 INFO:teuthology.orchestra.run.smithi155.stdout: { 2023-08-01T19:55:18.213 INFO:teuthology.orchestra.run.smithi155.stdout: "event": "queued_for_pg", 2023-08-01T19:55:18.213 INFO:teuthology.orchestra.run.smithi155.stdout: "time": "2023-08-01T19:55:05.153800+0000", 2023-08-01T19:55:18.213 INFO:teuthology.orchestra.run.smithi155.stdout: "duration": 7.2459999999999997e-06 2023-08-01T19:55:18.213 INFO:teuthology.orchestra.run.smithi155.stdout: }, 2023-08-01T19:55:18.214 INFO:teuthology.orchestra.run.smithi155.stdout: { 2023-08-01T19:55:18.214 INFO:teuthology.orchestra.run.smithi155.stdout: "event": "reached_pg", 2023-08-01T19:55:18.214 INFO:teuthology.orchestra.run.smithi155.stdout: "time": "2023-08-01T19:55:05.156241+0000", 2023-08-01T19:55:18.214 INFO:teuthology.orchestra.run.smithi155.stdout: "duration": 0.0024415359999999998 2023-08-01T19:55:18.214 INFO:teuthology.orchestra.run.smithi155.stdout: }, 2023-08-01T19:55:18.214 INFO:teuthology.orchestra.run.smithi155.stdout: { 2023-08-01T19:55:18.214 INFO:teuthology.orchestra.run.smithi155.stdout: "event": "started", 2023-08-01T19:55:18.214 INFO:teuthology.orchestra.run.smithi155.stdout: "time": "2023-08-01T19:55:05.219045+0000", 2023-08-01T19:55:18.215 INFO:teuthology.orchestra.run.smithi155.stdout: "duration": 0.062803855000000006 2023-08-01T19:55:18.215 INFO:teuthology.orchestra.run.smithi155.stdout: }, 2023-08-01T19:55:18.215 INFO:teuthology.orchestra.run.smithi155.stdout: { 2023-08-01T19:55:18.215 INFO:teuthology.orchestra.run.smithi155.stdout: "event": "waiting for subops from 0", 2023-08-01T19:55:18.215 INFO:teuthology.orchestra.run.smithi155.stdout: "time": "2023-08-01T19:55:05.219238+0000", 2023-08-01T19:55:18.215 INFO:teuthology.orchestra.run.smithi155.stdout: "duration": 0.00019241500000000001 2023-08-01T19:55:18.215 INFO:teuthology.orchestra.run.smithi155.stdout: }, 2023-08-01T19:55:18.215 INFO:teuthology.orchestra.run.smithi155.stdout: { 2023-08-01T19:55:18.216 INFO:teuthology.orchestra.run.smithi155.stdout: "event": "sub_op_commit_rec", 2023-08-01T19:55:18.216 INFO:teuthology.orchestra.run.smithi155.stdout: "time": "2023-08-01T19:55:05.223300+0000", 2023-08-01T19:55:18.216 INFO:teuthology.orchestra.run.smithi155.stdout: "duration": 0.0040626509999999996 2023-08-01T19:55:18.216 INFO:teuthology.orchestra.run.smithi155.stdout: }, 2023-08-01T19:55:18.216 INFO:teuthology.orchestra.run.smithi155.stdout: { 2023-08-01T19:55:18.216 INFO:teuthology.orchestra.run.smithi155.stdout: "event": "op_commit", 2023-08-01T19:55:18.216 INFO:teuthology.orchestra.run.smithi155.stdout: "time": "2023-08-01T19:55:05.225020+0000", 2023-08-01T19:55:18.216 INFO:teuthology.orchestra.run.smithi155.stdout: "duration": 0.0017201 2023-08-01T19:55:18.217 INFO:teuthology.orchestra.run.smithi155.stdout: }, 2023-08-01T19:55:18.217 INFO:teuthology.orchestra.run.smithi155.stdout: { 2023-08-01T19:55:18.217 INFO:teuthology.orchestra.run.smithi155.stdout: "event": "commit_sent", 2023-08-01T19:55:18.217 INFO:teuthology.orchestra.run.smithi155.stdout: "time": "2023-08-01T19:55:05.225066+0000", 2023-08-01T19:55:18.217 INFO:teuthology.orchestra.run.smithi155.stdout: "duration": 4.6143000000000002e-05 2023-08-01T19:55:18.217 INFO:teuthology.orchestra.run.smithi155.stdout: }, 2023-08-01T19:55:18.217 INFO:teuthology.orchestra.run.smithi155.stdout: { 2023-08-01T19:55:18.217 INFO:teuthology.orchestra.run.smithi155.stdout: "event": "done", 2023-08-01T19:55:18.218 INFO:teuthology.orchestra.run.smithi155.stdout: "time": "2023-08-01T19:55:05.225103+0000", 2023-08-01T19:55:18.218 INFO:teuthology.orchestra.run.smithi155.stdout: "duration": 3.6789999999999998e-05 2023-08-01T19:55:18.218 INFO:teuthology.orchestra.run.smithi155.stdout: } 2023-08-01T19:55:18.218 INFO:teuthology.orchestra.run.smithi155.stdout: ] 2023-08-01T19:55:18.218 INFO:teuthology.orchestra.run.smithi155.stdout: } 2023-08-01T19:55:18.218 INFO:teuthology.orchestra.run.smithi155.stdout: }, 2023-08-01T19:55:18.218 INFO:teuthology.orchestra.run.smithi155.stdout: { 2023-08-01T19:55:18.218 INFO:teuthology.orchestra.run.smithi155.stdout: "description": "osd_op(client.4668.0:100252 5.0 5:01f90c3c:::benchmark_data_smithi006_114134_object100251:head [set-alloc-hint object_size 65536 write_size 65536,write 0~65536] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e37)", 2023-08-01T19:55:18.219 INFO:teuthology.orchestra.run.smithi155.stdout: "initiated_at": "2023-08-01T19:55:05.154048+0000", 2023-08-01T19:55:18.219 INFO:teuthology.orchestra.run.smithi155.stdout: "age": 12.953528614, 2023-08-01T19:55:18.219 INFO:teuthology.orchestra.run.smithi155.stdout: "duration": 0.070156683999999997, 2023-08-01T19:55:18.219 INFO:teuthology.orchestra.run.smithi155.stdout: "type_data": { 2023-08-01T19:55:18.219 INFO:teuthology.orchestra.run.smithi155.stdout: "flag_point": "commit sent; apply or cleanup", 2023-08-01T19:55:18.219 INFO:teuthology.orchestra.run.smithi155.stdout: "client_info": { 2023-08-01T19:55:18.219 INFO:teuthology.orchestra.run.smithi155.stdout: "client": "client.4668", 2023-08-01T19:55:18.219 INFO:teuthology.orchestra.run.smithi155.stdout: "client_addr": "172.21.15.6:0/1709472247", 2023-08-01T19:55:18.220 INFO:teuthology.orchestra.run.smithi155.stdout: "tid": 100252 2023-08-01T19:55:18.220 INFO:teuthology.orchestra.run.smithi155.stdout: }, 2023-08-01T19:55:18.220 INFO:teuthology.orchestra.run.smithi155.stdout: "events": [ 2023-08-01T19:55:18.220 INFO:teuthology.orchestra.run.smithi155.stdout: { 2023-08-01T19:55:18.220 INFO:teuthology.orchestra.run.smithi155.stdout: "event": "initiated", 2023-08-01T19:55:18.220 INFO:teuthology.orchestra.run.smithi155.stdout: "time": "2023-08-01T19:55:05.154048+0000", 2023-08-01T19:55:18.220 INFO:teuthology.orchestra.run.smithi155.stdout: "duration": 0 2023-08-01T19:55:18.221 INFO:teuthology.orchestra.run.smithi155.stdout: }, 2023-08-01T19:55:18.221 INFO:teuthology.orchestra.run.smithi155.stdout: { 2023-08-01T19:55:18.221 INFO:teuthology.orchestra.run.smithi155.stdout: "event": "throttled", 2023-08-01T19:55:18.221 INFO:teuthology.orchestra.run.smithi155.stdout: "time": "2023-08-01T19:55:05.154048+0000", 2023-08-01T19:55:18.221 INFO:teuthology.orchestra.run.smithi155.stdout: "duration": 0 2023-08-01T19:55:18.221 INFO:teuthology.orchestra.run.smithi155.stdout: }, 2023-08-01T19:55:18.221 INFO:teuthology.orchestra.run.smithi155.stdout: { 2023-08-01T19:55:18.221 INFO:teuthology.orchestra.run.smithi155.stdout: "event": "header_read", 2023-08-01T19:55:18.222 INFO:teuthology.orchestra.run.smithi155.stdout: "time": "2023-08-01T19:55:05.154047+0000", 2023-08-01T19:55:18.222 INFO:teuthology.orchestra.run.smithi155.stdout: "duration": 4294967295.999999 2023-08-01T19:55:18.222 INFO:teuthology.orchestra.run.smithi155.stdout: }, 2023-08-01T19:55:18.222 INFO:teuthology.orchestra.run.smithi155.stdout: { 2023-08-01T19:55:18.222 INFO:teuthology.orchestra.run.smithi155.stdout: "event": "all_read", 2023-08-01T19:55:18.222 INFO:teuthology.orchestra.run.smithi155.stdout: "time": "2023-08-01T19:55:05.154115+0000", 2023-08-01T19:55:18.222 INFO:teuthology.orchestra.run.smithi155.stdout: "duration": 6.7545999999999993e-05 2023-08-01T19:55:18.222 INFO:teuthology.orchestra.run.smithi155.stdout: }, 2023-08-01T19:55:18.223 INFO:teuthology.orchestra.run.smithi155.stdout: { 2023-08-01T19:55:18.223 INFO:teuthology.orchestra.run.smithi155.stdout: "event": "dispatched", 2023-08-01T19:55:18.223 INFO:teuthology.orchestra.run.smithi155.stdout: "time": "2023-08-01T19:55:05.154125+0000", 2023-08-01T19:55:18.223 INFO:teuthology.orchestra.run.smithi155.stdout: "duration": 1.0669000000000001e-05 2023-08-01T19:55:18.223 INFO:teuthology.orchestra.run.smithi155.stdout: }, 2023-08-01T19:55:18.223 INFO:teuthology.orchestra.run.smithi155.stdout: { 2023-08-01T19:55:18.223 INFO:teuthology.orchestra.run.smithi155.stdout: "event": "queued_for_pg", 2023-08-01T19:55:18.223 INFO:teuthology.orchestra.run.smithi155.stdout: "time": "2023-08-01T19:55:05.154131+0000", 2023-08-01T19:55:18.224 INFO:teuthology.orchestra.run.smithi155.stdout: "duration": 6.0349999999999998e-06 2023-08-01T19:55:18.224 INFO:teuthology.orchestra.run.smithi155.stdout: }, 2023-08-01T19:55:18.224 INFO:teuthology.orchestra.run.smithi155.stdout: { 2023-08-01T19:55:18.224 INFO:teuthology.orchestra.run.smithi155.stdout: "event": "reached_pg", 2023-08-01T19:55:18.224 INFO:teuthology.orchestra.run.smithi155.stdout: "time": "2023-08-01T19:55:05.154174+0000", 2023-08-01T19:55:18.224 INFO:teuthology.orchestra.run.smithi155.stdout: "duration": 4.2429000000000003e-05 2023-08-01T19:55:18.224 INFO:teuthology.orchestra.run.smithi155.stdout: }, 2023-08-01T19:55:18.224 INFO:teuthology.orchestra.run.smithi155.stdout: { 2023-08-01T19:55:18.225 INFO:teuthology.orchestra.run.smithi155.stdout: "event": "started", 2023-08-01T19:55:18.225 INFO:teuthology.orchestra.run.smithi155.stdout: "time": "2023-08-01T19:55:05.154287+0000", 2023-08-01T19:55:18.225 INFO:teuthology.orchestra.run.smithi155.stdout: "duration": 0.000113138 2023-08-01T19:55:18.225 INFO:teuthology.orchestra.run.smithi155.stdout: }, 2023-08-01T19:55:18.225 INFO:teuthology.orchestra.run.smithi155.stdout: { 2023-08-01T19:55:18.225 INFO:teuthology.orchestra.run.smithi155.stdout: "event": "waiting for subops from 0", 2023-08-01T19:55:18.225 INFO:teuthology.orchestra.run.smithi155.stdout: "time": "2023-08-01T19:55:05.154420+0000", 2023-08-01T19:55:18.225 INFO:teuthology.orchestra.run.smithi155.stdout: "duration": 0.000133292 2023-08-01T19:55:18.226 INFO:teuthology.orchestra.run.smithi155.stdout: }, 2023-08-01T19:55:18.226 INFO:teuthology.orchestra.run.smithi155.stdout: { 2023-08-01T19:55:18.226 INFO:teuthology.orchestra.run.smithi155.stdout: "event": "sub_op_commit_rec", 2023-08-01T19:55:18.226 INFO:teuthology.orchestra.run.smithi155.stdout: "time": "2023-08-01T19:55:05.219034+0000", 2023-08-01T19:55:18.226 INFO:teuthology.orchestra.run.smithi155.stdout: "duration": 0.064613429999999999 2023-08-01T19:55:18.226 INFO:teuthology.orchestra.run.smithi155.stdout: }, 2023-08-01T19:55:18.226 INFO:teuthology.orchestra.run.smithi155.stdout: { 2023-08-01T19:55:18.226 INFO:teuthology.orchestra.run.smithi155.stdout: "event": "op_commit", 2023-08-01T19:55:18.227 INFO:teuthology.orchestra.run.smithi155.stdout: "time": "2023-08-01T19:55:05.224138+0000", 2023-08-01T19:55:18.227 INFO:teuthology.orchestra.run.smithi155.stdout: "duration": 0.0051041999999999997 2023-08-01T19:55:18.227 INFO:teuthology.orchestra.run.smithi155.stdout: }, 2023-08-01T19:55:18.227 INFO:teuthology.orchestra.run.smithi155.stdout: { 2023-08-01T19:55:18.227 INFO:teuthology.orchestra.run.smithi155.stdout: "event": "commit_sent", 2023-08-01T19:55:18.227 INFO:teuthology.orchestra.run.smithi155.stdout: "time": "2023-08-01T19:55:05.224171+0000", 2023-08-01T19:55:18.227 INFO:teuthology.orchestra.run.smithi155.stdout: "duration": 3.3345e-05 2023-08-01T19:55:18.227 INFO:teuthology.orchestra.run.smithi155.stdout: }, 2023-08-01T19:55:18.228 INFO:teuthology.orchestra.run.smithi155.stdout: { 2023-08-01T19:55:18.228 INFO:teuthology.orchestra.run.smithi155.stdout: "event": "done", 2023-08-01T19:55:18.228 INFO:teuthology.orchestra.run.smithi155.stdout: "time": "2023-08-01T19:55:05.224205+0000", 2023-08-01T19:55:18.228 INFO:teuthology.orchestra.run.smithi155.stdout: "duration": 3.3525999999999997e-05 2023-08-01T19:55:18.228 INFO:teuthology.orchestra.run.smithi155.stdout: } 2023-08-01T19:55:18.228 INFO:teuthology.orchestra.run.smithi155.stdout: ] 2023-08-01T19:55:18.228 INFO:teuthology.orchestra.run.smithi155.stdout: } 2023-08-01T19:55:18.228 INFO:teuthology.orchestra.run.smithi155.stdout: }, 2023-08-01T19:55:18.229 INFO:teuthology.orchestra.run.smithi155.stdout: { 2023-08-01T19:55:18.229 INFO:teuthology.orchestra.run.smithi155.stdout: "description": "osd_repop_reply(client.4668.0:100237 5.4 e37/19 ondisk, result = 0)", 2023-08-01T19:55:18.229 INFO:teuthology.orchestra.run.smithi155.stdout: "initiated_at": "2023-08-01T19:55:05.156249+0000", 2023-08-01T19:55:18.229 INFO:teuthology.orchestra.run.smithi155.stdout: "age": 12.951327668999999, 2023-08-01T19:55:18.229 INFO:teuthology.orchestra.run.smithi155.stdout: "duration": 0.062792549000000003, 2023-08-01T19:55:18.229 INFO:teuthology.orchestra.run.smithi155.stdout: "type_data": { 2023-08-01T19:55:18.229 INFO:teuthology.orchestra.run.smithi155.stdout: "flag_point": "started", 2023-08-01T19:55:18.229 INFO:teuthology.orchestra.run.smithi155.stdout: "events": [ 2023-08-01T19:55:18.230 INFO:teuthology.orchestra.run.smithi155.stdout: { 2023-08-01T19:55:18.230 INFO:teuthology.orchestra.run.smithi155.stdout: "event": "initiated", 2023-08-01T19:55:18.230 INFO:teuthology.orchestra.run.smithi155.stdout: "time": "2023-08-01T19:55:05.156249+0000", 2023-08-01T19:55:18.230 INFO:teuthology.orchestra.run.smithi155.stdout: "duration": 0 2023-08-01T19:55:18.230 INFO:teuthology.orchestra.run.smithi155.stdout: }, 2023-08-01T19:55:18.230 INFO:teuthology.orchestra.run.smithi155.stdout: { 2023-08-01T19:55:18.230 INFO:teuthology.orchestra.run.smithi155.stdout: "event": "throttled", 2023-08-01T19:55:18.231 INFO:teuthology.orchestra.run.smithi155.stdout: "time": "2023-08-01T19:55:05.156249+0000", 2023-08-01T19:55:18.231 INFO:teuthology.orchestra.run.smithi155.stdout: "duration": 0 2023-08-01T19:55:18.231 INFO:teuthology.orchestra.run.smithi155.stdout: }, 2023-08-01T19:55:18.231 INFO:teuthology.orchestra.run.smithi155.stdout: { 2023-08-01T19:55:18.231 INFO:teuthology.orchestra.run.smithi155.stdout: "event": "header_read", 2023-08-01T19:55:18.231 INFO:teuthology.orchestra.run.smithi155.stdout: "time": "2023-08-01T19:55:05.156248+0000", 2023-08-01T19:55:18.231 INFO:teuthology.orchestra.run.smithi155.stdout: "duration": 4294967295.9999995 2023-08-01T19:55:18.231 INFO:teuthology.orchestra.run.smithi155.stdout: }, 2023-08-01T19:55:18.232 INFO:teuthology.orchestra.run.smithi155.stdout: { 2023-08-01T19:55:18.232 INFO:teuthology.orchestra.run.smithi155.stdout: "event": "all_read", 2023-08-01T19:55:18.232 INFO:teuthology.orchestra.run.smithi155.stdout: "time": "2023-08-01T19:55:05.156252+0000", 2023-08-01T19:55:18.232 INFO:teuthology.orchestra.run.smithi155.stdout: "duration": 3.9999999999999998e-06 2023-08-01T19:55:18.232 INFO:teuthology.orchestra.run.smithi155.stdout: }, 2023-08-01T19:55:18.232 INFO:teuthology.orchestra.run.smithi155.stdout: { 2023-08-01T19:55:18.232 INFO:teuthology.orchestra.run.smithi155.stdout: "event": "dispatched", 2023-08-01T19:55:18.232 INFO:teuthology.orchestra.run.smithi155.stdout: "time": "2023-08-01T19:55:05.218844+0000", 2023-08-01T19:55:18.233 INFO:teuthology.orchestra.run.smithi155.stdout: "duration": 0.062591516999999999 2023-08-01T19:55:18.233 INFO:teuthology.orchestra.run.smithi155.stdout: }, 2023-08-01T19:55:18.233 INFO:teuthology.orchestra.run.smithi155.stdout: { 2023-08-01T19:55:18.233 INFO:teuthology.orchestra.run.smithi155.stdout: "event": "queued_for_pg", 2023-08-01T19:55:18.233 INFO:teuthology.orchestra.run.smithi155.stdout: "time": "2023-08-01T19:55:05.218862+0000", 2023-08-01T19:55:18.233 INFO:teuthology.orchestra.run.smithi155.stdout: "duration": 1.7666e-05 2023-08-01T19:55:18.233 INFO:teuthology.orchestra.run.smithi155.stdout: }, 2023-08-01T19:55:18.234 INFO:teuthology.orchestra.run.smithi155.stdout: { 2023-08-01T19:55:18.234 INFO:teuthology.orchestra.run.smithi155.stdout: "event": "reached_pg", 2023-08-01T19:55:18.234 INFO:teuthology.orchestra.run.smithi155.stdout: "time": "2023-08-01T19:55:05.218914+0000", 2023-08-01T19:55:18.234 INFO:teuthology.orchestra.run.smithi155.stdout: "duration": 5.2565999999999998e-05 2023-08-01T19:55:18.234 INFO:teuthology.orchestra.run.smithi155.stdout: }, 2023-08-01T19:55:18.234 INFO:teuthology.orchestra.run.smithi155.stdout: { 2023-08-01T19:55:18.234 INFO:teuthology.orchestra.run.smithi155.stdout: "event": "started", 2023-08-01T19:55:18.234 INFO:teuthology.orchestra.run.smithi155.stdout: "time": "2023-08-01T19:55:05.218925+0000", 2023-08-01T19:55:18.235 INFO:teuthology.orchestra.run.smithi155.stdout: "duration": 1.1375e-05 2023-08-01T19:55:18.235 INFO:teuthology.orchestra.run.smithi155.stdout: }, 2023-08-01T19:55:18.235 INFO:teuthology.orchestra.run.smithi155.stdout: { 2023-08-01T19:55:18.235 INFO:teuthology.orchestra.run.smithi155.stdout: "event": "done", 2023-08-01T19:55:18.235 INFO:teuthology.orchestra.run.smithi155.stdout: "time": "2023-08-01T19:55:05.219041+0000", 2023-08-01T19:55:18.235 INFO:teuthology.orchestra.run.smithi155.stdout: "duration": 0.000115977 2023-08-01T19:55:18.235 INFO:teuthology.orchestra.run.smithi155.stdout: } 2023-08-01T19:55:18.235 INFO:teuthology.orchestra.run.smithi155.stdout: ] 2023-08-01T19:55:18.236 INFO:teuthology.orchestra.run.smithi155.stdout: } 2023-08-01T19:55:18.236 INFO:teuthology.orchestra.run.smithi155.stdout: }, 2023-08-01T19:55:18.236 INFO:teuthology.orchestra.run.smithi155.stdout: { 2023-08-01T19:55:18.236 INFO:teuthology.orchestra.run.smithi155.stdout: "description": "osd_repop(client.4668.0:100253 5.f e37/19 5:f7bbce05:::benchmark_data_smithi006_114134_object100252:head v 37'6323, mlcod=37'6321)", 2023-08-01T19:55:18.236 INFO:teuthology.orchestra.run.smithi155.stdout: "initiated_at": "2023-08-01T19:55:05.156952+0000", 2023-08-01T19:55:18.236 INFO:teuthology.orchestra.run.smithi155.stdout: "age": 12.950624606, 2023-08-01T19:55:18.236 INFO:teuthology.orchestra.run.smithi155.stdout: "duration": 0.068018577999999996, 2023-08-01T19:55:18.236 INFO:teuthology.orchestra.run.smithi155.stdout: "type_data": { 2023-08-01T19:55:18.237 INFO:teuthology.orchestra.run.smithi155.stdout: "flag_point": "commit sent; apply or cleanup", 2023-08-01T19:55:18.237 INFO:teuthology.orchestra.run.smithi155.stdout: "events": [ 2023-08-01T19:55:18.237 INFO:teuthology.orchestra.run.smithi155.stdout: { 2023-08-01T19:55:18.237 INFO:teuthology.orchestra.run.smithi155.stdout: "event": "initiated", 2023-08-01T19:55:18.237 INFO:teuthology.orchestra.run.smithi155.stdout: "time": "2023-08-01T19:55:05.156952+0000", 2023-08-01T19:55:18.237 INFO:teuthology.orchestra.run.smithi155.stdout: "duration": 0 2023-08-01T19:55:18.237 INFO:teuthology.orchestra.run.smithi155.stdout: }, 2023-08-01T19:55:18.237 INFO:teuthology.orchestra.run.smithi155.stdout: { 2023-08-01T19:55:18.238 INFO:teuthology.orchestra.run.smithi155.stdout: "event": "throttled", 2023-08-01T19:55:18.238 INFO:teuthology.orchestra.run.smithi155.stdout: "time": "2023-08-01T19:55:05.156952+0000", 2023-08-01T19:55:18.238 INFO:teuthology.orchestra.run.smithi155.stdout: "duration": 0 2023-08-01T19:55:18.238 INFO:teuthology.orchestra.run.smithi155.stdout: }, 2023-08-01T19:55:18.238 INFO:teuthology.orchestra.run.smithi155.stdout: { 2023-08-01T19:55:18.238 INFO:teuthology.orchestra.run.smithi155.stdout: "event": "header_read", 2023-08-01T19:55:18.238 INFO:teuthology.orchestra.run.smithi155.stdout: "time": "2023-08-01T19:55:05.156951+0000", 2023-08-01T19:55:18.238 INFO:teuthology.orchestra.run.smithi155.stdout: "duration": 4294967295.999999 2023-08-01T19:55:18.239 INFO:teuthology.orchestra.run.smithi155.stdout: }, 2023-08-01T19:55:18.239 INFO:teuthology.orchestra.run.smithi155.stdout: { 2023-08-01T19:55:18.239 INFO:teuthology.orchestra.run.smithi155.stdout: "event": "all_read", 2023-08-01T19:55:18.239 INFO:teuthology.orchestra.run.smithi155.stdout: "time": "2023-08-01T19:55:05.156989+0000", 2023-08-01T19:55:18.239 INFO:teuthology.orchestra.run.smithi155.stdout: "duration": 3.8175e-05 2023-08-01T19:55:18.239 INFO:teuthology.orchestra.run.smithi155.stdout: }, 2023-08-01T19:55:18.239 INFO:teuthology.orchestra.run.smithi155.stdout: { 2023-08-01T19:55:18.239 INFO:teuthology.orchestra.run.smithi155.stdout: "event": "dispatched", 2023-08-01T19:55:18.240 INFO:teuthology.orchestra.run.smithi155.stdout: "time": "2023-08-01T19:55:05.218842+0000", 2023-08-01T19:55:18.240 INFO:teuthology.orchestra.run.smithi155.stdout: "duration": 0.061852299999999999 2023-08-01T19:55:18.240 INFO:teuthology.orchestra.run.smithi155.stdout: }, 2023-08-01T19:55:18.240 INFO:teuthology.orchestra.run.smithi155.stdout: { 2023-08-01T19:55:18.240 INFO:teuthology.orchestra.run.smithi155.stdout: "event": "queued_for_pg", 2023-08-01T19:55:18.240 INFO:teuthology.orchestra.run.smithi155.stdout: "time": "2023-08-01T19:55:05.218862+0000", 2023-08-01T19:55:18.240 INFO:teuthology.orchestra.run.smithi155.stdout: "duration": 1.9854999999999999e-05 2023-08-01T19:55:18.241 INFO:teuthology.orchestra.run.smithi155.stdout: }, 2023-08-01T19:55:18.241 INFO:teuthology.orchestra.run.smithi155.stdout: { 2023-08-01T19:55:18.241 INFO:teuthology.orchestra.run.smithi155.stdout: "event": "reached_pg", 2023-08-01T19:55:18.241 INFO:teuthology.orchestra.run.smithi155.stdout: "time": "2023-08-01T19:55:05.218918+0000", 2023-08-01T19:55:18.241 INFO:teuthology.orchestra.run.smithi155.stdout: "duration": 5.6570000000000002e-05 2023-08-01T19:55:18.241 INFO:teuthology.orchestra.run.smithi155.stdout: }, 2023-08-01T19:55:18.241 INFO:teuthology.orchestra.run.smithi155.stdout: { 2023-08-01T19:55:18.241 INFO:teuthology.orchestra.run.smithi155.stdout: "event": "started", 2023-08-01T19:55:18.242 INFO:teuthology.orchestra.run.smithi155.stdout: "time": "2023-08-01T19:55:05.218940+0000", 2023-08-01T19:55:18.242 INFO:teuthology.orchestra.run.smithi155.stdout: "duration": 2.1804e-05 2023-08-01T19:55:18.242 INFO:teuthology.orchestra.run.smithi155.stdout: }, 2023-08-01T19:55:18.242 INFO:teuthology.orchestra.run.smithi155.stdout: { 2023-08-01T19:55:18.242 INFO:teuthology.orchestra.run.smithi155.stdout: "event": "commit_sent", 2023-08-01T19:55:18.242 INFO:teuthology.orchestra.run.smithi155.stdout: "time": "2023-08-01T19:55:05.224928+0000", 2023-08-01T19:55:18.242 INFO:teuthology.orchestra.run.smithi155.stdout: "duration": 0.0059876759999999999 2023-08-01T19:55:18.242 INFO:teuthology.orchestra.run.smithi155.stdout: }, 2023-08-01T19:55:18.243 INFO:teuthology.orchestra.run.smithi155.stdout: { 2023-08-01T19:55:18.243 INFO:teuthology.orchestra.run.smithi155.stdout: "event": "done", 2023-08-01T19:55:18.243 INFO:teuthology.orchestra.run.smithi155.stdout: "time": "2023-08-01T19:55:05.224971+0000", 2023-08-01T19:55:18.243 INFO:teuthology.orchestra.run.smithi155.stdout: "duration": 4.2929999999999997e-05 2023-08-01T19:55:18.243 INFO:teuthology.orchestra.run.smithi155.stdout: } 2023-08-01T19:55:18.243 INFO:teuthology.orchestra.run.smithi155.stdout: ] 2023-08-01T19:55:18.243 INFO:teuthology.orchestra.run.smithi155.stdout: } 2023-08-01T19:55:18.243 INFO:teuthology.orchestra.run.smithi155.stdout: }, 2023-08-01T19:55:18.244 INFO:teuthology.orchestra.run.smithi155.stdout: { 2023-08-01T19:55:18.244 INFO:teuthology.orchestra.run.smithi155.stdout: "description": "osd_op(client.4668.0:100927 5.0 5:00608ec6:::benchmark_data_smithi006_114134_object100926:head [set-alloc-hint object_size 65536 write_size 65536,write 0~65536] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e37)", 2023-08-01T19:55:18.244 INFO:teuthology.orchestra.run.smithi155.stdout: "initiated_at": "2023-08-01T19:55:05.561169+0000", 2023-08-01T19:55:18.244 INFO:teuthology.orchestra.run.smithi155.stdout: "age": 12.546407703, 2023-08-01T19:55:18.244 INFO:teuthology.orchestra.run.smithi155.stdout: "duration": 0.066411687999999997, 2023-08-01T19:55:18.244 INFO:teuthology.orchestra.run.smithi155.stdout: "type_data": { 2023-08-01T19:55:18.244 INFO:teuthology.orchestra.run.smithi155.stdout: "flag_point": "commit sent; apply or cleanup", 2023-08-01T19:55:18.244 INFO:teuthology.orchestra.run.smithi155.stdout: "client_info": { 2023-08-01T19:55:18.245 INFO:teuthology.orchestra.run.smithi155.stdout: "client": "client.4668", 2023-08-01T19:55:18.245 INFO:teuthology.orchestra.run.smithi155.stdout: "client_addr": "172.21.15.6:0/1709472247", 2023-08-01T19:55:18.245 INFO:teuthology.orchestra.run.smithi155.stdout: "tid": 100927 2023-08-01T19:55:18.245 INFO:teuthology.orchestra.run.smithi155.stdout: }, 2023-08-01T19:55:18.245 INFO:teuthology.orchestra.run.smithi155.stdout: "events": [ 2023-08-01T19:55:18.245 INFO:teuthology.orchestra.run.smithi155.stdout: { 2023-08-01T19:55:18.245 INFO:teuthology.orchestra.run.smithi155.stdout: "event": "initiated", 2023-08-01T19:55:18.245 INFO:teuthology.orchestra.run.smithi155.stdout: "time": "2023-08-01T19:55:05.561169+0000", 2023-08-01T19:55:18.246 INFO:teuthology.orchestra.run.smithi155.stdout: "duration": 0 2023-08-01T19:55:18.246 INFO:teuthology.orchestra.run.smithi155.stdout: }, 2023-08-01T19:55:18.246 INFO:teuthology.orchestra.run.smithi155.stdout: { 2023-08-01T19:55:18.246 INFO:teuthology.orchestra.run.smithi155.stdout: "event": "throttled", 2023-08-01T19:55:18.246 INFO:teuthology.orchestra.run.smithi155.stdout: "time": "2023-08-01T19:55:05.561169+0000", 2023-08-01T19:55:18.246 INFO:teuthology.orchestra.run.smithi155.stdout: "duration": 0 2023-08-01T19:55:18.246 INFO:teuthology.orchestra.run.smithi155.stdout: }, 2023-08-01T19:55:18.246 INFO:teuthology.orchestra.run.smithi155.stdout: { 2023-08-01T19:55:18.247 INFO:teuthology.orchestra.run.smithi155.stdout: "event": "header_read", 2023-08-01T19:55:18.247 INFO:teuthology.orchestra.run.smithi155.stdout: "time": "2023-08-01T19:55:05.561168+0000", 2023-08-01T19:55:18.247 INFO:teuthology.orchestra.run.smithi155.stdout: "duration": 4294967295.9999995 2023-08-01T19:55:18.247 INFO:teuthology.orchestra.run.smithi155.stdout: }, 2023-08-01T19:55:18.247 INFO:teuthology.orchestra.run.smithi155.stdout: { 2023-08-01T19:55:18.247 INFO:teuthology.orchestra.run.smithi155.stdout: "event": "all_read", 2023-08-01T19:55:18.247 INFO:teuthology.orchestra.run.smithi155.stdout: "time": "2023-08-01T19:55:05.561218+0000", 2023-08-01T19:55:18.247 INFO:teuthology.orchestra.run.smithi155.stdout: "duration": 4.9379999999999998e-05 2023-08-01T19:55:18.248 INFO:teuthology.orchestra.run.smithi155.stdout: }, 2023-08-01T19:55:18.248 INFO:teuthology.orchestra.run.smithi155.stdout: { 2023-08-01T19:55:18.248 INFO:teuthology.orchestra.run.smithi155.stdout: "event": "dispatched", 2023-08-01T19:55:18.248 INFO:teuthology.orchestra.run.smithi155.stdout: "time": "2023-08-01T19:55:05.561225+0000", 2023-08-01T19:55:18.248 INFO:teuthology.orchestra.run.smithi155.stdout: "duration": 7.114e-06 2023-08-01T19:55:18.248 INFO:teuthology.orchestra.run.smithi155.stdout: }, 2023-08-01T19:55:18.248 INFO:teuthology.orchestra.run.smithi155.stdout: { 2023-08-01T19:55:18.249 INFO:teuthology.orchestra.run.smithi155.stdout: "event": "queued_for_pg", 2023-08-01T19:55:18.249 INFO:teuthology.orchestra.run.smithi155.stdout: "time": "2023-08-01T19:55:05.561229+0000", 2023-08-01T19:55:18.249 INFO:teuthology.orchestra.run.smithi155.stdout: "duration": 4.2180000000000001e-06 2023-08-01T19:55:18.249 INFO:teuthology.orchestra.run.smithi155.stdout: }, 2023-08-01T19:55:18.249 INFO:teuthology.orchestra.run.smithi155.stdout: { 2023-08-01T19:55:18.249 INFO:teuthology.orchestra.run.smithi155.stdout: "event": "reached_pg", 2023-08-01T19:55:18.249 INFO:teuthology.orchestra.run.smithi155.stdout: "time": "2023-08-01T19:55:05.564737+0000", 2023-08-01T19:55:18.249 INFO:teuthology.orchestra.run.smithi155.stdout: "duration": 0.0035081869999999999 2023-08-01T19:55:18.250 INFO:teuthology.orchestra.run.smithi155.stdout: }, 2023-08-01T19:55:18.250 INFO:teuthology.orchestra.run.smithi155.stdout: { 2023-08-01T19:55:18.250 INFO:teuthology.orchestra.run.smithi155.stdout: "event": "started", 2023-08-01T19:55:18.250 INFO:teuthology.orchestra.run.smithi155.stdout: "time": "2023-08-01T19:55:05.564859+0000", 2023-08-01T19:55:18.250 INFO:teuthology.orchestra.run.smithi155.stdout: "duration": 0.00012165800000000001 2023-08-01T19:55:18.250 INFO:teuthology.orchestra.run.smithi155.stdout: }, 2023-08-01T19:55:18.250 INFO:teuthology.orchestra.run.smithi155.stdout: { 2023-08-01T19:55:18.250 INFO:teuthology.orchestra.run.smithi155.stdout: "event": "waiting for subops from 0", 2023-08-01T19:55:18.251 INFO:teuthology.orchestra.run.smithi155.stdout: "time": "2023-08-01T19:55:05.565009+0000", 2023-08-01T19:55:18.251 INFO:teuthology.orchestra.run.smithi155.stdout: "duration": 0.00014979699999999999 2023-08-01T19:55:18.251 INFO:teuthology.orchestra.run.smithi155.stdout: }, 2023-08-01T19:55:18.251 INFO:teuthology.orchestra.run.smithi155.stdout: { 2023-08-01T19:55:18.251 INFO:teuthology.orchestra.run.smithi155.stdout: "event": "op_commit", 2023-08-01T19:55:18.251 INFO:teuthology.orchestra.run.smithi155.stdout: "time": "2023-08-01T19:55:05.568007+0000", 2023-08-01T19:55:18.251 INFO:teuthology.orchestra.run.smithi155.stdout: "duration": 0.00299796 2023-08-01T19:55:18.251 INFO:teuthology.orchestra.run.smithi155.stdout: }, 2023-08-01T19:55:18.252 INFO:teuthology.orchestra.run.smithi155.stdout: { 2023-08-01T19:55:18.252 INFO:teuthology.orchestra.run.smithi155.stdout: "event": "sub_op_commit_rec", 2023-08-01T19:55:18.252 INFO:teuthology.orchestra.run.smithi155.stdout: "time": "2023-08-01T19:55:05.627520+0000", 2023-08-01T19:55:18.252 INFO:teuthology.orchestra.run.smithi155.stdout: "duration": 0.059513636000000002 2023-08-01T19:55:18.252 INFO:teuthology.orchestra.run.smithi155.stdout: }, 2023-08-01T19:55:18.252 INFO:teuthology.orchestra.run.smithi155.stdout: { 2023-08-01T19:55:18.252 INFO:teuthology.orchestra.run.smithi155.stdout: "event": "commit_sent", 2023-08-01T19:55:18.253 INFO:teuthology.orchestra.run.smithi155.stdout: "time": "2023-08-01T19:55:05.627553+0000", 2023-08-01T19:55:18.253 INFO:teuthology.orchestra.run.smithi155.stdout: "duration": 3.2635999999999997e-05 2023-08-01T19:55:18.253 INFO:teuthology.orchestra.run.smithi155.stdout: }, 2023-08-01T19:55:18.253 INFO:teuthology.orchestra.run.smithi155.stdout: { 2023-08-01T19:55:18.253 INFO:teuthology.orchestra.run.smithi155.stdout: "event": "done", 2023-08-01T19:55:18.253 INFO:teuthology.orchestra.run.smithi155.stdout: "time": "2023-08-01T19:55:05.627581+0000", 2023-08-01T19:55:18.253 INFO:teuthology.orchestra.run.smithi155.stdout: "duration": 2.7681000000000001e-05 2023-08-01T19:55:18.253 INFO:teuthology.orchestra.run.smithi155.stdout: } 2023-08-01T19:55:18.254 INFO:teuthology.orchestra.run.smithi155.stdout: ] 2023-08-01T19:55:18.254 INFO:teuthology.orchestra.run.smithi155.stdout: } 2023-08-01T19:55:18.254 INFO:teuthology.orchestra.run.smithi155.stdout: }, 2023-08-01T19:55:18.254 INFO:teuthology.orchestra.run.smithi155.stdout: { 2023-08-01T19:55:18.254 INFO:teuthology.orchestra.run.smithi155.stdout: "description": "osd_op(client.4668.0:100935 5.e 5:7895b14e:::benchmark_data_smithi006_114134_object100934:head [set-alloc-hint object_size 65536 write_size 65536,write 0~65536] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e37)", 2023-08-01T19:55:18.254 INFO:teuthology.orchestra.run.smithi155.stdout: "initiated_at": "2023-08-01T19:55:05.566666+0000", 2023-08-01T19:55:18.254 INFO:teuthology.orchestra.run.smithi155.stdout: "age": 12.540910403, 2023-08-01T19:55:18.255 INFO:teuthology.orchestra.run.smithi155.stdout: "duration": 0.064309016999999996, 2023-08-01T19:55:18.255 INFO:teuthology.orchestra.run.smithi155.stdout: "type_data": { 2023-08-01T19:55:18.255 INFO:teuthology.orchestra.run.smithi155.stdout: "flag_point": "commit sent; apply or cleanup", 2023-08-01T19:55:18.255 INFO:teuthology.orchestra.run.smithi155.stdout: "client_info": { 2023-08-01T19:55:18.255 INFO:teuthology.orchestra.run.smithi155.stdout: "client": "client.4668", 2023-08-01T19:55:18.255 INFO:teuthology.orchestra.run.smithi155.stdout: "client_addr": "172.21.15.6:0/1709472247", 2023-08-01T19:55:18.255 INFO:teuthology.orchestra.run.smithi155.stdout: "tid": 100935 2023-08-01T19:55:18.255 INFO:teuthology.orchestra.run.smithi155.stdout: }, 2023-08-01T19:55:18.256 INFO:teuthology.orchestra.run.smithi155.stdout: "events": [ 2023-08-01T19:55:18.256 INFO:teuthology.orchestra.run.smithi155.stdout: { 2023-08-01T19:55:18.256 INFO:teuthology.orchestra.run.smithi155.stdout: "event": "initiated", 2023-08-01T19:55:18.256 INFO:teuthology.orchestra.run.smithi155.stdout: "time": "2023-08-01T19:55:05.566666+0000", 2023-08-01T19:55:18.256 INFO:teuthology.orchestra.run.smithi155.stdout: "duration": 0 2023-08-01T19:55:18.256 INFO:teuthology.orchestra.run.smithi155.stdout: }, 2023-08-01T19:55:18.256 INFO:teuthology.orchestra.run.smithi155.stdout: { 2023-08-01T19:55:18.257 INFO:teuthology.orchestra.run.smithi155.stdout: "event": "throttled", 2023-08-01T19:55:18.257 INFO:teuthology.orchestra.run.smithi155.stdout: "time": "2023-08-01T19:55:05.566666+0000", 2023-08-01T19:55:18.257 INFO:teuthology.orchestra.run.smithi155.stdout: "duration": 0 2023-08-01T19:55:18.257 INFO:teuthology.orchestra.run.smithi155.stdout: }, 2023-08-01T19:55:18.257 INFO:teuthology.orchestra.run.smithi155.stdout: { 2023-08-01T19:55:18.257 INFO:teuthology.orchestra.run.smithi155.stdout: "event": "header_read", 2023-08-01T19:55:18.257 INFO:teuthology.orchestra.run.smithi155.stdout: "time": "2023-08-01T19:55:05.566665+0000", 2023-08-01T19:55:18.257 INFO:teuthology.orchestra.run.smithi155.stdout: "duration": 4294967295.9999986 2023-08-01T19:55:18.258 INFO:teuthology.orchestra.run.smithi155.stdout: }, 2023-08-01T19:55:18.258 INFO:teuthology.orchestra.run.smithi155.stdout: { 2023-08-01T19:55:18.258 INFO:teuthology.orchestra.run.smithi155.stdout: "event": "all_read", 2023-08-01T19:55:18.258 INFO:teuthology.orchestra.run.smithi155.stdout: "time": "2023-08-01T19:55:05.566754+0000", 2023-08-01T19:55:18.258 INFO:teuthology.orchestra.run.smithi155.stdout: "duration": 8.9425999999999994e-05 2023-08-01T19:55:18.258 INFO:teuthology.orchestra.run.smithi155.stdout: }, 2023-08-01T19:55:18.258 INFO:teuthology.orchestra.run.smithi155.stdout: { 2023-08-01T19:55:18.258 INFO:teuthology.orchestra.run.smithi155.stdout: "event": "dispatched", 2023-08-01T19:55:18.259 INFO:teuthology.orchestra.run.smithi155.stdout: "time": "2023-08-01T19:55:05.566766+0000", 2023-08-01T19:55:18.259 INFO:teuthology.orchestra.run.smithi155.stdout: "duration": 1.2018000000000001e-05 2023-08-01T19:55:18.259 INFO:teuthology.orchestra.run.smithi155.stdout: }, 2023-08-01T19:55:18.259 INFO:teuthology.orchestra.run.smithi155.stdout: { 2023-08-01T19:55:18.259 INFO:teuthology.orchestra.run.smithi155.stdout: "event": "queued_for_pg", 2023-08-01T19:55:18.259 INFO:teuthology.orchestra.run.smithi155.stdout: "time": "2023-08-01T19:55:05.566772+0000", 2023-08-01T19:55:18.259 INFO:teuthology.orchestra.run.smithi155.stdout: "duration": 6.0190000000000003e-06 2023-08-01T19:55:18.260 INFO:teuthology.orchestra.run.smithi155.stdout: }, 2023-08-01T19:55:18.260 INFO:teuthology.orchestra.run.smithi155.stdout: { 2023-08-01T19:55:18.260 INFO:teuthology.orchestra.run.smithi155.stdout: "event": "reached_pg", 2023-08-01T19:55:18.260 INFO:teuthology.orchestra.run.smithi155.stdout: "time": "2023-08-01T19:55:05.566800+0000", 2023-08-01T19:55:18.260 INFO:teuthology.orchestra.run.smithi155.stdout: "duration": 2.7835999999999999e-05 2023-08-01T19:55:18.260 INFO:teuthology.orchestra.run.smithi155.stdout: }, 2023-08-01T19:55:18.260 INFO:teuthology.orchestra.run.smithi155.stdout: { 2023-08-01T19:55:18.260 INFO:teuthology.orchestra.run.smithi155.stdout: "event": "started", 2023-08-01T19:55:18.261 INFO:teuthology.orchestra.run.smithi155.stdout: "time": "2023-08-01T19:55:05.566879+0000", 2023-08-01T19:55:18.261 INFO:teuthology.orchestra.run.smithi155.stdout: "duration": 7.9105999999999998e-05 2023-08-01T19:55:18.261 INFO:teuthology.orchestra.run.smithi155.stdout: }, 2023-08-01T19:55:18.261 INFO:teuthology.orchestra.run.smithi155.stdout: { 2023-08-01T19:55:18.261 INFO:teuthology.orchestra.run.smithi155.stdout: "event": "waiting for subops from 0", 2023-08-01T19:55:18.261 INFO:teuthology.orchestra.run.smithi155.stdout: "time": "2023-08-01T19:55:05.566971+0000", 2023-08-01T19:55:18.261 INFO:teuthology.orchestra.run.smithi155.stdout: "duration": 9.1817999999999994e-05 2023-08-01T19:55:18.262 INFO:teuthology.orchestra.run.smithi155.stdout: }, 2023-08-01T19:55:18.262 INFO:teuthology.orchestra.run.smithi155.stdout: { 2023-08-01T19:55:18.262 INFO:teuthology.orchestra.run.smithi155.stdout: "event": "op_commit", 2023-08-01T19:55:18.262 INFO:teuthology.orchestra.run.smithi155.stdout: "time": "2023-08-01T19:55:05.571475+0000", 2023-08-01T19:55:18.262 INFO:teuthology.orchestra.run.smithi155.stdout: "duration": 0.0045039499999999996 2023-08-01T19:55:18.262 INFO:teuthology.orchestra.run.smithi155.stdout: }, 2023-08-01T19:55:18.262 INFO:teuthology.orchestra.run.smithi155.stdout: { 2023-08-01T19:55:18.262 INFO:teuthology.orchestra.run.smithi155.stdout: "event": "sub_op_commit_rec", 2023-08-01T19:55:18.263 INFO:teuthology.orchestra.run.smithi155.stdout: "time": "2023-08-01T19:55:05.630884+0000", 2023-08-01T19:55:18.263 INFO:teuthology.orchestra.run.smithi155.stdout: "duration": 0.059409181999999998 2023-08-01T19:55:18.263 INFO:teuthology.orchestra.run.smithi155.stdout: }, 2023-08-01T19:55:18.263 INFO:teuthology.orchestra.run.smithi155.stdout: { 2023-08-01T19:55:18.263 INFO:teuthology.orchestra.run.smithi155.stdout: "event": "commit_sent", 2023-08-01T19:55:18.263 INFO:teuthology.orchestra.run.smithi155.stdout: "time": "2023-08-01T19:55:05.630930+0000", 2023-08-01T19:55:18.263 INFO:teuthology.orchestra.run.smithi155.stdout: "duration": 4.5507999999999999e-05 2023-08-01T19:55:18.263 INFO:teuthology.orchestra.run.smithi155.stdout: }, 2023-08-01T19:55:18.264 INFO:teuthology.orchestra.run.smithi155.stdout: { 2023-08-01T19:55:18.264 INFO:teuthology.orchestra.run.smithi155.stdout: "event": "done", 2023-08-01T19:55:18.264 INFO:teuthology.orchestra.run.smithi155.stdout: "time": "2023-08-01T19:55:05.630975+0000", 2023-08-01T19:55:18.264 INFO:teuthology.orchestra.run.smithi155.stdout: "duration": 4.5441000000000001e-05 2023-08-01T19:55:18.264 INFO:teuthology.orchestra.run.smithi155.stdout: } 2023-08-01T19:55:18.264 INFO:teuthology.orchestra.run.smithi155.stdout: ] 2023-08-01T19:55:18.264 INFO:teuthology.orchestra.run.smithi155.stdout: } 2023-08-01T19:55:18.265 INFO:teuthology.orchestra.run.smithi155.stdout: }, 2023-08-01T19:55:18.265 INFO:teuthology.orchestra.run.smithi155.stdout: { 2023-08-01T19:55:18.265 INFO:teuthology.orchestra.run.smithi155.stdout: "description": "osd_op(client.4668.0:100941 5.e 5:736a6ac6:::benchmark_data_smithi006_114134_object100940:head [set-alloc-hint object_size 65536 write_size 65536,write 0~65536] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e37)", 2023-08-01T19:55:18.265 INFO:teuthology.orchestra.run.smithi155.stdout: "initiated_at": "2023-08-01T19:55:05.569750+0000", 2023-08-01T19:55:18.265 INFO:teuthology.orchestra.run.smithi155.stdout: "age": 12.53782651, 2023-08-01T19:55:18.265 INFO:teuthology.orchestra.run.smithi155.stdout: "duration": 0.065431331999999995, 2023-08-01T19:55:18.265 INFO:teuthology.orchestra.run.smithi155.stdout: "type_data": { 2023-08-01T19:55:18.265 INFO:teuthology.orchestra.run.smithi155.stdout: "flag_point": "commit sent; apply or cleanup", 2023-08-01T19:55:18.266 INFO:teuthology.orchestra.run.smithi155.stdout: "client_info": { 2023-08-01T19:55:18.266 INFO:teuthology.orchestra.run.smithi155.stdout: "client": "client.4668", 2023-08-01T19:55:18.266 INFO:teuthology.orchestra.run.smithi155.stdout: "client_addr": "172.21.15.6:0/1709472247", 2023-08-01T19:55:18.266 INFO:teuthology.orchestra.run.smithi155.stdout: "tid": 100941 2023-08-01T19:55:18.266 INFO:teuthology.orchestra.run.smithi155.stdout: }, 2023-08-01T19:55:18.266 INFO:teuthology.orchestra.run.smithi155.stdout: "events": [ 2023-08-01T19:55:18.266 INFO:teuthology.orchestra.run.smithi155.stdout: { 2023-08-01T19:55:18.266 INFO:teuthology.orchestra.run.smithi155.stdout: "event": "initiated", 2023-08-01T19:55:18.267 INFO:teuthology.orchestra.run.smithi155.stdout: "time": "2023-08-01T19:55:05.569750+0000", 2023-08-01T19:55:18.267 INFO:teuthology.orchestra.run.smithi155.stdout: "duration": 0 2023-08-01T19:55:18.267 INFO:teuthology.orchestra.run.smithi155.stdout: }, 2023-08-01T19:55:18.267 INFO:teuthology.orchestra.run.smithi155.stdout: { 2023-08-01T19:55:18.267 INFO:teuthology.orchestra.run.smithi155.stdout: "event": "throttled", 2023-08-01T19:55:18.267 INFO:teuthology.orchestra.run.smithi155.stdout: "time": "2023-08-01T19:55:05.569750+0000", 2023-08-01T19:55:18.267 INFO:teuthology.orchestra.run.smithi155.stdout: "duration": 0 2023-08-01T19:55:18.267 INFO:teuthology.orchestra.run.smithi155.stdout: }, 2023-08-01T19:55:18.268 INFO:teuthology.orchestra.run.smithi155.stdout: { 2023-08-01T19:55:18.268 INFO:teuthology.orchestra.run.smithi155.stdout: "event": "header_read", 2023-08-01T19:55:18.268 INFO:teuthology.orchestra.run.smithi155.stdout: "time": "2023-08-01T19:55:05.569749+0000", 2023-08-01T19:55:18.268 INFO:teuthology.orchestra.run.smithi155.stdout: "duration": 4294967295.999999 2023-08-01T19:55:18.268 INFO:teuthology.orchestra.run.smithi155.stdout: }, 2023-08-01T19:55:18.268 INFO:teuthology.orchestra.run.smithi155.stdout: { 2023-08-01T19:55:18.268 INFO:teuthology.orchestra.run.smithi155.stdout: "event": "all_read", 2023-08-01T19:55:18.268 INFO:teuthology.orchestra.run.smithi155.stdout: "time": "2023-08-01T19:55:05.569861+0000", 2023-08-01T19:55:18.269 INFO:teuthology.orchestra.run.smithi155.stdout: "duration": 0.000111333 2023-08-01T19:55:18.269 INFO:teuthology.orchestra.run.smithi155.stdout: }, 2023-08-01T19:55:18.269 INFO:teuthology.orchestra.run.smithi155.stdout: { 2023-08-01T19:55:18.269 INFO:teuthology.orchestra.run.smithi155.stdout: "event": "dispatched", 2023-08-01T19:55:18.269 INFO:teuthology.orchestra.run.smithi155.stdout: "time": "2023-08-01T19:55:05.569869+0000", 2023-08-01T19:55:18.269 INFO:teuthology.orchestra.run.smithi155.stdout: "duration": 8.8589999999999994e-06 2023-08-01T19:55:18.269 INFO:teuthology.orchestra.run.smithi155.stdout: }, 2023-08-01T19:55:18.269 INFO:teuthology.orchestra.run.smithi155.stdout: { 2023-08-01T19:55:18.270 INFO:teuthology.orchestra.run.smithi155.stdout: "event": "queued_for_pg", 2023-08-01T19:55:18.270 INFO:teuthology.orchestra.run.smithi155.stdout: "time": "2023-08-01T19:55:05.569874+0000", 2023-08-01T19:55:18.270 INFO:teuthology.orchestra.run.smithi155.stdout: "duration": 4.1679999999999997e-06 2023-08-01T19:55:18.270 INFO:teuthology.orchestra.run.smithi155.stdout: }, 2023-08-01T19:55:18.270 INFO:teuthology.orchestra.run.smithi155.stdout: { 2023-08-01T19:55:18.270 INFO:teuthology.orchestra.run.smithi155.stdout: "event": "reached_pg", 2023-08-01T19:55:18.270 INFO:teuthology.orchestra.run.smithi155.stdout: "time": "2023-08-01T19:55:05.569904+0000", 2023-08-01T19:55:18.270 INFO:teuthology.orchestra.run.smithi155.stdout: "duration": 3.0920999999999998e-05 2023-08-01T19:55:18.271 INFO:teuthology.orchestra.run.smithi155.stdout: }, 2023-08-01T19:55:18.271 INFO:teuthology.orchestra.run.smithi155.stdout: { 2023-08-01T19:55:18.271 INFO:teuthology.orchestra.run.smithi155.stdout: "event": "started", 2023-08-01T19:55:18.271 INFO:teuthology.orchestra.run.smithi155.stdout: "time": "2023-08-01T19:55:05.569998+0000", 2023-08-01T19:55:18.271 INFO:teuthology.orchestra.run.smithi155.stdout: "duration": 9.3086999999999998e-05 2023-08-01T19:55:18.271 INFO:teuthology.orchestra.run.smithi155.stdout: }, 2023-08-01T19:55:18.271 INFO:teuthology.orchestra.run.smithi155.stdout: { 2023-08-01T19:55:18.272 INFO:teuthology.orchestra.run.smithi155.stdout: "event": "waiting for subops from 0", 2023-08-01T19:55:18.272 INFO:teuthology.orchestra.run.smithi155.stdout: "time": "2023-08-01T19:55:05.570093+0000", 2023-08-01T19:55:18.272 INFO:teuthology.orchestra.run.smithi155.stdout: "duration": 9.5768999999999997e-05 2023-08-01T19:55:18.272 INFO:teuthology.orchestra.run.smithi155.stdout: }, 2023-08-01T19:55:18.272 INFO:teuthology.orchestra.run.smithi155.stdout: { 2023-08-01T19:55:18.272 INFO:teuthology.orchestra.run.smithi155.stdout: "event": "op_commit", 2023-08-01T19:55:18.272 INFO:teuthology.orchestra.run.smithi155.stdout: "time": "2023-08-01T19:55:05.572839+0000", 2023-08-01T19:55:18.272 INFO:teuthology.orchestra.run.smithi155.stdout: "duration": 0.0027460050000000001 2023-08-01T19:55:18.273 INFO:teuthology.orchestra.run.smithi155.stdout: }, 2023-08-01T19:55:18.273 INFO:teuthology.orchestra.run.smithi155.stdout: { 2023-08-01T19:55:18.273 INFO:teuthology.orchestra.run.smithi155.stdout: "event": "sub_op_commit_rec", 2023-08-01T19:55:18.273 INFO:teuthology.orchestra.run.smithi155.stdout: "time": "2023-08-01T19:55:05.635114+0000", 2023-08-01T19:55:18.273 INFO:teuthology.orchestra.run.smithi155.stdout: "duration": 0.062274297999999999 2023-08-01T19:55:18.273 INFO:teuthology.orchestra.run.smithi155.stdout: }, 2023-08-01T19:55:18.273 INFO:teuthology.orchestra.run.smithi155.stdout: { 2023-08-01T19:55:18.273 INFO:teuthology.orchestra.run.smithi155.stdout: "event": "commit_sent", 2023-08-01T19:55:18.274 INFO:teuthology.orchestra.run.smithi155.stdout: "time": "2023-08-01T19:55:05.635143+0000", 2023-08-01T19:55:18.274 INFO:teuthology.orchestra.run.smithi155.stdout: "duration": 2.9430000000000001e-05 2023-08-01T19:55:18.274 INFO:teuthology.orchestra.run.smithi155.stdout: }, 2023-08-01T19:55:18.274 INFO:teuthology.orchestra.run.smithi155.stdout: { 2023-08-01T19:55:18.274 INFO:teuthology.orchestra.run.smithi155.stdout: "event": "done", 2023-08-01T19:55:18.274 INFO:teuthology.orchestra.run.smithi155.stdout: "time": "2023-08-01T19:55:05.635181+0000", 2023-08-01T19:55:18.274 INFO:teuthology.orchestra.run.smithi155.stdout: "duration": 3.8352000000000001e-05 2023-08-01T19:55:18.274 INFO:teuthology.orchestra.run.smithi155.stdout: } 2023-08-01T19:55:18.275 INFO:teuthology.orchestra.run.smithi155.stdout: ] 2023-08-01T19:55:18.275 INFO:teuthology.orchestra.run.smithi155.stdout: } 2023-08-01T19:55:18.275 INFO:teuthology.orchestra.run.smithi155.stdout: }, 2023-08-01T19:55:18.275 INFO:teuthology.orchestra.run.smithi155.stdout: { 2023-08-01T19:55:18.275 INFO:teuthology.orchestra.run.smithi155.stdout: "description": "osd_op(client.4668.0:100944 5.4 5:25fae865:::benchmark_data_smithi006_114134_object100943:head [set-alloc-hint object_size 65536 write_size 65536,write 0~65536] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e37)", 2023-08-01T19:55:18.275 INFO:teuthology.orchestra.run.smithi155.stdout: "initiated_at": "2023-08-01T19:55:05.576662+0000", 2023-08-01T19:55:18.275 INFO:teuthology.orchestra.run.smithi155.stdout: "age": 12.530914813000001, 2023-08-01T19:55:18.275 INFO:teuthology.orchestra.run.smithi155.stdout: "duration": 0.056054925999999998, 2023-08-01T19:55:18.276 INFO:teuthology.orchestra.run.smithi155.stdout: "type_data": { 2023-08-01T19:55:18.276 INFO:teuthology.orchestra.run.smithi155.stdout: "flag_point": "commit sent; apply or cleanup", 2023-08-01T19:55:18.276 INFO:teuthology.orchestra.run.smithi155.stdout: "client_info": { 2023-08-01T19:55:18.276 INFO:teuthology.orchestra.run.smithi155.stdout: "client": "client.4668", 2023-08-01T19:55:18.276 INFO:teuthology.orchestra.run.smithi155.stdout: "client_addr": "172.21.15.6:0/1709472247", 2023-08-01T19:55:18.276 INFO:teuthology.orchestra.run.smithi155.stdout: "tid": 100944 2023-08-01T19:55:18.276 INFO:teuthology.orchestra.run.smithi155.stdout: }, 2023-08-01T19:55:18.276 INFO:teuthology.orchestra.run.smithi155.stdout: "events": [ 2023-08-01T19:55:18.277 INFO:teuthology.orchestra.run.smithi155.stdout: { 2023-08-01T19:55:18.277 INFO:teuthology.orchestra.run.smithi155.stdout: "event": "initiated", 2023-08-01T19:55:18.277 INFO:teuthology.orchestra.run.smithi155.stdout: "time": "2023-08-01T19:55:05.576662+0000", 2023-08-01T19:55:18.277 INFO:teuthology.orchestra.run.smithi155.stdout: "duration": 0 2023-08-01T19:55:18.277 INFO:teuthology.orchestra.run.smithi155.stdout: }, 2023-08-01T19:55:18.277 INFO:teuthology.orchestra.run.smithi155.stdout: { 2023-08-01T19:55:18.277 INFO:teuthology.orchestra.run.smithi155.stdout: "event": "throttled", 2023-08-01T19:55:18.277 INFO:teuthology.orchestra.run.smithi155.stdout: "time": "2023-08-01T19:55:05.576662+0000", 2023-08-01T19:55:18.278 INFO:teuthology.orchestra.run.smithi155.stdout: "duration": 0 2023-08-01T19:55:18.278 INFO:teuthology.orchestra.run.smithi155.stdout: }, 2023-08-01T19:55:18.278 INFO:teuthology.orchestra.run.smithi155.stdout: { 2023-08-01T19:55:18.278 INFO:teuthology.orchestra.run.smithi155.stdout: "event": "header_read", 2023-08-01T19:55:18.278 INFO:teuthology.orchestra.run.smithi155.stdout: "time": "2023-08-01T19:55:05.576661+0000", 2023-08-01T19:55:18.278 INFO:teuthology.orchestra.run.smithi155.stdout: "duration": 4294967295.999999 2023-08-01T19:55:18.278 INFO:teuthology.orchestra.run.smithi155.stdout: }, 2023-08-01T19:55:18.279 INFO:teuthology.orchestra.run.smithi155.stdout: { 2023-08-01T19:55:18.279 INFO:teuthology.orchestra.run.smithi155.stdout: "event": "all_read", 2023-08-01T19:55:18.279 INFO:teuthology.orchestra.run.smithi155.stdout: "time": "2023-08-01T19:55:05.576725+0000", 2023-08-01T19:55:18.279 INFO:teuthology.orchestra.run.smithi155.stdout: "duration": 6.4435000000000002e-05 2023-08-01T19:55:18.279 INFO:teuthology.orchestra.run.smithi155.stdout: }, 2023-08-01T19:55:18.279 INFO:teuthology.orchestra.run.smithi155.stdout: { 2023-08-01T19:55:18.279 INFO:teuthology.orchestra.run.smithi155.stdout: "event": "dispatched", 2023-08-01T19:55:18.279 INFO:teuthology.orchestra.run.smithi155.stdout: "time": "2023-08-01T19:55:05.576744+0000", 2023-08-01T19:55:18.280 INFO:teuthology.orchestra.run.smithi155.stdout: "duration": 1.8502999999999999e-05 2023-08-01T19:55:18.280 INFO:teuthology.orchestra.run.smithi155.stdout: }, 2023-08-01T19:55:18.280 INFO:teuthology.orchestra.run.smithi155.stdout: { 2023-08-01T19:55:18.280 INFO:teuthology.orchestra.run.smithi155.stdout: "event": "queued_for_pg", 2023-08-01T19:55:18.280 INFO:teuthology.orchestra.run.smithi155.stdout: "time": "2023-08-01T19:55:05.576772+0000", 2023-08-01T19:55:18.280 INFO:teuthology.orchestra.run.smithi155.stdout: "duration": 2.8354999999999999e-05 2023-08-01T19:55:18.280 INFO:teuthology.orchestra.run.smithi155.stdout: }, 2023-08-01T19:55:18.280 INFO:teuthology.orchestra.run.smithi155.stdout: { 2023-08-01T19:55:18.281 INFO:teuthology.orchestra.run.smithi155.stdout: "event": "reached_pg", 2023-08-01T19:55:18.281 INFO:teuthology.orchestra.run.smithi155.stdout: "time": "2023-08-01T19:55:05.576815+0000", 2023-08-01T19:55:18.281 INFO:teuthology.orchestra.run.smithi155.stdout: "duration": 4.3223999999999998e-05 2023-08-01T19:55:18.281 INFO:teuthology.orchestra.run.smithi155.stdout: }, 2023-08-01T19:55:18.281 INFO:teuthology.orchestra.run.smithi155.stdout: { 2023-08-01T19:55:18.281 INFO:teuthology.orchestra.run.smithi155.stdout: "event": "started", 2023-08-01T19:55:18.281 INFO:teuthology.orchestra.run.smithi155.stdout: "time": "2023-08-01T19:55:05.576961+0000", 2023-08-01T19:55:18.281 INFO:teuthology.orchestra.run.smithi155.stdout: "duration": 0.000145043 2023-08-01T19:55:18.282 INFO:teuthology.orchestra.run.smithi155.stdout: }, 2023-08-01T19:55:18.282 INFO:teuthology.orchestra.run.smithi155.stdout: { 2023-08-01T19:55:18.282 INFO:teuthology.orchestra.run.smithi155.stdout: "event": "waiting for subops from 0", 2023-08-01T19:55:18.282 INFO:teuthology.orchestra.run.smithi155.stdout: "time": "2023-08-01T19:55:05.577343+0000", 2023-08-01T19:55:18.282 INFO:teuthology.orchestra.run.smithi155.stdout: "duration": 0.00038249699999999998 2023-08-01T19:55:18.282 INFO:teuthology.orchestra.run.smithi155.stdout: }, 2023-08-01T19:55:18.282 INFO:teuthology.orchestra.run.smithi155.stdout: { 2023-08-01T19:55:18.282 INFO:teuthology.orchestra.run.smithi155.stdout: "event": "op_commit", 2023-08-01T19:55:18.283 INFO:teuthology.orchestra.run.smithi155.stdout: "time": "2023-08-01T19:55:05.582349+0000", 2023-08-01T19:55:18.283 INFO:teuthology.orchestra.run.smithi155.stdout: "duration": 0.0050062880000000002 2023-08-01T19:55:18.283 INFO:teuthology.orchestra.run.smithi155.stdout: }, 2023-08-01T19:55:18.283 INFO:teuthology.orchestra.run.smithi155.stdout: { 2023-08-01T19:55:18.283 INFO:teuthology.orchestra.run.smithi155.stdout: "event": "sub_op_commit_rec", 2023-08-01T19:55:18.283 INFO:teuthology.orchestra.run.smithi155.stdout: "time": "2023-08-01T19:55:05.632659+0000", 2023-08-01T19:55:18.283 INFO:teuthology.orchestra.run.smithi155.stdout: "duration": 0.050309185999999999 2023-08-01T19:55:18.284 INFO:teuthology.orchestra.run.smithi155.stdout: }, 2023-08-01T19:55:18.284 INFO:teuthology.orchestra.run.smithi155.stdout: { 2023-08-01T19:55:18.284 INFO:teuthology.orchestra.run.smithi155.stdout: "event": "commit_sent", 2023-08-01T19:55:18.284 INFO:teuthology.orchestra.run.smithi155.stdout: "time": "2023-08-01T19:55:05.632692+0000", 2023-08-01T19:55:18.284 INFO:teuthology.orchestra.run.smithi155.stdout: "duration": 3.3077999999999997e-05 2023-08-01T19:55:18.284 INFO:teuthology.orchestra.run.smithi155.stdout: }, 2023-08-01T19:55:18.284 INFO:teuthology.orchestra.run.smithi155.stdout: { 2023-08-01T19:55:18.284 INFO:teuthology.orchestra.run.smithi155.stdout: "event": "done", 2023-08-01T19:55:18.285 INFO:teuthology.orchestra.run.smithi155.stdout: "time": "2023-08-01T19:55:05.632717+0000", 2023-08-01T19:55:18.285 INFO:teuthology.orchestra.run.smithi155.stdout: "duration": 2.5119000000000001e-05 2023-08-01T19:55:18.285 INFO:teuthology.orchestra.run.smithi155.stdout: } 2023-08-01T19:55:18.285 INFO:teuthology.orchestra.run.smithi155.stdout: ] 2023-08-01T19:55:18.285 INFO:teuthology.orchestra.run.smithi155.stdout: } 2023-08-01T19:55:18.285 INFO:teuthology.orchestra.run.smithi155.stdout: }, 2023-08-01T19:55:18.285 INFO:teuthology.orchestra.run.smithi155.stdout: { 2023-08-01T19:55:18.285 INFO:teuthology.orchestra.run.smithi155.stdout: "description": "osd_op(client.4668.0:100945 5.e 5:73df68dd:::benchmark_data_smithi006_114134_object100944:head [set-alloc-hint object_size 65536 write_size 65536,write 0~65536] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e37)", 2023-08-01T19:55:18.286 INFO:teuthology.orchestra.run.smithi155.stdout: "initiated_at": "2023-08-01T19:55:05.576784+0000", 2023-08-01T19:55:18.286 INFO:teuthology.orchestra.run.smithi155.stdout: "age": 12.530792925, 2023-08-01T19:55:18.286 INFO:teuthology.orchestra.run.smithi155.stdout: "duration": 0.058512994999999998, 2023-08-01T19:55:18.286 INFO:teuthology.orchestra.run.smithi155.stdout: "type_data": { 2023-08-01T19:55:18.286 INFO:teuthology.orchestra.run.smithi155.stdout: "flag_point": "commit sent; apply or cleanup", 2023-08-01T19:55:18.286 INFO:teuthology.orchestra.run.smithi155.stdout: "client_info": { 2023-08-01T19:55:18.286 INFO:teuthology.orchestra.run.smithi155.stdout: "client": "client.4668", 2023-08-01T19:55:18.287 INFO:teuthology.orchestra.run.smithi155.stdout: "client_addr": "172.21.15.6:0/1709472247", 2023-08-01T19:55:18.287 INFO:teuthology.orchestra.run.smithi155.stdout: "tid": 100945 2023-08-01T19:55:18.287 INFO:teuthology.orchestra.run.smithi155.stdout: }, 2023-08-01T19:55:18.287 INFO:teuthology.orchestra.run.smithi155.stdout: "events": [ 2023-08-01T19:55:18.287 INFO:teuthology.orchestra.run.smithi155.stdout: { 2023-08-01T19:55:18.287 INFO:teuthology.orchestra.run.smithi155.stdout: "event": "initiated", 2023-08-01T19:55:18.287 INFO:teuthology.orchestra.run.smithi155.stdout: "time": "2023-08-01T19:55:05.576784+0000", 2023-08-01T19:55:18.287 INFO:teuthology.orchestra.run.smithi155.stdout: "duration": 0 2023-08-01T19:55:18.288 INFO:teuthology.orchestra.run.smithi155.stdout: }, 2023-08-01T19:55:18.288 INFO:teuthology.orchestra.run.smithi155.stdout: { 2023-08-01T19:55:18.288 INFO:teuthology.orchestra.run.smithi155.stdout: "event": "throttled", 2023-08-01T19:55:18.288 INFO:teuthology.orchestra.run.smithi155.stdout: "time": "2023-08-01T19:55:05.576784+0000", 2023-08-01T19:55:18.288 INFO:teuthology.orchestra.run.smithi155.stdout: "duration": 0 2023-08-01T19:55:18.288 INFO:teuthology.orchestra.run.smithi155.stdout: }, 2023-08-01T19:55:18.288 INFO:teuthology.orchestra.run.smithi155.stdout: { 2023-08-01T19:55:18.288 INFO:teuthology.orchestra.run.smithi155.stdout: "event": "header_read", 2023-08-01T19:55:18.289 INFO:teuthology.orchestra.run.smithi155.stdout: "time": "2023-08-01T19:55:05.576783+0000", 2023-08-01T19:55:18.289 INFO:teuthology.orchestra.run.smithi155.stdout: "duration": 4294967295.9999995 2023-08-01T19:55:18.289 INFO:teuthology.orchestra.run.smithi155.stdout: }, 2023-08-01T19:55:18.289 INFO:teuthology.orchestra.run.smithi155.stdout: { 2023-08-01T19:55:18.289 INFO:teuthology.orchestra.run.smithi155.stdout: "event": "all_read", 2023-08-01T19:55:18.289 INFO:teuthology.orchestra.run.smithi155.stdout: "time": "2023-08-01T19:55:05.576807+0000", 2023-08-01T19:55:18.289 INFO:teuthology.orchestra.run.smithi155.stdout: "duration": 2.3651000000000001e-05 2023-08-01T19:55:18.289 INFO:teuthology.orchestra.run.smithi155.stdout: }, 2023-08-01T19:55:18.290 INFO:teuthology.orchestra.run.smithi155.stdout: { 2023-08-01T19:55:18.290 INFO:teuthology.orchestra.run.smithi155.stdout: "event": "dispatched", 2023-08-01T19:55:18.290 INFO:teuthology.orchestra.run.smithi155.stdout: "time": "2023-08-01T19:55:05.576817+0000", 2023-08-01T19:55:18.290 INFO:teuthology.orchestra.run.smithi155.stdout: "duration": 9.9389999999999992e-06 2023-08-01T19:55:18.290 INFO:teuthology.orchestra.run.smithi155.stdout: }, 2023-08-01T19:55:18.290 INFO:teuthology.orchestra.run.smithi155.stdout: { 2023-08-01T19:55:18.290 INFO:teuthology.orchestra.run.smithi155.stdout: "event": "queued_for_pg", 2023-08-01T19:55:18.290 INFO:teuthology.orchestra.run.smithi155.stdout: "time": "2023-08-01T19:55:05.576820+0000", 2023-08-01T19:55:18.291 INFO:teuthology.orchestra.run.smithi155.stdout: "duration": 3.2619999999999999e-06 2023-08-01T19:55:18.291 INFO:teuthology.orchestra.run.smithi155.stdout: }, 2023-08-01T19:55:18.291 INFO:teuthology.orchestra.run.smithi155.stdout: { 2023-08-01T19:55:18.291 INFO:teuthology.orchestra.run.smithi155.stdout: "event": "reached_pg", 2023-08-01T19:55:18.291 INFO:teuthology.orchestra.run.smithi155.stdout: "time": "2023-08-01T19:55:05.576849+0000", 2023-08-01T19:55:18.291 INFO:teuthology.orchestra.run.smithi155.stdout: "duration": 2.8880000000000001e-05 2023-08-01T19:55:18.291 INFO:teuthology.orchestra.run.smithi155.stdout: }, 2023-08-01T19:55:18.291 INFO:teuthology.orchestra.run.smithi155.stdout: { 2023-08-01T19:55:18.292 INFO:teuthology.orchestra.run.smithi155.stdout: "event": "started", 2023-08-01T19:55:18.292 INFO:teuthology.orchestra.run.smithi155.stdout: "time": "2023-08-01T19:55:05.576940+0000", 2023-08-01T19:55:18.292 INFO:teuthology.orchestra.run.smithi155.stdout: "duration": 9.0570999999999997e-05 2023-08-01T19:55:18.292 INFO:teuthology.orchestra.run.smithi155.stdout: }, 2023-08-01T19:55:18.292 INFO:teuthology.orchestra.run.smithi155.stdout: { 2023-08-01T19:55:18.292 INFO:teuthology.orchestra.run.smithi155.stdout: "event": "waiting for subops from 0", 2023-08-01T19:55:18.292 INFO:teuthology.orchestra.run.smithi155.stdout: "time": "2023-08-01T19:55:05.577027+0000", 2023-08-01T19:55:18.293 INFO:teuthology.orchestra.run.smithi155.stdout: "duration": 8.7237999999999994e-05 2023-08-01T19:55:18.293 INFO:teuthology.orchestra.run.smithi155.stdout: }, 2023-08-01T19:55:18.293 INFO:teuthology.orchestra.run.smithi155.stdout: { 2023-08-01T19:55:18.293 INFO:teuthology.orchestra.run.smithi155.stdout: "event": "op_commit", 2023-08-01T19:55:18.293 INFO:teuthology.orchestra.run.smithi155.stdout: "time": "2023-08-01T19:55:05.579624+0000", 2023-08-01T19:55:18.293 INFO:teuthology.orchestra.run.smithi155.stdout: "duration": 0.0025971200000000001 2023-08-01T19:55:18.293 INFO:teuthology.orchestra.run.smithi155.stdout: }, 2023-08-01T19:55:18.293 INFO:teuthology.orchestra.run.smithi155.stdout: { 2023-08-01T19:55:18.294 INFO:teuthology.orchestra.run.smithi155.stdout: "event": "sub_op_commit_rec", 2023-08-01T19:55:18.294 INFO:teuthology.orchestra.run.smithi155.stdout: "time": "2023-08-01T19:55:05.635218+0000", 2023-08-01T19:55:18.294 INFO:teuthology.orchestra.run.smithi155.stdout: "duration": 0.055594487999999997 2023-08-01T19:55:18.294 INFO:teuthology.orchestra.run.smithi155.stdout: }, 2023-08-01T19:55:18.294 INFO:teuthology.orchestra.run.smithi155.stdout: { 2023-08-01T19:55:18.294 INFO:teuthology.orchestra.run.smithi155.stdout: "event": "commit_sent", 2023-08-01T19:55:18.294 INFO:teuthology.orchestra.run.smithi155.stdout: "time": "2023-08-01T19:55:05.635262+0000", 2023-08-01T19:55:18.294 INFO:teuthology.orchestra.run.smithi155.stdout: "duration": 4.3380999999999997e-05 2023-08-01T19:55:18.295 INFO:teuthology.orchestra.run.smithi155.stdout: }, 2023-08-01T19:55:18.295 INFO:teuthology.orchestra.run.smithi155.stdout: { 2023-08-01T19:55:18.295 INFO:teuthology.orchestra.run.smithi155.stdout: "event": "done", 2023-08-01T19:55:18.295 INFO:teuthology.orchestra.run.smithi155.stdout: "time": "2023-08-01T19:55:05.635297+0000", 2023-08-01T19:55:18.295 INFO:teuthology.orchestra.run.smithi155.stdout: "duration": 3.4842000000000003e-05 2023-08-01T19:55:18.295 INFO:teuthology.orchestra.run.smithi155.stdout: } 2023-08-01T19:55:18.295 INFO:teuthology.orchestra.run.smithi155.stdout: ] 2023-08-01T19:55:18.295 INFO:teuthology.orchestra.run.smithi155.stdout: } 2023-08-01T19:55:18.296 INFO:teuthology.orchestra.run.smithi155.stdout: }, 2023-08-01T19:55:18.296 INFO:teuthology.orchestra.run.smithi155.stdout: { 2023-08-01T19:55:18.296 INFO:teuthology.orchestra.run.smithi155.stdout: "description": "osd_op(client.4668.0:100947 5.4 5:23e8fc27:::benchmark_data_smithi006_114134_object100946:head [set-alloc-hint object_size 65536 write_size 65536,write 0~65536] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e37)", 2023-08-01T19:55:18.296 INFO:teuthology.orchestra.run.smithi155.stdout: "initiated_at": "2023-08-01T19:55:05.576840+0000", 2023-08-01T19:55:18.296 INFO:teuthology.orchestra.run.smithi155.stdout: "age": 12.53073687, 2023-08-01T19:55:18.296 INFO:teuthology.orchestra.run.smithi155.stdout: "duration": 0.058423127999999998, 2023-08-01T19:55:18.296 INFO:teuthology.orchestra.run.smithi155.stdout: "type_data": { 2023-08-01T19:55:18.296 INFO:teuthology.orchestra.run.smithi155.stdout: "flag_point": "commit sent; apply or cleanup", 2023-08-01T19:55:18.297 INFO:teuthology.orchestra.run.smithi155.stdout: "client_info": { 2023-08-01T19:55:18.297 INFO:teuthology.orchestra.run.smithi155.stdout: "client": "client.4668", 2023-08-01T19:55:18.297 INFO:teuthology.orchestra.run.smithi155.stdout: "client_addr": "172.21.15.6:0/1709472247", 2023-08-01T19:55:18.297 INFO:teuthology.orchestra.run.smithi155.stdout: "tid": 100947 2023-08-01T19:55:18.297 INFO:teuthology.orchestra.run.smithi155.stdout: }, 2023-08-01T19:55:18.297 INFO:teuthology.orchestra.run.smithi155.stdout: "events": [ 2023-08-01T19:55:18.297 INFO:teuthology.orchestra.run.smithi155.stdout: { 2023-08-01T19:55:18.297 INFO:teuthology.orchestra.run.smithi155.stdout: "event": "initiated", 2023-08-01T19:55:18.298 INFO:teuthology.orchestra.run.smithi155.stdout: "time": "2023-08-01T19:55:05.576840+0000", 2023-08-01T19:55:18.298 INFO:teuthology.orchestra.run.smithi155.stdout: "duration": 0 2023-08-01T19:55:18.298 INFO:teuthology.orchestra.run.smithi155.stdout: }, 2023-08-01T19:55:18.298 INFO:teuthology.orchestra.run.smithi155.stdout: { 2023-08-01T19:55:18.298 INFO:teuthology.orchestra.run.smithi155.stdout: "event": "throttled", 2023-08-01T19:55:18.298 INFO:teuthology.orchestra.run.smithi155.stdout: "time": "2023-08-01T19:55:05.576840+0000", 2023-08-01T19:55:18.298 INFO:teuthology.orchestra.run.smithi155.stdout: "duration": 0 2023-08-01T19:55:18.298 INFO:teuthology.orchestra.run.smithi155.stdout: }, 2023-08-01T19:55:18.299 INFO:teuthology.orchestra.run.smithi155.stdout: { 2023-08-01T19:55:18.299 INFO:teuthology.orchestra.run.smithi155.stdout: "event": "header_read", 2023-08-01T19:55:18.299 INFO:teuthology.orchestra.run.smithi155.stdout: "time": "2023-08-01T19:55:05.576839+0000", 2023-08-01T19:55:18.299 INFO:teuthology.orchestra.run.smithi155.stdout: "duration": 4294967295.9999995 2023-08-01T19:55:18.299 INFO:teuthology.orchestra.run.smithi155.stdout: }, 2023-08-01T19:55:18.299 INFO:teuthology.orchestra.run.smithi155.stdout: { 2023-08-01T19:55:18.299 INFO:teuthology.orchestra.run.smithi155.stdout: "event": "all_read", 2023-08-01T19:55:18.299 INFO:teuthology.orchestra.run.smithi155.stdout: "time": "2023-08-01T19:55:05.576893+0000", 2023-08-01T19:55:18.300 INFO:teuthology.orchestra.run.smithi155.stdout: "duration": 5.3893000000000001e-05 2023-08-01T19:55:18.300 INFO:teuthology.orchestra.run.smithi155.stdout: }, 2023-08-01T19:55:18.300 INFO:teuthology.orchestra.run.smithi155.stdout: { 2023-08-01T19:55:18.300 INFO:teuthology.orchestra.run.smithi155.stdout: "event": "dispatched", 2023-08-01T19:55:18.300 INFO:teuthology.orchestra.run.smithi155.stdout: "time": "2023-08-01T19:55:05.576902+0000", 2023-08-01T19:55:18.300 INFO:teuthology.orchestra.run.smithi155.stdout: "duration": 8.7520000000000002e-06 2023-08-01T19:55:18.300 INFO:teuthology.orchestra.run.smithi155.stdout: }, 2023-08-01T19:55:18.301 INFO:teuthology.orchestra.run.smithi155.stdout: { 2023-08-01T19:55:18.301 INFO:teuthology.orchestra.run.smithi155.stdout: "event": "queued_for_pg", 2023-08-01T19:55:18.301 INFO:teuthology.orchestra.run.smithi155.stdout: "time": "2023-08-01T19:55:05.576905+0000", 2023-08-01T19:55:18.301 INFO:teuthology.orchestra.run.smithi155.stdout: "duration": 3.01e-06 2023-08-01T19:55:18.301 INFO:teuthology.orchestra.run.smithi155.stdout: }, 2023-08-01T19:55:18.301 INFO:teuthology.orchestra.run.smithi155.stdout: { 2023-08-01T19:55:18.301 INFO:teuthology.orchestra.run.smithi155.stdout: "event": "reached_pg", 2023-08-01T19:55:18.301 INFO:teuthology.orchestra.run.smithi155.stdout: "time": "2023-08-01T19:55:05.579641+0000", 2023-08-01T19:55:18.302 INFO:teuthology.orchestra.run.smithi155.stdout: "duration": 0.0027366880000000001 2023-08-01T19:55:18.302 INFO:teuthology.orchestra.run.smithi155.stdout: }, 2023-08-01T19:55:18.302 INFO:teuthology.orchestra.run.smithi155.stdout: { 2023-08-01T19:55:18.302 INFO:teuthology.orchestra.run.smithi155.stdout: "event": "started", 2023-08-01T19:55:18.302 INFO:teuthology.orchestra.run.smithi155.stdout: "time": "2023-08-01T19:55:05.579734+0000", 2023-08-01T19:55:18.302 INFO:teuthology.orchestra.run.smithi155.stdout: "duration": 9.2590000000000006e-05 2023-08-01T19:55:18.302 INFO:teuthology.orchestra.run.smithi155.stdout: }, 2023-08-01T19:55:18.302 INFO:teuthology.orchestra.run.smithi155.stdout: { 2023-08-01T19:55:18.303 INFO:teuthology.orchestra.run.smithi155.stdout: "event": "waiting for subops from 0", 2023-08-01T19:55:18.303 INFO:teuthology.orchestra.run.smithi155.stdout: "time": "2023-08-01T19:55:05.579825+0000", 2023-08-01T19:55:18.303 INFO:teuthology.orchestra.run.smithi155.stdout: "duration": 9.0964999999999994e-05 2023-08-01T19:55:18.303 INFO:teuthology.orchestra.run.smithi155.stdout: }, 2023-08-01T19:55:18.303 INFO:teuthology.orchestra.run.smithi155.stdout: { 2023-08-01T19:55:18.303 INFO:teuthology.orchestra.run.smithi155.stdout: "event": "op_commit", 2023-08-01T19:55:18.303 INFO:teuthology.orchestra.run.smithi155.stdout: "time": "2023-08-01T19:55:05.585041+0000", 2023-08-01T19:55:18.303 INFO:teuthology.orchestra.run.smithi155.stdout: "duration": 0.0052159670000000002 2023-08-01T19:55:18.304 INFO:teuthology.orchestra.run.smithi155.stdout: }, 2023-08-01T19:55:18.304 INFO:teuthology.orchestra.run.smithi155.stdout: { 2023-08-01T19:55:18.304 INFO:teuthology.orchestra.run.smithi155.stdout: "event": "sub_op_commit_rec", 2023-08-01T19:55:18.304 INFO:teuthology.orchestra.run.smithi155.stdout: "time": "2023-08-01T19:55:05.635199+0000", 2023-08-01T19:55:18.304 INFO:teuthology.orchestra.run.smithi155.stdout: "duration": 0.050158023000000003 2023-08-01T19:55:18.304 INFO:teuthology.orchestra.run.smithi155.stdout: }, 2023-08-01T19:55:18.304 INFO:teuthology.orchestra.run.smithi155.stdout: { 2023-08-01T19:55:18.304 INFO:teuthology.orchestra.run.smithi155.stdout: "event": "commit_sent", 2023-08-01T19:55:18.305 INFO:teuthology.orchestra.run.smithi155.stdout: "time": "2023-08-01T19:55:05.635227+0000", 2023-08-01T19:55:18.305 INFO:teuthology.orchestra.run.smithi155.stdout: "duration": 2.7821e-05 2023-08-01T19:55:18.305 INFO:teuthology.orchestra.run.smithi155.stdout: }, 2023-08-01T19:55:18.305 INFO:teuthology.orchestra.run.smithi155.stdout: { 2023-08-01T19:55:18.305 INFO:teuthology.orchestra.run.smithi155.stdout: "event": "done", 2023-08-01T19:55:18.305 INFO:teuthology.orchestra.run.smithi155.stdout: "time": "2023-08-01T19:55:05.635263+0000", 2023-08-01T19:55:18.305 INFO:teuthology.orchestra.run.smithi155.stdout: "duration": 3.6081000000000002e-05 2023-08-01T19:55:18.305 INFO:teuthology.orchestra.run.smithi155.stdout: } 2023-08-01T19:55:18.306 INFO:teuthology.orchestra.run.smithi155.stdout: ] 2023-08-01T19:55:18.306 INFO:teuthology.orchestra.run.smithi155.stdout: } 2023-08-01T19:55:18.306 INFO:teuthology.orchestra.run.smithi155.stdout: } 2023-08-01T19:55:18.306 INFO:teuthology.orchestra.run.smithi155.stdout: ] 2023-08-01T19:55:18.306 INFO:teuthology.orchestra.run.smithi155.stdout:} 2023-08-01T19:55:18.307 INFO:tasks.ceph.osd.0.smithi008.stderr:2023-08-01T19:55:18.305+0000 7f16a58f4700 -1 received signal: Hangup from /usr/bin/python3 /bin/daemon-helper kill ceph-osd -f --cluster ceph -i 0 (PID: 111179) UID: 0 2023-08-01T19:55:18.308 DEBUG:teuthology.orchestra.run.smithi008:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 30 ceph --cluster ceph --admin-daemon /var/run/ceph/ceph-osd.0.asok dump_ops_in_flight 2023-08-01T19:55:18.317 INFO:tasks.radosbench.radosbench.0.smithi006.stdout: 54 16 122719 122703 142.005 118.875 0.00911753 0.00703916 2023-08-01T19:55:18.408 INFO:tasks.ceph.osd.2.smithi155.stderr:2023-08-01T19:55:18.407+0000 7faa5c6ac700 -1 received signal: Hangup from /usr/bin/python3 /bin/daemon-helper kill ceph-osd -f --cluster ceph -i 2 (PID: 111337) UID: 0 2023-08-01T19:55:18.496 INFO:teuthology.orchestra.run.smithi008.stdout:{ 2023-08-01T19:55:18.496 INFO:teuthology.orchestra.run.smithi008.stdout: "ops": [ 2023-08-01T19:55:18.496 INFO:teuthology.orchestra.run.smithi008.stdout: { 2023-08-01T19:55:18.496 INFO:teuthology.orchestra.run.smithi008.stdout: "description": "osd_repop(client.4668.0:123005 5.0 e43/19 5:0e0bdb7b:::benchmark_data_smithi006_114134_object123004:head v 43'7826, mlcod=43'7822)", 2023-08-01T19:55:18.497 INFO:teuthology.orchestra.run.smithi008.stdout: "initiated_at": "2023-08-01T19:55:18.487013+0000", 2023-08-01T19:55:18.497 INFO:teuthology.orchestra.run.smithi008.stdout: "age": 0.0063275069999999996, 2023-08-01T19:55:18.497 INFO:teuthology.orchestra.run.smithi008.stdout: "duration": 0.0063594669999999997, 2023-08-01T19:55:18.497 INFO:teuthology.orchestra.run.smithi008.stdout: "type_data": { 2023-08-01T19:55:18.497 INFO:teuthology.orchestra.run.smithi008.stdout: "flag_point": "started", 2023-08-01T19:55:18.497 INFO:teuthology.orchestra.run.smithi008.stdout: "events": [ 2023-08-01T19:55:18.497 INFO:teuthology.orchestra.run.smithi008.stdout: { 2023-08-01T19:55:18.498 INFO:teuthology.orchestra.run.smithi008.stdout: "event": "initiated", 2023-08-01T19:55:18.498 INFO:teuthology.orchestra.run.smithi008.stdout: "time": "2023-08-01T19:55:18.487013+0000", 2023-08-01T19:55:18.498 INFO:teuthology.orchestra.run.smithi008.stdout: "duration": 0 2023-08-01T19:55:18.498 INFO:teuthology.orchestra.run.smithi008.stdout: }, 2023-08-01T19:55:18.498 INFO:teuthology.orchestra.run.smithi008.stdout: { 2023-08-01T19:55:18.498 INFO:teuthology.orchestra.run.smithi008.stdout: "event": "throttled", 2023-08-01T19:55:18.498 INFO:teuthology.orchestra.run.smithi008.stdout: "time": "2023-08-01T19:55:18.487013+0000", 2023-08-01T19:55:18.498 INFO:teuthology.orchestra.run.smithi008.stdout: "duration": 0 2023-08-01T19:55:18.499 INFO:teuthology.orchestra.run.smithi008.stdout: }, 2023-08-01T19:55:18.499 INFO:teuthology.orchestra.run.smithi008.stdout: { 2023-08-01T19:55:18.499 INFO:teuthology.orchestra.run.smithi008.stdout: "event": "header_read", 2023-08-01T19:55:18.499 INFO:teuthology.orchestra.run.smithi008.stdout: "time": "2023-08-01T19:55:18.487013+0000", 2023-08-01T19:55:18.499 INFO:teuthology.orchestra.run.smithi008.stdout: "duration": 4294967295.9999995 2023-08-01T19:55:18.499 INFO:teuthology.orchestra.run.smithi008.stdout: }, 2023-08-01T19:55:18.499 INFO:teuthology.orchestra.run.smithi008.stdout: { 2023-08-01T19:55:18.499 INFO:teuthology.orchestra.run.smithi008.stdout: "event": "all_read", 2023-08-01T19:55:18.500 INFO:teuthology.orchestra.run.smithi008.stdout: "time": "2023-08-01T19:55:18.487093+0000", 2023-08-01T19:55:18.500 INFO:teuthology.orchestra.run.smithi008.stdout: "duration": 8.0292999999999998e-05 2023-08-01T19:55:18.500 INFO:teuthology.orchestra.run.smithi008.stdout: }, 2023-08-01T19:55:18.500 INFO:teuthology.orchestra.run.smithi008.stdout: { 2023-08-01T19:55:18.500 INFO:teuthology.orchestra.run.smithi008.stdout: "event": "dispatched", 2023-08-01T19:55:18.500 INFO:teuthology.orchestra.run.smithi008.stdout: "time": "2023-08-01T19:55:18.487098+0000", 2023-08-01T19:55:18.500 INFO:teuthology.orchestra.run.smithi008.stdout: "duration": 5.4229999999999996e-06 2023-08-01T19:55:18.501 INFO:teuthology.orchestra.run.smithi008.stdout: }, 2023-08-01T19:55:18.501 INFO:teuthology.orchestra.run.smithi008.stdout: { 2023-08-01T19:55:18.501 INFO:teuthology.orchestra.run.smithi008.stdout: "event": "queued_for_pg", 2023-08-01T19:55:18.501 INFO:teuthology.orchestra.run.smithi008.stdout: "time": "2023-08-01T19:55:18.487105+0000", 2023-08-01T19:55:18.501 INFO:teuthology.orchestra.run.smithi008.stdout: "duration": 6.63e-06 2023-08-01T19:55:18.501 INFO:teuthology.orchestra.run.smithi008.stdout: }, 2023-08-01T19:55:18.501 INFO:teuthology.orchestra.run.smithi008.stdout: { 2023-08-01T19:55:18.501 INFO:teuthology.orchestra.run.smithi008.stdout: "event": "reached_pg", 2023-08-01T19:55:18.502 INFO:teuthology.orchestra.run.smithi008.stdout: "time": "2023-08-01T19:55:18.488869+0000", 2023-08-01T19:55:18.502 INFO:teuthology.orchestra.run.smithi008.stdout: "duration": 0.0017635870000000001 2023-08-01T19:55:18.502 INFO:teuthology.orchestra.run.smithi008.stdout: }, 2023-08-01T19:55:18.502 INFO:teuthology.orchestra.run.smithi008.stdout: { 2023-08-01T19:55:18.502 INFO:teuthology.orchestra.run.smithi008.stdout: "event": "started", 2023-08-01T19:55:18.502 INFO:teuthology.orchestra.run.smithi008.stdout: "time": "2023-08-01T19:55:18.488880+0000", 2023-08-01T19:55:18.502 INFO:teuthology.orchestra.run.smithi008.stdout: "duration": 1.1139e-05 2023-08-01T19:55:18.502 INFO:teuthology.orchestra.run.smithi008.stdout: } 2023-08-01T19:55:18.503 INFO:teuthology.orchestra.run.smithi008.stdout: ] 2023-08-01T19:55:18.503 INFO:teuthology.orchestra.run.smithi008.stdout: } 2023-08-01T19:55:18.503 INFO:teuthology.orchestra.run.smithi008.stdout: }, 2023-08-01T19:55:18.503 INFO:teuthology.orchestra.run.smithi008.stdout: { 2023-08-01T19:55:18.503 INFO:teuthology.orchestra.run.smithi008.stdout: "description": "osd_op(client.4668.0:123006 5.3 5:c27dac8b:::benchmark_data_smithi006_114134_object123005:head [set-alloc-hint object_size 65536 write_size 65536,write 0~65536 in=65536b] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e43)", 2023-08-01T19:55:18.504 INFO:teuthology.orchestra.run.smithi008.stdout: "initiated_at": "2023-08-01T19:55:18.488645+0000", 2023-08-01T19:55:18.504 INFO:teuthology.orchestra.run.smithi008.stdout: "age": 0.0046956999999999997, 2023-08-01T19:55:18.504 INFO:teuthology.orchestra.run.smithi008.stdout: "duration": 0.0048100460000000001, 2023-08-01T19:55:18.504 INFO:teuthology.orchestra.run.smithi008.stdout: "type_data": { 2023-08-01T19:55:18.504 INFO:teuthology.orchestra.run.smithi008.stdout: "flag_point": "waiting for sub ops", 2023-08-01T19:55:18.504 INFO:teuthology.orchestra.run.smithi008.stdout: "client_info": { 2023-08-01T19:55:18.505 INFO:teuthology.orchestra.run.smithi008.stdout: "client": "client.4668", 2023-08-01T19:55:18.505 INFO:teuthology.orchestra.run.smithi008.stdout: "client_addr": "172.21.15.6:0/1709472247", 2023-08-01T19:55:18.505 INFO:teuthology.orchestra.run.smithi008.stdout: "tid": 123006 2023-08-01T19:55:18.505 INFO:teuthology.orchestra.run.smithi008.stdout: }, 2023-08-01T19:55:18.505 INFO:teuthology.orchestra.run.smithi008.stdout: "events": [ 2023-08-01T19:55:18.505 INFO:teuthology.orchestra.run.smithi008.stdout: { 2023-08-01T19:55:18.505 INFO:teuthology.orchestra.run.smithi008.stdout: "event": "initiated", 2023-08-01T19:55:18.505 INFO:teuthology.orchestra.run.smithi008.stdout: "time": "2023-08-01T19:55:18.488645+0000", 2023-08-01T19:55:18.506 INFO:teuthology.orchestra.run.smithi008.stdout: "duration": 0 2023-08-01T19:55:18.506 INFO:teuthology.orchestra.run.smithi008.stdout: }, 2023-08-01T19:55:18.506 INFO:teuthology.orchestra.run.smithi008.stdout: { 2023-08-01T19:55:18.506 INFO:teuthology.orchestra.run.smithi008.stdout: "event": "throttled", 2023-08-01T19:55:18.506 INFO:teuthology.orchestra.run.smithi008.stdout: "time": "2023-08-01T19:55:18.488645+0000", 2023-08-01T19:55:18.506 INFO:teuthology.orchestra.run.smithi008.stdout: "duration": 0 2023-08-01T19:55:18.506 INFO:teuthology.orchestra.run.smithi008.stdout: }, 2023-08-01T19:55:18.506 INFO:teuthology.orchestra.run.smithi008.stdout: { 2023-08-01T19:55:18.507 INFO:teuthology.orchestra.run.smithi008.stdout: "event": "header_read", 2023-08-01T19:55:18.507 INFO:teuthology.orchestra.run.smithi008.stdout: "time": "2023-08-01T19:55:18.488644+0000", 2023-08-01T19:55:18.507 INFO:teuthology.orchestra.run.smithi008.stdout: "duration": 4294967295.999999 2023-08-01T19:55:18.507 INFO:teuthology.orchestra.run.smithi008.stdout: }, 2023-08-01T19:55:18.507 INFO:teuthology.orchestra.run.smithi008.stdout: { 2023-08-01T19:55:18.507 INFO:teuthology.orchestra.run.smithi008.stdout: "event": "all_read", 2023-08-01T19:55:18.508 INFO:teuthology.orchestra.run.smithi008.stdout: "time": "2023-08-01T19:55:18.488695+0000", 2023-08-01T19:55:18.508 INFO:teuthology.orchestra.run.smithi008.stdout: "duration": 5.0435000000000001e-05 2023-08-01T19:55:18.508 INFO:teuthology.orchestra.run.smithi008.stdout: }, 2023-08-01T19:55:18.508 INFO:teuthology.orchestra.run.smithi008.stdout: { 2023-08-01T19:55:18.508 INFO:teuthology.orchestra.run.smithi008.stdout: "event": "dispatched", 2023-08-01T19:55:18.508 INFO:teuthology.orchestra.run.smithi008.stdout: "time": "2023-08-01T19:55:18.488713+0000", 2023-08-01T19:55:18.508 INFO:teuthology.orchestra.run.smithi008.stdout: "duration": 1.8624e-05 2023-08-01T19:55:18.509 INFO:teuthology.orchestra.run.smithi008.stdout: }, 2023-08-01T19:55:18.509 INFO:teuthology.orchestra.run.smithi008.stdout: { 2023-08-01T19:55:18.509 INFO:teuthology.orchestra.run.smithi008.stdout: "event": "queued_for_pg", 2023-08-01T19:55:18.509 INFO:teuthology.orchestra.run.smithi008.stdout: "time": "2023-08-01T19:55:18.488718+0000", 2023-08-01T19:55:18.509 INFO:teuthology.orchestra.run.smithi008.stdout: "duration": 4.916e-06 2023-08-01T19:55:18.509 INFO:teuthology.orchestra.run.smithi008.stdout: }, 2023-08-01T19:55:18.509 INFO:teuthology.orchestra.run.smithi008.stdout: { 2023-08-01T19:55:18.510 INFO:teuthology.orchestra.run.smithi008.stdout: "event": "reached_pg", 2023-08-01T19:55:18.510 INFO:teuthology.orchestra.run.smithi008.stdout: "time": "2023-08-01T19:55:18.488755+0000", 2023-08-01T19:55:18.510 INFO:teuthology.orchestra.run.smithi008.stdout: "duration": 3.7307e-05 2023-08-01T19:55:18.510 INFO:teuthology.orchestra.run.smithi008.stdout: }, 2023-08-01T19:55:18.510 INFO:teuthology.orchestra.run.smithi008.stdout: { 2023-08-01T19:55:18.510 INFO:teuthology.orchestra.run.smithi008.stdout: "event": "started", 2023-08-01T19:55:18.510 INFO:teuthology.orchestra.run.smithi008.stdout: "time": "2023-08-01T19:55:18.488865+0000", 2023-08-01T19:55:18.510 INFO:teuthology.orchestra.run.smithi008.stdout: "duration": 0.000110022 2023-08-01T19:55:18.511 INFO:teuthology.orchestra.run.smithi008.stdout: }, 2023-08-01T19:55:18.511 INFO:teuthology.orchestra.run.smithi008.stdout: { 2023-08-01T19:55:18.511 INFO:teuthology.orchestra.run.smithi008.stdout: "event": "waiting for subops from 1", 2023-08-01T19:55:18.511 INFO:teuthology.orchestra.run.smithi008.stdout: "time": "2023-08-01T19:55:18.489041+0000", 2023-08-01T19:55:18.511 INFO:teuthology.orchestra.run.smithi008.stdout: "duration": 0.00017583900000000001 2023-08-01T19:55:18.511 INFO:teuthology.orchestra.run.smithi008.stdout: } 2023-08-01T19:55:18.511 INFO:teuthology.orchestra.run.smithi008.stdout: ] 2023-08-01T19:55:18.511 INFO:teuthology.orchestra.run.smithi008.stdout: } 2023-08-01T19:55:18.512 INFO:teuthology.orchestra.run.smithi008.stdout: }, 2023-08-01T19:55:18.512 INFO:teuthology.orchestra.run.smithi008.stdout: { 2023-08-01T19:55:18.512 INFO:teuthology.orchestra.run.smithi008.stdout: "description": "osd_op(client.4668.0:123007 5.2 5:428a60b4:::benchmark_data_smithi006_114134_object123006:head [set-alloc-hint object_size 65536 write_size 65536,write 0~65536 in=65536b] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e43)", 2023-08-01T19:55:18.512 INFO:teuthology.orchestra.run.smithi008.stdout: "initiated_at": "2023-08-01T19:55:18.488727+0000", 2023-08-01T19:55:18.512 INFO:teuthology.orchestra.run.smithi008.stdout: "age": 0.0046138209999999997, 2023-08-01T19:55:18.512 INFO:teuthology.orchestra.run.smithi008.stdout: "duration": 0.0048124600000000002, 2023-08-01T19:55:18.512 INFO:teuthology.orchestra.run.smithi008.stdout: "type_data": { 2023-08-01T19:55:18.513 INFO:teuthology.orchestra.run.smithi008.stdout: "flag_point": "waiting for sub ops", 2023-08-01T19:55:18.513 INFO:teuthology.orchestra.run.smithi008.stdout: "client_info": { 2023-08-01T19:55:18.513 INFO:teuthology.orchestra.run.smithi008.stdout: "client": "client.4668", 2023-08-01T19:55:18.513 INFO:teuthology.orchestra.run.smithi008.stdout: "client_addr": "172.21.15.6:0/1709472247", 2023-08-01T19:55:18.513 INFO:teuthology.orchestra.run.smithi008.stdout: "tid": 123007 2023-08-01T19:55:18.513 INFO:teuthology.orchestra.run.smithi008.stdout: }, 2023-08-01T19:55:18.513 INFO:teuthology.orchestra.run.smithi008.stdout: "events": [ 2023-08-01T19:55:18.514 INFO:teuthology.orchestra.run.smithi008.stdout: { 2023-08-01T19:55:18.514 INFO:teuthology.orchestra.run.smithi008.stdout: "event": "initiated", 2023-08-01T19:55:18.514 INFO:teuthology.orchestra.run.smithi008.stdout: "time": "2023-08-01T19:55:18.488727+0000", 2023-08-01T19:55:18.514 INFO:teuthology.orchestra.run.smithi008.stdout: "duration": 0 2023-08-01T19:55:18.514 INFO:teuthology.orchestra.run.smithi008.stdout: }, 2023-08-01T19:55:18.514 INFO:teuthology.orchestra.run.smithi008.stdout: { 2023-08-01T19:55:18.514 INFO:teuthology.orchestra.run.smithi008.stdout: "event": "throttled", 2023-08-01T19:55:18.514 INFO:teuthology.orchestra.run.smithi008.stdout: "time": "2023-08-01T19:55:18.488727+0000", 2023-08-01T19:55:18.515 INFO:teuthology.orchestra.run.smithi008.stdout: "duration": 0 2023-08-01T19:55:18.515 INFO:teuthology.orchestra.run.smithi008.stdout: }, 2023-08-01T19:55:18.515 INFO:teuthology.orchestra.run.smithi008.stdout: { 2023-08-01T19:55:18.515 INFO:teuthology.orchestra.run.smithi008.stdout: "event": "header_read", 2023-08-01T19:55:18.515 INFO:teuthology.orchestra.run.smithi008.stdout: "time": "2023-08-01T19:55:18.488727+0000", 2023-08-01T19:55:18.515 INFO:teuthology.orchestra.run.smithi008.stdout: "duration": 4294967295.9999995 2023-08-01T19:55:18.515 INFO:teuthology.orchestra.run.smithi008.stdout: }, 2023-08-01T19:55:18.515 INFO:teuthology.orchestra.run.smithi008.stdout: { 2023-08-01T19:55:18.516 INFO:teuthology.orchestra.run.smithi008.stdout: "event": "all_read", 2023-08-01T19:55:18.516 INFO:teuthology.orchestra.run.smithi008.stdout: "time": "2023-08-01T19:55:18.488752+0000", 2023-08-01T19:55:18.516 INFO:teuthology.orchestra.run.smithi008.stdout: "duration": 2.5947000000000001e-05 2023-08-01T19:55:18.516 INFO:teuthology.orchestra.run.smithi008.stdout: }, 2023-08-01T19:55:18.516 INFO:teuthology.orchestra.run.smithi008.stdout: { 2023-08-01T19:55:18.516 INFO:teuthology.orchestra.run.smithi008.stdout: "event": "dispatched", 2023-08-01T19:55:18.516 INFO:teuthology.orchestra.run.smithi008.stdout: "time": "2023-08-01T19:55:18.488758+0000", 2023-08-01T19:55:18.516 INFO:teuthology.orchestra.run.smithi008.stdout: "duration": 5.1490000000000002e-06 2023-08-01T19:55:18.517 INFO:teuthology.orchestra.run.smithi008.stdout: }, 2023-08-01T19:55:18.517 INFO:teuthology.orchestra.run.smithi008.stdout: { 2023-08-01T19:55:18.517 INFO:teuthology.orchestra.run.smithi008.stdout: "event": "queued_for_pg", 2023-08-01T19:55:18.517 INFO:teuthology.orchestra.run.smithi008.stdout: "time": "2023-08-01T19:55:18.488761+0000", 2023-08-01T19:55:18.517 INFO:teuthology.orchestra.run.smithi008.stdout: "duration": 3.0690000000000002e-06 2023-08-01T19:55:18.517 INFO:teuthology.orchestra.run.smithi008.stdout: }, 2023-08-01T19:55:18.517 INFO:teuthology.orchestra.run.smithi008.stdout: { 2023-08-01T19:55:18.518 INFO:teuthology.orchestra.run.smithi008.stdout: "event": "reached_pg", 2023-08-01T19:55:18.518 INFO:teuthology.orchestra.run.smithi008.stdout: "time": "2023-08-01T19:55:18.488793+0000", 2023-08-01T19:55:18.518 INFO:teuthology.orchestra.run.smithi008.stdout: "duration": 3.2410000000000003e-05 2023-08-01T19:55:18.518 INFO:teuthology.orchestra.run.smithi008.stdout: }, 2023-08-01T19:55:18.518 INFO:teuthology.orchestra.run.smithi008.stdout: { 2023-08-01T19:55:18.518 INFO:teuthology.orchestra.run.smithi008.stdout: "event": "started", 2023-08-01T19:55:18.518 INFO:teuthology.orchestra.run.smithi008.stdout: "time": "2023-08-01T19:55:18.488906+0000", 2023-08-01T19:55:18.519 INFO:teuthology.orchestra.run.smithi008.stdout: "duration": 0.000112466 2023-08-01T19:55:18.519 INFO:teuthology.orchestra.run.smithi008.stdout: }, 2023-08-01T19:55:18.519 INFO:teuthology.orchestra.run.smithi008.stdout: { 2023-08-01T19:55:18.519 INFO:teuthology.orchestra.run.smithi008.stdout: "event": "waiting for subops from 1", 2023-08-01T19:55:18.519 INFO:teuthology.orchestra.run.smithi008.stdout: "time": "2023-08-01T19:55:18.489080+0000", 2023-08-01T19:55:18.519 INFO:teuthology.orchestra.run.smithi008.stdout: "duration": 0.00017436599999999999 2023-08-01T19:55:18.519 INFO:teuthology.orchestra.run.smithi008.stdout: }, 2023-08-01T19:55:18.519 INFO:teuthology.orchestra.run.smithi008.stdout: { 2023-08-01T19:55:18.520 INFO:teuthology.orchestra.run.smithi008.stdout: "event": "sub_op_commit_rec", 2023-08-01T19:55:18.520 INFO:teuthology.orchestra.run.smithi008.stdout: "time": "2023-08-01T19:55:18.493395+0000", 2023-08-01T19:55:18.520 INFO:teuthology.orchestra.run.smithi008.stdout: "duration": 0.00431505 2023-08-01T19:55:18.520 INFO:teuthology.orchestra.run.smithi008.stdout: } 2023-08-01T19:55:18.520 INFO:teuthology.orchestra.run.smithi008.stdout: ] 2023-08-01T19:55:18.520 INFO:teuthology.orchestra.run.smithi008.stdout: } 2023-08-01T19:55:18.520 INFO:teuthology.orchestra.run.smithi008.stdout: }, 2023-08-01T19:55:18.521 INFO:teuthology.orchestra.run.smithi008.stdout: { 2023-08-01T19:55:18.521 INFO:teuthology.orchestra.run.smithi008.stdout: "description": "osd_repop(client.4668.0:123009 5.4 e43/19 5:245bc09c:::benchmark_data_smithi006_114134_object123008:head v 43'7573, mlcod=43'7571)", 2023-08-01T19:55:18.521 INFO:teuthology.orchestra.run.smithi008.stdout: "initiated_at": "2023-08-01T19:55:18.489391+0000", 2023-08-01T19:55:18.521 INFO:teuthology.orchestra.run.smithi008.stdout: "age": 0.0039495370000000004, 2023-08-01T19:55:18.521 INFO:teuthology.orchestra.run.smithi008.stdout: "duration": 0.0042429219999999997, 2023-08-01T19:55:18.521 INFO:teuthology.orchestra.run.smithi008.stdout: "type_data": { 2023-08-01T19:55:18.521 INFO:teuthology.orchestra.run.smithi008.stdout: "flag_point": "started", 2023-08-01T19:55:18.521 INFO:teuthology.orchestra.run.smithi008.stdout: "events": [ 2023-08-01T19:55:18.522 INFO:teuthology.orchestra.run.smithi008.stdout: { 2023-08-01T19:55:18.522 INFO:teuthology.orchestra.run.smithi008.stdout: "event": "initiated", 2023-08-01T19:55:18.522 INFO:teuthology.orchestra.run.smithi008.stdout: "time": "2023-08-01T19:55:18.489391+0000", 2023-08-01T19:55:18.522 INFO:teuthology.orchestra.run.smithi008.stdout: "duration": 0 2023-08-01T19:55:18.522 INFO:teuthology.orchestra.run.smithi008.stdout: }, 2023-08-01T19:55:18.522 INFO:teuthology.orchestra.run.smithi008.stdout: { 2023-08-01T19:55:18.522 INFO:teuthology.orchestra.run.smithi008.stdout: "event": "throttled", 2023-08-01T19:55:18.522 INFO:teuthology.orchestra.run.smithi008.stdout: "time": "2023-08-01T19:55:18.489391+0000", 2023-08-01T19:55:18.523 INFO:teuthology.orchestra.run.smithi008.stdout: "duration": 0 2023-08-01T19:55:18.523 INFO:teuthology.orchestra.run.smithi008.stdout: }, 2023-08-01T19:55:18.523 INFO:teuthology.orchestra.run.smithi008.stdout: { 2023-08-01T19:55:18.523 INFO:teuthology.orchestra.run.smithi008.stdout: "event": "header_read", 2023-08-01T19:55:18.523 INFO:teuthology.orchestra.run.smithi008.stdout: "time": "2023-08-01T19:55:18.489391+0000", 2023-08-01T19:55:18.523 INFO:teuthology.orchestra.run.smithi008.stdout: "duration": 4294967295.9999995 2023-08-01T19:55:18.523 INFO:teuthology.orchestra.run.smithi008.stdout: }, 2023-08-01T19:55:18.524 INFO:teuthology.orchestra.run.smithi008.stdout: { 2023-08-01T19:55:18.524 INFO:teuthology.orchestra.run.smithi008.stdout: "event": "all_read", 2023-08-01T19:55:18.524 INFO:teuthology.orchestra.run.smithi008.stdout: "time": "2023-08-01T19:55:18.489456+0000", 2023-08-01T19:55:18.524 INFO:teuthology.orchestra.run.smithi008.stdout: "duration": 6.5767999999999998e-05 2023-08-01T19:55:18.524 INFO:teuthology.orchestra.run.smithi008.stdout: }, 2023-08-01T19:55:18.524 INFO:teuthology.orchestra.run.smithi008.stdout: { 2023-08-01T19:55:18.524 INFO:teuthology.orchestra.run.smithi008.stdout: "event": "dispatched", 2023-08-01T19:55:18.524 INFO:teuthology.orchestra.run.smithi008.stdout: "time": "2023-08-01T19:55:18.489468+0000", 2023-08-01T19:55:18.525 INFO:teuthology.orchestra.run.smithi008.stdout: "duration": 1.1749000000000001e-05 2023-08-01T19:55:18.525 INFO:teuthology.orchestra.run.smithi008.stdout: }, 2023-08-01T19:55:18.525 INFO:teuthology.orchestra.run.smithi008.stdout: { 2023-08-01T19:55:18.525 INFO:teuthology.orchestra.run.smithi008.stdout: "event": "queued_for_pg", 2023-08-01T19:55:18.525 INFO:teuthology.orchestra.run.smithi008.stdout: "time": "2023-08-01T19:55:18.489474+0000", 2023-08-01T19:55:18.525 INFO:teuthology.orchestra.run.smithi008.stdout: "duration": 5.5319999999999997e-06 2023-08-01T19:55:18.525 INFO:teuthology.orchestra.run.smithi008.stdout: }, 2023-08-01T19:55:18.526 INFO:teuthology.orchestra.run.smithi008.stdout: { 2023-08-01T19:55:18.526 INFO:teuthology.orchestra.run.smithi008.stdout: "event": "reached_pg", 2023-08-01T19:55:18.526 INFO:teuthology.orchestra.run.smithi008.stdout: "time": "2023-08-01T19:55:18.489512+0000", 2023-08-01T19:55:18.526 INFO:teuthology.orchestra.run.smithi008.stdout: "duration": 3.8226999999999998e-05 2023-08-01T19:55:18.526 INFO:teuthology.orchestra.run.smithi008.stdout: }, 2023-08-01T19:55:18.526 INFO:teuthology.orchestra.run.smithi008.stdout: { 2023-08-01T19:55:18.526 INFO:teuthology.orchestra.run.smithi008.stdout: "event": "started", 2023-08-01T19:55:18.526 INFO:teuthology.orchestra.run.smithi008.stdout: "time": "2023-08-01T19:55:18.489534+0000", 2023-08-01T19:55:18.527 INFO:teuthology.orchestra.run.smithi008.stdout: "duration": 2.1681000000000001e-05 2023-08-01T19:55:18.527 INFO:teuthology.orchestra.run.smithi008.stdout: } 2023-08-01T19:55:18.527 INFO:teuthology.orchestra.run.smithi008.stdout: ] 2023-08-01T19:55:18.527 INFO:teuthology.orchestra.run.smithi008.stdout: } 2023-08-01T19:55:18.527 INFO:teuthology.orchestra.run.smithi008.stdout: }, 2023-08-01T19:55:18.527 INFO:teuthology.orchestra.run.smithi008.stdout: { 2023-08-01T19:55:18.527 INFO:teuthology.orchestra.run.smithi008.stdout: "description": "osd_op(client.4668.0:123012 5.6 5:64d25f87:::benchmark_data_smithi006_114134_object123011:head [set-alloc-hint object_size 65536 write_size 65536,write 0~65536 in=65536b] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e43)", 2023-08-01T19:55:18.528 INFO:teuthology.orchestra.run.smithi008.stdout: "initiated_at": "2023-08-01T19:55:18.492582+0000", 2023-08-01T19:55:18.528 INFO:teuthology.orchestra.run.smithi008.stdout: "age": 0.00075916799999999995, 2023-08-01T19:55:18.528 INFO:teuthology.orchestra.run.smithi008.stdout: "duration": 0.001121176, 2023-08-01T19:55:18.528 INFO:teuthology.orchestra.run.smithi008.stdout: "type_data": { 2023-08-01T19:55:18.528 INFO:teuthology.orchestra.run.smithi008.stdout: "flag_point": "waiting for sub ops", 2023-08-01T19:55:18.528 INFO:teuthology.orchestra.run.smithi008.stdout: "client_info": { 2023-08-01T19:55:18.528 INFO:teuthology.orchestra.run.smithi008.stdout: "client": "client.4668", 2023-08-01T19:55:18.528 INFO:teuthology.orchestra.run.smithi008.stdout: "client_addr": "172.21.15.6:0/1709472247", 2023-08-01T19:55:18.529 INFO:teuthology.orchestra.run.smithi008.stdout: "tid": 123012 2023-08-01T19:55:18.529 INFO:teuthology.orchestra.run.smithi008.stdout: }, 2023-08-01T19:55:18.529 INFO:teuthology.orchestra.run.smithi008.stdout: "events": [ 2023-08-01T19:55:18.529 INFO:teuthology.orchestra.run.smithi008.stdout: { 2023-08-01T19:55:18.529 INFO:teuthology.orchestra.run.smithi008.stdout: "event": "initiated", 2023-08-01T19:55:18.529 INFO:teuthology.orchestra.run.smithi008.stdout: "time": "2023-08-01T19:55:18.492582+0000", 2023-08-01T19:55:18.529 INFO:teuthology.orchestra.run.smithi008.stdout: "duration": 0 2023-08-01T19:55:18.530 INFO:teuthology.orchestra.run.smithi008.stdout: }, 2023-08-01T19:55:18.530 INFO:teuthology.orchestra.run.smithi008.stdout: { 2023-08-01T19:55:18.530 INFO:teuthology.orchestra.run.smithi008.stdout: "event": "throttled", 2023-08-01T19:55:18.530 INFO:teuthology.orchestra.run.smithi008.stdout: "time": "2023-08-01T19:55:18.492582+0000", 2023-08-01T19:55:18.530 INFO:teuthology.orchestra.run.smithi008.stdout: "duration": 0 2023-08-01T19:55:18.530 INFO:teuthology.orchestra.run.smithi008.stdout: }, 2023-08-01T19:55:18.530 INFO:teuthology.orchestra.run.smithi008.stdout: { 2023-08-01T19:55:18.530 INFO:teuthology.orchestra.run.smithi008.stdout: "event": "header_read", 2023-08-01T19:55:18.531 INFO:teuthology.orchestra.run.smithi008.stdout: "time": "2023-08-01T19:55:18.492580+0000", 2023-08-01T19:55:18.531 INFO:teuthology.orchestra.run.smithi008.stdout: "duration": 4294967295.999999 2023-08-01T19:55:18.531 INFO:teuthology.orchestra.run.smithi008.stdout: }, 2023-08-01T19:55:18.531 INFO:teuthology.orchestra.run.smithi008.stdout: { 2023-08-01T19:55:18.531 INFO:teuthology.orchestra.run.smithi008.stdout: "event": "all_read", 2023-08-01T19:55:18.531 INFO:teuthology.orchestra.run.smithi008.stdout: "time": "2023-08-01T19:55:18.492636+0000", 2023-08-01T19:55:18.531 INFO:teuthology.orchestra.run.smithi008.stdout: "duration": 5.5810000000000003e-05 2023-08-01T19:55:18.531 INFO:teuthology.orchestra.run.smithi008.stdout: }, 2023-08-01T19:55:18.532 INFO:teuthology.orchestra.run.smithi008.stdout: { 2023-08-01T19:55:18.532 INFO:teuthology.orchestra.run.smithi008.stdout: "event": "dispatched", 2023-08-01T19:55:18.532 INFO:teuthology.orchestra.run.smithi008.stdout: "time": "2023-08-01T19:55:18.492649+0000", 2023-08-01T19:55:18.532 INFO:teuthology.orchestra.run.smithi008.stdout: "duration": 1.2401999999999999e-05 2023-08-01T19:55:18.532 INFO:teuthology.orchestra.run.smithi008.stdout: }, 2023-08-01T19:55:18.532 INFO:teuthology.orchestra.run.smithi008.stdout: { 2023-08-01T19:55:18.532 INFO:teuthology.orchestra.run.smithi008.stdout: "event": "queued_for_pg", 2023-08-01T19:55:18.533 INFO:teuthology.orchestra.run.smithi008.stdout: "time": "2023-08-01T19:55:18.492653+0000", 2023-08-01T19:55:18.533 INFO:teuthology.orchestra.run.smithi008.stdout: "duration": 4.5329999999999996e-06 2023-08-01T19:55:18.533 INFO:teuthology.orchestra.run.smithi008.stdout: }, 2023-08-01T19:55:18.533 INFO:teuthology.orchestra.run.smithi008.stdout: { 2023-08-01T19:55:18.533 INFO:teuthology.orchestra.run.smithi008.stdout: "event": "reached_pg", 2023-08-01T19:55:18.533 INFO:teuthology.orchestra.run.smithi008.stdout: "time": "2023-08-01T19:55:18.492703+0000", 2023-08-01T19:55:18.533 INFO:teuthology.orchestra.run.smithi008.stdout: "duration": 4.9917000000000003e-05 2023-08-01T19:55:18.534 INFO:teuthology.orchestra.run.smithi008.stdout: }, 2023-08-01T19:55:18.534 INFO:teuthology.orchestra.run.smithi008.stdout: { 2023-08-01T19:55:18.534 INFO:teuthology.orchestra.run.smithi008.stdout: "event": "started", 2023-08-01T19:55:18.534 INFO:teuthology.orchestra.run.smithi008.stdout: "time": "2023-08-01T19:55:18.492855+0000", 2023-08-01T19:55:18.534 INFO:teuthology.orchestra.run.smithi008.stdout: "duration": 0.00015175099999999999 2023-08-01T19:55:18.534 INFO:teuthology.orchestra.run.smithi008.stdout: }, 2023-08-01T19:55:18.534 INFO:teuthology.orchestra.run.smithi008.stdout: { 2023-08-01T19:55:18.534 INFO:teuthology.orchestra.run.smithi008.stdout: "event": "waiting for subops from 1", 2023-08-01T19:55:18.535 INFO:teuthology.orchestra.run.smithi008.stdout: "time": "2023-08-01T19:55:18.493027+0000", 2023-08-01T19:55:18.535 INFO:teuthology.orchestra.run.smithi008.stdout: "duration": 0.000172437 2023-08-01T19:55:18.535 INFO:teuthology.orchestra.run.smithi008.stdout: } 2023-08-01T19:55:18.535 INFO:teuthology.orchestra.run.smithi008.stdout: ] 2023-08-01T19:55:18.535 INFO:teuthology.orchestra.run.smithi008.stdout: } 2023-08-01T19:55:18.535 INFO:teuthology.orchestra.run.smithi008.stdout: }, 2023-08-01T19:55:18.535 INFO:teuthology.orchestra.run.smithi008.stdout: { 2023-08-01T19:55:18.535 INFO:teuthology.orchestra.run.smithi008.stdout: "description": "osd_op(client.4668.0:123014 5.3 5:c1a61111:::benchmark_data_smithi006_114134_object123013:head [set-alloc-hint object_size 65536 write_size 65536,write 0~65536 in=65536b] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e43)", 2023-08-01T19:55:18.536 INFO:teuthology.orchestra.run.smithi008.stdout: "initiated_at": "2023-08-01T19:55:18.492664+0000", 2023-08-01T19:55:18.536 INFO:teuthology.orchestra.run.smithi008.stdout: "age": 0.00067718699999999999, 2023-08-01T19:55:18.536 INFO:teuthology.orchestra.run.smithi008.stdout: "duration": 0.001121181, 2023-08-01T19:55:18.536 INFO:teuthology.orchestra.run.smithi008.stdout: "type_data": { 2023-08-01T19:55:18.536 INFO:teuthology.orchestra.run.smithi008.stdout: "flag_point": "waiting for sub ops", 2023-08-01T19:55:18.536 INFO:teuthology.orchestra.run.smithi008.stdout: "client_info": { 2023-08-01T19:55:18.536 INFO:teuthology.orchestra.run.smithi008.stdout: "client": "client.4668", 2023-08-01T19:55:18.536 INFO:teuthology.orchestra.run.smithi008.stdout: "client_addr": "172.21.15.6:0/1709472247", 2023-08-01T19:55:18.537 INFO:teuthology.orchestra.run.smithi008.stdout: "tid": 123014 2023-08-01T19:55:18.537 INFO:teuthology.orchestra.run.smithi008.stdout: }, 2023-08-01T19:55:18.537 INFO:teuthology.orchestra.run.smithi008.stdout: "events": [ 2023-08-01T19:55:18.537 INFO:teuthology.orchestra.run.smithi008.stdout: { 2023-08-01T19:55:18.537 INFO:teuthology.orchestra.run.smithi008.stdout: "event": "initiated", 2023-08-01T19:55:18.537 INFO:teuthology.orchestra.run.smithi008.stdout: "time": "2023-08-01T19:55:18.492664+0000", 2023-08-01T19:55:18.537 INFO:teuthology.orchestra.run.smithi008.stdout: "duration": 0 2023-08-01T19:55:18.538 INFO:teuthology.orchestra.run.smithi008.stdout: }, 2023-08-01T19:55:18.538 INFO:teuthology.orchestra.run.smithi008.stdout: { 2023-08-01T19:55:18.538 INFO:teuthology.orchestra.run.smithi008.stdout: "event": "throttled", 2023-08-01T19:55:18.538 INFO:teuthology.orchestra.run.smithi008.stdout: "time": "2023-08-01T19:55:18.492664+0000", 2023-08-01T19:55:18.538 INFO:teuthology.orchestra.run.smithi008.stdout: "duration": 0 2023-08-01T19:55:18.538 INFO:teuthology.orchestra.run.smithi008.stdout: }, 2023-08-01T19:55:18.538 INFO:teuthology.orchestra.run.smithi008.stdout: { 2023-08-01T19:55:18.539 INFO:teuthology.orchestra.run.smithi008.stdout: "event": "header_read", 2023-08-01T19:55:18.539 INFO:teuthology.orchestra.run.smithi008.stdout: "time": "2023-08-01T19:55:18.492663+0000", 2023-08-01T19:55:18.539 INFO:teuthology.orchestra.run.smithi008.stdout: "duration": 4294967295.9999995 2023-08-01T19:55:18.539 INFO:teuthology.orchestra.run.smithi008.stdout: }, 2023-08-01T19:55:18.539 INFO:teuthology.orchestra.run.smithi008.stdout: { 2023-08-01T19:55:18.539 INFO:teuthology.orchestra.run.smithi008.stdout: "event": "all_read", 2023-08-01T19:55:18.539 INFO:teuthology.orchestra.run.smithi008.stdout: "time": "2023-08-01T19:55:18.492771+0000", 2023-08-01T19:55:18.539 INFO:teuthology.orchestra.run.smithi008.stdout: "duration": 0.000108286 2023-08-01T19:55:18.540 INFO:teuthology.orchestra.run.smithi008.stdout: }, 2023-08-01T19:55:18.540 INFO:teuthology.orchestra.run.smithi008.stdout: { 2023-08-01T19:55:18.540 INFO:teuthology.orchestra.run.smithi008.stdout: "event": "dispatched", 2023-08-01T19:55:18.540 INFO:teuthology.orchestra.run.smithi008.stdout: "time": "2023-08-01T19:55:18.492778+0000", 2023-08-01T19:55:18.540 INFO:teuthology.orchestra.run.smithi008.stdout: "duration": 6.9e-06 2023-08-01T19:55:18.540 INFO:teuthology.orchestra.run.smithi008.stdout: }, 2023-08-01T19:55:18.540 INFO:teuthology.orchestra.run.smithi008.stdout: { 2023-08-01T19:55:18.541 INFO:teuthology.orchestra.run.smithi008.stdout: "event": "queued_for_pg", 2023-08-01T19:55:18.541 INFO:teuthology.orchestra.run.smithi008.stdout: "time": "2023-08-01T19:55:18.492782+0000", 2023-08-01T19:55:18.541 INFO:teuthology.orchestra.run.smithi008.stdout: "duration": 3.5990000000000002e-06 2023-08-01T19:55:18.541 INFO:teuthology.orchestra.run.smithi008.stdout: }, 2023-08-01T19:55:18.541 INFO:teuthology.orchestra.run.smithi008.stdout: { 2023-08-01T19:55:18.541 INFO:teuthology.orchestra.run.smithi008.stdout: "event": "reached_pg", 2023-08-01T19:55:18.541 INFO:teuthology.orchestra.run.smithi008.stdout: "time": "2023-08-01T19:55:18.492813+0000", 2023-08-01T19:55:18.541 INFO:teuthology.orchestra.run.smithi008.stdout: "duration": 3.0828999999999999e-05 2023-08-01T19:55:18.542 INFO:teuthology.orchestra.run.smithi008.stdout: }, 2023-08-01T19:55:18.542 INFO:teuthology.orchestra.run.smithi008.stdout: { 2023-08-01T19:55:18.542 INFO:teuthology.orchestra.run.smithi008.stdout: "event": "started", 2023-08-01T19:55:18.542 INFO:teuthology.orchestra.run.smithi008.stdout: "time": "2023-08-01T19:55:18.492909+0000", 2023-08-01T19:55:18.542 INFO:teuthology.orchestra.run.smithi008.stdout: "duration": 9.6150999999999995e-05 2023-08-01T19:55:18.542 INFO:teuthology.orchestra.run.smithi008.stdout: }, 2023-08-01T19:55:18.542 INFO:teuthology.orchestra.run.smithi008.stdout: { 2023-08-01T19:55:18.543 INFO:teuthology.orchestra.run.smithi008.stdout: "event": "waiting for subops from 1", 2023-08-01T19:55:18.543 INFO:teuthology.orchestra.run.smithi008.stdout: "time": "2023-08-01T19:55:18.493065+0000", 2023-08-01T19:55:18.543 INFO:teuthology.orchestra.run.smithi008.stdout: "duration": 0.000156329 2023-08-01T19:55:18.543 INFO:teuthology.orchestra.run.smithi008.stdout: } 2023-08-01T19:55:18.543 INFO:teuthology.orchestra.run.smithi008.stdout: ] 2023-08-01T19:55:18.543 INFO:teuthology.orchestra.run.smithi008.stdout: } 2023-08-01T19:55:18.543 INFO:teuthology.orchestra.run.smithi008.stdout: }, 2023-08-01T19:55:18.543 INFO:teuthology.orchestra.run.smithi008.stdout: { 2023-08-01T19:55:18.544 INFO:teuthology.orchestra.run.smithi008.stdout: "description": "osd_op(client.4668.0:123016 5.5 5:a38a14fd:::benchmark_data_smithi006_114134_object123015:head [set-alloc-hint object_size 65536 write_size 65536,write 0~65536 in=65536b] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e43)", 2023-08-01T19:55:18.544 INFO:teuthology.orchestra.run.smithi008.stdout: "initiated_at": "2023-08-01T19:55:18.492787+0000", 2023-08-01T19:55:18.544 INFO:teuthology.orchestra.run.smithi008.stdout: "age": 0.00055336399999999998, 2023-08-01T19:55:18.544 INFO:teuthology.orchestra.run.smithi008.stdout: "duration": 0.0010770790000000001, 2023-08-01T19:55:18.544 INFO:teuthology.orchestra.run.smithi008.stdout: "type_data": { 2023-08-01T19:55:18.544 INFO:teuthology.orchestra.run.smithi008.stdout: "flag_point": "waiting for sub ops", 2023-08-01T19:55:18.544 INFO:teuthology.orchestra.run.smithi008.stdout: "client_info": { 2023-08-01T19:55:18.545 INFO:teuthology.orchestra.run.smithi008.stdout: "client": "client.4668", 2023-08-01T19:55:18.545 INFO:teuthology.orchestra.run.smithi008.stdout: "client_addr": "172.21.15.6:0/1709472247", 2023-08-01T19:55:18.545 INFO:teuthology.orchestra.run.smithi008.stdout: "tid": 123016 2023-08-01T19:55:18.545 INFO:teuthology.orchestra.run.smithi008.stdout: }, 2023-08-01T19:55:18.545 INFO:teuthology.orchestra.run.smithi008.stdout: "events": [ 2023-08-01T19:55:18.545 INFO:teuthology.orchestra.run.smithi008.stdout: { 2023-08-01T19:55:18.545 INFO:teuthology.orchestra.run.smithi008.stdout: "event": "initiated", 2023-08-01T19:55:18.545 INFO:teuthology.orchestra.run.smithi008.stdout: "time": "2023-08-01T19:55:18.492787+0000", 2023-08-01T19:55:18.546 INFO:teuthology.orchestra.run.smithi008.stdout: "duration": 0 2023-08-01T19:55:18.546 INFO:teuthology.orchestra.run.smithi008.stdout: }, 2023-08-01T19:55:18.546 INFO:teuthology.orchestra.run.smithi008.stdout: { 2023-08-01T19:55:18.546 INFO:teuthology.orchestra.run.smithi008.stdout: "event": "throttled", 2023-08-01T19:55:18.546 INFO:teuthology.orchestra.run.smithi008.stdout: "time": "2023-08-01T19:55:18.492787+0000", 2023-08-01T19:55:18.546 INFO:teuthology.orchestra.run.smithi008.stdout: "duration": 0 2023-08-01T19:55:18.546 INFO:teuthology.orchestra.run.smithi008.stdout: }, 2023-08-01T19:55:18.546 INFO:teuthology.orchestra.run.smithi008.stdout: { 2023-08-01T19:55:18.547 INFO:teuthology.orchestra.run.smithi008.stdout: "event": "header_read", 2023-08-01T19:55:18.547 INFO:teuthology.orchestra.run.smithi008.stdout: "time": "2023-08-01T19:55:18.492787+0000", 2023-08-01T19:55:18.547 INFO:teuthology.orchestra.run.smithi008.stdout: "duration": 4294967295.9999995 2023-08-01T19:55:18.547 INFO:teuthology.orchestra.run.smithi008.stdout: }, 2023-08-01T19:55:18.547 INFO:teuthology.orchestra.run.smithi008.stdout: { 2023-08-01T19:55:18.547 INFO:teuthology.orchestra.run.smithi008.stdout: "event": "all_read", 2023-08-01T19:55:18.547 INFO:teuthology.orchestra.run.smithi008.stdout: "time": "2023-08-01T19:55:18.492872+0000", 2023-08-01T19:55:18.548 INFO:teuthology.orchestra.run.smithi008.stdout: "duration": 8.5007999999999997e-05 2023-08-01T19:55:18.548 INFO:teuthology.orchestra.run.smithi008.stdout: }, 2023-08-01T19:55:18.548 INFO:teuthology.orchestra.run.smithi008.stdout: { 2023-08-01T19:55:18.548 INFO:teuthology.orchestra.run.smithi008.stdout: "event": "dispatched", 2023-08-01T19:55:18.548 INFO:teuthology.orchestra.run.smithi008.stdout: "time": "2023-08-01T19:55:18.492878+0000", 2023-08-01T19:55:18.548 INFO:teuthology.orchestra.run.smithi008.stdout: "duration": 6.1210000000000003e-06 2023-08-01T19:55:18.549 INFO:teuthology.orchestra.run.smithi008.stdout: }, 2023-08-01T19:55:18.549 INFO:teuthology.orchestra.run.smithi008.stdout: { 2023-08-01T19:55:18.549 INFO:teuthology.orchestra.run.smithi008.stdout: "event": "queued_for_pg", 2023-08-01T19:55:18.549 INFO:teuthology.orchestra.run.smithi008.stdout: "time": "2023-08-01T19:55:18.492881+0000", 2023-08-01T19:55:18.549 INFO:teuthology.orchestra.run.smithi008.stdout: "duration": 3.19e-06 2023-08-01T19:55:18.549 INFO:teuthology.orchestra.run.smithi008.stdout: }, 2023-08-01T19:55:18.549 INFO:teuthology.orchestra.run.smithi008.stdout: { 2023-08-01T19:55:18.550 INFO:teuthology.orchestra.run.smithi008.stdout: "event": "reached_pg", 2023-08-01T19:55:18.550 INFO:teuthology.orchestra.run.smithi008.stdout: "time": "2023-08-01T19:55:18.492927+0000", 2023-08-01T19:55:18.550 INFO:teuthology.orchestra.run.smithi008.stdout: "duration": 4.5822999999999998e-05 2023-08-01T19:55:18.550 INFO:teuthology.orchestra.run.smithi008.stdout: }, 2023-08-01T19:55:18.550 INFO:teuthology.orchestra.run.smithi008.stdout: { 2023-08-01T19:55:18.550 INFO:teuthology.orchestra.run.smithi008.stdout: "event": "started", 2023-08-01T19:55:18.550 INFO:teuthology.orchestra.run.smithi008.stdout: "time": "2023-08-01T19:55:18.493051+0000", 2023-08-01T19:55:18.551 INFO:teuthology.orchestra.run.smithi008.stdout: "duration": 0.00012447599999999999 2023-08-01T19:55:18.551 INFO:teuthology.orchestra.run.smithi008.stdout: }, 2023-08-01T19:55:18.551 INFO:teuthology.orchestra.run.smithi008.stdout: { 2023-08-01T19:55:18.551 INFO:teuthology.orchestra.run.smithi008.stdout: "event": "waiting for subops from 1", 2023-08-01T19:55:18.551 INFO:teuthology.orchestra.run.smithi008.stdout: "time": "2023-08-01T19:55:18.493302+0000", 2023-08-01T19:55:18.551 INFO:teuthology.orchestra.run.smithi008.stdout: "duration": 0.000250027 2023-08-01T19:55:18.551 INFO:teuthology.orchestra.run.smithi008.stdout: } 2023-08-01T19:55:18.552 INFO:teuthology.orchestra.run.smithi008.stdout: ] 2023-08-01T19:55:18.552 INFO:teuthology.orchestra.run.smithi008.stdout: } 2023-08-01T19:55:18.552 INFO:teuthology.orchestra.run.smithi008.stdout: }, 2023-08-01T19:55:18.552 INFO:teuthology.orchestra.run.smithi008.stdout: { 2023-08-01T19:55:18.552 INFO:teuthology.orchestra.run.smithi008.stdout: "description": "osd_op(client.4668.0:123019 5.a 5:5f595cbb:::benchmark_data_smithi006_114134_object123018:head [set-alloc-hint object_size 65536 write_size 65536,write 0~65536 in=65536b] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e43)", 2023-08-01T19:55:18.552 INFO:teuthology.orchestra.run.smithi008.stdout: "initiated_at": "2023-08-01T19:55:18.492965+0000", 2023-08-01T19:55:18.553 INFO:teuthology.orchestra.run.smithi008.stdout: "age": 0.00037538099999999999, 2023-08-01T19:55:18.553 INFO:teuthology.orchestra.run.smithi008.stdout: "duration": 0.0009784520000000001, 2023-08-01T19:55:18.553 INFO:teuthology.orchestra.run.smithi008.stdout: "type_data": { 2023-08-01T19:55:18.553 INFO:teuthology.orchestra.run.smithi008.stdout: "flag_point": "waiting for sub ops", 2023-08-01T19:55:18.553 INFO:teuthology.orchestra.run.smithi008.stdout: "client_info": { 2023-08-01T19:55:18.553 INFO:teuthology.orchestra.run.smithi008.stdout: "client": "client.4668", 2023-08-01T19:55:18.553 INFO:teuthology.orchestra.run.smithi008.stdout: "client_addr": "172.21.15.6:0/1709472247", 2023-08-01T19:55:18.553 INFO:teuthology.orchestra.run.smithi008.stdout: "tid": 123019 2023-08-01T19:55:18.554 INFO:teuthology.orchestra.run.smithi008.stdout: }, 2023-08-01T19:55:18.554 INFO:teuthology.orchestra.run.smithi008.stdout: "events": [ 2023-08-01T19:55:18.554 INFO:teuthology.orchestra.run.smithi008.stdout: { 2023-08-01T19:55:18.554 INFO:teuthology.orchestra.run.smithi008.stdout: "event": "initiated", 2023-08-01T19:55:18.554 INFO:teuthology.orchestra.run.smithi008.stdout: "time": "2023-08-01T19:55:18.492965+0000", 2023-08-01T19:55:18.554 INFO:teuthology.orchestra.run.smithi008.stdout: "duration": 0 2023-08-01T19:55:18.554 INFO:teuthology.orchestra.run.smithi008.stdout: }, 2023-08-01T19:55:18.554 INFO:teuthology.orchestra.run.smithi008.stdout: { 2023-08-01T19:55:18.555 INFO:teuthology.orchestra.run.smithi008.stdout: "event": "throttled", 2023-08-01T19:55:18.555 INFO:teuthology.orchestra.run.smithi008.stdout: "time": "2023-08-01T19:55:18.492965+0000", 2023-08-01T19:55:18.555 INFO:teuthology.orchestra.run.smithi008.stdout: "duration": 0 2023-08-01T19:55:18.555 INFO:teuthology.orchestra.run.smithi008.stdout: }, 2023-08-01T19:55:18.555 INFO:teuthology.orchestra.run.smithi008.stdout: { 2023-08-01T19:55:18.555 INFO:teuthology.orchestra.run.smithi008.stdout: "event": "header_read", 2023-08-01T19:55:18.555 INFO:teuthology.orchestra.run.smithi008.stdout: "time": "2023-08-01T19:55:18.492965+0000", 2023-08-01T19:55:18.555 INFO:teuthology.orchestra.run.smithi008.stdout: "duration": 4294967295.9999995 2023-08-01T19:55:18.556 INFO:teuthology.orchestra.run.smithi008.stdout: }, 2023-08-01T19:55:18.556 INFO:teuthology.orchestra.run.smithi008.stdout: { 2023-08-01T19:55:18.556 INFO:teuthology.orchestra.run.smithi008.stdout: "event": "all_read", 2023-08-01T19:55:18.556 INFO:teuthology.orchestra.run.smithi008.stdout: "time": "2023-08-01T19:55:18.493051+0000", 2023-08-01T19:55:18.556 INFO:teuthology.orchestra.run.smithi008.stdout: "duration": 8.6403999999999995e-05 2023-08-01T19:55:18.556 INFO:teuthology.orchestra.run.smithi008.stdout: }, 2023-08-01T19:55:18.556 INFO:teuthology.orchestra.run.smithi008.stdout: { 2023-08-01T19:55:18.557 INFO:teuthology.orchestra.run.smithi008.stdout: "event": "dispatched", 2023-08-01T19:55:18.557 INFO:teuthology.orchestra.run.smithi008.stdout: "time": "2023-08-01T19:55:18.493061+0000", 2023-08-01T19:55:18.557 INFO:teuthology.orchestra.run.smithi008.stdout: "duration": 9.7059999999999999e-06 2023-08-01T19:55:18.557 INFO:teuthology.orchestra.run.smithi008.stdout: }, 2023-08-01T19:55:18.557 INFO:teuthology.orchestra.run.smithi008.stdout: { 2023-08-01T19:55:18.557 INFO:teuthology.orchestra.run.smithi008.stdout: "event": "queued_for_pg", 2023-08-01T19:55:18.557 INFO:teuthology.orchestra.run.smithi008.stdout: "time": "2023-08-01T19:55:18.493066+0000", 2023-08-01T19:55:18.557 INFO:teuthology.orchestra.run.smithi008.stdout: "duration": 5.1200000000000001e-06 2023-08-01T19:55:18.558 INFO:teuthology.orchestra.run.smithi008.stdout: }, 2023-08-01T19:55:18.558 INFO:teuthology.orchestra.run.smithi008.stdout: { 2023-08-01T19:55:18.558 INFO:teuthology.orchestra.run.smithi008.stdout: "event": "reached_pg", 2023-08-01T19:55:18.558 INFO:teuthology.orchestra.run.smithi008.stdout: "time": "2023-08-01T19:55:18.493419+0000", 2023-08-01T19:55:18.558 INFO:teuthology.orchestra.run.smithi008.stdout: "duration": 0.00035278600000000001 2023-08-01T19:55:18.558 INFO:teuthology.orchestra.run.smithi008.stdout: }, 2023-08-01T19:55:18.558 INFO:teuthology.orchestra.run.smithi008.stdout: { 2023-08-01T19:55:18.558 INFO:teuthology.orchestra.run.smithi008.stdout: "event": "started", 2023-08-01T19:55:18.559 INFO:teuthology.orchestra.run.smithi008.stdout: "time": "2023-08-01T19:55:18.493546+0000", 2023-08-01T19:55:18.559 INFO:teuthology.orchestra.run.smithi008.stdout: "duration": 0.00012732299999999999 2023-08-01T19:55:18.559 INFO:teuthology.orchestra.run.smithi008.stdout: }, 2023-08-01T19:55:18.559 INFO:teuthology.orchestra.run.smithi008.stdout: { 2023-08-01T19:55:18.559 INFO:teuthology.orchestra.run.smithi008.stdout: "event": "waiting for subops from 2", 2023-08-01T19:55:18.559 INFO:teuthology.orchestra.run.smithi008.stdout: "time": "2023-08-01T19:55:18.493695+0000", 2023-08-01T19:55:18.559 INFO:teuthology.orchestra.run.smithi008.stdout: "duration": 0.00014937500000000001 2023-08-01T19:55:18.560 INFO:teuthology.orchestra.run.smithi008.stdout: } 2023-08-01T19:55:18.560 INFO:teuthology.orchestra.run.smithi008.stdout: ] 2023-08-01T19:55:18.560 INFO:teuthology.orchestra.run.smithi008.stdout: } 2023-08-01T19:55:18.560 INFO:teuthology.orchestra.run.smithi008.stdout: }, 2023-08-01T19:55:18.560 INFO:teuthology.orchestra.run.smithi008.stdout: { 2023-08-01T19:55:18.560 INFO:teuthology.orchestra.run.smithi008.stdout: "description": "osd_repop_reply(client.4668.0:123006 5.3 e43/19)", 2023-08-01T19:55:18.560 INFO:teuthology.orchestra.run.smithi008.stdout: "initiated_at": "2023-08-01T19:55:18.493049+0000", 2023-08-01T19:55:18.560 INFO:teuthology.orchestra.run.smithi008.stdout: "age": 0.00029123000000000002, 2023-08-01T19:55:18.561 INFO:teuthology.orchestra.run.smithi008.stdout: "duration": 0.00096665499999999997, 2023-08-01T19:55:18.561 INFO:teuthology.orchestra.run.smithi008.stdout: "type_data": { 2023-08-01T19:55:18.561 INFO:teuthology.orchestra.run.smithi008.stdout: "flag_point": "queued for pg", 2023-08-01T19:55:18.561 INFO:teuthology.orchestra.run.smithi008.stdout: "events": [ 2023-08-01T19:55:18.561 INFO:teuthology.orchestra.run.smithi008.stdout: { 2023-08-01T19:55:18.561 INFO:teuthology.orchestra.run.smithi008.stdout: "event": "initiated", 2023-08-01T19:55:18.561 INFO:teuthology.orchestra.run.smithi008.stdout: "time": "2023-08-01T19:55:18.493049+0000", 2023-08-01T19:55:18.561 INFO:teuthology.orchestra.run.smithi008.stdout: "duration": 0 2023-08-01T19:55:18.562 INFO:teuthology.orchestra.run.smithi008.stdout: }, 2023-08-01T19:55:18.562 INFO:teuthology.orchestra.run.smithi008.stdout: { 2023-08-01T19:55:18.562 INFO:teuthology.orchestra.run.smithi008.stdout: "event": "throttled", 2023-08-01T19:55:18.562 INFO:teuthology.orchestra.run.smithi008.stdout: "time": "2023-08-01T19:55:18.493049+0000", 2023-08-01T19:55:18.562 INFO:teuthology.orchestra.run.smithi008.stdout: "duration": 0 2023-08-01T19:55:18.562 INFO:teuthology.orchestra.run.smithi008.stdout: }, 2023-08-01T19:55:18.562 INFO:teuthology.orchestra.run.smithi008.stdout: { 2023-08-01T19:55:18.563 INFO:teuthology.orchestra.run.smithi008.stdout: "event": "header_read", 2023-08-01T19:55:18.563 INFO:teuthology.orchestra.run.smithi008.stdout: "time": "2023-08-01T19:55:18.493049+0000", 2023-08-01T19:55:18.563 INFO:teuthology.orchestra.run.smithi008.stdout: "duration": 4294967295.9999995 2023-08-01T19:55:18.563 INFO:teuthology.orchestra.run.smithi008.stdout: }, 2023-08-01T19:55:18.563 INFO:teuthology.orchestra.run.smithi008.stdout: { 2023-08-01T19:55:18.563 INFO:teuthology.orchestra.run.smithi008.stdout: "event": "all_read", 2023-08-01T19:55:18.563 INFO:teuthology.orchestra.run.smithi008.stdout: "time": "2023-08-01T19:55:18.493052+0000", 2023-08-01T19:55:18.563 INFO:teuthology.orchestra.run.smithi008.stdout: "duration": 3.4800000000000001e-06 2023-08-01T19:55:18.564 INFO:teuthology.orchestra.run.smithi008.stdout: }, 2023-08-01T19:55:18.564 INFO:teuthology.orchestra.run.smithi008.stdout: { 2023-08-01T19:55:18.564 INFO:teuthology.orchestra.run.smithi008.stdout: "event": "dispatched", 2023-08-01T19:55:18.564 INFO:teuthology.orchestra.run.smithi008.stdout: "time": "2023-08-01T19:55:18.493061+0000", 2023-08-01T19:55:18.564 INFO:teuthology.orchestra.run.smithi008.stdout: "duration": 9.054e-06 2023-08-01T19:55:18.564 INFO:teuthology.orchestra.run.smithi008.stdout: }, 2023-08-01T19:55:18.564 INFO:teuthology.orchestra.run.smithi008.stdout: { 2023-08-01T19:55:18.564 INFO:teuthology.orchestra.run.smithi008.stdout: "event": "queued_for_pg", 2023-08-01T19:55:18.565 INFO:teuthology.orchestra.run.smithi008.stdout: "time": "2023-08-01T19:55:18.493066+0000", 2023-08-01T19:55:18.565 INFO:teuthology.orchestra.run.smithi008.stdout: "duration": 4.3810000000000001e-06 2023-08-01T19:55:18.565 INFO:teuthology.orchestra.run.smithi008.stdout: } 2023-08-01T19:55:18.565 INFO:teuthology.orchestra.run.smithi008.stdout: ] 2023-08-01T19:55:18.565 INFO:teuthology.orchestra.run.smithi008.stdout: } 2023-08-01T19:55:18.565 INFO:teuthology.orchestra.run.smithi008.stdout: }, 2023-08-01T19:55:18.565 INFO:teuthology.orchestra.run.smithi008.stdout: { 2023-08-01T19:55:18.565 INFO:teuthology.orchestra.run.smithi008.stdout: "description": "osd_repop(client.4668.0:123013 5.8 e43/19 5:12549109:::benchmark_data_smithi006_114134_object123012:head v 43'7738, mlcod=43'7736)", 2023-08-01T19:55:18.566 INFO:teuthology.orchestra.run.smithi008.stdout: "initiated_at": "2023-08-01T19:55:18.493130+0000", 2023-08-01T19:55:18.566 INFO:teuthology.orchestra.run.smithi008.stdout: "age": 0.000210712, 2023-08-01T19:55:18.566 INFO:teuthology.orchestra.run.smithi008.stdout: "duration": 0.00093675200000000001, 2023-08-01T19:55:18.566 INFO:teuthology.orchestra.run.smithi008.stdout: "type_data": { 2023-08-01T19:55:18.566 INFO:teuthology.orchestra.run.smithi008.stdout: "flag_point": "started", 2023-08-01T19:55:18.566 INFO:teuthology.orchestra.run.smithi008.stdout: "events": [ 2023-08-01T19:55:18.566 INFO:teuthology.orchestra.run.smithi008.stdout: { 2023-08-01T19:55:18.567 INFO:teuthology.orchestra.run.smithi008.stdout: "event": "initiated", 2023-08-01T19:55:18.567 INFO:teuthology.orchestra.run.smithi008.stdout: "time": "2023-08-01T19:55:18.493130+0000", 2023-08-01T19:55:18.567 INFO:teuthology.orchestra.run.smithi008.stdout: "duration": 0 2023-08-01T19:55:18.567 INFO:teuthology.orchestra.run.smithi008.stdout: }, 2023-08-01T19:55:18.567 INFO:teuthology.orchestra.run.smithi008.stdout: { 2023-08-01T19:55:18.567 INFO:teuthology.orchestra.run.smithi008.stdout: "event": "throttled", 2023-08-01T19:55:18.567 INFO:teuthology.orchestra.run.smithi008.stdout: "time": "2023-08-01T19:55:18.493130+0000", 2023-08-01T19:55:18.567 INFO:teuthology.orchestra.run.smithi008.stdout: "duration": 0 2023-08-01T19:55:18.568 INFO:teuthology.orchestra.run.smithi008.stdout: }, 2023-08-01T19:55:18.568 INFO:teuthology.orchestra.run.smithi008.stdout: { 2023-08-01T19:55:18.568 INFO:teuthology.orchestra.run.smithi008.stdout: "event": "header_read", 2023-08-01T19:55:18.568 INFO:teuthology.orchestra.run.smithi008.stdout: "time": "2023-08-01T19:55:18.493130+0000", 2023-08-01T19:55:18.568 INFO:teuthology.orchestra.run.smithi008.stdout: "duration": 4294967295.9999995 2023-08-01T19:55:18.568 INFO:teuthology.orchestra.run.smithi008.stdout: }, 2023-08-01T19:55:18.568 INFO:teuthology.orchestra.run.smithi008.stdout: { 2023-08-01T19:55:18.569 INFO:teuthology.orchestra.run.smithi008.stdout: "event": "all_read", 2023-08-01T19:55:18.569 INFO:teuthology.orchestra.run.smithi008.stdout: "time": "2023-08-01T19:55:18.493149+0000", 2023-08-01T19:55:18.569 INFO:teuthology.orchestra.run.smithi008.stdout: "duration": 1.9593e-05 2023-08-01T19:55:18.569 INFO:teuthology.orchestra.run.smithi008.stdout: }, 2023-08-01T19:55:18.569 INFO:teuthology.orchestra.run.smithi008.stdout: { 2023-08-01T19:55:18.569 INFO:teuthology.orchestra.run.smithi008.stdout: "event": "dispatched", 2023-08-01T19:55:18.569 INFO:teuthology.orchestra.run.smithi008.stdout: "time": "2023-08-01T19:55:18.493154+0000", 2023-08-01T19:55:18.569 INFO:teuthology.orchestra.run.smithi008.stdout: "duration": 4.7890000000000002e-06 2023-08-01T19:55:18.570 INFO:teuthology.orchestra.run.smithi008.stdout: }, 2023-08-01T19:55:18.570 INFO:teuthology.orchestra.run.smithi008.stdout: { 2023-08-01T19:55:18.570 INFO:teuthology.orchestra.run.smithi008.stdout: "event": "queued_for_pg", 2023-08-01T19:55:18.570 INFO:teuthology.orchestra.run.smithi008.stdout: "time": "2023-08-01T19:55:18.493157+0000", 2023-08-01T19:55:18.570 INFO:teuthology.orchestra.run.smithi008.stdout: "duration": 2.9110000000000002e-06 2023-08-01T19:55:18.570 INFO:teuthology.orchestra.run.smithi008.stdout: }, 2023-08-01T19:55:18.570 INFO:teuthology.orchestra.run.smithi008.stdout: { 2023-08-01T19:55:18.571 INFO:teuthology.orchestra.run.smithi008.stdout: "event": "reached_pg", 2023-08-01T19:55:18.571 INFO:teuthology.orchestra.run.smithi008.stdout: "time": "2023-08-01T19:55:18.493186+0000", 2023-08-01T19:55:18.571 INFO:teuthology.orchestra.run.smithi008.stdout: "duration": 2.8527e-05 2023-08-01T19:55:18.571 INFO:teuthology.orchestra.run.smithi008.stdout: }, 2023-08-01T19:55:18.571 INFO:teuthology.orchestra.run.smithi008.stdout: { 2023-08-01T19:55:18.571 INFO:teuthology.orchestra.run.smithi008.stdout: "event": "started", 2023-08-01T19:55:18.571 INFO:teuthology.orchestra.run.smithi008.stdout: "time": "2023-08-01T19:55:18.493197+0000", 2023-08-01T19:55:18.572 INFO:teuthology.orchestra.run.smithi008.stdout: "duration": 1.1708999999999999e-05 2023-08-01T19:55:18.572 INFO:teuthology.orchestra.run.smithi008.stdout: } 2023-08-01T19:55:18.572 INFO:teuthology.orchestra.run.smithi008.stdout: ] 2023-08-01T19:55:18.572 INFO:teuthology.orchestra.run.smithi008.stdout: } 2023-08-01T19:55:18.572 INFO:teuthology.orchestra.run.smithi008.stdout: }, 2023-08-01T19:55:18.572 INFO:teuthology.orchestra.run.smithi008.stdout: { 2023-08-01T19:55:18.572 INFO:teuthology.orchestra.run.smithi008.stdout: "description": "osd_repop(client.4668.0:123002 5.0 e43/19 5:03f396ab:::benchmark_data_smithi006_114134_object123001:head v 43'7825, mlcod=43'7822)", 2023-08-01T19:55:18.572 INFO:teuthology.orchestra.run.smithi008.stdout: "initiated_at": "2023-08-01T19:55:18.485287+0000", 2023-08-01T19:55:18.573 INFO:teuthology.orchestra.run.smithi008.stdout: "age": 0.0080541539999999991, 2023-08-01T19:55:18.573 INFO:teuthology.orchestra.run.smithi008.stdout: "duration": 0.0088422850000000001, 2023-08-01T19:55:18.573 INFO:teuthology.orchestra.run.smithi008.stdout: "type_data": { 2023-08-01T19:55:18.573 INFO:teuthology.orchestra.run.smithi008.stdout: "flag_point": "started", 2023-08-01T19:55:18.573 INFO:teuthology.orchestra.run.smithi008.stdout: "events": [ 2023-08-01T19:55:18.573 INFO:teuthology.orchestra.run.smithi008.stdout: { 2023-08-01T19:55:18.573 INFO:teuthology.orchestra.run.smithi008.stdout: "event": "initiated", 2023-08-01T19:55:18.574 INFO:teuthology.orchestra.run.smithi008.stdout: "time": "2023-08-01T19:55:18.485287+0000", 2023-08-01T19:55:18.574 INFO:teuthology.orchestra.run.smithi008.stdout: "duration": 0 2023-08-01T19:55:18.574 INFO:teuthology.orchestra.run.smithi008.stdout: }, 2023-08-01T19:55:18.574 INFO:teuthology.orchestra.run.smithi008.stdout: { 2023-08-01T19:55:18.574 INFO:teuthology.orchestra.run.smithi008.stdout: "event": "throttled", 2023-08-01T19:55:18.574 INFO:teuthology.orchestra.run.smithi008.stdout: "time": "2023-08-01T19:55:18.485287+0000", 2023-08-01T19:55:18.574 INFO:teuthology.orchestra.run.smithi008.stdout: "duration": 0 2023-08-01T19:55:18.574 INFO:teuthology.orchestra.run.smithi008.stdout: }, 2023-08-01T19:55:18.575 INFO:teuthology.orchestra.run.smithi008.stdout: { 2023-08-01T19:55:18.575 INFO:teuthology.orchestra.run.smithi008.stdout: "event": "header_read", 2023-08-01T19:55:18.575 INFO:teuthology.orchestra.run.smithi008.stdout: "time": "2023-08-01T19:55:18.485286+0000", 2023-08-01T19:55:18.575 INFO:teuthology.orchestra.run.smithi008.stdout: "duration": 4294967295.999999 2023-08-01T19:55:18.575 INFO:teuthology.orchestra.run.smithi008.stdout: }, 2023-08-01T19:55:18.575 INFO:teuthology.orchestra.run.smithi008.stdout: { 2023-08-01T19:55:18.575 INFO:teuthology.orchestra.run.smithi008.stdout: "event": "all_read", 2023-08-01T19:55:18.575 INFO:teuthology.orchestra.run.smithi008.stdout: "time": "2023-08-01T19:55:18.485335+0000", 2023-08-01T19:55:18.576 INFO:teuthology.orchestra.run.smithi008.stdout: "duration": 4.8922999999999999e-05 2023-08-01T19:55:18.576 INFO:teuthology.orchestra.run.smithi008.stdout: }, 2023-08-01T19:55:18.576 INFO:teuthology.orchestra.run.smithi008.stdout: { 2023-08-01T19:55:18.576 INFO:teuthology.orchestra.run.smithi008.stdout: "event": "dispatched", 2023-08-01T19:55:18.576 INFO:teuthology.orchestra.run.smithi008.stdout: "time": "2023-08-01T19:55:18.485344+0000", 2023-08-01T19:55:18.576 INFO:teuthology.orchestra.run.smithi008.stdout: "duration": 8.8589999999999994e-06 2023-08-01T19:55:18.576 INFO:teuthology.orchestra.run.smithi008.stdout: }, 2023-08-01T19:55:18.577 INFO:teuthology.orchestra.run.smithi008.stdout: { 2023-08-01T19:55:18.577 INFO:teuthology.orchestra.run.smithi008.stdout: "event": "queued_for_pg", 2023-08-01T19:55:18.577 INFO:teuthology.orchestra.run.smithi008.stdout: "time": "2023-08-01T19:55:18.485354+0000", 2023-08-01T19:55:18.577 INFO:teuthology.orchestra.run.smithi008.stdout: "duration": 1.0491e-05 2023-08-01T19:55:18.577 INFO:teuthology.orchestra.run.smithi008.stdout: }, 2023-08-01T19:55:18.577 INFO:teuthology.orchestra.run.smithi008.stdout: { 2023-08-01T19:55:18.577 INFO:teuthology.orchestra.run.smithi008.stdout: "event": "reached_pg", 2023-08-01T19:55:18.577 INFO:teuthology.orchestra.run.smithi008.stdout: "time": "2023-08-01T19:55:18.487121+0000", 2023-08-01T19:55:18.578 INFO:teuthology.orchestra.run.smithi008.stdout: "duration": 0.0017673459999999999 2023-08-01T19:55:18.578 INFO:teuthology.orchestra.run.smithi008.stdout: }, 2023-08-01T19:55:18.578 INFO:teuthology.orchestra.run.smithi008.stdout: { 2023-08-01T19:55:18.578 INFO:teuthology.orchestra.run.smithi008.stdout: "event": "started", 2023-08-01T19:55:18.578 INFO:teuthology.orchestra.run.smithi008.stdout: "time": "2023-08-01T19:55:18.487140+0000", 2023-08-01T19:55:18.578 INFO:teuthology.orchestra.run.smithi008.stdout: "duration": 1.8570999999999999e-05 2023-08-01T19:55:18.578 INFO:teuthology.orchestra.run.smithi008.stdout: } 2023-08-01T19:55:18.579 INFO:teuthology.orchestra.run.smithi008.stdout: ] 2023-08-01T19:55:18.579 INFO:teuthology.orchestra.run.smithi008.stdout: } 2023-08-01T19:55:18.579 INFO:teuthology.orchestra.run.smithi008.stdout: } 2023-08-01T19:55:18.579 INFO:teuthology.orchestra.run.smithi008.stdout: ], 2023-08-01T19:55:18.579 INFO:teuthology.orchestra.run.smithi008.stdout: "num_ops": 11 2023-08-01T19:55:18.579 INFO:teuthology.orchestra.run.smithi008.stdout:} 2023-08-01T19:55:18.580 DEBUG:teuthology.orchestra.run.smithi008:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 30 ceph --cluster ceph --admin-daemon /var/run/ceph/ceph-osd.0.asok dump_blocked_ops 2023-08-01T19:55:18.581 INFO:tasks.ceph.osd.2.smithi155.stderr:2023-08-01T19:55:18.579+0000 7faa5c6ac700 -1 received signal: Hangup from /usr/bin/python3 /bin/daemon-helper kill ceph-osd -f --cluster ceph -i 2 (PID: 111337) UID: 0 2023-08-01T19:55:18.620 INFO:teuthology.orchestra.run.smithi006.stderr:nodeep-scrub is unset 2023-08-01T19:55:18.681 INFO:tasks.ceph.osd.0.smithi008.stderr:2023-08-01T19:55:18.680+0000 7f16a58f4700 -1 received signal: Hangup from /usr/bin/python3 /bin/daemon-helper kill ceph-osd -f --cluster ceph -i 0 (PID: 111179) UID: 0 2023-08-01T19:55:18.779 INFO:teuthology.orchestra.run.smithi008.stdout:{ 2023-08-01T19:55:18.780 INFO:teuthology.orchestra.run.smithi008.stdout: "ops": [], 2023-08-01T19:55:18.780 INFO:teuthology.orchestra.run.smithi008.stdout: "complaint_time": 30, 2023-08-01T19:55:18.780 INFO:teuthology.orchestra.run.smithi008.stdout: "num_blocked_ops": 0 2023-08-01T19:55:18.780 INFO:teuthology.orchestra.run.smithi008.stdout:} 2023-08-01T19:55:18.782 INFO:tasks.ceph.osd.1.smithi101.stderr:2023-08-01T19:55:18.781+0000 7fb0cb7f6700 -1 received signal: Hangup from /usr/bin/python3 /bin/daemon-helper kill ceph-osd -f --cluster ceph -i 1 (PID: 111141) UID: 0 2023-08-01T19:55:18.794 DEBUG:teuthology.orchestra.run.smithi008:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 30 ceph --cluster ceph --admin-daemon /var/run/ceph/ceph-osd.0.asok dump_historic_ops 2023-08-01T19:55:18.883 INFO:tasks.ceph.osd.1.smithi101.stderr:2023-08-01T19:55:18.881+0000 7fb0cb7f6700 -1 received signal: Hangup from /usr/bin/python3 /bin/daemon-helper kill ceph-osd -f --cluster ceph -i 1 (PID: 111141) UID: 0 2023-08-01T19:55:18.899 DEBUG:teuthology.orchestra.run.smithi006:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 120 ceph --cluster ceph -- tell 'osd.*' injectargs --osd_enable_op_tracker=false 2023-08-01T19:55:18.983 INFO:tasks.ceph.osd.2.smithi155.stderr:2023-08-01T19:55:18.983+0000 7faa5c6ac700 -1 received signal: Hangup from /usr/bin/python3 /bin/daemon-helper kill ceph-osd -f --cluster ceph -i 2 (PID: 111337) UID: 0 2023-08-01T19:55:19.026 INFO:teuthology.orchestra.run.smithi008.stdout:{ 2023-08-01T19:55:19.026 INFO:teuthology.orchestra.run.smithi008.stdout: "size": 20, 2023-08-01T19:55:19.026 INFO:teuthology.orchestra.run.smithi008.stdout: "duration": 600, 2023-08-01T19:55:19.026 INFO:teuthology.orchestra.run.smithi008.stdout: "ops": [ 2023-08-01T19:55:19.026 INFO:teuthology.orchestra.run.smithi008.stdout: { 2023-08-01T19:55:19.027 INFO:teuthology.orchestra.run.smithi008.stdout: "description": "osd_op(client.4668.0:100240 5.a 5:5313c5b9:::benchmark_data_smithi006_114134_object100239:head [set-alloc-hint object_size 65536 write_size 65536,write 0~65536] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e37)", 2023-08-01T19:55:19.027 INFO:teuthology.orchestra.run.smithi008.stdout: "initiated_at": "2023-08-01T19:55:05.148399+0000", 2023-08-01T19:55:19.027 INFO:teuthology.orchestra.run.smithi008.stdout: "age": 13.87340343, 2023-08-01T19:55:19.027 INFO:teuthology.orchestra.run.smithi008.stdout: "duration": 0.077278904999999995, 2023-08-01T19:55:19.027 INFO:teuthology.orchestra.run.smithi008.stdout: "type_data": { 2023-08-01T19:55:19.027 INFO:teuthology.orchestra.run.smithi008.stdout: "flag_point": "commit sent; apply or cleanup", 2023-08-01T19:55:19.027 INFO:teuthology.orchestra.run.smithi008.stdout: "client_info": { 2023-08-01T19:55:19.028 INFO:teuthology.orchestra.run.smithi008.stdout: "client": "client.4668", 2023-08-01T19:55:19.028 INFO:teuthology.orchestra.run.smithi008.stdout: "client_addr": "172.21.15.6:0/1709472247", 2023-08-01T19:55:19.028 INFO:teuthology.orchestra.run.smithi008.stdout: "tid": 100240 2023-08-01T19:55:19.028 INFO:teuthology.orchestra.run.smithi008.stdout: }, 2023-08-01T19:55:19.028 INFO:teuthology.orchestra.run.smithi008.stdout: "events": [ 2023-08-01T19:55:19.028 INFO:teuthology.orchestra.run.smithi008.stdout: { 2023-08-01T19:55:19.029 INFO:teuthology.orchestra.run.smithi008.stdout: "event": "initiated", 2023-08-01T19:55:19.029 INFO:teuthology.orchestra.run.smithi008.stdout: "time": "2023-08-01T19:55:05.148399+0000", 2023-08-01T19:55:19.029 INFO:teuthology.orchestra.run.smithi008.stdout: "duration": 0 2023-08-01T19:55:19.029 INFO:teuthology.orchestra.run.smithi008.stdout: }, 2023-08-01T19:55:19.029 INFO:teuthology.orchestra.run.smithi008.stdout: { 2023-08-01T19:55:19.029 INFO:teuthology.orchestra.run.smithi008.stdout: "event": "throttled", 2023-08-01T19:55:19.030 INFO:teuthology.orchestra.run.smithi008.stdout: "time": "2023-08-01T19:55:05.148399+0000", 2023-08-01T19:55:19.030 INFO:teuthology.orchestra.run.smithi008.stdout: "duration": 0 2023-08-01T19:55:19.030 INFO:teuthology.orchestra.run.smithi008.stdout: }, 2023-08-01T19:55:19.030 INFO:teuthology.orchestra.run.smithi008.stdout: { 2023-08-01T19:55:19.030 INFO:teuthology.orchestra.run.smithi008.stdout: "event": "header_read", 2023-08-01T19:55:19.030 INFO:teuthology.orchestra.run.smithi008.stdout: "time": "2023-08-01T19:55:05.148398+0000", 2023-08-01T19:55:19.030 INFO:teuthology.orchestra.run.smithi008.stdout: "duration": 4294967295.999999 2023-08-01T19:55:19.031 INFO:teuthology.orchestra.run.smithi008.stdout: }, 2023-08-01T19:55:19.031 INFO:teuthology.orchestra.run.smithi008.stdout: { 2023-08-01T19:55:19.031 INFO:teuthology.orchestra.run.smithi008.stdout: "event": "all_read", 2023-08-01T19:55:19.031 INFO:teuthology.orchestra.run.smithi008.stdout: "time": "2023-08-01T19:55:05.148492+0000", 2023-08-01T19:55:19.031 INFO:teuthology.orchestra.run.smithi008.stdout: "duration": 9.3892000000000002e-05 2023-08-01T19:55:19.031 INFO:teuthology.orchestra.run.smithi008.stdout: }, 2023-08-01T19:55:19.031 INFO:teuthology.orchestra.run.smithi008.stdout: { 2023-08-01T19:55:19.031 INFO:teuthology.orchestra.run.smithi008.stdout: "event": "dispatched", 2023-08-01T19:55:19.032 INFO:teuthology.orchestra.run.smithi008.stdout: "time": "2023-08-01T19:55:05.148503+0000", 2023-08-01T19:55:19.032 INFO:teuthology.orchestra.run.smithi008.stdout: "duration": 1.0951000000000001e-05 2023-08-01T19:55:19.032 INFO:teuthology.orchestra.run.smithi008.stdout: }, 2023-08-01T19:55:19.032 INFO:teuthology.orchestra.run.smithi008.stdout: { 2023-08-01T19:55:19.032 INFO:teuthology.orchestra.run.smithi008.stdout: "event": "queued_for_pg", 2023-08-01T19:55:19.032 INFO:teuthology.orchestra.run.smithi008.stdout: "time": "2023-08-01T19:55:05.148508+0000", 2023-08-01T19:55:19.032 INFO:teuthology.orchestra.run.smithi008.stdout: "duration": 5.0080000000000002e-06 2023-08-01T19:55:19.033 INFO:teuthology.orchestra.run.smithi008.stdout: }, 2023-08-01T19:55:19.033 INFO:teuthology.orchestra.run.smithi008.stdout: { 2023-08-01T19:55:19.033 INFO:teuthology.orchestra.run.smithi008.stdout: "event": "reached_pg", 2023-08-01T19:55:19.033 INFO:teuthology.orchestra.run.smithi008.stdout: "time": "2023-08-01T19:55:05.148548+0000", 2023-08-01T19:55:19.033 INFO:teuthology.orchestra.run.smithi008.stdout: "duration": 4.0358999999999998e-05 2023-08-01T19:55:19.033 INFO:teuthology.orchestra.run.smithi008.stdout: }, 2023-08-01T19:55:19.033 INFO:teuthology.orchestra.run.smithi008.stdout: { 2023-08-01T19:55:19.034 INFO:teuthology.orchestra.run.smithi008.stdout: "event": "started", 2023-08-01T19:55:19.034 INFO:teuthology.orchestra.run.smithi008.stdout: "time": "2023-08-01T19:55:05.148666+0000", 2023-08-01T19:55:19.034 INFO:teuthology.orchestra.run.smithi008.stdout: "duration": 0.000117621 2023-08-01T19:55:19.034 INFO:teuthology.orchestra.run.smithi008.stdout: }, 2023-08-01T19:55:19.034 INFO:teuthology.orchestra.run.smithi008.stdout: { 2023-08-01T19:55:19.034 INFO:teuthology.orchestra.run.smithi008.stdout: "event": "waiting for subops from 2", 2023-08-01T19:55:19.034 INFO:teuthology.orchestra.run.smithi008.stdout: "time": "2023-08-01T19:55:05.148805+0000", 2023-08-01T19:55:19.034 INFO:teuthology.orchestra.run.smithi008.stdout: "duration": 0.000139176 2023-08-01T19:55:19.035 INFO:teuthology.orchestra.run.smithi008.stdout: }, 2023-08-01T19:55:19.035 INFO:teuthology.orchestra.run.smithi008.stdout: { 2023-08-01T19:55:19.035 INFO:teuthology.orchestra.run.smithi008.stdout: "event": "op_commit", 2023-08-01T19:55:19.035 INFO:teuthology.orchestra.run.smithi008.stdout: "time": "2023-08-01T19:55:05.156143+0000", 2023-08-01T19:55:19.035 INFO:teuthology.orchestra.run.smithi008.stdout: "duration": 0.007338041 2023-08-01T19:55:19.035 INFO:teuthology.orchestra.run.smithi008.stdout: }, 2023-08-01T19:55:19.035 INFO:teuthology.orchestra.run.smithi008.stdout: { 2023-08-01T19:55:19.036 INFO:teuthology.orchestra.run.smithi008.stdout: "event": "sub_op_commit_rec", 2023-08-01T19:55:19.036 INFO:teuthology.orchestra.run.smithi008.stdout: "time": "2023-08-01T19:55:05.225581+0000", 2023-08-01T19:55:19.036 INFO:teuthology.orchestra.run.smithi008.stdout: "duration": 0.069438402999999996 2023-08-01T19:55:19.036 INFO:teuthology.orchestra.run.smithi008.stdout: }, 2023-08-01T19:55:19.036 INFO:teuthology.orchestra.run.smithi008.stdout: { 2023-08-01T19:55:19.036 INFO:teuthology.orchestra.run.smithi008.stdout: "event": "commit_sent", 2023-08-01T19:55:19.036 INFO:teuthology.orchestra.run.smithi008.stdout: "time": "2023-08-01T19:55:05.225632+0000", 2023-08-01T19:55:19.036 INFO:teuthology.orchestra.run.smithi008.stdout: "duration": 5.0382e-05 2023-08-01T19:55:19.037 INFO:teuthology.orchestra.run.smithi008.stdout: }, 2023-08-01T19:55:19.037 INFO:teuthology.orchestra.run.smithi008.stdout: { 2023-08-01T19:55:19.037 INFO:teuthology.orchestra.run.smithi008.stdout: "event": "done", 2023-08-01T19:55:19.037 INFO:teuthology.orchestra.run.smithi008.stdout: "time": "2023-08-01T19:55:05.225677+0000", 2023-08-01T19:55:19.037 INFO:teuthology.orchestra.run.smithi008.stdout: "duration": 4.5893000000000003e-05 2023-08-01T19:55:19.037 INFO:teuthology.orchestra.run.smithi008.stdout: } 2023-08-01T19:55:19.037 INFO:teuthology.orchestra.run.smithi008.stdout: ] 2023-08-01T19:55:19.038 INFO:teuthology.orchestra.run.smithi008.stdout: } 2023-08-01T19:55:19.038 INFO:teuthology.orchestra.run.smithi008.stdout: }, 2023-08-01T19:55:19.038 INFO:teuthology.orchestra.run.smithi008.stdout: { 2023-08-01T19:55:19.038 INFO:teuthology.orchestra.run.smithi008.stdout: "description": "osd_op(client.4668.0:100243 5.a 5:5e8193b6:::benchmark_data_smithi006_114134_object100242:head [set-alloc-hint object_size 65536 write_size 65536,write 0~65536] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e37)", 2023-08-01T19:55:19.038 INFO:teuthology.orchestra.run.smithi008.stdout: "initiated_at": "2023-08-01T19:55:05.150737+0000", 2023-08-01T19:55:19.038 INFO:teuthology.orchestra.run.smithi008.stdout: "age": 13.871064974999999, 2023-08-01T19:55:19.038 INFO:teuthology.orchestra.run.smithi008.stdout: "duration": 0.075019885999999994, 2023-08-01T19:55:19.039 INFO:teuthology.orchestra.run.smithi008.stdout: "type_data": { 2023-08-01T19:55:19.039 INFO:teuthology.orchestra.run.smithi008.stdout: "flag_point": "commit sent; apply or cleanup", 2023-08-01T19:55:19.039 INFO:teuthology.orchestra.run.smithi008.stdout: "client_info": { 2023-08-01T19:55:19.039 INFO:teuthology.orchestra.run.smithi008.stdout: "client": "client.4668", 2023-08-01T19:55:19.039 INFO:teuthology.orchestra.run.smithi008.stdout: "client_addr": "172.21.15.6:0/1709472247", 2023-08-01T19:55:19.039 INFO:teuthology.orchestra.run.smithi008.stdout: "tid": 100243 2023-08-01T19:55:19.039 INFO:teuthology.orchestra.run.smithi008.stdout: }, 2023-08-01T19:55:19.040 INFO:teuthology.orchestra.run.smithi008.stdout: "events": [ 2023-08-01T19:55:19.040 INFO:teuthology.orchestra.run.smithi008.stdout: { 2023-08-01T19:55:19.040 INFO:teuthology.orchestra.run.smithi008.stdout: "event": "initiated", 2023-08-01T19:55:19.040 INFO:teuthology.orchestra.run.smithi008.stdout: "time": "2023-08-01T19:55:05.150737+0000", 2023-08-01T19:55:19.040 INFO:teuthology.orchestra.run.smithi008.stdout: "duration": 0 2023-08-01T19:55:19.040 INFO:teuthology.orchestra.run.smithi008.stdout: }, 2023-08-01T19:55:19.040 INFO:teuthology.orchestra.run.smithi008.stdout: { 2023-08-01T19:55:19.040 INFO:teuthology.orchestra.run.smithi008.stdout: "event": "throttled", 2023-08-01T19:55:19.041 INFO:teuthology.orchestra.run.smithi008.stdout: "time": "2023-08-01T19:55:05.150737+0000", 2023-08-01T19:55:19.041 INFO:teuthology.orchestra.run.smithi008.stdout: "duration": 0 2023-08-01T19:55:19.041 INFO:teuthology.orchestra.run.smithi008.stdout: }, 2023-08-01T19:55:19.041 INFO:teuthology.orchestra.run.smithi008.stdout: { 2023-08-01T19:55:19.041 INFO:teuthology.orchestra.run.smithi008.stdout: "event": "header_read", 2023-08-01T19:55:19.041 INFO:teuthology.orchestra.run.smithi008.stdout: "time": "2023-08-01T19:55:05.150736+0000", 2023-08-01T19:55:19.041 INFO:teuthology.orchestra.run.smithi008.stdout: "duration": 4294967295.999999 2023-08-01T19:55:19.042 INFO:teuthology.orchestra.run.smithi008.stdout: }, 2023-08-01T19:55:19.042 INFO:teuthology.orchestra.run.smithi008.stdout: { 2023-08-01T19:55:19.042 INFO:teuthology.orchestra.run.smithi008.stdout: "event": "all_read", 2023-08-01T19:55:19.042 INFO:teuthology.orchestra.run.smithi008.stdout: "time": "2023-08-01T19:55:05.150780+0000", 2023-08-01T19:55:19.042 INFO:teuthology.orchestra.run.smithi008.stdout: "duration": 4.3578999999999997e-05 2023-08-01T19:55:19.042 INFO:teuthology.orchestra.run.smithi008.stdout: }, 2023-08-01T19:55:19.042 INFO:teuthology.orchestra.run.smithi008.stdout: { 2023-08-01T19:55:19.043 INFO:teuthology.orchestra.run.smithi008.stdout: "event": "dispatched", 2023-08-01T19:55:19.043 INFO:teuthology.orchestra.run.smithi008.stdout: "time": "2023-08-01T19:55:05.150791+0000", 2023-08-01T19:55:19.043 INFO:teuthology.orchestra.run.smithi008.stdout: "duration": 1.0963e-05 2023-08-01T19:55:19.043 INFO:teuthology.orchestra.run.smithi008.stdout: }, 2023-08-01T19:55:19.043 INFO:teuthology.orchestra.run.smithi008.stdout: { 2023-08-01T19:55:19.043 INFO:teuthology.orchestra.run.smithi008.stdout: "event": "queued_for_pg", 2023-08-01T19:55:19.043 INFO:teuthology.orchestra.run.smithi008.stdout: "time": "2023-08-01T19:55:05.150797+0000", 2023-08-01T19:55:19.043 INFO:teuthology.orchestra.run.smithi008.stdout: "duration": 5.9780000000000002e-06 2023-08-01T19:55:19.044 INFO:teuthology.orchestra.run.smithi008.stdout: }, 2023-08-01T19:55:19.044 INFO:teuthology.orchestra.run.smithi008.stdout: { 2023-08-01T19:55:19.044 INFO:teuthology.orchestra.run.smithi008.stdout: "event": "reached_pg", 2023-08-01T19:55:19.044 INFO:teuthology.orchestra.run.smithi008.stdout: "time": "2023-08-01T19:55:05.150833+0000", 2023-08-01T19:55:19.044 INFO:teuthology.orchestra.run.smithi008.stdout: "duration": 3.6000000000000001e-05 2023-08-01T19:55:19.044 INFO:teuthology.orchestra.run.smithi008.stdout: }, 2023-08-01T19:55:19.045 INFO:teuthology.orchestra.run.smithi008.stdout: { 2023-08-01T19:55:19.045 INFO:teuthology.orchestra.run.smithi008.stdout: "event": "started", 2023-08-01T19:55:19.045 INFO:teuthology.orchestra.run.smithi008.stdout: "time": "2023-08-01T19:55:05.150951+0000", 2023-08-01T19:55:19.045 INFO:teuthology.orchestra.run.smithi008.stdout: "duration": 0.00011827799999999999 2023-08-01T19:55:19.045 INFO:teuthology.orchestra.run.smithi008.stdout: }, 2023-08-01T19:55:19.045 INFO:teuthology.orchestra.run.smithi008.stdout: { 2023-08-01T19:55:19.045 INFO:teuthology.orchestra.run.smithi008.stdout: "event": "waiting for subops from 2", 2023-08-01T19:55:19.045 INFO:teuthology.orchestra.run.smithi008.stdout: "time": "2023-08-01T19:55:05.151111+0000", 2023-08-01T19:55:19.046 INFO:teuthology.orchestra.run.smithi008.stdout: "duration": 0.00015961299999999999 2023-08-01T19:55:19.046 INFO:teuthology.orchestra.run.smithi008.stdout: }, 2023-08-01T19:55:19.046 INFO:teuthology.orchestra.run.smithi008.stdout: { 2023-08-01T19:55:19.046 INFO:teuthology.orchestra.run.smithi008.stdout: "event": "op_commit", 2023-08-01T19:55:19.046 INFO:teuthology.orchestra.run.smithi008.stdout: "time": "2023-08-01T19:55:05.156247+0000", 2023-08-01T19:55:19.046 INFO:teuthology.orchestra.run.smithi008.stdout: "duration": 0.005136524 2023-08-01T19:55:19.046 INFO:teuthology.orchestra.run.smithi008.stdout: }, 2023-08-01T19:55:19.047 INFO:teuthology.orchestra.run.smithi008.stdout: { 2023-08-01T19:55:19.047 INFO:teuthology.orchestra.run.smithi008.stdout: "event": "sub_op_commit_rec", 2023-08-01T19:55:19.047 INFO:teuthology.orchestra.run.smithi008.stdout: "time": "2023-08-01T19:55:05.225705+0000", 2023-08-01T19:55:19.047 INFO:teuthology.orchestra.run.smithi008.stdout: "duration": 0.069458377000000002 2023-08-01T19:55:19.047 INFO:teuthology.orchestra.run.smithi008.stdout: }, 2023-08-01T19:55:19.047 INFO:teuthology.orchestra.run.smithi008.stdout: { 2023-08-01T19:55:19.047 INFO:teuthology.orchestra.run.smithi008.stdout: "event": "commit_sent", 2023-08-01T19:55:19.048 INFO:teuthology.orchestra.run.smithi008.stdout: "time": "2023-08-01T19:55:05.225736+0000", 2023-08-01T19:55:19.048 INFO:teuthology.orchestra.run.smithi008.stdout: "duration": 3.0388000000000001e-05 2023-08-01T19:55:19.048 INFO:teuthology.orchestra.run.smithi008.stdout: }, 2023-08-01T19:55:19.048 INFO:teuthology.orchestra.run.smithi008.stdout: { 2023-08-01T19:55:19.048 INFO:teuthology.orchestra.run.smithi008.stdout: "event": "done", 2023-08-01T19:55:19.048 INFO:teuthology.orchestra.run.smithi008.stdout: "time": "2023-08-01T19:55:05.225757+0000", 2023-08-01T19:55:19.048 INFO:teuthology.orchestra.run.smithi008.stdout: "duration": 2.1090999999999998e-05 2023-08-01T19:55:19.049 INFO:teuthology.orchestra.run.smithi008.stdout: } 2023-08-01T19:55:19.049 INFO:teuthology.orchestra.run.smithi008.stdout: ] 2023-08-01T19:55:19.049 INFO:teuthology.orchestra.run.smithi008.stdout: } 2023-08-01T19:55:19.049 INFO:teuthology.orchestra.run.smithi008.stdout: }, 2023-08-01T19:55:19.049 INFO:teuthology.orchestra.run.smithi008.stdout: { 2023-08-01T19:55:19.049 INFO:teuthology.orchestra.run.smithi008.stdout: "description": "osd_op(client.4668.0:100261 5.a 5:562deedb:::benchmark_data_smithi006_114134_object100260:head [set-alloc-hint object_size 65536 write_size 65536,write 0~65536] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e37)", 2023-08-01T19:55:19.050 INFO:teuthology.orchestra.run.smithi008.stdout: "initiated_at": "2023-08-01T19:55:05.163316+0000", 2023-08-01T19:55:19.050 INFO:teuthology.orchestra.run.smithi008.stdout: "age": 13.858485559, 2023-08-01T19:55:19.050 INFO:teuthology.orchestra.run.smithi008.stdout: "duration": 0.063073012999999997, 2023-08-01T19:55:19.050 INFO:teuthology.orchestra.run.smithi008.stdout: "type_data": { 2023-08-01T19:55:19.050 INFO:teuthology.orchestra.run.smithi008.stdout: "flag_point": "commit sent; apply or cleanup", 2023-08-01T19:55:19.050 INFO:teuthology.orchestra.run.smithi008.stdout: "client_info": { 2023-08-01T19:55:19.050 INFO:teuthology.orchestra.run.smithi008.stdout: "client": "client.4668", 2023-08-01T19:55:19.050 INFO:teuthology.orchestra.run.smithi008.stdout: "client_addr": "172.21.15.6:0/1709472247", 2023-08-01T19:55:19.051 INFO:teuthology.orchestra.run.smithi008.stdout: "tid": 100261 2023-08-01T19:55:19.051 INFO:teuthology.orchestra.run.smithi008.stdout: }, 2023-08-01T19:55:19.051 INFO:teuthology.orchestra.run.smithi008.stdout: "events": [ 2023-08-01T19:55:19.051 INFO:teuthology.orchestra.run.smithi008.stdout: { 2023-08-01T19:55:19.051 INFO:teuthology.orchestra.run.smithi008.stdout: "event": "initiated", 2023-08-01T19:55:19.051 INFO:teuthology.orchestra.run.smithi008.stdout: "time": "2023-08-01T19:55:05.163316+0000", 2023-08-01T19:55:19.051 INFO:teuthology.orchestra.run.smithi008.stdout: "duration": 0 2023-08-01T19:55:19.052 INFO:teuthology.orchestra.run.smithi008.stdout: }, 2023-08-01T19:55:19.052 INFO:teuthology.orchestra.run.smithi008.stdout: { 2023-08-01T19:55:19.052 INFO:teuthology.orchestra.run.smithi008.stdout: "event": "throttled", 2023-08-01T19:55:19.052 INFO:teuthology.orchestra.run.smithi008.stdout: "time": "2023-08-01T19:55:05.163316+0000", 2023-08-01T19:55:19.052 INFO:teuthology.orchestra.run.smithi008.stdout: "duration": 0 2023-08-01T19:55:19.052 INFO:teuthology.orchestra.run.smithi008.stdout: }, 2023-08-01T19:55:19.052 INFO:teuthology.orchestra.run.smithi008.stdout: { 2023-08-01T19:55:19.053 INFO:teuthology.orchestra.run.smithi008.stdout: "event": "header_read", 2023-08-01T19:55:19.053 INFO:teuthology.orchestra.run.smithi008.stdout: "time": "2023-08-01T19:55:05.163316+0000", 2023-08-01T19:55:19.053 INFO:teuthology.orchestra.run.smithi008.stdout: "duration": 4294967295.999999 2023-08-01T19:55:19.053 INFO:teuthology.orchestra.run.smithi008.stdout: }, 2023-08-01T19:55:19.053 INFO:teuthology.orchestra.run.smithi008.stdout: { 2023-08-01T19:55:19.053 INFO:teuthology.orchestra.run.smithi008.stdout: "event": "all_read", 2023-08-01T19:55:19.053 INFO:teuthology.orchestra.run.smithi008.stdout: "time": "2023-08-01T19:55:05.163380+0000", 2023-08-01T19:55:19.053 INFO:teuthology.orchestra.run.smithi008.stdout: "duration": 6.4395999999999998e-05 2023-08-01T19:55:19.054 INFO:teuthology.orchestra.run.smithi008.stdout: }, 2023-08-01T19:55:19.054 INFO:teuthology.orchestra.run.smithi008.stdout: { 2023-08-01T19:55:19.054 INFO:teuthology.orchestra.run.smithi008.stdout: "event": "dispatched", 2023-08-01T19:55:19.054 INFO:teuthology.orchestra.run.smithi008.stdout: "time": "2023-08-01T19:55:05.163390+0000", 2023-08-01T19:55:19.054 INFO:teuthology.orchestra.run.smithi008.stdout: "duration": 1.0189e-05 2023-08-01T19:55:19.054 INFO:teuthology.orchestra.run.smithi008.stdout: }, 2023-08-01T19:55:19.054 INFO:teuthology.orchestra.run.smithi008.stdout: { 2023-08-01T19:55:19.055 INFO:teuthology.orchestra.run.smithi008.stdout: "event": "queued_for_pg", 2023-08-01T19:55:19.055 INFO:teuthology.orchestra.run.smithi008.stdout: "time": "2023-08-01T19:55:05.163395+0000", 2023-08-01T19:55:19.055 INFO:teuthology.orchestra.run.smithi008.stdout: "duration": 4.4059999999999998e-06 2023-08-01T19:55:19.055 INFO:teuthology.orchestra.run.smithi008.stdout: }, 2023-08-01T19:55:19.055 INFO:teuthology.orchestra.run.smithi008.stdout: { 2023-08-01T19:55:19.055 INFO:teuthology.orchestra.run.smithi008.stdout: "event": "reached_pg", 2023-08-01T19:55:19.055 INFO:teuthology.orchestra.run.smithi008.stdout: "time": "2023-08-01T19:55:05.163429+0000", 2023-08-01T19:55:19.056 INFO:teuthology.orchestra.run.smithi008.stdout: "duration": 3.4900000000000001e-05 2023-08-01T19:55:19.056 INFO:teuthology.orchestra.run.smithi008.stdout: }, 2023-08-01T19:55:19.056 INFO:teuthology.orchestra.run.smithi008.stdout: { 2023-08-01T19:55:19.056 INFO:teuthology.orchestra.run.smithi008.stdout: "event": "started", 2023-08-01T19:55:19.056 INFO:teuthology.orchestra.run.smithi008.stdout: "time": "2023-08-01T19:55:05.163512+0000", 2023-08-01T19:55:19.056 INFO:teuthology.orchestra.run.smithi008.stdout: "duration": 8.2987999999999999e-05 2023-08-01T19:55:19.056 INFO:teuthology.orchestra.run.smithi008.stdout: }, 2023-08-01T19:55:19.057 INFO:teuthology.orchestra.run.smithi008.stdout: { 2023-08-01T19:55:19.057 INFO:teuthology.orchestra.run.smithi008.stdout: "event": "waiting for subops from 2", 2023-08-01T19:55:19.057 INFO:teuthology.orchestra.run.smithi008.stdout: "time": "2023-08-01T19:55:05.163596+0000", 2023-08-01T19:55:19.057 INFO:teuthology.orchestra.run.smithi008.stdout: "duration": 8.3783999999999996e-05 2023-08-01T19:55:19.057 INFO:teuthology.orchestra.run.smithi008.stdout: }, 2023-08-01T19:55:19.057 INFO:teuthology.orchestra.run.smithi008.stdout: { 2023-08-01T19:55:19.057 INFO:teuthology.orchestra.run.smithi008.stdout: "event": "op_commit", 2023-08-01T19:55:19.057 INFO:teuthology.orchestra.run.smithi008.stdout: "time": "2023-08-01T19:55:05.167129+0000", 2023-08-01T19:55:19.058 INFO:teuthology.orchestra.run.smithi008.stdout: "duration": 0.0035328709999999999 2023-08-01T19:55:19.058 INFO:teuthology.orchestra.run.smithi008.stdout: }, 2023-08-01T19:55:19.058 INFO:teuthology.orchestra.run.smithi008.stdout: { 2023-08-01T19:55:19.058 INFO:teuthology.orchestra.run.smithi008.stdout: "event": "sub_op_commit_rec", 2023-08-01T19:55:19.058 INFO:teuthology.orchestra.run.smithi008.stdout: "time": "2023-08-01T19:55:05.226302+0000", 2023-08-01T19:55:19.058 INFO:teuthology.orchestra.run.smithi008.stdout: "duration": 0.059172711000000003 2023-08-01T19:55:19.058 INFO:teuthology.orchestra.run.smithi008.stdout: }, 2023-08-01T19:55:19.059 INFO:teuthology.orchestra.run.smithi008.stdout: { 2023-08-01T19:55:19.059 INFO:teuthology.orchestra.run.smithi008.stdout: "event": "commit_sent", 2023-08-01T19:55:19.059 INFO:teuthology.orchestra.run.smithi008.stdout: "time": "2023-08-01T19:55:05.226351+0000", 2023-08-01T19:55:19.059 INFO:teuthology.orchestra.run.smithi008.stdout: "duration": 4.969e-05 2023-08-01T19:55:19.059 INFO:teuthology.orchestra.run.smithi008.stdout: }, 2023-08-01T19:55:19.059 INFO:teuthology.orchestra.run.smithi008.stdout: { 2023-08-01T19:55:19.059 INFO:teuthology.orchestra.run.smithi008.stdout: "event": "done", 2023-08-01T19:55:19.060 INFO:teuthology.orchestra.run.smithi008.stdout: "time": "2023-08-01T19:55:05.226389+0000", 2023-08-01T19:55:19.060 INFO:teuthology.orchestra.run.smithi008.stdout: "duration": 3.7978000000000001e-05 2023-08-01T19:55:19.060 INFO:teuthology.orchestra.run.smithi008.stdout: } 2023-08-01T19:55:19.060 INFO:teuthology.orchestra.run.smithi008.stdout: ] 2023-08-01T19:55:19.060 INFO:teuthology.orchestra.run.smithi008.stdout: } 2023-08-01T19:55:19.060 INFO:teuthology.orchestra.run.smithi008.stdout: }, 2023-08-01T19:55:19.060 INFO:teuthology.orchestra.run.smithi008.stdout: { 2023-08-01T19:55:19.061 INFO:teuthology.orchestra.run.smithi008.stdout: "description": "osd_op(client.4668.0:100262 5.a 5:5c636b5d:::benchmark_data_smithi006_114134_object100261:head [set-alloc-hint object_size 65536 write_size 65536,write 0~65536] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e37)", 2023-08-01T19:55:19.061 INFO:teuthology.orchestra.run.smithi008.stdout: "initiated_at": "2023-08-01T19:55:05.165068+0000", 2023-08-01T19:55:19.061 INFO:teuthology.orchestra.run.smithi008.stdout: "age": 13.856733906000001, 2023-08-01T19:55:19.061 INFO:teuthology.orchestra.run.smithi008.stdout: "duration": 0.063919403, 2023-08-01T19:55:19.061 INFO:teuthology.orchestra.run.smithi008.stdout: "type_data": { 2023-08-01T19:55:19.061 INFO:teuthology.orchestra.run.smithi008.stdout: "flag_point": "commit sent; apply or cleanup", 2023-08-01T19:55:19.061 INFO:teuthology.orchestra.run.smithi008.stdout: "client_info": { 2023-08-01T19:55:19.061 INFO:teuthology.orchestra.run.smithi008.stdout: "client": "client.4668", 2023-08-01T19:55:19.062 INFO:teuthology.orchestra.run.smithi008.stdout: "client_addr": "172.21.15.6:0/1709472247", 2023-08-01T19:55:19.062 INFO:teuthology.orchestra.run.smithi008.stdout: "tid": 100262 2023-08-01T19:55:19.062 INFO:teuthology.orchestra.run.smithi008.stdout: }, 2023-08-01T19:55:19.062 INFO:teuthology.orchestra.run.smithi008.stdout: "events": [ 2023-08-01T19:55:19.062 INFO:teuthology.orchestra.run.smithi008.stdout: { 2023-08-01T19:55:19.062 INFO:teuthology.orchestra.run.smithi008.stdout: "event": "initiated", 2023-08-01T19:55:19.062 INFO:teuthology.orchestra.run.smithi008.stdout: "time": "2023-08-01T19:55:05.165068+0000", 2023-08-01T19:55:19.062 INFO:teuthology.orchestra.run.smithi008.stdout: "duration": 0 2023-08-01T19:55:19.063 INFO:teuthology.orchestra.run.smithi008.stdout: }, 2023-08-01T19:55:19.063 INFO:teuthology.orchestra.run.smithi008.stdout: { 2023-08-01T19:55:19.063 INFO:teuthology.orchestra.run.smithi008.stdout: "event": "throttled", 2023-08-01T19:55:19.063 INFO:teuthology.orchestra.run.smithi008.stdout: "time": "2023-08-01T19:55:05.165068+0000", 2023-08-01T19:55:19.063 INFO:teuthology.orchestra.run.smithi008.stdout: "duration": 0 2023-08-01T19:55:19.063 INFO:teuthology.orchestra.run.smithi008.stdout: }, 2023-08-01T19:55:19.063 INFO:teuthology.orchestra.run.smithi008.stdout: { 2023-08-01T19:55:19.064 INFO:teuthology.orchestra.run.smithi008.stdout: "event": "header_read", 2023-08-01T19:55:19.064 INFO:teuthology.orchestra.run.smithi008.stdout: "time": "2023-08-01T19:55:05.165067+0000", 2023-08-01T19:55:19.064 INFO:teuthology.orchestra.run.smithi008.stdout: "duration": 4294967295.999999 2023-08-01T19:55:19.064 INFO:teuthology.orchestra.run.smithi008.stdout: }, 2023-08-01T19:55:19.064 INFO:teuthology.orchestra.run.smithi008.stdout: { 2023-08-01T19:55:19.064 INFO:teuthology.orchestra.run.smithi008.stdout: "event": "all_read", 2023-08-01T19:55:19.064 INFO:teuthology.orchestra.run.smithi008.stdout: "time": "2023-08-01T19:55:05.165126+0000", 2023-08-01T19:55:19.064 INFO:teuthology.orchestra.run.smithi008.stdout: "duration": 5.9116000000000001e-05 2023-08-01T19:55:19.065 INFO:teuthology.orchestra.run.smithi008.stdout: }, 2023-08-01T19:55:19.065 INFO:teuthology.orchestra.run.smithi008.stdout: { 2023-08-01T19:55:19.065 INFO:teuthology.orchestra.run.smithi008.stdout: "event": "dispatched", 2023-08-01T19:55:19.065 INFO:teuthology.orchestra.run.smithi008.stdout: "time": "2023-08-01T19:55:05.165134+0000", 2023-08-01T19:55:19.065 INFO:teuthology.orchestra.run.smithi008.stdout: "duration": 7.9820000000000008e-06 2023-08-01T19:55:19.065 INFO:teuthology.orchestra.run.smithi008.stdout: }, 2023-08-01T19:55:19.065 INFO:teuthology.orchestra.run.smithi008.stdout: { 2023-08-01T19:55:19.066 INFO:teuthology.orchestra.run.smithi008.stdout: "event": "queued_for_pg", 2023-08-01T19:55:19.066 INFO:teuthology.orchestra.run.smithi008.stdout: "time": "2023-08-01T19:55:05.165139+0000", 2023-08-01T19:55:19.066 INFO:teuthology.orchestra.run.smithi008.stdout: "duration": 4.2560000000000004e-06 2023-08-01T19:55:19.066 INFO:teuthology.orchestra.run.smithi008.stdout: }, 2023-08-01T19:55:19.066 INFO:teuthology.orchestra.run.smithi008.stdout: { 2023-08-01T19:55:19.066 INFO:teuthology.orchestra.run.smithi008.stdout: "event": "reached_pg", 2023-08-01T19:55:19.066 INFO:teuthology.orchestra.run.smithi008.stdout: "time": "2023-08-01T19:55:05.165165+0000", 2023-08-01T19:55:19.066 INFO:teuthology.orchestra.run.smithi008.stdout: "duration": 2.6554e-05 2023-08-01T19:55:19.067 INFO:teuthology.orchestra.run.smithi008.stdout: }, 2023-08-01T19:55:19.067 INFO:teuthology.orchestra.run.smithi008.stdout: { 2023-08-01T19:55:19.067 INFO:teuthology.orchestra.run.smithi008.stdout: "event": "started", 2023-08-01T19:55:19.067 INFO:teuthology.orchestra.run.smithi008.stdout: "time": "2023-08-01T19:55:05.165243+0000", 2023-08-01T19:55:19.068 INFO:teuthology.orchestra.run.smithi008.stdout: "duration": 7.7877e-05 2023-08-01T19:55:19.068 INFO:teuthology.orchestra.run.smithi008.stdout: }, 2023-08-01T19:55:19.068 INFO:teuthology.orchestra.run.smithi008.stdout: { 2023-08-01T19:55:19.068 INFO:teuthology.orchestra.run.smithi008.stdout: "event": "waiting for subops from 2", 2023-08-01T19:55:19.068 INFO:teuthology.orchestra.run.smithi008.stdout: "time": "2023-08-01T19:55:05.165450+0000", 2023-08-01T19:55:19.068 INFO:teuthology.orchestra.run.smithi008.stdout: "duration": 0.00020655599999999999 2023-08-01T19:55:19.069 INFO:teuthology.orchestra.run.smithi008.stdout: }, 2023-08-01T19:55:19.069 INFO:teuthology.orchestra.run.smithi008.stdout: { 2023-08-01T19:55:19.069 INFO:teuthology.orchestra.run.smithi008.stdout: "event": "op_commit", 2023-08-01T19:55:19.069 INFO:teuthology.orchestra.run.smithi008.stdout: "time": "2023-08-01T19:55:05.168883+0000", 2023-08-01T19:55:19.069 INFO:teuthology.orchestra.run.smithi008.stdout: "duration": 0.0034333279999999998 2023-08-01T19:55:19.069 INFO:teuthology.orchestra.run.smithi008.stdout: }, 2023-08-01T19:55:19.069 INFO:teuthology.orchestra.run.smithi008.stdout: { 2023-08-01T19:55:19.070 INFO:teuthology.orchestra.run.smithi008.stdout: "event": "sub_op_commit_rec", 2023-08-01T19:55:19.070 INFO:teuthology.orchestra.run.smithi008.stdout: "time": "2023-08-01T19:55:05.228904+0000", 2023-08-01T19:55:19.070 INFO:teuthology.orchestra.run.smithi008.stdout: "duration": 0.060021370999999997 2023-08-01T19:55:19.070 INFO:teuthology.orchestra.run.smithi008.stdout: }, 2023-08-01T19:55:19.070 INFO:teuthology.orchestra.run.smithi008.stdout: { 2023-08-01T19:55:19.070 INFO:teuthology.orchestra.run.smithi008.stdout: "event": "commit_sent", 2023-08-01T19:55:19.070 INFO:teuthology.orchestra.run.smithi008.stdout: "time": "2023-08-01T19:55:05.228952+0000", 2023-08-01T19:55:19.071 INFO:teuthology.orchestra.run.smithi008.stdout: "duration": 4.8056999999999997e-05 2023-08-01T19:55:19.071 INFO:teuthology.orchestra.run.smithi008.stdout: }, 2023-08-01T19:55:19.071 INFO:teuthology.orchestra.run.smithi008.stdout: { 2023-08-01T19:55:19.071 INFO:teuthology.orchestra.run.smithi008.stdout: "event": "done", 2023-08-01T19:55:19.071 INFO:teuthology.orchestra.run.smithi008.stdout: "time": "2023-08-01T19:55:05.228987+0000", 2023-08-01T19:55:19.071 INFO:teuthology.orchestra.run.smithi008.stdout: "duration": 3.5083000000000003e-05 2023-08-01T19:55:19.071 INFO:teuthology.orchestra.run.smithi008.stdout: } 2023-08-01T19:55:19.071 INFO:teuthology.orchestra.run.smithi008.stdout: ] 2023-08-01T19:55:19.072 INFO:teuthology.orchestra.run.smithi008.stdout: } 2023-08-01T19:55:19.072 INFO:teuthology.orchestra.run.smithi008.stdout: }, 2023-08-01T19:55:19.072 INFO:teuthology.orchestra.run.smithi008.stdout: { 2023-08-01T19:55:19.072 INFO:teuthology.orchestra.run.smithi008.stdout: "description": "osd_op(client.4668.0:100929 5.3 5:c29f4adb:::benchmark_data_smithi006_114134_object100928:head [set-alloc-hint object_size 65536 write_size 65536,write 0~65536] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e37)", 2023-08-01T19:55:19.072 INFO:teuthology.orchestra.run.smithi008.stdout: "initiated_at": "2023-08-01T19:55:05.564759+0000", 2023-08-01T19:55:19.072 INFO:teuthology.orchestra.run.smithi008.stdout: "age": 13.457043267, 2023-08-01T19:55:19.072 INFO:teuthology.orchestra.run.smithi008.stdout: "duration": 0.062544635000000001, 2023-08-01T19:55:19.073 INFO:teuthology.orchestra.run.smithi008.stdout: "type_data": { 2023-08-01T19:55:19.073 INFO:teuthology.orchestra.run.smithi008.stdout: "flag_point": "commit sent; apply or cleanup", 2023-08-01T19:55:19.073 INFO:teuthology.orchestra.run.smithi008.stdout: "client_info": { 2023-08-01T19:55:19.073 INFO:teuthology.orchestra.run.smithi008.stdout: "client": "client.4668", 2023-08-01T19:55:19.073 INFO:teuthology.orchestra.run.smithi008.stdout: "client_addr": "172.21.15.6:0/1709472247", 2023-08-01T19:55:19.073 INFO:teuthology.orchestra.run.smithi008.stdout: "tid": 100929 2023-08-01T19:55:19.074 INFO:teuthology.orchestra.run.smithi008.stdout: }, 2023-08-01T19:55:19.074 INFO:teuthology.orchestra.run.smithi008.stdout: "events": [ 2023-08-01T19:55:19.074 INFO:teuthology.orchestra.run.smithi008.stdout: { 2023-08-01T19:55:19.074 INFO:teuthology.orchestra.run.smithi008.stdout: "event": "initiated", 2023-08-01T19:55:19.074 INFO:teuthology.orchestra.run.smithi008.stdout: "time": "2023-08-01T19:55:05.564759+0000", 2023-08-01T19:55:19.074 INFO:teuthology.orchestra.run.smithi008.stdout: "duration": 0 2023-08-01T19:55:19.075 INFO:teuthology.orchestra.run.smithi008.stdout: }, 2023-08-01T19:55:19.075 INFO:teuthology.orchestra.run.smithi008.stdout: { 2023-08-01T19:55:19.075 INFO:teuthology.orchestra.run.smithi008.stdout: "event": "throttled", 2023-08-01T19:55:19.075 INFO:teuthology.orchestra.run.smithi008.stdout: "time": "2023-08-01T19:55:05.564759+0000", 2023-08-01T19:55:19.075 INFO:teuthology.orchestra.run.smithi008.stdout: "duration": 0 2023-08-01T19:55:19.075 INFO:teuthology.orchestra.run.smithi008.stdout: }, 2023-08-01T19:55:19.075 INFO:teuthology.orchestra.run.smithi008.stdout: { 2023-08-01T19:55:19.075 INFO:teuthology.orchestra.run.smithi008.stdout: "event": "header_read", 2023-08-01T19:55:19.076 INFO:teuthology.orchestra.run.smithi008.stdout: "time": "2023-08-01T19:55:05.564758+0000", 2023-08-01T19:55:19.076 INFO:teuthology.orchestra.run.smithi008.stdout: "duration": 4294967295.999999 2023-08-01T19:55:19.076 INFO:teuthology.orchestra.run.smithi008.stdout: }, 2023-08-01T19:55:19.076 INFO:teuthology.orchestra.run.smithi008.stdout: { 2023-08-01T19:55:19.076 INFO:teuthology.orchestra.run.smithi008.stdout: "event": "all_read", 2023-08-01T19:55:19.076 INFO:teuthology.orchestra.run.smithi008.stdout: "time": "2023-08-01T19:55:05.564815+0000", 2023-08-01T19:55:19.076 INFO:teuthology.orchestra.run.smithi008.stdout: "duration": 5.7757000000000003e-05 2023-08-01T19:55:19.077 INFO:teuthology.orchestra.run.smithi008.stdout: }, 2023-08-01T19:55:19.077 INFO:teuthology.orchestra.run.smithi008.stdout: { 2023-08-01T19:55:19.077 INFO:teuthology.orchestra.run.smithi008.stdout: "event": "dispatched", 2023-08-01T19:55:19.077 INFO:teuthology.orchestra.run.smithi008.stdout: "time": "2023-08-01T19:55:05.564824+0000", 2023-08-01T19:55:19.077 INFO:teuthology.orchestra.run.smithi008.stdout: "duration": 8.6559999999999998e-06 2023-08-01T19:55:19.077 INFO:teuthology.orchestra.run.smithi008.stdout: }, 2023-08-01T19:55:19.077 INFO:teuthology.orchestra.run.smithi008.stdout: { 2023-08-01T19:55:19.078 INFO:teuthology.orchestra.run.smithi008.stdout: "event": "queued_for_pg", 2023-08-01T19:55:19.078 INFO:teuthology.orchestra.run.smithi008.stdout: "time": "2023-08-01T19:55:05.564829+0000", 2023-08-01T19:55:19.078 INFO:teuthology.orchestra.run.smithi008.stdout: "duration": 4.6160000000000004e-06 2023-08-01T19:55:19.078 INFO:teuthology.orchestra.run.smithi008.stdout: }, 2023-08-01T19:55:19.078 INFO:teuthology.orchestra.run.smithi008.stdout: { 2023-08-01T19:55:19.078 INFO:teuthology.orchestra.run.smithi008.stdout: "event": "reached_pg", 2023-08-01T19:55:19.078 INFO:teuthology.orchestra.run.smithi008.stdout: "time": "2023-08-01T19:55:05.564871+0000", 2023-08-01T19:55:19.079 INFO:teuthology.orchestra.run.smithi008.stdout: "duration": 4.2206000000000002e-05 2023-08-01T19:55:19.079 INFO:teuthology.orchestra.run.smithi008.stdout: }, 2023-08-01T19:55:19.079 INFO:teuthology.orchestra.run.smithi008.stdout: { 2023-08-01T19:55:19.079 INFO:teuthology.orchestra.run.smithi008.stdout: "event": "started", 2023-08-01T19:55:19.079 INFO:teuthology.orchestra.run.smithi008.stdout: "time": "2023-08-01T19:55:05.565011+0000", 2023-08-01T19:55:19.079 INFO:teuthology.orchestra.run.smithi008.stdout: "duration": 0.000140469 2023-08-01T19:55:19.079 INFO:teuthology.orchestra.run.smithi008.stdout: }, 2023-08-01T19:55:19.080 INFO:teuthology.orchestra.run.smithi008.stdout: { 2023-08-01T19:55:19.080 INFO:teuthology.orchestra.run.smithi008.stdout: "event": "waiting for subops from 1", 2023-08-01T19:55:19.080 INFO:teuthology.orchestra.run.smithi008.stdout: "time": "2023-08-01T19:55:05.565212+0000", 2023-08-01T19:55:19.080 INFO:teuthology.orchestra.run.smithi008.stdout: "duration": 0.00020106599999999999 2023-08-01T19:55:19.080 INFO:teuthology.orchestra.run.smithi008.stdout: }, 2023-08-01T19:55:19.080 INFO:teuthology.orchestra.run.smithi008.stdout: { 2023-08-01T19:55:19.080 INFO:teuthology.orchestra.run.smithi008.stdout: "event": "sub_op_commit_rec", 2023-08-01T19:55:19.081 INFO:teuthology.orchestra.run.smithi008.stdout: "time": "2023-08-01T19:55:05.626925+0000", 2023-08-01T19:55:19.081 INFO:teuthology.orchestra.run.smithi008.stdout: "duration": 0.061712111 2023-08-01T19:55:19.081 INFO:teuthology.orchestra.run.smithi008.stdout: }, 2023-08-01T19:55:19.081 INFO:teuthology.orchestra.run.smithi008.stdout: { 2023-08-01T19:55:19.081 INFO:teuthology.orchestra.run.smithi008.stdout: "event": "op_commit", 2023-08-01T19:55:19.081 INFO:teuthology.orchestra.run.smithi008.stdout: "time": "2023-08-01T19:55:05.627217+0000", 2023-08-01T19:55:19.081 INFO:teuthology.orchestra.run.smithi008.stdout: "duration": 0.00029265999999999998 2023-08-01T19:55:19.082 INFO:teuthology.orchestra.run.smithi008.stdout: }, 2023-08-01T19:55:19.082 INFO:teuthology.orchestra.run.smithi008.stdout: { 2023-08-01T19:55:19.082 INFO:teuthology.orchestra.run.smithi008.stdout: "event": "commit_sent", 2023-08-01T19:55:19.082 INFO:teuthology.orchestra.run.smithi008.stdout: "time": "2023-08-01T19:55:05.627264+0000", 2023-08-01T19:55:19.082 INFO:teuthology.orchestra.run.smithi008.stdout: "duration": 4.6260000000000001e-05 2023-08-01T19:55:19.082 INFO:teuthology.orchestra.run.smithi008.stdout: }, 2023-08-01T19:55:19.082 INFO:teuthology.orchestra.run.smithi008.stdout: { 2023-08-01T19:55:19.083 INFO:teuthology.orchestra.run.smithi008.stdout: "event": "done", 2023-08-01T19:55:19.083 INFO:teuthology.orchestra.run.smithi008.stdout: "time": "2023-08-01T19:55:05.627303+0000", 2023-08-01T19:55:19.083 INFO:teuthology.orchestra.run.smithi008.stdout: "duration": 3.9839999999999998e-05 2023-08-01T19:55:19.083 INFO:teuthology.orchestra.run.smithi008.stdout: } 2023-08-01T19:55:19.083 INFO:teuthology.orchestra.run.smithi008.stdout: ] 2023-08-01T19:55:19.083 INFO:teuthology.orchestra.run.smithi008.stdout: } 2023-08-01T19:55:19.083 INFO:teuthology.orchestra.run.smithi008.stdout: }, 2023-08-01T19:55:19.084 INFO:teuthology.orchestra.run.smithi008.stdout: { 2023-08-01T19:55:19.084 INFO:teuthology.orchestra.run.smithi008.stdout: "description": "osd_repop(client.4668.0:100928 5.7 e37/19 5:e61a7dfa:::benchmark_data_smithi006_114134_object100927:head v 37'6273, mlcod=37'6270)", 2023-08-01T19:55:19.084 INFO:teuthology.orchestra.run.smithi008.stdout: "initiated_at": "2023-08-01T19:55:05.565106+0000", 2023-08-01T19:55:19.084 INFO:teuthology.orchestra.run.smithi008.stdout: "age": 13.456696169000001, 2023-08-01T19:55:19.084 INFO:teuthology.orchestra.run.smithi008.stdout: "duration": 0.064091282999999999, 2023-08-01T19:55:19.084 INFO:teuthology.orchestra.run.smithi008.stdout: "type_data": { 2023-08-01T19:55:19.084 INFO:teuthology.orchestra.run.smithi008.stdout: "flag_point": "commit sent; apply or cleanup", 2023-08-01T19:55:19.085 INFO:teuthology.orchestra.run.smithi008.stdout: "events": [ 2023-08-01T19:55:19.085 INFO:teuthology.orchestra.run.smithi008.stdout: { 2023-08-01T19:55:19.085 INFO:teuthology.orchestra.run.smithi008.stdout: "event": "initiated", 2023-08-01T19:55:19.085 INFO:teuthology.orchestra.run.smithi008.stdout: "time": "2023-08-01T19:55:05.565106+0000", 2023-08-01T19:55:19.085 INFO:teuthology.orchestra.run.smithi008.stdout: "duration": 0 2023-08-01T19:55:19.085 INFO:teuthology.orchestra.run.smithi008.stdout: }, 2023-08-01T19:55:19.085 INFO:teuthology.orchestra.run.smithi008.stdout: { 2023-08-01T19:55:19.085 INFO:teuthology.orchestra.run.smithi008.stdout: "event": "throttled", 2023-08-01T19:55:19.086 INFO:teuthology.orchestra.run.smithi008.stdout: "time": "2023-08-01T19:55:05.565106+0000", 2023-08-01T19:55:19.086 INFO:teuthology.orchestra.run.smithi008.stdout: "duration": 0 2023-08-01T19:55:19.086 INFO:teuthology.orchestra.run.smithi008.stdout: }, 2023-08-01T19:55:19.086 INFO:teuthology.orchestra.run.smithi008.stdout: { 2023-08-01T19:55:19.086 INFO:teuthology.orchestra.run.smithi008.stdout: "event": "header_read", 2023-08-01T19:55:19.086 INFO:teuthology.orchestra.run.smithi008.stdout: "time": "2023-08-01T19:55:05.565105+0000", 2023-08-01T19:55:19.086 INFO:teuthology.orchestra.run.smithi008.stdout: "duration": 4294967295.9999995 2023-08-01T19:55:19.087 INFO:teuthology.orchestra.run.smithi008.stdout: }, 2023-08-01T19:55:19.087 INFO:teuthology.orchestra.run.smithi008.stdout: { 2023-08-01T19:55:19.087 INFO:teuthology.orchestra.run.smithi008.stdout: "event": "all_read", 2023-08-01T19:55:19.087 INFO:teuthology.orchestra.run.smithi008.stdout: "time": "2023-08-01T19:55:05.565173+0000", 2023-08-01T19:55:19.087 INFO:teuthology.orchestra.run.smithi008.stdout: "duration": 6.8186000000000001e-05 2023-08-01T19:55:19.087 INFO:teuthology.orchestra.run.smithi008.stdout: }, 2023-08-01T19:55:19.087 INFO:teuthology.orchestra.run.smithi008.stdout: { 2023-08-01T19:55:19.087 INFO:teuthology.orchestra.run.smithi008.stdout: "event": "dispatched", 2023-08-01T19:55:19.088 INFO:teuthology.orchestra.run.smithi008.stdout: "time": "2023-08-01T19:55:05.565182+0000", 2023-08-01T19:55:19.088 INFO:teuthology.orchestra.run.smithi008.stdout: "duration": 8.3620000000000006e-06 2023-08-01T19:55:19.088 INFO:teuthology.orchestra.run.smithi008.stdout: }, 2023-08-01T19:55:19.088 INFO:teuthology.orchestra.run.smithi008.stdout: { 2023-08-01T19:55:19.088 INFO:teuthology.orchestra.run.smithi008.stdout: "event": "queued_for_pg", 2023-08-01T19:55:19.088 INFO:teuthology.orchestra.run.smithi008.stdout: "time": "2023-08-01T19:55:05.565186+0000", 2023-08-01T19:55:19.088 INFO:teuthology.orchestra.run.smithi008.stdout: "duration": 3.7680000000000002e-06 2023-08-01T19:55:19.089 INFO:teuthology.orchestra.run.smithi008.stdout: }, 2023-08-01T19:55:19.089 INFO:teuthology.orchestra.run.smithi008.stdout: { 2023-08-01T19:55:19.089 INFO:teuthology.orchestra.run.smithi008.stdout: "event": "reached_pg", 2023-08-01T19:55:19.089 INFO:teuthology.orchestra.run.smithi008.stdout: "time": "2023-08-01T19:55:05.565212+0000", 2023-08-01T19:55:19.089 INFO:teuthology.orchestra.run.smithi008.stdout: "duration": 2.6230000000000001e-05 2023-08-01T19:55:19.089 INFO:teuthology.orchestra.run.smithi008.stdout: }, 2023-08-01T19:55:19.089 INFO:teuthology.orchestra.run.smithi008.stdout: { 2023-08-01T19:55:19.090 INFO:teuthology.orchestra.run.smithi008.stdout: "event": "started", 2023-08-01T19:55:19.090 INFO:teuthology.orchestra.run.smithi008.stdout: "time": "2023-08-01T19:55:05.565224+0000", 2023-08-01T19:55:19.090 INFO:teuthology.orchestra.run.smithi008.stdout: "duration": 1.2033e-05 2023-08-01T19:55:19.090 INFO:teuthology.orchestra.run.smithi008.stdout: }, 2023-08-01T19:55:19.090 INFO:teuthology.orchestra.run.smithi008.stdout: { 2023-08-01T19:55:19.090 INFO:teuthology.orchestra.run.smithi008.stdout: "event": "commit_sent", 2023-08-01T19:55:19.090 INFO:teuthology.orchestra.run.smithi008.stdout: "time": "2023-08-01T19:55:05.629152+0000", 2023-08-01T19:55:19.091 INFO:teuthology.orchestra.run.smithi008.stdout: "duration": 0.063928378999999994 2023-08-01T19:55:19.091 INFO:teuthology.orchestra.run.smithi008.stdout: }, 2023-08-01T19:55:19.091 INFO:teuthology.orchestra.run.smithi008.stdout: { 2023-08-01T19:55:19.091 INFO:teuthology.orchestra.run.smithi008.stdout: "event": "done", 2023-08-01T19:55:19.091 INFO:teuthology.orchestra.run.smithi008.stdout: "time": "2023-08-01T19:55:05.629197+0000", 2023-08-01T19:55:19.091 INFO:teuthology.orchestra.run.smithi008.stdout: "duration": 4.4894000000000001e-05 2023-08-01T19:55:19.091 INFO:teuthology.orchestra.run.smithi008.stdout: } 2023-08-01T19:55:19.091 INFO:teuthology.orchestra.run.smithi008.stdout: ] 2023-08-01T19:55:19.092 INFO:teuthology.orchestra.run.smithi008.stdout: } 2023-08-01T19:55:19.092 INFO:teuthology.orchestra.run.smithi008.stdout: }, 2023-08-01T19:55:19.092 INFO:teuthology.orchestra.run.smithi008.stdout: { 2023-08-01T19:55:19.092 INFO:teuthology.orchestra.run.smithi008.stdout: "description": "osd_repop(client.4668.0:100927 5.0 e37/19 5:00608ec6:::benchmark_data_smithi006_114134_object100926:head v 37'6408, mlcod=37'6403)", 2023-08-01T19:55:19.092 INFO:teuthology.orchestra.run.smithi008.stdout: "initiated_at": "2023-08-01T19:55:05.565153+0000", 2023-08-01T19:55:19.092 INFO:teuthology.orchestra.run.smithi008.stdout: "age": 13.456649432000001, 2023-08-01T19:55:19.092 INFO:teuthology.orchestra.run.smithi008.stdout: "duration": 0.062202714999999999, 2023-08-01T19:55:19.093 INFO:teuthology.orchestra.run.smithi008.stdout: "type_data": { 2023-08-01T19:55:19.093 INFO:teuthology.orchestra.run.smithi008.stdout: "flag_point": "commit sent; apply or cleanup", 2023-08-01T19:55:19.093 INFO:teuthology.orchestra.run.smithi008.stdout: "events": [ 2023-08-01T19:55:19.093 INFO:teuthology.orchestra.run.smithi008.stdout: { 2023-08-01T19:55:19.093 INFO:teuthology.orchestra.run.smithi008.stdout: "event": "initiated", 2023-08-01T19:55:19.093 INFO:teuthology.orchestra.run.smithi008.stdout: "time": "2023-08-01T19:55:05.565153+0000", 2023-08-01T19:55:19.093 INFO:teuthology.orchestra.run.smithi008.stdout: "duration": 0 2023-08-01T19:55:19.093 INFO:teuthology.orchestra.run.smithi008.stdout: }, 2023-08-01T19:55:19.094 INFO:teuthology.orchestra.run.smithi008.stdout: { 2023-08-01T19:55:19.094 INFO:teuthology.orchestra.run.smithi008.stdout: "event": "throttled", 2023-08-01T19:55:19.094 INFO:teuthology.orchestra.run.smithi008.stdout: "time": "2023-08-01T19:55:05.565153+0000", 2023-08-01T19:55:19.094 INFO:teuthology.orchestra.run.smithi008.stdout: "duration": 0 2023-08-01T19:55:19.094 INFO:teuthology.orchestra.run.smithi008.stdout: }, 2023-08-01T19:55:19.094 INFO:teuthology.orchestra.run.smithi008.stdout: { 2023-08-01T19:55:19.094 INFO:teuthology.orchestra.run.smithi008.stdout: "event": "header_read", 2023-08-01T19:55:19.094 INFO:teuthology.orchestra.run.smithi008.stdout: "time": "2023-08-01T19:55:05.565152+0000", 2023-08-01T19:55:19.095 INFO:teuthology.orchestra.run.smithi008.stdout: "duration": 4294967295.9999995 2023-08-01T19:55:19.095 INFO:teuthology.orchestra.run.smithi008.stdout: }, 2023-08-01T19:55:19.095 INFO:teuthology.orchestra.run.smithi008.stdout: { 2023-08-01T19:55:19.095 INFO:teuthology.orchestra.run.smithi008.stdout: "event": "all_read", 2023-08-01T19:55:19.095 INFO:teuthology.orchestra.run.smithi008.stdout: "time": "2023-08-01T19:55:05.565225+0000", 2023-08-01T19:55:19.095 INFO:teuthology.orchestra.run.smithi008.stdout: "duration": 7.2471000000000005e-05 2023-08-01T19:55:19.095 INFO:teuthology.orchestra.run.smithi008.stdout: }, 2023-08-01T19:55:19.095 INFO:teuthology.orchestra.run.smithi008.stdout: { 2023-08-01T19:55:19.096 INFO:teuthology.orchestra.run.smithi008.stdout: "event": "dispatched", 2023-08-01T19:55:19.096 INFO:teuthology.orchestra.run.smithi008.stdout: "time": "2023-08-01T19:55:05.565229+0000", 2023-08-01T19:55:19.096 INFO:teuthology.orchestra.run.smithi008.stdout: "duration": 4.5600000000000004e-06 2023-08-01T19:55:19.096 INFO:teuthology.orchestra.run.smithi008.stdout: }, 2023-08-01T19:55:19.096 INFO:teuthology.orchestra.run.smithi008.stdout: { 2023-08-01T19:55:19.096 INFO:teuthology.orchestra.run.smithi008.stdout: "event": "queued_for_pg", 2023-08-01T19:55:19.096 INFO:teuthology.orchestra.run.smithi008.stdout: "time": "2023-08-01T19:55:05.565232+0000", 2023-08-01T19:55:19.097 INFO:teuthology.orchestra.run.smithi008.stdout: "duration": 2.6900000000000001e-06 2023-08-01T19:55:19.097 INFO:teuthology.orchestra.run.smithi008.stdout: }, 2023-08-01T19:55:19.097 INFO:teuthology.orchestra.run.smithi008.stdout: { 2023-08-01T19:55:19.097 INFO:teuthology.orchestra.run.smithi008.stdout: "event": "reached_pg", 2023-08-01T19:55:19.097 INFO:teuthology.orchestra.run.smithi008.stdout: "time": "2023-08-01T19:55:05.565283+0000", 2023-08-01T19:55:19.097 INFO:teuthology.orchestra.run.smithi008.stdout: "duration": 5.1442e-05 2023-08-01T19:55:19.097 INFO:teuthology.orchestra.run.smithi008.stdout: }, 2023-08-01T19:55:19.097 INFO:teuthology.orchestra.run.smithi008.stdout: { 2023-08-01T19:55:19.098 INFO:teuthology.orchestra.run.smithi008.stdout: "event": "started", 2023-08-01T19:55:19.098 INFO:teuthology.orchestra.run.smithi008.stdout: "time": "2023-08-01T19:55:05.565301+0000", 2023-08-01T19:55:19.098 INFO:teuthology.orchestra.run.smithi008.stdout: "duration": 1.8029e-05 2023-08-01T19:55:19.098 INFO:teuthology.orchestra.run.smithi008.stdout: }, 2023-08-01T19:55:19.098 INFO:teuthology.orchestra.run.smithi008.stdout: { 2023-08-01T19:55:19.098 INFO:teuthology.orchestra.run.smithi008.stdout: "event": "commit_sent", 2023-08-01T19:55:19.098 INFO:teuthology.orchestra.run.smithi008.stdout: "time": "2023-08-01T19:55:05.627318+0000", 2023-08-01T19:55:19.098 INFO:teuthology.orchestra.run.smithi008.stdout: "duration": 0.062016763000000003 2023-08-01T19:55:19.099 INFO:teuthology.orchestra.run.smithi008.stdout: }, 2023-08-01T19:55:19.099 INFO:teuthology.orchestra.run.smithi008.stdout: { 2023-08-01T19:55:19.099 INFO:teuthology.orchestra.run.smithi008.stdout: "event": "done", 2023-08-01T19:55:19.099 INFO:teuthology.orchestra.run.smithi008.stdout: "time": "2023-08-01T19:55:05.627355+0000", 2023-08-01T19:55:19.099 INFO:teuthology.orchestra.run.smithi008.stdout: "duration": 3.7258999999999997e-05 2023-08-01T19:55:19.099 INFO:teuthology.orchestra.run.smithi008.stdout: } 2023-08-01T19:55:19.100 INFO:teuthology.orchestra.run.smithi008.stdout: ] 2023-08-01T19:55:19.100 INFO:teuthology.orchestra.run.smithi008.stdout: } 2023-08-01T19:55:19.100 INFO:teuthology.orchestra.run.smithi008.stdout: }, 2023-08-01T19:55:19.100 INFO:teuthology.orchestra.run.smithi008.stdout: { 2023-08-01T19:55:19.100 INFO:teuthology.orchestra.run.smithi008.stdout: "description": "osd_op(client.4668.0:100930 5.5 5:a7b64eb3:::benchmark_data_smithi006_114134_object100929:head [set-alloc-hint object_size 65536 write_size 65536,write 0~65536] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e37)", 2023-08-01T19:55:19.100 INFO:teuthology.orchestra.run.smithi008.stdout: "initiated_at": "2023-08-01T19:55:05.565766+0000", 2023-08-01T19:55:19.100 INFO:teuthology.orchestra.run.smithi008.stdout: "age": 13.456035647, 2023-08-01T19:55:19.101 INFO:teuthology.orchestra.run.smithi008.stdout: "duration": 0.063668735000000004, 2023-08-01T19:55:19.101 INFO:teuthology.orchestra.run.smithi008.stdout: "type_data": { 2023-08-01T19:55:19.101 INFO:teuthology.orchestra.run.smithi008.stdout: "flag_point": "commit sent; apply or cleanup", 2023-08-01T19:55:19.101 INFO:teuthology.orchestra.run.smithi008.stdout: "client_info": { 2023-08-01T19:55:19.101 INFO:teuthology.orchestra.run.smithi008.stdout: "client": "client.4668", 2023-08-01T19:55:19.101 INFO:teuthology.orchestra.run.smithi008.stdout: "client_addr": "172.21.15.6:0/1709472247", 2023-08-01T19:55:19.101 INFO:teuthology.orchestra.run.smithi008.stdout: "tid": 100930 2023-08-01T19:55:19.102 INFO:teuthology.orchestra.run.smithi008.stdout: }, 2023-08-01T19:55:19.102 INFO:teuthology.orchestra.run.smithi008.stdout: "events": [ 2023-08-01T19:55:19.102 INFO:teuthology.orchestra.run.smithi008.stdout: { 2023-08-01T19:55:19.102 INFO:teuthology.orchestra.run.smithi008.stdout: "event": "initiated", 2023-08-01T19:55:19.102 INFO:teuthology.orchestra.run.smithi008.stdout: "time": "2023-08-01T19:55:05.565766+0000", 2023-08-01T19:55:19.102 INFO:teuthology.orchestra.run.smithi008.stdout: "duration": 0 2023-08-01T19:55:19.102 INFO:teuthology.orchestra.run.smithi008.stdout: }, 2023-08-01T19:55:19.102 INFO:teuthology.orchestra.run.smithi008.stdout: { 2023-08-01T19:55:19.103 INFO:teuthology.orchestra.run.smithi008.stdout: "event": "throttled", 2023-08-01T19:55:19.103 INFO:teuthology.orchestra.run.smithi008.stdout: "time": "2023-08-01T19:55:05.565766+0000", 2023-08-01T19:55:19.103 INFO:teuthology.orchestra.run.smithi008.stdout: "duration": 0 2023-08-01T19:55:19.103 INFO:teuthology.orchestra.run.smithi008.stdout: }, 2023-08-01T19:55:19.103 INFO:teuthology.orchestra.run.smithi008.stdout: { 2023-08-01T19:55:19.103 INFO:teuthology.orchestra.run.smithi008.stdout: "event": "header_read", 2023-08-01T19:55:19.103 INFO:teuthology.orchestra.run.smithi008.stdout: "time": "2023-08-01T19:55:05.565766+0000", 2023-08-01T19:55:19.103 INFO:teuthology.orchestra.run.smithi008.stdout: "duration": 4294967295.999999 2023-08-01T19:55:19.104 INFO:teuthology.orchestra.run.smithi008.stdout: }, 2023-08-01T19:55:19.104 INFO:teuthology.orchestra.run.smithi008.stdout: { 2023-08-01T19:55:19.104 INFO:teuthology.orchestra.run.smithi008.stdout: "event": "all_read", 2023-08-01T19:55:19.104 INFO:teuthology.orchestra.run.smithi008.stdout: "time": "2023-08-01T19:55:05.565855+0000", 2023-08-01T19:55:19.104 INFO:teuthology.orchestra.run.smithi008.stdout: "duration": 8.9166999999999995e-05 2023-08-01T19:55:19.104 INFO:teuthology.orchestra.run.smithi008.stdout: }, 2023-08-01T19:55:19.104 INFO:teuthology.orchestra.run.smithi008.stdout: { 2023-08-01T19:55:19.105 INFO:teuthology.orchestra.run.smithi008.stdout: "event": "dispatched", 2023-08-01T19:55:19.105 INFO:teuthology.orchestra.run.smithi008.stdout: "time": "2023-08-01T19:55:05.565862+0000", 2023-08-01T19:55:19.105 INFO:teuthology.orchestra.run.smithi008.stdout: "duration": 7.4549999999999998e-06 2023-08-01T19:55:19.105 INFO:teuthology.orchestra.run.smithi008.stdout: }, 2023-08-01T19:55:19.105 INFO:teuthology.orchestra.run.smithi008.stdout: { 2023-08-01T19:55:19.105 INFO:teuthology.orchestra.run.smithi008.stdout: "event": "queued_for_pg", 2023-08-01T19:55:19.105 INFO:teuthology.orchestra.run.smithi008.stdout: "time": "2023-08-01T19:55:05.565866+0000", 2023-08-01T19:55:19.105 INFO:teuthology.orchestra.run.smithi008.stdout: "duration": 3.8060000000000001e-06 2023-08-01T19:55:19.106 INFO:teuthology.orchestra.run.smithi008.stdout: }, 2023-08-01T19:55:19.106 INFO:teuthology.orchestra.run.smithi008.stdout: { 2023-08-01T19:55:19.106 INFO:teuthology.orchestra.run.smithi008.stdout: "event": "reached_pg", 2023-08-01T19:55:19.106 INFO:teuthology.orchestra.run.smithi008.stdout: "time": "2023-08-01T19:55:05.565901+0000", 2023-08-01T19:55:19.106 INFO:teuthology.orchestra.run.smithi008.stdout: "duration": 3.5063e-05 2023-08-01T19:55:19.106 INFO:teuthology.orchestra.run.smithi008.stdout: }, 2023-08-01T19:55:19.106 INFO:teuthology.orchestra.run.smithi008.stdout: { 2023-08-01T19:55:19.106 INFO:teuthology.orchestra.run.smithi008.stdout: "event": "started", 2023-08-01T19:55:19.107 INFO:teuthology.orchestra.run.smithi008.stdout: "time": "2023-08-01T19:55:05.566016+0000", 2023-08-01T19:55:19.107 INFO:teuthology.orchestra.run.smithi008.stdout: "duration": 0.00011509400000000001 2023-08-01T19:55:19.107 INFO:teuthology.orchestra.run.smithi008.stdout: }, 2023-08-01T19:55:19.107 INFO:teuthology.orchestra.run.smithi008.stdout: { 2023-08-01T19:55:19.107 INFO:teuthology.orchestra.run.smithi008.stdout: "event": "waiting for subops from 1", 2023-08-01T19:55:19.107 INFO:teuthology.orchestra.run.smithi008.stdout: "time": "2023-08-01T19:55:05.566154+0000", 2023-08-01T19:55:19.107 INFO:teuthology.orchestra.run.smithi008.stdout: "duration": 0.000138052 2023-08-01T19:55:19.107 INFO:teuthology.orchestra.run.smithi008.stdout: }, 2023-08-01T19:55:19.108 INFO:teuthology.orchestra.run.smithi008.stdout: { 2023-08-01T19:55:19.108 INFO:teuthology.orchestra.run.smithi008.stdout: "event": "sub_op_commit_rec", 2023-08-01T19:55:19.108 INFO:teuthology.orchestra.run.smithi008.stdout: "time": "2023-08-01T19:55:05.629279+0000", 2023-08-01T19:55:19.108 INFO:teuthology.orchestra.run.smithi008.stdout: "duration": 0.063124531999999997 2023-08-01T19:55:19.108 INFO:teuthology.orchestra.run.smithi008.stdout: }, 2023-08-01T19:55:19.108 INFO:teuthology.orchestra.run.smithi008.stdout: { 2023-08-01T19:55:19.108 INFO:teuthology.orchestra.run.smithi008.stdout: "event": "op_commit", 2023-08-01T19:55:19.109 INFO:teuthology.orchestra.run.smithi008.stdout: "time": "2023-08-01T19:55:05.629333+0000", 2023-08-01T19:55:19.109 INFO:teuthology.orchestra.run.smithi008.stdout: "duration": 5.4694999999999997e-05 2023-08-01T19:55:19.109 INFO:teuthology.orchestra.run.smithi008.stdout: }, 2023-08-01T19:55:19.109 INFO:teuthology.orchestra.run.smithi008.stdout: { 2023-08-01T19:55:19.109 INFO:teuthology.orchestra.run.smithi008.stdout: "event": "commit_sent", 2023-08-01T19:55:19.109 INFO:teuthology.orchestra.run.smithi008.stdout: "time": "2023-08-01T19:55:05.629390+0000", 2023-08-01T19:55:19.109 INFO:teuthology.orchestra.run.smithi008.stdout: "duration": 5.6416000000000003e-05 2023-08-01T19:55:19.110 INFO:teuthology.orchestra.run.smithi008.stdout: }, 2023-08-01T19:55:19.110 INFO:teuthology.orchestra.run.smithi008.stdout: { 2023-08-01T19:55:19.110 INFO:teuthology.orchestra.run.smithi008.stdout: "event": "done", 2023-08-01T19:55:19.110 INFO:teuthology.orchestra.run.smithi008.stdout: "time": "2023-08-01T19:55:05.629435+0000", 2023-08-01T19:55:19.110 INFO:teuthology.orchestra.run.smithi008.stdout: "duration": 4.5170999999999998e-05 2023-08-01T19:55:19.110 INFO:teuthology.orchestra.run.smithi008.stdout: } 2023-08-01T19:55:19.110 INFO:teuthology.orchestra.run.smithi008.stdout: ] 2023-08-01T19:55:19.111 INFO:teuthology.orchestra.run.smithi008.stdout: } 2023-08-01T19:55:19.111 INFO:teuthology.orchestra.run.smithi008.stdout: }, 2023-08-01T19:55:19.111 INFO:teuthology.orchestra.run.smithi008.stdout: { 2023-08-01T19:55:19.111 INFO:teuthology.orchestra.run.smithi008.stdout: "description": "osd_op(client.4668.0:100933 5.5 5:af92e9f2:::benchmark_data_smithi006_114134_object100932:head [set-alloc-hint object_size 65536 write_size 65536,write 0~65536] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e37)", 2023-08-01T19:55:19.111 INFO:teuthology.orchestra.run.smithi008.stdout: "initiated_at": "2023-08-01T19:55:05.566634+0000", 2023-08-01T19:55:19.111 INFO:teuthology.orchestra.run.smithi008.stdout: "age": 13.455168104, 2023-08-01T19:55:19.111 INFO:teuthology.orchestra.run.smithi008.stdout: "duration": 0.065909364999999998, 2023-08-01T19:55:19.111 INFO:teuthology.orchestra.run.smithi008.stdout: "type_data": { 2023-08-01T19:55:19.112 INFO:teuthology.orchestra.run.smithi008.stdout: "flag_point": "commit sent; apply or cleanup", 2023-08-01T19:55:19.112 INFO:teuthology.orchestra.run.smithi008.stdout: "client_info": { 2023-08-01T19:55:19.112 INFO:teuthology.orchestra.run.smithi008.stdout: "client": "client.4668", 2023-08-01T19:55:19.112 INFO:teuthology.orchestra.run.smithi008.stdout: "client_addr": "172.21.15.6:0/1709472247", 2023-08-01T19:55:19.112 INFO:teuthology.orchestra.run.smithi008.stdout: "tid": 100933 2023-08-01T19:55:19.112 INFO:teuthology.orchestra.run.smithi008.stdout: }, 2023-08-01T19:55:19.112 INFO:teuthology.orchestra.run.smithi008.stdout: "events": [ 2023-08-01T19:55:19.113 INFO:teuthology.orchestra.run.smithi008.stdout: { 2023-08-01T19:55:19.113 INFO:teuthology.orchestra.run.smithi008.stdout: "event": "initiated", 2023-08-01T19:55:19.113 INFO:teuthology.orchestra.run.smithi008.stdout: "time": "2023-08-01T19:55:05.566634+0000", 2023-08-01T19:55:19.113 INFO:teuthology.orchestra.run.smithi008.stdout: "duration": 0 2023-08-01T19:55:19.113 INFO:teuthology.orchestra.run.smithi008.stdout: }, 2023-08-01T19:55:19.113 INFO:teuthology.orchestra.run.smithi008.stdout: { 2023-08-01T19:55:19.113 INFO:teuthology.orchestra.run.smithi008.stdout: "event": "throttled", 2023-08-01T19:55:19.113 INFO:teuthology.orchestra.run.smithi008.stdout: "time": "2023-08-01T19:55:05.566634+0000", 2023-08-01T19:55:19.114 INFO:teuthology.orchestra.run.smithi008.stdout: "duration": 0 2023-08-01T19:55:19.114 INFO:teuthology.orchestra.run.smithi008.stdout: }, 2023-08-01T19:55:19.114 INFO:teuthology.orchestra.run.smithi008.stdout: { 2023-08-01T19:55:19.114 INFO:teuthology.orchestra.run.smithi008.stdout: "event": "header_read", 2023-08-01T19:55:19.114 INFO:teuthology.orchestra.run.smithi008.stdout: "time": "2023-08-01T19:55:05.566630+0000", 2023-08-01T19:55:19.114 INFO:teuthology.orchestra.run.smithi008.stdout: "duration": 4294967295.9999962 2023-08-01T19:55:19.114 INFO:teuthology.orchestra.run.smithi008.stdout: }, 2023-08-01T19:55:19.115 INFO:teuthology.orchestra.run.smithi008.stdout: { 2023-08-01T19:55:19.115 INFO:teuthology.orchestra.run.smithi008.stdout: "event": "all_read", 2023-08-01T19:55:19.115 INFO:teuthology.orchestra.run.smithi008.stdout: "time": "2023-08-01T19:55:05.566736+0000", 2023-08-01T19:55:19.115 INFO:teuthology.orchestra.run.smithi008.stdout: "duration": 0.000105752 2023-08-01T19:55:19.115 INFO:teuthology.orchestra.run.smithi008.stdout: }, 2023-08-01T19:55:19.115 INFO:teuthology.orchestra.run.smithi008.stdout: { 2023-08-01T19:55:19.115 INFO:teuthology.orchestra.run.smithi008.stdout: "event": "dispatched", 2023-08-01T19:55:19.115 INFO:teuthology.orchestra.run.smithi008.stdout: "time": "2023-08-01T19:55:05.566742+0000", 2023-08-01T19:55:19.116 INFO:teuthology.orchestra.run.smithi008.stdout: "duration": 5.8209999999999998e-06 2023-08-01T19:55:19.116 INFO:teuthology.orchestra.run.smithi008.stdout: }, 2023-08-01T19:55:19.116 INFO:teuthology.orchestra.run.smithi008.stdout: { 2023-08-01T19:55:19.116 INFO:teuthology.orchestra.run.smithi008.stdout: "event": "queued_for_pg", 2023-08-01T19:55:19.116 INFO:teuthology.orchestra.run.smithi008.stdout: "time": "2023-08-01T19:55:05.566745+0000", 2023-08-01T19:55:19.116 INFO:teuthology.orchestra.run.smithi008.stdout: "duration": 3.337e-06 2023-08-01T19:55:19.116 INFO:teuthology.orchestra.run.smithi008.stdout: }, 2023-08-01T19:55:19.117 INFO:teuthology.orchestra.run.smithi008.stdout: { 2023-08-01T19:55:19.117 INFO:teuthology.orchestra.run.smithi008.stdout: "event": "reached_pg", 2023-08-01T19:55:19.117 INFO:teuthology.orchestra.run.smithi008.stdout: "time": "2023-08-01T19:55:05.568175+0000", 2023-08-01T19:55:19.117 INFO:teuthology.orchestra.run.smithi008.stdout: "duration": 0.001429647 2023-08-01T19:55:19.117 INFO:teuthology.orchestra.run.smithi008.stdout: }, 2023-08-01T19:55:19.117 INFO:teuthology.orchestra.run.smithi008.stdout: { 2023-08-01T19:55:19.117 INFO:teuthology.orchestra.run.smithi008.stdout: "event": "started", 2023-08-01T19:55:19.118 INFO:teuthology.orchestra.run.smithi008.stdout: "time": "2023-08-01T19:55:05.568288+0000", 2023-08-01T19:55:19.118 INFO:teuthology.orchestra.run.smithi008.stdout: "duration": 0.000113353 2023-08-01T19:55:19.118 INFO:teuthology.orchestra.run.smithi008.stdout: }, 2023-08-01T19:55:19.118 INFO:teuthology.orchestra.run.smithi008.stdout: { 2023-08-01T19:55:19.118 INFO:teuthology.orchestra.run.smithi008.stdout: "event": "waiting for subops from 1", 2023-08-01T19:55:19.118 INFO:teuthology.orchestra.run.smithi008.stdout: "time": "2023-08-01T19:55:05.568425+0000", 2023-08-01T19:55:19.118 INFO:teuthology.orchestra.run.smithi008.stdout: "duration": 0.000137346 2023-08-01T19:55:19.119 INFO:teuthology.orchestra.run.smithi008.stdout: }, 2023-08-01T19:55:19.119 INFO:teuthology.orchestra.run.smithi008.stdout: { 2023-08-01T19:55:19.119 INFO:teuthology.orchestra.run.smithi008.stdout: "event": "sub_op_commit_rec", 2023-08-01T19:55:19.119 INFO:teuthology.orchestra.run.smithi008.stdout: "time": "2023-08-01T19:55:05.629320+0000", 2023-08-01T19:55:19.119 INFO:teuthology.orchestra.run.smithi008.stdout: "duration": 0.060894491000000002 2023-08-01T19:55:19.119 INFO:teuthology.orchestra.run.smithi008.stdout: }, 2023-08-01T19:55:19.119 INFO:teuthology.orchestra.run.smithi008.stdout: { 2023-08-01T19:55:19.120 INFO:teuthology.orchestra.run.smithi008.stdout: "event": "op_commit", 2023-08-01T19:55:19.120 INFO:teuthology.orchestra.run.smithi008.stdout: "time": "2023-08-01T19:55:05.632452+0000", 2023-08-01T19:55:19.120 INFO:teuthology.orchestra.run.smithi008.stdout: "duration": 0.003131909 2023-08-01T19:55:19.120 INFO:teuthology.orchestra.run.smithi008.stdout: }, 2023-08-01T19:55:19.120 INFO:teuthology.orchestra.run.smithi008.stdout: { 2023-08-01T19:55:19.120 INFO:teuthology.orchestra.run.smithi008.stdout: "event": "commit_sent", 2023-08-01T19:55:19.120 INFO:teuthology.orchestra.run.smithi008.stdout: "time": "2023-08-01T19:55:05.632503+0000", 2023-08-01T19:55:19.121 INFO:teuthology.orchestra.run.smithi008.stdout: "duration": 5.1295000000000003e-05 2023-08-01T19:55:19.121 INFO:teuthology.orchestra.run.smithi008.stdout: }, 2023-08-01T19:55:19.121 INFO:teuthology.orchestra.run.smithi008.stdout: { 2023-08-01T19:55:19.121 INFO:teuthology.orchestra.run.smithi008.stdout: "event": "done", 2023-08-01T19:55:19.121 INFO:teuthology.orchestra.run.smithi008.stdout: "time": "2023-08-01T19:55:05.632543+0000", 2023-08-01T19:55:19.121 INFO:teuthology.orchestra.run.smithi008.stdout: "duration": 4.0234000000000001e-05 2023-08-01T19:55:19.121 INFO:teuthology.orchestra.run.smithi008.stdout: } 2023-08-01T19:55:19.121 INFO:teuthology.orchestra.run.smithi008.stdout: ] 2023-08-01T19:55:19.122 INFO:teuthology.orchestra.run.smithi008.stdout: } 2023-08-01T19:55:19.122 INFO:teuthology.orchestra.run.smithi008.stdout: }, 2023-08-01T19:55:19.122 INFO:teuthology.orchestra.run.smithi008.stdout: { 2023-08-01T19:55:19.122 INFO:teuthology.orchestra.run.smithi008.stdout: "description": "osd_repop(client.4668.0:100935 5.e e37/19 5:7895b14e:::benchmark_data_smithi006_114134_object100934:head v 37'6305, mlcod=37'6303)", 2023-08-01T19:55:19.122 INFO:teuthology.orchestra.run.smithi008.stdout: "initiated_at": "2023-08-01T19:55:05.567118+0000", 2023-08-01T19:55:19.122 INFO:teuthology.orchestra.run.smithi008.stdout: "age": 13.454683860999999, 2023-08-01T19:55:19.122 INFO:teuthology.orchestra.run.smithi008.stdout: "duration": 0.063691180999999999, 2023-08-01T19:55:19.122 INFO:teuthology.orchestra.run.smithi008.stdout: "type_data": { 2023-08-01T19:55:19.123 INFO:teuthology.orchestra.run.smithi008.stdout: "flag_point": "commit sent; apply or cleanup", 2023-08-01T19:55:19.123 INFO:teuthology.orchestra.run.smithi008.stdout: "events": [ 2023-08-01T19:55:19.123 INFO:teuthology.orchestra.run.smithi008.stdout: { 2023-08-01T19:55:19.123 INFO:teuthology.orchestra.run.smithi008.stdout: "event": "initiated", 2023-08-01T19:55:19.123 INFO:teuthology.orchestra.run.smithi008.stdout: "time": "2023-08-01T19:55:05.567118+0000", 2023-08-01T19:55:19.123 INFO:teuthology.orchestra.run.smithi008.stdout: "duration": 0 2023-08-01T19:55:19.123 INFO:teuthology.orchestra.run.smithi008.stdout: }, 2023-08-01T19:55:19.124 INFO:teuthology.orchestra.run.smithi008.stdout: { 2023-08-01T19:55:19.124 INFO:teuthology.orchestra.run.smithi008.stdout: "event": "throttled", 2023-08-01T19:55:19.124 INFO:teuthology.orchestra.run.smithi008.stdout: "time": "2023-08-01T19:55:05.567118+0000", 2023-08-01T19:55:19.124 INFO:teuthology.orchestra.run.smithi008.stdout: "duration": 0 2023-08-01T19:55:19.124 INFO:teuthology.orchestra.run.smithi008.stdout: }, 2023-08-01T19:55:19.124 INFO:teuthology.orchestra.run.smithi008.stdout: { 2023-08-01T19:55:19.124 INFO:teuthology.orchestra.run.smithi008.stdout: "event": "header_read", 2023-08-01T19:55:19.125 INFO:teuthology.orchestra.run.smithi008.stdout: "time": "2023-08-01T19:55:05.567117+0000", 2023-08-01T19:55:19.125 INFO:teuthology.orchestra.run.smithi008.stdout: "duration": 4294967295.999999 2023-08-01T19:55:19.125 INFO:teuthology.orchestra.run.smithi008.stdout: }, 2023-08-01T19:55:19.125 INFO:teuthology.orchestra.run.smithi008.stdout: { 2023-08-01T19:55:19.125 INFO:teuthology.orchestra.run.smithi008.stdout: "event": "all_read", 2023-08-01T19:55:19.125 INFO:teuthology.orchestra.run.smithi008.stdout: "time": "2023-08-01T19:55:05.567168+0000", 2023-08-01T19:55:19.125 INFO:teuthology.orchestra.run.smithi008.stdout: "duration": 5.0353999999999999e-05 2023-08-01T19:55:19.126 INFO:teuthology.orchestra.run.smithi008.stdout: }, 2023-08-01T19:55:19.126 INFO:teuthology.orchestra.run.smithi008.stdout: { 2023-08-01T19:55:19.126 INFO:teuthology.orchestra.run.smithi008.stdout: "event": "dispatched", 2023-08-01T19:55:19.126 INFO:teuthology.orchestra.run.smithi008.stdout: "time": "2023-08-01T19:55:05.567175+0000", 2023-08-01T19:55:19.126 INFO:teuthology.orchestra.run.smithi008.stdout: "duration": 7.3919999999999997e-06 2023-08-01T19:55:19.126 INFO:teuthology.orchestra.run.smithi008.stdout: }, 2023-08-01T19:55:19.126 INFO:teuthology.orchestra.run.smithi008.stdout: { 2023-08-01T19:55:19.127 INFO:teuthology.orchestra.run.smithi008.stdout: "event": "queued_for_pg", 2023-08-01T19:55:19.127 INFO:teuthology.orchestra.run.smithi008.stdout: "time": "2023-08-01T19:55:05.567180+0000", 2023-08-01T19:55:19.127 INFO:teuthology.orchestra.run.smithi008.stdout: "duration": 5.3090000000000003e-06 2023-08-01T19:55:19.127 INFO:teuthology.orchestra.run.smithi008.stdout: }, 2023-08-01T19:55:19.127 INFO:teuthology.orchestra.run.smithi008.stdout: { 2023-08-01T19:55:19.127 INFO:teuthology.orchestra.run.smithi008.stdout: "event": "reached_pg", 2023-08-01T19:55:19.127 INFO:teuthology.orchestra.run.smithi008.stdout: "time": "2023-08-01T19:55:05.567210+0000", 2023-08-01T19:55:19.127 INFO:teuthology.orchestra.run.smithi008.stdout: "duration": 3.0001999999999998e-05 2023-08-01T19:55:19.128 INFO:teuthology.orchestra.run.smithi008.stdout: }, 2023-08-01T19:55:19.128 INFO:teuthology.orchestra.run.smithi008.stdout: { 2023-08-01T19:55:19.128 INFO:teuthology.orchestra.run.smithi008.stdout: "event": "started", 2023-08-01T19:55:19.128 INFO:teuthology.orchestra.run.smithi008.stdout: "time": "2023-08-01T19:55:05.567222+0000", 2023-08-01T19:55:19.128 INFO:teuthology.orchestra.run.smithi008.stdout: "duration": 1.1499e-05 2023-08-01T19:55:19.128 INFO:teuthology.orchestra.run.smithi008.stdout: }, 2023-08-01T19:55:19.128 INFO:teuthology.orchestra.run.smithi008.stdout: { 2023-08-01T19:55:19.129 INFO:teuthology.orchestra.run.smithi008.stdout: "event": "commit_sent", 2023-08-01T19:55:19.129 INFO:teuthology.orchestra.run.smithi008.stdout: "time": "2023-08-01T19:55:05.630772+0000", 2023-08-01T19:55:19.129 INFO:teuthology.orchestra.run.smithi008.stdout: "duration": 0.063550572999999999 2023-08-01T19:55:19.129 INFO:teuthology.orchestra.run.smithi008.stdout: }, 2023-08-01T19:55:19.129 INFO:teuthology.orchestra.run.smithi008.stdout: { 2023-08-01T19:55:19.129 INFO:teuthology.orchestra.run.smithi008.stdout: "event": "done", 2023-08-01T19:55:19.129 INFO:teuthology.orchestra.run.smithi008.stdout: "time": "2023-08-01T19:55:05.630809+0000", 2023-08-01T19:55:19.130 INFO:teuthology.orchestra.run.smithi008.stdout: "duration": 3.7033000000000003e-05 2023-08-01T19:55:19.130 INFO:teuthology.orchestra.run.smithi008.stdout: } 2023-08-01T19:55:19.130 INFO:teuthology.orchestra.run.smithi008.stdout: ] 2023-08-01T19:55:19.130 INFO:teuthology.orchestra.run.smithi008.stdout: } 2023-08-01T19:55:19.130 INFO:teuthology.orchestra.run.smithi008.stdout: }, 2023-08-01T19:55:19.130 INFO:teuthology.orchestra.run.smithi008.stdout: { 2023-08-01T19:55:19.130 INFO:teuthology.orchestra.run.smithi008.stdout: "description": "osd_repop(client.4668.0:100936 5.1 e37/19 5:8f4e3576:::benchmark_data_smithi006_114134_object100935:head v 37'6263, mlcod=37'6261)", 2023-08-01T19:55:19.131 INFO:teuthology.orchestra.run.smithi008.stdout: "initiated_at": "2023-08-01T19:55:05.567617+0000", 2023-08-01T19:55:19.131 INFO:teuthology.orchestra.run.smithi008.stdout: "age": 13.454184597999999, 2023-08-01T19:55:19.131 INFO:teuthology.orchestra.run.smithi008.stdout: "duration": 0.062773918999999997, 2023-08-01T19:55:19.131 INFO:teuthology.orchestra.run.smithi008.stdout: "type_data": { 2023-08-01T19:55:19.131 INFO:teuthology.orchestra.run.smithi008.stdout: "flag_point": "commit sent; apply or cleanup", 2023-08-01T19:55:19.131 INFO:teuthology.orchestra.run.smithi008.stdout: "events": [ 2023-08-01T19:55:19.131 INFO:teuthology.orchestra.run.smithi008.stdout: { 2023-08-01T19:55:19.132 INFO:teuthology.orchestra.run.smithi008.stdout: "event": "initiated", 2023-08-01T19:55:19.132 INFO:teuthology.orchestra.run.smithi008.stdout: "time": "2023-08-01T19:55:05.567617+0000", 2023-08-01T19:55:19.132 INFO:teuthology.orchestra.run.smithi008.stdout: "duration": 0 2023-08-01T19:55:19.132 INFO:teuthology.orchestra.run.smithi008.stdout: }, 2023-08-01T19:55:19.132 INFO:teuthology.orchestra.run.smithi008.stdout: { 2023-08-01T19:55:19.132 INFO:teuthology.orchestra.run.smithi008.stdout: "event": "throttled", 2023-08-01T19:55:19.132 INFO:teuthology.orchestra.run.smithi008.stdout: "time": "2023-08-01T19:55:05.567617+0000", 2023-08-01T19:55:19.132 INFO:teuthology.orchestra.run.smithi008.stdout: "duration": 0 2023-08-01T19:55:19.133 INFO:teuthology.orchestra.run.smithi008.stdout: }, 2023-08-01T19:55:19.133 INFO:teuthology.orchestra.run.smithi008.stdout: { 2023-08-01T19:55:19.133 INFO:teuthology.orchestra.run.smithi008.stdout: "event": "header_read", 2023-08-01T19:55:19.133 INFO:teuthology.orchestra.run.smithi008.stdout: "time": "2023-08-01T19:55:05.567617+0000", 2023-08-01T19:55:19.133 INFO:teuthology.orchestra.run.smithi008.stdout: "duration": 4294967295.9999995 2023-08-01T19:55:19.133 INFO:teuthology.orchestra.run.smithi008.stdout: }, 2023-08-01T19:55:19.133 INFO:teuthology.orchestra.run.smithi008.stdout: { 2023-08-01T19:55:19.133 INFO:teuthology.orchestra.run.smithi008.stdout: "event": "all_read", 2023-08-01T19:55:19.134 INFO:teuthology.orchestra.run.smithi008.stdout: "time": "2023-08-01T19:55:05.567700+0000", 2023-08-01T19:55:19.134 INFO:teuthology.orchestra.run.smithi008.stdout: "duration": 8.3363999999999997e-05 2023-08-01T19:55:19.134 INFO:teuthology.orchestra.run.smithi008.stdout: }, 2023-08-01T19:55:19.134 INFO:teuthology.orchestra.run.smithi008.stdout: { 2023-08-01T19:55:19.134 INFO:teuthology.orchestra.run.smithi008.stdout: "event": "dispatched", 2023-08-01T19:55:19.134 INFO:teuthology.orchestra.run.smithi008.stdout: "time": "2023-08-01T19:55:05.567706+0000", 2023-08-01T19:55:19.134 INFO:teuthology.orchestra.run.smithi008.stdout: "duration": 5.9739999999999999e-06 2023-08-01T19:55:19.135 INFO:teuthology.orchestra.run.smithi008.stdout: }, 2023-08-01T19:55:19.135 INFO:teuthology.orchestra.run.smithi008.stdout: { 2023-08-01T19:55:19.135 INFO:teuthology.orchestra.run.smithi008.stdout: "event": "queued_for_pg", 2023-08-01T19:55:19.135 INFO:teuthology.orchestra.run.smithi008.stdout: "time": "2023-08-01T19:55:05.567709+0000", 2023-08-01T19:55:19.135 INFO:teuthology.orchestra.run.smithi008.stdout: "duration": 3.1420000000000002e-06 2023-08-01T19:55:19.135 INFO:teuthology.orchestra.run.smithi008.stdout: }, 2023-08-01T19:55:19.135 INFO:teuthology.orchestra.run.smithi008.stdout: { 2023-08-01T19:55:19.135 INFO:teuthology.orchestra.run.smithi008.stdout: "event": "reached_pg", 2023-08-01T19:55:19.136 INFO:teuthology.orchestra.run.smithi008.stdout: "time": "2023-08-01T19:55:05.567741+0000", 2023-08-01T19:55:19.136 INFO:teuthology.orchestra.run.smithi008.stdout: "duration": 3.1532999999999998e-05 2023-08-01T19:55:19.136 INFO:teuthology.orchestra.run.smithi008.stdout: }, 2023-08-01T19:55:19.136 INFO:teuthology.orchestra.run.smithi008.stdout: { 2023-08-01T19:55:19.136 INFO:teuthology.orchestra.run.smithi008.stdout: "event": "started", 2023-08-01T19:55:19.136 INFO:teuthology.orchestra.run.smithi008.stdout: "time": "2023-08-01T19:55:05.567752+0000", 2023-08-01T19:55:19.136 INFO:teuthology.orchestra.run.smithi008.stdout: "duration": 1.1266e-05 2023-08-01T19:55:19.136 INFO:teuthology.orchestra.run.smithi008.stdout: }, 2023-08-01T19:55:19.137 INFO:teuthology.orchestra.run.smithi008.stdout: { 2023-08-01T19:55:19.137 INFO:teuthology.orchestra.run.smithi008.stdout: "event": "commit_sent", 2023-08-01T19:55:19.137 INFO:teuthology.orchestra.run.smithi008.stdout: "time": "2023-08-01T19:55:05.630357+0000", 2023-08-01T19:55:19.137 INFO:teuthology.orchestra.run.smithi008.stdout: "duration": 0.062604554000000007 2023-08-01T19:55:19.137 INFO:teuthology.orchestra.run.smithi008.stdout: }, 2023-08-01T19:55:19.137 INFO:teuthology.orchestra.run.smithi008.stdout: { 2023-08-01T19:55:19.137 INFO:teuthology.orchestra.run.smithi008.stdout: "event": "done", 2023-08-01T19:55:19.137 INFO:teuthology.orchestra.run.smithi008.stdout: "time": "2023-08-01T19:55:05.630391+0000", 2023-08-01T19:55:19.138 INFO:teuthology.orchestra.run.smithi008.stdout: "duration": 3.4619000000000002e-05 2023-08-01T19:55:19.138 INFO:teuthology.orchestra.run.smithi008.stdout: } 2023-08-01T19:55:19.138 INFO:teuthology.orchestra.run.smithi008.stdout: ] 2023-08-01T19:55:19.138 INFO:teuthology.orchestra.run.smithi008.stdout: } 2023-08-01T19:55:19.138 INFO:teuthology.orchestra.run.smithi008.stdout: }, 2023-08-01T19:55:19.138 INFO:teuthology.orchestra.run.smithi008.stdout: { 2023-08-01T19:55:19.138 INFO:teuthology.orchestra.run.smithi008.stdout: "description": "osd_op(client.4668.0:100937 5.c 5:34445fc3:::benchmark_data_smithi006_114134_object100936:head [set-alloc-hint object_size 65536 write_size 65536,write 0~65536] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e37)", 2023-08-01T19:55:19.139 INFO:teuthology.orchestra.run.smithi008.stdout: "initiated_at": "2023-08-01T19:55:05.569198+0000", 2023-08-01T19:55:19.139 INFO:teuthology.orchestra.run.smithi008.stdout: "age": 13.452603975000001, 2023-08-01T19:55:19.139 INFO:teuthology.orchestra.run.smithi008.stdout: "duration": 0.063349390000000005, 2023-08-01T19:55:19.139 INFO:teuthology.orchestra.run.smithi008.stdout: "type_data": { 2023-08-01T19:55:19.139 INFO:teuthology.orchestra.run.smithi008.stdout: "flag_point": "commit sent; apply or cleanup", 2023-08-01T19:55:19.139 INFO:teuthology.orchestra.run.smithi008.stdout: "client_info": { 2023-08-01T19:55:19.139 INFO:teuthology.orchestra.run.smithi008.stdout: "client": "client.4668", 2023-08-01T19:55:19.140 INFO:teuthology.orchestra.run.smithi008.stdout: "client_addr": "172.21.15.6:0/1709472247", 2023-08-01T19:55:19.140 INFO:teuthology.orchestra.run.smithi008.stdout: "tid": 100937 2023-08-01T19:55:19.140 INFO:teuthology.orchestra.run.smithi008.stdout: }, 2023-08-01T19:55:19.140 INFO:teuthology.orchestra.run.smithi008.stdout: "events": [ 2023-08-01T19:55:19.140 INFO:teuthology.orchestra.run.smithi008.stdout: { 2023-08-01T19:55:19.140 INFO:teuthology.orchestra.run.smithi008.stdout: "event": "initiated", 2023-08-01T19:55:19.140 INFO:teuthology.orchestra.run.smithi008.stdout: "time": "2023-08-01T19:55:05.569198+0000", 2023-08-01T19:55:19.141 INFO:teuthology.orchestra.run.smithi008.stdout: "duration": 0 2023-08-01T19:55:19.141 INFO:teuthology.orchestra.run.smithi008.stdout: }, 2023-08-01T19:55:19.141 INFO:teuthology.orchestra.run.smithi008.stdout: { 2023-08-01T19:55:19.141 INFO:teuthology.orchestra.run.smithi008.stdout: "event": "throttled", 2023-08-01T19:55:19.141 INFO:teuthology.orchestra.run.smithi008.stdout: "time": "2023-08-01T19:55:05.569198+0000", 2023-08-01T19:55:19.141 INFO:teuthology.orchestra.run.smithi008.stdout: "duration": 0 2023-08-01T19:55:19.141 INFO:teuthology.orchestra.run.smithi008.stdout: }, 2023-08-01T19:55:19.141 INFO:teuthology.orchestra.run.smithi008.stdout: { 2023-08-01T19:55:19.142 INFO:teuthology.orchestra.run.smithi008.stdout: "event": "header_read", 2023-08-01T19:55:19.142 INFO:teuthology.orchestra.run.smithi008.stdout: "time": "2023-08-01T19:55:05.569197+0000", 2023-08-01T19:55:19.142 INFO:teuthology.orchestra.run.smithi008.stdout: "duration": 4294967295.999999 2023-08-01T19:55:19.142 INFO:teuthology.orchestra.run.smithi008.stdout: }, 2023-08-01T19:55:19.142 INFO:teuthology.orchestra.run.smithi008.stdout: { 2023-08-01T19:55:19.142 INFO:teuthology.orchestra.run.smithi008.stdout: "event": "all_read", 2023-08-01T19:55:19.142 INFO:teuthology.orchestra.run.smithi008.stdout: "time": "2023-08-01T19:55:05.569250+0000", 2023-08-01T19:55:19.143 INFO:teuthology.orchestra.run.smithi008.stdout: "duration": 5.3106000000000003e-05 2023-08-01T19:55:19.143 INFO:teuthology.orchestra.run.smithi008.stdout: }, 2023-08-01T19:55:19.143 INFO:teuthology.orchestra.run.smithi008.stdout: { 2023-08-01T19:55:19.143 INFO:teuthology.orchestra.run.smithi008.stdout: "event": "dispatched", 2023-08-01T19:55:19.143 INFO:teuthology.orchestra.run.smithi008.stdout: "time": "2023-08-01T19:55:05.569260+0000", 2023-08-01T19:55:19.143 INFO:teuthology.orchestra.run.smithi008.stdout: "duration": 9.533e-06 2023-08-01T19:55:19.143 INFO:teuthology.orchestra.run.smithi008.stdout: }, 2023-08-01T19:55:19.144 INFO:teuthology.orchestra.run.smithi008.stdout: { 2023-08-01T19:55:19.144 INFO:teuthology.orchestra.run.smithi008.stdout: "event": "queued_for_pg", 2023-08-01T19:55:19.144 INFO:teuthology.orchestra.run.smithi008.stdout: "time": "2023-08-01T19:55:05.569264+0000", 2023-08-01T19:55:19.144 INFO:teuthology.orchestra.run.smithi008.stdout: "duration": 4.6099999999999999e-06 2023-08-01T19:55:19.144 INFO:teuthology.orchestra.run.smithi008.stdout: }, 2023-08-01T19:55:19.144 INFO:teuthology.orchestra.run.smithi008.stdout: { 2023-08-01T19:55:19.144 INFO:teuthology.orchestra.run.smithi008.stdout: "event": "reached_pg", 2023-08-01T19:55:19.145 INFO:teuthology.orchestra.run.smithi008.stdout: "time": "2023-08-01T19:55:05.569293+0000", 2023-08-01T19:55:19.145 INFO:teuthology.orchestra.run.smithi008.stdout: "duration": 2.8181999999999999e-05 2023-08-01T19:55:19.145 INFO:teuthology.orchestra.run.smithi008.stdout: }, 2023-08-01T19:55:19.145 INFO:teuthology.orchestra.run.smithi008.stdout: { 2023-08-01T19:55:19.145 INFO:teuthology.orchestra.run.smithi008.stdout: "event": "started", 2023-08-01T19:55:19.145 INFO:teuthology.orchestra.run.smithi008.stdout: "time": "2023-08-01T19:55:05.569401+0000", 2023-08-01T19:55:19.145 INFO:teuthology.orchestra.run.smithi008.stdout: "duration": 0.000108065 2023-08-01T19:55:19.146 INFO:teuthology.orchestra.run.smithi008.stdout: }, 2023-08-01T19:55:19.146 INFO:teuthology.orchestra.run.smithi008.stdout: { 2023-08-01T19:55:19.146 INFO:teuthology.orchestra.run.smithi008.stdout: "event": "waiting for subops from 1", 2023-08-01T19:55:19.146 INFO:teuthology.orchestra.run.smithi008.stdout: "time": "2023-08-01T19:55:05.569521+0000", 2023-08-01T19:55:19.146 INFO:teuthology.orchestra.run.smithi008.stdout: "duration": 0.00012006900000000001 2023-08-01T19:55:19.146 INFO:teuthology.orchestra.run.smithi008.stdout: }, 2023-08-01T19:55:19.147 INFO:teuthology.orchestra.run.smithi008.stdout: { 2023-08-01T19:55:19.147 INFO:teuthology.orchestra.run.smithi008.stdout: "event": "sub_op_commit_rec", 2023-08-01T19:55:19.147 INFO:teuthology.orchestra.run.smithi008.stdout: "time": "2023-08-01T19:55:05.629421+0000", 2023-08-01T19:55:19.147 INFO:teuthology.orchestra.run.smithi008.stdout: "duration": 0.059900525000000003 2023-08-01T19:55:19.147 INFO:teuthology.orchestra.run.smithi008.stdout: }, 2023-08-01T19:55:19.147 INFO:teuthology.orchestra.run.smithi008.stdout: { 2023-08-01T19:55:19.148 INFO:teuthology.orchestra.run.smithi008.stdout: "event": "op_commit", 2023-08-01T19:55:19.148 INFO:teuthology.orchestra.run.smithi008.stdout: "time": "2023-08-01T19:55:05.632461+0000", 2023-08-01T19:55:19.148 INFO:teuthology.orchestra.run.smithi008.stdout: "duration": 0.0030401220000000001 2023-08-01T19:55:19.148 INFO:teuthology.orchestra.run.smithi008.stdout: }, 2023-08-01T19:55:19.148 INFO:teuthology.orchestra.run.smithi008.stdout: { 2023-08-01T19:55:19.148 INFO:teuthology.orchestra.run.smithi008.stdout: "event": "commit_sent", 2023-08-01T19:55:19.148 INFO:teuthology.orchestra.run.smithi008.stdout: "time": "2023-08-01T19:55:05.632507+0000", 2023-08-01T19:55:19.149 INFO:teuthology.orchestra.run.smithi008.stdout: "duration": 4.5361999999999997e-05 2023-08-01T19:55:19.149 INFO:teuthology.orchestra.run.smithi008.stdout: }, 2023-08-01T19:55:19.149 INFO:teuthology.orchestra.run.smithi008.stdout: { 2023-08-01T19:55:19.149 INFO:teuthology.orchestra.run.smithi008.stdout: "event": "done", 2023-08-01T19:55:19.149 INFO:teuthology.orchestra.run.smithi008.stdout: "time": "2023-08-01T19:55:05.632547+0000", 2023-08-01T19:55:19.149 INFO:teuthology.orchestra.run.smithi008.stdout: "duration": 4.0760999999999998e-05 2023-08-01T19:55:19.149 INFO:teuthology.orchestra.run.smithi008.stdout: } 2023-08-01T19:55:19.150 INFO:teuthology.orchestra.run.smithi008.stdout: ] 2023-08-01T19:55:19.150 INFO:teuthology.orchestra.run.smithi008.stdout: } 2023-08-01T19:55:19.150 INFO:teuthology.orchestra.run.smithi008.stdout: }, 2023-08-01T19:55:19.150 INFO:teuthology.orchestra.run.smithi008.stdout: { 2023-08-01T19:55:19.150 INFO:teuthology.orchestra.run.smithi008.stdout: "description": "osd_op(client.4668.0:100939 5.5 5:a75fa6e3:::benchmark_data_smithi006_114134_object100938:head [set-alloc-hint object_size 65536 write_size 65536,write 0~65536] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e37)", 2023-08-01T19:55:19.150 INFO:teuthology.orchestra.run.smithi008.stdout: "initiated_at": "2023-08-01T19:55:05.569740+0000", 2023-08-01T19:55:19.150 INFO:teuthology.orchestra.run.smithi008.stdout: "age": 13.452062433, 2023-08-01T19:55:19.150 INFO:teuthology.orchestra.run.smithi008.stdout: "duration": 0.067753412999999998, 2023-08-01T19:55:19.151 INFO:teuthology.orchestra.run.smithi008.stdout: "type_data": { 2023-08-01T19:55:19.151 INFO:teuthology.orchestra.run.smithi008.stdout: "flag_point": "commit sent; apply or cleanup", 2023-08-01T19:55:19.151 INFO:teuthology.orchestra.run.smithi008.stdout: "client_info": { 2023-08-01T19:55:19.151 INFO:teuthology.orchestra.run.smithi008.stdout: "client": "client.4668", 2023-08-01T19:55:19.151 INFO:teuthology.orchestra.run.smithi008.stdout: "client_addr": "172.21.15.6:0/1709472247", 2023-08-01T19:55:19.151 INFO:teuthology.orchestra.run.smithi008.stdout: "tid": 100939 2023-08-01T19:55:19.151 INFO:teuthology.orchestra.run.smithi008.stdout: }, 2023-08-01T19:55:19.152 INFO:teuthology.orchestra.run.smithi008.stdout: "events": [ 2023-08-01T19:55:19.152 INFO:teuthology.orchestra.run.smithi008.stdout: { 2023-08-01T19:55:19.152 INFO:teuthology.orchestra.run.smithi008.stdout: "event": "initiated", 2023-08-01T19:55:19.152 INFO:teuthology.orchestra.run.smithi008.stdout: "time": "2023-08-01T19:55:05.569740+0000", 2023-08-01T19:55:19.152 INFO:teuthology.orchestra.run.smithi008.stdout: "duration": 0 2023-08-01T19:55:19.152 INFO:teuthology.orchestra.run.smithi008.stdout: }, 2023-08-01T19:55:19.152 INFO:teuthology.orchestra.run.smithi008.stdout: { 2023-08-01T19:55:19.152 INFO:teuthology.orchestra.run.smithi008.stdout: "event": "throttled", 2023-08-01T19:55:19.153 INFO:teuthology.orchestra.run.smithi008.stdout: "time": "2023-08-01T19:55:05.569740+0000", 2023-08-01T19:55:19.153 INFO:teuthology.orchestra.run.smithi008.stdout: "duration": 0 2023-08-01T19:55:19.153 INFO:teuthology.orchestra.run.smithi008.stdout: }, 2023-08-01T19:55:19.153 INFO:teuthology.orchestra.run.smithi008.stdout: { 2023-08-01T19:55:19.153 INFO:teuthology.orchestra.run.smithi008.stdout: "event": "header_read", 2023-08-01T19:55:19.153 INFO:teuthology.orchestra.run.smithi008.stdout: "time": "2023-08-01T19:55:05.569739+0000", 2023-08-01T19:55:19.153 INFO:teuthology.orchestra.run.smithi008.stdout: "duration": 4294967295.9999995 2023-08-01T19:55:19.154 INFO:teuthology.orchestra.run.smithi008.stdout: }, 2023-08-01T19:55:19.154 INFO:teuthology.orchestra.run.smithi008.stdout: { 2023-08-01T19:55:19.154 INFO:teuthology.orchestra.run.smithi008.stdout: "event": "all_read", 2023-08-01T19:55:19.154 INFO:teuthology.orchestra.run.smithi008.stdout: "time": "2023-08-01T19:55:05.569839+0000", 2023-08-01T19:55:19.154 INFO:teuthology.orchestra.run.smithi008.stdout: "duration": 0.000100219 2023-08-01T19:55:19.154 INFO:teuthology.orchestra.run.smithi008.stdout: }, 2023-08-01T19:55:19.154 INFO:teuthology.orchestra.run.smithi008.stdout: { 2023-08-01T19:55:19.154 INFO:teuthology.orchestra.run.smithi008.stdout: "event": "dispatched", 2023-08-01T19:55:19.155 INFO:teuthology.orchestra.run.smithi008.stdout: "time": "2023-08-01T19:55:05.569846+0000", 2023-08-01T19:55:19.155 INFO:teuthology.orchestra.run.smithi008.stdout: "duration": 7.3150000000000003e-06 2023-08-01T19:55:19.155 INFO:teuthology.orchestra.run.smithi008.stdout: }, 2023-08-01T19:55:19.155 INFO:teuthology.orchestra.run.smithi008.stdout: { 2023-08-01T19:55:19.155 INFO:teuthology.orchestra.run.smithi008.stdout: "event": "queued_for_pg", 2023-08-01T19:55:19.155 INFO:teuthology.orchestra.run.smithi008.stdout: "time": "2023-08-01T19:55:05.569850+0000", 2023-08-01T19:55:19.155 INFO:teuthology.orchestra.run.smithi008.stdout: "duration": 3.3299999999999999e-06 2023-08-01T19:55:19.155 INFO:teuthology.orchestra.run.smithi008.stdout: }, 2023-08-01T19:55:19.156 INFO:teuthology.orchestra.run.smithi008.stdout: { 2023-08-01T19:55:19.156 INFO:teuthology.orchestra.run.smithi008.stdout: "event": "reached_pg", 2023-08-01T19:55:19.156 INFO:teuthology.orchestra.run.smithi008.stdout: "time": "2023-08-01T19:55:05.626991+0000", 2023-08-01T19:55:19.156 INFO:teuthology.orchestra.run.smithi008.stdout: "duration": 0.057141585000000002 2023-08-01T19:55:19.156 INFO:teuthology.orchestra.run.smithi008.stdout: }, 2023-08-01T19:55:19.156 INFO:teuthology.orchestra.run.smithi008.stdout: { 2023-08-01T19:55:19.156 INFO:teuthology.orchestra.run.smithi008.stdout: "event": "started", 2023-08-01T19:55:19.157 INFO:teuthology.orchestra.run.smithi008.stdout: "time": "2023-08-01T19:55:05.627111+0000", 2023-08-01T19:55:19.157 INFO:teuthology.orchestra.run.smithi008.stdout: "duration": 0.000119238 2023-08-01T19:55:19.157 INFO:teuthology.orchestra.run.smithi008.stdout: }, 2023-08-01T19:55:19.157 INFO:teuthology.orchestra.run.smithi008.stdout: { 2023-08-01T19:55:19.157 INFO:teuthology.orchestra.run.smithi008.stdout: "event": "waiting for subops from 1", 2023-08-01T19:55:19.157 INFO:teuthology.orchestra.run.smithi008.stdout: "time": "2023-08-01T19:55:05.627253+0000", 2023-08-01T19:55:19.158 INFO:teuthology.orchestra.run.smithi008.stdout: "duration": 0.000142822 2023-08-01T19:55:19.158 INFO:teuthology.orchestra.run.smithi008.stdout: }, 2023-08-01T19:55:19.158 INFO:teuthology.orchestra.run.smithi008.stdout: { 2023-08-01T19:55:19.158 INFO:teuthology.orchestra.run.smithi008.stdout: "event": "op_commit", 2023-08-01T19:55:19.158 INFO:teuthology.orchestra.run.smithi008.stdout: "time": "2023-08-01T19:55:05.632555+0000", 2023-08-01T19:55:19.158 INFO:teuthology.orchestra.run.smithi008.stdout: "duration": 0.0053012449999999996 2023-08-01T19:55:19.158 INFO:teuthology.orchestra.run.smithi008.stdout: }, 2023-08-01T19:55:19.159 INFO:teuthology.orchestra.run.smithi008.stdout: { 2023-08-01T19:55:19.159 INFO:teuthology.orchestra.run.smithi008.stdout: "event": "sub_op_commit_rec", 2023-08-01T19:55:19.159 INFO:teuthology.orchestra.run.smithi008.stdout: "time": "2023-08-01T19:55:05.637380+0000", 2023-08-01T19:55:19.159 INFO:teuthology.orchestra.run.smithi008.stdout: "duration": 0.0048257639999999997 2023-08-01T19:55:19.159 INFO:teuthology.orchestra.run.smithi008.stdout: }, 2023-08-01T19:55:19.159 INFO:teuthology.orchestra.run.smithi008.stdout: { 2023-08-01T19:55:19.159 INFO:teuthology.orchestra.run.smithi008.stdout: "event": "commit_sent", 2023-08-01T19:55:19.160 INFO:teuthology.orchestra.run.smithi008.stdout: "time": "2023-08-01T19:55:05.637454+0000", 2023-08-01T19:55:19.160 INFO:teuthology.orchestra.run.smithi008.stdout: "duration": 7.3578999999999995e-05 2023-08-01T19:55:19.160 INFO:teuthology.orchestra.run.smithi008.stdout: }, 2023-08-01T19:55:19.160 INFO:teuthology.orchestra.run.smithi008.stdout: { 2023-08-01T19:55:19.160 INFO:teuthology.orchestra.run.smithi008.stdout: "event": "done", 2023-08-01T19:55:19.160 INFO:teuthology.orchestra.run.smithi008.stdout: "time": "2023-08-01T19:55:05.637493+0000", 2023-08-01T19:55:19.160 INFO:teuthology.orchestra.run.smithi008.stdout: "duration": 3.8986999999999998e-05 2023-08-01T19:55:19.161 INFO:teuthology.orchestra.run.smithi008.stdout: } 2023-08-01T19:55:19.161 INFO:teuthology.orchestra.run.smithi008.stdout: ] 2023-08-01T19:55:19.161 INFO:teuthology.orchestra.run.smithi008.stdout: } 2023-08-01T19:55:19.161 INFO:teuthology.orchestra.run.smithi008.stdout: }, 2023-08-01T19:55:19.161 INFO:teuthology.orchestra.run.smithi008.stdout: { 2023-08-01T19:55:19.161 INFO:teuthology.orchestra.run.smithi008.stdout: "description": "osd_repop(client.4668.0:100941 5.e e37/19 5:736a6ac6:::benchmark_data_smithi006_114134_object100940:head v 37'6306, mlcod=37'6303)", 2023-08-01T19:55:19.161 INFO:teuthology.orchestra.run.smithi008.stdout: "initiated_at": "2023-08-01T19:55:05.570237+0000", 2023-08-01T19:55:19.161 INFO:teuthology.orchestra.run.smithi008.stdout: "age": 13.451565123, 2023-08-01T19:55:19.162 INFO:teuthology.orchestra.run.smithi008.stdout: "duration": 0.064830421999999999, 2023-08-01T19:55:19.162 INFO:teuthology.orchestra.run.smithi008.stdout: "type_data": { 2023-08-01T19:55:19.162 INFO:teuthology.orchestra.run.smithi008.stdout: "flag_point": "commit sent; apply or cleanup", 2023-08-01T19:55:19.162 INFO:teuthology.orchestra.run.smithi008.stdout: "events": [ 2023-08-01T19:55:19.162 INFO:teuthology.orchestra.run.smithi008.stdout: { 2023-08-01T19:55:19.162 INFO:teuthology.orchestra.run.smithi008.stdout: "event": "initiated", 2023-08-01T19:55:19.162 INFO:teuthology.orchestra.run.smithi008.stdout: "time": "2023-08-01T19:55:05.570237+0000", 2023-08-01T19:55:19.162 INFO:teuthology.orchestra.run.smithi008.stdout: "duration": 0 2023-08-01T19:55:19.163 INFO:teuthology.orchestra.run.smithi008.stdout: }, 2023-08-01T19:55:19.163 INFO:teuthology.orchestra.run.smithi008.stdout: { 2023-08-01T19:55:19.163 INFO:teuthology.orchestra.run.smithi008.stdout: "event": "throttled", 2023-08-01T19:55:19.163 INFO:teuthology.orchestra.run.smithi008.stdout: "time": "2023-08-01T19:55:05.570237+0000", 2023-08-01T19:55:19.163 INFO:teuthology.orchestra.run.smithi008.stdout: "duration": 0 2023-08-01T19:55:19.163 INFO:teuthology.orchestra.run.smithi008.stdout: }, 2023-08-01T19:55:19.163 INFO:teuthology.orchestra.run.smithi008.stdout: { 2023-08-01T19:55:19.163 INFO:teuthology.orchestra.run.smithi008.stdout: "event": "header_read", 2023-08-01T19:55:19.164 INFO:teuthology.orchestra.run.smithi008.stdout: "time": "2023-08-01T19:55:05.570236+0000", 2023-08-01T19:55:19.164 INFO:teuthology.orchestra.run.smithi008.stdout: "duration": 4294967295.9999995 2023-08-01T19:55:19.164 INFO:teuthology.orchestra.run.smithi008.stdout: }, 2023-08-01T19:55:19.164 INFO:teuthology.orchestra.run.smithi008.stdout: { 2023-08-01T19:55:19.164 INFO:teuthology.orchestra.run.smithi008.stdout: "event": "all_read", 2023-08-01T19:55:19.164 INFO:teuthology.orchestra.run.smithi008.stdout: "time": "2023-08-01T19:55:05.570354+0000", 2023-08-01T19:55:19.164 INFO:teuthology.orchestra.run.smithi008.stdout: "duration": 0.000118029 2023-08-01T19:55:19.165 INFO:teuthology.orchestra.run.smithi008.stdout: }, 2023-08-01T19:55:19.165 INFO:teuthology.orchestra.run.smithi008.stdout: { 2023-08-01T19:55:19.165 INFO:teuthology.orchestra.run.smithi008.stdout: "event": "dispatched", 2023-08-01T19:55:19.165 INFO:teuthology.orchestra.run.smithi008.stdout: "time": "2023-08-01T19:55:05.626649+0000", 2023-08-01T19:55:19.165 INFO:teuthology.orchestra.run.smithi008.stdout: "duration": 0.056294489000000003 2023-08-01T19:55:19.165 INFO:teuthology.orchestra.run.smithi008.stdout: }, 2023-08-01T19:55:19.165 INFO:teuthology.orchestra.run.smithi008.stdout: { 2023-08-01T19:55:19.165 INFO:teuthology.orchestra.run.smithi008.stdout: "event": "queued_for_pg", 2023-08-01T19:55:19.166 INFO:teuthology.orchestra.run.smithi008.stdout: "time": "2023-08-01T19:55:05.626676+0000", 2023-08-01T19:55:19.166 INFO:teuthology.orchestra.run.smithi008.stdout: "duration": 2.7228000000000001e-05 2023-08-01T19:55:19.166 INFO:teuthology.orchestra.run.smithi008.stdout: }, 2023-08-01T19:55:19.166 INFO:teuthology.orchestra.run.smithi008.stdout: { 2023-08-01T19:55:19.166 INFO:teuthology.orchestra.run.smithi008.stdout: "event": "reached_pg", 2023-08-01T19:55:19.166 INFO:teuthology.orchestra.run.smithi008.stdout: "time": "2023-08-01T19:55:05.626717+0000", 2023-08-01T19:55:19.166 INFO:teuthology.orchestra.run.smithi008.stdout: "duration": 4.1318e-05 2023-08-01T19:55:19.166 INFO:teuthology.orchestra.run.smithi008.stdout: }, 2023-08-01T19:55:19.167 INFO:teuthology.orchestra.run.smithi008.stdout: { 2023-08-01T19:55:19.167 INFO:teuthology.orchestra.run.smithi008.stdout: "event": "started", 2023-08-01T19:55:19.167 INFO:teuthology.orchestra.run.smithi008.stdout: "time": "2023-08-01T19:55:05.626737+0000", 2023-08-01T19:55:19.167 INFO:teuthology.orchestra.run.smithi008.stdout: "duration": 1.9415e-05 2023-08-01T19:55:19.167 INFO:teuthology.orchestra.run.smithi008.stdout: }, 2023-08-01T19:55:19.167 INFO:teuthology.orchestra.run.smithi008.stdout: { 2023-08-01T19:55:19.167 INFO:teuthology.orchestra.run.smithi008.stdout: "event": "commit_sent", 2023-08-01T19:55:19.168 INFO:teuthology.orchestra.run.smithi008.stdout: "time": "2023-08-01T19:55:05.635036+0000", 2023-08-01T19:55:19.168 INFO:teuthology.orchestra.run.smithi008.stdout: "duration": 0.0082987700000000005 2023-08-01T19:55:19.168 INFO:teuthology.orchestra.run.smithi008.stdout: }, 2023-08-01T19:55:19.168 INFO:teuthology.orchestra.run.smithi008.stdout: { 2023-08-01T19:55:19.168 INFO:teuthology.orchestra.run.smithi008.stdout: "event": "done", 2023-08-01T19:55:19.168 INFO:teuthology.orchestra.run.smithi008.stdout: "time": "2023-08-01T19:55:05.635067+0000", 2023-08-01T19:55:19.169 INFO:teuthology.orchestra.run.smithi008.stdout: "duration": 3.1786999999999999e-05 2023-08-01T19:55:19.169 INFO:teuthology.orchestra.run.smithi008.stdout: } 2023-08-01T19:55:19.169 INFO:teuthology.orchestra.run.smithi008.stdout: ] 2023-08-01T19:55:19.169 INFO:teuthology.orchestra.run.smithi008.stdout: } 2023-08-01T19:55:19.169 INFO:teuthology.orchestra.run.smithi008.stdout: }, 2023-08-01T19:55:19.169 INFO:teuthology.orchestra.run.smithi008.stdout: { 2023-08-01T19:55:19.169 INFO:teuthology.orchestra.run.smithi008.stdout: "description": "osd_op(client.4668.0:107863 5.3 5:cbdd875a:::benchmark_data_smithi006_114134_object107862:head [set-alloc-hint object_size 65536 write_size 65536,write 0~65536] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e38)", 2023-08-01T19:55:19.170 INFO:teuthology.orchestra.run.smithi008.stdout: "initiated_at": "2023-08-01T19:55:09.278851+0000", 2023-08-01T19:55:19.170 INFO:teuthology.orchestra.run.smithi008.stdout: "age": 9.7429506930000009, 2023-08-01T19:55:19.170 INFO:teuthology.orchestra.run.smithi008.stdout: "duration": 0.071378853000000006, 2023-08-01T19:55:19.170 INFO:teuthology.orchestra.run.smithi008.stdout: "type_data": { 2023-08-01T19:55:19.170 INFO:teuthology.orchestra.run.smithi008.stdout: "flag_point": "commit sent; apply or cleanup", 2023-08-01T19:55:19.170 INFO:teuthology.orchestra.run.smithi008.stdout: "client_info": { 2023-08-01T19:55:19.170 INFO:teuthology.orchestra.run.smithi008.stdout: "client": "client.4668", 2023-08-01T19:55:19.171 INFO:teuthology.orchestra.run.smithi008.stdout: "client_addr": "172.21.15.6:0/1709472247", 2023-08-01T19:55:19.171 INFO:teuthology.orchestra.run.smithi008.stdout: "tid": 107863 2023-08-01T19:55:19.171 INFO:teuthology.orchestra.run.smithi008.stdout: }, 2023-08-01T19:55:19.171 INFO:teuthology.orchestra.run.smithi008.stdout: "events": [ 2023-08-01T19:55:19.171 INFO:teuthology.orchestra.run.smithi008.stdout: { 2023-08-01T19:55:19.171 INFO:teuthology.orchestra.run.smithi008.stdout: "event": "initiated", 2023-08-01T19:55:19.171 INFO:teuthology.orchestra.run.smithi008.stdout: "time": "2023-08-01T19:55:09.278851+0000", 2023-08-01T19:55:19.171 INFO:teuthology.orchestra.run.smithi008.stdout: "duration": 0 2023-08-01T19:55:19.172 INFO:teuthology.orchestra.run.smithi008.stdout: }, 2023-08-01T19:55:19.172 INFO:teuthology.orchestra.run.smithi008.stdout: { 2023-08-01T19:55:19.172 INFO:teuthology.orchestra.run.smithi008.stdout: "event": "throttled", 2023-08-01T19:55:19.172 INFO:teuthology.orchestra.run.smithi008.stdout: "time": "2023-08-01T19:55:09.278851+0000", 2023-08-01T19:55:19.172 INFO:teuthology.orchestra.run.smithi008.stdout: "duration": 0 2023-08-01T19:55:19.172 INFO:teuthology.orchestra.run.smithi008.stdout: }, 2023-08-01T19:55:19.172 INFO:teuthology.orchestra.run.smithi008.stdout: { 2023-08-01T19:55:19.173 INFO:teuthology.orchestra.run.smithi008.stdout: "event": "header_read", 2023-08-01T19:55:19.173 INFO:teuthology.orchestra.run.smithi008.stdout: "time": "2023-08-01T19:55:09.278850+0000", 2023-08-01T19:55:19.173 INFO:teuthology.orchestra.run.smithi008.stdout: "duration": 4294967295.999999 2023-08-01T19:55:19.173 INFO:teuthology.orchestra.run.smithi008.stdout: }, 2023-08-01T19:55:19.173 INFO:teuthology.orchestra.run.smithi008.stdout: { 2023-08-01T19:55:19.173 INFO:teuthology.orchestra.run.smithi008.stdout: "event": "all_read", 2023-08-01T19:55:19.173 INFO:teuthology.orchestra.run.smithi008.stdout: "time": "2023-08-01T19:55:09.278945+0000", 2023-08-01T19:55:19.173 INFO:teuthology.orchestra.run.smithi008.stdout: "duration": 9.4388000000000005e-05 2023-08-01T19:55:19.174 INFO:teuthology.orchestra.run.smithi008.stdout: }, 2023-08-01T19:55:19.174 INFO:teuthology.orchestra.run.smithi008.stdout: { 2023-08-01T19:55:19.174 INFO:teuthology.orchestra.run.smithi008.stdout: "event": "dispatched", 2023-08-01T19:55:19.174 INFO:teuthology.orchestra.run.smithi008.stdout: "time": "2023-08-01T19:55:09.278955+0000", 2023-08-01T19:55:19.174 INFO:teuthology.orchestra.run.smithi008.stdout: "duration": 1.0413e-05 2023-08-01T19:55:19.174 INFO:teuthology.orchestra.run.smithi008.stdout: }, 2023-08-01T19:55:19.174 INFO:teuthology.orchestra.run.smithi008.stdout: { 2023-08-01T19:55:19.174 INFO:teuthology.orchestra.run.smithi008.stdout: "event": "queued_for_pg", 2023-08-01T19:55:19.175 INFO:teuthology.orchestra.run.smithi008.stdout: "time": "2023-08-01T19:55:09.278962+0000", 2023-08-01T19:55:19.175 INFO:teuthology.orchestra.run.smithi008.stdout: "duration": 6.2169999999999999e-06 2023-08-01T19:55:19.175 INFO:teuthology.orchestra.run.smithi008.stdout: }, 2023-08-01T19:55:19.175 INFO:teuthology.orchestra.run.smithi008.stdout: { 2023-08-01T19:55:19.175 INFO:teuthology.orchestra.run.smithi008.stdout: "event": "reached_pg", 2023-08-01T19:55:19.175 INFO:teuthology.orchestra.run.smithi008.stdout: "time": "2023-08-01T19:55:09.280363+0000", 2023-08-01T19:55:19.175 INFO:teuthology.orchestra.run.smithi008.stdout: "duration": 0.0014014489999999999 2023-08-01T19:55:19.176 INFO:teuthology.orchestra.run.smithi008.stdout: }, 2023-08-01T19:55:19.176 INFO:teuthology.orchestra.run.smithi008.stdout: { 2023-08-01T19:55:19.176 INFO:teuthology.orchestra.run.smithi008.stdout: "event": "started", 2023-08-01T19:55:19.176 INFO:teuthology.orchestra.run.smithi008.stdout: "time": "2023-08-01T19:55:09.280488+0000", 2023-08-01T19:55:19.176 INFO:teuthology.orchestra.run.smithi008.stdout: "duration": 0.00012474099999999999 2023-08-01T19:55:19.176 INFO:teuthology.orchestra.run.smithi008.stdout: }, 2023-08-01T19:55:19.176 INFO:teuthology.orchestra.run.smithi008.stdout: { 2023-08-01T19:55:19.177 INFO:teuthology.orchestra.run.smithi008.stdout: "event": "waiting for subops from 1", 2023-08-01T19:55:19.177 INFO:teuthology.orchestra.run.smithi008.stdout: "time": "2023-08-01T19:55:09.280626+0000", 2023-08-01T19:55:19.177 INFO:teuthology.orchestra.run.smithi008.stdout: "duration": 0.000138193 2023-08-01T19:55:19.177 INFO:teuthology.orchestra.run.smithi008.stdout: }, 2023-08-01T19:55:19.177 INFO:teuthology.orchestra.run.smithi008.stdout: { 2023-08-01T19:55:19.177 INFO:teuthology.orchestra.run.smithi008.stdout: "event": "op_commit", 2023-08-01T19:55:19.177 INFO:teuthology.orchestra.run.smithi008.stdout: "time": "2023-08-01T19:55:09.285958+0000", 2023-08-01T19:55:19.177 INFO:teuthology.orchestra.run.smithi008.stdout: "duration": 0.0053317130000000001 2023-08-01T19:55:19.178 INFO:teuthology.orchestra.run.smithi008.stdout: }, 2023-08-01T19:55:19.178 INFO:teuthology.orchestra.run.smithi008.stdout: { 2023-08-01T19:55:19.178 INFO:teuthology.orchestra.run.smithi008.stdout: "event": "sub_op_commit_rec", 2023-08-01T19:55:19.178 INFO:teuthology.orchestra.run.smithi008.stdout: "time": "2023-08-01T19:55:09.350151+0000", 2023-08-01T19:55:19.178 INFO:teuthology.orchestra.run.smithi008.stdout: "duration": 0.064193202000000005 2023-08-01T19:55:19.178 INFO:teuthology.orchestra.run.smithi008.stdout: }, 2023-08-01T19:55:19.178 INFO:teuthology.orchestra.run.smithi008.stdout: { 2023-08-01T19:55:19.179 INFO:teuthology.orchestra.run.smithi008.stdout: "event": "commit_sent", 2023-08-01T19:55:19.179 INFO:teuthology.orchestra.run.smithi008.stdout: "time": "2023-08-01T19:55:09.350188+0000", 2023-08-01T19:55:19.179 INFO:teuthology.orchestra.run.smithi008.stdout: "duration": 3.7549999999999998e-05 2023-08-01T19:55:19.179 INFO:teuthology.orchestra.run.smithi008.stdout: }, 2023-08-01T19:55:19.179 INFO:teuthology.orchestra.run.smithi008.stdout: { 2023-08-01T19:55:19.179 INFO:teuthology.orchestra.run.smithi008.stdout: "event": "done", 2023-08-01T19:55:19.179 INFO:teuthology.orchestra.run.smithi008.stdout: "time": "2023-08-01T19:55:09.350230+0000", 2023-08-01T19:55:19.180 INFO:teuthology.orchestra.run.smithi008.stdout: "duration": 4.1804999999999997e-05 2023-08-01T19:55:19.180 INFO:teuthology.orchestra.run.smithi008.stdout: } 2023-08-01T19:55:19.180 INFO:teuthology.orchestra.run.smithi008.stdout: ] 2023-08-01T19:55:19.180 INFO:teuthology.orchestra.run.smithi008.stdout: } 2023-08-01T19:55:19.180 INFO:teuthology.orchestra.run.smithi008.stdout: }, 2023-08-01T19:55:19.180 INFO:teuthology.orchestra.run.smithi008.stdout: { 2023-08-01T19:55:19.180 INFO:teuthology.orchestra.run.smithi008.stdout: "description": "osd_op(client.4668.0:107865 5.3 5:c2ebb96d:::benchmark_data_smithi006_114134_object107864:head [set-alloc-hint object_size 65536 write_size 65536,write 0~65536] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e38)", 2023-08-01T19:55:19.181 INFO:teuthology.orchestra.run.smithi008.stdout: "initiated_at": "2023-08-01T19:55:09.279020+0000", 2023-08-01T19:55:19.181 INFO:teuthology.orchestra.run.smithi008.stdout: "age": 9.742782021, 2023-08-01T19:55:19.181 INFO:teuthology.orchestra.run.smithi008.stdout: "duration": 0.072892565000000006, 2023-08-01T19:55:19.181 INFO:teuthology.orchestra.run.smithi008.stdout: "type_data": { 2023-08-01T19:55:19.181 INFO:teuthology.orchestra.run.smithi008.stdout: "flag_point": "commit sent; apply or cleanup", 2023-08-01T19:55:19.181 INFO:teuthology.orchestra.run.smithi008.stdout: "client_info": { 2023-08-01T19:55:19.181 INFO:teuthology.orchestra.run.smithi008.stdout: "client": "client.4668", 2023-08-01T19:55:19.181 INFO:teuthology.orchestra.run.smithi008.stdout: "client_addr": "172.21.15.6:0/1709472247", 2023-08-01T19:55:19.182 INFO:teuthology.orchestra.run.smithi008.stdout: "tid": 107865 2023-08-01T19:55:19.182 INFO:teuthology.orchestra.run.smithi008.stdout: }, 2023-08-01T19:55:19.182 INFO:teuthology.orchestra.run.smithi008.stdout: "events": [ 2023-08-01T19:55:19.182 INFO:teuthology.orchestra.run.smithi008.stdout: { 2023-08-01T19:55:19.182 INFO:teuthology.orchestra.run.smithi008.stdout: "event": "initiated", 2023-08-01T19:55:19.182 INFO:teuthology.orchestra.run.smithi008.stdout: "time": "2023-08-01T19:55:09.279020+0000", 2023-08-01T19:55:19.182 INFO:teuthology.orchestra.run.smithi008.stdout: "duration": 0 2023-08-01T19:55:19.182 INFO:teuthology.orchestra.run.smithi008.stdout: }, 2023-08-01T19:55:19.183 INFO:teuthology.orchestra.run.smithi008.stdout: { 2023-08-01T19:55:19.183 INFO:teuthology.orchestra.run.smithi008.stdout: "event": "throttled", 2023-08-01T19:55:19.183 INFO:teuthology.orchestra.run.smithi008.stdout: "time": "2023-08-01T19:55:09.279020+0000", 2023-08-01T19:55:19.183 INFO:teuthology.orchestra.run.smithi008.stdout: "duration": 0 2023-08-01T19:55:19.183 INFO:teuthology.orchestra.run.smithi008.stdout: }, 2023-08-01T19:55:19.183 INFO:teuthology.orchestra.run.smithi008.stdout: { 2023-08-01T19:55:19.183 INFO:teuthology.orchestra.run.smithi008.stdout: "event": "header_read", 2023-08-01T19:55:19.184 INFO:teuthology.orchestra.run.smithi008.stdout: "time": "2023-08-01T19:55:09.279019+0000", 2023-08-01T19:55:19.184 INFO:teuthology.orchestra.run.smithi008.stdout: "duration": 4294967295.999999 2023-08-01T19:55:19.184 INFO:teuthology.orchestra.run.smithi008.stdout: }, 2023-08-01T19:55:19.184 INFO:teuthology.orchestra.run.smithi008.stdout: { 2023-08-01T19:55:19.184 INFO:teuthology.orchestra.run.smithi008.stdout: "event": "all_read", 2023-08-01T19:55:19.184 INFO:teuthology.orchestra.run.smithi008.stdout: "time": "2023-08-01T19:55:09.279087+0000", 2023-08-01T19:55:19.184 INFO:teuthology.orchestra.run.smithi008.stdout: "duration": 6.8392000000000005e-05 2023-08-01T19:55:19.185 INFO:teuthology.orchestra.run.smithi008.stdout: }, 2023-08-01T19:55:19.185 INFO:teuthology.orchestra.run.smithi008.stdout: { 2023-08-01T19:55:19.185 INFO:teuthology.orchestra.run.smithi008.stdout: "event": "dispatched", 2023-08-01T19:55:19.185 INFO:teuthology.orchestra.run.smithi008.stdout: "time": "2023-08-01T19:55:09.279095+0000", 2023-08-01T19:55:19.185 INFO:teuthology.orchestra.run.smithi008.stdout: "duration": 8.0989999999999999e-06 2023-08-01T19:55:19.185 INFO:teuthology.orchestra.run.smithi008.stdout: }, 2023-08-01T19:55:19.185 INFO:teuthology.orchestra.run.smithi008.stdout: { 2023-08-01T19:55:19.185 INFO:teuthology.orchestra.run.smithi008.stdout: "event": "queued_for_pg", 2023-08-01T19:55:19.186 INFO:teuthology.orchestra.run.smithi008.stdout: "time": "2023-08-01T19:55:09.279101+0000", 2023-08-01T19:55:19.186 INFO:teuthology.orchestra.run.smithi008.stdout: "duration": 5.0390000000000004e-06 2023-08-01T19:55:19.186 INFO:teuthology.orchestra.run.smithi008.stdout: }, 2023-08-01T19:55:19.186 INFO:teuthology.orchestra.run.smithi008.stdout: { 2023-08-01T19:55:19.186 INFO:teuthology.orchestra.run.smithi008.stdout: "event": "reached_pg", 2023-08-01T19:55:19.186 INFO:teuthology.orchestra.run.smithi008.stdout: "time": "2023-08-01T19:55:09.282574+0000", 2023-08-01T19:55:19.186 INFO:teuthology.orchestra.run.smithi008.stdout: "duration": 0.0034730619999999999 2023-08-01T19:55:19.186 INFO:teuthology.orchestra.run.smithi008.stdout: }, 2023-08-01T19:55:19.187 INFO:teuthology.orchestra.run.smithi008.stdout: { 2023-08-01T19:55:19.187 INFO:teuthology.orchestra.run.smithi008.stdout: "event": "started", 2023-08-01T19:55:19.187 INFO:teuthology.orchestra.run.smithi008.stdout: "time": "2023-08-01T19:55:09.282705+0000", 2023-08-01T19:55:19.187 INFO:teuthology.orchestra.run.smithi008.stdout: "duration": 0.00013133400000000001 2023-08-01T19:55:19.187 INFO:teuthology.orchestra.run.smithi008.stdout: }, 2023-08-01T19:55:19.187 INFO:teuthology.orchestra.run.smithi008.stdout: { 2023-08-01T19:55:19.187 INFO:teuthology.orchestra.run.smithi008.stdout: "event": "waiting for subops from 1", 2023-08-01T19:55:19.187 INFO:teuthology.orchestra.run.smithi008.stdout: "time": "2023-08-01T19:55:09.283067+0000", 2023-08-01T19:55:19.188 INFO:teuthology.orchestra.run.smithi008.stdout: "duration": 0.00036195299999999998 2023-08-01T19:55:19.188 INFO:teuthology.orchestra.run.smithi008.stdout: }, 2023-08-01T19:55:19.188 INFO:teuthology.orchestra.run.smithi008.stdout: { 2023-08-01T19:55:19.188 INFO:teuthology.orchestra.run.smithi008.stdout: "event": "op_commit", 2023-08-01T19:55:19.188 INFO:teuthology.orchestra.run.smithi008.stdout: "time": "2023-08-01T19:55:09.288196+0000", 2023-08-01T19:55:19.188 INFO:teuthology.orchestra.run.smithi008.stdout: "duration": 0.0051293780000000004 2023-08-01T19:55:19.188 INFO:teuthology.orchestra.run.smithi008.stdout: }, 2023-08-01T19:55:19.189 INFO:teuthology.orchestra.run.smithi008.stdout: { 2023-08-01T19:55:19.189 INFO:teuthology.orchestra.run.smithi008.stdout: "event": "sub_op_commit_rec", 2023-08-01T19:55:19.189 INFO:teuthology.orchestra.run.smithi008.stdout: "time": "2023-08-01T19:55:09.351832+0000", 2023-08-01T19:55:19.189 INFO:teuthology.orchestra.run.smithi008.stdout: "duration": 0.063636076 2023-08-01T19:55:19.189 INFO:teuthology.orchestra.run.smithi008.stdout: }, 2023-08-01T19:55:19.189 INFO:teuthology.orchestra.run.smithi008.stdout: { 2023-08-01T19:55:19.189 INFO:teuthology.orchestra.run.smithi008.stdout: "event": "commit_sent", 2023-08-01T19:55:19.190 INFO:teuthology.orchestra.run.smithi008.stdout: "time": "2023-08-01T19:55:09.351878+0000", 2023-08-01T19:55:19.190 INFO:teuthology.orchestra.run.smithi008.stdout: "duration": 4.5408999999999998e-05 2023-08-01T19:55:19.190 INFO:teuthology.orchestra.run.smithi008.stdout: }, 2023-08-01T19:55:19.190 INFO:teuthology.orchestra.run.smithi008.stdout: { 2023-08-01T19:55:19.190 INFO:teuthology.orchestra.run.smithi008.stdout: "event": "done", 2023-08-01T19:55:19.190 INFO:teuthology.orchestra.run.smithi008.stdout: "time": "2023-08-01T19:55:09.351913+0000", 2023-08-01T19:55:19.190 INFO:teuthology.orchestra.run.smithi008.stdout: "duration": 3.4808999999999998e-05 2023-08-01T19:55:19.190 INFO:teuthology.orchestra.run.smithi008.stdout: } 2023-08-01T19:55:19.191 INFO:teuthology.orchestra.run.smithi008.stdout: ] 2023-08-01T19:55:19.191 INFO:teuthology.orchestra.run.smithi008.stdout: } 2023-08-01T19:55:19.191 INFO:teuthology.orchestra.run.smithi008.stdout: }, 2023-08-01T19:55:19.191 INFO:teuthology.orchestra.run.smithi008.stdout: { 2023-08-01T19:55:19.191 INFO:teuthology.orchestra.run.smithi008.stdout: "description": "osd_op(client.4668.0:107869 5.c 5:31910384:::benchmark_data_smithi006_114134_object107868:head [set-alloc-hint object_size 65536 write_size 65536,write 0~65536] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e38)", 2023-08-01T19:55:19.191 INFO:teuthology.orchestra.run.smithi008.stdout: "initiated_at": "2023-08-01T19:55:09.283205+0000", 2023-08-01T19:55:19.191 INFO:teuthology.orchestra.run.smithi008.stdout: "age": 9.7385968560000009, 2023-08-01T19:55:19.192 INFO:teuthology.orchestra.run.smithi008.stdout: "duration": 0.068611808999999996, 2023-08-01T19:55:19.192 INFO:teuthology.orchestra.run.smithi008.stdout: "type_data": { 2023-08-01T19:55:19.192 INFO:teuthology.orchestra.run.smithi008.stdout: "flag_point": "commit sent; apply or cleanup", 2023-08-01T19:55:19.192 INFO:teuthology.orchestra.run.smithi008.stdout: "client_info": { 2023-08-01T19:55:19.192 INFO:teuthology.orchestra.run.smithi008.stdout: "client": "client.4668", 2023-08-01T19:55:19.192 INFO:teuthology.orchestra.run.smithi008.stdout: "client_addr": "172.21.15.6:0/1709472247", 2023-08-01T19:55:19.192 INFO:teuthology.orchestra.run.smithi008.stdout: "tid": 107869 2023-08-01T19:55:19.192 INFO:teuthology.orchestra.run.smithi008.stdout: }, 2023-08-01T19:55:19.193 INFO:teuthology.orchestra.run.smithi008.stdout: "events": [ 2023-08-01T19:55:19.193 INFO:teuthology.orchestra.run.smithi008.stdout: { 2023-08-01T19:55:19.193 INFO:teuthology.orchestra.run.smithi008.stdout: "event": "initiated", 2023-08-01T19:55:19.193 INFO:teuthology.orchestra.run.smithi008.stdout: "time": "2023-08-01T19:55:09.283205+0000", 2023-08-01T19:55:19.193 INFO:teuthology.orchestra.run.smithi008.stdout: "duration": 0 2023-08-01T19:55:19.193 INFO:teuthology.orchestra.run.smithi008.stdout: }, 2023-08-01T19:55:19.193 INFO:teuthology.orchestra.run.smithi008.stdout: { 2023-08-01T19:55:19.194 INFO:teuthology.orchestra.run.smithi008.stdout: "event": "throttled", 2023-08-01T19:55:19.194 INFO:teuthology.orchestra.run.smithi008.stdout: "time": "2023-08-01T19:55:09.283205+0000", 2023-08-01T19:55:19.194 INFO:teuthology.orchestra.run.smithi008.stdout: "duration": 0 2023-08-01T19:55:19.194 INFO:teuthology.orchestra.run.smithi008.stdout: }, 2023-08-01T19:55:19.194 INFO:teuthology.orchestra.run.smithi008.stdout: { 2023-08-01T19:55:19.194 INFO:teuthology.orchestra.run.smithi008.stdout: "event": "header_read", 2023-08-01T19:55:19.194 INFO:teuthology.orchestra.run.smithi008.stdout: "time": "2023-08-01T19:55:09.283204+0000", 2023-08-01T19:55:19.195 INFO:teuthology.orchestra.run.smithi008.stdout: "duration": 4294967295.999999 2023-08-01T19:55:19.195 INFO:teuthology.orchestra.run.smithi008.stdout: }, 2023-08-01T19:55:19.195 INFO:teuthology.orchestra.run.smithi008.stdout: { 2023-08-01T19:55:19.195 INFO:teuthology.orchestra.run.smithi008.stdout: "event": "all_read", 2023-08-01T19:55:19.195 INFO:teuthology.orchestra.run.smithi008.stdout: "time": "2023-08-01T19:55:09.283300+0000", 2023-08-01T19:55:19.195 INFO:teuthology.orchestra.run.smithi008.stdout: "duration": 9.6280000000000007e-05 2023-08-01T19:55:19.195 INFO:teuthology.orchestra.run.smithi008.stdout: }, 2023-08-01T19:55:19.195 INFO:teuthology.orchestra.run.smithi008.stdout: { 2023-08-01T19:55:19.196 INFO:teuthology.orchestra.run.smithi008.stdout: "event": "dispatched", 2023-08-01T19:55:19.196 INFO:teuthology.orchestra.run.smithi008.stdout: "time": "2023-08-01T19:55:09.283314+0000", 2023-08-01T19:55:19.196 INFO:teuthology.orchestra.run.smithi008.stdout: "duration": 1.3344e-05 2023-08-01T19:55:19.196 INFO:teuthology.orchestra.run.smithi008.stdout: }, 2023-08-01T19:55:19.196 INFO:teuthology.orchestra.run.smithi008.stdout: { 2023-08-01T19:55:19.196 INFO:teuthology.orchestra.run.smithi008.stdout: "event": "queued_for_pg", 2023-08-01T19:55:19.196 INFO:teuthology.orchestra.run.smithi008.stdout: "time": "2023-08-01T19:55:09.283320+0000", 2023-08-01T19:55:19.197 INFO:teuthology.orchestra.run.smithi008.stdout: "duration": 6.0299999999999999e-06 2023-08-01T19:55:19.197 INFO:teuthology.orchestra.run.smithi008.stdout: }, 2023-08-01T19:55:19.197 INFO:teuthology.orchestra.run.smithi008.stdout: { 2023-08-01T19:55:19.197 INFO:teuthology.orchestra.run.smithi008.stdout: "event": "reached_pg", 2023-08-01T19:55:19.197 INFO:teuthology.orchestra.run.smithi008.stdout: "time": "2023-08-01T19:55:09.283365+0000", 2023-08-01T19:55:19.197 INFO:teuthology.orchestra.run.smithi008.stdout: "duration": 4.5578999999999998e-05 2023-08-01T19:55:19.197 INFO:teuthology.orchestra.run.smithi008.stdout: }, 2023-08-01T19:55:19.197 INFO:teuthology.orchestra.run.smithi008.stdout: { 2023-08-01T19:55:19.198 INFO:teuthology.orchestra.run.smithi008.stdout: "event": "started", 2023-08-01T19:55:19.198 INFO:teuthology.orchestra.run.smithi008.stdout: "time": "2023-08-01T19:55:09.283490+0000", 2023-08-01T19:55:19.198 INFO:teuthology.orchestra.run.smithi008.stdout: "duration": 0.00012473700000000001 2023-08-01T19:55:19.198 INFO:teuthology.orchestra.run.smithi008.stdout: }, 2023-08-01T19:55:19.198 INFO:teuthology.orchestra.run.smithi008.stdout: { 2023-08-01T19:55:19.198 INFO:teuthology.orchestra.run.smithi008.stdout: "event": "waiting for subops from 1", 2023-08-01T19:55:19.199 INFO:teuthology.orchestra.run.smithi008.stdout: "time": "2023-08-01T19:55:09.283637+0000", 2023-08-01T19:55:19.199 INFO:teuthology.orchestra.run.smithi008.stdout: "duration": 0.00014715600000000001 2023-08-01T19:55:19.199 INFO:teuthology.orchestra.run.smithi008.stdout: }, 2023-08-01T19:55:19.199 INFO:teuthology.orchestra.run.smithi008.stdout: { 2023-08-01T19:55:19.199 INFO:teuthology.orchestra.run.smithi008.stdout: "event": "op_commit", 2023-08-01T19:55:19.199 INFO:teuthology.orchestra.run.smithi008.stdout: "time": "2023-08-01T19:55:09.288214+0000", 2023-08-01T19:55:19.199 INFO:teuthology.orchestra.run.smithi008.stdout: "duration": 0.0045769560000000001 2023-08-01T19:55:19.199 INFO:teuthology.orchestra.run.smithi008.stdout: }, 2023-08-01T19:55:19.200 INFO:teuthology.orchestra.run.smithi008.stdout: { 2023-08-01T19:55:19.200 INFO:teuthology.orchestra.run.smithi008.stdout: "event": "sub_op_commit_rec", 2023-08-01T19:55:19.200 INFO:teuthology.orchestra.run.smithi008.stdout: "time": "2023-08-01T19:55:09.351721+0000", 2023-08-01T19:55:19.200 INFO:teuthology.orchestra.run.smithi008.stdout: "duration": 0.063507383000000001 2023-08-01T19:55:19.200 INFO:teuthology.orchestra.run.smithi008.stdout: }, 2023-08-01T19:55:19.200 INFO:teuthology.orchestra.run.smithi008.stdout: { 2023-08-01T19:55:19.200 INFO:teuthology.orchestra.run.smithi008.stdout: "event": "commit_sent", 2023-08-01T19:55:19.201 INFO:teuthology.orchestra.run.smithi008.stdout: "time": "2023-08-01T19:55:09.351777+0000", 2023-08-01T19:55:19.201 INFO:teuthology.orchestra.run.smithi008.stdout: "duration": 5.5733999999999999e-05 2023-08-01T19:55:19.201 INFO:teuthology.orchestra.run.smithi008.stdout: }, 2023-08-01T19:55:19.201 INFO:teuthology.orchestra.run.smithi008.stdout: { 2023-08-01T19:55:19.201 INFO:teuthology.orchestra.run.smithi008.stdout: "event": "done", 2023-08-01T19:55:19.201 INFO:teuthology.orchestra.run.smithi008.stdout: "time": "2023-08-01T19:55:09.351817+0000", 2023-08-01T19:55:19.201 INFO:teuthology.orchestra.run.smithi008.stdout: "duration": 3.9765000000000003e-05 2023-08-01T19:55:19.202 INFO:teuthology.orchestra.run.smithi008.stdout: } 2023-08-01T19:55:19.202 INFO:teuthology.orchestra.run.smithi008.stdout: ] 2023-08-01T19:55:19.202 INFO:teuthology.orchestra.run.smithi008.stdout: } 2023-08-01T19:55:19.202 INFO:teuthology.orchestra.run.smithi008.stdout: }, 2023-08-01T19:55:19.202 INFO:teuthology.orchestra.run.smithi008.stdout: { 2023-08-01T19:55:19.202 INFO:teuthology.orchestra.run.smithi008.stdout: "description": "osd_op(client.4668.0:107874 5.3 5:ce4c2799:::benchmark_data_smithi006_114134_object107873:head [set-alloc-hint object_size 65536 write_size 65536,write 0~65536] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e38)", 2023-08-01T19:55:19.202 INFO:teuthology.orchestra.run.smithi008.stdout: "initiated_at": "2023-08-01T19:55:09.286239+0000", 2023-08-01T19:55:19.202 INFO:teuthology.orchestra.run.smithi008.stdout: "age": 9.7355633509999997, 2023-08-01T19:55:19.203 INFO:teuthology.orchestra.run.smithi008.stdout: "duration": 0.068224389999999996, 2023-08-01T19:55:19.203 INFO:teuthology.orchestra.run.smithi008.stdout: "type_data": { 2023-08-01T19:55:19.203 INFO:teuthology.orchestra.run.smithi008.stdout: "flag_point": "commit sent; apply or cleanup", 2023-08-01T19:55:19.203 INFO:teuthology.orchestra.run.smithi008.stdout: "client_info": { 2023-08-01T19:55:19.203 INFO:teuthology.orchestra.run.smithi008.stdout: "client": "client.4668", 2023-08-01T19:55:19.203 INFO:teuthology.orchestra.run.smithi008.stdout: "client_addr": "172.21.15.6:0/1709472247", 2023-08-01T19:55:19.203 INFO:teuthology.orchestra.run.smithi008.stdout: "tid": 107874 2023-08-01T19:55:19.204 INFO:teuthology.orchestra.run.smithi008.stdout: }, 2023-08-01T19:55:19.204 INFO:teuthology.orchestra.run.smithi008.stdout: "events": [ 2023-08-01T19:55:19.204 INFO:teuthology.orchestra.run.smithi008.stdout: { 2023-08-01T19:55:19.204 INFO:teuthology.orchestra.run.smithi008.stdout: "event": "initiated", 2023-08-01T19:55:19.204 INFO:teuthology.orchestra.run.smithi008.stdout: "time": "2023-08-01T19:55:09.286239+0000", 2023-08-01T19:55:19.204 INFO:teuthology.orchestra.run.smithi008.stdout: "duration": 0 2023-08-01T19:55:19.204 INFO:teuthology.orchestra.run.smithi008.stdout: }, 2023-08-01T19:55:19.204 INFO:teuthology.orchestra.run.smithi008.stdout: { 2023-08-01T19:55:19.205 INFO:teuthology.orchestra.run.smithi008.stdout: "event": "throttled", 2023-08-01T19:55:19.205 INFO:teuthology.orchestra.run.smithi008.stdout: "time": "2023-08-01T19:55:09.286239+0000", 2023-08-01T19:55:19.205 INFO:teuthology.orchestra.run.smithi008.stdout: "duration": 0 2023-08-01T19:55:19.205 INFO:teuthology.orchestra.run.smithi008.stdout: }, 2023-08-01T19:55:19.205 INFO:teuthology.orchestra.run.smithi008.stdout: { 2023-08-01T19:55:19.205 INFO:teuthology.orchestra.run.smithi008.stdout: "event": "header_read", 2023-08-01T19:55:19.205 INFO:teuthology.orchestra.run.smithi008.stdout: "time": "2023-08-01T19:55:09.286238+0000", 2023-08-01T19:55:19.205 INFO:teuthology.orchestra.run.smithi008.stdout: "duration": 4294967295.999999 2023-08-01T19:55:19.206 INFO:teuthology.orchestra.run.smithi008.stdout: }, 2023-08-01T19:55:19.206 INFO:teuthology.orchestra.run.smithi008.stdout: { 2023-08-01T19:55:19.206 INFO:teuthology.orchestra.run.smithi008.stdout: "event": "all_read", 2023-08-01T19:55:19.206 INFO:teuthology.orchestra.run.smithi008.stdout: "time": "2023-08-01T19:55:09.286310+0000", 2023-08-01T19:55:19.206 INFO:teuthology.orchestra.run.smithi008.stdout: "duration": 7.2583999999999995e-05 2023-08-01T19:55:19.206 INFO:teuthology.orchestra.run.smithi008.stdout: }, 2023-08-01T19:55:19.206 INFO:teuthology.orchestra.run.smithi008.stdout: { 2023-08-01T19:55:19.207 INFO:teuthology.orchestra.run.smithi008.stdout: "event": "dispatched", 2023-08-01T19:55:19.207 INFO:teuthology.orchestra.run.smithi008.stdout: "time": "2023-08-01T19:55:09.286323+0000", 2023-08-01T19:55:19.207 INFO:teuthology.orchestra.run.smithi008.stdout: "duration": 1.3151e-05 2023-08-01T19:55:19.207 INFO:teuthology.orchestra.run.smithi008.stdout: }, 2023-08-01T19:55:19.207 INFO:teuthology.orchestra.run.smithi008.stdout: { 2023-08-01T19:55:19.207 INFO:teuthology.orchestra.run.smithi008.stdout: "event": "queued_for_pg", 2023-08-01T19:55:19.207 INFO:teuthology.orchestra.run.smithi008.stdout: "time": "2023-08-01T19:55:09.286329+0000", 2023-08-01T19:55:19.207 INFO:teuthology.orchestra.run.smithi008.stdout: "duration": 5.8719999999999999e-06 2023-08-01T19:55:19.208 INFO:teuthology.orchestra.run.smithi008.stdout: }, 2023-08-01T19:55:19.208 INFO:teuthology.orchestra.run.smithi008.stdout: { 2023-08-01T19:55:19.208 INFO:teuthology.orchestra.run.smithi008.stdout: "event": "reached_pg", 2023-08-01T19:55:19.208 INFO:teuthology.orchestra.run.smithi008.stdout: "time": "2023-08-01T19:55:09.286392+0000", 2023-08-01T19:55:19.208 INFO:teuthology.orchestra.run.smithi008.stdout: "duration": 6.2378000000000005e-05 2023-08-01T19:55:19.208 INFO:teuthology.orchestra.run.smithi008.stdout: }, 2023-08-01T19:55:19.208 INFO:teuthology.orchestra.run.smithi008.stdout: { 2023-08-01T19:55:19.209 INFO:teuthology.orchestra.run.smithi008.stdout: "event": "started", 2023-08-01T19:55:19.209 INFO:teuthology.orchestra.run.smithi008.stdout: "time": "2023-08-01T19:55:09.286473+0000", 2023-08-01T19:55:19.209 INFO:teuthology.orchestra.run.smithi008.stdout: "duration": 8.1327000000000002e-05 2023-08-01T19:55:19.209 INFO:teuthology.orchestra.run.smithi008.stdout: }, 2023-08-01T19:55:19.209 INFO:teuthology.orchestra.run.smithi008.stdout: { 2023-08-01T19:55:19.209 INFO:teuthology.orchestra.run.smithi008.stdout: "event": "waiting for subops from 1", 2023-08-01T19:55:19.209 INFO:teuthology.orchestra.run.smithi008.stdout: "time": "2023-08-01T19:55:09.286557+0000", 2023-08-01T19:55:19.210 INFO:teuthology.orchestra.run.smithi008.stdout: "duration": 8.4140000000000004e-05 2023-08-01T19:55:19.210 INFO:teuthology.orchestra.run.smithi008.stdout: }, 2023-08-01T19:55:19.210 INFO:teuthology.orchestra.run.smithi008.stdout: { 2023-08-01T19:55:19.210 INFO:teuthology.orchestra.run.smithi008.stdout: "event": "op_commit", 2023-08-01T19:55:19.210 INFO:teuthology.orchestra.run.smithi008.stdout: "time": "2023-08-01T19:55:09.290681+0000", 2023-08-01T19:55:19.210 INFO:teuthology.orchestra.run.smithi008.stdout: "duration": 0.0041242420000000002 2023-08-01T19:55:19.210 INFO:teuthology.orchestra.run.smithi008.stdout: }, 2023-08-01T19:55:19.210 INFO:teuthology.orchestra.run.smithi008.stdout: { 2023-08-01T19:55:19.211 INFO:teuthology.orchestra.run.smithi008.stdout: "event": "sub_op_commit_rec", 2023-08-01T19:55:19.211 INFO:teuthology.orchestra.run.smithi008.stdout: "time": "2023-08-01T19:55:09.354372+0000", 2023-08-01T19:55:19.211 INFO:teuthology.orchestra.run.smithi008.stdout: "duration": 0.063690438000000002 2023-08-01T19:55:19.211 INFO:teuthology.orchestra.run.smithi008.stdout: }, 2023-08-01T19:55:19.211 INFO:teuthology.orchestra.run.smithi008.stdout: { 2023-08-01T19:55:19.211 INFO:teuthology.orchestra.run.smithi008.stdout: "event": "commit_sent", 2023-08-01T19:55:19.211 INFO:teuthology.orchestra.run.smithi008.stdout: "time": "2023-08-01T19:55:09.354421+0000", 2023-08-01T19:55:19.212 INFO:teuthology.orchestra.run.smithi008.stdout: "duration": 4.9413000000000003e-05 2023-08-01T19:55:19.212 INFO:teuthology.orchestra.run.smithi008.stdout: }, 2023-08-01T19:55:19.212 INFO:teuthology.orchestra.run.smithi008.stdout: { 2023-08-01T19:55:19.212 INFO:teuthology.orchestra.run.smithi008.stdout: "event": "done", 2023-08-01T19:55:19.212 INFO:teuthology.orchestra.run.smithi008.stdout: "time": "2023-08-01T19:55:09.354463+0000", 2023-08-01T19:55:19.212 INFO:teuthology.orchestra.run.smithi008.stdout: "duration": 4.1924e-05 2023-08-01T19:55:19.212 INFO:teuthology.orchestra.run.smithi008.stdout: } 2023-08-01T19:55:19.212 INFO:teuthology.orchestra.run.smithi008.stdout: ] 2023-08-01T19:55:19.213 INFO:teuthology.orchestra.run.smithi008.stdout: } 2023-08-01T19:55:19.213 INFO:teuthology.orchestra.run.smithi008.stdout: }, 2023-08-01T19:55:19.213 INFO:teuthology.orchestra.run.smithi008.stdout: { 2023-08-01T19:55:19.213 INFO:teuthology.orchestra.run.smithi008.stdout: "description": "osd_op(client.4668.0:107875 5.5 5:af4ec927:::benchmark_data_smithi006_114134_object107874:head [set-alloc-hint object_size 65536 write_size 65536,write 0~65536] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e38)", 2023-08-01T19:55:19.213 INFO:teuthology.orchestra.run.smithi008.stdout: "initiated_at": "2023-08-01T19:55:09.287186+0000", 2023-08-01T19:55:19.213 INFO:teuthology.orchestra.run.smithi008.stdout: "age": 9.7346155640000003, 2023-08-01T19:55:19.213 INFO:teuthology.orchestra.run.smithi008.stdout: "duration": 0.064764719999999998, 2023-08-01T19:55:19.214 INFO:teuthology.orchestra.run.smithi008.stdout: "type_data": { 2023-08-01T19:55:19.214 INFO:teuthology.orchestra.run.smithi008.stdout: "flag_point": "commit sent; apply or cleanup", 2023-08-01T19:55:19.214 INFO:teuthology.orchestra.run.smithi008.stdout: "client_info": { 2023-08-01T19:55:19.214 INFO:teuthology.orchestra.run.smithi008.stdout: "client": "client.4668", 2023-08-01T19:55:19.214 INFO:teuthology.orchestra.run.smithi008.stdout: "client_addr": "172.21.15.6:0/1709472247", 2023-08-01T19:55:19.214 INFO:teuthology.orchestra.run.smithi008.stdout: "tid": 107875 2023-08-01T19:55:19.215 INFO:teuthology.orchestra.run.smithi008.stdout: }, 2023-08-01T19:55:19.215 INFO:teuthology.orchestra.run.smithi008.stdout: "events": [ 2023-08-01T19:55:19.215 INFO:teuthology.orchestra.run.smithi008.stdout: { 2023-08-01T19:55:19.215 INFO:teuthology.orchestra.run.smithi008.stdout: "event": "initiated", 2023-08-01T19:55:19.215 INFO:teuthology.orchestra.run.smithi008.stdout: "time": "2023-08-01T19:55:09.287186+0000", 2023-08-01T19:55:19.215 INFO:teuthology.orchestra.run.smithi008.stdout: "duration": 0 2023-08-01T19:55:19.215 INFO:teuthology.orchestra.run.smithi008.stdout: }, 2023-08-01T19:55:19.215 INFO:teuthology.orchestra.run.smithi008.stdout: { 2023-08-01T19:55:19.216 INFO:teuthology.orchestra.run.smithi008.stdout: "event": "throttled", 2023-08-01T19:55:19.216 INFO:teuthology.orchestra.run.smithi008.stdout: "time": "2023-08-01T19:55:09.287186+0000", 2023-08-01T19:55:19.216 INFO:teuthology.orchestra.run.smithi008.stdout: "duration": 0 2023-08-01T19:55:19.216 INFO:teuthology.orchestra.run.smithi008.stdout: }, 2023-08-01T19:55:19.216 INFO:teuthology.orchestra.run.smithi008.stdout: { 2023-08-01T19:55:19.216 INFO:teuthology.orchestra.run.smithi008.stdout: "event": "header_read", 2023-08-01T19:55:19.216 INFO:teuthology.orchestra.run.smithi008.stdout: "time": "2023-08-01T19:55:09.287186+0000", 2023-08-01T19:55:19.217 INFO:teuthology.orchestra.run.smithi008.stdout: "duration": 4294967295.999999 2023-08-01T19:55:19.217 INFO:teuthology.orchestra.run.smithi008.stdout: }, 2023-08-01T19:55:19.217 INFO:teuthology.orchestra.run.smithi008.stdout: { 2023-08-01T19:55:19.217 INFO:teuthology.orchestra.run.smithi008.stdout: "event": "all_read", 2023-08-01T19:55:19.217 INFO:teuthology.orchestra.run.smithi008.stdout: "time": "2023-08-01T19:55:09.287248+0000", 2023-08-01T19:55:19.217 INFO:teuthology.orchestra.run.smithi008.stdout: "duration": 6.2922000000000005e-05 2023-08-01T19:55:19.217 INFO:teuthology.orchestra.run.smithi008.stdout: }, 2023-08-01T19:55:19.218 INFO:teuthology.orchestra.run.smithi008.stdout: { 2023-08-01T19:55:19.218 INFO:teuthology.orchestra.run.smithi008.stdout: "event": "dispatched", 2023-08-01T19:55:19.218 INFO:teuthology.orchestra.run.smithi008.stdout: "time": "2023-08-01T19:55:09.287261+0000", 2023-08-01T19:55:19.218 INFO:teuthology.orchestra.run.smithi008.stdout: "duration": 1.2364000000000001e-05 2023-08-01T19:55:19.218 INFO:teuthology.orchestra.run.smithi008.stdout: }, 2023-08-01T19:55:19.218 INFO:teuthology.orchestra.run.smithi008.stdout: { 2023-08-01T19:55:19.218 INFO:teuthology.orchestra.run.smithi008.stdout: "event": "queued_for_pg", 2023-08-01T19:55:19.219 INFO:teuthology.orchestra.run.smithi008.stdout: "time": "2023-08-01T19:55:09.287267+0000", 2023-08-01T19:55:19.219 INFO:teuthology.orchestra.run.smithi008.stdout: "duration": 6.2580000000000001e-06 2023-08-01T19:55:19.219 INFO:teuthology.orchestra.run.smithi008.stdout: }, 2023-08-01T19:55:19.219 INFO:teuthology.orchestra.run.smithi008.stdout: { 2023-08-01T19:55:19.219 INFO:teuthology.orchestra.run.smithi008.stdout: "event": "reached_pg", 2023-08-01T19:55:19.219 INFO:teuthology.orchestra.run.smithi008.stdout: "time": "2023-08-01T19:55:09.287306+0000", 2023-08-01T19:55:19.220 INFO:teuthology.orchestra.run.smithi008.stdout: "duration": 3.9057999999999998e-05 2023-08-01T19:55:19.220 INFO:teuthology.orchestra.run.smithi008.stdout: }, 2023-08-01T19:55:19.220 INFO:teuthology.orchestra.run.smithi008.stdout: { 2023-08-01T19:55:19.220 INFO:teuthology.orchestra.run.smithi008.stdout: "event": "started", 2023-08-01T19:55:19.220 INFO:teuthology.orchestra.run.smithi008.stdout: "time": "2023-08-01T19:55:09.287419+0000", 2023-08-01T19:55:19.220 INFO:teuthology.orchestra.run.smithi008.stdout: "duration": 0.000112843 2023-08-01T19:55:19.221 INFO:teuthology.orchestra.run.smithi008.stdout: }, 2023-08-01T19:55:19.221 INFO:teuthology.orchestra.run.smithi008.stdout: { 2023-08-01T19:55:19.221 INFO:teuthology.orchestra.run.smithi008.stdout: "event": "waiting for subops from 1", 2023-08-01T19:55:19.221 INFO:teuthology.orchestra.run.smithi008.stdout: "time": "2023-08-01T19:55:09.287514+0000", 2023-08-01T19:55:19.221 INFO:teuthology.orchestra.run.smithi008.stdout: "duration": 9.5068000000000005e-05 2023-08-01T19:55:19.221 INFO:teuthology.orchestra.run.smithi008.stdout: }, 2023-08-01T19:55:19.221 INFO:teuthology.orchestra.run.smithi008.stdout: { 2023-08-01T19:55:19.222 INFO:teuthology.orchestra.run.smithi008.stdout: "event": "op_commit", 2023-08-01T19:55:19.222 INFO:teuthology.orchestra.run.smithi008.stdout: "time": "2023-08-01T19:55:09.293891+0000", 2023-08-01T19:55:19.222 INFO:teuthology.orchestra.run.smithi008.stdout: "duration": 0.00637712 2023-08-01T19:55:19.222 INFO:teuthology.orchestra.run.smithi008.stdout: }, 2023-08-01T19:55:19.222 INFO:teuthology.orchestra.run.smithi008.stdout: { 2023-08-01T19:55:19.222 INFO:teuthology.orchestra.run.smithi008.stdout: "event": "sub_op_commit_rec", 2023-08-01T19:55:19.222 INFO:teuthology.orchestra.run.smithi008.stdout: "time": "2023-08-01T19:55:09.351871+0000", 2023-08-01T19:55:19.223 INFO:teuthology.orchestra.run.smithi008.stdout: "duration": 0.057980054000000003 2023-08-01T19:55:19.223 INFO:teuthology.orchestra.run.smithi008.stdout: }, 2023-08-01T19:55:19.223 INFO:teuthology.orchestra.run.smithi008.stdout: { 2023-08-01T19:55:19.223 INFO:teuthology.orchestra.run.smithi008.stdout: "event": "commit_sent", 2023-08-01T19:55:19.223 INFO:teuthology.orchestra.run.smithi008.stdout: "time": "2023-08-01T19:55:09.351917+0000", 2023-08-01T19:55:19.223 INFO:teuthology.orchestra.run.smithi008.stdout: "duration": 4.5501999999999999e-05 2023-08-01T19:55:19.223 INFO:teuthology.orchestra.run.smithi008.stdout: }, 2023-08-01T19:55:19.223 INFO:teuthology.orchestra.run.smithi008.stdout: { 2023-08-01T19:55:19.224 INFO:teuthology.orchestra.run.smithi008.stdout: "event": "done", 2023-08-01T19:55:19.224 INFO:teuthology.orchestra.run.smithi008.stdout: "time": "2023-08-01T19:55:09.351951+0000", 2023-08-01T19:55:19.224 INFO:teuthology.orchestra.run.smithi008.stdout: "duration": 3.4450999999999999e-05 2023-08-01T19:55:19.224 INFO:teuthology.orchestra.run.smithi008.stdout: } 2023-08-01T19:55:19.224 INFO:teuthology.orchestra.run.smithi008.stdout: ] 2023-08-01T19:55:19.224 INFO:teuthology.orchestra.run.smithi008.stdout: } 2023-08-01T19:55:19.224 INFO:teuthology.orchestra.run.smithi008.stdout: }, 2023-08-01T19:55:19.225 INFO:teuthology.orchestra.run.smithi008.stdout: { 2023-08-01T19:55:19.225 INFO:teuthology.orchestra.run.smithi008.stdout: "description": "osd_op(client.4668.0:107880 5.5 5:a8d12d4b:::benchmark_data_smithi006_114134_object107879:head [set-alloc-hint object_size 65536 write_size 65536,write 0~65536] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e38)", 2023-08-01T19:55:19.225 INFO:teuthology.orchestra.run.smithi008.stdout: "initiated_at": "2023-08-01T19:55:09.292335+0000", 2023-08-01T19:55:19.225 INFO:teuthology.orchestra.run.smithi008.stdout: "age": 9.7294669630000001, 2023-08-01T19:55:19.225 INFO:teuthology.orchestra.run.smithi008.stdout: "duration": 0.061350719999999997, 2023-08-01T19:55:19.225 INFO:teuthology.orchestra.run.smithi008.stdout: "type_data": { 2023-08-01T19:55:19.225 INFO:teuthology.orchestra.run.smithi008.stdout: "flag_point": "commit sent; apply or cleanup", 2023-08-01T19:55:19.225 INFO:teuthology.orchestra.run.smithi008.stdout: "client_info": { 2023-08-01T19:55:19.226 INFO:teuthology.orchestra.run.smithi008.stdout: "client": "client.4668", 2023-08-01T19:55:19.226 INFO:teuthology.orchestra.run.smithi008.stdout: "client_addr": "172.21.15.6:0/1709472247", 2023-08-01T19:55:19.226 INFO:teuthology.orchestra.run.smithi008.stdout: "tid": 107880 2023-08-01T19:55:19.226 INFO:teuthology.orchestra.run.smithi008.stdout: }, 2023-08-01T19:55:19.226 INFO:teuthology.orchestra.run.smithi008.stdout: "events": [ 2023-08-01T19:55:19.226 INFO:teuthology.orchestra.run.smithi008.stdout: { 2023-08-01T19:55:19.227 INFO:teuthology.orchestra.run.smithi008.stdout: "event": "initiated", 2023-08-01T19:55:19.227 INFO:teuthology.orchestra.run.smithi008.stdout: "time": "2023-08-01T19:55:09.292335+0000", 2023-08-01T19:55:19.227 INFO:teuthology.orchestra.run.smithi008.stdout: "duration": 0 2023-08-01T19:55:19.227 INFO:teuthology.orchestra.run.smithi008.stdout: }, 2023-08-01T19:55:19.227 INFO:teuthology.orchestra.run.smithi008.stdout: { 2023-08-01T19:55:19.227 INFO:teuthology.orchestra.run.smithi008.stdout: "event": "throttled", 2023-08-01T19:55:19.228 INFO:teuthology.orchestra.run.smithi008.stdout: "time": "2023-08-01T19:55:09.292335+0000", 2023-08-01T19:55:19.228 INFO:teuthology.orchestra.run.smithi008.stdout: "duration": 0 2023-08-01T19:55:19.228 INFO:teuthology.orchestra.run.smithi008.stdout: }, 2023-08-01T19:55:19.228 INFO:teuthology.orchestra.run.smithi008.stdout: { 2023-08-01T19:55:19.228 INFO:teuthology.orchestra.run.smithi008.stdout: "event": "header_read", 2023-08-01T19:55:19.228 INFO:teuthology.orchestra.run.smithi008.stdout: "time": "2023-08-01T19:55:09.292334+0000", 2023-08-01T19:55:19.228 INFO:teuthology.orchestra.run.smithi008.stdout: "duration": 4294967295.999999 2023-08-01T19:55:19.229 INFO:teuthology.orchestra.run.smithi008.stdout: }, 2023-08-01T19:55:19.229 INFO:teuthology.orchestra.run.smithi008.stdout: { 2023-08-01T19:55:19.229 INFO:teuthology.orchestra.run.smithi008.stdout: "event": "all_read", 2023-08-01T19:55:19.229 INFO:teuthology.orchestra.run.smithi008.stdout: "time": "2023-08-01T19:55:09.292449+0000", 2023-08-01T19:55:19.229 INFO:teuthology.orchestra.run.smithi008.stdout: "duration": 0.00011551400000000001 2023-08-01T19:55:19.229 INFO:teuthology.orchestra.run.smithi008.stdout: }, 2023-08-01T19:55:19.230 INFO:teuthology.orchestra.run.smithi008.stdout: { 2023-08-01T19:55:19.230 INFO:teuthology.orchestra.run.smithi008.stdout: "event": "dispatched", 2023-08-01T19:55:19.230 INFO:teuthology.orchestra.run.smithi008.stdout: "time": "2023-08-01T19:55:09.292461+0000", 2023-08-01T19:55:19.230 INFO:teuthology.orchestra.run.smithi008.stdout: "duration": 1.1287000000000001e-05 2023-08-01T19:55:19.230 INFO:teuthology.orchestra.run.smithi008.stdout: }, 2023-08-01T19:55:19.230 INFO:teuthology.orchestra.run.smithi008.stdout: { 2023-08-01T19:55:19.230 INFO:teuthology.orchestra.run.smithi008.stdout: "event": "queued_for_pg", 2023-08-01T19:55:19.231 INFO:teuthology.orchestra.run.smithi008.stdout: "time": "2023-08-01T19:55:09.292467+0000", 2023-08-01T19:55:19.231 INFO:teuthology.orchestra.run.smithi008.stdout: "duration": 6.4520000000000002e-06 2023-08-01T19:55:19.231 INFO:teuthology.orchestra.run.smithi008.stdout: }, 2023-08-01T19:55:19.231 INFO:teuthology.orchestra.run.smithi008.stdout: { 2023-08-01T19:55:19.231 INFO:teuthology.orchestra.run.smithi008.stdout: "event": "reached_pg", 2023-08-01T19:55:19.231 INFO:teuthology.orchestra.run.smithi008.stdout: "time": "2023-08-01T19:55:09.292510+0000", 2023-08-01T19:55:19.231 INFO:teuthology.orchestra.run.smithi008.stdout: "duration": 4.2502000000000001e-05 2023-08-01T19:55:19.231 INFO:teuthology.orchestra.run.smithi008.stdout: }, 2023-08-01T19:55:19.232 INFO:teuthology.orchestra.run.smithi008.stdout: { 2023-08-01T19:55:19.232 INFO:teuthology.orchestra.run.smithi008.stdout: "event": "started", 2023-08-01T19:55:19.232 INFO:teuthology.orchestra.run.smithi008.stdout: "time": "2023-08-01T19:55:09.292596+0000", 2023-08-01T19:55:19.232 INFO:teuthology.orchestra.run.smithi008.stdout: "duration": 8.6545000000000006e-05 2023-08-01T19:55:19.232 INFO:teuthology.orchestra.run.smithi008.stdout: }, 2023-08-01T19:55:19.232 INFO:teuthology.orchestra.run.smithi008.stdout: { 2023-08-01T19:55:19.232 INFO:teuthology.orchestra.run.smithi008.stdout: "event": "waiting for subops from 1", 2023-08-01T19:55:19.233 INFO:teuthology.orchestra.run.smithi008.stdout: "time": "2023-08-01T19:55:09.292697+0000", 2023-08-01T19:55:19.233 INFO:teuthology.orchestra.run.smithi008.stdout: "duration": 0.000100368 2023-08-01T19:55:19.233 INFO:teuthology.orchestra.run.smithi008.stdout: }, 2023-08-01T19:55:19.233 INFO:teuthology.orchestra.run.smithi008.stdout: { 2023-08-01T19:55:19.233 INFO:teuthology.orchestra.run.smithi008.stdout: "event": "op_commit", 2023-08-01T19:55:19.233 INFO:teuthology.orchestra.run.smithi008.stdout: "time": "2023-08-01T19:55:09.295658+0000", 2023-08-01T19:55:19.233 INFO:teuthology.orchestra.run.smithi008.stdout: "duration": 0.0029617290000000002 2023-08-01T19:55:19.234 INFO:teuthology.orchestra.run.smithi008.stdout: }, 2023-08-01T19:55:19.234 INFO:teuthology.orchestra.run.smithi008.stdout: { 2023-08-01T19:55:19.234 INFO:teuthology.orchestra.run.smithi008.stdout: "event": "sub_op_commit_rec", 2023-08-01T19:55:19.234 INFO:teuthology.orchestra.run.smithi008.stdout: "time": "2023-08-01T19:55:09.353604+0000", 2023-08-01T19:55:19.234 INFO:teuthology.orchestra.run.smithi008.stdout: "duration": 0.057945868999999997 2023-08-01T19:55:19.234 INFO:teuthology.orchestra.run.smithi008.stdout: }, 2023-08-01T19:55:19.234 INFO:teuthology.orchestra.run.smithi008.stdout: { 2023-08-01T19:55:19.235 INFO:teuthology.orchestra.run.smithi008.stdout: "event": "commit_sent", 2023-08-01T19:55:19.235 INFO:teuthology.orchestra.run.smithi008.stdout: "time": "2023-08-01T19:55:09.353650+0000", 2023-08-01T19:55:19.235 INFO:teuthology.orchestra.run.smithi008.stdout: "duration": 4.5698999999999997e-05 2023-08-01T19:55:19.235 INFO:teuthology.orchestra.run.smithi008.stdout: }, 2023-08-01T19:55:19.235 INFO:teuthology.orchestra.run.smithi008.stdout: { 2023-08-01T19:55:19.235 INFO:teuthology.orchestra.run.smithi008.stdout: "event": "done", 2023-08-01T19:55:19.235 INFO:teuthology.orchestra.run.smithi008.stdout: "time": "2023-08-01T19:55:09.353686+0000", 2023-08-01T19:55:19.235 INFO:teuthology.orchestra.run.smithi008.stdout: "duration": 3.5936999999999998e-05 2023-08-01T19:55:19.236 INFO:teuthology.orchestra.run.smithi008.stdout: } 2023-08-01T19:55:19.236 INFO:teuthology.orchestra.run.smithi008.stdout: ] 2023-08-01T19:55:19.236 INFO:teuthology.orchestra.run.smithi008.stdout: } 2023-08-01T19:55:19.236 INFO:teuthology.orchestra.run.smithi008.stdout: } 2023-08-01T19:55:19.236 INFO:teuthology.orchestra.run.smithi008.stdout: ] 2023-08-01T19:55:19.236 INFO:teuthology.orchestra.run.smithi008.stdout:} 2023-08-01T19:55:19.238 INFO:teuthology.orchestra.run.smithi006.stdout:osd.0: {} 2023-08-01T19:55:19.238 INFO:teuthology.orchestra.run.smithi006.stdout:osd.1: {} 2023-08-01T19:55:19.238 INFO:teuthology.orchestra.run.smithi006.stdout:osd.2: {} 2023-08-01T19:55:19.239 DEBUG:teuthology.orchestra.run.smithi101:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 30 ceph --cluster ceph --admin-daemon /var/run/ceph/ceph-osd.1.asok dump_ops_in_flight 2023-08-01T19:55:19.239 INFO:tasks.ceph.osd.0.smithi008.stderr:2023-08-01T19:55:19.236+0000 7f16a58f4700 -1 received signal: Hangup from /usr/bin/python3 /bin/daemon-helper kill ceph-osd -f --cluster ceph -i 0 (PID: 111179) UID: 0 2023-08-01T19:55:19.240 INFO:teuthology.orchestra.run.smithi006.stderr:osd.0: osd_enable_op_tracker = 'false' 2023-08-01T19:55:19.240 INFO:teuthology.orchestra.run.smithi006.stderr:osd.1: osd_enable_op_tracker = 'false' 2023-08-01T19:55:19.240 INFO:teuthology.orchestra.run.smithi006.stderr:osd.2: osd_enable_op_tracker = 'false' 2023-08-01T19:55:19.317 INFO:tasks.radosbench.radosbench.0.smithi006.stdout: 55 16 124501 124485 141.448 111.375 0.0112692 0.00706687 2023-08-01T19:55:19.338 INFO:tasks.ceph.osd.1.smithi101.stderr:2023-08-01T19:55:19.337+0000 7fb0cb7f6700 -1 received signal: Hangup from /usr/bin/python3 /bin/daemon-helper kill ceph-osd -f --cluster ceph -i 1 (PID: 111141) UID: 0 2023-08-01T19:55:19.411 INFO:teuthology.orchestra.run.smithi101.stdout:ERROR: (22) Invalid argument 2023-08-01T19:55:19.411 INFO:teuthology.orchestra.run.smithi101.stdout:op_tracker tracking is not enabled now, so no ops are tracked currently, even those get stuck. Please enable "osd_enable_op_tracker", and the tracker will start to track new ops received afterwards. 2023-08-01T19:55:19.426 DEBUG:teuthology.orchestra.run.smithi101:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 30 ceph --cluster ceph --admin-daemon /var/run/ceph/ceph-osd.1.asok dump_blocked_ops 2023-08-01T19:55:19.439 INFO:tasks.ceph.osd.2.smithi155.stderr:2023-08-01T19:55:19.438+0000 7faa5c6ac700 -1 received signal: Hangup from /usr/bin/python3 /bin/daemon-helper kill ceph-osd -f --cluster ceph -i 2 (PID: 111337) UID: 0 2023-08-01T19:55:19.539 INFO:tasks.ceph.osd.1.smithi101.stderr:2023-08-01T19:55:19.538+0000 7fb0cb7f6700 -1 received signal: Hangup from /usr/bin/python3 /bin/daemon-helper kill ceph-osd -f --cluster ceph -i 1 (PID: 111141) UID: 0 2023-08-01T19:55:19.617 INFO:teuthology.orchestra.run.smithi101.stdout:ERROR: (22) Invalid argument 2023-08-01T19:55:19.618 INFO:teuthology.orchestra.run.smithi101.stdout:op_tracker tracking is not enabled now, so no ops are tracked currently, even those get stuck. Please enable "osd_enable_op_tracker", and the tracker will start to track new ops received afterwards. 2023-08-01T19:55:19.629 DEBUG:teuthology.orchestra.run.smithi101:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 30 ceph --cluster ceph --admin-daemon /var/run/ceph/ceph-osd.1.asok dump_historic_ops 2023-08-01T19:55:19.640 INFO:tasks.ceph.osd.2.smithi155.stderr:2023-08-01T19:55:19.639+0000 7faa5c6ac700 -1 received signal: Hangup from /usr/bin/python3 /bin/daemon-helper kill ceph-osd -f --cluster ceph -i 2 (PID: 111337) UID: 0 2023-08-01T19:55:19.740 INFO:tasks.ceph.osd.2.smithi155.stderr:2023-08-01T19:55:19.740+0000 7faa5c6ac700 -1 received signal: Hangup from /usr/bin/python3 /bin/daemon-helper kill ceph-osd -f --cluster ceph -i 2 (PID: 111337) UID: 0 2023-08-01T19:55:19.841 INFO:tasks.ceph.osd.2.smithi155.stderr:2023-08-01T19:55:19.840+0000 7faa5c6ac700 -1 received signal: Hangup from /usr/bin/python3 /bin/daemon-helper kill ceph-osd -f --cluster ceph -i 2 (PID: 111337) UID: 0 2023-08-01T19:55:19.841 INFO:teuthology.orchestra.run.smithi101.stdout:ERROR: (22) Invalid argument 2023-08-01T19:55:19.842 INFO:teuthology.orchestra.run.smithi101.stdout:op_tracker tracking is not enabled now, so no ops are tracked currently, even those get stuck. Please enable "osd_enable_op_tracker", and the tracker will start to track new ops received afterwards. 2023-08-01T19:55:19.854 DEBUG:teuthology.orchestra.run.smithi155:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 30 ceph --cluster ceph --admin-daemon /var/run/ceph/ceph-osd.2.asok dump_ops_in_flight 2023-08-01T19:55:19.941 INFO:tasks.ceph.osd.0.smithi008.stderr:2023-08-01T19:55:19.939+0000 7f16a58f4700 -1 received signal: Hangup from /usr/bin/python3 /bin/daemon-helper kill ceph-osd -f --cluster ceph -i 0 (PID: 111179) UID: 0 2023-08-01T19:55:20.022 INFO:teuthology.orchestra.run.smithi155.stdout:ERROR: (22) Invalid argument 2023-08-01T19:55:20.022 INFO:teuthology.orchestra.run.smithi155.stdout:op_tracker tracking is not enabled now, so no ops are tracked currently, even those get stuck. Please enable "osd_enable_op_tracker", and the tracker will start to track new ops received afterwards. 2023-08-01T19:55:20.037 DEBUG:teuthology.orchestra.run.smithi155:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 30 ceph --cluster ceph --admin-daemon /var/run/ceph/ceph-osd.2.asok dump_blocked_ops 2023-08-01T19:55:20.042 INFO:tasks.ceph.osd.1.smithi101.stderr:2023-08-01T19:55:20.041+0000 7fb0cb7f6700 -1 received signal: Hangup from /usr/bin/python3 /bin/daemon-helper kill ceph-osd -f --cluster ceph -i 1 (PID: 111141) UID: 0 2023-08-01T19:55:20.143 INFO:tasks.ceph.osd.2.smithi155.stderr:2023-08-01T19:55:20.142+0000 7faa5c6ac700 -1 received signal: Hangup from /usr/bin/python3 /bin/daemon-helper kill ceph-osd -f --cluster ceph -i 2 (PID: 111337) UID: 0 2023-08-01T19:55:20.204 INFO:teuthology.orchestra.run.smithi155.stdout:ERROR: (22) Invalid argument 2023-08-01T19:55:20.205 INFO:teuthology.orchestra.run.smithi155.stdout:op_tracker tracking is not enabled now, so no ops are tracked currently, even those get stuck. Please enable "osd_enable_op_tracker", and the tracker will start to track new ops received afterwards. 2023-08-01T19:55:20.219 DEBUG:teuthology.orchestra.run.smithi155:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 30 ceph --cluster ceph --admin-daemon /var/run/ceph/ceph-osd.2.asok dump_historic_ops 2023-08-01T19:55:20.244 INFO:tasks.ceph.osd.0.smithi008.stderr:2023-08-01T19:55:20.242+0000 7f16a58f4700 -1 received signal: Hangup from /usr/bin/python3 /bin/daemon-helper kill ceph-osd -f --cluster ceph -i 0 (PID: 111179) UID: 0 2023-08-01T19:55:20.317 INFO:tasks.radosbench.radosbench.0.smithi006.stdout: 56 16 126380 126364 141.019 117.438 0.00922656 0.00708851 2023-08-01T19:55:20.344 INFO:tasks.ceph.osd.0.smithi008.stderr:2023-08-01T19:55:20.342+0000 7f16a58f4700 -1 received signal: Hangup from /usr/bin/python3 /bin/daemon-helper kill ceph-osd -f --cluster ceph -i 0 (PID: 111179) UID: 0 2023-08-01T19:55:20.443 INFO:teuthology.orchestra.run.smithi155.stdout:ERROR: (22) Invalid argument 2023-08-01T19:55:20.443 INFO:teuthology.orchestra.run.smithi155.stdout:op_tracker tracking is not enabled now, so no ops are tracked currently, even those get stuck. Please enable "osd_enable_op_tracker", and the tracker will start to track new ops received afterwards. 2023-08-01T19:55:20.445 INFO:tasks.ceph.osd.1.smithi101.stderr:2023-08-01T19:55:20.444+0000 7fb0cb7f6700 -1 received signal: Hangup from /usr/bin/python3 /bin/daemon-helper kill ceph-osd -f --cluster ceph -i 1 (PID: 111141) UID: 0 2023-08-01T19:55:20.456 DEBUG:teuthology.orchestra.run.smithi008:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 30 ceph --cluster ceph --admin-daemon /var/run/ceph/ceph-osd.0.asok dump_ops_in_flight 2023-08-01T19:55:20.546 INFO:tasks.ceph.osd.2.smithi155.stderr:2023-08-01T19:55:20.546+0000 7faa5c6ac700 -1 received signal: Hangup from /usr/bin/python3 /bin/daemon-helper kill ceph-osd -f --cluster ceph -i 2 (PID: 111337) UID: 0 2023-08-01T19:55:20.632 DEBUG:teuthology.orchestra.run.smithi006:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 120 ceph --cluster ceph osd set noscrub 2023-08-01T19:55:20.647 INFO:tasks.ceph.osd.2.smithi155.stderr:2023-08-01T19:55:20.647+0000 7faa5c6ac700 -1 received signal: Hangup from /usr/bin/python3 /bin/daemon-helper kill ceph-osd -f --cluster ceph -i 2 (PID: 111337) UID: 0 2023-08-01T19:55:20.657 INFO:teuthology.orchestra.run.smithi008.stdout:ERROR: (22) Invalid argument 2023-08-01T19:55:20.657 INFO:teuthology.orchestra.run.smithi008.stdout:op_tracker tracking is not enabled now, so no ops are tracked currently, even those get stuck. Please enable "osd_enable_op_tracker", and the tracker will start to track new ops received afterwards. 2023-08-01T19:55:20.672 DEBUG:teuthology.orchestra.run.smithi008:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 30 ceph --cluster ceph --admin-daemon /var/run/ceph/ceph-osd.0.asok dump_blocked_ops 2023-08-01T19:55:20.748 INFO:tasks.ceph.osd.2.smithi155.stderr:2023-08-01T19:55:20.747+0000 7faa5c6ac700 -1 received signal: Hangup from /usr/bin/python3 /bin/daemon-helper kill ceph-osd -f --cluster ceph -i 2 (PID: 111337) UID: 0 2023-08-01T19:55:20.770 INFO:tasks.thrashosds.thrasher:in_osds: [0, 1, 2] out_osds: [] dead_osds: [] live_osds: [0, 1, 2] 2023-08-01T19:55:20.770 INFO:tasks.thrashosds.thrasher:choose_action: min_in 4 min_out 0 min_live 2 min_dead 0 chance_down 1.00 2023-08-01T19:55:20.770 INFO:tasks.thrashosds.thrasher:thrash_pg_upmap_items 2023-08-01T19:55:20.770 DEBUG:teuthology.orchestra.run.smithi006:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 120 ceph --cluster ceph osd dump -f json-pretty 2023-08-01T19:55:20.849 INFO:tasks.ceph.osd.0.smithi008.stderr:2023-08-01T19:55:20.848+0000 7f16a58f4700 -1 received signal: Hangup from /usr/bin/python3 /bin/daemon-helper kill ceph-osd -f --cluster ceph -i 0 (PID: 111179) UID: 0 2023-08-01T19:55:20.861 INFO:teuthology.orchestra.run.smithi008.stdout:ERROR: (22) Invalid argument 2023-08-01T19:55:20.862 INFO:teuthology.orchestra.run.smithi008.stdout:op_tracker tracking is not enabled now, so no ops are tracked currently, even those get stuck. Please enable "osd_enable_op_tracker", and the tracker will start to track new ops received afterwards. 2023-08-01T19:55:20.874 DEBUG:teuthology.orchestra.run.smithi008:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 30 ceph --cluster ceph --admin-daemon /var/run/ceph/ceph-osd.0.asok dump_historic_ops 2023-08-01T19:55:20.959 INFO:tasks.ceph.osd.0.smithi008.stderr:2023-08-01T19:55:20.958+0000 7f16a58f4700 -1 received signal: Hangup from /usr/bin/python3 /bin/daemon-helper kill ceph-osd -f --cluster ceph -i 0 (PID: 111179) UID: 0 2023-08-01T19:55:21.052 INFO:tasks.ceph.osd.2.smithi155.stderr:2023-08-01T19:55:21.050+0000 7faa5c6ac700 -1 received signal: Hangup from /usr/bin/python3 /bin/daemon-helper kill ceph-osd -f --cluster ceph -i 2 (PID: 111337) UID: 0 2023-08-01T19:55:21.112 INFO:teuthology.orchestra.run.smithi008.stdout:ERROR: (22) Invalid argument 2023-08-01T19:55:21.113 INFO:teuthology.orchestra.run.smithi008.stdout:op_tracker tracking is not enabled now, so no ops are tracked currently, even those get stuck. Please enable "osd_enable_op_tracker", and the tracker will start to track new ops received afterwards. 2023-08-01T19:55:21.115 INFO:teuthology.orchestra.run.smithi006.stdout: 2023-08-01T19:55:21.115 INFO:teuthology.orchestra.run.smithi006.stdout:{ 2023-08-01T19:55:21.115 INFO:teuthology.orchestra.run.smithi006.stdout: "epoch": 44, 2023-08-01T19:55:21.115 INFO:teuthology.orchestra.run.smithi006.stdout: "fsid": "a0e420cc-4df1-42a5-8bd4-a98c309a9349", 2023-08-01T19:55:21.115 INFO:teuthology.orchestra.run.smithi006.stdout: "created": "2023-08-01T19:53:41.279588+0000", 2023-08-01T19:55:21.116 INFO:teuthology.orchestra.run.smithi006.stdout: "modified": "2023-08-01T19:55:18.605908+0000", 2023-08-01T19:55:21.116 INFO:teuthology.orchestra.run.smithi006.stdout: "last_up_change": "2023-08-01T19:53:50.735626+0000", 2023-08-01T19:55:21.116 INFO:teuthology.orchestra.run.smithi006.stdout: "last_in_change": "2023-08-01T19:53:42.974751+0000", 2023-08-01T19:55:21.116 INFO:teuthology.orchestra.run.smithi006.stdout: "flags": "sortbitwise,recovery_deletes,purged_snapdirs,pglog_hardlimit", 2023-08-01T19:55:21.116 INFO:teuthology.orchestra.run.smithi006.stdout: "flags_num": 5799936, 2023-08-01T19:55:21.116 INFO:teuthology.orchestra.run.smithi006.stdout: "flags_set": [ 2023-08-01T19:55:21.116 INFO:teuthology.orchestra.run.smithi006.stdout: "pglog_hardlimit", 2023-08-01T19:55:21.117 INFO:teuthology.orchestra.run.smithi006.stdout: "purged_snapdirs", 2023-08-01T19:55:21.117 INFO:teuthology.orchestra.run.smithi006.stdout: "recovery_deletes", 2023-08-01T19:55:21.117 INFO:teuthology.orchestra.run.smithi006.stdout: "sortbitwise" 2023-08-01T19:55:21.117 INFO:teuthology.orchestra.run.smithi006.stdout: ], 2023-08-01T19:55:21.117 INFO:teuthology.orchestra.run.smithi006.stdout: "crush_version": 5, 2023-08-01T19:55:21.117 INFO:teuthology.orchestra.run.smithi006.stdout: "full_ratio": 0.94999998807907104, 2023-08-01T19:55:21.117 INFO:teuthology.orchestra.run.smithi006.stdout: "backfillfull_ratio": 0.89999997615814209, 2023-08-01T19:55:21.117 INFO:teuthology.orchestra.run.smithi006.stdout: "nearfull_ratio": 0.85000002384185791, 2023-08-01T19:55:21.118 INFO:teuthology.orchestra.run.smithi006.stdout: "cluster_snapshot": "", 2023-08-01T19:55:21.118 INFO:teuthology.orchestra.run.smithi006.stdout: "pool_max": 5, 2023-08-01T19:55:21.118 INFO:teuthology.orchestra.run.smithi006.stdout: "max_osd": 3, 2023-08-01T19:55:21.118 INFO:teuthology.orchestra.run.smithi006.stdout: "require_min_compat_client": "luminous", 2023-08-01T19:55:21.118 INFO:teuthology.orchestra.run.smithi006.stdout: "min_compat_client": "jewel", 2023-08-01T19:55:21.118 INFO:teuthology.orchestra.run.smithi006.stdout: "require_osd_release": "quincy", 2023-08-01T19:55:21.118 INFO:teuthology.orchestra.run.smithi006.stdout: "pools": [ 2023-08-01T19:55:21.119 INFO:teuthology.orchestra.run.smithi006.stdout: { 2023-08-01T19:55:21.119 INFO:teuthology.orchestra.run.smithi006.stdout: "pool": 1, 2023-08-01T19:55:21.119 INFO:teuthology.orchestra.run.smithi006.stdout: "pool_name": ".mgr", 2023-08-01T19:55:21.119 INFO:teuthology.orchestra.run.smithi006.stdout: "create_time": "2023-08-01T19:53:49.961944+0000", 2023-08-01T19:55:21.119 INFO:teuthology.orchestra.run.smithi006.stdout: "flags": 1, 2023-08-01T19:55:21.119 INFO:teuthology.orchestra.run.smithi006.stdout: "flags_names": "hashpspool", 2023-08-01T19:55:21.119 INFO:teuthology.orchestra.run.smithi006.stdout: "type": 1, 2023-08-01T19:55:21.119 INFO:teuthology.orchestra.run.smithi006.stdout: "size": 2, 2023-08-01T19:55:21.120 INFO:teuthology.orchestra.run.smithi006.stdout: "min_size": 1, 2023-08-01T19:55:21.120 INFO:teuthology.orchestra.run.smithi006.stdout: "crush_rule": 0, 2023-08-01T19:55:21.120 INFO:teuthology.orchestra.run.smithi006.stdout: "peering_crush_bucket_count": 0, 2023-08-01T19:55:21.120 INFO:teuthology.orchestra.run.smithi006.stdout: "peering_crush_bucket_target": 0, 2023-08-01T19:55:21.120 INFO:teuthology.orchestra.run.smithi006.stdout: "peering_crush_bucket_barrier": 0, 2023-08-01T19:55:21.120 INFO:teuthology.orchestra.run.smithi006.stdout: "peering_crush_bucket_mandatory_member": 2147483647, 2023-08-01T19:55:21.120 INFO:teuthology.orchestra.run.smithi006.stdout: "object_hash": 2, 2023-08-01T19:55:21.120 INFO:teuthology.orchestra.run.smithi006.stdout: "pg_autoscale_mode": "off", 2023-08-01T19:55:21.121 INFO:teuthology.orchestra.run.smithi006.stdout: "pg_num": 1, 2023-08-01T19:55:21.121 INFO:teuthology.orchestra.run.smithi006.stdout: "pg_placement_num": 1, 2023-08-01T19:55:21.121 INFO:teuthology.orchestra.run.smithi006.stdout: "pg_placement_num_target": 1, 2023-08-01T19:55:21.121 INFO:teuthology.orchestra.run.smithi006.stdout: "pg_num_target": 1, 2023-08-01T19:55:21.121 INFO:teuthology.orchestra.run.smithi006.stdout: "pg_num_pending": 1, 2023-08-01T19:55:21.121 INFO:teuthology.orchestra.run.smithi006.stdout: "last_pg_merge_meta": { 2023-08-01T19:55:21.121 INFO:teuthology.orchestra.run.smithi006.stdout: "source_pgid": "0.0", 2023-08-01T19:55:21.122 INFO:teuthology.orchestra.run.smithi006.stdout: "ready_epoch": 0, 2023-08-01T19:55:21.122 INFO:teuthology.orchestra.run.smithi006.stdout: "last_epoch_started": 0, 2023-08-01T19:55:21.122 INFO:teuthology.orchestra.run.smithi006.stdout: "last_epoch_clean": 0, 2023-08-01T19:55:21.122 INFO:teuthology.orchestra.run.smithi006.stdout: "source_version": "0'0", 2023-08-01T19:55:21.122 INFO:teuthology.orchestra.run.smithi006.stdout: "target_version": "0'0" 2023-08-01T19:55:21.122 INFO:teuthology.orchestra.run.smithi006.stdout: }, 2023-08-01T19:55:21.122 INFO:teuthology.orchestra.run.smithi006.stdout: "last_change": "11", 2023-08-01T19:55:21.122 INFO:teuthology.orchestra.run.smithi006.stdout: "last_force_op_resend": "0", 2023-08-01T19:55:21.123 INFO:teuthology.orchestra.run.smithi006.stdout: "last_force_op_resend_prenautilus": "0", 2023-08-01T19:55:21.123 INFO:teuthology.orchestra.run.smithi006.stdout: "last_force_op_resend_preluminous": "0", 2023-08-01T19:55:21.123 INFO:teuthology.orchestra.run.smithi006.stdout: "auid": 0, 2023-08-01T19:55:21.123 INFO:teuthology.orchestra.run.smithi006.stdout: "snap_mode": "selfmanaged", 2023-08-01T19:55:21.123 INFO:teuthology.orchestra.run.smithi006.stdout: "snap_seq": 0, 2023-08-01T19:55:21.123 INFO:teuthology.orchestra.run.smithi006.stdout: "snap_epoch": 0, 2023-08-01T19:55:21.123 INFO:teuthology.orchestra.run.smithi006.stdout: "pool_snaps": [], 2023-08-01T19:55:21.123 INFO:teuthology.orchestra.run.smithi006.stdout: "removed_snaps": "[]", 2023-08-01T19:55:21.124 INFO:teuthology.orchestra.run.smithi006.stdout: "quota_max_bytes": 0, 2023-08-01T19:55:21.124 INFO:teuthology.orchestra.run.smithi006.stdout: "quota_max_objects": 0, 2023-08-01T19:55:21.124 INFO:teuthology.orchestra.run.smithi006.stdout: "tiers": [], 2023-08-01T19:55:21.124 INFO:teuthology.orchestra.run.smithi006.stdout: "tier_of": -1, 2023-08-01T19:55:21.124 INFO:teuthology.orchestra.run.smithi006.stdout: "read_tier": -1, 2023-08-01T19:55:21.124 INFO:teuthology.orchestra.run.smithi006.stdout: "write_tier": -1, 2023-08-01T19:55:21.124 INFO:teuthology.orchestra.run.smithi006.stdout: "cache_mode": "none", 2023-08-01T19:55:21.125 INFO:teuthology.orchestra.run.smithi006.stdout: "target_max_bytes": 0, 2023-08-01T19:55:21.125 INFO:teuthology.orchestra.run.smithi006.stdout: "target_max_objects": 0, 2023-08-01T19:55:21.125 INFO:teuthology.orchestra.run.smithi006.stdout: "cache_target_dirty_ratio_micro": 400000, 2023-08-01T19:55:21.125 INFO:teuthology.orchestra.run.smithi006.stdout: "cache_target_dirty_high_ratio_micro": 600000, 2023-08-01T19:55:21.125 INFO:teuthology.orchestra.run.smithi006.stdout: "cache_target_full_ratio_micro": 800000, 2023-08-01T19:55:21.125 INFO:teuthology.orchestra.run.smithi006.stdout: "cache_min_flush_age": 0, 2023-08-01T19:55:21.125 INFO:teuthology.orchestra.run.smithi006.stdout: "cache_min_evict_age": 0, 2023-08-01T19:55:21.126 INFO:teuthology.orchestra.run.smithi006.stdout: "erasure_code_profile": "", 2023-08-01T19:55:21.126 INFO:teuthology.orchestra.run.smithi006.stdout: "hit_set_params": { 2023-08-01T19:55:21.126 INFO:teuthology.orchestra.run.smithi006.stdout: "type": "none" 2023-08-01T19:55:21.126 INFO:teuthology.orchestra.run.smithi006.stdout: }, 2023-08-01T19:55:21.126 INFO:teuthology.orchestra.run.smithi006.stdout: "hit_set_period": 0, 2023-08-01T19:55:21.126 INFO:teuthology.orchestra.run.smithi006.stdout: "hit_set_count": 0, 2023-08-01T19:55:21.126 INFO:teuthology.orchestra.run.smithi006.stdout: "use_gmt_hitset": true, 2023-08-01T19:55:21.127 INFO:teuthology.orchestra.run.smithi006.stdout: "min_read_recency_for_promote": 0, 2023-08-01T19:55:21.127 INFO:teuthology.orchestra.run.smithi006.stdout: "min_write_recency_for_promote": 0, 2023-08-01T19:55:21.127 INFO:teuthology.orchestra.run.smithi006.stdout: "hit_set_grade_decay_rate": 0, 2023-08-01T19:55:21.127 INFO:teuthology.orchestra.run.smithi006.stdout: "hit_set_search_last_n": 0, 2023-08-01T19:55:21.127 INFO:teuthology.orchestra.run.smithi006.stdout: "grade_table": [], 2023-08-01T19:55:21.127 INFO:teuthology.orchestra.run.smithi006.stdout: "stripe_width": 0, 2023-08-01T19:55:21.127 INFO:teuthology.orchestra.run.smithi006.stdout: "expected_num_objects": 0, 2023-08-01T19:55:21.127 INFO:teuthology.orchestra.run.smithi006.stdout: "fast_read": false, 2023-08-01T19:55:21.128 INFO:teuthology.orchestra.run.smithi006.stdout: "options": { 2023-08-01T19:55:21.128 INFO:teuthology.orchestra.run.smithi006.stdout: "pg_num_max": 32, 2023-08-01T19:55:21.128 INFO:teuthology.orchestra.run.smithi006.stdout: "pg_num_min": 1 2023-08-01T19:55:21.128 INFO:teuthology.orchestra.run.smithi006.stdout: }, 2023-08-01T19:55:21.128 INFO:teuthology.orchestra.run.smithi006.stdout: "application_metadata": { 2023-08-01T19:55:21.128 INFO:teuthology.orchestra.run.smithi006.stdout: "mgr": {} 2023-08-01T19:55:21.128 INFO:teuthology.orchestra.run.smithi006.stdout: } 2023-08-01T19:55:21.129 INFO:teuthology.orchestra.run.smithi006.stdout: }, 2023-08-01T19:55:21.129 INFO:teuthology.orchestra.run.smithi006.stdout: { 2023-08-01T19:55:21.129 INFO:teuthology.orchestra.run.smithi006.stdout: "pool": 2, 2023-08-01T19:55:21.129 INFO:teuthology.orchestra.run.smithi006.stdout: "pool_name": "rbd", 2023-08-01T19:55:21.129 INFO:teuthology.orchestra.run.smithi006.stdout: "create_time": "2023-08-01T19:53:57.404091+0000", 2023-08-01T19:55:21.129 INFO:teuthology.orchestra.run.smithi006.stdout: "flags": 1, 2023-08-01T19:55:21.129 INFO:teuthology.orchestra.run.smithi006.stdout: "flags_names": "hashpspool", 2023-08-01T19:55:21.129 INFO:teuthology.orchestra.run.smithi006.stdout: "type": 1, 2023-08-01T19:55:21.130 INFO:teuthology.orchestra.run.smithi006.stdout: "size": 2, 2023-08-01T19:55:21.130 INFO:teuthology.orchestra.run.smithi006.stdout: "min_size": 1, 2023-08-01T19:55:21.130 INFO:teuthology.orchestra.run.smithi006.stdout: "crush_rule": 0, 2023-08-01T19:55:21.130 INFO:teuthology.orchestra.run.smithi006.stdout: "peering_crush_bucket_count": 0, 2023-08-01T19:55:21.130 INFO:teuthology.orchestra.run.smithi006.stdout: "peering_crush_bucket_target": 0, 2023-08-01T19:55:21.130 INFO:teuthology.orchestra.run.smithi006.stdout: "peering_crush_bucket_barrier": 0, 2023-08-01T19:55:21.130 INFO:teuthology.orchestra.run.smithi006.stdout: "peering_crush_bucket_mandatory_member": 2147483647, 2023-08-01T19:55:21.130 INFO:teuthology.orchestra.run.smithi006.stdout: "object_hash": 2, 2023-08-01T19:55:21.131 INFO:teuthology.orchestra.run.smithi006.stdout: "pg_autoscale_mode": "off", 2023-08-01T19:55:21.131 INFO:teuthology.orchestra.run.smithi006.stdout: "pg_num": 8, 2023-08-01T19:55:21.131 INFO:teuthology.orchestra.run.smithi006.stdout: "pg_placement_num": 8, 2023-08-01T19:55:21.131 INFO:teuthology.orchestra.run.smithi006.stdout: "pg_placement_num_target": 8, 2023-08-01T19:55:21.131 INFO:teuthology.orchestra.run.smithi006.stdout: "pg_num_target": 8, 2023-08-01T19:55:21.131 INFO:teuthology.orchestra.run.smithi006.stdout: "pg_num_pending": 8, 2023-08-01T19:55:21.131 INFO:teuthology.orchestra.run.smithi006.stdout: "last_pg_merge_meta": { 2023-08-01T19:55:21.131 INFO:teuthology.orchestra.run.smithi006.stdout: "source_pgid": "0.0", 2023-08-01T19:55:21.132 INFO:teuthology.orchestra.run.smithi006.stdout: "ready_epoch": 0, 2023-08-01T19:55:21.132 INFO:teuthology.orchestra.run.smithi006.stdout: "last_epoch_started": 0, 2023-08-01T19:55:21.132 INFO:teuthology.orchestra.run.smithi006.stdout: "last_epoch_clean": 0, 2023-08-01T19:55:21.132 INFO:teuthology.orchestra.run.smithi006.stdout: "source_version": "0'0", 2023-08-01T19:55:21.132 INFO:teuthology.orchestra.run.smithi006.stdout: "target_version": "0'0" 2023-08-01T19:55:21.132 INFO:teuthology.orchestra.run.smithi006.stdout: }, 2023-08-01T19:55:21.132 INFO:teuthology.orchestra.run.smithi006.stdout: "last_change": "14", 2023-08-01T19:55:21.132 INFO:teuthology.orchestra.run.smithi006.stdout: "last_force_op_resend": "0", 2023-08-01T19:55:21.133 INFO:teuthology.orchestra.run.smithi006.stdout: "last_force_op_resend_prenautilus": "0", 2023-08-01T19:55:21.133 INFO:teuthology.orchestra.run.smithi006.stdout: "last_force_op_resend_preluminous": "0", 2023-08-01T19:55:21.133 INFO:teuthology.orchestra.run.smithi006.stdout: "auid": 0, 2023-08-01T19:55:21.133 INFO:teuthology.orchestra.run.smithi006.stdout: "snap_mode": "selfmanaged", 2023-08-01T19:55:21.133 INFO:teuthology.orchestra.run.smithi006.stdout: "snap_seq": 0, 2023-08-01T19:55:21.133 INFO:teuthology.orchestra.run.smithi006.stdout: "snap_epoch": 0, 2023-08-01T19:55:21.133 INFO:teuthology.orchestra.run.smithi006.stdout: "pool_snaps": [], 2023-08-01T19:55:21.133 INFO:teuthology.orchestra.run.smithi006.stdout: "removed_snaps": "[]", 2023-08-01T19:55:21.134 INFO:teuthology.orchestra.run.smithi006.stdout: "quota_max_bytes": 0, 2023-08-01T19:55:21.134 INFO:teuthology.orchestra.run.smithi006.stdout: "quota_max_objects": 0, 2023-08-01T19:55:21.134 INFO:teuthology.orchestra.run.smithi006.stdout: "tiers": [], 2023-08-01T19:55:21.134 INFO:teuthology.orchestra.run.smithi006.stdout: "tier_of": -1, 2023-08-01T19:55:21.134 INFO:teuthology.orchestra.run.smithi006.stdout: "read_tier": -1, 2023-08-01T19:55:21.134 INFO:teuthology.orchestra.run.smithi006.stdout: "write_tier": -1, 2023-08-01T19:55:21.134 INFO:teuthology.orchestra.run.smithi006.stdout: "cache_mode": "none", 2023-08-01T19:55:21.134 INFO:teuthology.orchestra.run.smithi006.stdout: "target_max_bytes": 0, 2023-08-01T19:55:21.135 INFO:teuthology.orchestra.run.smithi006.stdout: "target_max_objects": 0, 2023-08-01T19:55:21.135 INFO:teuthology.orchestra.run.smithi006.stdout: "cache_target_dirty_ratio_micro": 400000, 2023-08-01T19:55:21.135 INFO:teuthology.orchestra.run.smithi006.stdout: "cache_target_dirty_high_ratio_micro": 600000, 2023-08-01T19:55:21.135 INFO:teuthology.orchestra.run.smithi006.stdout: "cache_target_full_ratio_micro": 800000, 2023-08-01T19:55:21.135 INFO:teuthology.orchestra.run.smithi006.stdout: "cache_min_flush_age": 0, 2023-08-01T19:55:21.135 INFO:teuthology.orchestra.run.smithi006.stdout: "cache_min_evict_age": 0, 2023-08-01T19:55:21.135 INFO:teuthology.orchestra.run.smithi006.stdout: "erasure_code_profile": "", 2023-08-01T19:55:21.136 INFO:teuthology.orchestra.run.smithi006.stdout: "hit_set_params": { 2023-08-01T19:55:21.136 INFO:teuthology.orchestra.run.smithi006.stdout: "type": "none" 2023-08-01T19:55:21.136 INFO:teuthology.orchestra.run.smithi006.stdout: }, 2023-08-01T19:55:21.136 INFO:teuthology.orchestra.run.smithi006.stdout: "hit_set_period": 0, 2023-08-01T19:55:21.136 INFO:teuthology.orchestra.run.smithi006.stdout: "hit_set_count": 0, 2023-08-01T19:55:21.136 INFO:teuthology.orchestra.run.smithi006.stdout: "use_gmt_hitset": true, 2023-08-01T19:55:21.136 INFO:teuthology.orchestra.run.smithi006.stdout: "min_read_recency_for_promote": 0, 2023-08-01T19:55:21.136 INFO:teuthology.orchestra.run.smithi006.stdout: "min_write_recency_for_promote": 0, 2023-08-01T19:55:21.137 INFO:teuthology.orchestra.run.smithi006.stdout: "hit_set_grade_decay_rate": 0, 2023-08-01T19:55:21.137 INFO:teuthology.orchestra.run.smithi006.stdout: "hit_set_search_last_n": 0, 2023-08-01T19:55:21.137 INFO:teuthology.orchestra.run.smithi006.stdout: "grade_table": [], 2023-08-01T19:55:21.137 INFO:teuthology.orchestra.run.smithi006.stdout: "stripe_width": 0, 2023-08-01T19:55:21.137 INFO:teuthology.orchestra.run.smithi006.stdout: "expected_num_objects": 0, 2023-08-01T19:55:21.137 INFO:teuthology.orchestra.run.smithi006.stdout: "fast_read": false, 2023-08-01T19:55:21.137 INFO:teuthology.orchestra.run.smithi006.stdout: "options": {}, 2023-08-01T19:55:21.138 INFO:teuthology.orchestra.run.smithi006.stdout: "application_metadata": { 2023-08-01T19:55:21.138 INFO:teuthology.orchestra.run.smithi006.stdout: "rbd": {} 2023-08-01T19:55:21.138 INFO:teuthology.orchestra.run.smithi006.stdout: } 2023-08-01T19:55:21.138 INFO:teuthology.orchestra.run.smithi006.stdout: }, 2023-08-01T19:55:21.138 INFO:teuthology.orchestra.run.smithi006.stdout: { 2023-08-01T19:55:21.138 INFO:teuthology.orchestra.run.smithi006.stdout: "pool": 3, 2023-08-01T19:55:21.138 INFO:teuthology.orchestra.run.smithi006.stdout: "pool_name": "cephfs_metadata", 2023-08-01T19:55:21.138 INFO:teuthology.orchestra.run.smithi006.stdout: "create_time": "2023-08-01T19:54:02.111247+0000", 2023-08-01T19:55:21.139 INFO:teuthology.orchestra.run.smithi006.stdout: "flags": 1, 2023-08-01T19:55:21.139 INFO:teuthology.orchestra.run.smithi006.stdout: "flags_names": "hashpspool", 2023-08-01T19:55:21.139 INFO:teuthology.orchestra.run.smithi006.stdout: "type": 1, 2023-08-01T19:55:21.139 INFO:teuthology.orchestra.run.smithi006.stdout: "size": 2, 2023-08-01T19:55:21.139 INFO:teuthology.orchestra.run.smithi006.stdout: "min_size": 1, 2023-08-01T19:55:21.139 INFO:teuthology.orchestra.run.smithi006.stdout: "crush_rule": 0, 2023-08-01T19:55:21.139 INFO:teuthology.orchestra.run.smithi006.stdout: "peering_crush_bucket_count": 0, 2023-08-01T19:55:21.139 INFO:teuthology.orchestra.run.smithi006.stdout: "peering_crush_bucket_target": 0, 2023-08-01T19:55:21.140 INFO:teuthology.orchestra.run.smithi006.stdout: "peering_crush_bucket_barrier": 0, 2023-08-01T19:55:21.140 INFO:teuthology.orchestra.run.smithi006.stdout: "peering_crush_bucket_mandatory_member": 2147483647, 2023-08-01T19:55:21.140 INFO:teuthology.orchestra.run.smithi006.stdout: "object_hash": 2, 2023-08-01T19:55:21.140 INFO:teuthology.orchestra.run.smithi006.stdout: "pg_autoscale_mode": "off", 2023-08-01T19:55:21.140 INFO:teuthology.orchestra.run.smithi006.stdout: "pg_num": 32, 2023-08-01T19:55:21.140 INFO:teuthology.orchestra.run.smithi006.stdout: "pg_placement_num": 32, 2023-08-01T19:55:21.140 INFO:teuthology.orchestra.run.smithi006.stdout: "pg_placement_num_target": 32, 2023-08-01T19:55:21.141 INFO:teuthology.orchestra.run.smithi006.stdout: "pg_num_target": 32, 2023-08-01T19:55:21.141 INFO:teuthology.orchestra.run.smithi006.stdout: "pg_num_pending": 32, 2023-08-01T19:55:21.141 INFO:teuthology.orchestra.run.smithi006.stdout: "last_pg_merge_meta": { 2023-08-01T19:55:21.141 INFO:teuthology.orchestra.run.smithi006.stdout: "source_pgid": "0.0", 2023-08-01T19:55:21.141 INFO:teuthology.orchestra.run.smithi006.stdout: "ready_epoch": 0, 2023-08-01T19:55:21.141 INFO:teuthology.orchestra.run.smithi006.stdout: "last_epoch_started": 0, 2023-08-01T19:55:21.141 INFO:teuthology.orchestra.run.smithi006.stdout: "last_epoch_clean": 0, 2023-08-01T19:55:21.141 INFO:teuthology.orchestra.run.smithi006.stdout: "source_version": "0'0", 2023-08-01T19:55:21.142 INFO:teuthology.orchestra.run.smithi006.stdout: "target_version": "0'0" 2023-08-01T19:55:21.142 INFO:teuthology.orchestra.run.smithi006.stdout: }, 2023-08-01T19:55:21.142 INFO:teuthology.orchestra.run.smithi006.stdout: "last_change": "17", 2023-08-01T19:55:21.142 INFO:teuthology.orchestra.run.smithi006.stdout: "last_force_op_resend": "0", 2023-08-01T19:55:21.142 INFO:teuthology.orchestra.run.smithi006.stdout: "last_force_op_resend_prenautilus": "0", 2023-08-01T19:55:21.142 INFO:teuthology.orchestra.run.smithi006.stdout: "last_force_op_resend_preluminous": "0", 2023-08-01T19:55:21.142 INFO:teuthology.orchestra.run.smithi006.stdout: "auid": 0, 2023-08-01T19:55:21.142 INFO:teuthology.orchestra.run.smithi006.stdout: "snap_mode": "selfmanaged", 2023-08-01T19:55:21.143 INFO:teuthology.orchestra.run.smithi006.stdout: "snap_seq": 0, 2023-08-01T19:55:21.143 INFO:teuthology.orchestra.run.smithi006.stdout: "snap_epoch": 0, 2023-08-01T19:55:21.143 INFO:teuthology.orchestra.run.smithi006.stdout: "pool_snaps": [], 2023-08-01T19:55:21.143 INFO:teuthology.orchestra.run.smithi006.stdout: "removed_snaps": "[]", 2023-08-01T19:55:21.143 INFO:teuthology.orchestra.run.smithi006.stdout: "quota_max_bytes": 0, 2023-08-01T19:55:21.143 INFO:teuthology.orchestra.run.smithi006.stdout: "quota_max_objects": 0, 2023-08-01T19:55:21.143 INFO:teuthology.orchestra.run.smithi006.stdout: "tiers": [], 2023-08-01T19:55:21.143 INFO:teuthology.orchestra.run.smithi006.stdout: "tier_of": -1, 2023-08-01T19:55:21.144 INFO:teuthology.orchestra.run.smithi006.stdout: "read_tier": -1, 2023-08-01T19:55:21.144 INFO:teuthology.orchestra.run.smithi006.stdout: "write_tier": -1, 2023-08-01T19:55:21.144 INFO:teuthology.orchestra.run.smithi006.stdout: "cache_mode": "none", 2023-08-01T19:55:21.144 INFO:teuthology.orchestra.run.smithi006.stdout: "target_max_bytes": 0, 2023-08-01T19:55:21.144 INFO:teuthology.orchestra.run.smithi006.stdout: "target_max_objects": 0, 2023-08-01T19:55:21.144 INFO:teuthology.orchestra.run.smithi006.stdout: "cache_target_dirty_ratio_micro": 400000, 2023-08-01T19:55:21.144 INFO:teuthology.orchestra.run.smithi006.stdout: "cache_target_dirty_high_ratio_micro": 600000, 2023-08-01T19:55:21.145 INFO:teuthology.orchestra.run.smithi006.stdout: "cache_target_full_ratio_micro": 800000, 2023-08-01T19:55:21.145 INFO:teuthology.orchestra.run.smithi006.stdout: "cache_min_flush_age": 0, 2023-08-01T19:55:21.145 INFO:teuthology.orchestra.run.smithi006.stdout: "cache_min_evict_age": 0, 2023-08-01T19:55:21.145 INFO:teuthology.orchestra.run.smithi006.stdout: "erasure_code_profile": "", 2023-08-01T19:55:21.145 INFO:teuthology.orchestra.run.smithi006.stdout: "hit_set_params": { 2023-08-01T19:55:21.145 INFO:teuthology.orchestra.run.smithi006.stdout: "type": "none" 2023-08-01T19:55:21.145 INFO:teuthology.orchestra.run.smithi006.stdout: }, 2023-08-01T19:55:21.145 INFO:teuthology.orchestra.run.smithi006.stdout: "hit_set_period": 0, 2023-08-01T19:55:21.146 INFO:teuthology.orchestra.run.smithi006.stdout: "hit_set_count": 0, 2023-08-01T19:55:21.146 INFO:teuthology.orchestra.run.smithi006.stdout: "use_gmt_hitset": true, 2023-08-01T19:55:21.146 INFO:teuthology.orchestra.run.smithi006.stdout: "min_read_recency_for_promote": 0, 2023-08-01T19:55:21.146 INFO:teuthology.orchestra.run.smithi006.stdout: "min_write_recency_for_promote": 0, 2023-08-01T19:55:21.146 INFO:teuthology.orchestra.run.smithi006.stdout: "hit_set_grade_decay_rate": 0, 2023-08-01T19:55:21.146 INFO:teuthology.orchestra.run.smithi006.stdout: "hit_set_search_last_n": 0, 2023-08-01T19:55:21.146 INFO:teuthology.orchestra.run.smithi006.stdout: "grade_table": [], 2023-08-01T19:55:21.146 INFO:teuthology.orchestra.run.smithi006.stdout: "stripe_width": 0, 2023-08-01T19:55:21.147 INFO:teuthology.orchestra.run.smithi006.stdout: "expected_num_objects": 0, 2023-08-01T19:55:21.147 INFO:teuthology.orchestra.run.smithi006.stdout: "fast_read": false, 2023-08-01T19:55:21.147 INFO:teuthology.orchestra.run.smithi006.stdout: "options": { 2023-08-01T19:55:21.147 INFO:teuthology.orchestra.run.smithi006.stdout: "pg_autoscale_bias": 4, 2023-08-01T19:55:21.147 INFO:teuthology.orchestra.run.smithi006.stdout: "pg_num_min": 16, 2023-08-01T19:55:21.147 INFO:teuthology.orchestra.run.smithi006.stdout: "recovery_priority": 5 2023-08-01T19:55:21.147 INFO:teuthology.orchestra.run.smithi006.stdout: }, 2023-08-01T19:55:21.147 INFO:teuthology.orchestra.run.smithi006.stdout: "application_metadata": { 2023-08-01T19:55:21.148 INFO:teuthology.orchestra.run.smithi006.stdout: "cephfs": { 2023-08-01T19:55:21.148 INFO:teuthology.orchestra.run.smithi006.stdout: "metadata": "cephfs" 2023-08-01T19:55:21.148 INFO:teuthology.orchestra.run.smithi006.stdout: } 2023-08-01T19:55:21.148 INFO:teuthology.orchestra.run.smithi006.stdout: } 2023-08-01T19:55:21.148 INFO:teuthology.orchestra.run.smithi006.stdout: }, 2023-08-01T19:55:21.148 INFO:teuthology.orchestra.run.smithi006.stdout: { 2023-08-01T19:55:21.148 INFO:teuthology.orchestra.run.smithi006.stdout: "pool": 4, 2023-08-01T19:55:21.148 INFO:teuthology.orchestra.run.smithi006.stdout: "pool_name": "cephfs_data", 2023-08-01T19:55:21.149 INFO:teuthology.orchestra.run.smithi006.stdout: "create_time": "2023-08-01T19:54:03.430277+0000", 2023-08-01T19:55:21.149 INFO:teuthology.orchestra.run.smithi006.stdout: "flags": 1, 2023-08-01T19:55:21.149 INFO:teuthology.orchestra.run.smithi006.stdout: "flags_names": "hashpspool", 2023-08-01T19:55:21.149 INFO:teuthology.orchestra.run.smithi006.stdout: "type": 1, 2023-08-01T19:55:21.149 INFO:teuthology.orchestra.run.smithi006.stdout: "size": 2, 2023-08-01T19:55:21.149 INFO:teuthology.orchestra.run.smithi006.stdout: "min_size": 1, 2023-08-01T19:55:21.149 INFO:teuthology.orchestra.run.smithi006.stdout: "crush_rule": 0, 2023-08-01T19:55:21.150 INFO:teuthology.orchestra.run.smithi006.stdout: "peering_crush_bucket_count": 0, 2023-08-01T19:55:21.150 INFO:teuthology.orchestra.run.smithi006.stdout: "peering_crush_bucket_target": 0, 2023-08-01T19:55:21.150 INFO:teuthology.orchestra.run.smithi006.stdout: "peering_crush_bucket_barrier": 0, 2023-08-01T19:55:21.150 INFO:teuthology.orchestra.run.smithi006.stdout: "peering_crush_bucket_mandatory_member": 2147483647, 2023-08-01T19:55:21.150 INFO:teuthology.orchestra.run.smithi006.stdout: "object_hash": 2, 2023-08-01T19:55:21.150 INFO:teuthology.orchestra.run.smithi006.stdout: "pg_autoscale_mode": "off", 2023-08-01T19:55:21.150 INFO:teuthology.orchestra.run.smithi006.stdout: "pg_num": 64, 2023-08-01T19:55:21.150 INFO:teuthology.orchestra.run.smithi006.stdout: "pg_placement_num": 64, 2023-08-01T19:55:21.151 INFO:teuthology.orchestra.run.smithi006.stdout: "pg_placement_num_target": 64, 2023-08-01T19:55:21.151 INFO:teuthology.orchestra.run.smithi006.stdout: "pg_num_target": 64, 2023-08-01T19:55:21.151 INFO:teuthology.orchestra.run.smithi006.stdout: "pg_num_pending": 64, 2023-08-01T19:55:21.151 INFO:teuthology.orchestra.run.smithi006.stdout: "last_pg_merge_meta": { 2023-08-01T19:55:21.151 INFO:teuthology.orchestra.run.smithi006.stdout: "source_pgid": "0.0", 2023-08-01T19:55:21.151 INFO:teuthology.orchestra.run.smithi006.stdout: "ready_epoch": 0, 2023-08-01T19:55:21.151 INFO:teuthology.orchestra.run.smithi006.stdout: "last_epoch_started": 0, 2023-08-01T19:55:21.151 INFO:teuthology.orchestra.run.smithi006.stdout: "last_epoch_clean": 0, 2023-08-01T19:55:21.152 INFO:teuthology.orchestra.run.smithi006.stdout: "source_version": "0'0", 2023-08-01T19:55:21.152 INFO:teuthology.orchestra.run.smithi006.stdout: "target_version": "0'0" 2023-08-01T19:55:21.152 INFO:teuthology.orchestra.run.smithi006.stdout: }, 2023-08-01T19:55:21.152 INFO:teuthology.orchestra.run.smithi006.stdout: "last_change": "18", 2023-08-01T19:55:21.152 INFO:teuthology.orchestra.run.smithi006.stdout: "last_force_op_resend": "0", 2023-08-01T19:55:21.152 INFO:teuthology.orchestra.run.smithi006.stdout: "last_force_op_resend_prenautilus": "0", 2023-08-01T19:55:21.152 INFO:teuthology.orchestra.run.smithi006.stdout: "last_force_op_resend_preluminous": "0", 2023-08-01T19:55:21.152 INFO:teuthology.orchestra.run.smithi006.stdout: "auid": 0, 2023-08-01T19:55:21.153 INFO:teuthology.orchestra.run.smithi006.stdout: "snap_mode": "selfmanaged", 2023-08-01T19:55:21.153 INFO:teuthology.orchestra.run.smithi006.stdout: "snap_seq": 0, 2023-08-01T19:55:21.153 INFO:teuthology.orchestra.run.smithi006.stdout: "snap_epoch": 0, 2023-08-01T19:55:21.153 INFO:teuthology.orchestra.run.smithi006.stdout: "pool_snaps": [], 2023-08-01T19:55:21.153 INFO:teuthology.orchestra.run.smithi006.stdout: "removed_snaps": "[]", 2023-08-01T19:55:21.153 INFO:teuthology.orchestra.run.smithi006.stdout: "quota_max_bytes": 0, 2023-08-01T19:55:21.153 INFO:teuthology.orchestra.run.smithi006.stdout: "quota_max_objects": 0, 2023-08-01T19:55:21.154 INFO:teuthology.orchestra.run.smithi006.stdout: "tiers": [], 2023-08-01T19:55:21.154 INFO:teuthology.orchestra.run.smithi006.stdout: "tier_of": -1, 2023-08-01T19:55:21.154 INFO:teuthology.orchestra.run.smithi006.stdout: "read_tier": -1, 2023-08-01T19:55:21.154 INFO:teuthology.orchestra.run.smithi006.stdout: "write_tier": -1, 2023-08-01T19:55:21.154 INFO:teuthology.orchestra.run.smithi006.stdout: "cache_mode": "none", 2023-08-01T19:55:21.154 INFO:teuthology.orchestra.run.smithi006.stdout: "target_max_bytes": 0, 2023-08-01T19:55:21.154 INFO:teuthology.orchestra.run.smithi006.stdout: "target_max_objects": 0, 2023-08-01T19:55:21.154 INFO:teuthology.orchestra.run.smithi006.stdout: "cache_target_dirty_ratio_micro": 400000, 2023-08-01T19:55:21.155 INFO:teuthology.orchestra.run.smithi006.stdout: "cache_target_dirty_high_ratio_micro": 600000, 2023-08-01T19:55:21.155 INFO:teuthology.orchestra.run.smithi006.stdout: "cache_target_full_ratio_micro": 800000, 2023-08-01T19:55:21.155 INFO:teuthology.orchestra.run.smithi006.stdout: "cache_min_flush_age": 0, 2023-08-01T19:55:21.155 INFO:teuthology.orchestra.run.smithi006.stdout: "cache_min_evict_age": 0, 2023-08-01T19:55:21.155 INFO:teuthology.orchestra.run.smithi006.stdout: "erasure_code_profile": "", 2023-08-01T19:55:21.155 INFO:teuthology.orchestra.run.smithi006.stdout: "hit_set_params": { 2023-08-01T19:55:21.155 INFO:teuthology.orchestra.run.smithi006.stdout: "type": "none" 2023-08-01T19:55:21.156 INFO:teuthology.orchestra.run.smithi006.stdout: }, 2023-08-01T19:55:21.156 INFO:teuthology.orchestra.run.smithi006.stdout: "hit_set_period": 0, 2023-08-01T19:55:21.156 INFO:teuthology.orchestra.run.smithi006.stdout: "hit_set_count": 0, 2023-08-01T19:55:21.156 INFO:teuthology.orchestra.run.smithi006.stdout: "use_gmt_hitset": true, 2023-08-01T19:55:21.156 INFO:teuthology.orchestra.run.smithi006.stdout: "min_read_recency_for_promote": 0, 2023-08-01T19:55:21.156 INFO:teuthology.orchestra.run.smithi006.stdout: "min_write_recency_for_promote": 0, 2023-08-01T19:55:21.156 INFO:teuthology.orchestra.run.smithi006.stdout: "hit_set_grade_decay_rate": 0, 2023-08-01T19:55:21.156 INFO:teuthology.orchestra.run.smithi006.stdout: "hit_set_search_last_n": 0, 2023-08-01T19:55:21.157 INFO:teuthology.orchestra.run.smithi006.stdout: "grade_table": [], 2023-08-01T19:55:21.157 INFO:teuthology.orchestra.run.smithi006.stdout: "stripe_width": 0, 2023-08-01T19:55:21.157 INFO:teuthology.orchestra.run.smithi006.stdout: "expected_num_objects": 0, 2023-08-01T19:55:21.157 INFO:teuthology.orchestra.run.smithi006.stdout: "fast_read": false, 2023-08-01T19:55:21.157 INFO:teuthology.orchestra.run.smithi006.stdout: "options": { 2023-08-01T19:55:21.157 INFO:teuthology.orchestra.run.smithi006.stdout: "pg_num_min": 64, 2023-08-01T19:55:21.157 INFO:teuthology.orchestra.run.smithi006.stdout: "target_size_ratio": 0.89999997615814209 2023-08-01T19:55:21.157 INFO:teuthology.orchestra.run.smithi006.stdout: }, 2023-08-01T19:55:21.158 INFO:teuthology.orchestra.run.smithi006.stdout: "application_metadata": { 2023-08-01T19:55:21.158 INFO:teuthology.orchestra.run.smithi006.stdout: "cephfs": { 2023-08-01T19:55:21.158 INFO:teuthology.orchestra.run.smithi006.stdout: "data": "cephfs" 2023-08-01T19:55:21.158 INFO:teuthology.orchestra.run.smithi006.stdout: } 2023-08-01T19:55:21.158 INFO:teuthology.orchestra.run.smithi006.stdout: } 2023-08-01T19:55:21.158 INFO:teuthology.orchestra.run.smithi006.stdout: }, 2023-08-01T19:55:21.158 INFO:teuthology.orchestra.run.smithi006.stdout: { 2023-08-01T19:55:21.158 INFO:teuthology.orchestra.run.smithi006.stdout: "pool": 5, 2023-08-01T19:55:21.159 INFO:teuthology.orchestra.run.smithi006.stdout: "pool_name": "unique_pool_0", 2023-08-01T19:55:21.159 INFO:teuthology.orchestra.run.smithi006.stdout: "create_time": "2023-08-01T19:54:21.165668+0000", 2023-08-01T19:55:21.159 INFO:teuthology.orchestra.run.smithi006.stdout: "flags": 1, 2023-08-01T19:55:21.159 INFO:teuthology.orchestra.run.smithi006.stdout: "flags_names": "hashpspool", 2023-08-01T19:55:21.159 INFO:teuthology.orchestra.run.smithi006.stdout: "type": 1, 2023-08-01T19:55:21.159 INFO:teuthology.orchestra.run.smithi006.stdout: "size": 2, 2023-08-01T19:55:21.159 INFO:teuthology.orchestra.run.smithi006.stdout: "min_size": 1, 2023-08-01T19:55:21.160 INFO:teuthology.orchestra.run.smithi006.stdout: "crush_rule": 0, 2023-08-01T19:55:21.160 INFO:teuthology.orchestra.run.smithi006.stdout: "peering_crush_bucket_count": 0, 2023-08-01T19:55:21.160 INFO:teuthology.orchestra.run.smithi006.stdout: "peering_crush_bucket_target": 0, 2023-08-01T19:55:21.160 INFO:teuthology.orchestra.run.smithi006.stdout: "peering_crush_bucket_barrier": 0, 2023-08-01T19:55:21.160 INFO:teuthology.orchestra.run.smithi006.stdout: "peering_crush_bucket_mandatory_member": 2147483647, 2023-08-01T19:55:21.160 INFO:teuthology.orchestra.run.smithi006.stdout: "object_hash": 2, 2023-08-01T19:55:21.160 INFO:teuthology.orchestra.run.smithi006.stdout: "pg_autoscale_mode": "off", 2023-08-01T19:55:21.160 INFO:teuthology.orchestra.run.smithi006.stdout: "pg_num": 16, 2023-08-01T19:55:21.161 INFO:teuthology.orchestra.run.smithi006.stdout: "pg_placement_num": 16, 2023-08-01T19:55:21.161 INFO:teuthology.orchestra.run.smithi006.stdout: "pg_placement_num_target": 16, 2023-08-01T19:55:21.161 INFO:teuthology.orchestra.run.smithi006.stdout: "pg_num_target": 16, 2023-08-01T19:55:21.161 INFO:teuthology.orchestra.run.smithi006.stdout: "pg_num_pending": 16, 2023-08-01T19:55:21.161 INFO:teuthology.orchestra.run.smithi006.stdout: "last_pg_merge_meta": { 2023-08-01T19:55:21.161 INFO:teuthology.orchestra.run.smithi006.stdout: "source_pgid": "0.0", 2023-08-01T19:55:21.161 INFO:teuthology.orchestra.run.smithi006.stdout: "ready_epoch": 0, 2023-08-01T19:55:21.161 INFO:teuthology.orchestra.run.smithi006.stdout: "last_epoch_started": 0, 2023-08-01T19:55:21.162 INFO:teuthology.orchestra.run.smithi006.stdout: "last_epoch_clean": 0, 2023-08-01T19:55:21.162 INFO:teuthology.orchestra.run.smithi006.stdout: "source_version": "0'0", 2023-08-01T19:55:21.162 INFO:teuthology.orchestra.run.smithi006.stdout: "target_version": "0'0" 2023-08-01T19:55:21.162 INFO:teuthology.orchestra.run.smithi006.stdout: }, 2023-08-01T19:55:21.162 INFO:teuthology.orchestra.run.smithi006.stdout: "last_change": "21", 2023-08-01T19:55:21.162 INFO:teuthology.orchestra.run.smithi006.stdout: "last_force_op_resend": "0", 2023-08-01T19:55:21.162 INFO:teuthology.orchestra.run.smithi006.stdout: "last_force_op_resend_prenautilus": "0", 2023-08-01T19:55:21.162 INFO:teuthology.orchestra.run.smithi006.stdout: "last_force_op_resend_preluminous": "0", 2023-08-01T19:55:21.163 INFO:teuthology.orchestra.run.smithi006.stdout: "auid": 0, 2023-08-01T19:55:21.163 INFO:teuthology.orchestra.run.smithi006.stdout: "snap_mode": "selfmanaged", 2023-08-01T19:55:21.163 INFO:teuthology.orchestra.run.smithi006.stdout: "snap_seq": 0, 2023-08-01T19:55:21.163 INFO:teuthology.orchestra.run.smithi006.stdout: "snap_epoch": 0, 2023-08-01T19:55:21.163 INFO:teuthology.orchestra.run.smithi006.stdout: "pool_snaps": [], 2023-08-01T19:55:21.163 INFO:teuthology.orchestra.run.smithi006.stdout: "removed_snaps": "[]", 2023-08-01T19:55:21.163 INFO:teuthology.orchestra.run.smithi006.stdout: "quota_max_bytes": 0, 2023-08-01T19:55:21.164 INFO:teuthology.orchestra.run.smithi006.stdout: "quota_max_objects": 0, 2023-08-01T19:55:21.164 INFO:teuthology.orchestra.run.smithi006.stdout: "tiers": [], 2023-08-01T19:55:21.164 INFO:teuthology.orchestra.run.smithi006.stdout: "tier_of": -1, 2023-08-01T19:55:21.164 INFO:teuthology.orchestra.run.smithi006.stdout: "read_tier": -1, 2023-08-01T19:55:21.164 INFO:teuthology.orchestra.run.smithi006.stdout: "write_tier": -1, 2023-08-01T19:55:21.164 INFO:teuthology.orchestra.run.smithi006.stdout: "cache_mode": "none", 2023-08-01T19:55:21.164 INFO:teuthology.orchestra.run.smithi006.stdout: "target_max_bytes": 0, 2023-08-01T19:55:21.164 INFO:teuthology.orchestra.run.smithi006.stdout: "target_max_objects": 0, 2023-08-01T19:55:21.165 INFO:teuthology.orchestra.run.smithi006.stdout: "cache_target_dirty_ratio_micro": 400000, 2023-08-01T19:55:21.165 INFO:teuthology.orchestra.run.smithi006.stdout: "cache_target_dirty_high_ratio_micro": 600000, 2023-08-01T19:55:21.165 INFO:teuthology.orchestra.run.smithi006.stdout: "cache_target_full_ratio_micro": 800000, 2023-08-01T19:55:21.165 INFO:teuthology.orchestra.run.smithi006.stdout: "cache_min_flush_age": 0, 2023-08-01T19:55:21.165 INFO:teuthology.orchestra.run.smithi006.stdout: "cache_min_evict_age": 0, 2023-08-01T19:55:21.165 INFO:teuthology.orchestra.run.smithi006.stdout: "erasure_code_profile": "", 2023-08-01T19:55:21.165 INFO:teuthology.orchestra.run.smithi006.stdout: "hit_set_params": { 2023-08-01T19:55:21.166 INFO:teuthology.orchestra.run.smithi006.stdout: "type": "none" 2023-08-01T19:55:21.166 INFO:teuthology.orchestra.run.smithi006.stdout: }, 2023-08-01T19:55:21.166 INFO:teuthology.orchestra.run.smithi006.stdout: "hit_set_period": 0, 2023-08-01T19:55:21.166 INFO:teuthology.orchestra.run.smithi006.stdout: "hit_set_count": 0, 2023-08-01T19:55:21.166 INFO:teuthology.orchestra.run.smithi006.stdout: "use_gmt_hitset": true, 2023-08-01T19:55:21.166 INFO:teuthology.orchestra.run.smithi006.stdout: "min_read_recency_for_promote": 0, 2023-08-01T19:55:21.166 INFO:teuthology.orchestra.run.smithi006.stdout: "min_write_recency_for_promote": 0, 2023-08-01T19:55:21.166 INFO:teuthology.orchestra.run.smithi006.stdout: "hit_set_grade_decay_rate": 0, 2023-08-01T19:55:21.167 INFO:teuthology.orchestra.run.smithi006.stdout: "hit_set_search_last_n": 0, 2023-08-01T19:55:21.167 INFO:teuthology.orchestra.run.smithi006.stdout: "grade_table": [], 2023-08-01T19:55:21.167 INFO:teuthology.orchestra.run.smithi006.stdout: "stripe_width": 0, 2023-08-01T19:55:21.167 INFO:teuthology.orchestra.run.smithi006.stdout: "expected_num_objects": 0, 2023-08-01T19:55:21.167 INFO:teuthology.orchestra.run.smithi006.stdout: "fast_read": false, 2023-08-01T19:55:21.167 INFO:teuthology.orchestra.run.smithi006.stdout: "options": {}, 2023-08-01T19:55:21.167 INFO:teuthology.orchestra.run.smithi006.stdout: "application_metadata": { 2023-08-01T19:55:21.167 INFO:teuthology.orchestra.run.smithi006.stdout: "rados": {} 2023-08-01T19:55:21.168 INFO:teuthology.orchestra.run.smithi006.stdout: } 2023-08-01T19:55:21.168 INFO:teuthology.orchestra.run.smithi006.stdout: } 2023-08-01T19:55:21.168 INFO:teuthology.orchestra.run.smithi006.stdout: ], 2023-08-01T19:55:21.168 INFO:teuthology.orchestra.run.smithi006.stdout: "osds": [ 2023-08-01T19:55:21.168 INFO:teuthology.orchestra.run.smithi006.stdout: { 2023-08-01T19:55:21.168 INFO:teuthology.orchestra.run.smithi006.stdout: "osd": 0, 2023-08-01T19:55:21.168 INFO:teuthology.orchestra.run.smithi006.stdout: "uuid": "5dd675c7-2777-48f2-8009-ff0e0d4c7086", 2023-08-01T19:55:21.169 INFO:teuthology.orchestra.run.smithi006.stdout: "up": 1, 2023-08-01T19:55:21.169 INFO:teuthology.orchestra.run.smithi006.stdout: "in": 1, 2023-08-01T19:55:21.169 INFO:teuthology.orchestra.run.smithi006.stdout: "weight": 1, 2023-08-01T19:55:21.169 INFO:teuthology.orchestra.run.smithi006.stdout: "primary_affinity": 1, 2023-08-01T19:55:21.169 INFO:teuthology.orchestra.run.smithi006.stdout: "last_clean_begin": 0, 2023-08-01T19:55:21.169 INFO:teuthology.orchestra.run.smithi006.stdout: "last_clean_end": 0, 2023-08-01T19:55:21.169 INFO:teuthology.orchestra.run.smithi006.stdout: "up_from": 8, 2023-08-01T19:55:21.169 INFO:teuthology.orchestra.run.smithi006.stdout: "up_thru": 40, 2023-08-01T19:55:21.170 INFO:teuthology.orchestra.run.smithi006.stdout: "down_at": 0, 2023-08-01T19:55:21.170 INFO:teuthology.orchestra.run.smithi006.stdout: "lost_at": 0, 2023-08-01T19:55:21.170 INFO:teuthology.orchestra.run.smithi006.stdout: "public_addrs": { 2023-08-01T19:55:21.170 INFO:teuthology.orchestra.run.smithi006.stdout: "addrvec": [ 2023-08-01T19:55:21.170 INFO:teuthology.orchestra.run.smithi006.stdout: { 2023-08-01T19:55:21.170 INFO:teuthology.orchestra.run.smithi006.stdout: "type": "v2", 2023-08-01T19:55:21.170 INFO:teuthology.orchestra.run.smithi006.stdout: "addr": "172.21.15.8:6800", 2023-08-01T19:55:21.170 INFO:teuthology.orchestra.run.smithi006.stdout: "nonce": 111181 2023-08-01T19:55:21.171 INFO:teuthology.orchestra.run.smithi006.stdout: }, 2023-08-01T19:55:21.171 INFO:teuthology.orchestra.run.smithi006.stdout: { 2023-08-01T19:55:21.171 INFO:teuthology.orchestra.run.smithi006.stdout: "type": "v1", 2023-08-01T19:55:21.171 INFO:teuthology.orchestra.run.smithi006.stdout: "addr": "172.21.15.8:6801", 2023-08-01T19:55:21.171 INFO:teuthology.orchestra.run.smithi006.stdout: "nonce": 111181 2023-08-01T19:55:21.171 INFO:teuthology.orchestra.run.smithi006.stdout: } 2023-08-01T19:55:21.171 INFO:teuthology.orchestra.run.smithi006.stdout: ] 2023-08-01T19:55:21.171 INFO:teuthology.orchestra.run.smithi006.stdout: }, 2023-08-01T19:55:21.172 INFO:teuthology.orchestra.run.smithi006.stdout: "cluster_addrs": { 2023-08-01T19:55:21.172 INFO:teuthology.orchestra.run.smithi006.stdout: "addrvec": [ 2023-08-01T19:55:21.172 INFO:teuthology.orchestra.run.smithi006.stdout: { 2023-08-01T19:55:21.172 INFO:teuthology.orchestra.run.smithi006.stdout: "type": "v2", 2023-08-01T19:55:21.172 INFO:teuthology.orchestra.run.smithi006.stdout: "addr": "172.21.15.8:6802", 2023-08-01T19:55:21.172 INFO:teuthology.orchestra.run.smithi006.stdout: "nonce": 111181 2023-08-01T19:55:21.172 INFO:teuthology.orchestra.run.smithi006.stdout: }, 2023-08-01T19:55:21.173 INFO:teuthology.orchestra.run.smithi006.stdout: { 2023-08-01T19:55:21.173 INFO:teuthology.orchestra.run.smithi006.stdout: "type": "v1", 2023-08-01T19:55:21.173 INFO:teuthology.orchestra.run.smithi006.stdout: "addr": "172.21.15.8:6803", 2023-08-01T19:55:21.173 INFO:teuthology.orchestra.run.smithi006.stdout: "nonce": 111181 2023-08-01T19:55:21.173 INFO:teuthology.orchestra.run.smithi006.stdout: } 2023-08-01T19:55:21.173 INFO:teuthology.orchestra.run.smithi006.stdout: ] 2023-08-01T19:55:21.173 INFO:teuthology.orchestra.run.smithi006.stdout: }, 2023-08-01T19:55:21.173 INFO:teuthology.orchestra.run.smithi006.stdout: "heartbeat_back_addrs": { 2023-08-01T19:55:21.174 INFO:teuthology.orchestra.run.smithi006.stdout: "addrvec": [ 2023-08-01T19:55:21.174 INFO:teuthology.orchestra.run.smithi006.stdout: { 2023-08-01T19:55:21.174 INFO:teuthology.orchestra.run.smithi006.stdout: "type": "v2", 2023-08-01T19:55:21.174 INFO:teuthology.orchestra.run.smithi006.stdout: "addr": "172.21.15.8:6806", 2023-08-01T19:55:21.174 INFO:teuthology.orchestra.run.smithi006.stdout: "nonce": 111181 2023-08-01T19:55:21.174 INFO:teuthology.orchestra.run.smithi006.stdout: }, 2023-08-01T19:55:21.174 INFO:teuthology.orchestra.run.smithi006.stdout: { 2023-08-01T19:55:21.174 INFO:teuthology.orchestra.run.smithi006.stdout: "type": "v1", 2023-08-01T19:55:21.175 INFO:teuthology.orchestra.run.smithi006.stdout: "addr": "172.21.15.8:6807", 2023-08-01T19:55:21.175 INFO:teuthology.orchestra.run.smithi006.stdout: "nonce": 111181 2023-08-01T19:55:21.175 INFO:teuthology.orchestra.run.smithi006.stdout: } 2023-08-01T19:55:21.175 INFO:teuthology.orchestra.run.smithi006.stdout: ] 2023-08-01T19:55:21.175 INFO:teuthology.orchestra.run.smithi006.stdout: }, 2023-08-01T19:55:21.175 INFO:teuthology.orchestra.run.smithi006.stdout: "heartbeat_front_addrs": { 2023-08-01T19:55:21.175 INFO:teuthology.orchestra.run.smithi006.stdout: "addrvec": [ 2023-08-01T19:55:21.176 INFO:teuthology.orchestra.run.smithi006.stdout: { 2023-08-01T19:55:21.176 INFO:teuthology.orchestra.run.smithi006.stdout: "type": "v2", 2023-08-01T19:55:21.176 INFO:teuthology.orchestra.run.smithi006.stdout: "addr": "172.21.15.8:6804", 2023-08-01T19:55:21.176 INFO:teuthology.orchestra.run.smithi006.stdout: "nonce": 111181 2023-08-01T19:55:21.176 INFO:teuthology.orchestra.run.smithi006.stdout: }, 2023-08-01T19:55:21.176 INFO:teuthology.orchestra.run.smithi006.stdout: { 2023-08-01T19:55:21.176 INFO:teuthology.orchestra.run.smithi006.stdout: "type": "v1", 2023-08-01T19:55:21.176 INFO:teuthology.orchestra.run.smithi006.stdout: "addr": "172.21.15.8:6805", 2023-08-01T19:55:21.177 INFO:teuthology.orchestra.run.smithi006.stdout: "nonce": 111181 2023-08-01T19:55:21.177 INFO:teuthology.orchestra.run.smithi006.stdout: } 2023-08-01T19:55:21.177 INFO:teuthology.orchestra.run.smithi006.stdout: ] 2023-08-01T19:55:21.177 INFO:teuthology.orchestra.run.smithi006.stdout: }, 2023-08-01T19:55:21.177 INFO:teuthology.orchestra.run.smithi006.stdout: "public_addr": "172.21.15.8:6801/111181", 2023-08-01T19:55:21.177 INFO:teuthology.orchestra.run.smithi006.stdout: "cluster_addr": "172.21.15.8:6803/111181", 2023-08-01T19:55:21.177 INFO:teuthology.orchestra.run.smithi006.stdout: "heartbeat_back_addr": "172.21.15.8:6807/111181", 2023-08-01T19:55:21.178 INFO:teuthology.orchestra.run.smithi006.stdout: "heartbeat_front_addr": "172.21.15.8:6805/111181", 2023-08-01T19:55:21.178 INFO:teuthology.orchestra.run.smithi006.stdout: "state": [ 2023-08-01T19:55:21.178 INFO:teuthology.orchestra.run.smithi006.stdout: "exists", 2023-08-01T19:55:21.178 INFO:teuthology.orchestra.run.smithi006.stdout: "up" 2023-08-01T19:55:21.178 INFO:teuthology.orchestra.run.smithi006.stdout: ] 2023-08-01T19:55:21.178 INFO:teuthology.orchestra.run.smithi006.stdout: }, 2023-08-01T19:55:21.178 INFO:teuthology.orchestra.run.smithi006.stdout: { 2023-08-01T19:55:21.179 INFO:teuthology.orchestra.run.smithi006.stdout: "osd": 1, 2023-08-01T19:55:21.179 INFO:teuthology.orchestra.run.smithi006.stdout: "uuid": "7fc612c4-33ba-4a33-bca8-1f42ee8ed548", 2023-08-01T19:55:21.179 INFO:teuthology.orchestra.run.smithi006.stdout: "up": 1, 2023-08-01T19:55:21.179 INFO:teuthology.orchestra.run.smithi006.stdout: "in": 1, 2023-08-01T19:55:21.179 INFO:teuthology.orchestra.run.smithi006.stdout: "weight": 1, 2023-08-01T19:55:21.179 INFO:teuthology.orchestra.run.smithi006.stdout: "primary_affinity": 0.3376312255859375, 2023-08-01T19:55:21.179 INFO:teuthology.orchestra.run.smithi006.stdout: "last_clean_begin": 0, 2023-08-01T19:55:21.180 INFO:teuthology.orchestra.run.smithi006.stdout: "last_clean_end": 0, 2023-08-01T19:55:21.180 INFO:teuthology.orchestra.run.smithi006.stdout: "up_from": 8, 2023-08-01T19:55:21.180 INFO:teuthology.orchestra.run.smithi006.stdout: "up_thru": 19, 2023-08-01T19:55:21.180 INFO:teuthology.orchestra.run.smithi006.stdout: "down_at": 0, 2023-08-01T19:55:21.180 INFO:teuthology.orchestra.run.smithi006.stdout: "lost_at": 0, 2023-08-01T19:55:21.180 INFO:teuthology.orchestra.run.smithi006.stdout: "public_addrs": { 2023-08-01T19:55:21.180 INFO:teuthology.orchestra.run.smithi006.stdout: "addrvec": [ 2023-08-01T19:55:21.180 INFO:teuthology.orchestra.run.smithi006.stdout: { 2023-08-01T19:55:21.181 INFO:teuthology.orchestra.run.smithi006.stdout: "type": "v2", 2023-08-01T19:55:21.181 INFO:teuthology.orchestra.run.smithi006.stdout: "addr": "172.21.15.101:6800", 2023-08-01T19:55:21.181 INFO:teuthology.orchestra.run.smithi006.stdout: "nonce": 111143 2023-08-01T19:55:21.181 INFO:teuthology.orchestra.run.smithi006.stdout: }, 2023-08-01T19:55:21.181 INFO:teuthology.orchestra.run.smithi006.stdout: { 2023-08-01T19:55:21.181 INFO:teuthology.orchestra.run.smithi006.stdout: "type": "v1", 2023-08-01T19:55:21.181 INFO:teuthology.orchestra.run.smithi006.stdout: "addr": "172.21.15.101:6801", 2023-08-01T19:55:21.182 INFO:teuthology.orchestra.run.smithi006.stdout: "nonce": 111143 2023-08-01T19:55:21.182 INFO:teuthology.orchestra.run.smithi006.stdout: } 2023-08-01T19:55:21.182 INFO:teuthology.orchestra.run.smithi006.stdout: ] 2023-08-01T19:55:21.182 INFO:teuthology.orchestra.run.smithi006.stdout: }, 2023-08-01T19:55:21.182 INFO:teuthology.orchestra.run.smithi006.stdout: "cluster_addrs": { 2023-08-01T19:55:21.182 INFO:teuthology.orchestra.run.smithi006.stdout: "addrvec": [ 2023-08-01T19:55:21.182 INFO:teuthology.orchestra.run.smithi006.stdout: { 2023-08-01T19:55:21.182 INFO:teuthology.orchestra.run.smithi006.stdout: "type": "v2", 2023-08-01T19:55:21.183 INFO:teuthology.orchestra.run.smithi006.stdout: "addr": "172.21.15.101:6802", 2023-08-01T19:55:21.183 INFO:teuthology.orchestra.run.smithi006.stdout: "nonce": 111143 2023-08-01T19:55:21.183 INFO:teuthology.orchestra.run.smithi006.stdout: }, 2023-08-01T19:55:21.183 INFO:teuthology.orchestra.run.smithi006.stdout: { 2023-08-01T19:55:21.183 INFO:teuthology.orchestra.run.smithi006.stdout: "type": "v1", 2023-08-01T19:55:21.183 INFO:teuthology.orchestra.run.smithi006.stdout: "addr": "172.21.15.101:6803", 2023-08-01T19:55:21.183 INFO:teuthology.orchestra.run.smithi006.stdout: "nonce": 111143 2023-08-01T19:55:21.183 INFO:teuthology.orchestra.run.smithi006.stdout: } 2023-08-01T19:55:21.184 INFO:teuthology.orchestra.run.smithi006.stdout: ] 2023-08-01T19:55:21.184 INFO:teuthology.orchestra.run.smithi006.stdout: }, 2023-08-01T19:55:21.184 INFO:teuthology.orchestra.run.smithi006.stdout: "heartbeat_back_addrs": { 2023-08-01T19:55:21.184 INFO:teuthology.orchestra.run.smithi006.stdout: "addrvec": [ 2023-08-01T19:55:21.184 INFO:teuthology.orchestra.run.smithi006.stdout: { 2023-08-01T19:55:21.184 INFO:teuthology.orchestra.run.smithi006.stdout: "type": "v2", 2023-08-01T19:55:21.184 INFO:teuthology.orchestra.run.smithi006.stdout: "addr": "172.21.15.101:6806", 2023-08-01T19:55:21.184 INFO:teuthology.orchestra.run.smithi006.stdout: "nonce": 111143 2023-08-01T19:55:21.185 INFO:teuthology.orchestra.run.smithi006.stdout: }, 2023-08-01T19:55:21.185 INFO:teuthology.orchestra.run.smithi006.stdout: { 2023-08-01T19:55:21.185 INFO:teuthology.orchestra.run.smithi006.stdout: "type": "v1", 2023-08-01T19:55:21.185 INFO:teuthology.orchestra.run.smithi006.stdout: "addr": "172.21.15.101:6807", 2023-08-01T19:55:21.185 INFO:teuthology.orchestra.run.smithi006.stdout: "nonce": 111143 2023-08-01T19:55:21.185 INFO:teuthology.orchestra.run.smithi006.stdout: } 2023-08-01T19:55:21.185 INFO:teuthology.orchestra.run.smithi006.stdout: ] 2023-08-01T19:55:21.186 INFO:teuthology.orchestra.run.smithi006.stdout: }, 2023-08-01T19:55:21.186 INFO:teuthology.orchestra.run.smithi006.stdout: "heartbeat_front_addrs": { 2023-08-01T19:55:21.186 INFO:teuthology.orchestra.run.smithi006.stdout: "addrvec": [ 2023-08-01T19:55:21.186 INFO:teuthology.orchestra.run.smithi006.stdout: { 2023-08-01T19:55:21.186 INFO:teuthology.orchestra.run.smithi006.stdout: "type": "v2", 2023-08-01T19:55:21.186 INFO:teuthology.orchestra.run.smithi006.stdout: "addr": "172.21.15.101:6804", 2023-08-01T19:55:21.186 INFO:teuthology.orchestra.run.smithi006.stdout: "nonce": 111143 2023-08-01T19:55:21.186 INFO:teuthology.orchestra.run.smithi006.stdout: }, 2023-08-01T19:55:21.187 INFO:teuthology.orchestra.run.smithi006.stdout: { 2023-08-01T19:55:21.187 INFO:teuthology.orchestra.run.smithi006.stdout: "type": "v1", 2023-08-01T19:55:21.187 INFO:teuthology.orchestra.run.smithi006.stdout: "addr": "172.21.15.101:6805", 2023-08-01T19:55:21.187 INFO:teuthology.orchestra.run.smithi006.stdout: "nonce": 111143 2023-08-01T19:55:21.187 INFO:teuthology.orchestra.run.smithi006.stdout: } 2023-08-01T19:55:21.187 INFO:teuthology.orchestra.run.smithi006.stdout: ] 2023-08-01T19:55:21.187 INFO:teuthology.orchestra.run.smithi006.stdout: }, 2023-08-01T19:55:21.187 INFO:teuthology.orchestra.run.smithi006.stdout: "public_addr": "172.21.15.101:6801/111143", 2023-08-01T19:55:21.188 INFO:teuthology.orchestra.run.smithi006.stdout: "cluster_addr": "172.21.15.101:6803/111143", 2023-08-01T19:55:21.188 INFO:teuthology.orchestra.run.smithi006.stdout: "heartbeat_back_addr": "172.21.15.101:6807/111143", 2023-08-01T19:55:21.188 INFO:teuthology.orchestra.run.smithi006.stdout: "heartbeat_front_addr": "172.21.15.101:6805/111143", 2023-08-01T19:55:21.188 INFO:teuthology.orchestra.run.smithi006.stdout: "state": [ 2023-08-01T19:55:21.188 INFO:teuthology.orchestra.run.smithi006.stdout: "exists", 2023-08-01T19:55:21.188 INFO:teuthology.orchestra.run.smithi006.stdout: "up" 2023-08-01T19:55:21.188 INFO:teuthology.orchestra.run.smithi006.stdout: ] 2023-08-01T19:55:21.189 INFO:teuthology.orchestra.run.smithi006.stdout: }, 2023-08-01T19:55:21.189 INFO:teuthology.orchestra.run.smithi006.stdout: { 2023-08-01T19:55:21.189 INFO:teuthology.orchestra.run.smithi006.stdout: "osd": 2, 2023-08-01T19:55:21.189 INFO:teuthology.orchestra.run.smithi006.stdout: "uuid": "f85cadbc-4230-4772-8f39-62ed52e220b1", 2023-08-01T19:55:21.189 INFO:teuthology.orchestra.run.smithi006.stdout: "up": 1, 2023-08-01T19:55:21.189 INFO:teuthology.orchestra.run.smithi006.stdout: "in": 1, 2023-08-01T19:55:21.189 INFO:teuthology.orchestra.run.smithi006.stdout: "weight": 1, 2023-08-01T19:55:21.189 INFO:teuthology.orchestra.run.smithi006.stdout: "primary_affinity": 1, 2023-08-01T19:55:21.190 INFO:teuthology.orchestra.run.smithi006.stdout: "last_clean_begin": 0, 2023-08-01T19:55:21.190 INFO:teuthology.orchestra.run.smithi006.stdout: "last_clean_end": 0, 2023-08-01T19:55:21.190 INFO:teuthology.orchestra.run.smithi006.stdout: "up_from": 9, 2023-08-01T19:55:21.190 INFO:teuthology.orchestra.run.smithi006.stdout: "up_thru": 40, 2023-08-01T19:55:21.190 INFO:teuthology.orchestra.run.smithi006.stdout: "down_at": 0, 2023-08-01T19:55:21.190 INFO:teuthology.orchestra.run.smithi006.stdout: "lost_at": 0, 2023-08-01T19:55:21.190 INFO:teuthology.orchestra.run.smithi006.stdout: "public_addrs": { 2023-08-01T19:55:21.190 INFO:teuthology.orchestra.run.smithi006.stdout: "addrvec": [ 2023-08-01T19:55:21.191 INFO:teuthology.orchestra.run.smithi006.stdout: { 2023-08-01T19:55:21.191 INFO:teuthology.orchestra.run.smithi006.stdout: "type": "v2", 2023-08-01T19:55:21.191 INFO:teuthology.orchestra.run.smithi006.stdout: "addr": "172.21.15.155:6800", 2023-08-01T19:55:21.191 INFO:teuthology.orchestra.run.smithi006.stdout: "nonce": 111339 2023-08-01T19:55:21.191 INFO:teuthology.orchestra.run.smithi006.stdout: }, 2023-08-01T19:55:21.191 INFO:teuthology.orchestra.run.smithi006.stdout: { 2023-08-01T19:55:21.191 INFO:teuthology.orchestra.run.smithi006.stdout: "type": "v1", 2023-08-01T19:55:21.192 INFO:teuthology.orchestra.run.smithi006.stdout: "addr": "172.21.15.155:6801", 2023-08-01T19:55:21.192 INFO:teuthology.orchestra.run.smithi006.stdout: "nonce": 111339 2023-08-01T19:55:21.192 INFO:teuthology.orchestra.run.smithi006.stdout: } 2023-08-01T19:55:21.192 INFO:teuthology.orchestra.run.smithi006.stdout: ] 2023-08-01T19:55:21.192 INFO:teuthology.orchestra.run.smithi006.stdout: }, 2023-08-01T19:55:21.192 INFO:teuthology.orchestra.run.smithi006.stdout: "cluster_addrs": { 2023-08-01T19:55:21.192 INFO:teuthology.orchestra.run.smithi006.stdout: "addrvec": [ 2023-08-01T19:55:21.192 INFO:teuthology.orchestra.run.smithi006.stdout: { 2023-08-01T19:55:21.193 INFO:teuthology.orchestra.run.smithi006.stdout: "type": "v2", 2023-08-01T19:55:21.193 INFO:teuthology.orchestra.run.smithi006.stdout: "addr": "172.21.15.155:6802", 2023-08-01T19:55:21.193 INFO:teuthology.orchestra.run.smithi006.stdout: "nonce": 111339 2023-08-01T19:55:21.193 INFO:teuthology.orchestra.run.smithi006.stdout: }, 2023-08-01T19:55:21.193 INFO:teuthology.orchestra.run.smithi006.stdout: { 2023-08-01T19:55:21.193 INFO:teuthology.orchestra.run.smithi006.stdout: "type": "v1", 2023-08-01T19:55:21.193 INFO:teuthology.orchestra.run.smithi006.stdout: "addr": "172.21.15.155:6803", 2023-08-01T19:55:21.193 INFO:teuthology.orchestra.run.smithi006.stdout: "nonce": 111339 2023-08-01T19:55:21.194 INFO:teuthology.orchestra.run.smithi006.stdout: } 2023-08-01T19:55:21.194 INFO:teuthology.orchestra.run.smithi006.stdout: ] 2023-08-01T19:55:21.194 INFO:teuthology.orchestra.run.smithi006.stdout: }, 2023-08-01T19:55:21.194 INFO:teuthology.orchestra.run.smithi006.stdout: "heartbeat_back_addrs": { 2023-08-01T19:55:21.194 INFO:teuthology.orchestra.run.smithi006.stdout: "addrvec": [ 2023-08-01T19:55:21.194 INFO:teuthology.orchestra.run.smithi006.stdout: { 2023-08-01T19:55:21.194 INFO:teuthology.orchestra.run.smithi006.stdout: "type": "v2", 2023-08-01T19:55:21.194 INFO:teuthology.orchestra.run.smithi006.stdout: "addr": "172.21.15.155:6806", 2023-08-01T19:55:21.195 INFO:teuthology.orchestra.run.smithi006.stdout: "nonce": 111339 2023-08-01T19:55:21.195 INFO:teuthology.orchestra.run.smithi006.stdout: }, 2023-08-01T19:55:21.195 INFO:teuthology.orchestra.run.smithi006.stdout: { 2023-08-01T19:55:21.195 INFO:teuthology.orchestra.run.smithi006.stdout: "type": "v1", 2023-08-01T19:55:21.195 INFO:teuthology.orchestra.run.smithi006.stdout: "addr": "172.21.15.155:6807", 2023-08-01T19:55:21.195 INFO:teuthology.orchestra.run.smithi006.stdout: "nonce": 111339 2023-08-01T19:55:21.195 INFO:teuthology.orchestra.run.smithi006.stdout: } 2023-08-01T19:55:21.195 INFO:teuthology.orchestra.run.smithi006.stdout: ] 2023-08-01T19:55:21.196 INFO:teuthology.orchestra.run.smithi006.stdout: }, 2023-08-01T19:55:21.196 INFO:teuthology.orchestra.run.smithi006.stdout: "heartbeat_front_addrs": { 2023-08-01T19:55:21.196 INFO:teuthology.orchestra.run.smithi006.stdout: "addrvec": [ 2023-08-01T19:55:21.196 INFO:teuthology.orchestra.run.smithi006.stdout: { 2023-08-01T19:55:21.196 INFO:teuthology.orchestra.run.smithi006.stdout: "type": "v2", 2023-08-01T19:55:21.196 INFO:teuthology.orchestra.run.smithi006.stdout: "addr": "172.21.15.155:6804", 2023-08-01T19:55:21.196 INFO:teuthology.orchestra.run.smithi006.stdout: "nonce": 111339 2023-08-01T19:55:21.196 INFO:teuthology.orchestra.run.smithi006.stdout: }, 2023-08-01T19:55:21.197 INFO:teuthology.orchestra.run.smithi006.stdout: { 2023-08-01T19:55:21.197 INFO:teuthology.orchestra.run.smithi006.stdout: "type": "v1", 2023-08-01T19:55:21.197 INFO:teuthology.orchestra.run.smithi006.stdout: "addr": "172.21.15.155:6805", 2023-08-01T19:55:21.197 INFO:teuthology.orchestra.run.smithi006.stdout: "nonce": 111339 2023-08-01T19:55:21.197 INFO:teuthology.orchestra.run.smithi006.stdout: } 2023-08-01T19:55:21.197 INFO:teuthology.orchestra.run.smithi006.stdout: ] 2023-08-01T19:55:21.197 INFO:teuthology.orchestra.run.smithi006.stdout: }, 2023-08-01T19:55:21.197 INFO:teuthology.orchestra.run.smithi006.stdout: "public_addr": "172.21.15.155:6801/111339", 2023-08-01T19:55:21.198 INFO:teuthology.orchestra.run.smithi006.stdout: "cluster_addr": "172.21.15.155:6803/111339", 2023-08-01T19:55:21.198 INFO:teuthology.orchestra.run.smithi006.stdout: "heartbeat_back_addr": "172.21.15.155:6807/111339", 2023-08-01T19:55:21.198 INFO:teuthology.orchestra.run.smithi006.stdout: "heartbeat_front_addr": "172.21.15.155:6805/111339", 2023-08-01T19:55:21.198 INFO:teuthology.orchestra.run.smithi006.stdout: "state": [ 2023-08-01T19:55:21.198 INFO:teuthology.orchestra.run.smithi006.stdout: "exists", 2023-08-01T19:55:21.198 INFO:teuthology.orchestra.run.smithi006.stdout: "up" 2023-08-01T19:55:21.198 INFO:teuthology.orchestra.run.smithi006.stdout: ] 2023-08-01T19:55:21.199 INFO:teuthology.orchestra.run.smithi006.stdout: } 2023-08-01T19:55:21.199 INFO:teuthology.orchestra.run.smithi006.stdout: ], 2023-08-01T19:55:21.199 INFO:teuthology.orchestra.run.smithi006.stdout: "osd_xinfo": [ 2023-08-01T19:55:21.199 INFO:teuthology.orchestra.run.smithi006.stdout: { 2023-08-01T19:55:21.199 INFO:teuthology.orchestra.run.smithi006.stdout: "osd": 0, 2023-08-01T19:55:21.199 INFO:teuthology.orchestra.run.smithi006.stdout: "down_stamp": "0.000000", 2023-08-01T19:55:21.199 INFO:teuthology.orchestra.run.smithi006.stdout: "laggy_probability": 0, 2023-08-01T19:55:21.199 INFO:teuthology.orchestra.run.smithi006.stdout: "laggy_interval": 0, 2023-08-01T19:55:21.200 INFO:teuthology.orchestra.run.smithi006.stdout: "features": 4540138320759226367, 2023-08-01T19:55:21.200 INFO:teuthology.orchestra.run.smithi006.stdout: "old_weight": 0, 2023-08-01T19:55:21.200 INFO:teuthology.orchestra.run.smithi006.stdout: "last_purged_snaps_scrub": "2023-08-01T19:53:48.018154+0000", 2023-08-01T19:55:21.200 INFO:teuthology.orchestra.run.smithi006.stdout: "dead_epoch": 0 2023-08-01T19:55:21.200 INFO:teuthology.orchestra.run.smithi006.stdout: }, 2023-08-01T19:55:21.200 INFO:teuthology.orchestra.run.smithi006.stdout: { 2023-08-01T19:55:21.200 INFO:teuthology.orchestra.run.smithi006.stdout: "osd": 1, 2023-08-01T19:55:21.200 INFO:teuthology.orchestra.run.smithi006.stdout: "down_stamp": "0.000000", 2023-08-01T19:55:21.201 INFO:teuthology.orchestra.run.smithi006.stdout: "laggy_probability": 0, 2023-08-01T19:55:21.201 INFO:teuthology.orchestra.run.smithi006.stdout: "laggy_interval": 0, 2023-08-01T19:55:21.201 INFO:teuthology.orchestra.run.smithi006.stdout: "features": 4540138320759226367, 2023-08-01T19:55:21.201 INFO:teuthology.orchestra.run.smithi006.stdout: "old_weight": 0, 2023-08-01T19:55:21.201 INFO:teuthology.orchestra.run.smithi006.stdout: "last_purged_snaps_scrub": "2023-08-01T19:53:48.000488+0000", 2023-08-01T19:55:21.201 INFO:teuthology.orchestra.run.smithi006.stdout: "dead_epoch": 0 2023-08-01T19:55:21.201 INFO:teuthology.orchestra.run.smithi006.stdout: }, 2023-08-01T19:55:21.201 INFO:teuthology.orchestra.run.smithi006.stdout: { 2023-08-01T19:55:21.202 INFO:teuthology.orchestra.run.smithi006.stdout: "osd": 2, 2023-08-01T19:55:21.202 INFO:teuthology.orchestra.run.smithi006.stdout: "down_stamp": "0.000000", 2023-08-01T19:55:21.202 INFO:teuthology.orchestra.run.smithi006.stdout: "laggy_probability": 0, 2023-08-01T19:55:21.202 INFO:teuthology.orchestra.run.smithi006.stdout: "laggy_interval": 0, 2023-08-01T19:55:21.202 INFO:teuthology.orchestra.run.smithi006.stdout: "features": 4540138320759226367, 2023-08-01T19:55:21.202 INFO:teuthology.orchestra.run.smithi006.stdout: "old_weight": 0, 2023-08-01T19:55:21.202 INFO:teuthology.orchestra.run.smithi006.stdout: "last_purged_snaps_scrub": "2023-08-01T19:53:48.072529+0000", 2023-08-01T19:55:21.202 INFO:teuthology.orchestra.run.smithi006.stdout: "dead_epoch": 0 2023-08-01T19:55:21.203 INFO:teuthology.orchestra.run.smithi006.stdout: } 2023-08-01T19:55:21.203 INFO:teuthology.orchestra.run.smithi006.stdout: ], 2023-08-01T19:55:21.203 INFO:teuthology.orchestra.run.smithi006.stdout: "pg_upmap": [], 2023-08-01T19:55:21.203 INFO:teuthology.orchestra.run.smithi006.stdout: "pg_upmap_items": [], 2023-08-01T19:55:21.203 INFO:teuthology.orchestra.run.smithi006.stdout: "pg_temp": [], 2023-08-01T19:55:21.203 INFO:teuthology.orchestra.run.smithi006.stdout: "primary_temp": [], 2023-08-01T19:55:21.203 INFO:teuthology.orchestra.run.smithi006.stdout: "blocklist": {}, 2023-08-01T19:55:21.203 INFO:teuthology.orchestra.run.smithi006.stdout: "range_blocklist": {}, 2023-08-01T19:55:21.204 INFO:teuthology.orchestra.run.smithi006.stdout: "erasure_code_profiles": { 2023-08-01T19:55:21.204 INFO:teuthology.orchestra.run.smithi006.stdout: "default": { 2023-08-01T19:55:21.204 INFO:teuthology.orchestra.run.smithi006.stdout: "crush-failure-domain": "osd", 2023-08-01T19:55:21.204 INFO:teuthology.orchestra.run.smithi006.stdout: "k": "2", 2023-08-01T19:55:21.204 INFO:teuthology.orchestra.run.smithi006.stdout: "m": "1", 2023-08-01T19:55:21.204 INFO:teuthology.orchestra.run.smithi006.stdout: "plugin": "jerasure", 2023-08-01T19:55:21.204 INFO:teuthology.orchestra.run.smithi006.stdout: "technique": "reed_sol_van" 2023-08-01T19:55:21.204 INFO:teuthology.orchestra.run.smithi006.stdout: } 2023-08-01T19:55:21.205 INFO:teuthology.orchestra.run.smithi006.stdout: }, 2023-08-01T19:55:21.205 INFO:teuthology.orchestra.run.smithi006.stdout: "removed_snaps_queue": [], 2023-08-01T19:55:21.205 INFO:teuthology.orchestra.run.smithi006.stdout: "new_removed_snaps": [], 2023-08-01T19:55:21.205 INFO:teuthology.orchestra.run.smithi006.stdout: "new_purged_snaps": [], 2023-08-01T19:55:21.205 INFO:teuthology.orchestra.run.smithi006.stdout: "crush_node_flags": {}, 2023-08-01T19:55:21.205 INFO:teuthology.orchestra.run.smithi006.stdout: "device_class_flags": {}, 2023-08-01T19:55:21.205 INFO:teuthology.orchestra.run.smithi006.stdout: "stretch_mode": { 2023-08-01T19:55:21.205 INFO:teuthology.orchestra.run.smithi006.stdout: "stretch_mode_enabled": false, 2023-08-01T19:55:21.206 INFO:teuthology.orchestra.run.smithi006.stdout: "stretch_bucket_count": 0, 2023-08-01T19:55:21.206 INFO:teuthology.orchestra.run.smithi006.stdout: "degraded_stretch_mode": 0, 2023-08-01T19:55:21.206 INFO:teuthology.orchestra.run.smithi006.stdout: "recovering_stretch_mode": 0, 2023-08-01T19:55:21.206 INFO:teuthology.orchestra.run.smithi006.stdout: "stretch_mode_bucket": 0 2023-08-01T19:55:21.206 INFO:teuthology.orchestra.run.smithi006.stdout: } 2023-08-01T19:55:21.206 INFO:teuthology.orchestra.run.smithi006.stdout:} 2023-08-01T19:55:21.207 INFO:tasks.ceph.osd.2.smithi155.stderr:2023-08-01T19:55:21.206+0000 7faa5c6ac700 -1 received signal: Hangup from /usr/bin/python3 /bin/daemon-helper kill ceph-osd -f --cluster ceph -i 2 (PID: 111337) UID: 0 2023-08-01T19:55:21.208 DEBUG:teuthology.orchestra.run.smithi101:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 30 ceph --cluster ceph --admin-daemon /var/run/ceph/ceph-osd.1.asok dump_ops_in_flight 2023-08-01T19:55:21.209 INFO:tasks.thrashosds.thrasher:j is {'epoch': 44, 'fsid': 'a0e420cc-4df1-42a5-8bd4-a98c309a9349', 'created': '2023-08-01T19:53:41.279588+0000', 'modified': '2023-08-01T19:55:18.605908+0000', 'last_up_change': '2023-08-01T19:53:50.735626+0000', 'last_in_change': '2023-08-01T19:53:42.974751+0000', 'flags': 'sortbitwise,recovery_deletes,purged_snapdirs,pglog_hardlimit', 'flags_num': 5799936, 'flags_set': ['pglog_hardlimit', 'purged_snapdirs', 'recovery_deletes', 'sortbitwise'], 'crush_version': 5, 'full_ratio': 0.949999988079071, 'backfillfull_ratio': 0.8999999761581421, 'nearfull_ratio': 0.8500000238418579, 'cluster_snapshot': '', 'pool_max': 5, 'max_osd': 3, 'require_min_compat_client': 'luminous', 'min_compat_client': 'jewel', 'require_osd_release': 'quincy', 'pools': [{'pool': 1, 'pool_name': '.mgr', 'create_time': '2023-08-01T19:53:49.961944+0000', 'flags': 1, 'flags_names': 'hashpspool', 'type': 1, 'size': 2, 'min_size': 1, 'crush_rule': 0, 'peering_crush_bucket_count': 0, 'peering_crush_bucket_target': 0, 'peering_crush_bucket_barrier': 0, 'peering_crush_bucket_mandatory_member': 2147483647, 'object_hash': 2, 'pg_autoscale_mode': 'off', 'pg_num': 1, 'pg_placement_num': 1, 'pg_placement_num_target': 1, 'pg_num_target': 1, 'pg_num_pending': 1, 'last_pg_merge_meta': {'source_pgid': '0.0', 'ready_epoch': 0, 'last_epoch_started': 0, 'last_epoch_clean': 0, 'source_version': "0'0", 'target_version': "0'0"}, 'last_change': '11', 'last_force_op_resend': '0', 'last_force_op_resend_prenautilus': '0', 'last_force_op_resend_preluminous': '0', 'auid': 0, 'snap_mode': 'selfmanaged', 'snap_seq': 0, 'snap_epoch': 0, 'pool_snaps': [], 'removed_snaps': '[]', 'quota_max_bytes': 0, 'quota_max_objects': 0, 'tiers': [], 'tier_of': -1, 'read_tier': -1, 'write_tier': -1, 'cache_mode': 'none', 'target_max_bytes': 0, 'target_max_objects': 0, 'cache_target_dirty_ratio_micro': 400000, 'cache_target_dirty_high_ratio_micro': 600000, 'cache_target_full_ratio_micro': 800000, 'cache_min_flush_age': 0, 'cache_min_evict_age': 0, 'erasure_code_profile': '', 'hit_set_params': {'type': 'none'}, 'hit_set_period': 0, 'hit_set_count': 0, 'use_gmt_hitset': True, 'min_read_recency_for_promote': 0, 'min_write_recency_for_promote': 0, 'hit_set_grade_decay_rate': 0, 'hit_set_search_last_n': 0, 'grade_table': [], 'stripe_width': 0, 'expected_num_objects': 0, 'fast_read': False, 'options': {'pg_num_max': 32, 'pg_num_min': 1}, 'application_metadata': {'mgr': {}}}, {'pool': 2, 'pool_name': 'rbd', 'create_time': '2023-08-01T19:53:57.404091+0000', 'flags': 1, 'flags_names': 'hashpspool', 'type': 1, 'size': 2, 'min_size': 1, 'crush_rule': 0, 'peering_crush_bucket_count': 0, 'peering_crush_bucket_target': 0, 'peering_crush_bucket_barrier': 0, 'peering_crush_bucket_mandatory_member': 2147483647, 'object_hash': 2, 'pg_autoscale_mode': 'off', 'pg_num': 8, 'pg_placement_num': 8, 'pg_placement_num_target': 8, 'pg_num_target': 8, 'pg_num_pending': 8, 'last_pg_merge_meta': {'source_pgid': '0.0', 'ready_epoch': 0, 'last_epoch_started': 0, 'last_epoch_clean': 0, 'source_version': "0'0", 'target_version': "0'0"}, 'last_change': '14', 'last_force_op_resend': '0', 'last_force_op_resend_prenautilus': '0', 'last_force_op_resend_preluminous': '0', 'auid': 0, 'snap_mode': 'selfmanaged', 'snap_seq': 0, 'snap_epoch': 0, 'pool_snaps': [], 'removed_snaps': '[]', 'quota_max_bytes': 0, 'quota_max_objects': 0, 'tiers': [], 'tier_of': -1, 'read_tier': -1, 'write_tier': -1, 'cache_mode': 'none', 'target_max_bytes': 0, 'target_max_objects': 0, 'cache_target_dirty_ratio_micro': 400000, 'cache_target_dirty_high_ratio_micro': 600000, 'cache_target_full_ratio_micro': 800000, 'cache_min_flush_age': 0, 'cache_min_evict_age': 0, 'erasure_code_profile': '', 'hit_set_params': {'type': 'none'}, 'hit_set_period': 0, 'hit_set_count': 0, 'use_gmt_hitset': True, 'min_read_recency_for_promote': 0, 'min_write_recency_for_promote': 0, 'hit_set_grade_decay_rate': 0, 'hit_set_search_last_n': 0, 'grade_table': [], 'stripe_width': 0, 'expected_num_objects': 0, 'fast_read': False, 'options': {}, 'application_metadata': {'rbd': {}}}, {'pool': 3, 'pool_name': 'cephfs_metadata', 'create_time': '2023-08-01T19:54:02.111247+0000', 'flags': 1, 'flags_names': 'hashpspool', 'type': 1, 'size': 2, 'min_size': 1, 'crush_rule': 0, 'peering_crush_bucket_count': 0, 'peering_crush_bucket_target': 0, 'peering_crush_bucket_barrier': 0, 'peering_crush_bucket_mandatory_member': 2147483647, 'object_hash': 2, 'pg_autoscale_mode': 'off', 'pg_num': 32, 'pg_placement_num': 32, 'pg_placement_num_target': 32, 'pg_num_target': 32, 'pg_num_pending': 32, 'last_pg_merge_meta': {'source_pgid': '0.0', 'ready_epoch': 0, 'last_epoch_started': 0, 'last_epoch_clean': 0, 'source_version': "0'0", 'target_version': "0'0"}, 'last_change': '17', 'last_force_op_resend': '0', 'last_force_op_resend_prenautilus': '0', 'last_force_op_resend_preluminous': '0', 'auid': 0, 'snap_mode': 'selfmanaged', 'snap_seq': 0, 'snap_epoch': 0, 'pool_snaps': [], 'removed_snaps': '[]', 'quota_max_bytes': 0, 'quota_max_objects': 0, 'tiers': [], 'tier_of': -1, 'read_tier': -1, 'write_tier': -1, 'cache_mode': 'none', 'target_max_bytes': 0, 'target_max_objects': 0, 'cache_target_dirty_ratio_micro': 400000, 'cache_target_dirty_high_ratio_micro': 600000, 'cache_target_full_ratio_micro': 800000, 'cache_min_flush_age': 0, 'cache_min_evict_age': 0, 'erasure_code_profile': '', 'hit_set_params': {'type': 'none'}, 'hit_set_period': 0, 'hit_set_count': 0, 'use_gmt_hitset': True, 'min_read_recency_for_promote': 0, 'min_write_recency_for_promote': 0, 'hit_set_grade_decay_rate': 0, 'hit_set_search_last_n': 0, 'grade_table': [], 'stripe_width': 0, 'expected_num_objects': 0, 'fast_read': False, 'options': {'pg_autoscale_bias': 4, 'pg_num_min': 16, 'recovery_priority': 5}, 'application_metadata': {'cephfs': {'metadata': 'cephfs'}}}, {'pool': 4, 'pool_name': 'cephfs_data', 'create_time': '2023-08-01T19:54:03.430277+0000', 'flags': 1, 'flags_names': 'hashpspool', 'type': 1, 'size': 2, 'min_size': 1, 'crush_rule': 0, 'peering_crush_bucket_count': 0, 'peering_crush_bucket_target': 0, 'peering_crush_bucket_barrier': 0, 'peering_crush_bucket_mandatory_member': 2147483647, 'object_hash': 2, 'pg_autoscale_mode': 'off', 'pg_num': 64, 'pg_placement_num': 64, 'pg_placement_num_target': 64, 'pg_num_target': 64, 'pg_num_pending': 64, 'last_pg_merge_meta': {'source_pgid': '0.0', 'ready_epoch': 0, 'last_epoch_started': 0, 'last_epoch_clean': 0, 'source_version': "0'0", 'target_version': "0'0"}, 'last_change': '18', 'last_force_op_resend': '0', 'last_force_op_resend_prenautilus': '0', 'last_force_op_resend_preluminous': '0', 'auid': 0, 'snap_mode': 'selfmanaged', 'snap_seq': 0, 'snap_epoch': 0, 'pool_snaps': [], 'removed_snaps': '[]', 'quota_max_bytes': 0, 'quota_max_objects': 0, 'tiers': [], 'tier_of': -1, 'read_tier': -1, 'write_tier': -1, 'cache_mode': 'none', 'target_max_bytes': 0, 'target_max_objects': 0, 'cache_target_dirty_ratio_micro': 400000, 'cache_target_dirty_high_ratio_micro': 600000, 'cache_target_full_ratio_micro': 800000, 'cache_min_flush_age': 0, 'cache_min_evict_age': 0, 'erasure_code_profile': '', 'hit_set_params': {'type': 'none'}, 'hit_set_period': 0, 'hit_set_count': 0, 'use_gmt_hitset': True, 'min_read_recency_for_promote': 0, 'min_write_recency_for_promote': 0, 'hit_set_grade_decay_rate': 0, 'hit_set_search_last_n': 0, 'grade_table': [], 'stripe_width': 0, 'expected_num_objects': 0, 'fast_read': False, 'options': {'pg_num_min': 64, 'target_size_ratio': 0.8999999761581421}, 'application_metadata': {'cephfs': {'data': 'cephfs'}}}, {'pool': 5, 'pool_name': 'unique_pool_0', 'create_time': '2023-08-01T19:54:21.165668+0000', 'flags': 1, 'flags_names': 'hashpspool', 'type': 1, 'size': 2, 'min_size': 1, 'crush_rule': 0, 'peering_crush_bucket_count': 0, 'peering_crush_bucket_target': 0, 'peering_crush_bucket_barrier': 0, 'peering_crush_bucket_mandatory_member': 2147483647, 'object_hash': 2, 'pg_autoscale_mode': 'off', 'pg_num': 16, 'pg_placement_num': 16, 'pg_placement_num_target': 16, 'pg_num_target': 16, 'pg_num_pending': 16, 'last_pg_merge_meta': {'source_pgid': '0.0', 'ready_epoch': 0, 'last_epoch_started': 0, 'last_epoch_clean': 0, 'source_version': "0'0", 'target_version': "0'0"}, 'last_change': '21', 'last_force_op_resend': '0', 'last_force_op_resend_prenautilus': '0', 'last_force_op_resend_preluminous': '0', 'auid': 0, 'snap_mode': 'selfmanaged', 'snap_seq': 0, 'snap_epoch': 0, 'pool_snaps': [], 'removed_snaps': '[]', 'quota_max_bytes': 0, 'quota_max_objects': 0, 'tiers': [], 'tier_of': -1, 'read_tier': -1, 'write_tier': -1, 'cache_mode': 'none', 'target_max_bytes': 0, 'target_max_objects': 0, 'cache_target_dirty_ratio_micro': 400000, 'cache_target_dirty_high_ratio_micro': 600000, 'cache_target_full_ratio_micro': 800000, 'cache_min_flush_age': 0, 'cache_min_evict_age': 0, 'erasure_code_profile': '', 'hit_set_params': {'type': 'none'}, 'hit_set_period': 0, 'hit_set_count': 0, 'use_gmt_hitset': True, 'min_read_recency_for_promote': 0, 'min_write_recency_for_promote': 0, 'hit_set_grade_decay_rate': 0, 'hit_set_search_last_n': 0, 'grade_table': [], 'stripe_width': 0, 'expected_num_objects': 0, 'fast_read': False, 'options': {}, 'application_metadata': {'rados': {}}}], 'osds': [{'osd': 0, 'uuid': '5dd675c7-2777-48f2-8009-ff0e0d4c7086', 'up': 1, 'in': 1, 'weight': 1, 'primary_affinity': 1, 'last_clean_begin': 0, 'last_clean_end': 0, 'up_from': 8, 'up_thru': 40, 'down_at': 0, 'lost_at': 0, 'public_addrs': {'addrvec': [{'type': 'v2', 'addr': '172.21.15.8:6800', 'nonce': 111181}, {'type': 'v1', 'addr': '172.21.15.8:6801', 'nonce': 111181}]}, 'cluster_addrs': {'addrvec': [{'type': 'v2', 'addr': '172.21.15.8:6802', 'nonce': 111181}, {'type': 'v1', 'addr': '172.21.15.8:6803', 'nonce': 111181}]}, 'heartbeat_back_addrs': {'addrvec': [{'type': 'v2', 'addr': '172.21.15.8:6806', 'nonce': 111181}, {'type': 'v1', 'addr': '172.21.15.8:6807', 'nonce': 111181}]}, 'heartbeat_front_addrs': {'addrvec': [{'type': 'v2', 'addr': '172.21.15.8:6804', 'nonce': 111181}, {'type': 'v1', 'addr': '172.21.15.8:6805', 'nonce': 111181}]}, 'public_addr': '172.21.15.8:6801/111181', 'cluster_addr': '172.21.15.8:6803/111181', 'heartbeat_back_addr': '172.21.15.8:6807/111181', 'heartbeat_front_addr': '172.21.15.8:6805/111181', 'state': ['exists', 'up']}, {'osd': 1, 'uuid': '7fc612c4-33ba-4a33-bca8-1f42ee8ed548', 'up': 1, 'in': 1, 'weight': 1, 'primary_affinity': 0.3376312255859375, 'last_clean_begin': 0, 'last_clean_end': 0, 'up_from': 8, 'up_thru': 19, 'down_at': 0, 'lost_at': 0, 'public_addrs': {'addrvec': [{'type': 'v2', 'addr': '172.21.15.101:6800', 'nonce': 111143}, {'type': 'v1', 'addr': '172.21.15.101:6801', 'nonce': 111143}]}, 'cluster_addrs': {'addrvec': [{'type': 'v2', 'addr': '172.21.15.101:6802', 'nonce': 111143}, {'type': 'v1', 'addr': '172.21.15.101:6803', 'nonce': 111143}]}, 'heartbeat_back_addrs': {'addrvec': [{'type': 'v2', 'addr': '172.21.15.101:6806', 'nonce': 111143}, {'type': 'v1', 'addr': '172.21.15.101:6807', 'nonce': 111143}]}, 'heartbeat_front_addrs': {'addrvec': [{'type': 'v2', 'addr': '172.21.15.101:6804', 'nonce': 111143}, {'type': 'v1', 'addr': '172.21.15.101:6805', 'nonce': 111143}]}, 'public_addr': '172.21.15.101:6801/111143', 'cluster_addr': '172.21.15.101:6803/111143', 'heartbeat_back_addr': '172.21.15.101:6807/111143', 'heartbeat_front_addr': '172.21.15.101:6805/111143', 'state': ['exists', 'up']}, {'osd': 2, 'uuid': 'f85cadbc-4230-4772-8f39-62ed52e220b1', 'up': 1, 'in': 1, 'weight': 1, 'primary_affinity': 1, 'last_clean_begin': 0, 'last_clean_end': 0, 'up_from': 9, 'up_thru': 40, 'down_at': 0, 'lost_at': 0, 'public_addrs': {'addrvec': [{'type': 'v2', 'addr': '172.21.15.155:6800', 'nonce': 111339}, {'type': 'v1', 'addr': '172.21.15.155:6801', 'nonce': 111339}]}, 'cluster_addrs': {'addrvec': [{'type': 'v2', 'addr': '172.21.15.155:6802', 'nonce': 111339}, {'type': 'v1', 'addr': '172.21.15.155:6803', 'nonce': 111339}]}, 'heartbeat_back_addrs': {'addrvec': [{'type': 'v2', 'addr': '172.21.15.155:6806', 'nonce': 111339}, {'type': 'v1', 'addr': '172.21.15.155:6807', 'nonce': 111339}]}, 'heartbeat_front_addrs': {'addrvec': [{'type': 'v2', 'addr': '172.21.15.155:6804', 'nonce': 111339}, {'type': 'v1', 'addr': '172.21.15.155:6805', 'nonce': 111339}]}, 'public_addr': '172.21.15.155:6801/111339', 'cluster_addr': '172.21.15.155:6803/111339', 'heartbeat_back_addr': '172.21.15.155:6807/111339', 'heartbeat_front_addr': '172.21.15.155:6805/111339', 'state': ['exists', 'up']}], 'osd_xinfo': [{'osd': 0, 'down_stamp': '0.000000', 'laggy_probability': 0, 'laggy_interval': 0, 'features': 4540138320759226367, 'old_weight': 0, 'last_purged_snaps_scrub': '2023-08-01T19:53:48.018154+0000', 'dead_epoch': 0}, {'osd': 1, 'down_stamp': '0.000000', 'laggy_probability': 0, 'laggy_interval': 0, 'features': 4540138320759226367, 'old_weight': 0, 'last_purged_snaps_scrub': '2023-08-01T19:53:48.000488+0000', 'dead_epoch': 0}, {'osd': 2, 'down_stamp': '0.000000', 'laggy_probability': 0, 'laggy_interval': 0, 'features': 4540138320759226367, 'old_weight': 0, 'last_purged_snaps_scrub': '2023-08-01T19:53:48.072529+0000', 'dead_epoch': 0}], 'pg_upmap': [], 'pg_upmap_items': [], 'pg_temp': [], 'primary_temp': [], 'blocklist': {}, 'range_blocklist': {}, 'erasure_code_profiles': {'default': {'crush-failure-domain': 'osd', 'k': '2', 'm': '1', 'plugin': 'jerasure', 'technique': 'reed_sol_van'}}, 'removed_snaps_queue': [], 'new_removed_snaps': [], 'new_purged_snaps': [], 'crush_node_flags': {}, 'device_class_flags': {}, 'stretch_mode': {'stretch_mode_enabled': False, 'stretch_bucket_count': 0, 'degraded_stretch_mode': 0, 'recovering_stretch_mode': 0, 'stretch_mode_bucket': 0}} 2023-08-01T19:55:21.209 INFO:tasks.thrashosds.thrasher:No pg_upmap entries; doing nothing 2023-08-01T19:55:21.241 DEBUG:teuthology.orchestra.run.smithi006:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 120 ceph --cluster ceph -- tell 'osd.*' injectargs --osd_enable_op_tracker=true 2023-08-01T19:55:21.308 INFO:tasks.ceph.osd.2.smithi155.stderr:2023-08-01T19:55:21.308+0000 7faa5c6ac700 -1 received signal: Hangup from /usr/bin/python3 /bin/daemon-helper kill ceph-osd -f --cluster ceph -i 2 (PID: 111337) UID: 0 2023-08-01T19:55:21.317 INFO:tasks.radosbench.radosbench.0.smithi006.stdout: 57 16 128133 128117 140.467 109.562 0.0110326 0.00711625 2023-08-01T19:55:21.368 INFO:teuthology.orchestra.run.smithi101.stdout:ERROR: (22) Invalid argument 2023-08-01T19:55:21.368 INFO:teuthology.orchestra.run.smithi101.stdout:op_tracker tracking is not enabled now, so no ops are tracked currently, even those get stuck. Please enable "osd_enable_op_tracker", and the tracker will start to track new ops received afterwards. 2023-08-01T19:55:21.381 DEBUG:teuthology.orchestra.run.smithi101:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 30 ceph --cluster ceph --admin-daemon /var/run/ceph/ceph-osd.1.asok dump_blocked_ops 2023-08-01T19:55:21.391 INFO:teuthology.orchestra.run.smithi006.stdout:osd.0: {} 2023-08-01T19:55:21.409 INFO:tasks.ceph.osd.2.smithi155.stderr:2023-08-01T19:55:21.408+0000 7faa5c6ac700 -1 received signal: Hangup from /usr/bin/python3 /bin/daemon-helper kill ceph-osd -f --cluster ceph -i 2 (PID: 111337) UID: 0 2023-08-01T19:55:21.412 INFO:teuthology.orchestra.run.smithi006.stdout:osd.1: {} 2023-08-01T19:55:21.432 INFO:teuthology.orchestra.run.smithi006.stdout:osd.2: {} 2023-08-01T19:55:21.433 INFO:teuthology.orchestra.run.smithi006.stderr:osd.0: osd_enable_op_tracker = 'true' 2023-08-01T19:55:21.433 INFO:teuthology.orchestra.run.smithi006.stderr:osd.1: osd_enable_op_tracker = 'true' 2023-08-01T19:55:21.433 INFO:teuthology.orchestra.run.smithi006.stderr:osd.2: osd_enable_op_tracker = 'true' 2023-08-01T19:55:21.510 INFO:tasks.ceph.osd.0.smithi008.stderr:2023-08-01T19:55:21.508+0000 7f16a58f4700 -1 received signal: Hangup from /usr/bin/python3 /bin/daemon-helper kill ceph-osd -f --cluster ceph -i 0 (PID: 111179) UID: 0 2023-08-01T19:55:21.548 INFO:teuthology.orchestra.run.smithi101.stdout:{ 2023-08-01T19:55:21.548 INFO:teuthology.orchestra.run.smithi101.stdout: "ops": [], 2023-08-01T19:55:21.548 INFO:teuthology.orchestra.run.smithi101.stdout: "complaint_time": 30, 2023-08-01T19:55:21.548 INFO:teuthology.orchestra.run.smithi101.stdout: "num_blocked_ops": 0 2023-08-01T19:55:21.549 INFO:teuthology.orchestra.run.smithi101.stdout:} 2023-08-01T19:55:21.560 DEBUG:teuthology.orchestra.run.smithi101:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 30 ceph --cluster ceph --admin-daemon /var/run/ceph/ceph-osd.1.asok dump_historic_ops 2023-08-01T19:55:21.611 INFO:tasks.ceph.osd.2.smithi155.stderr:2023-08-01T19:55:21.610+0000 7faa5c6ac700 -1 received signal: Hangup from /usr/bin/python3 /bin/daemon-helper kill ceph-osd -f --cluster ceph -i 2 (PID: 111337) UID: 0 2023-08-01T19:55:21.626 INFO:teuthology.orchestra.run.smithi006.stderr:noscrub is set 2023-08-01T19:55:21.712 INFO:tasks.ceph.osd.0.smithi008.stderr:2023-08-01T19:55:21.710+0000 7f16a58f4700 -1 received signal: Hangup from /usr/bin/python3 /bin/daemon-helper kill ceph-osd -f --cluster ceph -i 0 (PID: 111179) UID: 0 2023-08-01T19:55:21.726 INFO:teuthology.orchestra.run.smithi101.stdout:{ 2023-08-01T19:55:21.727 INFO:teuthology.orchestra.run.smithi101.stdout: "size": 20, 2023-08-01T19:55:21.727 INFO:teuthology.orchestra.run.smithi101.stdout: "duration": 600, 2023-08-01T19:55:21.727 INFO:teuthology.orchestra.run.smithi101.stdout: "ops": [ 2023-08-01T19:55:21.727 INFO:teuthology.orchestra.run.smithi101.stdout: { 2023-08-01T19:55:21.727 INFO:teuthology.orchestra.run.smithi101.stdout: "description": "osd_op(mds.0.3:11 3.10 3:0bd6d154:::602.00000000:head [create,setxattr parent (62) in=6b,setxattr layout (30) in=6b] snapc 0=[] ondisk+write+known_if_redirected+full_force+supports_pool_eio e17)", 2023-08-01T19:55:21.727 INFO:teuthology.orchestra.run.smithi101.stdout: "initiated_at": "2023-08-01T19:54:04.458960+0000", 2023-08-01T19:55:21.728 INFO:teuthology.orchestra.run.smithi101.stdout: "age": 77.264556013999993, 2023-08-01T19:55:21.728 INFO:teuthology.orchestra.run.smithi101.stdout: "duration": 0.019645459000000001, 2023-08-01T19:55:21.728 INFO:teuthology.orchestra.run.smithi101.stdout: "type_data": { 2023-08-01T19:55:21.728 INFO:teuthology.orchestra.run.smithi101.stdout: "flag_point": "commit sent; apply or cleanup", 2023-08-01T19:55:21.728 INFO:teuthology.orchestra.run.smithi101.stdout: "events": [ 2023-08-01T19:55:21.728 INFO:teuthology.orchestra.run.smithi101.stdout: { 2023-08-01T19:55:21.728 INFO:teuthology.orchestra.run.smithi101.stdout: "event": "initiated", 2023-08-01T19:55:21.729 INFO:teuthology.orchestra.run.smithi101.stdout: "time": "2023-08-01T19:54:04.458960+0000", 2023-08-01T19:55:21.729 INFO:teuthology.orchestra.run.smithi101.stdout: "duration": 0 2023-08-01T19:55:21.729 INFO:teuthology.orchestra.run.smithi101.stdout: }, 2023-08-01T19:55:21.729 INFO:teuthology.orchestra.run.smithi101.stdout: { 2023-08-01T19:55:21.729 INFO:teuthology.orchestra.run.smithi101.stdout: "event": "throttled", 2023-08-01T19:55:21.729 INFO:teuthology.orchestra.run.smithi101.stdout: "time": "2023-08-01T19:54:04.458960+0000", 2023-08-01T19:55:21.729 INFO:teuthology.orchestra.run.smithi101.stdout: "duration": 0 2023-08-01T19:55:21.729 INFO:teuthology.orchestra.run.smithi101.stdout: }, 2023-08-01T19:55:21.730 INFO:teuthology.orchestra.run.smithi101.stdout: { 2023-08-01T19:55:21.730 INFO:teuthology.orchestra.run.smithi101.stdout: "event": "header_read", 2023-08-01T19:55:21.730 INFO:teuthology.orchestra.run.smithi101.stdout: "time": "2023-08-01T19:54:04.458959+0000", 2023-08-01T19:55:21.730 INFO:teuthology.orchestra.run.smithi101.stdout: "duration": 4294967295.9999995 2023-08-01T19:55:21.730 INFO:teuthology.orchestra.run.smithi101.stdout: }, 2023-08-01T19:55:21.730 INFO:teuthology.orchestra.run.smithi101.stdout: { 2023-08-01T19:55:21.730 INFO:teuthology.orchestra.run.smithi101.stdout: "event": "all_read", 2023-08-01T19:55:21.730 INFO:teuthology.orchestra.run.smithi101.stdout: "time": "2023-08-01T19:54:04.458963+0000", 2023-08-01T19:55:21.731 INFO:teuthology.orchestra.run.smithi101.stdout: "duration": 3.9199999999999997e-06 2023-08-01T19:55:21.731 INFO:teuthology.orchestra.run.smithi101.stdout: }, 2023-08-01T19:55:21.731 INFO:teuthology.orchestra.run.smithi101.stdout: { 2023-08-01T19:55:21.731 INFO:teuthology.orchestra.run.smithi101.stdout: "event": "dispatched", 2023-08-01T19:55:21.731 INFO:teuthology.orchestra.run.smithi101.stdout: "time": "2023-08-01T19:54:04.458970+0000", 2023-08-01T19:55:21.731 INFO:teuthology.orchestra.run.smithi101.stdout: "duration": 7.0439999999999998e-06 2023-08-01T19:55:21.731 INFO:teuthology.orchestra.run.smithi101.stdout: }, 2023-08-01T19:55:21.732 INFO:teuthology.orchestra.run.smithi101.stdout: { 2023-08-01T19:55:21.732 INFO:teuthology.orchestra.run.smithi101.stdout: "event": "queued_for_pg", 2023-08-01T19:55:21.732 INFO:teuthology.orchestra.run.smithi101.stdout: "time": "2023-08-01T19:54:04.458976+0000", 2023-08-01T19:55:21.732 INFO:teuthology.orchestra.run.smithi101.stdout: "duration": 5.9540000000000001e-06 2023-08-01T19:55:21.732 INFO:teuthology.orchestra.run.smithi101.stdout: }, 2023-08-01T19:55:21.732 INFO:teuthology.orchestra.run.smithi101.stdout: { 2023-08-01T19:55:21.732 INFO:teuthology.orchestra.run.smithi101.stdout: "event": "reached_pg", 2023-08-01T19:55:21.733 INFO:teuthology.orchestra.run.smithi101.stdout: "time": "2023-08-01T19:54:04.459035+0000", 2023-08-01T19:55:21.733 INFO:teuthology.orchestra.run.smithi101.stdout: "duration": 5.8924e-05 2023-08-01T19:55:21.733 INFO:teuthology.orchestra.run.smithi101.stdout: }, 2023-08-01T19:55:21.733 INFO:teuthology.orchestra.run.smithi101.stdout: { 2023-08-01T19:55:21.733 INFO:teuthology.orchestra.run.smithi101.stdout: "event": "waiting_for_map not empty", 2023-08-01T19:55:21.733 INFO:teuthology.orchestra.run.smithi101.stdout: "time": "2023-08-01T19:54:04.459038+0000", 2023-08-01T19:55:21.733 INFO:teuthology.orchestra.run.smithi101.stdout: "duration": 3.2760000000000001e-06 2023-08-01T19:55:21.733 INFO:teuthology.orchestra.run.smithi101.stdout: }, 2023-08-01T19:55:21.734 INFO:teuthology.orchestra.run.smithi101.stdout: { 2023-08-01T19:55:21.734 INFO:teuthology.orchestra.run.smithi101.stdout: "event": "reached_pg", 2023-08-01T19:55:21.734 INFO:teuthology.orchestra.run.smithi101.stdout: "time": "2023-08-01T19:54:04.471511+0000", 2023-08-01T19:55:21.734 INFO:teuthology.orchestra.run.smithi101.stdout: "duration": 0.012473039999999999 2023-08-01T19:55:21.734 INFO:teuthology.orchestra.run.smithi101.stdout: }, 2023-08-01T19:55:21.734 INFO:teuthology.orchestra.run.smithi101.stdout: { 2023-08-01T19:55:21.734 INFO:teuthology.orchestra.run.smithi101.stdout: "event": "started", 2023-08-01T19:55:21.734 INFO:teuthology.orchestra.run.smithi101.stdout: "time": "2023-08-01T19:54:04.472086+0000", 2023-08-01T19:55:21.735 INFO:teuthology.orchestra.run.smithi101.stdout: "duration": 0.00057491699999999998 2023-08-01T19:55:21.735 INFO:teuthology.orchestra.run.smithi101.stdout: }, 2023-08-01T19:55:21.735 INFO:teuthology.orchestra.run.smithi101.stdout: { 2023-08-01T19:55:21.735 INFO:teuthology.orchestra.run.smithi101.stdout: "event": "waiting for subops from 2", 2023-08-01T19:55:21.735 INFO:teuthology.orchestra.run.smithi101.stdout: "time": "2023-08-01T19:54:04.472310+0000", 2023-08-01T19:55:21.735 INFO:teuthology.orchestra.run.smithi101.stdout: "duration": 0.00022396499999999999 2023-08-01T19:55:21.735 INFO:teuthology.orchestra.run.smithi101.stdout: }, 2023-08-01T19:55:21.735 INFO:teuthology.orchestra.run.smithi101.stdout: { 2023-08-01T19:55:21.736 INFO:teuthology.orchestra.run.smithi101.stdout: "event": "op_commit", 2023-08-01T19:55:21.736 INFO:teuthology.orchestra.run.smithi101.stdout: "time": "2023-08-01T19:54:04.478141+0000", 2023-08-01T19:55:21.736 INFO:teuthology.orchestra.run.smithi101.stdout: "duration": 0.0058312320000000004 2023-08-01T19:55:21.736 INFO:teuthology.orchestra.run.smithi101.stdout: }, 2023-08-01T19:55:21.736 INFO:teuthology.orchestra.run.smithi101.stdout: { 2023-08-01T19:55:21.736 INFO:teuthology.orchestra.run.smithi101.stdout: "event": "sub_op_commit_rec", 2023-08-01T19:55:21.736 INFO:teuthology.orchestra.run.smithi101.stdout: "time": "2023-08-01T19:54:04.478543+0000", 2023-08-01T19:55:21.737 INFO:teuthology.orchestra.run.smithi101.stdout: "duration": 0.00040160800000000002 2023-08-01T19:55:21.737 INFO:teuthology.orchestra.run.smithi101.stdout: }, 2023-08-01T19:55:21.737 INFO:teuthology.orchestra.run.smithi101.stdout: { 2023-08-01T19:55:21.737 INFO:teuthology.orchestra.run.smithi101.stdout: "event": "commit_sent", 2023-08-01T19:55:21.737 INFO:teuthology.orchestra.run.smithi101.stdout: "time": "2023-08-01T19:54:04.478584+0000", 2023-08-01T19:55:21.737 INFO:teuthology.orchestra.run.smithi101.stdout: "duration": 4.0989999999999999e-05 2023-08-01T19:55:21.737 INFO:teuthology.orchestra.run.smithi101.stdout: }, 2023-08-01T19:55:21.737 INFO:teuthology.orchestra.run.smithi101.stdout: { 2023-08-01T19:55:21.738 INFO:teuthology.orchestra.run.smithi101.stdout: "event": "done", 2023-08-01T19:55:21.738 INFO:teuthology.orchestra.run.smithi101.stdout: "time": "2023-08-01T19:54:04.478605+0000", 2023-08-01T19:55:21.738 INFO:teuthology.orchestra.run.smithi101.stdout: "duration": 2.1178e-05 2023-08-01T19:55:21.738 INFO:teuthology.orchestra.run.smithi101.stdout: } 2023-08-01T19:55:21.738 INFO:teuthology.orchestra.run.smithi101.stdout: ] 2023-08-01T19:55:21.738 INFO:teuthology.orchestra.run.smithi101.stdout: } 2023-08-01T19:55:21.738 INFO:teuthology.orchestra.run.smithi101.stdout: }, 2023-08-01T19:55:21.738 INFO:teuthology.orchestra.run.smithi101.stdout: { 2023-08-01T19:55:21.739 INFO:teuthology.orchestra.run.smithi101.stdout: "description": "osd_op(mds.0.3:12 3.10 3:0d89b25e:::603.00000000:head [omap-set-header] snapc 0=[] ondisk+write+known_if_redirected+full_force+supports_pool_eio e17)", 2023-08-01T19:55:21.739 INFO:teuthology.orchestra.run.smithi101.stdout: "initiated_at": "2023-08-01T19:54:04.458982+0000", 2023-08-01T19:55:21.739 INFO:teuthology.orchestra.run.smithi101.stdout: "age": 77.264533786000001, 2023-08-01T19:55:21.739 INFO:teuthology.orchestra.run.smithi101.stdout: "duration": 0.021266334000000001, 2023-08-01T19:55:21.739 INFO:teuthology.orchestra.run.smithi101.stdout: "type_data": { 2023-08-01T19:55:21.739 INFO:teuthology.orchestra.run.smithi101.stdout: "flag_point": "commit sent; apply or cleanup", 2023-08-01T19:55:21.739 INFO:teuthology.orchestra.run.smithi101.stdout: "events": [ 2023-08-01T19:55:21.740 INFO:teuthology.orchestra.run.smithi101.stdout: { 2023-08-01T19:55:21.740 INFO:teuthology.orchestra.run.smithi101.stdout: "event": "initiated", 2023-08-01T19:55:21.740 INFO:teuthology.orchestra.run.smithi101.stdout: "time": "2023-08-01T19:54:04.458982+0000", 2023-08-01T19:55:21.740 INFO:teuthology.orchestra.run.smithi101.stdout: "duration": 0 2023-08-01T19:55:21.740 INFO:teuthology.orchestra.run.smithi101.stdout: }, 2023-08-01T19:55:21.740 INFO:teuthology.orchestra.run.smithi101.stdout: { 2023-08-01T19:55:21.740 INFO:teuthology.orchestra.run.smithi101.stdout: "event": "throttled", 2023-08-01T19:55:21.740 INFO:teuthology.orchestra.run.smithi101.stdout: "time": "2023-08-01T19:54:04.458982+0000", 2023-08-01T19:55:21.741 INFO:teuthology.orchestra.run.smithi101.stdout: "duration": 0 2023-08-01T19:55:21.741 INFO:teuthology.orchestra.run.smithi101.stdout: }, 2023-08-01T19:55:21.741 INFO:teuthology.orchestra.run.smithi101.stdout: { 2023-08-01T19:55:21.741 INFO:teuthology.orchestra.run.smithi101.stdout: "event": "header_read", 2023-08-01T19:55:21.741 INFO:teuthology.orchestra.run.smithi101.stdout: "time": "2023-08-01T19:54:04.458982+0000", 2023-08-01T19:55:21.741 INFO:teuthology.orchestra.run.smithi101.stdout: "duration": 4294967295.9999995 2023-08-01T19:55:21.741 INFO:teuthology.orchestra.run.smithi101.stdout: }, 2023-08-01T19:55:21.741 INFO:teuthology.orchestra.run.smithi101.stdout: { 2023-08-01T19:55:21.742 INFO:teuthology.orchestra.run.smithi101.stdout: "event": "all_read", 2023-08-01T19:55:21.742 INFO:teuthology.orchestra.run.smithi101.stdout: "time": "2023-08-01T19:54:04.458985+0000", 2023-08-01T19:55:21.742 INFO:teuthology.orchestra.run.smithi101.stdout: "duration": 3.4800000000000001e-06 2023-08-01T19:55:21.742 INFO:teuthology.orchestra.run.smithi101.stdout: }, 2023-08-01T19:55:21.742 INFO:teuthology.orchestra.run.smithi101.stdout: { 2023-08-01T19:55:21.742 INFO:teuthology.orchestra.run.smithi101.stdout: "event": "dispatched", 2023-08-01T19:55:21.742 INFO:teuthology.orchestra.run.smithi101.stdout: "time": "2023-08-01T19:54:04.458992+0000", 2023-08-01T19:55:21.743 INFO:teuthology.orchestra.run.smithi101.stdout: "duration": 7.306e-06 2023-08-01T19:55:21.743 INFO:teuthology.orchestra.run.smithi101.stdout: }, 2023-08-01T19:55:21.743 INFO:teuthology.orchestra.run.smithi101.stdout: { 2023-08-01T19:55:21.743 INFO:teuthology.orchestra.run.smithi101.stdout: "event": "queued_for_pg", 2023-08-01T19:55:21.743 INFO:teuthology.orchestra.run.smithi101.stdout: "time": "2023-08-01T19:54:04.458997+0000", 2023-08-01T19:55:21.743 INFO:teuthology.orchestra.run.smithi101.stdout: "duration": 4.4530000000000004e-06 2023-08-01T19:55:21.743 INFO:teuthology.orchestra.run.smithi101.stdout: }, 2023-08-01T19:55:21.744 INFO:teuthology.orchestra.run.smithi101.stdout: { 2023-08-01T19:55:21.744 INFO:teuthology.orchestra.run.smithi101.stdout: "event": "reached_pg", 2023-08-01T19:55:21.744 INFO:teuthology.orchestra.run.smithi101.stdout: "time": "2023-08-01T19:54:04.459060+0000", 2023-08-01T19:55:21.744 INFO:teuthology.orchestra.run.smithi101.stdout: "duration": 6.3249000000000004e-05 2023-08-01T19:55:21.744 INFO:teuthology.orchestra.run.smithi101.stdout: }, 2023-08-01T19:55:21.744 INFO:teuthology.orchestra.run.smithi101.stdout: { 2023-08-01T19:55:21.744 INFO:teuthology.orchestra.run.smithi101.stdout: "event": "waiting_for_map not empty", 2023-08-01T19:55:21.744 INFO:teuthology.orchestra.run.smithi101.stdout: "time": "2023-08-01T19:54:04.459063+0000", 2023-08-01T19:55:21.745 INFO:teuthology.orchestra.run.smithi101.stdout: "duration": 2.717e-06 2023-08-01T19:55:21.745 INFO:teuthology.orchestra.run.smithi101.stdout: }, 2023-08-01T19:55:21.745 INFO:teuthology.orchestra.run.smithi101.stdout: { 2023-08-01T19:55:21.745 INFO:teuthology.orchestra.run.smithi101.stdout: "event": "reached_pg", 2023-08-01T19:55:21.745 INFO:teuthology.orchestra.run.smithi101.stdout: "time": "2023-08-01T19:54:04.473625+0000", 2023-08-01T19:55:21.745 INFO:teuthology.orchestra.run.smithi101.stdout: "duration": 0.014562007 2023-08-01T19:55:21.745 INFO:teuthology.orchestra.run.smithi101.stdout: }, 2023-08-01T19:55:21.745 INFO:teuthology.orchestra.run.smithi101.stdout: { 2023-08-01T19:55:21.746 INFO:teuthology.orchestra.run.smithi101.stdout: "event": "started", 2023-08-01T19:55:21.746 INFO:teuthology.orchestra.run.smithi101.stdout: "time": "2023-08-01T19:54:04.473757+0000", 2023-08-01T19:55:21.746 INFO:teuthology.orchestra.run.smithi101.stdout: "duration": 0.00013238599999999999 2023-08-01T19:55:21.746 INFO:teuthology.orchestra.run.smithi101.stdout: }, 2023-08-01T19:55:21.746 INFO:teuthology.orchestra.run.smithi101.stdout: { 2023-08-01T19:55:21.746 INFO:teuthology.orchestra.run.smithi101.stdout: "event": "waiting for subops from 2", 2023-08-01T19:55:21.746 INFO:teuthology.orchestra.run.smithi101.stdout: "time": "2023-08-01T19:54:04.473898+0000", 2023-08-01T19:55:21.747 INFO:teuthology.orchestra.run.smithi101.stdout: "duration": 0.00014039 2023-08-01T19:55:21.747 INFO:teuthology.orchestra.run.smithi101.stdout: }, 2023-08-01T19:55:21.747 INFO:teuthology.orchestra.run.smithi101.stdout: { 2023-08-01T19:55:21.747 INFO:teuthology.orchestra.run.smithi101.stdout: "event": "op_commit", 2023-08-01T19:55:21.747 INFO:teuthology.orchestra.run.smithi101.stdout: "time": "2023-08-01T19:54:04.478380+0000", 2023-08-01T19:55:21.747 INFO:teuthology.orchestra.run.smithi101.stdout: "duration": 0.0044827449999999998 2023-08-01T19:55:21.747 INFO:teuthology.orchestra.run.smithi101.stdout: }, 2023-08-01T19:55:21.747 INFO:teuthology.orchestra.run.smithi101.stdout: { 2023-08-01T19:55:21.748 INFO:teuthology.orchestra.run.smithi101.stdout: "event": "sub_op_commit_rec", 2023-08-01T19:55:21.748 INFO:teuthology.orchestra.run.smithi101.stdout: "time": "2023-08-01T19:54:04.480169+0000", 2023-08-01T19:55:21.748 INFO:teuthology.orchestra.run.smithi101.stdout: "duration": 0.0017886040000000001 2023-08-01T19:55:21.748 INFO:teuthology.orchestra.run.smithi101.stdout: }, 2023-08-01T19:55:21.748 INFO:teuthology.orchestra.run.smithi101.stdout: { 2023-08-01T19:55:21.748 INFO:teuthology.orchestra.run.smithi101.stdout: "event": "commit_sent", 2023-08-01T19:55:21.748 INFO:teuthology.orchestra.run.smithi101.stdout: "time": "2023-08-01T19:54:04.480212+0000", 2023-08-01T19:55:21.748 INFO:teuthology.orchestra.run.smithi101.stdout: "duration": 4.2687e-05 2023-08-01T19:55:21.749 INFO:teuthology.orchestra.run.smithi101.stdout: }, 2023-08-01T19:55:21.749 INFO:teuthology.orchestra.run.smithi101.stdout: { 2023-08-01T19:55:21.749 INFO:teuthology.orchestra.run.smithi101.stdout: "event": "done", 2023-08-01T19:55:21.749 INFO:teuthology.orchestra.run.smithi101.stdout: "time": "2023-08-01T19:54:04.480248+0000", 2023-08-01T19:55:21.749 INFO:teuthology.orchestra.run.smithi101.stdout: "duration": 3.6743999999999999e-05 2023-08-01T19:55:21.749 INFO:teuthology.orchestra.run.smithi101.stdout: } 2023-08-01T19:55:21.749 INFO:teuthology.orchestra.run.smithi101.stdout: ] 2023-08-01T19:55:21.749 INFO:teuthology.orchestra.run.smithi101.stdout: } 2023-08-01T19:55:21.750 INFO:teuthology.orchestra.run.smithi101.stdout: }, 2023-08-01T19:55:21.750 INFO:teuthology.orchestra.run.smithi101.stdout: { 2023-08-01T19:55:21.750 INFO:teuthology.orchestra.run.smithi101.stdout: "description": "osd_op(mds.0.3:13 3.10 3:0d89b25e:::603.00000000:head [create,setxattr parent (62) in=6b,setxattr layout (30) in=6b] snapc 0=[] ondisk+write+known_if_redirected+full_force+supports_pool_eio e17)", 2023-08-01T19:55:21.750 INFO:teuthology.orchestra.run.smithi101.stdout: "initiated_at": "2023-08-01T19:54:04.459010+0000", 2023-08-01T19:55:21.750 INFO:teuthology.orchestra.run.smithi101.stdout: "age": 77.264506065999996, 2023-08-01T19:55:21.750 INFO:teuthology.orchestra.run.smithi101.stdout: "duration": 0.021327220000000001, 2023-08-01T19:55:21.750 INFO:teuthology.orchestra.run.smithi101.stdout: "type_data": { 2023-08-01T19:55:21.751 INFO:teuthology.orchestra.run.smithi101.stdout: "flag_point": "commit sent; apply or cleanup", 2023-08-01T19:55:21.751 INFO:teuthology.orchestra.run.smithi101.stdout: "events": [ 2023-08-01T19:55:21.751 INFO:teuthology.orchestra.run.smithi101.stdout: { 2023-08-01T19:55:21.751 INFO:teuthology.orchestra.run.smithi101.stdout: "event": "initiated", 2023-08-01T19:55:21.751 INFO:teuthology.orchestra.run.smithi101.stdout: "time": "2023-08-01T19:54:04.459010+0000", 2023-08-01T19:55:21.751 INFO:teuthology.orchestra.run.smithi101.stdout: "duration": 0 2023-08-01T19:55:21.751 INFO:teuthology.orchestra.run.smithi101.stdout: }, 2023-08-01T19:55:21.751 INFO:teuthology.orchestra.run.smithi101.stdout: { 2023-08-01T19:55:21.752 INFO:teuthology.orchestra.run.smithi101.stdout: "event": "throttled", 2023-08-01T19:55:21.752 INFO:teuthology.orchestra.run.smithi101.stdout: "time": "2023-08-01T19:54:04.459010+0000", 2023-08-01T19:55:21.752 INFO:teuthology.orchestra.run.smithi101.stdout: "duration": 0 2023-08-01T19:55:21.752 INFO:teuthology.orchestra.run.smithi101.stdout: }, 2023-08-01T19:55:21.752 INFO:teuthology.orchestra.run.smithi101.stdout: { 2023-08-01T19:55:21.752 INFO:teuthology.orchestra.run.smithi101.stdout: "event": "header_read", 2023-08-01T19:55:21.752 INFO:teuthology.orchestra.run.smithi101.stdout: "time": "2023-08-01T19:54:04.459009+0000", 2023-08-01T19:55:21.752 INFO:teuthology.orchestra.run.smithi101.stdout: "duration": 4294967295.9999995 2023-08-01T19:55:21.753 INFO:teuthology.orchestra.run.smithi101.stdout: }, 2023-08-01T19:55:21.753 INFO:teuthology.orchestra.run.smithi101.stdout: { 2023-08-01T19:55:21.753 INFO:teuthology.orchestra.run.smithi101.stdout: "event": "all_read", 2023-08-01T19:55:21.753 INFO:teuthology.orchestra.run.smithi101.stdout: "time": "2023-08-01T19:54:04.459013+0000", 2023-08-01T19:55:21.753 INFO:teuthology.orchestra.run.smithi101.stdout: "duration": 3.8929999999999998e-06 2023-08-01T19:55:21.753 INFO:teuthology.orchestra.run.smithi101.stdout: }, 2023-08-01T19:55:21.753 INFO:teuthology.orchestra.run.smithi101.stdout: { 2023-08-01T19:55:21.754 INFO:teuthology.orchestra.run.smithi101.stdout: "event": "dispatched", 2023-08-01T19:55:21.754 INFO:teuthology.orchestra.run.smithi101.stdout: "time": "2023-08-01T19:54:04.459027+0000", 2023-08-01T19:55:21.754 INFO:teuthology.orchestra.run.smithi101.stdout: "duration": 1.3416e-05 2023-08-01T19:55:21.754 INFO:teuthology.orchestra.run.smithi101.stdout: }, 2023-08-01T19:55:21.754 INFO:teuthology.orchestra.run.smithi101.stdout: { 2023-08-01T19:55:21.754 INFO:teuthology.orchestra.run.smithi101.stdout: "event": "queued_for_pg", 2023-08-01T19:55:21.754 INFO:teuthology.orchestra.run.smithi101.stdout: "time": "2023-08-01T19:54:04.459033+0000", 2023-08-01T19:55:21.754 INFO:teuthology.orchestra.run.smithi101.stdout: "duration": 5.9800000000000003e-06 2023-08-01T19:55:21.755 INFO:teuthology.orchestra.run.smithi101.stdout: }, 2023-08-01T19:55:21.755 INFO:teuthology.orchestra.run.smithi101.stdout: { 2023-08-01T19:55:21.755 INFO:teuthology.orchestra.run.smithi101.stdout: "event": "reached_pg", 2023-08-01T19:55:21.755 INFO:teuthology.orchestra.run.smithi101.stdout: "time": "2023-08-01T19:54:04.459099+0000", 2023-08-01T19:55:21.755 INFO:teuthology.orchestra.run.smithi101.stdout: "duration": 6.6192999999999995e-05 2023-08-01T19:55:21.755 INFO:teuthology.orchestra.run.smithi101.stdout: }, 2023-08-01T19:55:21.755 INFO:teuthology.orchestra.run.smithi101.stdout: { 2023-08-01T19:55:21.755 INFO:teuthology.orchestra.run.smithi101.stdout: "event": "waiting_for_map not empty", 2023-08-01T19:55:21.756 INFO:teuthology.orchestra.run.smithi101.stdout: "time": "2023-08-01T19:54:04.459106+0000", 2023-08-01T19:55:21.756 INFO:teuthology.orchestra.run.smithi101.stdout: "duration": 6.8619999999999997e-06 2023-08-01T19:55:21.756 INFO:teuthology.orchestra.run.smithi101.stdout: }, 2023-08-01T19:55:21.756 INFO:teuthology.orchestra.run.smithi101.stdout: { 2023-08-01T19:55:21.756 INFO:teuthology.orchestra.run.smithi101.stdout: "event": "reached_pg", 2023-08-01T19:55:21.756 INFO:teuthology.orchestra.run.smithi101.stdout: "time": "2023-08-01T19:54:04.475182+0000", 2023-08-01T19:55:21.756 INFO:teuthology.orchestra.run.smithi101.stdout: "duration": 0.016076333000000002 2023-08-01T19:55:21.756 INFO:teuthology.orchestra.run.smithi101.stdout: }, 2023-08-01T19:55:21.757 INFO:teuthology.orchestra.run.smithi101.stdout: { 2023-08-01T19:55:21.757 INFO:teuthology.orchestra.run.smithi101.stdout: "event": "started", 2023-08-01T19:55:21.757 INFO:teuthology.orchestra.run.smithi101.stdout: "time": "2023-08-01T19:54:04.475353+0000", 2023-08-01T19:55:21.757 INFO:teuthology.orchestra.run.smithi101.stdout: "duration": 0.000171378 2023-08-01T19:55:21.757 INFO:teuthology.orchestra.run.smithi101.stdout: }, 2023-08-01T19:55:21.757 INFO:teuthology.orchestra.run.smithi101.stdout: { 2023-08-01T19:55:21.757 INFO:teuthology.orchestra.run.smithi101.stdout: "event": "waiting for subops from 2", 2023-08-01T19:55:21.758 INFO:teuthology.orchestra.run.smithi101.stdout: "time": "2023-08-01T19:54:04.475793+0000", 2023-08-01T19:55:21.758 INFO:teuthology.orchestra.run.smithi101.stdout: "duration": 0.000440123 2023-08-01T19:55:21.758 INFO:teuthology.orchestra.run.smithi101.stdout: }, 2023-08-01T19:55:21.758 INFO:teuthology.orchestra.run.smithi101.stdout: { 2023-08-01T19:55:21.758 INFO:teuthology.orchestra.run.smithi101.stdout: "event": "op_commit", 2023-08-01T19:55:21.758 INFO:teuthology.orchestra.run.smithi101.stdout: "time": "2023-08-01T19:54:04.478624+0000", 2023-08-01T19:55:21.758 INFO:teuthology.orchestra.run.smithi101.stdout: "duration": 0.0028305000000000001 2023-08-01T19:55:21.758 INFO:teuthology.orchestra.run.smithi101.stdout: }, 2023-08-01T19:55:21.759 INFO:teuthology.orchestra.run.smithi101.stdout: { 2023-08-01T19:55:21.759 INFO:teuthology.orchestra.run.smithi101.stdout: "event": "sub_op_commit_rec", 2023-08-01T19:55:21.759 INFO:teuthology.orchestra.run.smithi101.stdout: "time": "2023-08-01T19:54:04.480291+0000", 2023-08-01T19:55:21.759 INFO:teuthology.orchestra.run.smithi101.stdout: "duration": 0.0016670000000000001 2023-08-01T19:55:21.759 INFO:teuthology.orchestra.run.smithi101.stdout: }, 2023-08-01T19:55:21.759 INFO:teuthology.orchestra.run.smithi101.stdout: { 2023-08-01T19:55:21.759 INFO:teuthology.orchestra.run.smithi101.stdout: "event": "commit_sent", 2023-08-01T19:55:21.759 INFO:teuthology.orchestra.run.smithi101.stdout: "time": "2023-08-01T19:54:04.480318+0000", 2023-08-01T19:55:21.760 INFO:teuthology.orchestra.run.smithi101.stdout: "duration": 2.6815e-05 2023-08-01T19:55:21.760 INFO:teuthology.orchestra.run.smithi101.stdout: }, 2023-08-01T19:55:21.760 INFO:teuthology.orchestra.run.smithi101.stdout: { 2023-08-01T19:55:21.760 INFO:teuthology.orchestra.run.smithi101.stdout: "event": "done", 2023-08-01T19:55:21.760 INFO:teuthology.orchestra.run.smithi101.stdout: "time": "2023-08-01T19:54:04.480337+0000", 2023-08-01T19:55:21.760 INFO:teuthology.orchestra.run.smithi101.stdout: "duration": 1.9241000000000001e-05 2023-08-01T19:55:21.760 INFO:teuthology.orchestra.run.smithi101.stdout: } 2023-08-01T19:55:21.761 INFO:teuthology.orchestra.run.smithi101.stdout: ] 2023-08-01T19:55:21.761 INFO:teuthology.orchestra.run.smithi101.stdout: } 2023-08-01T19:55:21.761 INFO:teuthology.orchestra.run.smithi101.stdout: }, 2023-08-01T19:55:21.761 INFO:teuthology.orchestra.run.smithi101.stdout: { 2023-08-01T19:55:21.761 INFO:teuthology.orchestra.run.smithi101.stdout: "description": "osd_op(mds.0.3:1 3.14 3:292cf221:::200.00000000:head [writefull 0~90] snapc 0=[] ondisk+write+known_if_redirected+full_force+supports_pool_eio e17)", 2023-08-01T19:55:21.761 INFO:teuthology.orchestra.run.smithi101.stdout: "initiated_at": "2023-08-01T19:54:04.459177+0000", 2023-08-01T19:55:21.761 INFO:teuthology.orchestra.run.smithi101.stdout: "age": 77.264339167000003, 2023-08-01T19:55:21.761 INFO:teuthology.orchestra.run.smithi101.stdout: "duration": 0.021067196, 2023-08-01T19:55:21.762 INFO:teuthology.orchestra.run.smithi101.stdout: "type_data": { 2023-08-01T19:55:21.762 INFO:teuthology.orchestra.run.smithi101.stdout: "flag_point": "commit sent; apply or cleanup", 2023-08-01T19:55:21.762 INFO:teuthology.orchestra.run.smithi101.stdout: "events": [ 2023-08-01T19:55:21.762 INFO:teuthology.orchestra.run.smithi101.stdout: { 2023-08-01T19:55:21.762 INFO:teuthology.orchestra.run.smithi101.stdout: "event": "initiated", 2023-08-01T19:55:21.762 INFO:teuthology.orchestra.run.smithi101.stdout: "time": "2023-08-01T19:54:04.459177+0000", 2023-08-01T19:55:21.762 INFO:teuthology.orchestra.run.smithi101.stdout: "duration": 0 2023-08-01T19:55:21.762 INFO:teuthology.orchestra.run.smithi101.stdout: }, 2023-08-01T19:55:21.763 INFO:teuthology.orchestra.run.smithi101.stdout: { 2023-08-01T19:55:21.763 INFO:teuthology.orchestra.run.smithi101.stdout: "event": "throttled", 2023-08-01T19:55:21.763 INFO:teuthology.orchestra.run.smithi101.stdout: "time": "2023-08-01T19:54:04.459177+0000", 2023-08-01T19:55:21.763 INFO:teuthology.orchestra.run.smithi101.stdout: "duration": 0 2023-08-01T19:55:21.763 INFO:teuthology.orchestra.run.smithi101.stdout: }, 2023-08-01T19:55:21.763 INFO:teuthology.orchestra.run.smithi101.stdout: { 2023-08-01T19:55:21.763 INFO:teuthology.orchestra.run.smithi101.stdout: "event": "header_read", 2023-08-01T19:55:21.763 INFO:teuthology.orchestra.run.smithi101.stdout: "time": "2023-08-01T19:54:04.459176+0000", 2023-08-01T19:55:21.764 INFO:teuthology.orchestra.run.smithi101.stdout: "duration": 4294967295.9999995 2023-08-01T19:55:21.764 INFO:teuthology.orchestra.run.smithi101.stdout: }, 2023-08-01T19:55:21.764 INFO:teuthology.orchestra.run.smithi101.stdout: { 2023-08-01T19:55:21.764 INFO:teuthology.orchestra.run.smithi101.stdout: "event": "all_read", 2023-08-01T19:55:21.764 INFO:teuthology.orchestra.run.smithi101.stdout: "time": "2023-08-01T19:54:04.459181+0000", 2023-08-01T19:55:21.764 INFO:teuthology.orchestra.run.smithi101.stdout: "duration": 5.2109999999999997e-06 2023-08-01T19:55:21.764 INFO:teuthology.orchestra.run.smithi101.stdout: }, 2023-08-01T19:55:21.765 INFO:teuthology.orchestra.run.smithi101.stdout: { 2023-08-01T19:55:21.765 INFO:teuthology.orchestra.run.smithi101.stdout: "event": "dispatched", 2023-08-01T19:55:21.765 INFO:teuthology.orchestra.run.smithi101.stdout: "time": "2023-08-01T19:54:04.459188+0000", 2023-08-01T19:55:21.765 INFO:teuthology.orchestra.run.smithi101.stdout: "duration": 6.6680000000000004e-06 2023-08-01T19:55:21.765 INFO:teuthology.orchestra.run.smithi101.stdout: }, 2023-08-01T19:55:21.765 INFO:teuthology.orchestra.run.smithi101.stdout: { 2023-08-01T19:55:21.765 INFO:teuthology.orchestra.run.smithi101.stdout: "event": "queued_for_pg", 2023-08-01T19:55:21.765 INFO:teuthology.orchestra.run.smithi101.stdout: "time": "2023-08-01T19:54:04.459192+0000", 2023-08-01T19:55:21.766 INFO:teuthology.orchestra.run.smithi101.stdout: "duration": 4.228e-06 2023-08-01T19:55:21.766 INFO:teuthology.orchestra.run.smithi101.stdout: }, 2023-08-01T19:55:21.766 INFO:teuthology.orchestra.run.smithi101.stdout: { 2023-08-01T19:55:21.766 INFO:teuthology.orchestra.run.smithi101.stdout: "event": "reached_pg", 2023-08-01T19:55:21.766 INFO:teuthology.orchestra.run.smithi101.stdout: "time": "2023-08-01T19:54:04.459219+0000", 2023-08-01T19:55:21.766 INFO:teuthology.orchestra.run.smithi101.stdout: "duration": 2.6930000000000001e-05 2023-08-01T19:55:21.766 INFO:teuthology.orchestra.run.smithi101.stdout: }, 2023-08-01T19:55:21.767 INFO:teuthology.orchestra.run.smithi101.stdout: { 2023-08-01T19:55:21.767 INFO:teuthology.orchestra.run.smithi101.stdout: "event": "waiting_for_map not empty", 2023-08-01T19:55:21.767 INFO:teuthology.orchestra.run.smithi101.stdout: "time": "2023-08-01T19:54:04.459223+0000", 2023-08-01T19:55:21.767 INFO:teuthology.orchestra.run.smithi101.stdout: "duration": 3.8469999999999998e-06 2023-08-01T19:55:21.767 INFO:teuthology.orchestra.run.smithi101.stdout: }, 2023-08-01T19:55:21.767 INFO:teuthology.orchestra.run.smithi101.stdout: { 2023-08-01T19:55:21.767 INFO:teuthology.orchestra.run.smithi101.stdout: "event": "reached_pg", 2023-08-01T19:55:21.767 INFO:teuthology.orchestra.run.smithi101.stdout: "time": "2023-08-01T19:54:04.473347+0000", 2023-08-01T19:55:21.768 INFO:teuthology.orchestra.run.smithi101.stdout: "duration": 0.014124319 2023-08-01T19:55:21.768 INFO:teuthology.orchestra.run.smithi101.stdout: }, 2023-08-01T19:55:21.768 INFO:teuthology.orchestra.run.smithi101.stdout: { 2023-08-01T19:55:21.768 INFO:teuthology.orchestra.run.smithi101.stdout: "event": "started", 2023-08-01T19:55:21.768 INFO:teuthology.orchestra.run.smithi101.stdout: "time": "2023-08-01T19:54:04.473480+0000", 2023-08-01T19:55:21.768 INFO:teuthology.orchestra.run.smithi101.stdout: "duration": 0.00013276799999999999 2023-08-01T19:55:21.768 INFO:teuthology.orchestra.run.smithi101.stdout: }, 2023-08-01T19:55:21.769 INFO:teuthology.orchestra.run.smithi101.stdout: { 2023-08-01T19:55:21.769 INFO:teuthology.orchestra.run.smithi101.stdout: "event": "waiting for subops from 2", 2023-08-01T19:55:21.769 INFO:teuthology.orchestra.run.smithi101.stdout: "time": "2023-08-01T19:54:04.473622+0000", 2023-08-01T19:55:21.769 INFO:teuthology.orchestra.run.smithi101.stdout: "duration": 0.00014154799999999999 2023-08-01T19:55:21.769 INFO:teuthology.orchestra.run.smithi101.stdout: }, 2023-08-01T19:55:21.769 INFO:teuthology.orchestra.run.smithi101.stdout: { 2023-08-01T19:55:21.769 INFO:teuthology.orchestra.run.smithi101.stdout: "event": "op_commit", 2023-08-01T19:55:21.769 INFO:teuthology.orchestra.run.smithi101.stdout: "time": "2023-08-01T19:54:04.478281+0000", 2023-08-01T19:55:21.770 INFO:teuthology.orchestra.run.smithi101.stdout: "duration": 0.004659252 2023-08-01T19:55:21.770 INFO:teuthology.orchestra.run.smithi101.stdout: }, 2023-08-01T19:55:21.770 INFO:teuthology.orchestra.run.smithi101.stdout: { 2023-08-01T19:55:21.770 INFO:teuthology.orchestra.run.smithi101.stdout: "event": "sub_op_commit_rec", 2023-08-01T19:55:21.770 INFO:teuthology.orchestra.run.smithi101.stdout: "time": "2023-08-01T19:54:04.480180+0000", 2023-08-01T19:55:21.770 INFO:teuthology.orchestra.run.smithi101.stdout: "duration": 0.0018986859999999999 2023-08-01T19:55:21.770 INFO:teuthology.orchestra.run.smithi101.stdout: }, 2023-08-01T19:55:21.771 INFO:teuthology.orchestra.run.smithi101.stdout: { 2023-08-01T19:55:21.771 INFO:teuthology.orchestra.run.smithi101.stdout: "event": "commit_sent", 2023-08-01T19:55:21.771 INFO:teuthology.orchestra.run.smithi101.stdout: "time": "2023-08-01T19:54:04.480209+0000", 2023-08-01T19:55:21.771 INFO:teuthology.orchestra.run.smithi101.stdout: "duration": 2.9244999999999999e-05 2023-08-01T19:55:21.771 INFO:teuthology.orchestra.run.smithi101.stdout: }, 2023-08-01T19:55:21.771 INFO:teuthology.orchestra.run.smithi101.stdout: { 2023-08-01T19:55:21.771 INFO:teuthology.orchestra.run.smithi101.stdout: "event": "done", 2023-08-01T19:55:21.771 INFO:teuthology.orchestra.run.smithi101.stdout: "time": "2023-08-01T19:54:04.480244+0000", 2023-08-01T19:55:21.772 INFO:teuthology.orchestra.run.smithi101.stdout: "duration": 3.4875000000000001e-05 2023-08-01T19:55:21.772 INFO:teuthology.orchestra.run.smithi101.stdout: } 2023-08-01T19:55:21.772 INFO:teuthology.orchestra.run.smithi101.stdout: ] 2023-08-01T19:55:21.772 INFO:teuthology.orchestra.run.smithi101.stdout: } 2023-08-01T19:55:21.772 INFO:teuthology.orchestra.run.smithi101.stdout: }, 2023-08-01T19:55:21.772 INFO:teuthology.orchestra.run.smithi101.stdout: { 2023-08-01T19:55:21.772 INFO:teuthology.orchestra.run.smithi101.stdout: "description": "osd_op(mds.0.3:3 3.14 3:287034c4:::1.00000000.inode:head [writefull 0~554] snapc 0=[] ondisk+write+known_if_redirected+full_force+supports_pool_eio e17)", 2023-08-01T19:55:21.773 INFO:teuthology.orchestra.run.smithi101.stdout: "initiated_at": "2023-08-01T19:54:04.459226+0000", 2023-08-01T19:55:21.773 INFO:teuthology.orchestra.run.smithi101.stdout: "age": 77.264290087999996, 2023-08-01T19:55:21.773 INFO:teuthology.orchestra.run.smithi101.stdout: "duration": 0.021104531999999999, 2023-08-01T19:55:21.773 INFO:teuthology.orchestra.run.smithi101.stdout: "type_data": { 2023-08-01T19:55:21.773 INFO:teuthology.orchestra.run.smithi101.stdout: "flag_point": "commit sent; apply or cleanup", 2023-08-01T19:55:21.773 INFO:teuthology.orchestra.run.smithi101.stdout: "events": [ 2023-08-01T19:55:21.773 INFO:teuthology.orchestra.run.smithi101.stdout: { 2023-08-01T19:55:21.773 INFO:teuthology.orchestra.run.smithi101.stdout: "event": "initiated", 2023-08-01T19:55:21.774 INFO:teuthology.orchestra.run.smithi101.stdout: "time": "2023-08-01T19:54:04.459226+0000", 2023-08-01T19:55:21.774 INFO:teuthology.orchestra.run.smithi101.stdout: "duration": 0 2023-08-01T19:55:21.774 INFO:teuthology.orchestra.run.smithi101.stdout: }, 2023-08-01T19:55:21.774 INFO:teuthology.orchestra.run.smithi101.stdout: { 2023-08-01T19:55:21.774 INFO:teuthology.orchestra.run.smithi101.stdout: "event": "throttled", 2023-08-01T19:55:21.774 INFO:teuthology.orchestra.run.smithi101.stdout: "time": "2023-08-01T19:54:04.459226+0000", 2023-08-01T19:55:21.774 INFO:teuthology.orchestra.run.smithi101.stdout: "duration": 0 2023-08-01T19:55:21.774 INFO:teuthology.orchestra.run.smithi101.stdout: }, 2023-08-01T19:55:21.775 INFO:teuthology.orchestra.run.smithi101.stdout: { 2023-08-01T19:55:21.775 INFO:teuthology.orchestra.run.smithi101.stdout: "event": "header_read", 2023-08-01T19:55:21.775 INFO:teuthology.orchestra.run.smithi101.stdout: "time": "2023-08-01T19:54:04.459225+0000", 2023-08-01T19:55:21.775 INFO:teuthology.orchestra.run.smithi101.stdout: "duration": 4294967295.9999995 2023-08-01T19:55:21.775 INFO:teuthology.orchestra.run.smithi101.stdout: }, 2023-08-01T19:55:21.775 INFO:teuthology.orchestra.run.smithi101.stdout: { 2023-08-01T19:55:21.775 INFO:teuthology.orchestra.run.smithi101.stdout: "event": "all_read", 2023-08-01T19:55:21.776 INFO:teuthology.orchestra.run.smithi101.stdout: "time": "2023-08-01T19:54:04.459238+0000", 2023-08-01T19:55:21.776 INFO:teuthology.orchestra.run.smithi101.stdout: "duration": 1.2809000000000001e-05 2023-08-01T19:55:21.776 INFO:teuthology.orchestra.run.smithi101.stdout: }, 2023-08-01T19:55:21.776 INFO:teuthology.orchestra.run.smithi101.stdout: { 2023-08-01T19:55:21.776 INFO:teuthology.orchestra.run.smithi101.stdout: "event": "dispatched", 2023-08-01T19:55:21.776 INFO:teuthology.orchestra.run.smithi101.stdout: "time": "2023-08-01T19:54:04.459245+0000", 2023-08-01T19:55:21.776 INFO:teuthology.orchestra.run.smithi101.stdout: "duration": 6.6540000000000002e-06 2023-08-01T19:55:21.776 INFO:teuthology.orchestra.run.smithi101.stdout: }, 2023-08-01T19:55:21.777 INFO:teuthology.orchestra.run.smithi101.stdout: { 2023-08-01T19:55:21.777 INFO:teuthology.orchestra.run.smithi101.stdout: "event": "queued_for_pg", 2023-08-01T19:55:21.777 INFO:teuthology.orchestra.run.smithi101.stdout: "time": "2023-08-01T19:54:04.459249+0000", 2023-08-01T19:55:21.777 INFO:teuthology.orchestra.run.smithi101.stdout: "duration": 4.6e-06 2023-08-01T19:55:21.777 INFO:teuthology.orchestra.run.smithi101.stdout: }, 2023-08-01T19:55:21.777 INFO:teuthology.orchestra.run.smithi101.stdout: { 2023-08-01T19:55:21.777 INFO:teuthology.orchestra.run.smithi101.stdout: "event": "reached_pg", 2023-08-01T19:55:21.778 INFO:teuthology.orchestra.run.smithi101.stdout: "time": "2023-08-01T19:54:04.459276+0000", 2023-08-01T19:55:21.778 INFO:teuthology.orchestra.run.smithi101.stdout: "duration": 2.6373999999999999e-05 2023-08-01T19:55:21.778 INFO:teuthology.orchestra.run.smithi101.stdout: }, 2023-08-01T19:55:21.778 INFO:teuthology.orchestra.run.smithi101.stdout: { 2023-08-01T19:55:21.778 INFO:teuthology.orchestra.run.smithi101.stdout: "event": "waiting_for_map not empty", 2023-08-01T19:55:21.778 INFO:teuthology.orchestra.run.smithi101.stdout: "time": "2023-08-01T19:54:04.459278+0000", 2023-08-01T19:55:21.778 INFO:teuthology.orchestra.run.smithi101.stdout: "duration": 2.4980000000000001e-06 2023-08-01T19:55:21.778 INFO:teuthology.orchestra.run.smithi101.stdout: }, 2023-08-01T19:55:21.779 INFO:teuthology.orchestra.run.smithi101.stdout: { 2023-08-01T19:55:21.779 INFO:teuthology.orchestra.run.smithi101.stdout: "event": "reached_pg", 2023-08-01T19:55:21.779 INFO:teuthology.orchestra.run.smithi101.stdout: "time": "2023-08-01T19:54:04.474058+0000", 2023-08-01T19:55:21.779 INFO:teuthology.orchestra.run.smithi101.stdout: "duration": 0.014779979 2023-08-01T19:55:21.779 INFO:teuthology.orchestra.run.smithi101.stdout: }, 2023-08-01T19:55:21.779 INFO:teuthology.orchestra.run.smithi101.stdout: { 2023-08-01T19:55:21.779 INFO:teuthology.orchestra.run.smithi101.stdout: "event": "started", 2023-08-01T19:55:21.779 INFO:teuthology.orchestra.run.smithi101.stdout: "time": "2023-08-01T19:54:04.474614+0000", 2023-08-01T19:55:21.780 INFO:teuthology.orchestra.run.smithi101.stdout: "duration": 0.00055546899999999995 2023-08-01T19:55:21.780 INFO:teuthology.orchestra.run.smithi101.stdout: }, 2023-08-01T19:55:21.780 INFO:teuthology.orchestra.run.smithi101.stdout: { 2023-08-01T19:55:21.780 INFO:teuthology.orchestra.run.smithi101.stdout: "event": "waiting for subops from 2", 2023-08-01T19:55:21.780 INFO:teuthology.orchestra.run.smithi101.stdout: "time": "2023-08-01T19:54:04.474720+0000", 2023-08-01T19:55:21.780 INFO:teuthology.orchestra.run.smithi101.stdout: "duration": 0.00010645300000000001 2023-08-01T19:55:21.780 INFO:teuthology.orchestra.run.smithi101.stdout: }, 2023-08-01T19:55:21.781 INFO:teuthology.orchestra.run.smithi101.stdout: { 2023-08-01T19:55:21.781 INFO:teuthology.orchestra.run.smithi101.stdout: "event": "op_commit", 2023-08-01T19:55:21.781 INFO:teuthology.orchestra.run.smithi101.stdout: "time": "2023-08-01T19:54:04.478480+0000", 2023-08-01T19:55:21.781 INFO:teuthology.orchestra.run.smithi101.stdout: "duration": 0.0037600279999999999 2023-08-01T19:55:21.781 INFO:teuthology.orchestra.run.smithi101.stdout: }, 2023-08-01T19:55:21.781 INFO:teuthology.orchestra.run.smithi101.stdout: { 2023-08-01T19:55:21.781 INFO:teuthology.orchestra.run.smithi101.stdout: "event": "sub_op_commit_rec", 2023-08-01T19:55:21.781 INFO:teuthology.orchestra.run.smithi101.stdout: "time": "2023-08-01T19:54:04.480273+0000", 2023-08-01T19:55:21.782 INFO:teuthology.orchestra.run.smithi101.stdout: "duration": 0.001792465 2023-08-01T19:55:21.782 INFO:teuthology.orchestra.run.smithi101.stdout: }, 2023-08-01T19:55:21.782 INFO:teuthology.orchestra.run.smithi101.stdout: { 2023-08-01T19:55:21.782 INFO:teuthology.orchestra.run.smithi101.stdout: "event": "commit_sent", 2023-08-01T19:55:21.782 INFO:teuthology.orchestra.run.smithi101.stdout: "time": "2023-08-01T19:54:04.480304+0000", 2023-08-01T19:55:21.782 INFO:teuthology.orchestra.run.smithi101.stdout: "duration": 3.1708999999999997e-05 2023-08-01T19:55:21.782 INFO:teuthology.orchestra.run.smithi101.stdout: }, 2023-08-01T19:55:21.782 INFO:teuthology.orchestra.run.smithi101.stdout: { 2023-08-01T19:55:21.783 INFO:teuthology.orchestra.run.smithi101.stdout: "event": "done", 2023-08-01T19:55:21.783 INFO:teuthology.orchestra.run.smithi101.stdout: "time": "2023-08-01T19:54:04.480330+0000", 2023-08-01T19:55:21.783 INFO:teuthology.orchestra.run.smithi101.stdout: "duration": 2.5860999999999999e-05 2023-08-01T19:55:21.783 INFO:teuthology.orchestra.run.smithi101.stdout: } 2023-08-01T19:55:21.783 INFO:teuthology.orchestra.run.smithi101.stdout: ] 2023-08-01T19:55:21.783 INFO:teuthology.orchestra.run.smithi101.stdout: } 2023-08-01T19:55:21.783 INFO:teuthology.orchestra.run.smithi101.stdout: }, 2023-08-01T19:55:21.783 INFO:teuthology.orchestra.run.smithi101.stdout: { 2023-08-01T19:55:21.784 INFO:teuthology.orchestra.run.smithi101.stdout: "description": "osd_op(mds.0.3:32 3.14 3:2e2fa760:::200.00000001:head [delete] snapc 0=[] ondisk+write+known_if_redirected+full_force+supports_pool_eio e17)", 2023-08-01T19:55:21.784 INFO:teuthology.orchestra.run.smithi101.stdout: "initiated_at": "2023-08-01T19:54:04.459304+0000", 2023-08-01T19:55:21.784 INFO:teuthology.orchestra.run.smithi101.stdout: "age": 77.264211427000006, 2023-08-01T19:55:21.784 INFO:teuthology.orchestra.run.smithi101.stdout: "duration": 0.021110606000000001, 2023-08-01T19:55:21.784 INFO:teuthology.orchestra.run.smithi101.stdout: "type_data": { 2023-08-01T19:55:21.784 INFO:teuthology.orchestra.run.smithi101.stdout: "flag_point": "started", 2023-08-01T19:55:21.784 INFO:teuthology.orchestra.run.smithi101.stdout: "events": [ 2023-08-01T19:55:21.785 INFO:teuthology.orchestra.run.smithi101.stdout: { 2023-08-01T19:55:21.785 INFO:teuthology.orchestra.run.smithi101.stdout: "event": "initiated", 2023-08-01T19:55:21.785 INFO:teuthology.orchestra.run.smithi101.stdout: "time": "2023-08-01T19:54:04.459304+0000", 2023-08-01T19:55:21.785 INFO:teuthology.orchestra.run.smithi101.stdout: "duration": 0 2023-08-01T19:55:21.785 INFO:teuthology.orchestra.run.smithi101.stdout: }, 2023-08-01T19:55:21.785 INFO:teuthology.orchestra.run.smithi101.stdout: { 2023-08-01T19:55:21.785 INFO:teuthology.orchestra.run.smithi101.stdout: "event": "throttled", 2023-08-01T19:55:21.785 INFO:teuthology.orchestra.run.smithi101.stdout: "time": "2023-08-01T19:54:04.459304+0000", 2023-08-01T19:55:21.786 INFO:teuthology.orchestra.run.smithi101.stdout: "duration": 0 2023-08-01T19:55:21.786 INFO:teuthology.orchestra.run.smithi101.stdout: }, 2023-08-01T19:55:21.786 INFO:teuthology.orchestra.run.smithi101.stdout: { 2023-08-01T19:55:21.786 INFO:teuthology.orchestra.run.smithi101.stdout: "event": "header_read", 2023-08-01T19:55:21.786 INFO:teuthology.orchestra.run.smithi101.stdout: "time": "2023-08-01T19:54:04.459304+0000", 2023-08-01T19:55:21.786 INFO:teuthology.orchestra.run.smithi101.stdout: "duration": 4294967295.9999995 2023-08-01T19:55:21.786 INFO:teuthology.orchestra.run.smithi101.stdout: }, 2023-08-01T19:55:21.786 INFO:teuthology.orchestra.run.smithi101.stdout: { 2023-08-01T19:55:21.787 INFO:teuthology.orchestra.run.smithi101.stdout: "event": "all_read", 2023-08-01T19:55:21.787 INFO:teuthology.orchestra.run.smithi101.stdout: "time": "2023-08-01T19:54:04.459306+0000", 2023-08-01T19:55:21.787 INFO:teuthology.orchestra.run.smithi101.stdout: "duration": 2.3889999999999999e-06 2023-08-01T19:55:21.787 INFO:teuthology.orchestra.run.smithi101.stdout: }, 2023-08-01T19:55:21.787 INFO:teuthology.orchestra.run.smithi101.stdout: { 2023-08-01T19:55:21.787 INFO:teuthology.orchestra.run.smithi101.stdout: "event": "dispatched", 2023-08-01T19:55:21.787 INFO:teuthology.orchestra.run.smithi101.stdout: "time": "2023-08-01T19:54:04.459314+0000", 2023-08-01T19:55:21.787 INFO:teuthology.orchestra.run.smithi101.stdout: "duration": 7.1180000000000003e-06 2023-08-01T19:55:21.788 INFO:teuthology.orchestra.run.smithi101.stdout: }, 2023-08-01T19:55:21.788 INFO:teuthology.orchestra.run.smithi101.stdout: { 2023-08-01T19:55:21.788 INFO:teuthology.orchestra.run.smithi101.stdout: "event": "queued_for_pg", 2023-08-01T19:55:21.788 INFO:teuthology.orchestra.run.smithi101.stdout: "time": "2023-08-01T19:54:04.459318+0000", 2023-08-01T19:55:21.788 INFO:teuthology.orchestra.run.smithi101.stdout: "duration": 4.0239999999999999e-06 2023-08-01T19:55:21.788 INFO:teuthology.orchestra.run.smithi101.stdout: }, 2023-08-01T19:55:21.788 INFO:teuthology.orchestra.run.smithi101.stdout: { 2023-08-01T19:55:21.789 INFO:teuthology.orchestra.run.smithi101.stdout: "event": "reached_pg", 2023-08-01T19:55:21.789 INFO:teuthology.orchestra.run.smithi101.stdout: "time": "2023-08-01T19:54:04.459340+0000", 2023-08-01T19:55:21.789 INFO:teuthology.orchestra.run.smithi101.stdout: "duration": 2.2476e-05 2023-08-01T19:55:21.789 INFO:teuthology.orchestra.run.smithi101.stdout: }, 2023-08-01T19:55:21.789 INFO:teuthology.orchestra.run.smithi101.stdout: { 2023-08-01T19:55:21.789 INFO:teuthology.orchestra.run.smithi101.stdout: "event": "waiting_for_map not empty", 2023-08-01T19:55:21.789 INFO:teuthology.orchestra.run.smithi101.stdout: "time": "2023-08-01T19:54:04.459342+0000", 2023-08-01T19:55:21.789 INFO:teuthology.orchestra.run.smithi101.stdout: "duration": 2.272e-06 2023-08-01T19:55:21.790 INFO:teuthology.orchestra.run.smithi101.stdout: }, 2023-08-01T19:55:21.790 INFO:teuthology.orchestra.run.smithi101.stdout: { 2023-08-01T19:55:21.790 INFO:teuthology.orchestra.run.smithi101.stdout: "event": "reached_pg", 2023-08-01T19:55:21.790 INFO:teuthology.orchestra.run.smithi101.stdout: "time": "2023-08-01T19:54:04.475922+0000", 2023-08-01T19:55:21.790 INFO:teuthology.orchestra.run.smithi101.stdout: "duration": 0.016579388 2023-08-01T19:55:21.790 INFO:teuthology.orchestra.run.smithi101.stdout: }, 2023-08-01T19:55:21.790 INFO:teuthology.orchestra.run.smithi101.stdout: { 2023-08-01T19:55:21.790 INFO:teuthology.orchestra.run.smithi101.stdout: "event": "started", 2023-08-01T19:55:21.791 INFO:teuthology.orchestra.run.smithi101.stdout: "time": "2023-08-01T19:54:04.476107+0000", 2023-08-01T19:55:21.791 INFO:teuthology.orchestra.run.smithi101.stdout: "duration": 0.00018486300000000001 2023-08-01T19:55:21.791 INFO:teuthology.orchestra.run.smithi101.stdout: }, 2023-08-01T19:55:21.791 INFO:teuthology.orchestra.run.smithi101.stdout: { 2023-08-01T19:55:21.791 INFO:teuthology.orchestra.run.smithi101.stdout: "event": "done", 2023-08-01T19:55:21.791 INFO:teuthology.orchestra.run.smithi101.stdout: "time": "2023-08-01T19:54:04.480415+0000", 2023-08-01T19:55:21.791 INFO:teuthology.orchestra.run.smithi101.stdout: "duration": 0.0043084589999999997 2023-08-01T19:55:21.792 INFO:teuthology.orchestra.run.smithi101.stdout: } 2023-08-01T19:55:21.792 INFO:teuthology.orchestra.run.smithi101.stdout: ] 2023-08-01T19:55:21.792 INFO:teuthology.orchestra.run.smithi101.stdout: } 2023-08-01T19:55:21.792 INFO:teuthology.orchestra.run.smithi101.stdout: }, 2023-08-01T19:55:21.792 INFO:teuthology.orchestra.run.smithi101.stdout: { 2023-08-01T19:55:21.792 INFO:teuthology.orchestra.run.smithi101.stdout: "description": "osd_op(client.4668.0:70878 5.2 5:49b7d2be:::benchmark_data_smithi006_114134_object70877:head [set-alloc-hint object_size 65536 write_size 65536,write 0~65536] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e30)", 2023-08-01T19:55:21.792 INFO:teuthology.orchestra.run.smithi101.stdout: "initiated_at": "2023-08-01T19:54:50.210223+0000", 2023-08-01T19:55:21.792 INFO:teuthology.orchestra.run.smithi101.stdout: "age": 31.513292857, 2023-08-01T19:55:21.793 INFO:teuthology.orchestra.run.smithi101.stdout: "duration": 0.019884895, 2023-08-01T19:55:21.793 INFO:teuthology.orchestra.run.smithi101.stdout: "type_data": { 2023-08-01T19:55:21.793 INFO:teuthology.orchestra.run.smithi101.stdout: "flag_point": "commit sent; apply or cleanup", 2023-08-01T19:55:21.793 INFO:teuthology.orchestra.run.smithi101.stdout: "client_info": { 2023-08-01T19:55:21.793 INFO:teuthology.orchestra.run.smithi101.stdout: "client": "client.4668", 2023-08-01T19:55:21.793 INFO:teuthology.orchestra.run.smithi101.stdout: "client_addr": "172.21.15.6:0/1709472247", 2023-08-01T19:55:21.793 INFO:teuthology.orchestra.run.smithi101.stdout: "tid": 70878 2023-08-01T19:55:21.794 INFO:teuthology.orchestra.run.smithi101.stdout: }, 2023-08-01T19:55:21.794 INFO:teuthology.orchestra.run.smithi101.stdout: "events": [ 2023-08-01T19:55:21.794 INFO:teuthology.orchestra.run.smithi101.stdout: { 2023-08-01T19:55:21.794 INFO:teuthology.orchestra.run.smithi101.stdout: "event": "initiated", 2023-08-01T19:55:21.794 INFO:teuthology.orchestra.run.smithi101.stdout: "time": "2023-08-01T19:54:50.210223+0000", 2023-08-01T19:55:21.794 INFO:teuthology.orchestra.run.smithi101.stdout: "duration": 0 2023-08-01T19:55:21.794 INFO:teuthology.orchestra.run.smithi101.stdout: }, 2023-08-01T19:55:21.794 INFO:teuthology.orchestra.run.smithi101.stdout: { 2023-08-01T19:55:21.795 INFO:teuthology.orchestra.run.smithi101.stdout: "event": "throttled", 2023-08-01T19:55:21.795 INFO:teuthology.orchestra.run.smithi101.stdout: "time": "2023-08-01T19:54:50.210223+0000", 2023-08-01T19:55:21.795 INFO:teuthology.orchestra.run.smithi101.stdout: "duration": 0 2023-08-01T19:55:21.795 INFO:teuthology.orchestra.run.smithi101.stdout: }, 2023-08-01T19:55:21.795 INFO:teuthology.orchestra.run.smithi101.stdout: { 2023-08-01T19:55:21.795 INFO:teuthology.orchestra.run.smithi101.stdout: "event": "header_read", 2023-08-01T19:55:21.795 INFO:teuthology.orchestra.run.smithi101.stdout: "time": "2023-08-01T19:54:50.210222+0000", 2023-08-01T19:55:21.795 INFO:teuthology.orchestra.run.smithi101.stdout: "duration": 4294967295.999999 2023-08-01T19:55:21.796 INFO:teuthology.orchestra.run.smithi101.stdout: }, 2023-08-01T19:55:21.796 INFO:teuthology.orchestra.run.smithi101.stdout: { 2023-08-01T19:55:21.796 INFO:teuthology.orchestra.run.smithi101.stdout: "event": "all_read", 2023-08-01T19:55:21.796 INFO:teuthology.orchestra.run.smithi101.stdout: "time": "2023-08-01T19:54:50.210315+0000", 2023-08-01T19:55:21.796 INFO:teuthology.orchestra.run.smithi101.stdout: "duration": 9.2567999999999999e-05 2023-08-01T19:55:21.796 INFO:teuthology.orchestra.run.smithi101.stdout: }, 2023-08-01T19:55:21.796 INFO:teuthology.orchestra.run.smithi101.stdout: { 2023-08-01T19:55:21.797 INFO:teuthology.orchestra.run.smithi101.stdout: "event": "dispatched", 2023-08-01T19:55:21.797 INFO:teuthology.orchestra.run.smithi101.stdout: "time": "2023-08-01T19:54:50.210326+0000", 2023-08-01T19:55:21.797 INFO:teuthology.orchestra.run.smithi101.stdout: "duration": 1.1430000000000001e-05 2023-08-01T19:55:21.797 INFO:teuthology.orchestra.run.smithi101.stdout: }, 2023-08-01T19:55:21.797 INFO:teuthology.orchestra.run.smithi101.stdout: { 2023-08-01T19:55:21.797 INFO:teuthology.orchestra.run.smithi101.stdout: "event": "queued_for_pg", 2023-08-01T19:55:21.797 INFO:teuthology.orchestra.run.smithi101.stdout: "time": "2023-08-01T19:54:50.210332+0000", 2023-08-01T19:55:21.797 INFO:teuthology.orchestra.run.smithi101.stdout: "duration": 5.8479999999999997e-06 2023-08-01T19:55:21.798 INFO:teuthology.orchestra.run.smithi101.stdout: }, 2023-08-01T19:55:21.798 INFO:teuthology.orchestra.run.smithi101.stdout: { 2023-08-01T19:55:21.798 INFO:teuthology.orchestra.run.smithi101.stdout: "event": "reached_pg", 2023-08-01T19:55:21.798 INFO:teuthology.orchestra.run.smithi101.stdout: "time": "2023-08-01T19:54:50.214259+0000", 2023-08-01T19:55:21.798 INFO:teuthology.orchestra.run.smithi101.stdout: "duration": 0.003926789 2023-08-01T19:55:21.798 INFO:teuthology.orchestra.run.smithi101.stdout: }, 2023-08-01T19:55:21.798 INFO:teuthology.orchestra.run.smithi101.stdout: { 2023-08-01T19:55:21.798 INFO:teuthology.orchestra.run.smithi101.stdout: "event": "started", 2023-08-01T19:55:21.799 INFO:teuthology.orchestra.run.smithi101.stdout: "time": "2023-08-01T19:54:50.214387+0000", 2023-08-01T19:55:21.799 INFO:teuthology.orchestra.run.smithi101.stdout: "duration": 0.00012787599999999999 2023-08-01T19:55:21.799 INFO:teuthology.orchestra.run.smithi101.stdout: }, 2023-08-01T19:55:21.799 INFO:teuthology.orchestra.run.smithi101.stdout: { 2023-08-01T19:55:21.799 INFO:teuthology.orchestra.run.smithi101.stdout: "event": "waiting for subops from 0", 2023-08-01T19:55:21.799 INFO:teuthology.orchestra.run.smithi101.stdout: "time": "2023-08-01T19:54:50.214536+0000", 2023-08-01T19:55:21.799 INFO:teuthology.orchestra.run.smithi101.stdout: "duration": 0.00014935299999999999 2023-08-01T19:55:21.800 INFO:teuthology.orchestra.run.smithi101.stdout: }, 2023-08-01T19:55:21.800 INFO:teuthology.orchestra.run.smithi101.stdout: { 2023-08-01T19:55:21.800 INFO:teuthology.orchestra.run.smithi101.stdout: "event": "op_commit", 2023-08-01T19:55:21.800 INFO:teuthology.orchestra.run.smithi101.stdout: "time": "2023-08-01T19:54:50.217739+0000", 2023-08-01T19:55:21.800 INFO:teuthology.orchestra.run.smithi101.stdout: "duration": 0.0032034619999999998 2023-08-01T19:55:21.800 INFO:teuthology.orchestra.run.smithi101.stdout: }, 2023-08-01T19:55:21.800 INFO:teuthology.orchestra.run.smithi101.stdout: { 2023-08-01T19:55:21.800 INFO:teuthology.orchestra.run.smithi101.stdout: "event": "sub_op_commit_rec", 2023-08-01T19:55:21.801 INFO:teuthology.orchestra.run.smithi101.stdout: "time": "2023-08-01T19:54:50.230032+0000", 2023-08-01T19:55:21.801 INFO:teuthology.orchestra.run.smithi101.stdout: "duration": 0.012293068000000001 2023-08-01T19:55:21.801 INFO:teuthology.orchestra.run.smithi101.stdout: }, 2023-08-01T19:55:21.801 INFO:teuthology.orchestra.run.smithi101.stdout: { 2023-08-01T19:55:21.801 INFO:teuthology.orchestra.run.smithi101.stdout: "event": "commit_sent", 2023-08-01T19:55:21.801 INFO:teuthology.orchestra.run.smithi101.stdout: "time": "2023-08-01T19:54:50.230075+0000", 2023-08-01T19:55:21.801 INFO:teuthology.orchestra.run.smithi101.stdout: "duration": 4.3062999999999997e-05 2023-08-01T19:55:21.802 INFO:teuthology.orchestra.run.smithi101.stdout: }, 2023-08-01T19:55:21.802 INFO:teuthology.orchestra.run.smithi101.stdout: { 2023-08-01T19:55:21.802 INFO:teuthology.orchestra.run.smithi101.stdout: "event": "done", 2023-08-01T19:55:21.802 INFO:teuthology.orchestra.run.smithi101.stdout: "time": "2023-08-01T19:54:50.230108+0000", 2023-08-01T19:55:21.802 INFO:teuthology.orchestra.run.smithi101.stdout: "duration": 3.2366999999999997e-05 2023-08-01T19:55:21.802 INFO:teuthology.orchestra.run.smithi101.stdout: } 2023-08-01T19:55:21.802 INFO:teuthology.orchestra.run.smithi101.stdout: ] 2023-08-01T19:55:21.802 INFO:teuthology.orchestra.run.smithi101.stdout: } 2023-08-01T19:55:21.803 INFO:teuthology.orchestra.run.smithi101.stdout: }, 2023-08-01T19:55:21.803 INFO:teuthology.orchestra.run.smithi101.stdout: { 2023-08-01T19:55:21.803 INFO:teuthology.orchestra.run.smithi101.stdout: "description": "osd_op(client.4668.0:73460 5.f 5:ff4f0704:::benchmark_data_smithi006_114134_object73459:head [set-alloc-hint object_size 65536 write_size 65536,write 0~65536] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e31)", 2023-08-01T19:55:21.803 INFO:teuthology.orchestra.run.smithi101.stdout: "initiated_at": "2023-08-01T19:54:51.462968+0000", 2023-08-01T19:55:21.803 INFO:teuthology.orchestra.run.smithi101.stdout: "age": 30.260547978000002, 2023-08-01T19:55:21.803 INFO:teuthology.orchestra.run.smithi101.stdout: "duration": 0.020056502, 2023-08-01T19:55:21.803 INFO:teuthology.orchestra.run.smithi101.stdout: "type_data": { 2023-08-01T19:55:21.803 INFO:teuthology.orchestra.run.smithi101.stdout: "flag_point": "commit sent; apply or cleanup", 2023-08-01T19:55:21.804 INFO:teuthology.orchestra.run.smithi101.stdout: "client_info": { 2023-08-01T19:55:21.804 INFO:teuthology.orchestra.run.smithi101.stdout: "client": "client.4668", 2023-08-01T19:55:21.804 INFO:teuthology.orchestra.run.smithi101.stdout: "client_addr": "172.21.15.6:0/1709472247", 2023-08-01T19:55:21.804 INFO:teuthology.orchestra.run.smithi101.stdout: "tid": 73460 2023-08-01T19:55:21.804 INFO:teuthology.orchestra.run.smithi101.stdout: }, 2023-08-01T19:55:21.804 INFO:teuthology.orchestra.run.smithi101.stdout: "events": [ 2023-08-01T19:55:21.804 INFO:teuthology.orchestra.run.smithi101.stdout: { 2023-08-01T19:55:21.805 INFO:teuthology.orchestra.run.smithi101.stdout: "event": "initiated", 2023-08-01T19:55:21.805 INFO:teuthology.orchestra.run.smithi101.stdout: "time": "2023-08-01T19:54:51.462968+0000", 2023-08-01T19:55:21.805 INFO:teuthology.orchestra.run.smithi101.stdout: "duration": 0 2023-08-01T19:55:21.805 INFO:teuthology.orchestra.run.smithi101.stdout: }, 2023-08-01T19:55:21.805 INFO:teuthology.orchestra.run.smithi101.stdout: { 2023-08-01T19:55:21.805 INFO:teuthology.orchestra.run.smithi101.stdout: "event": "throttled", 2023-08-01T19:55:21.805 INFO:teuthology.orchestra.run.smithi101.stdout: "time": "2023-08-01T19:54:51.462968+0000", 2023-08-01T19:55:21.805 INFO:teuthology.orchestra.run.smithi101.stdout: "duration": 0 2023-08-01T19:55:21.806 INFO:teuthology.orchestra.run.smithi101.stdout: }, 2023-08-01T19:55:21.806 INFO:teuthology.orchestra.run.smithi101.stdout: { 2023-08-01T19:55:21.806 INFO:teuthology.orchestra.run.smithi101.stdout: "event": "header_read", 2023-08-01T19:55:21.806 INFO:teuthology.orchestra.run.smithi101.stdout: "time": "2023-08-01T19:54:51.462967+0000", 2023-08-01T19:55:21.806 INFO:teuthology.orchestra.run.smithi101.stdout: "duration": 4294967295.999999 2023-08-01T19:55:21.806 INFO:teuthology.orchestra.run.smithi101.stdout: }, 2023-08-01T19:55:21.806 INFO:teuthology.orchestra.run.smithi101.stdout: { 2023-08-01T19:55:21.806 INFO:teuthology.orchestra.run.smithi101.stdout: "event": "all_read", 2023-08-01T19:55:21.807 INFO:teuthology.orchestra.run.smithi101.stdout: "time": "2023-08-01T19:54:51.463009+0000", 2023-08-01T19:55:21.807 INFO:teuthology.orchestra.run.smithi101.stdout: "duration": 4.2106e-05 2023-08-01T19:55:21.807 INFO:teuthology.orchestra.run.smithi101.stdout: }, 2023-08-01T19:55:21.807 INFO:teuthology.orchestra.run.smithi101.stdout: { 2023-08-01T19:55:21.807 INFO:teuthology.orchestra.run.smithi101.stdout: "event": "dispatched", 2023-08-01T19:55:21.807 INFO:teuthology.orchestra.run.smithi101.stdout: "time": "2023-08-01T19:54:51.463017+0000", 2023-08-01T19:55:21.807 INFO:teuthology.orchestra.run.smithi101.stdout: "duration": 8.1529999999999997e-06 2023-08-01T19:55:21.808 INFO:teuthology.orchestra.run.smithi101.stdout: }, 2023-08-01T19:55:21.808 INFO:teuthology.orchestra.run.smithi101.stdout: { 2023-08-01T19:55:21.808 INFO:teuthology.orchestra.run.smithi101.stdout: "event": "queued_for_pg", 2023-08-01T19:55:21.808 INFO:teuthology.orchestra.run.smithi101.stdout: "time": "2023-08-01T19:54:51.463027+0000", 2023-08-01T19:55:21.808 INFO:teuthology.orchestra.run.smithi101.stdout: "duration": 9.5659999999999996e-06 2023-08-01T19:55:21.808 INFO:teuthology.orchestra.run.smithi101.stdout: }, 2023-08-01T19:55:21.808 INFO:teuthology.orchestra.run.smithi101.stdout: { 2023-08-01T19:55:21.808 INFO:teuthology.orchestra.run.smithi101.stdout: "event": "reached_pg", 2023-08-01T19:55:21.809 INFO:teuthology.orchestra.run.smithi101.stdout: "time": "2023-08-01T19:54:51.463062+0000", 2023-08-01T19:55:21.809 INFO:teuthology.orchestra.run.smithi101.stdout: "duration": 3.5442999999999999e-05 2023-08-01T19:55:21.809 INFO:teuthology.orchestra.run.smithi101.stdout: }, 2023-08-01T19:55:21.809 INFO:teuthology.orchestra.run.smithi101.stdout: { 2023-08-01T19:55:21.809 INFO:teuthology.orchestra.run.smithi101.stdout: "event": "started", 2023-08-01T19:55:21.809 INFO:teuthology.orchestra.run.smithi101.stdout: "time": "2023-08-01T19:54:51.463198+0000", 2023-08-01T19:55:21.809 INFO:teuthology.orchestra.run.smithi101.stdout: "duration": 0.000135628 2023-08-01T19:55:21.810 INFO:teuthology.orchestra.run.smithi101.stdout: }, 2023-08-01T19:55:21.810 INFO:teuthology.orchestra.run.smithi101.stdout: { 2023-08-01T19:55:21.810 INFO:teuthology.orchestra.run.smithi101.stdout: "event": "waiting for subops from 2", 2023-08-01T19:55:21.810 INFO:teuthology.orchestra.run.smithi101.stdout: "time": "2023-08-01T19:54:51.463341+0000", 2023-08-01T19:55:21.810 INFO:teuthology.orchestra.run.smithi101.stdout: "duration": 0.00014346500000000001 2023-08-01T19:55:21.810 INFO:teuthology.orchestra.run.smithi101.stdout: }, 2023-08-01T19:55:21.810 INFO:teuthology.orchestra.run.smithi101.stdout: { 2023-08-01T19:55:21.810 INFO:teuthology.orchestra.run.smithi101.stdout: "event": "op_commit", 2023-08-01T19:55:21.811 INFO:teuthology.orchestra.run.smithi101.stdout: "time": "2023-08-01T19:54:51.472684+0000", 2023-08-01T19:55:21.811 INFO:teuthology.orchestra.run.smithi101.stdout: "duration": 0.0093427900000000001 2023-08-01T19:55:21.811 INFO:teuthology.orchestra.run.smithi101.stdout: }, 2023-08-01T19:55:21.811 INFO:teuthology.orchestra.run.smithi101.stdout: { 2023-08-01T19:55:21.811 INFO:teuthology.orchestra.run.smithi101.stdout: "event": "sub_op_commit_rec", 2023-08-01T19:55:21.811 INFO:teuthology.orchestra.run.smithi101.stdout: "time": "2023-08-01T19:54:51.482937+0000", 2023-08-01T19:55:21.811 INFO:teuthology.orchestra.run.smithi101.stdout: "duration": 0.010252557000000001 2023-08-01T19:55:21.811 INFO:teuthology.orchestra.run.smithi101.stdout: }, 2023-08-01T19:55:21.812 INFO:teuthology.orchestra.run.smithi101.stdout: { 2023-08-01T19:55:21.812 INFO:teuthology.orchestra.run.smithi101.stdout: "event": "commit_sent", 2023-08-01T19:55:21.812 INFO:teuthology.orchestra.run.smithi101.stdout: "time": "2023-08-01T19:54:51.482984+0000", 2023-08-01T19:55:21.812 INFO:teuthology.orchestra.run.smithi101.stdout: "duration": 4.7394000000000001e-05 2023-08-01T19:55:21.812 INFO:teuthology.orchestra.run.smithi101.stdout: }, 2023-08-01T19:55:21.812 INFO:teuthology.orchestra.run.smithi101.stdout: { 2023-08-01T19:55:21.812 INFO:teuthology.orchestra.run.smithi101.stdout: "event": "done", 2023-08-01T19:55:21.812 INFO:teuthology.orchestra.run.smithi101.stdout: "time": "2023-08-01T19:54:51.483024+0000", 2023-08-01T19:55:21.813 INFO:teuthology.orchestra.run.smithi101.stdout: "duration": 4.0159e-05 2023-08-01T19:55:21.813 INFO:teuthology.orchestra.run.smithi101.stdout: } 2023-08-01T19:55:21.813 INFO:teuthology.orchestra.run.smithi101.stdout: ] 2023-08-01T19:55:21.813 INFO:teuthology.orchestra.run.smithi101.stdout: } 2023-08-01T19:55:21.813 INFO:teuthology.orchestra.run.smithi101.stdout: }, 2023-08-01T19:55:21.813 INFO:teuthology.orchestra.run.smithi101.stdout: { 2023-08-01T19:55:21.813 INFO:teuthology.orchestra.run.smithi101.stdout: "description": "osd_op(client.4668.0:92726 5.2 5:41e18163:::benchmark_data_smithi006_114134_object92725:head [set-alloc-hint object_size 65536 write_size 65536,write 0~65536] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e36)", 2023-08-01T19:55:21.814 INFO:teuthology.orchestra.run.smithi101.stdout: "initiated_at": "2023-08-01T19:55:01.256971+0000", 2023-08-01T19:55:21.814 INFO:teuthology.orchestra.run.smithi101.stdout: "age": 20.466544898999999, 2023-08-01T19:55:21.814 INFO:teuthology.orchestra.run.smithi101.stdout: "duration": 0.019854296, 2023-08-01T19:55:21.814 INFO:teuthology.orchestra.run.smithi101.stdout: "type_data": { 2023-08-01T19:55:21.814 INFO:teuthology.orchestra.run.smithi101.stdout: "flag_point": "commit sent; apply or cleanup", 2023-08-01T19:55:21.814 INFO:teuthology.orchestra.run.smithi101.stdout: "client_info": { 2023-08-01T19:55:21.814 INFO:teuthology.orchestra.run.smithi101.stdout: "client": "client.4668", 2023-08-01T19:55:21.814 INFO:teuthology.orchestra.run.smithi101.stdout: "client_addr": "172.21.15.6:0/1709472247", 2023-08-01T19:55:21.815 INFO:teuthology.orchestra.run.smithi101.stdout: "tid": 92726 2023-08-01T19:55:21.815 INFO:teuthology.orchestra.run.smithi101.stdout: }, 2023-08-01T19:55:21.815 INFO:teuthology.orchestra.run.smithi101.stdout: "events": [ 2023-08-01T19:55:21.815 INFO:teuthology.orchestra.run.smithi101.stdout: { 2023-08-01T19:55:21.815 INFO:teuthology.orchestra.run.smithi101.stdout: "event": "initiated", 2023-08-01T19:55:21.815 INFO:teuthology.orchestra.run.smithi101.stdout: "time": "2023-08-01T19:55:01.256971+0000", 2023-08-01T19:55:21.815 INFO:teuthology.orchestra.run.smithi101.stdout: "duration": 0 2023-08-01T19:55:21.815 INFO:teuthology.orchestra.run.smithi101.stdout: }, 2023-08-01T19:55:21.816 INFO:teuthology.orchestra.run.smithi101.stdout: { 2023-08-01T19:55:21.816 INFO:teuthology.orchestra.run.smithi101.stdout: "event": "throttled", 2023-08-01T19:55:21.816 INFO:teuthology.orchestra.run.smithi101.stdout: "time": "2023-08-01T19:55:01.256971+0000", 2023-08-01T19:55:21.816 INFO:teuthology.orchestra.run.smithi101.stdout: "duration": 0 2023-08-01T19:55:21.816 INFO:teuthology.orchestra.run.smithi101.stdout: }, 2023-08-01T19:55:21.816 INFO:teuthology.orchestra.run.smithi101.stdout: { 2023-08-01T19:55:21.816 INFO:teuthology.orchestra.run.smithi101.stdout: "event": "header_read", 2023-08-01T19:55:21.817 INFO:teuthology.orchestra.run.smithi101.stdout: "time": "2023-08-01T19:55:01.256970+0000", 2023-08-01T19:55:21.817 INFO:teuthology.orchestra.run.smithi101.stdout: "duration": 4294967295.9999995 2023-08-01T19:55:21.817 INFO:teuthology.orchestra.run.smithi101.stdout: }, 2023-08-01T19:55:21.817 INFO:teuthology.orchestra.run.smithi101.stdout: { 2023-08-01T19:55:21.817 INFO:teuthology.orchestra.run.smithi101.stdout: "event": "all_read", 2023-08-01T19:55:21.817 INFO:teuthology.orchestra.run.smithi101.stdout: "time": "2023-08-01T19:55:01.257057+0000", 2023-08-01T19:55:21.817 INFO:teuthology.orchestra.run.smithi101.stdout: "duration": 8.6627999999999998e-05 2023-08-01T19:55:21.817 INFO:teuthology.orchestra.run.smithi101.stdout: }, 2023-08-01T19:55:21.818 INFO:teuthology.orchestra.run.smithi101.stdout: { 2023-08-01T19:55:21.818 INFO:teuthology.orchestra.run.smithi101.stdout: "event": "dispatched", 2023-08-01T19:55:21.818 INFO:teuthology.orchestra.run.smithi101.stdout: "time": "2023-08-01T19:55:01.257063+0000", 2023-08-01T19:55:21.818 INFO:teuthology.orchestra.run.smithi101.stdout: "duration": 6.528e-06 2023-08-01T19:55:21.818 INFO:teuthology.orchestra.run.smithi101.stdout: }, 2023-08-01T19:55:21.818 INFO:teuthology.orchestra.run.smithi101.stdout: { 2023-08-01T19:55:21.818 INFO:teuthology.orchestra.run.smithi101.stdout: "event": "queued_for_pg", 2023-08-01T19:55:21.818 INFO:teuthology.orchestra.run.smithi101.stdout: "time": "2023-08-01T19:55:01.257067+0000", 2023-08-01T19:55:21.819 INFO:teuthology.orchestra.run.smithi101.stdout: "duration": 3.2739999999999999e-06 2023-08-01T19:55:21.819 INFO:teuthology.orchestra.run.smithi101.stdout: }, 2023-08-01T19:55:21.819 INFO:teuthology.orchestra.run.smithi101.stdout: { 2023-08-01T19:55:21.819 INFO:teuthology.orchestra.run.smithi101.stdout: "event": "reached_pg", 2023-08-01T19:55:21.819 INFO:teuthology.orchestra.run.smithi101.stdout: "time": "2023-08-01T19:55:01.259714+0000", 2023-08-01T19:55:21.819 INFO:teuthology.orchestra.run.smithi101.stdout: "duration": 0.0026476709999999999 2023-08-01T19:55:21.819 INFO:teuthology.orchestra.run.smithi101.stdout: }, 2023-08-01T19:55:21.819 INFO:teuthology.orchestra.run.smithi101.stdout: { 2023-08-01T19:55:21.820 INFO:teuthology.orchestra.run.smithi101.stdout: "event": "started", 2023-08-01T19:55:21.820 INFO:teuthology.orchestra.run.smithi101.stdout: "time": "2023-08-01T19:55:01.259829+0000", 2023-08-01T19:55:21.820 INFO:teuthology.orchestra.run.smithi101.stdout: "duration": 0.000114471 2023-08-01T19:55:21.820 INFO:teuthology.orchestra.run.smithi101.stdout: }, 2023-08-01T19:55:21.820 INFO:teuthology.orchestra.run.smithi101.stdout: { 2023-08-01T19:55:21.820 INFO:teuthology.orchestra.run.smithi101.stdout: "event": "waiting for subops from 0", 2023-08-01T19:55:21.820 INFO:teuthology.orchestra.run.smithi101.stdout: "time": "2023-08-01T19:55:01.259965+0000", 2023-08-01T19:55:21.821 INFO:teuthology.orchestra.run.smithi101.stdout: "duration": 0.00013597300000000001 2023-08-01T19:55:21.821 INFO:teuthology.orchestra.run.smithi101.stdout: }, 2023-08-01T19:55:21.821 INFO:teuthology.orchestra.run.smithi101.stdout: { 2023-08-01T19:55:21.821 INFO:teuthology.orchestra.run.smithi101.stdout: "event": "op_commit", 2023-08-01T19:55:21.821 INFO:teuthology.orchestra.run.smithi101.stdout: "time": "2023-08-01T19:55:01.264360+0000", 2023-08-01T19:55:21.821 INFO:teuthology.orchestra.run.smithi101.stdout: "duration": 0.0043956619999999998 2023-08-01T19:55:21.821 INFO:teuthology.orchestra.run.smithi101.stdout: }, 2023-08-01T19:55:21.821 INFO:teuthology.orchestra.run.smithi101.stdout: { 2023-08-01T19:55:21.822 INFO:teuthology.orchestra.run.smithi101.stdout: "event": "sub_op_commit_rec", 2023-08-01T19:55:21.822 INFO:teuthology.orchestra.run.smithi101.stdout: "time": "2023-08-01T19:55:01.276766+0000", 2023-08-01T19:55:21.822 INFO:teuthology.orchestra.run.smithi101.stdout: "duration": 0.012405736000000001 2023-08-01T19:55:21.822 INFO:teuthology.orchestra.run.smithi101.stdout: }, 2023-08-01T19:55:21.822 INFO:teuthology.orchestra.run.smithi101.stdout: { 2023-08-01T19:55:21.822 INFO:teuthology.orchestra.run.smithi101.stdout: "event": "commit_sent", 2023-08-01T19:55:21.822 INFO:teuthology.orchestra.run.smithi101.stdout: "time": "2023-08-01T19:55:01.276804+0000", 2023-08-01T19:55:21.822 INFO:teuthology.orchestra.run.smithi101.stdout: "duration": 3.7759999999999998e-05 2023-08-01T19:55:21.823 INFO:teuthology.orchestra.run.smithi101.stdout: }, 2023-08-01T19:55:21.823 INFO:teuthology.orchestra.run.smithi101.stdout: { 2023-08-01T19:55:21.823 INFO:teuthology.orchestra.run.smithi101.stdout: "event": "done", 2023-08-01T19:55:21.823 INFO:teuthology.orchestra.run.smithi101.stdout: "time": "2023-08-01T19:55:01.276825+0000", 2023-08-01T19:55:21.823 INFO:teuthology.orchestra.run.smithi101.stdout: "duration": 2.1299000000000001e-05 2023-08-01T19:55:21.823 INFO:teuthology.orchestra.run.smithi101.stdout: } 2023-08-01T19:55:21.823 INFO:teuthology.orchestra.run.smithi101.stdout: ] 2023-08-01T19:55:21.823 INFO:teuthology.orchestra.run.smithi101.stdout: } 2023-08-01T19:55:21.824 INFO:teuthology.orchestra.run.smithi101.stdout: }, 2023-08-01T19:55:21.824 INFO:teuthology.orchestra.run.smithi101.stdout: { 2023-08-01T19:55:21.824 INFO:teuthology.orchestra.run.smithi101.stdout: "description": "osd_op(client.4668.0:100244 5.9 5:92f56a12:::benchmark_data_smithi006_114134_object100243:head [set-alloc-hint object_size 65536 write_size 65536,write 0~65536] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e37)", 2023-08-01T19:55:21.824 INFO:teuthology.orchestra.run.smithi101.stdout: "initiated_at": "2023-08-01T19:55:05.150910+0000", 2023-08-01T19:55:21.824 INFO:teuthology.orchestra.run.smithi101.stdout: "age": 16.572606083, 2023-08-01T19:55:21.824 INFO:teuthology.orchestra.run.smithi101.stdout: "duration": 0.072864287, 2023-08-01T19:55:21.824 INFO:teuthology.orchestra.run.smithi101.stdout: "type_data": { 2023-08-01T19:55:21.825 INFO:teuthology.orchestra.run.smithi101.stdout: "flag_point": "commit sent; apply or cleanup", 2023-08-01T19:55:21.825 INFO:teuthology.orchestra.run.smithi101.stdout: "client_info": { 2023-08-01T19:55:21.825 INFO:teuthology.orchestra.run.smithi101.stdout: "client": "client.4668", 2023-08-01T19:55:21.825 INFO:teuthology.orchestra.run.smithi101.stdout: "client_addr": "172.21.15.6:0/1709472247", 2023-08-01T19:55:21.825 INFO:teuthology.orchestra.run.smithi101.stdout: "tid": 100244 2023-08-01T19:55:21.825 INFO:teuthology.orchestra.run.smithi101.stdout: }, 2023-08-01T19:55:21.825 INFO:teuthology.orchestra.run.smithi101.stdout: "events": [ 2023-08-01T19:55:21.826 INFO:teuthology.orchestra.run.smithi101.stdout: { 2023-08-01T19:55:21.826 INFO:teuthology.orchestra.run.smithi101.stdout: "event": "initiated", 2023-08-01T19:55:21.826 INFO:teuthology.orchestra.run.smithi101.stdout: "time": "2023-08-01T19:55:05.150910+0000", 2023-08-01T19:55:21.826 INFO:teuthology.orchestra.run.smithi101.stdout: "duration": 0 2023-08-01T19:55:21.826 INFO:teuthology.orchestra.run.smithi101.stdout: }, 2023-08-01T19:55:21.826 INFO:teuthology.orchestra.run.smithi101.stdout: { 2023-08-01T19:55:21.826 INFO:teuthology.orchestra.run.smithi101.stdout: "event": "throttled", 2023-08-01T19:55:21.826 INFO:teuthology.orchestra.run.smithi101.stdout: "time": "2023-08-01T19:55:05.150910+0000", 2023-08-01T19:55:21.827 INFO:teuthology.orchestra.run.smithi101.stdout: "duration": 0 2023-08-01T19:55:21.827 INFO:teuthology.orchestra.run.smithi101.stdout: }, 2023-08-01T19:55:21.827 INFO:teuthology.orchestra.run.smithi101.stdout: { 2023-08-01T19:55:21.827 INFO:teuthology.orchestra.run.smithi101.stdout: "event": "header_read", 2023-08-01T19:55:21.827 INFO:teuthology.orchestra.run.smithi101.stdout: "time": "2023-08-01T19:55:05.150909+0000", 2023-08-01T19:55:21.827 INFO:teuthology.orchestra.run.smithi101.stdout: "duration": 4294967295.999999 2023-08-01T19:55:21.827 INFO:teuthology.orchestra.run.smithi101.stdout: }, 2023-08-01T19:55:21.827 INFO:teuthology.orchestra.run.smithi101.stdout: { 2023-08-01T19:55:21.828 INFO:teuthology.orchestra.run.smithi101.stdout: "event": "all_read", 2023-08-01T19:55:21.828 INFO:teuthology.orchestra.run.smithi101.stdout: "time": "2023-08-01T19:55:05.150973+0000", 2023-08-01T19:55:21.828 INFO:teuthology.orchestra.run.smithi101.stdout: "duration": 6.4531999999999998e-05 2023-08-01T19:55:21.828 INFO:teuthology.orchestra.run.smithi101.stdout: }, 2023-08-01T19:55:21.828 INFO:teuthology.orchestra.run.smithi101.stdout: { 2023-08-01T19:55:21.828 INFO:teuthology.orchestra.run.smithi101.stdout: "event": "dispatched", 2023-08-01T19:55:21.828 INFO:teuthology.orchestra.run.smithi101.stdout: "time": "2023-08-01T19:55:05.150984+0000", 2023-08-01T19:55:21.828 INFO:teuthology.orchestra.run.smithi101.stdout: "duration": 1.0287e-05 2023-08-01T19:55:21.829 INFO:teuthology.orchestra.run.smithi101.stdout: }, 2023-08-01T19:55:21.829 INFO:teuthology.orchestra.run.smithi101.stdout: { 2023-08-01T19:55:21.829 INFO:teuthology.orchestra.run.smithi101.stdout: "event": "queued_for_pg", 2023-08-01T19:55:21.829 INFO:teuthology.orchestra.run.smithi101.stdout: "time": "2023-08-01T19:55:05.150989+0000", 2023-08-01T19:55:21.829 INFO:teuthology.orchestra.run.smithi101.stdout: "duration": 5.3929999999999999e-06 2023-08-01T19:55:21.829 INFO:teuthology.orchestra.run.smithi101.stdout: }, 2023-08-01T19:55:21.829 INFO:teuthology.orchestra.run.smithi101.stdout: { 2023-08-01T19:55:21.830 INFO:teuthology.orchestra.run.smithi101.stdout: "event": "reached_pg", 2023-08-01T19:55:21.830 INFO:teuthology.orchestra.run.smithi101.stdout: "time": "2023-08-01T19:55:05.151034+0000", 2023-08-01T19:55:21.830 INFO:teuthology.orchestra.run.smithi101.stdout: "duration": 4.4336999999999999e-05 2023-08-01T19:55:21.830 INFO:teuthology.orchestra.run.smithi101.stdout: }, 2023-08-01T19:55:21.830 INFO:teuthology.orchestra.run.smithi101.stdout: { 2023-08-01T19:55:21.830 INFO:teuthology.orchestra.run.smithi101.stdout: "event": "started", 2023-08-01T19:55:21.830 INFO:teuthology.orchestra.run.smithi101.stdout: "time": "2023-08-01T19:55:05.151167+0000", 2023-08-01T19:55:21.830 INFO:teuthology.orchestra.run.smithi101.stdout: "duration": 0.00013368899999999999 2023-08-01T19:55:21.831 INFO:teuthology.orchestra.run.smithi101.stdout: }, 2023-08-01T19:55:21.831 INFO:teuthology.orchestra.run.smithi101.stdout: { 2023-08-01T19:55:21.831 INFO:teuthology.orchestra.run.smithi101.stdout: "event": "waiting for subops from 2", 2023-08-01T19:55:21.831 INFO:teuthology.orchestra.run.smithi101.stdout: "time": "2023-08-01T19:55:05.151328+0000", 2023-08-01T19:55:21.831 INFO:teuthology.orchestra.run.smithi101.stdout: "duration": 0.00016122700000000001 2023-08-01T19:55:21.831 INFO:teuthology.orchestra.run.smithi101.stdout: }, 2023-08-01T19:55:21.831 INFO:teuthology.orchestra.run.smithi101.stdout: { 2023-08-01T19:55:21.831 INFO:teuthology.orchestra.run.smithi101.stdout: "event": "op_commit", 2023-08-01T19:55:21.832 INFO:teuthology.orchestra.run.smithi101.stdout: "time": "2023-08-01T19:55:05.156101+0000", 2023-08-01T19:55:21.832 INFO:teuthology.orchestra.run.smithi101.stdout: "duration": 0.0047724100000000004 2023-08-01T19:55:21.832 INFO:teuthology.orchestra.run.smithi101.stdout: }, 2023-08-01T19:55:21.832 INFO:teuthology.orchestra.run.smithi101.stdout: { 2023-08-01T19:55:21.832 INFO:teuthology.orchestra.run.smithi101.stdout: "event": "sub_op_commit_rec", 2023-08-01T19:55:21.832 INFO:teuthology.orchestra.run.smithi101.stdout: "time": "2023-08-01T19:55:05.223688+0000", 2023-08-01T19:55:21.832 INFO:teuthology.orchestra.run.smithi101.stdout: "duration": 0.067586937999999999 2023-08-01T19:55:21.833 INFO:teuthology.orchestra.run.smithi101.stdout: }, 2023-08-01T19:55:21.833 INFO:teuthology.orchestra.run.smithi101.stdout: { 2023-08-01T19:55:21.833 INFO:teuthology.orchestra.run.smithi101.stdout: "event": "commit_sent", 2023-08-01T19:55:21.833 INFO:teuthology.orchestra.run.smithi101.stdout: "time": "2023-08-01T19:55:05.223737+0000", 2023-08-01T19:55:21.833 INFO:teuthology.orchestra.run.smithi101.stdout: "duration": 4.8921999999999997e-05 2023-08-01T19:55:21.833 INFO:teuthology.orchestra.run.smithi101.stdout: }, 2023-08-01T19:55:21.833 INFO:teuthology.orchestra.run.smithi101.stdout: { 2023-08-01T19:55:21.833 INFO:teuthology.orchestra.run.smithi101.stdout: "event": "done", 2023-08-01T19:55:21.834 INFO:teuthology.orchestra.run.smithi101.stdout: "time": "2023-08-01T19:55:05.223774+0000", 2023-08-01T19:55:21.834 INFO:teuthology.orchestra.run.smithi101.stdout: "duration": 3.7342999999999998e-05 2023-08-01T19:55:21.834 INFO:teuthology.orchestra.run.smithi101.stdout: } 2023-08-01T19:55:21.834 INFO:teuthology.orchestra.run.smithi101.stdout: ] 2023-08-01T19:55:21.834 INFO:teuthology.orchestra.run.smithi101.stdout: } 2023-08-01T19:55:21.834 INFO:teuthology.orchestra.run.smithi101.stdout: }, 2023-08-01T19:55:21.834 INFO:teuthology.orchestra.run.smithi101.stdout: { 2023-08-01T19:55:21.834 INFO:teuthology.orchestra.run.smithi101.stdout: "description": "osd_op(client.4668.0:100253 5.f 5:f7bbce05:::benchmark_data_smithi006_114134_object100252:head [set-alloc-hint object_size 65536 write_size 65536,write 0~65536] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e37)", 2023-08-01T19:55:21.835 INFO:teuthology.orchestra.run.smithi101.stdout: "initiated_at": "2023-08-01T19:55:05.156562+0000", 2023-08-01T19:55:21.835 INFO:teuthology.orchestra.run.smithi101.stdout: "age": 16.56695405, 2023-08-01T19:55:21.835 INFO:teuthology.orchestra.run.smithi101.stdout: "duration": 0.068677503000000001, 2023-08-01T19:55:21.835 INFO:teuthology.orchestra.run.smithi101.stdout: "type_data": { 2023-08-01T19:55:21.835 INFO:teuthology.orchestra.run.smithi101.stdout: "flag_point": "commit sent; apply or cleanup", 2023-08-01T19:55:21.835 INFO:teuthology.orchestra.run.smithi101.stdout: "client_info": { 2023-08-01T19:55:21.835 INFO:teuthology.orchestra.run.smithi101.stdout: "client": "client.4668", 2023-08-01T19:55:21.836 INFO:teuthology.orchestra.run.smithi101.stdout: "client_addr": "172.21.15.6:0/1709472247", 2023-08-01T19:55:21.836 INFO:teuthology.orchestra.run.smithi101.stdout: "tid": 100253 2023-08-01T19:55:21.836 INFO:teuthology.orchestra.run.smithi101.stdout: }, 2023-08-01T19:55:21.836 INFO:teuthology.orchestra.run.smithi101.stdout: "events": [ 2023-08-01T19:55:21.836 INFO:teuthology.orchestra.run.smithi101.stdout: { 2023-08-01T19:55:21.836 INFO:teuthology.orchestra.run.smithi101.stdout: "event": "initiated", 2023-08-01T19:55:21.836 INFO:teuthology.orchestra.run.smithi101.stdout: "time": "2023-08-01T19:55:05.156562+0000", 2023-08-01T19:55:21.836 INFO:teuthology.orchestra.run.smithi101.stdout: "duration": 0 2023-08-01T19:55:21.837 INFO:teuthology.orchestra.run.smithi101.stdout: }, 2023-08-01T19:55:21.837 INFO:teuthology.orchestra.run.smithi101.stdout: { 2023-08-01T19:55:21.837 INFO:teuthology.orchestra.run.smithi101.stdout: "event": "throttled", 2023-08-01T19:55:21.837 INFO:teuthology.orchestra.run.smithi101.stdout: "time": "2023-08-01T19:55:05.156562+0000", 2023-08-01T19:55:21.837 INFO:teuthology.orchestra.run.smithi101.stdout: "duration": 0 2023-08-01T19:55:21.837 INFO:teuthology.orchestra.run.smithi101.stdout: }, 2023-08-01T19:55:21.837 INFO:teuthology.orchestra.run.smithi101.stdout: { 2023-08-01T19:55:21.837 INFO:teuthology.orchestra.run.smithi101.stdout: "event": "header_read", 2023-08-01T19:55:21.838 INFO:teuthology.orchestra.run.smithi101.stdout: "time": "2023-08-01T19:55:05.156561+0000", 2023-08-01T19:55:21.838 INFO:teuthology.orchestra.run.smithi101.stdout: "duration": 4294967295.999999 2023-08-01T19:55:21.838 INFO:teuthology.orchestra.run.smithi101.stdout: }, 2023-08-01T19:55:21.838 INFO:teuthology.orchestra.run.smithi101.stdout: { 2023-08-01T19:55:21.838 INFO:teuthology.orchestra.run.smithi101.stdout: "event": "all_read", 2023-08-01T19:55:21.838 INFO:teuthology.orchestra.run.smithi101.stdout: "time": "2023-08-01T19:55:05.156655+0000", 2023-08-01T19:55:21.838 INFO:teuthology.orchestra.run.smithi101.stdout: "duration": 9.4018999999999995e-05 2023-08-01T19:55:21.838 INFO:teuthology.orchestra.run.smithi101.stdout: }, 2023-08-01T19:55:21.839 INFO:teuthology.orchestra.run.smithi101.stdout: { 2023-08-01T19:55:21.839 INFO:teuthology.orchestra.run.smithi101.stdout: "event": "dispatched", 2023-08-01T19:55:21.839 INFO:teuthology.orchestra.run.smithi101.stdout: "time": "2023-08-01T19:55:05.156664+0000", 2023-08-01T19:55:21.839 INFO:teuthology.orchestra.run.smithi101.stdout: "duration": 9.4970000000000007e-06 2023-08-01T19:55:21.839 INFO:teuthology.orchestra.run.smithi101.stdout: }, 2023-08-01T19:55:21.839 INFO:teuthology.orchestra.run.smithi101.stdout: { 2023-08-01T19:55:21.839 INFO:teuthology.orchestra.run.smithi101.stdout: "event": "queued_for_pg", 2023-08-01T19:55:21.839 INFO:teuthology.orchestra.run.smithi101.stdout: "time": "2023-08-01T19:55:05.156671+0000", 2023-08-01T19:55:21.840 INFO:teuthology.orchestra.run.smithi101.stdout: "duration": 6.1929999999999998e-06 2023-08-01T19:55:21.840 INFO:teuthology.orchestra.run.smithi101.stdout: }, 2023-08-01T19:55:21.840 INFO:teuthology.orchestra.run.smithi101.stdout: { 2023-08-01T19:55:21.840 INFO:teuthology.orchestra.run.smithi101.stdout: "event": "reached_pg", 2023-08-01T19:55:21.840 INFO:teuthology.orchestra.run.smithi101.stdout: "time": "2023-08-01T19:55:05.156742+0000", 2023-08-01T19:55:21.840 INFO:teuthology.orchestra.run.smithi101.stdout: "duration": 7.1181999999999997e-05 2023-08-01T19:55:21.840 INFO:teuthology.orchestra.run.smithi101.stdout: }, 2023-08-01T19:55:21.841 INFO:teuthology.orchestra.run.smithi101.stdout: { 2023-08-01T19:55:21.841 INFO:teuthology.orchestra.run.smithi101.stdout: "event": "started", 2023-08-01T19:55:21.841 INFO:teuthology.orchestra.run.smithi101.stdout: "time": "2023-08-01T19:55:05.156839+0000", 2023-08-01T19:55:21.841 INFO:teuthology.orchestra.run.smithi101.stdout: "duration": 9.7182000000000006e-05 2023-08-01T19:55:21.841 INFO:teuthology.orchestra.run.smithi101.stdout: }, 2023-08-01T19:55:21.841 INFO:teuthology.orchestra.run.smithi101.stdout: { 2023-08-01T19:55:21.841 INFO:teuthology.orchestra.run.smithi101.stdout: "event": "waiting for subops from 2", 2023-08-01T19:55:21.841 INFO:teuthology.orchestra.run.smithi101.stdout: "time": "2023-08-01T19:55:05.156925+0000", 2023-08-01T19:55:21.842 INFO:teuthology.orchestra.run.smithi101.stdout: "duration": 8.5816000000000006e-05 2023-08-01T19:55:21.842 INFO:teuthology.orchestra.run.smithi101.stdout: }, 2023-08-01T19:55:21.842 INFO:teuthology.orchestra.run.smithi101.stdout: { 2023-08-01T19:55:21.842 INFO:teuthology.orchestra.run.smithi101.stdout: "event": "op_commit", 2023-08-01T19:55:21.842 INFO:teuthology.orchestra.run.smithi101.stdout: "time": "2023-08-01T19:55:05.160082+0000", 2023-08-01T19:55:21.842 INFO:teuthology.orchestra.run.smithi101.stdout: "duration": 0.0031573959999999998 2023-08-01T19:55:21.842 INFO:teuthology.orchestra.run.smithi101.stdout: }, 2023-08-01T19:55:21.842 INFO:teuthology.orchestra.run.smithi101.stdout: { 2023-08-01T19:55:21.843 INFO:teuthology.orchestra.run.smithi101.stdout: "event": "sub_op_commit_rec", 2023-08-01T19:55:21.843 INFO:teuthology.orchestra.run.smithi101.stdout: "time": "2023-08-01T19:55:05.225162+0000", 2023-08-01T19:55:21.843 INFO:teuthology.orchestra.run.smithi101.stdout: "duration": 0.065079466000000002 2023-08-01T19:55:21.843 INFO:teuthology.orchestra.run.smithi101.stdout: }, 2023-08-01T19:55:21.843 INFO:teuthology.orchestra.run.smithi101.stdout: { 2023-08-01T19:55:21.843 INFO:teuthology.orchestra.run.smithi101.stdout: "event": "commit_sent", 2023-08-01T19:55:21.843 INFO:teuthology.orchestra.run.smithi101.stdout: "time": "2023-08-01T19:55:05.225205+0000", 2023-08-01T19:55:21.843 INFO:teuthology.orchestra.run.smithi101.stdout: "duration": 4.3446999999999999e-05 2023-08-01T19:55:21.844 INFO:teuthology.orchestra.run.smithi101.stdout: }, 2023-08-01T19:55:21.844 INFO:teuthology.orchestra.run.smithi101.stdout: { 2023-08-01T19:55:21.844 INFO:teuthology.orchestra.run.smithi101.stdout: "event": "done", 2023-08-01T19:55:21.844 INFO:teuthology.orchestra.run.smithi101.stdout: "time": "2023-08-01T19:55:05.225239+0000", 2023-08-01T19:55:21.844 INFO:teuthology.orchestra.run.smithi101.stdout: "duration": 3.4121000000000001e-05 2023-08-01T19:55:21.844 INFO:teuthology.orchestra.run.smithi101.stdout: } 2023-08-01T19:55:21.844 INFO:teuthology.orchestra.run.smithi101.stdout: ] 2023-08-01T19:55:21.844 INFO:teuthology.orchestra.run.smithi101.stdout: } 2023-08-01T19:55:21.845 INFO:teuthology.orchestra.run.smithi101.stdout: }, 2023-08-01T19:55:21.845 INFO:teuthology.orchestra.run.smithi101.stdout: { 2023-08-01T19:55:21.845 INFO:teuthology.orchestra.run.smithi101.stdout: "description": "osd_op(client.4668.0:100928 5.7 5:e61a7dfa:::benchmark_data_smithi006_114134_object100927:head [set-alloc-hint object_size 65536 write_size 65536,write 0~65536] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e37)", 2023-08-01T19:55:21.845 INFO:teuthology.orchestra.run.smithi101.stdout: "initiated_at": "2023-08-01T19:55:05.564731+0000", 2023-08-01T19:55:21.845 INFO:teuthology.orchestra.run.smithi101.stdout: "age": 16.158784558000001, 2023-08-01T19:55:21.845 INFO:teuthology.orchestra.run.smithi101.stdout: "duration": 0.064686603999999995, 2023-08-01T19:55:21.845 INFO:teuthology.orchestra.run.smithi101.stdout: "type_data": { 2023-08-01T19:55:21.846 INFO:teuthology.orchestra.run.smithi101.stdout: "flag_point": "commit sent; apply or cleanup", 2023-08-01T19:55:21.846 INFO:teuthology.orchestra.run.smithi101.stdout: "client_info": { 2023-08-01T19:55:21.846 INFO:teuthology.orchestra.run.smithi101.stdout: "client": "client.4668", 2023-08-01T19:55:21.846 INFO:teuthology.orchestra.run.smithi101.stdout: "client_addr": "172.21.15.6:0/1709472247", 2023-08-01T19:55:21.846 INFO:teuthology.orchestra.run.smithi101.stdout: "tid": 100928 2023-08-01T19:55:21.846 INFO:teuthology.orchestra.run.smithi101.stdout: }, 2023-08-01T19:55:21.846 INFO:teuthology.orchestra.run.smithi101.stdout: "events": [ 2023-08-01T19:55:21.847 INFO:teuthology.orchestra.run.smithi101.stdout: { 2023-08-01T19:55:21.847 INFO:teuthology.orchestra.run.smithi101.stdout: "event": "initiated", 2023-08-01T19:55:21.847 INFO:teuthology.orchestra.run.smithi101.stdout: "time": "2023-08-01T19:55:05.564731+0000", 2023-08-01T19:55:21.847 INFO:teuthology.orchestra.run.smithi101.stdout: "duration": 0 2023-08-01T19:55:21.847 INFO:teuthology.orchestra.run.smithi101.stdout: }, 2023-08-01T19:55:21.847 INFO:teuthology.orchestra.run.smithi101.stdout: { 2023-08-01T19:55:21.847 INFO:teuthology.orchestra.run.smithi101.stdout: "event": "throttled", 2023-08-01T19:55:21.847 INFO:teuthology.orchestra.run.smithi101.stdout: "time": "2023-08-01T19:55:05.564731+0000", 2023-08-01T19:55:21.848 INFO:teuthology.orchestra.run.smithi101.stdout: "duration": 0 2023-08-01T19:55:21.848 INFO:teuthology.orchestra.run.smithi101.stdout: }, 2023-08-01T19:55:21.848 INFO:teuthology.orchestra.run.smithi101.stdout: { 2023-08-01T19:55:21.848 INFO:teuthology.orchestra.run.smithi101.stdout: "event": "header_read", 2023-08-01T19:55:21.848 INFO:teuthology.orchestra.run.smithi101.stdout: "time": "2023-08-01T19:55:05.564731+0000", 2023-08-01T19:55:21.848 INFO:teuthology.orchestra.run.smithi101.stdout: "duration": 4294967295.999999 2023-08-01T19:55:21.848 INFO:teuthology.orchestra.run.smithi101.stdout: }, 2023-08-01T19:55:21.849 INFO:teuthology.orchestra.run.smithi101.stdout: { 2023-08-01T19:55:21.849 INFO:teuthology.orchestra.run.smithi101.stdout: "event": "all_read", 2023-08-01T19:55:21.849 INFO:teuthology.orchestra.run.smithi101.stdout: "time": "2023-08-01T19:55:05.564832+0000", 2023-08-01T19:55:21.849 INFO:teuthology.orchestra.run.smithi101.stdout: "duration": 0.000101752 2023-08-01T19:55:21.849 INFO:teuthology.orchestra.run.smithi101.stdout: }, 2023-08-01T19:55:21.849 INFO:teuthology.orchestra.run.smithi101.stdout: { 2023-08-01T19:55:21.849 INFO:teuthology.orchestra.run.smithi101.stdout: "event": "dispatched", 2023-08-01T19:55:21.849 INFO:teuthology.orchestra.run.smithi101.stdout: "time": "2023-08-01T19:55:05.564840+0000", 2023-08-01T19:55:21.850 INFO:teuthology.orchestra.run.smithi101.stdout: "duration": 7.8590000000000005e-06 2023-08-01T19:55:21.850 INFO:teuthology.orchestra.run.smithi101.stdout: }, 2023-08-01T19:55:21.850 INFO:teuthology.orchestra.run.smithi101.stdout: { 2023-08-01T19:55:21.850 INFO:teuthology.orchestra.run.smithi101.stdout: "event": "queued_for_pg", 2023-08-01T19:55:21.850 INFO:teuthology.orchestra.run.smithi101.stdout: "time": "2023-08-01T19:55:05.564845+0000", 2023-08-01T19:55:21.850 INFO:teuthology.orchestra.run.smithi101.stdout: "duration": 4.9189999999999998e-06 2023-08-01T19:55:21.850 INFO:teuthology.orchestra.run.smithi101.stdout: }, 2023-08-01T19:55:21.851 INFO:teuthology.orchestra.run.smithi101.stdout: { 2023-08-01T19:55:21.851 INFO:teuthology.orchestra.run.smithi101.stdout: "event": "reached_pg", 2023-08-01T19:55:21.851 INFO:teuthology.orchestra.run.smithi101.stdout: "time": "2023-08-01T19:55:05.564883+0000", 2023-08-01T19:55:21.851 INFO:teuthology.orchestra.run.smithi101.stdout: "duration": 3.7481999999999998e-05 2023-08-01T19:55:21.851 INFO:teuthology.orchestra.run.smithi101.stdout: }, 2023-08-01T19:55:21.851 INFO:teuthology.orchestra.run.smithi101.stdout: { 2023-08-01T19:55:21.851 INFO:teuthology.orchestra.run.smithi101.stdout: "event": "started", 2023-08-01T19:55:21.852 INFO:teuthology.orchestra.run.smithi101.stdout: "time": "2023-08-01T19:55:05.564968+0000", 2023-08-01T19:55:21.852 INFO:teuthology.orchestra.run.smithi101.stdout: "duration": 8.5494999999999994e-05 2023-08-01T19:55:21.852 INFO:teuthology.orchestra.run.smithi101.stdout: }, 2023-08-01T19:55:21.852 INFO:teuthology.orchestra.run.smithi101.stdout: { 2023-08-01T19:55:21.852 INFO:teuthology.orchestra.run.smithi101.stdout: "event": "waiting for subops from 0", 2023-08-01T19:55:21.852 INFO:teuthology.orchestra.run.smithi101.stdout: "time": "2023-08-01T19:55:05.565062+0000", 2023-08-01T19:55:21.852 INFO:teuthology.orchestra.run.smithi101.stdout: "duration": 9.3478000000000002e-05 2023-08-01T19:55:21.852 INFO:teuthology.orchestra.run.smithi101.stdout: }, 2023-08-01T19:55:21.853 INFO:teuthology.orchestra.run.smithi101.stdout: { 2023-08-01T19:55:21.853 INFO:teuthology.orchestra.run.smithi101.stdout: "event": "op_commit", 2023-08-01T19:55:21.853 INFO:teuthology.orchestra.run.smithi101.stdout: "time": "2023-08-01T19:55:05.572061+0000", 2023-08-01T19:55:21.853 INFO:teuthology.orchestra.run.smithi101.stdout: "duration": 0.0069998250000000003 2023-08-01T19:55:21.853 INFO:teuthology.orchestra.run.smithi101.stdout: }, 2023-08-01T19:55:21.853 INFO:teuthology.orchestra.run.smithi101.stdout: { 2023-08-01T19:55:21.853 INFO:teuthology.orchestra.run.smithi101.stdout: "event": "sub_op_commit_rec", 2023-08-01T19:55:21.853 INFO:teuthology.orchestra.run.smithi101.stdout: "time": "2023-08-01T19:55:05.629362+0000", 2023-08-01T19:55:21.854 INFO:teuthology.orchestra.run.smithi101.stdout: "duration": 0.057300691000000001 2023-08-01T19:55:21.854 INFO:teuthology.orchestra.run.smithi101.stdout: }, 2023-08-01T19:55:21.854 INFO:teuthology.orchestra.run.smithi101.stdout: { 2023-08-01T19:55:21.854 INFO:teuthology.orchestra.run.smithi101.stdout: "event": "commit_sent", 2023-08-01T19:55:21.854 INFO:teuthology.orchestra.run.smithi101.stdout: "time": "2023-08-01T19:55:05.629395+0000", 2023-08-01T19:55:21.854 INFO:teuthology.orchestra.run.smithi101.stdout: "duration": 3.3124000000000003e-05 2023-08-01T19:55:21.854 INFO:teuthology.orchestra.run.smithi101.stdout: }, 2023-08-01T19:55:21.854 INFO:teuthology.orchestra.run.smithi101.stdout: { 2023-08-01T19:55:21.855 INFO:teuthology.orchestra.run.smithi101.stdout: "event": "done", 2023-08-01T19:55:21.855 INFO:teuthology.orchestra.run.smithi101.stdout: "time": "2023-08-01T19:55:05.629418+0000", 2023-08-01T19:55:21.855 INFO:teuthology.orchestra.run.smithi101.stdout: "duration": 2.2697999999999999e-05 2023-08-01T19:55:21.855 INFO:teuthology.orchestra.run.smithi101.stdout: } 2023-08-01T19:55:21.855 INFO:teuthology.orchestra.run.smithi101.stdout: ] 2023-08-01T19:55:21.855 INFO:teuthology.orchestra.run.smithi101.stdout: } 2023-08-01T19:55:21.855 INFO:teuthology.orchestra.run.smithi101.stdout: }, 2023-08-01T19:55:21.855 INFO:teuthology.orchestra.run.smithi101.stdout: { 2023-08-01T19:55:21.856 INFO:teuthology.orchestra.run.smithi101.stdout: "description": "osd_op(client.4668.0:100936 5.1 5:8f4e3576:::benchmark_data_smithi006_114134_object100935:head [set-alloc-hint object_size 65536 write_size 65536,write 0~65536] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e37)", 2023-08-01T19:55:21.856 INFO:teuthology.orchestra.run.smithi101.stdout: "initiated_at": "2023-08-01T19:55:05.567147+0000", 2023-08-01T19:55:21.856 INFO:teuthology.orchestra.run.smithi101.stdout: "age": 16.156369032000001, 2023-08-01T19:55:21.856 INFO:teuthology.orchestra.run.smithi101.stdout: "duration": 0.063466380000000003, 2023-08-01T19:55:21.856 INFO:teuthology.orchestra.run.smithi101.stdout: "type_data": { 2023-08-01T19:55:21.856 INFO:teuthology.orchestra.run.smithi101.stdout: "flag_point": "commit sent; apply or cleanup", 2023-08-01T19:55:21.856 INFO:teuthology.orchestra.run.smithi101.stdout: "client_info": { 2023-08-01T19:55:21.857 INFO:teuthology.orchestra.run.smithi101.stdout: "client": "client.4668", 2023-08-01T19:55:21.857 INFO:teuthology.orchestra.run.smithi101.stdout: "client_addr": "172.21.15.6:0/1709472247", 2023-08-01T19:55:21.857 INFO:teuthology.orchestra.run.smithi101.stdout: "tid": 100936 2023-08-01T19:55:21.857 INFO:teuthology.orchestra.run.smithi101.stdout: }, 2023-08-01T19:55:21.857 INFO:teuthology.orchestra.run.smithi101.stdout: "events": [ 2023-08-01T19:55:21.857 INFO:teuthology.orchestra.run.smithi101.stdout: { 2023-08-01T19:55:21.857 INFO:teuthology.orchestra.run.smithi101.stdout: "event": "initiated", 2023-08-01T19:55:21.857 INFO:teuthology.orchestra.run.smithi101.stdout: "time": "2023-08-01T19:55:05.567147+0000", 2023-08-01T19:55:21.858 INFO:teuthology.orchestra.run.smithi101.stdout: "duration": 0 2023-08-01T19:55:21.858 INFO:teuthology.orchestra.run.smithi101.stdout: }, 2023-08-01T19:55:21.858 INFO:teuthology.orchestra.run.smithi101.stdout: { 2023-08-01T19:55:21.858 INFO:teuthology.orchestra.run.smithi101.stdout: "event": "throttled", 2023-08-01T19:55:21.858 INFO:teuthology.orchestra.run.smithi101.stdout: "time": "2023-08-01T19:55:05.567147+0000", 2023-08-01T19:55:21.858 INFO:teuthology.orchestra.run.smithi101.stdout: "duration": 0 2023-08-01T19:55:21.858 INFO:teuthology.orchestra.run.smithi101.stdout: }, 2023-08-01T19:55:21.858 INFO:teuthology.orchestra.run.smithi101.stdout: { 2023-08-01T19:55:21.859 INFO:teuthology.orchestra.run.smithi101.stdout: "event": "header_read", 2023-08-01T19:55:21.859 INFO:teuthology.orchestra.run.smithi101.stdout: "time": "2023-08-01T19:55:05.567146+0000", 2023-08-01T19:55:21.859 INFO:teuthology.orchestra.run.smithi101.stdout: "duration": 4294967295.999999 2023-08-01T19:55:21.859 INFO:teuthology.orchestra.run.smithi101.stdout: }, 2023-08-01T19:55:21.859 INFO:teuthology.orchestra.run.smithi101.stdout: { 2023-08-01T19:55:21.859 INFO:teuthology.orchestra.run.smithi101.stdout: "event": "all_read", 2023-08-01T19:55:21.859 INFO:teuthology.orchestra.run.smithi101.stdout: "time": "2023-08-01T19:55:05.567224+0000", 2023-08-01T19:55:21.860 INFO:teuthology.orchestra.run.smithi101.stdout: "duration": 7.8460000000000004e-05 2023-08-01T19:55:21.860 INFO:teuthology.orchestra.run.smithi101.stdout: }, 2023-08-01T19:55:21.860 INFO:teuthology.orchestra.run.smithi101.stdout: { 2023-08-01T19:55:21.860 INFO:teuthology.orchestra.run.smithi101.stdout: "event": "dispatched", 2023-08-01T19:55:21.860 INFO:teuthology.orchestra.run.smithi101.stdout: "time": "2023-08-01T19:55:05.567234+0000", 2023-08-01T19:55:21.860 INFO:teuthology.orchestra.run.smithi101.stdout: "duration": 9.7110000000000007e-06 2023-08-01T19:55:21.860 INFO:teuthology.orchestra.run.smithi101.stdout: }, 2023-08-01T19:55:21.860 INFO:teuthology.orchestra.run.smithi101.stdout: { 2023-08-01T19:55:21.861 INFO:teuthology.orchestra.run.smithi101.stdout: "event": "queued_for_pg", 2023-08-01T19:55:21.861 INFO:teuthology.orchestra.run.smithi101.stdout: "time": "2023-08-01T19:55:05.567239+0000", 2023-08-01T19:55:21.861 INFO:teuthology.orchestra.run.smithi101.stdout: "duration": 5.237e-06 2023-08-01T19:55:21.861 INFO:teuthology.orchestra.run.smithi101.stdout: }, 2023-08-01T19:55:21.861 INFO:teuthology.orchestra.run.smithi101.stdout: { 2023-08-01T19:55:21.861 INFO:teuthology.orchestra.run.smithi101.stdout: "event": "reached_pg", 2023-08-01T19:55:21.861 INFO:teuthology.orchestra.run.smithi101.stdout: "time": "2023-08-01T19:55:05.567278+0000", 2023-08-01T19:55:21.862 INFO:teuthology.orchestra.run.smithi101.stdout: "duration": 3.9069999999999997e-05 2023-08-01T19:55:21.862 INFO:teuthology.orchestra.run.smithi101.stdout: }, 2023-08-01T19:55:21.862 INFO:teuthology.orchestra.run.smithi101.stdout: { 2023-08-01T19:55:21.862 INFO:teuthology.orchestra.run.smithi101.stdout: "event": "started", 2023-08-01T19:55:21.862 INFO:teuthology.orchestra.run.smithi101.stdout: "time": "2023-08-01T19:55:05.567402+0000", 2023-08-01T19:55:21.862 INFO:teuthology.orchestra.run.smithi101.stdout: "duration": 0.00012348700000000001 2023-08-01T19:55:21.862 INFO:teuthology.orchestra.run.smithi101.stdout: }, 2023-08-01T19:55:21.862 INFO:teuthology.orchestra.run.smithi101.stdout: { 2023-08-01T19:55:21.863 INFO:teuthology.orchestra.run.smithi101.stdout: "event": "waiting for subops from 0", 2023-08-01T19:55:21.863 INFO:teuthology.orchestra.run.smithi101.stdout: "time": "2023-08-01T19:55:05.567558+0000", 2023-08-01T19:55:21.863 INFO:teuthology.orchestra.run.smithi101.stdout: "duration": 0.000156179 2023-08-01T19:55:21.863 INFO:teuthology.orchestra.run.smithi101.stdout: }, 2023-08-01T19:55:21.863 INFO:teuthology.orchestra.run.smithi101.stdout: { 2023-08-01T19:55:21.863 INFO:teuthology.orchestra.run.smithi101.stdout: "event": "op_commit", 2023-08-01T19:55:21.863 INFO:teuthology.orchestra.run.smithi101.stdout: "time": "2023-08-01T19:55:05.573767+0000", 2023-08-01T19:55:21.864 INFO:teuthology.orchestra.run.smithi101.stdout: "duration": 0.0062092409999999999 2023-08-01T19:55:21.864 INFO:teuthology.orchestra.run.smithi101.stdout: }, 2023-08-01T19:55:21.864 INFO:teuthology.orchestra.run.smithi101.stdout: { 2023-08-01T19:55:21.864 INFO:teuthology.orchestra.run.smithi101.stdout: "event": "sub_op_commit_rec", 2023-08-01T19:55:21.864 INFO:teuthology.orchestra.run.smithi101.stdout: "time": "2023-08-01T19:55:05.630531+0000", 2023-08-01T19:55:21.864 INFO:teuthology.orchestra.run.smithi101.stdout: "duration": 0.056763409000000001 2023-08-01T19:55:21.864 INFO:teuthology.orchestra.run.smithi101.stdout: }, 2023-08-01T19:55:21.864 INFO:teuthology.orchestra.run.smithi101.stdout: { 2023-08-01T19:55:21.865 INFO:teuthology.orchestra.run.smithi101.stdout: "event": "commit_sent", 2023-08-01T19:55:21.865 INFO:teuthology.orchestra.run.smithi101.stdout: "time": "2023-08-01T19:55:05.630577+0000", 2023-08-01T19:55:21.865 INFO:teuthology.orchestra.run.smithi101.stdout: "duration": 4.6588000000000002e-05 2023-08-01T19:55:21.865 INFO:teuthology.orchestra.run.smithi101.stdout: }, 2023-08-01T19:55:21.865 INFO:teuthology.orchestra.run.smithi101.stdout: { 2023-08-01T19:55:21.865 INFO:teuthology.orchestra.run.smithi101.stdout: "event": "done", 2023-08-01T19:55:21.865 INFO:teuthology.orchestra.run.smithi101.stdout: "time": "2023-08-01T19:55:05.630613+0000", 2023-08-01T19:55:21.865 INFO:teuthology.orchestra.run.smithi101.stdout: "duration": 3.5802e-05 2023-08-01T19:55:21.866 INFO:teuthology.orchestra.run.smithi101.stdout: } 2023-08-01T19:55:21.866 INFO:teuthology.orchestra.run.smithi101.stdout: ] 2023-08-01T19:55:21.866 INFO:teuthology.orchestra.run.smithi101.stdout: } 2023-08-01T19:55:21.866 INFO:teuthology.orchestra.run.smithi101.stdout: }, 2023-08-01T19:55:21.866 INFO:teuthology.orchestra.run.smithi101.stdout: { 2023-08-01T19:55:21.866 INFO:teuthology.orchestra.run.smithi101.stdout: "description": "osd_op(client.4668.0:100943 5.7 5:e01743fe:::benchmark_data_smithi006_114134_object100942:head [set-alloc-hint object_size 65536 write_size 65536,write 0~65536] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e37)", 2023-08-01T19:55:21.866 INFO:teuthology.orchestra.run.smithi101.stdout: "initiated_at": "2023-08-01T19:55:05.574724+0000", 2023-08-01T19:55:21.866 INFO:teuthology.orchestra.run.smithi101.stdout: "age": 16.148791938999999, 2023-08-01T19:55:21.867 INFO:teuthology.orchestra.run.smithi101.stdout: "duration": 0.058761188999999998, 2023-08-01T19:55:21.867 INFO:teuthology.orchestra.run.smithi101.stdout: "type_data": { 2023-08-01T19:55:21.867 INFO:teuthology.orchestra.run.smithi101.stdout: "flag_point": "commit sent; apply or cleanup", 2023-08-01T19:55:21.867 INFO:teuthology.orchestra.run.smithi101.stdout: "client_info": { 2023-08-01T19:55:21.867 INFO:teuthology.orchestra.run.smithi101.stdout: "client": "client.4668", 2023-08-01T19:55:21.867 INFO:teuthology.orchestra.run.smithi101.stdout: "client_addr": "172.21.15.6:0/1709472247", 2023-08-01T19:55:21.867 INFO:teuthology.orchestra.run.smithi101.stdout: "tid": 100943 2023-08-01T19:55:21.867 INFO:teuthology.orchestra.run.smithi101.stdout: }, 2023-08-01T19:55:21.868 INFO:teuthology.orchestra.run.smithi101.stdout: "events": [ 2023-08-01T19:55:21.868 INFO:teuthology.orchestra.run.smithi101.stdout: { 2023-08-01T19:55:21.868 INFO:teuthology.orchestra.run.smithi101.stdout: "event": "initiated", 2023-08-01T19:55:21.868 INFO:teuthology.orchestra.run.smithi101.stdout: "time": "2023-08-01T19:55:05.574724+0000", 2023-08-01T19:55:21.868 INFO:teuthology.orchestra.run.smithi101.stdout: "duration": 0 2023-08-01T19:55:21.868 INFO:teuthology.orchestra.run.smithi101.stdout: }, 2023-08-01T19:55:21.868 INFO:teuthology.orchestra.run.smithi101.stdout: { 2023-08-01T19:55:21.869 INFO:teuthology.orchestra.run.smithi101.stdout: "event": "throttled", 2023-08-01T19:55:21.869 INFO:teuthology.orchestra.run.smithi101.stdout: "time": "2023-08-01T19:55:05.574724+0000", 2023-08-01T19:55:21.869 INFO:teuthology.orchestra.run.smithi101.stdout: "duration": 0 2023-08-01T19:55:21.869 INFO:teuthology.orchestra.run.smithi101.stdout: }, 2023-08-01T19:55:21.869 INFO:teuthology.orchestra.run.smithi101.stdout: { 2023-08-01T19:55:21.869 INFO:teuthology.orchestra.run.smithi101.stdout: "event": "header_read", 2023-08-01T19:55:21.869 INFO:teuthology.orchestra.run.smithi101.stdout: "time": "2023-08-01T19:55:05.574723+0000", 2023-08-01T19:55:21.869 INFO:teuthology.orchestra.run.smithi101.stdout: "duration": 4294967295.999999 2023-08-01T19:55:21.870 INFO:teuthology.orchestra.run.smithi101.stdout: }, 2023-08-01T19:55:21.870 INFO:teuthology.orchestra.run.smithi101.stdout: { 2023-08-01T19:55:21.870 INFO:teuthology.orchestra.run.smithi101.stdout: "event": "all_read", 2023-08-01T19:55:21.870 INFO:teuthology.orchestra.run.smithi101.stdout: "time": "2023-08-01T19:55:05.574773+0000", 2023-08-01T19:55:21.870 INFO:teuthology.orchestra.run.smithi101.stdout: "duration": 4.9469999999999999e-05 2023-08-01T19:55:21.870 INFO:teuthology.orchestra.run.smithi101.stdout: }, 2023-08-01T19:55:21.870 INFO:teuthology.orchestra.run.smithi101.stdout: { 2023-08-01T19:55:21.870 INFO:teuthology.orchestra.run.smithi101.stdout: "event": "dispatched", 2023-08-01T19:55:21.871 INFO:teuthology.orchestra.run.smithi101.stdout: "time": "2023-08-01T19:55:05.574780+0000", 2023-08-01T19:55:21.871 INFO:teuthology.orchestra.run.smithi101.stdout: "duration": 7.5059999999999998e-06 2023-08-01T19:55:21.871 INFO:teuthology.orchestra.run.smithi101.stdout: }, 2023-08-01T19:55:21.871 INFO:teuthology.orchestra.run.smithi101.stdout: { 2023-08-01T19:55:21.871 INFO:teuthology.orchestra.run.smithi101.stdout: "event": "queued_for_pg", 2023-08-01T19:55:21.871 INFO:teuthology.orchestra.run.smithi101.stdout: "time": "2023-08-01T19:55:05.574784+0000", 2023-08-01T19:55:21.871 INFO:teuthology.orchestra.run.smithi101.stdout: "duration": 3.5540000000000002e-06 2023-08-01T19:55:21.871 INFO:teuthology.orchestra.run.smithi101.stdout: }, 2023-08-01T19:55:21.872 INFO:teuthology.orchestra.run.smithi101.stdout: { 2023-08-01T19:55:21.872 INFO:teuthology.orchestra.run.smithi101.stdout: "event": "reached_pg", 2023-08-01T19:55:21.872 INFO:teuthology.orchestra.run.smithi101.stdout: "time": "2023-08-01T19:55:05.574805+0000", 2023-08-01T19:55:21.872 INFO:teuthology.orchestra.run.smithi101.stdout: "duration": 2.1257999999999999e-05 2023-08-01T19:55:21.872 INFO:teuthology.orchestra.run.smithi101.stdout: }, 2023-08-01T19:55:21.872 INFO:teuthology.orchestra.run.smithi101.stdout: { 2023-08-01T19:55:21.872 INFO:teuthology.orchestra.run.smithi101.stdout: "event": "started", 2023-08-01T19:55:21.873 INFO:teuthology.orchestra.run.smithi101.stdout: "time": "2023-08-01T19:55:05.574886+0000", 2023-08-01T19:55:21.873 INFO:teuthology.orchestra.run.smithi101.stdout: "duration": 8.1545999999999995e-05 2023-08-01T19:55:21.873 INFO:teuthology.orchestra.run.smithi101.stdout: }, 2023-08-01T19:55:21.873 INFO:teuthology.orchestra.run.smithi101.stdout: { 2023-08-01T19:55:21.873 INFO:teuthology.orchestra.run.smithi101.stdout: "event": "waiting for subops from 0", 2023-08-01T19:55:21.873 INFO:teuthology.orchestra.run.smithi101.stdout: "time": "2023-08-01T19:55:05.574973+0000", 2023-08-01T19:55:21.873 INFO:teuthology.orchestra.run.smithi101.stdout: "duration": 8.6998999999999998e-05 2023-08-01T19:55:21.873 INFO:teuthology.orchestra.run.smithi101.stdout: }, 2023-08-01T19:55:21.874 INFO:teuthology.orchestra.run.smithi101.stdout: { 2023-08-01T19:55:21.874 INFO:teuthology.orchestra.run.smithi101.stdout: "event": "op_commit", 2023-08-01T19:55:21.874 INFO:teuthology.orchestra.run.smithi101.stdout: "time": "2023-08-01T19:55:05.581580+0000", 2023-08-01T19:55:21.874 INFO:teuthology.orchestra.run.smithi101.stdout: "duration": 0.0066068790000000004 2023-08-01T19:55:21.874 INFO:teuthology.orchestra.run.smithi101.stdout: }, 2023-08-01T19:55:21.874 INFO:teuthology.orchestra.run.smithi101.stdout: { 2023-08-01T19:55:21.874 INFO:teuthology.orchestra.run.smithi101.stdout: "event": "sub_op_commit_rec", 2023-08-01T19:55:21.874 INFO:teuthology.orchestra.run.smithi101.stdout: "time": "2023-08-01T19:55:05.633422+0000", 2023-08-01T19:55:21.875 INFO:teuthology.orchestra.run.smithi101.stdout: "duration": 0.051841992000000003 2023-08-01T19:55:21.875 INFO:teuthology.orchestra.run.smithi101.stdout: }, 2023-08-01T19:55:21.875 INFO:teuthology.orchestra.run.smithi101.stdout: { 2023-08-01T19:55:21.875 INFO:teuthology.orchestra.run.smithi101.stdout: "event": "commit_sent", 2023-08-01T19:55:21.875 INFO:teuthology.orchestra.run.smithi101.stdout: "time": "2023-08-01T19:55:05.633461+0000", 2023-08-01T19:55:21.875 INFO:teuthology.orchestra.run.smithi101.stdout: "duration": 3.8330000000000001e-05 2023-08-01T19:55:21.875 INFO:teuthology.orchestra.run.smithi101.stdout: }, 2023-08-01T19:55:21.875 INFO:teuthology.orchestra.run.smithi101.stdout: { 2023-08-01T19:55:21.876 INFO:teuthology.orchestra.run.smithi101.stdout: "event": "done", 2023-08-01T19:55:21.876 INFO:teuthology.orchestra.run.smithi101.stdout: "time": "2023-08-01T19:55:05.633485+0000", 2023-08-01T19:55:21.876 INFO:teuthology.orchestra.run.smithi101.stdout: "duration": 2.4451e-05 2023-08-01T19:55:21.876 INFO:teuthology.orchestra.run.smithi101.stdout: } 2023-08-01T19:55:21.876 INFO:teuthology.orchestra.run.smithi101.stdout: ] 2023-08-01T19:55:21.876 INFO:teuthology.orchestra.run.smithi101.stdout: } 2023-08-01T19:55:21.876 INFO:teuthology.orchestra.run.smithi101.stdout: }, 2023-08-01T19:55:21.877 INFO:teuthology.orchestra.run.smithi101.stdout: { 2023-08-01T19:55:21.877 INFO:teuthology.orchestra.run.smithi101.stdout: "description": "osd_op(client.4668.0:107866 5.f 5:ffcbf9c4:::benchmark_data_smithi006_114134_object107865:head [set-alloc-hint object_size 65536 write_size 65536,write 0~65536] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e38)", 2023-08-01T19:55:21.877 INFO:teuthology.orchestra.run.smithi101.stdout: "initiated_at": "2023-08-01T19:55:09.280625+0000", 2023-08-01T19:55:21.877 INFO:teuthology.orchestra.run.smithi101.stdout: "age": 12.442890601, 2023-08-01T19:55:21.877 INFO:teuthology.orchestra.run.smithi101.stdout: "duration": 0.069869799999999996, 2023-08-01T19:55:21.877 INFO:teuthology.orchestra.run.smithi101.stdout: "type_data": { 2023-08-01T19:55:21.877 INFO:teuthology.orchestra.run.smithi101.stdout: "flag_point": "commit sent; apply or cleanup", 2023-08-01T19:55:21.877 INFO:teuthology.orchestra.run.smithi101.stdout: "client_info": { 2023-08-01T19:55:21.878 INFO:teuthology.orchestra.run.smithi101.stdout: "client": "client.4668", 2023-08-01T19:55:21.878 INFO:teuthology.orchestra.run.smithi101.stdout: "client_addr": "172.21.15.6:0/1709472247", 2023-08-01T19:55:21.878 INFO:teuthology.orchestra.run.smithi101.stdout: "tid": 107866 2023-08-01T19:55:21.878 INFO:teuthology.orchestra.run.smithi101.stdout: }, 2023-08-01T19:55:21.878 INFO:teuthology.orchestra.run.smithi101.stdout: "events": [ 2023-08-01T19:55:21.878 INFO:teuthology.orchestra.run.smithi101.stdout: { 2023-08-01T19:55:21.878 INFO:teuthology.orchestra.run.smithi101.stdout: "event": "initiated", 2023-08-01T19:55:21.878 INFO:teuthology.orchestra.run.smithi101.stdout: "time": "2023-08-01T19:55:09.280625+0000", 2023-08-01T19:55:21.879 INFO:teuthology.orchestra.run.smithi101.stdout: "duration": 0 2023-08-01T19:55:21.879 INFO:teuthology.orchestra.run.smithi101.stdout: }, 2023-08-01T19:55:21.879 INFO:teuthology.orchestra.run.smithi101.stdout: { 2023-08-01T19:55:21.879 INFO:teuthology.orchestra.run.smithi101.stdout: "event": "throttled", 2023-08-01T19:55:21.879 INFO:teuthology.orchestra.run.smithi101.stdout: "time": "2023-08-01T19:55:09.280625+0000", 2023-08-01T19:55:21.879 INFO:teuthology.orchestra.run.smithi101.stdout: "duration": 0 2023-08-01T19:55:21.879 INFO:teuthology.orchestra.run.smithi101.stdout: }, 2023-08-01T19:55:21.880 INFO:teuthology.orchestra.run.smithi101.stdout: { 2023-08-01T19:55:21.880 INFO:teuthology.orchestra.run.smithi101.stdout: "event": "header_read", 2023-08-01T19:55:21.880 INFO:teuthology.orchestra.run.smithi101.stdout: "time": "2023-08-01T19:55:09.280624+0000", 2023-08-01T19:55:21.880 INFO:teuthology.orchestra.run.smithi101.stdout: "duration": 4294967295.999999 2023-08-01T19:55:21.880 INFO:teuthology.orchestra.run.smithi101.stdout: }, 2023-08-01T19:55:21.880 INFO:teuthology.orchestra.run.smithi101.stdout: { 2023-08-01T19:55:21.880 INFO:teuthology.orchestra.run.smithi101.stdout: "event": "all_read", 2023-08-01T19:55:21.880 INFO:teuthology.orchestra.run.smithi101.stdout: "time": "2023-08-01T19:55:09.280648+0000", 2023-08-01T19:55:21.881 INFO:teuthology.orchestra.run.smithi101.stdout: "duration": 2.3521999999999999e-05 2023-08-01T19:55:21.881 INFO:teuthology.orchestra.run.smithi101.stdout: }, 2023-08-01T19:55:21.881 INFO:teuthology.orchestra.run.smithi101.stdout: { 2023-08-01T19:55:21.881 INFO:teuthology.orchestra.run.smithi101.stdout: "event": "dispatched", 2023-08-01T19:55:21.881 INFO:teuthology.orchestra.run.smithi101.stdout: "time": "2023-08-01T19:55:09.280658+0000", 2023-08-01T19:55:21.881 INFO:teuthology.orchestra.run.smithi101.stdout: "duration": 9.8660000000000001e-06 2023-08-01T19:55:21.881 INFO:teuthology.orchestra.run.smithi101.stdout: }, 2023-08-01T19:55:21.882 INFO:teuthology.orchestra.run.smithi101.stdout: { 2023-08-01T19:55:21.882 INFO:teuthology.orchestra.run.smithi101.stdout: "event": "queued_for_pg", 2023-08-01T19:55:21.882 INFO:teuthology.orchestra.run.smithi101.stdout: "time": "2023-08-01T19:55:09.280663+0000", 2023-08-01T19:55:21.882 INFO:teuthology.orchestra.run.smithi101.stdout: "duration": 4.8369999999999996e-06 2023-08-01T19:55:21.882 INFO:teuthology.orchestra.run.smithi101.stdout: }, 2023-08-01T19:55:21.882 INFO:teuthology.orchestra.run.smithi101.stdout: { 2023-08-01T19:55:21.882 INFO:teuthology.orchestra.run.smithi101.stdout: "event": "reached_pg", 2023-08-01T19:55:21.882 INFO:teuthology.orchestra.run.smithi101.stdout: "time": "2023-08-01T19:55:09.280690+0000", 2023-08-01T19:55:21.883 INFO:teuthology.orchestra.run.smithi101.stdout: "duration": 2.7534000000000001e-05 2023-08-01T19:55:21.883 INFO:teuthology.orchestra.run.smithi101.stdout: }, 2023-08-01T19:55:21.883 INFO:teuthology.orchestra.run.smithi101.stdout: { 2023-08-01T19:55:21.883 INFO:teuthology.orchestra.run.smithi101.stdout: "event": "started", 2023-08-01T19:55:21.883 INFO:teuthology.orchestra.run.smithi101.stdout: "time": "2023-08-01T19:55:09.280825+0000", 2023-08-01T19:55:21.883 INFO:teuthology.orchestra.run.smithi101.stdout: "duration": 0.000135399 2023-08-01T19:55:21.883 INFO:teuthology.orchestra.run.smithi101.stdout: }, 2023-08-01T19:55:21.883 INFO:teuthology.orchestra.run.smithi101.stdout: { 2023-08-01T19:55:21.884 INFO:teuthology.orchestra.run.smithi101.stdout: "event": "waiting for subops from 2", 2023-08-01T19:55:21.884 INFO:teuthology.orchestra.run.smithi101.stdout: "time": "2023-08-01T19:55:09.280929+0000", 2023-08-01T19:55:21.884 INFO:teuthology.orchestra.run.smithi101.stdout: "duration": 0.000103328 2023-08-01T19:55:21.884 INFO:teuthology.orchestra.run.smithi101.stdout: }, 2023-08-01T19:55:21.884 INFO:teuthology.orchestra.run.smithi101.stdout: { 2023-08-01T19:55:21.884 INFO:teuthology.orchestra.run.smithi101.stdout: "event": "sub_op_commit_rec", 2023-08-01T19:55:21.884 INFO:teuthology.orchestra.run.smithi101.stdout: "time": "2023-08-01T19:55:09.348321+0000", 2023-08-01T19:55:21.884 INFO:teuthology.orchestra.run.smithi101.stdout: "duration": 0.067392176999999998 2023-08-01T19:55:21.885 INFO:teuthology.orchestra.run.smithi101.stdout: }, 2023-08-01T19:55:21.885 INFO:teuthology.orchestra.run.smithi101.stdout: { 2023-08-01T19:55:21.885 INFO:teuthology.orchestra.run.smithi101.stdout: "event": "op_commit", 2023-08-01T19:55:21.885 INFO:teuthology.orchestra.run.smithi101.stdout: "time": "2023-08-01T19:55:09.350431+0000", 2023-08-01T19:55:21.885 INFO:teuthology.orchestra.run.smithi101.stdout: "duration": 0.0021096980000000001 2023-08-01T19:55:21.885 INFO:teuthology.orchestra.run.smithi101.stdout: }, 2023-08-01T19:55:21.885 INFO:teuthology.orchestra.run.smithi101.stdout: { 2023-08-01T19:55:21.886 INFO:teuthology.orchestra.run.smithi101.stdout: "event": "commit_sent", 2023-08-01T19:55:21.886 INFO:teuthology.orchestra.run.smithi101.stdout: "time": "2023-08-01T19:55:09.350469+0000", 2023-08-01T19:55:21.886 INFO:teuthology.orchestra.run.smithi101.stdout: "duration": 3.8625999999999999e-05 2023-08-01T19:55:21.886 INFO:teuthology.orchestra.run.smithi101.stdout: }, 2023-08-01T19:55:21.886 INFO:teuthology.orchestra.run.smithi101.stdout: { 2023-08-01T19:55:21.886 INFO:teuthology.orchestra.run.smithi101.stdout: "event": "done", 2023-08-01T19:55:21.886 INFO:teuthology.orchestra.run.smithi101.stdout: "time": "2023-08-01T19:55:09.350495+0000", 2023-08-01T19:55:21.886 INFO:teuthology.orchestra.run.smithi101.stdout: "duration": 2.5698999999999999e-05 2023-08-01T19:55:21.887 INFO:teuthology.orchestra.run.smithi101.stdout: } 2023-08-01T19:55:21.887 INFO:teuthology.orchestra.run.smithi101.stdout: ] 2023-08-01T19:55:21.887 INFO:teuthology.orchestra.run.smithi101.stdout: } 2023-08-01T19:55:21.887 INFO:teuthology.orchestra.run.smithi101.stdout: }, 2023-08-01T19:55:21.887 INFO:teuthology.orchestra.run.smithi101.stdout: { 2023-08-01T19:55:21.887 INFO:teuthology.orchestra.run.smithi101.stdout: "description": "osd_op(client.4668.0:107867 5.f 5:ff29bbf7:::benchmark_data_smithi006_114134_object107866:head [set-alloc-hint object_size 65536 write_size 65536,write 0~65536] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e38)", 2023-08-01T19:55:21.887 INFO:teuthology.orchestra.run.smithi101.stdout: "initiated_at": "2023-08-01T19:55:09.280670+0000", 2023-08-01T19:55:21.887 INFO:teuthology.orchestra.run.smithi101.stdout: "age": 12.442845667, 2023-08-01T19:55:21.888 INFO:teuthology.orchestra.run.smithi101.stdout: "duration": 0.069898092999999994, 2023-08-01T19:55:21.888 INFO:teuthology.orchestra.run.smithi101.stdout: "type_data": { 2023-08-01T19:55:21.888 INFO:teuthology.orchestra.run.smithi101.stdout: "flag_point": "commit sent; apply or cleanup", 2023-08-01T19:55:21.888 INFO:teuthology.orchestra.run.smithi101.stdout: "client_info": { 2023-08-01T19:55:21.888 INFO:teuthology.orchestra.run.smithi101.stdout: "client": "client.4668", 2023-08-01T19:55:21.888 INFO:teuthology.orchestra.run.smithi101.stdout: "client_addr": "172.21.15.6:0/1709472247", 2023-08-01T19:55:21.888 INFO:teuthology.orchestra.run.smithi101.stdout: "tid": 107867 2023-08-01T19:55:21.889 INFO:teuthology.orchestra.run.smithi101.stdout: }, 2023-08-01T19:55:21.889 INFO:teuthology.orchestra.run.smithi101.stdout: "events": [ 2023-08-01T19:55:21.889 INFO:teuthology.orchestra.run.smithi101.stdout: { 2023-08-01T19:55:21.889 INFO:teuthology.orchestra.run.smithi101.stdout: "event": "initiated", 2023-08-01T19:55:21.889 INFO:teuthology.orchestra.run.smithi101.stdout: "time": "2023-08-01T19:55:09.280670+0000", 2023-08-01T19:55:21.889 INFO:teuthology.orchestra.run.smithi101.stdout: "duration": 0 2023-08-01T19:55:21.889 INFO:teuthology.orchestra.run.smithi101.stdout: }, 2023-08-01T19:55:21.889 INFO:teuthology.orchestra.run.smithi101.stdout: { 2023-08-01T19:55:21.890 INFO:teuthology.orchestra.run.smithi101.stdout: "event": "throttled", 2023-08-01T19:55:21.890 INFO:teuthology.orchestra.run.smithi101.stdout: "time": "2023-08-01T19:55:09.280670+0000", 2023-08-01T19:55:21.890 INFO:teuthology.orchestra.run.smithi101.stdout: "duration": 0 2023-08-01T19:55:21.890 INFO:teuthology.orchestra.run.smithi101.stdout: }, 2023-08-01T19:55:21.890 INFO:teuthology.orchestra.run.smithi101.stdout: { 2023-08-01T19:55:21.890 INFO:teuthology.orchestra.run.smithi101.stdout: "event": "header_read", 2023-08-01T19:55:21.890 INFO:teuthology.orchestra.run.smithi101.stdout: "time": "2023-08-01T19:55:09.280670+0000", 2023-08-01T19:55:21.890 INFO:teuthology.orchestra.run.smithi101.stdout: "duration": 4294967295.9999995 2023-08-01T19:55:21.891 INFO:teuthology.orchestra.run.smithi101.stdout: }, 2023-08-01T19:55:21.891 INFO:teuthology.orchestra.run.smithi101.stdout: { 2023-08-01T19:55:21.891 INFO:teuthology.orchestra.run.smithi101.stdout: "event": "all_read", 2023-08-01T19:55:21.891 INFO:teuthology.orchestra.run.smithi101.stdout: "time": "2023-08-01T19:55:09.280690+0000", 2023-08-01T19:55:21.891 INFO:teuthology.orchestra.run.smithi101.stdout: "duration": 2.0526e-05 2023-08-01T19:55:21.891 INFO:teuthology.orchestra.run.smithi101.stdout: }, 2023-08-01T19:55:21.891 INFO:teuthology.orchestra.run.smithi101.stdout: { 2023-08-01T19:55:21.892 INFO:teuthology.orchestra.run.smithi101.stdout: "event": "dispatched", 2023-08-01T19:55:21.892 INFO:teuthology.orchestra.run.smithi101.stdout: "time": "2023-08-01T19:55:09.280695+0000", 2023-08-01T19:55:21.892 INFO:teuthology.orchestra.run.smithi101.stdout: "duration": 4.5140000000000003e-06 2023-08-01T19:55:21.892 INFO:teuthology.orchestra.run.smithi101.stdout: }, 2023-08-01T19:55:21.892 INFO:teuthology.orchestra.run.smithi101.stdout: { 2023-08-01T19:55:21.892 INFO:teuthology.orchestra.run.smithi101.stdout: "event": "queued_for_pg", 2023-08-01T19:55:21.892 INFO:teuthology.orchestra.run.smithi101.stdout: "time": "2023-08-01T19:55:09.280697+0000", 2023-08-01T19:55:21.892 INFO:teuthology.orchestra.run.smithi101.stdout: "duration": 2.6290000000000002e-06 2023-08-01T19:55:21.893 INFO:teuthology.orchestra.run.smithi101.stdout: }, 2023-08-01T19:55:21.893 INFO:teuthology.orchestra.run.smithi101.stdout: { 2023-08-01T19:55:21.893 INFO:teuthology.orchestra.run.smithi101.stdout: "event": "reached_pg", 2023-08-01T19:55:21.893 INFO:teuthology.orchestra.run.smithi101.stdout: "time": "2023-08-01T19:55:09.282392+0000", 2023-08-01T19:55:21.893 INFO:teuthology.orchestra.run.smithi101.stdout: "duration": 0.0016948709999999999 2023-08-01T19:55:21.893 INFO:teuthology.orchestra.run.smithi101.stdout: }, 2023-08-01T19:55:21.893 INFO:teuthology.orchestra.run.smithi101.stdout: { 2023-08-01T19:55:21.893 INFO:teuthology.orchestra.run.smithi101.stdout: "event": "started", 2023-08-01T19:55:21.894 INFO:teuthology.orchestra.run.smithi101.stdout: "time": "2023-08-01T19:55:09.282514+0000", 2023-08-01T19:55:21.894 INFO:teuthology.orchestra.run.smithi101.stdout: "duration": 0.000121839 2023-08-01T19:55:21.894 INFO:teuthology.orchestra.run.smithi101.stdout: }, 2023-08-01T19:55:21.894 INFO:teuthology.orchestra.run.smithi101.stdout: { 2023-08-01T19:55:21.894 INFO:teuthology.orchestra.run.smithi101.stdout: "event": "waiting for subops from 2", 2023-08-01T19:55:21.894 INFO:teuthology.orchestra.run.smithi101.stdout: "time": "2023-08-01T19:55:09.282664+0000", 2023-08-01T19:55:21.894 INFO:teuthology.orchestra.run.smithi101.stdout: "duration": 0.00014968699999999999 2023-08-01T19:55:21.894 INFO:teuthology.orchestra.run.smithi101.stdout: }, 2023-08-01T19:55:21.895 INFO:teuthology.orchestra.run.smithi101.stdout: { 2023-08-01T19:55:21.895 INFO:teuthology.orchestra.run.smithi101.stdout: "event": "sub_op_commit_rec", 2023-08-01T19:55:21.895 INFO:teuthology.orchestra.run.smithi101.stdout: "time": "2023-08-01T19:55:09.348344+0000", 2023-08-01T19:55:21.895 INFO:teuthology.orchestra.run.smithi101.stdout: "duration": 0.065680247999999997 2023-08-01T19:55:21.895 INFO:teuthology.orchestra.run.smithi101.stdout: }, 2023-08-01T19:55:21.895 INFO:teuthology.orchestra.run.smithi101.stdout: { 2023-08-01T19:55:21.895 INFO:teuthology.orchestra.run.smithi101.stdout: "event": "op_commit", 2023-08-01T19:55:21.896 INFO:teuthology.orchestra.run.smithi101.stdout: "time": "2023-08-01T19:55:09.350502+0000", 2023-08-01T19:55:21.896 INFO:teuthology.orchestra.run.smithi101.stdout: "duration": 0.0021578140000000001 2023-08-01T19:55:21.896 INFO:teuthology.orchestra.run.smithi101.stdout: }, 2023-08-01T19:55:21.896 INFO:teuthology.orchestra.run.smithi101.stdout: { 2023-08-01T19:55:21.896 INFO:teuthology.orchestra.run.smithi101.stdout: "event": "commit_sent", 2023-08-01T19:55:21.896 INFO:teuthology.orchestra.run.smithi101.stdout: "time": "2023-08-01T19:55:09.350529+0000", 2023-08-01T19:55:21.896 INFO:teuthology.orchestra.run.smithi101.stdout: "duration": 2.6838e-05 2023-08-01T19:55:21.896 INFO:teuthology.orchestra.run.smithi101.stdout: }, 2023-08-01T19:55:21.897 INFO:teuthology.orchestra.run.smithi101.stdout: { 2023-08-01T19:55:21.897 INFO:teuthology.orchestra.run.smithi101.stdout: "event": "done", 2023-08-01T19:55:21.897 INFO:teuthology.orchestra.run.smithi101.stdout: "time": "2023-08-01T19:55:09.350568+0000", 2023-08-01T19:55:21.897 INFO:teuthology.orchestra.run.smithi101.stdout: "duration": 3.9477000000000002e-05 2023-08-01T19:55:21.897 INFO:teuthology.orchestra.run.smithi101.stdout: } 2023-08-01T19:55:21.897 INFO:teuthology.orchestra.run.smithi101.stdout: ] 2023-08-01T19:55:21.897 INFO:teuthology.orchestra.run.smithi101.stdout: } 2023-08-01T19:55:21.897 INFO:teuthology.orchestra.run.smithi101.stdout: }, 2023-08-01T19:55:21.898 INFO:teuthology.orchestra.run.smithi101.stdout: { 2023-08-01T19:55:21.898 INFO:teuthology.orchestra.run.smithi101.stdout: "description": "osd_repop(client.4668.0:107863 5.3 e38/19 5:cbdd875a:::benchmark_data_smithi006_114134_object107862:head v 38'6829, mlcod=38'6826)", 2023-08-01T19:55:21.898 INFO:teuthology.orchestra.run.smithi101.stdout: "initiated_at": "2023-08-01T19:55:09.280747+0000", 2023-08-01T19:55:21.898 INFO:teuthology.orchestra.run.smithi101.stdout: "age": 12.442768718, 2023-08-01T19:55:21.898 INFO:teuthology.orchestra.run.smithi101.stdout: "duration": 0.069343305999999993, 2023-08-01T19:55:21.898 INFO:teuthology.orchestra.run.smithi101.stdout: "type_data": { 2023-08-01T19:55:21.898 INFO:teuthology.orchestra.run.smithi101.stdout: "flag_point": "commit sent; apply or cleanup", 2023-08-01T19:55:21.898 INFO:teuthology.orchestra.run.smithi101.stdout: "events": [ 2023-08-01T19:55:21.899 INFO:teuthology.orchestra.run.smithi101.stdout: { 2023-08-01T19:55:21.899 INFO:teuthology.orchestra.run.smithi101.stdout: "event": "initiated", 2023-08-01T19:55:21.899 INFO:teuthology.orchestra.run.smithi101.stdout: "time": "2023-08-01T19:55:09.280747+0000", 2023-08-01T19:55:21.899 INFO:teuthology.orchestra.run.smithi101.stdout: "duration": 0 2023-08-01T19:55:21.899 INFO:teuthology.orchestra.run.smithi101.stdout: }, 2023-08-01T19:55:21.899 INFO:teuthology.orchestra.run.smithi101.stdout: { 2023-08-01T19:55:21.899 INFO:teuthology.orchestra.run.smithi101.stdout: "event": "throttled", 2023-08-01T19:55:21.900 INFO:teuthology.orchestra.run.smithi101.stdout: "time": "2023-08-01T19:55:09.280747+0000", 2023-08-01T19:55:21.900 INFO:teuthology.orchestra.run.smithi101.stdout: "duration": 0 2023-08-01T19:55:21.900 INFO:teuthology.orchestra.run.smithi101.stdout: }, 2023-08-01T19:55:21.900 INFO:teuthology.orchestra.run.smithi101.stdout: { 2023-08-01T19:55:21.900 INFO:teuthology.orchestra.run.smithi101.stdout: "event": "header_read", 2023-08-01T19:55:21.900 INFO:teuthology.orchestra.run.smithi101.stdout: "time": "2023-08-01T19:55:09.280746+0000", 2023-08-01T19:55:21.900 INFO:teuthology.orchestra.run.smithi101.stdout: "duration": 4294967295.9999995 2023-08-01T19:55:21.900 INFO:teuthology.orchestra.run.smithi101.stdout: }, 2023-08-01T19:55:21.901 INFO:teuthology.orchestra.run.smithi101.stdout: { 2023-08-01T19:55:21.901 INFO:teuthology.orchestra.run.smithi101.stdout: "event": "all_read", 2023-08-01T19:55:21.901 INFO:teuthology.orchestra.run.smithi101.stdout: "time": "2023-08-01T19:55:09.280798+0000", 2023-08-01T19:55:21.901 INFO:teuthology.orchestra.run.smithi101.stdout: "duration": 5.1706000000000003e-05 2023-08-01T19:55:21.901 INFO:teuthology.orchestra.run.smithi101.stdout: }, 2023-08-01T19:55:21.901 INFO:teuthology.orchestra.run.smithi101.stdout: { 2023-08-01T19:55:21.901 INFO:teuthology.orchestra.run.smithi101.stdout: "event": "dispatched", 2023-08-01T19:55:21.902 INFO:teuthology.orchestra.run.smithi101.stdout: "time": "2023-08-01T19:55:09.280807+0000", 2023-08-01T19:55:21.902 INFO:teuthology.orchestra.run.smithi101.stdout: "duration": 8.4889999999999995e-06 2023-08-01T19:55:21.902 INFO:teuthology.orchestra.run.smithi101.stdout: }, 2023-08-01T19:55:21.902 INFO:teuthology.orchestra.run.smithi101.stdout: { 2023-08-01T19:55:21.902 INFO:teuthology.orchestra.run.smithi101.stdout: "event": "queued_for_pg", 2023-08-01T19:55:21.902 INFO:teuthology.orchestra.run.smithi101.stdout: "time": "2023-08-01T19:55:09.280812+0000", 2023-08-01T19:55:21.902 INFO:teuthology.orchestra.run.smithi101.stdout: "duration": 5.2120000000000002e-06 2023-08-01T19:55:21.902 INFO:teuthology.orchestra.run.smithi101.stdout: }, 2023-08-01T19:55:21.903 INFO:teuthology.orchestra.run.smithi101.stdout: { 2023-08-01T19:55:21.903 INFO:teuthology.orchestra.run.smithi101.stdout: "event": "reached_pg", 2023-08-01T19:55:21.903 INFO:teuthology.orchestra.run.smithi101.stdout: "time": "2023-08-01T19:55:09.280843+0000", 2023-08-01T19:55:21.903 INFO:teuthology.orchestra.run.smithi101.stdout: "duration": 3.1406999999999999e-05 2023-08-01T19:55:21.903 INFO:teuthology.orchestra.run.smithi101.stdout: }, 2023-08-01T19:55:21.903 INFO:teuthology.orchestra.run.smithi101.stdout: { 2023-08-01T19:55:21.903 INFO:teuthology.orchestra.run.smithi101.stdout: "event": "started", 2023-08-01T19:55:21.903 INFO:teuthology.orchestra.run.smithi101.stdout: "time": "2023-08-01T19:55:09.280860+0000", 2023-08-01T19:55:21.904 INFO:teuthology.orchestra.run.smithi101.stdout: "duration": 1.6283999999999999e-05 2023-08-01T19:55:21.904 INFO:teuthology.orchestra.run.smithi101.stdout: }, 2023-08-01T19:55:21.904 INFO:teuthology.orchestra.run.smithi101.stdout: { 2023-08-01T19:55:21.904 INFO:teuthology.orchestra.run.smithi101.stdout: "event": "commit_sent", 2023-08-01T19:55:21.904 INFO:teuthology.orchestra.run.smithi101.stdout: "time": "2023-08-01T19:55:09.350059+0000", 2023-08-01T19:55:21.904 INFO:teuthology.orchestra.run.smithi101.stdout: "duration": 0.069199094000000003 2023-08-01T19:55:21.904 INFO:teuthology.orchestra.run.smithi101.stdout: }, 2023-08-01T19:55:21.904 INFO:teuthology.orchestra.run.smithi101.stdout: { 2023-08-01T19:55:21.905 INFO:teuthology.orchestra.run.smithi101.stdout: "event": "done", 2023-08-01T19:55:21.905 INFO:teuthology.orchestra.run.smithi101.stdout: "time": "2023-08-01T19:55:09.350090+0000", 2023-08-01T19:55:21.905 INFO:teuthology.orchestra.run.smithi101.stdout: "duration": 3.1736000000000002e-05 2023-08-01T19:55:21.905 INFO:teuthology.orchestra.run.smithi101.stdout: } 2023-08-01T19:55:21.905 INFO:teuthology.orchestra.run.smithi101.stdout: ] 2023-08-01T19:55:21.905 INFO:teuthology.orchestra.run.smithi101.stdout: } 2023-08-01T19:55:21.905 INFO:teuthology.orchestra.run.smithi101.stdout: }, 2023-08-01T19:55:21.906 INFO:teuthology.orchestra.run.smithi101.stdout: { 2023-08-01T19:55:21.906 INFO:teuthology.orchestra.run.smithi101.stdout: "description": "osd_repop(client.4668.0:107865 5.3 e38/19 5:c2ebb96d:::benchmark_data_smithi006_114134_object107864:head v 38'6830, mlcod=38'6826)", 2023-08-01T19:55:21.906 INFO:teuthology.orchestra.run.smithi101.stdout: "initiated_at": "2023-08-01T19:55:09.283182+0000", 2023-08-01T19:55:21.906 INFO:teuthology.orchestra.run.smithi101.stdout: "age": 12.440333409999999, 2023-08-01T19:55:21.906 INFO:teuthology.orchestra.run.smithi101.stdout: "duration": 0.068554793000000003, 2023-08-01T19:55:21.906 INFO:teuthology.orchestra.run.smithi101.stdout: "type_data": { 2023-08-01T19:55:21.906 INFO:teuthology.orchestra.run.smithi101.stdout: "flag_point": "commit sent; apply or cleanup", 2023-08-01T19:55:21.906 INFO:teuthology.orchestra.run.smithi101.stdout: "events": [ 2023-08-01T19:55:21.907 INFO:teuthology.orchestra.run.smithi101.stdout: { 2023-08-01T19:55:21.907 INFO:teuthology.orchestra.run.smithi101.stdout: "event": "initiated", 2023-08-01T19:55:21.907 INFO:teuthology.orchestra.run.smithi101.stdout: "time": "2023-08-01T19:55:09.283182+0000", 2023-08-01T19:55:21.907 INFO:teuthology.orchestra.run.smithi101.stdout: "duration": 0 2023-08-01T19:55:21.907 INFO:teuthology.orchestra.run.smithi101.stdout: }, 2023-08-01T19:55:21.907 INFO:teuthology.orchestra.run.smithi101.stdout: { 2023-08-01T19:55:21.907 INFO:teuthology.orchestra.run.smithi101.stdout: "event": "throttled", 2023-08-01T19:55:21.907 INFO:teuthology.orchestra.run.smithi101.stdout: "time": "2023-08-01T19:55:09.283182+0000", 2023-08-01T19:55:21.908 INFO:teuthology.orchestra.run.smithi101.stdout: "duration": 0 2023-08-01T19:55:21.908 INFO:teuthology.orchestra.run.smithi101.stdout: }, 2023-08-01T19:55:21.908 INFO:teuthology.orchestra.run.smithi101.stdout: { 2023-08-01T19:55:21.908 INFO:teuthology.orchestra.run.smithi101.stdout: "event": "header_read", 2023-08-01T19:55:21.908 INFO:teuthology.orchestra.run.smithi101.stdout: "time": "2023-08-01T19:55:09.283182+0000", 2023-08-01T19:55:21.908 INFO:teuthology.orchestra.run.smithi101.stdout: "duration": 4294967295.9999995 2023-08-01T19:55:21.908 INFO:teuthology.orchestra.run.smithi101.stdout: }, 2023-08-01T19:55:21.908 INFO:teuthology.orchestra.run.smithi101.stdout: { 2023-08-01T19:55:21.909 INFO:teuthology.orchestra.run.smithi101.stdout: "event": "all_read", 2023-08-01T19:55:21.909 INFO:teuthology.orchestra.run.smithi101.stdout: "time": "2023-08-01T19:55:09.283233+0000", 2023-08-01T19:55:21.909 INFO:teuthology.orchestra.run.smithi101.stdout: "duration": 5.1511999999999997e-05 2023-08-01T19:55:21.909 INFO:teuthology.orchestra.run.smithi101.stdout: }, 2023-08-01T19:55:21.909 INFO:teuthology.orchestra.run.smithi101.stdout: { 2023-08-01T19:55:21.909 INFO:teuthology.orchestra.run.smithi101.stdout: "event": "dispatched", 2023-08-01T19:55:21.909 INFO:teuthology.orchestra.run.smithi101.stdout: "time": "2023-08-01T19:55:09.283239+0000", 2023-08-01T19:55:21.910 INFO:teuthology.orchestra.run.smithi101.stdout: "duration": 5.6640000000000003e-06 2023-08-01T19:55:21.910 INFO:teuthology.orchestra.run.smithi101.stdout: }, 2023-08-01T19:55:21.910 INFO:teuthology.orchestra.run.smithi101.stdout: { 2023-08-01T19:55:21.910 INFO:teuthology.orchestra.run.smithi101.stdout: "event": "queued_for_pg", 2023-08-01T19:55:21.910 INFO:teuthology.orchestra.run.smithi101.stdout: "time": "2023-08-01T19:55:09.283242+0000", 2023-08-01T19:55:21.910 INFO:teuthology.orchestra.run.smithi101.stdout: "duration": 2.9639999999999999e-06 2023-08-01T19:55:21.910 INFO:teuthology.orchestra.run.smithi101.stdout: }, 2023-08-01T19:55:21.910 INFO:teuthology.orchestra.run.smithi101.stdout: { 2023-08-01T19:55:21.911 INFO:teuthology.orchestra.run.smithi101.stdout: "event": "reached_pg", 2023-08-01T19:55:21.911 INFO:teuthology.orchestra.run.smithi101.stdout: "time": "2023-08-01T19:55:09.283276+0000", 2023-08-01T19:55:21.911 INFO:teuthology.orchestra.run.smithi101.stdout: "duration": 3.3631999999999999e-05 2023-08-01T19:55:21.911 INFO:teuthology.orchestra.run.smithi101.stdout: }, 2023-08-01T19:55:21.911 INFO:teuthology.orchestra.run.smithi101.stdout: { 2023-08-01T19:55:21.911 INFO:teuthology.orchestra.run.smithi101.stdout: "event": "started", 2023-08-01T19:55:21.911 INFO:teuthology.orchestra.run.smithi101.stdout: "time": "2023-08-01T19:55:09.283288+0000", 2023-08-01T19:55:21.912 INFO:teuthology.orchestra.run.smithi101.stdout: "duration": 1.1816e-05 2023-08-01T19:55:21.912 INFO:teuthology.orchestra.run.smithi101.stdout: }, 2023-08-01T19:55:21.912 INFO:teuthology.orchestra.run.smithi101.stdout: { 2023-08-01T19:55:21.912 INFO:teuthology.orchestra.run.smithi101.stdout: "event": "commit_sent", 2023-08-01T19:55:21.912 INFO:teuthology.orchestra.run.smithi101.stdout: "time": "2023-08-01T19:55:09.351712+0000", 2023-08-01T19:55:21.912 INFO:teuthology.orchestra.run.smithi101.stdout: "duration": 0.068424311000000002 2023-08-01T19:55:21.912 INFO:teuthology.orchestra.run.smithi101.stdout: }, 2023-08-01T19:55:21.912 INFO:teuthology.orchestra.run.smithi101.stdout: { 2023-08-01T19:55:21.913 INFO:teuthology.orchestra.run.smithi101.stdout: "event": "done", 2023-08-01T19:55:21.913 INFO:teuthology.orchestra.run.smithi101.stdout: "time": "2023-08-01T19:55:09.351737+0000", 2023-08-01T19:55:21.913 INFO:teuthology.orchestra.run.smithi101.stdout: "duration": 2.5364999999999999e-05 2023-08-01T19:55:21.913 INFO:teuthology.orchestra.run.smithi101.stdout: } 2023-08-01T19:55:21.913 INFO:teuthology.orchestra.run.smithi101.stdout: ] 2023-08-01T19:55:21.913 INFO:teuthology.orchestra.run.smithi101.stdout: } 2023-08-01T19:55:21.913 INFO:teuthology.orchestra.run.smithi101.stdout: }, 2023-08-01T19:55:21.914 INFO:teuthology.orchestra.run.smithi101.stdout: { 2023-08-01T19:55:21.914 INFO:teuthology.orchestra.run.smithi101.stdout: "description": "osd_repop(client.4668.0:107869 5.c e38/19 5:31910384:::benchmark_data_smithi006_114134_object107868:head v 38'6761, mlcod=38'6759)", 2023-08-01T19:55:21.914 INFO:teuthology.orchestra.run.smithi101.stdout: "initiated_at": "2023-08-01T19:55:09.283762+0000", 2023-08-01T19:55:21.914 INFO:teuthology.orchestra.run.smithi101.stdout: "age": 12.439754074, 2023-08-01T19:55:21.914 INFO:teuthology.orchestra.run.smithi101.stdout: "duration": 0.067877541, 2023-08-01T19:55:21.914 INFO:teuthology.orchestra.run.smithi101.stdout: "type_data": { 2023-08-01T19:55:21.914 INFO:teuthology.orchestra.run.smithi101.stdout: "flag_point": "commit sent; apply or cleanup", 2023-08-01T19:55:21.914 INFO:teuthology.orchestra.run.smithi101.stdout: "events": [ 2023-08-01T19:55:21.915 INFO:teuthology.orchestra.run.smithi101.stdout: { 2023-08-01T19:55:21.915 INFO:teuthology.orchestra.run.smithi101.stdout: "event": "initiated", 2023-08-01T19:55:21.915 INFO:teuthology.orchestra.run.smithi101.stdout: "time": "2023-08-01T19:55:09.283762+0000", 2023-08-01T19:55:21.915 INFO:teuthology.orchestra.run.smithi101.stdout: "duration": 0 2023-08-01T19:55:21.915 INFO:teuthology.orchestra.run.smithi101.stdout: }, 2023-08-01T19:55:21.915 INFO:teuthology.orchestra.run.smithi101.stdout: { 2023-08-01T19:55:21.915 INFO:teuthology.orchestra.run.smithi101.stdout: "event": "throttled", 2023-08-01T19:55:21.915 INFO:teuthology.orchestra.run.smithi101.stdout: "time": "2023-08-01T19:55:09.283762+0000", 2023-08-01T19:55:21.916 INFO:teuthology.orchestra.run.smithi101.stdout: "duration": 0 2023-08-01T19:55:21.916 INFO:teuthology.orchestra.run.smithi101.stdout: }, 2023-08-01T19:55:21.916 INFO:teuthology.orchestra.run.smithi101.stdout: { 2023-08-01T19:55:21.916 INFO:teuthology.orchestra.run.smithi101.stdout: "event": "header_read", 2023-08-01T19:55:21.916 INFO:teuthology.orchestra.run.smithi101.stdout: "time": "2023-08-01T19:55:09.283761+0000", 2023-08-01T19:55:21.916 INFO:teuthology.orchestra.run.smithi101.stdout: "duration": 4294967295.9999995 2023-08-01T19:55:21.916 INFO:teuthology.orchestra.run.smithi101.stdout: }, 2023-08-01T19:55:21.917 INFO:teuthology.orchestra.run.smithi101.stdout: { 2023-08-01T19:55:21.917 INFO:teuthology.orchestra.run.smithi101.stdout: "event": "all_read", 2023-08-01T19:55:21.917 INFO:teuthology.orchestra.run.smithi101.stdout: "time": "2023-08-01T19:55:09.283825+0000", 2023-08-01T19:55:21.917 INFO:teuthology.orchestra.run.smithi101.stdout: "duration": 6.3200000000000005e-05 2023-08-01T19:55:21.917 INFO:teuthology.orchestra.run.smithi101.stdout: }, 2023-08-01T19:55:21.917 INFO:teuthology.orchestra.run.smithi101.stdout: { 2023-08-01T19:55:21.917 INFO:teuthology.orchestra.run.smithi101.stdout: "event": "dispatched", 2023-08-01T19:55:21.917 INFO:teuthology.orchestra.run.smithi101.stdout: "time": "2023-08-01T19:55:09.345759+0000", 2023-08-01T19:55:21.918 INFO:teuthology.orchestra.run.smithi101.stdout: "duration": 0.061934221999999997 2023-08-01T19:55:21.918 INFO:teuthology.orchestra.run.smithi101.stdout: }, 2023-08-01T19:55:21.918 INFO:teuthology.orchestra.run.smithi101.stdout: { 2023-08-01T19:55:21.918 INFO:teuthology.orchestra.run.smithi101.stdout: "event": "queued_for_pg", 2023-08-01T19:55:21.918 INFO:teuthology.orchestra.run.smithi101.stdout: "time": "2023-08-01T19:55:09.345768+0000", 2023-08-01T19:55:21.918 INFO:teuthology.orchestra.run.smithi101.stdout: "duration": 8.7099999999999996e-06 2023-08-01T19:55:21.918 INFO:teuthology.orchestra.run.smithi101.stdout: }, 2023-08-01T19:55:21.918 INFO:teuthology.orchestra.run.smithi101.stdout: { 2023-08-01T19:55:21.919 INFO:teuthology.orchestra.run.smithi101.stdout: "event": "reached_pg", 2023-08-01T19:55:21.919 INFO:teuthology.orchestra.run.smithi101.stdout: "time": "2023-08-01T19:55:09.345832+0000", 2023-08-01T19:55:21.919 INFO:teuthology.orchestra.run.smithi101.stdout: "duration": 6.4769000000000003e-05 2023-08-01T19:55:21.919 INFO:teuthology.orchestra.run.smithi101.stdout: }, 2023-08-01T19:55:21.919 INFO:teuthology.orchestra.run.smithi101.stdout: { 2023-08-01T19:55:21.919 INFO:teuthology.orchestra.run.smithi101.stdout: "event": "started", 2023-08-01T19:55:21.919 INFO:teuthology.orchestra.run.smithi101.stdout: "time": "2023-08-01T19:55:09.345851+0000", 2023-08-01T19:55:21.919 INFO:teuthology.orchestra.run.smithi101.stdout: "duration": 1.9049e-05 2023-08-01T19:55:21.920 INFO:teuthology.orchestra.run.smithi101.stdout: }, 2023-08-01T19:55:21.920 INFO:teuthology.orchestra.run.smithi101.stdout: { 2023-08-01T19:55:21.920 INFO:teuthology.orchestra.run.smithi101.stdout: "event": "commit_sent", 2023-08-01T19:55:21.920 INFO:teuthology.orchestra.run.smithi101.stdout: "time": "2023-08-01T19:55:09.351601+0000", 2023-08-01T19:55:21.920 INFO:teuthology.orchestra.run.smithi101.stdout: "duration": 0.0057499930000000001 2023-08-01T19:55:21.920 INFO:teuthology.orchestra.run.smithi101.stdout: }, 2023-08-01T19:55:21.920 INFO:teuthology.orchestra.run.smithi101.stdout: { 2023-08-01T19:55:21.920 INFO:teuthology.orchestra.run.smithi101.stdout: "event": "done", 2023-08-01T19:55:21.921 INFO:teuthology.orchestra.run.smithi101.stdout: "time": "2023-08-01T19:55:09.351639+0000", 2023-08-01T19:55:21.921 INFO:teuthology.orchestra.run.smithi101.stdout: "duration": 3.7941000000000001e-05 2023-08-01T19:55:21.921 INFO:teuthology.orchestra.run.smithi101.stdout: } 2023-08-01T19:55:21.921 INFO:teuthology.orchestra.run.smithi101.stdout: ] 2023-08-01T19:55:21.921 INFO:teuthology.orchestra.run.smithi101.stdout: } 2023-08-01T19:55:21.921 INFO:teuthology.orchestra.run.smithi101.stdout: }, 2023-08-01T19:55:21.921 INFO:teuthology.orchestra.run.smithi101.stdout: { 2023-08-01T19:55:21.922 INFO:teuthology.orchestra.run.smithi101.stdout: "description": "osd_op(client.4668.0:107876 5.1 5:8d2344a3:::benchmark_data_smithi006_114134_object107875:head [set-alloc-hint object_size 65536 write_size 65536,write 0~65536] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e38)", 2023-08-01T19:55:21.922 INFO:teuthology.orchestra.run.smithi101.stdout: "initiated_at": "2023-08-01T19:55:09.287802+0000", 2023-08-01T19:55:21.922 INFO:teuthology.orchestra.run.smithi101.stdout: "age": 12.435713754, 2023-08-01T19:55:21.922 INFO:teuthology.orchestra.run.smithi101.stdout: "duration": 0.066738461999999998, 2023-08-01T19:55:21.922 INFO:teuthology.orchestra.run.smithi101.stdout: "type_data": { 2023-08-01T19:55:21.922 INFO:teuthology.orchestra.run.smithi101.stdout: "flag_point": "commit sent; apply or cleanup", 2023-08-01T19:55:21.922 INFO:teuthology.orchestra.run.smithi101.stdout: "client_info": { 2023-08-01T19:55:21.922 INFO:teuthology.orchestra.run.smithi101.stdout: "client": "client.4668", 2023-08-01T19:55:21.923 INFO:teuthology.orchestra.run.smithi101.stdout: "client_addr": "172.21.15.6:0/1709472247", 2023-08-01T19:55:21.923 INFO:teuthology.orchestra.run.smithi101.stdout: "tid": 107876 2023-08-01T19:55:21.923 INFO:teuthology.orchestra.run.smithi101.stdout: }, 2023-08-01T19:55:21.923 INFO:teuthology.orchestra.run.smithi101.stdout: "events": [ 2023-08-01T19:55:21.923 INFO:teuthology.orchestra.run.smithi101.stdout: { 2023-08-01T19:55:21.923 INFO:teuthology.orchestra.run.smithi101.stdout: "event": "initiated", 2023-08-01T19:55:21.923 INFO:teuthology.orchestra.run.smithi101.stdout: "time": "2023-08-01T19:55:09.287802+0000", 2023-08-01T19:55:21.923 INFO:teuthology.orchestra.run.smithi101.stdout: "duration": 0 2023-08-01T19:55:21.924 INFO:teuthology.orchestra.run.smithi101.stdout: }, 2023-08-01T19:55:21.924 INFO:teuthology.orchestra.run.smithi101.stdout: { 2023-08-01T19:55:21.924 INFO:teuthology.orchestra.run.smithi101.stdout: "event": "throttled", 2023-08-01T19:55:21.924 INFO:teuthology.orchestra.run.smithi101.stdout: "time": "2023-08-01T19:55:09.287802+0000", 2023-08-01T19:55:21.924 INFO:teuthology.orchestra.run.smithi101.stdout: "duration": 0 2023-08-01T19:55:21.924 INFO:teuthology.orchestra.run.smithi101.stdout: }, 2023-08-01T19:55:21.924 INFO:teuthology.orchestra.run.smithi101.stdout: { 2023-08-01T19:55:21.925 INFO:teuthology.orchestra.run.smithi101.stdout: "event": "header_read", 2023-08-01T19:55:21.925 INFO:teuthology.orchestra.run.smithi101.stdout: "time": "2023-08-01T19:55:09.287800+0000", 2023-08-01T19:55:21.925 INFO:teuthology.orchestra.run.smithi101.stdout: "duration": 4294967295.9999981 2023-08-01T19:55:21.925 INFO:teuthology.orchestra.run.smithi101.stdout: }, 2023-08-01T19:55:21.925 INFO:teuthology.orchestra.run.smithi101.stdout: { 2023-08-01T19:55:21.925 INFO:teuthology.orchestra.run.smithi101.stdout: "event": "all_read", 2023-08-01T19:55:21.925 INFO:teuthology.orchestra.run.smithi101.stdout: "time": "2023-08-01T19:55:09.287847+0000", 2023-08-01T19:55:21.925 INFO:teuthology.orchestra.run.smithi101.stdout: "duration": 4.6455999999999997e-05 2023-08-01T19:55:21.926 INFO:teuthology.orchestra.run.smithi101.stdout: }, 2023-08-01T19:55:21.926 INFO:teuthology.orchestra.run.smithi101.stdout: { 2023-08-01T19:55:21.926 INFO:teuthology.orchestra.run.smithi101.stdout: "event": "dispatched", 2023-08-01T19:55:21.926 INFO:teuthology.orchestra.run.smithi101.stdout: "time": "2023-08-01T19:55:09.345732+0000", 2023-08-01T19:55:21.926 INFO:teuthology.orchestra.run.smithi101.stdout: "duration": 0.057885955000000003 2023-08-01T19:55:21.926 INFO:teuthology.orchestra.run.smithi101.stdout: }, 2023-08-01T19:55:21.926 INFO:teuthology.orchestra.run.smithi101.stdout: { 2023-08-01T19:55:21.926 INFO:teuthology.orchestra.run.smithi101.stdout: "event": "queued_for_pg", 2023-08-01T19:55:21.927 INFO:teuthology.orchestra.run.smithi101.stdout: "time": "2023-08-01T19:55:09.345802+0000", 2023-08-01T19:55:21.927 INFO:teuthology.orchestra.run.smithi101.stdout: "duration": 6.9845000000000006e-05 2023-08-01T19:55:21.927 INFO:teuthology.orchestra.run.smithi101.stdout: }, 2023-08-01T19:55:21.927 INFO:teuthology.orchestra.run.smithi101.stdout: { 2023-08-01T19:55:21.927 INFO:teuthology.orchestra.run.smithi101.stdout: "event": "reached_pg", 2023-08-01T19:55:21.927 INFO:teuthology.orchestra.run.smithi101.stdout: "time": "2023-08-01T19:55:09.345841+0000", 2023-08-01T19:55:21.927 INFO:teuthology.orchestra.run.smithi101.stdout: "duration": 3.8719e-05 2023-08-01T19:55:21.927 INFO:teuthology.orchestra.run.smithi101.stdout: }, 2023-08-01T19:55:21.928 INFO:teuthology.orchestra.run.smithi101.stdout: { 2023-08-01T19:55:21.928 INFO:teuthology.orchestra.run.smithi101.stdout: "event": "started", 2023-08-01T19:55:21.928 INFO:teuthology.orchestra.run.smithi101.stdout: "time": "2023-08-01T19:55:09.345965+0000", 2023-08-01T19:55:21.928 INFO:teuthology.orchestra.run.smithi101.stdout: "duration": 0.00012353099999999999 2023-08-01T19:55:21.928 INFO:teuthology.orchestra.run.smithi101.stdout: }, 2023-08-01T19:55:21.928 INFO:teuthology.orchestra.run.smithi101.stdout: { 2023-08-01T19:55:21.928 INFO:teuthology.orchestra.run.smithi101.stdout: "event": "waiting for subops from 0", 2023-08-01T19:55:21.929 INFO:teuthology.orchestra.run.smithi101.stdout: "time": "2023-08-01T19:55:09.346113+0000", 2023-08-01T19:55:21.929 INFO:teuthology.orchestra.run.smithi101.stdout: "duration": 0.000148496 2023-08-01T19:55:21.929 INFO:teuthology.orchestra.run.smithi101.stdout: }, 2023-08-01T19:55:21.929 INFO:teuthology.orchestra.run.smithi101.stdout: { 2023-08-01T19:55:21.929 INFO:teuthology.orchestra.run.smithi101.stdout: "event": "sub_op_commit_rec", 2023-08-01T19:55:21.929 INFO:teuthology.orchestra.run.smithi101.stdout: "time": "2023-08-01T19:55:09.352561+0000", 2023-08-01T19:55:21.929 INFO:teuthology.orchestra.run.smithi101.stdout: "duration": 0.0064478890000000001 2023-08-01T19:55:21.929 INFO:teuthology.orchestra.run.smithi101.stdout: }, 2023-08-01T19:55:21.930 INFO:teuthology.orchestra.run.smithi101.stdout: { 2023-08-01T19:55:21.930 INFO:teuthology.orchestra.run.smithi101.stdout: "event": "op_commit", 2023-08-01T19:55:21.930 INFO:teuthology.orchestra.run.smithi101.stdout: "time": "2023-08-01T19:55:09.354475+0000", 2023-08-01T19:55:21.930 INFO:teuthology.orchestra.run.smithi101.stdout: "duration": 0.001913903 2023-08-01T19:55:21.930 INFO:teuthology.orchestra.run.smithi101.stdout: }, 2023-08-01T19:55:21.930 INFO:teuthology.orchestra.run.smithi101.stdout: { 2023-08-01T19:55:21.930 INFO:teuthology.orchestra.run.smithi101.stdout: "event": "commit_sent", 2023-08-01T19:55:21.930 INFO:teuthology.orchestra.run.smithi101.stdout: "time": "2023-08-01T19:55:09.354514+0000", 2023-08-01T19:55:21.931 INFO:teuthology.orchestra.run.smithi101.stdout: "duration": 3.8680999999999998e-05 2023-08-01T19:55:21.931 INFO:teuthology.orchestra.run.smithi101.stdout: }, 2023-08-01T19:55:21.931 INFO:teuthology.orchestra.run.smithi101.stdout: { 2023-08-01T19:55:21.931 INFO:teuthology.orchestra.run.smithi101.stdout: "event": "done", 2023-08-01T19:55:21.931 INFO:teuthology.orchestra.run.smithi101.stdout: "time": "2023-08-01T19:55:09.354541+0000", 2023-08-01T19:55:21.931 INFO:teuthology.orchestra.run.smithi101.stdout: "duration": 2.6976999999999999e-05 2023-08-01T19:55:21.931 INFO:teuthology.orchestra.run.smithi101.stdout: } 2023-08-01T19:55:21.931 INFO:teuthology.orchestra.run.smithi101.stdout: ] 2023-08-01T19:55:21.932 INFO:teuthology.orchestra.run.smithi101.stdout: } 2023-08-01T19:55:21.932 INFO:teuthology.orchestra.run.smithi101.stdout: } 2023-08-01T19:55:21.932 INFO:teuthology.orchestra.run.smithi101.stdout: ] 2023-08-01T19:55:21.932 INFO:teuthology.orchestra.run.smithi101.stdout:} 2023-08-01T19:55:21.933 INFO:tasks.ceph.osd.2.smithi155.stderr:2023-08-01T19:55:21.932+0000 7faa5c6ac700 -1 received signal: Hangup from /usr/bin/python3 /bin/daemon-helper kill ceph-osd -f --cluster ceph -i 2 (PID: 111337) UID: 0 2023-08-01T19:55:21.934 DEBUG:teuthology.orchestra.run.smithi155:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 30 ceph --cluster ceph --admin-daemon /var/run/ceph/ceph-osd.2.asok dump_ops_in_flight 2023-08-01T19:55:22.034 INFO:tasks.ceph.osd.0.smithi008.stderr:2023-08-01T19:55:22.032+0000 7f16a58f4700 -1 received signal: Hangup from /usr/bin/python3 /bin/daemon-helper kill ceph-osd -f --cluster ceph -i 0 (PID: 111179) UID: 0 2023-08-01T19:55:22.102 INFO:teuthology.orchestra.run.smithi155.stdout:{ 2023-08-01T19:55:22.103 INFO:teuthology.orchestra.run.smithi155.stdout: "ops": [ 2023-08-01T19:55:22.103 INFO:teuthology.orchestra.run.smithi155.stdout: { 2023-08-01T19:55:22.103 INFO:teuthology.orchestra.run.smithi155.stdout: "description": "osd_op(client.4668.0:129594 5.d 5:b4ae0b4a:::benchmark_data_smithi006_114134_object129593:head [set-alloc-hint object_size 65536 write_size 65536,write 0~65536 in=65536b] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e45)", 2023-08-01T19:55:22.103 INFO:teuthology.orchestra.run.smithi155.stdout: "initiated_at": "2023-08-01T19:55:22.095224+0000", 2023-08-01T19:55:22.103 INFO:teuthology.orchestra.run.smithi155.stdout: "age": 0.0057689100000000004, 2023-08-01T19:55:22.104 INFO:teuthology.orchestra.run.smithi155.stdout: "duration": 0.0058001520000000003, 2023-08-01T19:55:22.104 INFO:teuthology.orchestra.run.smithi155.stdout: "type_data": { 2023-08-01T19:55:22.104 INFO:teuthology.orchestra.run.smithi155.stdout: "flag_point": "waiting for sub ops", 2023-08-01T19:55:22.104 INFO:teuthology.orchestra.run.smithi155.stdout: "client_info": { 2023-08-01T19:55:22.104 INFO:teuthology.orchestra.run.smithi155.stdout: "client": "client.4668", 2023-08-01T19:55:22.104 INFO:teuthology.orchestra.run.smithi155.stdout: "client_addr": "172.21.15.6:0/1709472247", 2023-08-01T19:55:22.104 INFO:teuthology.orchestra.run.smithi155.stdout: "tid": 129594 2023-08-01T19:55:22.105 INFO:teuthology.orchestra.run.smithi155.stdout: }, 2023-08-01T19:55:22.105 INFO:teuthology.orchestra.run.smithi155.stdout: "events": [ 2023-08-01T19:55:22.105 INFO:teuthology.orchestra.run.smithi155.stdout: { 2023-08-01T19:55:22.105 INFO:teuthology.orchestra.run.smithi155.stdout: "event": "initiated", 2023-08-01T19:55:22.105 INFO:teuthology.orchestra.run.smithi155.stdout: "time": "2023-08-01T19:55:22.095224+0000", 2023-08-01T19:55:22.105 INFO:teuthology.orchestra.run.smithi155.stdout: "duration": 0 2023-08-01T19:55:22.105 INFO:teuthology.orchestra.run.smithi155.stdout: }, 2023-08-01T19:55:22.105 INFO:teuthology.orchestra.run.smithi155.stdout: { 2023-08-01T19:55:22.106 INFO:teuthology.orchestra.run.smithi155.stdout: "event": "throttled", 2023-08-01T19:55:22.106 INFO:teuthology.orchestra.run.smithi155.stdout: "time": "2023-08-01T19:55:22.095224+0000", 2023-08-01T19:55:22.106 INFO:teuthology.orchestra.run.smithi155.stdout: "duration": 0 2023-08-01T19:55:22.106 INFO:teuthology.orchestra.run.smithi155.stdout: }, 2023-08-01T19:55:22.106 INFO:teuthology.orchestra.run.smithi155.stdout: { 2023-08-01T19:55:22.106 INFO:teuthology.orchestra.run.smithi155.stdout: "event": "header_read", 2023-08-01T19:55:22.106 INFO:teuthology.orchestra.run.smithi155.stdout: "time": "2023-08-01T19:55:22.095224+0000", 2023-08-01T19:55:22.106 INFO:teuthology.orchestra.run.smithi155.stdout: "duration": 4294967295.9999995 2023-08-01T19:55:22.107 INFO:teuthology.orchestra.run.smithi155.stdout: }, 2023-08-01T19:55:22.107 INFO:teuthology.orchestra.run.smithi155.stdout: { 2023-08-01T19:55:22.107 INFO:teuthology.orchestra.run.smithi155.stdout: "event": "all_read", 2023-08-01T19:55:22.107 INFO:teuthology.orchestra.run.smithi155.stdout: "time": "2023-08-01T19:55:22.095253+0000", 2023-08-01T19:55:22.107 INFO:teuthology.orchestra.run.smithi155.stdout: "duration": 2.9521000000000001e-05 2023-08-01T19:55:22.107 INFO:teuthology.orchestra.run.smithi155.stdout: }, 2023-08-01T19:55:22.107 INFO:teuthology.orchestra.run.smithi155.stdout: { 2023-08-01T19:55:22.107 INFO:teuthology.orchestra.run.smithi155.stdout: "event": "dispatched", 2023-08-01T19:55:22.108 INFO:teuthology.orchestra.run.smithi155.stdout: "time": "2023-08-01T19:55:22.095260+0000", 2023-08-01T19:55:22.108 INFO:teuthology.orchestra.run.smithi155.stdout: "duration": 7.3300000000000001e-06 2023-08-01T19:55:22.108 INFO:teuthology.orchestra.run.smithi155.stdout: }, 2023-08-01T19:55:22.108 INFO:teuthology.orchestra.run.smithi155.stdout: { 2023-08-01T19:55:22.108 INFO:teuthology.orchestra.run.smithi155.stdout: "event": "queued_for_pg", 2023-08-01T19:55:22.108 INFO:teuthology.orchestra.run.smithi155.stdout: "time": "2023-08-01T19:55:22.095265+0000", 2023-08-01T19:55:22.108 INFO:teuthology.orchestra.run.smithi155.stdout: "duration": 4.1339999999999997e-06 2023-08-01T19:55:22.109 INFO:teuthology.orchestra.run.smithi155.stdout: }, 2023-08-01T19:55:22.109 INFO:teuthology.orchestra.run.smithi155.stdout: { 2023-08-01T19:55:22.109 INFO:teuthology.orchestra.run.smithi155.stdout: "event": "reached_pg", 2023-08-01T19:55:22.109 INFO:teuthology.orchestra.run.smithi155.stdout: "time": "2023-08-01T19:55:22.095330+0000", 2023-08-01T19:55:22.109 INFO:teuthology.orchestra.run.smithi155.stdout: "duration": 6.5784999999999994e-05 2023-08-01T19:55:22.109 INFO:teuthology.orchestra.run.smithi155.stdout: }, 2023-08-01T19:55:22.109 INFO:teuthology.orchestra.run.smithi155.stdout: { 2023-08-01T19:55:22.109 INFO:teuthology.orchestra.run.smithi155.stdout: "event": "started", 2023-08-01T19:55:22.110 INFO:teuthology.orchestra.run.smithi155.stdout: "time": "2023-08-01T19:55:22.095461+0000", 2023-08-01T19:55:22.110 INFO:teuthology.orchestra.run.smithi155.stdout: "duration": 0.00013096000000000001 2023-08-01T19:55:22.110 INFO:teuthology.orchestra.run.smithi155.stdout: }, 2023-08-01T19:55:22.110 INFO:teuthology.orchestra.run.smithi155.stdout: { 2023-08-01T19:55:22.110 INFO:teuthology.orchestra.run.smithi155.stdout: "event": "waiting for subops from 1", 2023-08-01T19:55:22.110 INFO:teuthology.orchestra.run.smithi155.stdout: "time": "2023-08-01T19:55:22.095575+0000", 2023-08-01T19:55:22.110 INFO:teuthology.orchestra.run.smithi155.stdout: "duration": 0.00011391300000000001 2023-08-01T19:55:22.110 INFO:teuthology.orchestra.run.smithi155.stdout: } 2023-08-01T19:55:22.111 INFO:teuthology.orchestra.run.smithi155.stdout: ] 2023-08-01T19:55:22.111 INFO:teuthology.orchestra.run.smithi155.stdout: } 2023-08-01T19:55:22.111 INFO:teuthology.orchestra.run.smithi155.stdout: }, 2023-08-01T19:55:22.111 INFO:teuthology.orchestra.run.smithi155.stdout: { 2023-08-01T19:55:22.111 INFO:teuthology.orchestra.run.smithi155.stdout: "description": "osd_op(client.4668.0:129595 5.b 5:d73deddc:::benchmark_data_smithi006_114134_object129594:head [set-alloc-hint object_size 65536 write_size 65536,write 0~65536 in=65536b] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e45)", 2023-08-01T19:55:22.111 INFO:teuthology.orchestra.run.smithi155.stdout: "initiated_at": "2023-08-01T19:55:22.095274+0000", 2023-08-01T19:55:22.111 INFO:teuthology.orchestra.run.smithi155.stdout: "age": 0.0057188899999999999, 2023-08-01T19:55:22.111 INFO:teuthology.orchestra.run.smithi155.stdout: "duration": 0.0058420470000000004, 2023-08-01T19:55:22.112 INFO:teuthology.orchestra.run.smithi155.stdout: "type_data": { 2023-08-01T19:55:22.112 INFO:teuthology.orchestra.run.smithi155.stdout: "flag_point": "waiting for sub ops", 2023-08-01T19:55:22.112 INFO:teuthology.orchestra.run.smithi155.stdout: "client_info": { 2023-08-01T19:55:22.112 INFO:teuthology.orchestra.run.smithi155.stdout: "client": "client.4668", 2023-08-01T19:55:22.112 INFO:teuthology.orchestra.run.smithi155.stdout: "client_addr": "172.21.15.6:0/1709472247", 2023-08-01T19:55:22.112 INFO:teuthology.orchestra.run.smithi155.stdout: "tid": 129595 2023-08-01T19:55:22.112 INFO:teuthology.orchestra.run.smithi155.stdout: }, 2023-08-01T19:55:22.113 INFO:teuthology.orchestra.run.smithi155.stdout: "events": [ 2023-08-01T19:55:22.113 INFO:teuthology.orchestra.run.smithi155.stdout: { 2023-08-01T19:55:22.113 INFO:teuthology.orchestra.run.smithi155.stdout: "event": "initiated", 2023-08-01T19:55:22.113 INFO:teuthology.orchestra.run.smithi155.stdout: "time": "2023-08-01T19:55:22.095274+0000", 2023-08-01T19:55:22.113 INFO:teuthology.orchestra.run.smithi155.stdout: "duration": 0 2023-08-01T19:55:22.113 INFO:teuthology.orchestra.run.smithi155.stdout: }, 2023-08-01T19:55:22.113 INFO:teuthology.orchestra.run.smithi155.stdout: { 2023-08-01T19:55:22.113 INFO:teuthology.orchestra.run.smithi155.stdout: "event": "throttled", 2023-08-01T19:55:22.114 INFO:teuthology.orchestra.run.smithi155.stdout: "time": "2023-08-01T19:55:22.095274+0000", 2023-08-01T19:55:22.114 INFO:teuthology.orchestra.run.smithi155.stdout: "duration": 0 2023-08-01T19:55:22.114 INFO:teuthology.orchestra.run.smithi155.stdout: }, 2023-08-01T19:55:22.114 INFO:teuthology.orchestra.run.smithi155.stdout: { 2023-08-01T19:55:22.114 INFO:teuthology.orchestra.run.smithi155.stdout: "event": "header_read", 2023-08-01T19:55:22.114 INFO:teuthology.orchestra.run.smithi155.stdout: "time": "2023-08-01T19:55:22.095274+0000", 2023-08-01T19:55:22.114 INFO:teuthology.orchestra.run.smithi155.stdout: "duration": 4294967295.9999995 2023-08-01T19:55:22.115 INFO:teuthology.orchestra.run.smithi155.stdout: }, 2023-08-01T19:55:22.115 INFO:teuthology.orchestra.run.smithi155.stdout: { 2023-08-01T19:55:22.115 INFO:teuthology.orchestra.run.smithi155.stdout: "event": "all_read", 2023-08-01T19:55:22.115 INFO:teuthology.orchestra.run.smithi155.stdout: "time": "2023-08-01T19:55:22.095297+0000", 2023-08-01T19:55:22.115 INFO:teuthology.orchestra.run.smithi155.stdout: "duration": 2.3057e-05 2023-08-01T19:55:22.115 INFO:teuthology.orchestra.run.smithi155.stdout: }, 2023-08-01T19:55:22.115 INFO:teuthology.orchestra.run.smithi155.stdout: { 2023-08-01T19:55:22.115 INFO:teuthology.orchestra.run.smithi155.stdout: "event": "dispatched", 2023-08-01T19:55:22.116 INFO:teuthology.orchestra.run.smithi155.stdout: "time": "2023-08-01T19:55:22.095303+0000", 2023-08-01T19:55:22.116 INFO:teuthology.orchestra.run.smithi155.stdout: "duration": 6.4400000000000002e-06 2023-08-01T19:55:22.116 INFO:teuthology.orchestra.run.smithi155.stdout: }, 2023-08-01T19:55:22.116 INFO:teuthology.orchestra.run.smithi155.stdout: { 2023-08-01T19:55:22.116 INFO:teuthology.orchestra.run.smithi155.stdout: "event": "queued_for_pg", 2023-08-01T19:55:22.116 INFO:teuthology.orchestra.run.smithi155.stdout: "time": "2023-08-01T19:55:22.095307+0000", 2023-08-01T19:55:22.116 INFO:teuthology.orchestra.run.smithi155.stdout: "duration": 4.0239999999999999e-06 2023-08-01T19:55:22.116 INFO:teuthology.orchestra.run.smithi155.stdout: }, 2023-08-01T19:55:22.117 INFO:teuthology.orchestra.run.smithi155.stdout: { 2023-08-01T19:55:22.117 INFO:teuthology.orchestra.run.smithi155.stdout: "event": "reached_pg", 2023-08-01T19:55:22.117 INFO:teuthology.orchestra.run.smithi155.stdout: "time": "2023-08-01T19:55:22.099735+0000", 2023-08-01T19:55:22.117 INFO:teuthology.orchestra.run.smithi155.stdout: "duration": 0.0044277459999999998 2023-08-01T19:55:22.117 INFO:teuthology.orchestra.run.smithi155.stdout: }, 2023-08-01T19:55:22.117 INFO:teuthology.orchestra.run.smithi155.stdout: { 2023-08-01T19:55:22.117 INFO:teuthology.orchestra.run.smithi155.stdout: "event": "started", 2023-08-01T19:55:22.117 INFO:teuthology.orchestra.run.smithi155.stdout: "time": "2023-08-01T19:55:22.099859+0000", 2023-08-01T19:55:22.118 INFO:teuthology.orchestra.run.smithi155.stdout: "duration": 0.00012424199999999999 2023-08-01T19:55:22.118 INFO:teuthology.orchestra.run.smithi155.stdout: }, 2023-08-01T19:55:22.118 INFO:teuthology.orchestra.run.smithi155.stdout: { 2023-08-01T19:55:22.118 INFO:teuthology.orchestra.run.smithi155.stdout: "event": "waiting for subops from 0", 2023-08-01T19:55:22.118 INFO:teuthology.orchestra.run.smithi155.stdout: "time": "2023-08-01T19:55:22.100014+0000", 2023-08-01T19:55:22.118 INFO:teuthology.orchestra.run.smithi155.stdout: "duration": 0.000154642 2023-08-01T19:55:22.118 INFO:teuthology.orchestra.run.smithi155.stdout: } 2023-08-01T19:55:22.118 INFO:teuthology.orchestra.run.smithi155.stdout: ] 2023-08-01T19:55:22.119 INFO:teuthology.orchestra.run.smithi155.stdout: } 2023-08-01T19:55:22.119 INFO:teuthology.orchestra.run.smithi155.stdout: }, 2023-08-01T19:55:22.119 INFO:teuthology.orchestra.run.smithi155.stdout: { 2023-08-01T19:55:22.119 INFO:teuthology.orchestra.run.smithi155.stdout: "description": "osd_op(client.4668.0:129596 5.8 5:11002e97:::benchmark_data_smithi006_114134_object129595:head [set-alloc-hint object_size 65536 write_size 65536,write 0~65536 in=65536b] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e45)", 2023-08-01T19:55:22.119 INFO:teuthology.orchestra.run.smithi155.stdout: "initiated_at": "2023-08-01T19:55:22.097592+0000", 2023-08-01T19:55:22.119 INFO:teuthology.orchestra.run.smithi155.stdout: "age": 0.003400985, 2023-08-01T19:55:22.119 INFO:teuthology.orchestra.run.smithi155.stdout: "duration": 0.0035742009999999999, 2023-08-01T19:55:22.119 INFO:teuthology.orchestra.run.smithi155.stdout: "type_data": { 2023-08-01T19:55:22.120 INFO:teuthology.orchestra.run.smithi155.stdout: "flag_point": "waiting for sub ops", 2023-08-01T19:55:22.120 INFO:teuthology.orchestra.run.smithi155.stdout: "client_info": { 2023-08-01T19:55:22.120 INFO:teuthology.orchestra.run.smithi155.stdout: "client": "client.4668", 2023-08-01T19:55:22.120 INFO:teuthology.orchestra.run.smithi155.stdout: "client_addr": "172.21.15.6:0/1709472247", 2023-08-01T19:55:22.120 INFO:teuthology.orchestra.run.smithi155.stdout: "tid": 129596 2023-08-01T19:55:22.120 INFO:teuthology.orchestra.run.smithi155.stdout: }, 2023-08-01T19:55:22.120 INFO:teuthology.orchestra.run.smithi155.stdout: "events": [ 2023-08-01T19:55:22.120 INFO:teuthology.orchestra.run.smithi155.stdout: { 2023-08-01T19:55:22.121 INFO:teuthology.orchestra.run.smithi155.stdout: "event": "initiated", 2023-08-01T19:55:22.121 INFO:teuthology.orchestra.run.smithi155.stdout: "time": "2023-08-01T19:55:22.097592+0000", 2023-08-01T19:55:22.121 INFO:teuthology.orchestra.run.smithi155.stdout: "duration": 0 2023-08-01T19:55:22.121 INFO:teuthology.orchestra.run.smithi155.stdout: }, 2023-08-01T19:55:22.121 INFO:teuthology.orchestra.run.smithi155.stdout: { 2023-08-01T19:55:22.121 INFO:teuthology.orchestra.run.smithi155.stdout: "event": "throttled", 2023-08-01T19:55:22.121 INFO:teuthology.orchestra.run.smithi155.stdout: "time": "2023-08-01T19:55:22.097592+0000", 2023-08-01T19:55:22.122 INFO:teuthology.orchestra.run.smithi155.stdout: "duration": 0 2023-08-01T19:55:22.122 INFO:teuthology.orchestra.run.smithi155.stdout: }, 2023-08-01T19:55:22.122 INFO:teuthology.orchestra.run.smithi155.stdout: { 2023-08-01T19:55:22.122 INFO:teuthology.orchestra.run.smithi155.stdout: "event": "header_read", 2023-08-01T19:55:22.122 INFO:teuthology.orchestra.run.smithi155.stdout: "time": "2023-08-01T19:55:22.097591+0000", 2023-08-01T19:55:22.122 INFO:teuthology.orchestra.run.smithi155.stdout: "duration": 4294967295.9999986 2023-08-01T19:55:22.122 INFO:teuthology.orchestra.run.smithi155.stdout: }, 2023-08-01T19:55:22.122 INFO:teuthology.orchestra.run.smithi155.stdout: { 2023-08-01T19:55:22.123 INFO:teuthology.orchestra.run.smithi155.stdout: "event": "all_read", 2023-08-01T19:55:22.123 INFO:teuthology.orchestra.run.smithi155.stdout: "time": "2023-08-01T19:55:22.097662+0000", 2023-08-01T19:55:22.123 INFO:teuthology.orchestra.run.smithi155.stdout: "duration": 7.1796000000000002e-05 2023-08-01T19:55:22.123 INFO:teuthology.orchestra.run.smithi155.stdout: }, 2023-08-01T19:55:22.123 INFO:teuthology.orchestra.run.smithi155.stdout: { 2023-08-01T19:55:22.123 INFO:teuthology.orchestra.run.smithi155.stdout: "event": "dispatched", 2023-08-01T19:55:22.123 INFO:teuthology.orchestra.run.smithi155.stdout: "time": "2023-08-01T19:55:22.097674+0000", 2023-08-01T19:55:22.124 INFO:teuthology.orchestra.run.smithi155.stdout: "duration": 1.1955e-05 2023-08-01T19:55:22.124 INFO:teuthology.orchestra.run.smithi155.stdout: }, 2023-08-01T19:55:22.124 INFO:teuthology.orchestra.run.smithi155.stdout: { 2023-08-01T19:55:22.124 INFO:teuthology.orchestra.run.smithi155.stdout: "event": "queued_for_pg", 2023-08-01T19:55:22.124 INFO:teuthology.orchestra.run.smithi155.stdout: "time": "2023-08-01T19:55:22.097680+0000", 2023-08-01T19:55:22.124 INFO:teuthology.orchestra.run.smithi155.stdout: "duration": 5.5110000000000003e-06 2023-08-01T19:55:22.124 INFO:teuthology.orchestra.run.smithi155.stdout: }, 2023-08-01T19:55:22.124 INFO:teuthology.orchestra.run.smithi155.stdout: { 2023-08-01T19:55:22.125 INFO:teuthology.orchestra.run.smithi155.stdout: "event": "reached_pg", 2023-08-01T19:55:22.125 INFO:teuthology.orchestra.run.smithi155.stdout: "time": "2023-08-01T19:55:22.097734+0000", 2023-08-01T19:55:22.125 INFO:teuthology.orchestra.run.smithi155.stdout: "duration": 5.397e-05 2023-08-01T19:55:22.125 INFO:teuthology.orchestra.run.smithi155.stdout: }, 2023-08-01T19:55:22.125 INFO:teuthology.orchestra.run.smithi155.stdout: { 2023-08-01T19:55:22.125 INFO:teuthology.orchestra.run.smithi155.stdout: "event": "started", 2023-08-01T19:55:22.125 INFO:teuthology.orchestra.run.smithi155.stdout: "time": "2023-08-01T19:55:22.097862+0000", 2023-08-01T19:55:22.125 INFO:teuthology.orchestra.run.smithi155.stdout: "duration": 0.00012802000000000001 2023-08-01T19:55:22.126 INFO:teuthology.orchestra.run.smithi155.stdout: }, 2023-08-01T19:55:22.126 INFO:teuthology.orchestra.run.smithi155.stdout: { 2023-08-01T19:55:22.126 INFO:teuthology.orchestra.run.smithi155.stdout: "event": "waiting for subops from 0", 2023-08-01T19:55:22.126 INFO:teuthology.orchestra.run.smithi155.stdout: "time": "2023-08-01T19:55:22.098001+0000", 2023-08-01T19:55:22.126 INFO:teuthology.orchestra.run.smithi155.stdout: "duration": 0.00013889300000000001 2023-08-01T19:55:22.126 INFO:teuthology.orchestra.run.smithi155.stdout: } 2023-08-01T19:55:22.126 INFO:teuthology.orchestra.run.smithi155.stdout: ] 2023-08-01T19:55:22.126 INFO:teuthology.orchestra.run.smithi155.stdout: } 2023-08-01T19:55:22.127 INFO:teuthology.orchestra.run.smithi155.stdout: }, 2023-08-01T19:55:22.127 INFO:teuthology.orchestra.run.smithi155.stdout: { 2023-08-01T19:55:22.127 INFO:teuthology.orchestra.run.smithi155.stdout: "description": "osd_op(client.4668.0:129597 5.d 5:b7aa4de4:::benchmark_data_smithi006_114134_object129596:head [set-alloc-hint object_size 65536 write_size 65536,write 0~65536 in=65536b] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e45)", 2023-08-01T19:55:22.127 INFO:teuthology.orchestra.run.smithi155.stdout: "initiated_at": "2023-08-01T19:55:22.097704+0000", 2023-08-01T19:55:22.127 INFO:teuthology.orchestra.run.smithi155.stdout: "age": 0.0032894809999999999, 2023-08-01T19:55:22.127 INFO:teuthology.orchestra.run.smithi155.stdout: "duration": 0.0035166920000000001, 2023-08-01T19:55:22.127 INFO:teuthology.orchestra.run.smithi155.stdout: "type_data": { 2023-08-01T19:55:22.128 INFO:teuthology.orchestra.run.smithi155.stdout: "flag_point": "waiting for sub ops", 2023-08-01T19:55:22.128 INFO:teuthology.orchestra.run.smithi155.stdout: "client_info": { 2023-08-01T19:55:22.128 INFO:teuthology.orchestra.run.smithi155.stdout: "client": "client.4668", 2023-08-01T19:55:22.128 INFO:teuthology.orchestra.run.smithi155.stdout: "client_addr": "172.21.15.6:0/1709472247", 2023-08-01T19:55:22.128 INFO:teuthology.orchestra.run.smithi155.stdout: "tid": 129597 2023-08-01T19:55:22.128 INFO:teuthology.orchestra.run.smithi155.stdout: }, 2023-08-01T19:55:22.128 INFO:teuthology.orchestra.run.smithi155.stdout: "events": [ 2023-08-01T19:55:22.128 INFO:teuthology.orchestra.run.smithi155.stdout: { 2023-08-01T19:55:22.129 INFO:teuthology.orchestra.run.smithi155.stdout: "event": "initiated", 2023-08-01T19:55:22.129 INFO:teuthology.orchestra.run.smithi155.stdout: "time": "2023-08-01T19:55:22.097704+0000", 2023-08-01T19:55:22.129 INFO:teuthology.orchestra.run.smithi155.stdout: "duration": 0 2023-08-01T19:55:22.129 INFO:teuthology.orchestra.run.smithi155.stdout: }, 2023-08-01T19:55:22.129 INFO:teuthology.orchestra.run.smithi155.stdout: { 2023-08-01T19:55:22.129 INFO:teuthology.orchestra.run.smithi155.stdout: "event": "throttled", 2023-08-01T19:55:22.129 INFO:teuthology.orchestra.run.smithi155.stdout: "time": "2023-08-01T19:55:22.097704+0000", 2023-08-01T19:55:22.129 INFO:teuthology.orchestra.run.smithi155.stdout: "duration": 0 2023-08-01T19:55:22.130 INFO:teuthology.orchestra.run.smithi155.stdout: }, 2023-08-01T19:55:22.130 INFO:teuthology.orchestra.run.smithi155.stdout: { 2023-08-01T19:55:22.130 INFO:teuthology.orchestra.run.smithi155.stdout: "event": "header_read", 2023-08-01T19:55:22.130 INFO:teuthology.orchestra.run.smithi155.stdout: "time": "2023-08-01T19:55:22.097703+0000", 2023-08-01T19:55:22.130 INFO:teuthology.orchestra.run.smithi155.stdout: "duration": 4294967295.9999995 2023-08-01T19:55:22.130 INFO:teuthology.orchestra.run.smithi155.stdout: }, 2023-08-01T19:55:22.130 INFO:teuthology.orchestra.run.smithi155.stdout: { 2023-08-01T19:55:22.131 INFO:teuthology.orchestra.run.smithi155.stdout: "event": "all_read", 2023-08-01T19:55:22.131 INFO:teuthology.orchestra.run.smithi155.stdout: "time": "2023-08-01T19:55:22.097742+0000", 2023-08-01T19:55:22.131 INFO:teuthology.orchestra.run.smithi155.stdout: "duration": 3.8776000000000003e-05 2023-08-01T19:55:22.131 INFO:teuthology.orchestra.run.smithi155.stdout: }, 2023-08-01T19:55:22.131 INFO:teuthology.orchestra.run.smithi155.stdout: { 2023-08-01T19:55:22.131 INFO:teuthology.orchestra.run.smithi155.stdout: "event": "dispatched", 2023-08-01T19:55:22.131 INFO:teuthology.orchestra.run.smithi155.stdout: "time": "2023-08-01T19:55:22.097749+0000", 2023-08-01T19:55:22.131 INFO:teuthology.orchestra.run.smithi155.stdout: "duration": 7.3119999999999996e-06 2023-08-01T19:55:22.132 INFO:teuthology.orchestra.run.smithi155.stdout: }, 2023-08-01T19:55:22.132 INFO:teuthology.orchestra.run.smithi155.stdout: { 2023-08-01T19:55:22.132 INFO:teuthology.orchestra.run.smithi155.stdout: "event": "queued_for_pg", 2023-08-01T19:55:22.132 INFO:teuthology.orchestra.run.smithi155.stdout: "time": "2023-08-01T19:55:22.097768+0000", 2023-08-01T19:55:22.132 INFO:teuthology.orchestra.run.smithi155.stdout: "duration": 1.9426e-05 2023-08-01T19:55:22.132 INFO:teuthology.orchestra.run.smithi155.stdout: }, 2023-08-01T19:55:22.132 INFO:teuthology.orchestra.run.smithi155.stdout: { 2023-08-01T19:55:22.132 INFO:teuthology.orchestra.run.smithi155.stdout: "event": "reached_pg", 2023-08-01T19:55:22.133 INFO:teuthology.orchestra.run.smithi155.stdout: "time": "2023-08-01T19:55:22.097806+0000", 2023-08-01T19:55:22.133 INFO:teuthology.orchestra.run.smithi155.stdout: "duration": 3.7475999999999998e-05 2023-08-01T19:55:22.133 INFO:teuthology.orchestra.run.smithi155.stdout: }, 2023-08-01T19:55:22.133 INFO:teuthology.orchestra.run.smithi155.stdout: { 2023-08-01T19:55:22.133 INFO:teuthology.orchestra.run.smithi155.stdout: "event": "started", 2023-08-01T19:55:22.133 INFO:teuthology.orchestra.run.smithi155.stdout: "time": "2023-08-01T19:55:22.097920+0000", 2023-08-01T19:55:22.133 INFO:teuthology.orchestra.run.smithi155.stdout: "duration": 0.000114355 2023-08-01T19:55:22.133 INFO:teuthology.orchestra.run.smithi155.stdout: }, 2023-08-01T19:55:22.134 INFO:teuthology.orchestra.run.smithi155.stdout: { 2023-08-01T19:55:22.134 INFO:teuthology.orchestra.run.smithi155.stdout: "event": "waiting for subops from 1", 2023-08-01T19:55:22.134 INFO:teuthology.orchestra.run.smithi155.stdout: "time": "2023-08-01T19:55:22.098061+0000", 2023-08-01T19:55:22.134 INFO:teuthology.orchestra.run.smithi155.stdout: "duration": 0.000141237 2023-08-01T19:55:22.134 INFO:teuthology.orchestra.run.smithi155.stdout: } 2023-08-01T19:55:22.134 INFO:teuthology.orchestra.run.smithi155.stdout: ] 2023-08-01T19:55:22.134 INFO:teuthology.orchestra.run.smithi155.stdout: } 2023-08-01T19:55:22.134 INFO:teuthology.orchestra.run.smithi155.stdout: }, 2023-08-01T19:55:22.135 INFO:teuthology.orchestra.run.smithi155.stdout: { 2023-08-01T19:55:22.135 INFO:teuthology.orchestra.run.smithi155.stdout: "description": "osd_op(client.4668.0:129598 5.d 5:b02da988:::benchmark_data_smithi006_114134_object129597:head [set-alloc-hint object_size 65536 write_size 65536,write 0~65536 in=65536b] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e45)", 2023-08-01T19:55:22.135 INFO:teuthology.orchestra.run.smithi155.stdout: "initiated_at": "2023-08-01T19:55:22.097777+0000", 2023-08-01T19:55:22.135 INFO:teuthology.orchestra.run.smithi155.stdout: "age": 0.0032156200000000002, 2023-08-01T19:55:22.135 INFO:teuthology.orchestra.run.smithi155.stdout: "duration": 0.0034877990000000002, 2023-08-01T19:55:22.135 INFO:teuthology.orchestra.run.smithi155.stdout: "type_data": { 2023-08-01T19:55:22.135 INFO:teuthology.orchestra.run.smithi155.stdout: "flag_point": "waiting for sub ops", 2023-08-01T19:55:22.136 INFO:teuthology.orchestra.run.smithi155.stdout: "client_info": { 2023-08-01T19:55:22.136 INFO:teuthology.orchestra.run.smithi155.stdout: "client": "client.4668", 2023-08-01T19:55:22.136 INFO:teuthology.orchestra.run.smithi155.stdout: "client_addr": "172.21.15.6:0/1709472247", 2023-08-01T19:55:22.136 INFO:teuthology.orchestra.run.smithi155.stdout: "tid": 129598 2023-08-01T19:55:22.136 INFO:teuthology.orchestra.run.smithi155.stdout: }, 2023-08-01T19:55:22.136 INFO:teuthology.orchestra.run.smithi155.stdout: "events": [ 2023-08-01T19:55:22.136 INFO:teuthology.orchestra.run.smithi155.stdout: { 2023-08-01T19:55:22.136 INFO:teuthology.orchestra.run.smithi155.stdout: "event": "initiated", 2023-08-01T19:55:22.137 INFO:teuthology.orchestra.run.smithi155.stdout: "time": "2023-08-01T19:55:22.097777+0000", 2023-08-01T19:55:22.137 INFO:teuthology.orchestra.run.smithi155.stdout: "duration": 0 2023-08-01T19:55:22.137 INFO:teuthology.orchestra.run.smithi155.stdout: }, 2023-08-01T19:55:22.137 INFO:teuthology.orchestra.run.smithi155.stdout: { 2023-08-01T19:55:22.137 INFO:teuthology.orchestra.run.smithi155.stdout: "event": "throttled", 2023-08-01T19:55:22.137 INFO:teuthology.orchestra.run.smithi155.stdout: "time": "2023-08-01T19:55:22.097777+0000", 2023-08-01T19:55:22.137 INFO:teuthology.orchestra.run.smithi155.stdout: "duration": 0 2023-08-01T19:55:22.138 INFO:teuthology.orchestra.run.smithi155.stdout: }, 2023-08-01T19:55:22.138 INFO:teuthology.orchestra.run.smithi155.stdout: { 2023-08-01T19:55:22.138 INFO:teuthology.orchestra.run.smithi155.stdout: "event": "header_read", 2023-08-01T19:55:22.138 INFO:teuthology.orchestra.run.smithi155.stdout: "time": "2023-08-01T19:55:22.097777+0000", 2023-08-01T19:55:22.138 INFO:teuthology.orchestra.run.smithi155.stdout: "duration": 4294967295.9999995 2023-08-01T19:55:22.138 INFO:teuthology.orchestra.run.smithi155.stdout: }, 2023-08-01T19:55:22.138 INFO:teuthology.orchestra.run.smithi155.stdout: { 2023-08-01T19:55:22.138 INFO:teuthology.orchestra.run.smithi155.stdout: "event": "all_read", 2023-08-01T19:55:22.139 INFO:teuthology.orchestra.run.smithi155.stdout: "time": "2023-08-01T19:55:22.097816+0000", 2023-08-01T19:55:22.139 INFO:teuthology.orchestra.run.smithi155.stdout: "duration": 3.8897999999999999e-05 2023-08-01T19:55:22.139 INFO:teuthology.orchestra.run.smithi155.stdout: }, 2023-08-01T19:55:22.139 INFO:teuthology.orchestra.run.smithi155.stdout: { 2023-08-01T19:55:22.139 INFO:teuthology.orchestra.run.smithi155.stdout: "event": "dispatched", 2023-08-01T19:55:22.139 INFO:teuthology.orchestra.run.smithi155.stdout: "time": "2023-08-01T19:55:22.097824+0000", 2023-08-01T19:55:22.139 INFO:teuthology.orchestra.run.smithi155.stdout: "duration": 8.3129999999999999e-06 2023-08-01T19:55:22.139 INFO:teuthology.orchestra.run.smithi155.stdout: }, 2023-08-01T19:55:22.140 INFO:teuthology.orchestra.run.smithi155.stdout: { 2023-08-01T19:55:22.140 INFO:teuthology.orchestra.run.smithi155.stdout: "event": "queued_for_pg", 2023-08-01T19:55:22.140 INFO:teuthology.orchestra.run.smithi155.stdout: "time": "2023-08-01T19:55:22.097832+0000", 2023-08-01T19:55:22.140 INFO:teuthology.orchestra.run.smithi155.stdout: "duration": 7.9440000000000005e-06 2023-08-01T19:55:22.140 INFO:teuthology.orchestra.run.smithi155.stdout: }, 2023-08-01T19:55:22.140 INFO:teuthology.orchestra.run.smithi155.stdout: { 2023-08-01T19:55:22.140 INFO:teuthology.orchestra.run.smithi155.stdout: "event": "reached_pg", 2023-08-01T19:55:22.140 INFO:teuthology.orchestra.run.smithi155.stdout: "time": "2023-08-01T19:55:22.099759+0000", 2023-08-01T19:55:22.141 INFO:teuthology.orchestra.run.smithi155.stdout: "duration": 0.0019269440000000001 2023-08-01T19:55:22.141 INFO:teuthology.orchestra.run.smithi155.stdout: }, 2023-08-01T19:55:22.141 INFO:teuthology.orchestra.run.smithi155.stdout: { 2023-08-01T19:55:22.141 INFO:teuthology.orchestra.run.smithi155.stdout: "event": "started", 2023-08-01T19:55:22.141 INFO:teuthology.orchestra.run.smithi155.stdout: "time": "2023-08-01T19:55:22.099869+0000", 2023-08-01T19:55:22.141 INFO:teuthology.orchestra.run.smithi155.stdout: "duration": 0.000109645 2023-08-01T19:55:22.141 INFO:teuthology.orchestra.run.smithi155.stdout: }, 2023-08-01T19:55:22.141 INFO:teuthology.orchestra.run.smithi155.stdout: { 2023-08-01T19:55:22.142 INFO:teuthology.orchestra.run.smithi155.stdout: "event": "waiting for subops from 1", 2023-08-01T19:55:22.142 INFO:teuthology.orchestra.run.smithi155.stdout: "time": "2023-08-01T19:55:22.099953+0000", 2023-08-01T19:55:22.142 INFO:teuthology.orchestra.run.smithi155.stdout: "duration": 8.4728000000000006e-05 2023-08-01T19:55:22.142 INFO:teuthology.orchestra.run.smithi155.stdout: } 2023-08-01T19:55:22.142 INFO:teuthology.orchestra.run.smithi155.stdout: ] 2023-08-01T19:55:22.142 INFO:teuthology.orchestra.run.smithi155.stdout: } 2023-08-01T19:55:22.142 INFO:teuthology.orchestra.run.smithi155.stdout: }, 2023-08-01T19:55:22.142 INFO:teuthology.orchestra.run.smithi155.stdout: { 2023-08-01T19:55:22.143 INFO:teuthology.orchestra.run.smithi155.stdout: "description": "osd_op(client.4668.0:129599 5.f 5:f31fa776:::benchmark_data_smithi006_114134_object129598:head [set-alloc-hint object_size 65536 write_size 65536,write 0~65536 in=65536b] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e45)", 2023-08-01T19:55:22.143 INFO:teuthology.orchestra.run.smithi155.stdout: "initiated_at": "2023-08-01T19:55:22.097838+0000", 2023-08-01T19:55:22.143 INFO:teuthology.orchestra.run.smithi155.stdout: "age": 0.0031545560000000002, 2023-08-01T19:55:22.143 INFO:teuthology.orchestra.run.smithi155.stdout: "duration": 0.0034733810000000002, 2023-08-01T19:55:22.143 INFO:teuthology.orchestra.run.smithi155.stdout: "type_data": { 2023-08-01T19:55:22.143 INFO:teuthology.orchestra.run.smithi155.stdout: "flag_point": "waiting for sub ops", 2023-08-01T19:55:22.143 INFO:teuthology.orchestra.run.smithi155.stdout: "client_info": { 2023-08-01T19:55:22.143 INFO:teuthology.orchestra.run.smithi155.stdout: "client": "client.4668", 2023-08-01T19:55:22.144 INFO:teuthology.orchestra.run.smithi155.stdout: "client_addr": "172.21.15.6:0/1709472247", 2023-08-01T19:55:22.144 INFO:teuthology.orchestra.run.smithi155.stdout: "tid": 129599 2023-08-01T19:55:22.144 INFO:teuthology.orchestra.run.smithi155.stdout: }, 2023-08-01T19:55:22.144 INFO:teuthology.orchestra.run.smithi155.stdout: "events": [ 2023-08-01T19:55:22.144 INFO:teuthology.orchestra.run.smithi155.stdout: { 2023-08-01T19:55:22.144 INFO:teuthology.orchestra.run.smithi155.stdout: "event": "initiated", 2023-08-01T19:55:22.144 INFO:teuthology.orchestra.run.smithi155.stdout: "time": "2023-08-01T19:55:22.097838+0000", 2023-08-01T19:55:22.145 INFO:teuthology.orchestra.run.smithi155.stdout: "duration": 0 2023-08-01T19:55:22.145 INFO:teuthology.orchestra.run.smithi155.stdout: }, 2023-08-01T19:55:22.145 INFO:teuthology.orchestra.run.smithi155.stdout: { 2023-08-01T19:55:22.145 INFO:teuthology.orchestra.run.smithi155.stdout: "event": "throttled", 2023-08-01T19:55:22.145 INFO:teuthology.orchestra.run.smithi155.stdout: "time": "2023-08-01T19:55:22.097838+0000", 2023-08-01T19:55:22.145 INFO:teuthology.orchestra.run.smithi155.stdout: "duration": 0 2023-08-01T19:55:22.145 INFO:teuthology.orchestra.run.smithi155.stdout: }, 2023-08-01T19:55:22.145 INFO:teuthology.orchestra.run.smithi155.stdout: { 2023-08-01T19:55:22.146 INFO:teuthology.orchestra.run.smithi155.stdout: "event": "header_read", 2023-08-01T19:55:22.146 INFO:teuthology.orchestra.run.smithi155.stdout: "time": "2023-08-01T19:55:22.097838+0000", 2023-08-01T19:55:22.146 INFO:teuthology.orchestra.run.smithi155.stdout: "duration": 4294967295.9999995 2023-08-01T19:55:22.146 INFO:teuthology.orchestra.run.smithi155.stdout: }, 2023-08-01T19:55:22.146 INFO:teuthology.orchestra.run.smithi155.stdout: { 2023-08-01T19:55:22.146 INFO:teuthology.orchestra.run.smithi155.stdout: "event": "all_read", 2023-08-01T19:55:22.146 INFO:teuthology.orchestra.run.smithi155.stdout: "time": "2023-08-01T19:55:22.097882+0000", 2023-08-01T19:55:22.146 INFO:teuthology.orchestra.run.smithi155.stdout: "duration": 4.4468000000000002e-05 2023-08-01T19:55:22.147 INFO:teuthology.orchestra.run.smithi155.stdout: }, 2023-08-01T19:55:22.147 INFO:teuthology.orchestra.run.smithi155.stdout: { 2023-08-01T19:55:22.147 INFO:teuthology.orchestra.run.smithi155.stdout: "event": "dispatched", 2023-08-01T19:55:22.147 INFO:teuthology.orchestra.run.smithi155.stdout: "time": "2023-08-01T19:55:22.097890+0000", 2023-08-01T19:55:22.147 INFO:teuthology.orchestra.run.smithi155.stdout: "duration": 7.3549999999999999e-06 2023-08-01T19:55:22.147 INFO:teuthology.orchestra.run.smithi155.stdout: }, 2023-08-01T19:55:22.147 INFO:teuthology.orchestra.run.smithi155.stdout: { 2023-08-01T19:55:22.148 INFO:teuthology.orchestra.run.smithi155.stdout: "event": "queued_for_pg", 2023-08-01T19:55:22.148 INFO:teuthology.orchestra.run.smithi155.stdout: "time": "2023-08-01T19:55:22.097894+0000", 2023-08-01T19:55:22.148 INFO:teuthology.orchestra.run.smithi155.stdout: "duration": 3.9929999999999997e-06 2023-08-01T19:55:22.148 INFO:teuthology.orchestra.run.smithi155.stdout: }, 2023-08-01T19:55:22.148 INFO:teuthology.orchestra.run.smithi155.stdout: { 2023-08-01T19:55:22.148 INFO:teuthology.orchestra.run.smithi155.stdout: "event": "reached_pg", 2023-08-01T19:55:22.148 INFO:teuthology.orchestra.run.smithi155.stdout: "time": "2023-08-01T19:55:22.097928+0000", 2023-08-01T19:55:22.148 INFO:teuthology.orchestra.run.smithi155.stdout: "duration": 3.4050000000000001e-05 2023-08-01T19:55:22.149 INFO:teuthology.orchestra.run.smithi155.stdout: }, 2023-08-01T19:55:22.149 INFO:teuthology.orchestra.run.smithi155.stdout: { 2023-08-01T19:55:22.149 INFO:teuthology.orchestra.run.smithi155.stdout: "event": "started", 2023-08-01T19:55:22.149 INFO:teuthology.orchestra.run.smithi155.stdout: "time": "2023-08-01T19:55:22.098041+0000", 2023-08-01T19:55:22.149 INFO:teuthology.orchestra.run.smithi155.stdout: "duration": 0.00011355 2023-08-01T19:55:22.149 INFO:teuthology.orchestra.run.smithi155.stdout: }, 2023-08-01T19:55:22.149 INFO:teuthology.orchestra.run.smithi155.stdout: { 2023-08-01T19:55:22.150 INFO:teuthology.orchestra.run.smithi155.stdout: "event": "waiting for subops from 1", 2023-08-01T19:55:22.150 INFO:teuthology.orchestra.run.smithi155.stdout: "time": "2023-08-01T19:55:22.098168+0000", 2023-08-01T19:55:22.150 INFO:teuthology.orchestra.run.smithi155.stdout: "duration": 0.00012676199999999999 2023-08-01T19:55:22.150 INFO:teuthology.orchestra.run.smithi155.stdout: } 2023-08-01T19:55:22.150 INFO:teuthology.orchestra.run.smithi155.stdout: ] 2023-08-01T19:55:22.150 INFO:teuthology.orchestra.run.smithi155.stdout: } 2023-08-01T19:55:22.150 INFO:teuthology.orchestra.run.smithi155.stdout: }, 2023-08-01T19:55:22.150 INFO:teuthology.orchestra.run.smithi155.stdout: { 2023-08-01T19:55:22.151 INFO:teuthology.orchestra.run.smithi155.stdout: "description": "osd_op(client.4668.0:129601 5.d 5.8a63abed (undecoded) ondisk+write+known_if_redirected+supports_pool_eio e45)", 2023-08-01T19:55:22.151 INFO:teuthology.orchestra.run.smithi155.stdout: "initiated_at": "2023-08-01T19:55:22.098747+0000", 2023-08-01T19:55:22.151 INFO:teuthology.orchestra.run.smithi155.stdout: "age": 0.0022460869999999999, 2023-08-01T19:55:22.151 INFO:teuthology.orchestra.run.smithi155.stdout: "duration": 0.0026065519999999998, 2023-08-01T19:55:22.151 INFO:teuthology.orchestra.run.smithi155.stdout: "type_data": { 2023-08-01T19:55:22.151 INFO:teuthology.orchestra.run.smithi155.stdout: "flag_point": "queued for pg", 2023-08-01T19:55:22.151 INFO:teuthology.orchestra.run.smithi155.stdout: "client_info": { 2023-08-01T19:55:22.151 INFO:teuthology.orchestra.run.smithi155.stdout: "client": "client.4668", 2023-08-01T19:55:22.152 INFO:teuthology.orchestra.run.smithi155.stdout: "client_addr": "172.21.15.6:0/1709472247", 2023-08-01T19:55:22.152 INFO:teuthology.orchestra.run.smithi155.stdout: "tid": 129601 2023-08-01T19:55:22.152 INFO:teuthology.orchestra.run.smithi155.stdout: }, 2023-08-01T19:55:22.152 INFO:teuthology.orchestra.run.smithi155.stdout: "events": [ 2023-08-01T19:55:22.152 INFO:teuthology.orchestra.run.smithi155.stdout: { 2023-08-01T19:55:22.152 INFO:teuthology.orchestra.run.smithi155.stdout: "event": "initiated", 2023-08-01T19:55:22.152 INFO:teuthology.orchestra.run.smithi155.stdout: "time": "2023-08-01T19:55:22.098747+0000", 2023-08-01T19:55:22.153 INFO:teuthology.orchestra.run.smithi155.stdout: "duration": 0 2023-08-01T19:55:22.153 INFO:teuthology.orchestra.run.smithi155.stdout: }, 2023-08-01T19:55:22.153 INFO:teuthology.orchestra.run.smithi155.stdout: { 2023-08-01T19:55:22.153 INFO:teuthology.orchestra.run.smithi155.stdout: "event": "throttled", 2023-08-01T19:55:22.153 INFO:teuthology.orchestra.run.smithi155.stdout: "time": "2023-08-01T19:55:22.098747+0000", 2023-08-01T19:55:22.153 INFO:teuthology.orchestra.run.smithi155.stdout: "duration": 0 2023-08-01T19:55:22.153 INFO:teuthology.orchestra.run.smithi155.stdout: }, 2023-08-01T19:55:22.154 INFO:teuthology.orchestra.run.smithi155.stdout: { 2023-08-01T19:55:22.154 INFO:teuthology.orchestra.run.smithi155.stdout: "event": "header_read", 2023-08-01T19:55:22.154 INFO:teuthology.orchestra.run.smithi155.stdout: "time": "2023-08-01T19:55:22.098746+0000", 2023-08-01T19:55:22.154 INFO:teuthology.orchestra.run.smithi155.stdout: "duration": 4294967295.999999 2023-08-01T19:55:22.154 INFO:teuthology.orchestra.run.smithi155.stdout: }, 2023-08-01T19:55:22.154 INFO:teuthology.orchestra.run.smithi155.stdout: { 2023-08-01T19:55:22.154 INFO:teuthology.orchestra.run.smithi155.stdout: "event": "all_read", 2023-08-01T19:55:22.154 INFO:teuthology.orchestra.run.smithi155.stdout: "time": "2023-08-01T19:55:22.098813+0000", 2023-08-01T19:55:22.155 INFO:teuthology.orchestra.run.smithi155.stdout: "duration": 6.7416000000000006e-05 2023-08-01T19:55:22.155 INFO:teuthology.orchestra.run.smithi155.stdout: }, 2023-08-01T19:55:22.155 INFO:teuthology.orchestra.run.smithi155.stdout: { 2023-08-01T19:55:22.155 INFO:teuthology.orchestra.run.smithi155.stdout: "event": "dispatched", 2023-08-01T19:55:22.155 INFO:teuthology.orchestra.run.smithi155.stdout: "time": "2023-08-01T19:55:22.098825+0000", 2023-08-01T19:55:22.155 INFO:teuthology.orchestra.run.smithi155.stdout: "duration": 1.1931e-05 2023-08-01T19:55:22.155 INFO:teuthology.orchestra.run.smithi155.stdout: }, 2023-08-01T19:55:22.156 INFO:teuthology.orchestra.run.smithi155.stdout: { 2023-08-01T19:55:22.156 INFO:teuthology.orchestra.run.smithi155.stdout: "event": "queued_for_pg", 2023-08-01T19:55:22.156 INFO:teuthology.orchestra.run.smithi155.stdout: "time": "2023-08-01T19:55:22.098831+0000", 2023-08-01T19:55:22.156 INFO:teuthology.orchestra.run.smithi155.stdout: "duration": 5.9279999999999998e-06 2023-08-01T19:55:22.156 INFO:teuthology.orchestra.run.smithi155.stdout: } 2023-08-01T19:55:22.156 INFO:teuthology.orchestra.run.smithi155.stdout: ] 2023-08-01T19:55:22.156 INFO:teuthology.orchestra.run.smithi155.stdout: } 2023-08-01T19:55:22.156 INFO:teuthology.orchestra.run.smithi155.stdout: }, 2023-08-01T19:55:22.157 INFO:teuthology.orchestra.run.smithi155.stdout: { 2023-08-01T19:55:22.157 INFO:teuthology.orchestra.run.smithi155.stdout: "description": "osd_op(client.4668.0:129588 5.4 5:2e5de5c4:::benchmark_data_smithi006_114134_object129587:head [set-alloc-hint object_size 65536 write_size 65536,write 0~65536 in=65536b] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e45)", 2023-08-01T19:55:22.157 INFO:teuthology.orchestra.run.smithi155.stdout: "initiated_at": "2023-08-01T19:55:22.091938+0000", 2023-08-01T19:55:22.157 INFO:teuthology.orchestra.run.smithi155.stdout: "age": 0.0090553590000000007, 2023-08-01T19:55:22.157 INFO:teuthology.orchestra.run.smithi155.stdout: "duration": 0.0094578449999999994, 2023-08-01T19:55:22.157 INFO:teuthology.orchestra.run.smithi155.stdout: "type_data": { 2023-08-01T19:55:22.157 INFO:teuthology.orchestra.run.smithi155.stdout: "flag_point": "waiting for sub ops", 2023-08-01T19:55:22.157 INFO:teuthology.orchestra.run.smithi155.stdout: "client_info": { 2023-08-01T19:55:22.158 INFO:teuthology.orchestra.run.smithi155.stdout: "client": "client.4668", 2023-08-01T19:55:22.158 INFO:teuthology.orchestra.run.smithi155.stdout: "client_addr": "172.21.15.6:0/1709472247", 2023-08-01T19:55:22.158 INFO:teuthology.orchestra.run.smithi155.stdout: "tid": 129588 2023-08-01T19:55:22.158 INFO:teuthology.orchestra.run.smithi155.stdout: }, 2023-08-01T19:55:22.158 INFO:teuthology.orchestra.run.smithi155.stdout: "events": [ 2023-08-01T19:55:22.158 INFO:teuthology.orchestra.run.smithi155.stdout: { 2023-08-01T19:55:22.158 INFO:teuthology.orchestra.run.smithi155.stdout: "event": "initiated", 2023-08-01T19:55:22.159 INFO:teuthology.orchestra.run.smithi155.stdout: "time": "2023-08-01T19:55:22.091938+0000", 2023-08-01T19:55:22.159 INFO:teuthology.orchestra.run.smithi155.stdout: "duration": 0 2023-08-01T19:55:22.159 INFO:teuthology.orchestra.run.smithi155.stdout: }, 2023-08-01T19:55:22.159 INFO:teuthology.orchestra.run.smithi155.stdout: { 2023-08-01T19:55:22.159 INFO:teuthology.orchestra.run.smithi155.stdout: "event": "throttled", 2023-08-01T19:55:22.159 INFO:teuthology.orchestra.run.smithi155.stdout: "time": "2023-08-01T19:55:22.091938+0000", 2023-08-01T19:55:22.159 INFO:teuthology.orchestra.run.smithi155.stdout: "duration": 0 2023-08-01T19:55:22.159 INFO:teuthology.orchestra.run.smithi155.stdout: }, 2023-08-01T19:55:22.160 INFO:teuthology.orchestra.run.smithi155.stdout: { 2023-08-01T19:55:22.160 INFO:teuthology.orchestra.run.smithi155.stdout: "event": "header_read", 2023-08-01T19:55:22.160 INFO:teuthology.orchestra.run.smithi155.stdout: "time": "2023-08-01T19:55:22.091937+0000", 2023-08-01T19:55:22.160 INFO:teuthology.orchestra.run.smithi155.stdout: "duration": 4294967295.9999995 2023-08-01T19:55:22.160 INFO:teuthology.orchestra.run.smithi155.stdout: }, 2023-08-01T19:55:22.160 INFO:teuthology.orchestra.run.smithi155.stdout: { 2023-08-01T19:55:22.160 INFO:teuthology.orchestra.run.smithi155.stdout: "event": "all_read", 2023-08-01T19:55:22.161 INFO:teuthology.orchestra.run.smithi155.stdout: "time": "2023-08-01T19:55:22.091968+0000", 2023-08-01T19:55:22.161 INFO:teuthology.orchestra.run.smithi155.stdout: "duration": 3.0524000000000001e-05 2023-08-01T19:55:22.161 INFO:teuthology.orchestra.run.smithi155.stdout: }, 2023-08-01T19:55:22.161 INFO:teuthology.orchestra.run.smithi155.stdout: { 2023-08-01T19:55:22.161 INFO:teuthology.orchestra.run.smithi155.stdout: "event": "dispatched", 2023-08-01T19:55:22.161 INFO:teuthology.orchestra.run.smithi155.stdout: "time": "2023-08-01T19:55:22.091977+0000", 2023-08-01T19:55:22.161 INFO:teuthology.orchestra.run.smithi155.stdout: "duration": 9.7259999999999997e-06 2023-08-01T19:55:22.161 INFO:teuthology.orchestra.run.smithi155.stdout: }, 2023-08-01T19:55:22.162 INFO:teuthology.orchestra.run.smithi155.stdout: { 2023-08-01T19:55:22.162 INFO:teuthology.orchestra.run.smithi155.stdout: "event": "queued_for_pg", 2023-08-01T19:55:22.162 INFO:teuthology.orchestra.run.smithi155.stdout: "time": "2023-08-01T19:55:22.091982+0000", 2023-08-01T19:55:22.162 INFO:teuthology.orchestra.run.smithi155.stdout: "duration": 4.296e-06 2023-08-01T19:55:22.162 INFO:teuthology.orchestra.run.smithi155.stdout: }, 2023-08-01T19:55:22.162 INFO:teuthology.orchestra.run.smithi155.stdout: { 2023-08-01T19:55:22.162 INFO:teuthology.orchestra.run.smithi155.stdout: "event": "reached_pg", 2023-08-01T19:55:22.162 INFO:teuthology.orchestra.run.smithi155.stdout: "time": "2023-08-01T19:55:22.093135+0000", 2023-08-01T19:55:22.163 INFO:teuthology.orchestra.run.smithi155.stdout: "duration": 0.001153694 2023-08-01T19:55:22.163 INFO:teuthology.orchestra.run.smithi155.stdout: }, 2023-08-01T19:55:22.163 INFO:teuthology.orchestra.run.smithi155.stdout: { 2023-08-01T19:55:22.163 INFO:teuthology.orchestra.run.smithi155.stdout: "event": "started", 2023-08-01T19:55:22.163 INFO:teuthology.orchestra.run.smithi155.stdout: "time": "2023-08-01T19:55:22.093254+0000", 2023-08-01T19:55:22.163 INFO:teuthology.orchestra.run.smithi155.stdout: "duration": 0.000118502 2023-08-01T19:55:22.163 INFO:teuthology.orchestra.run.smithi155.stdout: }, 2023-08-01T19:55:22.163 INFO:teuthology.orchestra.run.smithi155.stdout: { 2023-08-01T19:55:22.164 INFO:teuthology.orchestra.run.smithi155.stdout: "event": "waiting for subops from 0", 2023-08-01T19:55:22.164 INFO:teuthology.orchestra.run.smithi155.stdout: "time": "2023-08-01T19:55:22.093373+0000", 2023-08-01T19:55:22.164 INFO:teuthology.orchestra.run.smithi155.stdout: "duration": 0.000119604 2023-08-01T19:55:22.164 INFO:teuthology.orchestra.run.smithi155.stdout: }, 2023-08-01T19:55:22.164 INFO:teuthology.orchestra.run.smithi155.stdout: { 2023-08-01T19:55:22.164 INFO:teuthology.orchestra.run.smithi155.stdout: "event": "sub_op_commit_rec", 2023-08-01T19:55:22.164 INFO:teuthology.orchestra.run.smithi155.stdout: "time": "2023-08-01T19:55:22.099513+0000", 2023-08-01T19:55:22.165 INFO:teuthology.orchestra.run.smithi155.stdout: "duration": 0.0061397450000000003 2023-08-01T19:55:22.165 INFO:teuthology.orchestra.run.smithi155.stdout: } 2023-08-01T19:55:22.165 INFO:teuthology.orchestra.run.smithi155.stdout: ] 2023-08-01T19:55:22.165 INFO:teuthology.orchestra.run.smithi155.stdout: } 2023-08-01T19:55:22.165 INFO:teuthology.orchestra.run.smithi155.stdout: }, 2023-08-01T19:55:22.165 INFO:teuthology.orchestra.run.smithi155.stdout: { 2023-08-01T19:55:22.165 INFO:teuthology.orchestra.run.smithi155.stdout: "description": "osd_op(client.4668.0:129589 5.e 5:7d0ac426:::benchmark_data_smithi006_114134_object129588:head [set-alloc-hint object_size 65536 write_size 65536,write 0~65536 in=65536b] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e45)", 2023-08-01T19:55:22.165 INFO:teuthology.orchestra.run.smithi155.stdout: "initiated_at": "2023-08-01T19:55:22.093716+0000", 2023-08-01T19:55:22.166 INFO:teuthology.orchestra.run.smithi155.stdout: "age": 0.0072768609999999999, 2023-08-01T19:55:22.166 INFO:teuthology.orchestra.run.smithi155.stdout: "duration": 0.0077354349999999997, 2023-08-01T19:55:22.166 INFO:teuthology.orchestra.run.smithi155.stdout: "type_data": { 2023-08-01T19:55:22.166 INFO:teuthology.orchestra.run.smithi155.stdout: "flag_point": "waiting for sub ops", 2023-08-01T19:55:22.166 INFO:teuthology.orchestra.run.smithi155.stdout: "client_info": { 2023-08-01T19:55:22.166 INFO:teuthology.orchestra.run.smithi155.stdout: "client": "client.4668", 2023-08-01T19:55:22.166 INFO:teuthology.orchestra.run.smithi155.stdout: "client_addr": "172.21.15.6:0/1709472247", 2023-08-01T19:55:22.166 INFO:teuthology.orchestra.run.smithi155.stdout: "tid": 129589 2023-08-01T19:55:22.167 INFO:teuthology.orchestra.run.smithi155.stdout: }, 2023-08-01T19:55:22.167 INFO:teuthology.orchestra.run.smithi155.stdout: "events": [ 2023-08-01T19:55:22.167 INFO:teuthology.orchestra.run.smithi155.stdout: { 2023-08-01T19:55:22.167 INFO:teuthology.orchestra.run.smithi155.stdout: "event": "initiated", 2023-08-01T19:55:22.167 INFO:teuthology.orchestra.run.smithi155.stdout: "time": "2023-08-01T19:55:22.093716+0000", 2023-08-01T19:55:22.167 INFO:teuthology.orchestra.run.smithi155.stdout: "duration": 0 2023-08-01T19:55:22.167 INFO:teuthology.orchestra.run.smithi155.stdout: }, 2023-08-01T19:55:22.167 INFO:teuthology.orchestra.run.smithi155.stdout: { 2023-08-01T19:55:22.168 INFO:teuthology.orchestra.run.smithi155.stdout: "event": "throttled", 2023-08-01T19:55:22.168 INFO:teuthology.orchestra.run.smithi155.stdout: "time": "2023-08-01T19:55:22.093716+0000", 2023-08-01T19:55:22.168 INFO:teuthology.orchestra.run.smithi155.stdout: "duration": 0 2023-08-01T19:55:22.168 INFO:teuthology.orchestra.run.smithi155.stdout: }, 2023-08-01T19:55:22.168 INFO:teuthology.orchestra.run.smithi155.stdout: { 2023-08-01T19:55:22.168 INFO:teuthology.orchestra.run.smithi155.stdout: "event": "header_read", 2023-08-01T19:55:22.168 INFO:teuthology.orchestra.run.smithi155.stdout: "time": "2023-08-01T19:55:22.093715+0000", 2023-08-01T19:55:22.168 INFO:teuthology.orchestra.run.smithi155.stdout: "duration": 4294967295.999999 2023-08-01T19:55:22.169 INFO:teuthology.orchestra.run.smithi155.stdout: }, 2023-08-01T19:55:22.169 INFO:teuthology.orchestra.run.smithi155.stdout: { 2023-08-01T19:55:22.169 INFO:teuthology.orchestra.run.smithi155.stdout: "event": "all_read", 2023-08-01T19:55:22.169 INFO:teuthology.orchestra.run.smithi155.stdout: "time": "2023-08-01T19:55:22.093804+0000", 2023-08-01T19:55:22.169 INFO:teuthology.orchestra.run.smithi155.stdout: "duration": 8.8906000000000006e-05 2023-08-01T19:55:22.169 INFO:teuthology.orchestra.run.smithi155.stdout: }, 2023-08-01T19:55:22.169 INFO:teuthology.orchestra.run.smithi155.stdout: { 2023-08-01T19:55:22.169 INFO:teuthology.orchestra.run.smithi155.stdout: "event": "dispatched", 2023-08-01T19:55:22.170 INFO:teuthology.orchestra.run.smithi155.stdout: "time": "2023-08-01T19:55:22.093813+0000", 2023-08-01T19:55:22.170 INFO:teuthology.orchestra.run.smithi155.stdout: "duration": 8.3820000000000004e-06 2023-08-01T19:55:22.170 INFO:teuthology.orchestra.run.smithi155.stdout: }, 2023-08-01T19:55:22.170 INFO:teuthology.orchestra.run.smithi155.stdout: { 2023-08-01T19:55:22.170 INFO:teuthology.orchestra.run.smithi155.stdout: "event": "queued_for_pg", 2023-08-01T19:55:22.170 INFO:teuthology.orchestra.run.smithi155.stdout: "time": "2023-08-01T19:55:22.093818+0000", 2023-08-01T19:55:22.170 INFO:teuthology.orchestra.run.smithi155.stdout: "duration": 5.3850000000000001e-06 2023-08-01T19:55:22.170 INFO:teuthology.orchestra.run.smithi155.stdout: }, 2023-08-01T19:55:22.171 INFO:teuthology.orchestra.run.smithi155.stdout: { 2023-08-01T19:55:22.171 INFO:teuthology.orchestra.run.smithi155.stdout: "event": "reached_pg", 2023-08-01T19:55:22.171 INFO:teuthology.orchestra.run.smithi155.stdout: "time": "2023-08-01T19:55:22.093853+0000", 2023-08-01T19:55:22.171 INFO:teuthology.orchestra.run.smithi155.stdout: "duration": 3.5231000000000002e-05 2023-08-01T19:55:22.171 INFO:teuthology.orchestra.run.smithi155.stdout: }, 2023-08-01T19:55:22.171 INFO:teuthology.orchestra.run.smithi155.stdout: { 2023-08-01T19:55:22.171 INFO:teuthology.orchestra.run.smithi155.stdout: "event": "started", 2023-08-01T19:55:22.171 INFO:teuthology.orchestra.run.smithi155.stdout: "time": "2023-08-01T19:55:22.093968+0000", 2023-08-01T19:55:22.172 INFO:teuthology.orchestra.run.smithi155.stdout: "duration": 0.000115178 2023-08-01T19:55:22.172 INFO:teuthology.orchestra.run.smithi155.stdout: }, 2023-08-01T19:55:22.172 INFO:teuthology.orchestra.run.smithi155.stdout: { 2023-08-01T19:55:22.172 INFO:teuthology.orchestra.run.smithi155.stdout: "event": "waiting for subops from 0", 2023-08-01T19:55:22.172 INFO:teuthology.orchestra.run.smithi155.stdout: "time": "2023-08-01T19:55:22.094106+0000", 2023-08-01T19:55:22.172 INFO:teuthology.orchestra.run.smithi155.stdout: "duration": 0.00013746200000000001 2023-08-01T19:55:22.172 INFO:teuthology.orchestra.run.smithi155.stdout: }, 2023-08-01T19:55:22.172 INFO:teuthology.orchestra.run.smithi155.stdout: { 2023-08-01T19:55:22.173 INFO:teuthology.orchestra.run.smithi155.stdout: "event": "sub_op_commit_rec", 2023-08-01T19:55:22.173 INFO:teuthology.orchestra.run.smithi155.stdout: "time": "2023-08-01T19:55:22.099529+0000", 2023-08-01T19:55:22.173 INFO:teuthology.orchestra.run.smithi155.stdout: "duration": 0.0054230099999999998 2023-08-01T19:55:22.173 INFO:teuthology.orchestra.run.smithi155.stdout: } 2023-08-01T19:55:22.173 INFO:teuthology.orchestra.run.smithi155.stdout: ] 2023-08-01T19:55:22.173 INFO:teuthology.orchestra.run.smithi155.stdout: } 2023-08-01T19:55:22.173 INFO:teuthology.orchestra.run.smithi155.stdout: }, 2023-08-01T19:55:22.174 INFO:teuthology.orchestra.run.smithi155.stdout: { 2023-08-01T19:55:22.174 INFO:teuthology.orchestra.run.smithi155.stdout: "description": "osd_op(client.4668.0:129590 5.0 5:0f2db534:::benchmark_data_smithi006_114134_object129589:head [set-alloc-hint object_size 65536 write_size 65536,write 0~65536 in=65536b] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e45)", 2023-08-01T19:55:22.174 INFO:teuthology.orchestra.run.smithi155.stdout: "initiated_at": "2023-08-01T19:55:22.093829+0000", 2023-08-01T19:55:22.174 INFO:teuthology.orchestra.run.smithi155.stdout: "age": 0.007164063, 2023-08-01T19:55:22.174 INFO:teuthology.orchestra.run.smithi155.stdout: "duration": 0.0076752890000000001, 2023-08-01T19:55:22.174 INFO:teuthology.orchestra.run.smithi155.stdout: "type_data": { 2023-08-01T19:55:22.174 INFO:teuthology.orchestra.run.smithi155.stdout: "flag_point": "waiting for sub ops", 2023-08-01T19:55:22.174 INFO:teuthology.orchestra.run.smithi155.stdout: "client_info": { 2023-08-01T19:55:22.175 INFO:teuthology.orchestra.run.smithi155.stdout: "client": "client.4668", 2023-08-01T19:55:22.175 INFO:teuthology.orchestra.run.smithi155.stdout: "client_addr": "172.21.15.6:0/1709472247", 2023-08-01T19:55:22.175 INFO:teuthology.orchestra.run.smithi155.stdout: "tid": 129590 2023-08-01T19:55:22.175 INFO:teuthology.orchestra.run.smithi155.stdout: }, 2023-08-01T19:55:22.175 INFO:teuthology.orchestra.run.smithi155.stdout: "events": [ 2023-08-01T19:55:22.175 INFO:teuthology.orchestra.run.smithi155.stdout: { 2023-08-01T19:55:22.175 INFO:teuthology.orchestra.run.smithi155.stdout: "event": "initiated", 2023-08-01T19:55:22.176 INFO:teuthology.orchestra.run.smithi155.stdout: "time": "2023-08-01T19:55:22.093829+0000", 2023-08-01T19:55:22.176 INFO:teuthology.orchestra.run.smithi155.stdout: "duration": 0 2023-08-01T19:55:22.176 INFO:teuthology.orchestra.run.smithi155.stdout: }, 2023-08-01T19:55:22.176 INFO:teuthology.orchestra.run.smithi155.stdout: { 2023-08-01T19:55:22.176 INFO:teuthology.orchestra.run.smithi155.stdout: "event": "throttled", 2023-08-01T19:55:22.176 INFO:teuthology.orchestra.run.smithi155.stdout: "time": "2023-08-01T19:55:22.093829+0000", 2023-08-01T19:55:22.176 INFO:teuthology.orchestra.run.smithi155.stdout: "duration": 0 2023-08-01T19:55:22.176 INFO:teuthology.orchestra.run.smithi155.stdout: }, 2023-08-01T19:55:22.177 INFO:teuthology.orchestra.run.smithi155.stdout: { 2023-08-01T19:55:22.177 INFO:teuthology.orchestra.run.smithi155.stdout: "event": "header_read", 2023-08-01T19:55:22.177 INFO:teuthology.orchestra.run.smithi155.stdout: "time": "2023-08-01T19:55:22.093828+0000", 2023-08-01T19:55:22.177 INFO:teuthology.orchestra.run.smithi155.stdout: "duration": 4294967295.9999995 2023-08-01T19:55:22.177 INFO:teuthology.orchestra.run.smithi155.stdout: }, 2023-08-01T19:55:22.177 INFO:teuthology.orchestra.run.smithi155.stdout: { 2023-08-01T19:55:22.177 INFO:teuthology.orchestra.run.smithi155.stdout: "event": "all_read", 2023-08-01T19:55:22.177 INFO:teuthology.orchestra.run.smithi155.stdout: "time": "2023-08-01T19:55:22.093861+0000", 2023-08-01T19:55:22.178 INFO:teuthology.orchestra.run.smithi155.stdout: "duration": 3.2094999999999997e-05 2023-08-01T19:55:22.178 INFO:teuthology.orchestra.run.smithi155.stdout: }, 2023-08-01T19:55:22.178 INFO:teuthology.orchestra.run.smithi155.stdout: { 2023-08-01T19:55:22.178 INFO:teuthology.orchestra.run.smithi155.stdout: "event": "dispatched", 2023-08-01T19:55:22.178 INFO:teuthology.orchestra.run.smithi155.stdout: "time": "2023-08-01T19:55:22.093869+0000", 2023-08-01T19:55:22.178 INFO:teuthology.orchestra.run.smithi155.stdout: "duration": 8.6100000000000006e-06 2023-08-01T19:55:22.178 INFO:teuthology.orchestra.run.smithi155.stdout: }, 2023-08-01T19:55:22.178 INFO:teuthology.orchestra.run.smithi155.stdout: { 2023-08-01T19:55:22.179 INFO:teuthology.orchestra.run.smithi155.stdout: "event": "queued_for_pg", 2023-08-01T19:55:22.179 INFO:teuthology.orchestra.run.smithi155.stdout: "time": "2023-08-01T19:55:22.093874+0000", 2023-08-01T19:55:22.179 INFO:teuthology.orchestra.run.smithi155.stdout: "duration": 4.4789999999999998e-06 2023-08-01T19:55:22.179 INFO:teuthology.orchestra.run.smithi155.stdout: }, 2023-08-01T19:55:22.179 INFO:teuthology.orchestra.run.smithi155.stdout: { 2023-08-01T19:55:22.179 INFO:teuthology.orchestra.run.smithi155.stdout: "event": "reached_pg", 2023-08-01T19:55:22.179 INFO:teuthology.orchestra.run.smithi155.stdout: "time": "2023-08-01T19:55:22.094421+0000", 2023-08-01T19:55:22.179 INFO:teuthology.orchestra.run.smithi155.stdout: "duration": 0.00054693600000000004 2023-08-01T19:55:22.180 INFO:teuthology.orchestra.run.smithi155.stdout: }, 2023-08-01T19:55:22.180 INFO:teuthology.orchestra.run.smithi155.stdout: { 2023-08-01T19:55:22.180 INFO:teuthology.orchestra.run.smithi155.stdout: "event": "started", 2023-08-01T19:55:22.180 INFO:teuthology.orchestra.run.smithi155.stdout: "time": "2023-08-01T19:55:22.094542+0000", 2023-08-01T19:55:22.180 INFO:teuthology.orchestra.run.smithi155.stdout: "duration": 0.000121109 2023-08-01T19:55:22.180 INFO:teuthology.orchestra.run.smithi155.stdout: }, 2023-08-01T19:55:22.180 INFO:teuthology.orchestra.run.smithi155.stdout: { 2023-08-01T19:55:22.180 INFO:teuthology.orchestra.run.smithi155.stdout: "event": "waiting for subops from 0", 2023-08-01T19:55:22.181 INFO:teuthology.orchestra.run.smithi155.stdout: "time": "2023-08-01T19:55:22.094675+0000", 2023-08-01T19:55:22.181 INFO:teuthology.orchestra.run.smithi155.stdout: "duration": 0.0001338 2023-08-01T19:55:22.181 INFO:teuthology.orchestra.run.smithi155.stdout: }, 2023-08-01T19:55:22.181 INFO:teuthology.orchestra.run.smithi155.stdout: { 2023-08-01T19:55:22.181 INFO:teuthology.orchestra.run.smithi155.stdout: "event": "sub_op_commit_rec", 2023-08-01T19:55:22.181 INFO:teuthology.orchestra.run.smithi155.stdout: "time": "2023-08-01T19:55:22.101128+0000", 2023-08-01T19:55:22.181 INFO:teuthology.orchestra.run.smithi155.stdout: "duration": 0.0064526899999999996 2023-08-01T19:55:22.181 INFO:teuthology.orchestra.run.smithi155.stdout: } 2023-08-01T19:55:22.182 INFO:teuthology.orchestra.run.smithi155.stdout: ] 2023-08-01T19:55:22.182 INFO:teuthology.orchestra.run.smithi155.stdout: } 2023-08-01T19:55:22.182 INFO:teuthology.orchestra.run.smithi155.stdout: }, 2023-08-01T19:55:22.182 INFO:teuthology.orchestra.run.smithi155.stdout: { 2023-08-01T19:55:22.182 INFO:teuthology.orchestra.run.smithi155.stdout: "description": "osd_op(client.4668.0:129592 5.9 5:979d1bf1:::benchmark_data_smithi006_114134_object129591:head [set-alloc-hint object_size 65536 write_size 65536,write 0~65536 in=65536b] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e45)", 2023-08-01T19:55:22.182 INFO:teuthology.orchestra.run.smithi155.stdout: "initiated_at": "2023-08-01T19:55:22.094977+0000", 2023-08-01T19:55:22.182 INFO:teuthology.orchestra.run.smithi155.stdout: "age": 0.0060160589999999998, 2023-08-01T19:55:22.183 INFO:teuthology.orchestra.run.smithi155.stdout: "duration": 0.0065775579999999998, 2023-08-01T19:55:22.183 INFO:teuthology.orchestra.run.smithi155.stdout: "type_data": { 2023-08-01T19:55:22.183 INFO:teuthology.orchestra.run.smithi155.stdout: "flag_point": "waiting for sub ops", 2023-08-01T19:55:22.183 INFO:teuthology.orchestra.run.smithi155.stdout: "client_info": { 2023-08-01T19:55:22.183 INFO:teuthology.orchestra.run.smithi155.stdout: "client": "client.4668", 2023-08-01T19:55:22.183 INFO:teuthology.orchestra.run.smithi155.stdout: "client_addr": "172.21.15.6:0/1709472247", 2023-08-01T19:55:22.183 INFO:teuthology.orchestra.run.smithi155.stdout: "tid": 129592 2023-08-01T19:55:22.184 INFO:teuthology.orchestra.run.smithi155.stdout: }, 2023-08-01T19:55:22.184 INFO:teuthology.orchestra.run.smithi155.stdout: "events": [ 2023-08-01T19:55:22.184 INFO:teuthology.orchestra.run.smithi155.stdout: { 2023-08-01T19:55:22.184 INFO:teuthology.orchestra.run.smithi155.stdout: "event": "initiated", 2023-08-01T19:55:22.184 INFO:teuthology.orchestra.run.smithi155.stdout: "time": "2023-08-01T19:55:22.094977+0000", 2023-08-01T19:55:22.184 INFO:teuthology.orchestra.run.smithi155.stdout: "duration": 0 2023-08-01T19:55:22.184 INFO:teuthology.orchestra.run.smithi155.stdout: }, 2023-08-01T19:55:22.184 INFO:teuthology.orchestra.run.smithi155.stdout: { 2023-08-01T19:55:22.185 INFO:teuthology.orchestra.run.smithi155.stdout: "event": "throttled", 2023-08-01T19:55:22.185 INFO:teuthology.orchestra.run.smithi155.stdout: "time": "2023-08-01T19:55:22.094977+0000", 2023-08-01T19:55:22.185 INFO:teuthology.orchestra.run.smithi155.stdout: "duration": 0 2023-08-01T19:55:22.185 INFO:teuthology.orchestra.run.smithi155.stdout: }, 2023-08-01T19:55:22.185 INFO:teuthology.orchestra.run.smithi155.stdout: { 2023-08-01T19:55:22.185 INFO:teuthology.orchestra.run.smithi155.stdout: "event": "header_read", 2023-08-01T19:55:22.185 INFO:teuthology.orchestra.run.smithi155.stdout: "time": "2023-08-01T19:55:22.094976+0000", 2023-08-01T19:55:22.185 INFO:teuthology.orchestra.run.smithi155.stdout: "duration": 4294967295.999999 2023-08-01T19:55:22.186 INFO:teuthology.orchestra.run.smithi155.stdout: }, 2023-08-01T19:55:22.186 INFO:teuthology.orchestra.run.smithi155.stdout: { 2023-08-01T19:55:22.186 INFO:teuthology.orchestra.run.smithi155.stdout: "event": "all_read", 2023-08-01T19:55:22.186 INFO:teuthology.orchestra.run.smithi155.stdout: "time": "2023-08-01T19:55:22.095091+0000", 2023-08-01T19:55:22.186 INFO:teuthology.orchestra.run.smithi155.stdout: "duration": 0.00011446300000000001 2023-08-01T19:55:22.186 INFO:teuthology.orchestra.run.smithi155.stdout: }, 2023-08-01T19:55:22.186 INFO:teuthology.orchestra.run.smithi155.stdout: { 2023-08-01T19:55:22.187 INFO:teuthology.orchestra.run.smithi155.stdout: "event": "dispatched", 2023-08-01T19:55:22.187 INFO:teuthology.orchestra.run.smithi155.stdout: "time": "2023-08-01T19:55:22.095118+0000", 2023-08-01T19:55:22.187 INFO:teuthology.orchestra.run.smithi155.stdout: "duration": 2.7050999999999999e-05 2023-08-01T19:55:22.187 INFO:teuthology.orchestra.run.smithi155.stdout: }, 2023-08-01T19:55:22.187 INFO:teuthology.orchestra.run.smithi155.stdout: { 2023-08-01T19:55:22.187 INFO:teuthology.orchestra.run.smithi155.stdout: "event": "queued_for_pg", 2023-08-01T19:55:22.187 INFO:teuthology.orchestra.run.smithi155.stdout: "time": "2023-08-01T19:55:22.095123+0000", 2023-08-01T19:55:22.187 INFO:teuthology.orchestra.run.smithi155.stdout: "duration": 5.6280000000000002e-06 2023-08-01T19:55:22.188 INFO:teuthology.orchestra.run.smithi155.stdout: }, 2023-08-01T19:55:22.188 INFO:teuthology.orchestra.run.smithi155.stdout: { 2023-08-01T19:55:22.188 INFO:teuthology.orchestra.run.smithi155.stdout: "event": "reached_pg", 2023-08-01T19:55:22.188 INFO:teuthology.orchestra.run.smithi155.stdout: "time": "2023-08-01T19:55:22.095173+0000", 2023-08-01T19:55:22.188 INFO:teuthology.orchestra.run.smithi155.stdout: "duration": 4.9639999999999999e-05 2023-08-01T19:55:22.188 INFO:teuthology.orchestra.run.smithi155.stdout: }, 2023-08-01T19:55:22.188 INFO:teuthology.orchestra.run.smithi155.stdout: { 2023-08-01T19:55:22.188 INFO:teuthology.orchestra.run.smithi155.stdout: "event": "started", 2023-08-01T19:55:22.189 INFO:teuthology.orchestra.run.smithi155.stdout: "time": "2023-08-01T19:55:22.095316+0000", 2023-08-01T19:55:22.189 INFO:teuthology.orchestra.run.smithi155.stdout: "duration": 0.00014277300000000001 2023-08-01T19:55:22.189 INFO:teuthology.orchestra.run.smithi155.stdout: }, 2023-08-01T19:55:22.189 INFO:teuthology.orchestra.run.smithi155.stdout: { 2023-08-01T19:55:22.189 INFO:teuthology.orchestra.run.smithi155.stdout: "event": "waiting for subops from 1", 2023-08-01T19:55:22.189 INFO:teuthology.orchestra.run.smithi155.stdout: "time": "2023-08-01T19:55:22.095467+0000", 2023-08-01T19:55:22.189 INFO:teuthology.orchestra.run.smithi155.stdout: "duration": 0.000151407 2023-08-01T19:55:22.189 INFO:teuthology.orchestra.run.smithi155.stdout: }, 2023-08-01T19:55:22.190 INFO:teuthology.orchestra.run.smithi155.stdout: { 2023-08-01T19:55:22.190 INFO:teuthology.orchestra.run.smithi155.stdout: "event": "sub_op_commit_rec", 2023-08-01T19:55:22.190 INFO:teuthology.orchestra.run.smithi155.stdout: "time": "2023-08-01T19:55:22.100398+0000", 2023-08-01T19:55:22.190 INFO:teuthology.orchestra.run.smithi155.stdout: "duration": 0.0049306640000000004 2023-08-01T19:55:22.190 INFO:teuthology.orchestra.run.smithi155.stdout: } 2023-08-01T19:55:22.190 INFO:teuthology.orchestra.run.smithi155.stdout: ] 2023-08-01T19:55:22.190 INFO:teuthology.orchestra.run.smithi155.stdout: } 2023-08-01T19:55:22.190 INFO:teuthology.orchestra.run.smithi155.stdout: }, 2023-08-01T19:55:22.191 INFO:teuthology.orchestra.run.smithi155.stdout: { 2023-08-01T19:55:22.191 INFO:teuthology.orchestra.run.smithi155.stdout: "description": "osd_op(client.4668.0:129593 5.b 5:de8a8c0f:::benchmark_data_smithi006_114134_object129592:head [set-alloc-hint object_size 65536 write_size 65536,write 0~65536 in=65536b] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e45)", 2023-08-01T19:55:22.191 INFO:teuthology.orchestra.run.smithi155.stdout: "initiated_at": "2023-08-01T19:55:22.095142+0000", 2023-08-01T19:55:22.191 INFO:teuthology.orchestra.run.smithi155.stdout: "age": 0.0058509180000000001, 2023-08-01T19:55:22.191 INFO:teuthology.orchestra.run.smithi155.stdout: "duration": 0.0064623780000000004, 2023-08-01T19:55:22.191 INFO:teuthology.orchestra.run.smithi155.stdout: "type_data": { 2023-08-01T19:55:22.191 INFO:teuthology.orchestra.run.smithi155.stdout: "flag_point": "waiting for sub ops", 2023-08-01T19:55:22.191 INFO:teuthology.orchestra.run.smithi155.stdout: "client_info": { 2023-08-01T19:55:22.192 INFO:teuthology.orchestra.run.smithi155.stdout: "client": "client.4668", 2023-08-01T19:55:22.192 INFO:teuthology.orchestra.run.smithi155.stdout: "client_addr": "172.21.15.6:0/1709472247", 2023-08-01T19:55:22.192 INFO:teuthology.orchestra.run.smithi155.stdout: "tid": 129593 2023-08-01T19:55:22.192 INFO:teuthology.orchestra.run.smithi155.stdout: }, 2023-08-01T19:55:22.192 INFO:teuthology.orchestra.run.smithi155.stdout: "events": [ 2023-08-01T19:55:22.192 INFO:teuthology.orchestra.run.smithi155.stdout: { 2023-08-01T19:55:22.192 INFO:teuthology.orchestra.run.smithi155.stdout: "event": "initiated", 2023-08-01T19:55:22.193 INFO:teuthology.orchestra.run.smithi155.stdout: "time": "2023-08-01T19:55:22.095142+0000", 2023-08-01T19:55:22.193 INFO:teuthology.orchestra.run.smithi155.stdout: "duration": 0 2023-08-01T19:55:22.193 INFO:teuthology.orchestra.run.smithi155.stdout: }, 2023-08-01T19:55:22.193 INFO:teuthology.orchestra.run.smithi155.stdout: { 2023-08-01T19:55:22.193 INFO:teuthology.orchestra.run.smithi155.stdout: "event": "throttled", 2023-08-01T19:55:22.193 INFO:teuthology.orchestra.run.smithi155.stdout: "time": "2023-08-01T19:55:22.095142+0000", 2023-08-01T19:55:22.193 INFO:teuthology.orchestra.run.smithi155.stdout: "duration": 0 2023-08-01T19:55:22.193 INFO:teuthology.orchestra.run.smithi155.stdout: }, 2023-08-01T19:55:22.194 INFO:teuthology.orchestra.run.smithi155.stdout: { 2023-08-01T19:55:22.194 INFO:teuthology.orchestra.run.smithi155.stdout: "event": "header_read", 2023-08-01T19:55:22.194 INFO:teuthology.orchestra.run.smithi155.stdout: "time": "2023-08-01T19:55:22.095142+0000", 2023-08-01T19:55:22.194 INFO:teuthology.orchestra.run.smithi155.stdout: "duration": 4294967295.9999995 2023-08-01T19:55:22.194 INFO:teuthology.orchestra.run.smithi155.stdout: }, 2023-08-01T19:55:22.194 INFO:teuthology.orchestra.run.smithi155.stdout: { 2023-08-01T19:55:22.194 INFO:teuthology.orchestra.run.smithi155.stdout: "event": "all_read", 2023-08-01T19:55:22.194 INFO:teuthology.orchestra.run.smithi155.stdout: "time": "2023-08-01T19:55:22.095188+0000", 2023-08-01T19:55:22.195 INFO:teuthology.orchestra.run.smithi155.stdout: "duration": 4.6780999999999998e-05 2023-08-01T19:55:22.195 INFO:teuthology.orchestra.run.smithi155.stdout: }, 2023-08-01T19:55:22.195 INFO:teuthology.orchestra.run.smithi155.stdout: { 2023-08-01T19:55:22.195 INFO:teuthology.orchestra.run.smithi155.stdout: "event": "dispatched", 2023-08-01T19:55:22.195 INFO:teuthology.orchestra.run.smithi155.stdout: "time": "2023-08-01T19:55:22.095200+0000", 2023-08-01T19:55:22.195 INFO:teuthology.orchestra.run.smithi155.stdout: "duration": 1.1406999999999999e-05 2023-08-01T19:55:22.195 INFO:teuthology.orchestra.run.smithi155.stdout: }, 2023-08-01T19:55:22.196 INFO:teuthology.orchestra.run.smithi155.stdout: { 2023-08-01T19:55:22.196 INFO:teuthology.orchestra.run.smithi155.stdout: "event": "queued_for_pg", 2023-08-01T19:55:22.196 INFO:teuthology.orchestra.run.smithi155.stdout: "time": "2023-08-01T19:55:22.095213+0000", 2023-08-01T19:55:22.196 INFO:teuthology.orchestra.run.smithi155.stdout: "duration": 1.3257e-05 2023-08-01T19:55:22.196 INFO:teuthology.orchestra.run.smithi155.stdout: }, 2023-08-01T19:55:22.196 INFO:teuthology.orchestra.run.smithi155.stdout: { 2023-08-01T19:55:22.196 INFO:teuthology.orchestra.run.smithi155.stdout: "event": "reached_pg", 2023-08-01T19:55:22.196 INFO:teuthology.orchestra.run.smithi155.stdout: "time": "2023-08-01T19:55:22.096082+0000", 2023-08-01T19:55:22.197 INFO:teuthology.orchestra.run.smithi155.stdout: "duration": 0.00086881700000000003 2023-08-01T19:55:22.197 INFO:teuthology.orchestra.run.smithi155.stdout: }, 2023-08-01T19:55:22.197 INFO:teuthology.orchestra.run.smithi155.stdout: { 2023-08-01T19:55:22.197 INFO:teuthology.orchestra.run.smithi155.stdout: "event": "started", 2023-08-01T19:55:22.197 INFO:teuthology.orchestra.run.smithi155.stdout: "time": "2023-08-01T19:55:22.096206+0000", 2023-08-01T19:55:22.197 INFO:teuthology.orchestra.run.smithi155.stdout: "duration": 0.00012391400000000001 2023-08-01T19:55:22.197 INFO:teuthology.orchestra.run.smithi155.stdout: }, 2023-08-01T19:55:22.197 INFO:teuthology.orchestra.run.smithi155.stdout: { 2023-08-01T19:55:22.198 INFO:teuthology.orchestra.run.smithi155.stdout: "event": "waiting for subops from 0", 2023-08-01T19:55:22.198 INFO:teuthology.orchestra.run.smithi155.stdout: "time": "2023-08-01T19:55:22.096336+0000", 2023-08-01T19:55:22.198 INFO:teuthology.orchestra.run.smithi155.stdout: "duration": 0.00013077799999999999 2023-08-01T19:55:22.198 INFO:teuthology.orchestra.run.smithi155.stdout: } 2023-08-01T19:55:22.198 INFO:teuthology.orchestra.run.smithi155.stdout: ] 2023-08-01T19:55:22.198 INFO:teuthology.orchestra.run.smithi155.stdout: } 2023-08-01T19:55:22.198 INFO:teuthology.orchestra.run.smithi155.stdout: } 2023-08-01T19:55:22.198 INFO:teuthology.orchestra.run.smithi155.stdout: ], 2023-08-01T19:55:22.199 INFO:teuthology.orchestra.run.smithi155.stdout: "num_ops": 12 2023-08-01T19:55:22.199 INFO:teuthology.orchestra.run.smithi155.stdout:} 2023-08-01T19:55:22.200 INFO:tasks.ceph.osd.1.smithi101.stderr:2023-08-01T19:55:22.198+0000 7fb0cb7f6700 -1 received signal: Hangup from /usr/bin/python3 /bin/daemon-helper kill ceph-osd -f --cluster ceph -i 1 (PID: 111141) UID: 0 2023-08-01T19:55:22.200 DEBUG:teuthology.orchestra.run.smithi155:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 30 ceph --cluster ceph --admin-daemon /var/run/ceph/ceph-osd.2.asok dump_blocked_ops 2023-08-01T19:55:22.300 INFO:tasks.ceph.osd.1.smithi101.stderr:2023-08-01T19:55:22.299+0000 7fb0cb7f6700 -1 received signal: Hangup from /usr/bin/python3 /bin/daemon-helper kill ceph-osd -f --cluster ceph -i 1 (PID: 111141) UID: 0 2023-08-01T19:55:22.317 INFO:tasks.radosbench.radosbench.0.smithi006.stdout: 58 16 130005 129989 140.063 117 0.0102529 0.00713669 2023-08-01T19:55:22.363 INFO:teuthology.orchestra.run.smithi155.stdout:{ 2023-08-01T19:55:22.363 INFO:teuthology.orchestra.run.smithi155.stdout: "ops": [], 2023-08-01T19:55:22.363 INFO:teuthology.orchestra.run.smithi155.stdout: "complaint_time": 30, 2023-08-01T19:55:22.364 INFO:teuthology.orchestra.run.smithi155.stdout: "num_blocked_ops": 0 2023-08-01T19:55:22.364 INFO:teuthology.orchestra.run.smithi155.stdout:} 2023-08-01T19:55:22.379 DEBUG:teuthology.orchestra.run.smithi155:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 30 ceph --cluster ceph --admin-daemon /var/run/ceph/ceph-osd.2.asok dump_historic_ops 2023-08-01T19:55:22.422 INFO:tasks.ceph.osd.2.smithi155.stderr:2023-08-01T19:55:22.422+0000 7faa5c6ac700 -1 received signal: Hangup from /usr/bin/python3 /bin/daemon-helper kill ceph-osd -f --cluster ceph -i 2 (PID: 111337) UID: 0 2023-08-01T19:55:22.503 INFO:tasks.ceph.osd.2.smithi155.stderr:2023-08-01T19:55:22.502+0000 7faa5c6ac700 -1 received signal: Hangup from /usr/bin/python3 /bin/daemon-helper kill ceph-osd -f --cluster ceph -i 2 (PID: 111337) UID: 0 2023-08-01T19:55:22.554 INFO:teuthology.orchestra.run.smithi155.stdout:{ 2023-08-01T19:55:22.555 INFO:teuthology.orchestra.run.smithi155.stdout: "size": 20, 2023-08-01T19:55:22.555 INFO:teuthology.orchestra.run.smithi155.stdout: "duration": 600, 2023-08-01T19:55:22.555 INFO:teuthology.orchestra.run.smithi155.stdout: "ops": [ 2023-08-01T19:55:22.555 INFO:teuthology.orchestra.run.smithi155.stdout: { 2023-08-01T19:55:22.555 INFO:teuthology.orchestra.run.smithi155.stdout: "description": "osd_op(client.4668.0:73454 5.8 5:15596b2f:::benchmark_data_smithi006_114134_object73453:head [set-alloc-hint object_size 65536 write_size 65536,write 0~65536] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e31)", 2023-08-01T19:55:22.555 INFO:teuthology.orchestra.run.smithi155.stdout: "initiated_at": "2023-08-01T19:54:51.460020+0000", 2023-08-01T19:55:22.555 INFO:teuthology.orchestra.run.smithi155.stdout: "age": 31.091407648000001, 2023-08-01T19:55:22.556 INFO:teuthology.orchestra.run.smithi155.stdout: "duration": 0.022889436999999999, 2023-08-01T19:55:22.556 INFO:teuthology.orchestra.run.smithi155.stdout: "type_data": { 2023-08-01T19:55:22.556 INFO:teuthology.orchestra.run.smithi155.stdout: "flag_point": "commit sent; apply or cleanup", 2023-08-01T19:55:22.556 INFO:teuthology.orchestra.run.smithi155.stdout: "client_info": { 2023-08-01T19:55:22.556 INFO:teuthology.orchestra.run.smithi155.stdout: "client": "client.4668", 2023-08-01T19:55:22.556 INFO:teuthology.orchestra.run.smithi155.stdout: "client_addr": "172.21.15.6:0/1709472247", 2023-08-01T19:55:22.556 INFO:teuthology.orchestra.run.smithi155.stdout: "tid": 73454 2023-08-01T19:55:22.557 INFO:teuthology.orchestra.run.smithi155.stdout: }, 2023-08-01T19:55:22.557 INFO:teuthology.orchestra.run.smithi155.stdout: "events": [ 2023-08-01T19:55:22.557 INFO:teuthology.orchestra.run.smithi155.stdout: { 2023-08-01T19:55:22.557 INFO:teuthology.orchestra.run.smithi155.stdout: "event": "initiated", 2023-08-01T19:55:22.557 INFO:teuthology.orchestra.run.smithi155.stdout: "time": "2023-08-01T19:54:51.460020+0000", 2023-08-01T19:55:22.557 INFO:teuthology.orchestra.run.smithi155.stdout: "duration": 0 2023-08-01T19:55:22.557 INFO:teuthology.orchestra.run.smithi155.stdout: }, 2023-08-01T19:55:22.557 INFO:teuthology.orchestra.run.smithi155.stdout: { 2023-08-01T19:55:22.558 INFO:teuthology.orchestra.run.smithi155.stdout: "event": "throttled", 2023-08-01T19:55:22.558 INFO:teuthology.orchestra.run.smithi155.stdout: "time": "2023-08-01T19:54:51.460020+0000", 2023-08-01T19:55:22.558 INFO:teuthology.orchestra.run.smithi155.stdout: "duration": 0 2023-08-01T19:55:22.558 INFO:teuthology.orchestra.run.smithi155.stdout: }, 2023-08-01T19:55:22.558 INFO:teuthology.orchestra.run.smithi155.stdout: { 2023-08-01T19:55:22.558 INFO:teuthology.orchestra.run.smithi155.stdout: "event": "header_read", 2023-08-01T19:55:22.558 INFO:teuthology.orchestra.run.smithi155.stdout: "time": "2023-08-01T19:54:51.460019+0000", 2023-08-01T19:55:22.559 INFO:teuthology.orchestra.run.smithi155.stdout: "duration": 4294967295.9999995 2023-08-01T19:55:22.559 INFO:teuthology.orchestra.run.smithi155.stdout: }, 2023-08-01T19:55:22.559 INFO:teuthology.orchestra.run.smithi155.stdout: { 2023-08-01T19:55:22.559 INFO:teuthology.orchestra.run.smithi155.stdout: "event": "all_read", 2023-08-01T19:55:22.559 INFO:teuthology.orchestra.run.smithi155.stdout: "time": "2023-08-01T19:54:51.460051+0000", 2023-08-01T19:55:22.559 INFO:teuthology.orchestra.run.smithi155.stdout: "duration": 3.1736000000000002e-05 2023-08-01T19:55:22.559 INFO:teuthology.orchestra.run.smithi155.stdout: }, 2023-08-01T19:55:22.559 INFO:teuthology.orchestra.run.smithi155.stdout: { 2023-08-01T19:55:22.560 INFO:teuthology.orchestra.run.smithi155.stdout: "event": "dispatched", 2023-08-01T19:55:22.560 INFO:teuthology.orchestra.run.smithi155.stdout: "time": "2023-08-01T19:54:51.460058+0000", 2023-08-01T19:55:22.560 INFO:teuthology.orchestra.run.smithi155.stdout: "duration": 7.3869999999999997e-06 2023-08-01T19:55:22.560 INFO:teuthology.orchestra.run.smithi155.stdout: }, 2023-08-01T19:55:22.560 INFO:teuthology.orchestra.run.smithi155.stdout: { 2023-08-01T19:55:22.560 INFO:teuthology.orchestra.run.smithi155.stdout: "event": "queued_for_pg", 2023-08-01T19:55:22.560 INFO:teuthology.orchestra.run.smithi155.stdout: "time": "2023-08-01T19:54:51.460062+0000", 2023-08-01T19:55:22.561 INFO:teuthology.orchestra.run.smithi155.stdout: "duration": 4.352e-06 2023-08-01T19:55:22.561 INFO:teuthology.orchestra.run.smithi155.stdout: }, 2023-08-01T19:55:22.561 INFO:teuthology.orchestra.run.smithi155.stdout: { 2023-08-01T19:55:22.561 INFO:teuthology.orchestra.run.smithi155.stdout: "event": "reached_pg", 2023-08-01T19:55:22.561 INFO:teuthology.orchestra.run.smithi155.stdout: "time": "2023-08-01T19:54:51.460101+0000", 2023-08-01T19:55:22.561 INFO:teuthology.orchestra.run.smithi155.stdout: "duration": 3.8705000000000003e-05 2023-08-01T19:55:22.561 INFO:teuthology.orchestra.run.smithi155.stdout: }, 2023-08-01T19:55:22.561 INFO:teuthology.orchestra.run.smithi155.stdout: { 2023-08-01T19:55:22.562 INFO:teuthology.orchestra.run.smithi155.stdout: "event": "started", 2023-08-01T19:55:22.562 INFO:teuthology.orchestra.run.smithi155.stdout: "time": "2023-08-01T19:54:51.460236+0000", 2023-08-01T19:55:22.562 INFO:teuthology.orchestra.run.smithi155.stdout: "duration": 0.00013463599999999999 2023-08-01T19:55:22.562 INFO:teuthology.orchestra.run.smithi155.stdout: }, 2023-08-01T19:55:22.562 INFO:teuthology.orchestra.run.smithi155.stdout: { 2023-08-01T19:55:22.562 INFO:teuthology.orchestra.run.smithi155.stdout: "event": "waiting for subops from 0", 2023-08-01T19:55:22.562 INFO:teuthology.orchestra.run.smithi155.stdout: "time": "2023-08-01T19:54:51.460391+0000", 2023-08-01T19:55:22.562 INFO:teuthology.orchestra.run.smithi155.stdout: "duration": 0.00015525000000000001 2023-08-01T19:55:22.563 INFO:teuthology.orchestra.run.smithi155.stdout: }, 2023-08-01T19:55:22.563 INFO:teuthology.orchestra.run.smithi155.stdout: { 2023-08-01T19:55:22.563 INFO:teuthology.orchestra.run.smithi155.stdout: "event": "sub_op_commit_rec", 2023-08-01T19:55:22.563 INFO:teuthology.orchestra.run.smithi155.stdout: "time": "2023-08-01T19:54:51.468393+0000", 2023-08-01T19:55:22.563 INFO:teuthology.orchestra.run.smithi155.stdout: "duration": 0.00800208 2023-08-01T19:55:22.563 INFO:teuthology.orchestra.run.smithi155.stdout: }, 2023-08-01T19:55:22.563 INFO:teuthology.orchestra.run.smithi155.stdout: { 2023-08-01T19:55:22.564 INFO:teuthology.orchestra.run.smithi155.stdout: "event": "op_commit", 2023-08-01T19:55:22.564 INFO:teuthology.orchestra.run.smithi155.stdout: "time": "2023-08-01T19:54:51.482815+0000", 2023-08-01T19:55:22.564 INFO:teuthology.orchestra.run.smithi155.stdout: "duration": 0.01442148 2023-08-01T19:55:22.564 INFO:teuthology.orchestra.run.smithi155.stdout: }, 2023-08-01T19:55:22.564 INFO:teuthology.orchestra.run.smithi155.stdout: { 2023-08-01T19:55:22.564 INFO:teuthology.orchestra.run.smithi155.stdout: "event": "commit_sent", 2023-08-01T19:55:22.564 INFO:teuthology.orchestra.run.smithi155.stdout: "time": "2023-08-01T19:54:51.482866+0000", 2023-08-01T19:55:22.564 INFO:teuthology.orchestra.run.smithi155.stdout: "duration": 5.1842999999999998e-05 2023-08-01T19:55:22.565 INFO:teuthology.orchestra.run.smithi155.stdout: }, 2023-08-01T19:55:22.565 INFO:teuthology.orchestra.run.smithi155.stdout: { 2023-08-01T19:55:22.565 INFO:teuthology.orchestra.run.smithi155.stdout: "event": "done", 2023-08-01T19:55:22.565 INFO:teuthology.orchestra.run.smithi155.stdout: "time": "2023-08-01T19:54:51.482909+0000", 2023-08-01T19:55:22.565 INFO:teuthology.orchestra.run.smithi155.stdout: "duration": 4.2663000000000001e-05 2023-08-01T19:55:22.565 INFO:teuthology.orchestra.run.smithi155.stdout: } 2023-08-01T19:55:22.565 INFO:teuthology.orchestra.run.smithi155.stdout: ] 2023-08-01T19:55:22.566 INFO:teuthology.orchestra.run.smithi155.stdout: } 2023-08-01T19:55:22.566 INFO:teuthology.orchestra.run.smithi155.stdout: }, 2023-08-01T19:55:22.566 INFO:teuthology.orchestra.run.smithi155.stdout: { 2023-08-01T19:55:22.566 INFO:teuthology.orchestra.run.smithi155.stdout: "description": "osd_op(client.4668.0:73455 5.b 5:de51121e:::benchmark_data_smithi006_114134_object73454:head [set-alloc-hint object_size 65536 write_size 65536,write 0~65536] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e31)", 2023-08-01T19:55:22.566 INFO:teuthology.orchestra.run.smithi155.stdout: "initiated_at": "2023-08-01T19:54:51.460078+0000", 2023-08-01T19:55:22.566 INFO:teuthology.orchestra.run.smithi155.stdout: "age": 31.091349674, 2023-08-01T19:55:22.566 INFO:teuthology.orchestra.run.smithi155.stdout: "duration": 0.022689121999999999, 2023-08-01T19:55:22.566 INFO:teuthology.orchestra.run.smithi155.stdout: "type_data": { 2023-08-01T19:55:22.567 INFO:teuthology.orchestra.run.smithi155.stdout: "flag_point": "commit sent; apply or cleanup", 2023-08-01T19:55:22.567 INFO:teuthology.orchestra.run.smithi155.stdout: "client_info": { 2023-08-01T19:55:22.567 INFO:teuthology.orchestra.run.smithi155.stdout: "client": "client.4668", 2023-08-01T19:55:22.567 INFO:teuthology.orchestra.run.smithi155.stdout: "client_addr": "172.21.15.6:0/1709472247", 2023-08-01T19:55:22.567 INFO:teuthology.orchestra.run.smithi155.stdout: "tid": 73455 2023-08-01T19:55:22.567 INFO:teuthology.orchestra.run.smithi155.stdout: }, 2023-08-01T19:55:22.567 INFO:teuthology.orchestra.run.smithi155.stdout: "events": [ 2023-08-01T19:55:22.567 INFO:teuthology.orchestra.run.smithi155.stdout: { 2023-08-01T19:55:22.568 INFO:teuthology.orchestra.run.smithi155.stdout: "event": "initiated", 2023-08-01T19:55:22.568 INFO:teuthology.orchestra.run.smithi155.stdout: "time": "2023-08-01T19:54:51.460078+0000", 2023-08-01T19:55:22.568 INFO:teuthology.orchestra.run.smithi155.stdout: "duration": 0 2023-08-01T19:55:22.568 INFO:teuthology.orchestra.run.smithi155.stdout: }, 2023-08-01T19:55:22.568 INFO:teuthology.orchestra.run.smithi155.stdout: { 2023-08-01T19:55:22.568 INFO:teuthology.orchestra.run.smithi155.stdout: "event": "throttled", 2023-08-01T19:55:22.568 INFO:teuthology.orchestra.run.smithi155.stdout: "time": "2023-08-01T19:54:51.460078+0000", 2023-08-01T19:55:22.568 INFO:teuthology.orchestra.run.smithi155.stdout: "duration": 0 2023-08-01T19:55:22.569 INFO:teuthology.orchestra.run.smithi155.stdout: }, 2023-08-01T19:55:22.569 INFO:teuthology.orchestra.run.smithi155.stdout: { 2023-08-01T19:55:22.569 INFO:teuthology.orchestra.run.smithi155.stdout: "event": "header_read", 2023-08-01T19:55:22.569 INFO:teuthology.orchestra.run.smithi155.stdout: "time": "2023-08-01T19:54:51.460077+0000", 2023-08-01T19:55:22.569 INFO:teuthology.orchestra.run.smithi155.stdout: "duration": 4294967295.9999995 2023-08-01T19:55:22.569 INFO:teuthology.orchestra.run.smithi155.stdout: }, 2023-08-01T19:55:22.569 INFO:teuthology.orchestra.run.smithi155.stdout: { 2023-08-01T19:55:22.569 INFO:teuthology.orchestra.run.smithi155.stdout: "event": "all_read", 2023-08-01T19:55:22.570 INFO:teuthology.orchestra.run.smithi155.stdout: "time": "2023-08-01T19:54:51.460102+0000", 2023-08-01T19:55:22.570 INFO:teuthology.orchestra.run.smithi155.stdout: "duration": 2.4933e-05 2023-08-01T19:55:22.570 INFO:teuthology.orchestra.run.smithi155.stdout: }, 2023-08-01T19:55:22.570 INFO:teuthology.orchestra.run.smithi155.stdout: { 2023-08-01T19:55:22.570 INFO:teuthology.orchestra.run.smithi155.stdout: "event": "dispatched", 2023-08-01T19:55:22.570 INFO:teuthology.orchestra.run.smithi155.stdout: "time": "2023-08-01T19:54:51.460109+0000", 2023-08-01T19:55:22.570 INFO:teuthology.orchestra.run.smithi155.stdout: "duration": 7.0720000000000002e-06 2023-08-01T19:55:22.570 INFO:teuthology.orchestra.run.smithi155.stdout: }, 2023-08-01T19:55:22.571 INFO:teuthology.orchestra.run.smithi155.stdout: { 2023-08-01T19:55:22.571 INFO:teuthology.orchestra.run.smithi155.stdout: "event": "queued_for_pg", 2023-08-01T19:55:22.571 INFO:teuthology.orchestra.run.smithi155.stdout: "time": "2023-08-01T19:54:51.460113+0000", 2023-08-01T19:55:22.571 INFO:teuthology.orchestra.run.smithi155.stdout: "duration": 4.3220000000000003e-06 2023-08-01T19:55:22.571 INFO:teuthology.orchestra.run.smithi155.stdout: }, 2023-08-01T19:55:22.571 INFO:teuthology.orchestra.run.smithi155.stdout: { 2023-08-01T19:55:22.571 INFO:teuthology.orchestra.run.smithi155.stdout: "event": "reached_pg", 2023-08-01T19:55:22.572 INFO:teuthology.orchestra.run.smithi155.stdout: "time": "2023-08-01T19:54:51.460955+0000", 2023-08-01T19:55:22.572 INFO:teuthology.orchestra.run.smithi155.stdout: "duration": 0.00084142500000000003 2023-08-01T19:55:22.572 INFO:teuthology.orchestra.run.smithi155.stdout: }, 2023-08-01T19:55:22.572 INFO:teuthology.orchestra.run.smithi155.stdout: { 2023-08-01T19:55:22.572 INFO:teuthology.orchestra.run.smithi155.stdout: "event": "started", 2023-08-01T19:55:22.572 INFO:teuthology.orchestra.run.smithi155.stdout: "time": "2023-08-01T19:54:51.461079+0000", 2023-08-01T19:55:22.572 INFO:teuthology.orchestra.run.smithi155.stdout: "duration": 0.000123826 2023-08-01T19:55:22.572 INFO:teuthology.orchestra.run.smithi155.stdout: }, 2023-08-01T19:55:22.573 INFO:teuthology.orchestra.run.smithi155.stdout: { 2023-08-01T19:55:22.573 INFO:teuthology.orchestra.run.smithi155.stdout: "event": "waiting for subops from 0", 2023-08-01T19:55:22.573 INFO:teuthology.orchestra.run.smithi155.stdout: "time": "2023-08-01T19:54:51.461233+0000", 2023-08-01T19:55:22.573 INFO:teuthology.orchestra.run.smithi155.stdout: "duration": 0.00015431900000000001 2023-08-01T19:55:22.573 INFO:teuthology.orchestra.run.smithi155.stdout: }, 2023-08-01T19:55:22.573 INFO:teuthology.orchestra.run.smithi155.stdout: { 2023-08-01T19:55:22.573 INFO:teuthology.orchestra.run.smithi155.stdout: "event": "sub_op_commit_rec", 2023-08-01T19:55:22.573 INFO:teuthology.orchestra.run.smithi155.stdout: "time": "2023-08-01T19:54:51.468509+0000", 2023-08-01T19:55:22.574 INFO:teuthology.orchestra.run.smithi155.stdout: "duration": 0.0072759859999999999 2023-08-01T19:55:22.574 INFO:teuthology.orchestra.run.smithi155.stdout: }, 2023-08-01T19:55:22.574 INFO:teuthology.orchestra.run.smithi155.stdout: { 2023-08-01T19:55:22.574 INFO:teuthology.orchestra.run.smithi155.stdout: "event": "op_commit", 2023-08-01T19:55:22.574 INFO:teuthology.orchestra.run.smithi155.stdout: "time": "2023-08-01T19:54:51.482704+0000", 2023-08-01T19:55:22.574 INFO:teuthology.orchestra.run.smithi155.stdout: "duration": 0.01419545 2023-08-01T19:55:22.574 INFO:teuthology.orchestra.run.smithi155.stdout: }, 2023-08-01T19:55:22.575 INFO:teuthology.orchestra.run.smithi155.stdout: { 2023-08-01T19:55:22.575 INFO:teuthology.orchestra.run.smithi155.stdout: "event": "commit_sent", 2023-08-01T19:55:22.575 INFO:teuthology.orchestra.run.smithi155.stdout: "time": "2023-08-01T19:54:51.482747+0000", 2023-08-01T19:55:22.575 INFO:teuthology.orchestra.run.smithi155.stdout: "duration": 4.2413999999999997e-05 2023-08-01T19:55:22.575 INFO:teuthology.orchestra.run.smithi155.stdout: }, 2023-08-01T19:55:22.575 INFO:teuthology.orchestra.run.smithi155.stdout: { 2023-08-01T19:55:22.575 INFO:teuthology.orchestra.run.smithi155.stdout: "event": "done", 2023-08-01T19:55:22.575 INFO:teuthology.orchestra.run.smithi155.stdout: "time": "2023-08-01T19:54:51.482767+0000", 2023-08-01T19:55:22.576 INFO:teuthology.orchestra.run.smithi155.stdout: "duration": 1.9908999999999999e-05 2023-08-01T19:55:22.576 INFO:teuthology.orchestra.run.smithi155.stdout: } 2023-08-01T19:55:22.576 INFO:teuthology.orchestra.run.smithi155.stdout: ] 2023-08-01T19:55:22.576 INFO:teuthology.orchestra.run.smithi155.stdout: } 2023-08-01T19:55:22.576 INFO:teuthology.orchestra.run.smithi155.stdout: }, 2023-08-01T19:55:22.576 INFO:teuthology.orchestra.run.smithi155.stdout: { 2023-08-01T19:55:22.576 INFO:teuthology.orchestra.run.smithi155.stdout: "description": "osd_op(client.4668.0:73456 5.0 5:0164baf4:::benchmark_data_smithi006_114134_object73455:head [set-alloc-hint object_size 65536 write_size 65536,write 0~65536] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e31)", 2023-08-01T19:55:22.576 INFO:teuthology.orchestra.run.smithi155.stdout: "initiated_at": "2023-08-01T19:54:51.461520+0000", 2023-08-01T19:55:22.577 INFO:teuthology.orchestra.run.smithi155.stdout: "age": 31.089907684, 2023-08-01T19:55:22.577 INFO:teuthology.orchestra.run.smithi155.stdout: "duration": 0.023899916, 2023-08-01T19:55:22.577 INFO:teuthology.orchestra.run.smithi155.stdout: "type_data": { 2023-08-01T19:55:22.577 INFO:teuthology.orchestra.run.smithi155.stdout: "flag_point": "commit sent; apply or cleanup", 2023-08-01T19:55:22.577 INFO:teuthology.orchestra.run.smithi155.stdout: "client_info": { 2023-08-01T19:55:22.578 INFO:teuthology.orchestra.run.smithi155.stdout: "client": "client.4668", 2023-08-01T19:55:22.578 INFO:teuthology.orchestra.run.smithi155.stdout: "client_addr": "172.21.15.6:0/1709472247", 2023-08-01T19:55:22.578 INFO:teuthology.orchestra.run.smithi155.stdout: "tid": 73456 2023-08-01T19:55:22.578 INFO:teuthology.orchestra.run.smithi155.stdout: }, 2023-08-01T19:55:22.578 INFO:teuthology.orchestra.run.smithi155.stdout: "events": [ 2023-08-01T19:55:22.578 INFO:teuthology.orchestra.run.smithi155.stdout: { 2023-08-01T19:55:22.579 INFO:teuthology.orchestra.run.smithi155.stdout: "event": "initiated", 2023-08-01T19:55:22.579 INFO:teuthology.orchestra.run.smithi155.stdout: "time": "2023-08-01T19:54:51.461520+0000", 2023-08-01T19:55:22.579 INFO:teuthology.orchestra.run.smithi155.stdout: "duration": 0 2023-08-01T19:55:22.579 INFO:teuthology.orchestra.run.smithi155.stdout: }, 2023-08-01T19:55:22.579 INFO:teuthology.orchestra.run.smithi155.stdout: { 2023-08-01T19:55:22.580 INFO:teuthology.orchestra.run.smithi155.stdout: "event": "throttled", 2023-08-01T19:55:22.580 INFO:teuthology.orchestra.run.smithi155.stdout: "time": "2023-08-01T19:54:51.461520+0000", 2023-08-01T19:55:22.580 INFO:teuthology.orchestra.run.smithi155.stdout: "duration": 0 2023-08-01T19:55:22.580 INFO:teuthology.orchestra.run.smithi155.stdout: }, 2023-08-01T19:55:22.581 INFO:teuthology.orchestra.run.smithi155.stdout: { 2023-08-01T19:55:22.581 INFO:teuthology.orchestra.run.smithi155.stdout: "event": "header_read", 2023-08-01T19:55:22.581 INFO:teuthology.orchestra.run.smithi155.stdout: "time": "2023-08-01T19:54:51.461519+0000", 2023-08-01T19:55:22.581 INFO:teuthology.orchestra.run.smithi155.stdout: "duration": 4294967295.999999 2023-08-01T19:55:22.582 INFO:teuthology.orchestra.run.smithi155.stdout: }, 2023-08-01T19:55:22.582 INFO:teuthology.orchestra.run.smithi155.stdout: { 2023-08-01T19:55:22.582 INFO:teuthology.orchestra.run.smithi155.stdout: "event": "all_read", 2023-08-01T19:55:22.582 INFO:teuthology.orchestra.run.smithi155.stdout: "time": "2023-08-01T19:54:51.461633+0000", 2023-08-01T19:55:22.583 INFO:teuthology.orchestra.run.smithi155.stdout: "duration": 0.000114015 2023-08-01T19:55:22.583 INFO:teuthology.orchestra.run.smithi155.stdout: }, 2023-08-01T19:55:22.583 INFO:teuthology.orchestra.run.smithi155.stdout: { 2023-08-01T19:55:22.583 INFO:teuthology.orchestra.run.smithi155.stdout: "event": "dispatched", 2023-08-01T19:55:22.584 INFO:teuthology.orchestra.run.smithi155.stdout: "time": "2023-08-01T19:54:51.461643+0000", 2023-08-01T19:55:22.584 INFO:teuthology.orchestra.run.smithi155.stdout: "duration": 1.0217000000000001e-05 2023-08-01T19:55:22.584 INFO:teuthology.orchestra.run.smithi155.stdout: }, 2023-08-01T19:55:22.584 INFO:teuthology.orchestra.run.smithi155.stdout: { 2023-08-01T19:55:22.585 INFO:teuthology.orchestra.run.smithi155.stdout: "event": "queued_for_pg", 2023-08-01T19:55:22.585 INFO:teuthology.orchestra.run.smithi155.stdout: "time": "2023-08-01T19:54:51.461649+0000", 2023-08-01T19:55:22.585 INFO:teuthology.orchestra.run.smithi155.stdout: "duration": 5.8850000000000004e-06 2023-08-01T19:55:22.586 INFO:teuthology.orchestra.run.smithi155.stdout: }, 2023-08-01T19:55:22.586 INFO:teuthology.orchestra.run.smithi155.stdout: { 2023-08-01T19:55:22.586 INFO:teuthology.orchestra.run.smithi155.stdout: "event": "reached_pg", 2023-08-01T19:55:22.586 INFO:teuthology.orchestra.run.smithi155.stdout: "time": "2023-08-01T19:54:51.461686+0000", 2023-08-01T19:55:22.587 INFO:teuthology.orchestra.run.smithi155.stdout: "duration": 3.7319e-05 2023-08-01T19:55:22.587 INFO:teuthology.orchestra.run.smithi155.stdout: }, 2023-08-01T19:55:22.587 INFO:teuthology.orchestra.run.smithi155.stdout: { 2023-08-01T19:55:22.587 INFO:teuthology.orchestra.run.smithi155.stdout: "event": "started", 2023-08-01T19:55:22.588 INFO:teuthology.orchestra.run.smithi155.stdout: "time": "2023-08-01T19:54:51.461802+0000", 2023-08-01T19:55:22.588 INFO:teuthology.orchestra.run.smithi155.stdout: "duration": 0.000115604 2023-08-01T19:55:22.588 INFO:teuthology.orchestra.run.smithi155.stdout: }, 2023-08-01T19:55:22.588 INFO:teuthology.orchestra.run.smithi155.stdout: { 2023-08-01T19:55:22.588 INFO:teuthology.orchestra.run.smithi155.stdout: "event": "waiting for subops from 0", 2023-08-01T19:55:22.589 INFO:teuthology.orchestra.run.smithi155.stdout: "time": "2023-08-01T19:54:51.461933+0000", 2023-08-01T19:55:22.589 INFO:teuthology.orchestra.run.smithi155.stdout: "duration": 0.000131175 2023-08-01T19:55:22.589 INFO:teuthology.orchestra.run.smithi155.stdout: }, 2023-08-01T19:55:22.589 INFO:teuthology.orchestra.run.smithi155.stdout: { 2023-08-01T19:55:22.590 INFO:teuthology.orchestra.run.smithi155.stdout: "event": "sub_op_commit_rec", 2023-08-01T19:55:22.590 INFO:teuthology.orchestra.run.smithi155.stdout: "time": "2023-08-01T19:54:51.468411+0000", 2023-08-01T19:55:22.590 INFO:teuthology.orchestra.run.smithi155.stdout: "duration": 0.0064775850000000001 2023-08-01T19:55:22.590 INFO:teuthology.orchestra.run.smithi155.stdout: }, 2023-08-01T19:55:22.591 INFO:teuthology.orchestra.run.smithi155.stdout: { 2023-08-01T19:55:22.591 INFO:teuthology.orchestra.run.smithi155.stdout: "event": "op_commit", 2023-08-01T19:55:22.591 INFO:teuthology.orchestra.run.smithi155.stdout: "time": "2023-08-01T19:54:51.485340+0000", 2023-08-01T19:55:22.591 INFO:teuthology.orchestra.run.smithi155.stdout: "duration": 0.016928907 2023-08-01T19:55:22.591 INFO:teuthology.orchestra.run.smithi155.stdout: }, 2023-08-01T19:55:22.592 INFO:teuthology.orchestra.run.smithi155.stdout: { 2023-08-01T19:55:22.592 INFO:teuthology.orchestra.run.smithi155.stdout: "event": "commit_sent", 2023-08-01T19:55:22.592 INFO:teuthology.orchestra.run.smithi155.stdout: "time": "2023-08-01T19:54:51.485385+0000", 2023-08-01T19:55:22.592 INFO:teuthology.orchestra.run.smithi155.stdout: "duration": 4.5222000000000002e-05 2023-08-01T19:55:22.593 INFO:teuthology.orchestra.run.smithi155.stdout: }, 2023-08-01T19:55:22.593 INFO:teuthology.orchestra.run.smithi155.stdout: { 2023-08-01T19:55:22.593 INFO:teuthology.orchestra.run.smithi155.stdout: "event": "done", 2023-08-01T19:55:22.593 INFO:teuthology.orchestra.run.smithi155.stdout: "time": "2023-08-01T19:54:51.485420+0000", 2023-08-01T19:55:22.594 INFO:teuthology.orchestra.run.smithi155.stdout: "duration": 3.4717e-05 2023-08-01T19:55:22.594 INFO:teuthology.orchestra.run.smithi155.stdout: } 2023-08-01T19:55:22.594 INFO:teuthology.orchestra.run.smithi155.stdout: ] 2023-08-01T19:55:22.594 INFO:teuthology.orchestra.run.smithi155.stdout: } 2023-08-01T19:55:22.594 INFO:teuthology.orchestra.run.smithi155.stdout: }, 2023-08-01T19:55:22.595 INFO:teuthology.orchestra.run.smithi155.stdout: { 2023-08-01T19:55:22.595 INFO:teuthology.orchestra.run.smithi155.stdout: "description": "osd_op(client.4668.0:100237 5.4 5:2d68bec9:::benchmark_data_smithi006_114134_object100236:head [set-alloc-hint object_size 65536 write_size 65536,write 0~65536] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e37)", 2023-08-01T19:55:22.595 INFO:teuthology.orchestra.run.smithi155.stdout: "initiated_at": "2023-08-01T19:55:05.147736+0000", 2023-08-01T19:55:22.595 INFO:teuthology.orchestra.run.smithi155.stdout: "age": 17.403690971, 2023-08-01T19:55:22.596 INFO:teuthology.orchestra.run.smithi155.stdout: "duration": 0.071299464000000007, 2023-08-01T19:55:22.596 INFO:teuthology.orchestra.run.smithi155.stdout: "type_data": { 2023-08-01T19:55:22.596 INFO:teuthology.orchestra.run.smithi155.stdout: "flag_point": "commit sent; apply or cleanup", 2023-08-01T19:55:22.597 INFO:teuthology.orchestra.run.smithi155.stdout: "client_info": { 2023-08-01T19:55:22.597 INFO:teuthology.orchestra.run.smithi155.stdout: "client": "client.4668", 2023-08-01T19:55:22.597 INFO:teuthology.orchestra.run.smithi155.stdout: "client_addr": "172.21.15.6:0/1709472247", 2023-08-01T19:55:22.597 INFO:teuthology.orchestra.run.smithi155.stdout: "tid": 100237 2023-08-01T19:55:22.598 INFO:teuthology.orchestra.run.smithi155.stdout: }, 2023-08-01T19:55:22.598 INFO:teuthology.orchestra.run.smithi155.stdout: "events": [ 2023-08-01T19:55:22.598 INFO:teuthology.orchestra.run.smithi155.stdout: { 2023-08-01T19:55:22.599 INFO:teuthology.orchestra.run.smithi155.stdout: "event": "initiated", 2023-08-01T19:55:22.599 INFO:teuthology.orchestra.run.smithi155.stdout: "time": "2023-08-01T19:55:05.147736+0000", 2023-08-01T19:55:22.599 INFO:teuthology.orchestra.run.smithi155.stdout: "duration": 0 2023-08-01T19:55:22.599 INFO:teuthology.orchestra.run.smithi155.stdout: }, 2023-08-01T19:55:22.599 INFO:teuthology.orchestra.run.smithi155.stdout: { 2023-08-01T19:55:22.600 INFO:teuthology.orchestra.run.smithi155.stdout: "event": "throttled", 2023-08-01T19:55:22.600 INFO:teuthology.orchestra.run.smithi155.stdout: "time": "2023-08-01T19:55:05.147736+0000", 2023-08-01T19:55:22.600 INFO:teuthology.orchestra.run.smithi155.stdout: "duration": 0 2023-08-01T19:55:22.600 INFO:teuthology.orchestra.run.smithi155.stdout: }, 2023-08-01T19:55:22.601 INFO:teuthology.orchestra.run.smithi155.stdout: { 2023-08-01T19:55:22.601 INFO:teuthology.orchestra.run.smithi155.stdout: "event": "header_read", 2023-08-01T19:55:22.601 INFO:teuthology.orchestra.run.smithi155.stdout: "time": "2023-08-01T19:55:05.147736+0000", 2023-08-01T19:55:22.601 INFO:teuthology.orchestra.run.smithi155.stdout: "duration": 4294967295.9999995 2023-08-01T19:55:22.601 INFO:teuthology.orchestra.run.smithi155.stdout: }, 2023-08-01T19:55:22.601 INFO:teuthology.orchestra.run.smithi155.stdout: { 2023-08-01T19:55:22.601 INFO:teuthology.orchestra.run.smithi155.stdout: "event": "all_read", 2023-08-01T19:55:22.602 INFO:teuthology.orchestra.run.smithi155.stdout: "time": "2023-08-01T19:55:05.147766+0000", 2023-08-01T19:55:22.602 INFO:teuthology.orchestra.run.smithi155.stdout: "duration": 3.0394000000000001e-05 2023-08-01T19:55:22.602 INFO:teuthology.orchestra.run.smithi155.stdout: }, 2023-08-01T19:55:22.602 INFO:teuthology.orchestra.run.smithi155.stdout: { 2023-08-01T19:55:22.602 INFO:teuthology.orchestra.run.smithi155.stdout: "event": "dispatched", 2023-08-01T19:55:22.602 INFO:teuthology.orchestra.run.smithi155.stdout: "time": "2023-08-01T19:55:05.147771+0000", 2023-08-01T19:55:22.602 INFO:teuthology.orchestra.run.smithi155.stdout: "duration": 4.25e-06 2023-08-01T19:55:22.602 INFO:teuthology.orchestra.run.smithi155.stdout: }, 2023-08-01T19:55:22.603 INFO:teuthology.orchestra.run.smithi155.stdout: { 2023-08-01T19:55:22.603 INFO:teuthology.orchestra.run.smithi155.stdout: "event": "queued_for_pg", 2023-08-01T19:55:22.603 INFO:teuthology.orchestra.run.smithi155.stdout: "time": "2023-08-01T19:55:05.147773+0000", 2023-08-01T19:55:22.603 INFO:teuthology.orchestra.run.smithi155.stdout: "duration": 2.4159999999999998e-06 2023-08-01T19:55:22.603 INFO:teuthology.orchestra.run.smithi155.stdout: }, 2023-08-01T19:55:22.603 INFO:teuthology.orchestra.run.smithi155.stdout: { 2023-08-01T19:55:22.603 INFO:teuthology.orchestra.run.smithi155.stdout: "event": "reached_pg", 2023-08-01T19:55:22.603 INFO:teuthology.orchestra.run.smithi155.stdout: "time": "2023-08-01T19:55:05.149903+0000", 2023-08-01T19:55:22.604 INFO:teuthology.orchestra.run.smithi155.stdout: "duration": 0.002129948 2023-08-01T19:55:22.604 INFO:teuthology.orchestra.run.smithi155.stdout: }, 2023-08-01T19:55:22.604 INFO:teuthology.orchestra.run.smithi155.stdout: { 2023-08-01T19:55:22.604 INFO:teuthology.orchestra.run.smithi155.stdout: "event": "started", 2023-08-01T19:55:22.604 INFO:teuthology.orchestra.run.smithi155.stdout: "time": "2023-08-01T19:55:05.149982+0000", 2023-08-01T19:55:22.604 INFO:teuthology.orchestra.run.smithi155.stdout: "duration": 7.8706000000000002e-05 2023-08-01T19:55:22.604 INFO:teuthology.orchestra.run.smithi155.stdout: }, 2023-08-01T19:55:22.605 INFO:teuthology.orchestra.run.smithi155.stdout: { 2023-08-01T19:55:22.605 INFO:teuthology.orchestra.run.smithi155.stdout: "event": "waiting for subops from 0", 2023-08-01T19:55:22.605 INFO:teuthology.orchestra.run.smithi155.stdout: "time": "2023-08-01T19:55:05.150066+0000", 2023-08-01T19:55:22.605 INFO:teuthology.orchestra.run.smithi155.stdout: "duration": 8.4241999999999997e-05 2023-08-01T19:55:22.605 INFO:teuthology.orchestra.run.smithi155.stdout: }, 2023-08-01T19:55:22.605 INFO:teuthology.orchestra.run.smithi155.stdout: { 2023-08-01T19:55:22.605 INFO:teuthology.orchestra.run.smithi155.stdout: "event": "op_commit", 2023-08-01T19:55:22.605 INFO:teuthology.orchestra.run.smithi155.stdout: "time": "2023-08-01T19:55:05.154994+0000", 2023-08-01T19:55:22.606 INFO:teuthology.orchestra.run.smithi155.stdout: "duration": 0.0049277050000000001 2023-08-01T19:55:22.606 INFO:teuthology.orchestra.run.smithi155.stdout: }, 2023-08-01T19:55:22.606 INFO:teuthology.orchestra.run.smithi155.stdout: { 2023-08-01T19:55:22.606 INFO:teuthology.orchestra.run.smithi155.stdout: "event": "sub_op_commit_rec", 2023-08-01T19:55:22.606 INFO:teuthology.orchestra.run.smithi155.stdout: "time": "2023-08-01T19:55:05.218933+0000", 2023-08-01T19:55:22.606 INFO:teuthology.orchestra.run.smithi155.stdout: "duration": 0.063939916999999999 2023-08-01T19:55:22.606 INFO:teuthology.orchestra.run.smithi155.stdout: }, 2023-08-01T19:55:22.606 INFO:teuthology.orchestra.run.smithi155.stdout: { 2023-08-01T19:55:22.607 INFO:teuthology.orchestra.run.smithi155.stdout: "event": "commit_sent", 2023-08-01T19:55:22.607 INFO:teuthology.orchestra.run.smithi155.stdout: "time": "2023-08-01T19:55:05.218989+0000", 2023-08-01T19:55:22.607 INFO:teuthology.orchestra.run.smithi155.stdout: "duration": 5.5772000000000001e-05 2023-08-01T19:55:22.607 INFO:teuthology.orchestra.run.smithi155.stdout: }, 2023-08-01T19:55:22.607 INFO:teuthology.orchestra.run.smithi155.stdout: { 2023-08-01T19:55:22.607 INFO:teuthology.orchestra.run.smithi155.stdout: "event": "done", 2023-08-01T19:55:22.607 INFO:teuthology.orchestra.run.smithi155.stdout: "time": "2023-08-01T19:55:05.219036+0000", 2023-08-01T19:55:22.608 INFO:teuthology.orchestra.run.smithi155.stdout: "duration": 4.6526000000000001e-05 2023-08-01T19:55:22.608 INFO:teuthology.orchestra.run.smithi155.stdout: } 2023-08-01T19:55:22.608 INFO:teuthology.orchestra.run.smithi155.stdout: ] 2023-08-01T19:55:22.608 INFO:teuthology.orchestra.run.smithi155.stdout: } 2023-08-01T19:55:22.608 INFO:teuthology.orchestra.run.smithi155.stdout: }, 2023-08-01T19:55:22.608 INFO:teuthology.orchestra.run.smithi155.stdout: { 2023-08-01T19:55:22.608 INFO:teuthology.orchestra.run.smithi155.stdout: "description": "osd_op(client.4668.0:100242 5.8 5:16a314b8:::benchmark_data_smithi006_114134_object100241:head [set-alloc-hint object_size 65536 write_size 65536,write 0~65536] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e37)", 2023-08-01T19:55:22.609 INFO:teuthology.orchestra.run.smithi155.stdout: "initiated_at": "2023-08-01T19:55:05.150616+0000", 2023-08-01T19:55:22.609 INFO:teuthology.orchestra.run.smithi155.stdout: "age": 17.400811341000001, 2023-08-01T19:55:22.609 INFO:teuthology.orchestra.run.smithi155.stdout: "duration": 0.071105065999999995, 2023-08-01T19:55:22.609 INFO:teuthology.orchestra.run.smithi155.stdout: "type_data": { 2023-08-01T19:55:22.609 INFO:teuthology.orchestra.run.smithi155.stdout: "flag_point": "commit sent; apply or cleanup", 2023-08-01T19:55:22.609 INFO:teuthology.orchestra.run.smithi155.stdout: "client_info": { 2023-08-01T19:55:22.609 INFO:teuthology.orchestra.run.smithi155.stdout: "client": "client.4668", 2023-08-01T19:55:22.609 INFO:teuthology.orchestra.run.smithi155.stdout: "client_addr": "172.21.15.6:0/1709472247", 2023-08-01T19:55:22.610 INFO:teuthology.orchestra.run.smithi155.stdout: "tid": 100242 2023-08-01T19:55:22.610 INFO:teuthology.orchestra.run.smithi155.stdout: }, 2023-08-01T19:55:22.610 INFO:teuthology.orchestra.run.smithi155.stdout: "events": [ 2023-08-01T19:55:22.610 INFO:teuthology.orchestra.run.smithi155.stdout: { 2023-08-01T19:55:22.610 INFO:teuthology.orchestra.run.smithi155.stdout: "event": "initiated", 2023-08-01T19:55:22.610 INFO:teuthology.orchestra.run.smithi155.stdout: "time": "2023-08-01T19:55:05.150616+0000", 2023-08-01T19:55:22.610 INFO:teuthology.orchestra.run.smithi155.stdout: "duration": 0 2023-08-01T19:55:22.610 INFO:teuthology.orchestra.run.smithi155.stdout: }, 2023-08-01T19:55:22.611 INFO:teuthology.orchestra.run.smithi155.stdout: { 2023-08-01T19:55:22.611 INFO:teuthology.orchestra.run.smithi155.stdout: "event": "throttled", 2023-08-01T19:55:22.611 INFO:teuthology.orchestra.run.smithi155.stdout: "time": "2023-08-01T19:55:05.150616+0000", 2023-08-01T19:55:22.611 INFO:teuthology.orchestra.run.smithi155.stdout: "duration": 0 2023-08-01T19:55:22.611 INFO:teuthology.orchestra.run.smithi155.stdout: }, 2023-08-01T19:55:22.611 INFO:teuthology.orchestra.run.smithi155.stdout: { 2023-08-01T19:55:22.611 INFO:teuthology.orchestra.run.smithi155.stdout: "event": "header_read", 2023-08-01T19:55:22.611 INFO:teuthology.orchestra.run.smithi155.stdout: "time": "2023-08-01T19:55:05.150615+0000", 2023-08-01T19:55:22.612 INFO:teuthology.orchestra.run.smithi155.stdout: "duration": 4294967295.999999 2023-08-01T19:55:22.612 INFO:teuthology.orchestra.run.smithi155.stdout: }, 2023-08-01T19:55:22.612 INFO:teuthology.orchestra.run.smithi155.stdout: { 2023-08-01T19:55:22.612 INFO:teuthology.orchestra.run.smithi155.stdout: "event": "all_read", 2023-08-01T19:55:22.612 INFO:teuthology.orchestra.run.smithi155.stdout: "time": "2023-08-01T19:55:05.150696+0000", 2023-08-01T19:55:22.612 INFO:teuthology.orchestra.run.smithi155.stdout: "duration": 8.0852000000000004e-05 2023-08-01T19:55:22.612 INFO:teuthology.orchestra.run.smithi155.stdout: }, 2023-08-01T19:55:22.613 INFO:teuthology.orchestra.run.smithi155.stdout: { 2023-08-01T19:55:22.613 INFO:teuthology.orchestra.run.smithi155.stdout: "event": "dispatched", 2023-08-01T19:55:22.613 INFO:teuthology.orchestra.run.smithi155.stdout: "time": "2023-08-01T19:55:05.150708+0000", 2023-08-01T19:55:22.613 INFO:teuthology.orchestra.run.smithi155.stdout: "duration": 1.2116999999999999e-05 2023-08-01T19:55:22.613 INFO:teuthology.orchestra.run.smithi155.stdout: }, 2023-08-01T19:55:22.613 INFO:teuthology.orchestra.run.smithi155.stdout: { 2023-08-01T19:55:22.613 INFO:teuthology.orchestra.run.smithi155.stdout: "event": "queued_for_pg", 2023-08-01T19:55:22.613 INFO:teuthology.orchestra.run.smithi155.stdout: "time": "2023-08-01T19:55:05.150713+0000", 2023-08-01T19:55:22.614 INFO:teuthology.orchestra.run.smithi155.stdout: "duration": 5.4620000000000004e-06 2023-08-01T19:55:22.614 INFO:teuthology.orchestra.run.smithi155.stdout: }, 2023-08-01T19:55:22.614 INFO:teuthology.orchestra.run.smithi155.stdout: { 2023-08-01T19:55:22.614 INFO:teuthology.orchestra.run.smithi155.stdout: "event": "reached_pg", 2023-08-01T19:55:22.614 INFO:teuthology.orchestra.run.smithi155.stdout: "time": "2023-08-01T19:55:05.150761+0000", 2023-08-01T19:55:22.614 INFO:teuthology.orchestra.run.smithi155.stdout: "duration": 4.7429000000000003e-05 2023-08-01T19:55:22.614 INFO:teuthology.orchestra.run.smithi155.stdout: }, 2023-08-01T19:55:22.614 INFO:teuthology.orchestra.run.smithi155.stdout: { 2023-08-01T19:55:22.615 INFO:teuthology.orchestra.run.smithi155.stdout: "event": "started", 2023-08-01T19:55:22.615 INFO:teuthology.orchestra.run.smithi155.stdout: "time": "2023-08-01T19:55:05.150856+0000", 2023-08-01T19:55:22.615 INFO:teuthology.orchestra.run.smithi155.stdout: "duration": 9.5356e-05 2023-08-01T19:55:22.615 INFO:teuthology.orchestra.run.smithi155.stdout: }, 2023-08-01T19:55:22.615 INFO:teuthology.orchestra.run.smithi155.stdout: { 2023-08-01T19:55:22.615 INFO:teuthology.orchestra.run.smithi155.stdout: "event": "waiting for subops from 0", 2023-08-01T19:55:22.615 INFO:teuthology.orchestra.run.smithi155.stdout: "time": "2023-08-01T19:55:05.150999+0000", 2023-08-01T19:55:22.616 INFO:teuthology.orchestra.run.smithi155.stdout: "duration": 0.00014234499999999999 2023-08-01T19:55:22.616 INFO:teuthology.orchestra.run.smithi155.stdout: }, 2023-08-01T19:55:22.616 INFO:teuthology.orchestra.run.smithi155.stdout: { 2023-08-01T19:55:22.616 INFO:teuthology.orchestra.run.smithi155.stdout: "event": "sub_op_commit_rec", 2023-08-01T19:55:22.616 INFO:teuthology.orchestra.run.smithi155.stdout: "time": "2023-08-01T19:55:05.219001+0000", 2023-08-01T19:55:22.616 INFO:teuthology.orchestra.run.smithi155.stdout: "duration": 0.068002776000000001 2023-08-01T19:55:22.616 INFO:teuthology.orchestra.run.smithi155.stdout: }, 2023-08-01T19:55:22.616 INFO:teuthology.orchestra.run.smithi155.stdout: { 2023-08-01T19:55:22.617 INFO:teuthology.orchestra.run.smithi155.stdout: "event": "op_commit", 2023-08-01T19:55:22.617 INFO:teuthology.orchestra.run.smithi155.stdout: "time": "2023-08-01T19:55:05.221635+0000", 2023-08-01T19:55:22.617 INFO:teuthology.orchestra.run.smithi155.stdout: "duration": 0.0026340579999999999 2023-08-01T19:55:22.617 INFO:teuthology.orchestra.run.smithi155.stdout: }, 2023-08-01T19:55:22.617 INFO:teuthology.orchestra.run.smithi155.stdout: { 2023-08-01T19:55:22.617 INFO:teuthology.orchestra.run.smithi155.stdout: "event": "commit_sent", 2023-08-01T19:55:22.617 INFO:teuthology.orchestra.run.smithi155.stdout: "time": "2023-08-01T19:55:05.221682+0000", 2023-08-01T19:55:22.617 INFO:teuthology.orchestra.run.smithi155.stdout: "duration": 4.7123999999999998e-05 2023-08-01T19:55:22.618 INFO:teuthology.orchestra.run.smithi155.stdout: }, 2023-08-01T19:55:22.618 INFO:teuthology.orchestra.run.smithi155.stdout: { 2023-08-01T19:55:22.618 INFO:teuthology.orchestra.run.smithi155.stdout: "event": "done", 2023-08-01T19:55:22.618 INFO:teuthology.orchestra.run.smithi155.stdout: "time": "2023-08-01T19:55:05.221721+0000", 2023-08-01T19:55:22.618 INFO:teuthology.orchestra.run.smithi155.stdout: "duration": 3.8529999999999999e-05 2023-08-01T19:55:22.618 INFO:teuthology.orchestra.run.smithi155.stdout: } 2023-08-01T19:55:22.618 INFO:teuthology.orchestra.run.smithi155.stdout: ] 2023-08-01T19:55:22.618 INFO:teuthology.orchestra.run.smithi155.stdout: } 2023-08-01T19:55:22.619 INFO:teuthology.orchestra.run.smithi155.stdout: }, 2023-08-01T19:55:22.619 INFO:teuthology.orchestra.run.smithi155.stdout: { 2023-08-01T19:55:22.619 INFO:teuthology.orchestra.run.smithi155.stdout: "description": "osd_repop(client.4668.0:100240 5.a e37/19 5:5313c5b9:::benchmark_data_smithi006_114134_object100239:head v 37'6227, mlcod=37'6225)", 2023-08-01T19:55:22.619 INFO:teuthology.orchestra.run.smithi155.stdout: "initiated_at": "2023-08-01T19:55:05.150778+0000", 2023-08-01T19:55:22.619 INFO:teuthology.orchestra.run.smithi155.stdout: "age": 17.400649139999999, 2023-08-01T19:55:22.619 INFO:teuthology.orchestra.run.smithi155.stdout: "duration": 0.073362533999999993, 2023-08-01T19:55:22.619 INFO:teuthology.orchestra.run.smithi155.stdout: "type_data": { 2023-08-01T19:55:22.619 INFO:teuthology.orchestra.run.smithi155.stdout: "flag_point": "commit sent; apply or cleanup", 2023-08-01T19:55:22.620 INFO:teuthology.orchestra.run.smithi155.stdout: "events": [ 2023-08-01T19:55:22.620 INFO:teuthology.orchestra.run.smithi155.stdout: { 2023-08-01T19:55:22.620 INFO:teuthology.orchestra.run.smithi155.stdout: "event": "initiated", 2023-08-01T19:55:22.620 INFO:teuthology.orchestra.run.smithi155.stdout: "time": "2023-08-01T19:55:05.150778+0000", 2023-08-01T19:55:22.620 INFO:teuthology.orchestra.run.smithi155.stdout: "duration": 0 2023-08-01T19:55:22.620 INFO:teuthology.orchestra.run.smithi155.stdout: }, 2023-08-01T19:55:22.620 INFO:teuthology.orchestra.run.smithi155.stdout: { 2023-08-01T19:55:22.621 INFO:teuthology.orchestra.run.smithi155.stdout: "event": "throttled", 2023-08-01T19:55:22.621 INFO:teuthology.orchestra.run.smithi155.stdout: "time": "2023-08-01T19:55:05.150778+0000", 2023-08-01T19:55:22.621 INFO:teuthology.orchestra.run.smithi155.stdout: "duration": 0 2023-08-01T19:55:22.621 INFO:teuthology.orchestra.run.smithi155.stdout: }, 2023-08-01T19:55:22.621 INFO:teuthology.orchestra.run.smithi155.stdout: { 2023-08-01T19:55:22.621 INFO:teuthology.orchestra.run.smithi155.stdout: "event": "header_read", 2023-08-01T19:55:22.621 INFO:teuthology.orchestra.run.smithi155.stdout: "time": "2023-08-01T19:55:05.150778+0000", 2023-08-01T19:55:22.621 INFO:teuthology.orchestra.run.smithi155.stdout: "duration": 4294967295.9999995 2023-08-01T19:55:22.622 INFO:teuthology.orchestra.run.smithi155.stdout: }, 2023-08-01T19:55:22.622 INFO:teuthology.orchestra.run.smithi155.stdout: { 2023-08-01T19:55:22.622 INFO:teuthology.orchestra.run.smithi155.stdout: "event": "all_read", 2023-08-01T19:55:22.622 INFO:teuthology.orchestra.run.smithi155.stdout: "time": "2023-08-01T19:55:05.150811+0000", 2023-08-01T19:55:22.622 INFO:teuthology.orchestra.run.smithi155.stdout: "duration": 3.3664000000000002e-05 2023-08-01T19:55:22.622 INFO:teuthology.orchestra.run.smithi155.stdout: }, 2023-08-01T19:55:22.622 INFO:teuthology.orchestra.run.smithi155.stdout: { 2023-08-01T19:55:22.622 INFO:teuthology.orchestra.run.smithi155.stdout: "event": "dispatched", 2023-08-01T19:55:22.623 INFO:teuthology.orchestra.run.smithi155.stdout: "time": "2023-08-01T19:55:05.150818+0000", 2023-08-01T19:55:22.623 INFO:teuthology.orchestra.run.smithi155.stdout: "duration": 6.5769999999999999e-06 2023-08-01T19:55:22.623 INFO:teuthology.orchestra.run.smithi155.stdout: }, 2023-08-01T19:55:22.623 INFO:teuthology.orchestra.run.smithi155.stdout: { 2023-08-01T19:55:22.623 INFO:teuthology.orchestra.run.smithi155.stdout: "event": "queued_for_pg", 2023-08-01T19:55:22.623 INFO:teuthology.orchestra.run.smithi155.stdout: "time": "2023-08-01T19:55:05.150822+0000", 2023-08-01T19:55:22.623 INFO:teuthology.orchestra.run.smithi155.stdout: "duration": 4.0060000000000003e-06 2023-08-01T19:55:22.623 INFO:teuthology.orchestra.run.smithi155.stdout: }, 2023-08-01T19:55:22.624 INFO:teuthology.orchestra.run.smithi155.stdout: { 2023-08-01T19:55:22.624 INFO:teuthology.orchestra.run.smithi155.stdout: "event": "reached_pg", 2023-08-01T19:55:22.624 INFO:teuthology.orchestra.run.smithi155.stdout: "time": "2023-08-01T19:55:05.150855+0000", 2023-08-01T19:55:22.624 INFO:teuthology.orchestra.run.smithi155.stdout: "duration": 3.3204999999999998e-05 2023-08-01T19:55:22.624 INFO:teuthology.orchestra.run.smithi155.stdout: }, 2023-08-01T19:55:22.624 INFO:teuthology.orchestra.run.smithi155.stdout: { 2023-08-01T19:55:22.624 INFO:teuthology.orchestra.run.smithi155.stdout: "event": "started", 2023-08-01T19:55:22.625 INFO:teuthology.orchestra.run.smithi155.stdout: "time": "2023-08-01T19:55:05.150873+0000", 2023-08-01T19:55:22.625 INFO:teuthology.orchestra.run.smithi155.stdout: "duration": 1.8139999999999999e-05 2023-08-01T19:55:22.625 INFO:teuthology.orchestra.run.smithi155.stdout: }, 2023-08-01T19:55:22.625 INFO:teuthology.orchestra.run.smithi155.stdout: { 2023-08-01T19:55:22.625 INFO:teuthology.orchestra.run.smithi155.stdout: "event": "commit_sent", 2023-08-01T19:55:22.625 INFO:teuthology.orchestra.run.smithi155.stdout: "time": "2023-08-01T19:55:05.224095+0000", 2023-08-01T19:55:22.625 INFO:teuthology.orchestra.run.smithi155.stdout: "duration": 0.073221895999999995 2023-08-01T19:55:22.625 INFO:teuthology.orchestra.run.smithi155.stdout: }, 2023-08-01T19:55:22.626 INFO:teuthology.orchestra.run.smithi155.stdout: { 2023-08-01T19:55:22.626 INFO:teuthology.orchestra.run.smithi155.stdout: "event": "done", 2023-08-01T19:55:22.626 INFO:teuthology.orchestra.run.smithi155.stdout: "time": "2023-08-01T19:55:05.224141+0000", 2023-08-01T19:55:22.626 INFO:teuthology.orchestra.run.smithi155.stdout: "duration": 4.5385e-05 2023-08-01T19:55:22.626 INFO:teuthology.orchestra.run.smithi155.stdout: } 2023-08-01T19:55:22.626 INFO:teuthology.orchestra.run.smithi155.stdout: ] 2023-08-01T19:55:22.626 INFO:teuthology.orchestra.run.smithi155.stdout: } 2023-08-01T19:55:22.626 INFO:teuthology.orchestra.run.smithi155.stdout: }, 2023-08-01T19:55:22.627 INFO:teuthology.orchestra.run.smithi155.stdout: { 2023-08-01T19:55:22.627 INFO:teuthology.orchestra.run.smithi155.stdout: "description": "osd_op(client.4668.0:100245 5.e 5:71869c66:::benchmark_data_smithi006_114134_object100244:head [set-alloc-hint object_size 65536 write_size 65536,write 0~65536] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e37)", 2023-08-01T19:55:22.627 INFO:teuthology.orchestra.run.smithi155.stdout: "initiated_at": "2023-08-01T19:55:05.150991+0000", 2023-08-01T19:55:22.627 INFO:teuthology.orchestra.run.smithi155.stdout: "age": 17.400436353, 2023-08-01T19:55:22.627 INFO:teuthology.orchestra.run.smithi155.stdout: "duration": 0.070734490999999997, 2023-08-01T19:55:22.627 INFO:teuthology.orchestra.run.smithi155.stdout: "type_data": { 2023-08-01T19:55:22.627 INFO:teuthology.orchestra.run.smithi155.stdout: "flag_point": "commit sent; apply or cleanup", 2023-08-01T19:55:22.627 INFO:teuthology.orchestra.run.smithi155.stdout: "client_info": { 2023-08-01T19:55:22.628 INFO:teuthology.orchestra.run.smithi155.stdout: "client": "client.4668", 2023-08-01T19:55:22.628 INFO:teuthology.orchestra.run.smithi155.stdout: "client_addr": "172.21.15.6:0/1709472247", 2023-08-01T19:55:22.628 INFO:teuthology.orchestra.run.smithi155.stdout: "tid": 100245 2023-08-01T19:55:22.628 INFO:teuthology.orchestra.run.smithi155.stdout: }, 2023-08-01T19:55:22.628 INFO:teuthology.orchestra.run.smithi155.stdout: "events": [ 2023-08-01T19:55:22.628 INFO:teuthology.orchestra.run.smithi155.stdout: { 2023-08-01T19:55:22.628 INFO:teuthology.orchestra.run.smithi155.stdout: "event": "initiated", 2023-08-01T19:55:22.629 INFO:teuthology.orchestra.run.smithi155.stdout: "time": "2023-08-01T19:55:05.150991+0000", 2023-08-01T19:55:22.629 INFO:teuthology.orchestra.run.smithi155.stdout: "duration": 0 2023-08-01T19:55:22.629 INFO:teuthology.orchestra.run.smithi155.stdout: }, 2023-08-01T19:55:22.629 INFO:teuthology.orchestra.run.smithi155.stdout: { 2023-08-01T19:55:22.629 INFO:teuthology.orchestra.run.smithi155.stdout: "event": "throttled", 2023-08-01T19:55:22.630 INFO:teuthology.orchestra.run.smithi155.stdout: "time": "2023-08-01T19:55:05.150991+0000", 2023-08-01T19:55:22.630 INFO:teuthology.orchestra.run.smithi155.stdout: "duration": 0 2023-08-01T19:55:22.630 INFO:teuthology.orchestra.run.smithi155.stdout: }, 2023-08-01T19:55:22.630 INFO:teuthology.orchestra.run.smithi155.stdout: { 2023-08-01T19:55:22.630 INFO:teuthology.orchestra.run.smithi155.stdout: "event": "header_read", 2023-08-01T19:55:22.630 INFO:teuthology.orchestra.run.smithi155.stdout: "time": "2023-08-01T19:55:05.150990+0000", 2023-08-01T19:55:22.630 INFO:teuthology.orchestra.run.smithi155.stdout: "duration": 4294967295.999999 2023-08-01T19:55:22.631 INFO:teuthology.orchestra.run.smithi155.stdout: }, 2023-08-01T19:55:22.631 INFO:teuthology.orchestra.run.smithi155.stdout: { 2023-08-01T19:55:22.631 INFO:teuthology.orchestra.run.smithi155.stdout: "event": "all_read", 2023-08-01T19:55:22.631 INFO:teuthology.orchestra.run.smithi155.stdout: "time": "2023-08-01T19:55:05.151108+0000", 2023-08-01T19:55:22.631 INFO:teuthology.orchestra.run.smithi155.stdout: "duration": 0.00011849300000000001 2023-08-01T19:55:22.631 INFO:teuthology.orchestra.run.smithi155.stdout: }, 2023-08-01T19:55:22.631 INFO:teuthology.orchestra.run.smithi155.stdout: { 2023-08-01T19:55:22.631 INFO:teuthology.orchestra.run.smithi155.stdout: "event": "dispatched", 2023-08-01T19:55:22.632 INFO:teuthology.orchestra.run.smithi155.stdout: "time": "2023-08-01T19:55:05.151117+0000", 2023-08-01T19:55:22.632 INFO:teuthology.orchestra.run.smithi155.stdout: "duration": 8.1040000000000007e-06 2023-08-01T19:55:22.632 INFO:teuthology.orchestra.run.smithi155.stdout: }, 2023-08-01T19:55:22.632 INFO:teuthology.orchestra.run.smithi155.stdout: { 2023-08-01T19:55:22.632 INFO:teuthology.orchestra.run.smithi155.stdout: "event": "queued_for_pg", 2023-08-01T19:55:22.632 INFO:teuthology.orchestra.run.smithi155.stdout: "time": "2023-08-01T19:55:05.151121+0000", 2023-08-01T19:55:22.632 INFO:teuthology.orchestra.run.smithi155.stdout: "duration": 4.2019999999999997e-06 2023-08-01T19:55:22.633 INFO:teuthology.orchestra.run.smithi155.stdout: }, 2023-08-01T19:55:22.633 INFO:teuthology.orchestra.run.smithi155.stdout: { 2023-08-01T19:55:22.633 INFO:teuthology.orchestra.run.smithi155.stdout: "event": "reached_pg", 2023-08-01T19:55:22.633 INFO:teuthology.orchestra.run.smithi155.stdout: "time": "2023-08-01T19:55:05.151162+0000", 2023-08-01T19:55:22.633 INFO:teuthology.orchestra.run.smithi155.stdout: "duration": 4.1448e-05 2023-08-01T19:55:22.633 INFO:teuthology.orchestra.run.smithi155.stdout: }, 2023-08-01T19:55:22.633 INFO:teuthology.orchestra.run.smithi155.stdout: { 2023-08-01T19:55:22.633 INFO:teuthology.orchestra.run.smithi155.stdout: "event": "started", 2023-08-01T19:55:22.634 INFO:teuthology.orchestra.run.smithi155.stdout: "time": "2023-08-01T19:55:05.151281+0000", 2023-08-01T19:55:22.634 INFO:teuthology.orchestra.run.smithi155.stdout: "duration": 0.000119141 2023-08-01T19:55:22.634 INFO:teuthology.orchestra.run.smithi155.stdout: }, 2023-08-01T19:55:22.634 INFO:teuthology.orchestra.run.smithi155.stdout: { 2023-08-01T19:55:22.634 INFO:teuthology.orchestra.run.smithi155.stdout: "event": "waiting for subops from 0", 2023-08-01T19:55:22.634 INFO:teuthology.orchestra.run.smithi155.stdout: "time": "2023-08-01T19:55:05.151443+0000", 2023-08-01T19:55:22.634 INFO:teuthology.orchestra.run.smithi155.stdout: "duration": 0.00016181600000000001 2023-08-01T19:55:22.634 INFO:teuthology.orchestra.run.smithi155.stdout: }, 2023-08-01T19:55:22.635 INFO:teuthology.orchestra.run.smithi155.stdout: { 2023-08-01T19:55:22.635 INFO:teuthology.orchestra.run.smithi155.stdout: "event": "sub_op_commit_rec", 2023-08-01T19:55:22.635 INFO:teuthology.orchestra.run.smithi155.stdout: "time": "2023-08-01T19:55:05.219101+0000", 2023-08-01T19:55:22.635 INFO:teuthology.orchestra.run.smithi155.stdout: "duration": 0.067658037000000004 2023-08-01T19:55:22.635 INFO:teuthology.orchestra.run.smithi155.stdout: }, 2023-08-01T19:55:22.635 INFO:teuthology.orchestra.run.smithi155.stdout: { 2023-08-01T19:55:22.635 INFO:teuthology.orchestra.run.smithi155.stdout: "event": "op_commit", 2023-08-01T19:55:22.635 INFO:teuthology.orchestra.run.smithi155.stdout: "time": "2023-08-01T19:55:05.221646+0000", 2023-08-01T19:55:22.636 INFO:teuthology.orchestra.run.smithi155.stdout: "duration": 0.0025450540000000002 2023-08-01T19:55:22.636 INFO:teuthology.orchestra.run.smithi155.stdout: }, 2023-08-01T19:55:22.636 INFO:teuthology.orchestra.run.smithi155.stdout: { 2023-08-01T19:55:22.636 INFO:teuthology.orchestra.run.smithi155.stdout: "event": "commit_sent", 2023-08-01T19:55:22.636 INFO:teuthology.orchestra.run.smithi155.stdout: "time": "2023-08-01T19:55:05.221689+0000", 2023-08-01T19:55:22.636 INFO:teuthology.orchestra.run.smithi155.stdout: "duration": 4.3078999999999999e-05 2023-08-01T19:55:22.636 INFO:teuthology.orchestra.run.smithi155.stdout: }, 2023-08-01T19:55:22.637 INFO:teuthology.orchestra.run.smithi155.stdout: { 2023-08-01T19:55:22.637 INFO:teuthology.orchestra.run.smithi155.stdout: "event": "done", 2023-08-01T19:55:22.637 INFO:teuthology.orchestra.run.smithi155.stdout: "time": "2023-08-01T19:55:05.221725+0000", 2023-08-01T19:55:22.637 INFO:teuthology.orchestra.run.smithi155.stdout: "duration": 3.6137999999999999e-05 2023-08-01T19:55:22.637 INFO:teuthology.orchestra.run.smithi155.stdout: } 2023-08-01T19:55:22.637 INFO:teuthology.orchestra.run.smithi155.stdout: ] 2023-08-01T19:55:22.637 INFO:teuthology.orchestra.run.smithi155.stdout: } 2023-08-01T19:55:22.637 INFO:teuthology.orchestra.run.smithi155.stdout: }, 2023-08-01T19:55:22.638 INFO:teuthology.orchestra.run.smithi155.stdout: { 2023-08-01T19:55:22.638 INFO:teuthology.orchestra.run.smithi155.stdout: "description": "osd_repop(client.4668.0:100243 5.a e37/19 5:5e8193b6:::benchmark_data_smithi006_114134_object100242:head v 37'6228, mlcod=37'6225)", 2023-08-01T19:55:22.638 INFO:teuthology.orchestra.run.smithi155.stdout: "initiated_at": "2023-08-01T19:55:05.151148+0000", 2023-08-01T19:55:22.638 INFO:teuthology.orchestra.run.smithi155.stdout: "age": 17.400279342000001, 2023-08-01T19:55:22.638 INFO:teuthology.orchestra.run.smithi155.stdout: "duration": 0.073020370000000001, 2023-08-01T19:55:22.638 INFO:teuthology.orchestra.run.smithi155.stdout: "type_data": { 2023-08-01T19:55:22.638 INFO:teuthology.orchestra.run.smithi155.stdout: "flag_point": "commit sent; apply or cleanup", 2023-08-01T19:55:22.638 INFO:teuthology.orchestra.run.smithi155.stdout: "events": [ 2023-08-01T19:55:22.639 INFO:teuthology.orchestra.run.smithi155.stdout: { 2023-08-01T19:55:22.639 INFO:teuthology.orchestra.run.smithi155.stdout: "event": "initiated", 2023-08-01T19:55:22.639 INFO:teuthology.orchestra.run.smithi155.stdout: "time": "2023-08-01T19:55:05.151148+0000", 2023-08-01T19:55:22.639 INFO:teuthology.orchestra.run.smithi155.stdout: "duration": 0 2023-08-01T19:55:22.639 INFO:teuthology.orchestra.run.smithi155.stdout: }, 2023-08-01T19:55:22.639 INFO:teuthology.orchestra.run.smithi155.stdout: { 2023-08-01T19:55:22.639 INFO:teuthology.orchestra.run.smithi155.stdout: "event": "throttled", 2023-08-01T19:55:22.639 INFO:teuthology.orchestra.run.smithi155.stdout: "time": "2023-08-01T19:55:05.151148+0000", 2023-08-01T19:55:22.640 INFO:teuthology.orchestra.run.smithi155.stdout: "duration": 0 2023-08-01T19:55:22.640 INFO:teuthology.orchestra.run.smithi155.stdout: }, 2023-08-01T19:55:22.640 INFO:teuthology.orchestra.run.smithi155.stdout: { 2023-08-01T19:55:22.640 INFO:teuthology.orchestra.run.smithi155.stdout: "event": "header_read", 2023-08-01T19:55:22.640 INFO:teuthology.orchestra.run.smithi155.stdout: "time": "2023-08-01T19:55:05.151147+0000", 2023-08-01T19:55:22.640 INFO:teuthology.orchestra.run.smithi155.stdout: "duration": 4294967295.9999995 2023-08-01T19:55:22.640 INFO:teuthology.orchestra.run.smithi155.stdout: }, 2023-08-01T19:55:22.641 INFO:teuthology.orchestra.run.smithi155.stdout: { 2023-08-01T19:55:22.641 INFO:teuthology.orchestra.run.smithi155.stdout: "event": "all_read", 2023-08-01T19:55:22.641 INFO:teuthology.orchestra.run.smithi155.stdout: "time": "2023-08-01T19:55:05.151231+0000", 2023-08-01T19:55:22.641 INFO:teuthology.orchestra.run.smithi155.stdout: "duration": 8.3135999999999998e-05 2023-08-01T19:55:22.641 INFO:teuthology.orchestra.run.smithi155.stdout: }, 2023-08-01T19:55:22.641 INFO:teuthology.orchestra.run.smithi155.stdout: { 2023-08-01T19:55:22.641 INFO:teuthology.orchestra.run.smithi155.stdout: "event": "dispatched", 2023-08-01T19:55:22.641 INFO:teuthology.orchestra.run.smithi155.stdout: "time": "2023-08-01T19:55:05.151239+0000", 2023-08-01T19:55:22.642 INFO:teuthology.orchestra.run.smithi155.stdout: "duration": 8.7469999999999994e-06 2023-08-01T19:55:22.642 INFO:teuthology.orchestra.run.smithi155.stdout: }, 2023-08-01T19:55:22.642 INFO:teuthology.orchestra.run.smithi155.stdout: { 2023-08-01T19:55:22.642 INFO:teuthology.orchestra.run.smithi155.stdout: "event": "queued_for_pg", 2023-08-01T19:55:22.642 INFO:teuthology.orchestra.run.smithi155.stdout: "time": "2023-08-01T19:55:05.151244+0000", 2023-08-01T19:55:22.642 INFO:teuthology.orchestra.run.smithi155.stdout: "duration": 4.4800000000000003e-06 2023-08-01T19:55:22.642 INFO:teuthology.orchestra.run.smithi155.stdout: }, 2023-08-01T19:55:22.642 INFO:teuthology.orchestra.run.smithi155.stdout: { 2023-08-01T19:55:22.643 INFO:teuthology.orchestra.run.smithi155.stdout: "event": "reached_pg", 2023-08-01T19:55:22.643 INFO:teuthology.orchestra.run.smithi155.stdout: "time": "2023-08-01T19:55:05.152938+0000", 2023-08-01T19:55:22.643 INFO:teuthology.orchestra.run.smithi155.stdout: "duration": 0.001693824 2023-08-01T19:55:22.643 INFO:teuthology.orchestra.run.smithi155.stdout: }, 2023-08-01T19:55:22.643 INFO:teuthology.orchestra.run.smithi155.stdout: { 2023-08-01T19:55:22.643 INFO:teuthology.orchestra.run.smithi155.stdout: "event": "started", 2023-08-01T19:55:22.643 INFO:teuthology.orchestra.run.smithi155.stdout: "time": "2023-08-01T19:55:05.152956+0000", 2023-08-01T19:55:22.643 INFO:teuthology.orchestra.run.smithi155.stdout: "duration": 1.8287e-05 2023-08-01T19:55:22.644 INFO:teuthology.orchestra.run.smithi155.stdout: }, 2023-08-01T19:55:22.644 INFO:teuthology.orchestra.run.smithi155.stdout: { 2023-08-01T19:55:22.644 INFO:teuthology.orchestra.run.smithi155.stdout: "event": "commit_sent", 2023-08-01T19:55:22.644 INFO:teuthology.orchestra.run.smithi155.stdout: "time": "2023-08-01T19:55:05.224145+0000", 2023-08-01T19:55:22.644 INFO:teuthology.orchestra.run.smithi155.stdout: "duration": 0.071189447000000003 2023-08-01T19:55:22.644 INFO:teuthology.orchestra.run.smithi155.stdout: }, 2023-08-01T19:55:22.644 INFO:teuthology.orchestra.run.smithi155.stdout: { 2023-08-01T19:55:22.645 INFO:teuthology.orchestra.run.smithi155.stdout: "event": "done", 2023-08-01T19:55:22.645 INFO:teuthology.orchestra.run.smithi155.stdout: "time": "2023-08-01T19:55:05.224168+0000", 2023-08-01T19:55:22.645 INFO:teuthology.orchestra.run.smithi155.stdout: "duration": 2.3008999999999999e-05 2023-08-01T19:55:22.645 INFO:teuthology.orchestra.run.smithi155.stdout: } 2023-08-01T19:55:22.645 INFO:teuthology.orchestra.run.smithi155.stdout: ] 2023-08-01T19:55:22.645 INFO:teuthology.orchestra.run.smithi155.stdout: } 2023-08-01T19:55:22.645 INFO:teuthology.orchestra.run.smithi155.stdout: }, 2023-08-01T19:55:22.645 INFO:teuthology.orchestra.run.smithi155.stdout: { 2023-08-01T19:55:22.646 INFO:teuthology.orchestra.run.smithi155.stdout: "description": "osd_repop(client.4668.0:100244 5.9 e37/19 5:92f56a12:::benchmark_data_smithi006_114134_object100243:head v 37'6294, mlcod=37'6292)", 2023-08-01T19:55:22.646 INFO:teuthology.orchestra.run.smithi155.stdout: "initiated_at": "2023-08-01T19:55:05.151325+0000", 2023-08-01T19:55:22.646 INFO:teuthology.orchestra.run.smithi155.stdout: "age": 17.400101997, 2023-08-01T19:55:22.646 INFO:teuthology.orchestra.run.smithi155.stdout: "duration": 0.071883673999999995, 2023-08-01T19:55:22.646 INFO:teuthology.orchestra.run.smithi155.stdout: "type_data": { 2023-08-01T19:55:22.646 INFO:teuthology.orchestra.run.smithi155.stdout: "flag_point": "commit sent; apply or cleanup", 2023-08-01T19:55:22.646 INFO:teuthology.orchestra.run.smithi155.stdout: "events": [ 2023-08-01T19:55:22.646 INFO:teuthology.orchestra.run.smithi155.stdout: { 2023-08-01T19:55:22.647 INFO:teuthology.orchestra.run.smithi155.stdout: "event": "initiated", 2023-08-01T19:55:22.647 INFO:teuthology.orchestra.run.smithi155.stdout: "time": "2023-08-01T19:55:05.151325+0000", 2023-08-01T19:55:22.647 INFO:teuthology.orchestra.run.smithi155.stdout: "duration": 0 2023-08-01T19:55:22.647 INFO:teuthology.orchestra.run.smithi155.stdout: }, 2023-08-01T19:55:22.647 INFO:teuthology.orchestra.run.smithi155.stdout: { 2023-08-01T19:55:22.647 INFO:teuthology.orchestra.run.smithi155.stdout: "event": "throttled", 2023-08-01T19:55:22.647 INFO:teuthology.orchestra.run.smithi155.stdout: "time": "2023-08-01T19:55:05.151325+0000", 2023-08-01T19:55:22.647 INFO:teuthology.orchestra.run.smithi155.stdout: "duration": 0 2023-08-01T19:55:22.648 INFO:teuthology.orchestra.run.smithi155.stdout: }, 2023-08-01T19:55:22.648 INFO:teuthology.orchestra.run.smithi155.stdout: { 2023-08-01T19:55:22.648 INFO:teuthology.orchestra.run.smithi155.stdout: "event": "header_read", 2023-08-01T19:55:22.648 INFO:teuthology.orchestra.run.smithi155.stdout: "time": "2023-08-01T19:55:05.151325+0000", 2023-08-01T19:55:22.648 INFO:teuthology.orchestra.run.smithi155.stdout: "duration": 4294967295.9999995 2023-08-01T19:55:22.648 INFO:teuthology.orchestra.run.smithi155.stdout: }, 2023-08-01T19:55:22.648 INFO:teuthology.orchestra.run.smithi155.stdout: { 2023-08-01T19:55:22.648 INFO:teuthology.orchestra.run.smithi155.stdout: "event": "all_read", 2023-08-01T19:55:22.649 INFO:teuthology.orchestra.run.smithi155.stdout: "time": "2023-08-01T19:55:05.151390+0000", 2023-08-01T19:55:22.649 INFO:teuthology.orchestra.run.smithi155.stdout: "duration": 6.5456999999999993e-05 2023-08-01T19:55:22.649 INFO:teuthology.orchestra.run.smithi155.stdout: }, 2023-08-01T19:55:22.649 INFO:teuthology.orchestra.run.smithi155.stdout: { 2023-08-01T19:55:22.649 INFO:teuthology.orchestra.run.smithi155.stdout: "event": "dispatched", 2023-08-01T19:55:22.649 INFO:teuthology.orchestra.run.smithi155.stdout: "time": "2023-08-01T19:55:05.151396+0000", 2023-08-01T19:55:22.649 INFO:teuthology.orchestra.run.smithi155.stdout: "duration": 5.9190000000000004e-06 2023-08-01T19:55:22.649 INFO:teuthology.orchestra.run.smithi155.stdout: }, 2023-08-01T19:55:22.650 INFO:teuthology.orchestra.run.smithi155.stdout: { 2023-08-01T19:55:22.650 INFO:teuthology.orchestra.run.smithi155.stdout: "event": "queued_for_pg", 2023-08-01T19:55:22.650 INFO:teuthology.orchestra.run.smithi155.stdout: "time": "2023-08-01T19:55:05.151400+0000", 2023-08-01T19:55:22.650 INFO:teuthology.orchestra.run.smithi155.stdout: "duration": 4.1030000000000004e-06 2023-08-01T19:55:22.650 INFO:teuthology.orchestra.run.smithi155.stdout: }, 2023-08-01T19:55:22.650 INFO:teuthology.orchestra.run.smithi155.stdout: { 2023-08-01T19:55:22.650 INFO:teuthology.orchestra.run.smithi155.stdout: "event": "reached_pg", 2023-08-01T19:55:22.650 INFO:teuthology.orchestra.run.smithi155.stdout: "time": "2023-08-01T19:55:05.151452+0000", 2023-08-01T19:55:22.651 INFO:teuthology.orchestra.run.smithi155.stdout: "duration": 5.2136999999999999e-05 2023-08-01T19:55:22.651 INFO:teuthology.orchestra.run.smithi155.stdout: }, 2023-08-01T19:55:22.651 INFO:teuthology.orchestra.run.smithi155.stdout: { 2023-08-01T19:55:22.651 INFO:teuthology.orchestra.run.smithi155.stdout: "event": "started", 2023-08-01T19:55:22.651 INFO:teuthology.orchestra.run.smithi155.stdout: "time": "2023-08-01T19:55:05.151470+0000", 2023-08-01T19:55:22.651 INFO:teuthology.orchestra.run.smithi155.stdout: "duration": 1.8e-05 2023-08-01T19:55:22.651 INFO:teuthology.orchestra.run.smithi155.stdout: }, 2023-08-01T19:55:22.651 INFO:teuthology.orchestra.run.smithi155.stdout: { 2023-08-01T19:55:22.652 INFO:teuthology.orchestra.run.smithi155.stdout: "event": "commit_sent", 2023-08-01T19:55:22.652 INFO:teuthology.orchestra.run.smithi155.stdout: "time": "2023-08-01T19:55:05.223183+0000", 2023-08-01T19:55:22.652 INFO:teuthology.orchestra.run.smithi155.stdout: "duration": 0.071712622000000004 2023-08-01T19:55:22.652 INFO:teuthology.orchestra.run.smithi155.stdout: }, 2023-08-01T19:55:22.652 INFO:teuthology.orchestra.run.smithi155.stdout: { 2023-08-01T19:55:22.652 INFO:teuthology.orchestra.run.smithi155.stdout: "event": "done", 2023-08-01T19:55:22.652 INFO:teuthology.orchestra.run.smithi155.stdout: "time": "2023-08-01T19:55:05.223209+0000", 2023-08-01T19:55:22.653 INFO:teuthology.orchestra.run.smithi155.stdout: "duration": 2.5956e-05 2023-08-01T19:55:22.653 INFO:teuthology.orchestra.run.smithi155.stdout: } 2023-08-01T19:55:22.653 INFO:teuthology.orchestra.run.smithi155.stdout: ] 2023-08-01T19:55:22.653 INFO:teuthology.orchestra.run.smithi155.stdout: } 2023-08-01T19:55:22.653 INFO:teuthology.orchestra.run.smithi155.stdout: }, 2023-08-01T19:55:22.653 INFO:teuthology.orchestra.run.smithi155.stdout: { 2023-08-01T19:55:22.653 INFO:teuthology.orchestra.run.smithi155.stdout: "description": "osd_op(client.4668.0:100249 5.b 5:d0666827:::benchmark_data_smithi006_114134_object100248:head [set-alloc-hint object_size 65536 write_size 65536,write 0~65536] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e37)", 2023-08-01T19:55:22.653 INFO:teuthology.orchestra.run.smithi155.stdout: "initiated_at": "2023-08-01T19:55:05.153614+0000", 2023-08-01T19:55:22.654 INFO:teuthology.orchestra.run.smithi155.stdout: "age": 17.397813572, 2023-08-01T19:55:22.654 INFO:teuthology.orchestra.run.smithi155.stdout: "duration": 0.069286118999999993, 2023-08-01T19:55:22.654 INFO:teuthology.orchestra.run.smithi155.stdout: "type_data": { 2023-08-01T19:55:22.654 INFO:teuthology.orchestra.run.smithi155.stdout: "flag_point": "commit sent; apply or cleanup", 2023-08-01T19:55:22.654 INFO:teuthology.orchestra.run.smithi155.stdout: "client_info": { 2023-08-01T19:55:22.654 INFO:teuthology.orchestra.run.smithi155.stdout: "client": "client.4668", 2023-08-01T19:55:22.654 INFO:teuthology.orchestra.run.smithi155.stdout: "client_addr": "172.21.15.6:0/1709472247", 2023-08-01T19:55:22.654 INFO:teuthology.orchestra.run.smithi155.stdout: "tid": 100249 2023-08-01T19:55:22.655 INFO:teuthology.orchestra.run.smithi155.stdout: }, 2023-08-01T19:55:22.655 INFO:teuthology.orchestra.run.smithi155.stdout: "events": [ 2023-08-01T19:55:22.655 INFO:teuthology.orchestra.run.smithi155.stdout: { 2023-08-01T19:55:22.655 INFO:teuthology.orchestra.run.smithi155.stdout: "event": "initiated", 2023-08-01T19:55:22.655 INFO:teuthology.orchestra.run.smithi155.stdout: "time": "2023-08-01T19:55:05.153614+0000", 2023-08-01T19:55:22.655 INFO:teuthology.orchestra.run.smithi155.stdout: "duration": 0 2023-08-01T19:55:22.655 INFO:teuthology.orchestra.run.smithi155.stdout: }, 2023-08-01T19:55:22.656 INFO:teuthology.orchestra.run.smithi155.stdout: { 2023-08-01T19:55:22.656 INFO:teuthology.orchestra.run.smithi155.stdout: "event": "throttled", 2023-08-01T19:55:22.656 INFO:teuthology.orchestra.run.smithi155.stdout: "time": "2023-08-01T19:55:05.153614+0000", 2023-08-01T19:55:22.656 INFO:teuthology.orchestra.run.smithi155.stdout: "duration": 0 2023-08-01T19:55:22.656 INFO:teuthology.orchestra.run.smithi155.stdout: }, 2023-08-01T19:55:22.656 INFO:teuthology.orchestra.run.smithi155.stdout: { 2023-08-01T19:55:22.656 INFO:teuthology.orchestra.run.smithi155.stdout: "event": "header_read", 2023-08-01T19:55:22.656 INFO:teuthology.orchestra.run.smithi155.stdout: "time": "2023-08-01T19:55:05.153612+0000", 2023-08-01T19:55:22.657 INFO:teuthology.orchestra.run.smithi155.stdout: "duration": 4294967295.9999986 2023-08-01T19:55:22.657 INFO:teuthology.orchestra.run.smithi155.stdout: }, 2023-08-01T19:55:22.657 INFO:teuthology.orchestra.run.smithi155.stdout: { 2023-08-01T19:55:22.657 INFO:teuthology.orchestra.run.smithi155.stdout: "event": "all_read", 2023-08-01T19:55:22.657 INFO:teuthology.orchestra.run.smithi155.stdout: "time": "2023-08-01T19:55:05.153694+0000", 2023-08-01T19:55:22.657 INFO:teuthology.orchestra.run.smithi155.stdout: "duration": 8.1618000000000004e-05 2023-08-01T19:55:22.657 INFO:teuthology.orchestra.run.smithi155.stdout: }, 2023-08-01T19:55:22.658 INFO:teuthology.orchestra.run.smithi155.stdout: { 2023-08-01T19:55:22.658 INFO:teuthology.orchestra.run.smithi155.stdout: "event": "dispatched", 2023-08-01T19:55:22.658 INFO:teuthology.orchestra.run.smithi155.stdout: "time": "2023-08-01T19:55:05.153713+0000", 2023-08-01T19:55:22.658 INFO:teuthology.orchestra.run.smithi155.stdout: "duration": 1.9069999999999999e-05 2023-08-01T19:55:22.658 INFO:teuthology.orchestra.run.smithi155.stdout: }, 2023-08-01T19:55:22.658 INFO:teuthology.orchestra.run.smithi155.stdout: { 2023-08-01T19:55:22.658 INFO:teuthology.orchestra.run.smithi155.stdout: "event": "queued_for_pg", 2023-08-01T19:55:22.659 INFO:teuthology.orchestra.run.smithi155.stdout: "time": "2023-08-01T19:55:05.153726+0000", 2023-08-01T19:55:22.659 INFO:teuthology.orchestra.run.smithi155.stdout: "duration": 1.238e-05 2023-08-01T19:55:22.659 INFO:teuthology.orchestra.run.smithi155.stdout: }, 2023-08-01T19:55:22.659 INFO:teuthology.orchestra.run.smithi155.stdout: { 2023-08-01T19:55:22.659 INFO:teuthology.orchestra.run.smithi155.stdout: "event": "reached_pg", 2023-08-01T19:55:22.659 INFO:teuthology.orchestra.run.smithi155.stdout: "time": "2023-08-01T19:55:05.153761+0000", 2023-08-01T19:55:22.659 INFO:teuthology.orchestra.run.smithi155.stdout: "duration": 3.5046999999999998e-05 2023-08-01T19:55:22.659 INFO:teuthology.orchestra.run.smithi155.stdout: }, 2023-08-01T19:55:22.660 INFO:teuthology.orchestra.run.smithi155.stdout: { 2023-08-01T19:55:22.660 INFO:teuthology.orchestra.run.smithi155.stdout: "event": "started", 2023-08-01T19:55:22.660 INFO:teuthology.orchestra.run.smithi155.stdout: "time": "2023-08-01T19:55:05.153896+0000", 2023-08-01T19:55:22.660 INFO:teuthology.orchestra.run.smithi155.stdout: "duration": 0.00013575800000000001 2023-08-01T19:55:22.660 INFO:teuthology.orchestra.run.smithi155.stdout: }, 2023-08-01T19:55:22.660 INFO:teuthology.orchestra.run.smithi155.stdout: { 2023-08-01T19:55:22.660 INFO:teuthology.orchestra.run.smithi155.stdout: "event": "waiting for subops from 0", 2023-08-01T19:55:22.660 INFO:teuthology.orchestra.run.smithi155.stdout: "time": "2023-08-01T19:55:05.154043+0000", 2023-08-01T19:55:22.661 INFO:teuthology.orchestra.run.smithi155.stdout: "duration": 0.00014650700000000001 2023-08-01T19:55:22.661 INFO:teuthology.orchestra.run.smithi155.stdout: }, 2023-08-01T19:55:22.661 INFO:teuthology.orchestra.run.smithi155.stdout: { 2023-08-01T19:55:22.661 INFO:teuthology.orchestra.run.smithi155.stdout: "event": "sub_op_commit_rec", 2023-08-01T19:55:22.661 INFO:teuthology.orchestra.run.smithi155.stdout: "time": "2023-08-01T19:55:05.221876+0000", 2023-08-01T19:55:22.661 INFO:teuthology.orchestra.run.smithi155.stdout: "duration": 0.067832796000000001 2023-08-01T19:55:22.661 INFO:teuthology.orchestra.run.smithi155.stdout: }, 2023-08-01T19:55:22.661 INFO:teuthology.orchestra.run.smithi155.stdout: { 2023-08-01T19:55:22.662 INFO:teuthology.orchestra.run.smithi155.stdout: "event": "op_commit", 2023-08-01T19:55:22.662 INFO:teuthology.orchestra.run.smithi155.stdout: "time": "2023-08-01T19:55:05.222813+0000", 2023-08-01T19:55:22.662 INFO:teuthology.orchestra.run.smithi155.stdout: "duration": 0.00093755300000000004 2023-08-01T19:55:22.662 INFO:teuthology.orchestra.run.smithi155.stdout: }, 2023-08-01T19:55:22.662 INFO:teuthology.orchestra.run.smithi155.stdout: { 2023-08-01T19:55:22.662 INFO:teuthology.orchestra.run.smithi155.stdout: "event": "commit_sent", 2023-08-01T19:55:22.662 INFO:teuthology.orchestra.run.smithi155.stdout: "time": "2023-08-01T19:55:05.222861+0000", 2023-08-01T19:55:22.663 INFO:teuthology.orchestra.run.smithi155.stdout: "duration": 4.8013999999999998e-05 2023-08-01T19:55:22.663 INFO:teuthology.orchestra.run.smithi155.stdout: }, 2023-08-01T19:55:22.663 INFO:teuthology.orchestra.run.smithi155.stdout: { 2023-08-01T19:55:22.663 INFO:teuthology.orchestra.run.smithi155.stdout: "event": "done", 2023-08-01T19:55:22.663 INFO:teuthology.orchestra.run.smithi155.stdout: "time": "2023-08-01T19:55:05.222900+0000", 2023-08-01T19:55:22.663 INFO:teuthology.orchestra.run.smithi155.stdout: "duration": 3.8634999999999999e-05 2023-08-01T19:55:22.663 INFO:teuthology.orchestra.run.smithi155.stdout: } 2023-08-01T19:55:22.663 INFO:teuthology.orchestra.run.smithi155.stdout: ] 2023-08-01T19:55:22.664 INFO:teuthology.orchestra.run.smithi155.stdout: } 2023-08-01T19:55:22.664 INFO:teuthology.orchestra.run.smithi155.stdout: }, 2023-08-01T19:55:22.664 INFO:teuthology.orchestra.run.smithi155.stdout: { 2023-08-01T19:55:22.664 INFO:teuthology.orchestra.run.smithi155.stdout: "description": "osd_op(client.4668.0:100251 5.b 5:d853df24:::benchmark_data_smithi006_114134_object100250:head [set-alloc-hint object_size 65536 write_size 65536,write 0~65536] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e37)", 2023-08-01T19:55:22.664 INFO:teuthology.orchestra.run.smithi155.stdout: "initiated_at": "2023-08-01T19:55:05.153737+0000", 2023-08-01T19:55:22.664 INFO:teuthology.orchestra.run.smithi155.stdout: "age": 17.397690558000001, 2023-08-01T19:55:22.664 INFO:teuthology.orchestra.run.smithi155.stdout: "duration": 0.071366545000000003, 2023-08-01T19:55:22.665 INFO:teuthology.orchestra.run.smithi155.stdout: "type_data": { 2023-08-01T19:55:22.665 INFO:teuthology.orchestra.run.smithi155.stdout: "flag_point": "commit sent; apply or cleanup", 2023-08-01T19:55:22.665 INFO:teuthology.orchestra.run.smithi155.stdout: "client_info": { 2023-08-01T19:55:22.665 INFO:teuthology.orchestra.run.smithi155.stdout: "client": "client.4668", 2023-08-01T19:55:22.665 INFO:teuthology.orchestra.run.smithi155.stdout: "client_addr": "172.21.15.6:0/1709472247", 2023-08-01T19:55:22.665 INFO:teuthology.orchestra.run.smithi155.stdout: "tid": 100251 2023-08-01T19:55:22.665 INFO:teuthology.orchestra.run.smithi155.stdout: }, 2023-08-01T19:55:22.665 INFO:teuthology.orchestra.run.smithi155.stdout: "events": [ 2023-08-01T19:55:22.666 INFO:teuthology.orchestra.run.smithi155.stdout: { 2023-08-01T19:55:22.666 INFO:teuthology.orchestra.run.smithi155.stdout: "event": "initiated", 2023-08-01T19:55:22.666 INFO:teuthology.orchestra.run.smithi155.stdout: "time": "2023-08-01T19:55:05.153737+0000", 2023-08-01T19:55:22.666 INFO:teuthology.orchestra.run.smithi155.stdout: "duration": 0 2023-08-01T19:55:22.666 INFO:teuthology.orchestra.run.smithi155.stdout: }, 2023-08-01T19:55:22.666 INFO:teuthology.orchestra.run.smithi155.stdout: { 2023-08-01T19:55:22.666 INFO:teuthology.orchestra.run.smithi155.stdout: "event": "throttled", 2023-08-01T19:55:22.667 INFO:teuthology.orchestra.run.smithi155.stdout: "time": "2023-08-01T19:55:05.153737+0000", 2023-08-01T19:55:22.667 INFO:teuthology.orchestra.run.smithi155.stdout: "duration": 0 2023-08-01T19:55:22.667 INFO:teuthology.orchestra.run.smithi155.stdout: }, 2023-08-01T19:55:22.667 INFO:teuthology.orchestra.run.smithi155.stdout: { 2023-08-01T19:55:22.667 INFO:teuthology.orchestra.run.smithi155.stdout: "event": "header_read", 2023-08-01T19:55:22.667 INFO:teuthology.orchestra.run.smithi155.stdout: "time": "2023-08-01T19:55:05.153736+0000", 2023-08-01T19:55:22.667 INFO:teuthology.orchestra.run.smithi155.stdout: "duration": 4294967295.9999995 2023-08-01T19:55:22.667 INFO:teuthology.orchestra.run.smithi155.stdout: }, 2023-08-01T19:55:22.668 INFO:teuthology.orchestra.run.smithi155.stdout: { 2023-08-01T19:55:22.668 INFO:teuthology.orchestra.run.smithi155.stdout: "event": "all_read", 2023-08-01T19:55:22.668 INFO:teuthology.orchestra.run.smithi155.stdout: "time": "2023-08-01T19:55:05.153784+0000", 2023-08-01T19:55:22.668 INFO:teuthology.orchestra.run.smithi155.stdout: "duration": 4.7660000000000001e-05 2023-08-01T19:55:22.668 INFO:teuthology.orchestra.run.smithi155.stdout: }, 2023-08-01T19:55:22.668 INFO:teuthology.orchestra.run.smithi155.stdout: { 2023-08-01T19:55:22.668 INFO:teuthology.orchestra.run.smithi155.stdout: "event": "dispatched", 2023-08-01T19:55:22.668 INFO:teuthology.orchestra.run.smithi155.stdout: "time": "2023-08-01T19:55:05.153793+0000", 2023-08-01T19:55:22.669 INFO:teuthology.orchestra.run.smithi155.stdout: "duration": 8.7150000000000004e-06 2023-08-01T19:55:22.669 INFO:teuthology.orchestra.run.smithi155.stdout: }, 2023-08-01T19:55:22.669 INFO:teuthology.orchestra.run.smithi155.stdout: { 2023-08-01T19:55:22.669 INFO:teuthology.orchestra.run.smithi155.stdout: "event": "queued_for_pg", 2023-08-01T19:55:22.669 INFO:teuthology.orchestra.run.smithi155.stdout: "time": "2023-08-01T19:55:05.153800+0000", 2023-08-01T19:55:22.669 INFO:teuthology.orchestra.run.smithi155.stdout: "duration": 7.2459999999999997e-06 2023-08-01T19:55:22.669 INFO:teuthology.orchestra.run.smithi155.stdout: }, 2023-08-01T19:55:22.670 INFO:teuthology.orchestra.run.smithi155.stdout: { 2023-08-01T19:55:22.670 INFO:teuthology.orchestra.run.smithi155.stdout: "event": "reached_pg", 2023-08-01T19:55:22.670 INFO:teuthology.orchestra.run.smithi155.stdout: "time": "2023-08-01T19:55:05.156241+0000", 2023-08-01T19:55:22.670 INFO:teuthology.orchestra.run.smithi155.stdout: "duration": 0.0024415359999999998 2023-08-01T19:55:22.670 INFO:teuthology.orchestra.run.smithi155.stdout: }, 2023-08-01T19:55:22.670 INFO:teuthology.orchestra.run.smithi155.stdout: { 2023-08-01T19:55:22.670 INFO:teuthology.orchestra.run.smithi155.stdout: "event": "started", 2023-08-01T19:55:22.670 INFO:teuthology.orchestra.run.smithi155.stdout: "time": "2023-08-01T19:55:05.219045+0000", 2023-08-01T19:55:22.671 INFO:teuthology.orchestra.run.smithi155.stdout: "duration": 0.062803855000000006 2023-08-01T19:55:22.671 INFO:teuthology.orchestra.run.smithi155.stdout: }, 2023-08-01T19:55:22.671 INFO:teuthology.orchestra.run.smithi155.stdout: { 2023-08-01T19:55:22.671 INFO:teuthology.orchestra.run.smithi155.stdout: "event": "waiting for subops from 0", 2023-08-01T19:55:22.671 INFO:teuthology.orchestra.run.smithi155.stdout: "time": "2023-08-01T19:55:05.219238+0000", 2023-08-01T19:55:22.671 INFO:teuthology.orchestra.run.smithi155.stdout: "duration": 0.00019241500000000001 2023-08-01T19:55:22.671 INFO:teuthology.orchestra.run.smithi155.stdout: }, 2023-08-01T19:55:22.671 INFO:teuthology.orchestra.run.smithi155.stdout: { 2023-08-01T19:55:22.672 INFO:teuthology.orchestra.run.smithi155.stdout: "event": "sub_op_commit_rec", 2023-08-01T19:55:22.672 INFO:teuthology.orchestra.run.smithi155.stdout: "time": "2023-08-01T19:55:05.223300+0000", 2023-08-01T19:55:22.672 INFO:teuthology.orchestra.run.smithi155.stdout: "duration": 0.0040626509999999996 2023-08-01T19:55:22.672 INFO:teuthology.orchestra.run.smithi155.stdout: }, 2023-08-01T19:55:22.672 INFO:teuthology.orchestra.run.smithi155.stdout: { 2023-08-01T19:55:22.672 INFO:teuthology.orchestra.run.smithi155.stdout: "event": "op_commit", 2023-08-01T19:55:22.672 INFO:teuthology.orchestra.run.smithi155.stdout: "time": "2023-08-01T19:55:05.225020+0000", 2023-08-01T19:55:22.673 INFO:teuthology.orchestra.run.smithi155.stdout: "duration": 0.0017201 2023-08-01T19:55:22.673 INFO:teuthology.orchestra.run.smithi155.stdout: }, 2023-08-01T19:55:22.673 INFO:teuthology.orchestra.run.smithi155.stdout: { 2023-08-01T19:55:22.673 INFO:teuthology.orchestra.run.smithi155.stdout: "event": "commit_sent", 2023-08-01T19:55:22.673 INFO:teuthology.orchestra.run.smithi155.stdout: "time": "2023-08-01T19:55:05.225066+0000", 2023-08-01T19:55:22.673 INFO:teuthology.orchestra.run.smithi155.stdout: "duration": 4.6143000000000002e-05 2023-08-01T19:55:22.673 INFO:teuthology.orchestra.run.smithi155.stdout: }, 2023-08-01T19:55:22.673 INFO:teuthology.orchestra.run.smithi155.stdout: { 2023-08-01T19:55:22.674 INFO:teuthology.orchestra.run.smithi155.stdout: "event": "done", 2023-08-01T19:55:22.674 INFO:teuthology.orchestra.run.smithi155.stdout: "time": "2023-08-01T19:55:05.225103+0000", 2023-08-01T19:55:22.674 INFO:teuthology.orchestra.run.smithi155.stdout: "duration": 3.6789999999999998e-05 2023-08-01T19:55:22.674 INFO:teuthology.orchestra.run.smithi155.stdout: } 2023-08-01T19:55:22.674 INFO:teuthology.orchestra.run.smithi155.stdout: ] 2023-08-01T19:55:22.674 INFO:teuthology.orchestra.run.smithi155.stdout: } 2023-08-01T19:55:22.674 INFO:teuthology.orchestra.run.smithi155.stdout: }, 2023-08-01T19:55:22.675 INFO:teuthology.orchestra.run.smithi155.stdout: { 2023-08-01T19:55:22.675 INFO:teuthology.orchestra.run.smithi155.stdout: "description": "osd_op(client.4668.0:100252 5.0 5:01f90c3c:::benchmark_data_smithi006_114134_object100251:head [set-alloc-hint object_size 65536 write_size 65536,write 0~65536] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e37)", 2023-08-01T19:55:22.675 INFO:teuthology.orchestra.run.smithi155.stdout: "initiated_at": "2023-08-01T19:55:05.154048+0000", 2023-08-01T19:55:22.675 INFO:teuthology.orchestra.run.smithi155.stdout: "age": 17.397379311000002, 2023-08-01T19:55:22.675 INFO:teuthology.orchestra.run.smithi155.stdout: "duration": 0.070156683999999997, 2023-08-01T19:55:22.675 INFO:teuthology.orchestra.run.smithi155.stdout: "type_data": { 2023-08-01T19:55:22.675 INFO:teuthology.orchestra.run.smithi155.stdout: "flag_point": "commit sent; apply or cleanup", 2023-08-01T19:55:22.675 INFO:teuthology.orchestra.run.smithi155.stdout: "client_info": { 2023-08-01T19:55:22.676 INFO:teuthology.orchestra.run.smithi155.stdout: "client": "client.4668", 2023-08-01T19:55:22.676 INFO:teuthology.orchestra.run.smithi155.stdout: "client_addr": "172.21.15.6:0/1709472247", 2023-08-01T19:55:22.676 INFO:teuthology.orchestra.run.smithi155.stdout: "tid": 100252 2023-08-01T19:55:22.676 INFO:teuthology.orchestra.run.smithi155.stdout: }, 2023-08-01T19:55:22.676 INFO:teuthology.orchestra.run.smithi155.stdout: "events": [ 2023-08-01T19:55:22.676 INFO:teuthology.orchestra.run.smithi155.stdout: { 2023-08-01T19:55:22.676 INFO:teuthology.orchestra.run.smithi155.stdout: "event": "initiated", 2023-08-01T19:55:22.676 INFO:teuthology.orchestra.run.smithi155.stdout: "time": "2023-08-01T19:55:05.154048+0000", 2023-08-01T19:55:22.677 INFO:teuthology.orchestra.run.smithi155.stdout: "duration": 0 2023-08-01T19:55:22.677 INFO:teuthology.orchestra.run.smithi155.stdout: }, 2023-08-01T19:55:22.677 INFO:teuthology.orchestra.run.smithi155.stdout: { 2023-08-01T19:55:22.677 INFO:teuthology.orchestra.run.smithi155.stdout: "event": "throttled", 2023-08-01T19:55:22.677 INFO:teuthology.orchestra.run.smithi155.stdout: "time": "2023-08-01T19:55:05.154048+0000", 2023-08-01T19:55:22.677 INFO:teuthology.orchestra.run.smithi155.stdout: "duration": 0 2023-08-01T19:55:22.677 INFO:teuthology.orchestra.run.smithi155.stdout: }, 2023-08-01T19:55:22.677 INFO:teuthology.orchestra.run.smithi155.stdout: { 2023-08-01T19:55:22.678 INFO:teuthology.orchestra.run.smithi155.stdout: "event": "header_read", 2023-08-01T19:55:22.678 INFO:teuthology.orchestra.run.smithi155.stdout: "time": "2023-08-01T19:55:05.154047+0000", 2023-08-01T19:55:22.678 INFO:teuthology.orchestra.run.smithi155.stdout: "duration": 4294967295.999999 2023-08-01T19:55:22.678 INFO:teuthology.orchestra.run.smithi155.stdout: }, 2023-08-01T19:55:22.678 INFO:teuthology.orchestra.run.smithi155.stdout: { 2023-08-01T19:55:22.678 INFO:teuthology.orchestra.run.smithi155.stdout: "event": "all_read", 2023-08-01T19:55:22.678 INFO:teuthology.orchestra.run.smithi155.stdout: "time": "2023-08-01T19:55:05.154115+0000", 2023-08-01T19:55:22.678 INFO:teuthology.orchestra.run.smithi155.stdout: "duration": 6.7545999999999993e-05 2023-08-01T19:55:22.679 INFO:teuthology.orchestra.run.smithi155.stdout: }, 2023-08-01T19:55:22.679 INFO:teuthology.orchestra.run.smithi155.stdout: { 2023-08-01T19:55:22.679 INFO:teuthology.orchestra.run.smithi155.stdout: "event": "dispatched", 2023-08-01T19:55:22.679 INFO:teuthology.orchestra.run.smithi155.stdout: "time": "2023-08-01T19:55:05.154125+0000", 2023-08-01T19:55:22.679 INFO:teuthology.orchestra.run.smithi155.stdout: "duration": 1.0669000000000001e-05 2023-08-01T19:55:22.679 INFO:teuthology.orchestra.run.smithi155.stdout: }, 2023-08-01T19:55:22.679 INFO:teuthology.orchestra.run.smithi155.stdout: { 2023-08-01T19:55:22.679 INFO:teuthology.orchestra.run.smithi155.stdout: "event": "queued_for_pg", 2023-08-01T19:55:22.680 INFO:teuthology.orchestra.run.smithi155.stdout: "time": "2023-08-01T19:55:05.154131+0000", 2023-08-01T19:55:22.680 INFO:teuthology.orchestra.run.smithi155.stdout: "duration": 6.0349999999999998e-06 2023-08-01T19:55:22.680 INFO:teuthology.orchestra.run.smithi155.stdout: }, 2023-08-01T19:55:22.680 INFO:teuthology.orchestra.run.smithi155.stdout: { 2023-08-01T19:55:22.680 INFO:teuthology.orchestra.run.smithi155.stdout: "event": "reached_pg", 2023-08-01T19:55:22.680 INFO:teuthology.orchestra.run.smithi155.stdout: "time": "2023-08-01T19:55:05.154174+0000", 2023-08-01T19:55:22.680 INFO:teuthology.orchestra.run.smithi155.stdout: "duration": 4.2429000000000003e-05 2023-08-01T19:55:22.680 INFO:teuthology.orchestra.run.smithi155.stdout: }, 2023-08-01T19:55:22.681 INFO:teuthology.orchestra.run.smithi155.stdout: { 2023-08-01T19:55:22.681 INFO:teuthology.orchestra.run.smithi155.stdout: "event": "started", 2023-08-01T19:55:22.681 INFO:teuthology.orchestra.run.smithi155.stdout: "time": "2023-08-01T19:55:05.154287+0000", 2023-08-01T19:55:22.681 INFO:teuthology.orchestra.run.smithi155.stdout: "duration": 0.000113138 2023-08-01T19:55:22.681 INFO:teuthology.orchestra.run.smithi155.stdout: }, 2023-08-01T19:55:22.681 INFO:teuthology.orchestra.run.smithi155.stdout: { 2023-08-01T19:55:22.681 INFO:teuthology.orchestra.run.smithi155.stdout: "event": "waiting for subops from 0", 2023-08-01T19:55:22.682 INFO:teuthology.orchestra.run.smithi155.stdout: "time": "2023-08-01T19:55:05.154420+0000", 2023-08-01T19:55:22.682 INFO:teuthology.orchestra.run.smithi155.stdout: "duration": 0.000133292 2023-08-01T19:55:22.682 INFO:teuthology.orchestra.run.smithi155.stdout: }, 2023-08-01T19:55:22.682 INFO:teuthology.orchestra.run.smithi155.stdout: { 2023-08-01T19:55:22.682 INFO:teuthology.orchestra.run.smithi155.stdout: "event": "sub_op_commit_rec", 2023-08-01T19:55:22.682 INFO:teuthology.orchestra.run.smithi155.stdout: "time": "2023-08-01T19:55:05.219034+0000", 2023-08-01T19:55:22.682 INFO:teuthology.orchestra.run.smithi155.stdout: "duration": 0.064613429999999999 2023-08-01T19:55:22.682 INFO:teuthology.orchestra.run.smithi155.stdout: }, 2023-08-01T19:55:22.683 INFO:teuthology.orchestra.run.smithi155.stdout: { 2023-08-01T19:55:22.683 INFO:teuthology.orchestra.run.smithi155.stdout: "event": "op_commit", 2023-08-01T19:55:22.683 INFO:teuthology.orchestra.run.smithi155.stdout: "time": "2023-08-01T19:55:05.224138+0000", 2023-08-01T19:55:22.683 INFO:teuthology.orchestra.run.smithi155.stdout: "duration": 0.0051041999999999997 2023-08-01T19:55:22.683 INFO:teuthology.orchestra.run.smithi155.stdout: }, 2023-08-01T19:55:22.683 INFO:teuthology.orchestra.run.smithi155.stdout: { 2023-08-01T19:55:22.683 INFO:teuthology.orchestra.run.smithi155.stdout: "event": "commit_sent", 2023-08-01T19:55:22.683 INFO:teuthology.orchestra.run.smithi155.stdout: "time": "2023-08-01T19:55:05.224171+0000", 2023-08-01T19:55:22.684 INFO:teuthology.orchestra.run.smithi155.stdout: "duration": 3.3345e-05 2023-08-01T19:55:22.684 INFO:teuthology.orchestra.run.smithi155.stdout: }, 2023-08-01T19:55:22.684 INFO:teuthology.orchestra.run.smithi155.stdout: { 2023-08-01T19:55:22.684 INFO:teuthology.orchestra.run.smithi155.stdout: "event": "done", 2023-08-01T19:55:22.684 INFO:teuthology.orchestra.run.smithi155.stdout: "time": "2023-08-01T19:55:05.224205+0000", 2023-08-01T19:55:22.684 INFO:teuthology.orchestra.run.smithi155.stdout: "duration": 3.3525999999999997e-05 2023-08-01T19:55:22.684 INFO:teuthology.orchestra.run.smithi155.stdout: } 2023-08-01T19:55:22.684 INFO:teuthology.orchestra.run.smithi155.stdout: ] 2023-08-01T19:55:22.685 INFO:teuthology.orchestra.run.smithi155.stdout: } 2023-08-01T19:55:22.685 INFO:teuthology.orchestra.run.smithi155.stdout: }, 2023-08-01T19:55:22.685 INFO:teuthology.orchestra.run.smithi155.stdout: { 2023-08-01T19:55:22.685 INFO:teuthology.orchestra.run.smithi155.stdout: "description": "osd_repop_reply(client.4668.0:100237 5.4 e37/19 ondisk, result = 0)", 2023-08-01T19:55:22.685 INFO:teuthology.orchestra.run.smithi155.stdout: "initiated_at": "2023-08-01T19:55:05.156249+0000", 2023-08-01T19:55:22.685 INFO:teuthology.orchestra.run.smithi155.stdout: "age": 17.395178366, 2023-08-01T19:55:22.685 INFO:teuthology.orchestra.run.smithi155.stdout: "duration": 0.062792549000000003, 2023-08-01T19:55:22.685 INFO:teuthology.orchestra.run.smithi155.stdout: "type_data": { 2023-08-01T19:55:22.686 INFO:teuthology.orchestra.run.smithi155.stdout: "flag_point": "started", 2023-08-01T19:55:22.686 INFO:teuthology.orchestra.run.smithi155.stdout: "events": [ 2023-08-01T19:55:22.686 INFO:teuthology.orchestra.run.smithi155.stdout: { 2023-08-01T19:55:22.686 INFO:teuthology.orchestra.run.smithi155.stdout: "event": "initiated", 2023-08-01T19:55:22.686 INFO:teuthology.orchestra.run.smithi155.stdout: "time": "2023-08-01T19:55:05.156249+0000", 2023-08-01T19:55:22.686 INFO:teuthology.orchestra.run.smithi155.stdout: "duration": 0 2023-08-01T19:55:22.686 INFO:teuthology.orchestra.run.smithi155.stdout: }, 2023-08-01T19:55:22.686 INFO:teuthology.orchestra.run.smithi155.stdout: { 2023-08-01T19:55:22.687 INFO:teuthology.orchestra.run.smithi155.stdout: "event": "throttled", 2023-08-01T19:55:22.687 INFO:teuthology.orchestra.run.smithi155.stdout: "time": "2023-08-01T19:55:05.156249+0000", 2023-08-01T19:55:22.687 INFO:teuthology.orchestra.run.smithi155.stdout: "duration": 0 2023-08-01T19:55:22.687 INFO:teuthology.orchestra.run.smithi155.stdout: }, 2023-08-01T19:55:22.687 INFO:teuthology.orchestra.run.smithi155.stdout: { 2023-08-01T19:55:22.687 INFO:teuthology.orchestra.run.smithi155.stdout: "event": "header_read", 2023-08-01T19:55:22.687 INFO:teuthology.orchestra.run.smithi155.stdout: "time": "2023-08-01T19:55:05.156248+0000", 2023-08-01T19:55:22.687 INFO:teuthology.orchestra.run.smithi155.stdout: "duration": 4294967295.9999995 2023-08-01T19:55:22.688 INFO:teuthology.orchestra.run.smithi155.stdout: }, 2023-08-01T19:55:22.688 INFO:teuthology.orchestra.run.smithi155.stdout: { 2023-08-01T19:55:22.688 INFO:teuthology.orchestra.run.smithi155.stdout: "event": "all_read", 2023-08-01T19:55:22.688 INFO:teuthology.orchestra.run.smithi155.stdout: "time": "2023-08-01T19:55:05.156252+0000", 2023-08-01T19:55:22.688 INFO:teuthology.orchestra.run.smithi155.stdout: "duration": 3.9999999999999998e-06 2023-08-01T19:55:22.688 INFO:teuthology.orchestra.run.smithi155.stdout: }, 2023-08-01T19:55:22.688 INFO:teuthology.orchestra.run.smithi155.stdout: { 2023-08-01T19:55:22.689 INFO:teuthology.orchestra.run.smithi155.stdout: "event": "dispatched", 2023-08-01T19:55:22.689 INFO:teuthology.orchestra.run.smithi155.stdout: "time": "2023-08-01T19:55:05.218844+0000", 2023-08-01T19:55:22.689 INFO:teuthology.orchestra.run.smithi155.stdout: "duration": 0.062591516999999999 2023-08-01T19:55:22.689 INFO:teuthology.orchestra.run.smithi155.stdout: }, 2023-08-01T19:55:22.689 INFO:teuthology.orchestra.run.smithi155.stdout: { 2023-08-01T19:55:22.689 INFO:teuthology.orchestra.run.smithi155.stdout: "event": "queued_for_pg", 2023-08-01T19:55:22.689 INFO:teuthology.orchestra.run.smithi155.stdout: "time": "2023-08-01T19:55:05.218862+0000", 2023-08-01T19:55:22.690 INFO:teuthology.orchestra.run.smithi155.stdout: "duration": 1.7666e-05 2023-08-01T19:55:22.690 INFO:teuthology.orchestra.run.smithi155.stdout: }, 2023-08-01T19:55:22.690 INFO:teuthology.orchestra.run.smithi155.stdout: { 2023-08-01T19:55:22.690 INFO:teuthology.orchestra.run.smithi155.stdout: "event": "reached_pg", 2023-08-01T19:55:22.690 INFO:teuthology.orchestra.run.smithi155.stdout: "time": "2023-08-01T19:55:05.218914+0000", 2023-08-01T19:55:22.690 INFO:teuthology.orchestra.run.smithi155.stdout: "duration": 5.2565999999999998e-05 2023-08-01T19:55:22.690 INFO:teuthology.orchestra.run.smithi155.stdout: }, 2023-08-01T19:55:22.690 INFO:teuthology.orchestra.run.smithi155.stdout: { 2023-08-01T19:55:22.691 INFO:teuthology.orchestra.run.smithi155.stdout: "event": "started", 2023-08-01T19:55:22.691 INFO:teuthology.orchestra.run.smithi155.stdout: "time": "2023-08-01T19:55:05.218925+0000", 2023-08-01T19:55:22.691 INFO:teuthology.orchestra.run.smithi155.stdout: "duration": 1.1375e-05 2023-08-01T19:55:22.691 INFO:teuthology.orchestra.run.smithi155.stdout: }, 2023-08-01T19:55:22.691 INFO:teuthology.orchestra.run.smithi155.stdout: { 2023-08-01T19:55:22.691 INFO:teuthology.orchestra.run.smithi155.stdout: "event": "done", 2023-08-01T19:55:22.691 INFO:teuthology.orchestra.run.smithi155.stdout: "time": "2023-08-01T19:55:05.219041+0000", 2023-08-01T19:55:22.691 INFO:teuthology.orchestra.run.smithi155.stdout: "duration": 0.000115977 2023-08-01T19:55:22.692 INFO:teuthology.orchestra.run.smithi155.stdout: } 2023-08-01T19:55:22.692 INFO:teuthology.orchestra.run.smithi155.stdout: ] 2023-08-01T19:55:22.692 INFO:teuthology.orchestra.run.smithi155.stdout: } 2023-08-01T19:55:22.692 INFO:teuthology.orchestra.run.smithi155.stdout: }, 2023-08-01T19:55:22.692 INFO:teuthology.orchestra.run.smithi155.stdout: { 2023-08-01T19:55:22.692 INFO:teuthology.orchestra.run.smithi155.stdout: "description": "osd_repop(client.4668.0:100253 5.f e37/19 5:f7bbce05:::benchmark_data_smithi006_114134_object100252:head v 37'6323, mlcod=37'6321)", 2023-08-01T19:55:22.692 INFO:teuthology.orchestra.run.smithi155.stdout: "initiated_at": "2023-08-01T19:55:05.156952+0000", 2023-08-01T19:55:22.692 INFO:teuthology.orchestra.run.smithi155.stdout: "age": 17.394475303, 2023-08-01T19:55:22.693 INFO:teuthology.orchestra.run.smithi155.stdout: "duration": 0.068018577999999996, 2023-08-01T19:55:22.693 INFO:teuthology.orchestra.run.smithi155.stdout: "type_data": { 2023-08-01T19:55:22.693 INFO:teuthology.orchestra.run.smithi155.stdout: "flag_point": "commit sent; apply or cleanup", 2023-08-01T19:55:22.693 INFO:teuthology.orchestra.run.smithi155.stdout: "events": [ 2023-08-01T19:55:22.693 INFO:teuthology.orchestra.run.smithi155.stdout: { 2023-08-01T19:55:22.693 INFO:teuthology.orchestra.run.smithi155.stdout: "event": "initiated", 2023-08-01T19:55:22.693 INFO:teuthology.orchestra.run.smithi155.stdout: "time": "2023-08-01T19:55:05.156952+0000", 2023-08-01T19:55:22.694 INFO:teuthology.orchestra.run.smithi155.stdout: "duration": 0 2023-08-01T19:55:22.694 INFO:teuthology.orchestra.run.smithi155.stdout: }, 2023-08-01T19:55:22.694 INFO:teuthology.orchestra.run.smithi155.stdout: { 2023-08-01T19:55:22.694 INFO:teuthology.orchestra.run.smithi155.stdout: "event": "throttled", 2023-08-01T19:55:22.694 INFO:teuthology.orchestra.run.smithi155.stdout: "time": "2023-08-01T19:55:05.156952+0000", 2023-08-01T19:55:22.694 INFO:teuthology.orchestra.run.smithi155.stdout: "duration": 0 2023-08-01T19:55:22.694 INFO:teuthology.orchestra.run.smithi155.stdout: }, 2023-08-01T19:55:22.694 INFO:teuthology.orchestra.run.smithi155.stdout: { 2023-08-01T19:55:22.695 INFO:teuthology.orchestra.run.smithi155.stdout: "event": "header_read", 2023-08-01T19:55:22.695 INFO:teuthology.orchestra.run.smithi155.stdout: "time": "2023-08-01T19:55:05.156951+0000", 2023-08-01T19:55:22.695 INFO:teuthology.orchestra.run.smithi155.stdout: "duration": 4294967295.999999 2023-08-01T19:55:22.695 INFO:teuthology.orchestra.run.smithi155.stdout: }, 2023-08-01T19:55:22.695 INFO:teuthology.orchestra.run.smithi155.stdout: { 2023-08-01T19:55:22.695 INFO:teuthology.orchestra.run.smithi155.stdout: "event": "all_read", 2023-08-01T19:55:22.695 INFO:teuthology.orchestra.run.smithi155.stdout: "time": "2023-08-01T19:55:05.156989+0000", 2023-08-01T19:55:22.695 INFO:teuthology.orchestra.run.smithi155.stdout: "duration": 3.8175e-05 2023-08-01T19:55:22.696 INFO:teuthology.orchestra.run.smithi155.stdout: }, 2023-08-01T19:55:22.696 INFO:teuthology.orchestra.run.smithi155.stdout: { 2023-08-01T19:55:22.696 INFO:teuthology.orchestra.run.smithi155.stdout: "event": "dispatched", 2023-08-01T19:55:22.696 INFO:teuthology.orchestra.run.smithi155.stdout: "time": "2023-08-01T19:55:05.218842+0000", 2023-08-01T19:55:22.696 INFO:teuthology.orchestra.run.smithi155.stdout: "duration": 0.061852299999999999 2023-08-01T19:55:22.696 INFO:teuthology.orchestra.run.smithi155.stdout: }, 2023-08-01T19:55:22.696 INFO:teuthology.orchestra.run.smithi155.stdout: { 2023-08-01T19:55:22.696 INFO:teuthology.orchestra.run.smithi155.stdout: "event": "queued_for_pg", 2023-08-01T19:55:22.697 INFO:teuthology.orchestra.run.smithi155.stdout: "time": "2023-08-01T19:55:05.218862+0000", 2023-08-01T19:55:22.697 INFO:teuthology.orchestra.run.smithi155.stdout: "duration": 1.9854999999999999e-05 2023-08-01T19:55:22.697 INFO:teuthology.orchestra.run.smithi155.stdout: }, 2023-08-01T19:55:22.697 INFO:teuthology.orchestra.run.smithi155.stdout: { 2023-08-01T19:55:22.697 INFO:teuthology.orchestra.run.smithi155.stdout: "event": "reached_pg", 2023-08-01T19:55:22.697 INFO:teuthology.orchestra.run.smithi155.stdout: "time": "2023-08-01T19:55:05.218918+0000", 2023-08-01T19:55:22.697 INFO:teuthology.orchestra.run.smithi155.stdout: "duration": 5.6570000000000002e-05 2023-08-01T19:55:22.697 INFO:teuthology.orchestra.run.smithi155.stdout: }, 2023-08-01T19:55:22.698 INFO:teuthology.orchestra.run.smithi155.stdout: { 2023-08-01T19:55:22.698 INFO:teuthology.orchestra.run.smithi155.stdout: "event": "started", 2023-08-01T19:55:22.698 INFO:teuthology.orchestra.run.smithi155.stdout: "time": "2023-08-01T19:55:05.218940+0000", 2023-08-01T19:55:22.698 INFO:teuthology.orchestra.run.smithi155.stdout: "duration": 2.1804e-05 2023-08-01T19:55:22.698 INFO:teuthology.orchestra.run.smithi155.stdout: }, 2023-08-01T19:55:22.698 INFO:teuthology.orchestra.run.smithi155.stdout: { 2023-08-01T19:55:22.698 INFO:teuthology.orchestra.run.smithi155.stdout: "event": "commit_sent", 2023-08-01T19:55:22.698 INFO:teuthology.orchestra.run.smithi155.stdout: "time": "2023-08-01T19:55:05.224928+0000", 2023-08-01T19:55:22.699 INFO:teuthology.orchestra.run.smithi155.stdout: "duration": 0.0059876759999999999 2023-08-01T19:55:22.699 INFO:teuthology.orchestra.run.smithi155.stdout: }, 2023-08-01T19:55:22.699 INFO:teuthology.orchestra.run.smithi155.stdout: { 2023-08-01T19:55:22.699 INFO:teuthology.orchestra.run.smithi155.stdout: "event": "done", 2023-08-01T19:55:22.699 INFO:teuthology.orchestra.run.smithi155.stdout: "time": "2023-08-01T19:55:05.224971+0000", 2023-08-01T19:55:22.699 INFO:teuthology.orchestra.run.smithi155.stdout: "duration": 4.2929999999999997e-05 2023-08-01T19:55:22.699 INFO:teuthology.orchestra.run.smithi155.stdout: } 2023-08-01T19:55:22.700 INFO:teuthology.orchestra.run.smithi155.stdout: ] 2023-08-01T19:55:22.700 INFO:teuthology.orchestra.run.smithi155.stdout: } 2023-08-01T19:55:22.700 INFO:teuthology.orchestra.run.smithi155.stdout: }, 2023-08-01T19:55:22.700 INFO:teuthology.orchestra.run.smithi155.stdout: { 2023-08-01T19:55:22.700 INFO:teuthology.orchestra.run.smithi155.stdout: "description": "osd_op(client.4668.0:100927 5.0 5:00608ec6:::benchmark_data_smithi006_114134_object100926:head [set-alloc-hint object_size 65536 write_size 65536,write 0~65536] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e37)", 2023-08-01T19:55:22.700 INFO:teuthology.orchestra.run.smithi155.stdout: "initiated_at": "2023-08-01T19:55:05.561169+0000", 2023-08-01T19:55:22.700 INFO:teuthology.orchestra.run.smithi155.stdout: "age": 16.990258399999998, 2023-08-01T19:55:22.700 INFO:teuthology.orchestra.run.smithi155.stdout: "duration": 0.066411687999999997, 2023-08-01T19:55:22.701 INFO:teuthology.orchestra.run.smithi155.stdout: "type_data": { 2023-08-01T19:55:22.701 INFO:teuthology.orchestra.run.smithi155.stdout: "flag_point": "commit sent; apply or cleanup", 2023-08-01T19:55:22.701 INFO:teuthology.orchestra.run.smithi155.stdout: "client_info": { 2023-08-01T19:55:22.701 INFO:teuthology.orchestra.run.smithi155.stdout: "client": "client.4668", 2023-08-01T19:55:22.701 INFO:teuthology.orchestra.run.smithi155.stdout: "client_addr": "172.21.15.6:0/1709472247", 2023-08-01T19:55:22.701 INFO:teuthology.orchestra.run.smithi155.stdout: "tid": 100927 2023-08-01T19:55:22.701 INFO:teuthology.orchestra.run.smithi155.stdout: }, 2023-08-01T19:55:22.702 INFO:teuthology.orchestra.run.smithi155.stdout: "events": [ 2023-08-01T19:55:22.702 INFO:teuthology.orchestra.run.smithi155.stdout: { 2023-08-01T19:55:22.702 INFO:teuthology.orchestra.run.smithi155.stdout: "event": "initiated", 2023-08-01T19:55:22.702 INFO:teuthology.orchestra.run.smithi155.stdout: "time": "2023-08-01T19:55:05.561169+0000", 2023-08-01T19:55:22.702 INFO:teuthology.orchestra.run.smithi155.stdout: "duration": 0 2023-08-01T19:55:22.702 INFO:teuthology.orchestra.run.smithi155.stdout: }, 2023-08-01T19:55:22.702 INFO:teuthology.orchestra.run.smithi155.stdout: { 2023-08-01T19:55:22.702 INFO:teuthology.orchestra.run.smithi155.stdout: "event": "throttled", 2023-08-01T19:55:22.703 INFO:teuthology.orchestra.run.smithi155.stdout: "time": "2023-08-01T19:55:05.561169+0000", 2023-08-01T19:55:22.703 INFO:teuthology.orchestra.run.smithi155.stdout: "duration": 0 2023-08-01T19:55:22.703 INFO:teuthology.orchestra.run.smithi155.stdout: }, 2023-08-01T19:55:22.703 INFO:teuthology.orchestra.run.smithi155.stdout: { 2023-08-01T19:55:22.703 INFO:teuthology.orchestra.run.smithi155.stdout: "event": "header_read", 2023-08-01T19:55:22.703 INFO:teuthology.orchestra.run.smithi155.stdout: "time": "2023-08-01T19:55:05.561168+0000", 2023-08-01T19:55:22.703 INFO:teuthology.orchestra.run.smithi155.stdout: "duration": 4294967295.9999995 2023-08-01T19:55:22.704 INFO:teuthology.orchestra.run.smithi155.stdout: }, 2023-08-01T19:55:22.704 INFO:teuthology.orchestra.run.smithi155.stdout: { 2023-08-01T19:55:22.704 INFO:teuthology.orchestra.run.smithi155.stdout: "event": "all_read", 2023-08-01T19:55:22.704 INFO:teuthology.orchestra.run.smithi155.stdout: "time": "2023-08-01T19:55:05.561218+0000", 2023-08-01T19:55:22.704 INFO:teuthology.orchestra.run.smithi155.stdout: "duration": 4.9379999999999998e-05 2023-08-01T19:55:22.704 INFO:teuthology.orchestra.run.smithi155.stdout: }, 2023-08-01T19:55:22.705 INFO:teuthology.orchestra.run.smithi155.stdout: { 2023-08-01T19:55:22.705 INFO:teuthology.orchestra.run.smithi155.stdout: "event": "dispatched", 2023-08-01T19:55:22.705 INFO:teuthology.orchestra.run.smithi155.stdout: "time": "2023-08-01T19:55:05.561225+0000", 2023-08-01T19:55:22.705 INFO:teuthology.orchestra.run.smithi155.stdout: "duration": 7.114e-06 2023-08-01T19:55:22.705 INFO:teuthology.orchestra.run.smithi155.stdout: }, 2023-08-01T19:55:22.705 INFO:teuthology.orchestra.run.smithi155.stdout: { 2023-08-01T19:55:22.705 INFO:teuthology.orchestra.run.smithi155.stdout: "event": "queued_for_pg", 2023-08-01T19:55:22.705 INFO:teuthology.orchestra.run.smithi155.stdout: "time": "2023-08-01T19:55:05.561229+0000", 2023-08-01T19:55:22.706 INFO:teuthology.orchestra.run.smithi155.stdout: "duration": 4.2180000000000001e-06 2023-08-01T19:55:22.706 INFO:teuthology.orchestra.run.smithi155.stdout: }, 2023-08-01T19:55:22.706 INFO:teuthology.orchestra.run.smithi155.stdout: { 2023-08-01T19:55:22.706 INFO:teuthology.orchestra.run.smithi155.stdout: "event": "reached_pg", 2023-08-01T19:55:22.706 INFO:teuthology.orchestra.run.smithi155.stdout: "time": "2023-08-01T19:55:05.564737+0000", 2023-08-01T19:55:22.706 INFO:teuthology.orchestra.run.smithi155.stdout: "duration": 0.0035081869999999999 2023-08-01T19:55:22.706 INFO:teuthology.orchestra.run.smithi155.stdout: }, 2023-08-01T19:55:22.707 INFO:teuthology.orchestra.run.smithi155.stdout: { 2023-08-01T19:55:22.707 INFO:teuthology.orchestra.run.smithi155.stdout: "event": "started", 2023-08-01T19:55:22.707 INFO:teuthology.orchestra.run.smithi155.stdout: "time": "2023-08-01T19:55:05.564859+0000", 2023-08-01T19:55:22.707 INFO:teuthology.orchestra.run.smithi155.stdout: "duration": 0.00012165800000000001 2023-08-01T19:55:22.707 INFO:teuthology.orchestra.run.smithi155.stdout: }, 2023-08-01T19:55:22.707 INFO:teuthology.orchestra.run.smithi155.stdout: { 2023-08-01T19:55:22.707 INFO:teuthology.orchestra.run.smithi155.stdout: "event": "waiting for subops from 0", 2023-08-01T19:55:22.707 INFO:teuthology.orchestra.run.smithi155.stdout: "time": "2023-08-01T19:55:05.565009+0000", 2023-08-01T19:55:22.708 INFO:teuthology.orchestra.run.smithi155.stdout: "duration": 0.00014979699999999999 2023-08-01T19:55:22.708 INFO:teuthology.orchestra.run.smithi155.stdout: }, 2023-08-01T19:55:22.708 INFO:teuthology.orchestra.run.smithi155.stdout: { 2023-08-01T19:55:22.708 INFO:teuthology.orchestra.run.smithi155.stdout: "event": "op_commit", 2023-08-01T19:55:22.708 INFO:teuthology.orchestra.run.smithi155.stdout: "time": "2023-08-01T19:55:05.568007+0000", 2023-08-01T19:55:22.708 INFO:teuthology.orchestra.run.smithi155.stdout: "duration": 0.00299796 2023-08-01T19:55:22.708 INFO:teuthology.orchestra.run.smithi155.stdout: }, 2023-08-01T19:55:22.709 INFO:teuthology.orchestra.run.smithi155.stdout: { 2023-08-01T19:55:22.709 INFO:teuthology.orchestra.run.smithi155.stdout: "event": "sub_op_commit_rec", 2023-08-01T19:55:22.709 INFO:teuthology.orchestra.run.smithi155.stdout: "time": "2023-08-01T19:55:05.627520+0000", 2023-08-01T19:55:22.709 INFO:teuthology.orchestra.run.smithi155.stdout: "duration": 0.059513636000000002 2023-08-01T19:55:22.709 INFO:teuthology.orchestra.run.smithi155.stdout: }, 2023-08-01T19:55:22.709 INFO:teuthology.orchestra.run.smithi155.stdout: { 2023-08-01T19:55:22.709 INFO:teuthology.orchestra.run.smithi155.stdout: "event": "commit_sent", 2023-08-01T19:55:22.709 INFO:teuthology.orchestra.run.smithi155.stdout: "time": "2023-08-01T19:55:05.627553+0000", 2023-08-01T19:55:22.710 INFO:teuthology.orchestra.run.smithi155.stdout: "duration": 3.2635999999999997e-05 2023-08-01T19:55:22.710 INFO:teuthology.orchestra.run.smithi155.stdout: }, 2023-08-01T19:55:22.710 INFO:teuthology.orchestra.run.smithi155.stdout: { 2023-08-01T19:55:22.710 INFO:teuthology.orchestra.run.smithi155.stdout: "event": "done", 2023-08-01T19:55:22.710 INFO:teuthology.orchestra.run.smithi155.stdout: "time": "2023-08-01T19:55:05.627581+0000", 2023-08-01T19:55:22.710 INFO:teuthology.orchestra.run.smithi155.stdout: "duration": 2.7681000000000001e-05 2023-08-01T19:55:22.710 INFO:teuthology.orchestra.run.smithi155.stdout: } 2023-08-01T19:55:22.710 INFO:teuthology.orchestra.run.smithi155.stdout: ] 2023-08-01T19:55:22.711 INFO:teuthology.orchestra.run.smithi155.stdout: } 2023-08-01T19:55:22.711 INFO:teuthology.orchestra.run.smithi155.stdout: }, 2023-08-01T19:55:22.711 INFO:teuthology.orchestra.run.smithi155.stdout: { 2023-08-01T19:55:22.711 INFO:teuthology.orchestra.run.smithi155.stdout: "description": "osd_op(client.4668.0:100935 5.e 5:7895b14e:::benchmark_data_smithi006_114134_object100934:head [set-alloc-hint object_size 65536 write_size 65536,write 0~65536] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e37)", 2023-08-01T19:55:22.711 INFO:teuthology.orchestra.run.smithi155.stdout: "initiated_at": "2023-08-01T19:55:05.566666+0000", 2023-08-01T19:55:22.711 INFO:teuthology.orchestra.run.smithi155.stdout: "age": 16.9847611, 2023-08-01T19:55:22.711 INFO:teuthology.orchestra.run.smithi155.stdout: "duration": 0.064309016999999996, 2023-08-01T19:55:22.712 INFO:teuthology.orchestra.run.smithi155.stdout: "type_data": { 2023-08-01T19:55:22.712 INFO:teuthology.orchestra.run.smithi155.stdout: "flag_point": "commit sent; apply or cleanup", 2023-08-01T19:55:22.712 INFO:teuthology.orchestra.run.smithi155.stdout: "client_info": { 2023-08-01T19:55:22.712 INFO:teuthology.orchestra.run.smithi155.stdout: "client": "client.4668", 2023-08-01T19:55:22.712 INFO:teuthology.orchestra.run.smithi155.stdout: "client_addr": "172.21.15.6:0/1709472247", 2023-08-01T19:55:22.712 INFO:teuthology.orchestra.run.smithi155.stdout: "tid": 100935 2023-08-01T19:55:22.712 INFO:teuthology.orchestra.run.smithi155.stdout: }, 2023-08-01T19:55:22.713 INFO:teuthology.orchestra.run.smithi155.stdout: "events": [ 2023-08-01T19:55:22.713 INFO:teuthology.orchestra.run.smithi155.stdout: { 2023-08-01T19:55:22.713 INFO:teuthology.orchestra.run.smithi155.stdout: "event": "initiated", 2023-08-01T19:55:22.713 INFO:teuthology.orchestra.run.smithi155.stdout: "time": "2023-08-01T19:55:05.566666+0000", 2023-08-01T19:55:22.713 INFO:teuthology.orchestra.run.smithi155.stdout: "duration": 0 2023-08-01T19:55:22.713 INFO:teuthology.orchestra.run.smithi155.stdout: }, 2023-08-01T19:55:22.713 INFO:teuthology.orchestra.run.smithi155.stdout: { 2023-08-01T19:55:22.713 INFO:teuthology.orchestra.run.smithi155.stdout: "event": "throttled", 2023-08-01T19:55:22.714 INFO:teuthology.orchestra.run.smithi155.stdout: "time": "2023-08-01T19:55:05.566666+0000", 2023-08-01T19:55:22.714 INFO:teuthology.orchestra.run.smithi155.stdout: "duration": 0 2023-08-01T19:55:22.714 INFO:teuthology.orchestra.run.smithi155.stdout: }, 2023-08-01T19:55:22.714 INFO:teuthology.orchestra.run.smithi155.stdout: { 2023-08-01T19:55:22.714 INFO:teuthology.orchestra.run.smithi155.stdout: "event": "header_read", 2023-08-01T19:55:22.714 INFO:teuthology.orchestra.run.smithi155.stdout: "time": "2023-08-01T19:55:05.566665+0000", 2023-08-01T19:55:22.714 INFO:teuthology.orchestra.run.smithi155.stdout: "duration": 4294967295.9999986 2023-08-01T19:55:22.715 INFO:teuthology.orchestra.run.smithi155.stdout: }, 2023-08-01T19:55:22.715 INFO:teuthology.orchestra.run.smithi155.stdout: { 2023-08-01T19:55:22.715 INFO:teuthology.orchestra.run.smithi155.stdout: "event": "all_read", 2023-08-01T19:55:22.715 INFO:teuthology.orchestra.run.smithi155.stdout: "time": "2023-08-01T19:55:05.566754+0000", 2023-08-01T19:55:22.715 INFO:teuthology.orchestra.run.smithi155.stdout: "duration": 8.9425999999999994e-05 2023-08-01T19:55:22.715 INFO:teuthology.orchestra.run.smithi155.stdout: }, 2023-08-01T19:55:22.715 INFO:teuthology.orchestra.run.smithi155.stdout: { 2023-08-01T19:55:22.715 INFO:teuthology.orchestra.run.smithi155.stdout: "event": "dispatched", 2023-08-01T19:55:22.716 INFO:teuthology.orchestra.run.smithi155.stdout: "time": "2023-08-01T19:55:05.566766+0000", 2023-08-01T19:55:22.716 INFO:teuthology.orchestra.run.smithi155.stdout: "duration": 1.2018000000000001e-05 2023-08-01T19:55:22.716 INFO:teuthology.orchestra.run.smithi155.stdout: }, 2023-08-01T19:55:22.716 INFO:teuthology.orchestra.run.smithi155.stdout: { 2023-08-01T19:55:22.716 INFO:teuthology.orchestra.run.smithi155.stdout: "event": "queued_for_pg", 2023-08-01T19:55:22.716 INFO:teuthology.orchestra.run.smithi155.stdout: "time": "2023-08-01T19:55:05.566772+0000", 2023-08-01T19:55:22.716 INFO:teuthology.orchestra.run.smithi155.stdout: "duration": 6.0190000000000003e-06 2023-08-01T19:55:22.717 INFO:teuthology.orchestra.run.smithi155.stdout: }, 2023-08-01T19:55:22.717 INFO:teuthology.orchestra.run.smithi155.stdout: { 2023-08-01T19:55:22.717 INFO:teuthology.orchestra.run.smithi155.stdout: "event": "reached_pg", 2023-08-01T19:55:22.717 INFO:teuthology.orchestra.run.smithi155.stdout: "time": "2023-08-01T19:55:05.566800+0000", 2023-08-01T19:55:22.717 INFO:teuthology.orchestra.run.smithi155.stdout: "duration": 2.7835999999999999e-05 2023-08-01T19:55:22.717 INFO:teuthology.orchestra.run.smithi155.stdout: }, 2023-08-01T19:55:22.717 INFO:teuthology.orchestra.run.smithi155.stdout: { 2023-08-01T19:55:22.717 INFO:teuthology.orchestra.run.smithi155.stdout: "event": "started", 2023-08-01T19:55:22.718 INFO:teuthology.orchestra.run.smithi155.stdout: "time": "2023-08-01T19:55:05.566879+0000", 2023-08-01T19:55:22.718 INFO:teuthology.orchestra.run.smithi155.stdout: "duration": 7.9105999999999998e-05 2023-08-01T19:55:22.718 INFO:teuthology.orchestra.run.smithi155.stdout: }, 2023-08-01T19:55:22.718 INFO:teuthology.orchestra.run.smithi155.stdout: { 2023-08-01T19:55:22.718 INFO:teuthology.orchestra.run.smithi155.stdout: "event": "waiting for subops from 0", 2023-08-01T19:55:22.718 INFO:teuthology.orchestra.run.smithi155.stdout: "time": "2023-08-01T19:55:05.566971+0000", 2023-08-01T19:55:22.718 INFO:teuthology.orchestra.run.smithi155.stdout: "duration": 9.1817999999999994e-05 2023-08-01T19:55:22.718 INFO:teuthology.orchestra.run.smithi155.stdout: }, 2023-08-01T19:55:22.719 INFO:teuthology.orchestra.run.smithi155.stdout: { 2023-08-01T19:55:22.719 INFO:teuthology.orchestra.run.smithi155.stdout: "event": "op_commit", 2023-08-01T19:55:22.719 INFO:teuthology.orchestra.run.smithi155.stdout: "time": "2023-08-01T19:55:05.571475+0000", 2023-08-01T19:55:22.719 INFO:teuthology.orchestra.run.smithi155.stdout: "duration": 0.0045039499999999996 2023-08-01T19:55:22.719 INFO:teuthology.orchestra.run.smithi155.stdout: }, 2023-08-01T19:55:22.719 INFO:teuthology.orchestra.run.smithi155.stdout: { 2023-08-01T19:55:22.719 INFO:teuthology.orchestra.run.smithi155.stdout: "event": "sub_op_commit_rec", 2023-08-01T19:55:22.719 INFO:teuthology.orchestra.run.smithi155.stdout: "time": "2023-08-01T19:55:05.630884+0000", 2023-08-01T19:55:22.720 INFO:teuthology.orchestra.run.smithi155.stdout: "duration": 0.059409181999999998 2023-08-01T19:55:22.720 INFO:teuthology.orchestra.run.smithi155.stdout: }, 2023-08-01T19:55:22.720 INFO:teuthology.orchestra.run.smithi155.stdout: { 2023-08-01T19:55:22.720 INFO:teuthology.orchestra.run.smithi155.stdout: "event": "commit_sent", 2023-08-01T19:55:22.720 INFO:teuthology.orchestra.run.smithi155.stdout: "time": "2023-08-01T19:55:05.630930+0000", 2023-08-01T19:55:22.720 INFO:teuthology.orchestra.run.smithi155.stdout: "duration": 4.5507999999999999e-05 2023-08-01T19:55:22.720 INFO:teuthology.orchestra.run.smithi155.stdout: }, 2023-08-01T19:55:22.720 INFO:teuthology.orchestra.run.smithi155.stdout: { 2023-08-01T19:55:22.721 INFO:teuthology.orchestra.run.smithi155.stdout: "event": "done", 2023-08-01T19:55:22.721 INFO:teuthology.orchestra.run.smithi155.stdout: "time": "2023-08-01T19:55:05.630975+0000", 2023-08-01T19:55:22.721 INFO:teuthology.orchestra.run.smithi155.stdout: "duration": 4.5441000000000001e-05 2023-08-01T19:55:22.721 INFO:teuthology.orchestra.run.smithi155.stdout: } 2023-08-01T19:55:22.721 INFO:teuthology.orchestra.run.smithi155.stdout: ] 2023-08-01T19:55:22.721 INFO:teuthology.orchestra.run.smithi155.stdout: } 2023-08-01T19:55:22.721 INFO:teuthology.orchestra.run.smithi155.stdout: }, 2023-08-01T19:55:22.722 INFO:teuthology.orchestra.run.smithi155.stdout: { 2023-08-01T19:55:22.722 INFO:teuthology.orchestra.run.smithi155.stdout: "description": "osd_op(client.4668.0:100941 5.e 5:736a6ac6:::benchmark_data_smithi006_114134_object100940:head [set-alloc-hint object_size 65536 write_size 65536,write 0~65536] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e37)", 2023-08-01T19:55:22.722 INFO:teuthology.orchestra.run.smithi155.stdout: "initiated_at": "2023-08-01T19:55:05.569750+0000", 2023-08-01T19:55:22.722 INFO:teuthology.orchestra.run.smithi155.stdout: "age": 16.981677207000001, 2023-08-01T19:55:22.722 INFO:teuthology.orchestra.run.smithi155.stdout: "duration": 0.065431331999999995, 2023-08-01T19:55:22.722 INFO:teuthology.orchestra.run.smithi155.stdout: "type_data": { 2023-08-01T19:55:22.722 INFO:teuthology.orchestra.run.smithi155.stdout: "flag_point": "commit sent; apply or cleanup", 2023-08-01T19:55:22.722 INFO:teuthology.orchestra.run.smithi155.stdout: "client_info": { 2023-08-01T19:55:22.723 INFO:teuthology.orchestra.run.smithi155.stdout: "client": "client.4668", 2023-08-01T19:55:22.723 INFO:teuthology.orchestra.run.smithi155.stdout: "client_addr": "172.21.15.6:0/1709472247", 2023-08-01T19:55:22.723 INFO:teuthology.orchestra.run.smithi155.stdout: "tid": 100941 2023-08-01T19:55:22.723 INFO:teuthology.orchestra.run.smithi155.stdout: }, 2023-08-01T19:55:22.723 INFO:teuthology.orchestra.run.smithi155.stdout: "events": [ 2023-08-01T19:55:22.723 INFO:teuthology.orchestra.run.smithi155.stdout: { 2023-08-01T19:55:22.723 INFO:teuthology.orchestra.run.smithi155.stdout: "event": "initiated", 2023-08-01T19:55:22.724 INFO:teuthology.orchestra.run.smithi155.stdout: "time": "2023-08-01T19:55:05.569750+0000", 2023-08-01T19:55:22.724 INFO:teuthology.orchestra.run.smithi155.stdout: "duration": 0 2023-08-01T19:55:22.724 INFO:teuthology.orchestra.run.smithi155.stdout: }, 2023-08-01T19:55:22.724 INFO:teuthology.orchestra.run.smithi155.stdout: { 2023-08-01T19:55:22.724 INFO:teuthology.orchestra.run.smithi155.stdout: "event": "throttled", 2023-08-01T19:55:22.724 INFO:teuthology.orchestra.run.smithi155.stdout: "time": "2023-08-01T19:55:05.569750+0000", 2023-08-01T19:55:22.724 INFO:teuthology.orchestra.run.smithi155.stdout: "duration": 0 2023-08-01T19:55:22.724 INFO:teuthology.orchestra.run.smithi155.stdout: }, 2023-08-01T19:55:22.725 INFO:teuthology.orchestra.run.smithi155.stdout: { 2023-08-01T19:55:22.725 INFO:teuthology.orchestra.run.smithi155.stdout: "event": "header_read", 2023-08-01T19:55:22.725 INFO:teuthology.orchestra.run.smithi155.stdout: "time": "2023-08-01T19:55:05.569749+0000", 2023-08-01T19:55:22.725 INFO:teuthology.orchestra.run.smithi155.stdout: "duration": 4294967295.999999 2023-08-01T19:55:22.725 INFO:teuthology.orchestra.run.smithi155.stdout: }, 2023-08-01T19:55:22.725 INFO:teuthology.orchestra.run.smithi155.stdout: { 2023-08-01T19:55:22.725 INFO:teuthology.orchestra.run.smithi155.stdout: "event": "all_read", 2023-08-01T19:55:22.726 INFO:teuthology.orchestra.run.smithi155.stdout: "time": "2023-08-01T19:55:05.569861+0000", 2023-08-01T19:55:22.726 INFO:teuthology.orchestra.run.smithi155.stdout: "duration": 0.000111333 2023-08-01T19:55:22.726 INFO:teuthology.orchestra.run.smithi155.stdout: }, 2023-08-01T19:55:22.726 INFO:teuthology.orchestra.run.smithi155.stdout: { 2023-08-01T19:55:22.726 INFO:teuthology.orchestra.run.smithi155.stdout: "event": "dispatched", 2023-08-01T19:55:22.726 INFO:teuthology.orchestra.run.smithi155.stdout: "time": "2023-08-01T19:55:05.569869+0000", 2023-08-01T19:55:22.726 INFO:teuthology.orchestra.run.smithi155.stdout: "duration": 8.8589999999999994e-06 2023-08-01T19:55:22.726 INFO:teuthology.orchestra.run.smithi155.stdout: }, 2023-08-01T19:55:22.727 INFO:teuthology.orchestra.run.smithi155.stdout: { 2023-08-01T19:55:22.727 INFO:teuthology.orchestra.run.smithi155.stdout: "event": "queued_for_pg", 2023-08-01T19:55:22.727 INFO:teuthology.orchestra.run.smithi155.stdout: "time": "2023-08-01T19:55:05.569874+0000", 2023-08-01T19:55:22.727 INFO:teuthology.orchestra.run.smithi155.stdout: "duration": 4.1679999999999997e-06 2023-08-01T19:55:22.727 INFO:teuthology.orchestra.run.smithi155.stdout: }, 2023-08-01T19:55:22.727 INFO:teuthology.orchestra.run.smithi155.stdout: { 2023-08-01T19:55:22.727 INFO:teuthology.orchestra.run.smithi155.stdout: "event": "reached_pg", 2023-08-01T19:55:22.727 INFO:teuthology.orchestra.run.smithi155.stdout: "time": "2023-08-01T19:55:05.569904+0000", 2023-08-01T19:55:22.728 INFO:teuthology.orchestra.run.smithi155.stdout: "duration": 3.0920999999999998e-05 2023-08-01T19:55:22.728 INFO:teuthology.orchestra.run.smithi155.stdout: }, 2023-08-01T19:55:22.728 INFO:teuthology.orchestra.run.smithi155.stdout: { 2023-08-01T19:55:22.728 INFO:teuthology.orchestra.run.smithi155.stdout: "event": "started", 2023-08-01T19:55:22.728 INFO:teuthology.orchestra.run.smithi155.stdout: "time": "2023-08-01T19:55:05.569998+0000", 2023-08-01T19:55:22.728 INFO:teuthology.orchestra.run.smithi155.stdout: "duration": 9.3086999999999998e-05 2023-08-01T19:55:22.728 INFO:teuthology.orchestra.run.smithi155.stdout: }, 2023-08-01T19:55:22.728 INFO:teuthology.orchestra.run.smithi155.stdout: { 2023-08-01T19:55:22.729 INFO:teuthology.orchestra.run.smithi155.stdout: "event": "waiting for subops from 0", 2023-08-01T19:55:22.729 INFO:teuthology.orchestra.run.smithi155.stdout: "time": "2023-08-01T19:55:05.570093+0000", 2023-08-01T19:55:22.729 INFO:teuthology.orchestra.run.smithi155.stdout: "duration": 9.5768999999999997e-05 2023-08-01T19:55:22.729 INFO:teuthology.orchestra.run.smithi155.stdout: }, 2023-08-01T19:55:22.729 INFO:teuthology.orchestra.run.smithi155.stdout: { 2023-08-01T19:55:22.729 INFO:teuthology.orchestra.run.smithi155.stdout: "event": "op_commit", 2023-08-01T19:55:22.729 INFO:teuthology.orchestra.run.smithi155.stdout: "time": "2023-08-01T19:55:05.572839+0000", 2023-08-01T19:55:22.729 INFO:teuthology.orchestra.run.smithi155.stdout: "duration": 0.0027460050000000001 2023-08-01T19:55:22.730 INFO:teuthology.orchestra.run.smithi155.stdout: }, 2023-08-01T19:55:22.730 INFO:teuthology.orchestra.run.smithi155.stdout: { 2023-08-01T19:55:22.730 INFO:teuthology.orchestra.run.smithi155.stdout: "event": "sub_op_commit_rec", 2023-08-01T19:55:22.730 INFO:teuthology.orchestra.run.smithi155.stdout: "time": "2023-08-01T19:55:05.635114+0000", 2023-08-01T19:55:22.730 INFO:teuthology.orchestra.run.smithi155.stdout: "duration": 0.062274297999999999 2023-08-01T19:55:22.730 INFO:teuthology.orchestra.run.smithi155.stdout: }, 2023-08-01T19:55:22.730 INFO:teuthology.orchestra.run.smithi155.stdout: { 2023-08-01T19:55:22.731 INFO:teuthology.orchestra.run.smithi155.stdout: "event": "commit_sent", 2023-08-01T19:55:22.731 INFO:teuthology.orchestra.run.smithi155.stdout: "time": "2023-08-01T19:55:05.635143+0000", 2023-08-01T19:55:22.731 INFO:teuthology.orchestra.run.smithi155.stdout: "duration": 2.9430000000000001e-05 2023-08-01T19:55:22.731 INFO:teuthology.orchestra.run.smithi155.stdout: }, 2023-08-01T19:55:22.731 INFO:teuthology.orchestra.run.smithi155.stdout: { 2023-08-01T19:55:22.731 INFO:teuthology.orchestra.run.smithi155.stdout: "event": "done", 2023-08-01T19:55:22.731 INFO:teuthology.orchestra.run.smithi155.stdout: "time": "2023-08-01T19:55:05.635181+0000", 2023-08-01T19:55:22.731 INFO:teuthology.orchestra.run.smithi155.stdout: "duration": 3.8352000000000001e-05 2023-08-01T19:55:22.732 INFO:teuthology.orchestra.run.smithi155.stdout: } 2023-08-01T19:55:22.732 INFO:teuthology.orchestra.run.smithi155.stdout: ] 2023-08-01T19:55:22.732 INFO:teuthology.orchestra.run.smithi155.stdout: } 2023-08-01T19:55:22.732 INFO:teuthology.orchestra.run.smithi155.stdout: }, 2023-08-01T19:55:22.732 INFO:teuthology.orchestra.run.smithi155.stdout: { 2023-08-01T19:55:22.732 INFO:teuthology.orchestra.run.smithi155.stdout: "description": "osd_op(client.4668.0:100944 5.4 5:25fae865:::benchmark_data_smithi006_114134_object100943:head [set-alloc-hint object_size 65536 write_size 65536,write 0~65536] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e37)", 2023-08-01T19:55:22.732 INFO:teuthology.orchestra.run.smithi155.stdout: "initiated_at": "2023-08-01T19:55:05.576662+0000", 2023-08-01T19:55:22.733 INFO:teuthology.orchestra.run.smithi155.stdout: "age": 16.974765510000001, 2023-08-01T19:55:22.733 INFO:teuthology.orchestra.run.smithi155.stdout: "duration": 0.056054925999999998, 2023-08-01T19:55:22.733 INFO:teuthology.orchestra.run.smithi155.stdout: "type_data": { 2023-08-01T19:55:22.733 INFO:teuthology.orchestra.run.smithi155.stdout: "flag_point": "commit sent; apply or cleanup", 2023-08-01T19:55:22.733 INFO:teuthology.orchestra.run.smithi155.stdout: "client_info": { 2023-08-01T19:55:22.733 INFO:teuthology.orchestra.run.smithi155.stdout: "client": "client.4668", 2023-08-01T19:55:22.733 INFO:teuthology.orchestra.run.smithi155.stdout: "client_addr": "172.21.15.6:0/1709472247", 2023-08-01T19:55:22.734 INFO:teuthology.orchestra.run.smithi155.stdout: "tid": 100944 2023-08-01T19:55:22.734 INFO:teuthology.orchestra.run.smithi155.stdout: }, 2023-08-01T19:55:22.734 INFO:teuthology.orchestra.run.smithi155.stdout: "events": [ 2023-08-01T19:55:22.734 INFO:teuthology.orchestra.run.smithi155.stdout: { 2023-08-01T19:55:22.734 INFO:teuthology.orchestra.run.smithi155.stdout: "event": "initiated", 2023-08-01T19:55:22.734 INFO:teuthology.orchestra.run.smithi155.stdout: "time": "2023-08-01T19:55:05.576662+0000", 2023-08-01T19:55:22.734 INFO:teuthology.orchestra.run.smithi155.stdout: "duration": 0 2023-08-01T19:55:22.735 INFO:teuthology.orchestra.run.smithi155.stdout: }, 2023-08-01T19:55:22.735 INFO:teuthology.orchestra.run.smithi155.stdout: { 2023-08-01T19:55:22.735 INFO:teuthology.orchestra.run.smithi155.stdout: "event": "throttled", 2023-08-01T19:55:22.735 INFO:teuthology.orchestra.run.smithi155.stdout: "time": "2023-08-01T19:55:05.576662+0000", 2023-08-01T19:55:22.735 INFO:teuthology.orchestra.run.smithi155.stdout: "duration": 0 2023-08-01T19:55:22.735 INFO:teuthology.orchestra.run.smithi155.stdout: }, 2023-08-01T19:55:22.735 INFO:teuthology.orchestra.run.smithi155.stdout: { 2023-08-01T19:55:22.735 INFO:teuthology.orchestra.run.smithi155.stdout: "event": "header_read", 2023-08-01T19:55:22.736 INFO:teuthology.orchestra.run.smithi155.stdout: "time": "2023-08-01T19:55:05.576661+0000", 2023-08-01T19:55:22.736 INFO:teuthology.orchestra.run.smithi155.stdout: "duration": 4294967295.999999 2023-08-01T19:55:22.736 INFO:teuthology.orchestra.run.smithi155.stdout: }, 2023-08-01T19:55:22.736 INFO:teuthology.orchestra.run.smithi155.stdout: { 2023-08-01T19:55:22.736 INFO:teuthology.orchestra.run.smithi155.stdout: "event": "all_read", 2023-08-01T19:55:22.736 INFO:teuthology.orchestra.run.smithi155.stdout: "time": "2023-08-01T19:55:05.576725+0000", 2023-08-01T19:55:22.736 INFO:teuthology.orchestra.run.smithi155.stdout: "duration": 6.4435000000000002e-05 2023-08-01T19:55:22.736 INFO:teuthology.orchestra.run.smithi155.stdout: }, 2023-08-01T19:55:22.737 INFO:teuthology.orchestra.run.smithi155.stdout: { 2023-08-01T19:55:22.737 INFO:teuthology.orchestra.run.smithi155.stdout: "event": "dispatched", 2023-08-01T19:55:22.737 INFO:teuthology.orchestra.run.smithi155.stdout: "time": "2023-08-01T19:55:05.576744+0000", 2023-08-01T19:55:22.737 INFO:teuthology.orchestra.run.smithi155.stdout: "duration": 1.8502999999999999e-05 2023-08-01T19:55:22.737 INFO:teuthology.orchestra.run.smithi155.stdout: }, 2023-08-01T19:55:22.737 INFO:teuthology.orchestra.run.smithi155.stdout: { 2023-08-01T19:55:22.737 INFO:teuthology.orchestra.run.smithi155.stdout: "event": "queued_for_pg", 2023-08-01T19:55:22.737 INFO:teuthology.orchestra.run.smithi155.stdout: "time": "2023-08-01T19:55:05.576772+0000", 2023-08-01T19:55:22.738 INFO:teuthology.orchestra.run.smithi155.stdout: "duration": 2.8354999999999999e-05 2023-08-01T19:55:22.738 INFO:teuthology.orchestra.run.smithi155.stdout: }, 2023-08-01T19:55:22.738 INFO:teuthology.orchestra.run.smithi155.stdout: { 2023-08-01T19:55:22.738 INFO:teuthology.orchestra.run.smithi155.stdout: "event": "reached_pg", 2023-08-01T19:55:22.738 INFO:teuthology.orchestra.run.smithi155.stdout: "time": "2023-08-01T19:55:05.576815+0000", 2023-08-01T19:55:22.738 INFO:teuthology.orchestra.run.smithi155.stdout: "duration": 4.3223999999999998e-05 2023-08-01T19:55:22.738 INFO:teuthology.orchestra.run.smithi155.stdout: }, 2023-08-01T19:55:22.739 INFO:teuthology.orchestra.run.smithi155.stdout: { 2023-08-01T19:55:22.739 INFO:teuthology.orchestra.run.smithi155.stdout: "event": "started", 2023-08-01T19:55:22.739 INFO:teuthology.orchestra.run.smithi155.stdout: "time": "2023-08-01T19:55:05.576961+0000", 2023-08-01T19:55:22.739 INFO:teuthology.orchestra.run.smithi155.stdout: "duration": 0.000145043 2023-08-01T19:55:22.739 INFO:teuthology.orchestra.run.smithi155.stdout: }, 2023-08-01T19:55:22.739 INFO:teuthology.orchestra.run.smithi155.stdout: { 2023-08-01T19:55:22.739 INFO:teuthology.orchestra.run.smithi155.stdout: "event": "waiting for subops from 0", 2023-08-01T19:55:22.739 INFO:teuthology.orchestra.run.smithi155.stdout: "time": "2023-08-01T19:55:05.577343+0000", 2023-08-01T19:55:22.740 INFO:teuthology.orchestra.run.smithi155.stdout: "duration": 0.00038249699999999998 2023-08-01T19:55:22.740 INFO:teuthology.orchestra.run.smithi155.stdout: }, 2023-08-01T19:55:22.740 INFO:teuthology.orchestra.run.smithi155.stdout: { 2023-08-01T19:55:22.740 INFO:teuthology.orchestra.run.smithi155.stdout: "event": "op_commit", 2023-08-01T19:55:22.740 INFO:teuthology.orchestra.run.smithi155.stdout: "time": "2023-08-01T19:55:05.582349+0000", 2023-08-01T19:55:22.740 INFO:teuthology.orchestra.run.smithi155.stdout: "duration": 0.0050062880000000002 2023-08-01T19:55:22.740 INFO:teuthology.orchestra.run.smithi155.stdout: }, 2023-08-01T19:55:22.740 INFO:teuthology.orchestra.run.smithi155.stdout: { 2023-08-01T19:55:22.741 INFO:teuthology.orchestra.run.smithi155.stdout: "event": "sub_op_commit_rec", 2023-08-01T19:55:22.741 INFO:teuthology.orchestra.run.smithi155.stdout: "time": "2023-08-01T19:55:05.632659+0000", 2023-08-01T19:55:22.741 INFO:teuthology.orchestra.run.smithi155.stdout: "duration": 0.050309185999999999 2023-08-01T19:55:22.741 INFO:teuthology.orchestra.run.smithi155.stdout: }, 2023-08-01T19:55:22.741 INFO:teuthology.orchestra.run.smithi155.stdout: { 2023-08-01T19:55:22.741 INFO:teuthology.orchestra.run.smithi155.stdout: "event": "commit_sent", 2023-08-01T19:55:22.741 INFO:teuthology.orchestra.run.smithi155.stdout: "time": "2023-08-01T19:55:05.632692+0000", 2023-08-01T19:55:22.741 INFO:teuthology.orchestra.run.smithi155.stdout: "duration": 3.3077999999999997e-05 2023-08-01T19:55:22.742 INFO:teuthology.orchestra.run.smithi155.stdout: }, 2023-08-01T19:55:22.742 INFO:teuthology.orchestra.run.smithi155.stdout: { 2023-08-01T19:55:22.742 INFO:teuthology.orchestra.run.smithi155.stdout: "event": "done", 2023-08-01T19:55:22.742 INFO:teuthology.orchestra.run.smithi155.stdout: "time": "2023-08-01T19:55:05.632717+0000", 2023-08-01T19:55:22.742 INFO:teuthology.orchestra.run.smithi155.stdout: "duration": 2.5119000000000001e-05 2023-08-01T19:55:22.742 INFO:teuthology.orchestra.run.smithi155.stdout: } 2023-08-01T19:55:22.742 INFO:teuthology.orchestra.run.smithi155.stdout: ] 2023-08-01T19:55:22.742 INFO:teuthology.orchestra.run.smithi155.stdout: } 2023-08-01T19:55:22.743 INFO:teuthology.orchestra.run.smithi155.stdout: }, 2023-08-01T19:55:22.743 INFO:teuthology.orchestra.run.smithi155.stdout: { 2023-08-01T19:55:22.743 INFO:teuthology.orchestra.run.smithi155.stdout: "description": "osd_op(client.4668.0:100945 5.e 5:73df68dd:::benchmark_data_smithi006_114134_object100944:head [set-alloc-hint object_size 65536 write_size 65536,write 0~65536] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e37)", 2023-08-01T19:55:22.743 INFO:teuthology.orchestra.run.smithi155.stdout: "initiated_at": "2023-08-01T19:55:05.576784+0000", 2023-08-01T19:55:22.743 INFO:teuthology.orchestra.run.smithi155.stdout: "age": 16.974643621999999, 2023-08-01T19:55:22.743 INFO:teuthology.orchestra.run.smithi155.stdout: "duration": 0.058512994999999998, 2023-08-01T19:55:22.743 INFO:teuthology.orchestra.run.smithi155.stdout: "type_data": { 2023-08-01T19:55:22.744 INFO:teuthology.orchestra.run.smithi155.stdout: "flag_point": "commit sent; apply or cleanup", 2023-08-01T19:55:22.744 INFO:teuthology.orchestra.run.smithi155.stdout: "client_info": { 2023-08-01T19:55:22.744 INFO:teuthology.orchestra.run.smithi155.stdout: "client": "client.4668", 2023-08-01T19:55:22.744 INFO:teuthology.orchestra.run.smithi155.stdout: "client_addr": "172.21.15.6:0/1709472247", 2023-08-01T19:55:22.744 INFO:teuthology.orchestra.run.smithi155.stdout: "tid": 100945 2023-08-01T19:55:22.744 INFO:teuthology.orchestra.run.smithi155.stdout: }, 2023-08-01T19:55:22.744 INFO:teuthology.orchestra.run.smithi155.stdout: "events": [ 2023-08-01T19:55:22.745 INFO:teuthology.orchestra.run.smithi155.stdout: { 2023-08-01T19:55:22.745 INFO:teuthology.orchestra.run.smithi155.stdout: "event": "initiated", 2023-08-01T19:55:22.745 INFO:teuthology.orchestra.run.smithi155.stdout: "time": "2023-08-01T19:55:05.576784+0000", 2023-08-01T19:55:22.745 INFO:teuthology.orchestra.run.smithi155.stdout: "duration": 0 2023-08-01T19:55:22.745 INFO:teuthology.orchestra.run.smithi155.stdout: }, 2023-08-01T19:55:22.745 INFO:teuthology.orchestra.run.smithi155.stdout: { 2023-08-01T19:55:22.745 INFO:teuthology.orchestra.run.smithi155.stdout: "event": "throttled", 2023-08-01T19:55:22.746 INFO:teuthology.orchestra.run.smithi155.stdout: "time": "2023-08-01T19:55:05.576784+0000", 2023-08-01T19:55:22.746 INFO:teuthology.orchestra.run.smithi155.stdout: "duration": 0 2023-08-01T19:55:22.746 INFO:teuthology.orchestra.run.smithi155.stdout: }, 2023-08-01T19:55:22.746 INFO:teuthology.orchestra.run.smithi155.stdout: { 2023-08-01T19:55:22.746 INFO:teuthology.orchestra.run.smithi155.stdout: "event": "header_read", 2023-08-01T19:55:22.746 INFO:teuthology.orchestra.run.smithi155.stdout: "time": "2023-08-01T19:55:05.576783+0000", 2023-08-01T19:55:22.746 INFO:teuthology.orchestra.run.smithi155.stdout: "duration": 4294967295.9999995 2023-08-01T19:55:22.746 INFO:teuthology.orchestra.run.smithi155.stdout: }, 2023-08-01T19:55:22.747 INFO:teuthology.orchestra.run.smithi155.stdout: { 2023-08-01T19:55:22.747 INFO:teuthology.orchestra.run.smithi155.stdout: "event": "all_read", 2023-08-01T19:55:22.747 INFO:teuthology.orchestra.run.smithi155.stdout: "time": "2023-08-01T19:55:05.576807+0000", 2023-08-01T19:55:22.747 INFO:teuthology.orchestra.run.smithi155.stdout: "duration": 2.3651000000000001e-05 2023-08-01T19:55:22.747 INFO:teuthology.orchestra.run.smithi155.stdout: }, 2023-08-01T19:55:22.747 INFO:teuthology.orchestra.run.smithi155.stdout: { 2023-08-01T19:55:22.747 INFO:teuthology.orchestra.run.smithi155.stdout: "event": "dispatched", 2023-08-01T19:55:22.747 INFO:teuthology.orchestra.run.smithi155.stdout: "time": "2023-08-01T19:55:05.576817+0000", 2023-08-01T19:55:22.748 INFO:teuthology.orchestra.run.smithi155.stdout: "duration": 9.9389999999999992e-06 2023-08-01T19:55:22.748 INFO:teuthology.orchestra.run.smithi155.stdout: }, 2023-08-01T19:55:22.748 INFO:teuthology.orchestra.run.smithi155.stdout: { 2023-08-01T19:55:22.748 INFO:teuthology.orchestra.run.smithi155.stdout: "event": "queued_for_pg", 2023-08-01T19:55:22.748 INFO:teuthology.orchestra.run.smithi155.stdout: "time": "2023-08-01T19:55:05.576820+0000", 2023-08-01T19:55:22.748 INFO:teuthology.orchestra.run.smithi155.stdout: "duration": 3.2619999999999999e-06 2023-08-01T19:55:22.748 INFO:teuthology.orchestra.run.smithi155.stdout: }, 2023-08-01T19:55:22.748 INFO:teuthology.orchestra.run.smithi155.stdout: { 2023-08-01T19:55:22.749 INFO:teuthology.orchestra.run.smithi155.stdout: "event": "reached_pg", 2023-08-01T19:55:22.749 INFO:teuthology.orchestra.run.smithi155.stdout: "time": "2023-08-01T19:55:05.576849+0000", 2023-08-01T19:55:22.749 INFO:teuthology.orchestra.run.smithi155.stdout: "duration": 2.8880000000000001e-05 2023-08-01T19:55:22.749 INFO:teuthology.orchestra.run.smithi155.stdout: }, 2023-08-01T19:55:22.749 INFO:teuthology.orchestra.run.smithi155.stdout: { 2023-08-01T19:55:22.749 INFO:teuthology.orchestra.run.smithi155.stdout: "event": "started", 2023-08-01T19:55:22.749 INFO:teuthology.orchestra.run.smithi155.stdout: "time": "2023-08-01T19:55:05.576940+0000", 2023-08-01T19:55:22.750 INFO:teuthology.orchestra.run.smithi155.stdout: "duration": 9.0570999999999997e-05 2023-08-01T19:55:22.750 INFO:teuthology.orchestra.run.smithi155.stdout: }, 2023-08-01T19:55:22.750 INFO:teuthology.orchestra.run.smithi155.stdout: { 2023-08-01T19:55:22.750 INFO:teuthology.orchestra.run.smithi155.stdout: "event": "waiting for subops from 0", 2023-08-01T19:55:22.750 INFO:teuthology.orchestra.run.smithi155.stdout: "time": "2023-08-01T19:55:05.577027+0000", 2023-08-01T19:55:22.750 INFO:teuthology.orchestra.run.smithi155.stdout: "duration": 8.7237999999999994e-05 2023-08-01T19:55:22.750 INFO:teuthology.orchestra.run.smithi155.stdout: }, 2023-08-01T19:55:22.750 INFO:teuthology.orchestra.run.smithi155.stdout: { 2023-08-01T19:55:22.751 INFO:teuthology.orchestra.run.smithi155.stdout: "event": "op_commit", 2023-08-01T19:55:22.751 INFO:teuthology.orchestra.run.smithi155.stdout: "time": "2023-08-01T19:55:05.579624+0000", 2023-08-01T19:55:22.751 INFO:teuthology.orchestra.run.smithi155.stdout: "duration": 0.0025971200000000001 2023-08-01T19:55:22.751 INFO:teuthology.orchestra.run.smithi155.stdout: }, 2023-08-01T19:55:22.751 INFO:teuthology.orchestra.run.smithi155.stdout: { 2023-08-01T19:55:22.751 INFO:teuthology.orchestra.run.smithi155.stdout: "event": "sub_op_commit_rec", 2023-08-01T19:55:22.751 INFO:teuthology.orchestra.run.smithi155.stdout: "time": "2023-08-01T19:55:05.635218+0000", 2023-08-01T19:55:22.752 INFO:teuthology.orchestra.run.smithi155.stdout: "duration": 0.055594487999999997 2023-08-01T19:55:22.752 INFO:teuthology.orchestra.run.smithi155.stdout: }, 2023-08-01T19:55:22.752 INFO:teuthology.orchestra.run.smithi155.stdout: { 2023-08-01T19:55:22.752 INFO:teuthology.orchestra.run.smithi155.stdout: "event": "commit_sent", 2023-08-01T19:55:22.752 INFO:teuthology.orchestra.run.smithi155.stdout: "time": "2023-08-01T19:55:05.635262+0000", 2023-08-01T19:55:22.752 INFO:teuthology.orchestra.run.smithi155.stdout: "duration": 4.3380999999999997e-05 2023-08-01T19:55:22.752 INFO:teuthology.orchestra.run.smithi155.stdout: }, 2023-08-01T19:55:22.752 INFO:teuthology.orchestra.run.smithi155.stdout: { 2023-08-01T19:55:22.753 INFO:teuthology.orchestra.run.smithi155.stdout: "event": "done", 2023-08-01T19:55:22.753 INFO:teuthology.orchestra.run.smithi155.stdout: "time": "2023-08-01T19:55:05.635297+0000", 2023-08-01T19:55:22.753 INFO:teuthology.orchestra.run.smithi155.stdout: "duration": 3.4842000000000003e-05 2023-08-01T19:55:22.753 INFO:teuthology.orchestra.run.smithi155.stdout: } 2023-08-01T19:55:22.753 INFO:teuthology.orchestra.run.smithi155.stdout: ] 2023-08-01T19:55:22.753 INFO:teuthology.orchestra.run.smithi155.stdout: } 2023-08-01T19:55:22.753 INFO:teuthology.orchestra.run.smithi155.stdout: }, 2023-08-01T19:55:22.754 INFO:teuthology.orchestra.run.smithi155.stdout: { 2023-08-01T19:55:22.754 INFO:teuthology.orchestra.run.smithi155.stdout: "description": "osd_op(client.4668.0:100947 5.4 5:23e8fc27:::benchmark_data_smithi006_114134_object100946:head [set-alloc-hint object_size 65536 write_size 65536,write 0~65536] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e37)", 2023-08-01T19:55:22.754 INFO:teuthology.orchestra.run.smithi155.stdout: "initiated_at": "2023-08-01T19:55:05.576840+0000", 2023-08-01T19:55:22.754 INFO:teuthology.orchestra.run.smithi155.stdout: "age": 16.974587567, 2023-08-01T19:55:22.754 INFO:teuthology.orchestra.run.smithi155.stdout: "duration": 0.058423127999999998, 2023-08-01T19:55:22.754 INFO:teuthology.orchestra.run.smithi155.stdout: "type_data": { 2023-08-01T19:55:22.754 INFO:teuthology.orchestra.run.smithi155.stdout: "flag_point": "commit sent; apply or cleanup", 2023-08-01T19:55:22.754 INFO:teuthology.orchestra.run.smithi155.stdout: "client_info": { 2023-08-01T19:55:22.755 INFO:teuthology.orchestra.run.smithi155.stdout: "client": "client.4668", 2023-08-01T19:55:22.755 INFO:teuthology.orchestra.run.smithi155.stdout: "client_addr": "172.21.15.6:0/1709472247", 2023-08-01T19:55:22.755 INFO:teuthology.orchestra.run.smithi155.stdout: "tid": 100947 2023-08-01T19:55:22.755 INFO:teuthology.orchestra.run.smithi155.stdout: }, 2023-08-01T19:55:22.755 INFO:teuthology.orchestra.run.smithi155.stdout: "events": [ 2023-08-01T19:55:22.755 INFO:teuthology.orchestra.run.smithi155.stdout: { 2023-08-01T19:55:22.755 INFO:teuthology.orchestra.run.smithi155.stdout: "event": "initiated", 2023-08-01T19:55:22.756 INFO:teuthology.orchestra.run.smithi155.stdout: "time": "2023-08-01T19:55:05.576840+0000", 2023-08-01T19:55:22.756 INFO:teuthology.orchestra.run.smithi155.stdout: "duration": 0 2023-08-01T19:55:22.756 INFO:teuthology.orchestra.run.smithi155.stdout: }, 2023-08-01T19:55:22.756 INFO:teuthology.orchestra.run.smithi155.stdout: { 2023-08-01T19:55:22.756 INFO:teuthology.orchestra.run.smithi155.stdout: "event": "throttled", 2023-08-01T19:55:22.756 INFO:teuthology.orchestra.run.smithi155.stdout: "time": "2023-08-01T19:55:05.576840+0000", 2023-08-01T19:55:22.756 INFO:teuthology.orchestra.run.smithi155.stdout: "duration": 0 2023-08-01T19:55:22.757 INFO:teuthology.orchestra.run.smithi155.stdout: }, 2023-08-01T19:55:22.757 INFO:teuthology.orchestra.run.smithi155.stdout: { 2023-08-01T19:55:22.757 INFO:teuthology.orchestra.run.smithi155.stdout: "event": "header_read", 2023-08-01T19:55:22.757 INFO:teuthology.orchestra.run.smithi155.stdout: "time": "2023-08-01T19:55:05.576839+0000", 2023-08-01T19:55:22.757 INFO:teuthology.orchestra.run.smithi155.stdout: "duration": 4294967295.9999995 2023-08-01T19:55:22.757 INFO:teuthology.orchestra.run.smithi155.stdout: }, 2023-08-01T19:55:22.757 INFO:teuthology.orchestra.run.smithi155.stdout: { 2023-08-01T19:55:22.757 INFO:teuthology.orchestra.run.smithi155.stdout: "event": "all_read", 2023-08-01T19:55:22.758 INFO:teuthology.orchestra.run.smithi155.stdout: "time": "2023-08-01T19:55:05.576893+0000", 2023-08-01T19:55:22.758 INFO:teuthology.orchestra.run.smithi155.stdout: "duration": 5.3893000000000001e-05 2023-08-01T19:55:22.758 INFO:teuthology.orchestra.run.smithi155.stdout: }, 2023-08-01T19:55:22.758 INFO:teuthology.orchestra.run.smithi155.stdout: { 2023-08-01T19:55:22.758 INFO:teuthology.orchestra.run.smithi155.stdout: "event": "dispatched", 2023-08-01T19:55:22.758 INFO:teuthology.orchestra.run.smithi155.stdout: "time": "2023-08-01T19:55:05.576902+0000", 2023-08-01T19:55:22.758 INFO:teuthology.orchestra.run.smithi155.stdout: "duration": 8.7520000000000002e-06 2023-08-01T19:55:22.758 INFO:teuthology.orchestra.run.smithi155.stdout: }, 2023-08-01T19:55:22.759 INFO:teuthology.orchestra.run.smithi155.stdout: { 2023-08-01T19:55:22.759 INFO:teuthology.orchestra.run.smithi155.stdout: "event": "queued_for_pg", 2023-08-01T19:55:22.759 INFO:teuthology.orchestra.run.smithi155.stdout: "time": "2023-08-01T19:55:05.576905+0000", 2023-08-01T19:55:22.759 INFO:teuthology.orchestra.run.smithi155.stdout: "duration": 3.01e-06 2023-08-01T19:55:22.759 INFO:teuthology.orchestra.run.smithi155.stdout: }, 2023-08-01T19:55:22.759 INFO:teuthology.orchestra.run.smithi155.stdout: { 2023-08-01T19:55:22.759 INFO:teuthology.orchestra.run.smithi155.stdout: "event": "reached_pg", 2023-08-01T19:55:22.760 INFO:teuthology.orchestra.run.smithi155.stdout: "time": "2023-08-01T19:55:05.579641+0000", 2023-08-01T19:55:22.760 INFO:teuthology.orchestra.run.smithi155.stdout: "duration": 0.0027366880000000001 2023-08-01T19:55:22.760 INFO:teuthology.orchestra.run.smithi155.stdout: }, 2023-08-01T19:55:22.760 INFO:teuthology.orchestra.run.smithi155.stdout: { 2023-08-01T19:55:22.760 INFO:teuthology.orchestra.run.smithi155.stdout: "event": "started", 2023-08-01T19:55:22.760 INFO:teuthology.orchestra.run.smithi155.stdout: "time": "2023-08-01T19:55:05.579734+0000", 2023-08-01T19:55:22.760 INFO:teuthology.orchestra.run.smithi155.stdout: "duration": 9.2590000000000006e-05 2023-08-01T19:55:22.760 INFO:teuthology.orchestra.run.smithi155.stdout: }, 2023-08-01T19:55:22.761 INFO:teuthology.orchestra.run.smithi155.stdout: { 2023-08-01T19:55:22.761 INFO:teuthology.orchestra.run.smithi155.stdout: "event": "waiting for subops from 0", 2023-08-01T19:55:22.761 INFO:teuthology.orchestra.run.smithi155.stdout: "time": "2023-08-01T19:55:05.579825+0000", 2023-08-01T19:55:22.761 INFO:teuthology.orchestra.run.smithi155.stdout: "duration": 9.0964999999999994e-05 2023-08-01T19:55:22.761 INFO:teuthology.orchestra.run.smithi155.stdout: }, 2023-08-01T19:55:22.761 INFO:teuthology.orchestra.run.smithi155.stdout: { 2023-08-01T19:55:22.761 INFO:teuthology.orchestra.run.smithi155.stdout: "event": "op_commit", 2023-08-01T19:55:22.761 INFO:teuthology.orchestra.run.smithi155.stdout: "time": "2023-08-01T19:55:05.585041+0000", 2023-08-01T19:55:22.762 INFO:teuthology.orchestra.run.smithi155.stdout: "duration": 0.0052159670000000002 2023-08-01T19:55:22.762 INFO:teuthology.orchestra.run.smithi155.stdout: }, 2023-08-01T19:55:22.762 INFO:teuthology.orchestra.run.smithi155.stdout: { 2023-08-01T19:55:22.762 INFO:teuthology.orchestra.run.smithi155.stdout: "event": "sub_op_commit_rec", 2023-08-01T19:55:22.762 INFO:teuthology.orchestra.run.smithi155.stdout: "time": "2023-08-01T19:55:05.635199+0000", 2023-08-01T19:55:22.762 INFO:teuthology.orchestra.run.smithi155.stdout: "duration": 0.050158023000000003 2023-08-01T19:55:22.762 INFO:teuthology.orchestra.run.smithi155.stdout: }, 2023-08-01T19:55:22.763 INFO:teuthology.orchestra.run.smithi155.stdout: { 2023-08-01T19:55:22.763 INFO:teuthology.orchestra.run.smithi155.stdout: "event": "commit_sent", 2023-08-01T19:55:22.763 INFO:teuthology.orchestra.run.smithi155.stdout: "time": "2023-08-01T19:55:05.635227+0000", 2023-08-01T19:55:22.763 INFO:teuthology.orchestra.run.smithi155.stdout: "duration": 2.7821e-05 2023-08-01T19:55:22.763 INFO:teuthology.orchestra.run.smithi155.stdout: }, 2023-08-01T19:55:22.763 INFO:teuthology.orchestra.run.smithi155.stdout: { 2023-08-01T19:55:22.763 INFO:teuthology.orchestra.run.smithi155.stdout: "event": "done", 2023-08-01T19:55:22.763 INFO:teuthology.orchestra.run.smithi155.stdout: "time": "2023-08-01T19:55:05.635263+0000", 2023-08-01T19:55:22.764 INFO:teuthology.orchestra.run.smithi155.stdout: "duration": 3.6081000000000002e-05 2023-08-01T19:55:22.764 INFO:teuthology.orchestra.run.smithi155.stdout: } 2023-08-01T19:55:22.764 INFO:teuthology.orchestra.run.smithi155.stdout: ] 2023-08-01T19:55:22.764 INFO:teuthology.orchestra.run.smithi155.stdout: } 2023-08-01T19:55:22.764 INFO:teuthology.orchestra.run.smithi155.stdout: } 2023-08-01T19:55:22.764 INFO:teuthology.orchestra.run.smithi155.stdout: ] 2023-08-01T19:55:22.764 INFO:teuthology.orchestra.run.smithi155.stdout:} 2023-08-01T19:55:22.766 DEBUG:teuthology.orchestra.run.smithi008:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 30 ceph --cluster ceph --admin-daemon /var/run/ceph/ceph-osd.0.asok dump_ops_in_flight 2023-08-01T19:55:22.766 INFO:tasks.ceph.osd.1.smithi101.stderr:2023-08-01T19:55:22.764+0000 7fb0cb7f6700 -1 received signal: Hangup from /usr/bin/python3 /bin/daemon-helper kill ceph-osd -f --cluster ceph -i 1 (PID: 111141) UID: 0 2023-08-01T19:55:22.866 INFO:tasks.ceph.osd.0.smithi008.stderr:2023-08-01T19:55:22.864+0000 7f16a58f4700 -1 received signal: Hangup from /usr/bin/python3 /bin/daemon-helper kill ceph-osd -f --cluster ceph -i 0 (PID: 111179) UID: 0 2023-08-01T19:55:22.952 INFO:teuthology.orchestra.run.smithi008.stdout:{ 2023-08-01T19:55:22.952 INFO:teuthology.orchestra.run.smithi008.stdout: "ops": [ 2023-08-01T19:55:22.952 INFO:teuthology.orchestra.run.smithi008.stdout: { 2023-08-01T19:55:22.952 INFO:teuthology.orchestra.run.smithi008.stdout: "description": "osd_repop(client.4668.0:131163 5.8 e45/19 5:1fc1f2f3:::benchmark_data_smithi006_114134_object131162:head v 45'8243, mlcod=45'8240)", 2023-08-01T19:55:22.953 INFO:teuthology.orchestra.run.smithi008.stdout: "initiated_at": "2023-08-01T19:55:22.945293+0000", 2023-08-01T19:55:22.953 INFO:teuthology.orchestra.run.smithi008.stdout: "age": 0.0021367309999999998, 2023-08-01T19:55:22.953 INFO:teuthology.orchestra.run.smithi008.stdout: "duration": 0.0021751209999999999, 2023-08-01T19:55:22.953 INFO:teuthology.orchestra.run.smithi008.stdout: "type_data": { 2023-08-01T19:55:22.953 INFO:teuthology.orchestra.run.smithi008.stdout: "flag_point": "started", 2023-08-01T19:55:22.953 INFO:teuthology.orchestra.run.smithi008.stdout: "events": [ 2023-08-01T19:55:22.953 INFO:teuthology.orchestra.run.smithi008.stdout: { 2023-08-01T19:55:22.953 INFO:teuthology.orchestra.run.smithi008.stdout: "event": "initiated", 2023-08-01T19:55:22.954 INFO:teuthology.orchestra.run.smithi008.stdout: "time": "2023-08-01T19:55:22.945293+0000", 2023-08-01T19:55:22.954 INFO:teuthology.orchestra.run.smithi008.stdout: "duration": 0 2023-08-01T19:55:22.954 INFO:teuthology.orchestra.run.smithi008.stdout: }, 2023-08-01T19:55:22.954 INFO:teuthology.orchestra.run.smithi008.stdout: { 2023-08-01T19:55:22.954 INFO:teuthology.orchestra.run.smithi008.stdout: "event": "throttled", 2023-08-01T19:55:22.954 INFO:teuthology.orchestra.run.smithi008.stdout: "time": "2023-08-01T19:55:22.945293+0000", 2023-08-01T19:55:22.954 INFO:teuthology.orchestra.run.smithi008.stdout: "duration": 0 2023-08-01T19:55:22.955 INFO:teuthology.orchestra.run.smithi008.stdout: }, 2023-08-01T19:55:22.955 INFO:teuthology.orchestra.run.smithi008.stdout: { 2023-08-01T19:55:22.955 INFO:teuthology.orchestra.run.smithi008.stdout: "event": "header_read", 2023-08-01T19:55:22.955 INFO:teuthology.orchestra.run.smithi008.stdout: "time": "2023-08-01T19:55:22.945293+0000", 2023-08-01T19:55:22.955 INFO:teuthology.orchestra.run.smithi008.stdout: "duration": 4294967295.9999995 2023-08-01T19:55:22.955 INFO:teuthology.orchestra.run.smithi008.stdout: }, 2023-08-01T19:55:22.955 INFO:teuthology.orchestra.run.smithi008.stdout: { 2023-08-01T19:55:22.956 INFO:teuthology.orchestra.run.smithi008.stdout: "event": "all_read", 2023-08-01T19:55:22.956 INFO:teuthology.orchestra.run.smithi008.stdout: "time": "2023-08-01T19:55:22.945363+0000", 2023-08-01T19:55:22.956 INFO:teuthology.orchestra.run.smithi008.stdout: "duration": 7.0675999999999999e-05 2023-08-01T19:55:22.956 INFO:teuthology.orchestra.run.smithi008.stdout: }, 2023-08-01T19:55:22.956 INFO:teuthology.orchestra.run.smithi008.stdout: { 2023-08-01T19:55:22.956 INFO:teuthology.orchestra.run.smithi008.stdout: "event": "dispatched", 2023-08-01T19:55:22.956 INFO:teuthology.orchestra.run.smithi008.stdout: "time": "2023-08-01T19:55:22.945380+0000", 2023-08-01T19:55:22.957 INFO:teuthology.orchestra.run.smithi008.stdout: "duration": 1.6789000000000001e-05 2023-08-01T19:55:22.957 INFO:teuthology.orchestra.run.smithi008.stdout: }, 2023-08-01T19:55:22.957 INFO:teuthology.orchestra.run.smithi008.stdout: { 2023-08-01T19:55:22.957 INFO:teuthology.orchestra.run.smithi008.stdout: "event": "queued_for_pg", 2023-08-01T19:55:22.957 INFO:teuthology.orchestra.run.smithi008.stdout: "time": "2023-08-01T19:55:22.945386+0000", 2023-08-01T19:55:22.957 INFO:teuthology.orchestra.run.smithi008.stdout: "duration": 6.2820000000000002e-06 2023-08-01T19:55:22.957 INFO:teuthology.orchestra.run.smithi008.stdout: }, 2023-08-01T19:55:22.957 INFO:teuthology.orchestra.run.smithi008.stdout: { 2023-08-01T19:55:22.958 INFO:teuthology.orchestra.run.smithi008.stdout: "event": "reached_pg", 2023-08-01T19:55:22.958 INFO:teuthology.orchestra.run.smithi008.stdout: "time": "2023-08-01T19:55:22.946556+0000", 2023-08-01T19:55:22.958 INFO:teuthology.orchestra.run.smithi008.stdout: "duration": 0.001169771 2023-08-01T19:55:22.958 INFO:teuthology.orchestra.run.smithi008.stdout: }, 2023-08-01T19:55:22.958 INFO:teuthology.orchestra.run.smithi008.stdout: { 2023-08-01T19:55:22.958 INFO:teuthology.orchestra.run.smithi008.stdout: "event": "started", 2023-08-01T19:55:22.958 INFO:teuthology.orchestra.run.smithi008.stdout: "time": "2023-08-01T19:55:22.946569+0000", 2023-08-01T19:55:22.958 INFO:teuthology.orchestra.run.smithi008.stdout: "duration": 1.2765999999999999e-05 2023-08-01T19:55:22.959 INFO:teuthology.orchestra.run.smithi008.stdout: } 2023-08-01T19:55:22.959 INFO:teuthology.orchestra.run.smithi008.stdout: ] 2023-08-01T19:55:22.959 INFO:teuthology.orchestra.run.smithi008.stdout: } 2023-08-01T19:55:22.959 INFO:teuthology.orchestra.run.smithi008.stdout: }, 2023-08-01T19:55:22.959 INFO:teuthology.orchestra.run.smithi008.stdout: { 2023-08-01T19:55:22.959 INFO:teuthology.orchestra.run.smithi008.stdout: "description": "osd_repop(client.4668.0:131155 5.0 e45/19 5:0229dca4:::benchmark_data_smithi006_114134_object131154:head v 45'8327, mlcod=45'8325)", 2023-08-01T19:55:22.959 INFO:teuthology.orchestra.run.smithi008.stdout: "initiated_at": "2023-08-01T19:55:22.940304+0000", 2023-08-01T19:55:22.959 INFO:teuthology.orchestra.run.smithi008.stdout: "age": 0.0071264220000000003, 2023-08-01T19:55:22.960 INFO:teuthology.orchestra.run.smithi008.stdout: "duration": 0.0072810239999999997, 2023-08-01T19:55:22.960 INFO:teuthology.orchestra.run.smithi008.stdout: "type_data": { 2023-08-01T19:55:22.960 INFO:teuthology.orchestra.run.smithi008.stdout: "flag_point": "started", 2023-08-01T19:55:22.960 INFO:teuthology.orchestra.run.smithi008.stdout: "events": [ 2023-08-01T19:55:22.960 INFO:teuthology.orchestra.run.smithi008.stdout: { 2023-08-01T19:55:22.960 INFO:teuthology.orchestra.run.smithi008.stdout: "event": "initiated", 2023-08-01T19:55:22.960 INFO:teuthology.orchestra.run.smithi008.stdout: "time": "2023-08-01T19:55:22.940304+0000", 2023-08-01T19:55:22.961 INFO:teuthology.orchestra.run.smithi008.stdout: "duration": 0 2023-08-01T19:55:22.961 INFO:teuthology.orchestra.run.smithi008.stdout: }, 2023-08-01T19:55:22.961 INFO:teuthology.orchestra.run.smithi008.stdout: { 2023-08-01T19:55:22.961 INFO:teuthology.orchestra.run.smithi008.stdout: "event": "throttled", 2023-08-01T19:55:22.961 INFO:teuthology.orchestra.run.smithi008.stdout: "time": "2023-08-01T19:55:22.940304+0000", 2023-08-01T19:55:22.961 INFO:teuthology.orchestra.run.smithi008.stdout: "duration": 0 2023-08-01T19:55:22.961 INFO:teuthology.orchestra.run.smithi008.stdout: }, 2023-08-01T19:55:22.961 INFO:teuthology.orchestra.run.smithi008.stdout: { 2023-08-01T19:55:22.962 INFO:teuthology.orchestra.run.smithi008.stdout: "event": "header_read", 2023-08-01T19:55:22.962 INFO:teuthology.orchestra.run.smithi008.stdout: "time": "2023-08-01T19:55:22.940303+0000", 2023-08-01T19:55:22.962 INFO:teuthology.orchestra.run.smithi008.stdout: "duration": 4294967295.9999995 2023-08-01T19:55:22.962 INFO:teuthology.orchestra.run.smithi008.stdout: }, 2023-08-01T19:55:22.962 INFO:teuthology.orchestra.run.smithi008.stdout: { 2023-08-01T19:55:22.962 INFO:teuthology.orchestra.run.smithi008.stdout: "event": "all_read", 2023-08-01T19:55:22.962 INFO:teuthology.orchestra.run.smithi008.stdout: "time": "2023-08-01T19:55:22.940437+0000", 2023-08-01T19:55:22.962 INFO:teuthology.orchestra.run.smithi008.stdout: "duration": 0.000133886 2023-08-01T19:55:22.963 INFO:teuthology.orchestra.run.smithi008.stdout: }, 2023-08-01T19:55:22.963 INFO:teuthology.orchestra.run.smithi008.stdout: { 2023-08-01T19:55:22.963 INFO:teuthology.orchestra.run.smithi008.stdout: "event": "dispatched", 2023-08-01T19:55:22.963 INFO:teuthology.orchestra.run.smithi008.stdout: "time": "2023-08-01T19:55:22.940448+0000", 2023-08-01T19:55:22.963 INFO:teuthology.orchestra.run.smithi008.stdout: "duration": 1.0910000000000001e-05 2023-08-01T19:55:22.963 INFO:teuthology.orchestra.run.smithi008.stdout: }, 2023-08-01T19:55:22.963 INFO:teuthology.orchestra.run.smithi008.stdout: { 2023-08-01T19:55:22.963 INFO:teuthology.orchestra.run.smithi008.stdout: "event": "queued_for_pg", 2023-08-01T19:55:22.964 INFO:teuthology.orchestra.run.smithi008.stdout: "time": "2023-08-01T19:55:22.940453+0000", 2023-08-01T19:55:22.964 INFO:teuthology.orchestra.run.smithi008.stdout: "duration": 5.507e-06 2023-08-01T19:55:22.964 INFO:teuthology.orchestra.run.smithi008.stdout: }, 2023-08-01T19:55:22.964 INFO:teuthology.orchestra.run.smithi008.stdout: { 2023-08-01T19:55:22.964 INFO:teuthology.orchestra.run.smithi008.stdout: "event": "reached_pg", 2023-08-01T19:55:22.964 INFO:teuthology.orchestra.run.smithi008.stdout: "time": "2023-08-01T19:55:22.940501+0000", 2023-08-01T19:55:22.964 INFO:teuthology.orchestra.run.smithi008.stdout: "duration": 4.7744999999999998e-05 2023-08-01T19:55:22.965 INFO:teuthology.orchestra.run.smithi008.stdout: }, 2023-08-01T19:55:22.965 INFO:teuthology.orchestra.run.smithi008.stdout: { 2023-08-01T19:55:22.965 INFO:teuthology.orchestra.run.smithi008.stdout: "event": "started", 2023-08-01T19:55:22.965 INFO:teuthology.orchestra.run.smithi008.stdout: "time": "2023-08-01T19:55:22.940521+0000", 2023-08-01T19:55:22.965 INFO:teuthology.orchestra.run.smithi008.stdout: "duration": 1.9556999999999999e-05 2023-08-01T19:55:22.965 INFO:teuthology.orchestra.run.smithi008.stdout: } 2023-08-01T19:55:22.965 INFO:teuthology.orchestra.run.smithi008.stdout: ] 2023-08-01T19:55:22.965 INFO:teuthology.orchestra.run.smithi008.stdout: } 2023-08-01T19:55:22.966 INFO:teuthology.orchestra.run.smithi008.stdout: }, 2023-08-01T19:55:22.966 INFO:teuthology.orchestra.run.smithi008.stdout: { 2023-08-01T19:55:22.966 INFO:teuthology.orchestra.run.smithi008.stdout: "description": "osd_op(client.4668.0:131153 5.5 5:a61ab75c:::benchmark_data_smithi006_114134_object131152:head [set-alloc-hint object_size 65536 write_size 65536,write 0~65536 in=65536b] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e45)", 2023-08-01T19:55:22.966 INFO:teuthology.orchestra.run.smithi008.stdout: "initiated_at": "2023-08-01T19:55:22.941701+0000", 2023-08-01T19:55:22.966 INFO:teuthology.orchestra.run.smithi008.stdout: "age": 0.005728721, 2023-08-01T19:55:22.966 INFO:teuthology.orchestra.run.smithi008.stdout: "duration": 0.0059729199999999996, 2023-08-01T19:55:22.966 INFO:teuthology.orchestra.run.smithi008.stdout: "type_data": { 2023-08-01T19:55:22.966 INFO:teuthology.orchestra.run.smithi008.stdout: "flag_point": "waiting for sub ops", 2023-08-01T19:55:22.967 INFO:teuthology.orchestra.run.smithi008.stdout: "client_info": { 2023-08-01T19:55:22.967 INFO:teuthology.orchestra.run.smithi008.stdout: "client": "client.4668", 2023-08-01T19:55:22.967 INFO:teuthology.orchestra.run.smithi008.stdout: "client_addr": "172.21.15.6:0/1709472247", 2023-08-01T19:55:22.967 INFO:teuthology.orchestra.run.smithi008.stdout: "tid": 131153 2023-08-01T19:55:22.967 INFO:teuthology.orchestra.run.smithi008.stdout: }, 2023-08-01T19:55:22.967 INFO:teuthology.orchestra.run.smithi008.stdout: "events": [ 2023-08-01T19:55:22.967 INFO:teuthology.orchestra.run.smithi008.stdout: { 2023-08-01T19:55:22.968 INFO:teuthology.orchestra.run.smithi008.stdout: "event": "initiated", 2023-08-01T19:55:22.968 INFO:teuthology.orchestra.run.smithi008.stdout: "time": "2023-08-01T19:55:22.941701+0000", 2023-08-01T19:55:22.968 INFO:teuthology.orchestra.run.smithi008.stdout: "duration": 0 2023-08-01T19:55:22.968 INFO:teuthology.orchestra.run.smithi008.stdout: }, 2023-08-01T19:55:22.968 INFO:teuthology.orchestra.run.smithi008.stdout: { 2023-08-01T19:55:22.968 INFO:teuthology.orchestra.run.smithi008.stdout: "event": "throttled", 2023-08-01T19:55:22.968 INFO:teuthology.orchestra.run.smithi008.stdout: "time": "2023-08-01T19:55:22.941701+0000", 2023-08-01T19:55:22.968 INFO:teuthology.orchestra.run.smithi008.stdout: "duration": 0 2023-08-01T19:55:22.969 INFO:teuthology.orchestra.run.smithi008.stdout: }, 2023-08-01T19:55:22.969 INFO:teuthology.orchestra.run.smithi008.stdout: { 2023-08-01T19:55:22.969 INFO:teuthology.orchestra.run.smithi008.stdout: "event": "header_read", 2023-08-01T19:55:22.969 INFO:teuthology.orchestra.run.smithi008.stdout: "time": "2023-08-01T19:55:22.941701+0000", 2023-08-01T19:55:22.969 INFO:teuthology.orchestra.run.smithi008.stdout: "duration": 4294967295.9999995 2023-08-01T19:55:22.969 INFO:teuthology.orchestra.run.smithi008.stdout: }, 2023-08-01T19:55:22.969 INFO:teuthology.orchestra.run.smithi008.stdout: { 2023-08-01T19:55:22.970 INFO:teuthology.orchestra.run.smithi008.stdout: "event": "all_read", 2023-08-01T19:55:22.970 INFO:teuthology.orchestra.run.smithi008.stdout: "time": "2023-08-01T19:55:22.941724+0000", 2023-08-01T19:55:22.970 INFO:teuthology.orchestra.run.smithi008.stdout: "duration": 2.3493999999999999e-05 2023-08-01T19:55:22.970 INFO:teuthology.orchestra.run.smithi008.stdout: }, 2023-08-01T19:55:22.970 INFO:teuthology.orchestra.run.smithi008.stdout: { 2023-08-01T19:55:22.970 INFO:teuthology.orchestra.run.smithi008.stdout: "event": "dispatched", 2023-08-01T19:55:22.970 INFO:teuthology.orchestra.run.smithi008.stdout: "time": "2023-08-01T19:55:22.941732+0000", 2023-08-01T19:55:22.970 INFO:teuthology.orchestra.run.smithi008.stdout: "duration": 7.7919999999999993e-06 2023-08-01T19:55:22.971 INFO:teuthology.orchestra.run.smithi008.stdout: }, 2023-08-01T19:55:22.971 INFO:teuthology.orchestra.run.smithi008.stdout: { 2023-08-01T19:55:22.971 INFO:teuthology.orchestra.run.smithi008.stdout: "event": "queued_for_pg", 2023-08-01T19:55:22.971 INFO:teuthology.orchestra.run.smithi008.stdout: "time": "2023-08-01T19:55:22.941736+0000", 2023-08-01T19:55:22.971 INFO:teuthology.orchestra.run.smithi008.stdout: "duration": 4.0999999999999997e-06 2023-08-01T19:55:22.971 INFO:teuthology.orchestra.run.smithi008.stdout: }, 2023-08-01T19:55:22.971 INFO:teuthology.orchestra.run.smithi008.stdout: { 2023-08-01T19:55:22.972 INFO:teuthology.orchestra.run.smithi008.stdout: "event": "reached_pg", 2023-08-01T19:55:22.972 INFO:teuthology.orchestra.run.smithi008.stdout: "time": "2023-08-01T19:55:22.941777+0000", 2023-08-01T19:55:22.972 INFO:teuthology.orchestra.run.smithi008.stdout: "duration": 4.0649000000000003e-05 2023-08-01T19:55:22.972 INFO:teuthology.orchestra.run.smithi008.stdout: }, 2023-08-01T19:55:22.972 INFO:teuthology.orchestra.run.smithi008.stdout: { 2023-08-01T19:55:22.972 INFO:teuthology.orchestra.run.smithi008.stdout: "event": "started", 2023-08-01T19:55:22.972 INFO:teuthology.orchestra.run.smithi008.stdout: "time": "2023-08-01T19:55:22.941903+0000", 2023-08-01T19:55:22.972 INFO:teuthology.orchestra.run.smithi008.stdout: "duration": 0.00012611600000000001 2023-08-01T19:55:22.973 INFO:teuthology.orchestra.run.smithi008.stdout: }, 2023-08-01T19:55:22.973 INFO:teuthology.orchestra.run.smithi008.stdout: { 2023-08-01T19:55:22.973 INFO:teuthology.orchestra.run.smithi008.stdout: "event": "waiting for subops from 1", 2023-08-01T19:55:22.973 INFO:teuthology.orchestra.run.smithi008.stdout: "time": "2023-08-01T19:55:22.942086+0000", 2023-08-01T19:55:22.973 INFO:teuthology.orchestra.run.smithi008.stdout: "duration": 0.00018280799999999999 2023-08-01T19:55:22.973 INFO:teuthology.orchestra.run.smithi008.stdout: }, 2023-08-01T19:55:22.973 INFO:teuthology.orchestra.run.smithi008.stdout: { 2023-08-01T19:55:22.973 INFO:teuthology.orchestra.run.smithi008.stdout: "event": "op_commit", 2023-08-01T19:55:22.974 INFO:teuthology.orchestra.run.smithi008.stdout: "time": "2023-08-01T19:55:22.947061+0000", 2023-08-01T19:55:22.974 INFO:teuthology.orchestra.run.smithi008.stdout: "duration": 0.0049757999999999998 2023-08-01T19:55:22.974 INFO:teuthology.orchestra.run.smithi008.stdout: } 2023-08-01T19:55:22.974 INFO:teuthology.orchestra.run.smithi008.stdout: ] 2023-08-01T19:55:22.974 INFO:teuthology.orchestra.run.smithi008.stdout: } 2023-08-01T19:55:22.974 INFO:teuthology.orchestra.run.smithi008.stdout: }, 2023-08-01T19:55:22.974 INFO:teuthology.orchestra.run.smithi008.stdout: { 2023-08-01T19:55:22.974 INFO:teuthology.orchestra.run.smithi008.stdout: "description": "osd_op(client.4668.0:131154 5.2 5:4d5ca6ec:::benchmark_data_smithi006_114134_object131153:head [set-alloc-hint object_size 65536 write_size 65536,write 0~65536 in=65536b] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e45)", 2023-08-01T19:55:22.975 INFO:teuthology.orchestra.run.smithi008.stdout: "initiated_at": "2023-08-01T19:55:22.941746+0000", 2023-08-01T19:55:22.975 INFO:teuthology.orchestra.run.smithi008.stdout: "age": 0.0056837540000000001, 2023-08-01T19:55:22.975 INFO:teuthology.orchestra.run.smithi008.stdout: "duration": 0.0060320749999999996, 2023-08-01T19:55:22.975 INFO:teuthology.orchestra.run.smithi008.stdout: "type_data": { 2023-08-01T19:55:22.975 INFO:teuthology.orchestra.run.smithi008.stdout: "flag_point": "waiting for sub ops", 2023-08-01T19:55:22.975 INFO:teuthology.orchestra.run.smithi008.stdout: "client_info": { 2023-08-01T19:55:22.975 INFO:teuthology.orchestra.run.smithi008.stdout: "client": "client.4668", 2023-08-01T19:55:22.976 INFO:teuthology.orchestra.run.smithi008.stdout: "client_addr": "172.21.15.6:0/1709472247", 2023-08-01T19:55:22.976 INFO:teuthology.orchestra.run.smithi008.stdout: "tid": 131154 2023-08-01T19:55:22.976 INFO:teuthology.orchestra.run.smithi008.stdout: }, 2023-08-01T19:55:22.976 INFO:teuthology.orchestra.run.smithi008.stdout: "events": [ 2023-08-01T19:55:22.976 INFO:teuthology.orchestra.run.smithi008.stdout: { 2023-08-01T19:55:22.976 INFO:teuthology.orchestra.run.smithi008.stdout: "event": "initiated", 2023-08-01T19:55:22.976 INFO:teuthology.orchestra.run.smithi008.stdout: "time": "2023-08-01T19:55:22.941746+0000", 2023-08-01T19:55:22.976 INFO:teuthology.orchestra.run.smithi008.stdout: "duration": 0 2023-08-01T19:55:22.977 INFO:teuthology.orchestra.run.smithi008.stdout: }, 2023-08-01T19:55:22.977 INFO:teuthology.orchestra.run.smithi008.stdout: { 2023-08-01T19:55:22.977 INFO:teuthology.orchestra.run.smithi008.stdout: "event": "throttled", 2023-08-01T19:55:22.977 INFO:teuthology.orchestra.run.smithi008.stdout: "time": "2023-08-01T19:55:22.941746+0000", 2023-08-01T19:55:22.977 INFO:teuthology.orchestra.run.smithi008.stdout: "duration": 0 2023-08-01T19:55:22.977 INFO:teuthology.orchestra.run.smithi008.stdout: }, 2023-08-01T19:55:22.977 INFO:teuthology.orchestra.run.smithi008.stdout: { 2023-08-01T19:55:22.978 INFO:teuthology.orchestra.run.smithi008.stdout: "event": "header_read", 2023-08-01T19:55:22.978 INFO:teuthology.orchestra.run.smithi008.stdout: "time": "2023-08-01T19:55:22.941746+0000", 2023-08-01T19:55:22.978 INFO:teuthology.orchestra.run.smithi008.stdout: "duration": 4294967295.9999995 2023-08-01T19:55:22.978 INFO:teuthology.orchestra.run.smithi008.stdout: }, 2023-08-01T19:55:22.978 INFO:teuthology.orchestra.run.smithi008.stdout: { 2023-08-01T19:55:22.978 INFO:teuthology.orchestra.run.smithi008.stdout: "event": "all_read", 2023-08-01T19:55:22.978 INFO:teuthology.orchestra.run.smithi008.stdout: "time": "2023-08-01T19:55:22.941765+0000", 2023-08-01T19:55:22.978 INFO:teuthology.orchestra.run.smithi008.stdout: "duration": 1.9479000000000001e-05 2023-08-01T19:55:22.979 INFO:teuthology.orchestra.run.smithi008.stdout: }, 2023-08-01T19:55:22.979 INFO:teuthology.orchestra.run.smithi008.stdout: { 2023-08-01T19:55:22.979 INFO:teuthology.orchestra.run.smithi008.stdout: "event": "dispatched", 2023-08-01T19:55:22.979 INFO:teuthology.orchestra.run.smithi008.stdout: "time": "2023-08-01T19:55:22.941770+0000", 2023-08-01T19:55:22.979 INFO:teuthology.orchestra.run.smithi008.stdout: "duration": 4.532e-06 2023-08-01T19:55:22.979 INFO:teuthology.orchestra.run.smithi008.stdout: }, 2023-08-01T19:55:22.979 INFO:teuthology.orchestra.run.smithi008.stdout: { 2023-08-01T19:55:22.979 INFO:teuthology.orchestra.run.smithi008.stdout: "event": "queued_for_pg", 2023-08-01T19:55:22.980 INFO:teuthology.orchestra.run.smithi008.stdout: "time": "2023-08-01T19:55:22.941773+0000", 2023-08-01T19:55:22.980 INFO:teuthology.orchestra.run.smithi008.stdout: "duration": 2.774e-06 2023-08-01T19:55:22.980 INFO:teuthology.orchestra.run.smithi008.stdout: }, 2023-08-01T19:55:22.980 INFO:teuthology.orchestra.run.smithi008.stdout: { 2023-08-01T19:55:22.980 INFO:teuthology.orchestra.run.smithi008.stdout: "event": "reached_pg", 2023-08-01T19:55:22.980 INFO:teuthology.orchestra.run.smithi008.stdout: "time": "2023-08-01T19:55:22.941808+0000", 2023-08-01T19:55:22.980 INFO:teuthology.orchestra.run.smithi008.stdout: "duration": 3.5003999999999999e-05 2023-08-01T19:55:22.981 INFO:teuthology.orchestra.run.smithi008.stdout: }, 2023-08-01T19:55:22.981 INFO:teuthology.orchestra.run.smithi008.stdout: { 2023-08-01T19:55:22.981 INFO:teuthology.orchestra.run.smithi008.stdout: "event": "started", 2023-08-01T19:55:22.981 INFO:teuthology.orchestra.run.smithi008.stdout: "time": "2023-08-01T19:55:22.941923+0000", 2023-08-01T19:55:22.981 INFO:teuthology.orchestra.run.smithi008.stdout: "duration": 0.000115361 2023-08-01T19:55:22.981 INFO:teuthology.orchestra.run.smithi008.stdout: }, 2023-08-01T19:55:22.981 INFO:teuthology.orchestra.run.smithi008.stdout: { 2023-08-01T19:55:22.981 INFO:teuthology.orchestra.run.smithi008.stdout: "event": "waiting for subops from 1", 2023-08-01T19:55:22.982 INFO:teuthology.orchestra.run.smithi008.stdout: "time": "2023-08-01T19:55:22.942043+0000", 2023-08-01T19:55:22.982 INFO:teuthology.orchestra.run.smithi008.stdout: "duration": 0.000119376 2023-08-01T19:55:22.982 INFO:teuthology.orchestra.run.smithi008.stdout: }, 2023-08-01T19:55:22.982 INFO:teuthology.orchestra.run.smithi008.stdout: { 2023-08-01T19:55:22.982 INFO:teuthology.orchestra.run.smithi008.stdout: "event": "op_commit", 2023-08-01T19:55:22.982 INFO:teuthology.orchestra.run.smithi008.stdout: "time": "2023-08-01T19:55:22.947041+0000", 2023-08-01T19:55:22.982 INFO:teuthology.orchestra.run.smithi008.stdout: "duration": 0.0049982999999999998 2023-08-01T19:55:22.982 INFO:teuthology.orchestra.run.smithi008.stdout: } 2023-08-01T19:55:22.983 INFO:teuthology.orchestra.run.smithi008.stdout: ] 2023-08-01T19:55:22.983 INFO:teuthology.orchestra.run.smithi008.stdout: } 2023-08-01T19:55:22.983 INFO:teuthology.orchestra.run.smithi008.stdout: }, 2023-08-01T19:55:22.983 INFO:teuthology.orchestra.run.smithi008.stdout: { 2023-08-01T19:55:22.983 INFO:teuthology.orchestra.run.smithi008.stdout: "description": "osd_op(client.4668.0:131158 5.2 5:4e3f326e:::benchmark_data_smithi006_114134_object131157:head [set-alloc-hint object_size 65536 write_size 65536,write 0~65536 in=65536b] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e45)", 2023-08-01T19:55:22.983 INFO:teuthology.orchestra.run.smithi008.stdout: "initiated_at": "2023-08-01T19:55:22.941986+0000", 2023-08-01T19:55:22.983 INFO:teuthology.orchestra.run.smithi008.stdout: "age": 0.0054442270000000003, 2023-08-01T19:55:22.983 INFO:teuthology.orchestra.run.smithi008.stdout: "duration": 0.0058868970000000003, 2023-08-01T19:55:22.984 INFO:teuthology.orchestra.run.smithi008.stdout: "type_data": { 2023-08-01T19:55:22.984 INFO:teuthology.orchestra.run.smithi008.stdout: "flag_point": "waiting for sub ops", 2023-08-01T19:55:22.984 INFO:teuthology.orchestra.run.smithi008.stdout: "client_info": { 2023-08-01T19:55:22.984 INFO:teuthology.orchestra.run.smithi008.stdout: "client": "client.4668", 2023-08-01T19:55:22.984 INFO:teuthology.orchestra.run.smithi008.stdout: "client_addr": "172.21.15.6:0/1709472247", 2023-08-01T19:55:22.984 INFO:teuthology.orchestra.run.smithi008.stdout: "tid": 131158 2023-08-01T19:55:22.984 INFO:teuthology.orchestra.run.smithi008.stdout: }, 2023-08-01T19:55:22.985 INFO:teuthology.orchestra.run.smithi008.stdout: "events": [ 2023-08-01T19:55:22.985 INFO:teuthology.orchestra.run.smithi008.stdout: { 2023-08-01T19:55:22.985 INFO:teuthology.orchestra.run.smithi008.stdout: "event": "initiated", 2023-08-01T19:55:22.985 INFO:teuthology.orchestra.run.smithi008.stdout: "time": "2023-08-01T19:55:22.941986+0000", 2023-08-01T19:55:22.985 INFO:teuthology.orchestra.run.smithi008.stdout: "duration": 0 2023-08-01T19:55:22.985 INFO:teuthology.orchestra.run.smithi008.stdout: }, 2023-08-01T19:55:22.985 INFO:teuthology.orchestra.run.smithi008.stdout: { 2023-08-01T19:55:22.985 INFO:teuthology.orchestra.run.smithi008.stdout: "event": "throttled", 2023-08-01T19:55:22.986 INFO:teuthology.orchestra.run.smithi008.stdout: "time": "2023-08-01T19:55:22.941986+0000", 2023-08-01T19:55:22.986 INFO:teuthology.orchestra.run.smithi008.stdout: "duration": 0 2023-08-01T19:55:22.986 INFO:teuthology.orchestra.run.smithi008.stdout: }, 2023-08-01T19:55:22.986 INFO:teuthology.orchestra.run.smithi008.stdout: { 2023-08-01T19:55:22.986 INFO:teuthology.orchestra.run.smithi008.stdout: "event": "header_read", 2023-08-01T19:55:22.986 INFO:teuthology.orchestra.run.smithi008.stdout: "time": "2023-08-01T19:55:22.941985+0000", 2023-08-01T19:55:22.986 INFO:teuthology.orchestra.run.smithi008.stdout: "duration": 4294967295.999999 2023-08-01T19:55:22.986 INFO:teuthology.orchestra.run.smithi008.stdout: }, 2023-08-01T19:55:22.987 INFO:teuthology.orchestra.run.smithi008.stdout: { 2023-08-01T19:55:22.987 INFO:teuthology.orchestra.run.smithi008.stdout: "event": "all_read", 2023-08-01T19:55:22.987 INFO:teuthology.orchestra.run.smithi008.stdout: "time": "2023-08-01T19:55:22.942069+0000", 2023-08-01T19:55:22.987 INFO:teuthology.orchestra.run.smithi008.stdout: "duration": 8.4343000000000002e-05 2023-08-01T19:55:22.987 INFO:teuthology.orchestra.run.smithi008.stdout: }, 2023-08-01T19:55:22.987 INFO:teuthology.orchestra.run.smithi008.stdout: { 2023-08-01T19:55:22.987 INFO:teuthology.orchestra.run.smithi008.stdout: "event": "dispatched", 2023-08-01T19:55:22.987 INFO:teuthology.orchestra.run.smithi008.stdout: "time": "2023-08-01T19:55:22.942079+0000", 2023-08-01T19:55:22.988 INFO:teuthology.orchestra.run.smithi008.stdout: "duration": 9.8749999999999995e-06 2023-08-01T19:55:22.988 INFO:teuthology.orchestra.run.smithi008.stdout: }, 2023-08-01T19:55:22.988 INFO:teuthology.orchestra.run.smithi008.stdout: { 2023-08-01T19:55:22.988 INFO:teuthology.orchestra.run.smithi008.stdout: "event": "queued_for_pg", 2023-08-01T19:55:22.988 INFO:teuthology.orchestra.run.smithi008.stdout: "time": "2023-08-01T19:55:22.942094+0000", 2023-08-01T19:55:22.988 INFO:teuthology.orchestra.run.smithi008.stdout: "duration": 1.4722999999999999e-05 2023-08-01T19:55:22.988 INFO:teuthology.orchestra.run.smithi008.stdout: }, 2023-08-01T19:55:22.989 INFO:teuthology.orchestra.run.smithi008.stdout: { 2023-08-01T19:55:22.989 INFO:teuthology.orchestra.run.smithi008.stdout: "event": "reached_pg", 2023-08-01T19:55:22.989 INFO:teuthology.orchestra.run.smithi008.stdout: "time": "2023-08-01T19:55:22.943677+0000", 2023-08-01T19:55:22.989 INFO:teuthology.orchestra.run.smithi008.stdout: "duration": 0.0015835440000000001 2023-08-01T19:55:22.989 INFO:teuthology.orchestra.run.smithi008.stdout: }, 2023-08-01T19:55:22.989 INFO:teuthology.orchestra.run.smithi008.stdout: { 2023-08-01T19:55:22.989 INFO:teuthology.orchestra.run.smithi008.stdout: "event": "started", 2023-08-01T19:55:22.989 INFO:teuthology.orchestra.run.smithi008.stdout: "time": "2023-08-01T19:55:22.943775+0000", 2023-08-01T19:55:22.990 INFO:teuthology.orchestra.run.smithi008.stdout: "duration": 9.7188000000000005e-05 2023-08-01T19:55:22.990 INFO:teuthology.orchestra.run.smithi008.stdout: }, 2023-08-01T19:55:22.990 INFO:teuthology.orchestra.run.smithi008.stdout: { 2023-08-01T19:55:22.990 INFO:teuthology.orchestra.run.smithi008.stdout: "event": "waiting for subops from 1", 2023-08-01T19:55:22.990 INFO:teuthology.orchestra.run.smithi008.stdout: "time": "2023-08-01T19:55:22.943857+0000", 2023-08-01T19:55:22.990 INFO:teuthology.orchestra.run.smithi008.stdout: "duration": 8.2065999999999997e-05 2023-08-01T19:55:22.990 INFO:teuthology.orchestra.run.smithi008.stdout: } 2023-08-01T19:55:22.990 INFO:teuthology.orchestra.run.smithi008.stdout: ] 2023-08-01T19:55:22.991 INFO:teuthology.orchestra.run.smithi008.stdout: } 2023-08-01T19:55:22.991 INFO:teuthology.orchestra.run.smithi008.stdout: }, 2023-08-01T19:55:22.991 INFO:teuthology.orchestra.run.smithi008.stdout: { 2023-08-01T19:55:22.991 INFO:teuthology.orchestra.run.smithi008.stdout: "description": "osd_op(client.4668.0:131160 5.c 5:39adc759:::benchmark_data_smithi006_114134_object131159:head [set-alloc-hint object_size 65536 write_size 65536,write 0~65536 in=65536b] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e45)", 2023-08-01T19:55:22.991 INFO:teuthology.orchestra.run.smithi008.stdout: "initiated_at": "2023-08-01T19:55:22.942267+0000", 2023-08-01T19:55:22.991 INFO:teuthology.orchestra.run.smithi008.stdout: "age": 0.0051628969999999996, 2023-08-01T19:55:22.991 INFO:teuthology.orchestra.run.smithi008.stdout: "duration": 0.0056906329999999996, 2023-08-01T19:55:22.991 INFO:teuthology.orchestra.run.smithi008.stdout: "type_data": { 2023-08-01T19:55:22.992 INFO:teuthology.orchestra.run.smithi008.stdout: "flag_point": "waiting for sub ops", 2023-08-01T19:55:22.992 INFO:teuthology.orchestra.run.smithi008.stdout: "client_info": { 2023-08-01T19:55:22.992 INFO:teuthology.orchestra.run.smithi008.stdout: "client": "client.4668", 2023-08-01T19:55:22.992 INFO:teuthology.orchestra.run.smithi008.stdout: "client_addr": "172.21.15.6:0/1709472247", 2023-08-01T19:55:22.992 INFO:teuthology.orchestra.run.smithi008.stdout: "tid": 131160 2023-08-01T19:55:22.992 INFO:teuthology.orchestra.run.smithi008.stdout: }, 2023-08-01T19:55:22.992 INFO:teuthology.orchestra.run.smithi008.stdout: "events": [ 2023-08-01T19:55:22.993 INFO:teuthology.orchestra.run.smithi008.stdout: { 2023-08-01T19:55:22.993 INFO:teuthology.orchestra.run.smithi008.stdout: "event": "initiated", 2023-08-01T19:55:22.993 INFO:teuthology.orchestra.run.smithi008.stdout: "time": "2023-08-01T19:55:22.942267+0000", 2023-08-01T19:55:22.993 INFO:teuthology.orchestra.run.smithi008.stdout: "duration": 0 2023-08-01T19:55:22.993 INFO:teuthology.orchestra.run.smithi008.stdout: }, 2023-08-01T19:55:22.993 INFO:teuthology.orchestra.run.smithi008.stdout: { 2023-08-01T19:55:22.993 INFO:teuthology.orchestra.run.smithi008.stdout: "event": "throttled", 2023-08-01T19:55:22.993 INFO:teuthology.orchestra.run.smithi008.stdout: "time": "2023-08-01T19:55:22.942267+0000", 2023-08-01T19:55:22.994 INFO:teuthology.orchestra.run.smithi008.stdout: "duration": 0 2023-08-01T19:55:22.994 INFO:teuthology.orchestra.run.smithi008.stdout: }, 2023-08-01T19:55:22.994 INFO:teuthology.orchestra.run.smithi008.stdout: { 2023-08-01T19:55:22.994 INFO:teuthology.orchestra.run.smithi008.stdout: "event": "header_read", 2023-08-01T19:55:22.994 INFO:teuthology.orchestra.run.smithi008.stdout: "time": "2023-08-01T19:55:22.942266+0000", 2023-08-01T19:55:22.994 INFO:teuthology.orchestra.run.smithi008.stdout: "duration": 4294967295.999999 2023-08-01T19:55:22.994 INFO:teuthology.orchestra.run.smithi008.stdout: }, 2023-08-01T19:55:22.994 INFO:teuthology.orchestra.run.smithi008.stdout: { 2023-08-01T19:55:22.995 INFO:teuthology.orchestra.run.smithi008.stdout: "event": "all_read", 2023-08-01T19:55:22.995 INFO:teuthology.orchestra.run.smithi008.stdout: "time": "2023-08-01T19:55:22.942332+0000", 2023-08-01T19:55:22.995 INFO:teuthology.orchestra.run.smithi008.stdout: "duration": 6.5497e-05 2023-08-01T19:55:22.995 INFO:teuthology.orchestra.run.smithi008.stdout: }, 2023-08-01T19:55:22.995 INFO:teuthology.orchestra.run.smithi008.stdout: { 2023-08-01T19:55:22.995 INFO:teuthology.orchestra.run.smithi008.stdout: "event": "dispatched", 2023-08-01T19:55:22.995 INFO:teuthology.orchestra.run.smithi008.stdout: "time": "2023-08-01T19:55:22.942344+0000", 2023-08-01T19:55:22.996 INFO:teuthology.orchestra.run.smithi008.stdout: "duration": 1.1878999999999999e-05 2023-08-01T19:55:22.996 INFO:teuthology.orchestra.run.smithi008.stdout: }, 2023-08-01T19:55:22.996 INFO:teuthology.orchestra.run.smithi008.stdout: { 2023-08-01T19:55:22.996 INFO:teuthology.orchestra.run.smithi008.stdout: "event": "queued_for_pg", 2023-08-01T19:55:22.996 INFO:teuthology.orchestra.run.smithi008.stdout: "time": "2023-08-01T19:55:22.942354+0000", 2023-08-01T19:55:22.996 INFO:teuthology.orchestra.run.smithi008.stdout: "duration": 1.0063e-05 2023-08-01T19:55:22.996 INFO:teuthology.orchestra.run.smithi008.stdout: }, 2023-08-01T19:55:22.996 INFO:teuthology.orchestra.run.smithi008.stdout: { 2023-08-01T19:55:22.997 INFO:teuthology.orchestra.run.smithi008.stdout: "event": "reached_pg", 2023-08-01T19:55:22.997 INFO:teuthology.orchestra.run.smithi008.stdout: "time": "2023-08-01T19:55:22.942391+0000", 2023-08-01T19:55:22.997 INFO:teuthology.orchestra.run.smithi008.stdout: "duration": 3.6918999999999997e-05 2023-08-01T19:55:22.997 INFO:teuthology.orchestra.run.smithi008.stdout: }, 2023-08-01T19:55:22.997 INFO:teuthology.orchestra.run.smithi008.stdout: { 2023-08-01T19:55:22.997 INFO:teuthology.orchestra.run.smithi008.stdout: "event": "started", 2023-08-01T19:55:22.997 INFO:teuthology.orchestra.run.smithi008.stdout: "time": "2023-08-01T19:55:22.942520+0000", 2023-08-01T19:55:22.997 INFO:teuthology.orchestra.run.smithi008.stdout: "duration": 0.000129386 2023-08-01T19:55:22.998 INFO:teuthology.orchestra.run.smithi008.stdout: }, 2023-08-01T19:55:22.998 INFO:teuthology.orchestra.run.smithi008.stdout: { 2023-08-01T19:55:22.998 INFO:teuthology.orchestra.run.smithi008.stdout: "event": "waiting for subops from 1", 2023-08-01T19:55:22.998 INFO:teuthology.orchestra.run.smithi008.stdout: "time": "2023-08-01T19:55:22.942696+0000", 2023-08-01T19:55:22.998 INFO:teuthology.orchestra.run.smithi008.stdout: "duration": 0.00017580199999999999 2023-08-01T19:55:22.998 INFO:teuthology.orchestra.run.smithi008.stdout: } 2023-08-01T19:55:22.998 INFO:teuthology.orchestra.run.smithi008.stdout: ] 2023-08-01T19:55:22.998 INFO:teuthology.orchestra.run.smithi008.stdout: } 2023-08-01T19:55:22.999 INFO:teuthology.orchestra.run.smithi008.stdout: }, 2023-08-01T19:55:22.999 INFO:teuthology.orchestra.run.smithi008.stdout: { 2023-08-01T19:55:22.999 INFO:teuthology.orchestra.run.smithi008.stdout: "description": "osd_repop(client.4668.0:131159 5.8 e45/19 5:1f4b775c:::benchmark_data_smithi006_114134_object131158:head v 45'8242, mlcod=45'8240)", 2023-08-01T19:55:22.999 INFO:teuthology.orchestra.run.smithi008.stdout: "initiated_at": "2023-08-01T19:55:22.944173+0000", 2023-08-01T19:55:22.999 INFO:teuthology.orchestra.run.smithi008.stdout: "age": 0.0032566520000000001, 2023-08-01T19:55:22.999 INFO:teuthology.orchestra.run.smithi008.stdout: "duration": 0.0038668510000000001, 2023-08-01T19:55:22.999 INFO:teuthology.orchestra.run.smithi008.stdout: "type_data": { 2023-08-01T19:55:22.999 INFO:teuthology.orchestra.run.smithi008.stdout: "flag_point": "started", 2023-08-01T19:55:23.000 INFO:teuthology.orchestra.run.smithi008.stdout: "events": [ 2023-08-01T19:55:23.000 INFO:teuthology.orchestra.run.smithi008.stdout: { 2023-08-01T19:55:23.000 INFO:teuthology.orchestra.run.smithi008.stdout: "event": "initiated", 2023-08-01T19:55:23.000 INFO:teuthology.orchestra.run.smithi008.stdout: "time": "2023-08-01T19:55:22.944173+0000", 2023-08-01T19:55:23.000 INFO:teuthology.orchestra.run.smithi008.stdout: "duration": 0 2023-08-01T19:55:23.000 INFO:teuthology.orchestra.run.smithi008.stdout: }, 2023-08-01T19:55:23.000 INFO:teuthology.orchestra.run.smithi008.stdout: { 2023-08-01T19:55:23.001 INFO:teuthology.orchestra.run.smithi008.stdout: "event": "throttled", 2023-08-01T19:55:23.001 INFO:teuthology.orchestra.run.smithi008.stdout: "time": "2023-08-01T19:55:22.944173+0000", 2023-08-01T19:55:23.001 INFO:teuthology.orchestra.run.smithi008.stdout: "duration": 0 2023-08-01T19:55:23.001 INFO:teuthology.orchestra.run.smithi008.stdout: }, 2023-08-01T19:55:23.001 INFO:teuthology.orchestra.run.smithi008.stdout: { 2023-08-01T19:55:23.001 INFO:teuthology.orchestra.run.smithi008.stdout: "event": "header_read", 2023-08-01T19:55:23.001 INFO:teuthology.orchestra.run.smithi008.stdout: "time": "2023-08-01T19:55:22.944173+0000", 2023-08-01T19:55:23.001 INFO:teuthology.orchestra.run.smithi008.stdout: "duration": 4294967295.9999995 2023-08-01T19:55:23.002 INFO:teuthology.orchestra.run.smithi008.stdout: }, 2023-08-01T19:55:23.002 INFO:teuthology.orchestra.run.smithi008.stdout: { 2023-08-01T19:55:23.002 INFO:teuthology.orchestra.run.smithi008.stdout: "event": "all_read", 2023-08-01T19:55:23.002 INFO:teuthology.orchestra.run.smithi008.stdout: "time": "2023-08-01T19:55:22.944200+0000", 2023-08-01T19:55:23.002 INFO:teuthology.orchestra.run.smithi008.stdout: "duration": 2.7725999999999998e-05 2023-08-01T19:55:23.002 INFO:teuthology.orchestra.run.smithi008.stdout: }, 2023-08-01T19:55:23.002 INFO:teuthology.orchestra.run.smithi008.stdout: { 2023-08-01T19:55:23.002 INFO:teuthology.orchestra.run.smithi008.stdout: "event": "dispatched", 2023-08-01T19:55:23.003 INFO:teuthology.orchestra.run.smithi008.stdout: "time": "2023-08-01T19:55:22.944219+0000", 2023-08-01T19:55:23.003 INFO:teuthology.orchestra.run.smithi008.stdout: "duration": 1.8658e-05 2023-08-01T19:55:23.003 INFO:teuthology.orchestra.run.smithi008.stdout: }, 2023-08-01T19:55:23.003 INFO:teuthology.orchestra.run.smithi008.stdout: { 2023-08-01T19:55:23.003 INFO:teuthology.orchestra.run.smithi008.stdout: "event": "queued_for_pg", 2023-08-01T19:55:23.003 INFO:teuthology.orchestra.run.smithi008.stdout: "time": "2023-08-01T19:55:22.944225+0000", 2023-08-01T19:55:23.003 INFO:teuthology.orchestra.run.smithi008.stdout: "duration": 5.6659999999999996e-06 2023-08-01T19:55:23.003 INFO:teuthology.orchestra.run.smithi008.stdout: }, 2023-08-01T19:55:23.004 INFO:teuthology.orchestra.run.smithi008.stdout: { 2023-08-01T19:55:23.004 INFO:teuthology.orchestra.run.smithi008.stdout: "event": "reached_pg", 2023-08-01T19:55:23.004 INFO:teuthology.orchestra.run.smithi008.stdout: "time": "2023-08-01T19:55:22.944265+0000", 2023-08-01T19:55:23.004 INFO:teuthology.orchestra.run.smithi008.stdout: "duration": 4.0593999999999998e-05 2023-08-01T19:55:23.004 INFO:teuthology.orchestra.run.smithi008.stdout: }, 2023-08-01T19:55:23.004 INFO:teuthology.orchestra.run.smithi008.stdout: { 2023-08-01T19:55:23.004 INFO:teuthology.orchestra.run.smithi008.stdout: "event": "started", 2023-08-01T19:55:23.004 INFO:teuthology.orchestra.run.smithi008.stdout: "time": "2023-08-01T19:55:22.944286+0000", 2023-08-01T19:55:23.005 INFO:teuthology.orchestra.run.smithi008.stdout: "duration": 2.0662e-05 2023-08-01T19:55:23.005 INFO:teuthology.orchestra.run.smithi008.stdout: } 2023-08-01T19:55:23.005 INFO:teuthology.orchestra.run.smithi008.stdout: ] 2023-08-01T19:55:23.005 INFO:teuthology.orchestra.run.smithi008.stdout: } 2023-08-01T19:55:23.005 INFO:teuthology.orchestra.run.smithi008.stdout: }, 2023-08-01T19:55:23.005 INFO:teuthology.orchestra.run.smithi008.stdout: { 2023-08-01T19:55:23.005 INFO:teuthology.orchestra.run.smithi008.stdout: "description": "osd_op(client.4668.0:131164 5.1 5:85a91dcc:::benchmark_data_smithi006_114134_object131163:head [set-alloc-hint object_size 65536 write_size 65536,write 0~65536 in=65536b] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e45)", 2023-08-01T19:55:23.006 INFO:teuthology.orchestra.run.smithi008.stdout: "initiated_at": "2023-08-01T19:55:22.945209+0000", 2023-08-01T19:55:23.006 INFO:teuthology.orchestra.run.smithi008.stdout: "age": 0.0022207709999999999, 2023-08-01T19:55:23.006 INFO:teuthology.orchestra.run.smithi008.stdout: "duration": 0.002923232, 2023-08-01T19:55:23.006 INFO:teuthology.orchestra.run.smithi008.stdout: "type_data": { 2023-08-01T19:55:23.006 INFO:teuthology.orchestra.run.smithi008.stdout: "flag_point": "waiting for sub ops", 2023-08-01T19:55:23.006 INFO:teuthology.orchestra.run.smithi008.stdout: "client_info": { 2023-08-01T19:55:23.006 INFO:teuthology.orchestra.run.smithi008.stdout: "client": "client.4668", 2023-08-01T19:55:23.006 INFO:teuthology.orchestra.run.smithi008.stdout: "client_addr": "172.21.15.6:0/1709472247", 2023-08-01T19:55:23.007 INFO:teuthology.orchestra.run.smithi008.stdout: "tid": 131164 2023-08-01T19:55:23.007 INFO:teuthology.orchestra.run.smithi008.stdout: }, 2023-08-01T19:55:23.007 INFO:teuthology.orchestra.run.smithi008.stdout: "events": [ 2023-08-01T19:55:23.007 INFO:teuthology.orchestra.run.smithi008.stdout: { 2023-08-01T19:55:23.007 INFO:teuthology.orchestra.run.smithi008.stdout: "event": "initiated", 2023-08-01T19:55:23.007 INFO:teuthology.orchestra.run.smithi008.stdout: "time": "2023-08-01T19:55:22.945209+0000", 2023-08-01T19:55:23.007 INFO:teuthology.orchestra.run.smithi008.stdout: "duration": 0 2023-08-01T19:55:23.007 INFO:teuthology.orchestra.run.smithi008.stdout: }, 2023-08-01T19:55:23.008 INFO:teuthology.orchestra.run.smithi008.stdout: { 2023-08-01T19:55:23.008 INFO:teuthology.orchestra.run.smithi008.stdout: "event": "throttled", 2023-08-01T19:55:23.008 INFO:teuthology.orchestra.run.smithi008.stdout: "time": "2023-08-01T19:55:22.945209+0000", 2023-08-01T19:55:23.008 INFO:teuthology.orchestra.run.smithi008.stdout: "duration": 0 2023-08-01T19:55:23.008 INFO:teuthology.orchestra.run.smithi008.stdout: }, 2023-08-01T19:55:23.008 INFO:teuthology.orchestra.run.smithi008.stdout: { 2023-08-01T19:55:23.008 INFO:teuthology.orchestra.run.smithi008.stdout: "event": "header_read", 2023-08-01T19:55:23.009 INFO:teuthology.orchestra.run.smithi008.stdout: "time": "2023-08-01T19:55:22.945208+0000", 2023-08-01T19:55:23.009 INFO:teuthology.orchestra.run.smithi008.stdout: "duration": 4294967295.999999 2023-08-01T19:55:23.009 INFO:teuthology.orchestra.run.smithi008.stdout: }, 2023-08-01T19:55:23.009 INFO:teuthology.orchestra.run.smithi008.stdout: { 2023-08-01T19:55:23.009 INFO:teuthology.orchestra.run.smithi008.stdout: "event": "all_read", 2023-08-01T19:55:23.009 INFO:teuthology.orchestra.run.smithi008.stdout: "time": "2023-08-01T19:55:22.945254+0000", 2023-08-01T19:55:23.009 INFO:teuthology.orchestra.run.smithi008.stdout: "duration": 4.5365999999999999e-05 2023-08-01T19:55:23.009 INFO:teuthology.orchestra.run.smithi008.stdout: }, 2023-08-01T19:55:23.010 INFO:teuthology.orchestra.run.smithi008.stdout: { 2023-08-01T19:55:23.010 INFO:teuthology.orchestra.run.smithi008.stdout: "event": "dispatched", 2023-08-01T19:55:23.010 INFO:teuthology.orchestra.run.smithi008.stdout: "time": "2023-08-01T19:55:22.945264+0000", 2023-08-01T19:55:23.010 INFO:teuthology.orchestra.run.smithi008.stdout: "duration": 1.0098999999999999e-05 2023-08-01T19:55:23.010 INFO:teuthology.orchestra.run.smithi008.stdout: }, 2023-08-01T19:55:23.010 INFO:teuthology.orchestra.run.smithi008.stdout: { 2023-08-01T19:55:23.010 INFO:teuthology.orchestra.run.smithi008.stdout: "event": "queued_for_pg", 2023-08-01T19:55:23.010 INFO:teuthology.orchestra.run.smithi008.stdout: "time": "2023-08-01T19:55:22.945268+0000", 2023-08-01T19:55:23.011 INFO:teuthology.orchestra.run.smithi008.stdout: "duration": 4.2250000000000002e-06 2023-08-01T19:55:23.011 INFO:teuthology.orchestra.run.smithi008.stdout: }, 2023-08-01T19:55:23.011 INFO:teuthology.orchestra.run.smithi008.stdout: { 2023-08-01T19:55:23.011 INFO:teuthology.orchestra.run.smithi008.stdout: "event": "reached_pg", 2023-08-01T19:55:23.011 INFO:teuthology.orchestra.run.smithi008.stdout: "time": "2023-08-01T19:55:22.945306+0000", 2023-08-01T19:55:23.011 INFO:teuthology.orchestra.run.smithi008.stdout: "duration": 3.7598000000000002e-05 2023-08-01T19:55:23.011 INFO:teuthology.orchestra.run.smithi008.stdout: }, 2023-08-01T19:55:23.011 INFO:teuthology.orchestra.run.smithi008.stdout: { 2023-08-01T19:55:23.012 INFO:teuthology.orchestra.run.smithi008.stdout: "event": "started", 2023-08-01T19:55:23.012 INFO:teuthology.orchestra.run.smithi008.stdout: "time": "2023-08-01T19:55:22.945451+0000", 2023-08-01T19:55:23.012 INFO:teuthology.orchestra.run.smithi008.stdout: "duration": 0.000145625 2023-08-01T19:55:23.012 INFO:teuthology.orchestra.run.smithi008.stdout: }, 2023-08-01T19:55:23.012 INFO:teuthology.orchestra.run.smithi008.stdout: { 2023-08-01T19:55:23.012 INFO:teuthology.orchestra.run.smithi008.stdout: "event": "waiting for subops from 1", 2023-08-01T19:55:23.012 INFO:teuthology.orchestra.run.smithi008.stdout: "time": "2023-08-01T19:55:22.945622+0000", 2023-08-01T19:55:23.013 INFO:teuthology.orchestra.run.smithi008.stdout: "duration": 0.00017044 2023-08-01T19:55:23.013 INFO:teuthology.orchestra.run.smithi008.stdout: } 2023-08-01T19:55:23.013 INFO:teuthology.orchestra.run.smithi008.stdout: ] 2023-08-01T19:55:23.013 INFO:teuthology.orchestra.run.smithi008.stdout: } 2023-08-01T19:55:23.013 INFO:teuthology.orchestra.run.smithi008.stdout: } 2023-08-01T19:55:23.013 INFO:teuthology.orchestra.run.smithi008.stdout: ], 2023-08-01T19:55:23.013 INFO:teuthology.orchestra.run.smithi008.stdout: "num_ops": 8 2023-08-01T19:55:23.014 INFO:teuthology.orchestra.run.smithi008.stdout:} 2023-08-01T19:55:23.015 INFO:tasks.ceph.osd.2.smithi155.stderr:2023-08-01T19:55:23.014+0000 7faa5c6ac700 -1 received signal: Hangup from /usr/bin/python3 /bin/daemon-helper kill ceph-osd -f --cluster ceph -i 2 (PID: 111337) UID: 0 2023-08-01T19:55:23.016 DEBUG:teuthology.orchestra.run.smithi008:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 30 ceph --cluster ceph --admin-daemon /var/run/ceph/ceph-osd.0.asok dump_blocked_ops 2023-08-01T19:55:23.116 INFO:tasks.ceph.osd.2.smithi155.stderr:2023-08-01T19:55:23.115+0000 7faa5c6ac700 -1 received signal: Hangup from /usr/bin/python3 /bin/daemon-helper kill ceph-osd -f --cluster ceph -i 2 (PID: 111337) UID: 0 2023-08-01T19:55:23.216 INFO:tasks.ceph.osd.1.smithi101.stderr:2023-08-01T19:55:23.215+0000 7fb0cb7f6700 -1 received signal: Hangup from /usr/bin/python3 /bin/daemon-helper kill ceph-osd -f --cluster ceph -i 1 (PID: 111141) UID: 0 2023-08-01T19:55:23.246 INFO:teuthology.orchestra.run.smithi008.stdout:{ 2023-08-01T19:55:23.246 INFO:teuthology.orchestra.run.smithi008.stdout: "ops": [], 2023-08-01T19:55:23.246 INFO:teuthology.orchestra.run.smithi008.stdout: "complaint_time": 30, 2023-08-01T19:55:23.247 INFO:teuthology.orchestra.run.smithi008.stdout: "num_blocked_ops": 0 2023-08-01T19:55:23.247 INFO:teuthology.orchestra.run.smithi008.stdout:} 2023-08-01T19:55:23.261 DEBUG:teuthology.orchestra.run.smithi008:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 30 ceph --cluster ceph --admin-daemon /var/run/ceph/ceph-osd.0.asok dump_historic_ops 2023-08-01T19:55:23.317 INFO:tasks.radosbench.radosbench.0.smithi006.stdout: 59 15 131815 131800 139.607 113.188 0.00618453 0.00716027 2023-08-01T19:55:23.318 INFO:tasks.ceph.osd.1.smithi101.stderr:2023-08-01T19:55:23.316+0000 7fb0cb7f6700 -1 received signal: Hangup from /usr/bin/python3 /bin/daemon-helper kill ceph-osd -f --cluster ceph -i 1 (PID: 111141) UID: 0 2023-08-01T19:55:23.418 INFO:tasks.ceph.osd.1.smithi101.stderr:2023-08-01T19:55:23.417+0000 7fb0cb7f6700 -1 received signal: Hangup from /usr/bin/python3 /bin/daemon-helper kill ceph-osd -f --cluster ceph -i 1 (PID: 111141) UID: 0 2023-08-01T19:55:23.445 DEBUG:teuthology.orchestra.run.smithi006:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 120 ceph --cluster ceph -- tell 'osd.*' injectargs --osd_enable_op_tracker=false 2023-08-01T19:55:23.446 INFO:teuthology.orchestra.run.smithi008.stdout:{ 2023-08-01T19:55:23.446 INFO:teuthology.orchestra.run.smithi008.stdout: "size": 20, 2023-08-01T19:55:23.447 INFO:teuthology.orchestra.run.smithi008.stdout: "duration": 600, 2023-08-01T19:55:23.447 INFO:teuthology.orchestra.run.smithi008.stdout: "ops": [ 2023-08-01T19:55:23.447 INFO:teuthology.orchestra.run.smithi008.stdout: { 2023-08-01T19:55:23.447 INFO:teuthology.orchestra.run.smithi008.stdout: "description": "osd_op(client.4668.0:100240 5.a 5:5313c5b9:::benchmark_data_smithi006_114134_object100239:head [set-alloc-hint object_size 65536 write_size 65536,write 0~65536] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e37)", 2023-08-01T19:55:23.447 INFO:teuthology.orchestra.run.smithi008.stdout: "initiated_at": "2023-08-01T19:55:05.148399+0000", 2023-08-01T19:55:23.447 INFO:teuthology.orchestra.run.smithi008.stdout: "age": 18.295237973999999, 2023-08-01T19:55:23.447 INFO:teuthology.orchestra.run.smithi008.stdout: "duration": 0.077278904999999995, 2023-08-01T19:55:23.448 INFO:teuthology.orchestra.run.smithi008.stdout: "type_data": { 2023-08-01T19:55:23.448 INFO:teuthology.orchestra.run.smithi008.stdout: "flag_point": "commit sent; apply or cleanup", 2023-08-01T19:55:23.448 INFO:teuthology.orchestra.run.smithi008.stdout: "client_info": { 2023-08-01T19:55:23.448 INFO:teuthology.orchestra.run.smithi008.stdout: "client": "client.4668", 2023-08-01T19:55:23.448 INFO:teuthology.orchestra.run.smithi008.stdout: "client_addr": "172.21.15.6:0/1709472247", 2023-08-01T19:55:23.448 INFO:teuthology.orchestra.run.smithi008.stdout: "tid": 100240 2023-08-01T19:55:23.448 INFO:teuthology.orchestra.run.smithi008.stdout: }, 2023-08-01T19:55:23.448 INFO:teuthology.orchestra.run.smithi008.stdout: "events": [ 2023-08-01T19:55:23.449 INFO:teuthology.orchestra.run.smithi008.stdout: { 2023-08-01T19:55:23.449 INFO:teuthology.orchestra.run.smithi008.stdout: "event": "initiated", 2023-08-01T19:55:23.449 INFO:teuthology.orchestra.run.smithi008.stdout: "time": "2023-08-01T19:55:05.148399+0000", 2023-08-01T19:55:23.449 INFO:teuthology.orchestra.run.smithi008.stdout: "duration": 0 2023-08-01T19:55:23.449 INFO:teuthology.orchestra.run.smithi008.stdout: }, 2023-08-01T19:55:23.449 INFO:teuthology.orchestra.run.smithi008.stdout: { 2023-08-01T19:55:23.449 INFO:teuthology.orchestra.run.smithi008.stdout: "event": "throttled", 2023-08-01T19:55:23.450 INFO:teuthology.orchestra.run.smithi008.stdout: "time": "2023-08-01T19:55:05.148399+0000", 2023-08-01T19:55:23.450 INFO:teuthology.orchestra.run.smithi008.stdout: "duration": 0 2023-08-01T19:55:23.450 INFO:teuthology.orchestra.run.smithi008.stdout: }, 2023-08-01T19:55:23.450 INFO:teuthology.orchestra.run.smithi008.stdout: { 2023-08-01T19:55:23.450 INFO:teuthology.orchestra.run.smithi008.stdout: "event": "header_read", 2023-08-01T19:55:23.450 INFO:teuthology.orchestra.run.smithi008.stdout: "time": "2023-08-01T19:55:05.148398+0000", 2023-08-01T19:55:23.450 INFO:teuthology.orchestra.run.smithi008.stdout: "duration": 4294967295.999999 2023-08-01T19:55:23.450 INFO:teuthology.orchestra.run.smithi008.stdout: }, 2023-08-01T19:55:23.451 INFO:teuthology.orchestra.run.smithi008.stdout: { 2023-08-01T19:55:23.451 INFO:teuthology.orchestra.run.smithi008.stdout: "event": "all_read", 2023-08-01T19:55:23.451 INFO:teuthology.orchestra.run.smithi008.stdout: "time": "2023-08-01T19:55:05.148492+0000", 2023-08-01T19:55:23.451 INFO:teuthology.orchestra.run.smithi008.stdout: "duration": 9.3892000000000002e-05 2023-08-01T19:55:23.451 INFO:teuthology.orchestra.run.smithi008.stdout: }, 2023-08-01T19:55:23.451 INFO:teuthology.orchestra.run.smithi008.stdout: { 2023-08-01T19:55:23.451 INFO:teuthology.orchestra.run.smithi008.stdout: "event": "dispatched", 2023-08-01T19:55:23.451 INFO:teuthology.orchestra.run.smithi008.stdout: "time": "2023-08-01T19:55:05.148503+0000", 2023-08-01T19:55:23.452 INFO:teuthology.orchestra.run.smithi008.stdout: "duration": 1.0951000000000001e-05 2023-08-01T19:55:23.452 INFO:teuthology.orchestra.run.smithi008.stdout: }, 2023-08-01T19:55:23.452 INFO:teuthology.orchestra.run.smithi008.stdout: { 2023-08-01T19:55:23.452 INFO:teuthology.orchestra.run.smithi008.stdout: "event": "queued_for_pg", 2023-08-01T19:55:23.452 INFO:teuthology.orchestra.run.smithi008.stdout: "time": "2023-08-01T19:55:05.148508+0000", 2023-08-01T19:55:23.452 INFO:teuthology.orchestra.run.smithi008.stdout: "duration": 5.0080000000000002e-06 2023-08-01T19:55:23.452 INFO:teuthology.orchestra.run.smithi008.stdout: }, 2023-08-01T19:55:23.453 INFO:teuthology.orchestra.run.smithi008.stdout: { 2023-08-01T19:55:23.453 INFO:teuthology.orchestra.run.smithi008.stdout: "event": "reached_pg", 2023-08-01T19:55:23.453 INFO:teuthology.orchestra.run.smithi008.stdout: "time": "2023-08-01T19:55:05.148548+0000", 2023-08-01T19:55:23.453 INFO:teuthology.orchestra.run.smithi008.stdout: "duration": 4.0358999999999998e-05 2023-08-01T19:55:23.453 INFO:teuthology.orchestra.run.smithi008.stdout: }, 2023-08-01T19:55:23.453 INFO:teuthology.orchestra.run.smithi008.stdout: { 2023-08-01T19:55:23.453 INFO:teuthology.orchestra.run.smithi008.stdout: "event": "started", 2023-08-01T19:55:23.453 INFO:teuthology.orchestra.run.smithi008.stdout: "time": "2023-08-01T19:55:05.148666+0000", 2023-08-01T19:55:23.454 INFO:teuthology.orchestra.run.smithi008.stdout: "duration": 0.000117621 2023-08-01T19:55:23.454 INFO:teuthology.orchestra.run.smithi008.stdout: }, 2023-08-01T19:55:23.454 INFO:teuthology.orchestra.run.smithi008.stdout: { 2023-08-01T19:55:23.454 INFO:teuthology.orchestra.run.smithi008.stdout: "event": "waiting for subops from 2", 2023-08-01T19:55:23.454 INFO:teuthology.orchestra.run.smithi008.stdout: "time": "2023-08-01T19:55:05.148805+0000", 2023-08-01T19:55:23.454 INFO:teuthology.orchestra.run.smithi008.stdout: "duration": 0.000139176 2023-08-01T19:55:23.454 INFO:teuthology.orchestra.run.smithi008.stdout: }, 2023-08-01T19:55:23.455 INFO:teuthology.orchestra.run.smithi008.stdout: { 2023-08-01T19:55:23.455 INFO:teuthology.orchestra.run.smithi008.stdout: "event": "op_commit", 2023-08-01T19:55:23.455 INFO:teuthology.orchestra.run.smithi008.stdout: "time": "2023-08-01T19:55:05.156143+0000", 2023-08-01T19:55:23.455 INFO:teuthology.orchestra.run.smithi008.stdout: "duration": 0.007338041 2023-08-01T19:55:23.455 INFO:teuthology.orchestra.run.smithi008.stdout: }, 2023-08-01T19:55:23.455 INFO:teuthology.orchestra.run.smithi008.stdout: { 2023-08-01T19:55:23.455 INFO:teuthology.orchestra.run.smithi008.stdout: "event": "sub_op_commit_rec", 2023-08-01T19:55:23.455 INFO:teuthology.orchestra.run.smithi008.stdout: "time": "2023-08-01T19:55:05.225581+0000", 2023-08-01T19:55:23.456 INFO:teuthology.orchestra.run.smithi008.stdout: "duration": 0.069438402999999996 2023-08-01T19:55:23.456 INFO:teuthology.orchestra.run.smithi008.stdout: }, 2023-08-01T19:55:23.456 INFO:teuthology.orchestra.run.smithi008.stdout: { 2023-08-01T19:55:23.456 INFO:teuthology.orchestra.run.smithi008.stdout: "event": "commit_sent", 2023-08-01T19:55:23.456 INFO:teuthology.orchestra.run.smithi008.stdout: "time": "2023-08-01T19:55:05.225632+0000", 2023-08-01T19:55:23.456 INFO:teuthology.orchestra.run.smithi008.stdout: "duration": 5.0382e-05 2023-08-01T19:55:23.456 INFO:teuthology.orchestra.run.smithi008.stdout: }, 2023-08-01T19:55:23.457 INFO:teuthology.orchestra.run.smithi008.stdout: { 2023-08-01T19:55:23.457 INFO:teuthology.orchestra.run.smithi008.stdout: "event": "done", 2023-08-01T19:55:23.457 INFO:teuthology.orchestra.run.smithi008.stdout: "time": "2023-08-01T19:55:05.225677+0000", 2023-08-01T19:55:23.457 INFO:teuthology.orchestra.run.smithi008.stdout: "duration": 4.5893000000000003e-05 2023-08-01T19:55:23.457 INFO:teuthology.orchestra.run.smithi008.stdout: } 2023-08-01T19:55:23.457 INFO:teuthology.orchestra.run.smithi008.stdout: ] 2023-08-01T19:55:23.457 INFO:teuthology.orchestra.run.smithi008.stdout: } 2023-08-01T19:55:23.457 INFO:teuthology.orchestra.run.smithi008.stdout: }, 2023-08-01T19:55:23.458 INFO:teuthology.orchestra.run.smithi008.stdout: { 2023-08-01T19:55:23.458 INFO:teuthology.orchestra.run.smithi008.stdout: "description": "osd_op(client.4668.0:100243 5.a 5:5e8193b6:::benchmark_data_smithi006_114134_object100242:head [set-alloc-hint object_size 65536 write_size 65536,write 0~65536] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e37)", 2023-08-01T19:55:23.458 INFO:teuthology.orchestra.run.smithi008.stdout: "initiated_at": "2023-08-01T19:55:05.150737+0000", 2023-08-01T19:55:23.458 INFO:teuthology.orchestra.run.smithi008.stdout: "age": 18.292899518999999, 2023-08-01T19:55:23.458 INFO:teuthology.orchestra.run.smithi008.stdout: "duration": 0.075019885999999994, 2023-08-01T19:55:23.458 INFO:teuthology.orchestra.run.smithi008.stdout: "type_data": { 2023-08-01T19:55:23.458 INFO:teuthology.orchestra.run.smithi008.stdout: "flag_point": "commit sent; apply or cleanup", 2023-08-01T19:55:23.459 INFO:teuthology.orchestra.run.smithi008.stdout: "client_info": { 2023-08-01T19:55:23.459 INFO:teuthology.orchestra.run.smithi008.stdout: "client": "client.4668", 2023-08-01T19:55:23.459 INFO:teuthology.orchestra.run.smithi008.stdout: "client_addr": "172.21.15.6:0/1709472247", 2023-08-01T19:55:23.459 INFO:teuthology.orchestra.run.smithi008.stdout: "tid": 100243 2023-08-01T19:55:23.459 INFO:teuthology.orchestra.run.smithi008.stdout: }, 2023-08-01T19:55:23.459 INFO:teuthology.orchestra.run.smithi008.stdout: "events": [ 2023-08-01T19:55:23.459 INFO:teuthology.orchestra.run.smithi008.stdout: { 2023-08-01T19:55:23.459 INFO:teuthology.orchestra.run.smithi008.stdout: "event": "initiated", 2023-08-01T19:55:23.460 INFO:teuthology.orchestra.run.smithi008.stdout: "time": "2023-08-01T19:55:05.150737+0000", 2023-08-01T19:55:23.460 INFO:teuthology.orchestra.run.smithi008.stdout: "duration": 0 2023-08-01T19:55:23.460 INFO:teuthology.orchestra.run.smithi008.stdout: }, 2023-08-01T19:55:23.460 INFO:teuthology.orchestra.run.smithi008.stdout: { 2023-08-01T19:55:23.460 INFO:teuthology.orchestra.run.smithi008.stdout: "event": "throttled", 2023-08-01T19:55:23.460 INFO:teuthology.orchestra.run.smithi008.stdout: "time": "2023-08-01T19:55:05.150737+0000", 2023-08-01T19:55:23.460 INFO:teuthology.orchestra.run.smithi008.stdout: "duration": 0 2023-08-01T19:55:23.461 INFO:teuthology.orchestra.run.smithi008.stdout: }, 2023-08-01T19:55:23.461 INFO:teuthology.orchestra.run.smithi008.stdout: { 2023-08-01T19:55:23.461 INFO:teuthology.orchestra.run.smithi008.stdout: "event": "header_read", 2023-08-01T19:55:23.461 INFO:teuthology.orchestra.run.smithi008.stdout: "time": "2023-08-01T19:55:05.150736+0000", 2023-08-01T19:55:23.461 INFO:teuthology.orchestra.run.smithi008.stdout: "duration": 4294967295.999999 2023-08-01T19:55:23.461 INFO:teuthology.orchestra.run.smithi008.stdout: }, 2023-08-01T19:55:23.461 INFO:teuthology.orchestra.run.smithi008.stdout: { 2023-08-01T19:55:23.461 INFO:teuthology.orchestra.run.smithi008.stdout: "event": "all_read", 2023-08-01T19:55:23.462 INFO:teuthology.orchestra.run.smithi008.stdout: "time": "2023-08-01T19:55:05.150780+0000", 2023-08-01T19:55:23.462 INFO:teuthology.orchestra.run.smithi008.stdout: "duration": 4.3578999999999997e-05 2023-08-01T19:55:23.462 INFO:teuthology.orchestra.run.smithi008.stdout: }, 2023-08-01T19:55:23.462 INFO:teuthology.orchestra.run.smithi008.stdout: { 2023-08-01T19:55:23.462 INFO:teuthology.orchestra.run.smithi008.stdout: "event": "dispatched", 2023-08-01T19:55:23.462 INFO:teuthology.orchestra.run.smithi008.stdout: "time": "2023-08-01T19:55:05.150791+0000", 2023-08-01T19:55:23.462 INFO:teuthology.orchestra.run.smithi008.stdout: "duration": 1.0963e-05 2023-08-01T19:55:23.462 INFO:teuthology.orchestra.run.smithi008.stdout: }, 2023-08-01T19:55:23.463 INFO:teuthology.orchestra.run.smithi008.stdout: { 2023-08-01T19:55:23.463 INFO:teuthology.orchestra.run.smithi008.stdout: "event": "queued_for_pg", 2023-08-01T19:55:23.463 INFO:teuthology.orchestra.run.smithi008.stdout: "time": "2023-08-01T19:55:05.150797+0000", 2023-08-01T19:55:23.463 INFO:teuthology.orchestra.run.smithi008.stdout: "duration": 5.9780000000000002e-06 2023-08-01T19:55:23.463 INFO:teuthology.orchestra.run.smithi008.stdout: }, 2023-08-01T19:55:23.463 INFO:teuthology.orchestra.run.smithi008.stdout: { 2023-08-01T19:55:23.463 INFO:teuthology.orchestra.run.smithi008.stdout: "event": "reached_pg", 2023-08-01T19:55:23.464 INFO:teuthology.orchestra.run.smithi008.stdout: "time": "2023-08-01T19:55:05.150833+0000", 2023-08-01T19:55:23.464 INFO:teuthology.orchestra.run.smithi008.stdout: "duration": 3.6000000000000001e-05 2023-08-01T19:55:23.464 INFO:teuthology.orchestra.run.smithi008.stdout: }, 2023-08-01T19:55:23.464 INFO:teuthology.orchestra.run.smithi008.stdout: { 2023-08-01T19:55:23.464 INFO:teuthology.orchestra.run.smithi008.stdout: "event": "started", 2023-08-01T19:55:23.464 INFO:teuthology.orchestra.run.smithi008.stdout: "time": "2023-08-01T19:55:05.150951+0000", 2023-08-01T19:55:23.464 INFO:teuthology.orchestra.run.smithi008.stdout: "duration": 0.00011827799999999999 2023-08-01T19:55:23.465 INFO:teuthology.orchestra.run.smithi008.stdout: }, 2023-08-01T19:55:23.465 INFO:teuthology.orchestra.run.smithi008.stdout: { 2023-08-01T19:55:23.465 INFO:teuthology.orchestra.run.smithi008.stdout: "event": "waiting for subops from 2", 2023-08-01T19:55:23.465 INFO:teuthology.orchestra.run.smithi008.stdout: "time": "2023-08-01T19:55:05.151111+0000", 2023-08-01T19:55:23.465 INFO:teuthology.orchestra.run.smithi008.stdout: "duration": 0.00015961299999999999 2023-08-01T19:55:23.465 INFO:teuthology.orchestra.run.smithi008.stdout: }, 2023-08-01T19:55:23.465 INFO:teuthology.orchestra.run.smithi008.stdout: { 2023-08-01T19:55:23.466 INFO:teuthology.orchestra.run.smithi008.stdout: "event": "op_commit", 2023-08-01T19:55:23.466 INFO:teuthology.orchestra.run.smithi008.stdout: "time": "2023-08-01T19:55:05.156247+0000", 2023-08-01T19:55:23.466 INFO:teuthology.orchestra.run.smithi008.stdout: "duration": 0.005136524 2023-08-01T19:55:23.466 INFO:teuthology.orchestra.run.smithi008.stdout: }, 2023-08-01T19:55:23.466 INFO:teuthology.orchestra.run.smithi008.stdout: { 2023-08-01T19:55:23.466 INFO:teuthology.orchestra.run.smithi008.stdout: "event": "sub_op_commit_rec", 2023-08-01T19:55:23.466 INFO:teuthology.orchestra.run.smithi008.stdout: "time": "2023-08-01T19:55:05.225705+0000", 2023-08-01T19:55:23.466 INFO:teuthology.orchestra.run.smithi008.stdout: "duration": 0.069458377000000002 2023-08-01T19:55:23.467 INFO:teuthology.orchestra.run.smithi008.stdout: }, 2023-08-01T19:55:23.467 INFO:teuthology.orchestra.run.smithi008.stdout: { 2023-08-01T19:55:23.467 INFO:teuthology.orchestra.run.smithi008.stdout: "event": "commit_sent", 2023-08-01T19:55:23.467 INFO:teuthology.orchestra.run.smithi008.stdout: "time": "2023-08-01T19:55:05.225736+0000", 2023-08-01T19:55:23.467 INFO:teuthology.orchestra.run.smithi008.stdout: "duration": 3.0388000000000001e-05 2023-08-01T19:55:23.467 INFO:teuthology.orchestra.run.smithi008.stdout: }, 2023-08-01T19:55:23.467 INFO:teuthology.orchestra.run.smithi008.stdout: { 2023-08-01T19:55:23.467 INFO:teuthology.orchestra.run.smithi008.stdout: "event": "done", 2023-08-01T19:55:23.468 INFO:teuthology.orchestra.run.smithi008.stdout: "time": "2023-08-01T19:55:05.225757+0000", 2023-08-01T19:55:23.468 INFO:teuthology.orchestra.run.smithi008.stdout: "duration": 2.1090999999999998e-05 2023-08-01T19:55:23.468 INFO:teuthology.orchestra.run.smithi008.stdout: } 2023-08-01T19:55:23.468 INFO:teuthology.orchestra.run.smithi008.stdout: ] 2023-08-01T19:55:23.468 INFO:teuthology.orchestra.run.smithi008.stdout: } 2023-08-01T19:55:23.468 INFO:teuthology.orchestra.run.smithi008.stdout: }, 2023-08-01T19:55:23.468 INFO:teuthology.orchestra.run.smithi008.stdout: { 2023-08-01T19:55:23.469 INFO:teuthology.orchestra.run.smithi008.stdout: "description": "osd_op(client.4668.0:100261 5.a 5:562deedb:::benchmark_data_smithi006_114134_object100260:head [set-alloc-hint object_size 65536 write_size 65536,write 0~65536] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e37)", 2023-08-01T19:55:23.469 INFO:teuthology.orchestra.run.smithi008.stdout: "initiated_at": "2023-08-01T19:55:05.163316+0000", 2023-08-01T19:55:23.469 INFO:teuthology.orchestra.run.smithi008.stdout: "age": 18.280320103000001, 2023-08-01T19:55:23.469 INFO:teuthology.orchestra.run.smithi008.stdout: "duration": 0.063073012999999997, 2023-08-01T19:55:23.470 INFO:teuthology.orchestra.run.smithi008.stdout: "type_data": { 2023-08-01T19:55:23.470 INFO:teuthology.orchestra.run.smithi008.stdout: "flag_point": "commit sent; apply or cleanup", 2023-08-01T19:55:23.470 INFO:teuthology.orchestra.run.smithi008.stdout: "client_info": { 2023-08-01T19:55:23.470 INFO:teuthology.orchestra.run.smithi008.stdout: "client": "client.4668", 2023-08-01T19:55:23.470 INFO:teuthology.orchestra.run.smithi008.stdout: "client_addr": "172.21.15.6:0/1709472247", 2023-08-01T19:55:23.470 INFO:teuthology.orchestra.run.smithi008.stdout: "tid": 100261 2023-08-01T19:55:23.470 INFO:teuthology.orchestra.run.smithi008.stdout: }, 2023-08-01T19:55:23.470 INFO:teuthology.orchestra.run.smithi008.stdout: "events": [ 2023-08-01T19:55:23.471 INFO:teuthology.orchestra.run.smithi008.stdout: { 2023-08-01T19:55:23.471 INFO:teuthology.orchestra.run.smithi008.stdout: "event": "initiated", 2023-08-01T19:55:23.471 INFO:teuthology.orchestra.run.smithi008.stdout: "time": "2023-08-01T19:55:05.163316+0000", 2023-08-01T19:55:23.471 INFO:teuthology.orchestra.run.smithi008.stdout: "duration": 0 2023-08-01T19:55:23.471 INFO:teuthology.orchestra.run.smithi008.stdout: }, 2023-08-01T19:55:23.471 INFO:teuthology.orchestra.run.smithi008.stdout: { 2023-08-01T19:55:23.471 INFO:teuthology.orchestra.run.smithi008.stdout: "event": "throttled", 2023-08-01T19:55:23.471 INFO:teuthology.orchestra.run.smithi008.stdout: "time": "2023-08-01T19:55:05.163316+0000", 2023-08-01T19:55:23.472 INFO:teuthology.orchestra.run.smithi008.stdout: "duration": 0 2023-08-01T19:55:23.472 INFO:teuthology.orchestra.run.smithi008.stdout: }, 2023-08-01T19:55:23.472 INFO:teuthology.orchestra.run.smithi008.stdout: { 2023-08-01T19:55:23.472 INFO:teuthology.orchestra.run.smithi008.stdout: "event": "header_read", 2023-08-01T19:55:23.472 INFO:teuthology.orchestra.run.smithi008.stdout: "time": "2023-08-01T19:55:05.163316+0000", 2023-08-01T19:55:23.472 INFO:teuthology.orchestra.run.smithi008.stdout: "duration": 4294967295.999999 2023-08-01T19:55:23.472 INFO:teuthology.orchestra.run.smithi008.stdout: }, 2023-08-01T19:55:23.473 INFO:teuthology.orchestra.run.smithi008.stdout: { 2023-08-01T19:55:23.473 INFO:teuthology.orchestra.run.smithi008.stdout: "event": "all_read", 2023-08-01T19:55:23.473 INFO:teuthology.orchestra.run.smithi008.stdout: "time": "2023-08-01T19:55:05.163380+0000", 2023-08-01T19:55:23.473 INFO:teuthology.orchestra.run.smithi008.stdout: "duration": 6.4395999999999998e-05 2023-08-01T19:55:23.473 INFO:teuthology.orchestra.run.smithi008.stdout: }, 2023-08-01T19:55:23.473 INFO:teuthology.orchestra.run.smithi008.stdout: { 2023-08-01T19:55:23.473 INFO:teuthology.orchestra.run.smithi008.stdout: "event": "dispatched", 2023-08-01T19:55:23.473 INFO:teuthology.orchestra.run.smithi008.stdout: "time": "2023-08-01T19:55:05.163390+0000", 2023-08-01T19:55:23.474 INFO:teuthology.orchestra.run.smithi008.stdout: "duration": 1.0189e-05 2023-08-01T19:55:23.474 INFO:teuthology.orchestra.run.smithi008.stdout: }, 2023-08-01T19:55:23.474 INFO:teuthology.orchestra.run.smithi008.stdout: { 2023-08-01T19:55:23.474 INFO:teuthology.orchestra.run.smithi008.stdout: "event": "queued_for_pg", 2023-08-01T19:55:23.474 INFO:teuthology.orchestra.run.smithi008.stdout: "time": "2023-08-01T19:55:05.163395+0000", 2023-08-01T19:55:23.474 INFO:teuthology.orchestra.run.smithi008.stdout: "duration": 4.4059999999999998e-06 2023-08-01T19:55:23.474 INFO:teuthology.orchestra.run.smithi008.stdout: }, 2023-08-01T19:55:23.474 INFO:teuthology.orchestra.run.smithi008.stdout: { 2023-08-01T19:55:23.475 INFO:teuthology.orchestra.run.smithi008.stdout: "event": "reached_pg", 2023-08-01T19:55:23.475 INFO:teuthology.orchestra.run.smithi008.stdout: "time": "2023-08-01T19:55:05.163429+0000", 2023-08-01T19:55:23.475 INFO:teuthology.orchestra.run.smithi008.stdout: "duration": 3.4900000000000001e-05 2023-08-01T19:55:23.475 INFO:teuthology.orchestra.run.smithi008.stdout: }, 2023-08-01T19:55:23.475 INFO:teuthology.orchestra.run.smithi008.stdout: { 2023-08-01T19:55:23.475 INFO:teuthology.orchestra.run.smithi008.stdout: "event": "started", 2023-08-01T19:55:23.475 INFO:teuthology.orchestra.run.smithi008.stdout: "time": "2023-08-01T19:55:05.163512+0000", 2023-08-01T19:55:23.475 INFO:teuthology.orchestra.run.smithi008.stdout: "duration": 8.2987999999999999e-05 2023-08-01T19:55:23.476 INFO:teuthology.orchestra.run.smithi008.stdout: }, 2023-08-01T19:55:23.476 INFO:teuthology.orchestra.run.smithi008.stdout: { 2023-08-01T19:55:23.476 INFO:teuthology.orchestra.run.smithi008.stdout: "event": "waiting for subops from 2", 2023-08-01T19:55:23.476 INFO:teuthology.orchestra.run.smithi008.stdout: "time": "2023-08-01T19:55:05.163596+0000", 2023-08-01T19:55:23.476 INFO:teuthology.orchestra.run.smithi008.stdout: "duration": 8.3783999999999996e-05 2023-08-01T19:55:23.476 INFO:teuthology.orchestra.run.smithi008.stdout: }, 2023-08-01T19:55:23.476 INFO:teuthology.orchestra.run.smithi008.stdout: { 2023-08-01T19:55:23.477 INFO:teuthology.orchestra.run.smithi008.stdout: "event": "op_commit", 2023-08-01T19:55:23.477 INFO:teuthology.orchestra.run.smithi008.stdout: "time": "2023-08-01T19:55:05.167129+0000", 2023-08-01T19:55:23.477 INFO:teuthology.orchestra.run.smithi008.stdout: "duration": 0.0035328709999999999 2023-08-01T19:55:23.477 INFO:teuthology.orchestra.run.smithi008.stdout: }, 2023-08-01T19:55:23.477 INFO:teuthology.orchestra.run.smithi008.stdout: { 2023-08-01T19:55:23.477 INFO:teuthology.orchestra.run.smithi008.stdout: "event": "sub_op_commit_rec", 2023-08-01T19:55:23.477 INFO:teuthology.orchestra.run.smithi008.stdout: "time": "2023-08-01T19:55:05.226302+0000", 2023-08-01T19:55:23.477 INFO:teuthology.orchestra.run.smithi008.stdout: "duration": 0.059172711000000003 2023-08-01T19:55:23.478 INFO:teuthology.orchestra.run.smithi008.stdout: }, 2023-08-01T19:55:23.478 INFO:teuthology.orchestra.run.smithi008.stdout: { 2023-08-01T19:55:23.478 INFO:teuthology.orchestra.run.smithi008.stdout: "event": "commit_sent", 2023-08-01T19:55:23.478 INFO:teuthology.orchestra.run.smithi008.stdout: "time": "2023-08-01T19:55:05.226351+0000", 2023-08-01T19:55:23.478 INFO:teuthology.orchestra.run.smithi008.stdout: "duration": 4.969e-05 2023-08-01T19:55:23.478 INFO:teuthology.orchestra.run.smithi008.stdout: }, 2023-08-01T19:55:23.478 INFO:teuthology.orchestra.run.smithi008.stdout: { 2023-08-01T19:55:23.478 INFO:teuthology.orchestra.run.smithi008.stdout: "event": "done", 2023-08-01T19:55:23.479 INFO:teuthology.orchestra.run.smithi008.stdout: "time": "2023-08-01T19:55:05.226389+0000", 2023-08-01T19:55:23.479 INFO:teuthology.orchestra.run.smithi008.stdout: "duration": 3.7978000000000001e-05 2023-08-01T19:55:23.479 INFO:teuthology.orchestra.run.smithi008.stdout: } 2023-08-01T19:55:23.479 INFO:teuthology.orchestra.run.smithi008.stdout: ] 2023-08-01T19:55:23.479 INFO:teuthology.orchestra.run.smithi008.stdout: } 2023-08-01T19:55:23.479 INFO:teuthology.orchestra.run.smithi008.stdout: }, 2023-08-01T19:55:23.479 INFO:teuthology.orchestra.run.smithi008.stdout: { 2023-08-01T19:55:23.480 INFO:teuthology.orchestra.run.smithi008.stdout: "description": "osd_op(client.4668.0:100262 5.a 5:5c636b5d:::benchmark_data_smithi006_114134_object100261:head [set-alloc-hint object_size 65536 write_size 65536,write 0~65536] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e37)", 2023-08-01T19:55:23.480 INFO:teuthology.orchestra.run.smithi008.stdout: "initiated_at": "2023-08-01T19:55:05.165068+0000", 2023-08-01T19:55:23.480 INFO:teuthology.orchestra.run.smithi008.stdout: "age": 18.278568450000002, 2023-08-01T19:55:23.480 INFO:teuthology.orchestra.run.smithi008.stdout: "duration": 0.063919403, 2023-08-01T19:55:23.480 INFO:teuthology.orchestra.run.smithi008.stdout: "type_data": { 2023-08-01T19:55:23.480 INFO:teuthology.orchestra.run.smithi008.stdout: "flag_point": "commit sent; apply or cleanup", 2023-08-01T19:55:23.480 INFO:teuthology.orchestra.run.smithi008.stdout: "client_info": { 2023-08-01T19:55:23.480 INFO:teuthology.orchestra.run.smithi008.stdout: "client": "client.4668", 2023-08-01T19:55:23.481 INFO:teuthology.orchestra.run.smithi008.stdout: "client_addr": "172.21.15.6:0/1709472247", 2023-08-01T19:55:23.481 INFO:teuthology.orchestra.run.smithi008.stdout: "tid": 100262 2023-08-01T19:55:23.481 INFO:teuthology.orchestra.run.smithi008.stdout: }, 2023-08-01T19:55:23.481 INFO:teuthology.orchestra.run.smithi008.stdout: "events": [ 2023-08-01T19:55:23.481 INFO:teuthology.orchestra.run.smithi008.stdout: { 2023-08-01T19:55:23.481 INFO:teuthology.orchestra.run.smithi008.stdout: "event": "initiated", 2023-08-01T19:55:23.481 INFO:teuthology.orchestra.run.smithi008.stdout: "time": "2023-08-01T19:55:05.165068+0000", 2023-08-01T19:55:23.481 INFO:teuthology.orchestra.run.smithi008.stdout: "duration": 0 2023-08-01T19:55:23.482 INFO:teuthology.orchestra.run.smithi008.stdout: }, 2023-08-01T19:55:23.482 INFO:teuthology.orchestra.run.smithi008.stdout: { 2023-08-01T19:55:23.482 INFO:teuthology.orchestra.run.smithi008.stdout: "event": "throttled", 2023-08-01T19:55:23.482 INFO:teuthology.orchestra.run.smithi008.stdout: "time": "2023-08-01T19:55:05.165068+0000", 2023-08-01T19:55:23.482 INFO:teuthology.orchestra.run.smithi008.stdout: "duration": 0 2023-08-01T19:55:23.482 INFO:teuthology.orchestra.run.smithi008.stdout: }, 2023-08-01T19:55:23.482 INFO:teuthology.orchestra.run.smithi008.stdout: { 2023-08-01T19:55:23.482 INFO:teuthology.orchestra.run.smithi008.stdout: "event": "header_read", 2023-08-01T19:55:23.483 INFO:teuthology.orchestra.run.smithi008.stdout: "time": "2023-08-01T19:55:05.165067+0000", 2023-08-01T19:55:23.483 INFO:teuthology.orchestra.run.smithi008.stdout: "duration": 4294967295.999999 2023-08-01T19:55:23.483 INFO:teuthology.orchestra.run.smithi008.stdout: }, 2023-08-01T19:55:23.483 INFO:teuthology.orchestra.run.smithi008.stdout: { 2023-08-01T19:55:23.483 INFO:teuthology.orchestra.run.smithi008.stdout: "event": "all_read", 2023-08-01T19:55:23.483 INFO:teuthology.orchestra.run.smithi008.stdout: "time": "2023-08-01T19:55:05.165126+0000", 2023-08-01T19:55:23.483 INFO:teuthology.orchestra.run.smithi008.stdout: "duration": 5.9116000000000001e-05 2023-08-01T19:55:23.484 INFO:teuthology.orchestra.run.smithi008.stdout: }, 2023-08-01T19:55:23.484 INFO:teuthology.orchestra.run.smithi008.stdout: { 2023-08-01T19:55:23.484 INFO:teuthology.orchestra.run.smithi008.stdout: "event": "dispatched", 2023-08-01T19:55:23.484 INFO:teuthology.orchestra.run.smithi008.stdout: "time": "2023-08-01T19:55:05.165134+0000", 2023-08-01T19:55:23.484 INFO:teuthology.orchestra.run.smithi008.stdout: "duration": 7.9820000000000008e-06 2023-08-01T19:55:23.484 INFO:teuthology.orchestra.run.smithi008.stdout: }, 2023-08-01T19:55:23.484 INFO:teuthology.orchestra.run.smithi008.stdout: { 2023-08-01T19:55:23.484 INFO:teuthology.orchestra.run.smithi008.stdout: "event": "queued_for_pg", 2023-08-01T19:55:23.485 INFO:teuthology.orchestra.run.smithi008.stdout: "time": "2023-08-01T19:55:05.165139+0000", 2023-08-01T19:55:23.485 INFO:teuthology.orchestra.run.smithi008.stdout: "duration": 4.2560000000000004e-06 2023-08-01T19:55:23.485 INFO:teuthology.orchestra.run.smithi008.stdout: }, 2023-08-01T19:55:23.485 INFO:teuthology.orchestra.run.smithi008.stdout: { 2023-08-01T19:55:23.485 INFO:teuthology.orchestra.run.smithi008.stdout: "event": "reached_pg", 2023-08-01T19:55:23.485 INFO:teuthology.orchestra.run.smithi008.stdout: "time": "2023-08-01T19:55:05.165165+0000", 2023-08-01T19:55:23.485 INFO:teuthology.orchestra.run.smithi008.stdout: "duration": 2.6554e-05 2023-08-01T19:55:23.485 INFO:teuthology.orchestra.run.smithi008.stdout: }, 2023-08-01T19:55:23.486 INFO:teuthology.orchestra.run.smithi008.stdout: { 2023-08-01T19:55:23.486 INFO:teuthology.orchestra.run.smithi008.stdout: "event": "started", 2023-08-01T19:55:23.486 INFO:teuthology.orchestra.run.smithi008.stdout: "time": "2023-08-01T19:55:05.165243+0000", 2023-08-01T19:55:23.486 INFO:teuthology.orchestra.run.smithi008.stdout: "duration": 7.7877e-05 2023-08-01T19:55:23.486 INFO:teuthology.orchestra.run.smithi008.stdout: }, 2023-08-01T19:55:23.486 INFO:teuthology.orchestra.run.smithi008.stdout: { 2023-08-01T19:55:23.486 INFO:teuthology.orchestra.run.smithi008.stdout: "event": "waiting for subops from 2", 2023-08-01T19:55:23.486 INFO:teuthology.orchestra.run.smithi008.stdout: "time": "2023-08-01T19:55:05.165450+0000", 2023-08-01T19:55:23.487 INFO:teuthology.orchestra.run.smithi008.stdout: "duration": 0.00020655599999999999 2023-08-01T19:55:23.487 INFO:teuthology.orchestra.run.smithi008.stdout: }, 2023-08-01T19:55:23.487 INFO:teuthology.orchestra.run.smithi008.stdout: { 2023-08-01T19:55:23.487 INFO:teuthology.orchestra.run.smithi008.stdout: "event": "op_commit", 2023-08-01T19:55:23.487 INFO:teuthology.orchestra.run.smithi008.stdout: "time": "2023-08-01T19:55:05.168883+0000", 2023-08-01T19:55:23.487 INFO:teuthology.orchestra.run.smithi008.stdout: "duration": 0.0034333279999999998 2023-08-01T19:55:23.487 INFO:teuthology.orchestra.run.smithi008.stdout: }, 2023-08-01T19:55:23.487 INFO:teuthology.orchestra.run.smithi008.stdout: { 2023-08-01T19:55:23.488 INFO:teuthology.orchestra.run.smithi008.stdout: "event": "sub_op_commit_rec", 2023-08-01T19:55:23.488 INFO:teuthology.orchestra.run.smithi008.stdout: "time": "2023-08-01T19:55:05.228904+0000", 2023-08-01T19:55:23.488 INFO:teuthology.orchestra.run.smithi008.stdout: "duration": 0.060021370999999997 2023-08-01T19:55:23.488 INFO:teuthology.orchestra.run.smithi008.stdout: }, 2023-08-01T19:55:23.488 INFO:teuthology.orchestra.run.smithi008.stdout: { 2023-08-01T19:55:23.488 INFO:teuthology.orchestra.run.smithi008.stdout: "event": "commit_sent", 2023-08-01T19:55:23.488 INFO:teuthology.orchestra.run.smithi008.stdout: "time": "2023-08-01T19:55:05.228952+0000", 2023-08-01T19:55:23.489 INFO:teuthology.orchestra.run.smithi008.stdout: "duration": 4.8056999999999997e-05 2023-08-01T19:55:23.489 INFO:teuthology.orchestra.run.smithi008.stdout: }, 2023-08-01T19:55:23.489 INFO:teuthology.orchestra.run.smithi008.stdout: { 2023-08-01T19:55:23.489 INFO:teuthology.orchestra.run.smithi008.stdout: "event": "done", 2023-08-01T19:55:23.489 INFO:teuthology.orchestra.run.smithi008.stdout: "time": "2023-08-01T19:55:05.228987+0000", 2023-08-01T19:55:23.489 INFO:teuthology.orchestra.run.smithi008.stdout: "duration": 3.5083000000000003e-05 2023-08-01T19:55:23.489 INFO:teuthology.orchestra.run.smithi008.stdout: } 2023-08-01T19:55:23.490 INFO:teuthology.orchestra.run.smithi008.stdout: ] 2023-08-01T19:55:23.490 INFO:teuthology.orchestra.run.smithi008.stdout: } 2023-08-01T19:55:23.490 INFO:teuthology.orchestra.run.smithi008.stdout: }, 2023-08-01T19:55:23.490 INFO:teuthology.orchestra.run.smithi008.stdout: { 2023-08-01T19:55:23.490 INFO:teuthology.orchestra.run.smithi008.stdout: "description": "osd_op(client.4668.0:100929 5.3 5:c29f4adb:::benchmark_data_smithi006_114134_object100928:head [set-alloc-hint object_size 65536 write_size 65536,write 0~65536] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e37)", 2023-08-01T19:55:23.490 INFO:teuthology.orchestra.run.smithi008.stdout: "initiated_at": "2023-08-01T19:55:05.564759+0000", 2023-08-01T19:55:23.490 INFO:teuthology.orchestra.run.smithi008.stdout: "age": 17.878877810999999, 2023-08-01T19:55:23.490 INFO:teuthology.orchestra.run.smithi008.stdout: "duration": 0.062544635000000001, 2023-08-01T19:55:23.491 INFO:teuthology.orchestra.run.smithi008.stdout: "type_data": { 2023-08-01T19:55:23.491 INFO:teuthology.orchestra.run.smithi008.stdout: "flag_point": "commit sent; apply or cleanup", 2023-08-01T19:55:23.491 INFO:teuthology.orchestra.run.smithi008.stdout: "client_info": { 2023-08-01T19:55:23.491 INFO:teuthology.orchestra.run.smithi008.stdout: "client": "client.4668", 2023-08-01T19:55:23.491 INFO:teuthology.orchestra.run.smithi008.stdout: "client_addr": "172.21.15.6:0/1709472247", 2023-08-01T19:55:23.491 INFO:teuthology.orchestra.run.smithi008.stdout: "tid": 100929 2023-08-01T19:55:23.491 INFO:teuthology.orchestra.run.smithi008.stdout: }, 2023-08-01T19:55:23.491 INFO:teuthology.orchestra.run.smithi008.stdout: "events": [ 2023-08-01T19:55:23.492 INFO:teuthology.orchestra.run.smithi008.stdout: { 2023-08-01T19:55:23.492 INFO:teuthology.orchestra.run.smithi008.stdout: "event": "initiated", 2023-08-01T19:55:23.492 INFO:teuthology.orchestra.run.smithi008.stdout: "time": "2023-08-01T19:55:05.564759+0000", 2023-08-01T19:55:23.492 INFO:teuthology.orchestra.run.smithi008.stdout: "duration": 0 2023-08-01T19:55:23.492 INFO:teuthology.orchestra.run.smithi008.stdout: }, 2023-08-01T19:55:23.492 INFO:teuthology.orchestra.run.smithi008.stdout: { 2023-08-01T19:55:23.492 INFO:teuthology.orchestra.run.smithi008.stdout: "event": "throttled", 2023-08-01T19:55:23.492 INFO:teuthology.orchestra.run.smithi008.stdout: "time": "2023-08-01T19:55:05.564759+0000", 2023-08-01T19:55:23.493 INFO:teuthology.orchestra.run.smithi008.stdout: "duration": 0 2023-08-01T19:55:23.493 INFO:teuthology.orchestra.run.smithi008.stdout: }, 2023-08-01T19:55:23.493 INFO:teuthology.orchestra.run.smithi008.stdout: { 2023-08-01T19:55:23.493 INFO:teuthology.orchestra.run.smithi008.stdout: "event": "header_read", 2023-08-01T19:55:23.493 INFO:teuthology.orchestra.run.smithi008.stdout: "time": "2023-08-01T19:55:05.564758+0000", 2023-08-01T19:55:23.493 INFO:teuthology.orchestra.run.smithi008.stdout: "duration": 4294967295.999999 2023-08-01T19:55:23.493 INFO:teuthology.orchestra.run.smithi008.stdout: }, 2023-08-01T19:55:23.493 INFO:teuthology.orchestra.run.smithi008.stdout: { 2023-08-01T19:55:23.494 INFO:teuthology.orchestra.run.smithi008.stdout: "event": "all_read", 2023-08-01T19:55:23.494 INFO:teuthology.orchestra.run.smithi008.stdout: "time": "2023-08-01T19:55:05.564815+0000", 2023-08-01T19:55:23.494 INFO:teuthology.orchestra.run.smithi008.stdout: "duration": 5.7757000000000003e-05 2023-08-01T19:55:23.494 INFO:teuthology.orchestra.run.smithi008.stdout: }, 2023-08-01T19:55:23.494 INFO:teuthology.orchestra.run.smithi008.stdout: { 2023-08-01T19:55:23.494 INFO:teuthology.orchestra.run.smithi008.stdout: "event": "dispatched", 2023-08-01T19:55:23.494 INFO:teuthology.orchestra.run.smithi008.stdout: "time": "2023-08-01T19:55:05.564824+0000", 2023-08-01T19:55:23.494 INFO:teuthology.orchestra.run.smithi008.stdout: "duration": 8.6559999999999998e-06 2023-08-01T19:55:23.495 INFO:teuthology.orchestra.run.smithi008.stdout: }, 2023-08-01T19:55:23.495 INFO:teuthology.orchestra.run.smithi008.stdout: { 2023-08-01T19:55:23.495 INFO:teuthology.orchestra.run.smithi008.stdout: "event": "queued_for_pg", 2023-08-01T19:55:23.495 INFO:teuthology.orchestra.run.smithi008.stdout: "time": "2023-08-01T19:55:05.564829+0000", 2023-08-01T19:55:23.495 INFO:teuthology.orchestra.run.smithi008.stdout: "duration": 4.6160000000000004e-06 2023-08-01T19:55:23.495 INFO:teuthology.orchestra.run.smithi008.stdout: }, 2023-08-01T19:55:23.495 INFO:teuthology.orchestra.run.smithi008.stdout: { 2023-08-01T19:55:23.496 INFO:teuthology.orchestra.run.smithi008.stdout: "event": "reached_pg", 2023-08-01T19:55:23.496 INFO:teuthology.orchestra.run.smithi008.stdout: "time": "2023-08-01T19:55:05.564871+0000", 2023-08-01T19:55:23.496 INFO:teuthology.orchestra.run.smithi008.stdout: "duration": 4.2206000000000002e-05 2023-08-01T19:55:23.496 INFO:teuthology.orchestra.run.smithi008.stdout: }, 2023-08-01T19:55:23.496 INFO:teuthology.orchestra.run.smithi008.stdout: { 2023-08-01T19:55:23.496 INFO:teuthology.orchestra.run.smithi008.stdout: "event": "started", 2023-08-01T19:55:23.497 INFO:teuthology.orchestra.run.smithi008.stdout: "time": "2023-08-01T19:55:05.565011+0000", 2023-08-01T19:55:23.497 INFO:teuthology.orchestra.run.smithi008.stdout: "duration": 0.000140469 2023-08-01T19:55:23.497 INFO:teuthology.orchestra.run.smithi008.stdout: }, 2023-08-01T19:55:23.497 INFO:teuthology.orchestra.run.smithi008.stdout: { 2023-08-01T19:55:23.498 INFO:teuthology.orchestra.run.smithi008.stdout: "event": "waiting for subops from 1", 2023-08-01T19:55:23.498 INFO:teuthology.orchestra.run.smithi008.stdout: "time": "2023-08-01T19:55:05.565212+0000", 2023-08-01T19:55:23.498 INFO:teuthology.orchestra.run.smithi008.stdout: "duration": 0.00020106599999999999 2023-08-01T19:55:23.498 INFO:teuthology.orchestra.run.smithi008.stdout: }, 2023-08-01T19:55:23.498 INFO:teuthology.orchestra.run.smithi008.stdout: { 2023-08-01T19:55:23.498 INFO:teuthology.orchestra.run.smithi008.stdout: "event": "sub_op_commit_rec", 2023-08-01T19:55:23.499 INFO:teuthology.orchestra.run.smithi008.stdout: "time": "2023-08-01T19:55:05.626925+0000", 2023-08-01T19:55:23.499 INFO:teuthology.orchestra.run.smithi008.stdout: "duration": 0.061712111 2023-08-01T19:55:23.499 INFO:teuthology.orchestra.run.smithi008.stdout: }, 2023-08-01T19:55:23.499 INFO:teuthology.orchestra.run.smithi008.stdout: { 2023-08-01T19:55:23.499 INFO:teuthology.orchestra.run.smithi008.stdout: "event": "op_commit", 2023-08-01T19:55:23.499 INFO:teuthology.orchestra.run.smithi008.stdout: "time": "2023-08-01T19:55:05.627217+0000", 2023-08-01T19:55:23.499 INFO:teuthology.orchestra.run.smithi008.stdout: "duration": 0.00029265999999999998 2023-08-01T19:55:23.500 INFO:teuthology.orchestra.run.smithi008.stdout: }, 2023-08-01T19:55:23.500 INFO:teuthology.orchestra.run.smithi008.stdout: { 2023-08-01T19:55:23.500 INFO:teuthology.orchestra.run.smithi008.stdout: "event": "commit_sent", 2023-08-01T19:55:23.500 INFO:teuthology.orchestra.run.smithi008.stdout: "time": "2023-08-01T19:55:05.627264+0000", 2023-08-01T19:55:23.500 INFO:teuthology.orchestra.run.smithi008.stdout: "duration": 4.6260000000000001e-05 2023-08-01T19:55:23.500 INFO:teuthology.orchestra.run.smithi008.stdout: }, 2023-08-01T19:55:23.500 INFO:teuthology.orchestra.run.smithi008.stdout: { 2023-08-01T19:55:23.501 INFO:teuthology.orchestra.run.smithi008.stdout: "event": "done", 2023-08-01T19:55:23.501 INFO:teuthology.orchestra.run.smithi008.stdout: "time": "2023-08-01T19:55:05.627303+0000", 2023-08-01T19:55:23.501 INFO:teuthology.orchestra.run.smithi008.stdout: "duration": 3.9839999999999998e-05 2023-08-01T19:55:23.501 INFO:teuthology.orchestra.run.smithi008.stdout: } 2023-08-01T19:55:23.501 INFO:teuthology.orchestra.run.smithi008.stdout: ] 2023-08-01T19:55:23.501 INFO:teuthology.orchestra.run.smithi008.stdout: } 2023-08-01T19:55:23.501 INFO:teuthology.orchestra.run.smithi008.stdout: }, 2023-08-01T19:55:23.501 INFO:teuthology.orchestra.run.smithi008.stdout: { 2023-08-01T19:55:23.502 INFO:teuthology.orchestra.run.smithi008.stdout: "description": "osd_repop(client.4668.0:100928 5.7 e37/19 5:e61a7dfa:::benchmark_data_smithi006_114134_object100927:head v 37'6273, mlcod=37'6270)", 2023-08-01T19:55:23.502 INFO:teuthology.orchestra.run.smithi008.stdout: "initiated_at": "2023-08-01T19:55:05.565106+0000", 2023-08-01T19:55:23.502 INFO:teuthology.orchestra.run.smithi008.stdout: "age": 17.878530713, 2023-08-01T19:55:23.502 INFO:teuthology.orchestra.run.smithi008.stdout: "duration": 0.064091282999999999, 2023-08-01T19:55:23.502 INFO:teuthology.orchestra.run.smithi008.stdout: "type_data": { 2023-08-01T19:55:23.502 INFO:teuthology.orchestra.run.smithi008.stdout: "flag_point": "commit sent; apply or cleanup", 2023-08-01T19:55:23.502 INFO:teuthology.orchestra.run.smithi008.stdout: "events": [ 2023-08-01T19:55:23.502 INFO:teuthology.orchestra.run.smithi008.stdout: { 2023-08-01T19:55:23.503 INFO:teuthology.orchestra.run.smithi008.stdout: "event": "initiated", 2023-08-01T19:55:23.503 INFO:teuthology.orchestra.run.smithi008.stdout: "time": "2023-08-01T19:55:05.565106+0000", 2023-08-01T19:55:23.503 INFO:teuthology.orchestra.run.smithi008.stdout: "duration": 0 2023-08-01T19:55:23.503 INFO:teuthology.orchestra.run.smithi008.stdout: }, 2023-08-01T19:55:23.503 INFO:teuthology.orchestra.run.smithi008.stdout: { 2023-08-01T19:55:23.503 INFO:teuthology.orchestra.run.smithi008.stdout: "event": "throttled", 2023-08-01T19:55:23.503 INFO:teuthology.orchestra.run.smithi008.stdout: "time": "2023-08-01T19:55:05.565106+0000", 2023-08-01T19:55:23.503 INFO:teuthology.orchestra.run.smithi008.stdout: "duration": 0 2023-08-01T19:55:23.504 INFO:teuthology.orchestra.run.smithi008.stdout: }, 2023-08-01T19:55:23.504 INFO:teuthology.orchestra.run.smithi008.stdout: { 2023-08-01T19:55:23.504 INFO:teuthology.orchestra.run.smithi008.stdout: "event": "header_read", 2023-08-01T19:55:23.504 INFO:teuthology.orchestra.run.smithi008.stdout: "time": "2023-08-01T19:55:05.565105+0000", 2023-08-01T19:55:23.504 INFO:teuthology.orchestra.run.smithi008.stdout: "duration": 4294967295.9999995 2023-08-01T19:55:23.504 INFO:teuthology.orchestra.run.smithi008.stdout: }, 2023-08-01T19:55:23.504 INFO:teuthology.orchestra.run.smithi008.stdout: { 2023-08-01T19:55:23.505 INFO:teuthology.orchestra.run.smithi008.stdout: "event": "all_read", 2023-08-01T19:55:23.505 INFO:teuthology.orchestra.run.smithi008.stdout: "time": "2023-08-01T19:55:05.565173+0000", 2023-08-01T19:55:23.505 INFO:teuthology.orchestra.run.smithi008.stdout: "duration": 6.8186000000000001e-05 2023-08-01T19:55:23.505 INFO:teuthology.orchestra.run.smithi008.stdout: }, 2023-08-01T19:55:23.505 INFO:teuthology.orchestra.run.smithi008.stdout: { 2023-08-01T19:55:23.505 INFO:teuthology.orchestra.run.smithi008.stdout: "event": "dispatched", 2023-08-01T19:55:23.505 INFO:teuthology.orchestra.run.smithi008.stdout: "time": "2023-08-01T19:55:05.565182+0000", 2023-08-01T19:55:23.505 INFO:teuthology.orchestra.run.smithi008.stdout: "duration": 8.3620000000000006e-06 2023-08-01T19:55:23.506 INFO:teuthology.orchestra.run.smithi008.stdout: }, 2023-08-01T19:55:23.506 INFO:teuthology.orchestra.run.smithi008.stdout: { 2023-08-01T19:55:23.506 INFO:teuthology.orchestra.run.smithi008.stdout: "event": "queued_for_pg", 2023-08-01T19:55:23.506 INFO:teuthology.orchestra.run.smithi008.stdout: "time": "2023-08-01T19:55:05.565186+0000", 2023-08-01T19:55:23.506 INFO:teuthology.orchestra.run.smithi008.stdout: "duration": 3.7680000000000002e-06 2023-08-01T19:55:23.506 INFO:teuthology.orchestra.run.smithi008.stdout: }, 2023-08-01T19:55:23.506 INFO:teuthology.orchestra.run.smithi008.stdout: { 2023-08-01T19:55:23.506 INFO:teuthology.orchestra.run.smithi008.stdout: "event": "reached_pg", 2023-08-01T19:55:23.507 INFO:teuthology.orchestra.run.smithi008.stdout: "time": "2023-08-01T19:55:05.565212+0000", 2023-08-01T19:55:23.507 INFO:teuthology.orchestra.run.smithi008.stdout: "duration": 2.6230000000000001e-05 2023-08-01T19:55:23.507 INFO:teuthology.orchestra.run.smithi008.stdout: }, 2023-08-01T19:55:23.507 INFO:teuthology.orchestra.run.smithi008.stdout: { 2023-08-01T19:55:23.507 INFO:teuthology.orchestra.run.smithi008.stdout: "event": "started", 2023-08-01T19:55:23.507 INFO:teuthology.orchestra.run.smithi008.stdout: "time": "2023-08-01T19:55:05.565224+0000", 2023-08-01T19:55:23.507 INFO:teuthology.orchestra.run.smithi008.stdout: "duration": 1.2033e-05 2023-08-01T19:55:23.507 INFO:teuthology.orchestra.run.smithi008.stdout: }, 2023-08-01T19:55:23.508 INFO:teuthology.orchestra.run.smithi008.stdout: { 2023-08-01T19:55:23.508 INFO:teuthology.orchestra.run.smithi008.stdout: "event": "commit_sent", 2023-08-01T19:55:23.508 INFO:teuthology.orchestra.run.smithi008.stdout: "time": "2023-08-01T19:55:05.629152+0000", 2023-08-01T19:55:23.508 INFO:teuthology.orchestra.run.smithi008.stdout: "duration": 0.063928378999999994 2023-08-01T19:55:23.508 INFO:teuthology.orchestra.run.smithi008.stdout: }, 2023-08-01T19:55:23.508 INFO:teuthology.orchestra.run.smithi008.stdout: { 2023-08-01T19:55:23.508 INFO:teuthology.orchestra.run.smithi008.stdout: "event": "done", 2023-08-01T19:55:23.509 INFO:teuthology.orchestra.run.smithi008.stdout: "time": "2023-08-01T19:55:05.629197+0000", 2023-08-01T19:55:23.509 INFO:teuthology.orchestra.run.smithi008.stdout: "duration": 4.4894000000000001e-05 2023-08-01T19:55:23.509 INFO:teuthology.orchestra.run.smithi008.stdout: } 2023-08-01T19:55:23.509 INFO:teuthology.orchestra.run.smithi008.stdout: ] 2023-08-01T19:55:23.509 INFO:teuthology.orchestra.run.smithi008.stdout: } 2023-08-01T19:55:23.509 INFO:teuthology.orchestra.run.smithi008.stdout: }, 2023-08-01T19:55:23.509 INFO:teuthology.orchestra.run.smithi008.stdout: { 2023-08-01T19:55:23.509 INFO:teuthology.orchestra.run.smithi008.stdout: "description": "osd_repop(client.4668.0:100927 5.0 e37/19 5:00608ec6:::benchmark_data_smithi006_114134_object100926:head v 37'6408, mlcod=37'6403)", 2023-08-01T19:55:23.510 INFO:teuthology.orchestra.run.smithi008.stdout: "initiated_at": "2023-08-01T19:55:05.565153+0000", 2023-08-01T19:55:23.510 INFO:teuthology.orchestra.run.smithi008.stdout: "age": 17.878483975999998, 2023-08-01T19:55:23.510 INFO:teuthology.orchestra.run.smithi008.stdout: "duration": 0.062202714999999999, 2023-08-01T19:55:23.510 INFO:teuthology.orchestra.run.smithi008.stdout: "type_data": { 2023-08-01T19:55:23.510 INFO:teuthology.orchestra.run.smithi008.stdout: "flag_point": "commit sent; apply or cleanup", 2023-08-01T19:55:23.510 INFO:teuthology.orchestra.run.smithi008.stdout: "events": [ 2023-08-01T19:55:23.510 INFO:teuthology.orchestra.run.smithi008.stdout: { 2023-08-01T19:55:23.510 INFO:teuthology.orchestra.run.smithi008.stdout: "event": "initiated", 2023-08-01T19:55:23.511 INFO:teuthology.orchestra.run.smithi008.stdout: "time": "2023-08-01T19:55:05.565153+0000", 2023-08-01T19:55:23.511 INFO:teuthology.orchestra.run.smithi008.stdout: "duration": 0 2023-08-01T19:55:23.511 INFO:teuthology.orchestra.run.smithi008.stdout: }, 2023-08-01T19:55:23.511 INFO:teuthology.orchestra.run.smithi008.stdout: { 2023-08-01T19:55:23.511 INFO:teuthology.orchestra.run.smithi008.stdout: "event": "throttled", 2023-08-01T19:55:23.511 INFO:teuthology.orchestra.run.smithi008.stdout: "time": "2023-08-01T19:55:05.565153+0000", 2023-08-01T19:55:23.511 INFO:teuthology.orchestra.run.smithi008.stdout: "duration": 0 2023-08-01T19:55:23.511 INFO:teuthology.orchestra.run.smithi008.stdout: }, 2023-08-01T19:55:23.512 INFO:teuthology.orchestra.run.smithi008.stdout: { 2023-08-01T19:55:23.512 INFO:teuthology.orchestra.run.smithi008.stdout: "event": "header_read", 2023-08-01T19:55:23.512 INFO:teuthology.orchestra.run.smithi008.stdout: "time": "2023-08-01T19:55:05.565152+0000", 2023-08-01T19:55:23.512 INFO:teuthology.orchestra.run.smithi008.stdout: "duration": 4294967295.9999995 2023-08-01T19:55:23.512 INFO:teuthology.orchestra.run.smithi008.stdout: }, 2023-08-01T19:55:23.512 INFO:teuthology.orchestra.run.smithi008.stdout: { 2023-08-01T19:55:23.512 INFO:teuthology.orchestra.run.smithi008.stdout: "event": "all_read", 2023-08-01T19:55:23.512 INFO:teuthology.orchestra.run.smithi008.stdout: "time": "2023-08-01T19:55:05.565225+0000", 2023-08-01T19:55:23.513 INFO:teuthology.orchestra.run.smithi008.stdout: "duration": 7.2471000000000005e-05 2023-08-01T19:55:23.513 INFO:teuthology.orchestra.run.smithi008.stdout: }, 2023-08-01T19:55:23.513 INFO:teuthology.orchestra.run.smithi008.stdout: { 2023-08-01T19:55:23.514 INFO:teuthology.orchestra.run.smithi008.stdout: "event": "dispatched", 2023-08-01T19:55:23.514 INFO:teuthology.orchestra.run.smithi008.stdout: "time": "2023-08-01T19:55:05.565229+0000", 2023-08-01T19:55:23.514 INFO:teuthology.orchestra.run.smithi008.stdout: "duration": 4.5600000000000004e-06 2023-08-01T19:55:23.514 INFO:teuthology.orchestra.run.smithi008.stdout: }, 2023-08-01T19:55:23.515 INFO:teuthology.orchestra.run.smithi008.stdout: { 2023-08-01T19:55:23.515 INFO:teuthology.orchestra.run.smithi008.stdout: "event": "queued_for_pg", 2023-08-01T19:55:23.515 INFO:teuthology.orchestra.run.smithi008.stdout: "time": "2023-08-01T19:55:05.565232+0000", 2023-08-01T19:55:23.515 INFO:teuthology.orchestra.run.smithi008.stdout: "duration": 2.6900000000000001e-06 2023-08-01T19:55:23.515 INFO:teuthology.orchestra.run.smithi008.stdout: }, 2023-08-01T19:55:23.515 INFO:teuthology.orchestra.run.smithi008.stdout: { 2023-08-01T19:55:23.516 INFO:teuthology.orchestra.run.smithi008.stdout: "event": "reached_pg", 2023-08-01T19:55:23.516 INFO:teuthology.orchestra.run.smithi008.stdout: "time": "2023-08-01T19:55:05.565283+0000", 2023-08-01T19:55:23.516 INFO:teuthology.orchestra.run.smithi008.stdout: "duration": 5.1442e-05 2023-08-01T19:55:23.517 INFO:teuthology.orchestra.run.smithi008.stdout: }, 2023-08-01T19:55:23.517 INFO:teuthology.orchestra.run.smithi008.stdout: { 2023-08-01T19:55:23.517 INFO:teuthology.orchestra.run.smithi008.stdout: "event": "started", 2023-08-01T19:55:23.517 INFO:teuthology.orchestra.run.smithi008.stdout: "time": "2023-08-01T19:55:05.565301+0000", 2023-08-01T19:55:23.517 INFO:teuthology.orchestra.run.smithi008.stdout: "duration": 1.8029e-05 2023-08-01T19:55:23.517 INFO:teuthology.orchestra.run.smithi008.stdout: }, 2023-08-01T19:55:23.517 INFO:teuthology.orchestra.run.smithi008.stdout: { 2023-08-01T19:55:23.518 INFO:teuthology.orchestra.run.smithi008.stdout: "event": "commit_sent", 2023-08-01T19:55:23.518 INFO:teuthology.orchestra.run.smithi008.stdout: "time": "2023-08-01T19:55:05.627318+0000", 2023-08-01T19:55:23.518 INFO:teuthology.orchestra.run.smithi008.stdout: "duration": 0.062016763000000003 2023-08-01T19:55:23.518 INFO:teuthology.orchestra.run.smithi008.stdout: }, 2023-08-01T19:55:23.518 INFO:teuthology.orchestra.run.smithi008.stdout: { 2023-08-01T19:55:23.518 INFO:teuthology.orchestra.run.smithi008.stdout: "event": "done", 2023-08-01T19:55:23.518 INFO:teuthology.orchestra.run.smithi008.stdout: "time": "2023-08-01T19:55:05.627355+0000", 2023-08-01T19:55:23.519 INFO:teuthology.orchestra.run.smithi008.stdout: "duration": 3.7258999999999997e-05 2023-08-01T19:55:23.519 INFO:teuthology.orchestra.run.smithi008.stdout: } 2023-08-01T19:55:23.519 INFO:teuthology.orchestra.run.smithi008.stdout: ] 2023-08-01T19:55:23.519 INFO:teuthology.orchestra.run.smithi008.stdout: } 2023-08-01T19:55:23.519 INFO:teuthology.orchestra.run.smithi008.stdout: }, 2023-08-01T19:55:23.519 INFO:teuthology.orchestra.run.smithi008.stdout: { 2023-08-01T19:55:23.519 INFO:teuthology.orchestra.run.smithi008.stdout: "description": "osd_op(client.4668.0:100930 5.5 5:a7b64eb3:::benchmark_data_smithi006_114134_object100929:head [set-alloc-hint object_size 65536 write_size 65536,write 0~65536] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e37)", 2023-08-01T19:55:23.519 INFO:teuthology.orchestra.run.smithi008.stdout: "initiated_at": "2023-08-01T19:55:05.565766+0000", 2023-08-01T19:55:23.520 INFO:teuthology.orchestra.run.smithi008.stdout: "age": 17.877870191, 2023-08-01T19:55:23.520 INFO:teuthology.orchestra.run.smithi008.stdout: "duration": 0.063668735000000004, 2023-08-01T19:55:23.520 INFO:teuthology.orchestra.run.smithi008.stdout: "type_data": { 2023-08-01T19:55:23.520 INFO:teuthology.orchestra.run.smithi008.stdout: "flag_point": "commit sent; apply or cleanup", 2023-08-01T19:55:23.520 INFO:teuthology.orchestra.run.smithi008.stdout: "client_info": { 2023-08-01T19:55:23.520 INFO:teuthology.orchestra.run.smithi008.stdout: "client": "client.4668", 2023-08-01T19:55:23.520 INFO:teuthology.orchestra.run.smithi008.stdout: "client_addr": "172.21.15.6:0/1709472247", 2023-08-01T19:55:23.520 INFO:teuthology.orchestra.run.smithi008.stdout: "tid": 100930 2023-08-01T19:55:23.521 INFO:teuthology.orchestra.run.smithi008.stdout: }, 2023-08-01T19:55:23.521 INFO:teuthology.orchestra.run.smithi008.stdout: "events": [ 2023-08-01T19:55:23.521 INFO:teuthology.orchestra.run.smithi008.stdout: { 2023-08-01T19:55:23.521 INFO:teuthology.orchestra.run.smithi008.stdout: "event": "initiated", 2023-08-01T19:55:23.521 INFO:teuthology.orchestra.run.smithi008.stdout: "time": "2023-08-01T19:55:05.565766+0000", 2023-08-01T19:55:23.521 INFO:teuthology.orchestra.run.smithi008.stdout: "duration": 0 2023-08-01T19:55:23.521 INFO:teuthology.orchestra.run.smithi008.stdout: }, 2023-08-01T19:55:23.521 INFO:teuthology.orchestra.run.smithi008.stdout: { 2023-08-01T19:55:23.522 INFO:teuthology.orchestra.run.smithi008.stdout: "event": "throttled", 2023-08-01T19:55:23.522 INFO:teuthology.orchestra.run.smithi008.stdout: "time": "2023-08-01T19:55:05.565766+0000", 2023-08-01T19:55:23.522 INFO:teuthology.orchestra.run.smithi008.stdout: "duration": 0 2023-08-01T19:55:23.522 INFO:teuthology.orchestra.run.smithi008.stdout: }, 2023-08-01T19:55:23.522 INFO:teuthology.orchestra.run.smithi008.stdout: { 2023-08-01T19:55:23.522 INFO:teuthology.orchestra.run.smithi008.stdout: "event": "header_read", 2023-08-01T19:55:23.522 INFO:teuthology.orchestra.run.smithi008.stdout: "time": "2023-08-01T19:55:05.565766+0000", 2023-08-01T19:55:23.522 INFO:teuthology.orchestra.run.smithi008.stdout: "duration": 4294967295.999999 2023-08-01T19:55:23.523 INFO:teuthology.orchestra.run.smithi008.stdout: }, 2023-08-01T19:55:23.523 INFO:teuthology.orchestra.run.smithi008.stdout: { 2023-08-01T19:55:23.523 INFO:teuthology.orchestra.run.smithi008.stdout: "event": "all_read", 2023-08-01T19:55:23.523 INFO:teuthology.orchestra.run.smithi008.stdout: "time": "2023-08-01T19:55:05.565855+0000", 2023-08-01T19:55:23.523 INFO:teuthology.orchestra.run.smithi008.stdout: "duration": 8.9166999999999995e-05 2023-08-01T19:55:23.523 INFO:teuthology.orchestra.run.smithi008.stdout: }, 2023-08-01T19:55:23.523 INFO:teuthology.orchestra.run.smithi008.stdout: { 2023-08-01T19:55:23.524 INFO:teuthology.orchestra.run.smithi008.stdout: "event": "dispatched", 2023-08-01T19:55:23.524 INFO:teuthology.orchestra.run.smithi008.stdout: "time": "2023-08-01T19:55:05.565862+0000", 2023-08-01T19:55:23.524 INFO:teuthology.orchestra.run.smithi008.stdout: "duration": 7.4549999999999998e-06 2023-08-01T19:55:23.524 INFO:teuthology.orchestra.run.smithi008.stdout: }, 2023-08-01T19:55:23.524 INFO:teuthology.orchestra.run.smithi008.stdout: { 2023-08-01T19:55:23.524 INFO:teuthology.orchestra.run.smithi008.stdout: "event": "queued_for_pg", 2023-08-01T19:55:23.524 INFO:teuthology.orchestra.run.smithi008.stdout: "time": "2023-08-01T19:55:05.565866+0000", 2023-08-01T19:55:23.525 INFO:teuthology.orchestra.run.smithi008.stdout: "duration": 3.8060000000000001e-06 2023-08-01T19:55:23.525 INFO:teuthology.orchestra.run.smithi008.stdout: }, 2023-08-01T19:55:23.525 INFO:teuthology.orchestra.run.smithi008.stdout: { 2023-08-01T19:55:23.525 INFO:teuthology.orchestra.run.smithi008.stdout: "event": "reached_pg", 2023-08-01T19:55:23.525 INFO:teuthology.orchestra.run.smithi008.stdout: "time": "2023-08-01T19:55:05.565901+0000", 2023-08-01T19:55:23.525 INFO:teuthology.orchestra.run.smithi008.stdout: "duration": 3.5063e-05 2023-08-01T19:55:23.525 INFO:teuthology.orchestra.run.smithi008.stdout: }, 2023-08-01T19:55:23.525 INFO:teuthology.orchestra.run.smithi008.stdout: { 2023-08-01T19:55:23.526 INFO:teuthology.orchestra.run.smithi008.stdout: "event": "started", 2023-08-01T19:55:23.526 INFO:teuthology.orchestra.run.smithi008.stdout: "time": "2023-08-01T19:55:05.566016+0000", 2023-08-01T19:55:23.526 INFO:teuthology.orchestra.run.smithi008.stdout: "duration": 0.00011509400000000001 2023-08-01T19:55:23.526 INFO:teuthology.orchestra.run.smithi008.stdout: }, 2023-08-01T19:55:23.526 INFO:teuthology.orchestra.run.smithi008.stdout: { 2023-08-01T19:55:23.526 INFO:teuthology.orchestra.run.smithi008.stdout: "event": "waiting for subops from 1", 2023-08-01T19:55:23.526 INFO:teuthology.orchestra.run.smithi008.stdout: "time": "2023-08-01T19:55:05.566154+0000", 2023-08-01T19:55:23.527 INFO:teuthology.orchestra.run.smithi008.stdout: "duration": 0.000138052 2023-08-01T19:55:23.527 INFO:teuthology.orchestra.run.smithi008.stdout: }, 2023-08-01T19:55:23.527 INFO:teuthology.orchestra.run.smithi008.stdout: { 2023-08-01T19:55:23.527 INFO:teuthology.orchestra.run.smithi008.stdout: "event": "sub_op_commit_rec", 2023-08-01T19:55:23.527 INFO:teuthology.orchestra.run.smithi008.stdout: "time": "2023-08-01T19:55:05.629279+0000", 2023-08-01T19:55:23.527 INFO:teuthology.orchestra.run.smithi008.stdout: "duration": 0.063124531999999997 2023-08-01T19:55:23.527 INFO:teuthology.orchestra.run.smithi008.stdout: }, 2023-08-01T19:55:23.527 INFO:teuthology.orchestra.run.smithi008.stdout: { 2023-08-01T19:55:23.528 INFO:teuthology.orchestra.run.smithi008.stdout: "event": "op_commit", 2023-08-01T19:55:23.528 INFO:teuthology.orchestra.run.smithi008.stdout: "time": "2023-08-01T19:55:05.629333+0000", 2023-08-01T19:55:23.528 INFO:teuthology.orchestra.run.smithi008.stdout: "duration": 5.4694999999999997e-05 2023-08-01T19:55:23.528 INFO:teuthology.orchestra.run.smithi008.stdout: }, 2023-08-01T19:55:23.528 INFO:teuthology.orchestra.run.smithi008.stdout: { 2023-08-01T19:55:23.528 INFO:teuthology.orchestra.run.smithi008.stdout: "event": "commit_sent", 2023-08-01T19:55:23.528 INFO:teuthology.orchestra.run.smithi008.stdout: "time": "2023-08-01T19:55:05.629390+0000", 2023-08-01T19:55:23.528 INFO:teuthology.orchestra.run.smithi008.stdout: "duration": 5.6416000000000003e-05 2023-08-01T19:55:23.529 INFO:teuthology.orchestra.run.smithi008.stdout: }, 2023-08-01T19:55:23.529 INFO:teuthology.orchestra.run.smithi008.stdout: { 2023-08-01T19:55:23.529 INFO:teuthology.orchestra.run.smithi008.stdout: "event": "done", 2023-08-01T19:55:23.529 INFO:teuthology.orchestra.run.smithi008.stdout: "time": "2023-08-01T19:55:05.629435+0000", 2023-08-01T19:55:23.529 INFO:teuthology.orchestra.run.smithi008.stdout: "duration": 4.5170999999999998e-05 2023-08-01T19:55:23.529 INFO:teuthology.orchestra.run.smithi008.stdout: } 2023-08-01T19:55:23.529 INFO:teuthology.orchestra.run.smithi008.stdout: ] 2023-08-01T19:55:23.529 INFO:teuthology.orchestra.run.smithi008.stdout: } 2023-08-01T19:55:23.530 INFO:teuthology.orchestra.run.smithi008.stdout: }, 2023-08-01T19:55:23.530 INFO:teuthology.orchestra.run.smithi008.stdout: { 2023-08-01T19:55:23.530 INFO:teuthology.orchestra.run.smithi008.stdout: "description": "osd_op(client.4668.0:100933 5.5 5:af92e9f2:::benchmark_data_smithi006_114134_object100932:head [set-alloc-hint object_size 65536 write_size 65536,write 0~65536] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e37)", 2023-08-01T19:55:23.530 INFO:teuthology.orchestra.run.smithi008.stdout: "initiated_at": "2023-08-01T19:55:05.566634+0000", 2023-08-01T19:55:23.530 INFO:teuthology.orchestra.run.smithi008.stdout: "age": 17.877002648000001, 2023-08-01T19:55:23.530 INFO:teuthology.orchestra.run.smithi008.stdout: "duration": 0.065909364999999998, 2023-08-01T19:55:23.530 INFO:teuthology.orchestra.run.smithi008.stdout: "type_data": { 2023-08-01T19:55:23.530 INFO:teuthology.orchestra.run.smithi008.stdout: "flag_point": "commit sent; apply or cleanup", 2023-08-01T19:55:23.531 INFO:teuthology.orchestra.run.smithi008.stdout: "client_info": { 2023-08-01T19:55:23.531 INFO:teuthology.orchestra.run.smithi008.stdout: "client": "client.4668", 2023-08-01T19:55:23.531 INFO:teuthology.orchestra.run.smithi008.stdout: "client_addr": "172.21.15.6:0/1709472247", 2023-08-01T19:55:23.531 INFO:teuthology.orchestra.run.smithi008.stdout: "tid": 100933 2023-08-01T19:55:23.531 INFO:teuthology.orchestra.run.smithi008.stdout: }, 2023-08-01T19:55:23.531 INFO:teuthology.orchestra.run.smithi008.stdout: "events": [ 2023-08-01T19:55:23.531 INFO:teuthology.orchestra.run.smithi008.stdout: { 2023-08-01T19:55:23.531 INFO:teuthology.orchestra.run.smithi008.stdout: "event": "initiated", 2023-08-01T19:55:23.532 INFO:teuthology.orchestra.run.smithi008.stdout: "time": "2023-08-01T19:55:05.566634+0000", 2023-08-01T19:55:23.532 INFO:teuthology.orchestra.run.smithi008.stdout: "duration": 0 2023-08-01T19:55:23.532 INFO:teuthology.orchestra.run.smithi008.stdout: }, 2023-08-01T19:55:23.532 INFO:teuthology.orchestra.run.smithi008.stdout: { 2023-08-01T19:55:23.532 INFO:teuthology.orchestra.run.smithi008.stdout: "event": "throttled", 2023-08-01T19:55:23.532 INFO:teuthology.orchestra.run.smithi008.stdout: "time": "2023-08-01T19:55:05.566634+0000", 2023-08-01T19:55:23.532 INFO:teuthology.orchestra.run.smithi008.stdout: "duration": 0 2023-08-01T19:55:23.532 INFO:teuthology.orchestra.run.smithi008.stdout: }, 2023-08-01T19:55:23.533 INFO:teuthology.orchestra.run.smithi008.stdout: { 2023-08-01T19:55:23.533 INFO:teuthology.orchestra.run.smithi008.stdout: "event": "header_read", 2023-08-01T19:55:23.533 INFO:teuthology.orchestra.run.smithi008.stdout: "time": "2023-08-01T19:55:05.566630+0000", 2023-08-01T19:55:23.533 INFO:teuthology.orchestra.run.smithi008.stdout: "duration": 4294967295.9999962 2023-08-01T19:55:23.533 INFO:teuthology.orchestra.run.smithi008.stdout: }, 2023-08-01T19:55:23.533 INFO:teuthology.orchestra.run.smithi008.stdout: { 2023-08-01T19:55:23.533 INFO:teuthology.orchestra.run.smithi008.stdout: "event": "all_read", 2023-08-01T19:55:23.534 INFO:teuthology.orchestra.run.smithi008.stdout: "time": "2023-08-01T19:55:05.566736+0000", 2023-08-01T19:55:23.534 INFO:teuthology.orchestra.run.smithi008.stdout: "duration": 0.000105752 2023-08-01T19:55:23.534 INFO:teuthology.orchestra.run.smithi008.stdout: }, 2023-08-01T19:55:23.534 INFO:teuthology.orchestra.run.smithi008.stdout: { 2023-08-01T19:55:23.534 INFO:teuthology.orchestra.run.smithi008.stdout: "event": "dispatched", 2023-08-01T19:55:23.534 INFO:teuthology.orchestra.run.smithi008.stdout: "time": "2023-08-01T19:55:05.566742+0000", 2023-08-01T19:55:23.534 INFO:teuthology.orchestra.run.smithi008.stdout: "duration": 5.8209999999999998e-06 2023-08-01T19:55:23.534 INFO:teuthology.orchestra.run.smithi008.stdout: }, 2023-08-01T19:55:23.535 INFO:teuthology.orchestra.run.smithi008.stdout: { 2023-08-01T19:55:23.535 INFO:teuthology.orchestra.run.smithi008.stdout: "event": "queued_for_pg", 2023-08-01T19:55:23.535 INFO:teuthology.orchestra.run.smithi008.stdout: "time": "2023-08-01T19:55:05.566745+0000", 2023-08-01T19:55:23.535 INFO:teuthology.orchestra.run.smithi008.stdout: "duration": 3.337e-06 2023-08-01T19:55:23.535 INFO:teuthology.orchestra.run.smithi008.stdout: }, 2023-08-01T19:55:23.535 INFO:teuthology.orchestra.run.smithi008.stdout: { 2023-08-01T19:55:23.535 INFO:teuthology.orchestra.run.smithi008.stdout: "event": "reached_pg", 2023-08-01T19:55:23.535 INFO:teuthology.orchestra.run.smithi008.stdout: "time": "2023-08-01T19:55:05.568175+0000", 2023-08-01T19:55:23.536 INFO:teuthology.orchestra.run.smithi008.stdout: "duration": 0.001429647 2023-08-01T19:55:23.536 INFO:teuthology.orchestra.run.smithi008.stdout: }, 2023-08-01T19:55:23.536 INFO:teuthology.orchestra.run.smithi008.stdout: { 2023-08-01T19:55:23.536 INFO:teuthology.orchestra.run.smithi008.stdout: "event": "started", 2023-08-01T19:55:23.536 INFO:teuthology.orchestra.run.smithi008.stdout: "time": "2023-08-01T19:55:05.568288+0000", 2023-08-01T19:55:23.536 INFO:teuthology.orchestra.run.smithi008.stdout: "duration": 0.000113353 2023-08-01T19:55:23.536 INFO:teuthology.orchestra.run.smithi008.stdout: }, 2023-08-01T19:55:23.537 INFO:teuthology.orchestra.run.smithi008.stdout: { 2023-08-01T19:55:23.537 INFO:teuthology.orchestra.run.smithi008.stdout: "event": "waiting for subops from 1", 2023-08-01T19:55:23.537 INFO:teuthology.orchestra.run.smithi008.stdout: "time": "2023-08-01T19:55:05.568425+0000", 2023-08-01T19:55:23.537 INFO:teuthology.orchestra.run.smithi008.stdout: "duration": 0.000137346 2023-08-01T19:55:23.537 INFO:teuthology.orchestra.run.smithi008.stdout: }, 2023-08-01T19:55:23.537 INFO:teuthology.orchestra.run.smithi008.stdout: { 2023-08-01T19:55:23.537 INFO:teuthology.orchestra.run.smithi008.stdout: "event": "sub_op_commit_rec", 2023-08-01T19:55:23.537 INFO:teuthology.orchestra.run.smithi008.stdout: "time": "2023-08-01T19:55:05.629320+0000", 2023-08-01T19:55:23.538 INFO:teuthology.orchestra.run.smithi008.stdout: "duration": 0.060894491000000002 2023-08-01T19:55:23.538 INFO:teuthology.orchestra.run.smithi008.stdout: }, 2023-08-01T19:55:23.538 INFO:teuthology.orchestra.run.smithi008.stdout: { 2023-08-01T19:55:23.538 INFO:teuthology.orchestra.run.smithi008.stdout: "event": "op_commit", 2023-08-01T19:55:23.538 INFO:teuthology.orchestra.run.smithi008.stdout: "time": "2023-08-01T19:55:05.632452+0000", 2023-08-01T19:55:23.538 INFO:teuthology.orchestra.run.smithi008.stdout: "duration": 0.003131909 2023-08-01T19:55:23.538 INFO:teuthology.orchestra.run.smithi008.stdout: }, 2023-08-01T19:55:23.538 INFO:teuthology.orchestra.run.smithi008.stdout: { 2023-08-01T19:55:23.539 INFO:teuthology.orchestra.run.smithi008.stdout: "event": "commit_sent", 2023-08-01T19:55:23.539 INFO:teuthology.orchestra.run.smithi008.stdout: "time": "2023-08-01T19:55:05.632503+0000", 2023-08-01T19:55:23.539 INFO:teuthology.orchestra.run.smithi008.stdout: "duration": 5.1295000000000003e-05 2023-08-01T19:55:23.539 INFO:teuthology.orchestra.run.smithi008.stdout: }, 2023-08-01T19:55:23.539 INFO:teuthology.orchestra.run.smithi008.stdout: { 2023-08-01T19:55:23.539 INFO:teuthology.orchestra.run.smithi008.stdout: "event": "done", 2023-08-01T19:55:23.539 INFO:teuthology.orchestra.run.smithi008.stdout: "time": "2023-08-01T19:55:05.632543+0000", 2023-08-01T19:55:23.539 INFO:teuthology.orchestra.run.smithi008.stdout: "duration": 4.0234000000000001e-05 2023-08-01T19:55:23.540 INFO:teuthology.orchestra.run.smithi008.stdout: } 2023-08-01T19:55:23.540 INFO:teuthology.orchestra.run.smithi008.stdout: ] 2023-08-01T19:55:23.540 INFO:teuthology.orchestra.run.smithi008.stdout: } 2023-08-01T19:55:23.540 INFO:teuthology.orchestra.run.smithi008.stdout: }, 2023-08-01T19:55:23.540 INFO:teuthology.orchestra.run.smithi008.stdout: { 2023-08-01T19:55:23.540 INFO:teuthology.orchestra.run.smithi008.stdout: "description": "osd_repop(client.4668.0:100935 5.e e37/19 5:7895b14e:::benchmark_data_smithi006_114134_object100934:head v 37'6305, mlcod=37'6303)", 2023-08-01T19:55:23.540 INFO:teuthology.orchestra.run.smithi008.stdout: "initiated_at": "2023-08-01T19:55:05.567118+0000", 2023-08-01T19:55:23.541 INFO:teuthology.orchestra.run.smithi008.stdout: "age": 17.876518404999999, 2023-08-01T19:55:23.541 INFO:teuthology.orchestra.run.smithi008.stdout: "duration": 0.063691180999999999, 2023-08-01T19:55:23.541 INFO:teuthology.orchestra.run.smithi008.stdout: "type_data": { 2023-08-01T19:55:23.541 INFO:teuthology.orchestra.run.smithi008.stdout: "flag_point": "commit sent; apply or cleanup", 2023-08-01T19:55:23.541 INFO:teuthology.orchestra.run.smithi008.stdout: "events": [ 2023-08-01T19:55:23.541 INFO:teuthology.orchestra.run.smithi008.stdout: { 2023-08-01T19:55:23.541 INFO:teuthology.orchestra.run.smithi008.stdout: "event": "initiated", 2023-08-01T19:55:23.541 INFO:teuthology.orchestra.run.smithi008.stdout: "time": "2023-08-01T19:55:05.567118+0000", 2023-08-01T19:55:23.542 INFO:teuthology.orchestra.run.smithi008.stdout: "duration": 0 2023-08-01T19:55:23.542 INFO:teuthology.orchestra.run.smithi008.stdout: }, 2023-08-01T19:55:23.542 INFO:teuthology.orchestra.run.smithi008.stdout: { 2023-08-01T19:55:23.542 INFO:teuthology.orchestra.run.smithi008.stdout: "event": "throttled", 2023-08-01T19:55:23.542 INFO:teuthology.orchestra.run.smithi008.stdout: "time": "2023-08-01T19:55:05.567118+0000", 2023-08-01T19:55:23.542 INFO:teuthology.orchestra.run.smithi008.stdout: "duration": 0 2023-08-01T19:55:23.542 INFO:teuthology.orchestra.run.smithi008.stdout: }, 2023-08-01T19:55:23.542 INFO:teuthology.orchestra.run.smithi008.stdout: { 2023-08-01T19:55:23.543 INFO:teuthology.orchestra.run.smithi008.stdout: "event": "header_read", 2023-08-01T19:55:23.543 INFO:teuthology.orchestra.run.smithi008.stdout: "time": "2023-08-01T19:55:05.567117+0000", 2023-08-01T19:55:23.543 INFO:teuthology.orchestra.run.smithi008.stdout: "duration": 4294967295.999999 2023-08-01T19:55:23.543 INFO:teuthology.orchestra.run.smithi008.stdout: }, 2023-08-01T19:55:23.543 INFO:teuthology.orchestra.run.smithi008.stdout: { 2023-08-01T19:55:23.543 INFO:teuthology.orchestra.run.smithi008.stdout: "event": "all_read", 2023-08-01T19:55:23.544 INFO:teuthology.orchestra.run.smithi008.stdout: "time": "2023-08-01T19:55:05.567168+0000", 2023-08-01T19:55:23.544 INFO:teuthology.orchestra.run.smithi008.stdout: "duration": 5.0353999999999999e-05 2023-08-01T19:55:23.544 INFO:teuthology.orchestra.run.smithi008.stdout: }, 2023-08-01T19:55:23.544 INFO:teuthology.orchestra.run.smithi008.stdout: { 2023-08-01T19:55:23.544 INFO:teuthology.orchestra.run.smithi008.stdout: "event": "dispatched", 2023-08-01T19:55:23.544 INFO:teuthology.orchestra.run.smithi008.stdout: "time": "2023-08-01T19:55:05.567175+0000", 2023-08-01T19:55:23.544 INFO:teuthology.orchestra.run.smithi008.stdout: "duration": 7.3919999999999997e-06 2023-08-01T19:55:23.544 INFO:teuthology.orchestra.run.smithi008.stdout: }, 2023-08-01T19:55:23.545 INFO:teuthology.orchestra.run.smithi008.stdout: { 2023-08-01T19:55:23.545 INFO:teuthology.orchestra.run.smithi008.stdout: "event": "queued_for_pg", 2023-08-01T19:55:23.545 INFO:teuthology.orchestra.run.smithi008.stdout: "time": "2023-08-01T19:55:05.567180+0000", 2023-08-01T19:55:23.545 INFO:teuthology.orchestra.run.smithi008.stdout: "duration": 5.3090000000000003e-06 2023-08-01T19:55:23.545 INFO:teuthology.orchestra.run.smithi008.stdout: }, 2023-08-01T19:55:23.545 INFO:teuthology.orchestra.run.smithi008.stdout: { 2023-08-01T19:55:23.546 INFO:teuthology.orchestra.run.smithi008.stdout: "event": "reached_pg", 2023-08-01T19:55:23.546 INFO:teuthology.orchestra.run.smithi008.stdout: "time": "2023-08-01T19:55:05.567210+0000", 2023-08-01T19:55:23.546 INFO:teuthology.orchestra.run.smithi008.stdout: "duration": 3.0001999999999998e-05 2023-08-01T19:55:23.546 INFO:teuthology.orchestra.run.smithi008.stdout: }, 2023-08-01T19:55:23.546 INFO:teuthology.orchestra.run.smithi008.stdout: { 2023-08-01T19:55:23.546 INFO:teuthology.orchestra.run.smithi008.stdout: "event": "started", 2023-08-01T19:55:23.546 INFO:teuthology.orchestra.run.smithi008.stdout: "time": "2023-08-01T19:55:05.567222+0000", 2023-08-01T19:55:23.546 INFO:teuthology.orchestra.run.smithi008.stdout: "duration": 1.1499e-05 2023-08-01T19:55:23.547 INFO:teuthology.orchestra.run.smithi008.stdout: }, 2023-08-01T19:55:23.547 INFO:teuthology.orchestra.run.smithi008.stdout: { 2023-08-01T19:55:23.547 INFO:teuthology.orchestra.run.smithi008.stdout: "event": "commit_sent", 2023-08-01T19:55:23.547 INFO:teuthology.orchestra.run.smithi008.stdout: "time": "2023-08-01T19:55:05.630772+0000", 2023-08-01T19:55:23.547 INFO:teuthology.orchestra.run.smithi008.stdout: "duration": 0.063550572999999999 2023-08-01T19:55:23.547 INFO:teuthology.orchestra.run.smithi008.stdout: }, 2023-08-01T19:55:23.547 INFO:teuthology.orchestra.run.smithi008.stdout: { 2023-08-01T19:55:23.547 INFO:teuthology.orchestra.run.smithi008.stdout: "event": "done", 2023-08-01T19:55:23.548 INFO:teuthology.orchestra.run.smithi008.stdout: "time": "2023-08-01T19:55:05.630809+0000", 2023-08-01T19:55:23.548 INFO:teuthology.orchestra.run.smithi008.stdout: "duration": 3.7033000000000003e-05 2023-08-01T19:55:23.548 INFO:teuthology.orchestra.run.smithi008.stdout: } 2023-08-01T19:55:23.548 INFO:teuthology.orchestra.run.smithi008.stdout: ] 2023-08-01T19:55:23.548 INFO:teuthology.orchestra.run.smithi008.stdout: } 2023-08-01T19:55:23.548 INFO:teuthology.orchestra.run.smithi008.stdout: }, 2023-08-01T19:55:23.548 INFO:teuthology.orchestra.run.smithi008.stdout: { 2023-08-01T19:55:23.548 INFO:teuthology.orchestra.run.smithi008.stdout: "description": "osd_repop(client.4668.0:100936 5.1 e37/19 5:8f4e3576:::benchmark_data_smithi006_114134_object100935:head v 37'6263, mlcod=37'6261)", 2023-08-01T19:55:23.549 INFO:teuthology.orchestra.run.smithi008.stdout: "initiated_at": "2023-08-01T19:55:05.567617+0000", 2023-08-01T19:55:23.549 INFO:teuthology.orchestra.run.smithi008.stdout: "age": 17.876019142000001, 2023-08-01T19:55:23.549 INFO:teuthology.orchestra.run.smithi008.stdout: "duration": 0.062773918999999997, 2023-08-01T19:55:23.549 INFO:teuthology.orchestra.run.smithi008.stdout: "type_data": { 2023-08-01T19:55:23.549 INFO:teuthology.orchestra.run.smithi008.stdout: "flag_point": "commit sent; apply or cleanup", 2023-08-01T19:55:23.549 INFO:teuthology.orchestra.run.smithi008.stdout: "events": [ 2023-08-01T19:55:23.549 INFO:teuthology.orchestra.run.smithi008.stdout: { 2023-08-01T19:55:23.550 INFO:teuthology.orchestra.run.smithi008.stdout: "event": "initiated", 2023-08-01T19:55:23.550 INFO:teuthology.orchestra.run.smithi008.stdout: "time": "2023-08-01T19:55:05.567617+0000", 2023-08-01T19:55:23.550 INFO:teuthology.orchestra.run.smithi008.stdout: "duration": 0 2023-08-01T19:55:23.550 INFO:teuthology.orchestra.run.smithi008.stdout: }, 2023-08-01T19:55:23.550 INFO:teuthology.orchestra.run.smithi008.stdout: { 2023-08-01T19:55:23.550 INFO:teuthology.orchestra.run.smithi008.stdout: "event": "throttled", 2023-08-01T19:55:23.550 INFO:teuthology.orchestra.run.smithi008.stdout: "time": "2023-08-01T19:55:05.567617+0000", 2023-08-01T19:55:23.550 INFO:teuthology.orchestra.run.smithi008.stdout: "duration": 0 2023-08-01T19:55:23.551 INFO:teuthology.orchestra.run.smithi008.stdout: }, 2023-08-01T19:55:23.551 INFO:teuthology.orchestra.run.smithi008.stdout: { 2023-08-01T19:55:23.551 INFO:teuthology.orchestra.run.smithi008.stdout: "event": "header_read", 2023-08-01T19:55:23.551 INFO:teuthology.orchestra.run.smithi008.stdout: "time": "2023-08-01T19:55:05.567617+0000", 2023-08-01T19:55:23.551 INFO:teuthology.orchestra.run.smithi008.stdout: "duration": 4294967295.9999995 2023-08-01T19:55:23.551 INFO:teuthology.orchestra.run.smithi008.stdout: }, 2023-08-01T19:55:23.551 INFO:teuthology.orchestra.run.smithi008.stdout: { 2023-08-01T19:55:23.551 INFO:teuthology.orchestra.run.smithi008.stdout: "event": "all_read", 2023-08-01T19:55:23.552 INFO:teuthology.orchestra.run.smithi008.stdout: "time": "2023-08-01T19:55:05.567700+0000", 2023-08-01T19:55:23.552 INFO:teuthology.orchestra.run.smithi008.stdout: "duration": 8.3363999999999997e-05 2023-08-01T19:55:23.552 INFO:teuthology.orchestra.run.smithi008.stdout: }, 2023-08-01T19:55:23.552 INFO:teuthology.orchestra.run.smithi008.stdout: { 2023-08-01T19:55:23.552 INFO:teuthology.orchestra.run.smithi008.stdout: "event": "dispatched", 2023-08-01T19:55:23.552 INFO:teuthology.orchestra.run.smithi008.stdout: "time": "2023-08-01T19:55:05.567706+0000", 2023-08-01T19:55:23.552 INFO:teuthology.orchestra.run.smithi008.stdout: "duration": 5.9739999999999999e-06 2023-08-01T19:55:23.552 INFO:teuthology.orchestra.run.smithi008.stdout: }, 2023-08-01T19:55:23.553 INFO:teuthology.orchestra.run.smithi008.stdout: { 2023-08-01T19:55:23.553 INFO:teuthology.orchestra.run.smithi008.stdout: "event": "queued_for_pg", 2023-08-01T19:55:23.553 INFO:teuthology.orchestra.run.smithi008.stdout: "time": "2023-08-01T19:55:05.567709+0000", 2023-08-01T19:55:23.553 INFO:teuthology.orchestra.run.smithi008.stdout: "duration": 3.1420000000000002e-06 2023-08-01T19:55:23.553 INFO:teuthology.orchestra.run.smithi008.stdout: }, 2023-08-01T19:55:23.553 INFO:teuthology.orchestra.run.smithi008.stdout: { 2023-08-01T19:55:23.553 INFO:teuthology.orchestra.run.smithi008.stdout: "event": "reached_pg", 2023-08-01T19:55:23.553 INFO:teuthology.orchestra.run.smithi008.stdout: "time": "2023-08-01T19:55:05.567741+0000", 2023-08-01T19:55:23.554 INFO:teuthology.orchestra.run.smithi008.stdout: "duration": 3.1532999999999998e-05 2023-08-01T19:55:23.554 INFO:teuthology.orchestra.run.smithi008.stdout: }, 2023-08-01T19:55:23.554 INFO:teuthology.orchestra.run.smithi008.stdout: { 2023-08-01T19:55:23.554 INFO:teuthology.orchestra.run.smithi008.stdout: "event": "started", 2023-08-01T19:55:23.554 INFO:teuthology.orchestra.run.smithi008.stdout: "time": "2023-08-01T19:55:05.567752+0000", 2023-08-01T19:55:23.554 INFO:teuthology.orchestra.run.smithi008.stdout: "duration": 1.1266e-05 2023-08-01T19:55:23.554 INFO:teuthology.orchestra.run.smithi008.stdout: }, 2023-08-01T19:55:23.554 INFO:teuthology.orchestra.run.smithi008.stdout: { 2023-08-01T19:55:23.555 INFO:teuthology.orchestra.run.smithi008.stdout: "event": "commit_sent", 2023-08-01T19:55:23.555 INFO:teuthology.orchestra.run.smithi008.stdout: "time": "2023-08-01T19:55:05.630357+0000", 2023-08-01T19:55:23.555 INFO:teuthology.orchestra.run.smithi008.stdout: "duration": 0.062604554000000007 2023-08-01T19:55:23.555 INFO:teuthology.orchestra.run.smithi008.stdout: }, 2023-08-01T19:55:23.555 INFO:teuthology.orchestra.run.smithi008.stdout: { 2023-08-01T19:55:23.555 INFO:teuthology.orchestra.run.smithi008.stdout: "event": "done", 2023-08-01T19:55:23.555 INFO:teuthology.orchestra.run.smithi008.stdout: "time": "2023-08-01T19:55:05.630391+0000", 2023-08-01T19:55:23.555 INFO:teuthology.orchestra.run.smithi008.stdout: "duration": 3.4619000000000002e-05 2023-08-01T19:55:23.556 INFO:teuthology.orchestra.run.smithi008.stdout: } 2023-08-01T19:55:23.556 INFO:teuthology.orchestra.run.smithi008.stdout: ] 2023-08-01T19:55:23.556 INFO:teuthology.orchestra.run.smithi008.stdout: } 2023-08-01T19:55:23.556 INFO:teuthology.orchestra.run.smithi008.stdout: }, 2023-08-01T19:55:23.556 INFO:teuthology.orchestra.run.smithi008.stdout: { 2023-08-01T19:55:23.556 INFO:teuthology.orchestra.run.smithi008.stdout: "description": "osd_op(client.4668.0:100937 5.c 5:34445fc3:::benchmark_data_smithi006_114134_object100936:head [set-alloc-hint object_size 65536 write_size 65536,write 0~65536] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e37)", 2023-08-01T19:55:23.556 INFO:teuthology.orchestra.run.smithi008.stdout: "initiated_at": "2023-08-01T19:55:05.569198+0000", 2023-08-01T19:55:23.557 INFO:teuthology.orchestra.run.smithi008.stdout: "age": 17.874438519000002, 2023-08-01T19:55:23.557 INFO:teuthology.orchestra.run.smithi008.stdout: "duration": 0.063349390000000005, 2023-08-01T19:55:23.557 INFO:teuthology.orchestra.run.smithi008.stdout: "type_data": { 2023-08-01T19:55:23.557 INFO:teuthology.orchestra.run.smithi008.stdout: "flag_point": "commit sent; apply or cleanup", 2023-08-01T19:55:23.558 INFO:teuthology.orchestra.run.smithi008.stdout: "client_info": { 2023-08-01T19:55:23.558 INFO:teuthology.orchestra.run.smithi008.stdout: "client": "client.4668", 2023-08-01T19:55:23.558 INFO:teuthology.orchestra.run.smithi008.stdout: "client_addr": "172.21.15.6:0/1709472247", 2023-08-01T19:55:23.558 INFO:teuthology.orchestra.run.smithi008.stdout: "tid": 100937 2023-08-01T19:55:23.558 INFO:teuthology.orchestra.run.smithi008.stdout: }, 2023-08-01T19:55:23.558 INFO:teuthology.orchestra.run.smithi008.stdout: "events": [ 2023-08-01T19:55:23.559 INFO:teuthology.orchestra.run.smithi008.stdout: { 2023-08-01T19:55:23.559 INFO:teuthology.orchestra.run.smithi008.stdout: "event": "initiated", 2023-08-01T19:55:23.559 INFO:teuthology.orchestra.run.smithi008.stdout: "time": "2023-08-01T19:55:05.569198+0000", 2023-08-01T19:55:23.559 INFO:teuthology.orchestra.run.smithi008.stdout: "duration": 0 2023-08-01T19:55:23.559 INFO:teuthology.orchestra.run.smithi008.stdout: }, 2023-08-01T19:55:23.559 INFO:teuthology.orchestra.run.smithi008.stdout: { 2023-08-01T19:55:23.559 INFO:teuthology.orchestra.run.smithi008.stdout: "event": "throttled", 2023-08-01T19:55:23.559 INFO:teuthology.orchestra.run.smithi008.stdout: "time": "2023-08-01T19:55:05.569198+0000", 2023-08-01T19:55:23.560 INFO:teuthology.orchestra.run.smithi008.stdout: "duration": 0 2023-08-01T19:55:23.560 INFO:teuthology.orchestra.run.smithi008.stdout: }, 2023-08-01T19:55:23.560 INFO:teuthology.orchestra.run.smithi008.stdout: { 2023-08-01T19:55:23.560 INFO:teuthology.orchestra.run.smithi008.stdout: "event": "header_read", 2023-08-01T19:55:23.560 INFO:teuthology.orchestra.run.smithi008.stdout: "time": "2023-08-01T19:55:05.569197+0000", 2023-08-01T19:55:23.560 INFO:teuthology.orchestra.run.smithi008.stdout: "duration": 4294967295.999999 2023-08-01T19:55:23.560 INFO:teuthology.orchestra.run.smithi008.stdout: }, 2023-08-01T19:55:23.561 INFO:teuthology.orchestra.run.smithi008.stdout: { 2023-08-01T19:55:23.561 INFO:teuthology.orchestra.run.smithi008.stdout: "event": "all_read", 2023-08-01T19:55:23.561 INFO:teuthology.orchestra.run.smithi008.stdout: "time": "2023-08-01T19:55:05.569250+0000", 2023-08-01T19:55:23.561 INFO:teuthology.orchestra.run.smithi008.stdout: "duration": 5.3106000000000003e-05 2023-08-01T19:55:23.561 INFO:teuthology.orchestra.run.smithi008.stdout: }, 2023-08-01T19:55:23.561 INFO:teuthology.orchestra.run.smithi008.stdout: { 2023-08-01T19:55:23.561 INFO:teuthology.orchestra.run.smithi008.stdout: "event": "dispatched", 2023-08-01T19:55:23.561 INFO:teuthology.orchestra.run.smithi008.stdout: "time": "2023-08-01T19:55:05.569260+0000", 2023-08-01T19:55:23.562 INFO:teuthology.orchestra.run.smithi008.stdout: "duration": 9.533e-06 2023-08-01T19:55:23.562 INFO:teuthology.orchestra.run.smithi008.stdout: }, 2023-08-01T19:55:23.562 INFO:teuthology.orchestra.run.smithi008.stdout: { 2023-08-01T19:55:23.562 INFO:teuthology.orchestra.run.smithi008.stdout: "event": "queued_for_pg", 2023-08-01T19:55:23.562 INFO:teuthology.orchestra.run.smithi008.stdout: "time": "2023-08-01T19:55:05.569264+0000", 2023-08-01T19:55:23.562 INFO:teuthology.orchestra.run.smithi008.stdout: "duration": 4.6099999999999999e-06 2023-08-01T19:55:23.562 INFO:teuthology.orchestra.run.smithi008.stdout: }, 2023-08-01T19:55:23.562 INFO:teuthology.orchestra.run.smithi008.stdout: { 2023-08-01T19:55:23.563 INFO:teuthology.orchestra.run.smithi008.stdout: "event": "reached_pg", 2023-08-01T19:55:23.563 INFO:teuthology.orchestra.run.smithi008.stdout: "time": "2023-08-01T19:55:05.569293+0000", 2023-08-01T19:55:23.563 INFO:teuthology.orchestra.run.smithi008.stdout: "duration": 2.8181999999999999e-05 2023-08-01T19:55:23.563 INFO:teuthology.orchestra.run.smithi008.stdout: }, 2023-08-01T19:55:23.563 INFO:teuthology.orchestra.run.smithi008.stdout: { 2023-08-01T19:55:23.563 INFO:teuthology.orchestra.run.smithi008.stdout: "event": "started", 2023-08-01T19:55:23.563 INFO:teuthology.orchestra.run.smithi008.stdout: "time": "2023-08-01T19:55:05.569401+0000", 2023-08-01T19:55:23.563 INFO:teuthology.orchestra.run.smithi008.stdout: "duration": 0.000108065 2023-08-01T19:55:23.564 INFO:teuthology.orchestra.run.smithi008.stdout: }, 2023-08-01T19:55:23.564 INFO:teuthology.orchestra.run.smithi008.stdout: { 2023-08-01T19:55:23.564 INFO:teuthology.orchestra.run.smithi008.stdout: "event": "waiting for subops from 1", 2023-08-01T19:55:23.564 INFO:teuthology.orchestra.run.smithi008.stdout: "time": "2023-08-01T19:55:05.569521+0000", 2023-08-01T19:55:23.564 INFO:teuthology.orchestra.run.smithi008.stdout: "duration": 0.00012006900000000001 2023-08-01T19:55:23.564 INFO:teuthology.orchestra.run.smithi008.stdout: }, 2023-08-01T19:55:23.564 INFO:teuthology.orchestra.run.smithi008.stdout: { 2023-08-01T19:55:23.565 INFO:teuthology.orchestra.run.smithi008.stdout: "event": "sub_op_commit_rec", 2023-08-01T19:55:23.565 INFO:teuthology.orchestra.run.smithi008.stdout: "time": "2023-08-01T19:55:05.629421+0000", 2023-08-01T19:55:23.565 INFO:teuthology.orchestra.run.smithi008.stdout: "duration": 0.059900525000000003 2023-08-01T19:55:23.565 INFO:teuthology.orchestra.run.smithi008.stdout: }, 2023-08-01T19:55:23.565 INFO:teuthology.orchestra.run.smithi008.stdout: { 2023-08-01T19:55:23.565 INFO:teuthology.orchestra.run.smithi008.stdout: "event": "op_commit", 2023-08-01T19:55:23.565 INFO:teuthology.orchestra.run.smithi008.stdout: "time": "2023-08-01T19:55:05.632461+0000", 2023-08-01T19:55:23.565 INFO:teuthology.orchestra.run.smithi008.stdout: "duration": 0.0030401220000000001 2023-08-01T19:55:23.566 INFO:teuthology.orchestra.run.smithi008.stdout: }, 2023-08-01T19:55:23.566 INFO:teuthology.orchestra.run.smithi008.stdout: { 2023-08-01T19:55:23.566 INFO:teuthology.orchestra.run.smithi008.stdout: "event": "commit_sent", 2023-08-01T19:55:23.566 INFO:teuthology.orchestra.run.smithi008.stdout: "time": "2023-08-01T19:55:05.632507+0000", 2023-08-01T19:55:23.566 INFO:teuthology.orchestra.run.smithi008.stdout: "duration": 4.5361999999999997e-05 2023-08-01T19:55:23.566 INFO:teuthology.orchestra.run.smithi008.stdout: }, 2023-08-01T19:55:23.566 INFO:teuthology.orchestra.run.smithi008.stdout: { 2023-08-01T19:55:23.566 INFO:teuthology.orchestra.run.smithi008.stdout: "event": "done", 2023-08-01T19:55:23.567 INFO:teuthology.orchestra.run.smithi008.stdout: "time": "2023-08-01T19:55:05.632547+0000", 2023-08-01T19:55:23.567 INFO:teuthology.orchestra.run.smithi008.stdout: "duration": 4.0760999999999998e-05 2023-08-01T19:55:23.567 INFO:teuthology.orchestra.run.smithi008.stdout: } 2023-08-01T19:55:23.567 INFO:teuthology.orchestra.run.smithi008.stdout: ] 2023-08-01T19:55:23.567 INFO:teuthology.orchestra.run.smithi008.stdout: } 2023-08-01T19:55:23.567 INFO:teuthology.orchestra.run.smithi008.stdout: }, 2023-08-01T19:55:23.567 INFO:teuthology.orchestra.run.smithi008.stdout: { 2023-08-01T19:55:23.567 INFO:teuthology.orchestra.run.smithi008.stdout: "description": "osd_op(client.4668.0:100939 5.5 5:a75fa6e3:::benchmark_data_smithi006_114134_object100938:head [set-alloc-hint object_size 65536 write_size 65536,write 0~65536] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e37)", 2023-08-01T19:55:23.568 INFO:teuthology.orchestra.run.smithi008.stdout: "initiated_at": "2023-08-01T19:55:05.569740+0000", 2023-08-01T19:55:23.568 INFO:teuthology.orchestra.run.smithi008.stdout: "age": 17.873896977000001, 2023-08-01T19:55:23.568 INFO:teuthology.orchestra.run.smithi008.stdout: "duration": 0.067753412999999998, 2023-08-01T19:55:23.568 INFO:teuthology.orchestra.run.smithi008.stdout: "type_data": { 2023-08-01T19:55:23.568 INFO:teuthology.orchestra.run.smithi008.stdout: "flag_point": "commit sent; apply or cleanup", 2023-08-01T19:55:23.568 INFO:teuthology.orchestra.run.smithi008.stdout: "client_info": { 2023-08-01T19:55:23.568 INFO:teuthology.orchestra.run.smithi008.stdout: "client": "client.4668", 2023-08-01T19:55:23.568 INFO:teuthology.orchestra.run.smithi008.stdout: "client_addr": "172.21.15.6:0/1709472247", 2023-08-01T19:55:23.569 INFO:teuthology.orchestra.run.smithi008.stdout: "tid": 100939 2023-08-01T19:55:23.569 INFO:teuthology.orchestra.run.smithi008.stdout: }, 2023-08-01T19:55:23.569 INFO:teuthology.orchestra.run.smithi008.stdout: "events": [ 2023-08-01T19:55:23.569 INFO:teuthology.orchestra.run.smithi008.stdout: { 2023-08-01T19:55:23.569 INFO:teuthology.orchestra.run.smithi008.stdout: "event": "initiated", 2023-08-01T19:55:23.569 INFO:teuthology.orchestra.run.smithi008.stdout: "time": "2023-08-01T19:55:05.569740+0000", 2023-08-01T19:55:23.569 INFO:teuthology.orchestra.run.smithi008.stdout: "duration": 0 2023-08-01T19:55:23.569 INFO:teuthology.orchestra.run.smithi008.stdout: }, 2023-08-01T19:55:23.570 INFO:teuthology.orchestra.run.smithi008.stdout: { 2023-08-01T19:55:23.570 INFO:teuthology.orchestra.run.smithi008.stdout: "event": "throttled", 2023-08-01T19:55:23.570 INFO:teuthology.orchestra.run.smithi008.stdout: "time": "2023-08-01T19:55:05.569740+0000", 2023-08-01T19:55:23.570 INFO:teuthology.orchestra.run.smithi008.stdout: "duration": 0 2023-08-01T19:55:23.570 INFO:teuthology.orchestra.run.smithi008.stdout: }, 2023-08-01T19:55:23.570 INFO:teuthology.orchestra.run.smithi008.stdout: { 2023-08-01T19:55:23.570 INFO:teuthology.orchestra.run.smithi008.stdout: "event": "header_read", 2023-08-01T19:55:23.570 INFO:teuthology.orchestra.run.smithi008.stdout: "time": "2023-08-01T19:55:05.569739+0000", 2023-08-01T19:55:23.571 INFO:teuthology.orchestra.run.smithi008.stdout: "duration": 4294967295.9999995 2023-08-01T19:55:23.571 INFO:teuthology.orchestra.run.smithi008.stdout: }, 2023-08-01T19:55:23.571 INFO:teuthology.orchestra.run.smithi008.stdout: { 2023-08-01T19:55:23.571 INFO:teuthology.orchestra.run.smithi008.stdout: "event": "all_read", 2023-08-01T19:55:23.571 INFO:teuthology.orchestra.run.smithi008.stdout: "time": "2023-08-01T19:55:05.569839+0000", 2023-08-01T19:55:23.571 INFO:teuthology.orchestra.run.smithi008.stdout: "duration": 0.000100219 2023-08-01T19:55:23.571 INFO:teuthology.orchestra.run.smithi008.stdout: }, 2023-08-01T19:55:23.572 INFO:teuthology.orchestra.run.smithi008.stdout: { 2023-08-01T19:55:23.572 INFO:teuthology.orchestra.run.smithi008.stdout: "event": "dispatched", 2023-08-01T19:55:23.572 INFO:teuthology.orchestra.run.smithi008.stdout: "time": "2023-08-01T19:55:05.569846+0000", 2023-08-01T19:55:23.572 INFO:teuthology.orchestra.run.smithi008.stdout: "duration": 7.3150000000000003e-06 2023-08-01T19:55:23.572 INFO:teuthology.orchestra.run.smithi008.stdout: }, 2023-08-01T19:55:23.572 INFO:teuthology.orchestra.run.smithi008.stdout: { 2023-08-01T19:55:23.572 INFO:teuthology.orchestra.run.smithi008.stdout: "event": "queued_for_pg", 2023-08-01T19:55:23.573 INFO:teuthology.orchestra.run.smithi008.stdout: "time": "2023-08-01T19:55:05.569850+0000", 2023-08-01T19:55:23.573 INFO:teuthology.orchestra.run.smithi008.stdout: "duration": 3.3299999999999999e-06 2023-08-01T19:55:23.573 INFO:teuthology.orchestra.run.smithi008.stdout: }, 2023-08-01T19:55:23.573 INFO:teuthology.orchestra.run.smithi008.stdout: { 2023-08-01T19:55:23.573 INFO:teuthology.orchestra.run.smithi008.stdout: "event": "reached_pg", 2023-08-01T19:55:23.573 INFO:teuthology.orchestra.run.smithi008.stdout: "time": "2023-08-01T19:55:05.626991+0000", 2023-08-01T19:55:23.573 INFO:teuthology.orchestra.run.smithi008.stdout: "duration": 0.057141585000000002 2023-08-01T19:55:23.573 INFO:teuthology.orchestra.run.smithi008.stdout: }, 2023-08-01T19:55:23.574 INFO:teuthology.orchestra.run.smithi008.stdout: { 2023-08-01T19:55:23.574 INFO:teuthology.orchestra.run.smithi008.stdout: "event": "started", 2023-08-01T19:55:23.574 INFO:teuthology.orchestra.run.smithi008.stdout: "time": "2023-08-01T19:55:05.627111+0000", 2023-08-01T19:55:23.574 INFO:teuthology.orchestra.run.smithi008.stdout: "duration": 0.000119238 2023-08-01T19:55:23.574 INFO:teuthology.orchestra.run.smithi008.stdout: }, 2023-08-01T19:55:23.574 INFO:teuthology.orchestra.run.smithi008.stdout: { 2023-08-01T19:55:23.574 INFO:teuthology.orchestra.run.smithi008.stdout: "event": "waiting for subops from 1", 2023-08-01T19:55:23.574 INFO:teuthology.orchestra.run.smithi008.stdout: "time": "2023-08-01T19:55:05.627253+0000", 2023-08-01T19:55:23.575 INFO:teuthology.orchestra.run.smithi008.stdout: "duration": 0.000142822 2023-08-01T19:55:23.575 INFO:teuthology.orchestra.run.smithi008.stdout: }, 2023-08-01T19:55:23.575 INFO:teuthology.orchestra.run.smithi008.stdout: { 2023-08-01T19:55:23.575 INFO:teuthology.orchestra.run.smithi008.stdout: "event": "op_commit", 2023-08-01T19:55:23.575 INFO:teuthology.orchestra.run.smithi008.stdout: "time": "2023-08-01T19:55:05.632555+0000", 2023-08-01T19:55:23.575 INFO:teuthology.orchestra.run.smithi008.stdout: "duration": 0.0053012449999999996 2023-08-01T19:55:23.575 INFO:teuthology.orchestra.run.smithi008.stdout: }, 2023-08-01T19:55:23.575 INFO:teuthology.orchestra.run.smithi008.stdout: { 2023-08-01T19:55:23.576 INFO:teuthology.orchestra.run.smithi008.stdout: "event": "sub_op_commit_rec", 2023-08-01T19:55:23.576 INFO:teuthology.orchestra.run.smithi008.stdout: "time": "2023-08-01T19:55:05.637380+0000", 2023-08-01T19:55:23.576 INFO:teuthology.orchestra.run.smithi008.stdout: "duration": 0.0048257639999999997 2023-08-01T19:55:23.576 INFO:teuthology.orchestra.run.smithi008.stdout: }, 2023-08-01T19:55:23.576 INFO:teuthology.orchestra.run.smithi008.stdout: { 2023-08-01T19:55:23.576 INFO:teuthology.orchestra.run.smithi008.stdout: "event": "commit_sent", 2023-08-01T19:55:23.576 INFO:teuthology.orchestra.run.smithi008.stdout: "time": "2023-08-01T19:55:05.637454+0000", 2023-08-01T19:55:23.577 INFO:teuthology.orchestra.run.smithi008.stdout: "duration": 7.3578999999999995e-05 2023-08-01T19:55:23.577 INFO:teuthology.orchestra.run.smithi008.stdout: }, 2023-08-01T19:55:23.577 INFO:teuthology.orchestra.run.smithi008.stdout: { 2023-08-01T19:55:23.577 INFO:teuthology.orchestra.run.smithi008.stdout: "event": "done", 2023-08-01T19:55:23.577 INFO:teuthology.orchestra.run.smithi008.stdout: "time": "2023-08-01T19:55:05.637493+0000", 2023-08-01T19:55:23.577 INFO:teuthology.orchestra.run.smithi008.stdout: "duration": 3.8986999999999998e-05 2023-08-01T19:55:23.577 INFO:teuthology.orchestra.run.smithi008.stdout: } 2023-08-01T19:55:23.577 INFO:teuthology.orchestra.run.smithi008.stdout: ] 2023-08-01T19:55:23.578 INFO:teuthology.orchestra.run.smithi008.stdout: } 2023-08-01T19:55:23.578 INFO:teuthology.orchestra.run.smithi008.stdout: }, 2023-08-01T19:55:23.578 INFO:teuthology.orchestra.run.smithi008.stdout: { 2023-08-01T19:55:23.578 INFO:teuthology.orchestra.run.smithi008.stdout: "description": "osd_repop(client.4668.0:100941 5.e e37/19 5:736a6ac6:::benchmark_data_smithi006_114134_object100940:head v 37'6306, mlcod=37'6303)", 2023-08-01T19:55:23.578 INFO:teuthology.orchestra.run.smithi008.stdout: "initiated_at": "2023-08-01T19:55:05.570237+0000", 2023-08-01T19:55:23.578 INFO:teuthology.orchestra.run.smithi008.stdout: "age": 17.873399667000001, 2023-08-01T19:55:23.578 INFO:teuthology.orchestra.run.smithi008.stdout: "duration": 0.064830421999999999, 2023-08-01T19:55:23.578 INFO:teuthology.orchestra.run.smithi008.stdout: "type_data": { 2023-08-01T19:55:23.579 INFO:teuthology.orchestra.run.smithi008.stdout: "flag_point": "commit sent; apply or cleanup", 2023-08-01T19:55:23.579 INFO:teuthology.orchestra.run.smithi008.stdout: "events": [ 2023-08-01T19:55:23.579 INFO:teuthology.orchestra.run.smithi008.stdout: { 2023-08-01T19:55:23.579 INFO:teuthology.orchestra.run.smithi008.stdout: "event": "initiated", 2023-08-01T19:55:23.579 INFO:teuthology.orchestra.run.smithi008.stdout: "time": "2023-08-01T19:55:05.570237+0000", 2023-08-01T19:55:23.579 INFO:teuthology.orchestra.run.smithi008.stdout: "duration": 0 2023-08-01T19:55:23.579 INFO:teuthology.orchestra.run.smithi008.stdout: }, 2023-08-01T19:55:23.579 INFO:teuthology.orchestra.run.smithi008.stdout: { 2023-08-01T19:55:23.580 INFO:teuthology.orchestra.run.smithi008.stdout: "event": "throttled", 2023-08-01T19:55:23.580 INFO:teuthology.orchestra.run.smithi008.stdout: "time": "2023-08-01T19:55:05.570237+0000", 2023-08-01T19:55:23.580 INFO:teuthology.orchestra.run.smithi008.stdout: "duration": 0 2023-08-01T19:55:23.580 INFO:teuthology.orchestra.run.smithi008.stdout: }, 2023-08-01T19:55:23.580 INFO:teuthology.orchestra.run.smithi008.stdout: { 2023-08-01T19:55:23.580 INFO:teuthology.orchestra.run.smithi008.stdout: "event": "header_read", 2023-08-01T19:55:23.580 INFO:teuthology.orchestra.run.smithi008.stdout: "time": "2023-08-01T19:55:05.570236+0000", 2023-08-01T19:55:23.580 INFO:teuthology.orchestra.run.smithi008.stdout: "duration": 4294967295.9999995 2023-08-01T19:55:23.581 INFO:teuthology.orchestra.run.smithi008.stdout: }, 2023-08-01T19:55:23.581 INFO:teuthology.orchestra.run.smithi008.stdout: { 2023-08-01T19:55:23.581 INFO:teuthology.orchestra.run.smithi008.stdout: "event": "all_read", 2023-08-01T19:55:23.581 INFO:teuthology.orchestra.run.smithi008.stdout: "time": "2023-08-01T19:55:05.570354+0000", 2023-08-01T19:55:23.581 INFO:teuthology.orchestra.run.smithi008.stdout: "duration": 0.000118029 2023-08-01T19:55:23.581 INFO:teuthology.orchestra.run.smithi008.stdout: }, 2023-08-01T19:55:23.581 INFO:teuthology.orchestra.run.smithi008.stdout: { 2023-08-01T19:55:23.582 INFO:teuthology.orchestra.run.smithi008.stdout: "event": "dispatched", 2023-08-01T19:55:23.582 INFO:teuthology.orchestra.run.smithi008.stdout: "time": "2023-08-01T19:55:05.626649+0000", 2023-08-01T19:55:23.582 INFO:teuthology.orchestra.run.smithi008.stdout: "duration": 0.056294489000000003 2023-08-01T19:55:23.582 INFO:teuthology.orchestra.run.smithi008.stdout: }, 2023-08-01T19:55:23.582 INFO:teuthology.orchestra.run.smithi008.stdout: { 2023-08-01T19:55:23.582 INFO:teuthology.orchestra.run.smithi008.stdout: "event": "queued_for_pg", 2023-08-01T19:55:23.582 INFO:teuthology.orchestra.run.smithi008.stdout: "time": "2023-08-01T19:55:05.626676+0000", 2023-08-01T19:55:23.582 INFO:teuthology.orchestra.run.smithi008.stdout: "duration": 2.7228000000000001e-05 2023-08-01T19:55:23.583 INFO:teuthology.orchestra.run.smithi008.stdout: }, 2023-08-01T19:55:23.583 INFO:teuthology.orchestra.run.smithi008.stdout: { 2023-08-01T19:55:23.583 INFO:teuthology.orchestra.run.smithi008.stdout: "event": "reached_pg", 2023-08-01T19:55:23.583 INFO:teuthology.orchestra.run.smithi008.stdout: "time": "2023-08-01T19:55:05.626717+0000", 2023-08-01T19:55:23.583 INFO:teuthology.orchestra.run.smithi008.stdout: "duration": 4.1318e-05 2023-08-01T19:55:23.583 INFO:teuthology.orchestra.run.smithi008.stdout: }, 2023-08-01T19:55:23.583 INFO:teuthology.orchestra.run.smithi008.stdout: { 2023-08-01T19:55:23.584 INFO:teuthology.orchestra.run.smithi008.stdout: "event": "started", 2023-08-01T19:55:23.584 INFO:teuthology.orchestra.run.smithi008.stdout: "time": "2023-08-01T19:55:05.626737+0000", 2023-08-01T19:55:23.584 INFO:teuthology.orchestra.run.smithi008.stdout: "duration": 1.9415e-05 2023-08-01T19:55:23.584 INFO:teuthology.orchestra.run.smithi008.stdout: }, 2023-08-01T19:55:23.584 INFO:teuthology.orchestra.run.smithi008.stdout: { 2023-08-01T19:55:23.584 INFO:teuthology.orchestra.run.smithi008.stdout: "event": "commit_sent", 2023-08-01T19:55:23.584 INFO:teuthology.orchestra.run.smithi008.stdout: "time": "2023-08-01T19:55:05.635036+0000", 2023-08-01T19:55:23.584 INFO:teuthology.orchestra.run.smithi008.stdout: "duration": 0.0082987700000000005 2023-08-01T19:55:23.585 INFO:teuthology.orchestra.run.smithi008.stdout: }, 2023-08-01T19:55:23.585 INFO:teuthology.orchestra.run.smithi008.stdout: { 2023-08-01T19:55:23.585 INFO:teuthology.orchestra.run.smithi008.stdout: "event": "done", 2023-08-01T19:55:23.585 INFO:teuthology.orchestra.run.smithi008.stdout: "time": "2023-08-01T19:55:05.635067+0000", 2023-08-01T19:55:23.585 INFO:teuthology.orchestra.run.smithi008.stdout: "duration": 3.1786999999999999e-05 2023-08-01T19:55:23.585 INFO:teuthology.orchestra.run.smithi008.stdout: } 2023-08-01T19:55:23.585 INFO:teuthology.orchestra.run.smithi008.stdout: ] 2023-08-01T19:55:23.585 INFO:teuthology.orchestra.run.smithi008.stdout: } 2023-08-01T19:55:23.586 INFO:teuthology.orchestra.run.smithi008.stdout: }, 2023-08-01T19:55:23.586 INFO:teuthology.orchestra.run.smithi008.stdout: { 2023-08-01T19:55:23.586 INFO:teuthology.orchestra.run.smithi008.stdout: "description": "osd_op(client.4668.0:107863 5.3 5:cbdd875a:::benchmark_data_smithi006_114134_object107862:head [set-alloc-hint object_size 65536 write_size 65536,write 0~65536] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e38)", 2023-08-01T19:55:23.586 INFO:teuthology.orchestra.run.smithi008.stdout: "initiated_at": "2023-08-01T19:55:09.278851+0000", 2023-08-01T19:55:23.586 INFO:teuthology.orchestra.run.smithi008.stdout: "age": 14.164785237, 2023-08-01T19:55:23.586 INFO:teuthology.orchestra.run.smithi008.stdout: "duration": 0.071378853000000006, 2023-08-01T19:55:23.586 INFO:teuthology.orchestra.run.smithi008.stdout: "type_data": { 2023-08-01T19:55:23.586 INFO:teuthology.orchestra.run.smithi008.stdout: "flag_point": "commit sent; apply or cleanup", 2023-08-01T19:55:23.587 INFO:teuthology.orchestra.run.smithi008.stdout: "client_info": { 2023-08-01T19:55:23.587 INFO:teuthology.orchestra.run.smithi008.stdout: "client": "client.4668", 2023-08-01T19:55:23.587 INFO:teuthology.orchestra.run.smithi008.stdout: "client_addr": "172.21.15.6:0/1709472247", 2023-08-01T19:55:23.587 INFO:teuthology.orchestra.run.smithi008.stdout: "tid": 107863 2023-08-01T19:55:23.587 INFO:teuthology.orchestra.run.smithi008.stdout: }, 2023-08-01T19:55:23.587 INFO:teuthology.orchestra.run.smithi008.stdout: "events": [ 2023-08-01T19:55:23.587 INFO:teuthology.orchestra.run.smithi008.stdout: { 2023-08-01T19:55:23.587 INFO:teuthology.orchestra.run.smithi008.stdout: "event": "initiated", 2023-08-01T19:55:23.588 INFO:teuthology.orchestra.run.smithi008.stdout: "time": "2023-08-01T19:55:09.278851+0000", 2023-08-01T19:55:23.588 INFO:teuthology.orchestra.run.smithi008.stdout: "duration": 0 2023-08-01T19:55:23.588 INFO:teuthology.orchestra.run.smithi008.stdout: }, 2023-08-01T19:55:23.588 INFO:teuthology.orchestra.run.smithi008.stdout: { 2023-08-01T19:55:23.588 INFO:teuthology.orchestra.run.smithi008.stdout: "event": "throttled", 2023-08-01T19:55:23.588 INFO:teuthology.orchestra.run.smithi008.stdout: "time": "2023-08-01T19:55:09.278851+0000", 2023-08-01T19:55:23.588 INFO:teuthology.orchestra.run.smithi008.stdout: "duration": 0 2023-08-01T19:55:23.589 INFO:teuthology.orchestra.run.smithi008.stdout: }, 2023-08-01T19:55:23.589 INFO:teuthology.orchestra.run.smithi008.stdout: { 2023-08-01T19:55:23.589 INFO:teuthology.orchestra.run.smithi008.stdout: "event": "header_read", 2023-08-01T19:55:23.590 INFO:teuthology.orchestra.run.smithi008.stdout: "time": "2023-08-01T19:55:09.278850+0000", 2023-08-01T19:55:23.590 INFO:teuthology.orchestra.run.smithi008.stdout: "duration": 4294967295.999999 2023-08-01T19:55:23.590 INFO:teuthology.orchestra.run.smithi008.stdout: }, 2023-08-01T19:55:23.591 INFO:teuthology.orchestra.run.smithi008.stdout: { 2023-08-01T19:55:23.591 INFO:teuthology.orchestra.run.smithi008.stdout: "event": "all_read", 2023-08-01T19:55:23.591 INFO:teuthology.orchestra.run.smithi008.stdout: "time": "2023-08-01T19:55:09.278945+0000", 2023-08-01T19:55:23.591 INFO:teuthology.orchestra.run.smithi008.stdout: "duration": 9.4388000000000005e-05 2023-08-01T19:55:23.592 INFO:teuthology.orchestra.run.smithi008.stdout: }, 2023-08-01T19:55:23.592 INFO:teuthology.orchestra.run.smithi008.stdout: { 2023-08-01T19:55:23.592 INFO:teuthology.orchestra.run.smithi008.stdout: "event": "dispatched", 2023-08-01T19:55:23.593 INFO:teuthology.orchestra.run.smithi008.stdout: "time": "2023-08-01T19:55:09.278955+0000", 2023-08-01T19:55:23.593 INFO:teuthology.orchestra.run.smithi008.stdout: "duration": 1.0413e-05 2023-08-01T19:55:23.593 INFO:teuthology.orchestra.run.smithi008.stdout: }, 2023-08-01T19:55:23.593 INFO:teuthology.orchestra.run.smithi008.stdout: { 2023-08-01T19:55:23.594 INFO:teuthology.orchestra.run.smithi008.stdout: "event": "queued_for_pg", 2023-08-01T19:55:23.594 INFO:teuthology.orchestra.run.smithi008.stdout: "time": "2023-08-01T19:55:09.278962+0000", 2023-08-01T19:55:23.594 INFO:teuthology.orchestra.run.smithi008.stdout: "duration": 6.2169999999999999e-06 2023-08-01T19:55:23.594 INFO:teuthology.orchestra.run.smithi008.stdout: }, 2023-08-01T19:55:23.595 INFO:teuthology.orchestra.run.smithi008.stdout: { 2023-08-01T19:55:23.595 INFO:teuthology.orchestra.run.smithi008.stdout: "event": "reached_pg", 2023-08-01T19:55:23.595 INFO:teuthology.orchestra.run.smithi008.stdout: "time": "2023-08-01T19:55:09.280363+0000", 2023-08-01T19:55:23.596 INFO:teuthology.orchestra.run.smithi008.stdout: "duration": 0.0014014489999999999 2023-08-01T19:55:23.596 INFO:teuthology.orchestra.run.smithi008.stdout: }, 2023-08-01T19:55:23.596 INFO:teuthology.orchestra.run.smithi008.stdout: { 2023-08-01T19:55:23.597 INFO:teuthology.orchestra.run.smithi008.stdout: "event": "started", 2023-08-01T19:55:23.597 INFO:teuthology.orchestra.run.smithi008.stdout: "time": "2023-08-01T19:55:09.280488+0000", 2023-08-01T19:55:23.597 INFO:teuthology.orchestra.run.smithi008.stdout: "duration": 0.00012474099999999999 2023-08-01T19:55:23.597 INFO:teuthology.orchestra.run.smithi008.stdout: }, 2023-08-01T19:55:23.597 INFO:teuthology.orchestra.run.smithi008.stdout: { 2023-08-01T19:55:23.597 INFO:teuthology.orchestra.run.smithi008.stdout: "event": "waiting for subops from 1", 2023-08-01T19:55:23.598 INFO:teuthology.orchestra.run.smithi008.stdout: "time": "2023-08-01T19:55:09.280626+0000", 2023-08-01T19:55:23.598 INFO:teuthology.orchestra.run.smithi008.stdout: "duration": 0.000138193 2023-08-01T19:55:23.598 INFO:teuthology.orchestra.run.smithi008.stdout: }, 2023-08-01T19:55:23.598 INFO:teuthology.orchestra.run.smithi008.stdout: { 2023-08-01T19:55:23.598 INFO:teuthology.orchestra.run.smithi008.stdout: "event": "op_commit", 2023-08-01T19:55:23.598 INFO:teuthology.orchestra.run.smithi008.stdout: "time": "2023-08-01T19:55:09.285958+0000", 2023-08-01T19:55:23.598 INFO:teuthology.orchestra.run.smithi008.stdout: "duration": 0.0053317130000000001 2023-08-01T19:55:23.598 INFO:teuthology.orchestra.run.smithi008.stdout: }, 2023-08-01T19:55:23.599 INFO:teuthology.orchestra.run.smithi008.stdout: { 2023-08-01T19:55:23.599 INFO:teuthology.orchestra.run.smithi008.stdout: "event": "sub_op_commit_rec", 2023-08-01T19:55:23.599 INFO:teuthology.orchestra.run.smithi008.stdout: "time": "2023-08-01T19:55:09.350151+0000", 2023-08-01T19:55:23.599 INFO:teuthology.orchestra.run.smithi008.stdout: "duration": 0.064193202000000005 2023-08-01T19:55:23.599 INFO:teuthology.orchestra.run.smithi008.stdout: }, 2023-08-01T19:55:23.599 INFO:teuthology.orchestra.run.smithi008.stdout: { 2023-08-01T19:55:23.599 INFO:teuthology.orchestra.run.smithi008.stdout: "event": "commit_sent", 2023-08-01T19:55:23.600 INFO:teuthology.orchestra.run.smithi008.stdout: "time": "2023-08-01T19:55:09.350188+0000", 2023-08-01T19:55:23.600 INFO:teuthology.orchestra.run.smithi008.stdout: "duration": 3.7549999999999998e-05 2023-08-01T19:55:23.600 INFO:teuthology.orchestra.run.smithi008.stdout: }, 2023-08-01T19:55:23.600 INFO:teuthology.orchestra.run.smithi008.stdout: { 2023-08-01T19:55:23.600 INFO:teuthology.orchestra.run.smithi008.stdout: "event": "done", 2023-08-01T19:55:23.600 INFO:teuthology.orchestra.run.smithi008.stdout: "time": "2023-08-01T19:55:09.350230+0000", 2023-08-01T19:55:23.600 INFO:teuthology.orchestra.run.smithi008.stdout: "duration": 4.1804999999999997e-05 2023-08-01T19:55:23.600 INFO:teuthology.orchestra.run.smithi008.stdout: } 2023-08-01T19:55:23.601 INFO:teuthology.orchestra.run.smithi008.stdout: ] 2023-08-01T19:55:23.601 INFO:teuthology.orchestra.run.smithi008.stdout: } 2023-08-01T19:55:23.601 INFO:teuthology.orchestra.run.smithi008.stdout: }, 2023-08-01T19:55:23.601 INFO:teuthology.orchestra.run.smithi008.stdout: { 2023-08-01T19:55:23.601 INFO:teuthology.orchestra.run.smithi008.stdout: "description": "osd_op(client.4668.0:107865 5.3 5:c2ebb96d:::benchmark_data_smithi006_114134_object107864:head [set-alloc-hint object_size 65536 write_size 65536,write 0~65536] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e38)", 2023-08-01T19:55:23.601 INFO:teuthology.orchestra.run.smithi008.stdout: "initiated_at": "2023-08-01T19:55:09.279020+0000", 2023-08-01T19:55:23.601 INFO:teuthology.orchestra.run.smithi008.stdout: "age": 14.164616564999999, 2023-08-01T19:55:23.601 INFO:teuthology.orchestra.run.smithi008.stdout: "duration": 0.072892565000000006, 2023-08-01T19:55:23.602 INFO:teuthology.orchestra.run.smithi008.stdout: "type_data": { 2023-08-01T19:55:23.602 INFO:teuthology.orchestra.run.smithi008.stdout: "flag_point": "commit sent; apply or cleanup", 2023-08-01T19:55:23.602 INFO:teuthology.orchestra.run.smithi008.stdout: "client_info": { 2023-08-01T19:55:23.602 INFO:teuthology.orchestra.run.smithi008.stdout: "client": "client.4668", 2023-08-01T19:55:23.602 INFO:teuthology.orchestra.run.smithi008.stdout: "client_addr": "172.21.15.6:0/1709472247", 2023-08-01T19:55:23.602 INFO:teuthology.orchestra.run.smithi008.stdout: "tid": 107865 2023-08-01T19:55:23.602 INFO:teuthology.orchestra.run.smithi008.stdout: }, 2023-08-01T19:55:23.602 INFO:teuthology.orchestra.run.smithi008.stdout: "events": [ 2023-08-01T19:55:23.603 INFO:teuthology.orchestra.run.smithi008.stdout: { 2023-08-01T19:55:23.603 INFO:teuthology.orchestra.run.smithi008.stdout: "event": "initiated", 2023-08-01T19:55:23.603 INFO:teuthology.orchestra.run.smithi008.stdout: "time": "2023-08-01T19:55:09.279020+0000", 2023-08-01T19:55:23.603 INFO:teuthology.orchestra.run.smithi008.stdout: "duration": 0 2023-08-01T19:55:23.603 INFO:teuthology.orchestra.run.smithi008.stdout: }, 2023-08-01T19:55:23.603 INFO:teuthology.orchestra.run.smithi008.stdout: { 2023-08-01T19:55:23.603 INFO:teuthology.orchestra.run.smithi008.stdout: "event": "throttled", 2023-08-01T19:55:23.604 INFO:teuthology.orchestra.run.smithi008.stdout: "time": "2023-08-01T19:55:09.279020+0000", 2023-08-01T19:55:23.604 INFO:teuthology.orchestra.run.smithi008.stdout: "duration": 0 2023-08-01T19:55:23.604 INFO:teuthology.orchestra.run.smithi008.stdout: }, 2023-08-01T19:55:23.604 INFO:teuthology.orchestra.run.smithi008.stdout: { 2023-08-01T19:55:23.605 INFO:teuthology.orchestra.run.smithi008.stdout: "event": "header_read", 2023-08-01T19:55:23.605 INFO:teuthology.orchestra.run.smithi008.stdout: "time": "2023-08-01T19:55:09.279019+0000", 2023-08-01T19:55:23.605 INFO:teuthology.orchestra.run.smithi008.stdout: "duration": 4294967295.999999 2023-08-01T19:55:23.605 INFO:teuthology.orchestra.run.smithi008.stdout: }, 2023-08-01T19:55:23.606 INFO:teuthology.orchestra.run.smithi008.stdout: { 2023-08-01T19:55:23.606 INFO:teuthology.orchestra.run.smithi008.stdout: "event": "all_read", 2023-08-01T19:55:23.606 INFO:teuthology.orchestra.run.smithi008.stdout: "time": "2023-08-01T19:55:09.279087+0000", 2023-08-01T19:55:23.606 INFO:teuthology.orchestra.run.smithi008.stdout: "duration": 6.8392000000000005e-05 2023-08-01T19:55:23.606 INFO:teuthology.orchestra.run.smithi008.stdout: }, 2023-08-01T19:55:23.607 INFO:teuthology.orchestra.run.smithi008.stdout: { 2023-08-01T19:55:23.607 INFO:teuthology.orchestra.run.smithi008.stdout: "event": "dispatched", 2023-08-01T19:55:23.607 INFO:teuthology.orchestra.run.smithi008.stdout: "time": "2023-08-01T19:55:09.279095+0000", 2023-08-01T19:55:23.607 INFO:teuthology.orchestra.run.smithi008.stdout: "duration": 8.0989999999999999e-06 2023-08-01T19:55:23.607 INFO:teuthology.orchestra.run.smithi008.stdout: }, 2023-08-01T19:55:23.607 INFO:teuthology.orchestra.run.smithi008.stdout: { 2023-08-01T19:55:23.608 INFO:teuthology.orchestra.run.smithi008.stdout: "event": "queued_for_pg", 2023-08-01T19:55:23.608 INFO:teuthology.orchestra.run.smithi008.stdout: "time": "2023-08-01T19:55:09.279101+0000", 2023-08-01T19:55:23.608 INFO:teuthology.orchestra.run.smithi008.stdout: "duration": 5.0390000000000004e-06 2023-08-01T19:55:23.608 INFO:teuthology.orchestra.run.smithi008.stdout: }, 2023-08-01T19:55:23.609 INFO:teuthology.orchestra.run.smithi008.stdout: { 2023-08-01T19:55:23.609 INFO:teuthology.orchestra.run.smithi008.stdout: "event": "reached_pg", 2023-08-01T19:55:23.609 INFO:teuthology.orchestra.run.smithi008.stdout: "time": "2023-08-01T19:55:09.282574+0000", 2023-08-01T19:55:23.609 INFO:teuthology.orchestra.run.smithi008.stdout: "duration": 0.0034730619999999999 2023-08-01T19:55:23.610 INFO:teuthology.orchestra.run.smithi008.stdout: }, 2023-08-01T19:55:23.610 INFO:teuthology.orchestra.run.smithi008.stdout: { 2023-08-01T19:55:23.610 INFO:teuthology.orchestra.run.smithi008.stdout: "event": "started", 2023-08-01T19:55:23.610 INFO:teuthology.orchestra.run.smithi008.stdout: "time": "2023-08-01T19:55:09.282705+0000", 2023-08-01T19:55:23.611 INFO:teuthology.orchestra.run.smithi008.stdout: "duration": 0.00013133400000000001 2023-08-01T19:55:23.611 INFO:teuthology.orchestra.run.smithi008.stdout: }, 2023-08-01T19:55:23.611 INFO:teuthology.orchestra.run.smithi008.stdout: { 2023-08-01T19:55:23.611 INFO:teuthology.orchestra.run.smithi008.stdout: "event": "waiting for subops from 1", 2023-08-01T19:55:23.611 INFO:teuthology.orchestra.run.smithi008.stdout: "time": "2023-08-01T19:55:09.283067+0000", 2023-08-01T19:55:23.612 INFO:teuthology.orchestra.run.smithi008.stdout: "duration": 0.00036195299999999998 2023-08-01T19:55:23.612 INFO:teuthology.orchestra.run.smithi008.stdout: }, 2023-08-01T19:55:23.612 INFO:teuthology.orchestra.run.smithi008.stdout: { 2023-08-01T19:55:23.612 INFO:teuthology.orchestra.run.smithi008.stdout: "event": "op_commit", 2023-08-01T19:55:23.613 INFO:teuthology.orchestra.run.smithi008.stdout: "time": "2023-08-01T19:55:09.288196+0000", 2023-08-01T19:55:23.613 INFO:teuthology.orchestra.run.smithi008.stdout: "duration": 0.0051293780000000004 2023-08-01T19:55:23.613 INFO:teuthology.orchestra.run.smithi008.stdout: }, 2023-08-01T19:55:23.613 INFO:teuthology.orchestra.run.smithi008.stdout: { 2023-08-01T19:55:23.613 INFO:teuthology.orchestra.run.smithi008.stdout: "event": "sub_op_commit_rec", 2023-08-01T19:55:23.614 INFO:teuthology.orchestra.run.smithi008.stdout: "time": "2023-08-01T19:55:09.351832+0000", 2023-08-01T19:55:23.614 INFO:teuthology.orchestra.run.smithi008.stdout: "duration": 0.063636076 2023-08-01T19:55:23.614 INFO:teuthology.orchestra.run.smithi008.stdout: }, 2023-08-01T19:55:23.614 INFO:teuthology.orchestra.run.smithi008.stdout: { 2023-08-01T19:55:23.615 INFO:teuthology.orchestra.run.smithi008.stdout: "event": "commit_sent", 2023-08-01T19:55:23.615 INFO:teuthology.orchestra.run.smithi008.stdout: "time": "2023-08-01T19:55:09.351878+0000", 2023-08-01T19:55:23.615 INFO:teuthology.orchestra.run.smithi008.stdout: "duration": 4.5408999999999998e-05 2023-08-01T19:55:23.615 INFO:teuthology.orchestra.run.smithi008.stdout: }, 2023-08-01T19:55:23.615 INFO:teuthology.orchestra.run.smithi008.stdout: { 2023-08-01T19:55:23.616 INFO:teuthology.orchestra.run.smithi008.stdout: "event": "done", 2023-08-01T19:55:23.616 INFO:teuthology.orchestra.run.smithi008.stdout: "time": "2023-08-01T19:55:09.351913+0000", 2023-08-01T19:55:23.616 INFO:teuthology.orchestra.run.smithi008.stdout: "duration": 3.4808999999999998e-05 2023-08-01T19:55:23.616 INFO:teuthology.orchestra.run.smithi008.stdout: } 2023-08-01T19:55:23.617 INFO:teuthology.orchestra.run.smithi008.stdout: ] 2023-08-01T19:55:23.617 INFO:teuthology.orchestra.run.smithi008.stdout: } 2023-08-01T19:55:23.617 INFO:teuthology.orchestra.run.smithi008.stdout: }, 2023-08-01T19:55:23.617 INFO:teuthology.orchestra.run.smithi008.stdout: { 2023-08-01T19:55:23.617 INFO:teuthology.orchestra.run.smithi008.stdout: "description": "osd_op(client.4668.0:107869 5.c 5:31910384:::benchmark_data_smithi006_114134_object107868:head [set-alloc-hint object_size 65536 write_size 65536,write 0~65536] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e38)", 2023-08-01T19:55:23.617 INFO:teuthology.orchestra.run.smithi008.stdout: "initiated_at": "2023-08-01T19:55:09.283205+0000", 2023-08-01T19:55:23.618 INFO:teuthology.orchestra.run.smithi008.stdout: "age": 14.1604314, 2023-08-01T19:55:23.618 INFO:teuthology.orchestra.run.smithi008.stdout: "duration": 0.068611808999999996, 2023-08-01T19:55:23.618 INFO:teuthology.orchestra.run.smithi008.stdout: "type_data": { 2023-08-01T19:55:23.618 INFO:teuthology.orchestra.run.smithi008.stdout: "flag_point": "commit sent; apply or cleanup", 2023-08-01T19:55:23.618 INFO:teuthology.orchestra.run.smithi008.stdout: "client_info": { 2023-08-01T19:55:23.618 INFO:teuthology.orchestra.run.smithi008.stdout: "client": "client.4668", 2023-08-01T19:55:23.618 INFO:teuthology.orchestra.run.smithi008.stdout: "client_addr": "172.21.15.6:0/1709472247", 2023-08-01T19:55:23.618 INFO:teuthology.orchestra.run.smithi008.stdout: "tid": 107869 2023-08-01T19:55:23.619 INFO:teuthology.orchestra.run.smithi008.stdout: }, 2023-08-01T19:55:23.619 INFO:teuthology.orchestra.run.smithi008.stdout: "events": [ 2023-08-01T19:55:23.619 INFO:teuthology.orchestra.run.smithi008.stdout: { 2023-08-01T19:55:23.619 INFO:teuthology.orchestra.run.smithi008.stdout: "event": "initiated", 2023-08-01T19:55:23.619 INFO:teuthology.orchestra.run.smithi008.stdout: "time": "2023-08-01T19:55:09.283205+0000", 2023-08-01T19:55:23.619 INFO:teuthology.orchestra.run.smithi008.stdout: "duration": 0 2023-08-01T19:55:23.619 INFO:teuthology.orchestra.run.smithi008.stdout: }, 2023-08-01T19:55:23.619 INFO:teuthology.orchestra.run.smithi008.stdout: { 2023-08-01T19:55:23.620 INFO:teuthology.orchestra.run.smithi008.stdout: "event": "throttled", 2023-08-01T19:55:23.620 INFO:teuthology.orchestra.run.smithi008.stdout: "time": "2023-08-01T19:55:09.283205+0000", 2023-08-01T19:55:23.620 INFO:teuthology.orchestra.run.smithi008.stdout: "duration": 0 2023-08-01T19:55:23.620 INFO:teuthology.orchestra.run.smithi008.stdout: }, 2023-08-01T19:55:23.620 INFO:teuthology.orchestra.run.smithi008.stdout: { 2023-08-01T19:55:23.620 INFO:teuthology.orchestra.run.smithi008.stdout: "event": "header_read", 2023-08-01T19:55:23.620 INFO:teuthology.orchestra.run.smithi008.stdout: "time": "2023-08-01T19:55:09.283204+0000", 2023-08-01T19:55:23.620 INFO:teuthology.orchestra.run.smithi008.stdout: "duration": 4294967295.999999 2023-08-01T19:55:23.621 INFO:teuthology.orchestra.run.smithi008.stdout: }, 2023-08-01T19:55:23.621 INFO:teuthology.orchestra.run.smithi008.stdout: { 2023-08-01T19:55:23.621 INFO:teuthology.orchestra.run.smithi008.stdout: "event": "all_read", 2023-08-01T19:55:23.621 INFO:teuthology.orchestra.run.smithi008.stdout: "time": "2023-08-01T19:55:09.283300+0000", 2023-08-01T19:55:23.621 INFO:teuthology.orchestra.run.smithi008.stdout: "duration": 9.6280000000000007e-05 2023-08-01T19:55:23.621 INFO:teuthology.orchestra.run.smithi008.stdout: }, 2023-08-01T19:55:23.621 INFO:teuthology.orchestra.run.smithi008.stdout: { 2023-08-01T19:55:23.621 INFO:teuthology.orchestra.run.smithi008.stdout: "event": "dispatched", 2023-08-01T19:55:23.622 INFO:teuthology.orchestra.run.smithi008.stdout: "time": "2023-08-01T19:55:09.283314+0000", 2023-08-01T19:55:23.622 INFO:teuthology.orchestra.run.smithi008.stdout: "duration": 1.3344e-05 2023-08-01T19:55:23.622 INFO:teuthology.orchestra.run.smithi008.stdout: }, 2023-08-01T19:55:23.622 INFO:teuthology.orchestra.run.smithi008.stdout: { 2023-08-01T19:55:23.622 INFO:teuthology.orchestra.run.smithi008.stdout: "event": "queued_for_pg", 2023-08-01T19:55:23.622 INFO:teuthology.orchestra.run.smithi008.stdout: "time": "2023-08-01T19:55:09.283320+0000", 2023-08-01T19:55:23.622 INFO:teuthology.orchestra.run.smithi008.stdout: "duration": 6.0299999999999999e-06 2023-08-01T19:55:23.622 INFO:teuthology.orchestra.run.smithi008.stdout: }, 2023-08-01T19:55:23.623 INFO:teuthology.orchestra.run.smithi008.stdout: { 2023-08-01T19:55:23.623 INFO:teuthology.orchestra.run.smithi008.stdout: "event": "reached_pg", 2023-08-01T19:55:23.623 INFO:teuthology.orchestra.run.smithi008.stdout: "time": "2023-08-01T19:55:09.283365+0000", 2023-08-01T19:55:23.623 INFO:teuthology.orchestra.run.smithi008.stdout: "duration": 4.5578999999999998e-05 2023-08-01T19:55:23.623 INFO:teuthology.orchestra.run.smithi008.stdout: }, 2023-08-01T19:55:23.623 INFO:teuthology.orchestra.run.smithi008.stdout: { 2023-08-01T19:55:23.623 INFO:teuthology.orchestra.run.smithi008.stdout: "event": "started", 2023-08-01T19:55:23.623 INFO:teuthology.orchestra.run.smithi008.stdout: "time": "2023-08-01T19:55:09.283490+0000", 2023-08-01T19:55:23.624 INFO:teuthology.orchestra.run.smithi008.stdout: "duration": 0.00012473700000000001 2023-08-01T19:55:23.624 INFO:teuthology.orchestra.run.smithi008.stdout: }, 2023-08-01T19:55:23.624 INFO:teuthology.orchestra.run.smithi008.stdout: { 2023-08-01T19:55:23.624 INFO:teuthology.orchestra.run.smithi008.stdout: "event": "waiting for subops from 1", 2023-08-01T19:55:23.624 INFO:teuthology.orchestra.run.smithi008.stdout: "time": "2023-08-01T19:55:09.283637+0000", 2023-08-01T19:55:23.624 INFO:teuthology.orchestra.run.smithi008.stdout: "duration": 0.00014715600000000001 2023-08-01T19:55:23.624 INFO:teuthology.orchestra.run.smithi008.stdout: }, 2023-08-01T19:55:23.625 INFO:teuthology.orchestra.run.smithi008.stdout: { 2023-08-01T19:55:23.625 INFO:teuthology.orchestra.run.smithi008.stdout: "event": "op_commit", 2023-08-01T19:55:23.625 INFO:teuthology.orchestra.run.smithi008.stdout: "time": "2023-08-01T19:55:09.288214+0000", 2023-08-01T19:55:23.625 INFO:teuthology.orchestra.run.smithi008.stdout: "duration": 0.0045769560000000001 2023-08-01T19:55:23.625 INFO:teuthology.orchestra.run.smithi008.stdout: }, 2023-08-01T19:55:23.625 INFO:teuthology.orchestra.run.smithi008.stdout: { 2023-08-01T19:55:23.625 INFO:teuthology.orchestra.run.smithi008.stdout: "event": "sub_op_commit_rec", 2023-08-01T19:55:23.625 INFO:teuthology.orchestra.run.smithi008.stdout: "time": "2023-08-01T19:55:09.351721+0000", 2023-08-01T19:55:23.626 INFO:teuthology.orchestra.run.smithi008.stdout: "duration": 0.063507383000000001 2023-08-01T19:55:23.626 INFO:teuthology.orchestra.run.smithi008.stdout: }, 2023-08-01T19:55:23.626 INFO:teuthology.orchestra.run.smithi008.stdout: { 2023-08-01T19:55:23.626 INFO:teuthology.orchestra.run.smithi008.stdout: "event": "commit_sent", 2023-08-01T19:55:23.626 INFO:teuthology.orchestra.run.smithi008.stdout: "time": "2023-08-01T19:55:09.351777+0000", 2023-08-01T19:55:23.626 INFO:teuthology.orchestra.run.smithi008.stdout: "duration": 5.5733999999999999e-05 2023-08-01T19:55:23.626 INFO:teuthology.orchestra.run.smithi008.stdout: }, 2023-08-01T19:55:23.626 INFO:teuthology.orchestra.run.smithi008.stdout: { 2023-08-01T19:55:23.627 INFO:teuthology.orchestra.run.smithi008.stdout: "event": "done", 2023-08-01T19:55:23.627 INFO:teuthology.orchestra.run.smithi008.stdout: "time": "2023-08-01T19:55:09.351817+0000", 2023-08-01T19:55:23.627 INFO:teuthology.orchestra.run.smithi008.stdout: "duration": 3.9765000000000003e-05 2023-08-01T19:55:23.627 INFO:teuthology.orchestra.run.smithi008.stdout: } 2023-08-01T19:55:23.627 INFO:teuthology.orchestra.run.smithi008.stdout: ] 2023-08-01T19:55:23.627 INFO:teuthology.orchestra.run.smithi008.stdout: } 2023-08-01T19:55:23.627 INFO:teuthology.orchestra.run.smithi008.stdout: }, 2023-08-01T19:55:23.628 INFO:teuthology.orchestra.run.smithi008.stdout: { 2023-08-01T19:55:23.628 INFO:teuthology.orchestra.run.smithi008.stdout: "description": "osd_op(client.4668.0:107874 5.3 5:ce4c2799:::benchmark_data_smithi006_114134_object107873:head [set-alloc-hint object_size 65536 write_size 65536,write 0~65536] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e38)", 2023-08-01T19:55:23.628 INFO:teuthology.orchestra.run.smithi008.stdout: "initiated_at": "2023-08-01T19:55:09.286239+0000", 2023-08-01T19:55:23.628 INFO:teuthology.orchestra.run.smithi008.stdout: "age": 14.157397895000001, 2023-08-01T19:55:23.628 INFO:teuthology.orchestra.run.smithi008.stdout: "duration": 0.068224389999999996, 2023-08-01T19:55:23.628 INFO:teuthology.orchestra.run.smithi008.stdout: "type_data": { 2023-08-01T19:55:23.629 INFO:teuthology.orchestra.run.smithi008.stdout: "flag_point": "commit sent; apply or cleanup", 2023-08-01T19:55:23.629 INFO:teuthology.orchestra.run.smithi008.stdout: "client_info": { 2023-08-01T19:55:23.629 INFO:teuthology.orchestra.run.smithi008.stdout: "client": "client.4668", 2023-08-01T19:55:23.629 INFO:teuthology.orchestra.run.smithi008.stdout: "client_addr": "172.21.15.6:0/1709472247", 2023-08-01T19:55:23.629 INFO:teuthology.orchestra.run.smithi008.stdout: "tid": 107874 2023-08-01T19:55:23.629 INFO:teuthology.orchestra.run.smithi008.stdout: }, 2023-08-01T19:55:23.629 INFO:teuthology.orchestra.run.smithi008.stdout: "events": [ 2023-08-01T19:55:23.630 INFO:teuthology.orchestra.run.smithi008.stdout: { 2023-08-01T19:55:23.630 INFO:teuthology.orchestra.run.smithi008.stdout: "event": "initiated", 2023-08-01T19:55:23.630 INFO:teuthology.orchestra.run.smithi008.stdout: "time": "2023-08-01T19:55:09.286239+0000", 2023-08-01T19:55:23.630 INFO:teuthology.orchestra.run.smithi008.stdout: "duration": 0 2023-08-01T19:55:23.630 INFO:teuthology.orchestra.run.smithi008.stdout: }, 2023-08-01T19:55:23.630 INFO:teuthology.orchestra.run.smithi008.stdout: { 2023-08-01T19:55:23.630 INFO:teuthology.orchestra.run.smithi008.stdout: "event": "throttled", 2023-08-01T19:55:23.631 INFO:teuthology.orchestra.run.smithi008.stdout: "time": "2023-08-01T19:55:09.286239+0000", 2023-08-01T19:55:23.631 INFO:teuthology.orchestra.run.smithi008.stdout: "duration": 0 2023-08-01T19:55:23.631 INFO:teuthology.orchestra.run.smithi008.stdout: }, 2023-08-01T19:55:23.631 INFO:teuthology.orchestra.run.smithi008.stdout: { 2023-08-01T19:55:23.631 INFO:teuthology.orchestra.run.smithi008.stdout: "event": "header_read", 2023-08-01T19:55:23.631 INFO:teuthology.orchestra.run.smithi008.stdout: "time": "2023-08-01T19:55:09.286238+0000", 2023-08-01T19:55:23.631 INFO:teuthology.orchestra.run.smithi008.stdout: "duration": 4294967295.999999 2023-08-01T19:55:23.631 INFO:teuthology.orchestra.run.smithi008.stdout: }, 2023-08-01T19:55:23.632 INFO:teuthology.orchestra.run.smithi008.stdout: { 2023-08-01T19:55:23.632 INFO:teuthology.orchestra.run.smithi008.stdout: "event": "all_read", 2023-08-01T19:55:23.632 INFO:teuthology.orchestra.run.smithi008.stdout: "time": "2023-08-01T19:55:09.286310+0000", 2023-08-01T19:55:23.632 INFO:teuthology.orchestra.run.smithi008.stdout: "duration": 7.2583999999999995e-05 2023-08-01T19:55:23.632 INFO:teuthology.orchestra.run.smithi008.stdout: }, 2023-08-01T19:55:23.633 INFO:teuthology.orchestra.run.smithi008.stdout: { 2023-08-01T19:55:23.633 INFO:teuthology.orchestra.run.smithi008.stdout: "event": "dispatched", 2023-08-01T19:55:23.633 INFO:teuthology.orchestra.run.smithi008.stdout: "time": "2023-08-01T19:55:09.286323+0000", 2023-08-01T19:55:23.634 INFO:teuthology.orchestra.run.smithi008.stdout: "duration": 1.3151e-05 2023-08-01T19:55:23.634 INFO:teuthology.orchestra.run.smithi008.stdout: }, 2023-08-01T19:55:23.634 INFO:teuthology.orchestra.run.smithi008.stdout: { 2023-08-01T19:55:23.634 INFO:teuthology.orchestra.run.smithi008.stdout: "event": "queued_for_pg", 2023-08-01T19:55:23.634 INFO:teuthology.orchestra.run.smithi008.stdout: "time": "2023-08-01T19:55:09.286329+0000", 2023-08-01T19:55:23.634 INFO:teuthology.orchestra.run.smithi008.stdout: "duration": 5.8719999999999999e-06 2023-08-01T19:55:23.635 INFO:teuthology.orchestra.run.smithi008.stdout: }, 2023-08-01T19:55:23.635 INFO:teuthology.orchestra.run.smithi008.stdout: { 2023-08-01T19:55:23.635 INFO:teuthology.orchestra.run.smithi008.stdout: "event": "reached_pg", 2023-08-01T19:55:23.635 INFO:teuthology.orchestra.run.smithi008.stdout: "time": "2023-08-01T19:55:09.286392+0000", 2023-08-01T19:55:23.635 INFO:teuthology.orchestra.run.smithi008.stdout: "duration": 6.2378000000000005e-05 2023-08-01T19:55:23.635 INFO:teuthology.orchestra.run.smithi008.stdout: }, 2023-08-01T19:55:23.635 INFO:teuthology.orchestra.run.smithi008.stdout: { 2023-08-01T19:55:23.635 INFO:teuthology.orchestra.run.smithi008.stdout: "event": "started", 2023-08-01T19:55:23.636 INFO:teuthology.orchestra.run.smithi008.stdout: "time": "2023-08-01T19:55:09.286473+0000", 2023-08-01T19:55:23.636 INFO:teuthology.orchestra.run.smithi008.stdout: "duration": 8.1327000000000002e-05 2023-08-01T19:55:23.636 INFO:teuthology.orchestra.run.smithi008.stdout: }, 2023-08-01T19:55:23.636 INFO:teuthology.orchestra.run.smithi008.stdout: { 2023-08-01T19:55:23.636 INFO:teuthology.orchestra.run.smithi008.stdout: "event": "waiting for subops from 1", 2023-08-01T19:55:23.636 INFO:teuthology.orchestra.run.smithi008.stdout: "time": "2023-08-01T19:55:09.286557+0000", 2023-08-01T19:55:23.636 INFO:teuthology.orchestra.run.smithi008.stdout: "duration": 8.4140000000000004e-05 2023-08-01T19:55:23.636 INFO:teuthology.orchestra.run.smithi008.stdout: }, 2023-08-01T19:55:23.637 INFO:teuthology.orchestra.run.smithi008.stdout: { 2023-08-01T19:55:23.637 INFO:teuthology.orchestra.run.smithi008.stdout: "event": "op_commit", 2023-08-01T19:55:23.637 INFO:teuthology.orchestra.run.smithi008.stdout: "time": "2023-08-01T19:55:09.290681+0000", 2023-08-01T19:55:23.637 INFO:teuthology.orchestra.run.smithi008.stdout: "duration": 0.0041242420000000002 2023-08-01T19:55:23.637 INFO:teuthology.orchestra.run.smithi008.stdout: }, 2023-08-01T19:55:23.637 INFO:teuthology.orchestra.run.smithi008.stdout: { 2023-08-01T19:55:23.637 INFO:teuthology.orchestra.run.smithi008.stdout: "event": "sub_op_commit_rec", 2023-08-01T19:55:23.637 INFO:teuthology.orchestra.run.smithi008.stdout: "time": "2023-08-01T19:55:09.354372+0000", 2023-08-01T19:55:23.638 INFO:teuthology.orchestra.run.smithi008.stdout: "duration": 0.063690438000000002 2023-08-01T19:55:23.638 INFO:teuthology.orchestra.run.smithi008.stdout: }, 2023-08-01T19:55:23.638 INFO:teuthology.orchestra.run.smithi008.stdout: { 2023-08-01T19:55:23.638 INFO:teuthology.orchestra.run.smithi008.stdout: "event": "commit_sent", 2023-08-01T19:55:23.638 INFO:teuthology.orchestra.run.smithi008.stdout: "time": "2023-08-01T19:55:09.354421+0000", 2023-08-01T19:55:23.638 INFO:teuthology.orchestra.run.smithi008.stdout: "duration": 4.9413000000000003e-05 2023-08-01T19:55:23.638 INFO:teuthology.orchestra.run.smithi008.stdout: }, 2023-08-01T19:55:23.639 INFO:teuthology.orchestra.run.smithi008.stdout: { 2023-08-01T19:55:23.639 INFO:teuthology.orchestra.run.smithi008.stdout: "event": "done", 2023-08-01T19:55:23.639 INFO:teuthology.orchestra.run.smithi008.stdout: "time": "2023-08-01T19:55:09.354463+0000", 2023-08-01T19:55:23.639 INFO:teuthology.orchestra.run.smithi008.stdout: "duration": 4.1924e-05 2023-08-01T19:55:23.639 INFO:teuthology.orchestra.run.smithi008.stdout: } 2023-08-01T19:55:23.639 INFO:teuthology.orchestra.run.smithi008.stdout: ] 2023-08-01T19:55:23.639 INFO:teuthology.orchestra.run.smithi008.stdout: } 2023-08-01T19:55:23.639 INFO:teuthology.orchestra.run.smithi008.stdout: }, 2023-08-01T19:55:23.640 INFO:teuthology.orchestra.run.smithi008.stdout: { 2023-08-01T19:55:23.640 INFO:teuthology.orchestra.run.smithi008.stdout: "description": "osd_op(client.4668.0:107875 5.5 5:af4ec927:::benchmark_data_smithi006_114134_object107874:head [set-alloc-hint object_size 65536 write_size 65536,write 0~65536] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e38)", 2023-08-01T19:55:23.640 INFO:teuthology.orchestra.run.smithi008.stdout: "initiated_at": "2023-08-01T19:55:09.287186+0000", 2023-08-01T19:55:23.640 INFO:teuthology.orchestra.run.smithi008.stdout: "age": 14.156450108, 2023-08-01T19:55:23.640 INFO:teuthology.orchestra.run.smithi008.stdout: "duration": 0.064764719999999998, 2023-08-01T19:55:23.640 INFO:teuthology.orchestra.run.smithi008.stdout: "type_data": { 2023-08-01T19:55:23.640 INFO:teuthology.orchestra.run.smithi008.stdout: "flag_point": "commit sent; apply or cleanup", 2023-08-01T19:55:23.640 INFO:teuthology.orchestra.run.smithi008.stdout: "client_info": { 2023-08-01T19:55:23.641 INFO:teuthology.orchestra.run.smithi008.stdout: "client": "client.4668", 2023-08-01T19:55:23.641 INFO:teuthology.orchestra.run.smithi008.stdout: "client_addr": "172.21.15.6:0/1709472247", 2023-08-01T19:55:23.641 INFO:teuthology.orchestra.run.smithi008.stdout: "tid": 107875 2023-08-01T19:55:23.641 INFO:teuthology.orchestra.run.smithi008.stdout: }, 2023-08-01T19:55:23.641 INFO:teuthology.orchestra.run.smithi008.stdout: "events": [ 2023-08-01T19:55:23.641 INFO:teuthology.orchestra.run.smithi008.stdout: { 2023-08-01T19:55:23.641 INFO:teuthology.orchestra.run.smithi008.stdout: "event": "initiated", 2023-08-01T19:55:23.642 INFO:teuthology.orchestra.run.smithi008.stdout: "time": "2023-08-01T19:55:09.287186+0000", 2023-08-01T19:55:23.642 INFO:teuthology.orchestra.run.smithi008.stdout: "duration": 0 2023-08-01T19:55:23.642 INFO:teuthology.orchestra.run.smithi008.stdout: }, 2023-08-01T19:55:23.642 INFO:teuthology.orchestra.run.smithi008.stdout: { 2023-08-01T19:55:23.642 INFO:teuthology.orchestra.run.smithi008.stdout: "event": "throttled", 2023-08-01T19:55:23.642 INFO:teuthology.orchestra.run.smithi008.stdout: "time": "2023-08-01T19:55:09.287186+0000", 2023-08-01T19:55:23.642 INFO:teuthology.orchestra.run.smithi008.stdout: "duration": 0 2023-08-01T19:55:23.643 INFO:teuthology.orchestra.run.smithi008.stdout: }, 2023-08-01T19:55:23.643 INFO:teuthology.orchestra.run.smithi008.stdout: { 2023-08-01T19:55:23.643 INFO:teuthology.orchestra.run.smithi008.stdout: "event": "header_read", 2023-08-01T19:55:23.643 INFO:teuthology.orchestra.run.smithi008.stdout: "time": "2023-08-01T19:55:09.287186+0000", 2023-08-01T19:55:23.643 INFO:teuthology.orchestra.run.smithi008.stdout: "duration": 4294967295.999999 2023-08-01T19:55:23.643 INFO:teuthology.orchestra.run.smithi008.stdout: }, 2023-08-01T19:55:23.643 INFO:teuthology.orchestra.run.smithi008.stdout: { 2023-08-01T19:55:23.643 INFO:teuthology.orchestra.run.smithi008.stdout: "event": "all_read", 2023-08-01T19:55:23.644 INFO:teuthology.orchestra.run.smithi008.stdout: "time": "2023-08-01T19:55:09.287248+0000", 2023-08-01T19:55:23.644 INFO:teuthology.orchestra.run.smithi008.stdout: "duration": 6.2922000000000005e-05 2023-08-01T19:55:23.644 INFO:teuthology.orchestra.run.smithi008.stdout: }, 2023-08-01T19:55:23.644 INFO:teuthology.orchestra.run.smithi008.stdout: { 2023-08-01T19:55:23.645 INFO:teuthology.orchestra.run.smithi008.stdout: "event": "dispatched", 2023-08-01T19:55:23.645 INFO:teuthology.orchestra.run.smithi008.stdout: "time": "2023-08-01T19:55:09.287261+0000", 2023-08-01T19:55:23.645 INFO:teuthology.orchestra.run.smithi008.stdout: "duration": 1.2364000000000001e-05 2023-08-01T19:55:23.646 INFO:teuthology.orchestra.run.smithi008.stdout: }, 2023-08-01T19:55:23.646 INFO:teuthology.orchestra.run.smithi008.stdout: { 2023-08-01T19:55:23.646 INFO:teuthology.orchestra.run.smithi008.stdout: "event": "queued_for_pg", 2023-08-01T19:55:23.646 INFO:teuthology.orchestra.run.smithi008.stdout: "time": "2023-08-01T19:55:09.287267+0000", 2023-08-01T19:55:23.646 INFO:teuthology.orchestra.run.smithi008.stdout: "duration": 6.2580000000000001e-06 2023-08-01T19:55:23.647 INFO:teuthology.orchestra.run.smithi008.stdout: }, 2023-08-01T19:55:23.647 INFO:teuthology.orchestra.run.smithi008.stdout: { 2023-08-01T19:55:23.647 INFO:teuthology.orchestra.run.smithi008.stdout: "event": "reached_pg", 2023-08-01T19:55:23.647 INFO:teuthology.orchestra.run.smithi008.stdout: "time": "2023-08-01T19:55:09.287306+0000", 2023-08-01T19:55:23.647 INFO:teuthology.orchestra.run.smithi008.stdout: "duration": 3.9057999999999998e-05 2023-08-01T19:55:23.648 INFO:teuthology.orchestra.run.smithi008.stdout: }, 2023-08-01T19:55:23.648 INFO:teuthology.orchestra.run.smithi008.stdout: { 2023-08-01T19:55:23.648 INFO:teuthology.orchestra.run.smithi008.stdout: "event": "started", 2023-08-01T19:55:23.648 INFO:teuthology.orchestra.run.smithi008.stdout: "time": "2023-08-01T19:55:09.287419+0000", 2023-08-01T19:55:23.648 INFO:teuthology.orchestra.run.smithi008.stdout: "duration": 0.000112843 2023-08-01T19:55:23.648 INFO:teuthology.orchestra.run.smithi008.stdout: }, 2023-08-01T19:55:23.648 INFO:teuthology.orchestra.run.smithi008.stdout: { 2023-08-01T19:55:23.649 INFO:teuthology.orchestra.run.smithi008.stdout: "event": "waiting for subops from 1", 2023-08-01T19:55:23.649 INFO:teuthology.orchestra.run.smithi008.stdout: "time": "2023-08-01T19:55:09.287514+0000", 2023-08-01T19:55:23.649 INFO:teuthology.orchestra.run.smithi008.stdout: "duration": 9.5068000000000005e-05 2023-08-01T19:55:23.649 INFO:teuthology.orchestra.run.smithi008.stdout: }, 2023-08-01T19:55:23.649 INFO:teuthology.orchestra.run.smithi008.stdout: { 2023-08-01T19:55:23.649 INFO:teuthology.orchestra.run.smithi008.stdout: "event": "op_commit", 2023-08-01T19:55:23.649 INFO:teuthology.orchestra.run.smithi008.stdout: "time": "2023-08-01T19:55:09.293891+0000", 2023-08-01T19:55:23.649 INFO:teuthology.orchestra.run.smithi008.stdout: "duration": 0.00637712 2023-08-01T19:55:23.650 INFO:teuthology.orchestra.run.smithi008.stdout: }, 2023-08-01T19:55:23.650 INFO:teuthology.orchestra.run.smithi008.stdout: { 2023-08-01T19:55:23.650 INFO:teuthology.orchestra.run.smithi008.stdout: "event": "sub_op_commit_rec", 2023-08-01T19:55:23.650 INFO:teuthology.orchestra.run.smithi008.stdout: "time": "2023-08-01T19:55:09.351871+0000", 2023-08-01T19:55:23.650 INFO:teuthology.orchestra.run.smithi008.stdout: "duration": 0.057980054000000003 2023-08-01T19:55:23.650 INFO:teuthology.orchestra.run.smithi008.stdout: }, 2023-08-01T19:55:23.650 INFO:teuthology.orchestra.run.smithi008.stdout: { 2023-08-01T19:55:23.651 INFO:teuthology.orchestra.run.smithi008.stdout: "event": "commit_sent", 2023-08-01T19:55:23.651 INFO:teuthology.orchestra.run.smithi008.stdout: "time": "2023-08-01T19:55:09.351917+0000", 2023-08-01T19:55:23.651 INFO:teuthology.orchestra.run.smithi008.stdout: "duration": 4.5501999999999999e-05 2023-08-01T19:55:23.651 INFO:teuthology.orchestra.run.smithi008.stdout: }, 2023-08-01T19:55:23.651 INFO:teuthology.orchestra.run.smithi008.stdout: { 2023-08-01T19:55:23.651 INFO:teuthology.orchestra.run.smithi008.stdout: "event": "done", 2023-08-01T19:55:23.651 INFO:teuthology.orchestra.run.smithi008.stdout: "time": "2023-08-01T19:55:09.351951+0000", 2023-08-01T19:55:23.652 INFO:teuthology.orchestra.run.smithi008.stdout: "duration": 3.4450999999999999e-05 2023-08-01T19:55:23.652 INFO:teuthology.orchestra.run.smithi008.stdout: } 2023-08-01T19:55:23.652 INFO:teuthology.orchestra.run.smithi008.stdout: ] 2023-08-01T19:55:23.652 INFO:teuthology.orchestra.run.smithi008.stdout: } 2023-08-01T19:55:23.652 INFO:teuthology.orchestra.run.smithi008.stdout: }, 2023-08-01T19:55:23.652 INFO:teuthology.orchestra.run.smithi008.stdout: { 2023-08-01T19:55:23.652 INFO:teuthology.orchestra.run.smithi008.stdout: "description": "osd_op(client.4668.0:107880 5.5 5:a8d12d4b:::benchmark_data_smithi006_114134_object107879:head [set-alloc-hint object_size 65536 write_size 65536,write 0~65536] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e38)", 2023-08-01T19:55:23.652 INFO:teuthology.orchestra.run.smithi008.stdout: "initiated_at": "2023-08-01T19:55:09.292335+0000", 2023-08-01T19:55:23.653 INFO:teuthology.orchestra.run.smithi008.stdout: "age": 14.151301506999999, 2023-08-01T19:55:23.653 INFO:teuthology.orchestra.run.smithi008.stdout: "duration": 0.061350719999999997, 2023-08-01T19:55:23.653 INFO:teuthology.orchestra.run.smithi008.stdout: "type_data": { 2023-08-01T19:55:23.653 INFO:teuthology.orchestra.run.smithi008.stdout: "flag_point": "commit sent; apply or cleanup", 2023-08-01T19:55:23.653 INFO:teuthology.orchestra.run.smithi008.stdout: "client_info": { 2023-08-01T19:55:23.653 INFO:teuthology.orchestra.run.smithi008.stdout: "client": "client.4668", 2023-08-01T19:55:23.653 INFO:teuthology.orchestra.run.smithi008.stdout: "client_addr": "172.21.15.6:0/1709472247", 2023-08-01T19:55:23.653 INFO:teuthology.orchestra.run.smithi008.stdout: "tid": 107880 2023-08-01T19:55:23.654 INFO:teuthology.orchestra.run.smithi008.stdout: }, 2023-08-01T19:55:23.654 INFO:teuthology.orchestra.run.smithi008.stdout: "events": [ 2023-08-01T19:55:23.654 INFO:teuthology.orchestra.run.smithi008.stdout: { 2023-08-01T19:55:23.654 INFO:teuthology.orchestra.run.smithi008.stdout: "event": "initiated", 2023-08-01T19:55:23.654 INFO:teuthology.orchestra.run.smithi008.stdout: "time": "2023-08-01T19:55:09.292335+0000", 2023-08-01T19:55:23.654 INFO:teuthology.orchestra.run.smithi008.stdout: "duration": 0 2023-08-01T19:55:23.654 INFO:teuthology.orchestra.run.smithi008.stdout: }, 2023-08-01T19:55:23.654 INFO:teuthology.orchestra.run.smithi008.stdout: { 2023-08-01T19:55:23.655 INFO:teuthology.orchestra.run.smithi008.stdout: "event": "throttled", 2023-08-01T19:55:23.655 INFO:teuthology.orchestra.run.smithi008.stdout: "time": "2023-08-01T19:55:09.292335+0000", 2023-08-01T19:55:23.655 INFO:teuthology.orchestra.run.smithi008.stdout: "duration": 0 2023-08-01T19:55:23.655 INFO:teuthology.orchestra.run.smithi008.stdout: }, 2023-08-01T19:55:23.655 INFO:teuthology.orchestra.run.smithi008.stdout: { 2023-08-01T19:55:23.655 INFO:teuthology.orchestra.run.smithi008.stdout: "event": "header_read", 2023-08-01T19:55:23.655 INFO:teuthology.orchestra.run.smithi008.stdout: "time": "2023-08-01T19:55:09.292334+0000", 2023-08-01T19:55:23.656 INFO:teuthology.orchestra.run.smithi008.stdout: "duration": 4294967295.999999 2023-08-01T19:55:23.656 INFO:teuthology.orchestra.run.smithi008.stdout: }, 2023-08-01T19:55:23.656 INFO:teuthology.orchestra.run.smithi008.stdout: { 2023-08-01T19:55:23.656 INFO:teuthology.orchestra.run.smithi008.stdout: "event": "all_read", 2023-08-01T19:55:23.656 INFO:teuthology.orchestra.run.smithi008.stdout: "time": "2023-08-01T19:55:09.292449+0000", 2023-08-01T19:55:23.656 INFO:teuthology.orchestra.run.smithi008.stdout: "duration": 0.00011551400000000001 2023-08-01T19:55:23.656 INFO:teuthology.orchestra.run.smithi008.stdout: }, 2023-08-01T19:55:23.656 INFO:teuthology.orchestra.run.smithi008.stdout: { 2023-08-01T19:55:23.657 INFO:teuthology.orchestra.run.smithi008.stdout: "event": "dispatched", 2023-08-01T19:55:23.657 INFO:teuthology.orchestra.run.smithi008.stdout: "time": "2023-08-01T19:55:09.292461+0000", 2023-08-01T19:55:23.657 INFO:teuthology.orchestra.run.smithi008.stdout: "duration": 1.1287000000000001e-05 2023-08-01T19:55:23.657 INFO:teuthology.orchestra.run.smithi008.stdout: }, 2023-08-01T19:55:23.657 INFO:teuthology.orchestra.run.smithi008.stdout: { 2023-08-01T19:55:23.657 INFO:teuthology.orchestra.run.smithi008.stdout: "event": "queued_for_pg", 2023-08-01T19:55:23.657 INFO:teuthology.orchestra.run.smithi008.stdout: "time": "2023-08-01T19:55:09.292467+0000", 2023-08-01T19:55:23.657 INFO:teuthology.orchestra.run.smithi008.stdout: "duration": 6.4520000000000002e-06 2023-08-01T19:55:23.658 INFO:teuthology.orchestra.run.smithi008.stdout: }, 2023-08-01T19:55:23.658 INFO:teuthology.orchestra.run.smithi008.stdout: { 2023-08-01T19:55:23.658 INFO:teuthology.orchestra.run.smithi008.stdout: "event": "reached_pg", 2023-08-01T19:55:23.658 INFO:teuthology.orchestra.run.smithi008.stdout: "time": "2023-08-01T19:55:09.292510+0000", 2023-08-01T19:55:23.658 INFO:teuthology.orchestra.run.smithi008.stdout: "duration": 4.2502000000000001e-05 2023-08-01T19:55:23.658 INFO:teuthology.orchestra.run.smithi008.stdout: }, 2023-08-01T19:55:23.658 INFO:teuthology.orchestra.run.smithi008.stdout: { 2023-08-01T19:55:23.658 INFO:teuthology.orchestra.run.smithi008.stdout: "event": "started", 2023-08-01T19:55:23.659 INFO:teuthology.orchestra.run.smithi008.stdout: "time": "2023-08-01T19:55:09.292596+0000", 2023-08-01T19:55:23.659 INFO:teuthology.orchestra.run.smithi008.stdout: "duration": 8.6545000000000006e-05 2023-08-01T19:55:23.659 INFO:teuthology.orchestra.run.smithi008.stdout: }, 2023-08-01T19:55:23.659 INFO:teuthology.orchestra.run.smithi008.stdout: { 2023-08-01T19:55:23.659 INFO:teuthology.orchestra.run.smithi008.stdout: "event": "waiting for subops from 1", 2023-08-01T19:55:23.659 INFO:teuthology.orchestra.run.smithi008.stdout: "time": "2023-08-01T19:55:09.292697+0000", 2023-08-01T19:55:23.659 INFO:teuthology.orchestra.run.smithi008.stdout: "duration": 0.000100368 2023-08-01T19:55:23.660 INFO:teuthology.orchestra.run.smithi008.stdout: }, 2023-08-01T19:55:23.660 INFO:teuthology.orchestra.run.smithi008.stdout: { 2023-08-01T19:55:23.660 INFO:teuthology.orchestra.run.smithi008.stdout: "event": "op_commit", 2023-08-01T19:55:23.660 INFO:teuthology.orchestra.run.smithi008.stdout: "time": "2023-08-01T19:55:09.295658+0000", 2023-08-01T19:55:23.660 INFO:teuthology.orchestra.run.smithi008.stdout: "duration": 0.0029617290000000002 2023-08-01T19:55:23.660 INFO:teuthology.orchestra.run.smithi008.stdout: }, 2023-08-01T19:55:23.660 INFO:teuthology.orchestra.run.smithi008.stdout: { 2023-08-01T19:55:23.661 INFO:teuthology.orchestra.run.smithi008.stdout: "event": "sub_op_commit_rec", 2023-08-01T19:55:23.661 INFO:teuthology.orchestra.run.smithi008.stdout: "time": "2023-08-01T19:55:09.353604+0000", 2023-08-01T19:55:23.661 INFO:teuthology.orchestra.run.smithi008.stdout: "duration": 0.057945868999999997 2023-08-01T19:55:23.661 INFO:teuthology.orchestra.run.smithi008.stdout: }, 2023-08-01T19:55:23.661 INFO:teuthology.orchestra.run.smithi008.stdout: { 2023-08-01T19:55:23.661 INFO:teuthology.orchestra.run.smithi008.stdout: "event": "commit_sent", 2023-08-01T19:55:23.661 INFO:teuthology.orchestra.run.smithi008.stdout: "time": "2023-08-01T19:55:09.353650+0000", 2023-08-01T19:55:23.661 INFO:teuthology.orchestra.run.smithi008.stdout: "duration": 4.5698999999999997e-05 2023-08-01T19:55:23.662 INFO:teuthology.orchestra.run.smithi008.stdout: }, 2023-08-01T19:55:23.662 INFO:teuthology.orchestra.run.smithi008.stdout: { 2023-08-01T19:55:23.662 INFO:teuthology.orchestra.run.smithi008.stdout: "event": "done", 2023-08-01T19:55:23.662 INFO:teuthology.orchestra.run.smithi008.stdout: "time": "2023-08-01T19:55:09.353686+0000", 2023-08-01T19:55:23.662 INFO:teuthology.orchestra.run.smithi008.stdout: "duration": 3.5936999999999998e-05 2023-08-01T19:55:23.662 INFO:teuthology.orchestra.run.smithi008.stdout: } 2023-08-01T19:55:23.662 INFO:teuthology.orchestra.run.smithi008.stdout: ] 2023-08-01T19:55:23.662 INFO:teuthology.orchestra.run.smithi008.stdout: } 2023-08-01T19:55:23.663 INFO:teuthology.orchestra.run.smithi008.stdout: } 2023-08-01T19:55:23.663 INFO:teuthology.orchestra.run.smithi008.stdout: ] 2023-08-01T19:55:23.663 INFO:teuthology.orchestra.run.smithi008.stdout:} 2023-08-01T19:55:23.663 DEBUG:teuthology.orchestra.run.smithi006:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 120 ceph --cluster ceph osd set nodeep-scrub 2023-08-01T19:55:23.665 INFO:tasks.ceph.osd.1.smithi101.stderr:2023-08-01T19:55:23.662+0000 7fb0cb7f6700 -1 received signal: Hangup from /usr/bin/python3 /bin/daemon-helper kill ceph-osd -f --cluster ceph -i 1 (PID: 111141) UID: 0 2023-08-01T19:55:23.666 DEBUG:teuthology.orchestra.run.smithi101:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 30 ceph --cluster ceph --admin-daemon /var/run/ceph/ceph-osd.1.asok dump_ops_in_flight 2023-08-01T19:55:23.764 INFO:tasks.ceph.osd.0.smithi008.stderr:2023-08-01T19:55:23.762+0000 7f16a58f4700 -1 received signal: Hangup from /usr/bin/python3 /bin/daemon-helper kill ceph-osd -f --cluster ceph -i 0 (PID: 111179) UID: 0 2023-08-01T19:55:23.826 INFO:teuthology.orchestra.run.smithi101.stdout:{ 2023-08-01T19:55:23.826 INFO:teuthology.orchestra.run.smithi101.stdout: "ops": [ 2023-08-01T19:55:23.826 INFO:teuthology.orchestra.run.smithi101.stdout: { 2023-08-01T19:55:23.827 INFO:teuthology.orchestra.run.smithi101.stdout: "description": "osd_repop(client.4668.0:132723 5.9 e45/40 5:91b4b447:::benchmark_data_smithi006_114134_object132722:head v 45'8340, mlcod=45'8338)", 2023-08-01T19:55:23.827 INFO:teuthology.orchestra.run.smithi101.stdout: "initiated_at": "2023-08-01T19:55:23.817821+0000", 2023-08-01T19:55:23.827 INFO:teuthology.orchestra.run.smithi101.stdout: "age": 0.006636075, 2023-08-01T19:55:23.827 INFO:teuthology.orchestra.run.smithi101.stdout: "duration": 0.0066587030000000002, 2023-08-01T19:55:23.828 INFO:teuthology.orchestra.run.smithi101.stdout: "type_data": { 2023-08-01T19:55:23.828 INFO:teuthology.orchestra.run.smithi101.stdout: "flag_point": "started", 2023-08-01T19:55:23.828 INFO:teuthology.orchestra.run.smithi101.stdout: "events": [ 2023-08-01T19:55:23.829 INFO:teuthology.orchestra.run.smithi101.stdout: { 2023-08-01T19:55:23.829 INFO:teuthology.orchestra.run.smithi101.stdout: "event": "initiated", 2023-08-01T19:55:23.829 INFO:teuthology.orchestra.run.smithi101.stdout: "time": "2023-08-01T19:55:23.817821+0000", 2023-08-01T19:55:23.829 INFO:teuthology.orchestra.run.smithi101.stdout: "duration": 0 2023-08-01T19:55:23.830 INFO:teuthology.orchestra.run.smithi101.stdout: }, 2023-08-01T19:55:23.830 INFO:teuthology.orchestra.run.smithi101.stdout: { 2023-08-01T19:55:23.830 INFO:teuthology.orchestra.run.smithi101.stdout: "event": "throttled", 2023-08-01T19:55:23.830 INFO:teuthology.orchestra.run.smithi101.stdout: "time": "2023-08-01T19:55:23.817821+0000", 2023-08-01T19:55:23.831 INFO:teuthology.orchestra.run.smithi101.stdout: "duration": 0 2023-08-01T19:55:23.831 INFO:teuthology.orchestra.run.smithi101.stdout: }, 2023-08-01T19:55:23.831 INFO:teuthology.orchestra.run.smithi101.stdout: { 2023-08-01T19:55:23.831 INFO:teuthology.orchestra.run.smithi101.stdout: "event": "header_read", 2023-08-01T19:55:23.832 INFO:teuthology.orchestra.run.smithi101.stdout: "time": "2023-08-01T19:55:23.817820+0000", 2023-08-01T19:55:23.832 INFO:teuthology.orchestra.run.smithi101.stdout: "duration": 4294967295.9999995 2023-08-01T19:55:23.832 INFO:teuthology.orchestra.run.smithi101.stdout: }, 2023-08-01T19:55:23.832 INFO:teuthology.orchestra.run.smithi101.stdout: { 2023-08-01T19:55:23.833 INFO:teuthology.orchestra.run.smithi101.stdout: "event": "all_read", 2023-08-01T19:55:23.833 INFO:teuthology.orchestra.run.smithi101.stdout: "time": "2023-08-01T19:55:23.817881+0000", 2023-08-01T19:55:23.833 INFO:teuthology.orchestra.run.smithi101.stdout: "duration": 6.0590000000000001e-05 2023-08-01T19:55:23.833 INFO:teuthology.orchestra.run.smithi101.stdout: }, 2023-08-01T19:55:23.834 INFO:teuthology.orchestra.run.smithi101.stdout: { 2023-08-01T19:55:23.834 INFO:teuthology.orchestra.run.smithi101.stdout: "event": "dispatched", 2023-08-01T19:55:23.834 INFO:teuthology.orchestra.run.smithi101.stdout: "time": "2023-08-01T19:55:23.817889+0000", 2023-08-01T19:55:23.834 INFO:teuthology.orchestra.run.smithi101.stdout: "duration": 8.4889999999999995e-06 2023-08-01T19:55:23.835 INFO:teuthology.orchestra.run.smithi101.stdout: }, 2023-08-01T19:55:23.835 INFO:teuthology.orchestra.run.smithi101.stdout: { 2023-08-01T19:55:23.835 INFO:teuthology.orchestra.run.smithi101.stdout: "event": "queued_for_pg", 2023-08-01T19:55:23.835 INFO:teuthology.orchestra.run.smithi101.stdout: "time": "2023-08-01T19:55:23.817895+0000", 2023-08-01T19:55:23.836 INFO:teuthology.orchestra.run.smithi101.stdout: "duration": 5.5079999999999996e-06 2023-08-01T19:55:23.836 INFO:teuthology.orchestra.run.smithi101.stdout: }, 2023-08-01T19:55:23.836 INFO:teuthology.orchestra.run.smithi101.stdout: { 2023-08-01T19:55:23.836 INFO:teuthology.orchestra.run.smithi101.stdout: "event": "reached_pg", 2023-08-01T19:55:23.837 INFO:teuthology.orchestra.run.smithi101.stdout: "time": "2023-08-01T19:55:23.817936+0000", 2023-08-01T19:55:23.837 INFO:teuthology.orchestra.run.smithi101.stdout: "duration": 4.0901e-05 2023-08-01T19:55:23.837 INFO:teuthology.orchestra.run.smithi101.stdout: }, 2023-08-01T19:55:23.837 INFO:teuthology.orchestra.run.smithi101.stdout: { 2023-08-01T19:55:23.838 INFO:teuthology.orchestra.run.smithi101.stdout: "event": "started", 2023-08-01T19:55:23.838 INFO:teuthology.orchestra.run.smithi101.stdout: "time": "2023-08-01T19:55:23.817956+0000", 2023-08-01T19:55:23.838 INFO:teuthology.orchestra.run.smithi101.stdout: "duration": 2.0587000000000001e-05 2023-08-01T19:55:23.838 INFO:teuthology.orchestra.run.smithi101.stdout: } 2023-08-01T19:55:23.839 INFO:teuthology.orchestra.run.smithi101.stdout: ] 2023-08-01T19:55:23.839 INFO:teuthology.orchestra.run.smithi101.stdout: } 2023-08-01T19:55:23.839 INFO:teuthology.orchestra.run.smithi101.stdout: }, 2023-08-01T19:55:23.840 INFO:teuthology.orchestra.run.smithi101.stdout: { 2023-08-01T19:55:23.840 INFO:teuthology.orchestra.run.smithi101.stdout: "description": "osd_repop(client.4668.0:132724 5.d e45/19 5:bdec2f3c:::benchmark_data_smithi006_114134_object132723:head v 45'8145, mlcod=45'8143)", 2023-08-01T19:55:23.840 INFO:teuthology.orchestra.run.smithi101.stdout: "initiated_at": "2023-08-01T19:55:23.820531+0000", 2023-08-01T19:55:23.840 INFO:teuthology.orchestra.run.smithi101.stdout: "age": 0.0039258959999999999, 2023-08-01T19:55:23.841 INFO:teuthology.orchestra.run.smithi101.stdout: "duration": 0.004016759, 2023-08-01T19:55:23.841 INFO:teuthology.orchestra.run.smithi101.stdout: "type_data": { 2023-08-01T19:55:23.841 INFO:teuthology.orchestra.run.smithi101.stdout: "flag_point": "started", 2023-08-01T19:55:23.841 INFO:teuthology.orchestra.run.smithi101.stdout: "events": [ 2023-08-01T19:55:23.842 INFO:teuthology.orchestra.run.smithi101.stdout: { 2023-08-01T19:55:23.842 INFO:teuthology.orchestra.run.smithi101.stdout: "event": "initiated", 2023-08-01T19:55:23.842 INFO:teuthology.orchestra.run.smithi101.stdout: "time": "2023-08-01T19:55:23.820531+0000", 2023-08-01T19:55:23.842 INFO:teuthology.orchestra.run.smithi101.stdout: "duration": 0 2023-08-01T19:55:23.843 INFO:teuthology.orchestra.run.smithi101.stdout: }, 2023-08-01T19:55:23.843 INFO:teuthology.orchestra.run.smithi101.stdout: { 2023-08-01T19:55:23.843 INFO:teuthology.orchestra.run.smithi101.stdout: "event": "throttled", 2023-08-01T19:55:23.843 INFO:teuthology.orchestra.run.smithi101.stdout: "time": "2023-08-01T19:55:23.820531+0000", 2023-08-01T19:55:23.844 INFO:teuthology.orchestra.run.smithi101.stdout: "duration": 0 2023-08-01T19:55:23.844 INFO:teuthology.orchestra.run.smithi101.stdout: }, 2023-08-01T19:55:23.844 INFO:teuthology.orchestra.run.smithi101.stdout: { 2023-08-01T19:55:23.844 INFO:teuthology.orchestra.run.smithi101.stdout: "event": "header_read", 2023-08-01T19:55:23.845 INFO:teuthology.orchestra.run.smithi101.stdout: "time": "2023-08-01T19:55:23.820530+0000", 2023-08-01T19:55:23.845 INFO:teuthology.orchestra.run.smithi101.stdout: "duration": 4294967295.9999995 2023-08-01T19:55:23.845 INFO:teuthology.orchestra.run.smithi101.stdout: }, 2023-08-01T19:55:23.845 INFO:teuthology.orchestra.run.smithi101.stdout: { 2023-08-01T19:55:23.846 INFO:teuthology.orchestra.run.smithi101.stdout: "event": "all_read", 2023-08-01T19:55:23.846 INFO:teuthology.orchestra.run.smithi101.stdout: "time": "2023-08-01T19:55:23.820584+0000", 2023-08-01T19:55:23.846 INFO:teuthology.orchestra.run.smithi101.stdout: "duration": 5.3103000000000003e-05 2023-08-01T19:55:23.846 INFO:teuthology.orchestra.run.smithi101.stdout: }, 2023-08-01T19:55:23.847 INFO:teuthology.orchestra.run.smithi101.stdout: { 2023-08-01T19:55:23.847 INFO:teuthology.orchestra.run.smithi101.stdout: "event": "dispatched", 2023-08-01T19:55:23.847 INFO:teuthology.orchestra.run.smithi101.stdout: "time": "2023-08-01T19:55:23.820592+0000", 2023-08-01T19:55:23.847 INFO:teuthology.orchestra.run.smithi101.stdout: "duration": 8.7660000000000004e-06 2023-08-01T19:55:23.848 INFO:teuthology.orchestra.run.smithi101.stdout: }, 2023-08-01T19:55:23.848 INFO:teuthology.orchestra.run.smithi101.stdout: { 2023-08-01T19:55:23.848 INFO:teuthology.orchestra.run.smithi101.stdout: "event": "queued_for_pg", 2023-08-01T19:55:23.848 INFO:teuthology.orchestra.run.smithi101.stdout: "time": "2023-08-01T19:55:23.820598+0000", 2023-08-01T19:55:23.849 INFO:teuthology.orchestra.run.smithi101.stdout: "duration": 5.6540000000000004e-06 2023-08-01T19:55:23.849 INFO:teuthology.orchestra.run.smithi101.stdout: }, 2023-08-01T19:55:23.849 INFO:teuthology.orchestra.run.smithi101.stdout: { 2023-08-01T19:55:23.849 INFO:teuthology.orchestra.run.smithi101.stdout: "event": "reached_pg", 2023-08-01T19:55:23.850 INFO:teuthology.orchestra.run.smithi101.stdout: "time": "2023-08-01T19:55:23.820633+0000", 2023-08-01T19:55:23.850 INFO:teuthology.orchestra.run.smithi101.stdout: "duration": 3.4928999999999997e-05 2023-08-01T19:55:23.850 INFO:teuthology.orchestra.run.smithi101.stdout: }, 2023-08-01T19:55:23.851 INFO:teuthology.orchestra.run.smithi101.stdout: { 2023-08-01T19:55:23.851 INFO:teuthology.orchestra.run.smithi101.stdout: "event": "started", 2023-08-01T19:55:23.851 INFO:teuthology.orchestra.run.smithi101.stdout: "time": "2023-08-01T19:55:23.820652+0000", 2023-08-01T19:55:23.851 INFO:teuthology.orchestra.run.smithi101.stdout: "duration": 1.8794999999999999e-05 2023-08-01T19:55:23.852 INFO:teuthology.orchestra.run.smithi101.stdout: } 2023-08-01T19:55:23.852 INFO:teuthology.orchestra.run.smithi101.stdout: ] 2023-08-01T19:55:23.852 INFO:teuthology.orchestra.run.smithi101.stdout: } 2023-08-01T19:55:23.852 INFO:teuthology.orchestra.run.smithi101.stdout: }, 2023-08-01T19:55:23.853 INFO:teuthology.orchestra.run.smithi101.stdout: { 2023-08-01T19:55:23.853 INFO:teuthology.orchestra.run.smithi101.stdout: "description": "osd_repop(client.4668.0:132726 5.5 e45/19 5:aa037630:::benchmark_data_smithi006_114134_object132725:head v 45'8221, mlcod=45'8218)", 2023-08-01T19:55:23.853 INFO:teuthology.orchestra.run.smithi101.stdout: "initiated_at": "2023-08-01T19:55:23.820723+0000", 2023-08-01T19:55:23.853 INFO:teuthology.orchestra.run.smithi101.stdout: "age": 0.0037340049999999999, 2023-08-01T19:55:23.854 INFO:teuthology.orchestra.run.smithi101.stdout: "duration": 0.0038991410000000001, 2023-08-01T19:55:23.854 INFO:teuthology.orchestra.run.smithi101.stdout: "type_data": { 2023-08-01T19:55:23.854 INFO:teuthology.orchestra.run.smithi101.stdout: "flag_point": "started", 2023-08-01T19:55:23.854 INFO:teuthology.orchestra.run.smithi101.stdout: "events": [ 2023-08-01T19:55:23.855 INFO:teuthology.orchestra.run.smithi101.stdout: { 2023-08-01T19:55:23.855 INFO:teuthology.orchestra.run.smithi101.stdout: "event": "initiated", 2023-08-01T19:55:23.855 INFO:teuthology.orchestra.run.smithi101.stdout: "time": "2023-08-01T19:55:23.820723+0000", 2023-08-01T19:55:23.855 INFO:teuthology.orchestra.run.smithi101.stdout: "duration": 0 2023-08-01T19:55:23.856 INFO:teuthology.orchestra.run.smithi101.stdout: }, 2023-08-01T19:55:23.856 INFO:teuthology.orchestra.run.smithi101.stdout: { 2023-08-01T19:55:23.856 INFO:teuthology.orchestra.run.smithi101.stdout: "event": "throttled", 2023-08-01T19:55:23.857 INFO:teuthology.orchestra.run.smithi101.stdout: "time": "2023-08-01T19:55:23.820723+0000", 2023-08-01T19:55:23.857 INFO:teuthology.orchestra.run.smithi101.stdout: "duration": 0 2023-08-01T19:55:23.857 INFO:teuthology.orchestra.run.smithi101.stdout: }, 2023-08-01T19:55:23.857 INFO:teuthology.orchestra.run.smithi101.stdout: { 2023-08-01T19:55:23.858 INFO:teuthology.orchestra.run.smithi101.stdout: "event": "header_read", 2023-08-01T19:55:23.858 INFO:teuthology.orchestra.run.smithi101.stdout: "time": "2023-08-01T19:55:23.820722+0000", 2023-08-01T19:55:23.858 INFO:teuthology.orchestra.run.smithi101.stdout: "duration": 4294967295.9999995 2023-08-01T19:55:23.858 INFO:teuthology.orchestra.run.smithi101.stdout: }, 2023-08-01T19:55:23.859 INFO:teuthology.orchestra.run.smithi101.stdout: { 2023-08-01T19:55:23.859 INFO:teuthology.orchestra.run.smithi101.stdout: "event": "all_read", 2023-08-01T19:55:23.859 INFO:teuthology.orchestra.run.smithi101.stdout: "time": "2023-08-01T19:55:23.820756+0000", 2023-08-01T19:55:23.859 INFO:teuthology.orchestra.run.smithi101.stdout: "duration": 3.4198e-05 2023-08-01T19:55:23.860 INFO:teuthology.orchestra.run.smithi101.stdout: }, 2023-08-01T19:55:23.860 INFO:teuthology.orchestra.run.smithi101.stdout: { 2023-08-01T19:55:23.860 INFO:teuthology.orchestra.run.smithi101.stdout: "event": "dispatched", 2023-08-01T19:55:23.860 INFO:teuthology.orchestra.run.smithi101.stdout: "time": "2023-08-01T19:55:23.820766+0000", 2023-08-01T19:55:23.861 INFO:teuthology.orchestra.run.smithi101.stdout: "duration": 9.8859999999999999e-06 2023-08-01T19:55:23.861 INFO:teuthology.orchestra.run.smithi101.stdout: }, 2023-08-01T19:55:23.861 INFO:teuthology.orchestra.run.smithi101.stdout: { 2023-08-01T19:55:23.861 INFO:teuthology.orchestra.run.smithi101.stdout: "event": "queued_for_pg", 2023-08-01T19:55:23.862 INFO:teuthology.orchestra.run.smithi101.stdout: "time": "2023-08-01T19:55:23.820771+0000", 2023-08-01T19:55:23.862 INFO:teuthology.orchestra.run.smithi101.stdout: "duration": 4.2150000000000003e-06 2023-08-01T19:55:23.862 INFO:teuthology.orchestra.run.smithi101.stdout: }, 2023-08-01T19:55:23.862 INFO:teuthology.orchestra.run.smithi101.stdout: { 2023-08-01T19:55:23.863 INFO:teuthology.orchestra.run.smithi101.stdout: "event": "reached_pg", 2023-08-01T19:55:23.863 INFO:teuthology.orchestra.run.smithi101.stdout: "time": "2023-08-01T19:55:23.820804+0000", 2023-08-01T19:55:23.863 INFO:teuthology.orchestra.run.smithi101.stdout: "duration": 3.3633000000000001e-05 2023-08-01T19:55:23.863 INFO:teuthology.orchestra.run.smithi101.stdout: }, 2023-08-01T19:55:23.864 INFO:teuthology.orchestra.run.smithi101.stdout: { 2023-08-01T19:55:23.864 INFO:teuthology.orchestra.run.smithi101.stdout: "event": "started", 2023-08-01T19:55:23.864 INFO:teuthology.orchestra.run.smithi101.stdout: "time": "2023-08-01T19:55:23.820861+0000", 2023-08-01T19:55:23.864 INFO:teuthology.orchestra.run.smithi101.stdout: "duration": 5.6542000000000002e-05 2023-08-01T19:55:23.865 INFO:teuthology.orchestra.run.smithi101.stdout: } 2023-08-01T19:55:23.865 INFO:teuthology.orchestra.run.smithi101.stdout: ] 2023-08-01T19:55:23.865 INFO:teuthology.orchestra.run.smithi101.stdout: } 2023-08-01T19:55:23.865 INFO:teuthology.orchestra.run.smithi101.stdout: }, 2023-08-01T19:55:23.866 INFO:teuthology.orchestra.run.smithi101.stdout: { 2023-08-01T19:55:23.866 INFO:teuthology.orchestra.run.smithi101.stdout: "description": "osd_repop(client.4668.0:132728 5.9 e45/40 5:976e58e1:::benchmark_data_smithi006_114134_object132727:head v 45'8341, mlcod=45'8338)", 2023-08-01T19:55:23.866 INFO:teuthology.orchestra.run.smithi101.stdout: "initiated_at": "2023-08-01T19:55:23.820824+0000", 2023-08-01T19:55:23.866 INFO:teuthology.orchestra.run.smithi101.stdout: "age": 0.003633149, 2023-08-01T19:55:23.867 INFO:teuthology.orchestra.run.smithi101.stdout: "duration": 0.0038595209999999999, 2023-08-01T19:55:23.867 INFO:teuthology.orchestra.run.smithi101.stdout: "type_data": { 2023-08-01T19:55:23.867 INFO:teuthology.orchestra.run.smithi101.stdout: "flag_point": "started", 2023-08-01T19:55:23.868 INFO:teuthology.orchestra.run.smithi101.stdout: "events": [ 2023-08-01T19:55:23.868 INFO:teuthology.orchestra.run.smithi101.stdout: { 2023-08-01T19:55:23.868 INFO:teuthology.orchestra.run.smithi101.stdout: "event": "initiated", 2023-08-01T19:55:23.868 INFO:teuthology.orchestra.run.smithi101.stdout: "time": "2023-08-01T19:55:23.820824+0000", 2023-08-01T19:55:23.869 INFO:teuthology.orchestra.run.smithi101.stdout: "duration": 0 2023-08-01T19:55:23.869 INFO:teuthology.orchestra.run.smithi101.stdout: }, 2023-08-01T19:55:23.869 INFO:teuthology.orchestra.run.smithi101.stdout: { 2023-08-01T19:55:23.869 INFO:teuthology.orchestra.run.smithi101.stdout: "event": "throttled", 2023-08-01T19:55:23.870 INFO:teuthology.orchestra.run.smithi101.stdout: "time": "2023-08-01T19:55:23.820824+0000", 2023-08-01T19:55:23.870 INFO:teuthology.orchestra.run.smithi101.stdout: "duration": 0 2023-08-01T19:55:23.870 INFO:teuthology.orchestra.run.smithi101.stdout: }, 2023-08-01T19:55:23.870 INFO:teuthology.orchestra.run.smithi101.stdout: { 2023-08-01T19:55:23.871 INFO:teuthology.orchestra.run.smithi101.stdout: "event": "header_read", 2023-08-01T19:55:23.871 INFO:teuthology.orchestra.run.smithi101.stdout: "time": "2023-08-01T19:55:23.820823+0000", 2023-08-01T19:55:23.871 INFO:teuthology.orchestra.run.smithi101.stdout: "duration": 4294967295.9999995 2023-08-01T19:55:23.871 INFO:teuthology.orchestra.run.smithi101.stdout: }, 2023-08-01T19:55:23.872 INFO:teuthology.orchestra.run.smithi101.stdout: { 2023-08-01T19:55:23.872 INFO:teuthology.orchestra.run.smithi101.stdout: "event": "all_read", 2023-08-01T19:55:23.872 INFO:teuthology.orchestra.run.smithi101.stdout: "time": "2023-08-01T19:55:23.820916+0000", 2023-08-01T19:55:23.873 INFO:teuthology.orchestra.run.smithi101.stdout: "duration": 9.2910000000000003e-05 2023-08-01T19:55:23.873 INFO:teuthology.orchestra.run.smithi101.stdout: }, 2023-08-01T19:55:23.873 INFO:teuthology.orchestra.run.smithi101.stdout: { 2023-08-01T19:55:23.873 INFO:teuthology.orchestra.run.smithi101.stdout: "event": "dispatched", 2023-08-01T19:55:23.874 INFO:teuthology.orchestra.run.smithi101.stdout: "time": "2023-08-01T19:55:23.820932+0000", 2023-08-01T19:55:23.874 INFO:teuthology.orchestra.run.smithi101.stdout: "duration": 1.5288999999999999e-05 2023-08-01T19:55:23.874 INFO:teuthology.orchestra.run.smithi101.stdout: }, 2023-08-01T19:55:23.874 INFO:teuthology.orchestra.run.smithi101.stdout: { 2023-08-01T19:55:23.875 INFO:teuthology.orchestra.run.smithi101.stdout: "event": "queued_for_pg", 2023-08-01T19:55:23.875 INFO:teuthology.orchestra.run.smithi101.stdout: "time": "2023-08-01T19:55:23.820937+0000", 2023-08-01T19:55:23.875 INFO:teuthology.orchestra.run.smithi101.stdout: "duration": 5.1959999999999999e-06 2023-08-01T19:55:23.875 INFO:teuthology.orchestra.run.smithi101.stdout: }, 2023-08-01T19:55:23.876 INFO:teuthology.orchestra.run.smithi101.stdout: { 2023-08-01T19:55:23.876 INFO:teuthology.orchestra.run.smithi101.stdout: "event": "reached_pg", 2023-08-01T19:55:23.876 INFO:teuthology.orchestra.run.smithi101.stdout: "time": "2023-08-01T19:55:23.820970+0000", 2023-08-01T19:55:23.876 INFO:teuthology.orchestra.run.smithi101.stdout: "duration": 3.3293999999999997e-05 2023-08-01T19:55:23.877 INFO:teuthology.orchestra.run.smithi101.stdout: }, 2023-08-01T19:55:23.877 INFO:teuthology.orchestra.run.smithi101.stdout: { 2023-08-01T19:55:23.877 INFO:teuthology.orchestra.run.smithi101.stdout: "event": "started", 2023-08-01T19:55:23.877 INFO:teuthology.orchestra.run.smithi101.stdout: "time": "2023-08-01T19:55:23.820987+0000", 2023-08-01T19:55:23.878 INFO:teuthology.orchestra.run.smithi101.stdout: "duration": 1.7368e-05 2023-08-01T19:55:23.878 INFO:teuthology.orchestra.run.smithi101.stdout: } 2023-08-01T19:55:23.878 INFO:teuthology.orchestra.run.smithi101.stdout: ] 2023-08-01T19:55:23.878 INFO:teuthology.orchestra.run.smithi101.stdout: } 2023-08-01T19:55:23.879 INFO:teuthology.orchestra.run.smithi101.stdout: }, 2023-08-01T19:55:23.879 INFO:teuthology.orchestra.run.smithi101.stdout: { 2023-08-01T19:55:23.879 INFO:teuthology.orchestra.run.smithi101.stdout: "description": "osd_repop(client.4668.0:132727 5.6 e45/19 5:646d41d7:::benchmark_data_smithi006_114134_object132726:head v 45'8268, mlcod=45'8266)", 2023-08-01T19:55:23.879 INFO:teuthology.orchestra.run.smithi101.stdout: "initiated_at": "2023-08-01T19:55:23.820867+0000", 2023-08-01T19:55:23.880 INFO:teuthology.orchestra.run.smithi101.stdout: "age": 0.0035901779999999999, 2023-08-01T19:55:23.880 INFO:teuthology.orchestra.run.smithi101.stdout: "duration": 0.0038790360000000002, 2023-08-01T19:55:23.880 INFO:teuthology.orchestra.run.smithi101.stdout: "type_data": { 2023-08-01T19:55:23.880 INFO:teuthology.orchestra.run.smithi101.stdout: "flag_point": "started", 2023-08-01T19:55:23.881 INFO:teuthology.orchestra.run.smithi101.stdout: "events": [ 2023-08-01T19:55:23.881 INFO:teuthology.orchestra.run.smithi101.stdout: { 2023-08-01T19:55:23.881 INFO:teuthology.orchestra.run.smithi101.stdout: "event": "initiated", 2023-08-01T19:55:23.881 INFO:teuthology.orchestra.run.smithi101.stdout: "time": "2023-08-01T19:55:23.820867+0000", 2023-08-01T19:55:23.882 INFO:teuthology.orchestra.run.smithi101.stdout: "duration": 0 2023-08-01T19:55:23.882 INFO:teuthology.orchestra.run.smithi101.stdout: }, 2023-08-01T19:55:23.882 INFO:teuthology.orchestra.run.smithi101.stdout: { 2023-08-01T19:55:23.883 INFO:teuthology.orchestra.run.smithi101.stdout: "event": "throttled", 2023-08-01T19:55:23.883 INFO:teuthology.orchestra.run.smithi101.stdout: "time": "2023-08-01T19:55:23.820867+0000", 2023-08-01T19:55:23.883 INFO:teuthology.orchestra.run.smithi101.stdout: "duration": 0 2023-08-01T19:55:23.883 INFO:teuthology.orchestra.run.smithi101.stdout: }, 2023-08-01T19:55:23.884 INFO:teuthology.orchestra.run.smithi101.stdout: { 2023-08-01T19:55:23.884 INFO:teuthology.orchestra.run.smithi101.stdout: "event": "header_read", 2023-08-01T19:55:23.884 INFO:teuthology.orchestra.run.smithi101.stdout: "time": "2023-08-01T19:55:23.820866+0000", 2023-08-01T19:55:23.884 INFO:teuthology.orchestra.run.smithi101.stdout: "duration": 4294967295.9999995 2023-08-01T19:55:23.885 INFO:teuthology.orchestra.run.smithi101.stdout: }, 2023-08-01T19:55:23.885 INFO:teuthology.orchestra.run.smithi101.stdout: { 2023-08-01T19:55:23.885 INFO:teuthology.orchestra.run.smithi101.stdout: "event": "all_read", 2023-08-01T19:55:23.885 INFO:teuthology.orchestra.run.smithi101.stdout: "time": "2023-08-01T19:55:23.820941+0000", 2023-08-01T19:55:23.886 INFO:teuthology.orchestra.run.smithi101.stdout: "duration": 7.4429000000000002e-05 2023-08-01T19:55:23.886 INFO:teuthology.orchestra.run.smithi101.stdout: }, 2023-08-01T19:55:23.886 INFO:teuthology.orchestra.run.smithi101.stdout: { 2023-08-01T19:55:23.886 INFO:teuthology.orchestra.run.smithi101.stdout: "event": "dispatched", 2023-08-01T19:55:23.887 INFO:teuthology.orchestra.run.smithi101.stdout: "time": "2023-08-01T19:55:23.820947+0000", 2023-08-01T19:55:23.887 INFO:teuthology.orchestra.run.smithi101.stdout: "duration": 6.5610000000000004e-06 2023-08-01T19:55:23.887 INFO:teuthology.orchestra.run.smithi101.stdout: }, 2023-08-01T19:55:23.887 INFO:teuthology.orchestra.run.smithi101.stdout: { 2023-08-01T19:55:23.887 INFO:teuthology.orchestra.run.smithi101.stdout: "event": "queued_for_pg", 2023-08-01T19:55:23.887 INFO:teuthology.orchestra.run.smithi101.stdout: "time": "2023-08-01T19:55:23.820951+0000", 2023-08-01T19:55:23.887 INFO:teuthology.orchestra.run.smithi101.stdout: "duration": 4.0130000000000004e-06 2023-08-01T19:55:23.888 INFO:teuthology.orchestra.run.smithi101.stdout: }, 2023-08-01T19:55:23.888 INFO:teuthology.orchestra.run.smithi101.stdout: { 2023-08-01T19:55:23.888 INFO:teuthology.orchestra.run.smithi101.stdout: "event": "reached_pg", 2023-08-01T19:55:23.888 INFO:teuthology.orchestra.run.smithi101.stdout: "time": "2023-08-01T19:55:23.820996+0000", 2023-08-01T19:55:23.888 INFO:teuthology.orchestra.run.smithi101.stdout: "duration": 4.4787000000000003e-05 2023-08-01T19:55:23.888 INFO:teuthology.orchestra.run.smithi101.stdout: }, 2023-08-01T19:55:23.888 INFO:teuthology.orchestra.run.smithi101.stdout: { 2023-08-01T19:55:23.889 INFO:teuthology.orchestra.run.smithi101.stdout: "event": "started", 2023-08-01T19:55:23.889 INFO:teuthology.orchestra.run.smithi101.stdout: "time": "2023-08-01T19:55:23.821023+0000", 2023-08-01T19:55:23.889 INFO:teuthology.orchestra.run.smithi101.stdout: "duration": 2.6787e-05 2023-08-01T19:55:23.889 INFO:teuthology.orchestra.run.smithi101.stdout: } 2023-08-01T19:55:23.889 INFO:teuthology.orchestra.run.smithi101.stdout: ] 2023-08-01T19:55:23.889 INFO:teuthology.orchestra.run.smithi101.stdout: } 2023-08-01T19:55:23.889 INFO:teuthology.orchestra.run.smithi101.stdout: }, 2023-08-01T19:55:23.889 INFO:teuthology.orchestra.run.smithi101.stdout: { 2023-08-01T19:55:23.890 INFO:teuthology.orchestra.run.smithi101.stdout: "description": "osd_repop(client.4668.0:132732 5.3 e45/19 5:cc5344e5:::benchmark_data_smithi006_114134_object132731:head v 45'8415, mlcod=45'8413)", 2023-08-01T19:55:23.890 INFO:teuthology.orchestra.run.smithi101.stdout: "initiated_at": "2023-08-01T19:55:23.822872+0000", 2023-08-01T19:55:23.890 INFO:teuthology.orchestra.run.smithi101.stdout: "age": 0.0015846720000000001, 2023-08-01T19:55:23.890 INFO:teuthology.orchestra.run.smithi101.stdout: "duration": 0.0019344659999999999, 2023-08-01T19:55:23.890 INFO:teuthology.orchestra.run.smithi101.stdout: "type_data": { 2023-08-01T19:55:23.890 INFO:teuthology.orchestra.run.smithi101.stdout: "flag_point": "started", 2023-08-01T19:55:23.890 INFO:teuthology.orchestra.run.smithi101.stdout: "events": [ 2023-08-01T19:55:23.890 INFO:teuthology.orchestra.run.smithi101.stdout: { 2023-08-01T19:55:23.891 INFO:teuthology.orchestra.run.smithi101.stdout: "event": "initiated", 2023-08-01T19:55:23.891 INFO:teuthology.orchestra.run.smithi101.stdout: "time": "2023-08-01T19:55:23.822872+0000", 2023-08-01T19:55:23.891 INFO:teuthology.orchestra.run.smithi101.stdout: "duration": 0 2023-08-01T19:55:23.891 INFO:teuthology.orchestra.run.smithi101.stdout: }, 2023-08-01T19:55:23.891 INFO:teuthology.orchestra.run.smithi101.stdout: { 2023-08-01T19:55:23.891 INFO:teuthology.orchestra.run.smithi101.stdout: "event": "throttled", 2023-08-01T19:55:23.891 INFO:teuthology.orchestra.run.smithi101.stdout: "time": "2023-08-01T19:55:23.822872+0000", 2023-08-01T19:55:23.891 INFO:teuthology.orchestra.run.smithi101.stdout: "duration": 0 2023-08-01T19:55:23.892 INFO:teuthology.orchestra.run.smithi101.stdout: }, 2023-08-01T19:55:23.892 INFO:teuthology.orchestra.run.smithi101.stdout: { 2023-08-01T19:55:23.892 INFO:teuthology.orchestra.run.smithi101.stdout: "event": "header_read", 2023-08-01T19:55:23.892 INFO:teuthology.orchestra.run.smithi101.stdout: "time": "2023-08-01T19:55:23.822872+0000", 2023-08-01T19:55:23.892 INFO:teuthology.orchestra.run.smithi101.stdout: "duration": 4294967295.9999995 2023-08-01T19:55:23.892 INFO:teuthology.orchestra.run.smithi101.stdout: }, 2023-08-01T19:55:23.892 INFO:teuthology.orchestra.run.smithi101.stdout: { 2023-08-01T19:55:23.893 INFO:teuthology.orchestra.run.smithi101.stdout: "event": "all_read", 2023-08-01T19:55:23.893 INFO:teuthology.orchestra.run.smithi101.stdout: "time": "2023-08-01T19:55:23.822926+0000", 2023-08-01T19:55:23.893 INFO:teuthology.orchestra.run.smithi101.stdout: "duration": 5.4673999999999999e-05 2023-08-01T19:55:23.893 INFO:teuthology.orchestra.run.smithi101.stdout: }, 2023-08-01T19:55:23.893 INFO:teuthology.orchestra.run.smithi101.stdout: { 2023-08-01T19:55:23.893 INFO:teuthology.orchestra.run.smithi101.stdout: "event": "dispatched", 2023-08-01T19:55:23.893 INFO:teuthology.orchestra.run.smithi101.stdout: "time": "2023-08-01T19:55:23.822951+0000", 2023-08-01T19:55:23.893 INFO:teuthology.orchestra.run.smithi101.stdout: "duration": 2.5018e-05 2023-08-01T19:55:23.894 INFO:teuthology.orchestra.run.smithi101.stdout: }, 2023-08-01T19:55:23.894 INFO:teuthology.orchestra.run.smithi101.stdout: { 2023-08-01T19:55:23.894 INFO:teuthology.orchestra.run.smithi101.stdout: "event": "queued_for_pg", 2023-08-01T19:55:23.894 INFO:teuthology.orchestra.run.smithi101.stdout: "time": "2023-08-01T19:55:23.822956+0000", 2023-08-01T19:55:23.894 INFO:teuthology.orchestra.run.smithi101.stdout: "duration": 4.3749999999999996e-06 2023-08-01T19:55:23.894 INFO:teuthology.orchestra.run.smithi101.stdout: }, 2023-08-01T19:55:23.894 INFO:teuthology.orchestra.run.smithi101.stdout: { 2023-08-01T19:55:23.894 INFO:teuthology.orchestra.run.smithi101.stdout: "event": "reached_pg", 2023-08-01T19:55:23.895 INFO:teuthology.orchestra.run.smithi101.stdout: "time": "2023-08-01T19:55:23.822996+0000", 2023-08-01T19:55:23.895 INFO:teuthology.orchestra.run.smithi101.stdout: "duration": 4.0465e-05 2023-08-01T19:55:23.895 INFO:teuthology.orchestra.run.smithi101.stdout: }, 2023-08-01T19:55:23.895 INFO:teuthology.orchestra.run.smithi101.stdout: { 2023-08-01T19:55:23.895 INFO:teuthology.orchestra.run.smithi101.stdout: "event": "started", 2023-08-01T19:55:23.895 INFO:teuthology.orchestra.run.smithi101.stdout: "time": "2023-08-01T19:55:23.823017+0000", 2023-08-01T19:55:23.895 INFO:teuthology.orchestra.run.smithi101.stdout: "duration": 2.1189e-05 2023-08-01T19:55:23.895 INFO:teuthology.orchestra.run.smithi101.stdout: } 2023-08-01T19:55:23.896 INFO:teuthology.orchestra.run.smithi101.stdout: ] 2023-08-01T19:55:23.896 INFO:teuthology.orchestra.run.smithi101.stdout: } 2023-08-01T19:55:23.896 INFO:teuthology.orchestra.run.smithi101.stdout: }, 2023-08-01T19:55:23.896 INFO:teuthology.orchestra.run.smithi101.stdout: { 2023-08-01T19:55:23.896 INFO:teuthology.orchestra.run.smithi101.stdout: "description": "osd_repop(client.4668.0:132730 5.d e45/19 5:bb678aae:::benchmark_data_smithi006_114134_object132729:head v 45'8146, mlcod=45'8143)", 2023-08-01T19:55:23.896 INFO:teuthology.orchestra.run.smithi101.stdout: "initiated_at": "2023-08-01T19:55:23.823098+0000", 2023-08-01T19:55:23.896 INFO:teuthology.orchestra.run.smithi101.stdout: "age": 0.0013589660000000001, 2023-08-01T19:55:23.897 INFO:teuthology.orchestra.run.smithi101.stdout: "duration": 0.0017691060000000001, 2023-08-01T19:55:23.897 INFO:teuthology.orchestra.run.smithi101.stdout: "type_data": { 2023-08-01T19:55:23.897 INFO:teuthology.orchestra.run.smithi101.stdout: "flag_point": "started", 2023-08-01T19:55:23.897 INFO:teuthology.orchestra.run.smithi101.stdout: "events": [ 2023-08-01T19:55:23.897 INFO:teuthology.orchestra.run.smithi101.stdout: { 2023-08-01T19:55:23.897 INFO:teuthology.orchestra.run.smithi101.stdout: "event": "initiated", 2023-08-01T19:55:23.897 INFO:teuthology.orchestra.run.smithi101.stdout: "time": "2023-08-01T19:55:23.823098+0000", 2023-08-01T19:55:23.897 INFO:teuthology.orchestra.run.smithi101.stdout: "duration": 0 2023-08-01T19:55:23.898 INFO:teuthology.orchestra.run.smithi101.stdout: }, 2023-08-01T19:55:23.898 INFO:teuthology.orchestra.run.smithi101.stdout: { 2023-08-01T19:55:23.898 INFO:teuthology.orchestra.run.smithi101.stdout: "event": "throttled", 2023-08-01T19:55:23.898 INFO:teuthology.orchestra.run.smithi101.stdout: "time": "2023-08-01T19:55:23.823098+0000", 2023-08-01T19:55:23.898 INFO:teuthology.orchestra.run.smithi101.stdout: "duration": 0 2023-08-01T19:55:23.898 INFO:teuthology.orchestra.run.smithi101.stdout: }, 2023-08-01T19:55:23.898 INFO:teuthology.orchestra.run.smithi101.stdout: { 2023-08-01T19:55:23.898 INFO:teuthology.orchestra.run.smithi101.stdout: "event": "header_read", 2023-08-01T19:55:23.899 INFO:teuthology.orchestra.run.smithi101.stdout: "time": "2023-08-01T19:55:23.823098+0000", 2023-08-01T19:55:23.899 INFO:teuthology.orchestra.run.smithi101.stdout: "duration": 4294967295.9999995 2023-08-01T19:55:23.899 INFO:teuthology.orchestra.run.smithi101.stdout: }, 2023-08-01T19:55:23.899 INFO:teuthology.orchestra.run.smithi101.stdout: { 2023-08-01T19:55:23.899 INFO:teuthology.orchestra.run.smithi101.stdout: "event": "all_read", 2023-08-01T19:55:23.899 INFO:teuthology.orchestra.run.smithi101.stdout: "time": "2023-08-01T19:55:23.823202+0000", 2023-08-01T19:55:23.899 INFO:teuthology.orchestra.run.smithi101.stdout: "duration": 0.000104132 2023-08-01T19:55:23.900 INFO:teuthology.orchestra.run.smithi101.stdout: }, 2023-08-01T19:55:23.900 INFO:teuthology.orchestra.run.smithi101.stdout: { 2023-08-01T19:55:23.900 INFO:teuthology.orchestra.run.smithi101.stdout: "event": "dispatched", 2023-08-01T19:55:23.900 INFO:teuthology.orchestra.run.smithi101.stdout: "time": "2023-08-01T19:55:23.823209+0000", 2023-08-01T19:55:23.900 INFO:teuthology.orchestra.run.smithi101.stdout: "duration": 6.81e-06 2023-08-01T19:55:23.900 INFO:teuthology.orchestra.run.smithi101.stdout: }, 2023-08-01T19:55:23.900 INFO:teuthology.orchestra.run.smithi101.stdout: { 2023-08-01T19:55:23.900 INFO:teuthology.orchestra.run.smithi101.stdout: "event": "queued_for_pg", 2023-08-01T19:55:23.901 INFO:teuthology.orchestra.run.smithi101.stdout: "time": "2023-08-01T19:55:23.823211+0000", 2023-08-01T19:55:23.901 INFO:teuthology.orchestra.run.smithi101.stdout: "duration": 2.8870000000000001e-06 2023-08-01T19:55:23.901 INFO:teuthology.orchestra.run.smithi101.stdout: }, 2023-08-01T19:55:23.901 INFO:teuthology.orchestra.run.smithi101.stdout: { 2023-08-01T19:55:23.901 INFO:teuthology.orchestra.run.smithi101.stdout: "event": "reached_pg", 2023-08-01T19:55:23.901 INFO:teuthology.orchestra.run.smithi101.stdout: "time": "2023-08-01T19:55:23.823242+0000", 2023-08-01T19:55:23.901 INFO:teuthology.orchestra.run.smithi101.stdout: "duration": 3.0741999999999998e-05 2023-08-01T19:55:23.901 INFO:teuthology.orchestra.run.smithi101.stdout: }, 2023-08-01T19:55:23.902 INFO:teuthology.orchestra.run.smithi101.stdout: { 2023-08-01T19:55:23.902 INFO:teuthology.orchestra.run.smithi101.stdout: "event": "started", 2023-08-01T19:55:23.902 INFO:teuthology.orchestra.run.smithi101.stdout: "time": "2023-08-01T19:55:23.823261+0000", 2023-08-01T19:55:23.902 INFO:teuthology.orchestra.run.smithi101.stdout: "duration": 1.8717000000000001e-05 2023-08-01T19:55:23.902 INFO:teuthology.orchestra.run.smithi101.stdout: } 2023-08-01T19:55:23.902 INFO:teuthology.orchestra.run.smithi101.stdout: ] 2023-08-01T19:55:23.902 INFO:teuthology.orchestra.run.smithi101.stdout: } 2023-08-01T19:55:23.902 INFO:teuthology.orchestra.run.smithi101.stdout: }, 2023-08-01T19:55:23.903 INFO:teuthology.orchestra.run.smithi101.stdout: { 2023-08-01T19:55:23.903 INFO:teuthology.orchestra.run.smithi101.stdout: "description": "osd_op(client.4668.0:132734 5.7 5:ec47dd54:::benchmark_data_smithi006_114134_object132733:head [set-alloc-hint object_size 65536 write_size 65536,write 0~65536 in=65536b] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e45)", 2023-08-01T19:55:23.903 INFO:teuthology.orchestra.run.smithi101.stdout: "initiated_at": "2023-08-01T19:55:23.823411+0000", 2023-08-01T19:55:23.903 INFO:teuthology.orchestra.run.smithi101.stdout: "age": 0.001045615, 2023-08-01T19:55:23.903 INFO:teuthology.orchestra.run.smithi101.stdout: "duration": 0.0015224920000000001, 2023-08-01T19:55:23.903 INFO:teuthology.orchestra.run.smithi101.stdout: "type_data": { 2023-08-01T19:55:23.903 INFO:teuthology.orchestra.run.smithi101.stdout: "flag_point": "waiting for sub ops", 2023-08-01T19:55:23.904 INFO:teuthology.orchestra.run.smithi101.stdout: "client_info": { 2023-08-01T19:55:23.904 INFO:teuthology.orchestra.run.smithi101.stdout: "client": "client.4668", 2023-08-01T19:55:23.904 INFO:teuthology.orchestra.run.smithi101.stdout: "client_addr": "172.21.15.6:0/1709472247", 2023-08-01T19:55:23.904 INFO:teuthology.orchestra.run.smithi101.stdout: "tid": 132734 2023-08-01T19:55:23.904 INFO:teuthology.orchestra.run.smithi101.stdout: }, 2023-08-01T19:55:23.904 INFO:teuthology.orchestra.run.smithi101.stdout: "events": [ 2023-08-01T19:55:23.904 INFO:teuthology.orchestra.run.smithi101.stdout: { 2023-08-01T19:55:23.904 INFO:teuthology.orchestra.run.smithi101.stdout: "event": "initiated", 2023-08-01T19:55:23.905 INFO:teuthology.orchestra.run.smithi101.stdout: "time": "2023-08-01T19:55:23.823411+0000", 2023-08-01T19:55:23.905 INFO:teuthology.orchestra.run.smithi101.stdout: "duration": 0 2023-08-01T19:55:23.905 INFO:teuthology.orchestra.run.smithi101.stdout: }, 2023-08-01T19:55:23.905 INFO:teuthology.orchestra.run.smithi101.stdout: { 2023-08-01T19:55:23.905 INFO:teuthology.orchestra.run.smithi101.stdout: "event": "throttled", 2023-08-01T19:55:23.905 INFO:teuthology.orchestra.run.smithi101.stdout: "time": "2023-08-01T19:55:23.823411+0000", 2023-08-01T19:55:23.905 INFO:teuthology.orchestra.run.smithi101.stdout: "duration": 0 2023-08-01T19:55:23.905 INFO:teuthology.orchestra.run.smithi101.stdout: }, 2023-08-01T19:55:23.906 INFO:teuthology.orchestra.run.smithi101.stdout: { 2023-08-01T19:55:23.906 INFO:teuthology.orchestra.run.smithi101.stdout: "event": "header_read", 2023-08-01T19:55:23.906 INFO:teuthology.orchestra.run.smithi101.stdout: "time": "2023-08-01T19:55:23.823410+0000", 2023-08-01T19:55:23.906 INFO:teuthology.orchestra.run.smithi101.stdout: "duration": 4294967295.999999 2023-08-01T19:55:23.906 INFO:teuthology.orchestra.run.smithi101.stdout: }, 2023-08-01T19:55:23.906 INFO:teuthology.orchestra.run.smithi101.stdout: { 2023-08-01T19:55:23.906 INFO:teuthology.orchestra.run.smithi101.stdout: "event": "all_read", 2023-08-01T19:55:23.906 INFO:teuthology.orchestra.run.smithi101.stdout: "time": "2023-08-01T19:55:23.823465+0000", 2023-08-01T19:55:23.907 INFO:teuthology.orchestra.run.smithi101.stdout: "duration": 5.4367000000000003e-05 2023-08-01T19:55:23.907 INFO:teuthology.orchestra.run.smithi101.stdout: }, 2023-08-01T19:55:23.907 INFO:teuthology.orchestra.run.smithi101.stdout: { 2023-08-01T19:55:23.907 INFO:teuthology.orchestra.run.smithi101.stdout: "event": "dispatched", 2023-08-01T19:55:23.907 INFO:teuthology.orchestra.run.smithi101.stdout: "time": "2023-08-01T19:55:23.823486+0000", 2023-08-01T19:55:23.907 INFO:teuthology.orchestra.run.smithi101.stdout: "duration": 2.1415000000000001e-05 2023-08-01T19:55:23.907 INFO:teuthology.orchestra.run.smithi101.stdout: }, 2023-08-01T19:55:23.907 INFO:teuthology.orchestra.run.smithi101.stdout: { 2023-08-01T19:55:23.908 INFO:teuthology.orchestra.run.smithi101.stdout: "event": "queued_for_pg", 2023-08-01T19:55:23.908 INFO:teuthology.orchestra.run.smithi101.stdout: "time": "2023-08-01T19:55:23.823490+0000", 2023-08-01T19:55:23.908 INFO:teuthology.orchestra.run.smithi101.stdout: "duration": 4.2409999999999997e-06 2023-08-01T19:55:23.908 INFO:teuthology.orchestra.run.smithi101.stdout: }, 2023-08-01T19:55:23.908 INFO:teuthology.orchestra.run.smithi101.stdout: { 2023-08-01T19:55:23.908 INFO:teuthology.orchestra.run.smithi101.stdout: "event": "reached_pg", 2023-08-01T19:55:23.908 INFO:teuthology.orchestra.run.smithi101.stdout: "time": "2023-08-01T19:55:23.823523+0000", 2023-08-01T19:55:23.909 INFO:teuthology.orchestra.run.smithi101.stdout: "duration": 3.2277000000000003e-05 2023-08-01T19:55:23.909 INFO:teuthology.orchestra.run.smithi101.stdout: }, 2023-08-01T19:55:23.909 INFO:teuthology.orchestra.run.smithi101.stdout: { 2023-08-01T19:55:23.909 INFO:teuthology.orchestra.run.smithi101.stdout: "event": "started", 2023-08-01T19:55:23.909 INFO:teuthology.orchestra.run.smithi101.stdout: "time": "2023-08-01T19:55:23.823627+0000", 2023-08-01T19:55:23.909 INFO:teuthology.orchestra.run.smithi101.stdout: "duration": 0.00010446999999999999 2023-08-01T19:55:23.909 INFO:teuthology.orchestra.run.smithi101.stdout: }, 2023-08-01T19:55:23.909 INFO:teuthology.orchestra.run.smithi101.stdout: { 2023-08-01T19:55:23.910 INFO:teuthology.orchestra.run.smithi101.stdout: "event": "waiting for subops from 0", 2023-08-01T19:55:23.910 INFO:teuthology.orchestra.run.smithi101.stdout: "time": "2023-08-01T19:55:23.823730+0000", 2023-08-01T19:55:23.910 INFO:teuthology.orchestra.run.smithi101.stdout: "duration": 0.00010331300000000001 2023-08-01T19:55:23.910 INFO:teuthology.orchestra.run.smithi101.stdout: } 2023-08-01T19:55:23.910 INFO:teuthology.orchestra.run.smithi101.stdout: ] 2023-08-01T19:55:23.910 INFO:teuthology.orchestra.run.smithi101.stdout: } 2023-08-01T19:55:23.910 INFO:teuthology.orchestra.run.smithi101.stdout: } 2023-08-01T19:55:23.910 INFO:teuthology.orchestra.run.smithi101.stdout: ], 2023-08-01T19:55:23.911 INFO:teuthology.orchestra.run.smithi101.stdout: "num_ops": 8 2023-08-01T19:55:23.911 INFO:teuthology.orchestra.run.smithi101.stdout:} 2023-08-01T19:55:23.912 INFO:teuthology.orchestra.run.smithi006.stdout:osd.0: {} 2023-08-01T19:55:23.912 INFO:teuthology.orchestra.run.smithi006.stdout:osd.1: {} 2023-08-01T19:55:23.912 INFO:teuthology.orchestra.run.smithi006.stdout:osd.2: {} 2023-08-01T19:55:23.913 DEBUG:teuthology.orchestra.run.smithi101:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 30 ceph --cluster ceph --admin-daemon /var/run/ceph/ceph-osd.1.asok dump_blocked_ops 2023-08-01T19:55:23.913 INFO:tasks.ceph.osd.1.smithi101.stderr:2023-08-01T19:55:23.910+0000 7fb0cb7f6700 -1 received signal: Hangup from /usr/bin/python3 /bin/daemon-helper kill ceph-osd -f --cluster ceph -i 1 (PID: 111141) UID: 0 2023-08-01T19:55:23.914 INFO:teuthology.orchestra.run.smithi006.stderr:osd.0: osd_enable_op_tracker = 'false' 2023-08-01T19:55:23.914 INFO:teuthology.orchestra.run.smithi006.stderr:osd.1: osd_enable_op_tracker = 'false' 2023-08-01T19:55:23.914 INFO:teuthology.orchestra.run.smithi006.stderr:osd.2: osd_enable_op_tracker = 'false' 2023-08-01T19:55:24.012 INFO:tasks.ceph.osd.2.smithi155.stderr:2023-08-01T19:55:24.011+0000 7faa5c6ac700 -1 received signal: Hangup from /usr/bin/python3 /bin/daemon-helper kill ceph-osd -f --cluster ceph -i 2 (PID: 111337) UID: 0 2023-08-01T19:55:24.112 INFO:teuthology.orchestra.run.smithi101.stdout:ERROR: (22) Invalid argument 2023-08-01T19:55:24.112 INFO:teuthology.orchestra.run.smithi101.stdout:op_tracker tracking is not enabled now, so no ops are tracked currently, even those get stuck. Please enable "osd_enable_op_tracker", and the tracker will start to track new ops received afterwards. 2023-08-01T19:55:24.113 INFO:tasks.ceph.osd.0.smithi008.stderr:2023-08-01T19:55:24.111+0000 7f16a58f4700 -1 received signal: Hangup from /usr/bin/python3 /bin/daemon-helper kill ceph-osd -f --cluster ceph -i 0 (PID: 111179) UID: 0 2023-08-01T19:55:24.125 DEBUG:teuthology.orchestra.run.smithi101:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 30 ceph --cluster ceph --admin-daemon /var/run/ceph/ceph-osd.1.asok dump_historic_ops 2023-08-01T19:55:24.213 INFO:tasks.ceph.osd.1.smithi101.stderr:2023-08-01T19:55:24.212+0000 7fb0cb7f6700 -1 received signal: Hangup from /usr/bin/python3 /bin/daemon-helper kill ceph-osd -f --cluster ceph -i 1 (PID: 111141) UID: 0 2023-08-01T19:55:24.283 INFO:teuthology.orchestra.run.smithi101.stdout:ERROR: (22) Invalid argument 2023-08-01T19:55:24.283 INFO:teuthology.orchestra.run.smithi101.stdout:op_tracker tracking is not enabled now, so no ops are tracked currently, even those get stuck. Please enable "osd_enable_op_tracker", and the tracker will start to track new ops received afterwards. 2023-08-01T19:55:24.297 DEBUG:teuthology.orchestra.run.smithi155:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 30 ceph --cluster ceph --admin-daemon /var/run/ceph/ceph-osd.2.asok dump_ops_in_flight 2023-08-01T19:55:24.314 INFO:tasks.ceph.osd.0.smithi008.stderr:2023-08-01T19:55:24.313+0000 7f16a58f4700 -1 received signal: Hangup from /usr/bin/python3 /bin/daemon-helper kill ceph-osd -f --cluster ceph -i 0 (PID: 111179) UID: 0 2023-08-01T19:55:24.317 INFO:tasks.radosbench.radosbench.0.smithi006.stdout:2023-08-01T19:55:24.317050+0000 min lat: 0.00127316 max lat: 1.03074 avg lat: 0.00718071 2023-08-01T19:55:24.317 INFO:tasks.radosbench.radosbench.0.smithi006.stdout: sec Cur ops started finished avg MB/s cur MB/s last lat(s) avg lat(s) 2023-08-01T19:55:24.318 INFO:tasks.radosbench.radosbench.0.smithi006.stdout: 60 8 133658 133650 139.207 115.625 0.00905291 0.00718071 2023-08-01T19:55:24.415 INFO:tasks.ceph.osd.2.smithi155.stderr:2023-08-01T19:55:24.414+0000 7faa5c6ac700 -1 received signal: Hangup from /usr/bin/python3 /bin/daemon-helper kill ceph-osd -f --cluster ceph -i 2 (PID: 111337) UID: 0 2023-08-01T19:55:24.425 INFO:teuthology.orchestra.run.smithi155.stdout:ERROR: (22) Invalid argument 2023-08-01T19:55:24.425 INFO:teuthology.orchestra.run.smithi155.stdout:op_tracker tracking is not enabled now, so no ops are tracked currently, even those get stuck. Please enable "osd_enable_op_tracker", and the tracker will start to track new ops received afterwards. 2023-08-01T19:55:24.435 DEBUG:teuthology.orchestra.run.smithi155:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 30 ceph --cluster ceph --admin-daemon /var/run/ceph/ceph-osd.2.asok dump_blocked_ops 2023-08-01T19:55:24.517 INFO:tasks.ceph.osd.2.smithi155.stderr:2023-08-01T19:55:24.517+0000 7faa5c6ac700 -1 received signal: Hangup from /usr/bin/python3 /bin/daemon-helper kill ceph-osd -f --cluster ceph -i 2 (PID: 111337) UID: 0 2023-08-01T19:55:24.598 INFO:teuthology.orchestra.run.smithi155.stdout:ERROR: (22) Invalid argument 2023-08-01T19:55:24.598 INFO:teuthology.orchestra.run.smithi155.stdout:op_tracker tracking is not enabled now, so no ops are tracked currently, even those get stuck. Please enable "osd_enable_op_tracker", and the tracker will start to track new ops received afterwards. 2023-08-01T19:55:24.608 DEBUG:teuthology.orchestra.run.smithi155:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 30 ceph --cluster ceph --admin-daemon /var/run/ceph/ceph-osd.2.asok dump_historic_ops 2023-08-01T19:55:24.616 INFO:tasks.ceph.osd.1.smithi101.stderr:2023-08-01T19:55:24.615+0000 7fb0cb7f6700 -1 received signal: Hangup from /usr/bin/python3 /bin/daemon-helper kill ceph-osd -f --cluster ceph -i 1 (PID: 111141) UID: 0 2023-08-01T19:55:24.716 INFO:tasks.ceph.osd.1.smithi101.stderr:2023-08-01T19:55:24.715+0000 7fb0cb7f6700 -1 received signal: Hangup from /usr/bin/python3 /bin/daemon-helper kill ceph-osd -f --cluster ceph -i 1 (PID: 111141) UID: 0 2023-08-01T19:55:24.770 INFO:teuthology.orchestra.run.smithi155.stdout:ERROR: (22) Invalid argument 2023-08-01T19:55:24.770 INFO:teuthology.orchestra.run.smithi155.stdout:op_tracker tracking is not enabled now, so no ops are tracked currently, even those get stuck. Please enable "osd_enable_op_tracker", and the tracker will start to track new ops received afterwards. 2023-08-01T19:55:24.781 DEBUG:teuthology.orchestra.run.smithi008:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 30 ceph --cluster ceph --admin-daemon /var/run/ceph/ceph-osd.0.asok dump_ops_in_flight 2023-08-01T19:55:24.824 INFO:tasks.ceph.osd.0.smithi008.stderr:2023-08-01T19:55:24.823+0000 7f16a58f4700 -1 received signal: Hangup from /usr/bin/python3 /bin/daemon-helper kill ceph-osd -f --cluster ceph -i 0 (PID: 111179) UID: 0 2023-08-01T19:55:24.868 INFO:teuthology.orchestra.run.smithi006.stderr:nodeep-scrub is set 2023-08-01T19:55:24.913 INFO:teuthology.orchestra.run.smithi008.stdout:ERROR: (22) Invalid argument 2023-08-01T19:55:24.913 INFO:teuthology.orchestra.run.smithi008.stdout:op_tracker tracking is not enabled now, so no ops are tracked currently, even those get stuck. Please enable "osd_enable_op_tracker", and the tracker will start to track new ops received afterwards. 2023-08-01T19:55:24.918 INFO:tasks.ceph.osd.1.smithi101.stderr:2023-08-01T19:55:24.917+0000 7fb0cb7f6700 -1 received signal: Hangup from /usr/bin/python3 /bin/daemon-helper kill ceph-osd -f --cluster ceph -i 1 (PID: 111141) UID: 0 2023-08-01T19:55:24.923 DEBUG:teuthology.orchestra.run.smithi008:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 30 ceph --cluster ceph --admin-daemon /var/run/ceph/ceph-osd.0.asok dump_blocked_ops 2023-08-01T19:55:25.019 INFO:tasks.ceph.osd.2.smithi155.stderr:2023-08-01T19:55:25.018+0000 7faa5c6ac700 -1 received signal: Hangup from /usr/bin/python3 /bin/daemon-helper kill ceph-osd -f --cluster ceph -i 2 (PID: 111337) UID: 0 2023-08-01T19:55:25.090 INFO:teuthology.orchestra.run.smithi008.stdout:ERROR: (22) Invalid argument 2023-08-01T19:55:25.091 INFO:teuthology.orchestra.run.smithi008.stdout:op_tracker tracking is not enabled now, so no ops are tracked currently, even those get stuck. Please enable "osd_enable_op_tracker", and the tracker will start to track new ops received afterwards. 2023-08-01T19:55:25.100 DEBUG:teuthology.orchestra.run.smithi008:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 30 ceph --cluster ceph --admin-daemon /var/run/ceph/ceph-osd.0.asok dump_historic_ops 2023-08-01T19:55:25.119 INFO:tasks.ceph.osd.1.smithi101.stderr:2023-08-01T19:55:25.118+0000 7fb0cb7f6700 -1 received signal: Hangup from /usr/bin/python3 /bin/daemon-helper kill ceph-osd -f --cluster ceph -i 1 (PID: 111141) UID: 0 2023-08-01T19:55:25.220 INFO:tasks.ceph.osd.0.smithi008.stderr:2023-08-01T19:55:25.218+0000 7f16a58f4700 -1 received signal: Hangup from /usr/bin/python3 /bin/daemon-helper kill ceph-osd -f --cluster ceph -i 0 (PID: 111179) UID: 0 2023-08-01T19:55:25.228 INFO:teuthology.orchestra.run.smithi008.stdout:ERROR: (22) Invalid argument 2023-08-01T19:55:25.229 INFO:teuthology.orchestra.run.smithi008.stdout:op_tracker tracking is not enabled now, so no ops are tracked currently, even those get stuck. Please enable "osd_enable_op_tracker", and the tracker will start to track new ops received afterwards. 2023-08-01T19:55:25.239 DEBUG:teuthology.orchestra.run.smithi101:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 30 ceph --cluster ceph --admin-daemon /var/run/ceph/ceph-osd.1.asok dump_ops_in_flight 2023-08-01T19:55:25.318 INFO:tasks.radosbench.radosbench.0.smithi006.stdout:Total time run: 60.0073 2023-08-01T19:55:25.318 INFO:tasks.radosbench.radosbench.0.smithi006.stdout:Total writes made: 133658 2023-08-01T19:55:25.318 INFO:tasks.radosbench.radosbench.0.smithi006.stdout:Write size: 65536 2023-08-01T19:55:25.319 INFO:tasks.radosbench.radosbench.0.smithi006.stdout:Object size: 65536 2023-08-01T19:55:25.319 INFO:tasks.radosbench.radosbench.0.smithi006.stdout:Bandwidth (MB/sec): 139.21 2023-08-01T19:55:25.319 INFO:tasks.radosbench.radosbench.0.smithi006.stdout:Stddev Bandwidth: 41.8729 2023-08-01T19:55:25.319 INFO:tasks.radosbench.radosbench.0.smithi006.stdout:Max bandwidth (MB/sec): 278 2023-08-01T19:55:25.319 INFO:tasks.radosbench.radosbench.0.smithi006.stdout:Min bandwidth (MB/sec): 31.9375 2023-08-01T19:55:25.319 INFO:tasks.radosbench.radosbench.0.smithi006.stdout:Average IOPS: 2227 2023-08-01T19:55:25.319 INFO:tasks.radosbench.radosbench.0.smithi006.stdout:Stddev IOPS: 669.966 2023-08-01T19:55:25.319 INFO:tasks.radosbench.radosbench.0.smithi006.stdout:Max IOPS: 4448 2023-08-01T19:55:25.320 INFO:tasks.radosbench.radosbench.0.smithi006.stdout:Min IOPS: 511 2023-08-01T19:55:25.320 INFO:tasks.radosbench.radosbench.0.smithi006.stdout:Average Latency(s): 0.0071808 2023-08-01T19:55:25.320 INFO:tasks.radosbench.radosbench.0.smithi006.stdout:Stddev Latency(s): 0.011354 2023-08-01T19:55:25.320 INFO:tasks.radosbench.radosbench.0.smithi006.stdout:Max latency(s): 1.03074 2023-08-01T19:55:25.320 INFO:tasks.radosbench.radosbench.0.smithi006.stdout:Min latency(s): 0.00127316 2023-08-01T19:55:25.321 INFO:tasks.ceph.osd.0.smithi008.stderr:2023-08-01T19:55:25.320+0000 7f16a58f4700 -1 received signal: Hangup from /usr/bin/python3 /bin/daemon-helper kill ceph-osd -f --cluster ceph -i 0 (PID: 111179) UID: 0 2023-08-01T19:55:25.330 INFO:tasks.radosbench.radosbench.0.smithi006.stdout:Cleaning up (deleting benchmark objects) 2023-08-01T19:55:25.383 INFO:teuthology.orchestra.run.smithi101.stdout:ERROR: (22) Invalid argument 2023-08-01T19:55:25.384 INFO:teuthology.orchestra.run.smithi101.stdout:op_tracker tracking is not enabled now, so no ops are tracked currently, even those get stuck. Please enable "osd_enable_op_tracker", and the tracker will start to track new ops received afterwards. 2023-08-01T19:55:25.396 DEBUG:teuthology.orchestra.run.smithi101:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 30 ceph --cluster ceph --admin-daemon /var/run/ceph/ceph-osd.1.asok dump_blocked_ops 2023-08-01T19:55:25.422 INFO:tasks.ceph.osd.2.smithi155.stderr:2023-08-01T19:55:25.422+0000 7faa5c6ac700 -1 received signal: Hangup from /usr/bin/python3 /bin/daemon-helper kill ceph-osd -f --cluster ceph -i 2 (PID: 111337) UID: 0 2023-08-01T19:55:25.523 INFO:tasks.ceph.osd.2.smithi155.stderr:2023-08-01T19:55:25.523+0000 7faa5c6ac700 -1 received signal: Hangup from /usr/bin/python3 /bin/daemon-helper kill ceph-osd -f --cluster ceph -i 2 (PID: 111337) UID: 0 2023-08-01T19:55:25.553 INFO:teuthology.orchestra.run.smithi101.stdout:ERROR: (22) Invalid argument 2023-08-01T19:55:25.554 INFO:teuthology.orchestra.run.smithi101.stdout:op_tracker tracking is not enabled now, so no ops are tracked currently, even those get stuck. Please enable "osd_enable_op_tracker", and the tracker will start to track new ops received afterwards. 2023-08-01T19:55:25.567 DEBUG:teuthology.orchestra.run.smithi101:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 30 ceph --cluster ceph --admin-daemon /var/run/ceph/ceph-osd.1.asok dump_historic_ops 2023-08-01T19:55:25.624 INFO:tasks.ceph.osd.0.smithi008.stderr:2023-08-01T19:55:25.622+0000 7f16a58f4700 -1 received signal: Hangup from /usr/bin/python3 /bin/daemon-helper kill ceph-osd -f --cluster ceph -i 0 (PID: 111179) UID: 0 2023-08-01T19:55:25.718 INFO:teuthology.orchestra.run.smithi101.stdout:ERROR: (22) Invalid argument 2023-08-01T19:55:25.718 INFO:teuthology.orchestra.run.smithi101.stdout:op_tracker tracking is not enabled now, so no ops are tracked currently, even those get stuck. Please enable "osd_enable_op_tracker", and the tracker will start to track new ops received afterwards. 2023-08-01T19:55:25.725 INFO:tasks.ceph.osd.0.smithi008.stderr:2023-08-01T19:55:25.723+0000 7f16a58f4700 -1 received signal: Hangup from /usr/bin/python3 /bin/daemon-helper kill ceph-osd -f --cluster ceph -i 0 (PID: 111179) UID: 0 2023-08-01T19:55:25.728 DEBUG:teuthology.orchestra.run.smithi155:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 30 ceph --cluster ceph --admin-daemon /var/run/ceph/ceph-osd.2.asok dump_ops_in_flight 2023-08-01T19:55:25.826 INFO:tasks.ceph.osd.2.smithi155.stderr:2023-08-01T19:55:25.825+0000 7faa5c6ac700 -1 received signal: Hangup from /usr/bin/python3 /bin/daemon-helper kill ceph-osd -f --cluster ceph -i 2 (PID: 111337) UID: 0 2023-08-01T19:55:25.887 INFO:teuthology.orchestra.run.smithi155.stdout:ERROR: (22) Invalid argument 2023-08-01T19:55:25.887 INFO:teuthology.orchestra.run.smithi155.stdout:op_tracker tracking is not enabled now, so no ops are tracked currently, even those get stuck. Please enable "osd_enable_op_tracker", and the tracker will start to track new ops received afterwards. 2023-08-01T19:55:25.901 DEBUG:teuthology.orchestra.run.smithi155:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 30 ceph --cluster ceph --admin-daemon /var/run/ceph/ceph-osd.2.asok dump_blocked_ops 2023-08-01T19:55:25.915 DEBUG:teuthology.orchestra.run.smithi006:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 120 ceph --cluster ceph -- tell 'osd.*' injectargs --osd_enable_op_tracker=true 2023-08-01T19:55:25.926 INFO:tasks.ceph.osd.1.smithi101.stderr:2023-08-01T19:55:25.925+0000 7fb0cb7f6700 -1 received signal: Hangup from /usr/bin/python3 /bin/daemon-helper kill ceph-osd -f --cluster ceph -i 1 (PID: 111141) UID: 0 2023-08-01T19:55:26.027 INFO:tasks.ceph.osd.2.smithi155.stderr:2023-08-01T19:55:26.026+0000 7faa5c6ac700 -1 received signal: Hangup from /usr/bin/python3 /bin/daemon-helper kill ceph-osd -f --cluster ceph -i 2 (PID: 111337) UID: 0 2023-08-01T19:55:26.075 INFO:teuthology.orchestra.run.smithi006.stdout:osd.0: {} 2023-08-01T19:55:26.093 INFO:teuthology.orchestra.run.smithi006.stdout:osd.1: {} 2023-08-01T19:55:26.105 INFO:teuthology.orchestra.run.smithi155.stdout:ERROR: (22) Invalid argument 2023-08-01T19:55:26.105 INFO:teuthology.orchestra.run.smithi155.stdout:op_tracker tracking is not enabled now, so no ops are tracked currently, even those get stuck. Please enable "osd_enable_op_tracker", and the tracker will start to track new ops received afterwards. 2023-08-01T19:55:26.114 INFO:teuthology.orchestra.run.smithi006.stdout:osd.2: {} 2023-08-01T19:55:26.115 INFO:teuthology.orchestra.run.smithi006.stderr:osd.0: osd_enable_op_tracker = 'true' 2023-08-01T19:55:26.116 INFO:teuthology.orchestra.run.smithi006.stderr:osd.1: osd_enable_op_tracker = 'true' 2023-08-01T19:55:26.116 INFO:teuthology.orchestra.run.smithi006.stderr:osd.2: osd_enable_op_tracker = 'true' 2023-08-01T19:55:26.118 DEBUG:teuthology.orchestra.run.smithi155:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 30 ceph --cluster ceph --admin-daemon /var/run/ceph/ceph-osd.2.asok dump_historic_ops 2023-08-01T19:55:26.127 INFO:tasks.ceph.osd.1.smithi101.stderr:2023-08-01T19:55:26.125+0000 7fb0cb7f6700 -1 received signal: Hangup from /usr/bin/python3 /bin/daemon-helper kill ceph-osd -f --cluster ceph -i 1 (PID: 111141) UID: 0 2023-08-01T19:55:26.211 INFO:tasks.thrashosds.thrasher:in_osds: [0, 1, 2] out_osds: [] dead_osds: [] live_osds: [0, 1, 2] 2023-08-01T19:55:26.211 INFO:tasks.thrashosds.thrasher:choose_action: min_in 4 min_out 0 min_live 2 min_dead 0 chance_down 1.00 2023-08-01T19:55:26.211 INFO:tasks.thrashosds.thrasher:inject_pause on osd.2 2023-08-01T19:55:26.211 INFO:tasks.thrashosds.thrasher:Testing filestore_inject_stall pause injection for duration 3 2023-08-01T19:55:26.212 INFO:tasks.thrashosds.thrasher:Checking after 0, should_be_down=False 2023-08-01T19:55:26.212 DEBUG:teuthology.orchestra.run.smithi155:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 0 ceph --cluster ceph --admin-daemon /var/run/ceph/ceph-osd.2.asok config set filestore_inject_stall 3 2023-08-01T19:55:26.227 INFO:tasks.ceph.osd.0.smithi008.stderr:2023-08-01T19:55:26.225+0000 7f16a58f4700 -1 received signal: Hangup from /usr/bin/python3 /bin/daemon-helper kill ceph-osd -f --cluster ceph -i 0 (PID: 111179) UID: 0 2023-08-01T19:55:26.327 INFO:tasks.ceph.osd.0.smithi008.stderr:2023-08-01T19:55:26.326+0000 7f16a58f4700 -1 received signal: Hangup from /usr/bin/python3 /bin/daemon-helper kill ceph-osd -f --cluster ceph -i 0 (PID: 111179) UID: 0 2023-08-01T19:55:26.343 INFO:teuthology.orchestra.run.smithi155.stdout:{ 2023-08-01T19:55:26.343 INFO:teuthology.orchestra.run.smithi155.stdout: "size": 20, 2023-08-01T19:55:26.344 INFO:teuthology.orchestra.run.smithi155.stdout: "duration": 600, 2023-08-01T19:55:26.344 INFO:teuthology.orchestra.run.smithi155.stdout: "ops": [ 2023-08-01T19:55:26.344 INFO:teuthology.orchestra.run.smithi155.stdout: { 2023-08-01T19:55:26.344 INFO:teuthology.orchestra.run.smithi155.stdout: "description": "osd_op(client.4668.0:73454 5.8 5:15596b2f:::benchmark_data_smithi006_114134_object73453:head [set-alloc-hint object_size 65536 write_size 65536,write 0~65536] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e31)", 2023-08-01T19:55:26.344 INFO:teuthology.orchestra.run.smithi155.stdout: "initiated_at": "2023-08-01T19:54:51.460020+0000", 2023-08-01T19:55:26.344 INFO:teuthology.orchestra.run.smithi155.stdout: "age": 34.879999040999998, 2023-08-01T19:55:26.344 INFO:teuthology.orchestra.run.smithi155.stdout: "duration": 0.022889436999999999, 2023-08-01T19:55:26.344 INFO:teuthology.orchestra.run.smithi155.stdout: "type_data": { 2023-08-01T19:55:26.345 INFO:teuthology.orchestra.run.smithi155.stdout: "flag_point": "commit sent; apply or cleanup", 2023-08-01T19:55:26.345 INFO:teuthology.orchestra.run.smithi155.stdout: "client_info": { 2023-08-01T19:55:26.345 INFO:teuthology.orchestra.run.smithi155.stdout: "client": "client.4668", 2023-08-01T19:55:26.345 INFO:teuthology.orchestra.run.smithi155.stdout: "client_addr": "172.21.15.6:0/1709472247", 2023-08-01T19:55:26.345 INFO:teuthology.orchestra.run.smithi155.stdout: "tid": 73454 2023-08-01T19:55:26.345 INFO:teuthology.orchestra.run.smithi155.stdout: }, 2023-08-01T19:55:26.345 INFO:teuthology.orchestra.run.smithi155.stdout: "events": [ 2023-08-01T19:55:26.346 INFO:teuthology.orchestra.run.smithi155.stdout: { 2023-08-01T19:55:26.346 INFO:teuthology.orchestra.run.smithi155.stdout: "event": "initiated", 2023-08-01T19:55:26.346 INFO:teuthology.orchestra.run.smithi155.stdout: "time": "2023-08-01T19:54:51.460020+0000", 2023-08-01T19:55:26.346 INFO:teuthology.orchestra.run.smithi155.stdout: "duration": 0 2023-08-01T19:55:26.346 INFO:teuthology.orchestra.run.smithi155.stdout: }, 2023-08-01T19:55:26.346 INFO:teuthology.orchestra.run.smithi155.stdout: { 2023-08-01T19:55:26.346 INFO:teuthology.orchestra.run.smithi155.stdout: "event": "throttled", 2023-08-01T19:55:26.346 INFO:teuthology.orchestra.run.smithi155.stdout: "time": "2023-08-01T19:54:51.460020+0000", 2023-08-01T19:55:26.347 INFO:teuthology.orchestra.run.smithi155.stdout: "duration": 0 2023-08-01T19:55:26.347 INFO:teuthology.orchestra.run.smithi155.stdout: }, 2023-08-01T19:55:26.347 INFO:teuthology.orchestra.run.smithi155.stdout: { 2023-08-01T19:55:26.347 INFO:teuthology.orchestra.run.smithi155.stdout: "event": "header_read", 2023-08-01T19:55:26.347 INFO:teuthology.orchestra.run.smithi155.stdout: "time": "2023-08-01T19:54:51.460019+0000", 2023-08-01T19:55:26.347 INFO:teuthology.orchestra.run.smithi155.stdout: "duration": 4294967295.9999995 2023-08-01T19:55:26.347 INFO:teuthology.orchestra.run.smithi155.stdout: }, 2023-08-01T19:55:26.347 INFO:teuthology.orchestra.run.smithi155.stdout: { 2023-08-01T19:55:26.348 INFO:teuthology.orchestra.run.smithi155.stdout: "event": "all_read", 2023-08-01T19:55:26.348 INFO:teuthology.orchestra.run.smithi155.stdout: "time": "2023-08-01T19:54:51.460051+0000", 2023-08-01T19:55:26.348 INFO:teuthology.orchestra.run.smithi155.stdout: "duration": 3.1736000000000002e-05 2023-08-01T19:55:26.348 INFO:teuthology.orchestra.run.smithi155.stdout: }, 2023-08-01T19:55:26.348 INFO:teuthology.orchestra.run.smithi155.stdout: { 2023-08-01T19:55:26.348 INFO:teuthology.orchestra.run.smithi155.stdout: "event": "dispatched", 2023-08-01T19:55:26.348 INFO:teuthology.orchestra.run.smithi155.stdout: "time": "2023-08-01T19:54:51.460058+0000", 2023-08-01T19:55:26.348 INFO:teuthology.orchestra.run.smithi155.stdout: "duration": 7.3869999999999997e-06 2023-08-01T19:55:26.349 INFO:teuthology.orchestra.run.smithi155.stdout: }, 2023-08-01T19:55:26.349 INFO:teuthology.orchestra.run.smithi155.stdout: { 2023-08-01T19:55:26.349 INFO:teuthology.orchestra.run.smithi155.stdout: "event": "queued_for_pg", 2023-08-01T19:55:26.349 INFO:teuthology.orchestra.run.smithi155.stdout: "time": "2023-08-01T19:54:51.460062+0000", 2023-08-01T19:55:26.349 INFO:teuthology.orchestra.run.smithi155.stdout: "duration": 4.352e-06 2023-08-01T19:55:26.349 INFO:teuthology.orchestra.run.smithi155.stdout: }, 2023-08-01T19:55:26.349 INFO:teuthology.orchestra.run.smithi155.stdout: { 2023-08-01T19:55:26.350 INFO:teuthology.orchestra.run.smithi155.stdout: "event": "reached_pg", 2023-08-01T19:55:26.350 INFO:teuthology.orchestra.run.smithi155.stdout: "time": "2023-08-01T19:54:51.460101+0000", 2023-08-01T19:55:26.350 INFO:teuthology.orchestra.run.smithi155.stdout: "duration": 3.8705000000000003e-05 2023-08-01T19:55:26.350 INFO:teuthology.orchestra.run.smithi155.stdout: }, 2023-08-01T19:55:26.350 INFO:teuthology.orchestra.run.smithi155.stdout: { 2023-08-01T19:55:26.350 INFO:teuthology.orchestra.run.smithi155.stdout: "event": "started", 2023-08-01T19:55:26.350 INFO:teuthology.orchestra.run.smithi155.stdout: "time": "2023-08-01T19:54:51.460236+0000", 2023-08-01T19:55:26.350 INFO:teuthology.orchestra.run.smithi155.stdout: "duration": 0.00013463599999999999 2023-08-01T19:55:26.351 INFO:teuthology.orchestra.run.smithi155.stdout: }, 2023-08-01T19:55:26.351 INFO:teuthology.orchestra.run.smithi155.stdout: { 2023-08-01T19:55:26.351 INFO:teuthology.orchestra.run.smithi155.stdout: "event": "waiting for subops from 0", 2023-08-01T19:55:26.351 INFO:teuthology.orchestra.run.smithi155.stdout: "time": "2023-08-01T19:54:51.460391+0000", 2023-08-01T19:55:26.351 INFO:teuthology.orchestra.run.smithi155.stdout: "duration": 0.00015525000000000001 2023-08-01T19:55:26.351 INFO:teuthology.orchestra.run.smithi155.stdout: }, 2023-08-01T19:55:26.351 INFO:teuthology.orchestra.run.smithi155.stdout: { 2023-08-01T19:55:26.351 INFO:teuthology.orchestra.run.smithi155.stdout: "event": "sub_op_commit_rec", 2023-08-01T19:55:26.352 INFO:teuthology.orchestra.run.smithi155.stdout: "time": "2023-08-01T19:54:51.468393+0000", 2023-08-01T19:55:26.352 INFO:teuthology.orchestra.run.smithi155.stdout: "duration": 0.00800208 2023-08-01T19:55:26.352 INFO:teuthology.orchestra.run.smithi155.stdout: }, 2023-08-01T19:55:26.352 INFO:teuthology.orchestra.run.smithi155.stdout: { 2023-08-01T19:55:26.352 INFO:teuthology.orchestra.run.smithi155.stdout: "event": "op_commit", 2023-08-01T19:55:26.352 INFO:teuthology.orchestra.run.smithi155.stdout: "time": "2023-08-01T19:54:51.482815+0000", 2023-08-01T19:55:26.352 INFO:teuthology.orchestra.run.smithi155.stdout: "duration": 0.01442148 2023-08-01T19:55:26.352 INFO:teuthology.orchestra.run.smithi155.stdout: }, 2023-08-01T19:55:26.353 INFO:teuthology.orchestra.run.smithi155.stdout: { 2023-08-01T19:55:26.353 INFO:teuthology.orchestra.run.smithi155.stdout: "event": "commit_sent", 2023-08-01T19:55:26.353 INFO:teuthology.orchestra.run.smithi155.stdout: "time": "2023-08-01T19:54:51.482866+0000", 2023-08-01T19:55:26.353 INFO:teuthology.orchestra.run.smithi155.stdout: "duration": 5.1842999999999998e-05 2023-08-01T19:55:26.353 INFO:teuthology.orchestra.run.smithi155.stdout: }, 2023-08-01T19:55:26.353 INFO:teuthology.orchestra.run.smithi155.stdout: { 2023-08-01T19:55:26.353 INFO:teuthology.orchestra.run.smithi155.stdout: "event": "done", 2023-08-01T19:55:26.353 INFO:teuthology.orchestra.run.smithi155.stdout: "time": "2023-08-01T19:54:51.482909+0000", 2023-08-01T19:55:26.354 INFO:teuthology.orchestra.run.smithi155.stdout: "duration": 4.2663000000000001e-05 2023-08-01T19:55:26.354 INFO:teuthology.orchestra.run.smithi155.stdout: } 2023-08-01T19:55:26.354 INFO:teuthology.orchestra.run.smithi155.stdout: ] 2023-08-01T19:55:26.354 INFO:teuthology.orchestra.run.smithi155.stdout: } 2023-08-01T19:55:26.354 INFO:teuthology.orchestra.run.smithi155.stdout: }, 2023-08-01T19:55:26.354 INFO:teuthology.orchestra.run.smithi155.stdout: { 2023-08-01T19:55:26.354 INFO:teuthology.orchestra.run.smithi155.stdout: "description": "osd_op(client.4668.0:73455 5.b 5:de51121e:::benchmark_data_smithi006_114134_object73454:head [set-alloc-hint object_size 65536 write_size 65536,write 0~65536] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e31)", 2023-08-01T19:55:26.354 INFO:teuthology.orchestra.run.smithi155.stdout: "initiated_at": "2023-08-01T19:54:51.460078+0000", 2023-08-01T19:55:26.355 INFO:teuthology.orchestra.run.smithi155.stdout: "age": 34.879941066999997, 2023-08-01T19:55:26.355 INFO:teuthology.orchestra.run.smithi155.stdout: "duration": 0.022689121999999999, 2023-08-01T19:55:26.355 INFO:teuthology.orchestra.run.smithi155.stdout: "type_data": { 2023-08-01T19:55:26.355 INFO:teuthology.orchestra.run.smithi155.stdout: "flag_point": "commit sent; apply or cleanup", 2023-08-01T19:55:26.355 INFO:teuthology.orchestra.run.smithi155.stdout: "client_info": { 2023-08-01T19:55:26.355 INFO:teuthology.orchestra.run.smithi155.stdout: "client": "client.4668", 2023-08-01T19:55:26.355 INFO:teuthology.orchestra.run.smithi155.stdout: "client_addr": "172.21.15.6:0/1709472247", 2023-08-01T19:55:26.355 INFO:teuthology.orchestra.run.smithi155.stdout: "tid": 73455 2023-08-01T19:55:26.356 INFO:teuthology.orchestra.run.smithi155.stdout: }, 2023-08-01T19:55:26.356 INFO:teuthology.orchestra.run.smithi155.stdout: "events": [ 2023-08-01T19:55:26.356 INFO:teuthology.orchestra.run.smithi155.stdout: { 2023-08-01T19:55:26.356 INFO:teuthology.orchestra.run.smithi155.stdout: "event": "initiated", 2023-08-01T19:55:26.356 INFO:teuthology.orchestra.run.smithi155.stdout: "time": "2023-08-01T19:54:51.460078+0000", 2023-08-01T19:55:26.356 INFO:teuthology.orchestra.run.smithi155.stdout: "duration": 0 2023-08-01T19:55:26.356 INFO:teuthology.orchestra.run.smithi155.stdout: }, 2023-08-01T19:55:26.357 INFO:teuthology.orchestra.run.smithi155.stdout: { 2023-08-01T19:55:26.357 INFO:teuthology.orchestra.run.smithi155.stdout: "event": "throttled", 2023-08-01T19:55:26.357 INFO:teuthology.orchestra.run.smithi155.stdout: "time": "2023-08-01T19:54:51.460078+0000", 2023-08-01T19:55:26.357 INFO:teuthology.orchestra.run.smithi155.stdout: "duration": 0 2023-08-01T19:55:26.357 INFO:teuthology.orchestra.run.smithi155.stdout: }, 2023-08-01T19:55:26.357 INFO:teuthology.orchestra.run.smithi155.stdout: { 2023-08-01T19:55:26.357 INFO:teuthology.orchestra.run.smithi155.stdout: "event": "header_read", 2023-08-01T19:55:26.357 INFO:teuthology.orchestra.run.smithi155.stdout: "time": "2023-08-01T19:54:51.460077+0000", 2023-08-01T19:55:26.358 INFO:teuthology.orchestra.run.smithi155.stdout: "duration": 4294967295.9999995 2023-08-01T19:55:26.358 INFO:teuthology.orchestra.run.smithi155.stdout: }, 2023-08-01T19:55:26.358 INFO:teuthology.orchestra.run.smithi155.stdout: { 2023-08-01T19:55:26.358 INFO:teuthology.orchestra.run.smithi155.stdout: "event": "all_read", 2023-08-01T19:55:26.358 INFO:teuthology.orchestra.run.smithi155.stdout: "time": "2023-08-01T19:54:51.460102+0000", 2023-08-01T19:55:26.358 INFO:teuthology.orchestra.run.smithi155.stdout: "duration": 2.4933e-05 2023-08-01T19:55:26.358 INFO:teuthology.orchestra.run.smithi155.stdout: }, 2023-08-01T19:55:26.358 INFO:teuthology.orchestra.run.smithi155.stdout: { 2023-08-01T19:55:26.359 INFO:teuthology.orchestra.run.smithi155.stdout: "event": "dispatched", 2023-08-01T19:55:26.359 INFO:teuthology.orchestra.run.smithi155.stdout: "time": "2023-08-01T19:54:51.460109+0000", 2023-08-01T19:55:26.359 INFO:teuthology.orchestra.run.smithi155.stdout: "duration": 7.0720000000000002e-06 2023-08-01T19:55:26.359 INFO:teuthology.orchestra.run.smithi155.stdout: }, 2023-08-01T19:55:26.359 INFO:teuthology.orchestra.run.smithi155.stdout: { 2023-08-01T19:55:26.359 INFO:teuthology.orchestra.run.smithi155.stdout: "event": "queued_for_pg", 2023-08-01T19:55:26.359 INFO:teuthology.orchestra.run.smithi155.stdout: "time": "2023-08-01T19:54:51.460113+0000", 2023-08-01T19:55:26.359 INFO:teuthology.orchestra.run.smithi155.stdout: "duration": 4.3220000000000003e-06 2023-08-01T19:55:26.360 INFO:teuthology.orchestra.run.smithi155.stdout: }, 2023-08-01T19:55:26.360 INFO:teuthology.orchestra.run.smithi155.stdout: { 2023-08-01T19:55:26.360 INFO:teuthology.orchestra.run.smithi155.stdout: "event": "reached_pg", 2023-08-01T19:55:26.360 INFO:teuthology.orchestra.run.smithi155.stdout: "time": "2023-08-01T19:54:51.460955+0000", 2023-08-01T19:55:26.360 INFO:teuthology.orchestra.run.smithi155.stdout: "duration": 0.00084142500000000003 2023-08-01T19:55:26.360 INFO:teuthology.orchestra.run.smithi155.stdout: }, 2023-08-01T19:55:26.360 INFO:teuthology.orchestra.run.smithi155.stdout: { 2023-08-01T19:55:26.361 INFO:teuthology.orchestra.run.smithi155.stdout: "event": "started", 2023-08-01T19:55:26.361 INFO:teuthology.orchestra.run.smithi155.stdout: "time": "2023-08-01T19:54:51.461079+0000", 2023-08-01T19:55:26.361 INFO:teuthology.orchestra.run.smithi155.stdout: "duration": 0.000123826 2023-08-01T19:55:26.361 INFO:teuthology.orchestra.run.smithi155.stdout: }, 2023-08-01T19:55:26.361 INFO:teuthology.orchestra.run.smithi155.stdout: { 2023-08-01T19:55:26.361 INFO:teuthology.orchestra.run.smithi155.stdout: "event": "waiting for subops from 0", 2023-08-01T19:55:26.361 INFO:teuthology.orchestra.run.smithi155.stdout: "time": "2023-08-01T19:54:51.461233+0000", 2023-08-01T19:55:26.361 INFO:teuthology.orchestra.run.smithi155.stdout: "duration": 0.00015431900000000001 2023-08-01T19:55:26.362 INFO:teuthology.orchestra.run.smithi155.stdout: }, 2023-08-01T19:55:26.362 INFO:teuthology.orchestra.run.smithi155.stdout: { 2023-08-01T19:55:26.362 INFO:teuthology.orchestra.run.smithi155.stdout: "event": "sub_op_commit_rec", 2023-08-01T19:55:26.362 INFO:teuthology.orchestra.run.smithi155.stdout: "time": "2023-08-01T19:54:51.468509+0000", 2023-08-01T19:55:26.362 INFO:teuthology.orchestra.run.smithi155.stdout: "duration": 0.0072759859999999999 2023-08-01T19:55:26.362 INFO:teuthology.orchestra.run.smithi155.stdout: }, 2023-08-01T19:55:26.362 INFO:teuthology.orchestra.run.smithi155.stdout: { 2023-08-01T19:55:26.362 INFO:teuthology.orchestra.run.smithi155.stdout: "event": "op_commit", 2023-08-01T19:55:26.363 INFO:teuthology.orchestra.run.smithi155.stdout: "time": "2023-08-01T19:54:51.482704+0000", 2023-08-01T19:55:26.363 INFO:teuthology.orchestra.run.smithi155.stdout: "duration": 0.01419545 2023-08-01T19:55:26.363 INFO:teuthology.orchestra.run.smithi155.stdout: }, 2023-08-01T19:55:26.363 INFO:teuthology.orchestra.run.smithi155.stdout: { 2023-08-01T19:55:26.363 INFO:teuthology.orchestra.run.smithi155.stdout: "event": "commit_sent", 2023-08-01T19:55:26.363 INFO:teuthology.orchestra.run.smithi155.stdout: "time": "2023-08-01T19:54:51.482747+0000", 2023-08-01T19:55:26.363 INFO:teuthology.orchestra.run.smithi155.stdout: "duration": 4.2413999999999997e-05 2023-08-01T19:55:26.363 INFO:teuthology.orchestra.run.smithi155.stdout: }, 2023-08-01T19:55:26.364 INFO:teuthology.orchestra.run.smithi155.stdout: { 2023-08-01T19:55:26.364 INFO:teuthology.orchestra.run.smithi155.stdout: "event": "done", 2023-08-01T19:55:26.364 INFO:teuthology.orchestra.run.smithi155.stdout: "time": "2023-08-01T19:54:51.482767+0000", 2023-08-01T19:55:26.364 INFO:teuthology.orchestra.run.smithi155.stdout: "duration": 1.9908999999999999e-05 2023-08-01T19:55:26.364 INFO:teuthology.orchestra.run.smithi155.stdout: } 2023-08-01T19:55:26.364 INFO:teuthology.orchestra.run.smithi155.stdout: ] 2023-08-01T19:55:26.364 INFO:teuthology.orchestra.run.smithi155.stdout: } 2023-08-01T19:55:26.365 INFO:teuthology.orchestra.run.smithi155.stdout: }, 2023-08-01T19:55:26.365 INFO:teuthology.orchestra.run.smithi155.stdout: { 2023-08-01T19:55:26.365 INFO:teuthology.orchestra.run.smithi155.stdout: "description": "osd_op(client.4668.0:73456 5.0 5:0164baf4:::benchmark_data_smithi006_114134_object73455:head [set-alloc-hint object_size 65536 write_size 65536,write 0~65536] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e31)", 2023-08-01T19:55:26.365 INFO:teuthology.orchestra.run.smithi155.stdout: "initiated_at": "2023-08-01T19:54:51.461520+0000", 2023-08-01T19:55:26.365 INFO:teuthology.orchestra.run.smithi155.stdout: "age": 34.878499077000001, 2023-08-01T19:55:26.365 INFO:teuthology.orchestra.run.smithi155.stdout: "duration": 0.023899916, 2023-08-01T19:55:26.365 INFO:teuthology.orchestra.run.smithi155.stdout: "type_data": { 2023-08-01T19:55:26.366 INFO:teuthology.orchestra.run.smithi155.stdout: "flag_point": "commit sent; apply or cleanup", 2023-08-01T19:55:26.366 INFO:teuthology.orchestra.run.smithi155.stdout: "client_info": { 2023-08-01T19:55:26.366 INFO:teuthology.orchestra.run.smithi155.stdout: "client": "client.4668", 2023-08-01T19:55:26.366 INFO:teuthology.orchestra.run.smithi155.stdout: "client_addr": "172.21.15.6:0/1709472247", 2023-08-01T19:55:26.366 INFO:teuthology.orchestra.run.smithi155.stdout: "tid": 73456 2023-08-01T19:55:26.366 INFO:teuthology.orchestra.run.smithi155.stdout: }, 2023-08-01T19:55:26.366 INFO:teuthology.orchestra.run.smithi155.stdout: "events": [ 2023-08-01T19:55:26.366 INFO:teuthology.orchestra.run.smithi155.stdout: { 2023-08-01T19:55:26.367 INFO:teuthology.orchestra.run.smithi155.stdout: "event": "initiated", 2023-08-01T19:55:26.367 INFO:teuthology.orchestra.run.smithi155.stdout: "time": "2023-08-01T19:54:51.461520+0000", 2023-08-01T19:55:26.367 INFO:teuthology.orchestra.run.smithi155.stdout: "duration": 0 2023-08-01T19:55:26.367 INFO:teuthology.orchestra.run.smithi155.stdout: }, 2023-08-01T19:55:26.367 INFO:teuthology.orchestra.run.smithi155.stdout: { 2023-08-01T19:55:26.367 INFO:teuthology.orchestra.run.smithi155.stdout: "event": "throttled", 2023-08-01T19:55:26.367 INFO:teuthology.orchestra.run.smithi155.stdout: "time": "2023-08-01T19:54:51.461520+0000", 2023-08-01T19:55:26.367 INFO:teuthology.orchestra.run.smithi155.stdout: "duration": 0 2023-08-01T19:55:26.368 INFO:teuthology.orchestra.run.smithi155.stdout: }, 2023-08-01T19:55:26.368 INFO:teuthology.orchestra.run.smithi155.stdout: { 2023-08-01T19:55:26.368 INFO:teuthology.orchestra.run.smithi155.stdout: "event": "header_read", 2023-08-01T19:55:26.368 INFO:teuthology.orchestra.run.smithi155.stdout: "time": "2023-08-01T19:54:51.461519+0000", 2023-08-01T19:55:26.368 INFO:teuthology.orchestra.run.smithi155.stdout: "duration": 4294967295.999999 2023-08-01T19:55:26.368 INFO:teuthology.orchestra.run.smithi155.stdout: }, 2023-08-01T19:55:26.368 INFO:teuthology.orchestra.run.smithi155.stdout: { 2023-08-01T19:55:26.369 INFO:teuthology.orchestra.run.smithi155.stdout: "event": "all_read", 2023-08-01T19:55:26.369 INFO:teuthology.orchestra.run.smithi155.stdout: "time": "2023-08-01T19:54:51.461633+0000", 2023-08-01T19:55:26.369 INFO:teuthology.orchestra.run.smithi155.stdout: "duration": 0.000114015 2023-08-01T19:55:26.369 INFO:teuthology.orchestra.run.smithi155.stdout: }, 2023-08-01T19:55:26.369 INFO:teuthology.orchestra.run.smithi155.stdout: { 2023-08-01T19:55:26.369 INFO:teuthology.orchestra.run.smithi155.stdout: "event": "dispatched", 2023-08-01T19:55:26.369 INFO:teuthology.orchestra.run.smithi155.stdout: "time": "2023-08-01T19:54:51.461643+0000", 2023-08-01T19:55:26.369 INFO:teuthology.orchestra.run.smithi155.stdout: "duration": 1.0217000000000001e-05 2023-08-01T19:55:26.370 INFO:teuthology.orchestra.run.smithi155.stdout: }, 2023-08-01T19:55:26.370 INFO:teuthology.orchestra.run.smithi155.stdout: { 2023-08-01T19:55:26.370 INFO:teuthology.orchestra.run.smithi155.stdout: "event": "queued_for_pg", 2023-08-01T19:55:26.370 INFO:teuthology.orchestra.run.smithi155.stdout: "time": "2023-08-01T19:54:51.461649+0000", 2023-08-01T19:55:26.370 INFO:teuthology.orchestra.run.smithi155.stdout: "duration": 5.8850000000000004e-06 2023-08-01T19:55:26.370 INFO:teuthology.orchestra.run.smithi155.stdout: }, 2023-08-01T19:55:26.370 INFO:teuthology.orchestra.run.smithi155.stdout: { 2023-08-01T19:55:26.370 INFO:teuthology.orchestra.run.smithi155.stdout: "event": "reached_pg", 2023-08-01T19:55:26.371 INFO:teuthology.orchestra.run.smithi155.stdout: "time": "2023-08-01T19:54:51.461686+0000", 2023-08-01T19:55:26.371 INFO:teuthology.orchestra.run.smithi155.stdout: "duration": 3.7319e-05 2023-08-01T19:55:26.371 INFO:teuthology.orchestra.run.smithi155.stdout: }, 2023-08-01T19:55:26.371 INFO:teuthology.orchestra.run.smithi155.stdout: { 2023-08-01T19:55:26.371 INFO:teuthology.orchestra.run.smithi155.stdout: "event": "started", 2023-08-01T19:55:26.371 INFO:teuthology.orchestra.run.smithi155.stdout: "time": "2023-08-01T19:54:51.461802+0000", 2023-08-01T19:55:26.371 INFO:teuthology.orchestra.run.smithi155.stdout: "duration": 0.000115604 2023-08-01T19:55:26.371 INFO:teuthology.orchestra.run.smithi155.stdout: }, 2023-08-01T19:55:26.372 INFO:teuthology.orchestra.run.smithi155.stdout: { 2023-08-01T19:55:26.372 INFO:teuthology.orchestra.run.smithi155.stdout: "event": "waiting for subops from 0", 2023-08-01T19:55:26.372 INFO:teuthology.orchestra.run.smithi155.stdout: "time": "2023-08-01T19:54:51.461933+0000", 2023-08-01T19:55:26.372 INFO:teuthology.orchestra.run.smithi155.stdout: "duration": 0.000131175 2023-08-01T19:55:26.372 INFO:teuthology.orchestra.run.smithi155.stdout: }, 2023-08-01T19:55:26.372 INFO:teuthology.orchestra.run.smithi155.stdout: { 2023-08-01T19:55:26.372 INFO:teuthology.orchestra.run.smithi155.stdout: "event": "sub_op_commit_rec", 2023-08-01T19:55:26.372 INFO:teuthology.orchestra.run.smithi155.stdout: "time": "2023-08-01T19:54:51.468411+0000", 2023-08-01T19:55:26.373 INFO:teuthology.orchestra.run.smithi155.stdout: "duration": 0.0064775850000000001 2023-08-01T19:55:26.373 INFO:teuthology.orchestra.run.smithi155.stdout: }, 2023-08-01T19:55:26.373 INFO:teuthology.orchestra.run.smithi155.stdout: { 2023-08-01T19:55:26.373 INFO:teuthology.orchestra.run.smithi155.stdout: "event": "op_commit", 2023-08-01T19:55:26.373 INFO:teuthology.orchestra.run.smithi155.stdout: "time": "2023-08-01T19:54:51.485340+0000", 2023-08-01T19:55:26.373 INFO:teuthology.orchestra.run.smithi155.stdout: "duration": 0.016928907 2023-08-01T19:55:26.373 INFO:teuthology.orchestra.run.smithi155.stdout: }, 2023-08-01T19:55:26.373 INFO:teuthology.orchestra.run.smithi155.stdout: { 2023-08-01T19:55:26.374 INFO:teuthology.orchestra.run.smithi155.stdout: "event": "commit_sent", 2023-08-01T19:55:26.374 INFO:teuthology.orchestra.run.smithi155.stdout: "time": "2023-08-01T19:54:51.485385+0000", 2023-08-01T19:55:26.374 INFO:teuthology.orchestra.run.smithi155.stdout: "duration": 4.5222000000000002e-05 2023-08-01T19:55:26.374 INFO:teuthology.orchestra.run.smithi155.stdout: }, 2023-08-01T19:55:26.374 INFO:teuthology.orchestra.run.smithi155.stdout: { 2023-08-01T19:55:26.374 INFO:teuthology.orchestra.run.smithi155.stdout: "event": "done", 2023-08-01T19:55:26.374 INFO:teuthology.orchestra.run.smithi155.stdout: "time": "2023-08-01T19:54:51.485420+0000", 2023-08-01T19:55:26.375 INFO:teuthology.orchestra.run.smithi155.stdout: "duration": 3.4717e-05 2023-08-01T19:55:26.375 INFO:teuthology.orchestra.run.smithi155.stdout: } 2023-08-01T19:55:26.375 INFO:teuthology.orchestra.run.smithi155.stdout: ] 2023-08-01T19:55:26.375 INFO:teuthology.orchestra.run.smithi155.stdout: } 2023-08-01T19:55:26.375 INFO:teuthology.orchestra.run.smithi155.stdout: }, 2023-08-01T19:55:26.375 INFO:teuthology.orchestra.run.smithi155.stdout: { 2023-08-01T19:55:26.375 INFO:teuthology.orchestra.run.smithi155.stdout: "description": "osd_op(client.4668.0:100237 5.4 5:2d68bec9:::benchmark_data_smithi006_114134_object100236:head [set-alloc-hint object_size 65536 write_size 65536,write 0~65536] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e37)", 2023-08-01T19:55:26.375 INFO:teuthology.orchestra.run.smithi155.stdout: "initiated_at": "2023-08-01T19:55:05.147736+0000", 2023-08-01T19:55:26.376 INFO:teuthology.orchestra.run.smithi155.stdout: "age": 21.192282364, 2023-08-01T19:55:26.376 INFO:teuthology.orchestra.run.smithi155.stdout: "duration": 0.071299464000000007, 2023-08-01T19:55:26.376 INFO:teuthology.orchestra.run.smithi155.stdout: "type_data": { 2023-08-01T19:55:26.376 INFO:teuthology.orchestra.run.smithi155.stdout: "flag_point": "commit sent; apply or cleanup", 2023-08-01T19:55:26.376 INFO:teuthology.orchestra.run.smithi155.stdout: "client_info": { 2023-08-01T19:55:26.376 INFO:teuthology.orchestra.run.smithi155.stdout: "client": "client.4668", 2023-08-01T19:55:26.376 INFO:teuthology.orchestra.run.smithi155.stdout: "client_addr": "172.21.15.6:0/1709472247", 2023-08-01T19:55:26.376 INFO:teuthology.orchestra.run.smithi155.stdout: "tid": 100237 2023-08-01T19:55:26.377 INFO:teuthology.orchestra.run.smithi155.stdout: }, 2023-08-01T19:55:26.377 INFO:teuthology.orchestra.run.smithi155.stdout: "events": [ 2023-08-01T19:55:26.377 INFO:teuthology.orchestra.run.smithi155.stdout: { 2023-08-01T19:55:26.377 INFO:teuthology.orchestra.run.smithi155.stdout: "event": "initiated", 2023-08-01T19:55:26.377 INFO:teuthology.orchestra.run.smithi155.stdout: "time": "2023-08-01T19:55:05.147736+0000", 2023-08-01T19:55:26.377 INFO:teuthology.orchestra.run.smithi155.stdout: "duration": 0 2023-08-01T19:55:26.377 INFO:teuthology.orchestra.run.smithi155.stdout: }, 2023-08-01T19:55:26.377 INFO:teuthology.orchestra.run.smithi155.stdout: { 2023-08-01T19:55:26.378 INFO:teuthology.orchestra.run.smithi155.stdout: "event": "throttled", 2023-08-01T19:55:26.378 INFO:teuthology.orchestra.run.smithi155.stdout: "time": "2023-08-01T19:55:05.147736+0000", 2023-08-01T19:55:26.378 INFO:teuthology.orchestra.run.smithi155.stdout: "duration": 0 2023-08-01T19:55:26.378 INFO:teuthology.orchestra.run.smithi155.stdout: }, 2023-08-01T19:55:26.378 INFO:teuthology.orchestra.run.smithi155.stdout: { 2023-08-01T19:55:26.378 INFO:teuthology.orchestra.run.smithi155.stdout: "event": "header_read", 2023-08-01T19:55:26.378 INFO:teuthology.orchestra.run.smithi155.stdout: "time": "2023-08-01T19:55:05.147736+0000", 2023-08-01T19:55:26.378 INFO:teuthology.orchestra.run.smithi155.stdout: "duration": 4294967295.9999995 2023-08-01T19:55:26.379 INFO:teuthology.orchestra.run.smithi155.stdout: }, 2023-08-01T19:55:26.379 INFO:teuthology.orchestra.run.smithi155.stdout: { 2023-08-01T19:55:26.379 INFO:teuthology.orchestra.run.smithi155.stdout: "event": "all_read", 2023-08-01T19:55:26.379 INFO:teuthology.orchestra.run.smithi155.stdout: "time": "2023-08-01T19:55:05.147766+0000", 2023-08-01T19:55:26.379 INFO:teuthology.orchestra.run.smithi155.stdout: "duration": 3.0394000000000001e-05 2023-08-01T19:55:26.379 INFO:teuthology.orchestra.run.smithi155.stdout: }, 2023-08-01T19:55:26.379 INFO:teuthology.orchestra.run.smithi155.stdout: { 2023-08-01T19:55:26.379 INFO:teuthology.orchestra.run.smithi155.stdout: "event": "dispatched", 2023-08-01T19:55:26.380 INFO:teuthology.orchestra.run.smithi155.stdout: "time": "2023-08-01T19:55:05.147771+0000", 2023-08-01T19:55:26.380 INFO:teuthology.orchestra.run.smithi155.stdout: "duration": 4.25e-06 2023-08-01T19:55:26.380 INFO:teuthology.orchestra.run.smithi155.stdout: }, 2023-08-01T19:55:26.380 INFO:teuthology.orchestra.run.smithi155.stdout: { 2023-08-01T19:55:26.380 INFO:teuthology.orchestra.run.smithi155.stdout: "event": "queued_for_pg", 2023-08-01T19:55:26.380 INFO:teuthology.orchestra.run.smithi155.stdout: "time": "2023-08-01T19:55:05.147773+0000", 2023-08-01T19:55:26.380 INFO:teuthology.orchestra.run.smithi155.stdout: "duration": 2.4159999999999998e-06 2023-08-01T19:55:26.381 INFO:teuthology.orchestra.run.smithi155.stdout: }, 2023-08-01T19:55:26.381 INFO:teuthology.orchestra.run.smithi155.stdout: { 2023-08-01T19:55:26.381 INFO:teuthology.orchestra.run.smithi155.stdout: "event": "reached_pg", 2023-08-01T19:55:26.381 INFO:teuthology.orchestra.run.smithi155.stdout: "time": "2023-08-01T19:55:05.149903+0000", 2023-08-01T19:55:26.381 INFO:teuthology.orchestra.run.smithi155.stdout: "duration": 0.002129948 2023-08-01T19:55:26.381 INFO:teuthology.orchestra.run.smithi155.stdout: }, 2023-08-01T19:55:26.381 INFO:teuthology.orchestra.run.smithi155.stdout: { 2023-08-01T19:55:26.381 INFO:teuthology.orchestra.run.smithi155.stdout: "event": "started", 2023-08-01T19:55:26.382 INFO:teuthology.orchestra.run.smithi155.stdout: "time": "2023-08-01T19:55:05.149982+0000", 2023-08-01T19:55:26.382 INFO:teuthology.orchestra.run.smithi155.stdout: "duration": 7.8706000000000002e-05 2023-08-01T19:55:26.382 INFO:teuthology.orchestra.run.smithi155.stdout: }, 2023-08-01T19:55:26.382 INFO:teuthology.orchestra.run.smithi155.stdout: { 2023-08-01T19:55:26.382 INFO:teuthology.orchestra.run.smithi155.stdout: "event": "waiting for subops from 0", 2023-08-01T19:55:26.382 INFO:teuthology.orchestra.run.smithi155.stdout: "time": "2023-08-01T19:55:05.150066+0000", 2023-08-01T19:55:26.382 INFO:teuthology.orchestra.run.smithi155.stdout: "duration": 8.4241999999999997e-05 2023-08-01T19:55:26.382 INFO:teuthology.orchestra.run.smithi155.stdout: }, 2023-08-01T19:55:26.383 INFO:teuthology.orchestra.run.smithi155.stdout: { 2023-08-01T19:55:26.383 INFO:teuthology.orchestra.run.smithi155.stdout: "event": "op_commit", 2023-08-01T19:55:26.383 INFO:teuthology.orchestra.run.smithi155.stdout: "time": "2023-08-01T19:55:05.154994+0000", 2023-08-01T19:55:26.383 INFO:teuthology.orchestra.run.smithi155.stdout: "duration": 0.0049277050000000001 2023-08-01T19:55:26.383 INFO:teuthology.orchestra.run.smithi155.stdout: }, 2023-08-01T19:55:26.383 INFO:teuthology.orchestra.run.smithi155.stdout: { 2023-08-01T19:55:26.383 INFO:teuthology.orchestra.run.smithi155.stdout: "event": "sub_op_commit_rec", 2023-08-01T19:55:26.383 INFO:teuthology.orchestra.run.smithi155.stdout: "time": "2023-08-01T19:55:05.218933+0000", 2023-08-01T19:55:26.384 INFO:teuthology.orchestra.run.smithi155.stdout: "duration": 0.063939916999999999 2023-08-01T19:55:26.384 INFO:teuthology.orchestra.run.smithi155.stdout: }, 2023-08-01T19:55:26.384 INFO:teuthology.orchestra.run.smithi155.stdout: { 2023-08-01T19:55:26.384 INFO:teuthology.orchestra.run.smithi155.stdout: "event": "commit_sent", 2023-08-01T19:55:26.384 INFO:teuthology.orchestra.run.smithi155.stdout: "time": "2023-08-01T19:55:05.218989+0000", 2023-08-01T19:55:26.384 INFO:teuthology.orchestra.run.smithi155.stdout: "duration": 5.5772000000000001e-05 2023-08-01T19:55:26.384 INFO:teuthology.orchestra.run.smithi155.stdout: }, 2023-08-01T19:55:26.384 INFO:teuthology.orchestra.run.smithi155.stdout: { 2023-08-01T19:55:26.385 INFO:teuthology.orchestra.run.smithi155.stdout: "event": "done", 2023-08-01T19:55:26.385 INFO:teuthology.orchestra.run.smithi155.stdout: "time": "2023-08-01T19:55:05.219036+0000", 2023-08-01T19:55:26.385 INFO:teuthology.orchestra.run.smithi155.stdout: "duration": 4.6526000000000001e-05 2023-08-01T19:55:26.385 INFO:teuthology.orchestra.run.smithi155.stdout: } 2023-08-01T19:55:26.385 INFO:teuthology.orchestra.run.smithi155.stdout: ] 2023-08-01T19:55:26.385 INFO:teuthology.orchestra.run.smithi155.stdout: } 2023-08-01T19:55:26.385 INFO:teuthology.orchestra.run.smithi155.stdout: }, 2023-08-01T19:55:26.385 INFO:teuthology.orchestra.run.smithi155.stdout: { 2023-08-01T19:55:26.386 INFO:teuthology.orchestra.run.smithi155.stdout: "description": "osd_op(client.4668.0:100242 5.8 5:16a314b8:::benchmark_data_smithi006_114134_object100241:head [set-alloc-hint object_size 65536 write_size 65536,write 0~65536] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e37)", 2023-08-01T19:55:26.386 INFO:teuthology.orchestra.run.smithi155.stdout: "initiated_at": "2023-08-01T19:55:05.150616+0000", 2023-08-01T19:55:26.386 INFO:teuthology.orchestra.run.smithi155.stdout: "age": 21.189402734000002, 2023-08-01T19:55:26.386 INFO:teuthology.orchestra.run.smithi155.stdout: "duration": 0.071105065999999995, 2023-08-01T19:55:26.386 INFO:teuthology.orchestra.run.smithi155.stdout: "type_data": { 2023-08-01T19:55:26.386 INFO:teuthology.orchestra.run.smithi155.stdout: "flag_point": "commit sent; apply or cleanup", 2023-08-01T19:55:26.386 INFO:teuthology.orchestra.run.smithi155.stdout: "client_info": { 2023-08-01T19:55:26.387 INFO:teuthology.orchestra.run.smithi155.stdout: "client": "client.4668", 2023-08-01T19:55:26.387 INFO:teuthology.orchestra.run.smithi155.stdout: "client_addr": "172.21.15.6:0/1709472247", 2023-08-01T19:55:26.387 INFO:teuthology.orchestra.run.smithi155.stdout: "tid": 100242 2023-08-01T19:55:26.387 INFO:teuthology.orchestra.run.smithi155.stdout: }, 2023-08-01T19:55:26.387 INFO:teuthology.orchestra.run.smithi155.stdout: "events": [ 2023-08-01T19:55:26.387 INFO:teuthology.orchestra.run.smithi155.stdout: { 2023-08-01T19:55:26.387 INFO:teuthology.orchestra.run.smithi155.stdout: "event": "initiated", 2023-08-01T19:55:26.387 INFO:teuthology.orchestra.run.smithi155.stdout: "time": "2023-08-01T19:55:05.150616+0000", 2023-08-01T19:55:26.388 INFO:teuthology.orchestra.run.smithi155.stdout: "duration": 0 2023-08-01T19:55:26.388 INFO:teuthology.orchestra.run.smithi155.stdout: }, 2023-08-01T19:55:26.388 INFO:teuthology.orchestra.run.smithi155.stdout: { 2023-08-01T19:55:26.388 INFO:teuthology.orchestra.run.smithi155.stdout: "event": "throttled", 2023-08-01T19:55:26.388 INFO:teuthology.orchestra.run.smithi155.stdout: "time": "2023-08-01T19:55:05.150616+0000", 2023-08-01T19:55:26.388 INFO:teuthology.orchestra.run.smithi155.stdout: "duration": 0 2023-08-01T19:55:26.388 INFO:teuthology.orchestra.run.smithi155.stdout: }, 2023-08-01T19:55:26.388 INFO:teuthology.orchestra.run.smithi155.stdout: { 2023-08-01T19:55:26.389 INFO:teuthology.orchestra.run.smithi155.stdout: "event": "header_read", 2023-08-01T19:55:26.389 INFO:teuthology.orchestra.run.smithi155.stdout: "time": "2023-08-01T19:55:05.150615+0000", 2023-08-01T19:55:26.389 INFO:teuthology.orchestra.run.smithi155.stdout: "duration": 4294967295.999999 2023-08-01T19:55:26.389 INFO:teuthology.orchestra.run.smithi155.stdout: }, 2023-08-01T19:55:26.389 INFO:teuthology.orchestra.run.smithi155.stdout: { 2023-08-01T19:55:26.389 INFO:teuthology.orchestra.run.smithi155.stdout: "event": "all_read", 2023-08-01T19:55:26.389 INFO:teuthology.orchestra.run.smithi155.stdout: "time": "2023-08-01T19:55:05.150696+0000", 2023-08-01T19:55:26.389 INFO:teuthology.orchestra.run.smithi155.stdout: "duration": 8.0852000000000004e-05 2023-08-01T19:55:26.390 INFO:teuthology.orchestra.run.smithi155.stdout: }, 2023-08-01T19:55:26.390 INFO:teuthology.orchestra.run.smithi155.stdout: { 2023-08-01T19:55:26.390 INFO:teuthology.orchestra.run.smithi155.stdout: "event": "dispatched", 2023-08-01T19:55:26.390 INFO:teuthology.orchestra.run.smithi155.stdout: "time": "2023-08-01T19:55:05.150708+0000", 2023-08-01T19:55:26.390 INFO:teuthology.orchestra.run.smithi155.stdout: "duration": 1.2116999999999999e-05 2023-08-01T19:55:26.390 INFO:teuthology.orchestra.run.smithi155.stdout: }, 2023-08-01T19:55:26.390 INFO:teuthology.orchestra.run.smithi155.stdout: { 2023-08-01T19:55:26.391 INFO:teuthology.orchestra.run.smithi155.stdout: "event": "queued_for_pg", 2023-08-01T19:55:26.391 INFO:teuthology.orchestra.run.smithi155.stdout: "time": "2023-08-01T19:55:05.150713+0000", 2023-08-01T19:55:26.391 INFO:teuthology.orchestra.run.smithi155.stdout: "duration": 5.4620000000000004e-06 2023-08-01T19:55:26.391 INFO:teuthology.orchestra.run.smithi155.stdout: }, 2023-08-01T19:55:26.391 INFO:teuthology.orchestra.run.smithi155.stdout: { 2023-08-01T19:55:26.391 INFO:teuthology.orchestra.run.smithi155.stdout: "event": "reached_pg", 2023-08-01T19:55:26.391 INFO:teuthology.orchestra.run.smithi155.stdout: "time": "2023-08-01T19:55:05.150761+0000", 2023-08-01T19:55:26.391 INFO:teuthology.orchestra.run.smithi155.stdout: "duration": 4.7429000000000003e-05 2023-08-01T19:55:26.392 INFO:teuthology.orchestra.run.smithi155.stdout: }, 2023-08-01T19:55:26.392 INFO:teuthology.orchestra.run.smithi155.stdout: { 2023-08-01T19:55:26.392 INFO:teuthology.orchestra.run.smithi155.stdout: "event": "started", 2023-08-01T19:55:26.392 INFO:teuthology.orchestra.run.smithi155.stdout: "time": "2023-08-01T19:55:05.150856+0000", 2023-08-01T19:55:26.392 INFO:teuthology.orchestra.run.smithi155.stdout: "duration": 9.5356e-05 2023-08-01T19:55:26.392 INFO:teuthology.orchestra.run.smithi155.stdout: }, 2023-08-01T19:55:26.392 INFO:teuthology.orchestra.run.smithi155.stdout: { 2023-08-01T19:55:26.393 INFO:teuthology.orchestra.run.smithi155.stdout: "event": "waiting for subops from 0", 2023-08-01T19:55:26.393 INFO:teuthology.orchestra.run.smithi155.stdout: "time": "2023-08-01T19:55:05.150999+0000", 2023-08-01T19:55:26.393 INFO:teuthology.orchestra.run.smithi155.stdout: "duration": 0.00014234499999999999 2023-08-01T19:55:26.393 INFO:teuthology.orchestra.run.smithi155.stdout: }, 2023-08-01T19:55:26.393 INFO:teuthology.orchestra.run.smithi155.stdout: { 2023-08-01T19:55:26.393 INFO:teuthology.orchestra.run.smithi155.stdout: "event": "sub_op_commit_rec", 2023-08-01T19:55:26.393 INFO:teuthology.orchestra.run.smithi155.stdout: "time": "2023-08-01T19:55:05.219001+0000", 2023-08-01T19:55:26.393 INFO:teuthology.orchestra.run.smithi155.stdout: "duration": 0.068002776000000001 2023-08-01T19:55:26.394 INFO:teuthology.orchestra.run.smithi155.stdout: }, 2023-08-01T19:55:26.394 INFO:teuthology.orchestra.run.smithi155.stdout: { 2023-08-01T19:55:26.394 INFO:teuthology.orchestra.run.smithi155.stdout: "event": "op_commit", 2023-08-01T19:55:26.394 INFO:teuthology.orchestra.run.smithi155.stdout: "time": "2023-08-01T19:55:05.221635+0000", 2023-08-01T19:55:26.394 INFO:teuthology.orchestra.run.smithi155.stdout: "duration": 0.0026340579999999999 2023-08-01T19:55:26.394 INFO:teuthology.orchestra.run.smithi155.stdout: }, 2023-08-01T19:55:26.394 INFO:teuthology.orchestra.run.smithi155.stdout: { 2023-08-01T19:55:26.395 INFO:teuthology.orchestra.run.smithi155.stdout: "event": "commit_sent", 2023-08-01T19:55:26.395 INFO:teuthology.orchestra.run.smithi155.stdout: "time": "2023-08-01T19:55:05.221682+0000", 2023-08-01T19:55:26.395 INFO:teuthology.orchestra.run.smithi155.stdout: "duration": 4.7123999999999998e-05 2023-08-01T19:55:26.395 INFO:teuthology.orchestra.run.smithi155.stdout: }, 2023-08-01T19:55:26.395 INFO:teuthology.orchestra.run.smithi155.stdout: { 2023-08-01T19:55:26.395 INFO:teuthology.orchestra.run.smithi155.stdout: "event": "done", 2023-08-01T19:55:26.395 INFO:teuthology.orchestra.run.smithi155.stdout: "time": "2023-08-01T19:55:05.221721+0000", 2023-08-01T19:55:26.396 INFO:teuthology.orchestra.run.smithi155.stdout: "duration": 3.8529999999999999e-05 2023-08-01T19:55:26.396 INFO:teuthology.orchestra.run.smithi155.stdout: } 2023-08-01T19:55:26.396 INFO:teuthology.orchestra.run.smithi155.stdout: ] 2023-08-01T19:55:26.396 INFO:teuthology.orchestra.run.smithi155.stdout: } 2023-08-01T19:55:26.396 INFO:teuthology.orchestra.run.smithi155.stdout: }, 2023-08-01T19:55:26.396 INFO:teuthology.orchestra.run.smithi155.stdout: { 2023-08-01T19:55:26.396 INFO:teuthology.orchestra.run.smithi155.stdout: "description": "osd_repop(client.4668.0:100240 5.a e37/19 5:5313c5b9:::benchmark_data_smithi006_114134_object100239:head v 37'6227, mlcod=37'6225)", 2023-08-01T19:55:26.396 INFO:teuthology.orchestra.run.smithi155.stdout: "initiated_at": "2023-08-01T19:55:05.150778+0000", 2023-08-01T19:55:26.397 INFO:teuthology.orchestra.run.smithi155.stdout: "age": 21.189240533, 2023-08-01T19:55:26.397 INFO:teuthology.orchestra.run.smithi155.stdout: "duration": 0.073362533999999993, 2023-08-01T19:55:26.397 INFO:teuthology.orchestra.run.smithi155.stdout: "type_data": { 2023-08-01T19:55:26.397 INFO:teuthology.orchestra.run.smithi155.stdout: "flag_point": "commit sent; apply or cleanup", 2023-08-01T19:55:26.397 INFO:teuthology.orchestra.run.smithi155.stdout: "events": [ 2023-08-01T19:55:26.397 INFO:teuthology.orchestra.run.smithi155.stdout: { 2023-08-01T19:55:26.397 INFO:teuthology.orchestra.run.smithi155.stdout: "event": "initiated", 2023-08-01T19:55:26.397 INFO:teuthology.orchestra.run.smithi155.stdout: "time": "2023-08-01T19:55:05.150778+0000", 2023-08-01T19:55:26.398 INFO:teuthology.orchestra.run.smithi155.stdout: "duration": 0 2023-08-01T19:55:26.398 INFO:teuthology.orchestra.run.smithi155.stdout: }, 2023-08-01T19:55:26.398 INFO:teuthology.orchestra.run.smithi155.stdout: { 2023-08-01T19:55:26.398 INFO:teuthology.orchestra.run.smithi155.stdout: "event": "throttled", 2023-08-01T19:55:26.398 INFO:teuthology.orchestra.run.smithi155.stdout: "time": "2023-08-01T19:55:05.150778+0000", 2023-08-01T19:55:26.398 INFO:teuthology.orchestra.run.smithi155.stdout: "duration": 0 2023-08-01T19:55:26.398 INFO:teuthology.orchestra.run.smithi155.stdout: }, 2023-08-01T19:55:26.399 INFO:teuthology.orchestra.run.smithi155.stdout: { 2023-08-01T19:55:26.399 INFO:teuthology.orchestra.run.smithi155.stdout: "event": "header_read", 2023-08-01T19:55:26.399 INFO:teuthology.orchestra.run.smithi155.stdout: "time": "2023-08-01T19:55:05.150778+0000", 2023-08-01T19:55:26.399 INFO:teuthology.orchestra.run.smithi155.stdout: "duration": 4294967295.9999995 2023-08-01T19:55:26.399 INFO:teuthology.orchestra.run.smithi155.stdout: }, 2023-08-01T19:55:26.399 INFO:teuthology.orchestra.run.smithi155.stdout: { 2023-08-01T19:55:26.399 INFO:teuthology.orchestra.run.smithi155.stdout: "event": "all_read", 2023-08-01T19:55:26.399 INFO:teuthology.orchestra.run.smithi155.stdout: "time": "2023-08-01T19:55:05.150811+0000", 2023-08-01T19:55:26.400 INFO:teuthology.orchestra.run.smithi155.stdout: "duration": 3.3664000000000002e-05 2023-08-01T19:55:26.400 INFO:teuthology.orchestra.run.smithi155.stdout: }, 2023-08-01T19:55:26.400 INFO:teuthology.orchestra.run.smithi155.stdout: { 2023-08-01T19:55:26.400 INFO:teuthology.orchestra.run.smithi155.stdout: "event": "dispatched", 2023-08-01T19:55:26.400 INFO:teuthology.orchestra.run.smithi155.stdout: "time": "2023-08-01T19:55:05.150818+0000", 2023-08-01T19:55:26.400 INFO:teuthology.orchestra.run.smithi155.stdout: "duration": 6.5769999999999999e-06 2023-08-01T19:55:26.400 INFO:teuthology.orchestra.run.smithi155.stdout: }, 2023-08-01T19:55:26.400 INFO:teuthology.orchestra.run.smithi155.stdout: { 2023-08-01T19:55:26.401 INFO:teuthology.orchestra.run.smithi155.stdout: "event": "queued_for_pg", 2023-08-01T19:55:26.401 INFO:teuthology.orchestra.run.smithi155.stdout: "time": "2023-08-01T19:55:05.150822+0000", 2023-08-01T19:55:26.401 INFO:teuthology.orchestra.run.smithi155.stdout: "duration": 4.0060000000000003e-06 2023-08-01T19:55:26.401 INFO:teuthology.orchestra.run.smithi155.stdout: }, 2023-08-01T19:55:26.401 INFO:teuthology.orchestra.run.smithi155.stdout: { 2023-08-01T19:55:26.401 INFO:teuthology.orchestra.run.smithi155.stdout: "event": "reached_pg", 2023-08-01T19:55:26.401 INFO:teuthology.orchestra.run.smithi155.stdout: "time": "2023-08-01T19:55:05.150855+0000", 2023-08-01T19:55:26.401 INFO:teuthology.orchestra.run.smithi155.stdout: "duration": 3.3204999999999998e-05 2023-08-01T19:55:26.402 INFO:teuthology.orchestra.run.smithi155.stdout: }, 2023-08-01T19:55:26.402 INFO:teuthology.orchestra.run.smithi155.stdout: { 2023-08-01T19:55:26.402 INFO:teuthology.orchestra.run.smithi155.stdout: "event": "started", 2023-08-01T19:55:26.402 INFO:teuthology.orchestra.run.smithi155.stdout: "time": "2023-08-01T19:55:05.150873+0000", 2023-08-01T19:55:26.402 INFO:teuthology.orchestra.run.smithi155.stdout: "duration": 1.8139999999999999e-05 2023-08-01T19:55:26.402 INFO:teuthology.orchestra.run.smithi155.stdout: }, 2023-08-01T19:55:26.402 INFO:teuthology.orchestra.run.smithi155.stdout: { 2023-08-01T19:55:26.402 INFO:teuthology.orchestra.run.smithi155.stdout: "event": "commit_sent", 2023-08-01T19:55:26.403 INFO:teuthology.orchestra.run.smithi155.stdout: "time": "2023-08-01T19:55:05.224095+0000", 2023-08-01T19:55:26.403 INFO:teuthology.orchestra.run.smithi155.stdout: "duration": 0.073221895999999995 2023-08-01T19:55:26.403 INFO:teuthology.orchestra.run.smithi155.stdout: }, 2023-08-01T19:55:26.403 INFO:teuthology.orchestra.run.smithi155.stdout: { 2023-08-01T19:55:26.403 INFO:teuthology.orchestra.run.smithi155.stdout: "event": "done", 2023-08-01T19:55:26.403 INFO:teuthology.orchestra.run.smithi155.stdout: "time": "2023-08-01T19:55:05.224141+0000", 2023-08-01T19:55:26.403 INFO:teuthology.orchestra.run.smithi155.stdout: "duration": 4.5385e-05 2023-08-01T19:55:26.403 INFO:teuthology.orchestra.run.smithi155.stdout: } 2023-08-01T19:55:26.404 INFO:teuthology.orchestra.run.smithi155.stdout: ] 2023-08-01T19:55:26.404 INFO:teuthology.orchestra.run.smithi155.stdout: } 2023-08-01T19:55:26.404 INFO:teuthology.orchestra.run.smithi155.stdout: }, 2023-08-01T19:55:26.404 INFO:teuthology.orchestra.run.smithi155.stdout: { 2023-08-01T19:55:26.404 INFO:teuthology.orchestra.run.smithi155.stdout: "description": "osd_op(client.4668.0:100245 5.e 5:71869c66:::benchmark_data_smithi006_114134_object100244:head [set-alloc-hint object_size 65536 write_size 65536,write 0~65536] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e37)", 2023-08-01T19:55:26.404 INFO:teuthology.orchestra.run.smithi155.stdout: "initiated_at": "2023-08-01T19:55:05.150991+0000", 2023-08-01T19:55:26.404 INFO:teuthology.orchestra.run.smithi155.stdout: "age": 21.189027746000001, 2023-08-01T19:55:26.405 INFO:teuthology.orchestra.run.smithi155.stdout: "duration": 0.070734490999999997, 2023-08-01T19:55:26.405 INFO:teuthology.orchestra.run.smithi155.stdout: "type_data": { 2023-08-01T19:55:26.405 INFO:teuthology.orchestra.run.smithi155.stdout: "flag_point": "commit sent; apply or cleanup", 2023-08-01T19:55:26.405 INFO:teuthology.orchestra.run.smithi155.stdout: "client_info": { 2023-08-01T19:55:26.405 INFO:teuthology.orchestra.run.smithi155.stdout: "client": "client.4668", 2023-08-01T19:55:26.405 INFO:teuthology.orchestra.run.smithi155.stdout: "client_addr": "172.21.15.6:0/1709472247", 2023-08-01T19:55:26.405 INFO:teuthology.orchestra.run.smithi155.stdout: "tid": 100245 2023-08-01T19:55:26.405 INFO:teuthology.orchestra.run.smithi155.stdout: }, 2023-08-01T19:55:26.406 INFO:teuthology.orchestra.run.smithi155.stdout: "events": [ 2023-08-01T19:55:26.406 INFO:teuthology.orchestra.run.smithi155.stdout: { 2023-08-01T19:55:26.406 INFO:teuthology.orchestra.run.smithi155.stdout: "event": "initiated", 2023-08-01T19:55:26.406 INFO:teuthology.orchestra.run.smithi155.stdout: "time": "2023-08-01T19:55:05.150991+0000", 2023-08-01T19:55:26.406 INFO:teuthology.orchestra.run.smithi155.stdout: "duration": 0 2023-08-01T19:55:26.406 INFO:teuthology.orchestra.run.smithi155.stdout: }, 2023-08-01T19:55:26.406 INFO:teuthology.orchestra.run.smithi155.stdout: { 2023-08-01T19:55:26.407 INFO:teuthology.orchestra.run.smithi155.stdout: "event": "throttled", 2023-08-01T19:55:26.407 INFO:teuthology.orchestra.run.smithi155.stdout: "time": "2023-08-01T19:55:05.150991+0000", 2023-08-01T19:55:26.407 INFO:teuthology.orchestra.run.smithi155.stdout: "duration": 0 2023-08-01T19:55:26.407 INFO:teuthology.orchestra.run.smithi155.stdout: }, 2023-08-01T19:55:26.407 INFO:teuthology.orchestra.run.smithi155.stdout: { 2023-08-01T19:55:26.407 INFO:teuthology.orchestra.run.smithi155.stdout: "event": "header_read", 2023-08-01T19:55:26.407 INFO:teuthology.orchestra.run.smithi155.stdout: "time": "2023-08-01T19:55:05.150990+0000", 2023-08-01T19:55:26.407 INFO:teuthology.orchestra.run.smithi155.stdout: "duration": 4294967295.999999 2023-08-01T19:55:26.408 INFO:teuthology.orchestra.run.smithi155.stdout: }, 2023-08-01T19:55:26.408 INFO:teuthology.orchestra.run.smithi155.stdout: { 2023-08-01T19:55:26.408 INFO:teuthology.orchestra.run.smithi155.stdout: "event": "all_read", 2023-08-01T19:55:26.408 INFO:teuthology.orchestra.run.smithi155.stdout: "time": "2023-08-01T19:55:05.151108+0000", 2023-08-01T19:55:26.408 INFO:teuthology.orchestra.run.smithi155.stdout: "duration": 0.00011849300000000001 2023-08-01T19:55:26.408 INFO:teuthology.orchestra.run.smithi155.stdout: }, 2023-08-01T19:55:26.408 INFO:teuthology.orchestra.run.smithi155.stdout: { 2023-08-01T19:55:26.408 INFO:teuthology.orchestra.run.smithi155.stdout: "event": "dispatched", 2023-08-01T19:55:26.409 INFO:teuthology.orchestra.run.smithi155.stdout: "time": "2023-08-01T19:55:05.151117+0000", 2023-08-01T19:55:26.409 INFO:teuthology.orchestra.run.smithi155.stdout: "duration": 8.1040000000000007e-06 2023-08-01T19:55:26.409 INFO:teuthology.orchestra.run.smithi155.stdout: }, 2023-08-01T19:55:26.409 INFO:teuthology.orchestra.run.smithi155.stdout: { 2023-08-01T19:55:26.409 INFO:teuthology.orchestra.run.smithi155.stdout: "event": "queued_for_pg", 2023-08-01T19:55:26.409 INFO:teuthology.orchestra.run.smithi155.stdout: "time": "2023-08-01T19:55:05.151121+0000", 2023-08-01T19:55:26.409 INFO:teuthology.orchestra.run.smithi155.stdout: "duration": 4.2019999999999997e-06 2023-08-01T19:55:26.410 INFO:teuthology.orchestra.run.smithi155.stdout: }, 2023-08-01T19:55:26.410 INFO:teuthology.orchestra.run.smithi155.stdout: { 2023-08-01T19:55:26.410 INFO:teuthology.orchestra.run.smithi155.stdout: "event": "reached_pg", 2023-08-01T19:55:26.410 INFO:teuthology.orchestra.run.smithi155.stdout: "time": "2023-08-01T19:55:05.151162+0000", 2023-08-01T19:55:26.410 INFO:teuthology.orchestra.run.smithi155.stdout: "duration": 4.1448e-05 2023-08-01T19:55:26.410 INFO:teuthology.orchestra.run.smithi155.stdout: }, 2023-08-01T19:55:26.410 INFO:teuthology.orchestra.run.smithi155.stdout: { 2023-08-01T19:55:26.410 INFO:teuthology.orchestra.run.smithi155.stdout: "event": "started", 2023-08-01T19:55:26.411 INFO:teuthology.orchestra.run.smithi155.stdout: "time": "2023-08-01T19:55:05.151281+0000", 2023-08-01T19:55:26.411 INFO:teuthology.orchestra.run.smithi155.stdout: "duration": 0.000119141 2023-08-01T19:55:26.411 INFO:teuthology.orchestra.run.smithi155.stdout: }, 2023-08-01T19:55:26.411 INFO:teuthology.orchestra.run.smithi155.stdout: { 2023-08-01T19:55:26.411 INFO:teuthology.orchestra.run.smithi155.stdout: "event": "waiting for subops from 0", 2023-08-01T19:55:26.411 INFO:teuthology.orchestra.run.smithi155.stdout: "time": "2023-08-01T19:55:05.151443+0000", 2023-08-01T19:55:26.411 INFO:teuthology.orchestra.run.smithi155.stdout: "duration": 0.00016181600000000001 2023-08-01T19:55:26.411 INFO:teuthology.orchestra.run.smithi155.stdout: }, 2023-08-01T19:55:26.412 INFO:teuthology.orchestra.run.smithi155.stdout: { 2023-08-01T19:55:26.412 INFO:teuthology.orchestra.run.smithi155.stdout: "event": "sub_op_commit_rec", 2023-08-01T19:55:26.412 INFO:teuthology.orchestra.run.smithi155.stdout: "time": "2023-08-01T19:55:05.219101+0000", 2023-08-01T19:55:26.412 INFO:teuthology.orchestra.run.smithi155.stdout: "duration": 0.067658037000000004 2023-08-01T19:55:26.412 INFO:teuthology.orchestra.run.smithi155.stdout: }, 2023-08-01T19:55:26.412 INFO:teuthology.orchestra.run.smithi155.stdout: { 2023-08-01T19:55:26.412 INFO:teuthology.orchestra.run.smithi155.stdout: "event": "op_commit", 2023-08-01T19:55:26.412 INFO:teuthology.orchestra.run.smithi155.stdout: "time": "2023-08-01T19:55:05.221646+0000", 2023-08-01T19:55:26.413 INFO:teuthology.orchestra.run.smithi155.stdout: "duration": 0.0025450540000000002 2023-08-01T19:55:26.413 INFO:teuthology.orchestra.run.smithi155.stdout: }, 2023-08-01T19:55:26.413 INFO:teuthology.orchestra.run.smithi155.stdout: { 2023-08-01T19:55:26.413 INFO:teuthology.orchestra.run.smithi155.stdout: "event": "commit_sent", 2023-08-01T19:55:26.413 INFO:teuthology.orchestra.run.smithi155.stdout: "time": "2023-08-01T19:55:05.221689+0000", 2023-08-01T19:55:26.413 INFO:teuthology.orchestra.run.smithi155.stdout: "duration": 4.3078999999999999e-05 2023-08-01T19:55:26.413 INFO:teuthology.orchestra.run.smithi155.stdout: }, 2023-08-01T19:55:26.413 INFO:teuthology.orchestra.run.smithi155.stdout: { 2023-08-01T19:55:26.414 INFO:teuthology.orchestra.run.smithi155.stdout: "event": "done", 2023-08-01T19:55:26.414 INFO:teuthology.orchestra.run.smithi155.stdout: "time": "2023-08-01T19:55:05.221725+0000", 2023-08-01T19:55:26.414 INFO:teuthology.orchestra.run.smithi155.stdout: "duration": 3.6137999999999999e-05 2023-08-01T19:55:26.414 INFO:teuthology.orchestra.run.smithi155.stdout: } 2023-08-01T19:55:26.414 INFO:teuthology.orchestra.run.smithi155.stdout: ] 2023-08-01T19:55:26.414 INFO:teuthology.orchestra.run.smithi155.stdout: } 2023-08-01T19:55:26.414 INFO:teuthology.orchestra.run.smithi155.stdout: }, 2023-08-01T19:55:26.414 INFO:teuthology.orchestra.run.smithi155.stdout: { 2023-08-01T19:55:26.415 INFO:teuthology.orchestra.run.smithi155.stdout: "description": "osd_repop(client.4668.0:100243 5.a e37/19 5:5e8193b6:::benchmark_data_smithi006_114134_object100242:head v 37'6228, mlcod=37'6225)", 2023-08-01T19:55:26.415 INFO:teuthology.orchestra.run.smithi155.stdout: "initiated_at": "2023-08-01T19:55:05.151148+0000", 2023-08-01T19:55:26.415 INFO:teuthology.orchestra.run.smithi155.stdout: "age": 21.188870734999998, 2023-08-01T19:55:26.415 INFO:teuthology.orchestra.run.smithi155.stdout: "duration": 0.073020370000000001, 2023-08-01T19:55:26.415 INFO:teuthology.orchestra.run.smithi155.stdout: "type_data": { 2023-08-01T19:55:26.415 INFO:teuthology.orchestra.run.smithi155.stdout: "flag_point": "commit sent; apply or cleanup", 2023-08-01T19:55:26.415 INFO:teuthology.orchestra.run.smithi155.stdout: "events": [ 2023-08-01T19:55:26.415 INFO:teuthology.orchestra.run.smithi155.stdout: { 2023-08-01T19:55:26.416 INFO:teuthology.orchestra.run.smithi155.stdout: "event": "initiated", 2023-08-01T19:55:26.416 INFO:teuthology.orchestra.run.smithi155.stdout: "time": "2023-08-01T19:55:05.151148+0000", 2023-08-01T19:55:26.416 INFO:teuthology.orchestra.run.smithi155.stdout: "duration": 0 2023-08-01T19:55:26.416 INFO:teuthology.orchestra.run.smithi155.stdout: }, 2023-08-01T19:55:26.416 INFO:teuthology.orchestra.run.smithi155.stdout: { 2023-08-01T19:55:26.416 INFO:teuthology.orchestra.run.smithi155.stdout: "event": "throttled", 2023-08-01T19:55:26.416 INFO:teuthology.orchestra.run.smithi155.stdout: "time": "2023-08-01T19:55:05.151148+0000", 2023-08-01T19:55:26.417 INFO:teuthology.orchestra.run.smithi155.stdout: "duration": 0 2023-08-01T19:55:26.417 INFO:teuthology.orchestra.run.smithi155.stdout: }, 2023-08-01T19:55:26.417 INFO:teuthology.orchestra.run.smithi155.stdout: { 2023-08-01T19:55:26.417 INFO:teuthology.orchestra.run.smithi155.stdout: "event": "header_read", 2023-08-01T19:55:26.417 INFO:teuthology.orchestra.run.smithi155.stdout: "time": "2023-08-01T19:55:05.151147+0000", 2023-08-01T19:55:26.417 INFO:teuthology.orchestra.run.smithi155.stdout: "duration": 4294967295.9999995 2023-08-01T19:55:26.417 INFO:teuthology.orchestra.run.smithi155.stdout: }, 2023-08-01T19:55:26.417 INFO:teuthology.orchestra.run.smithi155.stdout: { 2023-08-01T19:55:26.418 INFO:teuthology.orchestra.run.smithi155.stdout: "event": "all_read", 2023-08-01T19:55:26.418 INFO:teuthology.orchestra.run.smithi155.stdout: "time": "2023-08-01T19:55:05.151231+0000", 2023-08-01T19:55:26.418 INFO:teuthology.orchestra.run.smithi155.stdout: "duration": 8.3135999999999998e-05 2023-08-01T19:55:26.418 INFO:teuthology.orchestra.run.smithi155.stdout: }, 2023-08-01T19:55:26.418 INFO:teuthology.orchestra.run.smithi155.stdout: { 2023-08-01T19:55:26.418 INFO:teuthology.orchestra.run.smithi155.stdout: "event": "dispatched", 2023-08-01T19:55:26.418 INFO:teuthology.orchestra.run.smithi155.stdout: "time": "2023-08-01T19:55:05.151239+0000", 2023-08-01T19:55:26.418 INFO:teuthology.orchestra.run.smithi155.stdout: "duration": 8.7469999999999994e-06 2023-08-01T19:55:26.419 INFO:teuthology.orchestra.run.smithi155.stdout: }, 2023-08-01T19:55:26.419 INFO:teuthology.orchestra.run.smithi155.stdout: { 2023-08-01T19:55:26.419 INFO:teuthology.orchestra.run.smithi155.stdout: "event": "queued_for_pg", 2023-08-01T19:55:26.419 INFO:teuthology.orchestra.run.smithi155.stdout: "time": "2023-08-01T19:55:05.151244+0000", 2023-08-01T19:55:26.419 INFO:teuthology.orchestra.run.smithi155.stdout: "duration": 4.4800000000000003e-06 2023-08-01T19:55:26.419 INFO:teuthology.orchestra.run.smithi155.stdout: }, 2023-08-01T19:55:26.419 INFO:teuthology.orchestra.run.smithi155.stdout: { 2023-08-01T19:55:26.419 INFO:teuthology.orchestra.run.smithi155.stdout: "event": "reached_pg", 2023-08-01T19:55:26.420 INFO:teuthology.orchestra.run.smithi155.stdout: "time": "2023-08-01T19:55:05.152938+0000", 2023-08-01T19:55:26.420 INFO:teuthology.orchestra.run.smithi155.stdout: "duration": 0.001693824 2023-08-01T19:55:26.420 INFO:teuthology.orchestra.run.smithi155.stdout: }, 2023-08-01T19:55:26.420 INFO:teuthology.orchestra.run.smithi155.stdout: { 2023-08-01T19:55:26.420 INFO:teuthology.orchestra.run.smithi155.stdout: "event": "started", 2023-08-01T19:55:26.420 INFO:teuthology.orchestra.run.smithi155.stdout: "time": "2023-08-01T19:55:05.152956+0000", 2023-08-01T19:55:26.420 INFO:teuthology.orchestra.run.smithi155.stdout: "duration": 1.8287e-05 2023-08-01T19:55:26.420 INFO:teuthology.orchestra.run.smithi155.stdout: }, 2023-08-01T19:55:26.421 INFO:teuthology.orchestra.run.smithi155.stdout: { 2023-08-01T19:55:26.421 INFO:teuthology.orchestra.run.smithi155.stdout: "event": "commit_sent", 2023-08-01T19:55:26.421 INFO:teuthology.orchestra.run.smithi155.stdout: "time": "2023-08-01T19:55:05.224145+0000", 2023-08-01T19:55:26.421 INFO:teuthology.orchestra.run.smithi155.stdout: "duration": 0.071189447000000003 2023-08-01T19:55:26.421 INFO:teuthology.orchestra.run.smithi155.stdout: }, 2023-08-01T19:55:26.421 INFO:teuthology.orchestra.run.smithi155.stdout: { 2023-08-01T19:55:26.421 INFO:teuthology.orchestra.run.smithi155.stdout: "event": "done", 2023-08-01T19:55:26.421 INFO:teuthology.orchestra.run.smithi155.stdout: "time": "2023-08-01T19:55:05.224168+0000", 2023-08-01T19:55:26.422 INFO:teuthology.orchestra.run.smithi155.stdout: "duration": 2.3008999999999999e-05 2023-08-01T19:55:26.422 INFO:teuthology.orchestra.run.smithi155.stdout: } 2023-08-01T19:55:26.422 INFO:teuthology.orchestra.run.smithi155.stdout: ] 2023-08-01T19:55:26.422 INFO:teuthology.orchestra.run.smithi155.stdout: } 2023-08-01T19:55:26.422 INFO:teuthology.orchestra.run.smithi155.stdout: }, 2023-08-01T19:55:26.422 INFO:teuthology.orchestra.run.smithi155.stdout: { 2023-08-01T19:55:26.422 INFO:teuthology.orchestra.run.smithi155.stdout: "description": "osd_repop(client.4668.0:100244 5.9 e37/19 5:92f56a12:::benchmark_data_smithi006_114134_object100243:head v 37'6294, mlcod=37'6292)", 2023-08-01T19:55:26.423 INFO:teuthology.orchestra.run.smithi155.stdout: "initiated_at": "2023-08-01T19:55:05.151325+0000", 2023-08-01T19:55:26.423 INFO:teuthology.orchestra.run.smithi155.stdout: "age": 21.188693390000001, 2023-08-01T19:55:26.423 INFO:teuthology.orchestra.run.smithi155.stdout: "duration": 0.071883673999999995, 2023-08-01T19:55:26.423 INFO:teuthology.orchestra.run.smithi155.stdout: "type_data": { 2023-08-01T19:55:26.423 INFO:teuthology.orchestra.run.smithi155.stdout: "flag_point": "commit sent; apply or cleanup", 2023-08-01T19:55:26.423 INFO:teuthology.orchestra.run.smithi155.stdout: "events": [ 2023-08-01T19:55:26.423 INFO:teuthology.orchestra.run.smithi155.stdout: { 2023-08-01T19:55:26.423 INFO:teuthology.orchestra.run.smithi155.stdout: "event": "initiated", 2023-08-01T19:55:26.424 INFO:teuthology.orchestra.run.smithi155.stdout: "time": "2023-08-01T19:55:05.151325+0000", 2023-08-01T19:55:26.424 INFO:teuthology.orchestra.run.smithi155.stdout: "duration": 0 2023-08-01T19:55:26.424 INFO:teuthology.orchestra.run.smithi155.stdout: }, 2023-08-01T19:55:26.424 INFO:teuthology.orchestra.run.smithi155.stdout: { 2023-08-01T19:55:26.424 INFO:teuthology.orchestra.run.smithi155.stdout: "event": "throttled", 2023-08-01T19:55:26.424 INFO:teuthology.orchestra.run.smithi155.stdout: "time": "2023-08-01T19:55:05.151325+0000", 2023-08-01T19:55:26.424 INFO:teuthology.orchestra.run.smithi155.stdout: "duration": 0 2023-08-01T19:55:26.424 INFO:teuthology.orchestra.run.smithi155.stdout: }, 2023-08-01T19:55:26.425 INFO:teuthology.orchestra.run.smithi155.stdout: { 2023-08-01T19:55:26.425 INFO:teuthology.orchestra.run.smithi155.stdout: "event": "header_read", 2023-08-01T19:55:26.425 INFO:teuthology.orchestra.run.smithi155.stdout: "time": "2023-08-01T19:55:05.151325+0000", 2023-08-01T19:55:26.425 INFO:teuthology.orchestra.run.smithi155.stdout: "duration": 4294967295.9999995 2023-08-01T19:55:26.425 INFO:teuthology.orchestra.run.smithi155.stdout: }, 2023-08-01T19:55:26.425 INFO:teuthology.orchestra.run.smithi155.stdout: { 2023-08-01T19:55:26.425 INFO:teuthology.orchestra.run.smithi155.stdout: "event": "all_read", 2023-08-01T19:55:26.425 INFO:teuthology.orchestra.run.smithi155.stdout: "time": "2023-08-01T19:55:05.151390+0000", 2023-08-01T19:55:26.426 INFO:teuthology.orchestra.run.smithi155.stdout: "duration": 6.5456999999999993e-05 2023-08-01T19:55:26.426 INFO:teuthology.orchestra.run.smithi155.stdout: }, 2023-08-01T19:55:26.426 INFO:teuthology.orchestra.run.smithi155.stdout: { 2023-08-01T19:55:26.426 INFO:teuthology.orchestra.run.smithi155.stdout: "event": "dispatched", 2023-08-01T19:55:26.426 INFO:teuthology.orchestra.run.smithi155.stdout: "time": "2023-08-01T19:55:05.151396+0000", 2023-08-01T19:55:26.426 INFO:teuthology.orchestra.run.smithi155.stdout: "duration": 5.9190000000000004e-06 2023-08-01T19:55:26.426 INFO:teuthology.orchestra.run.smithi155.stdout: }, 2023-08-01T19:55:26.426 INFO:teuthology.orchestra.run.smithi155.stdout: { 2023-08-01T19:55:26.427 INFO:teuthology.orchestra.run.smithi155.stdout: "event": "queued_for_pg", 2023-08-01T19:55:26.427 INFO:teuthology.orchestra.run.smithi155.stdout: "time": "2023-08-01T19:55:05.151400+0000", 2023-08-01T19:55:26.427 INFO:teuthology.orchestra.run.smithi155.stdout: "duration": 4.1030000000000004e-06 2023-08-01T19:55:26.427 INFO:teuthology.orchestra.run.smithi155.stdout: }, 2023-08-01T19:55:26.427 INFO:teuthology.orchestra.run.smithi155.stdout: { 2023-08-01T19:55:26.427 INFO:teuthology.orchestra.run.smithi155.stdout: "event": "reached_pg", 2023-08-01T19:55:26.427 INFO:teuthology.orchestra.run.smithi155.stdout: "time": "2023-08-01T19:55:05.151452+0000", 2023-08-01T19:55:26.427 INFO:teuthology.orchestra.run.smithi155.stdout: "duration": 5.2136999999999999e-05 2023-08-01T19:55:26.428 INFO:teuthology.orchestra.run.smithi155.stdout: }, 2023-08-01T19:55:26.428 INFO:teuthology.orchestra.run.smithi155.stdout: { 2023-08-01T19:55:26.428 INFO:teuthology.orchestra.run.smithi155.stdout: "event": "started", 2023-08-01T19:55:26.428 INFO:teuthology.orchestra.run.smithi155.stdout: "time": "2023-08-01T19:55:05.151470+0000", 2023-08-01T19:55:26.428 INFO:teuthology.orchestra.run.smithi155.stdout: "duration": 1.8e-05 2023-08-01T19:55:26.428 INFO:teuthology.orchestra.run.smithi155.stdout: }, 2023-08-01T19:55:26.428 INFO:teuthology.orchestra.run.smithi155.stdout: { 2023-08-01T19:55:26.428 INFO:teuthology.orchestra.run.smithi155.stdout: "event": "commit_sent", 2023-08-01T19:55:26.429 INFO:teuthology.orchestra.run.smithi155.stdout: "time": "2023-08-01T19:55:05.223183+0000", 2023-08-01T19:55:26.429 INFO:teuthology.orchestra.run.smithi155.stdout: "duration": 0.071712622000000004 2023-08-01T19:55:26.429 INFO:teuthology.orchestra.run.smithi155.stdout: }, 2023-08-01T19:55:26.429 INFO:teuthology.orchestra.run.smithi155.stdout: { 2023-08-01T19:55:26.429 INFO:teuthology.orchestra.run.smithi155.stdout: "event": "done", 2023-08-01T19:55:26.429 INFO:teuthology.orchestra.run.smithi155.stdout: "time": "2023-08-01T19:55:05.223209+0000", 2023-08-01T19:55:26.429 INFO:teuthology.orchestra.run.smithi155.stdout: "duration": 2.5956e-05 2023-08-01T19:55:26.429 INFO:teuthology.orchestra.run.smithi155.stdout: } 2023-08-01T19:55:26.430 INFO:teuthology.orchestra.run.smithi155.stdout: ] 2023-08-01T19:55:26.430 INFO:teuthology.orchestra.run.smithi155.stdout: } 2023-08-01T19:55:26.430 INFO:teuthology.orchestra.run.smithi155.stdout: }, 2023-08-01T19:55:26.430 INFO:teuthology.orchestra.run.smithi155.stdout: { 2023-08-01T19:55:26.430 INFO:teuthology.orchestra.run.smithi155.stdout: "description": "osd_op(client.4668.0:100249 5.b 5:d0666827:::benchmark_data_smithi006_114134_object100248:head [set-alloc-hint object_size 65536 write_size 65536,write 0~65536] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e37)", 2023-08-01T19:55:26.430 INFO:teuthology.orchestra.run.smithi155.stdout: "initiated_at": "2023-08-01T19:55:05.153614+0000", 2023-08-01T19:55:26.430 INFO:teuthology.orchestra.run.smithi155.stdout: "age": 21.186404965000001, 2023-08-01T19:55:26.431 INFO:teuthology.orchestra.run.smithi155.stdout: "duration": 0.069286118999999993, 2023-08-01T19:55:26.431 INFO:teuthology.orchestra.run.smithi155.stdout: "type_data": { 2023-08-01T19:55:26.431 INFO:teuthology.orchestra.run.smithi155.stdout: "flag_point": "commit sent; apply or cleanup", 2023-08-01T19:55:26.431 INFO:teuthology.orchestra.run.smithi155.stdout: "client_info": { 2023-08-01T19:55:26.431 INFO:teuthology.orchestra.run.smithi155.stdout: "client": "client.4668", 2023-08-01T19:55:26.431 INFO:teuthology.orchestra.run.smithi155.stdout: "client_addr": "172.21.15.6:0/1709472247", 2023-08-01T19:55:26.431 INFO:teuthology.orchestra.run.smithi155.stdout: "tid": 100249 2023-08-01T19:55:26.431 INFO:teuthology.orchestra.run.smithi155.stdout: }, 2023-08-01T19:55:26.432 INFO:teuthology.orchestra.run.smithi155.stdout: "events": [ 2023-08-01T19:55:26.432 INFO:teuthology.orchestra.run.smithi155.stdout: { 2023-08-01T19:55:26.432 INFO:teuthology.orchestra.run.smithi155.stdout: "event": "initiated", 2023-08-01T19:55:26.432 INFO:teuthology.orchestra.run.smithi155.stdout: "time": "2023-08-01T19:55:05.153614+0000", 2023-08-01T19:55:26.432 INFO:teuthology.orchestra.run.smithi155.stdout: "duration": 0 2023-08-01T19:55:26.432 INFO:teuthology.orchestra.run.smithi155.stdout: }, 2023-08-01T19:55:26.432 INFO:teuthology.orchestra.run.smithi155.stdout: { 2023-08-01T19:55:26.432 INFO:teuthology.orchestra.run.smithi155.stdout: "event": "throttled", 2023-08-01T19:55:26.433 INFO:teuthology.orchestra.run.smithi155.stdout: "time": "2023-08-01T19:55:05.153614+0000", 2023-08-01T19:55:26.433 INFO:teuthology.orchestra.run.smithi155.stdout: "duration": 0 2023-08-01T19:55:26.433 INFO:teuthology.orchestra.run.smithi155.stdout: }, 2023-08-01T19:55:26.433 INFO:teuthology.orchestra.run.smithi155.stdout: { 2023-08-01T19:55:26.433 INFO:teuthology.orchestra.run.smithi155.stdout: "event": "header_read", 2023-08-01T19:55:26.433 INFO:teuthology.orchestra.run.smithi155.stdout: "time": "2023-08-01T19:55:05.153612+0000", 2023-08-01T19:55:26.433 INFO:teuthology.orchestra.run.smithi155.stdout: "duration": 4294967295.9999986 2023-08-01T19:55:26.433 INFO:teuthology.orchestra.run.smithi155.stdout: }, 2023-08-01T19:55:26.434 INFO:teuthology.orchestra.run.smithi155.stdout: { 2023-08-01T19:55:26.434 INFO:teuthology.orchestra.run.smithi155.stdout: "event": "all_read", 2023-08-01T19:55:26.434 INFO:teuthology.orchestra.run.smithi155.stdout: "time": "2023-08-01T19:55:05.153694+0000", 2023-08-01T19:55:26.434 INFO:teuthology.orchestra.run.smithi155.stdout: "duration": 8.1618000000000004e-05 2023-08-01T19:55:26.434 INFO:teuthology.orchestra.run.smithi155.stdout: }, 2023-08-01T19:55:26.434 INFO:teuthology.orchestra.run.smithi155.stdout: { 2023-08-01T19:55:26.434 INFO:teuthology.orchestra.run.smithi155.stdout: "event": "dispatched", 2023-08-01T19:55:26.434 INFO:teuthology.orchestra.run.smithi155.stdout: "time": "2023-08-01T19:55:05.153713+0000", 2023-08-01T19:55:26.435 INFO:teuthology.orchestra.run.smithi155.stdout: "duration": 1.9069999999999999e-05 2023-08-01T19:55:26.435 INFO:teuthology.orchestra.run.smithi155.stdout: }, 2023-08-01T19:55:26.435 INFO:teuthology.orchestra.run.smithi155.stdout: { 2023-08-01T19:55:26.435 INFO:teuthology.orchestra.run.smithi155.stdout: "event": "queued_for_pg", 2023-08-01T19:55:26.435 INFO:teuthology.orchestra.run.smithi155.stdout: "time": "2023-08-01T19:55:05.153726+0000", 2023-08-01T19:55:26.435 INFO:teuthology.orchestra.run.smithi155.stdout: "duration": 1.238e-05 2023-08-01T19:55:26.435 INFO:teuthology.orchestra.run.smithi155.stdout: }, 2023-08-01T19:55:26.435 INFO:teuthology.orchestra.run.smithi155.stdout: { 2023-08-01T19:55:26.436 INFO:teuthology.orchestra.run.smithi155.stdout: "event": "reached_pg", 2023-08-01T19:55:26.436 INFO:teuthology.orchestra.run.smithi155.stdout: "time": "2023-08-01T19:55:05.153761+0000", 2023-08-01T19:55:26.436 INFO:teuthology.orchestra.run.smithi155.stdout: "duration": 3.5046999999999998e-05 2023-08-01T19:55:26.436 INFO:teuthology.orchestra.run.smithi155.stdout: }, 2023-08-01T19:55:26.436 INFO:teuthology.orchestra.run.smithi155.stdout: { 2023-08-01T19:55:26.436 INFO:teuthology.orchestra.run.smithi155.stdout: "event": "started", 2023-08-01T19:55:26.436 INFO:teuthology.orchestra.run.smithi155.stdout: "time": "2023-08-01T19:55:05.153896+0000", 2023-08-01T19:55:26.437 INFO:teuthology.orchestra.run.smithi155.stdout: "duration": 0.00013575800000000001 2023-08-01T19:55:26.437 INFO:teuthology.orchestra.run.smithi155.stdout: }, 2023-08-01T19:55:26.437 INFO:teuthology.orchestra.run.smithi155.stdout: { 2023-08-01T19:55:26.437 INFO:teuthology.orchestra.run.smithi155.stdout: "event": "waiting for subops from 0", 2023-08-01T19:55:26.437 INFO:teuthology.orchestra.run.smithi155.stdout: "time": "2023-08-01T19:55:05.154043+0000", 2023-08-01T19:55:26.437 INFO:teuthology.orchestra.run.smithi155.stdout: "duration": 0.00014650700000000001 2023-08-01T19:55:26.437 INFO:teuthology.orchestra.run.smithi155.stdout: }, 2023-08-01T19:55:26.437 INFO:teuthology.orchestra.run.smithi155.stdout: { 2023-08-01T19:55:26.438 INFO:teuthology.orchestra.run.smithi155.stdout: "event": "sub_op_commit_rec", 2023-08-01T19:55:26.438 INFO:teuthology.orchestra.run.smithi155.stdout: "time": "2023-08-01T19:55:05.221876+0000", 2023-08-01T19:55:26.438 INFO:teuthology.orchestra.run.smithi155.stdout: "duration": 0.067832796000000001 2023-08-01T19:55:26.438 INFO:teuthology.orchestra.run.smithi155.stdout: }, 2023-08-01T19:55:26.438 INFO:teuthology.orchestra.run.smithi155.stdout: { 2023-08-01T19:55:26.438 INFO:teuthology.orchestra.run.smithi155.stdout: "event": "op_commit", 2023-08-01T19:55:26.438 INFO:teuthology.orchestra.run.smithi155.stdout: "time": "2023-08-01T19:55:05.222813+0000", 2023-08-01T19:55:26.438 INFO:teuthology.orchestra.run.smithi155.stdout: "duration": 0.00093755300000000004 2023-08-01T19:55:26.439 INFO:teuthology.orchestra.run.smithi155.stdout: }, 2023-08-01T19:55:26.439 INFO:teuthology.orchestra.run.smithi155.stdout: { 2023-08-01T19:55:26.439 INFO:teuthology.orchestra.run.smithi155.stdout: "event": "commit_sent", 2023-08-01T19:55:26.439 INFO:teuthology.orchestra.run.smithi155.stdout: "time": "2023-08-01T19:55:05.222861+0000", 2023-08-01T19:55:26.439 INFO:teuthology.orchestra.run.smithi155.stdout: "duration": 4.8013999999999998e-05 2023-08-01T19:55:26.439 INFO:teuthology.orchestra.run.smithi155.stdout: }, 2023-08-01T19:55:26.439 INFO:teuthology.orchestra.run.smithi155.stdout: { 2023-08-01T19:55:26.439 INFO:teuthology.orchestra.run.smithi155.stdout: "event": "done", 2023-08-01T19:55:26.440 INFO:teuthology.orchestra.run.smithi155.stdout: "time": "2023-08-01T19:55:05.222900+0000", 2023-08-01T19:55:26.440 INFO:teuthology.orchestra.run.smithi155.stdout: "duration": 3.8634999999999999e-05 2023-08-01T19:55:26.440 INFO:teuthology.orchestra.run.smithi155.stdout: } 2023-08-01T19:55:26.440 INFO:teuthology.orchestra.run.smithi155.stdout: ] 2023-08-01T19:55:26.440 INFO:teuthology.orchestra.run.smithi155.stdout: } 2023-08-01T19:55:26.440 INFO:teuthology.orchestra.run.smithi155.stdout: }, 2023-08-01T19:55:26.440 INFO:teuthology.orchestra.run.smithi155.stdout: { 2023-08-01T19:55:26.440 INFO:teuthology.orchestra.run.smithi155.stdout: "description": "osd_op(client.4668.0:100251 5.b 5:d853df24:::benchmark_data_smithi006_114134_object100250:head [set-alloc-hint object_size 65536 write_size 65536,write 0~65536] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e37)", 2023-08-01T19:55:26.441 INFO:teuthology.orchestra.run.smithi155.stdout: "initiated_at": "2023-08-01T19:55:05.153737+0000", 2023-08-01T19:55:26.441 INFO:teuthology.orchestra.run.smithi155.stdout: "age": 21.186281951000002, 2023-08-01T19:55:26.441 INFO:teuthology.orchestra.run.smithi155.stdout: "duration": 0.071366545000000003, 2023-08-01T19:55:26.441 INFO:teuthology.orchestra.run.smithi155.stdout: "type_data": { 2023-08-01T19:55:26.441 INFO:teuthology.orchestra.run.smithi155.stdout: "flag_point": "commit sent; apply or cleanup", 2023-08-01T19:55:26.441 INFO:teuthology.orchestra.run.smithi155.stdout: "client_info": { 2023-08-01T19:55:26.441 INFO:teuthology.orchestra.run.smithi155.stdout: "client": "client.4668", 2023-08-01T19:55:26.441 INFO:teuthology.orchestra.run.smithi155.stdout: "client_addr": "172.21.15.6:0/1709472247", 2023-08-01T19:55:26.442 INFO:teuthology.orchestra.run.smithi155.stdout: "tid": 100251 2023-08-01T19:55:26.442 INFO:teuthology.orchestra.run.smithi155.stdout: }, 2023-08-01T19:55:26.442 INFO:teuthology.orchestra.run.smithi155.stdout: "events": [ 2023-08-01T19:55:26.442 INFO:teuthology.orchestra.run.smithi155.stdout: { 2023-08-01T19:55:26.442 INFO:teuthology.orchestra.run.smithi155.stdout: "event": "initiated", 2023-08-01T19:55:26.442 INFO:teuthology.orchestra.run.smithi155.stdout: "time": "2023-08-01T19:55:05.153737+0000", 2023-08-01T19:55:26.442 INFO:teuthology.orchestra.run.smithi155.stdout: "duration": 0 2023-08-01T19:55:26.442 INFO:teuthology.orchestra.run.smithi155.stdout: }, 2023-08-01T19:55:26.443 INFO:teuthology.orchestra.run.smithi155.stdout: { 2023-08-01T19:55:26.443 INFO:teuthology.orchestra.run.smithi155.stdout: "event": "throttled", 2023-08-01T19:55:26.443 INFO:teuthology.orchestra.run.smithi155.stdout: "time": "2023-08-01T19:55:05.153737+0000", 2023-08-01T19:55:26.443 INFO:teuthology.orchestra.run.smithi155.stdout: "duration": 0 2023-08-01T19:55:26.443 INFO:teuthology.orchestra.run.smithi155.stdout: }, 2023-08-01T19:55:26.443 INFO:teuthology.orchestra.run.smithi155.stdout: { 2023-08-01T19:55:26.443 INFO:teuthology.orchestra.run.smithi155.stdout: "event": "header_read", 2023-08-01T19:55:26.444 INFO:teuthology.orchestra.run.smithi155.stdout: "time": "2023-08-01T19:55:05.153736+0000", 2023-08-01T19:55:26.444 INFO:teuthology.orchestra.run.smithi155.stdout: "duration": 4294967295.9999995 2023-08-01T19:55:26.444 INFO:teuthology.orchestra.run.smithi155.stdout: }, 2023-08-01T19:55:26.444 INFO:teuthology.orchestra.run.smithi155.stdout: { 2023-08-01T19:55:26.444 INFO:teuthology.orchestra.run.smithi155.stdout: "event": "all_read", 2023-08-01T19:55:26.444 INFO:teuthology.orchestra.run.smithi155.stdout: "time": "2023-08-01T19:55:05.153784+0000", 2023-08-01T19:55:26.444 INFO:teuthology.orchestra.run.smithi155.stdout: "duration": 4.7660000000000001e-05 2023-08-01T19:55:26.444 INFO:teuthology.orchestra.run.smithi155.stdout: }, 2023-08-01T19:55:26.445 INFO:teuthology.orchestra.run.smithi155.stdout: { 2023-08-01T19:55:26.445 INFO:teuthology.orchestra.run.smithi155.stdout: "event": "dispatched", 2023-08-01T19:55:26.445 INFO:teuthology.orchestra.run.smithi155.stdout: "time": "2023-08-01T19:55:05.153793+0000", 2023-08-01T19:55:26.445 INFO:teuthology.orchestra.run.smithi155.stdout: "duration": 8.7150000000000004e-06 2023-08-01T19:55:26.445 INFO:teuthology.orchestra.run.smithi155.stdout: }, 2023-08-01T19:55:26.445 INFO:teuthology.orchestra.run.smithi155.stdout: { 2023-08-01T19:55:26.445 INFO:teuthology.orchestra.run.smithi155.stdout: "event": "queued_for_pg", 2023-08-01T19:55:26.445 INFO:teuthology.orchestra.run.smithi155.stdout: "time": "2023-08-01T19:55:05.153800+0000", 2023-08-01T19:55:26.446 INFO:teuthology.orchestra.run.smithi155.stdout: "duration": 7.2459999999999997e-06 2023-08-01T19:55:26.446 INFO:teuthology.orchestra.run.smithi155.stdout: }, 2023-08-01T19:55:26.446 INFO:teuthology.orchestra.run.smithi155.stdout: { 2023-08-01T19:55:26.446 INFO:teuthology.orchestra.run.smithi155.stdout: "event": "reached_pg", 2023-08-01T19:55:26.446 INFO:teuthology.orchestra.run.smithi155.stdout: "time": "2023-08-01T19:55:05.156241+0000", 2023-08-01T19:55:26.446 INFO:teuthology.orchestra.run.smithi155.stdout: "duration": 0.0024415359999999998 2023-08-01T19:55:26.446 INFO:teuthology.orchestra.run.smithi155.stdout: }, 2023-08-01T19:55:26.446 INFO:teuthology.orchestra.run.smithi155.stdout: { 2023-08-01T19:55:26.447 INFO:teuthology.orchestra.run.smithi155.stdout: "event": "started", 2023-08-01T19:55:26.447 INFO:teuthology.orchestra.run.smithi155.stdout: "time": "2023-08-01T19:55:05.219045+0000", 2023-08-01T19:55:26.447 INFO:teuthology.orchestra.run.smithi155.stdout: "duration": 0.062803855000000006 2023-08-01T19:55:26.447 INFO:teuthology.orchestra.run.smithi155.stdout: }, 2023-08-01T19:55:26.447 INFO:teuthology.orchestra.run.smithi155.stdout: { 2023-08-01T19:55:26.447 INFO:teuthology.orchestra.run.smithi155.stdout: "event": "waiting for subops from 0", 2023-08-01T19:55:26.447 INFO:teuthology.orchestra.run.smithi155.stdout: "time": "2023-08-01T19:55:05.219238+0000", 2023-08-01T19:55:26.447 INFO:teuthology.orchestra.run.smithi155.stdout: "duration": 0.00019241500000000001 2023-08-01T19:55:26.448 INFO:teuthology.orchestra.run.smithi155.stdout: }, 2023-08-01T19:55:26.448 INFO:teuthology.orchestra.run.smithi155.stdout: { 2023-08-01T19:55:26.448 INFO:teuthology.orchestra.run.smithi155.stdout: "event": "sub_op_commit_rec", 2023-08-01T19:55:26.448 INFO:teuthology.orchestra.run.smithi155.stdout: "time": "2023-08-01T19:55:05.223300+0000", 2023-08-01T19:55:26.448 INFO:teuthology.orchestra.run.smithi155.stdout: "duration": 0.0040626509999999996 2023-08-01T19:55:26.448 INFO:teuthology.orchestra.run.smithi155.stdout: }, 2023-08-01T19:55:26.448 INFO:teuthology.orchestra.run.smithi155.stdout: { 2023-08-01T19:55:26.449 INFO:teuthology.orchestra.run.smithi155.stdout: "event": "op_commit", 2023-08-01T19:55:26.449 INFO:teuthology.orchestra.run.smithi155.stdout: "time": "2023-08-01T19:55:05.225020+0000", 2023-08-01T19:55:26.449 INFO:teuthology.orchestra.run.smithi155.stdout: "duration": 0.0017201 2023-08-01T19:55:26.449 INFO:teuthology.orchestra.run.smithi155.stdout: }, 2023-08-01T19:55:26.449 INFO:teuthology.orchestra.run.smithi155.stdout: { 2023-08-01T19:55:26.449 INFO:teuthology.orchestra.run.smithi155.stdout: "event": "commit_sent", 2023-08-01T19:55:26.449 INFO:teuthology.orchestra.run.smithi155.stdout: "time": "2023-08-01T19:55:05.225066+0000", 2023-08-01T19:55:26.449 INFO:teuthology.orchestra.run.smithi155.stdout: "duration": 4.6143000000000002e-05 2023-08-01T19:55:26.450 INFO:teuthology.orchestra.run.smithi155.stdout: }, 2023-08-01T19:55:26.450 INFO:teuthology.orchestra.run.smithi155.stdout: { 2023-08-01T19:55:26.450 INFO:teuthology.orchestra.run.smithi155.stdout: "event": "done", 2023-08-01T19:55:26.450 INFO:teuthology.orchestra.run.smithi155.stdout: "time": "2023-08-01T19:55:05.225103+0000", 2023-08-01T19:55:26.450 INFO:teuthology.orchestra.run.smithi155.stdout: "duration": 3.6789999999999998e-05 2023-08-01T19:55:26.450 INFO:teuthology.orchestra.run.smithi155.stdout: } 2023-08-01T19:55:26.450 INFO:teuthology.orchestra.run.smithi155.stdout: ] 2023-08-01T19:55:26.450 INFO:teuthology.orchestra.run.smithi155.stdout: } 2023-08-01T19:55:26.451 INFO:teuthology.orchestra.run.smithi155.stdout: }, 2023-08-01T19:55:26.451 INFO:teuthology.orchestra.run.smithi155.stdout: { 2023-08-01T19:55:26.451 INFO:teuthology.orchestra.run.smithi155.stdout: "description": "osd_op(client.4668.0:100252 5.0 5:01f90c3c:::benchmark_data_smithi006_114134_object100251:head [set-alloc-hint object_size 65536 write_size 65536,write 0~65536] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e37)", 2023-08-01T19:55:26.451 INFO:teuthology.orchestra.run.smithi155.stdout: "initiated_at": "2023-08-01T19:55:05.154048+0000", 2023-08-01T19:55:26.451 INFO:teuthology.orchestra.run.smithi155.stdout: "age": 21.185970703999999, 2023-08-01T19:55:26.451 INFO:teuthology.orchestra.run.smithi155.stdout: "duration": 0.070156683999999997, 2023-08-01T19:55:26.451 INFO:teuthology.orchestra.run.smithi155.stdout: "type_data": { 2023-08-01T19:55:26.451 INFO:teuthology.orchestra.run.smithi155.stdout: "flag_point": "commit sent; apply or cleanup", 2023-08-01T19:55:26.452 INFO:teuthology.orchestra.run.smithi155.stdout: "client_info": { 2023-08-01T19:55:26.452 INFO:teuthology.orchestra.run.smithi155.stdout: "client": "client.4668", 2023-08-01T19:55:26.452 INFO:teuthology.orchestra.run.smithi155.stdout: "client_addr": "172.21.15.6:0/1709472247", 2023-08-01T19:55:26.452 INFO:teuthology.orchestra.run.smithi155.stdout: "tid": 100252 2023-08-01T19:55:26.452 INFO:teuthology.orchestra.run.smithi155.stdout: }, 2023-08-01T19:55:26.452 INFO:teuthology.orchestra.run.smithi155.stdout: "events": [ 2023-08-01T19:55:26.452 INFO:teuthology.orchestra.run.smithi155.stdout: { 2023-08-01T19:55:26.453 INFO:teuthology.orchestra.run.smithi155.stdout: "event": "initiated", 2023-08-01T19:55:26.453 INFO:teuthology.orchestra.run.smithi155.stdout: "time": "2023-08-01T19:55:05.154048+0000", 2023-08-01T19:55:26.453 INFO:teuthology.orchestra.run.smithi155.stdout: "duration": 0 2023-08-01T19:55:26.453 INFO:teuthology.orchestra.run.smithi155.stdout: }, 2023-08-01T19:55:26.453 INFO:teuthology.orchestra.run.smithi155.stdout: { 2023-08-01T19:55:26.453 INFO:teuthology.orchestra.run.smithi155.stdout: "event": "throttled", 2023-08-01T19:55:26.453 INFO:teuthology.orchestra.run.smithi155.stdout: "time": "2023-08-01T19:55:05.154048+0000", 2023-08-01T19:55:26.454 INFO:teuthology.orchestra.run.smithi155.stdout: "duration": 0 2023-08-01T19:55:26.454 INFO:teuthology.orchestra.run.smithi155.stdout: }, 2023-08-01T19:55:26.454 INFO:teuthology.orchestra.run.smithi155.stdout: { 2023-08-01T19:55:26.454 INFO:teuthology.orchestra.run.smithi155.stdout: "event": "header_read", 2023-08-01T19:55:26.454 INFO:teuthology.orchestra.run.smithi155.stdout: "time": "2023-08-01T19:55:05.154047+0000", 2023-08-01T19:55:26.454 INFO:teuthology.orchestra.run.smithi155.stdout: "duration": 4294967295.999999 2023-08-01T19:55:26.454 INFO:teuthology.orchestra.run.smithi155.stdout: }, 2023-08-01T19:55:26.454 INFO:teuthology.orchestra.run.smithi155.stdout: { 2023-08-01T19:55:26.455 INFO:teuthology.orchestra.run.smithi155.stdout: "event": "all_read", 2023-08-01T19:55:26.455 INFO:teuthology.orchestra.run.smithi155.stdout: "time": "2023-08-01T19:55:05.154115+0000", 2023-08-01T19:55:26.455 INFO:teuthology.orchestra.run.smithi155.stdout: "duration": 6.7545999999999993e-05 2023-08-01T19:55:26.455 INFO:teuthology.orchestra.run.smithi155.stdout: }, 2023-08-01T19:55:26.455 INFO:teuthology.orchestra.run.smithi155.stdout: { 2023-08-01T19:55:26.455 INFO:teuthology.orchestra.run.smithi155.stdout: "event": "dispatched", 2023-08-01T19:55:26.455 INFO:teuthology.orchestra.run.smithi155.stdout: "time": "2023-08-01T19:55:05.154125+0000", 2023-08-01T19:55:26.455 INFO:teuthology.orchestra.run.smithi155.stdout: "duration": 1.0669000000000001e-05 2023-08-01T19:55:26.456 INFO:teuthology.orchestra.run.smithi155.stdout: }, 2023-08-01T19:55:26.456 INFO:teuthology.orchestra.run.smithi155.stdout: { 2023-08-01T19:55:26.456 INFO:teuthology.orchestra.run.smithi155.stdout: "event": "queued_for_pg", 2023-08-01T19:55:26.456 INFO:teuthology.orchestra.run.smithi155.stdout: "time": "2023-08-01T19:55:05.154131+0000", 2023-08-01T19:55:26.456 INFO:teuthology.orchestra.run.smithi155.stdout: "duration": 6.0349999999999998e-06 2023-08-01T19:55:26.456 INFO:teuthology.orchestra.run.smithi155.stdout: }, 2023-08-01T19:55:26.456 INFO:teuthology.orchestra.run.smithi155.stdout: { 2023-08-01T19:55:26.456 INFO:teuthology.orchestra.run.smithi155.stdout: "event": "reached_pg", 2023-08-01T19:55:26.457 INFO:teuthology.orchestra.run.smithi155.stdout: "time": "2023-08-01T19:55:05.154174+0000", 2023-08-01T19:55:26.457 INFO:teuthology.orchestra.run.smithi155.stdout: "duration": 4.2429000000000003e-05 2023-08-01T19:55:26.457 INFO:teuthology.orchestra.run.smithi155.stdout: }, 2023-08-01T19:55:26.457 INFO:teuthology.orchestra.run.smithi155.stdout: { 2023-08-01T19:55:26.457 INFO:teuthology.orchestra.run.smithi155.stdout: "event": "started", 2023-08-01T19:55:26.457 INFO:teuthology.orchestra.run.smithi155.stdout: "time": "2023-08-01T19:55:05.154287+0000", 2023-08-01T19:55:26.457 INFO:teuthology.orchestra.run.smithi155.stdout: "duration": 0.000113138 2023-08-01T19:55:26.457 INFO:teuthology.orchestra.run.smithi155.stdout: }, 2023-08-01T19:55:26.458 INFO:teuthology.orchestra.run.smithi155.stdout: { 2023-08-01T19:55:26.458 INFO:teuthology.orchestra.run.smithi155.stdout: "event": "waiting for subops from 0", 2023-08-01T19:55:26.458 INFO:teuthology.orchestra.run.smithi155.stdout: "time": "2023-08-01T19:55:05.154420+0000", 2023-08-01T19:55:26.458 INFO:teuthology.orchestra.run.smithi155.stdout: "duration": 0.000133292 2023-08-01T19:55:26.458 INFO:teuthology.orchestra.run.smithi155.stdout: }, 2023-08-01T19:55:26.458 INFO:teuthology.orchestra.run.smithi155.stdout: { 2023-08-01T19:55:26.458 INFO:teuthology.orchestra.run.smithi155.stdout: "event": "sub_op_commit_rec", 2023-08-01T19:55:26.458 INFO:teuthology.orchestra.run.smithi155.stdout: "time": "2023-08-01T19:55:05.219034+0000", 2023-08-01T19:55:26.459 INFO:teuthology.orchestra.run.smithi155.stdout: "duration": 0.064613429999999999 2023-08-01T19:55:26.459 INFO:teuthology.orchestra.run.smithi155.stdout: }, 2023-08-01T19:55:26.459 INFO:teuthology.orchestra.run.smithi155.stdout: { 2023-08-01T19:55:26.459 INFO:teuthology.orchestra.run.smithi155.stdout: "event": "op_commit", 2023-08-01T19:55:26.459 INFO:teuthology.orchestra.run.smithi155.stdout: "time": "2023-08-01T19:55:05.224138+0000", 2023-08-01T19:55:26.459 INFO:teuthology.orchestra.run.smithi155.stdout: "duration": 0.0051041999999999997 2023-08-01T19:55:26.459 INFO:teuthology.orchestra.run.smithi155.stdout: }, 2023-08-01T19:55:26.460 INFO:teuthology.orchestra.run.smithi155.stdout: { 2023-08-01T19:55:26.460 INFO:teuthology.orchestra.run.smithi155.stdout: "event": "commit_sent", 2023-08-01T19:55:26.460 INFO:teuthology.orchestra.run.smithi155.stdout: "time": "2023-08-01T19:55:05.224171+0000", 2023-08-01T19:55:26.460 INFO:teuthology.orchestra.run.smithi155.stdout: "duration": 3.3345e-05 2023-08-01T19:55:26.460 INFO:teuthology.orchestra.run.smithi155.stdout: }, 2023-08-01T19:55:26.460 INFO:teuthology.orchestra.run.smithi155.stdout: { 2023-08-01T19:55:26.460 INFO:teuthology.orchestra.run.smithi155.stdout: "event": "done", 2023-08-01T19:55:26.460 INFO:teuthology.orchestra.run.smithi155.stdout: "time": "2023-08-01T19:55:05.224205+0000", 2023-08-01T19:55:26.461 INFO:teuthology.orchestra.run.smithi155.stdout: "duration": 3.3525999999999997e-05 2023-08-01T19:55:26.461 INFO:teuthology.orchestra.run.smithi155.stdout: } 2023-08-01T19:55:26.461 INFO:teuthology.orchestra.run.smithi155.stdout: ] 2023-08-01T19:55:26.461 INFO:teuthology.orchestra.run.smithi155.stdout: } 2023-08-01T19:55:26.461 INFO:teuthology.orchestra.run.smithi155.stdout: }, 2023-08-01T19:55:26.461 INFO:teuthology.orchestra.run.smithi155.stdout: { 2023-08-01T19:55:26.461 INFO:teuthology.orchestra.run.smithi155.stdout: "description": "osd_repop_reply(client.4668.0:100237 5.4 e37/19 ondisk, result = 0)", 2023-08-01T19:55:26.461 INFO:teuthology.orchestra.run.smithi155.stdout: "initiated_at": "2023-08-01T19:55:05.156249+0000", 2023-08-01T19:55:26.462 INFO:teuthology.orchestra.run.smithi155.stdout: "age": 21.183769759, 2023-08-01T19:55:26.462 INFO:teuthology.orchestra.run.smithi155.stdout: "duration": 0.062792549000000003, 2023-08-01T19:55:26.462 INFO:teuthology.orchestra.run.smithi155.stdout: "type_data": { 2023-08-01T19:55:26.462 INFO:teuthology.orchestra.run.smithi155.stdout: "flag_point": "started", 2023-08-01T19:55:26.462 INFO:teuthology.orchestra.run.smithi155.stdout: "events": [ 2023-08-01T19:55:26.462 INFO:teuthology.orchestra.run.smithi155.stdout: { 2023-08-01T19:55:26.462 INFO:teuthology.orchestra.run.smithi155.stdout: "event": "initiated", 2023-08-01T19:55:26.462 INFO:teuthology.orchestra.run.smithi155.stdout: "time": "2023-08-01T19:55:05.156249+0000", 2023-08-01T19:55:26.463 INFO:teuthology.orchestra.run.smithi155.stdout: "duration": 0 2023-08-01T19:55:26.463 INFO:teuthology.orchestra.run.smithi155.stdout: }, 2023-08-01T19:55:26.463 INFO:teuthology.orchestra.run.smithi155.stdout: { 2023-08-01T19:55:26.463 INFO:teuthology.orchestra.run.smithi155.stdout: "event": "throttled", 2023-08-01T19:55:26.463 INFO:teuthology.orchestra.run.smithi155.stdout: "time": "2023-08-01T19:55:05.156249+0000", 2023-08-01T19:55:26.463 INFO:teuthology.orchestra.run.smithi155.stdout: "duration": 0 2023-08-01T19:55:26.463 INFO:teuthology.orchestra.run.smithi155.stdout: }, 2023-08-01T19:55:26.463 INFO:teuthology.orchestra.run.smithi155.stdout: { 2023-08-01T19:55:26.464 INFO:teuthology.orchestra.run.smithi155.stdout: "event": "header_read", 2023-08-01T19:55:26.464 INFO:teuthology.orchestra.run.smithi155.stdout: "time": "2023-08-01T19:55:05.156248+0000", 2023-08-01T19:55:26.464 INFO:teuthology.orchestra.run.smithi155.stdout: "duration": 4294967295.9999995 2023-08-01T19:55:26.464 INFO:teuthology.orchestra.run.smithi155.stdout: }, 2023-08-01T19:55:26.464 INFO:teuthology.orchestra.run.smithi155.stdout: { 2023-08-01T19:55:26.464 INFO:teuthology.orchestra.run.smithi155.stdout: "event": "all_read", 2023-08-01T19:55:26.464 INFO:teuthology.orchestra.run.smithi155.stdout: "time": "2023-08-01T19:55:05.156252+0000", 2023-08-01T19:55:26.465 INFO:teuthology.orchestra.run.smithi155.stdout: "duration": 3.9999999999999998e-06 2023-08-01T19:55:26.465 INFO:teuthology.orchestra.run.smithi155.stdout: }, 2023-08-01T19:55:26.465 INFO:teuthology.orchestra.run.smithi155.stdout: { 2023-08-01T19:55:26.465 INFO:teuthology.orchestra.run.smithi155.stdout: "event": "dispatched", 2023-08-01T19:55:26.465 INFO:teuthology.orchestra.run.smithi155.stdout: "time": "2023-08-01T19:55:05.218844+0000", 2023-08-01T19:55:26.465 INFO:teuthology.orchestra.run.smithi155.stdout: "duration": 0.062591516999999999 2023-08-01T19:55:26.465 INFO:teuthology.orchestra.run.smithi155.stdout: }, 2023-08-01T19:55:26.465 INFO:teuthology.orchestra.run.smithi155.stdout: { 2023-08-01T19:55:26.466 INFO:teuthology.orchestra.run.smithi155.stdout: "event": "queued_for_pg", 2023-08-01T19:55:26.466 INFO:teuthology.orchestra.run.smithi155.stdout: "time": "2023-08-01T19:55:05.218862+0000", 2023-08-01T19:55:26.466 INFO:teuthology.orchestra.run.smithi155.stdout: "duration": 1.7666e-05 2023-08-01T19:55:26.466 INFO:teuthology.orchestra.run.smithi155.stdout: }, 2023-08-01T19:55:26.466 INFO:teuthology.orchestra.run.smithi155.stdout: { 2023-08-01T19:55:26.466 INFO:teuthology.orchestra.run.smithi155.stdout: "event": "reached_pg", 2023-08-01T19:55:26.466 INFO:teuthology.orchestra.run.smithi155.stdout: "time": "2023-08-01T19:55:05.218914+0000", 2023-08-01T19:55:26.466 INFO:teuthology.orchestra.run.smithi155.stdout: "duration": 5.2565999999999998e-05 2023-08-01T19:55:26.467 INFO:teuthology.orchestra.run.smithi155.stdout: }, 2023-08-01T19:55:26.467 INFO:teuthology.orchestra.run.smithi155.stdout: { 2023-08-01T19:55:26.467 INFO:teuthology.orchestra.run.smithi155.stdout: "event": "started", 2023-08-01T19:55:26.467 INFO:teuthology.orchestra.run.smithi155.stdout: "time": "2023-08-01T19:55:05.218925+0000", 2023-08-01T19:55:26.467 INFO:teuthology.orchestra.run.smithi155.stdout: "duration": 1.1375e-05 2023-08-01T19:55:26.467 INFO:teuthology.orchestra.run.smithi155.stdout: }, 2023-08-01T19:55:26.467 INFO:teuthology.orchestra.run.smithi155.stdout: { 2023-08-01T19:55:26.467 INFO:teuthology.orchestra.run.smithi155.stdout: "event": "done", 2023-08-01T19:55:26.468 INFO:teuthology.orchestra.run.smithi155.stdout: "time": "2023-08-01T19:55:05.219041+0000", 2023-08-01T19:55:26.468 INFO:teuthology.orchestra.run.smithi155.stdout: "duration": 0.000115977 2023-08-01T19:55:26.468 INFO:teuthology.orchestra.run.smithi155.stdout: } 2023-08-01T19:55:26.468 INFO:teuthology.orchestra.run.smithi155.stdout: ] 2023-08-01T19:55:26.468 INFO:teuthology.orchestra.run.smithi155.stdout: } 2023-08-01T19:55:26.468 INFO:teuthology.orchestra.run.smithi155.stdout: }, 2023-08-01T19:55:26.468 INFO:teuthology.orchestra.run.smithi155.stdout: { 2023-08-01T19:55:26.468 INFO:teuthology.orchestra.run.smithi155.stdout: "description": "osd_repop(client.4668.0:100253 5.f e37/19 5:f7bbce05:::benchmark_data_smithi006_114134_object100252:head v 37'6323, mlcod=37'6321)", 2023-08-01T19:55:26.469 INFO:teuthology.orchestra.run.smithi155.stdout: "initiated_at": "2023-08-01T19:55:05.156952+0000", 2023-08-01T19:55:26.469 INFO:teuthology.orchestra.run.smithi155.stdout: "age": 21.183066696000001, 2023-08-01T19:55:26.469 INFO:teuthology.orchestra.run.smithi155.stdout: "duration": 0.068018577999999996, 2023-08-01T19:55:26.469 INFO:teuthology.orchestra.run.smithi155.stdout: "type_data": { 2023-08-01T19:55:26.469 INFO:teuthology.orchestra.run.smithi155.stdout: "flag_point": "commit sent; apply or cleanup", 2023-08-01T19:55:26.469 INFO:teuthology.orchestra.run.smithi155.stdout: "events": [ 2023-08-01T19:55:26.469 INFO:teuthology.orchestra.run.smithi155.stdout: { 2023-08-01T19:55:26.470 INFO:teuthology.orchestra.run.smithi155.stdout: "event": "initiated", 2023-08-01T19:55:26.470 INFO:teuthology.orchestra.run.smithi155.stdout: "time": "2023-08-01T19:55:05.156952+0000", 2023-08-01T19:55:26.470 INFO:teuthology.orchestra.run.smithi155.stdout: "duration": 0 2023-08-01T19:55:26.470 INFO:teuthology.orchestra.run.smithi155.stdout: }, 2023-08-01T19:55:26.470 INFO:teuthology.orchestra.run.smithi155.stdout: { 2023-08-01T19:55:26.470 INFO:teuthology.orchestra.run.smithi155.stdout: "event": "throttled", 2023-08-01T19:55:26.470 INFO:teuthology.orchestra.run.smithi155.stdout: "time": "2023-08-01T19:55:05.156952+0000", 2023-08-01T19:55:26.470 INFO:teuthology.orchestra.run.smithi155.stdout: "duration": 0 2023-08-01T19:55:26.471 INFO:teuthology.orchestra.run.smithi155.stdout: }, 2023-08-01T19:55:26.471 INFO:teuthology.orchestra.run.smithi155.stdout: { 2023-08-01T19:55:26.471 INFO:teuthology.orchestra.run.smithi155.stdout: "event": "header_read", 2023-08-01T19:55:26.471 INFO:teuthology.orchestra.run.smithi155.stdout: "time": "2023-08-01T19:55:05.156951+0000", 2023-08-01T19:55:26.471 INFO:teuthology.orchestra.run.smithi155.stdout: "duration": 4294967295.999999 2023-08-01T19:55:26.471 INFO:teuthology.orchestra.run.smithi155.stdout: }, 2023-08-01T19:55:26.471 INFO:teuthology.orchestra.run.smithi155.stdout: { 2023-08-01T19:55:26.471 INFO:teuthology.orchestra.run.smithi155.stdout: "event": "all_read", 2023-08-01T19:55:26.472 INFO:teuthology.orchestra.run.smithi155.stdout: "time": "2023-08-01T19:55:05.156989+0000", 2023-08-01T19:55:26.472 INFO:teuthology.orchestra.run.smithi155.stdout: "duration": 3.8175e-05 2023-08-01T19:55:26.472 INFO:teuthology.orchestra.run.smithi155.stdout: }, 2023-08-01T19:55:26.472 INFO:teuthology.orchestra.run.smithi155.stdout: { 2023-08-01T19:55:26.472 INFO:teuthology.orchestra.run.smithi155.stdout: "event": "dispatched", 2023-08-01T19:55:26.472 INFO:teuthology.orchestra.run.smithi155.stdout: "time": "2023-08-01T19:55:05.218842+0000", 2023-08-01T19:55:26.472 INFO:teuthology.orchestra.run.smithi155.stdout: "duration": 0.061852299999999999 2023-08-01T19:55:26.472 INFO:teuthology.orchestra.run.smithi155.stdout: }, 2023-08-01T19:55:26.473 INFO:teuthology.orchestra.run.smithi155.stdout: { 2023-08-01T19:55:26.473 INFO:teuthology.orchestra.run.smithi155.stdout: "event": "queued_for_pg", 2023-08-01T19:55:26.473 INFO:teuthology.orchestra.run.smithi155.stdout: "time": "2023-08-01T19:55:05.218862+0000", 2023-08-01T19:55:26.473 INFO:teuthology.orchestra.run.smithi155.stdout: "duration": 1.9854999999999999e-05 2023-08-01T19:55:26.473 INFO:teuthology.orchestra.run.smithi155.stdout: }, 2023-08-01T19:55:26.473 INFO:teuthology.orchestra.run.smithi155.stdout: { 2023-08-01T19:55:26.473 INFO:teuthology.orchestra.run.smithi155.stdout: "event": "reached_pg", 2023-08-01T19:55:26.473 INFO:teuthology.orchestra.run.smithi155.stdout: "time": "2023-08-01T19:55:05.218918+0000", 2023-08-01T19:55:26.474 INFO:teuthology.orchestra.run.smithi155.stdout: "duration": 5.6570000000000002e-05 2023-08-01T19:55:26.474 INFO:teuthology.orchestra.run.smithi155.stdout: }, 2023-08-01T19:55:26.474 INFO:teuthology.orchestra.run.smithi155.stdout: { 2023-08-01T19:55:26.474 INFO:teuthology.orchestra.run.smithi155.stdout: "event": "started", 2023-08-01T19:55:26.474 INFO:teuthology.orchestra.run.smithi155.stdout: "time": "2023-08-01T19:55:05.218940+0000", 2023-08-01T19:55:26.474 INFO:teuthology.orchestra.run.smithi155.stdout: "duration": 2.1804e-05 2023-08-01T19:55:26.474 INFO:teuthology.orchestra.run.smithi155.stdout: }, 2023-08-01T19:55:26.474 INFO:teuthology.orchestra.run.smithi155.stdout: { 2023-08-01T19:55:26.475 INFO:teuthology.orchestra.run.smithi155.stdout: "event": "commit_sent", 2023-08-01T19:55:26.475 INFO:teuthology.orchestra.run.smithi155.stdout: "time": "2023-08-01T19:55:05.224928+0000", 2023-08-01T19:55:26.475 INFO:teuthology.orchestra.run.smithi155.stdout: "duration": 0.0059876759999999999 2023-08-01T19:55:26.475 INFO:teuthology.orchestra.run.smithi155.stdout: }, 2023-08-01T19:55:26.475 INFO:teuthology.orchestra.run.smithi155.stdout: { 2023-08-01T19:55:26.475 INFO:teuthology.orchestra.run.smithi155.stdout: "event": "done", 2023-08-01T19:55:26.475 INFO:teuthology.orchestra.run.smithi155.stdout: "time": "2023-08-01T19:55:05.224971+0000", 2023-08-01T19:55:26.475 INFO:teuthology.orchestra.run.smithi155.stdout: "duration": 4.2929999999999997e-05 2023-08-01T19:55:26.476 INFO:teuthology.orchestra.run.smithi155.stdout: } 2023-08-01T19:55:26.476 INFO:teuthology.orchestra.run.smithi155.stdout: ] 2023-08-01T19:55:26.476 INFO:teuthology.orchestra.run.smithi155.stdout: } 2023-08-01T19:55:26.476 INFO:teuthology.orchestra.run.smithi155.stdout: }, 2023-08-01T19:55:26.476 INFO:teuthology.orchestra.run.smithi155.stdout: { 2023-08-01T19:55:26.476 INFO:teuthology.orchestra.run.smithi155.stdout: "description": "osd_op(client.4668.0:100927 5.0 5:00608ec6:::benchmark_data_smithi006_114134_object100926:head [set-alloc-hint object_size 65536 write_size 65536,write 0~65536] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e37)", 2023-08-01T19:55:26.476 INFO:teuthology.orchestra.run.smithi155.stdout: "initiated_at": "2023-08-01T19:55:05.561169+0000", 2023-08-01T19:55:26.477 INFO:teuthology.orchestra.run.smithi155.stdout: "age": 20.778849792999999, 2023-08-01T19:55:26.477 INFO:teuthology.orchestra.run.smithi155.stdout: "duration": 0.066411687999999997, 2023-08-01T19:55:26.477 INFO:teuthology.orchestra.run.smithi155.stdout: "type_data": { 2023-08-01T19:55:26.477 INFO:teuthology.orchestra.run.smithi155.stdout: "flag_point": "commit sent; apply or cleanup", 2023-08-01T19:55:26.477 INFO:teuthology.orchestra.run.smithi155.stdout: "client_info": { 2023-08-01T19:55:26.477 INFO:teuthology.orchestra.run.smithi155.stdout: "client": "client.4668", 2023-08-01T19:55:26.477 INFO:teuthology.orchestra.run.smithi155.stdout: "client_addr": "172.21.15.6:0/1709472247", 2023-08-01T19:55:26.477 INFO:teuthology.orchestra.run.smithi155.stdout: "tid": 100927 2023-08-01T19:55:26.478 INFO:teuthology.orchestra.run.smithi155.stdout: }, 2023-08-01T19:55:26.478 INFO:teuthology.orchestra.run.smithi155.stdout: "events": [ 2023-08-01T19:55:26.478 INFO:teuthology.orchestra.run.smithi155.stdout: { 2023-08-01T19:55:26.478 INFO:teuthology.orchestra.run.smithi155.stdout: "event": "initiated", 2023-08-01T19:55:26.478 INFO:teuthology.orchestra.run.smithi155.stdout: "time": "2023-08-01T19:55:05.561169+0000", 2023-08-01T19:55:26.478 INFO:teuthology.orchestra.run.smithi155.stdout: "duration": 0 2023-08-01T19:55:26.478 INFO:teuthology.orchestra.run.smithi155.stdout: }, 2023-08-01T19:55:26.478 INFO:teuthology.orchestra.run.smithi155.stdout: { 2023-08-01T19:55:26.479 INFO:teuthology.orchestra.run.smithi155.stdout: "event": "throttled", 2023-08-01T19:55:26.479 INFO:teuthology.orchestra.run.smithi155.stdout: "time": "2023-08-01T19:55:05.561169+0000", 2023-08-01T19:55:26.479 INFO:teuthology.orchestra.run.smithi155.stdout: "duration": 0 2023-08-01T19:55:26.479 INFO:teuthology.orchestra.run.smithi155.stdout: }, 2023-08-01T19:55:26.479 INFO:teuthology.orchestra.run.smithi155.stdout: { 2023-08-01T19:55:26.479 INFO:teuthology.orchestra.run.smithi155.stdout: "event": "header_read", 2023-08-01T19:55:26.479 INFO:teuthology.orchestra.run.smithi155.stdout: "time": "2023-08-01T19:55:05.561168+0000", 2023-08-01T19:55:26.479 INFO:teuthology.orchestra.run.smithi155.stdout: "duration": 4294967295.9999995 2023-08-01T19:55:26.480 INFO:teuthology.orchestra.run.smithi155.stdout: }, 2023-08-01T19:55:26.480 INFO:teuthology.orchestra.run.smithi155.stdout: { 2023-08-01T19:55:26.480 INFO:teuthology.orchestra.run.smithi155.stdout: "event": "all_read", 2023-08-01T19:55:26.480 INFO:teuthology.orchestra.run.smithi155.stdout: "time": "2023-08-01T19:55:05.561218+0000", 2023-08-01T19:55:26.480 INFO:teuthology.orchestra.run.smithi155.stdout: "duration": 4.9379999999999998e-05 2023-08-01T19:55:26.480 INFO:teuthology.orchestra.run.smithi155.stdout: }, 2023-08-01T19:55:26.480 INFO:teuthology.orchestra.run.smithi155.stdout: { 2023-08-01T19:55:26.480 INFO:teuthology.orchestra.run.smithi155.stdout: "event": "dispatched", 2023-08-01T19:55:26.481 INFO:teuthology.orchestra.run.smithi155.stdout: "time": "2023-08-01T19:55:05.561225+0000", 2023-08-01T19:55:26.481 INFO:teuthology.orchestra.run.smithi155.stdout: "duration": 7.114e-06 2023-08-01T19:55:26.481 INFO:teuthology.orchestra.run.smithi155.stdout: }, 2023-08-01T19:55:26.481 INFO:teuthology.orchestra.run.smithi155.stdout: { 2023-08-01T19:55:26.481 INFO:teuthology.orchestra.run.smithi155.stdout: "event": "queued_for_pg", 2023-08-01T19:55:26.481 INFO:teuthology.orchestra.run.smithi155.stdout: "time": "2023-08-01T19:55:05.561229+0000", 2023-08-01T19:55:26.481 INFO:teuthology.orchestra.run.smithi155.stdout: "duration": 4.2180000000000001e-06 2023-08-01T19:55:26.481 INFO:teuthology.orchestra.run.smithi155.stdout: }, 2023-08-01T19:55:26.482 INFO:teuthology.orchestra.run.smithi155.stdout: { 2023-08-01T19:55:26.482 INFO:teuthology.orchestra.run.smithi155.stdout: "event": "reached_pg", 2023-08-01T19:55:26.482 INFO:teuthology.orchestra.run.smithi155.stdout: "time": "2023-08-01T19:55:05.564737+0000", 2023-08-01T19:55:26.482 INFO:teuthology.orchestra.run.smithi155.stdout: "duration": 0.0035081869999999999 2023-08-01T19:55:26.482 INFO:teuthology.orchestra.run.smithi155.stdout: }, 2023-08-01T19:55:26.482 INFO:teuthology.orchestra.run.smithi155.stdout: { 2023-08-01T19:55:26.482 INFO:teuthology.orchestra.run.smithi155.stdout: "event": "started", 2023-08-01T19:55:26.482 INFO:teuthology.orchestra.run.smithi155.stdout: "time": "2023-08-01T19:55:05.564859+0000", 2023-08-01T19:55:26.483 INFO:teuthology.orchestra.run.smithi155.stdout: "duration": 0.00012165800000000001 2023-08-01T19:55:26.483 INFO:teuthology.orchestra.run.smithi155.stdout: }, 2023-08-01T19:55:26.483 INFO:teuthology.orchestra.run.smithi155.stdout: { 2023-08-01T19:55:26.483 INFO:teuthology.orchestra.run.smithi155.stdout: "event": "waiting for subops from 0", 2023-08-01T19:55:26.483 INFO:teuthology.orchestra.run.smithi155.stdout: "time": "2023-08-01T19:55:05.565009+0000", 2023-08-01T19:55:26.483 INFO:teuthology.orchestra.run.smithi155.stdout: "duration": 0.00014979699999999999 2023-08-01T19:55:26.483 INFO:teuthology.orchestra.run.smithi155.stdout: }, 2023-08-01T19:55:26.483 INFO:teuthology.orchestra.run.smithi155.stdout: { 2023-08-01T19:55:26.484 INFO:teuthology.orchestra.run.smithi155.stdout: "event": "op_commit", 2023-08-01T19:55:26.484 INFO:teuthology.orchestra.run.smithi155.stdout: "time": "2023-08-01T19:55:05.568007+0000", 2023-08-01T19:55:26.484 INFO:teuthology.orchestra.run.smithi155.stdout: "duration": 0.00299796 2023-08-01T19:55:26.484 INFO:teuthology.orchestra.run.smithi155.stdout: }, 2023-08-01T19:55:26.484 INFO:teuthology.orchestra.run.smithi155.stdout: { 2023-08-01T19:55:26.484 INFO:teuthology.orchestra.run.smithi155.stdout: "event": "sub_op_commit_rec", 2023-08-01T19:55:26.484 INFO:teuthology.orchestra.run.smithi155.stdout: "time": "2023-08-01T19:55:05.627520+0000", 2023-08-01T19:55:26.485 INFO:teuthology.orchestra.run.smithi155.stdout: "duration": 0.059513636000000002 2023-08-01T19:55:26.485 INFO:teuthology.orchestra.run.smithi155.stdout: }, 2023-08-01T19:55:26.485 INFO:teuthology.orchestra.run.smithi155.stdout: { 2023-08-01T19:55:26.485 INFO:teuthology.orchestra.run.smithi155.stdout: "event": "commit_sent", 2023-08-01T19:55:26.485 INFO:teuthology.orchestra.run.smithi155.stdout: "time": "2023-08-01T19:55:05.627553+0000", 2023-08-01T19:55:26.485 INFO:teuthology.orchestra.run.smithi155.stdout: "duration": 3.2635999999999997e-05 2023-08-01T19:55:26.485 INFO:teuthology.orchestra.run.smithi155.stdout: }, 2023-08-01T19:55:26.485 INFO:teuthology.orchestra.run.smithi155.stdout: { 2023-08-01T19:55:26.486 INFO:teuthology.orchestra.run.smithi155.stdout: "event": "done", 2023-08-01T19:55:26.486 INFO:teuthology.orchestra.run.smithi155.stdout: "time": "2023-08-01T19:55:05.627581+0000", 2023-08-01T19:55:26.486 INFO:teuthology.orchestra.run.smithi155.stdout: "duration": 2.7681000000000001e-05 2023-08-01T19:55:26.486 INFO:teuthology.orchestra.run.smithi155.stdout: } 2023-08-01T19:55:26.486 INFO:teuthology.orchestra.run.smithi155.stdout: ] 2023-08-01T19:55:26.486 INFO:teuthology.orchestra.run.smithi155.stdout: } 2023-08-01T19:55:26.486 INFO:teuthology.orchestra.run.smithi155.stdout: }, 2023-08-01T19:55:26.486 INFO:teuthology.orchestra.run.smithi155.stdout: { 2023-08-01T19:55:26.487 INFO:teuthology.orchestra.run.smithi155.stdout: "description": "osd_op(client.4668.0:100935 5.e 5:7895b14e:::benchmark_data_smithi006_114134_object100934:head [set-alloc-hint object_size 65536 write_size 65536,write 0~65536] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e37)", 2023-08-01T19:55:26.487 INFO:teuthology.orchestra.run.smithi155.stdout: "initiated_at": "2023-08-01T19:55:05.566666+0000", 2023-08-01T19:55:26.487 INFO:teuthology.orchestra.run.smithi155.stdout: "age": 20.773352493000001, 2023-08-01T19:55:26.487 INFO:teuthology.orchestra.run.smithi155.stdout: "duration": 0.064309016999999996, 2023-08-01T19:55:26.487 INFO:teuthology.orchestra.run.smithi155.stdout: "type_data": { 2023-08-01T19:55:26.487 INFO:teuthology.orchestra.run.smithi155.stdout: "flag_point": "commit sent; apply or cleanup", 2023-08-01T19:55:26.487 INFO:teuthology.orchestra.run.smithi155.stdout: "client_info": { 2023-08-01T19:55:26.487 INFO:teuthology.orchestra.run.smithi155.stdout: "client": "client.4668", 2023-08-01T19:55:26.488 INFO:teuthology.orchestra.run.smithi155.stdout: "client_addr": "172.21.15.6:0/1709472247", 2023-08-01T19:55:26.488 INFO:teuthology.orchestra.run.smithi155.stdout: "tid": 100935 2023-08-01T19:55:26.488 INFO:teuthology.orchestra.run.smithi155.stdout: }, 2023-08-01T19:55:26.488 INFO:teuthology.orchestra.run.smithi155.stdout: "events": [ 2023-08-01T19:55:26.488 INFO:teuthology.orchestra.run.smithi155.stdout: { 2023-08-01T19:55:26.488 INFO:teuthology.orchestra.run.smithi155.stdout: "event": "initiated", 2023-08-01T19:55:26.488 INFO:teuthology.orchestra.run.smithi155.stdout: "time": "2023-08-01T19:55:05.566666+0000", 2023-08-01T19:55:26.488 INFO:teuthology.orchestra.run.smithi155.stdout: "duration": 0 2023-08-01T19:55:26.489 INFO:teuthology.orchestra.run.smithi155.stdout: }, 2023-08-01T19:55:26.489 INFO:teuthology.orchestra.run.smithi155.stdout: { 2023-08-01T19:55:26.489 INFO:teuthology.orchestra.run.smithi155.stdout: "event": "throttled", 2023-08-01T19:55:26.489 INFO:teuthology.orchestra.run.smithi155.stdout: "time": "2023-08-01T19:55:05.566666+0000", 2023-08-01T19:55:26.489 INFO:teuthology.orchestra.run.smithi155.stdout: "duration": 0 2023-08-01T19:55:26.489 INFO:teuthology.orchestra.run.smithi155.stdout: }, 2023-08-01T19:55:26.489 INFO:teuthology.orchestra.run.smithi155.stdout: { 2023-08-01T19:55:26.489 INFO:teuthology.orchestra.run.smithi155.stdout: "event": "header_read", 2023-08-01T19:55:26.490 INFO:teuthology.orchestra.run.smithi155.stdout: "time": "2023-08-01T19:55:05.566665+0000", 2023-08-01T19:55:26.490 INFO:teuthology.orchestra.run.smithi155.stdout: "duration": 4294967295.9999986 2023-08-01T19:55:26.490 INFO:teuthology.orchestra.run.smithi155.stdout: }, 2023-08-01T19:55:26.490 INFO:teuthology.orchestra.run.smithi155.stdout: { 2023-08-01T19:55:26.490 INFO:teuthology.orchestra.run.smithi155.stdout: "event": "all_read", 2023-08-01T19:55:26.490 INFO:teuthology.orchestra.run.smithi155.stdout: "time": "2023-08-01T19:55:05.566754+0000", 2023-08-01T19:55:26.490 INFO:teuthology.orchestra.run.smithi155.stdout: "duration": 8.9425999999999994e-05 2023-08-01T19:55:26.491 INFO:teuthology.orchestra.run.smithi155.stdout: }, 2023-08-01T19:55:26.491 INFO:teuthology.orchestra.run.smithi155.stdout: { 2023-08-01T19:55:26.491 INFO:teuthology.orchestra.run.smithi155.stdout: "event": "dispatched", 2023-08-01T19:55:26.491 INFO:teuthology.orchestra.run.smithi155.stdout: "time": "2023-08-01T19:55:05.566766+0000", 2023-08-01T19:55:26.491 INFO:teuthology.orchestra.run.smithi155.stdout: "duration": 1.2018000000000001e-05 2023-08-01T19:55:26.491 INFO:teuthology.orchestra.run.smithi155.stdout: }, 2023-08-01T19:55:26.491 INFO:teuthology.orchestra.run.smithi155.stdout: { 2023-08-01T19:55:26.491 INFO:teuthology.orchestra.run.smithi155.stdout: "event": "queued_for_pg", 2023-08-01T19:55:26.492 INFO:teuthology.orchestra.run.smithi155.stdout: "time": "2023-08-01T19:55:05.566772+0000", 2023-08-01T19:55:26.492 INFO:teuthology.orchestra.run.smithi155.stdout: "duration": 6.0190000000000003e-06 2023-08-01T19:55:26.492 INFO:teuthology.orchestra.run.smithi155.stdout: }, 2023-08-01T19:55:26.492 INFO:teuthology.orchestra.run.smithi155.stdout: { 2023-08-01T19:55:26.492 INFO:teuthology.orchestra.run.smithi155.stdout: "event": "reached_pg", 2023-08-01T19:55:26.492 INFO:teuthology.orchestra.run.smithi155.stdout: "time": "2023-08-01T19:55:05.566800+0000", 2023-08-01T19:55:26.492 INFO:teuthology.orchestra.run.smithi155.stdout: "duration": 2.7835999999999999e-05 2023-08-01T19:55:26.492 INFO:teuthology.orchestra.run.smithi155.stdout: }, 2023-08-01T19:55:26.493 INFO:teuthology.orchestra.run.smithi155.stdout: { 2023-08-01T19:55:26.493 INFO:teuthology.orchestra.run.smithi155.stdout: "event": "started", 2023-08-01T19:55:26.493 INFO:teuthology.orchestra.run.smithi155.stdout: "time": "2023-08-01T19:55:05.566879+0000", 2023-08-01T19:55:26.493 INFO:teuthology.orchestra.run.smithi155.stdout: "duration": 7.9105999999999998e-05 2023-08-01T19:55:26.493 INFO:teuthology.orchestra.run.smithi155.stdout: }, 2023-08-01T19:55:26.493 INFO:teuthology.orchestra.run.smithi155.stdout: { 2023-08-01T19:55:26.493 INFO:teuthology.orchestra.run.smithi155.stdout: "event": "waiting for subops from 0", 2023-08-01T19:55:26.493 INFO:teuthology.orchestra.run.smithi155.stdout: "time": "2023-08-01T19:55:05.566971+0000", 2023-08-01T19:55:26.494 INFO:teuthology.orchestra.run.smithi155.stdout: "duration": 9.1817999999999994e-05 2023-08-01T19:55:26.494 INFO:teuthology.orchestra.run.smithi155.stdout: }, 2023-08-01T19:55:26.494 INFO:teuthology.orchestra.run.smithi155.stdout: { 2023-08-01T19:55:26.494 INFO:teuthology.orchestra.run.smithi155.stdout: "event": "op_commit", 2023-08-01T19:55:26.494 INFO:teuthology.orchestra.run.smithi155.stdout: "time": "2023-08-01T19:55:05.571475+0000", 2023-08-01T19:55:26.494 INFO:teuthology.orchestra.run.smithi155.stdout: "duration": 0.0045039499999999996 2023-08-01T19:55:26.494 INFO:teuthology.orchestra.run.smithi155.stdout: }, 2023-08-01T19:55:26.495 INFO:teuthology.orchestra.run.smithi155.stdout: { 2023-08-01T19:55:26.495 INFO:teuthology.orchestra.run.smithi155.stdout: "event": "sub_op_commit_rec", 2023-08-01T19:55:26.495 INFO:teuthology.orchestra.run.smithi155.stdout: "time": "2023-08-01T19:55:05.630884+0000", 2023-08-01T19:55:26.495 INFO:teuthology.orchestra.run.smithi155.stdout: "duration": 0.059409181999999998 2023-08-01T19:55:26.495 INFO:teuthology.orchestra.run.smithi155.stdout: }, 2023-08-01T19:55:26.495 INFO:teuthology.orchestra.run.smithi155.stdout: { 2023-08-01T19:55:26.495 INFO:teuthology.orchestra.run.smithi155.stdout: "event": "commit_sent", 2023-08-01T19:55:26.495 INFO:teuthology.orchestra.run.smithi155.stdout: "time": "2023-08-01T19:55:05.630930+0000", 2023-08-01T19:55:26.496 INFO:teuthology.orchestra.run.smithi155.stdout: "duration": 4.5507999999999999e-05 2023-08-01T19:55:26.496 INFO:teuthology.orchestra.run.smithi155.stdout: }, 2023-08-01T19:55:26.496 INFO:teuthology.orchestra.run.smithi155.stdout: { 2023-08-01T19:55:26.496 INFO:teuthology.orchestra.run.smithi155.stdout: "event": "done", 2023-08-01T19:55:26.496 INFO:teuthology.orchestra.run.smithi155.stdout: "time": "2023-08-01T19:55:05.630975+0000", 2023-08-01T19:55:26.496 INFO:teuthology.orchestra.run.smithi155.stdout: "duration": 4.5441000000000001e-05 2023-08-01T19:55:26.496 INFO:teuthology.orchestra.run.smithi155.stdout: } 2023-08-01T19:55:26.496 INFO:teuthology.orchestra.run.smithi155.stdout: ] 2023-08-01T19:55:26.497 INFO:teuthology.orchestra.run.smithi155.stdout: } 2023-08-01T19:55:26.497 INFO:teuthology.orchestra.run.smithi155.stdout: }, 2023-08-01T19:55:26.497 INFO:teuthology.orchestra.run.smithi155.stdout: { 2023-08-01T19:55:26.497 INFO:teuthology.orchestra.run.smithi155.stdout: "description": "osd_op(client.4668.0:100941 5.e 5:736a6ac6:::benchmark_data_smithi006_114134_object100940:head [set-alloc-hint object_size 65536 write_size 65536,write 0~65536] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e37)", 2023-08-01T19:55:26.497 INFO:teuthology.orchestra.run.smithi155.stdout: "initiated_at": "2023-08-01T19:55:05.569750+0000", 2023-08-01T19:55:26.497 INFO:teuthology.orchestra.run.smithi155.stdout: "age": 20.770268600000001, 2023-08-01T19:55:26.497 INFO:teuthology.orchestra.run.smithi155.stdout: "duration": 0.065431331999999995, 2023-08-01T19:55:26.497 INFO:teuthology.orchestra.run.smithi155.stdout: "type_data": { 2023-08-01T19:55:26.498 INFO:teuthology.orchestra.run.smithi155.stdout: "flag_point": "commit sent; apply or cleanup", 2023-08-01T19:55:26.498 INFO:teuthology.orchestra.run.smithi155.stdout: "client_info": { 2023-08-01T19:55:26.498 INFO:teuthology.orchestra.run.smithi155.stdout: "client": "client.4668", 2023-08-01T19:55:26.498 INFO:teuthology.orchestra.run.smithi155.stdout: "client_addr": "172.21.15.6:0/1709472247", 2023-08-01T19:55:26.498 INFO:teuthology.orchestra.run.smithi155.stdout: "tid": 100941 2023-08-01T19:55:26.498 INFO:teuthology.orchestra.run.smithi155.stdout: }, 2023-08-01T19:55:26.498 INFO:teuthology.orchestra.run.smithi155.stdout: "events": [ 2023-08-01T19:55:26.498 INFO:teuthology.orchestra.run.smithi155.stdout: { 2023-08-01T19:55:26.499 INFO:teuthology.orchestra.run.smithi155.stdout: "event": "initiated", 2023-08-01T19:55:26.499 INFO:teuthology.orchestra.run.smithi155.stdout: "time": "2023-08-01T19:55:05.569750+0000", 2023-08-01T19:55:26.499 INFO:teuthology.orchestra.run.smithi155.stdout: "duration": 0 2023-08-01T19:55:26.499 INFO:teuthology.orchestra.run.smithi155.stdout: }, 2023-08-01T19:55:26.499 INFO:teuthology.orchestra.run.smithi155.stdout: { 2023-08-01T19:55:26.499 INFO:teuthology.orchestra.run.smithi155.stdout: "event": "throttled", 2023-08-01T19:55:26.499 INFO:teuthology.orchestra.run.smithi155.stdout: "time": "2023-08-01T19:55:05.569750+0000", 2023-08-01T19:55:26.499 INFO:teuthology.orchestra.run.smithi155.stdout: "duration": 0 2023-08-01T19:55:26.500 INFO:teuthology.orchestra.run.smithi155.stdout: }, 2023-08-01T19:55:26.500 INFO:teuthology.orchestra.run.smithi155.stdout: { 2023-08-01T19:55:26.500 INFO:teuthology.orchestra.run.smithi155.stdout: "event": "header_read", 2023-08-01T19:55:26.500 INFO:teuthology.orchestra.run.smithi155.stdout: "time": "2023-08-01T19:55:05.569749+0000", 2023-08-01T19:55:26.500 INFO:teuthology.orchestra.run.smithi155.stdout: "duration": 4294967295.999999 2023-08-01T19:55:26.500 INFO:teuthology.orchestra.run.smithi155.stdout: }, 2023-08-01T19:55:26.500 INFO:teuthology.orchestra.run.smithi155.stdout: { 2023-08-01T19:55:26.501 INFO:teuthology.orchestra.run.smithi155.stdout: "event": "all_read", 2023-08-01T19:55:26.501 INFO:teuthology.orchestra.run.smithi155.stdout: "time": "2023-08-01T19:55:05.569861+0000", 2023-08-01T19:55:26.501 INFO:teuthology.orchestra.run.smithi155.stdout: "duration": 0.000111333 2023-08-01T19:55:26.501 INFO:teuthology.orchestra.run.smithi155.stdout: }, 2023-08-01T19:55:26.501 INFO:teuthology.orchestra.run.smithi155.stdout: { 2023-08-01T19:55:26.501 INFO:teuthology.orchestra.run.smithi155.stdout: "event": "dispatched", 2023-08-01T19:55:26.501 INFO:teuthology.orchestra.run.smithi155.stdout: "time": "2023-08-01T19:55:05.569869+0000", 2023-08-01T19:55:26.501 INFO:teuthology.orchestra.run.smithi155.stdout: "duration": 8.8589999999999994e-06 2023-08-01T19:55:26.502 INFO:teuthology.orchestra.run.smithi155.stdout: }, 2023-08-01T19:55:26.502 INFO:teuthology.orchestra.run.smithi155.stdout: { 2023-08-01T19:55:26.502 INFO:teuthology.orchestra.run.smithi155.stdout: "event": "queued_for_pg", 2023-08-01T19:55:26.502 INFO:teuthology.orchestra.run.smithi155.stdout: "time": "2023-08-01T19:55:05.569874+0000", 2023-08-01T19:55:26.502 INFO:teuthology.orchestra.run.smithi155.stdout: "duration": 4.1679999999999997e-06 2023-08-01T19:55:26.502 INFO:teuthology.orchestra.run.smithi155.stdout: }, 2023-08-01T19:55:26.502 INFO:teuthology.orchestra.run.smithi155.stdout: { 2023-08-01T19:55:26.502 INFO:teuthology.orchestra.run.smithi155.stdout: "event": "reached_pg", 2023-08-01T19:55:26.503 INFO:teuthology.orchestra.run.smithi155.stdout: "time": "2023-08-01T19:55:05.569904+0000", 2023-08-01T19:55:26.503 INFO:teuthology.orchestra.run.smithi155.stdout: "duration": 3.0920999999999998e-05 2023-08-01T19:55:26.503 INFO:teuthology.orchestra.run.smithi155.stdout: }, 2023-08-01T19:55:26.503 INFO:teuthology.orchestra.run.smithi155.stdout: { 2023-08-01T19:55:26.503 INFO:teuthology.orchestra.run.smithi155.stdout: "event": "started", 2023-08-01T19:55:26.503 INFO:teuthology.orchestra.run.smithi155.stdout: "time": "2023-08-01T19:55:05.569998+0000", 2023-08-01T19:55:26.503 INFO:teuthology.orchestra.run.smithi155.stdout: "duration": 9.3086999999999998e-05 2023-08-01T19:55:26.503 INFO:teuthology.orchestra.run.smithi155.stdout: }, 2023-08-01T19:55:26.504 INFO:teuthology.orchestra.run.smithi155.stdout: { 2023-08-01T19:55:26.504 INFO:teuthology.orchestra.run.smithi155.stdout: "event": "waiting for subops from 0", 2023-08-01T19:55:26.504 INFO:teuthology.orchestra.run.smithi155.stdout: "time": "2023-08-01T19:55:05.570093+0000", 2023-08-01T19:55:26.504 INFO:teuthology.orchestra.run.smithi155.stdout: "duration": 9.5768999999999997e-05 2023-08-01T19:55:26.504 INFO:teuthology.orchestra.run.smithi155.stdout: }, 2023-08-01T19:55:26.504 INFO:teuthology.orchestra.run.smithi155.stdout: { 2023-08-01T19:55:26.504 INFO:teuthology.orchestra.run.smithi155.stdout: "event": "op_commit", 2023-08-01T19:55:26.504 INFO:teuthology.orchestra.run.smithi155.stdout: "time": "2023-08-01T19:55:05.572839+0000", 2023-08-01T19:55:26.505 INFO:teuthology.orchestra.run.smithi155.stdout: "duration": 0.0027460050000000001 2023-08-01T19:55:26.505 INFO:teuthology.orchestra.run.smithi155.stdout: }, 2023-08-01T19:55:26.505 INFO:teuthology.orchestra.run.smithi155.stdout: { 2023-08-01T19:55:26.505 INFO:teuthology.orchestra.run.smithi155.stdout: "event": "sub_op_commit_rec", 2023-08-01T19:55:26.505 INFO:teuthology.orchestra.run.smithi155.stdout: "time": "2023-08-01T19:55:05.635114+0000", 2023-08-01T19:55:26.505 INFO:teuthology.orchestra.run.smithi155.stdout: "duration": 0.062274297999999999 2023-08-01T19:55:26.505 INFO:teuthology.orchestra.run.smithi155.stdout: }, 2023-08-01T19:55:26.505 INFO:teuthology.orchestra.run.smithi155.stdout: { 2023-08-01T19:55:26.506 INFO:teuthology.orchestra.run.smithi155.stdout: "event": "commit_sent", 2023-08-01T19:55:26.506 INFO:teuthology.orchestra.run.smithi155.stdout: "time": "2023-08-01T19:55:05.635143+0000", 2023-08-01T19:55:26.506 INFO:teuthology.orchestra.run.smithi155.stdout: "duration": 2.9430000000000001e-05 2023-08-01T19:55:26.506 INFO:teuthology.orchestra.run.smithi155.stdout: }, 2023-08-01T19:55:26.506 INFO:teuthology.orchestra.run.smithi155.stdout: { 2023-08-01T19:55:26.506 INFO:teuthology.orchestra.run.smithi155.stdout: "event": "done", 2023-08-01T19:55:26.506 INFO:teuthology.orchestra.run.smithi155.stdout: "time": "2023-08-01T19:55:05.635181+0000", 2023-08-01T19:55:26.506 INFO:teuthology.orchestra.run.smithi155.stdout: "duration": 3.8352000000000001e-05 2023-08-01T19:55:26.507 INFO:teuthology.orchestra.run.smithi155.stdout: } 2023-08-01T19:55:26.507 INFO:teuthology.orchestra.run.smithi155.stdout: ] 2023-08-01T19:55:26.507 INFO:teuthology.orchestra.run.smithi155.stdout: } 2023-08-01T19:55:26.507 INFO:teuthology.orchestra.run.smithi155.stdout: }, 2023-08-01T19:55:26.507 INFO:teuthology.orchestra.run.smithi155.stdout: { 2023-08-01T19:55:26.507 INFO:teuthology.orchestra.run.smithi155.stdout: "description": "osd_op(client.4668.0:100944 5.4 5:25fae865:::benchmark_data_smithi006_114134_object100943:head [set-alloc-hint object_size 65536 write_size 65536,write 0~65536] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e37)", 2023-08-01T19:55:26.507 INFO:teuthology.orchestra.run.smithi155.stdout: "initiated_at": "2023-08-01T19:55:05.576662+0000", 2023-08-01T19:55:26.508 INFO:teuthology.orchestra.run.smithi155.stdout: "age": 20.763356903000002, 2023-08-01T19:55:26.508 INFO:teuthology.orchestra.run.smithi155.stdout: "duration": 0.056054925999999998, 2023-08-01T19:55:26.508 INFO:teuthology.orchestra.run.smithi155.stdout: "type_data": { 2023-08-01T19:55:26.508 INFO:teuthology.orchestra.run.smithi155.stdout: "flag_point": "commit sent; apply or cleanup", 2023-08-01T19:55:26.508 INFO:teuthology.orchestra.run.smithi155.stdout: "client_info": { 2023-08-01T19:55:26.508 INFO:teuthology.orchestra.run.smithi155.stdout: "client": "client.4668", 2023-08-01T19:55:26.508 INFO:teuthology.orchestra.run.smithi155.stdout: "client_addr": "172.21.15.6:0/1709472247", 2023-08-01T19:55:26.508 INFO:teuthology.orchestra.run.smithi155.stdout: "tid": 100944 2023-08-01T19:55:26.509 INFO:teuthology.orchestra.run.smithi155.stdout: }, 2023-08-01T19:55:26.509 INFO:teuthology.orchestra.run.smithi155.stdout: "events": [ 2023-08-01T19:55:26.509 INFO:teuthology.orchestra.run.smithi155.stdout: { 2023-08-01T19:55:26.509 INFO:teuthology.orchestra.run.smithi155.stdout: "event": "initiated", 2023-08-01T19:55:26.509 INFO:teuthology.orchestra.run.smithi155.stdout: "time": "2023-08-01T19:55:05.576662+0000", 2023-08-01T19:55:26.509 INFO:teuthology.orchestra.run.smithi155.stdout: "duration": 0 2023-08-01T19:55:26.509 INFO:teuthology.orchestra.run.smithi155.stdout: }, 2023-08-01T19:55:26.509 INFO:teuthology.orchestra.run.smithi155.stdout: { 2023-08-01T19:55:26.510 INFO:teuthology.orchestra.run.smithi155.stdout: "event": "throttled", 2023-08-01T19:55:26.510 INFO:teuthology.orchestra.run.smithi155.stdout: "time": "2023-08-01T19:55:05.576662+0000", 2023-08-01T19:55:26.510 INFO:teuthology.orchestra.run.smithi155.stdout: "duration": 0 2023-08-01T19:55:26.510 INFO:teuthology.orchestra.run.smithi155.stdout: }, 2023-08-01T19:55:26.510 INFO:teuthology.orchestra.run.smithi155.stdout: { 2023-08-01T19:55:26.510 INFO:teuthology.orchestra.run.smithi155.stdout: "event": "header_read", 2023-08-01T19:55:26.510 INFO:teuthology.orchestra.run.smithi155.stdout: "time": "2023-08-01T19:55:05.576661+0000", 2023-08-01T19:55:26.510 INFO:teuthology.orchestra.run.smithi155.stdout: "duration": 4294967295.999999 2023-08-01T19:55:26.511 INFO:teuthology.orchestra.run.smithi155.stdout: }, 2023-08-01T19:55:26.511 INFO:teuthology.orchestra.run.smithi155.stdout: { 2023-08-01T19:55:26.511 INFO:teuthology.orchestra.run.smithi155.stdout: "event": "all_read", 2023-08-01T19:55:26.511 INFO:teuthology.orchestra.run.smithi155.stdout: "time": "2023-08-01T19:55:05.576725+0000", 2023-08-01T19:55:26.511 INFO:teuthology.orchestra.run.smithi155.stdout: "duration": 6.4435000000000002e-05 2023-08-01T19:55:26.511 INFO:teuthology.orchestra.run.smithi155.stdout: }, 2023-08-01T19:55:26.511 INFO:teuthology.orchestra.run.smithi155.stdout: { 2023-08-01T19:55:26.511 INFO:teuthology.orchestra.run.smithi155.stdout: "event": "dispatched", 2023-08-01T19:55:26.512 INFO:teuthology.orchestra.run.smithi155.stdout: "time": "2023-08-01T19:55:05.576744+0000", 2023-08-01T19:55:26.512 INFO:teuthology.orchestra.run.smithi155.stdout: "duration": 1.8502999999999999e-05 2023-08-01T19:55:26.512 INFO:teuthology.orchestra.run.smithi155.stdout: }, 2023-08-01T19:55:26.512 INFO:teuthology.orchestra.run.smithi155.stdout: { 2023-08-01T19:55:26.512 INFO:teuthology.orchestra.run.smithi155.stdout: "event": "queued_for_pg", 2023-08-01T19:55:26.512 INFO:teuthology.orchestra.run.smithi155.stdout: "time": "2023-08-01T19:55:05.576772+0000", 2023-08-01T19:55:26.512 INFO:teuthology.orchestra.run.smithi155.stdout: "duration": 2.8354999999999999e-05 2023-08-01T19:55:26.512 INFO:teuthology.orchestra.run.smithi155.stdout: }, 2023-08-01T19:55:26.513 INFO:teuthology.orchestra.run.smithi155.stdout: { 2023-08-01T19:55:26.513 INFO:teuthology.orchestra.run.smithi155.stdout: "event": "reached_pg", 2023-08-01T19:55:26.513 INFO:teuthology.orchestra.run.smithi155.stdout: "time": "2023-08-01T19:55:05.576815+0000", 2023-08-01T19:55:26.513 INFO:teuthology.orchestra.run.smithi155.stdout: "duration": 4.3223999999999998e-05 2023-08-01T19:55:26.513 INFO:teuthology.orchestra.run.smithi155.stdout: }, 2023-08-01T19:55:26.513 INFO:teuthology.orchestra.run.smithi155.stdout: { 2023-08-01T19:55:26.513 INFO:teuthology.orchestra.run.smithi155.stdout: "event": "started", 2023-08-01T19:55:26.514 INFO:teuthology.orchestra.run.smithi155.stdout: "time": "2023-08-01T19:55:05.576961+0000", 2023-08-01T19:55:26.514 INFO:teuthology.orchestra.run.smithi155.stdout: "duration": 0.000145043 2023-08-01T19:55:26.514 INFO:teuthology.orchestra.run.smithi155.stdout: }, 2023-08-01T19:55:26.514 INFO:teuthology.orchestra.run.smithi155.stdout: { 2023-08-01T19:55:26.514 INFO:teuthology.orchestra.run.smithi155.stdout: "event": "waiting for subops from 0", 2023-08-01T19:55:26.514 INFO:teuthology.orchestra.run.smithi155.stdout: "time": "2023-08-01T19:55:05.577343+0000", 2023-08-01T19:55:26.514 INFO:teuthology.orchestra.run.smithi155.stdout: "duration": 0.00038249699999999998 2023-08-01T19:55:26.514 INFO:teuthology.orchestra.run.smithi155.stdout: }, 2023-08-01T19:55:26.515 INFO:teuthology.orchestra.run.smithi155.stdout: { 2023-08-01T19:55:26.515 INFO:teuthology.orchestra.run.smithi155.stdout: "event": "op_commit", 2023-08-01T19:55:26.515 INFO:teuthology.orchestra.run.smithi155.stdout: "time": "2023-08-01T19:55:05.582349+0000", 2023-08-01T19:55:26.515 INFO:teuthology.orchestra.run.smithi155.stdout: "duration": 0.0050062880000000002 2023-08-01T19:55:26.515 INFO:teuthology.orchestra.run.smithi155.stdout: }, 2023-08-01T19:55:26.515 INFO:teuthology.orchestra.run.smithi155.stdout: { 2023-08-01T19:55:26.515 INFO:teuthology.orchestra.run.smithi155.stdout: "event": "sub_op_commit_rec", 2023-08-01T19:55:26.515 INFO:teuthology.orchestra.run.smithi155.stdout: "time": "2023-08-01T19:55:05.632659+0000", 2023-08-01T19:55:26.516 INFO:teuthology.orchestra.run.smithi155.stdout: "duration": 0.050309185999999999 2023-08-01T19:55:26.516 INFO:teuthology.orchestra.run.smithi155.stdout: }, 2023-08-01T19:55:26.516 INFO:teuthology.orchestra.run.smithi155.stdout: { 2023-08-01T19:55:26.516 INFO:teuthology.orchestra.run.smithi155.stdout: "event": "commit_sent", 2023-08-01T19:55:26.516 INFO:teuthology.orchestra.run.smithi155.stdout: "time": "2023-08-01T19:55:05.632692+0000", 2023-08-01T19:55:26.516 INFO:teuthology.orchestra.run.smithi155.stdout: "duration": 3.3077999999999997e-05 2023-08-01T19:55:26.516 INFO:teuthology.orchestra.run.smithi155.stdout: }, 2023-08-01T19:55:26.516 INFO:teuthology.orchestra.run.smithi155.stdout: { 2023-08-01T19:55:26.517 INFO:teuthology.orchestra.run.smithi155.stdout: "event": "done", 2023-08-01T19:55:26.517 INFO:teuthology.orchestra.run.smithi155.stdout: "time": "2023-08-01T19:55:05.632717+0000", 2023-08-01T19:55:26.517 INFO:teuthology.orchestra.run.smithi155.stdout: "duration": 2.5119000000000001e-05 2023-08-01T19:55:26.517 INFO:teuthology.orchestra.run.smithi155.stdout: } 2023-08-01T19:55:26.517 INFO:teuthology.orchestra.run.smithi155.stdout: ] 2023-08-01T19:55:26.517 INFO:teuthology.orchestra.run.smithi155.stdout: } 2023-08-01T19:55:26.517 INFO:teuthology.orchestra.run.smithi155.stdout: }, 2023-08-01T19:55:26.517 INFO:teuthology.orchestra.run.smithi155.stdout: { 2023-08-01T19:55:26.518 INFO:teuthology.orchestra.run.smithi155.stdout: "description": "osd_op(client.4668.0:100945 5.e 5:73df68dd:::benchmark_data_smithi006_114134_object100944:head [set-alloc-hint object_size 65536 write_size 65536,write 0~65536] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e37)", 2023-08-01T19:55:26.518 INFO:teuthology.orchestra.run.smithi155.stdout: "initiated_at": "2023-08-01T19:55:05.576784+0000", 2023-08-01T19:55:26.518 INFO:teuthology.orchestra.run.smithi155.stdout: "age": 20.763235014999999, 2023-08-01T19:55:26.518 INFO:teuthology.orchestra.run.smithi155.stdout: "duration": 0.058512994999999998, 2023-08-01T19:55:26.518 INFO:teuthology.orchestra.run.smithi155.stdout: "type_data": { 2023-08-01T19:55:26.518 INFO:teuthology.orchestra.run.smithi155.stdout: "flag_point": "commit sent; apply or cleanup", 2023-08-01T19:55:26.518 INFO:teuthology.orchestra.run.smithi155.stdout: "client_info": { 2023-08-01T19:55:26.518 INFO:teuthology.orchestra.run.smithi155.stdout: "client": "client.4668", 2023-08-01T19:55:26.519 INFO:teuthology.orchestra.run.smithi155.stdout: "client_addr": "172.21.15.6:0/1709472247", 2023-08-01T19:55:26.519 INFO:teuthology.orchestra.run.smithi155.stdout: "tid": 100945 2023-08-01T19:55:26.519 INFO:teuthology.orchestra.run.smithi155.stdout: }, 2023-08-01T19:55:26.519 INFO:teuthology.orchestra.run.smithi155.stdout: "events": [ 2023-08-01T19:55:26.519 INFO:teuthology.orchestra.run.smithi155.stdout: { 2023-08-01T19:55:26.519 INFO:teuthology.orchestra.run.smithi155.stdout: "event": "initiated", 2023-08-01T19:55:26.519 INFO:teuthology.orchestra.run.smithi155.stdout: "time": "2023-08-01T19:55:05.576784+0000", 2023-08-01T19:55:26.519 INFO:teuthology.orchestra.run.smithi155.stdout: "duration": 0 2023-08-01T19:55:26.520 INFO:teuthology.orchestra.run.smithi155.stdout: }, 2023-08-01T19:55:26.520 INFO:teuthology.orchestra.run.smithi155.stdout: { 2023-08-01T19:55:26.520 INFO:teuthology.orchestra.run.smithi155.stdout: "event": "throttled", 2023-08-01T19:55:26.520 INFO:teuthology.orchestra.run.smithi155.stdout: "time": "2023-08-01T19:55:05.576784+0000", 2023-08-01T19:55:26.520 INFO:teuthology.orchestra.run.smithi155.stdout: "duration": 0 2023-08-01T19:55:26.520 INFO:teuthology.orchestra.run.smithi155.stdout: }, 2023-08-01T19:55:26.520 INFO:teuthology.orchestra.run.smithi155.stdout: { 2023-08-01T19:55:26.521 INFO:teuthology.orchestra.run.smithi155.stdout: "event": "header_read", 2023-08-01T19:55:26.521 INFO:teuthology.orchestra.run.smithi155.stdout: "time": "2023-08-01T19:55:05.576783+0000", 2023-08-01T19:55:26.521 INFO:teuthology.orchestra.run.smithi155.stdout: "duration": 4294967295.9999995 2023-08-01T19:55:26.521 INFO:teuthology.orchestra.run.smithi155.stdout: }, 2023-08-01T19:55:26.521 INFO:teuthology.orchestra.run.smithi155.stdout: { 2023-08-01T19:55:26.521 INFO:teuthology.orchestra.run.smithi155.stdout: "event": "all_read", 2023-08-01T19:55:26.521 INFO:teuthology.orchestra.run.smithi155.stdout: "time": "2023-08-01T19:55:05.576807+0000", 2023-08-01T19:55:26.521 INFO:teuthology.orchestra.run.smithi155.stdout: "duration": 2.3651000000000001e-05 2023-08-01T19:55:26.522 INFO:teuthology.orchestra.run.smithi155.stdout: }, 2023-08-01T19:55:26.522 INFO:teuthology.orchestra.run.smithi155.stdout: { 2023-08-01T19:55:26.522 INFO:teuthology.orchestra.run.smithi155.stdout: "event": "dispatched", 2023-08-01T19:55:26.522 INFO:teuthology.orchestra.run.smithi155.stdout: "time": "2023-08-01T19:55:05.576817+0000", 2023-08-01T19:55:26.522 INFO:teuthology.orchestra.run.smithi155.stdout: "duration": 9.9389999999999992e-06 2023-08-01T19:55:26.522 INFO:teuthology.orchestra.run.smithi155.stdout: }, 2023-08-01T19:55:26.522 INFO:teuthology.orchestra.run.smithi155.stdout: { 2023-08-01T19:55:26.522 INFO:teuthology.orchestra.run.smithi155.stdout: "event": "queued_for_pg", 2023-08-01T19:55:26.523 INFO:teuthology.orchestra.run.smithi155.stdout: "time": "2023-08-01T19:55:05.576820+0000", 2023-08-01T19:55:26.523 INFO:teuthology.orchestra.run.smithi155.stdout: "duration": 3.2619999999999999e-06 2023-08-01T19:55:26.523 INFO:teuthology.orchestra.run.smithi155.stdout: }, 2023-08-01T19:55:26.523 INFO:teuthology.orchestra.run.smithi155.stdout: { 2023-08-01T19:55:26.523 INFO:teuthology.orchestra.run.smithi155.stdout: "event": "reached_pg", 2023-08-01T19:55:26.523 INFO:teuthology.orchestra.run.smithi155.stdout: "time": "2023-08-01T19:55:05.576849+0000", 2023-08-01T19:55:26.523 INFO:teuthology.orchestra.run.smithi155.stdout: "duration": 2.8880000000000001e-05 2023-08-01T19:55:26.523 INFO:teuthology.orchestra.run.smithi155.stdout: }, 2023-08-01T19:55:26.524 INFO:teuthology.orchestra.run.smithi155.stdout: { 2023-08-01T19:55:26.524 INFO:teuthology.orchestra.run.smithi155.stdout: "event": "started", 2023-08-01T19:55:26.524 INFO:teuthology.orchestra.run.smithi155.stdout: "time": "2023-08-01T19:55:05.576940+0000", 2023-08-01T19:55:26.524 INFO:teuthology.orchestra.run.smithi155.stdout: "duration": 9.0570999999999997e-05 2023-08-01T19:55:26.524 INFO:teuthology.orchestra.run.smithi155.stdout: }, 2023-08-01T19:55:26.524 INFO:teuthology.orchestra.run.smithi155.stdout: { 2023-08-01T19:55:26.524 INFO:teuthology.orchestra.run.smithi155.stdout: "event": "waiting for subops from 0", 2023-08-01T19:55:26.524 INFO:teuthology.orchestra.run.smithi155.stdout: "time": "2023-08-01T19:55:05.577027+0000", 2023-08-01T19:55:26.525 INFO:teuthology.orchestra.run.smithi155.stdout: "duration": 8.7237999999999994e-05 2023-08-01T19:55:26.525 INFO:teuthology.orchestra.run.smithi155.stdout: }, 2023-08-01T19:55:26.525 INFO:teuthology.orchestra.run.smithi155.stdout: { 2023-08-01T19:55:26.525 INFO:teuthology.orchestra.run.smithi155.stdout: "event": "op_commit", 2023-08-01T19:55:26.525 INFO:teuthology.orchestra.run.smithi155.stdout: "time": "2023-08-01T19:55:05.579624+0000", 2023-08-01T19:55:26.525 INFO:teuthology.orchestra.run.smithi155.stdout: "duration": 0.0025971200000000001 2023-08-01T19:55:26.525 INFO:teuthology.orchestra.run.smithi155.stdout: }, 2023-08-01T19:55:26.525 INFO:teuthology.orchestra.run.smithi155.stdout: { 2023-08-01T19:55:26.526 INFO:teuthology.orchestra.run.smithi155.stdout: "event": "sub_op_commit_rec", 2023-08-01T19:55:26.526 INFO:teuthology.orchestra.run.smithi155.stdout: "time": "2023-08-01T19:55:05.635218+0000", 2023-08-01T19:55:26.526 INFO:teuthology.orchestra.run.smithi155.stdout: "duration": 0.055594487999999997 2023-08-01T19:55:26.526 INFO:teuthology.orchestra.run.smithi155.stdout: }, 2023-08-01T19:55:26.526 INFO:teuthology.orchestra.run.smithi155.stdout: { 2023-08-01T19:55:26.526 INFO:teuthology.orchestra.run.smithi155.stdout: "event": "commit_sent", 2023-08-01T19:55:26.526 INFO:teuthology.orchestra.run.smithi155.stdout: "time": "2023-08-01T19:55:05.635262+0000", 2023-08-01T19:55:26.526 INFO:teuthology.orchestra.run.smithi155.stdout: "duration": 4.3380999999999997e-05 2023-08-01T19:55:26.527 INFO:teuthology.orchestra.run.smithi155.stdout: }, 2023-08-01T19:55:26.527 INFO:teuthology.orchestra.run.smithi155.stdout: { 2023-08-01T19:55:26.527 INFO:teuthology.orchestra.run.smithi155.stdout: "event": "done", 2023-08-01T19:55:26.527 INFO:teuthology.orchestra.run.smithi155.stdout: "time": "2023-08-01T19:55:05.635297+0000", 2023-08-01T19:55:26.527 INFO:teuthology.orchestra.run.smithi155.stdout: "duration": 3.4842000000000003e-05 2023-08-01T19:55:26.527 INFO:teuthology.orchestra.run.smithi155.stdout: } 2023-08-01T19:55:26.527 INFO:teuthology.orchestra.run.smithi155.stdout: ] 2023-08-01T19:55:26.527 INFO:teuthology.orchestra.run.smithi155.stdout: } 2023-08-01T19:55:26.528 INFO:teuthology.orchestra.run.smithi155.stdout: }, 2023-08-01T19:55:26.528 INFO:teuthology.orchestra.run.smithi155.stdout: { 2023-08-01T19:55:26.528 INFO:teuthology.orchestra.run.smithi155.stdout: "description": "osd_op(client.4668.0:100947 5.4 5:23e8fc27:::benchmark_data_smithi006_114134_object100946:head [set-alloc-hint object_size 65536 write_size 65536,write 0~65536] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e37)", 2023-08-01T19:55:26.528 INFO:teuthology.orchestra.run.smithi155.stdout: "initiated_at": "2023-08-01T19:55:05.576840+0000", 2023-08-01T19:55:26.528 INFO:teuthology.orchestra.run.smithi155.stdout: "age": 20.763178960000001, 2023-08-01T19:55:26.528 INFO:teuthology.orchestra.run.smithi155.stdout: "duration": 0.058423127999999998, 2023-08-01T19:55:26.528 INFO:teuthology.orchestra.run.smithi155.stdout: "type_data": { 2023-08-01T19:55:26.529 INFO:teuthology.orchestra.run.smithi155.stdout: "flag_point": "commit sent; apply or cleanup", 2023-08-01T19:55:26.529 INFO:teuthology.orchestra.run.smithi155.stdout: "client_info": { 2023-08-01T19:55:26.529 INFO:teuthology.orchestra.run.smithi155.stdout: "client": "client.4668", 2023-08-01T19:55:26.529 INFO:teuthology.orchestra.run.smithi155.stdout: "client_addr": "172.21.15.6:0/1709472247", 2023-08-01T19:55:26.529 INFO:teuthology.orchestra.run.smithi155.stdout: "tid": 100947 2023-08-01T19:55:26.529 INFO:teuthology.orchestra.run.smithi155.stdout: }, 2023-08-01T19:55:26.529 INFO:teuthology.orchestra.run.smithi155.stdout: "events": [ 2023-08-01T19:55:26.529 INFO:teuthology.orchestra.run.smithi155.stdout: { 2023-08-01T19:55:26.530 INFO:teuthology.orchestra.run.smithi155.stdout: "event": "initiated", 2023-08-01T19:55:26.530 INFO:teuthology.orchestra.run.smithi155.stdout: "time": "2023-08-01T19:55:05.576840+0000", 2023-08-01T19:55:26.530 INFO:teuthology.orchestra.run.smithi155.stdout: "duration": 0 2023-08-01T19:55:26.530 INFO:teuthology.orchestra.run.smithi155.stdout: }, 2023-08-01T19:55:26.530 INFO:teuthology.orchestra.run.smithi155.stdout: { 2023-08-01T19:55:26.530 INFO:teuthology.orchestra.run.smithi155.stdout: "event": "throttled", 2023-08-01T19:55:26.530 INFO:teuthology.orchestra.run.smithi155.stdout: "time": "2023-08-01T19:55:05.576840+0000", 2023-08-01T19:55:26.530 INFO:teuthology.orchestra.run.smithi155.stdout: "duration": 0 2023-08-01T19:55:26.531 INFO:teuthology.orchestra.run.smithi155.stdout: }, 2023-08-01T19:55:26.531 INFO:teuthology.orchestra.run.smithi155.stdout: { 2023-08-01T19:55:26.531 INFO:teuthology.orchestra.run.smithi155.stdout: "event": "header_read", 2023-08-01T19:55:26.531 INFO:teuthology.orchestra.run.smithi155.stdout: "time": "2023-08-01T19:55:05.576839+0000", 2023-08-01T19:55:26.531 INFO:teuthology.orchestra.run.smithi155.stdout: "duration": 4294967295.9999995 2023-08-01T19:55:26.531 INFO:teuthology.orchestra.run.smithi155.stdout: }, 2023-08-01T19:55:26.531 INFO:teuthology.orchestra.run.smithi155.stdout: { 2023-08-01T19:55:26.531 INFO:teuthology.orchestra.run.smithi155.stdout: "event": "all_read", 2023-08-01T19:55:26.532 INFO:teuthology.orchestra.run.smithi155.stdout: "time": "2023-08-01T19:55:05.576893+0000", 2023-08-01T19:55:26.532 INFO:teuthology.orchestra.run.smithi155.stdout: "duration": 5.3893000000000001e-05 2023-08-01T19:55:26.532 INFO:teuthology.orchestra.run.smithi155.stdout: }, 2023-08-01T19:55:26.532 INFO:teuthology.orchestra.run.smithi155.stdout: { 2023-08-01T19:55:26.532 INFO:teuthology.orchestra.run.smithi155.stdout: "event": "dispatched", 2023-08-01T19:55:26.532 INFO:teuthology.orchestra.run.smithi155.stdout: "time": "2023-08-01T19:55:05.576902+0000", 2023-08-01T19:55:26.532 INFO:teuthology.orchestra.run.smithi155.stdout: "duration": 8.7520000000000002e-06 2023-08-01T19:55:26.533 INFO:teuthology.orchestra.run.smithi155.stdout: }, 2023-08-01T19:55:26.533 INFO:teuthology.orchestra.run.smithi155.stdout: { 2023-08-01T19:55:26.533 INFO:teuthology.orchestra.run.smithi155.stdout: "event": "queued_for_pg", 2023-08-01T19:55:26.533 INFO:teuthology.orchestra.run.smithi155.stdout: "time": "2023-08-01T19:55:05.576905+0000", 2023-08-01T19:55:26.533 INFO:teuthology.orchestra.run.smithi155.stdout: "duration": 3.01e-06 2023-08-01T19:55:26.533 INFO:teuthology.orchestra.run.smithi155.stdout: }, 2023-08-01T19:55:26.533 INFO:teuthology.orchestra.run.smithi155.stdout: { 2023-08-01T19:55:26.533 INFO:teuthology.orchestra.run.smithi155.stdout: "event": "reached_pg", 2023-08-01T19:55:26.534 INFO:teuthology.orchestra.run.smithi155.stdout: "time": "2023-08-01T19:55:05.579641+0000", 2023-08-01T19:55:26.534 INFO:teuthology.orchestra.run.smithi155.stdout: "duration": 0.0027366880000000001 2023-08-01T19:55:26.534 INFO:teuthology.orchestra.run.smithi155.stdout: }, 2023-08-01T19:55:26.534 INFO:teuthology.orchestra.run.smithi155.stdout: { 2023-08-01T19:55:26.534 INFO:teuthology.orchestra.run.smithi155.stdout: "event": "started", 2023-08-01T19:55:26.534 INFO:teuthology.orchestra.run.smithi155.stdout: "time": "2023-08-01T19:55:05.579734+0000", 2023-08-01T19:55:26.534 INFO:teuthology.orchestra.run.smithi155.stdout: "duration": 9.2590000000000006e-05 2023-08-01T19:55:26.534 INFO:teuthology.orchestra.run.smithi155.stdout: }, 2023-08-01T19:55:26.535 INFO:teuthology.orchestra.run.smithi155.stdout: { 2023-08-01T19:55:26.535 INFO:teuthology.orchestra.run.smithi155.stdout: "event": "waiting for subops from 0", 2023-08-01T19:55:26.535 INFO:teuthology.orchestra.run.smithi155.stdout: "time": "2023-08-01T19:55:05.579825+0000", 2023-08-01T19:55:26.535 INFO:teuthology.orchestra.run.smithi155.stdout: "duration": 9.0964999999999994e-05 2023-08-01T19:55:26.535 INFO:teuthology.orchestra.run.smithi155.stdout: }, 2023-08-01T19:55:26.535 INFO:teuthology.orchestra.run.smithi155.stdout: { 2023-08-01T19:55:26.535 INFO:teuthology.orchestra.run.smithi155.stdout: "event": "op_commit", 2023-08-01T19:55:26.535 INFO:teuthology.orchestra.run.smithi155.stdout: "time": "2023-08-01T19:55:05.585041+0000", 2023-08-01T19:55:26.536 INFO:teuthology.orchestra.run.smithi155.stdout: "duration": 0.0052159670000000002 2023-08-01T19:55:26.536 INFO:teuthology.orchestra.run.smithi155.stdout: }, 2023-08-01T19:55:26.536 INFO:teuthology.orchestra.run.smithi155.stdout: { 2023-08-01T19:55:26.536 INFO:teuthology.orchestra.run.smithi155.stdout: "event": "sub_op_commit_rec", 2023-08-01T19:55:26.536 INFO:teuthology.orchestra.run.smithi155.stdout: "time": "2023-08-01T19:55:05.635199+0000", 2023-08-01T19:55:26.536 INFO:teuthology.orchestra.run.smithi155.stdout: "duration": 0.050158023000000003 2023-08-01T19:55:26.536 INFO:teuthology.orchestra.run.smithi155.stdout: }, 2023-08-01T19:55:26.536 INFO:teuthology.orchestra.run.smithi155.stdout: { 2023-08-01T19:55:26.537 INFO:teuthology.orchestra.run.smithi155.stdout: "event": "commit_sent", 2023-08-01T19:55:26.537 INFO:teuthology.orchestra.run.smithi155.stdout: "time": "2023-08-01T19:55:05.635227+0000", 2023-08-01T19:55:26.537 INFO:teuthology.orchestra.run.smithi155.stdout: "duration": 2.7821e-05 2023-08-01T19:55:26.537 INFO:teuthology.orchestra.run.smithi155.stdout: }, 2023-08-01T19:55:26.537 INFO:teuthology.orchestra.run.smithi155.stdout: { 2023-08-01T19:55:26.537 INFO:teuthology.orchestra.run.smithi155.stdout: "event": "done", 2023-08-01T19:55:26.537 INFO:teuthology.orchestra.run.smithi155.stdout: "time": "2023-08-01T19:55:05.635263+0000", 2023-08-01T19:55:26.537 INFO:teuthology.orchestra.run.smithi155.stdout: "duration": 3.6081000000000002e-05 2023-08-01T19:55:26.538 INFO:teuthology.orchestra.run.smithi155.stdout: } 2023-08-01T19:55:26.538 INFO:teuthology.orchestra.run.smithi155.stdout: ] 2023-08-01T19:55:26.538 INFO:teuthology.orchestra.run.smithi155.stdout: } 2023-08-01T19:55:26.538 INFO:teuthology.orchestra.run.smithi155.stdout: } 2023-08-01T19:55:26.538 INFO:teuthology.orchestra.run.smithi155.stdout: ] 2023-08-01T19:55:26.538 INFO:teuthology.orchestra.run.smithi155.stdout:} 2023-08-01T19:55:26.540 DEBUG:teuthology.orchestra.run.smithi008:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 30 ceph --cluster ceph --admin-daemon /var/run/ceph/ceph-osd.0.asok dump_ops_in_flight 2023-08-01T19:55:26.540 INFO:teuthology.orchestra.run.smithi155.stdout:{ 2023-08-01T19:55:26.541 INFO:teuthology.orchestra.run.smithi155.stdout: "success": "" 2023-08-01T19:55:26.541 INFO:teuthology.orchestra.run.smithi155.stdout:} 2023-08-01T19:55:26.541 INFO:tasks.ceph.osd.2.smithi155.stderr:2023-08-01T19:55:26.539+0000 7faa5c6ac700 -1 received signal: Hangup from /usr/bin/python3 /bin/daemon-helper kill ceph-osd -f --cluster ceph -i 2 (PID: 111337) UID: 0 2023-08-01T19:55:26.640 INFO:tasks.ceph.osd.1.smithi101.stderr:2023-08-01T19:55:26.638+0000 7fb0cb7f6700 -1 received signal: Hangup from /usr/bin/python3 /bin/daemon-helper kill ceph-osd -f --cluster ceph -i 1 (PID: 111141) UID: 0 2023-08-01T19:55:26.722 INFO:teuthology.orchestra.run.smithi008.stdout:{ 2023-08-01T19:55:26.722 INFO:teuthology.orchestra.run.smithi008.stdout: "ops": [ 2023-08-01T19:55:26.723 INFO:teuthology.orchestra.run.smithi008.stdout: { 2023-08-01T19:55:26.723 INFO:teuthology.orchestra.run.smithi008.stdout: "description": "osd_op(client.4668.0:136523 5.3 5:c6f5022a:::benchmark_data_smithi006_114134_object2862:head [delete] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e46)", 2023-08-01T19:55:26.723 INFO:teuthology.orchestra.run.smithi008.stdout: "initiated_at": "2023-08-01T19:55:26.716011+0000", 2023-08-01T19:55:26.723 INFO:teuthology.orchestra.run.smithi008.stdout: "age": 0.0049862600000000002, 2023-08-01T19:55:26.723 INFO:teuthology.orchestra.run.smithi008.stdout: "duration": 0.0050080539999999996, 2023-08-01T19:55:26.723 INFO:teuthology.orchestra.run.smithi008.stdout: "type_data": { 2023-08-01T19:55:26.723 INFO:teuthology.orchestra.run.smithi008.stdout: "flag_point": "waiting for sub ops", 2023-08-01T19:55:26.723 INFO:teuthology.orchestra.run.smithi008.stdout: "client_info": { 2023-08-01T19:55:26.724 INFO:teuthology.orchestra.run.smithi008.stdout: "client": "client.4668", 2023-08-01T19:55:26.724 INFO:teuthology.orchestra.run.smithi008.stdout: "client_addr": "172.21.15.6:0/1709472247", 2023-08-01T19:55:26.724 INFO:teuthology.orchestra.run.smithi008.stdout: "tid": 136523 2023-08-01T19:55:26.724 INFO:teuthology.orchestra.run.smithi008.stdout: }, 2023-08-01T19:55:26.724 INFO:teuthology.orchestra.run.smithi008.stdout: "events": [ 2023-08-01T19:55:26.724 INFO:teuthology.orchestra.run.smithi008.stdout: { 2023-08-01T19:55:26.724 INFO:teuthology.orchestra.run.smithi008.stdout: "event": "initiated", 2023-08-01T19:55:26.725 INFO:teuthology.orchestra.run.smithi008.stdout: "time": "2023-08-01T19:55:26.716011+0000", 2023-08-01T19:55:26.725 INFO:teuthology.orchestra.run.smithi008.stdout: "duration": 0 2023-08-01T19:55:26.725 INFO:teuthology.orchestra.run.smithi008.stdout: }, 2023-08-01T19:55:26.725 INFO:teuthology.orchestra.run.smithi008.stdout: { 2023-08-01T19:55:26.725 INFO:teuthology.orchestra.run.smithi008.stdout: "event": "throttled", 2023-08-01T19:55:26.725 INFO:teuthology.orchestra.run.smithi008.stdout: "time": "2023-08-01T19:55:26.716011+0000", 2023-08-01T19:55:26.725 INFO:teuthology.orchestra.run.smithi008.stdout: "duration": 0 2023-08-01T19:55:26.725 INFO:teuthology.orchestra.run.smithi008.stdout: }, 2023-08-01T19:55:26.726 INFO:teuthology.orchestra.run.smithi008.stdout: { 2023-08-01T19:55:26.726 INFO:teuthology.orchestra.run.smithi008.stdout: "event": "header_read", 2023-08-01T19:55:26.726 INFO:teuthology.orchestra.run.smithi008.stdout: "time": "2023-08-01T19:55:26.716010+0000", 2023-08-01T19:55:26.726 INFO:teuthology.orchestra.run.smithi008.stdout: "duration": 4294967295.999999 2023-08-01T19:55:26.726 INFO:teuthology.orchestra.run.smithi008.stdout: }, 2023-08-01T19:55:26.726 INFO:teuthology.orchestra.run.smithi008.stdout: { 2023-08-01T19:55:26.726 INFO:teuthology.orchestra.run.smithi008.stdout: "event": "all_read", 2023-08-01T19:55:26.726 INFO:teuthology.orchestra.run.smithi008.stdout: "time": "2023-08-01T19:55:26.716016+0000", 2023-08-01T19:55:26.727 INFO:teuthology.orchestra.run.smithi008.stdout: "duration": 5.4380000000000003e-06 2023-08-01T19:55:26.727 INFO:teuthology.orchestra.run.smithi008.stdout: }, 2023-08-01T19:55:26.727 INFO:teuthology.orchestra.run.smithi008.stdout: { 2023-08-01T19:55:26.727 INFO:teuthology.orchestra.run.smithi008.stdout: "event": "dispatched", 2023-08-01T19:55:26.727 INFO:teuthology.orchestra.run.smithi008.stdout: "time": "2023-08-01T19:55:26.716028+0000", 2023-08-01T19:55:26.727 INFO:teuthology.orchestra.run.smithi008.stdout: "duration": 1.1678999999999999e-05 2023-08-01T19:55:26.727 INFO:teuthology.orchestra.run.smithi008.stdout: }, 2023-08-01T19:55:26.727 INFO:teuthology.orchestra.run.smithi008.stdout: { 2023-08-01T19:55:26.728 INFO:teuthology.orchestra.run.smithi008.stdout: "event": "queued_for_pg", 2023-08-01T19:55:26.728 INFO:teuthology.orchestra.run.smithi008.stdout: "time": "2023-08-01T19:55:26.716033+0000", 2023-08-01T19:55:26.728 INFO:teuthology.orchestra.run.smithi008.stdout: "duration": 5.733e-06 2023-08-01T19:55:26.728 INFO:teuthology.orchestra.run.smithi008.stdout: }, 2023-08-01T19:55:26.728 INFO:teuthology.orchestra.run.smithi008.stdout: { 2023-08-01T19:55:26.728 INFO:teuthology.orchestra.run.smithi008.stdout: "event": "reached_pg", 2023-08-01T19:55:26.728 INFO:teuthology.orchestra.run.smithi008.stdout: "time": "2023-08-01T19:55:26.716065+0000", 2023-08-01T19:55:26.729 INFO:teuthology.orchestra.run.smithi008.stdout: "duration": 3.1936000000000001e-05 2023-08-01T19:55:26.729 INFO:teuthology.orchestra.run.smithi008.stdout: }, 2023-08-01T19:55:26.729 INFO:teuthology.orchestra.run.smithi008.stdout: { 2023-08-01T19:55:26.729 INFO:teuthology.orchestra.run.smithi008.stdout: "event": "started", 2023-08-01T19:55:26.729 INFO:teuthology.orchestra.run.smithi008.stdout: "time": "2023-08-01T19:55:26.716180+0000", 2023-08-01T19:55:26.729 INFO:teuthology.orchestra.run.smithi008.stdout: "duration": 0.00011446 2023-08-01T19:55:26.729 INFO:teuthology.orchestra.run.smithi008.stdout: }, 2023-08-01T19:55:26.729 INFO:teuthology.orchestra.run.smithi008.stdout: { 2023-08-01T19:55:26.730 INFO:teuthology.orchestra.run.smithi008.stdout: "event": "waiting for subops from 1", 2023-08-01T19:55:26.730 INFO:teuthology.orchestra.run.smithi008.stdout: "time": "2023-08-01T19:55:26.716287+0000", 2023-08-01T19:55:26.730 INFO:teuthology.orchestra.run.smithi008.stdout: "duration": 0.000106865 2023-08-01T19:55:26.730 INFO:teuthology.orchestra.run.smithi008.stdout: } 2023-08-01T19:55:26.730 INFO:teuthology.orchestra.run.smithi008.stdout: ] 2023-08-01T19:55:26.730 INFO:teuthology.orchestra.run.smithi008.stdout: } 2023-08-01T19:55:26.730 INFO:teuthology.orchestra.run.smithi008.stdout: }, 2023-08-01T19:55:26.730 INFO:teuthology.orchestra.run.smithi008.stdout: { 2023-08-01T19:55:26.731 INFO:teuthology.orchestra.run.smithi008.stdout: "description": "osd_op(client.4668.0:136524 5.c 5:3c180afd:::benchmark_data_smithi006_114134_object2863:head [delete] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e46)", 2023-08-01T19:55:26.731 INFO:teuthology.orchestra.run.smithi008.stdout: "initiated_at": "2023-08-01T19:55:26.716044+0000", 2023-08-01T19:55:26.731 INFO:teuthology.orchestra.run.smithi008.stdout: "age": 0.0049533709999999998, 2023-08-01T19:55:26.731 INFO:teuthology.orchestra.run.smithi008.stdout: "duration": 0.0050290530000000003, 2023-08-01T19:55:26.731 INFO:teuthology.orchestra.run.smithi008.stdout: "type_data": { 2023-08-01T19:55:26.731 INFO:teuthology.orchestra.run.smithi008.stdout: "flag_point": "waiting for sub ops", 2023-08-01T19:55:26.731 INFO:teuthology.orchestra.run.smithi008.stdout: "client_info": { 2023-08-01T19:55:26.731 INFO:teuthology.orchestra.run.smithi008.stdout: "client": "client.4668", 2023-08-01T19:55:26.732 INFO:teuthology.orchestra.run.smithi008.stdout: "client_addr": "172.21.15.6:0/1709472247", 2023-08-01T19:55:26.732 INFO:teuthology.orchestra.run.smithi008.stdout: "tid": 136524 2023-08-01T19:55:26.732 INFO:teuthology.orchestra.run.smithi008.stdout: }, 2023-08-01T19:55:26.732 INFO:teuthology.orchestra.run.smithi008.stdout: "events": [ 2023-08-01T19:55:26.732 INFO:teuthology.orchestra.run.smithi008.stdout: { 2023-08-01T19:55:26.732 INFO:teuthology.orchestra.run.smithi008.stdout: "event": "initiated", 2023-08-01T19:55:26.732 INFO:teuthology.orchestra.run.smithi008.stdout: "time": "2023-08-01T19:55:26.716044+0000", 2023-08-01T19:55:26.732 INFO:teuthology.orchestra.run.smithi008.stdout: "duration": 0 2023-08-01T19:55:26.733 INFO:teuthology.orchestra.run.smithi008.stdout: }, 2023-08-01T19:55:26.733 INFO:teuthology.orchestra.run.smithi008.stdout: { 2023-08-01T19:55:26.733 INFO:teuthology.orchestra.run.smithi008.stdout: "event": "throttled", 2023-08-01T19:55:26.733 INFO:teuthology.orchestra.run.smithi008.stdout: "time": "2023-08-01T19:55:26.716044+0000", 2023-08-01T19:55:26.733 INFO:teuthology.orchestra.run.smithi008.stdout: "duration": 0 2023-08-01T19:55:26.733 INFO:teuthology.orchestra.run.smithi008.stdout: }, 2023-08-01T19:55:26.733 INFO:teuthology.orchestra.run.smithi008.stdout: { 2023-08-01T19:55:26.734 INFO:teuthology.orchestra.run.smithi008.stdout: "event": "header_read", 2023-08-01T19:55:26.734 INFO:teuthology.orchestra.run.smithi008.stdout: "time": "2023-08-01T19:55:26.716044+0000", 2023-08-01T19:55:26.734 INFO:teuthology.orchestra.run.smithi008.stdout: "duration": 4294967295.9999995 2023-08-01T19:55:26.734 INFO:teuthology.orchestra.run.smithi008.stdout: }, 2023-08-01T19:55:26.734 INFO:teuthology.orchestra.run.smithi008.stdout: { 2023-08-01T19:55:26.734 INFO:teuthology.orchestra.run.smithi008.stdout: "event": "all_read", 2023-08-01T19:55:26.734 INFO:teuthology.orchestra.run.smithi008.stdout: "time": "2023-08-01T19:55:26.716047+0000", 2023-08-01T19:55:26.734 INFO:teuthology.orchestra.run.smithi008.stdout: "duration": 3.0149999999999999e-06 2023-08-01T19:55:26.735 INFO:teuthology.orchestra.run.smithi008.stdout: }, 2023-08-01T19:55:26.735 INFO:teuthology.orchestra.run.smithi008.stdout: { 2023-08-01T19:55:26.735 INFO:teuthology.orchestra.run.smithi008.stdout: "event": "dispatched", 2023-08-01T19:55:26.735 INFO:teuthology.orchestra.run.smithi008.stdout: "time": "2023-08-01T19:55:26.716054+0000", 2023-08-01T19:55:26.735 INFO:teuthology.orchestra.run.smithi008.stdout: "duration": 6.9160000000000004e-06 2023-08-01T19:55:26.735 INFO:teuthology.orchestra.run.smithi008.stdout: }, 2023-08-01T19:55:26.735 INFO:teuthology.orchestra.run.smithi008.stdout: { 2023-08-01T19:55:26.735 INFO:teuthology.orchestra.run.smithi008.stdout: "event": "queued_for_pg", 2023-08-01T19:55:26.736 INFO:teuthology.orchestra.run.smithi008.stdout: "time": "2023-08-01T19:55:26.716059+0000", 2023-08-01T19:55:26.736 INFO:teuthology.orchestra.run.smithi008.stdout: "duration": 4.853e-06 2023-08-01T19:55:26.736 INFO:teuthology.orchestra.run.smithi008.stdout: }, 2023-08-01T19:55:26.736 INFO:teuthology.orchestra.run.smithi008.stdout: { 2023-08-01T19:55:26.736 INFO:teuthology.orchestra.run.smithi008.stdout: "event": "reached_pg", 2023-08-01T19:55:26.736 INFO:teuthology.orchestra.run.smithi008.stdout: "time": "2023-08-01T19:55:26.716096+0000", 2023-08-01T19:55:26.736 INFO:teuthology.orchestra.run.smithi008.stdout: "duration": 3.7966000000000002e-05 2023-08-01T19:55:26.736 INFO:teuthology.orchestra.run.smithi008.stdout: }, 2023-08-01T19:55:26.737 INFO:teuthology.orchestra.run.smithi008.stdout: { 2023-08-01T19:55:26.737 INFO:teuthology.orchestra.run.smithi008.stdout: "event": "started", 2023-08-01T19:55:26.737 INFO:teuthology.orchestra.run.smithi008.stdout: "time": "2023-08-01T19:55:26.716208+0000", 2023-08-01T19:55:26.737 INFO:teuthology.orchestra.run.smithi008.stdout: "duration": 0.000111483 2023-08-01T19:55:26.737 INFO:teuthology.orchestra.run.smithi008.stdout: }, 2023-08-01T19:55:26.737 INFO:teuthology.orchestra.run.smithi008.stdout: { 2023-08-01T19:55:26.737 INFO:teuthology.orchestra.run.smithi008.stdout: "event": "waiting for subops from 1", 2023-08-01T19:55:26.737 INFO:teuthology.orchestra.run.smithi008.stdout: "time": "2023-08-01T19:55:26.716313+0000", 2023-08-01T19:55:26.738 INFO:teuthology.orchestra.run.smithi008.stdout: "duration": 0.000104744 2023-08-01T19:55:26.738 INFO:teuthology.orchestra.run.smithi008.stdout: } 2023-08-01T19:55:26.738 INFO:teuthology.orchestra.run.smithi008.stdout: ] 2023-08-01T19:55:26.738 INFO:teuthology.orchestra.run.smithi008.stdout: } 2023-08-01T19:55:26.738 INFO:teuthology.orchestra.run.smithi008.stdout: }, 2023-08-01T19:55:26.738 INFO:teuthology.orchestra.run.smithi008.stdout: { 2023-08-01T19:55:26.738 INFO:teuthology.orchestra.run.smithi008.stdout: "description": "osd_repop(client.4668.0:136526 5.e e46/19 5:7e24e81b:::benchmark_data_smithi006_114134_object2865:head v 46'8575, mlcod=46'8572)", 2023-08-01T19:55:26.738 INFO:teuthology.orchestra.run.smithi008.stdout: "initiated_at": "2023-08-01T19:55:26.716494+0000", 2023-08-01T19:55:26.739 INFO:teuthology.orchestra.run.smithi008.stdout: "age": 0.0045039019999999997, 2023-08-01T19:55:26.739 INFO:teuthology.orchestra.run.smithi008.stdout: "duration": 0.0046250500000000003, 2023-08-01T19:55:26.739 INFO:teuthology.orchestra.run.smithi008.stdout: "type_data": { 2023-08-01T19:55:26.739 INFO:teuthology.orchestra.run.smithi008.stdout: "flag_point": "started", 2023-08-01T19:55:26.739 INFO:teuthology.orchestra.run.smithi008.stdout: "events": [ 2023-08-01T19:55:26.739 INFO:teuthology.orchestra.run.smithi008.stdout: { 2023-08-01T19:55:26.739 INFO:teuthology.orchestra.run.smithi008.stdout: "event": "initiated", 2023-08-01T19:55:26.739 INFO:teuthology.orchestra.run.smithi008.stdout: "time": "2023-08-01T19:55:26.716494+0000", 2023-08-01T19:55:26.740 INFO:teuthology.orchestra.run.smithi008.stdout: "duration": 0 2023-08-01T19:55:26.740 INFO:teuthology.orchestra.run.smithi008.stdout: }, 2023-08-01T19:55:26.740 INFO:teuthology.orchestra.run.smithi008.stdout: { 2023-08-01T19:55:26.740 INFO:teuthology.orchestra.run.smithi008.stdout: "event": "throttled", 2023-08-01T19:55:26.740 INFO:teuthology.orchestra.run.smithi008.stdout: "time": "2023-08-01T19:55:26.716494+0000", 2023-08-01T19:55:26.740 INFO:teuthology.orchestra.run.smithi008.stdout: "duration": 0 2023-08-01T19:55:26.740 INFO:teuthology.orchestra.run.smithi008.stdout: }, 2023-08-01T19:55:26.741 INFO:teuthology.orchestra.run.smithi008.stdout: { 2023-08-01T19:55:26.741 INFO:teuthology.orchestra.run.smithi008.stdout: "event": "header_read", 2023-08-01T19:55:26.741 INFO:teuthology.orchestra.run.smithi008.stdout: "time": "2023-08-01T19:55:26.716493+0000", 2023-08-01T19:55:26.741 INFO:teuthology.orchestra.run.smithi008.stdout: "duration": 4294967295.9999995 2023-08-01T19:55:26.741 INFO:teuthology.orchestra.run.smithi008.stdout: }, 2023-08-01T19:55:26.741 INFO:teuthology.orchestra.run.smithi008.stdout: { 2023-08-01T19:55:26.741 INFO:teuthology.orchestra.run.smithi008.stdout: "event": "all_read", 2023-08-01T19:55:26.741 INFO:teuthology.orchestra.run.smithi008.stdout: "time": "2023-08-01T19:55:26.716498+0000", 2023-08-01T19:55:26.742 INFO:teuthology.orchestra.run.smithi008.stdout: "duration": 4.9139999999999999e-06 2023-08-01T19:55:26.742 INFO:teuthology.orchestra.run.smithi008.stdout: }, 2023-08-01T19:55:26.742 INFO:teuthology.orchestra.run.smithi008.stdout: { 2023-08-01T19:55:26.742 INFO:teuthology.orchestra.run.smithi008.stdout: "event": "dispatched", 2023-08-01T19:55:26.742 INFO:teuthology.orchestra.run.smithi008.stdout: "time": "2023-08-01T19:55:26.716509+0000", 2023-08-01T19:55:26.742 INFO:teuthology.orchestra.run.smithi008.stdout: "duration": 1.0903e-05 2023-08-01T19:55:26.742 INFO:teuthology.orchestra.run.smithi008.stdout: }, 2023-08-01T19:55:26.742 INFO:teuthology.orchestra.run.smithi008.stdout: { 2023-08-01T19:55:26.743 INFO:teuthology.orchestra.run.smithi008.stdout: "event": "queued_for_pg", 2023-08-01T19:55:26.743 INFO:teuthology.orchestra.run.smithi008.stdout: "time": "2023-08-01T19:55:26.716514+0000", 2023-08-01T19:55:26.743 INFO:teuthology.orchestra.run.smithi008.stdout: "duration": 5.2349999999999999e-06 2023-08-01T19:55:26.743 INFO:teuthology.orchestra.run.smithi008.stdout: }, 2023-08-01T19:55:26.743 INFO:teuthology.orchestra.run.smithi008.stdout: { 2023-08-01T19:55:26.743 INFO:teuthology.orchestra.run.smithi008.stdout: "event": "reached_pg", 2023-08-01T19:55:26.743 INFO:teuthology.orchestra.run.smithi008.stdout: "time": "2023-08-01T19:55:26.716544+0000", 2023-08-01T19:55:26.743 INFO:teuthology.orchestra.run.smithi008.stdout: "duration": 2.9468999999999999e-05 2023-08-01T19:55:26.744 INFO:teuthology.orchestra.run.smithi008.stdout: }, 2023-08-01T19:55:26.744 INFO:teuthology.orchestra.run.smithi008.stdout: { 2023-08-01T19:55:26.744 INFO:teuthology.orchestra.run.smithi008.stdout: "event": "started", 2023-08-01T19:55:26.744 INFO:teuthology.orchestra.run.smithi008.stdout: "time": "2023-08-01T19:55:26.716554+0000", 2023-08-01T19:55:26.744 INFO:teuthology.orchestra.run.smithi008.stdout: "duration": 1.0798000000000001e-05 2023-08-01T19:55:26.744 INFO:teuthology.orchestra.run.smithi008.stdout: } 2023-08-01T19:55:26.744 INFO:teuthology.orchestra.run.smithi008.stdout: ] 2023-08-01T19:55:26.744 INFO:teuthology.orchestra.run.smithi008.stdout: } 2023-08-01T19:55:26.745 INFO:teuthology.orchestra.run.smithi008.stdout: }, 2023-08-01T19:55:26.745 INFO:teuthology.orchestra.run.smithi008.stdout: { 2023-08-01T19:55:26.745 INFO:teuthology.orchestra.run.smithi008.stdout: "description": "osd_op(client.4668.0:136527 5.a 5:5f6ce668:::benchmark_data_smithi006_114134_object2866:head [delete] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e46)", 2023-08-01T19:55:26.745 INFO:teuthology.orchestra.run.smithi008.stdout: "initiated_at": "2023-08-01T19:55:26.717712+0000", 2023-08-01T19:55:26.745 INFO:teuthology.orchestra.run.smithi008.stdout: "age": 0.0032853829999999998, 2023-08-01T19:55:26.745 INFO:teuthology.orchestra.run.smithi008.stdout: "duration": 0.0034414960000000001, 2023-08-01T19:55:26.745 INFO:teuthology.orchestra.run.smithi008.stdout: "type_data": { 2023-08-01T19:55:26.745 INFO:teuthology.orchestra.run.smithi008.stdout: "flag_point": "waiting for sub ops", 2023-08-01T19:55:26.746 INFO:teuthology.orchestra.run.smithi008.stdout: "client_info": { 2023-08-01T19:55:26.746 INFO:teuthology.orchestra.run.smithi008.stdout: "client": "client.4668", 2023-08-01T19:55:26.746 INFO:teuthology.orchestra.run.smithi008.stdout: "client_addr": "172.21.15.6:0/1709472247", 2023-08-01T19:55:26.746 INFO:teuthology.orchestra.run.smithi008.stdout: "tid": 136527 2023-08-01T19:55:26.746 INFO:teuthology.orchestra.run.smithi008.stdout: }, 2023-08-01T19:55:26.746 INFO:teuthology.orchestra.run.smithi008.stdout: "events": [ 2023-08-01T19:55:26.746 INFO:teuthology.orchestra.run.smithi008.stdout: { 2023-08-01T19:55:26.747 INFO:teuthology.orchestra.run.smithi008.stdout: "event": "initiated", 2023-08-01T19:55:26.747 INFO:teuthology.orchestra.run.smithi008.stdout: "time": "2023-08-01T19:55:26.717712+0000", 2023-08-01T19:55:26.747 INFO:teuthology.orchestra.run.smithi008.stdout: "duration": 0 2023-08-01T19:55:26.747 INFO:teuthology.orchestra.run.smithi008.stdout: }, 2023-08-01T19:55:26.747 INFO:teuthology.orchestra.run.smithi008.stdout: { 2023-08-01T19:55:26.747 INFO:teuthology.orchestra.run.smithi008.stdout: "event": "throttled", 2023-08-01T19:55:26.747 INFO:teuthology.orchestra.run.smithi008.stdout: "time": "2023-08-01T19:55:26.717712+0000", 2023-08-01T19:55:26.747 INFO:teuthology.orchestra.run.smithi008.stdout: "duration": 0 2023-08-01T19:55:26.748 INFO:teuthology.orchestra.run.smithi008.stdout: }, 2023-08-01T19:55:26.748 INFO:teuthology.orchestra.run.smithi008.stdout: { 2023-08-01T19:55:26.748 INFO:teuthology.orchestra.run.smithi008.stdout: "event": "header_read", 2023-08-01T19:55:26.748 INFO:teuthology.orchestra.run.smithi008.stdout: "time": "2023-08-01T19:55:26.717711+0000", 2023-08-01T19:55:26.748 INFO:teuthology.orchestra.run.smithi008.stdout: "duration": 4294967295.999999 2023-08-01T19:55:26.748 INFO:teuthology.orchestra.run.smithi008.stdout: }, 2023-08-01T19:55:26.748 INFO:teuthology.orchestra.run.smithi008.stdout: { 2023-08-01T19:55:26.749 INFO:teuthology.orchestra.run.smithi008.stdout: "event": "all_read", 2023-08-01T19:55:26.749 INFO:teuthology.orchestra.run.smithi008.stdout: "time": "2023-08-01T19:55:26.717717+0000", 2023-08-01T19:55:26.749 INFO:teuthology.orchestra.run.smithi008.stdout: "duration": 5.8599999999999998e-06 2023-08-01T19:55:26.749 INFO:teuthology.orchestra.run.smithi008.stdout: }, 2023-08-01T19:55:26.749 INFO:teuthology.orchestra.run.smithi008.stdout: { 2023-08-01T19:55:26.749 INFO:teuthology.orchestra.run.smithi008.stdout: "event": "dispatched", 2023-08-01T19:55:26.749 INFO:teuthology.orchestra.run.smithi008.stdout: "time": "2023-08-01T19:55:26.717731+0000", 2023-08-01T19:55:26.749 INFO:teuthology.orchestra.run.smithi008.stdout: "duration": 1.4165000000000001e-05 2023-08-01T19:55:26.750 INFO:teuthology.orchestra.run.smithi008.stdout: }, 2023-08-01T19:55:26.750 INFO:teuthology.orchestra.run.smithi008.stdout: { 2023-08-01T19:55:26.750 INFO:teuthology.orchestra.run.smithi008.stdout: "event": "queued_for_pg", 2023-08-01T19:55:26.750 INFO:teuthology.orchestra.run.smithi008.stdout: "time": "2023-08-01T19:55:26.717738+0000", 2023-08-01T19:55:26.750 INFO:teuthology.orchestra.run.smithi008.stdout: "duration": 6.9269999999999999e-06 2023-08-01T19:55:26.750 INFO:teuthology.orchestra.run.smithi008.stdout: }, 2023-08-01T19:55:26.750 INFO:teuthology.orchestra.run.smithi008.stdout: { 2023-08-01T19:55:26.751 INFO:teuthology.orchestra.run.smithi008.stdout: "event": "reached_pg", 2023-08-01T19:55:26.751 INFO:teuthology.orchestra.run.smithi008.stdout: "time": "2023-08-01T19:55:26.717777+0000", 2023-08-01T19:55:26.751 INFO:teuthology.orchestra.run.smithi008.stdout: "duration": 3.9206999999999999e-05 2023-08-01T19:55:26.751 INFO:teuthology.orchestra.run.smithi008.stdout: }, 2023-08-01T19:55:26.751 INFO:teuthology.orchestra.run.smithi008.stdout: { 2023-08-01T19:55:26.751 INFO:teuthology.orchestra.run.smithi008.stdout: "event": "started", 2023-08-01T19:55:26.751 INFO:teuthology.orchestra.run.smithi008.stdout: "time": "2023-08-01T19:55:26.719180+0000", 2023-08-01T19:55:26.751 INFO:teuthology.orchestra.run.smithi008.stdout: "duration": 0.0014028739999999999 2023-08-01T19:55:26.752 INFO:teuthology.orchestra.run.smithi008.stdout: }, 2023-08-01T19:55:26.752 INFO:teuthology.orchestra.run.smithi008.stdout: { 2023-08-01T19:55:26.752 INFO:teuthology.orchestra.run.smithi008.stdout: "event": "waiting for subops from 2", 2023-08-01T19:55:26.752 INFO:teuthology.orchestra.run.smithi008.stdout: "time": "2023-08-01T19:55:26.719249+0000", 2023-08-01T19:55:26.752 INFO:teuthology.orchestra.run.smithi008.stdout: "duration": 6.8888999999999997e-05 2023-08-01T19:55:26.752 INFO:teuthology.orchestra.run.smithi008.stdout: } 2023-08-01T19:55:26.752 INFO:teuthology.orchestra.run.smithi008.stdout: ] 2023-08-01T19:55:26.753 INFO:teuthology.orchestra.run.smithi008.stdout: } 2023-08-01T19:55:26.753 INFO:teuthology.orchestra.run.smithi008.stdout: }, 2023-08-01T19:55:26.753 INFO:teuthology.orchestra.run.smithi008.stdout: { 2023-08-01T19:55:26.753 INFO:teuthology.orchestra.run.smithi008.stdout: "description": "osd_repop(client.4668.0:136528 5.0 e46/19 5:04210320:::benchmark_data_smithi006_114134_object2867:head v 46'8667, mlcod=46'8664)", 2023-08-01T19:55:26.753 INFO:teuthology.orchestra.run.smithi008.stdout: "initiated_at": "2023-08-01T19:55:26.718026+0000", 2023-08-01T19:55:26.753 INFO:teuthology.orchestra.run.smithi008.stdout: "age": 0.0029717789999999999, 2023-08-01T19:55:26.753 INFO:teuthology.orchestra.run.smithi008.stdout: "duration": 0.0031696239999999998, 2023-08-01T19:55:26.754 INFO:teuthology.orchestra.run.smithi008.stdout: "type_data": { 2023-08-01T19:55:26.754 INFO:teuthology.orchestra.run.smithi008.stdout: "flag_point": "started", 2023-08-01T19:55:26.754 INFO:teuthology.orchestra.run.smithi008.stdout: "events": [ 2023-08-01T19:55:26.754 INFO:teuthology.orchestra.run.smithi008.stdout: { 2023-08-01T19:55:26.754 INFO:teuthology.orchestra.run.smithi008.stdout: "event": "initiated", 2023-08-01T19:55:26.754 INFO:teuthology.orchestra.run.smithi008.stdout: "time": "2023-08-01T19:55:26.718026+0000", 2023-08-01T19:55:26.754 INFO:teuthology.orchestra.run.smithi008.stdout: "duration": 0 2023-08-01T19:55:26.754 INFO:teuthology.orchestra.run.smithi008.stdout: }, 2023-08-01T19:55:26.755 INFO:teuthology.orchestra.run.smithi008.stdout: { 2023-08-01T19:55:26.755 INFO:teuthology.orchestra.run.smithi008.stdout: "event": "throttled", 2023-08-01T19:55:26.755 INFO:teuthology.orchestra.run.smithi008.stdout: "time": "2023-08-01T19:55:26.718026+0000", 2023-08-01T19:55:26.755 INFO:teuthology.orchestra.run.smithi008.stdout: "duration": 0 2023-08-01T19:55:26.755 INFO:teuthology.orchestra.run.smithi008.stdout: }, 2023-08-01T19:55:26.755 INFO:teuthology.orchestra.run.smithi008.stdout: { 2023-08-01T19:55:26.755 INFO:teuthology.orchestra.run.smithi008.stdout: "event": "header_read", 2023-08-01T19:55:26.756 INFO:teuthology.orchestra.run.smithi008.stdout: "time": "2023-08-01T19:55:26.718025+0000", 2023-08-01T19:55:26.756 INFO:teuthology.orchestra.run.smithi008.stdout: "duration": 4294967295.9999995 2023-08-01T19:55:26.756 INFO:teuthology.orchestra.run.smithi008.stdout: }, 2023-08-01T19:55:26.756 INFO:teuthology.orchestra.run.smithi008.stdout: { 2023-08-01T19:55:26.756 INFO:teuthology.orchestra.run.smithi008.stdout: "event": "all_read", 2023-08-01T19:55:26.756 INFO:teuthology.orchestra.run.smithi008.stdout: "time": "2023-08-01T19:55:26.718030+0000", 2023-08-01T19:55:26.756 INFO:teuthology.orchestra.run.smithi008.stdout: "duration": 4.9540000000000003e-06 2023-08-01T19:55:26.756 INFO:teuthology.orchestra.run.smithi008.stdout: }, 2023-08-01T19:55:26.757 INFO:teuthology.orchestra.run.smithi008.stdout: { 2023-08-01T19:55:26.757 INFO:teuthology.orchestra.run.smithi008.stdout: "event": "dispatched", 2023-08-01T19:55:26.757 INFO:teuthology.orchestra.run.smithi008.stdout: "time": "2023-08-01T19:55:26.718038+0000", 2023-08-01T19:55:26.757 INFO:teuthology.orchestra.run.smithi008.stdout: "duration": 7.8089999999999993e-06 2023-08-01T19:55:26.757 INFO:teuthology.orchestra.run.smithi008.stdout: }, 2023-08-01T19:55:26.757 INFO:teuthology.orchestra.run.smithi008.stdout: { 2023-08-01T19:55:26.757 INFO:teuthology.orchestra.run.smithi008.stdout: "event": "queued_for_pg", 2023-08-01T19:55:26.757 INFO:teuthology.orchestra.run.smithi008.stdout: "time": "2023-08-01T19:55:26.718043+0000", 2023-08-01T19:55:26.758 INFO:teuthology.orchestra.run.smithi008.stdout: "duration": 5.1780000000000002e-06 2023-08-01T19:55:26.758 INFO:teuthology.orchestra.run.smithi008.stdout: }, 2023-08-01T19:55:26.758 INFO:teuthology.orchestra.run.smithi008.stdout: { 2023-08-01T19:55:26.758 INFO:teuthology.orchestra.run.smithi008.stdout: "event": "reached_pg", 2023-08-01T19:55:26.758 INFO:teuthology.orchestra.run.smithi008.stdout: "time": "2023-08-01T19:55:26.718088+0000", 2023-08-01T19:55:26.758 INFO:teuthology.orchestra.run.smithi008.stdout: "duration": 4.4571999999999999e-05 2023-08-01T19:55:26.758 INFO:teuthology.orchestra.run.smithi008.stdout: }, 2023-08-01T19:55:26.758 INFO:teuthology.orchestra.run.smithi008.stdout: { 2023-08-01T19:55:26.759 INFO:teuthology.orchestra.run.smithi008.stdout: "event": "started", 2023-08-01T19:55:26.759 INFO:teuthology.orchestra.run.smithi008.stdout: "time": "2023-08-01T19:55:26.718109+0000", 2023-08-01T19:55:26.759 INFO:teuthology.orchestra.run.smithi008.stdout: "duration": 2.1452000000000001e-05 2023-08-01T19:55:26.759 INFO:teuthology.orchestra.run.smithi008.stdout: } 2023-08-01T19:55:26.759 INFO:teuthology.orchestra.run.smithi008.stdout: ] 2023-08-01T19:55:26.759 INFO:teuthology.orchestra.run.smithi008.stdout: } 2023-08-01T19:55:26.759 INFO:teuthology.orchestra.run.smithi008.stdout: }, 2023-08-01T19:55:26.760 INFO:teuthology.orchestra.run.smithi008.stdout: { 2023-08-01T19:55:26.760 INFO:teuthology.orchestra.run.smithi008.stdout: "description": "osd_op(client.4668.0:136531 5.3 5:cb8ee5a9:::benchmark_data_smithi006_114134_object2870:head [delete] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e46)", 2023-08-01T19:55:26.760 INFO:teuthology.orchestra.run.smithi008.stdout: "initiated_at": "2023-08-01T19:55:26.718526+0000", 2023-08-01T19:55:26.760 INFO:teuthology.orchestra.run.smithi008.stdout: "age": 0.0024714120000000001, 2023-08-01T19:55:26.760 INFO:teuthology.orchestra.run.smithi008.stdout: "duration": 0.0027037229999999999, 2023-08-01T19:55:26.760 INFO:teuthology.orchestra.run.smithi008.stdout: "type_data": { 2023-08-01T19:55:26.760 INFO:teuthology.orchestra.run.smithi008.stdout: "flag_point": "waiting for sub ops", 2023-08-01T19:55:26.760 INFO:teuthology.orchestra.run.smithi008.stdout: "client_info": { 2023-08-01T19:55:26.761 INFO:teuthology.orchestra.run.smithi008.stdout: "client": "client.4668", 2023-08-01T19:55:26.761 INFO:teuthology.orchestra.run.smithi008.stdout: "client_addr": "172.21.15.6:0/1709472247", 2023-08-01T19:55:26.761 INFO:teuthology.orchestra.run.smithi008.stdout: "tid": 136531 2023-08-01T19:55:26.761 INFO:teuthology.orchestra.run.smithi008.stdout: }, 2023-08-01T19:55:26.761 INFO:teuthology.orchestra.run.smithi008.stdout: "events": [ 2023-08-01T19:55:26.761 INFO:teuthology.orchestra.run.smithi008.stdout: { 2023-08-01T19:55:26.761 INFO:teuthology.orchestra.run.smithi008.stdout: "event": "initiated", 2023-08-01T19:55:26.762 INFO:teuthology.orchestra.run.smithi008.stdout: "time": "2023-08-01T19:55:26.718526+0000", 2023-08-01T19:55:26.762 INFO:teuthology.orchestra.run.smithi008.stdout: "duration": 0 2023-08-01T19:55:26.762 INFO:teuthology.orchestra.run.smithi008.stdout: }, 2023-08-01T19:55:26.762 INFO:teuthology.orchestra.run.smithi008.stdout: { 2023-08-01T19:55:26.762 INFO:teuthology.orchestra.run.smithi008.stdout: "event": "throttled", 2023-08-01T19:55:26.762 INFO:teuthology.orchestra.run.smithi008.stdout: "time": "2023-08-01T19:55:26.718526+0000", 2023-08-01T19:55:26.762 INFO:teuthology.orchestra.run.smithi008.stdout: "duration": 0 2023-08-01T19:55:26.762 INFO:teuthology.orchestra.run.smithi008.stdout: }, 2023-08-01T19:55:26.763 INFO:teuthology.orchestra.run.smithi008.stdout: { 2023-08-01T19:55:26.763 INFO:teuthology.orchestra.run.smithi008.stdout: "event": "header_read", 2023-08-01T19:55:26.763 INFO:teuthology.orchestra.run.smithi008.stdout: "time": "2023-08-01T19:55:26.718525+0000", 2023-08-01T19:55:26.763 INFO:teuthology.orchestra.run.smithi008.stdout: "duration": 4294967295.999999 2023-08-01T19:55:26.763 INFO:teuthology.orchestra.run.smithi008.stdout: }, 2023-08-01T19:55:26.763 INFO:teuthology.orchestra.run.smithi008.stdout: { 2023-08-01T19:55:26.763 INFO:teuthology.orchestra.run.smithi008.stdout: "event": "all_read", 2023-08-01T19:55:26.764 INFO:teuthology.orchestra.run.smithi008.stdout: "time": "2023-08-01T19:55:26.718530+0000", 2023-08-01T19:55:26.764 INFO:teuthology.orchestra.run.smithi008.stdout: "duration": 4.9169999999999997e-06 2023-08-01T19:55:26.764 INFO:teuthology.orchestra.run.smithi008.stdout: }, 2023-08-01T19:55:26.764 INFO:teuthology.orchestra.run.smithi008.stdout: { 2023-08-01T19:55:26.764 INFO:teuthology.orchestra.run.smithi008.stdout: "event": "dispatched", 2023-08-01T19:55:26.764 INFO:teuthology.orchestra.run.smithi008.stdout: "time": "2023-08-01T19:55:26.718540+0000", 2023-08-01T19:55:26.764 INFO:teuthology.orchestra.run.smithi008.stdout: "duration": 1.009e-05 2023-08-01T19:55:26.764 INFO:teuthology.orchestra.run.smithi008.stdout: }, 2023-08-01T19:55:26.765 INFO:teuthology.orchestra.run.smithi008.stdout: { 2023-08-01T19:55:26.765 INFO:teuthology.orchestra.run.smithi008.stdout: "event": "queued_for_pg", 2023-08-01T19:55:26.765 INFO:teuthology.orchestra.run.smithi008.stdout: "time": "2023-08-01T19:55:26.718544+0000", 2023-08-01T19:55:26.765 INFO:teuthology.orchestra.run.smithi008.stdout: "duration": 4.0820000000000001e-06 2023-08-01T19:55:26.765 INFO:teuthology.orchestra.run.smithi008.stdout: }, 2023-08-01T19:55:26.765 INFO:teuthology.orchestra.run.smithi008.stdout: { 2023-08-01T19:55:26.765 INFO:teuthology.orchestra.run.smithi008.stdout: "event": "reached_pg", 2023-08-01T19:55:26.765 INFO:teuthology.orchestra.run.smithi008.stdout: "time": "2023-08-01T19:55:26.718582+0000", 2023-08-01T19:55:26.766 INFO:teuthology.orchestra.run.smithi008.stdout: "duration": 3.8059999999999998e-05 2023-08-01T19:55:26.766 INFO:teuthology.orchestra.run.smithi008.stdout: }, 2023-08-01T19:55:26.766 INFO:teuthology.orchestra.run.smithi008.stdout: { 2023-08-01T19:55:26.766 INFO:teuthology.orchestra.run.smithi008.stdout: "event": "started", 2023-08-01T19:55:26.766 INFO:teuthology.orchestra.run.smithi008.stdout: "time": "2023-08-01T19:55:26.718722+0000", 2023-08-01T19:55:26.766 INFO:teuthology.orchestra.run.smithi008.stdout: "duration": 0.00013961099999999999 2023-08-01T19:55:26.766 INFO:teuthology.orchestra.run.smithi008.stdout: }, 2023-08-01T19:55:26.766 INFO:teuthology.orchestra.run.smithi008.stdout: { 2023-08-01T19:55:26.767 INFO:teuthology.orchestra.run.smithi008.stdout: "event": "waiting for subops from 1", 2023-08-01T19:55:26.767 INFO:teuthology.orchestra.run.smithi008.stdout: "time": "2023-08-01T19:55:26.718841+0000", 2023-08-01T19:55:26.767 INFO:teuthology.orchestra.run.smithi008.stdout: "duration": 0.000119139 2023-08-01T19:55:26.767 INFO:teuthology.orchestra.run.smithi008.stdout: } 2023-08-01T19:55:26.767 INFO:teuthology.orchestra.run.smithi008.stdout: ] 2023-08-01T19:55:26.767 INFO:teuthology.orchestra.run.smithi008.stdout: } 2023-08-01T19:55:26.767 INFO:teuthology.orchestra.run.smithi008.stdout: }, 2023-08-01T19:55:26.768 INFO:teuthology.orchestra.run.smithi008.stdout: { 2023-08-01T19:55:26.768 INFO:teuthology.orchestra.run.smithi008.stdout: "description": "osd_op(client.4668.0:136533 5.2 5:45a14f9a:::benchmark_data_smithi006_114134_object2872:head [delete] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e46)", 2023-08-01T19:55:26.768 INFO:teuthology.orchestra.run.smithi008.stdout: "initiated_at": "2023-08-01T19:55:26.718654+0000", 2023-08-01T19:55:26.768 INFO:teuthology.orchestra.run.smithi008.stdout: "age": 0.0023437319999999998, 2023-08-01T19:55:26.768 INFO:teuthology.orchestra.run.smithi008.stdout: "duration": 0.002617898, 2023-08-01T19:55:26.768 INFO:teuthology.orchestra.run.smithi008.stdout: "type_data": { 2023-08-01T19:55:26.768 INFO:teuthology.orchestra.run.smithi008.stdout: "flag_point": "waiting for sub ops", 2023-08-01T19:55:26.768 INFO:teuthology.orchestra.run.smithi008.stdout: "client_info": { 2023-08-01T19:55:26.769 INFO:teuthology.orchestra.run.smithi008.stdout: "client": "client.4668", 2023-08-01T19:55:26.769 INFO:teuthology.orchestra.run.smithi008.stdout: "client_addr": "172.21.15.6:0/1709472247", 2023-08-01T19:55:26.769 INFO:teuthology.orchestra.run.smithi008.stdout: "tid": 136533 2023-08-01T19:55:26.769 INFO:teuthology.orchestra.run.smithi008.stdout: }, 2023-08-01T19:55:26.769 INFO:teuthology.orchestra.run.smithi008.stdout: "events": [ 2023-08-01T19:55:26.769 INFO:teuthology.orchestra.run.smithi008.stdout: { 2023-08-01T19:55:26.769 INFO:teuthology.orchestra.run.smithi008.stdout: "event": "initiated", 2023-08-01T19:55:26.769 INFO:teuthology.orchestra.run.smithi008.stdout: "time": "2023-08-01T19:55:26.718654+0000", 2023-08-01T19:55:26.770 INFO:teuthology.orchestra.run.smithi008.stdout: "duration": 0 2023-08-01T19:55:26.770 INFO:teuthology.orchestra.run.smithi008.stdout: }, 2023-08-01T19:55:26.770 INFO:teuthology.orchestra.run.smithi008.stdout: { 2023-08-01T19:55:26.770 INFO:teuthology.orchestra.run.smithi008.stdout: "event": "throttled", 2023-08-01T19:55:26.770 INFO:teuthology.orchestra.run.smithi008.stdout: "time": "2023-08-01T19:55:26.718654+0000", 2023-08-01T19:55:26.770 INFO:teuthology.orchestra.run.smithi008.stdout: "duration": 0 2023-08-01T19:55:26.770 INFO:teuthology.orchestra.run.smithi008.stdout: }, 2023-08-01T19:55:26.770 INFO:teuthology.orchestra.run.smithi008.stdout: { 2023-08-01T19:55:26.771 INFO:teuthology.orchestra.run.smithi008.stdout: "event": "header_read", 2023-08-01T19:55:26.771 INFO:teuthology.orchestra.run.smithi008.stdout: "time": "2023-08-01T19:55:26.718653+0000", 2023-08-01T19:55:26.771 INFO:teuthology.orchestra.run.smithi008.stdout: "duration": 4294967295.9999995 2023-08-01T19:55:26.771 INFO:teuthology.orchestra.run.smithi008.stdout: }, 2023-08-01T19:55:26.771 INFO:teuthology.orchestra.run.smithi008.stdout: { 2023-08-01T19:55:26.771 INFO:teuthology.orchestra.run.smithi008.stdout: "event": "all_read", 2023-08-01T19:55:26.771 INFO:teuthology.orchestra.run.smithi008.stdout: "time": "2023-08-01T19:55:26.718656+0000", 2023-08-01T19:55:26.771 INFO:teuthology.orchestra.run.smithi008.stdout: "duration": 3.2009999999999999e-06 2023-08-01T19:55:26.772 INFO:teuthology.orchestra.run.smithi008.stdout: }, 2023-08-01T19:55:26.772 INFO:teuthology.orchestra.run.smithi008.stdout: { 2023-08-01T19:55:26.772 INFO:teuthology.orchestra.run.smithi008.stdout: "event": "dispatched", 2023-08-01T19:55:26.772 INFO:teuthology.orchestra.run.smithi008.stdout: "time": "2023-08-01T19:55:26.718665+0000", 2023-08-01T19:55:26.772 INFO:teuthology.orchestra.run.smithi008.stdout: "duration": 8.0339999999999997e-06 2023-08-01T19:55:26.772 INFO:teuthology.orchestra.run.smithi008.stdout: }, 2023-08-01T19:55:26.772 INFO:teuthology.orchestra.run.smithi008.stdout: { 2023-08-01T19:55:26.773 INFO:teuthology.orchestra.run.smithi008.stdout: "event": "queued_for_pg", 2023-08-01T19:55:26.773 INFO:teuthology.orchestra.run.smithi008.stdout: "time": "2023-08-01T19:55:26.718668+0000", 2023-08-01T19:55:26.773 INFO:teuthology.orchestra.run.smithi008.stdout: "duration": 3.3160000000000001e-06 2023-08-01T19:55:26.773 INFO:teuthology.orchestra.run.smithi008.stdout: }, 2023-08-01T19:55:26.773 INFO:teuthology.orchestra.run.smithi008.stdout: { 2023-08-01T19:55:26.773 INFO:teuthology.orchestra.run.smithi008.stdout: "event": "reached_pg", 2023-08-01T19:55:26.773 INFO:teuthology.orchestra.run.smithi008.stdout: "time": "2023-08-01T19:55:26.718693+0000", 2023-08-01T19:55:26.773 INFO:teuthology.orchestra.run.smithi008.stdout: "duration": 2.4695e-05 2023-08-01T19:55:26.774 INFO:teuthology.orchestra.run.smithi008.stdout: }, 2023-08-01T19:55:26.774 INFO:teuthology.orchestra.run.smithi008.stdout: { 2023-08-01T19:55:26.774 INFO:teuthology.orchestra.run.smithi008.stdout: "event": "started", 2023-08-01T19:55:26.774 INFO:teuthology.orchestra.run.smithi008.stdout: "time": "2023-08-01T19:55:26.718770+0000", 2023-08-01T19:55:26.774 INFO:teuthology.orchestra.run.smithi008.stdout: "duration": 7.784e-05 2023-08-01T19:55:26.774 INFO:teuthology.orchestra.run.smithi008.stdout: }, 2023-08-01T19:55:26.774 INFO:teuthology.orchestra.run.smithi008.stdout: { 2023-08-01T19:55:26.774 INFO:teuthology.orchestra.run.smithi008.stdout: "event": "waiting for subops from 1", 2023-08-01T19:55:26.775 INFO:teuthology.orchestra.run.smithi008.stdout: "time": "2023-08-01T19:55:26.718833+0000", 2023-08-01T19:55:26.775 INFO:teuthology.orchestra.run.smithi008.stdout: "duration": 6.3019000000000001e-05 2023-08-01T19:55:26.775 INFO:teuthology.orchestra.run.smithi008.stdout: } 2023-08-01T19:55:26.775 INFO:teuthology.orchestra.run.smithi008.stdout: ] 2023-08-01T19:55:26.775 INFO:teuthology.orchestra.run.smithi008.stdout: } 2023-08-01T19:55:26.775 INFO:teuthology.orchestra.run.smithi008.stdout: }, 2023-08-01T19:55:26.775 INFO:teuthology.orchestra.run.smithi008.stdout: { 2023-08-01T19:55:26.775 INFO:teuthology.orchestra.run.smithi008.stdout: "description": "osd_repop(client.4668.0:136530 5.7 e46/19 5:ec3f9474:::benchmark_data_smithi006_114134_object2869:head v 46'8512, mlcod=46'8510)", 2023-08-01T19:55:26.776 INFO:teuthology.orchestra.run.smithi008.stdout: "initiated_at": "2023-08-01T19:55:26.719015+0000", 2023-08-01T19:55:26.776 INFO:teuthology.orchestra.run.smithi008.stdout: "age": 0.0019830099999999999, 2023-08-01T19:55:26.776 INFO:teuthology.orchestra.run.smithi008.stdout: "duration": 0.0023287659999999999, 2023-08-01T19:55:26.776 INFO:teuthology.orchestra.run.smithi008.stdout: "type_data": { 2023-08-01T19:55:26.776 INFO:teuthology.orchestra.run.smithi008.stdout: "flag_point": "started", 2023-08-01T19:55:26.776 INFO:teuthology.orchestra.run.smithi008.stdout: "events": [ 2023-08-01T19:55:26.776 INFO:teuthology.orchestra.run.smithi008.stdout: { 2023-08-01T19:55:26.776 INFO:teuthology.orchestra.run.smithi008.stdout: "event": "initiated", 2023-08-01T19:55:26.777 INFO:teuthology.orchestra.run.smithi008.stdout: "time": "2023-08-01T19:55:26.719015+0000", 2023-08-01T19:55:26.777 INFO:teuthology.orchestra.run.smithi008.stdout: "duration": 0 2023-08-01T19:55:26.777 INFO:teuthology.orchestra.run.smithi008.stdout: }, 2023-08-01T19:55:26.777 INFO:teuthology.orchestra.run.smithi008.stdout: { 2023-08-01T19:55:26.777 INFO:teuthology.orchestra.run.smithi008.stdout: "event": "throttled", 2023-08-01T19:55:26.777 INFO:teuthology.orchestra.run.smithi008.stdout: "time": "2023-08-01T19:55:26.719015+0000", 2023-08-01T19:55:26.777 INFO:teuthology.orchestra.run.smithi008.stdout: "duration": 0 2023-08-01T19:55:26.778 INFO:teuthology.orchestra.run.smithi008.stdout: }, 2023-08-01T19:55:26.778 INFO:teuthology.orchestra.run.smithi008.stdout: { 2023-08-01T19:55:26.778 INFO:teuthology.orchestra.run.smithi008.stdout: "event": "header_read", 2023-08-01T19:55:26.778 INFO:teuthology.orchestra.run.smithi008.stdout: "time": "2023-08-01T19:55:26.719014+0000", 2023-08-01T19:55:26.778 INFO:teuthology.orchestra.run.smithi008.stdout: "duration": 4294967295.9999995 2023-08-01T19:55:26.778 INFO:teuthology.orchestra.run.smithi008.stdout: }, 2023-08-01T19:55:26.778 INFO:teuthology.orchestra.run.smithi008.stdout: { 2023-08-01T19:55:26.778 INFO:teuthology.orchestra.run.smithi008.stdout: "event": "all_read", 2023-08-01T19:55:26.779 INFO:teuthology.orchestra.run.smithi008.stdout: "time": "2023-08-01T19:55:26.719020+0000", 2023-08-01T19:55:26.779 INFO:teuthology.orchestra.run.smithi008.stdout: "duration": 6.0839999999999997e-06 2023-08-01T19:55:26.779 INFO:teuthology.orchestra.run.smithi008.stdout: }, 2023-08-01T19:55:26.779 INFO:teuthology.orchestra.run.smithi008.stdout: { 2023-08-01T19:55:26.779 INFO:teuthology.orchestra.run.smithi008.stdout: "event": "dispatched", 2023-08-01T19:55:26.779 INFO:teuthology.orchestra.run.smithi008.stdout: "time": "2023-08-01T19:55:26.719031+0000", 2023-08-01T19:55:26.779 INFO:teuthology.orchestra.run.smithi008.stdout: "duration": 1.0958000000000001e-05 2023-08-01T19:55:26.779 INFO:teuthology.orchestra.run.smithi008.stdout: }, 2023-08-01T19:55:26.780 INFO:teuthology.orchestra.run.smithi008.stdout: { 2023-08-01T19:55:26.780 INFO:teuthology.orchestra.run.smithi008.stdout: "event": "queued_for_pg", 2023-08-01T19:55:26.780 INFO:teuthology.orchestra.run.smithi008.stdout: "time": "2023-08-01T19:55:26.719037+0000", 2023-08-01T19:55:26.780 INFO:teuthology.orchestra.run.smithi008.stdout: "duration": 5.9290000000000003e-06 2023-08-01T19:55:26.780 INFO:teuthology.orchestra.run.smithi008.stdout: }, 2023-08-01T19:55:26.780 INFO:teuthology.orchestra.run.smithi008.stdout: { 2023-08-01T19:55:26.780 INFO:teuthology.orchestra.run.smithi008.stdout: "event": "reached_pg", 2023-08-01T19:55:26.780 INFO:teuthology.orchestra.run.smithi008.stdout: "time": "2023-08-01T19:55:26.719084+0000", 2023-08-01T19:55:26.781 INFO:teuthology.orchestra.run.smithi008.stdout: "duration": 4.7311000000000002e-05 2023-08-01T19:55:26.781 INFO:teuthology.orchestra.run.smithi008.stdout: }, 2023-08-01T19:55:26.781 INFO:teuthology.orchestra.run.smithi008.stdout: { 2023-08-01T19:55:26.781 INFO:teuthology.orchestra.run.smithi008.stdout: "event": "started", 2023-08-01T19:55:26.781 INFO:teuthology.orchestra.run.smithi008.stdout: "time": "2023-08-01T19:55:26.719102+0000", 2023-08-01T19:55:26.781 INFO:teuthology.orchestra.run.smithi008.stdout: "duration": 1.7626999999999999e-05 2023-08-01T19:55:26.781 INFO:teuthology.orchestra.run.smithi008.stdout: } 2023-08-01T19:55:26.781 INFO:teuthology.orchestra.run.smithi008.stdout: ] 2023-08-01T19:55:26.782 INFO:teuthology.orchestra.run.smithi008.stdout: } 2023-08-01T19:55:26.782 INFO:teuthology.orchestra.run.smithi008.stdout: }, 2023-08-01T19:55:26.782 INFO:teuthology.orchestra.run.smithi008.stdout: { 2023-08-01T19:55:26.782 INFO:teuthology.orchestra.run.smithi008.stdout: "description": "osd_op(client.4668.0:136520 5.2 5:4b7afcb4:::benchmark_data_smithi006_114134_object2859:head [delete] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e46)", 2023-08-01T19:55:26.782 INFO:teuthology.orchestra.run.smithi008.stdout: "initiated_at": "2023-08-01T19:55:26.712979+0000", 2023-08-01T19:55:26.782 INFO:teuthology.orchestra.run.smithi008.stdout: "age": 0.0080190239999999996, 2023-08-01T19:55:26.782 INFO:teuthology.orchestra.run.smithi008.stdout: "duration": 0.0084275930000000006, 2023-08-01T19:55:26.782 INFO:teuthology.orchestra.run.smithi008.stdout: "type_data": { 2023-08-01T19:55:26.783 INFO:teuthology.orchestra.run.smithi008.stdout: "flag_point": "commit sent; apply or cleanup", 2023-08-01T19:55:26.783 INFO:teuthology.orchestra.run.smithi008.stdout: "client_info": { 2023-08-01T19:55:26.783 INFO:teuthology.orchestra.run.smithi008.stdout: "client": "client.4668", 2023-08-01T19:55:26.783 INFO:teuthology.orchestra.run.smithi008.stdout: "client_addr": "172.21.15.6:0/1709472247", 2023-08-01T19:55:26.783 INFO:teuthology.orchestra.run.smithi008.stdout: "tid": 136520 2023-08-01T19:55:26.783 INFO:teuthology.orchestra.run.smithi008.stdout: }, 2023-08-01T19:55:26.783 INFO:teuthology.orchestra.run.smithi008.stdout: "events": [ 2023-08-01T19:55:26.783 INFO:teuthology.orchestra.run.smithi008.stdout: { 2023-08-01T19:55:26.784 INFO:teuthology.orchestra.run.smithi008.stdout: "event": "initiated", 2023-08-01T19:55:26.784 INFO:teuthology.orchestra.run.smithi008.stdout: "time": "2023-08-01T19:55:26.712979+0000", 2023-08-01T19:55:26.784 INFO:teuthology.orchestra.run.smithi008.stdout: "duration": 0 2023-08-01T19:55:26.784 INFO:teuthology.orchestra.run.smithi008.stdout: }, 2023-08-01T19:55:26.784 INFO:teuthology.orchestra.run.smithi008.stdout: { 2023-08-01T19:55:26.784 INFO:teuthology.orchestra.run.smithi008.stdout: "event": "throttled", 2023-08-01T19:55:26.784 INFO:teuthology.orchestra.run.smithi008.stdout: "time": "2023-08-01T19:55:26.712979+0000", 2023-08-01T19:55:26.785 INFO:teuthology.orchestra.run.smithi008.stdout: "duration": 0 2023-08-01T19:55:26.785 INFO:teuthology.orchestra.run.smithi008.stdout: }, 2023-08-01T19:55:26.785 INFO:teuthology.orchestra.run.smithi008.stdout: { 2023-08-01T19:55:26.785 INFO:teuthology.orchestra.run.smithi008.stdout: "event": "header_read", 2023-08-01T19:55:26.785 INFO:teuthology.orchestra.run.smithi008.stdout: "time": "2023-08-01T19:55:26.712978+0000", 2023-08-01T19:55:26.785 INFO:teuthology.orchestra.run.smithi008.stdout: "duration": 4294967295.9999995 2023-08-01T19:55:26.785 INFO:teuthology.orchestra.run.smithi008.stdout: }, 2023-08-01T19:55:26.785 INFO:teuthology.orchestra.run.smithi008.stdout: { 2023-08-01T19:55:26.786 INFO:teuthology.orchestra.run.smithi008.stdout: "event": "all_read", 2023-08-01T19:55:26.786 INFO:teuthology.orchestra.run.smithi008.stdout: "time": "2023-08-01T19:55:26.712980+0000", 2023-08-01T19:55:26.786 INFO:teuthology.orchestra.run.smithi008.stdout: "duration": 2.199e-06 2023-08-01T19:55:26.786 INFO:teuthology.orchestra.run.smithi008.stdout: }, 2023-08-01T19:55:26.786 INFO:teuthology.orchestra.run.smithi008.stdout: { 2023-08-01T19:55:26.786 INFO:teuthology.orchestra.run.smithi008.stdout: "event": "dispatched", 2023-08-01T19:55:26.786 INFO:teuthology.orchestra.run.smithi008.stdout: "time": "2023-08-01T19:55:26.712986+0000", 2023-08-01T19:55:26.786 INFO:teuthology.orchestra.run.smithi008.stdout: "duration": 5.9100000000000002e-06 2023-08-01T19:55:26.787 INFO:teuthology.orchestra.run.smithi008.stdout: }, 2023-08-01T19:55:26.787 INFO:teuthology.orchestra.run.smithi008.stdout: { 2023-08-01T19:55:26.787 INFO:teuthology.orchestra.run.smithi008.stdout: "event": "queued_for_pg", 2023-08-01T19:55:26.787 INFO:teuthology.orchestra.run.smithi008.stdout: "time": "2023-08-01T19:55:26.712990+0000", 2023-08-01T19:55:26.787 INFO:teuthology.orchestra.run.smithi008.stdout: "duration": 3.7500000000000001e-06 2023-08-01T19:55:26.787 INFO:teuthology.orchestra.run.smithi008.stdout: }, 2023-08-01T19:55:26.787 INFO:teuthology.orchestra.run.smithi008.stdout: { 2023-08-01T19:55:26.787 INFO:teuthology.orchestra.run.smithi008.stdout: "event": "reached_pg", 2023-08-01T19:55:26.788 INFO:teuthology.orchestra.run.smithi008.stdout: "time": "2023-08-01T19:55:26.714826+0000", 2023-08-01T19:55:26.788 INFO:teuthology.orchestra.run.smithi008.stdout: "duration": 0.0018357149999999999 2023-08-01T19:55:26.788 INFO:teuthology.orchestra.run.smithi008.stdout: }, 2023-08-01T19:55:26.788 INFO:teuthology.orchestra.run.smithi008.stdout: { 2023-08-01T19:55:26.788 INFO:teuthology.orchestra.run.smithi008.stdout: "event": "started", 2023-08-01T19:55:26.788 INFO:teuthology.orchestra.run.smithi008.stdout: "time": "2023-08-01T19:55:26.714900+0000", 2023-08-01T19:55:26.788 INFO:teuthology.orchestra.run.smithi008.stdout: "duration": 7.4591999999999993e-05 2023-08-01T19:55:26.788 INFO:teuthology.orchestra.run.smithi008.stdout: }, 2023-08-01T19:55:26.789 INFO:teuthology.orchestra.run.smithi008.stdout: { 2023-08-01T19:55:26.789 INFO:teuthology.orchestra.run.smithi008.stdout: "event": "waiting for subops from 1", 2023-08-01T19:55:26.789 INFO:teuthology.orchestra.run.smithi008.stdout: "time": "2023-08-01T19:55:26.714962+0000", 2023-08-01T19:55:26.789 INFO:teuthology.orchestra.run.smithi008.stdout: "duration": 6.1340000000000006e-05 2023-08-01T19:55:26.789 INFO:teuthology.orchestra.run.smithi008.stdout: }, 2023-08-01T19:55:26.789 INFO:teuthology.orchestra.run.smithi008.stdout: { 2023-08-01T19:55:26.789 INFO:teuthology.orchestra.run.smithi008.stdout: "event": "sub_op_commit_rec", 2023-08-01T19:55:26.789 INFO:teuthology.orchestra.run.smithi008.stdout: "time": "2023-08-01T19:55:26.721000+0000", 2023-08-01T19:55:26.790 INFO:teuthology.orchestra.run.smithi008.stdout: "duration": 0.0060381740000000003 2023-08-01T19:55:26.790 INFO:teuthology.orchestra.run.smithi008.stdout: }, 2023-08-01T19:55:26.790 INFO:teuthology.orchestra.run.smithi008.stdout: { 2023-08-01T19:55:26.790 INFO:teuthology.orchestra.run.smithi008.stdout: "event": "op_commit", 2023-08-01T19:55:26.790 INFO:teuthology.orchestra.run.smithi008.stdout: "time": "2023-08-01T19:55:26.721349+0000", 2023-08-01T19:55:26.790 INFO:teuthology.orchestra.run.smithi008.stdout: "duration": 0.00034864 2023-08-01T19:55:26.790 INFO:teuthology.orchestra.run.smithi008.stdout: }, 2023-08-01T19:55:26.790 INFO:teuthology.orchestra.run.smithi008.stdout: { 2023-08-01T19:55:26.791 INFO:teuthology.orchestra.run.smithi008.stdout: "event": "commit_sent", 2023-08-01T19:55:26.791 INFO:teuthology.orchestra.run.smithi008.stdout: "time": "2023-08-01T19:55:26.721376+0000", 2023-08-01T19:55:26.791 INFO:teuthology.orchestra.run.smithi008.stdout: "duration": 2.7390999999999999e-05 2023-08-01T19:55:26.791 INFO:teuthology.orchestra.run.smithi008.stdout: }, 2023-08-01T19:55:26.791 INFO:teuthology.orchestra.run.smithi008.stdout: { 2023-08-01T19:55:26.791 INFO:teuthology.orchestra.run.smithi008.stdout: "event": "done", 2023-08-01T19:55:26.791 INFO:teuthology.orchestra.run.smithi008.stdout: "time": "2023-08-01T19:55:26.721406+0000", 2023-08-01T19:55:26.792 INFO:teuthology.orchestra.run.smithi008.stdout: "duration": 3.0230999999999999e-05 2023-08-01T19:55:26.792 INFO:teuthology.orchestra.run.smithi008.stdout: } 2023-08-01T19:55:26.792 INFO:teuthology.orchestra.run.smithi008.stdout: ] 2023-08-01T19:55:26.792 INFO:teuthology.orchestra.run.smithi008.stdout: } 2023-08-01T19:55:26.792 INFO:teuthology.orchestra.run.smithi008.stdout: } 2023-08-01T19:55:26.792 INFO:teuthology.orchestra.run.smithi008.stdout: ], 2023-08-01T19:55:26.792 INFO:teuthology.orchestra.run.smithi008.stdout: "num_ops": 9 2023-08-01T19:55:26.792 INFO:teuthology.orchestra.run.smithi008.stdout:} 2023-08-01T19:55:26.794 DEBUG:teuthology.orchestra.run.smithi008:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 30 ceph --cluster ceph --admin-daemon /var/run/ceph/ceph-osd.0.asok dump_blocked_ops 2023-08-01T19:55:26.794 INFO:tasks.ceph.osd.0.smithi008.stderr:2023-08-01T19:55:26.792+0000 7f16a58f4700 -1 received signal: Hangup from /usr/bin/python3 /bin/daemon-helper kill ceph-osd -f --cluster ceph -i 0 (PID: 111179) UID: 0 2023-08-01T19:55:26.882 DEBUG:teuthology.orchestra.run.smithi006:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 120 ceph --cluster ceph osd unset noscrub 2023-08-01T19:55:26.894 INFO:tasks.ceph.osd.0.smithi008.stderr:2023-08-01T19:55:26.892+0000 7f16a58f4700 -1 received signal: Hangup from /usr/bin/python3 /bin/daemon-helper kill ceph-osd -f --cluster ceph -i 0 (PID: 111179) UID: 0 2023-08-01T19:55:26.994 INFO:tasks.ceph.osd.1.smithi101.stderr:2023-08-01T19:55:26.993+0000 7fb0cb7f6700 -1 received signal: Hangup from /usr/bin/python3 /bin/daemon-helper kill ceph-osd -f --cluster ceph -i 1 (PID: 111141) UID: 0 2023-08-01T19:55:27.019 INFO:teuthology.orchestra.run.smithi008.stdout:{ 2023-08-01T19:55:27.019 INFO:teuthology.orchestra.run.smithi008.stdout: "ops": [], 2023-08-01T19:55:27.019 INFO:teuthology.orchestra.run.smithi008.stdout: "complaint_time": 30, 2023-08-01T19:55:27.020 INFO:teuthology.orchestra.run.smithi008.stdout: "num_blocked_ops": 0 2023-08-01T19:55:27.020 INFO:teuthology.orchestra.run.smithi008.stdout:} 2023-08-01T19:55:27.035 DEBUG:teuthology.orchestra.run.smithi008:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 30 ceph --cluster ceph --admin-daemon /var/run/ceph/ceph-osd.0.asok dump_historic_ops 2023-08-01T19:55:27.094 INFO:tasks.ceph.osd.1.smithi101.stderr:2023-08-01T19:55:27.093+0000 7fb0cb7f6700 -1 received signal: Hangup from /usr/bin/python3 /bin/daemon-helper kill ceph-osd -f --cluster ceph -i 1 (PID: 111141) UID: 0 2023-08-01T19:55:27.195 INFO:tasks.ceph.osd.1.smithi101.stderr:2023-08-01T19:55:27.193+0000 7fb0cb7f6700 -1 received signal: Hangup from /usr/bin/python3 /bin/daemon-helper kill ceph-osd -f --cluster ceph -i 1 (PID: 111141) UID: 0 2023-08-01T19:55:27.263 INFO:teuthology.orchestra.run.smithi008.stdout:{ 2023-08-01T19:55:27.263 INFO:teuthology.orchestra.run.smithi008.stdout: "size": 20, 2023-08-01T19:55:27.263 INFO:teuthology.orchestra.run.smithi008.stdout: "duration": 600, 2023-08-01T19:55:27.263 INFO:teuthology.orchestra.run.smithi008.stdout: "ops": [ 2023-08-01T19:55:27.264 INFO:teuthology.orchestra.run.smithi008.stdout: { 2023-08-01T19:55:27.264 INFO:teuthology.orchestra.run.smithi008.stdout: "description": "osd_op(client.4668.0:100240 5.a 5:5313c5b9:::benchmark_data_smithi006_114134_object100239:head [set-alloc-hint object_size 65536 write_size 65536,write 0~65536] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e37)", 2023-08-01T19:55:27.264 INFO:teuthology.orchestra.run.smithi008.stdout: "initiated_at": "2023-08-01T19:55:05.148399+0000", 2023-08-01T19:55:27.264 INFO:teuthology.orchestra.run.smithi008.stdout: "age": 22.111347155000001, 2023-08-01T19:55:27.264 INFO:teuthology.orchestra.run.smithi008.stdout: "duration": 0.077278904999999995, 2023-08-01T19:55:27.264 INFO:teuthology.orchestra.run.smithi008.stdout: "type_data": { 2023-08-01T19:55:27.264 INFO:teuthology.orchestra.run.smithi008.stdout: "flag_point": "commit sent; apply or cleanup", 2023-08-01T19:55:27.265 INFO:teuthology.orchestra.run.smithi008.stdout: "client_info": { 2023-08-01T19:55:27.265 INFO:teuthology.orchestra.run.smithi008.stdout: "client": "client.4668", 2023-08-01T19:55:27.265 INFO:teuthology.orchestra.run.smithi008.stdout: "client_addr": "172.21.15.6:0/1709472247", 2023-08-01T19:55:27.265 INFO:teuthology.orchestra.run.smithi008.stdout: "tid": 100240 2023-08-01T19:55:27.265 INFO:teuthology.orchestra.run.smithi008.stdout: }, 2023-08-01T19:55:27.265 INFO:teuthology.orchestra.run.smithi008.stdout: "events": [ 2023-08-01T19:55:27.265 INFO:teuthology.orchestra.run.smithi008.stdout: { 2023-08-01T19:55:27.265 INFO:teuthology.orchestra.run.smithi008.stdout: "event": "initiated", 2023-08-01T19:55:27.266 INFO:teuthology.orchestra.run.smithi008.stdout: "time": "2023-08-01T19:55:05.148399+0000", 2023-08-01T19:55:27.266 INFO:teuthology.orchestra.run.smithi008.stdout: "duration": 0 2023-08-01T19:55:27.266 INFO:teuthology.orchestra.run.smithi008.stdout: }, 2023-08-01T19:55:27.266 INFO:teuthology.orchestra.run.smithi008.stdout: { 2023-08-01T19:55:27.266 INFO:teuthology.orchestra.run.smithi008.stdout: "event": "throttled", 2023-08-01T19:55:27.266 INFO:teuthology.orchestra.run.smithi008.stdout: "time": "2023-08-01T19:55:05.148399+0000", 2023-08-01T19:55:27.266 INFO:teuthology.orchestra.run.smithi008.stdout: "duration": 0 2023-08-01T19:55:27.267 INFO:teuthology.orchestra.run.smithi008.stdout: }, 2023-08-01T19:55:27.267 INFO:teuthology.orchestra.run.smithi008.stdout: { 2023-08-01T19:55:27.267 INFO:teuthology.orchestra.run.smithi008.stdout: "event": "header_read", 2023-08-01T19:55:27.267 INFO:teuthology.orchestra.run.smithi008.stdout: "time": "2023-08-01T19:55:05.148398+0000", 2023-08-01T19:55:27.267 INFO:teuthology.orchestra.run.smithi008.stdout: "duration": 4294967295.999999 2023-08-01T19:55:27.267 INFO:teuthology.orchestra.run.smithi008.stdout: }, 2023-08-01T19:55:27.267 INFO:teuthology.orchestra.run.smithi008.stdout: { 2023-08-01T19:55:27.267 INFO:teuthology.orchestra.run.smithi008.stdout: "event": "all_read", 2023-08-01T19:55:27.268 INFO:teuthology.orchestra.run.smithi008.stdout: "time": "2023-08-01T19:55:05.148492+0000", 2023-08-01T19:55:27.268 INFO:teuthology.orchestra.run.smithi008.stdout: "duration": 9.3892000000000002e-05 2023-08-01T19:55:27.268 INFO:teuthology.orchestra.run.smithi008.stdout: }, 2023-08-01T19:55:27.268 INFO:teuthology.orchestra.run.smithi008.stdout: { 2023-08-01T19:55:27.268 INFO:teuthology.orchestra.run.smithi008.stdout: "event": "dispatched", 2023-08-01T19:55:27.268 INFO:teuthology.orchestra.run.smithi008.stdout: "time": "2023-08-01T19:55:05.148503+0000", 2023-08-01T19:55:27.268 INFO:teuthology.orchestra.run.smithi008.stdout: "duration": 1.0951000000000001e-05 2023-08-01T19:55:27.268 INFO:teuthology.orchestra.run.smithi008.stdout: }, 2023-08-01T19:55:27.269 INFO:teuthology.orchestra.run.smithi008.stdout: { 2023-08-01T19:55:27.269 INFO:teuthology.orchestra.run.smithi008.stdout: "event": "queued_for_pg", 2023-08-01T19:55:27.269 INFO:teuthology.orchestra.run.smithi008.stdout: "time": "2023-08-01T19:55:05.148508+0000", 2023-08-01T19:55:27.269 INFO:teuthology.orchestra.run.smithi008.stdout: "duration": 5.0080000000000002e-06 2023-08-01T19:55:27.269 INFO:teuthology.orchestra.run.smithi008.stdout: }, 2023-08-01T19:55:27.269 INFO:teuthology.orchestra.run.smithi008.stdout: { 2023-08-01T19:55:27.269 INFO:teuthology.orchestra.run.smithi008.stdout: "event": "reached_pg", 2023-08-01T19:55:27.270 INFO:teuthology.orchestra.run.smithi008.stdout: "time": "2023-08-01T19:55:05.148548+0000", 2023-08-01T19:55:27.270 INFO:teuthology.orchestra.run.smithi008.stdout: "duration": 4.0358999999999998e-05 2023-08-01T19:55:27.270 INFO:teuthology.orchestra.run.smithi008.stdout: }, 2023-08-01T19:55:27.270 INFO:teuthology.orchestra.run.smithi008.stdout: { 2023-08-01T19:55:27.270 INFO:teuthology.orchestra.run.smithi008.stdout: "event": "started", 2023-08-01T19:55:27.270 INFO:teuthology.orchestra.run.smithi008.stdout: "time": "2023-08-01T19:55:05.148666+0000", 2023-08-01T19:55:27.270 INFO:teuthology.orchestra.run.smithi008.stdout: "duration": 0.000117621 2023-08-01T19:55:27.270 INFO:teuthology.orchestra.run.smithi008.stdout: }, 2023-08-01T19:55:27.271 INFO:teuthology.orchestra.run.smithi008.stdout: { 2023-08-01T19:55:27.271 INFO:teuthology.orchestra.run.smithi008.stdout: "event": "waiting for subops from 2", 2023-08-01T19:55:27.271 INFO:teuthology.orchestra.run.smithi008.stdout: "time": "2023-08-01T19:55:05.148805+0000", 2023-08-01T19:55:27.271 INFO:teuthology.orchestra.run.smithi008.stdout: "duration": 0.000139176 2023-08-01T19:55:27.271 INFO:teuthology.orchestra.run.smithi008.stdout: }, 2023-08-01T19:55:27.271 INFO:teuthology.orchestra.run.smithi008.stdout: { 2023-08-01T19:55:27.271 INFO:teuthology.orchestra.run.smithi008.stdout: "event": "op_commit", 2023-08-01T19:55:27.271 INFO:teuthology.orchestra.run.smithi008.stdout: "time": "2023-08-01T19:55:05.156143+0000", 2023-08-01T19:55:27.272 INFO:teuthology.orchestra.run.smithi008.stdout: "duration": 0.007338041 2023-08-01T19:55:27.272 INFO:teuthology.orchestra.run.smithi008.stdout: }, 2023-08-01T19:55:27.272 INFO:teuthology.orchestra.run.smithi008.stdout: { 2023-08-01T19:55:27.272 INFO:teuthology.orchestra.run.smithi008.stdout: "event": "sub_op_commit_rec", 2023-08-01T19:55:27.272 INFO:teuthology.orchestra.run.smithi008.stdout: "time": "2023-08-01T19:55:05.225581+0000", 2023-08-01T19:55:27.272 INFO:teuthology.orchestra.run.smithi008.stdout: "duration": 0.069438402999999996 2023-08-01T19:55:27.272 INFO:teuthology.orchestra.run.smithi008.stdout: }, 2023-08-01T19:55:27.273 INFO:teuthology.orchestra.run.smithi008.stdout: { 2023-08-01T19:55:27.273 INFO:teuthology.orchestra.run.smithi008.stdout: "event": "commit_sent", 2023-08-01T19:55:27.273 INFO:teuthology.orchestra.run.smithi008.stdout: "time": "2023-08-01T19:55:05.225632+0000", 2023-08-01T19:55:27.273 INFO:teuthology.orchestra.run.smithi008.stdout: "duration": 5.0382e-05 2023-08-01T19:55:27.273 INFO:teuthology.orchestra.run.smithi008.stdout: }, 2023-08-01T19:55:27.273 INFO:teuthology.orchestra.run.smithi008.stdout: { 2023-08-01T19:55:27.273 INFO:teuthology.orchestra.run.smithi008.stdout: "event": "done", 2023-08-01T19:55:27.273 INFO:teuthology.orchestra.run.smithi008.stdout: "time": "2023-08-01T19:55:05.225677+0000", 2023-08-01T19:55:27.274 INFO:teuthology.orchestra.run.smithi008.stdout: "duration": 4.5893000000000003e-05 2023-08-01T19:55:27.274 INFO:teuthology.orchestra.run.smithi008.stdout: } 2023-08-01T19:55:27.274 INFO:teuthology.orchestra.run.smithi008.stdout: ] 2023-08-01T19:55:27.274 INFO:teuthology.orchestra.run.smithi008.stdout: } 2023-08-01T19:55:27.274 INFO:teuthology.orchestra.run.smithi008.stdout: }, 2023-08-01T19:55:27.274 INFO:teuthology.orchestra.run.smithi008.stdout: { 2023-08-01T19:55:27.274 INFO:teuthology.orchestra.run.smithi008.stdout: "description": "osd_op(client.4668.0:100243 5.a 5:5e8193b6:::benchmark_data_smithi006_114134_object100242:head [set-alloc-hint object_size 65536 write_size 65536,write 0~65536] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e37)", 2023-08-01T19:55:27.274 INFO:teuthology.orchestra.run.smithi008.stdout: "initiated_at": "2023-08-01T19:55:05.150737+0000", 2023-08-01T19:55:27.275 INFO:teuthology.orchestra.run.smithi008.stdout: "age": 22.1090087, 2023-08-01T19:55:27.275 INFO:teuthology.orchestra.run.smithi008.stdout: "duration": 0.075019885999999994, 2023-08-01T19:55:27.275 INFO:teuthology.orchestra.run.smithi008.stdout: "type_data": { 2023-08-01T19:55:27.275 INFO:teuthology.orchestra.run.smithi008.stdout: "flag_point": "commit sent; apply or cleanup", 2023-08-01T19:55:27.275 INFO:teuthology.orchestra.run.smithi008.stdout: "client_info": { 2023-08-01T19:55:27.275 INFO:teuthology.orchestra.run.smithi008.stdout: "client": "client.4668", 2023-08-01T19:55:27.275 INFO:teuthology.orchestra.run.smithi008.stdout: "client_addr": "172.21.15.6:0/1709472247", 2023-08-01T19:55:27.275 INFO:teuthology.orchestra.run.smithi008.stdout: "tid": 100243 2023-08-01T19:55:27.276 INFO:teuthology.orchestra.run.smithi008.stdout: }, 2023-08-01T19:55:27.276 INFO:teuthology.orchestra.run.smithi008.stdout: "events": [ 2023-08-01T19:55:27.276 INFO:teuthology.orchestra.run.smithi008.stdout: { 2023-08-01T19:55:27.276 INFO:teuthology.orchestra.run.smithi008.stdout: "event": "initiated", 2023-08-01T19:55:27.276 INFO:teuthology.orchestra.run.smithi008.stdout: "time": "2023-08-01T19:55:05.150737+0000", 2023-08-01T19:55:27.276 INFO:teuthology.orchestra.run.smithi008.stdout: "duration": 0 2023-08-01T19:55:27.276 INFO:teuthology.orchestra.run.smithi008.stdout: }, 2023-08-01T19:55:27.276 INFO:teuthology.orchestra.run.smithi008.stdout: { 2023-08-01T19:55:27.277 INFO:teuthology.orchestra.run.smithi008.stdout: "event": "throttled", 2023-08-01T19:55:27.277 INFO:teuthology.orchestra.run.smithi008.stdout: "time": "2023-08-01T19:55:05.150737+0000", 2023-08-01T19:55:27.277 INFO:teuthology.orchestra.run.smithi008.stdout: "duration": 0 2023-08-01T19:55:27.277 INFO:teuthology.orchestra.run.smithi008.stdout: }, 2023-08-01T19:55:27.277 INFO:teuthology.orchestra.run.smithi008.stdout: { 2023-08-01T19:55:27.277 INFO:teuthology.orchestra.run.smithi008.stdout: "event": "header_read", 2023-08-01T19:55:27.277 INFO:teuthology.orchestra.run.smithi008.stdout: "time": "2023-08-01T19:55:05.150736+0000", 2023-08-01T19:55:27.277 INFO:teuthology.orchestra.run.smithi008.stdout: "duration": 4294967295.999999 2023-08-01T19:55:27.278 INFO:teuthology.orchestra.run.smithi008.stdout: }, 2023-08-01T19:55:27.278 INFO:teuthology.orchestra.run.smithi008.stdout: { 2023-08-01T19:55:27.278 INFO:teuthology.orchestra.run.smithi008.stdout: "event": "all_read", 2023-08-01T19:55:27.278 INFO:teuthology.orchestra.run.smithi008.stdout: "time": "2023-08-01T19:55:05.150780+0000", 2023-08-01T19:55:27.278 INFO:teuthology.orchestra.run.smithi008.stdout: "duration": 4.3578999999999997e-05 2023-08-01T19:55:27.278 INFO:teuthology.orchestra.run.smithi008.stdout: }, 2023-08-01T19:55:27.278 INFO:teuthology.orchestra.run.smithi008.stdout: { 2023-08-01T19:55:27.279 INFO:teuthology.orchestra.run.smithi008.stdout: "event": "dispatched", 2023-08-01T19:55:27.279 INFO:teuthology.orchestra.run.smithi008.stdout: "time": "2023-08-01T19:55:05.150791+0000", 2023-08-01T19:55:27.279 INFO:teuthology.orchestra.run.smithi008.stdout: "duration": 1.0963e-05 2023-08-01T19:55:27.279 INFO:teuthology.orchestra.run.smithi008.stdout: }, 2023-08-01T19:55:27.279 INFO:teuthology.orchestra.run.smithi008.stdout: { 2023-08-01T19:55:27.279 INFO:teuthology.orchestra.run.smithi008.stdout: "event": "queued_for_pg", 2023-08-01T19:55:27.279 INFO:teuthology.orchestra.run.smithi008.stdout: "time": "2023-08-01T19:55:05.150797+0000", 2023-08-01T19:55:27.279 INFO:teuthology.orchestra.run.smithi008.stdout: "duration": 5.9780000000000002e-06 2023-08-01T19:55:27.280 INFO:teuthology.orchestra.run.smithi008.stdout: }, 2023-08-01T19:55:27.280 INFO:teuthology.orchestra.run.smithi008.stdout: { 2023-08-01T19:55:27.280 INFO:teuthology.orchestra.run.smithi008.stdout: "event": "reached_pg", 2023-08-01T19:55:27.280 INFO:teuthology.orchestra.run.smithi008.stdout: "time": "2023-08-01T19:55:05.150833+0000", 2023-08-01T19:55:27.280 INFO:teuthology.orchestra.run.smithi008.stdout: "duration": 3.6000000000000001e-05 2023-08-01T19:55:27.280 INFO:teuthology.orchestra.run.smithi008.stdout: }, 2023-08-01T19:55:27.280 INFO:teuthology.orchestra.run.smithi008.stdout: { 2023-08-01T19:55:27.281 INFO:teuthology.orchestra.run.smithi008.stdout: "event": "started", 2023-08-01T19:55:27.281 INFO:teuthology.orchestra.run.smithi008.stdout: "time": "2023-08-01T19:55:05.150951+0000", 2023-08-01T19:55:27.281 INFO:teuthology.orchestra.run.smithi008.stdout: "duration": 0.00011827799999999999 2023-08-01T19:55:27.281 INFO:teuthology.orchestra.run.smithi008.stdout: }, 2023-08-01T19:55:27.281 INFO:teuthology.orchestra.run.smithi008.stdout: { 2023-08-01T19:55:27.281 INFO:teuthology.orchestra.run.smithi008.stdout: "event": "waiting for subops from 2", 2023-08-01T19:55:27.281 INFO:teuthology.orchestra.run.smithi008.stdout: "time": "2023-08-01T19:55:05.151111+0000", 2023-08-01T19:55:27.281 INFO:teuthology.orchestra.run.smithi008.stdout: "duration": 0.00015961299999999999 2023-08-01T19:55:27.282 INFO:teuthology.orchestra.run.smithi008.stdout: }, 2023-08-01T19:55:27.282 INFO:teuthology.orchestra.run.smithi008.stdout: { 2023-08-01T19:55:27.282 INFO:teuthology.orchestra.run.smithi008.stdout: "event": "op_commit", 2023-08-01T19:55:27.282 INFO:teuthology.orchestra.run.smithi008.stdout: "time": "2023-08-01T19:55:05.156247+0000", 2023-08-01T19:55:27.282 INFO:teuthology.orchestra.run.smithi008.stdout: "duration": 0.005136524 2023-08-01T19:55:27.282 INFO:teuthology.orchestra.run.smithi008.stdout: }, 2023-08-01T19:55:27.282 INFO:teuthology.orchestra.run.smithi008.stdout: { 2023-08-01T19:55:27.282 INFO:teuthology.orchestra.run.smithi008.stdout: "event": "sub_op_commit_rec", 2023-08-01T19:55:27.283 INFO:teuthology.orchestra.run.smithi008.stdout: "time": "2023-08-01T19:55:05.225705+0000", 2023-08-01T19:55:27.283 INFO:teuthology.orchestra.run.smithi008.stdout: "duration": 0.069458377000000002 2023-08-01T19:55:27.283 INFO:teuthology.orchestra.run.smithi008.stdout: }, 2023-08-01T19:55:27.283 INFO:teuthology.orchestra.run.smithi008.stdout: { 2023-08-01T19:55:27.283 INFO:teuthology.orchestra.run.smithi008.stdout: "event": "commit_sent", 2023-08-01T19:55:27.283 INFO:teuthology.orchestra.run.smithi008.stdout: "time": "2023-08-01T19:55:05.225736+0000", 2023-08-01T19:55:27.283 INFO:teuthology.orchestra.run.smithi008.stdout: "duration": 3.0388000000000001e-05 2023-08-01T19:55:27.283 INFO:teuthology.orchestra.run.smithi008.stdout: }, 2023-08-01T19:55:27.284 INFO:teuthology.orchestra.run.smithi008.stdout: { 2023-08-01T19:55:27.284 INFO:teuthology.orchestra.run.smithi008.stdout: "event": "done", 2023-08-01T19:55:27.284 INFO:teuthology.orchestra.run.smithi008.stdout: "time": "2023-08-01T19:55:05.225757+0000", 2023-08-01T19:55:27.284 INFO:teuthology.orchestra.run.smithi008.stdout: "duration": 2.1090999999999998e-05 2023-08-01T19:55:27.284 INFO:teuthology.orchestra.run.smithi008.stdout: } 2023-08-01T19:55:27.284 INFO:teuthology.orchestra.run.smithi008.stdout: ] 2023-08-01T19:55:27.284 INFO:teuthology.orchestra.run.smithi008.stdout: } 2023-08-01T19:55:27.284 INFO:teuthology.orchestra.run.smithi008.stdout: }, 2023-08-01T19:55:27.285 INFO:teuthology.orchestra.run.smithi008.stdout: { 2023-08-01T19:55:27.285 INFO:teuthology.orchestra.run.smithi008.stdout: "description": "osd_op(client.4668.0:100261 5.a 5:562deedb:::benchmark_data_smithi006_114134_object100260:head [set-alloc-hint object_size 65536 write_size 65536,write 0~65536] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e37)", 2023-08-01T19:55:27.285 INFO:teuthology.orchestra.run.smithi008.stdout: "initiated_at": "2023-08-01T19:55:05.163316+0000", 2023-08-01T19:55:27.285 INFO:teuthology.orchestra.run.smithi008.stdout: "age": 22.096429283999999, 2023-08-01T19:55:27.285 INFO:teuthology.orchestra.run.smithi008.stdout: "duration": 0.063073012999999997, 2023-08-01T19:55:27.285 INFO:teuthology.orchestra.run.smithi008.stdout: "type_data": { 2023-08-01T19:55:27.285 INFO:teuthology.orchestra.run.smithi008.stdout: "flag_point": "commit sent; apply or cleanup", 2023-08-01T19:55:27.286 INFO:teuthology.orchestra.run.smithi008.stdout: "client_info": { 2023-08-01T19:55:27.286 INFO:teuthology.orchestra.run.smithi008.stdout: "client": "client.4668", 2023-08-01T19:55:27.286 INFO:teuthology.orchestra.run.smithi008.stdout: "client_addr": "172.21.15.6:0/1709472247", 2023-08-01T19:55:27.286 INFO:teuthology.orchestra.run.smithi008.stdout: "tid": 100261 2023-08-01T19:55:27.286 INFO:teuthology.orchestra.run.smithi008.stdout: }, 2023-08-01T19:55:27.286 INFO:teuthology.orchestra.run.smithi008.stdout: "events": [ 2023-08-01T19:55:27.286 INFO:teuthology.orchestra.run.smithi008.stdout: { 2023-08-01T19:55:27.286 INFO:teuthology.orchestra.run.smithi008.stdout: "event": "initiated", 2023-08-01T19:55:27.287 INFO:teuthology.orchestra.run.smithi008.stdout: "time": "2023-08-01T19:55:05.163316+0000", 2023-08-01T19:55:27.287 INFO:teuthology.orchestra.run.smithi008.stdout: "duration": 0 2023-08-01T19:55:27.287 INFO:teuthology.orchestra.run.smithi008.stdout: }, 2023-08-01T19:55:27.287 INFO:teuthology.orchestra.run.smithi008.stdout: { 2023-08-01T19:55:27.287 INFO:teuthology.orchestra.run.smithi008.stdout: "event": "throttled", 2023-08-01T19:55:27.287 INFO:teuthology.orchestra.run.smithi008.stdout: "time": "2023-08-01T19:55:05.163316+0000", 2023-08-01T19:55:27.287 INFO:teuthology.orchestra.run.smithi008.stdout: "duration": 0 2023-08-01T19:55:27.288 INFO:teuthology.orchestra.run.smithi008.stdout: }, 2023-08-01T19:55:27.288 INFO:teuthology.orchestra.run.smithi008.stdout: { 2023-08-01T19:55:27.288 INFO:teuthology.orchestra.run.smithi008.stdout: "event": "header_read", 2023-08-01T19:55:27.288 INFO:teuthology.orchestra.run.smithi008.stdout: "time": "2023-08-01T19:55:05.163316+0000", 2023-08-01T19:55:27.288 INFO:teuthology.orchestra.run.smithi008.stdout: "duration": 4294967295.999999 2023-08-01T19:55:27.288 INFO:teuthology.orchestra.run.smithi008.stdout: }, 2023-08-01T19:55:27.288 INFO:teuthology.orchestra.run.smithi008.stdout: { 2023-08-01T19:55:27.289 INFO:teuthology.orchestra.run.smithi008.stdout: "event": "all_read", 2023-08-01T19:55:27.289 INFO:teuthology.orchestra.run.smithi008.stdout: "time": "2023-08-01T19:55:05.163380+0000", 2023-08-01T19:55:27.289 INFO:teuthology.orchestra.run.smithi008.stdout: "duration": 6.4395999999999998e-05 2023-08-01T19:55:27.289 INFO:teuthology.orchestra.run.smithi008.stdout: }, 2023-08-01T19:55:27.289 INFO:teuthology.orchestra.run.smithi008.stdout: { 2023-08-01T19:55:27.289 INFO:teuthology.orchestra.run.smithi008.stdout: "event": "dispatched", 2023-08-01T19:55:27.289 INFO:teuthology.orchestra.run.smithi008.stdout: "time": "2023-08-01T19:55:05.163390+0000", 2023-08-01T19:55:27.289 INFO:teuthology.orchestra.run.smithi008.stdout: "duration": 1.0189e-05 2023-08-01T19:55:27.290 INFO:teuthology.orchestra.run.smithi008.stdout: }, 2023-08-01T19:55:27.290 INFO:teuthology.orchestra.run.smithi008.stdout: { 2023-08-01T19:55:27.290 INFO:teuthology.orchestra.run.smithi008.stdout: "event": "queued_for_pg", 2023-08-01T19:55:27.290 INFO:teuthology.orchestra.run.smithi008.stdout: "time": "2023-08-01T19:55:05.163395+0000", 2023-08-01T19:55:27.290 INFO:teuthology.orchestra.run.smithi008.stdout: "duration": 4.4059999999999998e-06 2023-08-01T19:55:27.290 INFO:teuthology.orchestra.run.smithi008.stdout: }, 2023-08-01T19:55:27.290 INFO:teuthology.orchestra.run.smithi008.stdout: { 2023-08-01T19:55:27.291 INFO:teuthology.orchestra.run.smithi008.stdout: "event": "reached_pg", 2023-08-01T19:55:27.291 INFO:teuthology.orchestra.run.smithi008.stdout: "time": "2023-08-01T19:55:05.163429+0000", 2023-08-01T19:55:27.291 INFO:teuthology.orchestra.run.smithi008.stdout: "duration": 3.4900000000000001e-05 2023-08-01T19:55:27.291 INFO:teuthology.orchestra.run.smithi008.stdout: }, 2023-08-01T19:55:27.291 INFO:teuthology.orchestra.run.smithi008.stdout: { 2023-08-01T19:55:27.291 INFO:teuthology.orchestra.run.smithi008.stdout: "event": "started", 2023-08-01T19:55:27.291 INFO:teuthology.orchestra.run.smithi008.stdout: "time": "2023-08-01T19:55:05.163512+0000", 2023-08-01T19:55:27.291 INFO:teuthology.orchestra.run.smithi008.stdout: "duration": 8.2987999999999999e-05 2023-08-01T19:55:27.292 INFO:teuthology.orchestra.run.smithi008.stdout: }, 2023-08-01T19:55:27.292 INFO:teuthology.orchestra.run.smithi008.stdout: { 2023-08-01T19:55:27.292 INFO:teuthology.orchestra.run.smithi008.stdout: "event": "waiting for subops from 2", 2023-08-01T19:55:27.292 INFO:teuthology.orchestra.run.smithi008.stdout: "time": "2023-08-01T19:55:05.163596+0000", 2023-08-01T19:55:27.292 INFO:teuthology.orchestra.run.smithi008.stdout: "duration": 8.3783999999999996e-05 2023-08-01T19:55:27.292 INFO:teuthology.orchestra.run.smithi008.stdout: }, 2023-08-01T19:55:27.292 INFO:teuthology.orchestra.run.smithi008.stdout: { 2023-08-01T19:55:27.292 INFO:teuthology.orchestra.run.smithi008.stdout: "event": "op_commit", 2023-08-01T19:55:27.293 INFO:teuthology.orchestra.run.smithi008.stdout: "time": "2023-08-01T19:55:05.167129+0000", 2023-08-01T19:55:27.293 INFO:teuthology.orchestra.run.smithi008.stdout: "duration": 0.0035328709999999999 2023-08-01T19:55:27.293 INFO:teuthology.orchestra.run.smithi008.stdout: }, 2023-08-01T19:55:27.293 INFO:teuthology.orchestra.run.smithi008.stdout: { 2023-08-01T19:55:27.293 INFO:teuthology.orchestra.run.smithi008.stdout: "event": "sub_op_commit_rec", 2023-08-01T19:55:27.293 INFO:teuthology.orchestra.run.smithi008.stdout: "time": "2023-08-01T19:55:05.226302+0000", 2023-08-01T19:55:27.293 INFO:teuthology.orchestra.run.smithi008.stdout: "duration": 0.059172711000000003 2023-08-01T19:55:27.294 INFO:teuthology.orchestra.run.smithi008.stdout: }, 2023-08-01T19:55:27.294 INFO:teuthology.orchestra.run.smithi008.stdout: { 2023-08-01T19:55:27.294 INFO:teuthology.orchestra.run.smithi008.stdout: "event": "commit_sent", 2023-08-01T19:55:27.294 INFO:teuthology.orchestra.run.smithi008.stdout: "time": "2023-08-01T19:55:05.226351+0000", 2023-08-01T19:55:27.294 INFO:teuthology.orchestra.run.smithi008.stdout: "duration": 4.969e-05 2023-08-01T19:55:27.294 INFO:teuthology.orchestra.run.smithi008.stdout: }, 2023-08-01T19:55:27.294 INFO:teuthology.orchestra.run.smithi008.stdout: { 2023-08-01T19:55:27.294 INFO:teuthology.orchestra.run.smithi008.stdout: "event": "done", 2023-08-01T19:55:27.295 INFO:teuthology.orchestra.run.smithi008.stdout: "time": "2023-08-01T19:55:05.226389+0000", 2023-08-01T19:55:27.295 INFO:teuthology.orchestra.run.smithi008.stdout: "duration": 3.7978000000000001e-05 2023-08-01T19:55:27.295 INFO:teuthology.orchestra.run.smithi008.stdout: } 2023-08-01T19:55:27.295 INFO:teuthology.orchestra.run.smithi008.stdout: ] 2023-08-01T19:55:27.295 INFO:teuthology.orchestra.run.smithi008.stdout: } 2023-08-01T19:55:27.295 INFO:teuthology.orchestra.run.smithi008.stdout: }, 2023-08-01T19:55:27.295 INFO:teuthology.orchestra.run.smithi008.stdout: { 2023-08-01T19:55:27.295 INFO:teuthology.orchestra.run.smithi008.stdout: "description": "osd_op(client.4668.0:100262 5.a 5:5c636b5d:::benchmark_data_smithi006_114134_object100261:head [set-alloc-hint object_size 65536 write_size 65536,write 0~65536] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e37)", 2023-08-01T19:55:27.296 INFO:teuthology.orchestra.run.smithi008.stdout: "initiated_at": "2023-08-01T19:55:05.165068+0000", 2023-08-01T19:55:27.296 INFO:teuthology.orchestra.run.smithi008.stdout: "age": 22.094677631, 2023-08-01T19:55:27.296 INFO:teuthology.orchestra.run.smithi008.stdout: "duration": 0.063919403, 2023-08-01T19:55:27.296 INFO:teuthology.orchestra.run.smithi008.stdout: "type_data": { 2023-08-01T19:55:27.296 INFO:teuthology.orchestra.run.smithi008.stdout: "flag_point": "commit sent; apply or cleanup", 2023-08-01T19:55:27.296 INFO:teuthology.orchestra.run.smithi008.stdout: "client_info": { 2023-08-01T19:55:27.296 INFO:teuthology.orchestra.run.smithi008.stdout: "client": "client.4668", 2023-08-01T19:55:27.297 INFO:teuthology.orchestra.run.smithi008.stdout: "client_addr": "172.21.15.6:0/1709472247", 2023-08-01T19:55:27.297 INFO:teuthology.orchestra.run.smithi008.stdout: "tid": 100262 2023-08-01T19:55:27.297 INFO:teuthology.orchestra.run.smithi008.stdout: }, 2023-08-01T19:55:27.297 INFO:teuthology.orchestra.run.smithi008.stdout: "events": [ 2023-08-01T19:55:27.297 INFO:teuthology.orchestra.run.smithi008.stdout: { 2023-08-01T19:55:27.297 INFO:teuthology.orchestra.run.smithi008.stdout: "event": "initiated", 2023-08-01T19:55:27.297 INFO:teuthology.orchestra.run.smithi008.stdout: "time": "2023-08-01T19:55:05.165068+0000", 2023-08-01T19:55:27.298 INFO:teuthology.orchestra.run.smithi008.stdout: "duration": 0 2023-08-01T19:55:27.298 INFO:teuthology.orchestra.run.smithi008.stdout: }, 2023-08-01T19:55:27.298 INFO:teuthology.orchestra.run.smithi008.stdout: { 2023-08-01T19:55:27.298 INFO:teuthology.orchestra.run.smithi008.stdout: "event": "throttled", 2023-08-01T19:55:27.298 INFO:teuthology.orchestra.run.smithi008.stdout: "time": "2023-08-01T19:55:05.165068+0000", 2023-08-01T19:55:27.298 INFO:teuthology.orchestra.run.smithi008.stdout: "duration": 0 2023-08-01T19:55:27.298 INFO:teuthology.orchestra.run.smithi008.stdout: }, 2023-08-01T19:55:27.298 INFO:teuthology.orchestra.run.smithi008.stdout: { 2023-08-01T19:55:27.299 INFO:teuthology.orchestra.run.smithi008.stdout: "event": "header_read", 2023-08-01T19:55:27.299 INFO:teuthology.orchestra.run.smithi008.stdout: "time": "2023-08-01T19:55:05.165067+0000", 2023-08-01T19:55:27.299 INFO:teuthology.orchestra.run.smithi008.stdout: "duration": 4294967295.999999 2023-08-01T19:55:27.299 INFO:teuthology.orchestra.run.smithi008.stdout: }, 2023-08-01T19:55:27.299 INFO:teuthology.orchestra.run.smithi008.stdout: { 2023-08-01T19:55:27.299 INFO:teuthology.orchestra.run.smithi008.stdout: "event": "all_read", 2023-08-01T19:55:27.299 INFO:teuthology.orchestra.run.smithi008.stdout: "time": "2023-08-01T19:55:05.165126+0000", 2023-08-01T19:55:27.299 INFO:teuthology.orchestra.run.smithi008.stdout: "duration": 5.9116000000000001e-05 2023-08-01T19:55:27.300 INFO:teuthology.orchestra.run.smithi008.stdout: }, 2023-08-01T19:55:27.300 INFO:teuthology.orchestra.run.smithi008.stdout: { 2023-08-01T19:55:27.300 INFO:teuthology.orchestra.run.smithi008.stdout: "event": "dispatched", 2023-08-01T19:55:27.300 INFO:teuthology.orchestra.run.smithi008.stdout: "time": "2023-08-01T19:55:05.165134+0000", 2023-08-01T19:55:27.300 INFO:teuthology.orchestra.run.smithi008.stdout: "duration": 7.9820000000000008e-06 2023-08-01T19:55:27.300 INFO:teuthology.orchestra.run.smithi008.stdout: }, 2023-08-01T19:55:27.300 INFO:teuthology.orchestra.run.smithi008.stdout: { 2023-08-01T19:55:27.301 INFO:teuthology.orchestra.run.smithi008.stdout: "event": "queued_for_pg", 2023-08-01T19:55:27.301 INFO:teuthology.orchestra.run.smithi008.stdout: "time": "2023-08-01T19:55:05.165139+0000", 2023-08-01T19:55:27.301 INFO:teuthology.orchestra.run.smithi008.stdout: "duration": 4.2560000000000004e-06 2023-08-01T19:55:27.301 INFO:teuthology.orchestra.run.smithi008.stdout: }, 2023-08-01T19:55:27.301 INFO:teuthology.orchestra.run.smithi008.stdout: { 2023-08-01T19:55:27.301 INFO:teuthology.orchestra.run.smithi008.stdout: "event": "reached_pg", 2023-08-01T19:55:27.301 INFO:teuthology.orchestra.run.smithi008.stdout: "time": "2023-08-01T19:55:05.165165+0000", 2023-08-01T19:55:27.302 INFO:teuthology.orchestra.run.smithi008.stdout: "duration": 2.6554e-05 2023-08-01T19:55:27.302 INFO:teuthology.orchestra.run.smithi008.stdout: }, 2023-08-01T19:55:27.302 INFO:teuthology.orchestra.run.smithi008.stdout: { 2023-08-01T19:55:27.302 INFO:teuthology.orchestra.run.smithi008.stdout: "event": "started", 2023-08-01T19:55:27.302 INFO:teuthology.orchestra.run.smithi008.stdout: "time": "2023-08-01T19:55:05.165243+0000", 2023-08-01T19:55:27.302 INFO:teuthology.orchestra.run.smithi008.stdout: "duration": 7.7877e-05 2023-08-01T19:55:27.302 INFO:teuthology.orchestra.run.smithi008.stdout: }, 2023-08-01T19:55:27.302 INFO:teuthology.orchestra.run.smithi008.stdout: { 2023-08-01T19:55:27.303 INFO:teuthology.orchestra.run.smithi008.stdout: "event": "waiting for subops from 2", 2023-08-01T19:55:27.303 INFO:teuthology.orchestra.run.smithi008.stdout: "time": "2023-08-01T19:55:05.165450+0000", 2023-08-01T19:55:27.303 INFO:teuthology.orchestra.run.smithi008.stdout: "duration": 0.00020655599999999999 2023-08-01T19:55:27.303 INFO:teuthology.orchestra.run.smithi008.stdout: }, 2023-08-01T19:55:27.303 INFO:teuthology.orchestra.run.smithi008.stdout: { 2023-08-01T19:55:27.303 INFO:teuthology.orchestra.run.smithi008.stdout: "event": "op_commit", 2023-08-01T19:55:27.303 INFO:teuthology.orchestra.run.smithi008.stdout: "time": "2023-08-01T19:55:05.168883+0000", 2023-08-01T19:55:27.303 INFO:teuthology.orchestra.run.smithi008.stdout: "duration": 0.0034333279999999998 2023-08-01T19:55:27.304 INFO:teuthology.orchestra.run.smithi008.stdout: }, 2023-08-01T19:55:27.304 INFO:teuthology.orchestra.run.smithi008.stdout: { 2023-08-01T19:55:27.304 INFO:teuthology.orchestra.run.smithi008.stdout: "event": "sub_op_commit_rec", 2023-08-01T19:55:27.304 INFO:teuthology.orchestra.run.smithi008.stdout: "time": "2023-08-01T19:55:05.228904+0000", 2023-08-01T19:55:27.304 INFO:teuthology.orchestra.run.smithi008.stdout: "duration": 0.060021370999999997 2023-08-01T19:55:27.304 INFO:teuthology.orchestra.run.smithi008.stdout: }, 2023-08-01T19:55:27.304 INFO:teuthology.orchestra.run.smithi008.stdout: { 2023-08-01T19:55:27.304 INFO:teuthology.orchestra.run.smithi008.stdout: "event": "commit_sent", 2023-08-01T19:55:27.305 INFO:teuthology.orchestra.run.smithi008.stdout: "time": "2023-08-01T19:55:05.228952+0000", 2023-08-01T19:55:27.305 INFO:teuthology.orchestra.run.smithi008.stdout: "duration": 4.8056999999999997e-05 2023-08-01T19:55:27.305 INFO:teuthology.orchestra.run.smithi008.stdout: }, 2023-08-01T19:55:27.305 INFO:teuthology.orchestra.run.smithi008.stdout: { 2023-08-01T19:55:27.305 INFO:teuthology.orchestra.run.smithi008.stdout: "event": "done", 2023-08-01T19:55:27.305 INFO:teuthology.orchestra.run.smithi008.stdout: "time": "2023-08-01T19:55:05.228987+0000", 2023-08-01T19:55:27.305 INFO:teuthology.orchestra.run.smithi008.stdout: "duration": 3.5083000000000003e-05 2023-08-01T19:55:27.306 INFO:teuthology.orchestra.run.smithi008.stdout: } 2023-08-01T19:55:27.306 INFO:teuthology.orchestra.run.smithi008.stdout: ] 2023-08-01T19:55:27.306 INFO:teuthology.orchestra.run.smithi008.stdout: } 2023-08-01T19:55:27.306 INFO:teuthology.orchestra.run.smithi008.stdout: }, 2023-08-01T19:55:27.306 INFO:teuthology.orchestra.run.smithi008.stdout: { 2023-08-01T19:55:27.306 INFO:teuthology.orchestra.run.smithi008.stdout: "description": "osd_op(client.4668.0:100929 5.3 5:c29f4adb:::benchmark_data_smithi006_114134_object100928:head [set-alloc-hint object_size 65536 write_size 65536,write 0~65536] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e37)", 2023-08-01T19:55:27.306 INFO:teuthology.orchestra.run.smithi008.stdout: "initiated_at": "2023-08-01T19:55:05.564759+0000", 2023-08-01T19:55:27.306 INFO:teuthology.orchestra.run.smithi008.stdout: "age": 21.694986992, 2023-08-01T19:55:27.307 INFO:teuthology.orchestra.run.smithi008.stdout: "duration": 0.062544635000000001, 2023-08-01T19:55:27.307 INFO:teuthology.orchestra.run.smithi008.stdout: "type_data": { 2023-08-01T19:55:27.307 INFO:teuthology.orchestra.run.smithi008.stdout: "flag_point": "commit sent; apply or cleanup", 2023-08-01T19:55:27.307 INFO:teuthology.orchestra.run.smithi008.stdout: "client_info": { 2023-08-01T19:55:27.307 INFO:teuthology.orchestra.run.smithi008.stdout: "client": "client.4668", 2023-08-01T19:55:27.307 INFO:teuthology.orchestra.run.smithi008.stdout: "client_addr": "172.21.15.6:0/1709472247", 2023-08-01T19:55:27.307 INFO:teuthology.orchestra.run.smithi008.stdout: "tid": 100929 2023-08-01T19:55:27.307 INFO:teuthology.orchestra.run.smithi008.stdout: }, 2023-08-01T19:55:27.308 INFO:teuthology.orchestra.run.smithi008.stdout: "events": [ 2023-08-01T19:55:27.308 INFO:teuthology.orchestra.run.smithi008.stdout: { 2023-08-01T19:55:27.308 INFO:teuthology.orchestra.run.smithi008.stdout: "event": "initiated", 2023-08-01T19:55:27.308 INFO:teuthology.orchestra.run.smithi008.stdout: "time": "2023-08-01T19:55:05.564759+0000", 2023-08-01T19:55:27.308 INFO:teuthology.orchestra.run.smithi008.stdout: "duration": 0 2023-08-01T19:55:27.308 INFO:teuthology.orchestra.run.smithi008.stdout: }, 2023-08-01T19:55:27.308 INFO:teuthology.orchestra.run.smithi008.stdout: { 2023-08-01T19:55:27.308 INFO:teuthology.orchestra.run.smithi008.stdout: "event": "throttled", 2023-08-01T19:55:27.309 INFO:teuthology.orchestra.run.smithi008.stdout: "time": "2023-08-01T19:55:05.564759+0000", 2023-08-01T19:55:27.309 INFO:teuthology.orchestra.run.smithi008.stdout: "duration": 0 2023-08-01T19:55:27.309 INFO:teuthology.orchestra.run.smithi008.stdout: }, 2023-08-01T19:55:27.309 INFO:teuthology.orchestra.run.smithi008.stdout: { 2023-08-01T19:55:27.309 INFO:teuthology.orchestra.run.smithi008.stdout: "event": "header_read", 2023-08-01T19:55:27.309 INFO:teuthology.orchestra.run.smithi008.stdout: "time": "2023-08-01T19:55:05.564758+0000", 2023-08-01T19:55:27.309 INFO:teuthology.orchestra.run.smithi008.stdout: "duration": 4294967295.999999 2023-08-01T19:55:27.309 INFO:teuthology.orchestra.run.smithi008.stdout: }, 2023-08-01T19:55:27.310 INFO:teuthology.orchestra.run.smithi008.stdout: { 2023-08-01T19:55:27.310 INFO:teuthology.orchestra.run.smithi008.stdout: "event": "all_read", 2023-08-01T19:55:27.310 INFO:teuthology.orchestra.run.smithi008.stdout: "time": "2023-08-01T19:55:05.564815+0000", 2023-08-01T19:55:27.310 INFO:teuthology.orchestra.run.smithi008.stdout: "duration": 5.7757000000000003e-05 2023-08-01T19:55:27.310 INFO:teuthology.orchestra.run.smithi008.stdout: }, 2023-08-01T19:55:27.310 INFO:teuthology.orchestra.run.smithi008.stdout: { 2023-08-01T19:55:27.310 INFO:teuthology.orchestra.run.smithi008.stdout: "event": "dispatched", 2023-08-01T19:55:27.310 INFO:teuthology.orchestra.run.smithi008.stdout: "time": "2023-08-01T19:55:05.564824+0000", 2023-08-01T19:55:27.311 INFO:teuthology.orchestra.run.smithi008.stdout: "duration": 8.6559999999999998e-06 2023-08-01T19:55:27.311 INFO:teuthology.orchestra.run.smithi008.stdout: }, 2023-08-01T19:55:27.311 INFO:teuthology.orchestra.run.smithi008.stdout: { 2023-08-01T19:55:27.311 INFO:teuthology.orchestra.run.smithi008.stdout: "event": "queued_for_pg", 2023-08-01T19:55:27.311 INFO:teuthology.orchestra.run.smithi008.stdout: "time": "2023-08-01T19:55:05.564829+0000", 2023-08-01T19:55:27.311 INFO:teuthology.orchestra.run.smithi008.stdout: "duration": 4.6160000000000004e-06 2023-08-01T19:55:27.311 INFO:teuthology.orchestra.run.smithi008.stdout: }, 2023-08-01T19:55:27.311 INFO:teuthology.orchestra.run.smithi008.stdout: { 2023-08-01T19:55:27.312 INFO:teuthology.orchestra.run.smithi008.stdout: "event": "reached_pg", 2023-08-01T19:55:27.312 INFO:teuthology.orchestra.run.smithi008.stdout: "time": "2023-08-01T19:55:05.564871+0000", 2023-08-01T19:55:27.312 INFO:teuthology.orchestra.run.smithi008.stdout: "duration": 4.2206000000000002e-05 2023-08-01T19:55:27.312 INFO:teuthology.orchestra.run.smithi008.stdout: }, 2023-08-01T19:55:27.312 INFO:teuthology.orchestra.run.smithi008.stdout: { 2023-08-01T19:55:27.312 INFO:teuthology.orchestra.run.smithi008.stdout: "event": "started", 2023-08-01T19:55:27.312 INFO:teuthology.orchestra.run.smithi008.stdout: "time": "2023-08-01T19:55:05.565011+0000", 2023-08-01T19:55:27.313 INFO:teuthology.orchestra.run.smithi008.stdout: "duration": 0.000140469 2023-08-01T19:55:27.313 INFO:teuthology.orchestra.run.smithi008.stdout: }, 2023-08-01T19:55:27.313 INFO:teuthology.orchestra.run.smithi008.stdout: { 2023-08-01T19:55:27.313 INFO:teuthology.orchestra.run.smithi008.stdout: "event": "waiting for subops from 1", 2023-08-01T19:55:27.313 INFO:teuthology.orchestra.run.smithi008.stdout: "time": "2023-08-01T19:55:05.565212+0000", 2023-08-01T19:55:27.313 INFO:teuthology.orchestra.run.smithi008.stdout: "duration": 0.00020106599999999999 2023-08-01T19:55:27.313 INFO:teuthology.orchestra.run.smithi008.stdout: }, 2023-08-01T19:55:27.313 INFO:teuthology.orchestra.run.smithi008.stdout: { 2023-08-01T19:55:27.314 INFO:teuthology.orchestra.run.smithi008.stdout: "event": "sub_op_commit_rec", 2023-08-01T19:55:27.314 INFO:teuthology.orchestra.run.smithi008.stdout: "time": "2023-08-01T19:55:05.626925+0000", 2023-08-01T19:55:27.314 INFO:teuthology.orchestra.run.smithi008.stdout: "duration": 0.061712111 2023-08-01T19:55:27.314 INFO:teuthology.orchestra.run.smithi008.stdout: }, 2023-08-01T19:55:27.314 INFO:teuthology.orchestra.run.smithi008.stdout: { 2023-08-01T19:55:27.314 INFO:teuthology.orchestra.run.smithi008.stdout: "event": "op_commit", 2023-08-01T19:55:27.314 INFO:teuthology.orchestra.run.smithi008.stdout: "time": "2023-08-01T19:55:05.627217+0000", 2023-08-01T19:55:27.314 INFO:teuthology.orchestra.run.smithi008.stdout: "duration": 0.00029265999999999998 2023-08-01T19:55:27.315 INFO:teuthology.orchestra.run.smithi008.stdout: }, 2023-08-01T19:55:27.315 INFO:teuthology.orchestra.run.smithi008.stdout: { 2023-08-01T19:55:27.315 INFO:teuthology.orchestra.run.smithi008.stdout: "event": "commit_sent", 2023-08-01T19:55:27.315 INFO:teuthology.orchestra.run.smithi008.stdout: "time": "2023-08-01T19:55:05.627264+0000", 2023-08-01T19:55:27.315 INFO:teuthology.orchestra.run.smithi008.stdout: "duration": 4.6260000000000001e-05 2023-08-01T19:55:27.315 INFO:teuthology.orchestra.run.smithi008.stdout: }, 2023-08-01T19:55:27.315 INFO:teuthology.orchestra.run.smithi008.stdout: { 2023-08-01T19:55:27.316 INFO:teuthology.orchestra.run.smithi008.stdout: "event": "done", 2023-08-01T19:55:27.316 INFO:teuthology.orchestra.run.smithi008.stdout: "time": "2023-08-01T19:55:05.627303+0000", 2023-08-01T19:55:27.316 INFO:teuthology.orchestra.run.smithi008.stdout: "duration": 3.9839999999999998e-05 2023-08-01T19:55:27.316 INFO:teuthology.orchestra.run.smithi008.stdout: } 2023-08-01T19:55:27.316 INFO:teuthology.orchestra.run.smithi008.stdout: ] 2023-08-01T19:55:27.316 INFO:teuthology.orchestra.run.smithi008.stdout: } 2023-08-01T19:55:27.316 INFO:teuthology.orchestra.run.smithi008.stdout: }, 2023-08-01T19:55:27.317 INFO:teuthology.orchestra.run.smithi008.stdout: { 2023-08-01T19:55:27.317 INFO:teuthology.orchestra.run.smithi008.stdout: "description": "osd_repop(client.4668.0:100928 5.7 e37/19 5:e61a7dfa:::benchmark_data_smithi006_114134_object100927:head v 37'6273, mlcod=37'6270)", 2023-08-01T19:55:27.317 INFO:teuthology.orchestra.run.smithi008.stdout: "initiated_at": "2023-08-01T19:55:05.565106+0000", 2023-08-01T19:55:27.317 INFO:teuthology.orchestra.run.smithi008.stdout: "age": 21.694639894000002, 2023-08-01T19:55:27.317 INFO:teuthology.orchestra.run.smithi008.stdout: "duration": 0.064091282999999999, 2023-08-01T19:55:27.317 INFO:teuthology.orchestra.run.smithi008.stdout: "type_data": { 2023-08-01T19:55:27.317 INFO:teuthology.orchestra.run.smithi008.stdout: "flag_point": "commit sent; apply or cleanup", 2023-08-01T19:55:27.317 INFO:teuthology.orchestra.run.smithi008.stdout: "events": [ 2023-08-01T19:55:27.318 INFO:teuthology.orchestra.run.smithi008.stdout: { 2023-08-01T19:55:27.318 INFO:teuthology.orchestra.run.smithi008.stdout: "event": "initiated", 2023-08-01T19:55:27.318 INFO:teuthology.orchestra.run.smithi008.stdout: "time": "2023-08-01T19:55:05.565106+0000", 2023-08-01T19:55:27.318 INFO:teuthology.orchestra.run.smithi008.stdout: "duration": 0 2023-08-01T19:55:27.318 INFO:teuthology.orchestra.run.smithi008.stdout: }, 2023-08-01T19:55:27.318 INFO:teuthology.orchestra.run.smithi008.stdout: { 2023-08-01T19:55:27.318 INFO:teuthology.orchestra.run.smithi008.stdout: "event": "throttled", 2023-08-01T19:55:27.318 INFO:teuthology.orchestra.run.smithi008.stdout: "time": "2023-08-01T19:55:05.565106+0000", 2023-08-01T19:55:27.319 INFO:teuthology.orchestra.run.smithi008.stdout: "duration": 0 2023-08-01T19:55:27.319 INFO:teuthology.orchestra.run.smithi008.stdout: }, 2023-08-01T19:55:27.319 INFO:teuthology.orchestra.run.smithi008.stdout: { 2023-08-01T19:55:27.319 INFO:teuthology.orchestra.run.smithi008.stdout: "event": "header_read", 2023-08-01T19:55:27.319 INFO:teuthology.orchestra.run.smithi008.stdout: "time": "2023-08-01T19:55:05.565105+0000", 2023-08-01T19:55:27.319 INFO:teuthology.orchestra.run.smithi008.stdout: "duration": 4294967295.9999995 2023-08-01T19:55:27.319 INFO:teuthology.orchestra.run.smithi008.stdout: }, 2023-08-01T19:55:27.319 INFO:teuthology.orchestra.run.smithi008.stdout: { 2023-08-01T19:55:27.320 INFO:teuthology.orchestra.run.smithi008.stdout: "event": "all_read", 2023-08-01T19:55:27.320 INFO:teuthology.orchestra.run.smithi008.stdout: "time": "2023-08-01T19:55:05.565173+0000", 2023-08-01T19:55:27.320 INFO:teuthology.orchestra.run.smithi008.stdout: "duration": 6.8186000000000001e-05 2023-08-01T19:55:27.320 INFO:teuthology.orchestra.run.smithi008.stdout: }, 2023-08-01T19:55:27.320 INFO:teuthology.orchestra.run.smithi008.stdout: { 2023-08-01T19:55:27.320 INFO:teuthology.orchestra.run.smithi008.stdout: "event": "dispatched", 2023-08-01T19:55:27.320 INFO:teuthology.orchestra.run.smithi008.stdout: "time": "2023-08-01T19:55:05.565182+0000", 2023-08-01T19:55:27.321 INFO:teuthology.orchestra.run.smithi008.stdout: "duration": 8.3620000000000006e-06 2023-08-01T19:55:27.321 INFO:teuthology.orchestra.run.smithi008.stdout: }, 2023-08-01T19:55:27.321 INFO:teuthology.orchestra.run.smithi008.stdout: { 2023-08-01T19:55:27.321 INFO:teuthology.orchestra.run.smithi008.stdout: "event": "queued_for_pg", 2023-08-01T19:55:27.321 INFO:teuthology.orchestra.run.smithi008.stdout: "time": "2023-08-01T19:55:05.565186+0000", 2023-08-01T19:55:27.321 INFO:teuthology.orchestra.run.smithi008.stdout: "duration": 3.7680000000000002e-06 2023-08-01T19:55:27.321 INFO:teuthology.orchestra.run.smithi008.stdout: }, 2023-08-01T19:55:27.321 INFO:teuthology.orchestra.run.smithi008.stdout: { 2023-08-01T19:55:27.322 INFO:teuthology.orchestra.run.smithi008.stdout: "event": "reached_pg", 2023-08-01T19:55:27.322 INFO:teuthology.orchestra.run.smithi008.stdout: "time": "2023-08-01T19:55:05.565212+0000", 2023-08-01T19:55:27.322 INFO:teuthology.orchestra.run.smithi008.stdout: "duration": 2.6230000000000001e-05 2023-08-01T19:55:27.322 INFO:teuthology.orchestra.run.smithi008.stdout: }, 2023-08-01T19:55:27.322 INFO:teuthology.orchestra.run.smithi008.stdout: { 2023-08-01T19:55:27.322 INFO:teuthology.orchestra.run.smithi008.stdout: "event": "started", 2023-08-01T19:55:27.322 INFO:teuthology.orchestra.run.smithi008.stdout: "time": "2023-08-01T19:55:05.565224+0000", 2023-08-01T19:55:27.322 INFO:teuthology.orchestra.run.smithi008.stdout: "duration": 1.2033e-05 2023-08-01T19:55:27.323 INFO:teuthology.orchestra.run.smithi008.stdout: }, 2023-08-01T19:55:27.323 INFO:teuthology.orchestra.run.smithi008.stdout: { 2023-08-01T19:55:27.323 INFO:teuthology.orchestra.run.smithi008.stdout: "event": "commit_sent", 2023-08-01T19:55:27.323 INFO:teuthology.orchestra.run.smithi008.stdout: "time": "2023-08-01T19:55:05.629152+0000", 2023-08-01T19:55:27.323 INFO:teuthology.orchestra.run.smithi008.stdout: "duration": 0.063928378999999994 2023-08-01T19:55:27.323 INFO:teuthology.orchestra.run.smithi008.stdout: }, 2023-08-01T19:55:27.323 INFO:teuthology.orchestra.run.smithi008.stdout: { 2023-08-01T19:55:27.324 INFO:teuthology.orchestra.run.smithi008.stdout: "event": "done", 2023-08-01T19:55:27.324 INFO:teuthology.orchestra.run.smithi008.stdout: "time": "2023-08-01T19:55:05.629197+0000", 2023-08-01T19:55:27.324 INFO:teuthology.orchestra.run.smithi008.stdout: "duration": 4.4894000000000001e-05 2023-08-01T19:55:27.324 INFO:teuthology.orchestra.run.smithi008.stdout: } 2023-08-01T19:55:27.324 INFO:teuthology.orchestra.run.smithi008.stdout: ] 2023-08-01T19:55:27.324 INFO:teuthology.orchestra.run.smithi008.stdout: } 2023-08-01T19:55:27.324 INFO:teuthology.orchestra.run.smithi008.stdout: }, 2023-08-01T19:55:27.324 INFO:teuthology.orchestra.run.smithi008.stdout: { 2023-08-01T19:55:27.325 INFO:teuthology.orchestra.run.smithi008.stdout: "description": "osd_repop(client.4668.0:100927 5.0 e37/19 5:00608ec6:::benchmark_data_smithi006_114134_object100926:head v 37'6408, mlcod=37'6403)", 2023-08-01T19:55:27.325 INFO:teuthology.orchestra.run.smithi008.stdout: "initiated_at": "2023-08-01T19:55:05.565153+0000", 2023-08-01T19:55:27.325 INFO:teuthology.orchestra.run.smithi008.stdout: "age": 21.694593157, 2023-08-01T19:55:27.325 INFO:teuthology.orchestra.run.smithi008.stdout: "duration": 0.062202714999999999, 2023-08-01T19:55:27.325 INFO:teuthology.orchestra.run.smithi008.stdout: "type_data": { 2023-08-01T19:55:27.325 INFO:teuthology.orchestra.run.smithi008.stdout: "flag_point": "commit sent; apply or cleanup", 2023-08-01T19:55:27.325 INFO:teuthology.orchestra.run.smithi008.stdout: "events": [ 2023-08-01T19:55:27.326 INFO:teuthology.orchestra.run.smithi008.stdout: { 2023-08-01T19:55:27.326 INFO:teuthology.orchestra.run.smithi008.stdout: "event": "initiated", 2023-08-01T19:55:27.326 INFO:teuthology.orchestra.run.smithi008.stdout: "time": "2023-08-01T19:55:05.565153+0000", 2023-08-01T19:55:27.326 INFO:teuthology.orchestra.run.smithi008.stdout: "duration": 0 2023-08-01T19:55:27.326 INFO:teuthology.orchestra.run.smithi008.stdout: }, 2023-08-01T19:55:27.326 INFO:teuthology.orchestra.run.smithi008.stdout: { 2023-08-01T19:55:27.326 INFO:teuthology.orchestra.run.smithi008.stdout: "event": "throttled", 2023-08-01T19:55:27.326 INFO:teuthology.orchestra.run.smithi008.stdout: "time": "2023-08-01T19:55:05.565153+0000", 2023-08-01T19:55:27.327 INFO:teuthology.orchestra.run.smithi008.stdout: "duration": 0 2023-08-01T19:55:27.327 INFO:teuthology.orchestra.run.smithi008.stdout: }, 2023-08-01T19:55:27.327 INFO:teuthology.orchestra.run.smithi008.stdout: { 2023-08-01T19:55:27.327 INFO:teuthology.orchestra.run.smithi008.stdout: "event": "header_read", 2023-08-01T19:55:27.327 INFO:teuthology.orchestra.run.smithi008.stdout: "time": "2023-08-01T19:55:05.565152+0000", 2023-08-01T19:55:27.327 INFO:teuthology.orchestra.run.smithi008.stdout: "duration": 4294967295.9999995 2023-08-01T19:55:27.327 INFO:teuthology.orchestra.run.smithi008.stdout: }, 2023-08-01T19:55:27.327 INFO:teuthology.orchestra.run.smithi008.stdout: { 2023-08-01T19:55:27.328 INFO:teuthology.orchestra.run.smithi008.stdout: "event": "all_read", 2023-08-01T19:55:27.328 INFO:teuthology.orchestra.run.smithi008.stdout: "time": "2023-08-01T19:55:05.565225+0000", 2023-08-01T19:55:27.328 INFO:teuthology.orchestra.run.smithi008.stdout: "duration": 7.2471000000000005e-05 2023-08-01T19:55:27.328 INFO:teuthology.orchestra.run.smithi008.stdout: }, 2023-08-01T19:55:27.328 INFO:teuthology.orchestra.run.smithi008.stdout: { 2023-08-01T19:55:27.328 INFO:teuthology.orchestra.run.smithi008.stdout: "event": "dispatched", 2023-08-01T19:55:27.328 INFO:teuthology.orchestra.run.smithi008.stdout: "time": "2023-08-01T19:55:05.565229+0000", 2023-08-01T19:55:27.329 INFO:teuthology.orchestra.run.smithi008.stdout: "duration": 4.5600000000000004e-06 2023-08-01T19:55:27.329 INFO:teuthology.orchestra.run.smithi008.stdout: }, 2023-08-01T19:55:27.329 INFO:teuthology.orchestra.run.smithi008.stdout: { 2023-08-01T19:55:27.329 INFO:teuthology.orchestra.run.smithi008.stdout: "event": "queued_for_pg", 2023-08-01T19:55:27.329 INFO:teuthology.orchestra.run.smithi008.stdout: "time": "2023-08-01T19:55:05.565232+0000", 2023-08-01T19:55:27.329 INFO:teuthology.orchestra.run.smithi008.stdout: "duration": 2.6900000000000001e-06 2023-08-01T19:55:27.329 INFO:teuthology.orchestra.run.smithi008.stdout: }, 2023-08-01T19:55:27.330 INFO:teuthology.orchestra.run.smithi008.stdout: { 2023-08-01T19:55:27.330 INFO:teuthology.orchestra.run.smithi008.stdout: "event": "reached_pg", 2023-08-01T19:55:27.330 INFO:teuthology.orchestra.run.smithi008.stdout: "time": "2023-08-01T19:55:05.565283+0000", 2023-08-01T19:55:27.330 INFO:teuthology.orchestra.run.smithi008.stdout: "duration": 5.1442e-05 2023-08-01T19:55:27.330 INFO:teuthology.orchestra.run.smithi008.stdout: }, 2023-08-01T19:55:27.330 INFO:teuthology.orchestra.run.smithi008.stdout: { 2023-08-01T19:55:27.330 INFO:teuthology.orchestra.run.smithi008.stdout: "event": "started", 2023-08-01T19:55:27.330 INFO:teuthology.orchestra.run.smithi008.stdout: "time": "2023-08-01T19:55:05.565301+0000", 2023-08-01T19:55:27.331 INFO:teuthology.orchestra.run.smithi008.stdout: "duration": 1.8029e-05 2023-08-01T19:55:27.331 INFO:teuthology.orchestra.run.smithi008.stdout: }, 2023-08-01T19:55:27.331 INFO:teuthology.orchestra.run.smithi008.stdout: { 2023-08-01T19:55:27.331 INFO:teuthology.orchestra.run.smithi008.stdout: "event": "commit_sent", 2023-08-01T19:55:27.331 INFO:teuthology.orchestra.run.smithi008.stdout: "time": "2023-08-01T19:55:05.627318+0000", 2023-08-01T19:55:27.331 INFO:teuthology.orchestra.run.smithi008.stdout: "duration": 0.062016763000000003 2023-08-01T19:55:27.331 INFO:teuthology.orchestra.run.smithi008.stdout: }, 2023-08-01T19:55:27.331 INFO:teuthology.orchestra.run.smithi008.stdout: { 2023-08-01T19:55:27.332 INFO:teuthology.orchestra.run.smithi008.stdout: "event": "done", 2023-08-01T19:55:27.332 INFO:teuthology.orchestra.run.smithi008.stdout: "time": "2023-08-01T19:55:05.627355+0000", 2023-08-01T19:55:27.332 INFO:teuthology.orchestra.run.smithi008.stdout: "duration": 3.7258999999999997e-05 2023-08-01T19:55:27.332 INFO:teuthology.orchestra.run.smithi008.stdout: } 2023-08-01T19:55:27.332 INFO:teuthology.orchestra.run.smithi008.stdout: ] 2023-08-01T19:55:27.332 INFO:teuthology.orchestra.run.smithi008.stdout: } 2023-08-01T19:55:27.332 INFO:teuthology.orchestra.run.smithi008.stdout: }, 2023-08-01T19:55:27.333 INFO:teuthology.orchestra.run.smithi008.stdout: { 2023-08-01T19:55:27.333 INFO:teuthology.orchestra.run.smithi008.stdout: "description": "osd_op(client.4668.0:100930 5.5 5:a7b64eb3:::benchmark_data_smithi006_114134_object100929:head [set-alloc-hint object_size 65536 write_size 65536,write 0~65536] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e37)", 2023-08-01T19:55:27.333 INFO:teuthology.orchestra.run.smithi008.stdout: "initiated_at": "2023-08-01T19:55:05.565766+0000", 2023-08-01T19:55:27.333 INFO:teuthology.orchestra.run.smithi008.stdout: "age": 21.693979372000001, 2023-08-01T19:55:27.333 INFO:teuthology.orchestra.run.smithi008.stdout: "duration": 0.063668735000000004, 2023-08-01T19:55:27.333 INFO:teuthology.orchestra.run.smithi008.stdout: "type_data": { 2023-08-01T19:55:27.333 INFO:teuthology.orchestra.run.smithi008.stdout: "flag_point": "commit sent; apply or cleanup", 2023-08-01T19:55:27.333 INFO:teuthology.orchestra.run.smithi008.stdout: "client_info": { 2023-08-01T19:55:27.334 INFO:teuthology.orchestra.run.smithi008.stdout: "client": "client.4668", 2023-08-01T19:55:27.334 INFO:teuthology.orchestra.run.smithi008.stdout: "client_addr": "172.21.15.6:0/1709472247", 2023-08-01T19:55:27.334 INFO:teuthology.orchestra.run.smithi008.stdout: "tid": 100930 2023-08-01T19:55:27.334 INFO:teuthology.orchestra.run.smithi008.stdout: }, 2023-08-01T19:55:27.334 INFO:teuthology.orchestra.run.smithi008.stdout: "events": [ 2023-08-01T19:55:27.334 INFO:teuthology.orchestra.run.smithi008.stdout: { 2023-08-01T19:55:27.335 INFO:teuthology.orchestra.run.smithi008.stdout: "event": "initiated", 2023-08-01T19:55:27.335 INFO:teuthology.orchestra.run.smithi008.stdout: "time": "2023-08-01T19:55:05.565766+0000", 2023-08-01T19:55:27.335 INFO:teuthology.orchestra.run.smithi008.stdout: "duration": 0 2023-08-01T19:55:27.335 INFO:teuthology.orchestra.run.smithi008.stdout: }, 2023-08-01T19:55:27.335 INFO:teuthology.orchestra.run.smithi008.stdout: { 2023-08-01T19:55:27.335 INFO:teuthology.orchestra.run.smithi008.stdout: "event": "throttled", 2023-08-01T19:55:27.335 INFO:teuthology.orchestra.run.smithi008.stdout: "time": "2023-08-01T19:55:05.565766+0000", 2023-08-01T19:55:27.335 INFO:teuthology.orchestra.run.smithi008.stdout: "duration": 0 2023-08-01T19:55:27.336 INFO:teuthology.orchestra.run.smithi008.stdout: }, 2023-08-01T19:55:27.336 INFO:teuthology.orchestra.run.smithi008.stdout: { 2023-08-01T19:55:27.336 INFO:teuthology.orchestra.run.smithi008.stdout: "event": "header_read", 2023-08-01T19:55:27.336 INFO:teuthology.orchestra.run.smithi008.stdout: "time": "2023-08-01T19:55:05.565766+0000", 2023-08-01T19:55:27.336 INFO:teuthology.orchestra.run.smithi008.stdout: "duration": 4294967295.999999 2023-08-01T19:55:27.336 INFO:teuthology.orchestra.run.smithi008.stdout: }, 2023-08-01T19:55:27.336 INFO:teuthology.orchestra.run.smithi008.stdout: { 2023-08-01T19:55:27.336 INFO:teuthology.orchestra.run.smithi008.stdout: "event": "all_read", 2023-08-01T19:55:27.337 INFO:teuthology.orchestra.run.smithi008.stdout: "time": "2023-08-01T19:55:05.565855+0000", 2023-08-01T19:55:27.337 INFO:teuthology.orchestra.run.smithi008.stdout: "duration": 8.9166999999999995e-05 2023-08-01T19:55:27.337 INFO:teuthology.orchestra.run.smithi008.stdout: }, 2023-08-01T19:55:27.337 INFO:teuthology.orchestra.run.smithi008.stdout: { 2023-08-01T19:55:27.337 INFO:teuthology.orchestra.run.smithi008.stdout: "event": "dispatched", 2023-08-01T19:55:27.337 INFO:teuthology.orchestra.run.smithi008.stdout: "time": "2023-08-01T19:55:05.565862+0000", 2023-08-01T19:55:27.337 INFO:teuthology.orchestra.run.smithi008.stdout: "duration": 7.4549999999999998e-06 2023-08-01T19:55:27.338 INFO:teuthology.orchestra.run.smithi008.stdout: }, 2023-08-01T19:55:27.338 INFO:teuthology.orchestra.run.smithi008.stdout: { 2023-08-01T19:55:27.338 INFO:teuthology.orchestra.run.smithi008.stdout: "event": "queued_for_pg", 2023-08-01T19:55:27.338 INFO:teuthology.orchestra.run.smithi008.stdout: "time": "2023-08-01T19:55:05.565866+0000", 2023-08-01T19:55:27.338 INFO:teuthology.orchestra.run.smithi008.stdout: "duration": 3.8060000000000001e-06 2023-08-01T19:55:27.338 INFO:teuthology.orchestra.run.smithi008.stdout: }, 2023-08-01T19:55:27.338 INFO:teuthology.orchestra.run.smithi008.stdout: { 2023-08-01T19:55:27.338 INFO:teuthology.orchestra.run.smithi008.stdout: "event": "reached_pg", 2023-08-01T19:55:27.339 INFO:teuthology.orchestra.run.smithi008.stdout: "time": "2023-08-01T19:55:05.565901+0000", 2023-08-01T19:55:27.339 INFO:teuthology.orchestra.run.smithi008.stdout: "duration": 3.5063e-05 2023-08-01T19:55:27.339 INFO:teuthology.orchestra.run.smithi008.stdout: }, 2023-08-01T19:55:27.339 INFO:teuthology.orchestra.run.smithi008.stdout: { 2023-08-01T19:55:27.339 INFO:teuthology.orchestra.run.smithi008.stdout: "event": "started", 2023-08-01T19:55:27.339 INFO:teuthology.orchestra.run.smithi008.stdout: "time": "2023-08-01T19:55:05.566016+0000", 2023-08-01T19:55:27.339 INFO:teuthology.orchestra.run.smithi008.stdout: "duration": 0.00011509400000000001 2023-08-01T19:55:27.340 INFO:teuthology.orchestra.run.smithi008.stdout: }, 2023-08-01T19:55:27.340 INFO:teuthology.orchestra.run.smithi008.stdout: { 2023-08-01T19:55:27.340 INFO:teuthology.orchestra.run.smithi008.stdout: "event": "waiting for subops from 1", 2023-08-01T19:55:27.340 INFO:teuthology.orchestra.run.smithi008.stdout: "time": "2023-08-01T19:55:05.566154+0000", 2023-08-01T19:55:27.340 INFO:teuthology.orchestra.run.smithi008.stdout: "duration": 0.000138052 2023-08-01T19:55:27.340 INFO:teuthology.orchestra.run.smithi008.stdout: }, 2023-08-01T19:55:27.340 INFO:teuthology.orchestra.run.smithi008.stdout: { 2023-08-01T19:55:27.340 INFO:teuthology.orchestra.run.smithi008.stdout: "event": "sub_op_commit_rec", 2023-08-01T19:55:27.341 INFO:teuthology.orchestra.run.smithi008.stdout: "time": "2023-08-01T19:55:05.629279+0000", 2023-08-01T19:55:27.341 INFO:teuthology.orchestra.run.smithi008.stdout: "duration": 0.063124531999999997 2023-08-01T19:55:27.341 INFO:teuthology.orchestra.run.smithi008.stdout: }, 2023-08-01T19:55:27.341 INFO:teuthology.orchestra.run.smithi008.stdout: { 2023-08-01T19:55:27.341 INFO:teuthology.orchestra.run.smithi008.stdout: "event": "op_commit", 2023-08-01T19:55:27.341 INFO:teuthology.orchestra.run.smithi008.stdout: "time": "2023-08-01T19:55:05.629333+0000", 2023-08-01T19:55:27.341 INFO:teuthology.orchestra.run.smithi008.stdout: "duration": 5.4694999999999997e-05 2023-08-01T19:55:27.341 INFO:teuthology.orchestra.run.smithi008.stdout: }, 2023-08-01T19:55:27.342 INFO:teuthology.orchestra.run.smithi008.stdout: { 2023-08-01T19:55:27.342 INFO:teuthology.orchestra.run.smithi008.stdout: "event": "commit_sent", 2023-08-01T19:55:27.342 INFO:teuthology.orchestra.run.smithi008.stdout: "time": "2023-08-01T19:55:05.629390+0000", 2023-08-01T19:55:27.342 INFO:teuthology.orchestra.run.smithi008.stdout: "duration": 5.6416000000000003e-05 2023-08-01T19:55:27.342 INFO:teuthology.orchestra.run.smithi008.stdout: }, 2023-08-01T19:55:27.342 INFO:teuthology.orchestra.run.smithi008.stdout: { 2023-08-01T19:55:27.342 INFO:teuthology.orchestra.run.smithi008.stdout: "event": "done", 2023-08-01T19:55:27.342 INFO:teuthology.orchestra.run.smithi008.stdout: "time": "2023-08-01T19:55:05.629435+0000", 2023-08-01T19:55:27.343 INFO:teuthology.orchestra.run.smithi008.stdout: "duration": 4.5170999999999998e-05 2023-08-01T19:55:27.343 INFO:teuthology.orchestra.run.smithi008.stdout: } 2023-08-01T19:55:27.343 INFO:teuthology.orchestra.run.smithi008.stdout: ] 2023-08-01T19:55:27.343 INFO:teuthology.orchestra.run.smithi008.stdout: } 2023-08-01T19:55:27.343 INFO:teuthology.orchestra.run.smithi008.stdout: }, 2023-08-01T19:55:27.343 INFO:teuthology.orchestra.run.smithi008.stdout: { 2023-08-01T19:55:27.343 INFO:teuthology.orchestra.run.smithi008.stdout: "description": "osd_op(client.4668.0:100933 5.5 5:af92e9f2:::benchmark_data_smithi006_114134_object100932:head [set-alloc-hint object_size 65536 write_size 65536,write 0~65536] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e37)", 2023-08-01T19:55:27.343 INFO:teuthology.orchestra.run.smithi008.stdout: "initiated_at": "2023-08-01T19:55:05.566634+0000", 2023-08-01T19:55:27.344 INFO:teuthology.orchestra.run.smithi008.stdout: "age": 21.693111828999999, 2023-08-01T19:55:27.344 INFO:teuthology.orchestra.run.smithi008.stdout: "duration": 0.065909364999999998, 2023-08-01T19:55:27.344 INFO:teuthology.orchestra.run.smithi008.stdout: "type_data": { 2023-08-01T19:55:27.344 INFO:teuthology.orchestra.run.smithi008.stdout: "flag_point": "commit sent; apply or cleanup", 2023-08-01T19:55:27.344 INFO:teuthology.orchestra.run.smithi008.stdout: "client_info": { 2023-08-01T19:55:27.344 INFO:teuthology.orchestra.run.smithi008.stdout: "client": "client.4668", 2023-08-01T19:55:27.344 INFO:teuthology.orchestra.run.smithi008.stdout: "client_addr": "172.21.15.6:0/1709472247", 2023-08-01T19:55:27.345 INFO:teuthology.orchestra.run.smithi008.stdout: "tid": 100933 2023-08-01T19:55:27.345 INFO:teuthology.orchestra.run.smithi008.stdout: }, 2023-08-01T19:55:27.345 INFO:teuthology.orchestra.run.smithi008.stdout: "events": [ 2023-08-01T19:55:27.345 INFO:teuthology.orchestra.run.smithi008.stdout: { 2023-08-01T19:55:27.345 INFO:teuthology.orchestra.run.smithi008.stdout: "event": "initiated", 2023-08-01T19:55:27.345 INFO:teuthology.orchestra.run.smithi008.stdout: "time": "2023-08-01T19:55:05.566634+0000", 2023-08-01T19:55:27.345 INFO:teuthology.orchestra.run.smithi008.stdout: "duration": 0 2023-08-01T19:55:27.345 INFO:teuthology.orchestra.run.smithi008.stdout: }, 2023-08-01T19:55:27.346 INFO:teuthology.orchestra.run.smithi008.stdout: { 2023-08-01T19:55:27.346 INFO:teuthology.orchestra.run.smithi008.stdout: "event": "throttled", 2023-08-01T19:55:27.346 INFO:teuthology.orchestra.run.smithi008.stdout: "time": "2023-08-01T19:55:05.566634+0000", 2023-08-01T19:55:27.346 INFO:teuthology.orchestra.run.smithi008.stdout: "duration": 0 2023-08-01T19:55:27.346 INFO:teuthology.orchestra.run.smithi008.stdout: }, 2023-08-01T19:55:27.346 INFO:teuthology.orchestra.run.smithi008.stdout: { 2023-08-01T19:55:27.346 INFO:teuthology.orchestra.run.smithi008.stdout: "event": "header_read", 2023-08-01T19:55:27.346 INFO:teuthology.orchestra.run.smithi008.stdout: "time": "2023-08-01T19:55:05.566630+0000", 2023-08-01T19:55:27.347 INFO:teuthology.orchestra.run.smithi008.stdout: "duration": 4294967295.9999962 2023-08-01T19:55:27.347 INFO:teuthology.orchestra.run.smithi008.stdout: }, 2023-08-01T19:55:27.347 INFO:teuthology.orchestra.run.smithi008.stdout: { 2023-08-01T19:55:27.347 INFO:teuthology.orchestra.run.smithi008.stdout: "event": "all_read", 2023-08-01T19:55:27.347 INFO:teuthology.orchestra.run.smithi008.stdout: "time": "2023-08-01T19:55:05.566736+0000", 2023-08-01T19:55:27.347 INFO:teuthology.orchestra.run.smithi008.stdout: "duration": 0.000105752 2023-08-01T19:55:27.347 INFO:teuthology.orchestra.run.smithi008.stdout: }, 2023-08-01T19:55:27.347 INFO:teuthology.orchestra.run.smithi008.stdout: { 2023-08-01T19:55:27.348 INFO:teuthology.orchestra.run.smithi008.stdout: "event": "dispatched", 2023-08-01T19:55:27.348 INFO:teuthology.orchestra.run.smithi008.stdout: "time": "2023-08-01T19:55:05.566742+0000", 2023-08-01T19:55:27.348 INFO:teuthology.orchestra.run.smithi008.stdout: "duration": 5.8209999999999998e-06 2023-08-01T19:55:27.348 INFO:teuthology.orchestra.run.smithi008.stdout: }, 2023-08-01T19:55:27.348 INFO:teuthology.orchestra.run.smithi008.stdout: { 2023-08-01T19:55:27.348 INFO:teuthology.orchestra.run.smithi008.stdout: "event": "queued_for_pg", 2023-08-01T19:55:27.349 INFO:teuthology.orchestra.run.smithi008.stdout: "time": "2023-08-01T19:55:05.566745+0000", 2023-08-01T19:55:27.349 INFO:teuthology.orchestra.run.smithi008.stdout: "duration": 3.337e-06 2023-08-01T19:55:27.349 INFO:teuthology.orchestra.run.smithi008.stdout: }, 2023-08-01T19:55:27.349 INFO:teuthology.orchestra.run.smithi008.stdout: { 2023-08-01T19:55:27.349 INFO:teuthology.orchestra.run.smithi008.stdout: "event": "reached_pg", 2023-08-01T19:55:27.349 INFO:teuthology.orchestra.run.smithi008.stdout: "time": "2023-08-01T19:55:05.568175+0000", 2023-08-01T19:55:27.349 INFO:teuthology.orchestra.run.smithi008.stdout: "duration": 0.001429647 2023-08-01T19:55:27.349 INFO:teuthology.orchestra.run.smithi008.stdout: }, 2023-08-01T19:55:27.350 INFO:teuthology.orchestra.run.smithi008.stdout: { 2023-08-01T19:55:27.350 INFO:teuthology.orchestra.run.smithi008.stdout: "event": "started", 2023-08-01T19:55:27.350 INFO:teuthology.orchestra.run.smithi008.stdout: "time": "2023-08-01T19:55:05.568288+0000", 2023-08-01T19:55:27.350 INFO:teuthology.orchestra.run.smithi008.stdout: "duration": 0.000113353 2023-08-01T19:55:27.350 INFO:teuthology.orchestra.run.smithi008.stdout: }, 2023-08-01T19:55:27.350 INFO:teuthology.orchestra.run.smithi008.stdout: { 2023-08-01T19:55:27.350 INFO:teuthology.orchestra.run.smithi008.stdout: "event": "waiting for subops from 1", 2023-08-01T19:55:27.350 INFO:teuthology.orchestra.run.smithi008.stdout: "time": "2023-08-01T19:55:05.568425+0000", 2023-08-01T19:55:27.351 INFO:teuthology.orchestra.run.smithi008.stdout: "duration": 0.000137346 2023-08-01T19:55:27.351 INFO:teuthology.orchestra.run.smithi008.stdout: }, 2023-08-01T19:55:27.351 INFO:teuthology.orchestra.run.smithi008.stdout: { 2023-08-01T19:55:27.351 INFO:teuthology.orchestra.run.smithi008.stdout: "event": "sub_op_commit_rec", 2023-08-01T19:55:27.351 INFO:teuthology.orchestra.run.smithi008.stdout: "time": "2023-08-01T19:55:05.629320+0000", 2023-08-01T19:55:27.351 INFO:teuthology.orchestra.run.smithi008.stdout: "duration": 0.060894491000000002 2023-08-01T19:55:27.351 INFO:teuthology.orchestra.run.smithi008.stdout: }, 2023-08-01T19:55:27.352 INFO:teuthology.orchestra.run.smithi008.stdout: { 2023-08-01T19:55:27.352 INFO:teuthology.orchestra.run.smithi008.stdout: "event": "op_commit", 2023-08-01T19:55:27.352 INFO:teuthology.orchestra.run.smithi008.stdout: "time": "2023-08-01T19:55:05.632452+0000", 2023-08-01T19:55:27.352 INFO:teuthology.orchestra.run.smithi008.stdout: "duration": 0.003131909 2023-08-01T19:55:27.352 INFO:teuthology.orchestra.run.smithi008.stdout: }, 2023-08-01T19:55:27.352 INFO:teuthology.orchestra.run.smithi008.stdout: { 2023-08-01T19:55:27.352 INFO:teuthology.orchestra.run.smithi008.stdout: "event": "commit_sent", 2023-08-01T19:55:27.353 INFO:teuthology.orchestra.run.smithi008.stdout: "time": "2023-08-01T19:55:05.632503+0000", 2023-08-01T19:55:27.353 INFO:teuthology.orchestra.run.smithi008.stdout: "duration": 5.1295000000000003e-05 2023-08-01T19:55:27.353 INFO:teuthology.orchestra.run.smithi008.stdout: }, 2023-08-01T19:55:27.353 INFO:teuthology.orchestra.run.smithi008.stdout: { 2023-08-01T19:55:27.353 INFO:teuthology.orchestra.run.smithi008.stdout: "event": "done", 2023-08-01T19:55:27.353 INFO:teuthology.orchestra.run.smithi008.stdout: "time": "2023-08-01T19:55:05.632543+0000", 2023-08-01T19:55:27.353 INFO:teuthology.orchestra.run.smithi008.stdout: "duration": 4.0234000000000001e-05 2023-08-01T19:55:27.353 INFO:teuthology.orchestra.run.smithi008.stdout: } 2023-08-01T19:55:27.354 INFO:teuthology.orchestra.run.smithi008.stdout: ] 2023-08-01T19:55:27.354 INFO:teuthology.orchestra.run.smithi008.stdout: } 2023-08-01T19:55:27.354 INFO:teuthology.orchestra.run.smithi008.stdout: }, 2023-08-01T19:55:27.354 INFO:teuthology.orchestra.run.smithi008.stdout: { 2023-08-01T19:55:27.354 INFO:teuthology.orchestra.run.smithi008.stdout: "description": "osd_repop(client.4668.0:100935 5.e e37/19 5:7895b14e:::benchmark_data_smithi006_114134_object100934:head v 37'6305, mlcod=37'6303)", 2023-08-01T19:55:27.354 INFO:teuthology.orchestra.run.smithi008.stdout: "initiated_at": "2023-08-01T19:55:05.567118+0000", 2023-08-01T19:55:27.354 INFO:teuthology.orchestra.run.smithi008.stdout: "age": 21.692627586, 2023-08-01T19:55:27.354 INFO:teuthology.orchestra.run.smithi008.stdout: "duration": 0.063691180999999999, 2023-08-01T19:55:27.355 INFO:teuthology.orchestra.run.smithi008.stdout: "type_data": { 2023-08-01T19:55:27.355 INFO:teuthology.orchestra.run.smithi008.stdout: "flag_point": "commit sent; apply or cleanup", 2023-08-01T19:55:27.355 INFO:teuthology.orchestra.run.smithi008.stdout: "events": [ 2023-08-01T19:55:27.355 INFO:teuthology.orchestra.run.smithi008.stdout: { 2023-08-01T19:55:27.355 INFO:teuthology.orchestra.run.smithi008.stdout: "event": "initiated", 2023-08-01T19:55:27.355 INFO:teuthology.orchestra.run.smithi008.stdout: "time": "2023-08-01T19:55:05.567118+0000", 2023-08-01T19:55:27.356 INFO:teuthology.orchestra.run.smithi008.stdout: "duration": 0 2023-08-01T19:55:27.356 INFO:teuthology.orchestra.run.smithi008.stdout: }, 2023-08-01T19:55:27.356 INFO:teuthology.orchestra.run.smithi008.stdout: { 2023-08-01T19:55:27.356 INFO:teuthology.orchestra.run.smithi008.stdout: "event": "throttled", 2023-08-01T19:55:27.356 INFO:teuthology.orchestra.run.smithi008.stdout: "time": "2023-08-01T19:55:05.567118+0000", 2023-08-01T19:55:27.356 INFO:teuthology.orchestra.run.smithi008.stdout: "duration": 0 2023-08-01T19:55:27.356 INFO:teuthology.orchestra.run.smithi008.stdout: }, 2023-08-01T19:55:27.356 INFO:teuthology.orchestra.run.smithi008.stdout: { 2023-08-01T19:55:27.357 INFO:teuthology.orchestra.run.smithi008.stdout: "event": "header_read", 2023-08-01T19:55:27.357 INFO:teuthology.orchestra.run.smithi008.stdout: "time": "2023-08-01T19:55:05.567117+0000", 2023-08-01T19:55:27.357 INFO:teuthology.orchestra.run.smithi008.stdout: "duration": 4294967295.999999 2023-08-01T19:55:27.357 INFO:teuthology.orchestra.run.smithi008.stdout: }, 2023-08-01T19:55:27.357 INFO:teuthology.orchestra.run.smithi008.stdout: { 2023-08-01T19:55:27.357 INFO:teuthology.orchestra.run.smithi008.stdout: "event": "all_read", 2023-08-01T19:55:27.357 INFO:teuthology.orchestra.run.smithi008.stdout: "time": "2023-08-01T19:55:05.567168+0000", 2023-08-01T19:55:27.358 INFO:teuthology.orchestra.run.smithi008.stdout: "duration": 5.0353999999999999e-05 2023-08-01T19:55:27.358 INFO:teuthology.orchestra.run.smithi008.stdout: }, 2023-08-01T19:55:27.358 INFO:teuthology.orchestra.run.smithi008.stdout: { 2023-08-01T19:55:27.358 INFO:teuthology.orchestra.run.smithi008.stdout: "event": "dispatched", 2023-08-01T19:55:27.358 INFO:teuthology.orchestra.run.smithi008.stdout: "time": "2023-08-01T19:55:05.567175+0000", 2023-08-01T19:55:27.358 INFO:teuthology.orchestra.run.smithi008.stdout: "duration": 7.3919999999999997e-06 2023-08-01T19:55:27.358 INFO:teuthology.orchestra.run.smithi008.stdout: }, 2023-08-01T19:55:27.358 INFO:teuthology.orchestra.run.smithi008.stdout: { 2023-08-01T19:55:27.359 INFO:teuthology.orchestra.run.smithi008.stdout: "event": "queued_for_pg", 2023-08-01T19:55:27.359 INFO:teuthology.orchestra.run.smithi008.stdout: "time": "2023-08-01T19:55:05.567180+0000", 2023-08-01T19:55:27.359 INFO:teuthology.orchestra.run.smithi008.stdout: "duration": 5.3090000000000003e-06 2023-08-01T19:55:27.359 INFO:teuthology.orchestra.run.smithi008.stdout: }, 2023-08-01T19:55:27.359 INFO:teuthology.orchestra.run.smithi008.stdout: { 2023-08-01T19:55:27.359 INFO:teuthology.orchestra.run.smithi008.stdout: "event": "reached_pg", 2023-08-01T19:55:27.359 INFO:teuthology.orchestra.run.smithi008.stdout: "time": "2023-08-01T19:55:05.567210+0000", 2023-08-01T19:55:27.360 INFO:teuthology.orchestra.run.smithi008.stdout: "duration": 3.0001999999999998e-05 2023-08-01T19:55:27.360 INFO:teuthology.orchestra.run.smithi008.stdout: }, 2023-08-01T19:55:27.360 INFO:teuthology.orchestra.run.smithi008.stdout: { 2023-08-01T19:55:27.360 INFO:teuthology.orchestra.run.smithi008.stdout: "event": "started", 2023-08-01T19:55:27.360 INFO:teuthology.orchestra.run.smithi008.stdout: "time": "2023-08-01T19:55:05.567222+0000", 2023-08-01T19:55:27.360 INFO:teuthology.orchestra.run.smithi008.stdout: "duration": 1.1499e-05 2023-08-01T19:55:27.360 INFO:teuthology.orchestra.run.smithi008.stdout: }, 2023-08-01T19:55:27.360 INFO:teuthology.orchestra.run.smithi008.stdout: { 2023-08-01T19:55:27.361 INFO:teuthology.orchestra.run.smithi008.stdout: "event": "commit_sent", 2023-08-01T19:55:27.361 INFO:teuthology.orchestra.run.smithi008.stdout: "time": "2023-08-01T19:55:05.630772+0000", 2023-08-01T19:55:27.361 INFO:teuthology.orchestra.run.smithi008.stdout: "duration": 0.063550572999999999 2023-08-01T19:55:27.361 INFO:teuthology.orchestra.run.smithi008.stdout: }, 2023-08-01T19:55:27.361 INFO:teuthology.orchestra.run.smithi008.stdout: { 2023-08-01T19:55:27.361 INFO:teuthology.orchestra.run.smithi008.stdout: "event": "done", 2023-08-01T19:55:27.361 INFO:teuthology.orchestra.run.smithi008.stdout: "time": "2023-08-01T19:55:05.630809+0000", 2023-08-01T19:55:27.361 INFO:teuthology.orchestra.run.smithi008.stdout: "duration": 3.7033000000000003e-05 2023-08-01T19:55:27.362 INFO:teuthology.orchestra.run.smithi008.stdout: } 2023-08-01T19:55:27.362 INFO:teuthology.orchestra.run.smithi008.stdout: ] 2023-08-01T19:55:27.362 INFO:teuthology.orchestra.run.smithi008.stdout: } 2023-08-01T19:55:27.362 INFO:teuthology.orchestra.run.smithi008.stdout: }, 2023-08-01T19:55:27.362 INFO:teuthology.orchestra.run.smithi008.stdout: { 2023-08-01T19:55:27.362 INFO:teuthology.orchestra.run.smithi008.stdout: "description": "osd_repop(client.4668.0:100936 5.1 e37/19 5:8f4e3576:::benchmark_data_smithi006_114134_object100935:head v 37'6263, mlcod=37'6261)", 2023-08-01T19:55:27.362 INFO:teuthology.orchestra.run.smithi008.stdout: "initiated_at": "2023-08-01T19:55:05.567617+0000", 2023-08-01T19:55:27.362 INFO:teuthology.orchestra.run.smithi008.stdout: "age": 21.692128322999999, 2023-08-01T19:55:27.363 INFO:teuthology.orchestra.run.smithi008.stdout: "duration": 0.062773918999999997, 2023-08-01T19:55:27.363 INFO:teuthology.orchestra.run.smithi008.stdout: "type_data": { 2023-08-01T19:55:27.363 INFO:teuthology.orchestra.run.smithi008.stdout: "flag_point": "commit sent; apply or cleanup", 2023-08-01T19:55:27.363 INFO:teuthology.orchestra.run.smithi008.stdout: "events": [ 2023-08-01T19:55:27.363 INFO:teuthology.orchestra.run.smithi008.stdout: { 2023-08-01T19:55:27.363 INFO:teuthology.orchestra.run.smithi008.stdout: "event": "initiated", 2023-08-01T19:55:27.363 INFO:teuthology.orchestra.run.smithi008.stdout: "time": "2023-08-01T19:55:05.567617+0000", 2023-08-01T19:55:27.364 INFO:teuthology.orchestra.run.smithi008.stdout: "duration": 0 2023-08-01T19:55:27.364 INFO:teuthology.orchestra.run.smithi008.stdout: }, 2023-08-01T19:55:27.364 INFO:teuthology.orchestra.run.smithi008.stdout: { 2023-08-01T19:55:27.364 INFO:teuthology.orchestra.run.smithi008.stdout: "event": "throttled", 2023-08-01T19:55:27.365 INFO:teuthology.orchestra.run.smithi008.stdout: "time": "2023-08-01T19:55:05.567617+0000", 2023-08-01T19:55:27.365 INFO:teuthology.orchestra.run.smithi008.stdout: "duration": 0 2023-08-01T19:55:27.365 INFO:teuthology.orchestra.run.smithi008.stdout: }, 2023-08-01T19:55:27.365 INFO:teuthology.orchestra.run.smithi008.stdout: { 2023-08-01T19:55:27.365 INFO:teuthology.orchestra.run.smithi008.stdout: "event": "header_read", 2023-08-01T19:55:27.365 INFO:teuthology.orchestra.run.smithi008.stdout: "time": "2023-08-01T19:55:05.567617+0000", 2023-08-01T19:55:27.365 INFO:teuthology.orchestra.run.smithi008.stdout: "duration": 4294967295.9999995 2023-08-01T19:55:27.366 INFO:teuthology.orchestra.run.smithi008.stdout: }, 2023-08-01T19:55:27.366 INFO:teuthology.orchestra.run.smithi008.stdout: { 2023-08-01T19:55:27.366 INFO:teuthology.orchestra.run.smithi008.stdout: "event": "all_read", 2023-08-01T19:55:27.366 INFO:teuthology.orchestra.run.smithi008.stdout: "time": "2023-08-01T19:55:05.567700+0000", 2023-08-01T19:55:27.366 INFO:teuthology.orchestra.run.smithi008.stdout: "duration": 8.3363999999999997e-05 2023-08-01T19:55:27.366 INFO:teuthology.orchestra.run.smithi008.stdout: }, 2023-08-01T19:55:27.366 INFO:teuthology.orchestra.run.smithi008.stdout: { 2023-08-01T19:55:27.367 INFO:teuthology.orchestra.run.smithi008.stdout: "event": "dispatched", 2023-08-01T19:55:27.367 INFO:teuthology.orchestra.run.smithi008.stdout: "time": "2023-08-01T19:55:05.567706+0000", 2023-08-01T19:55:27.367 INFO:teuthology.orchestra.run.smithi008.stdout: "duration": 5.9739999999999999e-06 2023-08-01T19:55:27.367 INFO:teuthology.orchestra.run.smithi008.stdout: }, 2023-08-01T19:55:27.367 INFO:teuthology.orchestra.run.smithi008.stdout: { 2023-08-01T19:55:27.367 INFO:teuthology.orchestra.run.smithi008.stdout: "event": "queued_for_pg", 2023-08-01T19:55:27.367 INFO:teuthology.orchestra.run.smithi008.stdout: "time": "2023-08-01T19:55:05.567709+0000", 2023-08-01T19:55:27.367 INFO:teuthology.orchestra.run.smithi008.stdout: "duration": 3.1420000000000002e-06 2023-08-01T19:55:27.368 INFO:teuthology.orchestra.run.smithi008.stdout: }, 2023-08-01T19:55:27.368 INFO:teuthology.orchestra.run.smithi008.stdout: { 2023-08-01T19:55:27.368 INFO:teuthology.orchestra.run.smithi008.stdout: "event": "reached_pg", 2023-08-01T19:55:27.368 INFO:teuthology.orchestra.run.smithi008.stdout: "time": "2023-08-01T19:55:05.567741+0000", 2023-08-01T19:55:27.368 INFO:teuthology.orchestra.run.smithi008.stdout: "duration": 3.1532999999999998e-05 2023-08-01T19:55:27.369 INFO:teuthology.orchestra.run.smithi008.stdout: }, 2023-08-01T19:55:27.369 INFO:teuthology.orchestra.run.smithi008.stdout: { 2023-08-01T19:55:27.369 INFO:teuthology.orchestra.run.smithi008.stdout: "event": "started", 2023-08-01T19:55:27.369 INFO:teuthology.orchestra.run.smithi008.stdout: "time": "2023-08-01T19:55:05.567752+0000", 2023-08-01T19:55:27.369 INFO:teuthology.orchestra.run.smithi008.stdout: "duration": 1.1266e-05 2023-08-01T19:55:27.369 INFO:teuthology.orchestra.run.smithi008.stdout: }, 2023-08-01T19:55:27.370 INFO:teuthology.orchestra.run.smithi008.stdout: { 2023-08-01T19:55:27.370 INFO:teuthology.orchestra.run.smithi008.stdout: "event": "commit_sent", 2023-08-01T19:55:27.370 INFO:teuthology.orchestra.run.smithi008.stdout: "time": "2023-08-01T19:55:05.630357+0000", 2023-08-01T19:55:27.370 INFO:teuthology.orchestra.run.smithi008.stdout: "duration": 0.062604554000000007 2023-08-01T19:55:27.370 INFO:teuthology.orchestra.run.smithi008.stdout: }, 2023-08-01T19:55:27.370 INFO:teuthology.orchestra.run.smithi008.stdout: { 2023-08-01T19:55:27.371 INFO:teuthology.orchestra.run.smithi008.stdout: "event": "done", 2023-08-01T19:55:27.371 INFO:teuthology.orchestra.run.smithi008.stdout: "time": "2023-08-01T19:55:05.630391+0000", 2023-08-01T19:55:27.371 INFO:teuthology.orchestra.run.smithi008.stdout: "duration": 3.4619000000000002e-05 2023-08-01T19:55:27.371 INFO:teuthology.orchestra.run.smithi008.stdout: } 2023-08-01T19:55:27.372 INFO:teuthology.orchestra.run.smithi008.stdout: ] 2023-08-01T19:55:27.372 INFO:teuthology.orchestra.run.smithi008.stdout: } 2023-08-01T19:55:27.372 INFO:teuthology.orchestra.run.smithi008.stdout: }, 2023-08-01T19:55:27.372 INFO:teuthology.orchestra.run.smithi008.stdout: { 2023-08-01T19:55:27.373 INFO:teuthology.orchestra.run.smithi008.stdout: "description": "osd_op(client.4668.0:100937 5.c 5:34445fc3:::benchmark_data_smithi006_114134_object100936:head [set-alloc-hint object_size 65536 write_size 65536,write 0~65536] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e37)", 2023-08-01T19:55:27.373 INFO:teuthology.orchestra.run.smithi008.stdout: "initiated_at": "2023-08-01T19:55:05.569198+0000", 2023-08-01T19:55:27.373 INFO:teuthology.orchestra.run.smithi008.stdout: "age": 21.6905477, 2023-08-01T19:55:27.373 INFO:teuthology.orchestra.run.smithi008.stdout: "duration": 0.063349390000000005, 2023-08-01T19:55:27.373 INFO:teuthology.orchestra.run.smithi008.stdout: "type_data": { 2023-08-01T19:55:27.374 INFO:teuthology.orchestra.run.smithi008.stdout: "flag_point": "commit sent; apply or cleanup", 2023-08-01T19:55:27.374 INFO:teuthology.orchestra.run.smithi008.stdout: "client_info": { 2023-08-01T19:55:27.374 INFO:teuthology.orchestra.run.smithi008.stdout: "client": "client.4668", 2023-08-01T19:55:27.374 INFO:teuthology.orchestra.run.smithi008.stdout: "client_addr": "172.21.15.6:0/1709472247", 2023-08-01T19:55:27.375 INFO:teuthology.orchestra.run.smithi008.stdout: "tid": 100937 2023-08-01T19:55:27.375 INFO:teuthology.orchestra.run.smithi008.stdout: }, 2023-08-01T19:55:27.375 INFO:teuthology.orchestra.run.smithi008.stdout: "events": [ 2023-08-01T19:55:27.375 INFO:teuthology.orchestra.run.smithi008.stdout: { 2023-08-01T19:55:27.375 INFO:teuthology.orchestra.run.smithi008.stdout: "event": "initiated", 2023-08-01T19:55:27.375 INFO:teuthology.orchestra.run.smithi008.stdout: "time": "2023-08-01T19:55:05.569198+0000", 2023-08-01T19:55:27.375 INFO:teuthology.orchestra.run.smithi008.stdout: "duration": 0 2023-08-01T19:55:27.376 INFO:teuthology.orchestra.run.smithi008.stdout: }, 2023-08-01T19:55:27.376 INFO:teuthology.orchestra.run.smithi008.stdout: { 2023-08-01T19:55:27.376 INFO:teuthology.orchestra.run.smithi008.stdout: "event": "throttled", 2023-08-01T19:55:27.376 INFO:teuthology.orchestra.run.smithi008.stdout: "time": "2023-08-01T19:55:05.569198+0000", 2023-08-01T19:55:27.376 INFO:teuthology.orchestra.run.smithi008.stdout: "duration": 0 2023-08-01T19:55:27.376 INFO:teuthology.orchestra.run.smithi008.stdout: }, 2023-08-01T19:55:27.376 INFO:teuthology.orchestra.run.smithi008.stdout: { 2023-08-01T19:55:27.376 INFO:teuthology.orchestra.run.smithi008.stdout: "event": "header_read", 2023-08-01T19:55:27.377 INFO:teuthology.orchestra.run.smithi008.stdout: "time": "2023-08-01T19:55:05.569197+0000", 2023-08-01T19:55:27.377 INFO:teuthology.orchestra.run.smithi008.stdout: "duration": 4294967295.999999 2023-08-01T19:55:27.377 INFO:teuthology.orchestra.run.smithi008.stdout: }, 2023-08-01T19:55:27.377 INFO:teuthology.orchestra.run.smithi008.stdout: { 2023-08-01T19:55:27.377 INFO:teuthology.orchestra.run.smithi008.stdout: "event": "all_read", 2023-08-01T19:55:27.377 INFO:teuthology.orchestra.run.smithi008.stdout: "time": "2023-08-01T19:55:05.569250+0000", 2023-08-01T19:55:27.377 INFO:teuthology.orchestra.run.smithi008.stdout: "duration": 5.3106000000000003e-05 2023-08-01T19:55:27.377 INFO:teuthology.orchestra.run.smithi008.stdout: }, 2023-08-01T19:55:27.378 INFO:teuthology.orchestra.run.smithi008.stdout: { 2023-08-01T19:55:27.379 INFO:teuthology.orchestra.run.smithi008.stdout: "event": "dispatched", 2023-08-01T19:55:27.379 INFO:teuthology.orchestra.run.smithi008.stdout: "time": "2023-08-01T19:55:05.569260+0000", 2023-08-01T19:55:27.379 INFO:teuthology.orchestra.run.smithi008.stdout: "duration": 9.533e-06 2023-08-01T19:55:27.380 INFO:teuthology.orchestra.run.smithi008.stdout: }, 2023-08-01T19:55:27.380 INFO:teuthology.orchestra.run.smithi008.stdout: { 2023-08-01T19:55:27.380 INFO:teuthology.orchestra.run.smithi008.stdout: "event": "queued_for_pg", 2023-08-01T19:55:27.380 INFO:teuthology.orchestra.run.smithi008.stdout: "time": "2023-08-01T19:55:05.569264+0000", 2023-08-01T19:55:27.380 INFO:teuthology.orchestra.run.smithi008.stdout: "duration": 4.6099999999999999e-06 2023-08-01T19:55:27.380 INFO:teuthology.orchestra.run.smithi008.stdout: }, 2023-08-01T19:55:27.380 INFO:teuthology.orchestra.run.smithi008.stdout: { 2023-08-01T19:55:27.380 INFO:teuthology.orchestra.run.smithi008.stdout: "event": "reached_pg", 2023-08-01T19:55:27.381 INFO:teuthology.orchestra.run.smithi008.stdout: "time": "2023-08-01T19:55:05.569293+0000", 2023-08-01T19:55:27.381 INFO:teuthology.orchestra.run.smithi008.stdout: "duration": 2.8181999999999999e-05 2023-08-01T19:55:27.381 INFO:teuthology.orchestra.run.smithi008.stdout: }, 2023-08-01T19:55:27.381 INFO:teuthology.orchestra.run.smithi008.stdout: { 2023-08-01T19:55:27.381 INFO:teuthology.orchestra.run.smithi008.stdout: "event": "started", 2023-08-01T19:55:27.381 INFO:teuthology.orchestra.run.smithi008.stdout: "time": "2023-08-01T19:55:05.569401+0000", 2023-08-01T19:55:27.381 INFO:teuthology.orchestra.run.smithi008.stdout: "duration": 0.000108065 2023-08-01T19:55:27.382 INFO:teuthology.orchestra.run.smithi008.stdout: }, 2023-08-01T19:55:27.382 INFO:teuthology.orchestra.run.smithi008.stdout: { 2023-08-01T19:55:27.382 INFO:teuthology.orchestra.run.smithi008.stdout: "event": "waiting for subops from 1", 2023-08-01T19:55:27.382 INFO:teuthology.orchestra.run.smithi008.stdout: "time": "2023-08-01T19:55:05.569521+0000", 2023-08-01T19:55:27.382 INFO:teuthology.orchestra.run.smithi008.stdout: "duration": 0.00012006900000000001 2023-08-01T19:55:27.382 INFO:teuthology.orchestra.run.smithi008.stdout: }, 2023-08-01T19:55:27.382 INFO:teuthology.orchestra.run.smithi008.stdout: { 2023-08-01T19:55:27.382 INFO:teuthology.orchestra.run.smithi008.stdout: "event": "sub_op_commit_rec", 2023-08-01T19:55:27.383 INFO:teuthology.orchestra.run.smithi008.stdout: "time": "2023-08-01T19:55:05.629421+0000", 2023-08-01T19:55:27.383 INFO:teuthology.orchestra.run.smithi008.stdout: "duration": 0.059900525000000003 2023-08-01T19:55:27.383 INFO:teuthology.orchestra.run.smithi008.stdout: }, 2023-08-01T19:55:27.383 INFO:teuthology.orchestra.run.smithi008.stdout: { 2023-08-01T19:55:27.383 INFO:teuthology.orchestra.run.smithi008.stdout: "event": "op_commit", 2023-08-01T19:55:27.383 INFO:teuthology.orchestra.run.smithi008.stdout: "time": "2023-08-01T19:55:05.632461+0000", 2023-08-01T19:55:27.383 INFO:teuthology.orchestra.run.smithi008.stdout: "duration": 0.0030401220000000001 2023-08-01T19:55:27.383 INFO:teuthology.orchestra.run.smithi008.stdout: }, 2023-08-01T19:55:27.384 INFO:teuthology.orchestra.run.smithi008.stdout: { 2023-08-01T19:55:27.384 INFO:teuthology.orchestra.run.smithi008.stdout: "event": "commit_sent", 2023-08-01T19:55:27.384 INFO:teuthology.orchestra.run.smithi008.stdout: "time": "2023-08-01T19:55:05.632507+0000", 2023-08-01T19:55:27.384 INFO:teuthology.orchestra.run.smithi008.stdout: "duration": 4.5361999999999997e-05 2023-08-01T19:55:27.384 INFO:teuthology.orchestra.run.smithi008.stdout: }, 2023-08-01T19:55:27.384 INFO:teuthology.orchestra.run.smithi008.stdout: { 2023-08-01T19:55:27.384 INFO:teuthology.orchestra.run.smithi008.stdout: "event": "done", 2023-08-01T19:55:27.384 INFO:teuthology.orchestra.run.smithi008.stdout: "time": "2023-08-01T19:55:05.632547+0000", 2023-08-01T19:55:27.385 INFO:teuthology.orchestra.run.smithi008.stdout: "duration": 4.0760999999999998e-05 2023-08-01T19:55:27.385 INFO:teuthology.orchestra.run.smithi008.stdout: } 2023-08-01T19:55:27.385 INFO:teuthology.orchestra.run.smithi008.stdout: ] 2023-08-01T19:55:27.385 INFO:teuthology.orchestra.run.smithi008.stdout: } 2023-08-01T19:55:27.385 INFO:teuthology.orchestra.run.smithi008.stdout: }, 2023-08-01T19:55:27.385 INFO:teuthology.orchestra.run.smithi008.stdout: { 2023-08-01T19:55:27.385 INFO:teuthology.orchestra.run.smithi008.stdout: "description": "osd_op(client.4668.0:100939 5.5 5:a75fa6e3:::benchmark_data_smithi006_114134_object100938:head [set-alloc-hint object_size 65536 write_size 65536,write 0~65536] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e37)", 2023-08-01T19:55:27.385 INFO:teuthology.orchestra.run.smithi008.stdout: "initiated_at": "2023-08-01T19:55:05.569740+0000", 2023-08-01T19:55:27.386 INFO:teuthology.orchestra.run.smithi008.stdout: "age": 21.690006157999999, 2023-08-01T19:55:27.386 INFO:teuthology.orchestra.run.smithi008.stdout: "duration": 0.067753412999999998, 2023-08-01T19:55:27.386 INFO:teuthology.orchestra.run.smithi008.stdout: "type_data": { 2023-08-01T19:55:27.386 INFO:teuthology.orchestra.run.smithi008.stdout: "flag_point": "commit sent; apply or cleanup", 2023-08-01T19:55:27.386 INFO:teuthology.orchestra.run.smithi008.stdout: "client_info": { 2023-08-01T19:55:27.386 INFO:teuthology.orchestra.run.smithi008.stdout: "client": "client.4668", 2023-08-01T19:55:27.386 INFO:teuthology.orchestra.run.smithi008.stdout: "client_addr": "172.21.15.6:0/1709472247", 2023-08-01T19:55:27.386 INFO:teuthology.orchestra.run.smithi008.stdout: "tid": 100939 2023-08-01T19:55:27.387 INFO:teuthology.orchestra.run.smithi008.stdout: }, 2023-08-01T19:55:27.387 INFO:teuthology.orchestra.run.smithi008.stdout: "events": [ 2023-08-01T19:55:27.387 INFO:teuthology.orchestra.run.smithi008.stdout: { 2023-08-01T19:55:27.387 INFO:teuthology.orchestra.run.smithi008.stdout: "event": "initiated", 2023-08-01T19:55:27.388 INFO:teuthology.orchestra.run.smithi008.stdout: "time": "2023-08-01T19:55:05.569740+0000", 2023-08-01T19:55:27.388 INFO:teuthology.orchestra.run.smithi008.stdout: "duration": 0 2023-08-01T19:55:27.388 INFO:teuthology.orchestra.run.smithi008.stdout: }, 2023-08-01T19:55:27.389 INFO:teuthology.orchestra.run.smithi008.stdout: { 2023-08-01T19:55:27.389 INFO:teuthology.orchestra.run.smithi008.stdout: "event": "throttled", 2023-08-01T19:55:27.389 INFO:teuthology.orchestra.run.smithi008.stdout: "time": "2023-08-01T19:55:05.569740+0000", 2023-08-01T19:55:27.389 INFO:teuthology.orchestra.run.smithi008.stdout: "duration": 0 2023-08-01T19:55:27.389 INFO:teuthology.orchestra.run.smithi008.stdout: }, 2023-08-01T19:55:27.390 INFO:teuthology.orchestra.run.smithi008.stdout: { 2023-08-01T19:55:27.390 INFO:teuthology.orchestra.run.smithi008.stdout: "event": "header_read", 2023-08-01T19:55:27.390 INFO:teuthology.orchestra.run.smithi008.stdout: "time": "2023-08-01T19:55:05.569739+0000", 2023-08-01T19:55:27.390 INFO:teuthology.orchestra.run.smithi008.stdout: "duration": 4294967295.9999995 2023-08-01T19:55:27.390 INFO:teuthology.orchestra.run.smithi008.stdout: }, 2023-08-01T19:55:27.391 INFO:teuthology.orchestra.run.smithi008.stdout: { 2023-08-01T19:55:27.391 INFO:teuthology.orchestra.run.smithi008.stdout: "event": "all_read", 2023-08-01T19:55:27.391 INFO:teuthology.orchestra.run.smithi008.stdout: "time": "2023-08-01T19:55:05.569839+0000", 2023-08-01T19:55:27.391 INFO:teuthology.orchestra.run.smithi008.stdout: "duration": 0.000100219 2023-08-01T19:55:27.391 INFO:teuthology.orchestra.run.smithi008.stdout: }, 2023-08-01T19:55:27.391 INFO:teuthology.orchestra.run.smithi008.stdout: { 2023-08-01T19:55:27.392 INFO:teuthology.orchestra.run.smithi008.stdout: "event": "dispatched", 2023-08-01T19:55:27.392 INFO:teuthology.orchestra.run.smithi008.stdout: "time": "2023-08-01T19:55:05.569846+0000", 2023-08-01T19:55:27.392 INFO:teuthology.orchestra.run.smithi008.stdout: "duration": 7.3150000000000003e-06 2023-08-01T19:55:27.393 INFO:teuthology.orchestra.run.smithi008.stdout: }, 2023-08-01T19:55:27.393 INFO:teuthology.orchestra.run.smithi008.stdout: { 2023-08-01T19:55:27.393 INFO:teuthology.orchestra.run.smithi008.stdout: "event": "queued_for_pg", 2023-08-01T19:55:27.393 INFO:teuthology.orchestra.run.smithi008.stdout: "time": "2023-08-01T19:55:05.569850+0000", 2023-08-01T19:55:27.393 INFO:teuthology.orchestra.run.smithi008.stdout: "duration": 3.3299999999999999e-06 2023-08-01T19:55:27.394 INFO:teuthology.orchestra.run.smithi008.stdout: }, 2023-08-01T19:55:27.394 INFO:teuthology.orchestra.run.smithi008.stdout: { 2023-08-01T19:55:27.394 INFO:teuthology.orchestra.run.smithi008.stdout: "event": "reached_pg", 2023-08-01T19:55:27.394 INFO:teuthology.orchestra.run.smithi008.stdout: "time": "2023-08-01T19:55:05.626991+0000", 2023-08-01T19:55:27.394 INFO:teuthology.orchestra.run.smithi008.stdout: "duration": 0.057141585000000002 2023-08-01T19:55:27.394 INFO:teuthology.orchestra.run.smithi008.stdout: }, 2023-08-01T19:55:27.394 INFO:teuthology.orchestra.run.smithi008.stdout: { 2023-08-01T19:55:27.394 INFO:teuthology.orchestra.run.smithi008.stdout: "event": "started", 2023-08-01T19:55:27.395 INFO:teuthology.orchestra.run.smithi008.stdout: "time": "2023-08-01T19:55:05.627111+0000", 2023-08-01T19:55:27.395 INFO:teuthology.orchestra.run.smithi008.stdout: "duration": 0.000119238 2023-08-01T19:55:27.395 INFO:teuthology.orchestra.run.smithi008.stdout: }, 2023-08-01T19:55:27.395 INFO:teuthology.orchestra.run.smithi008.stdout: { 2023-08-01T19:55:27.395 INFO:teuthology.orchestra.run.smithi008.stdout: "event": "waiting for subops from 1", 2023-08-01T19:55:27.395 INFO:teuthology.orchestra.run.smithi008.stdout: "time": "2023-08-01T19:55:05.627253+0000", 2023-08-01T19:55:27.395 INFO:teuthology.orchestra.run.smithi008.stdout: "duration": 0.000142822 2023-08-01T19:55:27.396 INFO:teuthology.orchestra.run.smithi008.stdout: }, 2023-08-01T19:55:27.396 INFO:teuthology.orchestra.run.smithi008.stdout: { 2023-08-01T19:55:27.396 INFO:teuthology.orchestra.run.smithi008.stdout: "event": "op_commit", 2023-08-01T19:55:27.396 INFO:teuthology.orchestra.run.smithi008.stdout: "time": "2023-08-01T19:55:05.632555+0000", 2023-08-01T19:55:27.396 INFO:teuthology.orchestra.run.smithi008.stdout: "duration": 0.0053012449999999996 2023-08-01T19:55:27.396 INFO:teuthology.orchestra.run.smithi008.stdout: }, 2023-08-01T19:55:27.396 INFO:teuthology.orchestra.run.smithi008.stdout: { 2023-08-01T19:55:27.397 INFO:teuthology.orchestra.run.smithi008.stdout: "event": "sub_op_commit_rec", 2023-08-01T19:55:27.397 INFO:teuthology.orchestra.run.smithi008.stdout: "time": "2023-08-01T19:55:05.637380+0000", 2023-08-01T19:55:27.397 INFO:teuthology.orchestra.run.smithi008.stdout: "duration": 0.0048257639999999997 2023-08-01T19:55:27.397 INFO:teuthology.orchestra.run.smithi008.stdout: }, 2023-08-01T19:55:27.397 INFO:teuthology.orchestra.run.smithi008.stdout: { 2023-08-01T19:55:27.397 INFO:teuthology.orchestra.run.smithi008.stdout: "event": "commit_sent", 2023-08-01T19:55:27.397 INFO:teuthology.orchestra.run.smithi008.stdout: "time": "2023-08-01T19:55:05.637454+0000", 2023-08-01T19:55:27.397 INFO:teuthology.orchestra.run.smithi008.stdout: "duration": 7.3578999999999995e-05 2023-08-01T19:55:27.398 INFO:teuthology.orchestra.run.smithi008.stdout: }, 2023-08-01T19:55:27.398 INFO:teuthology.orchestra.run.smithi008.stdout: { 2023-08-01T19:55:27.398 INFO:teuthology.orchestra.run.smithi008.stdout: "event": "done", 2023-08-01T19:55:27.398 INFO:teuthology.orchestra.run.smithi008.stdout: "time": "2023-08-01T19:55:05.637493+0000", 2023-08-01T19:55:27.398 INFO:teuthology.orchestra.run.smithi008.stdout: "duration": 3.8986999999999998e-05 2023-08-01T19:55:27.398 INFO:teuthology.orchestra.run.smithi008.stdout: } 2023-08-01T19:55:27.398 INFO:teuthology.orchestra.run.smithi008.stdout: ] 2023-08-01T19:55:27.398 INFO:teuthology.orchestra.run.smithi008.stdout: } 2023-08-01T19:55:27.399 INFO:teuthology.orchestra.run.smithi008.stdout: }, 2023-08-01T19:55:27.399 INFO:teuthology.orchestra.run.smithi008.stdout: { 2023-08-01T19:55:27.399 INFO:teuthology.orchestra.run.smithi008.stdout: "description": "osd_repop(client.4668.0:100941 5.e e37/19 5:736a6ac6:::benchmark_data_smithi006_114134_object100940:head v 37'6306, mlcod=37'6303)", 2023-08-01T19:55:27.399 INFO:teuthology.orchestra.run.smithi008.stdout: "initiated_at": "2023-08-01T19:55:05.570237+0000", 2023-08-01T19:55:27.399 INFO:teuthology.orchestra.run.smithi008.stdout: "age": 21.689508847999999, 2023-08-01T19:55:27.399 INFO:teuthology.orchestra.run.smithi008.stdout: "duration": 0.064830421999999999, 2023-08-01T19:55:27.399 INFO:teuthology.orchestra.run.smithi008.stdout: "type_data": { 2023-08-01T19:55:27.400 INFO:teuthology.orchestra.run.smithi008.stdout: "flag_point": "commit sent; apply or cleanup", 2023-08-01T19:55:27.400 INFO:teuthology.orchestra.run.smithi008.stdout: "events": [ 2023-08-01T19:55:27.400 INFO:teuthology.orchestra.run.smithi008.stdout: { 2023-08-01T19:55:27.400 INFO:teuthology.orchestra.run.smithi008.stdout: "event": "initiated", 2023-08-01T19:55:27.400 INFO:teuthology.orchestra.run.smithi008.stdout: "time": "2023-08-01T19:55:05.570237+0000", 2023-08-01T19:55:27.400 INFO:teuthology.orchestra.run.smithi008.stdout: "duration": 0 2023-08-01T19:55:27.400 INFO:teuthology.orchestra.run.smithi008.stdout: }, 2023-08-01T19:55:27.400 INFO:teuthology.orchestra.run.smithi008.stdout: { 2023-08-01T19:55:27.401 INFO:teuthology.orchestra.run.smithi008.stdout: "event": "throttled", 2023-08-01T19:55:27.401 INFO:teuthology.orchestra.run.smithi008.stdout: "time": "2023-08-01T19:55:05.570237+0000", 2023-08-01T19:55:27.401 INFO:teuthology.orchestra.run.smithi008.stdout: "duration": 0 2023-08-01T19:55:27.401 INFO:teuthology.orchestra.run.smithi008.stdout: }, 2023-08-01T19:55:27.401 INFO:teuthology.orchestra.run.smithi008.stdout: { 2023-08-01T19:55:27.401 INFO:teuthology.orchestra.run.smithi008.stdout: "event": "header_read", 2023-08-01T19:55:27.401 INFO:teuthology.orchestra.run.smithi008.stdout: "time": "2023-08-01T19:55:05.570236+0000", 2023-08-01T19:55:27.402 INFO:teuthology.orchestra.run.smithi008.stdout: "duration": 4294967295.9999995 2023-08-01T19:55:27.402 INFO:teuthology.orchestra.run.smithi008.stdout: }, 2023-08-01T19:55:27.402 INFO:teuthology.orchestra.run.smithi008.stdout: { 2023-08-01T19:55:27.402 INFO:teuthology.orchestra.run.smithi008.stdout: "event": "all_read", 2023-08-01T19:55:27.402 INFO:teuthology.orchestra.run.smithi008.stdout: "time": "2023-08-01T19:55:05.570354+0000", 2023-08-01T19:55:27.402 INFO:teuthology.orchestra.run.smithi008.stdout: "duration": 0.000118029 2023-08-01T19:55:27.402 INFO:teuthology.orchestra.run.smithi008.stdout: }, 2023-08-01T19:55:27.402 INFO:teuthology.orchestra.run.smithi008.stdout: { 2023-08-01T19:55:27.403 INFO:teuthology.orchestra.run.smithi008.stdout: "event": "dispatched", 2023-08-01T19:55:27.403 INFO:teuthology.orchestra.run.smithi008.stdout: "time": "2023-08-01T19:55:05.626649+0000", 2023-08-01T19:55:27.403 INFO:teuthology.orchestra.run.smithi008.stdout: "duration": 0.056294489000000003 2023-08-01T19:55:27.403 INFO:teuthology.orchestra.run.smithi008.stdout: }, 2023-08-01T19:55:27.403 INFO:teuthology.orchestra.run.smithi008.stdout: { 2023-08-01T19:55:27.403 INFO:teuthology.orchestra.run.smithi008.stdout: "event": "queued_for_pg", 2023-08-01T19:55:27.403 INFO:teuthology.orchestra.run.smithi008.stdout: "time": "2023-08-01T19:55:05.626676+0000", 2023-08-01T19:55:27.403 INFO:teuthology.orchestra.run.smithi008.stdout: "duration": 2.7228000000000001e-05 2023-08-01T19:55:27.404 INFO:teuthology.orchestra.run.smithi008.stdout: }, 2023-08-01T19:55:27.404 INFO:teuthology.orchestra.run.smithi008.stdout: { 2023-08-01T19:55:27.404 INFO:teuthology.orchestra.run.smithi008.stdout: "event": "reached_pg", 2023-08-01T19:55:27.404 INFO:teuthology.orchestra.run.smithi008.stdout: "time": "2023-08-01T19:55:05.626717+0000", 2023-08-01T19:55:27.404 INFO:teuthology.orchestra.run.smithi008.stdout: "duration": 4.1318e-05 2023-08-01T19:55:27.404 INFO:teuthology.orchestra.run.smithi008.stdout: }, 2023-08-01T19:55:27.405 INFO:teuthology.orchestra.run.smithi008.stdout: { 2023-08-01T19:55:27.405 INFO:teuthology.orchestra.run.smithi008.stdout: "event": "started", 2023-08-01T19:55:27.405 INFO:teuthology.orchestra.run.smithi008.stdout: "time": "2023-08-01T19:55:05.626737+0000", 2023-08-01T19:55:27.405 INFO:teuthology.orchestra.run.smithi008.stdout: "duration": 1.9415e-05 2023-08-01T19:55:27.405 INFO:teuthology.orchestra.run.smithi008.stdout: }, 2023-08-01T19:55:27.405 INFO:teuthology.orchestra.run.smithi008.stdout: { 2023-08-01T19:55:27.405 INFO:teuthology.orchestra.run.smithi008.stdout: "event": "commit_sent", 2023-08-01T19:55:27.406 INFO:teuthology.orchestra.run.smithi008.stdout: "time": "2023-08-01T19:55:05.635036+0000", 2023-08-01T19:55:27.406 INFO:teuthology.orchestra.run.smithi008.stdout: "duration": 0.0082987700000000005 2023-08-01T19:55:27.406 INFO:teuthology.orchestra.run.smithi008.stdout: }, 2023-08-01T19:55:27.406 INFO:teuthology.orchestra.run.smithi008.stdout: { 2023-08-01T19:55:27.406 INFO:teuthology.orchestra.run.smithi008.stdout: "event": "done", 2023-08-01T19:55:27.407 INFO:teuthology.orchestra.run.smithi008.stdout: "time": "2023-08-01T19:55:05.635067+0000", 2023-08-01T19:55:27.407 INFO:teuthology.orchestra.run.smithi008.stdout: "duration": 3.1786999999999999e-05 2023-08-01T19:55:27.407 INFO:teuthology.orchestra.run.smithi008.stdout: } 2023-08-01T19:55:27.407 INFO:teuthology.orchestra.run.smithi008.stdout: ] 2023-08-01T19:55:27.407 INFO:teuthology.orchestra.run.smithi008.stdout: } 2023-08-01T19:55:27.407 INFO:teuthology.orchestra.run.smithi008.stdout: }, 2023-08-01T19:55:27.407 INFO:teuthology.orchestra.run.smithi008.stdout: { 2023-08-01T19:55:27.407 INFO:teuthology.orchestra.run.smithi008.stdout: "description": "osd_op(client.4668.0:107863 5.3 5:cbdd875a:::benchmark_data_smithi006_114134_object107862:head [set-alloc-hint object_size 65536 write_size 65536,write 0~65536] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e38)", 2023-08-01T19:55:27.408 INFO:teuthology.orchestra.run.smithi008.stdout: "initiated_at": "2023-08-01T19:55:09.278851+0000", 2023-08-01T19:55:27.408 INFO:teuthology.orchestra.run.smithi008.stdout: "age": 17.980894417999998, 2023-08-01T19:55:27.408 INFO:teuthology.orchestra.run.smithi008.stdout: "duration": 0.071378853000000006, 2023-08-01T19:55:27.408 INFO:teuthology.orchestra.run.smithi008.stdout: "type_data": { 2023-08-01T19:55:27.408 INFO:teuthology.orchestra.run.smithi008.stdout: "flag_point": "commit sent; apply or cleanup", 2023-08-01T19:55:27.408 INFO:teuthology.orchestra.run.smithi008.stdout: "client_info": { 2023-08-01T19:55:27.409 INFO:teuthology.orchestra.run.smithi008.stdout: "client": "client.4668", 2023-08-01T19:55:27.409 INFO:teuthology.orchestra.run.smithi008.stdout: "client_addr": "172.21.15.6:0/1709472247", 2023-08-01T19:55:27.409 INFO:teuthology.orchestra.run.smithi008.stdout: "tid": 107863 2023-08-01T19:55:27.409 INFO:teuthology.orchestra.run.smithi008.stdout: }, 2023-08-01T19:55:27.409 INFO:teuthology.orchestra.run.smithi008.stdout: "events": [ 2023-08-01T19:55:27.409 INFO:teuthology.orchestra.run.smithi008.stdout: { 2023-08-01T19:55:27.409 INFO:teuthology.orchestra.run.smithi008.stdout: "event": "initiated", 2023-08-01T19:55:27.409 INFO:teuthology.orchestra.run.smithi008.stdout: "time": "2023-08-01T19:55:09.278851+0000", 2023-08-01T19:55:27.410 INFO:teuthology.orchestra.run.smithi008.stdout: "duration": 0 2023-08-01T19:55:27.410 INFO:teuthology.orchestra.run.smithi008.stdout: }, 2023-08-01T19:55:27.410 INFO:teuthology.orchestra.run.smithi008.stdout: { 2023-08-01T19:55:27.410 INFO:teuthology.orchestra.run.smithi008.stdout: "event": "throttled", 2023-08-01T19:55:27.410 INFO:teuthology.orchestra.run.smithi008.stdout: "time": "2023-08-01T19:55:09.278851+0000", 2023-08-01T19:55:27.410 INFO:teuthology.orchestra.run.smithi008.stdout: "duration": 0 2023-08-01T19:55:27.410 INFO:teuthology.orchestra.run.smithi008.stdout: }, 2023-08-01T19:55:27.410 INFO:teuthology.orchestra.run.smithi008.stdout: { 2023-08-01T19:55:27.411 INFO:teuthology.orchestra.run.smithi008.stdout: "event": "header_read", 2023-08-01T19:55:27.411 INFO:teuthology.orchestra.run.smithi008.stdout: "time": "2023-08-01T19:55:09.278850+0000", 2023-08-01T19:55:27.411 INFO:teuthology.orchestra.run.smithi008.stdout: "duration": 4294967295.999999 2023-08-01T19:55:27.411 INFO:teuthology.orchestra.run.smithi008.stdout: }, 2023-08-01T19:55:27.411 INFO:teuthology.orchestra.run.smithi008.stdout: { 2023-08-01T19:55:27.411 INFO:teuthology.orchestra.run.smithi008.stdout: "event": "all_read", 2023-08-01T19:55:27.411 INFO:teuthology.orchestra.run.smithi008.stdout: "time": "2023-08-01T19:55:09.278945+0000", 2023-08-01T19:55:27.411 INFO:teuthology.orchestra.run.smithi008.stdout: "duration": 9.4388000000000005e-05 2023-08-01T19:55:27.412 INFO:teuthology.orchestra.run.smithi008.stdout: }, 2023-08-01T19:55:27.412 INFO:teuthology.orchestra.run.smithi008.stdout: { 2023-08-01T19:55:27.412 INFO:teuthology.orchestra.run.smithi008.stdout: "event": "dispatched", 2023-08-01T19:55:27.412 INFO:teuthology.orchestra.run.smithi008.stdout: "time": "2023-08-01T19:55:09.278955+0000", 2023-08-01T19:55:27.412 INFO:teuthology.orchestra.run.smithi008.stdout: "duration": 1.0413e-05 2023-08-01T19:55:27.412 INFO:teuthology.orchestra.run.smithi008.stdout: }, 2023-08-01T19:55:27.412 INFO:teuthology.orchestra.run.smithi008.stdout: { 2023-08-01T19:55:27.413 INFO:teuthology.orchestra.run.smithi008.stdout: "event": "queued_for_pg", 2023-08-01T19:55:27.413 INFO:teuthology.orchestra.run.smithi008.stdout: "time": "2023-08-01T19:55:09.278962+0000", 2023-08-01T19:55:27.413 INFO:teuthology.orchestra.run.smithi008.stdout: "duration": 6.2169999999999999e-06 2023-08-01T19:55:27.413 INFO:teuthology.orchestra.run.smithi008.stdout: }, 2023-08-01T19:55:27.413 INFO:teuthology.orchestra.run.smithi008.stdout: { 2023-08-01T19:55:27.413 INFO:teuthology.orchestra.run.smithi008.stdout: "event": "reached_pg", 2023-08-01T19:55:27.413 INFO:teuthology.orchestra.run.smithi008.stdout: "time": "2023-08-01T19:55:09.280363+0000", 2023-08-01T19:55:27.413 INFO:teuthology.orchestra.run.smithi008.stdout: "duration": 0.0014014489999999999 2023-08-01T19:55:27.414 INFO:teuthology.orchestra.run.smithi008.stdout: }, 2023-08-01T19:55:27.414 INFO:teuthology.orchestra.run.smithi008.stdout: { 2023-08-01T19:55:27.414 INFO:teuthology.orchestra.run.smithi008.stdout: "event": "started", 2023-08-01T19:55:27.414 INFO:teuthology.orchestra.run.smithi008.stdout: "time": "2023-08-01T19:55:09.280488+0000", 2023-08-01T19:55:27.414 INFO:teuthology.orchestra.run.smithi008.stdout: "duration": 0.00012474099999999999 2023-08-01T19:55:27.414 INFO:teuthology.orchestra.run.smithi008.stdout: }, 2023-08-01T19:55:27.414 INFO:teuthology.orchestra.run.smithi008.stdout: { 2023-08-01T19:55:27.414 INFO:teuthology.orchestra.run.smithi008.stdout: "event": "waiting for subops from 1", 2023-08-01T19:55:27.415 INFO:teuthology.orchestra.run.smithi008.stdout: "time": "2023-08-01T19:55:09.280626+0000", 2023-08-01T19:55:27.415 INFO:teuthology.orchestra.run.smithi008.stdout: "duration": 0.000138193 2023-08-01T19:55:27.415 INFO:teuthology.orchestra.run.smithi008.stdout: }, 2023-08-01T19:55:27.415 INFO:teuthology.orchestra.run.smithi008.stdout: { 2023-08-01T19:55:27.415 INFO:teuthology.orchestra.run.smithi008.stdout: "event": "op_commit", 2023-08-01T19:55:27.415 INFO:teuthology.orchestra.run.smithi008.stdout: "time": "2023-08-01T19:55:09.285958+0000", 2023-08-01T19:55:27.415 INFO:teuthology.orchestra.run.smithi008.stdout: "duration": 0.0053317130000000001 2023-08-01T19:55:27.415 INFO:teuthology.orchestra.run.smithi008.stdout: }, 2023-08-01T19:55:27.416 INFO:teuthology.orchestra.run.smithi008.stdout: { 2023-08-01T19:55:27.416 INFO:teuthology.orchestra.run.smithi008.stdout: "event": "sub_op_commit_rec", 2023-08-01T19:55:27.416 INFO:teuthology.orchestra.run.smithi008.stdout: "time": "2023-08-01T19:55:09.350151+0000", 2023-08-01T19:55:27.416 INFO:teuthology.orchestra.run.smithi008.stdout: "duration": 0.064193202000000005 2023-08-01T19:55:27.416 INFO:teuthology.orchestra.run.smithi008.stdout: }, 2023-08-01T19:55:27.416 INFO:teuthology.orchestra.run.smithi008.stdout: { 2023-08-01T19:55:27.416 INFO:teuthology.orchestra.run.smithi008.stdout: "event": "commit_sent", 2023-08-01T19:55:27.417 INFO:teuthology.orchestra.run.smithi008.stdout: "time": "2023-08-01T19:55:09.350188+0000", 2023-08-01T19:55:27.417 INFO:teuthology.orchestra.run.smithi008.stdout: "duration": 3.7549999999999998e-05 2023-08-01T19:55:27.417 INFO:teuthology.orchestra.run.smithi008.stdout: }, 2023-08-01T19:55:27.417 INFO:teuthology.orchestra.run.smithi008.stdout: { 2023-08-01T19:55:27.417 INFO:teuthology.orchestra.run.smithi008.stdout: "event": "done", 2023-08-01T19:55:27.417 INFO:teuthology.orchestra.run.smithi008.stdout: "time": "2023-08-01T19:55:09.350230+0000", 2023-08-01T19:55:27.417 INFO:teuthology.orchestra.run.smithi008.stdout: "duration": 4.1804999999999997e-05 2023-08-01T19:55:27.417 INFO:teuthology.orchestra.run.smithi008.stdout: } 2023-08-01T19:55:27.418 INFO:teuthology.orchestra.run.smithi008.stdout: ] 2023-08-01T19:55:27.418 INFO:teuthology.orchestra.run.smithi008.stdout: } 2023-08-01T19:55:27.418 INFO:teuthology.orchestra.run.smithi008.stdout: }, 2023-08-01T19:55:27.418 INFO:teuthology.orchestra.run.smithi008.stdout: { 2023-08-01T19:55:27.418 INFO:teuthology.orchestra.run.smithi008.stdout: "description": "osd_op(client.4668.0:107865 5.3 5:c2ebb96d:::benchmark_data_smithi006_114134_object107864:head [set-alloc-hint object_size 65536 write_size 65536,write 0~65536] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e38)", 2023-08-01T19:55:27.418 INFO:teuthology.orchestra.run.smithi008.stdout: "initiated_at": "2023-08-01T19:55:09.279020+0000", 2023-08-01T19:55:27.418 INFO:teuthology.orchestra.run.smithi008.stdout: "age": 17.980725746000001, 2023-08-01T19:55:27.418 INFO:teuthology.orchestra.run.smithi008.stdout: "duration": 0.072892565000000006, 2023-08-01T19:55:27.419 INFO:teuthology.orchestra.run.smithi008.stdout: "type_data": { 2023-08-01T19:55:27.419 INFO:teuthology.orchestra.run.smithi008.stdout: "flag_point": "commit sent; apply or cleanup", 2023-08-01T19:55:27.419 INFO:teuthology.orchestra.run.smithi008.stdout: "client_info": { 2023-08-01T19:55:27.419 INFO:teuthology.orchestra.run.smithi008.stdout: "client": "client.4668", 2023-08-01T19:55:27.419 INFO:teuthology.orchestra.run.smithi008.stdout: "client_addr": "172.21.15.6:0/1709472247", 2023-08-01T19:55:27.419 INFO:teuthology.orchestra.run.smithi008.stdout: "tid": 107865 2023-08-01T19:55:27.419 INFO:teuthology.orchestra.run.smithi008.stdout: }, 2023-08-01T19:55:27.419 INFO:teuthology.orchestra.run.smithi008.stdout: "events": [ 2023-08-01T19:55:27.420 INFO:teuthology.orchestra.run.smithi008.stdout: { 2023-08-01T19:55:27.420 INFO:teuthology.orchestra.run.smithi008.stdout: "event": "initiated", 2023-08-01T19:55:27.420 INFO:teuthology.orchestra.run.smithi008.stdout: "time": "2023-08-01T19:55:09.279020+0000", 2023-08-01T19:55:27.420 INFO:teuthology.orchestra.run.smithi008.stdout: "duration": 0 2023-08-01T19:55:27.420 INFO:teuthology.orchestra.run.smithi008.stdout: }, 2023-08-01T19:55:27.420 INFO:teuthology.orchestra.run.smithi008.stdout: { 2023-08-01T19:55:27.420 INFO:teuthology.orchestra.run.smithi008.stdout: "event": "throttled", 2023-08-01T19:55:27.421 INFO:teuthology.orchestra.run.smithi008.stdout: "time": "2023-08-01T19:55:09.279020+0000", 2023-08-01T19:55:27.421 INFO:teuthology.orchestra.run.smithi008.stdout: "duration": 0 2023-08-01T19:55:27.421 INFO:teuthology.orchestra.run.smithi008.stdout: }, 2023-08-01T19:55:27.421 INFO:teuthology.orchestra.run.smithi008.stdout: { 2023-08-01T19:55:27.421 INFO:teuthology.orchestra.run.smithi008.stdout: "event": "header_read", 2023-08-01T19:55:27.421 INFO:teuthology.orchestra.run.smithi008.stdout: "time": "2023-08-01T19:55:09.279019+0000", 2023-08-01T19:55:27.421 INFO:teuthology.orchestra.run.smithi008.stdout: "duration": 4294967295.999999 2023-08-01T19:55:27.422 INFO:teuthology.orchestra.run.smithi008.stdout: }, 2023-08-01T19:55:27.422 INFO:teuthology.orchestra.run.smithi008.stdout: { 2023-08-01T19:55:27.422 INFO:teuthology.orchestra.run.smithi008.stdout: "event": "all_read", 2023-08-01T19:55:27.422 INFO:teuthology.orchestra.run.smithi008.stdout: "time": "2023-08-01T19:55:09.279087+0000", 2023-08-01T19:55:27.422 INFO:teuthology.orchestra.run.smithi008.stdout: "duration": 6.8392000000000005e-05 2023-08-01T19:55:27.422 INFO:teuthology.orchestra.run.smithi008.stdout: }, 2023-08-01T19:55:27.422 INFO:teuthology.orchestra.run.smithi008.stdout: { 2023-08-01T19:55:27.422 INFO:teuthology.orchestra.run.smithi008.stdout: "event": "dispatched", 2023-08-01T19:55:27.423 INFO:teuthology.orchestra.run.smithi008.stdout: "time": "2023-08-01T19:55:09.279095+0000", 2023-08-01T19:55:27.423 INFO:teuthology.orchestra.run.smithi008.stdout: "duration": 8.0989999999999999e-06 2023-08-01T19:55:27.423 INFO:teuthology.orchestra.run.smithi008.stdout: }, 2023-08-01T19:55:27.423 INFO:teuthology.orchestra.run.smithi008.stdout: { 2023-08-01T19:55:27.423 INFO:teuthology.orchestra.run.smithi008.stdout: "event": "queued_for_pg", 2023-08-01T19:55:27.423 INFO:teuthology.orchestra.run.smithi008.stdout: "time": "2023-08-01T19:55:09.279101+0000", 2023-08-01T19:55:27.423 INFO:teuthology.orchestra.run.smithi008.stdout: "duration": 5.0390000000000004e-06 2023-08-01T19:55:27.424 INFO:teuthology.orchestra.run.smithi008.stdout: }, 2023-08-01T19:55:27.424 INFO:teuthology.orchestra.run.smithi008.stdout: { 2023-08-01T19:55:27.424 INFO:teuthology.orchestra.run.smithi008.stdout: "event": "reached_pg", 2023-08-01T19:55:27.424 INFO:teuthology.orchestra.run.smithi008.stdout: "time": "2023-08-01T19:55:09.282574+0000", 2023-08-01T19:55:27.424 INFO:teuthology.orchestra.run.smithi008.stdout: "duration": 0.0034730619999999999 2023-08-01T19:55:27.424 INFO:teuthology.orchestra.run.smithi008.stdout: }, 2023-08-01T19:55:27.424 INFO:teuthology.orchestra.run.smithi008.stdout: { 2023-08-01T19:55:27.425 INFO:teuthology.orchestra.run.smithi008.stdout: "event": "started", 2023-08-01T19:55:27.425 INFO:teuthology.orchestra.run.smithi008.stdout: "time": "2023-08-01T19:55:09.282705+0000", 2023-08-01T19:55:27.425 INFO:teuthology.orchestra.run.smithi008.stdout: "duration": 0.00013133400000000001 2023-08-01T19:55:27.425 INFO:teuthology.orchestra.run.smithi008.stdout: }, 2023-08-01T19:55:27.425 INFO:teuthology.orchestra.run.smithi008.stdout: { 2023-08-01T19:55:27.425 INFO:teuthology.orchestra.run.smithi008.stdout: "event": "waiting for subops from 1", 2023-08-01T19:55:27.425 INFO:teuthology.orchestra.run.smithi008.stdout: "time": "2023-08-01T19:55:09.283067+0000", 2023-08-01T19:55:27.425 INFO:teuthology.orchestra.run.smithi008.stdout: "duration": 0.00036195299999999998 2023-08-01T19:55:27.426 INFO:teuthology.orchestra.run.smithi008.stdout: }, 2023-08-01T19:55:27.426 INFO:teuthology.orchestra.run.smithi008.stdout: { 2023-08-01T19:55:27.426 INFO:teuthology.orchestra.run.smithi008.stdout: "event": "op_commit", 2023-08-01T19:55:27.426 INFO:teuthology.orchestra.run.smithi008.stdout: "time": "2023-08-01T19:55:09.288196+0000", 2023-08-01T19:55:27.426 INFO:teuthology.orchestra.run.smithi008.stdout: "duration": 0.0051293780000000004 2023-08-01T19:55:27.426 INFO:teuthology.orchestra.run.smithi008.stdout: }, 2023-08-01T19:55:27.426 INFO:teuthology.orchestra.run.smithi008.stdout: { 2023-08-01T19:55:27.426 INFO:teuthology.orchestra.run.smithi008.stdout: "event": "sub_op_commit_rec", 2023-08-01T19:55:27.427 INFO:teuthology.orchestra.run.smithi008.stdout: "time": "2023-08-01T19:55:09.351832+0000", 2023-08-01T19:55:27.427 INFO:teuthology.orchestra.run.smithi008.stdout: "duration": 0.063636076 2023-08-01T19:55:27.427 INFO:teuthology.orchestra.run.smithi008.stdout: }, 2023-08-01T19:55:27.427 INFO:teuthology.orchestra.run.smithi008.stdout: { 2023-08-01T19:55:27.427 INFO:teuthology.orchestra.run.smithi008.stdout: "event": "commit_sent", 2023-08-01T19:55:27.427 INFO:teuthology.orchestra.run.smithi008.stdout: "time": "2023-08-01T19:55:09.351878+0000", 2023-08-01T19:55:27.427 INFO:teuthology.orchestra.run.smithi008.stdout: "duration": 4.5408999999999998e-05 2023-08-01T19:55:27.427 INFO:teuthology.orchestra.run.smithi008.stdout: }, 2023-08-01T19:55:27.428 INFO:teuthology.orchestra.run.smithi008.stdout: { 2023-08-01T19:55:27.428 INFO:teuthology.orchestra.run.smithi008.stdout: "event": "done", 2023-08-01T19:55:27.428 INFO:teuthology.orchestra.run.smithi008.stdout: "time": "2023-08-01T19:55:09.351913+0000", 2023-08-01T19:55:27.428 INFO:teuthology.orchestra.run.smithi008.stdout: "duration": 3.4808999999999998e-05 2023-08-01T19:55:27.428 INFO:teuthology.orchestra.run.smithi008.stdout: } 2023-08-01T19:55:27.428 INFO:teuthology.orchestra.run.smithi008.stdout: ] 2023-08-01T19:55:27.428 INFO:teuthology.orchestra.run.smithi008.stdout: } 2023-08-01T19:55:27.429 INFO:teuthology.orchestra.run.smithi008.stdout: }, 2023-08-01T19:55:27.429 INFO:teuthology.orchestra.run.smithi008.stdout: { 2023-08-01T19:55:27.429 INFO:teuthology.orchestra.run.smithi008.stdout: "description": "osd_op(client.4668.0:107869 5.c 5:31910384:::benchmark_data_smithi006_114134_object107868:head [set-alloc-hint object_size 65536 write_size 65536,write 0~65536] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e38)", 2023-08-01T19:55:27.429 INFO:teuthology.orchestra.run.smithi008.stdout: "initiated_at": "2023-08-01T19:55:09.283205+0000", 2023-08-01T19:55:27.429 INFO:teuthology.orchestra.run.smithi008.stdout: "age": 17.976540580999998, 2023-08-01T19:55:27.429 INFO:teuthology.orchestra.run.smithi008.stdout: "duration": 0.068611808999999996, 2023-08-01T19:55:27.429 INFO:teuthology.orchestra.run.smithi008.stdout: "type_data": { 2023-08-01T19:55:27.430 INFO:teuthology.orchestra.run.smithi008.stdout: "flag_point": "commit sent; apply or cleanup", 2023-08-01T19:55:27.430 INFO:teuthology.orchestra.run.smithi008.stdout: "client_info": { 2023-08-01T19:55:27.430 INFO:teuthology.orchestra.run.smithi008.stdout: "client": "client.4668", 2023-08-01T19:55:27.430 INFO:teuthology.orchestra.run.smithi008.stdout: "client_addr": "172.21.15.6:0/1709472247", 2023-08-01T19:55:27.430 INFO:teuthology.orchestra.run.smithi008.stdout: "tid": 107869 2023-08-01T19:55:27.430 INFO:teuthology.orchestra.run.smithi008.stdout: }, 2023-08-01T19:55:27.430 INFO:teuthology.orchestra.run.smithi008.stdout: "events": [ 2023-08-01T19:55:27.430 INFO:teuthology.orchestra.run.smithi008.stdout: { 2023-08-01T19:55:27.431 INFO:teuthology.orchestra.run.smithi008.stdout: "event": "initiated", 2023-08-01T19:55:27.431 INFO:teuthology.orchestra.run.smithi008.stdout: "time": "2023-08-01T19:55:09.283205+0000", 2023-08-01T19:55:27.431 INFO:teuthology.orchestra.run.smithi008.stdout: "duration": 0 2023-08-01T19:55:27.431 INFO:teuthology.orchestra.run.smithi008.stdout: }, 2023-08-01T19:55:27.431 INFO:teuthology.orchestra.run.smithi008.stdout: { 2023-08-01T19:55:27.431 INFO:teuthology.orchestra.run.smithi008.stdout: "event": "throttled", 2023-08-01T19:55:27.431 INFO:teuthology.orchestra.run.smithi008.stdout: "time": "2023-08-01T19:55:09.283205+0000", 2023-08-01T19:55:27.432 INFO:teuthology.orchestra.run.smithi008.stdout: "duration": 0 2023-08-01T19:55:27.432 INFO:teuthology.orchestra.run.smithi008.stdout: }, 2023-08-01T19:55:27.432 INFO:teuthology.orchestra.run.smithi008.stdout: { 2023-08-01T19:55:27.432 INFO:teuthology.orchestra.run.smithi008.stdout: "event": "header_read", 2023-08-01T19:55:27.432 INFO:teuthology.orchestra.run.smithi008.stdout: "time": "2023-08-01T19:55:09.283204+0000", 2023-08-01T19:55:27.432 INFO:teuthology.orchestra.run.smithi008.stdout: "duration": 4294967295.999999 2023-08-01T19:55:27.432 INFO:teuthology.orchestra.run.smithi008.stdout: }, 2023-08-01T19:55:27.432 INFO:teuthology.orchestra.run.smithi008.stdout: { 2023-08-01T19:55:27.433 INFO:teuthology.orchestra.run.smithi008.stdout: "event": "all_read", 2023-08-01T19:55:27.433 INFO:teuthology.orchestra.run.smithi008.stdout: "time": "2023-08-01T19:55:09.283300+0000", 2023-08-01T19:55:27.433 INFO:teuthology.orchestra.run.smithi008.stdout: "duration": 9.6280000000000007e-05 2023-08-01T19:55:27.433 INFO:teuthology.orchestra.run.smithi008.stdout: }, 2023-08-01T19:55:27.433 INFO:teuthology.orchestra.run.smithi008.stdout: { 2023-08-01T19:55:27.433 INFO:teuthology.orchestra.run.smithi008.stdout: "event": "dispatched", 2023-08-01T19:55:27.433 INFO:teuthology.orchestra.run.smithi008.stdout: "time": "2023-08-01T19:55:09.283314+0000", 2023-08-01T19:55:27.433 INFO:teuthology.orchestra.run.smithi008.stdout: "duration": 1.3344e-05 2023-08-01T19:55:27.434 INFO:teuthology.orchestra.run.smithi008.stdout: }, 2023-08-01T19:55:27.434 INFO:teuthology.orchestra.run.smithi008.stdout: { 2023-08-01T19:55:27.434 INFO:teuthology.orchestra.run.smithi008.stdout: "event": "queued_for_pg", 2023-08-01T19:55:27.434 INFO:teuthology.orchestra.run.smithi008.stdout: "time": "2023-08-01T19:55:09.283320+0000", 2023-08-01T19:55:27.434 INFO:teuthology.orchestra.run.smithi008.stdout: "duration": 6.0299999999999999e-06 2023-08-01T19:55:27.434 INFO:teuthology.orchestra.run.smithi008.stdout: }, 2023-08-01T19:55:27.435 INFO:teuthology.orchestra.run.smithi008.stdout: { 2023-08-01T19:55:27.435 INFO:teuthology.orchestra.run.smithi008.stdout: "event": "reached_pg", 2023-08-01T19:55:27.435 INFO:teuthology.orchestra.run.smithi008.stdout: "time": "2023-08-01T19:55:09.283365+0000", 2023-08-01T19:55:27.435 INFO:teuthology.orchestra.run.smithi008.stdout: "duration": 4.5578999999999998e-05 2023-08-01T19:55:27.435 INFO:teuthology.orchestra.run.smithi008.stdout: }, 2023-08-01T19:55:27.435 INFO:teuthology.orchestra.run.smithi008.stdout: { 2023-08-01T19:55:27.435 INFO:teuthology.orchestra.run.smithi008.stdout: "event": "started", 2023-08-01T19:55:27.435 INFO:teuthology.orchestra.run.smithi008.stdout: "time": "2023-08-01T19:55:09.283490+0000", 2023-08-01T19:55:27.436 INFO:teuthology.orchestra.run.smithi008.stdout: "duration": 0.00012473700000000001 2023-08-01T19:55:27.436 INFO:teuthology.orchestra.run.smithi008.stdout: }, 2023-08-01T19:55:27.436 INFO:teuthology.orchestra.run.smithi008.stdout: { 2023-08-01T19:55:27.436 INFO:teuthology.orchestra.run.smithi008.stdout: "event": "waiting for subops from 1", 2023-08-01T19:55:27.436 INFO:teuthology.orchestra.run.smithi008.stdout: "time": "2023-08-01T19:55:09.283637+0000", 2023-08-01T19:55:27.436 INFO:teuthology.orchestra.run.smithi008.stdout: "duration": 0.00014715600000000001 2023-08-01T19:55:27.436 INFO:teuthology.orchestra.run.smithi008.stdout: }, 2023-08-01T19:55:27.437 INFO:teuthology.orchestra.run.smithi008.stdout: { 2023-08-01T19:55:27.437 INFO:teuthology.orchestra.run.smithi008.stdout: "event": "op_commit", 2023-08-01T19:55:27.437 INFO:teuthology.orchestra.run.smithi008.stdout: "time": "2023-08-01T19:55:09.288214+0000", 2023-08-01T19:55:27.437 INFO:teuthology.orchestra.run.smithi008.stdout: "duration": 0.0045769560000000001 2023-08-01T19:55:27.437 INFO:teuthology.orchestra.run.smithi008.stdout: }, 2023-08-01T19:55:27.437 INFO:teuthology.orchestra.run.smithi008.stdout: { 2023-08-01T19:55:27.437 INFO:teuthology.orchestra.run.smithi008.stdout: "event": "sub_op_commit_rec", 2023-08-01T19:55:27.438 INFO:teuthology.orchestra.run.smithi008.stdout: "time": "2023-08-01T19:55:09.351721+0000", 2023-08-01T19:55:27.438 INFO:teuthology.orchestra.run.smithi008.stdout: "duration": 0.063507383000000001 2023-08-01T19:55:27.438 INFO:teuthology.orchestra.run.smithi008.stdout: }, 2023-08-01T19:55:27.438 INFO:teuthology.orchestra.run.smithi008.stdout: { 2023-08-01T19:55:27.438 INFO:teuthology.orchestra.run.smithi008.stdout: "event": "commit_sent", 2023-08-01T19:55:27.438 INFO:teuthology.orchestra.run.smithi008.stdout: "time": "2023-08-01T19:55:09.351777+0000", 2023-08-01T19:55:27.438 INFO:teuthology.orchestra.run.smithi008.stdout: "duration": 5.5733999999999999e-05 2023-08-01T19:55:27.438 INFO:teuthology.orchestra.run.smithi008.stdout: }, 2023-08-01T19:55:27.439 INFO:teuthology.orchestra.run.smithi008.stdout: { 2023-08-01T19:55:27.439 INFO:teuthology.orchestra.run.smithi008.stdout: "event": "done", 2023-08-01T19:55:27.439 INFO:teuthology.orchestra.run.smithi008.stdout: "time": "2023-08-01T19:55:09.351817+0000", 2023-08-01T19:55:27.439 INFO:teuthology.orchestra.run.smithi008.stdout: "duration": 3.9765000000000003e-05 2023-08-01T19:55:27.439 INFO:teuthology.orchestra.run.smithi008.stdout: } 2023-08-01T19:55:27.439 INFO:teuthology.orchestra.run.smithi008.stdout: ] 2023-08-01T19:55:27.439 INFO:teuthology.orchestra.run.smithi008.stdout: } 2023-08-01T19:55:27.439 INFO:teuthology.orchestra.run.smithi008.stdout: }, 2023-08-01T19:55:27.440 INFO:teuthology.orchestra.run.smithi008.stdout: { 2023-08-01T19:55:27.440 INFO:teuthology.orchestra.run.smithi008.stdout: "description": "osd_op(client.4668.0:107874 5.3 5:ce4c2799:::benchmark_data_smithi006_114134_object107873:head [set-alloc-hint object_size 65536 write_size 65536,write 0~65536] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e38)", 2023-08-01T19:55:27.440 INFO:teuthology.orchestra.run.smithi008.stdout: "initiated_at": "2023-08-01T19:55:09.286239+0000", 2023-08-01T19:55:27.440 INFO:teuthology.orchestra.run.smithi008.stdout: "age": 17.973507076000001, 2023-08-01T19:55:27.440 INFO:teuthology.orchestra.run.smithi008.stdout: "duration": 0.068224389999999996, 2023-08-01T19:55:27.440 INFO:teuthology.orchestra.run.smithi008.stdout: "type_data": { 2023-08-01T19:55:27.440 INFO:teuthology.orchestra.run.smithi008.stdout: "flag_point": "commit sent; apply or cleanup", 2023-08-01T19:55:27.441 INFO:teuthology.orchestra.run.smithi008.stdout: "client_info": { 2023-08-01T19:55:27.441 INFO:teuthology.orchestra.run.smithi008.stdout: "client": "client.4668", 2023-08-01T19:55:27.441 INFO:teuthology.orchestra.run.smithi008.stdout: "client_addr": "172.21.15.6:0/1709472247", 2023-08-01T19:55:27.441 INFO:teuthology.orchestra.run.smithi008.stdout: "tid": 107874 2023-08-01T19:55:27.441 INFO:teuthology.orchestra.run.smithi008.stdout: }, 2023-08-01T19:55:27.441 INFO:teuthology.orchestra.run.smithi008.stdout: "events": [ 2023-08-01T19:55:27.441 INFO:teuthology.orchestra.run.smithi008.stdout: { 2023-08-01T19:55:27.441 INFO:teuthology.orchestra.run.smithi008.stdout: "event": "initiated", 2023-08-01T19:55:27.442 INFO:teuthology.orchestra.run.smithi008.stdout: "time": "2023-08-01T19:55:09.286239+0000", 2023-08-01T19:55:27.442 INFO:teuthology.orchestra.run.smithi008.stdout: "duration": 0 2023-08-01T19:55:27.442 INFO:teuthology.orchestra.run.smithi008.stdout: }, 2023-08-01T19:55:27.442 INFO:teuthology.orchestra.run.smithi008.stdout: { 2023-08-01T19:55:27.442 INFO:teuthology.orchestra.run.smithi008.stdout: "event": "throttled", 2023-08-01T19:55:27.442 INFO:teuthology.orchestra.run.smithi008.stdout: "time": "2023-08-01T19:55:09.286239+0000", 2023-08-01T19:55:27.442 INFO:teuthology.orchestra.run.smithi008.stdout: "duration": 0 2023-08-01T19:55:27.442 INFO:teuthology.orchestra.run.smithi008.stdout: }, 2023-08-01T19:55:27.443 INFO:teuthology.orchestra.run.smithi008.stdout: { 2023-08-01T19:55:27.443 INFO:teuthology.orchestra.run.smithi008.stdout: "event": "header_read", 2023-08-01T19:55:27.443 INFO:teuthology.orchestra.run.smithi008.stdout: "time": "2023-08-01T19:55:09.286238+0000", 2023-08-01T19:55:27.443 INFO:teuthology.orchestra.run.smithi008.stdout: "duration": 4294967295.999999 2023-08-01T19:55:27.443 INFO:teuthology.orchestra.run.smithi008.stdout: }, 2023-08-01T19:55:27.443 INFO:teuthology.orchestra.run.smithi008.stdout: { 2023-08-01T19:55:27.443 INFO:teuthology.orchestra.run.smithi008.stdout: "event": "all_read", 2023-08-01T19:55:27.443 INFO:teuthology.orchestra.run.smithi008.stdout: "time": "2023-08-01T19:55:09.286310+0000", 2023-08-01T19:55:27.444 INFO:teuthology.orchestra.run.smithi008.stdout: "duration": 7.2583999999999995e-05 2023-08-01T19:55:27.444 INFO:teuthology.orchestra.run.smithi008.stdout: }, 2023-08-01T19:55:27.444 INFO:teuthology.orchestra.run.smithi008.stdout: { 2023-08-01T19:55:27.444 INFO:teuthology.orchestra.run.smithi008.stdout: "event": "dispatched", 2023-08-01T19:55:27.444 INFO:teuthology.orchestra.run.smithi008.stdout: "time": "2023-08-01T19:55:09.286323+0000", 2023-08-01T19:55:27.444 INFO:teuthology.orchestra.run.smithi008.stdout: "duration": 1.3151e-05 2023-08-01T19:55:27.444 INFO:teuthology.orchestra.run.smithi008.stdout: }, 2023-08-01T19:55:27.445 INFO:teuthology.orchestra.run.smithi008.stdout: { 2023-08-01T19:55:27.445 INFO:teuthology.orchestra.run.smithi008.stdout: "event": "queued_for_pg", 2023-08-01T19:55:27.445 INFO:teuthology.orchestra.run.smithi008.stdout: "time": "2023-08-01T19:55:09.286329+0000", 2023-08-01T19:55:27.445 INFO:teuthology.orchestra.run.smithi008.stdout: "duration": 5.8719999999999999e-06 2023-08-01T19:55:27.445 INFO:teuthology.orchestra.run.smithi008.stdout: }, 2023-08-01T19:55:27.445 INFO:teuthology.orchestra.run.smithi008.stdout: { 2023-08-01T19:55:27.445 INFO:teuthology.orchestra.run.smithi008.stdout: "event": "reached_pg", 2023-08-01T19:55:27.446 INFO:teuthology.orchestra.run.smithi008.stdout: "time": "2023-08-01T19:55:09.286392+0000", 2023-08-01T19:55:27.446 INFO:teuthology.orchestra.run.smithi008.stdout: "duration": 6.2378000000000005e-05 2023-08-01T19:55:27.446 INFO:teuthology.orchestra.run.smithi008.stdout: }, 2023-08-01T19:55:27.446 INFO:teuthology.orchestra.run.smithi008.stdout: { 2023-08-01T19:55:27.446 INFO:teuthology.orchestra.run.smithi008.stdout: "event": "started", 2023-08-01T19:55:27.446 INFO:teuthology.orchestra.run.smithi008.stdout: "time": "2023-08-01T19:55:09.286473+0000", 2023-08-01T19:55:27.446 INFO:teuthology.orchestra.run.smithi008.stdout: "duration": 8.1327000000000002e-05 2023-08-01T19:55:27.446 INFO:teuthology.orchestra.run.smithi008.stdout: }, 2023-08-01T19:55:27.447 INFO:teuthology.orchestra.run.smithi008.stdout: { 2023-08-01T19:55:27.447 INFO:teuthology.orchestra.run.smithi008.stdout: "event": "waiting for subops from 1", 2023-08-01T19:55:27.447 INFO:teuthology.orchestra.run.smithi008.stdout: "time": "2023-08-01T19:55:09.286557+0000", 2023-08-01T19:55:27.447 INFO:teuthology.orchestra.run.smithi008.stdout: "duration": 8.4140000000000004e-05 2023-08-01T19:55:27.447 INFO:teuthology.orchestra.run.smithi008.stdout: }, 2023-08-01T19:55:27.447 INFO:teuthology.orchestra.run.smithi008.stdout: { 2023-08-01T19:55:27.447 INFO:teuthology.orchestra.run.smithi008.stdout: "event": "op_commit", 2023-08-01T19:55:27.447 INFO:teuthology.orchestra.run.smithi008.stdout: "time": "2023-08-01T19:55:09.290681+0000", 2023-08-01T19:55:27.448 INFO:teuthology.orchestra.run.smithi008.stdout: "duration": 0.0041242420000000002 2023-08-01T19:55:27.448 INFO:teuthology.orchestra.run.smithi008.stdout: }, 2023-08-01T19:55:27.448 INFO:teuthology.orchestra.run.smithi008.stdout: { 2023-08-01T19:55:27.448 INFO:teuthology.orchestra.run.smithi008.stdout: "event": "sub_op_commit_rec", 2023-08-01T19:55:27.448 INFO:teuthology.orchestra.run.smithi008.stdout: "time": "2023-08-01T19:55:09.354372+0000", 2023-08-01T19:55:27.448 INFO:teuthology.orchestra.run.smithi008.stdout: "duration": 0.063690438000000002 2023-08-01T19:55:27.448 INFO:teuthology.orchestra.run.smithi008.stdout: }, 2023-08-01T19:55:27.449 INFO:teuthology.orchestra.run.smithi008.stdout: { 2023-08-01T19:55:27.449 INFO:teuthology.orchestra.run.smithi008.stdout: "event": "commit_sent", 2023-08-01T19:55:27.449 INFO:teuthology.orchestra.run.smithi008.stdout: "time": "2023-08-01T19:55:09.354421+0000", 2023-08-01T19:55:27.449 INFO:teuthology.orchestra.run.smithi008.stdout: "duration": 4.9413000000000003e-05 2023-08-01T19:55:27.449 INFO:teuthology.orchestra.run.smithi008.stdout: }, 2023-08-01T19:55:27.449 INFO:teuthology.orchestra.run.smithi008.stdout: { 2023-08-01T19:55:27.449 INFO:teuthology.orchestra.run.smithi008.stdout: "event": "done", 2023-08-01T19:55:27.449 INFO:teuthology.orchestra.run.smithi008.stdout: "time": "2023-08-01T19:55:09.354463+0000", 2023-08-01T19:55:27.450 INFO:teuthology.orchestra.run.smithi008.stdout: "duration": 4.1924e-05 2023-08-01T19:55:27.450 INFO:teuthology.orchestra.run.smithi008.stdout: } 2023-08-01T19:55:27.450 INFO:teuthology.orchestra.run.smithi008.stdout: ] 2023-08-01T19:55:27.450 INFO:teuthology.orchestra.run.smithi008.stdout: } 2023-08-01T19:55:27.450 INFO:teuthology.orchestra.run.smithi008.stdout: }, 2023-08-01T19:55:27.450 INFO:teuthology.orchestra.run.smithi008.stdout: { 2023-08-01T19:55:27.450 INFO:teuthology.orchestra.run.smithi008.stdout: "description": "osd_op(client.4668.0:107875 5.5 5:af4ec927:::benchmark_data_smithi006_114134_object107874:head [set-alloc-hint object_size 65536 write_size 65536,write 0~65536] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e38)", 2023-08-01T19:55:27.450 INFO:teuthology.orchestra.run.smithi008.stdout: "initiated_at": "2023-08-01T19:55:09.287186+0000", 2023-08-01T19:55:27.451 INFO:teuthology.orchestra.run.smithi008.stdout: "age": 17.972559288999999, 2023-08-01T19:55:27.451 INFO:teuthology.orchestra.run.smithi008.stdout: "duration": 0.064764719999999998, 2023-08-01T19:55:27.451 INFO:teuthology.orchestra.run.smithi008.stdout: "type_data": { 2023-08-01T19:55:27.451 INFO:teuthology.orchestra.run.smithi008.stdout: "flag_point": "commit sent; apply or cleanup", 2023-08-01T19:55:27.451 INFO:teuthology.orchestra.run.smithi008.stdout: "client_info": { 2023-08-01T19:55:27.451 INFO:teuthology.orchestra.run.smithi008.stdout: "client": "client.4668", 2023-08-01T19:55:27.451 INFO:teuthology.orchestra.run.smithi008.stdout: "client_addr": "172.21.15.6:0/1709472247", 2023-08-01T19:55:27.452 INFO:teuthology.orchestra.run.smithi008.stdout: "tid": 107875 2023-08-01T19:55:27.452 INFO:teuthology.orchestra.run.smithi008.stdout: }, 2023-08-01T19:55:27.452 INFO:teuthology.orchestra.run.smithi008.stdout: "events": [ 2023-08-01T19:55:27.452 INFO:teuthology.orchestra.run.smithi008.stdout: { 2023-08-01T19:55:27.452 INFO:teuthology.orchestra.run.smithi008.stdout: "event": "initiated", 2023-08-01T19:55:27.452 INFO:teuthology.orchestra.run.smithi008.stdout: "time": "2023-08-01T19:55:09.287186+0000", 2023-08-01T19:55:27.452 INFO:teuthology.orchestra.run.smithi008.stdout: "duration": 0 2023-08-01T19:55:27.453 INFO:teuthology.orchestra.run.smithi008.stdout: }, 2023-08-01T19:55:27.453 INFO:teuthology.orchestra.run.smithi008.stdout: { 2023-08-01T19:55:27.453 INFO:teuthology.orchestra.run.smithi008.stdout: "event": "throttled", 2023-08-01T19:55:27.453 INFO:teuthology.orchestra.run.smithi008.stdout: "time": "2023-08-01T19:55:09.287186+0000", 2023-08-01T19:55:27.453 INFO:teuthology.orchestra.run.smithi008.stdout: "duration": 0 2023-08-01T19:55:27.453 INFO:teuthology.orchestra.run.smithi008.stdout: }, 2023-08-01T19:55:27.453 INFO:teuthology.orchestra.run.smithi008.stdout: { 2023-08-01T19:55:27.453 INFO:teuthology.orchestra.run.smithi008.stdout: "event": "header_read", 2023-08-01T19:55:27.454 INFO:teuthology.orchestra.run.smithi008.stdout: "time": "2023-08-01T19:55:09.287186+0000", 2023-08-01T19:55:27.454 INFO:teuthology.orchestra.run.smithi008.stdout: "duration": 4294967295.999999 2023-08-01T19:55:27.454 INFO:teuthology.orchestra.run.smithi008.stdout: }, 2023-08-01T19:55:27.454 INFO:teuthology.orchestra.run.smithi008.stdout: { 2023-08-01T19:55:27.454 INFO:teuthology.orchestra.run.smithi008.stdout: "event": "all_read", 2023-08-01T19:55:27.454 INFO:teuthology.orchestra.run.smithi008.stdout: "time": "2023-08-01T19:55:09.287248+0000", 2023-08-01T19:55:27.454 INFO:teuthology.orchestra.run.smithi008.stdout: "duration": 6.2922000000000005e-05 2023-08-01T19:55:27.454 INFO:teuthology.orchestra.run.smithi008.stdout: }, 2023-08-01T19:55:27.455 INFO:teuthology.orchestra.run.smithi008.stdout: { 2023-08-01T19:55:27.455 INFO:teuthology.orchestra.run.smithi008.stdout: "event": "dispatched", 2023-08-01T19:55:27.455 INFO:teuthology.orchestra.run.smithi008.stdout: "time": "2023-08-01T19:55:09.287261+0000", 2023-08-01T19:55:27.455 INFO:teuthology.orchestra.run.smithi008.stdout: "duration": 1.2364000000000001e-05 2023-08-01T19:55:27.455 INFO:teuthology.orchestra.run.smithi008.stdout: }, 2023-08-01T19:55:27.455 INFO:teuthology.orchestra.run.smithi008.stdout: { 2023-08-01T19:55:27.455 INFO:teuthology.orchestra.run.smithi008.stdout: "event": "queued_for_pg", 2023-08-01T19:55:27.456 INFO:teuthology.orchestra.run.smithi008.stdout: "time": "2023-08-01T19:55:09.287267+0000", 2023-08-01T19:55:27.456 INFO:teuthology.orchestra.run.smithi008.stdout: "duration": 6.2580000000000001e-06 2023-08-01T19:55:27.456 INFO:teuthology.orchestra.run.smithi008.stdout: }, 2023-08-01T19:55:27.456 INFO:teuthology.orchestra.run.smithi008.stdout: { 2023-08-01T19:55:27.456 INFO:teuthology.orchestra.run.smithi008.stdout: "event": "reached_pg", 2023-08-01T19:55:27.456 INFO:teuthology.orchestra.run.smithi008.stdout: "time": "2023-08-01T19:55:09.287306+0000", 2023-08-01T19:55:27.456 INFO:teuthology.orchestra.run.smithi008.stdout: "duration": 3.9057999999999998e-05 2023-08-01T19:55:27.457 INFO:teuthology.orchestra.run.smithi008.stdout: }, 2023-08-01T19:55:27.457 INFO:teuthology.orchestra.run.smithi008.stdout: { 2023-08-01T19:55:27.457 INFO:teuthology.orchestra.run.smithi008.stdout: "event": "started", 2023-08-01T19:55:27.457 INFO:teuthology.orchestra.run.smithi008.stdout: "time": "2023-08-01T19:55:09.287419+0000", 2023-08-01T19:55:27.457 INFO:teuthology.orchestra.run.smithi008.stdout: "duration": 0.000112843 2023-08-01T19:55:27.457 INFO:teuthology.orchestra.run.smithi008.stdout: }, 2023-08-01T19:55:27.457 INFO:teuthology.orchestra.run.smithi008.stdout: { 2023-08-01T19:55:27.457 INFO:teuthology.orchestra.run.smithi008.stdout: "event": "waiting for subops from 1", 2023-08-01T19:55:27.458 INFO:teuthology.orchestra.run.smithi008.stdout: "time": "2023-08-01T19:55:09.287514+0000", 2023-08-01T19:55:27.458 INFO:teuthology.orchestra.run.smithi008.stdout: "duration": 9.5068000000000005e-05 2023-08-01T19:55:27.458 INFO:teuthology.orchestra.run.smithi008.stdout: }, 2023-08-01T19:55:27.458 INFO:teuthology.orchestra.run.smithi008.stdout: { 2023-08-01T19:55:27.458 INFO:teuthology.orchestra.run.smithi008.stdout: "event": "op_commit", 2023-08-01T19:55:27.458 INFO:teuthology.orchestra.run.smithi008.stdout: "time": "2023-08-01T19:55:09.293891+0000", 2023-08-01T19:55:27.458 INFO:teuthology.orchestra.run.smithi008.stdout: "duration": 0.00637712 2023-08-01T19:55:27.459 INFO:teuthology.orchestra.run.smithi008.stdout: }, 2023-08-01T19:55:27.459 INFO:teuthology.orchestra.run.smithi008.stdout: { 2023-08-01T19:55:27.459 INFO:teuthology.orchestra.run.smithi008.stdout: "event": "sub_op_commit_rec", 2023-08-01T19:55:27.459 INFO:teuthology.orchestra.run.smithi008.stdout: "time": "2023-08-01T19:55:09.351871+0000", 2023-08-01T19:55:27.459 INFO:teuthology.orchestra.run.smithi008.stdout: "duration": 0.057980054000000003 2023-08-01T19:55:27.459 INFO:teuthology.orchestra.run.smithi008.stdout: }, 2023-08-01T19:55:27.459 INFO:teuthology.orchestra.run.smithi008.stdout: { 2023-08-01T19:55:27.459 INFO:teuthology.orchestra.run.smithi008.stdout: "event": "commit_sent", 2023-08-01T19:55:27.460 INFO:teuthology.orchestra.run.smithi008.stdout: "time": "2023-08-01T19:55:09.351917+0000", 2023-08-01T19:55:27.460 INFO:teuthology.orchestra.run.smithi008.stdout: "duration": 4.5501999999999999e-05 2023-08-01T19:55:27.460 INFO:teuthology.orchestra.run.smithi008.stdout: }, 2023-08-01T19:55:27.460 INFO:teuthology.orchestra.run.smithi008.stdout: { 2023-08-01T19:55:27.460 INFO:teuthology.orchestra.run.smithi008.stdout: "event": "done", 2023-08-01T19:55:27.460 INFO:teuthology.orchestra.run.smithi008.stdout: "time": "2023-08-01T19:55:09.351951+0000", 2023-08-01T19:55:27.460 INFO:teuthology.orchestra.run.smithi008.stdout: "duration": 3.4450999999999999e-05 2023-08-01T19:55:27.460 INFO:teuthology.orchestra.run.smithi008.stdout: } 2023-08-01T19:55:27.461 INFO:teuthology.orchestra.run.smithi008.stdout: ] 2023-08-01T19:55:27.461 INFO:teuthology.orchestra.run.smithi008.stdout: } 2023-08-01T19:55:27.461 INFO:teuthology.orchestra.run.smithi008.stdout: }, 2023-08-01T19:55:27.461 INFO:teuthology.orchestra.run.smithi008.stdout: { 2023-08-01T19:55:27.461 INFO:teuthology.orchestra.run.smithi008.stdout: "description": "osd_op(client.4668.0:107880 5.5 5:a8d12d4b:::benchmark_data_smithi006_114134_object107879:head [set-alloc-hint object_size 65536 write_size 65536,write 0~65536] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e38)", 2023-08-01T19:55:27.461 INFO:teuthology.orchestra.run.smithi008.stdout: "initiated_at": "2023-08-01T19:55:09.292335+0000", 2023-08-01T19:55:27.461 INFO:teuthology.orchestra.run.smithi008.stdout: "age": 17.967410688000001, 2023-08-01T19:55:27.461 INFO:teuthology.orchestra.run.smithi008.stdout: "duration": 0.061350719999999997, 2023-08-01T19:55:27.462 INFO:teuthology.orchestra.run.smithi008.stdout: "type_data": { 2023-08-01T19:55:27.462 INFO:teuthology.orchestra.run.smithi008.stdout: "flag_point": "commit sent; apply or cleanup", 2023-08-01T19:55:27.462 INFO:teuthology.orchestra.run.smithi008.stdout: "client_info": { 2023-08-01T19:55:27.462 INFO:teuthology.orchestra.run.smithi008.stdout: "client": "client.4668", 2023-08-01T19:55:27.462 INFO:teuthology.orchestra.run.smithi008.stdout: "client_addr": "172.21.15.6:0/1709472247", 2023-08-01T19:55:27.462 INFO:teuthology.orchestra.run.smithi008.stdout: "tid": 107880 2023-08-01T19:55:27.462 INFO:teuthology.orchestra.run.smithi008.stdout: }, 2023-08-01T19:55:27.462 INFO:teuthology.orchestra.run.smithi008.stdout: "events": [ 2023-08-01T19:55:27.463 INFO:teuthology.orchestra.run.smithi008.stdout: { 2023-08-01T19:55:27.463 INFO:teuthology.orchestra.run.smithi008.stdout: "event": "initiated", 2023-08-01T19:55:27.463 INFO:teuthology.orchestra.run.smithi008.stdout: "time": "2023-08-01T19:55:09.292335+0000", 2023-08-01T19:55:27.463 INFO:teuthology.orchestra.run.smithi008.stdout: "duration": 0 2023-08-01T19:55:27.463 INFO:teuthology.orchestra.run.smithi008.stdout: }, 2023-08-01T19:55:27.463 INFO:teuthology.orchestra.run.smithi008.stdout: { 2023-08-01T19:55:27.463 INFO:teuthology.orchestra.run.smithi008.stdout: "event": "throttled", 2023-08-01T19:55:27.464 INFO:teuthology.orchestra.run.smithi008.stdout: "time": "2023-08-01T19:55:09.292335+0000", 2023-08-01T19:55:27.464 INFO:teuthology.orchestra.run.smithi008.stdout: "duration": 0 2023-08-01T19:55:27.464 INFO:teuthology.orchestra.run.smithi008.stdout: }, 2023-08-01T19:55:27.464 INFO:teuthology.orchestra.run.smithi008.stdout: { 2023-08-01T19:55:27.464 INFO:teuthology.orchestra.run.smithi008.stdout: "event": "header_read", 2023-08-01T19:55:27.464 INFO:teuthology.orchestra.run.smithi008.stdout: "time": "2023-08-01T19:55:09.292334+0000", 2023-08-01T19:55:27.464 INFO:teuthology.orchestra.run.smithi008.stdout: "duration": 4294967295.999999 2023-08-01T19:55:27.464 INFO:teuthology.orchestra.run.smithi008.stdout: }, 2023-08-01T19:55:27.465 INFO:teuthology.orchestra.run.smithi008.stdout: { 2023-08-01T19:55:27.465 INFO:teuthology.orchestra.run.smithi008.stdout: "event": "all_read", 2023-08-01T19:55:27.465 INFO:teuthology.orchestra.run.smithi008.stdout: "time": "2023-08-01T19:55:09.292449+0000", 2023-08-01T19:55:27.465 INFO:teuthology.orchestra.run.smithi008.stdout: "duration": 0.00011551400000000001 2023-08-01T19:55:27.466 INFO:teuthology.orchestra.run.smithi008.stdout: }, 2023-08-01T19:55:27.466 INFO:teuthology.orchestra.run.smithi008.stdout: { 2023-08-01T19:55:27.466 INFO:teuthology.orchestra.run.smithi008.stdout: "event": "dispatched", 2023-08-01T19:55:27.466 INFO:teuthology.orchestra.run.smithi008.stdout: "time": "2023-08-01T19:55:09.292461+0000", 2023-08-01T19:55:27.466 INFO:teuthology.orchestra.run.smithi008.stdout: "duration": 1.1287000000000001e-05 2023-08-01T19:55:27.466 INFO:teuthology.orchestra.run.smithi008.stdout: }, 2023-08-01T19:55:27.466 INFO:teuthology.orchestra.run.smithi008.stdout: { 2023-08-01T19:55:27.467 INFO:teuthology.orchestra.run.smithi008.stdout: "event": "queued_for_pg", 2023-08-01T19:55:27.467 INFO:teuthology.orchestra.run.smithi008.stdout: "time": "2023-08-01T19:55:09.292467+0000", 2023-08-01T19:55:27.467 INFO:teuthology.orchestra.run.smithi008.stdout: "duration": 6.4520000000000002e-06 2023-08-01T19:55:27.467 INFO:teuthology.orchestra.run.smithi008.stdout: }, 2023-08-01T19:55:27.467 INFO:teuthology.orchestra.run.smithi008.stdout: { 2023-08-01T19:55:27.467 INFO:teuthology.orchestra.run.smithi008.stdout: "event": "reached_pg", 2023-08-01T19:55:27.467 INFO:teuthology.orchestra.run.smithi008.stdout: "time": "2023-08-01T19:55:09.292510+0000", 2023-08-01T19:55:27.467 INFO:teuthology.orchestra.run.smithi008.stdout: "duration": 4.2502000000000001e-05 2023-08-01T19:55:27.468 INFO:teuthology.orchestra.run.smithi008.stdout: }, 2023-08-01T19:55:27.468 INFO:teuthology.orchestra.run.smithi008.stdout: { 2023-08-01T19:55:27.468 INFO:teuthology.orchestra.run.smithi008.stdout: "event": "started", 2023-08-01T19:55:27.468 INFO:teuthology.orchestra.run.smithi008.stdout: "time": "2023-08-01T19:55:09.292596+0000", 2023-08-01T19:55:27.468 INFO:teuthology.orchestra.run.smithi008.stdout: "duration": 8.6545000000000006e-05 2023-08-01T19:55:27.468 INFO:teuthology.orchestra.run.smithi008.stdout: }, 2023-08-01T19:55:27.468 INFO:teuthology.orchestra.run.smithi008.stdout: { 2023-08-01T19:55:27.468 INFO:teuthology.orchestra.run.smithi008.stdout: "event": "waiting for subops from 1", 2023-08-01T19:55:27.469 INFO:teuthology.orchestra.run.smithi008.stdout: "time": "2023-08-01T19:55:09.292697+0000", 2023-08-01T19:55:27.469 INFO:teuthology.orchestra.run.smithi008.stdout: "duration": 0.000100368 2023-08-01T19:55:27.469 INFO:teuthology.orchestra.run.smithi008.stdout: }, 2023-08-01T19:55:27.469 INFO:teuthology.orchestra.run.smithi008.stdout: { 2023-08-01T19:55:27.469 INFO:teuthology.orchestra.run.smithi008.stdout: "event": "op_commit", 2023-08-01T19:55:27.469 INFO:teuthology.orchestra.run.smithi008.stdout: "time": "2023-08-01T19:55:09.295658+0000", 2023-08-01T19:55:27.469 INFO:teuthology.orchestra.run.smithi008.stdout: "duration": 0.0029617290000000002 2023-08-01T19:55:27.470 INFO:teuthology.orchestra.run.smithi008.stdout: }, 2023-08-01T19:55:27.470 INFO:teuthology.orchestra.run.smithi008.stdout: { 2023-08-01T19:55:27.470 INFO:teuthology.orchestra.run.smithi008.stdout: "event": "sub_op_commit_rec", 2023-08-01T19:55:27.470 INFO:teuthology.orchestra.run.smithi008.stdout: "time": "2023-08-01T19:55:09.353604+0000", 2023-08-01T19:55:27.470 INFO:teuthology.orchestra.run.smithi008.stdout: "duration": 0.057945868999999997 2023-08-01T19:55:27.470 INFO:teuthology.orchestra.run.smithi008.stdout: }, 2023-08-01T19:55:27.470 INFO:teuthology.orchestra.run.smithi008.stdout: { 2023-08-01T19:55:27.471 INFO:teuthology.orchestra.run.smithi008.stdout: "event": "commit_sent", 2023-08-01T19:55:27.471 INFO:teuthology.orchestra.run.smithi008.stdout: "time": "2023-08-01T19:55:09.353650+0000", 2023-08-01T19:55:27.471 INFO:teuthology.orchestra.run.smithi008.stdout: "duration": 4.5698999999999997e-05 2023-08-01T19:55:27.471 INFO:teuthology.orchestra.run.smithi008.stdout: }, 2023-08-01T19:55:27.471 INFO:teuthology.orchestra.run.smithi008.stdout: { 2023-08-01T19:55:27.471 INFO:teuthology.orchestra.run.smithi008.stdout: "event": "done", 2023-08-01T19:55:27.471 INFO:teuthology.orchestra.run.smithi008.stdout: "time": "2023-08-01T19:55:09.353686+0000", 2023-08-01T19:55:27.471 INFO:teuthology.orchestra.run.smithi008.stdout: "duration": 3.5936999999999998e-05 2023-08-01T19:55:27.472 INFO:teuthology.orchestra.run.smithi008.stdout: } 2023-08-01T19:55:27.472 INFO:teuthology.orchestra.run.smithi008.stdout: ] 2023-08-01T19:55:27.472 INFO:teuthology.orchestra.run.smithi008.stdout: } 2023-08-01T19:55:27.472 INFO:teuthology.orchestra.run.smithi008.stdout: } 2023-08-01T19:55:27.472 INFO:teuthology.orchestra.run.smithi008.stdout: ] 2023-08-01T19:55:27.472 INFO:teuthology.orchestra.run.smithi008.stdout:} 2023-08-01T19:55:27.473 INFO:tasks.ceph.osd.2.smithi155.stderr:2023-08-01T19:55:27.472+0000 7faa5c6ac700 -1 received signal: Hangup from /usr/bin/python3 /bin/daemon-helper kill ceph-osd -f --cluster ceph -i 2 (PID: 111337) UID: 0 2023-08-01T19:55:27.474 DEBUG:teuthology.orchestra.run.smithi101:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 30 ceph --cluster ceph --admin-daemon /var/run/ceph/ceph-osd.1.asok dump_ops_in_flight 2023-08-01T19:55:27.574 INFO:tasks.ceph.osd.1.smithi101.stderr:2023-08-01T19:55:27.573+0000 7fb0cb7f6700 -1 received signal: Hangup from /usr/bin/python3 /bin/daemon-helper kill ceph-osd -f --cluster ceph -i 1 (PID: 111141) UID: 0 2023-08-01T19:55:27.626 INFO:teuthology.orchestra.run.smithi101.stdout:{ 2023-08-01T19:55:27.626 INFO:teuthology.orchestra.run.smithi101.stdout: "ops": [ 2023-08-01T19:55:27.626 INFO:teuthology.orchestra.run.smithi101.stdout: { 2023-08-01T19:55:27.626 INFO:teuthology.orchestra.run.smithi101.stdout: "description": "osd_repop(client.4668.0:138345 5.c e46/19 5:34f03d8d:::benchmark_data_smithi006_114134_object4684:head v 46'8607, mlcod=46'8605)", 2023-08-01T19:55:27.626 INFO:teuthology.orchestra.run.smithi101.stdout: "initiated_at": "2023-08-01T19:55:27.622472+0000", 2023-08-01T19:55:27.627 INFO:teuthology.orchestra.run.smithi101.stdout: "age": 0.0024394740000000001, 2023-08-01T19:55:27.627 INFO:teuthology.orchestra.run.smithi101.stdout: "duration": 0.0024595239999999998, 2023-08-01T19:55:27.627 INFO:teuthology.orchestra.run.smithi101.stdout: "type_data": { 2023-08-01T19:55:27.627 INFO:teuthology.orchestra.run.smithi101.stdout: "flag_point": "started", 2023-08-01T19:55:27.627 INFO:teuthology.orchestra.run.smithi101.stdout: "events": [ 2023-08-01T19:55:27.627 INFO:teuthology.orchestra.run.smithi101.stdout: { 2023-08-01T19:55:27.627 INFO:teuthology.orchestra.run.smithi101.stdout: "event": "initiated", 2023-08-01T19:55:27.627 INFO:teuthology.orchestra.run.smithi101.stdout: "time": "2023-08-01T19:55:27.622472+0000", 2023-08-01T19:55:27.628 INFO:teuthology.orchestra.run.smithi101.stdout: "duration": 0 2023-08-01T19:55:27.628 INFO:teuthology.orchestra.run.smithi101.stdout: }, 2023-08-01T19:55:27.628 INFO:teuthology.orchestra.run.smithi101.stdout: { 2023-08-01T19:55:27.628 INFO:teuthology.orchestra.run.smithi101.stdout: "event": "throttled", 2023-08-01T19:55:27.628 INFO:teuthology.orchestra.run.smithi101.stdout: "time": "2023-08-01T19:55:27.622472+0000", 2023-08-01T19:55:27.628 INFO:teuthology.orchestra.run.smithi101.stdout: "duration": 0 2023-08-01T19:55:27.628 INFO:teuthology.orchestra.run.smithi101.stdout: }, 2023-08-01T19:55:27.629 INFO:teuthology.orchestra.run.smithi101.stdout: { 2023-08-01T19:55:27.629 INFO:teuthology.orchestra.run.smithi101.stdout: "event": "header_read", 2023-08-01T19:55:27.629 INFO:teuthology.orchestra.run.smithi101.stdout: "time": "2023-08-01T19:55:27.622471+0000", 2023-08-01T19:55:27.629 INFO:teuthology.orchestra.run.smithi101.stdout: "duration": 4294967295.9999995 2023-08-01T19:55:27.629 INFO:teuthology.orchestra.run.smithi101.stdout: }, 2023-08-01T19:55:27.629 INFO:teuthology.orchestra.run.smithi101.stdout: { 2023-08-01T19:55:27.629 INFO:teuthology.orchestra.run.smithi101.stdout: "event": "all_read", 2023-08-01T19:55:27.629 INFO:teuthology.orchestra.run.smithi101.stdout: "time": "2023-08-01T19:55:27.622475+0000", 2023-08-01T19:55:27.630 INFO:teuthology.orchestra.run.smithi101.stdout: "duration": 3.8e-06 2023-08-01T19:55:27.630 INFO:teuthology.orchestra.run.smithi101.stdout: }, 2023-08-01T19:55:27.630 INFO:teuthology.orchestra.run.smithi101.stdout: { 2023-08-01T19:55:27.630 INFO:teuthology.orchestra.run.smithi101.stdout: "event": "dispatched", 2023-08-01T19:55:27.630 INFO:teuthology.orchestra.run.smithi101.stdout: "time": "2023-08-01T19:55:27.622483+0000", 2023-08-01T19:55:27.630 INFO:teuthology.orchestra.run.smithi101.stdout: "duration": 8.2269999999999993e-06 2023-08-01T19:55:27.630 INFO:teuthology.orchestra.run.smithi101.stdout: }, 2023-08-01T19:55:27.630 INFO:teuthology.orchestra.run.smithi101.stdout: { 2023-08-01T19:55:27.631 INFO:teuthology.orchestra.run.smithi101.stdout: "event": "queued_for_pg", 2023-08-01T19:55:27.631 INFO:teuthology.orchestra.run.smithi101.stdout: "time": "2023-08-01T19:55:27.622488+0000", 2023-08-01T19:55:27.631 INFO:teuthology.orchestra.run.smithi101.stdout: "duration": 4.3370000000000001e-06 2023-08-01T19:55:27.631 INFO:teuthology.orchestra.run.smithi101.stdout: }, 2023-08-01T19:55:27.631 INFO:teuthology.orchestra.run.smithi101.stdout: { 2023-08-01T19:55:27.631 INFO:teuthology.orchestra.run.smithi101.stdout: "event": "reached_pg", 2023-08-01T19:55:27.631 INFO:teuthology.orchestra.run.smithi101.stdout: "time": "2023-08-01T19:55:27.622546+0000", 2023-08-01T19:55:27.632 INFO:teuthology.orchestra.run.smithi101.stdout: "duration": 5.8074e-05 2023-08-01T19:55:27.632 INFO:teuthology.orchestra.run.smithi101.stdout: }, 2023-08-01T19:55:27.632 INFO:teuthology.orchestra.run.smithi101.stdout: { 2023-08-01T19:55:27.632 INFO:teuthology.orchestra.run.smithi101.stdout: "event": "started", 2023-08-01T19:55:27.632 INFO:teuthology.orchestra.run.smithi101.stdout: "time": "2023-08-01T19:55:27.622559+0000", 2023-08-01T19:55:27.632 INFO:teuthology.orchestra.run.smithi101.stdout: "duration": 1.3035e-05 2023-08-01T19:55:27.632 INFO:teuthology.orchestra.run.smithi101.stdout: } 2023-08-01T19:55:27.633 INFO:teuthology.orchestra.run.smithi101.stdout: ] 2023-08-01T19:55:27.633 INFO:teuthology.orchestra.run.smithi101.stdout: } 2023-08-01T19:55:27.633 INFO:teuthology.orchestra.run.smithi101.stdout: }, 2023-08-01T19:55:27.633 INFO:teuthology.orchestra.run.smithi101.stdout: { 2023-08-01T19:55:27.633 INFO:teuthology.orchestra.run.smithi101.stdout: "description": "osd_repop(client.4668.0:138346 5.f e46/40 5:ffddc1e7:::benchmark_data_smithi006_114134_object4685:head v 46'8668, mlcod=46'8666)", 2023-08-01T19:55:27.633 INFO:teuthology.orchestra.run.smithi101.stdout: "initiated_at": "2023-08-01T19:55:27.622608+0000", 2023-08-01T19:55:27.633 INFO:teuthology.orchestra.run.smithi101.stdout: "age": 0.0023033049999999998, 2023-08-01T19:55:27.633 INFO:teuthology.orchestra.run.smithi101.stdout: "duration": 0.002368191, 2023-08-01T19:55:27.634 INFO:teuthology.orchestra.run.smithi101.stdout: "type_data": { 2023-08-01T19:55:27.634 INFO:teuthology.orchestra.run.smithi101.stdout: "flag_point": "started", 2023-08-01T19:55:27.634 INFO:teuthology.orchestra.run.smithi101.stdout: "events": [ 2023-08-01T19:55:27.634 INFO:teuthology.orchestra.run.smithi101.stdout: { 2023-08-01T19:55:27.634 INFO:teuthology.orchestra.run.smithi101.stdout: "event": "initiated", 2023-08-01T19:55:27.634 INFO:teuthology.orchestra.run.smithi101.stdout: "time": "2023-08-01T19:55:27.622608+0000", 2023-08-01T19:55:27.634 INFO:teuthology.orchestra.run.smithi101.stdout: "duration": 0 2023-08-01T19:55:27.635 INFO:teuthology.orchestra.run.smithi101.stdout: }, 2023-08-01T19:55:27.635 INFO:teuthology.orchestra.run.smithi101.stdout: { 2023-08-01T19:55:27.635 INFO:teuthology.orchestra.run.smithi101.stdout: "event": "throttled", 2023-08-01T19:55:27.635 INFO:teuthology.orchestra.run.smithi101.stdout: "time": "2023-08-01T19:55:27.622608+0000", 2023-08-01T19:55:27.635 INFO:teuthology.orchestra.run.smithi101.stdout: "duration": 0 2023-08-01T19:55:27.635 INFO:teuthology.orchestra.run.smithi101.stdout: }, 2023-08-01T19:55:27.635 INFO:teuthology.orchestra.run.smithi101.stdout: { 2023-08-01T19:55:27.636 INFO:teuthology.orchestra.run.smithi101.stdout: "event": "header_read", 2023-08-01T19:55:27.636 INFO:teuthology.orchestra.run.smithi101.stdout: "time": "2023-08-01T19:55:27.622608+0000", 2023-08-01T19:55:27.636 INFO:teuthology.orchestra.run.smithi101.stdout: "duration": 4294967295.9999995 2023-08-01T19:55:27.636 INFO:teuthology.orchestra.run.smithi101.stdout: }, 2023-08-01T19:55:27.636 INFO:teuthology.orchestra.run.smithi101.stdout: { 2023-08-01T19:55:27.636 INFO:teuthology.orchestra.run.smithi101.stdout: "event": "all_read", 2023-08-01T19:55:27.636 INFO:teuthology.orchestra.run.smithi101.stdout: "time": "2023-08-01T19:55:27.622611+0000", 2023-08-01T19:55:27.637 INFO:teuthology.orchestra.run.smithi101.stdout: "duration": 3.704e-06 2023-08-01T19:55:27.637 INFO:teuthology.orchestra.run.smithi101.stdout: }, 2023-08-01T19:55:27.637 INFO:teuthology.orchestra.run.smithi101.stdout: { 2023-08-01T19:55:27.637 INFO:teuthology.orchestra.run.smithi101.stdout: "event": "dispatched", 2023-08-01T19:55:27.637 INFO:teuthology.orchestra.run.smithi101.stdout: "time": "2023-08-01T19:55:27.622615+0000", 2023-08-01T19:55:27.637 INFO:teuthology.orchestra.run.smithi101.stdout: "duration": 4.228e-06 2023-08-01T19:55:27.637 INFO:teuthology.orchestra.run.smithi101.stdout: }, 2023-08-01T19:55:27.637 INFO:teuthology.orchestra.run.smithi101.stdout: { 2023-08-01T19:55:27.638 INFO:teuthology.orchestra.run.smithi101.stdout: "event": "queued_for_pg", 2023-08-01T19:55:27.638 INFO:teuthology.orchestra.run.smithi101.stdout: "time": "2023-08-01T19:55:27.622618+0000", 2023-08-01T19:55:27.638 INFO:teuthology.orchestra.run.smithi101.stdout: "duration": 2.7e-06 2023-08-01T19:55:27.638 INFO:teuthology.orchestra.run.smithi101.stdout: }, 2023-08-01T19:55:27.638 INFO:teuthology.orchestra.run.smithi101.stdout: { 2023-08-01T19:55:27.638 INFO:teuthology.orchestra.run.smithi101.stdout: "event": "reached_pg", 2023-08-01T19:55:27.638 INFO:teuthology.orchestra.run.smithi101.stdout: "time": "2023-08-01T19:55:27.622643+0000", 2023-08-01T19:55:27.638 INFO:teuthology.orchestra.run.smithi101.stdout: "duration": 2.5272000000000001e-05 2023-08-01T19:55:27.639 INFO:teuthology.orchestra.run.smithi101.stdout: }, 2023-08-01T19:55:27.639 INFO:teuthology.orchestra.run.smithi101.stdout: { 2023-08-01T19:55:27.639 INFO:teuthology.orchestra.run.smithi101.stdout: "event": "started", 2023-08-01T19:55:27.639 INFO:teuthology.orchestra.run.smithi101.stdout: "time": "2023-08-01T19:55:27.622656+0000", 2023-08-01T19:55:27.639 INFO:teuthology.orchestra.run.smithi101.stdout: "duration": 1.2323e-05 2023-08-01T19:55:27.639 INFO:teuthology.orchestra.run.smithi101.stdout: } 2023-08-01T19:55:27.639 INFO:teuthology.orchestra.run.smithi101.stdout: ] 2023-08-01T19:55:27.639 INFO:teuthology.orchestra.run.smithi101.stdout: } 2023-08-01T19:55:27.640 INFO:teuthology.orchestra.run.smithi101.stdout: }, 2023-08-01T19:55:27.640 INFO:teuthology.orchestra.run.smithi101.stdout: { 2023-08-01T19:55:27.640 INFO:teuthology.orchestra.run.smithi101.stdout: "description": "osd_repop(client.4668.0:138347 5.d e46/19 5:bb04da8a:::benchmark_data_smithi006_114134_object4686:head v 46'8483, mlcod=46'8481)", 2023-08-01T19:55:27.640 INFO:teuthology.orchestra.run.smithi101.stdout: "initiated_at": "2023-08-01T19:55:27.624745+0000", 2023-08-01T19:55:27.640 INFO:teuthology.orchestra.run.smithi101.stdout: "age": 0.00016625599999999999, 2023-08-01T19:55:27.640 INFO:teuthology.orchestra.run.smithi101.stdout: "duration": 0.00027025399999999999, 2023-08-01T19:55:27.640 INFO:teuthology.orchestra.run.smithi101.stdout: "type_data": { 2023-08-01T19:55:27.640 INFO:teuthology.orchestra.run.smithi101.stdout: "flag_point": "started", 2023-08-01T19:55:27.641 INFO:teuthology.orchestra.run.smithi101.stdout: "events": [ 2023-08-01T19:55:27.641 INFO:teuthology.orchestra.run.smithi101.stdout: { 2023-08-01T19:55:27.641 INFO:teuthology.orchestra.run.smithi101.stdout: "event": "initiated", 2023-08-01T19:55:27.641 INFO:teuthology.orchestra.run.smithi101.stdout: "time": "2023-08-01T19:55:27.624745+0000", 2023-08-01T19:55:27.641 INFO:teuthology.orchestra.run.smithi101.stdout: "duration": 0 2023-08-01T19:55:27.641 INFO:teuthology.orchestra.run.smithi101.stdout: }, 2023-08-01T19:55:27.641 INFO:teuthology.orchestra.run.smithi101.stdout: { 2023-08-01T19:55:27.642 INFO:teuthology.orchestra.run.smithi101.stdout: "event": "throttled", 2023-08-01T19:55:27.642 INFO:teuthology.orchestra.run.smithi101.stdout: "time": "2023-08-01T19:55:27.624745+0000", 2023-08-01T19:55:27.642 INFO:teuthology.orchestra.run.smithi101.stdout: "duration": 0 2023-08-01T19:55:27.642 INFO:teuthology.orchestra.run.smithi101.stdout: }, 2023-08-01T19:55:27.642 INFO:teuthology.orchestra.run.smithi101.stdout: { 2023-08-01T19:55:27.642 INFO:teuthology.orchestra.run.smithi101.stdout: "event": "header_read", 2023-08-01T19:55:27.642 INFO:teuthology.orchestra.run.smithi101.stdout: "time": "2023-08-01T19:55:27.624744+0000", 2023-08-01T19:55:27.643 INFO:teuthology.orchestra.run.smithi101.stdout: "duration": 4294967295.9999995 2023-08-01T19:55:27.643 INFO:teuthology.orchestra.run.smithi101.stdout: }, 2023-08-01T19:55:27.643 INFO:teuthology.orchestra.run.smithi101.stdout: { 2023-08-01T19:55:27.643 INFO:teuthology.orchestra.run.smithi101.stdout: "event": "all_read", 2023-08-01T19:55:27.643 INFO:teuthology.orchestra.run.smithi101.stdout: "time": "2023-08-01T19:55:27.624749+0000", 2023-08-01T19:55:27.643 INFO:teuthology.orchestra.run.smithi101.stdout: "duration": 4.8659999999999997e-06 2023-08-01T19:55:27.643 INFO:teuthology.orchestra.run.smithi101.stdout: }, 2023-08-01T19:55:27.643 INFO:teuthology.orchestra.run.smithi101.stdout: { 2023-08-01T19:55:27.644 INFO:teuthology.orchestra.run.smithi101.stdout: "event": "dispatched", 2023-08-01T19:55:27.644 INFO:teuthology.orchestra.run.smithi101.stdout: "time": "2023-08-01T19:55:27.624762+0000", 2023-08-01T19:55:27.644 INFO:teuthology.orchestra.run.smithi101.stdout: "duration": 1.2573e-05 2023-08-01T19:55:27.644 INFO:teuthology.orchestra.run.smithi101.stdout: }, 2023-08-01T19:55:27.644 INFO:teuthology.orchestra.run.smithi101.stdout: { 2023-08-01T19:55:27.644 INFO:teuthology.orchestra.run.smithi101.stdout: "event": "queued_for_pg", 2023-08-01T19:55:27.644 INFO:teuthology.orchestra.run.smithi101.stdout: "time": "2023-08-01T19:55:27.624766+0000", 2023-08-01T19:55:27.645 INFO:teuthology.orchestra.run.smithi101.stdout: "duration": 3.9809999999999997e-06 2023-08-01T19:55:27.645 INFO:teuthology.orchestra.run.smithi101.stdout: }, 2023-08-01T19:55:27.645 INFO:teuthology.orchestra.run.smithi101.stdout: { 2023-08-01T19:55:27.645 INFO:teuthology.orchestra.run.smithi101.stdout: "event": "reached_pg", 2023-08-01T19:55:27.645 INFO:teuthology.orchestra.run.smithi101.stdout: "time": "2023-08-01T19:55:27.624803+0000", 2023-08-01T19:55:27.645 INFO:teuthology.orchestra.run.smithi101.stdout: "duration": 3.6767000000000002e-05 2023-08-01T19:55:27.645 INFO:teuthology.orchestra.run.smithi101.stdout: }, 2023-08-01T19:55:27.646 INFO:teuthology.orchestra.run.smithi101.stdout: { 2023-08-01T19:55:27.646 INFO:teuthology.orchestra.run.smithi101.stdout: "event": "started", 2023-08-01T19:55:27.646 INFO:teuthology.orchestra.run.smithi101.stdout: "time": "2023-08-01T19:55:27.624822+0000", 2023-08-01T19:55:27.646 INFO:teuthology.orchestra.run.smithi101.stdout: "duration": 1.9185999999999999e-05 2023-08-01T19:55:27.646 INFO:teuthology.orchestra.run.smithi101.stdout: } 2023-08-01T19:55:27.646 INFO:teuthology.orchestra.run.smithi101.stdout: ] 2023-08-01T19:55:27.646 INFO:teuthology.orchestra.run.smithi101.stdout: } 2023-08-01T19:55:27.646 INFO:teuthology.orchestra.run.smithi101.stdout: }, 2023-08-01T19:55:27.647 INFO:teuthology.orchestra.run.smithi101.stdout: { 2023-08-01T19:55:27.647 INFO:teuthology.orchestra.run.smithi101.stdout: "description": "osd_repop(client.4668.0:138349 5.9 e46/40 5:957f7a39:::benchmark_data_smithi006_114134_object4688:head v 46'8702, mlcod=46'8699)", 2023-08-01T19:55:27.647 INFO:teuthology.orchestra.run.smithi101.stdout: "initiated_at": "2023-08-01T19:55:27.624776+0000", 2023-08-01T19:55:27.647 INFO:teuthology.orchestra.run.smithi101.stdout: "age": 0.00013570699999999999, 2023-08-01T19:55:27.647 INFO:teuthology.orchestra.run.smithi101.stdout: "duration": 0.00028261399999999999, 2023-08-01T19:55:27.647 INFO:teuthology.orchestra.run.smithi101.stdout: "type_data": { 2023-08-01T19:55:27.647 INFO:teuthology.orchestra.run.smithi101.stdout: "flag_point": "started", 2023-08-01T19:55:27.648 INFO:teuthology.orchestra.run.smithi101.stdout: "events": [ 2023-08-01T19:55:27.648 INFO:teuthology.orchestra.run.smithi101.stdout: { 2023-08-01T19:55:27.648 INFO:teuthology.orchestra.run.smithi101.stdout: "event": "initiated", 2023-08-01T19:55:27.648 INFO:teuthology.orchestra.run.smithi101.stdout: "time": "2023-08-01T19:55:27.624776+0000", 2023-08-01T19:55:27.648 INFO:teuthology.orchestra.run.smithi101.stdout: "duration": 0 2023-08-01T19:55:27.648 INFO:teuthology.orchestra.run.smithi101.stdout: }, 2023-08-01T19:55:27.648 INFO:teuthology.orchestra.run.smithi101.stdout: { 2023-08-01T19:55:27.648 INFO:teuthology.orchestra.run.smithi101.stdout: "event": "throttled", 2023-08-01T19:55:27.649 INFO:teuthology.orchestra.run.smithi101.stdout: "time": "2023-08-01T19:55:27.624776+0000", 2023-08-01T19:55:27.649 INFO:teuthology.orchestra.run.smithi101.stdout: "duration": 0 2023-08-01T19:55:27.649 INFO:teuthology.orchestra.run.smithi101.stdout: }, 2023-08-01T19:55:27.649 INFO:teuthology.orchestra.run.smithi101.stdout: { 2023-08-01T19:55:27.649 INFO:teuthology.orchestra.run.smithi101.stdout: "event": "header_read", 2023-08-01T19:55:27.649 INFO:teuthology.orchestra.run.smithi101.stdout: "time": "2023-08-01T19:55:27.624775+0000", 2023-08-01T19:55:27.649 INFO:teuthology.orchestra.run.smithi101.stdout: "duration": 4294967295.9999995 2023-08-01T19:55:27.649 INFO:teuthology.orchestra.run.smithi101.stdout: }, 2023-08-01T19:55:27.650 INFO:teuthology.orchestra.run.smithi101.stdout: { 2023-08-01T19:55:27.650 INFO:teuthology.orchestra.run.smithi101.stdout: "event": "all_read", 2023-08-01T19:55:27.650 INFO:teuthology.orchestra.run.smithi101.stdout: "time": "2023-08-01T19:55:27.624778+0000", 2023-08-01T19:55:27.650 INFO:teuthology.orchestra.run.smithi101.stdout: "duration": 2.469e-06 2023-08-01T19:55:27.650 INFO:teuthology.orchestra.run.smithi101.stdout: }, 2023-08-01T19:55:27.650 INFO:teuthology.orchestra.run.smithi101.stdout: { 2023-08-01T19:55:27.650 INFO:teuthology.orchestra.run.smithi101.stdout: "event": "dispatched", 2023-08-01T19:55:27.650 INFO:teuthology.orchestra.run.smithi101.stdout: "time": "2023-08-01T19:55:27.624786+0000", 2023-08-01T19:55:27.651 INFO:teuthology.orchestra.run.smithi101.stdout: "duration": 8.5720000000000003e-06 2023-08-01T19:55:27.651 INFO:teuthology.orchestra.run.smithi101.stdout: }, 2023-08-01T19:55:27.651 INFO:teuthology.orchestra.run.smithi101.stdout: { 2023-08-01T19:55:27.651 INFO:teuthology.orchestra.run.smithi101.stdout: "event": "queued_for_pg", 2023-08-01T19:55:27.651 INFO:teuthology.orchestra.run.smithi101.stdout: "time": "2023-08-01T19:55:27.624789+0000", 2023-08-01T19:55:27.651 INFO:teuthology.orchestra.run.smithi101.stdout: "duration": 2.243e-06 2023-08-01T19:55:27.651 INFO:teuthology.orchestra.run.smithi101.stdout: }, 2023-08-01T19:55:27.652 INFO:teuthology.orchestra.run.smithi101.stdout: { 2023-08-01T19:55:27.652 INFO:teuthology.orchestra.run.smithi101.stdout: "event": "reached_pg", 2023-08-01T19:55:27.652 INFO:teuthology.orchestra.run.smithi101.stdout: "time": "2023-08-01T19:55:27.624816+0000", 2023-08-01T19:55:27.652 INFO:teuthology.orchestra.run.smithi101.stdout: "duration": 2.7855999999999999e-05 2023-08-01T19:55:27.652 INFO:teuthology.orchestra.run.smithi101.stdout: }, 2023-08-01T19:55:27.652 INFO:teuthology.orchestra.run.smithi101.stdout: { 2023-08-01T19:55:27.652 INFO:teuthology.orchestra.run.smithi101.stdout: "event": "started", 2023-08-01T19:55:27.652 INFO:teuthology.orchestra.run.smithi101.stdout: "time": "2023-08-01T19:55:27.624828+0000", 2023-08-01T19:55:27.653 INFO:teuthology.orchestra.run.smithi101.stdout: "duration": 1.1068e-05 2023-08-01T19:55:27.653 INFO:teuthology.orchestra.run.smithi101.stdout: } 2023-08-01T19:55:27.653 INFO:teuthology.orchestra.run.smithi101.stdout: ] 2023-08-01T19:55:27.653 INFO:teuthology.orchestra.run.smithi101.stdout: } 2023-08-01T19:55:27.653 INFO:teuthology.orchestra.run.smithi101.stdout: }, 2023-08-01T19:55:27.653 INFO:teuthology.orchestra.run.smithi101.stdout: { 2023-08-01T19:55:27.653 INFO:teuthology.orchestra.run.smithi101.stdout: "description": "osd_repop(client.4668.0:138350 5.2 e46/40 5:4b8fd84d:::benchmark_data_smithi006_114134_object4689:head v 46'8858, mlcod=46'8856)", 2023-08-01T19:55:27.653 INFO:teuthology.orchestra.run.smithi101.stdout: "initiated_at": "2023-08-01T19:55:27.624835+0000", 2023-08-01T19:55:27.654 INFO:teuthology.orchestra.run.smithi101.stdout: "age": 7.6069999999999995e-05, 2023-08-01T19:55:27.654 INFO:teuthology.orchestra.run.smithi101.stdout: "duration": 0.00025753499999999998, 2023-08-01T19:55:27.654 INFO:teuthology.orchestra.run.smithi101.stdout: "type_data": { 2023-08-01T19:55:27.654 INFO:teuthology.orchestra.run.smithi101.stdout: "flag_point": "started", 2023-08-01T19:55:27.654 INFO:teuthology.orchestra.run.smithi101.stdout: "events": [ 2023-08-01T19:55:27.654 INFO:teuthology.orchestra.run.smithi101.stdout: { 2023-08-01T19:55:27.654 INFO:teuthology.orchestra.run.smithi101.stdout: "event": "initiated", 2023-08-01T19:55:27.655 INFO:teuthology.orchestra.run.smithi101.stdout: "time": "2023-08-01T19:55:27.624835+0000", 2023-08-01T19:55:27.655 INFO:teuthology.orchestra.run.smithi101.stdout: "duration": 0 2023-08-01T19:55:27.655 INFO:teuthology.orchestra.run.smithi101.stdout: }, 2023-08-01T19:55:27.655 INFO:teuthology.orchestra.run.smithi101.stdout: { 2023-08-01T19:55:27.655 INFO:teuthology.orchestra.run.smithi101.stdout: "event": "throttled", 2023-08-01T19:55:27.655 INFO:teuthology.orchestra.run.smithi101.stdout: "time": "2023-08-01T19:55:27.624835+0000", 2023-08-01T19:55:27.655 INFO:teuthology.orchestra.run.smithi101.stdout: "duration": 0 2023-08-01T19:55:27.655 INFO:teuthology.orchestra.run.smithi101.stdout: }, 2023-08-01T19:55:27.656 INFO:teuthology.orchestra.run.smithi101.stdout: { 2023-08-01T19:55:27.656 INFO:teuthology.orchestra.run.smithi101.stdout: "event": "header_read", 2023-08-01T19:55:27.656 INFO:teuthology.orchestra.run.smithi101.stdout: "time": "2023-08-01T19:55:27.624835+0000", 2023-08-01T19:55:27.656 INFO:teuthology.orchestra.run.smithi101.stdout: "duration": 4294967295.9999995 2023-08-01T19:55:27.656 INFO:teuthology.orchestra.run.smithi101.stdout: }, 2023-08-01T19:55:27.656 INFO:teuthology.orchestra.run.smithi101.stdout: { 2023-08-01T19:55:27.656 INFO:teuthology.orchestra.run.smithi101.stdout: "event": "all_read", 2023-08-01T19:55:27.656 INFO:teuthology.orchestra.run.smithi101.stdout: "time": "2023-08-01T19:55:27.624840+0000", 2023-08-01T19:55:27.657 INFO:teuthology.orchestra.run.smithi101.stdout: "duration": 5.9259999999999997e-06 2023-08-01T19:55:27.657 INFO:teuthology.orchestra.run.smithi101.stdout: }, 2023-08-01T19:55:27.657 INFO:teuthology.orchestra.run.smithi101.stdout: { 2023-08-01T19:55:27.657 INFO:teuthology.orchestra.run.smithi101.stdout: "event": "dispatched", 2023-08-01T19:55:27.657 INFO:teuthology.orchestra.run.smithi101.stdout: "time": "2023-08-01T19:55:27.624851+0000", 2023-08-01T19:55:27.657 INFO:teuthology.orchestra.run.smithi101.stdout: "duration": 1.0485999999999999e-05 2023-08-01T19:55:27.657 INFO:teuthology.orchestra.run.smithi101.stdout: }, 2023-08-01T19:55:27.657 INFO:teuthology.orchestra.run.smithi101.stdout: { 2023-08-01T19:55:27.658 INFO:teuthology.orchestra.run.smithi101.stdout: "event": "queued_for_pg", 2023-08-01T19:55:27.658 INFO:teuthology.orchestra.run.smithi101.stdout: "time": "2023-08-01T19:55:27.624857+0000", 2023-08-01T19:55:27.658 INFO:teuthology.orchestra.run.smithi101.stdout: "duration": 5.7620000000000001e-06 2023-08-01T19:55:27.658 INFO:teuthology.orchestra.run.smithi101.stdout: }, 2023-08-01T19:55:27.658 INFO:teuthology.orchestra.run.smithi101.stdout: { 2023-08-01T19:55:27.658 INFO:teuthology.orchestra.run.smithi101.stdout: "event": "reached_pg", 2023-08-01T19:55:27.658 INFO:teuthology.orchestra.run.smithi101.stdout: "time": "2023-08-01T19:55:27.624886+0000", 2023-08-01T19:55:27.658 INFO:teuthology.orchestra.run.smithi101.stdout: "duration": 2.9305000000000001e-05 2023-08-01T19:55:27.659 INFO:teuthology.orchestra.run.smithi101.stdout: }, 2023-08-01T19:55:27.659 INFO:teuthology.orchestra.run.smithi101.stdout: { 2023-08-01T19:55:27.659 INFO:teuthology.orchestra.run.smithi101.stdout: "event": "started", 2023-08-01T19:55:27.659 INFO:teuthology.orchestra.run.smithi101.stdout: "time": "2023-08-01T19:55:27.624902+0000", 2023-08-01T19:55:27.659 INFO:teuthology.orchestra.run.smithi101.stdout: "duration": 1.5883e-05 2023-08-01T19:55:27.659 INFO:teuthology.orchestra.run.smithi101.stdout: } 2023-08-01T19:55:27.659 INFO:teuthology.orchestra.run.smithi101.stdout: ] 2023-08-01T19:55:27.660 INFO:teuthology.orchestra.run.smithi101.stdout: } 2023-08-01T19:55:27.660 INFO:teuthology.orchestra.run.smithi101.stdout: }, 2023-08-01T19:55:27.660 INFO:teuthology.orchestra.run.smithi101.stdout: { 2023-08-01T19:55:27.660 INFO:teuthology.orchestra.run.smithi101.stdout: "description": "osd_repop(client.4668.0:138339 5.3 e46/19 5:c3cb88df:::benchmark_data_smithi006_114134_object4678:head v 46'8772, mlcod=46'8769)", 2023-08-01T19:55:27.660 INFO:teuthology.orchestra.run.smithi101.stdout: "initiated_at": "2023-08-01T19:55:27.620221+0000", 2023-08-01T19:55:27.660 INFO:teuthology.orchestra.run.smithi101.stdout: "age": 0.0046903190000000001, 2023-08-01T19:55:27.660 INFO:teuthology.orchestra.run.smithi101.stdout: "duration": 0.0049059189999999999, 2023-08-01T19:55:27.660 INFO:teuthology.orchestra.run.smithi101.stdout: "type_data": { 2023-08-01T19:55:27.661 INFO:teuthology.orchestra.run.smithi101.stdout: "flag_point": "started", 2023-08-01T19:55:27.661 INFO:teuthology.orchestra.run.smithi101.stdout: "events": [ 2023-08-01T19:55:27.661 INFO:teuthology.orchestra.run.smithi101.stdout: { 2023-08-01T19:55:27.661 INFO:teuthology.orchestra.run.smithi101.stdout: "event": "initiated", 2023-08-01T19:55:27.661 INFO:teuthology.orchestra.run.smithi101.stdout: "time": "2023-08-01T19:55:27.620221+0000", 2023-08-01T19:55:27.661 INFO:teuthology.orchestra.run.smithi101.stdout: "duration": 0 2023-08-01T19:55:27.661 INFO:teuthology.orchestra.run.smithi101.stdout: }, 2023-08-01T19:55:27.661 INFO:teuthology.orchestra.run.smithi101.stdout: { 2023-08-01T19:55:27.662 INFO:teuthology.orchestra.run.smithi101.stdout: "event": "throttled", 2023-08-01T19:55:27.662 INFO:teuthology.orchestra.run.smithi101.stdout: "time": "2023-08-01T19:55:27.620221+0000", 2023-08-01T19:55:27.662 INFO:teuthology.orchestra.run.smithi101.stdout: "duration": 0 2023-08-01T19:55:27.662 INFO:teuthology.orchestra.run.smithi101.stdout: }, 2023-08-01T19:55:27.662 INFO:teuthology.orchestra.run.smithi101.stdout: { 2023-08-01T19:55:27.662 INFO:teuthology.orchestra.run.smithi101.stdout: "event": "header_read", 2023-08-01T19:55:27.662 INFO:teuthology.orchestra.run.smithi101.stdout: "time": "2023-08-01T19:55:27.620220+0000", 2023-08-01T19:55:27.662 INFO:teuthology.orchestra.run.smithi101.stdout: "duration": 4294967295.9999995 2023-08-01T19:55:27.663 INFO:teuthology.orchestra.run.smithi101.stdout: }, 2023-08-01T19:55:27.663 INFO:teuthology.orchestra.run.smithi101.stdout: { 2023-08-01T19:55:27.663 INFO:teuthology.orchestra.run.smithi101.stdout: "event": "all_read", 2023-08-01T19:55:27.663 INFO:teuthology.orchestra.run.smithi101.stdout: "time": "2023-08-01T19:55:27.620226+0000", 2023-08-01T19:55:27.663 INFO:teuthology.orchestra.run.smithi101.stdout: "duration": 5.3600000000000004e-06 2023-08-01T19:55:27.663 INFO:teuthology.orchestra.run.smithi101.stdout: }, 2023-08-01T19:55:27.663 INFO:teuthology.orchestra.run.smithi101.stdout: { 2023-08-01T19:55:27.663 INFO:teuthology.orchestra.run.smithi101.stdout: "event": "dispatched", 2023-08-01T19:55:27.664 INFO:teuthology.orchestra.run.smithi101.stdout: "time": "2023-08-01T19:55:27.620235+0000", 2023-08-01T19:55:27.664 INFO:teuthology.orchestra.run.smithi101.stdout: "duration": 9.6909999999999992e-06 2023-08-01T19:55:27.664 INFO:teuthology.orchestra.run.smithi101.stdout: }, 2023-08-01T19:55:27.664 INFO:teuthology.orchestra.run.smithi101.stdout: { 2023-08-01T19:55:27.664 INFO:teuthology.orchestra.run.smithi101.stdout: "event": "queued_for_pg", 2023-08-01T19:55:27.664 INFO:teuthology.orchestra.run.smithi101.stdout: "time": "2023-08-01T19:55:27.620239+0000", 2023-08-01T19:55:27.664 INFO:teuthology.orchestra.run.smithi101.stdout: "duration": 4.0890000000000002e-06 2023-08-01T19:55:27.664 INFO:teuthology.orchestra.run.smithi101.stdout: }, 2023-08-01T19:55:27.665 INFO:teuthology.orchestra.run.smithi101.stdout: { 2023-08-01T19:55:27.665 INFO:teuthology.orchestra.run.smithi101.stdout: "event": "reached_pg", 2023-08-01T19:55:27.665 INFO:teuthology.orchestra.run.smithi101.stdout: "time": "2023-08-01T19:55:27.620271+0000", 2023-08-01T19:55:27.665 INFO:teuthology.orchestra.run.smithi101.stdout: "duration": 3.1717999999999997e-05 2023-08-01T19:55:27.665 INFO:teuthology.orchestra.run.smithi101.stdout: }, 2023-08-01T19:55:27.665 INFO:teuthology.orchestra.run.smithi101.stdout: { 2023-08-01T19:55:27.665 INFO:teuthology.orchestra.run.smithi101.stdout: "event": "started", 2023-08-01T19:55:27.666 INFO:teuthology.orchestra.run.smithi101.stdout: "time": "2023-08-01T19:55:27.620288+0000", 2023-08-01T19:55:27.666 INFO:teuthology.orchestra.run.smithi101.stdout: "duration": 1.6977e-05 2023-08-01T19:55:27.666 INFO:teuthology.orchestra.run.smithi101.stdout: } 2023-08-01T19:55:27.666 INFO:teuthology.orchestra.run.smithi101.stdout: ] 2023-08-01T19:55:27.666 INFO:teuthology.orchestra.run.smithi101.stdout: } 2023-08-01T19:55:27.666 INFO:teuthology.orchestra.run.smithi101.stdout: }, 2023-08-01T19:55:27.666 INFO:teuthology.orchestra.run.smithi101.stdout: { 2023-08-01T19:55:27.666 INFO:teuthology.orchestra.run.smithi101.stdout: "description": "osd_op(client.4668.0:138342 5.7 5:e97f79c7:::benchmark_data_smithi006_114134_object4681:head [delete] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e46)", 2023-08-01T19:55:27.667 INFO:teuthology.orchestra.run.smithi101.stdout: "initiated_at": "2023-08-01T19:55:27.620646+0000", 2023-08-01T19:55:27.667 INFO:teuthology.orchestra.run.smithi101.stdout: "age": 0.0042655820000000004, 2023-08-01T19:55:27.667 INFO:teuthology.orchestra.run.smithi101.stdout: "duration": 0.0045169279999999999, 2023-08-01T19:55:27.667 INFO:teuthology.orchestra.run.smithi101.stdout: "type_data": { 2023-08-01T19:55:27.667 INFO:teuthology.orchestra.run.smithi101.stdout: "flag_point": "waiting for sub ops", 2023-08-01T19:55:27.667 INFO:teuthology.orchestra.run.smithi101.stdout: "client_info": { 2023-08-01T19:55:27.667 INFO:teuthology.orchestra.run.smithi101.stdout: "client": "client.4668", 2023-08-01T19:55:27.668 INFO:teuthology.orchestra.run.smithi101.stdout: "client_addr": "172.21.15.6:0/1709472247", 2023-08-01T19:55:27.668 INFO:teuthology.orchestra.run.smithi101.stdout: "tid": 138342 2023-08-01T19:55:27.668 INFO:teuthology.orchestra.run.smithi101.stdout: }, 2023-08-01T19:55:27.668 INFO:teuthology.orchestra.run.smithi101.stdout: "events": [ 2023-08-01T19:55:27.669 INFO:teuthology.orchestra.run.smithi101.stdout: { 2023-08-01T19:55:27.669 INFO:teuthology.orchestra.run.smithi101.stdout: "event": "initiated", 2023-08-01T19:55:27.669 INFO:teuthology.orchestra.run.smithi101.stdout: "time": "2023-08-01T19:55:27.620646+0000", 2023-08-01T19:55:27.669 INFO:teuthology.orchestra.run.smithi101.stdout: "duration": 0 2023-08-01T19:55:27.669 INFO:teuthology.orchestra.run.smithi101.stdout: }, 2023-08-01T19:55:27.669 INFO:teuthology.orchestra.run.smithi101.stdout: { 2023-08-01T19:55:27.669 INFO:teuthology.orchestra.run.smithi101.stdout: "event": "throttled", 2023-08-01T19:55:27.670 INFO:teuthology.orchestra.run.smithi101.stdout: "time": "2023-08-01T19:55:27.620646+0000", 2023-08-01T19:55:27.670 INFO:teuthology.orchestra.run.smithi101.stdout: "duration": 0 2023-08-01T19:55:27.670 INFO:teuthology.orchestra.run.smithi101.stdout: }, 2023-08-01T19:55:27.670 INFO:teuthology.orchestra.run.smithi101.stdout: { 2023-08-01T19:55:27.670 INFO:teuthology.orchestra.run.smithi101.stdout: "event": "header_read", 2023-08-01T19:55:27.670 INFO:teuthology.orchestra.run.smithi101.stdout: "time": "2023-08-01T19:55:27.620644+0000", 2023-08-01T19:55:27.670 INFO:teuthology.orchestra.run.smithi101.stdout: "duration": 4294967295.9999986 2023-08-01T19:55:27.670 INFO:teuthology.orchestra.run.smithi101.stdout: }, 2023-08-01T19:55:27.671 INFO:teuthology.orchestra.run.smithi101.stdout: { 2023-08-01T19:55:27.671 INFO:teuthology.orchestra.run.smithi101.stdout: "event": "all_read", 2023-08-01T19:55:27.671 INFO:teuthology.orchestra.run.smithi101.stdout: "time": "2023-08-01T19:55:27.620650+0000", 2023-08-01T19:55:27.671 INFO:teuthology.orchestra.run.smithi101.stdout: "duration": 6.0689999999999998e-06 2023-08-01T19:55:27.671 INFO:teuthology.orchestra.run.smithi101.stdout: }, 2023-08-01T19:55:27.671 INFO:teuthology.orchestra.run.smithi101.stdout: { 2023-08-01T19:55:27.671 INFO:teuthology.orchestra.run.smithi101.stdout: "event": "dispatched", 2023-08-01T19:55:27.671 INFO:teuthology.orchestra.run.smithi101.stdout: "time": "2023-08-01T19:55:27.620664+0000", 2023-08-01T19:55:27.672 INFO:teuthology.orchestra.run.smithi101.stdout: "duration": 1.3658999999999999e-05 2023-08-01T19:55:27.672 INFO:teuthology.orchestra.run.smithi101.stdout: }, 2023-08-01T19:55:27.672 INFO:teuthology.orchestra.run.smithi101.stdout: { 2023-08-01T19:55:27.672 INFO:teuthology.orchestra.run.smithi101.stdout: "event": "queued_for_pg", 2023-08-01T19:55:27.672 INFO:teuthology.orchestra.run.smithi101.stdout: "time": "2023-08-01T19:55:27.620671+0000", 2023-08-01T19:55:27.672 INFO:teuthology.orchestra.run.smithi101.stdout: "duration": 7.1230000000000002e-06 2023-08-01T19:55:27.672 INFO:teuthology.orchestra.run.smithi101.stdout: }, 2023-08-01T19:55:27.673 INFO:teuthology.orchestra.run.smithi101.stdout: { 2023-08-01T19:55:27.673 INFO:teuthology.orchestra.run.smithi101.stdout: "event": "reached_pg", 2023-08-01T19:55:27.673 INFO:teuthology.orchestra.run.smithi101.stdout: "time": "2023-08-01T19:55:27.620715+0000", 2023-08-01T19:55:27.673 INFO:teuthology.orchestra.run.smithi101.stdout: "duration": 4.3278999999999997e-05 2023-08-01T19:55:27.673 INFO:teuthology.orchestra.run.smithi101.stdout: }, 2023-08-01T19:55:27.673 INFO:teuthology.orchestra.run.smithi101.stdout: { 2023-08-01T19:55:27.673 INFO:teuthology.orchestra.run.smithi101.stdout: "event": "started", 2023-08-01T19:55:27.673 INFO:teuthology.orchestra.run.smithi101.stdout: "time": "2023-08-01T19:55:27.620848+0000", 2023-08-01T19:55:27.674 INFO:teuthology.orchestra.run.smithi101.stdout: "duration": 0.00013350600000000001 2023-08-01T19:55:27.674 INFO:teuthology.orchestra.run.smithi101.stdout: }, 2023-08-01T19:55:27.674 INFO:teuthology.orchestra.run.smithi101.stdout: { 2023-08-01T19:55:27.674 INFO:teuthology.orchestra.run.smithi101.stdout: "event": "waiting for subops from 0", 2023-08-01T19:55:27.674 INFO:teuthology.orchestra.run.smithi101.stdout: "time": "2023-08-01T19:55:27.620973+0000", 2023-08-01T19:55:27.674 INFO:teuthology.orchestra.run.smithi101.stdout: "duration": 0.000124845 2023-08-01T19:55:27.674 INFO:teuthology.orchestra.run.smithi101.stdout: } 2023-08-01T19:55:27.674 INFO:teuthology.orchestra.run.smithi101.stdout: ] 2023-08-01T19:55:27.675 INFO:teuthology.orchestra.run.smithi101.stdout: } 2023-08-01T19:55:27.675 INFO:teuthology.orchestra.run.smithi101.stdout: }, 2023-08-01T19:55:27.675 INFO:teuthology.orchestra.run.smithi101.stdout: { 2023-08-01T19:55:27.675 INFO:teuthology.orchestra.run.smithi101.stdout: "description": "osd_repop(client.4668.0:138344 5.9 e46/40 5:927416f7:::benchmark_data_smithi006_114134_object4683:head v 46'8701, mlcod=46'8698)", 2023-08-01T19:55:27.675 INFO:teuthology.orchestra.run.smithi101.stdout: "initiated_at": "2023-08-01T19:55:27.621937+0000", 2023-08-01T19:55:27.675 INFO:teuthology.orchestra.run.smithi101.stdout: "age": 0.0029744319999999999, 2023-08-01T19:55:27.675 INFO:teuthology.orchestra.run.smithi101.stdout: "duration": 0.0032678870000000001, 2023-08-01T19:55:27.675 INFO:teuthology.orchestra.run.smithi101.stdout: "type_data": { 2023-08-01T19:55:27.676 INFO:teuthology.orchestra.run.smithi101.stdout: "flag_point": "started", 2023-08-01T19:55:27.676 INFO:teuthology.orchestra.run.smithi101.stdout: "events": [ 2023-08-01T19:55:27.676 INFO:teuthology.orchestra.run.smithi101.stdout: { 2023-08-01T19:55:27.676 INFO:teuthology.orchestra.run.smithi101.stdout: "event": "initiated", 2023-08-01T19:55:27.676 INFO:teuthology.orchestra.run.smithi101.stdout: "time": "2023-08-01T19:55:27.621937+0000", 2023-08-01T19:55:27.676 INFO:teuthology.orchestra.run.smithi101.stdout: "duration": 0 2023-08-01T19:55:27.676 INFO:teuthology.orchestra.run.smithi101.stdout: }, 2023-08-01T19:55:27.677 INFO:teuthology.orchestra.run.smithi101.stdout: { 2023-08-01T19:55:27.677 INFO:teuthology.orchestra.run.smithi101.stdout: "event": "throttled", 2023-08-01T19:55:27.677 INFO:teuthology.orchestra.run.smithi101.stdout: "time": "2023-08-01T19:55:27.621937+0000", 2023-08-01T19:55:27.677 INFO:teuthology.orchestra.run.smithi101.stdout: "duration": 0 2023-08-01T19:55:27.677 INFO:teuthology.orchestra.run.smithi101.stdout: }, 2023-08-01T19:55:27.677 INFO:teuthology.orchestra.run.smithi101.stdout: { 2023-08-01T19:55:27.677 INFO:teuthology.orchestra.run.smithi101.stdout: "event": "header_read", 2023-08-01T19:55:27.677 INFO:teuthology.orchestra.run.smithi101.stdout: "time": "2023-08-01T19:55:27.621936+0000", 2023-08-01T19:55:27.678 INFO:teuthology.orchestra.run.smithi101.stdout: "duration": 4294967295.9999995 2023-08-01T19:55:27.678 INFO:teuthology.orchestra.run.smithi101.stdout: }, 2023-08-01T19:55:27.678 INFO:teuthology.orchestra.run.smithi101.stdout: { 2023-08-01T19:55:27.678 INFO:teuthology.orchestra.run.smithi101.stdout: "event": "all_read", 2023-08-01T19:55:27.678 INFO:teuthology.orchestra.run.smithi101.stdout: "time": "2023-08-01T19:55:27.621941+0000", 2023-08-01T19:55:27.678 INFO:teuthology.orchestra.run.smithi101.stdout: "duration": 5.2390000000000002e-06 2023-08-01T19:55:27.678 INFO:teuthology.orchestra.run.smithi101.stdout: }, 2023-08-01T19:55:27.679 INFO:teuthology.orchestra.run.smithi101.stdout: { 2023-08-01T19:55:27.679 INFO:teuthology.orchestra.run.smithi101.stdout: "event": "dispatched", 2023-08-01T19:55:27.679 INFO:teuthology.orchestra.run.smithi101.stdout: "time": "2023-08-01T19:55:27.621951+0000", 2023-08-01T19:55:27.679 INFO:teuthology.orchestra.run.smithi101.stdout: "duration": 9.6190000000000006e-06 2023-08-01T19:55:27.679 INFO:teuthology.orchestra.run.smithi101.stdout: }, 2023-08-01T19:55:27.679 INFO:teuthology.orchestra.run.smithi101.stdout: { 2023-08-01T19:55:27.679 INFO:teuthology.orchestra.run.smithi101.stdout: "event": "queued_for_pg", 2023-08-01T19:55:27.679 INFO:teuthology.orchestra.run.smithi101.stdout: "time": "2023-08-01T19:55:27.621956+0000", 2023-08-01T19:55:27.680 INFO:teuthology.orchestra.run.smithi101.stdout: "duration": 5.2179999999999998e-06 2023-08-01T19:55:27.680 INFO:teuthology.orchestra.run.smithi101.stdout: }, 2023-08-01T19:55:27.680 INFO:teuthology.orchestra.run.smithi101.stdout: { 2023-08-01T19:55:27.680 INFO:teuthology.orchestra.run.smithi101.stdout: "event": "reached_pg", 2023-08-01T19:55:27.680 INFO:teuthology.orchestra.run.smithi101.stdout: "time": "2023-08-01T19:55:27.621995+0000", 2023-08-01T19:55:27.680 INFO:teuthology.orchestra.run.smithi101.stdout: "duration": 3.8318999999999997e-05 2023-08-01T19:55:27.680 INFO:teuthology.orchestra.run.smithi101.stdout: }, 2023-08-01T19:55:27.680 INFO:teuthology.orchestra.run.smithi101.stdout: { 2023-08-01T19:55:27.681 INFO:teuthology.orchestra.run.smithi101.stdout: "event": "started", 2023-08-01T19:55:27.681 INFO:teuthology.orchestra.run.smithi101.stdout: "time": "2023-08-01T19:55:27.622026+0000", 2023-08-01T19:55:27.681 INFO:teuthology.orchestra.run.smithi101.stdout: "duration": 3.1723000000000001e-05 2023-08-01T19:55:27.681 INFO:teuthology.orchestra.run.smithi101.stdout: } 2023-08-01T19:55:27.681 INFO:teuthology.orchestra.run.smithi101.stdout: ] 2023-08-01T19:55:27.681 INFO:teuthology.orchestra.run.smithi101.stdout: } 2023-08-01T19:55:27.681 INFO:teuthology.orchestra.run.smithi101.stdout: } 2023-08-01T19:55:27.681 INFO:teuthology.orchestra.run.smithi101.stdout: ], 2023-08-01T19:55:27.682 INFO:teuthology.orchestra.run.smithi101.stdout: "num_ops": 8 2023-08-01T19:55:27.682 INFO:teuthology.orchestra.run.smithi101.stdout:} 2023-08-01T19:55:27.683 INFO:tasks.ceph.osd.2.smithi155.stderr:2023-08-01T19:55:27.681+0000 7faa5c6ac700 -1 received signal: Hangup from /usr/bin/python3 /bin/daemon-helper kill ceph-osd -f --cluster ceph -i 2 (PID: 111337) UID: 0 2023-08-01T19:55:27.683 DEBUG:teuthology.orchestra.run.smithi101:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 30 ceph --cluster ceph --admin-daemon /var/run/ceph/ceph-osd.1.asok dump_blocked_ops 2023-08-01T19:55:27.783 INFO:tasks.ceph.osd.2.smithi155.stderr:2023-08-01T19:55:27.782+0000 7faa5c6ac700 -1 received signal: Hangup from /usr/bin/python3 /bin/daemon-helper kill ceph-osd -f --cluster ceph -i 2 (PID: 111337) UID: 0 2023-08-01T19:55:27.875 INFO:teuthology.orchestra.run.smithi006.stderr:noscrub is unset 2023-08-01T19:55:27.879 INFO:teuthology.orchestra.run.smithi101.stdout:{ 2023-08-01T19:55:27.879 INFO:teuthology.orchestra.run.smithi101.stdout: "ops": [], 2023-08-01T19:55:27.879 INFO:teuthology.orchestra.run.smithi101.stdout: "complaint_time": 30, 2023-08-01T19:55:27.880 INFO:teuthology.orchestra.run.smithi101.stdout: "num_blocked_ops": 0 2023-08-01T19:55:27.880 INFO:teuthology.orchestra.run.smithi101.stdout:} 2023-08-01T19:55:27.884 INFO:tasks.ceph.osd.0.smithi008.stderr:2023-08-01T19:55:27.882+0000 7f16a58f4700 -1 received signal: Hangup from /usr/bin/python3 /bin/daemon-helper kill ceph-osd -f --cluster ceph -i 0 (PID: 111179) UID: 0 2023-08-01T19:55:27.893 DEBUG:teuthology.orchestra.run.smithi101:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 30 ceph --cluster ceph --admin-daemon /var/run/ceph/ceph-osd.1.asok dump_historic_ops 2023-08-01T19:55:27.985 INFO:tasks.ceph.osd.2.smithi155.stderr:2023-08-01T19:55:27.983+0000 7faa5c6ac700 -1 received signal: Hangup from /usr/bin/python3 /bin/daemon-helper kill ceph-osd -f --cluster ceph -i 2 (PID: 111337) UID: 0 2023-08-01T19:55:28.051 INFO:teuthology.orchestra.run.smithi101.stdout:{ 2023-08-01T19:55:28.051 INFO:teuthology.orchestra.run.smithi101.stdout: "size": 20, 2023-08-01T19:55:28.051 INFO:teuthology.orchestra.run.smithi101.stdout: "duration": 600, 2023-08-01T19:55:28.051 INFO:teuthology.orchestra.run.smithi101.stdout: "ops": [ 2023-08-01T19:55:28.051 INFO:teuthology.orchestra.run.smithi101.stdout: { 2023-08-01T19:55:28.051 INFO:teuthology.orchestra.run.smithi101.stdout: "description": "osd_op(mds.0.3:11 3.10 3:0bd6d154:::602.00000000:head [create,setxattr parent (62) in=6b,setxattr layout (30) in=6b] snapc 0=[] ondisk+write+known_if_redirected+full_force+supports_pool_eio e17)", 2023-08-01T19:55:28.052 INFO:teuthology.orchestra.run.smithi101.stdout: "initiated_at": "2023-08-01T19:54:04.458960+0000", 2023-08-01T19:55:28.052 INFO:teuthology.orchestra.run.smithi101.stdout: "age": 83.588838146000001, 2023-08-01T19:55:28.052 INFO:teuthology.orchestra.run.smithi101.stdout: "duration": 0.019645459000000001, 2023-08-01T19:55:28.052 INFO:teuthology.orchestra.run.smithi101.stdout: "type_data": { 2023-08-01T19:55:28.052 INFO:teuthology.orchestra.run.smithi101.stdout: "flag_point": "commit sent; apply or cleanup", 2023-08-01T19:55:28.052 INFO:teuthology.orchestra.run.smithi101.stdout: "events": [ 2023-08-01T19:55:28.052 INFO:teuthology.orchestra.run.smithi101.stdout: { 2023-08-01T19:55:28.053 INFO:teuthology.orchestra.run.smithi101.stdout: "event": "initiated", 2023-08-01T19:55:28.053 INFO:teuthology.orchestra.run.smithi101.stdout: "time": "2023-08-01T19:54:04.458960+0000", 2023-08-01T19:55:28.053 INFO:teuthology.orchestra.run.smithi101.stdout: "duration": 0 2023-08-01T19:55:28.053 INFO:teuthology.orchestra.run.smithi101.stdout: }, 2023-08-01T19:55:28.053 INFO:teuthology.orchestra.run.smithi101.stdout: { 2023-08-01T19:55:28.053 INFO:teuthology.orchestra.run.smithi101.stdout: "event": "throttled", 2023-08-01T19:55:28.053 INFO:teuthology.orchestra.run.smithi101.stdout: "time": "2023-08-01T19:54:04.458960+0000", 2023-08-01T19:55:28.054 INFO:teuthology.orchestra.run.smithi101.stdout: "duration": 0 2023-08-01T19:55:28.054 INFO:teuthology.orchestra.run.smithi101.stdout: }, 2023-08-01T19:55:28.054 INFO:teuthology.orchestra.run.smithi101.stdout: { 2023-08-01T19:55:28.054 INFO:teuthology.orchestra.run.smithi101.stdout: "event": "header_read", 2023-08-01T19:55:28.054 INFO:teuthology.orchestra.run.smithi101.stdout: "time": "2023-08-01T19:54:04.458959+0000", 2023-08-01T19:55:28.054 INFO:teuthology.orchestra.run.smithi101.stdout: "duration": 4294967295.9999995 2023-08-01T19:55:28.054 INFO:teuthology.orchestra.run.smithi101.stdout: }, 2023-08-01T19:55:28.054 INFO:teuthology.orchestra.run.smithi101.stdout: { 2023-08-01T19:55:28.055 INFO:teuthology.orchestra.run.smithi101.stdout: "event": "all_read", 2023-08-01T19:55:28.055 INFO:teuthology.orchestra.run.smithi101.stdout: "time": "2023-08-01T19:54:04.458963+0000", 2023-08-01T19:55:28.055 INFO:teuthology.orchestra.run.smithi101.stdout: "duration": 3.9199999999999997e-06 2023-08-01T19:55:28.055 INFO:teuthology.orchestra.run.smithi101.stdout: }, 2023-08-01T19:55:28.055 INFO:teuthology.orchestra.run.smithi101.stdout: { 2023-08-01T19:55:28.055 INFO:teuthology.orchestra.run.smithi101.stdout: "event": "dispatched", 2023-08-01T19:55:28.055 INFO:teuthology.orchestra.run.smithi101.stdout: "time": "2023-08-01T19:54:04.458970+0000", 2023-08-01T19:55:28.056 INFO:teuthology.orchestra.run.smithi101.stdout: "duration": 7.0439999999999998e-06 2023-08-01T19:55:28.056 INFO:teuthology.orchestra.run.smithi101.stdout: }, 2023-08-01T19:55:28.056 INFO:teuthology.orchestra.run.smithi101.stdout: { 2023-08-01T19:55:28.056 INFO:teuthology.orchestra.run.smithi101.stdout: "event": "queued_for_pg", 2023-08-01T19:55:28.056 INFO:teuthology.orchestra.run.smithi101.stdout: "time": "2023-08-01T19:54:04.458976+0000", 2023-08-01T19:55:28.056 INFO:teuthology.orchestra.run.smithi101.stdout: "duration": 5.9540000000000001e-06 2023-08-01T19:55:28.056 INFO:teuthology.orchestra.run.smithi101.stdout: }, 2023-08-01T19:55:28.056 INFO:teuthology.orchestra.run.smithi101.stdout: { 2023-08-01T19:55:28.057 INFO:teuthology.orchestra.run.smithi101.stdout: "event": "reached_pg", 2023-08-01T19:55:28.057 INFO:teuthology.orchestra.run.smithi101.stdout: "time": "2023-08-01T19:54:04.459035+0000", 2023-08-01T19:55:28.057 INFO:teuthology.orchestra.run.smithi101.stdout: "duration": 5.8924e-05 2023-08-01T19:55:28.057 INFO:teuthology.orchestra.run.smithi101.stdout: }, 2023-08-01T19:55:28.057 INFO:teuthology.orchestra.run.smithi101.stdout: { 2023-08-01T19:55:28.057 INFO:teuthology.orchestra.run.smithi101.stdout: "event": "waiting_for_map not empty", 2023-08-01T19:55:28.057 INFO:teuthology.orchestra.run.smithi101.stdout: "time": "2023-08-01T19:54:04.459038+0000", 2023-08-01T19:55:28.057 INFO:teuthology.orchestra.run.smithi101.stdout: "duration": 3.2760000000000001e-06 2023-08-01T19:55:28.058 INFO:teuthology.orchestra.run.smithi101.stdout: }, 2023-08-01T19:55:28.058 INFO:teuthology.orchestra.run.smithi101.stdout: { 2023-08-01T19:55:28.058 INFO:teuthology.orchestra.run.smithi101.stdout: "event": "reached_pg", 2023-08-01T19:55:28.058 INFO:teuthology.orchestra.run.smithi101.stdout: "time": "2023-08-01T19:54:04.471511+0000", 2023-08-01T19:55:28.058 INFO:teuthology.orchestra.run.smithi101.stdout: "duration": 0.012473039999999999 2023-08-01T19:55:28.058 INFO:teuthology.orchestra.run.smithi101.stdout: }, 2023-08-01T19:55:28.058 INFO:teuthology.orchestra.run.smithi101.stdout: { 2023-08-01T19:55:28.059 INFO:teuthology.orchestra.run.smithi101.stdout: "event": "started", 2023-08-01T19:55:28.059 INFO:teuthology.orchestra.run.smithi101.stdout: "time": "2023-08-01T19:54:04.472086+0000", 2023-08-01T19:55:28.059 INFO:teuthology.orchestra.run.smithi101.stdout: "duration": 0.00057491699999999998 2023-08-01T19:55:28.059 INFO:teuthology.orchestra.run.smithi101.stdout: }, 2023-08-01T19:55:28.059 INFO:teuthology.orchestra.run.smithi101.stdout: { 2023-08-01T19:55:28.059 INFO:teuthology.orchestra.run.smithi101.stdout: "event": "waiting for subops from 2", 2023-08-01T19:55:28.059 INFO:teuthology.orchestra.run.smithi101.stdout: "time": "2023-08-01T19:54:04.472310+0000", 2023-08-01T19:55:28.060 INFO:teuthology.orchestra.run.smithi101.stdout: "duration": 0.00022396499999999999 2023-08-01T19:55:28.060 INFO:teuthology.orchestra.run.smithi101.stdout: }, 2023-08-01T19:55:28.060 INFO:teuthology.orchestra.run.smithi101.stdout: { 2023-08-01T19:55:28.060 INFO:teuthology.orchestra.run.smithi101.stdout: "event": "op_commit", 2023-08-01T19:55:28.060 INFO:teuthology.orchestra.run.smithi101.stdout: "time": "2023-08-01T19:54:04.478141+0000", 2023-08-01T19:55:28.060 INFO:teuthology.orchestra.run.smithi101.stdout: "duration": 0.0058312320000000004 2023-08-01T19:55:28.060 INFO:teuthology.orchestra.run.smithi101.stdout: }, 2023-08-01T19:55:28.060 INFO:teuthology.orchestra.run.smithi101.stdout: { 2023-08-01T19:55:28.061 INFO:teuthology.orchestra.run.smithi101.stdout: "event": "sub_op_commit_rec", 2023-08-01T19:55:28.061 INFO:teuthology.orchestra.run.smithi101.stdout: "time": "2023-08-01T19:54:04.478543+0000", 2023-08-01T19:55:28.061 INFO:teuthology.orchestra.run.smithi101.stdout: "duration": 0.00040160800000000002 2023-08-01T19:55:28.061 INFO:teuthology.orchestra.run.smithi101.stdout: }, 2023-08-01T19:55:28.061 INFO:teuthology.orchestra.run.smithi101.stdout: { 2023-08-01T19:55:28.061 INFO:teuthology.orchestra.run.smithi101.stdout: "event": "commit_sent", 2023-08-01T19:55:28.061 INFO:teuthology.orchestra.run.smithi101.stdout: "time": "2023-08-01T19:54:04.478584+0000", 2023-08-01T19:55:28.061 INFO:teuthology.orchestra.run.smithi101.stdout: "duration": 4.0989999999999999e-05 2023-08-01T19:55:28.062 INFO:teuthology.orchestra.run.smithi101.stdout: }, 2023-08-01T19:55:28.062 INFO:teuthology.orchestra.run.smithi101.stdout: { 2023-08-01T19:55:28.062 INFO:teuthology.orchestra.run.smithi101.stdout: "event": "done", 2023-08-01T19:55:28.062 INFO:teuthology.orchestra.run.smithi101.stdout: "time": "2023-08-01T19:54:04.478605+0000", 2023-08-01T19:55:28.062 INFO:teuthology.orchestra.run.smithi101.stdout: "duration": 2.1178e-05 2023-08-01T19:55:28.062 INFO:teuthology.orchestra.run.smithi101.stdout: } 2023-08-01T19:55:28.062 INFO:teuthology.orchestra.run.smithi101.stdout: ] 2023-08-01T19:55:28.062 INFO:teuthology.orchestra.run.smithi101.stdout: } 2023-08-01T19:55:28.063 INFO:teuthology.orchestra.run.smithi101.stdout: }, 2023-08-01T19:55:28.063 INFO:teuthology.orchestra.run.smithi101.stdout: { 2023-08-01T19:55:28.063 INFO:teuthology.orchestra.run.smithi101.stdout: "description": "osd_op(mds.0.3:12 3.10 3:0d89b25e:::603.00000000:head [omap-set-header] snapc 0=[] ondisk+write+known_if_redirected+full_force+supports_pool_eio e17)", 2023-08-01T19:55:28.063 INFO:teuthology.orchestra.run.smithi101.stdout: "initiated_at": "2023-08-01T19:54:04.458982+0000", 2023-08-01T19:55:28.063 INFO:teuthology.orchestra.run.smithi101.stdout: "age": 83.588815917999995, 2023-08-01T19:55:28.063 INFO:teuthology.orchestra.run.smithi101.stdout: "duration": 0.021266334000000001, 2023-08-01T19:55:28.063 INFO:teuthology.orchestra.run.smithi101.stdout: "type_data": { 2023-08-01T19:55:28.063 INFO:teuthology.orchestra.run.smithi101.stdout: "flag_point": "commit sent; apply or cleanup", 2023-08-01T19:55:28.064 INFO:teuthology.orchestra.run.smithi101.stdout: "events": [ 2023-08-01T19:55:28.064 INFO:teuthology.orchestra.run.smithi101.stdout: { 2023-08-01T19:55:28.064 INFO:teuthology.orchestra.run.smithi101.stdout: "event": "initiated", 2023-08-01T19:55:28.064 INFO:teuthology.orchestra.run.smithi101.stdout: "time": "2023-08-01T19:54:04.458982+0000", 2023-08-01T19:55:28.064 INFO:teuthology.orchestra.run.smithi101.stdout: "duration": 0 2023-08-01T19:55:28.064 INFO:teuthology.orchestra.run.smithi101.stdout: }, 2023-08-01T19:55:28.064 INFO:teuthology.orchestra.run.smithi101.stdout: { 2023-08-01T19:55:28.064 INFO:teuthology.orchestra.run.smithi101.stdout: "event": "throttled", 2023-08-01T19:55:28.065 INFO:teuthology.orchestra.run.smithi101.stdout: "time": "2023-08-01T19:54:04.458982+0000", 2023-08-01T19:55:28.065 INFO:teuthology.orchestra.run.smithi101.stdout: "duration": 0 2023-08-01T19:55:28.065 INFO:teuthology.orchestra.run.smithi101.stdout: }, 2023-08-01T19:55:28.065 INFO:teuthology.orchestra.run.smithi101.stdout: { 2023-08-01T19:55:28.065 INFO:teuthology.orchestra.run.smithi101.stdout: "event": "header_read", 2023-08-01T19:55:28.065 INFO:teuthology.orchestra.run.smithi101.stdout: "time": "2023-08-01T19:54:04.458982+0000", 2023-08-01T19:55:28.065 INFO:teuthology.orchestra.run.smithi101.stdout: "duration": 4294967295.9999995 2023-08-01T19:55:28.066 INFO:teuthology.orchestra.run.smithi101.stdout: }, 2023-08-01T19:55:28.066 INFO:teuthology.orchestra.run.smithi101.stdout: { 2023-08-01T19:55:28.066 INFO:teuthology.orchestra.run.smithi101.stdout: "event": "all_read", 2023-08-01T19:55:28.066 INFO:teuthology.orchestra.run.smithi101.stdout: "time": "2023-08-01T19:54:04.458985+0000", 2023-08-01T19:55:28.066 INFO:teuthology.orchestra.run.smithi101.stdout: "duration": 3.4800000000000001e-06 2023-08-01T19:55:28.066 INFO:teuthology.orchestra.run.smithi101.stdout: }, 2023-08-01T19:55:28.066 INFO:teuthology.orchestra.run.smithi101.stdout: { 2023-08-01T19:55:28.066 INFO:teuthology.orchestra.run.smithi101.stdout: "event": "dispatched", 2023-08-01T19:55:28.067 INFO:teuthology.orchestra.run.smithi101.stdout: "time": "2023-08-01T19:54:04.458992+0000", 2023-08-01T19:55:28.067 INFO:teuthology.orchestra.run.smithi101.stdout: "duration": 7.306e-06 2023-08-01T19:55:28.067 INFO:teuthology.orchestra.run.smithi101.stdout: }, 2023-08-01T19:55:28.067 INFO:teuthology.orchestra.run.smithi101.stdout: { 2023-08-01T19:55:28.067 INFO:teuthology.orchestra.run.smithi101.stdout: "event": "queued_for_pg", 2023-08-01T19:55:28.067 INFO:teuthology.orchestra.run.smithi101.stdout: "time": "2023-08-01T19:54:04.458997+0000", 2023-08-01T19:55:28.067 INFO:teuthology.orchestra.run.smithi101.stdout: "duration": 4.4530000000000004e-06 2023-08-01T19:55:28.067 INFO:teuthology.orchestra.run.smithi101.stdout: }, 2023-08-01T19:55:28.068 INFO:teuthology.orchestra.run.smithi101.stdout: { 2023-08-01T19:55:28.068 INFO:teuthology.orchestra.run.smithi101.stdout: "event": "reached_pg", 2023-08-01T19:55:28.068 INFO:teuthology.orchestra.run.smithi101.stdout: "time": "2023-08-01T19:54:04.459060+0000", 2023-08-01T19:55:28.068 INFO:teuthology.orchestra.run.smithi101.stdout: "duration": 6.3249000000000004e-05 2023-08-01T19:55:28.068 INFO:teuthology.orchestra.run.smithi101.stdout: }, 2023-08-01T19:55:28.068 INFO:teuthology.orchestra.run.smithi101.stdout: { 2023-08-01T19:55:28.068 INFO:teuthology.orchestra.run.smithi101.stdout: "event": "waiting_for_map not empty", 2023-08-01T19:55:28.069 INFO:teuthology.orchestra.run.smithi101.stdout: "time": "2023-08-01T19:54:04.459063+0000", 2023-08-01T19:55:28.069 INFO:teuthology.orchestra.run.smithi101.stdout: "duration": 2.717e-06 2023-08-01T19:55:28.069 INFO:teuthology.orchestra.run.smithi101.stdout: }, 2023-08-01T19:55:28.069 INFO:teuthology.orchestra.run.smithi101.stdout: { 2023-08-01T19:55:28.069 INFO:teuthology.orchestra.run.smithi101.stdout: "event": "reached_pg", 2023-08-01T19:55:28.069 INFO:teuthology.orchestra.run.smithi101.stdout: "time": "2023-08-01T19:54:04.473625+0000", 2023-08-01T19:55:28.069 INFO:teuthology.orchestra.run.smithi101.stdout: "duration": 0.014562007 2023-08-01T19:55:28.069 INFO:teuthology.orchestra.run.smithi101.stdout: }, 2023-08-01T19:55:28.070 INFO:teuthology.orchestra.run.smithi101.stdout: { 2023-08-01T19:55:28.070 INFO:teuthology.orchestra.run.smithi101.stdout: "event": "started", 2023-08-01T19:55:28.070 INFO:teuthology.orchestra.run.smithi101.stdout: "time": "2023-08-01T19:54:04.473757+0000", 2023-08-01T19:55:28.070 INFO:teuthology.orchestra.run.smithi101.stdout: "duration": 0.00013238599999999999 2023-08-01T19:55:28.070 INFO:teuthology.orchestra.run.smithi101.stdout: }, 2023-08-01T19:55:28.070 INFO:teuthology.orchestra.run.smithi101.stdout: { 2023-08-01T19:55:28.070 INFO:teuthology.orchestra.run.smithi101.stdout: "event": "waiting for subops from 2", 2023-08-01T19:55:28.070 INFO:teuthology.orchestra.run.smithi101.stdout: "time": "2023-08-01T19:54:04.473898+0000", 2023-08-01T19:55:28.071 INFO:teuthology.orchestra.run.smithi101.stdout: "duration": 0.00014039 2023-08-01T19:55:28.071 INFO:teuthology.orchestra.run.smithi101.stdout: }, 2023-08-01T19:55:28.071 INFO:teuthology.orchestra.run.smithi101.stdout: { 2023-08-01T19:55:28.071 INFO:teuthology.orchestra.run.smithi101.stdout: "event": "op_commit", 2023-08-01T19:55:28.071 INFO:teuthology.orchestra.run.smithi101.stdout: "time": "2023-08-01T19:54:04.478380+0000", 2023-08-01T19:55:28.071 INFO:teuthology.orchestra.run.smithi101.stdout: "duration": 0.0044827449999999998 2023-08-01T19:55:28.071 INFO:teuthology.orchestra.run.smithi101.stdout: }, 2023-08-01T19:55:28.071 INFO:teuthology.orchestra.run.smithi101.stdout: { 2023-08-01T19:55:28.072 INFO:teuthology.orchestra.run.smithi101.stdout: "event": "sub_op_commit_rec", 2023-08-01T19:55:28.072 INFO:teuthology.orchestra.run.smithi101.stdout: "time": "2023-08-01T19:54:04.480169+0000", 2023-08-01T19:55:28.072 INFO:teuthology.orchestra.run.smithi101.stdout: "duration": 0.0017886040000000001 2023-08-01T19:55:28.072 INFO:teuthology.orchestra.run.smithi101.stdout: }, 2023-08-01T19:55:28.072 INFO:teuthology.orchestra.run.smithi101.stdout: { 2023-08-01T19:55:28.072 INFO:teuthology.orchestra.run.smithi101.stdout: "event": "commit_sent", 2023-08-01T19:55:28.072 INFO:teuthology.orchestra.run.smithi101.stdout: "time": "2023-08-01T19:54:04.480212+0000", 2023-08-01T19:55:28.072 INFO:teuthology.orchestra.run.smithi101.stdout: "duration": 4.2687e-05 2023-08-01T19:55:28.073 INFO:teuthology.orchestra.run.smithi101.stdout: }, 2023-08-01T19:55:28.073 INFO:teuthology.orchestra.run.smithi101.stdout: { 2023-08-01T19:55:28.073 INFO:teuthology.orchestra.run.smithi101.stdout: "event": "done", 2023-08-01T19:55:28.073 INFO:teuthology.orchestra.run.smithi101.stdout: "time": "2023-08-01T19:54:04.480248+0000", 2023-08-01T19:55:28.073 INFO:teuthology.orchestra.run.smithi101.stdout: "duration": 3.6743999999999999e-05 2023-08-01T19:55:28.073 INFO:teuthology.orchestra.run.smithi101.stdout: } 2023-08-01T19:55:28.073 INFO:teuthology.orchestra.run.smithi101.stdout: ] 2023-08-01T19:55:28.073 INFO:teuthology.orchestra.run.smithi101.stdout: } 2023-08-01T19:55:28.074 INFO:teuthology.orchestra.run.smithi101.stdout: }, 2023-08-01T19:55:28.074 INFO:teuthology.orchestra.run.smithi101.stdout: { 2023-08-01T19:55:28.074 INFO:teuthology.orchestra.run.smithi101.stdout: "description": "osd_op(mds.0.3:13 3.10 3:0d89b25e:::603.00000000:head [create,setxattr parent (62) in=6b,setxattr layout (30) in=6b] snapc 0=[] ondisk+write+known_if_redirected+full_force+supports_pool_eio e17)", 2023-08-01T19:55:28.074 INFO:teuthology.orchestra.run.smithi101.stdout: "initiated_at": "2023-08-01T19:54:04.459010+0000", 2023-08-01T19:55:28.074 INFO:teuthology.orchestra.run.smithi101.stdout: "age": 83.588788198000003, 2023-08-01T19:55:28.074 INFO:teuthology.orchestra.run.smithi101.stdout: "duration": 0.021327220000000001, 2023-08-01T19:55:28.074 INFO:teuthology.orchestra.run.smithi101.stdout: "type_data": { 2023-08-01T19:55:28.075 INFO:teuthology.orchestra.run.smithi101.stdout: "flag_point": "commit sent; apply or cleanup", 2023-08-01T19:55:28.075 INFO:teuthology.orchestra.run.smithi101.stdout: "events": [ 2023-08-01T19:55:28.075 INFO:teuthology.orchestra.run.smithi101.stdout: { 2023-08-01T19:55:28.075 INFO:teuthology.orchestra.run.smithi101.stdout: "event": "initiated", 2023-08-01T19:55:28.075 INFO:teuthology.orchestra.run.smithi101.stdout: "time": "2023-08-01T19:54:04.459010+0000", 2023-08-01T19:55:28.075 INFO:teuthology.orchestra.run.smithi101.stdout: "duration": 0 2023-08-01T19:55:28.075 INFO:teuthology.orchestra.run.smithi101.stdout: }, 2023-08-01T19:55:28.076 INFO:teuthology.orchestra.run.smithi101.stdout: { 2023-08-01T19:55:28.076 INFO:teuthology.orchestra.run.smithi101.stdout: "event": "throttled", 2023-08-01T19:55:28.076 INFO:teuthology.orchestra.run.smithi101.stdout: "time": "2023-08-01T19:54:04.459010+0000", 2023-08-01T19:55:28.076 INFO:teuthology.orchestra.run.smithi101.stdout: "duration": 0 2023-08-01T19:55:28.076 INFO:teuthology.orchestra.run.smithi101.stdout: }, 2023-08-01T19:55:28.076 INFO:teuthology.orchestra.run.smithi101.stdout: { 2023-08-01T19:55:28.076 INFO:teuthology.orchestra.run.smithi101.stdout: "event": "header_read", 2023-08-01T19:55:28.076 INFO:teuthology.orchestra.run.smithi101.stdout: "time": "2023-08-01T19:54:04.459009+0000", 2023-08-01T19:55:28.077 INFO:teuthology.orchestra.run.smithi101.stdout: "duration": 4294967295.9999995 2023-08-01T19:55:28.077 INFO:teuthology.orchestra.run.smithi101.stdout: }, 2023-08-01T19:55:28.077 INFO:teuthology.orchestra.run.smithi101.stdout: { 2023-08-01T19:55:28.077 INFO:teuthology.orchestra.run.smithi101.stdout: "event": "all_read", 2023-08-01T19:55:28.077 INFO:teuthology.orchestra.run.smithi101.stdout: "time": "2023-08-01T19:54:04.459013+0000", 2023-08-01T19:55:28.077 INFO:teuthology.orchestra.run.smithi101.stdout: "duration": 3.8929999999999998e-06 2023-08-01T19:55:28.077 INFO:teuthology.orchestra.run.smithi101.stdout: }, 2023-08-01T19:55:28.077 INFO:teuthology.orchestra.run.smithi101.stdout: { 2023-08-01T19:55:28.078 INFO:teuthology.orchestra.run.smithi101.stdout: "event": "dispatched", 2023-08-01T19:55:28.078 INFO:teuthology.orchestra.run.smithi101.stdout: "time": "2023-08-01T19:54:04.459027+0000", 2023-08-01T19:55:28.078 INFO:teuthology.orchestra.run.smithi101.stdout: "duration": 1.3416e-05 2023-08-01T19:55:28.078 INFO:teuthology.orchestra.run.smithi101.stdout: }, 2023-08-01T19:55:28.078 INFO:teuthology.orchestra.run.smithi101.stdout: { 2023-08-01T19:55:28.078 INFO:teuthology.orchestra.run.smithi101.stdout: "event": "queued_for_pg", 2023-08-01T19:55:28.078 INFO:teuthology.orchestra.run.smithi101.stdout: "time": "2023-08-01T19:54:04.459033+0000", 2023-08-01T19:55:28.078 INFO:teuthology.orchestra.run.smithi101.stdout: "duration": 5.9800000000000003e-06 2023-08-01T19:55:28.079 INFO:teuthology.orchestra.run.smithi101.stdout: }, 2023-08-01T19:55:28.079 INFO:teuthology.orchestra.run.smithi101.stdout: { 2023-08-01T19:55:28.079 INFO:teuthology.orchestra.run.smithi101.stdout: "event": "reached_pg", 2023-08-01T19:55:28.079 INFO:teuthology.orchestra.run.smithi101.stdout: "time": "2023-08-01T19:54:04.459099+0000", 2023-08-01T19:55:28.079 INFO:teuthology.orchestra.run.smithi101.stdout: "duration": 6.6192999999999995e-05 2023-08-01T19:55:28.079 INFO:teuthology.orchestra.run.smithi101.stdout: }, 2023-08-01T19:55:28.079 INFO:teuthology.orchestra.run.smithi101.stdout: { 2023-08-01T19:55:28.080 INFO:teuthology.orchestra.run.smithi101.stdout: "event": "waiting_for_map not empty", 2023-08-01T19:55:28.080 INFO:teuthology.orchestra.run.smithi101.stdout: "time": "2023-08-01T19:54:04.459106+0000", 2023-08-01T19:55:28.080 INFO:teuthology.orchestra.run.smithi101.stdout: "duration": 6.8619999999999997e-06 2023-08-01T19:55:28.080 INFO:teuthology.orchestra.run.smithi101.stdout: }, 2023-08-01T19:55:28.080 INFO:teuthology.orchestra.run.smithi101.stdout: { 2023-08-01T19:55:28.080 INFO:teuthology.orchestra.run.smithi101.stdout: "event": "reached_pg", 2023-08-01T19:55:28.080 INFO:teuthology.orchestra.run.smithi101.stdout: "time": "2023-08-01T19:54:04.475182+0000", 2023-08-01T19:55:28.080 INFO:teuthology.orchestra.run.smithi101.stdout: "duration": 0.016076333000000002 2023-08-01T19:55:28.081 INFO:teuthology.orchestra.run.smithi101.stdout: }, 2023-08-01T19:55:28.081 INFO:teuthology.orchestra.run.smithi101.stdout: { 2023-08-01T19:55:28.081 INFO:teuthology.orchestra.run.smithi101.stdout: "event": "started", 2023-08-01T19:55:28.081 INFO:teuthology.orchestra.run.smithi101.stdout: "time": "2023-08-01T19:54:04.475353+0000", 2023-08-01T19:55:28.081 INFO:teuthology.orchestra.run.smithi101.stdout: "duration": 0.000171378 2023-08-01T19:55:28.081 INFO:teuthology.orchestra.run.smithi101.stdout: }, 2023-08-01T19:55:28.081 INFO:teuthology.orchestra.run.smithi101.stdout: { 2023-08-01T19:55:28.081 INFO:teuthology.orchestra.run.smithi101.stdout: "event": "waiting for subops from 2", 2023-08-01T19:55:28.082 INFO:teuthology.orchestra.run.smithi101.stdout: "time": "2023-08-01T19:54:04.475793+0000", 2023-08-01T19:55:28.082 INFO:teuthology.orchestra.run.smithi101.stdout: "duration": 0.000440123 2023-08-01T19:55:28.082 INFO:teuthology.orchestra.run.smithi101.stdout: }, 2023-08-01T19:55:28.082 INFO:teuthology.orchestra.run.smithi101.stdout: { 2023-08-01T19:55:28.082 INFO:teuthology.orchestra.run.smithi101.stdout: "event": "op_commit", 2023-08-01T19:55:28.082 INFO:teuthology.orchestra.run.smithi101.stdout: "time": "2023-08-01T19:54:04.478624+0000", 2023-08-01T19:55:28.082 INFO:teuthology.orchestra.run.smithi101.stdout: "duration": 0.0028305000000000001 2023-08-01T19:55:28.082 INFO:teuthology.orchestra.run.smithi101.stdout: }, 2023-08-01T19:55:28.083 INFO:teuthology.orchestra.run.smithi101.stdout: { 2023-08-01T19:55:28.083 INFO:teuthology.orchestra.run.smithi101.stdout: "event": "sub_op_commit_rec", 2023-08-01T19:55:28.083 INFO:teuthology.orchestra.run.smithi101.stdout: "time": "2023-08-01T19:54:04.480291+0000", 2023-08-01T19:55:28.083 INFO:teuthology.orchestra.run.smithi101.stdout: "duration": 0.0016670000000000001 2023-08-01T19:55:28.083 INFO:teuthology.orchestra.run.smithi101.stdout: }, 2023-08-01T19:55:28.083 INFO:teuthology.orchestra.run.smithi101.stdout: { 2023-08-01T19:55:28.083 INFO:teuthology.orchestra.run.smithi101.stdout: "event": "commit_sent", 2023-08-01T19:55:28.083 INFO:teuthology.orchestra.run.smithi101.stdout: "time": "2023-08-01T19:54:04.480318+0000", 2023-08-01T19:55:28.084 INFO:teuthology.orchestra.run.smithi101.stdout: "duration": 2.6815e-05 2023-08-01T19:55:28.084 INFO:teuthology.orchestra.run.smithi101.stdout: }, 2023-08-01T19:55:28.084 INFO:teuthology.orchestra.run.smithi101.stdout: { 2023-08-01T19:55:28.084 INFO:teuthology.orchestra.run.smithi101.stdout: "event": "done", 2023-08-01T19:55:28.084 INFO:teuthology.orchestra.run.smithi101.stdout: "time": "2023-08-01T19:54:04.480337+0000", 2023-08-01T19:55:28.084 INFO:teuthology.orchestra.run.smithi101.stdout: "duration": 1.9241000000000001e-05 2023-08-01T19:55:28.084 INFO:teuthology.orchestra.run.smithi101.stdout: } 2023-08-01T19:55:28.085 INFO:teuthology.orchestra.run.smithi101.stdout: ] 2023-08-01T19:55:28.085 INFO:teuthology.orchestra.run.smithi101.stdout: } 2023-08-01T19:55:28.085 INFO:teuthology.orchestra.run.smithi101.stdout: }, 2023-08-01T19:55:28.085 INFO:teuthology.orchestra.run.smithi101.stdout: { 2023-08-01T19:55:28.085 INFO:teuthology.orchestra.run.smithi101.stdout: "description": "osd_op(mds.0.3:1 3.14 3:292cf221:::200.00000000:head [writefull 0~90] snapc 0=[] ondisk+write+known_if_redirected+full_force+supports_pool_eio e17)", 2023-08-01T19:55:28.085 INFO:teuthology.orchestra.run.smithi101.stdout: "initiated_at": "2023-08-01T19:54:04.459177+0000", 2023-08-01T19:55:28.085 INFO:teuthology.orchestra.run.smithi101.stdout: "age": 83.588621298999996, 2023-08-01T19:55:28.086 INFO:teuthology.orchestra.run.smithi101.stdout: "duration": 0.021067196, 2023-08-01T19:55:28.086 INFO:teuthology.orchestra.run.smithi101.stdout: "type_data": { 2023-08-01T19:55:28.086 INFO:teuthology.orchestra.run.smithi101.stdout: "flag_point": "commit sent; apply or cleanup", 2023-08-01T19:55:28.086 INFO:teuthology.orchestra.run.smithi101.stdout: "events": [ 2023-08-01T19:55:28.086 INFO:teuthology.orchestra.run.smithi101.stdout: { 2023-08-01T19:55:28.086 INFO:teuthology.orchestra.run.smithi101.stdout: "event": "initiated", 2023-08-01T19:55:28.086 INFO:teuthology.orchestra.run.smithi101.stdout: "time": "2023-08-01T19:54:04.459177+0000", 2023-08-01T19:55:28.086 INFO:teuthology.orchestra.run.smithi101.stdout: "duration": 0 2023-08-01T19:55:28.087 INFO:teuthology.orchestra.run.smithi101.stdout: }, 2023-08-01T19:55:28.087 INFO:teuthology.orchestra.run.smithi101.stdout: { 2023-08-01T19:55:28.087 INFO:teuthology.orchestra.run.smithi101.stdout: "event": "throttled", 2023-08-01T19:55:28.087 INFO:teuthology.orchestra.run.smithi101.stdout: "time": "2023-08-01T19:54:04.459177+0000", 2023-08-01T19:55:28.087 INFO:teuthology.orchestra.run.smithi101.stdout: "duration": 0 2023-08-01T19:55:28.087 INFO:teuthology.orchestra.run.smithi101.stdout: }, 2023-08-01T19:55:28.087 INFO:teuthology.orchestra.run.smithi101.stdout: { 2023-08-01T19:55:28.087 INFO:teuthology.orchestra.run.smithi101.stdout: "event": "header_read", 2023-08-01T19:55:28.088 INFO:teuthology.orchestra.run.smithi101.stdout: "time": "2023-08-01T19:54:04.459176+0000", 2023-08-01T19:55:28.088 INFO:teuthology.orchestra.run.smithi101.stdout: "duration": 4294967295.9999995 2023-08-01T19:55:28.088 INFO:teuthology.orchestra.run.smithi101.stdout: }, 2023-08-01T19:55:28.088 INFO:teuthology.orchestra.run.smithi101.stdout: { 2023-08-01T19:55:28.088 INFO:teuthology.orchestra.run.smithi101.stdout: "event": "all_read", 2023-08-01T19:55:28.088 INFO:teuthology.orchestra.run.smithi101.stdout: "time": "2023-08-01T19:54:04.459181+0000", 2023-08-01T19:55:28.088 INFO:teuthology.orchestra.run.smithi101.stdout: "duration": 5.2109999999999997e-06 2023-08-01T19:55:28.089 INFO:teuthology.orchestra.run.smithi101.stdout: }, 2023-08-01T19:55:28.089 INFO:teuthology.orchestra.run.smithi101.stdout: { 2023-08-01T19:55:28.089 INFO:teuthology.orchestra.run.smithi101.stdout: "event": "dispatched", 2023-08-01T19:55:28.089 INFO:teuthology.orchestra.run.smithi101.stdout: "time": "2023-08-01T19:54:04.459188+0000", 2023-08-01T19:55:28.089 INFO:teuthology.orchestra.run.smithi101.stdout: "duration": 6.6680000000000004e-06 2023-08-01T19:55:28.089 INFO:teuthology.orchestra.run.smithi101.stdout: }, 2023-08-01T19:55:28.089 INFO:teuthology.orchestra.run.smithi101.stdout: { 2023-08-01T19:55:28.089 INFO:teuthology.orchestra.run.smithi101.stdout: "event": "queued_for_pg", 2023-08-01T19:55:28.090 INFO:teuthology.orchestra.run.smithi101.stdout: "time": "2023-08-01T19:54:04.459192+0000", 2023-08-01T19:55:28.090 INFO:teuthology.orchestra.run.smithi101.stdout: "duration": 4.228e-06 2023-08-01T19:55:28.090 INFO:teuthology.orchestra.run.smithi101.stdout: }, 2023-08-01T19:55:28.090 INFO:teuthology.orchestra.run.smithi101.stdout: { 2023-08-01T19:55:28.090 INFO:teuthology.orchestra.run.smithi101.stdout: "event": "reached_pg", 2023-08-01T19:55:28.090 INFO:teuthology.orchestra.run.smithi101.stdout: "time": "2023-08-01T19:54:04.459219+0000", 2023-08-01T19:55:28.090 INFO:teuthology.orchestra.run.smithi101.stdout: "duration": 2.6930000000000001e-05 2023-08-01T19:55:28.090 INFO:teuthology.orchestra.run.smithi101.stdout: }, 2023-08-01T19:55:28.091 INFO:teuthology.orchestra.run.smithi101.stdout: { 2023-08-01T19:55:28.091 INFO:teuthology.orchestra.run.smithi101.stdout: "event": "waiting_for_map not empty", 2023-08-01T19:55:28.091 INFO:teuthology.orchestra.run.smithi101.stdout: "time": "2023-08-01T19:54:04.459223+0000", 2023-08-01T19:55:28.091 INFO:teuthology.orchestra.run.smithi101.stdout: "duration": 3.8469999999999998e-06 2023-08-01T19:55:28.091 INFO:teuthology.orchestra.run.smithi101.stdout: }, 2023-08-01T19:55:28.091 INFO:teuthology.orchestra.run.smithi101.stdout: { 2023-08-01T19:55:28.091 INFO:teuthology.orchestra.run.smithi101.stdout: "event": "reached_pg", 2023-08-01T19:55:28.092 INFO:teuthology.orchestra.run.smithi101.stdout: "time": "2023-08-01T19:54:04.473347+0000", 2023-08-01T19:55:28.092 INFO:teuthology.orchestra.run.smithi101.stdout: "duration": 0.014124319 2023-08-01T19:55:28.092 INFO:teuthology.orchestra.run.smithi101.stdout: }, 2023-08-01T19:55:28.092 INFO:teuthology.orchestra.run.smithi101.stdout: { 2023-08-01T19:55:28.092 INFO:teuthology.orchestra.run.smithi101.stdout: "event": "started", 2023-08-01T19:55:28.092 INFO:teuthology.orchestra.run.smithi101.stdout: "time": "2023-08-01T19:54:04.473480+0000", 2023-08-01T19:55:28.092 INFO:teuthology.orchestra.run.smithi101.stdout: "duration": 0.00013276799999999999 2023-08-01T19:55:28.092 INFO:teuthology.orchestra.run.smithi101.stdout: }, 2023-08-01T19:55:28.093 INFO:teuthology.orchestra.run.smithi101.stdout: { 2023-08-01T19:55:28.093 INFO:teuthology.orchestra.run.smithi101.stdout: "event": "waiting for subops from 2", 2023-08-01T19:55:28.093 INFO:teuthology.orchestra.run.smithi101.stdout: "time": "2023-08-01T19:54:04.473622+0000", 2023-08-01T19:55:28.093 INFO:teuthology.orchestra.run.smithi101.stdout: "duration": 0.00014154799999999999 2023-08-01T19:55:28.093 INFO:teuthology.orchestra.run.smithi101.stdout: }, 2023-08-01T19:55:28.093 INFO:teuthology.orchestra.run.smithi101.stdout: { 2023-08-01T19:55:28.093 INFO:teuthology.orchestra.run.smithi101.stdout: "event": "op_commit", 2023-08-01T19:55:28.093 INFO:teuthology.orchestra.run.smithi101.stdout: "time": "2023-08-01T19:54:04.478281+0000", 2023-08-01T19:55:28.094 INFO:teuthology.orchestra.run.smithi101.stdout: "duration": 0.004659252 2023-08-01T19:55:28.094 INFO:teuthology.orchestra.run.smithi101.stdout: }, 2023-08-01T19:55:28.094 INFO:teuthology.orchestra.run.smithi101.stdout: { 2023-08-01T19:55:28.094 INFO:teuthology.orchestra.run.smithi101.stdout: "event": "sub_op_commit_rec", 2023-08-01T19:55:28.094 INFO:teuthology.orchestra.run.smithi101.stdout: "time": "2023-08-01T19:54:04.480180+0000", 2023-08-01T19:55:28.094 INFO:teuthology.orchestra.run.smithi101.stdout: "duration": 0.0018986859999999999 2023-08-01T19:55:28.094 INFO:teuthology.orchestra.run.smithi101.stdout: }, 2023-08-01T19:55:28.094 INFO:teuthology.orchestra.run.smithi101.stdout: { 2023-08-01T19:55:28.095 INFO:teuthology.orchestra.run.smithi101.stdout: "event": "commit_sent", 2023-08-01T19:55:28.095 INFO:teuthology.orchestra.run.smithi101.stdout: "time": "2023-08-01T19:54:04.480209+0000", 2023-08-01T19:55:28.095 INFO:teuthology.orchestra.run.smithi101.stdout: "duration": 2.9244999999999999e-05 2023-08-01T19:55:28.095 INFO:teuthology.orchestra.run.smithi101.stdout: }, 2023-08-01T19:55:28.095 INFO:teuthology.orchestra.run.smithi101.stdout: { 2023-08-01T19:55:28.096 INFO:teuthology.orchestra.run.smithi101.stdout: "event": "done", 2023-08-01T19:55:28.096 INFO:teuthology.orchestra.run.smithi101.stdout: "time": "2023-08-01T19:54:04.480244+0000", 2023-08-01T19:55:28.096 INFO:teuthology.orchestra.run.smithi101.stdout: "duration": 3.4875000000000001e-05 2023-08-01T19:55:28.096 INFO:teuthology.orchestra.run.smithi101.stdout: } 2023-08-01T19:55:28.097 INFO:teuthology.orchestra.run.smithi101.stdout: ] 2023-08-01T19:55:28.097 INFO:teuthology.orchestra.run.smithi101.stdout: } 2023-08-01T19:55:28.097 INFO:teuthology.orchestra.run.smithi101.stdout: }, 2023-08-01T19:55:28.097 INFO:teuthology.orchestra.run.smithi101.stdout: { 2023-08-01T19:55:28.097 INFO:teuthology.orchestra.run.smithi101.stdout: "description": "osd_op(mds.0.3:3 3.14 3:287034c4:::1.00000000.inode:head [writefull 0~554] snapc 0=[] ondisk+write+known_if_redirected+full_force+supports_pool_eio e17)", 2023-08-01T19:55:28.097 INFO:teuthology.orchestra.run.smithi101.stdout: "initiated_at": "2023-08-01T19:54:04.459226+0000", 2023-08-01T19:55:28.097 INFO:teuthology.orchestra.run.smithi101.stdout: "age": 83.588572220000003, 2023-08-01T19:55:28.098 INFO:teuthology.orchestra.run.smithi101.stdout: "duration": 0.021104531999999999, 2023-08-01T19:55:28.098 INFO:teuthology.orchestra.run.smithi101.stdout: "type_data": { 2023-08-01T19:55:28.098 INFO:teuthology.orchestra.run.smithi101.stdout: "flag_point": "commit sent; apply or cleanup", 2023-08-01T19:55:28.098 INFO:teuthology.orchestra.run.smithi101.stdout: "events": [ 2023-08-01T19:55:28.098 INFO:teuthology.orchestra.run.smithi101.stdout: { 2023-08-01T19:55:28.098 INFO:teuthology.orchestra.run.smithi101.stdout: "event": "initiated", 2023-08-01T19:55:28.098 INFO:teuthology.orchestra.run.smithi101.stdout: "time": "2023-08-01T19:54:04.459226+0000", 2023-08-01T19:55:28.098 INFO:teuthology.orchestra.run.smithi101.stdout: "duration": 0 2023-08-01T19:55:28.099 INFO:teuthology.orchestra.run.smithi101.stdout: }, 2023-08-01T19:55:28.099 INFO:teuthology.orchestra.run.smithi101.stdout: { 2023-08-01T19:55:28.099 INFO:teuthology.orchestra.run.smithi101.stdout: "event": "throttled", 2023-08-01T19:55:28.099 INFO:teuthology.orchestra.run.smithi101.stdout: "time": "2023-08-01T19:54:04.459226+0000", 2023-08-01T19:55:28.099 INFO:teuthology.orchestra.run.smithi101.stdout: "duration": 0 2023-08-01T19:55:28.099 INFO:teuthology.orchestra.run.smithi101.stdout: }, 2023-08-01T19:55:28.099 INFO:teuthology.orchestra.run.smithi101.stdout: { 2023-08-01T19:55:28.099 INFO:teuthology.orchestra.run.smithi101.stdout: "event": "header_read", 2023-08-01T19:55:28.100 INFO:teuthology.orchestra.run.smithi101.stdout: "time": "2023-08-01T19:54:04.459225+0000", 2023-08-01T19:55:28.100 INFO:teuthology.orchestra.run.smithi101.stdout: "duration": 4294967295.9999995 2023-08-01T19:55:28.100 INFO:teuthology.orchestra.run.smithi101.stdout: }, 2023-08-01T19:55:28.100 INFO:teuthology.orchestra.run.smithi101.stdout: { 2023-08-01T19:55:28.100 INFO:teuthology.orchestra.run.smithi101.stdout: "event": "all_read", 2023-08-01T19:55:28.100 INFO:teuthology.orchestra.run.smithi101.stdout: "time": "2023-08-01T19:54:04.459238+0000", 2023-08-01T19:55:28.100 INFO:teuthology.orchestra.run.smithi101.stdout: "duration": 1.2809000000000001e-05 2023-08-01T19:55:28.101 INFO:teuthology.orchestra.run.smithi101.stdout: }, 2023-08-01T19:55:28.101 INFO:teuthology.orchestra.run.smithi101.stdout: { 2023-08-01T19:55:28.101 INFO:teuthology.orchestra.run.smithi101.stdout: "event": "dispatched", 2023-08-01T19:55:28.101 INFO:teuthology.orchestra.run.smithi101.stdout: "time": "2023-08-01T19:54:04.459245+0000", 2023-08-01T19:55:28.101 INFO:teuthology.orchestra.run.smithi101.stdout: "duration": 6.6540000000000002e-06 2023-08-01T19:55:28.101 INFO:teuthology.orchestra.run.smithi101.stdout: }, 2023-08-01T19:55:28.101 INFO:teuthology.orchestra.run.smithi101.stdout: { 2023-08-01T19:55:28.101 INFO:teuthology.orchestra.run.smithi101.stdout: "event": "queued_for_pg", 2023-08-01T19:55:28.102 INFO:teuthology.orchestra.run.smithi101.stdout: "time": "2023-08-01T19:54:04.459249+0000", 2023-08-01T19:55:28.102 INFO:teuthology.orchestra.run.smithi101.stdout: "duration": 4.6e-06 2023-08-01T19:55:28.102 INFO:teuthology.orchestra.run.smithi101.stdout: }, 2023-08-01T19:55:28.102 INFO:teuthology.orchestra.run.smithi101.stdout: { 2023-08-01T19:55:28.102 INFO:teuthology.orchestra.run.smithi101.stdout: "event": "reached_pg", 2023-08-01T19:55:28.102 INFO:teuthology.orchestra.run.smithi101.stdout: "time": "2023-08-01T19:54:04.459276+0000", 2023-08-01T19:55:28.102 INFO:teuthology.orchestra.run.smithi101.stdout: "duration": 2.6373999999999999e-05 2023-08-01T19:55:28.102 INFO:teuthology.orchestra.run.smithi101.stdout: }, 2023-08-01T19:55:28.103 INFO:teuthology.orchestra.run.smithi101.stdout: { 2023-08-01T19:55:28.103 INFO:teuthology.orchestra.run.smithi101.stdout: "event": "waiting_for_map not empty", 2023-08-01T19:55:28.103 INFO:teuthology.orchestra.run.smithi101.stdout: "time": "2023-08-01T19:54:04.459278+0000", 2023-08-01T19:55:28.103 INFO:teuthology.orchestra.run.smithi101.stdout: "duration": 2.4980000000000001e-06 2023-08-01T19:55:28.103 INFO:teuthology.orchestra.run.smithi101.stdout: }, 2023-08-01T19:55:28.104 INFO:teuthology.orchestra.run.smithi101.stdout: { 2023-08-01T19:55:28.104 INFO:teuthology.orchestra.run.smithi101.stdout: "event": "reached_pg", 2023-08-01T19:55:28.104 INFO:teuthology.orchestra.run.smithi101.stdout: "time": "2023-08-01T19:54:04.474058+0000", 2023-08-01T19:55:28.104 INFO:teuthology.orchestra.run.smithi101.stdout: "duration": 0.014779979 2023-08-01T19:55:28.105 INFO:teuthology.orchestra.run.smithi101.stdout: }, 2023-08-01T19:55:28.105 INFO:teuthology.orchestra.run.smithi101.stdout: { 2023-08-01T19:55:28.105 INFO:teuthology.orchestra.run.smithi101.stdout: "event": "started", 2023-08-01T19:55:28.105 INFO:teuthology.orchestra.run.smithi101.stdout: "time": "2023-08-01T19:54:04.474614+0000", 2023-08-01T19:55:28.105 INFO:teuthology.orchestra.run.smithi101.stdout: "duration": 0.00055546899999999995 2023-08-01T19:55:28.105 INFO:teuthology.orchestra.run.smithi101.stdout: }, 2023-08-01T19:55:28.105 INFO:teuthology.orchestra.run.smithi101.stdout: { 2023-08-01T19:55:28.106 INFO:teuthology.orchestra.run.smithi101.stdout: "event": "waiting for subops from 2", 2023-08-01T19:55:28.106 INFO:teuthology.orchestra.run.smithi101.stdout: "time": "2023-08-01T19:54:04.474720+0000", 2023-08-01T19:55:28.106 INFO:teuthology.orchestra.run.smithi101.stdout: "duration": 0.00010645300000000001 2023-08-01T19:55:28.106 INFO:teuthology.orchestra.run.smithi101.stdout: }, 2023-08-01T19:55:28.106 INFO:teuthology.orchestra.run.smithi101.stdout: { 2023-08-01T19:55:28.106 INFO:teuthology.orchestra.run.smithi101.stdout: "event": "op_commit", 2023-08-01T19:55:28.106 INFO:teuthology.orchestra.run.smithi101.stdout: "time": "2023-08-01T19:54:04.478480+0000", 2023-08-01T19:55:28.107 INFO:teuthology.orchestra.run.smithi101.stdout: "duration": 0.0037600279999999999 2023-08-01T19:55:28.107 INFO:teuthology.orchestra.run.smithi101.stdout: }, 2023-08-01T19:55:28.107 INFO:teuthology.orchestra.run.smithi101.stdout: { 2023-08-01T19:55:28.107 INFO:teuthology.orchestra.run.smithi101.stdout: "event": "sub_op_commit_rec", 2023-08-01T19:55:28.107 INFO:teuthology.orchestra.run.smithi101.stdout: "time": "2023-08-01T19:54:04.480273+0000", 2023-08-01T19:55:28.107 INFO:teuthology.orchestra.run.smithi101.stdout: "duration": 0.001792465 2023-08-01T19:55:28.107 INFO:teuthology.orchestra.run.smithi101.stdout: }, 2023-08-01T19:55:28.107 INFO:teuthology.orchestra.run.smithi101.stdout: { 2023-08-01T19:55:28.108 INFO:teuthology.orchestra.run.smithi101.stdout: "event": "commit_sent", 2023-08-01T19:55:28.108 INFO:teuthology.orchestra.run.smithi101.stdout: "time": "2023-08-01T19:54:04.480304+0000", 2023-08-01T19:55:28.108 INFO:teuthology.orchestra.run.smithi101.stdout: "duration": 3.1708999999999997e-05 2023-08-01T19:55:28.108 INFO:teuthology.orchestra.run.smithi101.stdout: }, 2023-08-01T19:55:28.108 INFO:teuthology.orchestra.run.smithi101.stdout: { 2023-08-01T19:55:28.108 INFO:teuthology.orchestra.run.smithi101.stdout: "event": "done", 2023-08-01T19:55:28.108 INFO:teuthology.orchestra.run.smithi101.stdout: "time": "2023-08-01T19:54:04.480330+0000", 2023-08-01T19:55:28.108 INFO:teuthology.orchestra.run.smithi101.stdout: "duration": 2.5860999999999999e-05 2023-08-01T19:55:28.109 INFO:teuthology.orchestra.run.smithi101.stdout: } 2023-08-01T19:55:28.109 INFO:teuthology.orchestra.run.smithi101.stdout: ] 2023-08-01T19:55:28.109 INFO:teuthology.orchestra.run.smithi101.stdout: } 2023-08-01T19:55:28.109 INFO:teuthology.orchestra.run.smithi101.stdout: }, 2023-08-01T19:55:28.109 INFO:teuthology.orchestra.run.smithi101.stdout: { 2023-08-01T19:55:28.109 INFO:teuthology.orchestra.run.smithi101.stdout: "description": "osd_op(mds.0.3:32 3.14 3:2e2fa760:::200.00000001:head [delete] snapc 0=[] ondisk+write+known_if_redirected+full_force+supports_pool_eio e17)", 2023-08-01T19:55:28.109 INFO:teuthology.orchestra.run.smithi101.stdout: "initiated_at": "2023-08-01T19:54:04.459304+0000", 2023-08-01T19:55:28.110 INFO:teuthology.orchestra.run.smithi101.stdout: "age": 83.588493559, 2023-08-01T19:55:28.110 INFO:teuthology.orchestra.run.smithi101.stdout: "duration": 0.021110606000000001, 2023-08-01T19:55:28.110 INFO:teuthology.orchestra.run.smithi101.stdout: "type_data": { 2023-08-01T19:55:28.110 INFO:teuthology.orchestra.run.smithi101.stdout: "flag_point": "started", 2023-08-01T19:55:28.110 INFO:teuthology.orchestra.run.smithi101.stdout: "events": [ 2023-08-01T19:55:28.110 INFO:teuthology.orchestra.run.smithi101.stdout: { 2023-08-01T19:55:28.110 INFO:teuthology.orchestra.run.smithi101.stdout: "event": "initiated", 2023-08-01T19:55:28.110 INFO:teuthology.orchestra.run.smithi101.stdout: "time": "2023-08-01T19:54:04.459304+0000", 2023-08-01T19:55:28.111 INFO:teuthology.orchestra.run.smithi101.stdout: "duration": 0 2023-08-01T19:55:28.111 INFO:teuthology.orchestra.run.smithi101.stdout: }, 2023-08-01T19:55:28.111 INFO:teuthology.orchestra.run.smithi101.stdout: { 2023-08-01T19:55:28.111 INFO:teuthology.orchestra.run.smithi101.stdout: "event": "throttled", 2023-08-01T19:55:28.111 INFO:teuthology.orchestra.run.smithi101.stdout: "time": "2023-08-01T19:54:04.459304+0000", 2023-08-01T19:55:28.111 INFO:teuthology.orchestra.run.smithi101.stdout: "duration": 0 2023-08-01T19:55:28.111 INFO:teuthology.orchestra.run.smithi101.stdout: }, 2023-08-01T19:55:28.111 INFO:teuthology.orchestra.run.smithi101.stdout: { 2023-08-01T19:55:28.112 INFO:teuthology.orchestra.run.smithi101.stdout: "event": "header_read", 2023-08-01T19:55:28.112 INFO:teuthology.orchestra.run.smithi101.stdout: "time": "2023-08-01T19:54:04.459304+0000", 2023-08-01T19:55:28.112 INFO:teuthology.orchestra.run.smithi101.stdout: "duration": 4294967295.9999995 2023-08-01T19:55:28.112 INFO:teuthology.orchestra.run.smithi101.stdout: }, 2023-08-01T19:55:28.112 INFO:teuthology.orchestra.run.smithi101.stdout: { 2023-08-01T19:55:28.112 INFO:teuthology.orchestra.run.smithi101.stdout: "event": "all_read", 2023-08-01T19:55:28.113 INFO:teuthology.orchestra.run.smithi101.stdout: "time": "2023-08-01T19:54:04.459306+0000", 2023-08-01T19:55:28.113 INFO:teuthology.orchestra.run.smithi101.stdout: "duration": 2.3889999999999999e-06 2023-08-01T19:55:28.113 INFO:teuthology.orchestra.run.smithi101.stdout: }, 2023-08-01T19:55:28.113 INFO:teuthology.orchestra.run.smithi101.stdout: { 2023-08-01T19:55:28.114 INFO:teuthology.orchestra.run.smithi101.stdout: "event": "dispatched", 2023-08-01T19:55:28.114 INFO:teuthology.orchestra.run.smithi101.stdout: "time": "2023-08-01T19:54:04.459314+0000", 2023-08-01T19:55:28.114 INFO:teuthology.orchestra.run.smithi101.stdout: "duration": 7.1180000000000003e-06 2023-08-01T19:55:28.115 INFO:teuthology.orchestra.run.smithi101.stdout: }, 2023-08-01T19:55:28.115 INFO:teuthology.orchestra.run.smithi101.stdout: { 2023-08-01T19:55:28.115 INFO:teuthology.orchestra.run.smithi101.stdout: "event": "queued_for_pg", 2023-08-01T19:55:28.115 INFO:teuthology.orchestra.run.smithi101.stdout: "time": "2023-08-01T19:54:04.459318+0000", 2023-08-01T19:55:28.115 INFO:teuthology.orchestra.run.smithi101.stdout: "duration": 4.0239999999999999e-06 2023-08-01T19:55:28.116 INFO:teuthology.orchestra.run.smithi101.stdout: }, 2023-08-01T19:55:28.116 INFO:teuthology.orchestra.run.smithi101.stdout: { 2023-08-01T19:55:28.116 INFO:teuthology.orchestra.run.smithi101.stdout: "event": "reached_pg", 2023-08-01T19:55:28.116 INFO:teuthology.orchestra.run.smithi101.stdout: "time": "2023-08-01T19:54:04.459340+0000", 2023-08-01T19:55:28.116 INFO:teuthology.orchestra.run.smithi101.stdout: "duration": 2.2476e-05 2023-08-01T19:55:28.116 INFO:teuthology.orchestra.run.smithi101.stdout: }, 2023-08-01T19:55:28.117 INFO:teuthology.orchestra.run.smithi101.stdout: { 2023-08-01T19:55:28.117 INFO:teuthology.orchestra.run.smithi101.stdout: "event": "waiting_for_map not empty", 2023-08-01T19:55:28.117 INFO:teuthology.orchestra.run.smithi101.stdout: "time": "2023-08-01T19:54:04.459342+0000", 2023-08-01T19:55:28.117 INFO:teuthology.orchestra.run.smithi101.stdout: "duration": 2.272e-06 2023-08-01T19:55:28.117 INFO:teuthology.orchestra.run.smithi101.stdout: }, 2023-08-01T19:55:28.117 INFO:teuthology.orchestra.run.smithi101.stdout: { 2023-08-01T19:55:28.117 INFO:teuthology.orchestra.run.smithi101.stdout: "event": "reached_pg", 2023-08-01T19:55:28.117 INFO:teuthology.orchestra.run.smithi101.stdout: "time": "2023-08-01T19:54:04.475922+0000", 2023-08-01T19:55:28.118 INFO:teuthology.orchestra.run.smithi101.stdout: "duration": 0.016579388 2023-08-01T19:55:28.118 INFO:teuthology.orchestra.run.smithi101.stdout: }, 2023-08-01T19:55:28.118 INFO:teuthology.orchestra.run.smithi101.stdout: { 2023-08-01T19:55:28.118 INFO:teuthology.orchestra.run.smithi101.stdout: "event": "started", 2023-08-01T19:55:28.118 INFO:teuthology.orchestra.run.smithi101.stdout: "time": "2023-08-01T19:54:04.476107+0000", 2023-08-01T19:55:28.118 INFO:teuthology.orchestra.run.smithi101.stdout: "duration": 0.00018486300000000001 2023-08-01T19:55:28.118 INFO:teuthology.orchestra.run.smithi101.stdout: }, 2023-08-01T19:55:28.118 INFO:teuthology.orchestra.run.smithi101.stdout: { 2023-08-01T19:55:28.119 INFO:teuthology.orchestra.run.smithi101.stdout: "event": "done", 2023-08-01T19:55:28.119 INFO:teuthology.orchestra.run.smithi101.stdout: "time": "2023-08-01T19:54:04.480415+0000", 2023-08-01T19:55:28.119 INFO:teuthology.orchestra.run.smithi101.stdout: "duration": 0.0043084589999999997 2023-08-01T19:55:28.119 INFO:teuthology.orchestra.run.smithi101.stdout: } 2023-08-01T19:55:28.119 INFO:teuthology.orchestra.run.smithi101.stdout: ] 2023-08-01T19:55:28.119 INFO:teuthology.orchestra.run.smithi101.stdout: } 2023-08-01T19:55:28.119 INFO:teuthology.orchestra.run.smithi101.stdout: }, 2023-08-01T19:55:28.119 INFO:teuthology.orchestra.run.smithi101.stdout: { 2023-08-01T19:55:28.120 INFO:teuthology.orchestra.run.smithi101.stdout: "description": "osd_op(client.4668.0:70878 5.2 5:49b7d2be:::benchmark_data_smithi006_114134_object70877:head [set-alloc-hint object_size 65536 write_size 65536,write 0~65536] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e30)", 2023-08-01T19:55:28.120 INFO:teuthology.orchestra.run.smithi101.stdout: "initiated_at": "2023-08-01T19:54:50.210223+0000", 2023-08-01T19:55:28.120 INFO:teuthology.orchestra.run.smithi101.stdout: "age": 37.837574988999997, 2023-08-01T19:55:28.120 INFO:teuthology.orchestra.run.smithi101.stdout: "duration": 0.019884895, 2023-08-01T19:55:28.120 INFO:teuthology.orchestra.run.smithi101.stdout: "type_data": { 2023-08-01T19:55:28.120 INFO:teuthology.orchestra.run.smithi101.stdout: "flag_point": "commit sent; apply or cleanup", 2023-08-01T19:55:28.120 INFO:teuthology.orchestra.run.smithi101.stdout: "client_info": { 2023-08-01T19:55:28.121 INFO:teuthology.orchestra.run.smithi101.stdout: "client": "client.4668", 2023-08-01T19:55:28.121 INFO:teuthology.orchestra.run.smithi101.stdout: "client_addr": "172.21.15.6:0/1709472247", 2023-08-01T19:55:28.121 INFO:teuthology.orchestra.run.smithi101.stdout: "tid": 70878 2023-08-01T19:55:28.121 INFO:teuthology.orchestra.run.smithi101.stdout: }, 2023-08-01T19:55:28.121 INFO:teuthology.orchestra.run.smithi101.stdout: "events": [ 2023-08-01T19:55:28.121 INFO:teuthology.orchestra.run.smithi101.stdout: { 2023-08-01T19:55:28.121 INFO:teuthology.orchestra.run.smithi101.stdout: "event": "initiated", 2023-08-01T19:55:28.122 INFO:teuthology.orchestra.run.smithi101.stdout: "time": "2023-08-01T19:54:50.210223+0000", 2023-08-01T19:55:28.122 INFO:teuthology.orchestra.run.smithi101.stdout: "duration": 0 2023-08-01T19:55:28.122 INFO:teuthology.orchestra.run.smithi101.stdout: }, 2023-08-01T19:55:28.122 INFO:teuthology.orchestra.run.smithi101.stdout: { 2023-08-01T19:55:28.122 INFO:teuthology.orchestra.run.smithi101.stdout: "event": "throttled", 2023-08-01T19:55:28.122 INFO:teuthology.orchestra.run.smithi101.stdout: "time": "2023-08-01T19:54:50.210223+0000", 2023-08-01T19:55:28.122 INFO:teuthology.orchestra.run.smithi101.stdout: "duration": 0 2023-08-01T19:55:28.122 INFO:teuthology.orchestra.run.smithi101.stdout: }, 2023-08-01T19:55:28.123 INFO:teuthology.orchestra.run.smithi101.stdout: { 2023-08-01T19:55:28.123 INFO:teuthology.orchestra.run.smithi101.stdout: "event": "header_read", 2023-08-01T19:55:28.123 INFO:teuthology.orchestra.run.smithi101.stdout: "time": "2023-08-01T19:54:50.210222+0000", 2023-08-01T19:55:28.123 INFO:teuthology.orchestra.run.smithi101.stdout: "duration": 4294967295.999999 2023-08-01T19:55:28.123 INFO:teuthology.orchestra.run.smithi101.stdout: }, 2023-08-01T19:55:28.123 INFO:teuthology.orchestra.run.smithi101.stdout: { 2023-08-01T19:55:28.123 INFO:teuthology.orchestra.run.smithi101.stdout: "event": "all_read", 2023-08-01T19:55:28.123 INFO:teuthology.orchestra.run.smithi101.stdout: "time": "2023-08-01T19:54:50.210315+0000", 2023-08-01T19:55:28.124 INFO:teuthology.orchestra.run.smithi101.stdout: "duration": 9.2567999999999999e-05 2023-08-01T19:55:28.124 INFO:teuthology.orchestra.run.smithi101.stdout: }, 2023-08-01T19:55:28.124 INFO:teuthology.orchestra.run.smithi101.stdout: { 2023-08-01T19:55:28.124 INFO:teuthology.orchestra.run.smithi101.stdout: "event": "dispatched", 2023-08-01T19:55:28.124 INFO:teuthology.orchestra.run.smithi101.stdout: "time": "2023-08-01T19:54:50.210326+0000", 2023-08-01T19:55:28.124 INFO:teuthology.orchestra.run.smithi101.stdout: "duration": 1.1430000000000001e-05 2023-08-01T19:55:28.124 INFO:teuthology.orchestra.run.smithi101.stdout: }, 2023-08-01T19:55:28.125 INFO:teuthology.orchestra.run.smithi101.stdout: { 2023-08-01T19:55:28.125 INFO:teuthology.orchestra.run.smithi101.stdout: "event": "queued_for_pg", 2023-08-01T19:55:28.125 INFO:teuthology.orchestra.run.smithi101.stdout: "time": "2023-08-01T19:54:50.210332+0000", 2023-08-01T19:55:28.125 INFO:teuthology.orchestra.run.smithi101.stdout: "duration": 5.8479999999999997e-06 2023-08-01T19:55:28.125 INFO:teuthology.orchestra.run.smithi101.stdout: }, 2023-08-01T19:55:28.125 INFO:teuthology.orchestra.run.smithi101.stdout: { 2023-08-01T19:55:28.125 INFO:teuthology.orchestra.run.smithi101.stdout: "event": "reached_pg", 2023-08-01T19:55:28.125 INFO:teuthology.orchestra.run.smithi101.stdout: "time": "2023-08-01T19:54:50.214259+0000", 2023-08-01T19:55:28.126 INFO:teuthology.orchestra.run.smithi101.stdout: "duration": 0.003926789 2023-08-01T19:55:28.126 INFO:teuthology.orchestra.run.smithi101.stdout: }, 2023-08-01T19:55:28.126 INFO:teuthology.orchestra.run.smithi101.stdout: { 2023-08-01T19:55:28.126 INFO:teuthology.orchestra.run.smithi101.stdout: "event": "started", 2023-08-01T19:55:28.126 INFO:teuthology.orchestra.run.smithi101.stdout: "time": "2023-08-01T19:54:50.214387+0000", 2023-08-01T19:55:28.126 INFO:teuthology.orchestra.run.smithi101.stdout: "duration": 0.00012787599999999999 2023-08-01T19:55:28.126 INFO:teuthology.orchestra.run.smithi101.stdout: }, 2023-08-01T19:55:28.127 INFO:teuthology.orchestra.run.smithi101.stdout: { 2023-08-01T19:55:28.127 INFO:teuthology.orchestra.run.smithi101.stdout: "event": "waiting for subops from 0", 2023-08-01T19:55:28.127 INFO:teuthology.orchestra.run.smithi101.stdout: "time": "2023-08-01T19:54:50.214536+0000", 2023-08-01T19:55:28.127 INFO:teuthology.orchestra.run.smithi101.stdout: "duration": 0.00014935299999999999 2023-08-01T19:55:28.127 INFO:teuthology.orchestra.run.smithi101.stdout: }, 2023-08-01T19:55:28.127 INFO:teuthology.orchestra.run.smithi101.stdout: { 2023-08-01T19:55:28.127 INFO:teuthology.orchestra.run.smithi101.stdout: "event": "op_commit", 2023-08-01T19:55:28.127 INFO:teuthology.orchestra.run.smithi101.stdout: "time": "2023-08-01T19:54:50.217739+0000", 2023-08-01T19:55:28.128 INFO:teuthology.orchestra.run.smithi101.stdout: "duration": 0.0032034619999999998 2023-08-01T19:55:28.128 INFO:teuthology.orchestra.run.smithi101.stdout: }, 2023-08-01T19:55:28.128 INFO:teuthology.orchestra.run.smithi101.stdout: { 2023-08-01T19:55:28.128 INFO:teuthology.orchestra.run.smithi101.stdout: "event": "sub_op_commit_rec", 2023-08-01T19:55:28.128 INFO:teuthology.orchestra.run.smithi101.stdout: "time": "2023-08-01T19:54:50.230032+0000", 2023-08-01T19:55:28.128 INFO:teuthology.orchestra.run.smithi101.stdout: "duration": 0.012293068000000001 2023-08-01T19:55:28.128 INFO:teuthology.orchestra.run.smithi101.stdout: }, 2023-08-01T19:55:28.128 INFO:teuthology.orchestra.run.smithi101.stdout: { 2023-08-01T19:55:28.129 INFO:teuthology.orchestra.run.smithi101.stdout: "event": "commit_sent", 2023-08-01T19:55:28.129 INFO:teuthology.orchestra.run.smithi101.stdout: "time": "2023-08-01T19:54:50.230075+0000", 2023-08-01T19:55:28.129 INFO:teuthology.orchestra.run.smithi101.stdout: "duration": 4.3062999999999997e-05 2023-08-01T19:55:28.129 INFO:teuthology.orchestra.run.smithi101.stdout: }, 2023-08-01T19:55:28.129 INFO:teuthology.orchestra.run.smithi101.stdout: { 2023-08-01T19:55:28.129 INFO:teuthology.orchestra.run.smithi101.stdout: "event": "done", 2023-08-01T19:55:28.129 INFO:teuthology.orchestra.run.smithi101.stdout: "time": "2023-08-01T19:54:50.230108+0000", 2023-08-01T19:55:28.130 INFO:teuthology.orchestra.run.smithi101.stdout: "duration": 3.2366999999999997e-05 2023-08-01T19:55:28.130 INFO:teuthology.orchestra.run.smithi101.stdout: } 2023-08-01T19:55:28.130 INFO:teuthology.orchestra.run.smithi101.stdout: ] 2023-08-01T19:55:28.130 INFO:teuthology.orchestra.run.smithi101.stdout: } 2023-08-01T19:55:28.130 INFO:teuthology.orchestra.run.smithi101.stdout: }, 2023-08-01T19:55:28.130 INFO:teuthology.orchestra.run.smithi101.stdout: { 2023-08-01T19:55:28.130 INFO:teuthology.orchestra.run.smithi101.stdout: "description": "osd_op(client.4668.0:73460 5.f 5:ff4f0704:::benchmark_data_smithi006_114134_object73459:head [set-alloc-hint object_size 65536 write_size 65536,write 0~65536] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e31)", 2023-08-01T19:55:28.130 INFO:teuthology.orchestra.run.smithi101.stdout: "initiated_at": "2023-08-01T19:54:51.462968+0000", 2023-08-01T19:55:28.131 INFO:teuthology.orchestra.run.smithi101.stdout: "age": 36.584830109999999, 2023-08-01T19:55:28.131 INFO:teuthology.orchestra.run.smithi101.stdout: "duration": 0.020056502, 2023-08-01T19:55:28.131 INFO:teuthology.orchestra.run.smithi101.stdout: "type_data": { 2023-08-01T19:55:28.131 INFO:teuthology.orchestra.run.smithi101.stdout: "flag_point": "commit sent; apply or cleanup", 2023-08-01T19:55:28.131 INFO:teuthology.orchestra.run.smithi101.stdout: "client_info": { 2023-08-01T19:55:28.131 INFO:teuthology.orchestra.run.smithi101.stdout: "client": "client.4668", 2023-08-01T19:55:28.131 INFO:teuthology.orchestra.run.smithi101.stdout: "client_addr": "172.21.15.6:0/1709472247", 2023-08-01T19:55:28.131 INFO:teuthology.orchestra.run.smithi101.stdout: "tid": 73460 2023-08-01T19:55:28.132 INFO:teuthology.orchestra.run.smithi101.stdout: }, 2023-08-01T19:55:28.132 INFO:teuthology.orchestra.run.smithi101.stdout: "events": [ 2023-08-01T19:55:28.132 INFO:teuthology.orchestra.run.smithi101.stdout: { 2023-08-01T19:55:28.132 INFO:teuthology.orchestra.run.smithi101.stdout: "event": "initiated", 2023-08-01T19:55:28.132 INFO:teuthology.orchestra.run.smithi101.stdout: "time": "2023-08-01T19:54:51.462968+0000", 2023-08-01T19:55:28.132 INFO:teuthology.orchestra.run.smithi101.stdout: "duration": 0 2023-08-01T19:55:28.132 INFO:teuthology.orchestra.run.smithi101.stdout: }, 2023-08-01T19:55:28.133 INFO:teuthology.orchestra.run.smithi101.stdout: { 2023-08-01T19:55:28.133 INFO:teuthology.orchestra.run.smithi101.stdout: "event": "throttled", 2023-08-01T19:55:28.133 INFO:teuthology.orchestra.run.smithi101.stdout: "time": "2023-08-01T19:54:51.462968+0000", 2023-08-01T19:55:28.133 INFO:teuthology.orchestra.run.smithi101.stdout: "duration": 0 2023-08-01T19:55:28.133 INFO:teuthology.orchestra.run.smithi101.stdout: }, 2023-08-01T19:55:28.133 INFO:teuthology.orchestra.run.smithi101.stdout: { 2023-08-01T19:55:28.133 INFO:teuthology.orchestra.run.smithi101.stdout: "event": "header_read", 2023-08-01T19:55:28.133 INFO:teuthology.orchestra.run.smithi101.stdout: "time": "2023-08-01T19:54:51.462967+0000", 2023-08-01T19:55:28.134 INFO:teuthology.orchestra.run.smithi101.stdout: "duration": 4294967295.999999 2023-08-01T19:55:28.134 INFO:teuthology.orchestra.run.smithi101.stdout: }, 2023-08-01T19:55:28.134 INFO:teuthology.orchestra.run.smithi101.stdout: { 2023-08-01T19:55:28.134 INFO:teuthology.orchestra.run.smithi101.stdout: "event": "all_read", 2023-08-01T19:55:28.134 INFO:teuthology.orchestra.run.smithi101.stdout: "time": "2023-08-01T19:54:51.463009+0000", 2023-08-01T19:55:28.134 INFO:teuthology.orchestra.run.smithi101.stdout: "duration": 4.2106e-05 2023-08-01T19:55:28.134 INFO:teuthology.orchestra.run.smithi101.stdout: }, 2023-08-01T19:55:28.135 INFO:teuthology.orchestra.run.smithi101.stdout: { 2023-08-01T19:55:28.135 INFO:teuthology.orchestra.run.smithi101.stdout: "event": "dispatched", 2023-08-01T19:55:28.135 INFO:teuthology.orchestra.run.smithi101.stdout: "time": "2023-08-01T19:54:51.463017+0000", 2023-08-01T19:55:28.135 INFO:teuthology.orchestra.run.smithi101.stdout: "duration": 8.1529999999999997e-06 2023-08-01T19:55:28.135 INFO:teuthology.orchestra.run.smithi101.stdout: }, 2023-08-01T19:55:28.135 INFO:teuthology.orchestra.run.smithi101.stdout: { 2023-08-01T19:55:28.135 INFO:teuthology.orchestra.run.smithi101.stdout: "event": "queued_for_pg", 2023-08-01T19:55:28.135 INFO:teuthology.orchestra.run.smithi101.stdout: "time": "2023-08-01T19:54:51.463027+0000", 2023-08-01T19:55:28.136 INFO:teuthology.orchestra.run.smithi101.stdout: "duration": 9.5659999999999996e-06 2023-08-01T19:55:28.136 INFO:teuthology.orchestra.run.smithi101.stdout: }, 2023-08-01T19:55:28.136 INFO:teuthology.orchestra.run.smithi101.stdout: { 2023-08-01T19:55:28.136 INFO:teuthology.orchestra.run.smithi101.stdout: "event": "reached_pg", 2023-08-01T19:55:28.136 INFO:teuthology.orchestra.run.smithi101.stdout: "time": "2023-08-01T19:54:51.463062+0000", 2023-08-01T19:55:28.136 INFO:teuthology.orchestra.run.smithi101.stdout: "duration": 3.5442999999999999e-05 2023-08-01T19:55:28.136 INFO:teuthology.orchestra.run.smithi101.stdout: }, 2023-08-01T19:55:28.136 INFO:teuthology.orchestra.run.smithi101.stdout: { 2023-08-01T19:55:28.137 INFO:teuthology.orchestra.run.smithi101.stdout: "event": "started", 2023-08-01T19:55:28.137 INFO:teuthology.orchestra.run.smithi101.stdout: "time": "2023-08-01T19:54:51.463198+0000", 2023-08-01T19:55:28.137 INFO:teuthology.orchestra.run.smithi101.stdout: "duration": 0.000135628 2023-08-01T19:55:28.137 INFO:teuthology.orchestra.run.smithi101.stdout: }, 2023-08-01T19:55:28.137 INFO:teuthology.orchestra.run.smithi101.stdout: { 2023-08-01T19:55:28.137 INFO:teuthology.orchestra.run.smithi101.stdout: "event": "waiting for subops from 2", 2023-08-01T19:55:28.137 INFO:teuthology.orchestra.run.smithi101.stdout: "time": "2023-08-01T19:54:51.463341+0000", 2023-08-01T19:55:28.137 INFO:teuthology.orchestra.run.smithi101.stdout: "duration": 0.00014346500000000001 2023-08-01T19:55:28.138 INFO:teuthology.orchestra.run.smithi101.stdout: }, 2023-08-01T19:55:28.138 INFO:teuthology.orchestra.run.smithi101.stdout: { 2023-08-01T19:55:28.138 INFO:teuthology.orchestra.run.smithi101.stdout: "event": "op_commit", 2023-08-01T19:55:28.138 INFO:teuthology.orchestra.run.smithi101.stdout: "time": "2023-08-01T19:54:51.472684+0000", 2023-08-01T19:55:28.138 INFO:teuthology.orchestra.run.smithi101.stdout: "duration": 0.0093427900000000001 2023-08-01T19:55:28.138 INFO:teuthology.orchestra.run.smithi101.stdout: }, 2023-08-01T19:55:28.138 INFO:teuthology.orchestra.run.smithi101.stdout: { 2023-08-01T19:55:28.138 INFO:teuthology.orchestra.run.smithi101.stdout: "event": "sub_op_commit_rec", 2023-08-01T19:55:28.139 INFO:teuthology.orchestra.run.smithi101.stdout: "time": "2023-08-01T19:54:51.482937+0000", 2023-08-01T19:55:28.139 INFO:teuthology.orchestra.run.smithi101.stdout: "duration": 0.010252557000000001 2023-08-01T19:55:28.139 INFO:teuthology.orchestra.run.smithi101.stdout: }, 2023-08-01T19:55:28.139 INFO:teuthology.orchestra.run.smithi101.stdout: { 2023-08-01T19:55:28.139 INFO:teuthology.orchestra.run.smithi101.stdout: "event": "commit_sent", 2023-08-01T19:55:28.139 INFO:teuthology.orchestra.run.smithi101.stdout: "time": "2023-08-01T19:54:51.482984+0000", 2023-08-01T19:55:28.139 INFO:teuthology.orchestra.run.smithi101.stdout: "duration": 4.7394000000000001e-05 2023-08-01T19:55:28.139 INFO:teuthology.orchestra.run.smithi101.stdout: }, 2023-08-01T19:55:28.140 INFO:teuthology.orchestra.run.smithi101.stdout: { 2023-08-01T19:55:28.140 INFO:teuthology.orchestra.run.smithi101.stdout: "event": "done", 2023-08-01T19:55:28.140 INFO:teuthology.orchestra.run.smithi101.stdout: "time": "2023-08-01T19:54:51.483024+0000", 2023-08-01T19:55:28.140 INFO:teuthology.orchestra.run.smithi101.stdout: "duration": 4.0159e-05 2023-08-01T19:55:28.140 INFO:teuthology.orchestra.run.smithi101.stdout: } 2023-08-01T19:55:28.140 INFO:teuthology.orchestra.run.smithi101.stdout: ] 2023-08-01T19:55:28.140 INFO:teuthology.orchestra.run.smithi101.stdout: } 2023-08-01T19:55:28.141 INFO:teuthology.orchestra.run.smithi101.stdout: }, 2023-08-01T19:55:28.141 INFO:teuthology.orchestra.run.smithi101.stdout: { 2023-08-01T19:55:28.141 INFO:teuthology.orchestra.run.smithi101.stdout: "description": "osd_op(client.4668.0:92726 5.2 5:41e18163:::benchmark_data_smithi006_114134_object92725:head [set-alloc-hint object_size 65536 write_size 65536,write 0~65536] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e36)", 2023-08-01T19:55:28.141 INFO:teuthology.orchestra.run.smithi101.stdout: "initiated_at": "2023-08-01T19:55:01.256971+0000", 2023-08-01T19:55:28.141 INFO:teuthology.orchestra.run.smithi101.stdout: "age": 26.790827030999999, 2023-08-01T19:55:28.141 INFO:teuthology.orchestra.run.smithi101.stdout: "duration": 0.019854296, 2023-08-01T19:55:28.141 INFO:teuthology.orchestra.run.smithi101.stdout: "type_data": { 2023-08-01T19:55:28.141 INFO:teuthology.orchestra.run.smithi101.stdout: "flag_point": "commit sent; apply or cleanup", 2023-08-01T19:55:28.142 INFO:teuthology.orchestra.run.smithi101.stdout: "client_info": { 2023-08-01T19:55:28.142 INFO:teuthology.orchestra.run.smithi101.stdout: "client": "client.4668", 2023-08-01T19:55:28.142 INFO:teuthology.orchestra.run.smithi101.stdout: "client_addr": "172.21.15.6:0/1709472247", 2023-08-01T19:55:28.142 INFO:teuthology.orchestra.run.smithi101.stdout: "tid": 92726 2023-08-01T19:55:28.142 INFO:teuthology.orchestra.run.smithi101.stdout: }, 2023-08-01T19:55:28.142 INFO:teuthology.orchestra.run.smithi101.stdout: "events": [ 2023-08-01T19:55:28.142 INFO:teuthology.orchestra.run.smithi101.stdout: { 2023-08-01T19:55:28.142 INFO:teuthology.orchestra.run.smithi101.stdout: "event": "initiated", 2023-08-01T19:55:28.143 INFO:teuthology.orchestra.run.smithi101.stdout: "time": "2023-08-01T19:55:01.256971+0000", 2023-08-01T19:55:28.143 INFO:teuthology.orchestra.run.smithi101.stdout: "duration": 0 2023-08-01T19:55:28.143 INFO:teuthology.orchestra.run.smithi101.stdout: }, 2023-08-01T19:55:28.143 INFO:teuthology.orchestra.run.smithi101.stdout: { 2023-08-01T19:55:28.143 INFO:teuthology.orchestra.run.smithi101.stdout: "event": "throttled", 2023-08-01T19:55:28.143 INFO:teuthology.orchestra.run.smithi101.stdout: "time": "2023-08-01T19:55:01.256971+0000", 2023-08-01T19:55:28.143 INFO:teuthology.orchestra.run.smithi101.stdout: "duration": 0 2023-08-01T19:55:28.143 INFO:teuthology.orchestra.run.smithi101.stdout: }, 2023-08-01T19:55:28.144 INFO:teuthology.orchestra.run.smithi101.stdout: { 2023-08-01T19:55:28.144 INFO:teuthology.orchestra.run.smithi101.stdout: "event": "header_read", 2023-08-01T19:55:28.144 INFO:teuthology.orchestra.run.smithi101.stdout: "time": "2023-08-01T19:55:01.256970+0000", 2023-08-01T19:55:28.144 INFO:teuthology.orchestra.run.smithi101.stdout: "duration": 4294967295.9999995 2023-08-01T19:55:28.144 INFO:teuthology.orchestra.run.smithi101.stdout: }, 2023-08-01T19:55:28.144 INFO:teuthology.orchestra.run.smithi101.stdout: { 2023-08-01T19:55:28.144 INFO:teuthology.orchestra.run.smithi101.stdout: "event": "all_read", 2023-08-01T19:55:28.144 INFO:teuthology.orchestra.run.smithi101.stdout: "time": "2023-08-01T19:55:01.257057+0000", 2023-08-01T19:55:28.145 INFO:teuthology.orchestra.run.smithi101.stdout: "duration": 8.6627999999999998e-05 2023-08-01T19:55:28.145 INFO:teuthology.orchestra.run.smithi101.stdout: }, 2023-08-01T19:55:28.145 INFO:teuthology.orchestra.run.smithi101.stdout: { 2023-08-01T19:55:28.145 INFO:teuthology.orchestra.run.smithi101.stdout: "event": "dispatched", 2023-08-01T19:55:28.145 INFO:teuthology.orchestra.run.smithi101.stdout: "time": "2023-08-01T19:55:01.257063+0000", 2023-08-01T19:55:28.145 INFO:teuthology.orchestra.run.smithi101.stdout: "duration": 6.528e-06 2023-08-01T19:55:28.145 INFO:teuthology.orchestra.run.smithi101.stdout: }, 2023-08-01T19:55:28.145 INFO:teuthology.orchestra.run.smithi101.stdout: { 2023-08-01T19:55:28.146 INFO:teuthology.orchestra.run.smithi101.stdout: "event": "queued_for_pg", 2023-08-01T19:55:28.146 INFO:teuthology.orchestra.run.smithi101.stdout: "time": "2023-08-01T19:55:01.257067+0000", 2023-08-01T19:55:28.146 INFO:teuthology.orchestra.run.smithi101.stdout: "duration": 3.2739999999999999e-06 2023-08-01T19:55:28.146 INFO:teuthology.orchestra.run.smithi101.stdout: }, 2023-08-01T19:55:28.146 INFO:teuthology.orchestra.run.smithi101.stdout: { 2023-08-01T19:55:28.146 INFO:teuthology.orchestra.run.smithi101.stdout: "event": "reached_pg", 2023-08-01T19:55:28.146 INFO:teuthology.orchestra.run.smithi101.stdout: "time": "2023-08-01T19:55:01.259714+0000", 2023-08-01T19:55:28.146 INFO:teuthology.orchestra.run.smithi101.stdout: "duration": 0.0026476709999999999 2023-08-01T19:55:28.147 INFO:teuthology.orchestra.run.smithi101.stdout: }, 2023-08-01T19:55:28.147 INFO:teuthology.orchestra.run.smithi101.stdout: { 2023-08-01T19:55:28.147 INFO:teuthology.orchestra.run.smithi101.stdout: "event": "started", 2023-08-01T19:55:28.147 INFO:teuthology.orchestra.run.smithi101.stdout: "time": "2023-08-01T19:55:01.259829+0000", 2023-08-01T19:55:28.147 INFO:teuthology.orchestra.run.smithi101.stdout: "duration": 0.000114471 2023-08-01T19:55:28.147 INFO:teuthology.orchestra.run.smithi101.stdout: }, 2023-08-01T19:55:28.147 INFO:teuthology.orchestra.run.smithi101.stdout: { 2023-08-01T19:55:28.147 INFO:teuthology.orchestra.run.smithi101.stdout: "event": "waiting for subops from 0", 2023-08-01T19:55:28.148 INFO:teuthology.orchestra.run.smithi101.stdout: "time": "2023-08-01T19:55:01.259965+0000", 2023-08-01T19:55:28.148 INFO:teuthology.orchestra.run.smithi101.stdout: "duration": 0.00013597300000000001 2023-08-01T19:55:28.148 INFO:teuthology.orchestra.run.smithi101.stdout: }, 2023-08-01T19:55:28.148 INFO:teuthology.orchestra.run.smithi101.stdout: { 2023-08-01T19:55:28.148 INFO:teuthology.orchestra.run.smithi101.stdout: "event": "op_commit", 2023-08-01T19:55:28.148 INFO:teuthology.orchestra.run.smithi101.stdout: "time": "2023-08-01T19:55:01.264360+0000", 2023-08-01T19:55:28.148 INFO:teuthology.orchestra.run.smithi101.stdout: "duration": 0.0043956619999999998 2023-08-01T19:55:28.149 INFO:teuthology.orchestra.run.smithi101.stdout: }, 2023-08-01T19:55:28.149 INFO:teuthology.orchestra.run.smithi101.stdout: { 2023-08-01T19:55:28.149 INFO:teuthology.orchestra.run.smithi101.stdout: "event": "sub_op_commit_rec", 2023-08-01T19:55:28.149 INFO:teuthology.orchestra.run.smithi101.stdout: "time": "2023-08-01T19:55:01.276766+0000", 2023-08-01T19:55:28.149 INFO:teuthology.orchestra.run.smithi101.stdout: "duration": 0.012405736000000001 2023-08-01T19:55:28.149 INFO:teuthology.orchestra.run.smithi101.stdout: }, 2023-08-01T19:55:28.149 INFO:teuthology.orchestra.run.smithi101.stdout: { 2023-08-01T19:55:28.149 INFO:teuthology.orchestra.run.smithi101.stdout: "event": "commit_sent", 2023-08-01T19:55:28.150 INFO:teuthology.orchestra.run.smithi101.stdout: "time": "2023-08-01T19:55:01.276804+0000", 2023-08-01T19:55:28.150 INFO:teuthology.orchestra.run.smithi101.stdout: "duration": 3.7759999999999998e-05 2023-08-01T19:55:28.150 INFO:teuthology.orchestra.run.smithi101.stdout: }, 2023-08-01T19:55:28.150 INFO:teuthology.orchestra.run.smithi101.stdout: { 2023-08-01T19:55:28.150 INFO:teuthology.orchestra.run.smithi101.stdout: "event": "done", 2023-08-01T19:55:28.150 INFO:teuthology.orchestra.run.smithi101.stdout: "time": "2023-08-01T19:55:01.276825+0000", 2023-08-01T19:55:28.150 INFO:teuthology.orchestra.run.smithi101.stdout: "duration": 2.1299000000000001e-05 2023-08-01T19:55:28.150 INFO:teuthology.orchestra.run.smithi101.stdout: } 2023-08-01T19:55:28.151 INFO:teuthology.orchestra.run.smithi101.stdout: ] 2023-08-01T19:55:28.151 INFO:teuthology.orchestra.run.smithi101.stdout: } 2023-08-01T19:55:28.151 INFO:teuthology.orchestra.run.smithi101.stdout: }, 2023-08-01T19:55:28.151 INFO:teuthology.orchestra.run.smithi101.stdout: { 2023-08-01T19:55:28.151 INFO:teuthology.orchestra.run.smithi101.stdout: "description": "osd_op(client.4668.0:100244 5.9 5:92f56a12:::benchmark_data_smithi006_114134_object100243:head [set-alloc-hint object_size 65536 write_size 65536,write 0~65536] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e37)", 2023-08-01T19:55:28.151 INFO:teuthology.orchestra.run.smithi101.stdout: "initiated_at": "2023-08-01T19:55:05.150910+0000", 2023-08-01T19:55:28.151 INFO:teuthology.orchestra.run.smithi101.stdout: "age": 22.896888215000001, 2023-08-01T19:55:28.151 INFO:teuthology.orchestra.run.smithi101.stdout: "duration": 0.072864287, 2023-08-01T19:55:28.152 INFO:teuthology.orchestra.run.smithi101.stdout: "type_data": { 2023-08-01T19:55:28.152 INFO:teuthology.orchestra.run.smithi101.stdout: "flag_point": "commit sent; apply or cleanup", 2023-08-01T19:55:28.152 INFO:teuthology.orchestra.run.smithi101.stdout: "client_info": { 2023-08-01T19:55:28.152 INFO:teuthology.orchestra.run.smithi101.stdout: "client": "client.4668", 2023-08-01T19:55:28.152 INFO:teuthology.orchestra.run.smithi101.stdout: "client_addr": "172.21.15.6:0/1709472247", 2023-08-01T19:55:28.152 INFO:teuthology.orchestra.run.smithi101.stdout: "tid": 100244 2023-08-01T19:55:28.152 INFO:teuthology.orchestra.run.smithi101.stdout: }, 2023-08-01T19:55:28.152 INFO:teuthology.orchestra.run.smithi101.stdout: "events": [ 2023-08-01T19:55:28.153 INFO:teuthology.orchestra.run.smithi101.stdout: { 2023-08-01T19:55:28.153 INFO:teuthology.orchestra.run.smithi101.stdout: "event": "initiated", 2023-08-01T19:55:28.153 INFO:teuthology.orchestra.run.smithi101.stdout: "time": "2023-08-01T19:55:05.150910+0000", 2023-08-01T19:55:28.153 INFO:teuthology.orchestra.run.smithi101.stdout: "duration": 0 2023-08-01T19:55:28.153 INFO:teuthology.orchestra.run.smithi101.stdout: }, 2023-08-01T19:55:28.153 INFO:teuthology.orchestra.run.smithi101.stdout: { 2023-08-01T19:55:28.153 INFO:teuthology.orchestra.run.smithi101.stdout: "event": "throttled", 2023-08-01T19:55:28.154 INFO:teuthology.orchestra.run.smithi101.stdout: "time": "2023-08-01T19:55:05.150910+0000", 2023-08-01T19:55:28.154 INFO:teuthology.orchestra.run.smithi101.stdout: "duration": 0 2023-08-01T19:55:28.154 INFO:teuthology.orchestra.run.smithi101.stdout: }, 2023-08-01T19:55:28.154 INFO:teuthology.orchestra.run.smithi101.stdout: { 2023-08-01T19:55:28.154 INFO:teuthology.orchestra.run.smithi101.stdout: "event": "header_read", 2023-08-01T19:55:28.154 INFO:teuthology.orchestra.run.smithi101.stdout: "time": "2023-08-01T19:55:05.150909+0000", 2023-08-01T19:55:28.154 INFO:teuthology.orchestra.run.smithi101.stdout: "duration": 4294967295.999999 2023-08-01T19:55:28.154 INFO:teuthology.orchestra.run.smithi101.stdout: }, 2023-08-01T19:55:28.155 INFO:teuthology.orchestra.run.smithi101.stdout: { 2023-08-01T19:55:28.155 INFO:teuthology.orchestra.run.smithi101.stdout: "event": "all_read", 2023-08-01T19:55:28.155 INFO:teuthology.orchestra.run.smithi101.stdout: "time": "2023-08-01T19:55:05.150973+0000", 2023-08-01T19:55:28.155 INFO:teuthology.orchestra.run.smithi101.stdout: "duration": 6.4531999999999998e-05 2023-08-01T19:55:28.155 INFO:teuthology.orchestra.run.smithi101.stdout: }, 2023-08-01T19:55:28.155 INFO:teuthology.orchestra.run.smithi101.stdout: { 2023-08-01T19:55:28.155 INFO:teuthology.orchestra.run.smithi101.stdout: "event": "dispatched", 2023-08-01T19:55:28.155 INFO:teuthology.orchestra.run.smithi101.stdout: "time": "2023-08-01T19:55:05.150984+0000", 2023-08-01T19:55:28.156 INFO:teuthology.orchestra.run.smithi101.stdout: "duration": 1.0287e-05 2023-08-01T19:55:28.156 INFO:teuthology.orchestra.run.smithi101.stdout: }, 2023-08-01T19:55:28.156 INFO:teuthology.orchestra.run.smithi101.stdout: { 2023-08-01T19:55:28.156 INFO:teuthology.orchestra.run.smithi101.stdout: "event": "queued_for_pg", 2023-08-01T19:55:28.156 INFO:teuthology.orchestra.run.smithi101.stdout: "time": "2023-08-01T19:55:05.150989+0000", 2023-08-01T19:55:28.156 INFO:teuthology.orchestra.run.smithi101.stdout: "duration": 5.3929999999999999e-06 2023-08-01T19:55:28.156 INFO:teuthology.orchestra.run.smithi101.stdout: }, 2023-08-01T19:55:28.156 INFO:teuthology.orchestra.run.smithi101.stdout: { 2023-08-01T19:55:28.157 INFO:teuthology.orchestra.run.smithi101.stdout: "event": "reached_pg", 2023-08-01T19:55:28.157 INFO:teuthology.orchestra.run.smithi101.stdout: "time": "2023-08-01T19:55:05.151034+0000", 2023-08-01T19:55:28.157 INFO:teuthology.orchestra.run.smithi101.stdout: "duration": 4.4336999999999999e-05 2023-08-01T19:55:28.157 INFO:teuthology.orchestra.run.smithi101.stdout: }, 2023-08-01T19:55:28.157 INFO:teuthology.orchestra.run.smithi101.stdout: { 2023-08-01T19:55:28.157 INFO:teuthology.orchestra.run.smithi101.stdout: "event": "started", 2023-08-01T19:55:28.157 INFO:teuthology.orchestra.run.smithi101.stdout: "time": "2023-08-01T19:55:05.151167+0000", 2023-08-01T19:55:28.157 INFO:teuthology.orchestra.run.smithi101.stdout: "duration": 0.00013368899999999999 2023-08-01T19:55:28.158 INFO:teuthology.orchestra.run.smithi101.stdout: }, 2023-08-01T19:55:28.158 INFO:teuthology.orchestra.run.smithi101.stdout: { 2023-08-01T19:55:28.158 INFO:teuthology.orchestra.run.smithi101.stdout: "event": "waiting for subops from 2", 2023-08-01T19:55:28.158 INFO:teuthology.orchestra.run.smithi101.stdout: "time": "2023-08-01T19:55:05.151328+0000", 2023-08-01T19:55:28.158 INFO:teuthology.orchestra.run.smithi101.stdout: "duration": 0.00016122700000000001 2023-08-01T19:55:28.158 INFO:teuthology.orchestra.run.smithi101.stdout: }, 2023-08-01T19:55:28.158 INFO:teuthology.orchestra.run.smithi101.stdout: { 2023-08-01T19:55:28.158 INFO:teuthology.orchestra.run.smithi101.stdout: "event": "op_commit", 2023-08-01T19:55:28.159 INFO:teuthology.orchestra.run.smithi101.stdout: "time": "2023-08-01T19:55:05.156101+0000", 2023-08-01T19:55:28.159 INFO:teuthology.orchestra.run.smithi101.stdout: "duration": 0.0047724100000000004 2023-08-01T19:55:28.159 INFO:teuthology.orchestra.run.smithi101.stdout: }, 2023-08-01T19:55:28.159 INFO:teuthology.orchestra.run.smithi101.stdout: { 2023-08-01T19:55:28.159 INFO:teuthology.orchestra.run.smithi101.stdout: "event": "sub_op_commit_rec", 2023-08-01T19:55:28.159 INFO:teuthology.orchestra.run.smithi101.stdout: "time": "2023-08-01T19:55:05.223688+0000", 2023-08-01T19:55:28.159 INFO:teuthology.orchestra.run.smithi101.stdout: "duration": 0.067586937999999999 2023-08-01T19:55:28.160 INFO:teuthology.orchestra.run.smithi101.stdout: }, 2023-08-01T19:55:28.160 INFO:teuthology.orchestra.run.smithi101.stdout: { 2023-08-01T19:55:28.160 INFO:teuthology.orchestra.run.smithi101.stdout: "event": "commit_sent", 2023-08-01T19:55:28.160 INFO:teuthology.orchestra.run.smithi101.stdout: "time": "2023-08-01T19:55:05.223737+0000", 2023-08-01T19:55:28.160 INFO:teuthology.orchestra.run.smithi101.stdout: "duration": 4.8921999999999997e-05 2023-08-01T19:55:28.160 INFO:teuthology.orchestra.run.smithi101.stdout: }, 2023-08-01T19:55:28.160 INFO:teuthology.orchestra.run.smithi101.stdout: { 2023-08-01T19:55:28.160 INFO:teuthology.orchestra.run.smithi101.stdout: "event": "done", 2023-08-01T19:55:28.161 INFO:teuthology.orchestra.run.smithi101.stdout: "time": "2023-08-01T19:55:05.223774+0000", 2023-08-01T19:55:28.161 INFO:teuthology.orchestra.run.smithi101.stdout: "duration": 3.7342999999999998e-05 2023-08-01T19:55:28.161 INFO:teuthology.orchestra.run.smithi101.stdout: } 2023-08-01T19:55:28.161 INFO:teuthology.orchestra.run.smithi101.stdout: ] 2023-08-01T19:55:28.161 INFO:teuthology.orchestra.run.smithi101.stdout: } 2023-08-01T19:55:28.161 INFO:teuthology.orchestra.run.smithi101.stdout: }, 2023-08-01T19:55:28.161 INFO:teuthology.orchestra.run.smithi101.stdout: { 2023-08-01T19:55:28.161 INFO:teuthology.orchestra.run.smithi101.stdout: "description": "osd_op(client.4668.0:100253 5.f 5:f7bbce05:::benchmark_data_smithi006_114134_object100252:head [set-alloc-hint object_size 65536 write_size 65536,write 0~65536] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e37)", 2023-08-01T19:55:28.162 INFO:teuthology.orchestra.run.smithi101.stdout: "initiated_at": "2023-08-01T19:55:05.156562+0000", 2023-08-01T19:55:28.162 INFO:teuthology.orchestra.run.smithi101.stdout: "age": 22.891236182, 2023-08-01T19:55:28.162 INFO:teuthology.orchestra.run.smithi101.stdout: "duration": 0.068677503000000001, 2023-08-01T19:55:28.162 INFO:teuthology.orchestra.run.smithi101.stdout: "type_data": { 2023-08-01T19:55:28.162 INFO:teuthology.orchestra.run.smithi101.stdout: "flag_point": "commit sent; apply or cleanup", 2023-08-01T19:55:28.162 INFO:teuthology.orchestra.run.smithi101.stdout: "client_info": { 2023-08-01T19:55:28.162 INFO:teuthology.orchestra.run.smithi101.stdout: "client": "client.4668", 2023-08-01T19:55:28.162 INFO:teuthology.orchestra.run.smithi101.stdout: "client_addr": "172.21.15.6:0/1709472247", 2023-08-01T19:55:28.163 INFO:teuthology.orchestra.run.smithi101.stdout: "tid": 100253 2023-08-01T19:55:28.163 INFO:teuthology.orchestra.run.smithi101.stdout: }, 2023-08-01T19:55:28.163 INFO:teuthology.orchestra.run.smithi101.stdout: "events": [ 2023-08-01T19:55:28.163 INFO:teuthology.orchestra.run.smithi101.stdout: { 2023-08-01T19:55:28.163 INFO:teuthology.orchestra.run.smithi101.stdout: "event": "initiated", 2023-08-01T19:55:28.163 INFO:teuthology.orchestra.run.smithi101.stdout: "time": "2023-08-01T19:55:05.156562+0000", 2023-08-01T19:55:28.163 INFO:teuthology.orchestra.run.smithi101.stdout: "duration": 0 2023-08-01T19:55:28.164 INFO:teuthology.orchestra.run.smithi101.stdout: }, 2023-08-01T19:55:28.164 INFO:teuthology.orchestra.run.smithi101.stdout: { 2023-08-01T19:55:28.164 INFO:teuthology.orchestra.run.smithi101.stdout: "event": "throttled", 2023-08-01T19:55:28.164 INFO:teuthology.orchestra.run.smithi101.stdout: "time": "2023-08-01T19:55:05.156562+0000", 2023-08-01T19:55:28.164 INFO:teuthology.orchestra.run.smithi101.stdout: "duration": 0 2023-08-01T19:55:28.164 INFO:teuthology.orchestra.run.smithi101.stdout: }, 2023-08-01T19:55:28.164 INFO:teuthology.orchestra.run.smithi101.stdout: { 2023-08-01T19:55:28.164 INFO:teuthology.orchestra.run.smithi101.stdout: "event": "header_read", 2023-08-01T19:55:28.165 INFO:teuthology.orchestra.run.smithi101.stdout: "time": "2023-08-01T19:55:05.156561+0000", 2023-08-01T19:55:28.165 INFO:teuthology.orchestra.run.smithi101.stdout: "duration": 4294967295.999999 2023-08-01T19:55:28.165 INFO:teuthology.orchestra.run.smithi101.stdout: }, 2023-08-01T19:55:28.165 INFO:teuthology.orchestra.run.smithi101.stdout: { 2023-08-01T19:55:28.165 INFO:teuthology.orchestra.run.smithi101.stdout: "event": "all_read", 2023-08-01T19:55:28.165 INFO:teuthology.orchestra.run.smithi101.stdout: "time": "2023-08-01T19:55:05.156655+0000", 2023-08-01T19:55:28.165 INFO:teuthology.orchestra.run.smithi101.stdout: "duration": 9.4018999999999995e-05 2023-08-01T19:55:28.165 INFO:teuthology.orchestra.run.smithi101.stdout: }, 2023-08-01T19:55:28.166 INFO:teuthology.orchestra.run.smithi101.stdout: { 2023-08-01T19:55:28.166 INFO:teuthology.orchestra.run.smithi101.stdout: "event": "dispatched", 2023-08-01T19:55:28.166 INFO:teuthology.orchestra.run.smithi101.stdout: "time": "2023-08-01T19:55:05.156664+0000", 2023-08-01T19:55:28.166 INFO:teuthology.orchestra.run.smithi101.stdout: "duration": 9.4970000000000007e-06 2023-08-01T19:55:28.166 INFO:teuthology.orchestra.run.smithi101.stdout: }, 2023-08-01T19:55:28.166 INFO:teuthology.orchestra.run.smithi101.stdout: { 2023-08-01T19:55:28.166 INFO:teuthology.orchestra.run.smithi101.stdout: "event": "queued_for_pg", 2023-08-01T19:55:28.166 INFO:teuthology.orchestra.run.smithi101.stdout: "time": "2023-08-01T19:55:05.156671+0000", 2023-08-01T19:55:28.167 INFO:teuthology.orchestra.run.smithi101.stdout: "duration": 6.1929999999999998e-06 2023-08-01T19:55:28.167 INFO:teuthology.orchestra.run.smithi101.stdout: }, 2023-08-01T19:55:28.167 INFO:teuthology.orchestra.run.smithi101.stdout: { 2023-08-01T19:55:28.167 INFO:teuthology.orchestra.run.smithi101.stdout: "event": "reached_pg", 2023-08-01T19:55:28.167 INFO:teuthology.orchestra.run.smithi101.stdout: "time": "2023-08-01T19:55:05.156742+0000", 2023-08-01T19:55:28.167 INFO:teuthology.orchestra.run.smithi101.stdout: "duration": 7.1181999999999997e-05 2023-08-01T19:55:28.167 INFO:teuthology.orchestra.run.smithi101.stdout: }, 2023-08-01T19:55:28.167 INFO:teuthology.orchestra.run.smithi101.stdout: { 2023-08-01T19:55:28.168 INFO:teuthology.orchestra.run.smithi101.stdout: "event": "started", 2023-08-01T19:55:28.168 INFO:teuthology.orchestra.run.smithi101.stdout: "time": "2023-08-01T19:55:05.156839+0000", 2023-08-01T19:55:28.168 INFO:teuthology.orchestra.run.smithi101.stdout: "duration": 9.7182000000000006e-05 2023-08-01T19:55:28.168 INFO:teuthology.orchestra.run.smithi101.stdout: }, 2023-08-01T19:55:28.168 INFO:teuthology.orchestra.run.smithi101.stdout: { 2023-08-01T19:55:28.168 INFO:teuthology.orchestra.run.smithi101.stdout: "event": "waiting for subops from 2", 2023-08-01T19:55:28.168 INFO:teuthology.orchestra.run.smithi101.stdout: "time": "2023-08-01T19:55:05.156925+0000", 2023-08-01T19:55:28.168 INFO:teuthology.orchestra.run.smithi101.stdout: "duration": 8.5816000000000006e-05 2023-08-01T19:55:28.169 INFO:teuthology.orchestra.run.smithi101.stdout: }, 2023-08-01T19:55:28.169 INFO:teuthology.orchestra.run.smithi101.stdout: { 2023-08-01T19:55:28.169 INFO:teuthology.orchestra.run.smithi101.stdout: "event": "op_commit", 2023-08-01T19:55:28.169 INFO:teuthology.orchestra.run.smithi101.stdout: "time": "2023-08-01T19:55:05.160082+0000", 2023-08-01T19:55:28.169 INFO:teuthology.orchestra.run.smithi101.stdout: "duration": 0.0031573959999999998 2023-08-01T19:55:28.169 INFO:teuthology.orchestra.run.smithi101.stdout: }, 2023-08-01T19:55:28.169 INFO:teuthology.orchestra.run.smithi101.stdout: { 2023-08-01T19:55:28.169 INFO:teuthology.orchestra.run.smithi101.stdout: "event": "sub_op_commit_rec", 2023-08-01T19:55:28.170 INFO:teuthology.orchestra.run.smithi101.stdout: "time": "2023-08-01T19:55:05.225162+0000", 2023-08-01T19:55:28.170 INFO:teuthology.orchestra.run.smithi101.stdout: "duration": 0.065079466000000002 2023-08-01T19:55:28.170 INFO:teuthology.orchestra.run.smithi101.stdout: }, 2023-08-01T19:55:28.170 INFO:teuthology.orchestra.run.smithi101.stdout: { 2023-08-01T19:55:28.170 INFO:teuthology.orchestra.run.smithi101.stdout: "event": "commit_sent", 2023-08-01T19:55:28.170 INFO:teuthology.orchestra.run.smithi101.stdout: "time": "2023-08-01T19:55:05.225205+0000", 2023-08-01T19:55:28.170 INFO:teuthology.orchestra.run.smithi101.stdout: "duration": 4.3446999999999999e-05 2023-08-01T19:55:28.171 INFO:teuthology.orchestra.run.smithi101.stdout: }, 2023-08-01T19:55:28.171 INFO:teuthology.orchestra.run.smithi101.stdout: { 2023-08-01T19:55:28.171 INFO:teuthology.orchestra.run.smithi101.stdout: "event": "done", 2023-08-01T19:55:28.171 INFO:teuthology.orchestra.run.smithi101.stdout: "time": "2023-08-01T19:55:05.225239+0000", 2023-08-01T19:55:28.171 INFO:teuthology.orchestra.run.smithi101.stdout: "duration": 3.4121000000000001e-05 2023-08-01T19:55:28.171 INFO:teuthology.orchestra.run.smithi101.stdout: } 2023-08-01T19:55:28.171 INFO:teuthology.orchestra.run.smithi101.stdout: ] 2023-08-01T19:55:28.171 INFO:teuthology.orchestra.run.smithi101.stdout: } 2023-08-01T19:55:28.172 INFO:teuthology.orchestra.run.smithi101.stdout: }, 2023-08-01T19:55:28.172 INFO:teuthology.orchestra.run.smithi101.stdout: { 2023-08-01T19:55:28.172 INFO:teuthology.orchestra.run.smithi101.stdout: "description": "osd_op(client.4668.0:100928 5.7 5:e61a7dfa:::benchmark_data_smithi006_114134_object100927:head [set-alloc-hint object_size 65536 write_size 65536,write 0~65536] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e37)", 2023-08-01T19:55:28.172 INFO:teuthology.orchestra.run.smithi101.stdout: "initiated_at": "2023-08-01T19:55:05.564731+0000", 2023-08-01T19:55:28.172 INFO:teuthology.orchestra.run.smithi101.stdout: "age": 22.483066690000001, 2023-08-01T19:55:28.172 INFO:teuthology.orchestra.run.smithi101.stdout: "duration": 0.064686603999999995, 2023-08-01T19:55:28.172 INFO:teuthology.orchestra.run.smithi101.stdout: "type_data": { 2023-08-01T19:55:28.172 INFO:teuthology.orchestra.run.smithi101.stdout: "flag_point": "commit sent; apply or cleanup", 2023-08-01T19:55:28.173 INFO:teuthology.orchestra.run.smithi101.stdout: "client_info": { 2023-08-01T19:55:28.173 INFO:teuthology.orchestra.run.smithi101.stdout: "client": "client.4668", 2023-08-01T19:55:28.173 INFO:teuthology.orchestra.run.smithi101.stdout: "client_addr": "172.21.15.6:0/1709472247", 2023-08-01T19:55:28.173 INFO:teuthology.orchestra.run.smithi101.stdout: "tid": 100928 2023-08-01T19:55:28.173 INFO:teuthology.orchestra.run.smithi101.stdout: }, 2023-08-01T19:55:28.173 INFO:teuthology.orchestra.run.smithi101.stdout: "events": [ 2023-08-01T19:55:28.173 INFO:teuthology.orchestra.run.smithi101.stdout: { 2023-08-01T19:55:28.173 INFO:teuthology.orchestra.run.smithi101.stdout: "event": "initiated", 2023-08-01T19:55:28.174 INFO:teuthology.orchestra.run.smithi101.stdout: "time": "2023-08-01T19:55:05.564731+0000", 2023-08-01T19:55:28.174 INFO:teuthology.orchestra.run.smithi101.stdout: "duration": 0 2023-08-01T19:55:28.174 INFO:teuthology.orchestra.run.smithi101.stdout: }, 2023-08-01T19:55:28.174 INFO:teuthology.orchestra.run.smithi101.stdout: { 2023-08-01T19:55:28.174 INFO:teuthology.orchestra.run.smithi101.stdout: "event": "throttled", 2023-08-01T19:55:28.174 INFO:teuthology.orchestra.run.smithi101.stdout: "time": "2023-08-01T19:55:05.564731+0000", 2023-08-01T19:55:28.174 INFO:teuthology.orchestra.run.smithi101.stdout: "duration": 0 2023-08-01T19:55:28.174 INFO:teuthology.orchestra.run.smithi101.stdout: }, 2023-08-01T19:55:28.175 INFO:teuthology.orchestra.run.smithi101.stdout: { 2023-08-01T19:55:28.175 INFO:teuthology.orchestra.run.smithi101.stdout: "event": "header_read", 2023-08-01T19:55:28.175 INFO:teuthology.orchestra.run.smithi101.stdout: "time": "2023-08-01T19:55:05.564731+0000", 2023-08-01T19:55:28.175 INFO:teuthology.orchestra.run.smithi101.stdout: "duration": 4294967295.999999 2023-08-01T19:55:28.175 INFO:teuthology.orchestra.run.smithi101.stdout: }, 2023-08-01T19:55:28.175 INFO:teuthology.orchestra.run.smithi101.stdout: { 2023-08-01T19:55:28.175 INFO:teuthology.orchestra.run.smithi101.stdout: "event": "all_read", 2023-08-01T19:55:28.176 INFO:teuthology.orchestra.run.smithi101.stdout: "time": "2023-08-01T19:55:05.564832+0000", 2023-08-01T19:55:28.176 INFO:teuthology.orchestra.run.smithi101.stdout: "duration": 0.000101752 2023-08-01T19:55:28.176 INFO:teuthology.orchestra.run.smithi101.stdout: }, 2023-08-01T19:55:28.176 INFO:teuthology.orchestra.run.smithi101.stdout: { 2023-08-01T19:55:28.176 INFO:teuthology.orchestra.run.smithi101.stdout: "event": "dispatched", 2023-08-01T19:55:28.176 INFO:teuthology.orchestra.run.smithi101.stdout: "time": "2023-08-01T19:55:05.564840+0000", 2023-08-01T19:55:28.176 INFO:teuthology.orchestra.run.smithi101.stdout: "duration": 7.8590000000000005e-06 2023-08-01T19:55:28.176 INFO:teuthology.orchestra.run.smithi101.stdout: }, 2023-08-01T19:55:28.177 INFO:teuthology.orchestra.run.smithi101.stdout: { 2023-08-01T19:55:28.177 INFO:teuthology.orchestra.run.smithi101.stdout: "event": "queued_for_pg", 2023-08-01T19:55:28.177 INFO:teuthology.orchestra.run.smithi101.stdout: "time": "2023-08-01T19:55:05.564845+0000", 2023-08-01T19:55:28.177 INFO:teuthology.orchestra.run.smithi101.stdout: "duration": 4.9189999999999998e-06 2023-08-01T19:55:28.177 INFO:teuthology.orchestra.run.smithi101.stdout: }, 2023-08-01T19:55:28.177 INFO:teuthology.orchestra.run.smithi101.stdout: { 2023-08-01T19:55:28.177 INFO:teuthology.orchestra.run.smithi101.stdout: "event": "reached_pg", 2023-08-01T19:55:28.178 INFO:teuthology.orchestra.run.smithi101.stdout: "time": "2023-08-01T19:55:05.564883+0000", 2023-08-01T19:55:28.178 INFO:teuthology.orchestra.run.smithi101.stdout: "duration": 3.7481999999999998e-05 2023-08-01T19:55:28.178 INFO:teuthology.orchestra.run.smithi101.stdout: }, 2023-08-01T19:55:28.178 INFO:teuthology.orchestra.run.smithi101.stdout: { 2023-08-01T19:55:28.178 INFO:teuthology.orchestra.run.smithi101.stdout: "event": "started", 2023-08-01T19:55:28.178 INFO:teuthology.orchestra.run.smithi101.stdout: "time": "2023-08-01T19:55:05.564968+0000", 2023-08-01T19:55:28.178 INFO:teuthology.orchestra.run.smithi101.stdout: "duration": 8.5494999999999994e-05 2023-08-01T19:55:28.178 INFO:teuthology.orchestra.run.smithi101.stdout: }, 2023-08-01T19:55:28.179 INFO:teuthology.orchestra.run.smithi101.stdout: { 2023-08-01T19:55:28.179 INFO:teuthology.orchestra.run.smithi101.stdout: "event": "waiting for subops from 0", 2023-08-01T19:55:28.179 INFO:teuthology.orchestra.run.smithi101.stdout: "time": "2023-08-01T19:55:05.565062+0000", 2023-08-01T19:55:28.179 INFO:teuthology.orchestra.run.smithi101.stdout: "duration": 9.3478000000000002e-05 2023-08-01T19:55:28.179 INFO:teuthology.orchestra.run.smithi101.stdout: }, 2023-08-01T19:55:28.179 INFO:teuthology.orchestra.run.smithi101.stdout: { 2023-08-01T19:55:28.179 INFO:teuthology.orchestra.run.smithi101.stdout: "event": "op_commit", 2023-08-01T19:55:28.179 INFO:teuthology.orchestra.run.smithi101.stdout: "time": "2023-08-01T19:55:05.572061+0000", 2023-08-01T19:55:28.180 INFO:teuthology.orchestra.run.smithi101.stdout: "duration": 0.0069998250000000003 2023-08-01T19:55:28.180 INFO:teuthology.orchestra.run.smithi101.stdout: }, 2023-08-01T19:55:28.180 INFO:teuthology.orchestra.run.smithi101.stdout: { 2023-08-01T19:55:28.180 INFO:teuthology.orchestra.run.smithi101.stdout: "event": "sub_op_commit_rec", 2023-08-01T19:55:28.180 INFO:teuthology.orchestra.run.smithi101.stdout: "time": "2023-08-01T19:55:05.629362+0000", 2023-08-01T19:55:28.180 INFO:teuthology.orchestra.run.smithi101.stdout: "duration": 0.057300691000000001 2023-08-01T19:55:28.180 INFO:teuthology.orchestra.run.smithi101.stdout: }, 2023-08-01T19:55:28.180 INFO:teuthology.orchestra.run.smithi101.stdout: { 2023-08-01T19:55:28.181 INFO:teuthology.orchestra.run.smithi101.stdout: "event": "commit_sent", 2023-08-01T19:55:28.181 INFO:teuthology.orchestra.run.smithi101.stdout: "time": "2023-08-01T19:55:05.629395+0000", 2023-08-01T19:55:28.181 INFO:teuthology.orchestra.run.smithi101.stdout: "duration": 3.3124000000000003e-05 2023-08-01T19:55:28.181 INFO:teuthology.orchestra.run.smithi101.stdout: }, 2023-08-01T19:55:28.181 INFO:teuthology.orchestra.run.smithi101.stdout: { 2023-08-01T19:55:28.181 INFO:teuthology.orchestra.run.smithi101.stdout: "event": "done", 2023-08-01T19:55:28.181 INFO:teuthology.orchestra.run.smithi101.stdout: "time": "2023-08-01T19:55:05.629418+0000", 2023-08-01T19:55:28.182 INFO:teuthology.orchestra.run.smithi101.stdout: "duration": 2.2697999999999999e-05 2023-08-01T19:55:28.182 INFO:teuthology.orchestra.run.smithi101.stdout: } 2023-08-01T19:55:28.182 INFO:teuthology.orchestra.run.smithi101.stdout: ] 2023-08-01T19:55:28.182 INFO:teuthology.orchestra.run.smithi101.stdout: } 2023-08-01T19:55:28.182 INFO:teuthology.orchestra.run.smithi101.stdout: }, 2023-08-01T19:55:28.182 INFO:teuthology.orchestra.run.smithi101.stdout: { 2023-08-01T19:55:28.182 INFO:teuthology.orchestra.run.smithi101.stdout: "description": "osd_op(client.4668.0:100936 5.1 5:8f4e3576:::benchmark_data_smithi006_114134_object100935:head [set-alloc-hint object_size 65536 write_size 65536,write 0~65536] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e37)", 2023-08-01T19:55:28.183 INFO:teuthology.orchestra.run.smithi101.stdout: "initiated_at": "2023-08-01T19:55:05.567147+0000", 2023-08-01T19:55:28.183 INFO:teuthology.orchestra.run.smithi101.stdout: "age": 22.480651164000001, 2023-08-01T19:55:28.183 INFO:teuthology.orchestra.run.smithi101.stdout: "duration": 0.063466380000000003, 2023-08-01T19:55:28.183 INFO:teuthology.orchestra.run.smithi101.stdout: "type_data": { 2023-08-01T19:55:28.183 INFO:teuthology.orchestra.run.smithi101.stdout: "flag_point": "commit sent; apply or cleanup", 2023-08-01T19:55:28.183 INFO:teuthology.orchestra.run.smithi101.stdout: "client_info": { 2023-08-01T19:55:28.183 INFO:teuthology.orchestra.run.smithi101.stdout: "client": "client.4668", 2023-08-01T19:55:28.183 INFO:teuthology.orchestra.run.smithi101.stdout: "client_addr": "172.21.15.6:0/1709472247", 2023-08-01T19:55:28.184 INFO:teuthology.orchestra.run.smithi101.stdout: "tid": 100936 2023-08-01T19:55:28.184 INFO:teuthology.orchestra.run.smithi101.stdout: }, 2023-08-01T19:55:28.184 INFO:teuthology.orchestra.run.smithi101.stdout: "events": [ 2023-08-01T19:55:28.184 INFO:teuthology.orchestra.run.smithi101.stdout: { 2023-08-01T19:55:28.184 INFO:teuthology.orchestra.run.smithi101.stdout: "event": "initiated", 2023-08-01T19:55:28.184 INFO:teuthology.orchestra.run.smithi101.stdout: "time": "2023-08-01T19:55:05.567147+0000", 2023-08-01T19:55:28.184 INFO:teuthology.orchestra.run.smithi101.stdout: "duration": 0 2023-08-01T19:55:28.185 INFO:teuthology.orchestra.run.smithi101.stdout: }, 2023-08-01T19:55:28.185 INFO:teuthology.orchestra.run.smithi101.stdout: { 2023-08-01T19:55:28.185 INFO:teuthology.orchestra.run.smithi101.stdout: "event": "throttled", 2023-08-01T19:55:28.185 INFO:teuthology.orchestra.run.smithi101.stdout: "time": "2023-08-01T19:55:05.567147+0000", 2023-08-01T19:55:28.185 INFO:teuthology.orchestra.run.smithi101.stdout: "duration": 0 2023-08-01T19:55:28.185 INFO:teuthology.orchestra.run.smithi101.stdout: }, 2023-08-01T19:55:28.185 INFO:teuthology.orchestra.run.smithi101.stdout: { 2023-08-01T19:55:28.185 INFO:teuthology.orchestra.run.smithi101.stdout: "event": "header_read", 2023-08-01T19:55:28.186 INFO:teuthology.orchestra.run.smithi101.stdout: "time": "2023-08-01T19:55:05.567146+0000", 2023-08-01T19:55:28.186 INFO:teuthology.orchestra.run.smithi101.stdout: "duration": 4294967295.999999 2023-08-01T19:55:28.186 INFO:teuthology.orchestra.run.smithi101.stdout: }, 2023-08-01T19:55:28.186 INFO:teuthology.orchestra.run.smithi101.stdout: { 2023-08-01T19:55:28.186 INFO:teuthology.orchestra.run.smithi101.stdout: "event": "all_read", 2023-08-01T19:55:28.186 INFO:teuthology.orchestra.run.smithi101.stdout: "time": "2023-08-01T19:55:05.567224+0000", 2023-08-01T19:55:28.186 INFO:teuthology.orchestra.run.smithi101.stdout: "duration": 7.8460000000000004e-05 2023-08-01T19:55:28.186 INFO:teuthology.orchestra.run.smithi101.stdout: }, 2023-08-01T19:55:28.187 INFO:teuthology.orchestra.run.smithi101.stdout: { 2023-08-01T19:55:28.187 INFO:teuthology.orchestra.run.smithi101.stdout: "event": "dispatched", 2023-08-01T19:55:28.187 INFO:teuthology.orchestra.run.smithi101.stdout: "time": "2023-08-01T19:55:05.567234+0000", 2023-08-01T19:55:28.187 INFO:teuthology.orchestra.run.smithi101.stdout: "duration": 9.7110000000000007e-06 2023-08-01T19:55:28.187 INFO:teuthology.orchestra.run.smithi101.stdout: }, 2023-08-01T19:55:28.187 INFO:teuthology.orchestra.run.smithi101.stdout: { 2023-08-01T19:55:28.187 INFO:teuthology.orchestra.run.smithi101.stdout: "event": "queued_for_pg", 2023-08-01T19:55:28.188 INFO:teuthology.orchestra.run.smithi101.stdout: "time": "2023-08-01T19:55:05.567239+0000", 2023-08-01T19:55:28.188 INFO:teuthology.orchestra.run.smithi101.stdout: "duration": 5.237e-06 2023-08-01T19:55:28.188 INFO:teuthology.orchestra.run.smithi101.stdout: }, 2023-08-01T19:55:28.188 INFO:teuthology.orchestra.run.smithi101.stdout: { 2023-08-01T19:55:28.188 INFO:teuthology.orchestra.run.smithi101.stdout: "event": "reached_pg", 2023-08-01T19:55:28.188 INFO:teuthology.orchestra.run.smithi101.stdout: "time": "2023-08-01T19:55:05.567278+0000", 2023-08-01T19:55:28.188 INFO:teuthology.orchestra.run.smithi101.stdout: "duration": 3.9069999999999997e-05 2023-08-01T19:55:28.188 INFO:teuthology.orchestra.run.smithi101.stdout: }, 2023-08-01T19:55:28.189 INFO:teuthology.orchestra.run.smithi101.stdout: { 2023-08-01T19:55:28.189 INFO:teuthology.orchestra.run.smithi101.stdout: "event": "started", 2023-08-01T19:55:28.189 INFO:teuthology.orchestra.run.smithi101.stdout: "time": "2023-08-01T19:55:05.567402+0000", 2023-08-01T19:55:28.189 INFO:teuthology.orchestra.run.smithi101.stdout: "duration": 0.00012348700000000001 2023-08-01T19:55:28.189 INFO:teuthology.orchestra.run.smithi101.stdout: }, 2023-08-01T19:55:28.189 INFO:teuthology.orchestra.run.smithi101.stdout: { 2023-08-01T19:55:28.189 INFO:teuthology.orchestra.run.smithi101.stdout: "event": "waiting for subops from 0", 2023-08-01T19:55:28.190 INFO:teuthology.orchestra.run.smithi101.stdout: "time": "2023-08-01T19:55:05.567558+0000", 2023-08-01T19:55:28.190 INFO:teuthology.orchestra.run.smithi101.stdout: "duration": 0.000156179 2023-08-01T19:55:28.190 INFO:teuthology.orchestra.run.smithi101.stdout: }, 2023-08-01T19:55:28.190 INFO:teuthology.orchestra.run.smithi101.stdout: { 2023-08-01T19:55:28.190 INFO:teuthology.orchestra.run.smithi101.stdout: "event": "op_commit", 2023-08-01T19:55:28.190 INFO:teuthology.orchestra.run.smithi101.stdout: "time": "2023-08-01T19:55:05.573767+0000", 2023-08-01T19:55:28.190 INFO:teuthology.orchestra.run.smithi101.stdout: "duration": 0.0062092409999999999 2023-08-01T19:55:28.190 INFO:teuthology.orchestra.run.smithi101.stdout: }, 2023-08-01T19:55:28.191 INFO:teuthology.orchestra.run.smithi101.stdout: { 2023-08-01T19:55:28.191 INFO:teuthology.orchestra.run.smithi101.stdout: "event": "sub_op_commit_rec", 2023-08-01T19:55:28.191 INFO:teuthology.orchestra.run.smithi101.stdout: "time": "2023-08-01T19:55:05.630531+0000", 2023-08-01T19:55:28.191 INFO:teuthology.orchestra.run.smithi101.stdout: "duration": 0.056763409000000001 2023-08-01T19:55:28.191 INFO:teuthology.orchestra.run.smithi101.stdout: }, 2023-08-01T19:55:28.191 INFO:teuthology.orchestra.run.smithi101.stdout: { 2023-08-01T19:55:28.191 INFO:teuthology.orchestra.run.smithi101.stdout: "event": "commit_sent", 2023-08-01T19:55:28.191 INFO:teuthology.orchestra.run.smithi101.stdout: "time": "2023-08-01T19:55:05.630577+0000", 2023-08-01T19:55:28.192 INFO:teuthology.orchestra.run.smithi101.stdout: "duration": 4.6588000000000002e-05 2023-08-01T19:55:28.192 INFO:teuthology.orchestra.run.smithi101.stdout: }, 2023-08-01T19:55:28.192 INFO:teuthology.orchestra.run.smithi101.stdout: { 2023-08-01T19:55:28.192 INFO:teuthology.orchestra.run.smithi101.stdout: "event": "done", 2023-08-01T19:55:28.192 INFO:teuthology.orchestra.run.smithi101.stdout: "time": "2023-08-01T19:55:05.630613+0000", 2023-08-01T19:55:28.192 INFO:teuthology.orchestra.run.smithi101.stdout: "duration": 3.5802e-05 2023-08-01T19:55:28.192 INFO:teuthology.orchestra.run.smithi101.stdout: } 2023-08-01T19:55:28.192 INFO:teuthology.orchestra.run.smithi101.stdout: ] 2023-08-01T19:55:28.193 INFO:teuthology.orchestra.run.smithi101.stdout: } 2023-08-01T19:55:28.193 INFO:teuthology.orchestra.run.smithi101.stdout: }, 2023-08-01T19:55:28.193 INFO:teuthology.orchestra.run.smithi101.stdout: { 2023-08-01T19:55:28.193 INFO:teuthology.orchestra.run.smithi101.stdout: "description": "osd_op(client.4668.0:100943 5.7 5:e01743fe:::benchmark_data_smithi006_114134_object100942:head [set-alloc-hint object_size 65536 write_size 65536,write 0~65536] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e37)", 2023-08-01T19:55:28.193 INFO:teuthology.orchestra.run.smithi101.stdout: "initiated_at": "2023-08-01T19:55:05.574724+0000", 2023-08-01T19:55:28.193 INFO:teuthology.orchestra.run.smithi101.stdout: "age": 22.473074070999999, 2023-08-01T19:55:28.193 INFO:teuthology.orchestra.run.smithi101.stdout: "duration": 0.058761188999999998, 2023-08-01T19:55:28.194 INFO:teuthology.orchestra.run.smithi101.stdout: "type_data": { 2023-08-01T19:55:28.194 INFO:teuthology.orchestra.run.smithi101.stdout: "flag_point": "commit sent; apply or cleanup", 2023-08-01T19:55:28.194 INFO:teuthology.orchestra.run.smithi101.stdout: "client_info": { 2023-08-01T19:55:28.194 INFO:teuthology.orchestra.run.smithi101.stdout: "client": "client.4668", 2023-08-01T19:55:28.194 INFO:teuthology.orchestra.run.smithi101.stdout: "client_addr": "172.21.15.6:0/1709472247", 2023-08-01T19:55:28.194 INFO:teuthology.orchestra.run.smithi101.stdout: "tid": 100943 2023-08-01T19:55:28.194 INFO:teuthology.orchestra.run.smithi101.stdout: }, 2023-08-01T19:55:28.195 INFO:teuthology.orchestra.run.smithi101.stdout: "events": [ 2023-08-01T19:55:28.195 INFO:teuthology.orchestra.run.smithi101.stdout: { 2023-08-01T19:55:28.195 INFO:teuthology.orchestra.run.smithi101.stdout: "event": "initiated", 2023-08-01T19:55:28.195 INFO:teuthology.orchestra.run.smithi101.stdout: "time": "2023-08-01T19:55:05.574724+0000", 2023-08-01T19:55:28.195 INFO:teuthology.orchestra.run.smithi101.stdout: "duration": 0 2023-08-01T19:55:28.195 INFO:teuthology.orchestra.run.smithi101.stdout: }, 2023-08-01T19:55:28.195 INFO:teuthology.orchestra.run.smithi101.stdout: { 2023-08-01T19:55:28.195 INFO:teuthology.orchestra.run.smithi101.stdout: "event": "throttled", 2023-08-01T19:55:28.196 INFO:teuthology.orchestra.run.smithi101.stdout: "time": "2023-08-01T19:55:05.574724+0000", 2023-08-01T19:55:28.196 INFO:teuthology.orchestra.run.smithi101.stdout: "duration": 0 2023-08-01T19:55:28.196 INFO:teuthology.orchestra.run.smithi101.stdout: }, 2023-08-01T19:55:28.196 INFO:teuthology.orchestra.run.smithi101.stdout: { 2023-08-01T19:55:28.197 INFO:teuthology.orchestra.run.smithi101.stdout: "event": "header_read", 2023-08-01T19:55:28.197 INFO:teuthology.orchestra.run.smithi101.stdout: "time": "2023-08-01T19:55:05.574723+0000", 2023-08-01T19:55:28.197 INFO:teuthology.orchestra.run.smithi101.stdout: "duration": 4294967295.999999 2023-08-01T19:55:28.197 INFO:teuthology.orchestra.run.smithi101.stdout: }, 2023-08-01T19:55:28.198 INFO:teuthology.orchestra.run.smithi101.stdout: { 2023-08-01T19:55:28.198 INFO:teuthology.orchestra.run.smithi101.stdout: "event": "all_read", 2023-08-01T19:55:28.198 INFO:teuthology.orchestra.run.smithi101.stdout: "time": "2023-08-01T19:55:05.574773+0000", 2023-08-01T19:55:28.198 INFO:teuthology.orchestra.run.smithi101.stdout: "duration": 4.9469999999999999e-05 2023-08-01T19:55:28.198 INFO:teuthology.orchestra.run.smithi101.stdout: }, 2023-08-01T19:55:28.198 INFO:teuthology.orchestra.run.smithi101.stdout: { 2023-08-01T19:55:28.198 INFO:teuthology.orchestra.run.smithi101.stdout: "event": "dispatched", 2023-08-01T19:55:28.199 INFO:teuthology.orchestra.run.smithi101.stdout: "time": "2023-08-01T19:55:05.574780+0000", 2023-08-01T19:55:28.199 INFO:teuthology.orchestra.run.smithi101.stdout: "duration": 7.5059999999999998e-06 2023-08-01T19:55:28.199 INFO:teuthology.orchestra.run.smithi101.stdout: }, 2023-08-01T19:55:28.199 INFO:teuthology.orchestra.run.smithi101.stdout: { 2023-08-01T19:55:28.199 INFO:teuthology.orchestra.run.smithi101.stdout: "event": "queued_for_pg", 2023-08-01T19:55:28.199 INFO:teuthology.orchestra.run.smithi101.stdout: "time": "2023-08-01T19:55:05.574784+0000", 2023-08-01T19:55:28.199 INFO:teuthology.orchestra.run.smithi101.stdout: "duration": 3.5540000000000002e-06 2023-08-01T19:55:28.199 INFO:teuthology.orchestra.run.smithi101.stdout: }, 2023-08-01T19:55:28.200 INFO:teuthology.orchestra.run.smithi101.stdout: { 2023-08-01T19:55:28.200 INFO:teuthology.orchestra.run.smithi101.stdout: "event": "reached_pg", 2023-08-01T19:55:28.200 INFO:teuthology.orchestra.run.smithi101.stdout: "time": "2023-08-01T19:55:05.574805+0000", 2023-08-01T19:55:28.200 INFO:teuthology.orchestra.run.smithi101.stdout: "duration": 2.1257999999999999e-05 2023-08-01T19:55:28.200 INFO:teuthology.orchestra.run.smithi101.stdout: }, 2023-08-01T19:55:28.200 INFO:teuthology.orchestra.run.smithi101.stdout: { 2023-08-01T19:55:28.200 INFO:teuthology.orchestra.run.smithi101.stdout: "event": "started", 2023-08-01T19:55:28.201 INFO:teuthology.orchestra.run.smithi101.stdout: "time": "2023-08-01T19:55:05.574886+0000", 2023-08-01T19:55:28.201 INFO:teuthology.orchestra.run.smithi101.stdout: "duration": 8.1545999999999995e-05 2023-08-01T19:55:28.201 INFO:teuthology.orchestra.run.smithi101.stdout: }, 2023-08-01T19:55:28.201 INFO:teuthology.orchestra.run.smithi101.stdout: { 2023-08-01T19:55:28.201 INFO:teuthology.orchestra.run.smithi101.stdout: "event": "waiting for subops from 0", 2023-08-01T19:55:28.201 INFO:teuthology.orchestra.run.smithi101.stdout: "time": "2023-08-01T19:55:05.574973+0000", 2023-08-01T19:55:28.201 INFO:teuthology.orchestra.run.smithi101.stdout: "duration": 8.6998999999999998e-05 2023-08-01T19:55:28.201 INFO:teuthology.orchestra.run.smithi101.stdout: }, 2023-08-01T19:55:28.202 INFO:teuthology.orchestra.run.smithi101.stdout: { 2023-08-01T19:55:28.202 INFO:teuthology.orchestra.run.smithi101.stdout: "event": "op_commit", 2023-08-01T19:55:28.202 INFO:teuthology.orchestra.run.smithi101.stdout: "time": "2023-08-01T19:55:05.581580+0000", 2023-08-01T19:55:28.202 INFO:teuthology.orchestra.run.smithi101.stdout: "duration": 0.0066068790000000004 2023-08-01T19:55:28.202 INFO:teuthology.orchestra.run.smithi101.stdout: }, 2023-08-01T19:55:28.202 INFO:teuthology.orchestra.run.smithi101.stdout: { 2023-08-01T19:55:28.202 INFO:teuthology.orchestra.run.smithi101.stdout: "event": "sub_op_commit_rec", 2023-08-01T19:55:28.203 INFO:teuthology.orchestra.run.smithi101.stdout: "time": "2023-08-01T19:55:05.633422+0000", 2023-08-01T19:55:28.203 INFO:teuthology.orchestra.run.smithi101.stdout: "duration": 0.051841992000000003 2023-08-01T19:55:28.203 INFO:teuthology.orchestra.run.smithi101.stdout: }, 2023-08-01T19:55:28.203 INFO:teuthology.orchestra.run.smithi101.stdout: { 2023-08-01T19:55:28.203 INFO:teuthology.orchestra.run.smithi101.stdout: "event": "commit_sent", 2023-08-01T19:55:28.203 INFO:teuthology.orchestra.run.smithi101.stdout: "time": "2023-08-01T19:55:05.633461+0000", 2023-08-01T19:55:28.203 INFO:teuthology.orchestra.run.smithi101.stdout: "duration": 3.8330000000000001e-05 2023-08-01T19:55:28.203 INFO:teuthology.orchestra.run.smithi101.stdout: }, 2023-08-01T19:55:28.204 INFO:teuthology.orchestra.run.smithi101.stdout: { 2023-08-01T19:55:28.204 INFO:teuthology.orchestra.run.smithi101.stdout: "event": "done", 2023-08-01T19:55:28.204 INFO:teuthology.orchestra.run.smithi101.stdout: "time": "2023-08-01T19:55:05.633485+0000", 2023-08-01T19:55:28.204 INFO:teuthology.orchestra.run.smithi101.stdout: "duration": 2.4451e-05 2023-08-01T19:55:28.204 INFO:teuthology.orchestra.run.smithi101.stdout: } 2023-08-01T19:55:28.204 INFO:teuthology.orchestra.run.smithi101.stdout: ] 2023-08-01T19:55:28.204 INFO:teuthology.orchestra.run.smithi101.stdout: } 2023-08-01T19:55:28.205 INFO:teuthology.orchestra.run.smithi101.stdout: }, 2023-08-01T19:55:28.205 INFO:teuthology.orchestra.run.smithi101.stdout: { 2023-08-01T19:55:28.205 INFO:teuthology.orchestra.run.smithi101.stdout: "description": "osd_op(client.4668.0:107866 5.f 5:ffcbf9c4:::benchmark_data_smithi006_114134_object107865:head [set-alloc-hint object_size 65536 write_size 65536,write 0~65536] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e38)", 2023-08-01T19:55:28.205 INFO:teuthology.orchestra.run.smithi101.stdout: "initiated_at": "2023-08-01T19:55:09.280625+0000", 2023-08-01T19:55:28.205 INFO:teuthology.orchestra.run.smithi101.stdout: "age": 18.767172732999999, 2023-08-01T19:55:28.205 INFO:teuthology.orchestra.run.smithi101.stdout: "duration": 0.069869799999999996, 2023-08-01T19:55:28.205 INFO:teuthology.orchestra.run.smithi101.stdout: "type_data": { 2023-08-01T19:55:28.205 INFO:teuthology.orchestra.run.smithi101.stdout: "flag_point": "commit sent; apply or cleanup", 2023-08-01T19:55:28.206 INFO:teuthology.orchestra.run.smithi101.stdout: "client_info": { 2023-08-01T19:55:28.206 INFO:teuthology.orchestra.run.smithi101.stdout: "client": "client.4668", 2023-08-01T19:55:28.206 INFO:teuthology.orchestra.run.smithi101.stdout: "client_addr": "172.21.15.6:0/1709472247", 2023-08-01T19:55:28.206 INFO:teuthology.orchestra.run.smithi101.stdout: "tid": 107866 2023-08-01T19:55:28.206 INFO:teuthology.orchestra.run.smithi101.stdout: }, 2023-08-01T19:55:28.206 INFO:teuthology.orchestra.run.smithi101.stdout: "events": [ 2023-08-01T19:55:28.206 INFO:teuthology.orchestra.run.smithi101.stdout: { 2023-08-01T19:55:28.206 INFO:teuthology.orchestra.run.smithi101.stdout: "event": "initiated", 2023-08-01T19:55:28.207 INFO:teuthology.orchestra.run.smithi101.stdout: "time": "2023-08-01T19:55:09.280625+0000", 2023-08-01T19:55:28.207 INFO:teuthology.orchestra.run.smithi101.stdout: "duration": 0 2023-08-01T19:55:28.207 INFO:teuthology.orchestra.run.smithi101.stdout: }, 2023-08-01T19:55:28.207 INFO:teuthology.orchestra.run.smithi101.stdout: { 2023-08-01T19:55:28.207 INFO:teuthology.orchestra.run.smithi101.stdout: "event": "throttled", 2023-08-01T19:55:28.207 INFO:teuthology.orchestra.run.smithi101.stdout: "time": "2023-08-01T19:55:09.280625+0000", 2023-08-01T19:55:28.207 INFO:teuthology.orchestra.run.smithi101.stdout: "duration": 0 2023-08-01T19:55:28.208 INFO:teuthology.orchestra.run.smithi101.stdout: }, 2023-08-01T19:55:28.208 INFO:teuthology.orchestra.run.smithi101.stdout: { 2023-08-01T19:55:28.208 INFO:teuthology.orchestra.run.smithi101.stdout: "event": "header_read", 2023-08-01T19:55:28.208 INFO:teuthology.orchestra.run.smithi101.stdout: "time": "2023-08-01T19:55:09.280624+0000", 2023-08-01T19:55:28.208 INFO:teuthology.orchestra.run.smithi101.stdout: "duration": 4294967295.999999 2023-08-01T19:55:28.208 INFO:teuthology.orchestra.run.smithi101.stdout: }, 2023-08-01T19:55:28.208 INFO:teuthology.orchestra.run.smithi101.stdout: { 2023-08-01T19:55:28.208 INFO:teuthology.orchestra.run.smithi101.stdout: "event": "all_read", 2023-08-01T19:55:28.209 INFO:teuthology.orchestra.run.smithi101.stdout: "time": "2023-08-01T19:55:09.280648+0000", 2023-08-01T19:55:28.209 INFO:teuthology.orchestra.run.smithi101.stdout: "duration": 2.3521999999999999e-05 2023-08-01T19:55:28.209 INFO:teuthology.orchestra.run.smithi101.stdout: }, 2023-08-01T19:55:28.209 INFO:teuthology.orchestra.run.smithi101.stdout: { 2023-08-01T19:55:28.209 INFO:teuthology.orchestra.run.smithi101.stdout: "event": "dispatched", 2023-08-01T19:55:28.209 INFO:teuthology.orchestra.run.smithi101.stdout: "time": "2023-08-01T19:55:09.280658+0000", 2023-08-01T19:55:28.209 INFO:teuthology.orchestra.run.smithi101.stdout: "duration": 9.8660000000000001e-06 2023-08-01T19:55:28.209 INFO:teuthology.orchestra.run.smithi101.stdout: }, 2023-08-01T19:55:28.210 INFO:teuthology.orchestra.run.smithi101.stdout: { 2023-08-01T19:55:28.210 INFO:teuthology.orchestra.run.smithi101.stdout: "event": "queued_for_pg", 2023-08-01T19:55:28.210 INFO:teuthology.orchestra.run.smithi101.stdout: "time": "2023-08-01T19:55:09.280663+0000", 2023-08-01T19:55:28.210 INFO:teuthology.orchestra.run.smithi101.stdout: "duration": 4.8369999999999996e-06 2023-08-01T19:55:28.210 INFO:teuthology.orchestra.run.smithi101.stdout: }, 2023-08-01T19:55:28.210 INFO:teuthology.orchestra.run.smithi101.stdout: { 2023-08-01T19:55:28.210 INFO:teuthology.orchestra.run.smithi101.stdout: "event": "reached_pg", 2023-08-01T19:55:28.210 INFO:teuthology.orchestra.run.smithi101.stdout: "time": "2023-08-01T19:55:09.280690+0000", 2023-08-01T19:55:28.211 INFO:teuthology.orchestra.run.smithi101.stdout: "duration": 2.7534000000000001e-05 2023-08-01T19:55:28.211 INFO:teuthology.orchestra.run.smithi101.stdout: }, 2023-08-01T19:55:28.211 INFO:teuthology.orchestra.run.smithi101.stdout: { 2023-08-01T19:55:28.211 INFO:teuthology.orchestra.run.smithi101.stdout: "event": "started", 2023-08-01T19:55:28.211 INFO:teuthology.orchestra.run.smithi101.stdout: "time": "2023-08-01T19:55:09.280825+0000", 2023-08-01T19:55:28.211 INFO:teuthology.orchestra.run.smithi101.stdout: "duration": 0.000135399 2023-08-01T19:55:28.211 INFO:teuthology.orchestra.run.smithi101.stdout: }, 2023-08-01T19:55:28.211 INFO:teuthology.orchestra.run.smithi101.stdout: { 2023-08-01T19:55:28.212 INFO:teuthology.orchestra.run.smithi101.stdout: "event": "waiting for subops from 2", 2023-08-01T19:55:28.212 INFO:teuthology.orchestra.run.smithi101.stdout: "time": "2023-08-01T19:55:09.280929+0000", 2023-08-01T19:55:28.212 INFO:teuthology.orchestra.run.smithi101.stdout: "duration": 0.000103328 2023-08-01T19:55:28.212 INFO:teuthology.orchestra.run.smithi101.stdout: }, 2023-08-01T19:55:28.212 INFO:teuthology.orchestra.run.smithi101.stdout: { 2023-08-01T19:55:28.212 INFO:teuthology.orchestra.run.smithi101.stdout: "event": "sub_op_commit_rec", 2023-08-01T19:55:28.212 INFO:teuthology.orchestra.run.smithi101.stdout: "time": "2023-08-01T19:55:09.348321+0000", 2023-08-01T19:55:28.213 INFO:teuthology.orchestra.run.smithi101.stdout: "duration": 0.067392176999999998 2023-08-01T19:55:28.213 INFO:teuthology.orchestra.run.smithi101.stdout: }, 2023-08-01T19:55:28.213 INFO:teuthology.orchestra.run.smithi101.stdout: { 2023-08-01T19:55:28.213 INFO:teuthology.orchestra.run.smithi101.stdout: "event": "op_commit", 2023-08-01T19:55:28.213 INFO:teuthology.orchestra.run.smithi101.stdout: "time": "2023-08-01T19:55:09.350431+0000", 2023-08-01T19:55:28.213 INFO:teuthology.orchestra.run.smithi101.stdout: "duration": 0.0021096980000000001 2023-08-01T19:55:28.214 INFO:teuthology.orchestra.run.smithi101.stdout: }, 2023-08-01T19:55:28.214 INFO:teuthology.orchestra.run.smithi101.stdout: { 2023-08-01T19:55:28.214 INFO:teuthology.orchestra.run.smithi101.stdout: "event": "commit_sent", 2023-08-01T19:55:28.214 INFO:teuthology.orchestra.run.smithi101.stdout: "time": "2023-08-01T19:55:09.350469+0000", 2023-08-01T19:55:28.215 INFO:teuthology.orchestra.run.smithi101.stdout: "duration": 3.8625999999999999e-05 2023-08-01T19:55:28.215 INFO:teuthology.orchestra.run.smithi101.stdout: }, 2023-08-01T19:55:28.215 INFO:teuthology.orchestra.run.smithi101.stdout: { 2023-08-01T19:55:28.215 INFO:teuthology.orchestra.run.smithi101.stdout: "event": "done", 2023-08-01T19:55:28.215 INFO:teuthology.orchestra.run.smithi101.stdout: "time": "2023-08-01T19:55:09.350495+0000", 2023-08-01T19:55:28.215 INFO:teuthology.orchestra.run.smithi101.stdout: "duration": 2.5698999999999999e-05 2023-08-01T19:55:28.216 INFO:teuthology.orchestra.run.smithi101.stdout: } 2023-08-01T19:55:28.216 INFO:teuthology.orchestra.run.smithi101.stdout: ] 2023-08-01T19:55:28.216 INFO:teuthology.orchestra.run.smithi101.stdout: } 2023-08-01T19:55:28.216 INFO:teuthology.orchestra.run.smithi101.stdout: }, 2023-08-01T19:55:28.216 INFO:teuthology.orchestra.run.smithi101.stdout: { 2023-08-01T19:55:28.216 INFO:teuthology.orchestra.run.smithi101.stdout: "description": "osd_op(client.4668.0:107867 5.f 5:ff29bbf7:::benchmark_data_smithi006_114134_object107866:head [set-alloc-hint object_size 65536 write_size 65536,write 0~65536] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e38)", 2023-08-01T19:55:28.216 INFO:teuthology.orchestra.run.smithi101.stdout: "initiated_at": "2023-08-01T19:55:09.280670+0000", 2023-08-01T19:55:28.217 INFO:teuthology.orchestra.run.smithi101.stdout: "age": 18.767127799000001, 2023-08-01T19:55:28.217 INFO:teuthology.orchestra.run.smithi101.stdout: "duration": 0.069898092999999994, 2023-08-01T19:55:28.217 INFO:teuthology.orchestra.run.smithi101.stdout: "type_data": { 2023-08-01T19:55:28.217 INFO:teuthology.orchestra.run.smithi101.stdout: "flag_point": "commit sent; apply or cleanup", 2023-08-01T19:55:28.217 INFO:teuthology.orchestra.run.smithi101.stdout: "client_info": { 2023-08-01T19:55:28.217 INFO:teuthology.orchestra.run.smithi101.stdout: "client": "client.4668", 2023-08-01T19:55:28.217 INFO:teuthology.orchestra.run.smithi101.stdout: "client_addr": "172.21.15.6:0/1709472247", 2023-08-01T19:55:28.217 INFO:teuthology.orchestra.run.smithi101.stdout: "tid": 107867 2023-08-01T19:55:28.218 INFO:teuthology.orchestra.run.smithi101.stdout: }, 2023-08-01T19:55:28.218 INFO:teuthology.orchestra.run.smithi101.stdout: "events": [ 2023-08-01T19:55:28.218 INFO:teuthology.orchestra.run.smithi101.stdout: { 2023-08-01T19:55:28.218 INFO:teuthology.orchestra.run.smithi101.stdout: "event": "initiated", 2023-08-01T19:55:28.218 INFO:teuthology.orchestra.run.smithi101.stdout: "time": "2023-08-01T19:55:09.280670+0000", 2023-08-01T19:55:28.218 INFO:teuthology.orchestra.run.smithi101.stdout: "duration": 0 2023-08-01T19:55:28.218 INFO:teuthology.orchestra.run.smithi101.stdout: }, 2023-08-01T19:55:28.218 INFO:teuthology.orchestra.run.smithi101.stdout: { 2023-08-01T19:55:28.219 INFO:teuthology.orchestra.run.smithi101.stdout: "event": "throttled", 2023-08-01T19:55:28.219 INFO:teuthology.orchestra.run.smithi101.stdout: "time": "2023-08-01T19:55:09.280670+0000", 2023-08-01T19:55:28.219 INFO:teuthology.orchestra.run.smithi101.stdout: "duration": 0 2023-08-01T19:55:28.219 INFO:teuthology.orchestra.run.smithi101.stdout: }, 2023-08-01T19:55:28.219 INFO:teuthology.orchestra.run.smithi101.stdout: { 2023-08-01T19:55:28.219 INFO:teuthology.orchestra.run.smithi101.stdout: "event": "header_read", 2023-08-01T19:55:28.219 INFO:teuthology.orchestra.run.smithi101.stdout: "time": "2023-08-01T19:55:09.280670+0000", 2023-08-01T19:55:28.219 INFO:teuthology.orchestra.run.smithi101.stdout: "duration": 4294967295.9999995 2023-08-01T19:55:28.220 INFO:teuthology.orchestra.run.smithi101.stdout: }, 2023-08-01T19:55:28.220 INFO:teuthology.orchestra.run.smithi101.stdout: { 2023-08-01T19:55:28.220 INFO:teuthology.orchestra.run.smithi101.stdout: "event": "all_read", 2023-08-01T19:55:28.220 INFO:teuthology.orchestra.run.smithi101.stdout: "time": "2023-08-01T19:55:09.280690+0000", 2023-08-01T19:55:28.220 INFO:teuthology.orchestra.run.smithi101.stdout: "duration": 2.0526e-05 2023-08-01T19:55:28.220 INFO:teuthology.orchestra.run.smithi101.stdout: }, 2023-08-01T19:55:28.220 INFO:teuthology.orchestra.run.smithi101.stdout: { 2023-08-01T19:55:28.221 INFO:teuthology.orchestra.run.smithi101.stdout: "event": "dispatched", 2023-08-01T19:55:28.221 INFO:teuthology.orchestra.run.smithi101.stdout: "time": "2023-08-01T19:55:09.280695+0000", 2023-08-01T19:55:28.221 INFO:teuthology.orchestra.run.smithi101.stdout: "duration": 4.5140000000000003e-06 2023-08-01T19:55:28.221 INFO:teuthology.orchestra.run.smithi101.stdout: }, 2023-08-01T19:55:28.221 INFO:teuthology.orchestra.run.smithi101.stdout: { 2023-08-01T19:55:28.221 INFO:teuthology.orchestra.run.smithi101.stdout: "event": "queued_for_pg", 2023-08-01T19:55:28.221 INFO:teuthology.orchestra.run.smithi101.stdout: "time": "2023-08-01T19:55:09.280697+0000", 2023-08-01T19:55:28.221 INFO:teuthology.orchestra.run.smithi101.stdout: "duration": 2.6290000000000002e-06 2023-08-01T19:55:28.222 INFO:teuthology.orchestra.run.smithi101.stdout: }, 2023-08-01T19:55:28.222 INFO:teuthology.orchestra.run.smithi101.stdout: { 2023-08-01T19:55:28.222 INFO:teuthology.orchestra.run.smithi101.stdout: "event": "reached_pg", 2023-08-01T19:55:28.222 INFO:teuthology.orchestra.run.smithi101.stdout: "time": "2023-08-01T19:55:09.282392+0000", 2023-08-01T19:55:28.223 INFO:teuthology.orchestra.run.smithi101.stdout: "duration": 0.0016948709999999999 2023-08-01T19:55:28.223 INFO:teuthology.orchestra.run.smithi101.stdout: }, 2023-08-01T19:55:28.223 INFO:teuthology.orchestra.run.smithi101.stdout: { 2023-08-01T19:55:28.223 INFO:teuthology.orchestra.run.smithi101.stdout: "event": "started", 2023-08-01T19:55:28.224 INFO:teuthology.orchestra.run.smithi101.stdout: "time": "2023-08-01T19:55:09.282514+0000", 2023-08-01T19:55:28.224 INFO:teuthology.orchestra.run.smithi101.stdout: "duration": 0.000121839 2023-08-01T19:55:28.224 INFO:teuthology.orchestra.run.smithi101.stdout: }, 2023-08-01T19:55:28.224 INFO:teuthology.orchestra.run.smithi101.stdout: { 2023-08-01T19:55:28.224 INFO:teuthology.orchestra.run.smithi101.stdout: "event": "waiting for subops from 2", 2023-08-01T19:55:28.225 INFO:teuthology.orchestra.run.smithi101.stdout: "time": "2023-08-01T19:55:09.282664+0000", 2023-08-01T19:55:28.225 INFO:teuthology.orchestra.run.smithi101.stdout: "duration": 0.00014968699999999999 2023-08-01T19:55:28.225 INFO:teuthology.orchestra.run.smithi101.stdout: }, 2023-08-01T19:55:28.225 INFO:teuthology.orchestra.run.smithi101.stdout: { 2023-08-01T19:55:28.226 INFO:teuthology.orchestra.run.smithi101.stdout: "event": "sub_op_commit_rec", 2023-08-01T19:55:28.226 INFO:teuthology.orchestra.run.smithi101.stdout: "time": "2023-08-01T19:55:09.348344+0000", 2023-08-01T19:55:28.226 INFO:teuthology.orchestra.run.smithi101.stdout: "duration": 0.065680247999999997 2023-08-01T19:55:28.226 INFO:teuthology.orchestra.run.smithi101.stdout: }, 2023-08-01T19:55:28.226 INFO:teuthology.orchestra.run.smithi101.stdout: { 2023-08-01T19:55:28.226 INFO:teuthology.orchestra.run.smithi101.stdout: "event": "op_commit", 2023-08-01T19:55:28.226 INFO:teuthology.orchestra.run.smithi101.stdout: "time": "2023-08-01T19:55:09.350502+0000", 2023-08-01T19:55:28.227 INFO:teuthology.orchestra.run.smithi101.stdout: "duration": 0.0021578140000000001 2023-08-01T19:55:28.227 INFO:teuthology.orchestra.run.smithi101.stdout: }, 2023-08-01T19:55:28.227 INFO:teuthology.orchestra.run.smithi101.stdout: { 2023-08-01T19:55:28.227 INFO:teuthology.orchestra.run.smithi101.stdout: "event": "commit_sent", 2023-08-01T19:55:28.227 INFO:teuthology.orchestra.run.smithi101.stdout: "time": "2023-08-01T19:55:09.350529+0000", 2023-08-01T19:55:28.227 INFO:teuthology.orchestra.run.smithi101.stdout: "duration": 2.6838e-05 2023-08-01T19:55:28.227 INFO:teuthology.orchestra.run.smithi101.stdout: }, 2023-08-01T19:55:28.227 INFO:teuthology.orchestra.run.smithi101.stdout: { 2023-08-01T19:55:28.228 INFO:teuthology.orchestra.run.smithi101.stdout: "event": "done", 2023-08-01T19:55:28.228 INFO:teuthology.orchestra.run.smithi101.stdout: "time": "2023-08-01T19:55:09.350568+0000", 2023-08-01T19:55:28.228 INFO:teuthology.orchestra.run.smithi101.stdout: "duration": 3.9477000000000002e-05 2023-08-01T19:55:28.228 INFO:teuthology.orchestra.run.smithi101.stdout: } 2023-08-01T19:55:28.228 INFO:teuthology.orchestra.run.smithi101.stdout: ] 2023-08-01T19:55:28.228 INFO:teuthology.orchestra.run.smithi101.stdout: } 2023-08-01T19:55:28.228 INFO:teuthology.orchestra.run.smithi101.stdout: }, 2023-08-01T19:55:28.228 INFO:teuthology.orchestra.run.smithi101.stdout: { 2023-08-01T19:55:28.229 INFO:teuthology.orchestra.run.smithi101.stdout: "description": "osd_repop(client.4668.0:107863 5.3 e38/19 5:cbdd875a:::benchmark_data_smithi006_114134_object107862:head v 38'6829, mlcod=38'6826)", 2023-08-01T19:55:28.229 INFO:teuthology.orchestra.run.smithi101.stdout: "initiated_at": "2023-08-01T19:55:09.280747+0000", 2023-08-01T19:55:28.229 INFO:teuthology.orchestra.run.smithi101.stdout: "age": 18.76705085, 2023-08-01T19:55:28.229 INFO:teuthology.orchestra.run.smithi101.stdout: "duration": 0.069343305999999993, 2023-08-01T19:55:28.229 INFO:teuthology.orchestra.run.smithi101.stdout: "type_data": { 2023-08-01T19:55:28.229 INFO:teuthology.orchestra.run.smithi101.stdout: "flag_point": "commit sent; apply or cleanup", 2023-08-01T19:55:28.229 INFO:teuthology.orchestra.run.smithi101.stdout: "events": [ 2023-08-01T19:55:28.229 INFO:teuthology.orchestra.run.smithi101.stdout: { 2023-08-01T19:55:28.230 INFO:teuthology.orchestra.run.smithi101.stdout: "event": "initiated", 2023-08-01T19:55:28.230 INFO:teuthology.orchestra.run.smithi101.stdout: "time": "2023-08-01T19:55:09.280747+0000", 2023-08-01T19:55:28.230 INFO:teuthology.orchestra.run.smithi101.stdout: "duration": 0 2023-08-01T19:55:28.230 INFO:teuthology.orchestra.run.smithi101.stdout: }, 2023-08-01T19:55:28.230 INFO:teuthology.orchestra.run.smithi101.stdout: { 2023-08-01T19:55:28.230 INFO:teuthology.orchestra.run.smithi101.stdout: "event": "throttled", 2023-08-01T19:55:28.230 INFO:teuthology.orchestra.run.smithi101.stdout: "time": "2023-08-01T19:55:09.280747+0000", 2023-08-01T19:55:28.231 INFO:teuthology.orchestra.run.smithi101.stdout: "duration": 0 2023-08-01T19:55:28.231 INFO:teuthology.orchestra.run.smithi101.stdout: }, 2023-08-01T19:55:28.231 INFO:teuthology.orchestra.run.smithi101.stdout: { 2023-08-01T19:55:28.231 INFO:teuthology.orchestra.run.smithi101.stdout: "event": "header_read", 2023-08-01T19:55:28.231 INFO:teuthology.orchestra.run.smithi101.stdout: "time": "2023-08-01T19:55:09.280746+0000", 2023-08-01T19:55:28.231 INFO:teuthology.orchestra.run.smithi101.stdout: "duration": 4294967295.9999995 2023-08-01T19:55:28.231 INFO:teuthology.orchestra.run.smithi101.stdout: }, 2023-08-01T19:55:28.231 INFO:teuthology.orchestra.run.smithi101.stdout: { 2023-08-01T19:55:28.232 INFO:teuthology.orchestra.run.smithi101.stdout: "event": "all_read", 2023-08-01T19:55:28.232 INFO:teuthology.orchestra.run.smithi101.stdout: "time": "2023-08-01T19:55:09.280798+0000", 2023-08-01T19:55:28.232 INFO:teuthology.orchestra.run.smithi101.stdout: "duration": 5.1706000000000003e-05 2023-08-01T19:55:28.232 INFO:teuthology.orchestra.run.smithi101.stdout: }, 2023-08-01T19:55:28.232 INFO:teuthology.orchestra.run.smithi101.stdout: { 2023-08-01T19:55:28.232 INFO:teuthology.orchestra.run.smithi101.stdout: "event": "dispatched", 2023-08-01T19:55:28.232 INFO:teuthology.orchestra.run.smithi101.stdout: "time": "2023-08-01T19:55:09.280807+0000", 2023-08-01T19:55:28.232 INFO:teuthology.orchestra.run.smithi101.stdout: "duration": 8.4889999999999995e-06 2023-08-01T19:55:28.233 INFO:teuthology.orchestra.run.smithi101.stdout: }, 2023-08-01T19:55:28.233 INFO:teuthology.orchestra.run.smithi101.stdout: { 2023-08-01T19:55:28.233 INFO:teuthology.orchestra.run.smithi101.stdout: "event": "queued_for_pg", 2023-08-01T19:55:28.233 INFO:teuthology.orchestra.run.smithi101.stdout: "time": "2023-08-01T19:55:09.280812+0000", 2023-08-01T19:55:28.233 INFO:teuthology.orchestra.run.smithi101.stdout: "duration": 5.2120000000000002e-06 2023-08-01T19:55:28.233 INFO:teuthology.orchestra.run.smithi101.stdout: }, 2023-08-01T19:55:28.233 INFO:teuthology.orchestra.run.smithi101.stdout: { 2023-08-01T19:55:28.233 INFO:teuthology.orchestra.run.smithi101.stdout: "event": "reached_pg", 2023-08-01T19:55:28.234 INFO:teuthology.orchestra.run.smithi101.stdout: "time": "2023-08-01T19:55:09.280843+0000", 2023-08-01T19:55:28.234 INFO:teuthology.orchestra.run.smithi101.stdout: "duration": 3.1406999999999999e-05 2023-08-01T19:55:28.234 INFO:teuthology.orchestra.run.smithi101.stdout: }, 2023-08-01T19:55:28.234 INFO:teuthology.orchestra.run.smithi101.stdout: { 2023-08-01T19:55:28.234 INFO:teuthology.orchestra.run.smithi101.stdout: "event": "started", 2023-08-01T19:55:28.234 INFO:teuthology.orchestra.run.smithi101.stdout: "time": "2023-08-01T19:55:09.280860+0000", 2023-08-01T19:55:28.234 INFO:teuthology.orchestra.run.smithi101.stdout: "duration": 1.6283999999999999e-05 2023-08-01T19:55:28.235 INFO:teuthology.orchestra.run.smithi101.stdout: }, 2023-08-01T19:55:28.235 INFO:teuthology.orchestra.run.smithi101.stdout: { 2023-08-01T19:55:28.235 INFO:teuthology.orchestra.run.smithi101.stdout: "event": "commit_sent", 2023-08-01T19:55:28.235 INFO:teuthology.orchestra.run.smithi101.stdout: "time": "2023-08-01T19:55:09.350059+0000", 2023-08-01T19:55:28.235 INFO:teuthology.orchestra.run.smithi101.stdout: "duration": 0.069199094000000003 2023-08-01T19:55:28.235 INFO:teuthology.orchestra.run.smithi101.stdout: }, 2023-08-01T19:55:28.235 INFO:teuthology.orchestra.run.smithi101.stdout: { 2023-08-01T19:55:28.235 INFO:teuthology.orchestra.run.smithi101.stdout: "event": "done", 2023-08-01T19:55:28.236 INFO:teuthology.orchestra.run.smithi101.stdout: "time": "2023-08-01T19:55:09.350090+0000", 2023-08-01T19:55:28.236 INFO:teuthology.orchestra.run.smithi101.stdout: "duration": 3.1736000000000002e-05 2023-08-01T19:55:28.236 INFO:teuthology.orchestra.run.smithi101.stdout: } 2023-08-01T19:55:28.236 INFO:teuthology.orchestra.run.smithi101.stdout: ] 2023-08-01T19:55:28.236 INFO:teuthology.orchestra.run.smithi101.stdout: } 2023-08-01T19:55:28.236 INFO:teuthology.orchestra.run.smithi101.stdout: }, 2023-08-01T19:55:28.236 INFO:teuthology.orchestra.run.smithi101.stdout: { 2023-08-01T19:55:28.236 INFO:teuthology.orchestra.run.smithi101.stdout: "description": "osd_repop(client.4668.0:107865 5.3 e38/19 5:c2ebb96d:::benchmark_data_smithi006_114134_object107864:head v 38'6830, mlcod=38'6826)", 2023-08-01T19:55:28.237 INFO:teuthology.orchestra.run.smithi101.stdout: "initiated_at": "2023-08-01T19:55:09.283182+0000", 2023-08-01T19:55:28.237 INFO:teuthology.orchestra.run.smithi101.stdout: "age": 18.764615542000001, 2023-08-01T19:55:28.237 INFO:teuthology.orchestra.run.smithi101.stdout: "duration": 0.068554793000000003, 2023-08-01T19:55:28.237 INFO:teuthology.orchestra.run.smithi101.stdout: "type_data": { 2023-08-01T19:55:28.237 INFO:teuthology.orchestra.run.smithi101.stdout: "flag_point": "commit sent; apply or cleanup", 2023-08-01T19:55:28.237 INFO:teuthology.orchestra.run.smithi101.stdout: "events": [ 2023-08-01T19:55:28.237 INFO:teuthology.orchestra.run.smithi101.stdout: { 2023-08-01T19:55:28.237 INFO:teuthology.orchestra.run.smithi101.stdout: "event": "initiated", 2023-08-01T19:55:28.238 INFO:teuthology.orchestra.run.smithi101.stdout: "time": "2023-08-01T19:55:09.283182+0000", 2023-08-01T19:55:28.238 INFO:teuthology.orchestra.run.smithi101.stdout: "duration": 0 2023-08-01T19:55:28.238 INFO:teuthology.orchestra.run.smithi101.stdout: }, 2023-08-01T19:55:28.238 INFO:teuthology.orchestra.run.smithi101.stdout: { 2023-08-01T19:55:28.238 INFO:teuthology.orchestra.run.smithi101.stdout: "event": "throttled", 2023-08-01T19:55:28.238 INFO:teuthology.orchestra.run.smithi101.stdout: "time": "2023-08-01T19:55:09.283182+0000", 2023-08-01T19:55:28.238 INFO:teuthology.orchestra.run.smithi101.stdout: "duration": 0 2023-08-01T19:55:28.238 INFO:teuthology.orchestra.run.smithi101.stdout: }, 2023-08-01T19:55:28.239 INFO:teuthology.orchestra.run.smithi101.stdout: { 2023-08-01T19:55:28.239 INFO:teuthology.orchestra.run.smithi101.stdout: "event": "header_read", 2023-08-01T19:55:28.239 INFO:teuthology.orchestra.run.smithi101.stdout: "time": "2023-08-01T19:55:09.283182+0000", 2023-08-01T19:55:28.239 INFO:teuthology.orchestra.run.smithi101.stdout: "duration": 4294967295.9999995 2023-08-01T19:55:28.239 INFO:teuthology.orchestra.run.smithi101.stdout: }, 2023-08-01T19:55:28.239 INFO:teuthology.orchestra.run.smithi101.stdout: { 2023-08-01T19:55:28.239 INFO:teuthology.orchestra.run.smithi101.stdout: "event": "all_read", 2023-08-01T19:55:28.239 INFO:teuthology.orchestra.run.smithi101.stdout: "time": "2023-08-01T19:55:09.283233+0000", 2023-08-01T19:55:28.240 INFO:teuthology.orchestra.run.smithi101.stdout: "duration": 5.1511999999999997e-05 2023-08-01T19:55:28.240 INFO:teuthology.orchestra.run.smithi101.stdout: }, 2023-08-01T19:55:28.240 INFO:teuthology.orchestra.run.smithi101.stdout: { 2023-08-01T19:55:28.240 INFO:teuthology.orchestra.run.smithi101.stdout: "event": "dispatched", 2023-08-01T19:55:28.240 INFO:teuthology.orchestra.run.smithi101.stdout: "time": "2023-08-01T19:55:09.283239+0000", 2023-08-01T19:55:28.240 INFO:teuthology.orchestra.run.smithi101.stdout: "duration": 5.6640000000000003e-06 2023-08-01T19:55:28.240 INFO:teuthology.orchestra.run.smithi101.stdout: }, 2023-08-01T19:55:28.240 INFO:teuthology.orchestra.run.smithi101.stdout: { 2023-08-01T19:55:28.241 INFO:teuthology.orchestra.run.smithi101.stdout: "event": "queued_for_pg", 2023-08-01T19:55:28.241 INFO:teuthology.orchestra.run.smithi101.stdout: "time": "2023-08-01T19:55:09.283242+0000", 2023-08-01T19:55:28.241 INFO:teuthology.orchestra.run.smithi101.stdout: "duration": 2.9639999999999999e-06 2023-08-01T19:55:28.241 INFO:teuthology.orchestra.run.smithi101.stdout: }, 2023-08-01T19:55:28.241 INFO:teuthology.orchestra.run.smithi101.stdout: { 2023-08-01T19:55:28.241 INFO:teuthology.orchestra.run.smithi101.stdout: "event": "reached_pg", 2023-08-01T19:55:28.241 INFO:teuthology.orchestra.run.smithi101.stdout: "time": "2023-08-01T19:55:09.283276+0000", 2023-08-01T19:55:28.241 INFO:teuthology.orchestra.run.smithi101.stdout: "duration": 3.3631999999999999e-05 2023-08-01T19:55:28.242 INFO:teuthology.orchestra.run.smithi101.stdout: }, 2023-08-01T19:55:28.242 INFO:teuthology.orchestra.run.smithi101.stdout: { 2023-08-01T19:55:28.242 INFO:teuthology.orchestra.run.smithi101.stdout: "event": "started", 2023-08-01T19:55:28.242 INFO:teuthology.orchestra.run.smithi101.stdout: "time": "2023-08-01T19:55:09.283288+0000", 2023-08-01T19:55:28.242 INFO:teuthology.orchestra.run.smithi101.stdout: "duration": 1.1816e-05 2023-08-01T19:55:28.242 INFO:teuthology.orchestra.run.smithi101.stdout: }, 2023-08-01T19:55:28.242 INFO:teuthology.orchestra.run.smithi101.stdout: { 2023-08-01T19:55:28.243 INFO:teuthology.orchestra.run.smithi101.stdout: "event": "commit_sent", 2023-08-01T19:55:28.243 INFO:teuthology.orchestra.run.smithi101.stdout: "time": "2023-08-01T19:55:09.351712+0000", 2023-08-01T19:55:28.243 INFO:teuthology.orchestra.run.smithi101.stdout: "duration": 0.068424311000000002 2023-08-01T19:55:28.243 INFO:teuthology.orchestra.run.smithi101.stdout: }, 2023-08-01T19:55:28.243 INFO:teuthology.orchestra.run.smithi101.stdout: { 2023-08-01T19:55:28.243 INFO:teuthology.orchestra.run.smithi101.stdout: "event": "done", 2023-08-01T19:55:28.243 INFO:teuthology.orchestra.run.smithi101.stdout: "time": "2023-08-01T19:55:09.351737+0000", 2023-08-01T19:55:28.243 INFO:teuthology.orchestra.run.smithi101.stdout: "duration": 2.5364999999999999e-05 2023-08-01T19:55:28.244 INFO:teuthology.orchestra.run.smithi101.stdout: } 2023-08-01T19:55:28.244 INFO:teuthology.orchestra.run.smithi101.stdout: ] 2023-08-01T19:55:28.244 INFO:teuthology.orchestra.run.smithi101.stdout: } 2023-08-01T19:55:28.244 INFO:teuthology.orchestra.run.smithi101.stdout: }, 2023-08-01T19:55:28.244 INFO:teuthology.orchestra.run.smithi101.stdout: { 2023-08-01T19:55:28.244 INFO:teuthology.orchestra.run.smithi101.stdout: "description": "osd_repop(client.4668.0:107869 5.c e38/19 5:31910384:::benchmark_data_smithi006_114134_object107868:head v 38'6761, mlcod=38'6759)", 2023-08-01T19:55:28.244 INFO:teuthology.orchestra.run.smithi101.stdout: "initiated_at": "2023-08-01T19:55:09.283762+0000", 2023-08-01T19:55:28.245 INFO:teuthology.orchestra.run.smithi101.stdout: "age": 18.764036206, 2023-08-01T19:55:28.245 INFO:teuthology.orchestra.run.smithi101.stdout: "duration": 0.067877541, 2023-08-01T19:55:28.245 INFO:teuthology.orchestra.run.smithi101.stdout: "type_data": { 2023-08-01T19:55:28.245 INFO:teuthology.orchestra.run.smithi101.stdout: "flag_point": "commit sent; apply or cleanup", 2023-08-01T19:55:28.245 INFO:teuthology.orchestra.run.smithi101.stdout: "events": [ 2023-08-01T19:55:28.245 INFO:teuthology.orchestra.run.smithi101.stdout: { 2023-08-01T19:55:28.245 INFO:teuthology.orchestra.run.smithi101.stdout: "event": "initiated", 2023-08-01T19:55:28.245 INFO:teuthology.orchestra.run.smithi101.stdout: "time": "2023-08-01T19:55:09.283762+0000", 2023-08-01T19:55:28.246 INFO:teuthology.orchestra.run.smithi101.stdout: "duration": 0 2023-08-01T19:55:28.246 INFO:teuthology.orchestra.run.smithi101.stdout: }, 2023-08-01T19:55:28.246 INFO:teuthology.orchestra.run.smithi101.stdout: { 2023-08-01T19:55:28.246 INFO:teuthology.orchestra.run.smithi101.stdout: "event": "throttled", 2023-08-01T19:55:28.246 INFO:teuthology.orchestra.run.smithi101.stdout: "time": "2023-08-01T19:55:09.283762+0000", 2023-08-01T19:55:28.246 INFO:teuthology.orchestra.run.smithi101.stdout: "duration": 0 2023-08-01T19:55:28.246 INFO:teuthology.orchestra.run.smithi101.stdout: }, 2023-08-01T19:55:28.246 INFO:teuthology.orchestra.run.smithi101.stdout: { 2023-08-01T19:55:28.247 INFO:teuthology.orchestra.run.smithi101.stdout: "event": "header_read", 2023-08-01T19:55:28.247 INFO:teuthology.orchestra.run.smithi101.stdout: "time": "2023-08-01T19:55:09.283761+0000", 2023-08-01T19:55:28.247 INFO:teuthology.orchestra.run.smithi101.stdout: "duration": 4294967295.9999995 2023-08-01T19:55:28.247 INFO:teuthology.orchestra.run.smithi101.stdout: }, 2023-08-01T19:55:28.247 INFO:teuthology.orchestra.run.smithi101.stdout: { 2023-08-01T19:55:28.247 INFO:teuthology.orchestra.run.smithi101.stdout: "event": "all_read", 2023-08-01T19:55:28.247 INFO:teuthology.orchestra.run.smithi101.stdout: "time": "2023-08-01T19:55:09.283825+0000", 2023-08-01T19:55:28.247 INFO:teuthology.orchestra.run.smithi101.stdout: "duration": 6.3200000000000005e-05 2023-08-01T19:55:28.248 INFO:teuthology.orchestra.run.smithi101.stdout: }, 2023-08-01T19:55:28.248 INFO:teuthology.orchestra.run.smithi101.stdout: { 2023-08-01T19:55:28.248 INFO:teuthology.orchestra.run.smithi101.stdout: "event": "dispatched", 2023-08-01T19:55:28.248 INFO:teuthology.orchestra.run.smithi101.stdout: "time": "2023-08-01T19:55:09.345759+0000", 2023-08-01T19:55:28.248 INFO:teuthology.orchestra.run.smithi101.stdout: "duration": 0.061934221999999997 2023-08-01T19:55:28.248 INFO:teuthology.orchestra.run.smithi101.stdout: }, 2023-08-01T19:55:28.248 INFO:teuthology.orchestra.run.smithi101.stdout: { 2023-08-01T19:55:28.249 INFO:teuthology.orchestra.run.smithi101.stdout: "event": "queued_for_pg", 2023-08-01T19:55:28.249 INFO:teuthology.orchestra.run.smithi101.stdout: "time": "2023-08-01T19:55:09.345768+0000", 2023-08-01T19:55:28.249 INFO:teuthology.orchestra.run.smithi101.stdout: "duration": 8.7099999999999996e-06 2023-08-01T19:55:28.249 INFO:teuthology.orchestra.run.smithi101.stdout: }, 2023-08-01T19:55:28.249 INFO:teuthology.orchestra.run.smithi101.stdout: { 2023-08-01T19:55:28.249 INFO:teuthology.orchestra.run.smithi101.stdout: "event": "reached_pg", 2023-08-01T19:55:28.249 INFO:teuthology.orchestra.run.smithi101.stdout: "time": "2023-08-01T19:55:09.345832+0000", 2023-08-01T19:55:28.249 INFO:teuthology.orchestra.run.smithi101.stdout: "duration": 6.4769000000000003e-05 2023-08-01T19:55:28.250 INFO:teuthology.orchestra.run.smithi101.stdout: }, 2023-08-01T19:55:28.250 INFO:teuthology.orchestra.run.smithi101.stdout: { 2023-08-01T19:55:28.250 INFO:teuthology.orchestra.run.smithi101.stdout: "event": "started", 2023-08-01T19:55:28.250 INFO:teuthology.orchestra.run.smithi101.stdout: "time": "2023-08-01T19:55:09.345851+0000", 2023-08-01T19:55:28.250 INFO:teuthology.orchestra.run.smithi101.stdout: "duration": 1.9049e-05 2023-08-01T19:55:28.250 INFO:teuthology.orchestra.run.smithi101.stdout: }, 2023-08-01T19:55:28.250 INFO:teuthology.orchestra.run.smithi101.stdout: { 2023-08-01T19:55:28.250 INFO:teuthology.orchestra.run.smithi101.stdout: "event": "commit_sent", 2023-08-01T19:55:28.251 INFO:teuthology.orchestra.run.smithi101.stdout: "time": "2023-08-01T19:55:09.351601+0000", 2023-08-01T19:55:28.251 INFO:teuthology.orchestra.run.smithi101.stdout: "duration": 0.0057499930000000001 2023-08-01T19:55:28.251 INFO:teuthology.orchestra.run.smithi101.stdout: }, 2023-08-01T19:55:28.251 INFO:teuthology.orchestra.run.smithi101.stdout: { 2023-08-01T19:55:28.251 INFO:teuthology.orchestra.run.smithi101.stdout: "event": "done", 2023-08-01T19:55:28.251 INFO:teuthology.orchestra.run.smithi101.stdout: "time": "2023-08-01T19:55:09.351639+0000", 2023-08-01T19:55:28.251 INFO:teuthology.orchestra.run.smithi101.stdout: "duration": 3.7941000000000001e-05 2023-08-01T19:55:28.251 INFO:teuthology.orchestra.run.smithi101.stdout: } 2023-08-01T19:55:28.252 INFO:teuthology.orchestra.run.smithi101.stdout: ] 2023-08-01T19:55:28.252 INFO:teuthology.orchestra.run.smithi101.stdout: } 2023-08-01T19:55:28.252 INFO:teuthology.orchestra.run.smithi101.stdout: }, 2023-08-01T19:55:28.252 INFO:teuthology.orchestra.run.smithi101.stdout: { 2023-08-01T19:55:28.252 INFO:teuthology.orchestra.run.smithi101.stdout: "description": "osd_op(client.4668.0:107876 5.1 5:8d2344a3:::benchmark_data_smithi006_114134_object107875:head [set-alloc-hint object_size 65536 write_size 65536,write 0~65536] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e38)", 2023-08-01T19:55:28.252 INFO:teuthology.orchestra.run.smithi101.stdout: "initiated_at": "2023-08-01T19:55:09.287802+0000", 2023-08-01T19:55:28.252 INFO:teuthology.orchestra.run.smithi101.stdout: "age": 18.759995885999999, 2023-08-01T19:55:28.252 INFO:teuthology.orchestra.run.smithi101.stdout: "duration": 0.066738461999999998, 2023-08-01T19:55:28.253 INFO:teuthology.orchestra.run.smithi101.stdout: "type_data": { 2023-08-01T19:55:28.253 INFO:teuthology.orchestra.run.smithi101.stdout: "flag_point": "commit sent; apply or cleanup", 2023-08-01T19:55:28.253 INFO:teuthology.orchestra.run.smithi101.stdout: "client_info": { 2023-08-01T19:55:28.253 INFO:teuthology.orchestra.run.smithi101.stdout: "client": "client.4668", 2023-08-01T19:55:28.253 INFO:teuthology.orchestra.run.smithi101.stdout: "client_addr": "172.21.15.6:0/1709472247", 2023-08-01T19:55:28.253 INFO:teuthology.orchestra.run.smithi101.stdout: "tid": 107876 2023-08-01T19:55:28.253 INFO:teuthology.orchestra.run.smithi101.stdout: }, 2023-08-01T19:55:28.253 INFO:teuthology.orchestra.run.smithi101.stdout: "events": [ 2023-08-01T19:55:28.254 INFO:teuthology.orchestra.run.smithi101.stdout: { 2023-08-01T19:55:28.254 INFO:teuthology.orchestra.run.smithi101.stdout: "event": "initiated", 2023-08-01T19:55:28.254 INFO:teuthology.orchestra.run.smithi101.stdout: "time": "2023-08-01T19:55:09.287802+0000", 2023-08-01T19:55:28.254 INFO:teuthology.orchestra.run.smithi101.stdout: "duration": 0 2023-08-01T19:55:28.254 INFO:teuthology.orchestra.run.smithi101.stdout: }, 2023-08-01T19:55:28.254 INFO:teuthology.orchestra.run.smithi101.stdout: { 2023-08-01T19:55:28.254 INFO:teuthology.orchestra.run.smithi101.stdout: "event": "throttled", 2023-08-01T19:55:28.254 INFO:teuthology.orchestra.run.smithi101.stdout: "time": "2023-08-01T19:55:09.287802+0000", 2023-08-01T19:55:28.255 INFO:teuthology.orchestra.run.smithi101.stdout: "duration": 0 2023-08-01T19:55:28.255 INFO:teuthology.orchestra.run.smithi101.stdout: }, 2023-08-01T19:55:28.255 INFO:teuthology.orchestra.run.smithi101.stdout: { 2023-08-01T19:55:28.255 INFO:teuthology.orchestra.run.smithi101.stdout: "event": "header_read", 2023-08-01T19:55:28.255 INFO:teuthology.orchestra.run.smithi101.stdout: "time": "2023-08-01T19:55:09.287800+0000", 2023-08-01T19:55:28.255 INFO:teuthology.orchestra.run.smithi101.stdout: "duration": 4294967295.9999981 2023-08-01T19:55:28.255 INFO:teuthology.orchestra.run.smithi101.stdout: }, 2023-08-01T19:55:28.255 INFO:teuthology.orchestra.run.smithi101.stdout: { 2023-08-01T19:55:28.256 INFO:teuthology.orchestra.run.smithi101.stdout: "event": "all_read", 2023-08-01T19:55:28.256 INFO:teuthology.orchestra.run.smithi101.stdout: "time": "2023-08-01T19:55:09.287847+0000", 2023-08-01T19:55:28.256 INFO:teuthology.orchestra.run.smithi101.stdout: "duration": 4.6455999999999997e-05 2023-08-01T19:55:28.256 INFO:teuthology.orchestra.run.smithi101.stdout: }, 2023-08-01T19:55:28.256 INFO:teuthology.orchestra.run.smithi101.stdout: { 2023-08-01T19:55:28.256 INFO:teuthology.orchestra.run.smithi101.stdout: "event": "dispatched", 2023-08-01T19:55:28.256 INFO:teuthology.orchestra.run.smithi101.stdout: "time": "2023-08-01T19:55:09.345732+0000", 2023-08-01T19:55:28.257 INFO:teuthology.orchestra.run.smithi101.stdout: "duration": 0.057885955000000003 2023-08-01T19:55:28.257 INFO:teuthology.orchestra.run.smithi101.stdout: }, 2023-08-01T19:55:28.257 INFO:teuthology.orchestra.run.smithi101.stdout: { 2023-08-01T19:55:28.257 INFO:teuthology.orchestra.run.smithi101.stdout: "event": "queued_for_pg", 2023-08-01T19:55:28.257 INFO:teuthology.orchestra.run.smithi101.stdout: "time": "2023-08-01T19:55:09.345802+0000", 2023-08-01T19:55:28.257 INFO:teuthology.orchestra.run.smithi101.stdout: "duration": 6.9845000000000006e-05 2023-08-01T19:55:28.257 INFO:teuthology.orchestra.run.smithi101.stdout: }, 2023-08-01T19:55:28.257 INFO:teuthology.orchestra.run.smithi101.stdout: { 2023-08-01T19:55:28.258 INFO:teuthology.orchestra.run.smithi101.stdout: "event": "reached_pg", 2023-08-01T19:55:28.258 INFO:teuthology.orchestra.run.smithi101.stdout: "time": "2023-08-01T19:55:09.345841+0000", 2023-08-01T19:55:28.258 INFO:teuthology.orchestra.run.smithi101.stdout: "duration": 3.8719e-05 2023-08-01T19:55:28.258 INFO:teuthology.orchestra.run.smithi101.stdout: }, 2023-08-01T19:55:28.258 INFO:teuthology.orchestra.run.smithi101.stdout: { 2023-08-01T19:55:28.258 INFO:teuthology.orchestra.run.smithi101.stdout: "event": "started", 2023-08-01T19:55:28.258 INFO:teuthology.orchestra.run.smithi101.stdout: "time": "2023-08-01T19:55:09.345965+0000", 2023-08-01T19:55:28.258 INFO:teuthology.orchestra.run.smithi101.stdout: "duration": 0.00012353099999999999 2023-08-01T19:55:28.259 INFO:teuthology.orchestra.run.smithi101.stdout: }, 2023-08-01T19:55:28.259 INFO:teuthology.orchestra.run.smithi101.stdout: { 2023-08-01T19:55:28.259 INFO:teuthology.orchestra.run.smithi101.stdout: "event": "waiting for subops from 0", 2023-08-01T19:55:28.259 INFO:teuthology.orchestra.run.smithi101.stdout: "time": "2023-08-01T19:55:09.346113+0000", 2023-08-01T19:55:28.259 INFO:teuthology.orchestra.run.smithi101.stdout: "duration": 0.000148496 2023-08-01T19:55:28.259 INFO:teuthology.orchestra.run.smithi101.stdout: }, 2023-08-01T19:55:28.259 INFO:teuthology.orchestra.run.smithi101.stdout: { 2023-08-01T19:55:28.259 INFO:teuthology.orchestra.run.smithi101.stdout: "event": "sub_op_commit_rec", 2023-08-01T19:55:28.260 INFO:teuthology.orchestra.run.smithi101.stdout: "time": "2023-08-01T19:55:09.352561+0000", 2023-08-01T19:55:28.260 INFO:teuthology.orchestra.run.smithi101.stdout: "duration": 0.0064478890000000001 2023-08-01T19:55:28.260 INFO:teuthology.orchestra.run.smithi101.stdout: }, 2023-08-01T19:55:28.260 INFO:teuthology.orchestra.run.smithi101.stdout: { 2023-08-01T19:55:28.260 INFO:teuthology.orchestra.run.smithi101.stdout: "event": "op_commit", 2023-08-01T19:55:28.260 INFO:teuthology.orchestra.run.smithi101.stdout: "time": "2023-08-01T19:55:09.354475+0000", 2023-08-01T19:55:28.260 INFO:teuthology.orchestra.run.smithi101.stdout: "duration": 0.001913903 2023-08-01T19:55:28.260 INFO:teuthology.orchestra.run.smithi101.stdout: }, 2023-08-01T19:55:28.261 INFO:teuthology.orchestra.run.smithi101.stdout: { 2023-08-01T19:55:28.261 INFO:teuthology.orchestra.run.smithi101.stdout: "event": "commit_sent", 2023-08-01T19:55:28.261 INFO:teuthology.orchestra.run.smithi101.stdout: "time": "2023-08-01T19:55:09.354514+0000", 2023-08-01T19:55:28.261 INFO:teuthology.orchestra.run.smithi101.stdout: "duration": 3.8680999999999998e-05 2023-08-01T19:55:28.261 INFO:teuthology.orchestra.run.smithi101.stdout: }, 2023-08-01T19:55:28.261 INFO:teuthology.orchestra.run.smithi101.stdout: { 2023-08-01T19:55:28.261 INFO:teuthology.orchestra.run.smithi101.stdout: "event": "done", 2023-08-01T19:55:28.261 INFO:teuthology.orchestra.run.smithi101.stdout: "time": "2023-08-01T19:55:09.354541+0000", 2023-08-01T19:55:28.262 INFO:teuthology.orchestra.run.smithi101.stdout: "duration": 2.6976999999999999e-05 2023-08-01T19:55:28.262 INFO:teuthology.orchestra.run.smithi101.stdout: } 2023-08-01T19:55:28.262 INFO:teuthology.orchestra.run.smithi101.stdout: ] 2023-08-01T19:55:28.262 INFO:teuthology.orchestra.run.smithi101.stdout: } 2023-08-01T19:55:28.262 INFO:teuthology.orchestra.run.smithi101.stdout: } 2023-08-01T19:55:28.262 INFO:teuthology.orchestra.run.smithi101.stdout: ] 2023-08-01T19:55:28.262 INFO:teuthology.orchestra.run.smithi101.stdout:} 2023-08-01T19:55:28.263 DEBUG:teuthology.orchestra.run.smithi006:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 120 ceph --cluster ceph -- tell 'osd.*' injectargs --osd_enable_op_tracker=false 2023-08-01T19:55:28.264 DEBUG:teuthology.orchestra.run.smithi155:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 30 ceph --cluster ceph --admin-daemon /var/run/ceph/ceph-osd.2.asok dump_ops_in_flight 2023-08-01T19:55:28.265 INFO:tasks.ceph.osd.1.smithi101.stderr:2023-08-01T19:55:28.262+0000 7fb0cb7f6700 -1 received signal: Hangup from /usr/bin/python3 /bin/daemon-helper kill ceph-osd -f --cluster ceph -i 1 (PID: 111141) UID: 0 2023-08-01T19:55:28.364 INFO:tasks.ceph.osd.2.smithi155.stderr:2023-08-01T19:55:28.363+0000 7faa5c6ac700 -1 received signal: Hangup from /usr/bin/python3 /bin/daemon-helper kill ceph-osd -f --cluster ceph -i 2 (PID: 111337) UID: 0 2023-08-01T19:55:28.410 INFO:teuthology.orchestra.run.smithi006.stdout:osd.0: {} 2023-08-01T19:55:28.430 INFO:teuthology.orchestra.run.smithi006.stdout:osd.1: {} 2023-08-01T19:55:28.434 INFO:teuthology.orchestra.run.smithi155.stdout:{ 2023-08-01T19:55:28.434 INFO:teuthology.orchestra.run.smithi155.stdout: "ops": [ 2023-08-01T19:55:28.434 INFO:teuthology.orchestra.run.smithi155.stdout: { 2023-08-01T19:55:28.434 INFO:teuthology.orchestra.run.smithi155.stdout: "description": "osd_op(client.4668.0:140046 5.f 5:fab9415c:::benchmark_data_smithi006_114134_object6385:head [delete] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e47)", 2023-08-01T19:55:28.434 INFO:teuthology.orchestra.run.smithi155.stdout: "initiated_at": "2023-08-01T19:55:28.428838+0000", 2023-08-01T19:55:28.434 INFO:teuthology.orchestra.run.smithi155.stdout: "age": 0.0037774919999999999, 2023-08-01T19:55:28.434 INFO:teuthology.orchestra.run.smithi155.stdout: "duration": 0.0037955770000000001, 2023-08-01T19:55:28.435 INFO:teuthology.orchestra.run.smithi155.stdout: "type_data": { 2023-08-01T19:55:28.435 INFO:teuthology.orchestra.run.smithi155.stdout: "flag_point": "waiting for sub ops", 2023-08-01T19:55:28.435 INFO:teuthology.orchestra.run.smithi155.stdout: "client_info": { 2023-08-01T19:55:28.435 INFO:teuthology.orchestra.run.smithi155.stdout: "client": "client.4668", 2023-08-01T19:55:28.435 INFO:teuthology.orchestra.run.smithi155.stdout: "client_addr": "172.21.15.6:0/1709472247", 2023-08-01T19:55:28.435 INFO:teuthology.orchestra.run.smithi155.stdout: "tid": 140046 2023-08-01T19:55:28.435 INFO:teuthology.orchestra.run.smithi155.stdout: }, 2023-08-01T19:55:28.436 INFO:teuthology.orchestra.run.smithi155.stdout: "events": [ 2023-08-01T19:55:28.436 INFO:teuthology.orchestra.run.smithi155.stdout: { 2023-08-01T19:55:28.436 INFO:teuthology.orchestra.run.smithi155.stdout: "event": "initiated", 2023-08-01T19:55:28.436 INFO:teuthology.orchestra.run.smithi155.stdout: "time": "2023-08-01T19:55:28.428838+0000", 2023-08-01T19:55:28.436 INFO:teuthology.orchestra.run.smithi155.stdout: "duration": 0 2023-08-01T19:55:28.436 INFO:teuthology.orchestra.run.smithi155.stdout: }, 2023-08-01T19:55:28.436 INFO:teuthology.orchestra.run.smithi155.stdout: { 2023-08-01T19:55:28.437 INFO:teuthology.orchestra.run.smithi155.stdout: "event": "throttled", 2023-08-01T19:55:28.437 INFO:teuthology.orchestra.run.smithi155.stdout: "time": "2023-08-01T19:55:28.428838+0000", 2023-08-01T19:55:28.437 INFO:teuthology.orchestra.run.smithi155.stdout: "duration": 0 2023-08-01T19:55:28.437 INFO:teuthology.orchestra.run.smithi155.stdout: }, 2023-08-01T19:55:28.437 INFO:teuthology.orchestra.run.smithi155.stdout: { 2023-08-01T19:55:28.437 INFO:teuthology.orchestra.run.smithi155.stdout: "event": "header_read", 2023-08-01T19:55:28.437 INFO:teuthology.orchestra.run.smithi155.stdout: "time": "2023-08-01T19:55:28.428837+0000", 2023-08-01T19:55:28.438 INFO:teuthology.orchestra.run.smithi155.stdout: "duration": 4294967295.999999 2023-08-01T19:55:28.438 INFO:teuthology.orchestra.run.smithi155.stdout: }, 2023-08-01T19:55:28.438 INFO:teuthology.orchestra.run.smithi155.stdout: { 2023-08-01T19:55:28.438 INFO:teuthology.orchestra.run.smithi155.stdout: "event": "all_read", 2023-08-01T19:55:28.438 INFO:teuthology.orchestra.run.smithi155.stdout: "time": "2023-08-01T19:55:28.428841+0000", 2023-08-01T19:55:28.438 INFO:teuthology.orchestra.run.smithi155.stdout: "duration": 3.9779999999999999e-06 2023-08-01T19:55:28.438 INFO:teuthology.orchestra.run.smithi155.stdout: }, 2023-08-01T19:55:28.439 INFO:teuthology.orchestra.run.smithi155.stdout: { 2023-08-01T19:55:28.439 INFO:teuthology.orchestra.run.smithi155.stdout: "event": "dispatched", 2023-08-01T19:55:28.439 INFO:teuthology.orchestra.run.smithi155.stdout: "time": "2023-08-01T19:55:28.428848+0000", 2023-08-01T19:55:28.439 INFO:teuthology.orchestra.run.smithi155.stdout: "duration": 6.6590000000000001e-06 2023-08-01T19:55:28.439 INFO:teuthology.orchestra.run.smithi155.stdout: }, 2023-08-01T19:55:28.439 INFO:teuthology.orchestra.run.smithi155.stdout: { 2023-08-01T19:55:28.439 INFO:teuthology.orchestra.run.smithi155.stdout: "event": "queued_for_pg", 2023-08-01T19:55:28.439 INFO:teuthology.orchestra.run.smithi155.stdout: "time": "2023-08-01T19:55:28.428851+0000", 2023-08-01T19:55:28.440 INFO:teuthology.orchestra.run.smithi155.stdout: "duration": 3.3100000000000001e-06 2023-08-01T19:55:28.440 INFO:teuthology.orchestra.run.smithi155.stdout: }, 2023-08-01T19:55:28.440 INFO:teuthology.orchestra.run.smithi155.stdout: { 2023-08-01T19:55:28.440 INFO:teuthology.orchestra.run.smithi155.stdout: "event": "reached_pg", 2023-08-01T19:55:28.440 INFO:teuthology.orchestra.run.smithi155.stdout: "time": "2023-08-01T19:55:28.428886+0000", 2023-08-01T19:55:28.440 INFO:teuthology.orchestra.run.smithi155.stdout: "duration": 3.4173e-05 2023-08-01T19:55:28.440 INFO:teuthology.orchestra.run.smithi155.stdout: }, 2023-08-01T19:55:28.440 INFO:teuthology.orchestra.run.smithi155.stdout: { 2023-08-01T19:55:28.441 INFO:teuthology.orchestra.run.smithi155.stdout: "event": "started", 2023-08-01T19:55:28.441 INFO:teuthology.orchestra.run.smithi155.stdout: "time": "2023-08-01T19:55:28.428973+0000", 2023-08-01T19:55:28.441 INFO:teuthology.orchestra.run.smithi155.stdout: "duration": 8.7669000000000004e-05 2023-08-01T19:55:28.441 INFO:teuthology.orchestra.run.smithi155.stdout: }, 2023-08-01T19:55:28.441 INFO:teuthology.orchestra.run.smithi155.stdout: { 2023-08-01T19:55:28.441 INFO:teuthology.orchestra.run.smithi155.stdout: "event": "waiting for subops from 1", 2023-08-01T19:55:28.441 INFO:teuthology.orchestra.run.smithi155.stdout: "time": "2023-08-01T19:55:28.429043+0000", 2023-08-01T19:55:28.442 INFO:teuthology.orchestra.run.smithi155.stdout: "duration": 6.9785999999999999e-05 2023-08-01T19:55:28.442 INFO:teuthology.orchestra.run.smithi155.stdout: }, 2023-08-01T19:55:28.442 INFO:teuthology.orchestra.run.smithi155.stdout: { 2023-08-01T19:55:28.442 INFO:teuthology.orchestra.run.smithi155.stdout: "event": "sub_op_commit_rec", 2023-08-01T19:55:28.442 INFO:teuthology.orchestra.run.smithi155.stdout: "time": "2023-08-01T19:55:28.432186+0000", 2023-08-01T19:55:28.442 INFO:teuthology.orchestra.run.smithi155.stdout: "duration": 0.0031426140000000002 2023-08-01T19:55:28.442 INFO:teuthology.orchestra.run.smithi155.stdout: } 2023-08-01T19:55:28.442 INFO:teuthology.orchestra.run.smithi155.stdout: ] 2023-08-01T19:55:28.443 INFO:teuthology.orchestra.run.smithi155.stdout: } 2023-08-01T19:55:28.443 INFO:teuthology.orchestra.run.smithi155.stdout: }, 2023-08-01T19:55:28.443 INFO:teuthology.orchestra.run.smithi155.stdout: { 2023-08-01T19:55:28.443 INFO:teuthology.orchestra.run.smithi155.stdout: "description": "osd_op(client.4668.0:140048 5.8 5:10d249f4:::benchmark_data_smithi006_114134_object6387:head [delete] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e47)", 2023-08-01T19:55:28.443 INFO:teuthology.orchestra.run.smithi155.stdout: "initiated_at": "2023-08-01T19:55:28.428952+0000", 2023-08-01T19:55:28.443 INFO:teuthology.orchestra.run.smithi155.stdout: "age": 0.0036633880000000001, 2023-08-01T19:55:28.443 INFO:teuthology.orchestra.run.smithi155.stdout: "duration": 0.003737836, 2023-08-01T19:55:28.443 INFO:teuthology.orchestra.run.smithi155.stdout: "type_data": { 2023-08-01T19:55:28.444 INFO:teuthology.orchestra.run.smithi155.stdout: "flag_point": "waiting for sub ops", 2023-08-01T19:55:28.444 INFO:teuthology.orchestra.run.smithi155.stdout: "client_info": { 2023-08-01T19:55:28.444 INFO:teuthology.orchestra.run.smithi155.stdout: "client": "client.4668", 2023-08-01T19:55:28.444 INFO:teuthology.orchestra.run.smithi155.stdout: "client_addr": "172.21.15.6:0/1709472247", 2023-08-01T19:55:28.444 INFO:teuthology.orchestra.run.smithi155.stdout: "tid": 140048 2023-08-01T19:55:28.444 INFO:teuthology.orchestra.run.smithi155.stdout: }, 2023-08-01T19:55:28.444 INFO:teuthology.orchestra.run.smithi155.stdout: "events": [ 2023-08-01T19:55:28.445 INFO:teuthology.orchestra.run.smithi155.stdout: { 2023-08-01T19:55:28.445 INFO:teuthology.orchestra.run.smithi155.stdout: "event": "initiated", 2023-08-01T19:55:28.445 INFO:teuthology.orchestra.run.smithi155.stdout: "time": "2023-08-01T19:55:28.428952+0000", 2023-08-01T19:55:28.445 INFO:teuthology.orchestra.run.smithi155.stdout: "duration": 0 2023-08-01T19:55:28.445 INFO:teuthology.orchestra.run.smithi155.stdout: }, 2023-08-01T19:55:28.445 INFO:teuthology.orchestra.run.smithi155.stdout: { 2023-08-01T19:55:28.445 INFO:teuthology.orchestra.run.smithi155.stdout: "event": "throttled", 2023-08-01T19:55:28.445 INFO:teuthology.orchestra.run.smithi155.stdout: "time": "2023-08-01T19:55:28.428952+0000", 2023-08-01T19:55:28.446 INFO:teuthology.orchestra.run.smithi155.stdout: "duration": 0 2023-08-01T19:55:28.446 INFO:teuthology.orchestra.run.smithi155.stdout: }, 2023-08-01T19:55:28.446 INFO:teuthology.orchestra.run.smithi155.stdout: { 2023-08-01T19:55:28.446 INFO:teuthology.orchestra.run.smithi155.stdout: "event": "header_read", 2023-08-01T19:55:28.446 INFO:teuthology.orchestra.run.smithi155.stdout: "time": "2023-08-01T19:55:28.428952+0000", 2023-08-01T19:55:28.446 INFO:teuthology.orchestra.run.smithi155.stdout: "duration": 4294967295.9999995 2023-08-01T19:55:28.446 INFO:teuthology.orchestra.run.smithi155.stdout: }, 2023-08-01T19:55:28.446 INFO:teuthology.orchestra.run.smithi155.stdout: { 2023-08-01T19:55:28.447 INFO:teuthology.orchestra.run.smithi155.stdout: "event": "all_read", 2023-08-01T19:55:28.447 INFO:teuthology.orchestra.run.smithi155.stdout: "time": "2023-08-01T19:55:28.428956+0000", 2023-08-01T19:55:28.447 INFO:teuthology.orchestra.run.smithi155.stdout: "duration": 4.0820000000000001e-06 2023-08-01T19:55:28.447 INFO:teuthology.orchestra.run.smithi155.stdout: }, 2023-08-01T19:55:28.447 INFO:teuthology.orchestra.run.smithi155.stdout: { 2023-08-01T19:55:28.447 INFO:teuthology.orchestra.run.smithi155.stdout: "event": "dispatched", 2023-08-01T19:55:28.447 INFO:teuthology.orchestra.run.smithi155.stdout: "time": "2023-08-01T19:55:28.428964+0000", 2023-08-01T19:55:28.447 INFO:teuthology.orchestra.run.smithi155.stdout: "duration": 8.4870000000000002e-06 2023-08-01T19:55:28.448 INFO:teuthology.orchestra.run.smithi155.stdout: }, 2023-08-01T19:55:28.448 INFO:teuthology.orchestra.run.smithi155.stdout: { 2023-08-01T19:55:28.448 INFO:teuthology.orchestra.run.smithi155.stdout: "event": "queued_for_pg", 2023-08-01T19:55:28.448 INFO:teuthology.orchestra.run.smithi155.stdout: "time": "2023-08-01T19:55:28.428969+0000", 2023-08-01T19:55:28.448 INFO:teuthology.orchestra.run.smithi155.stdout: "duration": 5.3140000000000003e-06 2023-08-01T19:55:28.448 INFO:teuthology.orchestra.run.smithi155.stdout: }, 2023-08-01T19:55:28.448 INFO:teuthology.orchestra.run.smithi155.stdout: { 2023-08-01T19:55:28.448 INFO:teuthology.orchestra.run.smithi155.stdout: "event": "reached_pg", 2023-08-01T19:55:28.449 INFO:teuthology.orchestra.run.smithi155.stdout: "time": "2023-08-01T19:55:28.429003+0000", 2023-08-01T19:55:28.449 INFO:teuthology.orchestra.run.smithi155.stdout: "duration": 3.3593999999999997e-05 2023-08-01T19:55:28.449 INFO:teuthology.orchestra.run.smithi155.stdout: }, 2023-08-01T19:55:28.449 INFO:teuthology.orchestra.run.smithi155.stdout: { 2023-08-01T19:55:28.449 INFO:teuthology.orchestra.run.smithi155.stdout: "event": "started", 2023-08-01T19:55:28.449 INFO:teuthology.orchestra.run.smithi155.stdout: "time": "2023-08-01T19:55:28.429105+0000", 2023-08-01T19:55:28.449 INFO:teuthology.orchestra.run.smithi155.stdout: "duration": 0.000101789 2023-08-01T19:55:28.449 INFO:teuthology.orchestra.run.smithi155.stdout: }, 2023-08-01T19:55:28.450 INFO:teuthology.orchestra.run.smithi155.stdout: { 2023-08-01T19:55:28.450 INFO:teuthology.orchestra.run.smithi155.stdout: "event": "waiting for subops from 0", 2023-08-01T19:55:28.450 INFO:teuthology.orchestra.run.smithi155.stdout: "time": "2023-08-01T19:55:28.429208+0000", 2023-08-01T19:55:28.450 INFO:teuthology.orchestra.run.smithi155.stdout: "duration": 0.00010320200000000001 2023-08-01T19:55:28.450 INFO:teuthology.orchestra.run.smithi155.stdout: } 2023-08-01T19:55:28.450 INFO:teuthology.orchestra.run.smithi155.stdout: ] 2023-08-01T19:55:28.450 INFO:teuthology.orchestra.run.smithi155.stdout: } 2023-08-01T19:55:28.451 INFO:teuthology.orchestra.run.smithi155.stdout: }, 2023-08-01T19:55:28.451 INFO:teuthology.orchestra.run.smithi155.stdout: { 2023-08-01T19:55:28.451 INFO:teuthology.orchestra.run.smithi155.stdout: "description": "osd_op(client.4668.0:140049 5.4 5:2a6a32d4:::benchmark_data_smithi006_114134_object6388:head [delete] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e47)", 2023-08-01T19:55:28.451 INFO:teuthology.orchestra.run.smithi155.stdout: "initiated_at": "2023-08-01T19:55:28.429773+0000", 2023-08-01T19:55:28.451 INFO:teuthology.orchestra.run.smithi155.stdout: "age": 0.0028429750000000002, 2023-08-01T19:55:28.451 INFO:teuthology.orchestra.run.smithi155.stdout: "duration": 0.0029703540000000001, 2023-08-01T19:55:28.451 INFO:teuthology.orchestra.run.smithi155.stdout: "type_data": { 2023-08-01T19:55:28.451 INFO:teuthology.orchestra.run.smithi155.stdout: "flag_point": "waiting for sub ops", 2023-08-01T19:55:28.452 INFO:teuthology.orchestra.run.smithi155.stdout: "client_info": { 2023-08-01T19:55:28.452 INFO:teuthology.orchestra.run.smithi155.stdout: "client": "client.4668", 2023-08-01T19:55:28.452 INFO:teuthology.orchestra.run.smithi155.stdout: "client_addr": "172.21.15.6:0/1709472247", 2023-08-01T19:55:28.452 INFO:teuthology.orchestra.run.smithi155.stdout: "tid": 140049 2023-08-01T19:55:28.452 INFO:teuthology.orchestra.run.smithi155.stdout: }, 2023-08-01T19:55:28.452 INFO:teuthology.orchestra.run.smithi155.stdout: "events": [ 2023-08-01T19:55:28.452 INFO:teuthology.orchestra.run.smithi155.stdout: { 2023-08-01T19:55:28.453 INFO:teuthology.orchestra.run.smithi155.stdout: "event": "initiated", 2023-08-01T19:55:28.453 INFO:teuthology.orchestra.run.smithi155.stdout: "time": "2023-08-01T19:55:28.429773+0000", 2023-08-01T19:55:28.453 INFO:teuthology.orchestra.run.smithi155.stdout: "duration": 0 2023-08-01T19:55:28.453 INFO:teuthology.orchestra.run.smithi155.stdout: }, 2023-08-01T19:55:28.453 INFO:teuthology.orchestra.run.smithi155.stdout: { 2023-08-01T19:55:28.453 INFO:teuthology.orchestra.run.smithi155.stdout: "event": "throttled", 2023-08-01T19:55:28.453 INFO:teuthology.orchestra.run.smithi155.stdout: "time": "2023-08-01T19:55:28.429773+0000", 2023-08-01T19:55:28.453 INFO:teuthology.orchestra.run.smithi155.stdout: "duration": 0 2023-08-01T19:55:28.454 INFO:teuthology.orchestra.run.smithi155.stdout: }, 2023-08-01T19:55:28.454 INFO:teuthology.orchestra.run.smithi155.stdout: { 2023-08-01T19:55:28.454 INFO:teuthology.orchestra.run.smithi155.stdout: "event": "header_read", 2023-08-01T19:55:28.454 INFO:teuthology.orchestra.run.smithi155.stdout: "time": "2023-08-01T19:55:28.429772+0000", 2023-08-01T19:55:28.454 INFO:teuthology.orchestra.run.smithi155.stdout: "duration": 4294967295.999999 2023-08-01T19:55:28.454 INFO:teuthology.orchestra.run.smithi155.stdout: }, 2023-08-01T19:55:28.454 INFO:teuthology.orchestra.run.smithi155.stdout: { 2023-08-01T19:55:28.454 INFO:teuthology.orchestra.run.smithi155.stdout: "event": "all_read", 2023-08-01T19:55:28.455 INFO:teuthology.orchestra.run.smithi155.stdout: "time": "2023-08-01T19:55:28.429776+0000", 2023-08-01T19:55:28.455 INFO:teuthology.orchestra.run.smithi155.stdout: "duration": 4.2719999999999999e-06 2023-08-01T19:55:28.455 INFO:teuthology.orchestra.run.smithi155.stdout: }, 2023-08-01T19:55:28.455 INFO:teuthology.orchestra.run.smithi155.stdout: { 2023-08-01T19:55:28.455 INFO:teuthology.orchestra.run.smithi155.stdout: "event": "dispatched", 2023-08-01T19:55:28.455 INFO:teuthology.orchestra.run.smithi155.stdout: "time": "2023-08-01T19:55:28.429788+0000", 2023-08-01T19:55:28.455 INFO:teuthology.orchestra.run.smithi155.stdout: "duration": 1.181e-05 2023-08-01T19:55:28.455 INFO:teuthology.orchestra.run.smithi155.stdout: }, 2023-08-01T19:55:28.456 INFO:teuthology.orchestra.run.smithi155.stdout: { 2023-08-01T19:55:28.456 INFO:teuthology.orchestra.run.smithi155.stdout: "event": "queued_for_pg", 2023-08-01T19:55:28.456 INFO:teuthology.orchestra.run.smithi155.stdout: "time": "2023-08-01T19:55:28.429793+0000", 2023-08-01T19:55:28.456 INFO:teuthology.orchestra.run.smithi155.stdout: "duration": 5.4029999999999998e-06 2023-08-01T19:55:28.456 INFO:teuthology.orchestra.run.smithi155.stdout: }, 2023-08-01T19:55:28.456 INFO:teuthology.orchestra.run.smithi155.stdout: { 2023-08-01T19:55:28.456 INFO:teuthology.orchestra.run.smithi155.stdout: "event": "reached_pg", 2023-08-01T19:55:28.456 INFO:teuthology.orchestra.run.smithi155.stdout: "time": "2023-08-01T19:55:28.429834+0000", 2023-08-01T19:55:28.457 INFO:teuthology.orchestra.run.smithi155.stdout: "duration": 4.0828000000000003e-05 2023-08-01T19:55:28.457 INFO:teuthology.orchestra.run.smithi155.stdout: }, 2023-08-01T19:55:28.457 INFO:teuthology.orchestra.run.smithi155.stdout: { 2023-08-01T19:55:28.457 INFO:teuthology.orchestra.run.smithi155.stdout: "event": "started", 2023-08-01T19:55:28.457 INFO:teuthology.orchestra.run.smithi155.stdout: "time": "2023-08-01T19:55:28.429952+0000", 2023-08-01T19:55:28.457 INFO:teuthology.orchestra.run.smithi155.stdout: "duration": 0.000117658 2023-08-01T19:55:28.458 INFO:teuthology.orchestra.run.smithi155.stdout: }, 2023-08-01T19:55:28.458 INFO:teuthology.orchestra.run.smithi155.stdout: { 2023-08-01T19:55:28.458 INFO:teuthology.orchestra.run.smithi155.stdout: "event": "waiting for subops from 0", 2023-08-01T19:55:28.458 INFO:teuthology.orchestra.run.smithi155.stdout: "time": "2023-08-01T19:55:28.430110+0000", 2023-08-01T19:55:28.458 INFO:teuthology.orchestra.run.smithi155.stdout: "duration": 0.000157949 2023-08-01T19:55:28.458 INFO:teuthology.orchestra.run.smithi155.stdout: } 2023-08-01T19:55:28.458 INFO:teuthology.orchestra.run.smithi155.stdout: ] 2023-08-01T19:55:28.459 INFO:teuthology.orchestra.run.smithi155.stdout: } 2023-08-01T19:55:28.459 INFO:teuthology.orchestra.run.smithi155.stdout: }, 2023-08-01T19:55:28.459 INFO:teuthology.orchestra.run.smithi155.stdout: { 2023-08-01T19:55:28.459 INFO:teuthology.orchestra.run.smithi155.stdout: "description": "osd_op(client.4668.0:140053 5.4 5:2572e40e:::benchmark_data_smithi006_114134_object6392:head [delete] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e47)", 2023-08-01T19:55:28.459 INFO:teuthology.orchestra.run.smithi155.stdout: "initiated_at": "2023-08-01T19:55:28.431343+0000", 2023-08-01T19:55:28.459 INFO:teuthology.orchestra.run.smithi155.stdout: "age": 0.0012729219999999999, 2023-08-01T19:55:28.459 INFO:teuthology.orchestra.run.smithi155.stdout: "duration": 0.001445633, 2023-08-01T19:55:28.459 INFO:teuthology.orchestra.run.smithi155.stdout: "type_data": { 2023-08-01T19:55:28.460 INFO:teuthology.orchestra.run.smithi155.stdout: "flag_point": "waiting for sub ops", 2023-08-01T19:55:28.460 INFO:teuthology.orchestra.run.smithi155.stdout: "client_info": { 2023-08-01T19:55:28.460 INFO:teuthology.orchestra.run.smithi155.stdout: "client": "client.4668", 2023-08-01T19:55:28.460 INFO:teuthology.orchestra.run.smithi155.stdout: "client_addr": "172.21.15.6:0/1709472247", 2023-08-01T19:55:28.460 INFO:teuthology.orchestra.run.smithi155.stdout: "tid": 140053 2023-08-01T19:55:28.460 INFO:teuthology.orchestra.run.smithi155.stdout: }, 2023-08-01T19:55:28.460 INFO:teuthology.orchestra.run.smithi155.stdout: "events": [ 2023-08-01T19:55:28.461 INFO:teuthology.orchestra.run.smithi155.stdout: { 2023-08-01T19:55:28.461 INFO:teuthology.orchestra.run.smithi155.stdout: "event": "initiated", 2023-08-01T19:55:28.461 INFO:teuthology.orchestra.run.smithi155.stdout: "time": "2023-08-01T19:55:28.431343+0000", 2023-08-01T19:55:28.461 INFO:teuthology.orchestra.run.smithi155.stdout: "duration": 0 2023-08-01T19:55:28.461 INFO:teuthology.orchestra.run.smithi155.stdout: }, 2023-08-01T19:55:28.461 INFO:teuthology.orchestra.run.smithi155.stdout: { 2023-08-01T19:55:28.461 INFO:teuthology.orchestra.run.smithi155.stdout: "event": "throttled", 2023-08-01T19:55:28.461 INFO:teuthology.orchestra.run.smithi155.stdout: "time": "2023-08-01T19:55:28.431343+0000", 2023-08-01T19:55:28.462 INFO:teuthology.orchestra.run.smithi155.stdout: "duration": 0 2023-08-01T19:55:28.462 INFO:teuthology.orchestra.run.smithi155.stdout: }, 2023-08-01T19:55:28.462 INFO:teuthology.orchestra.run.smithi155.stdout: { 2023-08-01T19:55:28.462 INFO:teuthology.orchestra.run.smithi155.stdout: "event": "header_read", 2023-08-01T19:55:28.462 INFO:teuthology.orchestra.run.smithi155.stdout: "time": "2023-08-01T19:55:28.431342+0000", 2023-08-01T19:55:28.462 INFO:teuthology.orchestra.run.smithi155.stdout: "duration": 4294967295.9999995 2023-08-01T19:55:28.462 INFO:teuthology.orchestra.run.smithi155.stdout: }, 2023-08-01T19:55:28.462 INFO:teuthology.orchestra.run.smithi155.stdout: { 2023-08-01T19:55:28.463 INFO:teuthology.orchestra.run.smithi155.stdout: "event": "all_read", 2023-08-01T19:55:28.463 INFO:teuthology.orchestra.run.smithi155.stdout: "time": "2023-08-01T19:55:28.431346+0000", 2023-08-01T19:55:28.463 INFO:teuthology.orchestra.run.smithi155.stdout: "duration": 3.7610000000000001e-06 2023-08-01T19:55:28.463 INFO:teuthology.orchestra.run.smithi155.stdout: }, 2023-08-01T19:55:28.463 INFO:teuthology.orchestra.run.smithi155.stdout: { 2023-08-01T19:55:28.463 INFO:teuthology.orchestra.run.smithi155.stdout: "event": "dispatched", 2023-08-01T19:55:28.463 INFO:teuthology.orchestra.run.smithi155.stdout: "time": "2023-08-01T19:55:28.431354+0000", 2023-08-01T19:55:28.463 INFO:teuthology.orchestra.run.smithi155.stdout: "duration": 7.7179999999999996e-06 2023-08-01T19:55:28.464 INFO:teuthology.orchestra.run.smithi155.stdout: }, 2023-08-01T19:55:28.464 INFO:teuthology.orchestra.run.smithi155.stdout: { 2023-08-01T19:55:28.464 INFO:teuthology.orchestra.run.smithi155.stdout: "event": "queued_for_pg", 2023-08-01T19:55:28.464 INFO:teuthology.orchestra.run.smithi155.stdout: "time": "2023-08-01T19:55:28.431358+0000", 2023-08-01T19:55:28.464 INFO:teuthology.orchestra.run.smithi155.stdout: "duration": 4.0759999999999996e-06 2023-08-01T19:55:28.465 INFO:teuthology.orchestra.run.smithi155.stdout: }, 2023-08-01T19:55:28.465 INFO:teuthology.orchestra.run.smithi155.stdout: { 2023-08-01T19:55:28.465 INFO:teuthology.orchestra.run.smithi155.stdout: "event": "reached_pg", 2023-08-01T19:55:28.465 INFO:teuthology.orchestra.run.smithi155.stdout: "time": "2023-08-01T19:55:28.431954+0000", 2023-08-01T19:55:28.465 INFO:teuthology.orchestra.run.smithi155.stdout: "duration": 0.00059607200000000001 2023-08-01T19:55:28.465 INFO:teuthology.orchestra.run.smithi155.stdout: }, 2023-08-01T19:55:28.466 INFO:teuthology.orchestra.run.smithi155.stdout: { 2023-08-01T19:55:28.466 INFO:teuthology.orchestra.run.smithi155.stdout: "event": "started", 2023-08-01T19:55:28.466 INFO:teuthology.orchestra.run.smithi155.stdout: "time": "2023-08-01T19:55:28.432061+0000", 2023-08-01T19:55:28.466 INFO:teuthology.orchestra.run.smithi155.stdout: "duration": 0.00010756600000000001 2023-08-01T19:55:28.466 INFO:teuthology.orchestra.run.smithi155.stdout: }, 2023-08-01T19:55:28.466 INFO:teuthology.orchestra.run.smithi155.stdout: { 2023-08-01T19:55:28.466 INFO:teuthology.orchestra.run.smithi155.stdout: "event": "waiting for subops from 0", 2023-08-01T19:55:28.466 INFO:teuthology.orchestra.run.smithi155.stdout: "time": "2023-08-01T19:55:28.432162+0000", 2023-08-01T19:55:28.467 INFO:teuthology.orchestra.run.smithi155.stdout: "duration": 0.000100819 2023-08-01T19:55:28.467 INFO:teuthology.orchestra.run.smithi155.stdout: } 2023-08-01T19:55:28.467 INFO:teuthology.orchestra.run.smithi155.stdout: ] 2023-08-01T19:55:28.467 INFO:teuthology.orchestra.run.smithi155.stdout: } 2023-08-01T19:55:28.467 INFO:teuthology.orchestra.run.smithi155.stdout: }, 2023-08-01T19:55:28.467 INFO:teuthology.orchestra.run.smithi155.stdout: { 2023-08-01T19:55:28.467 INFO:teuthology.orchestra.run.smithi155.stdout: "description": "osd_op(client.4668.0:140054 5.e 5:7f14e350:::benchmark_data_smithi006_114134_object6393:head [delete] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e47)", 2023-08-01T19:55:28.467 INFO:teuthology.orchestra.run.smithi155.stdout: "initiated_at": "2023-08-01T19:55:28.431391+0000", 2023-08-01T19:55:28.468 INFO:teuthology.orchestra.run.smithi155.stdout: "age": 0.0012243569999999999, 2023-08-01T19:55:28.468 INFO:teuthology.orchestra.run.smithi155.stdout: "duration": 0.0014410270000000001, 2023-08-01T19:55:28.468 INFO:teuthology.orchestra.run.smithi155.stdout: "type_data": { 2023-08-01T19:55:28.468 INFO:teuthology.orchestra.run.smithi155.stdout: "flag_point": "waiting for sub ops", 2023-08-01T19:55:28.468 INFO:teuthology.orchestra.run.smithi155.stdout: "client_info": { 2023-08-01T19:55:28.468 INFO:teuthology.orchestra.run.smithi155.stdout: "client": "client.4668", 2023-08-01T19:55:28.468 INFO:teuthology.orchestra.run.smithi155.stdout: "client_addr": "172.21.15.6:0/1709472247", 2023-08-01T19:55:28.469 INFO:teuthology.orchestra.run.smithi155.stdout: "tid": 140054 2023-08-01T19:55:28.469 INFO:teuthology.orchestra.run.smithi155.stdout: }, 2023-08-01T19:55:28.469 INFO:teuthology.orchestra.run.smithi155.stdout: "events": [ 2023-08-01T19:55:28.469 INFO:teuthology.orchestra.run.smithi155.stdout: { 2023-08-01T19:55:28.469 INFO:teuthology.orchestra.run.smithi155.stdout: "event": "initiated", 2023-08-01T19:55:28.469 INFO:teuthology.orchestra.run.smithi155.stdout: "time": "2023-08-01T19:55:28.431391+0000", 2023-08-01T19:55:28.469 INFO:teuthology.orchestra.run.smithi155.stdout: "duration": 0 2023-08-01T19:55:28.469 INFO:teuthology.orchestra.run.smithi155.stdout: }, 2023-08-01T19:55:28.470 INFO:teuthology.orchestra.run.smithi155.stdout: { 2023-08-01T19:55:28.470 INFO:teuthology.orchestra.run.smithi155.stdout: "event": "throttled", 2023-08-01T19:55:28.470 INFO:teuthology.orchestra.run.smithi155.stdout: "time": "2023-08-01T19:55:28.431391+0000", 2023-08-01T19:55:28.470 INFO:teuthology.orchestra.run.smithi155.stdout: "duration": 0 2023-08-01T19:55:28.470 INFO:teuthology.orchestra.run.smithi155.stdout: }, 2023-08-01T19:55:28.470 INFO:teuthology.orchestra.run.smithi155.stdout: { 2023-08-01T19:55:28.470 INFO:teuthology.orchestra.run.smithi155.stdout: "event": "header_read", 2023-08-01T19:55:28.470 INFO:teuthology.orchestra.run.smithi155.stdout: "time": "2023-08-01T19:55:28.431391+0000", 2023-08-01T19:55:28.471 INFO:teuthology.orchestra.run.smithi155.stdout: "duration": 4294967295.9999995 2023-08-01T19:55:28.471 INFO:teuthology.orchestra.run.smithi155.stdout: }, 2023-08-01T19:55:28.471 INFO:teuthology.orchestra.run.smithi155.stdout: { 2023-08-01T19:55:28.471 INFO:teuthology.orchestra.run.smithi155.stdout: "event": "all_read", 2023-08-01T19:55:28.471 INFO:teuthology.orchestra.run.smithi155.stdout: "time": "2023-08-01T19:55:28.431393+0000", 2023-08-01T19:55:28.471 INFO:teuthology.orchestra.run.smithi155.stdout: "duration": 2.277e-06 2023-08-01T19:55:28.471 INFO:teuthology.orchestra.run.smithi155.stdout: }, 2023-08-01T19:55:28.471 INFO:teuthology.orchestra.run.smithi155.stdout: { 2023-08-01T19:55:28.472 INFO:teuthology.orchestra.run.smithi155.stdout: "event": "dispatched", 2023-08-01T19:55:28.472 INFO:teuthology.orchestra.run.smithi155.stdout: "time": "2023-08-01T19:55:28.431399+0000", 2023-08-01T19:55:28.472 INFO:teuthology.orchestra.run.smithi155.stdout: "duration": 5.8599999999999998e-06 2023-08-01T19:55:28.472 INFO:teuthology.orchestra.run.smithi155.stdout: }, 2023-08-01T19:55:28.472 INFO:teuthology.orchestra.run.smithi155.stdout: { 2023-08-01T19:55:28.472 INFO:teuthology.orchestra.run.smithi155.stdout: "event": "queued_for_pg", 2023-08-01T19:55:28.472 INFO:teuthology.orchestra.run.smithi155.stdout: "time": "2023-08-01T19:55:28.431403+0000", 2023-08-01T19:55:28.472 INFO:teuthology.orchestra.run.smithi155.stdout: "duration": 3.9999999999999998e-06 2023-08-01T19:55:28.473 INFO:teuthology.orchestra.run.smithi155.stdout: }, 2023-08-01T19:55:28.473 INFO:teuthology.orchestra.run.smithi155.stdout: { 2023-08-01T19:55:28.473 INFO:teuthology.orchestra.run.smithi155.stdout: "event": "reached_pg", 2023-08-01T19:55:28.473 INFO:teuthology.orchestra.run.smithi155.stdout: "time": "2023-08-01T19:55:28.431425+0000", 2023-08-01T19:55:28.473 INFO:teuthology.orchestra.run.smithi155.stdout: "duration": 2.1900999999999999e-05 2023-08-01T19:55:28.473 INFO:teuthology.orchestra.run.smithi155.stdout: }, 2023-08-01T19:55:28.473 INFO:teuthology.orchestra.run.smithi155.stdout: { 2023-08-01T19:55:28.473 INFO:teuthology.orchestra.run.smithi155.stdout: "event": "started", 2023-08-01T19:55:28.474 INFO:teuthology.orchestra.run.smithi155.stdout: "time": "2023-08-01T19:55:28.431499+0000", 2023-08-01T19:55:28.474 INFO:teuthology.orchestra.run.smithi155.stdout: "duration": 7.4171000000000005e-05 2023-08-01T19:55:28.474 INFO:teuthology.orchestra.run.smithi155.stdout: }, 2023-08-01T19:55:28.474 INFO:teuthology.orchestra.run.smithi155.stdout: { 2023-08-01T19:55:28.474 INFO:teuthology.orchestra.run.smithi155.stdout: "event": "waiting for subops from 0", 2023-08-01T19:55:28.474 INFO:teuthology.orchestra.run.smithi155.stdout: "time": "2023-08-01T19:55:28.431560+0000", 2023-08-01T19:55:28.474 INFO:teuthology.orchestra.run.smithi155.stdout: "duration": 6.0556000000000001e-05 2023-08-01T19:55:28.474 INFO:teuthology.orchestra.run.smithi155.stdout: } 2023-08-01T19:55:28.475 INFO:teuthology.orchestra.run.smithi155.stdout: ] 2023-08-01T19:55:28.475 INFO:teuthology.orchestra.run.smithi155.stdout: } 2023-08-01T19:55:28.475 INFO:teuthology.orchestra.run.smithi155.stdout: }, 2023-08-01T19:55:28.475 INFO:teuthology.orchestra.run.smithi155.stdout: { 2023-08-01T19:55:28.475 INFO:teuthology.orchestra.run.smithi155.stdout: "description": "osd_op(client.4668.0:140036 5.4 5:277bb7d4:::benchmark_data_smithi006_114134_object6375:head [delete] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e47)", 2023-08-01T19:55:28.475 INFO:teuthology.orchestra.run.smithi155.stdout: "initiated_at": "2023-08-01T19:55:28.422573+0000", 2023-08-01T19:55:28.475 INFO:teuthology.orchestra.run.smithi155.stdout: "age": 0.010042811, 2023-08-01T19:55:28.476 INFO:teuthology.orchestra.run.smithi155.stdout: "duration": 0.010304182, 2023-08-01T19:55:28.476 INFO:teuthology.orchestra.run.smithi155.stdout: "type_data": { 2023-08-01T19:55:28.476 INFO:teuthology.orchestra.run.smithi155.stdout: "flag_point": "waiting for sub ops", 2023-08-01T19:55:28.476 INFO:teuthology.orchestra.run.smithi155.stdout: "client_info": { 2023-08-01T19:55:28.476 INFO:teuthology.orchestra.run.smithi155.stdout: "client": "client.4668", 2023-08-01T19:55:28.476 INFO:teuthology.orchestra.run.smithi155.stdout: "client_addr": "172.21.15.6:0/1709472247", 2023-08-01T19:55:28.476 INFO:teuthology.orchestra.run.smithi155.stdout: "tid": 140036 2023-08-01T19:55:28.476 INFO:teuthology.orchestra.run.smithi155.stdout: }, 2023-08-01T19:55:28.477 INFO:teuthology.orchestra.run.smithi155.stdout: "events": [ 2023-08-01T19:55:28.477 INFO:teuthology.orchestra.run.smithi155.stdout: { 2023-08-01T19:55:28.477 INFO:teuthology.orchestra.run.smithi155.stdout: "event": "initiated", 2023-08-01T19:55:28.477 INFO:teuthology.orchestra.run.smithi155.stdout: "time": "2023-08-01T19:55:28.422573+0000", 2023-08-01T19:55:28.477 INFO:teuthology.orchestra.run.smithi155.stdout: "duration": 0 2023-08-01T19:55:28.477 INFO:teuthology.orchestra.run.smithi155.stdout: }, 2023-08-01T19:55:28.477 INFO:teuthology.orchestra.run.smithi155.stdout: { 2023-08-01T19:55:28.477 INFO:teuthology.orchestra.run.smithi155.stdout: "event": "throttled", 2023-08-01T19:55:28.478 INFO:teuthology.orchestra.run.smithi155.stdout: "time": "2023-08-01T19:55:28.422573+0000", 2023-08-01T19:55:28.478 INFO:teuthology.orchestra.run.smithi155.stdout: "duration": 0 2023-08-01T19:55:28.478 INFO:teuthology.orchestra.run.smithi155.stdout: }, 2023-08-01T19:55:28.478 INFO:teuthology.orchestra.run.smithi155.stdout: { 2023-08-01T19:55:28.478 INFO:teuthology.orchestra.run.smithi155.stdout: "event": "header_read", 2023-08-01T19:55:28.478 INFO:teuthology.orchestra.run.smithi155.stdout: "time": "2023-08-01T19:55:28.422572+0000", 2023-08-01T19:55:28.478 INFO:teuthology.orchestra.run.smithi155.stdout: "duration": 4294967295.9999995 2023-08-01T19:55:28.478 INFO:teuthology.orchestra.run.smithi155.stdout: }, 2023-08-01T19:55:28.479 INFO:teuthology.orchestra.run.smithi155.stdout: { 2023-08-01T19:55:28.479 INFO:teuthology.orchestra.run.smithi155.stdout: "event": "all_read", 2023-08-01T19:55:28.479 INFO:teuthology.orchestra.run.smithi155.stdout: "time": "2023-08-01T19:55:28.422576+0000", 2023-08-01T19:55:28.479 INFO:teuthology.orchestra.run.smithi155.stdout: "duration": 3.4869999999999998e-06 2023-08-01T19:55:28.479 INFO:teuthology.orchestra.run.smithi155.stdout: }, 2023-08-01T19:55:28.479 INFO:teuthology.orchestra.run.smithi155.stdout: { 2023-08-01T19:55:28.479 INFO:teuthology.orchestra.run.smithi155.stdout: "event": "dispatched", 2023-08-01T19:55:28.479 INFO:teuthology.orchestra.run.smithi155.stdout: "time": "2023-08-01T19:55:28.422590+0000", 2023-08-01T19:55:28.480 INFO:teuthology.orchestra.run.smithi155.stdout: "duration": 1.4068e-05 2023-08-01T19:55:28.480 INFO:teuthology.orchestra.run.smithi155.stdout: }, 2023-08-01T19:55:28.480 INFO:teuthology.orchestra.run.smithi155.stdout: { 2023-08-01T19:55:28.480 INFO:teuthology.orchestra.run.smithi155.stdout: "event": "queued_for_pg", 2023-08-01T19:55:28.480 INFO:teuthology.orchestra.run.smithi155.stdout: "time": "2023-08-01T19:55:28.422594+0000", 2023-08-01T19:55:28.480 INFO:teuthology.orchestra.run.smithi155.stdout: "duration": 4.6249999999999998e-06 2023-08-01T19:55:28.480 INFO:teuthology.orchestra.run.smithi155.stdout: }, 2023-08-01T19:55:28.481 INFO:teuthology.orchestra.run.smithi155.stdout: { 2023-08-01T19:55:28.481 INFO:teuthology.orchestra.run.smithi155.stdout: "event": "reached_pg", 2023-08-01T19:55:28.481 INFO:teuthology.orchestra.run.smithi155.stdout: "time": "2023-08-01T19:55:28.422625+0000", 2023-08-01T19:55:28.481 INFO:teuthology.orchestra.run.smithi155.stdout: "duration": 3.0218000000000001e-05 2023-08-01T19:55:28.481 INFO:teuthology.orchestra.run.smithi155.stdout: }, 2023-08-01T19:55:28.481 INFO:teuthology.orchestra.run.smithi155.stdout: { 2023-08-01T19:55:28.481 INFO:teuthology.orchestra.run.smithi155.stdout: "event": "started", 2023-08-01T19:55:28.481 INFO:teuthology.orchestra.run.smithi155.stdout: "time": "2023-08-01T19:55:28.422742+0000", 2023-08-01T19:55:28.482 INFO:teuthology.orchestra.run.smithi155.stdout: "duration": 0.000116921 2023-08-01T19:55:28.482 INFO:teuthology.orchestra.run.smithi155.stdout: }, 2023-08-01T19:55:28.482 INFO:teuthology.orchestra.run.smithi155.stdout: { 2023-08-01T19:55:28.482 INFO:teuthology.orchestra.run.smithi155.stdout: "event": "waiting for subops from 0", 2023-08-01T19:55:28.482 INFO:teuthology.orchestra.run.smithi155.stdout: "time": "2023-08-01T19:55:28.422855+0000", 2023-08-01T19:55:28.482 INFO:teuthology.orchestra.run.smithi155.stdout: "duration": 0.000113186 2023-08-01T19:55:28.482 INFO:teuthology.orchestra.run.smithi155.stdout: }, 2023-08-01T19:55:28.482 INFO:teuthology.orchestra.run.smithi155.stdout: { 2023-08-01T19:55:28.483 INFO:teuthology.orchestra.run.smithi155.stdout: "event": "op_commit", 2023-08-01T19:55:28.483 INFO:teuthology.orchestra.run.smithi155.stdout: "time": "2023-08-01T19:55:28.426887+0000", 2023-08-01T19:55:28.483 INFO:teuthology.orchestra.run.smithi155.stdout: "duration": 0.0040320379999999999 2023-08-01T19:55:28.483 INFO:teuthology.orchestra.run.smithi155.stdout: } 2023-08-01T19:55:28.483 INFO:teuthology.orchestra.run.smithi155.stdout: ] 2023-08-01T19:55:28.483 INFO:teuthology.orchestra.run.smithi155.stdout: } 2023-08-01T19:55:28.483 INFO:teuthology.orchestra.run.smithi155.stdout: }, 2023-08-01T19:55:28.483 INFO:teuthology.orchestra.run.smithi155.stdout: { 2023-08-01T19:55:28.484 INFO:teuthology.orchestra.run.smithi155.stdout: "description": "osd_op(client.4668.0:140040 5.4 5:2aaf858c:::benchmark_data_smithi006_114134_object6379:head [delete] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e47)", 2023-08-01T19:55:28.484 INFO:teuthology.orchestra.run.smithi155.stdout: "initiated_at": "2023-08-01T19:55:28.425328+0000", 2023-08-01T19:55:28.484 INFO:teuthology.orchestra.run.smithi155.stdout: "age": 0.0072875650000000002, 2023-08-01T19:55:28.484 INFO:teuthology.orchestra.run.smithi155.stdout: "duration": 0.0075974429999999997, 2023-08-01T19:55:28.485 INFO:teuthology.orchestra.run.smithi155.stdout: "type_data": { 2023-08-01T19:55:28.485 INFO:teuthology.orchestra.run.smithi155.stdout: "flag_point": "waiting for sub ops", 2023-08-01T19:55:28.485 INFO:teuthology.orchestra.run.smithi155.stdout: "client_info": { 2023-08-01T19:55:28.485 INFO:teuthology.orchestra.run.smithi155.stdout: "client": "client.4668", 2023-08-01T19:55:28.485 INFO:teuthology.orchestra.run.smithi155.stdout: "client_addr": "172.21.15.6:0/1709472247", 2023-08-01T19:55:28.485 INFO:teuthology.orchestra.run.smithi155.stdout: "tid": 140040 2023-08-01T19:55:28.485 INFO:teuthology.orchestra.run.smithi155.stdout: }, 2023-08-01T19:55:28.486 INFO:teuthology.orchestra.run.smithi155.stdout: "events": [ 2023-08-01T19:55:28.486 INFO:teuthology.orchestra.run.smithi155.stdout: { 2023-08-01T19:55:28.486 INFO:teuthology.orchestra.run.smithi155.stdout: "event": "initiated", 2023-08-01T19:55:28.486 INFO:teuthology.orchestra.run.smithi155.stdout: "time": "2023-08-01T19:55:28.425328+0000", 2023-08-01T19:55:28.486 INFO:teuthology.orchestra.run.smithi155.stdout: "duration": 0 2023-08-01T19:55:28.486 INFO:teuthology.orchestra.run.smithi155.stdout: }, 2023-08-01T19:55:28.486 INFO:teuthology.orchestra.run.smithi155.stdout: { 2023-08-01T19:55:28.486 INFO:teuthology.orchestra.run.smithi155.stdout: "event": "throttled", 2023-08-01T19:55:28.487 INFO:teuthology.orchestra.run.smithi155.stdout: "time": "2023-08-01T19:55:28.425328+0000", 2023-08-01T19:55:28.487 INFO:teuthology.orchestra.run.smithi155.stdout: "duration": 0 2023-08-01T19:55:28.487 INFO:teuthology.orchestra.run.smithi155.stdout: }, 2023-08-01T19:55:28.487 INFO:teuthology.orchestra.run.smithi155.stdout: { 2023-08-01T19:55:28.487 INFO:teuthology.orchestra.run.smithi155.stdout: "event": "header_read", 2023-08-01T19:55:28.487 INFO:teuthology.orchestra.run.smithi155.stdout: "time": "2023-08-01T19:55:28.425327+0000", 2023-08-01T19:55:28.487 INFO:teuthology.orchestra.run.smithi155.stdout: "duration": 4294967295.999999 2023-08-01T19:55:28.487 INFO:teuthology.orchestra.run.smithi155.stdout: }, 2023-08-01T19:55:28.488 INFO:teuthology.orchestra.run.smithi155.stdout: { 2023-08-01T19:55:28.488 INFO:teuthology.orchestra.run.smithi155.stdout: "event": "all_read", 2023-08-01T19:55:28.488 INFO:teuthology.orchestra.run.smithi155.stdout: "time": "2023-08-01T19:55:28.425332+0000", 2023-08-01T19:55:28.488 INFO:teuthology.orchestra.run.smithi155.stdout: "duration": 4.8600000000000001e-06 2023-08-01T19:55:28.488 INFO:teuthology.orchestra.run.smithi155.stdout: }, 2023-08-01T19:55:28.488 INFO:teuthology.orchestra.run.smithi155.stdout: { 2023-08-01T19:55:28.488 INFO:teuthology.orchestra.run.smithi155.stdout: "event": "dispatched", 2023-08-01T19:55:28.489 INFO:teuthology.orchestra.run.smithi155.stdout: "time": "2023-08-01T19:55:28.425341+0000", 2023-08-01T19:55:28.489 INFO:teuthology.orchestra.run.smithi155.stdout: "duration": 9.2199999999999998e-06 2023-08-01T19:55:28.489 INFO:teuthology.orchestra.run.smithi155.stdout: }, 2023-08-01T19:55:28.489 INFO:teuthology.orchestra.run.smithi155.stdout: { 2023-08-01T19:55:28.489 INFO:teuthology.orchestra.run.smithi155.stdout: "event": "queued_for_pg", 2023-08-01T19:55:28.489 INFO:teuthology.orchestra.run.smithi155.stdout: "time": "2023-08-01T19:55:28.425346+0000", 2023-08-01T19:55:28.489 INFO:teuthology.orchestra.run.smithi155.stdout: "duration": 5.2390000000000002e-06 2023-08-01T19:55:28.489 INFO:teuthology.orchestra.run.smithi155.stdout: }, 2023-08-01T19:55:28.490 INFO:teuthology.orchestra.run.smithi155.stdout: { 2023-08-01T19:55:28.490 INFO:teuthology.orchestra.run.smithi155.stdout: "event": "reached_pg", 2023-08-01T19:55:28.490 INFO:teuthology.orchestra.run.smithi155.stdout: "time": "2023-08-01T19:55:28.425379+0000", 2023-08-01T19:55:28.490 INFO:teuthology.orchestra.run.smithi155.stdout: "duration": 3.3099999999999998e-05 2023-08-01T19:55:28.490 INFO:teuthology.orchestra.run.smithi155.stdout: }, 2023-08-01T19:55:28.490 INFO:teuthology.orchestra.run.smithi155.stdout: { 2023-08-01T19:55:28.490 INFO:teuthology.orchestra.run.smithi155.stdout: "event": "started", 2023-08-01T19:55:28.490 INFO:teuthology.orchestra.run.smithi155.stdout: "time": "2023-08-01T19:55:28.425502+0000", 2023-08-01T19:55:28.491 INFO:teuthology.orchestra.run.smithi155.stdout: "duration": 0.00012244299999999999 2023-08-01T19:55:28.491 INFO:teuthology.orchestra.run.smithi155.stdout: }, 2023-08-01T19:55:28.491 INFO:teuthology.orchestra.run.smithi155.stdout: { 2023-08-01T19:55:28.491 INFO:teuthology.orchestra.run.smithi155.stdout: "event": "waiting for subops from 0", 2023-08-01T19:55:28.491 INFO:teuthology.orchestra.run.smithi155.stdout: "time": "2023-08-01T19:55:28.425616+0000", 2023-08-01T19:55:28.491 INFO:teuthology.orchestra.run.smithi155.stdout: "duration": 0.000113941 2023-08-01T19:55:28.491 INFO:teuthology.orchestra.run.smithi155.stdout: } 2023-08-01T19:55:28.491 INFO:teuthology.orchestra.run.smithi155.stdout: ] 2023-08-01T19:55:28.492 INFO:teuthology.orchestra.run.smithi155.stdout: } 2023-08-01T19:55:28.492 INFO:teuthology.orchestra.run.smithi155.stdout: }, 2023-08-01T19:55:28.492 INFO:teuthology.orchestra.run.smithi155.stdout: { 2023-08-01T19:55:28.492 INFO:teuthology.orchestra.run.smithi155.stdout: "description": "osd_op(client.4668.0:140044 5.e 5:7012c513:::benchmark_data_smithi006_114134_object6383:head [delete] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e47)", 2023-08-01T19:55:28.492 INFO:teuthology.orchestra.run.smithi155.stdout: "initiated_at": "2023-08-01T19:55:28.426962+0000", 2023-08-01T19:55:28.492 INFO:teuthology.orchestra.run.smithi155.stdout: "age": 0.005653557, 2023-08-01T19:55:28.492 INFO:teuthology.orchestra.run.smithi155.stdout: "duration": 0.0060075140000000003, 2023-08-01T19:55:28.493 INFO:teuthology.orchestra.run.smithi155.stdout: "type_data": { 2023-08-01T19:55:28.493 INFO:teuthology.orchestra.run.smithi155.stdout: "flag_point": "waiting for sub ops", 2023-08-01T19:55:28.493 INFO:teuthology.orchestra.run.smithi155.stdout: "client_info": { 2023-08-01T19:55:28.493 INFO:teuthology.orchestra.run.smithi155.stdout: "client": "client.4668", 2023-08-01T19:55:28.493 INFO:teuthology.orchestra.run.smithi155.stdout: "client_addr": "172.21.15.6:0/1709472247", 2023-08-01T19:55:28.493 INFO:teuthology.orchestra.run.smithi155.stdout: "tid": 140044 2023-08-01T19:55:28.493 INFO:teuthology.orchestra.run.smithi155.stdout: }, 2023-08-01T19:55:28.493 INFO:teuthology.orchestra.run.smithi155.stdout: "events": [ 2023-08-01T19:55:28.494 INFO:teuthology.orchestra.run.smithi155.stdout: { 2023-08-01T19:55:28.494 INFO:teuthology.orchestra.run.smithi155.stdout: "event": "initiated", 2023-08-01T19:55:28.494 INFO:teuthology.orchestra.run.smithi155.stdout: "time": "2023-08-01T19:55:28.426962+0000", 2023-08-01T19:55:28.494 INFO:teuthology.orchestra.run.smithi155.stdout: "duration": 0 2023-08-01T19:55:28.494 INFO:teuthology.orchestra.run.smithi155.stdout: }, 2023-08-01T19:55:28.494 INFO:teuthology.orchestra.run.smithi155.stdout: { 2023-08-01T19:55:28.494 INFO:teuthology.orchestra.run.smithi155.stdout: "event": "throttled", 2023-08-01T19:55:28.494 INFO:teuthology.orchestra.run.smithi155.stdout: "time": "2023-08-01T19:55:28.426962+0000", 2023-08-01T19:55:28.495 INFO:teuthology.orchestra.run.smithi155.stdout: "duration": 0 2023-08-01T19:55:28.495 INFO:teuthology.orchestra.run.smithi155.stdout: }, 2023-08-01T19:55:28.495 INFO:teuthology.orchestra.run.smithi155.stdout: { 2023-08-01T19:55:28.495 INFO:teuthology.orchestra.run.smithi155.stdout: "event": "header_read", 2023-08-01T19:55:28.495 INFO:teuthology.orchestra.run.smithi155.stdout: "time": "2023-08-01T19:55:28.426961+0000", 2023-08-01T19:55:28.495 INFO:teuthology.orchestra.run.smithi155.stdout: "duration": 4294967295.999999 2023-08-01T19:55:28.495 INFO:teuthology.orchestra.run.smithi155.stdout: }, 2023-08-01T19:55:28.495 INFO:teuthology.orchestra.run.smithi155.stdout: { 2023-08-01T19:55:28.496 INFO:teuthology.orchestra.run.smithi155.stdout: "event": "all_read", 2023-08-01T19:55:28.496 INFO:teuthology.orchestra.run.smithi155.stdout: "time": "2023-08-01T19:55:28.426966+0000", 2023-08-01T19:55:28.496 INFO:teuthology.orchestra.run.smithi155.stdout: "duration": 4.7829999999999998e-06 2023-08-01T19:55:28.496 INFO:teuthology.orchestra.run.smithi155.stdout: }, 2023-08-01T19:55:28.496 INFO:teuthology.orchestra.run.smithi155.stdout: { 2023-08-01T19:55:28.496 INFO:teuthology.orchestra.run.smithi155.stdout: "event": "dispatched", 2023-08-01T19:55:28.496 INFO:teuthology.orchestra.run.smithi155.stdout: "time": "2023-08-01T19:55:28.426979+0000", 2023-08-01T19:55:28.497 INFO:teuthology.orchestra.run.smithi155.stdout: "duration": 1.2806000000000001e-05 2023-08-01T19:55:28.497 INFO:teuthology.orchestra.run.smithi155.stdout: }, 2023-08-01T19:55:28.497 INFO:teuthology.orchestra.run.smithi155.stdout: { 2023-08-01T19:55:28.497 INFO:teuthology.orchestra.run.smithi155.stdout: "event": "queued_for_pg", 2023-08-01T19:55:28.497 INFO:teuthology.orchestra.run.smithi155.stdout: "time": "2023-08-01T19:55:28.426986+0000", 2023-08-01T19:55:28.497 INFO:teuthology.orchestra.run.smithi155.stdout: "duration": 7.0929999999999997e-06 2023-08-01T19:55:28.497 INFO:teuthology.orchestra.run.smithi155.stdout: }, 2023-08-01T19:55:28.497 INFO:teuthology.orchestra.run.smithi155.stdout: { 2023-08-01T19:55:28.498 INFO:teuthology.orchestra.run.smithi155.stdout: "event": "reached_pg", 2023-08-01T19:55:28.498 INFO:teuthology.orchestra.run.smithi155.stdout: "time": "2023-08-01T19:55:28.427026+0000", 2023-08-01T19:55:28.498 INFO:teuthology.orchestra.run.smithi155.stdout: "duration": 3.9944999999999998e-05 2023-08-01T19:55:28.498 INFO:teuthology.orchestra.run.smithi155.stdout: }, 2023-08-01T19:55:28.498 INFO:teuthology.orchestra.run.smithi155.stdout: { 2023-08-01T19:55:28.498 INFO:teuthology.orchestra.run.smithi155.stdout: "event": "started", 2023-08-01T19:55:28.498 INFO:teuthology.orchestra.run.smithi155.stdout: "time": "2023-08-01T19:55:28.427158+0000", 2023-08-01T19:55:28.498 INFO:teuthology.orchestra.run.smithi155.stdout: "duration": 0.000132304 2023-08-01T19:55:28.499 INFO:teuthology.orchestra.run.smithi155.stdout: }, 2023-08-01T19:55:28.499 INFO:teuthology.orchestra.run.smithi155.stdout: { 2023-08-01T19:55:28.499 INFO:teuthology.orchestra.run.smithi155.stdout: "event": "waiting for subops from 0", 2023-08-01T19:55:28.499 INFO:teuthology.orchestra.run.smithi155.stdout: "time": "2023-08-01T19:55:28.427290+0000", 2023-08-01T19:55:28.499 INFO:teuthology.orchestra.run.smithi155.stdout: "duration": 0.00013162300000000001 2023-08-01T19:55:28.499 INFO:teuthology.orchestra.run.smithi155.stdout: } 2023-08-01T19:55:28.499 INFO:teuthology.orchestra.run.smithi155.stdout: ] 2023-08-01T19:55:28.499 INFO:teuthology.orchestra.run.smithi155.stdout: } 2023-08-01T19:55:28.500 INFO:teuthology.orchestra.run.smithi155.stdout: } 2023-08-01T19:55:28.500 INFO:teuthology.orchestra.run.smithi155.stdout: ], 2023-08-01T19:55:28.500 INFO:teuthology.orchestra.run.smithi155.stdout: "num_ops": 8 2023-08-01T19:55:28.500 INFO:teuthology.orchestra.run.smithi155.stdout:} 2023-08-01T19:55:28.501 INFO:teuthology.orchestra.run.smithi006.stdout:osd.2: {} 2023-08-01T19:55:28.502 DEBUG:teuthology.orchestra.run.smithi155:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 30 ceph --cluster ceph --admin-daemon /var/run/ceph/ceph-osd.2.asok dump_blocked_ops 2023-08-01T19:55:28.502 INFO:teuthology.orchestra.run.smithi006.stderr:osd.0: osd_enable_op_tracker = 'false' 2023-08-01T19:55:28.503 INFO:teuthology.orchestra.run.smithi006.stderr:osd.1: osd_enable_op_tracker = 'false' 2023-08-01T19:55:28.503 INFO:teuthology.orchestra.run.smithi006.stderr:osd.2: osd_enable_op_tracker = 'false' 2023-08-01T19:55:28.503 INFO:tasks.ceph.osd.0.smithi008.stderr:2023-08-01T19:55:28.499+0000 7f16a58f4700 -1 received signal: Hangup from /usr/bin/python3 /bin/daemon-helper kill ceph-osd -f --cluster ceph -i 0 (PID: 111179) UID: 0 2023-08-01T19:55:28.602 INFO:tasks.ceph.osd.2.smithi155.stderr:2023-08-01T19:55:28.600+0000 7faa5c6ac700 -1 received signal: Hangup from /usr/bin/python3 /bin/daemon-helper kill ceph-osd -f --cluster ceph -i 2 (PID: 111337) UID: 0 2023-08-01T19:55:28.703 INFO:tasks.ceph.osd.1.smithi101.stderr:2023-08-01T19:55:28.701+0000 7fb0cb7f6700 -1 received signal: Hangup from /usr/bin/python3 /bin/daemon-helper kill ceph-osd -f --cluster ceph -i 1 (PID: 111141) UID: 0 2023-08-01T19:55:28.703 INFO:teuthology.orchestra.run.smithi155.stdout:ERROR: (22) Invalid argument 2023-08-01T19:55:28.704 INFO:teuthology.orchestra.run.smithi155.stdout:op_tracker tracking is not enabled now, so no ops are tracked currently, even those get stuck. Please enable "osd_enable_op_tracker", and the tracker will start to track new ops received afterwards. 2023-08-01T19:55:28.715 DEBUG:teuthology.orchestra.run.smithi155:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 30 ceph --cluster ceph --admin-daemon /var/run/ceph/ceph-osd.2.asok dump_historic_ops 2023-08-01T19:55:28.803 INFO:tasks.ceph.osd.0.smithi008.stderr:2023-08-01T19:55:28.802+0000 7f16a58f4700 -1 received signal: Hangup from /usr/bin/python3 /bin/daemon-helper kill ceph-osd -f --cluster ceph -i 0 (PID: 111179) UID: 0 2023-08-01T19:55:28.904 INFO:tasks.ceph.osd.2.smithi155.stderr:2023-08-01T19:55:28.903+0000 7faa5c6ac700 -1 received signal: Hangup from /usr/bin/python3 /bin/daemon-helper kill ceph-osd -f --cluster ceph -i 2 (PID: 111337) UID: 0 2023-08-01T19:55:28.919 INFO:teuthology.orchestra.run.smithi155.stdout:ERROR: (22) Invalid argument 2023-08-01T19:55:28.919 INFO:teuthology.orchestra.run.smithi155.stdout:op_tracker tracking is not enabled now, so no ops are tracked currently, even those get stuck. Please enable "osd_enable_op_tracker", and the tracker will start to track new ops received afterwards. 2023-08-01T19:55:28.932 DEBUG:teuthology.orchestra.run.smithi008:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 30 ceph --cluster ceph --admin-daemon /var/run/ceph/ceph-osd.0.asok dump_ops_in_flight 2023-08-01T19:55:29.006 INFO:tasks.ceph.osd.0.smithi008.stderr:2023-08-01T19:55:29.004+0000 7f16a58f4700 -1 received signal: Hangup from /usr/bin/python3 /bin/daemon-helper kill ceph-osd -f --cluster ceph -i 0 (PID: 111179) UID: 0 2023-08-01T19:55:29.105 INFO:tasks.ceph.osd.1.smithi101.stderr:2023-08-01T19:55:29.104+0000 7fb0cb7f6700 -1 received signal: Hangup from /usr/bin/python3 /bin/daemon-helper kill ceph-osd -f --cluster ceph -i 1 (PID: 111141) UID: 0 2023-08-01T19:55:29.114 INFO:teuthology.orchestra.run.smithi008.stdout:ERROR: (22) Invalid argument 2023-08-01T19:55:29.114 INFO:teuthology.orchestra.run.smithi008.stdout:op_tracker tracking is not enabled now, so no ops are tracked currently, even those get stuck. Please enable "osd_enable_op_tracker", and the tracker will start to track new ops received afterwards. 2023-08-01T19:55:29.129 DEBUG:teuthology.orchestra.run.smithi008:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 30 ceph --cluster ceph --admin-daemon /var/run/ceph/ceph-osd.0.asok dump_blocked_ops 2023-08-01T19:55:29.212 INFO:tasks.ceph.osd.0.smithi008.stderr:2023-08-01T19:55:29.211+0000 7f16a58f4700 -1 received signal: Hangup from /usr/bin/python3 /bin/daemon-helper kill ceph-osd -f --cluster ceph -i 0 (PID: 111179) UID: 0 2023-08-01T19:55:29.308 INFO:tasks.ceph.osd.0.smithi008.stderr:2023-08-01T19:55:29.306+0000 7f16a58f4700 -1 received signal: Hangup from /usr/bin/python3 /bin/daemon-helper kill ceph-osd -f --cluster ceph -i 0 (PID: 111179) UID: 0 2023-08-01T19:55:29.371 INFO:teuthology.orchestra.run.smithi008.stdout:ERROR: (22) Invalid argument 2023-08-01T19:55:29.371 INFO:teuthology.orchestra.run.smithi008.stdout:op_tracker tracking is not enabled now, so no ops are tracked currently, even those get stuck. Please enable "osd_enable_op_tracker", and the tracker will start to track new ops received afterwards. 2023-08-01T19:55:29.385 DEBUG:teuthology.orchestra.run.smithi008:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 30 ceph --cluster ceph --admin-daemon /var/run/ceph/ceph-osd.0.asok dump_historic_ops 2023-08-01T19:55:29.409 INFO:tasks.ceph.osd.1.smithi101.stderr:2023-08-01T19:55:29.407+0000 7fb0cb7f6700 -1 received signal: Hangup from /usr/bin/python3 /bin/daemon-helper kill ceph-osd -f --cluster ceph -i 1 (PID: 111141) UID: 0 2023-08-01T19:55:29.510 INFO:tasks.ceph.osd.0.smithi008.stderr:2023-08-01T19:55:29.508+0000 7f16a58f4700 -1 received signal: Hangup from /usr/bin/python3 /bin/daemon-helper kill ceph-osd -f --cluster ceph -i 0 (PID: 111179) UID: 0 2023-08-01T19:55:29.609 INFO:teuthology.orchestra.run.smithi008.stdout:ERROR: (22) Invalid argument 2023-08-01T19:55:29.609 INFO:teuthology.orchestra.run.smithi008.stdout:op_tracker tracking is not enabled now, so no ops are tracked currently, even those get stuck. Please enable "osd_enable_op_tracker", and the tracker will start to track new ops received afterwards. 2023-08-01T19:55:29.611 INFO:tasks.ceph.osd.2.smithi155.stderr:2023-08-01T19:55:29.609+0000 7faa5c6ac700 -1 received signal: Hangup from /usr/bin/python3 /bin/daemon-helper kill ceph-osd -f --cluster ceph -i 2 (PID: 111337) UID: 0 2023-08-01T19:55:29.623 DEBUG:teuthology.orchestra.run.smithi101:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 30 ceph --cluster ceph --admin-daemon /var/run/ceph/ceph-osd.1.asok dump_ops_in_flight 2023-08-01T19:55:29.712 INFO:tasks.ceph.osd.1.smithi101.stderr:2023-08-01T19:55:29.711+0000 7fb0cb7f6700 -1 received signal: Hangup from /usr/bin/python3 /bin/daemon-helper kill ceph-osd -f --cluster ceph -i 1 (PID: 111141) UID: 0 2023-08-01T19:55:29.787 INFO:teuthology.orchestra.run.smithi101.stdout:ERROR: (22) Invalid argument 2023-08-01T19:55:29.788 INFO:teuthology.orchestra.run.smithi101.stdout:op_tracker tracking is not enabled now, so no ops are tracked currently, even those get stuck. Please enable "osd_enable_op_tracker", and the tracker will start to track new ops received afterwards. 2023-08-01T19:55:29.800 DEBUG:teuthology.orchestra.run.smithi101:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 30 ceph --cluster ceph --admin-daemon /var/run/ceph/ceph-osd.1.asok dump_blocked_ops 2023-08-01T19:55:29.813 INFO:tasks.ceph.osd.2.smithi155.stderr:2023-08-01T19:55:29.811+0000 7faa5c6ac700 -1 received signal: Hangup from /usr/bin/python3 /bin/daemon-helper kill ceph-osd -f --cluster ceph -i 2 (PID: 111337) UID: 0 2023-08-01T19:55:29.886 DEBUG:teuthology.orchestra.run.smithi006:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 120 ceph --cluster ceph osd unset nodeep-scrub 2023-08-01T19:55:29.914 INFO:tasks.ceph.osd.1.smithi101.stderr:2023-08-01T19:55:29.912+0000 7fb0cb7f6700 -1 received signal: Hangup from /usr/bin/python3 /bin/daemon-helper kill ceph-osd -f --cluster ceph -i 1 (PID: 111141) UID: 0 2023-08-01T19:55:29.997 INFO:teuthology.orchestra.run.smithi101.stdout:ERROR: (22) Invalid argument 2023-08-01T19:55:29.997 INFO:teuthology.orchestra.run.smithi101.stdout:op_tracker tracking is not enabled now, so no ops are tracked currently, even those get stuck. Please enable "osd_enable_op_tracker", and the tracker will start to track new ops received afterwards. 2023-08-01T19:55:30.012 DEBUG:teuthology.orchestra.run.smithi101:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 30 ceph --cluster ceph --admin-daemon /var/run/ceph/ceph-osd.1.asok dump_historic_ops 2023-08-01T19:55:30.015 INFO:tasks.ceph.osd.0.smithi008.stderr:2023-08-01T19:55:30.013+0000 7f16a58f4700 -1 received signal: Hangup from /usr/bin/python3 /bin/daemon-helper kill ceph-osd -f --cluster ceph -i 0 (PID: 111179) UID: 0 2023-08-01T19:55:30.115 INFO:tasks.ceph.osd.1.smithi101.stderr:2023-08-01T19:55:30.114+0000 7fb0cb7f6700 -1 received signal: Hangup from /usr/bin/python3 /bin/daemon-helper kill ceph-osd -f --cluster ceph -i 1 (PID: 111141) UID: 0 2023-08-01T19:55:30.200 INFO:teuthology.orchestra.run.smithi101.stdout:ERROR: (22) Invalid argument 2023-08-01T19:55:30.200 INFO:teuthology.orchestra.run.smithi101.stdout:op_tracker tracking is not enabled now, so no ops are tracked currently, even those get stuck. Please enable "osd_enable_op_tracker", and the tracker will start to track new ops received afterwards. 2023-08-01T19:55:30.212 DEBUG:teuthology.orchestra.run.smithi155:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 30 ceph --cluster ceph --admin-daemon /var/run/ceph/ceph-osd.2.asok dump_ops_in_flight 2023-08-01T19:55:30.216 INFO:tasks.ceph.osd.0.smithi008.stderr:2023-08-01T19:55:30.214+0000 7f16a58f4700 -1 received signal: Hangup from /usr/bin/python3 /bin/daemon-helper kill ceph-osd -f --cluster ceph -i 0 (PID: 111179) UID: 0 2023-08-01T19:55:30.318 INFO:tasks.ceph.osd.0.smithi008.stderr:2023-08-01T19:55:30.315+0000 7f16a58f4700 -1 received signal: Hangup from /usr/bin/python3 /bin/daemon-helper kill ceph-osd -f --cluster ceph -i 0 (PID: 111179) UID: 0 2023-08-01T19:55:30.374 INFO:teuthology.orchestra.run.smithi155.stdout:ERROR: (22) Invalid argument 2023-08-01T19:55:30.374 INFO:teuthology.orchestra.run.smithi155.stdout:op_tracker tracking is not enabled now, so no ops are tracked currently, even those get stuck. Please enable "osd_enable_op_tracker", and the tracker will start to track new ops received afterwards. 2023-08-01T19:55:30.388 DEBUG:teuthology.orchestra.run.smithi155:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 30 ceph --cluster ceph --admin-daemon /var/run/ceph/ceph-osd.2.asok dump_blocked_ops 2023-08-01T19:55:30.418 INFO:tasks.ceph.osd.0.smithi008.stderr:2023-08-01T19:55:30.416+0000 7f16a58f4700 -1 received signal: Hangup from /usr/bin/python3 /bin/daemon-helper kill ceph-osd -f --cluster ceph -i 0 (PID: 111179) UID: 0 2023-08-01T19:55:30.504 DEBUG:teuthology.orchestra.run.smithi006:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 120 ceph --cluster ceph -- tell 'osd.*' injectargs --osd_enable_op_tracker=true 2023-08-01T19:55:30.519 INFO:tasks.ceph.osd.1.smithi101.stderr:2023-08-01T19:55:30.517+0000 7fb0cb7f6700 -1 received signal: Hangup from /usr/bin/python3 /bin/daemon-helper kill ceph-osd -f --cluster ceph -i 1 (PID: 111141) UID: 0 2023-08-01T19:55:30.543 INFO:teuthology.orchestra.run.smithi155.stdout:ERROR: (22) Invalid argument 2023-08-01T19:55:30.543 INFO:teuthology.orchestra.run.smithi155.stdout:op_tracker tracking is not enabled now, so no ops are tracked currently, even those get stuck. Please enable "osd_enable_op_tracker", and the tracker will start to track new ops received afterwards. 2023-08-01T19:55:30.557 DEBUG:teuthology.orchestra.run.smithi155:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 30 ceph --cluster ceph --admin-daemon /var/run/ceph/ceph-osd.2.asok dump_historic_ops 2023-08-01T19:55:30.620 INFO:tasks.ceph.osd.1.smithi101.stderr:2023-08-01T19:55:30.618+0000 7fb0cb7f6700 -1 received signal: Hangup from /usr/bin/python3 /bin/daemon-helper kill ceph-osd -f --cluster ceph -i 1 (PID: 111141) UID: 0 2023-08-01T19:55:30.649 INFO:teuthology.orchestra.run.smithi006.stdout:osd.0: {} 2023-08-01T19:55:30.668 INFO:teuthology.orchestra.run.smithi006.stdout:osd.1: {} 2023-08-01T19:55:30.687 INFO:teuthology.orchestra.run.smithi006.stdout:osd.2: {} 2023-08-01T19:55:30.688 INFO:teuthology.orchestra.run.smithi006.stderr:osd.0: osd_enable_op_tracker = 'true' 2023-08-01T19:55:30.689 INFO:teuthology.orchestra.run.smithi006.stderr:osd.1: osd_enable_op_tracker = 'true' 2023-08-01T19:55:30.689 INFO:teuthology.orchestra.run.smithi006.stderr:osd.2: osd_enable_op_tracker = 'true' 2023-08-01T19:55:30.721 INFO:tasks.ceph.osd.2.smithi155.stderr:2023-08-01T19:55:30.719+0000 7faa5c6ac700 -1 received signal: Hangup from /usr/bin/python3 /bin/daemon-helper kill ceph-osd -f --cluster ceph -i 2 (PID: 111337) UID: 0 2023-08-01T19:55:30.735 INFO:teuthology.orchestra.run.smithi155.stdout:{ 2023-08-01T19:55:30.735 INFO:teuthology.orchestra.run.smithi155.stdout: "size": 20, 2023-08-01T19:55:30.735 INFO:teuthology.orchestra.run.smithi155.stdout: "duration": 600, 2023-08-01T19:55:30.735 INFO:teuthology.orchestra.run.smithi155.stdout: "ops": [ 2023-08-01T19:55:30.735 INFO:teuthology.orchestra.run.smithi155.stdout: { 2023-08-01T19:55:30.735 INFO:teuthology.orchestra.run.smithi155.stdout: "description": "osd_op(client.4668.0:73454 5.8 5:15596b2f:::benchmark_data_smithi006_114134_object73453:head [set-alloc-hint object_size 65536 write_size 65536,write 0~65536] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e31)", 2023-08-01T19:55:30.736 INFO:teuthology.orchestra.run.smithi155.stdout: "initiated_at": "2023-08-01T19:54:51.460020+0000", 2023-08-01T19:55:30.736 INFO:teuthology.orchestra.run.smithi155.stdout: "age": 39.271996653000002, 2023-08-01T19:55:30.736 INFO:teuthology.orchestra.run.smithi155.stdout: "duration": 0.022889436999999999, 2023-08-01T19:55:30.736 INFO:teuthology.orchestra.run.smithi155.stdout: "type_data": { 2023-08-01T19:55:30.736 INFO:teuthology.orchestra.run.smithi155.stdout: "flag_point": "commit sent; apply or cleanup", 2023-08-01T19:55:30.736 INFO:teuthology.orchestra.run.smithi155.stdout: "client_info": { 2023-08-01T19:55:30.736 INFO:teuthology.orchestra.run.smithi155.stdout: "client": "client.4668", 2023-08-01T19:55:30.736 INFO:teuthology.orchestra.run.smithi155.stdout: "client_addr": "172.21.15.6:0/1709472247", 2023-08-01T19:55:30.737 INFO:teuthology.orchestra.run.smithi155.stdout: "tid": 73454 2023-08-01T19:55:30.737 INFO:teuthology.orchestra.run.smithi155.stdout: }, 2023-08-01T19:55:30.737 INFO:teuthology.orchestra.run.smithi155.stdout: "events": [ 2023-08-01T19:55:30.737 INFO:teuthology.orchestra.run.smithi155.stdout: { 2023-08-01T19:55:30.737 INFO:teuthology.orchestra.run.smithi155.stdout: "event": "initiated", 2023-08-01T19:55:30.737 INFO:teuthology.orchestra.run.smithi155.stdout: "time": "2023-08-01T19:54:51.460020+0000", 2023-08-01T19:55:30.737 INFO:teuthology.orchestra.run.smithi155.stdout: "duration": 0 2023-08-01T19:55:30.738 INFO:teuthology.orchestra.run.smithi155.stdout: }, 2023-08-01T19:55:30.738 INFO:teuthology.orchestra.run.smithi155.stdout: { 2023-08-01T19:55:30.738 INFO:teuthology.orchestra.run.smithi155.stdout: "event": "throttled", 2023-08-01T19:55:30.738 INFO:teuthology.orchestra.run.smithi155.stdout: "time": "2023-08-01T19:54:51.460020+0000", 2023-08-01T19:55:30.738 INFO:teuthology.orchestra.run.smithi155.stdout: "duration": 0 2023-08-01T19:55:30.738 INFO:teuthology.orchestra.run.smithi155.stdout: }, 2023-08-01T19:55:30.738 INFO:teuthology.orchestra.run.smithi155.stdout: { 2023-08-01T19:55:30.738 INFO:teuthology.orchestra.run.smithi155.stdout: "event": "header_read", 2023-08-01T19:55:30.739 INFO:teuthology.orchestra.run.smithi155.stdout: "time": "2023-08-01T19:54:51.460019+0000", 2023-08-01T19:55:30.739 INFO:teuthology.orchestra.run.smithi155.stdout: "duration": 4294967295.9999995 2023-08-01T19:55:30.739 INFO:teuthology.orchestra.run.smithi155.stdout: }, 2023-08-01T19:55:30.739 INFO:teuthology.orchestra.run.smithi155.stdout: { 2023-08-01T19:55:30.739 INFO:teuthology.orchestra.run.smithi155.stdout: "event": "all_read", 2023-08-01T19:55:30.739 INFO:teuthology.orchestra.run.smithi155.stdout: "time": "2023-08-01T19:54:51.460051+0000", 2023-08-01T19:55:30.739 INFO:teuthology.orchestra.run.smithi155.stdout: "duration": 3.1736000000000002e-05 2023-08-01T19:55:30.739 INFO:teuthology.orchestra.run.smithi155.stdout: }, 2023-08-01T19:55:30.740 INFO:teuthology.orchestra.run.smithi155.stdout: { 2023-08-01T19:55:30.740 INFO:teuthology.orchestra.run.smithi155.stdout: "event": "dispatched", 2023-08-01T19:55:30.740 INFO:teuthology.orchestra.run.smithi155.stdout: "time": "2023-08-01T19:54:51.460058+0000", 2023-08-01T19:55:30.740 INFO:teuthology.orchestra.run.smithi155.stdout: "duration": 7.3869999999999997e-06 2023-08-01T19:55:30.740 INFO:teuthology.orchestra.run.smithi155.stdout: }, 2023-08-01T19:55:30.740 INFO:teuthology.orchestra.run.smithi155.stdout: { 2023-08-01T19:55:30.740 INFO:teuthology.orchestra.run.smithi155.stdout: "event": "queued_for_pg", 2023-08-01T19:55:30.740 INFO:teuthology.orchestra.run.smithi155.stdout: "time": "2023-08-01T19:54:51.460062+0000", 2023-08-01T19:55:30.741 INFO:teuthology.orchestra.run.smithi155.stdout: "duration": 4.352e-06 2023-08-01T19:55:30.741 INFO:teuthology.orchestra.run.smithi155.stdout: }, 2023-08-01T19:55:30.741 INFO:teuthology.orchestra.run.smithi155.stdout: { 2023-08-01T19:55:30.741 INFO:teuthology.orchestra.run.smithi155.stdout: "event": "reached_pg", 2023-08-01T19:55:30.741 INFO:teuthology.orchestra.run.smithi155.stdout: "time": "2023-08-01T19:54:51.460101+0000", 2023-08-01T19:55:30.741 INFO:teuthology.orchestra.run.smithi155.stdout: "duration": 3.8705000000000003e-05 2023-08-01T19:55:30.741 INFO:teuthology.orchestra.run.smithi155.stdout: }, 2023-08-01T19:55:30.741 INFO:teuthology.orchestra.run.smithi155.stdout: { 2023-08-01T19:55:30.742 INFO:teuthology.orchestra.run.smithi155.stdout: "event": "started", 2023-08-01T19:55:30.742 INFO:teuthology.orchestra.run.smithi155.stdout: "time": "2023-08-01T19:54:51.460236+0000", 2023-08-01T19:55:30.742 INFO:teuthology.orchestra.run.smithi155.stdout: "duration": 0.00013463599999999999 2023-08-01T19:55:30.742 INFO:teuthology.orchestra.run.smithi155.stdout: }, 2023-08-01T19:55:30.742 INFO:teuthology.orchestra.run.smithi155.stdout: { 2023-08-01T19:55:30.742 INFO:teuthology.orchestra.run.smithi155.stdout: "event": "waiting for subops from 0", 2023-08-01T19:55:30.742 INFO:teuthology.orchestra.run.smithi155.stdout: "time": "2023-08-01T19:54:51.460391+0000", 2023-08-01T19:55:30.743 INFO:teuthology.orchestra.run.smithi155.stdout: "duration": 0.00015525000000000001 2023-08-01T19:55:30.743 INFO:teuthology.orchestra.run.smithi155.stdout: }, 2023-08-01T19:55:30.743 INFO:teuthology.orchestra.run.smithi155.stdout: { 2023-08-01T19:55:30.743 INFO:teuthology.orchestra.run.smithi155.stdout: "event": "sub_op_commit_rec", 2023-08-01T19:55:30.743 INFO:teuthology.orchestra.run.smithi155.stdout: "time": "2023-08-01T19:54:51.468393+0000", 2023-08-01T19:55:30.743 INFO:teuthology.orchestra.run.smithi155.stdout: "duration": 0.00800208 2023-08-01T19:55:30.743 INFO:teuthology.orchestra.run.smithi155.stdout: }, 2023-08-01T19:55:30.743 INFO:teuthology.orchestra.run.smithi155.stdout: { 2023-08-01T19:55:30.744 INFO:teuthology.orchestra.run.smithi155.stdout: "event": "op_commit", 2023-08-01T19:55:30.744 INFO:teuthology.orchestra.run.smithi155.stdout: "time": "2023-08-01T19:54:51.482815+0000", 2023-08-01T19:55:30.744 INFO:teuthology.orchestra.run.smithi155.stdout: "duration": 0.01442148 2023-08-01T19:55:30.744 INFO:teuthology.orchestra.run.smithi155.stdout: }, 2023-08-01T19:55:30.744 INFO:teuthology.orchestra.run.smithi155.stdout: { 2023-08-01T19:55:30.744 INFO:teuthology.orchestra.run.smithi155.stdout: "event": "commit_sent", 2023-08-01T19:55:30.744 INFO:teuthology.orchestra.run.smithi155.stdout: "time": "2023-08-01T19:54:51.482866+0000", 2023-08-01T19:55:30.745 INFO:teuthology.orchestra.run.smithi155.stdout: "duration": 5.1842999999999998e-05 2023-08-01T19:55:30.745 INFO:teuthology.orchestra.run.smithi155.stdout: }, 2023-08-01T19:55:30.745 INFO:teuthology.orchestra.run.smithi155.stdout: { 2023-08-01T19:55:30.745 INFO:teuthology.orchestra.run.smithi155.stdout: "event": "done", 2023-08-01T19:55:30.745 INFO:teuthology.orchestra.run.smithi155.stdout: "time": "2023-08-01T19:54:51.482909+0000", 2023-08-01T19:55:30.745 INFO:teuthology.orchestra.run.smithi155.stdout: "duration": 4.2663000000000001e-05 2023-08-01T19:55:30.745 INFO:teuthology.orchestra.run.smithi155.stdout: } 2023-08-01T19:55:30.745 INFO:teuthology.orchestra.run.smithi155.stdout: ] 2023-08-01T19:55:30.746 INFO:teuthology.orchestra.run.smithi155.stdout: } 2023-08-01T19:55:30.746 INFO:teuthology.orchestra.run.smithi155.stdout: }, 2023-08-01T19:55:30.746 INFO:teuthology.orchestra.run.smithi155.stdout: { 2023-08-01T19:55:30.746 INFO:teuthology.orchestra.run.smithi155.stdout: "description": "osd_op(client.4668.0:73455 5.b 5:de51121e:::benchmark_data_smithi006_114134_object73454:head [set-alloc-hint object_size 65536 write_size 65536,write 0~65536] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e31)", 2023-08-01T19:55:30.746 INFO:teuthology.orchestra.run.smithi155.stdout: "initiated_at": "2023-08-01T19:54:51.460078+0000", 2023-08-01T19:55:30.746 INFO:teuthology.orchestra.run.smithi155.stdout: "age": 39.271938679000002, 2023-08-01T19:55:30.746 INFO:teuthology.orchestra.run.smithi155.stdout: "duration": 0.022689121999999999, 2023-08-01T19:55:30.747 INFO:teuthology.orchestra.run.smithi155.stdout: "type_data": { 2023-08-01T19:55:30.747 INFO:teuthology.orchestra.run.smithi155.stdout: "flag_point": "commit sent; apply or cleanup", 2023-08-01T19:55:30.747 INFO:teuthology.orchestra.run.smithi155.stdout: "client_info": { 2023-08-01T19:55:30.747 INFO:teuthology.orchestra.run.smithi155.stdout: "client": "client.4668", 2023-08-01T19:55:30.747 INFO:teuthology.orchestra.run.smithi155.stdout: "client_addr": "172.21.15.6:0/1709472247", 2023-08-01T19:55:30.747 INFO:teuthology.orchestra.run.smithi155.stdout: "tid": 73455 2023-08-01T19:55:30.747 INFO:teuthology.orchestra.run.smithi155.stdout: }, 2023-08-01T19:55:30.747 INFO:teuthology.orchestra.run.smithi155.stdout: "events": [ 2023-08-01T19:55:30.748 INFO:teuthology.orchestra.run.smithi155.stdout: { 2023-08-01T19:55:30.748 INFO:teuthology.orchestra.run.smithi155.stdout: "event": "initiated", 2023-08-01T19:55:30.748 INFO:teuthology.orchestra.run.smithi155.stdout: "time": "2023-08-01T19:54:51.460078+0000", 2023-08-01T19:55:30.748 INFO:teuthology.orchestra.run.smithi155.stdout: "duration": 0 2023-08-01T19:55:30.748 INFO:teuthology.orchestra.run.smithi155.stdout: }, 2023-08-01T19:55:30.748 INFO:teuthology.orchestra.run.smithi155.stdout: { 2023-08-01T19:55:30.748 INFO:teuthology.orchestra.run.smithi155.stdout: "event": "throttled", 2023-08-01T19:55:30.748 INFO:teuthology.orchestra.run.smithi155.stdout: "time": "2023-08-01T19:54:51.460078+0000", 2023-08-01T19:55:30.749 INFO:teuthology.orchestra.run.smithi155.stdout: "duration": 0 2023-08-01T19:55:30.749 INFO:teuthology.orchestra.run.smithi155.stdout: }, 2023-08-01T19:55:30.749 INFO:teuthology.orchestra.run.smithi155.stdout: { 2023-08-01T19:55:30.749 INFO:teuthology.orchestra.run.smithi155.stdout: "event": "header_read", 2023-08-01T19:55:30.749 INFO:teuthology.orchestra.run.smithi155.stdout: "time": "2023-08-01T19:54:51.460077+0000", 2023-08-01T19:55:30.749 INFO:teuthology.orchestra.run.smithi155.stdout: "duration": 4294967295.9999995 2023-08-01T19:55:30.749 INFO:teuthology.orchestra.run.smithi155.stdout: }, 2023-08-01T19:55:30.749 INFO:teuthology.orchestra.run.smithi155.stdout: { 2023-08-01T19:55:30.750 INFO:teuthology.orchestra.run.smithi155.stdout: "event": "all_read", 2023-08-01T19:55:30.750 INFO:teuthology.orchestra.run.smithi155.stdout: "time": "2023-08-01T19:54:51.460102+0000", 2023-08-01T19:55:30.750 INFO:teuthology.orchestra.run.smithi155.stdout: "duration": 2.4933e-05 2023-08-01T19:55:30.750 INFO:teuthology.orchestra.run.smithi155.stdout: }, 2023-08-01T19:55:30.750 INFO:teuthology.orchestra.run.smithi155.stdout: { 2023-08-01T19:55:30.750 INFO:teuthology.orchestra.run.smithi155.stdout: "event": "dispatched", 2023-08-01T19:55:30.750 INFO:teuthology.orchestra.run.smithi155.stdout: "time": "2023-08-01T19:54:51.460109+0000", 2023-08-01T19:55:30.750 INFO:teuthology.orchestra.run.smithi155.stdout: "duration": 7.0720000000000002e-06 2023-08-01T19:55:30.751 INFO:teuthology.orchestra.run.smithi155.stdout: }, 2023-08-01T19:55:30.751 INFO:teuthology.orchestra.run.smithi155.stdout: { 2023-08-01T19:55:30.751 INFO:teuthology.orchestra.run.smithi155.stdout: "event": "queued_for_pg", 2023-08-01T19:55:30.751 INFO:teuthology.orchestra.run.smithi155.stdout: "time": "2023-08-01T19:54:51.460113+0000", 2023-08-01T19:55:30.751 INFO:teuthology.orchestra.run.smithi155.stdout: "duration": 4.3220000000000003e-06 2023-08-01T19:55:30.751 INFO:teuthology.orchestra.run.smithi155.stdout: }, 2023-08-01T19:55:30.751 INFO:teuthology.orchestra.run.smithi155.stdout: { 2023-08-01T19:55:30.751 INFO:teuthology.orchestra.run.smithi155.stdout: "event": "reached_pg", 2023-08-01T19:55:30.752 INFO:teuthology.orchestra.run.smithi155.stdout: "time": "2023-08-01T19:54:51.460955+0000", 2023-08-01T19:55:30.752 INFO:teuthology.orchestra.run.smithi155.stdout: "duration": 0.00084142500000000003 2023-08-01T19:55:30.752 INFO:teuthology.orchestra.run.smithi155.stdout: }, 2023-08-01T19:55:30.752 INFO:teuthology.orchestra.run.smithi155.stdout: { 2023-08-01T19:55:30.752 INFO:teuthology.orchestra.run.smithi155.stdout: "event": "started", 2023-08-01T19:55:30.752 INFO:teuthology.orchestra.run.smithi155.stdout: "time": "2023-08-01T19:54:51.461079+0000", 2023-08-01T19:55:30.752 INFO:teuthology.orchestra.run.smithi155.stdout: "duration": 0.000123826 2023-08-01T19:55:30.753 INFO:teuthology.orchestra.run.smithi155.stdout: }, 2023-08-01T19:55:30.753 INFO:teuthology.orchestra.run.smithi155.stdout: { 2023-08-01T19:55:30.753 INFO:teuthology.orchestra.run.smithi155.stdout: "event": "waiting for subops from 0", 2023-08-01T19:55:30.753 INFO:teuthology.orchestra.run.smithi155.stdout: "time": "2023-08-01T19:54:51.461233+0000", 2023-08-01T19:55:30.753 INFO:teuthology.orchestra.run.smithi155.stdout: "duration": 0.00015431900000000001 2023-08-01T19:55:30.753 INFO:teuthology.orchestra.run.smithi155.stdout: }, 2023-08-01T19:55:30.753 INFO:teuthology.orchestra.run.smithi155.stdout: { 2023-08-01T19:55:30.753 INFO:teuthology.orchestra.run.smithi155.stdout: "event": "sub_op_commit_rec", 2023-08-01T19:55:30.754 INFO:teuthology.orchestra.run.smithi155.stdout: "time": "2023-08-01T19:54:51.468509+0000", 2023-08-01T19:55:30.754 INFO:teuthology.orchestra.run.smithi155.stdout: "duration": 0.0072759859999999999 2023-08-01T19:55:30.754 INFO:teuthology.orchestra.run.smithi155.stdout: }, 2023-08-01T19:55:30.754 INFO:teuthology.orchestra.run.smithi155.stdout: { 2023-08-01T19:55:30.754 INFO:teuthology.orchestra.run.smithi155.stdout: "event": "op_commit", 2023-08-01T19:55:30.754 INFO:teuthology.orchestra.run.smithi155.stdout: "time": "2023-08-01T19:54:51.482704+0000", 2023-08-01T19:55:30.754 INFO:teuthology.orchestra.run.smithi155.stdout: "duration": 0.01419545 2023-08-01T19:55:30.754 INFO:teuthology.orchestra.run.smithi155.stdout: }, 2023-08-01T19:55:30.755 INFO:teuthology.orchestra.run.smithi155.stdout: { 2023-08-01T19:55:30.755 INFO:teuthology.orchestra.run.smithi155.stdout: "event": "commit_sent", 2023-08-01T19:55:30.755 INFO:teuthology.orchestra.run.smithi155.stdout: "time": "2023-08-01T19:54:51.482747+0000", 2023-08-01T19:55:30.755 INFO:teuthology.orchestra.run.smithi155.stdout: "duration": 4.2413999999999997e-05 2023-08-01T19:55:30.755 INFO:teuthology.orchestra.run.smithi155.stdout: }, 2023-08-01T19:55:30.755 INFO:teuthology.orchestra.run.smithi155.stdout: { 2023-08-01T19:55:30.755 INFO:teuthology.orchestra.run.smithi155.stdout: "event": "done", 2023-08-01T19:55:30.755 INFO:teuthology.orchestra.run.smithi155.stdout: "time": "2023-08-01T19:54:51.482767+0000", 2023-08-01T19:55:30.756 INFO:teuthology.orchestra.run.smithi155.stdout: "duration": 1.9908999999999999e-05 2023-08-01T19:55:30.756 INFO:teuthology.orchestra.run.smithi155.stdout: } 2023-08-01T19:55:30.756 INFO:teuthology.orchestra.run.smithi155.stdout: ] 2023-08-01T19:55:30.756 INFO:teuthology.orchestra.run.smithi155.stdout: } 2023-08-01T19:55:30.756 INFO:teuthology.orchestra.run.smithi155.stdout: }, 2023-08-01T19:55:30.756 INFO:teuthology.orchestra.run.smithi155.stdout: { 2023-08-01T19:55:30.756 INFO:teuthology.orchestra.run.smithi155.stdout: "description": "osd_op(client.4668.0:73456 5.0 5:0164baf4:::benchmark_data_smithi006_114134_object73455:head [set-alloc-hint object_size 65536 write_size 65536,write 0~65536] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e31)", 2023-08-01T19:55:30.756 INFO:teuthology.orchestra.run.smithi155.stdout: "initiated_at": "2023-08-01T19:54:51.461520+0000", 2023-08-01T19:55:30.757 INFO:teuthology.orchestra.run.smithi155.stdout: "age": 39.270496688999998, 2023-08-01T19:55:30.757 INFO:teuthology.orchestra.run.smithi155.stdout: "duration": 0.023899916, 2023-08-01T19:55:30.757 INFO:teuthology.orchestra.run.smithi155.stdout: "type_data": { 2023-08-01T19:55:30.757 INFO:teuthology.orchestra.run.smithi155.stdout: "flag_point": "commit sent; apply or cleanup", 2023-08-01T19:55:30.757 INFO:teuthology.orchestra.run.smithi155.stdout: "client_info": { 2023-08-01T19:55:30.757 INFO:teuthology.orchestra.run.smithi155.stdout: "client": "client.4668", 2023-08-01T19:55:30.757 INFO:teuthology.orchestra.run.smithi155.stdout: "client_addr": "172.21.15.6:0/1709472247", 2023-08-01T19:55:30.757 INFO:teuthology.orchestra.run.smithi155.stdout: "tid": 73456 2023-08-01T19:55:30.758 INFO:teuthology.orchestra.run.smithi155.stdout: }, 2023-08-01T19:55:30.758 INFO:teuthology.orchestra.run.smithi155.stdout: "events": [ 2023-08-01T19:55:30.758 INFO:teuthology.orchestra.run.smithi155.stdout: { 2023-08-01T19:55:30.758 INFO:teuthology.orchestra.run.smithi155.stdout: "event": "initiated", 2023-08-01T19:55:30.758 INFO:teuthology.orchestra.run.smithi155.stdout: "time": "2023-08-01T19:54:51.461520+0000", 2023-08-01T19:55:30.758 INFO:teuthology.orchestra.run.smithi155.stdout: "duration": 0 2023-08-01T19:55:30.758 INFO:teuthology.orchestra.run.smithi155.stdout: }, 2023-08-01T19:55:30.758 INFO:teuthology.orchestra.run.smithi155.stdout: { 2023-08-01T19:55:30.759 INFO:teuthology.orchestra.run.smithi155.stdout: "event": "throttled", 2023-08-01T19:55:30.759 INFO:teuthology.orchestra.run.smithi155.stdout: "time": "2023-08-01T19:54:51.461520+0000", 2023-08-01T19:55:30.759 INFO:teuthology.orchestra.run.smithi155.stdout: "duration": 0 2023-08-01T19:55:30.759 INFO:teuthology.orchestra.run.smithi155.stdout: }, 2023-08-01T19:55:30.759 INFO:teuthology.orchestra.run.smithi155.stdout: { 2023-08-01T19:55:30.759 INFO:teuthology.orchestra.run.smithi155.stdout: "event": "header_read", 2023-08-01T19:55:30.759 INFO:teuthology.orchestra.run.smithi155.stdout: "time": "2023-08-01T19:54:51.461519+0000", 2023-08-01T19:55:30.759 INFO:teuthology.orchestra.run.smithi155.stdout: "duration": 4294967295.999999 2023-08-01T19:55:30.760 INFO:teuthology.orchestra.run.smithi155.stdout: }, 2023-08-01T19:55:30.760 INFO:teuthology.orchestra.run.smithi155.stdout: { 2023-08-01T19:55:30.760 INFO:teuthology.orchestra.run.smithi155.stdout: "event": "all_read", 2023-08-01T19:55:30.760 INFO:teuthology.orchestra.run.smithi155.stdout: "time": "2023-08-01T19:54:51.461633+0000", 2023-08-01T19:55:30.760 INFO:teuthology.orchestra.run.smithi155.stdout: "duration": 0.000114015 2023-08-01T19:55:30.760 INFO:teuthology.orchestra.run.smithi155.stdout: }, 2023-08-01T19:55:30.760 INFO:teuthology.orchestra.run.smithi155.stdout: { 2023-08-01T19:55:30.761 INFO:teuthology.orchestra.run.smithi155.stdout: "event": "dispatched", 2023-08-01T19:55:30.761 INFO:teuthology.orchestra.run.smithi155.stdout: "time": "2023-08-01T19:54:51.461643+0000", 2023-08-01T19:55:30.761 INFO:teuthology.orchestra.run.smithi155.stdout: "duration": 1.0217000000000001e-05 2023-08-01T19:55:30.761 INFO:teuthology.orchestra.run.smithi155.stdout: }, 2023-08-01T19:55:30.761 INFO:teuthology.orchestra.run.smithi155.stdout: { 2023-08-01T19:55:30.761 INFO:teuthology.orchestra.run.smithi155.stdout: "event": "queued_for_pg", 2023-08-01T19:55:30.761 INFO:teuthology.orchestra.run.smithi155.stdout: "time": "2023-08-01T19:54:51.461649+0000", 2023-08-01T19:55:30.761 INFO:teuthology.orchestra.run.smithi155.stdout: "duration": 5.8850000000000004e-06 2023-08-01T19:55:30.762 INFO:teuthology.orchestra.run.smithi155.stdout: }, 2023-08-01T19:55:30.762 INFO:teuthology.orchestra.run.smithi155.stdout: { 2023-08-01T19:55:30.762 INFO:teuthology.orchestra.run.smithi155.stdout: "event": "reached_pg", 2023-08-01T19:55:30.762 INFO:teuthology.orchestra.run.smithi155.stdout: "time": "2023-08-01T19:54:51.461686+0000", 2023-08-01T19:55:30.762 INFO:teuthology.orchestra.run.smithi155.stdout: "duration": 3.7319e-05 2023-08-01T19:55:30.762 INFO:teuthology.orchestra.run.smithi155.stdout: }, 2023-08-01T19:55:30.762 INFO:teuthology.orchestra.run.smithi155.stdout: { 2023-08-01T19:55:30.762 INFO:teuthology.orchestra.run.smithi155.stdout: "event": "started", 2023-08-01T19:55:30.763 INFO:teuthology.orchestra.run.smithi155.stdout: "time": "2023-08-01T19:54:51.461802+0000", 2023-08-01T19:55:30.763 INFO:teuthology.orchestra.run.smithi155.stdout: "duration": 0.000115604 2023-08-01T19:55:30.763 INFO:teuthology.orchestra.run.smithi155.stdout: }, 2023-08-01T19:55:30.763 INFO:teuthology.orchestra.run.smithi155.stdout: { 2023-08-01T19:55:30.763 INFO:teuthology.orchestra.run.smithi155.stdout: "event": "waiting for subops from 0", 2023-08-01T19:55:30.763 INFO:teuthology.orchestra.run.smithi155.stdout: "time": "2023-08-01T19:54:51.461933+0000", 2023-08-01T19:55:30.763 INFO:teuthology.orchestra.run.smithi155.stdout: "duration": 0.000131175 2023-08-01T19:55:30.763 INFO:teuthology.orchestra.run.smithi155.stdout: }, 2023-08-01T19:55:30.764 INFO:teuthology.orchestra.run.smithi155.stdout: { 2023-08-01T19:55:30.764 INFO:teuthology.orchestra.run.smithi155.stdout: "event": "sub_op_commit_rec", 2023-08-01T19:55:30.764 INFO:teuthology.orchestra.run.smithi155.stdout: "time": "2023-08-01T19:54:51.468411+0000", 2023-08-01T19:55:30.764 INFO:teuthology.orchestra.run.smithi155.stdout: "duration": 0.0064775850000000001 2023-08-01T19:55:30.764 INFO:teuthology.orchestra.run.smithi155.stdout: }, 2023-08-01T19:55:30.764 INFO:teuthology.orchestra.run.smithi155.stdout: { 2023-08-01T19:55:30.764 INFO:teuthology.orchestra.run.smithi155.stdout: "event": "op_commit", 2023-08-01T19:55:30.765 INFO:teuthology.orchestra.run.smithi155.stdout: "time": "2023-08-01T19:54:51.485340+0000", 2023-08-01T19:55:30.765 INFO:teuthology.orchestra.run.smithi155.stdout: "duration": 0.016928907 2023-08-01T19:55:30.765 INFO:teuthology.orchestra.run.smithi155.stdout: }, 2023-08-01T19:55:30.765 INFO:teuthology.orchestra.run.smithi155.stdout: { 2023-08-01T19:55:30.765 INFO:teuthology.orchestra.run.smithi155.stdout: "event": "commit_sent", 2023-08-01T19:55:30.765 INFO:teuthology.orchestra.run.smithi155.stdout: "time": "2023-08-01T19:54:51.485385+0000", 2023-08-01T19:55:30.765 INFO:teuthology.orchestra.run.smithi155.stdout: "duration": 4.5222000000000002e-05 2023-08-01T19:55:30.766 INFO:teuthology.orchestra.run.smithi155.stdout: }, 2023-08-01T19:55:30.766 INFO:teuthology.orchestra.run.smithi155.stdout: { 2023-08-01T19:55:30.766 INFO:teuthology.orchestra.run.smithi155.stdout: "event": "done", 2023-08-01T19:55:30.766 INFO:teuthology.orchestra.run.smithi155.stdout: "time": "2023-08-01T19:54:51.485420+0000", 2023-08-01T19:55:30.766 INFO:teuthology.orchestra.run.smithi155.stdout: "duration": 3.4717e-05 2023-08-01T19:55:30.766 INFO:teuthology.orchestra.run.smithi155.stdout: } 2023-08-01T19:55:30.766 INFO:teuthology.orchestra.run.smithi155.stdout: ] 2023-08-01T19:55:30.766 INFO:teuthology.orchestra.run.smithi155.stdout: } 2023-08-01T19:55:30.767 INFO:teuthology.orchestra.run.smithi155.stdout: }, 2023-08-01T19:55:30.767 INFO:teuthology.orchestra.run.smithi155.stdout: { 2023-08-01T19:55:30.767 INFO:teuthology.orchestra.run.smithi155.stdout: "description": "osd_op(client.4668.0:100237 5.4 5:2d68bec9:::benchmark_data_smithi006_114134_object100236:head [set-alloc-hint object_size 65536 write_size 65536,write 0~65536] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e37)", 2023-08-01T19:55:30.767 INFO:teuthology.orchestra.run.smithi155.stdout: "initiated_at": "2023-08-01T19:55:05.147736+0000", 2023-08-01T19:55:30.767 INFO:teuthology.orchestra.run.smithi155.stdout: "age": 25.584279976000001, 2023-08-01T19:55:30.767 INFO:teuthology.orchestra.run.smithi155.stdout: "duration": 0.071299464000000007, 2023-08-01T19:55:30.767 INFO:teuthology.orchestra.run.smithi155.stdout: "type_data": { 2023-08-01T19:55:30.767 INFO:teuthology.orchestra.run.smithi155.stdout: "flag_point": "commit sent; apply or cleanup", 2023-08-01T19:55:30.768 INFO:teuthology.orchestra.run.smithi155.stdout: "client_info": { 2023-08-01T19:55:30.768 INFO:teuthology.orchestra.run.smithi155.stdout: "client": "client.4668", 2023-08-01T19:55:30.768 INFO:teuthology.orchestra.run.smithi155.stdout: "client_addr": "172.21.15.6:0/1709472247", 2023-08-01T19:55:30.768 INFO:teuthology.orchestra.run.smithi155.stdout: "tid": 100237 2023-08-01T19:55:30.768 INFO:teuthology.orchestra.run.smithi155.stdout: }, 2023-08-01T19:55:30.768 INFO:teuthology.orchestra.run.smithi155.stdout: "events": [ 2023-08-01T19:55:30.768 INFO:teuthology.orchestra.run.smithi155.stdout: { 2023-08-01T19:55:30.768 INFO:teuthology.orchestra.run.smithi155.stdout: "event": "initiated", 2023-08-01T19:55:30.769 INFO:teuthology.orchestra.run.smithi155.stdout: "time": "2023-08-01T19:55:05.147736+0000", 2023-08-01T19:55:30.769 INFO:teuthology.orchestra.run.smithi155.stdout: "duration": 0 2023-08-01T19:55:30.769 INFO:teuthology.orchestra.run.smithi155.stdout: }, 2023-08-01T19:55:30.769 INFO:teuthology.orchestra.run.smithi155.stdout: { 2023-08-01T19:55:30.769 INFO:teuthology.orchestra.run.smithi155.stdout: "event": "throttled", 2023-08-01T19:55:30.769 INFO:teuthology.orchestra.run.smithi155.stdout: "time": "2023-08-01T19:55:05.147736+0000", 2023-08-01T19:55:30.769 INFO:teuthology.orchestra.run.smithi155.stdout: "duration": 0 2023-08-01T19:55:30.769 INFO:teuthology.orchestra.run.smithi155.stdout: }, 2023-08-01T19:55:30.770 INFO:teuthology.orchestra.run.smithi155.stdout: { 2023-08-01T19:55:30.770 INFO:teuthology.orchestra.run.smithi155.stdout: "event": "header_read", 2023-08-01T19:55:30.770 INFO:teuthology.orchestra.run.smithi155.stdout: "time": "2023-08-01T19:55:05.147736+0000", 2023-08-01T19:55:30.770 INFO:teuthology.orchestra.run.smithi155.stdout: "duration": 4294967295.9999995 2023-08-01T19:55:30.770 INFO:teuthology.orchestra.run.smithi155.stdout: }, 2023-08-01T19:55:30.770 INFO:teuthology.orchestra.run.smithi155.stdout: { 2023-08-01T19:55:30.770 INFO:teuthology.orchestra.run.smithi155.stdout: "event": "all_read", 2023-08-01T19:55:30.770 INFO:teuthology.orchestra.run.smithi155.stdout: "time": "2023-08-01T19:55:05.147766+0000", 2023-08-01T19:55:30.771 INFO:teuthology.orchestra.run.smithi155.stdout: "duration": 3.0394000000000001e-05 2023-08-01T19:55:30.771 INFO:teuthology.orchestra.run.smithi155.stdout: }, 2023-08-01T19:55:30.771 INFO:teuthology.orchestra.run.smithi155.stdout: { 2023-08-01T19:55:30.771 INFO:teuthology.orchestra.run.smithi155.stdout: "event": "dispatched", 2023-08-01T19:55:30.771 INFO:teuthology.orchestra.run.smithi155.stdout: "time": "2023-08-01T19:55:05.147771+0000", 2023-08-01T19:55:30.771 INFO:teuthology.orchestra.run.smithi155.stdout: "duration": 4.25e-06 2023-08-01T19:55:30.771 INFO:teuthology.orchestra.run.smithi155.stdout: }, 2023-08-01T19:55:30.771 INFO:teuthology.orchestra.run.smithi155.stdout: { 2023-08-01T19:55:30.772 INFO:teuthology.orchestra.run.smithi155.stdout: "event": "queued_for_pg", 2023-08-01T19:55:30.772 INFO:teuthology.orchestra.run.smithi155.stdout: "time": "2023-08-01T19:55:05.147773+0000", 2023-08-01T19:55:30.772 INFO:teuthology.orchestra.run.smithi155.stdout: "duration": 2.4159999999999998e-06 2023-08-01T19:55:30.772 INFO:teuthology.orchestra.run.smithi155.stdout: }, 2023-08-01T19:55:30.772 INFO:teuthology.orchestra.run.smithi155.stdout: { 2023-08-01T19:55:30.772 INFO:teuthology.orchestra.run.smithi155.stdout: "event": "reached_pg", 2023-08-01T19:55:30.772 INFO:teuthology.orchestra.run.smithi155.stdout: "time": "2023-08-01T19:55:05.149903+0000", 2023-08-01T19:55:30.773 INFO:teuthology.orchestra.run.smithi155.stdout: "duration": 0.002129948 2023-08-01T19:55:30.773 INFO:teuthology.orchestra.run.smithi155.stdout: }, 2023-08-01T19:55:30.773 INFO:teuthology.orchestra.run.smithi155.stdout: { 2023-08-01T19:55:30.773 INFO:teuthology.orchestra.run.smithi155.stdout: "event": "started", 2023-08-01T19:55:30.773 INFO:teuthology.orchestra.run.smithi155.stdout: "time": "2023-08-01T19:55:05.149982+0000", 2023-08-01T19:55:30.773 INFO:teuthology.orchestra.run.smithi155.stdout: "duration": 7.8706000000000002e-05 2023-08-01T19:55:30.773 INFO:teuthology.orchestra.run.smithi155.stdout: }, 2023-08-01T19:55:30.773 INFO:teuthology.orchestra.run.smithi155.stdout: { 2023-08-01T19:55:30.774 INFO:teuthology.orchestra.run.smithi155.stdout: "event": "waiting for subops from 0", 2023-08-01T19:55:30.774 INFO:teuthology.orchestra.run.smithi155.stdout: "time": "2023-08-01T19:55:05.150066+0000", 2023-08-01T19:55:30.774 INFO:teuthology.orchestra.run.smithi155.stdout: "duration": 8.4241999999999997e-05 2023-08-01T19:55:30.774 INFO:teuthology.orchestra.run.smithi155.stdout: }, 2023-08-01T19:55:30.774 INFO:teuthology.orchestra.run.smithi155.stdout: { 2023-08-01T19:55:30.774 INFO:teuthology.orchestra.run.smithi155.stdout: "event": "op_commit", 2023-08-01T19:55:30.774 INFO:teuthology.orchestra.run.smithi155.stdout: "time": "2023-08-01T19:55:05.154994+0000", 2023-08-01T19:55:30.774 INFO:teuthology.orchestra.run.smithi155.stdout: "duration": 0.0049277050000000001 2023-08-01T19:55:30.775 INFO:teuthology.orchestra.run.smithi155.stdout: }, 2023-08-01T19:55:30.775 INFO:teuthology.orchestra.run.smithi155.stdout: { 2023-08-01T19:55:30.775 INFO:teuthology.orchestra.run.smithi155.stdout: "event": "sub_op_commit_rec", 2023-08-01T19:55:30.775 INFO:teuthology.orchestra.run.smithi155.stdout: "time": "2023-08-01T19:55:05.218933+0000", 2023-08-01T19:55:30.775 INFO:teuthology.orchestra.run.smithi155.stdout: "duration": 0.063939916999999999 2023-08-01T19:55:30.775 INFO:teuthology.orchestra.run.smithi155.stdout: }, 2023-08-01T19:55:30.775 INFO:teuthology.orchestra.run.smithi155.stdout: { 2023-08-01T19:55:30.775 INFO:teuthology.orchestra.run.smithi155.stdout: "event": "commit_sent", 2023-08-01T19:55:30.776 INFO:teuthology.orchestra.run.smithi155.stdout: "time": "2023-08-01T19:55:05.218989+0000", 2023-08-01T19:55:30.776 INFO:teuthology.orchestra.run.smithi155.stdout: "duration": 5.5772000000000001e-05 2023-08-01T19:55:30.776 INFO:teuthology.orchestra.run.smithi155.stdout: }, 2023-08-01T19:55:30.776 INFO:teuthology.orchestra.run.smithi155.stdout: { 2023-08-01T19:55:30.776 INFO:teuthology.orchestra.run.smithi155.stdout: "event": "done", 2023-08-01T19:55:30.776 INFO:teuthology.orchestra.run.smithi155.stdout: "time": "2023-08-01T19:55:05.219036+0000", 2023-08-01T19:55:30.776 INFO:teuthology.orchestra.run.smithi155.stdout: "duration": 4.6526000000000001e-05 2023-08-01T19:55:30.776 INFO:teuthology.orchestra.run.smithi155.stdout: } 2023-08-01T19:55:30.777 INFO:teuthology.orchestra.run.smithi155.stdout: ] 2023-08-01T19:55:30.777 INFO:teuthology.orchestra.run.smithi155.stdout: } 2023-08-01T19:55:30.777 INFO:teuthology.orchestra.run.smithi155.stdout: }, 2023-08-01T19:55:30.777 INFO:teuthology.orchestra.run.smithi155.stdout: { 2023-08-01T19:55:30.777 INFO:teuthology.orchestra.run.smithi155.stdout: "description": "osd_op(client.4668.0:100242 5.8 5:16a314b8:::benchmark_data_smithi006_114134_object100241:head [set-alloc-hint object_size 65536 write_size 65536,write 0~65536] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e37)", 2023-08-01T19:55:30.777 INFO:teuthology.orchestra.run.smithi155.stdout: "initiated_at": "2023-08-01T19:55:05.150616+0000", 2023-08-01T19:55:30.777 INFO:teuthology.orchestra.run.smithi155.stdout: "age": 25.581400345999999, 2023-08-01T19:55:30.777 INFO:teuthology.orchestra.run.smithi155.stdout: "duration": 0.071105065999999995, 2023-08-01T19:55:30.778 INFO:teuthology.orchestra.run.smithi155.stdout: "type_data": { 2023-08-01T19:55:30.778 INFO:teuthology.orchestra.run.smithi155.stdout: "flag_point": "commit sent; apply or cleanup", 2023-08-01T19:55:30.778 INFO:teuthology.orchestra.run.smithi155.stdout: "client_info": { 2023-08-01T19:55:30.778 INFO:teuthology.orchestra.run.smithi155.stdout: "client": "client.4668", 2023-08-01T19:55:30.778 INFO:teuthology.orchestra.run.smithi155.stdout: "client_addr": "172.21.15.6:0/1709472247", 2023-08-01T19:55:30.778 INFO:teuthology.orchestra.run.smithi155.stdout: "tid": 100242 2023-08-01T19:55:30.778 INFO:teuthology.orchestra.run.smithi155.stdout: }, 2023-08-01T19:55:30.778 INFO:teuthology.orchestra.run.smithi155.stdout: "events": [ 2023-08-01T19:55:30.779 INFO:teuthology.orchestra.run.smithi155.stdout: { 2023-08-01T19:55:30.779 INFO:teuthology.orchestra.run.smithi155.stdout: "event": "initiated", 2023-08-01T19:55:30.779 INFO:teuthology.orchestra.run.smithi155.stdout: "time": "2023-08-01T19:55:05.150616+0000", 2023-08-01T19:55:30.779 INFO:teuthology.orchestra.run.smithi155.stdout: "duration": 0 2023-08-01T19:55:30.779 INFO:teuthology.orchestra.run.smithi155.stdout: }, 2023-08-01T19:55:30.779 INFO:teuthology.orchestra.run.smithi155.stdout: { 2023-08-01T19:55:30.779 INFO:teuthology.orchestra.run.smithi155.stdout: "event": "throttled", 2023-08-01T19:55:30.779 INFO:teuthology.orchestra.run.smithi155.stdout: "time": "2023-08-01T19:55:05.150616+0000", 2023-08-01T19:55:30.780 INFO:teuthology.orchestra.run.smithi155.stdout: "duration": 0 2023-08-01T19:55:30.780 INFO:teuthology.orchestra.run.smithi155.stdout: }, 2023-08-01T19:55:30.780 INFO:teuthology.orchestra.run.smithi155.stdout: { 2023-08-01T19:55:30.780 INFO:teuthology.orchestra.run.smithi155.stdout: "event": "header_read", 2023-08-01T19:55:30.780 INFO:teuthology.orchestra.run.smithi155.stdout: "time": "2023-08-01T19:55:05.150615+0000", 2023-08-01T19:55:30.780 INFO:teuthology.orchestra.run.smithi155.stdout: "duration": 4294967295.999999 2023-08-01T19:55:30.781 INFO:teuthology.orchestra.run.smithi155.stdout: }, 2023-08-01T19:55:30.781 INFO:teuthology.orchestra.run.smithi155.stdout: { 2023-08-01T19:55:30.781 INFO:teuthology.orchestra.run.smithi155.stdout: "event": "all_read", 2023-08-01T19:55:30.781 INFO:teuthology.orchestra.run.smithi155.stdout: "time": "2023-08-01T19:55:05.150696+0000", 2023-08-01T19:55:30.781 INFO:teuthology.orchestra.run.smithi155.stdout: "duration": 8.0852000000000004e-05 2023-08-01T19:55:30.781 INFO:teuthology.orchestra.run.smithi155.stdout: }, 2023-08-01T19:55:30.781 INFO:teuthology.orchestra.run.smithi155.stdout: { 2023-08-01T19:55:30.781 INFO:teuthology.orchestra.run.smithi155.stdout: "event": "dispatched", 2023-08-01T19:55:30.782 INFO:teuthology.orchestra.run.smithi155.stdout: "time": "2023-08-01T19:55:05.150708+0000", 2023-08-01T19:55:30.782 INFO:teuthology.orchestra.run.smithi155.stdout: "duration": 1.2116999999999999e-05 2023-08-01T19:55:30.782 INFO:teuthology.orchestra.run.smithi155.stdout: }, 2023-08-01T19:55:30.782 INFO:teuthology.orchestra.run.smithi155.stdout: { 2023-08-01T19:55:30.782 INFO:teuthology.orchestra.run.smithi155.stdout: "event": "queued_for_pg", 2023-08-01T19:55:30.782 INFO:teuthology.orchestra.run.smithi155.stdout: "time": "2023-08-01T19:55:05.150713+0000", 2023-08-01T19:55:30.782 INFO:teuthology.orchestra.run.smithi155.stdout: "duration": 5.4620000000000004e-06 2023-08-01T19:55:30.782 INFO:teuthology.orchestra.run.smithi155.stdout: }, 2023-08-01T19:55:30.783 INFO:teuthology.orchestra.run.smithi155.stdout: { 2023-08-01T19:55:30.783 INFO:teuthology.orchestra.run.smithi155.stdout: "event": "reached_pg", 2023-08-01T19:55:30.783 INFO:teuthology.orchestra.run.smithi155.stdout: "time": "2023-08-01T19:55:05.150761+0000", 2023-08-01T19:55:30.783 INFO:teuthology.orchestra.run.smithi155.stdout: "duration": 4.7429000000000003e-05 2023-08-01T19:55:30.783 INFO:teuthology.orchestra.run.smithi155.stdout: }, 2023-08-01T19:55:30.783 INFO:teuthology.orchestra.run.smithi155.stdout: { 2023-08-01T19:55:30.783 INFO:teuthology.orchestra.run.smithi155.stdout: "event": "started", 2023-08-01T19:55:30.783 INFO:teuthology.orchestra.run.smithi155.stdout: "time": "2023-08-01T19:55:05.150856+0000", 2023-08-01T19:55:30.784 INFO:teuthology.orchestra.run.smithi155.stdout: "duration": 9.5356e-05 2023-08-01T19:55:30.784 INFO:teuthology.orchestra.run.smithi155.stdout: }, 2023-08-01T19:55:30.784 INFO:teuthology.orchestra.run.smithi155.stdout: { 2023-08-01T19:55:30.784 INFO:teuthology.orchestra.run.smithi155.stdout: "event": "waiting for subops from 0", 2023-08-01T19:55:30.784 INFO:teuthology.orchestra.run.smithi155.stdout: "time": "2023-08-01T19:55:05.150999+0000", 2023-08-01T19:55:30.784 INFO:teuthology.orchestra.run.smithi155.stdout: "duration": 0.00014234499999999999 2023-08-01T19:55:30.784 INFO:teuthology.orchestra.run.smithi155.stdout: }, 2023-08-01T19:55:30.785 INFO:teuthology.orchestra.run.smithi155.stdout: { 2023-08-01T19:55:30.785 INFO:teuthology.orchestra.run.smithi155.stdout: "event": "sub_op_commit_rec", 2023-08-01T19:55:30.785 INFO:teuthology.orchestra.run.smithi155.stdout: "time": "2023-08-01T19:55:05.219001+0000", 2023-08-01T19:55:30.785 INFO:teuthology.orchestra.run.smithi155.stdout: "duration": 0.068002776000000001 2023-08-01T19:55:30.785 INFO:teuthology.orchestra.run.smithi155.stdout: }, 2023-08-01T19:55:30.785 INFO:teuthology.orchestra.run.smithi155.stdout: { 2023-08-01T19:55:30.786 INFO:teuthology.orchestra.run.smithi155.stdout: "event": "op_commit", 2023-08-01T19:55:30.786 INFO:teuthology.orchestra.run.smithi155.stdout: "time": "2023-08-01T19:55:05.221635+0000", 2023-08-01T19:55:30.786 INFO:teuthology.orchestra.run.smithi155.stdout: "duration": 0.0026340579999999999 2023-08-01T19:55:30.786 INFO:teuthology.orchestra.run.smithi155.stdout: }, 2023-08-01T19:55:30.787 INFO:teuthology.orchestra.run.smithi155.stdout: { 2023-08-01T19:55:30.787 INFO:teuthology.orchestra.run.smithi155.stdout: "event": "commit_sent", 2023-08-01T19:55:30.787 INFO:teuthology.orchestra.run.smithi155.stdout: "time": "2023-08-01T19:55:05.221682+0000", 2023-08-01T19:55:30.787 INFO:teuthology.orchestra.run.smithi155.stdout: "duration": 4.7123999999999998e-05 2023-08-01T19:55:30.788 INFO:teuthology.orchestra.run.smithi155.stdout: }, 2023-08-01T19:55:30.788 INFO:teuthology.orchestra.run.smithi155.stdout: { 2023-08-01T19:55:30.788 INFO:teuthology.orchestra.run.smithi155.stdout: "event": "done", 2023-08-01T19:55:30.789 INFO:teuthology.orchestra.run.smithi155.stdout: "time": "2023-08-01T19:55:05.221721+0000", 2023-08-01T19:55:30.789 INFO:teuthology.orchestra.run.smithi155.stdout: "duration": 3.8529999999999999e-05 2023-08-01T19:55:30.789 INFO:teuthology.orchestra.run.smithi155.stdout: } 2023-08-01T19:55:30.789 INFO:teuthology.orchestra.run.smithi155.stdout: ] 2023-08-01T19:55:30.790 INFO:teuthology.orchestra.run.smithi155.stdout: } 2023-08-01T19:55:30.790 INFO:teuthology.orchestra.run.smithi155.stdout: }, 2023-08-01T19:55:30.790 INFO:teuthology.orchestra.run.smithi155.stdout: { 2023-08-01T19:55:30.790 INFO:teuthology.orchestra.run.smithi155.stdout: "description": "osd_repop(client.4668.0:100240 5.a e37/19 5:5313c5b9:::benchmark_data_smithi006_114134_object100239:head v 37'6227, mlcod=37'6225)", 2023-08-01T19:55:30.790 INFO:teuthology.orchestra.run.smithi155.stdout: "initiated_at": "2023-08-01T19:55:05.150778+0000", 2023-08-01T19:55:30.790 INFO:teuthology.orchestra.run.smithi155.stdout: "age": 25.581238145, 2023-08-01T19:55:30.790 INFO:teuthology.orchestra.run.smithi155.stdout: "duration": 0.073362533999999993, 2023-08-01T19:55:30.791 INFO:teuthology.orchestra.run.smithi155.stdout: "type_data": { 2023-08-01T19:55:30.791 INFO:teuthology.orchestra.run.smithi155.stdout: "flag_point": "commit sent; apply or cleanup", 2023-08-01T19:55:30.791 INFO:teuthology.orchestra.run.smithi155.stdout: "events": [ 2023-08-01T19:55:30.791 INFO:teuthology.orchestra.run.smithi155.stdout: { 2023-08-01T19:55:30.791 INFO:teuthology.orchestra.run.smithi155.stdout: "event": "initiated", 2023-08-01T19:55:30.791 INFO:teuthology.orchestra.run.smithi155.stdout: "time": "2023-08-01T19:55:05.150778+0000", 2023-08-01T19:55:30.791 INFO:teuthology.orchestra.run.smithi155.stdout: "duration": 0 2023-08-01T19:55:30.792 INFO:teuthology.orchestra.run.smithi155.stdout: }, 2023-08-01T19:55:30.792 INFO:teuthology.orchestra.run.smithi155.stdout: { 2023-08-01T19:55:30.792 INFO:teuthology.orchestra.run.smithi155.stdout: "event": "throttled", 2023-08-01T19:55:30.792 INFO:teuthology.orchestra.run.smithi155.stdout: "time": "2023-08-01T19:55:05.150778+0000", 2023-08-01T19:55:30.792 INFO:teuthology.orchestra.run.smithi155.stdout: "duration": 0 2023-08-01T19:55:30.792 INFO:teuthology.orchestra.run.smithi155.stdout: }, 2023-08-01T19:55:30.792 INFO:teuthology.orchestra.run.smithi155.stdout: { 2023-08-01T19:55:30.792 INFO:teuthology.orchestra.run.smithi155.stdout: "event": "header_read", 2023-08-01T19:55:30.793 INFO:teuthology.orchestra.run.smithi155.stdout: "time": "2023-08-01T19:55:05.150778+0000", 2023-08-01T19:55:30.793 INFO:teuthology.orchestra.run.smithi155.stdout: "duration": 4294967295.9999995 2023-08-01T19:55:30.793 INFO:teuthology.orchestra.run.smithi155.stdout: }, 2023-08-01T19:55:30.793 INFO:teuthology.orchestra.run.smithi155.stdout: { 2023-08-01T19:55:30.793 INFO:teuthology.orchestra.run.smithi155.stdout: "event": "all_read", 2023-08-01T19:55:30.793 INFO:teuthology.orchestra.run.smithi155.stdout: "time": "2023-08-01T19:55:05.150811+0000", 2023-08-01T19:55:30.793 INFO:teuthology.orchestra.run.smithi155.stdout: "duration": 3.3664000000000002e-05 2023-08-01T19:55:30.793 INFO:teuthology.orchestra.run.smithi155.stdout: }, 2023-08-01T19:55:30.794 INFO:teuthology.orchestra.run.smithi155.stdout: { 2023-08-01T19:55:30.794 INFO:teuthology.orchestra.run.smithi155.stdout: "event": "dispatched", 2023-08-01T19:55:30.794 INFO:teuthology.orchestra.run.smithi155.stdout: "time": "2023-08-01T19:55:05.150818+0000", 2023-08-01T19:55:30.794 INFO:teuthology.orchestra.run.smithi155.stdout: "duration": 6.5769999999999999e-06 2023-08-01T19:55:30.794 INFO:teuthology.orchestra.run.smithi155.stdout: }, 2023-08-01T19:55:30.794 INFO:teuthology.orchestra.run.smithi155.stdout: { 2023-08-01T19:55:30.794 INFO:teuthology.orchestra.run.smithi155.stdout: "event": "queued_for_pg", 2023-08-01T19:55:30.794 INFO:teuthology.orchestra.run.smithi155.stdout: "time": "2023-08-01T19:55:05.150822+0000", 2023-08-01T19:55:30.795 INFO:teuthology.orchestra.run.smithi155.stdout: "duration": 4.0060000000000003e-06 2023-08-01T19:55:30.795 INFO:teuthology.orchestra.run.smithi155.stdout: }, 2023-08-01T19:55:30.795 INFO:teuthology.orchestra.run.smithi155.stdout: { 2023-08-01T19:55:30.795 INFO:teuthology.orchestra.run.smithi155.stdout: "event": "reached_pg", 2023-08-01T19:55:30.795 INFO:teuthology.orchestra.run.smithi155.stdout: "time": "2023-08-01T19:55:05.150855+0000", 2023-08-01T19:55:30.795 INFO:teuthology.orchestra.run.smithi155.stdout: "duration": 3.3204999999999998e-05 2023-08-01T19:55:30.795 INFO:teuthology.orchestra.run.smithi155.stdout: }, 2023-08-01T19:55:30.795 INFO:teuthology.orchestra.run.smithi155.stdout: { 2023-08-01T19:55:30.796 INFO:teuthology.orchestra.run.smithi155.stdout: "event": "started", 2023-08-01T19:55:30.796 INFO:teuthology.orchestra.run.smithi155.stdout: "time": "2023-08-01T19:55:05.150873+0000", 2023-08-01T19:55:30.796 INFO:teuthology.orchestra.run.smithi155.stdout: "duration": 1.8139999999999999e-05 2023-08-01T19:55:30.796 INFO:teuthology.orchestra.run.smithi155.stdout: }, 2023-08-01T19:55:30.796 INFO:teuthology.orchestra.run.smithi155.stdout: { 2023-08-01T19:55:30.796 INFO:teuthology.orchestra.run.smithi155.stdout: "event": "commit_sent", 2023-08-01T19:55:30.796 INFO:teuthology.orchestra.run.smithi155.stdout: "time": "2023-08-01T19:55:05.224095+0000", 2023-08-01T19:55:30.796 INFO:teuthology.orchestra.run.smithi155.stdout: "duration": 0.073221895999999995 2023-08-01T19:55:30.797 INFO:teuthology.orchestra.run.smithi155.stdout: }, 2023-08-01T19:55:30.797 INFO:teuthology.orchestra.run.smithi155.stdout: { 2023-08-01T19:55:30.797 INFO:teuthology.orchestra.run.smithi155.stdout: "event": "done", 2023-08-01T19:55:30.797 INFO:teuthology.orchestra.run.smithi155.stdout: "time": "2023-08-01T19:55:05.224141+0000", 2023-08-01T19:55:30.797 INFO:teuthology.orchestra.run.smithi155.stdout: "duration": 4.5385e-05 2023-08-01T19:55:30.797 INFO:teuthology.orchestra.run.smithi155.stdout: } 2023-08-01T19:55:30.798 INFO:teuthology.orchestra.run.smithi155.stdout: ] 2023-08-01T19:55:30.798 INFO:teuthology.orchestra.run.smithi155.stdout: } 2023-08-01T19:55:30.798 INFO:teuthology.orchestra.run.smithi155.stdout: }, 2023-08-01T19:55:30.798 INFO:teuthology.orchestra.run.smithi155.stdout: { 2023-08-01T19:55:30.798 INFO:teuthology.orchestra.run.smithi155.stdout: "description": "osd_op(client.4668.0:100245 5.e 5:71869c66:::benchmark_data_smithi006_114134_object100244:head [set-alloc-hint object_size 65536 write_size 65536,write 0~65536] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e37)", 2023-08-01T19:55:30.799 INFO:teuthology.orchestra.run.smithi155.stdout: "initiated_at": "2023-08-01T19:55:05.150991+0000", 2023-08-01T19:55:30.799 INFO:teuthology.orchestra.run.smithi155.stdout: "age": 25.581025358000002, 2023-08-01T19:55:30.799 INFO:teuthology.orchestra.run.smithi155.stdout: "duration": 0.070734490999999997, 2023-08-01T19:55:30.799 INFO:teuthology.orchestra.run.smithi155.stdout: "type_data": { 2023-08-01T19:55:30.799 INFO:teuthology.orchestra.run.smithi155.stdout: "flag_point": "commit sent; apply or cleanup", 2023-08-01T19:55:30.799 INFO:teuthology.orchestra.run.smithi155.stdout: "client_info": { 2023-08-01T19:55:30.799 INFO:teuthology.orchestra.run.smithi155.stdout: "client": "client.4668", 2023-08-01T19:55:30.799 INFO:teuthology.orchestra.run.smithi155.stdout: "client_addr": "172.21.15.6:0/1709472247", 2023-08-01T19:55:30.800 INFO:teuthology.orchestra.run.smithi155.stdout: "tid": 100245 2023-08-01T19:55:30.800 INFO:teuthology.orchestra.run.smithi155.stdout: }, 2023-08-01T19:55:30.800 INFO:teuthology.orchestra.run.smithi155.stdout: "events": [ 2023-08-01T19:55:30.800 INFO:teuthology.orchestra.run.smithi155.stdout: { 2023-08-01T19:55:30.800 INFO:teuthology.orchestra.run.smithi155.stdout: "event": "initiated", 2023-08-01T19:55:30.800 INFO:teuthology.orchestra.run.smithi155.stdout: "time": "2023-08-01T19:55:05.150991+0000", 2023-08-01T19:55:30.800 INFO:teuthology.orchestra.run.smithi155.stdout: "duration": 0 2023-08-01T19:55:30.801 INFO:teuthology.orchestra.run.smithi155.stdout: }, 2023-08-01T19:55:30.801 INFO:teuthology.orchestra.run.smithi155.stdout: { 2023-08-01T19:55:30.801 INFO:teuthology.orchestra.run.smithi155.stdout: "event": "throttled", 2023-08-01T19:55:30.801 INFO:teuthology.orchestra.run.smithi155.stdout: "time": "2023-08-01T19:55:05.150991+0000", 2023-08-01T19:55:30.801 INFO:teuthology.orchestra.run.smithi155.stdout: "duration": 0 2023-08-01T19:55:30.801 INFO:teuthology.orchestra.run.smithi155.stdout: }, 2023-08-01T19:55:30.801 INFO:teuthology.orchestra.run.smithi155.stdout: { 2023-08-01T19:55:30.802 INFO:teuthology.orchestra.run.smithi155.stdout: "event": "header_read", 2023-08-01T19:55:30.802 INFO:teuthology.orchestra.run.smithi155.stdout: "time": "2023-08-01T19:55:05.150990+0000", 2023-08-01T19:55:30.802 INFO:teuthology.orchestra.run.smithi155.stdout: "duration": 4294967295.999999 2023-08-01T19:55:30.802 INFO:teuthology.orchestra.run.smithi155.stdout: }, 2023-08-01T19:55:30.802 INFO:teuthology.orchestra.run.smithi155.stdout: { 2023-08-01T19:55:30.802 INFO:teuthology.orchestra.run.smithi155.stdout: "event": "all_read", 2023-08-01T19:55:30.802 INFO:teuthology.orchestra.run.smithi155.stdout: "time": "2023-08-01T19:55:05.151108+0000", 2023-08-01T19:55:30.803 INFO:teuthology.orchestra.run.smithi155.stdout: "duration": 0.00011849300000000001 2023-08-01T19:55:30.803 INFO:teuthology.orchestra.run.smithi155.stdout: }, 2023-08-01T19:55:30.803 INFO:teuthology.orchestra.run.smithi155.stdout: { 2023-08-01T19:55:30.803 INFO:teuthology.orchestra.run.smithi155.stdout: "event": "dispatched", 2023-08-01T19:55:30.803 INFO:teuthology.orchestra.run.smithi155.stdout: "time": "2023-08-01T19:55:05.151117+0000", 2023-08-01T19:55:30.803 INFO:teuthology.orchestra.run.smithi155.stdout: "duration": 8.1040000000000007e-06 2023-08-01T19:55:30.803 INFO:teuthology.orchestra.run.smithi155.stdout: }, 2023-08-01T19:55:30.803 INFO:teuthology.orchestra.run.smithi155.stdout: { 2023-08-01T19:55:30.804 INFO:teuthology.orchestra.run.smithi155.stdout: "event": "queued_for_pg", 2023-08-01T19:55:30.804 INFO:teuthology.orchestra.run.smithi155.stdout: "time": "2023-08-01T19:55:05.151121+0000", 2023-08-01T19:55:30.804 INFO:teuthology.orchestra.run.smithi155.stdout: "duration": 4.2019999999999997e-06 2023-08-01T19:55:30.804 INFO:teuthology.orchestra.run.smithi155.stdout: }, 2023-08-01T19:55:30.804 INFO:teuthology.orchestra.run.smithi155.stdout: { 2023-08-01T19:55:30.804 INFO:teuthology.orchestra.run.smithi155.stdout: "event": "reached_pg", 2023-08-01T19:55:30.804 INFO:teuthology.orchestra.run.smithi155.stdout: "time": "2023-08-01T19:55:05.151162+0000", 2023-08-01T19:55:30.804 INFO:teuthology.orchestra.run.smithi155.stdout: "duration": 4.1448e-05 2023-08-01T19:55:30.805 INFO:teuthology.orchestra.run.smithi155.stdout: }, 2023-08-01T19:55:30.805 INFO:teuthology.orchestra.run.smithi155.stdout: { 2023-08-01T19:55:30.805 INFO:teuthology.orchestra.run.smithi155.stdout: "event": "started", 2023-08-01T19:55:30.805 INFO:teuthology.orchestra.run.smithi155.stdout: "time": "2023-08-01T19:55:05.151281+0000", 2023-08-01T19:55:30.805 INFO:teuthology.orchestra.run.smithi155.stdout: "duration": 0.000119141 2023-08-01T19:55:30.805 INFO:teuthology.orchestra.run.smithi155.stdout: }, 2023-08-01T19:55:30.805 INFO:teuthology.orchestra.run.smithi155.stdout: { 2023-08-01T19:55:30.805 INFO:teuthology.orchestra.run.smithi155.stdout: "event": "waiting for subops from 0", 2023-08-01T19:55:30.806 INFO:teuthology.orchestra.run.smithi155.stdout: "time": "2023-08-01T19:55:05.151443+0000", 2023-08-01T19:55:30.806 INFO:teuthology.orchestra.run.smithi155.stdout: "duration": 0.00016181600000000001 2023-08-01T19:55:30.806 INFO:teuthology.orchestra.run.smithi155.stdout: }, 2023-08-01T19:55:30.806 INFO:teuthology.orchestra.run.smithi155.stdout: { 2023-08-01T19:55:30.806 INFO:teuthology.orchestra.run.smithi155.stdout: "event": "sub_op_commit_rec", 2023-08-01T19:55:30.806 INFO:teuthology.orchestra.run.smithi155.stdout: "time": "2023-08-01T19:55:05.219101+0000", 2023-08-01T19:55:30.806 INFO:teuthology.orchestra.run.smithi155.stdout: "duration": 0.067658037000000004 2023-08-01T19:55:30.806 INFO:teuthology.orchestra.run.smithi155.stdout: }, 2023-08-01T19:55:30.807 INFO:teuthology.orchestra.run.smithi155.stdout: { 2023-08-01T19:55:30.807 INFO:teuthology.orchestra.run.smithi155.stdout: "event": "op_commit", 2023-08-01T19:55:30.807 INFO:teuthology.orchestra.run.smithi155.stdout: "time": "2023-08-01T19:55:05.221646+0000", 2023-08-01T19:55:30.807 INFO:teuthology.orchestra.run.smithi155.stdout: "duration": 0.0025450540000000002 2023-08-01T19:55:30.807 INFO:teuthology.orchestra.run.smithi155.stdout: }, 2023-08-01T19:55:30.807 INFO:teuthology.orchestra.run.smithi155.stdout: { 2023-08-01T19:55:30.808 INFO:teuthology.orchestra.run.smithi155.stdout: "event": "commit_sent", 2023-08-01T19:55:30.808 INFO:teuthology.orchestra.run.smithi155.stdout: "time": "2023-08-01T19:55:05.221689+0000", 2023-08-01T19:55:30.808 INFO:teuthology.orchestra.run.smithi155.stdout: "duration": 4.3078999999999999e-05 2023-08-01T19:55:30.808 INFO:teuthology.orchestra.run.smithi155.stdout: }, 2023-08-01T19:55:30.809 INFO:teuthology.orchestra.run.smithi155.stdout: { 2023-08-01T19:55:30.809 INFO:teuthology.orchestra.run.smithi155.stdout: "event": "done", 2023-08-01T19:55:30.809 INFO:teuthology.orchestra.run.smithi155.stdout: "time": "2023-08-01T19:55:05.221725+0000", 2023-08-01T19:55:30.809 INFO:teuthology.orchestra.run.smithi155.stdout: "duration": 3.6137999999999999e-05 2023-08-01T19:55:30.809 INFO:teuthology.orchestra.run.smithi155.stdout: } 2023-08-01T19:55:30.809 INFO:teuthology.orchestra.run.smithi155.stdout: ] 2023-08-01T19:55:30.810 INFO:teuthology.orchestra.run.smithi155.stdout: } 2023-08-01T19:55:30.810 INFO:teuthology.orchestra.run.smithi155.stdout: }, 2023-08-01T19:55:30.810 INFO:teuthology.orchestra.run.smithi155.stdout: { 2023-08-01T19:55:30.810 INFO:teuthology.orchestra.run.smithi155.stdout: "description": "osd_repop(client.4668.0:100243 5.a e37/19 5:5e8193b6:::benchmark_data_smithi006_114134_object100242:head v 37'6228, mlcod=37'6225)", 2023-08-01T19:55:30.810 INFO:teuthology.orchestra.run.smithi155.stdout: "initiated_at": "2023-08-01T19:55:05.151148+0000", 2023-08-01T19:55:30.810 INFO:teuthology.orchestra.run.smithi155.stdout: "age": 25.580868346999999, 2023-08-01T19:55:30.810 INFO:teuthology.orchestra.run.smithi155.stdout: "duration": 0.073020370000000001, 2023-08-01T19:55:30.811 INFO:teuthology.orchestra.run.smithi155.stdout: "type_data": { 2023-08-01T19:55:30.811 INFO:teuthology.orchestra.run.smithi155.stdout: "flag_point": "commit sent; apply or cleanup", 2023-08-01T19:55:30.811 INFO:teuthology.orchestra.run.smithi155.stdout: "events": [ 2023-08-01T19:55:30.811 INFO:teuthology.orchestra.run.smithi155.stdout: { 2023-08-01T19:55:30.811 INFO:teuthology.orchestra.run.smithi155.stdout: "event": "initiated", 2023-08-01T19:55:30.811 INFO:teuthology.orchestra.run.smithi155.stdout: "time": "2023-08-01T19:55:05.151148+0000", 2023-08-01T19:55:30.811 INFO:teuthology.orchestra.run.smithi155.stdout: "duration": 0 2023-08-01T19:55:30.811 INFO:teuthology.orchestra.run.smithi155.stdout: }, 2023-08-01T19:55:30.812 INFO:teuthology.orchestra.run.smithi155.stdout: { 2023-08-01T19:55:30.812 INFO:teuthology.orchestra.run.smithi155.stdout: "event": "throttled", 2023-08-01T19:55:30.812 INFO:teuthology.orchestra.run.smithi155.stdout: "time": "2023-08-01T19:55:05.151148+0000", 2023-08-01T19:55:30.812 INFO:teuthology.orchestra.run.smithi155.stdout: "duration": 0 2023-08-01T19:55:30.812 INFO:teuthology.orchestra.run.smithi155.stdout: }, 2023-08-01T19:55:30.812 INFO:teuthology.orchestra.run.smithi155.stdout: { 2023-08-01T19:55:30.812 INFO:teuthology.orchestra.run.smithi155.stdout: "event": "header_read", 2023-08-01T19:55:30.812 INFO:teuthology.orchestra.run.smithi155.stdout: "time": "2023-08-01T19:55:05.151147+0000", 2023-08-01T19:55:30.813 INFO:teuthology.orchestra.run.smithi155.stdout: "duration": 4294967295.9999995 2023-08-01T19:55:30.813 INFO:teuthology.orchestra.run.smithi155.stdout: }, 2023-08-01T19:55:30.813 INFO:teuthology.orchestra.run.smithi155.stdout: { 2023-08-01T19:55:30.813 INFO:teuthology.orchestra.run.smithi155.stdout: "event": "all_read", 2023-08-01T19:55:30.813 INFO:teuthology.orchestra.run.smithi155.stdout: "time": "2023-08-01T19:55:05.151231+0000", 2023-08-01T19:55:30.813 INFO:teuthology.orchestra.run.smithi155.stdout: "duration": 8.3135999999999998e-05 2023-08-01T19:55:30.813 INFO:teuthology.orchestra.run.smithi155.stdout: }, 2023-08-01T19:55:30.813 INFO:teuthology.orchestra.run.smithi155.stdout: { 2023-08-01T19:55:30.814 INFO:teuthology.orchestra.run.smithi155.stdout: "event": "dispatched", 2023-08-01T19:55:30.814 INFO:teuthology.orchestra.run.smithi155.stdout: "time": "2023-08-01T19:55:05.151239+0000", 2023-08-01T19:55:30.814 INFO:teuthology.orchestra.run.smithi155.stdout: "duration": 8.7469999999999994e-06 2023-08-01T19:55:30.814 INFO:teuthology.orchestra.run.smithi155.stdout: }, 2023-08-01T19:55:30.814 INFO:teuthology.orchestra.run.smithi155.stdout: { 2023-08-01T19:55:30.814 INFO:teuthology.orchestra.run.smithi155.stdout: "event": "queued_for_pg", 2023-08-01T19:55:30.814 INFO:teuthology.orchestra.run.smithi155.stdout: "time": "2023-08-01T19:55:05.151244+0000", 2023-08-01T19:55:30.814 INFO:teuthology.orchestra.run.smithi155.stdout: "duration": 4.4800000000000003e-06 2023-08-01T19:55:30.815 INFO:teuthology.orchestra.run.smithi155.stdout: }, 2023-08-01T19:55:30.815 INFO:teuthology.orchestra.run.smithi155.stdout: { 2023-08-01T19:55:30.815 INFO:teuthology.orchestra.run.smithi155.stdout: "event": "reached_pg", 2023-08-01T19:55:30.815 INFO:teuthology.orchestra.run.smithi155.stdout: "time": "2023-08-01T19:55:05.152938+0000", 2023-08-01T19:55:30.815 INFO:teuthology.orchestra.run.smithi155.stdout: "duration": 0.001693824 2023-08-01T19:55:30.815 INFO:teuthology.orchestra.run.smithi155.stdout: }, 2023-08-01T19:55:30.815 INFO:teuthology.orchestra.run.smithi155.stdout: { 2023-08-01T19:55:30.816 INFO:teuthology.orchestra.run.smithi155.stdout: "event": "started", 2023-08-01T19:55:30.816 INFO:teuthology.orchestra.run.smithi155.stdout: "time": "2023-08-01T19:55:05.152956+0000", 2023-08-01T19:55:30.816 INFO:teuthology.orchestra.run.smithi155.stdout: "duration": 1.8287e-05 2023-08-01T19:55:30.816 INFO:teuthology.orchestra.run.smithi155.stdout: }, 2023-08-01T19:55:30.816 INFO:teuthology.orchestra.run.smithi155.stdout: { 2023-08-01T19:55:30.816 INFO:teuthology.orchestra.run.smithi155.stdout: "event": "commit_sent", 2023-08-01T19:55:30.816 INFO:teuthology.orchestra.run.smithi155.stdout: "time": "2023-08-01T19:55:05.224145+0000", 2023-08-01T19:55:30.816 INFO:teuthology.orchestra.run.smithi155.stdout: "duration": 0.071189447000000003 2023-08-01T19:55:30.817 INFO:teuthology.orchestra.run.smithi155.stdout: }, 2023-08-01T19:55:30.817 INFO:teuthology.orchestra.run.smithi155.stdout: { 2023-08-01T19:55:30.817 INFO:teuthology.orchestra.run.smithi155.stdout: "event": "done", 2023-08-01T19:55:30.817 INFO:teuthology.orchestra.run.smithi155.stdout: "time": "2023-08-01T19:55:05.224168+0000", 2023-08-01T19:55:30.817 INFO:teuthology.orchestra.run.smithi155.stdout: "duration": 2.3008999999999999e-05 2023-08-01T19:55:30.817 INFO:teuthology.orchestra.run.smithi155.stdout: } 2023-08-01T19:55:30.817 INFO:teuthology.orchestra.run.smithi155.stdout: ] 2023-08-01T19:55:30.817 INFO:teuthology.orchestra.run.smithi155.stdout: } 2023-08-01T19:55:30.818 INFO:teuthology.orchestra.run.smithi155.stdout: }, 2023-08-01T19:55:30.818 INFO:teuthology.orchestra.run.smithi155.stdout: { 2023-08-01T19:55:30.818 INFO:teuthology.orchestra.run.smithi155.stdout: "description": "osd_repop(client.4668.0:100244 5.9 e37/19 5:92f56a12:::benchmark_data_smithi006_114134_object100243:head v 37'6294, mlcod=37'6292)", 2023-08-01T19:55:30.818 INFO:teuthology.orchestra.run.smithi155.stdout: "initiated_at": "2023-08-01T19:55:05.151325+0000", 2023-08-01T19:55:30.818 INFO:teuthology.orchestra.run.smithi155.stdout: "age": 25.580691002000002, 2023-08-01T19:55:30.818 INFO:teuthology.orchestra.run.smithi155.stdout: "duration": 0.071883673999999995, 2023-08-01T19:55:30.818 INFO:teuthology.orchestra.run.smithi155.stdout: "type_data": { 2023-08-01T19:55:30.818 INFO:teuthology.orchestra.run.smithi155.stdout: "flag_point": "commit sent; apply or cleanup", 2023-08-01T19:55:30.819 INFO:teuthology.orchestra.run.smithi155.stdout: "events": [ 2023-08-01T19:55:30.819 INFO:teuthology.orchestra.run.smithi155.stdout: { 2023-08-01T19:55:30.819 INFO:teuthology.orchestra.run.smithi155.stdout: "event": "initiated", 2023-08-01T19:55:30.819 INFO:teuthology.orchestra.run.smithi155.stdout: "time": "2023-08-01T19:55:05.151325+0000", 2023-08-01T19:55:30.819 INFO:teuthology.orchestra.run.smithi155.stdout: "duration": 0 2023-08-01T19:55:30.819 INFO:teuthology.orchestra.run.smithi155.stdout: }, 2023-08-01T19:55:30.819 INFO:teuthology.orchestra.run.smithi155.stdout: { 2023-08-01T19:55:30.819 INFO:teuthology.orchestra.run.smithi155.stdout: "event": "throttled", 2023-08-01T19:55:30.820 INFO:teuthology.orchestra.run.smithi155.stdout: "time": "2023-08-01T19:55:05.151325+0000", 2023-08-01T19:55:30.820 INFO:teuthology.orchestra.run.smithi155.stdout: "duration": 0 2023-08-01T19:55:30.820 INFO:teuthology.orchestra.run.smithi155.stdout: }, 2023-08-01T19:55:30.820 INFO:teuthology.orchestra.run.smithi155.stdout: { 2023-08-01T19:55:30.820 INFO:teuthology.orchestra.run.smithi155.stdout: "event": "header_read", 2023-08-01T19:55:30.820 INFO:teuthology.orchestra.run.smithi155.stdout: "time": "2023-08-01T19:55:05.151325+0000", 2023-08-01T19:55:30.820 INFO:teuthology.orchestra.run.smithi155.stdout: "duration": 4294967295.9999995 2023-08-01T19:55:30.821 INFO:teuthology.orchestra.run.smithi155.stdout: }, 2023-08-01T19:55:30.821 INFO:teuthology.orchestra.run.smithi155.stdout: { 2023-08-01T19:55:30.821 INFO:teuthology.orchestra.run.smithi155.stdout: "event": "all_read", 2023-08-01T19:55:30.821 INFO:teuthology.orchestra.run.smithi155.stdout: "time": "2023-08-01T19:55:05.151390+0000", 2023-08-01T19:55:30.821 INFO:teuthology.orchestra.run.smithi155.stdout: "duration": 6.5456999999999993e-05 2023-08-01T19:55:30.821 INFO:teuthology.orchestra.run.smithi155.stdout: }, 2023-08-01T19:55:30.821 INFO:teuthology.orchestra.run.smithi155.stdout: { 2023-08-01T19:55:30.821 INFO:teuthology.orchestra.run.smithi155.stdout: "event": "dispatched", 2023-08-01T19:55:30.822 INFO:teuthology.orchestra.run.smithi155.stdout: "time": "2023-08-01T19:55:05.151396+0000", 2023-08-01T19:55:30.822 INFO:teuthology.orchestra.run.smithi155.stdout: "duration": 5.9190000000000004e-06 2023-08-01T19:55:30.822 INFO:teuthology.orchestra.run.smithi155.stdout: }, 2023-08-01T19:55:30.822 INFO:teuthology.orchestra.run.smithi155.stdout: { 2023-08-01T19:55:30.822 INFO:teuthology.orchestra.run.smithi155.stdout: "event": "queued_for_pg", 2023-08-01T19:55:30.822 INFO:teuthology.orchestra.run.smithi155.stdout: "time": "2023-08-01T19:55:05.151400+0000", 2023-08-01T19:55:30.822 INFO:teuthology.orchestra.run.smithi155.stdout: "duration": 4.1030000000000004e-06 2023-08-01T19:55:30.822 INFO:teuthology.orchestra.run.smithi155.stdout: }, 2023-08-01T19:55:30.823 INFO:teuthology.orchestra.run.smithi155.stdout: { 2023-08-01T19:55:30.823 INFO:teuthology.orchestra.run.smithi155.stdout: "event": "reached_pg", 2023-08-01T19:55:30.823 INFO:teuthology.orchestra.run.smithi155.stdout: "time": "2023-08-01T19:55:05.151452+0000", 2023-08-01T19:55:30.823 INFO:teuthology.orchestra.run.smithi155.stdout: "duration": 5.2136999999999999e-05 2023-08-01T19:55:30.823 INFO:teuthology.orchestra.run.smithi155.stdout: }, 2023-08-01T19:55:30.823 INFO:teuthology.orchestra.run.smithi155.stdout: { 2023-08-01T19:55:30.823 INFO:teuthology.orchestra.run.smithi155.stdout: "event": "started", 2023-08-01T19:55:30.823 INFO:teuthology.orchestra.run.smithi155.stdout: "time": "2023-08-01T19:55:05.151470+0000", 2023-08-01T19:55:30.824 INFO:teuthology.orchestra.run.smithi155.stdout: "duration": 1.8e-05 2023-08-01T19:55:30.824 INFO:teuthology.orchestra.run.smithi155.stdout: }, 2023-08-01T19:55:30.824 INFO:teuthology.orchestra.run.smithi155.stdout: { 2023-08-01T19:55:30.824 INFO:teuthology.orchestra.run.smithi155.stdout: "event": "commit_sent", 2023-08-01T19:55:30.824 INFO:teuthology.orchestra.run.smithi155.stdout: "time": "2023-08-01T19:55:05.223183+0000", 2023-08-01T19:55:30.824 INFO:teuthology.orchestra.run.smithi155.stdout: "duration": 0.071712622000000004 2023-08-01T19:55:30.824 INFO:teuthology.orchestra.run.smithi155.stdout: }, 2023-08-01T19:55:30.824 INFO:teuthology.orchestra.run.smithi155.stdout: { 2023-08-01T19:55:30.825 INFO:teuthology.orchestra.run.smithi155.stdout: "event": "done", 2023-08-01T19:55:30.825 INFO:teuthology.orchestra.run.smithi155.stdout: "time": "2023-08-01T19:55:05.223209+0000", 2023-08-01T19:55:30.825 INFO:teuthology.orchestra.run.smithi155.stdout: "duration": 2.5956e-05 2023-08-01T19:55:30.825 INFO:teuthology.orchestra.run.smithi155.stdout: } 2023-08-01T19:55:30.825 INFO:teuthology.orchestra.run.smithi155.stdout: ] 2023-08-01T19:55:30.825 INFO:teuthology.orchestra.run.smithi155.stdout: } 2023-08-01T19:55:30.825 INFO:teuthology.orchestra.run.smithi155.stdout: }, 2023-08-01T19:55:30.825 INFO:teuthology.orchestra.run.smithi155.stdout: { 2023-08-01T19:55:30.826 INFO:teuthology.orchestra.run.smithi155.stdout: "description": "osd_op(client.4668.0:100249 5.b 5:d0666827:::benchmark_data_smithi006_114134_object100248:head [set-alloc-hint object_size 65536 write_size 65536,write 0~65536] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e37)", 2023-08-01T19:55:30.826 INFO:teuthology.orchestra.run.smithi155.stdout: "initiated_at": "2023-08-01T19:55:05.153614+0000", 2023-08-01T19:55:30.826 INFO:teuthology.orchestra.run.smithi155.stdout: "age": 25.578402576999999, 2023-08-01T19:55:30.826 INFO:teuthology.orchestra.run.smithi155.stdout: "duration": 0.069286118999999993, 2023-08-01T19:55:30.826 INFO:teuthology.orchestra.run.smithi155.stdout: "type_data": { 2023-08-01T19:55:30.826 INFO:teuthology.orchestra.run.smithi155.stdout: "flag_point": "commit sent; apply or cleanup", 2023-08-01T19:55:30.826 INFO:teuthology.orchestra.run.smithi155.stdout: "client_info": { 2023-08-01T19:55:30.826 INFO:teuthology.orchestra.run.smithi155.stdout: "client": "client.4668", 2023-08-01T19:55:30.827 INFO:teuthology.orchestra.run.smithi155.stdout: "client_addr": "172.21.15.6:0/1709472247", 2023-08-01T19:55:30.827 INFO:teuthology.orchestra.run.smithi155.stdout: "tid": 100249 2023-08-01T19:55:30.827 INFO:teuthology.orchestra.run.smithi155.stdout: }, 2023-08-01T19:55:30.827 INFO:teuthology.orchestra.run.smithi155.stdout: "events": [ 2023-08-01T19:55:30.827 INFO:teuthology.orchestra.run.smithi155.stdout: { 2023-08-01T19:55:30.827 INFO:teuthology.orchestra.run.smithi155.stdout: "event": "initiated", 2023-08-01T19:55:30.827 INFO:teuthology.orchestra.run.smithi155.stdout: "time": "2023-08-01T19:55:05.153614+0000", 2023-08-01T19:55:30.828 INFO:teuthology.orchestra.run.smithi155.stdout: "duration": 0 2023-08-01T19:55:30.828 INFO:teuthology.orchestra.run.smithi155.stdout: }, 2023-08-01T19:55:30.828 INFO:teuthology.orchestra.run.smithi155.stdout: { 2023-08-01T19:55:30.828 INFO:teuthology.orchestra.run.smithi155.stdout: "event": "throttled", 2023-08-01T19:55:30.828 INFO:teuthology.orchestra.run.smithi155.stdout: "time": "2023-08-01T19:55:05.153614+0000", 2023-08-01T19:55:30.829 INFO:teuthology.orchestra.run.smithi155.stdout: "duration": 0 2023-08-01T19:55:30.829 INFO:teuthology.orchestra.run.smithi155.stdout: }, 2023-08-01T19:55:30.829 INFO:teuthology.orchestra.run.smithi155.stdout: { 2023-08-01T19:55:30.829 INFO:teuthology.orchestra.run.smithi155.stdout: "event": "header_read", 2023-08-01T19:55:30.830 INFO:teuthology.orchestra.run.smithi155.stdout: "time": "2023-08-01T19:55:05.153612+0000", 2023-08-01T19:55:30.830 INFO:teuthology.orchestra.run.smithi155.stdout: "duration": 4294967295.9999986 2023-08-01T19:55:30.830 INFO:teuthology.orchestra.run.smithi155.stdout: }, 2023-08-01T19:55:30.830 INFO:teuthology.orchestra.run.smithi155.stdout: { 2023-08-01T19:55:30.831 INFO:teuthology.orchestra.run.smithi155.stdout: "event": "all_read", 2023-08-01T19:55:30.831 INFO:teuthology.orchestra.run.smithi155.stdout: "time": "2023-08-01T19:55:05.153694+0000", 2023-08-01T19:55:30.831 INFO:teuthology.orchestra.run.smithi155.stdout: "duration": 8.1618000000000004e-05 2023-08-01T19:55:30.831 INFO:teuthology.orchestra.run.smithi155.stdout: }, 2023-08-01T19:55:30.831 INFO:teuthology.orchestra.run.smithi155.stdout: { 2023-08-01T19:55:30.831 INFO:teuthology.orchestra.run.smithi155.stdout: "event": "dispatched", 2023-08-01T19:55:30.831 INFO:teuthology.orchestra.run.smithi155.stdout: "time": "2023-08-01T19:55:05.153713+0000", 2023-08-01T19:55:30.832 INFO:teuthology.orchestra.run.smithi155.stdout: "duration": 1.9069999999999999e-05 2023-08-01T19:55:30.832 INFO:teuthology.orchestra.run.smithi155.stdout: }, 2023-08-01T19:55:30.832 INFO:teuthology.orchestra.run.smithi155.stdout: { 2023-08-01T19:55:30.832 INFO:teuthology.orchestra.run.smithi155.stdout: "event": "queued_for_pg", 2023-08-01T19:55:30.832 INFO:teuthology.orchestra.run.smithi155.stdout: "time": "2023-08-01T19:55:05.153726+0000", 2023-08-01T19:55:30.832 INFO:teuthology.orchestra.run.smithi155.stdout: "duration": 1.238e-05 2023-08-01T19:55:30.832 INFO:teuthology.orchestra.run.smithi155.stdout: }, 2023-08-01T19:55:30.833 INFO:teuthology.orchestra.run.smithi155.stdout: { 2023-08-01T19:55:30.833 INFO:teuthology.orchestra.run.smithi155.stdout: "event": "reached_pg", 2023-08-01T19:55:30.833 INFO:teuthology.orchestra.run.smithi155.stdout: "time": "2023-08-01T19:55:05.153761+0000", 2023-08-01T19:55:30.833 INFO:teuthology.orchestra.run.smithi155.stdout: "duration": 3.5046999999999998e-05 2023-08-01T19:55:30.833 INFO:teuthology.orchestra.run.smithi155.stdout: }, 2023-08-01T19:55:30.833 INFO:teuthology.orchestra.run.smithi155.stdout: { 2023-08-01T19:55:30.833 INFO:teuthology.orchestra.run.smithi155.stdout: "event": "started", 2023-08-01T19:55:30.833 INFO:teuthology.orchestra.run.smithi155.stdout: "time": "2023-08-01T19:55:05.153896+0000", 2023-08-01T19:55:30.834 INFO:teuthology.orchestra.run.smithi155.stdout: "duration": 0.00013575800000000001 2023-08-01T19:55:30.834 INFO:teuthology.orchestra.run.smithi155.stdout: }, 2023-08-01T19:55:30.834 INFO:teuthology.orchestra.run.smithi155.stdout: { 2023-08-01T19:55:30.834 INFO:teuthology.orchestra.run.smithi155.stdout: "event": "waiting for subops from 0", 2023-08-01T19:55:30.834 INFO:teuthology.orchestra.run.smithi155.stdout: "time": "2023-08-01T19:55:05.154043+0000", 2023-08-01T19:55:30.834 INFO:teuthology.orchestra.run.smithi155.stdout: "duration": 0.00014650700000000001 2023-08-01T19:55:30.834 INFO:teuthology.orchestra.run.smithi155.stdout: }, 2023-08-01T19:55:30.834 INFO:teuthology.orchestra.run.smithi155.stdout: { 2023-08-01T19:55:30.835 INFO:teuthology.orchestra.run.smithi155.stdout: "event": "sub_op_commit_rec", 2023-08-01T19:55:30.835 INFO:teuthology.orchestra.run.smithi155.stdout: "time": "2023-08-01T19:55:05.221876+0000", 2023-08-01T19:55:30.835 INFO:teuthology.orchestra.run.smithi155.stdout: "duration": 0.067832796000000001 2023-08-01T19:55:30.835 INFO:teuthology.orchestra.run.smithi155.stdout: }, 2023-08-01T19:55:30.835 INFO:teuthology.orchestra.run.smithi155.stdout: { 2023-08-01T19:55:30.835 INFO:teuthology.orchestra.run.smithi155.stdout: "event": "op_commit", 2023-08-01T19:55:30.835 INFO:teuthology.orchestra.run.smithi155.stdout: "time": "2023-08-01T19:55:05.222813+0000", 2023-08-01T19:55:30.835 INFO:teuthology.orchestra.run.smithi155.stdout: "duration": 0.00093755300000000004 2023-08-01T19:55:30.836 INFO:teuthology.orchestra.run.smithi155.stdout: }, 2023-08-01T19:55:30.836 INFO:teuthology.orchestra.run.smithi155.stdout: { 2023-08-01T19:55:30.836 INFO:teuthology.orchestra.run.smithi155.stdout: "event": "commit_sent", 2023-08-01T19:55:30.836 INFO:teuthology.orchestra.run.smithi155.stdout: "time": "2023-08-01T19:55:05.222861+0000", 2023-08-01T19:55:30.836 INFO:teuthology.orchestra.run.smithi155.stdout: "duration": 4.8013999999999998e-05 2023-08-01T19:55:30.836 INFO:teuthology.orchestra.run.smithi155.stdout: }, 2023-08-01T19:55:30.836 INFO:teuthology.orchestra.run.smithi155.stdout: { 2023-08-01T19:55:30.836 INFO:teuthology.orchestra.run.smithi155.stdout: "event": "done", 2023-08-01T19:55:30.837 INFO:teuthology.orchestra.run.smithi155.stdout: "time": "2023-08-01T19:55:05.222900+0000", 2023-08-01T19:55:30.837 INFO:teuthology.orchestra.run.smithi155.stdout: "duration": 3.8634999999999999e-05 2023-08-01T19:55:30.837 INFO:teuthology.orchestra.run.smithi155.stdout: } 2023-08-01T19:55:30.837 INFO:teuthology.orchestra.run.smithi155.stdout: ] 2023-08-01T19:55:30.837 INFO:teuthology.orchestra.run.smithi155.stdout: } 2023-08-01T19:55:30.837 INFO:teuthology.orchestra.run.smithi155.stdout: }, 2023-08-01T19:55:30.837 INFO:teuthology.orchestra.run.smithi155.stdout: { 2023-08-01T19:55:30.838 INFO:teuthology.orchestra.run.smithi155.stdout: "description": "osd_op(client.4668.0:100251 5.b 5:d853df24:::benchmark_data_smithi006_114134_object100250:head [set-alloc-hint object_size 65536 write_size 65536,write 0~65536] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e37)", 2023-08-01T19:55:30.838 INFO:teuthology.orchestra.run.smithi155.stdout: "initiated_at": "2023-08-01T19:55:05.153737+0000", 2023-08-01T19:55:30.838 INFO:teuthology.orchestra.run.smithi155.stdout: "age": 25.578279562999999, 2023-08-01T19:55:30.838 INFO:teuthology.orchestra.run.smithi155.stdout: "duration": 0.071366545000000003, 2023-08-01T19:55:30.838 INFO:teuthology.orchestra.run.smithi155.stdout: "type_data": { 2023-08-01T19:55:30.838 INFO:teuthology.orchestra.run.smithi155.stdout: "flag_point": "commit sent; apply or cleanup", 2023-08-01T19:55:30.838 INFO:teuthology.orchestra.run.smithi155.stdout: "client_info": { 2023-08-01T19:55:30.838 INFO:teuthology.orchestra.run.smithi155.stdout: "client": "client.4668", 2023-08-01T19:55:30.839 INFO:teuthology.orchestra.run.smithi155.stdout: "client_addr": "172.21.15.6:0/1709472247", 2023-08-01T19:55:30.839 INFO:teuthology.orchestra.run.smithi155.stdout: "tid": 100251 2023-08-01T19:55:30.839 INFO:teuthology.orchestra.run.smithi155.stdout: }, 2023-08-01T19:55:30.839 INFO:teuthology.orchestra.run.smithi155.stdout: "events": [ 2023-08-01T19:55:30.839 INFO:teuthology.orchestra.run.smithi155.stdout: { 2023-08-01T19:55:30.839 INFO:teuthology.orchestra.run.smithi155.stdout: "event": "initiated", 2023-08-01T19:55:30.839 INFO:teuthology.orchestra.run.smithi155.stdout: "time": "2023-08-01T19:55:05.153737+0000", 2023-08-01T19:55:30.839 INFO:teuthology.orchestra.run.smithi155.stdout: "duration": 0 2023-08-01T19:55:30.840 INFO:teuthology.orchestra.run.smithi155.stdout: }, 2023-08-01T19:55:30.840 INFO:teuthology.orchestra.run.smithi155.stdout: { 2023-08-01T19:55:30.840 INFO:teuthology.orchestra.run.smithi155.stdout: "event": "throttled", 2023-08-01T19:55:30.840 INFO:teuthology.orchestra.run.smithi155.stdout: "time": "2023-08-01T19:55:05.153737+0000", 2023-08-01T19:55:30.840 INFO:teuthology.orchestra.run.smithi155.stdout: "duration": 0 2023-08-01T19:55:30.840 INFO:teuthology.orchestra.run.smithi155.stdout: }, 2023-08-01T19:55:30.840 INFO:teuthology.orchestra.run.smithi155.stdout: { 2023-08-01T19:55:30.840 INFO:teuthology.orchestra.run.smithi155.stdout: "event": "header_read", 2023-08-01T19:55:30.841 INFO:teuthology.orchestra.run.smithi155.stdout: "time": "2023-08-01T19:55:05.153736+0000", 2023-08-01T19:55:30.841 INFO:teuthology.orchestra.run.smithi155.stdout: "duration": 4294967295.9999995 2023-08-01T19:55:30.841 INFO:teuthology.orchestra.run.smithi155.stdout: }, 2023-08-01T19:55:30.841 INFO:teuthology.orchestra.run.smithi155.stdout: { 2023-08-01T19:55:30.841 INFO:teuthology.orchestra.run.smithi155.stdout: "event": "all_read", 2023-08-01T19:55:30.841 INFO:teuthology.orchestra.run.smithi155.stdout: "time": "2023-08-01T19:55:05.153784+0000", 2023-08-01T19:55:30.841 INFO:teuthology.orchestra.run.smithi155.stdout: "duration": 4.7660000000000001e-05 2023-08-01T19:55:30.841 INFO:teuthology.orchestra.run.smithi155.stdout: }, 2023-08-01T19:55:30.842 INFO:teuthology.orchestra.run.smithi155.stdout: { 2023-08-01T19:55:30.842 INFO:teuthology.orchestra.run.smithi155.stdout: "event": "dispatched", 2023-08-01T19:55:30.842 INFO:teuthology.orchestra.run.smithi155.stdout: "time": "2023-08-01T19:55:05.153793+0000", 2023-08-01T19:55:30.842 INFO:teuthology.orchestra.run.smithi155.stdout: "duration": 8.7150000000000004e-06 2023-08-01T19:55:30.842 INFO:teuthology.orchestra.run.smithi155.stdout: }, 2023-08-01T19:55:30.842 INFO:teuthology.orchestra.run.smithi155.stdout: { 2023-08-01T19:55:30.842 INFO:teuthology.orchestra.run.smithi155.stdout: "event": "queued_for_pg", 2023-08-01T19:55:30.842 INFO:teuthology.orchestra.run.smithi155.stdout: "time": "2023-08-01T19:55:05.153800+0000", 2023-08-01T19:55:30.843 INFO:teuthology.orchestra.run.smithi155.stdout: "duration": 7.2459999999999997e-06 2023-08-01T19:55:30.843 INFO:teuthology.orchestra.run.smithi155.stdout: }, 2023-08-01T19:55:30.843 INFO:teuthology.orchestra.run.smithi155.stdout: { 2023-08-01T19:55:30.843 INFO:teuthology.orchestra.run.smithi155.stdout: "event": "reached_pg", 2023-08-01T19:55:30.843 INFO:teuthology.orchestra.run.smithi155.stdout: "time": "2023-08-01T19:55:05.156241+0000", 2023-08-01T19:55:30.843 INFO:teuthology.orchestra.run.smithi155.stdout: "duration": 0.0024415359999999998 2023-08-01T19:55:30.843 INFO:teuthology.orchestra.run.smithi155.stdout: }, 2023-08-01T19:55:30.843 INFO:teuthology.orchestra.run.smithi155.stdout: { 2023-08-01T19:55:30.844 INFO:teuthology.orchestra.run.smithi155.stdout: "event": "started", 2023-08-01T19:55:30.844 INFO:teuthology.orchestra.run.smithi155.stdout: "time": "2023-08-01T19:55:05.219045+0000", 2023-08-01T19:55:30.844 INFO:teuthology.orchestra.run.smithi155.stdout: "duration": 0.062803855000000006 2023-08-01T19:55:30.844 INFO:teuthology.orchestra.run.smithi155.stdout: }, 2023-08-01T19:55:30.844 INFO:teuthology.orchestra.run.smithi155.stdout: { 2023-08-01T19:55:30.844 INFO:teuthology.orchestra.run.smithi155.stdout: "event": "waiting for subops from 0", 2023-08-01T19:55:30.844 INFO:teuthology.orchestra.run.smithi155.stdout: "time": "2023-08-01T19:55:05.219238+0000", 2023-08-01T19:55:30.845 INFO:teuthology.orchestra.run.smithi155.stdout: "duration": 0.00019241500000000001 2023-08-01T19:55:30.845 INFO:teuthology.orchestra.run.smithi155.stdout: }, 2023-08-01T19:55:30.845 INFO:teuthology.orchestra.run.smithi155.stdout: { 2023-08-01T19:55:30.845 INFO:teuthology.orchestra.run.smithi155.stdout: "event": "sub_op_commit_rec", 2023-08-01T19:55:30.845 INFO:teuthology.orchestra.run.smithi155.stdout: "time": "2023-08-01T19:55:05.223300+0000", 2023-08-01T19:55:30.845 INFO:teuthology.orchestra.run.smithi155.stdout: "duration": 0.0040626509999999996 2023-08-01T19:55:30.845 INFO:teuthology.orchestra.run.smithi155.stdout: }, 2023-08-01T19:55:30.845 INFO:teuthology.orchestra.run.smithi155.stdout: { 2023-08-01T19:55:30.846 INFO:teuthology.orchestra.run.smithi155.stdout: "event": "op_commit", 2023-08-01T19:55:30.846 INFO:teuthology.orchestra.run.smithi155.stdout: "time": "2023-08-01T19:55:05.225020+0000", 2023-08-01T19:55:30.846 INFO:teuthology.orchestra.run.smithi155.stdout: "duration": 0.0017201 2023-08-01T19:55:30.846 INFO:teuthology.orchestra.run.smithi155.stdout: }, 2023-08-01T19:55:30.846 INFO:teuthology.orchestra.run.smithi155.stdout: { 2023-08-01T19:55:30.846 INFO:teuthology.orchestra.run.smithi155.stdout: "event": "commit_sent", 2023-08-01T19:55:30.846 INFO:teuthology.orchestra.run.smithi155.stdout: "time": "2023-08-01T19:55:05.225066+0000", 2023-08-01T19:55:30.846 INFO:teuthology.orchestra.run.smithi155.stdout: "duration": 4.6143000000000002e-05 2023-08-01T19:55:30.847 INFO:teuthology.orchestra.run.smithi155.stdout: }, 2023-08-01T19:55:30.847 INFO:teuthology.orchestra.run.smithi155.stdout: { 2023-08-01T19:55:30.847 INFO:teuthology.orchestra.run.smithi155.stdout: "event": "done", 2023-08-01T19:55:30.847 INFO:teuthology.orchestra.run.smithi155.stdout: "time": "2023-08-01T19:55:05.225103+0000", 2023-08-01T19:55:30.847 INFO:teuthology.orchestra.run.smithi155.stdout: "duration": 3.6789999999999998e-05 2023-08-01T19:55:30.847 INFO:teuthology.orchestra.run.smithi155.stdout: } 2023-08-01T19:55:30.847 INFO:teuthology.orchestra.run.smithi155.stdout: ] 2023-08-01T19:55:30.847 INFO:teuthology.orchestra.run.smithi155.stdout: } 2023-08-01T19:55:30.848 INFO:teuthology.orchestra.run.smithi155.stdout: }, 2023-08-01T19:55:30.848 INFO:teuthology.orchestra.run.smithi155.stdout: { 2023-08-01T19:55:30.848 INFO:teuthology.orchestra.run.smithi155.stdout: "description": "osd_op(client.4668.0:100252 5.0 5:01f90c3c:::benchmark_data_smithi006_114134_object100251:head [set-alloc-hint object_size 65536 write_size 65536,write 0~65536] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e37)", 2023-08-01T19:55:30.848 INFO:teuthology.orchestra.run.smithi155.stdout: "initiated_at": "2023-08-01T19:55:05.154048+0000", 2023-08-01T19:55:30.848 INFO:teuthology.orchestra.run.smithi155.stdout: "age": 25.577968316, 2023-08-01T19:55:30.848 INFO:teuthology.orchestra.run.smithi155.stdout: "duration": 0.070156683999999997, 2023-08-01T19:55:30.848 INFO:teuthology.orchestra.run.smithi155.stdout: "type_data": { 2023-08-01T19:55:30.849 INFO:teuthology.orchestra.run.smithi155.stdout: "flag_point": "commit sent; apply or cleanup", 2023-08-01T19:55:30.849 INFO:teuthology.orchestra.run.smithi155.stdout: "client_info": { 2023-08-01T19:55:30.849 INFO:teuthology.orchestra.run.smithi155.stdout: "client": "client.4668", 2023-08-01T19:55:30.849 INFO:teuthology.orchestra.run.smithi155.stdout: "client_addr": "172.21.15.6:0/1709472247", 2023-08-01T19:55:30.849 INFO:teuthology.orchestra.run.smithi155.stdout: "tid": 100252 2023-08-01T19:55:30.849 INFO:teuthology.orchestra.run.smithi155.stdout: }, 2023-08-01T19:55:30.850 INFO:teuthology.orchestra.run.smithi155.stdout: "events": [ 2023-08-01T19:55:30.850 INFO:teuthology.orchestra.run.smithi155.stdout: { 2023-08-01T19:55:30.850 INFO:teuthology.orchestra.run.smithi155.stdout: "event": "initiated", 2023-08-01T19:55:30.850 INFO:teuthology.orchestra.run.smithi155.stdout: "time": "2023-08-01T19:55:05.154048+0000", 2023-08-01T19:55:30.851 INFO:teuthology.orchestra.run.smithi155.stdout: "duration": 0 2023-08-01T19:55:30.851 INFO:teuthology.orchestra.run.smithi155.stdout: }, 2023-08-01T19:55:30.851 INFO:teuthology.orchestra.run.smithi155.stdout: { 2023-08-01T19:55:30.851 INFO:teuthology.orchestra.run.smithi155.stdout: "event": "throttled", 2023-08-01T19:55:30.851 INFO:teuthology.orchestra.run.smithi155.stdout: "time": "2023-08-01T19:55:05.154048+0000", 2023-08-01T19:55:30.851 INFO:teuthology.orchestra.run.smithi155.stdout: "duration": 0 2023-08-01T19:55:30.851 INFO:teuthology.orchestra.run.smithi155.stdout: }, 2023-08-01T19:55:30.851 INFO:teuthology.orchestra.run.smithi155.stdout: { 2023-08-01T19:55:30.852 INFO:teuthology.orchestra.run.smithi155.stdout: "event": "header_read", 2023-08-01T19:55:30.852 INFO:teuthology.orchestra.run.smithi155.stdout: "time": "2023-08-01T19:55:05.154047+0000", 2023-08-01T19:55:30.852 INFO:teuthology.orchestra.run.smithi155.stdout: "duration": 4294967295.999999 2023-08-01T19:55:30.852 INFO:teuthology.orchestra.run.smithi155.stdout: }, 2023-08-01T19:55:30.852 INFO:teuthology.orchestra.run.smithi155.stdout: { 2023-08-01T19:55:30.852 INFO:teuthology.orchestra.run.smithi155.stdout: "event": "all_read", 2023-08-01T19:55:30.852 INFO:teuthology.orchestra.run.smithi155.stdout: "time": "2023-08-01T19:55:05.154115+0000", 2023-08-01T19:55:30.853 INFO:teuthology.orchestra.run.smithi155.stdout: "duration": 6.7545999999999993e-05 2023-08-01T19:55:30.853 INFO:teuthology.orchestra.run.smithi155.stdout: }, 2023-08-01T19:55:30.853 INFO:teuthology.orchestra.run.smithi155.stdout: { 2023-08-01T19:55:30.853 INFO:teuthology.orchestra.run.smithi155.stdout: "event": "dispatched", 2023-08-01T19:55:30.853 INFO:teuthology.orchestra.run.smithi155.stdout: "time": "2023-08-01T19:55:05.154125+0000", 2023-08-01T19:55:30.853 INFO:teuthology.orchestra.run.smithi155.stdout: "duration": 1.0669000000000001e-05 2023-08-01T19:55:30.853 INFO:teuthology.orchestra.run.smithi155.stdout: }, 2023-08-01T19:55:30.853 INFO:teuthology.orchestra.run.smithi155.stdout: { 2023-08-01T19:55:30.854 INFO:teuthology.orchestra.run.smithi155.stdout: "event": "queued_for_pg", 2023-08-01T19:55:30.854 INFO:teuthology.orchestra.run.smithi155.stdout: "time": "2023-08-01T19:55:05.154131+0000", 2023-08-01T19:55:30.854 INFO:teuthology.orchestra.run.smithi155.stdout: "duration": 6.0349999999999998e-06 2023-08-01T19:55:30.854 INFO:teuthology.orchestra.run.smithi155.stdout: }, 2023-08-01T19:55:30.854 INFO:teuthology.orchestra.run.smithi155.stdout: { 2023-08-01T19:55:30.854 INFO:teuthology.orchestra.run.smithi155.stdout: "event": "reached_pg", 2023-08-01T19:55:30.854 INFO:teuthology.orchestra.run.smithi155.stdout: "time": "2023-08-01T19:55:05.154174+0000", 2023-08-01T19:55:30.854 INFO:teuthology.orchestra.run.smithi155.stdout: "duration": 4.2429000000000003e-05 2023-08-01T19:55:30.855 INFO:teuthology.orchestra.run.smithi155.stdout: }, 2023-08-01T19:55:30.855 INFO:teuthology.orchestra.run.smithi155.stdout: { 2023-08-01T19:55:30.855 INFO:teuthology.orchestra.run.smithi155.stdout: "event": "started", 2023-08-01T19:55:30.855 INFO:teuthology.orchestra.run.smithi155.stdout: "time": "2023-08-01T19:55:05.154287+0000", 2023-08-01T19:55:30.855 INFO:teuthology.orchestra.run.smithi155.stdout: "duration": 0.000113138 2023-08-01T19:55:30.855 INFO:teuthology.orchestra.run.smithi155.stdout: }, 2023-08-01T19:55:30.855 INFO:teuthology.orchestra.run.smithi155.stdout: { 2023-08-01T19:55:30.855 INFO:teuthology.orchestra.run.smithi155.stdout: "event": "waiting for subops from 0", 2023-08-01T19:55:30.856 INFO:teuthology.orchestra.run.smithi155.stdout: "time": "2023-08-01T19:55:05.154420+0000", 2023-08-01T19:55:30.856 INFO:teuthology.orchestra.run.smithi155.stdout: "duration": 0.000133292 2023-08-01T19:55:30.856 INFO:teuthology.orchestra.run.smithi155.stdout: }, 2023-08-01T19:55:30.856 INFO:teuthology.orchestra.run.smithi155.stdout: { 2023-08-01T19:55:30.856 INFO:teuthology.orchestra.run.smithi155.stdout: "event": "sub_op_commit_rec", 2023-08-01T19:55:30.856 INFO:teuthology.orchestra.run.smithi155.stdout: "time": "2023-08-01T19:55:05.219034+0000", 2023-08-01T19:55:30.856 INFO:teuthology.orchestra.run.smithi155.stdout: "duration": 0.064613429999999999 2023-08-01T19:55:30.857 INFO:teuthology.orchestra.run.smithi155.stdout: }, 2023-08-01T19:55:30.857 INFO:teuthology.orchestra.run.smithi155.stdout: { 2023-08-01T19:55:30.857 INFO:teuthology.orchestra.run.smithi155.stdout: "event": "op_commit", 2023-08-01T19:55:30.857 INFO:teuthology.orchestra.run.smithi155.stdout: "time": "2023-08-01T19:55:05.224138+0000", 2023-08-01T19:55:30.857 INFO:teuthology.orchestra.run.smithi155.stdout: "duration": 0.0051041999999999997 2023-08-01T19:55:30.857 INFO:teuthology.orchestra.run.smithi155.stdout: }, 2023-08-01T19:55:30.857 INFO:teuthology.orchestra.run.smithi155.stdout: { 2023-08-01T19:55:30.857 INFO:teuthology.orchestra.run.smithi155.stdout: "event": "commit_sent", 2023-08-01T19:55:30.858 INFO:teuthology.orchestra.run.smithi155.stdout: "time": "2023-08-01T19:55:05.224171+0000", 2023-08-01T19:55:30.858 INFO:teuthology.orchestra.run.smithi155.stdout: "duration": 3.3345e-05 2023-08-01T19:55:30.858 INFO:teuthology.orchestra.run.smithi155.stdout: }, 2023-08-01T19:55:30.858 INFO:teuthology.orchestra.run.smithi155.stdout: { 2023-08-01T19:55:30.858 INFO:teuthology.orchestra.run.smithi155.stdout: "event": "done", 2023-08-01T19:55:30.858 INFO:teuthology.orchestra.run.smithi155.stdout: "time": "2023-08-01T19:55:05.224205+0000", 2023-08-01T19:55:30.858 INFO:teuthology.orchestra.run.smithi155.stdout: "duration": 3.3525999999999997e-05 2023-08-01T19:55:30.859 INFO:teuthology.orchestra.run.smithi155.stdout: } 2023-08-01T19:55:30.859 INFO:teuthology.orchestra.run.smithi155.stdout: ] 2023-08-01T19:55:30.859 INFO:teuthology.orchestra.run.smithi155.stdout: } 2023-08-01T19:55:30.859 INFO:teuthology.orchestra.run.smithi155.stdout: }, 2023-08-01T19:55:30.859 INFO:teuthology.orchestra.run.smithi155.stdout: { 2023-08-01T19:55:30.859 INFO:teuthology.orchestra.run.smithi155.stdout: "description": "osd_repop_reply(client.4668.0:100237 5.4 e37/19 ondisk, result = 0)", 2023-08-01T19:55:30.859 INFO:teuthology.orchestra.run.smithi155.stdout: "initiated_at": "2023-08-01T19:55:05.156249+0000", 2023-08-01T19:55:30.859 INFO:teuthology.orchestra.run.smithi155.stdout: "age": 25.575767371000001, 2023-08-01T19:55:30.860 INFO:teuthology.orchestra.run.smithi155.stdout: "duration": 0.062792549000000003, 2023-08-01T19:55:30.860 INFO:teuthology.orchestra.run.smithi155.stdout: "type_data": { 2023-08-01T19:55:30.860 INFO:teuthology.orchestra.run.smithi155.stdout: "flag_point": "started", 2023-08-01T19:55:30.860 INFO:teuthology.orchestra.run.smithi155.stdout: "events": [ 2023-08-01T19:55:30.860 INFO:teuthology.orchestra.run.smithi155.stdout: { 2023-08-01T19:55:30.860 INFO:teuthology.orchestra.run.smithi155.stdout: "event": "initiated", 2023-08-01T19:55:30.860 INFO:teuthology.orchestra.run.smithi155.stdout: "time": "2023-08-01T19:55:05.156249+0000", 2023-08-01T19:55:30.861 INFO:teuthology.orchestra.run.smithi155.stdout: "duration": 0 2023-08-01T19:55:30.861 INFO:teuthology.orchestra.run.smithi155.stdout: }, 2023-08-01T19:55:30.861 INFO:teuthology.orchestra.run.smithi155.stdout: { 2023-08-01T19:55:30.861 INFO:teuthology.orchestra.run.smithi155.stdout: "event": "throttled", 2023-08-01T19:55:30.861 INFO:teuthology.orchestra.run.smithi155.stdout: "time": "2023-08-01T19:55:05.156249+0000", 2023-08-01T19:55:30.861 INFO:teuthology.orchestra.run.smithi155.stdout: "duration": 0 2023-08-01T19:55:30.861 INFO:teuthology.orchestra.run.smithi155.stdout: }, 2023-08-01T19:55:30.861 INFO:teuthology.orchestra.run.smithi155.stdout: { 2023-08-01T19:55:30.862 INFO:teuthology.orchestra.run.smithi155.stdout: "event": "header_read", 2023-08-01T19:55:30.862 INFO:teuthology.orchestra.run.smithi155.stdout: "time": "2023-08-01T19:55:05.156248+0000", 2023-08-01T19:55:30.862 INFO:teuthology.orchestra.run.smithi155.stdout: "duration": 4294967295.9999995 2023-08-01T19:55:30.862 INFO:teuthology.orchestra.run.smithi155.stdout: }, 2023-08-01T19:55:30.862 INFO:teuthology.orchestra.run.smithi155.stdout: { 2023-08-01T19:55:30.862 INFO:teuthology.orchestra.run.smithi155.stdout: "event": "all_read", 2023-08-01T19:55:30.862 INFO:teuthology.orchestra.run.smithi155.stdout: "time": "2023-08-01T19:55:05.156252+0000", 2023-08-01T19:55:30.862 INFO:teuthology.orchestra.run.smithi155.stdout: "duration": 3.9999999999999998e-06 2023-08-01T19:55:30.863 INFO:teuthology.orchestra.run.smithi155.stdout: }, 2023-08-01T19:55:30.863 INFO:teuthology.orchestra.run.smithi155.stdout: { 2023-08-01T19:55:30.863 INFO:teuthology.orchestra.run.smithi155.stdout: "event": "dispatched", 2023-08-01T19:55:30.863 INFO:teuthology.orchestra.run.smithi155.stdout: "time": "2023-08-01T19:55:05.218844+0000", 2023-08-01T19:55:30.863 INFO:teuthology.orchestra.run.smithi155.stdout: "duration": 0.062591516999999999 2023-08-01T19:55:30.863 INFO:teuthology.orchestra.run.smithi155.stdout: }, 2023-08-01T19:55:30.863 INFO:teuthology.orchestra.run.smithi155.stdout: { 2023-08-01T19:55:30.863 INFO:teuthology.orchestra.run.smithi155.stdout: "event": "queued_for_pg", 2023-08-01T19:55:30.864 INFO:teuthology.orchestra.run.smithi155.stdout: "time": "2023-08-01T19:55:05.218862+0000", 2023-08-01T19:55:30.864 INFO:teuthology.orchestra.run.smithi155.stdout: "duration": 1.7666e-05 2023-08-01T19:55:30.864 INFO:teuthology.orchestra.run.smithi155.stdout: }, 2023-08-01T19:55:30.864 INFO:teuthology.orchestra.run.smithi155.stdout: { 2023-08-01T19:55:30.864 INFO:teuthology.orchestra.run.smithi155.stdout: "event": "reached_pg", 2023-08-01T19:55:30.864 INFO:teuthology.orchestra.run.smithi155.stdout: "time": "2023-08-01T19:55:05.218914+0000", 2023-08-01T19:55:30.864 INFO:teuthology.orchestra.run.smithi155.stdout: "duration": 5.2565999999999998e-05 2023-08-01T19:55:30.864 INFO:teuthology.orchestra.run.smithi155.stdout: }, 2023-08-01T19:55:30.865 INFO:teuthology.orchestra.run.smithi155.stdout: { 2023-08-01T19:55:30.865 INFO:teuthology.orchestra.run.smithi155.stdout: "event": "started", 2023-08-01T19:55:30.865 INFO:teuthology.orchestra.run.smithi155.stdout: "time": "2023-08-01T19:55:05.218925+0000", 2023-08-01T19:55:30.865 INFO:teuthology.orchestra.run.smithi155.stdout: "duration": 1.1375e-05 2023-08-01T19:55:30.865 INFO:teuthology.orchestra.run.smithi155.stdout: }, 2023-08-01T19:55:30.865 INFO:teuthology.orchestra.run.smithi155.stdout: { 2023-08-01T19:55:30.865 INFO:teuthology.orchestra.run.smithi155.stdout: "event": "done", 2023-08-01T19:55:30.865 INFO:teuthology.orchestra.run.smithi155.stdout: "time": "2023-08-01T19:55:05.219041+0000", 2023-08-01T19:55:30.866 INFO:teuthology.orchestra.run.smithi155.stdout: "duration": 0.000115977 2023-08-01T19:55:30.866 INFO:teuthology.orchestra.run.smithi155.stdout: } 2023-08-01T19:55:30.866 INFO:teuthology.orchestra.run.smithi155.stdout: ] 2023-08-01T19:55:30.866 INFO:teuthology.orchestra.run.smithi155.stdout: } 2023-08-01T19:55:30.866 INFO:teuthology.orchestra.run.smithi155.stdout: }, 2023-08-01T19:55:30.866 INFO:teuthology.orchestra.run.smithi155.stdout: { 2023-08-01T19:55:30.866 INFO:teuthology.orchestra.run.smithi155.stdout: "description": "osd_repop(client.4668.0:100253 5.f e37/19 5:f7bbce05:::benchmark_data_smithi006_114134_object100252:head v 37'6323, mlcod=37'6321)", 2023-08-01T19:55:30.866 INFO:teuthology.orchestra.run.smithi155.stdout: "initiated_at": "2023-08-01T19:55:05.156952+0000", 2023-08-01T19:55:30.867 INFO:teuthology.orchestra.run.smithi155.stdout: "age": 25.575064308000002, 2023-08-01T19:55:30.867 INFO:teuthology.orchestra.run.smithi155.stdout: "duration": 0.068018577999999996, 2023-08-01T19:55:30.867 INFO:teuthology.orchestra.run.smithi155.stdout: "type_data": { 2023-08-01T19:55:30.867 INFO:teuthology.orchestra.run.smithi155.stdout: "flag_point": "commit sent; apply or cleanup", 2023-08-01T19:55:30.867 INFO:teuthology.orchestra.run.smithi155.stdout: "events": [ 2023-08-01T19:55:30.867 INFO:teuthology.orchestra.run.smithi155.stdout: { 2023-08-01T19:55:30.867 INFO:teuthology.orchestra.run.smithi155.stdout: "event": "initiated", 2023-08-01T19:55:30.867 INFO:teuthology.orchestra.run.smithi155.stdout: "time": "2023-08-01T19:55:05.156952+0000", 2023-08-01T19:55:30.868 INFO:teuthology.orchestra.run.smithi155.stdout: "duration": 0 2023-08-01T19:55:30.868 INFO:teuthology.orchestra.run.smithi155.stdout: }, 2023-08-01T19:55:30.868 INFO:teuthology.orchestra.run.smithi155.stdout: { 2023-08-01T19:55:30.868 INFO:teuthology.orchestra.run.smithi155.stdout: "event": "throttled", 2023-08-01T19:55:30.868 INFO:teuthology.orchestra.run.smithi155.stdout: "time": "2023-08-01T19:55:05.156952+0000", 2023-08-01T19:55:30.868 INFO:teuthology.orchestra.run.smithi155.stdout: "duration": 0 2023-08-01T19:55:30.868 INFO:teuthology.orchestra.run.smithi155.stdout: }, 2023-08-01T19:55:30.868 INFO:teuthology.orchestra.run.smithi155.stdout: { 2023-08-01T19:55:30.869 INFO:teuthology.orchestra.run.smithi155.stdout: "event": "header_read", 2023-08-01T19:55:30.869 INFO:teuthology.orchestra.run.smithi155.stdout: "time": "2023-08-01T19:55:05.156951+0000", 2023-08-01T19:55:30.869 INFO:teuthology.orchestra.run.smithi155.stdout: "duration": 4294967295.999999 2023-08-01T19:55:30.869 INFO:teuthology.orchestra.run.smithi155.stdout: }, 2023-08-01T19:55:30.869 INFO:teuthology.orchestra.run.smithi155.stdout: { 2023-08-01T19:55:30.869 INFO:teuthology.orchestra.run.smithi155.stdout: "event": "all_read", 2023-08-01T19:55:30.869 INFO:teuthology.orchestra.run.smithi155.stdout: "time": "2023-08-01T19:55:05.156989+0000", 2023-08-01T19:55:30.870 INFO:teuthology.orchestra.run.smithi155.stdout: "duration": 3.8175e-05 2023-08-01T19:55:30.870 INFO:teuthology.orchestra.run.smithi155.stdout: }, 2023-08-01T19:55:30.870 INFO:teuthology.orchestra.run.smithi155.stdout: { 2023-08-01T19:55:30.870 INFO:teuthology.orchestra.run.smithi155.stdout: "event": "dispatched", 2023-08-01T19:55:30.870 INFO:teuthology.orchestra.run.smithi155.stdout: "time": "2023-08-01T19:55:05.218842+0000", 2023-08-01T19:55:30.870 INFO:teuthology.orchestra.run.smithi155.stdout: "duration": 0.061852299999999999 2023-08-01T19:55:30.870 INFO:teuthology.orchestra.run.smithi155.stdout: }, 2023-08-01T19:55:30.870 INFO:teuthology.orchestra.run.smithi155.stdout: { 2023-08-01T19:55:30.871 INFO:teuthology.orchestra.run.smithi155.stdout: "event": "queued_for_pg", 2023-08-01T19:55:30.871 INFO:teuthology.orchestra.run.smithi155.stdout: "time": "2023-08-01T19:55:05.218862+0000", 2023-08-01T19:55:30.871 INFO:teuthology.orchestra.run.smithi155.stdout: "duration": 1.9854999999999999e-05 2023-08-01T19:55:30.871 INFO:teuthology.orchestra.run.smithi155.stdout: }, 2023-08-01T19:55:30.871 INFO:teuthology.orchestra.run.smithi155.stdout: { 2023-08-01T19:55:30.871 INFO:teuthology.orchestra.run.smithi155.stdout: "event": "reached_pg", 2023-08-01T19:55:30.872 INFO:teuthology.orchestra.run.smithi155.stdout: "time": "2023-08-01T19:55:05.218918+0000", 2023-08-01T19:55:30.872 INFO:teuthology.orchestra.run.smithi155.stdout: "duration": 5.6570000000000002e-05 2023-08-01T19:55:30.872 INFO:teuthology.orchestra.run.smithi155.stdout: }, 2023-08-01T19:55:30.872 INFO:teuthology.orchestra.run.smithi155.stdout: { 2023-08-01T19:55:30.873 INFO:teuthology.orchestra.run.smithi155.stdout: "event": "started", 2023-08-01T19:55:30.873 INFO:teuthology.orchestra.run.smithi155.stdout: "time": "2023-08-01T19:55:05.218940+0000", 2023-08-01T19:55:30.873 INFO:teuthology.orchestra.run.smithi155.stdout: "duration": 2.1804e-05 2023-08-01T19:55:30.873 INFO:teuthology.orchestra.run.smithi155.stdout: }, 2023-08-01T19:55:30.873 INFO:teuthology.orchestra.run.smithi155.stdout: { 2023-08-01T19:55:30.873 INFO:teuthology.orchestra.run.smithi155.stdout: "event": "commit_sent", 2023-08-01T19:55:30.873 INFO:teuthology.orchestra.run.smithi155.stdout: "time": "2023-08-01T19:55:05.224928+0000", 2023-08-01T19:55:30.873 INFO:teuthology.orchestra.run.smithi155.stdout: "duration": 0.0059876759999999999 2023-08-01T19:55:30.874 INFO:teuthology.orchestra.run.smithi155.stdout: }, 2023-08-01T19:55:30.874 INFO:teuthology.orchestra.run.smithi155.stdout: { 2023-08-01T19:55:30.874 INFO:teuthology.orchestra.run.smithi155.stdout: "event": "done", 2023-08-01T19:55:30.874 INFO:teuthology.orchestra.run.smithi155.stdout: "time": "2023-08-01T19:55:05.224971+0000", 2023-08-01T19:55:30.874 INFO:teuthology.orchestra.run.smithi155.stdout: "duration": 4.2929999999999997e-05 2023-08-01T19:55:30.874 INFO:teuthology.orchestra.run.smithi155.stdout: } 2023-08-01T19:55:30.874 INFO:teuthology.orchestra.run.smithi155.stdout: ] 2023-08-01T19:55:30.875 INFO:teuthology.orchestra.run.smithi155.stdout: } 2023-08-01T19:55:30.875 INFO:teuthology.orchestra.run.smithi155.stdout: }, 2023-08-01T19:55:30.875 INFO:teuthology.orchestra.run.smithi155.stdout: { 2023-08-01T19:55:30.875 INFO:teuthology.orchestra.run.smithi155.stdout: "description": "osd_op(client.4668.0:100927 5.0 5:00608ec6:::benchmark_data_smithi006_114134_object100926:head [set-alloc-hint object_size 65536 write_size 65536,write 0~65536] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e37)", 2023-08-01T19:55:30.875 INFO:teuthology.orchestra.run.smithi155.stdout: "initiated_at": "2023-08-01T19:55:05.561169+0000", 2023-08-01T19:55:30.875 INFO:teuthology.orchestra.run.smithi155.stdout: "age": 25.170847405, 2023-08-01T19:55:30.875 INFO:teuthology.orchestra.run.smithi155.stdout: "duration": 0.066411687999999997, 2023-08-01T19:55:30.875 INFO:teuthology.orchestra.run.smithi155.stdout: "type_data": { 2023-08-01T19:55:30.876 INFO:teuthology.orchestra.run.smithi155.stdout: "flag_point": "commit sent; apply or cleanup", 2023-08-01T19:55:30.876 INFO:teuthology.orchestra.run.smithi155.stdout: "client_info": { 2023-08-01T19:55:30.876 INFO:teuthology.orchestra.run.smithi155.stdout: "client": "client.4668", 2023-08-01T19:55:30.876 INFO:teuthology.orchestra.run.smithi155.stdout: "client_addr": "172.21.15.6:0/1709472247", 2023-08-01T19:55:30.876 INFO:teuthology.orchestra.run.smithi155.stdout: "tid": 100927 2023-08-01T19:55:30.876 INFO:teuthology.orchestra.run.smithi155.stdout: }, 2023-08-01T19:55:30.876 INFO:teuthology.orchestra.run.smithi155.stdout: "events": [ 2023-08-01T19:55:30.876 INFO:teuthology.orchestra.run.smithi155.stdout: { 2023-08-01T19:55:30.877 INFO:teuthology.orchestra.run.smithi155.stdout: "event": "initiated", 2023-08-01T19:55:30.877 INFO:teuthology.orchestra.run.smithi155.stdout: "time": "2023-08-01T19:55:05.561169+0000", 2023-08-01T19:55:30.877 INFO:teuthology.orchestra.run.smithi155.stdout: "duration": 0 2023-08-01T19:55:30.877 INFO:teuthology.orchestra.run.smithi155.stdout: }, 2023-08-01T19:55:30.877 INFO:teuthology.orchestra.run.smithi155.stdout: { 2023-08-01T19:55:30.877 INFO:teuthology.orchestra.run.smithi155.stdout: "event": "throttled", 2023-08-01T19:55:30.877 INFO:teuthology.orchestra.run.smithi155.stdout: "time": "2023-08-01T19:55:05.561169+0000", 2023-08-01T19:55:30.877 INFO:teuthology.orchestra.run.smithi155.stdout: "duration": 0 2023-08-01T19:55:30.878 INFO:teuthology.orchestra.run.smithi155.stdout: }, 2023-08-01T19:55:30.878 INFO:teuthology.orchestra.run.smithi155.stdout: { 2023-08-01T19:55:30.878 INFO:teuthology.orchestra.run.smithi155.stdout: "event": "header_read", 2023-08-01T19:55:30.878 INFO:teuthology.orchestra.run.smithi155.stdout: "time": "2023-08-01T19:55:05.561168+0000", 2023-08-01T19:55:30.878 INFO:teuthology.orchestra.run.smithi155.stdout: "duration": 4294967295.9999995 2023-08-01T19:55:30.878 INFO:teuthology.orchestra.run.smithi155.stdout: }, 2023-08-01T19:55:30.878 INFO:teuthology.orchestra.run.smithi155.stdout: { 2023-08-01T19:55:30.878 INFO:teuthology.orchestra.run.smithi155.stdout: "event": "all_read", 2023-08-01T19:55:30.879 INFO:teuthology.orchestra.run.smithi155.stdout: "time": "2023-08-01T19:55:05.561218+0000", 2023-08-01T19:55:30.879 INFO:teuthology.orchestra.run.smithi155.stdout: "duration": 4.9379999999999998e-05 2023-08-01T19:55:30.879 INFO:teuthology.orchestra.run.smithi155.stdout: }, 2023-08-01T19:55:30.879 INFO:teuthology.orchestra.run.smithi155.stdout: { 2023-08-01T19:55:30.879 INFO:teuthology.orchestra.run.smithi155.stdout: "event": "dispatched", 2023-08-01T19:55:30.879 INFO:teuthology.orchestra.run.smithi155.stdout: "time": "2023-08-01T19:55:05.561225+0000", 2023-08-01T19:55:30.879 INFO:teuthology.orchestra.run.smithi155.stdout: "duration": 7.114e-06 2023-08-01T19:55:30.879 INFO:teuthology.orchestra.run.smithi155.stdout: }, 2023-08-01T19:55:30.880 INFO:teuthology.orchestra.run.smithi155.stdout: { 2023-08-01T19:55:30.880 INFO:teuthology.orchestra.run.smithi155.stdout: "event": "queued_for_pg", 2023-08-01T19:55:30.880 INFO:teuthology.orchestra.run.smithi155.stdout: "time": "2023-08-01T19:55:05.561229+0000", 2023-08-01T19:55:30.880 INFO:teuthology.orchestra.run.smithi155.stdout: "duration": 4.2180000000000001e-06 2023-08-01T19:55:30.880 INFO:teuthology.orchestra.run.smithi155.stdout: }, 2023-08-01T19:55:30.880 INFO:teuthology.orchestra.run.smithi155.stdout: { 2023-08-01T19:55:30.880 INFO:teuthology.orchestra.run.smithi155.stdout: "event": "reached_pg", 2023-08-01T19:55:30.880 INFO:teuthology.orchestra.run.smithi155.stdout: "time": "2023-08-01T19:55:05.564737+0000", 2023-08-01T19:55:30.881 INFO:teuthology.orchestra.run.smithi155.stdout: "duration": 0.0035081869999999999 2023-08-01T19:55:30.881 INFO:teuthology.orchestra.run.smithi155.stdout: }, 2023-08-01T19:55:30.881 INFO:teuthology.orchestra.run.smithi155.stdout: { 2023-08-01T19:55:30.881 INFO:teuthology.orchestra.run.smithi155.stdout: "event": "started", 2023-08-01T19:55:30.881 INFO:teuthology.orchestra.run.smithi155.stdout: "time": "2023-08-01T19:55:05.564859+0000", 2023-08-01T19:55:30.881 INFO:teuthology.orchestra.run.smithi155.stdout: "duration": 0.00012165800000000001 2023-08-01T19:55:30.881 INFO:teuthology.orchestra.run.smithi155.stdout: }, 2023-08-01T19:55:30.881 INFO:teuthology.orchestra.run.smithi155.stdout: { 2023-08-01T19:55:30.882 INFO:teuthology.orchestra.run.smithi155.stdout: "event": "waiting for subops from 0", 2023-08-01T19:55:30.882 INFO:teuthology.orchestra.run.smithi155.stdout: "time": "2023-08-01T19:55:05.565009+0000", 2023-08-01T19:55:30.882 INFO:teuthology.orchestra.run.smithi155.stdout: "duration": 0.00014979699999999999 2023-08-01T19:55:30.882 INFO:teuthology.orchestra.run.smithi155.stdout: }, 2023-08-01T19:55:30.882 INFO:teuthology.orchestra.run.smithi155.stdout: { 2023-08-01T19:55:30.882 INFO:teuthology.orchestra.run.smithi155.stdout: "event": "op_commit", 2023-08-01T19:55:30.882 INFO:teuthology.orchestra.run.smithi155.stdout: "time": "2023-08-01T19:55:05.568007+0000", 2023-08-01T19:55:30.882 INFO:teuthology.orchestra.run.smithi155.stdout: "duration": 0.00299796 2023-08-01T19:55:30.883 INFO:teuthology.orchestra.run.smithi155.stdout: }, 2023-08-01T19:55:30.883 INFO:teuthology.orchestra.run.smithi155.stdout: { 2023-08-01T19:55:30.883 INFO:teuthology.orchestra.run.smithi155.stdout: "event": "sub_op_commit_rec", 2023-08-01T19:55:30.883 INFO:teuthology.orchestra.run.smithi155.stdout: "time": "2023-08-01T19:55:05.627520+0000", 2023-08-01T19:55:30.883 INFO:teuthology.orchestra.run.smithi155.stdout: "duration": 0.059513636000000002 2023-08-01T19:55:30.883 INFO:teuthology.orchestra.run.smithi155.stdout: }, 2023-08-01T19:55:30.883 INFO:teuthology.orchestra.run.smithi155.stdout: { 2023-08-01T19:55:30.883 INFO:teuthology.orchestra.run.smithi155.stdout: "event": "commit_sent", 2023-08-01T19:55:30.884 INFO:teuthology.orchestra.run.smithi155.stdout: "time": "2023-08-01T19:55:05.627553+0000", 2023-08-01T19:55:30.884 INFO:teuthology.orchestra.run.smithi155.stdout: "duration": 3.2635999999999997e-05 2023-08-01T19:55:30.884 INFO:teuthology.orchestra.run.smithi155.stdout: }, 2023-08-01T19:55:30.884 INFO:teuthology.orchestra.run.smithi155.stdout: { 2023-08-01T19:55:30.884 INFO:teuthology.orchestra.run.smithi155.stdout: "event": "done", 2023-08-01T19:55:30.884 INFO:teuthology.orchestra.run.smithi155.stdout: "time": "2023-08-01T19:55:05.627581+0000", 2023-08-01T19:55:30.884 INFO:teuthology.orchestra.run.smithi155.stdout: "duration": 2.7681000000000001e-05 2023-08-01T19:55:30.885 INFO:teuthology.orchestra.run.smithi155.stdout: } 2023-08-01T19:55:30.885 INFO:teuthology.orchestra.run.smithi155.stdout: ] 2023-08-01T19:55:30.885 INFO:teuthology.orchestra.run.smithi155.stdout: } 2023-08-01T19:55:30.885 INFO:teuthology.orchestra.run.smithi155.stdout: }, 2023-08-01T19:55:30.885 INFO:teuthology.orchestra.run.smithi155.stdout: { 2023-08-01T19:55:30.885 INFO:teuthology.orchestra.run.smithi155.stdout: "description": "osd_op(client.4668.0:100935 5.e 5:7895b14e:::benchmark_data_smithi006_114134_object100934:head [set-alloc-hint object_size 65536 write_size 65536,write 0~65536] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e37)", 2023-08-01T19:55:30.885 INFO:teuthology.orchestra.run.smithi155.stdout: "initiated_at": "2023-08-01T19:55:05.566666+0000", 2023-08-01T19:55:30.885 INFO:teuthology.orchestra.run.smithi155.stdout: "age": 25.165350105000002, 2023-08-01T19:55:30.886 INFO:teuthology.orchestra.run.smithi155.stdout: "duration": 0.064309016999999996, 2023-08-01T19:55:30.886 INFO:teuthology.orchestra.run.smithi155.stdout: "type_data": { 2023-08-01T19:55:30.886 INFO:teuthology.orchestra.run.smithi155.stdout: "flag_point": "commit sent; apply or cleanup", 2023-08-01T19:55:30.886 INFO:teuthology.orchestra.run.smithi155.stdout: "client_info": { 2023-08-01T19:55:30.886 INFO:teuthology.orchestra.run.smithi155.stdout: "client": "client.4668", 2023-08-01T19:55:30.886 INFO:teuthology.orchestra.run.smithi155.stdout: "client_addr": "172.21.15.6:0/1709472247", 2023-08-01T19:55:30.886 INFO:teuthology.orchestra.run.smithi155.stdout: "tid": 100935 2023-08-01T19:55:30.886 INFO:teuthology.orchestra.run.smithi155.stdout: }, 2023-08-01T19:55:30.887 INFO:teuthology.orchestra.run.smithi155.stdout: "events": [ 2023-08-01T19:55:30.887 INFO:teuthology.orchestra.run.smithi155.stdout: { 2023-08-01T19:55:30.887 INFO:teuthology.orchestra.run.smithi155.stdout: "event": "initiated", 2023-08-01T19:55:30.887 INFO:teuthology.orchestra.run.smithi155.stdout: "time": "2023-08-01T19:55:05.566666+0000", 2023-08-01T19:55:30.887 INFO:teuthology.orchestra.run.smithi155.stdout: "duration": 0 2023-08-01T19:55:30.887 INFO:teuthology.orchestra.run.smithi155.stdout: }, 2023-08-01T19:55:30.887 INFO:teuthology.orchestra.run.smithi155.stdout: { 2023-08-01T19:55:30.887 INFO:teuthology.orchestra.run.smithi155.stdout: "event": "throttled", 2023-08-01T19:55:30.888 INFO:teuthology.orchestra.run.smithi155.stdout: "time": "2023-08-01T19:55:05.566666+0000", 2023-08-01T19:55:30.888 INFO:teuthology.orchestra.run.smithi155.stdout: "duration": 0 2023-08-01T19:55:30.888 INFO:teuthology.orchestra.run.smithi155.stdout: }, 2023-08-01T19:55:30.888 INFO:teuthology.orchestra.run.smithi155.stdout: { 2023-08-01T19:55:30.888 INFO:teuthology.orchestra.run.smithi155.stdout: "event": "header_read", 2023-08-01T19:55:30.888 INFO:teuthology.orchestra.run.smithi155.stdout: "time": "2023-08-01T19:55:05.566665+0000", 2023-08-01T19:55:30.888 INFO:teuthology.orchestra.run.smithi155.stdout: "duration": 4294967295.9999986 2023-08-01T19:55:30.888 INFO:teuthology.orchestra.run.smithi155.stdout: }, 2023-08-01T19:55:30.889 INFO:teuthology.orchestra.run.smithi155.stdout: { 2023-08-01T19:55:30.889 INFO:teuthology.orchestra.run.smithi155.stdout: "event": "all_read", 2023-08-01T19:55:30.889 INFO:teuthology.orchestra.run.smithi155.stdout: "time": "2023-08-01T19:55:05.566754+0000", 2023-08-01T19:55:30.889 INFO:teuthology.orchestra.run.smithi155.stdout: "duration": 8.9425999999999994e-05 2023-08-01T19:55:30.889 INFO:teuthology.orchestra.run.smithi155.stdout: }, 2023-08-01T19:55:30.889 INFO:teuthology.orchestra.run.smithi155.stdout: { 2023-08-01T19:55:30.890 INFO:teuthology.orchestra.run.smithi155.stdout: "event": "dispatched", 2023-08-01T19:55:30.890 INFO:teuthology.orchestra.run.smithi155.stdout: "time": "2023-08-01T19:55:05.566766+0000", 2023-08-01T19:55:30.890 INFO:teuthology.orchestra.run.smithi155.stdout: "duration": 1.2018000000000001e-05 2023-08-01T19:55:30.890 INFO:teuthology.orchestra.run.smithi155.stdout: }, 2023-08-01T19:55:30.890 INFO:teuthology.orchestra.run.smithi155.stdout: { 2023-08-01T19:55:30.890 INFO:teuthology.orchestra.run.smithi155.stdout: "event": "queued_for_pg", 2023-08-01T19:55:30.890 INFO:teuthology.orchestra.run.smithi155.stdout: "time": "2023-08-01T19:55:05.566772+0000", 2023-08-01T19:55:30.891 INFO:teuthology.orchestra.run.smithi155.stdout: "duration": 6.0190000000000003e-06 2023-08-01T19:55:30.891 INFO:teuthology.orchestra.run.smithi155.stdout: }, 2023-08-01T19:55:30.891 INFO:teuthology.orchestra.run.smithi155.stdout: { 2023-08-01T19:55:30.891 INFO:teuthology.orchestra.run.smithi155.stdout: "event": "reached_pg", 2023-08-01T19:55:30.891 INFO:teuthology.orchestra.run.smithi155.stdout: "time": "2023-08-01T19:55:05.566800+0000", 2023-08-01T19:55:30.891 INFO:teuthology.orchestra.run.smithi155.stdout: "duration": 2.7835999999999999e-05 2023-08-01T19:55:30.891 INFO:teuthology.orchestra.run.smithi155.stdout: }, 2023-08-01T19:55:30.891 INFO:teuthology.orchestra.run.smithi155.stdout: { 2023-08-01T19:55:30.892 INFO:teuthology.orchestra.run.smithi155.stdout: "event": "started", 2023-08-01T19:55:30.892 INFO:teuthology.orchestra.run.smithi155.stdout: "time": "2023-08-01T19:55:05.566879+0000", 2023-08-01T19:55:30.892 INFO:teuthology.orchestra.run.smithi155.stdout: "duration": 7.9105999999999998e-05 2023-08-01T19:55:30.892 INFO:teuthology.orchestra.run.smithi155.stdout: }, 2023-08-01T19:55:30.893 INFO:teuthology.orchestra.run.smithi155.stdout: { 2023-08-01T19:55:30.893 INFO:teuthology.orchestra.run.smithi155.stdout: "event": "waiting for subops from 0", 2023-08-01T19:55:30.893 INFO:teuthology.orchestra.run.smithi155.stdout: "time": "2023-08-01T19:55:05.566971+0000", 2023-08-01T19:55:30.893 INFO:teuthology.orchestra.run.smithi155.stdout: "duration": 9.1817999999999994e-05 2023-08-01T19:55:30.893 INFO:teuthology.orchestra.run.smithi155.stdout: }, 2023-08-01T19:55:30.893 INFO:teuthology.orchestra.run.smithi155.stdout: { 2023-08-01T19:55:30.893 INFO:teuthology.orchestra.run.smithi155.stdout: "event": "op_commit", 2023-08-01T19:55:30.893 INFO:teuthology.orchestra.run.smithi155.stdout: "time": "2023-08-01T19:55:05.571475+0000", 2023-08-01T19:55:30.894 INFO:teuthology.orchestra.run.smithi155.stdout: "duration": 0.0045039499999999996 2023-08-01T19:55:30.894 INFO:teuthology.orchestra.run.smithi155.stdout: }, 2023-08-01T19:55:30.894 INFO:teuthology.orchestra.run.smithi155.stdout: { 2023-08-01T19:55:30.894 INFO:teuthology.orchestra.run.smithi155.stdout: "event": "sub_op_commit_rec", 2023-08-01T19:55:30.894 INFO:teuthology.orchestra.run.smithi155.stdout: "time": "2023-08-01T19:55:05.630884+0000", 2023-08-01T19:55:30.894 INFO:teuthology.orchestra.run.smithi155.stdout: "duration": 0.059409181999999998 2023-08-01T19:55:30.894 INFO:teuthology.orchestra.run.smithi155.stdout: }, 2023-08-01T19:55:30.894 INFO:teuthology.orchestra.run.smithi155.stdout: { 2023-08-01T19:55:30.895 INFO:teuthology.orchestra.run.smithi155.stdout: "event": "commit_sent", 2023-08-01T19:55:30.895 INFO:teuthology.orchestra.run.smithi155.stdout: "time": "2023-08-01T19:55:05.630930+0000", 2023-08-01T19:55:30.895 INFO:teuthology.orchestra.run.smithi155.stdout: "duration": 4.5507999999999999e-05 2023-08-01T19:55:30.895 INFO:teuthology.orchestra.run.smithi155.stdout: }, 2023-08-01T19:55:30.895 INFO:teuthology.orchestra.run.smithi155.stdout: { 2023-08-01T19:55:30.895 INFO:teuthology.orchestra.run.smithi155.stdout: "event": "done", 2023-08-01T19:55:30.895 INFO:teuthology.orchestra.run.smithi155.stdout: "time": "2023-08-01T19:55:05.630975+0000", 2023-08-01T19:55:30.895 INFO:teuthology.orchestra.run.smithi155.stdout: "duration": 4.5441000000000001e-05 2023-08-01T19:55:30.896 INFO:teuthology.orchestra.run.smithi155.stdout: } 2023-08-01T19:55:30.896 INFO:teuthology.orchestra.run.smithi155.stdout: ] 2023-08-01T19:55:30.896 INFO:teuthology.orchestra.run.smithi155.stdout: } 2023-08-01T19:55:30.896 INFO:teuthology.orchestra.run.smithi155.stdout: }, 2023-08-01T19:55:30.896 INFO:teuthology.orchestra.run.smithi155.stdout: { 2023-08-01T19:55:30.896 INFO:teuthology.orchestra.run.smithi155.stdout: "description": "osd_op(client.4668.0:100941 5.e 5:736a6ac6:::benchmark_data_smithi006_114134_object100940:head [set-alloc-hint object_size 65536 write_size 65536,write 0~65536] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e37)", 2023-08-01T19:55:30.896 INFO:teuthology.orchestra.run.smithi155.stdout: "initiated_at": "2023-08-01T19:55:05.569750+0000", 2023-08-01T19:55:30.897 INFO:teuthology.orchestra.run.smithi155.stdout: "age": 25.162266211999999, 2023-08-01T19:55:30.897 INFO:teuthology.orchestra.run.smithi155.stdout: "duration": 0.065431331999999995, 2023-08-01T19:55:30.897 INFO:teuthology.orchestra.run.smithi155.stdout: "type_data": { 2023-08-01T19:55:30.897 INFO:teuthology.orchestra.run.smithi155.stdout: "flag_point": "commit sent; apply or cleanup", 2023-08-01T19:55:30.897 INFO:teuthology.orchestra.run.smithi155.stdout: "client_info": { 2023-08-01T19:55:30.897 INFO:teuthology.orchestra.run.smithi155.stdout: "client": "client.4668", 2023-08-01T19:55:30.898 INFO:teuthology.orchestra.run.smithi155.stdout: "client_addr": "172.21.15.6:0/1709472247", 2023-08-01T19:55:30.898 INFO:teuthology.orchestra.run.smithi155.stdout: "tid": 100941 2023-08-01T19:55:30.898 INFO:teuthology.orchestra.run.smithi155.stdout: }, 2023-08-01T19:55:30.899 INFO:teuthology.orchestra.run.smithi155.stdout: "events": [ 2023-08-01T19:55:30.899 INFO:teuthology.orchestra.run.smithi155.stdout: { 2023-08-01T19:55:30.899 INFO:teuthology.orchestra.run.smithi155.stdout: "event": "initiated", 2023-08-01T19:55:30.899 INFO:teuthology.orchestra.run.smithi155.stdout: "time": "2023-08-01T19:55:05.569750+0000", 2023-08-01T19:55:30.900 INFO:teuthology.orchestra.run.smithi155.stdout: "duration": 0 2023-08-01T19:55:30.900 INFO:teuthology.orchestra.run.smithi155.stdout: }, 2023-08-01T19:55:30.900 INFO:teuthology.orchestra.run.smithi155.stdout: { 2023-08-01T19:55:30.900 INFO:teuthology.orchestra.run.smithi155.stdout: "event": "throttled", 2023-08-01T19:55:30.901 INFO:teuthology.orchestra.run.smithi155.stdout: "time": "2023-08-01T19:55:05.569750+0000", 2023-08-01T19:55:30.901 INFO:teuthology.orchestra.run.smithi155.stdout: "duration": 0 2023-08-01T19:55:30.901 INFO:teuthology.orchestra.run.smithi155.stdout: }, 2023-08-01T19:55:30.901 INFO:teuthology.orchestra.run.smithi155.stdout: { 2023-08-01T19:55:30.902 INFO:teuthology.orchestra.run.smithi155.stdout: "event": "header_read", 2023-08-01T19:55:30.902 INFO:teuthology.orchestra.run.smithi155.stdout: "time": "2023-08-01T19:55:05.569749+0000", 2023-08-01T19:55:30.902 INFO:teuthology.orchestra.run.smithi155.stdout: "duration": 4294967295.999999 2023-08-01T19:55:30.903 INFO:teuthology.orchestra.run.smithi155.stdout: }, 2023-08-01T19:55:30.903 INFO:teuthology.orchestra.run.smithi155.stdout: { 2023-08-01T19:55:30.903 INFO:teuthology.orchestra.run.smithi155.stdout: "event": "all_read", 2023-08-01T19:55:30.903 INFO:teuthology.orchestra.run.smithi155.stdout: "time": "2023-08-01T19:55:05.569861+0000", 2023-08-01T19:55:30.904 INFO:teuthology.orchestra.run.smithi155.stdout: "duration": 0.000111333 2023-08-01T19:55:30.904 INFO:teuthology.orchestra.run.smithi155.stdout: }, 2023-08-01T19:55:30.904 INFO:teuthology.orchestra.run.smithi155.stdout: { 2023-08-01T19:55:30.904 INFO:teuthology.orchestra.run.smithi155.stdout: "event": "dispatched", 2023-08-01T19:55:30.904 INFO:teuthology.orchestra.run.smithi155.stdout: "time": "2023-08-01T19:55:05.569869+0000", 2023-08-01T19:55:30.904 INFO:teuthology.orchestra.run.smithi155.stdout: "duration": 8.8589999999999994e-06 2023-08-01T19:55:30.905 INFO:teuthology.orchestra.run.smithi155.stdout: }, 2023-08-01T19:55:30.905 INFO:teuthology.orchestra.run.smithi155.stdout: { 2023-08-01T19:55:30.905 INFO:teuthology.orchestra.run.smithi155.stdout: "event": "queued_for_pg", 2023-08-01T19:55:30.905 INFO:teuthology.orchestra.run.smithi155.stdout: "time": "2023-08-01T19:55:05.569874+0000", 2023-08-01T19:55:30.905 INFO:teuthology.orchestra.run.smithi155.stdout: "duration": 4.1679999999999997e-06 2023-08-01T19:55:30.905 INFO:teuthology.orchestra.run.smithi155.stdout: }, 2023-08-01T19:55:30.905 INFO:teuthology.orchestra.run.smithi155.stdout: { 2023-08-01T19:55:30.905 INFO:teuthology.orchestra.run.smithi155.stdout: "event": "reached_pg", 2023-08-01T19:55:30.906 INFO:teuthology.orchestra.run.smithi155.stdout: "time": "2023-08-01T19:55:05.569904+0000", 2023-08-01T19:55:30.906 INFO:teuthology.orchestra.run.smithi155.stdout: "duration": 3.0920999999999998e-05 2023-08-01T19:55:30.906 INFO:teuthology.orchestra.run.smithi155.stdout: }, 2023-08-01T19:55:30.906 INFO:teuthology.orchestra.run.smithi155.stdout: { 2023-08-01T19:55:30.906 INFO:teuthology.orchestra.run.smithi155.stdout: "event": "started", 2023-08-01T19:55:30.906 INFO:teuthology.orchestra.run.smithi155.stdout: "time": "2023-08-01T19:55:05.569998+0000", 2023-08-01T19:55:30.906 INFO:teuthology.orchestra.run.smithi155.stdout: "duration": 9.3086999999999998e-05 2023-08-01T19:55:30.906 INFO:teuthology.orchestra.run.smithi155.stdout: }, 2023-08-01T19:55:30.907 INFO:teuthology.orchestra.run.smithi155.stdout: { 2023-08-01T19:55:30.907 INFO:teuthology.orchestra.run.smithi155.stdout: "event": "waiting for subops from 0", 2023-08-01T19:55:30.907 INFO:teuthology.orchestra.run.smithi155.stdout: "time": "2023-08-01T19:55:05.570093+0000", 2023-08-01T19:55:30.907 INFO:teuthology.orchestra.run.smithi155.stdout: "duration": 9.5768999999999997e-05 2023-08-01T19:55:30.907 INFO:teuthology.orchestra.run.smithi155.stdout: }, 2023-08-01T19:55:30.907 INFO:teuthology.orchestra.run.smithi155.stdout: { 2023-08-01T19:55:30.907 INFO:teuthology.orchestra.run.smithi155.stdout: "event": "op_commit", 2023-08-01T19:55:30.907 INFO:teuthology.orchestra.run.smithi155.stdout: "time": "2023-08-01T19:55:05.572839+0000", 2023-08-01T19:55:30.908 INFO:teuthology.orchestra.run.smithi155.stdout: "duration": 0.0027460050000000001 2023-08-01T19:55:30.908 INFO:teuthology.orchestra.run.smithi155.stdout: }, 2023-08-01T19:55:30.908 INFO:teuthology.orchestra.run.smithi155.stdout: { 2023-08-01T19:55:30.908 INFO:teuthology.orchestra.run.smithi155.stdout: "event": "sub_op_commit_rec", 2023-08-01T19:55:30.908 INFO:teuthology.orchestra.run.smithi155.stdout: "time": "2023-08-01T19:55:05.635114+0000", 2023-08-01T19:55:30.908 INFO:teuthology.orchestra.run.smithi155.stdout: "duration": 0.062274297999999999 2023-08-01T19:55:30.908 INFO:teuthology.orchestra.run.smithi155.stdout: }, 2023-08-01T19:55:30.909 INFO:teuthology.orchestra.run.smithi155.stdout: { 2023-08-01T19:55:30.909 INFO:teuthology.orchestra.run.smithi155.stdout: "event": "commit_sent", 2023-08-01T19:55:30.909 INFO:teuthology.orchestra.run.smithi155.stdout: "time": "2023-08-01T19:55:05.635143+0000", 2023-08-01T19:55:30.909 INFO:teuthology.orchestra.run.smithi155.stdout: "duration": 2.9430000000000001e-05 2023-08-01T19:55:30.909 INFO:teuthology.orchestra.run.smithi155.stdout: }, 2023-08-01T19:55:30.909 INFO:teuthology.orchestra.run.smithi155.stdout: { 2023-08-01T19:55:30.909 INFO:teuthology.orchestra.run.smithi155.stdout: "event": "done", 2023-08-01T19:55:30.909 INFO:teuthology.orchestra.run.smithi155.stdout: "time": "2023-08-01T19:55:05.635181+0000", 2023-08-01T19:55:30.910 INFO:teuthology.orchestra.run.smithi155.stdout: "duration": 3.8352000000000001e-05 2023-08-01T19:55:30.910 INFO:teuthology.orchestra.run.smithi155.stdout: } 2023-08-01T19:55:30.910 INFO:teuthology.orchestra.run.smithi155.stdout: ] 2023-08-01T19:55:30.910 INFO:teuthology.orchestra.run.smithi155.stdout: } 2023-08-01T19:55:30.910 INFO:teuthology.orchestra.run.smithi155.stdout: }, 2023-08-01T19:55:30.910 INFO:teuthology.orchestra.run.smithi155.stdout: { 2023-08-01T19:55:30.910 INFO:teuthology.orchestra.run.smithi155.stdout: "description": "osd_op(client.4668.0:100944 5.4 5:25fae865:::benchmark_data_smithi006_114134_object100943:head [set-alloc-hint object_size 65536 write_size 65536,write 0~65536] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e37)", 2023-08-01T19:55:30.910 INFO:teuthology.orchestra.run.smithi155.stdout: "initiated_at": "2023-08-01T19:55:05.576662+0000", 2023-08-01T19:55:30.911 INFO:teuthology.orchestra.run.smithi155.stdout: "age": 25.155354514999999, 2023-08-01T19:55:30.911 INFO:teuthology.orchestra.run.smithi155.stdout: "duration": 0.056054925999999998, 2023-08-01T19:55:30.911 INFO:teuthology.orchestra.run.smithi155.stdout: "type_data": { 2023-08-01T19:55:30.911 INFO:teuthology.orchestra.run.smithi155.stdout: "flag_point": "commit sent; apply or cleanup", 2023-08-01T19:55:30.911 INFO:teuthology.orchestra.run.smithi155.stdout: "client_info": { 2023-08-01T19:55:30.911 INFO:teuthology.orchestra.run.smithi155.stdout: "client": "client.4668", 2023-08-01T19:55:30.911 INFO:teuthology.orchestra.run.smithi155.stdout: "client_addr": "172.21.15.6:0/1709472247", 2023-08-01T19:55:30.911 INFO:teuthology.orchestra.run.smithi155.stdout: "tid": 100944 2023-08-01T19:55:30.912 INFO:teuthology.orchestra.run.smithi155.stdout: }, 2023-08-01T19:55:30.912 INFO:teuthology.orchestra.run.smithi155.stdout: "events": [ 2023-08-01T19:55:30.912 INFO:teuthology.orchestra.run.smithi155.stdout: { 2023-08-01T19:55:30.912 INFO:teuthology.orchestra.run.smithi155.stdout: "event": "initiated", 2023-08-01T19:55:30.912 INFO:teuthology.orchestra.run.smithi155.stdout: "time": "2023-08-01T19:55:05.576662+0000", 2023-08-01T19:55:30.912 INFO:teuthology.orchestra.run.smithi155.stdout: "duration": 0 2023-08-01T19:55:30.912 INFO:teuthology.orchestra.run.smithi155.stdout: }, 2023-08-01T19:55:30.912 INFO:teuthology.orchestra.run.smithi155.stdout: { 2023-08-01T19:55:30.913 INFO:teuthology.orchestra.run.smithi155.stdout: "event": "throttled", 2023-08-01T19:55:30.913 INFO:teuthology.orchestra.run.smithi155.stdout: "time": "2023-08-01T19:55:05.576662+0000", 2023-08-01T19:55:30.913 INFO:teuthology.orchestra.run.smithi155.stdout: "duration": 0 2023-08-01T19:55:30.913 INFO:teuthology.orchestra.run.smithi155.stdout: }, 2023-08-01T19:55:30.913 INFO:teuthology.orchestra.run.smithi155.stdout: { 2023-08-01T19:55:30.913 INFO:teuthology.orchestra.run.smithi155.stdout: "event": "header_read", 2023-08-01T19:55:30.913 INFO:teuthology.orchestra.run.smithi155.stdout: "time": "2023-08-01T19:55:05.576661+0000", 2023-08-01T19:55:30.913 INFO:teuthology.orchestra.run.smithi155.stdout: "duration": 4294967295.999999 2023-08-01T19:55:30.914 INFO:teuthology.orchestra.run.smithi155.stdout: }, 2023-08-01T19:55:30.914 INFO:teuthology.orchestra.run.smithi155.stdout: { 2023-08-01T19:55:30.914 INFO:teuthology.orchestra.run.smithi155.stdout: "event": "all_read", 2023-08-01T19:55:30.914 INFO:teuthology.orchestra.run.smithi155.stdout: "time": "2023-08-01T19:55:05.576725+0000", 2023-08-01T19:55:30.914 INFO:teuthology.orchestra.run.smithi155.stdout: "duration": 6.4435000000000002e-05 2023-08-01T19:55:30.914 INFO:teuthology.orchestra.run.smithi155.stdout: }, 2023-08-01T19:55:30.914 INFO:teuthology.orchestra.run.smithi155.stdout: { 2023-08-01T19:55:30.915 INFO:teuthology.orchestra.run.smithi155.stdout: "event": "dispatched", 2023-08-01T19:55:30.915 INFO:teuthology.orchestra.run.smithi155.stdout: "time": "2023-08-01T19:55:05.576744+0000", 2023-08-01T19:55:30.915 INFO:teuthology.orchestra.run.smithi155.stdout: "duration": 1.8502999999999999e-05 2023-08-01T19:55:30.915 INFO:teuthology.orchestra.run.smithi155.stdout: }, 2023-08-01T19:55:30.915 INFO:teuthology.orchestra.run.smithi155.stdout: { 2023-08-01T19:55:30.915 INFO:teuthology.orchestra.run.smithi155.stdout: "event": "queued_for_pg", 2023-08-01T19:55:30.915 INFO:teuthology.orchestra.run.smithi155.stdout: "time": "2023-08-01T19:55:05.576772+0000", 2023-08-01T19:55:30.915 INFO:teuthology.orchestra.run.smithi155.stdout: "duration": 2.8354999999999999e-05 2023-08-01T19:55:30.916 INFO:teuthology.orchestra.run.smithi155.stdout: }, 2023-08-01T19:55:30.916 INFO:teuthology.orchestra.run.smithi155.stdout: { 2023-08-01T19:55:30.916 INFO:teuthology.orchestra.run.smithi155.stdout: "event": "reached_pg", 2023-08-01T19:55:30.916 INFO:teuthology.orchestra.run.smithi155.stdout: "time": "2023-08-01T19:55:05.576815+0000", 2023-08-01T19:55:30.916 INFO:teuthology.orchestra.run.smithi155.stdout: "duration": 4.3223999999999998e-05 2023-08-01T19:55:30.916 INFO:teuthology.orchestra.run.smithi155.stdout: }, 2023-08-01T19:55:30.916 INFO:teuthology.orchestra.run.smithi155.stdout: { 2023-08-01T19:55:30.917 INFO:teuthology.orchestra.run.smithi155.stdout: "event": "started", 2023-08-01T19:55:30.917 INFO:teuthology.orchestra.run.smithi155.stdout: "time": "2023-08-01T19:55:05.576961+0000", 2023-08-01T19:55:30.917 INFO:teuthology.orchestra.run.smithi155.stdout: "duration": 0.000145043 2023-08-01T19:55:30.917 INFO:teuthology.orchestra.run.smithi155.stdout: }, 2023-08-01T19:55:30.917 INFO:teuthology.orchestra.run.smithi155.stdout: { 2023-08-01T19:55:30.917 INFO:teuthology.orchestra.run.smithi155.stdout: "event": "waiting for subops from 0", 2023-08-01T19:55:30.917 INFO:teuthology.orchestra.run.smithi155.stdout: "time": "2023-08-01T19:55:05.577343+0000", 2023-08-01T19:55:30.917 INFO:teuthology.orchestra.run.smithi155.stdout: "duration": 0.00038249699999999998 2023-08-01T19:55:30.918 INFO:teuthology.orchestra.run.smithi155.stdout: }, 2023-08-01T19:55:30.918 INFO:teuthology.orchestra.run.smithi155.stdout: { 2023-08-01T19:55:30.918 INFO:teuthology.orchestra.run.smithi155.stdout: "event": "op_commit", 2023-08-01T19:55:30.918 INFO:teuthology.orchestra.run.smithi155.stdout: "time": "2023-08-01T19:55:05.582349+0000", 2023-08-01T19:55:30.918 INFO:teuthology.orchestra.run.smithi155.stdout: "duration": 0.0050062880000000002 2023-08-01T19:55:30.918 INFO:teuthology.orchestra.run.smithi155.stdout: }, 2023-08-01T19:55:30.918 INFO:teuthology.orchestra.run.smithi155.stdout: { 2023-08-01T19:55:30.918 INFO:teuthology.orchestra.run.smithi155.stdout: "event": "sub_op_commit_rec", 2023-08-01T19:55:30.919 INFO:teuthology.orchestra.run.smithi155.stdout: "time": "2023-08-01T19:55:05.632659+0000", 2023-08-01T19:55:30.919 INFO:teuthology.orchestra.run.smithi155.stdout: "duration": 0.050309185999999999 2023-08-01T19:55:30.919 INFO:teuthology.orchestra.run.smithi155.stdout: }, 2023-08-01T19:55:30.919 INFO:teuthology.orchestra.run.smithi155.stdout: { 2023-08-01T19:55:30.919 INFO:teuthology.orchestra.run.smithi155.stdout: "event": "commit_sent", 2023-08-01T19:55:30.919 INFO:teuthology.orchestra.run.smithi155.stdout: "time": "2023-08-01T19:55:05.632692+0000", 2023-08-01T19:55:30.919 INFO:teuthology.orchestra.run.smithi155.stdout: "duration": 3.3077999999999997e-05 2023-08-01T19:55:30.919 INFO:teuthology.orchestra.run.smithi155.stdout: }, 2023-08-01T19:55:30.920 INFO:teuthology.orchestra.run.smithi155.stdout: { 2023-08-01T19:55:30.920 INFO:teuthology.orchestra.run.smithi155.stdout: "event": "done", 2023-08-01T19:55:30.920 INFO:teuthology.orchestra.run.smithi155.stdout: "time": "2023-08-01T19:55:05.632717+0000", 2023-08-01T19:55:30.920 INFO:teuthology.orchestra.run.smithi155.stdout: "duration": 2.5119000000000001e-05 2023-08-01T19:55:30.920 INFO:teuthology.orchestra.run.smithi155.stdout: } 2023-08-01T19:55:30.920 INFO:teuthology.orchestra.run.smithi155.stdout: ] 2023-08-01T19:55:30.920 INFO:teuthology.orchestra.run.smithi155.stdout: } 2023-08-01T19:55:30.920 INFO:teuthology.orchestra.run.smithi155.stdout: }, 2023-08-01T19:55:30.921 INFO:teuthology.orchestra.run.smithi155.stdout: { 2023-08-01T19:55:30.921 INFO:teuthology.orchestra.run.smithi155.stdout: "description": "osd_op(client.4668.0:100945 5.e 5:73df68dd:::benchmark_data_smithi006_114134_object100944:head [set-alloc-hint object_size 65536 write_size 65536,write 0~65536] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e37)", 2023-08-01T19:55:30.921 INFO:teuthology.orchestra.run.smithi155.stdout: "initiated_at": "2023-08-01T19:55:05.576784+0000", 2023-08-01T19:55:30.921 INFO:teuthology.orchestra.run.smithi155.stdout: "age": 25.155232627, 2023-08-01T19:55:30.921 INFO:teuthology.orchestra.run.smithi155.stdout: "duration": 0.058512994999999998, 2023-08-01T19:55:30.921 INFO:teuthology.orchestra.run.smithi155.stdout: "type_data": { 2023-08-01T19:55:30.921 INFO:teuthology.orchestra.run.smithi155.stdout: "flag_point": "commit sent; apply or cleanup", 2023-08-01T19:55:30.922 INFO:teuthology.orchestra.run.smithi155.stdout: "client_info": { 2023-08-01T19:55:30.922 INFO:teuthology.orchestra.run.smithi155.stdout: "client": "client.4668", 2023-08-01T19:55:30.922 INFO:teuthology.orchestra.run.smithi155.stdout: "client_addr": "172.21.15.6:0/1709472247", 2023-08-01T19:55:30.922 INFO:teuthology.orchestra.run.smithi155.stdout: "tid": 100945 2023-08-01T19:55:30.922 INFO:teuthology.orchestra.run.smithi155.stdout: }, 2023-08-01T19:55:30.922 INFO:teuthology.orchestra.run.smithi155.stdout: "events": [ 2023-08-01T19:55:30.922 INFO:teuthology.orchestra.run.smithi155.stdout: { 2023-08-01T19:55:30.922 INFO:teuthology.orchestra.run.smithi155.stdout: "event": "initiated", 2023-08-01T19:55:30.923 INFO:teuthology.orchestra.run.smithi155.stdout: "time": "2023-08-01T19:55:05.576784+0000", 2023-08-01T19:55:30.923 INFO:teuthology.orchestra.run.smithi155.stdout: "duration": 0 2023-08-01T19:55:30.923 INFO:teuthology.orchestra.run.smithi155.stdout: }, 2023-08-01T19:55:30.923 INFO:teuthology.orchestra.run.smithi155.stdout: { 2023-08-01T19:55:30.923 INFO:teuthology.orchestra.run.smithi155.stdout: "event": "throttled", 2023-08-01T19:55:30.923 INFO:teuthology.orchestra.run.smithi155.stdout: "time": "2023-08-01T19:55:05.576784+0000", 2023-08-01T19:55:30.923 INFO:teuthology.orchestra.run.smithi155.stdout: "duration": 0 2023-08-01T19:55:30.923 INFO:teuthology.orchestra.run.smithi155.stdout: }, 2023-08-01T19:55:30.924 INFO:teuthology.orchestra.run.smithi155.stdout: { 2023-08-01T19:55:30.924 INFO:teuthology.orchestra.run.smithi155.stdout: "event": "header_read", 2023-08-01T19:55:30.924 INFO:teuthology.orchestra.run.smithi155.stdout: "time": "2023-08-01T19:55:05.576783+0000", 2023-08-01T19:55:30.924 INFO:teuthology.orchestra.run.smithi155.stdout: "duration": 4294967295.9999995 2023-08-01T19:55:30.924 INFO:teuthology.orchestra.run.smithi155.stdout: }, 2023-08-01T19:55:30.924 INFO:teuthology.orchestra.run.smithi155.stdout: { 2023-08-01T19:55:30.924 INFO:teuthology.orchestra.run.smithi155.stdout: "event": "all_read", 2023-08-01T19:55:30.924 INFO:teuthology.orchestra.run.smithi155.stdout: "time": "2023-08-01T19:55:05.576807+0000", 2023-08-01T19:55:30.925 INFO:teuthology.orchestra.run.smithi155.stdout: "duration": 2.3651000000000001e-05 2023-08-01T19:55:30.925 INFO:teuthology.orchestra.run.smithi155.stdout: }, 2023-08-01T19:55:30.925 INFO:teuthology.orchestra.run.smithi155.stdout: { 2023-08-01T19:55:30.925 INFO:teuthology.orchestra.run.smithi155.stdout: "event": "dispatched", 2023-08-01T19:55:30.925 INFO:teuthology.orchestra.run.smithi155.stdout: "time": "2023-08-01T19:55:05.576817+0000", 2023-08-01T19:55:30.925 INFO:teuthology.orchestra.run.smithi155.stdout: "duration": 9.9389999999999992e-06 2023-08-01T19:55:30.925 INFO:teuthology.orchestra.run.smithi155.stdout: }, 2023-08-01T19:55:30.925 INFO:teuthology.orchestra.run.smithi155.stdout: { 2023-08-01T19:55:30.926 INFO:teuthology.orchestra.run.smithi155.stdout: "event": "queued_for_pg", 2023-08-01T19:55:30.926 INFO:teuthology.orchestra.run.smithi155.stdout: "time": "2023-08-01T19:55:05.576820+0000", 2023-08-01T19:55:30.926 INFO:teuthology.orchestra.run.smithi155.stdout: "duration": 3.2619999999999999e-06 2023-08-01T19:55:30.926 INFO:teuthology.orchestra.run.smithi155.stdout: }, 2023-08-01T19:55:30.926 INFO:teuthology.orchestra.run.smithi155.stdout: { 2023-08-01T19:55:30.926 INFO:teuthology.orchestra.run.smithi155.stdout: "event": "reached_pg", 2023-08-01T19:55:30.926 INFO:teuthology.orchestra.run.smithi155.stdout: "time": "2023-08-01T19:55:05.576849+0000", 2023-08-01T19:55:30.926 INFO:teuthology.orchestra.run.smithi155.stdout: "duration": 2.8880000000000001e-05 2023-08-01T19:55:30.927 INFO:teuthology.orchestra.run.smithi155.stdout: }, 2023-08-01T19:55:30.927 INFO:teuthology.orchestra.run.smithi155.stdout: { 2023-08-01T19:55:30.927 INFO:teuthology.orchestra.run.smithi155.stdout: "event": "started", 2023-08-01T19:55:30.927 INFO:teuthology.orchestra.run.smithi155.stdout: "time": "2023-08-01T19:55:05.576940+0000", 2023-08-01T19:55:30.927 INFO:teuthology.orchestra.run.smithi155.stdout: "duration": 9.0570999999999997e-05 2023-08-01T19:55:30.927 INFO:teuthology.orchestra.run.smithi155.stdout: }, 2023-08-01T19:55:30.927 INFO:teuthology.orchestra.run.smithi155.stdout: { 2023-08-01T19:55:30.927 INFO:teuthology.orchestra.run.smithi155.stdout: "event": "waiting for subops from 0", 2023-08-01T19:55:30.928 INFO:teuthology.orchestra.run.smithi155.stdout: "time": "2023-08-01T19:55:05.577027+0000", 2023-08-01T19:55:30.928 INFO:teuthology.orchestra.run.smithi155.stdout: "duration": 8.7237999999999994e-05 2023-08-01T19:55:30.928 INFO:teuthology.orchestra.run.smithi155.stdout: }, 2023-08-01T19:55:30.928 INFO:teuthology.orchestra.run.smithi155.stdout: { 2023-08-01T19:55:30.928 INFO:teuthology.orchestra.run.smithi155.stdout: "event": "op_commit", 2023-08-01T19:55:30.928 INFO:teuthology.orchestra.run.smithi155.stdout: "time": "2023-08-01T19:55:05.579624+0000", 2023-08-01T19:55:30.928 INFO:teuthology.orchestra.run.smithi155.stdout: "duration": 0.0025971200000000001 2023-08-01T19:55:30.928 INFO:teuthology.orchestra.run.smithi155.stdout: }, 2023-08-01T19:55:30.929 INFO:teuthology.orchestra.run.smithi155.stdout: { 2023-08-01T19:55:30.929 INFO:teuthology.orchestra.run.smithi155.stdout: "event": "sub_op_commit_rec", 2023-08-01T19:55:30.929 INFO:teuthology.orchestra.run.smithi155.stdout: "time": "2023-08-01T19:55:05.635218+0000", 2023-08-01T19:55:30.929 INFO:teuthology.orchestra.run.smithi155.stdout: "duration": 0.055594487999999997 2023-08-01T19:55:30.929 INFO:teuthology.orchestra.run.smithi155.stdout: }, 2023-08-01T19:55:30.929 INFO:teuthology.orchestra.run.smithi155.stdout: { 2023-08-01T19:55:30.929 INFO:teuthology.orchestra.run.smithi155.stdout: "event": "commit_sent", 2023-08-01T19:55:30.929 INFO:teuthology.orchestra.run.smithi155.stdout: "time": "2023-08-01T19:55:05.635262+0000", 2023-08-01T19:55:30.930 INFO:teuthology.orchestra.run.smithi155.stdout: "duration": 4.3380999999999997e-05 2023-08-01T19:55:30.930 INFO:teuthology.orchestra.run.smithi155.stdout: }, 2023-08-01T19:55:30.930 INFO:teuthology.orchestra.run.smithi155.stdout: { 2023-08-01T19:55:30.930 INFO:teuthology.orchestra.run.smithi155.stdout: "event": "done", 2023-08-01T19:55:30.930 INFO:teuthology.orchestra.run.smithi155.stdout: "time": "2023-08-01T19:55:05.635297+0000", 2023-08-01T19:55:30.930 INFO:teuthology.orchestra.run.smithi155.stdout: "duration": 3.4842000000000003e-05 2023-08-01T19:55:30.930 INFO:teuthology.orchestra.run.smithi155.stdout: } 2023-08-01T19:55:30.930 INFO:teuthology.orchestra.run.smithi155.stdout: ] 2023-08-01T19:55:30.931 INFO:teuthology.orchestra.run.smithi155.stdout: } 2023-08-01T19:55:30.931 INFO:teuthology.orchestra.run.smithi155.stdout: }, 2023-08-01T19:55:30.931 INFO:teuthology.orchestra.run.smithi155.stdout: { 2023-08-01T19:55:30.931 INFO:teuthology.orchestra.run.smithi155.stdout: "description": "osd_op(client.4668.0:100947 5.4 5:23e8fc27:::benchmark_data_smithi006_114134_object100946:head [set-alloc-hint object_size 65536 write_size 65536,write 0~65536] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e37)", 2023-08-01T19:55:30.931 INFO:teuthology.orchestra.run.smithi155.stdout: "initiated_at": "2023-08-01T19:55:05.576840+0000", 2023-08-01T19:55:30.931 INFO:teuthology.orchestra.run.smithi155.stdout: "age": 25.155176571999998, 2023-08-01T19:55:30.931 INFO:teuthology.orchestra.run.smithi155.stdout: "duration": 0.058423127999999998, 2023-08-01T19:55:30.931 INFO:teuthology.orchestra.run.smithi155.stdout: "type_data": { 2023-08-01T19:55:30.932 INFO:teuthology.orchestra.run.smithi155.stdout: "flag_point": "commit sent; apply or cleanup", 2023-08-01T19:55:30.932 INFO:teuthology.orchestra.run.smithi155.stdout: "client_info": { 2023-08-01T19:55:30.932 INFO:teuthology.orchestra.run.smithi155.stdout: "client": "client.4668", 2023-08-01T19:55:30.932 INFO:teuthology.orchestra.run.smithi155.stdout: "client_addr": "172.21.15.6:0/1709472247", 2023-08-01T19:55:30.932 INFO:teuthology.orchestra.run.smithi155.stdout: "tid": 100947 2023-08-01T19:55:30.932 INFO:teuthology.orchestra.run.smithi155.stdout: }, 2023-08-01T19:55:30.932 INFO:teuthology.orchestra.run.smithi155.stdout: "events": [ 2023-08-01T19:55:30.933 INFO:teuthology.orchestra.run.smithi155.stdout: { 2023-08-01T19:55:30.933 INFO:teuthology.orchestra.run.smithi155.stdout: "event": "initiated", 2023-08-01T19:55:30.933 INFO:teuthology.orchestra.run.smithi155.stdout: "time": "2023-08-01T19:55:05.576840+0000", 2023-08-01T19:55:30.933 INFO:teuthology.orchestra.run.smithi155.stdout: "duration": 0 2023-08-01T19:55:30.933 INFO:teuthology.orchestra.run.smithi155.stdout: }, 2023-08-01T19:55:30.933 INFO:teuthology.orchestra.run.smithi155.stdout: { 2023-08-01T19:55:30.933 INFO:teuthology.orchestra.run.smithi155.stdout: "event": "throttled", 2023-08-01T19:55:30.933 INFO:teuthology.orchestra.run.smithi155.stdout: "time": "2023-08-01T19:55:05.576840+0000", 2023-08-01T19:55:30.934 INFO:teuthology.orchestra.run.smithi155.stdout: "duration": 0 2023-08-01T19:55:30.934 INFO:teuthology.orchestra.run.smithi155.stdout: }, 2023-08-01T19:55:30.934 INFO:teuthology.orchestra.run.smithi155.stdout: { 2023-08-01T19:55:30.934 INFO:teuthology.orchestra.run.smithi155.stdout: "event": "header_read", 2023-08-01T19:55:30.934 INFO:teuthology.orchestra.run.smithi155.stdout: "time": "2023-08-01T19:55:05.576839+0000", 2023-08-01T19:55:30.934 INFO:teuthology.orchestra.run.smithi155.stdout: "duration": 4294967295.9999995 2023-08-01T19:55:30.934 INFO:teuthology.orchestra.run.smithi155.stdout: }, 2023-08-01T19:55:30.934 INFO:teuthology.orchestra.run.smithi155.stdout: { 2023-08-01T19:55:30.935 INFO:teuthology.orchestra.run.smithi155.stdout: "event": "all_read", 2023-08-01T19:55:30.935 INFO:teuthology.orchestra.run.smithi155.stdout: "time": "2023-08-01T19:55:05.576893+0000", 2023-08-01T19:55:30.935 INFO:teuthology.orchestra.run.smithi155.stdout: "duration": 5.3893000000000001e-05 2023-08-01T19:55:30.935 INFO:teuthology.orchestra.run.smithi155.stdout: }, 2023-08-01T19:55:30.935 INFO:teuthology.orchestra.run.smithi155.stdout: { 2023-08-01T19:55:30.935 INFO:teuthology.orchestra.run.smithi155.stdout: "event": "dispatched", 2023-08-01T19:55:30.935 INFO:teuthology.orchestra.run.smithi155.stdout: "time": "2023-08-01T19:55:05.576902+0000", 2023-08-01T19:55:30.935 INFO:teuthology.orchestra.run.smithi155.stdout: "duration": 8.7520000000000002e-06 2023-08-01T19:55:30.936 INFO:teuthology.orchestra.run.smithi155.stdout: }, 2023-08-01T19:55:30.936 INFO:teuthology.orchestra.run.smithi155.stdout: { 2023-08-01T19:55:30.936 INFO:teuthology.orchestra.run.smithi155.stdout: "event": "queued_for_pg", 2023-08-01T19:55:30.936 INFO:teuthology.orchestra.run.smithi155.stdout: "time": "2023-08-01T19:55:05.576905+0000", 2023-08-01T19:55:30.936 INFO:teuthology.orchestra.run.smithi155.stdout: "duration": 3.01e-06 2023-08-01T19:55:30.936 INFO:teuthology.orchestra.run.smithi155.stdout: }, 2023-08-01T19:55:30.936 INFO:teuthology.orchestra.run.smithi155.stdout: { 2023-08-01T19:55:30.936 INFO:teuthology.orchestra.run.smithi155.stdout: "event": "reached_pg", 2023-08-01T19:55:30.937 INFO:teuthology.orchestra.run.smithi155.stdout: "time": "2023-08-01T19:55:05.579641+0000", 2023-08-01T19:55:30.937 INFO:teuthology.orchestra.run.smithi155.stdout: "duration": 0.0027366880000000001 2023-08-01T19:55:30.937 INFO:teuthology.orchestra.run.smithi155.stdout: }, 2023-08-01T19:55:30.937 INFO:teuthology.orchestra.run.smithi155.stdout: { 2023-08-01T19:55:30.937 INFO:teuthology.orchestra.run.smithi155.stdout: "event": "started", 2023-08-01T19:55:30.937 INFO:teuthology.orchestra.run.smithi155.stdout: "time": "2023-08-01T19:55:05.579734+0000", 2023-08-01T19:55:30.937 INFO:teuthology.orchestra.run.smithi155.stdout: "duration": 9.2590000000000006e-05 2023-08-01T19:55:30.937 INFO:teuthology.orchestra.run.smithi155.stdout: }, 2023-08-01T19:55:30.938 INFO:teuthology.orchestra.run.smithi155.stdout: { 2023-08-01T19:55:30.938 INFO:teuthology.orchestra.run.smithi155.stdout: "event": "waiting for subops from 0", 2023-08-01T19:55:30.938 INFO:teuthology.orchestra.run.smithi155.stdout: "time": "2023-08-01T19:55:05.579825+0000", 2023-08-01T19:55:30.938 INFO:teuthology.orchestra.run.smithi155.stdout: "duration": 9.0964999999999994e-05 2023-08-01T19:55:30.938 INFO:teuthology.orchestra.run.smithi155.stdout: }, 2023-08-01T19:55:30.938 INFO:teuthology.orchestra.run.smithi155.stdout: { 2023-08-01T19:55:30.938 INFO:teuthology.orchestra.run.smithi155.stdout: "event": "op_commit", 2023-08-01T19:55:30.938 INFO:teuthology.orchestra.run.smithi155.stdout: "time": "2023-08-01T19:55:05.585041+0000", 2023-08-01T19:55:30.939 INFO:teuthology.orchestra.run.smithi155.stdout: "duration": 0.0052159670000000002 2023-08-01T19:55:30.939 INFO:teuthology.orchestra.run.smithi155.stdout: }, 2023-08-01T19:55:30.939 INFO:teuthology.orchestra.run.smithi155.stdout: { 2023-08-01T19:55:30.939 INFO:teuthology.orchestra.run.smithi155.stdout: "event": "sub_op_commit_rec", 2023-08-01T19:55:30.939 INFO:teuthology.orchestra.run.smithi155.stdout: "time": "2023-08-01T19:55:05.635199+0000", 2023-08-01T19:55:30.940 INFO:teuthology.orchestra.run.smithi155.stdout: "duration": 0.050158023000000003 2023-08-01T19:55:30.940 INFO:teuthology.orchestra.run.smithi155.stdout: }, 2023-08-01T19:55:30.940 INFO:teuthology.orchestra.run.smithi155.stdout: { 2023-08-01T19:55:30.940 INFO:teuthology.orchestra.run.smithi155.stdout: "event": "commit_sent", 2023-08-01T19:55:30.941 INFO:teuthology.orchestra.run.smithi155.stdout: "time": "2023-08-01T19:55:05.635227+0000", 2023-08-01T19:55:30.941 INFO:teuthology.orchestra.run.smithi155.stdout: "duration": 2.7821e-05 2023-08-01T19:55:30.941 INFO:teuthology.orchestra.run.smithi155.stdout: }, 2023-08-01T19:55:30.941 INFO:teuthology.orchestra.run.smithi155.stdout: { 2023-08-01T19:55:30.941 INFO:teuthology.orchestra.run.smithi155.stdout: "event": "done", 2023-08-01T19:55:30.941 INFO:teuthology.orchestra.run.smithi155.stdout: "time": "2023-08-01T19:55:05.635263+0000", 2023-08-01T19:55:30.941 INFO:teuthology.orchestra.run.smithi155.stdout: "duration": 3.6081000000000002e-05 2023-08-01T19:55:30.942 INFO:teuthology.orchestra.run.smithi155.stdout: } 2023-08-01T19:55:30.942 INFO:teuthology.orchestra.run.smithi155.stdout: ] 2023-08-01T19:55:30.942 INFO:teuthology.orchestra.run.smithi155.stdout: } 2023-08-01T19:55:30.942 INFO:teuthology.orchestra.run.smithi155.stdout: } 2023-08-01T19:55:30.942 INFO:teuthology.orchestra.run.smithi155.stdout: ] 2023-08-01T19:55:30.942 INFO:teuthology.orchestra.run.smithi155.stdout:} 2023-08-01T19:55:30.943 INFO:tasks.ceph.osd.2.smithi155.stderr:2023-08-01T19:55:30.941+0000 7faa5c6ac700 -1 received signal: Hangup from /usr/bin/python3 /bin/daemon-helper kill ceph-osd -f --cluster ceph -i 2 (PID: 111337) UID: 0 2023-08-01T19:55:30.944 DEBUG:teuthology.orchestra.run.smithi008:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 30 ceph --cluster ceph --admin-daemon /var/run/ceph/ceph-osd.0.asok dump_ops_in_flight 2023-08-01T19:55:30.993 INFO:teuthology.orchestra.run.smithi006.stderr:nodeep-scrub is unset 2023-08-01T19:55:31.044 INFO:tasks.ceph.osd.1.smithi101.stderr:2023-08-01T19:55:31.042+0000 7fb0cb7f6700 -1 received signal: Hangup from /usr/bin/python3 /bin/daemon-helper kill ceph-osd -f --cluster ceph -i 1 (PID: 111141) UID: 0 2023-08-01T19:55:31.131 INFO:teuthology.orchestra.run.smithi008.stdout:{ 2023-08-01T19:55:31.131 INFO:teuthology.orchestra.run.smithi008.stdout: "ops": [ 2023-08-01T19:55:31.131 INFO:teuthology.orchestra.run.smithi008.stdout: { 2023-08-01T19:55:31.132 INFO:teuthology.orchestra.run.smithi008.stdout: "description": "osd_repop(client.4668.0:145535 5.0 e48/19 5:071fab43:::benchmark_data_smithi006_114134_object11874:head v 48'9227, mlcod=48'9225)", 2023-08-01T19:55:31.132 INFO:teuthology.orchestra.run.smithi008.stdout: "initiated_at": "2023-08-01T19:55:31.120095+0000", 2023-08-01T19:55:31.132 INFO:teuthology.orchestra.run.smithi008.stdout: "age": 0.0092851670000000004, 2023-08-01T19:55:31.132 INFO:teuthology.orchestra.run.smithi008.stdout: "duration": 0.0093034710000000007, 2023-08-01T19:55:31.132 INFO:teuthology.orchestra.run.smithi008.stdout: "type_data": { 2023-08-01T19:55:31.132 INFO:teuthology.orchestra.run.smithi008.stdout: "flag_point": "started", 2023-08-01T19:55:31.132 INFO:teuthology.orchestra.run.smithi008.stdout: "events": [ 2023-08-01T19:55:31.133 INFO:teuthology.orchestra.run.smithi008.stdout: { 2023-08-01T19:55:31.133 INFO:teuthology.orchestra.run.smithi008.stdout: "event": "initiated", 2023-08-01T19:55:31.133 INFO:teuthology.orchestra.run.smithi008.stdout: "time": "2023-08-01T19:55:31.120095+0000", 2023-08-01T19:55:31.133 INFO:teuthology.orchestra.run.smithi008.stdout: "duration": 0 2023-08-01T19:55:31.133 INFO:teuthology.orchestra.run.smithi008.stdout: }, 2023-08-01T19:55:31.133 INFO:teuthology.orchestra.run.smithi008.stdout: { 2023-08-01T19:55:31.133 INFO:teuthology.orchestra.run.smithi008.stdout: "event": "throttled", 2023-08-01T19:55:31.133 INFO:teuthology.orchestra.run.smithi008.stdout: "time": "2023-08-01T19:55:31.120095+0000", 2023-08-01T19:55:31.134 INFO:teuthology.orchestra.run.smithi008.stdout: "duration": 0 2023-08-01T19:55:31.134 INFO:teuthology.orchestra.run.smithi008.stdout: }, 2023-08-01T19:55:31.134 INFO:teuthology.orchestra.run.smithi008.stdout: { 2023-08-01T19:55:31.134 INFO:teuthology.orchestra.run.smithi008.stdout: "event": "header_read", 2023-08-01T19:55:31.134 INFO:teuthology.orchestra.run.smithi008.stdout: "time": "2023-08-01T19:55:31.120095+0000", 2023-08-01T19:55:31.134 INFO:teuthology.orchestra.run.smithi008.stdout: "duration": 4294967295.9999995 2023-08-01T19:55:31.134 INFO:teuthology.orchestra.run.smithi008.stdout: }, 2023-08-01T19:55:31.134 INFO:teuthology.orchestra.run.smithi008.stdout: { 2023-08-01T19:55:31.135 INFO:teuthology.orchestra.run.smithi008.stdout: "event": "all_read", 2023-08-01T19:55:31.135 INFO:teuthology.orchestra.run.smithi008.stdout: "time": "2023-08-01T19:55:31.120099+0000", 2023-08-01T19:55:31.135 INFO:teuthology.orchestra.run.smithi008.stdout: "duration": 4.746e-06 2023-08-01T19:55:31.135 INFO:teuthology.orchestra.run.smithi008.stdout: }, 2023-08-01T19:55:31.135 INFO:teuthology.orchestra.run.smithi008.stdout: { 2023-08-01T19:55:31.135 INFO:teuthology.orchestra.run.smithi008.stdout: "event": "dispatched", 2023-08-01T19:55:31.135 INFO:teuthology.orchestra.run.smithi008.stdout: "time": "2023-08-01T19:55:31.120106+0000", 2023-08-01T19:55:31.135 INFO:teuthology.orchestra.run.smithi008.stdout: "duration": 7.0890000000000002e-06 2023-08-01T19:55:31.136 INFO:teuthology.orchestra.run.smithi008.stdout: }, 2023-08-01T19:55:31.136 INFO:teuthology.orchestra.run.smithi008.stdout: { 2023-08-01T19:55:31.136 INFO:teuthology.orchestra.run.smithi008.stdout: "event": "queued_for_pg", 2023-08-01T19:55:31.136 INFO:teuthology.orchestra.run.smithi008.stdout: "time": "2023-08-01T19:55:31.120110+0000", 2023-08-01T19:55:31.136 INFO:teuthology.orchestra.run.smithi008.stdout: "duration": 3.9890000000000003e-06 2023-08-01T19:55:31.136 INFO:teuthology.orchestra.run.smithi008.stdout: }, 2023-08-01T19:55:31.136 INFO:teuthology.orchestra.run.smithi008.stdout: { 2023-08-01T19:55:31.137 INFO:teuthology.orchestra.run.smithi008.stdout: "event": "reached_pg", 2023-08-01T19:55:31.137 INFO:teuthology.orchestra.run.smithi008.stdout: "time": "2023-08-01T19:55:31.121228+0000", 2023-08-01T19:55:31.137 INFO:teuthology.orchestra.run.smithi008.stdout: "duration": 0.0011176300000000001 2023-08-01T19:55:31.137 INFO:teuthology.orchestra.run.smithi008.stdout: }, 2023-08-01T19:55:31.137 INFO:teuthology.orchestra.run.smithi008.stdout: { 2023-08-01T19:55:31.137 INFO:teuthology.orchestra.run.smithi008.stdout: "event": "started", 2023-08-01T19:55:31.137 INFO:teuthology.orchestra.run.smithi008.stdout: "time": "2023-08-01T19:55:31.121240+0000", 2023-08-01T19:55:31.137 INFO:teuthology.orchestra.run.smithi008.stdout: "duration": 1.19e-05 2023-08-01T19:55:31.138 INFO:teuthology.orchestra.run.smithi008.stdout: } 2023-08-01T19:55:31.138 INFO:teuthology.orchestra.run.smithi008.stdout: ] 2023-08-01T19:55:31.138 INFO:teuthology.orchestra.run.smithi008.stdout: } 2023-08-01T19:55:31.138 INFO:teuthology.orchestra.run.smithi008.stdout: }, 2023-08-01T19:55:31.138 INFO:teuthology.orchestra.run.smithi008.stdout: { 2023-08-01T19:55:31.138 INFO:teuthology.orchestra.run.smithi008.stdout: "description": "osd_repop(client.4668.0:145537 5.4 e48/19 5:25cccce9:::benchmark_data_smithi006_114134_object11876:head v 48'8995, mlcod=48'8992)", 2023-08-01T19:55:31.138 INFO:teuthology.orchestra.run.smithi008.stdout: "initiated_at": "2023-08-01T19:55:31.121215+0000", 2023-08-01T19:55:31.139 INFO:teuthology.orchestra.run.smithi008.stdout: "age": 0.0081654359999999999, 2023-08-01T19:55:31.139 INFO:teuthology.orchestra.run.smithi008.stdout: "duration": 0.0082263130000000007, 2023-08-01T19:55:31.139 INFO:teuthology.orchestra.run.smithi008.stdout: "type_data": { 2023-08-01T19:55:31.139 INFO:teuthology.orchestra.run.smithi008.stdout: "flag_point": "started", 2023-08-01T19:55:31.139 INFO:teuthology.orchestra.run.smithi008.stdout: "events": [ 2023-08-01T19:55:31.139 INFO:teuthology.orchestra.run.smithi008.stdout: { 2023-08-01T19:55:31.139 INFO:teuthology.orchestra.run.smithi008.stdout: "event": "initiated", 2023-08-01T19:55:31.140 INFO:teuthology.orchestra.run.smithi008.stdout: "time": "2023-08-01T19:55:31.121215+0000", 2023-08-01T19:55:31.140 INFO:teuthology.orchestra.run.smithi008.stdout: "duration": 0 2023-08-01T19:55:31.140 INFO:teuthology.orchestra.run.smithi008.stdout: }, 2023-08-01T19:55:31.140 INFO:teuthology.orchestra.run.smithi008.stdout: { 2023-08-01T19:55:31.140 INFO:teuthology.orchestra.run.smithi008.stdout: "event": "throttled", 2023-08-01T19:55:31.140 INFO:teuthology.orchestra.run.smithi008.stdout: "time": "2023-08-01T19:55:31.121215+0000", 2023-08-01T19:55:31.140 INFO:teuthology.orchestra.run.smithi008.stdout: "duration": 0 2023-08-01T19:55:31.140 INFO:teuthology.orchestra.run.smithi008.stdout: }, 2023-08-01T19:55:31.141 INFO:teuthology.orchestra.run.smithi008.stdout: { 2023-08-01T19:55:31.141 INFO:teuthology.orchestra.run.smithi008.stdout: "event": "header_read", 2023-08-01T19:55:31.141 INFO:teuthology.orchestra.run.smithi008.stdout: "time": "2023-08-01T19:55:31.121214+0000", 2023-08-01T19:55:31.141 INFO:teuthology.orchestra.run.smithi008.stdout: "duration": 4294967295.9999995 2023-08-01T19:55:31.141 INFO:teuthology.orchestra.run.smithi008.stdout: }, 2023-08-01T19:55:31.141 INFO:teuthology.orchestra.run.smithi008.stdout: { 2023-08-01T19:55:31.141 INFO:teuthology.orchestra.run.smithi008.stdout: "event": "all_read", 2023-08-01T19:55:31.141 INFO:teuthology.orchestra.run.smithi008.stdout: "time": "2023-08-01T19:55:31.121220+0000", 2023-08-01T19:55:31.142 INFO:teuthology.orchestra.run.smithi008.stdout: "duration": 5.1070000000000004e-06 2023-08-01T19:55:31.142 INFO:teuthology.orchestra.run.smithi008.stdout: }, 2023-08-01T19:55:31.142 INFO:teuthology.orchestra.run.smithi008.stdout: { 2023-08-01T19:55:31.142 INFO:teuthology.orchestra.run.smithi008.stdout: "event": "dispatched", 2023-08-01T19:55:31.142 INFO:teuthology.orchestra.run.smithi008.stdout: "time": "2023-08-01T19:55:31.121229+0000", 2023-08-01T19:55:31.142 INFO:teuthology.orchestra.run.smithi008.stdout: "duration": 9.6989999999999998e-06 2023-08-01T19:55:31.142 INFO:teuthology.orchestra.run.smithi008.stdout: }, 2023-08-01T19:55:31.142 INFO:teuthology.orchestra.run.smithi008.stdout: { 2023-08-01T19:55:31.143 INFO:teuthology.orchestra.run.smithi008.stdout: "event": "queued_for_pg", 2023-08-01T19:55:31.143 INFO:teuthology.orchestra.run.smithi008.stdout: "time": "2023-08-01T19:55:31.121234+0000", 2023-08-01T19:55:31.143 INFO:teuthology.orchestra.run.smithi008.stdout: "duration": 5.1089999999999997e-06 2023-08-01T19:55:31.143 INFO:teuthology.orchestra.run.smithi008.stdout: }, 2023-08-01T19:55:31.143 INFO:teuthology.orchestra.run.smithi008.stdout: { 2023-08-01T19:55:31.143 INFO:teuthology.orchestra.run.smithi008.stdout: "event": "reached_pg", 2023-08-01T19:55:31.143 INFO:teuthology.orchestra.run.smithi008.stdout: "time": "2023-08-01T19:55:31.121266+0000", 2023-08-01T19:55:31.143 INFO:teuthology.orchestra.run.smithi008.stdout: "duration": 3.1340999999999997e-05 2023-08-01T19:55:31.144 INFO:teuthology.orchestra.run.smithi008.stdout: }, 2023-08-01T19:55:31.144 INFO:teuthology.orchestra.run.smithi008.stdout: { 2023-08-01T19:55:31.144 INFO:teuthology.orchestra.run.smithi008.stdout: "event": "started", 2023-08-01T19:55:31.144 INFO:teuthology.orchestra.run.smithi008.stdout: "time": "2023-08-01T19:55:31.121286+0000", 2023-08-01T19:55:31.144 INFO:teuthology.orchestra.run.smithi008.stdout: "duration": 2.0282999999999999e-05 2023-08-01T19:55:31.144 INFO:teuthology.orchestra.run.smithi008.stdout: } 2023-08-01T19:55:31.144 INFO:teuthology.orchestra.run.smithi008.stdout: ] 2023-08-01T19:55:31.144 INFO:teuthology.orchestra.run.smithi008.stdout: } 2023-08-01T19:55:31.145 INFO:teuthology.orchestra.run.smithi008.stdout: }, 2023-08-01T19:55:31.145 INFO:teuthology.orchestra.run.smithi008.stdout: { 2023-08-01T19:55:31.145 INFO:teuthology.orchestra.run.smithi008.stdout: "description": "osd_repop(client.4668.0:145538 5.b e48/19 5:d22a3d5d:::benchmark_data_smithi006_114134_object11877:head v 48'9052, mlcod=48'9050)", 2023-08-01T19:55:31.145 INFO:teuthology.orchestra.run.smithi008.stdout: "initiated_at": "2023-08-01T19:55:31.121243+0000", 2023-08-01T19:55:31.145 INFO:teuthology.orchestra.run.smithi008.stdout: "age": 0.0081376769999999994, 2023-08-01T19:55:31.145 INFO:teuthology.orchestra.run.smithi008.stdout: "duration": 0.0082357479999999993, 2023-08-01T19:55:31.145 INFO:teuthology.orchestra.run.smithi008.stdout: "type_data": { 2023-08-01T19:55:31.146 INFO:teuthology.orchestra.run.smithi008.stdout: "flag_point": "started", 2023-08-01T19:55:31.146 INFO:teuthology.orchestra.run.smithi008.stdout: "events": [ 2023-08-01T19:55:31.146 INFO:teuthology.orchestra.run.smithi008.stdout: { 2023-08-01T19:55:31.146 INFO:teuthology.orchestra.run.smithi008.stdout: "event": "initiated", 2023-08-01T19:55:31.146 INFO:teuthology.orchestra.run.smithi008.stdout: "time": "2023-08-01T19:55:31.121243+0000", 2023-08-01T19:55:31.146 INFO:teuthology.orchestra.run.smithi008.stdout: "duration": 0 2023-08-01T19:55:31.146 INFO:teuthology.orchestra.run.smithi008.stdout: }, 2023-08-01T19:55:31.146 INFO:teuthology.orchestra.run.smithi008.stdout: { 2023-08-01T19:55:31.147 INFO:teuthology.orchestra.run.smithi008.stdout: "event": "throttled", 2023-08-01T19:55:31.147 INFO:teuthology.orchestra.run.smithi008.stdout: "time": "2023-08-01T19:55:31.121243+0000", 2023-08-01T19:55:31.147 INFO:teuthology.orchestra.run.smithi008.stdout: "duration": 0 2023-08-01T19:55:31.147 INFO:teuthology.orchestra.run.smithi008.stdout: }, 2023-08-01T19:55:31.147 INFO:teuthology.orchestra.run.smithi008.stdout: { 2023-08-01T19:55:31.147 INFO:teuthology.orchestra.run.smithi008.stdout: "event": "header_read", 2023-08-01T19:55:31.147 INFO:teuthology.orchestra.run.smithi008.stdout: "time": "2023-08-01T19:55:31.121242+0000", 2023-08-01T19:55:31.147 INFO:teuthology.orchestra.run.smithi008.stdout: "duration": 4294967296 2023-08-01T19:55:31.148 INFO:teuthology.orchestra.run.smithi008.stdout: }, 2023-08-01T19:55:31.148 INFO:teuthology.orchestra.run.smithi008.stdout: { 2023-08-01T19:55:31.148 INFO:teuthology.orchestra.run.smithi008.stdout: "event": "all_read", 2023-08-01T19:55:31.148 INFO:teuthology.orchestra.run.smithi008.stdout: "time": "2023-08-01T19:55:31.121246+0000", 2023-08-01T19:55:31.148 INFO:teuthology.orchestra.run.smithi008.stdout: "duration": 3.0400000000000001e-06 2023-08-01T19:55:31.148 INFO:teuthology.orchestra.run.smithi008.stdout: }, 2023-08-01T19:55:31.148 INFO:teuthology.orchestra.run.smithi008.stdout: { 2023-08-01T19:55:31.149 INFO:teuthology.orchestra.run.smithi008.stdout: "event": "dispatched", 2023-08-01T19:55:31.149 INFO:teuthology.orchestra.run.smithi008.stdout: "time": "2023-08-01T19:55:31.121251+0000", 2023-08-01T19:55:31.149 INFO:teuthology.orchestra.run.smithi008.stdout: "duration": 5.4500000000000003e-06 2023-08-01T19:55:31.149 INFO:teuthology.orchestra.run.smithi008.stdout: }, 2023-08-01T19:55:31.149 INFO:teuthology.orchestra.run.smithi008.stdout: { 2023-08-01T19:55:31.149 INFO:teuthology.orchestra.run.smithi008.stdout: "event": "queued_for_pg", 2023-08-01T19:55:31.149 INFO:teuthology.orchestra.run.smithi008.stdout: "time": "2023-08-01T19:55:31.121254+0000", 2023-08-01T19:55:31.149 INFO:teuthology.orchestra.run.smithi008.stdout: "duration": 3.2499999999999998e-06 2023-08-01T19:55:31.150 INFO:teuthology.orchestra.run.smithi008.stdout: }, 2023-08-01T19:55:31.150 INFO:teuthology.orchestra.run.smithi008.stdout: { 2023-08-01T19:55:31.150 INFO:teuthology.orchestra.run.smithi008.stdout: "event": "reached_pg", 2023-08-01T19:55:31.150 INFO:teuthology.orchestra.run.smithi008.stdout: "time": "2023-08-01T19:55:31.121284+0000", 2023-08-01T19:55:31.150 INFO:teuthology.orchestra.run.smithi008.stdout: "duration": 2.9852000000000001e-05 2023-08-01T19:55:31.150 INFO:teuthology.orchestra.run.smithi008.stdout: }, 2023-08-01T19:55:31.150 INFO:teuthology.orchestra.run.smithi008.stdout: { 2023-08-01T19:55:31.150 INFO:teuthology.orchestra.run.smithi008.stdout: "event": "started", 2023-08-01T19:55:31.151 INFO:teuthology.orchestra.run.smithi008.stdout: "time": "2023-08-01T19:55:31.121302+0000", 2023-08-01T19:55:31.151 INFO:teuthology.orchestra.run.smithi008.stdout: "duration": 1.7651000000000001e-05 2023-08-01T19:55:31.151 INFO:teuthology.orchestra.run.smithi008.stdout: } 2023-08-01T19:55:31.151 INFO:teuthology.orchestra.run.smithi008.stdout: ] 2023-08-01T19:55:31.151 INFO:teuthology.orchestra.run.smithi008.stdout: } 2023-08-01T19:55:31.151 INFO:teuthology.orchestra.run.smithi008.stdout: }, 2023-08-01T19:55:31.151 INFO:teuthology.orchestra.run.smithi008.stdout: { 2023-08-01T19:55:31.151 INFO:teuthology.orchestra.run.smithi008.stdout: "description": "osd_repop(client.4668.0:145536 5.0 e48/19 5:053faa14:::benchmark_data_smithi006_114134_object11875:head v 48'9228, mlcod=48'9225)", 2023-08-01T19:55:31.152 INFO:teuthology.orchestra.run.smithi008.stdout: "initiated_at": "2023-08-01T19:55:31.121614+0000", 2023-08-01T19:55:31.152 INFO:teuthology.orchestra.run.smithi008.stdout: "age": 0.0077662110000000003, 2023-08-01T19:55:31.152 INFO:teuthology.orchestra.run.smithi008.stdout: "duration": 0.007899919, 2023-08-01T19:55:31.152 INFO:teuthology.orchestra.run.smithi008.stdout: "type_data": { 2023-08-01T19:55:31.152 INFO:teuthology.orchestra.run.smithi008.stdout: "flag_point": "started", 2023-08-01T19:55:31.152 INFO:teuthology.orchestra.run.smithi008.stdout: "events": [ 2023-08-01T19:55:31.152 INFO:teuthology.orchestra.run.smithi008.stdout: { 2023-08-01T19:55:31.153 INFO:teuthology.orchestra.run.smithi008.stdout: "event": "initiated", 2023-08-01T19:55:31.153 INFO:teuthology.orchestra.run.smithi008.stdout: "time": "2023-08-01T19:55:31.121614+0000", 2023-08-01T19:55:31.153 INFO:teuthology.orchestra.run.smithi008.stdout: "duration": 0 2023-08-01T19:55:31.153 INFO:teuthology.orchestra.run.smithi008.stdout: }, 2023-08-01T19:55:31.153 INFO:teuthology.orchestra.run.smithi008.stdout: { 2023-08-01T19:55:31.153 INFO:teuthology.orchestra.run.smithi008.stdout: "event": "throttled", 2023-08-01T19:55:31.153 INFO:teuthology.orchestra.run.smithi008.stdout: "time": "2023-08-01T19:55:31.121614+0000", 2023-08-01T19:55:31.153 INFO:teuthology.orchestra.run.smithi008.stdout: "duration": 0 2023-08-01T19:55:31.154 INFO:teuthology.orchestra.run.smithi008.stdout: }, 2023-08-01T19:55:31.154 INFO:teuthology.orchestra.run.smithi008.stdout: { 2023-08-01T19:55:31.154 INFO:teuthology.orchestra.run.smithi008.stdout: "event": "header_read", 2023-08-01T19:55:31.154 INFO:teuthology.orchestra.run.smithi008.stdout: "time": "2023-08-01T19:55:31.121614+0000", 2023-08-01T19:55:31.154 INFO:teuthology.orchestra.run.smithi008.stdout: "duration": 4294967295.9999995 2023-08-01T19:55:31.154 INFO:teuthology.orchestra.run.smithi008.stdout: }, 2023-08-01T19:55:31.154 INFO:teuthology.orchestra.run.smithi008.stdout: { 2023-08-01T19:55:31.154 INFO:teuthology.orchestra.run.smithi008.stdout: "event": "all_read", 2023-08-01T19:55:31.155 INFO:teuthology.orchestra.run.smithi008.stdout: "time": "2023-08-01T19:55:31.121618+0000", 2023-08-01T19:55:31.155 INFO:teuthology.orchestra.run.smithi008.stdout: "duration": 4.7119999999999999e-06 2023-08-01T19:55:31.155 INFO:teuthology.orchestra.run.smithi008.stdout: }, 2023-08-01T19:55:31.155 INFO:teuthology.orchestra.run.smithi008.stdout: { 2023-08-01T19:55:31.155 INFO:teuthology.orchestra.run.smithi008.stdout: "event": "dispatched", 2023-08-01T19:55:31.155 INFO:teuthology.orchestra.run.smithi008.stdout: "time": "2023-08-01T19:55:31.121627+0000", 2023-08-01T19:55:31.155 INFO:teuthology.orchestra.run.smithi008.stdout: "duration": 8.2700000000000004e-06 2023-08-01T19:55:31.155 INFO:teuthology.orchestra.run.smithi008.stdout: }, 2023-08-01T19:55:31.156 INFO:teuthology.orchestra.run.smithi008.stdout: { 2023-08-01T19:55:31.156 INFO:teuthology.orchestra.run.smithi008.stdout: "event": "queued_for_pg", 2023-08-01T19:55:31.156 INFO:teuthology.orchestra.run.smithi008.stdout: "time": "2023-08-01T19:55:31.121631+0000", 2023-08-01T19:55:31.156 INFO:teuthology.orchestra.run.smithi008.stdout: "duration": 4.7600000000000002e-06 2023-08-01T19:55:31.156 INFO:teuthology.orchestra.run.smithi008.stdout: }, 2023-08-01T19:55:31.156 INFO:teuthology.orchestra.run.smithi008.stdout: { 2023-08-01T19:55:31.156 INFO:teuthology.orchestra.run.smithi008.stdout: "event": "reached_pg", 2023-08-01T19:55:31.156 INFO:teuthology.orchestra.run.smithi008.stdout: "time": "2023-08-01T19:55:31.123249+0000", 2023-08-01T19:55:31.157 INFO:teuthology.orchestra.run.smithi008.stdout: "duration": 0.001617329 2023-08-01T19:55:31.157 INFO:teuthology.orchestra.run.smithi008.stdout: }, 2023-08-01T19:55:31.157 INFO:teuthology.orchestra.run.smithi008.stdout: { 2023-08-01T19:55:31.157 INFO:teuthology.orchestra.run.smithi008.stdout: "event": "started", 2023-08-01T19:55:31.157 INFO:teuthology.orchestra.run.smithi008.stdout: "time": "2023-08-01T19:55:31.123265+0000", 2023-08-01T19:55:31.157 INFO:teuthology.orchestra.run.smithi008.stdout: "duration": 1.6115000000000001e-05 2023-08-01T19:55:31.157 INFO:teuthology.orchestra.run.smithi008.stdout: } 2023-08-01T19:55:31.157 INFO:teuthology.orchestra.run.smithi008.stdout: ] 2023-08-01T19:55:31.158 INFO:teuthology.orchestra.run.smithi008.stdout: } 2023-08-01T19:55:31.158 INFO:teuthology.orchestra.run.smithi008.stdout: }, 2023-08-01T19:55:31.158 INFO:teuthology.orchestra.run.smithi008.stdout: { 2023-08-01T19:55:31.158 INFO:teuthology.orchestra.run.smithi008.stdout: "description": "osd_op(client.4668.0:145540 5.2 5:46ee72fe:::benchmark_data_smithi006_114134_object11879:head [delete] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e48)", 2023-08-01T19:55:31.158 INFO:teuthology.orchestra.run.smithi008.stdout: "initiated_at": "2023-08-01T19:55:31.123476+0000", 2023-08-01T19:55:31.158 INFO:teuthology.orchestra.run.smithi008.stdout: "age": 0.0059041959999999996, 2023-08-01T19:55:31.159 INFO:teuthology.orchestra.run.smithi008.stdout: "duration": 0.0060775940000000004, 2023-08-01T19:55:31.159 INFO:teuthology.orchestra.run.smithi008.stdout: "type_data": { 2023-08-01T19:55:31.159 INFO:teuthology.orchestra.run.smithi008.stdout: "flag_point": "waiting for sub ops", 2023-08-01T19:55:31.159 INFO:teuthology.orchestra.run.smithi008.stdout: "client_info": { 2023-08-01T19:55:31.159 INFO:teuthology.orchestra.run.smithi008.stdout: "client": "client.4668", 2023-08-01T19:55:31.159 INFO:teuthology.orchestra.run.smithi008.stdout: "client_addr": "172.21.15.6:0/1709472247", 2023-08-01T19:55:31.160 INFO:teuthology.orchestra.run.smithi008.stdout: "tid": 145540 2023-08-01T19:55:31.160 INFO:teuthology.orchestra.run.smithi008.stdout: }, 2023-08-01T19:55:31.160 INFO:teuthology.orchestra.run.smithi008.stdout: "events": [ 2023-08-01T19:55:31.160 INFO:teuthology.orchestra.run.smithi008.stdout: { 2023-08-01T19:55:31.160 INFO:teuthology.orchestra.run.smithi008.stdout: "event": "initiated", 2023-08-01T19:55:31.160 INFO:teuthology.orchestra.run.smithi008.stdout: "time": "2023-08-01T19:55:31.123476+0000", 2023-08-01T19:55:31.160 INFO:teuthology.orchestra.run.smithi008.stdout: "duration": 0 2023-08-01T19:55:31.161 INFO:teuthology.orchestra.run.smithi008.stdout: }, 2023-08-01T19:55:31.161 INFO:teuthology.orchestra.run.smithi008.stdout: { 2023-08-01T19:55:31.161 INFO:teuthology.orchestra.run.smithi008.stdout: "event": "throttled", 2023-08-01T19:55:31.161 INFO:teuthology.orchestra.run.smithi008.stdout: "time": "2023-08-01T19:55:31.123476+0000", 2023-08-01T19:55:31.161 INFO:teuthology.orchestra.run.smithi008.stdout: "duration": 0 2023-08-01T19:55:31.161 INFO:teuthology.orchestra.run.smithi008.stdout: }, 2023-08-01T19:55:31.161 INFO:teuthology.orchestra.run.smithi008.stdout: { 2023-08-01T19:55:31.161 INFO:teuthology.orchestra.run.smithi008.stdout: "event": "header_read", 2023-08-01T19:55:31.162 INFO:teuthology.orchestra.run.smithi008.stdout: "time": "2023-08-01T19:55:31.123475+0000", 2023-08-01T19:55:31.162 INFO:teuthology.orchestra.run.smithi008.stdout: "duration": 4294967295.999999 2023-08-01T19:55:31.162 INFO:teuthology.orchestra.run.smithi008.stdout: }, 2023-08-01T19:55:31.162 INFO:teuthology.orchestra.run.smithi008.stdout: { 2023-08-01T19:55:31.162 INFO:teuthology.orchestra.run.smithi008.stdout: "event": "all_read", 2023-08-01T19:55:31.162 INFO:teuthology.orchestra.run.smithi008.stdout: "time": "2023-08-01T19:55:31.123480+0000", 2023-08-01T19:55:31.162 INFO:teuthology.orchestra.run.smithi008.stdout: "duration": 5.3090000000000003e-06 2023-08-01T19:55:31.162 INFO:teuthology.orchestra.run.smithi008.stdout: }, 2023-08-01T19:55:31.163 INFO:teuthology.orchestra.run.smithi008.stdout: { 2023-08-01T19:55:31.163 INFO:teuthology.orchestra.run.smithi008.stdout: "event": "dispatched", 2023-08-01T19:55:31.163 INFO:teuthology.orchestra.run.smithi008.stdout: "time": "2023-08-01T19:55:31.123499+0000", 2023-08-01T19:55:31.163 INFO:teuthology.orchestra.run.smithi008.stdout: "duration": 1.8440999999999998e-05 2023-08-01T19:55:31.163 INFO:teuthology.orchestra.run.smithi008.stdout: }, 2023-08-01T19:55:31.163 INFO:teuthology.orchestra.run.smithi008.stdout: { 2023-08-01T19:55:31.163 INFO:teuthology.orchestra.run.smithi008.stdout: "event": "queued_for_pg", 2023-08-01T19:55:31.163 INFO:teuthology.orchestra.run.smithi008.stdout: "time": "2023-08-01T19:55:31.123505+0000", 2023-08-01T19:55:31.164 INFO:teuthology.orchestra.run.smithi008.stdout: "duration": 6.0390000000000001e-06 2023-08-01T19:55:31.164 INFO:teuthology.orchestra.run.smithi008.stdout: }, 2023-08-01T19:55:31.164 INFO:teuthology.orchestra.run.smithi008.stdout: { 2023-08-01T19:55:31.164 INFO:teuthology.orchestra.run.smithi008.stdout: "event": "reached_pg", 2023-08-01T19:55:31.164 INFO:teuthology.orchestra.run.smithi008.stdout: "time": "2023-08-01T19:55:31.123554+0000", 2023-08-01T19:55:31.164 INFO:teuthology.orchestra.run.smithi008.stdout: "duration": 4.8983999999999997e-05 2023-08-01T19:55:31.164 INFO:teuthology.orchestra.run.smithi008.stdout: }, 2023-08-01T19:55:31.164 INFO:teuthology.orchestra.run.smithi008.stdout: { 2023-08-01T19:55:31.165 INFO:teuthology.orchestra.run.smithi008.stdout: "event": "started", 2023-08-01T19:55:31.165 INFO:teuthology.orchestra.run.smithi008.stdout: "time": "2023-08-01T19:55:31.123692+0000", 2023-08-01T19:55:31.165 INFO:teuthology.orchestra.run.smithi008.stdout: "duration": 0.00013822500000000001 2023-08-01T19:55:31.165 INFO:teuthology.orchestra.run.smithi008.stdout: }, 2023-08-01T19:55:31.165 INFO:teuthology.orchestra.run.smithi008.stdout: { 2023-08-01T19:55:31.165 INFO:teuthology.orchestra.run.smithi008.stdout: "event": "waiting for subops from 1", 2023-08-01T19:55:31.165 INFO:teuthology.orchestra.run.smithi008.stdout: "time": "2023-08-01T19:55:31.123819+0000", 2023-08-01T19:55:31.165 INFO:teuthology.orchestra.run.smithi008.stdout: "duration": 0.00012669600000000001 2023-08-01T19:55:31.166 INFO:teuthology.orchestra.run.smithi008.stdout: } 2023-08-01T19:55:31.166 INFO:teuthology.orchestra.run.smithi008.stdout: ] 2023-08-01T19:55:31.166 INFO:teuthology.orchestra.run.smithi008.stdout: } 2023-08-01T19:55:31.166 INFO:teuthology.orchestra.run.smithi008.stdout: }, 2023-08-01T19:55:31.166 INFO:teuthology.orchestra.run.smithi008.stdout: { 2023-08-01T19:55:31.166 INFO:teuthology.orchestra.run.smithi008.stdout: "description": "osd_op(client.4668.0:145541 5.6 5:66b5dce9:::benchmark_data_smithi006_114134_object11880:head [delete] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e48)", 2023-08-01T19:55:31.166 INFO:teuthology.orchestra.run.smithi008.stdout: "initiated_at": "2023-08-01T19:55:31.123516+0000", 2023-08-01T19:55:31.167 INFO:teuthology.orchestra.run.smithi008.stdout: "age": 0.0058646870000000004, 2023-08-01T19:55:31.167 INFO:teuthology.orchestra.run.smithi008.stdout: "duration": 0.0060839420000000002, 2023-08-01T19:55:31.167 INFO:teuthology.orchestra.run.smithi008.stdout: "type_data": { 2023-08-01T19:55:31.167 INFO:teuthology.orchestra.run.smithi008.stdout: "flag_point": "waiting for sub ops", 2023-08-01T19:55:31.167 INFO:teuthology.orchestra.run.smithi008.stdout: "client_info": { 2023-08-01T19:55:31.167 INFO:teuthology.orchestra.run.smithi008.stdout: "client": "client.4668", 2023-08-01T19:55:31.167 INFO:teuthology.orchestra.run.smithi008.stdout: "client_addr": "172.21.15.6:0/1709472247", 2023-08-01T19:55:31.167 INFO:teuthology.orchestra.run.smithi008.stdout: "tid": 145541 2023-08-01T19:55:31.168 INFO:teuthology.orchestra.run.smithi008.stdout: }, 2023-08-01T19:55:31.168 INFO:teuthology.orchestra.run.smithi008.stdout: "events": [ 2023-08-01T19:55:31.168 INFO:teuthology.orchestra.run.smithi008.stdout: { 2023-08-01T19:55:31.168 INFO:teuthology.orchestra.run.smithi008.stdout: "event": "initiated", 2023-08-01T19:55:31.168 INFO:teuthology.orchestra.run.smithi008.stdout: "time": "2023-08-01T19:55:31.123516+0000", 2023-08-01T19:55:31.168 INFO:teuthology.orchestra.run.smithi008.stdout: "duration": 0 2023-08-01T19:55:31.168 INFO:teuthology.orchestra.run.smithi008.stdout: }, 2023-08-01T19:55:31.168 INFO:teuthology.orchestra.run.smithi008.stdout: { 2023-08-01T19:55:31.169 INFO:teuthology.orchestra.run.smithi008.stdout: "event": "throttled", 2023-08-01T19:55:31.169 INFO:teuthology.orchestra.run.smithi008.stdout: "time": "2023-08-01T19:55:31.123516+0000", 2023-08-01T19:55:31.169 INFO:teuthology.orchestra.run.smithi008.stdout: "duration": 0 2023-08-01T19:55:31.169 INFO:teuthology.orchestra.run.smithi008.stdout: }, 2023-08-01T19:55:31.169 INFO:teuthology.orchestra.run.smithi008.stdout: { 2023-08-01T19:55:31.169 INFO:teuthology.orchestra.run.smithi008.stdout: "event": "header_read", 2023-08-01T19:55:31.169 INFO:teuthology.orchestra.run.smithi008.stdout: "time": "2023-08-01T19:55:31.123515+0000", 2023-08-01T19:55:31.169 INFO:teuthology.orchestra.run.smithi008.stdout: "duration": 4294967295.9999995 2023-08-01T19:55:31.170 INFO:teuthology.orchestra.run.smithi008.stdout: }, 2023-08-01T19:55:31.170 INFO:teuthology.orchestra.run.smithi008.stdout: { 2023-08-01T19:55:31.170 INFO:teuthology.orchestra.run.smithi008.stdout: "event": "all_read", 2023-08-01T19:55:31.170 INFO:teuthology.orchestra.run.smithi008.stdout: "time": "2023-08-01T19:55:31.123518+0000", 2023-08-01T19:55:31.170 INFO:teuthology.orchestra.run.smithi008.stdout: "duration": 2.7209999999999999e-06 2023-08-01T19:55:31.170 INFO:teuthology.orchestra.run.smithi008.stdout: }, 2023-08-01T19:55:31.170 INFO:teuthology.orchestra.run.smithi008.stdout: { 2023-08-01T19:55:31.170 INFO:teuthology.orchestra.run.smithi008.stdout: "event": "dispatched", 2023-08-01T19:55:31.171 INFO:teuthology.orchestra.run.smithi008.stdout: "time": "2023-08-01T19:55:31.123524+0000", 2023-08-01T19:55:31.171 INFO:teuthology.orchestra.run.smithi008.stdout: "duration": 6.0850000000000002e-06 2023-08-01T19:55:31.171 INFO:teuthology.orchestra.run.smithi008.stdout: }, 2023-08-01T19:55:31.171 INFO:teuthology.orchestra.run.smithi008.stdout: { 2023-08-01T19:55:31.171 INFO:teuthology.orchestra.run.smithi008.stdout: "event": "queued_for_pg", 2023-08-01T19:55:31.171 INFO:teuthology.orchestra.run.smithi008.stdout: "time": "2023-08-01T19:55:31.123528+0000", 2023-08-01T19:55:31.171 INFO:teuthology.orchestra.run.smithi008.stdout: "duration": 4.126e-06 2023-08-01T19:55:31.171 INFO:teuthology.orchestra.run.smithi008.stdout: }, 2023-08-01T19:55:31.172 INFO:teuthology.orchestra.run.smithi008.stdout: { 2023-08-01T19:55:31.172 INFO:teuthology.orchestra.run.smithi008.stdout: "event": "reached_pg", 2023-08-01T19:55:31.172 INFO:teuthology.orchestra.run.smithi008.stdout: "time": "2023-08-01T19:55:31.123567+0000", 2023-08-01T19:55:31.172 INFO:teuthology.orchestra.run.smithi008.stdout: "duration": 3.8597999999999999e-05 2023-08-01T19:55:31.172 INFO:teuthology.orchestra.run.smithi008.stdout: }, 2023-08-01T19:55:31.172 INFO:teuthology.orchestra.run.smithi008.stdout: { 2023-08-01T19:55:31.172 INFO:teuthology.orchestra.run.smithi008.stdout: "event": "started", 2023-08-01T19:55:31.172 INFO:teuthology.orchestra.run.smithi008.stdout: "time": "2023-08-01T19:55:31.123708+0000", 2023-08-01T19:55:31.173 INFO:teuthology.orchestra.run.smithi008.stdout: "duration": 0.00014119299999999999 2023-08-01T19:55:31.173 INFO:teuthology.orchestra.run.smithi008.stdout: }, 2023-08-01T19:55:31.173 INFO:teuthology.orchestra.run.smithi008.stdout: { 2023-08-01T19:55:31.173 INFO:teuthology.orchestra.run.smithi008.stdout: "event": "waiting for subops from 1", 2023-08-01T19:55:31.173 INFO:teuthology.orchestra.run.smithi008.stdout: "time": "2023-08-01T19:55:31.123825+0000", 2023-08-01T19:55:31.173 INFO:teuthology.orchestra.run.smithi008.stdout: "duration": 0.000117248 2023-08-01T19:55:31.173 INFO:teuthology.orchestra.run.smithi008.stdout: } 2023-08-01T19:55:31.173 INFO:teuthology.orchestra.run.smithi008.stdout: ] 2023-08-01T19:55:31.174 INFO:teuthology.orchestra.run.smithi008.stdout: } 2023-08-01T19:55:31.174 INFO:teuthology.orchestra.run.smithi008.stdout: }, 2023-08-01T19:55:31.174 INFO:teuthology.orchestra.run.smithi008.stdout: { 2023-08-01T19:55:31.174 INFO:teuthology.orchestra.run.smithi008.stdout: "description": "osd_op(client.4668.0:145542 5.1 5:82546581:::benchmark_data_smithi006_114134_object11881:head [delete] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e48)", 2023-08-01T19:55:31.174 INFO:teuthology.orchestra.run.smithi008.stdout: "initiated_at": "2023-08-01T19:55:31.123537+0000", 2023-08-01T19:55:31.174 INFO:teuthology.orchestra.run.smithi008.stdout: "age": 0.0058432930000000003, 2023-08-01T19:55:31.174 INFO:teuthology.orchestra.run.smithi008.stdout: "duration": 0.0061040089999999997, 2023-08-01T19:55:31.175 INFO:teuthology.orchestra.run.smithi008.stdout: "type_data": { 2023-08-01T19:55:31.175 INFO:teuthology.orchestra.run.smithi008.stdout: "flag_point": "waiting for sub ops", 2023-08-01T19:55:31.175 INFO:teuthology.orchestra.run.smithi008.stdout: "client_info": { 2023-08-01T19:55:31.175 INFO:teuthology.orchestra.run.smithi008.stdout: "client": "client.4668", 2023-08-01T19:55:31.175 INFO:teuthology.orchestra.run.smithi008.stdout: "client_addr": "172.21.15.6:0/1709472247", 2023-08-01T19:55:31.175 INFO:teuthology.orchestra.run.smithi008.stdout: "tid": 145542 2023-08-01T19:55:31.175 INFO:teuthology.orchestra.run.smithi008.stdout: }, 2023-08-01T19:55:31.175 INFO:teuthology.orchestra.run.smithi008.stdout: "events": [ 2023-08-01T19:55:31.176 INFO:teuthology.orchestra.run.smithi008.stdout: { 2023-08-01T19:55:31.176 INFO:teuthology.orchestra.run.smithi008.stdout: "event": "initiated", 2023-08-01T19:55:31.176 INFO:teuthology.orchestra.run.smithi008.stdout: "time": "2023-08-01T19:55:31.123537+0000", 2023-08-01T19:55:31.176 INFO:teuthology.orchestra.run.smithi008.stdout: "duration": 0 2023-08-01T19:55:31.176 INFO:teuthology.orchestra.run.smithi008.stdout: }, 2023-08-01T19:55:31.176 INFO:teuthology.orchestra.run.smithi008.stdout: { 2023-08-01T19:55:31.176 INFO:teuthology.orchestra.run.smithi008.stdout: "event": "throttled", 2023-08-01T19:55:31.176 INFO:teuthology.orchestra.run.smithi008.stdout: "time": "2023-08-01T19:55:31.123537+0000", 2023-08-01T19:55:31.177 INFO:teuthology.orchestra.run.smithi008.stdout: "duration": 0 2023-08-01T19:55:31.177 INFO:teuthology.orchestra.run.smithi008.stdout: }, 2023-08-01T19:55:31.177 INFO:teuthology.orchestra.run.smithi008.stdout: { 2023-08-01T19:55:31.177 INFO:teuthology.orchestra.run.smithi008.stdout: "event": "header_read", 2023-08-01T19:55:31.177 INFO:teuthology.orchestra.run.smithi008.stdout: "time": "2023-08-01T19:55:31.123537+0000", 2023-08-01T19:55:31.177 INFO:teuthology.orchestra.run.smithi008.stdout: "duration": 4294967295.9999995 2023-08-01T19:55:31.177 INFO:teuthology.orchestra.run.smithi008.stdout: }, 2023-08-01T19:55:31.177 INFO:teuthology.orchestra.run.smithi008.stdout: { 2023-08-01T19:55:31.178 INFO:teuthology.orchestra.run.smithi008.stdout: "event": "all_read", 2023-08-01T19:55:31.178 INFO:teuthology.orchestra.run.smithi008.stdout: "time": "2023-08-01T19:55:31.123539+0000", 2023-08-01T19:55:31.178 INFO:teuthology.orchestra.run.smithi008.stdout: "duration": 2.0959999999999999e-06 2023-08-01T19:55:31.178 INFO:teuthology.orchestra.run.smithi008.stdout: }, 2023-08-01T19:55:31.178 INFO:teuthology.orchestra.run.smithi008.stdout: { 2023-08-01T19:55:31.178 INFO:teuthology.orchestra.run.smithi008.stdout: "event": "dispatched", 2023-08-01T19:55:31.178 INFO:teuthology.orchestra.run.smithi008.stdout: "time": "2023-08-01T19:55:31.123544+0000", 2023-08-01T19:55:31.178 INFO:teuthology.orchestra.run.smithi008.stdout: "duration": 5.5060000000000003e-06 2023-08-01T19:55:31.179 INFO:teuthology.orchestra.run.smithi008.stdout: }, 2023-08-01T19:55:31.179 INFO:teuthology.orchestra.run.smithi008.stdout: { 2023-08-01T19:55:31.179 INFO:teuthology.orchestra.run.smithi008.stdout: "event": "queued_for_pg", 2023-08-01T19:55:31.179 INFO:teuthology.orchestra.run.smithi008.stdout: "time": "2023-08-01T19:55:31.123548+0000", 2023-08-01T19:55:31.179 INFO:teuthology.orchestra.run.smithi008.stdout: "duration": 3.5810000000000001e-06 2023-08-01T19:55:31.179 INFO:teuthology.orchestra.run.smithi008.stdout: }, 2023-08-01T19:55:31.179 INFO:teuthology.orchestra.run.smithi008.stdout: { 2023-08-01T19:55:31.179 INFO:teuthology.orchestra.run.smithi008.stdout: "event": "reached_pg", 2023-08-01T19:55:31.180 INFO:teuthology.orchestra.run.smithi008.stdout: "time": "2023-08-01T19:55:31.123583+0000", 2023-08-01T19:55:31.180 INFO:teuthology.orchestra.run.smithi008.stdout: "duration": 3.4832999999999997e-05 2023-08-01T19:55:31.180 INFO:teuthology.orchestra.run.smithi008.stdout: }, 2023-08-01T19:55:31.180 INFO:teuthology.orchestra.run.smithi008.stdout: { 2023-08-01T19:55:31.180 INFO:teuthology.orchestra.run.smithi008.stdout: "event": "started", 2023-08-01T19:55:31.180 INFO:teuthology.orchestra.run.smithi008.stdout: "time": "2023-08-01T19:55:31.123709+0000", 2023-08-01T19:55:31.180 INFO:teuthology.orchestra.run.smithi008.stdout: "duration": 0.000125969 2023-08-01T19:55:31.181 INFO:teuthology.orchestra.run.smithi008.stdout: }, 2023-08-01T19:55:31.181 INFO:teuthology.orchestra.run.smithi008.stdout: { 2023-08-01T19:55:31.181 INFO:teuthology.orchestra.run.smithi008.stdout: "event": "waiting for subops from 1", 2023-08-01T19:55:31.181 INFO:teuthology.orchestra.run.smithi008.stdout: "time": "2023-08-01T19:55:31.123822+0000", 2023-08-01T19:55:31.181 INFO:teuthology.orchestra.run.smithi008.stdout: "duration": 0.00011280700000000001 2023-08-01T19:55:31.181 INFO:teuthology.orchestra.run.smithi008.stdout: } 2023-08-01T19:55:31.181 INFO:teuthology.orchestra.run.smithi008.stdout: ] 2023-08-01T19:55:31.182 INFO:teuthology.orchestra.run.smithi008.stdout: } 2023-08-01T19:55:31.182 INFO:teuthology.orchestra.run.smithi008.stdout: }, 2023-08-01T19:55:31.182 INFO:teuthology.orchestra.run.smithi008.stdout: { 2023-08-01T19:55:31.182 INFO:teuthology.orchestra.run.smithi008.stdout: "description": "osd_op(client.4668.0:145543 5.c 5:37538ed1:::benchmark_data_smithi006_114134_object11882:head [delete] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e48)", 2023-08-01T19:55:31.182 INFO:teuthology.orchestra.run.smithi008.stdout: "initiated_at": "2023-08-01T19:55:31.123619+0000", 2023-08-01T19:55:31.183 INFO:teuthology.orchestra.run.smithi008.stdout: "age": 0.0057617620000000001, 2023-08-01T19:55:31.183 INFO:teuthology.orchestra.run.smithi008.stdout: "duration": 0.0060724689999999996, 2023-08-01T19:55:31.183 INFO:teuthology.orchestra.run.smithi008.stdout: "type_data": { 2023-08-01T19:55:31.183 INFO:teuthology.orchestra.run.smithi008.stdout: "flag_point": "waiting for sub ops", 2023-08-01T19:55:31.183 INFO:teuthology.orchestra.run.smithi008.stdout: "client_info": { 2023-08-01T19:55:31.183 INFO:teuthology.orchestra.run.smithi008.stdout: "client": "client.4668", 2023-08-01T19:55:31.183 INFO:teuthology.orchestra.run.smithi008.stdout: "client_addr": "172.21.15.6:0/1709472247", 2023-08-01T19:55:31.184 INFO:teuthology.orchestra.run.smithi008.stdout: "tid": 145543 2023-08-01T19:55:31.184 INFO:teuthology.orchestra.run.smithi008.stdout: }, 2023-08-01T19:55:31.184 INFO:teuthology.orchestra.run.smithi008.stdout: "events": [ 2023-08-01T19:55:31.184 INFO:teuthology.orchestra.run.smithi008.stdout: { 2023-08-01T19:55:31.184 INFO:teuthology.orchestra.run.smithi008.stdout: "event": "initiated", 2023-08-01T19:55:31.184 INFO:teuthology.orchestra.run.smithi008.stdout: "time": "2023-08-01T19:55:31.123619+0000", 2023-08-01T19:55:31.185 INFO:teuthology.orchestra.run.smithi008.stdout: "duration": 0 2023-08-01T19:55:31.185 INFO:teuthology.orchestra.run.smithi008.stdout: }, 2023-08-01T19:55:31.185 INFO:teuthology.orchestra.run.smithi008.stdout: { 2023-08-01T19:55:31.186 INFO:teuthology.orchestra.run.smithi008.stdout: "event": "throttled", 2023-08-01T19:55:31.186 INFO:teuthology.orchestra.run.smithi008.stdout: "time": "2023-08-01T19:55:31.123619+0000", 2023-08-01T19:55:31.186 INFO:teuthology.orchestra.run.smithi008.stdout: "duration": 0 2023-08-01T19:55:31.186 INFO:teuthology.orchestra.run.smithi008.stdout: }, 2023-08-01T19:55:31.187 INFO:teuthology.orchestra.run.smithi008.stdout: { 2023-08-01T19:55:31.187 INFO:teuthology.orchestra.run.smithi008.stdout: "event": "header_read", 2023-08-01T19:55:31.187 INFO:teuthology.orchestra.run.smithi008.stdout: "time": "2023-08-01T19:55:31.123618+0000", 2023-08-01T19:55:31.187 INFO:teuthology.orchestra.run.smithi008.stdout: "duration": 4294967295.9999995 2023-08-01T19:55:31.187 INFO:teuthology.orchestra.run.smithi008.stdout: }, 2023-08-01T19:55:31.187 INFO:teuthology.orchestra.run.smithi008.stdout: { 2023-08-01T19:55:31.188 INFO:teuthology.orchestra.run.smithi008.stdout: "event": "all_read", 2023-08-01T19:55:31.188 INFO:teuthology.orchestra.run.smithi008.stdout: "time": "2023-08-01T19:55:31.123621+0000", 2023-08-01T19:55:31.188 INFO:teuthology.orchestra.run.smithi008.stdout: "duration": 3.2959999999999999e-06 2023-08-01T19:55:31.188 INFO:teuthology.orchestra.run.smithi008.stdout: }, 2023-08-01T19:55:31.188 INFO:teuthology.orchestra.run.smithi008.stdout: { 2023-08-01T19:55:31.189 INFO:teuthology.orchestra.run.smithi008.stdout: "event": "dispatched", 2023-08-01T19:55:31.189 INFO:teuthology.orchestra.run.smithi008.stdout: "time": "2023-08-01T19:55:31.123629+0000", 2023-08-01T19:55:31.189 INFO:teuthology.orchestra.run.smithi008.stdout: "duration": 7.4059999999999999e-06 2023-08-01T19:55:31.189 INFO:teuthology.orchestra.run.smithi008.stdout: }, 2023-08-01T19:55:31.189 INFO:teuthology.orchestra.run.smithi008.stdout: { 2023-08-01T19:55:31.189 INFO:teuthology.orchestra.run.smithi008.stdout: "event": "queued_for_pg", 2023-08-01T19:55:31.189 INFO:teuthology.orchestra.run.smithi008.stdout: "time": "2023-08-01T19:55:31.123633+0000", 2023-08-01T19:55:31.189 INFO:teuthology.orchestra.run.smithi008.stdout: "duration": 4.4259999999999996e-06 2023-08-01T19:55:31.190 INFO:teuthology.orchestra.run.smithi008.stdout: }, 2023-08-01T19:55:31.190 INFO:teuthology.orchestra.run.smithi008.stdout: { 2023-08-01T19:55:31.190 INFO:teuthology.orchestra.run.smithi008.stdout: "event": "reached_pg", 2023-08-01T19:55:31.190 INFO:teuthology.orchestra.run.smithi008.stdout: "time": "2023-08-01T19:55:31.123874+0000", 2023-08-01T19:55:31.190 INFO:teuthology.orchestra.run.smithi008.stdout: "duration": 0.000240972 2023-08-01T19:55:31.190 INFO:teuthology.orchestra.run.smithi008.stdout: }, 2023-08-01T19:55:31.190 INFO:teuthology.orchestra.run.smithi008.stdout: { 2023-08-01T19:55:31.190 INFO:teuthology.orchestra.run.smithi008.stdout: "event": "started", 2023-08-01T19:55:31.191 INFO:teuthology.orchestra.run.smithi008.stdout: "time": "2023-08-01T19:55:31.123985+0000", 2023-08-01T19:55:31.191 INFO:teuthology.orchestra.run.smithi008.stdout: "duration": 0.000110925 2023-08-01T19:55:31.191 INFO:teuthology.orchestra.run.smithi008.stdout: }, 2023-08-01T19:55:31.191 INFO:teuthology.orchestra.run.smithi008.stdout: { 2023-08-01T19:55:31.191 INFO:teuthology.orchestra.run.smithi008.stdout: "event": "waiting for subops from 1", 2023-08-01T19:55:31.191 INFO:teuthology.orchestra.run.smithi008.stdout: "time": "2023-08-01T19:55:31.125414+0000", 2023-08-01T19:55:31.191 INFO:teuthology.orchestra.run.smithi008.stdout: "duration": 0.0014288339999999999 2023-08-01T19:55:31.192 INFO:teuthology.orchestra.run.smithi008.stdout: } 2023-08-01T19:55:31.192 INFO:teuthology.orchestra.run.smithi008.stdout: ] 2023-08-01T19:55:31.192 INFO:teuthology.orchestra.run.smithi008.stdout: } 2023-08-01T19:55:31.192 INFO:teuthology.orchestra.run.smithi008.stdout: }, 2023-08-01T19:55:31.192 INFO:teuthology.orchestra.run.smithi008.stdout: { 2023-08-01T19:55:31.192 INFO:teuthology.orchestra.run.smithi008.stdout: "description": "osd_op(client.4668.0:145544 5.a 5:5108d92a:::benchmark_data_smithi006_114134_object11883:head [delete] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e48)", 2023-08-01T19:55:31.193 INFO:teuthology.orchestra.run.smithi008.stdout: "initiated_at": "2023-08-01T19:55:31.124699+0000", 2023-08-01T19:55:31.193 INFO:teuthology.orchestra.run.smithi008.stdout: "age": 0.0046812370000000004, 2023-08-01T19:55:31.193 INFO:teuthology.orchestra.run.smithi008.stdout: "duration": 0.005052483, 2023-08-01T19:55:31.193 INFO:teuthology.orchestra.run.smithi008.stdout: "type_data": { 2023-08-01T19:55:31.193 INFO:teuthology.orchestra.run.smithi008.stdout: "flag_point": "waiting for sub ops", 2023-08-01T19:55:31.193 INFO:teuthology.orchestra.run.smithi008.stdout: "client_info": { 2023-08-01T19:55:31.194 INFO:teuthology.orchestra.run.smithi008.stdout: "client": "client.4668", 2023-08-01T19:55:31.194 INFO:teuthology.orchestra.run.smithi008.stdout: "client_addr": "172.21.15.6:0/1709472247", 2023-08-01T19:55:31.194 INFO:teuthology.orchestra.run.smithi008.stdout: "tid": 145544 2023-08-01T19:55:31.194 INFO:teuthology.orchestra.run.smithi008.stdout: }, 2023-08-01T19:55:31.194 INFO:teuthology.orchestra.run.smithi008.stdout: "events": [ 2023-08-01T19:55:31.194 INFO:teuthology.orchestra.run.smithi008.stdout: { 2023-08-01T19:55:31.194 INFO:teuthology.orchestra.run.smithi008.stdout: "event": "initiated", 2023-08-01T19:55:31.194 INFO:teuthology.orchestra.run.smithi008.stdout: "time": "2023-08-01T19:55:31.124699+0000", 2023-08-01T19:55:31.195 INFO:teuthology.orchestra.run.smithi008.stdout: "duration": 0 2023-08-01T19:55:31.195 INFO:teuthology.orchestra.run.smithi008.stdout: }, 2023-08-01T19:55:31.195 INFO:teuthology.orchestra.run.smithi008.stdout: { 2023-08-01T19:55:31.195 INFO:teuthology.orchestra.run.smithi008.stdout: "event": "throttled", 2023-08-01T19:55:31.195 INFO:teuthology.orchestra.run.smithi008.stdout: "time": "2023-08-01T19:55:31.124699+0000", 2023-08-01T19:55:31.195 INFO:teuthology.orchestra.run.smithi008.stdout: "duration": 0 2023-08-01T19:55:31.195 INFO:teuthology.orchestra.run.smithi008.stdout: }, 2023-08-01T19:55:31.195 INFO:teuthology.orchestra.run.smithi008.stdout: { 2023-08-01T19:55:31.196 INFO:teuthology.orchestra.run.smithi008.stdout: "event": "header_read", 2023-08-01T19:55:31.196 INFO:teuthology.orchestra.run.smithi008.stdout: "time": "2023-08-01T19:55:31.124698+0000", 2023-08-01T19:55:31.196 INFO:teuthology.orchestra.run.smithi008.stdout: "duration": 4294967295.9999995 2023-08-01T19:55:31.196 INFO:teuthology.orchestra.run.smithi008.stdout: }, 2023-08-01T19:55:31.196 INFO:teuthology.orchestra.run.smithi008.stdout: { 2023-08-01T19:55:31.196 INFO:teuthology.orchestra.run.smithi008.stdout: "event": "all_read", 2023-08-01T19:55:31.196 INFO:teuthology.orchestra.run.smithi008.stdout: "time": "2023-08-01T19:55:31.124703+0000", 2023-08-01T19:55:31.197 INFO:teuthology.orchestra.run.smithi008.stdout: "duration": 4.0419999999999996e-06 2023-08-01T19:55:31.197 INFO:teuthology.orchestra.run.smithi008.stdout: }, 2023-08-01T19:55:31.197 INFO:teuthology.orchestra.run.smithi008.stdout: { 2023-08-01T19:55:31.197 INFO:teuthology.orchestra.run.smithi008.stdout: "event": "dispatched", 2023-08-01T19:55:31.197 INFO:teuthology.orchestra.run.smithi008.stdout: "time": "2023-08-01T19:55:31.124711+0000", 2023-08-01T19:55:31.197 INFO:teuthology.orchestra.run.smithi008.stdout: "duration": 8.918e-06 2023-08-01T19:55:31.197 INFO:teuthology.orchestra.run.smithi008.stdout: }, 2023-08-01T19:55:31.197 INFO:teuthology.orchestra.run.smithi008.stdout: { 2023-08-01T19:55:31.198 INFO:teuthology.orchestra.run.smithi008.stdout: "event": "queued_for_pg", 2023-08-01T19:55:31.198 INFO:teuthology.orchestra.run.smithi008.stdout: "time": "2023-08-01T19:55:31.124715+0000", 2023-08-01T19:55:31.198 INFO:teuthology.orchestra.run.smithi008.stdout: "duration": 3.9920000000000001e-06 2023-08-01T19:55:31.198 INFO:teuthology.orchestra.run.smithi008.stdout: }, 2023-08-01T19:55:31.198 INFO:teuthology.orchestra.run.smithi008.stdout: { 2023-08-01T19:55:31.198 INFO:teuthology.orchestra.run.smithi008.stdout: "event": "reached_pg", 2023-08-01T19:55:31.198 INFO:teuthology.orchestra.run.smithi008.stdout: "time": "2023-08-01T19:55:31.124744+0000", 2023-08-01T19:55:31.199 INFO:teuthology.orchestra.run.smithi008.stdout: "duration": 2.8493e-05 2023-08-01T19:55:31.199 INFO:teuthology.orchestra.run.smithi008.stdout: }, 2023-08-01T19:55:31.199 INFO:teuthology.orchestra.run.smithi008.stdout: { 2023-08-01T19:55:31.199 INFO:teuthology.orchestra.run.smithi008.stdout: "event": "started", 2023-08-01T19:55:31.199 INFO:teuthology.orchestra.run.smithi008.stdout: "time": "2023-08-01T19:55:31.124818+0000", 2023-08-01T19:55:31.199 INFO:teuthology.orchestra.run.smithi008.stdout: "duration": 7.4072000000000005e-05 2023-08-01T19:55:31.199 INFO:teuthology.orchestra.run.smithi008.stdout: }, 2023-08-01T19:55:31.199 INFO:teuthology.orchestra.run.smithi008.stdout: { 2023-08-01T19:55:31.200 INFO:teuthology.orchestra.run.smithi008.stdout: "event": "waiting for subops from 2", 2023-08-01T19:55:31.200 INFO:teuthology.orchestra.run.smithi008.stdout: "time": "2023-08-01T19:55:31.124878+0000", 2023-08-01T19:55:31.200 INFO:teuthology.orchestra.run.smithi008.stdout: "duration": 5.9629000000000001e-05 2023-08-01T19:55:31.200 INFO:teuthology.orchestra.run.smithi008.stdout: }, 2023-08-01T19:55:31.200 INFO:teuthology.orchestra.run.smithi008.stdout: { 2023-08-01T19:55:31.200 INFO:teuthology.orchestra.run.smithi008.stdout: "event": "sub_op_commit_rec", 2023-08-01T19:55:31.200 INFO:teuthology.orchestra.run.smithi008.stdout: "time": "2023-08-01T19:55:31.128688+0000", 2023-08-01T19:55:31.201 INFO:teuthology.orchestra.run.smithi008.stdout: "duration": 0.0038108769999999998 2023-08-01T19:55:31.201 INFO:teuthology.orchestra.run.smithi008.stdout: } 2023-08-01T19:55:31.201 INFO:teuthology.orchestra.run.smithi008.stdout: ] 2023-08-01T19:55:31.201 INFO:teuthology.orchestra.run.smithi008.stdout: } 2023-08-01T19:55:31.202 INFO:teuthology.orchestra.run.smithi008.stdout: }, 2023-08-01T19:55:31.202 INFO:teuthology.orchestra.run.smithi008.stdout: { 2023-08-01T19:55:31.202 INFO:teuthology.orchestra.run.smithi008.stdout: "description": "osd_op(client.4668.0:145546 5.c 5:34a061d2:::benchmark_data_smithi006_114134_object11885:head [delete] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e48)", 2023-08-01T19:55:31.202 INFO:teuthology.orchestra.run.smithi008.stdout: "initiated_at": "2023-08-01T19:55:31.125632+0000", 2023-08-01T19:55:31.202 INFO:teuthology.orchestra.run.smithi008.stdout: "age": 0.0037487280000000002, 2023-08-01T19:55:31.202 INFO:teuthology.orchestra.run.smithi008.stdout: "duration": 0.0042222700000000002, 2023-08-01T19:55:31.202 INFO:teuthology.orchestra.run.smithi008.stdout: "type_data": { 2023-08-01T19:55:31.203 INFO:teuthology.orchestra.run.smithi008.stdout: "flag_point": "waiting for sub ops", 2023-08-01T19:55:31.203 INFO:teuthology.orchestra.run.smithi008.stdout: "client_info": { 2023-08-01T19:55:31.203 INFO:teuthology.orchestra.run.smithi008.stdout: "client": "client.4668", 2023-08-01T19:55:31.203 INFO:teuthology.orchestra.run.smithi008.stdout: "client_addr": "172.21.15.6:0/1709472247", 2023-08-01T19:55:31.203 INFO:teuthology.orchestra.run.smithi008.stdout: "tid": 145546 2023-08-01T19:55:31.203 INFO:teuthology.orchestra.run.smithi008.stdout: }, 2023-08-01T19:55:31.203 INFO:teuthology.orchestra.run.smithi008.stdout: "events": [ 2023-08-01T19:55:31.203 INFO:teuthology.orchestra.run.smithi008.stdout: { 2023-08-01T19:55:31.204 INFO:teuthology.orchestra.run.smithi008.stdout: "event": "initiated", 2023-08-01T19:55:31.204 INFO:teuthology.orchestra.run.smithi008.stdout: "time": "2023-08-01T19:55:31.125632+0000", 2023-08-01T19:55:31.204 INFO:teuthology.orchestra.run.smithi008.stdout: "duration": 0 2023-08-01T19:55:31.204 INFO:teuthology.orchestra.run.smithi008.stdout: }, 2023-08-01T19:55:31.204 INFO:teuthology.orchestra.run.smithi008.stdout: { 2023-08-01T19:55:31.204 INFO:teuthology.orchestra.run.smithi008.stdout: "event": "throttled", 2023-08-01T19:55:31.204 INFO:teuthology.orchestra.run.smithi008.stdout: "time": "2023-08-01T19:55:31.125632+0000", 2023-08-01T19:55:31.205 INFO:teuthology.orchestra.run.smithi008.stdout: "duration": 0 2023-08-01T19:55:31.205 INFO:teuthology.orchestra.run.smithi008.stdout: }, 2023-08-01T19:55:31.205 INFO:teuthology.orchestra.run.smithi008.stdout: { 2023-08-01T19:55:31.205 INFO:teuthology.orchestra.run.smithi008.stdout: "event": "header_read", 2023-08-01T19:55:31.205 INFO:teuthology.orchestra.run.smithi008.stdout: "time": "2023-08-01T19:55:31.125631+0000", 2023-08-01T19:55:31.205 INFO:teuthology.orchestra.run.smithi008.stdout: "duration": 4294967295.999999 2023-08-01T19:55:31.205 INFO:teuthology.orchestra.run.smithi008.stdout: }, 2023-08-01T19:55:31.205 INFO:teuthology.orchestra.run.smithi008.stdout: { 2023-08-01T19:55:31.206 INFO:teuthology.orchestra.run.smithi008.stdout: "event": "all_read", 2023-08-01T19:55:31.206 INFO:teuthology.orchestra.run.smithi008.stdout: "time": "2023-08-01T19:55:31.125636+0000", 2023-08-01T19:55:31.206 INFO:teuthology.orchestra.run.smithi008.stdout: "duration": 5.4909999999999996e-06 2023-08-01T19:55:31.206 INFO:teuthology.orchestra.run.smithi008.stdout: }, 2023-08-01T19:55:31.206 INFO:teuthology.orchestra.run.smithi008.stdout: { 2023-08-01T19:55:31.206 INFO:teuthology.orchestra.run.smithi008.stdout: "event": "dispatched", 2023-08-01T19:55:31.206 INFO:teuthology.orchestra.run.smithi008.stdout: "time": "2023-08-01T19:55:31.125648+0000", 2023-08-01T19:55:31.206 INFO:teuthology.orchestra.run.smithi008.stdout: "duration": 1.2089999999999999e-05 2023-08-01T19:55:31.207 INFO:teuthology.orchestra.run.smithi008.stdout: }, 2023-08-01T19:55:31.207 INFO:teuthology.orchestra.run.smithi008.stdout: { 2023-08-01T19:55:31.207 INFO:teuthology.orchestra.run.smithi008.stdout: "event": "queued_for_pg", 2023-08-01T19:55:31.207 INFO:teuthology.orchestra.run.smithi008.stdout: "time": "2023-08-01T19:55:31.125654+0000", 2023-08-01T19:55:31.207 INFO:teuthology.orchestra.run.smithi008.stdout: "duration": 6.156e-06 2023-08-01T19:55:31.207 INFO:teuthology.orchestra.run.smithi008.stdout: }, 2023-08-01T19:55:31.207 INFO:teuthology.orchestra.run.smithi008.stdout: { 2023-08-01T19:55:31.207 INFO:teuthology.orchestra.run.smithi008.stdout: "event": "reached_pg", 2023-08-01T19:55:31.208 INFO:teuthology.orchestra.run.smithi008.stdout: "time": "2023-08-01T19:55:31.127080+0000", 2023-08-01T19:55:31.208 INFO:teuthology.orchestra.run.smithi008.stdout: "duration": 0.0014259209999999999 2023-08-01T19:55:31.208 INFO:teuthology.orchestra.run.smithi008.stdout: }, 2023-08-01T19:55:31.208 INFO:teuthology.orchestra.run.smithi008.stdout: { 2023-08-01T19:55:31.208 INFO:teuthology.orchestra.run.smithi008.stdout: "event": "started", 2023-08-01T19:55:31.208 INFO:teuthology.orchestra.run.smithi008.stdout: "time": "2023-08-01T19:55:31.127187+0000", 2023-08-01T19:55:31.208 INFO:teuthology.orchestra.run.smithi008.stdout: "duration": 0.000106531 2023-08-01T19:55:31.208 INFO:teuthology.orchestra.run.smithi008.stdout: }, 2023-08-01T19:55:31.209 INFO:teuthology.orchestra.run.smithi008.stdout: { 2023-08-01T19:55:31.209 INFO:teuthology.orchestra.run.smithi008.stdout: "event": "waiting for subops from 1", 2023-08-01T19:55:31.209 INFO:teuthology.orchestra.run.smithi008.stdout: "time": "2023-08-01T19:55:31.127293+0000", 2023-08-01T19:55:31.209 INFO:teuthology.orchestra.run.smithi008.stdout: "duration": 0.000106508 2023-08-01T19:55:31.209 INFO:teuthology.orchestra.run.smithi008.stdout: } 2023-08-01T19:55:31.209 INFO:teuthology.orchestra.run.smithi008.stdout: ] 2023-08-01T19:55:31.209 INFO:teuthology.orchestra.run.smithi008.stdout: } 2023-08-01T19:55:31.209 INFO:teuthology.orchestra.run.smithi008.stdout: }, 2023-08-01T19:55:31.210 INFO:teuthology.orchestra.run.smithi008.stdout: { 2023-08-01T19:55:31.210 INFO:teuthology.orchestra.run.smithi008.stdout: "description": "osd_op(client.4668.0:145547 5.a 5:53cabcec:::benchmark_data_smithi006_114134_object11886:head [delete] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e48)", 2023-08-01T19:55:31.210 INFO:teuthology.orchestra.run.smithi008.stdout: "initiated_at": "2023-08-01T19:55:31.125996+0000", 2023-08-01T19:55:31.210 INFO:teuthology.orchestra.run.smithi008.stdout: "age": 0.0033842450000000001, 2023-08-01T19:55:31.210 INFO:teuthology.orchestra.run.smithi008.stdout: "duration": 0.0039221270000000001, 2023-08-01T19:55:31.210 INFO:teuthology.orchestra.run.smithi008.stdout: "type_data": { 2023-08-01T19:55:31.210 INFO:teuthology.orchestra.run.smithi008.stdout: "flag_point": "waiting for sub ops", 2023-08-01T19:55:31.210 INFO:teuthology.orchestra.run.smithi008.stdout: "client_info": { 2023-08-01T19:55:31.211 INFO:teuthology.orchestra.run.smithi008.stdout: "client": "client.4668", 2023-08-01T19:55:31.211 INFO:teuthology.orchestra.run.smithi008.stdout: "client_addr": "172.21.15.6:0/1709472247", 2023-08-01T19:55:31.211 INFO:teuthology.orchestra.run.smithi008.stdout: "tid": 145547 2023-08-01T19:55:31.211 INFO:teuthology.orchestra.run.smithi008.stdout: }, 2023-08-01T19:55:31.211 INFO:teuthology.orchestra.run.smithi008.stdout: "events": [ 2023-08-01T19:55:31.211 INFO:teuthology.orchestra.run.smithi008.stdout: { 2023-08-01T19:55:31.211 INFO:teuthology.orchestra.run.smithi008.stdout: "event": "initiated", 2023-08-01T19:55:31.211 INFO:teuthology.orchestra.run.smithi008.stdout: "time": "2023-08-01T19:55:31.125996+0000", 2023-08-01T19:55:31.212 INFO:teuthology.orchestra.run.smithi008.stdout: "duration": 0 2023-08-01T19:55:31.212 INFO:teuthology.orchestra.run.smithi008.stdout: }, 2023-08-01T19:55:31.212 INFO:teuthology.orchestra.run.smithi008.stdout: { 2023-08-01T19:55:31.212 INFO:teuthology.orchestra.run.smithi008.stdout: "event": "throttled", 2023-08-01T19:55:31.212 INFO:teuthology.orchestra.run.smithi008.stdout: "time": "2023-08-01T19:55:31.125996+0000", 2023-08-01T19:55:31.212 INFO:teuthology.orchestra.run.smithi008.stdout: "duration": 0 2023-08-01T19:55:31.212 INFO:teuthology.orchestra.run.smithi008.stdout: }, 2023-08-01T19:55:31.213 INFO:teuthology.orchestra.run.smithi008.stdout: { 2023-08-01T19:55:31.213 INFO:teuthology.orchestra.run.smithi008.stdout: "event": "header_read", 2023-08-01T19:55:31.213 INFO:teuthology.orchestra.run.smithi008.stdout: "time": "2023-08-01T19:55:31.125995+0000", 2023-08-01T19:55:31.213 INFO:teuthology.orchestra.run.smithi008.stdout: "duration": 4294967295.999999 2023-08-01T19:55:31.213 INFO:teuthology.orchestra.run.smithi008.stdout: }, 2023-08-01T19:55:31.213 INFO:teuthology.orchestra.run.smithi008.stdout: { 2023-08-01T19:55:31.213 INFO:teuthology.orchestra.run.smithi008.stdout: "event": "all_read", 2023-08-01T19:55:31.213 INFO:teuthology.orchestra.run.smithi008.stdout: "time": "2023-08-01T19:55:31.126000+0000", 2023-08-01T19:55:31.214 INFO:teuthology.orchestra.run.smithi008.stdout: "duration": 5.2100000000000001e-06 2023-08-01T19:55:31.214 INFO:teuthology.orchestra.run.smithi008.stdout: }, 2023-08-01T19:55:31.214 INFO:teuthology.orchestra.run.smithi008.stdout: { 2023-08-01T19:55:31.214 INFO:teuthology.orchestra.run.smithi008.stdout: "event": "dispatched", 2023-08-01T19:55:31.214 INFO:teuthology.orchestra.run.smithi008.stdout: "time": "2023-08-01T19:55:31.126014+0000", 2023-08-01T19:55:31.214 INFO:teuthology.orchestra.run.smithi008.stdout: "duration": 1.3851e-05 2023-08-01T19:55:31.214 INFO:teuthology.orchestra.run.smithi008.stdout: }, 2023-08-01T19:55:31.214 INFO:teuthology.orchestra.run.smithi008.stdout: { 2023-08-01T19:55:31.215 INFO:teuthology.orchestra.run.smithi008.stdout: "event": "queued_for_pg", 2023-08-01T19:55:31.215 INFO:teuthology.orchestra.run.smithi008.stdout: "time": "2023-08-01T19:55:31.126021+0000", 2023-08-01T19:55:31.215 INFO:teuthology.orchestra.run.smithi008.stdout: "duration": 6.268e-06 2023-08-01T19:55:31.215 INFO:teuthology.orchestra.run.smithi008.stdout: }, 2023-08-01T19:55:31.215 INFO:teuthology.orchestra.run.smithi008.stdout: { 2023-08-01T19:55:31.215 INFO:teuthology.orchestra.run.smithi008.stdout: "event": "reached_pg", 2023-08-01T19:55:31.215 INFO:teuthology.orchestra.run.smithi008.stdout: "time": "2023-08-01T19:55:31.126645+0000", 2023-08-01T19:55:31.215 INFO:teuthology.orchestra.run.smithi008.stdout: "duration": 0.00062422900000000002 2023-08-01T19:55:31.216 INFO:teuthology.orchestra.run.smithi008.stdout: }, 2023-08-01T19:55:31.216 INFO:teuthology.orchestra.run.smithi008.stdout: { 2023-08-01T19:55:31.216 INFO:teuthology.orchestra.run.smithi008.stdout: "event": "started", 2023-08-01T19:55:31.216 INFO:teuthology.orchestra.run.smithi008.stdout: "time": "2023-08-01T19:55:31.126838+0000", 2023-08-01T19:55:31.216 INFO:teuthology.orchestra.run.smithi008.stdout: "duration": 0.000193148 2023-08-01T19:55:31.216 INFO:teuthology.orchestra.run.smithi008.stdout: }, 2023-08-01T19:55:31.216 INFO:teuthology.orchestra.run.smithi008.stdout: { 2023-08-01T19:55:31.217 INFO:teuthology.orchestra.run.smithi008.stdout: "event": "waiting for subops from 2", 2023-08-01T19:55:31.217 INFO:teuthology.orchestra.run.smithi008.stdout: "time": "2023-08-01T19:55:31.126959+0000", 2023-08-01T19:55:31.217 INFO:teuthology.orchestra.run.smithi008.stdout: "duration": 0.000120715 2023-08-01T19:55:31.217 INFO:teuthology.orchestra.run.smithi008.stdout: } 2023-08-01T19:55:31.217 INFO:teuthology.orchestra.run.smithi008.stdout: ] 2023-08-01T19:55:31.217 INFO:teuthology.orchestra.run.smithi008.stdout: } 2023-08-01T19:55:31.217 INFO:teuthology.orchestra.run.smithi008.stdout: }, 2023-08-01T19:55:31.217 INFO:teuthology.orchestra.run.smithi008.stdout: { 2023-08-01T19:55:31.218 INFO:teuthology.orchestra.run.smithi008.stdout: "description": "osd_op(client.4668.0:145549 5.3 5:c0db8805:::benchmark_data_smithi006_114134_object11888:head [delete] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e48)", 2023-08-01T19:55:31.218 INFO:teuthology.orchestra.run.smithi008.stdout: "initiated_at": "2023-08-01T19:55:31.126982+0000", 2023-08-01T19:55:31.218 INFO:teuthology.orchestra.run.smithi008.stdout: "age": 0.0023985930000000001, 2023-08-01T19:55:31.218 INFO:teuthology.orchestra.run.smithi008.stdout: "duration": 0.0029999229999999998, 2023-08-01T19:55:31.218 INFO:teuthology.orchestra.run.smithi008.stdout: "type_data": { 2023-08-01T19:55:31.218 INFO:teuthology.orchestra.run.smithi008.stdout: "flag_point": "waiting for sub ops", 2023-08-01T19:55:31.218 INFO:teuthology.orchestra.run.smithi008.stdout: "client_info": { 2023-08-01T19:55:31.218 INFO:teuthology.orchestra.run.smithi008.stdout: "client": "client.4668", 2023-08-01T19:55:31.219 INFO:teuthology.orchestra.run.smithi008.stdout: "client_addr": "172.21.15.6:0/1709472247", 2023-08-01T19:55:31.219 INFO:teuthology.orchestra.run.smithi008.stdout: "tid": 145549 2023-08-01T19:55:31.219 INFO:teuthology.orchestra.run.smithi008.stdout: }, 2023-08-01T19:55:31.219 INFO:teuthology.orchestra.run.smithi008.stdout: "events": [ 2023-08-01T19:55:31.219 INFO:teuthology.orchestra.run.smithi008.stdout: { 2023-08-01T19:55:31.219 INFO:teuthology.orchestra.run.smithi008.stdout: "event": "initiated", 2023-08-01T19:55:31.219 INFO:teuthology.orchestra.run.smithi008.stdout: "time": "2023-08-01T19:55:31.126982+0000", 2023-08-01T19:55:31.220 INFO:teuthology.orchestra.run.smithi008.stdout: "duration": 0 2023-08-01T19:55:31.220 INFO:teuthology.orchestra.run.smithi008.stdout: }, 2023-08-01T19:55:31.220 INFO:teuthology.orchestra.run.smithi008.stdout: { 2023-08-01T19:55:31.220 INFO:teuthology.orchestra.run.smithi008.stdout: "event": "throttled", 2023-08-01T19:55:31.220 INFO:teuthology.orchestra.run.smithi008.stdout: "time": "2023-08-01T19:55:31.126982+0000", 2023-08-01T19:55:31.220 INFO:teuthology.orchestra.run.smithi008.stdout: "duration": 0 2023-08-01T19:55:31.220 INFO:teuthology.orchestra.run.smithi008.stdout: }, 2023-08-01T19:55:31.220 INFO:teuthology.orchestra.run.smithi008.stdout: { 2023-08-01T19:55:31.221 INFO:teuthology.orchestra.run.smithi008.stdout: "event": "header_read", 2023-08-01T19:55:31.221 INFO:teuthology.orchestra.run.smithi008.stdout: "time": "2023-08-01T19:55:31.126981+0000", 2023-08-01T19:55:31.221 INFO:teuthology.orchestra.run.smithi008.stdout: "duration": 4294967295.999999 2023-08-01T19:55:31.221 INFO:teuthology.orchestra.run.smithi008.stdout: }, 2023-08-01T19:55:31.221 INFO:teuthology.orchestra.run.smithi008.stdout: { 2023-08-01T19:55:31.221 INFO:teuthology.orchestra.run.smithi008.stdout: "event": "all_read", 2023-08-01T19:55:31.221 INFO:teuthology.orchestra.run.smithi008.stdout: "time": "2023-08-01T19:55:31.126985+0000", 2023-08-01T19:55:31.221 INFO:teuthology.orchestra.run.smithi008.stdout: "duration": 4.0690000000000003e-06 2023-08-01T19:55:31.222 INFO:teuthology.orchestra.run.smithi008.stdout: }, 2023-08-01T19:55:31.222 INFO:teuthology.orchestra.run.smithi008.stdout: { 2023-08-01T19:55:31.222 INFO:teuthology.orchestra.run.smithi008.stdout: "event": "dispatched", 2023-08-01T19:55:31.222 INFO:teuthology.orchestra.run.smithi008.stdout: "time": "2023-08-01T19:55:31.126994+0000", 2023-08-01T19:55:31.222 INFO:teuthology.orchestra.run.smithi008.stdout: "duration": 8.7560000000000005e-06 2023-08-01T19:55:31.222 INFO:teuthology.orchestra.run.smithi008.stdout: }, 2023-08-01T19:55:31.222 INFO:teuthology.orchestra.run.smithi008.stdout: { 2023-08-01T19:55:31.223 INFO:teuthology.orchestra.run.smithi008.stdout: "event": "queued_for_pg", 2023-08-01T19:55:31.223 INFO:teuthology.orchestra.run.smithi008.stdout: "time": "2023-08-01T19:55:31.126998+0000", 2023-08-01T19:55:31.223 INFO:teuthology.orchestra.run.smithi008.stdout: "duration": 4.1760000000000003e-06 2023-08-01T19:55:31.223 INFO:teuthology.orchestra.run.smithi008.stdout: }, 2023-08-01T19:55:31.223 INFO:teuthology.orchestra.run.smithi008.stdout: { 2023-08-01T19:55:31.223 INFO:teuthology.orchestra.run.smithi008.stdout: "event": "reached_pg", 2023-08-01T19:55:31.223 INFO:teuthology.orchestra.run.smithi008.stdout: "time": "2023-08-01T19:55:31.127042+0000", 2023-08-01T19:55:31.223 INFO:teuthology.orchestra.run.smithi008.stdout: "duration": 4.3971000000000003e-05 2023-08-01T19:55:31.224 INFO:teuthology.orchestra.run.smithi008.stdout: }, 2023-08-01T19:55:31.224 INFO:teuthology.orchestra.run.smithi008.stdout: { 2023-08-01T19:55:31.224 INFO:teuthology.orchestra.run.smithi008.stdout: "event": "started", 2023-08-01T19:55:31.224 INFO:teuthology.orchestra.run.smithi008.stdout: "time": "2023-08-01T19:55:31.127156+0000", 2023-08-01T19:55:31.224 INFO:teuthology.orchestra.run.smithi008.stdout: "duration": 0.000114478 2023-08-01T19:55:31.224 INFO:teuthology.orchestra.run.smithi008.stdout: }, 2023-08-01T19:55:31.224 INFO:teuthology.orchestra.run.smithi008.stdout: { 2023-08-01T19:55:31.224 INFO:teuthology.orchestra.run.smithi008.stdout: "event": "waiting for subops from 1", 2023-08-01T19:55:31.225 INFO:teuthology.orchestra.run.smithi008.stdout: "time": "2023-08-01T19:55:31.127265+0000", 2023-08-01T19:55:31.225 INFO:teuthology.orchestra.run.smithi008.stdout: "duration": 0.000108389 2023-08-01T19:55:31.225 INFO:teuthology.orchestra.run.smithi008.stdout: } 2023-08-01T19:55:31.225 INFO:teuthology.orchestra.run.smithi008.stdout: ] 2023-08-01T19:55:31.225 INFO:teuthology.orchestra.run.smithi008.stdout: } 2023-08-01T19:55:31.225 INFO:teuthology.orchestra.run.smithi008.stdout: }, 2023-08-01T19:55:31.225 INFO:teuthology.orchestra.run.smithi008.stdout: { 2023-08-01T19:55:31.226 INFO:teuthology.orchestra.run.smithi008.stdout: "description": "osd_repop(client.4668.0:145548 5.b e48/19 5:dcf5bd41:::benchmark_data_smithi006_114134_object11887:head v 48'9053, mlcod=48'9050)", 2023-08-01T19:55:31.226 INFO:teuthology.orchestra.run.smithi008.stdout: "initiated_at": "2023-08-01T19:55:31.127303+0000", 2023-08-01T19:55:31.226 INFO:teuthology.orchestra.run.smithi008.stdout: "age": 0.0020771520000000001, 2023-08-01T19:55:31.226 INFO:teuthology.orchestra.run.smithi008.stdout: "duration": 0.0027670569999999999, 2023-08-01T19:55:31.226 INFO:teuthology.orchestra.run.smithi008.stdout: "type_data": { 2023-08-01T19:55:31.226 INFO:teuthology.orchestra.run.smithi008.stdout: "flag_point": "started", 2023-08-01T19:55:31.226 INFO:teuthology.orchestra.run.smithi008.stdout: "events": [ 2023-08-01T19:55:31.226 INFO:teuthology.orchestra.run.smithi008.stdout: { 2023-08-01T19:55:31.227 INFO:teuthology.orchestra.run.smithi008.stdout: "event": "initiated", 2023-08-01T19:55:31.227 INFO:teuthology.orchestra.run.smithi008.stdout: "time": "2023-08-01T19:55:31.127303+0000", 2023-08-01T19:55:31.227 INFO:teuthology.orchestra.run.smithi008.stdout: "duration": 0 2023-08-01T19:55:31.227 INFO:teuthology.orchestra.run.smithi008.stdout: }, 2023-08-01T19:55:31.227 INFO:teuthology.orchestra.run.smithi008.stdout: { 2023-08-01T19:55:31.227 INFO:teuthology.orchestra.run.smithi008.stdout: "event": "throttled", 2023-08-01T19:55:31.227 INFO:teuthology.orchestra.run.smithi008.stdout: "time": "2023-08-01T19:55:31.127303+0000", 2023-08-01T19:55:31.227 INFO:teuthology.orchestra.run.smithi008.stdout: "duration": 0 2023-08-01T19:55:31.228 INFO:teuthology.orchestra.run.smithi008.stdout: }, 2023-08-01T19:55:31.228 INFO:teuthology.orchestra.run.smithi008.stdout: { 2023-08-01T19:55:31.228 INFO:teuthology.orchestra.run.smithi008.stdout: "event": "header_read", 2023-08-01T19:55:31.228 INFO:teuthology.orchestra.run.smithi008.stdout: "time": "2023-08-01T19:55:31.127303+0000", 2023-08-01T19:55:31.228 INFO:teuthology.orchestra.run.smithi008.stdout: "duration": 4294967295.9999995 2023-08-01T19:55:31.228 INFO:teuthology.orchestra.run.smithi008.stdout: }, 2023-08-01T19:55:31.228 INFO:teuthology.orchestra.run.smithi008.stdout: { 2023-08-01T19:55:31.228 INFO:teuthology.orchestra.run.smithi008.stdout: "event": "all_read", 2023-08-01T19:55:31.229 INFO:teuthology.orchestra.run.smithi008.stdout: "time": "2023-08-01T19:55:31.127308+0000", 2023-08-01T19:55:31.229 INFO:teuthology.orchestra.run.smithi008.stdout: "duration": 5.587e-06 2023-08-01T19:55:31.229 INFO:teuthology.orchestra.run.smithi008.stdout: }, 2023-08-01T19:55:31.229 INFO:teuthology.orchestra.run.smithi008.stdout: { 2023-08-01T19:55:31.229 INFO:teuthology.orchestra.run.smithi008.stdout: "event": "dispatched", 2023-08-01T19:55:31.229 INFO:teuthology.orchestra.run.smithi008.stdout: "time": "2023-08-01T19:55:31.127317+0000", 2023-08-01T19:55:31.229 INFO:teuthology.orchestra.run.smithi008.stdout: "duration": 8.7229999999999993e-06 2023-08-01T19:55:31.229 INFO:teuthology.orchestra.run.smithi008.stdout: }, 2023-08-01T19:55:31.230 INFO:teuthology.orchestra.run.smithi008.stdout: { 2023-08-01T19:55:31.230 INFO:teuthology.orchestra.run.smithi008.stdout: "event": "queued_for_pg", 2023-08-01T19:55:31.230 INFO:teuthology.orchestra.run.smithi008.stdout: "time": "2023-08-01T19:55:31.127322+0000", 2023-08-01T19:55:31.230 INFO:teuthology.orchestra.run.smithi008.stdout: "duration": 4.8409999999999999e-06 2023-08-01T19:55:31.230 INFO:teuthology.orchestra.run.smithi008.stdout: }, 2023-08-01T19:55:31.230 INFO:teuthology.orchestra.run.smithi008.stdout: { 2023-08-01T19:55:31.230 INFO:teuthology.orchestra.run.smithi008.stdout: "event": "reached_pg", 2023-08-01T19:55:31.230 INFO:teuthology.orchestra.run.smithi008.stdout: "time": "2023-08-01T19:55:31.127359+0000", 2023-08-01T19:55:31.231 INFO:teuthology.orchestra.run.smithi008.stdout: "duration": 3.7045999999999997e-05 2023-08-01T19:55:31.231 INFO:teuthology.orchestra.run.smithi008.stdout: }, 2023-08-01T19:55:31.231 INFO:teuthology.orchestra.run.smithi008.stdout: { 2023-08-01T19:55:31.231 INFO:teuthology.orchestra.run.smithi008.stdout: "event": "started", 2023-08-01T19:55:31.231 INFO:teuthology.orchestra.run.smithi008.stdout: "time": "2023-08-01T19:55:31.127376+0000", 2023-08-01T19:55:31.231 INFO:teuthology.orchestra.run.smithi008.stdout: "duration": 1.7099e-05 2023-08-01T19:55:31.231 INFO:teuthology.orchestra.run.smithi008.stdout: } 2023-08-01T19:55:31.231 INFO:teuthology.orchestra.run.smithi008.stdout: ] 2023-08-01T19:55:31.232 INFO:teuthology.orchestra.run.smithi008.stdout: } 2023-08-01T19:55:31.232 INFO:teuthology.orchestra.run.smithi008.stdout: }, 2023-08-01T19:55:31.232 INFO:teuthology.orchestra.run.smithi008.stdout: { 2023-08-01T19:55:31.232 INFO:teuthology.orchestra.run.smithi008.stdout: "description": "osd_repop(client.4668.0:145551 5.7 e48/19 5:e2414e90:::benchmark_data_smithi006_114134_object11890:head v 48'9071, mlcod=48'9069)", 2023-08-01T19:55:31.232 INFO:teuthology.orchestra.run.smithi008.stdout: "initiated_at": "2023-08-01T19:55:31.129740+0000", 2023-08-01T19:55:31.232 INFO:teuthology.orchestra.run.smithi008.stdout: "age": 4294967295.9996409, 2023-08-01T19:55:31.232 INFO:teuthology.orchestra.run.smithi008.stdout: "duration": 0.00040919399999999999, 2023-08-01T19:55:31.233 INFO:teuthology.orchestra.run.smithi008.stdout: "type_data": { 2023-08-01T19:55:31.233 INFO:teuthology.orchestra.run.smithi008.stdout: "flag_point": "started", 2023-08-01T19:55:31.233 INFO:teuthology.orchestra.run.smithi008.stdout: "events": [ 2023-08-01T19:55:31.233 INFO:teuthology.orchestra.run.smithi008.stdout: { 2023-08-01T19:55:31.233 INFO:teuthology.orchestra.run.smithi008.stdout: "event": "initiated", 2023-08-01T19:55:31.233 INFO:teuthology.orchestra.run.smithi008.stdout: "time": "2023-08-01T19:55:31.129740+0000", 2023-08-01T19:55:31.233 INFO:teuthology.orchestra.run.smithi008.stdout: "duration": 0 2023-08-01T19:55:31.233 INFO:teuthology.orchestra.run.smithi008.stdout: }, 2023-08-01T19:55:31.234 INFO:teuthology.orchestra.run.smithi008.stdout: { 2023-08-01T19:55:31.234 INFO:teuthology.orchestra.run.smithi008.stdout: "event": "throttled", 2023-08-01T19:55:31.234 INFO:teuthology.orchestra.run.smithi008.stdout: "time": "2023-08-01T19:55:31.129740+0000", 2023-08-01T19:55:31.234 INFO:teuthology.orchestra.run.smithi008.stdout: "duration": 0 2023-08-01T19:55:31.234 INFO:teuthology.orchestra.run.smithi008.stdout: }, 2023-08-01T19:55:31.234 INFO:teuthology.orchestra.run.smithi008.stdout: { 2023-08-01T19:55:31.234 INFO:teuthology.orchestra.run.smithi008.stdout: "event": "header_read", 2023-08-01T19:55:31.234 INFO:teuthology.orchestra.run.smithi008.stdout: "time": "2023-08-01T19:55:31.129739+0000", 2023-08-01T19:55:31.235 INFO:teuthology.orchestra.run.smithi008.stdout: "duration": 4294967295.9999995 2023-08-01T19:55:31.235 INFO:teuthology.orchestra.run.smithi008.stdout: }, 2023-08-01T19:55:31.235 INFO:teuthology.orchestra.run.smithi008.stdout: { 2023-08-01T19:55:31.235 INFO:teuthology.orchestra.run.smithi008.stdout: "event": "all_read", 2023-08-01T19:55:31.235 INFO:teuthology.orchestra.run.smithi008.stdout: "time": "2023-08-01T19:55:31.129746+0000", 2023-08-01T19:55:31.235 INFO:teuthology.orchestra.run.smithi008.stdout: "duration": 6.8600000000000004e-06 2023-08-01T19:55:31.235 INFO:teuthology.orchestra.run.smithi008.stdout: }, 2023-08-01T19:55:31.235 INFO:teuthology.orchestra.run.smithi008.stdout: { 2023-08-01T19:55:31.236 INFO:teuthology.orchestra.run.smithi008.stdout: "event": "dispatched", 2023-08-01T19:55:31.236 INFO:teuthology.orchestra.run.smithi008.stdout: "time": "2023-08-01T19:55:31.129756+0000", 2023-08-01T19:55:31.236 INFO:teuthology.orchestra.run.smithi008.stdout: "duration": 1.0261000000000001e-05 2023-08-01T19:55:31.236 INFO:teuthology.orchestra.run.smithi008.stdout: }, 2023-08-01T19:55:31.236 INFO:teuthology.orchestra.run.smithi008.stdout: { 2023-08-01T19:55:31.236 INFO:teuthology.orchestra.run.smithi008.stdout: "event": "queued_for_pg", 2023-08-01T19:55:31.236 INFO:teuthology.orchestra.run.smithi008.stdout: "time": "2023-08-01T19:55:31.129760+0000", 2023-08-01T19:55:31.237 INFO:teuthology.orchestra.run.smithi008.stdout: "duration": 4.1579999999999998e-06 2023-08-01T19:55:31.237 INFO:teuthology.orchestra.run.smithi008.stdout: }, 2023-08-01T19:55:31.237 INFO:teuthology.orchestra.run.smithi008.stdout: { 2023-08-01T19:55:31.237 INFO:teuthology.orchestra.run.smithi008.stdout: "event": "reached_pg", 2023-08-01T19:55:31.237 INFO:teuthology.orchestra.run.smithi008.stdout: "time": "2023-08-01T19:55:31.129794+0000", 2023-08-01T19:55:31.237 INFO:teuthology.orchestra.run.smithi008.stdout: "duration": 3.4221000000000003e-05 2023-08-01T19:55:31.237 INFO:teuthology.orchestra.run.smithi008.stdout: }, 2023-08-01T19:55:31.237 INFO:teuthology.orchestra.run.smithi008.stdout: { 2023-08-01T19:55:31.238 INFO:teuthology.orchestra.run.smithi008.stdout: "event": "started", 2023-08-01T19:55:31.238 INFO:teuthology.orchestra.run.smithi008.stdout: "time": "2023-08-01T19:55:31.129815+0000", 2023-08-01T19:55:31.238 INFO:teuthology.orchestra.run.smithi008.stdout: "duration": 2.0349000000000001e-05 2023-08-01T19:55:31.238 INFO:teuthology.orchestra.run.smithi008.stdout: } 2023-08-01T19:55:31.238 INFO:teuthology.orchestra.run.smithi008.stdout: ] 2023-08-01T19:55:31.238 INFO:teuthology.orchestra.run.smithi008.stdout: } 2023-08-01T19:55:31.238 INFO:teuthology.orchestra.run.smithi008.stdout: } 2023-08-01T19:55:31.238 INFO:teuthology.orchestra.run.smithi008.stdout: ], 2023-08-01T19:55:31.239 INFO:teuthology.orchestra.run.smithi008.stdout: "num_ops": 14 2023-08-01T19:55:31.239 INFO:teuthology.orchestra.run.smithi008.stdout:} 2023-08-01T19:55:31.240 INFO:tasks.ceph.osd.1.smithi101.stderr:2023-08-01T19:55:31.238+0000 7fb0cb7f6700 -1 received signal: Hangup from /usr/bin/python3 /bin/daemon-helper kill ceph-osd -f --cluster ceph -i 1 (PID: 111141) UID: 0 2023-08-01T19:55:31.240 DEBUG:teuthology.orchestra.run.smithi008:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 30 ceph --cluster ceph --admin-daemon /var/run/ceph/ceph-osd.0.asok dump_blocked_ops 2023-08-01T19:55:31.340 INFO:tasks.ceph.osd.0.smithi008.stderr:2023-08-01T19:55:31.338+0000 7f16a58f4700 -1 received signal: Hangup from /usr/bin/python3 /bin/daemon-helper kill ceph-osd -f --cluster ceph -i 0 (PID: 111179) UID: 0 2023-08-01T19:55:31.426 INFO:teuthology.orchestra.run.smithi008.stdout:{ 2023-08-01T19:55:31.426 INFO:teuthology.orchestra.run.smithi008.stdout: "ops": [], 2023-08-01T19:55:31.426 INFO:teuthology.orchestra.run.smithi008.stdout: "complaint_time": 30, 2023-08-01T19:55:31.427 INFO:teuthology.orchestra.run.smithi008.stdout: "num_blocked_ops": 0 2023-08-01T19:55:31.427 INFO:teuthology.orchestra.run.smithi008.stdout:} 2023-08-01T19:55:31.441 DEBUG:teuthology.orchestra.run.smithi008:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 30 ceph --cluster ceph --admin-daemon /var/run/ceph/ceph-osd.0.asok dump_historic_ops 2023-08-01T19:55:31.442 INFO:tasks.ceph.osd.0.smithi008.stderr:2023-08-01T19:55:31.439+0000 7f16a58f4700 -1 received signal: Hangup from /usr/bin/python3 /bin/daemon-helper kill ceph-osd -f --cluster ceph -i 0 (PID: 111179) UID: 0 2023-08-01T19:55:31.541 INFO:tasks.thrashosds.thrasher:in_osds: [0, 1, 2] out_osds: [] dead_osds: [] live_osds: [0, 1, 2] 2023-08-01T19:55:31.542 INFO:tasks.thrashosds.thrasher:choose_action: min_in 4 min_out 0 min_live 2 min_dead 0 chance_down 1.00 2023-08-01T19:55:31.542 INFO:tasks.thrashosds.thrasher:inject_pause on osd.1 2023-08-01T19:55:31.542 INFO:tasks.thrashosds.thrasher:Testing filestore_inject_stall pause injection for duration 3 2023-08-01T19:55:31.542 INFO:tasks.thrashosds.thrasher:Checking after 0, should_be_down=False 2023-08-01T19:55:31.543 DEBUG:teuthology.orchestra.run.smithi101:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 0 ceph --cluster ceph --admin-daemon /var/run/ceph/ceph-osd.1.asok config set filestore_inject_stall 3 2023-08-01T19:55:31.543 INFO:tasks.ceph.osd.2.smithi155.stderr:2023-08-01T19:55:31.540+0000 7faa5c6ac700 -1 received signal: Hangup from /usr/bin/python3 /bin/daemon-helper kill ceph-osd -f --cluster ceph -i 2 (PID: 111337) UID: 0 2023-08-01T19:55:31.642 INFO:tasks.ceph.osd.2.smithi155.stderr:2023-08-01T19:55:31.641+0000 7faa5c6ac700 -1 received signal: Hangup from /usr/bin/python3 /bin/daemon-helper kill ceph-osd -f --cluster ceph -i 2 (PID: 111337) UID: 0 2023-08-01T19:55:31.680 INFO:teuthology.orchestra.run.smithi008.stdout:{ 2023-08-01T19:55:31.681 INFO:teuthology.orchestra.run.smithi008.stdout: "size": 20, 2023-08-01T19:55:31.681 INFO:teuthology.orchestra.run.smithi008.stdout: "duration": 600, 2023-08-01T19:55:31.681 INFO:teuthology.orchestra.run.smithi008.stdout: "ops": [ 2023-08-01T19:55:31.681 INFO:teuthology.orchestra.run.smithi008.stdout: { 2023-08-01T19:55:31.681 INFO:teuthology.orchestra.run.smithi008.stdout: "description": "osd_op(client.4668.0:100240 5.a 5:5313c5b9:::benchmark_data_smithi006_114134_object100239:head [set-alloc-hint object_size 65536 write_size 65536,write 0~65536] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e37)", 2023-08-01T19:55:31.681 INFO:teuthology.orchestra.run.smithi008.stdout: "initiated_at": "2023-08-01T19:55:05.148399+0000", 2023-08-01T19:55:31.682 INFO:teuthology.orchestra.run.smithi008.stdout: "age": 26.528896150000001, 2023-08-01T19:55:31.682 INFO:teuthology.orchestra.run.smithi008.stdout: "duration": 0.077278904999999995, 2023-08-01T19:55:31.682 INFO:teuthology.orchestra.run.smithi008.stdout: "type_data": { 2023-08-01T19:55:31.682 INFO:teuthology.orchestra.run.smithi008.stdout: "flag_point": "commit sent; apply or cleanup", 2023-08-01T19:55:31.682 INFO:teuthology.orchestra.run.smithi008.stdout: "client_info": { 2023-08-01T19:55:31.682 INFO:teuthology.orchestra.run.smithi008.stdout: "client": "client.4668", 2023-08-01T19:55:31.682 INFO:teuthology.orchestra.run.smithi008.stdout: "client_addr": "172.21.15.6:0/1709472247", 2023-08-01T19:55:31.682 INFO:teuthology.orchestra.run.smithi008.stdout: "tid": 100240 2023-08-01T19:55:31.683 INFO:teuthology.orchestra.run.smithi008.stdout: }, 2023-08-01T19:55:31.683 INFO:teuthology.orchestra.run.smithi008.stdout: "events": [ 2023-08-01T19:55:31.683 INFO:teuthology.orchestra.run.smithi008.stdout: { 2023-08-01T19:55:31.683 INFO:teuthology.orchestra.run.smithi008.stdout: "event": "initiated", 2023-08-01T19:55:31.683 INFO:teuthology.orchestra.run.smithi008.stdout: "time": "2023-08-01T19:55:05.148399+0000", 2023-08-01T19:55:31.683 INFO:teuthology.orchestra.run.smithi008.stdout: "duration": 0 2023-08-01T19:55:31.683 INFO:teuthology.orchestra.run.smithi008.stdout: }, 2023-08-01T19:55:31.683 INFO:teuthology.orchestra.run.smithi008.stdout: { 2023-08-01T19:55:31.684 INFO:teuthology.orchestra.run.smithi008.stdout: "event": "throttled", 2023-08-01T19:55:31.684 INFO:teuthology.orchestra.run.smithi008.stdout: "time": "2023-08-01T19:55:05.148399+0000", 2023-08-01T19:55:31.684 INFO:teuthology.orchestra.run.smithi008.stdout: "duration": 0 2023-08-01T19:55:31.684 INFO:teuthology.orchestra.run.smithi008.stdout: }, 2023-08-01T19:55:31.684 INFO:teuthology.orchestra.run.smithi008.stdout: { 2023-08-01T19:55:31.684 INFO:teuthology.orchestra.run.smithi008.stdout: "event": "header_read", 2023-08-01T19:55:31.684 INFO:teuthology.orchestra.run.smithi008.stdout: "time": "2023-08-01T19:55:05.148398+0000", 2023-08-01T19:55:31.684 INFO:teuthology.orchestra.run.smithi008.stdout: "duration": 4294967295.999999 2023-08-01T19:55:31.685 INFO:teuthology.orchestra.run.smithi008.stdout: }, 2023-08-01T19:55:31.685 INFO:teuthology.orchestra.run.smithi008.stdout: { 2023-08-01T19:55:31.685 INFO:teuthology.orchestra.run.smithi008.stdout: "event": "all_read", 2023-08-01T19:55:31.685 INFO:teuthology.orchestra.run.smithi008.stdout: "time": "2023-08-01T19:55:05.148492+0000", 2023-08-01T19:55:31.685 INFO:teuthology.orchestra.run.smithi008.stdout: "duration": 9.3892000000000002e-05 2023-08-01T19:55:31.685 INFO:teuthology.orchestra.run.smithi008.stdout: }, 2023-08-01T19:55:31.685 INFO:teuthology.orchestra.run.smithi008.stdout: { 2023-08-01T19:55:31.686 INFO:teuthology.orchestra.run.smithi008.stdout: "event": "dispatched", 2023-08-01T19:55:31.686 INFO:teuthology.orchestra.run.smithi008.stdout: "time": "2023-08-01T19:55:05.148503+0000", 2023-08-01T19:55:31.686 INFO:teuthology.orchestra.run.smithi008.stdout: "duration": 1.0951000000000001e-05 2023-08-01T19:55:31.686 INFO:teuthology.orchestra.run.smithi008.stdout: }, 2023-08-01T19:55:31.686 INFO:teuthology.orchestra.run.smithi008.stdout: { 2023-08-01T19:55:31.686 INFO:teuthology.orchestra.run.smithi008.stdout: "event": "queued_for_pg", 2023-08-01T19:55:31.686 INFO:teuthology.orchestra.run.smithi008.stdout: "time": "2023-08-01T19:55:05.148508+0000", 2023-08-01T19:55:31.686 INFO:teuthology.orchestra.run.smithi008.stdout: "duration": 5.0080000000000002e-06 2023-08-01T19:55:31.687 INFO:teuthology.orchestra.run.smithi008.stdout: }, 2023-08-01T19:55:31.687 INFO:teuthology.orchestra.run.smithi008.stdout: { 2023-08-01T19:55:31.687 INFO:teuthology.orchestra.run.smithi008.stdout: "event": "reached_pg", 2023-08-01T19:55:31.687 INFO:teuthology.orchestra.run.smithi008.stdout: "time": "2023-08-01T19:55:05.148548+0000", 2023-08-01T19:55:31.687 INFO:teuthology.orchestra.run.smithi008.stdout: "duration": 4.0358999999999998e-05 2023-08-01T19:55:31.687 INFO:teuthology.orchestra.run.smithi008.stdout: }, 2023-08-01T19:55:31.687 INFO:teuthology.orchestra.run.smithi008.stdout: { 2023-08-01T19:55:31.687 INFO:teuthology.orchestra.run.smithi008.stdout: "event": "started", 2023-08-01T19:55:31.688 INFO:teuthology.orchestra.run.smithi008.stdout: "time": "2023-08-01T19:55:05.148666+0000", 2023-08-01T19:55:31.688 INFO:teuthology.orchestra.run.smithi008.stdout: "duration": 0.000117621 2023-08-01T19:55:31.688 INFO:teuthology.orchestra.run.smithi008.stdout: }, 2023-08-01T19:55:31.688 INFO:teuthology.orchestra.run.smithi008.stdout: { 2023-08-01T19:55:31.688 INFO:teuthology.orchestra.run.smithi008.stdout: "event": "waiting for subops from 2", 2023-08-01T19:55:31.688 INFO:teuthology.orchestra.run.smithi008.stdout: "time": "2023-08-01T19:55:05.148805+0000", 2023-08-01T19:55:31.688 INFO:teuthology.orchestra.run.smithi008.stdout: "duration": 0.000139176 2023-08-01T19:55:31.689 INFO:teuthology.orchestra.run.smithi008.stdout: }, 2023-08-01T19:55:31.689 INFO:teuthology.orchestra.run.smithi008.stdout: { 2023-08-01T19:55:31.689 INFO:teuthology.orchestra.run.smithi008.stdout: "event": "op_commit", 2023-08-01T19:55:31.689 INFO:teuthology.orchestra.run.smithi008.stdout: "time": "2023-08-01T19:55:05.156143+0000", 2023-08-01T19:55:31.689 INFO:teuthology.orchestra.run.smithi008.stdout: "duration": 0.007338041 2023-08-01T19:55:31.689 INFO:teuthology.orchestra.run.smithi008.stdout: }, 2023-08-01T19:55:31.689 INFO:teuthology.orchestra.run.smithi008.stdout: { 2023-08-01T19:55:31.689 INFO:teuthology.orchestra.run.smithi008.stdout: "event": "sub_op_commit_rec", 2023-08-01T19:55:31.690 INFO:teuthology.orchestra.run.smithi008.stdout: "time": "2023-08-01T19:55:05.225581+0000", 2023-08-01T19:55:31.690 INFO:teuthology.orchestra.run.smithi008.stdout: "duration": 0.069438402999999996 2023-08-01T19:55:31.690 INFO:teuthology.orchestra.run.smithi008.stdout: }, 2023-08-01T19:55:31.690 INFO:teuthology.orchestra.run.smithi008.stdout: { 2023-08-01T19:55:31.690 INFO:teuthology.orchestra.run.smithi008.stdout: "event": "commit_sent", 2023-08-01T19:55:31.690 INFO:teuthology.orchestra.run.smithi008.stdout: "time": "2023-08-01T19:55:05.225632+0000", 2023-08-01T19:55:31.690 INFO:teuthology.orchestra.run.smithi008.stdout: "duration": 5.0382e-05 2023-08-01T19:55:31.690 INFO:teuthology.orchestra.run.smithi008.stdout: }, 2023-08-01T19:55:31.691 INFO:teuthology.orchestra.run.smithi008.stdout: { 2023-08-01T19:55:31.691 INFO:teuthology.orchestra.run.smithi008.stdout: "event": "done", 2023-08-01T19:55:31.691 INFO:teuthology.orchestra.run.smithi008.stdout: "time": "2023-08-01T19:55:05.225677+0000", 2023-08-01T19:55:31.691 INFO:teuthology.orchestra.run.smithi008.stdout: "duration": 4.5893000000000003e-05 2023-08-01T19:55:31.691 INFO:teuthology.orchestra.run.smithi008.stdout: } 2023-08-01T19:55:31.691 INFO:teuthology.orchestra.run.smithi008.stdout: ] 2023-08-01T19:55:31.691 INFO:teuthology.orchestra.run.smithi008.stdout: } 2023-08-01T19:55:31.691 INFO:teuthology.orchestra.run.smithi008.stdout: }, 2023-08-01T19:55:31.692 INFO:teuthology.orchestra.run.smithi008.stdout: { 2023-08-01T19:55:31.692 INFO:teuthology.orchestra.run.smithi008.stdout: "description": "osd_op(client.4668.0:100243 5.a 5:5e8193b6:::benchmark_data_smithi006_114134_object100242:head [set-alloc-hint object_size 65536 write_size 65536,write 0~65536] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e37)", 2023-08-01T19:55:31.692 INFO:teuthology.orchestra.run.smithi008.stdout: "initiated_at": "2023-08-01T19:55:05.150737+0000", 2023-08-01T19:55:31.692 INFO:teuthology.orchestra.run.smithi008.stdout: "age": 26.526557695000001, 2023-08-01T19:55:31.692 INFO:teuthology.orchestra.run.smithi008.stdout: "duration": 0.075019885999999994, 2023-08-01T19:55:31.692 INFO:teuthology.orchestra.run.smithi008.stdout: "type_data": { 2023-08-01T19:55:31.692 INFO:teuthology.orchestra.run.smithi008.stdout: "flag_point": "commit sent; apply or cleanup", 2023-08-01T19:55:31.693 INFO:teuthology.orchestra.run.smithi008.stdout: "client_info": { 2023-08-01T19:55:31.693 INFO:teuthology.orchestra.run.smithi008.stdout: "client": "client.4668", 2023-08-01T19:55:31.693 INFO:teuthology.orchestra.run.smithi008.stdout: "client_addr": "172.21.15.6:0/1709472247", 2023-08-01T19:55:31.693 INFO:teuthology.orchestra.run.smithi008.stdout: "tid": 100243 2023-08-01T19:55:31.693 INFO:teuthology.orchestra.run.smithi008.stdout: }, 2023-08-01T19:55:31.693 INFO:teuthology.orchestra.run.smithi008.stdout: "events": [ 2023-08-01T19:55:31.693 INFO:teuthology.orchestra.run.smithi008.stdout: { 2023-08-01T19:55:31.693 INFO:teuthology.orchestra.run.smithi008.stdout: "event": "initiated", 2023-08-01T19:55:31.694 INFO:teuthology.orchestra.run.smithi008.stdout: "time": "2023-08-01T19:55:05.150737+0000", 2023-08-01T19:55:31.694 INFO:teuthology.orchestra.run.smithi008.stdout: "duration": 0 2023-08-01T19:55:31.694 INFO:teuthology.orchestra.run.smithi008.stdout: }, 2023-08-01T19:55:31.694 INFO:teuthology.orchestra.run.smithi008.stdout: { 2023-08-01T19:55:31.694 INFO:teuthology.orchestra.run.smithi008.stdout: "event": "throttled", 2023-08-01T19:55:31.694 INFO:teuthology.orchestra.run.smithi008.stdout: "time": "2023-08-01T19:55:05.150737+0000", 2023-08-01T19:55:31.694 INFO:teuthology.orchestra.run.smithi008.stdout: "duration": 0 2023-08-01T19:55:31.694 INFO:teuthology.orchestra.run.smithi008.stdout: }, 2023-08-01T19:55:31.695 INFO:teuthology.orchestra.run.smithi008.stdout: { 2023-08-01T19:55:31.695 INFO:teuthology.orchestra.run.smithi008.stdout: "event": "header_read", 2023-08-01T19:55:31.695 INFO:teuthology.orchestra.run.smithi008.stdout: "time": "2023-08-01T19:55:05.150736+0000", 2023-08-01T19:55:31.695 INFO:teuthology.orchestra.run.smithi008.stdout: "duration": 4294967295.999999 2023-08-01T19:55:31.695 INFO:teuthology.orchestra.run.smithi008.stdout: }, 2023-08-01T19:55:31.695 INFO:teuthology.orchestra.run.smithi008.stdout: { 2023-08-01T19:55:31.695 INFO:teuthology.orchestra.run.smithi008.stdout: "event": "all_read", 2023-08-01T19:55:31.695 INFO:teuthology.orchestra.run.smithi008.stdout: "time": "2023-08-01T19:55:05.150780+0000", 2023-08-01T19:55:31.696 INFO:teuthology.orchestra.run.smithi008.stdout: "duration": 4.3578999999999997e-05 2023-08-01T19:55:31.696 INFO:teuthology.orchestra.run.smithi008.stdout: }, 2023-08-01T19:55:31.696 INFO:teuthology.orchestra.run.smithi008.stdout: { 2023-08-01T19:55:31.696 INFO:teuthology.orchestra.run.smithi008.stdout: "event": "dispatched", 2023-08-01T19:55:31.696 INFO:teuthology.orchestra.run.smithi008.stdout: "time": "2023-08-01T19:55:05.150791+0000", 2023-08-01T19:55:31.696 INFO:teuthology.orchestra.run.smithi008.stdout: "duration": 1.0963e-05 2023-08-01T19:55:31.696 INFO:teuthology.orchestra.run.smithi008.stdout: }, 2023-08-01T19:55:31.697 INFO:teuthology.orchestra.run.smithi008.stdout: { 2023-08-01T19:55:31.697 INFO:teuthology.orchestra.run.smithi008.stdout: "event": "queued_for_pg", 2023-08-01T19:55:31.697 INFO:teuthology.orchestra.run.smithi008.stdout: "time": "2023-08-01T19:55:05.150797+0000", 2023-08-01T19:55:31.697 INFO:teuthology.orchestra.run.smithi008.stdout: "duration": 5.9780000000000002e-06 2023-08-01T19:55:31.697 INFO:teuthology.orchestra.run.smithi008.stdout: }, 2023-08-01T19:55:31.697 INFO:teuthology.orchestra.run.smithi008.stdout: { 2023-08-01T19:55:31.697 INFO:teuthology.orchestra.run.smithi008.stdout: "event": "reached_pg", 2023-08-01T19:55:31.697 INFO:teuthology.orchestra.run.smithi008.stdout: "time": "2023-08-01T19:55:05.150833+0000", 2023-08-01T19:55:31.698 INFO:teuthology.orchestra.run.smithi008.stdout: "duration": 3.6000000000000001e-05 2023-08-01T19:55:31.698 INFO:teuthology.orchestra.run.smithi008.stdout: }, 2023-08-01T19:55:31.698 INFO:teuthology.orchestra.run.smithi008.stdout: { 2023-08-01T19:55:31.698 INFO:teuthology.orchestra.run.smithi008.stdout: "event": "started", 2023-08-01T19:55:31.698 INFO:teuthology.orchestra.run.smithi008.stdout: "time": "2023-08-01T19:55:05.150951+0000", 2023-08-01T19:55:31.698 INFO:teuthology.orchestra.run.smithi008.stdout: "duration": 0.00011827799999999999 2023-08-01T19:55:31.698 INFO:teuthology.orchestra.run.smithi008.stdout: }, 2023-08-01T19:55:31.698 INFO:teuthology.orchestra.run.smithi008.stdout: { 2023-08-01T19:55:31.699 INFO:teuthology.orchestra.run.smithi008.stdout: "event": "waiting for subops from 2", 2023-08-01T19:55:31.699 INFO:teuthology.orchestra.run.smithi008.stdout: "time": "2023-08-01T19:55:05.151111+0000", 2023-08-01T19:55:31.699 INFO:teuthology.orchestra.run.smithi008.stdout: "duration": 0.00015961299999999999 2023-08-01T19:55:31.699 INFO:teuthology.orchestra.run.smithi008.stdout: }, 2023-08-01T19:55:31.699 INFO:teuthology.orchestra.run.smithi008.stdout: { 2023-08-01T19:55:31.699 INFO:teuthology.orchestra.run.smithi008.stdout: "event": "op_commit", 2023-08-01T19:55:31.699 INFO:teuthology.orchestra.run.smithi008.stdout: "time": "2023-08-01T19:55:05.156247+0000", 2023-08-01T19:55:31.700 INFO:teuthology.orchestra.run.smithi008.stdout: "duration": 0.005136524 2023-08-01T19:55:31.700 INFO:teuthology.orchestra.run.smithi008.stdout: }, 2023-08-01T19:55:31.700 INFO:teuthology.orchestra.run.smithi008.stdout: { 2023-08-01T19:55:31.700 INFO:teuthology.orchestra.run.smithi008.stdout: "event": "sub_op_commit_rec", 2023-08-01T19:55:31.700 INFO:teuthology.orchestra.run.smithi008.stdout: "time": "2023-08-01T19:55:05.225705+0000", 2023-08-01T19:55:31.700 INFO:teuthology.orchestra.run.smithi008.stdout: "duration": 0.069458377000000002 2023-08-01T19:55:31.700 INFO:teuthology.orchestra.run.smithi008.stdout: }, 2023-08-01T19:55:31.700 INFO:teuthology.orchestra.run.smithi008.stdout: { 2023-08-01T19:55:31.701 INFO:teuthology.orchestra.run.smithi008.stdout: "event": "commit_sent", 2023-08-01T19:55:31.701 INFO:teuthology.orchestra.run.smithi008.stdout: "time": "2023-08-01T19:55:05.225736+0000", 2023-08-01T19:55:31.701 INFO:teuthology.orchestra.run.smithi008.stdout: "duration": 3.0388000000000001e-05 2023-08-01T19:55:31.701 INFO:teuthology.orchestra.run.smithi008.stdout: }, 2023-08-01T19:55:31.701 INFO:teuthology.orchestra.run.smithi008.stdout: { 2023-08-01T19:55:31.701 INFO:teuthology.orchestra.run.smithi008.stdout: "event": "done", 2023-08-01T19:55:31.701 INFO:teuthology.orchestra.run.smithi008.stdout: "time": "2023-08-01T19:55:05.225757+0000", 2023-08-01T19:55:31.702 INFO:teuthology.orchestra.run.smithi008.stdout: "duration": 2.1090999999999998e-05 2023-08-01T19:55:31.702 INFO:teuthology.orchestra.run.smithi008.stdout: } 2023-08-01T19:55:31.702 INFO:teuthology.orchestra.run.smithi008.stdout: ] 2023-08-01T19:55:31.702 INFO:teuthology.orchestra.run.smithi008.stdout: } 2023-08-01T19:55:31.702 INFO:teuthology.orchestra.run.smithi008.stdout: }, 2023-08-01T19:55:31.702 INFO:teuthology.orchestra.run.smithi008.stdout: { 2023-08-01T19:55:31.702 INFO:teuthology.orchestra.run.smithi008.stdout: "description": "osd_op(client.4668.0:100261 5.a 5:562deedb:::benchmark_data_smithi006_114134_object100260:head [set-alloc-hint object_size 65536 write_size 65536,write 0~65536] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e37)", 2023-08-01T19:55:31.702 INFO:teuthology.orchestra.run.smithi008.stdout: "initiated_at": "2023-08-01T19:55:05.163316+0000", 2023-08-01T19:55:31.703 INFO:teuthology.orchestra.run.smithi008.stdout: "age": 26.513978279, 2023-08-01T19:55:31.703 INFO:teuthology.orchestra.run.smithi008.stdout: "duration": 0.063073012999999997, 2023-08-01T19:55:31.703 INFO:teuthology.orchestra.run.smithi008.stdout: "type_data": { 2023-08-01T19:55:31.703 INFO:teuthology.orchestra.run.smithi008.stdout: "flag_point": "commit sent; apply or cleanup", 2023-08-01T19:55:31.703 INFO:teuthology.orchestra.run.smithi008.stdout: "client_info": { 2023-08-01T19:55:31.703 INFO:teuthology.orchestra.run.smithi008.stdout: "client": "client.4668", 2023-08-01T19:55:31.703 INFO:teuthology.orchestra.run.smithi008.stdout: "client_addr": "172.21.15.6:0/1709472247", 2023-08-01T19:55:31.704 INFO:teuthology.orchestra.run.smithi008.stdout: "tid": 100261 2023-08-01T19:55:31.704 INFO:teuthology.orchestra.run.smithi008.stdout: }, 2023-08-01T19:55:31.704 INFO:teuthology.orchestra.run.smithi008.stdout: "events": [ 2023-08-01T19:55:31.704 INFO:teuthology.orchestra.run.smithi008.stdout: { 2023-08-01T19:55:31.704 INFO:teuthology.orchestra.run.smithi008.stdout: "event": "initiated", 2023-08-01T19:55:31.704 INFO:teuthology.orchestra.run.smithi008.stdout: "time": "2023-08-01T19:55:05.163316+0000", 2023-08-01T19:55:31.704 INFO:teuthology.orchestra.run.smithi008.stdout: "duration": 0 2023-08-01T19:55:31.704 INFO:teuthology.orchestra.run.smithi008.stdout: }, 2023-08-01T19:55:31.705 INFO:teuthology.orchestra.run.smithi008.stdout: { 2023-08-01T19:55:31.705 INFO:teuthology.orchestra.run.smithi008.stdout: "event": "throttled", 2023-08-01T19:55:31.705 INFO:teuthology.orchestra.run.smithi008.stdout: "time": "2023-08-01T19:55:05.163316+0000", 2023-08-01T19:55:31.705 INFO:teuthology.orchestra.run.smithi008.stdout: "duration": 0 2023-08-01T19:55:31.705 INFO:teuthology.orchestra.run.smithi008.stdout: }, 2023-08-01T19:55:31.705 INFO:teuthology.orchestra.run.smithi008.stdout: { 2023-08-01T19:55:31.705 INFO:teuthology.orchestra.run.smithi008.stdout: "event": "header_read", 2023-08-01T19:55:31.706 INFO:teuthology.orchestra.run.smithi008.stdout: "time": "2023-08-01T19:55:05.163316+0000", 2023-08-01T19:55:31.706 INFO:teuthology.orchestra.run.smithi008.stdout: "duration": 4294967295.999999 2023-08-01T19:55:31.706 INFO:teuthology.orchestra.run.smithi008.stdout: }, 2023-08-01T19:55:31.706 INFO:teuthology.orchestra.run.smithi008.stdout: { 2023-08-01T19:55:31.706 INFO:teuthology.orchestra.run.smithi008.stdout: "event": "all_read", 2023-08-01T19:55:31.706 INFO:teuthology.orchestra.run.smithi008.stdout: "time": "2023-08-01T19:55:05.163380+0000", 2023-08-01T19:55:31.706 INFO:teuthology.orchestra.run.smithi008.stdout: "duration": 6.4395999999999998e-05 2023-08-01T19:55:31.706 INFO:teuthology.orchestra.run.smithi008.stdout: }, 2023-08-01T19:55:31.707 INFO:teuthology.orchestra.run.smithi008.stdout: { 2023-08-01T19:55:31.707 INFO:teuthology.orchestra.run.smithi008.stdout: "event": "dispatched", 2023-08-01T19:55:31.707 INFO:teuthology.orchestra.run.smithi008.stdout: "time": "2023-08-01T19:55:05.163390+0000", 2023-08-01T19:55:31.707 INFO:teuthology.orchestra.run.smithi008.stdout: "duration": 1.0189e-05 2023-08-01T19:55:31.707 INFO:teuthology.orchestra.run.smithi008.stdout: }, 2023-08-01T19:55:31.707 INFO:teuthology.orchestra.run.smithi008.stdout: { 2023-08-01T19:55:31.707 INFO:teuthology.orchestra.run.smithi008.stdout: "event": "queued_for_pg", 2023-08-01T19:55:31.708 INFO:teuthology.orchestra.run.smithi008.stdout: "time": "2023-08-01T19:55:05.163395+0000", 2023-08-01T19:55:31.708 INFO:teuthology.orchestra.run.smithi008.stdout: "duration": 4.4059999999999998e-06 2023-08-01T19:55:31.708 INFO:teuthology.orchestra.run.smithi008.stdout: }, 2023-08-01T19:55:31.708 INFO:teuthology.orchestra.run.smithi008.stdout: { 2023-08-01T19:55:31.708 INFO:teuthology.orchestra.run.smithi008.stdout: "event": "reached_pg", 2023-08-01T19:55:31.708 INFO:teuthology.orchestra.run.smithi008.stdout: "time": "2023-08-01T19:55:05.163429+0000", 2023-08-01T19:55:31.708 INFO:teuthology.orchestra.run.smithi008.stdout: "duration": 3.4900000000000001e-05 2023-08-01T19:55:31.709 INFO:teuthology.orchestra.run.smithi008.stdout: }, 2023-08-01T19:55:31.709 INFO:teuthology.orchestra.run.smithi008.stdout: { 2023-08-01T19:55:31.709 INFO:teuthology.orchestra.run.smithi008.stdout: "event": "started", 2023-08-01T19:55:31.709 INFO:teuthology.orchestra.run.smithi008.stdout: "time": "2023-08-01T19:55:05.163512+0000", 2023-08-01T19:55:31.709 INFO:teuthology.orchestra.run.smithi008.stdout: "duration": 8.2987999999999999e-05 2023-08-01T19:55:31.709 INFO:teuthology.orchestra.run.smithi008.stdout: }, 2023-08-01T19:55:31.709 INFO:teuthology.orchestra.run.smithi008.stdout: { 2023-08-01T19:55:31.709 INFO:teuthology.orchestra.run.smithi008.stdout: "event": "waiting for subops from 2", 2023-08-01T19:55:31.710 INFO:teuthology.orchestra.run.smithi008.stdout: "time": "2023-08-01T19:55:05.163596+0000", 2023-08-01T19:55:31.710 INFO:teuthology.orchestra.run.smithi008.stdout: "duration": 8.3783999999999996e-05 2023-08-01T19:55:31.710 INFO:teuthology.orchestra.run.smithi008.stdout: }, 2023-08-01T19:55:31.710 INFO:teuthology.orchestra.run.smithi008.stdout: { 2023-08-01T19:55:31.710 INFO:teuthology.orchestra.run.smithi008.stdout: "event": "op_commit", 2023-08-01T19:55:31.710 INFO:teuthology.orchestra.run.smithi008.stdout: "time": "2023-08-01T19:55:05.167129+0000", 2023-08-01T19:55:31.710 INFO:teuthology.orchestra.run.smithi008.stdout: "duration": 0.0035328709999999999 2023-08-01T19:55:31.710 INFO:teuthology.orchestra.run.smithi008.stdout: }, 2023-08-01T19:55:31.711 INFO:teuthology.orchestra.run.smithi008.stdout: { 2023-08-01T19:55:31.711 INFO:teuthology.orchestra.run.smithi008.stdout: "event": "sub_op_commit_rec", 2023-08-01T19:55:31.711 INFO:teuthology.orchestra.run.smithi008.stdout: "time": "2023-08-01T19:55:05.226302+0000", 2023-08-01T19:55:31.711 INFO:teuthology.orchestra.run.smithi008.stdout: "duration": 0.059172711000000003 2023-08-01T19:55:31.711 INFO:teuthology.orchestra.run.smithi008.stdout: }, 2023-08-01T19:55:31.711 INFO:teuthology.orchestra.run.smithi008.stdout: { 2023-08-01T19:55:31.711 INFO:teuthology.orchestra.run.smithi008.stdout: "event": "commit_sent", 2023-08-01T19:55:31.711 INFO:teuthology.orchestra.run.smithi008.stdout: "time": "2023-08-01T19:55:05.226351+0000", 2023-08-01T19:55:31.712 INFO:teuthology.orchestra.run.smithi008.stdout: "duration": 4.969e-05 2023-08-01T19:55:31.712 INFO:teuthology.orchestra.run.smithi008.stdout: }, 2023-08-01T19:55:31.712 INFO:teuthology.orchestra.run.smithi008.stdout: { 2023-08-01T19:55:31.712 INFO:teuthology.orchestra.run.smithi008.stdout: "event": "done", 2023-08-01T19:55:31.712 INFO:teuthology.orchestra.run.smithi008.stdout: "time": "2023-08-01T19:55:05.226389+0000", 2023-08-01T19:55:31.712 INFO:teuthology.orchestra.run.smithi008.stdout: "duration": 3.7978000000000001e-05 2023-08-01T19:55:31.712 INFO:teuthology.orchestra.run.smithi008.stdout: } 2023-08-01T19:55:31.712 INFO:teuthology.orchestra.run.smithi008.stdout: ] 2023-08-01T19:55:31.713 INFO:teuthology.orchestra.run.smithi008.stdout: } 2023-08-01T19:55:31.713 INFO:teuthology.orchestra.run.smithi008.stdout: }, 2023-08-01T19:55:31.713 INFO:teuthology.orchestra.run.smithi008.stdout: { 2023-08-01T19:55:31.713 INFO:teuthology.orchestra.run.smithi008.stdout: "description": "osd_op(client.4668.0:100262 5.a 5:5c636b5d:::benchmark_data_smithi006_114134_object100261:head [set-alloc-hint object_size 65536 write_size 65536,write 0~65536] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e37)", 2023-08-01T19:55:31.713 INFO:teuthology.orchestra.run.smithi008.stdout: "initiated_at": "2023-08-01T19:55:05.165068+0000", 2023-08-01T19:55:31.713 INFO:teuthology.orchestra.run.smithi008.stdout: "age": 26.512226626, 2023-08-01T19:55:31.713 INFO:teuthology.orchestra.run.smithi008.stdout: "duration": 0.063919403, 2023-08-01T19:55:31.713 INFO:teuthology.orchestra.run.smithi008.stdout: "type_data": { 2023-08-01T19:55:31.714 INFO:teuthology.orchestra.run.smithi008.stdout: "flag_point": "commit sent; apply or cleanup", 2023-08-01T19:55:31.714 INFO:teuthology.orchestra.run.smithi008.stdout: "client_info": { 2023-08-01T19:55:31.714 INFO:teuthology.orchestra.run.smithi008.stdout: "client": "client.4668", 2023-08-01T19:55:31.714 INFO:teuthology.orchestra.run.smithi008.stdout: "client_addr": "172.21.15.6:0/1709472247", 2023-08-01T19:55:31.714 INFO:teuthology.orchestra.run.smithi008.stdout: "tid": 100262 2023-08-01T19:55:31.714 INFO:teuthology.orchestra.run.smithi008.stdout: }, 2023-08-01T19:55:31.714 INFO:teuthology.orchestra.run.smithi008.stdout: "events": [ 2023-08-01T19:55:31.714 INFO:teuthology.orchestra.run.smithi008.stdout: { 2023-08-01T19:55:31.715 INFO:teuthology.orchestra.run.smithi008.stdout: "event": "initiated", 2023-08-01T19:55:31.715 INFO:teuthology.orchestra.run.smithi008.stdout: "time": "2023-08-01T19:55:05.165068+0000", 2023-08-01T19:55:31.715 INFO:teuthology.orchestra.run.smithi008.stdout: "duration": 0 2023-08-01T19:55:31.715 INFO:teuthology.orchestra.run.smithi008.stdout: }, 2023-08-01T19:55:31.715 INFO:teuthology.orchestra.run.smithi008.stdout: { 2023-08-01T19:55:31.715 INFO:teuthology.orchestra.run.smithi008.stdout: "event": "throttled", 2023-08-01T19:55:31.715 INFO:teuthology.orchestra.run.smithi008.stdout: "time": "2023-08-01T19:55:05.165068+0000", 2023-08-01T19:55:31.715 INFO:teuthology.orchestra.run.smithi008.stdout: "duration": 0 2023-08-01T19:55:31.716 INFO:teuthology.orchestra.run.smithi008.stdout: }, 2023-08-01T19:55:31.716 INFO:teuthology.orchestra.run.smithi008.stdout: { 2023-08-01T19:55:31.716 INFO:teuthology.orchestra.run.smithi008.stdout: "event": "header_read", 2023-08-01T19:55:31.716 INFO:teuthology.orchestra.run.smithi008.stdout: "time": "2023-08-01T19:55:05.165067+0000", 2023-08-01T19:55:31.716 INFO:teuthology.orchestra.run.smithi008.stdout: "duration": 4294967295.999999 2023-08-01T19:55:31.716 INFO:teuthology.orchestra.run.smithi008.stdout: }, 2023-08-01T19:55:31.716 INFO:teuthology.orchestra.run.smithi008.stdout: { 2023-08-01T19:55:31.717 INFO:teuthology.orchestra.run.smithi008.stdout: "event": "all_read", 2023-08-01T19:55:31.717 INFO:teuthology.orchestra.run.smithi008.stdout: "time": "2023-08-01T19:55:05.165126+0000", 2023-08-01T19:55:31.717 INFO:teuthology.orchestra.run.smithi008.stdout: "duration": 5.9116000000000001e-05 2023-08-01T19:55:31.717 INFO:teuthology.orchestra.run.smithi008.stdout: }, 2023-08-01T19:55:31.717 INFO:teuthology.orchestra.run.smithi008.stdout: { 2023-08-01T19:55:31.717 INFO:teuthology.orchestra.run.smithi008.stdout: "event": "dispatched", 2023-08-01T19:55:31.717 INFO:teuthology.orchestra.run.smithi008.stdout: "time": "2023-08-01T19:55:05.165134+0000", 2023-08-01T19:55:31.718 INFO:teuthology.orchestra.run.smithi008.stdout: "duration": 7.9820000000000008e-06 2023-08-01T19:55:31.718 INFO:teuthology.orchestra.run.smithi008.stdout: }, 2023-08-01T19:55:31.718 INFO:teuthology.orchestra.run.smithi008.stdout: { 2023-08-01T19:55:31.718 INFO:teuthology.orchestra.run.smithi008.stdout: "event": "queued_for_pg", 2023-08-01T19:55:31.718 INFO:teuthology.orchestra.run.smithi008.stdout: "time": "2023-08-01T19:55:05.165139+0000", 2023-08-01T19:55:31.718 INFO:teuthology.orchestra.run.smithi008.stdout: "duration": 4.2560000000000004e-06 2023-08-01T19:55:31.718 INFO:teuthology.orchestra.run.smithi008.stdout: }, 2023-08-01T19:55:31.719 INFO:teuthology.orchestra.run.smithi008.stdout: { 2023-08-01T19:55:31.719 INFO:teuthology.orchestra.run.smithi008.stdout: "event": "reached_pg", 2023-08-01T19:55:31.719 INFO:teuthology.orchestra.run.smithi008.stdout: "time": "2023-08-01T19:55:05.165165+0000", 2023-08-01T19:55:31.719 INFO:teuthology.orchestra.run.smithi008.stdout: "duration": 2.6554e-05 2023-08-01T19:55:31.719 INFO:teuthology.orchestra.run.smithi008.stdout: }, 2023-08-01T19:55:31.719 INFO:teuthology.orchestra.run.smithi008.stdout: { 2023-08-01T19:55:31.719 INFO:teuthology.orchestra.run.smithi008.stdout: "event": "started", 2023-08-01T19:55:31.720 INFO:teuthology.orchestra.run.smithi008.stdout: "time": "2023-08-01T19:55:05.165243+0000", 2023-08-01T19:55:31.720 INFO:teuthology.orchestra.run.smithi008.stdout: "duration": 7.7877e-05 2023-08-01T19:55:31.720 INFO:teuthology.orchestra.run.smithi008.stdout: }, 2023-08-01T19:55:31.720 INFO:teuthology.orchestra.run.smithi008.stdout: { 2023-08-01T19:55:31.720 INFO:teuthology.orchestra.run.smithi008.stdout: "event": "waiting for subops from 2", 2023-08-01T19:55:31.720 INFO:teuthology.orchestra.run.smithi008.stdout: "time": "2023-08-01T19:55:05.165450+0000", 2023-08-01T19:55:31.720 INFO:teuthology.orchestra.run.smithi008.stdout: "duration": 0.00020655599999999999 2023-08-01T19:55:31.721 INFO:teuthology.orchestra.run.smithi008.stdout: }, 2023-08-01T19:55:31.721 INFO:teuthology.orchestra.run.smithi008.stdout: { 2023-08-01T19:55:31.721 INFO:teuthology.orchestra.run.smithi008.stdout: "event": "op_commit", 2023-08-01T19:55:31.721 INFO:teuthology.orchestra.run.smithi008.stdout: "time": "2023-08-01T19:55:05.168883+0000", 2023-08-01T19:55:31.721 INFO:teuthology.orchestra.run.smithi008.stdout: "duration": 0.0034333279999999998 2023-08-01T19:55:31.721 INFO:teuthology.orchestra.run.smithi008.stdout: }, 2023-08-01T19:55:31.721 INFO:teuthology.orchestra.run.smithi008.stdout: { 2023-08-01T19:55:31.721 INFO:teuthology.orchestra.run.smithi008.stdout: "event": "sub_op_commit_rec", 2023-08-01T19:55:31.722 INFO:teuthology.orchestra.run.smithi008.stdout: "time": "2023-08-01T19:55:05.228904+0000", 2023-08-01T19:55:31.722 INFO:teuthology.orchestra.run.smithi008.stdout: "duration": 0.060021370999999997 2023-08-01T19:55:31.722 INFO:teuthology.orchestra.run.smithi008.stdout: }, 2023-08-01T19:55:31.722 INFO:teuthology.orchestra.run.smithi008.stdout: { 2023-08-01T19:55:31.722 INFO:teuthology.orchestra.run.smithi008.stdout: "event": "commit_sent", 2023-08-01T19:55:31.722 INFO:teuthology.orchestra.run.smithi008.stdout: "time": "2023-08-01T19:55:05.228952+0000", 2023-08-01T19:55:31.722 INFO:teuthology.orchestra.run.smithi008.stdout: "duration": 4.8056999999999997e-05 2023-08-01T19:55:31.723 INFO:teuthology.orchestra.run.smithi008.stdout: }, 2023-08-01T19:55:31.723 INFO:teuthology.orchestra.run.smithi008.stdout: { 2023-08-01T19:55:31.723 INFO:teuthology.orchestra.run.smithi008.stdout: "event": "done", 2023-08-01T19:55:31.723 INFO:teuthology.orchestra.run.smithi008.stdout: "time": "2023-08-01T19:55:05.228987+0000", 2023-08-01T19:55:31.723 INFO:teuthology.orchestra.run.smithi008.stdout: "duration": 3.5083000000000003e-05 2023-08-01T19:55:31.723 INFO:teuthology.orchestra.run.smithi008.stdout: } 2023-08-01T19:55:31.723 INFO:teuthology.orchestra.run.smithi008.stdout: ] 2023-08-01T19:55:31.723 INFO:teuthology.orchestra.run.smithi008.stdout: } 2023-08-01T19:55:31.724 INFO:teuthology.orchestra.run.smithi008.stdout: }, 2023-08-01T19:55:31.724 INFO:teuthology.orchestra.run.smithi008.stdout: { 2023-08-01T19:55:31.724 INFO:teuthology.orchestra.run.smithi008.stdout: "description": "osd_op(client.4668.0:100929 5.3 5:c29f4adb:::benchmark_data_smithi006_114134_object100928:head [set-alloc-hint object_size 65536 write_size 65536,write 0~65536] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e37)", 2023-08-01T19:55:31.724 INFO:teuthology.orchestra.run.smithi008.stdout: "initiated_at": "2023-08-01T19:55:05.564759+0000", 2023-08-01T19:55:31.724 INFO:teuthology.orchestra.run.smithi008.stdout: "age": 26.112535987000001, 2023-08-01T19:55:31.724 INFO:teuthology.orchestra.run.smithi008.stdout: "duration": 0.062544635000000001, 2023-08-01T19:55:31.724 INFO:teuthology.orchestra.run.smithi008.stdout: "type_data": { 2023-08-01T19:55:31.724 INFO:teuthology.orchestra.run.smithi008.stdout: "flag_point": "commit sent; apply or cleanup", 2023-08-01T19:55:31.725 INFO:teuthology.orchestra.run.smithi008.stdout: "client_info": { 2023-08-01T19:55:31.725 INFO:teuthology.orchestra.run.smithi008.stdout: "client": "client.4668", 2023-08-01T19:55:31.725 INFO:teuthology.orchestra.run.smithi008.stdout: "client_addr": "172.21.15.6:0/1709472247", 2023-08-01T19:55:31.725 INFO:teuthology.orchestra.run.smithi008.stdout: "tid": 100929 2023-08-01T19:55:31.725 INFO:teuthology.orchestra.run.smithi008.stdout: }, 2023-08-01T19:55:31.725 INFO:teuthology.orchestra.run.smithi008.stdout: "events": [ 2023-08-01T19:55:31.725 INFO:teuthology.orchestra.run.smithi008.stdout: { 2023-08-01T19:55:31.725 INFO:teuthology.orchestra.run.smithi008.stdout: "event": "initiated", 2023-08-01T19:55:31.726 INFO:teuthology.orchestra.run.smithi008.stdout: "time": "2023-08-01T19:55:05.564759+0000", 2023-08-01T19:55:31.726 INFO:teuthology.orchestra.run.smithi008.stdout: "duration": 0 2023-08-01T19:55:31.726 INFO:teuthology.orchestra.run.smithi008.stdout: }, 2023-08-01T19:55:31.726 INFO:teuthology.orchestra.run.smithi008.stdout: { 2023-08-01T19:55:31.726 INFO:teuthology.orchestra.run.smithi008.stdout: "event": "throttled", 2023-08-01T19:55:31.726 INFO:teuthology.orchestra.run.smithi008.stdout: "time": "2023-08-01T19:55:05.564759+0000", 2023-08-01T19:55:31.726 INFO:teuthology.orchestra.run.smithi008.stdout: "duration": 0 2023-08-01T19:55:31.726 INFO:teuthology.orchestra.run.smithi008.stdout: }, 2023-08-01T19:55:31.727 INFO:teuthology.orchestra.run.smithi008.stdout: { 2023-08-01T19:55:31.727 INFO:teuthology.orchestra.run.smithi008.stdout: "event": "header_read", 2023-08-01T19:55:31.727 INFO:teuthology.orchestra.run.smithi008.stdout: "time": "2023-08-01T19:55:05.564758+0000", 2023-08-01T19:55:31.727 INFO:teuthology.orchestra.run.smithi008.stdout: "duration": 4294967295.999999 2023-08-01T19:55:31.727 INFO:teuthology.orchestra.run.smithi008.stdout: }, 2023-08-01T19:55:31.727 INFO:teuthology.orchestra.run.smithi008.stdout: { 2023-08-01T19:55:31.727 INFO:teuthology.orchestra.run.smithi008.stdout: "event": "all_read", 2023-08-01T19:55:31.727 INFO:teuthology.orchestra.run.smithi008.stdout: "time": "2023-08-01T19:55:05.564815+0000", 2023-08-01T19:55:31.728 INFO:teuthology.orchestra.run.smithi008.stdout: "duration": 5.7757000000000003e-05 2023-08-01T19:55:31.728 INFO:teuthology.orchestra.run.smithi008.stdout: }, 2023-08-01T19:55:31.728 INFO:teuthology.orchestra.run.smithi008.stdout: { 2023-08-01T19:55:31.728 INFO:teuthology.orchestra.run.smithi008.stdout: "event": "dispatched", 2023-08-01T19:55:31.728 INFO:teuthology.orchestra.run.smithi008.stdout: "time": "2023-08-01T19:55:05.564824+0000", 2023-08-01T19:55:31.728 INFO:teuthology.orchestra.run.smithi008.stdout: "duration": 8.6559999999999998e-06 2023-08-01T19:55:31.728 INFO:teuthology.orchestra.run.smithi008.stdout: }, 2023-08-01T19:55:31.728 INFO:teuthology.orchestra.run.smithi008.stdout: { 2023-08-01T19:55:31.729 INFO:teuthology.orchestra.run.smithi008.stdout: "event": "queued_for_pg", 2023-08-01T19:55:31.729 INFO:teuthology.orchestra.run.smithi008.stdout: "time": "2023-08-01T19:55:05.564829+0000", 2023-08-01T19:55:31.729 INFO:teuthology.orchestra.run.smithi008.stdout: "duration": 4.6160000000000004e-06 2023-08-01T19:55:31.729 INFO:teuthology.orchestra.run.smithi008.stdout: }, 2023-08-01T19:55:31.729 INFO:teuthology.orchestra.run.smithi008.stdout: { 2023-08-01T19:55:31.729 INFO:teuthology.orchestra.run.smithi008.stdout: "event": "reached_pg", 2023-08-01T19:55:31.729 INFO:teuthology.orchestra.run.smithi008.stdout: "time": "2023-08-01T19:55:05.564871+0000", 2023-08-01T19:55:31.729 INFO:teuthology.orchestra.run.smithi008.stdout: "duration": 4.2206000000000002e-05 2023-08-01T19:55:31.730 INFO:teuthology.orchestra.run.smithi008.stdout: }, 2023-08-01T19:55:31.730 INFO:teuthology.orchestra.run.smithi008.stdout: { 2023-08-01T19:55:31.730 INFO:teuthology.orchestra.run.smithi008.stdout: "event": "started", 2023-08-01T19:55:31.730 INFO:teuthology.orchestra.run.smithi008.stdout: "time": "2023-08-01T19:55:05.565011+0000", 2023-08-01T19:55:31.730 INFO:teuthology.orchestra.run.smithi008.stdout: "duration": 0.000140469 2023-08-01T19:55:31.730 INFO:teuthology.orchestra.run.smithi008.stdout: }, 2023-08-01T19:55:31.730 INFO:teuthology.orchestra.run.smithi008.stdout: { 2023-08-01T19:55:31.731 INFO:teuthology.orchestra.run.smithi008.stdout: "event": "waiting for subops from 1", 2023-08-01T19:55:31.731 INFO:teuthology.orchestra.run.smithi008.stdout: "time": "2023-08-01T19:55:05.565212+0000", 2023-08-01T19:55:31.731 INFO:teuthology.orchestra.run.smithi008.stdout: "duration": 0.00020106599999999999 2023-08-01T19:55:31.731 INFO:teuthology.orchestra.run.smithi008.stdout: }, 2023-08-01T19:55:31.731 INFO:teuthology.orchestra.run.smithi008.stdout: { 2023-08-01T19:55:31.731 INFO:teuthology.orchestra.run.smithi008.stdout: "event": "sub_op_commit_rec", 2023-08-01T19:55:31.731 INFO:teuthology.orchestra.run.smithi008.stdout: "time": "2023-08-01T19:55:05.626925+0000", 2023-08-01T19:55:31.731 INFO:teuthology.orchestra.run.smithi008.stdout: "duration": 0.061712111 2023-08-01T19:55:31.732 INFO:teuthology.orchestra.run.smithi008.stdout: }, 2023-08-01T19:55:31.732 INFO:teuthology.orchestra.run.smithi008.stdout: { 2023-08-01T19:55:31.732 INFO:teuthology.orchestra.run.smithi008.stdout: "event": "op_commit", 2023-08-01T19:55:31.732 INFO:teuthology.orchestra.run.smithi008.stdout: "time": "2023-08-01T19:55:05.627217+0000", 2023-08-01T19:55:31.732 INFO:teuthology.orchestra.run.smithi008.stdout: "duration": 0.00029265999999999998 2023-08-01T19:55:31.732 INFO:teuthology.orchestra.run.smithi008.stdout: }, 2023-08-01T19:55:31.732 INFO:teuthology.orchestra.run.smithi008.stdout: { 2023-08-01T19:55:31.732 INFO:teuthology.orchestra.run.smithi008.stdout: "event": "commit_sent", 2023-08-01T19:55:31.733 INFO:teuthology.orchestra.run.smithi008.stdout: "time": "2023-08-01T19:55:05.627264+0000", 2023-08-01T19:55:31.733 INFO:teuthology.orchestra.run.smithi008.stdout: "duration": 4.6260000000000001e-05 2023-08-01T19:55:31.733 INFO:teuthology.orchestra.run.smithi008.stdout: }, 2023-08-01T19:55:31.733 INFO:teuthology.orchestra.run.smithi008.stdout: { 2023-08-01T19:55:31.733 INFO:teuthology.orchestra.run.smithi008.stdout: "event": "done", 2023-08-01T19:55:31.733 INFO:teuthology.orchestra.run.smithi008.stdout: "time": "2023-08-01T19:55:05.627303+0000", 2023-08-01T19:55:31.733 INFO:teuthology.orchestra.run.smithi008.stdout: "duration": 3.9839999999999998e-05 2023-08-01T19:55:31.733 INFO:teuthology.orchestra.run.smithi008.stdout: } 2023-08-01T19:55:31.734 INFO:teuthology.orchestra.run.smithi008.stdout: ] 2023-08-01T19:55:31.734 INFO:teuthology.orchestra.run.smithi008.stdout: } 2023-08-01T19:55:31.734 INFO:teuthology.orchestra.run.smithi008.stdout: }, 2023-08-01T19:55:31.734 INFO:teuthology.orchestra.run.smithi008.stdout: { 2023-08-01T19:55:31.734 INFO:teuthology.orchestra.run.smithi008.stdout: "description": "osd_repop(client.4668.0:100928 5.7 e37/19 5:e61a7dfa:::benchmark_data_smithi006_114134_object100927:head v 37'6273, mlcod=37'6270)", 2023-08-01T19:55:31.734 INFO:teuthology.orchestra.run.smithi008.stdout: "initiated_at": "2023-08-01T19:55:05.565106+0000", 2023-08-01T19:55:31.734 INFO:teuthology.orchestra.run.smithi008.stdout: "age": 26.112188888999999, 2023-08-01T19:55:31.734 INFO:teuthology.orchestra.run.smithi008.stdout: "duration": 0.064091282999999999, 2023-08-01T19:55:31.735 INFO:teuthology.orchestra.run.smithi008.stdout: "type_data": { 2023-08-01T19:55:31.735 INFO:teuthology.orchestra.run.smithi008.stdout: "flag_point": "commit sent; apply or cleanup", 2023-08-01T19:55:31.735 INFO:teuthology.orchestra.run.smithi008.stdout: "events": [ 2023-08-01T19:55:31.735 INFO:teuthology.orchestra.run.smithi008.stdout: { 2023-08-01T19:55:31.735 INFO:teuthology.orchestra.run.smithi008.stdout: "event": "initiated", 2023-08-01T19:55:31.735 INFO:teuthology.orchestra.run.smithi008.stdout: "time": "2023-08-01T19:55:05.565106+0000", 2023-08-01T19:55:31.735 INFO:teuthology.orchestra.run.smithi008.stdout: "duration": 0 2023-08-01T19:55:31.735 INFO:teuthology.orchestra.run.smithi008.stdout: }, 2023-08-01T19:55:31.736 INFO:teuthology.orchestra.run.smithi008.stdout: { 2023-08-01T19:55:31.736 INFO:teuthology.orchestra.run.smithi008.stdout: "event": "throttled", 2023-08-01T19:55:31.736 INFO:teuthology.orchestra.run.smithi008.stdout: "time": "2023-08-01T19:55:05.565106+0000", 2023-08-01T19:55:31.736 INFO:teuthology.orchestra.run.smithi008.stdout: "duration": 0 2023-08-01T19:55:31.736 INFO:teuthology.orchestra.run.smithi008.stdout: }, 2023-08-01T19:55:31.736 INFO:teuthology.orchestra.run.smithi008.stdout: { 2023-08-01T19:55:31.736 INFO:teuthology.orchestra.run.smithi008.stdout: "event": "header_read", 2023-08-01T19:55:31.737 INFO:teuthology.orchestra.run.smithi008.stdout: "time": "2023-08-01T19:55:05.565105+0000", 2023-08-01T19:55:31.737 INFO:teuthology.orchestra.run.smithi008.stdout: "duration": 4294967295.9999995 2023-08-01T19:55:31.737 INFO:teuthology.orchestra.run.smithi008.stdout: }, 2023-08-01T19:55:31.737 INFO:teuthology.orchestra.run.smithi008.stdout: { 2023-08-01T19:55:31.737 INFO:teuthology.orchestra.run.smithi008.stdout: "event": "all_read", 2023-08-01T19:55:31.737 INFO:teuthology.orchestra.run.smithi008.stdout: "time": "2023-08-01T19:55:05.565173+0000", 2023-08-01T19:55:31.737 INFO:teuthology.orchestra.run.smithi008.stdout: "duration": 6.8186000000000001e-05 2023-08-01T19:55:31.737 INFO:teuthology.orchestra.run.smithi008.stdout: }, 2023-08-01T19:55:31.738 INFO:teuthology.orchestra.run.smithi008.stdout: { 2023-08-01T19:55:31.738 INFO:teuthology.orchestra.run.smithi008.stdout: "event": "dispatched", 2023-08-01T19:55:31.738 INFO:teuthology.orchestra.run.smithi008.stdout: "time": "2023-08-01T19:55:05.565182+0000", 2023-08-01T19:55:31.738 INFO:teuthology.orchestra.run.smithi008.stdout: "duration": 8.3620000000000006e-06 2023-08-01T19:55:31.738 INFO:teuthology.orchestra.run.smithi008.stdout: }, 2023-08-01T19:55:31.738 INFO:teuthology.orchestra.run.smithi008.stdout: { 2023-08-01T19:55:31.738 INFO:teuthology.orchestra.run.smithi008.stdout: "event": "queued_for_pg", 2023-08-01T19:55:31.738 INFO:teuthology.orchestra.run.smithi008.stdout: "time": "2023-08-01T19:55:05.565186+0000", 2023-08-01T19:55:31.739 INFO:teuthology.orchestra.run.smithi008.stdout: "duration": 3.7680000000000002e-06 2023-08-01T19:55:31.739 INFO:teuthology.orchestra.run.smithi008.stdout: }, 2023-08-01T19:55:31.739 INFO:teuthology.orchestra.run.smithi008.stdout: { 2023-08-01T19:55:31.739 INFO:teuthology.orchestra.run.smithi008.stdout: "event": "reached_pg", 2023-08-01T19:55:31.739 INFO:teuthology.orchestra.run.smithi008.stdout: "time": "2023-08-01T19:55:05.565212+0000", 2023-08-01T19:55:31.739 INFO:teuthology.orchestra.run.smithi008.stdout: "duration": 2.6230000000000001e-05 2023-08-01T19:55:31.739 INFO:teuthology.orchestra.run.smithi008.stdout: }, 2023-08-01T19:55:31.739 INFO:teuthology.orchestra.run.smithi008.stdout: { 2023-08-01T19:55:31.740 INFO:teuthology.orchestra.run.smithi008.stdout: "event": "started", 2023-08-01T19:55:31.740 INFO:teuthology.orchestra.run.smithi008.stdout: "time": "2023-08-01T19:55:05.565224+0000", 2023-08-01T19:55:31.740 INFO:teuthology.orchestra.run.smithi008.stdout: "duration": 1.2033e-05 2023-08-01T19:55:31.740 INFO:teuthology.orchestra.run.smithi008.stdout: }, 2023-08-01T19:55:31.740 INFO:teuthology.orchestra.run.smithi008.stdout: { 2023-08-01T19:55:31.740 INFO:teuthology.orchestra.run.smithi008.stdout: "event": "commit_sent", 2023-08-01T19:55:31.740 INFO:teuthology.orchestra.run.smithi008.stdout: "time": "2023-08-01T19:55:05.629152+0000", 2023-08-01T19:55:31.740 INFO:teuthology.orchestra.run.smithi008.stdout: "duration": 0.063928378999999994 2023-08-01T19:55:31.741 INFO:teuthology.orchestra.run.smithi008.stdout: }, 2023-08-01T19:55:31.741 INFO:teuthology.orchestra.run.smithi008.stdout: { 2023-08-01T19:55:31.741 INFO:teuthology.orchestra.run.smithi008.stdout: "event": "done", 2023-08-01T19:55:31.741 INFO:teuthology.orchestra.run.smithi008.stdout: "time": "2023-08-01T19:55:05.629197+0000", 2023-08-01T19:55:31.741 INFO:teuthology.orchestra.run.smithi008.stdout: "duration": 4.4894000000000001e-05 2023-08-01T19:55:31.741 INFO:teuthology.orchestra.run.smithi008.stdout: } 2023-08-01T19:55:31.741 INFO:teuthology.orchestra.run.smithi008.stdout: ] 2023-08-01T19:55:31.741 INFO:teuthology.orchestra.run.smithi008.stdout: } 2023-08-01T19:55:31.742 INFO:teuthology.orchestra.run.smithi008.stdout: }, 2023-08-01T19:55:31.742 INFO:teuthology.orchestra.run.smithi008.stdout: { 2023-08-01T19:55:31.742 INFO:teuthology.orchestra.run.smithi008.stdout: "description": "osd_repop(client.4668.0:100927 5.0 e37/19 5:00608ec6:::benchmark_data_smithi006_114134_object100926:head v 37'6408, mlcod=37'6403)", 2023-08-01T19:55:31.742 INFO:teuthology.orchestra.run.smithi008.stdout: "initiated_at": "2023-08-01T19:55:05.565153+0000", 2023-08-01T19:55:31.742 INFO:teuthology.orchestra.run.smithi008.stdout: "age": 26.112142152000001, 2023-08-01T19:55:31.742 INFO:teuthology.orchestra.run.smithi008.stdout: "duration": 0.062202714999999999, 2023-08-01T19:55:31.742 INFO:teuthology.orchestra.run.smithi008.stdout: "type_data": { 2023-08-01T19:55:31.742 INFO:teuthology.orchestra.run.smithi008.stdout: "flag_point": "commit sent; apply or cleanup", 2023-08-01T19:55:31.743 INFO:teuthology.orchestra.run.smithi008.stdout: "events": [ 2023-08-01T19:55:31.743 INFO:teuthology.orchestra.run.smithi008.stdout: { 2023-08-01T19:55:31.743 INFO:teuthology.orchestra.run.smithi008.stdout: "event": "initiated", 2023-08-01T19:55:31.743 INFO:teuthology.orchestra.run.smithi008.stdout: "time": "2023-08-01T19:55:05.565153+0000", 2023-08-01T19:55:31.743 INFO:teuthology.orchestra.run.smithi008.stdout: "duration": 0 2023-08-01T19:55:31.743 INFO:teuthology.orchestra.run.smithi008.stdout: }, 2023-08-01T19:55:31.743 INFO:teuthology.orchestra.run.smithi008.stdout: { 2023-08-01T19:55:31.743 INFO:teuthology.orchestra.run.smithi008.stdout: "event": "throttled", 2023-08-01T19:55:31.744 INFO:teuthology.orchestra.run.smithi008.stdout: "time": "2023-08-01T19:55:05.565153+0000", 2023-08-01T19:55:31.744 INFO:teuthology.orchestra.run.smithi008.stdout: "duration": 0 2023-08-01T19:55:31.744 INFO:teuthology.orchestra.run.smithi008.stdout: }, 2023-08-01T19:55:31.744 INFO:teuthology.orchestra.run.smithi008.stdout: { 2023-08-01T19:55:31.744 INFO:teuthology.orchestra.run.smithi008.stdout: "event": "header_read", 2023-08-01T19:55:31.744 INFO:teuthology.orchestra.run.smithi008.stdout: "time": "2023-08-01T19:55:05.565152+0000", 2023-08-01T19:55:31.744 INFO:teuthology.orchestra.run.smithi008.stdout: "duration": 4294967295.9999995 2023-08-01T19:55:31.745 INFO:teuthology.orchestra.run.smithi008.stdout: }, 2023-08-01T19:55:31.745 INFO:teuthology.orchestra.run.smithi008.stdout: { 2023-08-01T19:55:31.745 INFO:teuthology.orchestra.run.smithi008.stdout: "event": "all_read", 2023-08-01T19:55:31.745 INFO:teuthology.orchestra.run.smithi008.stdout: "time": "2023-08-01T19:55:05.565225+0000", 2023-08-01T19:55:31.745 INFO:teuthology.orchestra.run.smithi008.stdout: "duration": 7.2471000000000005e-05 2023-08-01T19:55:31.745 INFO:teuthology.orchestra.run.smithi008.stdout: }, 2023-08-01T19:55:31.745 INFO:teuthology.orchestra.run.smithi008.stdout: { 2023-08-01T19:55:31.745 INFO:teuthology.orchestra.run.smithi008.stdout: "event": "dispatched", 2023-08-01T19:55:31.746 INFO:teuthology.orchestra.run.smithi008.stdout: "time": "2023-08-01T19:55:05.565229+0000", 2023-08-01T19:55:31.746 INFO:teuthology.orchestra.run.smithi008.stdout: "duration": 4.5600000000000004e-06 2023-08-01T19:55:31.746 INFO:teuthology.orchestra.run.smithi008.stdout: }, 2023-08-01T19:55:31.746 INFO:teuthology.orchestra.run.smithi008.stdout: { 2023-08-01T19:55:31.746 INFO:teuthology.orchestra.run.smithi008.stdout: "event": "queued_for_pg", 2023-08-01T19:55:31.746 INFO:teuthology.orchestra.run.smithi008.stdout: "time": "2023-08-01T19:55:05.565232+0000", 2023-08-01T19:55:31.746 INFO:teuthology.orchestra.run.smithi008.stdout: "duration": 2.6900000000000001e-06 2023-08-01T19:55:31.747 INFO:teuthology.orchestra.run.smithi008.stdout: }, 2023-08-01T19:55:31.747 INFO:teuthology.orchestra.run.smithi008.stdout: { 2023-08-01T19:55:31.747 INFO:teuthology.orchestra.run.smithi008.stdout: "event": "reached_pg", 2023-08-01T19:55:31.747 INFO:teuthology.orchestra.run.smithi008.stdout: "time": "2023-08-01T19:55:05.565283+0000", 2023-08-01T19:55:31.747 INFO:teuthology.orchestra.run.smithi008.stdout: "duration": 5.1442e-05 2023-08-01T19:55:31.747 INFO:teuthology.orchestra.run.smithi008.stdout: }, 2023-08-01T19:55:31.747 INFO:teuthology.orchestra.run.smithi008.stdout: { 2023-08-01T19:55:31.747 INFO:teuthology.orchestra.run.smithi008.stdout: "event": "started", 2023-08-01T19:55:31.748 INFO:teuthology.orchestra.run.smithi008.stdout: "time": "2023-08-01T19:55:05.565301+0000", 2023-08-01T19:55:31.748 INFO:teuthology.orchestra.run.smithi008.stdout: "duration": 1.8029e-05 2023-08-01T19:55:31.748 INFO:teuthology.orchestra.run.smithi008.stdout: }, 2023-08-01T19:55:31.748 INFO:teuthology.orchestra.run.smithi008.stdout: { 2023-08-01T19:55:31.748 INFO:teuthology.orchestra.run.smithi008.stdout: "event": "commit_sent", 2023-08-01T19:55:31.748 INFO:teuthology.orchestra.run.smithi008.stdout: "time": "2023-08-01T19:55:05.627318+0000", 2023-08-01T19:55:31.748 INFO:teuthology.orchestra.run.smithi008.stdout: "duration": 0.062016763000000003 2023-08-01T19:55:31.748 INFO:teuthology.orchestra.run.smithi008.stdout: }, 2023-08-01T19:55:31.749 INFO:teuthology.orchestra.run.smithi008.stdout: { 2023-08-01T19:55:31.749 INFO:teuthology.orchestra.run.smithi008.stdout: "event": "done", 2023-08-01T19:55:31.749 INFO:teuthology.orchestra.run.smithi008.stdout: "time": "2023-08-01T19:55:05.627355+0000", 2023-08-01T19:55:31.749 INFO:teuthology.orchestra.run.smithi008.stdout: "duration": 3.7258999999999997e-05 2023-08-01T19:55:31.749 INFO:teuthology.orchestra.run.smithi008.stdout: } 2023-08-01T19:55:31.749 INFO:teuthology.orchestra.run.smithi008.stdout: ] 2023-08-01T19:55:31.749 INFO:teuthology.orchestra.run.smithi008.stdout: } 2023-08-01T19:55:31.749 INFO:teuthology.orchestra.run.smithi008.stdout: }, 2023-08-01T19:55:31.750 INFO:teuthology.orchestra.run.smithi008.stdout: { 2023-08-01T19:55:31.750 INFO:teuthology.orchestra.run.smithi008.stdout: "description": "osd_op(client.4668.0:100930 5.5 5:a7b64eb3:::benchmark_data_smithi006_114134_object100929:head [set-alloc-hint object_size 65536 write_size 65536,write 0~65536] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e37)", 2023-08-01T19:55:31.750 INFO:teuthology.orchestra.run.smithi008.stdout: "initiated_at": "2023-08-01T19:55:05.565766+0000", 2023-08-01T19:55:31.750 INFO:teuthology.orchestra.run.smithi008.stdout: "age": 26.111528366999998, 2023-08-01T19:55:31.750 INFO:teuthology.orchestra.run.smithi008.stdout: "duration": 0.063668735000000004, 2023-08-01T19:55:31.750 INFO:teuthology.orchestra.run.smithi008.stdout: "type_data": { 2023-08-01T19:55:31.750 INFO:teuthology.orchestra.run.smithi008.stdout: "flag_point": "commit sent; apply or cleanup", 2023-08-01T19:55:31.751 INFO:teuthology.orchestra.run.smithi008.stdout: "client_info": { 2023-08-01T19:55:31.751 INFO:teuthology.orchestra.run.smithi008.stdout: "client": "client.4668", 2023-08-01T19:55:31.751 INFO:teuthology.orchestra.run.smithi008.stdout: "client_addr": "172.21.15.6:0/1709472247", 2023-08-01T19:55:31.751 INFO:teuthology.orchestra.run.smithi008.stdout: "tid": 100930 2023-08-01T19:55:31.751 INFO:teuthology.orchestra.run.smithi008.stdout: }, 2023-08-01T19:55:31.751 INFO:teuthology.orchestra.run.smithi008.stdout: "events": [ 2023-08-01T19:55:31.751 INFO:teuthology.orchestra.run.smithi008.stdout: { 2023-08-01T19:55:31.751 INFO:teuthology.orchestra.run.smithi008.stdout: "event": "initiated", 2023-08-01T19:55:31.752 INFO:teuthology.orchestra.run.smithi008.stdout: "time": "2023-08-01T19:55:05.565766+0000", 2023-08-01T19:55:31.752 INFO:teuthology.orchestra.run.smithi008.stdout: "duration": 0 2023-08-01T19:55:31.752 INFO:teuthology.orchestra.run.smithi008.stdout: }, 2023-08-01T19:55:31.752 INFO:teuthology.orchestra.run.smithi008.stdout: { 2023-08-01T19:55:31.752 INFO:teuthology.orchestra.run.smithi008.stdout: "event": "throttled", 2023-08-01T19:55:31.752 INFO:teuthology.orchestra.run.smithi008.stdout: "time": "2023-08-01T19:55:05.565766+0000", 2023-08-01T19:55:31.752 INFO:teuthology.orchestra.run.smithi008.stdout: "duration": 0 2023-08-01T19:55:31.752 INFO:teuthology.orchestra.run.smithi008.stdout: }, 2023-08-01T19:55:31.753 INFO:teuthology.orchestra.run.smithi008.stdout: { 2023-08-01T19:55:31.753 INFO:teuthology.orchestra.run.smithi008.stdout: "event": "header_read", 2023-08-01T19:55:31.753 INFO:teuthology.orchestra.run.smithi008.stdout: "time": "2023-08-01T19:55:05.565766+0000", 2023-08-01T19:55:31.753 INFO:teuthology.orchestra.run.smithi008.stdout: "duration": 4294967295.999999 2023-08-01T19:55:31.753 INFO:teuthology.orchestra.run.smithi008.stdout: }, 2023-08-01T19:55:31.753 INFO:teuthology.orchestra.run.smithi008.stdout: { 2023-08-01T19:55:31.753 INFO:teuthology.orchestra.run.smithi008.stdout: "event": "all_read", 2023-08-01T19:55:31.753 INFO:teuthology.orchestra.run.smithi008.stdout: "time": "2023-08-01T19:55:05.565855+0000", 2023-08-01T19:55:31.754 INFO:teuthology.orchestra.run.smithi008.stdout: "duration": 8.9166999999999995e-05 2023-08-01T19:55:31.754 INFO:teuthology.orchestra.run.smithi008.stdout: }, 2023-08-01T19:55:31.754 INFO:teuthology.orchestra.run.smithi008.stdout: { 2023-08-01T19:55:31.754 INFO:teuthology.orchestra.run.smithi008.stdout: "event": "dispatched", 2023-08-01T19:55:31.754 INFO:teuthology.orchestra.run.smithi008.stdout: "time": "2023-08-01T19:55:05.565862+0000", 2023-08-01T19:55:31.754 INFO:teuthology.orchestra.run.smithi008.stdout: "duration": 7.4549999999999998e-06 2023-08-01T19:55:31.754 INFO:teuthology.orchestra.run.smithi008.stdout: }, 2023-08-01T19:55:31.754 INFO:teuthology.orchestra.run.smithi008.stdout: { 2023-08-01T19:55:31.755 INFO:teuthology.orchestra.run.smithi008.stdout: "event": "queued_for_pg", 2023-08-01T19:55:31.755 INFO:teuthology.orchestra.run.smithi008.stdout: "time": "2023-08-01T19:55:05.565866+0000", 2023-08-01T19:55:31.755 INFO:teuthology.orchestra.run.smithi008.stdout: "duration": 3.8060000000000001e-06 2023-08-01T19:55:31.755 INFO:teuthology.orchestra.run.smithi008.stdout: }, 2023-08-01T19:55:31.755 INFO:teuthology.orchestra.run.smithi008.stdout: { 2023-08-01T19:55:31.755 INFO:teuthology.orchestra.run.smithi008.stdout: "event": "reached_pg", 2023-08-01T19:55:31.755 INFO:teuthology.orchestra.run.smithi008.stdout: "time": "2023-08-01T19:55:05.565901+0000", 2023-08-01T19:55:31.755 INFO:teuthology.orchestra.run.smithi008.stdout: "duration": 3.5063e-05 2023-08-01T19:55:31.756 INFO:teuthology.orchestra.run.smithi008.stdout: }, 2023-08-01T19:55:31.756 INFO:teuthology.orchestra.run.smithi008.stdout: { 2023-08-01T19:55:31.756 INFO:teuthology.orchestra.run.smithi008.stdout: "event": "started", 2023-08-01T19:55:31.756 INFO:teuthology.orchestra.run.smithi008.stdout: "time": "2023-08-01T19:55:05.566016+0000", 2023-08-01T19:55:31.756 INFO:teuthology.orchestra.run.smithi008.stdout: "duration": 0.00011509400000000001 2023-08-01T19:55:31.756 INFO:teuthology.orchestra.run.smithi008.stdout: }, 2023-08-01T19:55:31.756 INFO:teuthology.orchestra.run.smithi008.stdout: { 2023-08-01T19:55:31.757 INFO:teuthology.orchestra.run.smithi008.stdout: "event": "waiting for subops from 1", 2023-08-01T19:55:31.757 INFO:teuthology.orchestra.run.smithi008.stdout: "time": "2023-08-01T19:55:05.566154+0000", 2023-08-01T19:55:31.757 INFO:teuthology.orchestra.run.smithi008.stdout: "duration": 0.000138052 2023-08-01T19:55:31.757 INFO:teuthology.orchestra.run.smithi008.stdout: }, 2023-08-01T19:55:31.757 INFO:teuthology.orchestra.run.smithi008.stdout: { 2023-08-01T19:55:31.757 INFO:teuthology.orchestra.run.smithi008.stdout: "event": "sub_op_commit_rec", 2023-08-01T19:55:31.757 INFO:teuthology.orchestra.run.smithi008.stdout: "time": "2023-08-01T19:55:05.629279+0000", 2023-08-01T19:55:31.757 INFO:teuthology.orchestra.run.smithi008.stdout: "duration": 0.063124531999999997 2023-08-01T19:55:31.758 INFO:teuthology.orchestra.run.smithi008.stdout: }, 2023-08-01T19:55:31.758 INFO:teuthology.orchestra.run.smithi008.stdout: { 2023-08-01T19:55:31.758 INFO:teuthology.orchestra.run.smithi008.stdout: "event": "op_commit", 2023-08-01T19:55:31.758 INFO:teuthology.orchestra.run.smithi008.stdout: "time": "2023-08-01T19:55:05.629333+0000", 2023-08-01T19:55:31.758 INFO:teuthology.orchestra.run.smithi008.stdout: "duration": 5.4694999999999997e-05 2023-08-01T19:55:31.758 INFO:teuthology.orchestra.run.smithi008.stdout: }, 2023-08-01T19:55:31.758 INFO:teuthology.orchestra.run.smithi008.stdout: { 2023-08-01T19:55:31.758 INFO:teuthology.orchestra.run.smithi008.stdout: "event": "commit_sent", 2023-08-01T19:55:31.759 INFO:teuthology.orchestra.run.smithi008.stdout: "time": "2023-08-01T19:55:05.629390+0000", 2023-08-01T19:55:31.759 INFO:teuthology.orchestra.run.smithi008.stdout: "duration": 5.6416000000000003e-05 2023-08-01T19:55:31.759 INFO:teuthology.orchestra.run.smithi008.stdout: }, 2023-08-01T19:55:31.759 INFO:teuthology.orchestra.run.smithi008.stdout: { 2023-08-01T19:55:31.759 INFO:teuthology.orchestra.run.smithi008.stdout: "event": "done", 2023-08-01T19:55:31.759 INFO:teuthology.orchestra.run.smithi008.stdout: "time": "2023-08-01T19:55:05.629435+0000", 2023-08-01T19:55:31.759 INFO:teuthology.orchestra.run.smithi008.stdout: "duration": 4.5170999999999998e-05 2023-08-01T19:55:31.759 INFO:teuthology.orchestra.run.smithi008.stdout: } 2023-08-01T19:55:31.760 INFO:teuthology.orchestra.run.smithi008.stdout: ] 2023-08-01T19:55:31.760 INFO:teuthology.orchestra.run.smithi008.stdout: } 2023-08-01T19:55:31.760 INFO:teuthology.orchestra.run.smithi008.stdout: }, 2023-08-01T19:55:31.760 INFO:teuthology.orchestra.run.smithi008.stdout: { 2023-08-01T19:55:31.760 INFO:teuthology.orchestra.run.smithi008.stdout: "description": "osd_op(client.4668.0:100933 5.5 5:af92e9f2:::benchmark_data_smithi006_114134_object100932:head [set-alloc-hint object_size 65536 write_size 65536,write 0~65536] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e37)", 2023-08-01T19:55:31.760 INFO:teuthology.orchestra.run.smithi008.stdout: "initiated_at": "2023-08-01T19:55:05.566634+0000", 2023-08-01T19:55:31.760 INFO:teuthology.orchestra.run.smithi008.stdout: "age": 26.110660824, 2023-08-01T19:55:31.760 INFO:teuthology.orchestra.run.smithi008.stdout: "duration": 0.065909364999999998, 2023-08-01T19:55:31.761 INFO:teuthology.orchestra.run.smithi008.stdout: "type_data": { 2023-08-01T19:55:31.761 INFO:teuthology.orchestra.run.smithi008.stdout: "flag_point": "commit sent; apply or cleanup", 2023-08-01T19:55:31.761 INFO:teuthology.orchestra.run.smithi008.stdout: "client_info": { 2023-08-01T19:55:31.761 INFO:teuthology.orchestra.run.smithi008.stdout: "client": "client.4668", 2023-08-01T19:55:31.761 INFO:teuthology.orchestra.run.smithi008.stdout: "client_addr": "172.21.15.6:0/1709472247", 2023-08-01T19:55:31.761 INFO:teuthology.orchestra.run.smithi008.stdout: "tid": 100933 2023-08-01T19:55:31.761 INFO:teuthology.orchestra.run.smithi008.stdout: }, 2023-08-01T19:55:31.761 INFO:teuthology.orchestra.run.smithi008.stdout: "events": [ 2023-08-01T19:55:31.762 INFO:teuthology.orchestra.run.smithi008.stdout: { 2023-08-01T19:55:31.762 INFO:teuthology.orchestra.run.smithi008.stdout: "event": "initiated", 2023-08-01T19:55:31.762 INFO:teuthology.orchestra.run.smithi008.stdout: "time": "2023-08-01T19:55:05.566634+0000", 2023-08-01T19:55:31.762 INFO:teuthology.orchestra.run.smithi008.stdout: "duration": 0 2023-08-01T19:55:31.762 INFO:teuthology.orchestra.run.smithi008.stdout: }, 2023-08-01T19:55:31.762 INFO:teuthology.orchestra.run.smithi008.stdout: { 2023-08-01T19:55:31.762 INFO:teuthology.orchestra.run.smithi008.stdout: "event": "throttled", 2023-08-01T19:55:31.762 INFO:teuthology.orchestra.run.smithi008.stdout: "time": "2023-08-01T19:55:05.566634+0000", 2023-08-01T19:55:31.763 INFO:teuthology.orchestra.run.smithi008.stdout: "duration": 0 2023-08-01T19:55:31.763 INFO:teuthology.orchestra.run.smithi008.stdout: }, 2023-08-01T19:55:31.763 INFO:teuthology.orchestra.run.smithi008.stdout: { 2023-08-01T19:55:31.763 INFO:teuthology.orchestra.run.smithi008.stdout: "event": "header_read", 2023-08-01T19:55:31.763 INFO:teuthology.orchestra.run.smithi008.stdout: "time": "2023-08-01T19:55:05.566630+0000", 2023-08-01T19:55:31.763 INFO:teuthology.orchestra.run.smithi008.stdout: "duration": 4294967295.9999962 2023-08-01T19:55:31.763 INFO:teuthology.orchestra.run.smithi008.stdout: }, 2023-08-01T19:55:31.764 INFO:teuthology.orchestra.run.smithi008.stdout: { 2023-08-01T19:55:31.764 INFO:teuthology.orchestra.run.smithi008.stdout: "event": "all_read", 2023-08-01T19:55:31.764 INFO:teuthology.orchestra.run.smithi008.stdout: "time": "2023-08-01T19:55:05.566736+0000", 2023-08-01T19:55:31.764 INFO:teuthology.orchestra.run.smithi008.stdout: "duration": 0.000105752 2023-08-01T19:55:31.764 INFO:teuthology.orchestra.run.smithi008.stdout: }, 2023-08-01T19:55:31.764 INFO:teuthology.orchestra.run.smithi008.stdout: { 2023-08-01T19:55:31.764 INFO:teuthology.orchestra.run.smithi008.stdout: "event": "dispatched", 2023-08-01T19:55:31.764 INFO:teuthology.orchestra.run.smithi008.stdout: "time": "2023-08-01T19:55:05.566742+0000", 2023-08-01T19:55:31.765 INFO:teuthology.orchestra.run.smithi008.stdout: "duration": 5.8209999999999998e-06 2023-08-01T19:55:31.765 INFO:teuthology.orchestra.run.smithi008.stdout: }, 2023-08-01T19:55:31.765 INFO:teuthology.orchestra.run.smithi008.stdout: { 2023-08-01T19:55:31.765 INFO:teuthology.orchestra.run.smithi008.stdout: "event": "queued_for_pg", 2023-08-01T19:55:31.765 INFO:teuthology.orchestra.run.smithi008.stdout: "time": "2023-08-01T19:55:05.566745+0000", 2023-08-01T19:55:31.765 INFO:teuthology.orchestra.run.smithi008.stdout: "duration": 3.337e-06 2023-08-01T19:55:31.765 INFO:teuthology.orchestra.run.smithi008.stdout: }, 2023-08-01T19:55:31.765 INFO:teuthology.orchestra.run.smithi008.stdout: { 2023-08-01T19:55:31.766 INFO:teuthology.orchestra.run.smithi008.stdout: "event": "reached_pg", 2023-08-01T19:55:31.766 INFO:teuthology.orchestra.run.smithi008.stdout: "time": "2023-08-01T19:55:05.568175+0000", 2023-08-01T19:55:31.766 INFO:teuthology.orchestra.run.smithi008.stdout: "duration": 0.001429647 2023-08-01T19:55:31.766 INFO:teuthology.orchestra.run.smithi008.stdout: }, 2023-08-01T19:55:31.767 INFO:teuthology.orchestra.run.smithi008.stdout: { 2023-08-01T19:55:31.767 INFO:teuthology.orchestra.run.smithi008.stdout: "event": "started", 2023-08-01T19:55:31.767 INFO:teuthology.orchestra.run.smithi008.stdout: "time": "2023-08-01T19:55:05.568288+0000", 2023-08-01T19:55:31.768 INFO:teuthology.orchestra.run.smithi008.stdout: "duration": 0.000113353 2023-08-01T19:55:31.768 INFO:teuthology.orchestra.run.smithi008.stdout: }, 2023-08-01T19:55:31.768 INFO:teuthology.orchestra.run.smithi008.stdout: { 2023-08-01T19:55:31.769 INFO:teuthology.orchestra.run.smithi008.stdout: "event": "waiting for subops from 1", 2023-08-01T19:55:31.769 INFO:teuthology.orchestra.run.smithi008.stdout: "time": "2023-08-01T19:55:05.568425+0000", 2023-08-01T19:55:31.769 INFO:teuthology.orchestra.run.smithi008.stdout: "duration": 0.000137346 2023-08-01T19:55:31.770 INFO:teuthology.orchestra.run.smithi008.stdout: }, 2023-08-01T19:55:31.770 INFO:teuthology.orchestra.run.smithi008.stdout: { 2023-08-01T19:55:31.770 INFO:teuthology.orchestra.run.smithi008.stdout: "event": "sub_op_commit_rec", 2023-08-01T19:55:31.770 INFO:teuthology.orchestra.run.smithi008.stdout: "time": "2023-08-01T19:55:05.629320+0000", 2023-08-01T19:55:31.771 INFO:teuthology.orchestra.run.smithi008.stdout: "duration": 0.060894491000000002 2023-08-01T19:55:31.771 INFO:teuthology.orchestra.run.smithi008.stdout: }, 2023-08-01T19:55:31.771 INFO:teuthology.orchestra.run.smithi008.stdout: { 2023-08-01T19:55:31.771 INFO:teuthology.orchestra.run.smithi008.stdout: "event": "op_commit", 2023-08-01T19:55:31.771 INFO:teuthology.orchestra.run.smithi008.stdout: "time": "2023-08-01T19:55:05.632452+0000", 2023-08-01T19:55:31.771 INFO:teuthology.orchestra.run.smithi008.stdout: "duration": 0.003131909 2023-08-01T19:55:31.771 INFO:teuthology.orchestra.run.smithi008.stdout: }, 2023-08-01T19:55:31.771 INFO:teuthology.orchestra.run.smithi008.stdout: { 2023-08-01T19:55:31.772 INFO:teuthology.orchestra.run.smithi008.stdout: "event": "commit_sent", 2023-08-01T19:55:31.772 INFO:teuthology.orchestra.run.smithi008.stdout: "time": "2023-08-01T19:55:05.632503+0000", 2023-08-01T19:55:31.772 INFO:teuthology.orchestra.run.smithi008.stdout: "duration": 5.1295000000000003e-05 2023-08-01T19:55:31.772 INFO:teuthology.orchestra.run.smithi008.stdout: }, 2023-08-01T19:55:31.772 INFO:teuthology.orchestra.run.smithi008.stdout: { 2023-08-01T19:55:31.772 INFO:teuthology.orchestra.run.smithi008.stdout: "event": "done", 2023-08-01T19:55:31.772 INFO:teuthology.orchestra.run.smithi008.stdout: "time": "2023-08-01T19:55:05.632543+0000", 2023-08-01T19:55:31.773 INFO:teuthology.orchestra.run.smithi008.stdout: "duration": 4.0234000000000001e-05 2023-08-01T19:55:31.773 INFO:teuthology.orchestra.run.smithi008.stdout: } 2023-08-01T19:55:31.773 INFO:teuthology.orchestra.run.smithi008.stdout: ] 2023-08-01T19:55:31.773 INFO:teuthology.orchestra.run.smithi008.stdout: } 2023-08-01T19:55:31.773 INFO:teuthology.orchestra.run.smithi008.stdout: }, 2023-08-01T19:55:31.773 INFO:teuthology.orchestra.run.smithi008.stdout: { 2023-08-01T19:55:31.773 INFO:teuthology.orchestra.run.smithi008.stdout: "description": "osd_repop(client.4668.0:100935 5.e e37/19 5:7895b14e:::benchmark_data_smithi006_114134_object100934:head v 37'6305, mlcod=37'6303)", 2023-08-01T19:55:31.773 INFO:teuthology.orchestra.run.smithi008.stdout: "initiated_at": "2023-08-01T19:55:05.567118+0000", 2023-08-01T19:55:31.774 INFO:teuthology.orchestra.run.smithi008.stdout: "age": 26.110176581000001, 2023-08-01T19:55:31.774 INFO:teuthology.orchestra.run.smithi008.stdout: "duration": 0.063691180999999999, 2023-08-01T19:55:31.774 INFO:teuthology.orchestra.run.smithi008.stdout: "type_data": { 2023-08-01T19:55:31.774 INFO:teuthology.orchestra.run.smithi008.stdout: "flag_point": "commit sent; apply or cleanup", 2023-08-01T19:55:31.774 INFO:teuthology.orchestra.run.smithi008.stdout: "events": [ 2023-08-01T19:55:31.774 INFO:teuthology.orchestra.run.smithi008.stdout: { 2023-08-01T19:55:31.774 INFO:teuthology.orchestra.run.smithi008.stdout: "event": "initiated", 2023-08-01T19:55:31.774 INFO:teuthology.orchestra.run.smithi008.stdout: "time": "2023-08-01T19:55:05.567118+0000", 2023-08-01T19:55:31.775 INFO:teuthology.orchestra.run.smithi008.stdout: "duration": 0 2023-08-01T19:55:31.775 INFO:teuthology.orchestra.run.smithi008.stdout: }, 2023-08-01T19:55:31.775 INFO:teuthology.orchestra.run.smithi008.stdout: { 2023-08-01T19:55:31.775 INFO:teuthology.orchestra.run.smithi008.stdout: "event": "throttled", 2023-08-01T19:55:31.775 INFO:teuthology.orchestra.run.smithi008.stdout: "time": "2023-08-01T19:55:05.567118+0000", 2023-08-01T19:55:31.775 INFO:teuthology.orchestra.run.smithi008.stdout: "duration": 0 2023-08-01T19:55:31.775 INFO:teuthology.orchestra.run.smithi008.stdout: }, 2023-08-01T19:55:31.775 INFO:teuthology.orchestra.run.smithi008.stdout: { 2023-08-01T19:55:31.776 INFO:teuthology.orchestra.run.smithi008.stdout: "event": "header_read", 2023-08-01T19:55:31.776 INFO:teuthology.orchestra.run.smithi008.stdout: "time": "2023-08-01T19:55:05.567117+0000", 2023-08-01T19:55:31.776 INFO:teuthology.orchestra.run.smithi008.stdout: "duration": 4294967295.999999 2023-08-01T19:55:31.776 INFO:teuthology.orchestra.run.smithi008.stdout: }, 2023-08-01T19:55:31.776 INFO:teuthology.orchestra.run.smithi008.stdout: { 2023-08-01T19:55:31.776 INFO:teuthology.orchestra.run.smithi008.stdout: "event": "all_read", 2023-08-01T19:55:31.776 INFO:teuthology.orchestra.run.smithi008.stdout: "time": "2023-08-01T19:55:05.567168+0000", 2023-08-01T19:55:31.777 INFO:teuthology.orchestra.run.smithi008.stdout: "duration": 5.0353999999999999e-05 2023-08-01T19:55:31.777 INFO:teuthology.orchestra.run.smithi008.stdout: }, 2023-08-01T19:55:31.777 INFO:teuthology.orchestra.run.smithi008.stdout: { 2023-08-01T19:55:31.777 INFO:teuthology.orchestra.run.smithi008.stdout: "event": "dispatched", 2023-08-01T19:55:31.777 INFO:teuthology.orchestra.run.smithi008.stdout: "time": "2023-08-01T19:55:05.567175+0000", 2023-08-01T19:55:31.777 INFO:teuthology.orchestra.run.smithi008.stdout: "duration": 7.3919999999999997e-06 2023-08-01T19:55:31.777 INFO:teuthology.orchestra.run.smithi008.stdout: }, 2023-08-01T19:55:31.777 INFO:teuthology.orchestra.run.smithi008.stdout: { 2023-08-01T19:55:31.778 INFO:teuthology.orchestra.run.smithi008.stdout: "event": "queued_for_pg", 2023-08-01T19:55:31.778 INFO:teuthology.orchestra.run.smithi008.stdout: "time": "2023-08-01T19:55:05.567180+0000", 2023-08-01T19:55:31.778 INFO:teuthology.orchestra.run.smithi008.stdout: "duration": 5.3090000000000003e-06 2023-08-01T19:55:31.778 INFO:teuthology.orchestra.run.smithi008.stdout: }, 2023-08-01T19:55:31.778 INFO:teuthology.orchestra.run.smithi008.stdout: { 2023-08-01T19:55:31.778 INFO:teuthology.orchestra.run.smithi008.stdout: "event": "reached_pg", 2023-08-01T19:55:31.778 INFO:teuthology.orchestra.run.smithi008.stdout: "time": "2023-08-01T19:55:05.567210+0000", 2023-08-01T19:55:31.778 INFO:teuthology.orchestra.run.smithi008.stdout: "duration": 3.0001999999999998e-05 2023-08-01T19:55:31.779 INFO:teuthology.orchestra.run.smithi008.stdout: }, 2023-08-01T19:55:31.779 INFO:teuthology.orchestra.run.smithi008.stdout: { 2023-08-01T19:55:31.779 INFO:teuthology.orchestra.run.smithi008.stdout: "event": "started", 2023-08-01T19:55:31.779 INFO:teuthology.orchestra.run.smithi008.stdout: "time": "2023-08-01T19:55:05.567222+0000", 2023-08-01T19:55:31.779 INFO:teuthology.orchestra.run.smithi008.stdout: "duration": 1.1499e-05 2023-08-01T19:55:31.779 INFO:teuthology.orchestra.run.smithi008.stdout: }, 2023-08-01T19:55:31.779 INFO:teuthology.orchestra.run.smithi008.stdout: { 2023-08-01T19:55:31.779 INFO:teuthology.orchestra.run.smithi008.stdout: "event": "commit_sent", 2023-08-01T19:55:31.780 INFO:teuthology.orchestra.run.smithi008.stdout: "time": "2023-08-01T19:55:05.630772+0000", 2023-08-01T19:55:31.780 INFO:teuthology.orchestra.run.smithi008.stdout: "duration": 0.063550572999999999 2023-08-01T19:55:31.780 INFO:teuthology.orchestra.run.smithi008.stdout: }, 2023-08-01T19:55:31.780 INFO:teuthology.orchestra.run.smithi008.stdout: { 2023-08-01T19:55:31.780 INFO:teuthology.orchestra.run.smithi008.stdout: "event": "done", 2023-08-01T19:55:31.780 INFO:teuthology.orchestra.run.smithi008.stdout: "time": "2023-08-01T19:55:05.630809+0000", 2023-08-01T19:55:31.780 INFO:teuthology.orchestra.run.smithi008.stdout: "duration": 3.7033000000000003e-05 2023-08-01T19:55:31.780 INFO:teuthology.orchestra.run.smithi008.stdout: } 2023-08-01T19:55:31.781 INFO:teuthology.orchestra.run.smithi008.stdout: ] 2023-08-01T19:55:31.781 INFO:teuthology.orchestra.run.smithi008.stdout: } 2023-08-01T19:55:31.781 INFO:teuthology.orchestra.run.smithi008.stdout: }, 2023-08-01T19:55:31.781 INFO:teuthology.orchestra.run.smithi008.stdout: { 2023-08-01T19:55:31.781 INFO:teuthology.orchestra.run.smithi008.stdout: "description": "osd_repop(client.4668.0:100936 5.1 e37/19 5:8f4e3576:::benchmark_data_smithi006_114134_object100935:head v 37'6263, mlcod=37'6261)", 2023-08-01T19:55:31.781 INFO:teuthology.orchestra.run.smithi008.stdout: "initiated_at": "2023-08-01T19:55:05.567617+0000", 2023-08-01T19:55:31.781 INFO:teuthology.orchestra.run.smithi008.stdout: "age": 26.109677317999999, 2023-08-01T19:55:31.782 INFO:teuthology.orchestra.run.smithi008.stdout: "duration": 0.062773918999999997, 2023-08-01T19:55:31.782 INFO:teuthology.orchestra.run.smithi008.stdout: "type_data": { 2023-08-01T19:55:31.782 INFO:teuthology.orchestra.run.smithi008.stdout: "flag_point": "commit sent; apply or cleanup", 2023-08-01T19:55:31.782 INFO:teuthology.orchestra.run.smithi008.stdout: "events": [ 2023-08-01T19:55:31.782 INFO:teuthology.orchestra.run.smithi008.stdout: { 2023-08-01T19:55:31.782 INFO:teuthology.orchestra.run.smithi008.stdout: "event": "initiated", 2023-08-01T19:55:31.782 INFO:teuthology.orchestra.run.smithi008.stdout: "time": "2023-08-01T19:55:05.567617+0000", 2023-08-01T19:55:31.782 INFO:teuthology.orchestra.run.smithi008.stdout: "duration": 0 2023-08-01T19:55:31.783 INFO:teuthology.orchestra.run.smithi008.stdout: }, 2023-08-01T19:55:31.783 INFO:teuthology.orchestra.run.smithi008.stdout: { 2023-08-01T19:55:31.783 INFO:teuthology.orchestra.run.smithi008.stdout: "event": "throttled", 2023-08-01T19:55:31.783 INFO:teuthology.orchestra.run.smithi008.stdout: "time": "2023-08-01T19:55:05.567617+0000", 2023-08-01T19:55:31.783 INFO:teuthology.orchestra.run.smithi008.stdout: "duration": 0 2023-08-01T19:55:31.783 INFO:teuthology.orchestra.run.smithi008.stdout: }, 2023-08-01T19:55:31.783 INFO:teuthology.orchestra.run.smithi008.stdout: { 2023-08-01T19:55:31.783 INFO:teuthology.orchestra.run.smithi008.stdout: "event": "header_read", 2023-08-01T19:55:31.784 INFO:teuthology.orchestra.run.smithi008.stdout: "time": "2023-08-01T19:55:05.567617+0000", 2023-08-01T19:55:31.784 INFO:teuthology.orchestra.run.smithi008.stdout: "duration": 4294967295.9999995 2023-08-01T19:55:31.784 INFO:teuthology.orchestra.run.smithi008.stdout: }, 2023-08-01T19:55:31.784 INFO:teuthology.orchestra.run.smithi008.stdout: { 2023-08-01T19:55:31.784 INFO:teuthology.orchestra.run.smithi008.stdout: "event": "all_read", 2023-08-01T19:55:31.784 INFO:teuthology.orchestra.run.smithi008.stdout: "time": "2023-08-01T19:55:05.567700+0000", 2023-08-01T19:55:31.784 INFO:teuthology.orchestra.run.smithi008.stdout: "duration": 8.3363999999999997e-05 2023-08-01T19:55:31.784 INFO:teuthology.orchestra.run.smithi008.stdout: }, 2023-08-01T19:55:31.785 INFO:teuthology.orchestra.run.smithi008.stdout: { 2023-08-01T19:55:31.785 INFO:teuthology.orchestra.run.smithi008.stdout: "event": "dispatched", 2023-08-01T19:55:31.785 INFO:teuthology.orchestra.run.smithi008.stdout: "time": "2023-08-01T19:55:05.567706+0000", 2023-08-01T19:55:31.785 INFO:teuthology.orchestra.run.smithi008.stdout: "duration": 5.9739999999999999e-06 2023-08-01T19:55:31.785 INFO:teuthology.orchestra.run.smithi008.stdout: }, 2023-08-01T19:55:31.785 INFO:teuthology.orchestra.run.smithi008.stdout: { 2023-08-01T19:55:31.785 INFO:teuthology.orchestra.run.smithi008.stdout: "event": "queued_for_pg", 2023-08-01T19:55:31.785 INFO:teuthology.orchestra.run.smithi008.stdout: "time": "2023-08-01T19:55:05.567709+0000", 2023-08-01T19:55:31.786 INFO:teuthology.orchestra.run.smithi008.stdout: "duration": 3.1420000000000002e-06 2023-08-01T19:55:31.786 INFO:teuthology.orchestra.run.smithi008.stdout: }, 2023-08-01T19:55:31.786 INFO:teuthology.orchestra.run.smithi008.stdout: { 2023-08-01T19:55:31.786 INFO:teuthology.orchestra.run.smithi008.stdout: "event": "reached_pg", 2023-08-01T19:55:31.786 INFO:teuthology.orchestra.run.smithi008.stdout: "time": "2023-08-01T19:55:05.567741+0000", 2023-08-01T19:55:31.786 INFO:teuthology.orchestra.run.smithi008.stdout: "duration": 3.1532999999999998e-05 2023-08-01T19:55:31.786 INFO:teuthology.orchestra.run.smithi008.stdout: }, 2023-08-01T19:55:31.786 INFO:teuthology.orchestra.run.smithi008.stdout: { 2023-08-01T19:55:31.787 INFO:teuthology.orchestra.run.smithi008.stdout: "event": "started", 2023-08-01T19:55:31.787 INFO:teuthology.orchestra.run.smithi008.stdout: "time": "2023-08-01T19:55:05.567752+0000", 2023-08-01T19:55:31.787 INFO:teuthology.orchestra.run.smithi008.stdout: "duration": 1.1266e-05 2023-08-01T19:55:31.787 INFO:teuthology.orchestra.run.smithi008.stdout: }, 2023-08-01T19:55:31.787 INFO:teuthology.orchestra.run.smithi008.stdout: { 2023-08-01T19:55:31.787 INFO:teuthology.orchestra.run.smithi008.stdout: "event": "commit_sent", 2023-08-01T19:55:31.787 INFO:teuthology.orchestra.run.smithi008.stdout: "time": "2023-08-01T19:55:05.630357+0000", 2023-08-01T19:55:31.787 INFO:teuthology.orchestra.run.smithi008.stdout: "duration": 0.062604554000000007 2023-08-01T19:55:31.788 INFO:teuthology.orchestra.run.smithi008.stdout: }, 2023-08-01T19:55:31.788 INFO:teuthology.orchestra.run.smithi008.stdout: { 2023-08-01T19:55:31.788 INFO:teuthology.orchestra.run.smithi008.stdout: "event": "done", 2023-08-01T19:55:31.788 INFO:teuthology.orchestra.run.smithi008.stdout: "time": "2023-08-01T19:55:05.630391+0000", 2023-08-01T19:55:31.788 INFO:teuthology.orchestra.run.smithi008.stdout: "duration": 3.4619000000000002e-05 2023-08-01T19:55:31.788 INFO:teuthology.orchestra.run.smithi008.stdout: } 2023-08-01T19:55:31.788 INFO:teuthology.orchestra.run.smithi008.stdout: ] 2023-08-01T19:55:31.789 INFO:teuthology.orchestra.run.smithi008.stdout: } 2023-08-01T19:55:31.789 INFO:teuthology.orchestra.run.smithi008.stdout: }, 2023-08-01T19:55:31.789 INFO:teuthology.orchestra.run.smithi008.stdout: { 2023-08-01T19:55:31.789 INFO:teuthology.orchestra.run.smithi008.stdout: "description": "osd_op(client.4668.0:100937 5.c 5:34445fc3:::benchmark_data_smithi006_114134_object100936:head [set-alloc-hint object_size 65536 write_size 65536,write 0~65536] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e37)", 2023-08-01T19:55:31.789 INFO:teuthology.orchestra.run.smithi008.stdout: "initiated_at": "2023-08-01T19:55:05.569198+0000", 2023-08-01T19:55:31.789 INFO:teuthology.orchestra.run.smithi008.stdout: "age": 26.108096695, 2023-08-01T19:55:31.789 INFO:teuthology.orchestra.run.smithi008.stdout: "duration": 0.063349390000000005, 2023-08-01T19:55:31.789 INFO:teuthology.orchestra.run.smithi008.stdout: "type_data": { 2023-08-01T19:55:31.790 INFO:teuthology.orchestra.run.smithi008.stdout: "flag_point": "commit sent; apply or cleanup", 2023-08-01T19:55:31.790 INFO:teuthology.orchestra.run.smithi008.stdout: "client_info": { 2023-08-01T19:55:31.790 INFO:teuthology.orchestra.run.smithi008.stdout: "client": "client.4668", 2023-08-01T19:55:31.790 INFO:teuthology.orchestra.run.smithi008.stdout: "client_addr": "172.21.15.6:0/1709472247", 2023-08-01T19:55:31.790 INFO:teuthology.orchestra.run.smithi008.stdout: "tid": 100937 2023-08-01T19:55:31.790 INFO:teuthology.orchestra.run.smithi008.stdout: }, 2023-08-01T19:55:31.790 INFO:teuthology.orchestra.run.smithi008.stdout: "events": [ 2023-08-01T19:55:31.790 INFO:teuthology.orchestra.run.smithi008.stdout: { 2023-08-01T19:55:31.791 INFO:teuthology.orchestra.run.smithi008.stdout: "event": "initiated", 2023-08-01T19:55:31.791 INFO:teuthology.orchestra.run.smithi008.stdout: "time": "2023-08-01T19:55:05.569198+0000", 2023-08-01T19:55:31.791 INFO:teuthology.orchestra.run.smithi008.stdout: "duration": 0 2023-08-01T19:55:31.791 INFO:teuthology.orchestra.run.smithi008.stdout: }, 2023-08-01T19:55:31.791 INFO:teuthology.orchestra.run.smithi008.stdout: { 2023-08-01T19:55:31.791 INFO:teuthology.orchestra.run.smithi008.stdout: "event": "throttled", 2023-08-01T19:55:31.791 INFO:teuthology.orchestra.run.smithi008.stdout: "time": "2023-08-01T19:55:05.569198+0000", 2023-08-01T19:55:31.791 INFO:teuthology.orchestra.run.smithi008.stdout: "duration": 0 2023-08-01T19:55:31.792 INFO:teuthology.orchestra.run.smithi008.stdout: }, 2023-08-01T19:55:31.792 INFO:teuthology.orchestra.run.smithi008.stdout: { 2023-08-01T19:55:31.792 INFO:teuthology.orchestra.run.smithi008.stdout: "event": "header_read", 2023-08-01T19:55:31.792 INFO:teuthology.orchestra.run.smithi008.stdout: "time": "2023-08-01T19:55:05.569197+0000", 2023-08-01T19:55:31.792 INFO:teuthology.orchestra.run.smithi008.stdout: "duration": 4294967295.999999 2023-08-01T19:55:31.792 INFO:teuthology.orchestra.run.smithi008.stdout: }, 2023-08-01T19:55:31.792 INFO:teuthology.orchestra.run.smithi008.stdout: { 2023-08-01T19:55:31.793 INFO:teuthology.orchestra.run.smithi008.stdout: "event": "all_read", 2023-08-01T19:55:31.793 INFO:teuthology.orchestra.run.smithi008.stdout: "time": "2023-08-01T19:55:05.569250+0000", 2023-08-01T19:55:31.793 INFO:teuthology.orchestra.run.smithi008.stdout: "duration": 5.3106000000000003e-05 2023-08-01T19:55:31.793 INFO:teuthology.orchestra.run.smithi008.stdout: }, 2023-08-01T19:55:31.793 INFO:teuthology.orchestra.run.smithi008.stdout: { 2023-08-01T19:55:31.793 INFO:teuthology.orchestra.run.smithi008.stdout: "event": "dispatched", 2023-08-01T19:55:31.793 INFO:teuthology.orchestra.run.smithi008.stdout: "time": "2023-08-01T19:55:05.569260+0000", 2023-08-01T19:55:31.793 INFO:teuthology.orchestra.run.smithi008.stdout: "duration": 9.533e-06 2023-08-01T19:55:31.794 INFO:teuthology.orchestra.run.smithi008.stdout: }, 2023-08-01T19:55:31.794 INFO:teuthology.orchestra.run.smithi008.stdout: { 2023-08-01T19:55:31.794 INFO:teuthology.orchestra.run.smithi008.stdout: "event": "queued_for_pg", 2023-08-01T19:55:31.794 INFO:teuthology.orchestra.run.smithi008.stdout: "time": "2023-08-01T19:55:05.569264+0000", 2023-08-01T19:55:31.794 INFO:teuthology.orchestra.run.smithi008.stdout: "duration": 4.6099999999999999e-06 2023-08-01T19:55:31.794 INFO:teuthology.orchestra.run.smithi008.stdout: }, 2023-08-01T19:55:31.794 INFO:teuthology.orchestra.run.smithi008.stdout: { 2023-08-01T19:55:31.794 INFO:teuthology.orchestra.run.smithi008.stdout: "event": "reached_pg", 2023-08-01T19:55:31.795 INFO:teuthology.orchestra.run.smithi008.stdout: "time": "2023-08-01T19:55:05.569293+0000", 2023-08-01T19:55:31.795 INFO:teuthology.orchestra.run.smithi008.stdout: "duration": 2.8181999999999999e-05 2023-08-01T19:55:31.795 INFO:teuthology.orchestra.run.smithi008.stdout: }, 2023-08-01T19:55:31.795 INFO:teuthology.orchestra.run.smithi008.stdout: { 2023-08-01T19:55:31.795 INFO:teuthology.orchestra.run.smithi008.stdout: "event": "started", 2023-08-01T19:55:31.795 INFO:teuthology.orchestra.run.smithi008.stdout: "time": "2023-08-01T19:55:05.569401+0000", 2023-08-01T19:55:31.795 INFO:teuthology.orchestra.run.smithi008.stdout: "duration": 0.000108065 2023-08-01T19:55:31.795 INFO:teuthology.orchestra.run.smithi008.stdout: }, 2023-08-01T19:55:31.796 INFO:teuthology.orchestra.run.smithi008.stdout: { 2023-08-01T19:55:31.796 INFO:teuthology.orchestra.run.smithi008.stdout: "event": "waiting for subops from 1", 2023-08-01T19:55:31.796 INFO:teuthology.orchestra.run.smithi008.stdout: "time": "2023-08-01T19:55:05.569521+0000", 2023-08-01T19:55:31.796 INFO:teuthology.orchestra.run.smithi008.stdout: "duration": 0.00012006900000000001 2023-08-01T19:55:31.796 INFO:teuthology.orchestra.run.smithi008.stdout: }, 2023-08-01T19:55:31.796 INFO:teuthology.orchestra.run.smithi008.stdout: { 2023-08-01T19:55:31.796 INFO:teuthology.orchestra.run.smithi008.stdout: "event": "sub_op_commit_rec", 2023-08-01T19:55:31.797 INFO:teuthology.orchestra.run.smithi008.stdout: "time": "2023-08-01T19:55:05.629421+0000", 2023-08-01T19:55:31.797 INFO:teuthology.orchestra.run.smithi008.stdout: "duration": 0.059900525000000003 2023-08-01T19:55:31.797 INFO:teuthology.orchestra.run.smithi008.stdout: }, 2023-08-01T19:55:31.797 INFO:teuthology.orchestra.run.smithi008.stdout: { 2023-08-01T19:55:31.797 INFO:teuthology.orchestra.run.smithi008.stdout: "event": "op_commit", 2023-08-01T19:55:31.797 INFO:teuthology.orchestra.run.smithi008.stdout: "time": "2023-08-01T19:55:05.632461+0000", 2023-08-01T19:55:31.797 INFO:teuthology.orchestra.run.smithi008.stdout: "duration": 0.0030401220000000001 2023-08-01T19:55:31.797 INFO:teuthology.orchestra.run.smithi008.stdout: }, 2023-08-01T19:55:31.798 INFO:teuthology.orchestra.run.smithi008.stdout: { 2023-08-01T19:55:31.798 INFO:teuthology.orchestra.run.smithi008.stdout: "event": "commit_sent", 2023-08-01T19:55:31.798 INFO:teuthology.orchestra.run.smithi008.stdout: "time": "2023-08-01T19:55:05.632507+0000", 2023-08-01T19:55:31.798 INFO:teuthology.orchestra.run.smithi008.stdout: "duration": 4.5361999999999997e-05 2023-08-01T19:55:31.798 INFO:teuthology.orchestra.run.smithi008.stdout: }, 2023-08-01T19:55:31.798 INFO:teuthology.orchestra.run.smithi008.stdout: { 2023-08-01T19:55:31.798 INFO:teuthology.orchestra.run.smithi008.stdout: "event": "done", 2023-08-01T19:55:31.798 INFO:teuthology.orchestra.run.smithi008.stdout: "time": "2023-08-01T19:55:05.632547+0000", 2023-08-01T19:55:31.799 INFO:teuthology.orchestra.run.smithi008.stdout: "duration": 4.0760999999999998e-05 2023-08-01T19:55:31.799 INFO:teuthology.orchestra.run.smithi008.stdout: } 2023-08-01T19:55:31.799 INFO:teuthology.orchestra.run.smithi008.stdout: ] 2023-08-01T19:55:31.799 INFO:teuthology.orchestra.run.smithi008.stdout: } 2023-08-01T19:55:31.799 INFO:teuthology.orchestra.run.smithi008.stdout: }, 2023-08-01T19:55:31.799 INFO:teuthology.orchestra.run.smithi008.stdout: { 2023-08-01T19:55:31.799 INFO:teuthology.orchestra.run.smithi008.stdout: "description": "osd_op(client.4668.0:100939 5.5 5:a75fa6e3:::benchmark_data_smithi006_114134_object100938:head [set-alloc-hint object_size 65536 write_size 65536,write 0~65536] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e37)", 2023-08-01T19:55:31.800 INFO:teuthology.orchestra.run.smithi008.stdout: "initiated_at": "2023-08-01T19:55:05.569740+0000", 2023-08-01T19:55:31.800 INFO:teuthology.orchestra.run.smithi008.stdout: "age": 26.107555153, 2023-08-01T19:55:31.800 INFO:teuthology.orchestra.run.smithi008.stdout: "duration": 0.067753412999999998, 2023-08-01T19:55:31.800 INFO:teuthology.orchestra.run.smithi008.stdout: "type_data": { 2023-08-01T19:55:31.800 INFO:teuthology.orchestra.run.smithi008.stdout: "flag_point": "commit sent; apply or cleanup", 2023-08-01T19:55:31.800 INFO:teuthology.orchestra.run.smithi008.stdout: "client_info": { 2023-08-01T19:55:31.800 INFO:teuthology.orchestra.run.smithi008.stdout: "client": "client.4668", 2023-08-01T19:55:31.800 INFO:teuthology.orchestra.run.smithi008.stdout: "client_addr": "172.21.15.6:0/1709472247", 2023-08-01T19:55:31.801 INFO:teuthology.orchestra.run.smithi008.stdout: "tid": 100939 2023-08-01T19:55:31.801 INFO:teuthology.orchestra.run.smithi008.stdout: }, 2023-08-01T19:55:31.801 INFO:teuthology.orchestra.run.smithi008.stdout: "events": [ 2023-08-01T19:55:31.801 INFO:teuthology.orchestra.run.smithi008.stdout: { 2023-08-01T19:55:31.801 INFO:teuthology.orchestra.run.smithi008.stdout: "event": "initiated", 2023-08-01T19:55:31.801 INFO:teuthology.orchestra.run.smithi008.stdout: "time": "2023-08-01T19:55:05.569740+0000", 2023-08-01T19:55:31.801 INFO:teuthology.orchestra.run.smithi008.stdout: "duration": 0 2023-08-01T19:55:31.801 INFO:teuthology.orchestra.run.smithi008.stdout: }, 2023-08-01T19:55:31.802 INFO:teuthology.orchestra.run.smithi008.stdout: { 2023-08-01T19:55:31.802 INFO:teuthology.orchestra.run.smithi008.stdout: "event": "throttled", 2023-08-01T19:55:31.802 INFO:teuthology.orchestra.run.smithi008.stdout: "time": "2023-08-01T19:55:05.569740+0000", 2023-08-01T19:55:31.802 INFO:teuthology.orchestra.run.smithi008.stdout: "duration": 0 2023-08-01T19:55:31.802 INFO:teuthology.orchestra.run.smithi008.stdout: }, 2023-08-01T19:55:31.802 INFO:teuthology.orchestra.run.smithi008.stdout: { 2023-08-01T19:55:31.802 INFO:teuthology.orchestra.run.smithi008.stdout: "event": "header_read", 2023-08-01T19:55:31.802 INFO:teuthology.orchestra.run.smithi008.stdout: "time": "2023-08-01T19:55:05.569739+0000", 2023-08-01T19:55:31.803 INFO:teuthology.orchestra.run.smithi008.stdout: "duration": 4294967295.9999995 2023-08-01T19:55:31.803 INFO:teuthology.orchestra.run.smithi008.stdout: }, 2023-08-01T19:55:31.803 INFO:teuthology.orchestra.run.smithi008.stdout: { 2023-08-01T19:55:31.803 INFO:teuthology.orchestra.run.smithi008.stdout: "event": "all_read", 2023-08-01T19:55:31.803 INFO:teuthology.orchestra.run.smithi008.stdout: "time": "2023-08-01T19:55:05.569839+0000", 2023-08-01T19:55:31.803 INFO:teuthology.orchestra.run.smithi008.stdout: "duration": 0.000100219 2023-08-01T19:55:31.803 INFO:teuthology.orchestra.run.smithi008.stdout: }, 2023-08-01T19:55:31.803 INFO:teuthology.orchestra.run.smithi008.stdout: { 2023-08-01T19:55:31.804 INFO:teuthology.orchestra.run.smithi008.stdout: "event": "dispatched", 2023-08-01T19:55:31.804 INFO:teuthology.orchestra.run.smithi008.stdout: "time": "2023-08-01T19:55:05.569846+0000", 2023-08-01T19:55:31.804 INFO:teuthology.orchestra.run.smithi008.stdout: "duration": 7.3150000000000003e-06 2023-08-01T19:55:31.804 INFO:teuthology.orchestra.run.smithi008.stdout: }, 2023-08-01T19:55:31.804 INFO:teuthology.orchestra.run.smithi008.stdout: { 2023-08-01T19:55:31.804 INFO:teuthology.orchestra.run.smithi008.stdout: "event": "queued_for_pg", 2023-08-01T19:55:31.804 INFO:teuthology.orchestra.run.smithi008.stdout: "time": "2023-08-01T19:55:05.569850+0000", 2023-08-01T19:55:31.805 INFO:teuthology.orchestra.run.smithi008.stdout: "duration": 3.3299999999999999e-06 2023-08-01T19:55:31.805 INFO:teuthology.orchestra.run.smithi008.stdout: }, 2023-08-01T19:55:31.805 INFO:teuthology.orchestra.run.smithi008.stdout: { 2023-08-01T19:55:31.805 INFO:teuthology.orchestra.run.smithi008.stdout: "event": "reached_pg", 2023-08-01T19:55:31.805 INFO:teuthology.orchestra.run.smithi008.stdout: "time": "2023-08-01T19:55:05.626991+0000", 2023-08-01T19:55:31.805 INFO:teuthology.orchestra.run.smithi008.stdout: "duration": 0.057141585000000002 2023-08-01T19:55:31.805 INFO:teuthology.orchestra.run.smithi008.stdout: }, 2023-08-01T19:55:31.805 INFO:teuthology.orchestra.run.smithi008.stdout: { 2023-08-01T19:55:31.806 INFO:teuthology.orchestra.run.smithi008.stdout: "event": "started", 2023-08-01T19:55:31.806 INFO:teuthology.orchestra.run.smithi008.stdout: "time": "2023-08-01T19:55:05.627111+0000", 2023-08-01T19:55:31.806 INFO:teuthology.orchestra.run.smithi008.stdout: "duration": 0.000119238 2023-08-01T19:55:31.806 INFO:teuthology.orchestra.run.smithi008.stdout: }, 2023-08-01T19:55:31.806 INFO:teuthology.orchestra.run.smithi008.stdout: { 2023-08-01T19:55:31.806 INFO:teuthology.orchestra.run.smithi008.stdout: "event": "waiting for subops from 1", 2023-08-01T19:55:31.806 INFO:teuthology.orchestra.run.smithi008.stdout: "time": "2023-08-01T19:55:05.627253+0000", 2023-08-01T19:55:31.806 INFO:teuthology.orchestra.run.smithi008.stdout: "duration": 0.000142822 2023-08-01T19:55:31.807 INFO:teuthology.orchestra.run.smithi008.stdout: }, 2023-08-01T19:55:31.807 INFO:teuthology.orchestra.run.smithi008.stdout: { 2023-08-01T19:55:31.807 INFO:teuthology.orchestra.run.smithi008.stdout: "event": "op_commit", 2023-08-01T19:55:31.807 INFO:teuthology.orchestra.run.smithi008.stdout: "time": "2023-08-01T19:55:05.632555+0000", 2023-08-01T19:55:31.807 INFO:teuthology.orchestra.run.smithi008.stdout: "duration": 0.0053012449999999996 2023-08-01T19:55:31.807 INFO:teuthology.orchestra.run.smithi008.stdout: }, 2023-08-01T19:55:31.807 INFO:teuthology.orchestra.run.smithi008.stdout: { 2023-08-01T19:55:31.807 INFO:teuthology.orchestra.run.smithi008.stdout: "event": "sub_op_commit_rec", 2023-08-01T19:55:31.808 INFO:teuthology.orchestra.run.smithi008.stdout: "time": "2023-08-01T19:55:05.637380+0000", 2023-08-01T19:55:31.808 INFO:teuthology.orchestra.run.smithi008.stdout: "duration": 0.0048257639999999997 2023-08-01T19:55:31.808 INFO:teuthology.orchestra.run.smithi008.stdout: }, 2023-08-01T19:55:31.808 INFO:teuthology.orchestra.run.smithi008.stdout: { 2023-08-01T19:55:31.808 INFO:teuthology.orchestra.run.smithi008.stdout: "event": "commit_sent", 2023-08-01T19:55:31.808 INFO:teuthology.orchestra.run.smithi008.stdout: "time": "2023-08-01T19:55:05.637454+0000", 2023-08-01T19:55:31.808 INFO:teuthology.orchestra.run.smithi008.stdout: "duration": 7.3578999999999995e-05 2023-08-01T19:55:31.809 INFO:teuthology.orchestra.run.smithi008.stdout: }, 2023-08-01T19:55:31.809 INFO:teuthology.orchestra.run.smithi008.stdout: { 2023-08-01T19:55:31.809 INFO:teuthology.orchestra.run.smithi008.stdout: "event": "done", 2023-08-01T19:55:31.809 INFO:teuthology.orchestra.run.smithi008.stdout: "time": "2023-08-01T19:55:05.637493+0000", 2023-08-01T19:55:31.809 INFO:teuthology.orchestra.run.smithi008.stdout: "duration": 3.8986999999999998e-05 2023-08-01T19:55:31.809 INFO:teuthology.orchestra.run.smithi008.stdout: } 2023-08-01T19:55:31.809 INFO:teuthology.orchestra.run.smithi008.stdout: ] 2023-08-01T19:55:31.809 INFO:teuthology.orchestra.run.smithi008.stdout: } 2023-08-01T19:55:31.810 INFO:teuthology.orchestra.run.smithi008.stdout: }, 2023-08-01T19:55:31.810 INFO:teuthology.orchestra.run.smithi008.stdout: { 2023-08-01T19:55:31.810 INFO:teuthology.orchestra.run.smithi008.stdout: "description": "osd_repop(client.4668.0:100941 5.e e37/19 5:736a6ac6:::benchmark_data_smithi006_114134_object100940:head v 37'6306, mlcod=37'6303)", 2023-08-01T19:55:31.810 INFO:teuthology.orchestra.run.smithi008.stdout: "initiated_at": "2023-08-01T19:55:05.570237+0000", 2023-08-01T19:55:31.810 INFO:teuthology.orchestra.run.smithi008.stdout: "age": 26.107057843, 2023-08-01T19:55:31.810 INFO:teuthology.orchestra.run.smithi008.stdout: "duration": 0.064830421999999999, 2023-08-01T19:55:31.810 INFO:teuthology.orchestra.run.smithi008.stdout: "type_data": { 2023-08-01T19:55:31.810 INFO:teuthology.orchestra.run.smithi008.stdout: "flag_point": "commit sent; apply or cleanup", 2023-08-01T19:55:31.811 INFO:teuthology.orchestra.run.smithi008.stdout: "events": [ 2023-08-01T19:55:31.811 INFO:teuthology.orchestra.run.smithi008.stdout: { 2023-08-01T19:55:31.811 INFO:teuthology.orchestra.run.smithi008.stdout: "event": "initiated", 2023-08-01T19:55:31.811 INFO:teuthology.orchestra.run.smithi008.stdout: "time": "2023-08-01T19:55:05.570237+0000", 2023-08-01T19:55:31.811 INFO:teuthology.orchestra.run.smithi008.stdout: "duration": 0 2023-08-01T19:55:31.811 INFO:teuthology.orchestra.run.smithi008.stdout: }, 2023-08-01T19:55:31.811 INFO:teuthology.orchestra.run.smithi008.stdout: { 2023-08-01T19:55:31.811 INFO:teuthology.orchestra.run.smithi008.stdout: "event": "throttled", 2023-08-01T19:55:31.812 INFO:teuthology.orchestra.run.smithi008.stdout: "time": "2023-08-01T19:55:05.570237+0000", 2023-08-01T19:55:31.812 INFO:teuthology.orchestra.run.smithi008.stdout: "duration": 0 2023-08-01T19:55:31.812 INFO:teuthology.orchestra.run.smithi008.stdout: }, 2023-08-01T19:55:31.812 INFO:teuthology.orchestra.run.smithi008.stdout: { 2023-08-01T19:55:31.812 INFO:teuthology.orchestra.run.smithi008.stdout: "event": "header_read", 2023-08-01T19:55:31.812 INFO:teuthology.orchestra.run.smithi008.stdout: "time": "2023-08-01T19:55:05.570236+0000", 2023-08-01T19:55:31.812 INFO:teuthology.orchestra.run.smithi008.stdout: "duration": 4294967295.9999995 2023-08-01T19:55:31.812 INFO:teuthology.orchestra.run.smithi008.stdout: }, 2023-08-01T19:55:31.813 INFO:teuthology.orchestra.run.smithi008.stdout: { 2023-08-01T19:55:31.813 INFO:teuthology.orchestra.run.smithi008.stdout: "event": "all_read", 2023-08-01T19:55:31.813 INFO:teuthology.orchestra.run.smithi008.stdout: "time": "2023-08-01T19:55:05.570354+0000", 2023-08-01T19:55:31.813 INFO:teuthology.orchestra.run.smithi008.stdout: "duration": 0.000118029 2023-08-01T19:55:31.813 INFO:teuthology.orchestra.run.smithi008.stdout: }, 2023-08-01T19:55:31.813 INFO:teuthology.orchestra.run.smithi008.stdout: { 2023-08-01T19:55:31.813 INFO:teuthology.orchestra.run.smithi008.stdout: "event": "dispatched", 2023-08-01T19:55:31.813 INFO:teuthology.orchestra.run.smithi008.stdout: "time": "2023-08-01T19:55:05.626649+0000", 2023-08-01T19:55:31.814 INFO:teuthology.orchestra.run.smithi008.stdout: "duration": 0.056294489000000003 2023-08-01T19:55:31.814 INFO:teuthology.orchestra.run.smithi008.stdout: }, 2023-08-01T19:55:31.814 INFO:teuthology.orchestra.run.smithi008.stdout: { 2023-08-01T19:55:31.814 INFO:teuthology.orchestra.run.smithi008.stdout: "event": "queued_for_pg", 2023-08-01T19:55:31.814 INFO:teuthology.orchestra.run.smithi008.stdout: "time": "2023-08-01T19:55:05.626676+0000", 2023-08-01T19:55:31.814 INFO:teuthology.orchestra.run.smithi008.stdout: "duration": 2.7228000000000001e-05 2023-08-01T19:55:31.814 INFO:teuthology.orchestra.run.smithi008.stdout: }, 2023-08-01T19:55:31.815 INFO:teuthology.orchestra.run.smithi008.stdout: { 2023-08-01T19:55:31.815 INFO:teuthology.orchestra.run.smithi008.stdout: "event": "reached_pg", 2023-08-01T19:55:31.815 INFO:teuthology.orchestra.run.smithi008.stdout: "time": "2023-08-01T19:55:05.626717+0000", 2023-08-01T19:55:31.815 INFO:teuthology.orchestra.run.smithi008.stdout: "duration": 4.1318e-05 2023-08-01T19:55:31.815 INFO:teuthology.orchestra.run.smithi008.stdout: }, 2023-08-01T19:55:31.815 INFO:teuthology.orchestra.run.smithi008.stdout: { 2023-08-01T19:55:31.815 INFO:teuthology.orchestra.run.smithi008.stdout: "event": "started", 2023-08-01T19:55:31.815 INFO:teuthology.orchestra.run.smithi008.stdout: "time": "2023-08-01T19:55:05.626737+0000", 2023-08-01T19:55:31.816 INFO:teuthology.orchestra.run.smithi008.stdout: "duration": 1.9415e-05 2023-08-01T19:55:31.816 INFO:teuthology.orchestra.run.smithi008.stdout: }, 2023-08-01T19:55:31.816 INFO:teuthology.orchestra.run.smithi008.stdout: { 2023-08-01T19:55:31.816 INFO:teuthology.orchestra.run.smithi008.stdout: "event": "commit_sent", 2023-08-01T19:55:31.816 INFO:teuthology.orchestra.run.smithi008.stdout: "time": "2023-08-01T19:55:05.635036+0000", 2023-08-01T19:55:31.816 INFO:teuthology.orchestra.run.smithi008.stdout: "duration": 0.0082987700000000005 2023-08-01T19:55:31.816 INFO:teuthology.orchestra.run.smithi008.stdout: }, 2023-08-01T19:55:31.816 INFO:teuthology.orchestra.run.smithi008.stdout: { 2023-08-01T19:55:31.817 INFO:teuthology.orchestra.run.smithi008.stdout: "event": "done", 2023-08-01T19:55:31.817 INFO:teuthology.orchestra.run.smithi008.stdout: "time": "2023-08-01T19:55:05.635067+0000", 2023-08-01T19:55:31.817 INFO:teuthology.orchestra.run.smithi008.stdout: "duration": 3.1786999999999999e-05 2023-08-01T19:55:31.817 INFO:teuthology.orchestra.run.smithi008.stdout: } 2023-08-01T19:55:31.817 INFO:teuthology.orchestra.run.smithi008.stdout: ] 2023-08-01T19:55:31.817 INFO:teuthology.orchestra.run.smithi008.stdout: } 2023-08-01T19:55:31.817 INFO:teuthology.orchestra.run.smithi008.stdout: }, 2023-08-01T19:55:31.818 INFO:teuthology.orchestra.run.smithi008.stdout: { 2023-08-01T19:55:31.818 INFO:teuthology.orchestra.run.smithi008.stdout: "description": "osd_op(client.4668.0:107863 5.3 5:cbdd875a:::benchmark_data_smithi006_114134_object107862:head [set-alloc-hint object_size 65536 write_size 65536,write 0~65536] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e38)", 2023-08-01T19:55:31.818 INFO:teuthology.orchestra.run.smithi008.stdout: "initiated_at": "2023-08-01T19:55:09.278851+0000", 2023-08-01T19:55:31.818 INFO:teuthology.orchestra.run.smithi008.stdout: "age": 22.398443412999999, 2023-08-01T19:55:31.818 INFO:teuthology.orchestra.run.smithi008.stdout: "duration": 0.071378853000000006, 2023-08-01T19:55:31.818 INFO:teuthology.orchestra.run.smithi008.stdout: "type_data": { 2023-08-01T19:55:31.818 INFO:teuthology.orchestra.run.smithi008.stdout: "flag_point": "commit sent; apply or cleanup", 2023-08-01T19:55:31.819 INFO:teuthology.orchestra.run.smithi008.stdout: "client_info": { 2023-08-01T19:55:31.819 INFO:teuthology.orchestra.run.smithi008.stdout: "client": "client.4668", 2023-08-01T19:55:31.819 INFO:teuthology.orchestra.run.smithi008.stdout: "client_addr": "172.21.15.6:0/1709472247", 2023-08-01T19:55:31.819 INFO:teuthology.orchestra.run.smithi008.stdout: "tid": 107863 2023-08-01T19:55:31.819 INFO:teuthology.orchestra.run.smithi008.stdout: }, 2023-08-01T19:55:31.819 INFO:teuthology.orchestra.run.smithi008.stdout: "events": [ 2023-08-01T19:55:31.819 INFO:teuthology.orchestra.run.smithi008.stdout: { 2023-08-01T19:55:31.819 INFO:teuthology.orchestra.run.smithi008.stdout: "event": "initiated", 2023-08-01T19:55:31.820 INFO:teuthology.orchestra.run.smithi008.stdout: "time": "2023-08-01T19:55:09.278851+0000", 2023-08-01T19:55:31.820 INFO:teuthology.orchestra.run.smithi008.stdout: "duration": 0 2023-08-01T19:55:31.820 INFO:teuthology.orchestra.run.smithi008.stdout: }, 2023-08-01T19:55:31.820 INFO:teuthology.orchestra.run.smithi008.stdout: { 2023-08-01T19:55:31.820 INFO:teuthology.orchestra.run.smithi008.stdout: "event": "throttled", 2023-08-01T19:55:31.820 INFO:teuthology.orchestra.run.smithi008.stdout: "time": "2023-08-01T19:55:09.278851+0000", 2023-08-01T19:55:31.820 INFO:teuthology.orchestra.run.smithi008.stdout: "duration": 0 2023-08-01T19:55:31.821 INFO:teuthology.orchestra.run.smithi008.stdout: }, 2023-08-01T19:55:31.821 INFO:teuthology.orchestra.run.smithi008.stdout: { 2023-08-01T19:55:31.821 INFO:teuthology.orchestra.run.smithi008.stdout: "event": "header_read", 2023-08-01T19:55:31.821 INFO:teuthology.orchestra.run.smithi008.stdout: "time": "2023-08-01T19:55:09.278850+0000", 2023-08-01T19:55:31.821 INFO:teuthology.orchestra.run.smithi008.stdout: "duration": 4294967295.999999 2023-08-01T19:55:31.821 INFO:teuthology.orchestra.run.smithi008.stdout: }, 2023-08-01T19:55:31.821 INFO:teuthology.orchestra.run.smithi008.stdout: { 2023-08-01T19:55:31.821 INFO:teuthology.orchestra.run.smithi008.stdout: "event": "all_read", 2023-08-01T19:55:31.822 INFO:teuthology.orchestra.run.smithi008.stdout: "time": "2023-08-01T19:55:09.278945+0000", 2023-08-01T19:55:31.822 INFO:teuthology.orchestra.run.smithi008.stdout: "duration": 9.4388000000000005e-05 2023-08-01T19:55:31.822 INFO:teuthology.orchestra.run.smithi008.stdout: }, 2023-08-01T19:55:31.822 INFO:teuthology.orchestra.run.smithi008.stdout: { 2023-08-01T19:55:31.822 INFO:teuthology.orchestra.run.smithi008.stdout: "event": "dispatched", 2023-08-01T19:55:31.822 INFO:teuthology.orchestra.run.smithi008.stdout: "time": "2023-08-01T19:55:09.278955+0000", 2023-08-01T19:55:31.822 INFO:teuthology.orchestra.run.smithi008.stdout: "duration": 1.0413e-05 2023-08-01T19:55:31.823 INFO:teuthology.orchestra.run.smithi008.stdout: }, 2023-08-01T19:55:31.823 INFO:teuthology.orchestra.run.smithi008.stdout: { 2023-08-01T19:55:31.823 INFO:teuthology.orchestra.run.smithi008.stdout: "event": "queued_for_pg", 2023-08-01T19:55:31.823 INFO:teuthology.orchestra.run.smithi008.stdout: "time": "2023-08-01T19:55:09.278962+0000", 2023-08-01T19:55:31.823 INFO:teuthology.orchestra.run.smithi008.stdout: "duration": 6.2169999999999999e-06 2023-08-01T19:55:31.823 INFO:teuthology.orchestra.run.smithi008.stdout: }, 2023-08-01T19:55:31.823 INFO:teuthology.orchestra.run.smithi008.stdout: { 2023-08-01T19:55:31.823 INFO:teuthology.orchestra.run.smithi008.stdout: "event": "reached_pg", 2023-08-01T19:55:31.824 INFO:teuthology.orchestra.run.smithi008.stdout: "time": "2023-08-01T19:55:09.280363+0000", 2023-08-01T19:55:31.824 INFO:teuthology.orchestra.run.smithi008.stdout: "duration": 0.0014014489999999999 2023-08-01T19:55:31.824 INFO:teuthology.orchestra.run.smithi008.stdout: }, 2023-08-01T19:55:31.824 INFO:teuthology.orchestra.run.smithi008.stdout: { 2023-08-01T19:55:31.824 INFO:teuthology.orchestra.run.smithi008.stdout: "event": "started", 2023-08-01T19:55:31.824 INFO:teuthology.orchestra.run.smithi008.stdout: "time": "2023-08-01T19:55:09.280488+0000", 2023-08-01T19:55:31.824 INFO:teuthology.orchestra.run.smithi008.stdout: "duration": 0.00012474099999999999 2023-08-01T19:55:31.824 INFO:teuthology.orchestra.run.smithi008.stdout: }, 2023-08-01T19:55:31.825 INFO:teuthology.orchestra.run.smithi008.stdout: { 2023-08-01T19:55:31.825 INFO:teuthology.orchestra.run.smithi008.stdout: "event": "waiting for subops from 1", 2023-08-01T19:55:31.825 INFO:teuthology.orchestra.run.smithi008.stdout: "time": "2023-08-01T19:55:09.280626+0000", 2023-08-01T19:55:31.825 INFO:teuthology.orchestra.run.smithi008.stdout: "duration": 0.000138193 2023-08-01T19:55:31.825 INFO:teuthology.orchestra.run.smithi008.stdout: }, 2023-08-01T19:55:31.825 INFO:teuthology.orchestra.run.smithi008.stdout: { 2023-08-01T19:55:31.825 INFO:teuthology.orchestra.run.smithi008.stdout: "event": "op_commit", 2023-08-01T19:55:31.826 INFO:teuthology.orchestra.run.smithi008.stdout: "time": "2023-08-01T19:55:09.285958+0000", 2023-08-01T19:55:31.826 INFO:teuthology.orchestra.run.smithi008.stdout: "duration": 0.0053317130000000001 2023-08-01T19:55:31.826 INFO:teuthology.orchestra.run.smithi008.stdout: }, 2023-08-01T19:55:31.826 INFO:teuthology.orchestra.run.smithi008.stdout: { 2023-08-01T19:55:31.826 INFO:teuthology.orchestra.run.smithi008.stdout: "event": "sub_op_commit_rec", 2023-08-01T19:55:31.826 INFO:teuthology.orchestra.run.smithi008.stdout: "time": "2023-08-01T19:55:09.350151+0000", 2023-08-01T19:55:31.826 INFO:teuthology.orchestra.run.smithi008.stdout: "duration": 0.064193202000000005 2023-08-01T19:55:31.826 INFO:teuthology.orchestra.run.smithi008.stdout: }, 2023-08-01T19:55:31.827 INFO:teuthology.orchestra.run.smithi008.stdout: { 2023-08-01T19:55:31.827 INFO:teuthology.orchestra.run.smithi008.stdout: "event": "commit_sent", 2023-08-01T19:55:31.827 INFO:teuthology.orchestra.run.smithi008.stdout: "time": "2023-08-01T19:55:09.350188+0000", 2023-08-01T19:55:31.827 INFO:teuthology.orchestra.run.smithi008.stdout: "duration": 3.7549999999999998e-05 2023-08-01T19:55:31.827 INFO:teuthology.orchestra.run.smithi008.stdout: }, 2023-08-01T19:55:31.827 INFO:teuthology.orchestra.run.smithi008.stdout: { 2023-08-01T19:55:31.827 INFO:teuthology.orchestra.run.smithi008.stdout: "event": "done", 2023-08-01T19:55:31.827 INFO:teuthology.orchestra.run.smithi008.stdout: "time": "2023-08-01T19:55:09.350230+0000", 2023-08-01T19:55:31.828 INFO:teuthology.orchestra.run.smithi008.stdout: "duration": 4.1804999999999997e-05 2023-08-01T19:55:31.828 INFO:teuthology.orchestra.run.smithi008.stdout: } 2023-08-01T19:55:31.828 INFO:teuthology.orchestra.run.smithi008.stdout: ] 2023-08-01T19:55:31.828 INFO:teuthology.orchestra.run.smithi008.stdout: } 2023-08-01T19:55:31.828 INFO:teuthology.orchestra.run.smithi008.stdout: }, 2023-08-01T19:55:31.828 INFO:teuthology.orchestra.run.smithi008.stdout: { 2023-08-01T19:55:31.828 INFO:teuthology.orchestra.run.smithi008.stdout: "description": "osd_op(client.4668.0:107865 5.3 5:c2ebb96d:::benchmark_data_smithi006_114134_object107864:head [set-alloc-hint object_size 65536 write_size 65536,write 0~65536] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e38)", 2023-08-01T19:55:31.828 INFO:teuthology.orchestra.run.smithi008.stdout: "initiated_at": "2023-08-01T19:55:09.279020+0000", 2023-08-01T19:55:31.829 INFO:teuthology.orchestra.run.smithi008.stdout: "age": 22.398274741000002, 2023-08-01T19:55:31.829 INFO:teuthology.orchestra.run.smithi008.stdout: "duration": 0.072892565000000006, 2023-08-01T19:55:31.829 INFO:teuthology.orchestra.run.smithi008.stdout: "type_data": { 2023-08-01T19:55:31.829 INFO:teuthology.orchestra.run.smithi008.stdout: "flag_point": "commit sent; apply or cleanup", 2023-08-01T19:55:31.829 INFO:teuthology.orchestra.run.smithi008.stdout: "client_info": { 2023-08-01T19:55:31.829 INFO:teuthology.orchestra.run.smithi008.stdout: "client": "client.4668", 2023-08-01T19:55:31.829 INFO:teuthology.orchestra.run.smithi008.stdout: "client_addr": "172.21.15.6:0/1709472247", 2023-08-01T19:55:31.829 INFO:teuthology.orchestra.run.smithi008.stdout: "tid": 107865 2023-08-01T19:55:31.830 INFO:teuthology.orchestra.run.smithi008.stdout: }, 2023-08-01T19:55:31.830 INFO:teuthology.orchestra.run.smithi008.stdout: "events": [ 2023-08-01T19:55:31.830 INFO:teuthology.orchestra.run.smithi008.stdout: { 2023-08-01T19:55:31.830 INFO:teuthology.orchestra.run.smithi008.stdout: "event": "initiated", 2023-08-01T19:55:31.830 INFO:teuthology.orchestra.run.smithi008.stdout: "time": "2023-08-01T19:55:09.279020+0000", 2023-08-01T19:55:31.830 INFO:teuthology.orchestra.run.smithi008.stdout: "duration": 0 2023-08-01T19:55:31.830 INFO:teuthology.orchestra.run.smithi008.stdout: }, 2023-08-01T19:55:31.831 INFO:teuthology.orchestra.run.smithi008.stdout: { 2023-08-01T19:55:31.831 INFO:teuthology.orchestra.run.smithi008.stdout: "event": "throttled", 2023-08-01T19:55:31.831 INFO:teuthology.orchestra.run.smithi008.stdout: "time": "2023-08-01T19:55:09.279020+0000", 2023-08-01T19:55:31.831 INFO:teuthology.orchestra.run.smithi008.stdout: "duration": 0 2023-08-01T19:55:31.831 INFO:teuthology.orchestra.run.smithi008.stdout: }, 2023-08-01T19:55:31.831 INFO:teuthology.orchestra.run.smithi008.stdout: { 2023-08-01T19:55:31.831 INFO:teuthology.orchestra.run.smithi008.stdout: "event": "header_read", 2023-08-01T19:55:31.831 INFO:teuthology.orchestra.run.smithi008.stdout: "time": "2023-08-01T19:55:09.279019+0000", 2023-08-01T19:55:31.832 INFO:teuthology.orchestra.run.smithi008.stdout: "duration": 4294967295.999999 2023-08-01T19:55:31.832 INFO:teuthology.orchestra.run.smithi008.stdout: }, 2023-08-01T19:55:31.832 INFO:teuthology.orchestra.run.smithi008.stdout: { 2023-08-01T19:55:31.832 INFO:teuthology.orchestra.run.smithi008.stdout: "event": "all_read", 2023-08-01T19:55:31.832 INFO:teuthology.orchestra.run.smithi008.stdout: "time": "2023-08-01T19:55:09.279087+0000", 2023-08-01T19:55:31.832 INFO:teuthology.orchestra.run.smithi008.stdout: "duration": 6.8392000000000005e-05 2023-08-01T19:55:31.832 INFO:teuthology.orchestra.run.smithi008.stdout: }, 2023-08-01T19:55:31.832 INFO:teuthology.orchestra.run.smithi008.stdout: { 2023-08-01T19:55:31.833 INFO:teuthology.orchestra.run.smithi008.stdout: "event": "dispatched", 2023-08-01T19:55:31.833 INFO:teuthology.orchestra.run.smithi008.stdout: "time": "2023-08-01T19:55:09.279095+0000", 2023-08-01T19:55:31.833 INFO:teuthology.orchestra.run.smithi008.stdout: "duration": 8.0989999999999999e-06 2023-08-01T19:55:31.833 INFO:teuthology.orchestra.run.smithi008.stdout: }, 2023-08-01T19:55:31.833 INFO:teuthology.orchestra.run.smithi008.stdout: { 2023-08-01T19:55:31.833 INFO:teuthology.orchestra.run.smithi008.stdout: "event": "queued_for_pg", 2023-08-01T19:55:31.833 INFO:teuthology.orchestra.run.smithi008.stdout: "time": "2023-08-01T19:55:09.279101+0000", 2023-08-01T19:55:31.833 INFO:teuthology.orchestra.run.smithi008.stdout: "duration": 5.0390000000000004e-06 2023-08-01T19:55:31.834 INFO:teuthology.orchestra.run.smithi008.stdout: }, 2023-08-01T19:55:31.834 INFO:teuthology.orchestra.run.smithi008.stdout: { 2023-08-01T19:55:31.834 INFO:teuthology.orchestra.run.smithi008.stdout: "event": "reached_pg", 2023-08-01T19:55:31.834 INFO:teuthology.orchestra.run.smithi008.stdout: "time": "2023-08-01T19:55:09.282574+0000", 2023-08-01T19:55:31.834 INFO:teuthology.orchestra.run.smithi008.stdout: "duration": 0.0034730619999999999 2023-08-01T19:55:31.834 INFO:teuthology.orchestra.run.smithi008.stdout: }, 2023-08-01T19:55:31.834 INFO:teuthology.orchestra.run.smithi008.stdout: { 2023-08-01T19:55:31.834 INFO:teuthology.orchestra.run.smithi008.stdout: "event": "started", 2023-08-01T19:55:31.835 INFO:teuthology.orchestra.run.smithi008.stdout: "time": "2023-08-01T19:55:09.282705+0000", 2023-08-01T19:55:31.835 INFO:teuthology.orchestra.run.smithi008.stdout: "duration": 0.00013133400000000001 2023-08-01T19:55:31.835 INFO:teuthology.orchestra.run.smithi008.stdout: }, 2023-08-01T19:55:31.835 INFO:teuthology.orchestra.run.smithi008.stdout: { 2023-08-01T19:55:31.835 INFO:teuthology.orchestra.run.smithi008.stdout: "event": "waiting for subops from 1", 2023-08-01T19:55:31.835 INFO:teuthology.orchestra.run.smithi008.stdout: "time": "2023-08-01T19:55:09.283067+0000", 2023-08-01T19:55:31.835 INFO:teuthology.orchestra.run.smithi008.stdout: "duration": 0.00036195299999999998 2023-08-01T19:55:31.835 INFO:teuthology.orchestra.run.smithi008.stdout: }, 2023-08-01T19:55:31.836 INFO:teuthology.orchestra.run.smithi008.stdout: { 2023-08-01T19:55:31.836 INFO:teuthology.orchestra.run.smithi008.stdout: "event": "op_commit", 2023-08-01T19:55:31.836 INFO:teuthology.orchestra.run.smithi008.stdout: "time": "2023-08-01T19:55:09.288196+0000", 2023-08-01T19:55:31.836 INFO:teuthology.orchestra.run.smithi008.stdout: "duration": 0.0051293780000000004 2023-08-01T19:55:31.836 INFO:teuthology.orchestra.run.smithi008.stdout: }, 2023-08-01T19:55:31.836 INFO:teuthology.orchestra.run.smithi008.stdout: { 2023-08-01T19:55:31.836 INFO:teuthology.orchestra.run.smithi008.stdout: "event": "sub_op_commit_rec", 2023-08-01T19:55:31.836 INFO:teuthology.orchestra.run.smithi008.stdout: "time": "2023-08-01T19:55:09.351832+0000", 2023-08-01T19:55:31.837 INFO:teuthology.orchestra.run.smithi008.stdout: "duration": 0.063636076 2023-08-01T19:55:31.837 INFO:teuthology.orchestra.run.smithi008.stdout: }, 2023-08-01T19:55:31.837 INFO:teuthology.orchestra.run.smithi008.stdout: { 2023-08-01T19:55:31.837 INFO:teuthology.orchestra.run.smithi008.stdout: "event": "commit_sent", 2023-08-01T19:55:31.837 INFO:teuthology.orchestra.run.smithi008.stdout: "time": "2023-08-01T19:55:09.351878+0000", 2023-08-01T19:55:31.837 INFO:teuthology.orchestra.run.smithi008.stdout: "duration": 4.5408999999999998e-05 2023-08-01T19:55:31.837 INFO:teuthology.orchestra.run.smithi008.stdout: }, 2023-08-01T19:55:31.837 INFO:teuthology.orchestra.run.smithi008.stdout: { 2023-08-01T19:55:31.838 INFO:teuthology.orchestra.run.smithi008.stdout: "event": "done", 2023-08-01T19:55:31.838 INFO:teuthology.orchestra.run.smithi008.stdout: "time": "2023-08-01T19:55:09.351913+0000", 2023-08-01T19:55:31.838 INFO:teuthology.orchestra.run.smithi008.stdout: "duration": 3.4808999999999998e-05 2023-08-01T19:55:31.838 INFO:teuthology.orchestra.run.smithi008.stdout: } 2023-08-01T19:55:31.838 INFO:teuthology.orchestra.run.smithi008.stdout: ] 2023-08-01T19:55:31.838 INFO:teuthology.orchestra.run.smithi008.stdout: } 2023-08-01T19:55:31.838 INFO:teuthology.orchestra.run.smithi008.stdout: }, 2023-08-01T19:55:31.838 INFO:teuthology.orchestra.run.smithi008.stdout: { 2023-08-01T19:55:31.839 INFO:teuthology.orchestra.run.smithi008.stdout: "description": "osd_op(client.4668.0:107869 5.c 5:31910384:::benchmark_data_smithi006_114134_object107868:head [set-alloc-hint object_size 65536 write_size 65536,write 0~65536] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e38)", 2023-08-01T19:55:31.839 INFO:teuthology.orchestra.run.smithi008.stdout: "initiated_at": "2023-08-01T19:55:09.283205+0000", 2023-08-01T19:55:31.839 INFO:teuthology.orchestra.run.smithi008.stdout: "age": 22.394089575999999, 2023-08-01T19:55:31.839 INFO:teuthology.orchestra.run.smithi008.stdout: "duration": 0.068611808999999996, 2023-08-01T19:55:31.839 INFO:teuthology.orchestra.run.smithi008.stdout: "type_data": { 2023-08-01T19:55:31.839 INFO:teuthology.orchestra.run.smithi008.stdout: "flag_point": "commit sent; apply or cleanup", 2023-08-01T19:55:31.839 INFO:teuthology.orchestra.run.smithi008.stdout: "client_info": { 2023-08-01T19:55:31.839 INFO:teuthology.orchestra.run.smithi008.stdout: "client": "client.4668", 2023-08-01T19:55:31.840 INFO:teuthology.orchestra.run.smithi008.stdout: "client_addr": "172.21.15.6:0/1709472247", 2023-08-01T19:55:31.840 INFO:teuthology.orchestra.run.smithi008.stdout: "tid": 107869 2023-08-01T19:55:31.840 INFO:teuthology.orchestra.run.smithi008.stdout: }, 2023-08-01T19:55:31.840 INFO:teuthology.orchestra.run.smithi008.stdout: "events": [ 2023-08-01T19:55:31.840 INFO:teuthology.orchestra.run.smithi008.stdout: { 2023-08-01T19:55:31.840 INFO:teuthology.orchestra.run.smithi008.stdout: "event": "initiated", 2023-08-01T19:55:31.840 INFO:teuthology.orchestra.run.smithi008.stdout: "time": "2023-08-01T19:55:09.283205+0000", 2023-08-01T19:55:31.841 INFO:teuthology.orchestra.run.smithi008.stdout: "duration": 0 2023-08-01T19:55:31.841 INFO:teuthology.orchestra.run.smithi008.stdout: }, 2023-08-01T19:55:31.841 INFO:teuthology.orchestra.run.smithi008.stdout: { 2023-08-01T19:55:31.841 INFO:teuthology.orchestra.run.smithi008.stdout: "event": "throttled", 2023-08-01T19:55:31.841 INFO:teuthology.orchestra.run.smithi008.stdout: "time": "2023-08-01T19:55:09.283205+0000", 2023-08-01T19:55:31.841 INFO:teuthology.orchestra.run.smithi008.stdout: "duration": 0 2023-08-01T19:55:31.841 INFO:teuthology.orchestra.run.smithi008.stdout: }, 2023-08-01T19:55:31.841 INFO:teuthology.orchestra.run.smithi008.stdout: { 2023-08-01T19:55:31.842 INFO:teuthology.orchestra.run.smithi008.stdout: "event": "header_read", 2023-08-01T19:55:31.842 INFO:teuthology.orchestra.run.smithi008.stdout: "time": "2023-08-01T19:55:09.283204+0000", 2023-08-01T19:55:31.842 INFO:teuthology.orchestra.run.smithi008.stdout: "duration": 4294967295.999999 2023-08-01T19:55:31.842 INFO:teuthology.orchestra.run.smithi008.stdout: }, 2023-08-01T19:55:31.842 INFO:teuthology.orchestra.run.smithi008.stdout: { 2023-08-01T19:55:31.842 INFO:teuthology.orchestra.run.smithi008.stdout: "event": "all_read", 2023-08-01T19:55:31.842 INFO:teuthology.orchestra.run.smithi008.stdout: "time": "2023-08-01T19:55:09.283300+0000", 2023-08-01T19:55:31.842 INFO:teuthology.orchestra.run.smithi008.stdout: "duration": 9.6280000000000007e-05 2023-08-01T19:55:31.843 INFO:teuthology.orchestra.run.smithi008.stdout: }, 2023-08-01T19:55:31.843 INFO:teuthology.orchestra.run.smithi008.stdout: { 2023-08-01T19:55:31.843 INFO:teuthology.orchestra.run.smithi008.stdout: "event": "dispatched", 2023-08-01T19:55:31.843 INFO:teuthology.orchestra.run.smithi008.stdout: "time": "2023-08-01T19:55:09.283314+0000", 2023-08-01T19:55:31.843 INFO:teuthology.orchestra.run.smithi008.stdout: "duration": 1.3344e-05 2023-08-01T19:55:31.843 INFO:teuthology.orchestra.run.smithi008.stdout: }, 2023-08-01T19:55:31.843 INFO:teuthology.orchestra.run.smithi008.stdout: { 2023-08-01T19:55:31.843 INFO:teuthology.orchestra.run.smithi008.stdout: "event": "queued_for_pg", 2023-08-01T19:55:31.844 INFO:teuthology.orchestra.run.smithi008.stdout: "time": "2023-08-01T19:55:09.283320+0000", 2023-08-01T19:55:31.844 INFO:teuthology.orchestra.run.smithi008.stdout: "duration": 6.0299999999999999e-06 2023-08-01T19:55:31.844 INFO:teuthology.orchestra.run.smithi008.stdout: }, 2023-08-01T19:55:31.844 INFO:teuthology.orchestra.run.smithi008.stdout: { 2023-08-01T19:55:31.844 INFO:teuthology.orchestra.run.smithi008.stdout: "event": "reached_pg", 2023-08-01T19:55:31.844 INFO:teuthology.orchestra.run.smithi008.stdout: "time": "2023-08-01T19:55:09.283365+0000", 2023-08-01T19:55:31.844 INFO:teuthology.orchestra.run.smithi008.stdout: "duration": 4.5578999999999998e-05 2023-08-01T19:55:31.844 INFO:teuthology.orchestra.run.smithi008.stdout: }, 2023-08-01T19:55:31.845 INFO:teuthology.orchestra.run.smithi008.stdout: { 2023-08-01T19:55:31.845 INFO:teuthology.orchestra.run.smithi008.stdout: "event": "started", 2023-08-01T19:55:31.845 INFO:teuthology.orchestra.run.smithi008.stdout: "time": "2023-08-01T19:55:09.283490+0000", 2023-08-01T19:55:31.845 INFO:teuthology.orchestra.run.smithi008.stdout: "duration": 0.00012473700000000001 2023-08-01T19:55:31.845 INFO:teuthology.orchestra.run.smithi008.stdout: }, 2023-08-01T19:55:31.845 INFO:teuthology.orchestra.run.smithi008.stdout: { 2023-08-01T19:55:31.845 INFO:teuthology.orchestra.run.smithi008.stdout: "event": "waiting for subops from 1", 2023-08-01T19:55:31.845 INFO:teuthology.orchestra.run.smithi008.stdout: "time": "2023-08-01T19:55:09.283637+0000", 2023-08-01T19:55:31.846 INFO:teuthology.orchestra.run.smithi008.stdout: "duration": 0.00014715600000000001 2023-08-01T19:55:31.846 INFO:teuthology.orchestra.run.smithi008.stdout: }, 2023-08-01T19:55:31.846 INFO:teuthology.orchestra.run.smithi008.stdout: { 2023-08-01T19:55:31.846 INFO:teuthology.orchestra.run.smithi008.stdout: "event": "op_commit", 2023-08-01T19:55:31.846 INFO:teuthology.orchestra.run.smithi008.stdout: "time": "2023-08-01T19:55:09.288214+0000", 2023-08-01T19:55:31.846 INFO:teuthology.orchestra.run.smithi008.stdout: "duration": 0.0045769560000000001 2023-08-01T19:55:31.846 INFO:teuthology.orchestra.run.smithi008.stdout: }, 2023-08-01T19:55:31.846 INFO:teuthology.orchestra.run.smithi008.stdout: { 2023-08-01T19:55:31.847 INFO:teuthology.orchestra.run.smithi008.stdout: "event": "sub_op_commit_rec", 2023-08-01T19:55:31.847 INFO:teuthology.orchestra.run.smithi008.stdout: "time": "2023-08-01T19:55:09.351721+0000", 2023-08-01T19:55:31.847 INFO:teuthology.orchestra.run.smithi008.stdout: "duration": 0.063507383000000001 2023-08-01T19:55:31.847 INFO:teuthology.orchestra.run.smithi008.stdout: }, 2023-08-01T19:55:31.847 INFO:teuthology.orchestra.run.smithi008.stdout: { 2023-08-01T19:55:31.847 INFO:teuthology.orchestra.run.smithi008.stdout: "event": "commit_sent", 2023-08-01T19:55:31.847 INFO:teuthology.orchestra.run.smithi008.stdout: "time": "2023-08-01T19:55:09.351777+0000", 2023-08-01T19:55:31.847 INFO:teuthology.orchestra.run.smithi008.stdout: "duration": 5.5733999999999999e-05 2023-08-01T19:55:31.848 INFO:teuthology.orchestra.run.smithi008.stdout: }, 2023-08-01T19:55:31.848 INFO:teuthology.orchestra.run.smithi008.stdout: { 2023-08-01T19:55:31.848 INFO:teuthology.orchestra.run.smithi008.stdout: "event": "done", 2023-08-01T19:55:31.848 INFO:teuthology.orchestra.run.smithi008.stdout: "time": "2023-08-01T19:55:09.351817+0000", 2023-08-01T19:55:31.848 INFO:teuthology.orchestra.run.smithi008.stdout: "duration": 3.9765000000000003e-05 2023-08-01T19:55:31.848 INFO:teuthology.orchestra.run.smithi008.stdout: } 2023-08-01T19:55:31.848 INFO:teuthology.orchestra.run.smithi008.stdout: ] 2023-08-01T19:55:31.849 INFO:teuthology.orchestra.run.smithi008.stdout: } 2023-08-01T19:55:31.849 INFO:teuthology.orchestra.run.smithi008.stdout: }, 2023-08-01T19:55:31.849 INFO:teuthology.orchestra.run.smithi008.stdout: { 2023-08-01T19:55:31.849 INFO:teuthology.orchestra.run.smithi008.stdout: "description": "osd_op(client.4668.0:107874 5.3 5:ce4c2799:::benchmark_data_smithi006_114134_object107873:head [set-alloc-hint object_size 65536 write_size 65536,write 0~65536] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e38)", 2023-08-01T19:55:31.849 INFO:teuthology.orchestra.run.smithi008.stdout: "initiated_at": "2023-08-01T19:55:09.286239+0000", 2023-08-01T19:55:31.849 INFO:teuthology.orchestra.run.smithi008.stdout: "age": 22.391056071000001, 2023-08-01T19:55:31.849 INFO:teuthology.orchestra.run.smithi008.stdout: "duration": 0.068224389999999996, 2023-08-01T19:55:31.849 INFO:teuthology.orchestra.run.smithi008.stdout: "type_data": { 2023-08-01T19:55:31.850 INFO:teuthology.orchestra.run.smithi008.stdout: "flag_point": "commit sent; apply or cleanup", 2023-08-01T19:55:31.850 INFO:teuthology.orchestra.run.smithi008.stdout: "client_info": { 2023-08-01T19:55:31.850 INFO:teuthology.orchestra.run.smithi008.stdout: "client": "client.4668", 2023-08-01T19:55:31.850 INFO:teuthology.orchestra.run.smithi008.stdout: "client_addr": "172.21.15.6:0/1709472247", 2023-08-01T19:55:31.850 INFO:teuthology.orchestra.run.smithi008.stdout: "tid": 107874 2023-08-01T19:55:31.850 INFO:teuthology.orchestra.run.smithi008.stdout: }, 2023-08-01T19:55:31.850 INFO:teuthology.orchestra.run.smithi008.stdout: "events": [ 2023-08-01T19:55:31.850 INFO:teuthology.orchestra.run.smithi008.stdout: { 2023-08-01T19:55:31.851 INFO:teuthology.orchestra.run.smithi008.stdout: "event": "initiated", 2023-08-01T19:55:31.851 INFO:teuthology.orchestra.run.smithi008.stdout: "time": "2023-08-01T19:55:09.286239+0000", 2023-08-01T19:55:31.851 INFO:teuthology.orchestra.run.smithi008.stdout: "duration": 0 2023-08-01T19:55:31.851 INFO:teuthology.orchestra.run.smithi008.stdout: }, 2023-08-01T19:55:31.851 INFO:teuthology.orchestra.run.smithi008.stdout: { 2023-08-01T19:55:31.851 INFO:teuthology.orchestra.run.smithi008.stdout: "event": "throttled", 2023-08-01T19:55:31.851 INFO:teuthology.orchestra.run.smithi008.stdout: "time": "2023-08-01T19:55:09.286239+0000", 2023-08-01T19:55:31.851 INFO:teuthology.orchestra.run.smithi008.stdout: "duration": 0 2023-08-01T19:55:31.852 INFO:teuthology.orchestra.run.smithi008.stdout: }, 2023-08-01T19:55:31.852 INFO:teuthology.orchestra.run.smithi008.stdout: { 2023-08-01T19:55:31.852 INFO:teuthology.orchestra.run.smithi008.stdout: "event": "header_read", 2023-08-01T19:55:31.852 INFO:teuthology.orchestra.run.smithi008.stdout: "time": "2023-08-01T19:55:09.286238+0000", 2023-08-01T19:55:31.852 INFO:teuthology.orchestra.run.smithi008.stdout: "duration": 4294967295.999999 2023-08-01T19:55:31.852 INFO:teuthology.orchestra.run.smithi008.stdout: }, 2023-08-01T19:55:31.852 INFO:teuthology.orchestra.run.smithi008.stdout: { 2023-08-01T19:55:31.853 INFO:teuthology.orchestra.run.smithi008.stdout: "event": "all_read", 2023-08-01T19:55:31.853 INFO:teuthology.orchestra.run.smithi008.stdout: "time": "2023-08-01T19:55:09.286310+0000", 2023-08-01T19:55:31.853 INFO:teuthology.orchestra.run.smithi008.stdout: "duration": 7.2583999999999995e-05 2023-08-01T19:55:31.853 INFO:teuthology.orchestra.run.smithi008.stdout: }, 2023-08-01T19:55:31.853 INFO:teuthology.orchestra.run.smithi008.stdout: { 2023-08-01T19:55:31.853 INFO:teuthology.orchestra.run.smithi008.stdout: "event": "dispatched", 2023-08-01T19:55:31.853 INFO:teuthology.orchestra.run.smithi008.stdout: "time": "2023-08-01T19:55:09.286323+0000", 2023-08-01T19:55:31.853 INFO:teuthology.orchestra.run.smithi008.stdout: "duration": 1.3151e-05 2023-08-01T19:55:31.854 INFO:teuthology.orchestra.run.smithi008.stdout: }, 2023-08-01T19:55:31.854 INFO:teuthology.orchestra.run.smithi008.stdout: { 2023-08-01T19:55:31.854 INFO:teuthology.orchestra.run.smithi008.stdout: "event": "queued_for_pg", 2023-08-01T19:55:31.854 INFO:teuthology.orchestra.run.smithi008.stdout: "time": "2023-08-01T19:55:09.286329+0000", 2023-08-01T19:55:31.854 INFO:teuthology.orchestra.run.smithi008.stdout: "duration": 5.8719999999999999e-06 2023-08-01T19:55:31.854 INFO:teuthology.orchestra.run.smithi008.stdout: }, 2023-08-01T19:55:31.854 INFO:teuthology.orchestra.run.smithi008.stdout: { 2023-08-01T19:55:31.855 INFO:teuthology.orchestra.run.smithi008.stdout: "event": "reached_pg", 2023-08-01T19:55:31.855 INFO:teuthology.orchestra.run.smithi008.stdout: "time": "2023-08-01T19:55:09.286392+0000", 2023-08-01T19:55:31.855 INFO:teuthology.orchestra.run.smithi008.stdout: "duration": 6.2378000000000005e-05 2023-08-01T19:55:31.855 INFO:teuthology.orchestra.run.smithi008.stdout: }, 2023-08-01T19:55:31.855 INFO:teuthology.orchestra.run.smithi008.stdout: { 2023-08-01T19:55:31.855 INFO:teuthology.orchestra.run.smithi008.stdout: "event": "started", 2023-08-01T19:55:31.855 INFO:teuthology.orchestra.run.smithi008.stdout: "time": "2023-08-01T19:55:09.286473+0000", 2023-08-01T19:55:31.855 INFO:teuthology.orchestra.run.smithi008.stdout: "duration": 8.1327000000000002e-05 2023-08-01T19:55:31.856 INFO:teuthology.orchestra.run.smithi008.stdout: }, 2023-08-01T19:55:31.856 INFO:teuthology.orchestra.run.smithi008.stdout: { 2023-08-01T19:55:31.856 INFO:teuthology.orchestra.run.smithi008.stdout: "event": "waiting for subops from 1", 2023-08-01T19:55:31.856 INFO:teuthology.orchestra.run.smithi008.stdout: "time": "2023-08-01T19:55:09.286557+0000", 2023-08-01T19:55:31.856 INFO:teuthology.orchestra.run.smithi008.stdout: "duration": 8.4140000000000004e-05 2023-08-01T19:55:31.856 INFO:teuthology.orchestra.run.smithi008.stdout: }, 2023-08-01T19:55:31.856 INFO:teuthology.orchestra.run.smithi008.stdout: { 2023-08-01T19:55:31.856 INFO:teuthology.orchestra.run.smithi008.stdout: "event": "op_commit", 2023-08-01T19:55:31.857 INFO:teuthology.orchestra.run.smithi008.stdout: "time": "2023-08-01T19:55:09.290681+0000", 2023-08-01T19:55:31.857 INFO:teuthology.orchestra.run.smithi008.stdout: "duration": 0.0041242420000000002 2023-08-01T19:55:31.857 INFO:teuthology.orchestra.run.smithi008.stdout: }, 2023-08-01T19:55:31.857 INFO:teuthology.orchestra.run.smithi008.stdout: { 2023-08-01T19:55:31.857 INFO:teuthology.orchestra.run.smithi008.stdout: "event": "sub_op_commit_rec", 2023-08-01T19:55:31.857 INFO:teuthology.orchestra.run.smithi008.stdout: "time": "2023-08-01T19:55:09.354372+0000", 2023-08-01T19:55:31.857 INFO:teuthology.orchestra.run.smithi008.stdout: "duration": 0.063690438000000002 2023-08-01T19:55:31.858 INFO:teuthology.orchestra.run.smithi008.stdout: }, 2023-08-01T19:55:31.858 INFO:teuthology.orchestra.run.smithi008.stdout: { 2023-08-01T19:55:31.858 INFO:teuthology.orchestra.run.smithi008.stdout: "event": "commit_sent", 2023-08-01T19:55:31.858 INFO:teuthology.orchestra.run.smithi008.stdout: "time": "2023-08-01T19:55:09.354421+0000", 2023-08-01T19:55:31.858 INFO:teuthology.orchestra.run.smithi008.stdout: "duration": 4.9413000000000003e-05 2023-08-01T19:55:31.858 INFO:teuthology.orchestra.run.smithi008.stdout: }, 2023-08-01T19:55:31.858 INFO:teuthology.orchestra.run.smithi008.stdout: { 2023-08-01T19:55:31.858 INFO:teuthology.orchestra.run.smithi008.stdout: "event": "done", 2023-08-01T19:55:31.859 INFO:teuthology.orchestra.run.smithi008.stdout: "time": "2023-08-01T19:55:09.354463+0000", 2023-08-01T19:55:31.859 INFO:teuthology.orchestra.run.smithi008.stdout: "duration": 4.1924e-05 2023-08-01T19:55:31.859 INFO:teuthology.orchestra.run.smithi008.stdout: } 2023-08-01T19:55:31.859 INFO:teuthology.orchestra.run.smithi008.stdout: ] 2023-08-01T19:55:31.859 INFO:teuthology.orchestra.run.smithi008.stdout: } 2023-08-01T19:55:31.859 INFO:teuthology.orchestra.run.smithi008.stdout: }, 2023-08-01T19:55:31.859 INFO:teuthology.orchestra.run.smithi008.stdout: { 2023-08-01T19:55:31.859 INFO:teuthology.orchestra.run.smithi008.stdout: "description": "osd_op(client.4668.0:107875 5.5 5:af4ec927:::benchmark_data_smithi006_114134_object107874:head [set-alloc-hint object_size 65536 write_size 65536,write 0~65536] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e38)", 2023-08-01T19:55:31.860 INFO:teuthology.orchestra.run.smithi008.stdout: "initiated_at": "2023-08-01T19:55:09.287186+0000", 2023-08-01T19:55:31.860 INFO:teuthology.orchestra.run.smithi008.stdout: "age": 22.390108284, 2023-08-01T19:55:31.860 INFO:teuthology.orchestra.run.smithi008.stdout: "duration": 0.064764719999999998, 2023-08-01T19:55:31.860 INFO:teuthology.orchestra.run.smithi008.stdout: "type_data": { 2023-08-01T19:55:31.860 INFO:teuthology.orchestra.run.smithi008.stdout: "flag_point": "commit sent; apply or cleanup", 2023-08-01T19:55:31.860 INFO:teuthology.orchestra.run.smithi008.stdout: "client_info": { 2023-08-01T19:55:31.860 INFO:teuthology.orchestra.run.smithi008.stdout: "client": "client.4668", 2023-08-01T19:55:31.860 INFO:teuthology.orchestra.run.smithi008.stdout: "client_addr": "172.21.15.6:0/1709472247", 2023-08-01T19:55:31.861 INFO:teuthology.orchestra.run.smithi008.stdout: "tid": 107875 2023-08-01T19:55:31.861 INFO:teuthology.orchestra.run.smithi008.stdout: }, 2023-08-01T19:55:31.861 INFO:teuthology.orchestra.run.smithi008.stdout: "events": [ 2023-08-01T19:55:31.861 INFO:teuthology.orchestra.run.smithi008.stdout: { 2023-08-01T19:55:31.861 INFO:teuthology.orchestra.run.smithi008.stdout: "event": "initiated", 2023-08-01T19:55:31.861 INFO:teuthology.orchestra.run.smithi008.stdout: "time": "2023-08-01T19:55:09.287186+0000", 2023-08-01T19:55:31.861 INFO:teuthology.orchestra.run.smithi008.stdout: "duration": 0 2023-08-01T19:55:31.861 INFO:teuthology.orchestra.run.smithi008.stdout: }, 2023-08-01T19:55:31.862 INFO:teuthology.orchestra.run.smithi008.stdout: { 2023-08-01T19:55:31.862 INFO:teuthology.orchestra.run.smithi008.stdout: "event": "throttled", 2023-08-01T19:55:31.862 INFO:teuthology.orchestra.run.smithi008.stdout: "time": "2023-08-01T19:55:09.287186+0000", 2023-08-01T19:55:31.862 INFO:teuthology.orchestra.run.smithi008.stdout: "duration": 0 2023-08-01T19:55:31.862 INFO:teuthology.orchestra.run.smithi008.stdout: }, 2023-08-01T19:55:31.862 INFO:teuthology.orchestra.run.smithi008.stdout: { 2023-08-01T19:55:31.862 INFO:teuthology.orchestra.run.smithi008.stdout: "event": "header_read", 2023-08-01T19:55:31.862 INFO:teuthology.orchestra.run.smithi008.stdout: "time": "2023-08-01T19:55:09.287186+0000", 2023-08-01T19:55:31.863 INFO:teuthology.orchestra.run.smithi008.stdout: "duration": 4294967295.999999 2023-08-01T19:55:31.863 INFO:teuthology.orchestra.run.smithi008.stdout: }, 2023-08-01T19:55:31.863 INFO:teuthology.orchestra.run.smithi008.stdout: { 2023-08-01T19:55:31.863 INFO:teuthology.orchestra.run.smithi008.stdout: "event": "all_read", 2023-08-01T19:55:31.863 INFO:teuthology.orchestra.run.smithi008.stdout: "time": "2023-08-01T19:55:09.287248+0000", 2023-08-01T19:55:31.863 INFO:teuthology.orchestra.run.smithi008.stdout: "duration": 6.2922000000000005e-05 2023-08-01T19:55:31.863 INFO:teuthology.orchestra.run.smithi008.stdout: }, 2023-08-01T19:55:31.863 INFO:teuthology.orchestra.run.smithi008.stdout: { 2023-08-01T19:55:31.864 INFO:teuthology.orchestra.run.smithi008.stdout: "event": "dispatched", 2023-08-01T19:55:31.864 INFO:teuthology.orchestra.run.smithi008.stdout: "time": "2023-08-01T19:55:09.287261+0000", 2023-08-01T19:55:31.864 INFO:teuthology.orchestra.run.smithi008.stdout: "duration": 1.2364000000000001e-05 2023-08-01T19:55:31.864 INFO:teuthology.orchestra.run.smithi008.stdout: }, 2023-08-01T19:55:31.864 INFO:teuthology.orchestra.run.smithi008.stdout: { 2023-08-01T19:55:31.864 INFO:teuthology.orchestra.run.smithi008.stdout: "event": "queued_for_pg", 2023-08-01T19:55:31.864 INFO:teuthology.orchestra.run.smithi008.stdout: "time": "2023-08-01T19:55:09.287267+0000", 2023-08-01T19:55:31.865 INFO:teuthology.orchestra.run.smithi008.stdout: "duration": 6.2580000000000001e-06 2023-08-01T19:55:31.865 INFO:teuthology.orchestra.run.smithi008.stdout: }, 2023-08-01T19:55:31.865 INFO:teuthology.orchestra.run.smithi008.stdout: { 2023-08-01T19:55:31.865 INFO:teuthology.orchestra.run.smithi008.stdout: "event": "reached_pg", 2023-08-01T19:55:31.865 INFO:teuthology.orchestra.run.smithi008.stdout: "time": "2023-08-01T19:55:09.287306+0000", 2023-08-01T19:55:31.865 INFO:teuthology.orchestra.run.smithi008.stdout: "duration": 3.9057999999999998e-05 2023-08-01T19:55:31.865 INFO:teuthology.orchestra.run.smithi008.stdout: }, 2023-08-01T19:55:31.865 INFO:teuthology.orchestra.run.smithi008.stdout: { 2023-08-01T19:55:31.866 INFO:teuthology.orchestra.run.smithi008.stdout: "event": "started", 2023-08-01T19:55:31.866 INFO:teuthology.orchestra.run.smithi008.stdout: "time": "2023-08-01T19:55:09.287419+0000", 2023-08-01T19:55:31.866 INFO:teuthology.orchestra.run.smithi008.stdout: "duration": 0.000112843 2023-08-01T19:55:31.866 INFO:teuthology.orchestra.run.smithi008.stdout: }, 2023-08-01T19:55:31.866 INFO:teuthology.orchestra.run.smithi008.stdout: { 2023-08-01T19:55:31.866 INFO:teuthology.orchestra.run.smithi008.stdout: "event": "waiting for subops from 1", 2023-08-01T19:55:31.866 INFO:teuthology.orchestra.run.smithi008.stdout: "time": "2023-08-01T19:55:09.287514+0000", 2023-08-01T19:55:31.866 INFO:teuthology.orchestra.run.smithi008.stdout: "duration": 9.5068000000000005e-05 2023-08-01T19:55:31.867 INFO:teuthology.orchestra.run.smithi008.stdout: }, 2023-08-01T19:55:31.867 INFO:teuthology.orchestra.run.smithi008.stdout: { 2023-08-01T19:55:31.867 INFO:teuthology.orchestra.run.smithi008.stdout: "event": "op_commit", 2023-08-01T19:55:31.867 INFO:teuthology.orchestra.run.smithi008.stdout: "time": "2023-08-01T19:55:09.293891+0000", 2023-08-01T19:55:31.867 INFO:teuthology.orchestra.run.smithi008.stdout: "duration": 0.00637712 2023-08-01T19:55:31.867 INFO:teuthology.orchestra.run.smithi008.stdout: }, 2023-08-01T19:55:31.867 INFO:teuthology.orchestra.run.smithi008.stdout: { 2023-08-01T19:55:31.868 INFO:teuthology.orchestra.run.smithi008.stdout: "event": "sub_op_commit_rec", 2023-08-01T19:55:31.868 INFO:teuthology.orchestra.run.smithi008.stdout: "time": "2023-08-01T19:55:09.351871+0000", 2023-08-01T19:55:31.868 INFO:teuthology.orchestra.run.smithi008.stdout: "duration": 0.057980054000000003 2023-08-01T19:55:31.868 INFO:teuthology.orchestra.run.smithi008.stdout: }, 2023-08-01T19:55:31.868 INFO:teuthology.orchestra.run.smithi008.stdout: { 2023-08-01T19:55:31.868 INFO:teuthology.orchestra.run.smithi008.stdout: "event": "commit_sent", 2023-08-01T19:55:31.868 INFO:teuthology.orchestra.run.smithi008.stdout: "time": "2023-08-01T19:55:09.351917+0000", 2023-08-01T19:55:31.868 INFO:teuthology.orchestra.run.smithi008.stdout: "duration": 4.5501999999999999e-05 2023-08-01T19:55:31.869 INFO:teuthology.orchestra.run.smithi008.stdout: }, 2023-08-01T19:55:31.869 INFO:teuthology.orchestra.run.smithi008.stdout: { 2023-08-01T19:55:31.869 INFO:teuthology.orchestra.run.smithi008.stdout: "event": "done", 2023-08-01T19:55:31.869 INFO:teuthology.orchestra.run.smithi008.stdout: "time": "2023-08-01T19:55:09.351951+0000", 2023-08-01T19:55:31.869 INFO:teuthology.orchestra.run.smithi008.stdout: "duration": 3.4450999999999999e-05 2023-08-01T19:55:31.869 INFO:teuthology.orchestra.run.smithi008.stdout: } 2023-08-01T19:55:31.869 INFO:teuthology.orchestra.run.smithi008.stdout: ] 2023-08-01T19:55:31.869 INFO:teuthology.orchestra.run.smithi008.stdout: } 2023-08-01T19:55:31.870 INFO:teuthology.orchestra.run.smithi008.stdout: }, 2023-08-01T19:55:31.870 INFO:teuthology.orchestra.run.smithi008.stdout: { 2023-08-01T19:55:31.870 INFO:teuthology.orchestra.run.smithi008.stdout: "description": "osd_op(client.4668.0:107880 5.5 5:a8d12d4b:::benchmark_data_smithi006_114134_object107879:head [set-alloc-hint object_size 65536 write_size 65536,write 0~65536] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e38)", 2023-08-01T19:55:31.870 INFO:teuthology.orchestra.run.smithi008.stdout: "initiated_at": "2023-08-01T19:55:09.292335+0000", 2023-08-01T19:55:31.870 INFO:teuthology.orchestra.run.smithi008.stdout: "age": 22.384959683000002, 2023-08-01T19:55:31.870 INFO:teuthology.orchestra.run.smithi008.stdout: "duration": 0.061350719999999997, 2023-08-01T19:55:31.870 INFO:teuthology.orchestra.run.smithi008.stdout: "type_data": { 2023-08-01T19:55:31.870 INFO:teuthology.orchestra.run.smithi008.stdout: "flag_point": "commit sent; apply or cleanup", 2023-08-01T19:55:31.871 INFO:teuthology.orchestra.run.smithi008.stdout: "client_info": { 2023-08-01T19:55:31.871 INFO:teuthology.orchestra.run.smithi008.stdout: "client": "client.4668", 2023-08-01T19:55:31.871 INFO:teuthology.orchestra.run.smithi008.stdout: "client_addr": "172.21.15.6:0/1709472247", 2023-08-01T19:55:31.871 INFO:teuthology.orchestra.run.smithi008.stdout: "tid": 107880 2023-08-01T19:55:31.871 INFO:teuthology.orchestra.run.smithi008.stdout: }, 2023-08-01T19:55:31.871 INFO:teuthology.orchestra.run.smithi008.stdout: "events": [ 2023-08-01T19:55:31.871 INFO:teuthology.orchestra.run.smithi008.stdout: { 2023-08-01T19:55:31.871 INFO:teuthology.orchestra.run.smithi008.stdout: "event": "initiated", 2023-08-01T19:55:31.872 INFO:teuthology.orchestra.run.smithi008.stdout: "time": "2023-08-01T19:55:09.292335+0000", 2023-08-01T19:55:31.872 INFO:teuthology.orchestra.run.smithi008.stdout: "duration": 0 2023-08-01T19:55:31.872 INFO:teuthology.orchestra.run.smithi008.stdout: }, 2023-08-01T19:55:31.872 INFO:teuthology.orchestra.run.smithi008.stdout: { 2023-08-01T19:55:31.872 INFO:teuthology.orchestra.run.smithi008.stdout: "event": "throttled", 2023-08-01T19:55:31.872 INFO:teuthology.orchestra.run.smithi008.stdout: "time": "2023-08-01T19:55:09.292335+0000", 2023-08-01T19:55:31.872 INFO:teuthology.orchestra.run.smithi008.stdout: "duration": 0 2023-08-01T19:55:31.873 INFO:teuthology.orchestra.run.smithi008.stdout: }, 2023-08-01T19:55:31.873 INFO:teuthology.orchestra.run.smithi008.stdout: { 2023-08-01T19:55:31.873 INFO:teuthology.orchestra.run.smithi008.stdout: "event": "header_read", 2023-08-01T19:55:31.873 INFO:teuthology.orchestra.run.smithi008.stdout: "time": "2023-08-01T19:55:09.292334+0000", 2023-08-01T19:55:31.873 INFO:teuthology.orchestra.run.smithi008.stdout: "duration": 4294967295.999999 2023-08-01T19:55:31.873 INFO:teuthology.orchestra.run.smithi008.stdout: }, 2023-08-01T19:55:31.873 INFO:teuthology.orchestra.run.smithi008.stdout: { 2023-08-01T19:55:31.873 INFO:teuthology.orchestra.run.smithi008.stdout: "event": "all_read", 2023-08-01T19:55:31.874 INFO:teuthology.orchestra.run.smithi008.stdout: "time": "2023-08-01T19:55:09.292449+0000", 2023-08-01T19:55:31.874 INFO:teuthology.orchestra.run.smithi008.stdout: "duration": 0.00011551400000000001 2023-08-01T19:55:31.874 INFO:teuthology.orchestra.run.smithi008.stdout: }, 2023-08-01T19:55:31.874 INFO:teuthology.orchestra.run.smithi008.stdout: { 2023-08-01T19:55:31.874 INFO:teuthology.orchestra.run.smithi008.stdout: "event": "dispatched", 2023-08-01T19:55:31.874 INFO:teuthology.orchestra.run.smithi008.stdout: "time": "2023-08-01T19:55:09.292461+0000", 2023-08-01T19:55:31.874 INFO:teuthology.orchestra.run.smithi008.stdout: "duration": 1.1287000000000001e-05 2023-08-01T19:55:31.874 INFO:teuthology.orchestra.run.smithi008.stdout: }, 2023-08-01T19:55:31.875 INFO:teuthology.orchestra.run.smithi008.stdout: { 2023-08-01T19:55:31.875 INFO:teuthology.orchestra.run.smithi008.stdout: "event": "queued_for_pg", 2023-08-01T19:55:31.875 INFO:teuthology.orchestra.run.smithi008.stdout: "time": "2023-08-01T19:55:09.292467+0000", 2023-08-01T19:55:31.875 INFO:teuthology.orchestra.run.smithi008.stdout: "duration": 6.4520000000000002e-06 2023-08-01T19:55:31.875 INFO:teuthology.orchestra.run.smithi008.stdout: }, 2023-08-01T19:55:31.875 INFO:teuthology.orchestra.run.smithi008.stdout: { 2023-08-01T19:55:31.875 INFO:teuthology.orchestra.run.smithi008.stdout: "event": "reached_pg", 2023-08-01T19:55:31.875 INFO:teuthology.orchestra.run.smithi008.stdout: "time": "2023-08-01T19:55:09.292510+0000", 2023-08-01T19:55:31.876 INFO:teuthology.orchestra.run.smithi008.stdout: "duration": 4.2502000000000001e-05 2023-08-01T19:55:31.876 INFO:teuthology.orchestra.run.smithi008.stdout: }, 2023-08-01T19:55:31.876 INFO:teuthology.orchestra.run.smithi008.stdout: { 2023-08-01T19:55:31.876 INFO:teuthology.orchestra.run.smithi008.stdout: "event": "started", 2023-08-01T19:55:31.876 INFO:teuthology.orchestra.run.smithi008.stdout: "time": "2023-08-01T19:55:09.292596+0000", 2023-08-01T19:55:31.876 INFO:teuthology.orchestra.run.smithi008.stdout: "duration": 8.6545000000000006e-05 2023-08-01T19:55:31.876 INFO:teuthology.orchestra.run.smithi008.stdout: }, 2023-08-01T19:55:31.876 INFO:teuthology.orchestra.run.smithi008.stdout: { 2023-08-01T19:55:31.877 INFO:teuthology.orchestra.run.smithi008.stdout: "event": "waiting for subops from 1", 2023-08-01T19:55:31.877 INFO:teuthology.orchestra.run.smithi008.stdout: "time": "2023-08-01T19:55:09.292697+0000", 2023-08-01T19:55:31.877 INFO:teuthology.orchestra.run.smithi008.stdout: "duration": 0.000100368 2023-08-01T19:55:31.877 INFO:teuthology.orchestra.run.smithi008.stdout: }, 2023-08-01T19:55:31.877 INFO:teuthology.orchestra.run.smithi008.stdout: { 2023-08-01T19:55:31.877 INFO:teuthology.orchestra.run.smithi008.stdout: "event": "op_commit", 2023-08-01T19:55:31.877 INFO:teuthology.orchestra.run.smithi008.stdout: "time": "2023-08-01T19:55:09.295658+0000", 2023-08-01T19:55:31.877 INFO:teuthology.orchestra.run.smithi008.stdout: "duration": 0.0029617290000000002 2023-08-01T19:55:31.878 INFO:teuthology.orchestra.run.smithi008.stdout: }, 2023-08-01T19:55:31.878 INFO:teuthology.orchestra.run.smithi008.stdout: { 2023-08-01T19:55:31.878 INFO:teuthology.orchestra.run.smithi008.stdout: "event": "sub_op_commit_rec", 2023-08-01T19:55:31.878 INFO:teuthology.orchestra.run.smithi008.stdout: "time": "2023-08-01T19:55:09.353604+0000", 2023-08-01T19:55:31.878 INFO:teuthology.orchestra.run.smithi008.stdout: "duration": 0.057945868999999997 2023-08-01T19:55:31.878 INFO:teuthology.orchestra.run.smithi008.stdout: }, 2023-08-01T19:55:31.878 INFO:teuthology.orchestra.run.smithi008.stdout: { 2023-08-01T19:55:31.879 INFO:teuthology.orchestra.run.smithi008.stdout: "event": "commit_sent", 2023-08-01T19:55:31.879 INFO:teuthology.orchestra.run.smithi008.stdout: "time": "2023-08-01T19:55:09.353650+0000", 2023-08-01T19:55:31.879 INFO:teuthology.orchestra.run.smithi008.stdout: "duration": 4.5698999999999997e-05 2023-08-01T19:55:31.879 INFO:teuthology.orchestra.run.smithi008.stdout: }, 2023-08-01T19:55:31.879 INFO:teuthology.orchestra.run.smithi008.stdout: { 2023-08-01T19:55:31.879 INFO:teuthology.orchestra.run.smithi008.stdout: "event": "done", 2023-08-01T19:55:31.879 INFO:teuthology.orchestra.run.smithi008.stdout: "time": "2023-08-01T19:55:09.353686+0000", 2023-08-01T19:55:31.879 INFO:teuthology.orchestra.run.smithi008.stdout: "duration": 3.5936999999999998e-05 2023-08-01T19:55:31.879 INFO:teuthology.orchestra.run.smithi008.stdout: } 2023-08-01T19:55:31.880 INFO:teuthology.orchestra.run.smithi008.stdout: ] 2023-08-01T19:55:31.880 INFO:teuthology.orchestra.run.smithi008.stdout: } 2023-08-01T19:55:31.880 INFO:teuthology.orchestra.run.smithi008.stdout: } 2023-08-01T19:55:31.880 INFO:teuthology.orchestra.run.smithi008.stdout: ] 2023-08-01T19:55:31.880 INFO:teuthology.orchestra.run.smithi008.stdout:} 2023-08-01T19:55:31.882 INFO:teuthology.orchestra.run.smithi101.stdout:{ 2023-08-01T19:55:31.882 INFO:teuthology.orchestra.run.smithi101.stdout: "success": "" 2023-08-01T19:55:31.882 INFO:teuthology.orchestra.run.smithi101.stdout:} 2023-08-01T19:55:31.882 DEBUG:teuthology.orchestra.run.smithi101:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 30 ceph --cluster ceph --admin-daemon /var/run/ceph/ceph-osd.1.asok dump_ops_in_flight 2023-08-01T19:55:31.883 INFO:tasks.ceph.osd.1.smithi101.stderr:2023-08-01T19:55:31.880+0000 7fb0cb7f6700 -1 received signal: Hangup from /usr/bin/python3 /bin/daemon-helper kill ceph-osd -f --cluster ceph -i 1 (PID: 111141) UID: 0 2023-08-01T19:55:31.982 INFO:tasks.ceph.osd.0.smithi008.stderr:2023-08-01T19:55:31.980+0000 7f16a58f4700 -1 received signal: Hangup from /usr/bin/python3 /bin/daemon-helper kill ceph-osd -f --cluster ceph -i 0 (PID: 111179) UID: 0 2023-08-01T19:55:32.079 INFO:teuthology.orchestra.run.smithi101.stdout:{ 2023-08-01T19:55:32.080 INFO:teuthology.orchestra.run.smithi101.stdout: "ops": [ 2023-08-01T19:55:32.080 INFO:teuthology.orchestra.run.smithi101.stdout: { 2023-08-01T19:55:32.080 INFO:teuthology.orchestra.run.smithi101.stdout: "description": "osd_repop(client.4668.0:147470 5.6 e48/19)", 2023-08-01T19:55:32.080 INFO:teuthology.orchestra.run.smithi101.stdout: "initiated_at": "2023-08-01T19:55:32.078540+0000", 2023-08-01T19:55:32.080 INFO:teuthology.orchestra.run.smithi101.stdout: "age": 0.00019736600000000001, 2023-08-01T19:55:32.080 INFO:teuthology.orchestra.run.smithi101.stdout: "duration": 0.000210762, 2023-08-01T19:55:32.081 INFO:teuthology.orchestra.run.smithi101.stdout: "type_data": { 2023-08-01T19:55:32.081 INFO:teuthology.orchestra.run.smithi101.stdout: "flag_point": "queued for pg", 2023-08-01T19:55:32.081 INFO:teuthology.orchestra.run.smithi101.stdout: "events": [ 2023-08-01T19:55:32.081 INFO:teuthology.orchestra.run.smithi101.stdout: { 2023-08-01T19:55:32.081 INFO:teuthology.orchestra.run.smithi101.stdout: "event": "initiated", 2023-08-01T19:55:32.081 INFO:teuthology.orchestra.run.smithi101.stdout: "time": "2023-08-01T19:55:32.078540+0000", 2023-08-01T19:55:32.081 INFO:teuthology.orchestra.run.smithi101.stdout: "duration": 0 2023-08-01T19:55:32.081 INFO:teuthology.orchestra.run.smithi101.stdout: }, 2023-08-01T19:55:32.082 INFO:teuthology.orchestra.run.smithi101.stdout: { 2023-08-01T19:55:32.082 INFO:teuthology.orchestra.run.smithi101.stdout: "event": "throttled", 2023-08-01T19:55:32.082 INFO:teuthology.orchestra.run.smithi101.stdout: "time": "2023-08-01T19:55:32.078540+0000", 2023-08-01T19:55:32.082 INFO:teuthology.orchestra.run.smithi101.stdout: "duration": 0 2023-08-01T19:55:32.082 INFO:teuthology.orchestra.run.smithi101.stdout: }, 2023-08-01T19:55:32.082 INFO:teuthology.orchestra.run.smithi101.stdout: { 2023-08-01T19:55:32.082 INFO:teuthology.orchestra.run.smithi101.stdout: "event": "header_read", 2023-08-01T19:55:32.083 INFO:teuthology.orchestra.run.smithi101.stdout: "time": "2023-08-01T19:55:32.078539+0000", 2023-08-01T19:55:32.083 INFO:teuthology.orchestra.run.smithi101.stdout: "duration": 4294967295.9999995 2023-08-01T19:55:32.083 INFO:teuthology.orchestra.run.smithi101.stdout: }, 2023-08-01T19:55:32.083 INFO:teuthology.orchestra.run.smithi101.stdout: { 2023-08-01T19:55:32.083 INFO:teuthology.orchestra.run.smithi101.stdout: "event": "all_read", 2023-08-01T19:55:32.083 INFO:teuthology.orchestra.run.smithi101.stdout: "time": "2023-08-01T19:55:32.078544+0000", 2023-08-01T19:55:32.083 INFO:teuthology.orchestra.run.smithi101.stdout: "duration": 4.9339999999999997e-06 2023-08-01T19:55:32.083 INFO:teuthology.orchestra.run.smithi101.stdout: }, 2023-08-01T19:55:32.084 INFO:teuthology.orchestra.run.smithi101.stdout: { 2023-08-01T19:55:32.084 INFO:teuthology.orchestra.run.smithi101.stdout: "event": "dispatched", 2023-08-01T19:55:32.084 INFO:teuthology.orchestra.run.smithi101.stdout: "time": "2023-08-01T19:55:32.078552+0000", 2023-08-01T19:55:32.084 INFO:teuthology.orchestra.run.smithi101.stdout: "duration": 8.0669999999999992e-06 2023-08-01T19:55:32.084 INFO:teuthology.orchestra.run.smithi101.stdout: }, 2023-08-01T19:55:32.084 INFO:teuthology.orchestra.run.smithi101.stdout: { 2023-08-01T19:55:32.084 INFO:teuthology.orchestra.run.smithi101.stdout: "event": "queued_for_pg", 2023-08-01T19:55:32.084 INFO:teuthology.orchestra.run.smithi101.stdout: "time": "2023-08-01T19:55:32.078556+0000", 2023-08-01T19:55:32.085 INFO:teuthology.orchestra.run.smithi101.stdout: "duration": 3.5899999999999999e-06 2023-08-01T19:55:32.085 INFO:teuthology.orchestra.run.smithi101.stdout: } 2023-08-01T19:55:32.085 INFO:teuthology.orchestra.run.smithi101.stdout: ] 2023-08-01T19:55:32.085 INFO:teuthology.orchestra.run.smithi101.stdout: } 2023-08-01T19:55:32.085 INFO:teuthology.orchestra.run.smithi101.stdout: }, 2023-08-01T19:55:32.085 INFO:teuthology.orchestra.run.smithi101.stdout: { 2023-08-01T19:55:32.085 INFO:teuthology.orchestra.run.smithi101.stdout: "description": "osd_repop(client.4668.0:147461 5.f e48/40 5:f9b18a3f:::benchmark_data_smithi006_114134_object13800:head v 48'9251, mlcod=48'9248)", 2023-08-01T19:55:32.085 INFO:teuthology.orchestra.run.smithi101.stdout: "initiated_at": "2023-08-01T19:55:32.074924+0000", 2023-08-01T19:55:32.086 INFO:teuthology.orchestra.run.smithi101.stdout: "age": 0.0038133249999999998, 2023-08-01T19:55:32.086 INFO:teuthology.orchestra.run.smithi101.stdout: "duration": 0.003862903, 2023-08-01T19:55:32.086 INFO:teuthology.orchestra.run.smithi101.stdout: "type_data": { 2023-08-01T19:55:32.086 INFO:teuthology.orchestra.run.smithi101.stdout: "flag_point": "started", 2023-08-01T19:55:32.086 INFO:teuthology.orchestra.run.smithi101.stdout: "events": [ 2023-08-01T19:55:32.086 INFO:teuthology.orchestra.run.smithi101.stdout: { 2023-08-01T19:55:32.086 INFO:teuthology.orchestra.run.smithi101.stdout: "event": "initiated", 2023-08-01T19:55:32.087 INFO:teuthology.orchestra.run.smithi101.stdout: "time": "2023-08-01T19:55:32.074924+0000", 2023-08-01T19:55:32.087 INFO:teuthology.orchestra.run.smithi101.stdout: "duration": 0 2023-08-01T19:55:32.087 INFO:teuthology.orchestra.run.smithi101.stdout: }, 2023-08-01T19:55:32.087 INFO:teuthology.orchestra.run.smithi101.stdout: { 2023-08-01T19:55:32.087 INFO:teuthology.orchestra.run.smithi101.stdout: "event": "throttled", 2023-08-01T19:55:32.087 INFO:teuthology.orchestra.run.smithi101.stdout: "time": "2023-08-01T19:55:32.074924+0000", 2023-08-01T19:55:32.087 INFO:teuthology.orchestra.run.smithi101.stdout: "duration": 0 2023-08-01T19:55:32.088 INFO:teuthology.orchestra.run.smithi101.stdout: }, 2023-08-01T19:55:32.088 INFO:teuthology.orchestra.run.smithi101.stdout: { 2023-08-01T19:55:32.088 INFO:teuthology.orchestra.run.smithi101.stdout: "event": "header_read", 2023-08-01T19:55:32.088 INFO:teuthology.orchestra.run.smithi101.stdout: "time": "2023-08-01T19:55:32.074923+0000", 2023-08-01T19:55:32.088 INFO:teuthology.orchestra.run.smithi101.stdout: "duration": 4294967295.9999995 2023-08-01T19:55:32.088 INFO:teuthology.orchestra.run.smithi101.stdout: }, 2023-08-01T19:55:32.088 INFO:teuthology.orchestra.run.smithi101.stdout: { 2023-08-01T19:55:32.089 INFO:teuthology.orchestra.run.smithi101.stdout: "event": "all_read", 2023-08-01T19:55:32.089 INFO:teuthology.orchestra.run.smithi101.stdout: "time": "2023-08-01T19:55:32.074928+0000", 2023-08-01T19:55:32.089 INFO:teuthology.orchestra.run.smithi101.stdout: "duration": 5.1189999999999996e-06 2023-08-01T19:55:32.089 INFO:teuthology.orchestra.run.smithi101.stdout: }, 2023-08-01T19:55:32.089 INFO:teuthology.orchestra.run.smithi101.stdout: { 2023-08-01T19:55:32.089 INFO:teuthology.orchestra.run.smithi101.stdout: "event": "dispatched", 2023-08-01T19:55:32.089 INFO:teuthology.orchestra.run.smithi101.stdout: "time": "2023-08-01T19:55:32.074936+0000", 2023-08-01T19:55:32.089 INFO:teuthology.orchestra.run.smithi101.stdout: "duration": 7.8220000000000007e-06 2023-08-01T19:55:32.090 INFO:teuthology.orchestra.run.smithi101.stdout: }, 2023-08-01T19:55:32.090 INFO:teuthology.orchestra.run.smithi101.stdout: { 2023-08-01T19:55:32.090 INFO:teuthology.orchestra.run.smithi101.stdout: "event": "queued_for_pg", 2023-08-01T19:55:32.090 INFO:teuthology.orchestra.run.smithi101.stdout: "time": "2023-08-01T19:55:32.074940+0000", 2023-08-01T19:55:32.090 INFO:teuthology.orchestra.run.smithi101.stdout: "duration": 3.9999999999999998e-06 2023-08-01T19:55:32.091 INFO:teuthology.orchestra.run.smithi101.stdout: }, 2023-08-01T19:55:32.091 INFO:teuthology.orchestra.run.smithi101.stdout: { 2023-08-01T19:55:32.091 INFO:teuthology.orchestra.run.smithi101.stdout: "event": "reached_pg", 2023-08-01T19:55:32.091 INFO:teuthology.orchestra.run.smithi101.stdout: "time": "2023-08-01T19:55:32.074972+0000", 2023-08-01T19:55:32.092 INFO:teuthology.orchestra.run.smithi101.stdout: "duration": 3.1616999999999999e-05 2023-08-01T19:55:32.092 INFO:teuthology.orchestra.run.smithi101.stdout: }, 2023-08-01T19:55:32.092 INFO:teuthology.orchestra.run.smithi101.stdout: { 2023-08-01T19:55:32.093 INFO:teuthology.orchestra.run.smithi101.stdout: "event": "started", 2023-08-01T19:55:32.093 INFO:teuthology.orchestra.run.smithi101.stdout: "time": "2023-08-01T19:55:32.074994+0000", 2023-08-01T19:55:32.093 INFO:teuthology.orchestra.run.smithi101.stdout: "duration": 2.1875e-05 2023-08-01T19:55:32.093 INFO:teuthology.orchestra.run.smithi101.stdout: } 2023-08-01T19:55:32.094 INFO:teuthology.orchestra.run.smithi101.stdout: ] 2023-08-01T19:55:32.094 INFO:teuthology.orchestra.run.smithi101.stdout: } 2023-08-01T19:55:32.094 INFO:teuthology.orchestra.run.smithi101.stdout: }, 2023-08-01T19:55:32.094 INFO:teuthology.orchestra.run.smithi101.stdout: { 2023-08-01T19:55:32.094 INFO:teuthology.orchestra.run.smithi101.stdout: "description": "osd_repop(client.4668.0:147465 5.6 e48/19 5:613abb2f:::benchmark_data_smithi006_114134_object13804:head v 48'9177, mlcod=48'9175)", 2023-08-01T19:55:32.095 INFO:teuthology.orchestra.run.smithi101.stdout: "initiated_at": "2023-08-01T19:55:32.076216+0000", 2023-08-01T19:55:32.095 INFO:teuthology.orchestra.run.smithi101.stdout: "age": 0.002520727, 2023-08-01T19:55:32.095 INFO:teuthology.orchestra.run.smithi101.stdout: "duration": 0.0026070469999999999, 2023-08-01T19:55:32.095 INFO:teuthology.orchestra.run.smithi101.stdout: "type_data": { 2023-08-01T19:55:32.096 INFO:teuthology.orchestra.run.smithi101.stdout: "flag_point": "started", 2023-08-01T19:55:32.096 INFO:teuthology.orchestra.run.smithi101.stdout: "events": [ 2023-08-01T19:55:32.096 INFO:teuthology.orchestra.run.smithi101.stdout: { 2023-08-01T19:55:32.096 INFO:teuthology.orchestra.run.smithi101.stdout: "event": "initiated", 2023-08-01T19:55:32.097 INFO:teuthology.orchestra.run.smithi101.stdout: "time": "2023-08-01T19:55:32.076216+0000", 2023-08-01T19:55:32.097 INFO:teuthology.orchestra.run.smithi101.stdout: "duration": 0 2023-08-01T19:55:32.097 INFO:teuthology.orchestra.run.smithi101.stdout: }, 2023-08-01T19:55:32.097 INFO:teuthology.orchestra.run.smithi101.stdout: { 2023-08-01T19:55:32.098 INFO:teuthology.orchestra.run.smithi101.stdout: "event": "throttled", 2023-08-01T19:55:32.098 INFO:teuthology.orchestra.run.smithi101.stdout: "time": "2023-08-01T19:55:32.076216+0000", 2023-08-01T19:55:32.098 INFO:teuthology.orchestra.run.smithi101.stdout: "duration": 0 2023-08-01T19:55:32.098 INFO:teuthology.orchestra.run.smithi101.stdout: }, 2023-08-01T19:55:32.099 INFO:teuthology.orchestra.run.smithi101.stdout: { 2023-08-01T19:55:32.099 INFO:teuthology.orchestra.run.smithi101.stdout: "event": "header_read", 2023-08-01T19:55:32.099 INFO:teuthology.orchestra.run.smithi101.stdout: "time": "2023-08-01T19:55:32.076216+0000", 2023-08-01T19:55:32.099 INFO:teuthology.orchestra.run.smithi101.stdout: "duration": 4294967295.9999995 2023-08-01T19:55:32.100 INFO:teuthology.orchestra.run.smithi101.stdout: }, 2023-08-01T19:55:32.100 INFO:teuthology.orchestra.run.smithi101.stdout: { 2023-08-01T19:55:32.100 INFO:teuthology.orchestra.run.smithi101.stdout: "event": "all_read", 2023-08-01T19:55:32.100 INFO:teuthology.orchestra.run.smithi101.stdout: "time": "2023-08-01T19:55:32.076225+0000", 2023-08-01T19:55:32.101 INFO:teuthology.orchestra.run.smithi101.stdout: "duration": 9.4560000000000006e-06 2023-08-01T19:55:32.101 INFO:teuthology.orchestra.run.smithi101.stdout: }, 2023-08-01T19:55:32.101 INFO:teuthology.orchestra.run.smithi101.stdout: { 2023-08-01T19:55:32.101 INFO:teuthology.orchestra.run.smithi101.stdout: "event": "dispatched", 2023-08-01T19:55:32.101 INFO:teuthology.orchestra.run.smithi101.stdout: "time": "2023-08-01T19:55:32.076233+0000", 2023-08-01T19:55:32.102 INFO:teuthology.orchestra.run.smithi101.stdout: "duration": 8.0569999999999993e-06 2023-08-01T19:55:32.102 INFO:teuthology.orchestra.run.smithi101.stdout: }, 2023-08-01T19:55:32.102 INFO:teuthology.orchestra.run.smithi101.stdout: { 2023-08-01T19:55:32.102 INFO:teuthology.orchestra.run.smithi101.stdout: "event": "queued_for_pg", 2023-08-01T19:55:32.103 INFO:teuthology.orchestra.run.smithi101.stdout: "time": "2023-08-01T19:55:32.076237+0000", 2023-08-01T19:55:32.103 INFO:teuthology.orchestra.run.smithi101.stdout: "duration": 3.9620000000000004e-06 2023-08-01T19:55:32.103 INFO:teuthology.orchestra.run.smithi101.stdout: }, 2023-08-01T19:55:32.103 INFO:teuthology.orchestra.run.smithi101.stdout: { 2023-08-01T19:55:32.104 INFO:teuthology.orchestra.run.smithi101.stdout: "event": "reached_pg", 2023-08-01T19:55:32.104 INFO:teuthology.orchestra.run.smithi101.stdout: "time": "2023-08-01T19:55:32.076269+0000", 2023-08-01T19:55:32.104 INFO:teuthology.orchestra.run.smithi101.stdout: "duration": 3.1903000000000003e-05 2023-08-01T19:55:32.104 INFO:teuthology.orchestra.run.smithi101.stdout: }, 2023-08-01T19:55:32.105 INFO:teuthology.orchestra.run.smithi101.stdout: { 2023-08-01T19:55:32.105 INFO:teuthology.orchestra.run.smithi101.stdout: "event": "started", 2023-08-01T19:55:32.105 INFO:teuthology.orchestra.run.smithi101.stdout: "time": "2023-08-01T19:55:32.076287+0000", 2023-08-01T19:55:32.105 INFO:teuthology.orchestra.run.smithi101.stdout: "duration": 1.7963999999999999e-05 2023-08-01T19:55:32.105 INFO:teuthology.orchestra.run.smithi101.stdout: } 2023-08-01T19:55:32.106 INFO:teuthology.orchestra.run.smithi101.stdout: ] 2023-08-01T19:55:32.106 INFO:teuthology.orchestra.run.smithi101.stdout: } 2023-08-01T19:55:32.106 INFO:teuthology.orchestra.run.smithi101.stdout: }, 2023-08-01T19:55:32.106 INFO:teuthology.orchestra.run.smithi101.stdout: { 2023-08-01T19:55:32.106 INFO:teuthology.orchestra.run.smithi101.stdout: "description": "osd_repop(client.4668.0:147464 5.2 e48/40 5:4f5c6836:::benchmark_data_smithi006_114134_object13803:head v 48'9469, mlcod=48'9467)", 2023-08-01T19:55:32.107 INFO:teuthology.orchestra.run.smithi101.stdout: "initiated_at": "2023-08-01T19:55:32.076246+0000", 2023-08-01T19:55:32.107 INFO:teuthology.orchestra.run.smithi101.stdout: "age": 0.002491648, 2023-08-01T19:55:32.107 INFO:teuthology.orchestra.run.smithi101.stdout: "duration": 0.0026135630000000002, 2023-08-01T19:55:32.108 INFO:teuthology.orchestra.run.smithi101.stdout: "type_data": { 2023-08-01T19:55:32.108 INFO:teuthology.orchestra.run.smithi101.stdout: "flag_point": "started", 2023-08-01T19:55:32.108 INFO:teuthology.orchestra.run.smithi101.stdout: "events": [ 2023-08-01T19:55:32.108 INFO:teuthology.orchestra.run.smithi101.stdout: { 2023-08-01T19:55:32.109 INFO:teuthology.orchestra.run.smithi101.stdout: "event": "initiated", 2023-08-01T19:55:32.109 INFO:teuthology.orchestra.run.smithi101.stdout: "time": "2023-08-01T19:55:32.076246+0000", 2023-08-01T19:55:32.109 INFO:teuthology.orchestra.run.smithi101.stdout: "duration": 0 2023-08-01T19:55:32.109 INFO:teuthology.orchestra.run.smithi101.stdout: }, 2023-08-01T19:55:32.110 INFO:teuthology.orchestra.run.smithi101.stdout: { 2023-08-01T19:55:32.110 INFO:teuthology.orchestra.run.smithi101.stdout: "event": "throttled", 2023-08-01T19:55:32.110 INFO:teuthology.orchestra.run.smithi101.stdout: "time": "2023-08-01T19:55:32.076246+0000", 2023-08-01T19:55:32.110 INFO:teuthology.orchestra.run.smithi101.stdout: "duration": 0 2023-08-01T19:55:32.111 INFO:teuthology.orchestra.run.smithi101.stdout: }, 2023-08-01T19:55:32.111 INFO:teuthology.orchestra.run.smithi101.stdout: { 2023-08-01T19:55:32.111 INFO:teuthology.orchestra.run.smithi101.stdout: "event": "header_read", 2023-08-01T19:55:32.111 INFO:teuthology.orchestra.run.smithi101.stdout: "time": "2023-08-01T19:55:32.076245+0000", 2023-08-01T19:55:32.112 INFO:teuthology.orchestra.run.smithi101.stdout: "duration": 4294967295.9999995 2023-08-01T19:55:32.112 INFO:teuthology.orchestra.run.smithi101.stdout: }, 2023-08-01T19:55:32.112 INFO:teuthology.orchestra.run.smithi101.stdout: { 2023-08-01T19:55:32.112 INFO:teuthology.orchestra.run.smithi101.stdout: "event": "all_read", 2023-08-01T19:55:32.112 INFO:teuthology.orchestra.run.smithi101.stdout: "time": "2023-08-01T19:55:32.076249+0000", 2023-08-01T19:55:32.113 INFO:teuthology.orchestra.run.smithi101.stdout: "duration": 3.4489999999999999e-06 2023-08-01T19:55:32.113 INFO:teuthology.orchestra.run.smithi101.stdout: }, 2023-08-01T19:55:32.113 INFO:teuthology.orchestra.run.smithi101.stdout: { 2023-08-01T19:55:32.113 INFO:teuthology.orchestra.run.smithi101.stdout: "event": "dispatched", 2023-08-01T19:55:32.113 INFO:teuthology.orchestra.run.smithi101.stdout: "time": "2023-08-01T19:55:32.076254+0000", 2023-08-01T19:55:32.113 INFO:teuthology.orchestra.run.smithi101.stdout: "duration": 5.5740000000000003e-06 2023-08-01T19:55:32.114 INFO:teuthology.orchestra.run.smithi101.stdout: }, 2023-08-01T19:55:32.114 INFO:teuthology.orchestra.run.smithi101.stdout: { 2023-08-01T19:55:32.114 INFO:teuthology.orchestra.run.smithi101.stdout: "event": "queued_for_pg", 2023-08-01T19:55:32.114 INFO:teuthology.orchestra.run.smithi101.stdout: "time": "2023-08-01T19:55:32.076258+0000", 2023-08-01T19:55:32.114 INFO:teuthology.orchestra.run.smithi101.stdout: "duration": 3.506e-06 2023-08-01T19:55:32.114 INFO:teuthology.orchestra.run.smithi101.stdout: }, 2023-08-01T19:55:32.114 INFO:teuthology.orchestra.run.smithi101.stdout: { 2023-08-01T19:55:32.114 INFO:teuthology.orchestra.run.smithi101.stdout: "event": "reached_pg", 2023-08-01T19:55:32.115 INFO:teuthology.orchestra.run.smithi101.stdout: "time": "2023-08-01T19:55:32.076296+0000", 2023-08-01T19:55:32.115 INFO:teuthology.orchestra.run.smithi101.stdout: "duration": 3.8293000000000001e-05 2023-08-01T19:55:32.115 INFO:teuthology.orchestra.run.smithi101.stdout: }, 2023-08-01T19:55:32.115 INFO:teuthology.orchestra.run.smithi101.stdout: { 2023-08-01T19:55:32.115 INFO:teuthology.orchestra.run.smithi101.stdout: "event": "started", 2023-08-01T19:55:32.115 INFO:teuthology.orchestra.run.smithi101.stdout: "time": "2023-08-01T19:55:32.076317+0000", 2023-08-01T19:55:32.115 INFO:teuthology.orchestra.run.smithi101.stdout: "duration": 2.1124e-05 2023-08-01T19:55:32.115 INFO:teuthology.orchestra.run.smithi101.stdout: } 2023-08-01T19:55:32.116 INFO:teuthology.orchestra.run.smithi101.stdout: ] 2023-08-01T19:55:32.116 INFO:teuthology.orchestra.run.smithi101.stdout: } 2023-08-01T19:55:32.116 INFO:teuthology.orchestra.run.smithi101.stdout: }, 2023-08-01T19:55:32.116 INFO:teuthology.orchestra.run.smithi101.stdout: { 2023-08-01T19:55:32.116 INFO:teuthology.orchestra.run.smithi101.stdout: "description": "osd_repop(client.4668.0:147467 5.d e48/19 5:be37f196:::benchmark_data_smithi006_114134_object13806:head v 48'9022, mlcod=48'9019)", 2023-08-01T19:55:32.116 INFO:teuthology.orchestra.run.smithi101.stdout: "initiated_at": "2023-08-01T19:55:32.076822+0000", 2023-08-01T19:55:32.116 INFO:teuthology.orchestra.run.smithi101.stdout: "age": 0.0019152329999999999, 2023-08-01T19:55:32.117 INFO:teuthology.orchestra.run.smithi101.stdout: "duration": 0.0020730029999999999, 2023-08-01T19:55:32.117 INFO:teuthology.orchestra.run.smithi101.stdout: "type_data": { 2023-08-01T19:55:32.117 INFO:teuthology.orchestra.run.smithi101.stdout: "flag_point": "started", 2023-08-01T19:55:32.117 INFO:teuthology.orchestra.run.smithi101.stdout: "events": [ 2023-08-01T19:55:32.117 INFO:teuthology.orchestra.run.smithi101.stdout: { 2023-08-01T19:55:32.117 INFO:teuthology.orchestra.run.smithi101.stdout: "event": "initiated", 2023-08-01T19:55:32.117 INFO:teuthology.orchestra.run.smithi101.stdout: "time": "2023-08-01T19:55:32.076822+0000", 2023-08-01T19:55:32.117 INFO:teuthology.orchestra.run.smithi101.stdout: "duration": 0 2023-08-01T19:55:32.118 INFO:teuthology.orchestra.run.smithi101.stdout: }, 2023-08-01T19:55:32.118 INFO:teuthology.orchestra.run.smithi101.stdout: { 2023-08-01T19:55:32.118 INFO:teuthology.orchestra.run.smithi101.stdout: "event": "throttled", 2023-08-01T19:55:32.118 INFO:teuthology.orchestra.run.smithi101.stdout: "time": "2023-08-01T19:55:32.076822+0000", 2023-08-01T19:55:32.118 INFO:teuthology.orchestra.run.smithi101.stdout: "duration": 0 2023-08-01T19:55:32.118 INFO:teuthology.orchestra.run.smithi101.stdout: }, 2023-08-01T19:55:32.118 INFO:teuthology.orchestra.run.smithi101.stdout: { 2023-08-01T19:55:32.118 INFO:teuthology.orchestra.run.smithi101.stdout: "event": "header_read", 2023-08-01T19:55:32.119 INFO:teuthology.orchestra.run.smithi101.stdout: "time": "2023-08-01T19:55:32.076821+0000", 2023-08-01T19:55:32.119 INFO:teuthology.orchestra.run.smithi101.stdout: "duration": 4294967295.9999995 2023-08-01T19:55:32.119 INFO:teuthology.orchestra.run.smithi101.stdout: }, 2023-08-01T19:55:32.119 INFO:teuthology.orchestra.run.smithi101.stdout: { 2023-08-01T19:55:32.119 INFO:teuthology.orchestra.run.smithi101.stdout: "event": "all_read", 2023-08-01T19:55:32.119 INFO:teuthology.orchestra.run.smithi101.stdout: "time": "2023-08-01T19:55:32.076826+0000", 2023-08-01T19:55:32.119 INFO:teuthology.orchestra.run.smithi101.stdout: "duration": 5.0010000000000001e-06 2023-08-01T19:55:32.120 INFO:teuthology.orchestra.run.smithi101.stdout: }, 2023-08-01T19:55:32.120 INFO:teuthology.orchestra.run.smithi101.stdout: { 2023-08-01T19:55:32.120 INFO:teuthology.orchestra.run.smithi101.stdout: "event": "dispatched", 2023-08-01T19:55:32.120 INFO:teuthology.orchestra.run.smithi101.stdout: "time": "2023-08-01T19:55:32.076834+0000", 2023-08-01T19:55:32.120 INFO:teuthology.orchestra.run.smithi101.stdout: "duration": 7.3599999999999998e-06 2023-08-01T19:55:32.120 INFO:teuthology.orchestra.run.smithi101.stdout: }, 2023-08-01T19:55:32.120 INFO:teuthology.orchestra.run.smithi101.stdout: { 2023-08-01T19:55:32.121 INFO:teuthology.orchestra.run.smithi101.stdout: "event": "queued_for_pg", 2023-08-01T19:55:32.121 INFO:teuthology.orchestra.run.smithi101.stdout: "time": "2023-08-01T19:55:32.076839+0000", 2023-08-01T19:55:32.121 INFO:teuthology.orchestra.run.smithi101.stdout: "duration": 5.181e-06 2023-08-01T19:55:32.121 INFO:teuthology.orchestra.run.smithi101.stdout: }, 2023-08-01T19:55:32.121 INFO:teuthology.orchestra.run.smithi101.stdout: { 2023-08-01T19:55:32.121 INFO:teuthology.orchestra.run.smithi101.stdout: "event": "reached_pg", 2023-08-01T19:55:32.121 INFO:teuthology.orchestra.run.smithi101.stdout: "time": "2023-08-01T19:55:32.076872+0000", 2023-08-01T19:55:32.121 INFO:teuthology.orchestra.run.smithi101.stdout: "duration": 3.3152999999999999e-05 2023-08-01T19:55:32.122 INFO:teuthology.orchestra.run.smithi101.stdout: }, 2023-08-01T19:55:32.122 INFO:teuthology.orchestra.run.smithi101.stdout: { 2023-08-01T19:55:32.122 INFO:teuthology.orchestra.run.smithi101.stdout: "event": "started", 2023-08-01T19:55:32.122 INFO:teuthology.orchestra.run.smithi101.stdout: "time": "2023-08-01T19:55:32.076890+0000", 2023-08-01T19:55:32.122 INFO:teuthology.orchestra.run.smithi101.stdout: "duration": 1.7944999999999998e-05 2023-08-01T19:55:32.122 INFO:teuthology.orchestra.run.smithi101.stdout: } 2023-08-01T19:55:32.122 INFO:teuthology.orchestra.run.smithi101.stdout: ] 2023-08-01T19:55:32.122 INFO:teuthology.orchestra.run.smithi101.stdout: } 2023-08-01T19:55:32.123 INFO:teuthology.orchestra.run.smithi101.stdout: }, 2023-08-01T19:55:32.123 INFO:teuthology.orchestra.run.smithi101.stdout: { 2023-08-01T19:55:32.123 INFO:teuthology.orchestra.run.smithi101.stdout: "description": "osd_repop(client.4668.0:147468 5.6 e48/19 5:65c440bb:::benchmark_data_smithi006_114134_object13807:head v 48'9178, mlcod=48'9175)", 2023-08-01T19:55:32.123 INFO:teuthology.orchestra.run.smithi101.stdout: "initiated_at": "2023-08-01T19:55:32.077212+0000", 2023-08-01T19:55:32.123 INFO:teuthology.orchestra.run.smithi101.stdout: "age": 0.001524697, 2023-08-01T19:55:32.123 INFO:teuthology.orchestra.run.smithi101.stdout: "duration": 0.00171714, 2023-08-01T19:55:32.123 INFO:teuthology.orchestra.run.smithi101.stdout: "type_data": { 2023-08-01T19:55:32.124 INFO:teuthology.orchestra.run.smithi101.stdout: "flag_point": "started", 2023-08-01T19:55:32.124 INFO:teuthology.orchestra.run.smithi101.stdout: "events": [ 2023-08-01T19:55:32.124 INFO:teuthology.orchestra.run.smithi101.stdout: { 2023-08-01T19:55:32.124 INFO:teuthology.orchestra.run.smithi101.stdout: "event": "initiated", 2023-08-01T19:55:32.124 INFO:teuthology.orchestra.run.smithi101.stdout: "time": "2023-08-01T19:55:32.077212+0000", 2023-08-01T19:55:32.124 INFO:teuthology.orchestra.run.smithi101.stdout: "duration": 0 2023-08-01T19:55:32.124 INFO:teuthology.orchestra.run.smithi101.stdout: }, 2023-08-01T19:55:32.124 INFO:teuthology.orchestra.run.smithi101.stdout: { 2023-08-01T19:55:32.125 INFO:teuthology.orchestra.run.smithi101.stdout: "event": "throttled", 2023-08-01T19:55:32.125 INFO:teuthology.orchestra.run.smithi101.stdout: "time": "2023-08-01T19:55:32.077212+0000", 2023-08-01T19:55:32.125 INFO:teuthology.orchestra.run.smithi101.stdout: "duration": 0 2023-08-01T19:55:32.125 INFO:teuthology.orchestra.run.smithi101.stdout: }, 2023-08-01T19:55:32.125 INFO:teuthology.orchestra.run.smithi101.stdout: { 2023-08-01T19:55:32.125 INFO:teuthology.orchestra.run.smithi101.stdout: "event": "header_read", 2023-08-01T19:55:32.125 INFO:teuthology.orchestra.run.smithi101.stdout: "time": "2023-08-01T19:55:32.077212+0000", 2023-08-01T19:55:32.125 INFO:teuthology.orchestra.run.smithi101.stdout: "duration": 4294967295.9999995 2023-08-01T19:55:32.126 INFO:teuthology.orchestra.run.smithi101.stdout: }, 2023-08-01T19:55:32.126 INFO:teuthology.orchestra.run.smithi101.stdout: { 2023-08-01T19:55:32.126 INFO:teuthology.orchestra.run.smithi101.stdout: "event": "all_read", 2023-08-01T19:55:32.126 INFO:teuthology.orchestra.run.smithi101.stdout: "time": "2023-08-01T19:55:32.077217+0000", 2023-08-01T19:55:32.126 INFO:teuthology.orchestra.run.smithi101.stdout: "duration": 5.1019999999999996e-06 2023-08-01T19:55:32.126 INFO:teuthology.orchestra.run.smithi101.stdout: }, 2023-08-01T19:55:32.126 INFO:teuthology.orchestra.run.smithi101.stdout: { 2023-08-01T19:55:32.127 INFO:teuthology.orchestra.run.smithi101.stdout: "event": "dispatched", 2023-08-01T19:55:32.127 INFO:teuthology.orchestra.run.smithi101.stdout: "time": "2023-08-01T19:55:32.077226+0000", 2023-08-01T19:55:32.127 INFO:teuthology.orchestra.run.smithi101.stdout: "duration": 9.4320000000000005e-06 2023-08-01T19:55:32.127 INFO:teuthology.orchestra.run.smithi101.stdout: }, 2023-08-01T19:55:32.127 INFO:teuthology.orchestra.run.smithi101.stdout: { 2023-08-01T19:55:32.127 INFO:teuthology.orchestra.run.smithi101.stdout: "event": "queued_for_pg", 2023-08-01T19:55:32.127 INFO:teuthology.orchestra.run.smithi101.stdout: "time": "2023-08-01T19:55:32.077231+0000", 2023-08-01T19:55:32.127 INFO:teuthology.orchestra.run.smithi101.stdout: "duration": 4.6149999999999999e-06 2023-08-01T19:55:32.128 INFO:teuthology.orchestra.run.smithi101.stdout: }, 2023-08-01T19:55:32.128 INFO:teuthology.orchestra.run.smithi101.stdout: { 2023-08-01T19:55:32.128 INFO:teuthology.orchestra.run.smithi101.stdout: "event": "reached_pg", 2023-08-01T19:55:32.128 INFO:teuthology.orchestra.run.smithi101.stdout: "time": "2023-08-01T19:55:32.077566+0000", 2023-08-01T19:55:32.128 INFO:teuthology.orchestra.run.smithi101.stdout: "duration": 0.00033544599999999999 2023-08-01T19:55:32.128 INFO:teuthology.orchestra.run.smithi101.stdout: }, 2023-08-01T19:55:32.128 INFO:teuthology.orchestra.run.smithi101.stdout: { 2023-08-01T19:55:32.128 INFO:teuthology.orchestra.run.smithi101.stdout: "event": "started", 2023-08-01T19:55:32.129 INFO:teuthology.orchestra.run.smithi101.stdout: "time": "2023-08-01T19:55:32.077584+0000", 2023-08-01T19:55:32.129 INFO:teuthology.orchestra.run.smithi101.stdout: "duration": 1.7091999999999998e-05 2023-08-01T19:55:32.129 INFO:teuthology.orchestra.run.smithi101.stdout: } 2023-08-01T19:55:32.129 INFO:teuthology.orchestra.run.smithi101.stdout: ] 2023-08-01T19:55:32.129 INFO:teuthology.orchestra.run.smithi101.stdout: } 2023-08-01T19:55:32.129 INFO:teuthology.orchestra.run.smithi101.stdout: } 2023-08-01T19:55:32.129 INFO:teuthology.orchestra.run.smithi101.stdout: ], 2023-08-01T19:55:32.130 INFO:teuthology.orchestra.run.smithi101.stdout: "num_ops": 6 2023-08-01T19:55:32.130 INFO:teuthology.orchestra.run.smithi101.stdout:} 2023-08-01T19:55:32.131 DEBUG:teuthology.orchestra.run.smithi101:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 30 ceph --cluster ceph --admin-daemon /var/run/ceph/ceph-osd.1.asok dump_blocked_ops 2023-08-01T19:55:32.131 INFO:tasks.ceph.osd.1.smithi101.stderr:2023-08-01T19:55:32.129+0000 7fb0cb7f6700 -1 received signal: Hangup from /usr/bin/python3 /bin/daemon-helper kill ceph-osd -f --cluster ceph -i 1 (PID: 111141) UID: 0 2023-08-01T19:55:32.231 INFO:tasks.ceph.osd.1.smithi101.stderr:2023-08-01T19:55:32.230+0000 7fb0cb7f6700 -1 received signal: Hangup from /usr/bin/python3 /bin/daemon-helper kill ceph-osd -f --cluster ceph -i 1 (PID: 111141) UID: 0 2023-08-01T19:55:32.328 INFO:teuthology.orchestra.run.smithi101.stdout:{ 2023-08-01T19:55:32.328 INFO:teuthology.orchestra.run.smithi101.stdout: "ops": [], 2023-08-01T19:55:32.329 INFO:teuthology.orchestra.run.smithi101.stdout: "complaint_time": 30, 2023-08-01T19:55:32.329 INFO:teuthology.orchestra.run.smithi101.stdout: "num_blocked_ops": 0 2023-08-01T19:55:32.329 INFO:teuthology.orchestra.run.smithi101.stdout:} 2023-08-01T19:55:32.332 INFO:tasks.ceph.osd.1.smithi101.stderr:2023-08-01T19:55:32.330+0000 7fb0cb7f6700 -1 received signal: Hangup from /usr/bin/python3 /bin/daemon-helper kill ceph-osd -f --cluster ceph -i 1 (PID: 111141) UID: 0 2023-08-01T19:55:32.341 DEBUG:teuthology.orchestra.run.smithi101:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 30 ceph --cluster ceph --admin-daemon /var/run/ceph/ceph-osd.1.asok dump_historic_ops 2023-08-01T19:55:32.432 INFO:tasks.ceph.osd.2.smithi155.stderr:2023-08-01T19:55:32.431+0000 7faa5c6ac700 -1 received signal: Hangup from /usr/bin/python3 /bin/daemon-helper kill ceph-osd -f --cluster ceph -i 2 (PID: 111337) UID: 0 2023-08-01T19:55:32.534 INFO:teuthology.orchestra.run.smithi101.stdout:{ 2023-08-01T19:55:32.535 INFO:teuthology.orchestra.run.smithi101.stdout: "size": 20, 2023-08-01T19:55:32.535 INFO:teuthology.orchestra.run.smithi101.stdout: "duration": 600, 2023-08-01T19:55:32.535 INFO:teuthology.orchestra.run.smithi101.stdout: "ops": [ 2023-08-01T19:55:32.536 INFO:teuthology.orchestra.run.smithi101.stdout: { 2023-08-01T19:55:32.536 INFO:teuthology.orchestra.run.smithi101.stdout: "description": "osd_op(mds.0.3:11 3.10 3:0bd6d154:::602.00000000:head [create,setxattr parent (62) in=6b,setxattr layout (30) in=6b] snapc 0=[] ondisk+write+known_if_redirected+full_force+supports_pool_eio e17)", 2023-08-01T19:55:32.536 INFO:teuthology.orchestra.run.smithi101.stdout: "initiated_at": "2023-08-01T19:54:04.458960+0000", 2023-08-01T19:55:32.536 INFO:teuthology.orchestra.run.smithi101.stdout: "age": 88.071894830999994, 2023-08-01T19:55:32.536 INFO:teuthology.orchestra.run.smithi101.stdout: "duration": 0.019645459000000001, 2023-08-01T19:55:32.537 INFO:teuthology.orchestra.run.smithi101.stdout: "type_data": { 2023-08-01T19:55:32.537 INFO:teuthology.orchestra.run.smithi101.stdout: "flag_point": "commit sent; apply or cleanup", 2023-08-01T19:55:32.537 INFO:teuthology.orchestra.run.smithi101.stdout: "events": [ 2023-08-01T19:55:32.537 INFO:teuthology.orchestra.run.smithi101.stdout: { 2023-08-01T19:55:32.537 INFO:teuthology.orchestra.run.smithi101.stdout: "event": "initiated", 2023-08-01T19:55:32.537 INFO:teuthology.orchestra.run.smithi101.stdout: "time": "2023-08-01T19:54:04.458960+0000", 2023-08-01T19:55:32.537 INFO:teuthology.orchestra.run.smithi101.stdout: "duration": 0 2023-08-01T19:55:32.538 INFO:teuthology.orchestra.run.smithi101.stdout: }, 2023-08-01T19:55:32.538 INFO:teuthology.orchestra.run.smithi101.stdout: { 2023-08-01T19:55:32.538 INFO:teuthology.orchestra.run.smithi101.stdout: "event": "throttled", 2023-08-01T19:55:32.538 INFO:teuthology.orchestra.run.smithi101.stdout: "time": "2023-08-01T19:54:04.458960+0000", 2023-08-01T19:55:32.538 INFO:teuthology.orchestra.run.smithi101.stdout: "duration": 0 2023-08-01T19:55:32.538 INFO:teuthology.orchestra.run.smithi101.stdout: }, 2023-08-01T19:55:32.538 INFO:teuthology.orchestra.run.smithi101.stdout: { 2023-08-01T19:55:32.538 INFO:teuthology.orchestra.run.smithi101.stdout: "event": "header_read", 2023-08-01T19:55:32.539 INFO:teuthology.orchestra.run.smithi101.stdout: "time": "2023-08-01T19:54:04.458959+0000", 2023-08-01T19:55:32.539 INFO:teuthology.orchestra.run.smithi101.stdout: "duration": 4294967295.9999995 2023-08-01T19:55:32.539 INFO:teuthology.orchestra.run.smithi101.stdout: }, 2023-08-01T19:55:32.539 INFO:teuthology.orchestra.run.smithi101.stdout: { 2023-08-01T19:55:32.539 INFO:teuthology.orchestra.run.smithi101.stdout: "event": "all_read", 2023-08-01T19:55:32.539 INFO:teuthology.orchestra.run.smithi101.stdout: "time": "2023-08-01T19:54:04.458963+0000", 2023-08-01T19:55:32.539 INFO:teuthology.orchestra.run.smithi101.stdout: "duration": 3.9199999999999997e-06 2023-08-01T19:55:32.539 INFO:teuthology.orchestra.run.smithi101.stdout: }, 2023-08-01T19:55:32.540 INFO:teuthology.orchestra.run.smithi101.stdout: { 2023-08-01T19:55:32.540 INFO:teuthology.orchestra.run.smithi101.stdout: "event": "dispatched", 2023-08-01T19:55:32.540 INFO:teuthology.orchestra.run.smithi101.stdout: "time": "2023-08-01T19:54:04.458970+0000", 2023-08-01T19:55:32.540 INFO:teuthology.orchestra.run.smithi101.stdout: "duration": 7.0439999999999998e-06 2023-08-01T19:55:32.540 INFO:teuthology.orchestra.run.smithi101.stdout: }, 2023-08-01T19:55:32.540 INFO:teuthology.orchestra.run.smithi101.stdout: { 2023-08-01T19:55:32.540 INFO:teuthology.orchestra.run.smithi101.stdout: "event": "queued_for_pg", 2023-08-01T19:55:32.541 INFO:teuthology.orchestra.run.smithi101.stdout: "time": "2023-08-01T19:54:04.458976+0000", 2023-08-01T19:55:32.541 INFO:teuthology.orchestra.run.smithi101.stdout: "duration": 5.9540000000000001e-06 2023-08-01T19:55:32.541 INFO:teuthology.orchestra.run.smithi101.stdout: }, 2023-08-01T19:55:32.541 INFO:teuthology.orchestra.run.smithi101.stdout: { 2023-08-01T19:55:32.541 INFO:teuthology.orchestra.run.smithi101.stdout: "event": "reached_pg", 2023-08-01T19:55:32.541 INFO:teuthology.orchestra.run.smithi101.stdout: "time": "2023-08-01T19:54:04.459035+0000", 2023-08-01T19:55:32.541 INFO:teuthology.orchestra.run.smithi101.stdout: "duration": 5.8924e-05 2023-08-01T19:55:32.541 INFO:teuthology.orchestra.run.smithi101.stdout: }, 2023-08-01T19:55:32.542 INFO:teuthology.orchestra.run.smithi101.stdout: { 2023-08-01T19:55:32.542 INFO:teuthology.orchestra.run.smithi101.stdout: "event": "waiting_for_map not empty", 2023-08-01T19:55:32.542 INFO:teuthology.orchestra.run.smithi101.stdout: "time": "2023-08-01T19:54:04.459038+0000", 2023-08-01T19:55:32.542 INFO:teuthology.orchestra.run.smithi101.stdout: "duration": 3.2760000000000001e-06 2023-08-01T19:55:32.542 INFO:teuthology.orchestra.run.smithi101.stdout: }, 2023-08-01T19:55:32.542 INFO:teuthology.orchestra.run.smithi101.stdout: { 2023-08-01T19:55:32.542 INFO:teuthology.orchestra.run.smithi101.stdout: "event": "reached_pg", 2023-08-01T19:55:32.542 INFO:teuthology.orchestra.run.smithi101.stdout: "time": "2023-08-01T19:54:04.471511+0000", 2023-08-01T19:55:32.543 INFO:teuthology.orchestra.run.smithi101.stdout: "duration": 0.012473039999999999 2023-08-01T19:55:32.543 INFO:teuthology.orchestra.run.smithi101.stdout: }, 2023-08-01T19:55:32.543 INFO:teuthology.orchestra.run.smithi101.stdout: { 2023-08-01T19:55:32.543 INFO:teuthology.orchestra.run.smithi101.stdout: "event": "started", 2023-08-01T19:55:32.543 INFO:teuthology.orchestra.run.smithi101.stdout: "time": "2023-08-01T19:54:04.472086+0000", 2023-08-01T19:55:32.543 INFO:teuthology.orchestra.run.smithi101.stdout: "duration": 0.00057491699999999998 2023-08-01T19:55:32.543 INFO:teuthology.orchestra.run.smithi101.stdout: }, 2023-08-01T19:55:32.543 INFO:teuthology.orchestra.run.smithi101.stdout: { 2023-08-01T19:55:32.544 INFO:teuthology.orchestra.run.smithi101.stdout: "event": "waiting for subops from 2", 2023-08-01T19:55:32.544 INFO:teuthology.orchestra.run.smithi101.stdout: "time": "2023-08-01T19:54:04.472310+0000", 2023-08-01T19:55:32.544 INFO:teuthology.orchestra.run.smithi101.stdout: "duration": 0.00022396499999999999 2023-08-01T19:55:32.544 INFO:teuthology.orchestra.run.smithi101.stdout: }, 2023-08-01T19:55:32.544 INFO:teuthology.orchestra.run.smithi101.stdout: { 2023-08-01T19:55:32.544 INFO:teuthology.orchestra.run.smithi101.stdout: "event": "op_commit", 2023-08-01T19:55:32.544 INFO:teuthology.orchestra.run.smithi101.stdout: "time": "2023-08-01T19:54:04.478141+0000", 2023-08-01T19:55:32.544 INFO:teuthology.orchestra.run.smithi101.stdout: "duration": 0.0058312320000000004 2023-08-01T19:55:32.545 INFO:teuthology.orchestra.run.smithi101.stdout: }, 2023-08-01T19:55:32.545 INFO:teuthology.orchestra.run.smithi101.stdout: { 2023-08-01T19:55:32.545 INFO:teuthology.orchestra.run.smithi101.stdout: "event": "sub_op_commit_rec", 2023-08-01T19:55:32.545 INFO:teuthology.orchestra.run.smithi101.stdout: "time": "2023-08-01T19:54:04.478543+0000", 2023-08-01T19:55:32.545 INFO:teuthology.orchestra.run.smithi101.stdout: "duration": 0.00040160800000000002 2023-08-01T19:55:32.545 INFO:teuthology.orchestra.run.smithi101.stdout: }, 2023-08-01T19:55:32.545 INFO:teuthology.orchestra.run.smithi101.stdout: { 2023-08-01T19:55:32.546 INFO:teuthology.orchestra.run.smithi101.stdout: "event": "commit_sent", 2023-08-01T19:55:32.546 INFO:teuthology.orchestra.run.smithi101.stdout: "time": "2023-08-01T19:54:04.478584+0000", 2023-08-01T19:55:32.546 INFO:teuthology.orchestra.run.smithi101.stdout: "duration": 4.0989999999999999e-05 2023-08-01T19:55:32.546 INFO:teuthology.orchestra.run.smithi101.stdout: }, 2023-08-01T19:55:32.546 INFO:teuthology.orchestra.run.smithi101.stdout: { 2023-08-01T19:55:32.546 INFO:teuthology.orchestra.run.smithi101.stdout: "event": "done", 2023-08-01T19:55:32.546 INFO:teuthology.orchestra.run.smithi101.stdout: "time": "2023-08-01T19:54:04.478605+0000", 2023-08-01T19:55:32.546 INFO:teuthology.orchestra.run.smithi101.stdout: "duration": 2.1178e-05 2023-08-01T19:55:32.547 INFO:teuthology.orchestra.run.smithi101.stdout: } 2023-08-01T19:55:32.547 INFO:teuthology.orchestra.run.smithi101.stdout: ] 2023-08-01T19:55:32.547 INFO:teuthology.orchestra.run.smithi101.stdout: } 2023-08-01T19:55:32.547 INFO:teuthology.orchestra.run.smithi101.stdout: }, 2023-08-01T19:55:32.547 INFO:teuthology.orchestra.run.smithi101.stdout: { 2023-08-01T19:55:32.547 INFO:teuthology.orchestra.run.smithi101.stdout: "description": "osd_op(mds.0.3:12 3.10 3:0d89b25e:::603.00000000:head [omap-set-header] snapc 0=[] ondisk+write+known_if_redirected+full_force+supports_pool_eio e17)", 2023-08-01T19:55:32.547 INFO:teuthology.orchestra.run.smithi101.stdout: "initiated_at": "2023-08-01T19:54:04.458982+0000", 2023-08-01T19:55:32.547 INFO:teuthology.orchestra.run.smithi101.stdout: "age": 88.071872603000003, 2023-08-01T19:55:32.548 INFO:teuthology.orchestra.run.smithi101.stdout: "duration": 0.021266334000000001, 2023-08-01T19:55:32.548 INFO:teuthology.orchestra.run.smithi101.stdout: "type_data": { 2023-08-01T19:55:32.548 INFO:teuthology.orchestra.run.smithi101.stdout: "flag_point": "commit sent; apply or cleanup", 2023-08-01T19:55:32.548 INFO:teuthology.orchestra.run.smithi101.stdout: "events": [ 2023-08-01T19:55:32.548 INFO:teuthology.orchestra.run.smithi101.stdout: { 2023-08-01T19:55:32.548 INFO:teuthology.orchestra.run.smithi101.stdout: "event": "initiated", 2023-08-01T19:55:32.548 INFO:teuthology.orchestra.run.smithi101.stdout: "time": "2023-08-01T19:54:04.458982+0000", 2023-08-01T19:55:32.548 INFO:teuthology.orchestra.run.smithi101.stdout: "duration": 0 2023-08-01T19:55:32.549 INFO:teuthology.orchestra.run.smithi101.stdout: }, 2023-08-01T19:55:32.549 INFO:teuthology.orchestra.run.smithi101.stdout: { 2023-08-01T19:55:32.549 INFO:teuthology.orchestra.run.smithi101.stdout: "event": "throttled", 2023-08-01T19:55:32.549 INFO:teuthology.orchestra.run.smithi101.stdout: "time": "2023-08-01T19:54:04.458982+0000", 2023-08-01T19:55:32.549 INFO:teuthology.orchestra.run.smithi101.stdout: "duration": 0 2023-08-01T19:55:32.549 INFO:teuthology.orchestra.run.smithi101.stdout: }, 2023-08-01T19:55:32.549 INFO:teuthology.orchestra.run.smithi101.stdout: { 2023-08-01T19:55:32.550 INFO:teuthology.orchestra.run.smithi101.stdout: "event": "header_read", 2023-08-01T19:55:32.550 INFO:teuthology.orchestra.run.smithi101.stdout: "time": "2023-08-01T19:54:04.458982+0000", 2023-08-01T19:55:32.550 INFO:teuthology.orchestra.run.smithi101.stdout: "duration": 4294967295.9999995 2023-08-01T19:55:32.550 INFO:teuthology.orchestra.run.smithi101.stdout: }, 2023-08-01T19:55:32.550 INFO:teuthology.orchestra.run.smithi101.stdout: { 2023-08-01T19:55:32.550 INFO:teuthology.orchestra.run.smithi101.stdout: "event": "all_read", 2023-08-01T19:55:32.550 INFO:teuthology.orchestra.run.smithi101.stdout: "time": "2023-08-01T19:54:04.458985+0000", 2023-08-01T19:55:32.550 INFO:teuthology.orchestra.run.smithi101.stdout: "duration": 3.4800000000000001e-06 2023-08-01T19:55:32.551 INFO:teuthology.orchestra.run.smithi101.stdout: }, 2023-08-01T19:55:32.551 INFO:teuthology.orchestra.run.smithi101.stdout: { 2023-08-01T19:55:32.551 INFO:teuthology.orchestra.run.smithi101.stdout: "event": "dispatched", 2023-08-01T19:55:32.551 INFO:teuthology.orchestra.run.smithi101.stdout: "time": "2023-08-01T19:54:04.458992+0000", 2023-08-01T19:55:32.551 INFO:teuthology.orchestra.run.smithi101.stdout: "duration": 7.306e-06 2023-08-01T19:55:32.551 INFO:teuthology.orchestra.run.smithi101.stdout: }, 2023-08-01T19:55:32.551 INFO:teuthology.orchestra.run.smithi101.stdout: { 2023-08-01T19:55:32.551 INFO:teuthology.orchestra.run.smithi101.stdout: "event": "queued_for_pg", 2023-08-01T19:55:32.552 INFO:teuthology.orchestra.run.smithi101.stdout: "time": "2023-08-01T19:54:04.458997+0000", 2023-08-01T19:55:32.552 INFO:teuthology.orchestra.run.smithi101.stdout: "duration": 4.4530000000000004e-06 2023-08-01T19:55:32.552 INFO:teuthology.orchestra.run.smithi101.stdout: }, 2023-08-01T19:55:32.552 INFO:teuthology.orchestra.run.smithi101.stdout: { 2023-08-01T19:55:32.552 INFO:teuthology.orchestra.run.smithi101.stdout: "event": "reached_pg", 2023-08-01T19:55:32.552 INFO:teuthology.orchestra.run.smithi101.stdout: "time": "2023-08-01T19:54:04.459060+0000", 2023-08-01T19:55:32.552 INFO:teuthology.orchestra.run.smithi101.stdout: "duration": 6.3249000000000004e-05 2023-08-01T19:55:32.553 INFO:teuthology.orchestra.run.smithi101.stdout: }, 2023-08-01T19:55:32.553 INFO:teuthology.orchestra.run.smithi101.stdout: { 2023-08-01T19:55:32.553 INFO:teuthology.orchestra.run.smithi101.stdout: "event": "waiting_for_map not empty", 2023-08-01T19:55:32.553 INFO:teuthology.orchestra.run.smithi101.stdout: "time": "2023-08-01T19:54:04.459063+0000", 2023-08-01T19:55:32.553 INFO:teuthology.orchestra.run.smithi101.stdout: "duration": 2.717e-06 2023-08-01T19:55:32.553 INFO:teuthology.orchestra.run.smithi101.stdout: }, 2023-08-01T19:55:32.553 INFO:teuthology.orchestra.run.smithi101.stdout: { 2023-08-01T19:55:32.553 INFO:teuthology.orchestra.run.smithi101.stdout: "event": "reached_pg", 2023-08-01T19:55:32.554 INFO:teuthology.orchestra.run.smithi101.stdout: "time": "2023-08-01T19:54:04.473625+0000", 2023-08-01T19:55:32.554 INFO:teuthology.orchestra.run.smithi101.stdout: "duration": 0.014562007 2023-08-01T19:55:32.554 INFO:teuthology.orchestra.run.smithi101.stdout: }, 2023-08-01T19:55:32.554 INFO:teuthology.orchestra.run.smithi101.stdout: { 2023-08-01T19:55:32.554 INFO:teuthology.orchestra.run.smithi101.stdout: "event": "started", 2023-08-01T19:55:32.554 INFO:teuthology.orchestra.run.smithi101.stdout: "time": "2023-08-01T19:54:04.473757+0000", 2023-08-01T19:55:32.554 INFO:teuthology.orchestra.run.smithi101.stdout: "duration": 0.00013238599999999999 2023-08-01T19:55:32.554 INFO:teuthology.orchestra.run.smithi101.stdout: }, 2023-08-01T19:55:32.555 INFO:teuthology.orchestra.run.smithi101.stdout: { 2023-08-01T19:55:32.555 INFO:teuthology.orchestra.run.smithi101.stdout: "event": "waiting for subops from 2", 2023-08-01T19:55:32.555 INFO:teuthology.orchestra.run.smithi101.stdout: "time": "2023-08-01T19:54:04.473898+0000", 2023-08-01T19:55:32.555 INFO:teuthology.orchestra.run.smithi101.stdout: "duration": 0.00014039 2023-08-01T19:55:32.555 INFO:teuthology.orchestra.run.smithi101.stdout: }, 2023-08-01T19:55:32.555 INFO:teuthology.orchestra.run.smithi101.stdout: { 2023-08-01T19:55:32.555 INFO:teuthology.orchestra.run.smithi101.stdout: "event": "op_commit", 2023-08-01T19:55:32.555 INFO:teuthology.orchestra.run.smithi101.stdout: "time": "2023-08-01T19:54:04.478380+0000", 2023-08-01T19:55:32.556 INFO:teuthology.orchestra.run.smithi101.stdout: "duration": 0.0044827449999999998 2023-08-01T19:55:32.556 INFO:teuthology.orchestra.run.smithi101.stdout: }, 2023-08-01T19:55:32.556 INFO:teuthology.orchestra.run.smithi101.stdout: { 2023-08-01T19:55:32.556 INFO:teuthology.orchestra.run.smithi101.stdout: "event": "sub_op_commit_rec", 2023-08-01T19:55:32.556 INFO:teuthology.orchestra.run.smithi101.stdout: "time": "2023-08-01T19:54:04.480169+0000", 2023-08-01T19:55:32.556 INFO:teuthology.orchestra.run.smithi101.stdout: "duration": 0.0017886040000000001 2023-08-01T19:55:32.556 INFO:teuthology.orchestra.run.smithi101.stdout: }, 2023-08-01T19:55:32.556 INFO:teuthology.orchestra.run.smithi101.stdout: { 2023-08-01T19:55:32.557 INFO:teuthology.orchestra.run.smithi101.stdout: "event": "commit_sent", 2023-08-01T19:55:32.557 INFO:teuthology.orchestra.run.smithi101.stdout: "time": "2023-08-01T19:54:04.480212+0000", 2023-08-01T19:55:32.557 INFO:teuthology.orchestra.run.smithi101.stdout: "duration": 4.2687e-05 2023-08-01T19:55:32.557 INFO:teuthology.orchestra.run.smithi101.stdout: }, 2023-08-01T19:55:32.557 INFO:teuthology.orchestra.run.smithi101.stdout: { 2023-08-01T19:55:32.557 INFO:teuthology.orchestra.run.smithi101.stdout: "event": "done", 2023-08-01T19:55:32.557 INFO:teuthology.orchestra.run.smithi101.stdout: "time": "2023-08-01T19:54:04.480248+0000", 2023-08-01T19:55:32.557 INFO:teuthology.orchestra.run.smithi101.stdout: "duration": 3.6743999999999999e-05 2023-08-01T19:55:32.558 INFO:teuthology.orchestra.run.smithi101.stdout: } 2023-08-01T19:55:32.558 INFO:teuthology.orchestra.run.smithi101.stdout: ] 2023-08-01T19:55:32.558 INFO:teuthology.orchestra.run.smithi101.stdout: } 2023-08-01T19:55:32.558 INFO:teuthology.orchestra.run.smithi101.stdout: }, 2023-08-01T19:55:32.558 INFO:teuthology.orchestra.run.smithi101.stdout: { 2023-08-01T19:55:32.558 INFO:teuthology.orchestra.run.smithi101.stdout: "description": "osd_op(mds.0.3:13 3.10 3:0d89b25e:::603.00000000:head [create,setxattr parent (62) in=6b,setxattr layout (30) in=6b] snapc 0=[] ondisk+write+known_if_redirected+full_force+supports_pool_eio e17)", 2023-08-01T19:55:32.558 INFO:teuthology.orchestra.run.smithi101.stdout: "initiated_at": "2023-08-01T19:54:04.459010+0000", 2023-08-01T19:55:32.559 INFO:teuthology.orchestra.run.smithi101.stdout: "age": 88.071844882999997, 2023-08-01T19:55:32.559 INFO:teuthology.orchestra.run.smithi101.stdout: "duration": 0.021327220000000001, 2023-08-01T19:55:32.559 INFO:teuthology.orchestra.run.smithi101.stdout: "type_data": { 2023-08-01T19:55:32.559 INFO:teuthology.orchestra.run.smithi101.stdout: "flag_point": "commit sent; apply or cleanup", 2023-08-01T19:55:32.559 INFO:teuthology.orchestra.run.smithi101.stdout: "events": [ 2023-08-01T19:55:32.559 INFO:teuthology.orchestra.run.smithi101.stdout: { 2023-08-01T19:55:32.559 INFO:teuthology.orchestra.run.smithi101.stdout: "event": "initiated", 2023-08-01T19:55:32.559 INFO:teuthology.orchestra.run.smithi101.stdout: "time": "2023-08-01T19:54:04.459010+0000", 2023-08-01T19:55:32.560 INFO:teuthology.orchestra.run.smithi101.stdout: "duration": 0 2023-08-01T19:55:32.560 INFO:teuthology.orchestra.run.smithi101.stdout: }, 2023-08-01T19:55:32.560 INFO:teuthology.orchestra.run.smithi101.stdout: { 2023-08-01T19:55:32.560 INFO:teuthology.orchestra.run.smithi101.stdout: "event": "throttled", 2023-08-01T19:55:32.560 INFO:teuthology.orchestra.run.smithi101.stdout: "time": "2023-08-01T19:54:04.459010+0000", 2023-08-01T19:55:32.560 INFO:teuthology.orchestra.run.smithi101.stdout: "duration": 0 2023-08-01T19:55:32.560 INFO:teuthology.orchestra.run.smithi101.stdout: }, 2023-08-01T19:55:32.561 INFO:teuthology.orchestra.run.smithi101.stdout: { 2023-08-01T19:55:32.561 INFO:teuthology.orchestra.run.smithi101.stdout: "event": "header_read", 2023-08-01T19:55:32.561 INFO:teuthology.orchestra.run.smithi101.stdout: "time": "2023-08-01T19:54:04.459009+0000", 2023-08-01T19:55:32.561 INFO:teuthology.orchestra.run.smithi101.stdout: "duration": 4294967295.9999995 2023-08-01T19:55:32.561 INFO:teuthology.orchestra.run.smithi101.stdout: }, 2023-08-01T19:55:32.561 INFO:teuthology.orchestra.run.smithi101.stdout: { 2023-08-01T19:55:32.561 INFO:teuthology.orchestra.run.smithi101.stdout: "event": "all_read", 2023-08-01T19:55:32.561 INFO:teuthology.orchestra.run.smithi101.stdout: "time": "2023-08-01T19:54:04.459013+0000", 2023-08-01T19:55:32.562 INFO:teuthology.orchestra.run.smithi101.stdout: "duration": 3.8929999999999998e-06 2023-08-01T19:55:32.562 INFO:teuthology.orchestra.run.smithi101.stdout: }, 2023-08-01T19:55:32.562 INFO:teuthology.orchestra.run.smithi101.stdout: { 2023-08-01T19:55:32.562 INFO:teuthology.orchestra.run.smithi101.stdout: "event": "dispatched", 2023-08-01T19:55:32.562 INFO:teuthology.orchestra.run.smithi101.stdout: "time": "2023-08-01T19:54:04.459027+0000", 2023-08-01T19:55:32.562 INFO:teuthology.orchestra.run.smithi101.stdout: "duration": 1.3416e-05 2023-08-01T19:55:32.562 INFO:teuthology.orchestra.run.smithi101.stdout: }, 2023-08-01T19:55:32.562 INFO:teuthology.orchestra.run.smithi101.stdout: { 2023-08-01T19:55:32.563 INFO:teuthology.orchestra.run.smithi101.stdout: "event": "queued_for_pg", 2023-08-01T19:55:32.563 INFO:teuthology.orchestra.run.smithi101.stdout: "time": "2023-08-01T19:54:04.459033+0000", 2023-08-01T19:55:32.563 INFO:teuthology.orchestra.run.smithi101.stdout: "duration": 5.9800000000000003e-06 2023-08-01T19:55:32.563 INFO:teuthology.orchestra.run.smithi101.stdout: }, 2023-08-01T19:55:32.563 INFO:teuthology.orchestra.run.smithi101.stdout: { 2023-08-01T19:55:32.563 INFO:teuthology.orchestra.run.smithi101.stdout: "event": "reached_pg", 2023-08-01T19:55:32.563 INFO:teuthology.orchestra.run.smithi101.stdout: "time": "2023-08-01T19:54:04.459099+0000", 2023-08-01T19:55:32.564 INFO:teuthology.orchestra.run.smithi101.stdout: "duration": 6.6192999999999995e-05 2023-08-01T19:55:32.564 INFO:teuthology.orchestra.run.smithi101.stdout: }, 2023-08-01T19:55:32.564 INFO:teuthology.orchestra.run.smithi101.stdout: { 2023-08-01T19:55:32.564 INFO:teuthology.orchestra.run.smithi101.stdout: "event": "waiting_for_map not empty", 2023-08-01T19:55:32.564 INFO:teuthology.orchestra.run.smithi101.stdout: "time": "2023-08-01T19:54:04.459106+0000", 2023-08-01T19:55:32.564 INFO:teuthology.orchestra.run.smithi101.stdout: "duration": 6.8619999999999997e-06 2023-08-01T19:55:32.564 INFO:teuthology.orchestra.run.smithi101.stdout: }, 2023-08-01T19:55:32.564 INFO:teuthology.orchestra.run.smithi101.stdout: { 2023-08-01T19:55:32.565 INFO:teuthology.orchestra.run.smithi101.stdout: "event": "reached_pg", 2023-08-01T19:55:32.565 INFO:teuthology.orchestra.run.smithi101.stdout: "time": "2023-08-01T19:54:04.475182+0000", 2023-08-01T19:55:32.565 INFO:teuthology.orchestra.run.smithi101.stdout: "duration": 0.016076333000000002 2023-08-01T19:55:32.565 INFO:teuthology.orchestra.run.smithi101.stdout: }, 2023-08-01T19:55:32.565 INFO:teuthology.orchestra.run.smithi101.stdout: { 2023-08-01T19:55:32.565 INFO:teuthology.orchestra.run.smithi101.stdout: "event": "started", 2023-08-01T19:55:32.565 INFO:teuthology.orchestra.run.smithi101.stdout: "time": "2023-08-01T19:54:04.475353+0000", 2023-08-01T19:55:32.566 INFO:teuthology.orchestra.run.smithi101.stdout: "duration": 0.000171378 2023-08-01T19:55:32.566 INFO:teuthology.orchestra.run.smithi101.stdout: }, 2023-08-01T19:55:32.566 INFO:teuthology.orchestra.run.smithi101.stdout: { 2023-08-01T19:55:32.566 INFO:teuthology.orchestra.run.smithi101.stdout: "event": "waiting for subops from 2", 2023-08-01T19:55:32.566 INFO:teuthology.orchestra.run.smithi101.stdout: "time": "2023-08-01T19:54:04.475793+0000", 2023-08-01T19:55:32.566 INFO:teuthology.orchestra.run.smithi101.stdout: "duration": 0.000440123 2023-08-01T19:55:32.566 INFO:teuthology.orchestra.run.smithi101.stdout: }, 2023-08-01T19:55:32.566 INFO:teuthology.orchestra.run.smithi101.stdout: { 2023-08-01T19:55:32.567 INFO:teuthology.orchestra.run.smithi101.stdout: "event": "op_commit", 2023-08-01T19:55:32.567 INFO:teuthology.orchestra.run.smithi101.stdout: "time": "2023-08-01T19:54:04.478624+0000", 2023-08-01T19:55:32.567 INFO:teuthology.orchestra.run.smithi101.stdout: "duration": 0.0028305000000000001 2023-08-01T19:55:32.567 INFO:teuthology.orchestra.run.smithi101.stdout: }, 2023-08-01T19:55:32.567 INFO:teuthology.orchestra.run.smithi101.stdout: { 2023-08-01T19:55:32.567 INFO:teuthology.orchestra.run.smithi101.stdout: "event": "sub_op_commit_rec", 2023-08-01T19:55:32.567 INFO:teuthology.orchestra.run.smithi101.stdout: "time": "2023-08-01T19:54:04.480291+0000", 2023-08-01T19:55:32.567 INFO:teuthology.orchestra.run.smithi101.stdout: "duration": 0.0016670000000000001 2023-08-01T19:55:32.568 INFO:teuthology.orchestra.run.smithi101.stdout: }, 2023-08-01T19:55:32.568 INFO:teuthology.orchestra.run.smithi101.stdout: { 2023-08-01T19:55:32.568 INFO:teuthology.orchestra.run.smithi101.stdout: "event": "commit_sent", 2023-08-01T19:55:32.568 INFO:teuthology.orchestra.run.smithi101.stdout: "time": "2023-08-01T19:54:04.480318+0000", 2023-08-01T19:55:32.568 INFO:teuthology.orchestra.run.smithi101.stdout: "duration": 2.6815e-05 2023-08-01T19:55:32.568 INFO:teuthology.orchestra.run.smithi101.stdout: }, 2023-08-01T19:55:32.568 INFO:teuthology.orchestra.run.smithi101.stdout: { 2023-08-01T19:55:32.569 INFO:teuthology.orchestra.run.smithi101.stdout: "event": "done", 2023-08-01T19:55:32.569 INFO:teuthology.orchestra.run.smithi101.stdout: "time": "2023-08-01T19:54:04.480337+0000", 2023-08-01T19:55:32.569 INFO:teuthology.orchestra.run.smithi101.stdout: "duration": 1.9241000000000001e-05 2023-08-01T19:55:32.569 INFO:teuthology.orchestra.run.smithi101.stdout: } 2023-08-01T19:55:32.569 INFO:teuthology.orchestra.run.smithi101.stdout: ] 2023-08-01T19:55:32.569 INFO:teuthology.orchestra.run.smithi101.stdout: } 2023-08-01T19:55:32.569 INFO:teuthology.orchestra.run.smithi101.stdout: }, 2023-08-01T19:55:32.569 INFO:teuthology.orchestra.run.smithi101.stdout: { 2023-08-01T19:55:32.570 INFO:teuthology.orchestra.run.smithi101.stdout: "description": "osd_op(mds.0.3:1 3.14 3:292cf221:::200.00000000:head [writefull 0~90] snapc 0=[] ondisk+write+known_if_redirected+full_force+supports_pool_eio e17)", 2023-08-01T19:55:32.570 INFO:teuthology.orchestra.run.smithi101.stdout: "initiated_at": "2023-08-01T19:54:04.459177+0000", 2023-08-01T19:55:32.570 INFO:teuthology.orchestra.run.smithi101.stdout: "age": 88.071677984000004, 2023-08-01T19:55:32.570 INFO:teuthology.orchestra.run.smithi101.stdout: "duration": 0.021067196, 2023-08-01T19:55:32.570 INFO:teuthology.orchestra.run.smithi101.stdout: "type_data": { 2023-08-01T19:55:32.570 INFO:teuthology.orchestra.run.smithi101.stdout: "flag_point": "commit sent; apply or cleanup", 2023-08-01T19:55:32.570 INFO:teuthology.orchestra.run.smithi101.stdout: "events": [ 2023-08-01T19:55:32.570 INFO:teuthology.orchestra.run.smithi101.stdout: { 2023-08-01T19:55:32.571 INFO:teuthology.orchestra.run.smithi101.stdout: "event": "initiated", 2023-08-01T19:55:32.571 INFO:teuthology.orchestra.run.smithi101.stdout: "time": "2023-08-01T19:54:04.459177+0000", 2023-08-01T19:55:32.571 INFO:teuthology.orchestra.run.smithi101.stdout: "duration": 0 2023-08-01T19:55:32.571 INFO:teuthology.orchestra.run.smithi101.stdout: }, 2023-08-01T19:55:32.571 INFO:teuthology.orchestra.run.smithi101.stdout: { 2023-08-01T19:55:32.571 INFO:teuthology.orchestra.run.smithi101.stdout: "event": "throttled", 2023-08-01T19:55:32.571 INFO:teuthology.orchestra.run.smithi101.stdout: "time": "2023-08-01T19:54:04.459177+0000", 2023-08-01T19:55:32.572 INFO:teuthology.orchestra.run.smithi101.stdout: "duration": 0 2023-08-01T19:55:32.572 INFO:teuthology.orchestra.run.smithi101.stdout: }, 2023-08-01T19:55:32.572 INFO:teuthology.orchestra.run.smithi101.stdout: { 2023-08-01T19:55:32.572 INFO:teuthology.orchestra.run.smithi101.stdout: "event": "header_read", 2023-08-01T19:55:32.572 INFO:teuthology.orchestra.run.smithi101.stdout: "time": "2023-08-01T19:54:04.459176+0000", 2023-08-01T19:55:32.572 INFO:teuthology.orchestra.run.smithi101.stdout: "duration": 4294967295.9999995 2023-08-01T19:55:32.572 INFO:teuthology.orchestra.run.smithi101.stdout: }, 2023-08-01T19:55:32.572 INFO:teuthology.orchestra.run.smithi101.stdout: { 2023-08-01T19:55:32.573 INFO:teuthology.orchestra.run.smithi101.stdout: "event": "all_read", 2023-08-01T19:55:32.573 INFO:teuthology.orchestra.run.smithi101.stdout: "time": "2023-08-01T19:54:04.459181+0000", 2023-08-01T19:55:32.573 INFO:teuthology.orchestra.run.smithi101.stdout: "duration": 5.2109999999999997e-06 2023-08-01T19:55:32.573 INFO:teuthology.orchestra.run.smithi101.stdout: }, 2023-08-01T19:55:32.573 INFO:teuthology.orchestra.run.smithi101.stdout: { 2023-08-01T19:55:32.573 INFO:teuthology.orchestra.run.smithi101.stdout: "event": "dispatched", 2023-08-01T19:55:32.573 INFO:teuthology.orchestra.run.smithi101.stdout: "time": "2023-08-01T19:54:04.459188+0000", 2023-08-01T19:55:32.573 INFO:teuthology.orchestra.run.smithi101.stdout: "duration": 6.6680000000000004e-06 2023-08-01T19:55:32.574 INFO:teuthology.orchestra.run.smithi101.stdout: }, 2023-08-01T19:55:32.574 INFO:teuthology.orchestra.run.smithi101.stdout: { 2023-08-01T19:55:32.574 INFO:teuthology.orchestra.run.smithi101.stdout: "event": "queued_for_pg", 2023-08-01T19:55:32.574 INFO:teuthology.orchestra.run.smithi101.stdout: "time": "2023-08-01T19:54:04.459192+0000", 2023-08-01T19:55:32.574 INFO:teuthology.orchestra.run.smithi101.stdout: "duration": 4.228e-06 2023-08-01T19:55:32.574 INFO:teuthology.orchestra.run.smithi101.stdout: }, 2023-08-01T19:55:32.574 INFO:teuthology.orchestra.run.smithi101.stdout: { 2023-08-01T19:55:32.575 INFO:teuthology.orchestra.run.smithi101.stdout: "event": "reached_pg", 2023-08-01T19:55:32.575 INFO:teuthology.orchestra.run.smithi101.stdout: "time": "2023-08-01T19:54:04.459219+0000", 2023-08-01T19:55:32.575 INFO:teuthology.orchestra.run.smithi101.stdout: "duration": 2.6930000000000001e-05 2023-08-01T19:55:32.575 INFO:teuthology.orchestra.run.smithi101.stdout: }, 2023-08-01T19:55:32.575 INFO:teuthology.orchestra.run.smithi101.stdout: { 2023-08-01T19:55:32.575 INFO:teuthology.orchestra.run.smithi101.stdout: "event": "waiting_for_map not empty", 2023-08-01T19:55:32.575 INFO:teuthology.orchestra.run.smithi101.stdout: "time": "2023-08-01T19:54:04.459223+0000", 2023-08-01T19:55:32.576 INFO:teuthology.orchestra.run.smithi101.stdout: "duration": 3.8469999999999998e-06 2023-08-01T19:55:32.576 INFO:teuthology.orchestra.run.smithi101.stdout: }, 2023-08-01T19:55:32.576 INFO:teuthology.orchestra.run.smithi101.stdout: { 2023-08-01T19:55:32.576 INFO:teuthology.orchestra.run.smithi101.stdout: "event": "reached_pg", 2023-08-01T19:55:32.576 INFO:teuthology.orchestra.run.smithi101.stdout: "time": "2023-08-01T19:54:04.473347+0000", 2023-08-01T19:55:32.576 INFO:teuthology.orchestra.run.smithi101.stdout: "duration": 0.014124319 2023-08-01T19:55:32.576 INFO:teuthology.orchestra.run.smithi101.stdout: }, 2023-08-01T19:55:32.577 INFO:teuthology.orchestra.run.smithi101.stdout: { 2023-08-01T19:55:32.577 INFO:teuthology.orchestra.run.smithi101.stdout: "event": "started", 2023-08-01T19:55:32.577 INFO:teuthology.orchestra.run.smithi101.stdout: "time": "2023-08-01T19:54:04.473480+0000", 2023-08-01T19:55:32.577 INFO:teuthology.orchestra.run.smithi101.stdout: "duration": 0.00013276799999999999 2023-08-01T19:55:32.577 INFO:teuthology.orchestra.run.smithi101.stdout: }, 2023-08-01T19:55:32.577 INFO:teuthology.orchestra.run.smithi101.stdout: { 2023-08-01T19:55:32.577 INFO:teuthology.orchestra.run.smithi101.stdout: "event": "waiting for subops from 2", 2023-08-01T19:55:32.578 INFO:teuthology.orchestra.run.smithi101.stdout: "time": "2023-08-01T19:54:04.473622+0000", 2023-08-01T19:55:32.578 INFO:teuthology.orchestra.run.smithi101.stdout: "duration": 0.00014154799999999999 2023-08-01T19:55:32.578 INFO:teuthology.orchestra.run.smithi101.stdout: }, 2023-08-01T19:55:32.578 INFO:teuthology.orchestra.run.smithi101.stdout: { 2023-08-01T19:55:32.578 INFO:teuthology.orchestra.run.smithi101.stdout: "event": "op_commit", 2023-08-01T19:55:32.578 INFO:teuthology.orchestra.run.smithi101.stdout: "time": "2023-08-01T19:54:04.478281+0000", 2023-08-01T19:55:32.578 INFO:teuthology.orchestra.run.smithi101.stdout: "duration": 0.004659252 2023-08-01T19:55:32.579 INFO:teuthology.orchestra.run.smithi101.stdout: }, 2023-08-01T19:55:32.579 INFO:teuthology.orchestra.run.smithi101.stdout: { 2023-08-01T19:55:32.579 INFO:teuthology.orchestra.run.smithi101.stdout: "event": "sub_op_commit_rec", 2023-08-01T19:55:32.579 INFO:teuthology.orchestra.run.smithi101.stdout: "time": "2023-08-01T19:54:04.480180+0000", 2023-08-01T19:55:32.579 INFO:teuthology.orchestra.run.smithi101.stdout: "duration": 0.0018986859999999999 2023-08-01T19:55:32.579 INFO:teuthology.orchestra.run.smithi101.stdout: }, 2023-08-01T19:55:32.579 INFO:teuthology.orchestra.run.smithi101.stdout: { 2023-08-01T19:55:32.579 INFO:teuthology.orchestra.run.smithi101.stdout: "event": "commit_sent", 2023-08-01T19:55:32.580 INFO:teuthology.orchestra.run.smithi101.stdout: "time": "2023-08-01T19:54:04.480209+0000", 2023-08-01T19:55:32.580 INFO:teuthology.orchestra.run.smithi101.stdout: "duration": 2.9244999999999999e-05 2023-08-01T19:55:32.580 INFO:teuthology.orchestra.run.smithi101.stdout: }, 2023-08-01T19:55:32.580 INFO:teuthology.orchestra.run.smithi101.stdout: { 2023-08-01T19:55:32.580 INFO:teuthology.orchestra.run.smithi101.stdout: "event": "done", 2023-08-01T19:55:32.580 INFO:teuthology.orchestra.run.smithi101.stdout: "time": "2023-08-01T19:54:04.480244+0000", 2023-08-01T19:55:32.580 INFO:teuthology.orchestra.run.smithi101.stdout: "duration": 3.4875000000000001e-05 2023-08-01T19:55:32.581 INFO:teuthology.orchestra.run.smithi101.stdout: } 2023-08-01T19:55:32.581 INFO:teuthology.orchestra.run.smithi101.stdout: ] 2023-08-01T19:55:32.581 INFO:teuthology.orchestra.run.smithi101.stdout: } 2023-08-01T19:55:32.581 INFO:teuthology.orchestra.run.smithi101.stdout: }, 2023-08-01T19:55:32.581 INFO:teuthology.orchestra.run.smithi101.stdout: { 2023-08-01T19:55:32.581 INFO:teuthology.orchestra.run.smithi101.stdout: "description": "osd_op(mds.0.3:3 3.14 3:287034c4:::1.00000000.inode:head [writefull 0~554] snapc 0=[] ondisk+write+known_if_redirected+full_force+supports_pool_eio e17)", 2023-08-01T19:55:32.581 INFO:teuthology.orchestra.run.smithi101.stdout: "initiated_at": "2023-08-01T19:54:04.459226+0000", 2023-08-01T19:55:32.581 INFO:teuthology.orchestra.run.smithi101.stdout: "age": 88.071628904999997, 2023-08-01T19:55:32.582 INFO:teuthology.orchestra.run.smithi101.stdout: "duration": 0.021104531999999999, 2023-08-01T19:55:32.582 INFO:teuthology.orchestra.run.smithi101.stdout: "type_data": { 2023-08-01T19:55:32.582 INFO:teuthology.orchestra.run.smithi101.stdout: "flag_point": "commit sent; apply or cleanup", 2023-08-01T19:55:32.582 INFO:teuthology.orchestra.run.smithi101.stdout: "events": [ 2023-08-01T19:55:32.582 INFO:teuthology.orchestra.run.smithi101.stdout: { 2023-08-01T19:55:32.582 INFO:teuthology.orchestra.run.smithi101.stdout: "event": "initiated", 2023-08-01T19:55:32.582 INFO:teuthology.orchestra.run.smithi101.stdout: "time": "2023-08-01T19:54:04.459226+0000", 2023-08-01T19:55:32.582 INFO:teuthology.orchestra.run.smithi101.stdout: "duration": 0 2023-08-01T19:55:32.583 INFO:teuthology.orchestra.run.smithi101.stdout: }, 2023-08-01T19:55:32.583 INFO:teuthology.orchestra.run.smithi101.stdout: { 2023-08-01T19:55:32.583 INFO:teuthology.orchestra.run.smithi101.stdout: "event": "throttled", 2023-08-01T19:55:32.583 INFO:teuthology.orchestra.run.smithi101.stdout: "time": "2023-08-01T19:54:04.459226+0000", 2023-08-01T19:55:32.583 INFO:teuthology.orchestra.run.smithi101.stdout: "duration": 0 2023-08-01T19:55:32.583 INFO:teuthology.orchestra.run.smithi101.stdout: }, 2023-08-01T19:55:32.583 INFO:teuthology.orchestra.run.smithi101.stdout: { 2023-08-01T19:55:32.583 INFO:teuthology.orchestra.run.smithi101.stdout: "event": "header_read", 2023-08-01T19:55:32.584 INFO:teuthology.orchestra.run.smithi101.stdout: "time": "2023-08-01T19:54:04.459225+0000", 2023-08-01T19:55:32.584 INFO:teuthology.orchestra.run.smithi101.stdout: "duration": 4294967295.9999995 2023-08-01T19:55:32.584 INFO:teuthology.orchestra.run.smithi101.stdout: }, 2023-08-01T19:55:32.584 INFO:teuthology.orchestra.run.smithi101.stdout: { 2023-08-01T19:55:32.584 INFO:teuthology.orchestra.run.smithi101.stdout: "event": "all_read", 2023-08-01T19:55:32.584 INFO:teuthology.orchestra.run.smithi101.stdout: "time": "2023-08-01T19:54:04.459238+0000", 2023-08-01T19:55:32.584 INFO:teuthology.orchestra.run.smithi101.stdout: "duration": 1.2809000000000001e-05 2023-08-01T19:55:32.585 INFO:teuthology.orchestra.run.smithi101.stdout: }, 2023-08-01T19:55:32.585 INFO:teuthology.orchestra.run.smithi101.stdout: { 2023-08-01T19:55:32.585 INFO:teuthology.orchestra.run.smithi101.stdout: "event": "dispatched", 2023-08-01T19:55:32.585 INFO:teuthology.orchestra.run.smithi101.stdout: "time": "2023-08-01T19:54:04.459245+0000", 2023-08-01T19:55:32.585 INFO:teuthology.orchestra.run.smithi101.stdout: "duration": 6.6540000000000002e-06 2023-08-01T19:55:32.585 INFO:teuthology.orchestra.run.smithi101.stdout: }, 2023-08-01T19:55:32.585 INFO:teuthology.orchestra.run.smithi101.stdout: { 2023-08-01T19:55:32.586 INFO:teuthology.orchestra.run.smithi101.stdout: "event": "queued_for_pg", 2023-08-01T19:55:32.586 INFO:teuthology.orchestra.run.smithi101.stdout: "time": "2023-08-01T19:54:04.459249+0000", 2023-08-01T19:55:32.586 INFO:teuthology.orchestra.run.smithi101.stdout: "duration": 4.6e-06 2023-08-01T19:55:32.586 INFO:teuthology.orchestra.run.smithi101.stdout: }, 2023-08-01T19:55:32.586 INFO:teuthology.orchestra.run.smithi101.stdout: { 2023-08-01T19:55:32.586 INFO:teuthology.orchestra.run.smithi101.stdout: "event": "reached_pg", 2023-08-01T19:55:32.586 INFO:teuthology.orchestra.run.smithi101.stdout: "time": "2023-08-01T19:54:04.459276+0000", 2023-08-01T19:55:32.586 INFO:teuthology.orchestra.run.smithi101.stdout: "duration": 2.6373999999999999e-05 2023-08-01T19:55:32.587 INFO:teuthology.orchestra.run.smithi101.stdout: }, 2023-08-01T19:55:32.587 INFO:teuthology.orchestra.run.smithi101.stdout: { 2023-08-01T19:55:32.587 INFO:teuthology.orchestra.run.smithi101.stdout: "event": "waiting_for_map not empty", 2023-08-01T19:55:32.587 INFO:teuthology.orchestra.run.smithi101.stdout: "time": "2023-08-01T19:54:04.459278+0000", 2023-08-01T19:55:32.587 INFO:teuthology.orchestra.run.smithi101.stdout: "duration": 2.4980000000000001e-06 2023-08-01T19:55:32.587 INFO:teuthology.orchestra.run.smithi101.stdout: }, 2023-08-01T19:55:32.587 INFO:teuthology.orchestra.run.smithi101.stdout: { 2023-08-01T19:55:32.587 INFO:teuthology.orchestra.run.smithi101.stdout: "event": "reached_pg", 2023-08-01T19:55:32.588 INFO:teuthology.orchestra.run.smithi101.stdout: "time": "2023-08-01T19:54:04.474058+0000", 2023-08-01T19:55:32.588 INFO:teuthology.orchestra.run.smithi101.stdout: "duration": 0.014779979 2023-08-01T19:55:32.588 INFO:teuthology.orchestra.run.smithi101.stdout: }, 2023-08-01T19:55:32.588 INFO:teuthology.orchestra.run.smithi101.stdout: { 2023-08-01T19:55:32.588 INFO:teuthology.orchestra.run.smithi101.stdout: "event": "started", 2023-08-01T19:55:32.588 INFO:teuthology.orchestra.run.smithi101.stdout: "time": "2023-08-01T19:54:04.474614+0000", 2023-08-01T19:55:32.588 INFO:teuthology.orchestra.run.smithi101.stdout: "duration": 0.00055546899999999995 2023-08-01T19:55:32.588 INFO:teuthology.orchestra.run.smithi101.stdout: }, 2023-08-01T19:55:32.589 INFO:teuthology.orchestra.run.smithi101.stdout: { 2023-08-01T19:55:32.589 INFO:teuthology.orchestra.run.smithi101.stdout: "event": "waiting for subops from 2", 2023-08-01T19:55:32.589 INFO:teuthology.orchestra.run.smithi101.stdout: "time": "2023-08-01T19:54:04.474720+0000", 2023-08-01T19:55:32.589 INFO:teuthology.orchestra.run.smithi101.stdout: "duration": 0.00010645300000000001 2023-08-01T19:55:32.589 INFO:teuthology.orchestra.run.smithi101.stdout: }, 2023-08-01T19:55:32.589 INFO:teuthology.orchestra.run.smithi101.stdout: { 2023-08-01T19:55:32.589 INFO:teuthology.orchestra.run.smithi101.stdout: "event": "op_commit", 2023-08-01T19:55:32.590 INFO:teuthology.orchestra.run.smithi101.stdout: "time": "2023-08-01T19:54:04.478480+0000", 2023-08-01T19:55:32.590 INFO:teuthology.orchestra.run.smithi101.stdout: "duration": 0.0037600279999999999 2023-08-01T19:55:32.590 INFO:teuthology.orchestra.run.smithi101.stdout: }, 2023-08-01T19:55:32.590 INFO:teuthology.orchestra.run.smithi101.stdout: { 2023-08-01T19:55:32.590 INFO:teuthology.orchestra.run.smithi101.stdout: "event": "sub_op_commit_rec", 2023-08-01T19:55:32.590 INFO:teuthology.orchestra.run.smithi101.stdout: "time": "2023-08-01T19:54:04.480273+0000", 2023-08-01T19:55:32.590 INFO:teuthology.orchestra.run.smithi101.stdout: "duration": 0.001792465 2023-08-01T19:55:32.590 INFO:teuthology.orchestra.run.smithi101.stdout: }, 2023-08-01T19:55:32.591 INFO:teuthology.orchestra.run.smithi101.stdout: { 2023-08-01T19:55:32.591 INFO:teuthology.orchestra.run.smithi101.stdout: "event": "commit_sent", 2023-08-01T19:55:32.591 INFO:teuthology.orchestra.run.smithi101.stdout: "time": "2023-08-01T19:54:04.480304+0000", 2023-08-01T19:55:32.591 INFO:teuthology.orchestra.run.smithi101.stdout: "duration": 3.1708999999999997e-05 2023-08-01T19:55:32.591 INFO:teuthology.orchestra.run.smithi101.stdout: }, 2023-08-01T19:55:32.591 INFO:teuthology.orchestra.run.smithi101.stdout: { 2023-08-01T19:55:32.591 INFO:teuthology.orchestra.run.smithi101.stdout: "event": "done", 2023-08-01T19:55:32.591 INFO:teuthology.orchestra.run.smithi101.stdout: "time": "2023-08-01T19:54:04.480330+0000", 2023-08-01T19:55:32.592 INFO:teuthology.orchestra.run.smithi101.stdout: "duration": 2.5860999999999999e-05 2023-08-01T19:55:32.592 INFO:teuthology.orchestra.run.smithi101.stdout: } 2023-08-01T19:55:32.592 INFO:teuthology.orchestra.run.smithi101.stdout: ] 2023-08-01T19:55:32.592 INFO:teuthology.orchestra.run.smithi101.stdout: } 2023-08-01T19:55:32.592 INFO:teuthology.orchestra.run.smithi101.stdout: }, 2023-08-01T19:55:32.592 INFO:teuthology.orchestra.run.smithi101.stdout: { 2023-08-01T19:55:32.592 INFO:teuthology.orchestra.run.smithi101.stdout: "description": "osd_op(mds.0.3:32 3.14 3:2e2fa760:::200.00000001:head [delete] snapc 0=[] ondisk+write+known_if_redirected+full_force+supports_pool_eio e17)", 2023-08-01T19:55:32.592 INFO:teuthology.orchestra.run.smithi101.stdout: "initiated_at": "2023-08-01T19:54:04.459304+0000", 2023-08-01T19:55:32.593 INFO:teuthology.orchestra.run.smithi101.stdout: "age": 88.071550243999994, 2023-08-01T19:55:32.593 INFO:teuthology.orchestra.run.smithi101.stdout: "duration": 0.021110606000000001, 2023-08-01T19:55:32.593 INFO:teuthology.orchestra.run.smithi101.stdout: "type_data": { 2023-08-01T19:55:32.593 INFO:teuthology.orchestra.run.smithi101.stdout: "flag_point": "started", 2023-08-01T19:55:32.593 INFO:teuthology.orchestra.run.smithi101.stdout: "events": [ 2023-08-01T19:55:32.593 INFO:teuthology.orchestra.run.smithi101.stdout: { 2023-08-01T19:55:32.593 INFO:teuthology.orchestra.run.smithi101.stdout: "event": "initiated", 2023-08-01T19:55:32.594 INFO:teuthology.orchestra.run.smithi101.stdout: "time": "2023-08-01T19:54:04.459304+0000", 2023-08-01T19:55:32.594 INFO:teuthology.orchestra.run.smithi101.stdout: "duration": 0 2023-08-01T19:55:32.594 INFO:teuthology.orchestra.run.smithi101.stdout: }, 2023-08-01T19:55:32.594 INFO:teuthology.orchestra.run.smithi101.stdout: { 2023-08-01T19:55:32.594 INFO:teuthology.orchestra.run.smithi101.stdout: "event": "throttled", 2023-08-01T19:55:32.594 INFO:teuthology.orchestra.run.smithi101.stdout: "time": "2023-08-01T19:54:04.459304+0000", 2023-08-01T19:55:32.594 INFO:teuthology.orchestra.run.smithi101.stdout: "duration": 0 2023-08-01T19:55:32.594 INFO:teuthology.orchestra.run.smithi101.stdout: }, 2023-08-01T19:55:32.595 INFO:teuthology.orchestra.run.smithi101.stdout: { 2023-08-01T19:55:32.595 INFO:teuthology.orchestra.run.smithi101.stdout: "event": "header_read", 2023-08-01T19:55:32.595 INFO:teuthology.orchestra.run.smithi101.stdout: "time": "2023-08-01T19:54:04.459304+0000", 2023-08-01T19:55:32.595 INFO:teuthology.orchestra.run.smithi101.stdout: "duration": 4294967295.9999995 2023-08-01T19:55:32.595 INFO:teuthology.orchestra.run.smithi101.stdout: }, 2023-08-01T19:55:32.595 INFO:teuthology.orchestra.run.smithi101.stdout: { 2023-08-01T19:55:32.595 INFO:teuthology.orchestra.run.smithi101.stdout: "event": "all_read", 2023-08-01T19:55:32.595 INFO:teuthology.orchestra.run.smithi101.stdout: "time": "2023-08-01T19:54:04.459306+0000", 2023-08-01T19:55:32.596 INFO:teuthology.orchestra.run.smithi101.stdout: "duration": 2.3889999999999999e-06 2023-08-01T19:55:32.596 INFO:teuthology.orchestra.run.smithi101.stdout: }, 2023-08-01T19:55:32.596 INFO:teuthology.orchestra.run.smithi101.stdout: { 2023-08-01T19:55:32.596 INFO:teuthology.orchestra.run.smithi101.stdout: "event": "dispatched", 2023-08-01T19:55:32.596 INFO:teuthology.orchestra.run.smithi101.stdout: "time": "2023-08-01T19:54:04.459314+0000", 2023-08-01T19:55:32.596 INFO:teuthology.orchestra.run.smithi101.stdout: "duration": 7.1180000000000003e-06 2023-08-01T19:55:32.596 INFO:teuthology.orchestra.run.smithi101.stdout: }, 2023-08-01T19:55:32.596 INFO:teuthology.orchestra.run.smithi101.stdout: { 2023-08-01T19:55:32.597 INFO:teuthology.orchestra.run.smithi101.stdout: "event": "queued_for_pg", 2023-08-01T19:55:32.597 INFO:teuthology.orchestra.run.smithi101.stdout: "time": "2023-08-01T19:54:04.459318+0000", 2023-08-01T19:55:32.597 INFO:teuthology.orchestra.run.smithi101.stdout: "duration": 4.0239999999999999e-06 2023-08-01T19:55:32.597 INFO:teuthology.orchestra.run.smithi101.stdout: }, 2023-08-01T19:55:32.597 INFO:teuthology.orchestra.run.smithi101.stdout: { 2023-08-01T19:55:32.597 INFO:teuthology.orchestra.run.smithi101.stdout: "event": "reached_pg", 2023-08-01T19:55:32.597 INFO:teuthology.orchestra.run.smithi101.stdout: "time": "2023-08-01T19:54:04.459340+0000", 2023-08-01T19:55:32.597 INFO:teuthology.orchestra.run.smithi101.stdout: "duration": 2.2476e-05 2023-08-01T19:55:32.598 INFO:teuthology.orchestra.run.smithi101.stdout: }, 2023-08-01T19:55:32.598 INFO:teuthology.orchestra.run.smithi101.stdout: { 2023-08-01T19:55:32.598 INFO:teuthology.orchestra.run.smithi101.stdout: "event": "waiting_for_map not empty", 2023-08-01T19:55:32.598 INFO:teuthology.orchestra.run.smithi101.stdout: "time": "2023-08-01T19:54:04.459342+0000", 2023-08-01T19:55:32.598 INFO:teuthology.orchestra.run.smithi101.stdout: "duration": 2.272e-06 2023-08-01T19:55:32.598 INFO:teuthology.orchestra.run.smithi101.stdout: }, 2023-08-01T19:55:32.598 INFO:teuthology.orchestra.run.smithi101.stdout: { 2023-08-01T19:55:32.598 INFO:teuthology.orchestra.run.smithi101.stdout: "event": "reached_pg", 2023-08-01T19:55:32.599 INFO:teuthology.orchestra.run.smithi101.stdout: "time": "2023-08-01T19:54:04.475922+0000", 2023-08-01T19:55:32.599 INFO:teuthology.orchestra.run.smithi101.stdout: "duration": 0.016579388 2023-08-01T19:55:32.599 INFO:teuthology.orchestra.run.smithi101.stdout: }, 2023-08-01T19:55:32.599 INFO:teuthology.orchestra.run.smithi101.stdout: { 2023-08-01T19:55:32.599 INFO:teuthology.orchestra.run.smithi101.stdout: "event": "started", 2023-08-01T19:55:32.599 INFO:teuthology.orchestra.run.smithi101.stdout: "time": "2023-08-01T19:54:04.476107+0000", 2023-08-01T19:55:32.599 INFO:teuthology.orchestra.run.smithi101.stdout: "duration": 0.00018486300000000001 2023-08-01T19:55:32.599 INFO:teuthology.orchestra.run.smithi101.stdout: }, 2023-08-01T19:55:32.600 INFO:teuthology.orchestra.run.smithi101.stdout: { 2023-08-01T19:55:32.600 INFO:teuthology.orchestra.run.smithi101.stdout: "event": "done", 2023-08-01T19:55:32.600 INFO:teuthology.orchestra.run.smithi101.stdout: "time": "2023-08-01T19:54:04.480415+0000", 2023-08-01T19:55:32.600 INFO:teuthology.orchestra.run.smithi101.stdout: "duration": 0.0043084589999999997 2023-08-01T19:55:32.600 INFO:teuthology.orchestra.run.smithi101.stdout: } 2023-08-01T19:55:32.600 INFO:teuthology.orchestra.run.smithi101.stdout: ] 2023-08-01T19:55:32.600 INFO:teuthology.orchestra.run.smithi101.stdout: } 2023-08-01T19:55:32.601 INFO:teuthology.orchestra.run.smithi101.stdout: }, 2023-08-01T19:55:32.601 INFO:teuthology.orchestra.run.smithi101.stdout: { 2023-08-01T19:55:32.601 INFO:teuthology.orchestra.run.smithi101.stdout: "description": "osd_op(client.4668.0:70878 5.2 5:49b7d2be:::benchmark_data_smithi006_114134_object70877:head [set-alloc-hint object_size 65536 write_size 65536,write 0~65536] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e30)", 2023-08-01T19:55:32.601 INFO:teuthology.orchestra.run.smithi101.stdout: "initiated_at": "2023-08-01T19:54:50.210223+0000", 2023-08-01T19:55:32.601 INFO:teuthology.orchestra.run.smithi101.stdout: "age": 42.320631673999998, 2023-08-01T19:55:32.601 INFO:teuthology.orchestra.run.smithi101.stdout: "duration": 0.019884895, 2023-08-01T19:55:32.601 INFO:teuthology.orchestra.run.smithi101.stdout: "type_data": { 2023-08-01T19:55:32.601 INFO:teuthology.orchestra.run.smithi101.stdout: "flag_point": "commit sent; apply or cleanup", 2023-08-01T19:55:32.602 INFO:teuthology.orchestra.run.smithi101.stdout: "client_info": { 2023-08-01T19:55:32.602 INFO:teuthology.orchestra.run.smithi101.stdout: "client": "client.4668", 2023-08-01T19:55:32.602 INFO:teuthology.orchestra.run.smithi101.stdout: "client_addr": "172.21.15.6:0/1709472247", 2023-08-01T19:55:32.602 INFO:teuthology.orchestra.run.smithi101.stdout: "tid": 70878 2023-08-01T19:55:32.602 INFO:teuthology.orchestra.run.smithi101.stdout: }, 2023-08-01T19:55:32.602 INFO:teuthology.orchestra.run.smithi101.stdout: "events": [ 2023-08-01T19:55:32.602 INFO:teuthology.orchestra.run.smithi101.stdout: { 2023-08-01T19:55:32.603 INFO:teuthology.orchestra.run.smithi101.stdout: "event": "initiated", 2023-08-01T19:55:32.603 INFO:teuthology.orchestra.run.smithi101.stdout: "time": "2023-08-01T19:54:50.210223+0000", 2023-08-01T19:55:32.603 INFO:teuthology.orchestra.run.smithi101.stdout: "duration": 0 2023-08-01T19:55:32.603 INFO:teuthology.orchestra.run.smithi101.stdout: }, 2023-08-01T19:55:32.603 INFO:teuthology.orchestra.run.smithi101.stdout: { 2023-08-01T19:55:32.603 INFO:teuthology.orchestra.run.smithi101.stdout: "event": "throttled", 2023-08-01T19:55:32.603 INFO:teuthology.orchestra.run.smithi101.stdout: "time": "2023-08-01T19:54:50.210223+0000", 2023-08-01T19:55:32.603 INFO:teuthology.orchestra.run.smithi101.stdout: "duration": 0 2023-08-01T19:55:32.604 INFO:teuthology.orchestra.run.smithi101.stdout: }, 2023-08-01T19:55:32.604 INFO:teuthology.orchestra.run.smithi101.stdout: { 2023-08-01T19:55:32.604 INFO:teuthology.orchestra.run.smithi101.stdout: "event": "header_read", 2023-08-01T19:55:32.604 INFO:teuthology.orchestra.run.smithi101.stdout: "time": "2023-08-01T19:54:50.210222+0000", 2023-08-01T19:55:32.604 INFO:teuthology.orchestra.run.smithi101.stdout: "duration": 4294967295.999999 2023-08-01T19:55:32.604 INFO:teuthology.orchestra.run.smithi101.stdout: }, 2023-08-01T19:55:32.604 INFO:teuthology.orchestra.run.smithi101.stdout: { 2023-08-01T19:55:32.604 INFO:teuthology.orchestra.run.smithi101.stdout: "event": "all_read", 2023-08-01T19:55:32.605 INFO:teuthology.orchestra.run.smithi101.stdout: "time": "2023-08-01T19:54:50.210315+0000", 2023-08-01T19:55:32.605 INFO:teuthology.orchestra.run.smithi101.stdout: "duration": 9.2567999999999999e-05 2023-08-01T19:55:32.605 INFO:teuthology.orchestra.run.smithi101.stdout: }, 2023-08-01T19:55:32.605 INFO:teuthology.orchestra.run.smithi101.stdout: { 2023-08-01T19:55:32.605 INFO:teuthology.orchestra.run.smithi101.stdout: "event": "dispatched", 2023-08-01T19:55:32.605 INFO:teuthology.orchestra.run.smithi101.stdout: "time": "2023-08-01T19:54:50.210326+0000", 2023-08-01T19:55:32.605 INFO:teuthology.orchestra.run.smithi101.stdout: "duration": 1.1430000000000001e-05 2023-08-01T19:55:32.605 INFO:teuthology.orchestra.run.smithi101.stdout: }, 2023-08-01T19:55:32.606 INFO:teuthology.orchestra.run.smithi101.stdout: { 2023-08-01T19:55:32.606 INFO:teuthology.orchestra.run.smithi101.stdout: "event": "queued_for_pg", 2023-08-01T19:55:32.606 INFO:teuthology.orchestra.run.smithi101.stdout: "time": "2023-08-01T19:54:50.210332+0000", 2023-08-01T19:55:32.606 INFO:teuthology.orchestra.run.smithi101.stdout: "duration": 5.8479999999999997e-06 2023-08-01T19:55:32.606 INFO:teuthology.orchestra.run.smithi101.stdout: }, 2023-08-01T19:55:32.606 INFO:teuthology.orchestra.run.smithi101.stdout: { 2023-08-01T19:55:32.606 INFO:teuthology.orchestra.run.smithi101.stdout: "event": "reached_pg", 2023-08-01T19:55:32.606 INFO:teuthology.orchestra.run.smithi101.stdout: "time": "2023-08-01T19:54:50.214259+0000", 2023-08-01T19:55:32.607 INFO:teuthology.orchestra.run.smithi101.stdout: "duration": 0.003926789 2023-08-01T19:55:32.607 INFO:teuthology.orchestra.run.smithi101.stdout: }, 2023-08-01T19:55:32.607 INFO:teuthology.orchestra.run.smithi101.stdout: { 2023-08-01T19:55:32.607 INFO:teuthology.orchestra.run.smithi101.stdout: "event": "started", 2023-08-01T19:55:32.607 INFO:teuthology.orchestra.run.smithi101.stdout: "time": "2023-08-01T19:54:50.214387+0000", 2023-08-01T19:55:32.607 INFO:teuthology.orchestra.run.smithi101.stdout: "duration": 0.00012787599999999999 2023-08-01T19:55:32.607 INFO:teuthology.orchestra.run.smithi101.stdout: }, 2023-08-01T19:55:32.607 INFO:teuthology.orchestra.run.smithi101.stdout: { 2023-08-01T19:55:32.608 INFO:teuthology.orchestra.run.smithi101.stdout: "event": "waiting for subops from 0", 2023-08-01T19:55:32.608 INFO:teuthology.orchestra.run.smithi101.stdout: "time": "2023-08-01T19:54:50.214536+0000", 2023-08-01T19:55:32.608 INFO:teuthology.orchestra.run.smithi101.stdout: "duration": 0.00014935299999999999 2023-08-01T19:55:32.608 INFO:teuthology.orchestra.run.smithi101.stdout: }, 2023-08-01T19:55:32.608 INFO:teuthology.orchestra.run.smithi101.stdout: { 2023-08-01T19:55:32.608 INFO:teuthology.orchestra.run.smithi101.stdout: "event": "op_commit", 2023-08-01T19:55:32.608 INFO:teuthology.orchestra.run.smithi101.stdout: "time": "2023-08-01T19:54:50.217739+0000", 2023-08-01T19:55:32.609 INFO:teuthology.orchestra.run.smithi101.stdout: "duration": 0.0032034619999999998 2023-08-01T19:55:32.609 INFO:teuthology.orchestra.run.smithi101.stdout: }, 2023-08-01T19:55:32.609 INFO:teuthology.orchestra.run.smithi101.stdout: { 2023-08-01T19:55:32.609 INFO:teuthology.orchestra.run.smithi101.stdout: "event": "sub_op_commit_rec", 2023-08-01T19:55:32.609 INFO:teuthology.orchestra.run.smithi101.stdout: "time": "2023-08-01T19:54:50.230032+0000", 2023-08-01T19:55:32.609 INFO:teuthology.orchestra.run.smithi101.stdout: "duration": 0.012293068000000001 2023-08-01T19:55:32.609 INFO:teuthology.orchestra.run.smithi101.stdout: }, 2023-08-01T19:55:32.609 INFO:teuthology.orchestra.run.smithi101.stdout: { 2023-08-01T19:55:32.610 INFO:teuthology.orchestra.run.smithi101.stdout: "event": "commit_sent", 2023-08-01T19:55:32.610 INFO:teuthology.orchestra.run.smithi101.stdout: "time": "2023-08-01T19:54:50.230075+0000", 2023-08-01T19:55:32.610 INFO:teuthology.orchestra.run.smithi101.stdout: "duration": 4.3062999999999997e-05 2023-08-01T19:55:32.610 INFO:teuthology.orchestra.run.smithi101.stdout: }, 2023-08-01T19:55:32.610 INFO:teuthology.orchestra.run.smithi101.stdout: { 2023-08-01T19:55:32.610 INFO:teuthology.orchestra.run.smithi101.stdout: "event": "done", 2023-08-01T19:55:32.610 INFO:teuthology.orchestra.run.smithi101.stdout: "time": "2023-08-01T19:54:50.230108+0000", 2023-08-01T19:55:32.610 INFO:teuthology.orchestra.run.smithi101.stdout: "duration": 3.2366999999999997e-05 2023-08-01T19:55:32.611 INFO:teuthology.orchestra.run.smithi101.stdout: } 2023-08-01T19:55:32.611 INFO:teuthology.orchestra.run.smithi101.stdout: ] 2023-08-01T19:55:32.611 INFO:teuthology.orchestra.run.smithi101.stdout: } 2023-08-01T19:55:32.611 INFO:teuthology.orchestra.run.smithi101.stdout: }, 2023-08-01T19:55:32.611 INFO:teuthology.orchestra.run.smithi101.stdout: { 2023-08-01T19:55:32.611 INFO:teuthology.orchestra.run.smithi101.stdout: "description": "osd_op(client.4668.0:73460 5.f 5:ff4f0704:::benchmark_data_smithi006_114134_object73459:head [set-alloc-hint object_size 65536 write_size 65536,write 0~65536] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e31)", 2023-08-01T19:55:32.611 INFO:teuthology.orchestra.run.smithi101.stdout: "initiated_at": "2023-08-01T19:54:51.462968+0000", 2023-08-01T19:55:32.611 INFO:teuthology.orchestra.run.smithi101.stdout: "age": 41.067886795, 2023-08-01T19:55:32.612 INFO:teuthology.orchestra.run.smithi101.stdout: "duration": 0.020056502, 2023-08-01T19:55:32.612 INFO:teuthology.orchestra.run.smithi101.stdout: "type_data": { 2023-08-01T19:55:32.612 INFO:teuthology.orchestra.run.smithi101.stdout: "flag_point": "commit sent; apply or cleanup", 2023-08-01T19:55:32.612 INFO:teuthology.orchestra.run.smithi101.stdout: "client_info": { 2023-08-01T19:55:32.612 INFO:teuthology.orchestra.run.smithi101.stdout: "client": "client.4668", 2023-08-01T19:55:32.612 INFO:teuthology.orchestra.run.smithi101.stdout: "client_addr": "172.21.15.6:0/1709472247", 2023-08-01T19:55:32.612 INFO:teuthology.orchestra.run.smithi101.stdout: "tid": 73460 2023-08-01T19:55:32.612 INFO:teuthology.orchestra.run.smithi101.stdout: }, 2023-08-01T19:55:32.613 INFO:teuthology.orchestra.run.smithi101.stdout: "events": [ 2023-08-01T19:55:32.613 INFO:teuthology.orchestra.run.smithi101.stdout: { 2023-08-01T19:55:32.613 INFO:teuthology.orchestra.run.smithi101.stdout: "event": "initiated", 2023-08-01T19:55:32.613 INFO:teuthology.orchestra.run.smithi101.stdout: "time": "2023-08-01T19:54:51.462968+0000", 2023-08-01T19:55:32.613 INFO:teuthology.orchestra.run.smithi101.stdout: "duration": 0 2023-08-01T19:55:32.613 INFO:teuthology.orchestra.run.smithi101.stdout: }, 2023-08-01T19:55:32.613 INFO:teuthology.orchestra.run.smithi101.stdout: { 2023-08-01T19:55:32.613 INFO:teuthology.orchestra.run.smithi101.stdout: "event": "throttled", 2023-08-01T19:55:32.614 INFO:teuthology.orchestra.run.smithi101.stdout: "time": "2023-08-01T19:54:51.462968+0000", 2023-08-01T19:55:32.614 INFO:teuthology.orchestra.run.smithi101.stdout: "duration": 0 2023-08-01T19:55:32.614 INFO:teuthology.orchestra.run.smithi101.stdout: }, 2023-08-01T19:55:32.614 INFO:teuthology.orchestra.run.smithi101.stdout: { 2023-08-01T19:55:32.614 INFO:teuthology.orchestra.run.smithi101.stdout: "event": "header_read", 2023-08-01T19:55:32.614 INFO:teuthology.orchestra.run.smithi101.stdout: "time": "2023-08-01T19:54:51.462967+0000", 2023-08-01T19:55:32.614 INFO:teuthology.orchestra.run.smithi101.stdout: "duration": 4294967295.999999 2023-08-01T19:55:32.615 INFO:teuthology.orchestra.run.smithi101.stdout: }, 2023-08-01T19:55:32.615 INFO:teuthology.orchestra.run.smithi101.stdout: { 2023-08-01T19:55:32.615 INFO:teuthology.orchestra.run.smithi101.stdout: "event": "all_read", 2023-08-01T19:55:32.615 INFO:teuthology.orchestra.run.smithi101.stdout: "time": "2023-08-01T19:54:51.463009+0000", 2023-08-01T19:55:32.615 INFO:teuthology.orchestra.run.smithi101.stdout: "duration": 4.2106e-05 2023-08-01T19:55:32.615 INFO:teuthology.orchestra.run.smithi101.stdout: }, 2023-08-01T19:55:32.615 INFO:teuthology.orchestra.run.smithi101.stdout: { 2023-08-01T19:55:32.616 INFO:teuthology.orchestra.run.smithi101.stdout: "event": "dispatched", 2023-08-01T19:55:32.616 INFO:teuthology.orchestra.run.smithi101.stdout: "time": "2023-08-01T19:54:51.463017+0000", 2023-08-01T19:55:32.616 INFO:teuthology.orchestra.run.smithi101.stdout: "duration": 8.1529999999999997e-06 2023-08-01T19:55:32.616 INFO:teuthology.orchestra.run.smithi101.stdout: }, 2023-08-01T19:55:32.616 INFO:teuthology.orchestra.run.smithi101.stdout: { 2023-08-01T19:55:32.616 INFO:teuthology.orchestra.run.smithi101.stdout: "event": "queued_for_pg", 2023-08-01T19:55:32.617 INFO:teuthology.orchestra.run.smithi101.stdout: "time": "2023-08-01T19:54:51.463027+0000", 2023-08-01T19:55:32.617 INFO:teuthology.orchestra.run.smithi101.stdout: "duration": 9.5659999999999996e-06 2023-08-01T19:55:32.617 INFO:teuthology.orchestra.run.smithi101.stdout: }, 2023-08-01T19:55:32.617 INFO:teuthology.orchestra.run.smithi101.stdout: { 2023-08-01T19:55:32.617 INFO:teuthology.orchestra.run.smithi101.stdout: "event": "reached_pg", 2023-08-01T19:55:32.617 INFO:teuthology.orchestra.run.smithi101.stdout: "time": "2023-08-01T19:54:51.463062+0000", 2023-08-01T19:55:32.617 INFO:teuthology.orchestra.run.smithi101.stdout: "duration": 3.5442999999999999e-05 2023-08-01T19:55:32.618 INFO:teuthology.orchestra.run.smithi101.stdout: }, 2023-08-01T19:55:32.618 INFO:teuthology.orchestra.run.smithi101.stdout: { 2023-08-01T19:55:32.618 INFO:teuthology.orchestra.run.smithi101.stdout: "event": "started", 2023-08-01T19:55:32.618 INFO:teuthology.orchestra.run.smithi101.stdout: "time": "2023-08-01T19:54:51.463198+0000", 2023-08-01T19:55:32.618 INFO:teuthology.orchestra.run.smithi101.stdout: "duration": 0.000135628 2023-08-01T19:55:32.618 INFO:teuthology.orchestra.run.smithi101.stdout: }, 2023-08-01T19:55:32.618 INFO:teuthology.orchestra.run.smithi101.stdout: { 2023-08-01T19:55:32.619 INFO:teuthology.orchestra.run.smithi101.stdout: "event": "waiting for subops from 2", 2023-08-01T19:55:32.619 INFO:teuthology.orchestra.run.smithi101.stdout: "time": "2023-08-01T19:54:51.463341+0000", 2023-08-01T19:55:32.619 INFO:teuthology.orchestra.run.smithi101.stdout: "duration": 0.00014346500000000001 2023-08-01T19:55:32.619 INFO:teuthology.orchestra.run.smithi101.stdout: }, 2023-08-01T19:55:32.619 INFO:teuthology.orchestra.run.smithi101.stdout: { 2023-08-01T19:55:32.619 INFO:teuthology.orchestra.run.smithi101.stdout: "event": "op_commit", 2023-08-01T19:55:32.620 INFO:teuthology.orchestra.run.smithi101.stdout: "time": "2023-08-01T19:54:51.472684+0000", 2023-08-01T19:55:32.620 INFO:teuthology.orchestra.run.smithi101.stdout: "duration": 0.0093427900000000001 2023-08-01T19:55:32.620 INFO:teuthology.orchestra.run.smithi101.stdout: }, 2023-08-01T19:55:32.620 INFO:teuthology.orchestra.run.smithi101.stdout: { 2023-08-01T19:55:32.620 INFO:teuthology.orchestra.run.smithi101.stdout: "event": "sub_op_commit_rec", 2023-08-01T19:55:32.620 INFO:teuthology.orchestra.run.smithi101.stdout: "time": "2023-08-01T19:54:51.482937+0000", 2023-08-01T19:55:32.620 INFO:teuthology.orchestra.run.smithi101.stdout: "duration": 0.010252557000000001 2023-08-01T19:55:32.621 INFO:teuthology.orchestra.run.smithi101.stdout: }, 2023-08-01T19:55:32.621 INFO:teuthology.orchestra.run.smithi101.stdout: { 2023-08-01T19:55:32.621 INFO:teuthology.orchestra.run.smithi101.stdout: "event": "commit_sent", 2023-08-01T19:55:32.621 INFO:teuthology.orchestra.run.smithi101.stdout: "time": "2023-08-01T19:54:51.482984+0000", 2023-08-01T19:55:32.621 INFO:teuthology.orchestra.run.smithi101.stdout: "duration": 4.7394000000000001e-05 2023-08-01T19:55:32.621 INFO:teuthology.orchestra.run.smithi101.stdout: }, 2023-08-01T19:55:32.622 INFO:teuthology.orchestra.run.smithi101.stdout: { 2023-08-01T19:55:32.622 INFO:teuthology.orchestra.run.smithi101.stdout: "event": "done", 2023-08-01T19:55:32.622 INFO:teuthology.orchestra.run.smithi101.stdout: "time": "2023-08-01T19:54:51.483024+0000", 2023-08-01T19:55:32.622 INFO:teuthology.orchestra.run.smithi101.stdout: "duration": 4.0159e-05 2023-08-01T19:55:32.622 INFO:teuthology.orchestra.run.smithi101.stdout: } 2023-08-01T19:55:32.622 INFO:teuthology.orchestra.run.smithi101.stdout: ] 2023-08-01T19:55:32.622 INFO:teuthology.orchestra.run.smithi101.stdout: } 2023-08-01T19:55:32.623 INFO:teuthology.orchestra.run.smithi101.stdout: }, 2023-08-01T19:55:32.623 INFO:teuthology.orchestra.run.smithi101.stdout: { 2023-08-01T19:55:32.623 INFO:teuthology.orchestra.run.smithi101.stdout: "description": "osd_op(client.4668.0:92726 5.2 5:41e18163:::benchmark_data_smithi006_114134_object92725:head [set-alloc-hint object_size 65536 write_size 65536,write 0~65536] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e36)", 2023-08-01T19:55:32.623 INFO:teuthology.orchestra.run.smithi101.stdout: "initiated_at": "2023-08-01T19:55:01.256971+0000", 2023-08-01T19:55:32.623 INFO:teuthology.orchestra.run.smithi101.stdout: "age": 31.273883716, 2023-08-01T19:55:32.623 INFO:teuthology.orchestra.run.smithi101.stdout: "duration": 0.019854296, 2023-08-01T19:55:32.623 INFO:teuthology.orchestra.run.smithi101.stdout: "type_data": { 2023-08-01T19:55:32.624 INFO:teuthology.orchestra.run.smithi101.stdout: "flag_point": "commit sent; apply or cleanup", 2023-08-01T19:55:32.624 INFO:teuthology.orchestra.run.smithi101.stdout: "client_info": { 2023-08-01T19:55:32.624 INFO:teuthology.orchestra.run.smithi101.stdout: "client": "client.4668", 2023-08-01T19:55:32.624 INFO:teuthology.orchestra.run.smithi101.stdout: "client_addr": "172.21.15.6:0/1709472247", 2023-08-01T19:55:32.624 INFO:teuthology.orchestra.run.smithi101.stdout: "tid": 92726 2023-08-01T19:55:32.624 INFO:teuthology.orchestra.run.smithi101.stdout: }, 2023-08-01T19:55:32.624 INFO:teuthology.orchestra.run.smithi101.stdout: "events": [ 2023-08-01T19:55:32.624 INFO:teuthology.orchestra.run.smithi101.stdout: { 2023-08-01T19:55:32.625 INFO:teuthology.orchestra.run.smithi101.stdout: "event": "initiated", 2023-08-01T19:55:32.625 INFO:teuthology.orchestra.run.smithi101.stdout: "time": "2023-08-01T19:55:01.256971+0000", 2023-08-01T19:55:32.625 INFO:teuthology.orchestra.run.smithi101.stdout: "duration": 0 2023-08-01T19:55:32.625 INFO:teuthology.orchestra.run.smithi101.stdout: }, 2023-08-01T19:55:32.625 INFO:teuthology.orchestra.run.smithi101.stdout: { 2023-08-01T19:55:32.625 INFO:teuthology.orchestra.run.smithi101.stdout: "event": "throttled", 2023-08-01T19:55:32.625 INFO:teuthology.orchestra.run.smithi101.stdout: "time": "2023-08-01T19:55:01.256971+0000", 2023-08-01T19:55:32.625 INFO:teuthology.orchestra.run.smithi101.stdout: "duration": 0 2023-08-01T19:55:32.626 INFO:teuthology.orchestra.run.smithi101.stdout: }, 2023-08-01T19:55:32.626 INFO:teuthology.orchestra.run.smithi101.stdout: { 2023-08-01T19:55:32.626 INFO:teuthology.orchestra.run.smithi101.stdout: "event": "header_read", 2023-08-01T19:55:32.626 INFO:teuthology.orchestra.run.smithi101.stdout: "time": "2023-08-01T19:55:01.256970+0000", 2023-08-01T19:55:32.626 INFO:teuthology.orchestra.run.smithi101.stdout: "duration": 4294967295.9999995 2023-08-01T19:55:32.626 INFO:teuthology.orchestra.run.smithi101.stdout: }, 2023-08-01T19:55:32.626 INFO:teuthology.orchestra.run.smithi101.stdout: { 2023-08-01T19:55:32.626 INFO:teuthology.orchestra.run.smithi101.stdout: "event": "all_read", 2023-08-01T19:55:32.627 INFO:teuthology.orchestra.run.smithi101.stdout: "time": "2023-08-01T19:55:01.257057+0000", 2023-08-01T19:55:32.627 INFO:teuthology.orchestra.run.smithi101.stdout: "duration": 8.6627999999999998e-05 2023-08-01T19:55:32.627 INFO:teuthology.orchestra.run.smithi101.stdout: }, 2023-08-01T19:55:32.627 INFO:teuthology.orchestra.run.smithi101.stdout: { 2023-08-01T19:55:32.627 INFO:teuthology.orchestra.run.smithi101.stdout: "event": "dispatched", 2023-08-01T19:55:32.627 INFO:teuthology.orchestra.run.smithi101.stdout: "time": "2023-08-01T19:55:01.257063+0000", 2023-08-01T19:55:32.627 INFO:teuthology.orchestra.run.smithi101.stdout: "duration": 6.528e-06 2023-08-01T19:55:32.628 INFO:teuthology.orchestra.run.smithi101.stdout: }, 2023-08-01T19:55:32.628 INFO:teuthology.orchestra.run.smithi101.stdout: { 2023-08-01T19:55:32.628 INFO:teuthology.orchestra.run.smithi101.stdout: "event": "queued_for_pg", 2023-08-01T19:55:32.628 INFO:teuthology.orchestra.run.smithi101.stdout: "time": "2023-08-01T19:55:01.257067+0000", 2023-08-01T19:55:32.628 INFO:teuthology.orchestra.run.smithi101.stdout: "duration": 3.2739999999999999e-06 2023-08-01T19:55:32.628 INFO:teuthology.orchestra.run.smithi101.stdout: }, 2023-08-01T19:55:32.628 INFO:teuthology.orchestra.run.smithi101.stdout: { 2023-08-01T19:55:32.628 INFO:teuthology.orchestra.run.smithi101.stdout: "event": "reached_pg", 2023-08-01T19:55:32.629 INFO:teuthology.orchestra.run.smithi101.stdout: "time": "2023-08-01T19:55:01.259714+0000", 2023-08-01T19:55:32.629 INFO:teuthology.orchestra.run.smithi101.stdout: "duration": 0.0026476709999999999 2023-08-01T19:55:32.629 INFO:teuthology.orchestra.run.smithi101.stdout: }, 2023-08-01T19:55:32.629 INFO:teuthology.orchestra.run.smithi101.stdout: { 2023-08-01T19:55:32.629 INFO:teuthology.orchestra.run.smithi101.stdout: "event": "started", 2023-08-01T19:55:32.629 INFO:teuthology.orchestra.run.smithi101.stdout: "time": "2023-08-01T19:55:01.259829+0000", 2023-08-01T19:55:32.629 INFO:teuthology.orchestra.run.smithi101.stdout: "duration": 0.000114471 2023-08-01T19:55:32.629 INFO:teuthology.orchestra.run.smithi101.stdout: }, 2023-08-01T19:55:32.630 INFO:teuthology.orchestra.run.smithi101.stdout: { 2023-08-01T19:55:32.630 INFO:teuthology.orchestra.run.smithi101.stdout: "event": "waiting for subops from 0", 2023-08-01T19:55:32.630 INFO:teuthology.orchestra.run.smithi101.stdout: "time": "2023-08-01T19:55:01.259965+0000", 2023-08-01T19:55:32.630 INFO:teuthology.orchestra.run.smithi101.stdout: "duration": 0.00013597300000000001 2023-08-01T19:55:32.630 INFO:teuthology.orchestra.run.smithi101.stdout: }, 2023-08-01T19:55:32.630 INFO:teuthology.orchestra.run.smithi101.stdout: { 2023-08-01T19:55:32.630 INFO:teuthology.orchestra.run.smithi101.stdout: "event": "op_commit", 2023-08-01T19:55:32.631 INFO:teuthology.orchestra.run.smithi101.stdout: "time": "2023-08-01T19:55:01.264360+0000", 2023-08-01T19:55:32.631 INFO:teuthology.orchestra.run.smithi101.stdout: "duration": 0.0043956619999999998 2023-08-01T19:55:32.631 INFO:teuthology.orchestra.run.smithi101.stdout: }, 2023-08-01T19:55:32.631 INFO:teuthology.orchestra.run.smithi101.stdout: { 2023-08-01T19:55:32.631 INFO:teuthology.orchestra.run.smithi101.stdout: "event": "sub_op_commit_rec", 2023-08-01T19:55:32.631 INFO:teuthology.orchestra.run.smithi101.stdout: "time": "2023-08-01T19:55:01.276766+0000", 2023-08-01T19:55:32.631 INFO:teuthology.orchestra.run.smithi101.stdout: "duration": 0.012405736000000001 2023-08-01T19:55:32.631 INFO:teuthology.orchestra.run.smithi101.stdout: }, 2023-08-01T19:55:32.632 INFO:teuthology.orchestra.run.smithi101.stdout: { 2023-08-01T19:55:32.632 INFO:teuthology.orchestra.run.smithi101.stdout: "event": "commit_sent", 2023-08-01T19:55:32.632 INFO:teuthology.orchestra.run.smithi101.stdout: "time": "2023-08-01T19:55:01.276804+0000", 2023-08-01T19:55:32.632 INFO:teuthology.orchestra.run.smithi101.stdout: "duration": 3.7759999999999998e-05 2023-08-01T19:55:32.632 INFO:teuthology.orchestra.run.smithi101.stdout: }, 2023-08-01T19:55:32.632 INFO:teuthology.orchestra.run.smithi101.stdout: { 2023-08-01T19:55:32.632 INFO:teuthology.orchestra.run.smithi101.stdout: "event": "done", 2023-08-01T19:55:32.632 INFO:teuthology.orchestra.run.smithi101.stdout: "time": "2023-08-01T19:55:01.276825+0000", 2023-08-01T19:55:32.633 INFO:teuthology.orchestra.run.smithi101.stdout: "duration": 2.1299000000000001e-05 2023-08-01T19:55:32.633 INFO:teuthology.orchestra.run.smithi101.stdout: } 2023-08-01T19:55:32.633 INFO:teuthology.orchestra.run.smithi101.stdout: ] 2023-08-01T19:55:32.633 INFO:teuthology.orchestra.run.smithi101.stdout: } 2023-08-01T19:55:32.633 INFO:teuthology.orchestra.run.smithi101.stdout: }, 2023-08-01T19:55:32.633 INFO:teuthology.orchestra.run.smithi101.stdout: { 2023-08-01T19:55:32.633 INFO:teuthology.orchestra.run.smithi101.stdout: "description": "osd_op(client.4668.0:100244 5.9 5:92f56a12:::benchmark_data_smithi006_114134_object100243:head [set-alloc-hint object_size 65536 write_size 65536,write 0~65536] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e37)", 2023-08-01T19:55:32.633 INFO:teuthology.orchestra.run.smithi101.stdout: "initiated_at": "2023-08-01T19:55:05.150910+0000", 2023-08-01T19:55:32.634 INFO:teuthology.orchestra.run.smithi101.stdout: "age": 27.379944900000002, 2023-08-01T19:55:32.634 INFO:teuthology.orchestra.run.smithi101.stdout: "duration": 0.072864287, 2023-08-01T19:55:32.634 INFO:teuthology.orchestra.run.smithi101.stdout: "type_data": { 2023-08-01T19:55:32.634 INFO:teuthology.orchestra.run.smithi101.stdout: "flag_point": "commit sent; apply or cleanup", 2023-08-01T19:55:32.634 INFO:teuthology.orchestra.run.smithi101.stdout: "client_info": { 2023-08-01T19:55:32.634 INFO:teuthology.orchestra.run.smithi101.stdout: "client": "client.4668", 2023-08-01T19:55:32.634 INFO:teuthology.orchestra.run.smithi101.stdout: "client_addr": "172.21.15.6:0/1709472247", 2023-08-01T19:55:32.635 INFO:teuthology.orchestra.run.smithi101.stdout: "tid": 100244 2023-08-01T19:55:32.635 INFO:teuthology.orchestra.run.smithi101.stdout: }, 2023-08-01T19:55:32.635 INFO:teuthology.orchestra.run.smithi101.stdout: "events": [ 2023-08-01T19:55:32.635 INFO:teuthology.orchestra.run.smithi101.stdout: { 2023-08-01T19:55:32.635 INFO:teuthology.orchestra.run.smithi101.stdout: "event": "initiated", 2023-08-01T19:55:32.635 INFO:teuthology.orchestra.run.smithi101.stdout: "time": "2023-08-01T19:55:05.150910+0000", 2023-08-01T19:55:32.635 INFO:teuthology.orchestra.run.smithi101.stdout: "duration": 0 2023-08-01T19:55:32.635 INFO:teuthology.orchestra.run.smithi101.stdout: }, 2023-08-01T19:55:32.636 INFO:teuthology.orchestra.run.smithi101.stdout: { 2023-08-01T19:55:32.636 INFO:teuthology.orchestra.run.smithi101.stdout: "event": "throttled", 2023-08-01T19:55:32.636 INFO:teuthology.orchestra.run.smithi101.stdout: "time": "2023-08-01T19:55:05.150910+0000", 2023-08-01T19:55:32.636 INFO:teuthology.orchestra.run.smithi101.stdout: "duration": 0 2023-08-01T19:55:32.636 INFO:teuthology.orchestra.run.smithi101.stdout: }, 2023-08-01T19:55:32.636 INFO:teuthology.orchestra.run.smithi101.stdout: { 2023-08-01T19:55:32.636 INFO:teuthology.orchestra.run.smithi101.stdout: "event": "header_read", 2023-08-01T19:55:32.636 INFO:teuthology.orchestra.run.smithi101.stdout: "time": "2023-08-01T19:55:05.150909+0000", 2023-08-01T19:55:32.637 INFO:teuthology.orchestra.run.smithi101.stdout: "duration": 4294967295.999999 2023-08-01T19:55:32.637 INFO:teuthology.orchestra.run.smithi101.stdout: }, 2023-08-01T19:55:32.637 INFO:teuthology.orchestra.run.smithi101.stdout: { 2023-08-01T19:55:32.637 INFO:teuthology.orchestra.run.smithi101.stdout: "event": "all_read", 2023-08-01T19:55:32.637 INFO:teuthology.orchestra.run.smithi101.stdout: "time": "2023-08-01T19:55:05.150973+0000", 2023-08-01T19:55:32.637 INFO:teuthology.orchestra.run.smithi101.stdout: "duration": 6.4531999999999998e-05 2023-08-01T19:55:32.637 INFO:teuthology.orchestra.run.smithi101.stdout: }, 2023-08-01T19:55:32.638 INFO:teuthology.orchestra.run.smithi101.stdout: { 2023-08-01T19:55:32.638 INFO:teuthology.orchestra.run.smithi101.stdout: "event": "dispatched", 2023-08-01T19:55:32.638 INFO:teuthology.orchestra.run.smithi101.stdout: "time": "2023-08-01T19:55:05.150984+0000", 2023-08-01T19:55:32.638 INFO:teuthology.orchestra.run.smithi101.stdout: "duration": 1.0287e-05 2023-08-01T19:55:32.638 INFO:teuthology.orchestra.run.smithi101.stdout: }, 2023-08-01T19:55:32.638 INFO:teuthology.orchestra.run.smithi101.stdout: { 2023-08-01T19:55:32.638 INFO:teuthology.orchestra.run.smithi101.stdout: "event": "queued_for_pg", 2023-08-01T19:55:32.638 INFO:teuthology.orchestra.run.smithi101.stdout: "time": "2023-08-01T19:55:05.150989+0000", 2023-08-01T19:55:32.639 INFO:teuthology.orchestra.run.smithi101.stdout: "duration": 5.3929999999999999e-06 2023-08-01T19:55:32.639 INFO:teuthology.orchestra.run.smithi101.stdout: }, 2023-08-01T19:55:32.639 INFO:teuthology.orchestra.run.smithi101.stdout: { 2023-08-01T19:55:32.639 INFO:teuthology.orchestra.run.smithi101.stdout: "event": "reached_pg", 2023-08-01T19:55:32.639 INFO:teuthology.orchestra.run.smithi101.stdout: "time": "2023-08-01T19:55:05.151034+0000", 2023-08-01T19:55:32.639 INFO:teuthology.orchestra.run.smithi101.stdout: "duration": 4.4336999999999999e-05 2023-08-01T19:55:32.639 INFO:teuthology.orchestra.run.smithi101.stdout: }, 2023-08-01T19:55:32.639 INFO:teuthology.orchestra.run.smithi101.stdout: { 2023-08-01T19:55:32.640 INFO:teuthology.orchestra.run.smithi101.stdout: "event": "started", 2023-08-01T19:55:32.640 INFO:teuthology.orchestra.run.smithi101.stdout: "time": "2023-08-01T19:55:05.151167+0000", 2023-08-01T19:55:32.640 INFO:teuthology.orchestra.run.smithi101.stdout: "duration": 0.00013368899999999999 2023-08-01T19:55:32.640 INFO:teuthology.orchestra.run.smithi101.stdout: }, 2023-08-01T19:55:32.640 INFO:teuthology.orchestra.run.smithi101.stdout: { 2023-08-01T19:55:32.640 INFO:teuthology.orchestra.run.smithi101.stdout: "event": "waiting for subops from 2", 2023-08-01T19:55:32.640 INFO:teuthology.orchestra.run.smithi101.stdout: "time": "2023-08-01T19:55:05.151328+0000", 2023-08-01T19:55:32.640 INFO:teuthology.orchestra.run.smithi101.stdout: "duration": 0.00016122700000000001 2023-08-01T19:55:32.641 INFO:teuthology.orchestra.run.smithi101.stdout: }, 2023-08-01T19:55:32.641 INFO:teuthology.orchestra.run.smithi101.stdout: { 2023-08-01T19:55:32.641 INFO:teuthology.orchestra.run.smithi101.stdout: "event": "op_commit", 2023-08-01T19:55:32.641 INFO:teuthology.orchestra.run.smithi101.stdout: "time": "2023-08-01T19:55:05.156101+0000", 2023-08-01T19:55:32.641 INFO:teuthology.orchestra.run.smithi101.stdout: "duration": 0.0047724100000000004 2023-08-01T19:55:32.641 INFO:teuthology.orchestra.run.smithi101.stdout: }, 2023-08-01T19:55:32.641 INFO:teuthology.orchestra.run.smithi101.stdout: { 2023-08-01T19:55:32.642 INFO:teuthology.orchestra.run.smithi101.stdout: "event": "sub_op_commit_rec", 2023-08-01T19:55:32.642 INFO:teuthology.orchestra.run.smithi101.stdout: "time": "2023-08-01T19:55:05.223688+0000", 2023-08-01T19:55:32.642 INFO:teuthology.orchestra.run.smithi101.stdout: "duration": 0.067586937999999999 2023-08-01T19:55:32.642 INFO:teuthology.orchestra.run.smithi101.stdout: }, 2023-08-01T19:55:32.642 INFO:teuthology.orchestra.run.smithi101.stdout: { 2023-08-01T19:55:32.642 INFO:teuthology.orchestra.run.smithi101.stdout: "event": "commit_sent", 2023-08-01T19:55:32.642 INFO:teuthology.orchestra.run.smithi101.stdout: "time": "2023-08-01T19:55:05.223737+0000", 2023-08-01T19:55:32.642 INFO:teuthology.orchestra.run.smithi101.stdout: "duration": 4.8921999999999997e-05 2023-08-01T19:55:32.643 INFO:teuthology.orchestra.run.smithi101.stdout: }, 2023-08-01T19:55:32.643 INFO:teuthology.orchestra.run.smithi101.stdout: { 2023-08-01T19:55:32.643 INFO:teuthology.orchestra.run.smithi101.stdout: "event": "done", 2023-08-01T19:55:32.643 INFO:teuthology.orchestra.run.smithi101.stdout: "time": "2023-08-01T19:55:05.223774+0000", 2023-08-01T19:55:32.643 INFO:teuthology.orchestra.run.smithi101.stdout: "duration": 3.7342999999999998e-05 2023-08-01T19:55:32.643 INFO:teuthology.orchestra.run.smithi101.stdout: } 2023-08-01T19:55:32.643 INFO:teuthology.orchestra.run.smithi101.stdout: ] 2023-08-01T19:55:32.643 INFO:teuthology.orchestra.run.smithi101.stdout: } 2023-08-01T19:55:32.644 INFO:teuthology.orchestra.run.smithi101.stdout: }, 2023-08-01T19:55:32.644 INFO:teuthology.orchestra.run.smithi101.stdout: { 2023-08-01T19:55:32.644 INFO:teuthology.orchestra.run.smithi101.stdout: "description": "osd_op(client.4668.0:100253 5.f 5:f7bbce05:::benchmark_data_smithi006_114134_object100252:head [set-alloc-hint object_size 65536 write_size 65536,write 0~65536] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e37)", 2023-08-01T19:55:32.644 INFO:teuthology.orchestra.run.smithi101.stdout: "initiated_at": "2023-08-01T19:55:05.156562+0000", 2023-08-01T19:55:32.644 INFO:teuthology.orchestra.run.smithi101.stdout: "age": 27.374292867000001, 2023-08-01T19:55:32.644 INFO:teuthology.orchestra.run.smithi101.stdout: "duration": 0.068677503000000001, 2023-08-01T19:55:32.644 INFO:teuthology.orchestra.run.smithi101.stdout: "type_data": { 2023-08-01T19:55:32.644 INFO:teuthology.orchestra.run.smithi101.stdout: "flag_point": "commit sent; apply or cleanup", 2023-08-01T19:55:32.645 INFO:teuthology.orchestra.run.smithi101.stdout: "client_info": { 2023-08-01T19:55:32.645 INFO:teuthology.orchestra.run.smithi101.stdout: "client": "client.4668", 2023-08-01T19:55:32.645 INFO:teuthology.orchestra.run.smithi101.stdout: "client_addr": "172.21.15.6:0/1709472247", 2023-08-01T19:55:32.645 INFO:teuthology.orchestra.run.smithi101.stdout: "tid": 100253 2023-08-01T19:55:32.645 INFO:teuthology.orchestra.run.smithi101.stdout: }, 2023-08-01T19:55:32.645 INFO:teuthology.orchestra.run.smithi101.stdout: "events": [ 2023-08-01T19:55:32.645 INFO:teuthology.orchestra.run.smithi101.stdout: { 2023-08-01T19:55:32.646 INFO:teuthology.orchestra.run.smithi101.stdout: "event": "initiated", 2023-08-01T19:55:32.646 INFO:teuthology.orchestra.run.smithi101.stdout: "time": "2023-08-01T19:55:05.156562+0000", 2023-08-01T19:55:32.646 INFO:teuthology.orchestra.run.smithi101.stdout: "duration": 0 2023-08-01T19:55:32.646 INFO:teuthology.orchestra.run.smithi101.stdout: }, 2023-08-01T19:55:32.646 INFO:teuthology.orchestra.run.smithi101.stdout: { 2023-08-01T19:55:32.646 INFO:teuthology.orchestra.run.smithi101.stdout: "event": "throttled", 2023-08-01T19:55:32.646 INFO:teuthology.orchestra.run.smithi101.stdout: "time": "2023-08-01T19:55:05.156562+0000", 2023-08-01T19:55:32.646 INFO:teuthology.orchestra.run.smithi101.stdout: "duration": 0 2023-08-01T19:55:32.647 INFO:teuthology.orchestra.run.smithi101.stdout: }, 2023-08-01T19:55:32.647 INFO:teuthology.orchestra.run.smithi101.stdout: { 2023-08-01T19:55:32.647 INFO:teuthology.orchestra.run.smithi101.stdout: "event": "header_read", 2023-08-01T19:55:32.647 INFO:teuthology.orchestra.run.smithi101.stdout: "time": "2023-08-01T19:55:05.156561+0000", 2023-08-01T19:55:32.647 INFO:teuthology.orchestra.run.smithi101.stdout: "duration": 4294967295.999999 2023-08-01T19:55:32.647 INFO:teuthology.orchestra.run.smithi101.stdout: }, 2023-08-01T19:55:32.647 INFO:teuthology.orchestra.run.smithi101.stdout: { 2023-08-01T19:55:32.647 INFO:teuthology.orchestra.run.smithi101.stdout: "event": "all_read", 2023-08-01T19:55:32.648 INFO:teuthology.orchestra.run.smithi101.stdout: "time": "2023-08-01T19:55:05.156655+0000", 2023-08-01T19:55:32.648 INFO:teuthology.orchestra.run.smithi101.stdout: "duration": 9.4018999999999995e-05 2023-08-01T19:55:32.648 INFO:teuthology.orchestra.run.smithi101.stdout: }, 2023-08-01T19:55:32.648 INFO:teuthology.orchestra.run.smithi101.stdout: { 2023-08-01T19:55:32.648 INFO:teuthology.orchestra.run.smithi101.stdout: "event": "dispatched", 2023-08-01T19:55:32.648 INFO:teuthology.orchestra.run.smithi101.stdout: "time": "2023-08-01T19:55:05.156664+0000", 2023-08-01T19:55:32.648 INFO:teuthology.orchestra.run.smithi101.stdout: "duration": 9.4970000000000007e-06 2023-08-01T19:55:32.648 INFO:teuthology.orchestra.run.smithi101.stdout: }, 2023-08-01T19:55:32.649 INFO:teuthology.orchestra.run.smithi101.stdout: { 2023-08-01T19:55:32.649 INFO:teuthology.orchestra.run.smithi101.stdout: "event": "queued_for_pg", 2023-08-01T19:55:32.649 INFO:teuthology.orchestra.run.smithi101.stdout: "time": "2023-08-01T19:55:05.156671+0000", 2023-08-01T19:55:32.649 INFO:teuthology.orchestra.run.smithi101.stdout: "duration": 6.1929999999999998e-06 2023-08-01T19:55:32.649 INFO:teuthology.orchestra.run.smithi101.stdout: }, 2023-08-01T19:55:32.649 INFO:teuthology.orchestra.run.smithi101.stdout: { 2023-08-01T19:55:32.649 INFO:teuthology.orchestra.run.smithi101.stdout: "event": "reached_pg", 2023-08-01T19:55:32.649 INFO:teuthology.orchestra.run.smithi101.stdout: "time": "2023-08-01T19:55:05.156742+0000", 2023-08-01T19:55:32.650 INFO:teuthology.orchestra.run.smithi101.stdout: "duration": 7.1181999999999997e-05 2023-08-01T19:55:32.650 INFO:teuthology.orchestra.run.smithi101.stdout: }, 2023-08-01T19:55:32.650 INFO:teuthology.orchestra.run.smithi101.stdout: { 2023-08-01T19:55:32.650 INFO:teuthology.orchestra.run.smithi101.stdout: "event": "started", 2023-08-01T19:55:32.650 INFO:teuthology.orchestra.run.smithi101.stdout: "time": "2023-08-01T19:55:05.156839+0000", 2023-08-01T19:55:32.650 INFO:teuthology.orchestra.run.smithi101.stdout: "duration": 9.7182000000000006e-05 2023-08-01T19:55:32.650 INFO:teuthology.orchestra.run.smithi101.stdout: }, 2023-08-01T19:55:32.650 INFO:teuthology.orchestra.run.smithi101.stdout: { 2023-08-01T19:55:32.651 INFO:teuthology.orchestra.run.smithi101.stdout: "event": "waiting for subops from 2", 2023-08-01T19:55:32.651 INFO:teuthology.orchestra.run.smithi101.stdout: "time": "2023-08-01T19:55:05.156925+0000", 2023-08-01T19:55:32.651 INFO:teuthology.orchestra.run.smithi101.stdout: "duration": 8.5816000000000006e-05 2023-08-01T19:55:32.651 INFO:teuthology.orchestra.run.smithi101.stdout: }, 2023-08-01T19:55:32.651 INFO:teuthology.orchestra.run.smithi101.stdout: { 2023-08-01T19:55:32.651 INFO:teuthology.orchestra.run.smithi101.stdout: "event": "op_commit", 2023-08-01T19:55:32.651 INFO:teuthology.orchestra.run.smithi101.stdout: "time": "2023-08-01T19:55:05.160082+0000", 2023-08-01T19:55:32.651 INFO:teuthology.orchestra.run.smithi101.stdout: "duration": 0.0031573959999999998 2023-08-01T19:55:32.652 INFO:teuthology.orchestra.run.smithi101.stdout: }, 2023-08-01T19:55:32.652 INFO:teuthology.orchestra.run.smithi101.stdout: { 2023-08-01T19:55:32.652 INFO:teuthology.orchestra.run.smithi101.stdout: "event": "sub_op_commit_rec", 2023-08-01T19:55:32.652 INFO:teuthology.orchestra.run.smithi101.stdout: "time": "2023-08-01T19:55:05.225162+0000", 2023-08-01T19:55:32.652 INFO:teuthology.orchestra.run.smithi101.stdout: "duration": 0.065079466000000002 2023-08-01T19:55:32.652 INFO:teuthology.orchestra.run.smithi101.stdout: }, 2023-08-01T19:55:32.652 INFO:teuthology.orchestra.run.smithi101.stdout: { 2023-08-01T19:55:32.653 INFO:teuthology.orchestra.run.smithi101.stdout: "event": "commit_sent", 2023-08-01T19:55:32.653 INFO:teuthology.orchestra.run.smithi101.stdout: "time": "2023-08-01T19:55:05.225205+0000", 2023-08-01T19:55:32.653 INFO:teuthology.orchestra.run.smithi101.stdout: "duration": 4.3446999999999999e-05 2023-08-01T19:55:32.653 INFO:teuthology.orchestra.run.smithi101.stdout: }, 2023-08-01T19:55:32.653 INFO:teuthology.orchestra.run.smithi101.stdout: { 2023-08-01T19:55:32.653 INFO:teuthology.orchestra.run.smithi101.stdout: "event": "done", 2023-08-01T19:55:32.653 INFO:teuthology.orchestra.run.smithi101.stdout: "time": "2023-08-01T19:55:05.225239+0000", 2023-08-01T19:55:32.653 INFO:teuthology.orchestra.run.smithi101.stdout: "duration": 3.4121000000000001e-05 2023-08-01T19:55:32.654 INFO:teuthology.orchestra.run.smithi101.stdout: } 2023-08-01T19:55:32.654 INFO:teuthology.orchestra.run.smithi101.stdout: ] 2023-08-01T19:55:32.654 INFO:teuthology.orchestra.run.smithi101.stdout: } 2023-08-01T19:55:32.654 INFO:teuthology.orchestra.run.smithi101.stdout: }, 2023-08-01T19:55:32.654 INFO:teuthology.orchestra.run.smithi101.stdout: { 2023-08-01T19:55:32.654 INFO:teuthology.orchestra.run.smithi101.stdout: "description": "osd_op(client.4668.0:100928 5.7 5:e61a7dfa:::benchmark_data_smithi006_114134_object100927:head [set-alloc-hint object_size 65536 write_size 65536,write 0~65536] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e37)", 2023-08-01T19:55:32.654 INFO:teuthology.orchestra.run.smithi101.stdout: "initiated_at": "2023-08-01T19:55:05.564731+0000", 2023-08-01T19:55:32.654 INFO:teuthology.orchestra.run.smithi101.stdout: "age": 26.966123374999999, 2023-08-01T19:55:32.655 INFO:teuthology.orchestra.run.smithi101.stdout: "duration": 0.064686603999999995, 2023-08-01T19:55:32.655 INFO:teuthology.orchestra.run.smithi101.stdout: "type_data": { 2023-08-01T19:55:32.655 INFO:teuthology.orchestra.run.smithi101.stdout: "flag_point": "commit sent; apply or cleanup", 2023-08-01T19:55:32.655 INFO:teuthology.orchestra.run.smithi101.stdout: "client_info": { 2023-08-01T19:55:32.655 INFO:teuthology.orchestra.run.smithi101.stdout: "client": "client.4668", 2023-08-01T19:55:32.655 INFO:teuthology.orchestra.run.smithi101.stdout: "client_addr": "172.21.15.6:0/1709472247", 2023-08-01T19:55:32.655 INFO:teuthology.orchestra.run.smithi101.stdout: "tid": 100928 2023-08-01T19:55:32.655 INFO:teuthology.orchestra.run.smithi101.stdout: }, 2023-08-01T19:55:32.656 INFO:teuthology.orchestra.run.smithi101.stdout: "events": [ 2023-08-01T19:55:32.656 INFO:teuthology.orchestra.run.smithi101.stdout: { 2023-08-01T19:55:32.656 INFO:teuthology.orchestra.run.smithi101.stdout: "event": "initiated", 2023-08-01T19:55:32.656 INFO:teuthology.orchestra.run.smithi101.stdout: "time": "2023-08-01T19:55:05.564731+0000", 2023-08-01T19:55:32.656 INFO:teuthology.orchestra.run.smithi101.stdout: "duration": 0 2023-08-01T19:55:32.656 INFO:teuthology.orchestra.run.smithi101.stdout: }, 2023-08-01T19:55:32.656 INFO:teuthology.orchestra.run.smithi101.stdout: { 2023-08-01T19:55:32.657 INFO:teuthology.orchestra.run.smithi101.stdout: "event": "throttled", 2023-08-01T19:55:32.657 INFO:teuthology.orchestra.run.smithi101.stdout: "time": "2023-08-01T19:55:05.564731+0000", 2023-08-01T19:55:32.657 INFO:teuthology.orchestra.run.smithi101.stdout: "duration": 0 2023-08-01T19:55:32.657 INFO:teuthology.orchestra.run.smithi101.stdout: }, 2023-08-01T19:55:32.657 INFO:teuthology.orchestra.run.smithi101.stdout: { 2023-08-01T19:55:32.657 INFO:teuthology.orchestra.run.smithi101.stdout: "event": "header_read", 2023-08-01T19:55:32.657 INFO:teuthology.orchestra.run.smithi101.stdout: "time": "2023-08-01T19:55:05.564731+0000", 2023-08-01T19:55:32.657 INFO:teuthology.orchestra.run.smithi101.stdout: "duration": 4294967295.999999 2023-08-01T19:55:32.658 INFO:teuthology.orchestra.run.smithi101.stdout: }, 2023-08-01T19:55:32.658 INFO:teuthology.orchestra.run.smithi101.stdout: { 2023-08-01T19:55:32.658 INFO:teuthology.orchestra.run.smithi101.stdout: "event": "all_read", 2023-08-01T19:55:32.658 INFO:teuthology.orchestra.run.smithi101.stdout: "time": "2023-08-01T19:55:05.564832+0000", 2023-08-01T19:55:32.658 INFO:teuthology.orchestra.run.smithi101.stdout: "duration": 0.000101752 2023-08-01T19:55:32.658 INFO:teuthology.orchestra.run.smithi101.stdout: }, 2023-08-01T19:55:32.658 INFO:teuthology.orchestra.run.smithi101.stdout: { 2023-08-01T19:55:32.658 INFO:teuthology.orchestra.run.smithi101.stdout: "event": "dispatched", 2023-08-01T19:55:32.659 INFO:teuthology.orchestra.run.smithi101.stdout: "time": "2023-08-01T19:55:05.564840+0000", 2023-08-01T19:55:32.659 INFO:teuthology.orchestra.run.smithi101.stdout: "duration": 7.8590000000000005e-06 2023-08-01T19:55:32.659 INFO:teuthology.orchestra.run.smithi101.stdout: }, 2023-08-01T19:55:32.659 INFO:teuthology.orchestra.run.smithi101.stdout: { 2023-08-01T19:55:32.659 INFO:teuthology.orchestra.run.smithi101.stdout: "event": "queued_for_pg", 2023-08-01T19:55:32.659 INFO:teuthology.orchestra.run.smithi101.stdout: "time": "2023-08-01T19:55:05.564845+0000", 2023-08-01T19:55:32.659 INFO:teuthology.orchestra.run.smithi101.stdout: "duration": 4.9189999999999998e-06 2023-08-01T19:55:32.660 INFO:teuthology.orchestra.run.smithi101.stdout: }, 2023-08-01T19:55:32.660 INFO:teuthology.orchestra.run.smithi101.stdout: { 2023-08-01T19:55:32.660 INFO:teuthology.orchestra.run.smithi101.stdout: "event": "reached_pg", 2023-08-01T19:55:32.660 INFO:teuthology.orchestra.run.smithi101.stdout: "time": "2023-08-01T19:55:05.564883+0000", 2023-08-01T19:55:32.660 INFO:teuthology.orchestra.run.smithi101.stdout: "duration": 3.7481999999999998e-05 2023-08-01T19:55:32.660 INFO:teuthology.orchestra.run.smithi101.stdout: }, 2023-08-01T19:55:32.660 INFO:teuthology.orchestra.run.smithi101.stdout: { 2023-08-01T19:55:32.660 INFO:teuthology.orchestra.run.smithi101.stdout: "event": "started", 2023-08-01T19:55:32.661 INFO:teuthology.orchestra.run.smithi101.stdout: "time": "2023-08-01T19:55:05.564968+0000", 2023-08-01T19:55:32.661 INFO:teuthology.orchestra.run.smithi101.stdout: "duration": 8.5494999999999994e-05 2023-08-01T19:55:32.661 INFO:teuthology.orchestra.run.smithi101.stdout: }, 2023-08-01T19:55:32.661 INFO:teuthology.orchestra.run.smithi101.stdout: { 2023-08-01T19:55:32.661 INFO:teuthology.orchestra.run.smithi101.stdout: "event": "waiting for subops from 0", 2023-08-01T19:55:32.661 INFO:teuthology.orchestra.run.smithi101.stdout: "time": "2023-08-01T19:55:05.565062+0000", 2023-08-01T19:55:32.661 INFO:teuthology.orchestra.run.smithi101.stdout: "duration": 9.3478000000000002e-05 2023-08-01T19:55:32.661 INFO:teuthology.orchestra.run.smithi101.stdout: }, 2023-08-01T19:55:32.662 INFO:teuthology.orchestra.run.smithi101.stdout: { 2023-08-01T19:55:32.662 INFO:teuthology.orchestra.run.smithi101.stdout: "event": "op_commit", 2023-08-01T19:55:32.662 INFO:teuthology.orchestra.run.smithi101.stdout: "time": "2023-08-01T19:55:05.572061+0000", 2023-08-01T19:55:32.662 INFO:teuthology.orchestra.run.smithi101.stdout: "duration": 0.0069998250000000003 2023-08-01T19:55:32.662 INFO:teuthology.orchestra.run.smithi101.stdout: }, 2023-08-01T19:55:32.662 INFO:teuthology.orchestra.run.smithi101.stdout: { 2023-08-01T19:55:32.662 INFO:teuthology.orchestra.run.smithi101.stdout: "event": "sub_op_commit_rec", 2023-08-01T19:55:32.662 INFO:teuthology.orchestra.run.smithi101.stdout: "time": "2023-08-01T19:55:05.629362+0000", 2023-08-01T19:55:32.663 INFO:teuthology.orchestra.run.smithi101.stdout: "duration": 0.057300691000000001 2023-08-01T19:55:32.663 INFO:teuthology.orchestra.run.smithi101.stdout: }, 2023-08-01T19:55:32.663 INFO:teuthology.orchestra.run.smithi101.stdout: { 2023-08-01T19:55:32.663 INFO:teuthology.orchestra.run.smithi101.stdout: "event": "commit_sent", 2023-08-01T19:55:32.663 INFO:teuthology.orchestra.run.smithi101.stdout: "time": "2023-08-01T19:55:05.629395+0000", 2023-08-01T19:55:32.663 INFO:teuthology.orchestra.run.smithi101.stdout: "duration": 3.3124000000000003e-05 2023-08-01T19:55:32.663 INFO:teuthology.orchestra.run.smithi101.stdout: }, 2023-08-01T19:55:32.663 INFO:teuthology.orchestra.run.smithi101.stdout: { 2023-08-01T19:55:32.664 INFO:teuthology.orchestra.run.smithi101.stdout: "event": "done", 2023-08-01T19:55:32.664 INFO:teuthology.orchestra.run.smithi101.stdout: "time": "2023-08-01T19:55:05.629418+0000", 2023-08-01T19:55:32.664 INFO:teuthology.orchestra.run.smithi101.stdout: "duration": 2.2697999999999999e-05 2023-08-01T19:55:32.664 INFO:teuthology.orchestra.run.smithi101.stdout: } 2023-08-01T19:55:32.664 INFO:teuthology.orchestra.run.smithi101.stdout: ] 2023-08-01T19:55:32.664 INFO:teuthology.orchestra.run.smithi101.stdout: } 2023-08-01T19:55:32.664 INFO:teuthology.orchestra.run.smithi101.stdout: }, 2023-08-01T19:55:32.665 INFO:teuthology.orchestra.run.smithi101.stdout: { 2023-08-01T19:55:32.665 INFO:teuthology.orchestra.run.smithi101.stdout: "description": "osd_op(client.4668.0:100936 5.1 5:8f4e3576:::benchmark_data_smithi006_114134_object100935:head [set-alloc-hint object_size 65536 write_size 65536,write 0~65536] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e37)", 2023-08-01T19:55:32.665 INFO:teuthology.orchestra.run.smithi101.stdout: "initiated_at": "2023-08-01T19:55:05.567147+0000", 2023-08-01T19:55:32.665 INFO:teuthology.orchestra.run.smithi101.stdout: "age": 26.963707848999999, 2023-08-01T19:55:32.665 INFO:teuthology.orchestra.run.smithi101.stdout: "duration": 0.063466380000000003, 2023-08-01T19:55:32.665 INFO:teuthology.orchestra.run.smithi101.stdout: "type_data": { 2023-08-01T19:55:32.665 INFO:teuthology.orchestra.run.smithi101.stdout: "flag_point": "commit sent; apply or cleanup", 2023-08-01T19:55:32.665 INFO:teuthology.orchestra.run.smithi101.stdout: "client_info": { 2023-08-01T19:55:32.666 INFO:teuthology.orchestra.run.smithi101.stdout: "client": "client.4668", 2023-08-01T19:55:32.666 INFO:teuthology.orchestra.run.smithi101.stdout: "client_addr": "172.21.15.6:0/1709472247", 2023-08-01T19:55:32.666 INFO:teuthology.orchestra.run.smithi101.stdout: "tid": 100936 2023-08-01T19:55:32.666 INFO:teuthology.orchestra.run.smithi101.stdout: }, 2023-08-01T19:55:32.666 INFO:teuthology.orchestra.run.smithi101.stdout: "events": [ 2023-08-01T19:55:32.666 INFO:teuthology.orchestra.run.smithi101.stdout: { 2023-08-01T19:55:32.666 INFO:teuthology.orchestra.run.smithi101.stdout: "event": "initiated", 2023-08-01T19:55:32.666 INFO:teuthology.orchestra.run.smithi101.stdout: "time": "2023-08-01T19:55:05.567147+0000", 2023-08-01T19:55:32.667 INFO:teuthology.orchestra.run.smithi101.stdout: "duration": 0 2023-08-01T19:55:32.667 INFO:teuthology.orchestra.run.smithi101.stdout: }, 2023-08-01T19:55:32.667 INFO:teuthology.orchestra.run.smithi101.stdout: { 2023-08-01T19:55:32.667 INFO:teuthology.orchestra.run.smithi101.stdout: "event": "throttled", 2023-08-01T19:55:32.667 INFO:teuthology.orchestra.run.smithi101.stdout: "time": "2023-08-01T19:55:05.567147+0000", 2023-08-01T19:55:32.667 INFO:teuthology.orchestra.run.smithi101.stdout: "duration": 0 2023-08-01T19:55:32.667 INFO:teuthology.orchestra.run.smithi101.stdout: }, 2023-08-01T19:55:32.668 INFO:teuthology.orchestra.run.smithi101.stdout: { 2023-08-01T19:55:32.668 INFO:teuthology.orchestra.run.smithi101.stdout: "event": "header_read", 2023-08-01T19:55:32.668 INFO:teuthology.orchestra.run.smithi101.stdout: "time": "2023-08-01T19:55:05.567146+0000", 2023-08-01T19:55:32.668 INFO:teuthology.orchestra.run.smithi101.stdout: "duration": 4294967295.999999 2023-08-01T19:55:32.668 INFO:teuthology.orchestra.run.smithi101.stdout: }, 2023-08-01T19:55:32.668 INFO:teuthology.orchestra.run.smithi101.stdout: { 2023-08-01T19:55:32.668 INFO:teuthology.orchestra.run.smithi101.stdout: "event": "all_read", 2023-08-01T19:55:32.668 INFO:teuthology.orchestra.run.smithi101.stdout: "time": "2023-08-01T19:55:05.567224+0000", 2023-08-01T19:55:32.669 INFO:teuthology.orchestra.run.smithi101.stdout: "duration": 7.8460000000000004e-05 2023-08-01T19:55:32.669 INFO:teuthology.orchestra.run.smithi101.stdout: }, 2023-08-01T19:55:32.669 INFO:teuthology.orchestra.run.smithi101.stdout: { 2023-08-01T19:55:32.669 INFO:teuthology.orchestra.run.smithi101.stdout: "event": "dispatched", 2023-08-01T19:55:32.669 INFO:teuthology.orchestra.run.smithi101.stdout: "time": "2023-08-01T19:55:05.567234+0000", 2023-08-01T19:55:32.669 INFO:teuthology.orchestra.run.smithi101.stdout: "duration": 9.7110000000000007e-06 2023-08-01T19:55:32.669 INFO:teuthology.orchestra.run.smithi101.stdout: }, 2023-08-01T19:55:32.670 INFO:teuthology.orchestra.run.smithi101.stdout: { 2023-08-01T19:55:32.670 INFO:teuthology.orchestra.run.smithi101.stdout: "event": "queued_for_pg", 2023-08-01T19:55:32.670 INFO:teuthology.orchestra.run.smithi101.stdout: "time": "2023-08-01T19:55:05.567239+0000", 2023-08-01T19:55:32.670 INFO:teuthology.orchestra.run.smithi101.stdout: "duration": 5.237e-06 2023-08-01T19:55:32.670 INFO:teuthology.orchestra.run.smithi101.stdout: }, 2023-08-01T19:55:32.670 INFO:teuthology.orchestra.run.smithi101.stdout: { 2023-08-01T19:55:32.670 INFO:teuthology.orchestra.run.smithi101.stdout: "event": "reached_pg", 2023-08-01T19:55:32.671 INFO:teuthology.orchestra.run.smithi101.stdout: "time": "2023-08-01T19:55:05.567278+0000", 2023-08-01T19:55:32.671 INFO:teuthology.orchestra.run.smithi101.stdout: "duration": 3.9069999999999997e-05 2023-08-01T19:55:32.671 INFO:teuthology.orchestra.run.smithi101.stdout: }, 2023-08-01T19:55:32.671 INFO:teuthology.orchestra.run.smithi101.stdout: { 2023-08-01T19:55:32.671 INFO:teuthology.orchestra.run.smithi101.stdout: "event": "started", 2023-08-01T19:55:32.671 INFO:teuthology.orchestra.run.smithi101.stdout: "time": "2023-08-01T19:55:05.567402+0000", 2023-08-01T19:55:32.671 INFO:teuthology.orchestra.run.smithi101.stdout: "duration": 0.00012348700000000001 2023-08-01T19:55:32.671 INFO:teuthology.orchestra.run.smithi101.stdout: }, 2023-08-01T19:55:32.672 INFO:teuthology.orchestra.run.smithi101.stdout: { 2023-08-01T19:55:32.672 INFO:teuthology.orchestra.run.smithi101.stdout: "event": "waiting for subops from 0", 2023-08-01T19:55:32.672 INFO:teuthology.orchestra.run.smithi101.stdout: "time": "2023-08-01T19:55:05.567558+0000", 2023-08-01T19:55:32.672 INFO:teuthology.orchestra.run.smithi101.stdout: "duration": 0.000156179 2023-08-01T19:55:32.672 INFO:teuthology.orchestra.run.smithi101.stdout: }, 2023-08-01T19:55:32.672 INFO:teuthology.orchestra.run.smithi101.stdout: { 2023-08-01T19:55:32.672 INFO:teuthology.orchestra.run.smithi101.stdout: "event": "op_commit", 2023-08-01T19:55:32.672 INFO:teuthology.orchestra.run.smithi101.stdout: "time": "2023-08-01T19:55:05.573767+0000", 2023-08-01T19:55:32.673 INFO:teuthology.orchestra.run.smithi101.stdout: "duration": 0.0062092409999999999 2023-08-01T19:55:32.673 INFO:teuthology.orchestra.run.smithi101.stdout: }, 2023-08-01T19:55:32.673 INFO:teuthology.orchestra.run.smithi101.stdout: { 2023-08-01T19:55:32.673 INFO:teuthology.orchestra.run.smithi101.stdout: "event": "sub_op_commit_rec", 2023-08-01T19:55:32.673 INFO:teuthology.orchestra.run.smithi101.stdout: "time": "2023-08-01T19:55:05.630531+0000", 2023-08-01T19:55:32.673 INFO:teuthology.orchestra.run.smithi101.stdout: "duration": 0.056763409000000001 2023-08-01T19:55:32.673 INFO:teuthology.orchestra.run.smithi101.stdout: }, 2023-08-01T19:55:32.673 INFO:teuthology.orchestra.run.smithi101.stdout: { 2023-08-01T19:55:32.674 INFO:teuthology.orchestra.run.smithi101.stdout: "event": "commit_sent", 2023-08-01T19:55:32.674 INFO:teuthology.orchestra.run.smithi101.stdout: "time": "2023-08-01T19:55:05.630577+0000", 2023-08-01T19:55:32.674 INFO:teuthology.orchestra.run.smithi101.stdout: "duration": 4.6588000000000002e-05 2023-08-01T19:55:32.674 INFO:teuthology.orchestra.run.smithi101.stdout: }, 2023-08-01T19:55:32.674 INFO:teuthology.orchestra.run.smithi101.stdout: { 2023-08-01T19:55:32.674 INFO:teuthology.orchestra.run.smithi101.stdout: "event": "done", 2023-08-01T19:55:32.674 INFO:teuthology.orchestra.run.smithi101.stdout: "time": "2023-08-01T19:55:05.630613+0000", 2023-08-01T19:55:32.674 INFO:teuthology.orchestra.run.smithi101.stdout: "duration": 3.5802e-05 2023-08-01T19:55:32.675 INFO:teuthology.orchestra.run.smithi101.stdout: } 2023-08-01T19:55:32.675 INFO:teuthology.orchestra.run.smithi101.stdout: ] 2023-08-01T19:55:32.675 INFO:teuthology.orchestra.run.smithi101.stdout: } 2023-08-01T19:55:32.675 INFO:teuthology.orchestra.run.smithi101.stdout: }, 2023-08-01T19:55:32.675 INFO:teuthology.orchestra.run.smithi101.stdout: { 2023-08-01T19:55:32.675 INFO:teuthology.orchestra.run.smithi101.stdout: "description": "osd_op(client.4668.0:100943 5.7 5:e01743fe:::benchmark_data_smithi006_114134_object100942:head [set-alloc-hint object_size 65536 write_size 65536,write 0~65536] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e37)", 2023-08-01T19:55:32.675 INFO:teuthology.orchestra.run.smithi101.stdout: "initiated_at": "2023-08-01T19:55:05.574724+0000", 2023-08-01T19:55:32.676 INFO:teuthology.orchestra.run.smithi101.stdout: "age": 26.956130756, 2023-08-01T19:55:32.676 INFO:teuthology.orchestra.run.smithi101.stdout: "duration": 0.058761188999999998, 2023-08-01T19:55:32.676 INFO:teuthology.orchestra.run.smithi101.stdout: "type_data": { 2023-08-01T19:55:32.676 INFO:teuthology.orchestra.run.smithi101.stdout: "flag_point": "commit sent; apply or cleanup", 2023-08-01T19:55:32.676 INFO:teuthology.orchestra.run.smithi101.stdout: "client_info": { 2023-08-01T19:55:32.676 INFO:teuthology.orchestra.run.smithi101.stdout: "client": "client.4668", 2023-08-01T19:55:32.676 INFO:teuthology.orchestra.run.smithi101.stdout: "client_addr": "172.21.15.6:0/1709472247", 2023-08-01T19:55:32.677 INFO:teuthology.orchestra.run.smithi101.stdout: "tid": 100943 2023-08-01T19:55:32.677 INFO:teuthology.orchestra.run.smithi101.stdout: }, 2023-08-01T19:55:32.677 INFO:teuthology.orchestra.run.smithi101.stdout: "events": [ 2023-08-01T19:55:32.677 INFO:teuthology.orchestra.run.smithi101.stdout: { 2023-08-01T19:55:32.677 INFO:teuthology.orchestra.run.smithi101.stdout: "event": "initiated", 2023-08-01T19:55:32.677 INFO:teuthology.orchestra.run.smithi101.stdout: "time": "2023-08-01T19:55:05.574724+0000", 2023-08-01T19:55:32.677 INFO:teuthology.orchestra.run.smithi101.stdout: "duration": 0 2023-08-01T19:55:32.677 INFO:teuthology.orchestra.run.smithi101.stdout: }, 2023-08-01T19:55:32.678 INFO:teuthology.orchestra.run.smithi101.stdout: { 2023-08-01T19:55:32.678 INFO:teuthology.orchestra.run.smithi101.stdout: "event": "throttled", 2023-08-01T19:55:32.678 INFO:teuthology.orchestra.run.smithi101.stdout: "time": "2023-08-01T19:55:05.574724+0000", 2023-08-01T19:55:32.678 INFO:teuthology.orchestra.run.smithi101.stdout: "duration": 0 2023-08-01T19:55:32.678 INFO:teuthology.orchestra.run.smithi101.stdout: }, 2023-08-01T19:55:32.678 INFO:teuthology.orchestra.run.smithi101.stdout: { 2023-08-01T19:55:32.678 INFO:teuthology.orchestra.run.smithi101.stdout: "event": "header_read", 2023-08-01T19:55:32.678 INFO:teuthology.orchestra.run.smithi101.stdout: "time": "2023-08-01T19:55:05.574723+0000", 2023-08-01T19:55:32.679 INFO:teuthology.orchestra.run.smithi101.stdout: "duration": 4294967295.999999 2023-08-01T19:55:32.679 INFO:teuthology.orchestra.run.smithi101.stdout: }, 2023-08-01T19:55:32.679 INFO:teuthology.orchestra.run.smithi101.stdout: { 2023-08-01T19:55:32.679 INFO:teuthology.orchestra.run.smithi101.stdout: "event": "all_read", 2023-08-01T19:55:32.679 INFO:teuthology.orchestra.run.smithi101.stdout: "time": "2023-08-01T19:55:05.574773+0000", 2023-08-01T19:55:32.679 INFO:teuthology.orchestra.run.smithi101.stdout: "duration": 4.9469999999999999e-05 2023-08-01T19:55:32.679 INFO:teuthology.orchestra.run.smithi101.stdout: }, 2023-08-01T19:55:32.680 INFO:teuthology.orchestra.run.smithi101.stdout: { 2023-08-01T19:55:32.680 INFO:teuthology.orchestra.run.smithi101.stdout: "event": "dispatched", 2023-08-01T19:55:32.680 INFO:teuthology.orchestra.run.smithi101.stdout: "time": "2023-08-01T19:55:05.574780+0000", 2023-08-01T19:55:32.680 INFO:teuthology.orchestra.run.smithi101.stdout: "duration": 7.5059999999999998e-06 2023-08-01T19:55:32.680 INFO:teuthology.orchestra.run.smithi101.stdout: }, 2023-08-01T19:55:32.680 INFO:teuthology.orchestra.run.smithi101.stdout: { 2023-08-01T19:55:32.680 INFO:teuthology.orchestra.run.smithi101.stdout: "event": "queued_for_pg", 2023-08-01T19:55:32.681 INFO:teuthology.orchestra.run.smithi101.stdout: "time": "2023-08-01T19:55:05.574784+0000", 2023-08-01T19:55:32.681 INFO:teuthology.orchestra.run.smithi101.stdout: "duration": 3.5540000000000002e-06 2023-08-01T19:55:32.681 INFO:teuthology.orchestra.run.smithi101.stdout: }, 2023-08-01T19:55:32.681 INFO:teuthology.orchestra.run.smithi101.stdout: { 2023-08-01T19:55:32.681 INFO:teuthology.orchestra.run.smithi101.stdout: "event": "reached_pg", 2023-08-01T19:55:32.681 INFO:teuthology.orchestra.run.smithi101.stdout: "time": "2023-08-01T19:55:05.574805+0000", 2023-08-01T19:55:32.681 INFO:teuthology.orchestra.run.smithi101.stdout: "duration": 2.1257999999999999e-05 2023-08-01T19:55:32.681 INFO:teuthology.orchestra.run.smithi101.stdout: }, 2023-08-01T19:55:32.682 INFO:teuthology.orchestra.run.smithi101.stdout: { 2023-08-01T19:55:32.682 INFO:teuthology.orchestra.run.smithi101.stdout: "event": "started", 2023-08-01T19:55:32.682 INFO:teuthology.orchestra.run.smithi101.stdout: "time": "2023-08-01T19:55:05.574886+0000", 2023-08-01T19:55:32.682 INFO:teuthology.orchestra.run.smithi101.stdout: "duration": 8.1545999999999995e-05 2023-08-01T19:55:32.682 INFO:teuthology.orchestra.run.smithi101.stdout: }, 2023-08-01T19:55:32.682 INFO:teuthology.orchestra.run.smithi101.stdout: { 2023-08-01T19:55:32.682 INFO:teuthology.orchestra.run.smithi101.stdout: "event": "waiting for subops from 0", 2023-08-01T19:55:32.683 INFO:teuthology.orchestra.run.smithi101.stdout: "time": "2023-08-01T19:55:05.574973+0000", 2023-08-01T19:55:32.683 INFO:teuthology.orchestra.run.smithi101.stdout: "duration": 8.6998999999999998e-05 2023-08-01T19:55:32.683 INFO:teuthology.orchestra.run.smithi101.stdout: }, 2023-08-01T19:55:32.683 INFO:teuthology.orchestra.run.smithi101.stdout: { 2023-08-01T19:55:32.683 INFO:teuthology.orchestra.run.smithi101.stdout: "event": "op_commit", 2023-08-01T19:55:32.683 INFO:teuthology.orchestra.run.smithi101.stdout: "time": "2023-08-01T19:55:05.581580+0000", 2023-08-01T19:55:32.683 INFO:teuthology.orchestra.run.smithi101.stdout: "duration": 0.0066068790000000004 2023-08-01T19:55:32.683 INFO:teuthology.orchestra.run.smithi101.stdout: }, 2023-08-01T19:55:32.684 INFO:teuthology.orchestra.run.smithi101.stdout: { 2023-08-01T19:55:32.684 INFO:teuthology.orchestra.run.smithi101.stdout: "event": "sub_op_commit_rec", 2023-08-01T19:55:32.684 INFO:teuthology.orchestra.run.smithi101.stdout: "time": "2023-08-01T19:55:05.633422+0000", 2023-08-01T19:55:32.684 INFO:teuthology.orchestra.run.smithi101.stdout: "duration": 0.051841992000000003 2023-08-01T19:55:32.684 INFO:teuthology.orchestra.run.smithi101.stdout: }, 2023-08-01T19:55:32.684 INFO:teuthology.orchestra.run.smithi101.stdout: { 2023-08-01T19:55:32.684 INFO:teuthology.orchestra.run.smithi101.stdout: "event": "commit_sent", 2023-08-01T19:55:32.685 INFO:teuthology.orchestra.run.smithi101.stdout: "time": "2023-08-01T19:55:05.633461+0000", 2023-08-01T19:55:32.685 INFO:teuthology.orchestra.run.smithi101.stdout: "duration": 3.8330000000000001e-05 2023-08-01T19:55:32.685 INFO:teuthology.orchestra.run.smithi101.stdout: }, 2023-08-01T19:55:32.685 INFO:teuthology.orchestra.run.smithi101.stdout: { 2023-08-01T19:55:32.685 INFO:teuthology.orchestra.run.smithi101.stdout: "event": "done", 2023-08-01T19:55:32.685 INFO:teuthology.orchestra.run.smithi101.stdout: "time": "2023-08-01T19:55:05.633485+0000", 2023-08-01T19:55:32.685 INFO:teuthology.orchestra.run.smithi101.stdout: "duration": 2.4451e-05 2023-08-01T19:55:32.685 INFO:teuthology.orchestra.run.smithi101.stdout: } 2023-08-01T19:55:32.686 INFO:teuthology.orchestra.run.smithi101.stdout: ] 2023-08-01T19:55:32.686 INFO:teuthology.orchestra.run.smithi101.stdout: } 2023-08-01T19:55:32.686 INFO:teuthology.orchestra.run.smithi101.stdout: }, 2023-08-01T19:55:32.686 INFO:teuthology.orchestra.run.smithi101.stdout: { 2023-08-01T19:55:32.686 INFO:teuthology.orchestra.run.smithi101.stdout: "description": "osd_op(client.4668.0:107866 5.f 5:ffcbf9c4:::benchmark_data_smithi006_114134_object107865:head [set-alloc-hint object_size 65536 write_size 65536,write 0~65536] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e38)", 2023-08-01T19:55:32.686 INFO:teuthology.orchestra.run.smithi101.stdout: "initiated_at": "2023-08-01T19:55:09.280625+0000", 2023-08-01T19:55:32.686 INFO:teuthology.orchestra.run.smithi101.stdout: "age": 23.250229418, 2023-08-01T19:55:32.687 INFO:teuthology.orchestra.run.smithi101.stdout: "duration": 0.069869799999999996, 2023-08-01T19:55:32.687 INFO:teuthology.orchestra.run.smithi101.stdout: "type_data": { 2023-08-01T19:55:32.687 INFO:teuthology.orchestra.run.smithi101.stdout: "flag_point": "commit sent; apply or cleanup", 2023-08-01T19:55:32.687 INFO:teuthology.orchestra.run.smithi101.stdout: "client_info": { 2023-08-01T19:55:32.687 INFO:teuthology.orchestra.run.smithi101.stdout: "client": "client.4668", 2023-08-01T19:55:32.687 INFO:teuthology.orchestra.run.smithi101.stdout: "client_addr": "172.21.15.6:0/1709472247", 2023-08-01T19:55:32.687 INFO:teuthology.orchestra.run.smithi101.stdout: "tid": 107866 2023-08-01T19:55:32.687 INFO:teuthology.orchestra.run.smithi101.stdout: }, 2023-08-01T19:55:32.688 INFO:teuthology.orchestra.run.smithi101.stdout: "events": [ 2023-08-01T19:55:32.688 INFO:teuthology.orchestra.run.smithi101.stdout: { 2023-08-01T19:55:32.688 INFO:teuthology.orchestra.run.smithi101.stdout: "event": "initiated", 2023-08-01T19:55:32.688 INFO:teuthology.orchestra.run.smithi101.stdout: "time": "2023-08-01T19:55:09.280625+0000", 2023-08-01T19:55:32.688 INFO:teuthology.orchestra.run.smithi101.stdout: "duration": 0 2023-08-01T19:55:32.688 INFO:teuthology.orchestra.run.smithi101.stdout: }, 2023-08-01T19:55:32.688 INFO:teuthology.orchestra.run.smithi101.stdout: { 2023-08-01T19:55:32.688 INFO:teuthology.orchestra.run.smithi101.stdout: "event": "throttled", 2023-08-01T19:55:32.689 INFO:teuthology.orchestra.run.smithi101.stdout: "time": "2023-08-01T19:55:09.280625+0000", 2023-08-01T19:55:32.689 INFO:teuthology.orchestra.run.smithi101.stdout: "duration": 0 2023-08-01T19:55:32.689 INFO:teuthology.orchestra.run.smithi101.stdout: }, 2023-08-01T19:55:32.689 INFO:teuthology.orchestra.run.smithi101.stdout: { 2023-08-01T19:55:32.689 INFO:teuthology.orchestra.run.smithi101.stdout: "event": "header_read", 2023-08-01T19:55:32.689 INFO:teuthology.orchestra.run.smithi101.stdout: "time": "2023-08-01T19:55:09.280624+0000", 2023-08-01T19:55:32.689 INFO:teuthology.orchestra.run.smithi101.stdout: "duration": 4294967295.999999 2023-08-01T19:55:32.690 INFO:teuthology.orchestra.run.smithi101.stdout: }, 2023-08-01T19:55:32.690 INFO:teuthology.orchestra.run.smithi101.stdout: { 2023-08-01T19:55:32.690 INFO:teuthology.orchestra.run.smithi101.stdout: "event": "all_read", 2023-08-01T19:55:32.690 INFO:teuthology.orchestra.run.smithi101.stdout: "time": "2023-08-01T19:55:09.280648+0000", 2023-08-01T19:55:32.690 INFO:teuthology.orchestra.run.smithi101.stdout: "duration": 2.3521999999999999e-05 2023-08-01T19:55:32.690 INFO:teuthology.orchestra.run.smithi101.stdout: }, 2023-08-01T19:55:32.690 INFO:teuthology.orchestra.run.smithi101.stdout: { 2023-08-01T19:55:32.690 INFO:teuthology.orchestra.run.smithi101.stdout: "event": "dispatched", 2023-08-01T19:55:32.691 INFO:teuthology.orchestra.run.smithi101.stdout: "time": "2023-08-01T19:55:09.280658+0000", 2023-08-01T19:55:32.691 INFO:teuthology.orchestra.run.smithi101.stdout: "duration": 9.8660000000000001e-06 2023-08-01T19:55:32.691 INFO:teuthology.orchestra.run.smithi101.stdout: }, 2023-08-01T19:55:32.691 INFO:teuthology.orchestra.run.smithi101.stdout: { 2023-08-01T19:55:32.691 INFO:teuthology.orchestra.run.smithi101.stdout: "event": "queued_for_pg", 2023-08-01T19:55:32.691 INFO:teuthology.orchestra.run.smithi101.stdout: "time": "2023-08-01T19:55:09.280663+0000", 2023-08-01T19:55:32.691 INFO:teuthology.orchestra.run.smithi101.stdout: "duration": 4.8369999999999996e-06 2023-08-01T19:55:32.691 INFO:teuthology.orchestra.run.smithi101.stdout: }, 2023-08-01T19:55:32.692 INFO:teuthology.orchestra.run.smithi101.stdout: { 2023-08-01T19:55:32.692 INFO:teuthology.orchestra.run.smithi101.stdout: "event": "reached_pg", 2023-08-01T19:55:32.692 INFO:teuthology.orchestra.run.smithi101.stdout: "time": "2023-08-01T19:55:09.280690+0000", 2023-08-01T19:55:32.692 INFO:teuthology.orchestra.run.smithi101.stdout: "duration": 2.7534000000000001e-05 2023-08-01T19:55:32.692 INFO:teuthology.orchestra.run.smithi101.stdout: }, 2023-08-01T19:55:32.692 INFO:teuthology.orchestra.run.smithi101.stdout: { 2023-08-01T19:55:32.692 INFO:teuthology.orchestra.run.smithi101.stdout: "event": "started", 2023-08-01T19:55:32.692 INFO:teuthology.orchestra.run.smithi101.stdout: "time": "2023-08-01T19:55:09.280825+0000", 2023-08-01T19:55:32.693 INFO:teuthology.orchestra.run.smithi101.stdout: "duration": 0.000135399 2023-08-01T19:55:32.693 INFO:teuthology.orchestra.run.smithi101.stdout: }, 2023-08-01T19:55:32.693 INFO:teuthology.orchestra.run.smithi101.stdout: { 2023-08-01T19:55:32.693 INFO:teuthology.orchestra.run.smithi101.stdout: "event": "waiting for subops from 2", 2023-08-01T19:55:32.693 INFO:teuthology.orchestra.run.smithi101.stdout: "time": "2023-08-01T19:55:09.280929+0000", 2023-08-01T19:55:32.693 INFO:teuthology.orchestra.run.smithi101.stdout: "duration": 0.000103328 2023-08-01T19:55:32.693 INFO:teuthology.orchestra.run.smithi101.stdout: }, 2023-08-01T19:55:32.694 INFO:teuthology.orchestra.run.smithi101.stdout: { 2023-08-01T19:55:32.694 INFO:teuthology.orchestra.run.smithi101.stdout: "event": "sub_op_commit_rec", 2023-08-01T19:55:32.694 INFO:teuthology.orchestra.run.smithi101.stdout: "time": "2023-08-01T19:55:09.348321+0000", 2023-08-01T19:55:32.694 INFO:teuthology.orchestra.run.smithi101.stdout: "duration": 0.067392176999999998 2023-08-01T19:55:32.694 INFO:teuthology.orchestra.run.smithi101.stdout: }, 2023-08-01T19:55:32.694 INFO:teuthology.orchestra.run.smithi101.stdout: { 2023-08-01T19:55:32.694 INFO:teuthology.orchestra.run.smithi101.stdout: "event": "op_commit", 2023-08-01T19:55:32.694 INFO:teuthology.orchestra.run.smithi101.stdout: "time": "2023-08-01T19:55:09.350431+0000", 2023-08-01T19:55:32.695 INFO:teuthology.orchestra.run.smithi101.stdout: "duration": 0.0021096980000000001 2023-08-01T19:55:32.695 INFO:teuthology.orchestra.run.smithi101.stdout: }, 2023-08-01T19:55:32.695 INFO:teuthology.orchestra.run.smithi101.stdout: { 2023-08-01T19:55:32.695 INFO:teuthology.orchestra.run.smithi101.stdout: "event": "commit_sent", 2023-08-01T19:55:32.695 INFO:teuthology.orchestra.run.smithi101.stdout: "time": "2023-08-01T19:55:09.350469+0000", 2023-08-01T19:55:32.695 INFO:teuthology.orchestra.run.smithi101.stdout: "duration": 3.8625999999999999e-05 2023-08-01T19:55:32.695 INFO:teuthology.orchestra.run.smithi101.stdout: }, 2023-08-01T19:55:32.695 INFO:teuthology.orchestra.run.smithi101.stdout: { 2023-08-01T19:55:32.696 INFO:teuthology.orchestra.run.smithi101.stdout: "event": "done", 2023-08-01T19:55:32.696 INFO:teuthology.orchestra.run.smithi101.stdout: "time": "2023-08-01T19:55:09.350495+0000", 2023-08-01T19:55:32.696 INFO:teuthology.orchestra.run.smithi101.stdout: "duration": 2.5698999999999999e-05 2023-08-01T19:55:32.696 INFO:teuthology.orchestra.run.smithi101.stdout: } 2023-08-01T19:55:32.696 INFO:teuthology.orchestra.run.smithi101.stdout: ] 2023-08-01T19:55:32.696 INFO:teuthology.orchestra.run.smithi101.stdout: } 2023-08-01T19:55:32.696 INFO:teuthology.orchestra.run.smithi101.stdout: }, 2023-08-01T19:55:32.697 INFO:teuthology.orchestra.run.smithi101.stdout: { 2023-08-01T19:55:32.697 INFO:teuthology.orchestra.run.smithi101.stdout: "description": "osd_op(client.4668.0:107867 5.f 5:ff29bbf7:::benchmark_data_smithi006_114134_object107866:head [set-alloc-hint object_size 65536 write_size 65536,write 0~65536] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e38)", 2023-08-01T19:55:32.697 INFO:teuthology.orchestra.run.smithi101.stdout: "initiated_at": "2023-08-01T19:55:09.280670+0000", 2023-08-01T19:55:32.697 INFO:teuthology.orchestra.run.smithi101.stdout: "age": 23.250184483999998, 2023-08-01T19:55:32.697 INFO:teuthology.orchestra.run.smithi101.stdout: "duration": 0.069898092999999994, 2023-08-01T19:55:32.697 INFO:teuthology.orchestra.run.smithi101.stdout: "type_data": { 2023-08-01T19:55:32.697 INFO:teuthology.orchestra.run.smithi101.stdout: "flag_point": "commit sent; apply or cleanup", 2023-08-01T19:55:32.698 INFO:teuthology.orchestra.run.smithi101.stdout: "client_info": { 2023-08-01T19:55:32.698 INFO:teuthology.orchestra.run.smithi101.stdout: "client": "client.4668", 2023-08-01T19:55:32.698 INFO:teuthology.orchestra.run.smithi101.stdout: "client_addr": "172.21.15.6:0/1709472247", 2023-08-01T19:55:32.698 INFO:teuthology.orchestra.run.smithi101.stdout: "tid": 107867 2023-08-01T19:55:32.698 INFO:teuthology.orchestra.run.smithi101.stdout: }, 2023-08-01T19:55:32.698 INFO:teuthology.orchestra.run.smithi101.stdout: "events": [ 2023-08-01T19:55:32.698 INFO:teuthology.orchestra.run.smithi101.stdout: { 2023-08-01T19:55:32.698 INFO:teuthology.orchestra.run.smithi101.stdout: "event": "initiated", 2023-08-01T19:55:32.699 INFO:teuthology.orchestra.run.smithi101.stdout: "time": "2023-08-01T19:55:09.280670+0000", 2023-08-01T19:55:32.699 INFO:teuthology.orchestra.run.smithi101.stdout: "duration": 0 2023-08-01T19:55:32.699 INFO:teuthology.orchestra.run.smithi101.stdout: }, 2023-08-01T19:55:32.699 INFO:teuthology.orchestra.run.smithi101.stdout: { 2023-08-01T19:55:32.699 INFO:teuthology.orchestra.run.smithi101.stdout: "event": "throttled", 2023-08-01T19:55:32.699 INFO:teuthology.orchestra.run.smithi101.stdout: "time": "2023-08-01T19:55:09.280670+0000", 2023-08-01T19:55:32.699 INFO:teuthology.orchestra.run.smithi101.stdout: "duration": 0 2023-08-01T19:55:32.700 INFO:teuthology.orchestra.run.smithi101.stdout: }, 2023-08-01T19:55:32.700 INFO:teuthology.orchestra.run.smithi101.stdout: { 2023-08-01T19:55:32.700 INFO:teuthology.orchestra.run.smithi101.stdout: "event": "header_read", 2023-08-01T19:55:32.700 INFO:teuthology.orchestra.run.smithi101.stdout: "time": "2023-08-01T19:55:09.280670+0000", 2023-08-01T19:55:32.700 INFO:teuthology.orchestra.run.smithi101.stdout: "duration": 4294967295.9999995 2023-08-01T19:55:32.700 INFO:teuthology.orchestra.run.smithi101.stdout: }, 2023-08-01T19:55:32.700 INFO:teuthology.orchestra.run.smithi101.stdout: { 2023-08-01T19:55:32.700 INFO:teuthology.orchestra.run.smithi101.stdout: "event": "all_read", 2023-08-01T19:55:32.701 INFO:teuthology.orchestra.run.smithi101.stdout: "time": "2023-08-01T19:55:09.280690+0000", 2023-08-01T19:55:32.701 INFO:teuthology.orchestra.run.smithi101.stdout: "duration": 2.0526e-05 2023-08-01T19:55:32.701 INFO:teuthology.orchestra.run.smithi101.stdout: }, 2023-08-01T19:55:32.701 INFO:teuthology.orchestra.run.smithi101.stdout: { 2023-08-01T19:55:32.701 INFO:teuthology.orchestra.run.smithi101.stdout: "event": "dispatched", 2023-08-01T19:55:32.701 INFO:teuthology.orchestra.run.smithi101.stdout: "time": "2023-08-01T19:55:09.280695+0000", 2023-08-01T19:55:32.701 INFO:teuthology.orchestra.run.smithi101.stdout: "duration": 4.5140000000000003e-06 2023-08-01T19:55:32.701 INFO:teuthology.orchestra.run.smithi101.stdout: }, 2023-08-01T19:55:32.702 INFO:teuthology.orchestra.run.smithi101.stdout: { 2023-08-01T19:55:32.702 INFO:teuthology.orchestra.run.smithi101.stdout: "event": "queued_for_pg", 2023-08-01T19:55:32.702 INFO:teuthology.orchestra.run.smithi101.stdout: "time": "2023-08-01T19:55:09.280697+0000", 2023-08-01T19:55:32.702 INFO:teuthology.orchestra.run.smithi101.stdout: "duration": 2.6290000000000002e-06 2023-08-01T19:55:32.702 INFO:teuthology.orchestra.run.smithi101.stdout: }, 2023-08-01T19:55:32.702 INFO:teuthology.orchestra.run.smithi101.stdout: { 2023-08-01T19:55:32.702 INFO:teuthology.orchestra.run.smithi101.stdout: "event": "reached_pg", 2023-08-01T19:55:32.702 INFO:teuthology.orchestra.run.smithi101.stdout: "time": "2023-08-01T19:55:09.282392+0000", 2023-08-01T19:55:32.703 INFO:teuthology.orchestra.run.smithi101.stdout: "duration": 0.0016948709999999999 2023-08-01T19:55:32.703 INFO:teuthology.orchestra.run.smithi101.stdout: }, 2023-08-01T19:55:32.703 INFO:teuthology.orchestra.run.smithi101.stdout: { 2023-08-01T19:55:32.703 INFO:teuthology.orchestra.run.smithi101.stdout: "event": "started", 2023-08-01T19:55:32.703 INFO:teuthology.orchestra.run.smithi101.stdout: "time": "2023-08-01T19:55:09.282514+0000", 2023-08-01T19:55:32.703 INFO:teuthology.orchestra.run.smithi101.stdout: "duration": 0.000121839 2023-08-01T19:55:32.703 INFO:teuthology.orchestra.run.smithi101.stdout: }, 2023-08-01T19:55:32.703 INFO:teuthology.orchestra.run.smithi101.stdout: { 2023-08-01T19:55:32.704 INFO:teuthology.orchestra.run.smithi101.stdout: "event": "waiting for subops from 2", 2023-08-01T19:55:32.704 INFO:teuthology.orchestra.run.smithi101.stdout: "time": "2023-08-01T19:55:09.282664+0000", 2023-08-01T19:55:32.704 INFO:teuthology.orchestra.run.smithi101.stdout: "duration": 0.00014968699999999999 2023-08-01T19:55:32.704 INFO:teuthology.orchestra.run.smithi101.stdout: }, 2023-08-01T19:55:32.704 INFO:teuthology.orchestra.run.smithi101.stdout: { 2023-08-01T19:55:32.704 INFO:teuthology.orchestra.run.smithi101.stdout: "event": "sub_op_commit_rec", 2023-08-01T19:55:32.704 INFO:teuthology.orchestra.run.smithi101.stdout: "time": "2023-08-01T19:55:09.348344+0000", 2023-08-01T19:55:32.705 INFO:teuthology.orchestra.run.smithi101.stdout: "duration": 0.065680247999999997 2023-08-01T19:55:32.705 INFO:teuthology.orchestra.run.smithi101.stdout: }, 2023-08-01T19:55:32.705 INFO:teuthology.orchestra.run.smithi101.stdout: { 2023-08-01T19:55:32.705 INFO:teuthology.orchestra.run.smithi101.stdout: "event": "op_commit", 2023-08-01T19:55:32.705 INFO:teuthology.orchestra.run.smithi101.stdout: "time": "2023-08-01T19:55:09.350502+0000", 2023-08-01T19:55:32.705 INFO:teuthology.orchestra.run.smithi101.stdout: "duration": 0.0021578140000000001 2023-08-01T19:55:32.705 INFO:teuthology.orchestra.run.smithi101.stdout: }, 2023-08-01T19:55:32.705 INFO:teuthology.orchestra.run.smithi101.stdout: { 2023-08-01T19:55:32.706 INFO:teuthology.orchestra.run.smithi101.stdout: "event": "commit_sent", 2023-08-01T19:55:32.706 INFO:teuthology.orchestra.run.smithi101.stdout: "time": "2023-08-01T19:55:09.350529+0000", 2023-08-01T19:55:32.706 INFO:teuthology.orchestra.run.smithi101.stdout: "duration": 2.6838e-05 2023-08-01T19:55:32.706 INFO:teuthology.orchestra.run.smithi101.stdout: }, 2023-08-01T19:55:32.706 INFO:teuthology.orchestra.run.smithi101.stdout: { 2023-08-01T19:55:32.706 INFO:teuthology.orchestra.run.smithi101.stdout: "event": "done", 2023-08-01T19:55:32.706 INFO:teuthology.orchestra.run.smithi101.stdout: "time": "2023-08-01T19:55:09.350568+0000", 2023-08-01T19:55:32.707 INFO:teuthology.orchestra.run.smithi101.stdout: "duration": 3.9477000000000002e-05 2023-08-01T19:55:32.707 INFO:teuthology.orchestra.run.smithi101.stdout: } 2023-08-01T19:55:32.707 INFO:teuthology.orchestra.run.smithi101.stdout: ] 2023-08-01T19:55:32.707 INFO:teuthology.orchestra.run.smithi101.stdout: } 2023-08-01T19:55:32.707 INFO:teuthology.orchestra.run.smithi101.stdout: }, 2023-08-01T19:55:32.707 INFO:teuthology.orchestra.run.smithi101.stdout: { 2023-08-01T19:55:32.707 INFO:teuthology.orchestra.run.smithi101.stdout: "description": "osd_repop(client.4668.0:107863 5.3 e38/19 5:cbdd875a:::benchmark_data_smithi006_114134_object107862:head v 38'6829, mlcod=38'6826)", 2023-08-01T19:55:32.707 INFO:teuthology.orchestra.run.smithi101.stdout: "initiated_at": "2023-08-01T19:55:09.280747+0000", 2023-08-01T19:55:32.708 INFO:teuthology.orchestra.run.smithi101.stdout: "age": 23.250107535000001, 2023-08-01T19:55:32.708 INFO:teuthology.orchestra.run.smithi101.stdout: "duration": 0.069343305999999993, 2023-08-01T19:55:32.708 INFO:teuthology.orchestra.run.smithi101.stdout: "type_data": { 2023-08-01T19:55:32.708 INFO:teuthology.orchestra.run.smithi101.stdout: "flag_point": "commit sent; apply or cleanup", 2023-08-01T19:55:32.708 INFO:teuthology.orchestra.run.smithi101.stdout: "events": [ 2023-08-01T19:55:32.708 INFO:teuthology.orchestra.run.smithi101.stdout: { 2023-08-01T19:55:32.708 INFO:teuthology.orchestra.run.smithi101.stdout: "event": "initiated", 2023-08-01T19:55:32.709 INFO:teuthology.orchestra.run.smithi101.stdout: "time": "2023-08-01T19:55:09.280747+0000", 2023-08-01T19:55:32.709 INFO:teuthology.orchestra.run.smithi101.stdout: "duration": 0 2023-08-01T19:55:32.709 INFO:teuthology.orchestra.run.smithi101.stdout: }, 2023-08-01T19:55:32.709 INFO:teuthology.orchestra.run.smithi101.stdout: { 2023-08-01T19:55:32.709 INFO:teuthology.orchestra.run.smithi101.stdout: "event": "throttled", 2023-08-01T19:55:32.709 INFO:teuthology.orchestra.run.smithi101.stdout: "time": "2023-08-01T19:55:09.280747+0000", 2023-08-01T19:55:32.709 INFO:teuthology.orchestra.run.smithi101.stdout: "duration": 0 2023-08-01T19:55:32.709 INFO:teuthology.orchestra.run.smithi101.stdout: }, 2023-08-01T19:55:32.710 INFO:teuthology.orchestra.run.smithi101.stdout: { 2023-08-01T19:55:32.710 INFO:teuthology.orchestra.run.smithi101.stdout: "event": "header_read", 2023-08-01T19:55:32.710 INFO:teuthology.orchestra.run.smithi101.stdout: "time": "2023-08-01T19:55:09.280746+0000", 2023-08-01T19:55:32.710 INFO:teuthology.orchestra.run.smithi101.stdout: "duration": 4294967295.9999995 2023-08-01T19:55:32.710 INFO:teuthology.orchestra.run.smithi101.stdout: }, 2023-08-01T19:55:32.710 INFO:teuthology.orchestra.run.smithi101.stdout: { 2023-08-01T19:55:32.710 INFO:teuthology.orchestra.run.smithi101.stdout: "event": "all_read", 2023-08-01T19:55:32.710 INFO:teuthology.orchestra.run.smithi101.stdout: "time": "2023-08-01T19:55:09.280798+0000", 2023-08-01T19:55:32.711 INFO:teuthology.orchestra.run.smithi101.stdout: "duration": 5.1706000000000003e-05 2023-08-01T19:55:32.711 INFO:teuthology.orchestra.run.smithi101.stdout: }, 2023-08-01T19:55:32.711 INFO:teuthology.orchestra.run.smithi101.stdout: { 2023-08-01T19:55:32.711 INFO:teuthology.orchestra.run.smithi101.stdout: "event": "dispatched", 2023-08-01T19:55:32.711 INFO:teuthology.orchestra.run.smithi101.stdout: "time": "2023-08-01T19:55:09.280807+0000", 2023-08-01T19:55:32.711 INFO:teuthology.orchestra.run.smithi101.stdout: "duration": 8.4889999999999995e-06 2023-08-01T19:55:32.711 INFO:teuthology.orchestra.run.smithi101.stdout: }, 2023-08-01T19:55:32.711 INFO:teuthology.orchestra.run.smithi101.stdout: { 2023-08-01T19:55:32.712 INFO:teuthology.orchestra.run.smithi101.stdout: "event": "queued_for_pg", 2023-08-01T19:55:32.712 INFO:teuthology.orchestra.run.smithi101.stdout: "time": "2023-08-01T19:55:09.280812+0000", 2023-08-01T19:55:32.712 INFO:teuthology.orchestra.run.smithi101.stdout: "duration": 5.2120000000000002e-06 2023-08-01T19:55:32.712 INFO:teuthology.orchestra.run.smithi101.stdout: }, 2023-08-01T19:55:32.712 INFO:teuthology.orchestra.run.smithi101.stdout: { 2023-08-01T19:55:32.712 INFO:teuthology.orchestra.run.smithi101.stdout: "event": "reached_pg", 2023-08-01T19:55:32.712 INFO:teuthology.orchestra.run.smithi101.stdout: "time": "2023-08-01T19:55:09.280843+0000", 2023-08-01T19:55:32.713 INFO:teuthology.orchestra.run.smithi101.stdout: "duration": 3.1406999999999999e-05 2023-08-01T19:55:32.713 INFO:teuthology.orchestra.run.smithi101.stdout: }, 2023-08-01T19:55:32.713 INFO:teuthology.orchestra.run.smithi101.stdout: { 2023-08-01T19:55:32.713 INFO:teuthology.orchestra.run.smithi101.stdout: "event": "started", 2023-08-01T19:55:32.713 INFO:teuthology.orchestra.run.smithi101.stdout: "time": "2023-08-01T19:55:09.280860+0000", 2023-08-01T19:55:32.713 INFO:teuthology.orchestra.run.smithi101.stdout: "duration": 1.6283999999999999e-05 2023-08-01T19:55:32.713 INFO:teuthology.orchestra.run.smithi101.stdout: }, 2023-08-01T19:55:32.713 INFO:teuthology.orchestra.run.smithi101.stdout: { 2023-08-01T19:55:32.714 INFO:teuthology.orchestra.run.smithi101.stdout: "event": "commit_sent", 2023-08-01T19:55:32.714 INFO:teuthology.orchestra.run.smithi101.stdout: "time": "2023-08-01T19:55:09.350059+0000", 2023-08-01T19:55:32.714 INFO:teuthology.orchestra.run.smithi101.stdout: "duration": 0.069199094000000003 2023-08-01T19:55:32.714 INFO:teuthology.orchestra.run.smithi101.stdout: }, 2023-08-01T19:55:32.714 INFO:teuthology.orchestra.run.smithi101.stdout: { 2023-08-01T19:55:32.714 INFO:teuthology.orchestra.run.smithi101.stdout: "event": "done", 2023-08-01T19:55:32.714 INFO:teuthology.orchestra.run.smithi101.stdout: "time": "2023-08-01T19:55:09.350090+0000", 2023-08-01T19:55:32.714 INFO:teuthology.orchestra.run.smithi101.stdout: "duration": 3.1736000000000002e-05 2023-08-01T19:55:32.715 INFO:teuthology.orchestra.run.smithi101.stdout: } 2023-08-01T19:55:32.715 INFO:teuthology.orchestra.run.smithi101.stdout: ] 2023-08-01T19:55:32.715 INFO:teuthology.orchestra.run.smithi101.stdout: } 2023-08-01T19:55:32.715 INFO:teuthology.orchestra.run.smithi101.stdout: }, 2023-08-01T19:55:32.715 INFO:teuthology.orchestra.run.smithi101.stdout: { 2023-08-01T19:55:32.715 INFO:teuthology.orchestra.run.smithi101.stdout: "description": "osd_repop(client.4668.0:107865 5.3 e38/19 5:c2ebb96d:::benchmark_data_smithi006_114134_object107864:head v 38'6830, mlcod=38'6826)", 2023-08-01T19:55:32.715 INFO:teuthology.orchestra.run.smithi101.stdout: "initiated_at": "2023-08-01T19:55:09.283182+0000", 2023-08-01T19:55:32.715 INFO:teuthology.orchestra.run.smithi101.stdout: "age": 23.247672226999999, 2023-08-01T19:55:32.716 INFO:teuthology.orchestra.run.smithi101.stdout: "duration": 0.068554793000000003, 2023-08-01T19:55:32.716 INFO:teuthology.orchestra.run.smithi101.stdout: "type_data": { 2023-08-01T19:55:32.716 INFO:teuthology.orchestra.run.smithi101.stdout: "flag_point": "commit sent; apply or cleanup", 2023-08-01T19:55:32.716 INFO:teuthology.orchestra.run.smithi101.stdout: "events": [ 2023-08-01T19:55:32.716 INFO:teuthology.orchestra.run.smithi101.stdout: { 2023-08-01T19:55:32.716 INFO:teuthology.orchestra.run.smithi101.stdout: "event": "initiated", 2023-08-01T19:55:32.716 INFO:teuthology.orchestra.run.smithi101.stdout: "time": "2023-08-01T19:55:09.283182+0000", 2023-08-01T19:55:32.716 INFO:teuthology.orchestra.run.smithi101.stdout: "duration": 0 2023-08-01T19:55:32.717 INFO:teuthology.orchestra.run.smithi101.stdout: }, 2023-08-01T19:55:32.717 INFO:teuthology.orchestra.run.smithi101.stdout: { 2023-08-01T19:55:32.717 INFO:teuthology.orchestra.run.smithi101.stdout: "event": "throttled", 2023-08-01T19:55:32.717 INFO:teuthology.orchestra.run.smithi101.stdout: "time": "2023-08-01T19:55:09.283182+0000", 2023-08-01T19:55:32.717 INFO:teuthology.orchestra.run.smithi101.stdout: "duration": 0 2023-08-01T19:55:32.717 INFO:teuthology.orchestra.run.smithi101.stdout: }, 2023-08-01T19:55:32.717 INFO:teuthology.orchestra.run.smithi101.stdout: { 2023-08-01T19:55:32.717 INFO:teuthology.orchestra.run.smithi101.stdout: "event": "header_read", 2023-08-01T19:55:32.718 INFO:teuthology.orchestra.run.smithi101.stdout: "time": "2023-08-01T19:55:09.283182+0000", 2023-08-01T19:55:32.718 INFO:teuthology.orchestra.run.smithi101.stdout: "duration": 4294967295.9999995 2023-08-01T19:55:32.718 INFO:teuthology.orchestra.run.smithi101.stdout: }, 2023-08-01T19:55:32.718 INFO:teuthology.orchestra.run.smithi101.stdout: { 2023-08-01T19:55:32.718 INFO:teuthology.orchestra.run.smithi101.stdout: "event": "all_read", 2023-08-01T19:55:32.718 INFO:teuthology.orchestra.run.smithi101.stdout: "time": "2023-08-01T19:55:09.283233+0000", 2023-08-01T19:55:32.718 INFO:teuthology.orchestra.run.smithi101.stdout: "duration": 5.1511999999999997e-05 2023-08-01T19:55:32.719 INFO:teuthology.orchestra.run.smithi101.stdout: }, 2023-08-01T19:55:32.719 INFO:teuthology.orchestra.run.smithi101.stdout: { 2023-08-01T19:55:32.719 INFO:teuthology.orchestra.run.smithi101.stdout: "event": "dispatched", 2023-08-01T19:55:32.719 INFO:teuthology.orchestra.run.smithi101.stdout: "time": "2023-08-01T19:55:09.283239+0000", 2023-08-01T19:55:32.719 INFO:teuthology.orchestra.run.smithi101.stdout: "duration": 5.6640000000000003e-06 2023-08-01T19:55:32.719 INFO:teuthology.orchestra.run.smithi101.stdout: }, 2023-08-01T19:55:32.719 INFO:teuthology.orchestra.run.smithi101.stdout: { 2023-08-01T19:55:32.719 INFO:teuthology.orchestra.run.smithi101.stdout: "event": "queued_for_pg", 2023-08-01T19:55:32.720 INFO:teuthology.orchestra.run.smithi101.stdout: "time": "2023-08-01T19:55:09.283242+0000", 2023-08-01T19:55:32.720 INFO:teuthology.orchestra.run.smithi101.stdout: "duration": 2.9639999999999999e-06 2023-08-01T19:55:32.720 INFO:teuthology.orchestra.run.smithi101.stdout: }, 2023-08-01T19:55:32.720 INFO:teuthology.orchestra.run.smithi101.stdout: { 2023-08-01T19:55:32.720 INFO:teuthology.orchestra.run.smithi101.stdout: "event": "reached_pg", 2023-08-01T19:55:32.720 INFO:teuthology.orchestra.run.smithi101.stdout: "time": "2023-08-01T19:55:09.283276+0000", 2023-08-01T19:55:32.720 INFO:teuthology.orchestra.run.smithi101.stdout: "duration": 3.3631999999999999e-05 2023-08-01T19:55:32.720 INFO:teuthology.orchestra.run.smithi101.stdout: }, 2023-08-01T19:55:32.721 INFO:teuthology.orchestra.run.smithi101.stdout: { 2023-08-01T19:55:32.721 INFO:teuthology.orchestra.run.smithi101.stdout: "event": "started", 2023-08-01T19:55:32.721 INFO:teuthology.orchestra.run.smithi101.stdout: "time": "2023-08-01T19:55:09.283288+0000", 2023-08-01T19:55:32.721 INFO:teuthology.orchestra.run.smithi101.stdout: "duration": 1.1816e-05 2023-08-01T19:55:32.721 INFO:teuthology.orchestra.run.smithi101.stdout: }, 2023-08-01T19:55:32.721 INFO:teuthology.orchestra.run.smithi101.stdout: { 2023-08-01T19:55:32.721 INFO:teuthology.orchestra.run.smithi101.stdout: "event": "commit_sent", 2023-08-01T19:55:32.721 INFO:teuthology.orchestra.run.smithi101.stdout: "time": "2023-08-01T19:55:09.351712+0000", 2023-08-01T19:55:32.722 INFO:teuthology.orchestra.run.smithi101.stdout: "duration": 0.068424311000000002 2023-08-01T19:55:32.722 INFO:teuthology.orchestra.run.smithi101.stdout: }, 2023-08-01T19:55:32.722 INFO:teuthology.orchestra.run.smithi101.stdout: { 2023-08-01T19:55:32.722 INFO:teuthology.orchestra.run.smithi101.stdout: "event": "done", 2023-08-01T19:55:32.722 INFO:teuthology.orchestra.run.smithi101.stdout: "time": "2023-08-01T19:55:09.351737+0000", 2023-08-01T19:55:32.722 INFO:teuthology.orchestra.run.smithi101.stdout: "duration": 2.5364999999999999e-05 2023-08-01T19:55:32.722 INFO:teuthology.orchestra.run.smithi101.stdout: } 2023-08-01T19:55:32.722 INFO:teuthology.orchestra.run.smithi101.stdout: ] 2023-08-01T19:55:32.723 INFO:teuthology.orchestra.run.smithi101.stdout: } 2023-08-01T19:55:32.723 INFO:teuthology.orchestra.run.smithi101.stdout: }, 2023-08-01T19:55:32.723 INFO:teuthology.orchestra.run.smithi101.stdout: { 2023-08-01T19:55:32.723 INFO:teuthology.orchestra.run.smithi101.stdout: "description": "osd_repop(client.4668.0:107869 5.c e38/19 5:31910384:::benchmark_data_smithi006_114134_object107868:head v 38'6761, mlcod=38'6759)", 2023-08-01T19:55:32.723 INFO:teuthology.orchestra.run.smithi101.stdout: "initiated_at": "2023-08-01T19:55:09.283762+0000", 2023-08-01T19:55:32.723 INFO:teuthology.orchestra.run.smithi101.stdout: "age": 23.247092891000001, 2023-08-01T19:55:32.723 INFO:teuthology.orchestra.run.smithi101.stdout: "duration": 0.067877541, 2023-08-01T19:55:32.723 INFO:teuthology.orchestra.run.smithi101.stdout: "type_data": { 2023-08-01T19:55:32.724 INFO:teuthology.orchestra.run.smithi101.stdout: "flag_point": "commit sent; apply or cleanup", 2023-08-01T19:55:32.724 INFO:teuthology.orchestra.run.smithi101.stdout: "events": [ 2023-08-01T19:55:32.724 INFO:teuthology.orchestra.run.smithi101.stdout: { 2023-08-01T19:55:32.724 INFO:teuthology.orchestra.run.smithi101.stdout: "event": "initiated", 2023-08-01T19:55:32.724 INFO:teuthology.orchestra.run.smithi101.stdout: "time": "2023-08-01T19:55:09.283762+0000", 2023-08-01T19:55:32.724 INFO:teuthology.orchestra.run.smithi101.stdout: "duration": 0 2023-08-01T19:55:32.724 INFO:teuthology.orchestra.run.smithi101.stdout: }, 2023-08-01T19:55:32.725 INFO:teuthology.orchestra.run.smithi101.stdout: { 2023-08-01T19:55:32.725 INFO:teuthology.orchestra.run.smithi101.stdout: "event": "throttled", 2023-08-01T19:55:32.725 INFO:teuthology.orchestra.run.smithi101.stdout: "time": "2023-08-01T19:55:09.283762+0000", 2023-08-01T19:55:32.725 INFO:teuthology.orchestra.run.smithi101.stdout: "duration": 0 2023-08-01T19:55:32.725 INFO:teuthology.orchestra.run.smithi101.stdout: }, 2023-08-01T19:55:32.725 INFO:teuthology.orchestra.run.smithi101.stdout: { 2023-08-01T19:55:32.725 INFO:teuthology.orchestra.run.smithi101.stdout: "event": "header_read", 2023-08-01T19:55:32.725 INFO:teuthology.orchestra.run.smithi101.stdout: "time": "2023-08-01T19:55:09.283761+0000", 2023-08-01T19:55:32.726 INFO:teuthology.orchestra.run.smithi101.stdout: "duration": 4294967295.9999995 2023-08-01T19:55:32.726 INFO:teuthology.orchestra.run.smithi101.stdout: }, 2023-08-01T19:55:32.726 INFO:teuthology.orchestra.run.smithi101.stdout: { 2023-08-01T19:55:32.726 INFO:teuthology.orchestra.run.smithi101.stdout: "event": "all_read", 2023-08-01T19:55:32.726 INFO:teuthology.orchestra.run.smithi101.stdout: "time": "2023-08-01T19:55:09.283825+0000", 2023-08-01T19:55:32.726 INFO:teuthology.orchestra.run.smithi101.stdout: "duration": 6.3200000000000005e-05 2023-08-01T19:55:32.726 INFO:teuthology.orchestra.run.smithi101.stdout: }, 2023-08-01T19:55:32.726 INFO:teuthology.orchestra.run.smithi101.stdout: { 2023-08-01T19:55:32.727 INFO:teuthology.orchestra.run.smithi101.stdout: "event": "dispatched", 2023-08-01T19:55:32.727 INFO:teuthology.orchestra.run.smithi101.stdout: "time": "2023-08-01T19:55:09.345759+0000", 2023-08-01T19:55:32.727 INFO:teuthology.orchestra.run.smithi101.stdout: "duration": 0.061934221999999997 2023-08-01T19:55:32.727 INFO:teuthology.orchestra.run.smithi101.stdout: }, 2023-08-01T19:55:32.727 INFO:teuthology.orchestra.run.smithi101.stdout: { 2023-08-01T19:55:32.727 INFO:teuthology.orchestra.run.smithi101.stdout: "event": "queued_for_pg", 2023-08-01T19:55:32.727 INFO:teuthology.orchestra.run.smithi101.stdout: "time": "2023-08-01T19:55:09.345768+0000", 2023-08-01T19:55:32.727 INFO:teuthology.orchestra.run.smithi101.stdout: "duration": 8.7099999999999996e-06 2023-08-01T19:55:32.728 INFO:teuthology.orchestra.run.smithi101.stdout: }, 2023-08-01T19:55:32.728 INFO:teuthology.orchestra.run.smithi101.stdout: { 2023-08-01T19:55:32.728 INFO:teuthology.orchestra.run.smithi101.stdout: "event": "reached_pg", 2023-08-01T19:55:32.728 INFO:teuthology.orchestra.run.smithi101.stdout: "time": "2023-08-01T19:55:09.345832+0000", 2023-08-01T19:55:32.728 INFO:teuthology.orchestra.run.smithi101.stdout: "duration": 6.4769000000000003e-05 2023-08-01T19:55:32.728 INFO:teuthology.orchestra.run.smithi101.stdout: }, 2023-08-01T19:55:32.728 INFO:teuthology.orchestra.run.smithi101.stdout: { 2023-08-01T19:55:32.729 INFO:teuthology.orchestra.run.smithi101.stdout: "event": "started", 2023-08-01T19:55:32.729 INFO:teuthology.orchestra.run.smithi101.stdout: "time": "2023-08-01T19:55:09.345851+0000", 2023-08-01T19:55:32.729 INFO:teuthology.orchestra.run.smithi101.stdout: "duration": 1.9049e-05 2023-08-01T19:55:32.729 INFO:teuthology.orchestra.run.smithi101.stdout: }, 2023-08-01T19:55:32.729 INFO:teuthology.orchestra.run.smithi101.stdout: { 2023-08-01T19:55:32.729 INFO:teuthology.orchestra.run.smithi101.stdout: "event": "commit_sent", 2023-08-01T19:55:32.729 INFO:teuthology.orchestra.run.smithi101.stdout: "time": "2023-08-01T19:55:09.351601+0000", 2023-08-01T19:55:32.729 INFO:teuthology.orchestra.run.smithi101.stdout: "duration": 0.0057499930000000001 2023-08-01T19:55:32.730 INFO:teuthology.orchestra.run.smithi101.stdout: }, 2023-08-01T19:55:32.730 INFO:teuthology.orchestra.run.smithi101.stdout: { 2023-08-01T19:55:32.730 INFO:teuthology.orchestra.run.smithi101.stdout: "event": "done", 2023-08-01T19:55:32.730 INFO:teuthology.orchestra.run.smithi101.stdout: "time": "2023-08-01T19:55:09.351639+0000", 2023-08-01T19:55:32.730 INFO:teuthology.orchestra.run.smithi101.stdout: "duration": 3.7941000000000001e-05 2023-08-01T19:55:32.730 INFO:teuthology.orchestra.run.smithi101.stdout: } 2023-08-01T19:55:32.730 INFO:teuthology.orchestra.run.smithi101.stdout: ] 2023-08-01T19:55:32.730 INFO:teuthology.orchestra.run.smithi101.stdout: } 2023-08-01T19:55:32.731 INFO:teuthology.orchestra.run.smithi101.stdout: }, 2023-08-01T19:55:32.731 INFO:teuthology.orchestra.run.smithi101.stdout: { 2023-08-01T19:55:32.731 INFO:teuthology.orchestra.run.smithi101.stdout: "description": "osd_op(client.4668.0:107876 5.1 5:8d2344a3:::benchmark_data_smithi006_114134_object107875:head [set-alloc-hint object_size 65536 write_size 65536,write 0~65536] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e38)", 2023-08-01T19:55:32.731 INFO:teuthology.orchestra.run.smithi101.stdout: "initiated_at": "2023-08-01T19:55:09.287802+0000", 2023-08-01T19:55:32.731 INFO:teuthology.orchestra.run.smithi101.stdout: "age": 23.243052571, 2023-08-01T19:55:32.731 INFO:teuthology.orchestra.run.smithi101.stdout: "duration": 0.066738461999999998, 2023-08-01T19:55:32.731 INFO:teuthology.orchestra.run.smithi101.stdout: "type_data": { 2023-08-01T19:55:32.731 INFO:teuthology.orchestra.run.smithi101.stdout: "flag_point": "commit sent; apply or cleanup", 2023-08-01T19:55:32.732 INFO:teuthology.orchestra.run.smithi101.stdout: "client_info": { 2023-08-01T19:55:32.732 INFO:teuthology.orchestra.run.smithi101.stdout: "client": "client.4668", 2023-08-01T19:55:32.732 INFO:teuthology.orchestra.run.smithi101.stdout: "client_addr": "172.21.15.6:0/1709472247", 2023-08-01T19:55:32.732 INFO:teuthology.orchestra.run.smithi101.stdout: "tid": 107876 2023-08-01T19:55:32.732 INFO:teuthology.orchestra.run.smithi101.stdout: }, 2023-08-01T19:55:32.732 INFO:teuthology.orchestra.run.smithi101.stdout: "events": [ 2023-08-01T19:55:32.732 INFO:teuthology.orchestra.run.smithi101.stdout: { 2023-08-01T19:55:32.733 INFO:teuthology.orchestra.run.smithi101.stdout: "event": "initiated", 2023-08-01T19:55:32.733 INFO:teuthology.orchestra.run.smithi101.stdout: "time": "2023-08-01T19:55:09.287802+0000", 2023-08-01T19:55:32.733 INFO:teuthology.orchestra.run.smithi101.stdout: "duration": 0 2023-08-01T19:55:32.733 INFO:teuthology.orchestra.run.smithi101.stdout: }, 2023-08-01T19:55:32.733 INFO:teuthology.orchestra.run.smithi101.stdout: { 2023-08-01T19:55:32.733 INFO:teuthology.orchestra.run.smithi101.stdout: "event": "throttled", 2023-08-01T19:55:32.733 INFO:teuthology.orchestra.run.smithi101.stdout: "time": "2023-08-01T19:55:09.287802+0000", 2023-08-01T19:55:32.733 INFO:teuthology.orchestra.run.smithi101.stdout: "duration": 0 2023-08-01T19:55:32.734 INFO:teuthology.orchestra.run.smithi101.stdout: }, 2023-08-01T19:55:32.734 INFO:teuthology.orchestra.run.smithi101.stdout: { 2023-08-01T19:55:32.734 INFO:teuthology.orchestra.run.smithi101.stdout: "event": "header_read", 2023-08-01T19:55:32.734 INFO:teuthology.orchestra.run.smithi101.stdout: "time": "2023-08-01T19:55:09.287800+0000", 2023-08-01T19:55:32.734 INFO:teuthology.orchestra.run.smithi101.stdout: "duration": 4294967295.9999981 2023-08-01T19:55:32.734 INFO:teuthology.orchestra.run.smithi101.stdout: }, 2023-08-01T19:55:32.734 INFO:teuthology.orchestra.run.smithi101.stdout: { 2023-08-01T19:55:32.734 INFO:teuthology.orchestra.run.smithi101.stdout: "event": "all_read", 2023-08-01T19:55:32.735 INFO:teuthology.orchestra.run.smithi101.stdout: "time": "2023-08-01T19:55:09.287847+0000", 2023-08-01T19:55:32.735 INFO:teuthology.orchestra.run.smithi101.stdout: "duration": 4.6455999999999997e-05 2023-08-01T19:55:32.735 INFO:teuthology.orchestra.run.smithi101.stdout: }, 2023-08-01T19:55:32.735 INFO:teuthology.orchestra.run.smithi101.stdout: { 2023-08-01T19:55:32.735 INFO:teuthology.orchestra.run.smithi101.stdout: "event": "dispatched", 2023-08-01T19:55:32.735 INFO:teuthology.orchestra.run.smithi101.stdout: "time": "2023-08-01T19:55:09.345732+0000", 2023-08-01T19:55:32.735 INFO:teuthology.orchestra.run.smithi101.stdout: "duration": 0.057885955000000003 2023-08-01T19:55:32.735 INFO:teuthology.orchestra.run.smithi101.stdout: }, 2023-08-01T19:55:32.736 INFO:teuthology.orchestra.run.smithi101.stdout: { 2023-08-01T19:55:32.736 INFO:teuthology.orchestra.run.smithi101.stdout: "event": "queued_for_pg", 2023-08-01T19:55:32.736 INFO:teuthology.orchestra.run.smithi101.stdout: "time": "2023-08-01T19:55:09.345802+0000", 2023-08-01T19:55:32.736 INFO:teuthology.orchestra.run.smithi101.stdout: "duration": 6.9845000000000006e-05 2023-08-01T19:55:32.736 INFO:teuthology.orchestra.run.smithi101.stdout: }, 2023-08-01T19:55:32.736 INFO:teuthology.orchestra.run.smithi101.stdout: { 2023-08-01T19:55:32.736 INFO:teuthology.orchestra.run.smithi101.stdout: "event": "reached_pg", 2023-08-01T19:55:32.737 INFO:teuthology.orchestra.run.smithi101.stdout: "time": "2023-08-01T19:55:09.345841+0000", 2023-08-01T19:55:32.737 INFO:teuthology.orchestra.run.smithi101.stdout: "duration": 3.8719e-05 2023-08-01T19:55:32.737 INFO:teuthology.orchestra.run.smithi101.stdout: }, 2023-08-01T19:55:32.737 INFO:teuthology.orchestra.run.smithi101.stdout: { 2023-08-01T19:55:32.737 INFO:teuthology.orchestra.run.smithi101.stdout: "event": "started", 2023-08-01T19:55:32.737 INFO:teuthology.orchestra.run.smithi101.stdout: "time": "2023-08-01T19:55:09.345965+0000", 2023-08-01T19:55:32.737 INFO:teuthology.orchestra.run.smithi101.stdout: "duration": 0.00012353099999999999 2023-08-01T19:55:32.737 INFO:teuthology.orchestra.run.smithi101.stdout: }, 2023-08-01T19:55:32.738 INFO:teuthology.orchestra.run.smithi101.stdout: { 2023-08-01T19:55:32.738 INFO:teuthology.orchestra.run.smithi101.stdout: "event": "waiting for subops from 0", 2023-08-01T19:55:32.738 INFO:teuthology.orchestra.run.smithi101.stdout: "time": "2023-08-01T19:55:09.346113+0000", 2023-08-01T19:55:32.738 INFO:teuthology.orchestra.run.smithi101.stdout: "duration": 0.000148496 2023-08-01T19:55:32.738 INFO:teuthology.orchestra.run.smithi101.stdout: }, 2023-08-01T19:55:32.738 INFO:teuthology.orchestra.run.smithi101.stdout: { 2023-08-01T19:55:32.738 INFO:teuthology.orchestra.run.smithi101.stdout: "event": "sub_op_commit_rec", 2023-08-01T19:55:32.738 INFO:teuthology.orchestra.run.smithi101.stdout: "time": "2023-08-01T19:55:09.352561+0000", 2023-08-01T19:55:32.739 INFO:teuthology.orchestra.run.smithi101.stdout: "duration": 0.0064478890000000001 2023-08-01T19:55:32.739 INFO:teuthology.orchestra.run.smithi101.stdout: }, 2023-08-01T19:55:32.739 INFO:teuthology.orchestra.run.smithi101.stdout: { 2023-08-01T19:55:32.739 INFO:teuthology.orchestra.run.smithi101.stdout: "event": "op_commit", 2023-08-01T19:55:32.739 INFO:teuthology.orchestra.run.smithi101.stdout: "time": "2023-08-01T19:55:09.354475+0000", 2023-08-01T19:55:32.739 INFO:teuthology.orchestra.run.smithi101.stdout: "duration": 0.001913903 2023-08-01T19:55:32.739 INFO:teuthology.orchestra.run.smithi101.stdout: }, 2023-08-01T19:55:32.739 INFO:teuthology.orchestra.run.smithi101.stdout: { 2023-08-01T19:55:32.740 INFO:teuthology.orchestra.run.smithi101.stdout: "event": "commit_sent", 2023-08-01T19:55:32.740 INFO:teuthology.orchestra.run.smithi101.stdout: "time": "2023-08-01T19:55:09.354514+0000", 2023-08-01T19:55:32.740 INFO:teuthology.orchestra.run.smithi101.stdout: "duration": 3.8680999999999998e-05 2023-08-01T19:55:32.740 INFO:teuthology.orchestra.run.smithi101.stdout: }, 2023-08-01T19:55:32.740 INFO:teuthology.orchestra.run.smithi101.stdout: { 2023-08-01T19:55:32.740 INFO:teuthology.orchestra.run.smithi101.stdout: "event": "done", 2023-08-01T19:55:32.740 INFO:teuthology.orchestra.run.smithi101.stdout: "time": "2023-08-01T19:55:09.354541+0000", 2023-08-01T19:55:32.740 INFO:teuthology.orchestra.run.smithi101.stdout: "duration": 2.6976999999999999e-05 2023-08-01T19:55:32.741 INFO:teuthology.orchestra.run.smithi101.stdout: } 2023-08-01T19:55:32.741 INFO:teuthology.orchestra.run.smithi101.stdout: ] 2023-08-01T19:55:32.741 INFO:teuthology.orchestra.run.smithi101.stdout: } 2023-08-01T19:55:32.741 INFO:teuthology.orchestra.run.smithi101.stdout: } 2023-08-01T19:55:32.741 INFO:teuthology.orchestra.run.smithi101.stdout: ] 2023-08-01T19:55:32.741 INFO:teuthology.orchestra.run.smithi101.stdout:} 2023-08-01T19:55:32.742 INFO:tasks.ceph.osd.1.smithi101.stderr:2023-08-01T19:55:32.532+0000 7fb0cb7f6700 -1 received signal: Hangup from /usr/bin/python3 /bin/daemon-helper kill ceph-osd -f --cluster ceph -i 1 (PID: 111141) UID: 0 2023-08-01T19:55:32.742 DEBUG:teuthology.orchestra.run.smithi155:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 30 ceph --cluster ceph --admin-daemon /var/run/ceph/ceph-osd.2.asok dump_ops_in_flight 2023-08-01T19:55:32.743 DEBUG:teuthology.orchestra.run.smithi006:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 120 ceph --cluster ceph -- tell 'osd.*' injectargs --osd_enable_op_tracker=false 2023-08-01T19:55:32.744 INFO:tasks.ceph.osd.0.smithi008.stderr:2023-08-01T19:55:32.742+0000 7f16a58f4700 -1 received signal: Hangup from /usr/bin/python3 /bin/daemon-helper kill ceph-osd -f --cluster ceph -i 0 (PID: 111179) UID: 0 2023-08-01T19:55:32.844 INFO:tasks.ceph.osd.1.smithi101.stderr:2023-08-01T19:55:32.842+0000 7fb0cb7f6700 -1 received signal: Hangup from /usr/bin/python3 /bin/daemon-helper kill ceph-osd -f --cluster ceph -i 1 (PID: 111141) UID: 0 2023-08-01T19:55:32.892 INFO:teuthology.orchestra.run.smithi006.stdout:osd.0: {} 2023-08-01T19:55:32.910 INFO:teuthology.orchestra.run.smithi155.stdout:{ 2023-08-01T19:55:32.910 INFO:teuthology.orchestra.run.smithi155.stdout: "ops": [ 2023-08-01T19:55:32.911 INFO:teuthology.orchestra.run.smithi155.stdout: { 2023-08-01T19:55:32.911 INFO:teuthology.orchestra.run.smithi155.stdout: "description": "osd_op(client.4668.0:149209 5.0 5:081e8005:::benchmark_data_smithi006_114134_object15548:head [delete] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e48)", 2023-08-01T19:55:32.911 INFO:teuthology.orchestra.run.smithi155.stdout: "initiated_at": "2023-08-01T19:55:32.903369+0000", 2023-08-01T19:55:32.911 INFO:teuthology.orchestra.run.smithi155.stdout: "age": 0.0062175399999999997, 2023-08-01T19:55:32.911 INFO:teuthology.orchestra.run.smithi155.stdout: "duration": 0.006236424, 2023-08-01T19:55:32.911 INFO:teuthology.orchestra.run.smithi155.stdout: "type_data": { 2023-08-01T19:55:32.912 INFO:teuthology.orchestra.run.smithi155.stdout: "flag_point": "waiting for sub ops", 2023-08-01T19:55:32.912 INFO:teuthology.orchestra.run.smithi155.stdout: "client_info": { 2023-08-01T19:55:32.912 INFO:teuthology.orchestra.run.smithi155.stdout: "client": "client.4668", 2023-08-01T19:55:32.912 INFO:teuthology.orchestra.run.smithi155.stdout: "client_addr": "172.21.15.6:0/1709472247", 2023-08-01T19:55:32.912 INFO:teuthology.orchestra.run.smithi155.stdout: "tid": 149209 2023-08-01T19:55:32.912 INFO:teuthology.orchestra.run.smithi155.stdout: }, 2023-08-01T19:55:32.912 INFO:teuthology.orchestra.run.smithi155.stdout: "events": [ 2023-08-01T19:55:32.913 INFO:teuthology.orchestra.run.smithi155.stdout: { 2023-08-01T19:55:32.913 INFO:teuthology.orchestra.run.smithi155.stdout: "event": "initiated", 2023-08-01T19:55:32.913 INFO:teuthology.orchestra.run.smithi155.stdout: "time": "2023-08-01T19:55:32.903369+0000", 2023-08-01T19:55:32.913 INFO:teuthology.orchestra.run.smithi155.stdout: "duration": 0 2023-08-01T19:55:32.913 INFO:teuthology.orchestra.run.smithi155.stdout: }, 2023-08-01T19:55:32.913 INFO:teuthology.orchestra.run.smithi155.stdout: { 2023-08-01T19:55:32.913 INFO:teuthology.orchestra.run.smithi155.stdout: "event": "throttled", 2023-08-01T19:55:32.913 INFO:teuthology.orchestra.run.smithi155.stdout: "time": "2023-08-01T19:55:32.903369+0000", 2023-08-01T19:55:32.914 INFO:teuthology.orchestra.run.smithi155.stdout: "duration": 0 2023-08-01T19:55:32.914 INFO:teuthology.orchestra.run.smithi155.stdout: }, 2023-08-01T19:55:32.914 INFO:teuthology.orchestra.run.smithi155.stdout: { 2023-08-01T19:55:32.914 INFO:teuthology.orchestra.run.smithi155.stdout: "event": "header_read", 2023-08-01T19:55:32.914 INFO:teuthology.orchestra.run.smithi155.stdout: "time": "2023-08-01T19:55:32.903368+0000", 2023-08-01T19:55:32.914 INFO:teuthology.orchestra.run.smithi155.stdout: "duration": 4294967295.999999 2023-08-01T19:55:32.914 INFO:teuthology.orchestra.run.smithi155.stdout: }, 2023-08-01T19:55:32.915 INFO:teuthology.orchestra.run.smithi155.stdout: { 2023-08-01T19:55:32.915 INFO:teuthology.orchestra.run.smithi155.stdout: "event": "all_read", 2023-08-01T19:55:32.915 INFO:teuthology.orchestra.run.smithi155.stdout: "time": "2023-08-01T19:55:32.903372+0000", 2023-08-01T19:55:32.915 INFO:teuthology.orchestra.run.smithi155.stdout: "duration": 4.5379999999999996e-06 2023-08-01T19:55:32.915 INFO:teuthology.orchestra.run.smithi155.stdout: }, 2023-08-01T19:55:32.915 INFO:teuthology.orchestra.run.smithi155.stdout: { 2023-08-01T19:55:32.915 INFO:teuthology.orchestra.run.smithi155.stdout: "event": "dispatched", 2023-08-01T19:55:32.915 INFO:teuthology.orchestra.run.smithi155.stdout: "time": "2023-08-01T19:55:32.903383+0000", 2023-08-01T19:55:32.916 INFO:teuthology.orchestra.run.smithi155.stdout: "duration": 1.0730000000000001e-05 2023-08-01T19:55:32.916 INFO:teuthology.orchestra.run.smithi155.stdout: }, 2023-08-01T19:55:32.916 INFO:teuthology.orchestra.run.smithi155.stdout: { 2023-08-01T19:55:32.916 INFO:teuthology.orchestra.run.smithi155.stdout: "event": "queued_for_pg", 2023-08-01T19:55:32.916 INFO:teuthology.orchestra.run.smithi155.stdout: "time": "2023-08-01T19:55:32.903388+0000", 2023-08-01T19:55:32.916 INFO:teuthology.orchestra.run.smithi155.stdout: "duration": 5.4410000000000001e-06 2023-08-01T19:55:32.916 INFO:teuthology.orchestra.run.smithi155.stdout: }, 2023-08-01T19:55:32.917 INFO:teuthology.orchestra.run.smithi155.stdout: { 2023-08-01T19:55:32.917 INFO:teuthology.orchestra.run.smithi155.stdout: "event": "reached_pg", 2023-08-01T19:55:32.917 INFO:teuthology.orchestra.run.smithi155.stdout: "time": "2023-08-01T19:55:32.903417+0000", 2023-08-01T19:55:32.917 INFO:teuthology.orchestra.run.smithi155.stdout: "duration": 2.8348e-05 2023-08-01T19:55:32.917 INFO:teuthology.orchestra.run.smithi155.stdout: }, 2023-08-01T19:55:32.917 INFO:teuthology.orchestra.run.smithi155.stdout: { 2023-08-01T19:55:32.917 INFO:teuthology.orchestra.run.smithi155.stdout: "event": "started", 2023-08-01T19:55:32.918 INFO:teuthology.orchestra.run.smithi155.stdout: "time": "2023-08-01T19:55:32.903509+0000", 2023-08-01T19:55:32.918 INFO:teuthology.orchestra.run.smithi155.stdout: "duration": 9.2410000000000005e-05 2023-08-01T19:55:32.918 INFO:teuthology.orchestra.run.smithi155.stdout: }, 2023-08-01T19:55:32.918 INFO:teuthology.orchestra.run.smithi155.stdout: { 2023-08-01T19:55:32.918 INFO:teuthology.orchestra.run.smithi155.stdout: "event": "waiting for subops from 0", 2023-08-01T19:55:32.919 INFO:teuthology.orchestra.run.smithi155.stdout: "time": "2023-08-01T19:55:32.903585+0000", 2023-08-01T19:55:32.919 INFO:teuthology.orchestra.run.smithi155.stdout: "duration": 7.5578e-05 2023-08-01T19:55:32.919 INFO:teuthology.orchestra.run.smithi155.stdout: }, 2023-08-01T19:55:32.919 INFO:teuthology.orchestra.run.smithi155.stdout: { 2023-08-01T19:55:32.919 INFO:teuthology.orchestra.run.smithi155.stdout: "event": "op_commit", 2023-08-01T19:55:32.919 INFO:teuthology.orchestra.run.smithi155.stdout: "time": "2023-08-01T19:55:32.908582+0000", 2023-08-01T19:55:32.919 INFO:teuthology.orchestra.run.smithi155.stdout: "duration": 0.0049972310000000004 2023-08-01T19:55:32.920 INFO:teuthology.orchestra.run.smithi155.stdout: } 2023-08-01T19:55:32.920 INFO:teuthology.orchestra.run.smithi155.stdout: ] 2023-08-01T19:55:32.920 INFO:teuthology.orchestra.run.smithi155.stdout: } 2023-08-01T19:55:32.920 INFO:teuthology.orchestra.run.smithi155.stdout: }, 2023-08-01T19:55:32.920 INFO:teuthology.orchestra.run.smithi155.stdout: { 2023-08-01T19:55:32.920 INFO:teuthology.orchestra.run.smithi155.stdout: "description": "osd_op(client.4668.0:149210 5.8 5:115d95e9:::benchmark_data_smithi006_114134_object15549:head [delete] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e48)", 2023-08-01T19:55:32.920 INFO:teuthology.orchestra.run.smithi155.stdout: "initiated_at": "2023-08-01T19:55:32.903404+0000", 2023-08-01T19:55:32.921 INFO:teuthology.orchestra.run.smithi155.stdout: "age": 0.0061824829999999999, 2023-08-01T19:55:32.921 INFO:teuthology.orchestra.run.smithi155.stdout: "duration": 0.0062563319999999999, 2023-08-01T19:55:32.921 INFO:teuthology.orchestra.run.smithi155.stdout: "type_data": { 2023-08-01T19:55:32.921 INFO:teuthology.orchestra.run.smithi155.stdout: "flag_point": "waiting for sub ops", 2023-08-01T19:55:32.921 INFO:teuthology.orchestra.run.smithi155.stdout: "client_info": { 2023-08-01T19:55:32.921 INFO:teuthology.orchestra.run.smithi155.stdout: "client": "client.4668", 2023-08-01T19:55:32.921 INFO:teuthology.orchestra.run.smithi155.stdout: "client_addr": "172.21.15.6:0/1709472247", 2023-08-01T19:55:32.922 INFO:teuthology.orchestra.run.smithi155.stdout: "tid": 149210 2023-08-01T19:55:32.922 INFO:teuthology.orchestra.run.smithi155.stdout: }, 2023-08-01T19:55:32.922 INFO:teuthology.orchestra.run.smithi155.stdout: "events": [ 2023-08-01T19:55:32.922 INFO:teuthology.orchestra.run.smithi155.stdout: { 2023-08-01T19:55:32.922 INFO:teuthology.orchestra.run.smithi155.stdout: "event": "initiated", 2023-08-01T19:55:32.922 INFO:teuthology.orchestra.run.smithi155.stdout: "time": "2023-08-01T19:55:32.903404+0000", 2023-08-01T19:55:32.922 INFO:teuthology.orchestra.run.smithi155.stdout: "duration": 0 2023-08-01T19:55:32.923 INFO:teuthology.orchestra.run.smithi155.stdout: }, 2023-08-01T19:55:32.923 INFO:teuthology.orchestra.run.smithi155.stdout: { 2023-08-01T19:55:32.923 INFO:teuthology.orchestra.run.smithi155.stdout: "event": "throttled", 2023-08-01T19:55:32.923 INFO:teuthology.orchestra.run.smithi155.stdout: "time": "2023-08-01T19:55:32.903404+0000", 2023-08-01T19:55:32.923 INFO:teuthology.orchestra.run.smithi155.stdout: "duration": 0 2023-08-01T19:55:32.923 INFO:teuthology.orchestra.run.smithi155.stdout: }, 2023-08-01T19:55:32.923 INFO:teuthology.orchestra.run.smithi155.stdout: { 2023-08-01T19:55:32.923 INFO:teuthology.orchestra.run.smithi155.stdout: "event": "header_read", 2023-08-01T19:55:32.924 INFO:teuthology.orchestra.run.smithi155.stdout: "time": "2023-08-01T19:55:32.903403+0000", 2023-08-01T19:55:32.924 INFO:teuthology.orchestra.run.smithi155.stdout: "duration": 4294967295.9999995 2023-08-01T19:55:32.924 INFO:teuthology.orchestra.run.smithi155.stdout: }, 2023-08-01T19:55:32.924 INFO:teuthology.orchestra.run.smithi155.stdout: { 2023-08-01T19:55:32.924 INFO:teuthology.orchestra.run.smithi155.stdout: "event": "all_read", 2023-08-01T19:55:32.924 INFO:teuthology.orchestra.run.smithi155.stdout: "time": "2023-08-01T19:55:32.903406+0000", 2023-08-01T19:55:32.925 INFO:teuthology.orchestra.run.smithi155.stdout: "duration": 3.3340000000000002e-06 2023-08-01T19:55:32.925 INFO:teuthology.orchestra.run.smithi155.stdout: }, 2023-08-01T19:55:32.925 INFO:teuthology.orchestra.run.smithi155.stdout: { 2023-08-01T19:55:32.925 INFO:teuthology.orchestra.run.smithi155.stdout: "event": "dispatched", 2023-08-01T19:55:32.925 INFO:teuthology.orchestra.run.smithi155.stdout: "time": "2023-08-01T19:55:32.903414+0000", 2023-08-01T19:55:32.926 INFO:teuthology.orchestra.run.smithi155.stdout: "duration": 7.2389999999999996e-06 2023-08-01T19:55:32.926 INFO:teuthology.orchestra.run.smithi155.stdout: }, 2023-08-01T19:55:32.926 INFO:teuthology.orchestra.run.smithi155.stdout: { 2023-08-01T19:55:32.926 INFO:teuthology.orchestra.run.smithi155.stdout: "event": "queued_for_pg", 2023-08-01T19:55:32.926 INFO:teuthology.orchestra.run.smithi155.stdout: "time": "2023-08-01T19:55:32.903418+0000", 2023-08-01T19:55:32.926 INFO:teuthology.orchestra.run.smithi155.stdout: "duration": 4.2749999999999997e-06 2023-08-01T19:55:32.926 INFO:teuthology.orchestra.run.smithi155.stdout: }, 2023-08-01T19:55:32.927 INFO:teuthology.orchestra.run.smithi155.stdout: { 2023-08-01T19:55:32.928 INFO:teuthology.orchestra.run.smithi155.stdout: "event": "reached_pg", 2023-08-01T19:55:32.928 INFO:teuthology.orchestra.run.smithi155.stdout: "time": "2023-08-01T19:55:32.903444+0000", 2023-08-01T19:55:32.928 INFO:teuthology.orchestra.run.smithi155.stdout: "duration": 2.6058999999999999e-05 2023-08-01T19:55:32.928 INFO:teuthology.orchestra.run.smithi155.stdout: }, 2023-08-01T19:55:32.928 INFO:teuthology.orchestra.run.smithi155.stdout: { 2023-08-01T19:55:32.929 INFO:teuthology.orchestra.run.smithi155.stdout: "event": "started", 2023-08-01T19:55:32.929 INFO:teuthology.orchestra.run.smithi155.stdout: "time": "2023-08-01T19:55:32.903546+0000", 2023-08-01T19:55:32.929 INFO:teuthology.orchestra.run.smithi155.stdout: "duration": 0.000102129 2023-08-01T19:55:32.929 INFO:teuthology.orchestra.run.smithi155.stdout: }, 2023-08-01T19:55:32.929 INFO:teuthology.orchestra.run.smithi155.stdout: { 2023-08-01T19:55:32.929 INFO:teuthology.orchestra.run.smithi155.stdout: "event": "waiting for subops from 0", 2023-08-01T19:55:32.930 INFO:teuthology.orchestra.run.smithi155.stdout: "time": "2023-08-01T19:55:32.903640+0000", 2023-08-01T19:55:32.930 INFO:teuthology.orchestra.run.smithi155.stdout: "duration": 9.3703999999999996e-05 2023-08-01T19:55:32.930 INFO:teuthology.orchestra.run.smithi155.stdout: }, 2023-08-01T19:55:32.930 INFO:teuthology.orchestra.run.smithi155.stdout: { 2023-08-01T19:55:32.930 INFO:teuthology.orchestra.run.smithi155.stdout: "event": "op_commit", 2023-08-01T19:55:32.930 INFO:teuthology.orchestra.run.smithi155.stdout: "time": "2023-08-01T19:55:32.908684+0000", 2023-08-01T19:55:32.930 INFO:teuthology.orchestra.run.smithi155.stdout: "duration": 0.0050446919999999999 2023-08-01T19:55:32.930 INFO:teuthology.orchestra.run.smithi155.stdout: } 2023-08-01T19:55:32.931 INFO:teuthology.orchestra.run.smithi155.stdout: ] 2023-08-01T19:55:32.931 INFO:teuthology.orchestra.run.smithi155.stdout: } 2023-08-01T19:55:32.931 INFO:teuthology.orchestra.run.smithi155.stdout: }, 2023-08-01T19:55:32.931 INFO:teuthology.orchestra.run.smithi155.stdout: { 2023-08-01T19:55:32.931 INFO:teuthology.orchestra.run.smithi155.stdout: "description": "osd_op(client.4668.0:149217 5.0 5:01c44abf:::benchmark_data_smithi006_114134_object15556:head [delete] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e48)", 2023-08-01T19:55:32.931 INFO:teuthology.orchestra.run.smithi155.stdout: "initiated_at": "2023-08-01T19:55:32.907299+0000", 2023-08-01T19:55:32.931 INFO:teuthology.orchestra.run.smithi155.stdout: "age": 0.002287243, 2023-08-01T19:55:32.931 INFO:teuthology.orchestra.run.smithi155.stdout: "duration": 0.002410344, 2023-08-01T19:55:32.932 INFO:teuthology.orchestra.run.smithi155.stdout: "type_data": { 2023-08-01T19:55:32.932 INFO:teuthology.orchestra.run.smithi155.stdout: "flag_point": "waiting for sub ops", 2023-08-01T19:55:32.932 INFO:teuthology.orchestra.run.smithi155.stdout: "client_info": { 2023-08-01T19:55:32.932 INFO:teuthology.orchestra.run.smithi155.stdout: "client": "client.4668", 2023-08-01T19:55:32.932 INFO:teuthology.orchestra.run.smithi155.stdout: "client_addr": "172.21.15.6:0/1709472247", 2023-08-01T19:55:32.932 INFO:teuthology.orchestra.run.smithi155.stdout: "tid": 149217 2023-08-01T19:55:32.932 INFO:teuthology.orchestra.run.smithi155.stdout: }, 2023-08-01T19:55:32.932 INFO:teuthology.orchestra.run.smithi155.stdout: "events": [ 2023-08-01T19:55:32.933 INFO:teuthology.orchestra.run.smithi155.stdout: { 2023-08-01T19:55:32.933 INFO:teuthology.orchestra.run.smithi155.stdout: "event": "initiated", 2023-08-01T19:55:32.933 INFO:teuthology.orchestra.run.smithi155.stdout: "time": "2023-08-01T19:55:32.907299+0000", 2023-08-01T19:55:32.933 INFO:teuthology.orchestra.run.smithi155.stdout: "duration": 0 2023-08-01T19:55:32.933 INFO:teuthology.orchestra.run.smithi155.stdout: }, 2023-08-01T19:55:32.933 INFO:teuthology.orchestra.run.smithi155.stdout: { 2023-08-01T19:55:32.933 INFO:teuthology.orchestra.run.smithi155.stdout: "event": "throttled", 2023-08-01T19:55:32.934 INFO:teuthology.orchestra.run.smithi155.stdout: "time": "2023-08-01T19:55:32.907299+0000", 2023-08-01T19:55:32.934 INFO:teuthology.orchestra.run.smithi155.stdout: "duration": 0 2023-08-01T19:55:32.934 INFO:teuthology.orchestra.run.smithi155.stdout: }, 2023-08-01T19:55:32.934 INFO:teuthology.orchestra.run.smithi155.stdout: { 2023-08-01T19:55:32.934 INFO:teuthology.orchestra.run.smithi155.stdout: "event": "header_read", 2023-08-01T19:55:32.934 INFO:teuthology.orchestra.run.smithi155.stdout: "time": "2023-08-01T19:55:32.907298+0000", 2023-08-01T19:55:32.934 INFO:teuthology.orchestra.run.smithi155.stdout: "duration": 4294967295.9999995 2023-08-01T19:55:32.934 INFO:teuthology.orchestra.run.smithi155.stdout: }, 2023-08-01T19:55:32.935 INFO:teuthology.orchestra.run.smithi155.stdout: { 2023-08-01T19:55:32.935 INFO:teuthology.orchestra.run.smithi155.stdout: "event": "all_read", 2023-08-01T19:55:32.935 INFO:teuthology.orchestra.run.smithi155.stdout: "time": "2023-08-01T19:55:32.907302+0000", 2023-08-01T19:55:32.935 INFO:teuthology.orchestra.run.smithi155.stdout: "duration": 4.313e-06 2023-08-01T19:55:32.935 INFO:teuthology.orchestra.run.smithi155.stdout: }, 2023-08-01T19:55:32.935 INFO:teuthology.orchestra.run.smithi155.stdout: { 2023-08-01T19:55:32.935 INFO:teuthology.orchestra.run.smithi155.stdout: "event": "dispatched", 2023-08-01T19:55:32.935 INFO:teuthology.orchestra.run.smithi155.stdout: "time": "2023-08-01T19:55:32.907313+0000", 2023-08-01T19:55:32.935 INFO:teuthology.orchestra.run.smithi155.stdout: "duration": 1.0813e-05 2023-08-01T19:55:32.936 INFO:teuthology.orchestra.run.smithi155.stdout: }, 2023-08-01T19:55:32.936 INFO:teuthology.orchestra.run.smithi155.stdout: { 2023-08-01T19:55:32.936 INFO:teuthology.orchestra.run.smithi155.stdout: "event": "queued_for_pg", 2023-08-01T19:55:32.936 INFO:teuthology.orchestra.run.smithi155.stdout: "time": "2023-08-01T19:55:32.907319+0000", 2023-08-01T19:55:32.936 INFO:teuthology.orchestra.run.smithi155.stdout: "duration": 5.4430000000000002e-06 2023-08-01T19:55:32.936 INFO:teuthology.orchestra.run.smithi155.stdout: }, 2023-08-01T19:55:32.936 INFO:teuthology.orchestra.run.smithi155.stdout: { 2023-08-01T19:55:32.937 INFO:teuthology.orchestra.run.smithi155.stdout: "event": "reached_pg", 2023-08-01T19:55:32.937 INFO:teuthology.orchestra.run.smithi155.stdout: "time": "2023-08-01T19:55:32.907360+0000", 2023-08-01T19:55:32.937 INFO:teuthology.orchestra.run.smithi155.stdout: "duration": 4.1489000000000002e-05 2023-08-01T19:55:32.937 INFO:teuthology.orchestra.run.smithi155.stdout: }, 2023-08-01T19:55:32.937 INFO:teuthology.orchestra.run.smithi155.stdout: { 2023-08-01T19:55:32.937 INFO:teuthology.orchestra.run.smithi155.stdout: "event": "started", 2023-08-01T19:55:32.937 INFO:teuthology.orchestra.run.smithi155.stdout: "time": "2023-08-01T19:55:32.907429+0000", 2023-08-01T19:55:32.937 INFO:teuthology.orchestra.run.smithi155.stdout: "duration": 6.9197999999999997e-05 2023-08-01T19:55:32.938 INFO:teuthology.orchestra.run.smithi155.stdout: }, 2023-08-01T19:55:32.938 INFO:teuthology.orchestra.run.smithi155.stdout: { 2023-08-01T19:55:32.938 INFO:teuthology.orchestra.run.smithi155.stdout: "event": "waiting for subops from 0", 2023-08-01T19:55:32.938 INFO:teuthology.orchestra.run.smithi155.stdout: "time": "2023-08-01T19:55:32.907496+0000", 2023-08-01T19:55:32.938 INFO:teuthology.orchestra.run.smithi155.stdout: "duration": 6.6465999999999997e-05 2023-08-01T19:55:32.938 INFO:teuthology.orchestra.run.smithi155.stdout: } 2023-08-01T19:55:32.939 INFO:teuthology.orchestra.run.smithi155.stdout: ] 2023-08-01T19:55:32.939 INFO:teuthology.orchestra.run.smithi155.stdout: } 2023-08-01T19:55:32.939 INFO:teuthology.orchestra.run.smithi155.stdout: }, 2023-08-01T19:55:32.939 INFO:teuthology.orchestra.run.smithi155.stdout: { 2023-08-01T19:55:32.939 INFO:teuthology.orchestra.run.smithi155.stdout: "description": "osd_op(client.4668.0:149218 5.8 5:15b84bea:::benchmark_data_smithi006_114134_object15557:head [delete] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e48)", 2023-08-01T19:55:32.940 INFO:teuthology.orchestra.run.smithi155.stdout: "initiated_at": "2023-08-01T19:55:32.907450+0000", 2023-08-01T19:55:32.940 INFO:teuthology.orchestra.run.smithi155.stdout: "age": 0.0021360810000000002, 2023-08-01T19:55:32.940 INFO:teuthology.orchestra.run.smithi155.stdout: "duration": 0.0023041870000000001, 2023-08-01T19:55:32.940 INFO:teuthology.orchestra.run.smithi155.stdout: "type_data": { 2023-08-01T19:55:32.940 INFO:teuthology.orchestra.run.smithi155.stdout: "flag_point": "waiting for sub ops", 2023-08-01T19:55:32.940 INFO:teuthology.orchestra.run.smithi155.stdout: "client_info": { 2023-08-01T19:55:32.941 INFO:teuthology.orchestra.run.smithi155.stdout: "client": "client.4668", 2023-08-01T19:55:32.941 INFO:teuthology.orchestra.run.smithi155.stdout: "client_addr": "172.21.15.6:0/1709472247", 2023-08-01T19:55:32.941 INFO:teuthology.orchestra.run.smithi155.stdout: "tid": 149218 2023-08-01T19:55:32.941 INFO:teuthology.orchestra.run.smithi155.stdout: }, 2023-08-01T19:55:32.942 INFO:teuthology.orchestra.run.smithi155.stdout: "events": [ 2023-08-01T19:55:32.942 INFO:teuthology.orchestra.run.smithi155.stdout: { 2023-08-01T19:55:32.942 INFO:teuthology.orchestra.run.smithi155.stdout: "event": "initiated", 2023-08-01T19:55:32.942 INFO:teuthology.orchestra.run.smithi155.stdout: "time": "2023-08-01T19:55:32.907450+0000", 2023-08-01T19:55:32.943 INFO:teuthology.orchestra.run.smithi155.stdout: "duration": 0 2023-08-01T19:55:32.943 INFO:teuthology.orchestra.run.smithi155.stdout: }, 2023-08-01T19:55:32.943 INFO:teuthology.orchestra.run.smithi155.stdout: { 2023-08-01T19:55:32.943 INFO:teuthology.orchestra.run.smithi155.stdout: "event": "throttled", 2023-08-01T19:55:32.943 INFO:teuthology.orchestra.run.smithi155.stdout: "time": "2023-08-01T19:55:32.907450+0000", 2023-08-01T19:55:32.944 INFO:teuthology.orchestra.run.smithi155.stdout: "duration": 0 2023-08-01T19:55:32.944 INFO:teuthology.orchestra.run.smithi155.stdout: }, 2023-08-01T19:55:32.944 INFO:teuthology.orchestra.run.smithi155.stdout: { 2023-08-01T19:55:32.944 INFO:teuthology.orchestra.run.smithi155.stdout: "event": "header_read", 2023-08-01T19:55:32.944 INFO:teuthology.orchestra.run.smithi155.stdout: "time": "2023-08-01T19:55:32.907449+0000", 2023-08-01T19:55:32.944 INFO:teuthology.orchestra.run.smithi155.stdout: "duration": 4294967295.999999 2023-08-01T19:55:32.945 INFO:teuthology.orchestra.run.smithi155.stdout: }, 2023-08-01T19:55:32.945 INFO:teuthology.orchestra.run.smithi155.stdout: { 2023-08-01T19:55:32.945 INFO:teuthology.orchestra.run.smithi155.stdout: "event": "all_read", 2023-08-01T19:55:32.945 INFO:teuthology.orchestra.run.smithi155.stdout: "time": "2023-08-01T19:55:32.907453+0000", 2023-08-01T19:55:32.945 INFO:teuthology.orchestra.run.smithi155.stdout: "duration": 4.0969999999999999e-06 2023-08-01T19:55:32.945 INFO:teuthology.orchestra.run.smithi155.stdout: }, 2023-08-01T19:55:32.946 INFO:teuthology.orchestra.run.smithi155.stdout: { 2023-08-01T19:55:32.946 INFO:teuthology.orchestra.run.smithi155.stdout: "event": "dispatched", 2023-08-01T19:55:32.946 INFO:teuthology.orchestra.run.smithi155.stdout: "time": "2023-08-01T19:55:32.907461+0000", 2023-08-01T19:55:32.946 INFO:teuthology.orchestra.run.smithi155.stdout: "duration": 7.9710000000000004e-06 2023-08-01T19:55:32.946 INFO:teuthology.orchestra.run.smithi155.stdout: }, 2023-08-01T19:55:32.946 INFO:teuthology.orchestra.run.smithi155.stdout: { 2023-08-01T19:55:32.946 INFO:teuthology.orchestra.run.smithi155.stdout: "event": "queued_for_pg", 2023-08-01T19:55:32.947 INFO:teuthology.orchestra.run.smithi155.stdout: "time": "2023-08-01T19:55:32.907466+0000", 2023-08-01T19:55:32.947 INFO:teuthology.orchestra.run.smithi155.stdout: "duration": 4.6199999999999998e-06 2023-08-01T19:55:32.947 INFO:teuthology.orchestra.run.smithi155.stdout: }, 2023-08-01T19:55:32.947 INFO:teuthology.orchestra.run.smithi155.stdout: { 2023-08-01T19:55:32.947 INFO:teuthology.orchestra.run.smithi155.stdout: "event": "reached_pg", 2023-08-01T19:55:32.947 INFO:teuthology.orchestra.run.smithi155.stdout: "time": "2023-08-01T19:55:32.907490+0000", 2023-08-01T19:55:32.947 INFO:teuthology.orchestra.run.smithi155.stdout: "duration": 2.3597000000000001e-05 2023-08-01T19:55:32.948 INFO:teuthology.orchestra.run.smithi155.stdout: }, 2023-08-01T19:55:32.948 INFO:teuthology.orchestra.run.smithi155.stdout: { 2023-08-01T19:55:32.948 INFO:teuthology.orchestra.run.smithi155.stdout: "event": "started", 2023-08-01T19:55:32.948 INFO:teuthology.orchestra.run.smithi155.stdout: "time": "2023-08-01T19:55:32.907560+0000", 2023-08-01T19:55:32.948 INFO:teuthology.orchestra.run.smithi155.stdout: "duration": 7.0674999999999997e-05 2023-08-01T19:55:32.948 INFO:teuthology.orchestra.run.smithi155.stdout: }, 2023-08-01T19:55:32.948 INFO:teuthology.orchestra.run.smithi155.stdout: { 2023-08-01T19:55:32.948 INFO:teuthology.orchestra.run.smithi155.stdout: "event": "waiting for subops from 0", 2023-08-01T19:55:32.949 INFO:teuthology.orchestra.run.smithi155.stdout: "time": "2023-08-01T19:55:32.907629+0000", 2023-08-01T19:55:32.949 INFO:teuthology.orchestra.run.smithi155.stdout: "duration": 6.9134999999999995e-05 2023-08-01T19:55:32.949 INFO:teuthology.orchestra.run.smithi155.stdout: } 2023-08-01T19:55:32.949 INFO:teuthology.orchestra.run.smithi155.stdout: ] 2023-08-01T19:55:32.949 INFO:teuthology.orchestra.run.smithi155.stdout: } 2023-08-01T19:55:32.949 INFO:teuthology.orchestra.run.smithi155.stdout: }, 2023-08-01T19:55:32.949 INFO:teuthology.orchestra.run.smithi155.stdout: { 2023-08-01T19:55:32.950 INFO:teuthology.orchestra.run.smithi155.stdout: "description": "osd_op(client.4668.0:149206 5.4 5:2dc49a7f:::benchmark_data_smithi006_114134_object15545:head [delete] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e48)", 2023-08-01T19:55:32.950 INFO:teuthology.orchestra.run.smithi155.stdout: "initiated_at": "2023-08-01T19:55:32.902023+0000", 2023-08-01T19:55:32.950 INFO:teuthology.orchestra.run.smithi155.stdout: "age": 0.007563078, 2023-08-01T19:55:32.950 INFO:teuthology.orchestra.run.smithi155.stdout: "duration": 0.0077756570000000001, 2023-08-01T19:55:32.950 INFO:teuthology.orchestra.run.smithi155.stdout: "type_data": { 2023-08-01T19:55:32.950 INFO:teuthology.orchestra.run.smithi155.stdout: "flag_point": "waiting for sub ops", 2023-08-01T19:55:32.950 INFO:teuthology.orchestra.run.smithi155.stdout: "client_info": { 2023-08-01T19:55:32.950 INFO:teuthology.orchestra.run.smithi155.stdout: "client": "client.4668", 2023-08-01T19:55:32.951 INFO:teuthology.orchestra.run.smithi155.stdout: "client_addr": "172.21.15.6:0/1709472247", 2023-08-01T19:55:32.951 INFO:teuthology.orchestra.run.smithi155.stdout: "tid": 149206 2023-08-01T19:55:32.951 INFO:teuthology.orchestra.run.smithi155.stdout: }, 2023-08-01T19:55:32.951 INFO:teuthology.orchestra.run.smithi155.stdout: "events": [ 2023-08-01T19:55:32.951 INFO:teuthology.orchestra.run.smithi155.stdout: { 2023-08-01T19:55:32.951 INFO:teuthology.orchestra.run.smithi155.stdout: "event": "initiated", 2023-08-01T19:55:32.951 INFO:teuthology.orchestra.run.smithi155.stdout: "time": "2023-08-01T19:55:32.902023+0000", 2023-08-01T19:55:32.951 INFO:teuthology.orchestra.run.smithi155.stdout: "duration": 0 2023-08-01T19:55:32.952 INFO:teuthology.orchestra.run.smithi155.stdout: }, 2023-08-01T19:55:32.952 INFO:teuthology.orchestra.run.smithi155.stdout: { 2023-08-01T19:55:32.952 INFO:teuthology.orchestra.run.smithi155.stdout: "event": "throttled", 2023-08-01T19:55:32.952 INFO:teuthology.orchestra.run.smithi155.stdout: "time": "2023-08-01T19:55:32.902023+0000", 2023-08-01T19:55:32.952 INFO:teuthology.orchestra.run.smithi155.stdout: "duration": 0 2023-08-01T19:55:32.952 INFO:teuthology.orchestra.run.smithi155.stdout: }, 2023-08-01T19:55:32.952 INFO:teuthology.orchestra.run.smithi155.stdout: { 2023-08-01T19:55:32.953 INFO:teuthology.orchestra.run.smithi155.stdout: "event": "header_read", 2023-08-01T19:55:32.953 INFO:teuthology.orchestra.run.smithi155.stdout: "time": "2023-08-01T19:55:32.902022+0000", 2023-08-01T19:55:32.953 INFO:teuthology.orchestra.run.smithi155.stdout: "duration": 4294967295.999999 2023-08-01T19:55:32.953 INFO:teuthology.orchestra.run.smithi155.stdout: }, 2023-08-01T19:55:32.953 INFO:teuthology.orchestra.run.smithi155.stdout: { 2023-08-01T19:55:32.953 INFO:teuthology.orchestra.run.smithi155.stdout: "event": "all_read", 2023-08-01T19:55:32.953 INFO:teuthology.orchestra.run.smithi155.stdout: "time": "2023-08-01T19:55:32.902028+0000", 2023-08-01T19:55:32.954 INFO:teuthology.orchestra.run.smithi155.stdout: "duration": 5.4960000000000004e-06 2023-08-01T19:55:32.954 INFO:teuthology.orchestra.run.smithi155.stdout: }, 2023-08-01T19:55:32.954 INFO:teuthology.orchestra.run.smithi155.stdout: { 2023-08-01T19:55:32.954 INFO:teuthology.orchestra.run.smithi155.stdout: "event": "dispatched", 2023-08-01T19:55:32.954 INFO:teuthology.orchestra.run.smithi155.stdout: "time": "2023-08-01T19:55:32.902040+0000", 2023-08-01T19:55:32.954 INFO:teuthology.orchestra.run.smithi155.stdout: "duration": 1.2714000000000001e-05 2023-08-01T19:55:32.954 INFO:teuthology.orchestra.run.smithi155.stdout: }, 2023-08-01T19:55:32.955 INFO:teuthology.orchestra.run.smithi155.stdout: { 2023-08-01T19:55:32.955 INFO:teuthology.orchestra.run.smithi155.stdout: "event": "queued_for_pg", 2023-08-01T19:55:32.955 INFO:teuthology.orchestra.run.smithi155.stdout: "time": "2023-08-01T19:55:32.902047+0000", 2023-08-01T19:55:32.955 INFO:teuthology.orchestra.run.smithi155.stdout: "duration": 6.229e-06 2023-08-01T19:55:32.955 INFO:teuthology.orchestra.run.smithi155.stdout: }, 2023-08-01T19:55:32.955 INFO:teuthology.orchestra.run.smithi155.stdout: { 2023-08-01T19:55:32.955 INFO:teuthology.orchestra.run.smithi155.stdout: "event": "reached_pg", 2023-08-01T19:55:32.955 INFO:teuthology.orchestra.run.smithi155.stdout: "time": "2023-08-01T19:55:32.902081+0000", 2023-08-01T19:55:32.956 INFO:teuthology.orchestra.run.smithi155.stdout: "duration": 3.4164e-05 2023-08-01T19:55:32.956 INFO:teuthology.orchestra.run.smithi155.stdout: }, 2023-08-01T19:55:32.956 INFO:teuthology.orchestra.run.smithi155.stdout: { 2023-08-01T19:55:32.956 INFO:teuthology.orchestra.run.smithi155.stdout: "event": "started", 2023-08-01T19:55:32.956 INFO:teuthology.orchestra.run.smithi155.stdout: "time": "2023-08-01T19:55:32.902153+0000", 2023-08-01T19:55:32.956 INFO:teuthology.orchestra.run.smithi155.stdout: "duration": 7.2213999999999997e-05 2023-08-01T19:55:32.956 INFO:teuthology.orchestra.run.smithi155.stdout: }, 2023-08-01T19:55:32.957 INFO:teuthology.orchestra.run.smithi155.stdout: { 2023-08-01T19:55:32.957 INFO:teuthology.orchestra.run.smithi155.stdout: "event": "waiting for subops from 0", 2023-08-01T19:55:32.957 INFO:teuthology.orchestra.run.smithi155.stdout: "time": "2023-08-01T19:55:32.902227+0000", 2023-08-01T19:55:32.957 INFO:teuthology.orchestra.run.smithi155.stdout: "duration": 7.4268000000000001e-05 2023-08-01T19:55:32.957 INFO:teuthology.orchestra.run.smithi155.stdout: }, 2023-08-01T19:55:32.957 INFO:teuthology.orchestra.run.smithi155.stdout: { 2023-08-01T19:55:32.957 INFO:teuthology.orchestra.run.smithi155.stdout: "event": "op_commit", 2023-08-01T19:55:32.957 INFO:teuthology.orchestra.run.smithi155.stdout: "time": "2023-08-01T19:55:32.906275+0000", 2023-08-01T19:55:32.958 INFO:teuthology.orchestra.run.smithi155.stdout: "duration": 0.0040476929999999998 2023-08-01T19:55:32.958 INFO:teuthology.orchestra.run.smithi155.stdout: } 2023-08-01T19:55:32.958 INFO:teuthology.orchestra.run.smithi155.stdout: ] 2023-08-01T19:55:32.958 INFO:teuthology.orchestra.run.smithi155.stdout: } 2023-08-01T19:55:32.958 INFO:teuthology.orchestra.run.smithi155.stdout: } 2023-08-01T19:55:32.958 INFO:teuthology.orchestra.run.smithi155.stdout: ], 2023-08-01T19:55:32.958 INFO:teuthology.orchestra.run.smithi155.stdout: "num_ops": 5 2023-08-01T19:55:32.958 INFO:teuthology.orchestra.run.smithi155.stdout:} 2023-08-01T19:55:32.960 INFO:teuthology.orchestra.run.smithi006.stdout:osd.1: {} 2023-08-01T19:55:32.960 INFO:teuthology.orchestra.run.smithi006.stdout:osd.2: {} 2023-08-01T19:55:32.961 DEBUG:teuthology.orchestra.run.smithi155:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 30 ceph --cluster ceph --admin-daemon /var/run/ceph/ceph-osd.2.asok dump_blocked_ops 2023-08-01T19:55:32.961 INFO:tasks.ceph.osd.2.smithi155.stderr:2023-08-01T19:55:32.958+0000 7faa5c6ac700 -1 received signal: Hangup from /usr/bin/python3 /bin/daemon-helper kill ceph-osd -f --cluster ceph -i 2 (PID: 111337) UID: 0 2023-08-01T19:55:32.962 INFO:teuthology.orchestra.run.smithi006.stderr:osd.0: osd_enable_op_tracker = 'false' 2023-08-01T19:55:32.962 INFO:teuthology.orchestra.run.smithi006.stderr:osd.1: osd_enable_op_tracker = 'false' 2023-08-01T19:55:32.962 INFO:teuthology.orchestra.run.smithi006.stderr:osd.2: osd_enable_op_tracker = 'false' 2023-08-01T19:55:33.005 DEBUG:teuthology.orchestra.run.smithi006:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 120 ceph --cluster ceph osd set noscrub 2023-08-01T19:55:33.060 INFO:tasks.ceph.osd.1.smithi101.stderr:2023-08-01T19:55:33.059+0000 7fb0cb7f6700 -1 received signal: Hangup from /usr/bin/python3 /bin/daemon-helper kill ceph-osd -f --cluster ceph -i 1 (PID: 111141) UID: 0 2023-08-01T19:55:33.161 INFO:tasks.ceph.osd.1.smithi101.stderr:2023-08-01T19:55:33.160+0000 7fb0cb7f6700 -1 received signal: Hangup from /usr/bin/python3 /bin/daemon-helper kill ceph-osd -f --cluster ceph -i 1 (PID: 111141) UID: 0 2023-08-01T19:55:33.166 INFO:teuthology.orchestra.run.smithi155.stdout:ERROR: (22) Invalid argument 2023-08-01T19:55:33.166 INFO:teuthology.orchestra.run.smithi155.stdout:op_tracker tracking is not enabled now, so no ops are tracked currently, even those get stuck. Please enable "osd_enable_op_tracker", and the tracker will start to track new ops received afterwards. 2023-08-01T19:55:33.179 DEBUG:teuthology.orchestra.run.smithi155:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 30 ceph --cluster ceph --admin-daemon /var/run/ceph/ceph-osd.2.asok dump_historic_ops 2023-08-01T19:55:33.262 INFO:tasks.ceph.osd.0.smithi008.stderr:2023-08-01T19:55:33.260+0000 7f16a58f4700 -1 received signal: Hangup from /usr/bin/python3 /bin/daemon-helper kill ceph-osd -f --cluster ceph -i 0 (PID: 111179) UID: 0 2023-08-01T19:55:33.348 INFO:teuthology.orchestra.run.smithi155.stdout:ERROR: (22) Invalid argument 2023-08-01T19:55:33.348 INFO:teuthology.orchestra.run.smithi155.stdout:op_tracker tracking is not enabled now, so no ops are tracked currently, even those get stuck. Please enable "osd_enable_op_tracker", and the tracker will start to track new ops received afterwards. 2023-08-01T19:55:33.363 DEBUG:teuthology.orchestra.run.smithi008:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 30 ceph --cluster ceph --admin-daemon /var/run/ceph/ceph-osd.0.asok dump_ops_in_flight 2023-08-01T19:55:33.364 INFO:tasks.ceph.osd.0.smithi008.stderr:2023-08-01T19:55:33.361+0000 7f16a58f4700 -1 received signal: Hangup from /usr/bin/python3 /bin/daemon-helper kill ceph-osd -f --cluster ceph -i 0 (PID: 111179) UID: 0 2023-08-01T19:55:33.463 INFO:tasks.ceph.osd.2.smithi155.stderr:2023-08-01T19:55:33.462+0000 7faa5c6ac700 -1 received signal: Hangup from /usr/bin/python3 /bin/daemon-helper kill ceph-osd -f --cluster ceph -i 2 (PID: 111337) UID: 0 2023-08-01T19:55:33.544 INFO:teuthology.orchestra.run.smithi008.stdout:ERROR: (22) Invalid argument 2023-08-01T19:55:33.545 INFO:teuthology.orchestra.run.smithi008.stdout:op_tracker tracking is not enabled now, so no ops are tracked currently, even those get stuck. Please enable "osd_enable_op_tracker", and the tracker will start to track new ops received afterwards. 2023-08-01T19:55:33.554 DEBUG:teuthology.orchestra.run.smithi008:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 30 ceph --cluster ceph --admin-daemon /var/run/ceph/ceph-osd.0.asok dump_blocked_ops 2023-08-01T19:55:33.598 INFO:tasks.ceph.osd.0.smithi008.stderr:2023-08-01T19:55:33.596+0000 7f16a58f4700 -1 received signal: Hangup from /usr/bin/python3 /bin/daemon-helper kill ceph-osd -f --cluster ceph -i 0 (PID: 111179) UID: 0 2023-08-01T19:55:33.665 INFO:tasks.ceph.osd.1.smithi101.stderr:2023-08-01T19:55:33.664+0000 7fb0cb7f6700 -1 received signal: Hangup from /usr/bin/python3 /bin/daemon-helper kill ceph-osd -f --cluster ceph -i 1 (PID: 111141) UID: 0 2023-08-01T19:55:33.739 INFO:teuthology.orchestra.run.smithi008.stdout:ERROR: (22) Invalid argument 2023-08-01T19:55:33.740 INFO:teuthology.orchestra.run.smithi008.stdout:op_tracker tracking is not enabled now, so no ops are tracked currently, even those get stuck. Please enable "osd_enable_op_tracker", and the tracker will start to track new ops received afterwards. 2023-08-01T19:55:33.751 DEBUG:teuthology.orchestra.run.smithi008:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 30 ceph --cluster ceph --admin-daemon /var/run/ceph/ceph-osd.0.asok dump_historic_ops 2023-08-01T19:55:33.766 INFO:tasks.ceph.osd.1.smithi101.stderr:2023-08-01T19:55:33.765+0000 7fb0cb7f6700 -1 received signal: Hangup from /usr/bin/python3 /bin/daemon-helper kill ceph-osd -f --cluster ceph -i 1 (PID: 111141) UID: 0 2023-08-01T19:55:33.867 INFO:tasks.ceph.osd.2.smithi155.stderr:2023-08-01T19:55:33.865+0000 7faa5c6ac700 -1 received signal: Hangup from /usr/bin/python3 /bin/daemon-helper kill ceph-osd -f --cluster ceph -i 2 (PID: 111337) UID: 0 2023-08-01T19:55:33.968 INFO:tasks.ceph.osd.0.smithi008.stderr:2023-08-01T19:55:33.966+0000 7f16a58f4700 -1 received signal: Hangup from /usr/bin/python3 /bin/daemon-helper kill ceph-osd -f --cluster ceph -i 0 (PID: 111179) UID: 0 2023-08-01T19:55:33.986 INFO:teuthology.orchestra.run.smithi008.stdout:ERROR: (22) Invalid argument 2023-08-01T19:55:33.987 INFO:teuthology.orchestra.run.smithi008.stdout:op_tracker tracking is not enabled now, so no ops are tracked currently, even those get stuck. Please enable "osd_enable_op_tracker", and the tracker will start to track new ops received afterwards. 2023-08-01T19:55:33.991 INFO:teuthology.orchestra.run.smithi006.stderr:noscrub is set 2023-08-01T19:55:33.995 DEBUG:teuthology.orchestra.run.smithi101:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 30 ceph --cluster ceph --admin-daemon /var/run/ceph/ceph-osd.1.asok dump_ops_in_flight 2023-08-01T19:55:34.068 INFO:tasks.ceph.osd.2.smithi155.stderr:2023-08-01T19:55:34.067+0000 7faa5c6ac700 -1 received signal: Hangup from /usr/bin/python3 /bin/daemon-helper kill ceph-osd -f --cluster ceph -i 2 (PID: 111337) UID: 0 2023-08-01T19:55:34.169 INFO:tasks.ceph.osd.1.smithi101.stderr:2023-08-01T19:55:34.168+0000 7fb0cb7f6700 -1 received signal: Hangup from /usr/bin/python3 /bin/daemon-helper kill ceph-osd -f --cluster ceph -i 1 (PID: 111141) UID: 0 2023-08-01T19:55:34.171 INFO:teuthology.orchestra.run.smithi101.stdout:ERROR: (22) Invalid argument 2023-08-01T19:55:34.172 INFO:teuthology.orchestra.run.smithi101.stdout:op_tracker tracking is not enabled now, so no ops are tracked currently, even those get stuck. Please enable "osd_enable_op_tracker", and the tracker will start to track new ops received afterwards. 2023-08-01T19:55:34.184 DEBUG:teuthology.orchestra.run.smithi101:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 30 ceph --cluster ceph --admin-daemon /var/run/ceph/ceph-osd.1.asok dump_blocked_ops 2023-08-01T19:55:34.270 INFO:tasks.ceph.osd.0.smithi008.stderr:2023-08-01T19:55:34.269+0000 7f16a58f4700 -1 received signal: Hangup from /usr/bin/python3 /bin/daemon-helper kill ceph-osd -f --cluster ceph -i 0 (PID: 111179) UID: 0 2023-08-01T19:55:34.371 INFO:tasks.ceph.osd.1.smithi101.stderr:2023-08-01T19:55:34.369+0000 7fb0cb7f6700 -1 received signal: Hangup from /usr/bin/python3 /bin/daemon-helper kill ceph-osd -f --cluster ceph -i 1 (PID: 111141) UID: 0 2023-08-01T19:55:34.377 INFO:teuthology.orchestra.run.smithi101.stdout:ERROR: (22) Invalid argument 2023-08-01T19:55:34.377 INFO:teuthology.orchestra.run.smithi101.stdout:op_tracker tracking is not enabled now, so no ops are tracked currently, even those get stuck. Please enable "osd_enable_op_tracker", and the tracker will start to track new ops received afterwards. 2023-08-01T19:55:34.393 DEBUG:teuthology.orchestra.run.smithi101:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 30 ceph --cluster ceph --admin-daemon /var/run/ceph/ceph-osd.1.asok dump_historic_ops 2023-08-01T19:55:34.477 INFO:tasks.ceph.osd.1.smithi101.stderr:2023-08-01T19:55:34.476+0000 7fb0cb7f6700 -1 received signal: Hangup from /usr/bin/python3 /bin/daemon-helper kill ceph-osd -f --cluster ceph -i 1 (PID: 111141) UID: 0 2023-08-01T19:55:34.573 INFO:tasks.ceph.osd.1.smithi101.stderr:2023-08-01T19:55:34.571+0000 7fb0cb7f6700 -1 received signal: Hangup from /usr/bin/python3 /bin/daemon-helper kill ceph-osd -f --cluster ceph -i 1 (PID: 111141) UID: 0 2023-08-01T19:55:34.595 INFO:teuthology.orchestra.run.smithi101.stdout:ERROR: (22) Invalid argument 2023-08-01T19:55:34.595 INFO:teuthology.orchestra.run.smithi101.stdout:op_tracker tracking is not enabled now, so no ops are tracked currently, even those get stuck. Please enable "osd_enable_op_tracker", and the tracker will start to track new ops received afterwards. 2023-08-01T19:55:34.608 DEBUG:teuthology.orchestra.run.smithi155:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 30 ceph --cluster ceph --admin-daemon /var/run/ceph/ceph-osd.2.asok dump_ops_in_flight 2023-08-01T19:55:34.673 INFO:tasks.ceph.osd.1.smithi101.stderr:2023-08-01T19:55:34.672+0000 7fb0cb7f6700 -1 received signal: Hangup from /usr/bin/python3 /bin/daemon-helper kill ceph-osd -f --cluster ceph -i 1 (PID: 111141) UID: 0 2023-08-01T19:55:34.766 INFO:teuthology.orchestra.run.smithi155.stdout:ERROR: (22) Invalid argument 2023-08-01T19:55:34.766 INFO:teuthology.orchestra.run.smithi155.stdout:op_tracker tracking is not enabled now, so no ops are tracked currently, even those get stuck. Please enable "osd_enable_op_tracker", and the tracker will start to track new ops received afterwards. 2023-08-01T19:55:34.773 INFO:tasks.ceph.osd.1.smithi101.stderr:2023-08-01T19:55:34.772+0000 7fb0cb7f6700 -1 received signal: Hangup from /usr/bin/python3 /bin/daemon-helper kill ceph-osd -f --cluster ceph -i 1 (PID: 111141) UID: 0 2023-08-01T19:55:34.779 DEBUG:teuthology.orchestra.run.smithi155:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 30 ceph --cluster ceph --admin-daemon /var/run/ceph/ceph-osd.2.asok dump_blocked_ops 2023-08-01T19:55:34.874 INFO:tasks.ceph.osd.1.smithi101.stderr:2023-08-01T19:55:34.873+0000 7fb0cb7f6700 -1 received signal: Hangup from /usr/bin/python3 /bin/daemon-helper kill ceph-osd -f --cluster ceph -i 1 (PID: 111141) UID: 0 2023-08-01T19:55:34.955 INFO:teuthology.orchestra.run.smithi155.stdout:ERROR: (22) Invalid argument 2023-08-01T19:55:34.955 INFO:teuthology.orchestra.run.smithi155.stdout:op_tracker tracking is not enabled now, so no ops are tracked currently, even those get stuck. Please enable "osd_enable_op_tracker", and the tracker will start to track new ops received afterwards. 2023-08-01T19:55:34.961 DEBUG:teuthology.orchestra.run.smithi155:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 30 ceph --cluster ceph --admin-daemon /var/run/ceph/ceph-osd.2.asok dump_historic_ops 2023-08-01T19:55:34.962 DEBUG:teuthology.orchestra.run.smithi006:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 120 ceph --cluster ceph -- tell 'osd.*' injectargs --osd_enable_op_tracker=true 2023-08-01T19:55:35.005 INFO:tasks.ceph.osd.2.smithi155.stderr:2023-08-01T19:55:35.004+0000 7faa5c6ac700 -1 received signal: Hangup from /usr/bin/python3 /bin/daemon-helper kill ceph-osd -f --cluster ceph -i 2 (PID: 111337) UID: 0 2023-08-01T19:55:35.076 INFO:tasks.ceph.osd.2.smithi155.stderr:2023-08-01T19:55:35.074+0000 7faa5c6ac700 -1 received signal: Hangup from /usr/bin/python3 /bin/daemon-helper kill ceph-osd -f --cluster ceph -i 2 (PID: 111337) UID: 0 2023-08-01T19:55:35.110 INFO:teuthology.orchestra.run.smithi006.stdout:osd.0: {} 2023-08-01T19:55:35.119 INFO:teuthology.orchestra.run.smithi155.stdout:ERROR: (22) Invalid argument 2023-08-01T19:55:35.119 INFO:teuthology.orchestra.run.smithi155.stdout:op_tracker tracking is not enabled now, so no ops are tracked currently, even those get stuck. Please enable "osd_enable_op_tracker", and the tracker will start to track new ops received afterwards. 2023-08-01T19:55:35.129 INFO:teuthology.orchestra.run.smithi006.stdout:osd.1: {} 2023-08-01T19:55:35.133 DEBUG:teuthology.orchestra.run.smithi008:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 30 ceph --cluster ceph --admin-daemon /var/run/ceph/ceph-osd.0.asok dump_ops_in_flight 2023-08-01T19:55:35.150 INFO:teuthology.orchestra.run.smithi006.stdout:osd.2: {} 2023-08-01T19:55:35.151 INFO:teuthology.orchestra.run.smithi006.stderr:osd.0: osd_enable_op_tracker = 'true' 2023-08-01T19:55:35.152 INFO:teuthology.orchestra.run.smithi006.stderr:osd.1: osd_enable_op_tracker = 'true' 2023-08-01T19:55:35.152 INFO:teuthology.orchestra.run.smithi006.stderr:osd.2: osd_enable_op_tracker = 'true' 2023-08-01T19:55:35.179 INFO:tasks.ceph.osd.0.smithi008.stderr:2023-08-01T19:55:35.178+0000 7f16a58f4700 -1 received signal: Hangup from /usr/bin/python3 /bin/daemon-helper kill ceph-osd -f --cluster ceph -i 0 (PID: 111179) UID: 0 2023-08-01T19:55:35.277 INFO:tasks.ceph.osd.2.smithi155.stderr:2023-08-01T19:55:35.275+0000 7faa5c6ac700 -1 received signal: Hangup from /usr/bin/python3 /bin/daemon-helper kill ceph-osd -f --cluster ceph -i 2 (PID: 111337) UID: 0 2023-08-01T19:55:35.314 INFO:teuthology.orchestra.run.smithi008.stdout:{ 2023-08-01T19:55:35.315 INFO:teuthology.orchestra.run.smithi008.stdout: "ops": [ 2023-08-01T19:55:35.315 INFO:teuthology.orchestra.run.smithi008.stdout: { 2023-08-01T19:55:35.315 INFO:teuthology.orchestra.run.smithi008.stdout: "description": "osd_op(client.4668.0:154102 5.5 5:adbbea33:::benchmark_data_smithi006_114134_object20441:head [delete] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e49)", 2023-08-01T19:55:35.315 INFO:teuthology.orchestra.run.smithi008.stdout: "initiated_at": "2023-08-01T19:55:35.305332+0000", 2023-08-01T19:55:35.315 INFO:teuthology.orchestra.run.smithi008.stdout: "age": 0.0077890859999999998, 2023-08-01T19:55:35.315 INFO:teuthology.orchestra.run.smithi008.stdout: "duration": 0.0078088569999999998, 2023-08-01T19:55:35.316 INFO:teuthology.orchestra.run.smithi008.stdout: "type_data": { 2023-08-01T19:55:35.316 INFO:teuthology.orchestra.run.smithi008.stdout: "flag_point": "waiting for sub ops", 2023-08-01T19:55:35.316 INFO:teuthology.orchestra.run.smithi008.stdout: "client_info": { 2023-08-01T19:55:35.316 INFO:teuthology.orchestra.run.smithi008.stdout: "client": "client.4668", 2023-08-01T19:55:35.316 INFO:teuthology.orchestra.run.smithi008.stdout: "client_addr": "172.21.15.6:0/1709472247", 2023-08-01T19:55:35.316 INFO:teuthology.orchestra.run.smithi008.stdout: "tid": 154102 2023-08-01T19:55:35.316 INFO:teuthology.orchestra.run.smithi008.stdout: }, 2023-08-01T19:55:35.317 INFO:teuthology.orchestra.run.smithi008.stdout: "events": [ 2023-08-01T19:55:35.317 INFO:teuthology.orchestra.run.smithi008.stdout: { 2023-08-01T19:55:35.317 INFO:teuthology.orchestra.run.smithi008.stdout: "event": "initiated", 2023-08-01T19:55:35.317 INFO:teuthology.orchestra.run.smithi008.stdout: "time": "2023-08-01T19:55:35.305332+0000", 2023-08-01T19:55:35.317 INFO:teuthology.orchestra.run.smithi008.stdout: "duration": 0 2023-08-01T19:55:35.317 INFO:teuthology.orchestra.run.smithi008.stdout: }, 2023-08-01T19:55:35.317 INFO:teuthology.orchestra.run.smithi008.stdout: { 2023-08-01T19:55:35.317 INFO:teuthology.orchestra.run.smithi008.stdout: "event": "throttled", 2023-08-01T19:55:35.318 INFO:teuthology.orchestra.run.smithi008.stdout: "time": "2023-08-01T19:55:35.305332+0000", 2023-08-01T19:55:35.318 INFO:teuthology.orchestra.run.smithi008.stdout: "duration": 0 2023-08-01T19:55:35.318 INFO:teuthology.orchestra.run.smithi008.stdout: }, 2023-08-01T19:55:35.318 INFO:teuthology.orchestra.run.smithi008.stdout: { 2023-08-01T19:55:35.318 INFO:teuthology.orchestra.run.smithi008.stdout: "event": "header_read", 2023-08-01T19:55:35.318 INFO:teuthology.orchestra.run.smithi008.stdout: "time": "2023-08-01T19:55:35.305331+0000", 2023-08-01T19:55:35.318 INFO:teuthology.orchestra.run.smithi008.stdout: "duration": 4294967295.999999 2023-08-01T19:55:35.318 INFO:teuthology.orchestra.run.smithi008.stdout: }, 2023-08-01T19:55:35.319 INFO:teuthology.orchestra.run.smithi008.stdout: { 2023-08-01T19:55:35.319 INFO:teuthology.orchestra.run.smithi008.stdout: "event": "all_read", 2023-08-01T19:55:35.319 INFO:teuthology.orchestra.run.smithi008.stdout: "time": "2023-08-01T19:55:35.305336+0000", 2023-08-01T19:55:35.319 INFO:teuthology.orchestra.run.smithi008.stdout: "duration": 4.2950000000000004e-06 2023-08-01T19:55:35.319 INFO:teuthology.orchestra.run.smithi008.stdout: }, 2023-08-01T19:55:35.319 INFO:teuthology.orchestra.run.smithi008.stdout: { 2023-08-01T19:55:35.319 INFO:teuthology.orchestra.run.smithi008.stdout: "event": "dispatched", 2023-08-01T19:55:35.319 INFO:teuthology.orchestra.run.smithi008.stdout: "time": "2023-08-01T19:55:35.305350+0000", 2023-08-01T19:55:35.320 INFO:teuthology.orchestra.run.smithi008.stdout: "duration": 1.4174e-05 2023-08-01T19:55:35.320 INFO:teuthology.orchestra.run.smithi008.stdout: }, 2023-08-01T19:55:35.320 INFO:teuthology.orchestra.run.smithi008.stdout: { 2023-08-01T19:55:35.320 INFO:teuthology.orchestra.run.smithi008.stdout: "event": "queued_for_pg", 2023-08-01T19:55:35.320 INFO:teuthology.orchestra.run.smithi008.stdout: "time": "2023-08-01T19:55:35.305355+0000", 2023-08-01T19:55:35.320 INFO:teuthology.orchestra.run.smithi008.stdout: "duration": 5.2000000000000002e-06 2023-08-01T19:55:35.320 INFO:teuthology.orchestra.run.smithi008.stdout: }, 2023-08-01T19:55:35.321 INFO:teuthology.orchestra.run.smithi008.stdout: { 2023-08-01T19:55:35.321 INFO:teuthology.orchestra.run.smithi008.stdout: "event": "reached_pg", 2023-08-01T19:55:35.321 INFO:teuthology.orchestra.run.smithi008.stdout: "time": "2023-08-01T19:55:35.305394+0000", 2023-08-01T19:55:35.321 INFO:teuthology.orchestra.run.smithi008.stdout: "duration": 3.8708000000000003e-05 2023-08-01T19:55:35.321 INFO:teuthology.orchestra.run.smithi008.stdout: }, 2023-08-01T19:55:35.321 INFO:teuthology.orchestra.run.smithi008.stdout: { 2023-08-01T19:55:35.321 INFO:teuthology.orchestra.run.smithi008.stdout: "event": "started", 2023-08-01T19:55:35.321 INFO:teuthology.orchestra.run.smithi008.stdout: "time": "2023-08-01T19:55:35.305470+0000", 2023-08-01T19:55:35.322 INFO:teuthology.orchestra.run.smithi008.stdout: "duration": 7.6301e-05 2023-08-01T19:55:35.322 INFO:teuthology.orchestra.run.smithi008.stdout: }, 2023-08-01T19:55:35.322 INFO:teuthology.orchestra.run.smithi008.stdout: { 2023-08-01T19:55:35.322 INFO:teuthology.orchestra.run.smithi008.stdout: "event": "waiting for subops from 1", 2023-08-01T19:55:35.322 INFO:teuthology.orchestra.run.smithi008.stdout: "time": "2023-08-01T19:55:35.305532+0000", 2023-08-01T19:55:35.322 INFO:teuthology.orchestra.run.smithi008.stdout: "duration": 6.2099000000000003e-05 2023-08-01T19:55:35.322 INFO:teuthology.orchestra.run.smithi008.stdout: }, 2023-08-01T19:55:35.322 INFO:teuthology.orchestra.run.smithi008.stdout: { 2023-08-01T19:55:35.323 INFO:teuthology.orchestra.run.smithi008.stdout: "event": "sub_op_commit_rec", 2023-08-01T19:55:35.323 INFO:teuthology.orchestra.run.smithi008.stdout: "time": "2023-08-01T19:55:35.310348+0000", 2023-08-01T19:55:35.323 INFO:teuthology.orchestra.run.smithi008.stdout: "duration": 0.0048163030000000001 2023-08-01T19:55:35.323 INFO:teuthology.orchestra.run.smithi008.stdout: } 2023-08-01T19:55:35.323 INFO:teuthology.orchestra.run.smithi008.stdout: ] 2023-08-01T19:55:35.323 INFO:teuthology.orchestra.run.smithi008.stdout: } 2023-08-01T19:55:35.323 INFO:teuthology.orchestra.run.smithi008.stdout: }, 2023-08-01T19:55:35.323 INFO:teuthology.orchestra.run.smithi008.stdout: { 2023-08-01T19:55:35.324 INFO:teuthology.orchestra.run.smithi008.stdout: "description": "osd_repop(client.4668.0:154103 5.b e49/19 5:d89d19d9:::benchmark_data_smithi006_114134_object20442:head v 49'9570, mlcod=49'9566)", 2023-08-01T19:55:35.324 INFO:teuthology.orchestra.run.smithi008.stdout: "initiated_at": "2023-08-01T19:55:35.305585+0000", 2023-08-01T19:55:35.324 INFO:teuthology.orchestra.run.smithi008.stdout: "age": 0.0075361020000000003, 2023-08-01T19:55:35.324 INFO:teuthology.orchestra.run.smithi008.stdout: "duration": 0.0076111369999999996, 2023-08-01T19:55:35.324 INFO:teuthology.orchestra.run.smithi008.stdout: "type_data": { 2023-08-01T19:55:35.324 INFO:teuthology.orchestra.run.smithi008.stdout: "flag_point": "started", 2023-08-01T19:55:35.324 INFO:teuthology.orchestra.run.smithi008.stdout: "events": [ 2023-08-01T19:55:35.325 INFO:teuthology.orchestra.run.smithi008.stdout: { 2023-08-01T19:55:35.325 INFO:teuthology.orchestra.run.smithi008.stdout: "event": "initiated", 2023-08-01T19:55:35.325 INFO:teuthology.orchestra.run.smithi008.stdout: "time": "2023-08-01T19:55:35.305585+0000", 2023-08-01T19:55:35.325 INFO:teuthology.orchestra.run.smithi008.stdout: "duration": 0 2023-08-01T19:55:35.325 INFO:teuthology.orchestra.run.smithi008.stdout: }, 2023-08-01T19:55:35.325 INFO:teuthology.orchestra.run.smithi008.stdout: { 2023-08-01T19:55:35.325 INFO:teuthology.orchestra.run.smithi008.stdout: "event": "throttled", 2023-08-01T19:55:35.325 INFO:teuthology.orchestra.run.smithi008.stdout: "time": "2023-08-01T19:55:35.305585+0000", 2023-08-01T19:55:35.326 INFO:teuthology.orchestra.run.smithi008.stdout: "duration": 0 2023-08-01T19:55:35.326 INFO:teuthology.orchestra.run.smithi008.stdout: }, 2023-08-01T19:55:35.326 INFO:teuthology.orchestra.run.smithi008.stdout: { 2023-08-01T19:55:35.326 INFO:teuthology.orchestra.run.smithi008.stdout: "event": "header_read", 2023-08-01T19:55:35.326 INFO:teuthology.orchestra.run.smithi008.stdout: "time": "2023-08-01T19:55:35.305584+0000", 2023-08-01T19:55:35.326 INFO:teuthology.orchestra.run.smithi008.stdout: "duration": 4294967295.9999995 2023-08-01T19:55:35.326 INFO:teuthology.orchestra.run.smithi008.stdout: }, 2023-08-01T19:55:35.326 INFO:teuthology.orchestra.run.smithi008.stdout: { 2023-08-01T19:55:35.327 INFO:teuthology.orchestra.run.smithi008.stdout: "event": "all_read", 2023-08-01T19:55:35.327 INFO:teuthology.orchestra.run.smithi008.stdout: "time": "2023-08-01T19:55:35.305590+0000", 2023-08-01T19:55:35.327 INFO:teuthology.orchestra.run.smithi008.stdout: "duration": 5.6609999999999997e-06 2023-08-01T19:55:35.327 INFO:teuthology.orchestra.run.smithi008.stdout: }, 2023-08-01T19:55:35.327 INFO:teuthology.orchestra.run.smithi008.stdout: { 2023-08-01T19:55:35.327 INFO:teuthology.orchestra.run.smithi008.stdout: "event": "dispatched", 2023-08-01T19:55:35.327 INFO:teuthology.orchestra.run.smithi008.stdout: "time": "2023-08-01T19:55:35.305599+0000", 2023-08-01T19:55:35.327 INFO:teuthology.orchestra.run.smithi008.stdout: "duration": 9.1330000000000005e-06 2023-08-01T19:55:35.328 INFO:teuthology.orchestra.run.smithi008.stdout: }, 2023-08-01T19:55:35.328 INFO:teuthology.orchestra.run.smithi008.stdout: { 2023-08-01T19:55:35.328 INFO:teuthology.orchestra.run.smithi008.stdout: "event": "queued_for_pg", 2023-08-01T19:55:35.328 INFO:teuthology.orchestra.run.smithi008.stdout: "time": "2023-08-01T19:55:35.305604+0000", 2023-08-01T19:55:35.328 INFO:teuthology.orchestra.run.smithi008.stdout: "duration": 5.1359999999999996e-06 2023-08-01T19:55:35.328 INFO:teuthology.orchestra.run.smithi008.stdout: }, 2023-08-01T19:55:35.328 INFO:teuthology.orchestra.run.smithi008.stdout: { 2023-08-01T19:55:35.328 INFO:teuthology.orchestra.run.smithi008.stdout: "event": "reached_pg", 2023-08-01T19:55:35.329 INFO:teuthology.orchestra.run.smithi008.stdout: "time": "2023-08-01T19:55:35.305650+0000", 2023-08-01T19:55:35.329 INFO:teuthology.orchestra.run.smithi008.stdout: "duration": 4.5652000000000003e-05 2023-08-01T19:55:35.329 INFO:teuthology.orchestra.run.smithi008.stdout: }, 2023-08-01T19:55:35.329 INFO:teuthology.orchestra.run.smithi008.stdout: { 2023-08-01T19:55:35.329 INFO:teuthology.orchestra.run.smithi008.stdout: "event": "started", 2023-08-01T19:55:35.329 INFO:teuthology.orchestra.run.smithi008.stdout: "time": "2023-08-01T19:55:35.305670+0000", 2023-08-01T19:55:35.329 INFO:teuthology.orchestra.run.smithi008.stdout: "duration": 1.9678e-05 2023-08-01T19:55:35.330 INFO:teuthology.orchestra.run.smithi008.stdout: } 2023-08-01T19:55:35.330 INFO:teuthology.orchestra.run.smithi008.stdout: ] 2023-08-01T19:55:35.330 INFO:teuthology.orchestra.run.smithi008.stdout: } 2023-08-01T19:55:35.330 INFO:teuthology.orchestra.run.smithi008.stdout: }, 2023-08-01T19:55:35.330 INFO:teuthology.orchestra.run.smithi008.stdout: { 2023-08-01T19:55:35.330 INFO:teuthology.orchestra.run.smithi008.stdout: "description": "osd_op(client.4668.0:154105 5.3 5:c8b811dd:::benchmark_data_smithi006_114134_object20444:head [delete] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e49)", 2023-08-01T19:55:35.330 INFO:teuthology.orchestra.run.smithi008.stdout: "initiated_at": "2023-08-01T19:55:35.307566+0000", 2023-08-01T19:55:35.330 INFO:teuthology.orchestra.run.smithi008.stdout: "age": 0.0055547629999999999, 2023-08-01T19:55:35.331 INFO:teuthology.orchestra.run.smithi008.stdout: "duration": 0.0056677780000000001, 2023-08-01T19:55:35.331 INFO:teuthology.orchestra.run.smithi008.stdout: "type_data": { 2023-08-01T19:55:35.331 INFO:teuthology.orchestra.run.smithi008.stdout: "flag_point": "waiting for sub ops", 2023-08-01T19:55:35.331 INFO:teuthology.orchestra.run.smithi008.stdout: "client_info": { 2023-08-01T19:55:35.331 INFO:teuthology.orchestra.run.smithi008.stdout: "client": "client.4668", 2023-08-01T19:55:35.331 INFO:teuthology.orchestra.run.smithi008.stdout: "client_addr": "172.21.15.6:0/1709472247", 2023-08-01T19:55:35.331 INFO:teuthology.orchestra.run.smithi008.stdout: "tid": 154105 2023-08-01T19:55:35.331 INFO:teuthology.orchestra.run.smithi008.stdout: }, 2023-08-01T19:55:35.332 INFO:teuthology.orchestra.run.smithi008.stdout: "events": [ 2023-08-01T19:55:35.332 INFO:teuthology.orchestra.run.smithi008.stdout: { 2023-08-01T19:55:35.332 INFO:teuthology.orchestra.run.smithi008.stdout: "event": "initiated", 2023-08-01T19:55:35.332 INFO:teuthology.orchestra.run.smithi008.stdout: "time": "2023-08-01T19:55:35.307566+0000", 2023-08-01T19:55:35.332 INFO:teuthology.orchestra.run.smithi008.stdout: "duration": 0 2023-08-01T19:55:35.332 INFO:teuthology.orchestra.run.smithi008.stdout: }, 2023-08-01T19:55:35.332 INFO:teuthology.orchestra.run.smithi008.stdout: { 2023-08-01T19:55:35.332 INFO:teuthology.orchestra.run.smithi008.stdout: "event": "throttled", 2023-08-01T19:55:35.333 INFO:teuthology.orchestra.run.smithi008.stdout: "time": "2023-08-01T19:55:35.307566+0000", 2023-08-01T19:55:35.333 INFO:teuthology.orchestra.run.smithi008.stdout: "duration": 0 2023-08-01T19:55:35.333 INFO:teuthology.orchestra.run.smithi008.stdout: }, 2023-08-01T19:55:35.333 INFO:teuthology.orchestra.run.smithi008.stdout: { 2023-08-01T19:55:35.333 INFO:teuthology.orchestra.run.smithi008.stdout: "event": "header_read", 2023-08-01T19:55:35.333 INFO:teuthology.orchestra.run.smithi008.stdout: "time": "2023-08-01T19:55:35.307566+0000", 2023-08-01T19:55:35.333 INFO:teuthology.orchestra.run.smithi008.stdout: "duration": 4294967295.999999 2023-08-01T19:55:35.333 INFO:teuthology.orchestra.run.smithi008.stdout: }, 2023-08-01T19:55:35.334 INFO:teuthology.orchestra.run.smithi008.stdout: { 2023-08-01T19:55:35.334 INFO:teuthology.orchestra.run.smithi008.stdout: "event": "all_read", 2023-08-01T19:55:35.334 INFO:teuthology.orchestra.run.smithi008.stdout: "time": "2023-08-01T19:55:35.307570+0000", 2023-08-01T19:55:35.334 INFO:teuthology.orchestra.run.smithi008.stdout: "duration": 4.1330000000000001e-06 2023-08-01T19:55:35.334 INFO:teuthology.orchestra.run.smithi008.stdout: }, 2023-08-01T19:55:35.334 INFO:teuthology.orchestra.run.smithi008.stdout: { 2023-08-01T19:55:35.334 INFO:teuthology.orchestra.run.smithi008.stdout: "event": "dispatched", 2023-08-01T19:55:35.334 INFO:teuthology.orchestra.run.smithi008.stdout: "time": "2023-08-01T19:55:35.307578+0000", 2023-08-01T19:55:35.335 INFO:teuthology.orchestra.run.smithi008.stdout: "duration": 8.2700000000000004e-06 2023-08-01T19:55:35.335 INFO:teuthology.orchestra.run.smithi008.stdout: }, 2023-08-01T19:55:35.335 INFO:teuthology.orchestra.run.smithi008.stdout: { 2023-08-01T19:55:35.335 INFO:teuthology.orchestra.run.smithi008.stdout: "event": "queued_for_pg", 2023-08-01T19:55:35.335 INFO:teuthology.orchestra.run.smithi008.stdout: "time": "2023-08-01T19:55:35.307584+0000", 2023-08-01T19:55:35.335 INFO:teuthology.orchestra.run.smithi008.stdout: "duration": 5.8760000000000002e-06 2023-08-01T19:55:35.335 INFO:teuthology.orchestra.run.smithi008.stdout: }, 2023-08-01T19:55:35.336 INFO:teuthology.orchestra.run.smithi008.stdout: { 2023-08-01T19:55:35.336 INFO:teuthology.orchestra.run.smithi008.stdout: "event": "reached_pg", 2023-08-01T19:55:35.336 INFO:teuthology.orchestra.run.smithi008.stdout: "time": "2023-08-01T19:55:35.307618+0000", 2023-08-01T19:55:35.336 INFO:teuthology.orchestra.run.smithi008.stdout: "duration": 3.4360999999999998e-05 2023-08-01T19:55:35.336 INFO:teuthology.orchestra.run.smithi008.stdout: }, 2023-08-01T19:55:35.336 INFO:teuthology.orchestra.run.smithi008.stdout: { 2023-08-01T19:55:35.337 INFO:teuthology.orchestra.run.smithi008.stdout: "event": "started", 2023-08-01T19:55:35.337 INFO:teuthology.orchestra.run.smithi008.stdout: "time": "2023-08-01T19:55:35.307724+0000", 2023-08-01T19:55:35.337 INFO:teuthology.orchestra.run.smithi008.stdout: "duration": 0.00010602099999999999 2023-08-01T19:55:35.337 INFO:teuthology.orchestra.run.smithi008.stdout: }, 2023-08-01T19:55:35.337 INFO:teuthology.orchestra.run.smithi008.stdout: { 2023-08-01T19:55:35.337 INFO:teuthology.orchestra.run.smithi008.stdout: "event": "waiting for subops from 1", 2023-08-01T19:55:35.337 INFO:teuthology.orchestra.run.smithi008.stdout: "time": "2023-08-01T19:55:35.307838+0000", 2023-08-01T19:55:35.337 INFO:teuthology.orchestra.run.smithi008.stdout: "duration": 0.000114103 2023-08-01T19:55:35.338 INFO:teuthology.orchestra.run.smithi008.stdout: }, 2023-08-01T19:55:35.338 INFO:teuthology.orchestra.run.smithi008.stdout: { 2023-08-01T19:55:35.338 INFO:teuthology.orchestra.run.smithi008.stdout: "event": "sub_op_commit_rec", 2023-08-01T19:55:35.338 INFO:teuthology.orchestra.run.smithi008.stdout: "time": "2023-08-01T19:55:35.311650+0000", 2023-08-01T19:55:35.338 INFO:teuthology.orchestra.run.smithi008.stdout: "duration": 0.0038114289999999999 2023-08-01T19:55:35.338 INFO:teuthology.orchestra.run.smithi008.stdout: } 2023-08-01T19:55:35.338 INFO:teuthology.orchestra.run.smithi008.stdout: ] 2023-08-01T19:55:35.338 INFO:teuthology.orchestra.run.smithi008.stdout: } 2023-08-01T19:55:35.339 INFO:teuthology.orchestra.run.smithi008.stdout: }, 2023-08-01T19:55:35.339 INFO:teuthology.orchestra.run.smithi008.stdout: { 2023-08-01T19:55:35.339 INFO:teuthology.orchestra.run.smithi008.stdout: "description": "osd_op(client.4668.0:154106 5.6 5:651d1c42:::benchmark_data_smithi006_114134_object20445:head [delete] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e49)", 2023-08-01T19:55:35.339 INFO:teuthology.orchestra.run.smithi008.stdout: "initiated_at": "2023-08-01T19:55:35.307644+0000", 2023-08-01T19:55:35.339 INFO:teuthology.orchestra.run.smithi008.stdout: "age": 0.00547731, 2023-08-01T19:55:35.339 INFO:teuthology.orchestra.run.smithi008.stdout: "duration": 0.0056399149999999997, 2023-08-01T19:55:35.339 INFO:teuthology.orchestra.run.smithi008.stdout: "type_data": { 2023-08-01T19:55:35.340 INFO:teuthology.orchestra.run.smithi008.stdout: "flag_point": "waiting for sub ops", 2023-08-01T19:55:35.340 INFO:teuthology.orchestra.run.smithi008.stdout: "client_info": { 2023-08-01T19:55:35.340 INFO:teuthology.orchestra.run.smithi008.stdout: "client": "client.4668", 2023-08-01T19:55:35.340 INFO:teuthology.orchestra.run.smithi008.stdout: "client_addr": "172.21.15.6:0/1709472247", 2023-08-01T19:55:35.340 INFO:teuthology.orchestra.run.smithi008.stdout: "tid": 154106 2023-08-01T19:55:35.340 INFO:teuthology.orchestra.run.smithi008.stdout: }, 2023-08-01T19:55:35.340 INFO:teuthology.orchestra.run.smithi008.stdout: "events": [ 2023-08-01T19:55:35.340 INFO:teuthology.orchestra.run.smithi008.stdout: { 2023-08-01T19:55:35.341 INFO:teuthology.orchestra.run.smithi008.stdout: "event": "initiated", 2023-08-01T19:55:35.341 INFO:teuthology.orchestra.run.smithi008.stdout: "time": "2023-08-01T19:55:35.307644+0000", 2023-08-01T19:55:35.341 INFO:teuthology.orchestra.run.smithi008.stdout: "duration": 0 2023-08-01T19:55:35.341 INFO:teuthology.orchestra.run.smithi008.stdout: }, 2023-08-01T19:55:35.341 INFO:teuthology.orchestra.run.smithi008.stdout: { 2023-08-01T19:55:35.341 INFO:teuthology.orchestra.run.smithi008.stdout: "event": "throttled", 2023-08-01T19:55:35.341 INFO:teuthology.orchestra.run.smithi008.stdout: "time": "2023-08-01T19:55:35.307644+0000", 2023-08-01T19:55:35.341 INFO:teuthology.orchestra.run.smithi008.stdout: "duration": 0 2023-08-01T19:55:35.342 INFO:teuthology.orchestra.run.smithi008.stdout: }, 2023-08-01T19:55:35.342 INFO:teuthology.orchestra.run.smithi008.stdout: { 2023-08-01T19:55:35.342 INFO:teuthology.orchestra.run.smithi008.stdout: "event": "header_read", 2023-08-01T19:55:35.342 INFO:teuthology.orchestra.run.smithi008.stdout: "time": "2023-08-01T19:55:35.307643+0000", 2023-08-01T19:55:35.342 INFO:teuthology.orchestra.run.smithi008.stdout: "duration": 4294967295.9999995 2023-08-01T19:55:35.342 INFO:teuthology.orchestra.run.smithi008.stdout: }, 2023-08-01T19:55:35.342 INFO:teuthology.orchestra.run.smithi008.stdout: { 2023-08-01T19:55:35.343 INFO:teuthology.orchestra.run.smithi008.stdout: "event": "all_read", 2023-08-01T19:55:35.343 INFO:teuthology.orchestra.run.smithi008.stdout: "time": "2023-08-01T19:55:35.307646+0000", 2023-08-01T19:55:35.343 INFO:teuthology.orchestra.run.smithi008.stdout: "duration": 3.0280000000000001e-06 2023-08-01T19:55:35.343 INFO:teuthology.orchestra.run.smithi008.stdout: }, 2023-08-01T19:55:35.343 INFO:teuthology.orchestra.run.smithi008.stdout: { 2023-08-01T19:55:35.343 INFO:teuthology.orchestra.run.smithi008.stdout: "event": "dispatched", 2023-08-01T19:55:35.343 INFO:teuthology.orchestra.run.smithi008.stdout: "time": "2023-08-01T19:55:35.307652+0000", 2023-08-01T19:55:35.343 INFO:teuthology.orchestra.run.smithi008.stdout: "duration": 5.7479999999999999e-06 2023-08-01T19:55:35.344 INFO:teuthology.orchestra.run.smithi008.stdout: }, 2023-08-01T19:55:35.344 INFO:teuthology.orchestra.run.smithi008.stdout: { 2023-08-01T19:55:35.344 INFO:teuthology.orchestra.run.smithi008.stdout: "event": "queued_for_pg", 2023-08-01T19:55:35.344 INFO:teuthology.orchestra.run.smithi008.stdout: "time": "2023-08-01T19:55:35.307656+0000", 2023-08-01T19:55:35.344 INFO:teuthology.orchestra.run.smithi008.stdout: "duration": 3.6650000000000001e-06 2023-08-01T19:55:35.344 INFO:teuthology.orchestra.run.smithi008.stdout: }, 2023-08-01T19:55:35.344 INFO:teuthology.orchestra.run.smithi008.stdout: { 2023-08-01T19:55:35.344 INFO:teuthology.orchestra.run.smithi008.stdout: "event": "reached_pg", 2023-08-01T19:55:35.345 INFO:teuthology.orchestra.run.smithi008.stdout: "time": "2023-08-01T19:55:35.307701+0000", 2023-08-01T19:55:35.345 INFO:teuthology.orchestra.run.smithi008.stdout: "duration": 4.5735000000000002e-05 2023-08-01T19:55:35.345 INFO:teuthology.orchestra.run.smithi008.stdout: }, 2023-08-01T19:55:35.345 INFO:teuthology.orchestra.run.smithi008.stdout: { 2023-08-01T19:55:35.345 INFO:teuthology.orchestra.run.smithi008.stdout: "event": "started", 2023-08-01T19:55:35.345 INFO:teuthology.orchestra.run.smithi008.stdout: "time": "2023-08-01T19:55:35.307819+0000", 2023-08-01T19:55:35.345 INFO:teuthology.orchestra.run.smithi008.stdout: "duration": 0.000118044 2023-08-01T19:55:35.346 INFO:teuthology.orchestra.run.smithi008.stdout: }, 2023-08-01T19:55:35.346 INFO:teuthology.orchestra.run.smithi008.stdout: { 2023-08-01T19:55:35.346 INFO:teuthology.orchestra.run.smithi008.stdout: "event": "waiting for subops from 1", 2023-08-01T19:55:35.346 INFO:teuthology.orchestra.run.smithi008.stdout: "time": "2023-08-01T19:55:35.307926+0000", 2023-08-01T19:55:35.346 INFO:teuthology.orchestra.run.smithi008.stdout: "duration": 0.000106405 2023-08-01T19:55:35.346 INFO:teuthology.orchestra.run.smithi008.stdout: } 2023-08-01T19:55:35.346 INFO:teuthology.orchestra.run.smithi008.stdout: ] 2023-08-01T19:55:35.346 INFO:teuthology.orchestra.run.smithi008.stdout: } 2023-08-01T19:55:35.347 INFO:teuthology.orchestra.run.smithi008.stdout: }, 2023-08-01T19:55:35.347 INFO:teuthology.orchestra.run.smithi008.stdout: { 2023-08-01T19:55:35.347 INFO:teuthology.orchestra.run.smithi008.stdout: "description": "osd_op(client.4668.0:154107 5.2 5:4bcf2473:::benchmark_data_smithi006_114134_object20446:head [delete] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e49)", 2023-08-01T19:55:35.347 INFO:teuthology.orchestra.run.smithi008.stdout: "initiated_at": "2023-08-01T19:55:35.307664+0000", 2023-08-01T19:55:35.347 INFO:teuthology.orchestra.run.smithi008.stdout: "age": 0.0054575980000000001, 2023-08-01T19:55:35.347 INFO:teuthology.orchestra.run.smithi008.stdout: "duration": 0.0056652459999999997, 2023-08-01T19:55:35.347 INFO:teuthology.orchestra.run.smithi008.stdout: "type_data": { 2023-08-01T19:55:35.347 INFO:teuthology.orchestra.run.smithi008.stdout: "flag_point": "waiting for sub ops", 2023-08-01T19:55:35.348 INFO:teuthology.orchestra.run.smithi008.stdout: "client_info": { 2023-08-01T19:55:35.348 INFO:teuthology.orchestra.run.smithi008.stdout: "client": "client.4668", 2023-08-01T19:55:35.348 INFO:teuthology.orchestra.run.smithi008.stdout: "client_addr": "172.21.15.6:0/1709472247", 2023-08-01T19:55:35.348 INFO:teuthology.orchestra.run.smithi008.stdout: "tid": 154107 2023-08-01T19:55:35.348 INFO:teuthology.orchestra.run.smithi008.stdout: }, 2023-08-01T19:55:35.348 INFO:teuthology.orchestra.run.smithi008.stdout: "events": [ 2023-08-01T19:55:35.348 INFO:teuthology.orchestra.run.smithi008.stdout: { 2023-08-01T19:55:35.348 INFO:teuthology.orchestra.run.smithi008.stdout: "event": "initiated", 2023-08-01T19:55:35.349 INFO:teuthology.orchestra.run.smithi008.stdout: "time": "2023-08-01T19:55:35.307664+0000", 2023-08-01T19:55:35.349 INFO:teuthology.orchestra.run.smithi008.stdout: "duration": 0 2023-08-01T19:55:35.349 INFO:teuthology.orchestra.run.smithi008.stdout: }, 2023-08-01T19:55:35.349 INFO:teuthology.orchestra.run.smithi008.stdout: { 2023-08-01T19:55:35.349 INFO:teuthology.orchestra.run.smithi008.stdout: "event": "throttled", 2023-08-01T19:55:35.349 INFO:teuthology.orchestra.run.smithi008.stdout: "time": "2023-08-01T19:55:35.307664+0000", 2023-08-01T19:55:35.349 INFO:teuthology.orchestra.run.smithi008.stdout: "duration": 0 2023-08-01T19:55:35.349 INFO:teuthology.orchestra.run.smithi008.stdout: }, 2023-08-01T19:55:35.350 INFO:teuthology.orchestra.run.smithi008.stdout: { 2023-08-01T19:55:35.350 INFO:teuthology.orchestra.run.smithi008.stdout: "event": "header_read", 2023-08-01T19:55:35.350 INFO:teuthology.orchestra.run.smithi008.stdout: "time": "2023-08-01T19:55:35.307663+0000", 2023-08-01T19:55:35.350 INFO:teuthology.orchestra.run.smithi008.stdout: "duration": 4294967295.9999995 2023-08-01T19:55:35.350 INFO:teuthology.orchestra.run.smithi008.stdout: }, 2023-08-01T19:55:35.350 INFO:teuthology.orchestra.run.smithi008.stdout: { 2023-08-01T19:55:35.350 INFO:teuthology.orchestra.run.smithi008.stdout: "event": "all_read", 2023-08-01T19:55:35.351 INFO:teuthology.orchestra.run.smithi008.stdout: "time": "2023-08-01T19:55:35.307666+0000", 2023-08-01T19:55:35.351 INFO:teuthology.orchestra.run.smithi008.stdout: "duration": 2.447e-06 2023-08-01T19:55:35.351 INFO:teuthology.orchestra.run.smithi008.stdout: }, 2023-08-01T19:55:35.351 INFO:teuthology.orchestra.run.smithi008.stdout: { 2023-08-01T19:55:35.351 INFO:teuthology.orchestra.run.smithi008.stdout: "event": "dispatched", 2023-08-01T19:55:35.351 INFO:teuthology.orchestra.run.smithi008.stdout: "time": "2023-08-01T19:55:35.307676+0000", 2023-08-01T19:55:35.351 INFO:teuthology.orchestra.run.smithi008.stdout: "duration": 1.0902e-05 2023-08-01T19:55:35.351 INFO:teuthology.orchestra.run.smithi008.stdout: }, 2023-08-01T19:55:35.352 INFO:teuthology.orchestra.run.smithi008.stdout: { 2023-08-01T19:55:35.352 INFO:teuthology.orchestra.run.smithi008.stdout: "event": "queued_for_pg", 2023-08-01T19:55:35.352 INFO:teuthology.orchestra.run.smithi008.stdout: "time": "2023-08-01T19:55:35.307680+0000", 2023-08-01T19:55:35.352 INFO:teuthology.orchestra.run.smithi008.stdout: "duration": 3.332e-06 2023-08-01T19:55:35.352 INFO:teuthology.orchestra.run.smithi008.stdout: }, 2023-08-01T19:55:35.352 INFO:teuthology.orchestra.run.smithi008.stdout: { 2023-08-01T19:55:35.352 INFO:teuthology.orchestra.run.smithi008.stdout: "event": "reached_pg", 2023-08-01T19:55:35.352 INFO:teuthology.orchestra.run.smithi008.stdout: "time": "2023-08-01T19:55:35.307710+0000", 2023-08-01T19:55:35.353 INFO:teuthology.orchestra.run.smithi008.stdout: "duration": 3.0088000000000001e-05 2023-08-01T19:55:35.353 INFO:teuthology.orchestra.run.smithi008.stdout: }, 2023-08-01T19:55:35.353 INFO:teuthology.orchestra.run.smithi008.stdout: { 2023-08-01T19:55:35.353 INFO:teuthology.orchestra.run.smithi008.stdout: "event": "started", 2023-08-01T19:55:35.353 INFO:teuthology.orchestra.run.smithi008.stdout: "time": "2023-08-01T19:55:35.307810+0000", 2023-08-01T19:55:35.353 INFO:teuthology.orchestra.run.smithi008.stdout: "duration": 0.00010049599999999999 2023-08-01T19:55:35.353 INFO:teuthology.orchestra.run.smithi008.stdout: }, 2023-08-01T19:55:35.353 INFO:teuthology.orchestra.run.smithi008.stdout: { 2023-08-01T19:55:35.354 INFO:teuthology.orchestra.run.smithi008.stdout: "event": "waiting for subops from 1", 2023-08-01T19:55:35.354 INFO:teuthology.orchestra.run.smithi008.stdout: "time": "2023-08-01T19:55:35.307920+0000", 2023-08-01T19:55:35.354 INFO:teuthology.orchestra.run.smithi008.stdout: "duration": 0.000110072 2023-08-01T19:55:35.354 INFO:teuthology.orchestra.run.smithi008.stdout: } 2023-08-01T19:55:35.354 INFO:teuthology.orchestra.run.smithi008.stdout: ] 2023-08-01T19:55:35.354 INFO:teuthology.orchestra.run.smithi008.stdout: } 2023-08-01T19:55:35.354 INFO:teuthology.orchestra.run.smithi008.stdout: }, 2023-08-01T19:55:35.354 INFO:teuthology.orchestra.run.smithi008.stdout: { 2023-08-01T19:55:35.355 INFO:teuthology.orchestra.run.smithi008.stdout: "description": "osd_op(client.4668.0:154108 5.3 5:c7ad0eca:::benchmark_data_smithi006_114134_object20447:head [delete] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e49)", 2023-08-01T19:55:35.355 INFO:teuthology.orchestra.run.smithi008.stdout: "initiated_at": "2023-08-01T19:55:35.307710+0000", 2023-08-01T19:55:35.355 INFO:teuthology.orchestra.run.smithi008.stdout: "age": 0.0054108009999999998, 2023-08-01T19:55:35.355 INFO:teuthology.orchestra.run.smithi008.stdout: "duration": 0.0056771060000000003, 2023-08-01T19:55:35.355 INFO:teuthology.orchestra.run.smithi008.stdout: "type_data": { 2023-08-01T19:55:35.355 INFO:teuthology.orchestra.run.smithi008.stdout: "flag_point": "waiting for sub ops", 2023-08-01T19:55:35.355 INFO:teuthology.orchestra.run.smithi008.stdout: "client_info": { 2023-08-01T19:55:35.355 INFO:teuthology.orchestra.run.smithi008.stdout: "client": "client.4668", 2023-08-01T19:55:35.356 INFO:teuthology.orchestra.run.smithi008.stdout: "client_addr": "172.21.15.6:0/1709472247", 2023-08-01T19:55:35.356 INFO:teuthology.orchestra.run.smithi008.stdout: "tid": 154108 2023-08-01T19:55:35.356 INFO:teuthology.orchestra.run.smithi008.stdout: }, 2023-08-01T19:55:35.356 INFO:teuthology.orchestra.run.smithi008.stdout: "events": [ 2023-08-01T19:55:35.356 INFO:teuthology.orchestra.run.smithi008.stdout: { 2023-08-01T19:55:35.356 INFO:teuthology.orchestra.run.smithi008.stdout: "event": "initiated", 2023-08-01T19:55:35.356 INFO:teuthology.orchestra.run.smithi008.stdout: "time": "2023-08-01T19:55:35.307710+0000", 2023-08-01T19:55:35.357 INFO:teuthology.orchestra.run.smithi008.stdout: "duration": 0 2023-08-01T19:55:35.357 INFO:teuthology.orchestra.run.smithi008.stdout: }, 2023-08-01T19:55:35.357 INFO:teuthology.orchestra.run.smithi008.stdout: { 2023-08-01T19:55:35.357 INFO:teuthology.orchestra.run.smithi008.stdout: "event": "throttled", 2023-08-01T19:55:35.357 INFO:teuthology.orchestra.run.smithi008.stdout: "time": "2023-08-01T19:55:35.307710+0000", 2023-08-01T19:55:35.357 INFO:teuthology.orchestra.run.smithi008.stdout: "duration": 0 2023-08-01T19:55:35.357 INFO:teuthology.orchestra.run.smithi008.stdout: }, 2023-08-01T19:55:35.357 INFO:teuthology.orchestra.run.smithi008.stdout: { 2023-08-01T19:55:35.358 INFO:teuthology.orchestra.run.smithi008.stdout: "event": "header_read", 2023-08-01T19:55:35.358 INFO:teuthology.orchestra.run.smithi008.stdout: "time": "2023-08-01T19:55:35.307710+0000", 2023-08-01T19:55:35.358 INFO:teuthology.orchestra.run.smithi008.stdout: "duration": 4294967295.9999995 2023-08-01T19:55:35.358 INFO:teuthology.orchestra.run.smithi008.stdout: }, 2023-08-01T19:55:35.358 INFO:teuthology.orchestra.run.smithi008.stdout: { 2023-08-01T19:55:35.358 INFO:teuthology.orchestra.run.smithi008.stdout: "event": "all_read", 2023-08-01T19:55:35.358 INFO:teuthology.orchestra.run.smithi008.stdout: "time": "2023-08-01T19:55:35.307713+0000", 2023-08-01T19:55:35.358 INFO:teuthology.orchestra.run.smithi008.stdout: "duration": 3.4989999999999999e-06 2023-08-01T19:55:35.359 INFO:teuthology.orchestra.run.smithi008.stdout: }, 2023-08-01T19:55:35.359 INFO:teuthology.orchestra.run.smithi008.stdout: { 2023-08-01T19:55:35.359 INFO:teuthology.orchestra.run.smithi008.stdout: "event": "dispatched", 2023-08-01T19:55:35.359 INFO:teuthology.orchestra.run.smithi008.stdout: "time": "2023-08-01T19:55:35.307721+0000", 2023-08-01T19:55:35.359 INFO:teuthology.orchestra.run.smithi008.stdout: "duration": 7.486e-06 2023-08-01T19:55:35.359 INFO:teuthology.orchestra.run.smithi008.stdout: }, 2023-08-01T19:55:35.359 INFO:teuthology.orchestra.run.smithi008.stdout: { 2023-08-01T19:55:35.359 INFO:teuthology.orchestra.run.smithi008.stdout: "event": "queued_for_pg", 2023-08-01T19:55:35.360 INFO:teuthology.orchestra.run.smithi008.stdout: "time": "2023-08-01T19:55:35.307725+0000", 2023-08-01T19:55:35.360 INFO:teuthology.orchestra.run.smithi008.stdout: "duration": 4.442e-06 2023-08-01T19:55:35.360 INFO:teuthology.orchestra.run.smithi008.stdout: }, 2023-08-01T19:55:35.360 INFO:teuthology.orchestra.run.smithi008.stdout: { 2023-08-01T19:55:35.360 INFO:teuthology.orchestra.run.smithi008.stdout: "event": "reached_pg", 2023-08-01T19:55:35.360 INFO:teuthology.orchestra.run.smithi008.stdout: "time": "2023-08-01T19:55:35.309491+0000", 2023-08-01T19:55:35.360 INFO:teuthology.orchestra.run.smithi008.stdout: "duration": 0.001765427 2023-08-01T19:55:35.360 INFO:teuthology.orchestra.run.smithi008.stdout: }, 2023-08-01T19:55:35.361 INFO:teuthology.orchestra.run.smithi008.stdout: { 2023-08-01T19:55:35.361 INFO:teuthology.orchestra.run.smithi008.stdout: "event": "started", 2023-08-01T19:55:35.361 INFO:teuthology.orchestra.run.smithi008.stdout: "time": "2023-08-01T19:55:35.309562+0000", 2023-08-01T19:55:35.361 INFO:teuthology.orchestra.run.smithi008.stdout: "duration": 7.1644999999999996e-05 2023-08-01T19:55:35.361 INFO:teuthology.orchestra.run.smithi008.stdout: }, 2023-08-01T19:55:35.361 INFO:teuthology.orchestra.run.smithi008.stdout: { 2023-08-01T19:55:35.361 INFO:teuthology.orchestra.run.smithi008.stdout: "event": "waiting for subops from 1", 2023-08-01T19:55:35.362 INFO:teuthology.orchestra.run.smithi008.stdout: "time": "2023-08-01T19:55:35.309624+0000", 2023-08-01T19:55:35.362 INFO:teuthology.orchestra.run.smithi008.stdout: "duration": 6.1790000000000003e-05 2023-08-01T19:55:35.362 INFO:teuthology.orchestra.run.smithi008.stdout: } 2023-08-01T19:55:35.362 INFO:teuthology.orchestra.run.smithi008.stdout: ] 2023-08-01T19:55:35.362 INFO:teuthology.orchestra.run.smithi008.stdout: } 2023-08-01T19:55:35.362 INFO:teuthology.orchestra.run.smithi008.stdout: }, 2023-08-01T19:55:35.362 INFO:teuthology.orchestra.run.smithi008.stdout: { 2023-08-01T19:55:35.362 INFO:teuthology.orchestra.run.smithi008.stdout: "description": "osd_repop(client.4668.0:154109 5.0 e49/19 5:03dd1397:::benchmark_data_smithi006_114134_object20448:head v 49'9799, mlcod=49'9797)", 2023-08-01T19:55:35.363 INFO:teuthology.orchestra.run.smithi008.stdout: "initiated_at": "2023-08-01T19:55:35.308191+0000", 2023-08-01T19:55:35.363 INFO:teuthology.orchestra.run.smithi008.stdout: "age": 0.0049302299999999999, 2023-08-01T19:55:35.363 INFO:teuthology.orchestra.run.smithi008.stdout: "duration": 0.0052420330000000001, 2023-08-01T19:55:35.363 INFO:teuthology.orchestra.run.smithi008.stdout: "type_data": { 2023-08-01T19:55:35.363 INFO:teuthology.orchestra.run.smithi008.stdout: "flag_point": "started", 2023-08-01T19:55:35.363 INFO:teuthology.orchestra.run.smithi008.stdout: "events": [ 2023-08-01T19:55:35.363 INFO:teuthology.orchestra.run.smithi008.stdout: { 2023-08-01T19:55:35.363 INFO:teuthology.orchestra.run.smithi008.stdout: "event": "initiated", 2023-08-01T19:55:35.364 INFO:teuthology.orchestra.run.smithi008.stdout: "time": "2023-08-01T19:55:35.308191+0000", 2023-08-01T19:55:35.364 INFO:teuthology.orchestra.run.smithi008.stdout: "duration": 0 2023-08-01T19:55:35.364 INFO:teuthology.orchestra.run.smithi008.stdout: }, 2023-08-01T19:55:35.364 INFO:teuthology.orchestra.run.smithi008.stdout: { 2023-08-01T19:55:35.364 INFO:teuthology.orchestra.run.smithi008.stdout: "event": "throttled", 2023-08-01T19:55:35.364 INFO:teuthology.orchestra.run.smithi008.stdout: "time": "2023-08-01T19:55:35.308191+0000", 2023-08-01T19:55:35.364 INFO:teuthology.orchestra.run.smithi008.stdout: "duration": 0 2023-08-01T19:55:35.364 INFO:teuthology.orchestra.run.smithi008.stdout: }, 2023-08-01T19:55:35.365 INFO:teuthology.orchestra.run.smithi008.stdout: { 2023-08-01T19:55:35.365 INFO:teuthology.orchestra.run.smithi008.stdout: "event": "header_read", 2023-08-01T19:55:35.365 INFO:teuthology.orchestra.run.smithi008.stdout: "time": "2023-08-01T19:55:35.308190+0000", 2023-08-01T19:55:35.365 INFO:teuthology.orchestra.run.smithi008.stdout: "duration": 4294967295.999999 2023-08-01T19:55:35.365 INFO:teuthology.orchestra.run.smithi008.stdout: }, 2023-08-01T19:55:35.365 INFO:teuthology.orchestra.run.smithi008.stdout: { 2023-08-01T19:55:35.365 INFO:teuthology.orchestra.run.smithi008.stdout: "event": "all_read", 2023-08-01T19:55:35.366 INFO:teuthology.orchestra.run.smithi008.stdout: "time": "2023-08-01T19:55:35.308195+0000", 2023-08-01T19:55:35.366 INFO:teuthology.orchestra.run.smithi008.stdout: "duration": 5.0810000000000001e-06 2023-08-01T19:55:35.366 INFO:teuthology.orchestra.run.smithi008.stdout: }, 2023-08-01T19:55:35.366 INFO:teuthology.orchestra.run.smithi008.stdout: { 2023-08-01T19:55:35.366 INFO:teuthology.orchestra.run.smithi008.stdout: "event": "dispatched", 2023-08-01T19:55:35.366 INFO:teuthology.orchestra.run.smithi008.stdout: "time": "2023-08-01T19:55:35.308206+0000", 2023-08-01T19:55:35.366 INFO:teuthology.orchestra.run.smithi008.stdout: "duration": 1.1209999999999999e-05 2023-08-01T19:55:35.366 INFO:teuthology.orchestra.run.smithi008.stdout: }, 2023-08-01T19:55:35.367 INFO:teuthology.orchestra.run.smithi008.stdout: { 2023-08-01T19:55:35.367 INFO:teuthology.orchestra.run.smithi008.stdout: "event": "queued_for_pg", 2023-08-01T19:55:35.367 INFO:teuthology.orchestra.run.smithi008.stdout: "time": "2023-08-01T19:55:35.308212+0000", 2023-08-01T19:55:35.367 INFO:teuthology.orchestra.run.smithi008.stdout: "duration": 5.2639999999999999e-06 2023-08-01T19:55:35.367 INFO:teuthology.orchestra.run.smithi008.stdout: }, 2023-08-01T19:55:35.367 INFO:teuthology.orchestra.run.smithi008.stdout: { 2023-08-01T19:55:35.367 INFO:teuthology.orchestra.run.smithi008.stdout: "event": "reached_pg", 2023-08-01T19:55:35.367 INFO:teuthology.orchestra.run.smithi008.stdout: "time": "2023-08-01T19:55:35.308246+0000", 2023-08-01T19:55:35.368 INFO:teuthology.orchestra.run.smithi008.stdout: "duration": 3.3887999999999998e-05 2023-08-01T19:55:35.368 INFO:teuthology.orchestra.run.smithi008.stdout: }, 2023-08-01T19:55:35.368 INFO:teuthology.orchestra.run.smithi008.stdout: { 2023-08-01T19:55:35.368 INFO:teuthology.orchestra.run.smithi008.stdout: "event": "started", 2023-08-01T19:55:35.368 INFO:teuthology.orchestra.run.smithi008.stdout: "time": "2023-08-01T19:55:35.308265+0000", 2023-08-01T19:55:35.368 INFO:teuthology.orchestra.run.smithi008.stdout: "duration": 1.9505999999999999e-05 2023-08-01T19:55:35.368 INFO:teuthology.orchestra.run.smithi008.stdout: } 2023-08-01T19:55:35.368 INFO:teuthology.orchestra.run.smithi008.stdout: ] 2023-08-01T19:55:35.369 INFO:teuthology.orchestra.run.smithi008.stdout: } 2023-08-01T19:55:35.369 INFO:teuthology.orchestra.run.smithi008.stdout: }, 2023-08-01T19:55:35.369 INFO:teuthology.orchestra.run.smithi008.stdout: { 2023-08-01T19:55:35.369 INFO:teuthology.orchestra.run.smithi008.stdout: "description": "osd_repop(client.4668.0:154112 5.e e49/19 5:733d3ba4:::benchmark_data_smithi006_114134_object20451:head v 49'9707, mlcod=49'9705)", 2023-08-01T19:55:35.369 INFO:teuthology.orchestra.run.smithi008.stdout: "initiated_at": "2023-08-01T19:55:35.310522+0000", 2023-08-01T19:55:35.369 INFO:teuthology.orchestra.run.smithi008.stdout: "age": 0.0025992369999999999, 2023-08-01T19:55:35.369 INFO:teuthology.orchestra.run.smithi008.stdout: "duration": 0.0029502230000000001, 2023-08-01T19:55:35.369 INFO:teuthology.orchestra.run.smithi008.stdout: "type_data": { 2023-08-01T19:55:35.370 INFO:teuthology.orchestra.run.smithi008.stdout: "flag_point": "started", 2023-08-01T19:55:35.370 INFO:teuthology.orchestra.run.smithi008.stdout: "events": [ 2023-08-01T19:55:35.370 INFO:teuthology.orchestra.run.smithi008.stdout: { 2023-08-01T19:55:35.370 INFO:teuthology.orchestra.run.smithi008.stdout: "event": "initiated", 2023-08-01T19:55:35.370 INFO:teuthology.orchestra.run.smithi008.stdout: "time": "2023-08-01T19:55:35.310522+0000", 2023-08-01T19:55:35.370 INFO:teuthology.orchestra.run.smithi008.stdout: "duration": 0 2023-08-01T19:55:35.370 INFO:teuthology.orchestra.run.smithi008.stdout: }, 2023-08-01T19:55:35.370 INFO:teuthology.orchestra.run.smithi008.stdout: { 2023-08-01T19:55:35.371 INFO:teuthology.orchestra.run.smithi008.stdout: "event": "throttled", 2023-08-01T19:55:35.371 INFO:teuthology.orchestra.run.smithi008.stdout: "time": "2023-08-01T19:55:35.310522+0000", 2023-08-01T19:55:35.371 INFO:teuthology.orchestra.run.smithi008.stdout: "duration": 0 2023-08-01T19:55:35.371 INFO:teuthology.orchestra.run.smithi008.stdout: }, 2023-08-01T19:55:35.371 INFO:teuthology.orchestra.run.smithi008.stdout: { 2023-08-01T19:55:35.371 INFO:teuthology.orchestra.run.smithi008.stdout: "event": "header_read", 2023-08-01T19:55:35.371 INFO:teuthology.orchestra.run.smithi008.stdout: "time": "2023-08-01T19:55:35.310521+0000", 2023-08-01T19:55:35.371 INFO:teuthology.orchestra.run.smithi008.stdout: "duration": 4294967295.9999995 2023-08-01T19:55:35.372 INFO:teuthology.orchestra.run.smithi008.stdout: }, 2023-08-01T19:55:35.372 INFO:teuthology.orchestra.run.smithi008.stdout: { 2023-08-01T19:55:35.372 INFO:teuthology.orchestra.run.smithi008.stdout: "event": "all_read", 2023-08-01T19:55:35.372 INFO:teuthology.orchestra.run.smithi008.stdout: "time": "2023-08-01T19:55:35.310526+0000", 2023-08-01T19:55:35.372 INFO:teuthology.orchestra.run.smithi008.stdout: "duration": 4.9110000000000001e-06 2023-08-01T19:55:35.372 INFO:teuthology.orchestra.run.smithi008.stdout: }, 2023-08-01T19:55:35.372 INFO:teuthology.orchestra.run.smithi008.stdout: { 2023-08-01T19:55:35.373 INFO:teuthology.orchestra.run.smithi008.stdout: "event": "dispatched", 2023-08-01T19:55:35.373 INFO:teuthology.orchestra.run.smithi008.stdout: "time": "2023-08-01T19:55:35.310533+0000", 2023-08-01T19:55:35.373 INFO:teuthology.orchestra.run.smithi008.stdout: "duration": 6.8279999999999997e-06 2023-08-01T19:55:35.373 INFO:teuthology.orchestra.run.smithi008.stdout: }, 2023-08-01T19:55:35.373 INFO:teuthology.orchestra.run.smithi008.stdout: { 2023-08-01T19:55:35.373 INFO:teuthology.orchestra.run.smithi008.stdout: "event": "queued_for_pg", 2023-08-01T19:55:35.373 INFO:teuthology.orchestra.run.smithi008.stdout: "time": "2023-08-01T19:55:35.310537+0000", 2023-08-01T19:55:35.373 INFO:teuthology.orchestra.run.smithi008.stdout: "duration": 3.5360000000000001e-06 2023-08-01T19:55:35.374 INFO:teuthology.orchestra.run.smithi008.stdout: }, 2023-08-01T19:55:35.374 INFO:teuthology.orchestra.run.smithi008.stdout: { 2023-08-01T19:55:35.374 INFO:teuthology.orchestra.run.smithi008.stdout: "event": "reached_pg", 2023-08-01T19:55:35.374 INFO:teuthology.orchestra.run.smithi008.stdout: "time": "2023-08-01T19:55:35.310566+0000", 2023-08-01T19:55:35.374 INFO:teuthology.orchestra.run.smithi008.stdout: "duration": 2.9402000000000001e-05 2023-08-01T19:55:35.374 INFO:teuthology.orchestra.run.smithi008.stdout: }, 2023-08-01T19:55:35.374 INFO:teuthology.orchestra.run.smithi008.stdout: { 2023-08-01T19:55:35.374 INFO:teuthology.orchestra.run.smithi008.stdout: "event": "started", 2023-08-01T19:55:35.375 INFO:teuthology.orchestra.run.smithi008.stdout: "time": "2023-08-01T19:55:35.310587+0000", 2023-08-01T19:55:35.375 INFO:teuthology.orchestra.run.smithi008.stdout: "duration": 2.1220999999999999e-05 2023-08-01T19:55:35.375 INFO:teuthology.orchestra.run.smithi008.stdout: } 2023-08-01T19:55:35.375 INFO:teuthology.orchestra.run.smithi008.stdout: ] 2023-08-01T19:55:35.375 INFO:teuthology.orchestra.run.smithi008.stdout: } 2023-08-01T19:55:35.375 INFO:teuthology.orchestra.run.smithi008.stdout: }, 2023-08-01T19:55:35.375 INFO:teuthology.orchestra.run.smithi008.stdout: { 2023-08-01T19:55:35.375 INFO:teuthology.orchestra.run.smithi008.stdout: "description": "osd_op(client.4668.0:154113 5.1 5:8fcf1aeb:::benchmark_data_smithi006_114134_object20452:head [delete] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e49)", 2023-08-01T19:55:35.376 INFO:teuthology.orchestra.run.smithi008.stdout: "initiated_at": "2023-08-01T19:55:35.310682+0000", 2023-08-01T19:55:35.376 INFO:teuthology.orchestra.run.smithi008.stdout: "age": 0.0024388389999999999, 2023-08-01T19:55:35.376 INFO:teuthology.orchestra.run.smithi008.stdout: "duration": 0.0028322130000000001, 2023-08-01T19:55:35.376 INFO:teuthology.orchestra.run.smithi008.stdout: "type_data": { 2023-08-01T19:55:35.376 INFO:teuthology.orchestra.run.smithi008.stdout: "flag_point": "waiting for sub ops", 2023-08-01T19:55:35.376 INFO:teuthology.orchestra.run.smithi008.stdout: "client_info": { 2023-08-01T19:55:35.376 INFO:teuthology.orchestra.run.smithi008.stdout: "client": "client.4668", 2023-08-01T19:55:35.376 INFO:teuthology.orchestra.run.smithi008.stdout: "client_addr": "172.21.15.6:0/1709472247", 2023-08-01T19:55:35.377 INFO:teuthology.orchestra.run.smithi008.stdout: "tid": 154113 2023-08-01T19:55:35.377 INFO:teuthology.orchestra.run.smithi008.stdout: }, 2023-08-01T19:55:35.377 INFO:teuthology.orchestra.run.smithi008.stdout: "events": [ 2023-08-01T19:55:35.377 INFO:teuthology.orchestra.run.smithi008.stdout: { 2023-08-01T19:55:35.377 INFO:teuthology.orchestra.run.smithi008.stdout: "event": "initiated", 2023-08-01T19:55:35.377 INFO:teuthology.orchestra.run.smithi008.stdout: "time": "2023-08-01T19:55:35.310682+0000", 2023-08-01T19:55:35.377 INFO:teuthology.orchestra.run.smithi008.stdout: "duration": 0 2023-08-01T19:55:35.378 INFO:teuthology.orchestra.run.smithi008.stdout: }, 2023-08-01T19:55:35.378 INFO:teuthology.orchestra.run.smithi008.stdout: { 2023-08-01T19:55:35.378 INFO:teuthology.orchestra.run.smithi008.stdout: "event": "throttled", 2023-08-01T19:55:35.378 INFO:teuthology.orchestra.run.smithi008.stdout: "time": "2023-08-01T19:55:35.310682+0000", 2023-08-01T19:55:35.378 INFO:teuthology.orchestra.run.smithi008.stdout: "duration": 0 2023-08-01T19:55:35.378 INFO:teuthology.orchestra.run.smithi008.stdout: }, 2023-08-01T19:55:35.378 INFO:teuthology.orchestra.run.smithi008.stdout: { 2023-08-01T19:55:35.378 INFO:teuthology.orchestra.run.smithi008.stdout: "event": "header_read", 2023-08-01T19:55:35.379 INFO:teuthology.orchestra.run.smithi008.stdout: "time": "2023-08-01T19:55:35.310681+0000", 2023-08-01T19:55:35.379 INFO:teuthology.orchestra.run.smithi008.stdout: "duration": 4294967295.999999 2023-08-01T19:55:35.379 INFO:teuthology.orchestra.run.smithi008.stdout: }, 2023-08-01T19:55:35.379 INFO:teuthology.orchestra.run.smithi008.stdout: { 2023-08-01T19:55:35.379 INFO:teuthology.orchestra.run.smithi008.stdout: "event": "all_read", 2023-08-01T19:55:35.379 INFO:teuthology.orchestra.run.smithi008.stdout: "time": "2023-08-01T19:55:35.310685+0000", 2023-08-01T19:55:35.379 INFO:teuthology.orchestra.run.smithi008.stdout: "duration": 3.9720000000000003e-06 2023-08-01T19:55:35.379 INFO:teuthology.orchestra.run.smithi008.stdout: }, 2023-08-01T19:55:35.380 INFO:teuthology.orchestra.run.smithi008.stdout: { 2023-08-01T19:55:35.380 INFO:teuthology.orchestra.run.smithi008.stdout: "event": "dispatched", 2023-08-01T19:55:35.380 INFO:teuthology.orchestra.run.smithi008.stdout: "time": "2023-08-01T19:55:35.310693+0000", 2023-08-01T19:55:35.380 INFO:teuthology.orchestra.run.smithi008.stdout: "duration": 7.9570000000000002e-06 2023-08-01T19:55:35.380 INFO:teuthology.orchestra.run.smithi008.stdout: }, 2023-08-01T19:55:35.380 INFO:teuthology.orchestra.run.smithi008.stdout: { 2023-08-01T19:55:35.380 INFO:teuthology.orchestra.run.smithi008.stdout: "event": "queued_for_pg", 2023-08-01T19:55:35.380 INFO:teuthology.orchestra.run.smithi008.stdout: "time": "2023-08-01T19:55:35.310699+0000", 2023-08-01T19:55:35.381 INFO:teuthology.orchestra.run.smithi008.stdout: "duration": 6.0589999999999999e-06 2023-08-01T19:55:35.381 INFO:teuthology.orchestra.run.smithi008.stdout: }, 2023-08-01T19:55:35.381 INFO:teuthology.orchestra.run.smithi008.stdout: { 2023-08-01T19:55:35.381 INFO:teuthology.orchestra.run.smithi008.stdout: "event": "reached_pg", 2023-08-01T19:55:35.381 INFO:teuthology.orchestra.run.smithi008.stdout: "time": "2023-08-01T19:55:35.310732+0000", 2023-08-01T19:55:35.381 INFO:teuthology.orchestra.run.smithi008.stdout: "duration": 3.2264000000000001e-05 2023-08-01T19:55:35.381 INFO:teuthology.orchestra.run.smithi008.stdout: }, 2023-08-01T19:55:35.381 INFO:teuthology.orchestra.run.smithi008.stdout: { 2023-08-01T19:55:35.382 INFO:teuthology.orchestra.run.smithi008.stdout: "event": "started", 2023-08-01T19:55:35.382 INFO:teuthology.orchestra.run.smithi008.stdout: "time": "2023-08-01T19:55:35.310834+0000", 2023-08-01T19:55:35.382 INFO:teuthology.orchestra.run.smithi008.stdout: "duration": 0.000102464 2023-08-01T19:55:35.382 INFO:teuthology.orchestra.run.smithi008.stdout: }, 2023-08-01T19:55:35.382 INFO:teuthology.orchestra.run.smithi008.stdout: { 2023-08-01T19:55:35.382 INFO:teuthology.orchestra.run.smithi008.stdout: "event": "waiting for subops from 1", 2023-08-01T19:55:35.382 INFO:teuthology.orchestra.run.smithi008.stdout: "time": "2023-08-01T19:55:35.310925+0000", 2023-08-01T19:55:35.382 INFO:teuthology.orchestra.run.smithi008.stdout: "duration": 9.1271000000000001e-05 2023-08-01T19:55:35.383 INFO:teuthology.orchestra.run.smithi008.stdout: } 2023-08-01T19:55:35.383 INFO:teuthology.orchestra.run.smithi008.stdout: ] 2023-08-01T19:55:35.383 INFO:teuthology.orchestra.run.smithi008.stdout: } 2023-08-01T19:55:35.383 INFO:teuthology.orchestra.run.smithi008.stdout: }, 2023-08-01T19:55:35.383 INFO:teuthology.orchestra.run.smithi008.stdout: { 2023-08-01T19:55:35.383 INFO:teuthology.orchestra.run.smithi008.stdout: "description": "osd_op(client.4668.0:154114 5.c 5:37a7b485:::benchmark_data_smithi006_114134_object20453:head [delete] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e49)", 2023-08-01T19:55:35.383 INFO:teuthology.orchestra.run.smithi008.stdout: "initiated_at": "2023-08-01T19:55:35.310747+0000", 2023-08-01T19:55:35.383 INFO:teuthology.orchestra.run.smithi008.stdout: "age": 0.0023745699999999999, 2023-08-01T19:55:35.384 INFO:teuthology.orchestra.run.smithi008.stdout: "duration": 0.0028167240000000001, 2023-08-01T19:55:35.384 INFO:teuthology.orchestra.run.smithi008.stdout: "type_data": { 2023-08-01T19:55:35.384 INFO:teuthology.orchestra.run.smithi008.stdout: "flag_point": "waiting for sub ops", 2023-08-01T19:55:35.384 INFO:teuthology.orchestra.run.smithi008.stdout: "client_info": { 2023-08-01T19:55:35.384 INFO:teuthology.orchestra.run.smithi008.stdout: "client": "client.4668", 2023-08-01T19:55:35.384 INFO:teuthology.orchestra.run.smithi008.stdout: "client_addr": "172.21.15.6:0/1709472247", 2023-08-01T19:55:35.384 INFO:teuthology.orchestra.run.smithi008.stdout: "tid": 154114 2023-08-01T19:55:35.384 INFO:teuthology.orchestra.run.smithi008.stdout: }, 2023-08-01T19:55:35.385 INFO:teuthology.orchestra.run.smithi008.stdout: "events": [ 2023-08-01T19:55:35.385 INFO:teuthology.orchestra.run.smithi008.stdout: { 2023-08-01T19:55:35.385 INFO:teuthology.orchestra.run.smithi008.stdout: "event": "initiated", 2023-08-01T19:55:35.385 INFO:teuthology.orchestra.run.smithi008.stdout: "time": "2023-08-01T19:55:35.310747+0000", 2023-08-01T19:55:35.385 INFO:teuthology.orchestra.run.smithi008.stdout: "duration": 0 2023-08-01T19:55:35.385 INFO:teuthology.orchestra.run.smithi008.stdout: }, 2023-08-01T19:55:35.385 INFO:teuthology.orchestra.run.smithi008.stdout: { 2023-08-01T19:55:35.385 INFO:teuthology.orchestra.run.smithi008.stdout: "event": "throttled", 2023-08-01T19:55:35.386 INFO:teuthology.orchestra.run.smithi008.stdout: "time": "2023-08-01T19:55:35.310747+0000", 2023-08-01T19:55:35.386 INFO:teuthology.orchestra.run.smithi008.stdout: "duration": 0 2023-08-01T19:55:35.386 INFO:teuthology.orchestra.run.smithi008.stdout: }, 2023-08-01T19:55:35.386 INFO:teuthology.orchestra.run.smithi008.stdout: { 2023-08-01T19:55:35.386 INFO:teuthology.orchestra.run.smithi008.stdout: "event": "header_read", 2023-08-01T19:55:35.386 INFO:teuthology.orchestra.run.smithi008.stdout: "time": "2023-08-01T19:55:35.310746+0000", 2023-08-01T19:55:35.386 INFO:teuthology.orchestra.run.smithi008.stdout: "duration": 4294967295.999999 2023-08-01T19:55:35.386 INFO:teuthology.orchestra.run.smithi008.stdout: }, 2023-08-01T19:55:35.387 INFO:teuthology.orchestra.run.smithi008.stdout: { 2023-08-01T19:55:35.387 INFO:teuthology.orchestra.run.smithi008.stdout: "event": "all_read", 2023-08-01T19:55:35.387 INFO:teuthology.orchestra.run.smithi008.stdout: "time": "2023-08-01T19:55:35.310750+0000", 2023-08-01T19:55:35.387 INFO:teuthology.orchestra.run.smithi008.stdout: "duration": 3.9519999999999996e-06 2023-08-01T19:55:35.387 INFO:teuthology.orchestra.run.smithi008.stdout: }, 2023-08-01T19:55:35.387 INFO:teuthology.orchestra.run.smithi008.stdout: { 2023-08-01T19:55:35.387 INFO:teuthology.orchestra.run.smithi008.stdout: "event": "dispatched", 2023-08-01T19:55:35.388 INFO:teuthology.orchestra.run.smithi008.stdout: "time": "2023-08-01T19:55:35.310758+0000", 2023-08-01T19:55:35.388 INFO:teuthology.orchestra.run.smithi008.stdout: "duration": 7.9999999999999996e-06 2023-08-01T19:55:35.388 INFO:teuthology.orchestra.run.smithi008.stdout: }, 2023-08-01T19:55:35.388 INFO:teuthology.orchestra.run.smithi008.stdout: { 2023-08-01T19:55:35.388 INFO:teuthology.orchestra.run.smithi008.stdout: "event": "queued_for_pg", 2023-08-01T19:55:35.388 INFO:teuthology.orchestra.run.smithi008.stdout: "time": "2023-08-01T19:55:35.310763+0000", 2023-08-01T19:55:35.388 INFO:teuthology.orchestra.run.smithi008.stdout: "duration": 4.809e-06 2023-08-01T19:55:35.388 INFO:teuthology.orchestra.run.smithi008.stdout: }, 2023-08-01T19:55:35.389 INFO:teuthology.orchestra.run.smithi008.stdout: { 2023-08-01T19:55:35.389 INFO:teuthology.orchestra.run.smithi008.stdout: "event": "reached_pg", 2023-08-01T19:55:35.389 INFO:teuthology.orchestra.run.smithi008.stdout: "time": "2023-08-01T19:55:35.310799+0000", 2023-08-01T19:55:35.389 INFO:teuthology.orchestra.run.smithi008.stdout: "duration": 3.6368000000000001e-05 2023-08-01T19:55:35.389 INFO:teuthology.orchestra.run.smithi008.stdout: }, 2023-08-01T19:55:35.389 INFO:teuthology.orchestra.run.smithi008.stdout: { 2023-08-01T19:55:35.389 INFO:teuthology.orchestra.run.smithi008.stdout: "event": "started", 2023-08-01T19:55:35.389 INFO:teuthology.orchestra.run.smithi008.stdout: "time": "2023-08-01T19:55:35.310914+0000", 2023-08-01T19:55:35.390 INFO:teuthology.orchestra.run.smithi008.stdout: "duration": 0.000115303 2023-08-01T19:55:35.390 INFO:teuthology.orchestra.run.smithi008.stdout: }, 2023-08-01T19:55:35.390 INFO:teuthology.orchestra.run.smithi008.stdout: { 2023-08-01T19:55:35.390 INFO:teuthology.orchestra.run.smithi008.stdout: "event": "waiting for subops from 1", 2023-08-01T19:55:35.390 INFO:teuthology.orchestra.run.smithi008.stdout: "time": "2023-08-01T19:55:35.311027+0000", 2023-08-01T19:55:35.390 INFO:teuthology.orchestra.run.smithi008.stdout: "duration": 0.00011253599999999999 2023-08-01T19:55:35.390 INFO:teuthology.orchestra.run.smithi008.stdout: } 2023-08-01T19:55:35.390 INFO:teuthology.orchestra.run.smithi008.stdout: ] 2023-08-01T19:55:35.391 INFO:teuthology.orchestra.run.smithi008.stdout: } 2023-08-01T19:55:35.391 INFO:teuthology.orchestra.run.smithi008.stdout: }, 2023-08-01T19:55:35.391 INFO:teuthology.orchestra.run.smithi008.stdout: { 2023-08-01T19:55:35.391 INFO:teuthology.orchestra.run.smithi008.stdout: "description": "osd_op(client.4668.0:154115 5.1 5:82aecd95:::benchmark_data_smithi006_114134_object20454:head [delete] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e49)", 2023-08-01T19:55:35.391 INFO:teuthology.orchestra.run.smithi008.stdout: "initiated_at": "2023-08-01T19:55:35.310862+0000", 2023-08-01T19:55:35.391 INFO:teuthology.orchestra.run.smithi008.stdout: "age": 0.0022590850000000001, 2023-08-01T19:55:35.391 INFO:teuthology.orchestra.run.smithi008.stdout: "duration": 0.0027448500000000001, 2023-08-01T19:55:35.391 INFO:teuthology.orchestra.run.smithi008.stdout: "type_data": { 2023-08-01T19:55:35.392 INFO:teuthology.orchestra.run.smithi008.stdout: "flag_point": "waiting for sub ops", 2023-08-01T19:55:35.392 INFO:teuthology.orchestra.run.smithi008.stdout: "client_info": { 2023-08-01T19:55:35.392 INFO:teuthology.orchestra.run.smithi008.stdout: "client": "client.4668", 2023-08-01T19:55:35.392 INFO:teuthology.orchestra.run.smithi008.stdout: "client_addr": "172.21.15.6:0/1709472247", 2023-08-01T19:55:35.392 INFO:teuthology.orchestra.run.smithi008.stdout: "tid": 154115 2023-08-01T19:55:35.392 INFO:teuthology.orchestra.run.smithi008.stdout: }, 2023-08-01T19:55:35.392 INFO:teuthology.orchestra.run.smithi008.stdout: "events": [ 2023-08-01T19:55:35.393 INFO:teuthology.orchestra.run.smithi008.stdout: { 2023-08-01T19:55:35.393 INFO:teuthology.orchestra.run.smithi008.stdout: "event": "initiated", 2023-08-01T19:55:35.393 INFO:teuthology.orchestra.run.smithi008.stdout: "time": "2023-08-01T19:55:35.310862+0000", 2023-08-01T19:55:35.393 INFO:teuthology.orchestra.run.smithi008.stdout: "duration": 0 2023-08-01T19:55:35.393 INFO:teuthology.orchestra.run.smithi008.stdout: }, 2023-08-01T19:55:35.393 INFO:teuthology.orchestra.run.smithi008.stdout: { 2023-08-01T19:55:35.393 INFO:teuthology.orchestra.run.smithi008.stdout: "event": "throttled", 2023-08-01T19:55:35.393 INFO:teuthology.orchestra.run.smithi008.stdout: "time": "2023-08-01T19:55:35.310862+0000", 2023-08-01T19:55:35.394 INFO:teuthology.orchestra.run.smithi008.stdout: "duration": 0 2023-08-01T19:55:35.394 INFO:teuthology.orchestra.run.smithi008.stdout: }, 2023-08-01T19:55:35.394 INFO:teuthology.orchestra.run.smithi008.stdout: { 2023-08-01T19:55:35.394 INFO:teuthology.orchestra.run.smithi008.stdout: "event": "header_read", 2023-08-01T19:55:35.394 INFO:teuthology.orchestra.run.smithi008.stdout: "time": "2023-08-01T19:55:35.310861+0000", 2023-08-01T19:55:35.394 INFO:teuthology.orchestra.run.smithi008.stdout: "duration": 4294967295.999999 2023-08-01T19:55:35.394 INFO:teuthology.orchestra.run.smithi008.stdout: }, 2023-08-01T19:55:35.394 INFO:teuthology.orchestra.run.smithi008.stdout: { 2023-08-01T19:55:35.395 INFO:teuthology.orchestra.run.smithi008.stdout: "event": "all_read", 2023-08-01T19:55:35.395 INFO:teuthology.orchestra.run.smithi008.stdout: "time": "2023-08-01T19:55:35.310866+0000", 2023-08-01T19:55:35.395 INFO:teuthology.orchestra.run.smithi008.stdout: "duration": 4.3640000000000001e-06 2023-08-01T19:55:35.395 INFO:teuthology.orchestra.run.smithi008.stdout: }, 2023-08-01T19:55:35.395 INFO:teuthology.orchestra.run.smithi008.stdout: { 2023-08-01T19:55:35.395 INFO:teuthology.orchestra.run.smithi008.stdout: "event": "dispatched", 2023-08-01T19:55:35.395 INFO:teuthology.orchestra.run.smithi008.stdout: "time": "2023-08-01T19:55:35.310874+0000", 2023-08-01T19:55:35.395 INFO:teuthology.orchestra.run.smithi008.stdout: "duration": 8.8240000000000006e-06 2023-08-01T19:55:35.396 INFO:teuthology.orchestra.run.smithi008.stdout: }, 2023-08-01T19:55:35.396 INFO:teuthology.orchestra.run.smithi008.stdout: { 2023-08-01T19:55:35.396 INFO:teuthology.orchestra.run.smithi008.stdout: "event": "queued_for_pg", 2023-08-01T19:55:35.396 INFO:teuthology.orchestra.run.smithi008.stdout: "time": "2023-08-01T19:55:35.310880+0000", 2023-08-01T19:55:35.396 INFO:teuthology.orchestra.run.smithi008.stdout: "duration": 5.4049999999999999e-06 2023-08-01T19:55:35.396 INFO:teuthology.orchestra.run.smithi008.stdout: }, 2023-08-01T19:55:35.396 INFO:teuthology.orchestra.run.smithi008.stdout: { 2023-08-01T19:55:35.396 INFO:teuthology.orchestra.run.smithi008.stdout: "event": "reached_pg", 2023-08-01T19:55:35.397 INFO:teuthology.orchestra.run.smithi008.stdout: "time": "2023-08-01T19:55:35.312392+0000", 2023-08-01T19:55:35.397 INFO:teuthology.orchestra.run.smithi008.stdout: "duration": 0.001512268 2023-08-01T19:55:35.397 INFO:teuthology.orchestra.run.smithi008.stdout: }, 2023-08-01T19:55:35.397 INFO:teuthology.orchestra.run.smithi008.stdout: { 2023-08-01T19:55:35.397 INFO:teuthology.orchestra.run.smithi008.stdout: "event": "started", 2023-08-01T19:55:35.397 INFO:teuthology.orchestra.run.smithi008.stdout: "time": "2023-08-01T19:55:35.312460+0000", 2023-08-01T19:55:35.397 INFO:teuthology.orchestra.run.smithi008.stdout: "duration": 6.8078999999999997e-05 2023-08-01T19:55:35.397 INFO:teuthology.orchestra.run.smithi008.stdout: }, 2023-08-01T19:55:35.398 INFO:teuthology.orchestra.run.smithi008.stdout: { 2023-08-01T19:55:35.398 INFO:teuthology.orchestra.run.smithi008.stdout: "event": "waiting for subops from 1", 2023-08-01T19:55:35.398 INFO:teuthology.orchestra.run.smithi008.stdout: "time": "2023-08-01T19:55:35.312522+0000", 2023-08-01T19:55:35.398 INFO:teuthology.orchestra.run.smithi008.stdout: "duration": 6.1964000000000005e-05 2023-08-01T19:55:35.398 INFO:teuthology.orchestra.run.smithi008.stdout: } 2023-08-01T19:55:35.398 INFO:teuthology.orchestra.run.smithi008.stdout: ] 2023-08-01T19:55:35.398 INFO:teuthology.orchestra.run.smithi008.stdout: } 2023-08-01T19:55:35.398 INFO:teuthology.orchestra.run.smithi008.stdout: }, 2023-08-01T19:55:35.399 INFO:teuthology.orchestra.run.smithi008.stdout: { 2023-08-01T19:55:35.399 INFO:teuthology.orchestra.run.smithi008.stdout: "description": "osd_op(client.4668.0:154116 5.2 5:46e9972b:::benchmark_data_smithi006_114134_object20455:head [delete] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e49)", 2023-08-01T19:55:35.399 INFO:teuthology.orchestra.run.smithi008.stdout: "initiated_at": "2023-08-01T19:55:35.310886+0000", 2023-08-01T19:55:35.399 INFO:teuthology.orchestra.run.smithi008.stdout: "age": 0.0022347159999999999, 2023-08-01T19:55:35.399 INFO:teuthology.orchestra.run.smithi008.stdout: "duration": 0.0027761209999999999, 2023-08-01T19:55:35.399 INFO:teuthology.orchestra.run.smithi008.stdout: "type_data": { 2023-08-01T19:55:35.399 INFO:teuthology.orchestra.run.smithi008.stdout: "flag_point": "waiting for sub ops", 2023-08-01T19:55:35.399 INFO:teuthology.orchestra.run.smithi008.stdout: "client_info": { 2023-08-01T19:55:35.400 INFO:teuthology.orchestra.run.smithi008.stdout: "client": "client.4668", 2023-08-01T19:55:35.400 INFO:teuthology.orchestra.run.smithi008.stdout: "client_addr": "172.21.15.6:0/1709472247", 2023-08-01T19:55:35.400 INFO:teuthology.orchestra.run.smithi008.stdout: "tid": 154116 2023-08-01T19:55:35.400 INFO:teuthology.orchestra.run.smithi008.stdout: }, 2023-08-01T19:55:35.400 INFO:teuthology.orchestra.run.smithi008.stdout: "events": [ 2023-08-01T19:55:35.400 INFO:teuthology.orchestra.run.smithi008.stdout: { 2023-08-01T19:55:35.400 INFO:teuthology.orchestra.run.smithi008.stdout: "event": "initiated", 2023-08-01T19:55:35.401 INFO:teuthology.orchestra.run.smithi008.stdout: "time": "2023-08-01T19:55:35.310886+0000", 2023-08-01T19:55:35.401 INFO:teuthology.orchestra.run.smithi008.stdout: "duration": 0 2023-08-01T19:55:35.401 INFO:teuthology.orchestra.run.smithi008.stdout: }, 2023-08-01T19:55:35.401 INFO:teuthology.orchestra.run.smithi008.stdout: { 2023-08-01T19:55:35.401 INFO:teuthology.orchestra.run.smithi008.stdout: "event": "throttled", 2023-08-01T19:55:35.401 INFO:teuthology.orchestra.run.smithi008.stdout: "time": "2023-08-01T19:55:35.310886+0000", 2023-08-01T19:55:35.401 INFO:teuthology.orchestra.run.smithi008.stdout: "duration": 0 2023-08-01T19:55:35.401 INFO:teuthology.orchestra.run.smithi008.stdout: }, 2023-08-01T19:55:35.402 INFO:teuthology.orchestra.run.smithi008.stdout: { 2023-08-01T19:55:35.402 INFO:teuthology.orchestra.run.smithi008.stdout: "event": "header_read", 2023-08-01T19:55:35.402 INFO:teuthology.orchestra.run.smithi008.stdout: "time": "2023-08-01T19:55:35.310886+0000", 2023-08-01T19:55:35.402 INFO:teuthology.orchestra.run.smithi008.stdout: "duration": 4294967295.9999995 2023-08-01T19:55:35.402 INFO:teuthology.orchestra.run.smithi008.stdout: }, 2023-08-01T19:55:35.402 INFO:teuthology.orchestra.run.smithi008.stdout: { 2023-08-01T19:55:35.402 INFO:teuthology.orchestra.run.smithi008.stdout: "event": "all_read", 2023-08-01T19:55:35.402 INFO:teuthology.orchestra.run.smithi008.stdout: "time": "2023-08-01T19:55:35.310889+0000", 2023-08-01T19:55:35.403 INFO:teuthology.orchestra.run.smithi008.stdout: "duration": 2.6429999999999999e-06 2023-08-01T19:55:35.403 INFO:teuthology.orchestra.run.smithi008.stdout: }, 2023-08-01T19:55:35.403 INFO:teuthology.orchestra.run.smithi008.stdout: { 2023-08-01T19:55:35.403 INFO:teuthology.orchestra.run.smithi008.stdout: "event": "dispatched", 2023-08-01T19:55:35.403 INFO:teuthology.orchestra.run.smithi008.stdout: "time": "2023-08-01T19:55:35.310894+0000", 2023-08-01T19:55:35.403 INFO:teuthology.orchestra.run.smithi008.stdout: "duration": 5.699e-06 2023-08-01T19:55:35.403 INFO:teuthology.orchestra.run.smithi008.stdout: }, 2023-08-01T19:55:35.403 INFO:teuthology.orchestra.run.smithi008.stdout: { 2023-08-01T19:55:35.404 INFO:teuthology.orchestra.run.smithi008.stdout: "event": "queued_for_pg", 2023-08-01T19:55:35.404 INFO:teuthology.orchestra.run.smithi008.stdout: "time": "2023-08-01T19:55:35.310898+0000", 2023-08-01T19:55:35.404 INFO:teuthology.orchestra.run.smithi008.stdout: "duration": 3.9960000000000004e-06 2023-08-01T19:55:35.404 INFO:teuthology.orchestra.run.smithi008.stdout: }, 2023-08-01T19:55:35.404 INFO:teuthology.orchestra.run.smithi008.stdout: { 2023-08-01T19:55:35.404 INFO:teuthology.orchestra.run.smithi008.stdout: "event": "reached_pg", 2023-08-01T19:55:35.404 INFO:teuthology.orchestra.run.smithi008.stdout: "time": "2023-08-01T19:55:35.310932+0000", 2023-08-01T19:55:35.404 INFO:teuthology.orchestra.run.smithi008.stdout: "duration": 3.3880000000000001e-05 2023-08-01T19:55:35.405 INFO:teuthology.orchestra.run.smithi008.stdout: }, 2023-08-01T19:55:35.405 INFO:teuthology.orchestra.run.smithi008.stdout: { 2023-08-01T19:55:35.405 INFO:teuthology.orchestra.run.smithi008.stdout: "event": "started", 2023-08-01T19:55:35.405 INFO:teuthology.orchestra.run.smithi008.stdout: "time": "2023-08-01T19:55:35.311050+0000", 2023-08-01T19:55:35.405 INFO:teuthology.orchestra.run.smithi008.stdout: "duration": 0.000117497 2023-08-01T19:55:35.405 INFO:teuthology.orchestra.run.smithi008.stdout: }, 2023-08-01T19:55:35.405 INFO:teuthology.orchestra.run.smithi008.stdout: { 2023-08-01T19:55:35.405 INFO:teuthology.orchestra.run.smithi008.stdout: "event": "waiting for subops from 1", 2023-08-01T19:55:35.406 INFO:teuthology.orchestra.run.smithi008.stdout: "time": "2023-08-01T19:55:35.311176+0000", 2023-08-01T19:55:35.406 INFO:teuthology.orchestra.run.smithi008.stdout: "duration": 0.000126835 2023-08-01T19:55:35.406 INFO:teuthology.orchestra.run.smithi008.stdout: } 2023-08-01T19:55:35.406 INFO:teuthology.orchestra.run.smithi008.stdout: ] 2023-08-01T19:55:35.406 INFO:teuthology.orchestra.run.smithi008.stdout: } 2023-08-01T19:55:35.406 INFO:teuthology.orchestra.run.smithi008.stdout: }, 2023-08-01T19:55:35.406 INFO:teuthology.orchestra.run.smithi008.stdout: { 2023-08-01T19:55:35.406 INFO:teuthology.orchestra.run.smithi008.stdout: "description": "osd_op(client.4668.0:154117 5.a 5:5dd78013:::benchmark_data_smithi006_114134_object20456:head [delete] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e49)", 2023-08-01T19:55:35.407 INFO:teuthology.orchestra.run.smithi008.stdout: "initiated_at": "2023-08-01T19:55:35.311814+0000", 2023-08-01T19:55:35.407 INFO:teuthology.orchestra.run.smithi008.stdout: "age": 0.001306621, 2023-08-01T19:55:35.407 INFO:teuthology.orchestra.run.smithi008.stdout: "duration": 0.001937561, 2023-08-01T19:55:35.407 INFO:teuthology.orchestra.run.smithi008.stdout: "type_data": { 2023-08-01T19:55:35.407 INFO:teuthology.orchestra.run.smithi008.stdout: "flag_point": "waiting for sub ops", 2023-08-01T19:55:35.407 INFO:teuthology.orchestra.run.smithi008.stdout: "client_info": { 2023-08-01T19:55:35.407 INFO:teuthology.orchestra.run.smithi008.stdout: "client": "client.4668", 2023-08-01T19:55:35.408 INFO:teuthology.orchestra.run.smithi008.stdout: "client_addr": "172.21.15.6:0/1709472247", 2023-08-01T19:55:35.408 INFO:teuthology.orchestra.run.smithi008.stdout: "tid": 154117 2023-08-01T19:55:35.408 INFO:teuthology.orchestra.run.smithi008.stdout: }, 2023-08-01T19:55:35.408 INFO:teuthology.orchestra.run.smithi008.stdout: "events": [ 2023-08-01T19:55:35.408 INFO:teuthology.orchestra.run.smithi008.stdout: { 2023-08-01T19:55:35.408 INFO:teuthology.orchestra.run.smithi008.stdout: "event": "initiated", 2023-08-01T19:55:35.408 INFO:teuthology.orchestra.run.smithi008.stdout: "time": "2023-08-01T19:55:35.311814+0000", 2023-08-01T19:55:35.408 INFO:teuthology.orchestra.run.smithi008.stdout: "duration": 0 2023-08-01T19:55:35.409 INFO:teuthology.orchestra.run.smithi008.stdout: }, 2023-08-01T19:55:35.409 INFO:teuthology.orchestra.run.smithi008.stdout: { 2023-08-01T19:55:35.409 INFO:teuthology.orchestra.run.smithi008.stdout: "event": "throttled", 2023-08-01T19:55:35.409 INFO:teuthology.orchestra.run.smithi008.stdout: "time": "2023-08-01T19:55:35.311814+0000", 2023-08-01T19:55:35.409 INFO:teuthology.orchestra.run.smithi008.stdout: "duration": 0 2023-08-01T19:55:35.409 INFO:teuthology.orchestra.run.smithi008.stdout: }, 2023-08-01T19:55:35.409 INFO:teuthology.orchestra.run.smithi008.stdout: { 2023-08-01T19:55:35.409 INFO:teuthology.orchestra.run.smithi008.stdout: "event": "header_read", 2023-08-01T19:55:35.410 INFO:teuthology.orchestra.run.smithi008.stdout: "time": "2023-08-01T19:55:35.311814+0000", 2023-08-01T19:55:35.410 INFO:teuthology.orchestra.run.smithi008.stdout: "duration": 4294967295.999999 2023-08-01T19:55:35.410 INFO:teuthology.orchestra.run.smithi008.stdout: }, 2023-08-01T19:55:35.410 INFO:teuthology.orchestra.run.smithi008.stdout: { 2023-08-01T19:55:35.410 INFO:teuthology.orchestra.run.smithi008.stdout: "event": "all_read", 2023-08-01T19:55:35.410 INFO:teuthology.orchestra.run.smithi008.stdout: "time": "2023-08-01T19:55:35.311819+0000", 2023-08-01T19:55:35.410 INFO:teuthology.orchestra.run.smithi008.stdout: "duration": 5.1699999999999996e-06 2023-08-01T19:55:35.410 INFO:teuthology.orchestra.run.smithi008.stdout: }, 2023-08-01T19:55:35.411 INFO:teuthology.orchestra.run.smithi008.stdout: { 2023-08-01T19:55:35.411 INFO:teuthology.orchestra.run.smithi008.stdout: "event": "dispatched", 2023-08-01T19:55:35.411 INFO:teuthology.orchestra.run.smithi008.stdout: "time": "2023-08-01T19:55:35.311831+0000", 2023-08-01T19:55:35.411 INFO:teuthology.orchestra.run.smithi008.stdout: "duration": 1.2465e-05 2023-08-01T19:55:35.411 INFO:teuthology.orchestra.run.smithi008.stdout: }, 2023-08-01T19:55:35.411 INFO:teuthology.orchestra.run.smithi008.stdout: { 2023-08-01T19:55:35.411 INFO:teuthology.orchestra.run.smithi008.stdout: "event": "queued_for_pg", 2023-08-01T19:55:35.411 INFO:teuthology.orchestra.run.smithi008.stdout: "time": "2023-08-01T19:55:35.311837+0000", 2023-08-01T19:55:35.412 INFO:teuthology.orchestra.run.smithi008.stdout: "duration": 5.7420000000000003e-06 2023-08-01T19:55:35.412 INFO:teuthology.orchestra.run.smithi008.stdout: }, 2023-08-01T19:55:35.412 INFO:teuthology.orchestra.run.smithi008.stdout: { 2023-08-01T19:55:35.412 INFO:teuthology.orchestra.run.smithi008.stdout: "event": "reached_pg", 2023-08-01T19:55:35.412 INFO:teuthology.orchestra.run.smithi008.stdout: "time": "2023-08-01T19:55:35.311872+0000", 2023-08-01T19:55:35.412 INFO:teuthology.orchestra.run.smithi008.stdout: "duration": 3.5428e-05 2023-08-01T19:55:35.412 INFO:teuthology.orchestra.run.smithi008.stdout: }, 2023-08-01T19:55:35.412 INFO:teuthology.orchestra.run.smithi008.stdout: { 2023-08-01T19:55:35.413 INFO:teuthology.orchestra.run.smithi008.stdout: "event": "started", 2023-08-01T19:55:35.413 INFO:teuthology.orchestra.run.smithi008.stdout: "time": "2023-08-01T19:55:35.311974+0000", 2023-08-01T19:55:35.413 INFO:teuthology.orchestra.run.smithi008.stdout: "duration": 0.000102169 2023-08-01T19:55:35.413 INFO:teuthology.orchestra.run.smithi008.stdout: }, 2023-08-01T19:55:35.413 INFO:teuthology.orchestra.run.smithi008.stdout: { 2023-08-01T19:55:35.413 INFO:teuthology.orchestra.run.smithi008.stdout: "event": "waiting for subops from 2", 2023-08-01T19:55:35.413 INFO:teuthology.orchestra.run.smithi008.stdout: "time": "2023-08-01T19:55:35.312073+0000", 2023-08-01T19:55:35.413 INFO:teuthology.orchestra.run.smithi008.stdout: "duration": 9.8531999999999998e-05 2023-08-01T19:55:35.414 INFO:teuthology.orchestra.run.smithi008.stdout: } 2023-08-01T19:55:35.414 INFO:teuthology.orchestra.run.smithi008.stdout: ] 2023-08-01T19:55:35.414 INFO:teuthology.orchestra.run.smithi008.stdout: } 2023-08-01T19:55:35.414 INFO:teuthology.orchestra.run.smithi008.stdout: }, 2023-08-01T19:55:35.414 INFO:teuthology.orchestra.run.smithi008.stdout: { 2023-08-01T19:55:35.414 INFO:teuthology.orchestra.run.smithi008.stdout: "description": "osd_op(client.4668.0:154100 5.c 5:3ce46e05:::benchmark_data_smithi006_114134_object20439:head [delete] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e49)", 2023-08-01T19:55:35.414 INFO:teuthology.orchestra.run.smithi008.stdout: "initiated_at": "2023-08-01T19:55:35.304034+0000", 2023-08-01T19:55:35.415 INFO:teuthology.orchestra.run.smithi008.stdout: "age": 0.0090870949999999999, 2023-08-01T19:55:35.415 INFO:teuthology.orchestra.run.smithi008.stdout: "duration": 0.0097738649999999996, 2023-08-01T19:55:35.415 INFO:teuthology.orchestra.run.smithi008.stdout: "type_data": { 2023-08-01T19:55:35.415 INFO:teuthology.orchestra.run.smithi008.stdout: "flag_point": "waiting for sub ops", 2023-08-01T19:55:35.415 INFO:teuthology.orchestra.run.smithi008.stdout: "client_info": { 2023-08-01T19:55:35.415 INFO:teuthology.orchestra.run.smithi008.stdout: "client": "client.4668", 2023-08-01T19:55:35.415 INFO:teuthology.orchestra.run.smithi008.stdout: "client_addr": "172.21.15.6:0/1709472247", 2023-08-01T19:55:35.415 INFO:teuthology.orchestra.run.smithi008.stdout: "tid": 154100 2023-08-01T19:55:35.416 INFO:teuthology.orchestra.run.smithi008.stdout: }, 2023-08-01T19:55:35.416 INFO:teuthology.orchestra.run.smithi008.stdout: "events": [ 2023-08-01T19:55:35.416 INFO:teuthology.orchestra.run.smithi008.stdout: { 2023-08-01T19:55:35.416 INFO:teuthology.orchestra.run.smithi008.stdout: "event": "initiated", 2023-08-01T19:55:35.416 INFO:teuthology.orchestra.run.smithi008.stdout: "time": "2023-08-01T19:55:35.304034+0000", 2023-08-01T19:55:35.416 INFO:teuthology.orchestra.run.smithi008.stdout: "duration": 0 2023-08-01T19:55:35.416 INFO:teuthology.orchestra.run.smithi008.stdout: }, 2023-08-01T19:55:35.416 INFO:teuthology.orchestra.run.smithi008.stdout: { 2023-08-01T19:55:35.417 INFO:teuthology.orchestra.run.smithi008.stdout: "event": "throttled", 2023-08-01T19:55:35.417 INFO:teuthology.orchestra.run.smithi008.stdout: "time": "2023-08-01T19:55:35.304034+0000", 2023-08-01T19:55:35.417 INFO:teuthology.orchestra.run.smithi008.stdout: "duration": 0 2023-08-01T19:55:35.417 INFO:teuthology.orchestra.run.smithi008.stdout: }, 2023-08-01T19:55:35.417 INFO:teuthology.orchestra.run.smithi008.stdout: { 2023-08-01T19:55:35.417 INFO:teuthology.orchestra.run.smithi008.stdout: "event": "header_read", 2023-08-01T19:55:35.417 INFO:teuthology.orchestra.run.smithi008.stdout: "time": "2023-08-01T19:55:35.304033+0000", 2023-08-01T19:55:35.417 INFO:teuthology.orchestra.run.smithi008.stdout: "duration": 4294967295.999999 2023-08-01T19:55:35.418 INFO:teuthology.orchestra.run.smithi008.stdout: }, 2023-08-01T19:55:35.418 INFO:teuthology.orchestra.run.smithi008.stdout: { 2023-08-01T19:55:35.418 INFO:teuthology.orchestra.run.smithi008.stdout: "event": "all_read", 2023-08-01T19:55:35.418 INFO:teuthology.orchestra.run.smithi008.stdout: "time": "2023-08-01T19:55:35.304038+0000", 2023-08-01T19:55:35.418 INFO:teuthology.orchestra.run.smithi008.stdout: "duration": 4.7770000000000002e-06 2023-08-01T19:55:35.418 INFO:teuthology.orchestra.run.smithi008.stdout: }, 2023-08-01T19:55:35.418 INFO:teuthology.orchestra.run.smithi008.stdout: { 2023-08-01T19:55:35.418 INFO:teuthology.orchestra.run.smithi008.stdout: "event": "dispatched", 2023-08-01T19:55:35.419 INFO:teuthology.orchestra.run.smithi008.stdout: "time": "2023-08-01T19:55:35.304047+0000", 2023-08-01T19:55:35.419 INFO:teuthology.orchestra.run.smithi008.stdout: "duration": 8.6449999999999994e-06 2023-08-01T19:55:35.419 INFO:teuthology.orchestra.run.smithi008.stdout: }, 2023-08-01T19:55:35.419 INFO:teuthology.orchestra.run.smithi008.stdout: { 2023-08-01T19:55:35.419 INFO:teuthology.orchestra.run.smithi008.stdout: "event": "queued_for_pg", 2023-08-01T19:55:35.419 INFO:teuthology.orchestra.run.smithi008.stdout: "time": "2023-08-01T19:55:35.304052+0000", 2023-08-01T19:55:35.419 INFO:teuthology.orchestra.run.smithi008.stdout: "duration": 5.7169999999999996e-06 2023-08-01T19:55:35.419 INFO:teuthology.orchestra.run.smithi008.stdout: }, 2023-08-01T19:55:35.420 INFO:teuthology.orchestra.run.smithi008.stdout: { 2023-08-01T19:55:35.420 INFO:teuthology.orchestra.run.smithi008.stdout: "event": "reached_pg", 2023-08-01T19:55:35.420 INFO:teuthology.orchestra.run.smithi008.stdout: "time": "2023-08-01T19:55:35.305849+0000", 2023-08-01T19:55:35.420 INFO:teuthology.orchestra.run.smithi008.stdout: "duration": 0.0017968960000000001 2023-08-01T19:55:35.420 INFO:teuthology.orchestra.run.smithi008.stdout: }, 2023-08-01T19:55:35.420 INFO:teuthology.orchestra.run.smithi008.stdout: { 2023-08-01T19:55:35.420 INFO:teuthology.orchestra.run.smithi008.stdout: "event": "started", 2023-08-01T19:55:35.420 INFO:teuthology.orchestra.run.smithi008.stdout: "time": "2023-08-01T19:55:35.305976+0000", 2023-08-01T19:55:35.421 INFO:teuthology.orchestra.run.smithi008.stdout: "duration": 0.00012684600000000001 2023-08-01T19:55:35.421 INFO:teuthology.orchestra.run.smithi008.stdout: }, 2023-08-01T19:55:35.421 INFO:teuthology.orchestra.run.smithi008.stdout: { 2023-08-01T19:55:35.421 INFO:teuthology.orchestra.run.smithi008.stdout: "event": "waiting for subops from 1", 2023-08-01T19:55:35.421 INFO:teuthology.orchestra.run.smithi008.stdout: "time": "2023-08-01T19:55:35.306088+0000", 2023-08-01T19:55:35.421 INFO:teuthology.orchestra.run.smithi008.stdout: "duration": 0.000111792 2023-08-01T19:55:35.421 INFO:teuthology.orchestra.run.smithi008.stdout: }, 2023-08-01T19:55:35.421 INFO:teuthology.orchestra.run.smithi008.stdout: { 2023-08-01T19:55:35.422 INFO:teuthology.orchestra.run.smithi008.stdout: "event": "sub_op_commit_rec", 2023-08-01T19:55:35.422 INFO:teuthology.orchestra.run.smithi008.stdout: "time": "2023-08-01T19:55:35.313015+0000", 2023-08-01T19:55:35.422 INFO:teuthology.orchestra.run.smithi008.stdout: "duration": 0.0069270449999999997 2023-08-01T19:55:35.422 INFO:teuthology.orchestra.run.smithi008.stdout: } 2023-08-01T19:55:35.422 INFO:teuthology.orchestra.run.smithi008.stdout: ] 2023-08-01T19:55:35.422 INFO:teuthology.orchestra.run.smithi008.stdout: } 2023-08-01T19:55:35.422 INFO:teuthology.orchestra.run.smithi008.stdout: } 2023-08-01T19:55:35.422 INFO:teuthology.orchestra.run.smithi008.stdout: ], 2023-08-01T19:55:35.423 INFO:teuthology.orchestra.run.smithi008.stdout: "num_ops": 14 2023-08-01T19:55:35.423 INFO:teuthology.orchestra.run.smithi008.stdout:} 2023-08-01T19:55:35.424 INFO:tasks.ceph.osd.1.smithi101.stderr:2023-08-01T19:55:35.422+0000 7fb0cb7f6700 -1 received signal: Hangup from /usr/bin/python3 /bin/daemon-helper kill ceph-osd -f --cluster ceph -i 1 (PID: 111141) UID: 0 2023-08-01T19:55:35.424 DEBUG:teuthology.orchestra.run.smithi008:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 30 ceph --cluster ceph --admin-daemon /var/run/ceph/ceph-osd.0.asok dump_blocked_ops 2023-08-01T19:55:35.525 INFO:tasks.ceph.osd.0.smithi008.stderr:2023-08-01T19:55:35.523+0000 7f16a58f4700 -1 received signal: Hangup from /usr/bin/python3 /bin/daemon-helper kill ceph-osd -f --cluster ceph -i 0 (PID: 111179) UID: 0 2023-08-01T19:55:35.626 INFO:tasks.ceph.osd.1.smithi101.stderr:2023-08-01T19:55:35.624+0000 7fb0cb7f6700 -1 received signal: Hangup from /usr/bin/python3 /bin/daemon-helper kill ceph-osd -f --cluster ceph -i 1 (PID: 111141) UID: 0 2023-08-01T19:55:35.652 INFO:teuthology.orchestra.run.smithi008.stdout:{ 2023-08-01T19:55:35.652 INFO:teuthology.orchestra.run.smithi008.stdout: "ops": [], 2023-08-01T19:55:35.652 INFO:teuthology.orchestra.run.smithi008.stdout: "complaint_time": 30, 2023-08-01T19:55:35.652 INFO:teuthology.orchestra.run.smithi008.stdout: "num_blocked_ops": 0 2023-08-01T19:55:35.652 INFO:teuthology.orchestra.run.smithi008.stdout:} 2023-08-01T19:55:35.667 DEBUG:teuthology.orchestra.run.smithi008:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 30 ceph --cluster ceph --admin-daemon /var/run/ceph/ceph-osd.0.asok dump_historic_ops 2023-08-01T19:55:35.752 INFO:tasks.ceph.osd.0.smithi008.stderr:2023-08-01T19:55:35.750+0000 7f16a58f4700 -1 received signal: Hangup from /usr/bin/python3 /bin/daemon-helper kill ceph-osd -f --cluster ceph -i 0 (PID: 111179) UID: 0 2023-08-01T19:55:35.827 INFO:tasks.ceph.osd.2.smithi155.stderr:2023-08-01T19:55:35.825+0000 7faa5c6ac700 -1 received signal: Hangup from /usr/bin/python3 /bin/daemon-helper kill ceph-osd -f --cluster ceph -i 2 (PID: 111337) UID: 0 2023-08-01T19:55:35.897 INFO:teuthology.orchestra.run.smithi008.stdout:{ 2023-08-01T19:55:35.898 INFO:teuthology.orchestra.run.smithi008.stdout: "size": 20, 2023-08-01T19:55:35.898 INFO:teuthology.orchestra.run.smithi008.stdout: "duration": 600, 2023-08-01T19:55:35.898 INFO:teuthology.orchestra.run.smithi008.stdout: "ops": [ 2023-08-01T19:55:35.898 INFO:teuthology.orchestra.run.smithi008.stdout: { 2023-08-01T19:55:35.898 INFO:teuthology.orchestra.run.smithi008.stdout: "description": "osd_op(client.4668.0:100240 5.a 5:5313c5b9:::benchmark_data_smithi006_114134_object100239:head [set-alloc-hint object_size 65536 write_size 65536,write 0~65536] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e37)", 2023-08-01T19:55:35.898 INFO:teuthology.orchestra.run.smithi008.stdout: "initiated_at": "2023-08-01T19:55:05.148399+0000", 2023-08-01T19:55:35.899 INFO:teuthology.orchestra.run.smithi008.stdout: "age": 30.746454923000002, 2023-08-01T19:55:35.899 INFO:teuthology.orchestra.run.smithi008.stdout: "duration": 0.077278904999999995, 2023-08-01T19:55:35.899 INFO:teuthology.orchestra.run.smithi008.stdout: "type_data": { 2023-08-01T19:55:35.899 INFO:teuthology.orchestra.run.smithi008.stdout: "flag_point": "commit sent; apply or cleanup", 2023-08-01T19:55:35.899 INFO:teuthology.orchestra.run.smithi008.stdout: "client_info": { 2023-08-01T19:55:35.899 INFO:teuthology.orchestra.run.smithi008.stdout: "client": "client.4668", 2023-08-01T19:55:35.899 INFO:teuthology.orchestra.run.smithi008.stdout: "client_addr": "172.21.15.6:0/1709472247", 2023-08-01T19:55:35.899 INFO:teuthology.orchestra.run.smithi008.stdout: "tid": 100240 2023-08-01T19:55:35.900 INFO:teuthology.orchestra.run.smithi008.stdout: }, 2023-08-01T19:55:35.900 INFO:teuthology.orchestra.run.smithi008.stdout: "events": [ 2023-08-01T19:55:35.900 INFO:teuthology.orchestra.run.smithi008.stdout: { 2023-08-01T19:55:35.900 INFO:teuthology.orchestra.run.smithi008.stdout: "event": "initiated", 2023-08-01T19:55:35.900 INFO:teuthology.orchestra.run.smithi008.stdout: "time": "2023-08-01T19:55:05.148399+0000", 2023-08-01T19:55:35.900 INFO:teuthology.orchestra.run.smithi008.stdout: "duration": 0 2023-08-01T19:55:35.900 INFO:teuthology.orchestra.run.smithi008.stdout: }, 2023-08-01T19:55:35.901 INFO:teuthology.orchestra.run.smithi008.stdout: { 2023-08-01T19:55:35.901 INFO:teuthology.orchestra.run.smithi008.stdout: "event": "throttled", 2023-08-01T19:55:35.901 INFO:teuthology.orchestra.run.smithi008.stdout: "time": "2023-08-01T19:55:05.148399+0000", 2023-08-01T19:55:35.901 INFO:teuthology.orchestra.run.smithi008.stdout: "duration": 0 2023-08-01T19:55:35.901 INFO:teuthology.orchestra.run.smithi008.stdout: }, 2023-08-01T19:55:35.901 INFO:teuthology.orchestra.run.smithi008.stdout: { 2023-08-01T19:55:35.901 INFO:teuthology.orchestra.run.smithi008.stdout: "event": "header_read", 2023-08-01T19:55:35.901 INFO:teuthology.orchestra.run.smithi008.stdout: "time": "2023-08-01T19:55:05.148398+0000", 2023-08-01T19:55:35.902 INFO:teuthology.orchestra.run.smithi008.stdout: "duration": 4294967295.999999 2023-08-01T19:55:35.902 INFO:teuthology.orchestra.run.smithi008.stdout: }, 2023-08-01T19:55:35.902 INFO:teuthology.orchestra.run.smithi008.stdout: { 2023-08-01T19:55:35.902 INFO:teuthology.orchestra.run.smithi008.stdout: "event": "all_read", 2023-08-01T19:55:35.902 INFO:teuthology.orchestra.run.smithi008.stdout: "time": "2023-08-01T19:55:05.148492+0000", 2023-08-01T19:55:35.902 INFO:teuthology.orchestra.run.smithi008.stdout: "duration": 9.3892000000000002e-05 2023-08-01T19:55:35.902 INFO:teuthology.orchestra.run.smithi008.stdout: }, 2023-08-01T19:55:35.902 INFO:teuthology.orchestra.run.smithi008.stdout: { 2023-08-01T19:55:35.903 INFO:teuthology.orchestra.run.smithi008.stdout: "event": "dispatched", 2023-08-01T19:55:35.903 INFO:teuthology.orchestra.run.smithi008.stdout: "time": "2023-08-01T19:55:05.148503+0000", 2023-08-01T19:55:35.903 INFO:teuthology.orchestra.run.smithi008.stdout: "duration": 1.0951000000000001e-05 2023-08-01T19:55:35.903 INFO:teuthology.orchestra.run.smithi008.stdout: }, 2023-08-01T19:55:35.903 INFO:teuthology.orchestra.run.smithi008.stdout: { 2023-08-01T19:55:35.903 INFO:teuthology.orchestra.run.smithi008.stdout: "event": "queued_for_pg", 2023-08-01T19:55:35.903 INFO:teuthology.orchestra.run.smithi008.stdout: "time": "2023-08-01T19:55:05.148508+0000", 2023-08-01T19:55:35.903 INFO:teuthology.orchestra.run.smithi008.stdout: "duration": 5.0080000000000002e-06 2023-08-01T19:55:35.904 INFO:teuthology.orchestra.run.smithi008.stdout: }, 2023-08-01T19:55:35.904 INFO:teuthology.orchestra.run.smithi008.stdout: { 2023-08-01T19:55:35.904 INFO:teuthology.orchestra.run.smithi008.stdout: "event": "reached_pg", 2023-08-01T19:55:35.904 INFO:teuthology.orchestra.run.smithi008.stdout: "time": "2023-08-01T19:55:05.148548+0000", 2023-08-01T19:55:35.904 INFO:teuthology.orchestra.run.smithi008.stdout: "duration": 4.0358999999999998e-05 2023-08-01T19:55:35.904 INFO:teuthology.orchestra.run.smithi008.stdout: }, 2023-08-01T19:55:35.904 INFO:teuthology.orchestra.run.smithi008.stdout: { 2023-08-01T19:55:35.904 INFO:teuthology.orchestra.run.smithi008.stdout: "event": "started", 2023-08-01T19:55:35.905 INFO:teuthology.orchestra.run.smithi008.stdout: "time": "2023-08-01T19:55:05.148666+0000", 2023-08-01T19:55:35.905 INFO:teuthology.orchestra.run.smithi008.stdout: "duration": 0.000117621 2023-08-01T19:55:35.905 INFO:teuthology.orchestra.run.smithi008.stdout: }, 2023-08-01T19:55:35.905 INFO:teuthology.orchestra.run.smithi008.stdout: { 2023-08-01T19:55:35.905 INFO:teuthology.orchestra.run.smithi008.stdout: "event": "waiting for subops from 2", 2023-08-01T19:55:35.905 INFO:teuthology.orchestra.run.smithi008.stdout: "time": "2023-08-01T19:55:05.148805+0000", 2023-08-01T19:55:35.905 INFO:teuthology.orchestra.run.smithi008.stdout: "duration": 0.000139176 2023-08-01T19:55:35.905 INFO:teuthology.orchestra.run.smithi008.stdout: }, 2023-08-01T19:55:35.906 INFO:teuthology.orchestra.run.smithi008.stdout: { 2023-08-01T19:55:35.906 INFO:teuthology.orchestra.run.smithi008.stdout: "event": "op_commit", 2023-08-01T19:55:35.906 INFO:teuthology.orchestra.run.smithi008.stdout: "time": "2023-08-01T19:55:05.156143+0000", 2023-08-01T19:55:35.906 INFO:teuthology.orchestra.run.smithi008.stdout: "duration": 0.007338041 2023-08-01T19:55:35.906 INFO:teuthology.orchestra.run.smithi008.stdout: }, 2023-08-01T19:55:35.906 INFO:teuthology.orchestra.run.smithi008.stdout: { 2023-08-01T19:55:35.906 INFO:teuthology.orchestra.run.smithi008.stdout: "event": "sub_op_commit_rec", 2023-08-01T19:55:35.907 INFO:teuthology.orchestra.run.smithi008.stdout: "time": "2023-08-01T19:55:05.225581+0000", 2023-08-01T19:55:35.907 INFO:teuthology.orchestra.run.smithi008.stdout: "duration": 0.069438402999999996 2023-08-01T19:55:35.907 INFO:teuthology.orchestra.run.smithi008.stdout: }, 2023-08-01T19:55:35.907 INFO:teuthology.orchestra.run.smithi008.stdout: { 2023-08-01T19:55:35.907 INFO:teuthology.orchestra.run.smithi008.stdout: "event": "commit_sent", 2023-08-01T19:55:35.907 INFO:teuthology.orchestra.run.smithi008.stdout: "time": "2023-08-01T19:55:05.225632+0000", 2023-08-01T19:55:35.907 INFO:teuthology.orchestra.run.smithi008.stdout: "duration": 5.0382e-05 2023-08-01T19:55:35.907 INFO:teuthology.orchestra.run.smithi008.stdout: }, 2023-08-01T19:55:35.908 INFO:teuthology.orchestra.run.smithi008.stdout: { 2023-08-01T19:55:35.908 INFO:teuthology.orchestra.run.smithi008.stdout: "event": "done", 2023-08-01T19:55:35.908 INFO:teuthology.orchestra.run.smithi008.stdout: "time": "2023-08-01T19:55:05.225677+0000", 2023-08-01T19:55:35.908 INFO:teuthology.orchestra.run.smithi008.stdout: "duration": 4.5893000000000003e-05 2023-08-01T19:55:35.908 INFO:teuthology.orchestra.run.smithi008.stdout: } 2023-08-01T19:55:35.908 INFO:teuthology.orchestra.run.smithi008.stdout: ] 2023-08-01T19:55:35.908 INFO:teuthology.orchestra.run.smithi008.stdout: } 2023-08-01T19:55:35.908 INFO:teuthology.orchestra.run.smithi008.stdout: }, 2023-08-01T19:55:35.909 INFO:teuthology.orchestra.run.smithi008.stdout: { 2023-08-01T19:55:35.909 INFO:teuthology.orchestra.run.smithi008.stdout: "description": "osd_op(client.4668.0:100243 5.a 5:5e8193b6:::benchmark_data_smithi006_114134_object100242:head [set-alloc-hint object_size 65536 write_size 65536,write 0~65536] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e37)", 2023-08-01T19:55:35.909 INFO:teuthology.orchestra.run.smithi008.stdout: "initiated_at": "2023-08-01T19:55:05.150737+0000", 2023-08-01T19:55:35.909 INFO:teuthology.orchestra.run.smithi008.stdout: "age": 30.744116468000001, 2023-08-01T19:55:35.909 INFO:teuthology.orchestra.run.smithi008.stdout: "duration": 0.075019885999999994, 2023-08-01T19:55:35.909 INFO:teuthology.orchestra.run.smithi008.stdout: "type_data": { 2023-08-01T19:55:35.909 INFO:teuthology.orchestra.run.smithi008.stdout: "flag_point": "commit sent; apply or cleanup", 2023-08-01T19:55:35.909 INFO:teuthology.orchestra.run.smithi008.stdout: "client_info": { 2023-08-01T19:55:35.910 INFO:teuthology.orchestra.run.smithi008.stdout: "client": "client.4668", 2023-08-01T19:55:35.910 INFO:teuthology.orchestra.run.smithi008.stdout: "client_addr": "172.21.15.6:0/1709472247", 2023-08-01T19:55:35.910 INFO:teuthology.orchestra.run.smithi008.stdout: "tid": 100243 2023-08-01T19:55:35.910 INFO:teuthology.orchestra.run.smithi008.stdout: }, 2023-08-01T19:55:35.910 INFO:teuthology.orchestra.run.smithi008.stdout: "events": [ 2023-08-01T19:55:35.910 INFO:teuthology.orchestra.run.smithi008.stdout: { 2023-08-01T19:55:35.910 INFO:teuthology.orchestra.run.smithi008.stdout: "event": "initiated", 2023-08-01T19:55:35.910 INFO:teuthology.orchestra.run.smithi008.stdout: "time": "2023-08-01T19:55:05.150737+0000", 2023-08-01T19:55:35.911 INFO:teuthology.orchestra.run.smithi008.stdout: "duration": 0 2023-08-01T19:55:35.911 INFO:teuthology.orchestra.run.smithi008.stdout: }, 2023-08-01T19:55:35.911 INFO:teuthology.orchestra.run.smithi008.stdout: { 2023-08-01T19:55:35.911 INFO:teuthology.orchestra.run.smithi008.stdout: "event": "throttled", 2023-08-01T19:55:35.911 INFO:teuthology.orchestra.run.smithi008.stdout: "time": "2023-08-01T19:55:05.150737+0000", 2023-08-01T19:55:35.911 INFO:teuthology.orchestra.run.smithi008.stdout: "duration": 0 2023-08-01T19:55:35.911 INFO:teuthology.orchestra.run.smithi008.stdout: }, 2023-08-01T19:55:35.911 INFO:teuthology.orchestra.run.smithi008.stdout: { 2023-08-01T19:55:35.912 INFO:teuthology.orchestra.run.smithi008.stdout: "event": "header_read", 2023-08-01T19:55:35.912 INFO:teuthology.orchestra.run.smithi008.stdout: "time": "2023-08-01T19:55:05.150736+0000", 2023-08-01T19:55:35.912 INFO:teuthology.orchestra.run.smithi008.stdout: "duration": 4294967295.999999 2023-08-01T19:55:35.912 INFO:teuthology.orchestra.run.smithi008.stdout: }, 2023-08-01T19:55:35.912 INFO:teuthology.orchestra.run.smithi008.stdout: { 2023-08-01T19:55:35.912 INFO:teuthology.orchestra.run.smithi008.stdout: "event": "all_read", 2023-08-01T19:55:35.912 INFO:teuthology.orchestra.run.smithi008.stdout: "time": "2023-08-01T19:55:05.150780+0000", 2023-08-01T19:55:35.912 INFO:teuthology.orchestra.run.smithi008.stdout: "duration": 4.3578999999999997e-05 2023-08-01T19:55:35.913 INFO:teuthology.orchestra.run.smithi008.stdout: }, 2023-08-01T19:55:35.913 INFO:teuthology.orchestra.run.smithi008.stdout: { 2023-08-01T19:55:35.913 INFO:teuthology.orchestra.run.smithi008.stdout: "event": "dispatched", 2023-08-01T19:55:35.913 INFO:teuthology.orchestra.run.smithi008.stdout: "time": "2023-08-01T19:55:05.150791+0000", 2023-08-01T19:55:35.913 INFO:teuthology.orchestra.run.smithi008.stdout: "duration": 1.0963e-05 2023-08-01T19:55:35.913 INFO:teuthology.orchestra.run.smithi008.stdout: }, 2023-08-01T19:55:35.913 INFO:teuthology.orchestra.run.smithi008.stdout: { 2023-08-01T19:55:35.913 INFO:teuthology.orchestra.run.smithi008.stdout: "event": "queued_for_pg", 2023-08-01T19:55:35.914 INFO:teuthology.orchestra.run.smithi008.stdout: "time": "2023-08-01T19:55:05.150797+0000", 2023-08-01T19:55:35.914 INFO:teuthology.orchestra.run.smithi008.stdout: "duration": 5.9780000000000002e-06 2023-08-01T19:55:35.914 INFO:teuthology.orchestra.run.smithi008.stdout: }, 2023-08-01T19:55:35.914 INFO:teuthology.orchestra.run.smithi008.stdout: { 2023-08-01T19:55:35.914 INFO:teuthology.orchestra.run.smithi008.stdout: "event": "reached_pg", 2023-08-01T19:55:35.914 INFO:teuthology.orchestra.run.smithi008.stdout: "time": "2023-08-01T19:55:05.150833+0000", 2023-08-01T19:55:35.914 INFO:teuthology.orchestra.run.smithi008.stdout: "duration": 3.6000000000000001e-05 2023-08-01T19:55:35.914 INFO:teuthology.orchestra.run.smithi008.stdout: }, 2023-08-01T19:55:35.915 INFO:teuthology.orchestra.run.smithi008.stdout: { 2023-08-01T19:55:35.915 INFO:teuthology.orchestra.run.smithi008.stdout: "event": "started", 2023-08-01T19:55:35.915 INFO:teuthology.orchestra.run.smithi008.stdout: "time": "2023-08-01T19:55:05.150951+0000", 2023-08-01T19:55:35.915 INFO:teuthology.orchestra.run.smithi008.stdout: "duration": 0.00011827799999999999 2023-08-01T19:55:35.915 INFO:teuthology.orchestra.run.smithi008.stdout: }, 2023-08-01T19:55:35.915 INFO:teuthology.orchestra.run.smithi008.stdout: { 2023-08-01T19:55:35.915 INFO:teuthology.orchestra.run.smithi008.stdout: "event": "waiting for subops from 2", 2023-08-01T19:55:35.916 INFO:teuthology.orchestra.run.smithi008.stdout: "time": "2023-08-01T19:55:05.151111+0000", 2023-08-01T19:55:35.916 INFO:teuthology.orchestra.run.smithi008.stdout: "duration": 0.00015961299999999999 2023-08-01T19:55:35.916 INFO:teuthology.orchestra.run.smithi008.stdout: }, 2023-08-01T19:55:35.916 INFO:teuthology.orchestra.run.smithi008.stdout: { 2023-08-01T19:55:35.916 INFO:teuthology.orchestra.run.smithi008.stdout: "event": "op_commit", 2023-08-01T19:55:35.916 INFO:teuthology.orchestra.run.smithi008.stdout: "time": "2023-08-01T19:55:05.156247+0000", 2023-08-01T19:55:35.916 INFO:teuthology.orchestra.run.smithi008.stdout: "duration": 0.005136524 2023-08-01T19:55:35.917 INFO:teuthology.orchestra.run.smithi008.stdout: }, 2023-08-01T19:55:35.917 INFO:teuthology.orchestra.run.smithi008.stdout: { 2023-08-01T19:55:35.917 INFO:teuthology.orchestra.run.smithi008.stdout: "event": "sub_op_commit_rec", 2023-08-01T19:55:35.917 INFO:teuthology.orchestra.run.smithi008.stdout: "time": "2023-08-01T19:55:05.225705+0000", 2023-08-01T19:55:35.917 INFO:teuthology.orchestra.run.smithi008.stdout: "duration": 0.069458377000000002 2023-08-01T19:55:35.917 INFO:teuthology.orchestra.run.smithi008.stdout: }, 2023-08-01T19:55:35.917 INFO:teuthology.orchestra.run.smithi008.stdout: { 2023-08-01T19:55:35.917 INFO:teuthology.orchestra.run.smithi008.stdout: "event": "commit_sent", 2023-08-01T19:55:35.918 INFO:teuthology.orchestra.run.smithi008.stdout: "time": "2023-08-01T19:55:05.225736+0000", 2023-08-01T19:55:35.918 INFO:teuthology.orchestra.run.smithi008.stdout: "duration": 3.0388000000000001e-05 2023-08-01T19:55:35.918 INFO:teuthology.orchestra.run.smithi008.stdout: }, 2023-08-01T19:55:35.918 INFO:teuthology.orchestra.run.smithi008.stdout: { 2023-08-01T19:55:35.918 INFO:teuthology.orchestra.run.smithi008.stdout: "event": "done", 2023-08-01T19:55:35.918 INFO:teuthology.orchestra.run.smithi008.stdout: "time": "2023-08-01T19:55:05.225757+0000", 2023-08-01T19:55:35.918 INFO:teuthology.orchestra.run.smithi008.stdout: "duration": 2.1090999999999998e-05 2023-08-01T19:55:35.918 INFO:teuthology.orchestra.run.smithi008.stdout: } 2023-08-01T19:55:35.919 INFO:teuthology.orchestra.run.smithi008.stdout: ] 2023-08-01T19:55:35.919 INFO:teuthology.orchestra.run.smithi008.stdout: } 2023-08-01T19:55:35.919 INFO:teuthology.orchestra.run.smithi008.stdout: }, 2023-08-01T19:55:35.919 INFO:teuthology.orchestra.run.smithi008.stdout: { 2023-08-01T19:55:35.919 INFO:teuthology.orchestra.run.smithi008.stdout: "description": "osd_op(client.4668.0:100261 5.a 5:562deedb:::benchmark_data_smithi006_114134_object100260:head [set-alloc-hint object_size 65536 write_size 65536,write 0~65536] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e37)", 2023-08-01T19:55:35.919 INFO:teuthology.orchestra.run.smithi008.stdout: "initiated_at": "2023-08-01T19:55:05.163316+0000", 2023-08-01T19:55:35.919 INFO:teuthology.orchestra.run.smithi008.stdout: "age": 30.731537052, 2023-08-01T19:55:35.919 INFO:teuthology.orchestra.run.smithi008.stdout: "duration": 0.063073012999999997, 2023-08-01T19:55:35.920 INFO:teuthology.orchestra.run.smithi008.stdout: "type_data": { 2023-08-01T19:55:35.920 INFO:teuthology.orchestra.run.smithi008.stdout: "flag_point": "commit sent; apply or cleanup", 2023-08-01T19:55:35.920 INFO:teuthology.orchestra.run.smithi008.stdout: "client_info": { 2023-08-01T19:55:35.920 INFO:teuthology.orchestra.run.smithi008.stdout: "client": "client.4668", 2023-08-01T19:55:35.920 INFO:teuthology.orchestra.run.smithi008.stdout: "client_addr": "172.21.15.6:0/1709472247", 2023-08-01T19:55:35.920 INFO:teuthology.orchestra.run.smithi008.stdout: "tid": 100261 2023-08-01T19:55:35.920 INFO:teuthology.orchestra.run.smithi008.stdout: }, 2023-08-01T19:55:35.920 INFO:teuthology.orchestra.run.smithi008.stdout: "events": [ 2023-08-01T19:55:35.921 INFO:teuthology.orchestra.run.smithi008.stdout: { 2023-08-01T19:55:35.921 INFO:teuthology.orchestra.run.smithi008.stdout: "event": "initiated", 2023-08-01T19:55:35.921 INFO:teuthology.orchestra.run.smithi008.stdout: "time": "2023-08-01T19:55:05.163316+0000", 2023-08-01T19:55:35.921 INFO:teuthology.orchestra.run.smithi008.stdout: "duration": 0 2023-08-01T19:55:35.921 INFO:teuthology.orchestra.run.smithi008.stdout: }, 2023-08-01T19:55:35.921 INFO:teuthology.orchestra.run.smithi008.stdout: { 2023-08-01T19:55:35.921 INFO:teuthology.orchestra.run.smithi008.stdout: "event": "throttled", 2023-08-01T19:55:35.922 INFO:teuthology.orchestra.run.smithi008.stdout: "time": "2023-08-01T19:55:05.163316+0000", 2023-08-01T19:55:35.922 INFO:teuthology.orchestra.run.smithi008.stdout: "duration": 0 2023-08-01T19:55:35.922 INFO:teuthology.orchestra.run.smithi008.stdout: }, 2023-08-01T19:55:35.922 INFO:teuthology.orchestra.run.smithi008.stdout: { 2023-08-01T19:55:35.922 INFO:teuthology.orchestra.run.smithi008.stdout: "event": "header_read", 2023-08-01T19:55:35.922 INFO:teuthology.orchestra.run.smithi008.stdout: "time": "2023-08-01T19:55:05.163316+0000", 2023-08-01T19:55:35.922 INFO:teuthology.orchestra.run.smithi008.stdout: "duration": 4294967295.999999 2023-08-01T19:55:35.923 INFO:teuthology.orchestra.run.smithi008.stdout: }, 2023-08-01T19:55:35.923 INFO:teuthology.orchestra.run.smithi008.stdout: { 2023-08-01T19:55:35.923 INFO:teuthology.orchestra.run.smithi008.stdout: "event": "all_read", 2023-08-01T19:55:35.923 INFO:teuthology.orchestra.run.smithi008.stdout: "time": "2023-08-01T19:55:05.163380+0000", 2023-08-01T19:55:35.923 INFO:teuthology.orchestra.run.smithi008.stdout: "duration": 6.4395999999999998e-05 2023-08-01T19:55:35.924 INFO:teuthology.orchestra.run.smithi008.stdout: }, 2023-08-01T19:55:35.924 INFO:teuthology.orchestra.run.smithi008.stdout: { 2023-08-01T19:55:35.924 INFO:teuthology.orchestra.run.smithi008.stdout: "event": "dispatched", 2023-08-01T19:55:35.924 INFO:teuthology.orchestra.run.smithi008.stdout: "time": "2023-08-01T19:55:05.163390+0000", 2023-08-01T19:55:35.924 INFO:teuthology.orchestra.run.smithi008.stdout: "duration": 1.0189e-05 2023-08-01T19:55:35.924 INFO:teuthology.orchestra.run.smithi008.stdout: }, 2023-08-01T19:55:35.924 INFO:teuthology.orchestra.run.smithi008.stdout: { 2023-08-01T19:55:35.925 INFO:teuthology.orchestra.run.smithi008.stdout: "event": "queued_for_pg", 2023-08-01T19:55:35.925 INFO:teuthology.orchestra.run.smithi008.stdout: "time": "2023-08-01T19:55:05.163395+0000", 2023-08-01T19:55:35.925 INFO:teuthology.orchestra.run.smithi008.stdout: "duration": 4.4059999999999998e-06 2023-08-01T19:55:35.925 INFO:teuthology.orchestra.run.smithi008.stdout: }, 2023-08-01T19:55:35.925 INFO:teuthology.orchestra.run.smithi008.stdout: { 2023-08-01T19:55:35.925 INFO:teuthology.orchestra.run.smithi008.stdout: "event": "reached_pg", 2023-08-01T19:55:35.925 INFO:teuthology.orchestra.run.smithi008.stdout: "time": "2023-08-01T19:55:05.163429+0000", 2023-08-01T19:55:35.925 INFO:teuthology.orchestra.run.smithi008.stdout: "duration": 3.4900000000000001e-05 2023-08-01T19:55:35.926 INFO:teuthology.orchestra.run.smithi008.stdout: }, 2023-08-01T19:55:35.926 INFO:teuthology.orchestra.run.smithi008.stdout: { 2023-08-01T19:55:35.926 INFO:teuthology.orchestra.run.smithi008.stdout: "event": "started", 2023-08-01T19:55:35.926 INFO:teuthology.orchestra.run.smithi008.stdout: "time": "2023-08-01T19:55:05.163512+0000", 2023-08-01T19:55:35.926 INFO:teuthology.orchestra.run.smithi008.stdout: "duration": 8.2987999999999999e-05 2023-08-01T19:55:35.926 INFO:teuthology.orchestra.run.smithi008.stdout: }, 2023-08-01T19:55:35.926 INFO:teuthology.orchestra.run.smithi008.stdout: { 2023-08-01T19:55:35.927 INFO:teuthology.orchestra.run.smithi008.stdout: "event": "waiting for subops from 2", 2023-08-01T19:55:35.927 INFO:teuthology.orchestra.run.smithi008.stdout: "time": "2023-08-01T19:55:05.163596+0000", 2023-08-01T19:55:35.927 INFO:teuthology.orchestra.run.smithi008.stdout: "duration": 8.3783999999999996e-05 2023-08-01T19:55:35.927 INFO:teuthology.orchestra.run.smithi008.stdout: }, 2023-08-01T19:55:35.927 INFO:teuthology.orchestra.run.smithi008.stdout: { 2023-08-01T19:55:35.927 INFO:teuthology.orchestra.run.smithi008.stdout: "event": "op_commit", 2023-08-01T19:55:35.927 INFO:teuthology.orchestra.run.smithi008.stdout: "time": "2023-08-01T19:55:05.167129+0000", 2023-08-01T19:55:35.927 INFO:teuthology.orchestra.run.smithi008.stdout: "duration": 0.0035328709999999999 2023-08-01T19:55:35.928 INFO:teuthology.orchestra.run.smithi008.stdout: }, 2023-08-01T19:55:35.928 INFO:teuthology.orchestra.run.smithi008.stdout: { 2023-08-01T19:55:35.928 INFO:teuthology.orchestra.run.smithi008.stdout: "event": "sub_op_commit_rec", 2023-08-01T19:55:35.928 INFO:teuthology.orchestra.run.smithi008.stdout: "time": "2023-08-01T19:55:05.226302+0000", 2023-08-01T19:55:35.928 INFO:teuthology.orchestra.run.smithi008.stdout: "duration": 0.059172711000000003 2023-08-01T19:55:35.928 INFO:teuthology.orchestra.run.smithi008.stdout: }, 2023-08-01T19:55:35.928 INFO:teuthology.orchestra.run.smithi008.stdout: { 2023-08-01T19:55:35.929 INFO:teuthology.orchestra.run.smithi008.stdout: "event": "commit_sent", 2023-08-01T19:55:35.929 INFO:teuthology.orchestra.run.smithi008.stdout: "time": "2023-08-01T19:55:05.226351+0000", 2023-08-01T19:55:35.929 INFO:teuthology.orchestra.run.smithi008.stdout: "duration": 4.969e-05 2023-08-01T19:55:35.929 INFO:teuthology.orchestra.run.smithi008.stdout: }, 2023-08-01T19:55:35.929 INFO:teuthology.orchestra.run.smithi008.stdout: { 2023-08-01T19:55:35.929 INFO:teuthology.orchestra.run.smithi008.stdout: "event": "done", 2023-08-01T19:55:35.929 INFO:teuthology.orchestra.run.smithi008.stdout: "time": "2023-08-01T19:55:05.226389+0000", 2023-08-01T19:55:35.930 INFO:teuthology.orchestra.run.smithi008.stdout: "duration": 3.7978000000000001e-05 2023-08-01T19:55:35.930 INFO:teuthology.orchestra.run.smithi008.stdout: } 2023-08-01T19:55:35.930 INFO:teuthology.orchestra.run.smithi008.stdout: ] 2023-08-01T19:55:35.930 INFO:teuthology.orchestra.run.smithi008.stdout: } 2023-08-01T19:55:35.930 INFO:teuthology.orchestra.run.smithi008.stdout: }, 2023-08-01T19:55:35.930 INFO:teuthology.orchestra.run.smithi008.stdout: { 2023-08-01T19:55:35.930 INFO:teuthology.orchestra.run.smithi008.stdout: "description": "osd_op(client.4668.0:100262 5.a 5:5c636b5d:::benchmark_data_smithi006_114134_object100261:head [set-alloc-hint object_size 65536 write_size 65536,write 0~65536] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e37)", 2023-08-01T19:55:35.930 INFO:teuthology.orchestra.run.smithi008.stdout: "initiated_at": "2023-08-01T19:55:05.165068+0000", 2023-08-01T19:55:35.931 INFO:teuthology.orchestra.run.smithi008.stdout: "age": 30.729785399000001, 2023-08-01T19:55:35.931 INFO:teuthology.orchestra.run.smithi008.stdout: "duration": 0.063919403, 2023-08-01T19:55:35.931 INFO:teuthology.orchestra.run.smithi008.stdout: "type_data": { 2023-08-01T19:55:35.931 INFO:teuthology.orchestra.run.smithi008.stdout: "flag_point": "commit sent; apply or cleanup", 2023-08-01T19:55:35.931 INFO:teuthology.orchestra.run.smithi008.stdout: "client_info": { 2023-08-01T19:55:35.931 INFO:teuthology.orchestra.run.smithi008.stdout: "client": "client.4668", 2023-08-01T19:55:35.931 INFO:teuthology.orchestra.run.smithi008.stdout: "client_addr": "172.21.15.6:0/1709472247", 2023-08-01T19:55:35.931 INFO:teuthology.orchestra.run.smithi008.stdout: "tid": 100262 2023-08-01T19:55:35.932 INFO:teuthology.orchestra.run.smithi008.stdout: }, 2023-08-01T19:55:35.932 INFO:teuthology.orchestra.run.smithi008.stdout: "events": [ 2023-08-01T19:55:35.932 INFO:teuthology.orchestra.run.smithi008.stdout: { 2023-08-01T19:55:35.932 INFO:teuthology.orchestra.run.smithi008.stdout: "event": "initiated", 2023-08-01T19:55:35.932 INFO:teuthology.orchestra.run.smithi008.stdout: "time": "2023-08-01T19:55:05.165068+0000", 2023-08-01T19:55:35.932 INFO:teuthology.orchestra.run.smithi008.stdout: "duration": 0 2023-08-01T19:55:35.932 INFO:teuthology.orchestra.run.smithi008.stdout: }, 2023-08-01T19:55:35.933 INFO:teuthology.orchestra.run.smithi008.stdout: { 2023-08-01T19:55:35.933 INFO:teuthology.orchestra.run.smithi008.stdout: "event": "throttled", 2023-08-01T19:55:35.933 INFO:teuthology.orchestra.run.smithi008.stdout: "time": "2023-08-01T19:55:05.165068+0000", 2023-08-01T19:55:35.933 INFO:teuthology.orchestra.run.smithi008.stdout: "duration": 0 2023-08-01T19:55:35.933 INFO:teuthology.orchestra.run.smithi008.stdout: }, 2023-08-01T19:55:35.933 INFO:teuthology.orchestra.run.smithi008.stdout: { 2023-08-01T19:55:35.934 INFO:teuthology.orchestra.run.smithi008.stdout: "event": "header_read", 2023-08-01T19:55:35.934 INFO:teuthology.orchestra.run.smithi008.stdout: "time": "2023-08-01T19:55:05.165067+0000", 2023-08-01T19:55:35.934 INFO:teuthology.orchestra.run.smithi008.stdout: "duration": 4294967295.999999 2023-08-01T19:55:35.934 INFO:teuthology.orchestra.run.smithi008.stdout: }, 2023-08-01T19:55:35.934 INFO:teuthology.orchestra.run.smithi008.stdout: { 2023-08-01T19:55:35.934 INFO:teuthology.orchestra.run.smithi008.stdout: "event": "all_read", 2023-08-01T19:55:35.934 INFO:teuthology.orchestra.run.smithi008.stdout: "time": "2023-08-01T19:55:05.165126+0000", 2023-08-01T19:55:35.935 INFO:teuthology.orchestra.run.smithi008.stdout: "duration": 5.9116000000000001e-05 2023-08-01T19:55:35.935 INFO:teuthology.orchestra.run.smithi008.stdout: }, 2023-08-01T19:55:35.935 INFO:teuthology.orchestra.run.smithi008.stdout: { 2023-08-01T19:55:35.935 INFO:teuthology.orchestra.run.smithi008.stdout: "event": "dispatched", 2023-08-01T19:55:35.935 INFO:teuthology.orchestra.run.smithi008.stdout: "time": "2023-08-01T19:55:05.165134+0000", 2023-08-01T19:55:35.935 INFO:teuthology.orchestra.run.smithi008.stdout: "duration": 7.9820000000000008e-06 2023-08-01T19:55:35.935 INFO:teuthology.orchestra.run.smithi008.stdout: }, 2023-08-01T19:55:35.935 INFO:teuthology.orchestra.run.smithi008.stdout: { 2023-08-01T19:55:35.936 INFO:teuthology.orchestra.run.smithi008.stdout: "event": "queued_for_pg", 2023-08-01T19:55:35.936 INFO:teuthology.orchestra.run.smithi008.stdout: "time": "2023-08-01T19:55:05.165139+0000", 2023-08-01T19:55:35.936 INFO:teuthology.orchestra.run.smithi008.stdout: "duration": 4.2560000000000004e-06 2023-08-01T19:55:35.936 INFO:teuthology.orchestra.run.smithi008.stdout: }, 2023-08-01T19:55:35.936 INFO:teuthology.orchestra.run.smithi008.stdout: { 2023-08-01T19:55:35.936 INFO:teuthology.orchestra.run.smithi008.stdout: "event": "reached_pg", 2023-08-01T19:55:35.936 INFO:teuthology.orchestra.run.smithi008.stdout: "time": "2023-08-01T19:55:05.165165+0000", 2023-08-01T19:55:35.936 INFO:teuthology.orchestra.run.smithi008.stdout: "duration": 2.6554e-05 2023-08-01T19:55:35.937 INFO:teuthology.orchestra.run.smithi008.stdout: }, 2023-08-01T19:55:35.937 INFO:teuthology.orchestra.run.smithi008.stdout: { 2023-08-01T19:55:35.937 INFO:teuthology.orchestra.run.smithi008.stdout: "event": "started", 2023-08-01T19:55:35.937 INFO:teuthology.orchestra.run.smithi008.stdout: "time": "2023-08-01T19:55:05.165243+0000", 2023-08-01T19:55:35.937 INFO:teuthology.orchestra.run.smithi008.stdout: "duration": 7.7877e-05 2023-08-01T19:55:35.937 INFO:teuthology.orchestra.run.smithi008.stdout: }, 2023-08-01T19:55:35.937 INFO:teuthology.orchestra.run.smithi008.stdout: { 2023-08-01T19:55:35.937 INFO:teuthology.orchestra.run.smithi008.stdout: "event": "waiting for subops from 2", 2023-08-01T19:55:35.938 INFO:teuthology.orchestra.run.smithi008.stdout: "time": "2023-08-01T19:55:05.165450+0000", 2023-08-01T19:55:35.938 INFO:teuthology.orchestra.run.smithi008.stdout: "duration": 0.00020655599999999999 2023-08-01T19:55:35.938 INFO:teuthology.orchestra.run.smithi008.stdout: }, 2023-08-01T19:55:35.938 INFO:teuthology.orchestra.run.smithi008.stdout: { 2023-08-01T19:55:35.938 INFO:teuthology.orchestra.run.smithi008.stdout: "event": "op_commit", 2023-08-01T19:55:35.938 INFO:teuthology.orchestra.run.smithi008.stdout: "time": "2023-08-01T19:55:05.168883+0000", 2023-08-01T19:55:35.938 INFO:teuthology.orchestra.run.smithi008.stdout: "duration": 0.0034333279999999998 2023-08-01T19:55:35.938 INFO:teuthology.orchestra.run.smithi008.stdout: }, 2023-08-01T19:55:35.939 INFO:teuthology.orchestra.run.smithi008.stdout: { 2023-08-01T19:55:35.939 INFO:teuthology.orchestra.run.smithi008.stdout: "event": "sub_op_commit_rec", 2023-08-01T19:55:35.939 INFO:teuthology.orchestra.run.smithi008.stdout: "time": "2023-08-01T19:55:05.228904+0000", 2023-08-01T19:55:35.939 INFO:teuthology.orchestra.run.smithi008.stdout: "duration": 0.060021370999999997 2023-08-01T19:55:35.939 INFO:teuthology.orchestra.run.smithi008.stdout: }, 2023-08-01T19:55:35.939 INFO:teuthology.orchestra.run.smithi008.stdout: { 2023-08-01T19:55:35.939 INFO:teuthology.orchestra.run.smithi008.stdout: "event": "commit_sent", 2023-08-01T19:55:35.940 INFO:teuthology.orchestra.run.smithi008.stdout: "time": "2023-08-01T19:55:05.228952+0000", 2023-08-01T19:55:35.940 INFO:teuthology.orchestra.run.smithi008.stdout: "duration": 4.8056999999999997e-05 2023-08-01T19:55:35.940 INFO:teuthology.orchestra.run.smithi008.stdout: }, 2023-08-01T19:55:35.940 INFO:teuthology.orchestra.run.smithi008.stdout: { 2023-08-01T19:55:35.940 INFO:teuthology.orchestra.run.smithi008.stdout: "event": "done", 2023-08-01T19:55:35.940 INFO:teuthology.orchestra.run.smithi008.stdout: "time": "2023-08-01T19:55:05.228987+0000", 2023-08-01T19:55:35.940 INFO:teuthology.orchestra.run.smithi008.stdout: "duration": 3.5083000000000003e-05 2023-08-01T19:55:35.940 INFO:teuthology.orchestra.run.smithi008.stdout: } 2023-08-01T19:55:35.941 INFO:teuthology.orchestra.run.smithi008.stdout: ] 2023-08-01T19:55:35.941 INFO:teuthology.orchestra.run.smithi008.stdout: } 2023-08-01T19:55:35.941 INFO:teuthology.orchestra.run.smithi008.stdout: }, 2023-08-01T19:55:35.941 INFO:teuthology.orchestra.run.smithi008.stdout: { 2023-08-01T19:55:35.941 INFO:teuthology.orchestra.run.smithi008.stdout: "description": "osd_op(client.4668.0:100929 5.3 5:c29f4adb:::benchmark_data_smithi006_114134_object100928:head [set-alloc-hint object_size 65536 write_size 65536,write 0~65536] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e37)", 2023-08-01T19:55:35.941 INFO:teuthology.orchestra.run.smithi008.stdout: "initiated_at": "2023-08-01T19:55:05.564759+0000", 2023-08-01T19:55:35.941 INFO:teuthology.orchestra.run.smithi008.stdout: "age": 30.330094760000001, 2023-08-01T19:55:35.941 INFO:teuthology.orchestra.run.smithi008.stdout: "duration": 0.062544635000000001, 2023-08-01T19:55:35.942 INFO:teuthology.orchestra.run.smithi008.stdout: "type_data": { 2023-08-01T19:55:35.942 INFO:teuthology.orchestra.run.smithi008.stdout: "flag_point": "commit sent; apply or cleanup", 2023-08-01T19:55:35.942 INFO:teuthology.orchestra.run.smithi008.stdout: "client_info": { 2023-08-01T19:55:35.942 INFO:teuthology.orchestra.run.smithi008.stdout: "client": "client.4668", 2023-08-01T19:55:35.942 INFO:teuthology.orchestra.run.smithi008.stdout: "client_addr": "172.21.15.6:0/1709472247", 2023-08-01T19:55:35.942 INFO:teuthology.orchestra.run.smithi008.stdout: "tid": 100929 2023-08-01T19:55:35.942 INFO:teuthology.orchestra.run.smithi008.stdout: }, 2023-08-01T19:55:35.943 INFO:teuthology.orchestra.run.smithi008.stdout: "events": [ 2023-08-01T19:55:35.943 INFO:teuthology.orchestra.run.smithi008.stdout: { 2023-08-01T19:55:35.943 INFO:teuthology.orchestra.run.smithi008.stdout: "event": "initiated", 2023-08-01T19:55:35.943 INFO:teuthology.orchestra.run.smithi008.stdout: "time": "2023-08-01T19:55:05.564759+0000", 2023-08-01T19:55:35.943 INFO:teuthology.orchestra.run.smithi008.stdout: "duration": 0 2023-08-01T19:55:35.943 INFO:teuthology.orchestra.run.smithi008.stdout: }, 2023-08-01T19:55:35.943 INFO:teuthology.orchestra.run.smithi008.stdout: { 2023-08-01T19:55:35.943 INFO:teuthology.orchestra.run.smithi008.stdout: "event": "throttled", 2023-08-01T19:55:35.944 INFO:teuthology.orchestra.run.smithi008.stdout: "time": "2023-08-01T19:55:05.564759+0000", 2023-08-01T19:55:35.944 INFO:teuthology.orchestra.run.smithi008.stdout: "duration": 0 2023-08-01T19:55:35.944 INFO:teuthology.orchestra.run.smithi008.stdout: }, 2023-08-01T19:55:35.944 INFO:teuthology.orchestra.run.smithi008.stdout: { 2023-08-01T19:55:35.944 INFO:teuthology.orchestra.run.smithi008.stdout: "event": "header_read", 2023-08-01T19:55:35.944 INFO:teuthology.orchestra.run.smithi008.stdout: "time": "2023-08-01T19:55:05.564758+0000", 2023-08-01T19:55:35.944 INFO:teuthology.orchestra.run.smithi008.stdout: "duration": 4294967295.999999 2023-08-01T19:55:35.944 INFO:teuthology.orchestra.run.smithi008.stdout: }, 2023-08-01T19:55:35.945 INFO:teuthology.orchestra.run.smithi008.stdout: { 2023-08-01T19:55:35.945 INFO:teuthology.orchestra.run.smithi008.stdout: "event": "all_read", 2023-08-01T19:55:35.945 INFO:teuthology.orchestra.run.smithi008.stdout: "time": "2023-08-01T19:55:05.564815+0000", 2023-08-01T19:55:35.945 INFO:teuthology.orchestra.run.smithi008.stdout: "duration": 5.7757000000000003e-05 2023-08-01T19:55:35.945 INFO:teuthology.orchestra.run.smithi008.stdout: }, 2023-08-01T19:55:35.945 INFO:teuthology.orchestra.run.smithi008.stdout: { 2023-08-01T19:55:35.945 INFO:teuthology.orchestra.run.smithi008.stdout: "event": "dispatched", 2023-08-01T19:55:35.945 INFO:teuthology.orchestra.run.smithi008.stdout: "time": "2023-08-01T19:55:05.564824+0000", 2023-08-01T19:55:35.946 INFO:teuthology.orchestra.run.smithi008.stdout: "duration": 8.6559999999999998e-06 2023-08-01T19:55:35.946 INFO:teuthology.orchestra.run.smithi008.stdout: }, 2023-08-01T19:55:35.946 INFO:teuthology.orchestra.run.smithi008.stdout: { 2023-08-01T19:55:35.946 INFO:teuthology.orchestra.run.smithi008.stdout: "event": "queued_for_pg", 2023-08-01T19:55:35.946 INFO:teuthology.orchestra.run.smithi008.stdout: "time": "2023-08-01T19:55:05.564829+0000", 2023-08-01T19:55:35.946 INFO:teuthology.orchestra.run.smithi008.stdout: "duration": 4.6160000000000004e-06 2023-08-01T19:55:35.946 INFO:teuthology.orchestra.run.smithi008.stdout: }, 2023-08-01T19:55:35.947 INFO:teuthology.orchestra.run.smithi008.stdout: { 2023-08-01T19:55:35.947 INFO:teuthology.orchestra.run.smithi008.stdout: "event": "reached_pg", 2023-08-01T19:55:35.947 INFO:teuthology.orchestra.run.smithi008.stdout: "time": "2023-08-01T19:55:05.564871+0000", 2023-08-01T19:55:35.947 INFO:teuthology.orchestra.run.smithi008.stdout: "duration": 4.2206000000000002e-05 2023-08-01T19:55:35.947 INFO:teuthology.orchestra.run.smithi008.stdout: }, 2023-08-01T19:55:35.947 INFO:teuthology.orchestra.run.smithi008.stdout: { 2023-08-01T19:55:35.947 INFO:teuthology.orchestra.run.smithi008.stdout: "event": "started", 2023-08-01T19:55:35.947 INFO:teuthology.orchestra.run.smithi008.stdout: "time": "2023-08-01T19:55:05.565011+0000", 2023-08-01T19:55:35.948 INFO:teuthology.orchestra.run.smithi008.stdout: "duration": 0.000140469 2023-08-01T19:55:35.948 INFO:teuthology.orchestra.run.smithi008.stdout: }, 2023-08-01T19:55:35.948 INFO:teuthology.orchestra.run.smithi008.stdout: { 2023-08-01T19:55:35.948 INFO:teuthology.orchestra.run.smithi008.stdout: "event": "waiting for subops from 1", 2023-08-01T19:55:35.948 INFO:teuthology.orchestra.run.smithi008.stdout: "time": "2023-08-01T19:55:05.565212+0000", 2023-08-01T19:55:35.948 INFO:teuthology.orchestra.run.smithi008.stdout: "duration": 0.00020106599999999999 2023-08-01T19:55:35.948 INFO:teuthology.orchestra.run.smithi008.stdout: }, 2023-08-01T19:55:35.948 INFO:teuthology.orchestra.run.smithi008.stdout: { 2023-08-01T19:55:35.949 INFO:teuthology.orchestra.run.smithi008.stdout: "event": "sub_op_commit_rec", 2023-08-01T19:55:35.949 INFO:teuthology.orchestra.run.smithi008.stdout: "time": "2023-08-01T19:55:05.626925+0000", 2023-08-01T19:55:35.949 INFO:teuthology.orchestra.run.smithi008.stdout: "duration": 0.061712111 2023-08-01T19:55:35.949 INFO:teuthology.orchestra.run.smithi008.stdout: }, 2023-08-01T19:55:35.949 INFO:teuthology.orchestra.run.smithi008.stdout: { 2023-08-01T19:55:35.949 INFO:teuthology.orchestra.run.smithi008.stdout: "event": "op_commit", 2023-08-01T19:55:35.949 INFO:teuthology.orchestra.run.smithi008.stdout: "time": "2023-08-01T19:55:05.627217+0000", 2023-08-01T19:55:35.950 INFO:teuthology.orchestra.run.smithi008.stdout: "duration": 0.00029265999999999998 2023-08-01T19:55:35.950 INFO:teuthology.orchestra.run.smithi008.stdout: }, 2023-08-01T19:55:35.950 INFO:teuthology.orchestra.run.smithi008.stdout: { 2023-08-01T19:55:35.950 INFO:teuthology.orchestra.run.smithi008.stdout: "event": "commit_sent", 2023-08-01T19:55:35.950 INFO:teuthology.orchestra.run.smithi008.stdout: "time": "2023-08-01T19:55:05.627264+0000", 2023-08-01T19:55:35.950 INFO:teuthology.orchestra.run.smithi008.stdout: "duration": 4.6260000000000001e-05 2023-08-01T19:55:35.950 INFO:teuthology.orchestra.run.smithi008.stdout: }, 2023-08-01T19:55:35.950 INFO:teuthology.orchestra.run.smithi008.stdout: { 2023-08-01T19:55:35.951 INFO:teuthology.orchestra.run.smithi008.stdout: "event": "done", 2023-08-01T19:55:35.951 INFO:teuthology.orchestra.run.smithi008.stdout: "time": "2023-08-01T19:55:05.627303+0000", 2023-08-01T19:55:35.951 INFO:teuthology.orchestra.run.smithi008.stdout: "duration": 3.9839999999999998e-05 2023-08-01T19:55:35.951 INFO:teuthology.orchestra.run.smithi008.stdout: } 2023-08-01T19:55:35.951 INFO:teuthology.orchestra.run.smithi008.stdout: ] 2023-08-01T19:55:35.951 INFO:teuthology.orchestra.run.smithi008.stdout: } 2023-08-01T19:55:35.951 INFO:teuthology.orchestra.run.smithi008.stdout: }, 2023-08-01T19:55:35.951 INFO:teuthology.orchestra.run.smithi008.stdout: { 2023-08-01T19:55:35.952 INFO:teuthology.orchestra.run.smithi008.stdout: "description": "osd_repop(client.4668.0:100928 5.7 e37/19 5:e61a7dfa:::benchmark_data_smithi006_114134_object100927:head v 37'6273, mlcod=37'6270)", 2023-08-01T19:55:35.952 INFO:teuthology.orchestra.run.smithi008.stdout: "initiated_at": "2023-08-01T19:55:05.565106+0000", 2023-08-01T19:55:35.952 INFO:teuthology.orchestra.run.smithi008.stdout: "age": 30.329747661999999, 2023-08-01T19:55:35.952 INFO:teuthology.orchestra.run.smithi008.stdout: "duration": 0.064091282999999999, 2023-08-01T19:55:35.952 INFO:teuthology.orchestra.run.smithi008.stdout: "type_data": { 2023-08-01T19:55:35.952 INFO:teuthology.orchestra.run.smithi008.stdout: "flag_point": "commit sent; apply or cleanup", 2023-08-01T19:55:35.952 INFO:teuthology.orchestra.run.smithi008.stdout: "events": [ 2023-08-01T19:55:35.952 INFO:teuthology.orchestra.run.smithi008.stdout: { 2023-08-01T19:55:35.953 INFO:teuthology.orchestra.run.smithi008.stdout: "event": "initiated", 2023-08-01T19:55:35.953 INFO:teuthology.orchestra.run.smithi008.stdout: "time": "2023-08-01T19:55:05.565106+0000", 2023-08-01T19:55:35.953 INFO:teuthology.orchestra.run.smithi008.stdout: "duration": 0 2023-08-01T19:55:35.953 INFO:teuthology.orchestra.run.smithi008.stdout: }, 2023-08-01T19:55:35.953 INFO:teuthology.orchestra.run.smithi008.stdout: { 2023-08-01T19:55:35.953 INFO:teuthology.orchestra.run.smithi008.stdout: "event": "throttled", 2023-08-01T19:55:35.953 INFO:teuthology.orchestra.run.smithi008.stdout: "time": "2023-08-01T19:55:05.565106+0000", 2023-08-01T19:55:35.954 INFO:teuthology.orchestra.run.smithi008.stdout: "duration": 0 2023-08-01T19:55:35.954 INFO:teuthology.orchestra.run.smithi008.stdout: }, 2023-08-01T19:55:35.954 INFO:teuthology.orchestra.run.smithi008.stdout: { 2023-08-01T19:55:35.954 INFO:teuthology.orchestra.run.smithi008.stdout: "event": "header_read", 2023-08-01T19:55:35.954 INFO:teuthology.orchestra.run.smithi008.stdout: "time": "2023-08-01T19:55:05.565105+0000", 2023-08-01T19:55:35.954 INFO:teuthology.orchestra.run.smithi008.stdout: "duration": 4294967295.9999995 2023-08-01T19:55:35.954 INFO:teuthology.orchestra.run.smithi008.stdout: }, 2023-08-01T19:55:35.954 INFO:teuthology.orchestra.run.smithi008.stdout: { 2023-08-01T19:55:35.955 INFO:teuthology.orchestra.run.smithi008.stdout: "event": "all_read", 2023-08-01T19:55:35.955 INFO:teuthology.orchestra.run.smithi008.stdout: "time": "2023-08-01T19:55:05.565173+0000", 2023-08-01T19:55:35.955 INFO:teuthology.orchestra.run.smithi008.stdout: "duration": 6.8186000000000001e-05 2023-08-01T19:55:35.955 INFO:teuthology.orchestra.run.smithi008.stdout: }, 2023-08-01T19:55:35.955 INFO:teuthology.orchestra.run.smithi008.stdout: { 2023-08-01T19:55:35.955 INFO:teuthology.orchestra.run.smithi008.stdout: "event": "dispatched", 2023-08-01T19:55:35.955 INFO:teuthology.orchestra.run.smithi008.stdout: "time": "2023-08-01T19:55:05.565182+0000", 2023-08-01T19:55:35.955 INFO:teuthology.orchestra.run.smithi008.stdout: "duration": 8.3620000000000006e-06 2023-08-01T19:55:35.956 INFO:teuthology.orchestra.run.smithi008.stdout: }, 2023-08-01T19:55:35.956 INFO:teuthology.orchestra.run.smithi008.stdout: { 2023-08-01T19:55:35.956 INFO:teuthology.orchestra.run.smithi008.stdout: "event": "queued_for_pg", 2023-08-01T19:55:35.956 INFO:teuthology.orchestra.run.smithi008.stdout: "time": "2023-08-01T19:55:05.565186+0000", 2023-08-01T19:55:35.956 INFO:teuthology.orchestra.run.smithi008.stdout: "duration": 3.7680000000000002e-06 2023-08-01T19:55:35.956 INFO:teuthology.orchestra.run.smithi008.stdout: }, 2023-08-01T19:55:35.956 INFO:teuthology.orchestra.run.smithi008.stdout: { 2023-08-01T19:55:35.956 INFO:teuthology.orchestra.run.smithi008.stdout: "event": "reached_pg", 2023-08-01T19:55:35.957 INFO:teuthology.orchestra.run.smithi008.stdout: "time": "2023-08-01T19:55:05.565212+0000", 2023-08-01T19:55:35.957 INFO:teuthology.orchestra.run.smithi008.stdout: "duration": 2.6230000000000001e-05 2023-08-01T19:55:35.957 INFO:teuthology.orchestra.run.smithi008.stdout: }, 2023-08-01T19:55:35.957 INFO:teuthology.orchestra.run.smithi008.stdout: { 2023-08-01T19:55:35.957 INFO:teuthology.orchestra.run.smithi008.stdout: "event": "started", 2023-08-01T19:55:35.957 INFO:teuthology.orchestra.run.smithi008.stdout: "time": "2023-08-01T19:55:05.565224+0000", 2023-08-01T19:55:35.957 INFO:teuthology.orchestra.run.smithi008.stdout: "duration": 1.2033e-05 2023-08-01T19:55:35.957 INFO:teuthology.orchestra.run.smithi008.stdout: }, 2023-08-01T19:55:35.958 INFO:teuthology.orchestra.run.smithi008.stdout: { 2023-08-01T19:55:35.958 INFO:teuthology.orchestra.run.smithi008.stdout: "event": "commit_sent", 2023-08-01T19:55:35.958 INFO:teuthology.orchestra.run.smithi008.stdout: "time": "2023-08-01T19:55:05.629152+0000", 2023-08-01T19:55:35.958 INFO:teuthology.orchestra.run.smithi008.stdout: "duration": 0.063928378999999994 2023-08-01T19:55:35.958 INFO:teuthology.orchestra.run.smithi008.stdout: }, 2023-08-01T19:55:35.958 INFO:teuthology.orchestra.run.smithi008.stdout: { 2023-08-01T19:55:35.958 INFO:teuthology.orchestra.run.smithi008.stdout: "event": "done", 2023-08-01T19:55:35.958 INFO:teuthology.orchestra.run.smithi008.stdout: "time": "2023-08-01T19:55:05.629197+0000", 2023-08-01T19:55:35.959 INFO:teuthology.orchestra.run.smithi008.stdout: "duration": 4.4894000000000001e-05 2023-08-01T19:55:35.959 INFO:teuthology.orchestra.run.smithi008.stdout: } 2023-08-01T19:55:35.959 INFO:teuthology.orchestra.run.smithi008.stdout: ] 2023-08-01T19:55:35.959 INFO:teuthology.orchestra.run.smithi008.stdout: } 2023-08-01T19:55:35.959 INFO:teuthology.orchestra.run.smithi008.stdout: }, 2023-08-01T19:55:35.959 INFO:teuthology.orchestra.run.smithi008.stdout: { 2023-08-01T19:55:35.959 INFO:teuthology.orchestra.run.smithi008.stdout: "description": "osd_repop(client.4668.0:100927 5.0 e37/19 5:00608ec6:::benchmark_data_smithi006_114134_object100926:head v 37'6408, mlcod=37'6403)", 2023-08-01T19:55:35.960 INFO:teuthology.orchestra.run.smithi008.stdout: "initiated_at": "2023-08-01T19:55:05.565153+0000", 2023-08-01T19:55:35.960 INFO:teuthology.orchestra.run.smithi008.stdout: "age": 30.329700925000001, 2023-08-01T19:55:35.960 INFO:teuthology.orchestra.run.smithi008.stdout: "duration": 0.062202714999999999, 2023-08-01T19:55:35.960 INFO:teuthology.orchestra.run.smithi008.stdout: "type_data": { 2023-08-01T19:55:35.960 INFO:teuthology.orchestra.run.smithi008.stdout: "flag_point": "commit sent; apply or cleanup", 2023-08-01T19:55:35.960 INFO:teuthology.orchestra.run.smithi008.stdout: "events": [ 2023-08-01T19:55:35.960 INFO:teuthology.orchestra.run.smithi008.stdout: { 2023-08-01T19:55:35.960 INFO:teuthology.orchestra.run.smithi008.stdout: "event": "initiated", 2023-08-01T19:55:35.961 INFO:teuthology.orchestra.run.smithi008.stdout: "time": "2023-08-01T19:55:05.565153+0000", 2023-08-01T19:55:35.961 INFO:teuthology.orchestra.run.smithi008.stdout: "duration": 0 2023-08-01T19:55:35.961 INFO:teuthology.orchestra.run.smithi008.stdout: }, 2023-08-01T19:55:35.961 INFO:teuthology.orchestra.run.smithi008.stdout: { 2023-08-01T19:55:35.961 INFO:teuthology.orchestra.run.smithi008.stdout: "event": "throttled", 2023-08-01T19:55:35.961 INFO:teuthology.orchestra.run.smithi008.stdout: "time": "2023-08-01T19:55:05.565153+0000", 2023-08-01T19:55:35.961 INFO:teuthology.orchestra.run.smithi008.stdout: "duration": 0 2023-08-01T19:55:35.961 INFO:teuthology.orchestra.run.smithi008.stdout: }, 2023-08-01T19:55:35.962 INFO:teuthology.orchestra.run.smithi008.stdout: { 2023-08-01T19:55:35.962 INFO:teuthology.orchestra.run.smithi008.stdout: "event": "header_read", 2023-08-01T19:55:35.962 INFO:teuthology.orchestra.run.smithi008.stdout: "time": "2023-08-01T19:55:05.565152+0000", 2023-08-01T19:55:35.962 INFO:teuthology.orchestra.run.smithi008.stdout: "duration": 4294967295.9999995 2023-08-01T19:55:35.962 INFO:teuthology.orchestra.run.smithi008.stdout: }, 2023-08-01T19:55:35.962 INFO:teuthology.orchestra.run.smithi008.stdout: { 2023-08-01T19:55:35.962 INFO:teuthology.orchestra.run.smithi008.stdout: "event": "all_read", 2023-08-01T19:55:35.962 INFO:teuthology.orchestra.run.smithi008.stdout: "time": "2023-08-01T19:55:05.565225+0000", 2023-08-01T19:55:35.963 INFO:teuthology.orchestra.run.smithi008.stdout: "duration": 7.2471000000000005e-05 2023-08-01T19:55:35.963 INFO:teuthology.orchestra.run.smithi008.stdout: }, 2023-08-01T19:55:35.963 INFO:teuthology.orchestra.run.smithi008.stdout: { 2023-08-01T19:55:35.963 INFO:teuthology.orchestra.run.smithi008.stdout: "event": "dispatched", 2023-08-01T19:55:35.963 INFO:teuthology.orchestra.run.smithi008.stdout: "time": "2023-08-01T19:55:05.565229+0000", 2023-08-01T19:55:35.963 INFO:teuthology.orchestra.run.smithi008.stdout: "duration": 4.5600000000000004e-06 2023-08-01T19:55:35.963 INFO:teuthology.orchestra.run.smithi008.stdout: }, 2023-08-01T19:55:35.963 INFO:teuthology.orchestra.run.smithi008.stdout: { 2023-08-01T19:55:35.964 INFO:teuthology.orchestra.run.smithi008.stdout: "event": "queued_for_pg", 2023-08-01T19:55:35.964 INFO:teuthology.orchestra.run.smithi008.stdout: "time": "2023-08-01T19:55:05.565232+0000", 2023-08-01T19:55:35.964 INFO:teuthology.orchestra.run.smithi008.stdout: "duration": 2.6900000000000001e-06 2023-08-01T19:55:35.964 INFO:teuthology.orchestra.run.smithi008.stdout: }, 2023-08-01T19:55:35.964 INFO:teuthology.orchestra.run.smithi008.stdout: { 2023-08-01T19:55:35.964 INFO:teuthology.orchestra.run.smithi008.stdout: "event": "reached_pg", 2023-08-01T19:55:35.964 INFO:teuthology.orchestra.run.smithi008.stdout: "time": "2023-08-01T19:55:05.565283+0000", 2023-08-01T19:55:35.964 INFO:teuthology.orchestra.run.smithi008.stdout: "duration": 5.1442e-05 2023-08-01T19:55:35.965 INFO:teuthology.orchestra.run.smithi008.stdout: }, 2023-08-01T19:55:35.965 INFO:teuthology.orchestra.run.smithi008.stdout: { 2023-08-01T19:55:35.965 INFO:teuthology.orchestra.run.smithi008.stdout: "event": "started", 2023-08-01T19:55:35.965 INFO:teuthology.orchestra.run.smithi008.stdout: "time": "2023-08-01T19:55:05.565301+0000", 2023-08-01T19:55:35.965 INFO:teuthology.orchestra.run.smithi008.stdout: "duration": 1.8029e-05 2023-08-01T19:55:35.965 INFO:teuthology.orchestra.run.smithi008.stdout: }, 2023-08-01T19:55:35.965 INFO:teuthology.orchestra.run.smithi008.stdout: { 2023-08-01T19:55:35.965 INFO:teuthology.orchestra.run.smithi008.stdout: "event": "commit_sent", 2023-08-01T19:55:35.966 INFO:teuthology.orchestra.run.smithi008.stdout: "time": "2023-08-01T19:55:05.627318+0000", 2023-08-01T19:55:35.966 INFO:teuthology.orchestra.run.smithi008.stdout: "duration": 0.062016763000000003 2023-08-01T19:55:35.966 INFO:teuthology.orchestra.run.smithi008.stdout: }, 2023-08-01T19:55:35.966 INFO:teuthology.orchestra.run.smithi008.stdout: { 2023-08-01T19:55:35.966 INFO:teuthology.orchestra.run.smithi008.stdout: "event": "done", 2023-08-01T19:55:35.966 INFO:teuthology.orchestra.run.smithi008.stdout: "time": "2023-08-01T19:55:05.627355+0000", 2023-08-01T19:55:35.966 INFO:teuthology.orchestra.run.smithi008.stdout: "duration": 3.7258999999999997e-05 2023-08-01T19:55:35.966 INFO:teuthology.orchestra.run.smithi008.stdout: } 2023-08-01T19:55:35.967 INFO:teuthology.orchestra.run.smithi008.stdout: ] 2023-08-01T19:55:35.967 INFO:teuthology.orchestra.run.smithi008.stdout: } 2023-08-01T19:55:35.967 INFO:teuthology.orchestra.run.smithi008.stdout: }, 2023-08-01T19:55:35.967 INFO:teuthology.orchestra.run.smithi008.stdout: { 2023-08-01T19:55:35.967 INFO:teuthology.orchestra.run.smithi008.stdout: "description": "osd_op(client.4668.0:100930 5.5 5:a7b64eb3:::benchmark_data_smithi006_114134_object100929:head [set-alloc-hint object_size 65536 write_size 65536,write 0~65536] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e37)", 2023-08-01T19:55:35.967 INFO:teuthology.orchestra.run.smithi008.stdout: "initiated_at": "2023-08-01T19:55:05.565766+0000", 2023-08-01T19:55:35.967 INFO:teuthology.orchestra.run.smithi008.stdout: "age": 30.329087139999999, 2023-08-01T19:55:35.968 INFO:teuthology.orchestra.run.smithi008.stdout: "duration": 0.063668735000000004, 2023-08-01T19:55:35.968 INFO:teuthology.orchestra.run.smithi008.stdout: "type_data": { 2023-08-01T19:55:35.968 INFO:teuthology.orchestra.run.smithi008.stdout: "flag_point": "commit sent; apply or cleanup", 2023-08-01T19:55:35.968 INFO:teuthology.orchestra.run.smithi008.stdout: "client_info": { 2023-08-01T19:55:35.968 INFO:teuthology.orchestra.run.smithi008.stdout: "client": "client.4668", 2023-08-01T19:55:35.968 INFO:teuthology.orchestra.run.smithi008.stdout: "client_addr": "172.21.15.6:0/1709472247", 2023-08-01T19:55:35.968 INFO:teuthology.orchestra.run.smithi008.stdout: "tid": 100930 2023-08-01T19:55:35.968 INFO:teuthology.orchestra.run.smithi008.stdout: }, 2023-08-01T19:55:35.969 INFO:teuthology.orchestra.run.smithi008.stdout: "events": [ 2023-08-01T19:55:35.969 INFO:teuthology.orchestra.run.smithi008.stdout: { 2023-08-01T19:55:35.969 INFO:teuthology.orchestra.run.smithi008.stdout: "event": "initiated", 2023-08-01T19:55:35.969 INFO:teuthology.orchestra.run.smithi008.stdout: "time": "2023-08-01T19:55:05.565766+0000", 2023-08-01T19:55:35.969 INFO:teuthology.orchestra.run.smithi008.stdout: "duration": 0 2023-08-01T19:55:35.969 INFO:teuthology.orchestra.run.smithi008.stdout: }, 2023-08-01T19:55:35.969 INFO:teuthology.orchestra.run.smithi008.stdout: { 2023-08-01T19:55:35.969 INFO:teuthology.orchestra.run.smithi008.stdout: "event": "throttled", 2023-08-01T19:55:35.970 INFO:teuthology.orchestra.run.smithi008.stdout: "time": "2023-08-01T19:55:05.565766+0000", 2023-08-01T19:55:35.970 INFO:teuthology.orchestra.run.smithi008.stdout: "duration": 0 2023-08-01T19:55:35.970 INFO:teuthology.orchestra.run.smithi008.stdout: }, 2023-08-01T19:55:35.970 INFO:teuthology.orchestra.run.smithi008.stdout: { 2023-08-01T19:55:35.970 INFO:teuthology.orchestra.run.smithi008.stdout: "event": "header_read", 2023-08-01T19:55:35.970 INFO:teuthology.orchestra.run.smithi008.stdout: "time": "2023-08-01T19:55:05.565766+0000", 2023-08-01T19:55:35.970 INFO:teuthology.orchestra.run.smithi008.stdout: "duration": 4294967295.999999 2023-08-01T19:55:35.970 INFO:teuthology.orchestra.run.smithi008.stdout: }, 2023-08-01T19:55:35.971 INFO:teuthology.orchestra.run.smithi008.stdout: { 2023-08-01T19:55:35.971 INFO:teuthology.orchestra.run.smithi008.stdout: "event": "all_read", 2023-08-01T19:55:35.971 INFO:teuthology.orchestra.run.smithi008.stdout: "time": "2023-08-01T19:55:05.565855+0000", 2023-08-01T19:55:35.971 INFO:teuthology.orchestra.run.smithi008.stdout: "duration": 8.9166999999999995e-05 2023-08-01T19:55:35.971 INFO:teuthology.orchestra.run.smithi008.stdout: }, 2023-08-01T19:55:35.971 INFO:teuthology.orchestra.run.smithi008.stdout: { 2023-08-01T19:55:35.971 INFO:teuthology.orchestra.run.smithi008.stdout: "event": "dispatched", 2023-08-01T19:55:35.971 INFO:teuthology.orchestra.run.smithi008.stdout: "time": "2023-08-01T19:55:05.565862+0000", 2023-08-01T19:55:35.972 INFO:teuthology.orchestra.run.smithi008.stdout: "duration": 7.4549999999999998e-06 2023-08-01T19:55:35.972 INFO:teuthology.orchestra.run.smithi008.stdout: }, 2023-08-01T19:55:35.972 INFO:teuthology.orchestra.run.smithi008.stdout: { 2023-08-01T19:55:35.972 INFO:teuthology.orchestra.run.smithi008.stdout: "event": "queued_for_pg", 2023-08-01T19:55:35.972 INFO:teuthology.orchestra.run.smithi008.stdout: "time": "2023-08-01T19:55:05.565866+0000", 2023-08-01T19:55:35.972 INFO:teuthology.orchestra.run.smithi008.stdout: "duration": 3.8060000000000001e-06 2023-08-01T19:55:35.972 INFO:teuthology.orchestra.run.smithi008.stdout: }, 2023-08-01T19:55:35.973 INFO:teuthology.orchestra.run.smithi008.stdout: { 2023-08-01T19:55:35.973 INFO:teuthology.orchestra.run.smithi008.stdout: "event": "reached_pg", 2023-08-01T19:55:35.973 INFO:teuthology.orchestra.run.smithi008.stdout: "time": "2023-08-01T19:55:05.565901+0000", 2023-08-01T19:55:35.973 INFO:teuthology.orchestra.run.smithi008.stdout: "duration": 3.5063e-05 2023-08-01T19:55:35.973 INFO:teuthology.orchestra.run.smithi008.stdout: }, 2023-08-01T19:55:35.973 INFO:teuthology.orchestra.run.smithi008.stdout: { 2023-08-01T19:55:35.973 INFO:teuthology.orchestra.run.smithi008.stdout: "event": "started", 2023-08-01T19:55:35.973 INFO:teuthology.orchestra.run.smithi008.stdout: "time": "2023-08-01T19:55:05.566016+0000", 2023-08-01T19:55:35.974 INFO:teuthology.orchestra.run.smithi008.stdout: "duration": 0.00011509400000000001 2023-08-01T19:55:35.974 INFO:teuthology.orchestra.run.smithi008.stdout: }, 2023-08-01T19:55:35.974 INFO:teuthology.orchestra.run.smithi008.stdout: { 2023-08-01T19:55:35.974 INFO:teuthology.orchestra.run.smithi008.stdout: "event": "waiting for subops from 1", 2023-08-01T19:55:35.974 INFO:teuthology.orchestra.run.smithi008.stdout: "time": "2023-08-01T19:55:05.566154+0000", 2023-08-01T19:55:35.974 INFO:teuthology.orchestra.run.smithi008.stdout: "duration": 0.000138052 2023-08-01T19:55:35.974 INFO:teuthology.orchestra.run.smithi008.stdout: }, 2023-08-01T19:55:35.974 INFO:teuthology.orchestra.run.smithi008.stdout: { 2023-08-01T19:55:35.975 INFO:teuthology.orchestra.run.smithi008.stdout: "event": "sub_op_commit_rec", 2023-08-01T19:55:35.975 INFO:teuthology.orchestra.run.smithi008.stdout: "time": "2023-08-01T19:55:05.629279+0000", 2023-08-01T19:55:35.975 INFO:teuthology.orchestra.run.smithi008.stdout: "duration": 0.063124531999999997 2023-08-01T19:55:35.975 INFO:teuthology.orchestra.run.smithi008.stdout: }, 2023-08-01T19:55:35.975 INFO:teuthology.orchestra.run.smithi008.stdout: { 2023-08-01T19:55:35.975 INFO:teuthology.orchestra.run.smithi008.stdout: "event": "op_commit", 2023-08-01T19:55:35.975 INFO:teuthology.orchestra.run.smithi008.stdout: "time": "2023-08-01T19:55:05.629333+0000", 2023-08-01T19:55:35.975 INFO:teuthology.orchestra.run.smithi008.stdout: "duration": 5.4694999999999997e-05 2023-08-01T19:55:35.976 INFO:teuthology.orchestra.run.smithi008.stdout: }, 2023-08-01T19:55:35.976 INFO:teuthology.orchestra.run.smithi008.stdout: { 2023-08-01T19:55:35.976 INFO:teuthology.orchestra.run.smithi008.stdout: "event": "commit_sent", 2023-08-01T19:55:35.976 INFO:teuthology.orchestra.run.smithi008.stdout: "time": "2023-08-01T19:55:05.629390+0000", 2023-08-01T19:55:35.976 INFO:teuthology.orchestra.run.smithi008.stdout: "duration": 5.6416000000000003e-05 2023-08-01T19:55:35.976 INFO:teuthology.orchestra.run.smithi008.stdout: }, 2023-08-01T19:55:35.976 INFO:teuthology.orchestra.run.smithi008.stdout: { 2023-08-01T19:55:35.976 INFO:teuthology.orchestra.run.smithi008.stdout: "event": "done", 2023-08-01T19:55:35.977 INFO:teuthology.orchestra.run.smithi008.stdout: "time": "2023-08-01T19:55:05.629435+0000", 2023-08-01T19:55:35.977 INFO:teuthology.orchestra.run.smithi008.stdout: "duration": 4.5170999999999998e-05 2023-08-01T19:55:35.977 INFO:teuthology.orchestra.run.smithi008.stdout: } 2023-08-01T19:55:35.977 INFO:teuthology.orchestra.run.smithi008.stdout: ] 2023-08-01T19:55:35.977 INFO:teuthology.orchestra.run.smithi008.stdout: } 2023-08-01T19:55:35.977 INFO:teuthology.orchestra.run.smithi008.stdout: }, 2023-08-01T19:55:35.977 INFO:teuthology.orchestra.run.smithi008.stdout: { 2023-08-01T19:55:35.978 INFO:teuthology.orchestra.run.smithi008.stdout: "description": "osd_op(client.4668.0:100933 5.5 5:af92e9f2:::benchmark_data_smithi006_114134_object100932:head [set-alloc-hint object_size 65536 write_size 65536,write 0~65536] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e37)", 2023-08-01T19:55:35.978 INFO:teuthology.orchestra.run.smithi008.stdout: "initiated_at": "2023-08-01T19:55:05.566634+0000", 2023-08-01T19:55:35.978 INFO:teuthology.orchestra.run.smithi008.stdout: "age": 30.328219597, 2023-08-01T19:55:35.978 INFO:teuthology.orchestra.run.smithi008.stdout: "duration": 0.065909364999999998, 2023-08-01T19:55:35.978 INFO:teuthology.orchestra.run.smithi008.stdout: "type_data": { 2023-08-01T19:55:35.978 INFO:teuthology.orchestra.run.smithi008.stdout: "flag_point": "commit sent; apply or cleanup", 2023-08-01T19:55:35.978 INFO:teuthology.orchestra.run.smithi008.stdout: "client_info": { 2023-08-01T19:55:35.978 INFO:teuthology.orchestra.run.smithi008.stdout: "client": "client.4668", 2023-08-01T19:55:35.979 INFO:teuthology.orchestra.run.smithi008.stdout: "client_addr": "172.21.15.6:0/1709472247", 2023-08-01T19:55:35.979 INFO:teuthology.orchestra.run.smithi008.stdout: "tid": 100933 2023-08-01T19:55:35.979 INFO:teuthology.orchestra.run.smithi008.stdout: }, 2023-08-01T19:55:35.979 INFO:teuthology.orchestra.run.smithi008.stdout: "events": [ 2023-08-01T19:55:35.979 INFO:teuthology.orchestra.run.smithi008.stdout: { 2023-08-01T19:55:35.979 INFO:teuthology.orchestra.run.smithi008.stdout: "event": "initiated", 2023-08-01T19:55:35.979 INFO:teuthology.orchestra.run.smithi008.stdout: "time": "2023-08-01T19:55:05.566634+0000", 2023-08-01T19:55:35.979 INFO:teuthology.orchestra.run.smithi008.stdout: "duration": 0 2023-08-01T19:55:35.980 INFO:teuthology.orchestra.run.smithi008.stdout: }, 2023-08-01T19:55:35.980 INFO:teuthology.orchestra.run.smithi008.stdout: { 2023-08-01T19:55:35.980 INFO:teuthology.orchestra.run.smithi008.stdout: "event": "throttled", 2023-08-01T19:55:35.980 INFO:teuthology.orchestra.run.smithi008.stdout: "time": "2023-08-01T19:55:05.566634+0000", 2023-08-01T19:55:35.980 INFO:teuthology.orchestra.run.smithi008.stdout: "duration": 0 2023-08-01T19:55:35.980 INFO:teuthology.orchestra.run.smithi008.stdout: }, 2023-08-01T19:55:35.980 INFO:teuthology.orchestra.run.smithi008.stdout: { 2023-08-01T19:55:35.980 INFO:teuthology.orchestra.run.smithi008.stdout: "event": "header_read", 2023-08-01T19:55:35.981 INFO:teuthology.orchestra.run.smithi008.stdout: "time": "2023-08-01T19:55:05.566630+0000", 2023-08-01T19:55:35.981 INFO:teuthology.orchestra.run.smithi008.stdout: "duration": 4294967295.9999962 2023-08-01T19:55:35.981 INFO:teuthology.orchestra.run.smithi008.stdout: }, 2023-08-01T19:55:35.981 INFO:teuthology.orchestra.run.smithi008.stdout: { 2023-08-01T19:55:35.981 INFO:teuthology.orchestra.run.smithi008.stdout: "event": "all_read", 2023-08-01T19:55:35.981 INFO:teuthology.orchestra.run.smithi008.stdout: "time": "2023-08-01T19:55:05.566736+0000", 2023-08-01T19:55:35.981 INFO:teuthology.orchestra.run.smithi008.stdout: "duration": 0.000105752 2023-08-01T19:55:35.981 INFO:teuthology.orchestra.run.smithi008.stdout: }, 2023-08-01T19:55:35.982 INFO:teuthology.orchestra.run.smithi008.stdout: { 2023-08-01T19:55:35.982 INFO:teuthology.orchestra.run.smithi008.stdout: "event": "dispatched", 2023-08-01T19:55:35.982 INFO:teuthology.orchestra.run.smithi008.stdout: "time": "2023-08-01T19:55:05.566742+0000", 2023-08-01T19:55:35.982 INFO:teuthology.orchestra.run.smithi008.stdout: "duration": 5.8209999999999998e-06 2023-08-01T19:55:35.982 INFO:teuthology.orchestra.run.smithi008.stdout: }, 2023-08-01T19:55:35.982 INFO:teuthology.orchestra.run.smithi008.stdout: { 2023-08-01T19:55:35.982 INFO:teuthology.orchestra.run.smithi008.stdout: "event": "queued_for_pg", 2023-08-01T19:55:35.982 INFO:teuthology.orchestra.run.smithi008.stdout: "time": "2023-08-01T19:55:05.566745+0000", 2023-08-01T19:55:35.983 INFO:teuthology.orchestra.run.smithi008.stdout: "duration": 3.337e-06 2023-08-01T19:55:35.983 INFO:teuthology.orchestra.run.smithi008.stdout: }, 2023-08-01T19:55:35.983 INFO:teuthology.orchestra.run.smithi008.stdout: { 2023-08-01T19:55:35.983 INFO:teuthology.orchestra.run.smithi008.stdout: "event": "reached_pg", 2023-08-01T19:55:35.983 INFO:teuthology.orchestra.run.smithi008.stdout: "time": "2023-08-01T19:55:05.568175+0000", 2023-08-01T19:55:35.983 INFO:teuthology.orchestra.run.smithi008.stdout: "duration": 0.001429647 2023-08-01T19:55:35.983 INFO:teuthology.orchestra.run.smithi008.stdout: }, 2023-08-01T19:55:35.983 INFO:teuthology.orchestra.run.smithi008.stdout: { 2023-08-01T19:55:35.984 INFO:teuthology.orchestra.run.smithi008.stdout: "event": "started", 2023-08-01T19:55:35.984 INFO:teuthology.orchestra.run.smithi008.stdout: "time": "2023-08-01T19:55:05.568288+0000", 2023-08-01T19:55:35.984 INFO:teuthology.orchestra.run.smithi008.stdout: "duration": 0.000113353 2023-08-01T19:55:35.984 INFO:teuthology.orchestra.run.smithi008.stdout: }, 2023-08-01T19:55:35.984 INFO:teuthology.orchestra.run.smithi008.stdout: { 2023-08-01T19:55:35.984 INFO:teuthology.orchestra.run.smithi008.stdout: "event": "waiting for subops from 1", 2023-08-01T19:55:35.984 INFO:teuthology.orchestra.run.smithi008.stdout: "time": "2023-08-01T19:55:05.568425+0000", 2023-08-01T19:55:35.985 INFO:teuthology.orchestra.run.smithi008.stdout: "duration": 0.000137346 2023-08-01T19:55:35.985 INFO:teuthology.orchestra.run.smithi008.stdout: }, 2023-08-01T19:55:35.985 INFO:teuthology.orchestra.run.smithi008.stdout: { 2023-08-01T19:55:35.985 INFO:teuthology.orchestra.run.smithi008.stdout: "event": "sub_op_commit_rec", 2023-08-01T19:55:35.985 INFO:teuthology.orchestra.run.smithi008.stdout: "time": "2023-08-01T19:55:05.629320+0000", 2023-08-01T19:55:35.985 INFO:teuthology.orchestra.run.smithi008.stdout: "duration": 0.060894491000000002 2023-08-01T19:55:35.985 INFO:teuthology.orchestra.run.smithi008.stdout: }, 2023-08-01T19:55:35.985 INFO:teuthology.orchestra.run.smithi008.stdout: { 2023-08-01T19:55:35.986 INFO:teuthology.orchestra.run.smithi008.stdout: "event": "op_commit", 2023-08-01T19:55:35.986 INFO:teuthology.orchestra.run.smithi008.stdout: "time": "2023-08-01T19:55:05.632452+0000", 2023-08-01T19:55:35.986 INFO:teuthology.orchestra.run.smithi008.stdout: "duration": 0.003131909 2023-08-01T19:55:35.986 INFO:teuthology.orchestra.run.smithi008.stdout: }, 2023-08-01T19:55:35.986 INFO:teuthology.orchestra.run.smithi008.stdout: { 2023-08-01T19:55:35.986 INFO:teuthology.orchestra.run.smithi008.stdout: "event": "commit_sent", 2023-08-01T19:55:35.986 INFO:teuthology.orchestra.run.smithi008.stdout: "time": "2023-08-01T19:55:05.632503+0000", 2023-08-01T19:55:35.986 INFO:teuthology.orchestra.run.smithi008.stdout: "duration": 5.1295000000000003e-05 2023-08-01T19:55:35.987 INFO:teuthology.orchestra.run.smithi008.stdout: }, 2023-08-01T19:55:35.987 INFO:teuthology.orchestra.run.smithi008.stdout: { 2023-08-01T19:55:35.987 INFO:teuthology.orchestra.run.smithi008.stdout: "event": "done", 2023-08-01T19:55:35.987 INFO:teuthology.orchestra.run.smithi008.stdout: "time": "2023-08-01T19:55:05.632543+0000", 2023-08-01T19:55:35.987 INFO:teuthology.orchestra.run.smithi008.stdout: "duration": 4.0234000000000001e-05 2023-08-01T19:55:35.987 INFO:teuthology.orchestra.run.smithi008.stdout: } 2023-08-01T19:55:35.987 INFO:teuthology.orchestra.run.smithi008.stdout: ] 2023-08-01T19:55:35.987 INFO:teuthology.orchestra.run.smithi008.stdout: } 2023-08-01T19:55:35.988 INFO:teuthology.orchestra.run.smithi008.stdout: }, 2023-08-01T19:55:35.988 INFO:teuthology.orchestra.run.smithi008.stdout: { 2023-08-01T19:55:35.988 INFO:teuthology.orchestra.run.smithi008.stdout: "description": "osd_repop(client.4668.0:100935 5.e e37/19 5:7895b14e:::benchmark_data_smithi006_114134_object100934:head v 37'6305, mlcod=37'6303)", 2023-08-01T19:55:35.988 INFO:teuthology.orchestra.run.smithi008.stdout: "initiated_at": "2023-08-01T19:55:05.567118+0000", 2023-08-01T19:55:35.988 INFO:teuthology.orchestra.run.smithi008.stdout: "age": 30.327735354000001, 2023-08-01T19:55:35.988 INFO:teuthology.orchestra.run.smithi008.stdout: "duration": 0.063691180999999999, 2023-08-01T19:55:35.988 INFO:teuthology.orchestra.run.smithi008.stdout: "type_data": { 2023-08-01T19:55:35.988 INFO:teuthology.orchestra.run.smithi008.stdout: "flag_point": "commit sent; apply or cleanup", 2023-08-01T19:55:35.989 INFO:teuthology.orchestra.run.smithi008.stdout: "events": [ 2023-08-01T19:55:35.989 INFO:teuthology.orchestra.run.smithi008.stdout: { 2023-08-01T19:55:35.989 INFO:teuthology.orchestra.run.smithi008.stdout: "event": "initiated", 2023-08-01T19:55:35.989 INFO:teuthology.orchestra.run.smithi008.stdout: "time": "2023-08-01T19:55:05.567118+0000", 2023-08-01T19:55:35.989 INFO:teuthology.orchestra.run.smithi008.stdout: "duration": 0 2023-08-01T19:55:35.989 INFO:teuthology.orchestra.run.smithi008.stdout: }, 2023-08-01T19:55:35.989 INFO:teuthology.orchestra.run.smithi008.stdout: { 2023-08-01T19:55:35.989 INFO:teuthology.orchestra.run.smithi008.stdout: "event": "throttled", 2023-08-01T19:55:35.990 INFO:teuthology.orchestra.run.smithi008.stdout: "time": "2023-08-01T19:55:05.567118+0000", 2023-08-01T19:55:35.990 INFO:teuthology.orchestra.run.smithi008.stdout: "duration": 0 2023-08-01T19:55:35.990 INFO:teuthology.orchestra.run.smithi008.stdout: }, 2023-08-01T19:55:35.990 INFO:teuthology.orchestra.run.smithi008.stdout: { 2023-08-01T19:55:35.990 INFO:teuthology.orchestra.run.smithi008.stdout: "event": "header_read", 2023-08-01T19:55:35.990 INFO:teuthology.orchestra.run.smithi008.stdout: "time": "2023-08-01T19:55:05.567117+0000", 2023-08-01T19:55:35.990 INFO:teuthology.orchestra.run.smithi008.stdout: "duration": 4294967295.999999 2023-08-01T19:55:35.990 INFO:teuthology.orchestra.run.smithi008.stdout: }, 2023-08-01T19:55:35.991 INFO:teuthology.orchestra.run.smithi008.stdout: { 2023-08-01T19:55:35.991 INFO:teuthology.orchestra.run.smithi008.stdout: "event": "all_read", 2023-08-01T19:55:35.991 INFO:teuthology.orchestra.run.smithi008.stdout: "time": "2023-08-01T19:55:05.567168+0000", 2023-08-01T19:55:35.991 INFO:teuthology.orchestra.run.smithi008.stdout: "duration": 5.0353999999999999e-05 2023-08-01T19:55:35.991 INFO:teuthology.orchestra.run.smithi008.stdout: }, 2023-08-01T19:55:35.991 INFO:teuthology.orchestra.run.smithi008.stdout: { 2023-08-01T19:55:35.991 INFO:teuthology.orchestra.run.smithi008.stdout: "event": "dispatched", 2023-08-01T19:55:35.991 INFO:teuthology.orchestra.run.smithi008.stdout: "time": "2023-08-01T19:55:05.567175+0000", 2023-08-01T19:55:35.992 INFO:teuthology.orchestra.run.smithi008.stdout: "duration": 7.3919999999999997e-06 2023-08-01T19:55:35.992 INFO:teuthology.orchestra.run.smithi008.stdout: }, 2023-08-01T19:55:35.992 INFO:teuthology.orchestra.run.smithi008.stdout: { 2023-08-01T19:55:35.992 INFO:teuthology.orchestra.run.smithi008.stdout: "event": "queued_for_pg", 2023-08-01T19:55:35.992 INFO:teuthology.orchestra.run.smithi008.stdout: "time": "2023-08-01T19:55:05.567180+0000", 2023-08-01T19:55:35.992 INFO:teuthology.orchestra.run.smithi008.stdout: "duration": 5.3090000000000003e-06 2023-08-01T19:55:35.992 INFO:teuthology.orchestra.run.smithi008.stdout: }, 2023-08-01T19:55:35.992 INFO:teuthology.orchestra.run.smithi008.stdout: { 2023-08-01T19:55:35.993 INFO:teuthology.orchestra.run.smithi008.stdout: "event": "reached_pg", 2023-08-01T19:55:35.993 INFO:teuthology.orchestra.run.smithi008.stdout: "time": "2023-08-01T19:55:05.567210+0000", 2023-08-01T19:55:35.993 INFO:teuthology.orchestra.run.smithi008.stdout: "duration": 3.0001999999999998e-05 2023-08-01T19:55:35.993 INFO:teuthology.orchestra.run.smithi008.stdout: }, 2023-08-01T19:55:35.993 INFO:teuthology.orchestra.run.smithi008.stdout: { 2023-08-01T19:55:35.993 INFO:teuthology.orchestra.run.smithi008.stdout: "event": "started", 2023-08-01T19:55:35.993 INFO:teuthology.orchestra.run.smithi008.stdout: "time": "2023-08-01T19:55:05.567222+0000", 2023-08-01T19:55:35.994 INFO:teuthology.orchestra.run.smithi008.stdout: "duration": 1.1499e-05 2023-08-01T19:55:35.994 INFO:teuthology.orchestra.run.smithi008.stdout: }, 2023-08-01T19:55:35.994 INFO:teuthology.orchestra.run.smithi008.stdout: { 2023-08-01T19:55:35.994 INFO:teuthology.orchestra.run.smithi008.stdout: "event": "commit_sent", 2023-08-01T19:55:35.994 INFO:teuthology.orchestra.run.smithi008.stdout: "time": "2023-08-01T19:55:05.630772+0000", 2023-08-01T19:55:35.994 INFO:teuthology.orchestra.run.smithi008.stdout: "duration": 0.063550572999999999 2023-08-01T19:55:35.994 INFO:teuthology.orchestra.run.smithi008.stdout: }, 2023-08-01T19:55:35.994 INFO:teuthology.orchestra.run.smithi008.stdout: { 2023-08-01T19:55:35.995 INFO:teuthology.orchestra.run.smithi008.stdout: "event": "done", 2023-08-01T19:55:35.995 INFO:teuthology.orchestra.run.smithi008.stdout: "time": "2023-08-01T19:55:05.630809+0000", 2023-08-01T19:55:35.995 INFO:teuthology.orchestra.run.smithi008.stdout: "duration": 3.7033000000000003e-05 2023-08-01T19:55:35.995 INFO:teuthology.orchestra.run.smithi008.stdout: } 2023-08-01T19:55:35.995 INFO:teuthology.orchestra.run.smithi008.stdout: ] 2023-08-01T19:55:35.995 INFO:teuthology.orchestra.run.smithi008.stdout: } 2023-08-01T19:55:35.995 INFO:teuthology.orchestra.run.smithi008.stdout: }, 2023-08-01T19:55:35.995 INFO:teuthology.orchestra.run.smithi008.stdout: { 2023-08-01T19:55:35.996 INFO:teuthology.orchestra.run.smithi008.stdout: "description": "osd_repop(client.4668.0:100936 5.1 e37/19 5:8f4e3576:::benchmark_data_smithi006_114134_object100935:head v 37'6263, mlcod=37'6261)", 2023-08-01T19:55:35.996 INFO:teuthology.orchestra.run.smithi008.stdout: "initiated_at": "2023-08-01T19:55:05.567617+0000", 2023-08-01T19:55:35.996 INFO:teuthology.orchestra.run.smithi008.stdout: "age": 30.327236091, 2023-08-01T19:55:35.996 INFO:teuthology.orchestra.run.smithi008.stdout: "duration": 0.062773918999999997, 2023-08-01T19:55:35.996 INFO:teuthology.orchestra.run.smithi008.stdout: "type_data": { 2023-08-01T19:55:35.996 INFO:teuthology.orchestra.run.smithi008.stdout: "flag_point": "commit sent; apply or cleanup", 2023-08-01T19:55:35.996 INFO:teuthology.orchestra.run.smithi008.stdout: "events": [ 2023-08-01T19:55:35.996 INFO:teuthology.orchestra.run.smithi008.stdout: { 2023-08-01T19:55:35.997 INFO:teuthology.orchestra.run.smithi008.stdout: "event": "initiated", 2023-08-01T19:55:35.997 INFO:teuthology.orchestra.run.smithi008.stdout: "time": "2023-08-01T19:55:05.567617+0000", 2023-08-01T19:55:35.997 INFO:teuthology.orchestra.run.smithi008.stdout: "duration": 0 2023-08-01T19:55:35.997 INFO:teuthology.orchestra.run.smithi008.stdout: }, 2023-08-01T19:55:35.997 INFO:teuthology.orchestra.run.smithi008.stdout: { 2023-08-01T19:55:35.997 INFO:teuthology.orchestra.run.smithi008.stdout: "event": "throttled", 2023-08-01T19:55:35.997 INFO:teuthology.orchestra.run.smithi008.stdout: "time": "2023-08-01T19:55:05.567617+0000", 2023-08-01T19:55:35.997 INFO:teuthology.orchestra.run.smithi008.stdout: "duration": 0 2023-08-01T19:55:35.998 INFO:teuthology.orchestra.run.smithi008.stdout: }, 2023-08-01T19:55:35.998 INFO:teuthology.orchestra.run.smithi008.stdout: { 2023-08-01T19:55:35.998 INFO:teuthology.orchestra.run.smithi008.stdout: "event": "header_read", 2023-08-01T19:55:35.998 INFO:teuthology.orchestra.run.smithi008.stdout: "time": "2023-08-01T19:55:05.567617+0000", 2023-08-01T19:55:35.998 INFO:teuthology.orchestra.run.smithi008.stdout: "duration": 4294967295.9999995 2023-08-01T19:55:35.998 INFO:teuthology.orchestra.run.smithi008.stdout: }, 2023-08-01T19:55:35.998 INFO:teuthology.orchestra.run.smithi008.stdout: { 2023-08-01T19:55:35.998 INFO:teuthology.orchestra.run.smithi008.stdout: "event": "all_read", 2023-08-01T19:55:35.999 INFO:teuthology.orchestra.run.smithi008.stdout: "time": "2023-08-01T19:55:05.567700+0000", 2023-08-01T19:55:35.999 INFO:teuthology.orchestra.run.smithi008.stdout: "duration": 8.3363999999999997e-05 2023-08-01T19:55:35.999 INFO:teuthology.orchestra.run.smithi008.stdout: }, 2023-08-01T19:55:35.999 INFO:teuthology.orchestra.run.smithi008.stdout: { 2023-08-01T19:55:35.999 INFO:teuthology.orchestra.run.smithi008.stdout: "event": "dispatched", 2023-08-01T19:55:35.999 INFO:teuthology.orchestra.run.smithi008.stdout: "time": "2023-08-01T19:55:05.567706+0000", 2023-08-01T19:55:35.999 INFO:teuthology.orchestra.run.smithi008.stdout: "duration": 5.9739999999999999e-06 2023-08-01T19:55:36.000 INFO:teuthology.orchestra.run.smithi008.stdout: }, 2023-08-01T19:55:36.000 INFO:teuthology.orchestra.run.smithi008.stdout: { 2023-08-01T19:55:36.000 INFO:teuthology.orchestra.run.smithi008.stdout: "event": "queued_for_pg", 2023-08-01T19:55:36.000 INFO:teuthology.orchestra.run.smithi008.stdout: "time": "2023-08-01T19:55:05.567709+0000", 2023-08-01T19:55:36.000 INFO:teuthology.orchestra.run.smithi008.stdout: "duration": 3.1420000000000002e-06 2023-08-01T19:55:36.000 INFO:teuthology.orchestra.run.smithi008.stdout: }, 2023-08-01T19:55:36.000 INFO:teuthology.orchestra.run.smithi008.stdout: { 2023-08-01T19:55:36.000 INFO:teuthology.orchestra.run.smithi008.stdout: "event": "reached_pg", 2023-08-01T19:55:36.001 INFO:teuthology.orchestra.run.smithi008.stdout: "time": "2023-08-01T19:55:05.567741+0000", 2023-08-01T19:55:36.001 INFO:teuthology.orchestra.run.smithi008.stdout: "duration": 3.1532999999999998e-05 2023-08-01T19:55:36.001 INFO:teuthology.orchestra.run.smithi008.stdout: }, 2023-08-01T19:55:36.001 INFO:teuthology.orchestra.run.smithi008.stdout: { 2023-08-01T19:55:36.001 INFO:teuthology.orchestra.run.smithi008.stdout: "event": "started", 2023-08-01T19:55:36.001 INFO:teuthology.orchestra.run.smithi008.stdout: "time": "2023-08-01T19:55:05.567752+0000", 2023-08-01T19:55:36.001 INFO:teuthology.orchestra.run.smithi008.stdout: "duration": 1.1266e-05 2023-08-01T19:55:36.001 INFO:teuthology.orchestra.run.smithi008.stdout: }, 2023-08-01T19:55:36.002 INFO:teuthology.orchestra.run.smithi008.stdout: { 2023-08-01T19:55:36.002 INFO:teuthology.orchestra.run.smithi008.stdout: "event": "commit_sent", 2023-08-01T19:55:36.002 INFO:teuthology.orchestra.run.smithi008.stdout: "time": "2023-08-01T19:55:05.630357+0000", 2023-08-01T19:55:36.002 INFO:teuthology.orchestra.run.smithi008.stdout: "duration": 0.062604554000000007 2023-08-01T19:55:36.002 INFO:teuthology.orchestra.run.smithi008.stdout: }, 2023-08-01T19:55:36.002 INFO:teuthology.orchestra.run.smithi008.stdout: { 2023-08-01T19:55:36.002 INFO:teuthology.orchestra.run.smithi008.stdout: "event": "done", 2023-08-01T19:55:36.002 INFO:teuthology.orchestra.run.smithi008.stdout: "time": "2023-08-01T19:55:05.630391+0000", 2023-08-01T19:55:36.003 INFO:teuthology.orchestra.run.smithi008.stdout: "duration": 3.4619000000000002e-05 2023-08-01T19:55:36.003 INFO:teuthology.orchestra.run.smithi008.stdout: } 2023-08-01T19:55:36.003 INFO:teuthology.orchestra.run.smithi008.stdout: ] 2023-08-01T19:55:36.003 INFO:teuthology.orchestra.run.smithi008.stdout: } 2023-08-01T19:55:36.003 INFO:teuthology.orchestra.run.smithi008.stdout: }, 2023-08-01T19:55:36.003 INFO:teuthology.orchestra.run.smithi008.stdout: { 2023-08-01T19:55:36.003 INFO:teuthology.orchestra.run.smithi008.stdout: "description": "osd_op(client.4668.0:100937 5.c 5:34445fc3:::benchmark_data_smithi006_114134_object100936:head [set-alloc-hint object_size 65536 write_size 65536,write 0~65536] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e37)", 2023-08-01T19:55:36.003 INFO:teuthology.orchestra.run.smithi008.stdout: "initiated_at": "2023-08-01T19:55:05.569198+0000", 2023-08-01T19:55:36.004 INFO:teuthology.orchestra.run.smithi008.stdout: "age": 30.325655468000001, 2023-08-01T19:55:36.004 INFO:teuthology.orchestra.run.smithi008.stdout: "duration": 0.063349390000000005, 2023-08-01T19:55:36.004 INFO:teuthology.orchestra.run.smithi008.stdout: "type_data": { 2023-08-01T19:55:36.004 INFO:teuthology.orchestra.run.smithi008.stdout: "flag_point": "commit sent; apply or cleanup", 2023-08-01T19:55:36.004 INFO:teuthology.orchestra.run.smithi008.stdout: "client_info": { 2023-08-01T19:55:36.004 INFO:teuthology.orchestra.run.smithi008.stdout: "client": "client.4668", 2023-08-01T19:55:36.004 INFO:teuthology.orchestra.run.smithi008.stdout: "client_addr": "172.21.15.6:0/1709472247", 2023-08-01T19:55:36.005 INFO:teuthology.orchestra.run.smithi008.stdout: "tid": 100937 2023-08-01T19:55:36.005 INFO:teuthology.orchestra.run.smithi008.stdout: }, 2023-08-01T19:55:36.005 INFO:teuthology.orchestra.run.smithi008.stdout: "events": [ 2023-08-01T19:55:36.005 INFO:teuthology.orchestra.run.smithi008.stdout: { 2023-08-01T19:55:36.005 INFO:teuthology.orchestra.run.smithi008.stdout: "event": "initiated", 2023-08-01T19:55:36.005 INFO:teuthology.orchestra.run.smithi008.stdout: "time": "2023-08-01T19:55:05.569198+0000", 2023-08-01T19:55:36.005 INFO:teuthology.orchestra.run.smithi008.stdout: "duration": 0 2023-08-01T19:55:36.005 INFO:teuthology.orchestra.run.smithi008.stdout: }, 2023-08-01T19:55:36.006 INFO:teuthology.orchestra.run.smithi008.stdout: { 2023-08-01T19:55:36.006 INFO:teuthology.orchestra.run.smithi008.stdout: "event": "throttled", 2023-08-01T19:55:36.006 INFO:teuthology.orchestra.run.smithi008.stdout: "time": "2023-08-01T19:55:05.569198+0000", 2023-08-01T19:55:36.006 INFO:teuthology.orchestra.run.smithi008.stdout: "duration": 0 2023-08-01T19:55:36.006 INFO:teuthology.orchestra.run.smithi008.stdout: }, 2023-08-01T19:55:36.006 INFO:teuthology.orchestra.run.smithi008.stdout: { 2023-08-01T19:55:36.006 INFO:teuthology.orchestra.run.smithi008.stdout: "event": "header_read", 2023-08-01T19:55:36.006 INFO:teuthology.orchestra.run.smithi008.stdout: "time": "2023-08-01T19:55:05.569197+0000", 2023-08-01T19:55:36.007 INFO:teuthology.orchestra.run.smithi008.stdout: "duration": 4294967295.999999 2023-08-01T19:55:36.007 INFO:teuthology.orchestra.run.smithi008.stdout: }, 2023-08-01T19:55:36.007 INFO:teuthology.orchestra.run.smithi008.stdout: { 2023-08-01T19:55:36.007 INFO:teuthology.orchestra.run.smithi008.stdout: "event": "all_read", 2023-08-01T19:55:36.007 INFO:teuthology.orchestra.run.smithi008.stdout: "time": "2023-08-01T19:55:05.569250+0000", 2023-08-01T19:55:36.007 INFO:teuthology.orchestra.run.smithi008.stdout: "duration": 5.3106000000000003e-05 2023-08-01T19:55:36.007 INFO:teuthology.orchestra.run.smithi008.stdout: }, 2023-08-01T19:55:36.007 INFO:teuthology.orchestra.run.smithi008.stdout: { 2023-08-01T19:55:36.008 INFO:teuthology.orchestra.run.smithi008.stdout: "event": "dispatched", 2023-08-01T19:55:36.008 INFO:teuthology.orchestra.run.smithi008.stdout: "time": "2023-08-01T19:55:05.569260+0000", 2023-08-01T19:55:36.008 INFO:teuthology.orchestra.run.smithi008.stdout: "duration": 9.533e-06 2023-08-01T19:55:36.008 INFO:teuthology.orchestra.run.smithi008.stdout: }, 2023-08-01T19:55:36.008 INFO:teuthology.orchestra.run.smithi008.stdout: { 2023-08-01T19:55:36.008 INFO:teuthology.orchestra.run.smithi008.stdout: "event": "queued_for_pg", 2023-08-01T19:55:36.008 INFO:teuthology.orchestra.run.smithi008.stdout: "time": "2023-08-01T19:55:05.569264+0000", 2023-08-01T19:55:36.008 INFO:teuthology.orchestra.run.smithi008.stdout: "duration": 4.6099999999999999e-06 2023-08-01T19:55:36.009 INFO:teuthology.orchestra.run.smithi008.stdout: }, 2023-08-01T19:55:36.009 INFO:teuthology.orchestra.run.smithi008.stdout: { 2023-08-01T19:55:36.009 INFO:teuthology.orchestra.run.smithi008.stdout: "event": "reached_pg", 2023-08-01T19:55:36.009 INFO:teuthology.orchestra.run.smithi008.stdout: "time": "2023-08-01T19:55:05.569293+0000", 2023-08-01T19:55:36.009 INFO:teuthology.orchestra.run.smithi008.stdout: "duration": 2.8181999999999999e-05 2023-08-01T19:55:36.009 INFO:teuthology.orchestra.run.smithi008.stdout: }, 2023-08-01T19:55:36.009 INFO:teuthology.orchestra.run.smithi008.stdout: { 2023-08-01T19:55:36.009 INFO:teuthology.orchestra.run.smithi008.stdout: "event": "started", 2023-08-01T19:55:36.010 INFO:teuthology.orchestra.run.smithi008.stdout: "time": "2023-08-01T19:55:05.569401+0000", 2023-08-01T19:55:36.010 INFO:teuthology.orchestra.run.smithi008.stdout: "duration": 0.000108065 2023-08-01T19:55:36.010 INFO:teuthology.orchestra.run.smithi008.stdout: }, 2023-08-01T19:55:36.010 INFO:teuthology.orchestra.run.smithi008.stdout: { 2023-08-01T19:55:36.010 INFO:teuthology.orchestra.run.smithi008.stdout: "event": "waiting for subops from 1", 2023-08-01T19:55:36.010 INFO:teuthology.orchestra.run.smithi008.stdout: "time": "2023-08-01T19:55:05.569521+0000", 2023-08-01T19:55:36.010 INFO:teuthology.orchestra.run.smithi008.stdout: "duration": 0.00012006900000000001 2023-08-01T19:55:36.010 INFO:teuthology.orchestra.run.smithi008.stdout: }, 2023-08-01T19:55:36.011 INFO:teuthology.orchestra.run.smithi008.stdout: { 2023-08-01T19:55:36.011 INFO:teuthology.orchestra.run.smithi008.stdout: "event": "sub_op_commit_rec", 2023-08-01T19:55:36.011 INFO:teuthology.orchestra.run.smithi008.stdout: "time": "2023-08-01T19:55:05.629421+0000", 2023-08-01T19:55:36.011 INFO:teuthology.orchestra.run.smithi008.stdout: "duration": 0.059900525000000003 2023-08-01T19:55:36.011 INFO:teuthology.orchestra.run.smithi008.stdout: }, 2023-08-01T19:55:36.011 INFO:teuthology.orchestra.run.smithi008.stdout: { 2023-08-01T19:55:36.011 INFO:teuthology.orchestra.run.smithi008.stdout: "event": "op_commit", 2023-08-01T19:55:36.011 INFO:teuthology.orchestra.run.smithi008.stdout: "time": "2023-08-01T19:55:05.632461+0000", 2023-08-01T19:55:36.012 INFO:teuthology.orchestra.run.smithi008.stdout: "duration": 0.0030401220000000001 2023-08-01T19:55:36.012 INFO:teuthology.orchestra.run.smithi008.stdout: }, 2023-08-01T19:55:36.012 INFO:teuthology.orchestra.run.smithi008.stdout: { 2023-08-01T19:55:36.012 INFO:teuthology.orchestra.run.smithi008.stdout: "event": "commit_sent", 2023-08-01T19:55:36.012 INFO:teuthology.orchestra.run.smithi008.stdout: "time": "2023-08-01T19:55:05.632507+0000", 2023-08-01T19:55:36.012 INFO:teuthology.orchestra.run.smithi008.stdout: "duration": 4.5361999999999997e-05 2023-08-01T19:55:36.012 INFO:teuthology.orchestra.run.smithi008.stdout: }, 2023-08-01T19:55:36.012 INFO:teuthology.orchestra.run.smithi008.stdout: { 2023-08-01T19:55:36.013 INFO:teuthology.orchestra.run.smithi008.stdout: "event": "done", 2023-08-01T19:55:36.013 INFO:teuthology.orchestra.run.smithi008.stdout: "time": "2023-08-01T19:55:05.632547+0000", 2023-08-01T19:55:36.013 INFO:teuthology.orchestra.run.smithi008.stdout: "duration": 4.0760999999999998e-05 2023-08-01T19:55:36.013 INFO:teuthology.orchestra.run.smithi008.stdout: } 2023-08-01T19:55:36.013 INFO:teuthology.orchestra.run.smithi008.stdout: ] 2023-08-01T19:55:36.013 INFO:teuthology.orchestra.run.smithi008.stdout: } 2023-08-01T19:55:36.013 INFO:teuthology.orchestra.run.smithi008.stdout: }, 2023-08-01T19:55:36.014 INFO:teuthology.orchestra.run.smithi008.stdout: { 2023-08-01T19:55:36.014 INFO:teuthology.orchestra.run.smithi008.stdout: "description": "osd_op(client.4668.0:100939 5.5 5:a75fa6e3:::benchmark_data_smithi006_114134_object100938:head [set-alloc-hint object_size 65536 write_size 65536,write 0~65536] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e37)", 2023-08-01T19:55:36.014 INFO:teuthology.orchestra.run.smithi008.stdout: "initiated_at": "2023-08-01T19:55:05.569740+0000", 2023-08-01T19:55:36.014 INFO:teuthology.orchestra.run.smithi008.stdout: "age": 30.325113926, 2023-08-01T19:55:36.014 INFO:teuthology.orchestra.run.smithi008.stdout: "duration": 0.067753412999999998, 2023-08-01T19:55:36.014 INFO:teuthology.orchestra.run.smithi008.stdout: "type_data": { 2023-08-01T19:55:36.014 INFO:teuthology.orchestra.run.smithi008.stdout: "flag_point": "commit sent; apply or cleanup", 2023-08-01T19:55:36.014 INFO:teuthology.orchestra.run.smithi008.stdout: "client_info": { 2023-08-01T19:55:36.015 INFO:teuthology.orchestra.run.smithi008.stdout: "client": "client.4668", 2023-08-01T19:55:36.015 INFO:teuthology.orchestra.run.smithi008.stdout: "client_addr": "172.21.15.6:0/1709472247", 2023-08-01T19:55:36.015 INFO:teuthology.orchestra.run.smithi008.stdout: "tid": 100939 2023-08-01T19:55:36.015 INFO:teuthology.orchestra.run.smithi008.stdout: }, 2023-08-01T19:55:36.015 INFO:teuthology.orchestra.run.smithi008.stdout: "events": [ 2023-08-01T19:55:36.015 INFO:teuthology.orchestra.run.smithi008.stdout: { 2023-08-01T19:55:36.015 INFO:teuthology.orchestra.run.smithi008.stdout: "event": "initiated", 2023-08-01T19:55:36.015 INFO:teuthology.orchestra.run.smithi008.stdout: "time": "2023-08-01T19:55:05.569740+0000", 2023-08-01T19:55:36.016 INFO:teuthology.orchestra.run.smithi008.stdout: "duration": 0 2023-08-01T19:55:36.016 INFO:teuthology.orchestra.run.smithi008.stdout: }, 2023-08-01T19:55:36.016 INFO:teuthology.orchestra.run.smithi008.stdout: { 2023-08-01T19:55:36.016 INFO:teuthology.orchestra.run.smithi008.stdout: "event": "throttled", 2023-08-01T19:55:36.016 INFO:teuthology.orchestra.run.smithi008.stdout: "time": "2023-08-01T19:55:05.569740+0000", 2023-08-01T19:55:36.016 INFO:teuthology.orchestra.run.smithi008.stdout: "duration": 0 2023-08-01T19:55:36.016 INFO:teuthology.orchestra.run.smithi008.stdout: }, 2023-08-01T19:55:36.016 INFO:teuthology.orchestra.run.smithi008.stdout: { 2023-08-01T19:55:36.017 INFO:teuthology.orchestra.run.smithi008.stdout: "event": "header_read", 2023-08-01T19:55:36.017 INFO:teuthology.orchestra.run.smithi008.stdout: "time": "2023-08-01T19:55:05.569739+0000", 2023-08-01T19:55:36.017 INFO:teuthology.orchestra.run.smithi008.stdout: "duration": 4294967295.9999995 2023-08-01T19:55:36.017 INFO:teuthology.orchestra.run.smithi008.stdout: }, 2023-08-01T19:55:36.017 INFO:teuthology.orchestra.run.smithi008.stdout: { 2023-08-01T19:55:36.017 INFO:teuthology.orchestra.run.smithi008.stdout: "event": "all_read", 2023-08-01T19:55:36.017 INFO:teuthology.orchestra.run.smithi008.stdout: "time": "2023-08-01T19:55:05.569839+0000", 2023-08-01T19:55:36.017 INFO:teuthology.orchestra.run.smithi008.stdout: "duration": 0.000100219 2023-08-01T19:55:36.018 INFO:teuthology.orchestra.run.smithi008.stdout: }, 2023-08-01T19:55:36.018 INFO:teuthology.orchestra.run.smithi008.stdout: { 2023-08-01T19:55:36.018 INFO:teuthology.orchestra.run.smithi008.stdout: "event": "dispatched", 2023-08-01T19:55:36.018 INFO:teuthology.orchestra.run.smithi008.stdout: "time": "2023-08-01T19:55:05.569846+0000", 2023-08-01T19:55:36.018 INFO:teuthology.orchestra.run.smithi008.stdout: "duration": 7.3150000000000003e-06 2023-08-01T19:55:36.018 INFO:teuthology.orchestra.run.smithi008.stdout: }, 2023-08-01T19:55:36.018 INFO:teuthology.orchestra.run.smithi008.stdout: { 2023-08-01T19:55:36.018 INFO:teuthology.orchestra.run.smithi008.stdout: "event": "queued_for_pg", 2023-08-01T19:55:36.019 INFO:teuthology.orchestra.run.smithi008.stdout: "time": "2023-08-01T19:55:05.569850+0000", 2023-08-01T19:55:36.019 INFO:teuthology.orchestra.run.smithi008.stdout: "duration": 3.3299999999999999e-06 2023-08-01T19:55:36.019 INFO:teuthology.orchestra.run.smithi008.stdout: }, 2023-08-01T19:55:36.019 INFO:teuthology.orchestra.run.smithi008.stdout: { 2023-08-01T19:55:36.019 INFO:teuthology.orchestra.run.smithi008.stdout: "event": "reached_pg", 2023-08-01T19:55:36.019 INFO:teuthology.orchestra.run.smithi008.stdout: "time": "2023-08-01T19:55:05.626991+0000", 2023-08-01T19:55:36.019 INFO:teuthology.orchestra.run.smithi008.stdout: "duration": 0.057141585000000002 2023-08-01T19:55:36.019 INFO:teuthology.orchestra.run.smithi008.stdout: }, 2023-08-01T19:55:36.020 INFO:teuthology.orchestra.run.smithi008.stdout: { 2023-08-01T19:55:36.020 INFO:teuthology.orchestra.run.smithi008.stdout: "event": "started", 2023-08-01T19:55:36.020 INFO:teuthology.orchestra.run.smithi008.stdout: "time": "2023-08-01T19:55:05.627111+0000", 2023-08-01T19:55:36.020 INFO:teuthology.orchestra.run.smithi008.stdout: "duration": 0.000119238 2023-08-01T19:55:36.020 INFO:teuthology.orchestra.run.smithi008.stdout: }, 2023-08-01T19:55:36.020 INFO:teuthology.orchestra.run.smithi008.stdout: { 2023-08-01T19:55:36.020 INFO:teuthology.orchestra.run.smithi008.stdout: "event": "waiting for subops from 1", 2023-08-01T19:55:36.021 INFO:teuthology.orchestra.run.smithi008.stdout: "time": "2023-08-01T19:55:05.627253+0000", 2023-08-01T19:55:36.021 INFO:teuthology.orchestra.run.smithi008.stdout: "duration": 0.000142822 2023-08-01T19:55:36.021 INFO:teuthology.orchestra.run.smithi008.stdout: }, 2023-08-01T19:55:36.021 INFO:teuthology.orchestra.run.smithi008.stdout: { 2023-08-01T19:55:36.021 INFO:teuthology.orchestra.run.smithi008.stdout: "event": "op_commit", 2023-08-01T19:55:36.021 INFO:teuthology.orchestra.run.smithi008.stdout: "time": "2023-08-01T19:55:05.632555+0000", 2023-08-01T19:55:36.021 INFO:teuthology.orchestra.run.smithi008.stdout: "duration": 0.0053012449999999996 2023-08-01T19:55:36.021 INFO:teuthology.orchestra.run.smithi008.stdout: }, 2023-08-01T19:55:36.022 INFO:teuthology.orchestra.run.smithi008.stdout: { 2023-08-01T19:55:36.022 INFO:teuthology.orchestra.run.smithi008.stdout: "event": "sub_op_commit_rec", 2023-08-01T19:55:36.022 INFO:teuthology.orchestra.run.smithi008.stdout: "time": "2023-08-01T19:55:05.637380+0000", 2023-08-01T19:55:36.022 INFO:teuthology.orchestra.run.smithi008.stdout: "duration": 0.0048257639999999997 2023-08-01T19:55:36.022 INFO:teuthology.orchestra.run.smithi008.stdout: }, 2023-08-01T19:55:36.022 INFO:teuthology.orchestra.run.smithi008.stdout: { 2023-08-01T19:55:36.022 INFO:teuthology.orchestra.run.smithi008.stdout: "event": "commit_sent", 2023-08-01T19:55:36.022 INFO:teuthology.orchestra.run.smithi008.stdout: "time": "2023-08-01T19:55:05.637454+0000", 2023-08-01T19:55:36.023 INFO:teuthology.orchestra.run.smithi008.stdout: "duration": 7.3578999999999995e-05 2023-08-01T19:55:36.023 INFO:teuthology.orchestra.run.smithi008.stdout: }, 2023-08-01T19:55:36.023 INFO:teuthology.orchestra.run.smithi008.stdout: { 2023-08-01T19:55:36.023 INFO:teuthology.orchestra.run.smithi008.stdout: "event": "done", 2023-08-01T19:55:36.023 INFO:teuthology.orchestra.run.smithi008.stdout: "time": "2023-08-01T19:55:05.637493+0000", 2023-08-01T19:55:36.023 INFO:teuthology.orchestra.run.smithi008.stdout: "duration": 3.8986999999999998e-05 2023-08-01T19:55:36.023 INFO:teuthology.orchestra.run.smithi008.stdout: } 2023-08-01T19:55:36.023 INFO:teuthology.orchestra.run.smithi008.stdout: ] 2023-08-01T19:55:36.024 INFO:teuthology.orchestra.run.smithi008.stdout: } 2023-08-01T19:55:36.024 INFO:teuthology.orchestra.run.smithi008.stdout: }, 2023-08-01T19:55:36.024 INFO:teuthology.orchestra.run.smithi008.stdout: { 2023-08-01T19:55:36.024 INFO:teuthology.orchestra.run.smithi008.stdout: "description": "osd_repop(client.4668.0:100941 5.e e37/19 5:736a6ac6:::benchmark_data_smithi006_114134_object100940:head v 37'6306, mlcod=37'6303)", 2023-08-01T19:55:36.024 INFO:teuthology.orchestra.run.smithi008.stdout: "initiated_at": "2023-08-01T19:55:05.570237+0000", 2023-08-01T19:55:36.024 INFO:teuthology.orchestra.run.smithi008.stdout: "age": 30.324616616, 2023-08-01T19:55:36.024 INFO:teuthology.orchestra.run.smithi008.stdout: "duration": 0.064830421999999999, 2023-08-01T19:55:36.024 INFO:teuthology.orchestra.run.smithi008.stdout: "type_data": { 2023-08-01T19:55:36.025 INFO:teuthology.orchestra.run.smithi008.stdout: "flag_point": "commit sent; apply or cleanup", 2023-08-01T19:55:36.025 INFO:teuthology.orchestra.run.smithi008.stdout: "events": [ 2023-08-01T19:55:36.025 INFO:teuthology.orchestra.run.smithi008.stdout: { 2023-08-01T19:55:36.025 INFO:teuthology.orchestra.run.smithi008.stdout: "event": "initiated", 2023-08-01T19:55:36.025 INFO:teuthology.orchestra.run.smithi008.stdout: "time": "2023-08-01T19:55:05.570237+0000", 2023-08-01T19:55:36.025 INFO:teuthology.orchestra.run.smithi008.stdout: "duration": 0 2023-08-01T19:55:36.025 INFO:teuthology.orchestra.run.smithi008.stdout: }, 2023-08-01T19:55:36.025 INFO:teuthology.orchestra.run.smithi008.stdout: { 2023-08-01T19:55:36.026 INFO:teuthology.orchestra.run.smithi008.stdout: "event": "throttled", 2023-08-01T19:55:36.026 INFO:teuthology.orchestra.run.smithi008.stdout: "time": "2023-08-01T19:55:05.570237+0000", 2023-08-01T19:55:36.026 INFO:teuthology.orchestra.run.smithi008.stdout: "duration": 0 2023-08-01T19:55:36.026 INFO:teuthology.orchestra.run.smithi008.stdout: }, 2023-08-01T19:55:36.026 INFO:teuthology.orchestra.run.smithi008.stdout: { 2023-08-01T19:55:36.026 INFO:teuthology.orchestra.run.smithi008.stdout: "event": "header_read", 2023-08-01T19:55:36.026 INFO:teuthology.orchestra.run.smithi008.stdout: "time": "2023-08-01T19:55:05.570236+0000", 2023-08-01T19:55:36.026 INFO:teuthology.orchestra.run.smithi008.stdout: "duration": 4294967295.9999995 2023-08-01T19:55:36.027 INFO:teuthology.orchestra.run.smithi008.stdout: }, 2023-08-01T19:55:36.027 INFO:teuthology.orchestra.run.smithi008.stdout: { 2023-08-01T19:55:36.027 INFO:teuthology.orchestra.run.smithi008.stdout: "event": "all_read", 2023-08-01T19:55:36.027 INFO:teuthology.orchestra.run.smithi008.stdout: "time": "2023-08-01T19:55:05.570354+0000", 2023-08-01T19:55:36.027 INFO:teuthology.orchestra.run.smithi008.stdout: "duration": 0.000118029 2023-08-01T19:55:36.027 INFO:teuthology.orchestra.run.smithi008.stdout: }, 2023-08-01T19:55:36.027 INFO:teuthology.orchestra.run.smithi008.stdout: { 2023-08-01T19:55:36.027 INFO:teuthology.orchestra.run.smithi008.stdout: "event": "dispatched", 2023-08-01T19:55:36.028 INFO:teuthology.orchestra.run.smithi008.stdout: "time": "2023-08-01T19:55:05.626649+0000", 2023-08-01T19:55:36.028 INFO:teuthology.orchestra.run.smithi008.stdout: "duration": 0.056294489000000003 2023-08-01T19:55:36.028 INFO:teuthology.orchestra.run.smithi008.stdout: }, 2023-08-01T19:55:36.028 INFO:teuthology.orchestra.run.smithi008.stdout: { 2023-08-01T19:55:36.028 INFO:teuthology.orchestra.run.smithi008.stdout: "event": "queued_for_pg", 2023-08-01T19:55:36.028 INFO:teuthology.orchestra.run.smithi008.stdout: "time": "2023-08-01T19:55:05.626676+0000", 2023-08-01T19:55:36.028 INFO:teuthology.orchestra.run.smithi008.stdout: "duration": 2.7228000000000001e-05 2023-08-01T19:55:36.029 INFO:teuthology.orchestra.run.smithi008.stdout: }, 2023-08-01T19:55:36.029 INFO:teuthology.orchestra.run.smithi008.stdout: { 2023-08-01T19:55:36.029 INFO:teuthology.orchestra.run.smithi008.stdout: "event": "reached_pg", 2023-08-01T19:55:36.029 INFO:teuthology.orchestra.run.smithi008.stdout: "time": "2023-08-01T19:55:05.626717+0000", 2023-08-01T19:55:36.029 INFO:teuthology.orchestra.run.smithi008.stdout: "duration": 4.1318e-05 2023-08-01T19:55:36.029 INFO:teuthology.orchestra.run.smithi008.stdout: }, 2023-08-01T19:55:36.029 INFO:teuthology.orchestra.run.smithi008.stdout: { 2023-08-01T19:55:36.029 INFO:teuthology.orchestra.run.smithi008.stdout: "event": "started", 2023-08-01T19:55:36.030 INFO:teuthology.orchestra.run.smithi008.stdout: "time": "2023-08-01T19:55:05.626737+0000", 2023-08-01T19:55:36.030 INFO:teuthology.orchestra.run.smithi008.stdout: "duration": 1.9415e-05 2023-08-01T19:55:36.030 INFO:teuthology.orchestra.run.smithi008.stdout: }, 2023-08-01T19:55:36.030 INFO:teuthology.orchestra.run.smithi008.stdout: { 2023-08-01T19:55:36.030 INFO:teuthology.orchestra.run.smithi008.stdout: "event": "commit_sent", 2023-08-01T19:55:36.030 INFO:teuthology.orchestra.run.smithi008.stdout: "time": "2023-08-01T19:55:05.635036+0000", 2023-08-01T19:55:36.030 INFO:teuthology.orchestra.run.smithi008.stdout: "duration": 0.0082987700000000005 2023-08-01T19:55:36.030 INFO:teuthology.orchestra.run.smithi008.stdout: }, 2023-08-01T19:55:36.031 INFO:teuthology.orchestra.run.smithi008.stdout: { 2023-08-01T19:55:36.031 INFO:teuthology.orchestra.run.smithi008.stdout: "event": "done", 2023-08-01T19:55:36.031 INFO:teuthology.orchestra.run.smithi008.stdout: "time": "2023-08-01T19:55:05.635067+0000", 2023-08-01T19:55:36.031 INFO:teuthology.orchestra.run.smithi008.stdout: "duration": 3.1786999999999999e-05 2023-08-01T19:55:36.031 INFO:teuthology.orchestra.run.smithi008.stdout: } 2023-08-01T19:55:36.031 INFO:teuthology.orchestra.run.smithi008.stdout: ] 2023-08-01T19:55:36.031 INFO:teuthology.orchestra.run.smithi008.stdout: } 2023-08-01T19:55:36.031 INFO:teuthology.orchestra.run.smithi008.stdout: }, 2023-08-01T19:55:36.032 INFO:teuthology.orchestra.run.smithi008.stdout: { 2023-08-01T19:55:36.032 INFO:teuthology.orchestra.run.smithi008.stdout: "description": "osd_op(client.4668.0:107863 5.3 5:cbdd875a:::benchmark_data_smithi006_114134_object107862:head [set-alloc-hint object_size 65536 write_size 65536,write 0~65536] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e38)", 2023-08-01T19:55:36.032 INFO:teuthology.orchestra.run.smithi008.stdout: "initiated_at": "2023-08-01T19:55:09.278851+0000", 2023-08-01T19:55:36.032 INFO:teuthology.orchestra.run.smithi008.stdout: "age": 26.616002185999999, 2023-08-01T19:55:36.032 INFO:teuthology.orchestra.run.smithi008.stdout: "duration": 0.071378853000000006, 2023-08-01T19:55:36.032 INFO:teuthology.orchestra.run.smithi008.stdout: "type_data": { 2023-08-01T19:55:36.032 INFO:teuthology.orchestra.run.smithi008.stdout: "flag_point": "commit sent; apply or cleanup", 2023-08-01T19:55:36.032 INFO:teuthology.orchestra.run.smithi008.stdout: "client_info": { 2023-08-01T19:55:36.033 INFO:teuthology.orchestra.run.smithi008.stdout: "client": "client.4668", 2023-08-01T19:55:36.033 INFO:teuthology.orchestra.run.smithi008.stdout: "client_addr": "172.21.15.6:0/1709472247", 2023-08-01T19:55:36.033 INFO:teuthology.orchestra.run.smithi008.stdout: "tid": 107863 2023-08-01T19:55:36.033 INFO:teuthology.orchestra.run.smithi008.stdout: }, 2023-08-01T19:55:36.033 INFO:teuthology.orchestra.run.smithi008.stdout: "events": [ 2023-08-01T19:55:36.033 INFO:teuthology.orchestra.run.smithi008.stdout: { 2023-08-01T19:55:36.033 INFO:teuthology.orchestra.run.smithi008.stdout: "event": "initiated", 2023-08-01T19:55:36.033 INFO:teuthology.orchestra.run.smithi008.stdout: "time": "2023-08-01T19:55:09.278851+0000", 2023-08-01T19:55:36.034 INFO:teuthology.orchestra.run.smithi008.stdout: "duration": 0 2023-08-01T19:55:36.034 INFO:teuthology.orchestra.run.smithi008.stdout: }, 2023-08-01T19:55:36.034 INFO:teuthology.orchestra.run.smithi008.stdout: { 2023-08-01T19:55:36.034 INFO:teuthology.orchestra.run.smithi008.stdout: "event": "throttled", 2023-08-01T19:55:36.034 INFO:teuthology.orchestra.run.smithi008.stdout: "time": "2023-08-01T19:55:09.278851+0000", 2023-08-01T19:55:36.034 INFO:teuthology.orchestra.run.smithi008.stdout: "duration": 0 2023-08-01T19:55:36.034 INFO:teuthology.orchestra.run.smithi008.stdout: }, 2023-08-01T19:55:36.034 INFO:teuthology.orchestra.run.smithi008.stdout: { 2023-08-01T19:55:36.035 INFO:teuthology.orchestra.run.smithi008.stdout: "event": "header_read", 2023-08-01T19:55:36.035 INFO:teuthology.orchestra.run.smithi008.stdout: "time": "2023-08-01T19:55:09.278850+0000", 2023-08-01T19:55:36.035 INFO:teuthology.orchestra.run.smithi008.stdout: "duration": 4294967295.999999 2023-08-01T19:55:36.035 INFO:teuthology.orchestra.run.smithi008.stdout: }, 2023-08-01T19:55:36.035 INFO:teuthology.orchestra.run.smithi008.stdout: { 2023-08-01T19:55:36.035 INFO:teuthology.orchestra.run.smithi008.stdout: "event": "all_read", 2023-08-01T19:55:36.035 INFO:teuthology.orchestra.run.smithi008.stdout: "time": "2023-08-01T19:55:09.278945+0000", 2023-08-01T19:55:36.035 INFO:teuthology.orchestra.run.smithi008.stdout: "duration": 9.4388000000000005e-05 2023-08-01T19:55:36.036 INFO:teuthology.orchestra.run.smithi008.stdout: }, 2023-08-01T19:55:36.036 INFO:teuthology.orchestra.run.smithi008.stdout: { 2023-08-01T19:55:36.036 INFO:teuthology.orchestra.run.smithi008.stdout: "event": "dispatched", 2023-08-01T19:55:36.036 INFO:teuthology.orchestra.run.smithi008.stdout: "time": "2023-08-01T19:55:09.278955+0000", 2023-08-01T19:55:36.036 INFO:teuthology.orchestra.run.smithi008.stdout: "duration": 1.0413e-05 2023-08-01T19:55:36.036 INFO:teuthology.orchestra.run.smithi008.stdout: }, 2023-08-01T19:55:36.036 INFO:teuthology.orchestra.run.smithi008.stdout: { 2023-08-01T19:55:36.036 INFO:teuthology.orchestra.run.smithi008.stdout: "event": "queued_for_pg", 2023-08-01T19:55:36.037 INFO:teuthology.orchestra.run.smithi008.stdout: "time": "2023-08-01T19:55:09.278962+0000", 2023-08-01T19:55:36.037 INFO:teuthology.orchestra.run.smithi008.stdout: "duration": 6.2169999999999999e-06 2023-08-01T19:55:36.037 INFO:teuthology.orchestra.run.smithi008.stdout: }, 2023-08-01T19:55:36.037 INFO:teuthology.orchestra.run.smithi008.stdout: { 2023-08-01T19:55:36.037 INFO:teuthology.orchestra.run.smithi008.stdout: "event": "reached_pg", 2023-08-01T19:55:36.037 INFO:teuthology.orchestra.run.smithi008.stdout: "time": "2023-08-01T19:55:09.280363+0000", 2023-08-01T19:55:36.037 INFO:teuthology.orchestra.run.smithi008.stdout: "duration": 0.0014014489999999999 2023-08-01T19:55:36.037 INFO:teuthology.orchestra.run.smithi008.stdout: }, 2023-08-01T19:55:36.038 INFO:teuthology.orchestra.run.smithi008.stdout: { 2023-08-01T19:55:36.038 INFO:teuthology.orchestra.run.smithi008.stdout: "event": "started", 2023-08-01T19:55:36.038 INFO:teuthology.orchestra.run.smithi008.stdout: "time": "2023-08-01T19:55:09.280488+0000", 2023-08-01T19:55:36.038 INFO:teuthology.orchestra.run.smithi008.stdout: "duration": 0.00012474099999999999 2023-08-01T19:55:36.038 INFO:teuthology.orchestra.run.smithi008.stdout: }, 2023-08-01T19:55:36.038 INFO:teuthology.orchestra.run.smithi008.stdout: { 2023-08-01T19:55:36.038 INFO:teuthology.orchestra.run.smithi008.stdout: "event": "waiting for subops from 1", 2023-08-01T19:55:36.038 INFO:teuthology.orchestra.run.smithi008.stdout: "time": "2023-08-01T19:55:09.280626+0000", 2023-08-01T19:55:36.039 INFO:teuthology.orchestra.run.smithi008.stdout: "duration": 0.000138193 2023-08-01T19:55:36.039 INFO:teuthology.orchestra.run.smithi008.stdout: }, 2023-08-01T19:55:36.039 INFO:teuthology.orchestra.run.smithi008.stdout: { 2023-08-01T19:55:36.039 INFO:teuthology.orchestra.run.smithi008.stdout: "event": "op_commit", 2023-08-01T19:55:36.039 INFO:teuthology.orchestra.run.smithi008.stdout: "time": "2023-08-01T19:55:09.285958+0000", 2023-08-01T19:55:36.039 INFO:teuthology.orchestra.run.smithi008.stdout: "duration": 0.0053317130000000001 2023-08-01T19:55:36.039 INFO:teuthology.orchestra.run.smithi008.stdout: }, 2023-08-01T19:55:36.039 INFO:teuthology.orchestra.run.smithi008.stdout: { 2023-08-01T19:55:36.040 INFO:teuthology.orchestra.run.smithi008.stdout: "event": "sub_op_commit_rec", 2023-08-01T19:55:36.040 INFO:teuthology.orchestra.run.smithi008.stdout: "time": "2023-08-01T19:55:09.350151+0000", 2023-08-01T19:55:36.040 INFO:teuthology.orchestra.run.smithi008.stdout: "duration": 0.064193202000000005 2023-08-01T19:55:36.040 INFO:teuthology.orchestra.run.smithi008.stdout: }, 2023-08-01T19:55:36.040 INFO:teuthology.orchestra.run.smithi008.stdout: { 2023-08-01T19:55:36.040 INFO:teuthology.orchestra.run.smithi008.stdout: "event": "commit_sent", 2023-08-01T19:55:36.040 INFO:teuthology.orchestra.run.smithi008.stdout: "time": "2023-08-01T19:55:09.350188+0000", 2023-08-01T19:55:36.041 INFO:teuthology.orchestra.run.smithi008.stdout: "duration": 3.7549999999999998e-05 2023-08-01T19:55:36.041 INFO:teuthology.orchestra.run.smithi008.stdout: }, 2023-08-01T19:55:36.041 INFO:teuthology.orchestra.run.smithi008.stdout: { 2023-08-01T19:55:36.041 INFO:teuthology.orchestra.run.smithi008.stdout: "event": "done", 2023-08-01T19:55:36.041 INFO:teuthology.orchestra.run.smithi008.stdout: "time": "2023-08-01T19:55:09.350230+0000", 2023-08-01T19:55:36.041 INFO:teuthology.orchestra.run.smithi008.stdout: "duration": 4.1804999999999997e-05 2023-08-01T19:55:36.041 INFO:teuthology.orchestra.run.smithi008.stdout: } 2023-08-01T19:55:36.041 INFO:teuthology.orchestra.run.smithi008.stdout: ] 2023-08-01T19:55:36.042 INFO:teuthology.orchestra.run.smithi008.stdout: } 2023-08-01T19:55:36.042 INFO:teuthology.orchestra.run.smithi008.stdout: }, 2023-08-01T19:55:36.042 INFO:teuthology.orchestra.run.smithi008.stdout: { 2023-08-01T19:55:36.042 INFO:teuthology.orchestra.run.smithi008.stdout: "description": "osd_op(client.4668.0:107865 5.3 5:c2ebb96d:::benchmark_data_smithi006_114134_object107864:head [set-alloc-hint object_size 65536 write_size 65536,write 0~65536] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e38)", 2023-08-01T19:55:36.042 INFO:teuthology.orchestra.run.smithi008.stdout: "initiated_at": "2023-08-01T19:55:09.279020+0000", 2023-08-01T19:55:36.042 INFO:teuthology.orchestra.run.smithi008.stdout: "age": 26.615833513999998, 2023-08-01T19:55:36.042 INFO:teuthology.orchestra.run.smithi008.stdout: "duration": 0.072892565000000006, 2023-08-01T19:55:36.042 INFO:teuthology.orchestra.run.smithi008.stdout: "type_data": { 2023-08-01T19:55:36.043 INFO:teuthology.orchestra.run.smithi008.stdout: "flag_point": "commit sent; apply or cleanup", 2023-08-01T19:55:36.043 INFO:teuthology.orchestra.run.smithi008.stdout: "client_info": { 2023-08-01T19:55:36.043 INFO:teuthology.orchestra.run.smithi008.stdout: "client": "client.4668", 2023-08-01T19:55:36.043 INFO:teuthology.orchestra.run.smithi008.stdout: "client_addr": "172.21.15.6:0/1709472247", 2023-08-01T19:55:36.043 INFO:teuthology.orchestra.run.smithi008.stdout: "tid": 107865 2023-08-01T19:55:36.043 INFO:teuthology.orchestra.run.smithi008.stdout: }, 2023-08-01T19:55:36.043 INFO:teuthology.orchestra.run.smithi008.stdout: "events": [ 2023-08-01T19:55:36.043 INFO:teuthology.orchestra.run.smithi008.stdout: { 2023-08-01T19:55:36.044 INFO:teuthology.orchestra.run.smithi008.stdout: "event": "initiated", 2023-08-01T19:55:36.044 INFO:teuthology.orchestra.run.smithi008.stdout: "time": "2023-08-01T19:55:09.279020+0000", 2023-08-01T19:55:36.044 INFO:teuthology.orchestra.run.smithi008.stdout: "duration": 0 2023-08-01T19:55:36.044 INFO:teuthology.orchestra.run.smithi008.stdout: }, 2023-08-01T19:55:36.044 INFO:teuthology.orchestra.run.smithi008.stdout: { 2023-08-01T19:55:36.044 INFO:teuthology.orchestra.run.smithi008.stdout: "event": "throttled", 2023-08-01T19:55:36.044 INFO:teuthology.orchestra.run.smithi008.stdout: "time": "2023-08-01T19:55:09.279020+0000", 2023-08-01T19:55:36.044 INFO:teuthology.orchestra.run.smithi008.stdout: "duration": 0 2023-08-01T19:55:36.045 INFO:teuthology.orchestra.run.smithi008.stdout: }, 2023-08-01T19:55:36.045 INFO:teuthology.orchestra.run.smithi008.stdout: { 2023-08-01T19:55:36.045 INFO:teuthology.orchestra.run.smithi008.stdout: "event": "header_read", 2023-08-01T19:55:36.045 INFO:teuthology.orchestra.run.smithi008.stdout: "time": "2023-08-01T19:55:09.279019+0000", 2023-08-01T19:55:36.045 INFO:teuthology.orchestra.run.smithi008.stdout: "duration": 4294967295.999999 2023-08-01T19:55:36.045 INFO:teuthology.orchestra.run.smithi008.stdout: }, 2023-08-01T19:55:36.045 INFO:teuthology.orchestra.run.smithi008.stdout: { 2023-08-01T19:55:36.046 INFO:teuthology.orchestra.run.smithi008.stdout: "event": "all_read", 2023-08-01T19:55:36.046 INFO:teuthology.orchestra.run.smithi008.stdout: "time": "2023-08-01T19:55:09.279087+0000", 2023-08-01T19:55:36.046 INFO:teuthology.orchestra.run.smithi008.stdout: "duration": 6.8392000000000005e-05 2023-08-01T19:55:36.046 INFO:teuthology.orchestra.run.smithi008.stdout: }, 2023-08-01T19:55:36.046 INFO:teuthology.orchestra.run.smithi008.stdout: { 2023-08-01T19:55:36.046 INFO:teuthology.orchestra.run.smithi008.stdout: "event": "dispatched", 2023-08-01T19:55:36.046 INFO:teuthology.orchestra.run.smithi008.stdout: "time": "2023-08-01T19:55:09.279095+0000", 2023-08-01T19:55:36.046 INFO:teuthology.orchestra.run.smithi008.stdout: "duration": 8.0989999999999999e-06 2023-08-01T19:55:36.047 INFO:teuthology.orchestra.run.smithi008.stdout: }, 2023-08-01T19:55:36.047 INFO:teuthology.orchestra.run.smithi008.stdout: { 2023-08-01T19:55:36.047 INFO:teuthology.orchestra.run.smithi008.stdout: "event": "queued_for_pg", 2023-08-01T19:55:36.047 INFO:teuthology.orchestra.run.smithi008.stdout: "time": "2023-08-01T19:55:09.279101+0000", 2023-08-01T19:55:36.047 INFO:teuthology.orchestra.run.smithi008.stdout: "duration": 5.0390000000000004e-06 2023-08-01T19:55:36.047 INFO:teuthology.orchestra.run.smithi008.stdout: }, 2023-08-01T19:55:36.047 INFO:teuthology.orchestra.run.smithi008.stdout: { 2023-08-01T19:55:36.047 INFO:teuthology.orchestra.run.smithi008.stdout: "event": "reached_pg", 2023-08-01T19:55:36.048 INFO:teuthology.orchestra.run.smithi008.stdout: "time": "2023-08-01T19:55:09.282574+0000", 2023-08-01T19:55:36.048 INFO:teuthology.orchestra.run.smithi008.stdout: "duration": 0.0034730619999999999 2023-08-01T19:55:36.048 INFO:teuthology.orchestra.run.smithi008.stdout: }, 2023-08-01T19:55:36.048 INFO:teuthology.orchestra.run.smithi008.stdout: { 2023-08-01T19:55:36.048 INFO:teuthology.orchestra.run.smithi008.stdout: "event": "started", 2023-08-01T19:55:36.048 INFO:teuthology.orchestra.run.smithi008.stdout: "time": "2023-08-01T19:55:09.282705+0000", 2023-08-01T19:55:36.048 INFO:teuthology.orchestra.run.smithi008.stdout: "duration": 0.00013133400000000001 2023-08-01T19:55:36.048 INFO:teuthology.orchestra.run.smithi008.stdout: }, 2023-08-01T19:55:36.049 INFO:teuthology.orchestra.run.smithi008.stdout: { 2023-08-01T19:55:36.049 INFO:teuthology.orchestra.run.smithi008.stdout: "event": "waiting for subops from 1", 2023-08-01T19:55:36.049 INFO:teuthology.orchestra.run.smithi008.stdout: "time": "2023-08-01T19:55:09.283067+0000", 2023-08-01T19:55:36.049 INFO:teuthology.orchestra.run.smithi008.stdout: "duration": 0.00036195299999999998 2023-08-01T19:55:36.049 INFO:teuthology.orchestra.run.smithi008.stdout: }, 2023-08-01T19:55:36.049 INFO:teuthology.orchestra.run.smithi008.stdout: { 2023-08-01T19:55:36.049 INFO:teuthology.orchestra.run.smithi008.stdout: "event": "op_commit", 2023-08-01T19:55:36.049 INFO:teuthology.orchestra.run.smithi008.stdout: "time": "2023-08-01T19:55:09.288196+0000", 2023-08-01T19:55:36.050 INFO:teuthology.orchestra.run.smithi008.stdout: "duration": 0.0051293780000000004 2023-08-01T19:55:36.050 INFO:teuthology.orchestra.run.smithi008.stdout: }, 2023-08-01T19:55:36.050 INFO:teuthology.orchestra.run.smithi008.stdout: { 2023-08-01T19:55:36.050 INFO:teuthology.orchestra.run.smithi008.stdout: "event": "sub_op_commit_rec", 2023-08-01T19:55:36.050 INFO:teuthology.orchestra.run.smithi008.stdout: "time": "2023-08-01T19:55:09.351832+0000", 2023-08-01T19:55:36.050 INFO:teuthology.orchestra.run.smithi008.stdout: "duration": 0.063636076 2023-08-01T19:55:36.050 INFO:teuthology.orchestra.run.smithi008.stdout: }, 2023-08-01T19:55:36.050 INFO:teuthology.orchestra.run.smithi008.stdout: { 2023-08-01T19:55:36.051 INFO:teuthology.orchestra.run.smithi008.stdout: "event": "commit_sent", 2023-08-01T19:55:36.051 INFO:teuthology.orchestra.run.smithi008.stdout: "time": "2023-08-01T19:55:09.351878+0000", 2023-08-01T19:55:36.051 INFO:teuthology.orchestra.run.smithi008.stdout: "duration": 4.5408999999999998e-05 2023-08-01T19:55:36.051 INFO:teuthology.orchestra.run.smithi008.stdout: }, 2023-08-01T19:55:36.051 INFO:teuthology.orchestra.run.smithi008.stdout: { 2023-08-01T19:55:36.051 INFO:teuthology.orchestra.run.smithi008.stdout: "event": "done", 2023-08-01T19:55:36.051 INFO:teuthology.orchestra.run.smithi008.stdout: "time": "2023-08-01T19:55:09.351913+0000", 2023-08-01T19:55:36.051 INFO:teuthology.orchestra.run.smithi008.stdout: "duration": 3.4808999999999998e-05 2023-08-01T19:55:36.052 INFO:teuthology.orchestra.run.smithi008.stdout: } 2023-08-01T19:55:36.052 INFO:teuthology.orchestra.run.smithi008.stdout: ] 2023-08-01T19:55:36.052 INFO:teuthology.orchestra.run.smithi008.stdout: } 2023-08-01T19:55:36.052 INFO:teuthology.orchestra.run.smithi008.stdout: }, 2023-08-01T19:55:36.052 INFO:teuthology.orchestra.run.smithi008.stdout: { 2023-08-01T19:55:36.052 INFO:teuthology.orchestra.run.smithi008.stdout: "description": "osd_op(client.4668.0:107869 5.c 5:31910384:::benchmark_data_smithi006_114134_object107868:head [set-alloc-hint object_size 65536 write_size 65536,write 0~65536] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e38)", 2023-08-01T19:55:36.052 INFO:teuthology.orchestra.run.smithi008.stdout: "initiated_at": "2023-08-01T19:55:09.283205+0000", 2023-08-01T19:55:36.053 INFO:teuthology.orchestra.run.smithi008.stdout: "age": 26.611648348999999, 2023-08-01T19:55:36.053 INFO:teuthology.orchestra.run.smithi008.stdout: "duration": 0.068611808999999996, 2023-08-01T19:55:36.053 INFO:teuthology.orchestra.run.smithi008.stdout: "type_data": { 2023-08-01T19:55:36.053 INFO:teuthology.orchestra.run.smithi008.stdout: "flag_point": "commit sent; apply or cleanup", 2023-08-01T19:55:36.053 INFO:teuthology.orchestra.run.smithi008.stdout: "client_info": { 2023-08-01T19:55:36.053 INFO:teuthology.orchestra.run.smithi008.stdout: "client": "client.4668", 2023-08-01T19:55:36.053 INFO:teuthology.orchestra.run.smithi008.stdout: "client_addr": "172.21.15.6:0/1709472247", 2023-08-01T19:55:36.053 INFO:teuthology.orchestra.run.smithi008.stdout: "tid": 107869 2023-08-01T19:55:36.054 INFO:teuthology.orchestra.run.smithi008.stdout: }, 2023-08-01T19:55:36.054 INFO:teuthology.orchestra.run.smithi008.stdout: "events": [ 2023-08-01T19:55:36.054 INFO:teuthology.orchestra.run.smithi008.stdout: { 2023-08-01T19:55:36.054 INFO:teuthology.orchestra.run.smithi008.stdout: "event": "initiated", 2023-08-01T19:55:36.054 INFO:teuthology.orchestra.run.smithi008.stdout: "time": "2023-08-01T19:55:09.283205+0000", 2023-08-01T19:55:36.054 INFO:teuthology.orchestra.run.smithi008.stdout: "duration": 0 2023-08-01T19:55:36.054 INFO:teuthology.orchestra.run.smithi008.stdout: }, 2023-08-01T19:55:36.054 INFO:teuthology.orchestra.run.smithi008.stdout: { 2023-08-01T19:55:36.055 INFO:teuthology.orchestra.run.smithi008.stdout: "event": "throttled", 2023-08-01T19:55:36.055 INFO:teuthology.orchestra.run.smithi008.stdout: "time": "2023-08-01T19:55:09.283205+0000", 2023-08-01T19:55:36.055 INFO:teuthology.orchestra.run.smithi008.stdout: "duration": 0 2023-08-01T19:55:36.055 INFO:teuthology.orchestra.run.smithi008.stdout: }, 2023-08-01T19:55:36.055 INFO:teuthology.orchestra.run.smithi008.stdout: { 2023-08-01T19:55:36.055 INFO:teuthology.orchestra.run.smithi008.stdout: "event": "header_read", 2023-08-01T19:55:36.055 INFO:teuthology.orchestra.run.smithi008.stdout: "time": "2023-08-01T19:55:09.283204+0000", 2023-08-01T19:55:36.055 INFO:teuthology.orchestra.run.smithi008.stdout: "duration": 4294967295.999999 2023-08-01T19:55:36.056 INFO:teuthology.orchestra.run.smithi008.stdout: }, 2023-08-01T19:55:36.056 INFO:teuthology.orchestra.run.smithi008.stdout: { 2023-08-01T19:55:36.056 INFO:teuthology.orchestra.run.smithi008.stdout: "event": "all_read", 2023-08-01T19:55:36.056 INFO:teuthology.orchestra.run.smithi008.stdout: "time": "2023-08-01T19:55:09.283300+0000", 2023-08-01T19:55:36.056 INFO:teuthology.orchestra.run.smithi008.stdout: "duration": 9.6280000000000007e-05 2023-08-01T19:55:36.056 INFO:teuthology.orchestra.run.smithi008.stdout: }, 2023-08-01T19:55:36.056 INFO:teuthology.orchestra.run.smithi008.stdout: { 2023-08-01T19:55:36.056 INFO:teuthology.orchestra.run.smithi008.stdout: "event": "dispatched", 2023-08-01T19:55:36.057 INFO:teuthology.orchestra.run.smithi008.stdout: "time": "2023-08-01T19:55:09.283314+0000", 2023-08-01T19:55:36.057 INFO:teuthology.orchestra.run.smithi008.stdout: "duration": 1.3344e-05 2023-08-01T19:55:36.057 INFO:teuthology.orchestra.run.smithi008.stdout: }, 2023-08-01T19:55:36.057 INFO:teuthology.orchestra.run.smithi008.stdout: { 2023-08-01T19:55:36.057 INFO:teuthology.orchestra.run.smithi008.stdout: "event": "queued_for_pg", 2023-08-01T19:55:36.057 INFO:teuthology.orchestra.run.smithi008.stdout: "time": "2023-08-01T19:55:09.283320+0000", 2023-08-01T19:55:36.057 INFO:teuthology.orchestra.run.smithi008.stdout: "duration": 6.0299999999999999e-06 2023-08-01T19:55:36.057 INFO:teuthology.orchestra.run.smithi008.stdout: }, 2023-08-01T19:55:36.058 INFO:teuthology.orchestra.run.smithi008.stdout: { 2023-08-01T19:55:36.058 INFO:teuthology.orchestra.run.smithi008.stdout: "event": "reached_pg", 2023-08-01T19:55:36.058 INFO:teuthology.orchestra.run.smithi008.stdout: "time": "2023-08-01T19:55:09.283365+0000", 2023-08-01T19:55:36.058 INFO:teuthology.orchestra.run.smithi008.stdout: "duration": 4.5578999999999998e-05 2023-08-01T19:55:36.058 INFO:teuthology.orchestra.run.smithi008.stdout: }, 2023-08-01T19:55:36.058 INFO:teuthology.orchestra.run.smithi008.stdout: { 2023-08-01T19:55:36.058 INFO:teuthology.orchestra.run.smithi008.stdout: "event": "started", 2023-08-01T19:55:36.058 INFO:teuthology.orchestra.run.smithi008.stdout: "time": "2023-08-01T19:55:09.283490+0000", 2023-08-01T19:55:36.059 INFO:teuthology.orchestra.run.smithi008.stdout: "duration": 0.00012473700000000001 2023-08-01T19:55:36.059 INFO:teuthology.orchestra.run.smithi008.stdout: }, 2023-08-01T19:55:36.059 INFO:teuthology.orchestra.run.smithi008.stdout: { 2023-08-01T19:55:36.059 INFO:teuthology.orchestra.run.smithi008.stdout: "event": "waiting for subops from 1", 2023-08-01T19:55:36.059 INFO:teuthology.orchestra.run.smithi008.stdout: "time": "2023-08-01T19:55:09.283637+0000", 2023-08-01T19:55:36.059 INFO:teuthology.orchestra.run.smithi008.stdout: "duration": 0.00014715600000000001 2023-08-01T19:55:36.059 INFO:teuthology.orchestra.run.smithi008.stdout: }, 2023-08-01T19:55:36.059 INFO:teuthology.orchestra.run.smithi008.stdout: { 2023-08-01T19:55:36.060 INFO:teuthology.orchestra.run.smithi008.stdout: "event": "op_commit", 2023-08-01T19:55:36.060 INFO:teuthology.orchestra.run.smithi008.stdout: "time": "2023-08-01T19:55:09.288214+0000", 2023-08-01T19:55:36.060 INFO:teuthology.orchestra.run.smithi008.stdout: "duration": 0.0045769560000000001 2023-08-01T19:55:36.060 INFO:teuthology.orchestra.run.smithi008.stdout: }, 2023-08-01T19:55:36.060 INFO:teuthology.orchestra.run.smithi008.stdout: { 2023-08-01T19:55:36.060 INFO:teuthology.orchestra.run.smithi008.stdout: "event": "sub_op_commit_rec", 2023-08-01T19:55:36.060 INFO:teuthology.orchestra.run.smithi008.stdout: "time": "2023-08-01T19:55:09.351721+0000", 2023-08-01T19:55:36.060 INFO:teuthology.orchestra.run.smithi008.stdout: "duration": 0.063507383000000001 2023-08-01T19:55:36.061 INFO:teuthology.orchestra.run.smithi008.stdout: }, 2023-08-01T19:55:36.061 INFO:teuthology.orchestra.run.smithi008.stdout: { 2023-08-01T19:55:36.061 INFO:teuthology.orchestra.run.smithi008.stdout: "event": "commit_sent", 2023-08-01T19:55:36.061 INFO:teuthology.orchestra.run.smithi008.stdout: "time": "2023-08-01T19:55:09.351777+0000", 2023-08-01T19:55:36.061 INFO:teuthology.orchestra.run.smithi008.stdout: "duration": 5.5733999999999999e-05 2023-08-01T19:55:36.061 INFO:teuthology.orchestra.run.smithi008.stdout: }, 2023-08-01T19:55:36.061 INFO:teuthology.orchestra.run.smithi008.stdout: { 2023-08-01T19:55:36.061 INFO:teuthology.orchestra.run.smithi008.stdout: "event": "done", 2023-08-01T19:55:36.062 INFO:teuthology.orchestra.run.smithi008.stdout: "time": "2023-08-01T19:55:09.351817+0000", 2023-08-01T19:55:36.062 INFO:teuthology.orchestra.run.smithi008.stdout: "duration": 3.9765000000000003e-05 2023-08-01T19:55:36.062 INFO:teuthology.orchestra.run.smithi008.stdout: } 2023-08-01T19:55:36.062 INFO:teuthology.orchestra.run.smithi008.stdout: ] 2023-08-01T19:55:36.062 INFO:teuthology.orchestra.run.smithi008.stdout: } 2023-08-01T19:55:36.062 INFO:teuthology.orchestra.run.smithi008.stdout: }, 2023-08-01T19:55:36.062 INFO:teuthology.orchestra.run.smithi008.stdout: { 2023-08-01T19:55:36.062 INFO:teuthology.orchestra.run.smithi008.stdout: "description": "osd_op(client.4668.0:107874 5.3 5:ce4c2799:::benchmark_data_smithi006_114134_object107873:head [set-alloc-hint object_size 65536 write_size 65536,write 0~65536] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e38)", 2023-08-01T19:55:36.063 INFO:teuthology.orchestra.run.smithi008.stdout: "initiated_at": "2023-08-01T19:55:09.286239+0000", 2023-08-01T19:55:36.063 INFO:teuthology.orchestra.run.smithi008.stdout: "age": 26.608614844000002, 2023-08-01T19:55:36.063 INFO:teuthology.orchestra.run.smithi008.stdout: "duration": 0.068224389999999996, 2023-08-01T19:55:36.063 INFO:teuthology.orchestra.run.smithi008.stdout: "type_data": { 2023-08-01T19:55:36.063 INFO:teuthology.orchestra.run.smithi008.stdout: "flag_point": "commit sent; apply or cleanup", 2023-08-01T19:55:36.063 INFO:teuthology.orchestra.run.smithi008.stdout: "client_info": { 2023-08-01T19:55:36.063 INFO:teuthology.orchestra.run.smithi008.stdout: "client": "client.4668", 2023-08-01T19:55:36.064 INFO:teuthology.orchestra.run.smithi008.stdout: "client_addr": "172.21.15.6:0/1709472247", 2023-08-01T19:55:36.064 INFO:teuthology.orchestra.run.smithi008.stdout: "tid": 107874 2023-08-01T19:55:36.064 INFO:teuthology.orchestra.run.smithi008.stdout: }, 2023-08-01T19:55:36.064 INFO:teuthology.orchestra.run.smithi008.stdout: "events": [ 2023-08-01T19:55:36.064 INFO:teuthology.orchestra.run.smithi008.stdout: { 2023-08-01T19:55:36.064 INFO:teuthology.orchestra.run.smithi008.stdout: "event": "initiated", 2023-08-01T19:55:36.064 INFO:teuthology.orchestra.run.smithi008.stdout: "time": "2023-08-01T19:55:09.286239+0000", 2023-08-01T19:55:36.064 INFO:teuthology.orchestra.run.smithi008.stdout: "duration": 0 2023-08-01T19:55:36.065 INFO:teuthology.orchestra.run.smithi008.stdout: }, 2023-08-01T19:55:36.065 INFO:teuthology.orchestra.run.smithi008.stdout: { 2023-08-01T19:55:36.065 INFO:teuthology.orchestra.run.smithi008.stdout: "event": "throttled", 2023-08-01T19:55:36.065 INFO:teuthology.orchestra.run.smithi008.stdout: "time": "2023-08-01T19:55:09.286239+0000", 2023-08-01T19:55:36.065 INFO:teuthology.orchestra.run.smithi008.stdout: "duration": 0 2023-08-01T19:55:36.065 INFO:teuthology.orchestra.run.smithi008.stdout: }, 2023-08-01T19:55:36.065 INFO:teuthology.orchestra.run.smithi008.stdout: { 2023-08-01T19:55:36.065 INFO:teuthology.orchestra.run.smithi008.stdout: "event": "header_read", 2023-08-01T19:55:36.066 INFO:teuthology.orchestra.run.smithi008.stdout: "time": "2023-08-01T19:55:09.286238+0000", 2023-08-01T19:55:36.066 INFO:teuthology.orchestra.run.smithi008.stdout: "duration": 4294967295.999999 2023-08-01T19:55:36.066 INFO:teuthology.orchestra.run.smithi008.stdout: }, 2023-08-01T19:55:36.066 INFO:teuthology.orchestra.run.smithi008.stdout: { 2023-08-01T19:55:36.066 INFO:teuthology.orchestra.run.smithi008.stdout: "event": "all_read", 2023-08-01T19:55:36.066 INFO:teuthology.orchestra.run.smithi008.stdout: "time": "2023-08-01T19:55:09.286310+0000", 2023-08-01T19:55:36.066 INFO:teuthology.orchestra.run.smithi008.stdout: "duration": 7.2583999999999995e-05 2023-08-01T19:55:36.066 INFO:teuthology.orchestra.run.smithi008.stdout: }, 2023-08-01T19:55:36.067 INFO:teuthology.orchestra.run.smithi008.stdout: { 2023-08-01T19:55:36.067 INFO:teuthology.orchestra.run.smithi008.stdout: "event": "dispatched", 2023-08-01T19:55:36.067 INFO:teuthology.orchestra.run.smithi008.stdout: "time": "2023-08-01T19:55:09.286323+0000", 2023-08-01T19:55:36.067 INFO:teuthology.orchestra.run.smithi008.stdout: "duration": 1.3151e-05 2023-08-01T19:55:36.067 INFO:teuthology.orchestra.run.smithi008.stdout: }, 2023-08-01T19:55:36.067 INFO:teuthology.orchestra.run.smithi008.stdout: { 2023-08-01T19:55:36.067 INFO:teuthology.orchestra.run.smithi008.stdout: "event": "queued_for_pg", 2023-08-01T19:55:36.067 INFO:teuthology.orchestra.run.smithi008.stdout: "time": "2023-08-01T19:55:09.286329+0000", 2023-08-01T19:55:36.068 INFO:teuthology.orchestra.run.smithi008.stdout: "duration": 5.8719999999999999e-06 2023-08-01T19:55:36.068 INFO:teuthology.orchestra.run.smithi008.stdout: }, 2023-08-01T19:55:36.068 INFO:teuthology.orchestra.run.smithi008.stdout: { 2023-08-01T19:55:36.068 INFO:teuthology.orchestra.run.smithi008.stdout: "event": "reached_pg", 2023-08-01T19:55:36.068 INFO:teuthology.orchestra.run.smithi008.stdout: "time": "2023-08-01T19:55:09.286392+0000", 2023-08-01T19:55:36.068 INFO:teuthology.orchestra.run.smithi008.stdout: "duration": 6.2378000000000005e-05 2023-08-01T19:55:36.068 INFO:teuthology.orchestra.run.smithi008.stdout: }, 2023-08-01T19:55:36.069 INFO:teuthology.orchestra.run.smithi008.stdout: { 2023-08-01T19:55:36.069 INFO:teuthology.orchestra.run.smithi008.stdout: "event": "started", 2023-08-01T19:55:36.069 INFO:teuthology.orchestra.run.smithi008.stdout: "time": "2023-08-01T19:55:09.286473+0000", 2023-08-01T19:55:36.069 INFO:teuthology.orchestra.run.smithi008.stdout: "duration": 8.1327000000000002e-05 2023-08-01T19:55:36.069 INFO:teuthology.orchestra.run.smithi008.stdout: }, 2023-08-01T19:55:36.069 INFO:teuthology.orchestra.run.smithi008.stdout: { 2023-08-01T19:55:36.069 INFO:teuthology.orchestra.run.smithi008.stdout: "event": "waiting for subops from 1", 2023-08-01T19:55:36.069 INFO:teuthology.orchestra.run.smithi008.stdout: "time": "2023-08-01T19:55:09.286557+0000", 2023-08-01T19:55:36.070 INFO:teuthology.orchestra.run.smithi008.stdout: "duration": 8.4140000000000004e-05 2023-08-01T19:55:36.070 INFO:teuthology.orchestra.run.smithi008.stdout: }, 2023-08-01T19:55:36.070 INFO:teuthology.orchestra.run.smithi008.stdout: { 2023-08-01T19:55:36.070 INFO:teuthology.orchestra.run.smithi008.stdout: "event": "op_commit", 2023-08-01T19:55:36.070 INFO:teuthology.orchestra.run.smithi008.stdout: "time": "2023-08-01T19:55:09.290681+0000", 2023-08-01T19:55:36.070 INFO:teuthology.orchestra.run.smithi008.stdout: "duration": 0.0041242420000000002 2023-08-01T19:55:36.070 INFO:teuthology.orchestra.run.smithi008.stdout: }, 2023-08-01T19:55:36.070 INFO:teuthology.orchestra.run.smithi008.stdout: { 2023-08-01T19:55:36.071 INFO:teuthology.orchestra.run.smithi008.stdout: "event": "sub_op_commit_rec", 2023-08-01T19:55:36.071 INFO:teuthology.orchestra.run.smithi008.stdout: "time": "2023-08-01T19:55:09.354372+0000", 2023-08-01T19:55:36.071 INFO:teuthology.orchestra.run.smithi008.stdout: "duration": 0.063690438000000002 2023-08-01T19:55:36.071 INFO:teuthology.orchestra.run.smithi008.stdout: }, 2023-08-01T19:55:36.071 INFO:teuthology.orchestra.run.smithi008.stdout: { 2023-08-01T19:55:36.071 INFO:teuthology.orchestra.run.smithi008.stdout: "event": "commit_sent", 2023-08-01T19:55:36.071 INFO:teuthology.orchestra.run.smithi008.stdout: "time": "2023-08-01T19:55:09.354421+0000", 2023-08-01T19:55:36.071 INFO:teuthology.orchestra.run.smithi008.stdout: "duration": 4.9413000000000003e-05 2023-08-01T19:55:36.072 INFO:teuthology.orchestra.run.smithi008.stdout: }, 2023-08-01T19:55:36.072 INFO:teuthology.orchestra.run.smithi008.stdout: { 2023-08-01T19:55:36.072 INFO:teuthology.orchestra.run.smithi008.stdout: "event": "done", 2023-08-01T19:55:36.072 INFO:teuthology.orchestra.run.smithi008.stdout: "time": "2023-08-01T19:55:09.354463+0000", 2023-08-01T19:55:36.072 INFO:teuthology.orchestra.run.smithi008.stdout: "duration": 4.1924e-05 2023-08-01T19:55:36.072 INFO:teuthology.orchestra.run.smithi008.stdout: } 2023-08-01T19:55:36.072 INFO:teuthology.orchestra.run.smithi008.stdout: ] 2023-08-01T19:55:36.073 INFO:teuthology.orchestra.run.smithi008.stdout: } 2023-08-01T19:55:36.073 INFO:teuthology.orchestra.run.smithi008.stdout: }, 2023-08-01T19:55:36.073 INFO:teuthology.orchestra.run.smithi008.stdout: { 2023-08-01T19:55:36.073 INFO:teuthology.orchestra.run.smithi008.stdout: "description": "osd_op(client.4668.0:107875 5.5 5:af4ec927:::benchmark_data_smithi006_114134_object107874:head [set-alloc-hint object_size 65536 write_size 65536,write 0~65536] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e38)", 2023-08-01T19:55:36.073 INFO:teuthology.orchestra.run.smithi008.stdout: "initiated_at": "2023-08-01T19:55:09.287186+0000", 2023-08-01T19:55:36.073 INFO:teuthology.orchestra.run.smithi008.stdout: "age": 26.607667057, 2023-08-01T19:55:36.073 INFO:teuthology.orchestra.run.smithi008.stdout: "duration": 0.064764719999999998, 2023-08-01T19:55:36.073 INFO:teuthology.orchestra.run.smithi008.stdout: "type_data": { 2023-08-01T19:55:36.074 INFO:teuthology.orchestra.run.smithi008.stdout: "flag_point": "commit sent; apply or cleanup", 2023-08-01T19:55:36.074 INFO:teuthology.orchestra.run.smithi008.stdout: "client_info": { 2023-08-01T19:55:36.074 INFO:teuthology.orchestra.run.smithi008.stdout: "client": "client.4668", 2023-08-01T19:55:36.074 INFO:teuthology.orchestra.run.smithi008.stdout: "client_addr": "172.21.15.6:0/1709472247", 2023-08-01T19:55:36.074 INFO:teuthology.orchestra.run.smithi008.stdout: "tid": 107875 2023-08-01T19:55:36.074 INFO:teuthology.orchestra.run.smithi008.stdout: }, 2023-08-01T19:55:36.074 INFO:teuthology.orchestra.run.smithi008.stdout: "events": [ 2023-08-01T19:55:36.074 INFO:teuthology.orchestra.run.smithi008.stdout: { 2023-08-01T19:55:36.075 INFO:teuthology.orchestra.run.smithi008.stdout: "event": "initiated", 2023-08-01T19:55:36.075 INFO:teuthology.orchestra.run.smithi008.stdout: "time": "2023-08-01T19:55:09.287186+0000", 2023-08-01T19:55:36.075 INFO:teuthology.orchestra.run.smithi008.stdout: "duration": 0 2023-08-01T19:55:36.075 INFO:teuthology.orchestra.run.smithi008.stdout: }, 2023-08-01T19:55:36.075 INFO:teuthology.orchestra.run.smithi008.stdout: { 2023-08-01T19:55:36.075 INFO:teuthology.orchestra.run.smithi008.stdout: "event": "throttled", 2023-08-01T19:55:36.075 INFO:teuthology.orchestra.run.smithi008.stdout: "time": "2023-08-01T19:55:09.287186+0000", 2023-08-01T19:55:36.075 INFO:teuthology.orchestra.run.smithi008.stdout: "duration": 0 2023-08-01T19:55:36.076 INFO:teuthology.orchestra.run.smithi008.stdout: }, 2023-08-01T19:55:36.076 INFO:teuthology.orchestra.run.smithi008.stdout: { 2023-08-01T19:55:36.076 INFO:teuthology.orchestra.run.smithi008.stdout: "event": "header_read", 2023-08-01T19:55:36.076 INFO:teuthology.orchestra.run.smithi008.stdout: "time": "2023-08-01T19:55:09.287186+0000", 2023-08-01T19:55:36.076 INFO:teuthology.orchestra.run.smithi008.stdout: "duration": 4294967295.999999 2023-08-01T19:55:36.076 INFO:teuthology.orchestra.run.smithi008.stdout: }, 2023-08-01T19:55:36.076 INFO:teuthology.orchestra.run.smithi008.stdout: { 2023-08-01T19:55:36.076 INFO:teuthology.orchestra.run.smithi008.stdout: "event": "all_read", 2023-08-01T19:55:36.077 INFO:teuthology.orchestra.run.smithi008.stdout: "time": "2023-08-01T19:55:09.287248+0000", 2023-08-01T19:55:36.077 INFO:teuthology.orchestra.run.smithi008.stdout: "duration": 6.2922000000000005e-05 2023-08-01T19:55:36.077 INFO:teuthology.orchestra.run.smithi008.stdout: }, 2023-08-01T19:55:36.077 INFO:teuthology.orchestra.run.smithi008.stdout: { 2023-08-01T19:55:36.077 INFO:teuthology.orchestra.run.smithi008.stdout: "event": "dispatched", 2023-08-01T19:55:36.077 INFO:teuthology.orchestra.run.smithi008.stdout: "time": "2023-08-01T19:55:09.287261+0000", 2023-08-01T19:55:36.077 INFO:teuthology.orchestra.run.smithi008.stdout: "duration": 1.2364000000000001e-05 2023-08-01T19:55:36.077 INFO:teuthology.orchestra.run.smithi008.stdout: }, 2023-08-01T19:55:36.078 INFO:teuthology.orchestra.run.smithi008.stdout: { 2023-08-01T19:55:36.078 INFO:teuthology.orchestra.run.smithi008.stdout: "event": "queued_for_pg", 2023-08-01T19:55:36.078 INFO:teuthology.orchestra.run.smithi008.stdout: "time": "2023-08-01T19:55:09.287267+0000", 2023-08-01T19:55:36.078 INFO:teuthology.orchestra.run.smithi008.stdout: "duration": 6.2580000000000001e-06 2023-08-01T19:55:36.078 INFO:teuthology.orchestra.run.smithi008.stdout: }, 2023-08-01T19:55:36.078 INFO:teuthology.orchestra.run.smithi008.stdout: { 2023-08-01T19:55:36.078 INFO:teuthology.orchestra.run.smithi008.stdout: "event": "reached_pg", 2023-08-01T19:55:36.079 INFO:teuthology.orchestra.run.smithi008.stdout: "time": "2023-08-01T19:55:09.287306+0000", 2023-08-01T19:55:36.079 INFO:teuthology.orchestra.run.smithi008.stdout: "duration": 3.9057999999999998e-05 2023-08-01T19:55:36.079 INFO:teuthology.orchestra.run.smithi008.stdout: }, 2023-08-01T19:55:36.079 INFO:teuthology.orchestra.run.smithi008.stdout: { 2023-08-01T19:55:36.079 INFO:teuthology.orchestra.run.smithi008.stdout: "event": "started", 2023-08-01T19:55:36.079 INFO:teuthology.orchestra.run.smithi008.stdout: "time": "2023-08-01T19:55:09.287419+0000", 2023-08-01T19:55:36.079 INFO:teuthology.orchestra.run.smithi008.stdout: "duration": 0.000112843 2023-08-01T19:55:36.079 INFO:teuthology.orchestra.run.smithi008.stdout: }, 2023-08-01T19:55:36.080 INFO:teuthology.orchestra.run.smithi008.stdout: { 2023-08-01T19:55:36.080 INFO:teuthology.orchestra.run.smithi008.stdout: "event": "waiting for subops from 1", 2023-08-01T19:55:36.080 INFO:teuthology.orchestra.run.smithi008.stdout: "time": "2023-08-01T19:55:09.287514+0000", 2023-08-01T19:55:36.080 INFO:teuthology.orchestra.run.smithi008.stdout: "duration": 9.5068000000000005e-05 2023-08-01T19:55:36.080 INFO:teuthology.orchestra.run.smithi008.stdout: }, 2023-08-01T19:55:36.080 INFO:teuthology.orchestra.run.smithi008.stdout: { 2023-08-01T19:55:36.080 INFO:teuthology.orchestra.run.smithi008.stdout: "event": "op_commit", 2023-08-01T19:55:36.080 INFO:teuthology.orchestra.run.smithi008.stdout: "time": "2023-08-01T19:55:09.293891+0000", 2023-08-01T19:55:36.081 INFO:teuthology.orchestra.run.smithi008.stdout: "duration": 0.00637712 2023-08-01T19:55:36.081 INFO:teuthology.orchestra.run.smithi008.stdout: }, 2023-08-01T19:55:36.081 INFO:teuthology.orchestra.run.smithi008.stdout: { 2023-08-01T19:55:36.081 INFO:teuthology.orchestra.run.smithi008.stdout: "event": "sub_op_commit_rec", 2023-08-01T19:55:36.081 INFO:teuthology.orchestra.run.smithi008.stdout: "time": "2023-08-01T19:55:09.351871+0000", 2023-08-01T19:55:36.081 INFO:teuthology.orchestra.run.smithi008.stdout: "duration": 0.057980054000000003 2023-08-01T19:55:36.081 INFO:teuthology.orchestra.run.smithi008.stdout: }, 2023-08-01T19:55:36.081 INFO:teuthology.orchestra.run.smithi008.stdout: { 2023-08-01T19:55:36.082 INFO:teuthology.orchestra.run.smithi008.stdout: "event": "commit_sent", 2023-08-01T19:55:36.082 INFO:teuthology.orchestra.run.smithi008.stdout: "time": "2023-08-01T19:55:09.351917+0000", 2023-08-01T19:55:36.082 INFO:teuthology.orchestra.run.smithi008.stdout: "duration": 4.5501999999999999e-05 2023-08-01T19:55:36.082 INFO:teuthology.orchestra.run.smithi008.stdout: }, 2023-08-01T19:55:36.082 INFO:teuthology.orchestra.run.smithi008.stdout: { 2023-08-01T19:55:36.082 INFO:teuthology.orchestra.run.smithi008.stdout: "event": "done", 2023-08-01T19:55:36.082 INFO:teuthology.orchestra.run.smithi008.stdout: "time": "2023-08-01T19:55:09.351951+0000", 2023-08-01T19:55:36.082 INFO:teuthology.orchestra.run.smithi008.stdout: "duration": 3.4450999999999999e-05 2023-08-01T19:55:36.083 INFO:teuthology.orchestra.run.smithi008.stdout: } 2023-08-01T19:55:36.083 INFO:teuthology.orchestra.run.smithi008.stdout: ] 2023-08-01T19:55:36.083 INFO:teuthology.orchestra.run.smithi008.stdout: } 2023-08-01T19:55:36.083 INFO:teuthology.orchestra.run.smithi008.stdout: }, 2023-08-01T19:55:36.083 INFO:teuthology.orchestra.run.smithi008.stdout: { 2023-08-01T19:55:36.083 INFO:teuthology.orchestra.run.smithi008.stdout: "description": "osd_op(client.4668.0:107880 5.5 5:a8d12d4b:::benchmark_data_smithi006_114134_object107879:head [set-alloc-hint object_size 65536 write_size 65536,write 0~65536] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e38)", 2023-08-01T19:55:36.083 INFO:teuthology.orchestra.run.smithi008.stdout: "initiated_at": "2023-08-01T19:55:09.292335+0000", 2023-08-01T19:55:36.083 INFO:teuthology.orchestra.run.smithi008.stdout: "age": 26.602518455999999, 2023-08-01T19:55:36.084 INFO:teuthology.orchestra.run.smithi008.stdout: "duration": 0.061350719999999997, 2023-08-01T19:55:36.084 INFO:teuthology.orchestra.run.smithi008.stdout: "type_data": { 2023-08-01T19:55:36.084 INFO:teuthology.orchestra.run.smithi008.stdout: "flag_point": "commit sent; apply or cleanup", 2023-08-01T19:55:36.084 INFO:teuthology.orchestra.run.smithi008.stdout: "client_info": { 2023-08-01T19:55:36.084 INFO:teuthology.orchestra.run.smithi008.stdout: "client": "client.4668", 2023-08-01T19:55:36.084 INFO:teuthology.orchestra.run.smithi008.stdout: "client_addr": "172.21.15.6:0/1709472247", 2023-08-01T19:55:36.084 INFO:teuthology.orchestra.run.smithi008.stdout: "tid": 107880 2023-08-01T19:55:36.084 INFO:teuthology.orchestra.run.smithi008.stdout: }, 2023-08-01T19:55:36.085 INFO:teuthology.orchestra.run.smithi008.stdout: "events": [ 2023-08-01T19:55:36.085 INFO:teuthology.orchestra.run.smithi008.stdout: { 2023-08-01T19:55:36.085 INFO:teuthology.orchestra.run.smithi008.stdout: "event": "initiated", 2023-08-01T19:55:36.085 INFO:teuthology.orchestra.run.smithi008.stdout: "time": "2023-08-01T19:55:09.292335+0000", 2023-08-01T19:55:36.085 INFO:teuthology.orchestra.run.smithi008.stdout: "duration": 0 2023-08-01T19:55:36.085 INFO:teuthology.orchestra.run.smithi008.stdout: }, 2023-08-01T19:55:36.085 INFO:teuthology.orchestra.run.smithi008.stdout: { 2023-08-01T19:55:36.085 INFO:teuthology.orchestra.run.smithi008.stdout: "event": "throttled", 2023-08-01T19:55:36.086 INFO:teuthology.orchestra.run.smithi008.stdout: "time": "2023-08-01T19:55:09.292335+0000", 2023-08-01T19:55:36.086 INFO:teuthology.orchestra.run.smithi008.stdout: "duration": 0 2023-08-01T19:55:36.086 INFO:teuthology.orchestra.run.smithi008.stdout: }, 2023-08-01T19:55:36.086 INFO:teuthology.orchestra.run.smithi008.stdout: { 2023-08-01T19:55:36.086 INFO:teuthology.orchestra.run.smithi008.stdout: "event": "header_read", 2023-08-01T19:55:36.086 INFO:teuthology.orchestra.run.smithi008.stdout: "time": "2023-08-01T19:55:09.292334+0000", 2023-08-01T19:55:36.086 INFO:teuthology.orchestra.run.smithi008.stdout: "duration": 4294967295.999999 2023-08-01T19:55:36.086 INFO:teuthology.orchestra.run.smithi008.stdout: }, 2023-08-01T19:55:36.087 INFO:teuthology.orchestra.run.smithi008.stdout: { 2023-08-01T19:55:36.087 INFO:teuthology.orchestra.run.smithi008.stdout: "event": "all_read", 2023-08-01T19:55:36.087 INFO:teuthology.orchestra.run.smithi008.stdout: "time": "2023-08-01T19:55:09.292449+0000", 2023-08-01T19:55:36.087 INFO:teuthology.orchestra.run.smithi008.stdout: "duration": 0.00011551400000000001 2023-08-01T19:55:36.087 INFO:teuthology.orchestra.run.smithi008.stdout: }, 2023-08-01T19:55:36.087 INFO:teuthology.orchestra.run.smithi008.stdout: { 2023-08-01T19:55:36.087 INFO:teuthology.orchestra.run.smithi008.stdout: "event": "dispatched", 2023-08-01T19:55:36.087 INFO:teuthology.orchestra.run.smithi008.stdout: "time": "2023-08-01T19:55:09.292461+0000", 2023-08-01T19:55:36.088 INFO:teuthology.orchestra.run.smithi008.stdout: "duration": 1.1287000000000001e-05 2023-08-01T19:55:36.088 INFO:teuthology.orchestra.run.smithi008.stdout: }, 2023-08-01T19:55:36.088 INFO:teuthology.orchestra.run.smithi008.stdout: { 2023-08-01T19:55:36.088 INFO:teuthology.orchestra.run.smithi008.stdout: "event": "queued_for_pg", 2023-08-01T19:55:36.088 INFO:teuthology.orchestra.run.smithi008.stdout: "time": "2023-08-01T19:55:09.292467+0000", 2023-08-01T19:55:36.088 INFO:teuthology.orchestra.run.smithi008.stdout: "duration": 6.4520000000000002e-06 2023-08-01T19:55:36.088 INFO:teuthology.orchestra.run.smithi008.stdout: }, 2023-08-01T19:55:36.089 INFO:teuthology.orchestra.run.smithi008.stdout: { 2023-08-01T19:55:36.089 INFO:teuthology.orchestra.run.smithi008.stdout: "event": "reached_pg", 2023-08-01T19:55:36.089 INFO:teuthology.orchestra.run.smithi008.stdout: "time": "2023-08-01T19:55:09.292510+0000", 2023-08-01T19:55:36.089 INFO:teuthology.orchestra.run.smithi008.stdout: "duration": 4.2502000000000001e-05 2023-08-01T19:55:36.089 INFO:teuthology.orchestra.run.smithi008.stdout: }, 2023-08-01T19:55:36.089 INFO:teuthology.orchestra.run.smithi008.stdout: { 2023-08-01T19:55:36.089 INFO:teuthology.orchestra.run.smithi008.stdout: "event": "started", 2023-08-01T19:55:36.089 INFO:teuthology.orchestra.run.smithi008.stdout: "time": "2023-08-01T19:55:09.292596+0000", 2023-08-01T19:55:36.090 INFO:teuthology.orchestra.run.smithi008.stdout: "duration": 8.6545000000000006e-05 2023-08-01T19:55:36.090 INFO:teuthology.orchestra.run.smithi008.stdout: }, 2023-08-01T19:55:36.090 INFO:teuthology.orchestra.run.smithi008.stdout: { 2023-08-01T19:55:36.090 INFO:teuthology.orchestra.run.smithi008.stdout: "event": "waiting for subops from 1", 2023-08-01T19:55:36.090 INFO:teuthology.orchestra.run.smithi008.stdout: "time": "2023-08-01T19:55:09.292697+0000", 2023-08-01T19:55:36.090 INFO:teuthology.orchestra.run.smithi008.stdout: "duration": 0.000100368 2023-08-01T19:55:36.090 INFO:teuthology.orchestra.run.smithi008.stdout: }, 2023-08-01T19:55:36.090 INFO:teuthology.orchestra.run.smithi008.stdout: { 2023-08-01T19:55:36.091 INFO:teuthology.orchestra.run.smithi008.stdout: "event": "op_commit", 2023-08-01T19:55:36.091 INFO:teuthology.orchestra.run.smithi008.stdout: "time": "2023-08-01T19:55:09.295658+0000", 2023-08-01T19:55:36.091 INFO:teuthology.orchestra.run.smithi008.stdout: "duration": 0.0029617290000000002 2023-08-01T19:55:36.091 INFO:teuthology.orchestra.run.smithi008.stdout: }, 2023-08-01T19:55:36.091 INFO:teuthology.orchestra.run.smithi008.stdout: { 2023-08-01T19:55:36.091 INFO:teuthology.orchestra.run.smithi008.stdout: "event": "sub_op_commit_rec", 2023-08-01T19:55:36.091 INFO:teuthology.orchestra.run.smithi008.stdout: "time": "2023-08-01T19:55:09.353604+0000", 2023-08-01T19:55:36.091 INFO:teuthology.orchestra.run.smithi008.stdout: "duration": 0.057945868999999997 2023-08-01T19:55:36.092 INFO:teuthology.orchestra.run.smithi008.stdout: }, 2023-08-01T19:55:36.092 INFO:teuthology.orchestra.run.smithi008.stdout: { 2023-08-01T19:55:36.092 INFO:teuthology.orchestra.run.smithi008.stdout: "event": "commit_sent", 2023-08-01T19:55:36.092 INFO:teuthology.orchestra.run.smithi008.stdout: "time": "2023-08-01T19:55:09.353650+0000", 2023-08-01T19:55:36.092 INFO:teuthology.orchestra.run.smithi008.stdout: "duration": 4.5698999999999997e-05 2023-08-01T19:55:36.092 INFO:teuthology.orchestra.run.smithi008.stdout: }, 2023-08-01T19:55:36.092 INFO:teuthology.orchestra.run.smithi008.stdout: { 2023-08-01T19:55:36.092 INFO:teuthology.orchestra.run.smithi008.stdout: "event": "done", 2023-08-01T19:55:36.093 INFO:teuthology.orchestra.run.smithi008.stdout: "time": "2023-08-01T19:55:09.353686+0000", 2023-08-01T19:55:36.093 INFO:teuthology.orchestra.run.smithi008.stdout: "duration": 3.5936999999999998e-05 2023-08-01T19:55:36.093 INFO:teuthology.orchestra.run.smithi008.stdout: } 2023-08-01T19:55:36.093 INFO:teuthology.orchestra.run.smithi008.stdout: ] 2023-08-01T19:55:36.093 INFO:teuthology.orchestra.run.smithi008.stdout: } 2023-08-01T19:55:36.093 INFO:teuthology.orchestra.run.smithi008.stdout: } 2023-08-01T19:55:36.093 INFO:teuthology.orchestra.run.smithi008.stdout: ] 2023-08-01T19:55:36.093 INFO:teuthology.orchestra.run.smithi008.stdout:} 2023-08-01T19:55:36.094 DEBUG:teuthology.orchestra.run.smithi006:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 120 ceph --cluster ceph osd set nodeep-scrub 2023-08-01T19:55:36.095 INFO:tasks.ceph.osd.2.smithi155.stderr:2023-08-01T19:55:36.093+0000 7faa5c6ac700 -1 received signal: Hangup from /usr/bin/python3 /bin/daemon-helper kill ceph-osd -f --cluster ceph -i 2 (PID: 111337) UID: 0 2023-08-01T19:55:36.096 DEBUG:teuthology.orchestra.run.smithi101:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 30 ceph --cluster ceph --admin-daemon /var/run/ceph/ceph-osd.1.asok dump_ops_in_flight 2023-08-01T19:55:36.195 INFO:tasks.ceph.osd.0.smithi008.stderr:2023-08-01T19:55:36.193+0000 7f16a58f4700 -1 received signal: Hangup from /usr/bin/python3 /bin/daemon-helper kill ceph-osd -f --cluster ceph -i 0 (PID: 111179) UID: 0 2023-08-01T19:55:36.256 INFO:teuthology.orchestra.run.smithi101.stdout:{ 2023-08-01T19:55:36.257 INFO:teuthology.orchestra.run.smithi101.stdout: "ops": [ 2023-08-01T19:55:36.257 INFO:teuthology.orchestra.run.smithi101.stdout: { 2023-08-01T19:55:36.257 INFO:teuthology.orchestra.run.smithi101.stdout: "description": "osd_repop(client.4668.0:156050 5.9 e49/40 5:955c7b5c:::benchmark_data_smithi006_114134_object22389:head v 49'9849, mlcod=49'9847)", 2023-08-01T19:55:36.257 INFO:teuthology.orchestra.run.smithi101.stdout: "initiated_at": "2023-08-01T19:55:36.250376+0000", 2023-08-01T19:55:36.257 INFO:teuthology.orchestra.run.smithi101.stdout: "age": 0.0047637549999999997, 2023-08-01T19:55:36.257 INFO:teuthology.orchestra.run.smithi101.stdout: "duration": 0.0047876810000000002, 2023-08-01T19:55:36.257 INFO:teuthology.orchestra.run.smithi101.stdout: "type_data": { 2023-08-01T19:55:36.258 INFO:teuthology.orchestra.run.smithi101.stdout: "flag_point": "started", 2023-08-01T19:55:36.258 INFO:teuthology.orchestra.run.smithi101.stdout: "events": [ 2023-08-01T19:55:36.258 INFO:teuthology.orchestra.run.smithi101.stdout: { 2023-08-01T19:55:36.258 INFO:teuthology.orchestra.run.smithi101.stdout: "event": "initiated", 2023-08-01T19:55:36.258 INFO:teuthology.orchestra.run.smithi101.stdout: "time": "2023-08-01T19:55:36.250376+0000", 2023-08-01T19:55:36.258 INFO:teuthology.orchestra.run.smithi101.stdout: "duration": 0 2023-08-01T19:55:36.258 INFO:teuthology.orchestra.run.smithi101.stdout: }, 2023-08-01T19:55:36.258 INFO:teuthology.orchestra.run.smithi101.stdout: { 2023-08-01T19:55:36.259 INFO:teuthology.orchestra.run.smithi101.stdout: "event": "throttled", 2023-08-01T19:55:36.259 INFO:teuthology.orchestra.run.smithi101.stdout: "time": "2023-08-01T19:55:36.250376+0000", 2023-08-01T19:55:36.259 INFO:teuthology.orchestra.run.smithi101.stdout: "duration": 0 2023-08-01T19:55:36.259 INFO:teuthology.orchestra.run.smithi101.stdout: }, 2023-08-01T19:55:36.259 INFO:teuthology.orchestra.run.smithi101.stdout: { 2023-08-01T19:55:36.259 INFO:teuthology.orchestra.run.smithi101.stdout: "event": "header_read", 2023-08-01T19:55:36.259 INFO:teuthology.orchestra.run.smithi101.stdout: "time": "2023-08-01T19:55:36.250376+0000", 2023-08-01T19:55:36.259 INFO:teuthology.orchestra.run.smithi101.stdout: "duration": 4294967295.9999995 2023-08-01T19:55:36.260 INFO:teuthology.orchestra.run.smithi101.stdout: }, 2023-08-01T19:55:36.260 INFO:teuthology.orchestra.run.smithi101.stdout: { 2023-08-01T19:55:36.260 INFO:teuthology.orchestra.run.smithi101.stdout: "event": "all_read", 2023-08-01T19:55:36.260 INFO:teuthology.orchestra.run.smithi101.stdout: "time": "2023-08-01T19:55:36.250381+0000", 2023-08-01T19:55:36.260 INFO:teuthology.orchestra.run.smithi101.stdout: "duration": 4.9880000000000004e-06 2023-08-01T19:55:36.260 INFO:teuthology.orchestra.run.smithi101.stdout: }, 2023-08-01T19:55:36.260 INFO:teuthology.orchestra.run.smithi101.stdout: { 2023-08-01T19:55:36.260 INFO:teuthology.orchestra.run.smithi101.stdout: "event": "dispatched", 2023-08-01T19:55:36.261 INFO:teuthology.orchestra.run.smithi101.stdout: "time": "2023-08-01T19:55:36.250388+0000", 2023-08-01T19:55:36.261 INFO:teuthology.orchestra.run.smithi101.stdout: "duration": 6.9090000000000003e-06 2023-08-01T19:55:36.261 INFO:teuthology.orchestra.run.smithi101.stdout: }, 2023-08-01T19:55:36.261 INFO:teuthology.orchestra.run.smithi101.stdout: { 2023-08-01T19:55:36.261 INFO:teuthology.orchestra.run.smithi101.stdout: "event": "queued_for_pg", 2023-08-01T19:55:36.261 INFO:teuthology.orchestra.run.smithi101.stdout: "time": "2023-08-01T19:55:36.250391+0000", 2023-08-01T19:55:36.261 INFO:teuthology.orchestra.run.smithi101.stdout: "duration": 2.8940000000000002e-06 2023-08-01T19:55:36.261 INFO:teuthology.orchestra.run.smithi101.stdout: }, 2023-08-01T19:55:36.262 INFO:teuthology.orchestra.run.smithi101.stdout: { 2023-08-01T19:55:36.262 INFO:teuthology.orchestra.run.smithi101.stdout: "event": "reached_pg", 2023-08-01T19:55:36.262 INFO:teuthology.orchestra.run.smithi101.stdout: "time": "2023-08-01T19:55:36.250423+0000", 2023-08-01T19:55:36.262 INFO:teuthology.orchestra.run.smithi101.stdout: "duration": 3.2923999999999999e-05 2023-08-01T19:55:36.262 INFO:teuthology.orchestra.run.smithi101.stdout: }, 2023-08-01T19:55:36.262 INFO:teuthology.orchestra.run.smithi101.stdout: { 2023-08-01T19:55:36.262 INFO:teuthology.orchestra.run.smithi101.stdout: "event": "started", 2023-08-01T19:55:36.262 INFO:teuthology.orchestra.run.smithi101.stdout: "time": "2023-08-01T19:55:36.250442+0000", 2023-08-01T19:55:36.263 INFO:teuthology.orchestra.run.smithi101.stdout: "duration": 1.8431e-05 2023-08-01T19:55:36.263 INFO:teuthology.orchestra.run.smithi101.stdout: } 2023-08-01T19:55:36.263 INFO:teuthology.orchestra.run.smithi101.stdout: ] 2023-08-01T19:55:36.263 INFO:teuthology.orchestra.run.smithi101.stdout: } 2023-08-01T19:55:36.263 INFO:teuthology.orchestra.run.smithi101.stdout: }, 2023-08-01T19:55:36.263 INFO:teuthology.orchestra.run.smithi101.stdout: { 2023-08-01T19:55:36.263 INFO:teuthology.orchestra.run.smithi101.stdout: "description": "osd_repop(client.4668.0:156047 5.1 e49/40 5:8e84793a:::benchmark_data_smithi006_114134_object22386:head v 49'9700, mlcod=49'9696)", 2023-08-01T19:55:36.264 INFO:teuthology.orchestra.run.smithi101.stdout: "initiated_at": "2023-08-01T19:55:36.251337+0000", 2023-08-01T19:55:36.264 INFO:teuthology.orchestra.run.smithi101.stdout: "age": 0.003802532, 2023-08-01T19:55:36.264 INFO:teuthology.orchestra.run.smithi101.stdout: "duration": 0.0038939370000000001, 2023-08-01T19:55:36.264 INFO:teuthology.orchestra.run.smithi101.stdout: "type_data": { 2023-08-01T19:55:36.264 INFO:teuthology.orchestra.run.smithi101.stdout: "flag_point": "started", 2023-08-01T19:55:36.264 INFO:teuthology.orchestra.run.smithi101.stdout: "events": [ 2023-08-01T19:55:36.264 INFO:teuthology.orchestra.run.smithi101.stdout: { 2023-08-01T19:55:36.264 INFO:teuthology.orchestra.run.smithi101.stdout: "event": "initiated", 2023-08-01T19:55:36.265 INFO:teuthology.orchestra.run.smithi101.stdout: "time": "2023-08-01T19:55:36.251337+0000", 2023-08-01T19:55:36.265 INFO:teuthology.orchestra.run.smithi101.stdout: "duration": 0 2023-08-01T19:55:36.265 INFO:teuthology.orchestra.run.smithi101.stdout: }, 2023-08-01T19:55:36.265 INFO:teuthology.orchestra.run.smithi101.stdout: { 2023-08-01T19:55:36.265 INFO:teuthology.orchestra.run.smithi101.stdout: "event": "throttled", 2023-08-01T19:55:36.265 INFO:teuthology.orchestra.run.smithi101.stdout: "time": "2023-08-01T19:55:36.251337+0000", 2023-08-01T19:55:36.265 INFO:teuthology.orchestra.run.smithi101.stdout: "duration": 0 2023-08-01T19:55:36.265 INFO:teuthology.orchestra.run.smithi101.stdout: }, 2023-08-01T19:55:36.266 INFO:teuthology.orchestra.run.smithi101.stdout: { 2023-08-01T19:55:36.266 INFO:teuthology.orchestra.run.smithi101.stdout: "event": "header_read", 2023-08-01T19:55:36.266 INFO:teuthology.orchestra.run.smithi101.stdout: "time": "2023-08-01T19:55:36.251337+0000", 2023-08-01T19:55:36.266 INFO:teuthology.orchestra.run.smithi101.stdout: "duration": 4294967295.9999995 2023-08-01T19:55:36.266 INFO:teuthology.orchestra.run.smithi101.stdout: }, 2023-08-01T19:55:36.266 INFO:teuthology.orchestra.run.smithi101.stdout: { 2023-08-01T19:55:36.266 INFO:teuthology.orchestra.run.smithi101.stdout: "event": "all_read", 2023-08-01T19:55:36.266 INFO:teuthology.orchestra.run.smithi101.stdout: "time": "2023-08-01T19:55:36.251342+0000", 2023-08-01T19:55:36.267 INFO:teuthology.orchestra.run.smithi101.stdout: "duration": 4.8180000000000003e-06 2023-08-01T19:55:36.267 INFO:teuthology.orchestra.run.smithi101.stdout: }, 2023-08-01T19:55:36.267 INFO:teuthology.orchestra.run.smithi101.stdout: { 2023-08-01T19:55:36.267 INFO:teuthology.orchestra.run.smithi101.stdout: "event": "dispatched", 2023-08-01T19:55:36.267 INFO:teuthology.orchestra.run.smithi101.stdout: "time": "2023-08-01T19:55:36.251354+0000", 2023-08-01T19:55:36.267 INFO:teuthology.orchestra.run.smithi101.stdout: "duration": 1.2506e-05 2023-08-01T19:55:36.267 INFO:teuthology.orchestra.run.smithi101.stdout: }, 2023-08-01T19:55:36.267 INFO:teuthology.orchestra.run.smithi101.stdout: { 2023-08-01T19:55:36.268 INFO:teuthology.orchestra.run.smithi101.stdout: "event": "queued_for_pg", 2023-08-01T19:55:36.268 INFO:teuthology.orchestra.run.smithi101.stdout: "time": "2023-08-01T19:55:36.251358+0000", 2023-08-01T19:55:36.268 INFO:teuthology.orchestra.run.smithi101.stdout: "duration": 3.8940000000000003e-06 2023-08-01T19:55:36.268 INFO:teuthology.orchestra.run.smithi101.stdout: }, 2023-08-01T19:55:36.268 INFO:teuthology.orchestra.run.smithi101.stdout: { 2023-08-01T19:55:36.268 INFO:teuthology.orchestra.run.smithi101.stdout: "event": "reached_pg", 2023-08-01T19:55:36.268 INFO:teuthology.orchestra.run.smithi101.stdout: "time": "2023-08-01T19:55:36.251390+0000", 2023-08-01T19:55:36.268 INFO:teuthology.orchestra.run.smithi101.stdout: "duration": 3.218e-05 2023-08-01T19:55:36.269 INFO:teuthology.orchestra.run.smithi101.stdout: }, 2023-08-01T19:55:36.269 INFO:teuthology.orchestra.run.smithi101.stdout: { 2023-08-01T19:55:36.269 INFO:teuthology.orchestra.run.smithi101.stdout: "event": "started", 2023-08-01T19:55:36.269 INFO:teuthology.orchestra.run.smithi101.stdout: "time": "2023-08-01T19:55:36.251408+0000", 2023-08-01T19:55:36.269 INFO:teuthology.orchestra.run.smithi101.stdout: "duration": 1.7793000000000001e-05 2023-08-01T19:55:36.269 INFO:teuthology.orchestra.run.smithi101.stdout: } 2023-08-01T19:55:36.269 INFO:teuthology.orchestra.run.smithi101.stdout: ] 2023-08-01T19:55:36.269 INFO:teuthology.orchestra.run.smithi101.stdout: } 2023-08-01T19:55:36.270 INFO:teuthology.orchestra.run.smithi101.stdout: }, 2023-08-01T19:55:36.270 INFO:teuthology.orchestra.run.smithi101.stdout: { 2023-08-01T19:55:36.270 INFO:teuthology.orchestra.run.smithi101.stdout: "description": "osd_repop(client.4668.0:156049 5.1 e49/40 5:8539672c:::benchmark_data_smithi006_114134_object22388:head v 49'9701, mlcod=49'9696)", 2023-08-01T19:55:36.270 INFO:teuthology.orchestra.run.smithi101.stdout: "initiated_at": "2023-08-01T19:55:36.251696+0000", 2023-08-01T19:55:36.270 INFO:teuthology.orchestra.run.smithi101.stdout: "age": 0.003444033, 2023-08-01T19:55:36.270 INFO:teuthology.orchestra.run.smithi101.stdout: "duration": 0.0035978490000000002, 2023-08-01T19:55:36.270 INFO:teuthology.orchestra.run.smithi101.stdout: "type_data": { 2023-08-01T19:55:36.270 INFO:teuthology.orchestra.run.smithi101.stdout: "flag_point": "started", 2023-08-01T19:55:36.271 INFO:teuthology.orchestra.run.smithi101.stdout: "events": [ 2023-08-01T19:55:36.271 INFO:teuthology.orchestra.run.smithi101.stdout: { 2023-08-01T19:55:36.271 INFO:teuthology.orchestra.run.smithi101.stdout: "event": "initiated", 2023-08-01T19:55:36.271 INFO:teuthology.orchestra.run.smithi101.stdout: "time": "2023-08-01T19:55:36.251696+0000", 2023-08-01T19:55:36.271 INFO:teuthology.orchestra.run.smithi101.stdout: "duration": 0 2023-08-01T19:55:36.271 INFO:teuthology.orchestra.run.smithi101.stdout: }, 2023-08-01T19:55:36.271 INFO:teuthology.orchestra.run.smithi101.stdout: { 2023-08-01T19:55:36.272 INFO:teuthology.orchestra.run.smithi101.stdout: "event": "throttled", 2023-08-01T19:55:36.272 INFO:teuthology.orchestra.run.smithi101.stdout: "time": "2023-08-01T19:55:36.251696+0000", 2023-08-01T19:55:36.272 INFO:teuthology.orchestra.run.smithi101.stdout: "duration": 0 2023-08-01T19:55:36.272 INFO:teuthology.orchestra.run.smithi101.stdout: }, 2023-08-01T19:55:36.272 INFO:teuthology.orchestra.run.smithi101.stdout: { 2023-08-01T19:55:36.272 INFO:teuthology.orchestra.run.smithi101.stdout: "event": "header_read", 2023-08-01T19:55:36.272 INFO:teuthology.orchestra.run.smithi101.stdout: "time": "2023-08-01T19:55:36.251695+0000", 2023-08-01T19:55:36.272 INFO:teuthology.orchestra.run.smithi101.stdout: "duration": 4294967295.9999995 2023-08-01T19:55:36.273 INFO:teuthology.orchestra.run.smithi101.stdout: }, 2023-08-01T19:55:36.273 INFO:teuthology.orchestra.run.smithi101.stdout: { 2023-08-01T19:55:36.273 INFO:teuthology.orchestra.run.smithi101.stdout: "event": "all_read", 2023-08-01T19:55:36.273 INFO:teuthology.orchestra.run.smithi101.stdout: "time": "2023-08-01T19:55:36.251701+0000", 2023-08-01T19:55:36.273 INFO:teuthology.orchestra.run.smithi101.stdout: "duration": 5.2259999999999996e-06 2023-08-01T19:55:36.273 INFO:teuthology.orchestra.run.smithi101.stdout: }, 2023-08-01T19:55:36.273 INFO:teuthology.orchestra.run.smithi101.stdout: { 2023-08-01T19:55:36.273 INFO:teuthology.orchestra.run.smithi101.stdout: "event": "dispatched", 2023-08-01T19:55:36.274 INFO:teuthology.orchestra.run.smithi101.stdout: "time": "2023-08-01T19:55:36.251718+0000", 2023-08-01T19:55:36.274 INFO:teuthology.orchestra.run.smithi101.stdout: "duration": 1.7691999999999999e-05 2023-08-01T19:55:36.274 INFO:teuthology.orchestra.run.smithi101.stdout: }, 2023-08-01T19:55:36.274 INFO:teuthology.orchestra.run.smithi101.stdout: { 2023-08-01T19:55:36.274 INFO:teuthology.orchestra.run.smithi101.stdout: "event": "queued_for_pg", 2023-08-01T19:55:36.274 INFO:teuthology.orchestra.run.smithi101.stdout: "time": "2023-08-01T19:55:36.251724+0000", 2023-08-01T19:55:36.274 INFO:teuthology.orchestra.run.smithi101.stdout: "duration": 5.9170000000000003e-06 2023-08-01T19:55:36.274 INFO:teuthology.orchestra.run.smithi101.stdout: }, 2023-08-01T19:55:36.275 INFO:teuthology.orchestra.run.smithi101.stdout: { 2023-08-01T19:55:36.275 INFO:teuthology.orchestra.run.smithi101.stdout: "event": "reached_pg", 2023-08-01T19:55:36.275 INFO:teuthology.orchestra.run.smithi101.stdout: "time": "2023-08-01T19:55:36.252293+0000", 2023-08-01T19:55:36.275 INFO:teuthology.orchestra.run.smithi101.stdout: "duration": 0.00056846000000000002 2023-08-01T19:55:36.275 INFO:teuthology.orchestra.run.smithi101.stdout: }, 2023-08-01T19:55:36.275 INFO:teuthology.orchestra.run.smithi101.stdout: { 2023-08-01T19:55:36.275 INFO:teuthology.orchestra.run.smithi101.stdout: "event": "started", 2023-08-01T19:55:36.275 INFO:teuthology.orchestra.run.smithi101.stdout: "time": "2023-08-01T19:55:36.252309+0000", 2023-08-01T19:55:36.276 INFO:teuthology.orchestra.run.smithi101.stdout: "duration": 1.6113e-05 2023-08-01T19:55:36.276 INFO:teuthology.orchestra.run.smithi101.stdout: } 2023-08-01T19:55:36.276 INFO:teuthology.orchestra.run.smithi101.stdout: ] 2023-08-01T19:55:36.276 INFO:teuthology.orchestra.run.smithi101.stdout: } 2023-08-01T19:55:36.276 INFO:teuthology.orchestra.run.smithi101.stdout: }, 2023-08-01T19:55:36.276 INFO:teuthology.orchestra.run.smithi101.stdout: { 2023-08-01T19:55:36.276 INFO:teuthology.orchestra.run.smithi101.stdout: "description": "osd_repop(client.4668.0:156053 5.6 e49/19 5:66fdddc8:::benchmark_data_smithi006_114134_object22392:head v 49'9699, mlcod=49'9697)", 2023-08-01T19:55:36.276 INFO:teuthology.orchestra.run.smithi101.stdout: "initiated_at": "2023-08-01T19:55:36.252343+0000", 2023-08-01T19:55:36.277 INFO:teuthology.orchestra.run.smithi101.stdout: "age": 0.002796551, 2023-08-01T19:55:36.277 INFO:teuthology.orchestra.run.smithi101.stdout: "duration": 0.0030091330000000002, 2023-08-01T19:55:36.277 INFO:teuthology.orchestra.run.smithi101.stdout: "type_data": { 2023-08-01T19:55:36.277 INFO:teuthology.orchestra.run.smithi101.stdout: "flag_point": "started", 2023-08-01T19:55:36.277 INFO:teuthology.orchestra.run.smithi101.stdout: "events": [ 2023-08-01T19:55:36.277 INFO:teuthology.orchestra.run.smithi101.stdout: { 2023-08-01T19:55:36.277 INFO:teuthology.orchestra.run.smithi101.stdout: "event": "initiated", 2023-08-01T19:55:36.278 INFO:teuthology.orchestra.run.smithi101.stdout: "time": "2023-08-01T19:55:36.252343+0000", 2023-08-01T19:55:36.278 INFO:teuthology.orchestra.run.smithi101.stdout: "duration": 0 2023-08-01T19:55:36.278 INFO:teuthology.orchestra.run.smithi101.stdout: }, 2023-08-01T19:55:36.278 INFO:teuthology.orchestra.run.smithi101.stdout: { 2023-08-01T19:55:36.278 INFO:teuthology.orchestra.run.smithi101.stdout: "event": "throttled", 2023-08-01T19:55:36.278 INFO:teuthology.orchestra.run.smithi101.stdout: "time": "2023-08-01T19:55:36.252343+0000", 2023-08-01T19:55:36.278 INFO:teuthology.orchestra.run.smithi101.stdout: "duration": 0 2023-08-01T19:55:36.278 INFO:teuthology.orchestra.run.smithi101.stdout: }, 2023-08-01T19:55:36.279 INFO:teuthology.orchestra.run.smithi101.stdout: { 2023-08-01T19:55:36.279 INFO:teuthology.orchestra.run.smithi101.stdout: "event": "header_read", 2023-08-01T19:55:36.279 INFO:teuthology.orchestra.run.smithi101.stdout: "time": "2023-08-01T19:55:36.252343+0000", 2023-08-01T19:55:36.279 INFO:teuthology.orchestra.run.smithi101.stdout: "duration": 4294967295.9999995 2023-08-01T19:55:36.279 INFO:teuthology.orchestra.run.smithi101.stdout: }, 2023-08-01T19:55:36.279 INFO:teuthology.orchestra.run.smithi101.stdout: { 2023-08-01T19:55:36.279 INFO:teuthology.orchestra.run.smithi101.stdout: "event": "all_read", 2023-08-01T19:55:36.279 INFO:teuthology.orchestra.run.smithi101.stdout: "time": "2023-08-01T19:55:36.252348+0000", 2023-08-01T19:55:36.280 INFO:teuthology.orchestra.run.smithi101.stdout: "duration": 4.972e-06 2023-08-01T19:55:36.280 INFO:teuthology.orchestra.run.smithi101.stdout: }, 2023-08-01T19:55:36.280 INFO:teuthology.orchestra.run.smithi101.stdout: { 2023-08-01T19:55:36.280 INFO:teuthology.orchestra.run.smithi101.stdout: "event": "dispatched", 2023-08-01T19:55:36.280 INFO:teuthology.orchestra.run.smithi101.stdout: "time": "2023-08-01T19:55:36.252356+0000", 2023-08-01T19:55:36.280 INFO:teuthology.orchestra.run.smithi101.stdout: "duration": 7.8509999999999999e-06 2023-08-01T19:55:36.280 INFO:teuthology.orchestra.run.smithi101.stdout: }, 2023-08-01T19:55:36.280 INFO:teuthology.orchestra.run.smithi101.stdout: { 2023-08-01T19:55:36.281 INFO:teuthology.orchestra.run.smithi101.stdout: "event": "queued_for_pg", 2023-08-01T19:55:36.281 INFO:teuthology.orchestra.run.smithi101.stdout: "time": "2023-08-01T19:55:36.252360+0000", 2023-08-01T19:55:36.281 INFO:teuthology.orchestra.run.smithi101.stdout: "duration": 3.946e-06 2023-08-01T19:55:36.281 INFO:teuthology.orchestra.run.smithi101.stdout: }, 2023-08-01T19:55:36.281 INFO:teuthology.orchestra.run.smithi101.stdout: { 2023-08-01T19:55:36.281 INFO:teuthology.orchestra.run.smithi101.stdout: "event": "reached_pg", 2023-08-01T19:55:36.281 INFO:teuthology.orchestra.run.smithi101.stdout: "time": "2023-08-01T19:55:36.252394+0000", 2023-08-01T19:55:36.281 INFO:teuthology.orchestra.run.smithi101.stdout: "duration": 3.4440999999999998e-05 2023-08-01T19:55:36.282 INFO:teuthology.orchestra.run.smithi101.stdout: }, 2023-08-01T19:55:36.282 INFO:teuthology.orchestra.run.smithi101.stdout: { 2023-08-01T19:55:36.282 INFO:teuthology.orchestra.run.smithi101.stdout: "event": "started", 2023-08-01T19:55:36.282 INFO:teuthology.orchestra.run.smithi101.stdout: "time": "2023-08-01T19:55:36.252413+0000", 2023-08-01T19:55:36.282 INFO:teuthology.orchestra.run.smithi101.stdout: "duration": 1.8790000000000001e-05 2023-08-01T19:55:36.282 INFO:teuthology.orchestra.run.smithi101.stdout: } 2023-08-01T19:55:36.282 INFO:teuthology.orchestra.run.smithi101.stdout: ] 2023-08-01T19:55:36.282 INFO:teuthology.orchestra.run.smithi101.stdout: } 2023-08-01T19:55:36.283 INFO:teuthology.orchestra.run.smithi101.stdout: }, 2023-08-01T19:55:36.283 INFO:teuthology.orchestra.run.smithi101.stdout: { 2023-08-01T19:55:36.283 INFO:teuthology.orchestra.run.smithi101.stdout: "description": "osd_repop(client.4668.0:156055 5.c e49/19 5:3266e8bb:::benchmark_data_smithi006_114134_object22394:head v 49'9727, mlcod=49'9725)", 2023-08-01T19:55:36.283 INFO:teuthology.orchestra.run.smithi101.stdout: "initiated_at": "2023-08-01T19:55:36.252380+0000", 2023-08-01T19:55:36.283 INFO:teuthology.orchestra.run.smithi101.stdout: "age": 0.0027599130000000001, 2023-08-01T19:55:36.283 INFO:teuthology.orchestra.run.smithi101.stdout: "duration": 0.0030317579999999998, 2023-08-01T19:55:36.283 INFO:teuthology.orchestra.run.smithi101.stdout: "type_data": { 2023-08-01T19:55:36.283 INFO:teuthology.orchestra.run.smithi101.stdout: "flag_point": "started", 2023-08-01T19:55:36.284 INFO:teuthology.orchestra.run.smithi101.stdout: "events": [ 2023-08-01T19:55:36.284 INFO:teuthology.orchestra.run.smithi101.stdout: { 2023-08-01T19:55:36.284 INFO:teuthology.orchestra.run.smithi101.stdout: "event": "initiated", 2023-08-01T19:55:36.284 INFO:teuthology.orchestra.run.smithi101.stdout: "time": "2023-08-01T19:55:36.252380+0000", 2023-08-01T19:55:36.284 INFO:teuthology.orchestra.run.smithi101.stdout: "duration": 0 2023-08-01T19:55:36.284 INFO:teuthology.orchestra.run.smithi101.stdout: }, 2023-08-01T19:55:36.284 INFO:teuthology.orchestra.run.smithi101.stdout: { 2023-08-01T19:55:36.285 INFO:teuthology.orchestra.run.smithi101.stdout: "event": "throttled", 2023-08-01T19:55:36.285 INFO:teuthology.orchestra.run.smithi101.stdout: "time": "2023-08-01T19:55:36.252380+0000", 2023-08-01T19:55:36.285 INFO:teuthology.orchestra.run.smithi101.stdout: "duration": 0 2023-08-01T19:55:36.285 INFO:teuthology.orchestra.run.smithi101.stdout: }, 2023-08-01T19:55:36.285 INFO:teuthology.orchestra.run.smithi101.stdout: { 2023-08-01T19:55:36.285 INFO:teuthology.orchestra.run.smithi101.stdout: "event": "header_read", 2023-08-01T19:55:36.285 INFO:teuthology.orchestra.run.smithi101.stdout: "time": "2023-08-01T19:55:36.252380+0000", 2023-08-01T19:55:36.285 INFO:teuthology.orchestra.run.smithi101.stdout: "duration": 4294967295.9999995 2023-08-01T19:55:36.286 INFO:teuthology.orchestra.run.smithi101.stdout: }, 2023-08-01T19:55:36.286 INFO:teuthology.orchestra.run.smithi101.stdout: { 2023-08-01T19:55:36.286 INFO:teuthology.orchestra.run.smithi101.stdout: "event": "all_read", 2023-08-01T19:55:36.286 INFO:teuthology.orchestra.run.smithi101.stdout: "time": "2023-08-01T19:55:36.252383+0000", 2023-08-01T19:55:36.286 INFO:teuthology.orchestra.run.smithi101.stdout: "duration": 2.7580000000000001e-06 2023-08-01T19:55:36.286 INFO:teuthology.orchestra.run.smithi101.stdout: }, 2023-08-01T19:55:36.286 INFO:teuthology.orchestra.run.smithi101.stdout: { 2023-08-01T19:55:36.286 INFO:teuthology.orchestra.run.smithi101.stdout: "event": "dispatched", 2023-08-01T19:55:36.287 INFO:teuthology.orchestra.run.smithi101.stdout: "time": "2023-08-01T19:55:36.252386+0000", 2023-08-01T19:55:36.287 INFO:teuthology.orchestra.run.smithi101.stdout: "duration": 3.9380000000000002e-06 2023-08-01T19:55:36.287 INFO:teuthology.orchestra.run.smithi101.stdout: }, 2023-08-01T19:55:36.287 INFO:teuthology.orchestra.run.smithi101.stdout: { 2023-08-01T19:55:36.287 INFO:teuthology.orchestra.run.smithi101.stdout: "event": "queued_for_pg", 2023-08-01T19:55:36.287 INFO:teuthology.orchestra.run.smithi101.stdout: "time": "2023-08-01T19:55:36.252389+0000", 2023-08-01T19:55:36.287 INFO:teuthology.orchestra.run.smithi101.stdout: "duration": 2.4360000000000001e-06 2023-08-01T19:55:36.287 INFO:teuthology.orchestra.run.smithi101.stdout: }, 2023-08-01T19:55:36.288 INFO:teuthology.orchestra.run.smithi101.stdout: { 2023-08-01T19:55:36.288 INFO:teuthology.orchestra.run.smithi101.stdout: "event": "reached_pg", 2023-08-01T19:55:36.288 INFO:teuthology.orchestra.run.smithi101.stdout: "time": "2023-08-01T19:55:36.252425+0000", 2023-08-01T19:55:36.288 INFO:teuthology.orchestra.run.smithi101.stdout: "duration": 3.6257999999999997e-05 2023-08-01T19:55:36.288 INFO:teuthology.orchestra.run.smithi101.stdout: }, 2023-08-01T19:55:36.288 INFO:teuthology.orchestra.run.smithi101.stdout: { 2023-08-01T19:55:36.288 INFO:teuthology.orchestra.run.smithi101.stdout: "event": "started", 2023-08-01T19:55:36.288 INFO:teuthology.orchestra.run.smithi101.stdout: "time": "2023-08-01T19:55:36.252454+0000", 2023-08-01T19:55:36.289 INFO:teuthology.orchestra.run.smithi101.stdout: "duration": 2.8408999999999999e-05 2023-08-01T19:55:36.289 INFO:teuthology.orchestra.run.smithi101.stdout: } 2023-08-01T19:55:36.289 INFO:teuthology.orchestra.run.smithi101.stdout: ] 2023-08-01T19:55:36.289 INFO:teuthology.orchestra.run.smithi101.stdout: } 2023-08-01T19:55:36.289 INFO:teuthology.orchestra.run.smithi101.stdout: }, 2023-08-01T19:55:36.289 INFO:teuthology.orchestra.run.smithi101.stdout: { 2023-08-01T19:55:36.289 INFO:teuthology.orchestra.run.smithi101.stdout: "description": "osd_repop(client.4668.0:156051 5.9 e49/40 5:9e865967:::benchmark_data_smithi006_114134_object22390:head v 49'9850, mlcod=49'9847)", 2023-08-01T19:55:36.289 INFO:teuthology.orchestra.run.smithi101.stdout: "initiated_at": "2023-08-01T19:55:36.252742+0000", 2023-08-01T19:55:36.290 INFO:teuthology.orchestra.run.smithi101.stdout: "age": 0.0023982109999999999, 2023-08-01T19:55:36.290 INFO:teuthology.orchestra.run.smithi101.stdout: "duration": 0.002736236, 2023-08-01T19:55:36.290 INFO:teuthology.orchestra.run.smithi101.stdout: "type_data": { 2023-08-01T19:55:36.290 INFO:teuthology.orchestra.run.smithi101.stdout: "flag_point": "started", 2023-08-01T19:55:36.290 INFO:teuthology.orchestra.run.smithi101.stdout: "events": [ 2023-08-01T19:55:36.290 INFO:teuthology.orchestra.run.smithi101.stdout: { 2023-08-01T19:55:36.290 INFO:teuthology.orchestra.run.smithi101.stdout: "event": "initiated", 2023-08-01T19:55:36.290 INFO:teuthology.orchestra.run.smithi101.stdout: "time": "2023-08-01T19:55:36.252742+0000", 2023-08-01T19:55:36.291 INFO:teuthology.orchestra.run.smithi101.stdout: "duration": 0 2023-08-01T19:55:36.291 INFO:teuthology.orchestra.run.smithi101.stdout: }, 2023-08-01T19:55:36.291 INFO:teuthology.orchestra.run.smithi101.stdout: { 2023-08-01T19:55:36.291 INFO:teuthology.orchestra.run.smithi101.stdout: "event": "throttled", 2023-08-01T19:55:36.291 INFO:teuthology.orchestra.run.smithi101.stdout: "time": "2023-08-01T19:55:36.252742+0000", 2023-08-01T19:55:36.291 INFO:teuthology.orchestra.run.smithi101.stdout: "duration": 0 2023-08-01T19:55:36.291 INFO:teuthology.orchestra.run.smithi101.stdout: }, 2023-08-01T19:55:36.291 INFO:teuthology.orchestra.run.smithi101.stdout: { 2023-08-01T19:55:36.292 INFO:teuthology.orchestra.run.smithi101.stdout: "event": "header_read", 2023-08-01T19:55:36.292 INFO:teuthology.orchestra.run.smithi101.stdout: "time": "2023-08-01T19:55:36.252741+0000", 2023-08-01T19:55:36.292 INFO:teuthology.orchestra.run.smithi101.stdout: "duration": 4294967295.9999995 2023-08-01T19:55:36.292 INFO:teuthology.orchestra.run.smithi101.stdout: }, 2023-08-01T19:55:36.292 INFO:teuthology.orchestra.run.smithi101.stdout: { 2023-08-01T19:55:36.292 INFO:teuthology.orchestra.run.smithi101.stdout: "event": "all_read", 2023-08-01T19:55:36.292 INFO:teuthology.orchestra.run.smithi101.stdout: "time": "2023-08-01T19:55:36.252746+0000", 2023-08-01T19:55:36.293 INFO:teuthology.orchestra.run.smithi101.stdout: "duration": 5.0440000000000003e-06 2023-08-01T19:55:36.293 INFO:teuthology.orchestra.run.smithi101.stdout: }, 2023-08-01T19:55:36.293 INFO:teuthology.orchestra.run.smithi101.stdout: { 2023-08-01T19:55:36.293 INFO:teuthology.orchestra.run.smithi101.stdout: "event": "dispatched", 2023-08-01T19:55:36.293 INFO:teuthology.orchestra.run.smithi101.stdout: "time": "2023-08-01T19:55:36.252756+0000", 2023-08-01T19:55:36.293 INFO:teuthology.orchestra.run.smithi101.stdout: "duration": 9.5980000000000003e-06 2023-08-01T19:55:36.293 INFO:teuthology.orchestra.run.smithi101.stdout: }, 2023-08-01T19:55:36.293 INFO:teuthology.orchestra.run.smithi101.stdout: { 2023-08-01T19:55:36.294 INFO:teuthology.orchestra.run.smithi101.stdout: "event": "queued_for_pg", 2023-08-01T19:55:36.294 INFO:teuthology.orchestra.run.smithi101.stdout: "time": "2023-08-01T19:55:36.252760+0000", 2023-08-01T19:55:36.294 INFO:teuthology.orchestra.run.smithi101.stdout: "duration": 4.2880000000000003e-06 2023-08-01T19:55:36.294 INFO:teuthology.orchestra.run.smithi101.stdout: }, 2023-08-01T19:55:36.294 INFO:teuthology.orchestra.run.smithi101.stdout: { 2023-08-01T19:55:36.294 INFO:teuthology.orchestra.run.smithi101.stdout: "event": "reached_pg", 2023-08-01T19:55:36.294 INFO:teuthology.orchestra.run.smithi101.stdout: "time": "2023-08-01T19:55:36.252790+0000", 2023-08-01T19:55:36.294 INFO:teuthology.orchestra.run.smithi101.stdout: "duration": 3.0056000000000002e-05 2023-08-01T19:55:36.295 INFO:teuthology.orchestra.run.smithi101.stdout: }, 2023-08-01T19:55:36.295 INFO:teuthology.orchestra.run.smithi101.stdout: { 2023-08-01T19:55:36.295 INFO:teuthology.orchestra.run.smithi101.stdout: "event": "started", 2023-08-01T19:55:36.295 INFO:teuthology.orchestra.run.smithi101.stdout: "time": "2023-08-01T19:55:36.252803+0000", 2023-08-01T19:55:36.295 INFO:teuthology.orchestra.run.smithi101.stdout: "duration": 1.2802999999999999e-05 2023-08-01T19:55:36.295 INFO:teuthology.orchestra.run.smithi101.stdout: } 2023-08-01T19:55:36.295 INFO:teuthology.orchestra.run.smithi101.stdout: ] 2023-08-01T19:55:36.295 INFO:teuthology.orchestra.run.smithi101.stdout: } 2023-08-01T19:55:36.296 INFO:teuthology.orchestra.run.smithi101.stdout: }, 2023-08-01T19:55:36.296 INFO:teuthology.orchestra.run.smithi101.stdout: { 2023-08-01T19:55:36.296 INFO:teuthology.orchestra.run.smithi101.stdout: "description": "osd_repop(client.4668.0:156058 5.2 e49/40 5:4acf596d:::benchmark_data_smithi006_114134_object22397:head v 49'10015, mlcod=49'10013)", 2023-08-01T19:55:36.296 INFO:teuthology.orchestra.run.smithi101.stdout: "initiated_at": "2023-08-01T19:55:36.254473+0000", 2023-08-01T19:55:36.296 INFO:teuthology.orchestra.run.smithi101.stdout: "age": 0.00066666399999999997, 2023-08-01T19:55:36.296 INFO:teuthology.orchestra.run.smithi101.stdout: "duration": 0.0010660979999999999, 2023-08-01T19:55:36.296 INFO:teuthology.orchestra.run.smithi101.stdout: "type_data": { 2023-08-01T19:55:36.296 INFO:teuthology.orchestra.run.smithi101.stdout: "flag_point": "started", 2023-08-01T19:55:36.297 INFO:teuthology.orchestra.run.smithi101.stdout: "events": [ 2023-08-01T19:55:36.297 INFO:teuthology.orchestra.run.smithi101.stdout: { 2023-08-01T19:55:36.297 INFO:teuthology.orchestra.run.smithi101.stdout: "event": "initiated", 2023-08-01T19:55:36.297 INFO:teuthology.orchestra.run.smithi101.stdout: "time": "2023-08-01T19:55:36.254473+0000", 2023-08-01T19:55:36.297 INFO:teuthology.orchestra.run.smithi101.stdout: "duration": 0 2023-08-01T19:55:36.297 INFO:teuthology.orchestra.run.smithi101.stdout: }, 2023-08-01T19:55:36.297 INFO:teuthology.orchestra.run.smithi101.stdout: { 2023-08-01T19:55:36.297 INFO:teuthology.orchestra.run.smithi101.stdout: "event": "throttled", 2023-08-01T19:55:36.298 INFO:teuthology.orchestra.run.smithi101.stdout: "time": "2023-08-01T19:55:36.254473+0000", 2023-08-01T19:55:36.298 INFO:teuthology.orchestra.run.smithi101.stdout: "duration": 0 2023-08-01T19:55:36.298 INFO:teuthology.orchestra.run.smithi101.stdout: }, 2023-08-01T19:55:36.298 INFO:teuthology.orchestra.run.smithi101.stdout: { 2023-08-01T19:55:36.298 INFO:teuthology.orchestra.run.smithi101.stdout: "event": "header_read", 2023-08-01T19:55:36.298 INFO:teuthology.orchestra.run.smithi101.stdout: "time": "2023-08-01T19:55:36.254473+0000", 2023-08-01T19:55:36.298 INFO:teuthology.orchestra.run.smithi101.stdout: "duration": 4294967295.9999995 2023-08-01T19:55:36.298 INFO:teuthology.orchestra.run.smithi101.stdout: }, 2023-08-01T19:55:36.299 INFO:teuthology.orchestra.run.smithi101.stdout: { 2023-08-01T19:55:36.299 INFO:teuthology.orchestra.run.smithi101.stdout: "event": "all_read", 2023-08-01T19:55:36.299 INFO:teuthology.orchestra.run.smithi101.stdout: "time": "2023-08-01T19:55:36.254477+0000", 2023-08-01T19:55:36.299 INFO:teuthology.orchestra.run.smithi101.stdout: "duration": 3.7349999999999998e-06 2023-08-01T19:55:36.299 INFO:teuthology.orchestra.run.smithi101.stdout: }, 2023-08-01T19:55:36.299 INFO:teuthology.orchestra.run.smithi101.stdout: { 2023-08-01T19:55:36.299 INFO:teuthology.orchestra.run.smithi101.stdout: "event": "dispatched", 2023-08-01T19:55:36.299 INFO:teuthology.orchestra.run.smithi101.stdout: "time": "2023-08-01T19:55:36.254484+0000", 2023-08-01T19:55:36.300 INFO:teuthology.orchestra.run.smithi101.stdout: "duration": 7.024e-06 2023-08-01T19:55:36.300 INFO:teuthology.orchestra.run.smithi101.stdout: }, 2023-08-01T19:55:36.300 INFO:teuthology.orchestra.run.smithi101.stdout: { 2023-08-01T19:55:36.300 INFO:teuthology.orchestra.run.smithi101.stdout: "event": "queued_for_pg", 2023-08-01T19:55:36.300 INFO:teuthology.orchestra.run.smithi101.stdout: "time": "2023-08-01T19:55:36.254487+0000", 2023-08-01T19:55:36.300 INFO:teuthology.orchestra.run.smithi101.stdout: "duration": 3.7790000000000002e-06 2023-08-01T19:55:36.300 INFO:teuthology.orchestra.run.smithi101.stdout: }, 2023-08-01T19:55:36.300 INFO:teuthology.orchestra.run.smithi101.stdout: { 2023-08-01T19:55:36.301 INFO:teuthology.orchestra.run.smithi101.stdout: "event": "reached_pg", 2023-08-01T19:55:36.301 INFO:teuthology.orchestra.run.smithi101.stdout: "time": "2023-08-01T19:55:36.254515+0000", 2023-08-01T19:55:36.301 INFO:teuthology.orchestra.run.smithi101.stdout: "duration": 2.7515e-05 2023-08-01T19:55:36.301 INFO:teuthology.orchestra.run.smithi101.stdout: }, 2023-08-01T19:55:36.301 INFO:teuthology.orchestra.run.smithi101.stdout: { 2023-08-01T19:55:36.301 INFO:teuthology.orchestra.run.smithi101.stdout: "event": "started", 2023-08-01T19:55:36.301 INFO:teuthology.orchestra.run.smithi101.stdout: "time": "2023-08-01T19:55:36.254526+0000", 2023-08-01T19:55:36.301 INFO:teuthology.orchestra.run.smithi101.stdout: "duration": 1.1286e-05 2023-08-01T19:55:36.302 INFO:teuthology.orchestra.run.smithi101.stdout: } 2023-08-01T19:55:36.302 INFO:teuthology.orchestra.run.smithi101.stdout: ] 2023-08-01T19:55:36.302 INFO:teuthology.orchestra.run.smithi101.stdout: } 2023-08-01T19:55:36.302 INFO:teuthology.orchestra.run.smithi101.stdout: }, 2023-08-01T19:55:36.302 INFO:teuthology.orchestra.run.smithi101.stdout: { 2023-08-01T19:55:36.302 INFO:teuthology.orchestra.run.smithi101.stdout: "description": "osd_repop(client.4668.0:156052 5.9 e49/40 5:9db32720:::benchmark_data_smithi006_114134_object22391:head v 49'9851, mlcod=49'9847)", 2023-08-01T19:55:36.302 INFO:teuthology.orchestra.run.smithi101.stdout: "initiated_at": "2023-08-01T19:55:36.254503+0000", 2023-08-01T19:55:36.303 INFO:teuthology.orchestra.run.smithi101.stdout: "age": 0.00063646000000000004, 2023-08-01T19:55:36.303 INFO:teuthology.orchestra.run.smithi101.stdout: "duration": 0.0010970520000000001, 2023-08-01T19:55:36.303 INFO:teuthology.orchestra.run.smithi101.stdout: "type_data": { 2023-08-01T19:55:36.303 INFO:teuthology.orchestra.run.smithi101.stdout: "flag_point": "started", 2023-08-01T19:55:36.303 INFO:teuthology.orchestra.run.smithi101.stdout: "events": [ 2023-08-01T19:55:36.303 INFO:teuthology.orchestra.run.smithi101.stdout: { 2023-08-01T19:55:36.303 INFO:teuthology.orchestra.run.smithi101.stdout: "event": "initiated", 2023-08-01T19:55:36.303 INFO:teuthology.orchestra.run.smithi101.stdout: "time": "2023-08-01T19:55:36.254503+0000", 2023-08-01T19:55:36.304 INFO:teuthology.orchestra.run.smithi101.stdout: "duration": 0 2023-08-01T19:55:36.304 INFO:teuthology.orchestra.run.smithi101.stdout: }, 2023-08-01T19:55:36.304 INFO:teuthology.orchestra.run.smithi101.stdout: { 2023-08-01T19:55:36.304 INFO:teuthology.orchestra.run.smithi101.stdout: "event": "throttled", 2023-08-01T19:55:36.304 INFO:teuthology.orchestra.run.smithi101.stdout: "time": "2023-08-01T19:55:36.254503+0000", 2023-08-01T19:55:36.304 INFO:teuthology.orchestra.run.smithi101.stdout: "duration": 0 2023-08-01T19:55:36.304 INFO:teuthology.orchestra.run.smithi101.stdout: }, 2023-08-01T19:55:36.304 INFO:teuthology.orchestra.run.smithi101.stdout: { 2023-08-01T19:55:36.305 INFO:teuthology.orchestra.run.smithi101.stdout: "event": "header_read", 2023-08-01T19:55:36.305 INFO:teuthology.orchestra.run.smithi101.stdout: "time": "2023-08-01T19:55:36.254503+0000", 2023-08-01T19:55:36.305 INFO:teuthology.orchestra.run.smithi101.stdout: "duration": 4294967295.9999995 2023-08-01T19:55:36.305 INFO:teuthology.orchestra.run.smithi101.stdout: }, 2023-08-01T19:55:36.305 INFO:teuthology.orchestra.run.smithi101.stdout: { 2023-08-01T19:55:36.305 INFO:teuthology.orchestra.run.smithi101.stdout: "event": "all_read", 2023-08-01T19:55:36.305 INFO:teuthology.orchestra.run.smithi101.stdout: "time": "2023-08-01T19:55:36.254508+0000", 2023-08-01T19:55:36.305 INFO:teuthology.orchestra.run.smithi101.stdout: "duration": 5.4670000000000003e-06 2023-08-01T19:55:36.306 INFO:teuthology.orchestra.run.smithi101.stdout: }, 2023-08-01T19:55:36.306 INFO:teuthology.orchestra.run.smithi101.stdout: { 2023-08-01T19:55:36.306 INFO:teuthology.orchestra.run.smithi101.stdout: "event": "dispatched", 2023-08-01T19:55:36.306 INFO:teuthology.orchestra.run.smithi101.stdout: "time": "2023-08-01T19:55:36.254518+0000", 2023-08-01T19:55:36.306 INFO:teuthology.orchestra.run.smithi101.stdout: "duration": 9.6690000000000001e-06 2023-08-01T19:55:36.306 INFO:teuthology.orchestra.run.smithi101.stdout: }, 2023-08-01T19:55:36.306 INFO:teuthology.orchestra.run.smithi101.stdout: { 2023-08-01T19:55:36.306 INFO:teuthology.orchestra.run.smithi101.stdout: "event": "queued_for_pg", 2023-08-01T19:55:36.307 INFO:teuthology.orchestra.run.smithi101.stdout: "time": "2023-08-01T19:55:36.254524+0000", 2023-08-01T19:55:36.307 INFO:teuthology.orchestra.run.smithi101.stdout: "duration": 5.5550000000000002e-06 2023-08-01T19:55:36.307 INFO:teuthology.orchestra.run.smithi101.stdout: }, 2023-08-01T19:55:36.307 INFO:teuthology.orchestra.run.smithi101.stdout: { 2023-08-01T19:55:36.307 INFO:teuthology.orchestra.run.smithi101.stdout: "event": "reached_pg", 2023-08-01T19:55:36.307 INFO:teuthology.orchestra.run.smithi101.stdout: "time": "2023-08-01T19:55:36.254555+0000", 2023-08-01T19:55:36.307 INFO:teuthology.orchestra.run.smithi101.stdout: "duration": 3.1235999999999997e-05 2023-08-01T19:55:36.307 INFO:teuthology.orchestra.run.smithi101.stdout: }, 2023-08-01T19:55:36.308 INFO:teuthology.orchestra.run.smithi101.stdout: { 2023-08-01T19:55:36.308 INFO:teuthology.orchestra.run.smithi101.stdout: "event": "started", 2023-08-01T19:55:36.308 INFO:teuthology.orchestra.run.smithi101.stdout: "time": "2023-08-01T19:55:36.254572+0000", 2023-08-01T19:55:36.308 INFO:teuthology.orchestra.run.smithi101.stdout: "duration": 1.7266e-05 2023-08-01T19:55:36.308 INFO:teuthology.orchestra.run.smithi101.stdout: } 2023-08-01T19:55:36.308 INFO:teuthology.orchestra.run.smithi101.stdout: ] 2023-08-01T19:55:36.308 INFO:teuthology.orchestra.run.smithi101.stdout: } 2023-08-01T19:55:36.308 INFO:teuthology.orchestra.run.smithi101.stdout: } 2023-08-01T19:55:36.309 INFO:teuthology.orchestra.run.smithi101.stdout: ], 2023-08-01T19:55:36.309 INFO:teuthology.orchestra.run.smithi101.stdout: "num_ops": 8 2023-08-01T19:55:36.309 INFO:teuthology.orchestra.run.smithi101.stdout:} 2023-08-01T19:55:36.310 INFO:tasks.ceph.osd.2.smithi155.stderr:2023-08-01T19:55:36.308+0000 7faa5c6ac700 -1 received signal: Hangup from /usr/bin/python3 /bin/daemon-helper kill ceph-osd -f --cluster ceph -i 2 (PID: 111337) UID: 0 2023-08-01T19:55:36.311 DEBUG:teuthology.orchestra.run.smithi101:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 30 ceph --cluster ceph --admin-daemon /var/run/ceph/ceph-osd.1.asok dump_blocked_ops 2023-08-01T19:55:36.413 INFO:tasks.ceph.osd.0.smithi008.stderr:2023-08-01T19:55:36.409+0000 7f16a58f4700 -1 received signal: Hangup from /usr/bin/python3 /bin/daemon-helper kill ceph-osd -f --cluster ceph -i 0 (PID: 111179) UID: 0 2023-08-01T19:55:36.473 INFO:teuthology.orchestra.run.smithi101.stdout:{ 2023-08-01T19:55:36.473 INFO:teuthology.orchestra.run.smithi101.stdout: "ops": [], 2023-08-01T19:55:36.474 INFO:teuthology.orchestra.run.smithi101.stdout: "complaint_time": 30, 2023-08-01T19:55:36.474 INFO:teuthology.orchestra.run.smithi101.stdout: "num_blocked_ops": 0 2023-08-01T19:55:36.474 INFO:teuthology.orchestra.run.smithi101.stdout:} 2023-08-01T19:55:36.485 DEBUG:teuthology.orchestra.run.smithi101:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 30 ceph --cluster ceph --admin-daemon /var/run/ceph/ceph-osd.1.asok dump_historic_ops 2023-08-01T19:55:36.511 INFO:tasks.ceph.osd.0.smithi008.stderr:2023-08-01T19:55:36.509+0000 7f16a58f4700 -1 received signal: Hangup from /usr/bin/python3 /bin/daemon-helper kill ceph-osd -f --cluster ceph -i 0 (PID: 111179) UID: 0 2023-08-01T19:55:36.612 INFO:tasks.ceph.osd.0.smithi008.stderr:2023-08-01T19:55:36.611+0000 7f16a58f4700 -1 received signal: Hangup from /usr/bin/python3 /bin/daemon-helper kill ceph-osd -f --cluster ceph -i 0 (PID: 111179) UID: 0 2023-08-01T19:55:36.643 INFO:teuthology.orchestra.run.smithi101.stdout:{ 2023-08-01T19:55:36.644 INFO:teuthology.orchestra.run.smithi101.stdout: "size": 20, 2023-08-01T19:55:36.644 INFO:teuthology.orchestra.run.smithi101.stdout: "duration": 600, 2023-08-01T19:55:36.644 INFO:teuthology.orchestra.run.smithi101.stdout: "ops": [ 2023-08-01T19:55:36.644 INFO:teuthology.orchestra.run.smithi101.stdout: { 2023-08-01T19:55:36.644 INFO:teuthology.orchestra.run.smithi101.stdout: "description": "osd_op(mds.0.3:11 3.10 3:0bd6d154:::602.00000000:head [create,setxattr parent (62) in=6b,setxattr layout (30) in=6b] snapc 0=[] ondisk+write+known_if_redirected+full_force+supports_pool_eio e17)", 2023-08-01T19:55:36.645 INFO:teuthology.orchestra.run.smithi101.stdout: "initiated_at": "2023-08-01T19:54:04.458960+0000", 2023-08-01T19:55:36.645 INFO:teuthology.orchestra.run.smithi101.stdout: "age": 92.182053554999996, 2023-08-01T19:55:36.645 INFO:teuthology.orchestra.run.smithi101.stdout: "duration": 0.019645459000000001, 2023-08-01T19:55:36.645 INFO:teuthology.orchestra.run.smithi101.stdout: "type_data": { 2023-08-01T19:55:36.645 INFO:teuthology.orchestra.run.smithi101.stdout: "flag_point": "commit sent; apply or cleanup", 2023-08-01T19:55:36.645 INFO:teuthology.orchestra.run.smithi101.stdout: "events": [ 2023-08-01T19:55:36.645 INFO:teuthology.orchestra.run.smithi101.stdout: { 2023-08-01T19:55:36.645 INFO:teuthology.orchestra.run.smithi101.stdout: "event": "initiated", 2023-08-01T19:55:36.646 INFO:teuthology.orchestra.run.smithi101.stdout: "time": "2023-08-01T19:54:04.458960+0000", 2023-08-01T19:55:36.646 INFO:teuthology.orchestra.run.smithi101.stdout: "duration": 0 2023-08-01T19:55:36.646 INFO:teuthology.orchestra.run.smithi101.stdout: }, 2023-08-01T19:55:36.646 INFO:teuthology.orchestra.run.smithi101.stdout: { 2023-08-01T19:55:36.646 INFO:teuthology.orchestra.run.smithi101.stdout: "event": "throttled", 2023-08-01T19:55:36.646 INFO:teuthology.orchestra.run.smithi101.stdout: "time": "2023-08-01T19:54:04.458960+0000", 2023-08-01T19:55:36.646 INFO:teuthology.orchestra.run.smithi101.stdout: "duration": 0 2023-08-01T19:55:36.647 INFO:teuthology.orchestra.run.smithi101.stdout: }, 2023-08-01T19:55:36.647 INFO:teuthology.orchestra.run.smithi101.stdout: { 2023-08-01T19:55:36.647 INFO:teuthology.orchestra.run.smithi101.stdout: "event": "header_read", 2023-08-01T19:55:36.647 INFO:teuthology.orchestra.run.smithi101.stdout: "time": "2023-08-01T19:54:04.458959+0000", 2023-08-01T19:55:36.647 INFO:teuthology.orchestra.run.smithi101.stdout: "duration": 4294967295.9999995 2023-08-01T19:55:36.647 INFO:teuthology.orchestra.run.smithi101.stdout: }, 2023-08-01T19:55:36.647 INFO:teuthology.orchestra.run.smithi101.stdout: { 2023-08-01T19:55:36.647 INFO:teuthology.orchestra.run.smithi101.stdout: "event": "all_read", 2023-08-01T19:55:36.648 INFO:teuthology.orchestra.run.smithi101.stdout: "time": "2023-08-01T19:54:04.458963+0000", 2023-08-01T19:55:36.648 INFO:teuthology.orchestra.run.smithi101.stdout: "duration": 3.9199999999999997e-06 2023-08-01T19:55:36.648 INFO:teuthology.orchestra.run.smithi101.stdout: }, 2023-08-01T19:55:36.648 INFO:teuthology.orchestra.run.smithi101.stdout: { 2023-08-01T19:55:36.648 INFO:teuthology.orchestra.run.smithi101.stdout: "event": "dispatched", 2023-08-01T19:55:36.648 INFO:teuthology.orchestra.run.smithi101.stdout: "time": "2023-08-01T19:54:04.458970+0000", 2023-08-01T19:55:36.648 INFO:teuthology.orchestra.run.smithi101.stdout: "duration": 7.0439999999999998e-06 2023-08-01T19:55:36.649 INFO:teuthology.orchestra.run.smithi101.stdout: }, 2023-08-01T19:55:36.649 INFO:teuthology.orchestra.run.smithi101.stdout: { 2023-08-01T19:55:36.649 INFO:teuthology.orchestra.run.smithi101.stdout: "event": "queued_for_pg", 2023-08-01T19:55:36.649 INFO:teuthology.orchestra.run.smithi101.stdout: "time": "2023-08-01T19:54:04.458976+0000", 2023-08-01T19:55:36.649 INFO:teuthology.orchestra.run.smithi101.stdout: "duration": 5.9540000000000001e-06 2023-08-01T19:55:36.650 INFO:teuthology.orchestra.run.smithi101.stdout: }, 2023-08-01T19:55:36.650 INFO:teuthology.orchestra.run.smithi101.stdout: { 2023-08-01T19:55:36.650 INFO:teuthology.orchestra.run.smithi101.stdout: "event": "reached_pg", 2023-08-01T19:55:36.650 INFO:teuthology.orchestra.run.smithi101.stdout: "time": "2023-08-01T19:54:04.459035+0000", 2023-08-01T19:55:36.650 INFO:teuthology.orchestra.run.smithi101.stdout: "duration": 5.8924e-05 2023-08-01T19:55:36.650 INFO:teuthology.orchestra.run.smithi101.stdout: }, 2023-08-01T19:55:36.650 INFO:teuthology.orchestra.run.smithi101.stdout: { 2023-08-01T19:55:36.651 INFO:teuthology.orchestra.run.smithi101.stdout: "event": "waiting_for_map not empty", 2023-08-01T19:55:36.651 INFO:teuthology.orchestra.run.smithi101.stdout: "time": "2023-08-01T19:54:04.459038+0000", 2023-08-01T19:55:36.651 INFO:teuthology.orchestra.run.smithi101.stdout: "duration": 3.2760000000000001e-06 2023-08-01T19:55:36.651 INFO:teuthology.orchestra.run.smithi101.stdout: }, 2023-08-01T19:55:36.652 INFO:teuthology.orchestra.run.smithi101.stdout: { 2023-08-01T19:55:36.652 INFO:teuthology.orchestra.run.smithi101.stdout: "event": "reached_pg", 2023-08-01T19:55:36.652 INFO:teuthology.orchestra.run.smithi101.stdout: "time": "2023-08-01T19:54:04.471511+0000", 2023-08-01T19:55:36.652 INFO:teuthology.orchestra.run.smithi101.stdout: "duration": 0.012473039999999999 2023-08-01T19:55:36.653 INFO:teuthology.orchestra.run.smithi101.stdout: }, 2023-08-01T19:55:36.653 INFO:teuthology.orchestra.run.smithi101.stdout: { 2023-08-01T19:55:36.653 INFO:teuthology.orchestra.run.smithi101.stdout: "event": "started", 2023-08-01T19:55:36.653 INFO:teuthology.orchestra.run.smithi101.stdout: "time": "2023-08-01T19:54:04.472086+0000", 2023-08-01T19:55:36.654 INFO:teuthology.orchestra.run.smithi101.stdout: "duration": 0.00057491699999999998 2023-08-01T19:55:36.654 INFO:teuthology.orchestra.run.smithi101.stdout: }, 2023-08-01T19:55:36.654 INFO:teuthology.orchestra.run.smithi101.stdout: { 2023-08-01T19:55:36.654 INFO:teuthology.orchestra.run.smithi101.stdout: "event": "waiting for subops from 2", 2023-08-01T19:55:36.654 INFO:teuthology.orchestra.run.smithi101.stdout: "time": "2023-08-01T19:54:04.472310+0000", 2023-08-01T19:55:36.654 INFO:teuthology.orchestra.run.smithi101.stdout: "duration": 0.00022396499999999999 2023-08-01T19:55:36.654 INFO:teuthology.orchestra.run.smithi101.stdout: }, 2023-08-01T19:55:36.655 INFO:teuthology.orchestra.run.smithi101.stdout: { 2023-08-01T19:55:36.655 INFO:teuthology.orchestra.run.smithi101.stdout: "event": "op_commit", 2023-08-01T19:55:36.655 INFO:teuthology.orchestra.run.smithi101.stdout: "time": "2023-08-01T19:54:04.478141+0000", 2023-08-01T19:55:36.655 INFO:teuthology.orchestra.run.smithi101.stdout: "duration": 0.0058312320000000004 2023-08-01T19:55:36.656 INFO:teuthology.orchestra.run.smithi101.stdout: }, 2023-08-01T19:55:36.656 INFO:teuthology.orchestra.run.smithi101.stdout: { 2023-08-01T19:55:36.656 INFO:teuthology.orchestra.run.smithi101.stdout: "event": "sub_op_commit_rec", 2023-08-01T19:55:36.656 INFO:teuthology.orchestra.run.smithi101.stdout: "time": "2023-08-01T19:54:04.478543+0000", 2023-08-01T19:55:36.656 INFO:teuthology.orchestra.run.smithi101.stdout: "duration": 0.00040160800000000002 2023-08-01T19:55:36.656 INFO:teuthology.orchestra.run.smithi101.stdout: }, 2023-08-01T19:55:36.656 INFO:teuthology.orchestra.run.smithi101.stdout: { 2023-08-01T19:55:36.657 INFO:teuthology.orchestra.run.smithi101.stdout: "event": "commit_sent", 2023-08-01T19:55:36.657 INFO:teuthology.orchestra.run.smithi101.stdout: "time": "2023-08-01T19:54:04.478584+0000", 2023-08-01T19:55:36.657 INFO:teuthology.orchestra.run.smithi101.stdout: "duration": 4.0989999999999999e-05 2023-08-01T19:55:36.657 INFO:teuthology.orchestra.run.smithi101.stdout: }, 2023-08-01T19:55:36.657 INFO:teuthology.orchestra.run.smithi101.stdout: { 2023-08-01T19:55:36.657 INFO:teuthology.orchestra.run.smithi101.stdout: "event": "done", 2023-08-01T19:55:36.657 INFO:teuthology.orchestra.run.smithi101.stdout: "time": "2023-08-01T19:54:04.478605+0000", 2023-08-01T19:55:36.657 INFO:teuthology.orchestra.run.smithi101.stdout: "duration": 2.1178e-05 2023-08-01T19:55:36.658 INFO:teuthology.orchestra.run.smithi101.stdout: } 2023-08-01T19:55:36.658 INFO:teuthology.orchestra.run.smithi101.stdout: ] 2023-08-01T19:55:36.658 INFO:teuthology.orchestra.run.smithi101.stdout: } 2023-08-01T19:55:36.658 INFO:teuthology.orchestra.run.smithi101.stdout: }, 2023-08-01T19:55:36.658 INFO:teuthology.orchestra.run.smithi101.stdout: { 2023-08-01T19:55:36.658 INFO:teuthology.orchestra.run.smithi101.stdout: "description": "osd_op(mds.0.3:12 3.10 3:0d89b25e:::603.00000000:head [omap-set-header] snapc 0=[] ondisk+write+known_if_redirected+full_force+supports_pool_eio e17)", 2023-08-01T19:55:36.658 INFO:teuthology.orchestra.run.smithi101.stdout: "initiated_at": "2023-08-01T19:54:04.458982+0000", 2023-08-01T19:55:36.658 INFO:teuthology.orchestra.run.smithi101.stdout: "age": 92.182031327000004, 2023-08-01T19:55:36.659 INFO:teuthology.orchestra.run.smithi101.stdout: "duration": 0.021266334000000001, 2023-08-01T19:55:36.659 INFO:teuthology.orchestra.run.smithi101.stdout: "type_data": { 2023-08-01T19:55:36.659 INFO:teuthology.orchestra.run.smithi101.stdout: "flag_point": "commit sent; apply or cleanup", 2023-08-01T19:55:36.659 INFO:teuthology.orchestra.run.smithi101.stdout: "events": [ 2023-08-01T19:55:36.659 INFO:teuthology.orchestra.run.smithi101.stdout: { 2023-08-01T19:55:36.659 INFO:teuthology.orchestra.run.smithi101.stdout: "event": "initiated", 2023-08-01T19:55:36.659 INFO:teuthology.orchestra.run.smithi101.stdout: "time": "2023-08-01T19:54:04.458982+0000", 2023-08-01T19:55:36.659 INFO:teuthology.orchestra.run.smithi101.stdout: "duration": 0 2023-08-01T19:55:36.660 INFO:teuthology.orchestra.run.smithi101.stdout: }, 2023-08-01T19:55:36.660 INFO:teuthology.orchestra.run.smithi101.stdout: { 2023-08-01T19:55:36.660 INFO:teuthology.orchestra.run.smithi101.stdout: "event": "throttled", 2023-08-01T19:55:36.660 INFO:teuthology.orchestra.run.smithi101.stdout: "time": "2023-08-01T19:54:04.458982+0000", 2023-08-01T19:55:36.660 INFO:teuthology.orchestra.run.smithi101.stdout: "duration": 0 2023-08-01T19:55:36.660 INFO:teuthology.orchestra.run.smithi101.stdout: }, 2023-08-01T19:55:36.660 INFO:teuthology.orchestra.run.smithi101.stdout: { 2023-08-01T19:55:36.660 INFO:teuthology.orchestra.run.smithi101.stdout: "event": "header_read", 2023-08-01T19:55:36.661 INFO:teuthology.orchestra.run.smithi101.stdout: "time": "2023-08-01T19:54:04.458982+0000", 2023-08-01T19:55:36.661 INFO:teuthology.orchestra.run.smithi101.stdout: "duration": 4294967295.9999995 2023-08-01T19:55:36.661 INFO:teuthology.orchestra.run.smithi101.stdout: }, 2023-08-01T19:55:36.661 INFO:teuthology.orchestra.run.smithi101.stdout: { 2023-08-01T19:55:36.661 INFO:teuthology.orchestra.run.smithi101.stdout: "event": "all_read", 2023-08-01T19:55:36.661 INFO:teuthology.orchestra.run.smithi101.stdout: "time": "2023-08-01T19:54:04.458985+0000", 2023-08-01T19:55:36.661 INFO:teuthology.orchestra.run.smithi101.stdout: "duration": 3.4800000000000001e-06 2023-08-01T19:55:36.662 INFO:teuthology.orchestra.run.smithi101.stdout: }, 2023-08-01T19:55:36.662 INFO:teuthology.orchestra.run.smithi101.stdout: { 2023-08-01T19:55:36.662 INFO:teuthology.orchestra.run.smithi101.stdout: "event": "dispatched", 2023-08-01T19:55:36.662 INFO:teuthology.orchestra.run.smithi101.stdout: "time": "2023-08-01T19:54:04.458992+0000", 2023-08-01T19:55:36.662 INFO:teuthology.orchestra.run.smithi101.stdout: "duration": 7.306e-06 2023-08-01T19:55:36.662 INFO:teuthology.orchestra.run.smithi101.stdout: }, 2023-08-01T19:55:36.662 INFO:teuthology.orchestra.run.smithi101.stdout: { 2023-08-01T19:55:36.662 INFO:teuthology.orchestra.run.smithi101.stdout: "event": "queued_for_pg", 2023-08-01T19:55:36.663 INFO:teuthology.orchestra.run.smithi101.stdout: "time": "2023-08-01T19:54:04.458997+0000", 2023-08-01T19:55:36.663 INFO:teuthology.orchestra.run.smithi101.stdout: "duration": 4.4530000000000004e-06 2023-08-01T19:55:36.663 INFO:teuthology.orchestra.run.smithi101.stdout: }, 2023-08-01T19:55:36.663 INFO:teuthology.orchestra.run.smithi101.stdout: { 2023-08-01T19:55:36.663 INFO:teuthology.orchestra.run.smithi101.stdout: "event": "reached_pg", 2023-08-01T19:55:36.663 INFO:teuthology.orchestra.run.smithi101.stdout: "time": "2023-08-01T19:54:04.459060+0000", 2023-08-01T19:55:36.663 INFO:teuthology.orchestra.run.smithi101.stdout: "duration": 6.3249000000000004e-05 2023-08-01T19:55:36.663 INFO:teuthology.orchestra.run.smithi101.stdout: }, 2023-08-01T19:55:36.664 INFO:teuthology.orchestra.run.smithi101.stdout: { 2023-08-01T19:55:36.664 INFO:teuthology.orchestra.run.smithi101.stdout: "event": "waiting_for_map not empty", 2023-08-01T19:55:36.664 INFO:teuthology.orchestra.run.smithi101.stdout: "time": "2023-08-01T19:54:04.459063+0000", 2023-08-01T19:55:36.664 INFO:teuthology.orchestra.run.smithi101.stdout: "duration": 2.717e-06 2023-08-01T19:55:36.664 INFO:teuthology.orchestra.run.smithi101.stdout: }, 2023-08-01T19:55:36.664 INFO:teuthology.orchestra.run.smithi101.stdout: { 2023-08-01T19:55:36.664 INFO:teuthology.orchestra.run.smithi101.stdout: "event": "reached_pg", 2023-08-01T19:55:36.664 INFO:teuthology.orchestra.run.smithi101.stdout: "time": "2023-08-01T19:54:04.473625+0000", 2023-08-01T19:55:36.665 INFO:teuthology.orchestra.run.smithi101.stdout: "duration": 0.014562007 2023-08-01T19:55:36.665 INFO:teuthology.orchestra.run.smithi101.stdout: }, 2023-08-01T19:55:36.665 INFO:teuthology.orchestra.run.smithi101.stdout: { 2023-08-01T19:55:36.665 INFO:teuthology.orchestra.run.smithi101.stdout: "event": "started", 2023-08-01T19:55:36.665 INFO:teuthology.orchestra.run.smithi101.stdout: "time": "2023-08-01T19:54:04.473757+0000", 2023-08-01T19:55:36.665 INFO:teuthology.orchestra.run.smithi101.stdout: "duration": 0.00013238599999999999 2023-08-01T19:55:36.665 INFO:teuthology.orchestra.run.smithi101.stdout: }, 2023-08-01T19:55:36.665 INFO:teuthology.orchestra.run.smithi101.stdout: { 2023-08-01T19:55:36.666 INFO:teuthology.orchestra.run.smithi101.stdout: "event": "waiting for subops from 2", 2023-08-01T19:55:36.666 INFO:teuthology.orchestra.run.smithi101.stdout: "time": "2023-08-01T19:54:04.473898+0000", 2023-08-01T19:55:36.666 INFO:teuthology.orchestra.run.smithi101.stdout: "duration": 0.00014039 2023-08-01T19:55:36.666 INFO:teuthology.orchestra.run.smithi101.stdout: }, 2023-08-01T19:55:36.666 INFO:teuthology.orchestra.run.smithi101.stdout: { 2023-08-01T19:55:36.666 INFO:teuthology.orchestra.run.smithi101.stdout: "event": "op_commit", 2023-08-01T19:55:36.666 INFO:teuthology.orchestra.run.smithi101.stdout: "time": "2023-08-01T19:54:04.478380+0000", 2023-08-01T19:55:36.666 INFO:teuthology.orchestra.run.smithi101.stdout: "duration": 0.0044827449999999998 2023-08-01T19:55:36.667 INFO:teuthology.orchestra.run.smithi101.stdout: }, 2023-08-01T19:55:36.667 INFO:teuthology.orchestra.run.smithi101.stdout: { 2023-08-01T19:55:36.667 INFO:teuthology.orchestra.run.smithi101.stdout: "event": "sub_op_commit_rec", 2023-08-01T19:55:36.667 INFO:teuthology.orchestra.run.smithi101.stdout: "time": "2023-08-01T19:54:04.480169+0000", 2023-08-01T19:55:36.667 INFO:teuthology.orchestra.run.smithi101.stdout: "duration": 0.0017886040000000001 2023-08-01T19:55:36.667 INFO:teuthology.orchestra.run.smithi101.stdout: }, 2023-08-01T19:55:36.667 INFO:teuthology.orchestra.run.smithi101.stdout: { 2023-08-01T19:55:36.667 INFO:teuthology.orchestra.run.smithi101.stdout: "event": "commit_sent", 2023-08-01T19:55:36.668 INFO:teuthology.orchestra.run.smithi101.stdout: "time": "2023-08-01T19:54:04.480212+0000", 2023-08-01T19:55:36.668 INFO:teuthology.orchestra.run.smithi101.stdout: "duration": 4.2687e-05 2023-08-01T19:55:36.668 INFO:teuthology.orchestra.run.smithi101.stdout: }, 2023-08-01T19:55:36.668 INFO:teuthology.orchestra.run.smithi101.stdout: { 2023-08-01T19:55:36.668 INFO:teuthology.orchestra.run.smithi101.stdout: "event": "done", 2023-08-01T19:55:36.668 INFO:teuthology.orchestra.run.smithi101.stdout: "time": "2023-08-01T19:54:04.480248+0000", 2023-08-01T19:55:36.668 INFO:teuthology.orchestra.run.smithi101.stdout: "duration": 3.6743999999999999e-05 2023-08-01T19:55:36.668 INFO:teuthology.orchestra.run.smithi101.stdout: } 2023-08-01T19:55:36.669 INFO:teuthology.orchestra.run.smithi101.stdout: ] 2023-08-01T19:55:36.669 INFO:teuthology.orchestra.run.smithi101.stdout: } 2023-08-01T19:55:36.669 INFO:teuthology.orchestra.run.smithi101.stdout: }, 2023-08-01T19:55:36.669 INFO:teuthology.orchestra.run.smithi101.stdout: { 2023-08-01T19:55:36.669 INFO:teuthology.orchestra.run.smithi101.stdout: "description": "osd_op(mds.0.3:13 3.10 3:0d89b25e:::603.00000000:head [create,setxattr parent (62) in=6b,setxattr layout (30) in=6b] snapc 0=[] ondisk+write+known_if_redirected+full_force+supports_pool_eio e17)", 2023-08-01T19:55:36.669 INFO:teuthology.orchestra.run.smithi101.stdout: "initiated_at": "2023-08-01T19:54:04.459010+0000", 2023-08-01T19:55:36.669 INFO:teuthology.orchestra.run.smithi101.stdout: "age": 92.182003606999999, 2023-08-01T19:55:36.669 INFO:teuthology.orchestra.run.smithi101.stdout: "duration": 0.021327220000000001, 2023-08-01T19:55:36.670 INFO:teuthology.orchestra.run.smithi101.stdout: "type_data": { 2023-08-01T19:55:36.670 INFO:teuthology.orchestra.run.smithi101.stdout: "flag_point": "commit sent; apply or cleanup", 2023-08-01T19:55:36.670 INFO:teuthology.orchestra.run.smithi101.stdout: "events": [ 2023-08-01T19:55:36.670 INFO:teuthology.orchestra.run.smithi101.stdout: { 2023-08-01T19:55:36.670 INFO:teuthology.orchestra.run.smithi101.stdout: "event": "initiated", 2023-08-01T19:55:36.670 INFO:teuthology.orchestra.run.smithi101.stdout: "time": "2023-08-01T19:54:04.459010+0000", 2023-08-01T19:55:36.670 INFO:teuthology.orchestra.run.smithi101.stdout: "duration": 0 2023-08-01T19:55:36.671 INFO:teuthology.orchestra.run.smithi101.stdout: }, 2023-08-01T19:55:36.671 INFO:teuthology.orchestra.run.smithi101.stdout: { 2023-08-01T19:55:36.671 INFO:teuthology.orchestra.run.smithi101.stdout: "event": "throttled", 2023-08-01T19:55:36.671 INFO:teuthology.orchestra.run.smithi101.stdout: "time": "2023-08-01T19:54:04.459010+0000", 2023-08-01T19:55:36.671 INFO:teuthology.orchestra.run.smithi101.stdout: "duration": 0 2023-08-01T19:55:36.671 INFO:teuthology.orchestra.run.smithi101.stdout: }, 2023-08-01T19:55:36.671 INFO:teuthology.orchestra.run.smithi101.stdout: { 2023-08-01T19:55:36.671 INFO:teuthology.orchestra.run.smithi101.stdout: "event": "header_read", 2023-08-01T19:55:36.672 INFO:teuthology.orchestra.run.smithi101.stdout: "time": "2023-08-01T19:54:04.459009+0000", 2023-08-01T19:55:36.672 INFO:teuthology.orchestra.run.smithi101.stdout: "duration": 4294967295.9999995 2023-08-01T19:55:36.672 INFO:teuthology.orchestra.run.smithi101.stdout: }, 2023-08-01T19:55:36.672 INFO:teuthology.orchestra.run.smithi101.stdout: { 2023-08-01T19:55:36.672 INFO:teuthology.orchestra.run.smithi101.stdout: "event": "all_read", 2023-08-01T19:55:36.672 INFO:teuthology.orchestra.run.smithi101.stdout: "time": "2023-08-01T19:54:04.459013+0000", 2023-08-01T19:55:36.672 INFO:teuthology.orchestra.run.smithi101.stdout: "duration": 3.8929999999999998e-06 2023-08-01T19:55:36.672 INFO:teuthology.orchestra.run.smithi101.stdout: }, 2023-08-01T19:55:36.673 INFO:teuthology.orchestra.run.smithi101.stdout: { 2023-08-01T19:55:36.673 INFO:teuthology.orchestra.run.smithi101.stdout: "event": "dispatched", 2023-08-01T19:55:36.673 INFO:teuthology.orchestra.run.smithi101.stdout: "time": "2023-08-01T19:54:04.459027+0000", 2023-08-01T19:55:36.673 INFO:teuthology.orchestra.run.smithi101.stdout: "duration": 1.3416e-05 2023-08-01T19:55:36.673 INFO:teuthology.orchestra.run.smithi101.stdout: }, 2023-08-01T19:55:36.673 INFO:teuthology.orchestra.run.smithi101.stdout: { 2023-08-01T19:55:36.673 INFO:teuthology.orchestra.run.smithi101.stdout: "event": "queued_for_pg", 2023-08-01T19:55:36.673 INFO:teuthology.orchestra.run.smithi101.stdout: "time": "2023-08-01T19:54:04.459033+0000", 2023-08-01T19:55:36.674 INFO:teuthology.orchestra.run.smithi101.stdout: "duration": 5.9800000000000003e-06 2023-08-01T19:55:36.674 INFO:teuthology.orchestra.run.smithi101.stdout: }, 2023-08-01T19:55:36.674 INFO:teuthology.orchestra.run.smithi101.stdout: { 2023-08-01T19:55:36.674 INFO:teuthology.orchestra.run.smithi101.stdout: "event": "reached_pg", 2023-08-01T19:55:36.674 INFO:teuthology.orchestra.run.smithi101.stdout: "time": "2023-08-01T19:54:04.459099+0000", 2023-08-01T19:55:36.674 INFO:teuthology.orchestra.run.smithi101.stdout: "duration": 6.6192999999999995e-05 2023-08-01T19:55:36.674 INFO:teuthology.orchestra.run.smithi101.stdout: }, 2023-08-01T19:55:36.674 INFO:teuthology.orchestra.run.smithi101.stdout: { 2023-08-01T19:55:36.675 INFO:teuthology.orchestra.run.smithi101.stdout: "event": "waiting_for_map not empty", 2023-08-01T19:55:36.675 INFO:teuthology.orchestra.run.smithi101.stdout: "time": "2023-08-01T19:54:04.459106+0000", 2023-08-01T19:55:36.675 INFO:teuthology.orchestra.run.smithi101.stdout: "duration": 6.8619999999999997e-06 2023-08-01T19:55:36.675 INFO:teuthology.orchestra.run.smithi101.stdout: }, 2023-08-01T19:55:36.675 INFO:teuthology.orchestra.run.smithi101.stdout: { 2023-08-01T19:55:36.675 INFO:teuthology.orchestra.run.smithi101.stdout: "event": "reached_pg", 2023-08-01T19:55:36.675 INFO:teuthology.orchestra.run.smithi101.stdout: "time": "2023-08-01T19:54:04.475182+0000", 2023-08-01T19:55:36.675 INFO:teuthology.orchestra.run.smithi101.stdout: "duration": 0.016076333000000002 2023-08-01T19:55:36.676 INFO:teuthology.orchestra.run.smithi101.stdout: }, 2023-08-01T19:55:36.676 INFO:teuthology.orchestra.run.smithi101.stdout: { 2023-08-01T19:55:36.676 INFO:teuthology.orchestra.run.smithi101.stdout: "event": "started", 2023-08-01T19:55:36.676 INFO:teuthology.orchestra.run.smithi101.stdout: "time": "2023-08-01T19:54:04.475353+0000", 2023-08-01T19:55:36.676 INFO:teuthology.orchestra.run.smithi101.stdout: "duration": 0.000171378 2023-08-01T19:55:36.676 INFO:teuthology.orchestra.run.smithi101.stdout: }, 2023-08-01T19:55:36.676 INFO:teuthology.orchestra.run.smithi101.stdout: { 2023-08-01T19:55:36.676 INFO:teuthology.orchestra.run.smithi101.stdout: "event": "waiting for subops from 2", 2023-08-01T19:55:36.677 INFO:teuthology.orchestra.run.smithi101.stdout: "time": "2023-08-01T19:54:04.475793+0000", 2023-08-01T19:55:36.677 INFO:teuthology.orchestra.run.smithi101.stdout: "duration": 0.000440123 2023-08-01T19:55:36.677 INFO:teuthology.orchestra.run.smithi101.stdout: }, 2023-08-01T19:55:36.677 INFO:teuthology.orchestra.run.smithi101.stdout: { 2023-08-01T19:55:36.677 INFO:teuthology.orchestra.run.smithi101.stdout: "event": "op_commit", 2023-08-01T19:55:36.677 INFO:teuthology.orchestra.run.smithi101.stdout: "time": "2023-08-01T19:54:04.478624+0000", 2023-08-01T19:55:36.677 INFO:teuthology.orchestra.run.smithi101.stdout: "duration": 0.0028305000000000001 2023-08-01T19:55:36.677 INFO:teuthology.orchestra.run.smithi101.stdout: }, 2023-08-01T19:55:36.678 INFO:teuthology.orchestra.run.smithi101.stdout: { 2023-08-01T19:55:36.678 INFO:teuthology.orchestra.run.smithi101.stdout: "event": "sub_op_commit_rec", 2023-08-01T19:55:36.678 INFO:teuthology.orchestra.run.smithi101.stdout: "time": "2023-08-01T19:54:04.480291+0000", 2023-08-01T19:55:36.678 INFO:teuthology.orchestra.run.smithi101.stdout: "duration": 0.0016670000000000001 2023-08-01T19:55:36.678 INFO:teuthology.orchestra.run.smithi101.stdout: }, 2023-08-01T19:55:36.678 INFO:teuthology.orchestra.run.smithi101.stdout: { 2023-08-01T19:55:36.678 INFO:teuthology.orchestra.run.smithi101.stdout: "event": "commit_sent", 2023-08-01T19:55:36.678 INFO:teuthology.orchestra.run.smithi101.stdout: "time": "2023-08-01T19:54:04.480318+0000", 2023-08-01T19:55:36.679 INFO:teuthology.orchestra.run.smithi101.stdout: "duration": 2.6815e-05 2023-08-01T19:55:36.679 INFO:teuthology.orchestra.run.smithi101.stdout: }, 2023-08-01T19:55:36.679 INFO:teuthology.orchestra.run.smithi101.stdout: { 2023-08-01T19:55:36.679 INFO:teuthology.orchestra.run.smithi101.stdout: "event": "done", 2023-08-01T19:55:36.679 INFO:teuthology.orchestra.run.smithi101.stdout: "time": "2023-08-01T19:54:04.480337+0000", 2023-08-01T19:55:36.679 INFO:teuthology.orchestra.run.smithi101.stdout: "duration": 1.9241000000000001e-05 2023-08-01T19:55:36.679 INFO:teuthology.orchestra.run.smithi101.stdout: } 2023-08-01T19:55:36.680 INFO:teuthology.orchestra.run.smithi101.stdout: ] 2023-08-01T19:55:36.680 INFO:teuthology.orchestra.run.smithi101.stdout: } 2023-08-01T19:55:36.680 INFO:teuthology.orchestra.run.smithi101.stdout: }, 2023-08-01T19:55:36.680 INFO:teuthology.orchestra.run.smithi101.stdout: { 2023-08-01T19:55:36.680 INFO:teuthology.orchestra.run.smithi101.stdout: "description": "osd_op(mds.0.3:1 3.14 3:292cf221:::200.00000000:head [writefull 0~90] snapc 0=[] ondisk+write+known_if_redirected+full_force+supports_pool_eio e17)", 2023-08-01T19:55:36.680 INFO:teuthology.orchestra.run.smithi101.stdout: "initiated_at": "2023-08-01T19:54:04.459177+0000", 2023-08-01T19:55:36.680 INFO:teuthology.orchestra.run.smithi101.stdout: "age": 92.181836708000006, 2023-08-01T19:55:36.680 INFO:teuthology.orchestra.run.smithi101.stdout: "duration": 0.021067196, 2023-08-01T19:55:36.681 INFO:teuthology.orchestra.run.smithi101.stdout: "type_data": { 2023-08-01T19:55:36.681 INFO:teuthology.orchestra.run.smithi101.stdout: "flag_point": "commit sent; apply or cleanup", 2023-08-01T19:55:36.681 INFO:teuthology.orchestra.run.smithi101.stdout: "events": [ 2023-08-01T19:55:36.681 INFO:teuthology.orchestra.run.smithi101.stdout: { 2023-08-01T19:55:36.681 INFO:teuthology.orchestra.run.smithi101.stdout: "event": "initiated", 2023-08-01T19:55:36.681 INFO:teuthology.orchestra.run.smithi101.stdout: "time": "2023-08-01T19:54:04.459177+0000", 2023-08-01T19:55:36.681 INFO:teuthology.orchestra.run.smithi101.stdout: "duration": 0 2023-08-01T19:55:36.682 INFO:teuthology.orchestra.run.smithi101.stdout: }, 2023-08-01T19:55:36.682 INFO:teuthology.orchestra.run.smithi101.stdout: { 2023-08-01T19:55:36.682 INFO:teuthology.orchestra.run.smithi101.stdout: "event": "throttled", 2023-08-01T19:55:36.682 INFO:teuthology.orchestra.run.smithi101.stdout: "time": "2023-08-01T19:54:04.459177+0000", 2023-08-01T19:55:36.682 INFO:teuthology.orchestra.run.smithi101.stdout: "duration": 0 2023-08-01T19:55:36.682 INFO:teuthology.orchestra.run.smithi101.stdout: }, 2023-08-01T19:55:36.682 INFO:teuthology.orchestra.run.smithi101.stdout: { 2023-08-01T19:55:36.682 INFO:teuthology.orchestra.run.smithi101.stdout: "event": "header_read", 2023-08-01T19:55:36.683 INFO:teuthology.orchestra.run.smithi101.stdout: "time": "2023-08-01T19:54:04.459176+0000", 2023-08-01T19:55:36.683 INFO:teuthology.orchestra.run.smithi101.stdout: "duration": 4294967295.9999995 2023-08-01T19:55:36.683 INFO:teuthology.orchestra.run.smithi101.stdout: }, 2023-08-01T19:55:36.683 INFO:teuthology.orchestra.run.smithi101.stdout: { 2023-08-01T19:55:36.683 INFO:teuthology.orchestra.run.smithi101.stdout: "event": "all_read", 2023-08-01T19:55:36.683 INFO:teuthology.orchestra.run.smithi101.stdout: "time": "2023-08-01T19:54:04.459181+0000", 2023-08-01T19:55:36.683 INFO:teuthology.orchestra.run.smithi101.stdout: "duration": 5.2109999999999997e-06 2023-08-01T19:55:36.684 INFO:teuthology.orchestra.run.smithi101.stdout: }, 2023-08-01T19:55:36.684 INFO:teuthology.orchestra.run.smithi101.stdout: { 2023-08-01T19:55:36.684 INFO:teuthology.orchestra.run.smithi101.stdout: "event": "dispatched", 2023-08-01T19:55:36.684 INFO:teuthology.orchestra.run.smithi101.stdout: "time": "2023-08-01T19:54:04.459188+0000", 2023-08-01T19:55:36.684 INFO:teuthology.orchestra.run.smithi101.stdout: "duration": 6.6680000000000004e-06 2023-08-01T19:55:36.684 INFO:teuthology.orchestra.run.smithi101.stdout: }, 2023-08-01T19:55:36.684 INFO:teuthology.orchestra.run.smithi101.stdout: { 2023-08-01T19:55:36.685 INFO:teuthology.orchestra.run.smithi101.stdout: "event": "queued_for_pg", 2023-08-01T19:55:36.685 INFO:teuthology.orchestra.run.smithi101.stdout: "time": "2023-08-01T19:54:04.459192+0000", 2023-08-01T19:55:36.685 INFO:teuthology.orchestra.run.smithi101.stdout: "duration": 4.228e-06 2023-08-01T19:55:36.685 INFO:teuthology.orchestra.run.smithi101.stdout: }, 2023-08-01T19:55:36.685 INFO:teuthology.orchestra.run.smithi101.stdout: { 2023-08-01T19:55:36.685 INFO:teuthology.orchestra.run.smithi101.stdout: "event": "reached_pg", 2023-08-01T19:55:36.685 INFO:teuthology.orchestra.run.smithi101.stdout: "time": "2023-08-01T19:54:04.459219+0000", 2023-08-01T19:55:36.685 INFO:teuthology.orchestra.run.smithi101.stdout: "duration": 2.6930000000000001e-05 2023-08-01T19:55:36.686 INFO:teuthology.orchestra.run.smithi101.stdout: }, 2023-08-01T19:55:36.686 INFO:teuthology.orchestra.run.smithi101.stdout: { 2023-08-01T19:55:36.686 INFO:teuthology.orchestra.run.smithi101.stdout: "event": "waiting_for_map not empty", 2023-08-01T19:55:36.686 INFO:teuthology.orchestra.run.smithi101.stdout: "time": "2023-08-01T19:54:04.459223+0000", 2023-08-01T19:55:36.686 INFO:teuthology.orchestra.run.smithi101.stdout: "duration": 3.8469999999999998e-06 2023-08-01T19:55:36.686 INFO:teuthology.orchestra.run.smithi101.stdout: }, 2023-08-01T19:55:36.686 INFO:teuthology.orchestra.run.smithi101.stdout: { 2023-08-01T19:55:36.686 INFO:teuthology.orchestra.run.smithi101.stdout: "event": "reached_pg", 2023-08-01T19:55:36.687 INFO:teuthology.orchestra.run.smithi101.stdout: "time": "2023-08-01T19:54:04.473347+0000", 2023-08-01T19:55:36.687 INFO:teuthology.orchestra.run.smithi101.stdout: "duration": 0.014124319 2023-08-01T19:55:36.687 INFO:teuthology.orchestra.run.smithi101.stdout: }, 2023-08-01T19:55:36.687 INFO:teuthology.orchestra.run.smithi101.stdout: { 2023-08-01T19:55:36.687 INFO:teuthology.orchestra.run.smithi101.stdout: "event": "started", 2023-08-01T19:55:36.687 INFO:teuthology.orchestra.run.smithi101.stdout: "time": "2023-08-01T19:54:04.473480+0000", 2023-08-01T19:55:36.687 INFO:teuthology.orchestra.run.smithi101.stdout: "duration": 0.00013276799999999999 2023-08-01T19:55:36.687 INFO:teuthology.orchestra.run.smithi101.stdout: }, 2023-08-01T19:55:36.688 INFO:teuthology.orchestra.run.smithi101.stdout: { 2023-08-01T19:55:36.688 INFO:teuthology.orchestra.run.smithi101.stdout: "event": "waiting for subops from 2", 2023-08-01T19:55:36.688 INFO:teuthology.orchestra.run.smithi101.stdout: "time": "2023-08-01T19:54:04.473622+0000", 2023-08-01T19:55:36.688 INFO:teuthology.orchestra.run.smithi101.stdout: "duration": 0.00014154799999999999 2023-08-01T19:55:36.688 INFO:teuthology.orchestra.run.smithi101.stdout: }, 2023-08-01T19:55:36.688 INFO:teuthology.orchestra.run.smithi101.stdout: { 2023-08-01T19:55:36.688 INFO:teuthology.orchestra.run.smithi101.stdout: "event": "op_commit", 2023-08-01T19:55:36.689 INFO:teuthology.orchestra.run.smithi101.stdout: "time": "2023-08-01T19:54:04.478281+0000", 2023-08-01T19:55:36.689 INFO:teuthology.orchestra.run.smithi101.stdout: "duration": 0.004659252 2023-08-01T19:55:36.689 INFO:teuthology.orchestra.run.smithi101.stdout: }, 2023-08-01T19:55:36.689 INFO:teuthology.orchestra.run.smithi101.stdout: { 2023-08-01T19:55:36.689 INFO:teuthology.orchestra.run.smithi101.stdout: "event": "sub_op_commit_rec", 2023-08-01T19:55:36.689 INFO:teuthology.orchestra.run.smithi101.stdout: "time": "2023-08-01T19:54:04.480180+0000", 2023-08-01T19:55:36.689 INFO:teuthology.orchestra.run.smithi101.stdout: "duration": 0.0018986859999999999 2023-08-01T19:55:36.689 INFO:teuthology.orchestra.run.smithi101.stdout: }, 2023-08-01T19:55:36.690 INFO:teuthology.orchestra.run.smithi101.stdout: { 2023-08-01T19:55:36.690 INFO:teuthology.orchestra.run.smithi101.stdout: "event": "commit_sent", 2023-08-01T19:55:36.690 INFO:teuthology.orchestra.run.smithi101.stdout: "time": "2023-08-01T19:54:04.480209+0000", 2023-08-01T19:55:36.690 INFO:teuthology.orchestra.run.smithi101.stdout: "duration": 2.9244999999999999e-05 2023-08-01T19:55:36.690 INFO:teuthology.orchestra.run.smithi101.stdout: }, 2023-08-01T19:55:36.690 INFO:teuthology.orchestra.run.smithi101.stdout: { 2023-08-01T19:55:36.690 INFO:teuthology.orchestra.run.smithi101.stdout: "event": "done", 2023-08-01T19:55:36.690 INFO:teuthology.orchestra.run.smithi101.stdout: "time": "2023-08-01T19:54:04.480244+0000", 2023-08-01T19:55:36.691 INFO:teuthology.orchestra.run.smithi101.stdout: "duration": 3.4875000000000001e-05 2023-08-01T19:55:36.691 INFO:teuthology.orchestra.run.smithi101.stdout: } 2023-08-01T19:55:36.691 INFO:teuthology.orchestra.run.smithi101.stdout: ] 2023-08-01T19:55:36.691 INFO:teuthology.orchestra.run.smithi101.stdout: } 2023-08-01T19:55:36.691 INFO:teuthology.orchestra.run.smithi101.stdout: }, 2023-08-01T19:55:36.691 INFO:teuthology.orchestra.run.smithi101.stdout: { 2023-08-01T19:55:36.691 INFO:teuthology.orchestra.run.smithi101.stdout: "description": "osd_op(mds.0.3:3 3.14 3:287034c4:::1.00000000.inode:head [writefull 0~554] snapc 0=[] ondisk+write+known_if_redirected+full_force+supports_pool_eio e17)", 2023-08-01T19:55:36.691 INFO:teuthology.orchestra.run.smithi101.stdout: "initiated_at": "2023-08-01T19:54:04.459226+0000", 2023-08-01T19:55:36.692 INFO:teuthology.orchestra.run.smithi101.stdout: "age": 92.181787628999999, 2023-08-01T19:55:36.692 INFO:teuthology.orchestra.run.smithi101.stdout: "duration": 0.021104531999999999, 2023-08-01T19:55:36.692 INFO:teuthology.orchestra.run.smithi101.stdout: "type_data": { 2023-08-01T19:55:36.692 INFO:teuthology.orchestra.run.smithi101.stdout: "flag_point": "commit sent; apply or cleanup", 2023-08-01T19:55:36.692 INFO:teuthology.orchestra.run.smithi101.stdout: "events": [ 2023-08-01T19:55:36.692 INFO:teuthology.orchestra.run.smithi101.stdout: { 2023-08-01T19:55:36.692 INFO:teuthology.orchestra.run.smithi101.stdout: "event": "initiated", 2023-08-01T19:55:36.692 INFO:teuthology.orchestra.run.smithi101.stdout: "time": "2023-08-01T19:54:04.459226+0000", 2023-08-01T19:55:36.693 INFO:teuthology.orchestra.run.smithi101.stdout: "duration": 0 2023-08-01T19:55:36.693 INFO:teuthology.orchestra.run.smithi101.stdout: }, 2023-08-01T19:55:36.693 INFO:teuthology.orchestra.run.smithi101.stdout: { 2023-08-01T19:55:36.693 INFO:teuthology.orchestra.run.smithi101.stdout: "event": "throttled", 2023-08-01T19:55:36.693 INFO:teuthology.orchestra.run.smithi101.stdout: "time": "2023-08-01T19:54:04.459226+0000", 2023-08-01T19:55:36.693 INFO:teuthology.orchestra.run.smithi101.stdout: "duration": 0 2023-08-01T19:55:36.693 INFO:teuthology.orchestra.run.smithi101.stdout: }, 2023-08-01T19:55:36.693 INFO:teuthology.orchestra.run.smithi101.stdout: { 2023-08-01T19:55:36.694 INFO:teuthology.orchestra.run.smithi101.stdout: "event": "header_read", 2023-08-01T19:55:36.694 INFO:teuthology.orchestra.run.smithi101.stdout: "time": "2023-08-01T19:54:04.459225+0000", 2023-08-01T19:55:36.694 INFO:teuthology.orchestra.run.smithi101.stdout: "duration": 4294967295.9999995 2023-08-01T19:55:36.694 INFO:teuthology.orchestra.run.smithi101.stdout: }, 2023-08-01T19:55:36.694 INFO:teuthology.orchestra.run.smithi101.stdout: { 2023-08-01T19:55:36.694 INFO:teuthology.orchestra.run.smithi101.stdout: "event": "all_read", 2023-08-01T19:55:36.694 INFO:teuthology.orchestra.run.smithi101.stdout: "time": "2023-08-01T19:54:04.459238+0000", 2023-08-01T19:55:36.694 INFO:teuthology.orchestra.run.smithi101.stdout: "duration": 1.2809000000000001e-05 2023-08-01T19:55:36.695 INFO:teuthology.orchestra.run.smithi101.stdout: }, 2023-08-01T19:55:36.695 INFO:teuthology.orchestra.run.smithi101.stdout: { 2023-08-01T19:55:36.695 INFO:teuthology.orchestra.run.smithi101.stdout: "event": "dispatched", 2023-08-01T19:55:36.695 INFO:teuthology.orchestra.run.smithi101.stdout: "time": "2023-08-01T19:54:04.459245+0000", 2023-08-01T19:55:36.695 INFO:teuthology.orchestra.run.smithi101.stdout: "duration": 6.6540000000000002e-06 2023-08-01T19:55:36.695 INFO:teuthology.orchestra.run.smithi101.stdout: }, 2023-08-01T19:55:36.695 INFO:teuthology.orchestra.run.smithi101.stdout: { 2023-08-01T19:55:36.696 INFO:teuthology.orchestra.run.smithi101.stdout: "event": "queued_for_pg", 2023-08-01T19:55:36.696 INFO:teuthology.orchestra.run.smithi101.stdout: "time": "2023-08-01T19:54:04.459249+0000", 2023-08-01T19:55:36.696 INFO:teuthology.orchestra.run.smithi101.stdout: "duration": 4.6e-06 2023-08-01T19:55:36.696 INFO:teuthology.orchestra.run.smithi101.stdout: }, 2023-08-01T19:55:36.696 INFO:teuthology.orchestra.run.smithi101.stdout: { 2023-08-01T19:55:36.696 INFO:teuthology.orchestra.run.smithi101.stdout: "event": "reached_pg", 2023-08-01T19:55:36.696 INFO:teuthology.orchestra.run.smithi101.stdout: "time": "2023-08-01T19:54:04.459276+0000", 2023-08-01T19:55:36.696 INFO:teuthology.orchestra.run.smithi101.stdout: "duration": 2.6373999999999999e-05 2023-08-01T19:55:36.697 INFO:teuthology.orchestra.run.smithi101.stdout: }, 2023-08-01T19:55:36.697 INFO:teuthology.orchestra.run.smithi101.stdout: { 2023-08-01T19:55:36.697 INFO:teuthology.orchestra.run.smithi101.stdout: "event": "waiting_for_map not empty", 2023-08-01T19:55:36.697 INFO:teuthology.orchestra.run.smithi101.stdout: "time": "2023-08-01T19:54:04.459278+0000", 2023-08-01T19:55:36.697 INFO:teuthology.orchestra.run.smithi101.stdout: "duration": 2.4980000000000001e-06 2023-08-01T19:55:36.697 INFO:teuthology.orchestra.run.smithi101.stdout: }, 2023-08-01T19:55:36.697 INFO:teuthology.orchestra.run.smithi101.stdout: { 2023-08-01T19:55:36.697 INFO:teuthology.orchestra.run.smithi101.stdout: "event": "reached_pg", 2023-08-01T19:55:36.698 INFO:teuthology.orchestra.run.smithi101.stdout: "time": "2023-08-01T19:54:04.474058+0000", 2023-08-01T19:55:36.698 INFO:teuthology.orchestra.run.smithi101.stdout: "duration": 0.014779979 2023-08-01T19:55:36.698 INFO:teuthology.orchestra.run.smithi101.stdout: }, 2023-08-01T19:55:36.698 INFO:teuthology.orchestra.run.smithi101.stdout: { 2023-08-01T19:55:36.698 INFO:teuthology.orchestra.run.smithi101.stdout: "event": "started", 2023-08-01T19:55:36.698 INFO:teuthology.orchestra.run.smithi101.stdout: "time": "2023-08-01T19:54:04.474614+0000", 2023-08-01T19:55:36.698 INFO:teuthology.orchestra.run.smithi101.stdout: "duration": 0.00055546899999999995 2023-08-01T19:55:36.698 INFO:teuthology.orchestra.run.smithi101.stdout: }, 2023-08-01T19:55:36.699 INFO:teuthology.orchestra.run.smithi101.stdout: { 2023-08-01T19:55:36.699 INFO:teuthology.orchestra.run.smithi101.stdout: "event": "waiting for subops from 2", 2023-08-01T19:55:36.699 INFO:teuthology.orchestra.run.smithi101.stdout: "time": "2023-08-01T19:54:04.474720+0000", 2023-08-01T19:55:36.699 INFO:teuthology.orchestra.run.smithi101.stdout: "duration": 0.00010645300000000001 2023-08-01T19:55:36.699 INFO:teuthology.orchestra.run.smithi101.stdout: }, 2023-08-01T19:55:36.699 INFO:teuthology.orchestra.run.smithi101.stdout: { 2023-08-01T19:55:36.699 INFO:teuthology.orchestra.run.smithi101.stdout: "event": "op_commit", 2023-08-01T19:55:36.699 INFO:teuthology.orchestra.run.smithi101.stdout: "time": "2023-08-01T19:54:04.478480+0000", 2023-08-01T19:55:36.700 INFO:teuthology.orchestra.run.smithi101.stdout: "duration": 0.0037600279999999999 2023-08-01T19:55:36.700 INFO:teuthology.orchestra.run.smithi101.stdout: }, 2023-08-01T19:55:36.700 INFO:teuthology.orchestra.run.smithi101.stdout: { 2023-08-01T19:55:36.700 INFO:teuthology.orchestra.run.smithi101.stdout: "event": "sub_op_commit_rec", 2023-08-01T19:55:36.700 INFO:teuthology.orchestra.run.smithi101.stdout: "time": "2023-08-01T19:54:04.480273+0000", 2023-08-01T19:55:36.700 INFO:teuthology.orchestra.run.smithi101.stdout: "duration": 0.001792465 2023-08-01T19:55:36.700 INFO:teuthology.orchestra.run.smithi101.stdout: }, 2023-08-01T19:55:36.700 INFO:teuthology.orchestra.run.smithi101.stdout: { 2023-08-01T19:55:36.701 INFO:teuthology.orchestra.run.smithi101.stdout: "event": "commit_sent", 2023-08-01T19:55:36.701 INFO:teuthology.orchestra.run.smithi101.stdout: "time": "2023-08-01T19:54:04.480304+0000", 2023-08-01T19:55:36.701 INFO:teuthology.orchestra.run.smithi101.stdout: "duration": 3.1708999999999997e-05 2023-08-01T19:55:36.701 INFO:teuthology.orchestra.run.smithi101.stdout: }, 2023-08-01T19:55:36.701 INFO:teuthology.orchestra.run.smithi101.stdout: { 2023-08-01T19:55:36.701 INFO:teuthology.orchestra.run.smithi101.stdout: "event": "done", 2023-08-01T19:55:36.701 INFO:teuthology.orchestra.run.smithi101.stdout: "time": "2023-08-01T19:54:04.480330+0000", 2023-08-01T19:55:36.701 INFO:teuthology.orchestra.run.smithi101.stdout: "duration": 2.5860999999999999e-05 2023-08-01T19:55:36.702 INFO:teuthology.orchestra.run.smithi101.stdout: } 2023-08-01T19:55:36.702 INFO:teuthology.orchestra.run.smithi101.stdout: ] 2023-08-01T19:55:36.702 INFO:teuthology.orchestra.run.smithi101.stdout: } 2023-08-01T19:55:36.702 INFO:teuthology.orchestra.run.smithi101.stdout: }, 2023-08-01T19:55:36.702 INFO:teuthology.orchestra.run.smithi101.stdout: { 2023-08-01T19:55:36.702 INFO:teuthology.orchestra.run.smithi101.stdout: "description": "osd_op(mds.0.3:32 3.14 3:2e2fa760:::200.00000001:head [delete] snapc 0=[] ondisk+write+known_if_redirected+full_force+supports_pool_eio e17)", 2023-08-01T19:55:36.702 INFO:teuthology.orchestra.run.smithi101.stdout: "initiated_at": "2023-08-01T19:54:04.459304+0000", 2023-08-01T19:55:36.702 INFO:teuthology.orchestra.run.smithi101.stdout: "age": 92.181708967999995, 2023-08-01T19:55:36.703 INFO:teuthology.orchestra.run.smithi101.stdout: "duration": 0.021110606000000001, 2023-08-01T19:55:36.703 INFO:teuthology.orchestra.run.smithi101.stdout: "type_data": { 2023-08-01T19:55:36.703 INFO:teuthology.orchestra.run.smithi101.stdout: "flag_point": "started", 2023-08-01T19:55:36.703 INFO:teuthology.orchestra.run.smithi101.stdout: "events": [ 2023-08-01T19:55:36.703 INFO:teuthology.orchestra.run.smithi101.stdout: { 2023-08-01T19:55:36.703 INFO:teuthology.orchestra.run.smithi101.stdout: "event": "initiated", 2023-08-01T19:55:36.703 INFO:teuthology.orchestra.run.smithi101.stdout: "time": "2023-08-01T19:54:04.459304+0000", 2023-08-01T19:55:36.703 INFO:teuthology.orchestra.run.smithi101.stdout: "duration": 0 2023-08-01T19:55:36.704 INFO:teuthology.orchestra.run.smithi101.stdout: }, 2023-08-01T19:55:36.704 INFO:teuthology.orchestra.run.smithi101.stdout: { 2023-08-01T19:55:36.704 INFO:teuthology.orchestra.run.smithi101.stdout: "event": "throttled", 2023-08-01T19:55:36.704 INFO:teuthology.orchestra.run.smithi101.stdout: "time": "2023-08-01T19:54:04.459304+0000", 2023-08-01T19:55:36.704 INFO:teuthology.orchestra.run.smithi101.stdout: "duration": 0 2023-08-01T19:55:36.704 INFO:teuthology.orchestra.run.smithi101.stdout: }, 2023-08-01T19:55:36.704 INFO:teuthology.orchestra.run.smithi101.stdout: { 2023-08-01T19:55:36.705 INFO:teuthology.orchestra.run.smithi101.stdout: "event": "header_read", 2023-08-01T19:55:36.705 INFO:teuthology.orchestra.run.smithi101.stdout: "time": "2023-08-01T19:54:04.459304+0000", 2023-08-01T19:55:36.705 INFO:teuthology.orchestra.run.smithi101.stdout: "duration": 4294967295.9999995 2023-08-01T19:55:36.705 INFO:teuthology.orchestra.run.smithi101.stdout: }, 2023-08-01T19:55:36.705 INFO:teuthology.orchestra.run.smithi101.stdout: { 2023-08-01T19:55:36.705 INFO:teuthology.orchestra.run.smithi101.stdout: "event": "all_read", 2023-08-01T19:55:36.705 INFO:teuthology.orchestra.run.smithi101.stdout: "time": "2023-08-01T19:54:04.459306+0000", 2023-08-01T19:55:36.705 INFO:teuthology.orchestra.run.smithi101.stdout: "duration": 2.3889999999999999e-06 2023-08-01T19:55:36.706 INFO:teuthology.orchestra.run.smithi101.stdout: }, 2023-08-01T19:55:36.706 INFO:teuthology.orchestra.run.smithi101.stdout: { 2023-08-01T19:55:36.706 INFO:teuthology.orchestra.run.smithi101.stdout: "event": "dispatched", 2023-08-01T19:55:36.706 INFO:teuthology.orchestra.run.smithi101.stdout: "time": "2023-08-01T19:54:04.459314+0000", 2023-08-01T19:55:36.706 INFO:teuthology.orchestra.run.smithi101.stdout: "duration": 7.1180000000000003e-06 2023-08-01T19:55:36.706 INFO:teuthology.orchestra.run.smithi101.stdout: }, 2023-08-01T19:55:36.706 INFO:teuthology.orchestra.run.smithi101.stdout: { 2023-08-01T19:55:36.706 INFO:teuthology.orchestra.run.smithi101.stdout: "event": "queued_for_pg", 2023-08-01T19:55:36.707 INFO:teuthology.orchestra.run.smithi101.stdout: "time": "2023-08-01T19:54:04.459318+0000", 2023-08-01T19:55:36.707 INFO:teuthology.orchestra.run.smithi101.stdout: "duration": 4.0239999999999999e-06 2023-08-01T19:55:36.707 INFO:teuthology.orchestra.run.smithi101.stdout: }, 2023-08-01T19:55:36.707 INFO:teuthology.orchestra.run.smithi101.stdout: { 2023-08-01T19:55:36.707 INFO:teuthology.orchestra.run.smithi101.stdout: "event": "reached_pg", 2023-08-01T19:55:36.707 INFO:teuthology.orchestra.run.smithi101.stdout: "time": "2023-08-01T19:54:04.459340+0000", 2023-08-01T19:55:36.707 INFO:teuthology.orchestra.run.smithi101.stdout: "duration": 2.2476e-05 2023-08-01T19:55:36.707 INFO:teuthology.orchestra.run.smithi101.stdout: }, 2023-08-01T19:55:36.708 INFO:teuthology.orchestra.run.smithi101.stdout: { 2023-08-01T19:55:36.708 INFO:teuthology.orchestra.run.smithi101.stdout: "event": "waiting_for_map not empty", 2023-08-01T19:55:36.708 INFO:teuthology.orchestra.run.smithi101.stdout: "time": "2023-08-01T19:54:04.459342+0000", 2023-08-01T19:55:36.708 INFO:teuthology.orchestra.run.smithi101.stdout: "duration": 2.272e-06 2023-08-01T19:55:36.708 INFO:teuthology.orchestra.run.smithi101.stdout: }, 2023-08-01T19:55:36.708 INFO:teuthology.orchestra.run.smithi101.stdout: { 2023-08-01T19:55:36.708 INFO:teuthology.orchestra.run.smithi101.stdout: "event": "reached_pg", 2023-08-01T19:55:36.709 INFO:teuthology.orchestra.run.smithi101.stdout: "time": "2023-08-01T19:54:04.475922+0000", 2023-08-01T19:55:36.709 INFO:teuthology.orchestra.run.smithi101.stdout: "duration": 0.016579388 2023-08-01T19:55:36.709 INFO:teuthology.orchestra.run.smithi101.stdout: }, 2023-08-01T19:55:36.709 INFO:teuthology.orchestra.run.smithi101.stdout: { 2023-08-01T19:55:36.709 INFO:teuthology.orchestra.run.smithi101.stdout: "event": "started", 2023-08-01T19:55:36.709 INFO:teuthology.orchestra.run.smithi101.stdout: "time": "2023-08-01T19:54:04.476107+0000", 2023-08-01T19:55:36.709 INFO:teuthology.orchestra.run.smithi101.stdout: "duration": 0.00018486300000000001 2023-08-01T19:55:36.709 INFO:teuthology.orchestra.run.smithi101.stdout: }, 2023-08-01T19:55:36.710 INFO:teuthology.orchestra.run.smithi101.stdout: { 2023-08-01T19:55:36.710 INFO:teuthology.orchestra.run.smithi101.stdout: "event": "done", 2023-08-01T19:55:36.710 INFO:teuthology.orchestra.run.smithi101.stdout: "time": "2023-08-01T19:54:04.480415+0000", 2023-08-01T19:55:36.710 INFO:teuthology.orchestra.run.smithi101.stdout: "duration": 0.0043084589999999997 2023-08-01T19:55:36.710 INFO:teuthology.orchestra.run.smithi101.stdout: } 2023-08-01T19:55:36.710 INFO:teuthology.orchestra.run.smithi101.stdout: ] 2023-08-01T19:55:36.710 INFO:teuthology.orchestra.run.smithi101.stdout: } 2023-08-01T19:55:36.710 INFO:teuthology.orchestra.run.smithi101.stdout: }, 2023-08-01T19:55:36.711 INFO:teuthology.orchestra.run.smithi101.stdout: { 2023-08-01T19:55:36.711 INFO:teuthology.orchestra.run.smithi101.stdout: "description": "osd_op(client.4668.0:70878 5.2 5:49b7d2be:::benchmark_data_smithi006_114134_object70877:head [set-alloc-hint object_size 65536 write_size 65536,write 0~65536] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e30)", 2023-08-01T19:55:36.711 INFO:teuthology.orchestra.run.smithi101.stdout: "initiated_at": "2023-08-01T19:54:50.210223+0000", 2023-08-01T19:55:36.711 INFO:teuthology.orchestra.run.smithi101.stdout: "age": 46.430790397999999, 2023-08-01T19:55:36.711 INFO:teuthology.orchestra.run.smithi101.stdout: "duration": 0.019884895, 2023-08-01T19:55:36.711 INFO:teuthology.orchestra.run.smithi101.stdout: "type_data": { 2023-08-01T19:55:36.711 INFO:teuthology.orchestra.run.smithi101.stdout: "flag_point": "commit sent; apply or cleanup", 2023-08-01T19:55:36.712 INFO:teuthology.orchestra.run.smithi101.stdout: "client_info": { 2023-08-01T19:55:36.712 INFO:teuthology.orchestra.run.smithi101.stdout: "client": "client.4668", 2023-08-01T19:55:36.712 INFO:teuthology.orchestra.run.smithi101.stdout: "client_addr": "172.21.15.6:0/1709472247", 2023-08-01T19:55:36.712 INFO:teuthology.orchestra.run.smithi101.stdout: "tid": 70878 2023-08-01T19:55:36.712 INFO:teuthology.orchestra.run.smithi101.stdout: }, 2023-08-01T19:55:36.712 INFO:teuthology.orchestra.run.smithi101.stdout: "events": [ 2023-08-01T19:55:36.712 INFO:teuthology.orchestra.run.smithi101.stdout: { 2023-08-01T19:55:36.712 INFO:teuthology.orchestra.run.smithi101.stdout: "event": "initiated", 2023-08-01T19:55:36.713 INFO:teuthology.orchestra.run.smithi101.stdout: "time": "2023-08-01T19:54:50.210223+0000", 2023-08-01T19:55:36.713 INFO:teuthology.orchestra.run.smithi101.stdout: "duration": 0 2023-08-01T19:55:36.713 INFO:teuthology.orchestra.run.smithi101.stdout: }, 2023-08-01T19:55:36.713 INFO:teuthology.orchestra.run.smithi101.stdout: { 2023-08-01T19:55:36.713 INFO:teuthology.orchestra.run.smithi101.stdout: "event": "throttled", 2023-08-01T19:55:36.713 INFO:teuthology.orchestra.run.smithi101.stdout: "time": "2023-08-01T19:54:50.210223+0000", 2023-08-01T19:55:36.713 INFO:teuthology.orchestra.run.smithi101.stdout: "duration": 0 2023-08-01T19:55:36.713 INFO:teuthology.orchestra.run.smithi101.stdout: }, 2023-08-01T19:55:36.714 INFO:teuthology.orchestra.run.smithi101.stdout: { 2023-08-01T19:55:36.714 INFO:teuthology.orchestra.run.smithi101.stdout: "event": "header_read", 2023-08-01T19:55:36.714 INFO:teuthology.orchestra.run.smithi101.stdout: "time": "2023-08-01T19:54:50.210222+0000", 2023-08-01T19:55:36.714 INFO:teuthology.orchestra.run.smithi101.stdout: "duration": 4294967295.999999 2023-08-01T19:55:36.714 INFO:teuthology.orchestra.run.smithi101.stdout: }, 2023-08-01T19:55:36.714 INFO:teuthology.orchestra.run.smithi101.stdout: { 2023-08-01T19:55:36.714 INFO:teuthology.orchestra.run.smithi101.stdout: "event": "all_read", 2023-08-01T19:55:36.714 INFO:teuthology.orchestra.run.smithi101.stdout: "time": "2023-08-01T19:54:50.210315+0000", 2023-08-01T19:55:36.715 INFO:teuthology.orchestra.run.smithi101.stdout: "duration": 9.2567999999999999e-05 2023-08-01T19:55:36.715 INFO:teuthology.orchestra.run.smithi101.stdout: }, 2023-08-01T19:55:36.715 INFO:teuthology.orchestra.run.smithi101.stdout: { 2023-08-01T19:55:36.715 INFO:teuthology.orchestra.run.smithi101.stdout: "event": "dispatched", 2023-08-01T19:55:36.715 INFO:teuthology.orchestra.run.smithi101.stdout: "time": "2023-08-01T19:54:50.210326+0000", 2023-08-01T19:55:36.715 INFO:teuthology.orchestra.run.smithi101.stdout: "duration": 1.1430000000000001e-05 2023-08-01T19:55:36.715 INFO:teuthology.orchestra.run.smithi101.stdout: }, 2023-08-01T19:55:36.715 INFO:teuthology.orchestra.run.smithi101.stdout: { 2023-08-01T19:55:36.716 INFO:teuthology.orchestra.run.smithi101.stdout: "event": "queued_for_pg", 2023-08-01T19:55:36.716 INFO:teuthology.orchestra.run.smithi101.stdout: "time": "2023-08-01T19:54:50.210332+0000", 2023-08-01T19:55:36.716 INFO:teuthology.orchestra.run.smithi101.stdout: "duration": 5.8479999999999997e-06 2023-08-01T19:55:36.716 INFO:teuthology.orchestra.run.smithi101.stdout: }, 2023-08-01T19:55:36.716 INFO:teuthology.orchestra.run.smithi101.stdout: { 2023-08-01T19:55:36.716 INFO:teuthology.orchestra.run.smithi101.stdout: "event": "reached_pg", 2023-08-01T19:55:36.716 INFO:teuthology.orchestra.run.smithi101.stdout: "time": "2023-08-01T19:54:50.214259+0000", 2023-08-01T19:55:36.717 INFO:teuthology.orchestra.run.smithi101.stdout: "duration": 0.003926789 2023-08-01T19:55:36.717 INFO:teuthology.orchestra.run.smithi101.stdout: }, 2023-08-01T19:55:36.717 INFO:teuthology.orchestra.run.smithi101.stdout: { 2023-08-01T19:55:36.717 INFO:teuthology.orchestra.run.smithi101.stdout: "event": "started", 2023-08-01T19:55:36.717 INFO:teuthology.orchestra.run.smithi101.stdout: "time": "2023-08-01T19:54:50.214387+0000", 2023-08-01T19:55:36.717 INFO:teuthology.orchestra.run.smithi101.stdout: "duration": 0.00012787599999999999 2023-08-01T19:55:36.717 INFO:teuthology.orchestra.run.smithi101.stdout: }, 2023-08-01T19:55:36.717 INFO:teuthology.orchestra.run.smithi101.stdout: { 2023-08-01T19:55:36.718 INFO:teuthology.orchestra.run.smithi101.stdout: "event": "waiting for subops from 0", 2023-08-01T19:55:36.718 INFO:teuthology.orchestra.run.smithi101.stdout: "time": "2023-08-01T19:54:50.214536+0000", 2023-08-01T19:55:36.718 INFO:teuthology.orchestra.run.smithi101.stdout: "duration": 0.00014935299999999999 2023-08-01T19:55:36.718 INFO:teuthology.orchestra.run.smithi101.stdout: }, 2023-08-01T19:55:36.718 INFO:teuthology.orchestra.run.smithi101.stdout: { 2023-08-01T19:55:36.718 INFO:teuthology.orchestra.run.smithi101.stdout: "event": "op_commit", 2023-08-01T19:55:36.718 INFO:teuthology.orchestra.run.smithi101.stdout: "time": "2023-08-01T19:54:50.217739+0000", 2023-08-01T19:55:36.719 INFO:teuthology.orchestra.run.smithi101.stdout: "duration": 0.0032034619999999998 2023-08-01T19:55:36.719 INFO:teuthology.orchestra.run.smithi101.stdout: }, 2023-08-01T19:55:36.719 INFO:teuthology.orchestra.run.smithi101.stdout: { 2023-08-01T19:55:36.719 INFO:teuthology.orchestra.run.smithi101.stdout: "event": "sub_op_commit_rec", 2023-08-01T19:55:36.719 INFO:teuthology.orchestra.run.smithi101.stdout: "time": "2023-08-01T19:54:50.230032+0000", 2023-08-01T19:55:36.719 INFO:teuthology.orchestra.run.smithi101.stdout: "duration": 0.012293068000000001 2023-08-01T19:55:36.719 INFO:teuthology.orchestra.run.smithi101.stdout: }, 2023-08-01T19:55:36.719 INFO:teuthology.orchestra.run.smithi101.stdout: { 2023-08-01T19:55:36.720 INFO:teuthology.orchestra.run.smithi101.stdout: "event": "commit_sent", 2023-08-01T19:55:36.720 INFO:teuthology.orchestra.run.smithi101.stdout: "time": "2023-08-01T19:54:50.230075+0000", 2023-08-01T19:55:36.720 INFO:teuthology.orchestra.run.smithi101.stdout: "duration": 4.3062999999999997e-05 2023-08-01T19:55:36.720 INFO:teuthology.orchestra.run.smithi101.stdout: }, 2023-08-01T19:55:36.720 INFO:teuthology.orchestra.run.smithi101.stdout: { 2023-08-01T19:55:36.720 INFO:teuthology.orchestra.run.smithi101.stdout: "event": "done", 2023-08-01T19:55:36.720 INFO:teuthology.orchestra.run.smithi101.stdout: "time": "2023-08-01T19:54:50.230108+0000", 2023-08-01T19:55:36.721 INFO:teuthology.orchestra.run.smithi101.stdout: "duration": 3.2366999999999997e-05 2023-08-01T19:55:36.721 INFO:teuthology.orchestra.run.smithi101.stdout: } 2023-08-01T19:55:36.721 INFO:teuthology.orchestra.run.smithi101.stdout: ] 2023-08-01T19:55:36.721 INFO:teuthology.orchestra.run.smithi101.stdout: } 2023-08-01T19:55:36.721 INFO:teuthology.orchestra.run.smithi101.stdout: }, 2023-08-01T19:55:36.721 INFO:teuthology.orchestra.run.smithi101.stdout: { 2023-08-01T19:55:36.721 INFO:teuthology.orchestra.run.smithi101.stdout: "description": "osd_op(client.4668.0:73460 5.f 5:ff4f0704:::benchmark_data_smithi006_114134_object73459:head [set-alloc-hint object_size 65536 write_size 65536,write 0~65536] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e31)", 2023-08-01T19:55:36.721 INFO:teuthology.orchestra.run.smithi101.stdout: "initiated_at": "2023-08-01T19:54:51.462968+0000", 2023-08-01T19:55:36.722 INFO:teuthology.orchestra.run.smithi101.stdout: "age": 45.178045519000001, 2023-08-01T19:55:36.722 INFO:teuthology.orchestra.run.smithi101.stdout: "duration": 0.020056502, 2023-08-01T19:55:36.722 INFO:teuthology.orchestra.run.smithi101.stdout: "type_data": { 2023-08-01T19:55:36.722 INFO:teuthology.orchestra.run.smithi101.stdout: "flag_point": "commit sent; apply or cleanup", 2023-08-01T19:55:36.722 INFO:teuthology.orchestra.run.smithi101.stdout: "client_info": { 2023-08-01T19:55:36.722 INFO:teuthology.orchestra.run.smithi101.stdout: "client": "client.4668", 2023-08-01T19:55:36.722 INFO:teuthology.orchestra.run.smithi101.stdout: "client_addr": "172.21.15.6:0/1709472247", 2023-08-01T19:55:36.722 INFO:teuthology.orchestra.run.smithi101.stdout: "tid": 73460 2023-08-01T19:55:36.723 INFO:teuthology.orchestra.run.smithi101.stdout: }, 2023-08-01T19:55:36.723 INFO:teuthology.orchestra.run.smithi101.stdout: "events": [ 2023-08-01T19:55:36.723 INFO:teuthology.orchestra.run.smithi101.stdout: { 2023-08-01T19:55:36.723 INFO:teuthology.orchestra.run.smithi101.stdout: "event": "initiated", 2023-08-01T19:55:36.723 INFO:teuthology.orchestra.run.smithi101.stdout: "time": "2023-08-01T19:54:51.462968+0000", 2023-08-01T19:55:36.723 INFO:teuthology.orchestra.run.smithi101.stdout: "duration": 0 2023-08-01T19:55:36.723 INFO:teuthology.orchestra.run.smithi101.stdout: }, 2023-08-01T19:55:36.723 INFO:teuthology.orchestra.run.smithi101.stdout: { 2023-08-01T19:55:36.724 INFO:teuthology.orchestra.run.smithi101.stdout: "event": "throttled", 2023-08-01T19:55:36.724 INFO:teuthology.orchestra.run.smithi101.stdout: "time": "2023-08-01T19:54:51.462968+0000", 2023-08-01T19:55:36.724 INFO:teuthology.orchestra.run.smithi101.stdout: "duration": 0 2023-08-01T19:55:36.724 INFO:teuthology.orchestra.run.smithi101.stdout: }, 2023-08-01T19:55:36.724 INFO:teuthology.orchestra.run.smithi101.stdout: { 2023-08-01T19:55:36.724 INFO:teuthology.orchestra.run.smithi101.stdout: "event": "header_read", 2023-08-01T19:55:36.724 INFO:teuthology.orchestra.run.smithi101.stdout: "time": "2023-08-01T19:54:51.462967+0000", 2023-08-01T19:55:36.724 INFO:teuthology.orchestra.run.smithi101.stdout: "duration": 4294967295.999999 2023-08-01T19:55:36.725 INFO:teuthology.orchestra.run.smithi101.stdout: }, 2023-08-01T19:55:36.725 INFO:teuthology.orchestra.run.smithi101.stdout: { 2023-08-01T19:55:36.725 INFO:teuthology.orchestra.run.smithi101.stdout: "event": "all_read", 2023-08-01T19:55:36.725 INFO:teuthology.orchestra.run.smithi101.stdout: "time": "2023-08-01T19:54:51.463009+0000", 2023-08-01T19:55:36.725 INFO:teuthology.orchestra.run.smithi101.stdout: "duration": 4.2106e-05 2023-08-01T19:55:36.725 INFO:teuthology.orchestra.run.smithi101.stdout: }, 2023-08-01T19:55:36.725 INFO:teuthology.orchestra.run.smithi101.stdout: { 2023-08-01T19:55:36.725 INFO:teuthology.orchestra.run.smithi101.stdout: "event": "dispatched", 2023-08-01T19:55:36.726 INFO:teuthology.orchestra.run.smithi101.stdout: "time": "2023-08-01T19:54:51.463017+0000", 2023-08-01T19:55:36.726 INFO:teuthology.orchestra.run.smithi101.stdout: "duration": 8.1529999999999997e-06 2023-08-01T19:55:36.726 INFO:teuthology.orchestra.run.smithi101.stdout: }, 2023-08-01T19:55:36.726 INFO:teuthology.orchestra.run.smithi101.stdout: { 2023-08-01T19:55:36.726 INFO:teuthology.orchestra.run.smithi101.stdout: "event": "queued_for_pg", 2023-08-01T19:55:36.726 INFO:teuthology.orchestra.run.smithi101.stdout: "time": "2023-08-01T19:54:51.463027+0000", 2023-08-01T19:55:36.726 INFO:teuthology.orchestra.run.smithi101.stdout: "duration": 9.5659999999999996e-06 2023-08-01T19:55:36.727 INFO:teuthology.orchestra.run.smithi101.stdout: }, 2023-08-01T19:55:36.727 INFO:teuthology.orchestra.run.smithi101.stdout: { 2023-08-01T19:55:36.727 INFO:teuthology.orchestra.run.smithi101.stdout: "event": "reached_pg", 2023-08-01T19:55:36.727 INFO:teuthology.orchestra.run.smithi101.stdout: "time": "2023-08-01T19:54:51.463062+0000", 2023-08-01T19:55:36.727 INFO:teuthology.orchestra.run.smithi101.stdout: "duration": 3.5442999999999999e-05 2023-08-01T19:55:36.727 INFO:teuthology.orchestra.run.smithi101.stdout: }, 2023-08-01T19:55:36.727 INFO:teuthology.orchestra.run.smithi101.stdout: { 2023-08-01T19:55:36.727 INFO:teuthology.orchestra.run.smithi101.stdout: "event": "started", 2023-08-01T19:55:36.728 INFO:teuthology.orchestra.run.smithi101.stdout: "time": "2023-08-01T19:54:51.463198+0000", 2023-08-01T19:55:36.728 INFO:teuthology.orchestra.run.smithi101.stdout: "duration": 0.000135628 2023-08-01T19:55:36.728 INFO:teuthology.orchestra.run.smithi101.stdout: }, 2023-08-01T19:55:36.728 INFO:teuthology.orchestra.run.smithi101.stdout: { 2023-08-01T19:55:36.728 INFO:teuthology.orchestra.run.smithi101.stdout: "event": "waiting for subops from 2", 2023-08-01T19:55:36.728 INFO:teuthology.orchestra.run.smithi101.stdout: "time": "2023-08-01T19:54:51.463341+0000", 2023-08-01T19:55:36.728 INFO:teuthology.orchestra.run.smithi101.stdout: "duration": 0.00014346500000000001 2023-08-01T19:55:36.728 INFO:teuthology.orchestra.run.smithi101.stdout: }, 2023-08-01T19:55:36.729 INFO:teuthology.orchestra.run.smithi101.stdout: { 2023-08-01T19:55:36.729 INFO:teuthology.orchestra.run.smithi101.stdout: "event": "op_commit", 2023-08-01T19:55:36.729 INFO:teuthology.orchestra.run.smithi101.stdout: "time": "2023-08-01T19:54:51.472684+0000", 2023-08-01T19:55:36.729 INFO:teuthology.orchestra.run.smithi101.stdout: "duration": 0.0093427900000000001 2023-08-01T19:55:36.729 INFO:teuthology.orchestra.run.smithi101.stdout: }, 2023-08-01T19:55:36.729 INFO:teuthology.orchestra.run.smithi101.stdout: { 2023-08-01T19:55:36.729 INFO:teuthology.orchestra.run.smithi101.stdout: "event": "sub_op_commit_rec", 2023-08-01T19:55:36.729 INFO:teuthology.orchestra.run.smithi101.stdout: "time": "2023-08-01T19:54:51.482937+0000", 2023-08-01T19:55:36.730 INFO:teuthology.orchestra.run.smithi101.stdout: "duration": 0.010252557000000001 2023-08-01T19:55:36.730 INFO:teuthology.orchestra.run.smithi101.stdout: }, 2023-08-01T19:55:36.730 INFO:teuthology.orchestra.run.smithi101.stdout: { 2023-08-01T19:55:36.730 INFO:teuthology.orchestra.run.smithi101.stdout: "event": "commit_sent", 2023-08-01T19:55:36.730 INFO:teuthology.orchestra.run.smithi101.stdout: "time": "2023-08-01T19:54:51.482984+0000", 2023-08-01T19:55:36.730 INFO:teuthology.orchestra.run.smithi101.stdout: "duration": 4.7394000000000001e-05 2023-08-01T19:55:36.730 INFO:teuthology.orchestra.run.smithi101.stdout: }, 2023-08-01T19:55:36.730 INFO:teuthology.orchestra.run.smithi101.stdout: { 2023-08-01T19:55:36.731 INFO:teuthology.orchestra.run.smithi101.stdout: "event": "done", 2023-08-01T19:55:36.731 INFO:teuthology.orchestra.run.smithi101.stdout: "time": "2023-08-01T19:54:51.483024+0000", 2023-08-01T19:55:36.731 INFO:teuthology.orchestra.run.smithi101.stdout: "duration": 4.0159e-05 2023-08-01T19:55:36.731 INFO:teuthology.orchestra.run.smithi101.stdout: } 2023-08-01T19:55:36.731 INFO:teuthology.orchestra.run.smithi101.stdout: ] 2023-08-01T19:55:36.731 INFO:teuthology.orchestra.run.smithi101.stdout: } 2023-08-01T19:55:36.731 INFO:teuthology.orchestra.run.smithi101.stdout: }, 2023-08-01T19:55:36.731 INFO:teuthology.orchestra.run.smithi101.stdout: { 2023-08-01T19:55:36.732 INFO:teuthology.orchestra.run.smithi101.stdout: "description": "osd_op(client.4668.0:92726 5.2 5:41e18163:::benchmark_data_smithi006_114134_object92725:head [set-alloc-hint object_size 65536 write_size 65536,write 0~65536] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e36)", 2023-08-01T19:55:36.732 INFO:teuthology.orchestra.run.smithi101.stdout: "initiated_at": "2023-08-01T19:55:01.256971+0000", 2023-08-01T19:55:36.732 INFO:teuthology.orchestra.run.smithi101.stdout: "age": 35.384042440000002, 2023-08-01T19:55:36.732 INFO:teuthology.orchestra.run.smithi101.stdout: "duration": 0.019854296, 2023-08-01T19:55:36.732 INFO:teuthology.orchestra.run.smithi101.stdout: "type_data": { 2023-08-01T19:55:36.732 INFO:teuthology.orchestra.run.smithi101.stdout: "flag_point": "commit sent; apply or cleanup", 2023-08-01T19:55:36.732 INFO:teuthology.orchestra.run.smithi101.stdout: "client_info": { 2023-08-01T19:55:36.732 INFO:teuthology.orchestra.run.smithi101.stdout: "client": "client.4668", 2023-08-01T19:55:36.733 INFO:teuthology.orchestra.run.smithi101.stdout: "client_addr": "172.21.15.6:0/1709472247", 2023-08-01T19:55:36.733 INFO:teuthology.orchestra.run.smithi101.stdout: "tid": 92726 2023-08-01T19:55:36.733 INFO:teuthology.orchestra.run.smithi101.stdout: }, 2023-08-01T19:55:36.733 INFO:teuthology.orchestra.run.smithi101.stdout: "events": [ 2023-08-01T19:55:36.733 INFO:teuthology.orchestra.run.smithi101.stdout: { 2023-08-01T19:55:36.733 INFO:teuthology.orchestra.run.smithi101.stdout: "event": "initiated", 2023-08-01T19:55:36.733 INFO:teuthology.orchestra.run.smithi101.stdout: "time": "2023-08-01T19:55:01.256971+0000", 2023-08-01T19:55:36.733 INFO:teuthology.orchestra.run.smithi101.stdout: "duration": 0 2023-08-01T19:55:36.734 INFO:teuthology.orchestra.run.smithi101.stdout: }, 2023-08-01T19:55:36.734 INFO:teuthology.orchestra.run.smithi101.stdout: { 2023-08-01T19:55:36.734 INFO:teuthology.orchestra.run.smithi101.stdout: "event": "throttled", 2023-08-01T19:55:36.734 INFO:teuthology.orchestra.run.smithi101.stdout: "time": "2023-08-01T19:55:01.256971+0000", 2023-08-01T19:55:36.734 INFO:teuthology.orchestra.run.smithi101.stdout: "duration": 0 2023-08-01T19:55:36.734 INFO:teuthology.orchestra.run.smithi101.stdout: }, 2023-08-01T19:55:36.734 INFO:teuthology.orchestra.run.smithi101.stdout: { 2023-08-01T19:55:36.734 INFO:teuthology.orchestra.run.smithi101.stdout: "event": "header_read", 2023-08-01T19:55:36.735 INFO:teuthology.orchestra.run.smithi101.stdout: "time": "2023-08-01T19:55:01.256970+0000", 2023-08-01T19:55:36.735 INFO:teuthology.orchestra.run.smithi101.stdout: "duration": 4294967295.9999995 2023-08-01T19:55:36.735 INFO:teuthology.orchestra.run.smithi101.stdout: }, 2023-08-01T19:55:36.735 INFO:teuthology.orchestra.run.smithi101.stdout: { 2023-08-01T19:55:36.735 INFO:teuthology.orchestra.run.smithi101.stdout: "event": "all_read", 2023-08-01T19:55:36.735 INFO:teuthology.orchestra.run.smithi101.stdout: "time": "2023-08-01T19:55:01.257057+0000", 2023-08-01T19:55:36.735 INFO:teuthology.orchestra.run.smithi101.stdout: "duration": 8.6627999999999998e-05 2023-08-01T19:55:36.736 INFO:teuthology.orchestra.run.smithi101.stdout: }, 2023-08-01T19:55:36.736 INFO:teuthology.orchestra.run.smithi101.stdout: { 2023-08-01T19:55:36.736 INFO:teuthology.orchestra.run.smithi101.stdout: "event": "dispatched", 2023-08-01T19:55:36.736 INFO:teuthology.orchestra.run.smithi101.stdout: "time": "2023-08-01T19:55:01.257063+0000", 2023-08-01T19:55:36.736 INFO:teuthology.orchestra.run.smithi101.stdout: "duration": 6.528e-06 2023-08-01T19:55:36.736 INFO:teuthology.orchestra.run.smithi101.stdout: }, 2023-08-01T19:55:36.736 INFO:teuthology.orchestra.run.smithi101.stdout: { 2023-08-01T19:55:36.736 INFO:teuthology.orchestra.run.smithi101.stdout: "event": "queued_for_pg", 2023-08-01T19:55:36.737 INFO:teuthology.orchestra.run.smithi101.stdout: "time": "2023-08-01T19:55:01.257067+0000", 2023-08-01T19:55:36.737 INFO:teuthology.orchestra.run.smithi101.stdout: "duration": 3.2739999999999999e-06 2023-08-01T19:55:36.737 INFO:teuthology.orchestra.run.smithi101.stdout: }, 2023-08-01T19:55:36.737 INFO:teuthology.orchestra.run.smithi101.stdout: { 2023-08-01T19:55:36.737 INFO:teuthology.orchestra.run.smithi101.stdout: "event": "reached_pg", 2023-08-01T19:55:36.737 INFO:teuthology.orchestra.run.smithi101.stdout: "time": "2023-08-01T19:55:01.259714+0000", 2023-08-01T19:55:36.737 INFO:teuthology.orchestra.run.smithi101.stdout: "duration": 0.0026476709999999999 2023-08-01T19:55:36.738 INFO:teuthology.orchestra.run.smithi101.stdout: }, 2023-08-01T19:55:36.738 INFO:teuthology.orchestra.run.smithi101.stdout: { 2023-08-01T19:55:36.738 INFO:teuthology.orchestra.run.smithi101.stdout: "event": "started", 2023-08-01T19:55:36.738 INFO:teuthology.orchestra.run.smithi101.stdout: "time": "2023-08-01T19:55:01.259829+0000", 2023-08-01T19:55:36.738 INFO:teuthology.orchestra.run.smithi101.stdout: "duration": 0.000114471 2023-08-01T19:55:36.739 INFO:teuthology.orchestra.run.smithi101.stdout: }, 2023-08-01T19:55:36.739 INFO:teuthology.orchestra.run.smithi101.stdout: { 2023-08-01T19:55:36.739 INFO:teuthology.orchestra.run.smithi101.stdout: "event": "waiting for subops from 0", 2023-08-01T19:55:36.739 INFO:teuthology.orchestra.run.smithi101.stdout: "time": "2023-08-01T19:55:01.259965+0000", 2023-08-01T19:55:36.739 INFO:teuthology.orchestra.run.smithi101.stdout: "duration": 0.00013597300000000001 2023-08-01T19:55:36.739 INFO:teuthology.orchestra.run.smithi101.stdout: }, 2023-08-01T19:55:36.739 INFO:teuthology.orchestra.run.smithi101.stdout: { 2023-08-01T19:55:36.739 INFO:teuthology.orchestra.run.smithi101.stdout: "event": "op_commit", 2023-08-01T19:55:36.740 INFO:teuthology.orchestra.run.smithi101.stdout: "time": "2023-08-01T19:55:01.264360+0000", 2023-08-01T19:55:36.740 INFO:teuthology.orchestra.run.smithi101.stdout: "duration": 0.0043956619999999998 2023-08-01T19:55:36.740 INFO:teuthology.orchestra.run.smithi101.stdout: }, 2023-08-01T19:55:36.740 INFO:teuthology.orchestra.run.smithi101.stdout: { 2023-08-01T19:55:36.740 INFO:teuthology.orchestra.run.smithi101.stdout: "event": "sub_op_commit_rec", 2023-08-01T19:55:36.740 INFO:teuthology.orchestra.run.smithi101.stdout: "time": "2023-08-01T19:55:01.276766+0000", 2023-08-01T19:55:36.740 INFO:teuthology.orchestra.run.smithi101.stdout: "duration": 0.012405736000000001 2023-08-01T19:55:36.741 INFO:teuthology.orchestra.run.smithi101.stdout: }, 2023-08-01T19:55:36.741 INFO:teuthology.orchestra.run.smithi101.stdout: { 2023-08-01T19:55:36.741 INFO:teuthology.orchestra.run.smithi101.stdout: "event": "commit_sent", 2023-08-01T19:55:36.741 INFO:teuthology.orchestra.run.smithi101.stdout: "time": "2023-08-01T19:55:01.276804+0000", 2023-08-01T19:55:36.741 INFO:teuthology.orchestra.run.smithi101.stdout: "duration": 3.7759999999999998e-05 2023-08-01T19:55:36.741 INFO:teuthology.orchestra.run.smithi101.stdout: }, 2023-08-01T19:55:36.741 INFO:teuthology.orchestra.run.smithi101.stdout: { 2023-08-01T19:55:36.741 INFO:teuthology.orchestra.run.smithi101.stdout: "event": "done", 2023-08-01T19:55:36.742 INFO:teuthology.orchestra.run.smithi101.stdout: "time": "2023-08-01T19:55:01.276825+0000", 2023-08-01T19:55:36.742 INFO:teuthology.orchestra.run.smithi101.stdout: "duration": 2.1299000000000001e-05 2023-08-01T19:55:36.742 INFO:teuthology.orchestra.run.smithi101.stdout: } 2023-08-01T19:55:36.742 INFO:teuthology.orchestra.run.smithi101.stdout: ] 2023-08-01T19:55:36.742 INFO:teuthology.orchestra.run.smithi101.stdout: } 2023-08-01T19:55:36.742 INFO:teuthology.orchestra.run.smithi101.stdout: }, 2023-08-01T19:55:36.742 INFO:teuthology.orchestra.run.smithi101.stdout: { 2023-08-01T19:55:36.742 INFO:teuthology.orchestra.run.smithi101.stdout: "description": "osd_op(client.4668.0:100244 5.9 5:92f56a12:::benchmark_data_smithi006_114134_object100243:head [set-alloc-hint object_size 65536 write_size 65536,write 0~65536] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e37)", 2023-08-01T19:55:36.743 INFO:teuthology.orchestra.run.smithi101.stdout: "initiated_at": "2023-08-01T19:55:05.150910+0000", 2023-08-01T19:55:36.743 INFO:teuthology.orchestra.run.smithi101.stdout: "age": 31.490103624, 2023-08-01T19:55:36.743 INFO:teuthology.orchestra.run.smithi101.stdout: "duration": 0.072864287, 2023-08-01T19:55:36.743 INFO:teuthology.orchestra.run.smithi101.stdout: "type_data": { 2023-08-01T19:55:36.743 INFO:teuthology.orchestra.run.smithi101.stdout: "flag_point": "commit sent; apply or cleanup", 2023-08-01T19:55:36.743 INFO:teuthology.orchestra.run.smithi101.stdout: "client_info": { 2023-08-01T19:55:36.743 INFO:teuthology.orchestra.run.smithi101.stdout: "client": "client.4668", 2023-08-01T19:55:36.743 INFO:teuthology.orchestra.run.smithi101.stdout: "client_addr": "172.21.15.6:0/1709472247", 2023-08-01T19:55:36.744 INFO:teuthology.orchestra.run.smithi101.stdout: "tid": 100244 2023-08-01T19:55:36.744 INFO:teuthology.orchestra.run.smithi101.stdout: }, 2023-08-01T19:55:36.744 INFO:teuthology.orchestra.run.smithi101.stdout: "events": [ 2023-08-01T19:55:36.744 INFO:teuthology.orchestra.run.smithi101.stdout: { 2023-08-01T19:55:36.744 INFO:teuthology.orchestra.run.smithi101.stdout: "event": "initiated", 2023-08-01T19:55:36.744 INFO:teuthology.orchestra.run.smithi101.stdout: "time": "2023-08-01T19:55:05.150910+0000", 2023-08-01T19:55:36.744 INFO:teuthology.orchestra.run.smithi101.stdout: "duration": 0 2023-08-01T19:55:36.744 INFO:teuthology.orchestra.run.smithi101.stdout: }, 2023-08-01T19:55:36.745 INFO:teuthology.orchestra.run.smithi101.stdout: { 2023-08-01T19:55:36.745 INFO:teuthology.orchestra.run.smithi101.stdout: "event": "throttled", 2023-08-01T19:55:36.745 INFO:teuthology.orchestra.run.smithi101.stdout: "time": "2023-08-01T19:55:05.150910+0000", 2023-08-01T19:55:36.745 INFO:teuthology.orchestra.run.smithi101.stdout: "duration": 0 2023-08-01T19:55:36.745 INFO:teuthology.orchestra.run.smithi101.stdout: }, 2023-08-01T19:55:36.745 INFO:teuthology.orchestra.run.smithi101.stdout: { 2023-08-01T19:55:36.745 INFO:teuthology.orchestra.run.smithi101.stdout: "event": "header_read", 2023-08-01T19:55:36.746 INFO:teuthology.orchestra.run.smithi101.stdout: "time": "2023-08-01T19:55:05.150909+0000", 2023-08-01T19:55:36.746 INFO:teuthology.orchestra.run.smithi101.stdout: "duration": 4294967295.999999 2023-08-01T19:55:36.746 INFO:teuthology.orchestra.run.smithi101.stdout: }, 2023-08-01T19:55:36.746 INFO:teuthology.orchestra.run.smithi101.stdout: { 2023-08-01T19:55:36.746 INFO:teuthology.orchestra.run.smithi101.stdout: "event": "all_read", 2023-08-01T19:55:36.746 INFO:teuthology.orchestra.run.smithi101.stdout: "time": "2023-08-01T19:55:05.150973+0000", 2023-08-01T19:55:36.746 INFO:teuthology.orchestra.run.smithi101.stdout: "duration": 6.4531999999999998e-05 2023-08-01T19:55:36.746 INFO:teuthology.orchestra.run.smithi101.stdout: }, 2023-08-01T19:55:36.747 INFO:teuthology.orchestra.run.smithi101.stdout: { 2023-08-01T19:55:36.747 INFO:teuthology.orchestra.run.smithi101.stdout: "event": "dispatched", 2023-08-01T19:55:36.747 INFO:teuthology.orchestra.run.smithi101.stdout: "time": "2023-08-01T19:55:05.150984+0000", 2023-08-01T19:55:36.747 INFO:teuthology.orchestra.run.smithi101.stdout: "duration": 1.0287e-05 2023-08-01T19:55:36.747 INFO:teuthology.orchestra.run.smithi101.stdout: }, 2023-08-01T19:55:36.747 INFO:teuthology.orchestra.run.smithi101.stdout: { 2023-08-01T19:55:36.747 INFO:teuthology.orchestra.run.smithi101.stdout: "event": "queued_for_pg", 2023-08-01T19:55:36.747 INFO:teuthology.orchestra.run.smithi101.stdout: "time": "2023-08-01T19:55:05.150989+0000", 2023-08-01T19:55:36.748 INFO:teuthology.orchestra.run.smithi101.stdout: "duration": 5.3929999999999999e-06 2023-08-01T19:55:36.748 INFO:teuthology.orchestra.run.smithi101.stdout: }, 2023-08-01T19:55:36.748 INFO:teuthology.orchestra.run.smithi101.stdout: { 2023-08-01T19:55:36.748 INFO:teuthology.orchestra.run.smithi101.stdout: "event": "reached_pg", 2023-08-01T19:55:36.748 INFO:teuthology.orchestra.run.smithi101.stdout: "time": "2023-08-01T19:55:05.151034+0000", 2023-08-01T19:55:36.748 INFO:teuthology.orchestra.run.smithi101.stdout: "duration": 4.4336999999999999e-05 2023-08-01T19:55:36.748 INFO:teuthology.orchestra.run.smithi101.stdout: }, 2023-08-01T19:55:36.748 INFO:teuthology.orchestra.run.smithi101.stdout: { 2023-08-01T19:55:36.749 INFO:teuthology.orchestra.run.smithi101.stdout: "event": "started", 2023-08-01T19:55:36.749 INFO:teuthology.orchestra.run.smithi101.stdout: "time": "2023-08-01T19:55:05.151167+0000", 2023-08-01T19:55:36.749 INFO:teuthology.orchestra.run.smithi101.stdout: "duration": 0.00013368899999999999 2023-08-01T19:55:36.749 INFO:teuthology.orchestra.run.smithi101.stdout: }, 2023-08-01T19:55:36.749 INFO:teuthology.orchestra.run.smithi101.stdout: { 2023-08-01T19:55:36.749 INFO:teuthology.orchestra.run.smithi101.stdout: "event": "waiting for subops from 2", 2023-08-01T19:55:36.749 INFO:teuthology.orchestra.run.smithi101.stdout: "time": "2023-08-01T19:55:05.151328+0000", 2023-08-01T19:55:36.750 INFO:teuthology.orchestra.run.smithi101.stdout: "duration": 0.00016122700000000001 2023-08-01T19:55:36.750 INFO:teuthology.orchestra.run.smithi101.stdout: }, 2023-08-01T19:55:36.750 INFO:teuthology.orchestra.run.smithi101.stdout: { 2023-08-01T19:55:36.750 INFO:teuthology.orchestra.run.smithi101.stdout: "event": "op_commit", 2023-08-01T19:55:36.750 INFO:teuthology.orchestra.run.smithi101.stdout: "time": "2023-08-01T19:55:05.156101+0000", 2023-08-01T19:55:36.750 INFO:teuthology.orchestra.run.smithi101.stdout: "duration": 0.0047724100000000004 2023-08-01T19:55:36.750 INFO:teuthology.orchestra.run.smithi101.stdout: }, 2023-08-01T19:55:36.750 INFO:teuthology.orchestra.run.smithi101.stdout: { 2023-08-01T19:55:36.751 INFO:teuthology.orchestra.run.smithi101.stdout: "event": "sub_op_commit_rec", 2023-08-01T19:55:36.751 INFO:teuthology.orchestra.run.smithi101.stdout: "time": "2023-08-01T19:55:05.223688+0000", 2023-08-01T19:55:36.751 INFO:teuthology.orchestra.run.smithi101.stdout: "duration": 0.067586937999999999 2023-08-01T19:55:36.751 INFO:teuthology.orchestra.run.smithi101.stdout: }, 2023-08-01T19:55:36.751 INFO:teuthology.orchestra.run.smithi101.stdout: { 2023-08-01T19:55:36.751 INFO:teuthology.orchestra.run.smithi101.stdout: "event": "commit_sent", 2023-08-01T19:55:36.751 INFO:teuthology.orchestra.run.smithi101.stdout: "time": "2023-08-01T19:55:05.223737+0000", 2023-08-01T19:55:36.751 INFO:teuthology.orchestra.run.smithi101.stdout: "duration": 4.8921999999999997e-05 2023-08-01T19:55:36.752 INFO:teuthology.orchestra.run.smithi101.stdout: }, 2023-08-01T19:55:36.752 INFO:teuthology.orchestra.run.smithi101.stdout: { 2023-08-01T19:55:36.752 INFO:teuthology.orchestra.run.smithi101.stdout: "event": "done", 2023-08-01T19:55:36.752 INFO:teuthology.orchestra.run.smithi101.stdout: "time": "2023-08-01T19:55:05.223774+0000", 2023-08-01T19:55:36.752 INFO:teuthology.orchestra.run.smithi101.stdout: "duration": 3.7342999999999998e-05 2023-08-01T19:55:36.752 INFO:teuthology.orchestra.run.smithi101.stdout: } 2023-08-01T19:55:36.752 INFO:teuthology.orchestra.run.smithi101.stdout: ] 2023-08-01T19:55:36.753 INFO:teuthology.orchestra.run.smithi101.stdout: } 2023-08-01T19:55:36.753 INFO:teuthology.orchestra.run.smithi101.stdout: }, 2023-08-01T19:55:36.753 INFO:teuthology.orchestra.run.smithi101.stdout: { 2023-08-01T19:55:36.753 INFO:teuthology.orchestra.run.smithi101.stdout: "description": "osd_op(client.4668.0:100253 5.f 5:f7bbce05:::benchmark_data_smithi006_114134_object100252:head [set-alloc-hint object_size 65536 write_size 65536,write 0~65536] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e37)", 2023-08-01T19:55:36.753 INFO:teuthology.orchestra.run.smithi101.stdout: "initiated_at": "2023-08-01T19:55:05.156562+0000", 2023-08-01T19:55:36.753 INFO:teuthology.orchestra.run.smithi101.stdout: "age": 31.484451590999999, 2023-08-01T19:55:36.753 INFO:teuthology.orchestra.run.smithi101.stdout: "duration": 0.068677503000000001, 2023-08-01T19:55:36.753 INFO:teuthology.orchestra.run.smithi101.stdout: "type_data": { 2023-08-01T19:55:36.754 INFO:teuthology.orchestra.run.smithi101.stdout: "flag_point": "commit sent; apply or cleanup", 2023-08-01T19:55:36.754 INFO:teuthology.orchestra.run.smithi101.stdout: "client_info": { 2023-08-01T19:55:36.754 INFO:teuthology.orchestra.run.smithi101.stdout: "client": "client.4668", 2023-08-01T19:55:36.754 INFO:teuthology.orchestra.run.smithi101.stdout: "client_addr": "172.21.15.6:0/1709472247", 2023-08-01T19:55:36.754 INFO:teuthology.orchestra.run.smithi101.stdout: "tid": 100253 2023-08-01T19:55:36.754 INFO:teuthology.orchestra.run.smithi101.stdout: }, 2023-08-01T19:55:36.754 INFO:teuthology.orchestra.run.smithi101.stdout: "events": [ 2023-08-01T19:55:36.755 INFO:teuthology.orchestra.run.smithi101.stdout: { 2023-08-01T19:55:36.755 INFO:teuthology.orchestra.run.smithi101.stdout: "event": "initiated", 2023-08-01T19:55:36.755 INFO:teuthology.orchestra.run.smithi101.stdout: "time": "2023-08-01T19:55:05.156562+0000", 2023-08-01T19:55:36.755 INFO:teuthology.orchestra.run.smithi101.stdout: "duration": 0 2023-08-01T19:55:36.755 INFO:teuthology.orchestra.run.smithi101.stdout: }, 2023-08-01T19:55:36.755 INFO:teuthology.orchestra.run.smithi101.stdout: { 2023-08-01T19:55:36.755 INFO:teuthology.orchestra.run.smithi101.stdout: "event": "throttled", 2023-08-01T19:55:36.755 INFO:teuthology.orchestra.run.smithi101.stdout: "time": "2023-08-01T19:55:05.156562+0000", 2023-08-01T19:55:36.756 INFO:teuthology.orchestra.run.smithi101.stdout: "duration": 0 2023-08-01T19:55:36.756 INFO:teuthology.orchestra.run.smithi101.stdout: }, 2023-08-01T19:55:36.756 INFO:teuthology.orchestra.run.smithi101.stdout: { 2023-08-01T19:55:36.756 INFO:teuthology.orchestra.run.smithi101.stdout: "event": "header_read", 2023-08-01T19:55:36.756 INFO:teuthology.orchestra.run.smithi101.stdout: "time": "2023-08-01T19:55:05.156561+0000", 2023-08-01T19:55:36.756 INFO:teuthology.orchestra.run.smithi101.stdout: "duration": 4294967295.999999 2023-08-01T19:55:36.757 INFO:teuthology.orchestra.run.smithi101.stdout: }, 2023-08-01T19:55:36.757 INFO:teuthology.orchestra.run.smithi101.stdout: { 2023-08-01T19:55:36.757 INFO:teuthology.orchestra.run.smithi101.stdout: "event": "all_read", 2023-08-01T19:55:36.757 INFO:teuthology.orchestra.run.smithi101.stdout: "time": "2023-08-01T19:55:05.156655+0000", 2023-08-01T19:55:36.757 INFO:teuthology.orchestra.run.smithi101.stdout: "duration": 9.4018999999999995e-05 2023-08-01T19:55:36.757 INFO:teuthology.orchestra.run.smithi101.stdout: }, 2023-08-01T19:55:36.757 INFO:teuthology.orchestra.run.smithi101.stdout: { 2023-08-01T19:55:36.758 INFO:teuthology.orchestra.run.smithi101.stdout: "event": "dispatched", 2023-08-01T19:55:36.758 INFO:teuthology.orchestra.run.smithi101.stdout: "time": "2023-08-01T19:55:05.156664+0000", 2023-08-01T19:55:36.758 INFO:teuthology.orchestra.run.smithi101.stdout: "duration": 9.4970000000000007e-06 2023-08-01T19:55:36.758 INFO:teuthology.orchestra.run.smithi101.stdout: }, 2023-08-01T19:55:36.758 INFO:teuthology.orchestra.run.smithi101.stdout: { 2023-08-01T19:55:36.758 INFO:teuthology.orchestra.run.smithi101.stdout: "event": "queued_for_pg", 2023-08-01T19:55:36.759 INFO:teuthology.orchestra.run.smithi101.stdout: "time": "2023-08-01T19:55:05.156671+0000", 2023-08-01T19:55:36.759 INFO:teuthology.orchestra.run.smithi101.stdout: "duration": 6.1929999999999998e-06 2023-08-01T19:55:36.759 INFO:teuthology.orchestra.run.smithi101.stdout: }, 2023-08-01T19:55:36.759 INFO:teuthology.orchestra.run.smithi101.stdout: { 2023-08-01T19:55:36.759 INFO:teuthology.orchestra.run.smithi101.stdout: "event": "reached_pg", 2023-08-01T19:55:36.759 INFO:teuthology.orchestra.run.smithi101.stdout: "time": "2023-08-01T19:55:05.156742+0000", 2023-08-01T19:55:36.759 INFO:teuthology.orchestra.run.smithi101.stdout: "duration": 7.1181999999999997e-05 2023-08-01T19:55:36.760 INFO:teuthology.orchestra.run.smithi101.stdout: }, 2023-08-01T19:55:36.760 INFO:teuthology.orchestra.run.smithi101.stdout: { 2023-08-01T19:55:36.760 INFO:teuthology.orchestra.run.smithi101.stdout: "event": "started", 2023-08-01T19:55:36.760 INFO:teuthology.orchestra.run.smithi101.stdout: "time": "2023-08-01T19:55:05.156839+0000", 2023-08-01T19:55:36.760 INFO:teuthology.orchestra.run.smithi101.stdout: "duration": 9.7182000000000006e-05 2023-08-01T19:55:36.760 INFO:teuthology.orchestra.run.smithi101.stdout: }, 2023-08-01T19:55:36.760 INFO:teuthology.orchestra.run.smithi101.stdout: { 2023-08-01T19:55:36.761 INFO:teuthology.orchestra.run.smithi101.stdout: "event": "waiting for subops from 2", 2023-08-01T19:55:36.761 INFO:teuthology.orchestra.run.smithi101.stdout: "time": "2023-08-01T19:55:05.156925+0000", 2023-08-01T19:55:36.761 INFO:teuthology.orchestra.run.smithi101.stdout: "duration": 8.5816000000000006e-05 2023-08-01T19:55:36.761 INFO:teuthology.orchestra.run.smithi101.stdout: }, 2023-08-01T19:55:36.761 INFO:teuthology.orchestra.run.smithi101.stdout: { 2023-08-01T19:55:36.761 INFO:teuthology.orchestra.run.smithi101.stdout: "event": "op_commit", 2023-08-01T19:55:36.761 INFO:teuthology.orchestra.run.smithi101.stdout: "time": "2023-08-01T19:55:05.160082+0000", 2023-08-01T19:55:36.761 INFO:teuthology.orchestra.run.smithi101.stdout: "duration": 0.0031573959999999998 2023-08-01T19:55:36.762 INFO:teuthology.orchestra.run.smithi101.stdout: }, 2023-08-01T19:55:36.762 INFO:teuthology.orchestra.run.smithi101.stdout: { 2023-08-01T19:55:36.762 INFO:teuthology.orchestra.run.smithi101.stdout: "event": "sub_op_commit_rec", 2023-08-01T19:55:36.762 INFO:teuthology.orchestra.run.smithi101.stdout: "time": "2023-08-01T19:55:05.225162+0000", 2023-08-01T19:55:36.762 INFO:teuthology.orchestra.run.smithi101.stdout: "duration": 0.065079466000000002 2023-08-01T19:55:36.762 INFO:teuthology.orchestra.run.smithi101.stdout: }, 2023-08-01T19:55:36.762 INFO:teuthology.orchestra.run.smithi101.stdout: { 2023-08-01T19:55:36.762 INFO:teuthology.orchestra.run.smithi101.stdout: "event": "commit_sent", 2023-08-01T19:55:36.763 INFO:teuthology.orchestra.run.smithi101.stdout: "time": "2023-08-01T19:55:05.225205+0000", 2023-08-01T19:55:36.763 INFO:teuthology.orchestra.run.smithi101.stdout: "duration": 4.3446999999999999e-05 2023-08-01T19:55:36.763 INFO:teuthology.orchestra.run.smithi101.stdout: }, 2023-08-01T19:55:36.763 INFO:teuthology.orchestra.run.smithi101.stdout: { 2023-08-01T19:55:36.763 INFO:teuthology.orchestra.run.smithi101.stdout: "event": "done", 2023-08-01T19:55:36.763 INFO:teuthology.orchestra.run.smithi101.stdout: "time": "2023-08-01T19:55:05.225239+0000", 2023-08-01T19:55:36.763 INFO:teuthology.orchestra.run.smithi101.stdout: "duration": 3.4121000000000001e-05 2023-08-01T19:55:36.763 INFO:teuthology.orchestra.run.smithi101.stdout: } 2023-08-01T19:55:36.764 INFO:teuthology.orchestra.run.smithi101.stdout: ] 2023-08-01T19:55:36.764 INFO:teuthology.orchestra.run.smithi101.stdout: } 2023-08-01T19:55:36.764 INFO:teuthology.orchestra.run.smithi101.stdout: }, 2023-08-01T19:55:36.764 INFO:teuthology.orchestra.run.smithi101.stdout: { 2023-08-01T19:55:36.764 INFO:teuthology.orchestra.run.smithi101.stdout: "description": "osd_op(client.4668.0:100928 5.7 5:e61a7dfa:::benchmark_data_smithi006_114134_object100927:head [set-alloc-hint object_size 65536 write_size 65536,write 0~65536] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e37)", 2023-08-01T19:55:36.764 INFO:teuthology.orchestra.run.smithi101.stdout: "initiated_at": "2023-08-01T19:55:05.564731+0000", 2023-08-01T19:55:36.765 INFO:teuthology.orchestra.run.smithi101.stdout: "age": 31.076282099, 2023-08-01T19:55:36.765 INFO:teuthology.orchestra.run.smithi101.stdout: "duration": 0.064686603999999995, 2023-08-01T19:55:36.765 INFO:teuthology.orchestra.run.smithi101.stdout: "type_data": { 2023-08-01T19:55:36.765 INFO:teuthology.orchestra.run.smithi101.stdout: "flag_point": "commit sent; apply or cleanup", 2023-08-01T19:55:36.765 INFO:teuthology.orchestra.run.smithi101.stdout: "client_info": { 2023-08-01T19:55:36.765 INFO:teuthology.orchestra.run.smithi101.stdout: "client": "client.4668", 2023-08-01T19:55:36.766 INFO:teuthology.orchestra.run.smithi101.stdout: "client_addr": "172.21.15.6:0/1709472247", 2023-08-01T19:55:36.766 INFO:teuthology.orchestra.run.smithi101.stdout: "tid": 100928 2023-08-01T19:55:36.766 INFO:teuthology.orchestra.run.smithi101.stdout: }, 2023-08-01T19:55:36.766 INFO:teuthology.orchestra.run.smithi101.stdout: "events": [ 2023-08-01T19:55:36.766 INFO:teuthology.orchestra.run.smithi101.stdout: { 2023-08-01T19:55:36.766 INFO:teuthology.orchestra.run.smithi101.stdout: "event": "initiated", 2023-08-01T19:55:36.766 INFO:teuthology.orchestra.run.smithi101.stdout: "time": "2023-08-01T19:55:05.564731+0000", 2023-08-01T19:55:36.767 INFO:teuthology.orchestra.run.smithi101.stdout: "duration": 0 2023-08-01T19:55:36.767 INFO:teuthology.orchestra.run.smithi101.stdout: }, 2023-08-01T19:55:36.767 INFO:teuthology.orchestra.run.smithi101.stdout: { 2023-08-01T19:55:36.767 INFO:teuthology.orchestra.run.smithi101.stdout: "event": "throttled", 2023-08-01T19:55:36.768 INFO:teuthology.orchestra.run.smithi101.stdout: "time": "2023-08-01T19:55:05.564731+0000", 2023-08-01T19:55:36.768 INFO:teuthology.orchestra.run.smithi101.stdout: "duration": 0 2023-08-01T19:55:36.768 INFO:teuthology.orchestra.run.smithi101.stdout: }, 2023-08-01T19:55:36.768 INFO:teuthology.orchestra.run.smithi101.stdout: { 2023-08-01T19:55:36.769 INFO:teuthology.orchestra.run.smithi101.stdout: "event": "header_read", 2023-08-01T19:55:36.769 INFO:teuthology.orchestra.run.smithi101.stdout: "time": "2023-08-01T19:55:05.564731+0000", 2023-08-01T19:55:36.769 INFO:teuthology.orchestra.run.smithi101.stdout: "duration": 4294967295.999999 2023-08-01T19:55:36.769 INFO:teuthology.orchestra.run.smithi101.stdout: }, 2023-08-01T19:55:36.769 INFO:teuthology.orchestra.run.smithi101.stdout: { 2023-08-01T19:55:36.770 INFO:teuthology.orchestra.run.smithi101.stdout: "event": "all_read", 2023-08-01T19:55:36.770 INFO:teuthology.orchestra.run.smithi101.stdout: "time": "2023-08-01T19:55:05.564832+0000", 2023-08-01T19:55:36.770 INFO:teuthology.orchestra.run.smithi101.stdout: "duration": 0.000101752 2023-08-01T19:55:36.770 INFO:teuthology.orchestra.run.smithi101.stdout: }, 2023-08-01T19:55:36.771 INFO:teuthology.orchestra.run.smithi101.stdout: { 2023-08-01T19:55:36.771 INFO:teuthology.orchestra.run.smithi101.stdout: "event": "dispatched", 2023-08-01T19:55:36.771 INFO:teuthology.orchestra.run.smithi101.stdout: "time": "2023-08-01T19:55:05.564840+0000", 2023-08-01T19:55:36.771 INFO:teuthology.orchestra.run.smithi101.stdout: "duration": 7.8590000000000005e-06 2023-08-01T19:55:36.771 INFO:teuthology.orchestra.run.smithi101.stdout: }, 2023-08-01T19:55:36.771 INFO:teuthology.orchestra.run.smithi101.stdout: { 2023-08-01T19:55:36.771 INFO:teuthology.orchestra.run.smithi101.stdout: "event": "queued_for_pg", 2023-08-01T19:55:36.771 INFO:teuthology.orchestra.run.smithi101.stdout: "time": "2023-08-01T19:55:05.564845+0000", 2023-08-01T19:55:36.772 INFO:teuthology.orchestra.run.smithi101.stdout: "duration": 4.9189999999999998e-06 2023-08-01T19:55:36.772 INFO:teuthology.orchestra.run.smithi101.stdout: }, 2023-08-01T19:55:36.772 INFO:teuthology.orchestra.run.smithi101.stdout: { 2023-08-01T19:55:36.772 INFO:teuthology.orchestra.run.smithi101.stdout: "event": "reached_pg", 2023-08-01T19:55:36.772 INFO:teuthology.orchestra.run.smithi101.stdout: "time": "2023-08-01T19:55:05.564883+0000", 2023-08-01T19:55:36.772 INFO:teuthology.orchestra.run.smithi101.stdout: "duration": 3.7481999999999998e-05 2023-08-01T19:55:36.772 INFO:teuthology.orchestra.run.smithi101.stdout: }, 2023-08-01T19:55:36.773 INFO:teuthology.orchestra.run.smithi101.stdout: { 2023-08-01T19:55:36.773 INFO:teuthology.orchestra.run.smithi101.stdout: "event": "started", 2023-08-01T19:55:36.773 INFO:teuthology.orchestra.run.smithi101.stdout: "time": "2023-08-01T19:55:05.564968+0000", 2023-08-01T19:55:36.773 INFO:teuthology.orchestra.run.smithi101.stdout: "duration": 8.5494999999999994e-05 2023-08-01T19:55:36.773 INFO:teuthology.orchestra.run.smithi101.stdout: }, 2023-08-01T19:55:36.773 INFO:teuthology.orchestra.run.smithi101.stdout: { 2023-08-01T19:55:36.773 INFO:teuthology.orchestra.run.smithi101.stdout: "event": "waiting for subops from 0", 2023-08-01T19:55:36.773 INFO:teuthology.orchestra.run.smithi101.stdout: "time": "2023-08-01T19:55:05.565062+0000", 2023-08-01T19:55:36.774 INFO:teuthology.orchestra.run.smithi101.stdout: "duration": 9.3478000000000002e-05 2023-08-01T19:55:36.774 INFO:teuthology.orchestra.run.smithi101.stdout: }, 2023-08-01T19:55:36.774 INFO:teuthology.orchestra.run.smithi101.stdout: { 2023-08-01T19:55:36.774 INFO:teuthology.orchestra.run.smithi101.stdout: "event": "op_commit", 2023-08-01T19:55:36.774 INFO:teuthology.orchestra.run.smithi101.stdout: "time": "2023-08-01T19:55:05.572061+0000", 2023-08-01T19:55:36.774 INFO:teuthology.orchestra.run.smithi101.stdout: "duration": 0.0069998250000000003 2023-08-01T19:55:36.774 INFO:teuthology.orchestra.run.smithi101.stdout: }, 2023-08-01T19:55:36.774 INFO:teuthology.orchestra.run.smithi101.stdout: { 2023-08-01T19:55:36.775 INFO:teuthology.orchestra.run.smithi101.stdout: "event": "sub_op_commit_rec", 2023-08-01T19:55:36.775 INFO:teuthology.orchestra.run.smithi101.stdout: "time": "2023-08-01T19:55:05.629362+0000", 2023-08-01T19:55:36.775 INFO:teuthology.orchestra.run.smithi101.stdout: "duration": 0.057300691000000001 2023-08-01T19:55:36.775 INFO:teuthology.orchestra.run.smithi101.stdout: }, 2023-08-01T19:55:36.775 INFO:teuthology.orchestra.run.smithi101.stdout: { 2023-08-01T19:55:36.775 INFO:teuthology.orchestra.run.smithi101.stdout: "event": "commit_sent", 2023-08-01T19:55:36.775 INFO:teuthology.orchestra.run.smithi101.stdout: "time": "2023-08-01T19:55:05.629395+0000", 2023-08-01T19:55:36.776 INFO:teuthology.orchestra.run.smithi101.stdout: "duration": 3.3124000000000003e-05 2023-08-01T19:55:36.776 INFO:teuthology.orchestra.run.smithi101.stdout: }, 2023-08-01T19:55:36.776 INFO:teuthology.orchestra.run.smithi101.stdout: { 2023-08-01T19:55:36.776 INFO:teuthology.orchestra.run.smithi101.stdout: "event": "done", 2023-08-01T19:55:36.776 INFO:teuthology.orchestra.run.smithi101.stdout: "time": "2023-08-01T19:55:05.629418+0000", 2023-08-01T19:55:36.776 INFO:teuthology.orchestra.run.smithi101.stdout: "duration": 2.2697999999999999e-05 2023-08-01T19:55:36.776 INFO:teuthology.orchestra.run.smithi101.stdout: } 2023-08-01T19:55:36.776 INFO:teuthology.orchestra.run.smithi101.stdout: ] 2023-08-01T19:55:36.777 INFO:teuthology.orchestra.run.smithi101.stdout: } 2023-08-01T19:55:36.777 INFO:teuthology.orchestra.run.smithi101.stdout: }, 2023-08-01T19:55:36.777 INFO:teuthology.orchestra.run.smithi101.stdout: { 2023-08-01T19:55:36.777 INFO:teuthology.orchestra.run.smithi101.stdout: "description": "osd_op(client.4668.0:100936 5.1 5:8f4e3576:::benchmark_data_smithi006_114134_object100935:head [set-alloc-hint object_size 65536 write_size 65536,write 0~65536] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e37)", 2023-08-01T19:55:36.777 INFO:teuthology.orchestra.run.smithi101.stdout: "initiated_at": "2023-08-01T19:55:05.567147+0000", 2023-08-01T19:55:36.777 INFO:teuthology.orchestra.run.smithi101.stdout: "age": 31.073866573, 2023-08-01T19:55:36.777 INFO:teuthology.orchestra.run.smithi101.stdout: "duration": 0.063466380000000003, 2023-08-01T19:55:36.777 INFO:teuthology.orchestra.run.smithi101.stdout: "type_data": { 2023-08-01T19:55:36.778 INFO:teuthology.orchestra.run.smithi101.stdout: "flag_point": "commit sent; apply or cleanup", 2023-08-01T19:55:36.778 INFO:teuthology.orchestra.run.smithi101.stdout: "client_info": { 2023-08-01T19:55:36.778 INFO:teuthology.orchestra.run.smithi101.stdout: "client": "client.4668", 2023-08-01T19:55:36.778 INFO:teuthology.orchestra.run.smithi101.stdout: "client_addr": "172.21.15.6:0/1709472247", 2023-08-01T19:55:36.778 INFO:teuthology.orchestra.run.smithi101.stdout: "tid": 100936 2023-08-01T19:55:36.778 INFO:teuthology.orchestra.run.smithi101.stdout: }, 2023-08-01T19:55:36.778 INFO:teuthology.orchestra.run.smithi101.stdout: "events": [ 2023-08-01T19:55:36.778 INFO:teuthology.orchestra.run.smithi101.stdout: { 2023-08-01T19:55:36.779 INFO:teuthology.orchestra.run.smithi101.stdout: "event": "initiated", 2023-08-01T19:55:36.779 INFO:teuthology.orchestra.run.smithi101.stdout: "time": "2023-08-01T19:55:05.567147+0000", 2023-08-01T19:55:36.779 INFO:teuthology.orchestra.run.smithi101.stdout: "duration": 0 2023-08-01T19:55:36.779 INFO:teuthology.orchestra.run.smithi101.stdout: }, 2023-08-01T19:55:36.779 INFO:teuthology.orchestra.run.smithi101.stdout: { 2023-08-01T19:55:36.779 INFO:teuthology.orchestra.run.smithi101.stdout: "event": "throttled", 2023-08-01T19:55:36.779 INFO:teuthology.orchestra.run.smithi101.stdout: "time": "2023-08-01T19:55:05.567147+0000", 2023-08-01T19:55:36.779 INFO:teuthology.orchestra.run.smithi101.stdout: "duration": 0 2023-08-01T19:55:36.780 INFO:teuthology.orchestra.run.smithi101.stdout: }, 2023-08-01T19:55:36.780 INFO:teuthology.orchestra.run.smithi101.stdout: { 2023-08-01T19:55:36.780 INFO:teuthology.orchestra.run.smithi101.stdout: "event": "header_read", 2023-08-01T19:55:36.780 INFO:teuthology.orchestra.run.smithi101.stdout: "time": "2023-08-01T19:55:05.567146+0000", 2023-08-01T19:55:36.780 INFO:teuthology.orchestra.run.smithi101.stdout: "duration": 4294967295.999999 2023-08-01T19:55:36.780 INFO:teuthology.orchestra.run.smithi101.stdout: }, 2023-08-01T19:55:36.780 INFO:teuthology.orchestra.run.smithi101.stdout: { 2023-08-01T19:55:36.781 INFO:teuthology.orchestra.run.smithi101.stdout: "event": "all_read", 2023-08-01T19:55:36.781 INFO:teuthology.orchestra.run.smithi101.stdout: "time": "2023-08-01T19:55:05.567224+0000", 2023-08-01T19:55:36.781 INFO:teuthology.orchestra.run.smithi101.stdout: "duration": 7.8460000000000004e-05 2023-08-01T19:55:36.781 INFO:teuthology.orchestra.run.smithi101.stdout: }, 2023-08-01T19:55:36.781 INFO:teuthology.orchestra.run.smithi101.stdout: { 2023-08-01T19:55:36.781 INFO:teuthology.orchestra.run.smithi101.stdout: "event": "dispatched", 2023-08-01T19:55:36.781 INFO:teuthology.orchestra.run.smithi101.stdout: "time": "2023-08-01T19:55:05.567234+0000", 2023-08-01T19:55:36.781 INFO:teuthology.orchestra.run.smithi101.stdout: "duration": 9.7110000000000007e-06 2023-08-01T19:55:36.782 INFO:teuthology.orchestra.run.smithi101.stdout: }, 2023-08-01T19:55:36.782 INFO:teuthology.orchestra.run.smithi101.stdout: { 2023-08-01T19:55:36.782 INFO:teuthology.orchestra.run.smithi101.stdout: "event": "queued_for_pg", 2023-08-01T19:55:36.782 INFO:teuthology.orchestra.run.smithi101.stdout: "time": "2023-08-01T19:55:05.567239+0000", 2023-08-01T19:55:36.782 INFO:teuthology.orchestra.run.smithi101.stdout: "duration": 5.237e-06 2023-08-01T19:55:36.782 INFO:teuthology.orchestra.run.smithi101.stdout: }, 2023-08-01T19:55:36.782 INFO:teuthology.orchestra.run.smithi101.stdout: { 2023-08-01T19:55:36.782 INFO:teuthology.orchestra.run.smithi101.stdout: "event": "reached_pg", 2023-08-01T19:55:36.783 INFO:teuthology.orchestra.run.smithi101.stdout: "time": "2023-08-01T19:55:05.567278+0000", 2023-08-01T19:55:36.783 INFO:teuthology.orchestra.run.smithi101.stdout: "duration": 3.9069999999999997e-05 2023-08-01T19:55:36.783 INFO:teuthology.orchestra.run.smithi101.stdout: }, 2023-08-01T19:55:36.783 INFO:teuthology.orchestra.run.smithi101.stdout: { 2023-08-01T19:55:36.783 INFO:teuthology.orchestra.run.smithi101.stdout: "event": "started", 2023-08-01T19:55:36.783 INFO:teuthology.orchestra.run.smithi101.stdout: "time": "2023-08-01T19:55:05.567402+0000", 2023-08-01T19:55:36.783 INFO:teuthology.orchestra.run.smithi101.stdout: "duration": 0.00012348700000000001 2023-08-01T19:55:36.783 INFO:teuthology.orchestra.run.smithi101.stdout: }, 2023-08-01T19:55:36.784 INFO:teuthology.orchestra.run.smithi101.stdout: { 2023-08-01T19:55:36.784 INFO:teuthology.orchestra.run.smithi101.stdout: "event": "waiting for subops from 0", 2023-08-01T19:55:36.784 INFO:teuthology.orchestra.run.smithi101.stdout: "time": "2023-08-01T19:55:05.567558+0000", 2023-08-01T19:55:36.784 INFO:teuthology.orchestra.run.smithi101.stdout: "duration": 0.000156179 2023-08-01T19:55:36.784 INFO:teuthology.orchestra.run.smithi101.stdout: }, 2023-08-01T19:55:36.784 INFO:teuthology.orchestra.run.smithi101.stdout: { 2023-08-01T19:55:36.784 INFO:teuthology.orchestra.run.smithi101.stdout: "event": "op_commit", 2023-08-01T19:55:36.784 INFO:teuthology.orchestra.run.smithi101.stdout: "time": "2023-08-01T19:55:05.573767+0000", 2023-08-01T19:55:36.785 INFO:teuthology.orchestra.run.smithi101.stdout: "duration": 0.0062092409999999999 2023-08-01T19:55:36.785 INFO:teuthology.orchestra.run.smithi101.stdout: }, 2023-08-01T19:55:36.785 INFO:teuthology.orchestra.run.smithi101.stdout: { 2023-08-01T19:55:36.785 INFO:teuthology.orchestra.run.smithi101.stdout: "event": "sub_op_commit_rec", 2023-08-01T19:55:36.785 INFO:teuthology.orchestra.run.smithi101.stdout: "time": "2023-08-01T19:55:05.630531+0000", 2023-08-01T19:55:36.785 INFO:teuthology.orchestra.run.smithi101.stdout: "duration": 0.056763409000000001 2023-08-01T19:55:36.785 INFO:teuthology.orchestra.run.smithi101.stdout: }, 2023-08-01T19:55:36.785 INFO:teuthology.orchestra.run.smithi101.stdout: { 2023-08-01T19:55:36.786 INFO:teuthology.orchestra.run.smithi101.stdout: "event": "commit_sent", 2023-08-01T19:55:36.786 INFO:teuthology.orchestra.run.smithi101.stdout: "time": "2023-08-01T19:55:05.630577+0000", 2023-08-01T19:55:36.786 INFO:teuthology.orchestra.run.smithi101.stdout: "duration": 4.6588000000000002e-05 2023-08-01T19:55:36.786 INFO:teuthology.orchestra.run.smithi101.stdout: }, 2023-08-01T19:55:36.786 INFO:teuthology.orchestra.run.smithi101.stdout: { 2023-08-01T19:55:36.786 INFO:teuthology.orchestra.run.smithi101.stdout: "event": "done", 2023-08-01T19:55:36.786 INFO:teuthology.orchestra.run.smithi101.stdout: "time": "2023-08-01T19:55:05.630613+0000", 2023-08-01T19:55:36.786 INFO:teuthology.orchestra.run.smithi101.stdout: "duration": 3.5802e-05 2023-08-01T19:55:36.787 INFO:teuthology.orchestra.run.smithi101.stdout: } 2023-08-01T19:55:36.787 INFO:teuthology.orchestra.run.smithi101.stdout: ] 2023-08-01T19:55:36.787 INFO:teuthology.orchestra.run.smithi101.stdout: } 2023-08-01T19:55:36.787 INFO:teuthology.orchestra.run.smithi101.stdout: }, 2023-08-01T19:55:36.787 INFO:teuthology.orchestra.run.smithi101.stdout: { 2023-08-01T19:55:36.787 INFO:teuthology.orchestra.run.smithi101.stdout: "description": "osd_op(client.4668.0:100943 5.7 5:e01743fe:::benchmark_data_smithi006_114134_object100942:head [set-alloc-hint object_size 65536 write_size 65536,write 0~65536] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e37)", 2023-08-01T19:55:36.787 INFO:teuthology.orchestra.run.smithi101.stdout: "initiated_at": "2023-08-01T19:55:05.574724+0000", 2023-08-01T19:55:36.787 INFO:teuthology.orchestra.run.smithi101.stdout: "age": 31.066289479999998, 2023-08-01T19:55:36.788 INFO:teuthology.orchestra.run.smithi101.stdout: "duration": 0.058761188999999998, 2023-08-01T19:55:36.788 INFO:teuthology.orchestra.run.smithi101.stdout: "type_data": { 2023-08-01T19:55:36.788 INFO:teuthology.orchestra.run.smithi101.stdout: "flag_point": "commit sent; apply or cleanup", 2023-08-01T19:55:36.788 INFO:teuthology.orchestra.run.smithi101.stdout: "client_info": { 2023-08-01T19:55:36.788 INFO:teuthology.orchestra.run.smithi101.stdout: "client": "client.4668", 2023-08-01T19:55:36.788 INFO:teuthology.orchestra.run.smithi101.stdout: "client_addr": "172.21.15.6:0/1709472247", 2023-08-01T19:55:36.788 INFO:teuthology.orchestra.run.smithi101.stdout: "tid": 100943 2023-08-01T19:55:36.788 INFO:teuthology.orchestra.run.smithi101.stdout: }, 2023-08-01T19:55:36.789 INFO:teuthology.orchestra.run.smithi101.stdout: "events": [ 2023-08-01T19:55:36.789 INFO:teuthology.orchestra.run.smithi101.stdout: { 2023-08-01T19:55:36.789 INFO:teuthology.orchestra.run.smithi101.stdout: "event": "initiated", 2023-08-01T19:55:36.789 INFO:teuthology.orchestra.run.smithi101.stdout: "time": "2023-08-01T19:55:05.574724+0000", 2023-08-01T19:55:36.789 INFO:teuthology.orchestra.run.smithi101.stdout: "duration": 0 2023-08-01T19:55:36.789 INFO:teuthology.orchestra.run.smithi101.stdout: }, 2023-08-01T19:55:36.789 INFO:teuthology.orchestra.run.smithi101.stdout: { 2023-08-01T19:55:36.790 INFO:teuthology.orchestra.run.smithi101.stdout: "event": "throttled", 2023-08-01T19:55:36.790 INFO:teuthology.orchestra.run.smithi101.stdout: "time": "2023-08-01T19:55:05.574724+0000", 2023-08-01T19:55:36.790 INFO:teuthology.orchestra.run.smithi101.stdout: "duration": 0 2023-08-01T19:55:36.790 INFO:teuthology.orchestra.run.smithi101.stdout: }, 2023-08-01T19:55:36.790 INFO:teuthology.orchestra.run.smithi101.stdout: { 2023-08-01T19:55:36.790 INFO:teuthology.orchestra.run.smithi101.stdout: "event": "header_read", 2023-08-01T19:55:36.790 INFO:teuthology.orchestra.run.smithi101.stdout: "time": "2023-08-01T19:55:05.574723+0000", 2023-08-01T19:55:36.790 INFO:teuthology.orchestra.run.smithi101.stdout: "duration": 4294967295.999999 2023-08-01T19:55:36.791 INFO:teuthology.orchestra.run.smithi101.stdout: }, 2023-08-01T19:55:36.791 INFO:teuthology.orchestra.run.smithi101.stdout: { 2023-08-01T19:55:36.791 INFO:teuthology.orchestra.run.smithi101.stdout: "event": "all_read", 2023-08-01T19:55:36.791 INFO:teuthology.orchestra.run.smithi101.stdout: "time": "2023-08-01T19:55:05.574773+0000", 2023-08-01T19:55:36.791 INFO:teuthology.orchestra.run.smithi101.stdout: "duration": 4.9469999999999999e-05 2023-08-01T19:55:36.791 INFO:teuthology.orchestra.run.smithi101.stdout: }, 2023-08-01T19:55:36.791 INFO:teuthology.orchestra.run.smithi101.stdout: { 2023-08-01T19:55:36.791 INFO:teuthology.orchestra.run.smithi101.stdout: "event": "dispatched", 2023-08-01T19:55:36.792 INFO:teuthology.orchestra.run.smithi101.stdout: "time": "2023-08-01T19:55:05.574780+0000", 2023-08-01T19:55:36.792 INFO:teuthology.orchestra.run.smithi101.stdout: "duration": 7.5059999999999998e-06 2023-08-01T19:55:36.792 INFO:teuthology.orchestra.run.smithi101.stdout: }, 2023-08-01T19:55:36.792 INFO:teuthology.orchestra.run.smithi101.stdout: { 2023-08-01T19:55:36.792 INFO:teuthology.orchestra.run.smithi101.stdout: "event": "queued_for_pg", 2023-08-01T19:55:36.792 INFO:teuthology.orchestra.run.smithi101.stdout: "time": "2023-08-01T19:55:05.574784+0000", 2023-08-01T19:55:36.792 INFO:teuthology.orchestra.run.smithi101.stdout: "duration": 3.5540000000000002e-06 2023-08-01T19:55:36.792 INFO:teuthology.orchestra.run.smithi101.stdout: }, 2023-08-01T19:55:36.793 INFO:teuthology.orchestra.run.smithi101.stdout: { 2023-08-01T19:55:36.793 INFO:teuthology.orchestra.run.smithi101.stdout: "event": "reached_pg", 2023-08-01T19:55:36.793 INFO:teuthology.orchestra.run.smithi101.stdout: "time": "2023-08-01T19:55:05.574805+0000", 2023-08-01T19:55:36.793 INFO:teuthology.orchestra.run.smithi101.stdout: "duration": 2.1257999999999999e-05 2023-08-01T19:55:36.793 INFO:teuthology.orchestra.run.smithi101.stdout: }, 2023-08-01T19:55:36.793 INFO:teuthology.orchestra.run.smithi101.stdout: { 2023-08-01T19:55:36.793 INFO:teuthology.orchestra.run.smithi101.stdout: "event": "started", 2023-08-01T19:55:36.793 INFO:teuthology.orchestra.run.smithi101.stdout: "time": "2023-08-01T19:55:05.574886+0000", 2023-08-01T19:55:36.794 INFO:teuthology.orchestra.run.smithi101.stdout: "duration": 8.1545999999999995e-05 2023-08-01T19:55:36.794 INFO:teuthology.orchestra.run.smithi101.stdout: }, 2023-08-01T19:55:36.794 INFO:teuthology.orchestra.run.smithi101.stdout: { 2023-08-01T19:55:36.794 INFO:teuthology.orchestra.run.smithi101.stdout: "event": "waiting for subops from 0", 2023-08-01T19:55:36.794 INFO:teuthology.orchestra.run.smithi101.stdout: "time": "2023-08-01T19:55:05.574973+0000", 2023-08-01T19:55:36.794 INFO:teuthology.orchestra.run.smithi101.stdout: "duration": 8.6998999999999998e-05 2023-08-01T19:55:36.794 INFO:teuthology.orchestra.run.smithi101.stdout: }, 2023-08-01T19:55:36.794 INFO:teuthology.orchestra.run.smithi101.stdout: { 2023-08-01T19:55:36.795 INFO:teuthology.orchestra.run.smithi101.stdout: "event": "op_commit", 2023-08-01T19:55:36.795 INFO:teuthology.orchestra.run.smithi101.stdout: "time": "2023-08-01T19:55:05.581580+0000", 2023-08-01T19:55:36.795 INFO:teuthology.orchestra.run.smithi101.stdout: "duration": 0.0066068790000000004 2023-08-01T19:55:36.795 INFO:teuthology.orchestra.run.smithi101.stdout: }, 2023-08-01T19:55:36.795 INFO:teuthology.orchestra.run.smithi101.stdout: { 2023-08-01T19:55:36.795 INFO:teuthology.orchestra.run.smithi101.stdout: "event": "sub_op_commit_rec", 2023-08-01T19:55:36.795 INFO:teuthology.orchestra.run.smithi101.stdout: "time": "2023-08-01T19:55:05.633422+0000", 2023-08-01T19:55:36.796 INFO:teuthology.orchestra.run.smithi101.stdout: "duration": 0.051841992000000003 2023-08-01T19:55:36.796 INFO:teuthology.orchestra.run.smithi101.stdout: }, 2023-08-01T19:55:36.796 INFO:teuthology.orchestra.run.smithi101.stdout: { 2023-08-01T19:55:36.796 INFO:teuthology.orchestra.run.smithi101.stdout: "event": "commit_sent", 2023-08-01T19:55:36.796 INFO:teuthology.orchestra.run.smithi101.stdout: "time": "2023-08-01T19:55:05.633461+0000", 2023-08-01T19:55:36.796 INFO:teuthology.orchestra.run.smithi101.stdout: "duration": 3.8330000000000001e-05 2023-08-01T19:55:36.796 INFO:teuthology.orchestra.run.smithi101.stdout: }, 2023-08-01T19:55:36.796 INFO:teuthology.orchestra.run.smithi101.stdout: { 2023-08-01T19:55:36.797 INFO:teuthology.orchestra.run.smithi101.stdout: "event": "done", 2023-08-01T19:55:36.797 INFO:teuthology.orchestra.run.smithi101.stdout: "time": "2023-08-01T19:55:05.633485+0000", 2023-08-01T19:55:36.797 INFO:teuthology.orchestra.run.smithi101.stdout: "duration": 2.4451e-05 2023-08-01T19:55:36.797 INFO:teuthology.orchestra.run.smithi101.stdout: } 2023-08-01T19:55:36.797 INFO:teuthology.orchestra.run.smithi101.stdout: ] 2023-08-01T19:55:36.797 INFO:teuthology.orchestra.run.smithi101.stdout: } 2023-08-01T19:55:36.797 INFO:teuthology.orchestra.run.smithi101.stdout: }, 2023-08-01T19:55:36.797 INFO:teuthology.orchestra.run.smithi101.stdout: { 2023-08-01T19:55:36.798 INFO:teuthology.orchestra.run.smithi101.stdout: "description": "osd_op(client.4668.0:107866 5.f 5:ffcbf9c4:::benchmark_data_smithi006_114134_object107865:head [set-alloc-hint object_size 65536 write_size 65536,write 0~65536] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e38)", 2023-08-01T19:55:36.798 INFO:teuthology.orchestra.run.smithi101.stdout: "initiated_at": "2023-08-01T19:55:09.280625+0000", 2023-08-01T19:55:36.798 INFO:teuthology.orchestra.run.smithi101.stdout: "age": 27.360388142000001, 2023-08-01T19:55:36.798 INFO:teuthology.orchestra.run.smithi101.stdout: "duration": 0.069869799999999996, 2023-08-01T19:55:36.798 INFO:teuthology.orchestra.run.smithi101.stdout: "type_data": { 2023-08-01T19:55:36.798 INFO:teuthology.orchestra.run.smithi101.stdout: "flag_point": "commit sent; apply or cleanup", 2023-08-01T19:55:36.799 INFO:teuthology.orchestra.run.smithi101.stdout: "client_info": { 2023-08-01T19:55:36.799 INFO:teuthology.orchestra.run.smithi101.stdout: "client": "client.4668", 2023-08-01T19:55:36.799 INFO:teuthology.orchestra.run.smithi101.stdout: "client_addr": "172.21.15.6:0/1709472247", 2023-08-01T19:55:36.799 INFO:teuthology.orchestra.run.smithi101.stdout: "tid": 107866 2023-08-01T19:55:36.799 INFO:teuthology.orchestra.run.smithi101.stdout: }, 2023-08-01T19:55:36.800 INFO:teuthology.orchestra.run.smithi101.stdout: "events": [ 2023-08-01T19:55:36.800 INFO:teuthology.orchestra.run.smithi101.stdout: { 2023-08-01T19:55:36.800 INFO:teuthology.orchestra.run.smithi101.stdout: "event": "initiated", 2023-08-01T19:55:36.800 INFO:teuthology.orchestra.run.smithi101.stdout: "time": "2023-08-01T19:55:09.280625+0000", 2023-08-01T19:55:36.800 INFO:teuthology.orchestra.run.smithi101.stdout: "duration": 0 2023-08-01T19:55:36.800 INFO:teuthology.orchestra.run.smithi101.stdout: }, 2023-08-01T19:55:36.800 INFO:teuthology.orchestra.run.smithi101.stdout: { 2023-08-01T19:55:36.801 INFO:teuthology.orchestra.run.smithi101.stdout: "event": "throttled", 2023-08-01T19:55:36.801 INFO:teuthology.orchestra.run.smithi101.stdout: "time": "2023-08-01T19:55:09.280625+0000", 2023-08-01T19:55:36.801 INFO:teuthology.orchestra.run.smithi101.stdout: "duration": 0 2023-08-01T19:55:36.801 INFO:teuthology.orchestra.run.smithi101.stdout: }, 2023-08-01T19:55:36.801 INFO:teuthology.orchestra.run.smithi101.stdout: { 2023-08-01T19:55:36.801 INFO:teuthology.orchestra.run.smithi101.stdout: "event": "header_read", 2023-08-01T19:55:36.801 INFO:teuthology.orchestra.run.smithi101.stdout: "time": "2023-08-01T19:55:09.280624+0000", 2023-08-01T19:55:36.801 INFO:teuthology.orchestra.run.smithi101.stdout: "duration": 4294967295.999999 2023-08-01T19:55:36.802 INFO:teuthology.orchestra.run.smithi101.stdout: }, 2023-08-01T19:55:36.802 INFO:teuthology.orchestra.run.smithi101.stdout: { 2023-08-01T19:55:36.802 INFO:teuthology.orchestra.run.smithi101.stdout: "event": "all_read", 2023-08-01T19:55:36.802 INFO:teuthology.orchestra.run.smithi101.stdout: "time": "2023-08-01T19:55:09.280648+0000", 2023-08-01T19:55:36.802 INFO:teuthology.orchestra.run.smithi101.stdout: "duration": 2.3521999999999999e-05 2023-08-01T19:55:36.802 INFO:teuthology.orchestra.run.smithi101.stdout: }, 2023-08-01T19:55:36.802 INFO:teuthology.orchestra.run.smithi101.stdout: { 2023-08-01T19:55:36.802 INFO:teuthology.orchestra.run.smithi101.stdout: "event": "dispatched", 2023-08-01T19:55:36.803 INFO:teuthology.orchestra.run.smithi101.stdout: "time": "2023-08-01T19:55:09.280658+0000", 2023-08-01T19:55:36.803 INFO:teuthology.orchestra.run.smithi101.stdout: "duration": 9.8660000000000001e-06 2023-08-01T19:55:36.803 INFO:teuthology.orchestra.run.smithi101.stdout: }, 2023-08-01T19:55:36.803 INFO:teuthology.orchestra.run.smithi101.stdout: { 2023-08-01T19:55:36.803 INFO:teuthology.orchestra.run.smithi101.stdout: "event": "queued_for_pg", 2023-08-01T19:55:36.803 INFO:teuthology.orchestra.run.smithi101.stdout: "time": "2023-08-01T19:55:09.280663+0000", 2023-08-01T19:55:36.803 INFO:teuthology.orchestra.run.smithi101.stdout: "duration": 4.8369999999999996e-06 2023-08-01T19:55:36.803 INFO:teuthology.orchestra.run.smithi101.stdout: }, 2023-08-01T19:55:36.804 INFO:teuthology.orchestra.run.smithi101.stdout: { 2023-08-01T19:55:36.804 INFO:teuthology.orchestra.run.smithi101.stdout: "event": "reached_pg", 2023-08-01T19:55:36.804 INFO:teuthology.orchestra.run.smithi101.stdout: "time": "2023-08-01T19:55:09.280690+0000", 2023-08-01T19:55:36.804 INFO:teuthology.orchestra.run.smithi101.stdout: "duration": 2.7534000000000001e-05 2023-08-01T19:55:36.804 INFO:teuthology.orchestra.run.smithi101.stdout: }, 2023-08-01T19:55:36.804 INFO:teuthology.orchestra.run.smithi101.stdout: { 2023-08-01T19:55:36.804 INFO:teuthology.orchestra.run.smithi101.stdout: "event": "started", 2023-08-01T19:55:36.805 INFO:teuthology.orchestra.run.smithi101.stdout: "time": "2023-08-01T19:55:09.280825+0000", 2023-08-01T19:55:36.805 INFO:teuthology.orchestra.run.smithi101.stdout: "duration": 0.000135399 2023-08-01T19:55:36.805 INFO:teuthology.orchestra.run.smithi101.stdout: }, 2023-08-01T19:55:36.805 INFO:teuthology.orchestra.run.smithi101.stdout: { 2023-08-01T19:55:36.805 INFO:teuthology.orchestra.run.smithi101.stdout: "event": "waiting for subops from 2", 2023-08-01T19:55:36.805 INFO:teuthology.orchestra.run.smithi101.stdout: "time": "2023-08-01T19:55:09.280929+0000", 2023-08-01T19:55:36.805 INFO:teuthology.orchestra.run.smithi101.stdout: "duration": 0.000103328 2023-08-01T19:55:36.805 INFO:teuthology.orchestra.run.smithi101.stdout: }, 2023-08-01T19:55:36.806 INFO:teuthology.orchestra.run.smithi101.stdout: { 2023-08-01T19:55:36.806 INFO:teuthology.orchestra.run.smithi101.stdout: "event": "sub_op_commit_rec", 2023-08-01T19:55:36.806 INFO:teuthology.orchestra.run.smithi101.stdout: "time": "2023-08-01T19:55:09.348321+0000", 2023-08-01T19:55:36.806 INFO:teuthology.orchestra.run.smithi101.stdout: "duration": 0.067392176999999998 2023-08-01T19:55:36.806 INFO:teuthology.orchestra.run.smithi101.stdout: }, 2023-08-01T19:55:36.806 INFO:teuthology.orchestra.run.smithi101.stdout: { 2023-08-01T19:55:36.806 INFO:teuthology.orchestra.run.smithi101.stdout: "event": "op_commit", 2023-08-01T19:55:36.806 INFO:teuthology.orchestra.run.smithi101.stdout: "time": "2023-08-01T19:55:09.350431+0000", 2023-08-01T19:55:36.807 INFO:teuthology.orchestra.run.smithi101.stdout: "duration": 0.0021096980000000001 2023-08-01T19:55:36.807 INFO:teuthology.orchestra.run.smithi101.stdout: }, 2023-08-01T19:55:36.807 INFO:teuthology.orchestra.run.smithi101.stdout: { 2023-08-01T19:55:36.807 INFO:teuthology.orchestra.run.smithi101.stdout: "event": "commit_sent", 2023-08-01T19:55:36.807 INFO:teuthology.orchestra.run.smithi101.stdout: "time": "2023-08-01T19:55:09.350469+0000", 2023-08-01T19:55:36.807 INFO:teuthology.orchestra.run.smithi101.stdout: "duration": 3.8625999999999999e-05 2023-08-01T19:55:36.807 INFO:teuthology.orchestra.run.smithi101.stdout: }, 2023-08-01T19:55:36.807 INFO:teuthology.orchestra.run.smithi101.stdout: { 2023-08-01T19:55:36.808 INFO:teuthology.orchestra.run.smithi101.stdout: "event": "done", 2023-08-01T19:55:36.808 INFO:teuthology.orchestra.run.smithi101.stdout: "time": "2023-08-01T19:55:09.350495+0000", 2023-08-01T19:55:36.808 INFO:teuthology.orchestra.run.smithi101.stdout: "duration": 2.5698999999999999e-05 2023-08-01T19:55:36.808 INFO:teuthology.orchestra.run.smithi101.stdout: } 2023-08-01T19:55:36.808 INFO:teuthology.orchestra.run.smithi101.stdout: ] 2023-08-01T19:55:36.808 INFO:teuthology.orchestra.run.smithi101.stdout: } 2023-08-01T19:55:36.808 INFO:teuthology.orchestra.run.smithi101.stdout: }, 2023-08-01T19:55:36.809 INFO:teuthology.orchestra.run.smithi101.stdout: { 2023-08-01T19:55:36.809 INFO:teuthology.orchestra.run.smithi101.stdout: "description": "osd_op(client.4668.0:107867 5.f 5:ff29bbf7:::benchmark_data_smithi006_114134_object107866:head [set-alloc-hint object_size 65536 write_size 65536,write 0~65536] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e38)", 2023-08-01T19:55:36.809 INFO:teuthology.orchestra.run.smithi101.stdout: "initiated_at": "2023-08-01T19:55:09.280670+0000", 2023-08-01T19:55:36.809 INFO:teuthology.orchestra.run.smithi101.stdout: "age": 27.360343208, 2023-08-01T19:55:36.809 INFO:teuthology.orchestra.run.smithi101.stdout: "duration": 0.069898092999999994, 2023-08-01T19:55:36.809 INFO:teuthology.orchestra.run.smithi101.stdout: "type_data": { 2023-08-01T19:55:36.809 INFO:teuthology.orchestra.run.smithi101.stdout: "flag_point": "commit sent; apply or cleanup", 2023-08-01T19:55:36.810 INFO:teuthology.orchestra.run.smithi101.stdout: "client_info": { 2023-08-01T19:55:36.810 INFO:teuthology.orchestra.run.smithi101.stdout: "client": "client.4668", 2023-08-01T19:55:36.810 INFO:teuthology.orchestra.run.smithi101.stdout: "client_addr": "172.21.15.6:0/1709472247", 2023-08-01T19:55:36.810 INFO:teuthology.orchestra.run.smithi101.stdout: "tid": 107867 2023-08-01T19:55:36.810 INFO:teuthology.orchestra.run.smithi101.stdout: }, 2023-08-01T19:55:36.810 INFO:teuthology.orchestra.run.smithi101.stdout: "events": [ 2023-08-01T19:55:36.810 INFO:teuthology.orchestra.run.smithi101.stdout: { 2023-08-01T19:55:36.810 INFO:teuthology.orchestra.run.smithi101.stdout: "event": "initiated", 2023-08-01T19:55:36.811 INFO:teuthology.orchestra.run.smithi101.stdout: "time": "2023-08-01T19:55:09.280670+0000", 2023-08-01T19:55:36.811 INFO:teuthology.orchestra.run.smithi101.stdout: "duration": 0 2023-08-01T19:55:36.811 INFO:teuthology.orchestra.run.smithi101.stdout: }, 2023-08-01T19:55:36.811 INFO:teuthology.orchestra.run.smithi101.stdout: { 2023-08-01T19:55:36.811 INFO:teuthology.orchestra.run.smithi101.stdout: "event": "throttled", 2023-08-01T19:55:36.811 INFO:teuthology.orchestra.run.smithi101.stdout: "time": "2023-08-01T19:55:09.280670+0000", 2023-08-01T19:55:36.811 INFO:teuthology.orchestra.run.smithi101.stdout: "duration": 0 2023-08-01T19:55:36.811 INFO:teuthology.orchestra.run.smithi101.stdout: }, 2023-08-01T19:55:36.812 INFO:teuthology.orchestra.run.smithi101.stdout: { 2023-08-01T19:55:36.812 INFO:teuthology.orchestra.run.smithi101.stdout: "event": "header_read", 2023-08-01T19:55:36.812 INFO:teuthology.orchestra.run.smithi101.stdout: "time": "2023-08-01T19:55:09.280670+0000", 2023-08-01T19:55:36.812 INFO:teuthology.orchestra.run.smithi101.stdout: "duration": 4294967295.9999995 2023-08-01T19:55:36.812 INFO:teuthology.orchestra.run.smithi101.stdout: }, 2023-08-01T19:55:36.812 INFO:teuthology.orchestra.run.smithi101.stdout: { 2023-08-01T19:55:36.812 INFO:teuthology.orchestra.run.smithi101.stdout: "event": "all_read", 2023-08-01T19:55:36.812 INFO:teuthology.orchestra.run.smithi101.stdout: "time": "2023-08-01T19:55:09.280690+0000", 2023-08-01T19:55:36.813 INFO:teuthology.orchestra.run.smithi101.stdout: "duration": 2.0526e-05 2023-08-01T19:55:36.813 INFO:teuthology.orchestra.run.smithi101.stdout: }, 2023-08-01T19:55:36.813 INFO:teuthology.orchestra.run.smithi101.stdout: { 2023-08-01T19:55:36.813 INFO:teuthology.orchestra.run.smithi101.stdout: "event": "dispatched", 2023-08-01T19:55:36.813 INFO:teuthology.orchestra.run.smithi101.stdout: "time": "2023-08-01T19:55:09.280695+0000", 2023-08-01T19:55:36.813 INFO:teuthology.orchestra.run.smithi101.stdout: "duration": 4.5140000000000003e-06 2023-08-01T19:55:36.813 INFO:teuthology.orchestra.run.smithi101.stdout: }, 2023-08-01T19:55:36.813 INFO:teuthology.orchestra.run.smithi101.stdout: { 2023-08-01T19:55:36.814 INFO:teuthology.orchestra.run.smithi101.stdout: "event": "queued_for_pg", 2023-08-01T19:55:36.814 INFO:teuthology.orchestra.run.smithi101.stdout: "time": "2023-08-01T19:55:09.280697+0000", 2023-08-01T19:55:36.814 INFO:teuthology.orchestra.run.smithi101.stdout: "duration": 2.6290000000000002e-06 2023-08-01T19:55:36.814 INFO:teuthology.orchestra.run.smithi101.stdout: }, 2023-08-01T19:55:36.814 INFO:teuthology.orchestra.run.smithi101.stdout: { 2023-08-01T19:55:36.814 INFO:teuthology.orchestra.run.smithi101.stdout: "event": "reached_pg", 2023-08-01T19:55:36.814 INFO:teuthology.orchestra.run.smithi101.stdout: "time": "2023-08-01T19:55:09.282392+0000", 2023-08-01T19:55:36.815 INFO:teuthology.orchestra.run.smithi101.stdout: "duration": 0.0016948709999999999 2023-08-01T19:55:36.815 INFO:teuthology.orchestra.run.smithi101.stdout: }, 2023-08-01T19:55:36.815 INFO:teuthology.orchestra.run.smithi101.stdout: { 2023-08-01T19:55:36.815 INFO:teuthology.orchestra.run.smithi101.stdout: "event": "started", 2023-08-01T19:55:36.815 INFO:teuthology.orchestra.run.smithi101.stdout: "time": "2023-08-01T19:55:09.282514+0000", 2023-08-01T19:55:36.816 INFO:teuthology.orchestra.run.smithi101.stdout: "duration": 0.000121839 2023-08-01T19:55:36.816 INFO:teuthology.orchestra.run.smithi101.stdout: }, 2023-08-01T19:55:36.816 INFO:teuthology.orchestra.run.smithi101.stdout: { 2023-08-01T19:55:36.816 INFO:teuthology.orchestra.run.smithi101.stdout: "event": "waiting for subops from 2", 2023-08-01T19:55:36.816 INFO:teuthology.orchestra.run.smithi101.stdout: "time": "2023-08-01T19:55:09.282664+0000", 2023-08-01T19:55:36.816 INFO:teuthology.orchestra.run.smithi101.stdout: "duration": 0.00014968699999999999 2023-08-01T19:55:36.816 INFO:teuthology.orchestra.run.smithi101.stdout: }, 2023-08-01T19:55:36.816 INFO:teuthology.orchestra.run.smithi101.stdout: { 2023-08-01T19:55:36.817 INFO:teuthology.orchestra.run.smithi101.stdout: "event": "sub_op_commit_rec", 2023-08-01T19:55:36.817 INFO:teuthology.orchestra.run.smithi101.stdout: "time": "2023-08-01T19:55:09.348344+0000", 2023-08-01T19:55:36.817 INFO:teuthology.orchestra.run.smithi101.stdout: "duration": 0.065680247999999997 2023-08-01T19:55:36.817 INFO:teuthology.orchestra.run.smithi101.stdout: }, 2023-08-01T19:55:36.817 INFO:teuthology.orchestra.run.smithi101.stdout: { 2023-08-01T19:55:36.817 INFO:teuthology.orchestra.run.smithi101.stdout: "event": "op_commit", 2023-08-01T19:55:36.817 INFO:teuthology.orchestra.run.smithi101.stdout: "time": "2023-08-01T19:55:09.350502+0000", 2023-08-01T19:55:36.817 INFO:teuthology.orchestra.run.smithi101.stdout: "duration": 0.0021578140000000001 2023-08-01T19:55:36.818 INFO:teuthology.orchestra.run.smithi101.stdout: }, 2023-08-01T19:55:36.818 INFO:teuthology.orchestra.run.smithi101.stdout: { 2023-08-01T19:55:36.818 INFO:teuthology.orchestra.run.smithi101.stdout: "event": "commit_sent", 2023-08-01T19:55:36.818 INFO:teuthology.orchestra.run.smithi101.stdout: "time": "2023-08-01T19:55:09.350529+0000", 2023-08-01T19:55:36.818 INFO:teuthology.orchestra.run.smithi101.stdout: "duration": 2.6838e-05 2023-08-01T19:55:36.818 INFO:teuthology.orchestra.run.smithi101.stdout: }, 2023-08-01T19:55:36.818 INFO:teuthology.orchestra.run.smithi101.stdout: { 2023-08-01T19:55:36.818 INFO:teuthology.orchestra.run.smithi101.stdout: "event": "done", 2023-08-01T19:55:36.819 INFO:teuthology.orchestra.run.smithi101.stdout: "time": "2023-08-01T19:55:09.350568+0000", 2023-08-01T19:55:36.819 INFO:teuthology.orchestra.run.smithi101.stdout: "duration": 3.9477000000000002e-05 2023-08-01T19:55:36.819 INFO:teuthology.orchestra.run.smithi101.stdout: } 2023-08-01T19:55:36.819 INFO:teuthology.orchestra.run.smithi101.stdout: ] 2023-08-01T19:55:36.819 INFO:teuthology.orchestra.run.smithi101.stdout: } 2023-08-01T19:55:36.819 INFO:teuthology.orchestra.run.smithi101.stdout: }, 2023-08-01T19:55:36.819 INFO:teuthology.orchestra.run.smithi101.stdout: { 2023-08-01T19:55:36.820 INFO:teuthology.orchestra.run.smithi101.stdout: "description": "osd_repop(client.4668.0:107863 5.3 e38/19 5:cbdd875a:::benchmark_data_smithi006_114134_object107862:head v 38'6829, mlcod=38'6826)", 2023-08-01T19:55:36.820 INFO:teuthology.orchestra.run.smithi101.stdout: "initiated_at": "2023-08-01T19:55:09.280747+0000", 2023-08-01T19:55:36.820 INFO:teuthology.orchestra.run.smithi101.stdout: "age": 27.360266258999999, 2023-08-01T19:55:36.820 INFO:teuthology.orchestra.run.smithi101.stdout: "duration": 0.069343305999999993, 2023-08-01T19:55:36.820 INFO:teuthology.orchestra.run.smithi101.stdout: "type_data": { 2023-08-01T19:55:36.820 INFO:teuthology.orchestra.run.smithi101.stdout: "flag_point": "commit sent; apply or cleanup", 2023-08-01T19:55:36.820 INFO:teuthology.orchestra.run.smithi101.stdout: "events": [ 2023-08-01T19:55:36.820 INFO:teuthology.orchestra.run.smithi101.stdout: { 2023-08-01T19:55:36.821 INFO:teuthology.orchestra.run.smithi101.stdout: "event": "initiated", 2023-08-01T19:55:36.821 INFO:teuthology.orchestra.run.smithi101.stdout: "time": "2023-08-01T19:55:09.280747+0000", 2023-08-01T19:55:36.821 INFO:teuthology.orchestra.run.smithi101.stdout: "duration": 0 2023-08-01T19:55:36.821 INFO:teuthology.orchestra.run.smithi101.stdout: }, 2023-08-01T19:55:36.821 INFO:teuthology.orchestra.run.smithi101.stdout: { 2023-08-01T19:55:36.821 INFO:teuthology.orchestra.run.smithi101.stdout: "event": "throttled", 2023-08-01T19:55:36.821 INFO:teuthology.orchestra.run.smithi101.stdout: "time": "2023-08-01T19:55:09.280747+0000", 2023-08-01T19:55:36.821 INFO:teuthology.orchestra.run.smithi101.stdout: "duration": 0 2023-08-01T19:55:36.822 INFO:teuthology.orchestra.run.smithi101.stdout: }, 2023-08-01T19:55:36.822 INFO:teuthology.orchestra.run.smithi101.stdout: { 2023-08-01T19:55:36.822 INFO:teuthology.orchestra.run.smithi101.stdout: "event": "header_read", 2023-08-01T19:55:36.822 INFO:teuthology.orchestra.run.smithi101.stdout: "time": "2023-08-01T19:55:09.280746+0000", 2023-08-01T19:55:36.822 INFO:teuthology.orchestra.run.smithi101.stdout: "duration": 4294967295.9999995 2023-08-01T19:55:36.822 INFO:teuthology.orchestra.run.smithi101.stdout: }, 2023-08-01T19:55:36.822 INFO:teuthology.orchestra.run.smithi101.stdout: { 2023-08-01T19:55:36.822 INFO:teuthology.orchestra.run.smithi101.stdout: "event": "all_read", 2023-08-01T19:55:36.823 INFO:teuthology.orchestra.run.smithi101.stdout: "time": "2023-08-01T19:55:09.280798+0000", 2023-08-01T19:55:36.823 INFO:teuthology.orchestra.run.smithi101.stdout: "duration": 5.1706000000000003e-05 2023-08-01T19:55:36.823 INFO:teuthology.orchestra.run.smithi101.stdout: }, 2023-08-01T19:55:36.823 INFO:teuthology.orchestra.run.smithi101.stdout: { 2023-08-01T19:55:36.823 INFO:teuthology.orchestra.run.smithi101.stdout: "event": "dispatched", 2023-08-01T19:55:36.823 INFO:teuthology.orchestra.run.smithi101.stdout: "time": "2023-08-01T19:55:09.280807+0000", 2023-08-01T19:55:36.823 INFO:teuthology.orchestra.run.smithi101.stdout: "duration": 8.4889999999999995e-06 2023-08-01T19:55:36.824 INFO:teuthology.orchestra.run.smithi101.stdout: }, 2023-08-01T19:55:36.824 INFO:teuthology.orchestra.run.smithi101.stdout: { 2023-08-01T19:55:36.824 INFO:teuthology.orchestra.run.smithi101.stdout: "event": "queued_for_pg", 2023-08-01T19:55:36.824 INFO:teuthology.orchestra.run.smithi101.stdout: "time": "2023-08-01T19:55:09.280812+0000", 2023-08-01T19:55:36.824 INFO:teuthology.orchestra.run.smithi101.stdout: "duration": 5.2120000000000002e-06 2023-08-01T19:55:36.824 INFO:teuthology.orchestra.run.smithi101.stdout: }, 2023-08-01T19:55:36.824 INFO:teuthology.orchestra.run.smithi101.stdout: { 2023-08-01T19:55:36.825 INFO:teuthology.orchestra.run.smithi101.stdout: "event": "reached_pg", 2023-08-01T19:55:36.825 INFO:teuthology.orchestra.run.smithi101.stdout: "time": "2023-08-01T19:55:09.280843+0000", 2023-08-01T19:55:36.825 INFO:teuthology.orchestra.run.smithi101.stdout: "duration": 3.1406999999999999e-05 2023-08-01T19:55:36.825 INFO:teuthology.orchestra.run.smithi101.stdout: }, 2023-08-01T19:55:36.825 INFO:teuthology.orchestra.run.smithi101.stdout: { 2023-08-01T19:55:36.825 INFO:teuthology.orchestra.run.smithi101.stdout: "event": "started", 2023-08-01T19:55:36.825 INFO:teuthology.orchestra.run.smithi101.stdout: "time": "2023-08-01T19:55:09.280860+0000", 2023-08-01T19:55:36.825 INFO:teuthology.orchestra.run.smithi101.stdout: "duration": 1.6283999999999999e-05 2023-08-01T19:55:36.826 INFO:teuthology.orchestra.run.smithi101.stdout: }, 2023-08-01T19:55:36.826 INFO:teuthology.orchestra.run.smithi101.stdout: { 2023-08-01T19:55:36.826 INFO:teuthology.orchestra.run.smithi101.stdout: "event": "commit_sent", 2023-08-01T19:55:36.826 INFO:teuthology.orchestra.run.smithi101.stdout: "time": "2023-08-01T19:55:09.350059+0000", 2023-08-01T19:55:36.826 INFO:teuthology.orchestra.run.smithi101.stdout: "duration": 0.069199094000000003 2023-08-01T19:55:36.826 INFO:teuthology.orchestra.run.smithi101.stdout: }, 2023-08-01T19:55:36.826 INFO:teuthology.orchestra.run.smithi101.stdout: { 2023-08-01T19:55:36.826 INFO:teuthology.orchestra.run.smithi101.stdout: "event": "done", 2023-08-01T19:55:36.827 INFO:teuthology.orchestra.run.smithi101.stdout: "time": "2023-08-01T19:55:09.350090+0000", 2023-08-01T19:55:36.827 INFO:teuthology.orchestra.run.smithi101.stdout: "duration": 3.1736000000000002e-05 2023-08-01T19:55:36.827 INFO:teuthology.orchestra.run.smithi101.stdout: } 2023-08-01T19:55:36.827 INFO:teuthology.orchestra.run.smithi101.stdout: ] 2023-08-01T19:55:36.827 INFO:teuthology.orchestra.run.smithi101.stdout: } 2023-08-01T19:55:36.827 INFO:teuthology.orchestra.run.smithi101.stdout: }, 2023-08-01T19:55:36.827 INFO:teuthology.orchestra.run.smithi101.stdout: { 2023-08-01T19:55:36.827 INFO:teuthology.orchestra.run.smithi101.stdout: "description": "osd_repop(client.4668.0:107865 5.3 e38/19 5:c2ebb96d:::benchmark_data_smithi006_114134_object107864:head v 38'6830, mlcod=38'6826)", 2023-08-01T19:55:36.828 INFO:teuthology.orchestra.run.smithi101.stdout: "initiated_at": "2023-08-01T19:55:09.283182+0000", 2023-08-01T19:55:36.828 INFO:teuthology.orchestra.run.smithi101.stdout: "age": 27.357830951, 2023-08-01T19:55:36.828 INFO:teuthology.orchestra.run.smithi101.stdout: "duration": 0.068554793000000003, 2023-08-01T19:55:36.828 INFO:teuthology.orchestra.run.smithi101.stdout: "type_data": { 2023-08-01T19:55:36.828 INFO:teuthology.orchestra.run.smithi101.stdout: "flag_point": "commit sent; apply or cleanup", 2023-08-01T19:55:36.828 INFO:teuthology.orchestra.run.smithi101.stdout: "events": [ 2023-08-01T19:55:36.828 INFO:teuthology.orchestra.run.smithi101.stdout: { 2023-08-01T19:55:36.829 INFO:teuthology.orchestra.run.smithi101.stdout: "event": "initiated", 2023-08-01T19:55:36.829 INFO:teuthology.orchestra.run.smithi101.stdout: "time": "2023-08-01T19:55:09.283182+0000", 2023-08-01T19:55:36.829 INFO:teuthology.orchestra.run.smithi101.stdout: "duration": 0 2023-08-01T19:55:36.829 INFO:teuthology.orchestra.run.smithi101.stdout: }, 2023-08-01T19:55:36.829 INFO:teuthology.orchestra.run.smithi101.stdout: { 2023-08-01T19:55:36.829 INFO:teuthology.orchestra.run.smithi101.stdout: "event": "throttled", 2023-08-01T19:55:36.829 INFO:teuthology.orchestra.run.smithi101.stdout: "time": "2023-08-01T19:55:09.283182+0000", 2023-08-01T19:55:36.829 INFO:teuthology.orchestra.run.smithi101.stdout: "duration": 0 2023-08-01T19:55:36.830 INFO:teuthology.orchestra.run.smithi101.stdout: }, 2023-08-01T19:55:36.830 INFO:teuthology.orchestra.run.smithi101.stdout: { 2023-08-01T19:55:36.830 INFO:teuthology.orchestra.run.smithi101.stdout: "event": "header_read", 2023-08-01T19:55:36.830 INFO:teuthology.orchestra.run.smithi101.stdout: "time": "2023-08-01T19:55:09.283182+0000", 2023-08-01T19:55:36.830 INFO:teuthology.orchestra.run.smithi101.stdout: "duration": 4294967295.9999995 2023-08-01T19:55:36.830 INFO:teuthology.orchestra.run.smithi101.stdout: }, 2023-08-01T19:55:36.830 INFO:teuthology.orchestra.run.smithi101.stdout: { 2023-08-01T19:55:36.831 INFO:teuthology.orchestra.run.smithi101.stdout: "event": "all_read", 2023-08-01T19:55:36.831 INFO:teuthology.orchestra.run.smithi101.stdout: "time": "2023-08-01T19:55:09.283233+0000", 2023-08-01T19:55:36.831 INFO:teuthology.orchestra.run.smithi101.stdout: "duration": 5.1511999999999997e-05 2023-08-01T19:55:36.831 INFO:teuthology.orchestra.run.smithi101.stdout: }, 2023-08-01T19:55:36.831 INFO:teuthology.orchestra.run.smithi101.stdout: { 2023-08-01T19:55:36.831 INFO:teuthology.orchestra.run.smithi101.stdout: "event": "dispatched", 2023-08-01T19:55:36.831 INFO:teuthology.orchestra.run.smithi101.stdout: "time": "2023-08-01T19:55:09.283239+0000", 2023-08-01T19:55:36.831 INFO:teuthology.orchestra.run.smithi101.stdout: "duration": 5.6640000000000003e-06 2023-08-01T19:55:36.832 INFO:teuthology.orchestra.run.smithi101.stdout: }, 2023-08-01T19:55:36.832 INFO:teuthology.orchestra.run.smithi101.stdout: { 2023-08-01T19:55:36.832 INFO:teuthology.orchestra.run.smithi101.stdout: "event": "queued_for_pg", 2023-08-01T19:55:36.832 INFO:teuthology.orchestra.run.smithi101.stdout: "time": "2023-08-01T19:55:09.283242+0000", 2023-08-01T19:55:36.832 INFO:teuthology.orchestra.run.smithi101.stdout: "duration": 2.9639999999999999e-06 2023-08-01T19:55:36.832 INFO:teuthology.orchestra.run.smithi101.stdout: }, 2023-08-01T19:55:36.832 INFO:teuthology.orchestra.run.smithi101.stdout: { 2023-08-01T19:55:36.833 INFO:teuthology.orchestra.run.smithi101.stdout: "event": "reached_pg", 2023-08-01T19:55:36.833 INFO:teuthology.orchestra.run.smithi101.stdout: "time": "2023-08-01T19:55:09.283276+0000", 2023-08-01T19:55:36.833 INFO:teuthology.orchestra.run.smithi101.stdout: "duration": 3.3631999999999999e-05 2023-08-01T19:55:36.833 INFO:teuthology.orchestra.run.smithi101.stdout: }, 2023-08-01T19:55:36.833 INFO:teuthology.orchestra.run.smithi101.stdout: { 2023-08-01T19:55:36.833 INFO:teuthology.orchestra.run.smithi101.stdout: "event": "started", 2023-08-01T19:55:36.833 INFO:teuthology.orchestra.run.smithi101.stdout: "time": "2023-08-01T19:55:09.283288+0000", 2023-08-01T19:55:36.834 INFO:teuthology.orchestra.run.smithi101.stdout: "duration": 1.1816e-05 2023-08-01T19:55:36.834 INFO:teuthology.orchestra.run.smithi101.stdout: }, 2023-08-01T19:55:36.834 INFO:teuthology.orchestra.run.smithi101.stdout: { 2023-08-01T19:55:36.834 INFO:teuthology.orchestra.run.smithi101.stdout: "event": "commit_sent", 2023-08-01T19:55:36.834 INFO:teuthology.orchestra.run.smithi101.stdout: "time": "2023-08-01T19:55:09.351712+0000", 2023-08-01T19:55:36.834 INFO:teuthology.orchestra.run.smithi101.stdout: "duration": 0.068424311000000002 2023-08-01T19:55:36.834 INFO:teuthology.orchestra.run.smithi101.stdout: }, 2023-08-01T19:55:36.834 INFO:teuthology.orchestra.run.smithi101.stdout: { 2023-08-01T19:55:36.835 INFO:teuthology.orchestra.run.smithi101.stdout: "event": "done", 2023-08-01T19:55:36.835 INFO:teuthology.orchestra.run.smithi101.stdout: "time": "2023-08-01T19:55:09.351737+0000", 2023-08-01T19:55:36.835 INFO:teuthology.orchestra.run.smithi101.stdout: "duration": 2.5364999999999999e-05 2023-08-01T19:55:36.835 INFO:teuthology.orchestra.run.smithi101.stdout: } 2023-08-01T19:55:36.835 INFO:teuthology.orchestra.run.smithi101.stdout: ] 2023-08-01T19:55:36.835 INFO:teuthology.orchestra.run.smithi101.stdout: } 2023-08-01T19:55:36.835 INFO:teuthology.orchestra.run.smithi101.stdout: }, 2023-08-01T19:55:36.835 INFO:teuthology.orchestra.run.smithi101.stdout: { 2023-08-01T19:55:36.836 INFO:teuthology.orchestra.run.smithi101.stdout: "description": "osd_repop(client.4668.0:107869 5.c e38/19 5:31910384:::benchmark_data_smithi006_114134_object107868:head v 38'6761, mlcod=38'6759)", 2023-08-01T19:55:36.836 INFO:teuthology.orchestra.run.smithi101.stdout: "initiated_at": "2023-08-01T19:55:09.283762+0000", 2023-08-01T19:55:36.836 INFO:teuthology.orchestra.run.smithi101.stdout: "age": 27.357251614999999, 2023-08-01T19:55:36.836 INFO:teuthology.orchestra.run.smithi101.stdout: "duration": 0.067877541, 2023-08-01T19:55:36.836 INFO:teuthology.orchestra.run.smithi101.stdout: "type_data": { 2023-08-01T19:55:36.836 INFO:teuthology.orchestra.run.smithi101.stdout: "flag_point": "commit sent; apply or cleanup", 2023-08-01T19:55:36.836 INFO:teuthology.orchestra.run.smithi101.stdout: "events": [ 2023-08-01T19:55:36.836 INFO:teuthology.orchestra.run.smithi101.stdout: { 2023-08-01T19:55:36.837 INFO:teuthology.orchestra.run.smithi101.stdout: "event": "initiated", 2023-08-01T19:55:36.837 INFO:teuthology.orchestra.run.smithi101.stdout: "time": "2023-08-01T19:55:09.283762+0000", 2023-08-01T19:55:36.837 INFO:teuthology.orchestra.run.smithi101.stdout: "duration": 0 2023-08-01T19:55:36.837 INFO:teuthology.orchestra.run.smithi101.stdout: }, 2023-08-01T19:55:36.837 INFO:teuthology.orchestra.run.smithi101.stdout: { 2023-08-01T19:55:36.837 INFO:teuthology.orchestra.run.smithi101.stdout: "event": "throttled", 2023-08-01T19:55:36.837 INFO:teuthology.orchestra.run.smithi101.stdout: "time": "2023-08-01T19:55:09.283762+0000", 2023-08-01T19:55:36.838 INFO:teuthology.orchestra.run.smithi101.stdout: "duration": 0 2023-08-01T19:55:36.838 INFO:teuthology.orchestra.run.smithi101.stdout: }, 2023-08-01T19:55:36.838 INFO:teuthology.orchestra.run.smithi101.stdout: { 2023-08-01T19:55:36.838 INFO:teuthology.orchestra.run.smithi101.stdout: "event": "header_read", 2023-08-01T19:55:36.838 INFO:teuthology.orchestra.run.smithi101.stdout: "time": "2023-08-01T19:55:09.283761+0000", 2023-08-01T19:55:36.838 INFO:teuthology.orchestra.run.smithi101.stdout: "duration": 4294967295.9999995 2023-08-01T19:55:36.838 INFO:teuthology.orchestra.run.smithi101.stdout: }, 2023-08-01T19:55:36.839 INFO:teuthology.orchestra.run.smithi101.stdout: { 2023-08-01T19:55:36.839 INFO:teuthology.orchestra.run.smithi101.stdout: "event": "all_read", 2023-08-01T19:55:36.839 INFO:teuthology.orchestra.run.smithi101.stdout: "time": "2023-08-01T19:55:09.283825+0000", 2023-08-01T19:55:36.839 INFO:teuthology.orchestra.run.smithi101.stdout: "duration": 6.3200000000000005e-05 2023-08-01T19:55:36.839 INFO:teuthology.orchestra.run.smithi101.stdout: }, 2023-08-01T19:55:36.840 INFO:teuthology.orchestra.run.smithi101.stdout: { 2023-08-01T19:55:36.840 INFO:teuthology.orchestra.run.smithi101.stdout: "event": "dispatched", 2023-08-01T19:55:36.840 INFO:teuthology.orchestra.run.smithi101.stdout: "time": "2023-08-01T19:55:09.345759+0000", 2023-08-01T19:55:36.840 INFO:teuthology.orchestra.run.smithi101.stdout: "duration": 0.061934221999999997 2023-08-01T19:55:36.840 INFO:teuthology.orchestra.run.smithi101.stdout: }, 2023-08-01T19:55:36.840 INFO:teuthology.orchestra.run.smithi101.stdout: { 2023-08-01T19:55:36.841 INFO:teuthology.orchestra.run.smithi101.stdout: "event": "queued_for_pg", 2023-08-01T19:55:36.841 INFO:teuthology.orchestra.run.smithi101.stdout: "time": "2023-08-01T19:55:09.345768+0000", 2023-08-01T19:55:36.841 INFO:teuthology.orchestra.run.smithi101.stdout: "duration": 8.7099999999999996e-06 2023-08-01T19:55:36.841 INFO:teuthology.orchestra.run.smithi101.stdout: }, 2023-08-01T19:55:36.841 INFO:teuthology.orchestra.run.smithi101.stdout: { 2023-08-01T19:55:36.841 INFO:teuthology.orchestra.run.smithi101.stdout: "event": "reached_pg", 2023-08-01T19:55:36.841 INFO:teuthology.orchestra.run.smithi101.stdout: "time": "2023-08-01T19:55:09.345832+0000", 2023-08-01T19:55:36.841 INFO:teuthology.orchestra.run.smithi101.stdout: "duration": 6.4769000000000003e-05 2023-08-01T19:55:36.842 INFO:teuthology.orchestra.run.smithi101.stdout: }, 2023-08-01T19:55:36.842 INFO:teuthology.orchestra.run.smithi101.stdout: { 2023-08-01T19:55:36.842 INFO:teuthology.orchestra.run.smithi101.stdout: "event": "started", 2023-08-01T19:55:36.842 INFO:teuthology.orchestra.run.smithi101.stdout: "time": "2023-08-01T19:55:09.345851+0000", 2023-08-01T19:55:36.842 INFO:teuthology.orchestra.run.smithi101.stdout: "duration": 1.9049e-05 2023-08-01T19:55:36.842 INFO:teuthology.orchestra.run.smithi101.stdout: }, 2023-08-01T19:55:36.842 INFO:teuthology.orchestra.run.smithi101.stdout: { 2023-08-01T19:55:36.843 INFO:teuthology.orchestra.run.smithi101.stdout: "event": "commit_sent", 2023-08-01T19:55:36.843 INFO:teuthology.orchestra.run.smithi101.stdout: "time": "2023-08-01T19:55:09.351601+0000", 2023-08-01T19:55:36.843 INFO:teuthology.orchestra.run.smithi101.stdout: "duration": 0.0057499930000000001 2023-08-01T19:55:36.843 INFO:teuthology.orchestra.run.smithi101.stdout: }, 2023-08-01T19:55:36.843 INFO:teuthology.orchestra.run.smithi101.stdout: { 2023-08-01T19:55:36.843 INFO:teuthology.orchestra.run.smithi101.stdout: "event": "done", 2023-08-01T19:55:36.843 INFO:teuthology.orchestra.run.smithi101.stdout: "time": "2023-08-01T19:55:09.351639+0000", 2023-08-01T19:55:36.843 INFO:teuthology.orchestra.run.smithi101.stdout: "duration": 3.7941000000000001e-05 2023-08-01T19:55:36.844 INFO:teuthology.orchestra.run.smithi101.stdout: } 2023-08-01T19:55:36.844 INFO:teuthology.orchestra.run.smithi101.stdout: ] 2023-08-01T19:55:36.844 INFO:teuthology.orchestra.run.smithi101.stdout: } 2023-08-01T19:55:36.844 INFO:teuthology.orchestra.run.smithi101.stdout: }, 2023-08-01T19:55:36.844 INFO:teuthology.orchestra.run.smithi101.stdout: { 2023-08-01T19:55:36.844 INFO:teuthology.orchestra.run.smithi101.stdout: "description": "osd_op(client.4668.0:107876 5.1 5:8d2344a3:::benchmark_data_smithi006_114134_object107875:head [set-alloc-hint object_size 65536 write_size 65536,write 0~65536] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e38)", 2023-08-01T19:55:36.844 INFO:teuthology.orchestra.run.smithi101.stdout: "initiated_at": "2023-08-01T19:55:09.287802+0000", 2023-08-01T19:55:36.845 INFO:teuthology.orchestra.run.smithi101.stdout: "age": 27.353211295000001, 2023-08-01T19:55:36.845 INFO:teuthology.orchestra.run.smithi101.stdout: "duration": 0.066738461999999998, 2023-08-01T19:55:36.845 INFO:teuthology.orchestra.run.smithi101.stdout: "type_data": { 2023-08-01T19:55:36.845 INFO:teuthology.orchestra.run.smithi101.stdout: "flag_point": "commit sent; apply or cleanup", 2023-08-01T19:55:36.845 INFO:teuthology.orchestra.run.smithi101.stdout: "client_info": { 2023-08-01T19:55:36.845 INFO:teuthology.orchestra.run.smithi101.stdout: "client": "client.4668", 2023-08-01T19:55:36.845 INFO:teuthology.orchestra.run.smithi101.stdout: "client_addr": "172.21.15.6:0/1709472247", 2023-08-01T19:55:36.845 INFO:teuthology.orchestra.run.smithi101.stdout: "tid": 107876 2023-08-01T19:55:36.846 INFO:teuthology.orchestra.run.smithi101.stdout: }, 2023-08-01T19:55:36.846 INFO:teuthology.orchestra.run.smithi101.stdout: "events": [ 2023-08-01T19:55:36.846 INFO:teuthology.orchestra.run.smithi101.stdout: { 2023-08-01T19:55:36.846 INFO:teuthology.orchestra.run.smithi101.stdout: "event": "initiated", 2023-08-01T19:55:36.846 INFO:teuthology.orchestra.run.smithi101.stdout: "time": "2023-08-01T19:55:09.287802+0000", 2023-08-01T19:55:36.846 INFO:teuthology.orchestra.run.smithi101.stdout: "duration": 0 2023-08-01T19:55:36.846 INFO:teuthology.orchestra.run.smithi101.stdout: }, 2023-08-01T19:55:36.846 INFO:teuthology.orchestra.run.smithi101.stdout: { 2023-08-01T19:55:36.847 INFO:teuthology.orchestra.run.smithi101.stdout: "event": "throttled", 2023-08-01T19:55:36.847 INFO:teuthology.orchestra.run.smithi101.stdout: "time": "2023-08-01T19:55:09.287802+0000", 2023-08-01T19:55:36.847 INFO:teuthology.orchestra.run.smithi101.stdout: "duration": 0 2023-08-01T19:55:36.847 INFO:teuthology.orchestra.run.smithi101.stdout: }, 2023-08-01T19:55:36.847 INFO:teuthology.orchestra.run.smithi101.stdout: { 2023-08-01T19:55:36.847 INFO:teuthology.orchestra.run.smithi101.stdout: "event": "header_read", 2023-08-01T19:55:36.847 INFO:teuthology.orchestra.run.smithi101.stdout: "time": "2023-08-01T19:55:09.287800+0000", 2023-08-01T19:55:36.847 INFO:teuthology.orchestra.run.smithi101.stdout: "duration": 4294967295.9999981 2023-08-01T19:55:36.848 INFO:teuthology.orchestra.run.smithi101.stdout: }, 2023-08-01T19:55:36.848 INFO:teuthology.orchestra.run.smithi101.stdout: { 2023-08-01T19:55:36.848 INFO:teuthology.orchestra.run.smithi101.stdout: "event": "all_read", 2023-08-01T19:55:36.848 INFO:teuthology.orchestra.run.smithi101.stdout: "time": "2023-08-01T19:55:09.287847+0000", 2023-08-01T19:55:36.848 INFO:teuthology.orchestra.run.smithi101.stdout: "duration": 4.6455999999999997e-05 2023-08-01T19:55:36.848 INFO:teuthology.orchestra.run.smithi101.stdout: }, 2023-08-01T19:55:36.848 INFO:teuthology.orchestra.run.smithi101.stdout: { 2023-08-01T19:55:36.848 INFO:teuthology.orchestra.run.smithi101.stdout: "event": "dispatched", 2023-08-01T19:55:36.849 INFO:teuthology.orchestra.run.smithi101.stdout: "time": "2023-08-01T19:55:09.345732+0000", 2023-08-01T19:55:36.849 INFO:teuthology.orchestra.run.smithi101.stdout: "duration": 0.057885955000000003 2023-08-01T19:55:36.849 INFO:teuthology.orchestra.run.smithi101.stdout: }, 2023-08-01T19:55:36.849 INFO:teuthology.orchestra.run.smithi101.stdout: { 2023-08-01T19:55:36.849 INFO:teuthology.orchestra.run.smithi101.stdout: "event": "queued_for_pg", 2023-08-01T19:55:36.849 INFO:teuthology.orchestra.run.smithi101.stdout: "time": "2023-08-01T19:55:09.345802+0000", 2023-08-01T19:55:36.849 INFO:teuthology.orchestra.run.smithi101.stdout: "duration": 6.9845000000000006e-05 2023-08-01T19:55:36.850 INFO:teuthology.orchestra.run.smithi101.stdout: }, 2023-08-01T19:55:36.850 INFO:teuthology.orchestra.run.smithi101.stdout: { 2023-08-01T19:55:36.850 INFO:teuthology.orchestra.run.smithi101.stdout: "event": "reached_pg", 2023-08-01T19:55:36.850 INFO:teuthology.orchestra.run.smithi101.stdout: "time": "2023-08-01T19:55:09.345841+0000", 2023-08-01T19:55:36.850 INFO:teuthology.orchestra.run.smithi101.stdout: "duration": 3.8719e-05 2023-08-01T19:55:36.850 INFO:teuthology.orchestra.run.smithi101.stdout: }, 2023-08-01T19:55:36.850 INFO:teuthology.orchestra.run.smithi101.stdout: { 2023-08-01T19:55:36.850 INFO:teuthology.orchestra.run.smithi101.stdout: "event": "started", 2023-08-01T19:55:36.851 INFO:teuthology.orchestra.run.smithi101.stdout: "time": "2023-08-01T19:55:09.345965+0000", 2023-08-01T19:55:36.851 INFO:teuthology.orchestra.run.smithi101.stdout: "duration": 0.00012353099999999999 2023-08-01T19:55:36.851 INFO:teuthology.orchestra.run.smithi101.stdout: }, 2023-08-01T19:55:36.851 INFO:teuthology.orchestra.run.smithi101.stdout: { 2023-08-01T19:55:36.851 INFO:teuthology.orchestra.run.smithi101.stdout: "event": "waiting for subops from 0", 2023-08-01T19:55:36.851 INFO:teuthology.orchestra.run.smithi101.stdout: "time": "2023-08-01T19:55:09.346113+0000", 2023-08-01T19:55:36.851 INFO:teuthology.orchestra.run.smithi101.stdout: "duration": 0.000148496 2023-08-01T19:55:36.851 INFO:teuthology.orchestra.run.smithi101.stdout: }, 2023-08-01T19:55:36.852 INFO:teuthology.orchestra.run.smithi101.stdout: { 2023-08-01T19:55:36.852 INFO:teuthology.orchestra.run.smithi101.stdout: "event": "sub_op_commit_rec", 2023-08-01T19:55:36.852 INFO:teuthology.orchestra.run.smithi101.stdout: "time": "2023-08-01T19:55:09.352561+0000", 2023-08-01T19:55:36.852 INFO:teuthology.orchestra.run.smithi101.stdout: "duration": 0.0064478890000000001 2023-08-01T19:55:36.852 INFO:teuthology.orchestra.run.smithi101.stdout: }, 2023-08-01T19:55:36.852 INFO:teuthology.orchestra.run.smithi101.stdout: { 2023-08-01T19:55:36.852 INFO:teuthology.orchestra.run.smithi101.stdout: "event": "op_commit", 2023-08-01T19:55:36.853 INFO:teuthology.orchestra.run.smithi101.stdout: "time": "2023-08-01T19:55:09.354475+0000", 2023-08-01T19:55:36.853 INFO:teuthology.orchestra.run.smithi101.stdout: "duration": 0.001913903 2023-08-01T19:55:36.853 INFO:teuthology.orchestra.run.smithi101.stdout: }, 2023-08-01T19:55:36.853 INFO:teuthology.orchestra.run.smithi101.stdout: { 2023-08-01T19:55:36.853 INFO:teuthology.orchestra.run.smithi101.stdout: "event": "commit_sent", 2023-08-01T19:55:36.853 INFO:teuthology.orchestra.run.smithi101.stdout: "time": "2023-08-01T19:55:09.354514+0000", 2023-08-01T19:55:36.853 INFO:teuthology.orchestra.run.smithi101.stdout: "duration": 3.8680999999999998e-05 2023-08-01T19:55:36.854 INFO:teuthology.orchestra.run.smithi101.stdout: }, 2023-08-01T19:55:36.854 INFO:teuthology.orchestra.run.smithi101.stdout: { 2023-08-01T19:55:36.854 INFO:teuthology.orchestra.run.smithi101.stdout: "event": "done", 2023-08-01T19:55:36.854 INFO:teuthology.orchestra.run.smithi101.stdout: "time": "2023-08-01T19:55:09.354541+0000", 2023-08-01T19:55:36.854 INFO:teuthology.orchestra.run.smithi101.stdout: "duration": 2.6976999999999999e-05 2023-08-01T19:55:36.854 INFO:teuthology.orchestra.run.smithi101.stdout: } 2023-08-01T19:55:36.854 INFO:teuthology.orchestra.run.smithi101.stdout: ] 2023-08-01T19:55:36.855 INFO:teuthology.orchestra.run.smithi101.stdout: } 2023-08-01T19:55:36.855 INFO:teuthology.orchestra.run.smithi101.stdout: } 2023-08-01T19:55:36.855 INFO:teuthology.orchestra.run.smithi101.stdout: ] 2023-08-01T19:55:36.855 INFO:teuthology.orchestra.run.smithi101.stdout:} 2023-08-01T19:55:36.856 DEBUG:teuthology.orchestra.run.smithi155:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 30 ceph --cluster ceph --admin-daemon /var/run/ceph/ceph-osd.2.asok dump_ops_in_flight 2023-08-01T19:55:36.857 INFO:tasks.ceph.osd.2.smithi155.stderr:2023-08-01T19:55:36.854+0000 7faa5c6ac700 -1 received signal: Hangup from /usr/bin/python3 /bin/daemon-helper kill ceph-osd -f --cluster ceph -i 2 (PID: 111337) UID: 0 2023-08-01T19:55:36.884 INFO:tasks.thrashosds.thrasher:in_osds: [0, 1, 2] out_osds: [] dead_osds: [] live_osds: [0, 1, 2] 2023-08-01T19:55:36.884 INFO:tasks.thrashosds.thrasher:choose_action: min_in 4 min_out 0 min_live 2 min_dead 0 chance_down 1.00 2023-08-01T19:55:36.884 INFO:tasks.thrashosds.thrasher:thrash_pg_upmap_items 2023-08-01T19:55:36.884 DEBUG:teuthology.orchestra.run.smithi006:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 120 ceph --cluster ceph osd dump -f json-pretty 2023-08-01T19:55:36.957 INFO:tasks.ceph.osd.1.smithi101.stderr:2023-08-01T19:55:36.956+0000 7fb0cb7f6700 -1 received signal: Hangup from /usr/bin/python3 /bin/daemon-helper kill ceph-osd -f --cluster ceph -i 1 (PID: 111141) UID: 0 2023-08-01T19:55:37.019 INFO:teuthology.orchestra.run.smithi155.stdout:{ 2023-08-01T19:55:37.019 INFO:teuthology.orchestra.run.smithi155.stdout: "ops": [ 2023-08-01T19:55:37.019 INFO:teuthology.orchestra.run.smithi155.stdout: { 2023-08-01T19:55:37.020 INFO:teuthology.orchestra.run.smithi155.stdout: "description": "osd_op(client.4668.0:157669 5.0 5:0bb12fed:::benchmark_data_smithi006_114134_object24008:head [delete] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e49)", 2023-08-01T19:55:37.020 INFO:teuthology.orchestra.run.smithi155.stdout: "initiated_at": "2023-08-01T19:55:37.010302+0000", 2023-08-01T19:55:37.020 INFO:teuthology.orchestra.run.smithi155.stdout: "age": 0.0067224859999999997, 2023-08-01T19:55:37.020 INFO:teuthology.orchestra.run.smithi155.stdout: "duration": 0.0067478900000000003, 2023-08-01T19:55:37.020 INFO:teuthology.orchestra.run.smithi155.stdout: "type_data": { 2023-08-01T19:55:37.020 INFO:teuthology.orchestra.run.smithi155.stdout: "flag_point": "waiting for sub ops", 2023-08-01T19:55:37.020 INFO:teuthology.orchestra.run.smithi155.stdout: "client_info": { 2023-08-01T19:55:37.021 INFO:teuthology.orchestra.run.smithi155.stdout: "client": "client.4668", 2023-08-01T19:55:37.021 INFO:teuthology.orchestra.run.smithi155.stdout: "client_addr": "172.21.15.6:0/1709472247", 2023-08-01T19:55:37.021 INFO:teuthology.orchestra.run.smithi155.stdout: "tid": 157669 2023-08-01T19:55:37.021 INFO:teuthology.orchestra.run.smithi155.stdout: }, 2023-08-01T19:55:37.021 INFO:teuthology.orchestra.run.smithi155.stdout: "events": [ 2023-08-01T19:55:37.021 INFO:teuthology.orchestra.run.smithi155.stdout: { 2023-08-01T19:55:37.021 INFO:teuthology.orchestra.run.smithi155.stdout: "event": "initiated", 2023-08-01T19:55:37.021 INFO:teuthology.orchestra.run.smithi155.stdout: "time": "2023-08-01T19:55:37.010302+0000", 2023-08-01T19:55:37.022 INFO:teuthology.orchestra.run.smithi155.stdout: "duration": 0 2023-08-01T19:55:37.022 INFO:teuthology.orchestra.run.smithi155.stdout: }, 2023-08-01T19:55:37.022 INFO:teuthology.orchestra.run.smithi155.stdout: { 2023-08-01T19:55:37.022 INFO:teuthology.orchestra.run.smithi155.stdout: "event": "throttled", 2023-08-01T19:55:37.022 INFO:teuthology.orchestra.run.smithi155.stdout: "time": "2023-08-01T19:55:37.010302+0000", 2023-08-01T19:55:37.022 INFO:teuthology.orchestra.run.smithi155.stdout: "duration": 0 2023-08-01T19:55:37.022 INFO:teuthology.orchestra.run.smithi155.stdout: }, 2023-08-01T19:55:37.023 INFO:teuthology.orchestra.run.smithi155.stdout: { 2023-08-01T19:55:37.023 INFO:teuthology.orchestra.run.smithi155.stdout: "event": "header_read", 2023-08-01T19:55:37.023 INFO:teuthology.orchestra.run.smithi155.stdout: "time": "2023-08-01T19:55:37.010301+0000", 2023-08-01T19:55:37.023 INFO:teuthology.orchestra.run.smithi155.stdout: "duration": 4294967295.9999995 2023-08-01T19:55:37.023 INFO:teuthology.orchestra.run.smithi155.stdout: }, 2023-08-01T19:55:37.023 INFO:teuthology.orchestra.run.smithi155.stdout: { 2023-08-01T19:55:37.023 INFO:teuthology.orchestra.run.smithi155.stdout: "event": "all_read", 2023-08-01T19:55:37.023 INFO:teuthology.orchestra.run.smithi155.stdout: "time": "2023-08-01T19:55:37.010304+0000", 2023-08-01T19:55:37.024 INFO:teuthology.orchestra.run.smithi155.stdout: "duration": 3.4010000000000001e-06 2023-08-01T19:55:37.024 INFO:teuthology.orchestra.run.smithi155.stdout: }, 2023-08-01T19:55:37.024 INFO:teuthology.orchestra.run.smithi155.stdout: { 2023-08-01T19:55:37.024 INFO:teuthology.orchestra.run.smithi155.stdout: "event": "dispatched", 2023-08-01T19:55:37.024 INFO:teuthology.orchestra.run.smithi155.stdout: "time": "2023-08-01T19:55:37.010312+0000", 2023-08-01T19:55:37.024 INFO:teuthology.orchestra.run.smithi155.stdout: "duration": 7.9850000000000006e-06 2023-08-01T19:55:37.024 INFO:teuthology.orchestra.run.smithi155.stdout: }, 2023-08-01T19:55:37.025 INFO:teuthology.orchestra.run.smithi155.stdout: { 2023-08-01T19:55:37.025 INFO:teuthology.orchestra.run.smithi155.stdout: "event": "queued_for_pg", 2023-08-01T19:55:37.025 INFO:teuthology.orchestra.run.smithi155.stdout: "time": "2023-08-01T19:55:37.010316+0000", 2023-08-01T19:55:37.025 INFO:teuthology.orchestra.run.smithi155.stdout: "duration": 3.7869999999999999e-06 2023-08-01T19:55:37.025 INFO:teuthology.orchestra.run.smithi155.stdout: }, 2023-08-01T19:55:37.025 INFO:teuthology.orchestra.run.smithi155.stdout: { 2023-08-01T19:55:37.025 INFO:teuthology.orchestra.run.smithi155.stdout: "event": "reached_pg", 2023-08-01T19:55:37.026 INFO:teuthology.orchestra.run.smithi155.stdout: "time": "2023-08-01T19:55:37.010350+0000", 2023-08-01T19:55:37.026 INFO:teuthology.orchestra.run.smithi155.stdout: "duration": 3.3822000000000002e-05 2023-08-01T19:55:37.026 INFO:teuthology.orchestra.run.smithi155.stdout: }, 2023-08-01T19:55:37.026 INFO:teuthology.orchestra.run.smithi155.stdout: { 2023-08-01T19:55:37.026 INFO:teuthology.orchestra.run.smithi155.stdout: "event": "started", 2023-08-01T19:55:37.026 INFO:teuthology.orchestra.run.smithi155.stdout: "time": "2023-08-01T19:55:37.010455+0000", 2023-08-01T19:55:37.026 INFO:teuthology.orchestra.run.smithi155.stdout: "duration": 0.000104937 2023-08-01T19:55:37.026 INFO:teuthology.orchestra.run.smithi155.stdout: }, 2023-08-01T19:55:37.027 INFO:teuthology.orchestra.run.smithi155.stdout: { 2023-08-01T19:55:37.027 INFO:teuthology.orchestra.run.smithi155.stdout: "event": "waiting for subops from 0", 2023-08-01T19:55:37.027 INFO:teuthology.orchestra.run.smithi155.stdout: "time": "2023-08-01T19:55:37.010543+0000", 2023-08-01T19:55:37.027 INFO:teuthology.orchestra.run.smithi155.stdout: "duration": 8.8410000000000002e-05 2023-08-01T19:55:37.027 INFO:teuthology.orchestra.run.smithi155.stdout: } 2023-08-01T19:55:37.027 INFO:teuthology.orchestra.run.smithi155.stdout: ] 2023-08-01T19:55:37.027 INFO:teuthology.orchestra.run.smithi155.stdout: } 2023-08-01T19:55:37.028 INFO:teuthology.orchestra.run.smithi155.stdout: }, 2023-08-01T19:55:37.028 INFO:teuthology.orchestra.run.smithi155.stdout: { 2023-08-01T19:55:37.028 INFO:teuthology.orchestra.run.smithi155.stdout: "description": "osd_op(client.4668.0:157670 5.8 5:149b7724:::benchmark_data_smithi006_114134_object24009:head [delete] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e49)", 2023-08-01T19:55:37.028 INFO:teuthology.orchestra.run.smithi155.stdout: "initiated_at": "2023-08-01T19:55:37.010321+0000", 2023-08-01T19:55:37.028 INFO:teuthology.orchestra.run.smithi155.stdout: "age": 0.0067025399999999999, 2023-08-01T19:55:37.028 INFO:teuthology.orchestra.run.smithi155.stdout: "duration": 0.0068112820000000001, 2023-08-01T19:55:37.029 INFO:teuthology.orchestra.run.smithi155.stdout: "type_data": { 2023-08-01T19:55:37.029 INFO:teuthology.orchestra.run.smithi155.stdout: "flag_point": "waiting for sub ops", 2023-08-01T19:55:37.029 INFO:teuthology.orchestra.run.smithi155.stdout: "client_info": { 2023-08-01T19:55:37.029 INFO:teuthology.orchestra.run.smithi155.stdout: "client": "client.4668", 2023-08-01T19:55:37.029 INFO:teuthology.orchestra.run.smithi155.stdout: "client_addr": "172.21.15.6:0/1709472247", 2023-08-01T19:55:37.029 INFO:teuthology.orchestra.run.smithi155.stdout: "tid": 157670 2023-08-01T19:55:37.029 INFO:teuthology.orchestra.run.smithi155.stdout: }, 2023-08-01T19:55:37.030 INFO:teuthology.orchestra.run.smithi155.stdout: "events": [ 2023-08-01T19:55:37.030 INFO:teuthology.orchestra.run.smithi155.stdout: { 2023-08-01T19:55:37.030 INFO:teuthology.orchestra.run.smithi155.stdout: "event": "initiated", 2023-08-01T19:55:37.030 INFO:teuthology.orchestra.run.smithi155.stdout: "time": "2023-08-01T19:55:37.010321+0000", 2023-08-01T19:55:37.030 INFO:teuthology.orchestra.run.smithi155.stdout: "duration": 0 2023-08-01T19:55:37.030 INFO:teuthology.orchestra.run.smithi155.stdout: }, 2023-08-01T19:55:37.030 INFO:teuthology.orchestra.run.smithi155.stdout: { 2023-08-01T19:55:37.030 INFO:teuthology.orchestra.run.smithi155.stdout: "event": "throttled", 2023-08-01T19:55:37.031 INFO:teuthology.orchestra.run.smithi155.stdout: "time": "2023-08-01T19:55:37.010321+0000", 2023-08-01T19:55:37.031 INFO:teuthology.orchestra.run.smithi155.stdout: "duration": 0 2023-08-01T19:55:37.031 INFO:teuthology.orchestra.run.smithi155.stdout: }, 2023-08-01T19:55:37.031 INFO:teuthology.orchestra.run.smithi155.stdout: { 2023-08-01T19:55:37.031 INFO:teuthology.orchestra.run.smithi155.stdout: "event": "header_read", 2023-08-01T19:55:37.031 INFO:teuthology.orchestra.run.smithi155.stdout: "time": "2023-08-01T19:55:37.010321+0000", 2023-08-01T19:55:37.031 INFO:teuthology.orchestra.run.smithi155.stdout: "duration": 4294967295.9999995 2023-08-01T19:55:37.032 INFO:teuthology.orchestra.run.smithi155.stdout: }, 2023-08-01T19:55:37.032 INFO:teuthology.orchestra.run.smithi155.stdout: { 2023-08-01T19:55:37.032 INFO:teuthology.orchestra.run.smithi155.stdout: "event": "all_read", 2023-08-01T19:55:37.032 INFO:teuthology.orchestra.run.smithi155.stdout: "time": "2023-08-01T19:55:37.010323+0000", 2023-08-01T19:55:37.032 INFO:teuthology.orchestra.run.smithi155.stdout: "duration": 1.705e-06 2023-08-01T19:55:37.032 INFO:teuthology.orchestra.run.smithi155.stdout: }, 2023-08-01T19:55:37.032 INFO:teuthology.orchestra.run.smithi155.stdout: { 2023-08-01T19:55:37.032 INFO:teuthology.orchestra.run.smithi155.stdout: "event": "dispatched", 2023-08-01T19:55:37.033 INFO:teuthology.orchestra.run.smithi155.stdout: "time": "2023-08-01T19:55:37.010327+0000", 2023-08-01T19:55:37.033 INFO:teuthology.orchestra.run.smithi155.stdout: "duration": 3.6200000000000001e-06 2023-08-01T19:55:37.033 INFO:teuthology.orchestra.run.smithi155.stdout: }, 2023-08-01T19:55:37.033 INFO:teuthology.orchestra.run.smithi155.stdout: { 2023-08-01T19:55:37.033 INFO:teuthology.orchestra.run.smithi155.stdout: "event": "queued_for_pg", 2023-08-01T19:55:37.033 INFO:teuthology.orchestra.run.smithi155.stdout: "time": "2023-08-01T19:55:37.010329+0000", 2023-08-01T19:55:37.033 INFO:teuthology.orchestra.run.smithi155.stdout: "duration": 2.182e-06 2023-08-01T19:55:37.033 INFO:teuthology.orchestra.run.smithi155.stdout: }, 2023-08-01T19:55:37.034 INFO:teuthology.orchestra.run.smithi155.stdout: { 2023-08-01T19:55:37.034 INFO:teuthology.orchestra.run.smithi155.stdout: "event": "reached_pg", 2023-08-01T19:55:37.034 INFO:teuthology.orchestra.run.smithi155.stdout: "time": "2023-08-01T19:55:37.011047+0000", 2023-08-01T19:55:37.034 INFO:teuthology.orchestra.run.smithi155.stdout: "duration": 0.00071793300000000003 2023-08-01T19:55:37.034 INFO:teuthology.orchestra.run.smithi155.stdout: }, 2023-08-01T19:55:37.034 INFO:teuthology.orchestra.run.smithi155.stdout: { 2023-08-01T19:55:37.034 INFO:teuthology.orchestra.run.smithi155.stdout: "event": "started", 2023-08-01T19:55:37.034 INFO:teuthology.orchestra.run.smithi155.stdout: "time": "2023-08-01T19:55:37.011113+0000", 2023-08-01T19:55:37.035 INFO:teuthology.orchestra.run.smithi155.stdout: "duration": 6.6857e-05 2023-08-01T19:55:37.035 INFO:teuthology.orchestra.run.smithi155.stdout: }, 2023-08-01T19:55:37.035 INFO:teuthology.orchestra.run.smithi155.stdout: { 2023-08-01T19:55:37.035 INFO:teuthology.orchestra.run.smithi155.stdout: "event": "waiting for subops from 0", 2023-08-01T19:55:37.035 INFO:teuthology.orchestra.run.smithi155.stdout: "time": "2023-08-01T19:55:37.011173+0000", 2023-08-01T19:55:37.035 INFO:teuthology.orchestra.run.smithi155.stdout: "duration": 5.9447999999999997e-05 2023-08-01T19:55:37.035 INFO:teuthology.orchestra.run.smithi155.stdout: }, 2023-08-01T19:55:37.036 INFO:teuthology.orchestra.run.smithi155.stdout: { 2023-08-01T19:55:37.036 INFO:teuthology.orchestra.run.smithi155.stdout: "event": "sub_op_commit_rec", 2023-08-01T19:55:37.036 INFO:teuthology.orchestra.run.smithi155.stdout: "time": "2023-08-01T19:55:37.016418+0000", 2023-08-01T19:55:37.036 INFO:teuthology.orchestra.run.smithi155.stdout: "duration": 0.0052454729999999996 2023-08-01T19:55:37.036 INFO:teuthology.orchestra.run.smithi155.stdout: } 2023-08-01T19:55:37.036 INFO:teuthology.orchestra.run.smithi155.stdout: ] 2023-08-01T19:55:37.036 INFO:teuthology.orchestra.run.smithi155.stdout: } 2023-08-01T19:55:37.036 INFO:teuthology.orchestra.run.smithi155.stdout: }, 2023-08-01T19:55:37.037 INFO:teuthology.orchestra.run.smithi155.stdout: { 2023-08-01T19:55:37.037 INFO:teuthology.orchestra.run.smithi155.stdout: "description": "osd_repop(client.4668.0:157667 5.a e49/19 5:511d9a9e:::benchmark_data_smithi006_114134_object24006:head v 49'9751, mlcod=49'9748)", 2023-08-01T19:55:37.037 INFO:teuthology.orchestra.run.smithi155.stdout: "initiated_at": "2023-08-01T19:55:37.011779+0000", 2023-08-01T19:55:37.037 INFO:teuthology.orchestra.run.smithi155.stdout: "age": 0.0052453559999999996, 2023-08-01T19:55:37.037 INFO:teuthology.orchestra.run.smithi155.stdout: "duration": 0.0054483609999999997, 2023-08-01T19:55:37.037 INFO:teuthology.orchestra.run.smithi155.stdout: "type_data": { 2023-08-01T19:55:37.037 INFO:teuthology.orchestra.run.smithi155.stdout: "flag_point": "started", 2023-08-01T19:55:37.038 INFO:teuthology.orchestra.run.smithi155.stdout: "events": [ 2023-08-01T19:55:37.038 INFO:teuthology.orchestra.run.smithi155.stdout: { 2023-08-01T19:55:37.038 INFO:teuthology.orchestra.run.smithi155.stdout: "event": "initiated", 2023-08-01T19:55:37.038 INFO:teuthology.orchestra.run.smithi155.stdout: "time": "2023-08-01T19:55:37.011779+0000", 2023-08-01T19:55:37.038 INFO:teuthology.orchestra.run.smithi155.stdout: "duration": 0 2023-08-01T19:55:37.038 INFO:teuthology.orchestra.run.smithi155.stdout: }, 2023-08-01T19:55:37.038 INFO:teuthology.orchestra.run.smithi155.stdout: { 2023-08-01T19:55:37.038 INFO:teuthology.orchestra.run.smithi155.stdout: "event": "throttled", 2023-08-01T19:55:37.039 INFO:teuthology.orchestra.run.smithi155.stdout: "time": "2023-08-01T19:55:37.011779+0000", 2023-08-01T19:55:37.039 INFO:teuthology.orchestra.run.smithi155.stdout: "duration": 0 2023-08-01T19:55:37.039 INFO:teuthology.orchestra.run.smithi155.stdout: }, 2023-08-01T19:55:37.039 INFO:teuthology.orchestra.run.smithi155.stdout: { 2023-08-01T19:55:37.039 INFO:teuthology.orchestra.run.smithi155.stdout: "event": "header_read", 2023-08-01T19:55:37.039 INFO:teuthology.orchestra.run.smithi155.stdout: "time": "2023-08-01T19:55:37.011778+0000", 2023-08-01T19:55:37.039 INFO:teuthology.orchestra.run.smithi155.stdout: "duration": 4294967295.9999995 2023-08-01T19:55:37.039 INFO:teuthology.orchestra.run.smithi155.stdout: }, 2023-08-01T19:55:37.040 INFO:teuthology.orchestra.run.smithi155.stdout: { 2023-08-01T19:55:37.040 INFO:teuthology.orchestra.run.smithi155.stdout: "event": "all_read", 2023-08-01T19:55:37.040 INFO:teuthology.orchestra.run.smithi155.stdout: "time": "2023-08-01T19:55:37.011785+0000", 2023-08-01T19:55:37.040 INFO:teuthology.orchestra.run.smithi155.stdout: "duration": 7.3100000000000003e-06 2023-08-01T19:55:37.040 INFO:teuthology.orchestra.run.smithi155.stdout: }, 2023-08-01T19:55:37.040 INFO:teuthology.orchestra.run.smithi155.stdout: { 2023-08-01T19:55:37.041 INFO:teuthology.orchestra.run.smithi155.stdout: "event": "dispatched", 2023-08-01T19:55:37.041 INFO:teuthology.orchestra.run.smithi155.stdout: "time": "2023-08-01T19:55:37.011792+0000", 2023-08-01T19:55:37.041 INFO:teuthology.orchestra.run.smithi155.stdout: "duration": 6.832e-06 2023-08-01T19:55:37.041 INFO:teuthology.orchestra.run.smithi155.stdout: }, 2023-08-01T19:55:37.041 INFO:teuthology.orchestra.run.smithi155.stdout: { 2023-08-01T19:55:37.042 INFO:teuthology.orchestra.run.smithi155.stdout: "event": "queued_for_pg", 2023-08-01T19:55:37.042 INFO:teuthology.orchestra.run.smithi155.stdout: "time": "2023-08-01T19:55:37.011796+0000", 2023-08-01T19:55:37.042 INFO:teuthology.orchestra.run.smithi155.stdout: "duration": 3.3979999999999999e-06 2023-08-01T19:55:37.042 INFO:teuthology.orchestra.run.smithi155.stdout: }, 2023-08-01T19:55:37.042 INFO:teuthology.orchestra.run.smithi155.stdout: { 2023-08-01T19:55:37.042 INFO:teuthology.orchestra.run.smithi155.stdout: "event": "reached_pg", 2023-08-01T19:55:37.042 INFO:teuthology.orchestra.run.smithi155.stdout: "time": "2023-08-01T19:55:37.011822+0000", 2023-08-01T19:55:37.042 INFO:teuthology.orchestra.run.smithi155.stdout: "duration": 2.6843e-05 2023-08-01T19:55:37.043 INFO:teuthology.orchestra.run.smithi155.stdout: }, 2023-08-01T19:55:37.043 INFO:teuthology.orchestra.run.smithi155.stdout: { 2023-08-01T19:55:37.043 INFO:teuthology.orchestra.run.smithi155.stdout: "event": "started", 2023-08-01T19:55:37.043 INFO:teuthology.orchestra.run.smithi155.stdout: "time": "2023-08-01T19:55:37.011836+0000", 2023-08-01T19:55:37.043 INFO:teuthology.orchestra.run.smithi155.stdout: "duration": 1.3412e-05 2023-08-01T19:55:37.043 INFO:teuthology.orchestra.run.smithi155.stdout: } 2023-08-01T19:55:37.043 INFO:teuthology.orchestra.run.smithi155.stdout: ] 2023-08-01T19:55:37.044 INFO:teuthology.orchestra.run.smithi155.stdout: } 2023-08-01T19:55:37.044 INFO:teuthology.orchestra.run.smithi155.stdout: }, 2023-08-01T19:55:37.044 INFO:teuthology.orchestra.run.smithi155.stdout: { 2023-08-01T19:55:37.044 INFO:teuthology.orchestra.run.smithi155.stdout: "description": "osd_repop(client.4668.0:157671 5.a e49/19 5:530b8ce6:::benchmark_data_smithi006_114134_object24010:head v 49'9752, mlcod=49'9748)", 2023-08-01T19:55:37.044 INFO:teuthology.orchestra.run.smithi155.stdout: "initiated_at": "2023-08-01T19:55:37.013396+0000", 2023-08-01T19:55:37.044 INFO:teuthology.orchestra.run.smithi155.stdout: "age": 0.0036276479999999998, 2023-08-01T19:55:37.044 INFO:teuthology.orchestra.run.smithi155.stdout: "duration": 0.0038931230000000001, 2023-08-01T19:55:37.045 INFO:teuthology.orchestra.run.smithi155.stdout: "type_data": { 2023-08-01T19:55:37.045 INFO:teuthology.orchestra.run.smithi155.stdout: "flag_point": "started", 2023-08-01T19:55:37.045 INFO:teuthology.orchestra.run.smithi155.stdout: "events": [ 2023-08-01T19:55:37.045 INFO:teuthology.orchestra.run.smithi155.stdout: { 2023-08-01T19:55:37.045 INFO:teuthology.orchestra.run.smithi155.stdout: "event": "initiated", 2023-08-01T19:55:37.045 INFO:teuthology.orchestra.run.smithi155.stdout: "time": "2023-08-01T19:55:37.013396+0000", 2023-08-01T19:55:37.045 INFO:teuthology.orchestra.run.smithi155.stdout: "duration": 0 2023-08-01T19:55:37.045 INFO:teuthology.orchestra.run.smithi155.stdout: }, 2023-08-01T19:55:37.046 INFO:teuthology.orchestra.run.smithi155.stdout: { 2023-08-01T19:55:37.046 INFO:teuthology.orchestra.run.smithi155.stdout: "event": "throttled", 2023-08-01T19:55:37.046 INFO:teuthology.orchestra.run.smithi155.stdout: "time": "2023-08-01T19:55:37.013396+0000", 2023-08-01T19:55:37.046 INFO:teuthology.orchestra.run.smithi155.stdout: "duration": 0 2023-08-01T19:55:37.046 INFO:teuthology.orchestra.run.smithi155.stdout: }, 2023-08-01T19:55:37.046 INFO:teuthology.orchestra.run.smithi155.stdout: { 2023-08-01T19:55:37.046 INFO:teuthology.orchestra.run.smithi155.stdout: "event": "header_read", 2023-08-01T19:55:37.047 INFO:teuthology.orchestra.run.smithi155.stdout: "time": "2023-08-01T19:55:37.013396+0000", 2023-08-01T19:55:37.047 INFO:teuthology.orchestra.run.smithi155.stdout: "duration": 4294967295.9999995 2023-08-01T19:55:37.047 INFO:teuthology.orchestra.run.smithi155.stdout: }, 2023-08-01T19:55:37.047 INFO:teuthology.orchestra.run.smithi155.stdout: { 2023-08-01T19:55:37.047 INFO:teuthology.orchestra.run.smithi155.stdout: "event": "all_read", 2023-08-01T19:55:37.047 INFO:teuthology.orchestra.run.smithi155.stdout: "time": "2023-08-01T19:55:37.013403+0000", 2023-08-01T19:55:37.047 INFO:teuthology.orchestra.run.smithi155.stdout: "duration": 7.3350000000000001e-06 2023-08-01T19:55:37.047 INFO:teuthology.orchestra.run.smithi155.stdout: }, 2023-08-01T19:55:37.048 INFO:teuthology.orchestra.run.smithi155.stdout: { 2023-08-01T19:55:37.048 INFO:teuthology.orchestra.run.smithi155.stdout: "event": "dispatched", 2023-08-01T19:55:37.048 INFO:teuthology.orchestra.run.smithi155.stdout: "time": "2023-08-01T19:55:37.013411+0000", 2023-08-01T19:55:37.048 INFO:teuthology.orchestra.run.smithi155.stdout: "duration": 7.5959999999999998e-06 2023-08-01T19:55:37.048 INFO:teuthology.orchestra.run.smithi155.stdout: }, 2023-08-01T19:55:37.048 INFO:teuthology.orchestra.run.smithi155.stdout: { 2023-08-01T19:55:37.048 INFO:teuthology.orchestra.run.smithi155.stdout: "event": "queued_for_pg", 2023-08-01T19:55:37.049 INFO:teuthology.orchestra.run.smithi155.stdout: "time": "2023-08-01T19:55:37.013414+0000", 2023-08-01T19:55:37.049 INFO:teuthology.orchestra.run.smithi155.stdout: "duration": 3.6540000000000001e-06 2023-08-01T19:55:37.049 INFO:teuthology.orchestra.run.smithi155.stdout: }, 2023-08-01T19:55:37.049 INFO:teuthology.orchestra.run.smithi155.stdout: { 2023-08-01T19:55:37.049 INFO:teuthology.orchestra.run.smithi155.stdout: "event": "reached_pg", 2023-08-01T19:55:37.049 INFO:teuthology.orchestra.run.smithi155.stdout: "time": "2023-08-01T19:55:37.013442+0000", 2023-08-01T19:55:37.049 INFO:teuthology.orchestra.run.smithi155.stdout: "duration": 2.7943999999999999e-05 2023-08-01T19:55:37.050 INFO:teuthology.orchestra.run.smithi155.stdout: }, 2023-08-01T19:55:37.050 INFO:teuthology.orchestra.run.smithi155.stdout: { 2023-08-01T19:55:37.050 INFO:teuthology.orchestra.run.smithi155.stdout: "event": "started", 2023-08-01T19:55:37.050 INFO:teuthology.orchestra.run.smithi155.stdout: "time": "2023-08-01T19:55:37.013461+0000", 2023-08-01T19:55:37.050 INFO:teuthology.orchestra.run.smithi155.stdout: "duration": 1.8719000000000002e-05 2023-08-01T19:55:37.050 INFO:teuthology.orchestra.run.smithi155.stdout: } 2023-08-01T19:55:37.050 INFO:teuthology.orchestra.run.smithi155.stdout: ] 2023-08-01T19:55:37.050 INFO:teuthology.orchestra.run.smithi155.stdout: } 2023-08-01T19:55:37.051 INFO:teuthology.orchestra.run.smithi155.stdout: }, 2023-08-01T19:55:37.051 INFO:teuthology.orchestra.run.smithi155.stdout: { 2023-08-01T19:55:37.051 INFO:teuthology.orchestra.run.smithi155.stdout: "description": "osd_op(client.4668.0:157672 5.f 5:f8a981aa:::benchmark_data_smithi006_114134_object24011:head [delete] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e49)", 2023-08-01T19:55:37.051 INFO:teuthology.orchestra.run.smithi155.stdout: "initiated_at": "2023-08-01T19:55:37.013679+0000", 2023-08-01T19:55:37.051 INFO:teuthology.orchestra.run.smithi155.stdout: "age": 0.0033452429999999999, 2023-08-01T19:55:37.051 INFO:teuthology.orchestra.run.smithi155.stdout: "duration": 0.0036769839999999999, 2023-08-01T19:55:37.051 INFO:teuthology.orchestra.run.smithi155.stdout: "type_data": { 2023-08-01T19:55:37.051 INFO:teuthology.orchestra.run.smithi155.stdout: "flag_point": "waiting for sub ops", 2023-08-01T19:55:37.052 INFO:teuthology.orchestra.run.smithi155.stdout: "client_info": { 2023-08-01T19:55:37.052 INFO:teuthology.orchestra.run.smithi155.stdout: "client": "client.4668", 2023-08-01T19:55:37.052 INFO:teuthology.orchestra.run.smithi155.stdout: "client_addr": "172.21.15.6:0/1709472247", 2023-08-01T19:55:37.052 INFO:teuthology.orchestra.run.smithi155.stdout: "tid": 157672 2023-08-01T19:55:37.052 INFO:teuthology.orchestra.run.smithi155.stdout: }, 2023-08-01T19:55:37.052 INFO:teuthology.orchestra.run.smithi155.stdout: "events": [ 2023-08-01T19:55:37.052 INFO:teuthology.orchestra.run.smithi155.stdout: { 2023-08-01T19:55:37.053 INFO:teuthology.orchestra.run.smithi155.stdout: "event": "initiated", 2023-08-01T19:55:37.053 INFO:teuthology.orchestra.run.smithi155.stdout: "time": "2023-08-01T19:55:37.013679+0000", 2023-08-01T19:55:37.053 INFO:teuthology.orchestra.run.smithi155.stdout: "duration": 0 2023-08-01T19:55:37.053 INFO:teuthology.orchestra.run.smithi155.stdout: }, 2023-08-01T19:55:37.053 INFO:teuthology.orchestra.run.smithi155.stdout: { 2023-08-01T19:55:37.053 INFO:teuthology.orchestra.run.smithi155.stdout: "event": "throttled", 2023-08-01T19:55:37.053 INFO:teuthology.orchestra.run.smithi155.stdout: "time": "2023-08-01T19:55:37.013679+0000", 2023-08-01T19:55:37.053 INFO:teuthology.orchestra.run.smithi155.stdout: "duration": 0 2023-08-01T19:55:37.054 INFO:teuthology.orchestra.run.smithi155.stdout: }, 2023-08-01T19:55:37.054 INFO:teuthology.orchestra.run.smithi155.stdout: { 2023-08-01T19:55:37.054 INFO:teuthology.orchestra.run.smithi155.stdout: "event": "header_read", 2023-08-01T19:55:37.054 INFO:teuthology.orchestra.run.smithi155.stdout: "time": "2023-08-01T19:55:37.013678+0000", 2023-08-01T19:55:37.054 INFO:teuthology.orchestra.run.smithi155.stdout: "duration": 4294967295.9999995 2023-08-01T19:55:37.054 INFO:teuthology.orchestra.run.smithi155.stdout: }, 2023-08-01T19:55:37.054 INFO:teuthology.orchestra.run.smithi155.stdout: { 2023-08-01T19:55:37.054 INFO:teuthology.orchestra.run.smithi155.stdout: "event": "all_read", 2023-08-01T19:55:37.055 INFO:teuthology.orchestra.run.smithi155.stdout: "time": "2023-08-01T19:55:37.013681+0000", 2023-08-01T19:55:37.055 INFO:teuthology.orchestra.run.smithi155.stdout: "duration": 2.8720000000000002e-06 2023-08-01T19:55:37.055 INFO:teuthology.orchestra.run.smithi155.stdout: }, 2023-08-01T19:55:37.055 INFO:teuthology.orchestra.run.smithi155.stdout: { 2023-08-01T19:55:37.055 INFO:teuthology.orchestra.run.smithi155.stdout: "event": "dispatched", 2023-08-01T19:55:37.055 INFO:teuthology.orchestra.run.smithi155.stdout: "time": "2023-08-01T19:55:37.013688+0000", 2023-08-01T19:55:37.055 INFO:teuthology.orchestra.run.smithi155.stdout: "duration": 6.7410000000000003e-06 2023-08-01T19:55:37.055 INFO:teuthology.orchestra.run.smithi155.stdout: }, 2023-08-01T19:55:37.056 INFO:teuthology.orchestra.run.smithi155.stdout: { 2023-08-01T19:55:37.056 INFO:teuthology.orchestra.run.smithi155.stdout: "event": "queued_for_pg", 2023-08-01T19:55:37.056 INFO:teuthology.orchestra.run.smithi155.stdout: "time": "2023-08-01T19:55:37.013691+0000", 2023-08-01T19:55:37.056 INFO:teuthology.orchestra.run.smithi155.stdout: "duration": 3.3419999999999999e-06 2023-08-01T19:55:37.056 INFO:teuthology.orchestra.run.smithi155.stdout: }, 2023-08-01T19:55:37.056 INFO:teuthology.orchestra.run.smithi155.stdout: { 2023-08-01T19:55:37.056 INFO:teuthology.orchestra.run.smithi155.stdout: "event": "reached_pg", 2023-08-01T19:55:37.056 INFO:teuthology.orchestra.run.smithi155.stdout: "time": "2023-08-01T19:55:37.013725+0000", 2023-08-01T19:55:37.057 INFO:teuthology.orchestra.run.smithi155.stdout: "duration": 3.3946000000000003e-05 2023-08-01T19:55:37.057 INFO:teuthology.orchestra.run.smithi155.stdout: }, 2023-08-01T19:55:37.057 INFO:teuthology.orchestra.run.smithi155.stdout: { 2023-08-01T19:55:37.057 INFO:teuthology.orchestra.run.smithi155.stdout: "event": "started", 2023-08-01T19:55:37.057 INFO:teuthology.orchestra.run.smithi155.stdout: "time": "2023-08-01T19:55:37.013820+0000", 2023-08-01T19:55:37.057 INFO:teuthology.orchestra.run.smithi155.stdout: "duration": 9.5026999999999997e-05 2023-08-01T19:55:37.057 INFO:teuthology.orchestra.run.smithi155.stdout: }, 2023-08-01T19:55:37.057 INFO:teuthology.orchestra.run.smithi155.stdout: { 2023-08-01T19:55:37.058 INFO:teuthology.orchestra.run.smithi155.stdout: "event": "waiting for subops from 1", 2023-08-01T19:55:37.058 INFO:teuthology.orchestra.run.smithi155.stdout: "time": "2023-08-01T19:55:37.013894+0000", 2023-08-01T19:55:37.058 INFO:teuthology.orchestra.run.smithi155.stdout: "duration": 7.4017000000000006e-05 2023-08-01T19:55:37.058 INFO:teuthology.orchestra.run.smithi155.stdout: } 2023-08-01T19:55:37.058 INFO:teuthology.orchestra.run.smithi155.stdout: ] 2023-08-01T19:55:37.058 INFO:teuthology.orchestra.run.smithi155.stdout: } 2023-08-01T19:55:37.058 INFO:teuthology.orchestra.run.smithi155.stdout: }, 2023-08-01T19:55:37.059 INFO:teuthology.orchestra.run.smithi155.stdout: { 2023-08-01T19:55:37.059 INFO:teuthology.orchestra.run.smithi155.stdout: "description": "osd_op(client.4668.0:157673 5.d 5:b7aacaa5:::benchmark_data_smithi006_114134_object24012:head [delete] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e49)", 2023-08-01T19:55:37.059 INFO:teuthology.orchestra.run.smithi155.stdout: "initiated_at": "2023-08-01T19:55:37.013776+0000", 2023-08-01T19:55:37.059 INFO:teuthology.orchestra.run.smithi155.stdout: "age": 0.0032478849999999998, 2023-08-01T19:55:37.059 INFO:teuthology.orchestra.run.smithi155.stdout: "duration": 0.003656917, 2023-08-01T19:55:37.059 INFO:teuthology.orchestra.run.smithi155.stdout: "type_data": { 2023-08-01T19:55:37.059 INFO:teuthology.orchestra.run.smithi155.stdout: "flag_point": "waiting for sub ops", 2023-08-01T19:55:37.059 INFO:teuthology.orchestra.run.smithi155.stdout: "client_info": { 2023-08-01T19:55:37.060 INFO:teuthology.orchestra.run.smithi155.stdout: "client": "client.4668", 2023-08-01T19:55:37.060 INFO:teuthology.orchestra.run.smithi155.stdout: "client_addr": "172.21.15.6:0/1709472247", 2023-08-01T19:55:37.060 INFO:teuthology.orchestra.run.smithi155.stdout: "tid": 157673 2023-08-01T19:55:37.060 INFO:teuthology.orchestra.run.smithi155.stdout: }, 2023-08-01T19:55:37.060 INFO:teuthology.orchestra.run.smithi155.stdout: "events": [ 2023-08-01T19:55:37.060 INFO:teuthology.orchestra.run.smithi155.stdout: { 2023-08-01T19:55:37.060 INFO:teuthology.orchestra.run.smithi155.stdout: "event": "initiated", 2023-08-01T19:55:37.061 INFO:teuthology.orchestra.run.smithi155.stdout: "time": "2023-08-01T19:55:37.013776+0000", 2023-08-01T19:55:37.061 INFO:teuthology.orchestra.run.smithi155.stdout: "duration": 0 2023-08-01T19:55:37.061 INFO:teuthology.orchestra.run.smithi155.stdout: }, 2023-08-01T19:55:37.061 INFO:teuthology.orchestra.run.smithi155.stdout: { 2023-08-01T19:55:37.061 INFO:teuthology.orchestra.run.smithi155.stdout: "event": "throttled", 2023-08-01T19:55:37.061 INFO:teuthology.orchestra.run.smithi155.stdout: "time": "2023-08-01T19:55:37.013776+0000", 2023-08-01T19:55:37.061 INFO:teuthology.orchestra.run.smithi155.stdout: "duration": 0 2023-08-01T19:55:37.061 INFO:teuthology.orchestra.run.smithi155.stdout: }, 2023-08-01T19:55:37.062 INFO:teuthology.orchestra.run.smithi155.stdout: { 2023-08-01T19:55:37.062 INFO:teuthology.orchestra.run.smithi155.stdout: "event": "header_read", 2023-08-01T19:55:37.062 INFO:teuthology.orchestra.run.smithi155.stdout: "time": "2023-08-01T19:55:37.013775+0000", 2023-08-01T19:55:37.062 INFO:teuthology.orchestra.run.smithi155.stdout: "duration": 4294967295.9999995 2023-08-01T19:55:37.062 INFO:teuthology.orchestra.run.smithi155.stdout: }, 2023-08-01T19:55:37.062 INFO:teuthology.orchestra.run.smithi155.stdout: { 2023-08-01T19:55:37.062 INFO:teuthology.orchestra.run.smithi155.stdout: "event": "all_read", 2023-08-01T19:55:37.062 INFO:teuthology.orchestra.run.smithi155.stdout: "time": "2023-08-01T19:55:37.013780+0000", 2023-08-01T19:55:37.063 INFO:teuthology.orchestra.run.smithi155.stdout: "duration": 4.1649999999999999e-06 2023-08-01T19:55:37.063 INFO:teuthology.orchestra.run.smithi155.stdout: }, 2023-08-01T19:55:37.063 INFO:teuthology.orchestra.run.smithi155.stdout: { 2023-08-01T19:55:37.063 INFO:teuthology.orchestra.run.smithi155.stdout: "event": "dispatched", 2023-08-01T19:55:37.063 INFO:teuthology.orchestra.run.smithi155.stdout: "time": "2023-08-01T19:55:37.013789+0000", 2023-08-01T19:55:37.063 INFO:teuthology.orchestra.run.smithi155.stdout: "duration": 8.9590000000000001e-06 2023-08-01T19:55:37.063 INFO:teuthology.orchestra.run.smithi155.stdout: }, 2023-08-01T19:55:37.064 INFO:teuthology.orchestra.run.smithi155.stdout: { 2023-08-01T19:55:37.064 INFO:teuthology.orchestra.run.smithi155.stdout: "event": "queued_for_pg", 2023-08-01T19:55:37.064 INFO:teuthology.orchestra.run.smithi155.stdout: "time": "2023-08-01T19:55:37.013793+0000", 2023-08-01T19:55:37.064 INFO:teuthology.orchestra.run.smithi155.stdout: "duration": 4.7339999999999999e-06 2023-08-01T19:55:37.064 INFO:teuthology.orchestra.run.smithi155.stdout: }, 2023-08-01T19:55:37.064 INFO:teuthology.orchestra.run.smithi155.stdout: { 2023-08-01T19:55:37.064 INFO:teuthology.orchestra.run.smithi155.stdout: "event": "reached_pg", 2023-08-01T19:55:37.064 INFO:teuthology.orchestra.run.smithi155.stdout: "time": "2023-08-01T19:55:37.013824+0000", 2023-08-01T19:55:37.065 INFO:teuthology.orchestra.run.smithi155.stdout: "duration": 3.0497999999999998e-05 2023-08-01T19:55:37.065 INFO:teuthology.orchestra.run.smithi155.stdout: }, 2023-08-01T19:55:37.065 INFO:teuthology.orchestra.run.smithi155.stdout: { 2023-08-01T19:55:37.065 INFO:teuthology.orchestra.run.smithi155.stdout: "event": "started", 2023-08-01T19:55:37.065 INFO:teuthology.orchestra.run.smithi155.stdout: "time": "2023-08-01T19:55:37.013943+0000", 2023-08-01T19:55:37.065 INFO:teuthology.orchestra.run.smithi155.stdout: "duration": 0.0001192 2023-08-01T19:55:37.065 INFO:teuthology.orchestra.run.smithi155.stdout: }, 2023-08-01T19:55:37.065 INFO:teuthology.orchestra.run.smithi155.stdout: { 2023-08-01T19:55:37.066 INFO:teuthology.orchestra.run.smithi155.stdout: "event": "waiting for subops from 1", 2023-08-01T19:55:37.066 INFO:teuthology.orchestra.run.smithi155.stdout: "time": "2023-08-01T19:55:37.014064+0000", 2023-08-01T19:55:37.066 INFO:teuthology.orchestra.run.smithi155.stdout: "duration": 0.000121202 2023-08-01T19:55:37.066 INFO:teuthology.orchestra.run.smithi155.stdout: } 2023-08-01T19:55:37.066 INFO:teuthology.orchestra.run.smithi155.stdout: ] 2023-08-01T19:55:37.066 INFO:teuthology.orchestra.run.smithi155.stdout: } 2023-08-01T19:55:37.066 INFO:teuthology.orchestra.run.smithi155.stdout: }, 2023-08-01T19:55:37.066 INFO:teuthology.orchestra.run.smithi155.stdout: { 2023-08-01T19:55:37.067 INFO:teuthology.orchestra.run.smithi155.stdout: "description": "osd_op(client.4668.0:157674 5.e 5:7c2dae88:::benchmark_data_smithi006_114134_object24013:head [delete] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e49)", 2023-08-01T19:55:37.067 INFO:teuthology.orchestra.run.smithi155.stdout: "initiated_at": "2023-08-01T19:55:37.013809+0000", 2023-08-01T19:55:37.067 INFO:teuthology.orchestra.run.smithi155.stdout: "age": 0.0032153619999999998, 2023-08-01T19:55:37.067 INFO:teuthology.orchestra.run.smithi155.stdout: "duration": 0.0036987679999999998, 2023-08-01T19:55:37.067 INFO:teuthology.orchestra.run.smithi155.stdout: "type_data": { 2023-08-01T19:55:37.067 INFO:teuthology.orchestra.run.smithi155.stdout: "flag_point": "waiting for sub ops", 2023-08-01T19:55:37.067 INFO:teuthology.orchestra.run.smithi155.stdout: "client_info": { 2023-08-01T19:55:37.068 INFO:teuthology.orchestra.run.smithi155.stdout: "client": "client.4668", 2023-08-01T19:55:37.068 INFO:teuthology.orchestra.run.smithi155.stdout: "client_addr": "172.21.15.6:0/1709472247", 2023-08-01T19:55:37.068 INFO:teuthology.orchestra.run.smithi155.stdout: "tid": 157674 2023-08-01T19:55:37.068 INFO:teuthology.orchestra.run.smithi155.stdout: }, 2023-08-01T19:55:37.068 INFO:teuthology.orchestra.run.smithi155.stdout: "events": [ 2023-08-01T19:55:37.068 INFO:teuthology.orchestra.run.smithi155.stdout: { 2023-08-01T19:55:37.068 INFO:teuthology.orchestra.run.smithi155.stdout: "event": "initiated", 2023-08-01T19:55:37.069 INFO:teuthology.orchestra.run.smithi155.stdout: "time": "2023-08-01T19:55:37.013809+0000", 2023-08-01T19:55:37.069 INFO:teuthology.orchestra.run.smithi155.stdout: "duration": 0 2023-08-01T19:55:37.069 INFO:teuthology.orchestra.run.smithi155.stdout: }, 2023-08-01T19:55:37.069 INFO:teuthology.orchestra.run.smithi155.stdout: { 2023-08-01T19:55:37.069 INFO:teuthology.orchestra.run.smithi155.stdout: "event": "throttled", 2023-08-01T19:55:37.069 INFO:teuthology.orchestra.run.smithi155.stdout: "time": "2023-08-01T19:55:37.013809+0000", 2023-08-01T19:55:37.069 INFO:teuthology.orchestra.run.smithi155.stdout: "duration": 0 2023-08-01T19:55:37.070 INFO:teuthology.orchestra.run.smithi155.stdout: }, 2023-08-01T19:55:37.070 INFO:teuthology.orchestra.run.smithi155.stdout: { 2023-08-01T19:55:37.070 INFO:teuthology.orchestra.run.smithi155.stdout: "event": "header_read", 2023-08-01T19:55:37.070 INFO:teuthology.orchestra.run.smithi155.stdout: "time": "2023-08-01T19:55:37.013808+0000", 2023-08-01T19:55:37.070 INFO:teuthology.orchestra.run.smithi155.stdout: "duration": 4294967295.9999995 2023-08-01T19:55:37.070 INFO:teuthology.orchestra.run.smithi155.stdout: }, 2023-08-01T19:55:37.070 INFO:teuthology.orchestra.run.smithi155.stdout: { 2023-08-01T19:55:37.071 INFO:teuthology.orchestra.run.smithi155.stdout: "event": "all_read", 2023-08-01T19:55:37.071 INFO:teuthology.orchestra.run.smithi155.stdout: "time": "2023-08-01T19:55:37.013811+0000", 2023-08-01T19:55:37.071 INFO:teuthology.orchestra.run.smithi155.stdout: "duration": 3.01e-06 2023-08-01T19:55:37.071 INFO:teuthology.orchestra.run.smithi155.stdout: }, 2023-08-01T19:55:37.071 INFO:teuthology.orchestra.run.smithi155.stdout: { 2023-08-01T19:55:37.071 INFO:teuthology.orchestra.run.smithi155.stdout: "event": "dispatched", 2023-08-01T19:55:37.071 INFO:teuthology.orchestra.run.smithi155.stdout: "time": "2023-08-01T19:55:37.013821+0000", 2023-08-01T19:55:37.071 INFO:teuthology.orchestra.run.smithi155.stdout: "duration": 9.9909999999999997e-06 2023-08-01T19:55:37.072 INFO:teuthology.orchestra.run.smithi155.stdout: }, 2023-08-01T19:55:37.072 INFO:teuthology.orchestra.run.smithi155.stdout: { 2023-08-01T19:55:37.072 INFO:teuthology.orchestra.run.smithi155.stdout: "event": "queued_for_pg", 2023-08-01T19:55:37.072 INFO:teuthology.orchestra.run.smithi155.stdout: "time": "2023-08-01T19:55:37.013825+0000", 2023-08-01T19:55:37.072 INFO:teuthology.orchestra.run.smithi155.stdout: "duration": 4.2080000000000002e-06 2023-08-01T19:55:37.072 INFO:teuthology.orchestra.run.smithi155.stdout: }, 2023-08-01T19:55:37.072 INFO:teuthology.orchestra.run.smithi155.stdout: { 2023-08-01T19:55:37.073 INFO:teuthology.orchestra.run.smithi155.stdout: "event": "reached_pg", 2023-08-01T19:55:37.073 INFO:teuthology.orchestra.run.smithi155.stdout: "time": "2023-08-01T19:55:37.014060+0000", 2023-08-01T19:55:37.073 INFO:teuthology.orchestra.run.smithi155.stdout: "duration": 0.00023471000000000001 2023-08-01T19:55:37.073 INFO:teuthology.orchestra.run.smithi155.stdout: }, 2023-08-01T19:55:37.073 INFO:teuthology.orchestra.run.smithi155.stdout: { 2023-08-01T19:55:37.073 INFO:teuthology.orchestra.run.smithi155.stdout: "event": "started", 2023-08-01T19:55:37.073 INFO:teuthology.orchestra.run.smithi155.stdout: "time": "2023-08-01T19:55:37.014166+0000", 2023-08-01T19:55:37.074 INFO:teuthology.orchestra.run.smithi155.stdout: "duration": 0.000105987 2023-08-01T19:55:37.074 INFO:teuthology.orchestra.run.smithi155.stdout: }, 2023-08-01T19:55:37.074 INFO:teuthology.orchestra.run.smithi155.stdout: { 2023-08-01T19:55:37.074 INFO:teuthology.orchestra.run.smithi155.stdout: "event": "waiting for subops from 0", 2023-08-01T19:55:37.074 INFO:teuthology.orchestra.run.smithi155.stdout: "time": "2023-08-01T19:55:37.014276+0000", 2023-08-01T19:55:37.074 INFO:teuthology.orchestra.run.smithi155.stdout: "duration": 0.000109985 2023-08-01T19:55:37.074 INFO:teuthology.orchestra.run.smithi155.stdout: } 2023-08-01T19:55:37.074 INFO:teuthology.orchestra.run.smithi155.stdout: ] 2023-08-01T19:55:37.075 INFO:teuthology.orchestra.run.smithi155.stdout: } 2023-08-01T19:55:37.075 INFO:teuthology.orchestra.run.smithi155.stdout: }, 2023-08-01T19:55:37.075 INFO:teuthology.orchestra.run.smithi155.stdout: { 2023-08-01T19:55:37.075 INFO:teuthology.orchestra.run.smithi155.stdout: "description": "osd_op(client.4668.0:157675 5.0 5:05353848:::benchmark_data_smithi006_114134_object24014:head [delete] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e49)", 2023-08-01T19:55:37.075 INFO:teuthology.orchestra.run.smithi155.stdout: "initiated_at": "2023-08-01T19:55:37.014064+0000", 2023-08-01T19:55:37.075 INFO:teuthology.orchestra.run.smithi155.stdout: "age": 0.0029597759999999999, 2023-08-01T19:55:37.075 INFO:teuthology.orchestra.run.smithi155.stdout: "duration": 0.0035208359999999998, 2023-08-01T19:55:37.075 INFO:teuthology.orchestra.run.smithi155.stdout: "type_data": { 2023-08-01T19:55:37.076 INFO:teuthology.orchestra.run.smithi155.stdout: "flag_point": "waiting for sub ops", 2023-08-01T19:55:37.076 INFO:teuthology.orchestra.run.smithi155.stdout: "client_info": { 2023-08-01T19:55:37.076 INFO:teuthology.orchestra.run.smithi155.stdout: "client": "client.4668", 2023-08-01T19:55:37.076 INFO:teuthology.orchestra.run.smithi155.stdout: "client_addr": "172.21.15.6:0/1709472247", 2023-08-01T19:55:37.076 INFO:teuthology.orchestra.run.smithi155.stdout: "tid": 157675 2023-08-01T19:55:37.076 INFO:teuthology.orchestra.run.smithi155.stdout: }, 2023-08-01T19:55:37.077 INFO:teuthology.orchestra.run.smithi155.stdout: "events": [ 2023-08-01T19:55:37.077 INFO:teuthology.orchestra.run.smithi155.stdout: { 2023-08-01T19:55:37.077 INFO:teuthology.orchestra.run.smithi155.stdout: "event": "initiated", 2023-08-01T19:55:37.077 INFO:teuthology.orchestra.run.smithi155.stdout: "time": "2023-08-01T19:55:37.014064+0000", 2023-08-01T19:55:37.077 INFO:teuthology.orchestra.run.smithi155.stdout: "duration": 0 2023-08-01T19:55:37.077 INFO:teuthology.orchestra.run.smithi155.stdout: }, 2023-08-01T19:55:37.077 INFO:teuthology.orchestra.run.smithi155.stdout: { 2023-08-01T19:55:37.077 INFO:teuthology.orchestra.run.smithi155.stdout: "event": "throttled", 2023-08-01T19:55:37.078 INFO:teuthology.orchestra.run.smithi155.stdout: "time": "2023-08-01T19:55:37.014064+0000", 2023-08-01T19:55:37.078 INFO:teuthology.orchestra.run.smithi155.stdout: "duration": 0 2023-08-01T19:55:37.078 INFO:teuthology.orchestra.run.smithi155.stdout: }, 2023-08-01T19:55:37.078 INFO:teuthology.orchestra.run.smithi155.stdout: { 2023-08-01T19:55:37.078 INFO:teuthology.orchestra.run.smithi155.stdout: "event": "header_read", 2023-08-01T19:55:37.078 INFO:teuthology.orchestra.run.smithi155.stdout: "time": "2023-08-01T19:55:37.014063+0000", 2023-08-01T19:55:37.078 INFO:teuthology.orchestra.run.smithi155.stdout: "duration": 4294967295.999999 2023-08-01T19:55:37.079 INFO:teuthology.orchestra.run.smithi155.stdout: }, 2023-08-01T19:55:37.079 INFO:teuthology.orchestra.run.smithi155.stdout: { 2023-08-01T19:55:37.079 INFO:teuthology.orchestra.run.smithi155.stdout: "event": "all_read", 2023-08-01T19:55:37.079 INFO:teuthology.orchestra.run.smithi155.stdout: "time": "2023-08-01T19:55:37.014069+0000", 2023-08-01T19:55:37.079 INFO:teuthology.orchestra.run.smithi155.stdout: "duration": 6.0120000000000002e-06 2023-08-01T19:55:37.079 INFO:teuthology.orchestra.run.smithi155.stdout: }, 2023-08-01T19:55:37.079 INFO:teuthology.orchestra.run.smithi155.stdout: { 2023-08-01T19:55:37.080 INFO:teuthology.orchestra.run.smithi155.stdout: "event": "dispatched", 2023-08-01T19:55:37.080 INFO:teuthology.orchestra.run.smithi155.stdout: "time": "2023-08-01T19:55:37.014080+0000", 2023-08-01T19:55:37.080 INFO:teuthology.orchestra.run.smithi155.stdout: "duration": 1.1116e-05 2023-08-01T19:55:37.080 INFO:teuthology.orchestra.run.smithi155.stdout: }, 2023-08-01T19:55:37.080 INFO:teuthology.orchestra.run.smithi155.stdout: { 2023-08-01T19:55:37.080 INFO:teuthology.orchestra.run.smithi155.stdout: "event": "queued_for_pg", 2023-08-01T19:55:37.080 INFO:teuthology.orchestra.run.smithi155.stdout: "time": "2023-08-01T19:55:37.014087+0000", 2023-08-01T19:55:37.080 INFO:teuthology.orchestra.run.smithi155.stdout: "duration": 6.3720000000000001e-06 2023-08-01T19:55:37.081 INFO:teuthology.orchestra.run.smithi155.stdout: }, 2023-08-01T19:55:37.081 INFO:teuthology.orchestra.run.smithi155.stdout: { 2023-08-01T19:55:37.081 INFO:teuthology.orchestra.run.smithi155.stdout: "event": "reached_pg", 2023-08-01T19:55:37.081 INFO:teuthology.orchestra.run.smithi155.stdout: "time": "2023-08-01T19:55:37.014154+0000", 2023-08-01T19:55:37.081 INFO:teuthology.orchestra.run.smithi155.stdout: "duration": 6.7256999999999997e-05 2023-08-01T19:55:37.081 INFO:teuthology.orchestra.run.smithi155.stdout: }, 2023-08-01T19:55:37.081 INFO:teuthology.orchestra.run.smithi155.stdout: { 2023-08-01T19:55:37.082 INFO:teuthology.orchestra.run.smithi155.stdout: "event": "started", 2023-08-01T19:55:37.082 INFO:teuthology.orchestra.run.smithi155.stdout: "time": "2023-08-01T19:55:37.014278+0000", 2023-08-01T19:55:37.082 INFO:teuthology.orchestra.run.smithi155.stdout: "duration": 0.00012427200000000001 2023-08-01T19:55:37.082 INFO:teuthology.orchestra.run.smithi155.stdout: }, 2023-08-01T19:55:37.082 INFO:teuthology.orchestra.run.smithi155.stdout: { 2023-08-01T19:55:37.082 INFO:teuthology.orchestra.run.smithi155.stdout: "event": "waiting for subops from 0", 2023-08-01T19:55:37.082 INFO:teuthology.orchestra.run.smithi155.stdout: "time": "2023-08-01T19:55:37.014391+0000", 2023-08-01T19:55:37.083 INFO:teuthology.orchestra.run.smithi155.stdout: "duration": 0.000113158 2023-08-01T19:55:37.083 INFO:teuthology.orchestra.run.smithi155.stdout: } 2023-08-01T19:55:37.083 INFO:teuthology.orchestra.run.smithi155.stdout: ] 2023-08-01T19:55:37.083 INFO:teuthology.orchestra.run.smithi155.stdout: } 2023-08-01T19:55:37.083 INFO:teuthology.orchestra.run.smithi155.stdout: }, 2023-08-01T19:55:37.083 INFO:teuthology.orchestra.run.smithi155.stdout: { 2023-08-01T19:55:37.083 INFO:teuthology.orchestra.run.smithi155.stdout: "description": "osd_op(client.4668.0:157678 5.f 5:f89ecb9a:::benchmark_data_smithi006_114134_object24017:head [delete] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e49)", 2023-08-01T19:55:37.083 INFO:teuthology.orchestra.run.smithi155.stdout: "initiated_at": "2023-08-01T19:55:37.015849+0000", 2023-08-01T19:55:37.084 INFO:teuthology.orchestra.run.smithi155.stdout: "age": 0.0011750280000000001, 2023-08-01T19:55:37.084 INFO:teuthology.orchestra.run.smithi155.stdout: "duration": 0.001810501, 2023-08-01T19:55:37.084 INFO:teuthology.orchestra.run.smithi155.stdout: "type_data": { 2023-08-01T19:55:37.084 INFO:teuthology.orchestra.run.smithi155.stdout: "flag_point": "waiting for sub ops", 2023-08-01T19:55:37.084 INFO:teuthology.orchestra.run.smithi155.stdout: "client_info": { 2023-08-01T19:55:37.084 INFO:teuthology.orchestra.run.smithi155.stdout: "client": "client.4668", 2023-08-01T19:55:37.084 INFO:teuthology.orchestra.run.smithi155.stdout: "client_addr": "172.21.15.6:0/1709472247", 2023-08-01T19:55:37.084 INFO:teuthology.orchestra.run.smithi155.stdout: "tid": 157678 2023-08-01T19:55:37.085 INFO:teuthology.orchestra.run.smithi155.stdout: }, 2023-08-01T19:55:37.085 INFO:teuthology.orchestra.run.smithi155.stdout: "events": [ 2023-08-01T19:55:37.085 INFO:teuthology.orchestra.run.smithi155.stdout: { 2023-08-01T19:55:37.085 INFO:teuthology.orchestra.run.smithi155.stdout: "event": "initiated", 2023-08-01T19:55:37.085 INFO:teuthology.orchestra.run.smithi155.stdout: "time": "2023-08-01T19:55:37.015849+0000", 2023-08-01T19:55:37.085 INFO:teuthology.orchestra.run.smithi155.stdout: "duration": 0 2023-08-01T19:55:37.085 INFO:teuthology.orchestra.run.smithi155.stdout: }, 2023-08-01T19:55:37.085 INFO:teuthology.orchestra.run.smithi155.stdout: { 2023-08-01T19:55:37.086 INFO:teuthology.orchestra.run.smithi155.stdout: "event": "throttled", 2023-08-01T19:55:37.086 INFO:teuthology.orchestra.run.smithi155.stdout: "time": "2023-08-01T19:55:37.015849+0000", 2023-08-01T19:55:37.086 INFO:teuthology.orchestra.run.smithi155.stdout: "duration": 0 2023-08-01T19:55:37.086 INFO:teuthology.orchestra.run.smithi155.stdout: }, 2023-08-01T19:55:37.086 INFO:teuthology.orchestra.run.smithi155.stdout: { 2023-08-01T19:55:37.086 INFO:teuthology.orchestra.run.smithi155.stdout: "event": "header_read", 2023-08-01T19:55:37.086 INFO:teuthology.orchestra.run.smithi155.stdout: "time": "2023-08-01T19:55:37.015848+0000", 2023-08-01T19:55:37.087 INFO:teuthology.orchestra.run.smithi155.stdout: "duration": 4294967295.999999 2023-08-01T19:55:37.087 INFO:teuthology.orchestra.run.smithi155.stdout: }, 2023-08-01T19:55:37.087 INFO:teuthology.orchestra.run.smithi155.stdout: { 2023-08-01T19:55:37.087 INFO:teuthology.orchestra.run.smithi155.stdout: "event": "all_read", 2023-08-01T19:55:37.087 INFO:teuthology.orchestra.run.smithi155.stdout: "time": "2023-08-01T19:55:37.015854+0000", 2023-08-01T19:55:37.087 INFO:teuthology.orchestra.run.smithi155.stdout: "duration": 5.6620000000000002e-06 2023-08-01T19:55:37.087 INFO:teuthology.orchestra.run.smithi155.stdout: }, 2023-08-01T19:55:37.087 INFO:teuthology.orchestra.run.smithi155.stdout: { 2023-08-01T19:55:37.088 INFO:teuthology.orchestra.run.smithi155.stdout: "event": "dispatched", 2023-08-01T19:55:37.088 INFO:teuthology.orchestra.run.smithi155.stdout: "time": "2023-08-01T19:55:37.015865+0000", 2023-08-01T19:55:37.088 INFO:teuthology.orchestra.run.smithi155.stdout: "duration": 1.1615e-05 2023-08-01T19:55:37.088 INFO:teuthology.orchestra.run.smithi155.stdout: }, 2023-08-01T19:55:37.088 INFO:teuthology.orchestra.run.smithi155.stdout: { 2023-08-01T19:55:37.088 INFO:teuthology.orchestra.run.smithi155.stdout: "event": "queued_for_pg", 2023-08-01T19:55:37.088 INFO:teuthology.orchestra.run.smithi155.stdout: "time": "2023-08-01T19:55:37.015871+0000", 2023-08-01T19:55:37.088 INFO:teuthology.orchestra.run.smithi155.stdout: "duration": 5.9100000000000002e-06 2023-08-01T19:55:37.089 INFO:teuthology.orchestra.run.smithi155.stdout: }, 2023-08-01T19:55:37.089 INFO:teuthology.orchestra.run.smithi155.stdout: { 2023-08-01T19:55:37.089 INFO:teuthology.orchestra.run.smithi155.stdout: "event": "reached_pg", 2023-08-01T19:55:37.089 INFO:teuthology.orchestra.run.smithi155.stdout: "time": "2023-08-01T19:55:37.015903+0000", 2023-08-01T19:55:37.089 INFO:teuthology.orchestra.run.smithi155.stdout: "duration": 3.1640000000000002e-05 2023-08-01T19:55:37.089 INFO:teuthology.orchestra.run.smithi155.stdout: }, 2023-08-01T19:55:37.089 INFO:teuthology.orchestra.run.smithi155.stdout: { 2023-08-01T19:55:37.090 INFO:teuthology.orchestra.run.smithi155.stdout: "event": "started", 2023-08-01T19:55:37.090 INFO:teuthology.orchestra.run.smithi155.stdout: "time": "2023-08-01T19:55:37.016034+0000", 2023-08-01T19:55:37.090 INFO:teuthology.orchestra.run.smithi155.stdout: "duration": 0.00013144900000000001 2023-08-01T19:55:37.090 INFO:teuthology.orchestra.run.smithi155.stdout: }, 2023-08-01T19:55:37.090 INFO:teuthology.orchestra.run.smithi155.stdout: { 2023-08-01T19:55:37.091 INFO:teuthology.orchestra.run.smithi155.stdout: "event": "waiting for subops from 1", 2023-08-01T19:55:37.091 INFO:teuthology.orchestra.run.smithi155.stdout: "time": "2023-08-01T19:55:37.016150+0000", 2023-08-01T19:55:37.091 INFO:teuthology.orchestra.run.smithi155.stdout: "duration": 0.000115858 2023-08-01T19:55:37.091 INFO:teuthology.orchestra.run.smithi155.stdout: } 2023-08-01T19:55:37.091 INFO:teuthology.orchestra.run.smithi155.stdout: ] 2023-08-01T19:55:37.091 INFO:teuthology.orchestra.run.smithi155.stdout: } 2023-08-01T19:55:37.091 INFO:teuthology.orchestra.run.smithi155.stdout: }, 2023-08-01T19:55:37.092 INFO:teuthology.orchestra.run.smithi155.stdout: { 2023-08-01T19:55:37.092 INFO:teuthology.orchestra.run.smithi155.stdout: "description": "osd_op(client.4668.0:157679 5.b 5:d0b75b4d:::benchmark_data_smithi006_114134_object24018:head [delete] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e49)", 2023-08-01T19:55:37.092 INFO:teuthology.orchestra.run.smithi155.stdout: "initiated_at": "2023-08-01T19:55:37.016221+0000", 2023-08-01T19:55:37.092 INFO:teuthology.orchestra.run.smithi155.stdout: "age": 0.00080351000000000001, 2023-08-01T19:55:37.092 INFO:teuthology.orchestra.run.smithi155.stdout: "duration": 0.0015120139999999999, 2023-08-01T19:55:37.092 INFO:teuthology.orchestra.run.smithi155.stdout: "type_data": { 2023-08-01T19:55:37.092 INFO:teuthology.orchestra.run.smithi155.stdout: "flag_point": "waiting for sub ops", 2023-08-01T19:55:37.092 INFO:teuthology.orchestra.run.smithi155.stdout: "client_info": { 2023-08-01T19:55:37.093 INFO:teuthology.orchestra.run.smithi155.stdout: "client": "client.4668", 2023-08-01T19:55:37.093 INFO:teuthology.orchestra.run.smithi155.stdout: "client_addr": "172.21.15.6:0/1709472247", 2023-08-01T19:55:37.093 INFO:teuthology.orchestra.run.smithi155.stdout: "tid": 157679 2023-08-01T19:55:37.093 INFO:teuthology.orchestra.run.smithi155.stdout: }, 2023-08-01T19:55:37.093 INFO:teuthology.orchestra.run.smithi155.stdout: "events": [ 2023-08-01T19:55:37.093 INFO:teuthology.orchestra.run.smithi155.stdout: { 2023-08-01T19:55:37.093 INFO:teuthology.orchestra.run.smithi155.stdout: "event": "initiated", 2023-08-01T19:55:37.093 INFO:teuthology.orchestra.run.smithi155.stdout: "time": "2023-08-01T19:55:37.016221+0000", 2023-08-01T19:55:37.094 INFO:teuthology.orchestra.run.smithi155.stdout: "duration": 0 2023-08-01T19:55:37.094 INFO:teuthology.orchestra.run.smithi155.stdout: }, 2023-08-01T19:55:37.094 INFO:teuthology.orchestra.run.smithi155.stdout: { 2023-08-01T19:55:37.094 INFO:teuthology.orchestra.run.smithi155.stdout: "event": "throttled", 2023-08-01T19:55:37.094 INFO:teuthology.orchestra.run.smithi155.stdout: "time": "2023-08-01T19:55:37.016221+0000", 2023-08-01T19:55:37.094 INFO:teuthology.orchestra.run.smithi155.stdout: "duration": 0 2023-08-01T19:55:37.094 INFO:teuthology.orchestra.run.smithi155.stdout: }, 2023-08-01T19:55:37.095 INFO:teuthology.orchestra.run.smithi155.stdout: { 2023-08-01T19:55:37.095 INFO:teuthology.orchestra.run.smithi155.stdout: "event": "header_read", 2023-08-01T19:55:37.095 INFO:teuthology.orchestra.run.smithi155.stdout: "time": "2023-08-01T19:55:37.016220+0000", 2023-08-01T19:55:37.095 INFO:teuthology.orchestra.run.smithi155.stdout: "duration": 4294967295.9999995 2023-08-01T19:55:37.095 INFO:teuthology.orchestra.run.smithi155.stdout: }, 2023-08-01T19:55:37.095 INFO:teuthology.orchestra.run.smithi155.stdout: { 2023-08-01T19:55:37.095 INFO:teuthology.orchestra.run.smithi155.stdout: "event": "all_read", 2023-08-01T19:55:37.096 INFO:teuthology.orchestra.run.smithi155.stdout: "time": "2023-08-01T19:55:37.016223+0000", 2023-08-01T19:55:37.096 INFO:teuthology.orchestra.run.smithi155.stdout: "duration": 3.5650000000000002e-06 2023-08-01T19:55:37.096 INFO:teuthology.orchestra.run.smithi155.stdout: }, 2023-08-01T19:55:37.096 INFO:teuthology.orchestra.run.smithi155.stdout: { 2023-08-01T19:55:37.096 INFO:teuthology.orchestra.run.smithi155.stdout: "event": "dispatched", 2023-08-01T19:55:37.096 INFO:teuthology.orchestra.run.smithi155.stdout: "time": "2023-08-01T19:55:37.016231+0000", 2023-08-01T19:55:37.096 INFO:teuthology.orchestra.run.smithi155.stdout: "duration": 7.3259999999999998e-06 2023-08-01T19:55:37.097 INFO:teuthology.orchestra.run.smithi155.stdout: }, 2023-08-01T19:55:37.097 INFO:teuthology.orchestra.run.smithi155.stdout: { 2023-08-01T19:55:37.097 INFO:teuthology.orchestra.run.smithi155.stdout: "event": "queued_for_pg", 2023-08-01T19:55:37.097 INFO:teuthology.orchestra.run.smithi155.stdout: "time": "2023-08-01T19:55:37.016234+0000", 2023-08-01T19:55:37.097 INFO:teuthology.orchestra.run.smithi155.stdout: "duration": 3.5200000000000002e-06 2023-08-01T19:55:37.097 INFO:teuthology.orchestra.run.smithi155.stdout: }, 2023-08-01T19:55:37.097 INFO:teuthology.orchestra.run.smithi155.stdout: { 2023-08-01T19:55:37.097 INFO:teuthology.orchestra.run.smithi155.stdout: "event": "reached_pg", 2023-08-01T19:55:37.098 INFO:teuthology.orchestra.run.smithi155.stdout: "time": "2023-08-01T19:55:37.016261+0000", 2023-08-01T19:55:37.098 INFO:teuthology.orchestra.run.smithi155.stdout: "duration": 2.7087e-05 2023-08-01T19:55:37.098 INFO:teuthology.orchestra.run.smithi155.stdout: }, 2023-08-01T19:55:37.098 INFO:teuthology.orchestra.run.smithi155.stdout: { 2023-08-01T19:55:37.098 INFO:teuthology.orchestra.run.smithi155.stdout: "event": "started", 2023-08-01T19:55:37.098 INFO:teuthology.orchestra.run.smithi155.stdout: "time": "2023-08-01T19:55:37.016343+0000", 2023-08-01T19:55:37.098 INFO:teuthology.orchestra.run.smithi155.stdout: "duration": 8.1173000000000004e-05 2023-08-01T19:55:37.099 INFO:teuthology.orchestra.run.smithi155.stdout: }, 2023-08-01T19:55:37.099 INFO:teuthology.orchestra.run.smithi155.stdout: { 2023-08-01T19:55:37.099 INFO:teuthology.orchestra.run.smithi155.stdout: "event": "waiting for subops from 0", 2023-08-01T19:55:37.099 INFO:teuthology.orchestra.run.smithi155.stdout: "time": "2023-08-01T19:55:37.016430+0000", 2023-08-01T19:55:37.099 INFO:teuthology.orchestra.run.smithi155.stdout: "duration": 8.7200999999999994e-05 2023-08-01T19:55:37.099 INFO:teuthology.orchestra.run.smithi155.stdout: } 2023-08-01T19:55:37.099 INFO:teuthology.orchestra.run.smithi155.stdout: ] 2023-08-01T19:55:37.099 INFO:teuthology.orchestra.run.smithi155.stdout: } 2023-08-01T19:55:37.100 INFO:teuthology.orchestra.run.smithi155.stdout: }, 2023-08-01T19:55:37.100 INFO:teuthology.orchestra.run.smithi155.stdout: { 2023-08-01T19:55:37.100 INFO:teuthology.orchestra.run.smithi155.stdout: "description": "osd_op(client.4668.0:157681 5.0 5:03ec44cf:::benchmark_data_smithi006_114134_object24020:head [delete] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e49)", 2023-08-01T19:55:37.100 INFO:teuthology.orchestra.run.smithi155.stdout: "initiated_at": "2023-08-01T19:55:37.016385+0000", 2023-08-01T19:55:37.100 INFO:teuthology.orchestra.run.smithi155.stdout: "age": 0.00063881300000000001, 2023-08-01T19:55:37.100 INFO:teuthology.orchestra.run.smithi155.stdout: "duration": 0.001421505, 2023-08-01T19:55:37.100 INFO:teuthology.orchestra.run.smithi155.stdout: "type_data": { 2023-08-01T19:55:37.101 INFO:teuthology.orchestra.run.smithi155.stdout: "flag_point": "waiting for sub ops", 2023-08-01T19:55:37.101 INFO:teuthology.orchestra.run.smithi155.stdout: "client_info": { 2023-08-01T19:55:37.101 INFO:teuthology.orchestra.run.smithi155.stdout: "client": "client.4668", 2023-08-01T19:55:37.101 INFO:teuthology.orchestra.run.smithi155.stdout: "client_addr": "172.21.15.6:0/1709472247", 2023-08-01T19:55:37.101 INFO:teuthology.orchestra.run.smithi155.stdout: "tid": 157681 2023-08-01T19:55:37.101 INFO:teuthology.orchestra.run.smithi155.stdout: }, 2023-08-01T19:55:37.101 INFO:teuthology.orchestra.run.smithi155.stdout: "events": [ 2023-08-01T19:55:37.101 INFO:teuthology.orchestra.run.smithi155.stdout: { 2023-08-01T19:55:37.102 INFO:teuthology.orchestra.run.smithi155.stdout: "event": "initiated", 2023-08-01T19:55:37.102 INFO:teuthology.orchestra.run.smithi155.stdout: "time": "2023-08-01T19:55:37.016385+0000", 2023-08-01T19:55:37.102 INFO:teuthology.orchestra.run.smithi155.stdout: "duration": 0 2023-08-01T19:55:37.102 INFO:teuthology.orchestra.run.smithi155.stdout: }, 2023-08-01T19:55:37.102 INFO:teuthology.orchestra.run.smithi155.stdout: { 2023-08-01T19:55:37.102 INFO:teuthology.orchestra.run.smithi155.stdout: "event": "throttled", 2023-08-01T19:55:37.102 INFO:teuthology.orchestra.run.smithi155.stdout: "time": "2023-08-01T19:55:37.016385+0000", 2023-08-01T19:55:37.102 INFO:teuthology.orchestra.run.smithi155.stdout: "duration": 0 2023-08-01T19:55:37.103 INFO:teuthology.orchestra.run.smithi155.stdout: }, 2023-08-01T19:55:37.103 INFO:teuthology.orchestra.run.smithi155.stdout: { 2023-08-01T19:55:37.103 INFO:teuthology.orchestra.run.smithi155.stdout: "event": "header_read", 2023-08-01T19:55:37.103 INFO:teuthology.orchestra.run.smithi155.stdout: "time": "2023-08-01T19:55:37.016384+0000", 2023-08-01T19:55:37.103 INFO:teuthology.orchestra.run.smithi155.stdout: "duration": 4294967295.999999 2023-08-01T19:55:37.103 INFO:teuthology.orchestra.run.smithi155.stdout: }, 2023-08-01T19:55:37.103 INFO:teuthology.orchestra.run.smithi155.stdout: { 2023-08-01T19:55:37.103 INFO:teuthology.orchestra.run.smithi155.stdout: "event": "all_read", 2023-08-01T19:55:37.104 INFO:teuthology.orchestra.run.smithi155.stdout: "time": "2023-08-01T19:55:37.016389+0000", 2023-08-01T19:55:37.104 INFO:teuthology.orchestra.run.smithi155.stdout: "duration": 4.1350000000000002e-06 2023-08-01T19:55:37.104 INFO:teuthology.orchestra.run.smithi155.stdout: }, 2023-08-01T19:55:37.104 INFO:teuthology.orchestra.run.smithi155.stdout: { 2023-08-01T19:55:37.104 INFO:teuthology.orchestra.run.smithi155.stdout: "event": "dispatched", 2023-08-01T19:55:37.104 INFO:teuthology.orchestra.run.smithi155.stdout: "time": "2023-08-01T19:55:37.016397+0000", 2023-08-01T19:55:37.104 INFO:teuthology.orchestra.run.smithi155.stdout: "duration": 8.5520000000000005e-06 2023-08-01T19:55:37.105 INFO:teuthology.orchestra.run.smithi155.stdout: }, 2023-08-01T19:55:37.105 INFO:teuthology.orchestra.run.smithi155.stdout: { 2023-08-01T19:55:37.105 INFO:teuthology.orchestra.run.smithi155.stdout: "event": "queued_for_pg", 2023-08-01T19:55:37.105 INFO:teuthology.orchestra.run.smithi155.stdout: "time": "2023-08-01T19:55:37.016402+0000", 2023-08-01T19:55:37.105 INFO:teuthology.orchestra.run.smithi155.stdout: "duration": 5.0919999999999997e-06 2023-08-01T19:55:37.105 INFO:teuthology.orchestra.run.smithi155.stdout: }, 2023-08-01T19:55:37.105 INFO:teuthology.orchestra.run.smithi155.stdout: { 2023-08-01T19:55:37.105 INFO:teuthology.orchestra.run.smithi155.stdout: "event": "reached_pg", 2023-08-01T19:55:37.106 INFO:teuthology.orchestra.run.smithi155.stdout: "time": "2023-08-01T19:55:37.016482+0000", 2023-08-01T19:55:37.106 INFO:teuthology.orchestra.run.smithi155.stdout: "duration": 7.9367000000000001e-05 2023-08-01T19:55:37.106 INFO:teuthology.orchestra.run.smithi155.stdout: }, 2023-08-01T19:55:37.106 INFO:teuthology.orchestra.run.smithi155.stdout: { 2023-08-01T19:55:37.106 INFO:teuthology.orchestra.run.smithi155.stdout: "event": "started", 2023-08-01T19:55:37.106 INFO:teuthology.orchestra.run.smithi155.stdout: "time": "2023-08-01T19:55:37.016592+0000", 2023-08-01T19:55:37.106 INFO:teuthology.orchestra.run.smithi155.stdout: "duration": 0.000110438 2023-08-01T19:55:37.106 INFO:teuthology.orchestra.run.smithi155.stdout: }, 2023-08-01T19:55:37.107 INFO:teuthology.orchestra.run.smithi155.stdout: { 2023-08-01T19:55:37.107 INFO:teuthology.orchestra.run.smithi155.stdout: "event": "waiting for subops from 0", 2023-08-01T19:55:37.107 INFO:teuthology.orchestra.run.smithi155.stdout: "time": "2023-08-01T19:55:37.016696+0000", 2023-08-01T19:55:37.107 INFO:teuthology.orchestra.run.smithi155.stdout: "duration": 0.000103671 2023-08-01T19:55:37.107 INFO:teuthology.orchestra.run.smithi155.stdout: } 2023-08-01T19:55:37.107 INFO:teuthology.orchestra.run.smithi155.stdout: ] 2023-08-01T19:55:37.107 INFO:teuthology.orchestra.run.smithi155.stdout: } 2023-08-01T19:55:37.107 INFO:teuthology.orchestra.run.smithi155.stdout: }, 2023-08-01T19:55:37.108 INFO:teuthology.orchestra.run.smithi155.stdout: { 2023-08-01T19:55:37.108 INFO:teuthology.orchestra.run.smithi155.stdout: "description": "osd_op(client.4668.0:157682 5.e 5:76b00024:::benchmark_data_smithi006_114134_object24021:head [delete] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e49)", 2023-08-01T19:55:37.108 INFO:teuthology.orchestra.run.smithi155.stdout: "initiated_at": "2023-08-01T19:55:37.016480+0000", 2023-08-01T19:55:37.108 INFO:teuthology.orchestra.run.smithi155.stdout: "age": 0.00054404099999999999, 2023-08-01T19:55:37.108 INFO:teuthology.orchestra.run.smithi155.stdout: "duration": 0.0013999329999999999, 2023-08-01T19:55:37.108 INFO:teuthology.orchestra.run.smithi155.stdout: "type_data": { 2023-08-01T19:55:37.108 INFO:teuthology.orchestra.run.smithi155.stdout: "flag_point": "waiting for sub ops", 2023-08-01T19:55:37.109 INFO:teuthology.orchestra.run.smithi155.stdout: "client_info": { 2023-08-01T19:55:37.109 INFO:teuthology.orchestra.run.smithi155.stdout: "client": "client.4668", 2023-08-01T19:55:37.109 INFO:teuthology.orchestra.run.smithi155.stdout: "client_addr": "172.21.15.6:0/1709472247", 2023-08-01T19:55:37.109 INFO:teuthology.orchestra.run.smithi155.stdout: "tid": 157682 2023-08-01T19:55:37.109 INFO:teuthology.orchestra.run.smithi155.stdout: }, 2023-08-01T19:55:37.109 INFO:teuthology.orchestra.run.smithi155.stdout: "events": [ 2023-08-01T19:55:37.109 INFO:teuthology.orchestra.run.smithi155.stdout: { 2023-08-01T19:55:37.110 INFO:teuthology.orchestra.run.smithi155.stdout: "event": "initiated", 2023-08-01T19:55:37.110 INFO:teuthology.orchestra.run.smithi155.stdout: "time": "2023-08-01T19:55:37.016480+0000", 2023-08-01T19:55:37.110 INFO:teuthology.orchestra.run.smithi155.stdout: "duration": 0 2023-08-01T19:55:37.110 INFO:teuthology.orchestra.run.smithi155.stdout: }, 2023-08-01T19:55:37.110 INFO:teuthology.orchestra.run.smithi155.stdout: { 2023-08-01T19:55:37.110 INFO:teuthology.orchestra.run.smithi155.stdout: "event": "throttled", 2023-08-01T19:55:37.110 INFO:teuthology.orchestra.run.smithi155.stdout: "time": "2023-08-01T19:55:37.016480+0000", 2023-08-01T19:55:37.110 INFO:teuthology.orchestra.run.smithi155.stdout: "duration": 0 2023-08-01T19:55:37.111 INFO:teuthology.orchestra.run.smithi155.stdout: }, 2023-08-01T19:55:37.111 INFO:teuthology.orchestra.run.smithi155.stdout: { 2023-08-01T19:55:37.111 INFO:teuthology.orchestra.run.smithi155.stdout: "event": "header_read", 2023-08-01T19:55:37.111 INFO:teuthology.orchestra.run.smithi155.stdout: "time": "2023-08-01T19:55:37.016479+0000", 2023-08-01T19:55:37.111 INFO:teuthology.orchestra.run.smithi155.stdout: "duration": 4294967295.9999995 2023-08-01T19:55:37.111 INFO:teuthology.orchestra.run.smithi155.stdout: }, 2023-08-01T19:55:37.111 INFO:teuthology.orchestra.run.smithi155.stdout: { 2023-08-01T19:55:37.111 INFO:teuthology.orchestra.run.smithi155.stdout: "event": "all_read", 2023-08-01T19:55:37.112 INFO:teuthology.orchestra.run.smithi155.stdout: "time": "2023-08-01T19:55:37.016483+0000", 2023-08-01T19:55:37.112 INFO:teuthology.orchestra.run.smithi155.stdout: "duration": 4.0350000000000003e-06 2023-08-01T19:55:37.112 INFO:teuthology.orchestra.run.smithi155.stdout: }, 2023-08-01T19:55:37.112 INFO:teuthology.orchestra.run.smithi155.stdout: { 2023-08-01T19:55:37.112 INFO:teuthology.orchestra.run.smithi155.stdout: "event": "dispatched", 2023-08-01T19:55:37.113 INFO:teuthology.orchestra.run.smithi155.stdout: "time": "2023-08-01T19:55:37.016494+0000", 2023-08-01T19:55:37.113 INFO:teuthology.orchestra.run.smithi155.stdout: "duration": 1.0832999999999999e-05 2023-08-01T19:55:37.113 INFO:teuthology.orchestra.run.smithi155.stdout: }, 2023-08-01T19:55:37.113 INFO:teuthology.orchestra.run.smithi155.stdout: { 2023-08-01T19:55:37.113 INFO:teuthology.orchestra.run.smithi155.stdout: "event": "queued_for_pg", 2023-08-01T19:55:37.113 INFO:teuthology.orchestra.run.smithi155.stdout: "time": "2023-08-01T19:55:37.016500+0000", 2023-08-01T19:55:37.113 INFO:teuthology.orchestra.run.smithi155.stdout: "duration": 5.823e-06 2023-08-01T19:55:37.114 INFO:teuthology.orchestra.run.smithi155.stdout: }, 2023-08-01T19:55:37.114 INFO:teuthology.orchestra.run.smithi155.stdout: { 2023-08-01T19:55:37.114 INFO:teuthology.orchestra.run.smithi155.stdout: "event": "reached_pg", 2023-08-01T19:55:37.114 INFO:teuthology.orchestra.run.smithi155.stdout: "time": "2023-08-01T19:55:37.017214+0000", 2023-08-01T19:55:37.114 INFO:teuthology.orchestra.run.smithi155.stdout: "duration": 0.00071448799999999999 2023-08-01T19:55:37.114 INFO:teuthology.orchestra.run.smithi155.stdout: }, 2023-08-01T19:55:37.115 INFO:teuthology.orchestra.run.smithi155.stdout: { 2023-08-01T19:55:37.115 INFO:teuthology.orchestra.run.smithi155.stdout: "event": "started", 2023-08-01T19:55:37.115 INFO:teuthology.orchestra.run.smithi155.stdout: "time": "2023-08-01T19:55:37.017334+0000", 2023-08-01T19:55:37.116 INFO:teuthology.orchestra.run.smithi155.stdout: "duration": 0.000119463 2023-08-01T19:55:37.116 INFO:teuthology.orchestra.run.smithi155.stdout: }, 2023-08-01T19:55:37.116 INFO:teuthology.orchestra.run.smithi155.stdout: { 2023-08-01T19:55:37.116 INFO:teuthology.orchestra.run.smithi155.stdout: "event": "waiting for subops from 0", 2023-08-01T19:55:37.117 INFO:teuthology.orchestra.run.smithi155.stdout: "time": "2023-08-01T19:55:37.017462+0000", 2023-08-01T19:55:37.117 INFO:teuthology.orchestra.run.smithi155.stdout: "duration": 0.00012792899999999999 2023-08-01T19:55:37.117 INFO:teuthology.orchestra.run.smithi155.stdout: } 2023-08-01T19:55:37.117 INFO:teuthology.orchestra.run.smithi155.stdout: ] 2023-08-01T19:55:37.117 INFO:teuthology.orchestra.run.smithi155.stdout: } 2023-08-01T19:55:37.117 INFO:teuthology.orchestra.run.smithi155.stdout: }, 2023-08-01T19:55:37.118 INFO:teuthology.orchestra.run.smithi155.stdout: { 2023-08-01T19:55:37.118 INFO:teuthology.orchestra.run.smithi155.stdout: "description": "osd_repop_reply(client.4668.0:157672 5.f e49/40)", 2023-08-01T19:55:37.118 INFO:teuthology.orchestra.run.smithi155.stdout: "initiated_at": "2023-08-01T19:55:37.017711+0000", 2023-08-01T19:55:37.118 INFO:teuthology.orchestra.run.smithi155.stdout: "age": 4294967295.9993134, 2023-08-01T19:55:37.119 INFO:teuthology.orchestra.run.smithi155.stdout: "duration": 0.00023959299999999999, 2023-08-01T19:55:37.119 INFO:teuthology.orchestra.run.smithi155.stdout: "type_data": { 2023-08-01T19:55:37.119 INFO:teuthology.orchestra.run.smithi155.stdout: "flag_point": "queued for pg", 2023-08-01T19:55:37.119 INFO:teuthology.orchestra.run.smithi155.stdout: "events": [ 2023-08-01T19:55:37.119 INFO:teuthology.orchestra.run.smithi155.stdout: { 2023-08-01T19:55:37.119 INFO:teuthology.orchestra.run.smithi155.stdout: "event": "initiated", 2023-08-01T19:55:37.119 INFO:teuthology.orchestra.run.smithi155.stdout: "time": "2023-08-01T19:55:37.017711+0000", 2023-08-01T19:55:37.120 INFO:teuthology.orchestra.run.smithi155.stdout: "duration": 0 2023-08-01T19:55:37.120 INFO:teuthology.orchestra.run.smithi155.stdout: }, 2023-08-01T19:55:37.120 INFO:teuthology.orchestra.run.smithi155.stdout: { 2023-08-01T19:55:37.120 INFO:teuthology.orchestra.run.smithi155.stdout: "event": "throttled", 2023-08-01T19:55:37.120 INFO:teuthology.orchestra.run.smithi155.stdout: "time": "2023-08-01T19:55:37.017711+0000", 2023-08-01T19:55:37.120 INFO:teuthology.orchestra.run.smithi155.stdout: "duration": 0 2023-08-01T19:55:37.120 INFO:teuthology.orchestra.run.smithi155.stdout: }, 2023-08-01T19:55:37.120 INFO:teuthology.orchestra.run.smithi155.stdout: { 2023-08-01T19:55:37.121 INFO:teuthology.orchestra.run.smithi155.stdout: "event": "header_read", 2023-08-01T19:55:37.121 INFO:teuthology.orchestra.run.smithi155.stdout: "time": "2023-08-01T19:55:37.017710+0000", 2023-08-01T19:55:37.121 INFO:teuthology.orchestra.run.smithi155.stdout: "duration": 4294967295.9999995 2023-08-01T19:55:37.121 INFO:teuthology.orchestra.run.smithi155.stdout: }, 2023-08-01T19:55:37.121 INFO:teuthology.orchestra.run.smithi155.stdout: { 2023-08-01T19:55:37.121 INFO:teuthology.orchestra.run.smithi155.stdout: "event": "all_read", 2023-08-01T19:55:37.121 INFO:teuthology.orchestra.run.smithi155.stdout: "time": "2023-08-01T19:55:37.017717+0000", 2023-08-01T19:55:37.121 INFO:teuthology.orchestra.run.smithi155.stdout: "duration": 6.6250000000000001e-06 2023-08-01T19:55:37.122 INFO:teuthology.orchestra.run.smithi155.stdout: }, 2023-08-01T19:55:37.122 INFO:teuthology.orchestra.run.smithi155.stdout: { 2023-08-01T19:55:37.122 INFO:teuthology.orchestra.run.smithi155.stdout: "event": "dispatched", 2023-08-01T19:55:37.122 INFO:teuthology.orchestra.run.smithi155.stdout: "time": "2023-08-01T19:55:37.017726+0000", 2023-08-01T19:55:37.122 INFO:teuthology.orchestra.run.smithi155.stdout: "duration": 8.7790000000000001e-06 2023-08-01T19:55:37.122 INFO:teuthology.orchestra.run.smithi155.stdout: }, 2023-08-01T19:55:37.122 INFO:teuthology.orchestra.run.smithi155.stdout: { 2023-08-01T19:55:37.122 INFO:teuthology.orchestra.run.smithi155.stdout: "event": "queued_for_pg", 2023-08-01T19:55:37.123 INFO:teuthology.orchestra.run.smithi155.stdout: "time": "2023-08-01T19:55:37.017730+0000", 2023-08-01T19:55:37.123 INFO:teuthology.orchestra.run.smithi155.stdout: "duration": 4.7149999999999997e-06 2023-08-01T19:55:37.123 INFO:teuthology.orchestra.run.smithi155.stdout: } 2023-08-01T19:55:37.123 INFO:teuthology.orchestra.run.smithi155.stdout: ] 2023-08-01T19:55:37.123 INFO:teuthology.orchestra.run.smithi155.stdout: } 2023-08-01T19:55:37.123 INFO:teuthology.orchestra.run.smithi155.stdout: }, 2023-08-01T19:55:37.123 INFO:teuthology.orchestra.run.smithi155.stdout: { 2023-08-01T19:55:37.124 INFO:teuthology.orchestra.run.smithi155.stdout: "description": "osd_repop_reply(client.4668.0:157673 5.d e49/19)", 2023-08-01T19:55:37.124 INFO:teuthology.orchestra.run.smithi155.stdout: "initiated_at": "2023-08-01T19:55:37.017740+0000", 2023-08-01T19:55:37.124 INFO:teuthology.orchestra.run.smithi155.stdout: "age": 4294967295.9992838, 2023-08-01T19:55:37.124 INFO:teuthology.orchestra.run.smithi155.stdout: "duration": 0.00025665399999999999, 2023-08-01T19:55:37.124 INFO:teuthology.orchestra.run.smithi155.stdout: "type_data": { 2023-08-01T19:55:37.124 INFO:teuthology.orchestra.run.smithi155.stdout: "flag_point": "queued for pg", 2023-08-01T19:55:37.124 INFO:teuthology.orchestra.run.smithi155.stdout: "events": [ 2023-08-01T19:55:37.124 INFO:teuthology.orchestra.run.smithi155.stdout: { 2023-08-01T19:55:37.125 INFO:teuthology.orchestra.run.smithi155.stdout: "event": "initiated", 2023-08-01T19:55:37.125 INFO:teuthology.orchestra.run.smithi155.stdout: "time": "2023-08-01T19:55:37.017740+0000", 2023-08-01T19:55:37.125 INFO:teuthology.orchestra.run.smithi155.stdout: "duration": 0 2023-08-01T19:55:37.125 INFO:teuthology.orchestra.run.smithi155.stdout: }, 2023-08-01T19:55:37.125 INFO:teuthology.orchestra.run.smithi155.stdout: { 2023-08-01T19:55:37.125 INFO:teuthology.orchestra.run.smithi155.stdout: "event": "throttled", 2023-08-01T19:55:37.125 INFO:teuthology.orchestra.run.smithi155.stdout: "time": "2023-08-01T19:55:37.017740+0000", 2023-08-01T19:55:37.126 INFO:teuthology.orchestra.run.smithi155.stdout: "duration": 0 2023-08-01T19:55:37.126 INFO:teuthology.orchestra.run.smithi155.stdout: }, 2023-08-01T19:55:37.126 INFO:teuthology.orchestra.run.smithi155.stdout: { 2023-08-01T19:55:37.126 INFO:teuthology.orchestra.run.smithi155.stdout: "event": "header_read", 2023-08-01T19:55:37.126 INFO:teuthology.orchestra.run.smithi155.stdout: "time": "2023-08-01T19:55:37.017740+0000", 2023-08-01T19:55:37.126 INFO:teuthology.orchestra.run.smithi155.stdout: "duration": 4294967295.9999995 2023-08-01T19:55:37.126 INFO:teuthology.orchestra.run.smithi155.stdout: }, 2023-08-01T19:55:37.126 INFO:teuthology.orchestra.run.smithi155.stdout: { 2023-08-01T19:55:37.127 INFO:teuthology.orchestra.run.smithi155.stdout: "event": "all_read", 2023-08-01T19:55:37.127 INFO:teuthology.orchestra.run.smithi155.stdout: "time": "2023-08-01T19:55:37.017742+0000", 2023-08-01T19:55:37.127 INFO:teuthology.orchestra.run.smithi155.stdout: "duration": 2.3159999999999999e-06 2023-08-01T19:55:37.127 INFO:teuthology.orchestra.run.smithi155.stdout: }, 2023-08-01T19:55:37.127 INFO:teuthology.orchestra.run.smithi155.stdout: { 2023-08-01T19:55:37.127 INFO:teuthology.orchestra.run.smithi155.stdout: "event": "dispatched", 2023-08-01T19:55:37.127 INFO:teuthology.orchestra.run.smithi155.stdout: "time": "2023-08-01T19:55:37.017748+0000", 2023-08-01T19:55:37.128 INFO:teuthology.orchestra.run.smithi155.stdout: "duration": 5.0730000000000004e-06 2023-08-01T19:55:37.128 INFO:teuthology.orchestra.run.smithi155.stdout: }, 2023-08-01T19:55:37.128 INFO:teuthology.orchestra.run.smithi155.stdout: { 2023-08-01T19:55:37.128 INFO:teuthology.orchestra.run.smithi155.stdout: "event": "queued_for_pg", 2023-08-01T19:55:37.128 INFO:teuthology.orchestra.run.smithi155.stdout: "time": "2023-08-01T19:55:37.017751+0000", 2023-08-01T19:55:37.128 INFO:teuthology.orchestra.run.smithi155.stdout: "duration": 3.2399999999999999e-06 2023-08-01T19:55:37.128 INFO:teuthology.orchestra.run.smithi155.stdout: } 2023-08-01T19:55:37.129 INFO:teuthology.orchestra.run.smithi155.stdout: ] 2023-08-01T19:55:37.129 INFO:teuthology.orchestra.run.smithi155.stdout: } 2023-08-01T19:55:37.129 INFO:teuthology.orchestra.run.smithi155.stdout: } 2023-08-01T19:55:37.129 INFO:teuthology.orchestra.run.smithi155.stdout: ], 2023-08-01T19:55:37.129 INFO:teuthology.orchestra.run.smithi155.stdout: "num_ops": 14 2023-08-01T19:55:37.129 INFO:teuthology.orchestra.run.smithi155.stdout:} 2023-08-01T19:55:37.131 INFO:teuthology.orchestra.run.smithi006.stderr:nodeep-scrub is set 2023-08-01T19:55:37.131 DEBUG:teuthology.orchestra.run.smithi155:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 30 ceph --cluster ceph --admin-daemon /var/run/ceph/ceph-osd.2.asok dump_blocked_ops 2023-08-01T19:55:37.132 INFO:tasks.ceph.osd.0.smithi008.stderr:2023-08-01T19:55:37.128+0000 7f16a58f4700 -1 received signal: Hangup from /usr/bin/python3 /bin/daemon-helper kill ceph-osd -f --cluster ceph -i 0 (PID: 111179) UID: 0 2023-08-01T19:55:37.163 DEBUG:teuthology.orchestra.run.smithi006:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 120 ceph --cluster ceph -- tell 'osd.*' injectargs --osd_enable_op_tracker=false 2023-08-01T19:55:37.223 INFO:teuthology.orchestra.run.smithi006.stdout: 2023-08-01T19:55:37.223 INFO:teuthology.orchestra.run.smithi006.stdout:{ 2023-08-01T19:55:37.224 INFO:teuthology.orchestra.run.smithi006.stdout: "epoch": 50, 2023-08-01T19:55:37.224 INFO:teuthology.orchestra.run.smithi006.stdout: "fsid": "a0e420cc-4df1-42a5-8bd4-a98c309a9349", 2023-08-01T19:55:37.224 INFO:teuthology.orchestra.run.smithi006.stdout: "created": "2023-08-01T19:53:41.279588+0000", 2023-08-01T19:55:37.224 INFO:teuthology.orchestra.run.smithi006.stdout: "modified": "2023-08-01T19:55:37.046308+0000", 2023-08-01T19:55:37.224 INFO:teuthology.orchestra.run.smithi006.stdout: "last_up_change": "2023-08-01T19:53:50.735626+0000", 2023-08-01T19:55:37.224 INFO:teuthology.orchestra.run.smithi006.stdout: "last_in_change": "2023-08-01T19:53:42.974751+0000", 2023-08-01T19:55:37.224 INFO:teuthology.orchestra.run.smithi006.stdout: "flags": "noscrub,nodeep-scrub,sortbitwise,recovery_deletes,purged_snapdirs,pglog_hardlimit", 2023-08-01T19:55:37.225 INFO:teuthology.orchestra.run.smithi006.stdout: "flags_num": 5806080, 2023-08-01T19:55:37.225 INFO:teuthology.orchestra.run.smithi006.stdout: "flags_set": [ 2023-08-01T19:55:37.225 INFO:teuthology.orchestra.run.smithi006.stdout: "nodeep-scrub", 2023-08-01T19:55:37.225 INFO:teuthology.orchestra.run.smithi006.stdout: "noscrub", 2023-08-01T19:55:37.225 INFO:teuthology.orchestra.run.smithi006.stdout: "pglog_hardlimit", 2023-08-01T19:55:37.225 INFO:teuthology.orchestra.run.smithi006.stdout: "purged_snapdirs", 2023-08-01T19:55:37.225 INFO:teuthology.orchestra.run.smithi006.stdout: "recovery_deletes", 2023-08-01T19:55:37.225 INFO:teuthology.orchestra.run.smithi006.stdout: "sortbitwise" 2023-08-01T19:55:37.226 INFO:teuthology.orchestra.run.smithi006.stdout: ], 2023-08-01T19:55:37.226 INFO:teuthology.orchestra.run.smithi006.stdout: "crush_version": 5, 2023-08-01T19:55:37.226 INFO:teuthology.orchestra.run.smithi006.stdout: "full_ratio": 0.94999998807907104, 2023-08-01T19:55:37.226 INFO:teuthology.orchestra.run.smithi006.stdout: "backfillfull_ratio": 0.89999997615814209, 2023-08-01T19:55:37.226 INFO:teuthology.orchestra.run.smithi006.stdout: "nearfull_ratio": 0.85000002384185791, 2023-08-01T19:55:37.226 INFO:teuthology.orchestra.run.smithi006.stdout: "cluster_snapshot": "", 2023-08-01T19:55:37.227 INFO:teuthology.orchestra.run.smithi006.stdout: "pool_max": 5, 2023-08-01T19:55:37.227 INFO:teuthology.orchestra.run.smithi006.stdout: "max_osd": 3, 2023-08-01T19:55:37.227 INFO:teuthology.orchestra.run.smithi006.stdout: "require_min_compat_client": "luminous", 2023-08-01T19:55:37.227 INFO:teuthology.orchestra.run.smithi006.stdout: "min_compat_client": "jewel", 2023-08-01T19:55:37.227 INFO:teuthology.orchestra.run.smithi006.stdout: "require_osd_release": "quincy", 2023-08-01T19:55:37.227 INFO:teuthology.orchestra.run.smithi006.stdout: "pools": [ 2023-08-01T19:55:37.227 INFO:teuthology.orchestra.run.smithi006.stdout: { 2023-08-01T19:55:37.228 INFO:teuthology.orchestra.run.smithi006.stdout: "pool": 1, 2023-08-01T19:55:37.228 INFO:teuthology.orchestra.run.smithi006.stdout: "pool_name": ".mgr", 2023-08-01T19:55:37.228 INFO:teuthology.orchestra.run.smithi006.stdout: "create_time": "2023-08-01T19:53:49.961944+0000", 2023-08-01T19:55:37.228 INFO:teuthology.orchestra.run.smithi006.stdout: "flags": 1, 2023-08-01T19:55:37.228 INFO:teuthology.orchestra.run.smithi006.stdout: "flags_names": "hashpspool", 2023-08-01T19:55:37.228 INFO:teuthology.orchestra.run.smithi006.stdout: "type": 1, 2023-08-01T19:55:37.228 INFO:teuthology.orchestra.run.smithi006.stdout: "size": 2, 2023-08-01T19:55:37.229 INFO:teuthology.orchestra.run.smithi006.stdout: "min_size": 1, 2023-08-01T19:55:37.229 INFO:teuthology.orchestra.run.smithi006.stdout: "crush_rule": 0, 2023-08-01T19:55:37.229 INFO:teuthology.orchestra.run.smithi006.stdout: "peering_crush_bucket_count": 0, 2023-08-01T19:55:37.229 INFO:teuthology.orchestra.run.smithi006.stdout: "peering_crush_bucket_target": 0, 2023-08-01T19:55:37.229 INFO:teuthology.orchestra.run.smithi006.stdout: "peering_crush_bucket_barrier": 0, 2023-08-01T19:55:37.229 INFO:teuthology.orchestra.run.smithi006.stdout: "peering_crush_bucket_mandatory_member": 2147483647, 2023-08-01T19:55:37.229 INFO:teuthology.orchestra.run.smithi006.stdout: "object_hash": 2, 2023-08-01T19:55:37.230 INFO:teuthology.orchestra.run.smithi006.stdout: "pg_autoscale_mode": "off", 2023-08-01T19:55:37.230 INFO:teuthology.orchestra.run.smithi006.stdout: "pg_num": 1, 2023-08-01T19:55:37.230 INFO:teuthology.orchestra.run.smithi006.stdout: "pg_placement_num": 1, 2023-08-01T19:55:37.230 INFO:teuthology.orchestra.run.smithi006.stdout: "pg_placement_num_target": 1, 2023-08-01T19:55:37.230 INFO:teuthology.orchestra.run.smithi006.stdout: "pg_num_target": 1, 2023-08-01T19:55:37.230 INFO:teuthology.orchestra.run.smithi006.stdout: "pg_num_pending": 1, 2023-08-01T19:55:37.230 INFO:teuthology.orchestra.run.smithi006.stdout: "last_pg_merge_meta": { 2023-08-01T19:55:37.231 INFO:teuthology.orchestra.run.smithi006.stdout: "source_pgid": "0.0", 2023-08-01T19:55:37.231 INFO:teuthology.orchestra.run.smithi006.stdout: "ready_epoch": 0, 2023-08-01T19:55:37.231 INFO:teuthology.orchestra.run.smithi006.stdout: "last_epoch_started": 0, 2023-08-01T19:55:37.231 INFO:teuthology.orchestra.run.smithi006.stdout: "last_epoch_clean": 0, 2023-08-01T19:55:37.231 INFO:teuthology.orchestra.run.smithi006.stdout: "source_version": "0'0", 2023-08-01T19:55:37.231 INFO:teuthology.orchestra.run.smithi006.stdout: "target_version": "0'0" 2023-08-01T19:55:37.231 INFO:teuthology.orchestra.run.smithi006.stdout: }, 2023-08-01T19:55:37.232 INFO:teuthology.orchestra.run.smithi006.stdout: "last_change": "11", 2023-08-01T19:55:37.232 INFO:teuthology.orchestra.run.smithi006.stdout: "last_force_op_resend": "0", 2023-08-01T19:55:37.232 INFO:teuthology.orchestra.run.smithi006.stdout: "last_force_op_resend_prenautilus": "0", 2023-08-01T19:55:37.232 INFO:teuthology.orchestra.run.smithi006.stdout: "last_force_op_resend_preluminous": "0", 2023-08-01T19:55:37.232 INFO:teuthology.orchestra.run.smithi006.stdout: "auid": 0, 2023-08-01T19:55:37.233 INFO:teuthology.orchestra.run.smithi006.stdout: "snap_mode": "selfmanaged", 2023-08-01T19:55:37.233 INFO:teuthology.orchestra.run.smithi006.stdout: "snap_seq": 0, 2023-08-01T19:55:37.233 INFO:teuthology.orchestra.run.smithi006.stdout: "snap_epoch": 0, 2023-08-01T19:55:37.233 INFO:teuthology.orchestra.run.smithi006.stdout: "pool_snaps": [], 2023-08-01T19:55:37.233 INFO:teuthology.orchestra.run.smithi006.stdout: "removed_snaps": "[]", 2023-08-01T19:55:37.233 INFO:teuthology.orchestra.run.smithi006.stdout: "quota_max_bytes": 0, 2023-08-01T19:55:37.233 INFO:teuthology.orchestra.run.smithi006.stdout: "quota_max_objects": 0, 2023-08-01T19:55:37.234 INFO:teuthology.orchestra.run.smithi006.stdout: "tiers": [], 2023-08-01T19:55:37.234 INFO:teuthology.orchestra.run.smithi006.stdout: "tier_of": -1, 2023-08-01T19:55:37.234 INFO:teuthology.orchestra.run.smithi006.stdout: "read_tier": -1, 2023-08-01T19:55:37.234 INFO:teuthology.orchestra.run.smithi006.stdout: "write_tier": -1, 2023-08-01T19:55:37.235 INFO:teuthology.orchestra.run.smithi006.stdout: "cache_mode": "none", 2023-08-01T19:55:37.235 INFO:teuthology.orchestra.run.smithi006.stdout: "target_max_bytes": 0, 2023-08-01T19:55:37.235 INFO:teuthology.orchestra.run.smithi006.stdout: "target_max_objects": 0, 2023-08-01T19:55:37.235 INFO:teuthology.orchestra.run.smithi006.stdout: "cache_target_dirty_ratio_micro": 400000, 2023-08-01T19:55:37.236 INFO:teuthology.orchestra.run.smithi006.stdout: "cache_target_dirty_high_ratio_micro": 600000, 2023-08-01T19:55:37.236 INFO:teuthology.orchestra.run.smithi006.stdout: "cache_target_full_ratio_micro": 800000, 2023-08-01T19:55:37.236 INFO:teuthology.orchestra.run.smithi006.stdout: "cache_min_flush_age": 0, 2023-08-01T19:55:37.236 INFO:teuthology.orchestra.run.smithi006.stdout: "cache_min_evict_age": 0, 2023-08-01T19:55:37.237 INFO:teuthology.orchestra.run.smithi006.stdout: "erasure_code_profile": "", 2023-08-01T19:55:37.237 INFO:teuthology.orchestra.run.smithi006.stdout: "hit_set_params": { 2023-08-01T19:55:37.237 INFO:teuthology.orchestra.run.smithi006.stdout: "type": "none" 2023-08-01T19:55:37.237 INFO:teuthology.orchestra.run.smithi006.stdout: }, 2023-08-01T19:55:37.237 INFO:teuthology.orchestra.run.smithi006.stdout: "hit_set_period": 0, 2023-08-01T19:55:37.237 INFO:teuthology.orchestra.run.smithi006.stdout: "hit_set_count": 0, 2023-08-01T19:55:37.237 INFO:teuthology.orchestra.run.smithi006.stdout: "use_gmt_hitset": true, 2023-08-01T19:55:37.238 INFO:teuthology.orchestra.run.smithi006.stdout: "min_read_recency_for_promote": 0, 2023-08-01T19:55:37.238 INFO:teuthology.orchestra.run.smithi006.stdout: "min_write_recency_for_promote": 0, 2023-08-01T19:55:37.238 INFO:teuthology.orchestra.run.smithi006.stdout: "hit_set_grade_decay_rate": 0, 2023-08-01T19:55:37.238 INFO:teuthology.orchestra.run.smithi006.stdout: "hit_set_search_last_n": 0, 2023-08-01T19:55:37.238 INFO:teuthology.orchestra.run.smithi006.stdout: "grade_table": [], 2023-08-01T19:55:37.239 INFO:teuthology.orchestra.run.smithi006.stdout: "stripe_width": 0, 2023-08-01T19:55:37.239 INFO:teuthology.orchestra.run.smithi006.stdout: "expected_num_objects": 0, 2023-08-01T19:55:37.239 INFO:teuthology.orchestra.run.smithi006.stdout: "fast_read": false, 2023-08-01T19:55:37.239 INFO:teuthology.orchestra.run.smithi006.stdout: "options": { 2023-08-01T19:55:37.239 INFO:teuthology.orchestra.run.smithi006.stdout: "pg_num_max": 32, 2023-08-01T19:55:37.239 INFO:teuthology.orchestra.run.smithi006.stdout: "pg_num_min": 1 2023-08-01T19:55:37.239 INFO:teuthology.orchestra.run.smithi006.stdout: }, 2023-08-01T19:55:37.240 INFO:teuthology.orchestra.run.smithi006.stdout: "application_metadata": { 2023-08-01T19:55:37.240 INFO:teuthology.orchestra.run.smithi006.stdout: "mgr": {} 2023-08-01T19:55:37.240 INFO:teuthology.orchestra.run.smithi006.stdout: } 2023-08-01T19:55:37.240 INFO:teuthology.orchestra.run.smithi006.stdout: }, 2023-08-01T19:55:37.240 INFO:teuthology.orchestra.run.smithi006.stdout: { 2023-08-01T19:55:37.240 INFO:teuthology.orchestra.run.smithi006.stdout: "pool": 2, 2023-08-01T19:55:37.240 INFO:teuthology.orchestra.run.smithi006.stdout: "pool_name": "rbd", 2023-08-01T19:55:37.240 INFO:teuthology.orchestra.run.smithi006.stdout: "create_time": "2023-08-01T19:53:57.404091+0000", 2023-08-01T19:55:37.241 INFO:teuthology.orchestra.run.smithi006.stdout: "flags": 1, 2023-08-01T19:55:37.241 INFO:teuthology.orchestra.run.smithi006.stdout: "flags_names": "hashpspool", 2023-08-01T19:55:37.241 INFO:teuthology.orchestra.run.smithi006.stdout: "type": 1, 2023-08-01T19:55:37.241 INFO:teuthology.orchestra.run.smithi006.stdout: "size": 2, 2023-08-01T19:55:37.241 INFO:teuthology.orchestra.run.smithi006.stdout: "min_size": 1, 2023-08-01T19:55:37.241 INFO:teuthology.orchestra.run.smithi006.stdout: "crush_rule": 0, 2023-08-01T19:55:37.241 INFO:teuthology.orchestra.run.smithi006.stdout: "peering_crush_bucket_count": 0, 2023-08-01T19:55:37.242 INFO:teuthology.orchestra.run.smithi006.stdout: "peering_crush_bucket_target": 0, 2023-08-01T19:55:37.242 INFO:teuthology.orchestra.run.smithi006.stdout: "peering_crush_bucket_barrier": 0, 2023-08-01T19:55:37.242 INFO:teuthology.orchestra.run.smithi006.stdout: "peering_crush_bucket_mandatory_member": 2147483647, 2023-08-01T19:55:37.242 INFO:teuthology.orchestra.run.smithi006.stdout: "object_hash": 2, 2023-08-01T19:55:37.242 INFO:teuthology.orchestra.run.smithi006.stdout: "pg_autoscale_mode": "off", 2023-08-01T19:55:37.242 INFO:teuthology.orchestra.run.smithi006.stdout: "pg_num": 8, 2023-08-01T19:55:37.243 INFO:teuthology.orchestra.run.smithi006.stdout: "pg_placement_num": 8, 2023-08-01T19:55:37.243 INFO:teuthology.orchestra.run.smithi006.stdout: "pg_placement_num_target": 8, 2023-08-01T19:55:37.243 INFO:teuthology.orchestra.run.smithi006.stdout: "pg_num_target": 8, 2023-08-01T19:55:37.243 INFO:teuthology.orchestra.run.smithi006.stdout: "pg_num_pending": 8, 2023-08-01T19:55:37.243 INFO:teuthology.orchestra.run.smithi006.stdout: "last_pg_merge_meta": { 2023-08-01T19:55:37.243 INFO:teuthology.orchestra.run.smithi006.stdout: "source_pgid": "0.0", 2023-08-01T19:55:37.244 INFO:teuthology.orchestra.run.smithi006.stdout: "ready_epoch": 0, 2023-08-01T19:55:37.244 INFO:teuthology.orchestra.run.smithi006.stdout: "last_epoch_started": 0, 2023-08-01T19:55:37.244 INFO:teuthology.orchestra.run.smithi006.stdout: "last_epoch_clean": 0, 2023-08-01T19:55:37.244 INFO:teuthology.orchestra.run.smithi006.stdout: "source_version": "0'0", 2023-08-01T19:55:37.244 INFO:teuthology.orchestra.run.smithi006.stdout: "target_version": "0'0" 2023-08-01T19:55:37.244 INFO:teuthology.orchestra.run.smithi006.stdout: }, 2023-08-01T19:55:37.244 INFO:teuthology.orchestra.run.smithi006.stdout: "last_change": "14", 2023-08-01T19:55:37.245 INFO:teuthology.orchestra.run.smithi006.stdout: "last_force_op_resend": "0", 2023-08-01T19:55:37.245 INFO:teuthology.orchestra.run.smithi006.stdout: "last_force_op_resend_prenautilus": "0", 2023-08-01T19:55:37.245 INFO:teuthology.orchestra.run.smithi006.stdout: "last_force_op_resend_preluminous": "0", 2023-08-01T19:55:37.245 INFO:teuthology.orchestra.run.smithi006.stdout: "auid": 0, 2023-08-01T19:55:37.245 INFO:teuthology.orchestra.run.smithi006.stdout: "snap_mode": "selfmanaged", 2023-08-01T19:55:37.245 INFO:teuthology.orchestra.run.smithi006.stdout: "snap_seq": 0, 2023-08-01T19:55:37.245 INFO:teuthology.orchestra.run.smithi006.stdout: "snap_epoch": 0, 2023-08-01T19:55:37.245 INFO:teuthology.orchestra.run.smithi006.stdout: "pool_snaps": [], 2023-08-01T19:55:37.246 INFO:teuthology.orchestra.run.smithi006.stdout: "removed_snaps": "[]", 2023-08-01T19:55:37.246 INFO:teuthology.orchestra.run.smithi006.stdout: "quota_max_bytes": 0, 2023-08-01T19:55:37.246 INFO:teuthology.orchestra.run.smithi006.stdout: "quota_max_objects": 0, 2023-08-01T19:55:37.246 INFO:teuthology.orchestra.run.smithi006.stdout: "tiers": [], 2023-08-01T19:55:37.246 INFO:teuthology.orchestra.run.smithi006.stdout: "tier_of": -1, 2023-08-01T19:55:37.246 INFO:teuthology.orchestra.run.smithi006.stdout: "read_tier": -1, 2023-08-01T19:55:37.246 INFO:teuthology.orchestra.run.smithi006.stdout: "write_tier": -1, 2023-08-01T19:55:37.247 INFO:teuthology.orchestra.run.smithi006.stdout: "cache_mode": "none", 2023-08-01T19:55:37.247 INFO:teuthology.orchestra.run.smithi006.stdout: "target_max_bytes": 0, 2023-08-01T19:55:37.247 INFO:teuthology.orchestra.run.smithi006.stdout: "target_max_objects": 0, 2023-08-01T19:55:37.247 INFO:teuthology.orchestra.run.smithi006.stdout: "cache_target_dirty_ratio_micro": 400000, 2023-08-01T19:55:37.247 INFO:teuthology.orchestra.run.smithi006.stdout: "cache_target_dirty_high_ratio_micro": 600000, 2023-08-01T19:55:37.247 INFO:teuthology.orchestra.run.smithi006.stdout: "cache_target_full_ratio_micro": 800000, 2023-08-01T19:55:37.247 INFO:teuthology.orchestra.run.smithi006.stdout: "cache_min_flush_age": 0, 2023-08-01T19:55:37.247 INFO:teuthology.orchestra.run.smithi006.stdout: "cache_min_evict_age": 0, 2023-08-01T19:55:37.248 INFO:teuthology.orchestra.run.smithi006.stdout: "erasure_code_profile": "", 2023-08-01T19:55:37.248 INFO:teuthology.orchestra.run.smithi006.stdout: "hit_set_params": { 2023-08-01T19:55:37.248 INFO:teuthology.orchestra.run.smithi006.stdout: "type": "none" 2023-08-01T19:55:37.248 INFO:teuthology.orchestra.run.smithi006.stdout: }, 2023-08-01T19:55:37.248 INFO:teuthology.orchestra.run.smithi006.stdout: "hit_set_period": 0, 2023-08-01T19:55:37.248 INFO:teuthology.orchestra.run.smithi006.stdout: "hit_set_count": 0, 2023-08-01T19:55:37.248 INFO:teuthology.orchestra.run.smithi006.stdout: "use_gmt_hitset": true, 2023-08-01T19:55:37.249 INFO:teuthology.orchestra.run.smithi006.stdout: "min_read_recency_for_promote": 0, 2023-08-01T19:55:37.249 INFO:teuthology.orchestra.run.smithi006.stdout: "min_write_recency_for_promote": 0, 2023-08-01T19:55:37.249 INFO:teuthology.orchestra.run.smithi006.stdout: "hit_set_grade_decay_rate": 0, 2023-08-01T19:55:37.249 INFO:teuthology.orchestra.run.smithi006.stdout: "hit_set_search_last_n": 0, 2023-08-01T19:55:37.249 INFO:teuthology.orchestra.run.smithi006.stdout: "grade_table": [], 2023-08-01T19:55:37.249 INFO:teuthology.orchestra.run.smithi006.stdout: "stripe_width": 0, 2023-08-01T19:55:37.249 INFO:teuthology.orchestra.run.smithi006.stdout: "expected_num_objects": 0, 2023-08-01T19:55:37.249 INFO:teuthology.orchestra.run.smithi006.stdout: "fast_read": false, 2023-08-01T19:55:37.250 INFO:teuthology.orchestra.run.smithi006.stdout: "options": {}, 2023-08-01T19:55:37.250 INFO:teuthology.orchestra.run.smithi006.stdout: "application_metadata": { 2023-08-01T19:55:37.250 INFO:teuthology.orchestra.run.smithi006.stdout: "rbd": {} 2023-08-01T19:55:37.250 INFO:teuthology.orchestra.run.smithi006.stdout: } 2023-08-01T19:55:37.250 INFO:teuthology.orchestra.run.smithi006.stdout: }, 2023-08-01T19:55:37.250 INFO:teuthology.orchestra.run.smithi006.stdout: { 2023-08-01T19:55:37.250 INFO:teuthology.orchestra.run.smithi006.stdout: "pool": 3, 2023-08-01T19:55:37.251 INFO:teuthology.orchestra.run.smithi006.stdout: "pool_name": "cephfs_metadata", 2023-08-01T19:55:37.251 INFO:teuthology.orchestra.run.smithi006.stdout: "create_time": "2023-08-01T19:54:02.111247+0000", 2023-08-01T19:55:37.251 INFO:teuthology.orchestra.run.smithi006.stdout: "flags": 1, 2023-08-01T19:55:37.251 INFO:teuthology.orchestra.run.smithi006.stdout: "flags_names": "hashpspool", 2023-08-01T19:55:37.251 INFO:teuthology.orchestra.run.smithi006.stdout: "type": 1, 2023-08-01T19:55:37.252 INFO:teuthology.orchestra.run.smithi006.stdout: "size": 2, 2023-08-01T19:55:37.252 INFO:teuthology.orchestra.run.smithi006.stdout: "min_size": 1, 2023-08-01T19:55:37.252 INFO:teuthology.orchestra.run.smithi006.stdout: "crush_rule": 0, 2023-08-01T19:55:37.252 INFO:teuthology.orchestra.run.smithi006.stdout: "peering_crush_bucket_count": 0, 2023-08-01T19:55:37.252 INFO:teuthology.orchestra.run.smithi006.stdout: "peering_crush_bucket_target": 0, 2023-08-01T19:55:37.252 INFO:teuthology.orchestra.run.smithi006.stdout: "peering_crush_bucket_barrier": 0, 2023-08-01T19:55:37.252 INFO:teuthology.orchestra.run.smithi006.stdout: "peering_crush_bucket_mandatory_member": 2147483647, 2023-08-01T19:55:37.253 INFO:teuthology.orchestra.run.smithi006.stdout: "object_hash": 2, 2023-08-01T19:55:37.253 INFO:teuthology.orchestra.run.smithi006.stdout: "pg_autoscale_mode": "off", 2023-08-01T19:55:37.253 INFO:teuthology.orchestra.run.smithi006.stdout: "pg_num": 32, 2023-08-01T19:55:37.253 INFO:teuthology.orchestra.run.smithi006.stdout: "pg_placement_num": 32, 2023-08-01T19:55:37.253 INFO:teuthology.orchestra.run.smithi006.stdout: "pg_placement_num_target": 32, 2023-08-01T19:55:37.253 INFO:teuthology.orchestra.run.smithi006.stdout: "pg_num_target": 32, 2023-08-01T19:55:37.253 INFO:teuthology.orchestra.run.smithi006.stdout: "pg_num_pending": 32, 2023-08-01T19:55:37.253 INFO:teuthology.orchestra.run.smithi006.stdout: "last_pg_merge_meta": { 2023-08-01T19:55:37.254 INFO:teuthology.orchestra.run.smithi006.stdout: "source_pgid": "0.0", 2023-08-01T19:55:37.254 INFO:teuthology.orchestra.run.smithi006.stdout: "ready_epoch": 0, 2023-08-01T19:55:37.254 INFO:teuthology.orchestra.run.smithi006.stdout: "last_epoch_started": 0, 2023-08-01T19:55:37.254 INFO:teuthology.orchestra.run.smithi006.stdout: "last_epoch_clean": 0, 2023-08-01T19:55:37.254 INFO:teuthology.orchestra.run.smithi006.stdout: "source_version": "0'0", 2023-08-01T19:55:37.254 INFO:teuthology.orchestra.run.smithi006.stdout: "target_version": "0'0" 2023-08-01T19:55:37.254 INFO:teuthology.orchestra.run.smithi006.stdout: }, 2023-08-01T19:55:37.254 INFO:teuthology.orchestra.run.smithi006.stdout: "last_change": "17", 2023-08-01T19:55:37.255 INFO:teuthology.orchestra.run.smithi006.stdout: "last_force_op_resend": "0", 2023-08-01T19:55:37.255 INFO:teuthology.orchestra.run.smithi006.stdout: "last_force_op_resend_prenautilus": "0", 2023-08-01T19:55:37.255 INFO:teuthology.orchestra.run.smithi006.stdout: "last_force_op_resend_preluminous": "0", 2023-08-01T19:55:37.255 INFO:teuthology.orchestra.run.smithi006.stdout: "auid": 0, 2023-08-01T19:55:37.255 INFO:teuthology.orchestra.run.smithi006.stdout: "snap_mode": "selfmanaged", 2023-08-01T19:55:37.255 INFO:teuthology.orchestra.run.smithi006.stdout: "snap_seq": 0, 2023-08-01T19:55:37.255 INFO:teuthology.orchestra.run.smithi006.stdout: "snap_epoch": 0, 2023-08-01T19:55:37.255 INFO:teuthology.orchestra.run.smithi006.stdout: "pool_snaps": [], 2023-08-01T19:55:37.256 INFO:teuthology.orchestra.run.smithi006.stdout: "removed_snaps": "[]", 2023-08-01T19:55:37.256 INFO:teuthology.orchestra.run.smithi006.stdout: "quota_max_bytes": 0, 2023-08-01T19:55:37.256 INFO:teuthology.orchestra.run.smithi006.stdout: "quota_max_objects": 0, 2023-08-01T19:55:37.256 INFO:teuthology.orchestra.run.smithi006.stdout: "tiers": [], 2023-08-01T19:55:37.256 INFO:teuthology.orchestra.run.smithi006.stdout: "tier_of": -1, 2023-08-01T19:55:37.256 INFO:teuthology.orchestra.run.smithi006.stdout: "read_tier": -1, 2023-08-01T19:55:37.256 INFO:teuthology.orchestra.run.smithi006.stdout: "write_tier": -1, 2023-08-01T19:55:37.257 INFO:teuthology.orchestra.run.smithi006.stdout: "cache_mode": "none", 2023-08-01T19:55:37.257 INFO:teuthology.orchestra.run.smithi006.stdout: "target_max_bytes": 0, 2023-08-01T19:55:37.257 INFO:teuthology.orchestra.run.smithi006.stdout: "target_max_objects": 0, 2023-08-01T19:55:37.257 INFO:teuthology.orchestra.run.smithi006.stdout: "cache_target_dirty_ratio_micro": 400000, 2023-08-01T19:55:37.257 INFO:teuthology.orchestra.run.smithi006.stdout: "cache_target_dirty_high_ratio_micro": 600000, 2023-08-01T19:55:37.257 INFO:teuthology.orchestra.run.smithi006.stdout: "cache_target_full_ratio_micro": 800000, 2023-08-01T19:55:37.257 INFO:teuthology.orchestra.run.smithi006.stdout: "cache_min_flush_age": 0, 2023-08-01T19:55:37.257 INFO:teuthology.orchestra.run.smithi006.stdout: "cache_min_evict_age": 0, 2023-08-01T19:55:37.258 INFO:teuthology.orchestra.run.smithi006.stdout: "erasure_code_profile": "", 2023-08-01T19:55:37.258 INFO:teuthology.orchestra.run.smithi006.stdout: "hit_set_params": { 2023-08-01T19:55:37.258 INFO:teuthology.orchestra.run.smithi006.stdout: "type": "none" 2023-08-01T19:55:37.258 INFO:teuthology.orchestra.run.smithi006.stdout: }, 2023-08-01T19:55:37.258 INFO:teuthology.orchestra.run.smithi006.stdout: "hit_set_period": 0, 2023-08-01T19:55:37.258 INFO:teuthology.orchestra.run.smithi006.stdout: "hit_set_count": 0, 2023-08-01T19:55:37.258 INFO:teuthology.orchestra.run.smithi006.stdout: "use_gmt_hitset": true, 2023-08-01T19:55:37.259 INFO:teuthology.orchestra.run.smithi006.stdout: "min_read_recency_for_promote": 0, 2023-08-01T19:55:37.259 INFO:teuthology.orchestra.run.smithi006.stdout: "min_write_recency_for_promote": 0, 2023-08-01T19:55:37.259 INFO:teuthology.orchestra.run.smithi006.stdout: "hit_set_grade_decay_rate": 0, 2023-08-01T19:55:37.259 INFO:teuthology.orchestra.run.smithi006.stdout: "hit_set_search_last_n": 0, 2023-08-01T19:55:37.259 INFO:teuthology.orchestra.run.smithi006.stdout: "grade_table": [], 2023-08-01T19:55:37.259 INFO:teuthology.orchestra.run.smithi006.stdout: "stripe_width": 0, 2023-08-01T19:55:37.259 INFO:teuthology.orchestra.run.smithi006.stdout: "expected_num_objects": 0, 2023-08-01T19:55:37.260 INFO:teuthology.orchestra.run.smithi006.stdout: "fast_read": false, 2023-08-01T19:55:37.260 INFO:teuthology.orchestra.run.smithi006.stdout: "options": { 2023-08-01T19:55:37.260 INFO:teuthology.orchestra.run.smithi006.stdout: "pg_autoscale_bias": 4, 2023-08-01T19:55:37.260 INFO:teuthology.orchestra.run.smithi006.stdout: "pg_num_min": 16, 2023-08-01T19:55:37.260 INFO:teuthology.orchestra.run.smithi006.stdout: "recovery_priority": 5 2023-08-01T19:55:37.260 INFO:teuthology.orchestra.run.smithi006.stdout: }, 2023-08-01T19:55:37.260 INFO:teuthology.orchestra.run.smithi006.stdout: "application_metadata": { 2023-08-01T19:55:37.261 INFO:teuthology.orchestra.run.smithi006.stdout: "cephfs": { 2023-08-01T19:55:37.261 INFO:teuthology.orchestra.run.smithi006.stdout: "metadata": "cephfs" 2023-08-01T19:55:37.261 INFO:teuthology.orchestra.run.smithi006.stdout: } 2023-08-01T19:55:37.261 INFO:teuthology.orchestra.run.smithi006.stdout: } 2023-08-01T19:55:37.261 INFO:teuthology.orchestra.run.smithi006.stdout: }, 2023-08-01T19:55:37.261 INFO:teuthology.orchestra.run.smithi006.stdout: { 2023-08-01T19:55:37.261 INFO:teuthology.orchestra.run.smithi006.stdout: "pool": 4, 2023-08-01T19:55:37.262 INFO:teuthology.orchestra.run.smithi006.stdout: "pool_name": "cephfs_data", 2023-08-01T19:55:37.262 INFO:teuthology.orchestra.run.smithi006.stdout: "create_time": "2023-08-01T19:54:03.430277+0000", 2023-08-01T19:55:37.262 INFO:teuthology.orchestra.run.smithi006.stdout: "flags": 1, 2023-08-01T19:55:37.262 INFO:teuthology.orchestra.run.smithi006.stdout: "flags_names": "hashpspool", 2023-08-01T19:55:37.262 INFO:teuthology.orchestra.run.smithi006.stdout: "type": 1, 2023-08-01T19:55:37.262 INFO:teuthology.orchestra.run.smithi006.stdout: "size": 2, 2023-08-01T19:55:37.262 INFO:teuthology.orchestra.run.smithi006.stdout: "min_size": 1, 2023-08-01T19:55:37.262 INFO:teuthology.orchestra.run.smithi006.stdout: "crush_rule": 0, 2023-08-01T19:55:37.263 INFO:teuthology.orchestra.run.smithi006.stdout: "peering_crush_bucket_count": 0, 2023-08-01T19:55:37.263 INFO:teuthology.orchestra.run.smithi006.stdout: "peering_crush_bucket_target": 0, 2023-08-01T19:55:37.263 INFO:teuthology.orchestra.run.smithi006.stdout: "peering_crush_bucket_barrier": 0, 2023-08-01T19:55:37.263 INFO:teuthology.orchestra.run.smithi006.stdout: "peering_crush_bucket_mandatory_member": 2147483647, 2023-08-01T19:55:37.263 INFO:teuthology.orchestra.run.smithi006.stdout: "object_hash": 2, 2023-08-01T19:55:37.263 INFO:teuthology.orchestra.run.smithi006.stdout: "pg_autoscale_mode": "off", 2023-08-01T19:55:37.263 INFO:teuthology.orchestra.run.smithi006.stdout: "pg_num": 64, 2023-08-01T19:55:37.263 INFO:teuthology.orchestra.run.smithi006.stdout: "pg_placement_num": 64, 2023-08-01T19:55:37.264 INFO:teuthology.orchestra.run.smithi006.stdout: "pg_placement_num_target": 64, 2023-08-01T19:55:37.264 INFO:teuthology.orchestra.run.smithi006.stdout: "pg_num_target": 64, 2023-08-01T19:55:37.264 INFO:teuthology.orchestra.run.smithi006.stdout: "pg_num_pending": 64, 2023-08-01T19:55:37.264 INFO:teuthology.orchestra.run.smithi006.stdout: "last_pg_merge_meta": { 2023-08-01T19:55:37.264 INFO:teuthology.orchestra.run.smithi006.stdout: "source_pgid": "0.0", 2023-08-01T19:55:37.264 INFO:teuthology.orchestra.run.smithi006.stdout: "ready_epoch": 0, 2023-08-01T19:55:37.264 INFO:teuthology.orchestra.run.smithi006.stdout: "last_epoch_started": 0, 2023-08-01T19:55:37.264 INFO:teuthology.orchestra.run.smithi006.stdout: "last_epoch_clean": 0, 2023-08-01T19:55:37.265 INFO:teuthology.orchestra.run.smithi006.stdout: "source_version": "0'0", 2023-08-01T19:55:37.265 INFO:teuthology.orchestra.run.smithi006.stdout: "target_version": "0'0" 2023-08-01T19:55:37.265 INFO:teuthology.orchestra.run.smithi006.stdout: }, 2023-08-01T19:55:37.265 INFO:teuthology.orchestra.run.smithi006.stdout: "last_change": "18", 2023-08-01T19:55:37.265 INFO:teuthology.orchestra.run.smithi006.stdout: "last_force_op_resend": "0", 2023-08-01T19:55:37.265 INFO:teuthology.orchestra.run.smithi006.stdout: "last_force_op_resend_prenautilus": "0", 2023-08-01T19:55:37.265 INFO:teuthology.orchestra.run.smithi006.stdout: "last_force_op_resend_preluminous": "0", 2023-08-01T19:55:37.265 INFO:teuthology.orchestra.run.smithi006.stdout: "auid": 0, 2023-08-01T19:55:37.266 INFO:teuthology.orchestra.run.smithi006.stdout: "snap_mode": "selfmanaged", 2023-08-01T19:55:37.266 INFO:teuthology.orchestra.run.smithi006.stdout: "snap_seq": 0, 2023-08-01T19:55:37.266 INFO:teuthology.orchestra.run.smithi006.stdout: "snap_epoch": 0, 2023-08-01T19:55:37.266 INFO:teuthology.orchestra.run.smithi006.stdout: "pool_snaps": [], 2023-08-01T19:55:37.266 INFO:teuthology.orchestra.run.smithi006.stdout: "removed_snaps": "[]", 2023-08-01T19:55:37.266 INFO:teuthology.orchestra.run.smithi006.stdout: "quota_max_bytes": 0, 2023-08-01T19:55:37.266 INFO:teuthology.orchestra.run.smithi006.stdout: "quota_max_objects": 0, 2023-08-01T19:55:37.266 INFO:teuthology.orchestra.run.smithi006.stdout: "tiers": [], 2023-08-01T19:55:37.267 INFO:teuthology.orchestra.run.smithi006.stdout: "tier_of": -1, 2023-08-01T19:55:37.267 INFO:teuthology.orchestra.run.smithi006.stdout: "read_tier": -1, 2023-08-01T19:55:37.267 INFO:teuthology.orchestra.run.smithi006.stdout: "write_tier": -1, 2023-08-01T19:55:37.267 INFO:teuthology.orchestra.run.smithi006.stdout: "cache_mode": "none", 2023-08-01T19:55:37.267 INFO:teuthology.orchestra.run.smithi006.stdout: "target_max_bytes": 0, 2023-08-01T19:55:37.267 INFO:teuthology.orchestra.run.smithi006.stdout: "target_max_objects": 0, 2023-08-01T19:55:37.267 INFO:teuthology.orchestra.run.smithi006.stdout: "cache_target_dirty_ratio_micro": 400000, 2023-08-01T19:55:37.267 INFO:teuthology.orchestra.run.smithi006.stdout: "cache_target_dirty_high_ratio_micro": 600000, 2023-08-01T19:55:37.268 INFO:teuthology.orchestra.run.smithi006.stdout: "cache_target_full_ratio_micro": 800000, 2023-08-01T19:55:37.268 INFO:teuthology.orchestra.run.smithi006.stdout: "cache_min_flush_age": 0, 2023-08-01T19:55:37.268 INFO:teuthology.orchestra.run.smithi006.stdout: "cache_min_evict_age": 0, 2023-08-01T19:55:37.268 INFO:teuthology.orchestra.run.smithi006.stdout: "erasure_code_profile": "", 2023-08-01T19:55:37.268 INFO:teuthology.orchestra.run.smithi006.stdout: "hit_set_params": { 2023-08-01T19:55:37.268 INFO:teuthology.orchestra.run.smithi006.stdout: "type": "none" 2023-08-01T19:55:37.268 INFO:teuthology.orchestra.run.smithi006.stdout: }, 2023-08-01T19:55:37.269 INFO:teuthology.orchestra.run.smithi006.stdout: "hit_set_period": 0, 2023-08-01T19:55:37.269 INFO:teuthology.orchestra.run.smithi006.stdout: "hit_set_count": 0, 2023-08-01T19:55:37.269 INFO:teuthology.orchestra.run.smithi006.stdout: "use_gmt_hitset": true, 2023-08-01T19:55:37.269 INFO:teuthology.orchestra.run.smithi006.stdout: "min_read_recency_for_promote": 0, 2023-08-01T19:55:37.269 INFO:teuthology.orchestra.run.smithi006.stdout: "min_write_recency_for_promote": 0, 2023-08-01T19:55:37.269 INFO:teuthology.orchestra.run.smithi006.stdout: "hit_set_grade_decay_rate": 0, 2023-08-01T19:55:37.269 INFO:teuthology.orchestra.run.smithi006.stdout: "hit_set_search_last_n": 0, 2023-08-01T19:55:37.269 INFO:teuthology.orchestra.run.smithi006.stdout: "grade_table": [], 2023-08-01T19:55:37.270 INFO:teuthology.orchestra.run.smithi006.stdout: "stripe_width": 0, 2023-08-01T19:55:37.270 INFO:teuthology.orchestra.run.smithi006.stdout: "expected_num_objects": 0, 2023-08-01T19:55:37.270 INFO:teuthology.orchestra.run.smithi006.stdout: "fast_read": false, 2023-08-01T19:55:37.270 INFO:teuthology.orchestra.run.smithi006.stdout: "options": { 2023-08-01T19:55:37.270 INFO:teuthology.orchestra.run.smithi006.stdout: "pg_num_min": 64, 2023-08-01T19:55:37.270 INFO:teuthology.orchestra.run.smithi006.stdout: "target_size_ratio": 0.89999997615814209 2023-08-01T19:55:37.270 INFO:teuthology.orchestra.run.smithi006.stdout: }, 2023-08-01T19:55:37.271 INFO:teuthology.orchestra.run.smithi006.stdout: "application_metadata": { 2023-08-01T19:55:37.271 INFO:teuthology.orchestra.run.smithi006.stdout: "cephfs": { 2023-08-01T19:55:37.271 INFO:teuthology.orchestra.run.smithi006.stdout: "data": "cephfs" 2023-08-01T19:55:37.271 INFO:teuthology.orchestra.run.smithi006.stdout: } 2023-08-01T19:55:37.271 INFO:teuthology.orchestra.run.smithi006.stdout: } 2023-08-01T19:55:37.271 INFO:teuthology.orchestra.run.smithi006.stdout: }, 2023-08-01T19:55:37.271 INFO:teuthology.orchestra.run.smithi006.stdout: { 2023-08-01T19:55:37.271 INFO:teuthology.orchestra.run.smithi006.stdout: "pool": 5, 2023-08-01T19:55:37.272 INFO:teuthology.orchestra.run.smithi006.stdout: "pool_name": "unique_pool_0", 2023-08-01T19:55:37.272 INFO:teuthology.orchestra.run.smithi006.stdout: "create_time": "2023-08-01T19:54:21.165668+0000", 2023-08-01T19:55:37.272 INFO:teuthology.orchestra.run.smithi006.stdout: "flags": 1, 2023-08-01T19:55:37.272 INFO:teuthology.orchestra.run.smithi006.stdout: "flags_names": "hashpspool", 2023-08-01T19:55:37.272 INFO:teuthology.orchestra.run.smithi006.stdout: "type": 1, 2023-08-01T19:55:37.272 INFO:teuthology.orchestra.run.smithi006.stdout: "size": 2, 2023-08-01T19:55:37.272 INFO:teuthology.orchestra.run.smithi006.stdout: "min_size": 1, 2023-08-01T19:55:37.273 INFO:teuthology.orchestra.run.smithi006.stdout: "crush_rule": 0, 2023-08-01T19:55:37.273 INFO:teuthology.orchestra.run.smithi006.stdout: "peering_crush_bucket_count": 0, 2023-08-01T19:55:37.273 INFO:teuthology.orchestra.run.smithi006.stdout: "peering_crush_bucket_target": 0, 2023-08-01T19:55:37.273 INFO:teuthology.orchestra.run.smithi006.stdout: "peering_crush_bucket_barrier": 0, 2023-08-01T19:55:37.273 INFO:teuthology.orchestra.run.smithi006.stdout: "peering_crush_bucket_mandatory_member": 2147483647, 2023-08-01T19:55:37.273 INFO:teuthology.orchestra.run.smithi006.stdout: "object_hash": 2, 2023-08-01T19:55:37.273 INFO:teuthology.orchestra.run.smithi006.stdout: "pg_autoscale_mode": "off", 2023-08-01T19:55:37.273 INFO:teuthology.orchestra.run.smithi006.stdout: "pg_num": 16, 2023-08-01T19:55:37.274 INFO:teuthology.orchestra.run.smithi006.stdout: "pg_placement_num": 16, 2023-08-01T19:55:37.274 INFO:teuthology.orchestra.run.smithi006.stdout: "pg_placement_num_target": 16, 2023-08-01T19:55:37.274 INFO:teuthology.orchestra.run.smithi006.stdout: "pg_num_target": 16, 2023-08-01T19:55:37.274 INFO:teuthology.orchestra.run.smithi006.stdout: "pg_num_pending": 16, 2023-08-01T19:55:37.274 INFO:teuthology.orchestra.run.smithi006.stdout: "last_pg_merge_meta": { 2023-08-01T19:55:37.274 INFO:teuthology.orchestra.run.smithi006.stdout: "source_pgid": "0.0", 2023-08-01T19:55:37.274 INFO:teuthology.orchestra.run.smithi006.stdout: "ready_epoch": 0, 2023-08-01T19:55:37.274 INFO:teuthology.orchestra.run.smithi006.stdout: "last_epoch_started": 0, 2023-08-01T19:55:37.275 INFO:teuthology.orchestra.run.smithi006.stdout: "last_epoch_clean": 0, 2023-08-01T19:55:37.275 INFO:teuthology.orchestra.run.smithi006.stdout: "source_version": "0'0", 2023-08-01T19:55:37.275 INFO:teuthology.orchestra.run.smithi006.stdout: "target_version": "0'0" 2023-08-01T19:55:37.275 INFO:teuthology.orchestra.run.smithi006.stdout: }, 2023-08-01T19:55:37.275 INFO:teuthology.orchestra.run.smithi006.stdout: "last_change": "21", 2023-08-01T19:55:37.275 INFO:teuthology.orchestra.run.smithi006.stdout: "last_force_op_resend": "0", 2023-08-01T19:55:37.275 INFO:teuthology.orchestra.run.smithi006.stdout: "last_force_op_resend_prenautilus": "0", 2023-08-01T19:55:37.276 INFO:teuthology.orchestra.run.smithi006.stdout: "last_force_op_resend_preluminous": "0", 2023-08-01T19:55:37.276 INFO:teuthology.orchestra.run.smithi006.stdout: "auid": 0, 2023-08-01T19:55:37.276 INFO:teuthology.orchestra.run.smithi006.stdout: "snap_mode": "selfmanaged", 2023-08-01T19:55:37.276 INFO:teuthology.orchestra.run.smithi006.stdout: "snap_seq": 0, 2023-08-01T19:55:37.276 INFO:teuthology.orchestra.run.smithi006.stdout: "snap_epoch": 0, 2023-08-01T19:55:37.276 INFO:teuthology.orchestra.run.smithi006.stdout: "pool_snaps": [], 2023-08-01T19:55:37.276 INFO:teuthology.orchestra.run.smithi006.stdout: "removed_snaps": "[]", 2023-08-01T19:55:37.276 INFO:teuthology.orchestra.run.smithi006.stdout: "quota_max_bytes": 0, 2023-08-01T19:55:37.277 INFO:teuthology.orchestra.run.smithi006.stdout: "quota_max_objects": 0, 2023-08-01T19:55:37.277 INFO:teuthology.orchestra.run.smithi006.stdout: "tiers": [], 2023-08-01T19:55:37.277 INFO:teuthology.orchestra.run.smithi006.stdout: "tier_of": -1, 2023-08-01T19:55:37.277 INFO:teuthology.orchestra.run.smithi006.stdout: "read_tier": -1, 2023-08-01T19:55:37.277 INFO:teuthology.orchestra.run.smithi006.stdout: "write_tier": -1, 2023-08-01T19:55:37.277 INFO:teuthology.orchestra.run.smithi006.stdout: "cache_mode": "none", 2023-08-01T19:55:37.277 INFO:teuthology.orchestra.run.smithi006.stdout: "target_max_bytes": 0, 2023-08-01T19:55:37.278 INFO:teuthology.orchestra.run.smithi006.stdout: "target_max_objects": 0, 2023-08-01T19:55:37.278 INFO:teuthology.orchestra.run.smithi006.stdout: "cache_target_dirty_ratio_micro": 400000, 2023-08-01T19:55:37.278 INFO:teuthology.orchestra.run.smithi006.stdout: "cache_target_dirty_high_ratio_micro": 600000, 2023-08-01T19:55:37.278 INFO:teuthology.orchestra.run.smithi006.stdout: "cache_target_full_ratio_micro": 800000, 2023-08-01T19:55:37.278 INFO:teuthology.orchestra.run.smithi006.stdout: "cache_min_flush_age": 0, 2023-08-01T19:55:37.278 INFO:teuthology.orchestra.run.smithi006.stdout: "cache_min_evict_age": 0, 2023-08-01T19:55:37.278 INFO:teuthology.orchestra.run.smithi006.stdout: "erasure_code_profile": "", 2023-08-01T19:55:37.279 INFO:teuthology.orchestra.run.smithi006.stdout: "hit_set_params": { 2023-08-01T19:55:37.279 INFO:teuthology.orchestra.run.smithi006.stdout: "type": "none" 2023-08-01T19:55:37.279 INFO:teuthology.orchestra.run.smithi006.stdout: }, 2023-08-01T19:55:37.279 INFO:teuthology.orchestra.run.smithi006.stdout: "hit_set_period": 0, 2023-08-01T19:55:37.279 INFO:teuthology.orchestra.run.smithi006.stdout: "hit_set_count": 0, 2023-08-01T19:55:37.279 INFO:teuthology.orchestra.run.smithi006.stdout: "use_gmt_hitset": true, 2023-08-01T19:55:37.279 INFO:teuthology.orchestra.run.smithi006.stdout: "min_read_recency_for_promote": 0, 2023-08-01T19:55:37.280 INFO:teuthology.orchestra.run.smithi006.stdout: "min_write_recency_for_promote": 0, 2023-08-01T19:55:37.280 INFO:teuthology.orchestra.run.smithi006.stdout: "hit_set_grade_decay_rate": 0, 2023-08-01T19:55:37.280 INFO:teuthology.orchestra.run.smithi006.stdout: "hit_set_search_last_n": 0, 2023-08-01T19:55:37.280 INFO:teuthology.orchestra.run.smithi006.stdout: "grade_table": [], 2023-08-01T19:55:37.280 INFO:teuthology.orchestra.run.smithi006.stdout: "stripe_width": 0, 2023-08-01T19:55:37.280 INFO:teuthology.orchestra.run.smithi006.stdout: "expected_num_objects": 0, 2023-08-01T19:55:37.280 INFO:teuthology.orchestra.run.smithi006.stdout: "fast_read": false, 2023-08-01T19:55:37.280 INFO:teuthology.orchestra.run.smithi006.stdout: "options": {}, 2023-08-01T19:55:37.281 INFO:teuthology.orchestra.run.smithi006.stdout: "application_metadata": { 2023-08-01T19:55:37.281 INFO:teuthology.orchestra.run.smithi006.stdout: "rados": {} 2023-08-01T19:55:37.281 INFO:teuthology.orchestra.run.smithi006.stdout: } 2023-08-01T19:55:37.281 INFO:teuthology.orchestra.run.smithi006.stdout: } 2023-08-01T19:55:37.281 INFO:teuthology.orchestra.run.smithi006.stdout: ], 2023-08-01T19:55:37.281 INFO:teuthology.orchestra.run.smithi006.stdout: "osds": [ 2023-08-01T19:55:37.281 INFO:teuthology.orchestra.run.smithi006.stdout: { 2023-08-01T19:55:37.281 INFO:teuthology.orchestra.run.smithi006.stdout: "osd": 0, 2023-08-01T19:55:37.282 INFO:teuthology.orchestra.run.smithi006.stdout: "uuid": "5dd675c7-2777-48f2-8009-ff0e0d4c7086", 2023-08-01T19:55:37.282 INFO:teuthology.orchestra.run.smithi006.stdout: "up": 1, 2023-08-01T19:55:37.282 INFO:teuthology.orchestra.run.smithi006.stdout: "in": 1, 2023-08-01T19:55:37.282 INFO:teuthology.orchestra.run.smithi006.stdout: "weight": 1, 2023-08-01T19:55:37.282 INFO:teuthology.orchestra.run.smithi006.stdout: "primary_affinity": 1, 2023-08-01T19:55:37.282 INFO:teuthology.orchestra.run.smithi006.stdout: "last_clean_begin": 0, 2023-08-01T19:55:37.282 INFO:teuthology.orchestra.run.smithi006.stdout: "last_clean_end": 0, 2023-08-01T19:55:37.283 INFO:teuthology.orchestra.run.smithi006.stdout: "up_from": 8, 2023-08-01T19:55:37.283 INFO:teuthology.orchestra.run.smithi006.stdout: "up_thru": 40, 2023-08-01T19:55:37.283 INFO:teuthology.orchestra.run.smithi006.stdout: "down_at": 0, 2023-08-01T19:55:37.283 INFO:teuthology.orchestra.run.smithi006.stdout: "lost_at": 0, 2023-08-01T19:55:37.283 INFO:teuthology.orchestra.run.smithi006.stdout: "public_addrs": { 2023-08-01T19:55:37.283 INFO:teuthology.orchestra.run.smithi006.stdout: "addrvec": [ 2023-08-01T19:55:37.283 INFO:teuthology.orchestra.run.smithi006.stdout: { 2023-08-01T19:55:37.283 INFO:teuthology.orchestra.run.smithi006.stdout: "type": "v2", 2023-08-01T19:55:37.284 INFO:teuthology.orchestra.run.smithi006.stdout: "addr": "172.21.15.8:6800", 2023-08-01T19:55:37.284 INFO:teuthology.orchestra.run.smithi006.stdout: "nonce": 111181 2023-08-01T19:55:37.284 INFO:teuthology.orchestra.run.smithi006.stdout: }, 2023-08-01T19:55:37.284 INFO:teuthology.orchestra.run.smithi006.stdout: { 2023-08-01T19:55:37.284 INFO:teuthology.orchestra.run.smithi006.stdout: "type": "v1", 2023-08-01T19:55:37.284 INFO:teuthology.orchestra.run.smithi006.stdout: "addr": "172.21.15.8:6801", 2023-08-01T19:55:37.284 INFO:teuthology.orchestra.run.smithi006.stdout: "nonce": 111181 2023-08-01T19:55:37.285 INFO:teuthology.orchestra.run.smithi006.stdout: } 2023-08-01T19:55:37.285 INFO:teuthology.orchestra.run.smithi006.stdout: ] 2023-08-01T19:55:37.285 INFO:teuthology.orchestra.run.smithi006.stdout: }, 2023-08-01T19:55:37.285 INFO:teuthology.orchestra.run.smithi006.stdout: "cluster_addrs": { 2023-08-01T19:55:37.285 INFO:teuthology.orchestra.run.smithi006.stdout: "addrvec": [ 2023-08-01T19:55:37.285 INFO:teuthology.orchestra.run.smithi006.stdout: { 2023-08-01T19:55:37.285 INFO:teuthology.orchestra.run.smithi006.stdout: "type": "v2", 2023-08-01T19:55:37.285 INFO:teuthology.orchestra.run.smithi006.stdout: "addr": "172.21.15.8:6802", 2023-08-01T19:55:37.286 INFO:teuthology.orchestra.run.smithi006.stdout: "nonce": 111181 2023-08-01T19:55:37.286 INFO:teuthology.orchestra.run.smithi006.stdout: }, 2023-08-01T19:55:37.286 INFO:teuthology.orchestra.run.smithi006.stdout: { 2023-08-01T19:55:37.286 INFO:teuthology.orchestra.run.smithi006.stdout: "type": "v1", 2023-08-01T19:55:37.286 INFO:teuthology.orchestra.run.smithi006.stdout: "addr": "172.21.15.8:6803", 2023-08-01T19:55:37.286 INFO:teuthology.orchestra.run.smithi006.stdout: "nonce": 111181 2023-08-01T19:55:37.286 INFO:teuthology.orchestra.run.smithi006.stdout: } 2023-08-01T19:55:37.287 INFO:teuthology.orchestra.run.smithi006.stdout: ] 2023-08-01T19:55:37.287 INFO:teuthology.orchestra.run.smithi006.stdout: }, 2023-08-01T19:55:37.287 INFO:teuthology.orchestra.run.smithi006.stdout: "heartbeat_back_addrs": { 2023-08-01T19:55:37.287 INFO:teuthology.orchestra.run.smithi006.stdout: "addrvec": [ 2023-08-01T19:55:37.287 INFO:teuthology.orchestra.run.smithi006.stdout: { 2023-08-01T19:55:37.287 INFO:teuthology.orchestra.run.smithi006.stdout: "type": "v2", 2023-08-01T19:55:37.287 INFO:teuthology.orchestra.run.smithi006.stdout: "addr": "172.21.15.8:6806", 2023-08-01T19:55:37.288 INFO:teuthology.orchestra.run.smithi006.stdout: "nonce": 111181 2023-08-01T19:55:37.288 INFO:teuthology.orchestra.run.smithi006.stdout: }, 2023-08-01T19:55:37.288 INFO:teuthology.orchestra.run.smithi006.stdout: { 2023-08-01T19:55:37.288 INFO:teuthology.orchestra.run.smithi006.stdout: "type": "v1", 2023-08-01T19:55:37.288 INFO:teuthology.orchestra.run.smithi006.stdout: "addr": "172.21.15.8:6807", 2023-08-01T19:55:37.288 INFO:teuthology.orchestra.run.smithi006.stdout: "nonce": 111181 2023-08-01T19:55:37.288 INFO:teuthology.orchestra.run.smithi006.stdout: } 2023-08-01T19:55:37.288 INFO:teuthology.orchestra.run.smithi006.stdout: ] 2023-08-01T19:55:37.289 INFO:teuthology.orchestra.run.smithi006.stdout: }, 2023-08-01T19:55:37.289 INFO:teuthology.orchestra.run.smithi006.stdout: "heartbeat_front_addrs": { 2023-08-01T19:55:37.289 INFO:teuthology.orchestra.run.smithi006.stdout: "addrvec": [ 2023-08-01T19:55:37.289 INFO:teuthology.orchestra.run.smithi006.stdout: { 2023-08-01T19:55:37.289 INFO:teuthology.orchestra.run.smithi006.stdout: "type": "v2", 2023-08-01T19:55:37.289 INFO:teuthology.orchestra.run.smithi006.stdout: "addr": "172.21.15.8:6804", 2023-08-01T19:55:37.289 INFO:teuthology.orchestra.run.smithi006.stdout: "nonce": 111181 2023-08-01T19:55:37.290 INFO:teuthology.orchestra.run.smithi006.stdout: }, 2023-08-01T19:55:37.290 INFO:teuthology.orchestra.run.smithi006.stdout: { 2023-08-01T19:55:37.290 INFO:teuthology.orchestra.run.smithi006.stdout: "type": "v1", 2023-08-01T19:55:37.290 INFO:teuthology.orchestra.run.smithi006.stdout: "addr": "172.21.15.8:6805", 2023-08-01T19:55:37.290 INFO:teuthology.orchestra.run.smithi006.stdout: "nonce": 111181 2023-08-01T19:55:37.290 INFO:teuthology.orchestra.run.smithi006.stdout: } 2023-08-01T19:55:37.290 INFO:teuthology.orchestra.run.smithi006.stdout: ] 2023-08-01T19:55:37.290 INFO:teuthology.orchestra.run.smithi006.stdout: }, 2023-08-01T19:55:37.291 INFO:teuthology.orchestra.run.smithi006.stdout: "public_addr": "172.21.15.8:6801/111181", 2023-08-01T19:55:37.291 INFO:teuthology.orchestra.run.smithi006.stdout: "cluster_addr": "172.21.15.8:6803/111181", 2023-08-01T19:55:37.291 INFO:teuthology.orchestra.run.smithi006.stdout: "heartbeat_back_addr": "172.21.15.8:6807/111181", 2023-08-01T19:55:37.291 INFO:teuthology.orchestra.run.smithi006.stdout: "heartbeat_front_addr": "172.21.15.8:6805/111181", 2023-08-01T19:55:37.291 INFO:teuthology.orchestra.run.smithi006.stdout: "state": [ 2023-08-01T19:55:37.291 INFO:teuthology.orchestra.run.smithi006.stdout: "exists", 2023-08-01T19:55:37.291 INFO:teuthology.orchestra.run.smithi006.stdout: "up" 2023-08-01T19:55:37.291 INFO:teuthology.orchestra.run.smithi006.stdout: ] 2023-08-01T19:55:37.292 INFO:teuthology.orchestra.run.smithi006.stdout: }, 2023-08-01T19:55:37.292 INFO:teuthology.orchestra.run.smithi006.stdout: { 2023-08-01T19:55:37.292 INFO:teuthology.orchestra.run.smithi006.stdout: "osd": 1, 2023-08-01T19:55:37.292 INFO:teuthology.orchestra.run.smithi006.stdout: "uuid": "7fc612c4-33ba-4a33-bca8-1f42ee8ed548", 2023-08-01T19:55:37.292 INFO:teuthology.orchestra.run.smithi006.stdout: "up": 1, 2023-08-01T19:55:37.292 INFO:teuthology.orchestra.run.smithi006.stdout: "in": 1, 2023-08-01T19:55:37.293 INFO:teuthology.orchestra.run.smithi006.stdout: "weight": 1, 2023-08-01T19:55:37.293 INFO:teuthology.orchestra.run.smithi006.stdout: "primary_affinity": 0.3376312255859375, 2023-08-01T19:55:37.293 INFO:teuthology.orchestra.run.smithi006.stdout: "last_clean_begin": 0, 2023-08-01T19:55:37.293 INFO:teuthology.orchestra.run.smithi006.stdout: "last_clean_end": 0, 2023-08-01T19:55:37.293 INFO:teuthology.orchestra.run.smithi006.stdout: "up_from": 8, 2023-08-01T19:55:37.293 INFO:teuthology.orchestra.run.smithi006.stdout: "up_thru": 19, 2023-08-01T19:55:37.293 INFO:teuthology.orchestra.run.smithi006.stdout: "down_at": 0, 2023-08-01T19:55:37.293 INFO:teuthology.orchestra.run.smithi006.stdout: "lost_at": 0, 2023-08-01T19:55:37.294 INFO:teuthology.orchestra.run.smithi006.stdout: "public_addrs": { 2023-08-01T19:55:37.294 INFO:teuthology.orchestra.run.smithi006.stdout: "addrvec": [ 2023-08-01T19:55:37.294 INFO:teuthology.orchestra.run.smithi006.stdout: { 2023-08-01T19:55:37.294 INFO:teuthology.orchestra.run.smithi006.stdout: "type": "v2", 2023-08-01T19:55:37.294 INFO:teuthology.orchestra.run.smithi006.stdout: "addr": "172.21.15.101:6800", 2023-08-01T19:55:37.294 INFO:teuthology.orchestra.run.smithi006.stdout: "nonce": 111143 2023-08-01T19:55:37.294 INFO:teuthology.orchestra.run.smithi006.stdout: }, 2023-08-01T19:55:37.295 INFO:teuthology.orchestra.run.smithi006.stdout: { 2023-08-01T19:55:37.295 INFO:teuthology.orchestra.run.smithi006.stdout: "type": "v1", 2023-08-01T19:55:37.295 INFO:teuthology.orchestra.run.smithi006.stdout: "addr": "172.21.15.101:6801", 2023-08-01T19:55:37.295 INFO:teuthology.orchestra.run.smithi006.stdout: "nonce": 111143 2023-08-01T19:55:37.295 INFO:teuthology.orchestra.run.smithi006.stdout: } 2023-08-01T19:55:37.295 INFO:teuthology.orchestra.run.smithi006.stdout: ] 2023-08-01T19:55:37.295 INFO:teuthology.orchestra.run.smithi006.stdout: }, 2023-08-01T19:55:37.296 INFO:teuthology.orchestra.run.smithi006.stdout: "cluster_addrs": { 2023-08-01T19:55:37.296 INFO:teuthology.orchestra.run.smithi006.stdout: "addrvec": [ 2023-08-01T19:55:37.296 INFO:teuthology.orchestra.run.smithi006.stdout: { 2023-08-01T19:55:37.296 INFO:teuthology.orchestra.run.smithi006.stdout: "type": "v2", 2023-08-01T19:55:37.296 INFO:teuthology.orchestra.run.smithi006.stdout: "addr": "172.21.15.101:6802", 2023-08-01T19:55:37.296 INFO:teuthology.orchestra.run.smithi006.stdout: "nonce": 111143 2023-08-01T19:55:37.296 INFO:teuthology.orchestra.run.smithi006.stdout: }, 2023-08-01T19:55:37.297 INFO:teuthology.orchestra.run.smithi006.stdout: { 2023-08-01T19:55:37.297 INFO:teuthology.orchestra.run.smithi006.stdout: "type": "v1", 2023-08-01T19:55:37.297 INFO:teuthology.orchestra.run.smithi006.stdout: "addr": "172.21.15.101:6803", 2023-08-01T19:55:37.297 INFO:teuthology.orchestra.run.smithi006.stdout: "nonce": 111143 2023-08-01T19:55:37.297 INFO:teuthology.orchestra.run.smithi006.stdout: } 2023-08-01T19:55:37.297 INFO:teuthology.orchestra.run.smithi006.stdout: ] 2023-08-01T19:55:37.297 INFO:teuthology.orchestra.run.smithi006.stdout: }, 2023-08-01T19:55:37.298 INFO:teuthology.orchestra.run.smithi006.stdout: "heartbeat_back_addrs": { 2023-08-01T19:55:37.298 INFO:teuthology.orchestra.run.smithi006.stdout: "addrvec": [ 2023-08-01T19:55:37.298 INFO:teuthology.orchestra.run.smithi006.stdout: { 2023-08-01T19:55:37.298 INFO:teuthology.orchestra.run.smithi006.stdout: "type": "v2", 2023-08-01T19:55:37.298 INFO:teuthology.orchestra.run.smithi006.stdout: "addr": "172.21.15.101:6806", 2023-08-01T19:55:37.298 INFO:teuthology.orchestra.run.smithi006.stdout: "nonce": 111143 2023-08-01T19:55:37.298 INFO:teuthology.orchestra.run.smithi006.stdout: }, 2023-08-01T19:55:37.298 INFO:teuthology.orchestra.run.smithi006.stdout: { 2023-08-01T19:55:37.299 INFO:teuthology.orchestra.run.smithi006.stdout: "type": "v1", 2023-08-01T19:55:37.299 INFO:teuthology.orchestra.run.smithi006.stdout: "addr": "172.21.15.101:6807", 2023-08-01T19:55:37.299 INFO:teuthology.orchestra.run.smithi006.stdout: "nonce": 111143 2023-08-01T19:55:37.299 INFO:teuthology.orchestra.run.smithi006.stdout: } 2023-08-01T19:55:37.299 INFO:teuthology.orchestra.run.smithi006.stdout: ] 2023-08-01T19:55:37.299 INFO:teuthology.orchestra.run.smithi006.stdout: }, 2023-08-01T19:55:37.299 INFO:teuthology.orchestra.run.smithi006.stdout: "heartbeat_front_addrs": { 2023-08-01T19:55:37.300 INFO:teuthology.orchestra.run.smithi006.stdout: "addrvec": [ 2023-08-01T19:55:37.300 INFO:teuthology.orchestra.run.smithi006.stdout: { 2023-08-01T19:55:37.300 INFO:teuthology.orchestra.run.smithi006.stdout: "type": "v2", 2023-08-01T19:55:37.300 INFO:teuthology.orchestra.run.smithi006.stdout: "addr": "172.21.15.101:6804", 2023-08-01T19:55:37.300 INFO:teuthology.orchestra.run.smithi006.stdout: "nonce": 111143 2023-08-01T19:55:37.300 INFO:teuthology.orchestra.run.smithi006.stdout: }, 2023-08-01T19:55:37.300 INFO:teuthology.orchestra.run.smithi006.stdout: { 2023-08-01T19:55:37.300 INFO:teuthology.orchestra.run.smithi006.stdout: "type": "v1", 2023-08-01T19:55:37.301 INFO:teuthology.orchestra.run.smithi006.stdout: "addr": "172.21.15.101:6805", 2023-08-01T19:55:37.301 INFO:teuthology.orchestra.run.smithi006.stdout: "nonce": 111143 2023-08-01T19:55:37.301 INFO:teuthology.orchestra.run.smithi006.stdout: } 2023-08-01T19:55:37.301 INFO:teuthology.orchestra.run.smithi006.stdout: ] 2023-08-01T19:55:37.301 INFO:teuthology.orchestra.run.smithi006.stdout: }, 2023-08-01T19:55:37.301 INFO:teuthology.orchestra.run.smithi006.stdout: "public_addr": "172.21.15.101:6801/111143", 2023-08-01T19:55:37.301 INFO:teuthology.orchestra.run.smithi006.stdout: "cluster_addr": "172.21.15.101:6803/111143", 2023-08-01T19:55:37.301 INFO:teuthology.orchestra.run.smithi006.stdout: "heartbeat_back_addr": "172.21.15.101:6807/111143", 2023-08-01T19:55:37.302 INFO:teuthology.orchestra.run.smithi006.stdout: "heartbeat_front_addr": "172.21.15.101:6805/111143", 2023-08-01T19:55:37.302 INFO:teuthology.orchestra.run.smithi006.stdout: "state": [ 2023-08-01T19:55:37.302 INFO:teuthology.orchestra.run.smithi006.stdout: "exists", 2023-08-01T19:55:37.302 INFO:teuthology.orchestra.run.smithi006.stdout: "up" 2023-08-01T19:55:37.302 INFO:teuthology.orchestra.run.smithi006.stdout: ] 2023-08-01T19:55:37.302 INFO:teuthology.orchestra.run.smithi006.stdout: }, 2023-08-01T19:55:37.302 INFO:teuthology.orchestra.run.smithi006.stdout: { 2023-08-01T19:55:37.302 INFO:teuthology.orchestra.run.smithi006.stdout: "osd": 2, 2023-08-01T19:55:37.303 INFO:teuthology.orchestra.run.smithi006.stdout: "uuid": "f85cadbc-4230-4772-8f39-62ed52e220b1", 2023-08-01T19:55:37.303 INFO:teuthology.orchestra.run.smithi006.stdout: "up": 1, 2023-08-01T19:55:37.303 INFO:teuthology.orchestra.run.smithi006.stdout: "in": 1, 2023-08-01T19:55:37.303 INFO:teuthology.orchestra.run.smithi006.stdout: "weight": 1, 2023-08-01T19:55:37.303 INFO:teuthology.orchestra.run.smithi006.stdout: "primary_affinity": 1, 2023-08-01T19:55:37.304 INFO:teuthology.orchestra.run.smithi006.stdout: "last_clean_begin": 0, 2023-08-01T19:55:37.304 INFO:teuthology.orchestra.run.smithi006.stdout: "last_clean_end": 0, 2023-08-01T19:55:37.304 INFO:teuthology.orchestra.run.smithi006.stdout: "up_from": 9, 2023-08-01T19:55:37.304 INFO:teuthology.orchestra.run.smithi006.stdout: "up_thru": 40, 2023-08-01T19:55:37.304 INFO:teuthology.orchestra.run.smithi006.stdout: "down_at": 0, 2023-08-01T19:55:37.304 INFO:teuthology.orchestra.run.smithi006.stdout: "lost_at": 0, 2023-08-01T19:55:37.305 INFO:teuthology.orchestra.run.smithi006.stdout: "public_addrs": { 2023-08-01T19:55:37.305 INFO:teuthology.orchestra.run.smithi006.stdout: "addrvec": [ 2023-08-01T19:55:37.305 INFO:teuthology.orchestra.run.smithi006.stdout: { 2023-08-01T19:55:37.305 INFO:teuthology.orchestra.run.smithi006.stdout: "type": "v2", 2023-08-01T19:55:37.305 INFO:teuthology.orchestra.run.smithi006.stdout: "addr": "172.21.15.155:6800", 2023-08-01T19:55:37.305 INFO:teuthology.orchestra.run.smithi006.stdout: "nonce": 111339 2023-08-01T19:55:37.305 INFO:teuthology.orchestra.run.smithi006.stdout: }, 2023-08-01T19:55:37.305 INFO:teuthology.orchestra.run.smithi006.stdout: { 2023-08-01T19:55:37.306 INFO:teuthology.orchestra.run.smithi006.stdout: "type": "v1", 2023-08-01T19:55:37.306 INFO:teuthology.orchestra.run.smithi006.stdout: "addr": "172.21.15.155:6801", 2023-08-01T19:55:37.306 INFO:teuthology.orchestra.run.smithi006.stdout: "nonce": 111339 2023-08-01T19:55:37.306 INFO:teuthology.orchestra.run.smithi006.stdout: } 2023-08-01T19:55:37.306 INFO:teuthology.orchestra.run.smithi006.stdout: ] 2023-08-01T19:55:37.306 INFO:teuthology.orchestra.run.smithi006.stdout: }, 2023-08-01T19:55:37.306 INFO:teuthology.orchestra.run.smithi006.stdout: "cluster_addrs": { 2023-08-01T19:55:37.306 INFO:teuthology.orchestra.run.smithi006.stdout: "addrvec": [ 2023-08-01T19:55:37.307 INFO:teuthology.orchestra.run.smithi006.stdout: { 2023-08-01T19:55:37.307 INFO:teuthology.orchestra.run.smithi006.stdout: "type": "v2", 2023-08-01T19:55:37.307 INFO:teuthology.orchestra.run.smithi006.stdout: "addr": "172.21.15.155:6802", 2023-08-01T19:55:37.307 INFO:teuthology.orchestra.run.smithi006.stdout: "nonce": 111339 2023-08-01T19:55:37.307 INFO:teuthology.orchestra.run.smithi006.stdout: }, 2023-08-01T19:55:37.307 INFO:teuthology.orchestra.run.smithi006.stdout: { 2023-08-01T19:55:37.307 INFO:teuthology.orchestra.run.smithi006.stdout: "type": "v1", 2023-08-01T19:55:37.307 INFO:teuthology.orchestra.run.smithi006.stdout: "addr": "172.21.15.155:6803", 2023-08-01T19:55:37.308 INFO:teuthology.orchestra.run.smithi006.stdout: "nonce": 111339 2023-08-01T19:55:37.308 INFO:teuthology.orchestra.run.smithi006.stdout: } 2023-08-01T19:55:37.308 INFO:teuthology.orchestra.run.smithi006.stdout: ] 2023-08-01T19:55:37.308 INFO:teuthology.orchestra.run.smithi006.stdout: }, 2023-08-01T19:55:37.308 INFO:teuthology.orchestra.run.smithi006.stdout: "heartbeat_back_addrs": { 2023-08-01T19:55:37.308 INFO:teuthology.orchestra.run.smithi006.stdout: "addrvec": [ 2023-08-01T19:55:37.308 INFO:teuthology.orchestra.run.smithi006.stdout: { 2023-08-01T19:55:37.308 INFO:teuthology.orchestra.run.smithi006.stdout: "type": "v2", 2023-08-01T19:55:37.309 INFO:teuthology.orchestra.run.smithi006.stdout: "addr": "172.21.15.155:6806", 2023-08-01T19:55:37.309 INFO:teuthology.orchestra.run.smithi006.stdout: "nonce": 111339 2023-08-01T19:55:37.309 INFO:teuthology.orchestra.run.smithi006.stdout: }, 2023-08-01T19:55:37.309 INFO:teuthology.orchestra.run.smithi006.stdout: { 2023-08-01T19:55:37.309 INFO:teuthology.orchestra.run.smithi006.stdout: "type": "v1", 2023-08-01T19:55:37.309 INFO:teuthology.orchestra.run.smithi006.stdout: "addr": "172.21.15.155:6807", 2023-08-01T19:55:37.309 INFO:teuthology.orchestra.run.smithi006.stdout: "nonce": 111339 2023-08-01T19:55:37.310 INFO:teuthology.orchestra.run.smithi006.stdout: } 2023-08-01T19:55:37.310 INFO:teuthology.orchestra.run.smithi006.stdout: ] 2023-08-01T19:55:37.310 INFO:teuthology.orchestra.run.smithi006.stdout: }, 2023-08-01T19:55:37.310 INFO:teuthology.orchestra.run.smithi006.stdout: "heartbeat_front_addrs": { 2023-08-01T19:55:37.310 INFO:teuthology.orchestra.run.smithi006.stdout: "addrvec": [ 2023-08-01T19:55:37.310 INFO:teuthology.orchestra.run.smithi006.stdout: { 2023-08-01T19:55:37.310 INFO:teuthology.orchestra.run.smithi006.stdout: "type": "v2", 2023-08-01T19:55:37.310 INFO:teuthology.orchestra.run.smithi006.stdout: "addr": "172.21.15.155:6804", 2023-08-01T19:55:37.311 INFO:teuthology.orchestra.run.smithi006.stdout: "nonce": 111339 2023-08-01T19:55:37.311 INFO:teuthology.orchestra.run.smithi006.stdout: }, 2023-08-01T19:55:37.311 INFO:teuthology.orchestra.run.smithi006.stdout: { 2023-08-01T19:55:37.311 INFO:teuthology.orchestra.run.smithi006.stdout: "type": "v1", 2023-08-01T19:55:37.311 INFO:teuthology.orchestra.run.smithi006.stdout: "addr": "172.21.15.155:6805", 2023-08-01T19:55:37.311 INFO:teuthology.orchestra.run.smithi006.stdout: "nonce": 111339 2023-08-01T19:55:37.311 INFO:teuthology.orchestra.run.smithi006.stdout: } 2023-08-01T19:55:37.311 INFO:teuthology.orchestra.run.smithi006.stdout: ] 2023-08-01T19:55:37.312 INFO:teuthology.orchestra.run.smithi006.stdout: }, 2023-08-01T19:55:37.312 INFO:teuthology.orchestra.run.smithi006.stdout: "public_addr": "172.21.15.155:6801/111339", 2023-08-01T19:55:37.312 INFO:teuthology.orchestra.run.smithi006.stdout: "cluster_addr": "172.21.15.155:6803/111339", 2023-08-01T19:55:37.312 INFO:teuthology.orchestra.run.smithi006.stdout: "heartbeat_back_addr": "172.21.15.155:6807/111339", 2023-08-01T19:55:37.312 INFO:teuthology.orchestra.run.smithi006.stdout: "heartbeat_front_addr": "172.21.15.155:6805/111339", 2023-08-01T19:55:37.312 INFO:teuthology.orchestra.run.smithi006.stdout: "state": [ 2023-08-01T19:55:37.312 INFO:teuthology.orchestra.run.smithi006.stdout: "exists", 2023-08-01T19:55:37.312 INFO:teuthology.orchestra.run.smithi006.stdout: "up" 2023-08-01T19:55:37.313 INFO:teuthology.orchestra.run.smithi006.stdout: ] 2023-08-01T19:55:37.313 INFO:teuthology.orchestra.run.smithi006.stdout: } 2023-08-01T19:55:37.313 INFO:teuthology.orchestra.run.smithi006.stdout: ], 2023-08-01T19:55:37.313 INFO:teuthology.orchestra.run.smithi006.stdout: "osd_xinfo": [ 2023-08-01T19:55:37.313 INFO:teuthology.orchestra.run.smithi006.stdout: { 2023-08-01T19:55:37.313 INFO:teuthology.orchestra.run.smithi006.stdout: "osd": 0, 2023-08-01T19:55:37.313 INFO:teuthology.orchestra.run.smithi006.stdout: "down_stamp": "0.000000", 2023-08-01T19:55:37.314 INFO:teuthology.orchestra.run.smithi006.stdout: "laggy_probability": 0, 2023-08-01T19:55:37.314 INFO:teuthology.orchestra.run.smithi006.stdout: "laggy_interval": 0, 2023-08-01T19:55:37.314 INFO:teuthology.orchestra.run.smithi006.stdout: "features": 4540138320759226367, 2023-08-01T19:55:37.314 INFO:teuthology.orchestra.run.smithi006.stdout: "old_weight": 0, 2023-08-01T19:55:37.314 INFO:teuthology.orchestra.run.smithi006.stdout: "last_purged_snaps_scrub": "2023-08-01T19:53:48.018154+0000", 2023-08-01T19:55:37.314 INFO:teuthology.orchestra.run.smithi006.stdout: "dead_epoch": 0 2023-08-01T19:55:37.314 INFO:teuthology.orchestra.run.smithi006.stdout: }, 2023-08-01T19:55:37.314 INFO:teuthology.orchestra.run.smithi006.stdout: { 2023-08-01T19:55:37.315 INFO:teuthology.orchestra.run.smithi006.stdout: "osd": 1, 2023-08-01T19:55:37.315 INFO:teuthology.orchestra.run.smithi006.stdout: "down_stamp": "0.000000", 2023-08-01T19:55:37.315 INFO:teuthology.orchestra.run.smithi006.stdout: "laggy_probability": 0, 2023-08-01T19:55:37.315 INFO:teuthology.orchestra.run.smithi006.stdout: "laggy_interval": 0, 2023-08-01T19:55:37.315 INFO:teuthology.orchestra.run.smithi006.stdout: "features": 4540138320759226367, 2023-08-01T19:55:37.315 INFO:teuthology.orchestra.run.smithi006.stdout: "old_weight": 0, 2023-08-01T19:55:37.315 INFO:teuthology.orchestra.run.smithi006.stdout: "last_purged_snaps_scrub": "2023-08-01T19:53:48.000488+0000", 2023-08-01T19:55:37.316 INFO:teuthology.orchestra.run.smithi006.stdout: "dead_epoch": 0 2023-08-01T19:55:37.316 INFO:teuthology.orchestra.run.smithi006.stdout: }, 2023-08-01T19:55:37.316 INFO:teuthology.orchestra.run.smithi006.stdout: { 2023-08-01T19:55:37.316 INFO:teuthology.orchestra.run.smithi006.stdout: "osd": 2, 2023-08-01T19:55:37.316 INFO:teuthology.orchestra.run.smithi006.stdout: "down_stamp": "0.000000", 2023-08-01T19:55:37.316 INFO:teuthology.orchestra.run.smithi006.stdout: "laggy_probability": 0, 2023-08-01T19:55:37.316 INFO:teuthology.orchestra.run.smithi006.stdout: "laggy_interval": 0, 2023-08-01T19:55:37.316 INFO:teuthology.orchestra.run.smithi006.stdout: "features": 4540138320759226367, 2023-08-01T19:55:37.317 INFO:teuthology.orchestra.run.smithi006.stdout: "old_weight": 0, 2023-08-01T19:55:37.317 INFO:teuthology.orchestra.run.smithi006.stdout: "last_purged_snaps_scrub": "2023-08-01T19:53:48.072529+0000", 2023-08-01T19:55:37.317 INFO:teuthology.orchestra.run.smithi006.stdout: "dead_epoch": 0 2023-08-01T19:55:37.317 INFO:teuthology.orchestra.run.smithi006.stdout: } 2023-08-01T19:55:37.317 INFO:teuthology.orchestra.run.smithi006.stdout: ], 2023-08-01T19:55:37.317 INFO:teuthology.orchestra.run.smithi006.stdout: "pg_upmap": [], 2023-08-01T19:55:37.317 INFO:teuthology.orchestra.run.smithi006.stdout: "pg_upmap_items": [], 2023-08-01T19:55:37.318 INFO:teuthology.orchestra.run.smithi006.stdout: "pg_temp": [], 2023-08-01T19:55:37.318 INFO:teuthology.orchestra.run.smithi006.stdout: "primary_temp": [], 2023-08-01T19:55:37.318 INFO:teuthology.orchestra.run.smithi006.stdout: "blocklist": {}, 2023-08-01T19:55:37.318 INFO:teuthology.orchestra.run.smithi006.stdout: "range_blocklist": {}, 2023-08-01T19:55:37.318 INFO:teuthology.orchestra.run.smithi006.stdout: "erasure_code_profiles": { 2023-08-01T19:55:37.318 INFO:teuthology.orchestra.run.smithi006.stdout: "default": { 2023-08-01T19:55:37.318 INFO:teuthology.orchestra.run.smithi006.stdout: "crush-failure-domain": "osd", 2023-08-01T19:55:37.319 INFO:teuthology.orchestra.run.smithi006.stdout: "k": "2", 2023-08-01T19:55:37.319 INFO:teuthology.orchestra.run.smithi006.stdout: "m": "1", 2023-08-01T19:55:37.319 INFO:teuthology.orchestra.run.smithi006.stdout: "plugin": "jerasure", 2023-08-01T19:55:37.319 INFO:teuthology.orchestra.run.smithi006.stdout: "technique": "reed_sol_van" 2023-08-01T19:55:37.319 INFO:teuthology.orchestra.run.smithi006.stdout: } 2023-08-01T19:55:37.319 INFO:teuthology.orchestra.run.smithi006.stdout: }, 2023-08-01T19:55:37.319 INFO:teuthology.orchestra.run.smithi006.stdout: "removed_snaps_queue": [], 2023-08-01T19:55:37.319 INFO:teuthology.orchestra.run.smithi006.stdout: "new_removed_snaps": [], 2023-08-01T19:55:37.320 INFO:teuthology.orchestra.run.smithi006.stdout: "new_purged_snaps": [], 2023-08-01T19:55:37.320 INFO:teuthology.orchestra.run.smithi006.stdout: "crush_node_flags": {}, 2023-08-01T19:55:37.320 INFO:teuthology.orchestra.run.smithi006.stdout: "device_class_flags": {}, 2023-08-01T19:55:37.320 INFO:teuthology.orchestra.run.smithi006.stdout: "stretch_mode": { 2023-08-01T19:55:37.320 INFO:teuthology.orchestra.run.smithi006.stdout: "stretch_mode_enabled": false, 2023-08-01T19:55:37.320 INFO:teuthology.orchestra.run.smithi006.stdout: "stretch_bucket_count": 0, 2023-08-01T19:55:37.320 INFO:teuthology.orchestra.run.smithi006.stdout: "degraded_stretch_mode": 0, 2023-08-01T19:55:37.321 INFO:teuthology.orchestra.run.smithi006.stdout: "recovering_stretch_mode": 0, 2023-08-01T19:55:37.321 INFO:teuthology.orchestra.run.smithi006.stdout: "stretch_mode_bucket": 0 2023-08-01T19:55:37.321 INFO:teuthology.orchestra.run.smithi006.stdout: } 2023-08-01T19:55:37.321 INFO:teuthology.orchestra.run.smithi006.stdout:} 2023-08-01T19:55:37.322 INFO:teuthology.orchestra.run.smithi155.stdout:{ 2023-08-01T19:55:37.323 INFO:teuthology.orchestra.run.smithi155.stdout: "ops": [], 2023-08-01T19:55:37.323 INFO:teuthology.orchestra.run.smithi155.stdout: "complaint_time": 30, 2023-08-01T19:55:37.323 INFO:teuthology.orchestra.run.smithi155.stdout: "num_blocked_ops": 0 2023-08-01T19:55:37.323 INFO:teuthology.orchestra.run.smithi155.stdout:} 2023-08-01T19:55:37.324 INFO:tasks.thrashosds.thrasher:j is {'epoch': 50, 'fsid': 'a0e420cc-4df1-42a5-8bd4-a98c309a9349', 'created': '2023-08-01T19:53:41.279588+0000', 'modified': '2023-08-01T19:55:37.046308+0000', 'last_up_change': '2023-08-01T19:53:50.735626+0000', 'last_in_change': '2023-08-01T19:53:42.974751+0000', 'flags': 'noscrub,nodeep-scrub,sortbitwise,recovery_deletes,purged_snapdirs,pglog_hardlimit', 'flags_num': 5806080, 'flags_set': ['nodeep-scrub', 'noscrub', 'pglog_hardlimit', 'purged_snapdirs', 'recovery_deletes', 'sortbitwise'], 'crush_version': 5, 'full_ratio': 0.949999988079071, 'backfillfull_ratio': 0.8999999761581421, 'nearfull_ratio': 0.8500000238418579, 'cluster_snapshot': '', 'pool_max': 5, 'max_osd': 3, 'require_min_compat_client': 'luminous', 'min_compat_client': 'jewel', 'require_osd_release': 'quincy', 'pools': [{'pool': 1, 'pool_name': '.mgr', 'create_time': '2023-08-01T19:53:49.961944+0000', 'flags': 1, 'flags_names': 'hashpspool', 'type': 1, 'size': 2, 'min_size': 1, 'crush_rule': 0, 'peering_crush_bucket_count': 0, 'peering_crush_bucket_target': 0, 'peering_crush_bucket_barrier': 0, 'peering_crush_bucket_mandatory_member': 2147483647, 'object_hash': 2, 'pg_autoscale_mode': 'off', 'pg_num': 1, 'pg_placement_num': 1, 'pg_placement_num_target': 1, 'pg_num_target': 1, 'pg_num_pending': 1, 'last_pg_merge_meta': {'source_pgid': '0.0', 'ready_epoch': 0, 'last_epoch_started': 0, 'last_epoch_clean': 0, 'source_version': "0'0", 'target_version': "0'0"}, 'last_change': '11', 'last_force_op_resend': '0', 'last_force_op_resend_prenautilus': '0', 'last_force_op_resend_preluminous': '0', 'auid': 0, 'snap_mode': 'selfmanaged', 'snap_seq': 0, 'snap_epoch': 0, 'pool_snaps': [], 'removed_snaps': '[]', 'quota_max_bytes': 0, 'quota_max_objects': 0, 'tiers': [], 'tier_of': -1, 'read_tier': -1, 'write_tier': -1, 'cache_mode': 'none', 'target_max_bytes': 0, 'target_max_objects': 0, 'cache_target_dirty_ratio_micro': 400000, 'cache_target_dirty_high_ratio_micro': 600000, 'cache_target_full_ratio_micro': 800000, 'cache_min_flush_age': 0, 'cache_min_evict_age': 0, 'erasure_code_profile': '', 'hit_set_params': {'type': 'none'}, 'hit_set_period': 0, 'hit_set_count': 0, 'use_gmt_hitset': True, 'min_read_recency_for_promote': 0, 'min_write_recency_for_promote': 0, 'hit_set_grade_decay_rate': 0, 'hit_set_search_last_n': 0, 'grade_table': [], 'stripe_width': 0, 'expected_num_objects': 0, 'fast_read': False, 'options': {'pg_num_max': 32, 'pg_num_min': 1}, 'application_metadata': {'mgr': {}}}, {'pool': 2, 'pool_name': 'rbd', 'create_time': '2023-08-01T19:53:57.404091+0000', 'flags': 1, 'flags_names': 'hashpspool', 'type': 1, 'size': 2, 'min_size': 1, 'crush_rule': 0, 'peering_crush_bucket_count': 0, 'peering_crush_bucket_target': 0, 'peering_crush_bucket_barrier': 0, 'peering_crush_bucket_mandatory_member': 2147483647, 'object_hash': 2, 'pg_autoscale_mode': 'off', 'pg_num': 8, 'pg_placement_num': 8, 'pg_placement_num_target': 8, 'pg_num_target': 8, 'pg_num_pending': 8, 'last_pg_merge_meta': {'source_pgid': '0.0', 'ready_epoch': 0, 'last_epoch_started': 0, 'last_epoch_clean': 0, 'source_version': "0'0", 'target_version': "0'0"}, 'last_change': '14', 'last_force_op_resend': '0', 'last_force_op_resend_prenautilus': '0', 'last_force_op_resend_preluminous': '0', 'auid': 0, 'snap_mode': 'selfmanaged', 'snap_seq': 0, 'snap_epoch': 0, 'pool_snaps': [], 'removed_snaps': '[]', 'quota_max_bytes': 0, 'quota_max_objects': 0, 'tiers': [], 'tier_of': -1, 'read_tier': -1, 'write_tier': -1, 'cache_mode': 'none', 'target_max_bytes': 0, 'target_max_objects': 0, 'cache_target_dirty_ratio_micro': 400000, 'cache_target_dirty_high_ratio_micro': 600000, 'cache_target_full_ratio_micro': 800000, 'cache_min_flush_age': 0, 'cache_min_evict_age': 0, 'erasure_code_profile': '', 'hit_set_params': {'type': 'none'}, 'hit_set_period': 0, 'hit_set_count': 0, 'use_gmt_hitset': True, 'min_read_recency_for_promote': 0, 'min_write_recency_for_promote': 0, 'hit_set_grade_decay_rate': 0, 'hit_set_search_last_n': 0, 'grade_table': [], 'stripe_width': 0, 'expected_num_objects': 0, 'fast_read': False, 'options': {}, 'application_metadata': {'rbd': {}}}, {'pool': 3, 'pool_name': 'cephfs_metadata', 'create_time': '2023-08-01T19:54:02.111247+0000', 'flags': 1, 'flags_names': 'hashpspool', 'type': 1, 'size': 2, 'min_size': 1, 'crush_rule': 0, 'peering_crush_bucket_count': 0, 'peering_crush_bucket_target': 0, 'peering_crush_bucket_barrier': 0, 'peering_crush_bucket_mandatory_member': 2147483647, 'object_hash': 2, 'pg_autoscale_mode': 'off', 'pg_num': 32, 'pg_placement_num': 32, 'pg_placement_num_target': 32, 'pg_num_target': 32, 'pg_num_pending': 32, 'last_pg_merge_meta': {'source_pgid': '0.0', 'ready_epoch': 0, 'last_epoch_started': 0, 'last_epoch_clean': 0, 'source_version': "0'0", 'target_version': "0'0"}, 'last_change': '17', 'last_force_op_resend': '0', 'last_force_op_resend_prenautilus': '0', 'last_force_op_resend_preluminous': '0', 'auid': 0, 'snap_mode': 'selfmanaged', 'snap_seq': 0, 'snap_epoch': 0, 'pool_snaps': [], 'removed_snaps': '[]', 'quota_max_bytes': 0, 'quota_max_objects': 0, 'tiers': [], 'tier_of': -1, 'read_tier': -1, 'write_tier': -1, 'cache_mode': 'none', 'target_max_bytes': 0, 'target_max_objects': 0, 'cache_target_dirty_ratio_micro': 400000, 'cache_target_dirty_high_ratio_micro': 600000, 'cache_target_full_ratio_micro': 800000, 'cache_min_flush_age': 0, 'cache_min_evict_age': 0, 'erasure_code_profile': '', 'hit_set_params': {'type': 'none'}, 'hit_set_period': 0, 'hit_set_count': 0, 'use_gmt_hitset': True, 'min_read_recency_for_promote': 0, 'min_write_recency_for_promote': 0, 'hit_set_grade_decay_rate': 0, 'hit_set_search_last_n': 0, 'grade_table': [], 'stripe_width': 0, 'expected_num_objects': 0, 'fast_read': False, 'options': {'pg_autoscale_bias': 4, 'pg_num_min': 16, 'recovery_priority': 5}, 'application_metadata': {'cephfs': {'metadata': 'cephfs'}}}, {'pool': 4, 'pool_name': 'cephfs_data', 'create_time': '2023-08-01T19:54:03.430277+0000', 'flags': 1, 'flags_names': 'hashpspool', 'type': 1, 'size': 2, 'min_size': 1, 'crush_rule': 0, 'peering_crush_bucket_count': 0, 'peering_crush_bucket_target': 0, 'peering_crush_bucket_barrier': 0, 'peering_crush_bucket_mandatory_member': 2147483647, 'object_hash': 2, 'pg_autoscale_mode': 'off', 'pg_num': 64, 'pg_placement_num': 64, 'pg_placement_num_target': 64, 'pg_num_target': 64, 'pg_num_pending': 64, 'last_pg_merge_meta': {'source_pgid': '0.0', 'ready_epoch': 0, 'last_epoch_started': 0, 'last_epoch_clean': 0, 'source_version': "0'0", 'target_version': "0'0"}, 'last_change': '18', 'last_force_op_resend': '0', 'last_force_op_resend_prenautilus': '0', 'last_force_op_resend_preluminous': '0', 'auid': 0, 'snap_mode': 'selfmanaged', 'snap_seq': 0, 'snap_epoch': 0, 'pool_snaps': [], 'removed_snaps': '[]', 'quota_max_bytes': 0, 'quota_max_objects': 0, 'tiers': [], 'tier_of': -1, 'read_tier': -1, 'write_tier': -1, 'cache_mode': 'none', 'target_max_bytes': 0, 'target_max_objects': 0, 'cache_target_dirty_ratio_micro': 400000, 'cache_target_dirty_high_ratio_micro': 600000, 'cache_target_full_ratio_micro': 800000, 'cache_min_flush_age': 0, 'cache_min_evict_age': 0, 'erasure_code_profile': '', 'hit_set_params': {'type': 'none'}, 'hit_set_period': 0, 'hit_set_count': 0, 'use_gmt_hitset': True, 'min_read_recency_for_promote': 0, 'min_write_recency_for_promote': 0, 'hit_set_grade_decay_rate': 0, 'hit_set_search_last_n': 0, 'grade_table': [], 'stripe_width': 0, 'expected_num_objects': 0, 'fast_read': False, 'options': {'pg_num_min': 64, 'target_size_ratio': 0.8999999761581421}, 'application_metadata': {'cephfs': {'data': 'cephfs'}}}, {'pool': 5, 'pool_name': 'unique_pool_0', 'create_time': '2023-08-01T19:54:21.165668+0000', 'flags': 1, 'flags_names': 'hashpspool', 'type': 1, 'size': 2, 'min_size': 1, 'crush_rule': 0, 'peering_crush_bucket_count': 0, 'peering_crush_bucket_target': 0, 'peering_crush_bucket_barrier': 0, 'peering_crush_bucket_mandatory_member': 2147483647, 'object_hash': 2, 'pg_autoscale_mode': 'off', 'pg_num': 16, 'pg_placement_num': 16, 'pg_placement_num_target': 16, 'pg_num_target': 16, 'pg_num_pending': 16, 'last_pg_merge_meta': {'source_pgid': '0.0', 'ready_epoch': 0, 'last_epoch_started': 0, 'last_epoch_clean': 0, 'source_version': "0'0", 'target_version': "0'0"}, 'last_change': '21', 'last_force_op_resend': '0', 'last_force_op_resend_prenautilus': '0', 'last_force_op_resend_preluminous': '0', 'auid': 0, 'snap_mode': 'selfmanaged', 'snap_seq': 0, 'snap_epoch': 0, 'pool_snaps': [], 'removed_snaps': '[]', 'quota_max_bytes': 0, 'quota_max_objects': 0, 'tiers': [], 'tier_of': -1, 'read_tier': -1, 'write_tier': -1, 'cache_mode': 'none', 'target_max_bytes': 0, 'target_max_objects': 0, 'cache_target_dirty_ratio_micro': 400000, 'cache_target_dirty_high_ratio_micro': 600000, 'cache_target_full_ratio_micro': 800000, 'cache_min_flush_age': 0, 'cache_min_evict_age': 0, 'erasure_code_profile': '', 'hit_set_params': {'type': 'none'}, 'hit_set_period': 0, 'hit_set_count': 0, 'use_gmt_hitset': True, 'min_read_recency_for_promote': 0, 'min_write_recency_for_promote': 0, 'hit_set_grade_decay_rate': 0, 'hit_set_search_last_n': 0, 'grade_table': [], 'stripe_width': 0, 'expected_num_objects': 0, 'fast_read': False, 'options': {}, 'application_metadata': {'rados': {}}}], 'osds': [{'osd': 0, 'uuid': '5dd675c7-2777-48f2-8009-ff0e0d4c7086', 'up': 1, 'in': 1, 'weight': 1, 'primary_affinity': 1, 'last_clean_begin': 0, 'last_clean_end': 0, 'up_from': 8, 'up_thru': 40, 'down_at': 0, 'lost_at': 0, 'public_addrs': {'addrvec': [{'type': 'v2', 'addr': '172.21.15.8:6800', 'nonce': 111181}, {'type': 'v1', 'addr': '172.21.15.8:6801', 'nonce': 111181}]}, 'cluster_addrs': {'addrvec': [{'type': 'v2', 'addr': '172.21.15.8:6802', 'nonce': 111181}, {'type': 'v1', 'addr': '172.21.15.8:6803', 'nonce': 111181}]}, 'heartbeat_back_addrs': {'addrvec': [{'type': 'v2', 'addr': '172.21.15.8:6806', 'nonce': 111181}, {'type': 'v1', 'addr': '172.21.15.8:6807', 'nonce': 111181}]}, 'heartbeat_front_addrs': {'addrvec': [{'type': 'v2', 'addr': '172.21.15.8:6804', 'nonce': 111181}, {'type': 'v1', 'addr': '172.21.15.8:6805', 'nonce': 111181}]}, 'public_addr': '172.21.15.8:6801/111181', 'cluster_addr': '172.21.15.8:6803/111181', 'heartbeat_back_addr': '172.21.15.8:6807/111181', 'heartbeat_front_addr': '172.21.15.8:6805/111181', 'state': ['exists', 'up']}, {'osd': 1, 'uuid': '7fc612c4-33ba-4a33-bca8-1f42ee8ed548', 'up': 1, 'in': 1, 'weight': 1, 'primary_affinity': 0.3376312255859375, 'last_clean_begin': 0, 'last_clean_end': 0, 'up_from': 8, 'up_thru': 19, 'down_at': 0, 'lost_at': 0, 'public_addrs': {'addrvec': [{'type': 'v2', 'addr': '172.21.15.101:6800', 'nonce': 111143}, {'type': 'v1', 'addr': '172.21.15.101:6801', 'nonce': 111143}]}, 'cluster_addrs': {'addrvec': [{'type': 'v2', 'addr': '172.21.15.101:6802', 'nonce': 111143}, {'type': 'v1', 'addr': '172.21.15.101:6803', 'nonce': 111143}]}, 'heartbeat_back_addrs': {'addrvec': [{'type': 'v2', 'addr': '172.21.15.101:6806', 'nonce': 111143}, {'type': 'v1', 'addr': '172.21.15.101:6807', 'nonce': 111143}]}, 'heartbeat_front_addrs': {'addrvec': [{'type': 'v2', 'addr': '172.21.15.101:6804', 'nonce': 111143}, {'type': 'v1', 'addr': '172.21.15.101:6805', 'nonce': 111143}]}, 'public_addr': '172.21.15.101:6801/111143', 'cluster_addr': '172.21.15.101:6803/111143', 'heartbeat_back_addr': '172.21.15.101:6807/111143', 'heartbeat_front_addr': '172.21.15.101:6805/111143', 'state': ['exists', 'up']}, {'osd': 2, 'uuid': 'f85cadbc-4230-4772-8f39-62ed52e220b1', 'up': 1, 'in': 1, 'weight': 1, 'primary_affinity': 1, 'last_clean_begin': 0, 'last_clean_end': 0, 'up_from': 9, 'up_thru': 40, 'down_at': 0, 'lost_at': 0, 'public_addrs': {'addrvec': [{'type': 'v2', 'addr': '172.21.15.155:6800', 'nonce': 111339}, {'type': 'v1', 'addr': '172.21.15.155:6801', 'nonce': 111339}]}, 'cluster_addrs': {'addrvec': [{'type': 'v2', 'addr': '172.21.15.155:6802', 'nonce': 111339}, {'type': 'v1', 'addr': '172.21.15.155:6803', 'nonce': 111339}]}, 'heartbeat_back_addrs': {'addrvec': [{'type': 'v2', 'addr': '172.21.15.155:6806', 'nonce': 111339}, {'type': 'v1', 'addr': '172.21.15.155:6807', 'nonce': 111339}]}, 'heartbeat_front_addrs': {'addrvec': [{'type': 'v2', 'addr': '172.21.15.155:6804', 'nonce': 111339}, {'type': 'v1', 'addr': '172.21.15.155:6805', 'nonce': 111339}]}, 'public_addr': '172.21.15.155:6801/111339', 'cluster_addr': '172.21.15.155:6803/111339', 'heartbeat_back_addr': '172.21.15.155:6807/111339', 'heartbeat_front_addr': '172.21.15.155:6805/111339', 'state': ['exists', 'up']}], 'osd_xinfo': [{'osd': 0, 'down_stamp': '0.000000', 'laggy_probability': 0, 'laggy_interval': 0, 'features': 4540138320759226367, 'old_weight': 0, 'last_purged_snaps_scrub': '2023-08-01T19:53:48.018154+0000', 'dead_epoch': 0}, {'osd': 1, 'down_stamp': '0.000000', 'laggy_probability': 0, 'laggy_interval': 0, 'features': 4540138320759226367, 'old_weight': 0, 'last_purged_snaps_scrub': '2023-08-01T19:53:48.000488+0000', 'dead_epoch': 0}, {'osd': 2, 'down_stamp': '0.000000', 'laggy_probability': 0, 'laggy_interval': 0, 'features': 4540138320759226367, 'old_weight': 0, 'last_purged_snaps_scrub': '2023-08-01T19:53:48.072529+0000', 'dead_epoch': 0}], 'pg_upmap': [], 'pg_upmap_items': [], 'pg_temp': [], 'primary_temp': [], 'blocklist': {}, 'range_blocklist': {}, 'erasure_code_profiles': {'default': {'crush-failure-domain': 'osd', 'k': '2', 'm': '1', 'plugin': 'jerasure', 'technique': 'reed_sol_van'}}, 'removed_snaps_queue': [], 'new_removed_snaps': [], 'new_purged_snaps': [], 'crush_node_flags': {}, 'device_class_flags': {}, 'stretch_mode': {'stretch_mode_enabled': False, 'stretch_bucket_count': 0, 'degraded_stretch_mode': 0, 'recovering_stretch_mode': 0, 'stretch_mode_bucket': 0}} 2023-08-01T19:55:37.324 DEBUG:teuthology.orchestra.run.smithi006:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 120 ceph --cluster ceph pg dump --format=json 2023-08-01T19:55:37.325 INFO:teuthology.orchestra.run.smithi006.stdout:osd.0: {} 2023-08-01T19:55:37.325 DEBUG:teuthology.orchestra.run.smithi155:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 30 ceph --cluster ceph --admin-daemon /var/run/ceph/ceph-osd.2.asok dump_historic_ops 2023-08-01T19:55:37.325 INFO:tasks.ceph.osd.2.smithi155.stderr:2023-08-01T19:55:37.320+0000 7faa5c6ac700 -1 received signal: Hangup from /usr/bin/python3 /bin/daemon-helper kill ceph-osd -f --cluster ceph -i 2 (PID: 111337) UID: 0 2023-08-01T19:55:37.334 INFO:teuthology.orchestra.run.smithi006.stdout:osd.1: {} 2023-08-01T19:55:37.353 INFO:teuthology.orchestra.run.smithi006.stdout:osd.2: {} 2023-08-01T19:55:37.355 INFO:teuthology.orchestra.run.smithi006.stderr:osd.0: osd_enable_op_tracker = 'false' 2023-08-01T19:55:37.355 INFO:teuthology.orchestra.run.smithi006.stderr:osd.1: osd_enable_op_tracker = 'false' 2023-08-01T19:55:37.355 INFO:teuthology.orchestra.run.smithi006.stderr:osd.2: osd_enable_op_tracker = 'false' 2023-08-01T19:55:37.423 INFO:tasks.ceph.osd.0.smithi008.stderr:2023-08-01T19:55:37.421+0000 7f16a58f4700 -1 received signal: Hangup from /usr/bin/python3 /bin/daemon-helper kill ceph-osd -f --cluster ceph -i 0 (PID: 111179) UID: 0 2023-08-01T19:55:37.523 INFO:tasks.ceph.osd.2.smithi155.stderr:2023-08-01T19:55:37.522+0000 7faa5c6ac700 -1 received signal: Hangup from /usr/bin/python3 /bin/daemon-helper kill ceph-osd -f --cluster ceph -i 2 (PID: 111337) UID: 0 2023-08-01T19:55:37.525 INFO:teuthology.orchestra.run.smithi155.stdout:ERROR: (22) Invalid argument 2023-08-01T19:55:37.525 INFO:teuthology.orchestra.run.smithi155.stdout:op_tracker tracking is not enabled now, so no ops are tracked currently, even those get stuck. Please enable "osd_enable_op_tracker", and the tracker will start to track new ops received afterwards. 2023-08-01T19:55:37.540 DEBUG:teuthology.orchestra.run.smithi008:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 30 ceph --cluster ceph --admin-daemon /var/run/ceph/ceph-osd.0.asok dump_ops_in_flight 2023-08-01T19:55:37.624 INFO:tasks.ceph.osd.1.smithi101.stderr:2023-08-01T19:55:37.622+0000 7fb0cb7f6700 -1 received signal: Hangup from /usr/bin/python3 /bin/daemon-helper kill ceph-osd -f --cluster ceph -i 1 (PID: 111141) UID: 0 2023-08-01T19:55:37.659 INFO:teuthology.orchestra.run.smithi006.stdout: 2023-08-01T19:55:37.660 INFO:teuthology.orchestra.run.smithi006.stderr:dumped all 2023-08-01T19:55:37.671 INFO:teuthology.orchestra.run.smithi006.stdout:{"pg_ready":true,"pg_map":{"version":100,"stamp":"2023-08-01T19:55:37.047920+0000","last_osdmap_epoch":0,"last_pg_scan":0,"pg_stats_sum":{"stat_sum":{"num_bytes":7389711162,"num_objects":112774,"num_object_clones":0,"num_object_copies":225548,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":112774,"num_whiteouts":0,"num_read":137,"num_read_kb":119,"num_write":154816,"num_write_kb":8557586,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":1,"num_bytes_recovered":65536,"num_keys_recovered":0,"num_objects_omap":14,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"store_stats":{"total":0,"available":0,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},"log_size":60834,"ondisk_log_size":60834,"up":242,"acting":242,"num_store_stats":0},"osd_stats_sum":{"up_from":0,"seq":0,"num_pgs":242,"num_osds":3,"num_per_pool_osds":3,"num_per_pool_omap_osds":3,"kb":283115520,"kb_used":1278424,"kb_used_data":919700,"kb_used_omap":0,"kb_used_meta":358656,"kb_avail":281837096,"statfs":{"total":289910292480,"available":288601186304,"internally_reserved":0,"allocated":941772800,"data_stored":15041373565,"data_compressed":72146578,"data_compressed_allocated":940048384,"data_compressed_original":15040741376,"omap_allocated":0,"internal_metadata":367263744},"hb_peers":[],"snap_trim_queue_len":0,"num_snap_trimming":0,"num_shards_repaired":0,"op_queue_age_hist":{"histogram":[],"upper_bound":1},"perf_stat":{"commit_latency_ms":10,"apply_latency_ms":10,"commit_latency_ns":10000000,"apply_latency_ns":10000000},"alerts":[],"network_ping_times":[]},"pg_stats_delta":{"stat_sum":{"num_bytes":-1317732352,"num_objects":-20107,"num_object_clones":0,"num_object_copies":-40214,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":-20107,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":20107,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"store_stats":{"total":0,"available":0,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},"log_size":0,"ondisk_log_size":0,"up":0,"acting":0,"num_store_stats":0,"stamp_delta":"7.125164"},"pg_stats":[{"pgid":"4.3f","version":"0'0","reported_seq":40,"reported_epoch":48,"state":"active+clean","last_fresh":"2023-08-01T19:55:30.995454+0000","last_change":"2023-08-01T19:54:04.473430+0000","last_active":"2023-08-01T19:55:30.995454+0000","last_peered":"2023-08-01T19:55:30.995454+0000","last_clean":"2023-08-01T19:55:30.995454+0000","last_became_active":"2023-08-01T19:54:04.472887+0000","last_became_peered":"2023-08-01T19:54:04.472887+0000","last_unstale":"2023-08-01T19:55:30.995454+0000","last_undegraded":"2023-08-01T19:55:30.995454+0000","last_fullsized":"2023-08-01T19:55:30.995454+0000","mapping_epoch":16,"log_start":"0'0","ondisk_log_start":"0'0","created":16,"last_epoch_clean":17,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-08-01T19:54:04.040663+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-08-01T19:54:04.040663+0000","last_clean_scrub_stamp":"2023-08-01T19:54:04.040663+0000","objects_scrubbed":0,"log_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-08-03T06:38:54.196605+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[2,0],"acting":[2,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":2,"acting_primary":2,"purged_snaps":[]},{"pgid":"4.3e","version":"0'0","reported_seq":40,"reported_epoch":48,"state":"active+clean","last_fresh":"2023-08-01T19:55:30.994203+0000","last_change":"2023-08-01T19:54:04.470501+0000","last_active":"2023-08-01T19:55:30.994203+0000","last_peered":"2023-08-01T19:55:30.994203+0000","last_clean":"2023-08-01T19:55:30.994203+0000","last_became_active":"2023-08-01T19:54:04.469692+0000","last_became_peered":"2023-08-01T19:54:04.469692+0000","last_unstale":"2023-08-01T19:55:30.994203+0000","last_undegraded":"2023-08-01T19:55:30.994203+0000","last_fullsized":"2023-08-01T19:55:30.994203+0000","mapping_epoch":16,"log_start":"0'0","ondisk_log_start":"0'0","created":16,"last_epoch_clean":17,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-08-01T19:54:04.040663+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-08-01T19:54:04.040663+0000","last_clean_scrub_stamp":"2023-08-01T19:54:04.040663+0000","objects_scrubbed":0,"log_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-08-03T02:19:35.201107+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[2,0],"acting":[2,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":2,"acting_primary":2,"purged_snaps":[]},{"pgid":"4.3d","version":"0'0","reported_seq":40,"reported_epoch":48,"state":"active+clean","last_fresh":"2023-08-01T19:55:30.997532+0000","last_change":"2023-08-01T19:54:04.472579+0000","last_active":"2023-08-01T19:55:30.997532+0000","last_peered":"2023-08-01T19:55:30.997532+0000","last_clean":"2023-08-01T19:55:30.997532+0000","last_became_active":"2023-08-01T19:54:04.471128+0000","last_became_peered":"2023-08-01T19:54:04.471128+0000","last_unstale":"2023-08-01T19:55:30.997532+0000","last_undegraded":"2023-08-01T19:55:30.997532+0000","last_fullsized":"2023-08-01T19:55:30.997532+0000","mapping_epoch":16,"log_start":"0'0","ondisk_log_start":"0'0","created":16,"last_epoch_clean":17,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-08-01T19:54:04.040663+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-08-01T19:54:04.040663+0000","last_clean_scrub_stamp":"2023-08-01T19:54:04.040663+0000","objects_scrubbed":0,"log_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-08-03T03:04:06.137335+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[1,2],"acting":[1,2],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":1,"acting_primary":1,"purged_snaps":[]},{"pgid":"4.3c","version":"0'0","reported_seq":20,"reported_epoch":48,"state":"active+clean","last_fresh":"2023-08-01T19:55:31.006604+0000","last_change":"2023-08-01T19:55:11.596659+0000","last_active":"2023-08-01T19:55:31.006604+0000","last_peered":"2023-08-01T19:55:31.006604+0000","last_clean":"2023-08-01T19:55:31.006604+0000","last_became_active":"2023-08-01T19:55:11.596259+0000","last_became_peered":"2023-08-01T19:55:11.596259+0000","last_unstale":"2023-08-01T19:55:31.006604+0000","last_undegraded":"2023-08-01T19:55:31.006604+0000","last_fullsized":"2023-08-01T19:55:31.006604+0000","mapping_epoch":40,"log_start":"0'0","ondisk_log_start":"0'0","created":16,"last_epoch_clean":41,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-08-01T19:54:04.040663+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-08-01T19:54:04.040663+0000","last_clean_scrub_stamp":"2023-08-01T19:54:04.040663+0000","objects_scrubbed":0,"log_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-08-03T04:14:41.855119+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[0,1],"acting":[0,1],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":0,"acting_primary":0,"purged_snaps":[]},{"pgid":"4.3b","version":"0'0","reported_seq":40,"reported_epoch":48,"state":"active+clean","last_fresh":"2023-08-01T19:55:30.993689+0000","last_change":"2023-08-01T19:54:04.467197+0000","last_active":"2023-08-01T19:55:30.993689+0000","last_peered":"2023-08-01T19:55:30.993689+0000","last_clean":"2023-08-01T19:55:30.993689+0000","last_became_active":"2023-08-01T19:54:04.466526+0000","last_became_peered":"2023-08-01T19:54:04.466526+0000","last_unstale":"2023-08-01T19:55:30.993689+0000","last_undegraded":"2023-08-01T19:55:30.993689+0000","last_fullsized":"2023-08-01T19:55:30.993689+0000","mapping_epoch":16,"log_start":"0'0","ondisk_log_start":"0'0","created":16,"last_epoch_clean":17,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-08-01T19:54:04.040663+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-08-01T19:54:04.040663+0000","last_clean_scrub_stamp":"2023-08-01T19:54:04.040663+0000","objects_scrubbed":0,"log_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-08-03T06:54:18.982174+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[2,0],"acting":[2,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":2,"acting_primary":2,"purged_snaps":[]},{"pgid":"4.3a","version":"0'0","reported_seq":20,"reported_epoch":48,"state":"active+clean","last_fresh":"2023-08-01T19:55:31.006269+0000","last_change":"2023-08-01T19:55:11.595847+0000","last_active":"2023-08-01T19:55:31.006269+0000","last_peered":"2023-08-01T19:55:31.006269+0000","last_clean":"2023-08-01T19:55:31.006269+0000","last_became_active":"2023-08-01T19:55:11.595435+0000","last_became_peered":"2023-08-01T19:55:11.595435+0000","last_unstale":"2023-08-01T19:55:31.006269+0000","last_undegraded":"2023-08-01T19:55:31.006269+0000","last_fullsized":"2023-08-01T19:55:31.006269+0000","mapping_epoch":40,"log_start":"0'0","ondisk_log_start":"0'0","created":16,"last_epoch_clean":41,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-08-01T19:54:04.040663+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-08-01T19:54:04.040663+0000","last_clean_scrub_stamp":"2023-08-01T19:54:04.040663+0000","objects_scrubbed":0,"log_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-08-03T01:14:30.767847+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[0,1],"acting":[0,1],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":0,"acting_primary":0,"purged_snaps":[]},{"pgid":"4.39","version":"0'0","reported_seq":20,"reported_epoch":48,"state":"active+clean","last_fresh":"2023-08-01T19:55:31.005968+0000","last_change":"2023-08-01T19:55:11.612943+0000","last_active":"2023-08-01T19:55:31.005968+0000","last_peered":"2023-08-01T19:55:31.005968+0000","last_clean":"2023-08-01T19:55:31.005968+0000","last_became_active":"2023-08-01T19:55:11.612371+0000","last_became_peered":"2023-08-01T19:55:11.612371+0000","last_unstale":"2023-08-01T19:55:31.005968+0000","last_undegraded":"2023-08-01T19:55:31.005968+0000","last_fullsized":"2023-08-01T19:55:31.005968+0000","mapping_epoch":40,"log_start":"0'0","ondisk_log_start":"0'0","created":16,"last_epoch_clean":41,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-08-01T19:54:04.040663+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-08-01T19:54:04.040663+0000","last_clean_scrub_stamp":"2023-08-01T19:54:04.040663+0000","objects_scrubbed":0,"log_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-08-03T01:14:02.441930+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[0,1],"acting":[0,1],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":0,"acting_primary":0,"purged_snaps":[]},{"pgid":"4.38","version":"0'0","reported_seq":40,"reported_epoch":48,"state":"active+clean","last_fresh":"2023-08-01T19:55:30.996157+0000","last_change":"2023-08-01T19:54:04.478505+0000","last_active":"2023-08-01T19:55:30.996157+0000","last_peered":"2023-08-01T19:55:30.996157+0000","last_clean":"2023-08-01T19:55:30.996157+0000","last_became_active":"2023-08-01T19:54:04.477325+0000","last_became_peered":"2023-08-01T19:54:04.477325+0000","last_unstale":"2023-08-01T19:55:30.996157+0000","last_undegraded":"2023-08-01T19:55:30.996157+0000","last_fullsized":"2023-08-01T19:55:30.996157+0000","mapping_epoch":16,"log_start":"0'0","ondisk_log_start":"0'0","created":16,"last_epoch_clean":17,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-08-01T19:54:04.040663+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-08-01T19:54:04.040663+0000","last_clean_scrub_stamp":"2023-08-01T19:54:04.040663+0000","objects_scrubbed":0,"log_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-08-03T01:38:12.939736+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[1,0],"acting":[1,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":1,"acting_primary":1,"purged_snaps":[]},{"pgid":"4.37","version":"0'0","reported_seq":40,"reported_epoch":48,"state":"active+clean","last_fresh":"2023-08-01T19:55:31.006432+0000","last_change":"2023-08-01T19:54:04.470971+0000","last_active":"2023-08-01T19:55:31.006432+0000","last_peered":"2023-08-01T19:55:31.006432+0000","last_clean":"2023-08-01T19:55:31.006432+0000","last_became_active":"2023-08-01T19:54:04.469011+0000","last_became_peered":"2023-08-01T19:54:04.469011+0000","last_unstale":"2023-08-01T19:55:31.006432+0000","last_undegraded":"2023-08-01T19:55:31.006432+0000","last_fullsized":"2023-08-01T19:55:31.006432+0000","mapping_epoch":16,"log_start":"0'0","ondisk_log_start":"0'0","created":16,"last_epoch_clean":17,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-08-01T19:54:04.040663+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-08-01T19:54:04.040663+0000","last_clean_scrub_stamp":"2023-08-01T19:54:04.040663+0000","objects_scrubbed":0,"log_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-08-03T06:50:03.420334+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[0,2],"acting":[0,2],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":0,"acting_primary":0,"purged_snaps":[]},{"pgid":"4.36","version":"0'0","reported_seq":40,"reported_epoch":48,"state":"active+clean","last_fresh":"2023-08-01T19:55:30.994385+0000","last_change":"2023-08-01T19:54:04.473523+0000","last_active":"2023-08-01T19:55:30.994385+0000","last_peered":"2023-08-01T19:55:30.994385+0000","last_clean":"2023-08-01T19:55:30.994385+0000","last_became_active":"2023-08-01T19:54:04.473084+0000","last_became_peered":"2023-08-01T19:54:04.473084+0000","last_unstale":"2023-08-01T19:55:30.994385+0000","last_undegraded":"2023-08-01T19:55:30.994385+0000","last_fullsized":"2023-08-01T19:55:30.994385+0000","mapping_epoch":16,"log_start":"0'0","ondisk_log_start":"0'0","created":16,"last_epoch_clean":17,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-08-01T19:54:04.040663+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-08-01T19:54:04.040663+0000","last_clean_scrub_stamp":"2023-08-01T19:54:04.040663+0000","objects_scrubbed":0,"log_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-08-03T04:28:59.042443+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[2,0],"acting":[2,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":2,"acting_primary":2,"purged_snaps":[]},{"pgid":"4.35","version":"0'0","reported_seq":20,"reported_epoch":48,"state":"active+clean","last_fresh":"2023-08-01T19:55:31.006384+0000","last_change":"2023-08-01T19:55:11.593519+0000","last_active":"2023-08-01T19:55:31.006384+0000","last_peered":"2023-08-01T19:55:31.006384+0000","last_clean":"2023-08-01T19:55:31.006384+0000","last_became_active":"2023-08-01T19:55:11.593236+0000","last_became_peered":"2023-08-01T19:55:11.593236+0000","last_unstale":"2023-08-01T19:55:31.006384+0000","last_undegraded":"2023-08-01T19:55:31.006384+0000","last_fullsized":"2023-08-01T19:55:31.006384+0000","mapping_epoch":40,"log_start":"0'0","ondisk_log_start":"0'0","created":16,"last_epoch_clean":41,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-08-01T19:54:04.040663+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-08-01T19:54:04.040663+0000","last_clean_scrub_stamp":"2023-08-01T19:54:04.040663+0000","objects_scrubbed":0,"log_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-08-03T06:02:31.485631+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[0,1],"acting":[0,1],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":0,"acting_primary":0,"purged_snaps":[]},{"pgid":"4.34","version":"0'0","reported_seq":40,"reported_epoch":48,"state":"active+clean","last_fresh":"2023-08-01T19:55:30.996009+0000","last_change":"2023-08-01T19:54:04.468009+0000","last_active":"2023-08-01T19:55:30.996009+0000","last_peered":"2023-08-01T19:55:30.996009+0000","last_clean":"2023-08-01T19:55:30.996009+0000","last_became_active":"2023-08-01T19:54:04.467568+0000","last_became_peered":"2023-08-01T19:54:04.467568+0000","last_unstale":"2023-08-01T19:55:30.996009+0000","last_undegraded":"2023-08-01T19:55:30.996009+0000","last_fullsized":"2023-08-01T19:55:30.996009+0000","mapping_epoch":16,"log_start":"0'0","ondisk_log_start":"0'0","created":16,"last_epoch_clean":17,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-08-01T19:54:04.040663+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-08-01T19:54:04.040663+0000","last_clean_scrub_stamp":"2023-08-01T19:54:04.040663+0000","objects_scrubbed":0,"log_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-08-03T04:53:44.017572+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[2,1],"acting":[2,1],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":2,"acting_primary":2,"purged_snaps":[]},{"pgid":"4.33","version":"0'0","reported_seq":40,"reported_epoch":48,"state":"active+clean","last_fresh":"2023-08-01T19:55:30.994173+0000","last_change":"2023-08-01T19:54:04.466770+0000","last_active":"2023-08-01T19:55:30.994173+0000","last_peered":"2023-08-01T19:55:30.994173+0000","last_clean":"2023-08-01T19:55:30.994173+0000","last_became_active":"2023-08-01T19:54:04.466460+0000","last_became_peered":"2023-08-01T19:54:04.466460+0000","last_unstale":"2023-08-01T19:55:30.994173+0000","last_undegraded":"2023-08-01T19:55:30.994173+0000","last_fullsized":"2023-08-01T19:55:30.994173+0000","mapping_epoch":16,"log_start":"0'0","ondisk_log_start":"0'0","created":16,"last_epoch_clean":17,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-08-01T19:54:04.040663+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-08-01T19:54:04.040663+0000","last_clean_scrub_stamp":"2023-08-01T19:54:04.040663+0000","objects_scrubbed":0,"log_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-08-03T06:04:11.595951+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[2,0],"acting":[2,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":2,"acting_primary":2,"purged_snaps":[]},{"pgid":"4.32","version":"0'0","reported_seq":20,"reported_epoch":48,"state":"active+clean","last_fresh":"2023-08-01T19:55:30.993517+0000","last_change":"2023-08-01T19:55:11.589671+0000","last_active":"2023-08-01T19:55:30.993517+0000","last_peered":"2023-08-01T19:55:30.993517+0000","last_clean":"2023-08-01T19:55:30.993517+0000","last_became_active":"2023-08-01T19:55:11.589441+0000","last_became_peered":"2023-08-01T19:55:11.589441+0000","last_unstale":"2023-08-01T19:55:30.993517+0000","last_undegraded":"2023-08-01T19:55:30.993517+0000","last_fullsized":"2023-08-01T19:55:30.993517+0000","mapping_epoch":40,"log_start":"0'0","ondisk_log_start":"0'0","created":16,"last_epoch_clean":41,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-08-01T19:54:04.040663+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-08-01T19:54:04.040663+0000","last_clean_scrub_stamp":"2023-08-01T19:54:04.040663+0000","objects_scrubbed":0,"log_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-08-03T07:30:02.795230+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[2,1],"acting":[2,1],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":2,"acting_primary":2,"purged_snaps":[]},{"pgid":"4.31","version":"0'0","reported_seq":40,"reported_epoch":48,"state":"active+clean","last_fresh":"2023-08-01T19:55:30.996353+0000","last_change":"2023-08-01T19:54:04.472407+0000","last_active":"2023-08-01T19:55:30.996353+0000","last_peered":"2023-08-01T19:55:30.996353+0000","last_clean":"2023-08-01T19:55:30.996353+0000","last_became_active":"2023-08-01T19:54:04.472008+0000","last_became_peered":"2023-08-01T19:54:04.472008+0000","last_unstale":"2023-08-01T19:55:30.996353+0000","last_undegraded":"2023-08-01T19:55:30.996353+0000","last_fullsized":"2023-08-01T19:55:30.996353+0000","mapping_epoch":16,"log_start":"0'0","ondisk_log_start":"0'0","created":16,"last_epoch_clean":17,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-08-01T19:54:04.040663+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-08-01T19:54:04.040663+0000","last_clean_scrub_stamp":"2023-08-01T19:54:04.040663+0000","objects_scrubbed":0,"log_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-08-02T22:42:25.293502+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[1,2],"acting":[1,2],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":1,"acting_primary":1,"purged_snaps":[]},{"pgid":"4.30","version":"0'0","reported_seq":20,"reported_epoch":48,"state":"active+clean","last_fresh":"2023-08-01T19:55:31.005885+0000","last_change":"2023-08-01T19:55:11.596254+0000","last_active":"2023-08-01T19:55:31.005885+0000","last_peered":"2023-08-01T19:55:31.005885+0000","last_clean":"2023-08-01T19:55:31.005885+0000","last_became_active":"2023-08-01T19:55:11.595463+0000","last_became_peered":"2023-08-01T19:55:11.595463+0000","last_unstale":"2023-08-01T19:55:31.005885+0000","last_undegraded":"2023-08-01T19:55:31.005885+0000","last_fullsized":"2023-08-01T19:55:31.005885+0000","mapping_epoch":40,"log_start":"0'0","ondisk_log_start":"0'0","created":16,"last_epoch_clean":41,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-08-01T19:54:04.040663+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-08-01T19:54:04.040663+0000","last_clean_scrub_stamp":"2023-08-01T19:54:04.040663+0000","objects_scrubbed":0,"log_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-08-02T23:10:21.458279+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[0,1],"acting":[0,1],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":0,"acting_primary":0,"purged_snaps":[]},{"pgid":"4.2f","version":"0'0","reported_seq":40,"reported_epoch":48,"state":"active+clean","last_fresh":"2023-08-01T19:55:31.006514+0000","last_change":"2023-08-01T19:54:04.470302+0000","last_active":"2023-08-01T19:55:31.006514+0000","last_peered":"2023-08-01T19:55:31.006514+0000","last_clean":"2023-08-01T19:55:31.006514+0000","last_became_active":"2023-08-01T19:54:04.468919+0000","last_became_peered":"2023-08-01T19:54:04.468919+0000","last_unstale":"2023-08-01T19:55:31.006514+0000","last_undegraded":"2023-08-01T19:55:31.006514+0000","last_fullsized":"2023-08-01T19:55:31.006514+0000","mapping_epoch":16,"log_start":"0'0","ondisk_log_start":"0'0","created":16,"last_epoch_clean":17,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-08-01T19:54:04.040663+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-08-01T19:54:04.040663+0000","last_clean_scrub_stamp":"2023-08-01T19:54:04.040663+0000","objects_scrubbed":0,"log_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-08-02T22:42:25.293502+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[0,2],"acting":[0,2],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":0,"acting_primary":0,"purged_snaps":[]},{"pgid":"4.2e","version":"0'0","reported_seq":40,"reported_epoch":48,"state":"active+clean","last_fresh":"2023-08-01T19:55:30.994543+0000","last_change":"2023-08-01T19:54:04.474058+0000","last_active":"2023-08-01T19:55:30.994543+0000","last_peered":"2023-08-01T19:55:30.994543+0000","last_clean":"2023-08-01T19:55:30.994543+0000","last_became_active":"2023-08-01T19:54:04.473355+0000","last_became_peered":"2023-08-01T19:54:04.473355+0000","last_unstale":"2023-08-01T19:55:30.994543+0000","last_undegraded":"2023-08-01T19:55:30.994543+0000","last_fullsized":"2023-08-01T19:55:30.994543+0000","mapping_epoch":16,"log_start":"0'0","ondisk_log_start":"0'0","created":16,"last_epoch_clean":17,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-08-01T19:54:04.040663+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-08-01T19:54:04.040663+0000","last_clean_scrub_stamp":"2023-08-01T19:54:04.040663+0000","objects_scrubbed":0,"log_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-08-03T04:55:54.197252+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[2,0],"acting":[2,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":2,"acting_primary":2,"purged_snaps":[]},{"pgid":"4.2d","version":"0'0","reported_seq":40,"reported_epoch":48,"state":"active+clean","last_fresh":"2023-08-01T19:55:31.006618+0000","last_change":"2023-08-01T19:54:04.468775+0000","last_active":"2023-08-01T19:55:31.006618+0000","last_peered":"2023-08-01T19:55:31.006618+0000","last_clean":"2023-08-01T19:55:31.006618+0000","last_became_active":"2023-08-01T19:54:04.467274+0000","last_became_peered":"2023-08-01T19:54:04.467274+0000","last_unstale":"2023-08-01T19:55:31.006618+0000","last_undegraded":"2023-08-01T19:55:31.006618+0000","last_fullsized":"2023-08-01T19:55:31.006618+0000","mapping_epoch":16,"log_start":"0'0","ondisk_log_start":"0'0","created":16,"last_epoch_clean":17,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-08-01T19:54:04.040663+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-08-01T19:54:04.040663+0000","last_clean_scrub_stamp":"2023-08-01T19:54:04.040663+0000","objects_scrubbed":0,"log_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-08-02T23:00:37.537286+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[0,2],"acting":[0,2],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":0,"acting_primary":0,"purged_snaps":[]},{"pgid":"4.2c","version":"0'0","reported_seq":20,"reported_epoch":48,"state":"active+clean","last_fresh":"2023-08-01T19:55:31.009611+0000","last_change":"2023-08-01T19:55:11.595857+0000","last_active":"2023-08-01T19:55:31.009611+0000","last_peered":"2023-08-01T19:55:31.009611+0000","last_clean":"2023-08-01T19:55:31.009611+0000","last_became_active":"2023-08-01T19:55:11.595386+0000","last_became_peered":"2023-08-01T19:55:11.595386+0000","last_unstale":"2023-08-01T19:55:31.009611+0000","last_undegraded":"2023-08-01T19:55:31.009611+0000","last_fullsized":"2023-08-01T19:55:31.009611+0000","mapping_epoch":40,"log_start":"0'0","ondisk_log_start":"0'0","created":16,"last_epoch_clean":41,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-08-01T19:54:04.040663+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-08-01T19:54:04.040663+0000","last_clean_scrub_stamp":"2023-08-01T19:54:04.040663+0000","objects_scrubbed":0,"log_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-08-03T02:27:53.540347+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[0,1],"acting":[0,1],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":0,"acting_primary":0,"purged_snaps":[]},{"pgid":"4.2b","version":"0'0","reported_seq":40,"reported_epoch":48,"state":"active+clean","last_fresh":"2023-08-01T19:55:30.997063+0000","last_change":"2023-08-01T19:54:04.474047+0000","last_active":"2023-08-01T19:55:30.997063+0000","last_peered":"2023-08-01T19:55:30.997063+0000","last_clean":"2023-08-01T19:55:30.997063+0000","last_became_active":"2023-08-01T19:54:04.473578+0000","last_became_peered":"2023-08-01T19:54:04.473578+0000","last_unstale":"2023-08-01T19:55:30.997063+0000","last_undegraded":"2023-08-01T19:55:30.997063+0000","last_fullsized":"2023-08-01T19:55:30.997063+0000","mapping_epoch":16,"log_start":"0'0","ondisk_log_start":"0'0","created":16,"last_epoch_clean":17,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-08-01T19:54:04.040663+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-08-01T19:54:04.040663+0000","last_clean_scrub_stamp":"2023-08-01T19:54:04.040663+0000","objects_scrubbed":0,"log_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-08-03T05:39:29.199142+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[1,0],"acting":[1,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":1,"acting_primary":1,"purged_snaps":[]},{"pgid":"4.2a","version":"0'0","reported_seq":40,"reported_epoch":48,"state":"active+clean","last_fresh":"2023-08-01T19:55:30.993881+0000","last_change":"2023-08-01T19:54:04.469281+0000","last_active":"2023-08-01T19:55:30.993881+0000","last_peered":"2023-08-01T19:55:30.993881+0000","last_clean":"2023-08-01T19:55:30.993881+0000","last_became_active":"2023-08-01T19:54:04.468771+0000","last_became_peered":"2023-08-01T19:54:04.468771+0000","last_unstale":"2023-08-01T19:55:30.993881+0000","last_undegraded":"2023-08-01T19:55:30.993881+0000","last_fullsized":"2023-08-01T19:55:30.993881+0000","mapping_epoch":16,"log_start":"0'0","ondisk_log_start":"0'0","created":16,"last_epoch_clean":17,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-08-01T19:54:04.040663+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-08-01T19:54:04.040663+0000","last_clean_scrub_stamp":"2023-08-01T19:54:04.040663+0000","objects_scrubbed":0,"log_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-08-03T01:15:27.748810+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[2,1],"acting":[2,1],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":2,"acting_primary":2,"purged_snaps":[]},{"pgid":"4.29","version":"0'0","reported_seq":40,"reported_epoch":48,"state":"active+clean","last_fresh":"2023-08-01T19:55:31.007635+0000","last_change":"2023-08-01T19:54:04.466694+0000","last_active":"2023-08-01T19:55:31.007635+0000","last_peered":"2023-08-01T19:55:31.007635+0000","last_clean":"2023-08-01T19:55:31.007635+0000","last_became_active":"2023-08-01T19:54:04.466250+0000","last_became_peered":"2023-08-01T19:54:04.466250+0000","last_unstale":"2023-08-01T19:55:31.007635+0000","last_undegraded":"2023-08-01T19:55:31.007635+0000","last_fullsized":"2023-08-01T19:55:31.007635+0000","mapping_epoch":16,"log_start":"0'0","ondisk_log_start":"0'0","created":16,"last_epoch_clean":17,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-08-01T19:54:04.040663+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-08-01T19:54:04.040663+0000","last_clean_scrub_stamp":"2023-08-01T19:54:04.040663+0000","objects_scrubbed":0,"log_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-08-03T01:00:18.725898+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[0,1],"acting":[0,1],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":0,"acting_primary":0,"purged_snaps":[]},{"pgid":"4.28","version":"0'0","reported_seq":40,"reported_epoch":48,"state":"active+clean","last_fresh":"2023-08-01T19:55:30.993785+0000","last_change":"2023-08-01T19:54:04.468160+0000","last_active":"2023-08-01T19:55:30.993785+0000","last_peered":"2023-08-01T19:55:30.993785+0000","last_clean":"2023-08-01T19:55:30.993785+0000","last_became_active":"2023-08-01T19:54:04.467625+0000","last_became_peered":"2023-08-01T19:54:04.467625+0000","last_unstale":"2023-08-01T19:55:30.993785+0000","last_undegraded":"2023-08-01T19:55:30.993785+0000","last_fullsized":"2023-08-01T19:55:30.993785+0000","mapping_epoch":16,"log_start":"0'0","ondisk_log_start":"0'0","created":16,"last_epoch_clean":17,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-08-01T19:54:04.040663+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-08-01T19:54:04.040663+0000","last_clean_scrub_stamp":"2023-08-01T19:54:04.040663+0000","objects_scrubbed":0,"log_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-08-02T21:27:52.506153+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[2,0],"acting":[2,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":2,"acting_primary":2,"purged_snaps":[]},{"pgid":"4.27","version":"0'0","reported_seq":40,"reported_epoch":48,"state":"active+clean","last_fresh":"2023-08-01T19:55:30.995393+0000","last_change":"2023-08-01T19:54:04.469187+0000","last_active":"2023-08-01T19:55:30.995393+0000","last_peered":"2023-08-01T19:55:30.995393+0000","last_clean":"2023-08-01T19:55:30.995393+0000","last_became_active":"2023-08-01T19:54:04.468628+0000","last_became_peered":"2023-08-01T19:54:04.468628+0000","last_unstale":"2023-08-01T19:55:30.995393+0000","last_undegraded":"2023-08-01T19:55:30.995393+0000","last_fullsized":"2023-08-01T19:55:30.995393+0000","mapping_epoch":16,"log_start":"0'0","ondisk_log_start":"0'0","created":16,"last_epoch_clean":17,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-08-01T19:54:04.040663+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-08-01T19:54:04.040663+0000","last_clean_scrub_stamp":"2023-08-01T19:54:04.040663+0000","objects_scrubbed":0,"log_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-08-03T00:07:29.565677+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[2,1],"acting":[2,1],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":2,"acting_primary":2,"purged_snaps":[]},{"pgid":"4.26","version":"0'0","reported_seq":40,"reported_epoch":48,"state":"active+clean","last_fresh":"2023-08-01T19:55:31.010939+0000","last_change":"2023-08-01T19:54:04.470942+0000","last_active":"2023-08-01T19:55:31.010939+0000","last_peered":"2023-08-01T19:55:31.010939+0000","last_clean":"2023-08-01T19:55:31.010939+0000","last_became_active":"2023-08-01T19:54:04.470564+0000","last_became_peered":"2023-08-01T19:54:04.470564+0000","last_unstale":"2023-08-01T19:55:31.010939+0000","last_undegraded":"2023-08-01T19:55:31.010939+0000","last_fullsized":"2023-08-01T19:55:31.010939+0000","mapping_epoch":16,"log_start":"0'0","ondisk_log_start":"0'0","created":16,"last_epoch_clean":17,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-08-01T19:54:04.040663+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-08-01T19:54:04.040663+0000","last_clean_scrub_stamp":"2023-08-01T19:54:04.040663+0000","objects_scrubbed":0,"log_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-08-03T04:43:21.408174+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[0,1],"acting":[0,1],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":0,"acting_primary":0,"purged_snaps":[]},{"pgid":"4.25","version":"0'0","reported_seq":40,"reported_epoch":48,"state":"active+clean","last_fresh":"2023-08-01T19:55:30.997445+0000","last_change":"2023-08-01T19:54:04.474813+0000","last_active":"2023-08-01T19:55:30.997445+0000","last_peered":"2023-08-01T19:55:30.997445+0000","last_clean":"2023-08-01T19:55:30.997445+0000","last_became_active":"2023-08-01T19:54:04.472530+0000","last_became_peered":"2023-08-01T19:54:04.472530+0000","last_unstale":"2023-08-01T19:55:30.997445+0000","last_undegraded":"2023-08-01T19:55:30.997445+0000","last_fullsized":"2023-08-01T19:55:30.997445+0000","mapping_epoch":16,"log_start":"0'0","ondisk_log_start":"0'0","created":16,"last_epoch_clean":17,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-08-01T19:54:04.040663+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-08-01T19:54:04.040663+0000","last_clean_scrub_stamp":"2023-08-01T19:54:04.040663+0000","objects_scrubbed":0,"log_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-08-03T01:00:18.725898+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[1,2],"acting":[1,2],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":1,"acting_primary":1,"purged_snaps":[]},{"pgid":"3.1a","version":"17'1","reported_seq":42,"reported_epoch":48,"state":"active+clean","last_fresh":"2023-08-01T19:55:30.993860+0000","last_change":"2023-08-01T19:54:04.063936+0000","last_active":"2023-08-01T19:55:30.993860+0000","last_peered":"2023-08-01T19:55:30.993860+0000","last_clean":"2023-08-01T19:55:30.993860+0000","last_became_active":"2023-08-01T19:54:04.063674+0000","last_became_peered":"2023-08-01T19:54:04.063674+0000","last_unstale":"2023-08-01T19:55:30.993860+0000","last_undegraded":"2023-08-01T19:55:30.993860+0000","last_fullsized":"2023-08-01T19:55:30.993860+0000","mapping_epoch":15,"log_start":"0'0","ondisk_log_start":"0'0","created":15,"last_epoch_clean":16,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-08-01T19:54:03.032665+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-08-01T19:54:03.032665+0000","last_clean_scrub_stamp":"2023-08-01T19:54:03.032665+0000","objects_scrubbed":0,"log_size":1,"ondisk_log_size":1,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-08-03T00:06:00.058200+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[2,0],"acting":[2,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":2,"acting_primary":2,"purged_snaps":[]},{"pgid":"4.1d","version":"0'0","reported_seq":40,"reported_epoch":48,"state":"active+clean","last_fresh":"2023-08-01T19:55:30.996223+0000","last_change":"2023-08-01T19:54:04.471916+0000","last_active":"2023-08-01T19:55:30.996223+0000","last_peered":"2023-08-01T19:55:30.996223+0000","last_clean":"2023-08-01T19:55:30.996223+0000","last_became_active":"2023-08-01T19:54:04.471480+0000","last_became_peered":"2023-08-01T19:54:04.471480+0000","last_unstale":"2023-08-01T19:55:30.996223+0000","last_undegraded":"2023-08-01T19:55:30.996223+0000","last_fullsized":"2023-08-01T19:55:30.996223+0000","mapping_epoch":16,"log_start":"0'0","ondisk_log_start":"0'0","created":16,"last_epoch_clean":17,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-08-01T19:54:04.040663+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-08-01T19:54:04.040663+0000","last_clean_scrub_stamp":"2023-08-01T19:54:04.040663+0000","objects_scrubbed":0,"log_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-08-02T21:19:17.547590+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[2,1],"acting":[2,1],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":2,"acting_primary":2,"purged_snaps":[]},{"pgid":"3.19","version":"0'0","reported_seq":41,"reported_epoch":48,"state":"active+clean","last_fresh":"2023-08-01T19:55:31.007699+0000","last_change":"2023-08-01T19:54:04.067837+0000","last_active":"2023-08-01T19:55:31.007699+0000","last_peered":"2023-08-01T19:55:31.007699+0000","last_clean":"2023-08-01T19:55:31.007699+0000","last_became_active":"2023-08-01T19:54:04.067535+0000","last_became_peered":"2023-08-01T19:54:04.067535+0000","last_unstale":"2023-08-01T19:55:31.007699+0000","last_undegraded":"2023-08-01T19:55:31.007699+0000","last_fullsized":"2023-08-01T19:55:31.007699+0000","mapping_epoch":15,"log_start":"0'0","ondisk_log_start":"0'0","created":15,"last_epoch_clean":16,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-08-01T19:54:03.032665+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-08-01T19:54:03.032665+0000","last_clean_scrub_stamp":"2023-08-01T19:54:03.032665+0000","objects_scrubbed":0,"log_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-08-02T20:56:47.324761+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[0,1],"acting":[0,1],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":0,"acting_primary":0,"purged_snaps":[]},{"pgid":"4.1e","version":"0'0","reported_seq":40,"reported_epoch":48,"state":"active+clean","last_fresh":"2023-08-01T19:55:31.011037+0000","last_change":"2023-08-01T19:54:04.470544+0000","last_active":"2023-08-01T19:55:31.011037+0000","last_peered":"2023-08-01T19:55:31.011037+0000","last_clean":"2023-08-01T19:55:31.011037+0000","last_became_active":"2023-08-01T19:54:04.469657+0000","last_became_peered":"2023-08-01T19:54:04.469657+0000","last_unstale":"2023-08-01T19:55:31.011037+0000","last_undegraded":"2023-08-01T19:55:31.011037+0000","last_fullsized":"2023-08-01T19:55:31.011037+0000","mapping_epoch":16,"log_start":"0'0","ondisk_log_start":"0'0","created":16,"last_epoch_clean":17,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-08-01T19:54:04.040663+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-08-01T19:54:04.040663+0000","last_clean_scrub_stamp":"2023-08-01T19:54:04.040663+0000","objects_scrubbed":0,"log_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-08-02T23:12:30.830199+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[0,1],"acting":[0,1],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":0,"acting_primary":0,"purged_snaps":[]},{"pgid":"3.18","version":"0'0","reported_seq":41,"reported_epoch":48,"state":"active+clean","last_fresh":"2023-08-01T19:55:31.006392+0000","last_change":"2023-08-01T19:54:04.064289+0000","last_active":"2023-08-01T19:55:31.006392+0000","last_peered":"2023-08-01T19:55:31.006392+0000","last_clean":"2023-08-01T19:55:31.006392+0000","last_became_active":"2023-08-01T19:54:04.063971+0000","last_became_peered":"2023-08-01T19:54:04.063971+0000","last_unstale":"2023-08-01T19:55:31.006392+0000","last_undegraded":"2023-08-01T19:55:31.006392+0000","last_fullsized":"2023-08-01T19:55:31.006392+0000","mapping_epoch":15,"log_start":"0'0","ondisk_log_start":"0'0","created":15,"last_epoch_clean":16,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-08-01T19:54:03.032665+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-08-01T19:54:03.032665+0000","last_clean_scrub_stamp":"2023-08-01T19:54:03.032665+0000","objects_scrubbed":0,"log_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-08-03T04:09:30.496098+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[0,2],"acting":[0,2],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":0,"acting_primary":0,"purged_snaps":[]},{"pgid":"4.1f","version":"0'0","reported_seq":40,"reported_epoch":48,"state":"active+clean","last_fresh":"2023-08-01T19:55:30.995330+0000","last_change":"2023-08-01T19:54:04.472227+0000","last_active":"2023-08-01T19:55:30.995330+0000","last_peered":"2023-08-01T19:55:30.995330+0000","last_clean":"2023-08-01T19:55:30.995330+0000","last_became_active":"2023-08-01T19:54:04.471767+0000","last_became_peered":"2023-08-01T19:54:04.471767+0000","last_unstale":"2023-08-01T19:55:30.995330+0000","last_undegraded":"2023-08-01T19:55:30.995330+0000","last_fullsized":"2023-08-01T19:55:30.995330+0000","mapping_epoch":16,"log_start":"0'0","ondisk_log_start":"0'0","created":16,"last_epoch_clean":17,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-08-01T19:54:04.040663+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-08-01T19:54:04.040663+0000","last_clean_scrub_stamp":"2023-08-01T19:54:04.040663+0000","objects_scrubbed":0,"log_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-08-02T20:25:25.280329+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[2,1],"acting":[2,1],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":2,"acting_primary":2,"purged_snaps":[]},{"pgid":"3.17","version":"0'0","reported_seq":41,"reported_epoch":48,"state":"active+clean","last_fresh":"2023-08-01T19:55:31.006858+0000","last_change":"2023-08-01T19:54:04.067975+0000","last_active":"2023-08-01T19:55:31.006858+0000","last_peered":"2023-08-01T19:55:31.006858+0000","last_clean":"2023-08-01T19:55:31.006858+0000","last_became_active":"2023-08-01T19:54:04.067577+0000","last_became_peered":"2023-08-01T19:54:04.067577+0000","last_unstale":"2023-08-01T19:55:31.006858+0000","last_undegraded":"2023-08-01T19:55:31.006858+0000","last_fullsized":"2023-08-01T19:55:31.006858+0000","mapping_epoch":15,"log_start":"0'0","ondisk_log_start":"0'0","created":15,"last_epoch_clean":16,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-08-01T19:54:03.032665+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-08-01T19:54:03.032665+0000","last_clean_scrub_stamp":"2023-08-01T19:54:03.032665+0000","objects_scrubbed":0,"log_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-08-03T07:13:34.025722+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[0,1],"acting":[0,1],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":0,"acting_primary":0,"purged_snaps":[]},{"pgid":"4.10","version":"0'0","reported_seq":40,"reported_epoch":48,"state":"active+clean","last_fresh":"2023-08-01T19:55:31.006002+0000","last_change":"2023-08-01T19:54:04.467146+0000","last_active":"2023-08-01T19:55:31.006002+0000","last_peered":"2023-08-01T19:55:31.006002+0000","last_clean":"2023-08-01T19:55:31.006002+0000","last_became_active":"2023-08-01T19:54:04.466627+0000","last_became_peered":"2023-08-01T19:54:04.466627+0000","last_unstale":"2023-08-01T19:55:31.006002+0000","last_undegraded":"2023-08-01T19:55:31.006002+0000","last_fullsized":"2023-08-01T19:55:31.006002+0000","mapping_epoch":16,"log_start":"0'0","ondisk_log_start":"0'0","created":16,"last_epoch_clean":17,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-08-01T19:54:04.040663+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-08-01T19:54:04.040663+0000","last_clean_scrub_stamp":"2023-08-01T19:54:04.040663+0000","objects_scrubbed":0,"log_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-08-03T04:43:26.793480+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[0,2],"acting":[0,2],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":0,"acting_primary":0,"purged_snaps":[]},{"pgid":"3.16","version":"0'0","reported_seq":20,"reported_epoch":48,"state":"active+clean","last_fresh":"2023-08-01T19:55:31.011209+0000","last_change":"2023-08-01T19:55:11.595790+0000","last_active":"2023-08-01T19:55:31.011209+0000","last_peered":"2023-08-01T19:55:31.011209+0000","last_clean":"2023-08-01T19:55:31.011209+0000","last_became_active":"2023-08-01T19:55:11.595430+0000","last_became_peered":"2023-08-01T19:55:11.595430+0000","last_unstale":"2023-08-01T19:55:31.011209+0000","last_undegraded":"2023-08-01T19:55:31.011209+0000","last_fullsized":"2023-08-01T19:55:31.011209+0000","mapping_epoch":40,"log_start":"0'0","ondisk_log_start":"0'0","created":15,"last_epoch_clean":41,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-08-01T19:54:03.032665+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-08-01T19:54:03.032665+0000","last_clean_scrub_stamp":"2023-08-01T19:54:03.032665+0000","objects_scrubbed":0,"log_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-08-02T21:57:45.604518+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[0,1],"acting":[0,1],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":0,"acting_primary":0,"purged_snaps":[]},{"pgid":"4.11","version":"0'0","reported_seq":40,"reported_epoch":48,"state":"active+clean","last_fresh":"2023-08-01T19:55:31.010664+0000","last_change":"2023-08-01T19:54:04.470401+0000","last_active":"2023-08-01T19:55:31.010664+0000","last_peered":"2023-08-01T19:55:31.010664+0000","last_clean":"2023-08-01T19:55:31.010664+0000","last_became_active":"2023-08-01T19:54:04.469680+0000","last_became_peered":"2023-08-01T19:54:04.469680+0000","last_unstale":"2023-08-01T19:55:31.010664+0000","last_undegraded":"2023-08-01T19:55:31.010664+0000","last_fullsized":"2023-08-01T19:55:31.010664+0000","mapping_epoch":16,"log_start":"0'0","ondisk_log_start":"0'0","created":16,"last_epoch_clean":17,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-08-01T19:54:04.040663+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-08-01T19:54:04.040663+0000","last_clean_scrub_stamp":"2023-08-01T19:54:04.040663+0000","objects_scrubbed":0,"log_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-08-03T03:58:06.360840+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[0,1],"acting":[0,1],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":0,"acting_primary":0,"purged_snaps":[]},{"pgid":"3.15","version":"17'3","reported_seq":44,"reported_epoch":48,"state":"active+clean","last_fresh":"2023-08-01T19:55:30.994386+0000","last_change":"2023-08-01T19:54:04.065443+0000","last_active":"2023-08-01T19:55:30.994386+0000","last_peered":"2023-08-01T19:55:30.994386+0000","last_clean":"2023-08-01T19:55:30.994386+0000","last_became_active":"2023-08-01T19:54:04.065112+0000","last_became_peered":"2023-08-01T19:54:04.065112+0000","last_unstale":"2023-08-01T19:55:30.994386+0000","last_undegraded":"2023-08-01T19:55:30.994386+0000","last_fullsized":"2023-08-01T19:55:30.994386+0000","mapping_epoch":15,"log_start":"0'0","ondisk_log_start":"0'0","created":15,"last_epoch_clean":16,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-08-01T19:54:03.032665+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-08-01T19:54:03.032665+0000","last_clean_scrub_stamp":"2023-08-01T19:54:03.032665+0000","objects_scrubbed":0,"log_size":3,"ondisk_log_size":3,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-08-03T03:27:50.887004+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":90,"num_objects":2,"num_object_clones":0,"num_object_copies":4,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":2,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":4,"num_write_kb":1,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":1,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[2,1],"acting":[2,1],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":2,"acting_primary":2,"purged_snaps":[]},{"pgid":"4.12","version":"0'0","reported_seq":40,"reported_epoch":48,"state":"active+clean","last_fresh":"2023-08-01T19:55:31.007573+0000","last_change":"2023-08-01T19:54:04.467822+0000","last_active":"2023-08-01T19:55:31.007573+0000","last_peered":"2023-08-01T19:55:31.007573+0000","last_clean":"2023-08-01T19:55:31.007573+0000","last_became_active":"2023-08-01T19:54:04.466667+0000","last_became_peered":"2023-08-01T19:54:04.466667+0000","last_unstale":"2023-08-01T19:55:31.007573+0000","last_undegraded":"2023-08-01T19:55:31.007573+0000","last_fullsized":"2023-08-01T19:55:31.007573+0000","mapping_epoch":16,"log_start":"0'0","ondisk_log_start":"0'0","created":16,"last_epoch_clean":17,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-08-01T19:54:04.040663+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-08-01T19:54:04.040663+0000","last_clean_scrub_stamp":"2023-08-01T19:54:04.040663+0000","objects_scrubbed":0,"log_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-08-03T02:57:18.148077+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[0,2],"acting":[0,2],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":0,"acting_primary":0,"purged_snaps":[]},{"pgid":"3.14","version":"17'6","reported_seq":33,"reported_epoch":48,"state":"active+clean","last_fresh":"2023-08-01T19:55:30.996131+0000","last_change":"2023-08-01T19:55:11.591023+0000","last_active":"2023-08-01T19:55:30.996131+0000","last_peered":"2023-08-01T19:55:30.996131+0000","last_clean":"2023-08-01T19:55:30.996131+0000","last_became_active":"2023-08-01T19:55:11.590698+0000","last_became_peered":"2023-08-01T19:55:11.590698+0000","last_unstale":"2023-08-01T19:55:30.996131+0000","last_undegraded":"2023-08-01T19:55:30.996131+0000","last_fullsized":"2023-08-01T19:55:30.996131+0000","mapping_epoch":40,"log_start":"0'0","ondisk_log_start":"0'0","created":15,"last_epoch_clean":41,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-08-01T19:54:03.032665+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-08-01T19:54:03.032665+0000","last_clean_scrub_stamp":"2023-08-01T19:54:03.032665+0000","objects_scrubbed":0,"log_size":6,"ondisk_log_size":6,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-08-03T04:36:46.112514+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":1536,"num_objects":4,"num_object_clones":0,"num_object_copies":8,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":4,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":6,"num_write_kb":3,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":1,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[2,1],"acting":[2,1],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":2,"acting_primary":2,"purged_snaps":[]},{"pgid":"4.13","version":"0'0","reported_seq":20,"reported_epoch":48,"state":"active+clean","last_fresh":"2023-08-01T19:55:30.994310+0000","last_change":"2023-08-01T19:55:11.590835+0000","last_active":"2023-08-01T19:55:30.994310+0000","last_peered":"2023-08-01T19:55:30.994310+0000","last_clean":"2023-08-01T19:55:30.994310+0000","last_became_active":"2023-08-01T19:55:11.590569+0000","last_became_peered":"2023-08-01T19:55:11.590569+0000","last_unstale":"2023-08-01T19:55:30.994310+0000","last_undegraded":"2023-08-01T19:55:30.994310+0000","last_fullsized":"2023-08-01T19:55:30.994310+0000","mapping_epoch":40,"log_start":"0'0","ondisk_log_start":"0'0","created":16,"last_epoch_clean":41,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-08-01T19:54:04.040663+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-08-01T19:54:04.040663+0000","last_clean_scrub_stamp":"2023-08-01T19:54:04.040663+0000","objects_scrubbed":0,"log_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-08-03T04:21:54.206707+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[2,1],"acting":[2,1],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":2,"acting_primary":2,"purged_snaps":[]},{"pgid":"3.13","version":"17'2","reported_seq":43,"reported_epoch":48,"state":"active+clean","last_fresh":"2023-08-01T19:55:30.997230+0000","last_change":"2023-08-01T19:54:04.065212+0000","last_active":"2023-08-01T19:55:30.997230+0000","last_peered":"2023-08-01T19:55:30.997230+0000","last_clean":"2023-08-01T19:55:30.997230+0000","last_became_active":"2023-08-01T19:54:04.064375+0000","last_became_peered":"2023-08-01T19:54:04.064375+0000","last_unstale":"2023-08-01T19:55:30.997230+0000","last_undegraded":"2023-08-01T19:55:30.997230+0000","last_fullsized":"2023-08-01T19:55:30.997230+0000","mapping_epoch":15,"log_start":"0'0","ondisk_log_start":"0'0","created":15,"last_epoch_clean":16,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-08-01T19:54:03.032665+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-08-01T19:54:03.032665+0000","last_clean_scrub_stamp":"2023-08-01T19:54:03.032665+0000","objects_scrubbed":0,"log_size":2,"ondisk_log_size":2,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-08-03T06:17:37.910752+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":34,"num_objects":2,"num_object_clones":0,"num_object_copies":4,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":2,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":3,"num_write_kb":6,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":1,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[1,0],"acting":[1,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":1,"acting_primary":1,"purged_snaps":[]},{"pgid":"4.14","version":"0'0","reported_seq":40,"reported_epoch":48,"state":"active+clean","last_fresh":"2023-08-01T19:55:30.996080+0000","last_change":"2023-08-01T19:54:04.464446+0000","last_active":"2023-08-01T19:55:30.996080+0000","last_peered":"2023-08-01T19:55:30.996080+0000","last_clean":"2023-08-01T19:55:30.996080+0000","last_became_active":"2023-08-01T19:54:04.464021+0000","last_became_peered":"2023-08-01T19:54:04.464021+0000","last_unstale":"2023-08-01T19:55:30.996080+0000","last_undegraded":"2023-08-01T19:55:30.996080+0000","last_fullsized":"2023-08-01T19:55:30.996080+0000","mapping_epoch":16,"log_start":"0'0","ondisk_log_start":"0'0","created":16,"last_epoch_clean":17,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-08-01T19:54:04.040663+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-08-01T19:54:04.040663+0000","last_clean_scrub_stamp":"2023-08-01T19:54:04.040663+0000","objects_scrubbed":0,"log_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-08-02T20:26:51.080849+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[2,0],"acting":[2,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":2,"acting_primary":2,"purged_snaps":[]},{"pgid":"3.12","version":"0'0","reported_seq":41,"reported_epoch":48,"state":"active+clean","last_fresh":"2023-08-01T19:55:31.007682+0000","last_change":"2023-08-01T19:54:04.066566+0000","last_active":"2023-08-01T19:55:31.007682+0000","last_peered":"2023-08-01T19:55:31.007682+0000","last_clean":"2023-08-01T19:55:31.007682+0000","last_became_active":"2023-08-01T19:54:04.066190+0000","last_became_peered":"2023-08-01T19:54:04.066190+0000","last_unstale":"2023-08-01T19:55:31.007682+0000","last_undegraded":"2023-08-01T19:55:31.007682+0000","last_fullsized":"2023-08-01T19:55:31.007682+0000","mapping_epoch":15,"log_start":"0'0","ondisk_log_start":"0'0","created":15,"last_epoch_clean":16,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-08-01T19:54:03.032665+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-08-01T19:54:03.032665+0000","last_clean_scrub_stamp":"2023-08-01T19:54:03.032665+0000","objects_scrubbed":0,"log_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-08-03T02:01:47.073630+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[0,1],"acting":[0,1],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":0,"acting_primary":0,"purged_snaps":[]},{"pgid":"4.15","version":"0'0","reported_seq":40,"reported_epoch":48,"state":"active+clean","last_fresh":"2023-08-01T19:55:30.996065+0000","last_change":"2023-08-01T19:54:04.468791+0000","last_active":"2023-08-01T19:55:30.996065+0000","last_peered":"2023-08-01T19:55:30.996065+0000","last_clean":"2023-08-01T19:55:30.996065+0000","last_became_active":"2023-08-01T19:54:04.468214+0000","last_became_peered":"2023-08-01T19:54:04.468214+0000","last_unstale":"2023-08-01T19:55:30.996065+0000","last_undegraded":"2023-08-01T19:55:30.996065+0000","last_fullsized":"2023-08-01T19:55:30.996065+0000","mapping_epoch":16,"log_start":"0'0","ondisk_log_start":"0'0","created":16,"last_epoch_clean":17,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-08-01T19:54:04.040663+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-08-01T19:54:04.040663+0000","last_clean_scrub_stamp":"2023-08-01T19:54:04.040663+0000","objects_scrubbed":0,"log_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-08-03T04:10:44.729287+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[2,0],"acting":[2,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":2,"acting_primary":2,"purged_snaps":[]},{"pgid":"3.11","version":"0'0","reported_seq":41,"reported_epoch":48,"state":"active+clean","last_fresh":"2023-08-01T19:55:30.993679+0000","last_change":"2023-08-01T19:54:04.064280+0000","last_active":"2023-08-01T19:55:30.993679+0000","last_peered":"2023-08-01T19:55:30.993679+0000","last_clean":"2023-08-01T19:55:30.993679+0000","last_became_active":"2023-08-01T19:54:04.064064+0000","last_became_peered":"2023-08-01T19:54:04.064064+0000","last_unstale":"2023-08-01T19:55:30.993679+0000","last_undegraded":"2023-08-01T19:55:30.993679+0000","last_fullsized":"2023-08-01T19:55:30.993679+0000","mapping_epoch":15,"log_start":"0'0","ondisk_log_start":"0'0","created":15,"last_epoch_clean":16,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-08-01T19:54:03.032665+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-08-01T19:54:03.032665+0000","last_clean_scrub_stamp":"2023-08-01T19:54:03.032665+0000","objects_scrubbed":0,"log_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-08-03T06:13:51.475710+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[2,1],"acting":[2,1],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":2,"acting_primary":2,"purged_snaps":[]},{"pgid":"4.16","version":"0'0","reported_seq":40,"reported_epoch":48,"state":"active+clean","last_fresh":"2023-08-01T19:55:31.011075+0000","last_change":"2023-08-01T19:54:04.469724+0000","last_active":"2023-08-01T19:55:31.011075+0000","last_peered":"2023-08-01T19:55:31.011075+0000","last_clean":"2023-08-01T19:55:31.011075+0000","last_became_active":"2023-08-01T19:54:04.469275+0000","last_became_peered":"2023-08-01T19:54:04.469275+0000","last_unstale":"2023-08-01T19:55:31.011075+0000","last_undegraded":"2023-08-01T19:55:31.011075+0000","last_fullsized":"2023-08-01T19:55:31.011075+0000","mapping_epoch":16,"log_start":"0'0","ondisk_log_start":"0'0","created":16,"last_epoch_clean":17,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-08-01T19:54:04.040663+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-08-01T19:54:04.040663+0000","last_clean_scrub_stamp":"2023-08-01T19:54:04.040663+0000","objects_scrubbed":0,"log_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-08-03T03:04:06.137335+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[0,1],"acting":[0,1],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":0,"acting_primary":0,"purged_snaps":[]},{"pgid":"3.10","version":"17'8","reported_seq":28,"reported_epoch":48,"state":"active+clean","last_fresh":"2023-08-01T19:55:30.993620+0000","last_change":"2023-08-01T19:55:11.591065+0000","last_active":"2023-08-01T19:55:30.993620+0000","last_peered":"2023-08-01T19:55:30.993620+0000","last_clean":"2023-08-01T19:55:30.993620+0000","last_became_active":"2023-08-01T19:55:11.590550+0000","last_became_peered":"2023-08-01T19:55:11.590550+0000","last_unstale":"2023-08-01T19:55:30.993620+0000","last_undegraded":"2023-08-01T19:55:30.993620+0000","last_fullsized":"2023-08-01T19:55:30.993620+0000","mapping_epoch":40,"log_start":"0'0","ondisk_log_start":"0'0","created":15,"last_epoch_clean":41,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-08-01T19:54:03.032665+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-08-01T19:54:03.032665+0000","last_clean_scrub_stamp":"2023-08-01T19:54:03.032665+0000","objects_scrubbed":0,"log_size":8,"ondisk_log_size":8,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-08-03T02:59:35.333215+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":4,"num_object_clones":0,"num_object_copies":8,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":4,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":12,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":4,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[2,1],"acting":[2,1],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":2,"acting_primary":2,"purged_snaps":[]},{"pgid":"4.17","version":"0'0","reported_seq":40,"reported_epoch":48,"state":"active+clean","last_fresh":"2023-08-01T19:55:31.007051+0000","last_change":"2023-08-01T19:54:04.472721+0000","last_active":"2023-08-01T19:55:31.007051+0000","last_peered":"2023-08-01T19:55:31.007051+0000","last_clean":"2023-08-01T19:55:31.007051+0000","last_became_active":"2023-08-01T19:54:04.472126+0000","last_became_peered":"2023-08-01T19:54:04.472126+0000","last_unstale":"2023-08-01T19:55:31.007051+0000","last_undegraded":"2023-08-01T19:55:31.007051+0000","last_fullsized":"2023-08-01T19:55:31.007051+0000","mapping_epoch":16,"log_start":"0'0","ondisk_log_start":"0'0","created":16,"last_epoch_clean":17,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-08-01T19:54:04.040663+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-08-01T19:54:04.040663+0000","last_clean_scrub_stamp":"2023-08-01T19:54:04.040663+0000","objects_scrubbed":0,"log_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-08-03T00:29:05.857138+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[0,1],"acting":[0,1],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":0,"acting_primary":0,"purged_snaps":[]},{"pgid":"5.9","version":"49'9828","reported_seq":9872,"reported_epoch":49,"state":"active+clean","last_fresh":"2023-08-01T19:55:36.082557+0000","last_change":"2023-08-01T19:55:11.603489+0000","last_active":"2023-08-01T19:55:36.082557+0000","last_peered":"2023-08-01T19:55:36.082557+0000","last_clean":"2023-08-01T19:55:36.082557+0000","last_became_active":"2023-08-01T19:55:11.590417+0000","last_became_peered":"2023-08-01T19:55:11.590417+0000","last_unstale":"2023-08-01T19:55:36.082557+0000","last_undegraded":"2023-08-01T19:55:36.082557+0000","last_fullsized":"2023-08-01T19:55:36.082557+0000","mapping_epoch":40,"log_start":"36'5800","ondisk_log_start":"36'5800","created":19,"last_epoch_clean":41,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-08-01T19:54:22.116710+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-08-01T19:54:22.116710+0000","last_clean_scrub_stamp":"2023-08-01T19:54:22.116710+0000","objects_scrubbed":0,"log_size":4028,"ondisk_log_size":4028,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-08-03T04:41:29.477101+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":456130560,"num_objects":6960,"num_object_clones":0,"num_object_copies":13920,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":6960,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":9828,"num_write_kb":537216,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[2,1],"acting":[2,1],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":2,"acting_primary":2,"purged_snaps":[]},{"pgid":"3.f","version":"17'1","reported_seq":42,"reported_epoch":48,"state":"active+clean","last_fresh":"2023-08-01T19:55:30.997400+0000","last_change":"2023-08-01T19:54:04.060797+0000","last_active":"2023-08-01T19:55:30.997400+0000","last_peered":"2023-08-01T19:55:30.997400+0000","last_clean":"2023-08-01T19:55:30.997400+0000","last_became_active":"2023-08-01T19:54:04.060444+0000","last_became_peered":"2023-08-01T19:54:04.060444+0000","last_unstale":"2023-08-01T19:55:30.997400+0000","last_undegraded":"2023-08-01T19:55:30.997400+0000","last_fullsized":"2023-08-01T19:55:30.997400+0000","mapping_epoch":15,"log_start":"0'0","ondisk_log_start":"0'0","created":15,"last_epoch_clean":16,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-08-01T19:54:03.032665+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-08-01T19:54:03.032665+0000","last_clean_scrub_stamp":"2023-08-01T19:54:03.032665+0000","objects_scrubbed":0,"log_size":1,"ondisk_log_size":1,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-08-03T07:13:34.025722+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":22,"num_objects":1,"num_object_clones":0,"num_object_copies":2,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":1,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":1,"num_write_kb":1,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[1,2],"acting":[1,2],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":1,"acting_primary":1,"purged_snaps":[]},{"pgid":"4.8","version":"0'0","reported_seq":40,"reported_epoch":48,"state":"active+clean","last_fresh":"2023-08-01T19:55:30.993417+0000","last_change":"2023-08-01T19:54:04.467671+0000","last_active":"2023-08-01T19:55:30.993417+0000","last_peered":"2023-08-01T19:55:30.993417+0000","last_clean":"2023-08-01T19:55:30.993417+0000","last_became_active":"2023-08-01T19:54:04.467300+0000","last_became_peered":"2023-08-01T19:54:04.467300+0000","last_unstale":"2023-08-01T19:55:30.993417+0000","last_undegraded":"2023-08-01T19:55:30.993417+0000","last_fullsized":"2023-08-01T19:55:30.993417+0000","mapping_epoch":16,"log_start":"0'0","ondisk_log_start":"0'0","created":16,"last_epoch_clean":17,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-08-01T19:54:04.040663+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-08-01T19:54:04.040663+0000","last_clean_scrub_stamp":"2023-08-01T19:54:04.040663+0000","objects_scrubbed":0,"log_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-08-03T05:27:24.774345+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[2,1],"acting":[2,1],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":2,"acting_primary":2,"purged_snaps":[]},{"pgid":"5.8","version":"49'9759","reported_seq":9796,"reported_epoch":49,"state":"active+clean","last_fresh":"2023-08-01T19:55:36.061238+0000","last_change":"2023-08-01T19:54:23.139383+0000","last_active":"2023-08-01T19:55:36.061238+0000","last_peered":"2023-08-01T19:55:36.061238+0000","last_clean":"2023-08-01T19:55:36.061238+0000","last_became_active":"2023-08-01T19:54:23.139198+0000","last_became_peered":"2023-08-01T19:54:23.139198+0000","last_unstale":"2023-08-01T19:55:36.061238+0000","last_undegraded":"2023-08-01T19:55:36.061238+0000","last_fullsized":"2023-08-01T19:55:36.061238+0000","mapping_epoch":19,"log_start":"36'5800","ondisk_log_start":"36'5800","created":19,"last_epoch_clean":20,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-08-01T19:54:22.116710+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-08-01T19:54:22.116710+0000","last_clean_scrub_stamp":"2023-08-01T19:54:22.116710+0000","objects_scrubbed":0,"log_size":3959,"ondisk_log_size":3959,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-08-03T05:20:31.724064+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":461963264,"num_objects":7049,"num_object_clones":0,"num_object_copies":14098,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":7049,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":9759,"num_write_kb":537856,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[2,0],"acting":[2,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":2,"acting_primary":2,"purged_snaps":[]},{"pgid":"3.e","version":"17'2","reported_seq":43,"reported_epoch":48,"state":"active+clean","last_fresh":"2023-08-01T19:55:30.994249+0000","last_change":"2023-08-01T19:54:04.065595+0000","last_active":"2023-08-01T19:55:30.994249+0000","last_peered":"2023-08-01T19:55:30.994249+0000","last_clean":"2023-08-01T19:55:30.994249+0000","last_became_active":"2023-08-01T19:54:04.065303+0000","last_became_peered":"2023-08-01T19:54:04.065303+0000","last_unstale":"2023-08-01T19:55:30.994249+0000","last_undegraded":"2023-08-01T19:55:30.994249+0000","last_fullsized":"2023-08-01T19:55:30.994249+0000","mapping_epoch":15,"log_start":"0'0","ondisk_log_start":"0'0","created":15,"last_epoch_clean":16,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-08-01T19:54:03.032665+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-08-01T19:54:03.032665+0000","last_clean_scrub_stamp":"2023-08-01T19:54:03.032665+0000","objects_scrubbed":0,"log_size":2,"ondisk_log_size":2,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-08-02T22:40:38.782053+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":1,"num_object_clones":0,"num_object_copies":2,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":1,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":3,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":1,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[2,1],"acting":[2,1],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":2,"acting_primary":2,"purged_snaps":[]},{"pgid":"4.9","version":"0'0","reported_seq":40,"reported_epoch":48,"state":"active+clean","last_fresh":"2023-08-01T19:55:30.993897+0000","last_change":"2023-08-01T19:54:04.468007+0000","last_active":"2023-08-01T19:55:30.993897+0000","last_peered":"2023-08-01T19:55:30.993897+0000","last_clean":"2023-08-01T19:55:30.993897+0000","last_became_active":"2023-08-01T19:54:04.467509+0000","last_became_peered":"2023-08-01T19:54:04.467509+0000","last_unstale":"2023-08-01T19:55:30.993897+0000","last_undegraded":"2023-08-01T19:55:30.993897+0000","last_fullsized":"2023-08-01T19:55:30.993897+0000","mapping_epoch":16,"log_start":"0'0","ondisk_log_start":"0'0","created":16,"last_epoch_clean":17,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-08-01T19:54:04.040663+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-08-01T19:54:04.040663+0000","last_clean_scrub_stamp":"2023-08-01T19:54:04.040663+0000","objects_scrubbed":0,"log_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-08-03T06:04:50.963711+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[2,0],"acting":[2,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":2,"acting_primary":2,"purged_snaps":[]},{"pgid":"5.b","version":"49'9669","reported_seq":9706,"reported_epoch":49,"state":"active+clean","last_fresh":"2023-08-01T19:55:36.069081+0000","last_change":"2023-08-01T19:54:23.138143+0000","last_active":"2023-08-01T19:55:36.069081+0000","last_peered":"2023-08-01T19:55:36.069081+0000","last_clean":"2023-08-01T19:55:36.069081+0000","last_became_active":"2023-08-01T19:54:23.137922+0000","last_became_peered":"2023-08-01T19:54:23.137922+0000","last_unstale":"2023-08-01T19:55:36.069081+0000","last_undegraded":"2023-08-01T19:55:36.069081+0000","last_fullsized":"2023-08-01T19:55:36.069081+0000","mapping_epoch":19,"log_start":"35'5700","ondisk_log_start":"35'5700","created":19,"last_epoch_clean":20,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-08-01T19:54:22.116710+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-08-01T19:54:22.116710+0000","last_clean_scrub_stamp":"2023-08-01T19:54:22.116710+0000","objects_scrubbed":0,"log_size":3969,"ondisk_log_size":3969,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-08-02T23:27:13.080055+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":454623232,"num_objects":6937,"num_object_clones":0,"num_object_copies":13874,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":6937,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":9669,"num_write_kb":531392,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[2,0],"acting":[2,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":2,"acting_primary":2,"purged_snaps":[]},{"pgid":"3.d","version":"17'1","reported_seq":42,"reported_epoch":48,"state":"active+clean","last_fresh":"2023-08-01T19:55:30.997490+0000","last_change":"2023-08-01T19:54:04.062853+0000","last_active":"2023-08-01T19:55:30.997490+0000","last_peered":"2023-08-01T19:55:30.997490+0000","last_clean":"2023-08-01T19:55:30.997490+0000","last_became_active":"2023-08-01T19:54:04.062598+0000","last_became_peered":"2023-08-01T19:54:04.062598+0000","last_unstale":"2023-08-01T19:55:30.997490+0000","last_undegraded":"2023-08-01T19:55:30.997490+0000","last_fullsized":"2023-08-01T19:55:30.997490+0000","mapping_epoch":15,"log_start":"0'0","ondisk_log_start":"0'0","created":15,"last_epoch_clean":16,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-08-01T19:54:03.032665+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-08-01T19:54:03.032665+0000","last_clean_scrub_stamp":"2023-08-01T19:54:03.032665+0000","objects_scrubbed":0,"log_size":1,"ondisk_log_size":1,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-08-02T20:56:47.324761+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":70,"num_objects":1,"num_object_clones":0,"num_object_copies":2,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":1,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":1,"num_write_kb":1,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[1,2],"acting":[1,2],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":1,"acting_primary":1,"purged_snaps":[]},{"pgid":"4.a","version":"0'0","reported_seq":40,"reported_epoch":48,"state":"active+clean","last_fresh":"2023-08-01T19:55:30.996525+0000","last_change":"2023-08-01T19:54:04.471997+0000","last_active":"2023-08-01T19:55:30.996525+0000","last_peered":"2023-08-01T19:55:30.996525+0000","last_clean":"2023-08-01T19:55:30.996525+0000","last_became_active":"2023-08-01T19:54:04.471204+0000","last_became_peered":"2023-08-01T19:54:04.471204+0000","last_unstale":"2023-08-01T19:55:30.996525+0000","last_undegraded":"2023-08-01T19:55:30.996525+0000","last_fullsized":"2023-08-01T19:55:30.996525+0000","mapping_epoch":16,"log_start":"0'0","ondisk_log_start":"0'0","created":16,"last_epoch_clean":17,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-08-01T19:54:04.040663+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-08-01T19:54:04.040663+0000","last_clean_scrub_stamp":"2023-08-01T19:54:04.040663+0000","objects_scrubbed":0,"log_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-08-02T23:12:30.830199+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[1,0],"acting":[1,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":1,"acting_primary":1,"purged_snaps":[]},{"pgid":"5.a","version":"49'9486","reported_seq":9523,"reported_epoch":49,"state":"active+clean","last_fresh":"2023-08-01T19:55:34.927747+0000","last_change":"2023-08-01T19:54:23.138147+0000","last_active":"2023-08-01T19:55:34.927747+0000","last_peered":"2023-08-01T19:55:34.927747+0000","last_clean":"2023-08-01T19:55:34.927747+0000","last_became_active":"2023-08-01T19:54:23.137827+0000","last_became_peered":"2023-08-01T19:54:23.137827+0000","last_unstale":"2023-08-01T19:55:34.927747+0000","last_undegraded":"2023-08-01T19:55:34.927747+0000","last_fullsized":"2023-08-01T19:55:34.927747+0000","mapping_epoch":19,"log_start":"36'5900","ondisk_log_start":"36'5900","created":19,"last_epoch_clean":20,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-08-01T19:54:22.116710+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-08-01T19:54:22.116710+0000","last_clean_scrub_stamp":"2023-08-01T19:54:22.116710+0000","objects_scrubbed":0,"log_size":3586,"ondisk_log_size":3586,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-08-03T05:22:32.106433+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":464388096,"num_objects":7086,"num_object_clones":0,"num_object_copies":14172,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":7086,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":9486,"num_write_kb":530304,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[0,2],"acting":[0,2],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":0,"acting_primary":0,"purged_snaps":[]},{"pgid":"3.c","version":"0'0","reported_seq":41,"reported_epoch":48,"state":"active+clean","last_fresh":"2023-08-01T19:55:30.997117+0000","last_change":"2023-08-01T19:54:04.063532+0000","last_active":"2023-08-01T19:55:30.997117+0000","last_peered":"2023-08-01T19:55:30.997117+0000","last_clean":"2023-08-01T19:55:30.997117+0000","last_became_active":"2023-08-01T19:54:04.063116+0000","last_became_peered":"2023-08-01T19:54:04.063116+0000","last_unstale":"2023-08-01T19:55:30.997117+0000","last_undegraded":"2023-08-01T19:55:30.997117+0000","last_fullsized":"2023-08-01T19:55:30.997117+0000","mapping_epoch":15,"log_start":"0'0","ondisk_log_start":"0'0","created":15,"last_epoch_clean":16,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-08-01T19:54:03.032665+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-08-01T19:54:03.032665+0000","last_clean_scrub_stamp":"2023-08-01T19:54:03.032665+0000","objects_scrubbed":0,"log_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-08-02T22:28:51.936138+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[1,0],"acting":[1,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":1,"acting_primary":1,"purged_snaps":[]},{"pgid":"4.b","version":"0'0","reported_seq":40,"reported_epoch":48,"state":"active+clean","last_fresh":"2023-08-01T19:55:31.006988+0000","last_change":"2023-08-01T19:54:04.470787+0000","last_active":"2023-08-01T19:55:31.006988+0000","last_peered":"2023-08-01T19:55:31.006988+0000","last_clean":"2023-08-01T19:55:31.006988+0000","last_became_active":"2023-08-01T19:54:04.470332+0000","last_became_peered":"2023-08-01T19:54:04.470332+0000","last_unstale":"2023-08-01T19:55:31.006988+0000","last_undegraded":"2023-08-01T19:55:31.006988+0000","last_fullsized":"2023-08-01T19:55:31.006988+0000","mapping_epoch":16,"log_start":"0'0","ondisk_log_start":"0'0","created":16,"last_epoch_clean":17,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-08-01T19:54:04.040663+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-08-01T19:54:04.040663+0000","last_clean_scrub_stamp":"2023-08-01T19:54:04.040663+0000","objects_scrubbed":0,"log_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-08-03T05:13:38.298401+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[0,1],"acting":[0,1],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":0,"acting_primary":0,"purged_snaps":[]},{"pgid":"5.d","version":"49'9514","reported_seq":9551,"reported_epoch":49,"state":"active+clean","last_fresh":"2023-08-01T19:55:36.082649+0000","last_change":"2023-08-01T19:54:23.134380+0000","last_active":"2023-08-01T19:55:36.082649+0000","last_peered":"2023-08-01T19:55:36.082649+0000","last_clean":"2023-08-01T19:55:36.082649+0000","last_became_active":"2023-08-01T19:54:23.134100+0000","last_became_peered":"2023-08-01T19:54:23.134100+0000","last_unstale":"2023-08-01T19:55:36.082649+0000","last_undegraded":"2023-08-01T19:55:36.082649+0000","last_fullsized":"2023-08-01T19:55:36.082649+0000","mapping_epoch":19,"log_start":"35'5500","ondisk_log_start":"35'5500","created":19,"last_epoch_clean":20,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-08-01T19:54:22.116710+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-08-01T19:54:22.116710+0000","last_clean_scrub_stamp":"2023-08-01T19:54:22.116710+0000","objects_scrubbed":0,"log_size":4014,"ondisk_log_size":4014,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-08-02T22:07:43.756233+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":452132888,"num_objects":6900,"num_object_clones":0,"num_object_copies":13800,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":6900,"num_whiteouts":0,"num_read":1,"num_read_kb":1,"num_write":9514,"num_write_kb":525185,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[2,1],"acting":[2,1],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":2,"acting_primary":2,"purged_snaps":[]},{"pgid":"3.b","version":"17'2","reported_seq":43,"reported_epoch":48,"state":"active+clean","last_fresh":"2023-08-01T19:55:31.006852+0000","last_change":"2023-08-01T19:54:04.066839+0000","last_active":"2023-08-01T19:55:31.006852+0000","last_peered":"2023-08-01T19:55:31.006852+0000","last_clean":"2023-08-01T19:55:31.006852+0000","last_became_active":"2023-08-01T19:54:04.065535+0000","last_became_peered":"2023-08-01T19:54:04.065535+0000","last_unstale":"2023-08-01T19:55:31.006852+0000","last_undegraded":"2023-08-01T19:55:31.006852+0000","last_fullsized":"2023-08-01T19:55:31.006852+0000","mapping_epoch":15,"log_start":"0'0","ondisk_log_start":"0'0","created":15,"last_epoch_clean":16,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-08-01T19:54:03.032665+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-08-01T19:54:03.032665+0000","last_clean_scrub_stamp":"2023-08-01T19:54:03.032665+0000","objects_scrubbed":0,"log_size":2,"ondisk_log_size":2,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-08-03T05:00:51.171444+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":1,"num_object_clones":0,"num_object_copies":2,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":1,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":1,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":1,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[0,1],"acting":[0,1],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":0,"acting_primary":0,"purged_snaps":[]},{"pgid":"4.c","version":"0'0","reported_seq":40,"reported_epoch":48,"state":"active+clean","last_fresh":"2023-08-01T19:55:30.997139+0000","last_change":"2023-08-01T19:54:04.478715+0000","last_active":"2023-08-01T19:55:30.997139+0000","last_peered":"2023-08-01T19:55:30.997139+0000","last_clean":"2023-08-01T19:55:30.997139+0000","last_became_active":"2023-08-01T19:54:04.477435+0000","last_became_peered":"2023-08-01T19:54:04.477435+0000","last_unstale":"2023-08-01T19:55:30.997139+0000","last_undegraded":"2023-08-01T19:55:30.997139+0000","last_fullsized":"2023-08-01T19:55:30.997139+0000","mapping_epoch":16,"log_start":"0'0","ondisk_log_start":"0'0","created":16,"last_epoch_clean":17,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-08-01T19:54:04.040663+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-08-01T19:54:04.040663+0000","last_clean_scrub_stamp":"2023-08-01T19:54:04.040663+0000","objects_scrubbed":0,"log_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-08-03T04:43:21.408174+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[1,0],"acting":[1,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":1,"acting_primary":1,"purged_snaps":[]},{"pgid":"5.c","version":"49'9561","reported_seq":9598,"reported_epoch":49,"state":"active+clean","last_fresh":"2023-08-01T19:55:34.954892+0000","last_change":"2023-08-01T19:54:23.138439+0000","last_active":"2023-08-01T19:55:34.954892+0000","last_peered":"2023-08-01T19:55:34.954892+0000","last_clean":"2023-08-01T19:55:34.954892+0000","last_became_active":"2023-08-01T19:54:23.138051+0000","last_became_peered":"2023-08-01T19:54:23.138051+0000","last_unstale":"2023-08-01T19:55:34.954892+0000","last_undegraded":"2023-08-01T19:55:34.954892+0000","last_fullsized":"2023-08-01T19:55:34.954892+0000","mapping_epoch":19,"log_start":"36'6000","ondisk_log_start":"36'6000","created":19,"last_epoch_clean":20,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-08-01T19:54:22.116710+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-08-01T19:54:22.116710+0000","last_clean_scrub_stamp":"2023-08-01T19:54:22.116710+0000","objects_scrubbed":0,"log_size":3561,"ondisk_log_size":3561,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-08-03T03:01:16.402814+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":461832192,"num_objects":7047,"num_object_clones":0,"num_object_copies":14094,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":7047,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":9561,"num_write_kb":531456,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[0,1],"acting":[0,1],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":0,"acting_primary":0,"purged_snaps":[]},{"pgid":"3.a","version":"0'0","reported_seq":20,"reported_epoch":48,"state":"active+clean","last_fresh":"2023-08-01T19:55:31.007436+0000","last_change":"2023-08-01T19:55:11.593578+0000","last_active":"2023-08-01T19:55:31.007436+0000","last_peered":"2023-08-01T19:55:31.007436+0000","last_clean":"2023-08-01T19:55:31.007436+0000","last_became_active":"2023-08-01T19:55:11.593267+0000","last_became_peered":"2023-08-01T19:55:11.593267+0000","last_unstale":"2023-08-01T19:55:31.007436+0000","last_undegraded":"2023-08-01T19:55:31.007436+0000","last_fullsized":"2023-08-01T19:55:31.007436+0000","mapping_epoch":40,"log_start":"0'0","ondisk_log_start":"0'0","created":15,"last_epoch_clean":41,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-08-01T19:54:03.032665+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-08-01T19:54:03.032665+0000","last_clean_scrub_stamp":"2023-08-01T19:54:03.032665+0000","objects_scrubbed":0,"log_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-08-02T23:23:42.096990+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[0,1],"acting":[0,1],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":0,"acting_primary":0,"purged_snaps":[]},{"pgid":"4.d","version":"0'0","reported_seq":40,"reported_epoch":48,"state":"active+clean","last_fresh":"2023-08-01T19:55:30.997605+0000","last_change":"2023-08-01T19:54:04.474755+0000","last_active":"2023-08-01T19:55:30.997605+0000","last_peered":"2023-08-01T19:55:30.997605+0000","last_clean":"2023-08-01T19:55:30.997605+0000","last_became_active":"2023-08-01T19:54:04.471526+0000","last_became_peered":"2023-08-01T19:54:04.471526+0000","last_unstale":"2023-08-01T19:55:30.997605+0000","last_undegraded":"2023-08-01T19:55:30.997605+0000","last_fullsized":"2023-08-01T19:55:30.997605+0000","mapping_epoch":16,"log_start":"0'0","ondisk_log_start":"0'0","created":16,"last_epoch_clean":17,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-08-01T19:54:04.040663+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-08-01T19:54:04.040663+0000","last_clean_scrub_stamp":"2023-08-01T19:54:04.040663+0000","objects_scrubbed":0,"log_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-08-03T06:50:03.420334+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[1,2],"acting":[1,2],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":1,"acting_primary":1,"purged_snaps":[]},{"pgid":"5.f","version":"49'9778","reported_seq":9823,"reported_epoch":49,"state":"active+clean","last_fresh":"2023-08-01T19:55:36.076983+0000","last_change":"2023-08-01T19:55:11.597094+0000","last_active":"2023-08-01T19:55:36.076983+0000","last_peered":"2023-08-01T19:55:36.076983+0000","last_clean":"2023-08-01T19:55:36.076983+0000","last_became_active":"2023-08-01T19:55:11.591208+0000","last_became_peered":"2023-08-01T19:55:11.591208+0000","last_unstale":"2023-08-01T19:55:36.076983+0000","last_undegraded":"2023-08-01T19:55:36.076983+0000","last_fullsized":"2023-08-01T19:55:36.076983+0000","mapping_epoch":40,"log_start":"35'5800","ondisk_log_start":"35'5800","created":19,"last_epoch_clean":41,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-08-01T19:54:22.116710+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-08-01T19:54:22.116710+0000","last_clean_scrub_stamp":"2023-08-01T19:54:22.116710+0000","objects_scrubbed":0,"log_size":3978,"ondisk_log_size":3978,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-08-03T07:38:26.526580+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":458358784,"num_objects":6994,"num_object_clones":0,"num_object_copies":13988,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":6994,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":9778,"num_write_kb":536704,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[2,1],"acting":[2,1],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":2,"acting_primary":2,"purged_snaps":[]},{"pgid":"3.9","version":"0'0","reported_seq":41,"reported_epoch":48,"state":"active+clean","last_fresh":"2023-08-01T19:55:30.993493+0000","last_change":"2023-08-01T19:54:04.065519+0000","last_active":"2023-08-01T19:55:30.993493+0000","last_peered":"2023-08-01T19:55:30.993493+0000","last_clean":"2023-08-01T19:55:30.993493+0000","last_became_active":"2023-08-01T19:54:04.065211+0000","last_became_peered":"2023-08-01T19:54:04.065211+0000","last_unstale":"2023-08-01T19:55:30.993493+0000","last_undegraded":"2023-08-01T19:55:30.993493+0000","last_fullsized":"2023-08-01T19:55:30.993493+0000","mapping_epoch":15,"log_start":"0'0","ondisk_log_start":"0'0","created":15,"last_epoch_clean":16,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-08-01T19:54:03.032665+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-08-01T19:54:03.032665+0000","last_clean_scrub_stamp":"2023-08-01T19:54:03.032665+0000","objects_scrubbed":0,"log_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-08-03T05:46:27.672957+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[2,1],"acting":[2,1],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":2,"acting_primary":2,"purged_snaps":[]},{"pgid":"4.e","version":"0'0","reported_seq":20,"reported_epoch":48,"state":"active+clean","last_fresh":"2023-08-01T19:55:30.994121+0000","last_change":"2023-08-01T19:55:11.591148+0000","last_active":"2023-08-01T19:55:30.994121+0000","last_peered":"2023-08-01T19:55:30.994121+0000","last_clean":"2023-08-01T19:55:30.994121+0000","last_became_active":"2023-08-01T19:55:11.590816+0000","last_became_peered":"2023-08-01T19:55:11.590816+0000","last_unstale":"2023-08-01T19:55:30.994121+0000","last_undegraded":"2023-08-01T19:55:30.994121+0000","last_fullsized":"2023-08-01T19:55:30.994121+0000","mapping_epoch":40,"log_start":"0'0","ondisk_log_start":"0'0","created":16,"last_epoch_clean":41,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-08-01T19:54:04.040663+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-08-01T19:54:04.040663+0000","last_clean_scrub_stamp":"2023-08-01T19:54:04.040663+0000","objects_scrubbed":0,"log_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-08-02T20:53:54.754642+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[2,1],"acting":[2,1],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":2,"acting_primary":2,"purged_snaps":[]},{"pgid":"5.e","version":"49'9806","reported_seq":9843,"reported_epoch":49,"state":"active+clean","last_fresh":"2023-08-01T19:55:36.080399+0000","last_change":"2023-08-01T19:54:23.138341+0000","last_active":"2023-08-01T19:55:36.080399+0000","last_peered":"2023-08-01T19:55:36.080399+0000","last_clean":"2023-08-01T19:55:36.080399+0000","last_became_active":"2023-08-01T19:54:23.138119+0000","last_became_peered":"2023-08-01T19:54:23.138119+0000","last_unstale":"2023-08-01T19:55:36.080399+0000","last_undegraded":"2023-08-01T19:55:36.080399+0000","last_fullsized":"2023-08-01T19:55:36.080399+0000","mapping_epoch":19,"log_start":"36'5800","ondisk_log_start":"36'5800","created":19,"last_epoch_clean":20,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-08-01T19:54:22.116710+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-08-01T19:54:22.116710+0000","last_clean_scrub_stamp":"2023-08-01T19:54:22.116710+0000","objects_scrubbed":0,"log_size":4006,"ondisk_log_size":4006,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-08-03T07:48:27.709982+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":453902336,"num_objects":6926,"num_object_clones":0,"num_object_copies":13852,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":6926,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":9806,"num_write_kb":535424,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[2,0],"acting":[2,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":2,"acting_primary":2,"purged_snaps":[]},{"pgid":"3.8","version":"0'0","reported_seq":41,"reported_epoch":48,"state":"active+clean","last_fresh":"2023-08-01T19:55:30.993566+0000","last_change":"2023-08-01T19:54:04.063990+0000","last_active":"2023-08-01T19:55:30.993566+0000","last_peered":"2023-08-01T19:55:30.993566+0000","last_clean":"2023-08-01T19:55:30.993566+0000","last_became_active":"2023-08-01T19:54:04.063652+0000","last_became_peered":"2023-08-01T19:54:04.063652+0000","last_unstale":"2023-08-01T19:55:30.993566+0000","last_undegraded":"2023-08-01T19:55:30.993566+0000","last_fullsized":"2023-08-01T19:55:30.993566+0000","mapping_epoch":15,"log_start":"0'0","ondisk_log_start":"0'0","created":15,"last_epoch_clean":16,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-08-01T19:54:03.032665+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-08-01T19:54:03.032665+0000","last_clean_scrub_stamp":"2023-08-01T19:54:03.032665+0000","objects_scrubbed":0,"log_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-08-03T05:30:28.028091+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[2,0],"acting":[2,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":2,"acting_primary":2,"purged_snaps":[]},{"pgid":"4.f","version":"0'0","reported_seq":40,"reported_epoch":48,"state":"active+clean","last_fresh":"2023-08-01T19:55:31.006703+0000","last_change":"2023-08-01T19:54:04.469648+0000","last_active":"2023-08-01T19:55:31.006703+0000","last_peered":"2023-08-01T19:55:31.006703+0000","last_clean":"2023-08-01T19:55:31.006703+0000","last_became_active":"2023-08-01T19:54:04.468445+0000","last_became_peered":"2023-08-01T19:54:04.468445+0000","last_unstale":"2023-08-01T19:55:31.006703+0000","last_undegraded":"2023-08-01T19:55:31.006703+0000","last_fullsized":"2023-08-01T19:55:31.006703+0000","mapping_epoch":16,"log_start":"0'0","ondisk_log_start":"0'0","created":16,"last_epoch_clean":17,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-08-01T19:54:04.040663+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-08-01T19:54:04.040663+0000","last_clean_scrub_stamp":"2023-08-01T19:54:04.040663+0000","objects_scrubbed":0,"log_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-08-03T05:46:11.085577+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[0,2],"acting":[0,2],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":0,"acting_primary":0,"purged_snaps":[]},{"pgid":"5.3","version":"49'9738","reported_seq":9775,"reported_epoch":49,"state":"active+clean","last_fresh":"2023-08-01T19:55:34.966068+0000","last_change":"2023-08-01T19:54:23.138357+0000","last_active":"2023-08-01T19:55:34.966068+0000","last_peered":"2023-08-01T19:55:34.966068+0000","last_clean":"2023-08-01T19:55:34.966068+0000","last_became_active":"2023-08-01T19:54:23.137942+0000","last_became_peered":"2023-08-01T19:54:23.137942+0000","last_unstale":"2023-08-01T19:55:34.966068+0000","last_undegraded":"2023-08-01T19:55:34.966068+0000","last_fullsized":"2023-08-01T19:55:34.966068+0000","mapping_epoch":19,"log_start":"37'6200","ondisk_log_start":"37'6200","created":19,"last_epoch_clean":20,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-08-01T19:54:22.116710+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-08-01T19:54:22.116710+0000","last_clean_scrub_stamp":"2023-08-01T19:54:22.116710+0000","objects_scrubbed":0,"log_size":3538,"ondisk_log_size":3538,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-08-03T01:44:47.434321+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":473038848,"num_objects":7218,"num_object_clones":0,"num_object_copies":14436,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":7218,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":9738,"num_write_kb":542592,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[0,1],"acting":[0,1],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":0,"acting_primary":0,"purged_snaps":[]},{"pgid":"2.4","version":"0'0","reported_seq":44,"reported_epoch":48,"state":"active+clean","last_fresh":"2023-08-01T19:55:31.010632+0000","last_change":"2023-08-01T19:53:58.973838+0000","last_active":"2023-08-01T19:55:31.010632+0000","last_peered":"2023-08-01T19:55:31.010632+0000","last_clean":"2023-08-01T19:55:31.010632+0000","last_became_active":"2023-08-01T19:53:58.973242+0000","last_became_peered":"2023-08-01T19:53:58.973242+0000","last_unstale":"2023-08-01T19:55:31.010632+0000","last_undegraded":"2023-08-01T19:55:31.010632+0000","last_fullsized":"2023-08-01T19:55:31.010632+0000","mapping_epoch":12,"log_start":"0'0","ondisk_log_start":"0'0","created":12,"last_epoch_clean":13,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-08-01T19:53:57.959448+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-08-01T19:53:57.959448+0000","last_clean_scrub_stamp":"2023-08-01T19:53:57.959448+0000","objects_scrubbed":0,"log_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-08-03T00:09:48.796549+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[0,2],"acting":[0,2],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":0,"acting_primary":0,"purged_snaps":[]},{"pgid":"3.5","version":"0'0","reported_seq":20,"reported_epoch":48,"state":"active+clean","last_fresh":"2023-08-01T19:55:31.006532+0000","last_change":"2023-08-01T19:55:11.596442+0000","last_active":"2023-08-01T19:55:31.006532+0000","last_peered":"2023-08-01T19:55:31.006532+0000","last_clean":"2023-08-01T19:55:31.006532+0000","last_became_active":"2023-08-01T19:55:11.595908+0000","last_became_peered":"2023-08-01T19:55:11.595908+0000","last_unstale":"2023-08-01T19:55:31.006532+0000","last_undegraded":"2023-08-01T19:55:31.006532+0000","last_fullsized":"2023-08-01T19:55:31.006532+0000","mapping_epoch":40,"log_start":"0'0","ondisk_log_start":"0'0","created":15,"last_epoch_clean":41,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-08-01T19:54:03.032665+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-08-01T19:54:03.032665+0000","last_clean_scrub_stamp":"2023-08-01T19:54:03.032665+0000","objects_scrubbed":0,"log_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-08-03T06:35:57.498471+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[0,1],"acting":[0,1],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":0,"acting_primary":0,"purged_snaps":[]},{"pgid":"4.2","version":"0'0","reported_seq":40,"reported_epoch":48,"state":"active+clean","last_fresh":"2023-08-01T19:55:30.994023+0000","last_change":"2023-08-01T19:54:04.471715+0000","last_active":"2023-08-01T19:55:30.994023+0000","last_peered":"2023-08-01T19:55:30.994023+0000","last_clean":"2023-08-01T19:55:30.994023+0000","last_became_active":"2023-08-01T19:54:04.471300+0000","last_became_peered":"2023-08-01T19:54:04.471300+0000","last_unstale":"2023-08-01T19:55:30.994023+0000","last_undegraded":"2023-08-01T19:55:30.994023+0000","last_fullsized":"2023-08-01T19:55:30.994023+0000","mapping_epoch":16,"log_start":"0'0","ondisk_log_start":"0'0","created":16,"last_epoch_clean":17,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-08-01T19:54:04.040663+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-08-01T19:54:04.040663+0000","last_clean_scrub_stamp":"2023-08-01T19:54:04.040663+0000","objects_scrubbed":0,"log_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-08-02T23:00:24.980203+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[2,1],"acting":[2,1],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":2,"acting_primary":2,"purged_snaps":[]},{"pgid":"5.5","version":"49'9477","reported_seq":9514,"reported_epoch":49,"state":"active+clean","last_fresh":"2023-08-01T19:55:34.960359+0000","last_change":"2023-08-01T19:54:23.137678+0000","last_active":"2023-08-01T19:55:34.960359+0000","last_peered":"2023-08-01T19:55:34.960359+0000","last_clean":"2023-08-01T19:55:34.960359+0000","last_became_active":"2023-08-01T19:54:23.136756+0000","last_became_peered":"2023-08-01T19:54:23.136756+0000","last_unstale":"2023-08-01T19:55:34.960359+0000","last_undegraded":"2023-08-01T19:55:34.960359+0000","last_fullsized":"2023-08-01T19:55:34.960359+0000","mapping_epoch":19,"log_start":"36'5900","ondisk_log_start":"36'5900","created":19,"last_epoch_clean":20,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-08-01T19:54:22.116710+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-08-01T19:54:22.116710+0000","last_clean_scrub_stamp":"2023-08-01T19:54:22.116710+0000","objects_scrubbed":0,"log_size":3577,"ondisk_log_size":3577,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-08-03T03:50:03.076219+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":463142912,"num_objects":7067,"num_object_clones":0,"num_object_copies":14134,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":7067,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":9477,"num_write_kb":529408,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[0,1],"acting":[0,1],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":0,"acting_primary":0,"purged_snaps":[]},{"pgid":"2.2","version":"0'0","reported_seq":44,"reported_epoch":48,"state":"active+clean","last_fresh":"2023-08-01T19:55:30.996597+0000","last_change":"2023-08-01T19:53:58.973665+0000","last_active":"2023-08-01T19:55:30.996597+0000","last_peered":"2023-08-01T19:55:30.996597+0000","last_clean":"2023-08-01T19:55:30.996597+0000","last_became_active":"2023-08-01T19:53:58.973463+0000","last_became_peered":"2023-08-01T19:53:58.973463+0000","last_unstale":"2023-08-01T19:55:30.996597+0000","last_undegraded":"2023-08-01T19:55:30.996597+0000","last_fullsized":"2023-08-01T19:55:30.996597+0000","mapping_epoch":12,"log_start":"0'0","ondisk_log_start":"0'0","created":12,"last_epoch_clean":13,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-08-01T19:53:57.959448+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-08-01T19:53:57.959448+0000","last_clean_scrub_stamp":"2023-08-01T19:53:57.959448+0000","objects_scrubbed":0,"log_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-08-03T04:50:42.368892+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[1,0],"acting":[1,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":1,"acting_primary":1,"purged_snaps":[]},{"pgid":"3.3","version":"0'0","reported_seq":41,"reported_epoch":48,"state":"active+clean","last_fresh":"2023-08-01T19:55:30.997136+0000","last_change":"2023-08-01T19:54:04.065415+0000","last_active":"2023-08-01T19:55:30.997136+0000","last_peered":"2023-08-01T19:55:30.997136+0000","last_clean":"2023-08-01T19:55:30.997136+0000","last_became_active":"2023-08-01T19:54:04.065030+0000","last_became_peered":"2023-08-01T19:54:04.065030+0000","last_unstale":"2023-08-01T19:55:30.997136+0000","last_undegraded":"2023-08-01T19:55:30.997136+0000","last_fullsized":"2023-08-01T19:55:30.997136+0000","mapping_epoch":15,"log_start":"0'0","ondisk_log_start":"0'0","created":15,"last_epoch_clean":16,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-08-01T19:54:03.032665+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-08-01T19:54:03.032665+0000","last_clean_scrub_stamp":"2023-08-01T19:54:03.032665+0000","objects_scrubbed":0,"log_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-08-02T21:33:27.007118+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[1,0],"acting":[1,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":1,"acting_primary":1,"purged_snaps":[]},{"pgid":"4.4","version":"0'0","reported_seq":40,"reported_epoch":48,"state":"active+clean","last_fresh":"2023-08-01T19:55:31.009538+0000","last_change":"2023-08-01T19:54:04.468101+0000","last_active":"2023-08-01T19:55:31.009538+0000","last_peered":"2023-08-01T19:55:31.009538+0000","last_clean":"2023-08-01T19:55:31.009538+0000","last_became_active":"2023-08-01T19:54:04.467409+0000","last_became_peered":"2023-08-01T19:54:04.467409+0000","last_unstale":"2023-08-01T19:55:31.009538+0000","last_undegraded":"2023-08-01T19:55:31.009538+0000","last_fullsized":"2023-08-01T19:55:31.009538+0000","mapping_epoch":16,"log_start":"0'0","ondisk_log_start":"0'0","created":16,"last_epoch_clean":17,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-08-01T19:54:04.040663+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-08-01T19:54:04.040663+0000","last_clean_scrub_stamp":"2023-08-01T19:54:04.040663+0000","objects_scrubbed":0,"log_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-08-02T21:43:30.325991+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[0,2],"acting":[0,2],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":0,"acting_primary":0,"purged_snaps":[]},{"pgid":"5.6","version":"49'9545","reported_seq":9582,"reported_epoch":49,"state":"active+clean","last_fresh":"2023-08-01T19:55:34.958443+0000","last_change":"2023-08-01T19:54:23.138275+0000","last_active":"2023-08-01T19:55:34.958443+0000","last_peered":"2023-08-01T19:55:34.958443+0000","last_clean":"2023-08-01T19:55:34.958443+0000","last_became_active":"2023-08-01T19:54:23.137973+0000","last_became_peered":"2023-08-01T19:54:23.137973+0000","last_unstale":"2023-08-01T19:55:34.958443+0000","last_undegraded":"2023-08-01T19:55:34.958443+0000","last_fullsized":"2023-08-01T19:55:34.958443+0000","mapping_epoch":19,"log_start":"36'6000","ondisk_log_start":"36'6000","created":19,"last_epoch_clean":20,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-08-01T19:54:22.116710+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-08-01T19:54:22.116710+0000","last_clean_scrub_stamp":"2023-08-01T19:54:22.116710+0000","objects_scrubbed":0,"log_size":3545,"ondisk_log_size":3545,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-08-03T01:19:10.526905+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":466157568,"num_objects":7113,"num_object_clones":0,"num_object_copies":14226,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":7113,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":9545,"num_write_kb":533056,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[0,1],"acting":[0,1],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":0,"acting_primary":0,"purged_snaps":[]},{"pgid":"2.1","version":"0'0","reported_seq":44,"reported_epoch":48,"state":"active+clean","last_fresh":"2023-08-01T19:55:31.007569+0000","last_change":"2023-08-01T19:53:58.973700+0000","last_active":"2023-08-01T19:55:31.007569+0000","last_peered":"2023-08-01T19:55:31.007569+0000","last_clean":"2023-08-01T19:55:31.007569+0000","last_became_active":"2023-08-01T19:53:58.973285+0000","last_became_peered":"2023-08-01T19:53:58.973285+0000","last_unstale":"2023-08-01T19:55:31.007569+0000","last_undegraded":"2023-08-01T19:55:31.007569+0000","last_fullsized":"2023-08-01T19:55:31.007569+0000","mapping_epoch":12,"log_start":"0'0","ondisk_log_start":"0'0","created":12,"last_epoch_clean":13,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-08-01T19:53:57.959448+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-08-01T19:53:57.959448+0000","last_clean_scrub_stamp":"2023-08-01T19:53:57.959448+0000","objects_scrubbed":0,"log_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-08-02T21:26:02.570824+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[0,2],"acting":[0,2],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":0,"acting_primary":0,"purged_snaps":[]},{"pgid":"3.0","version":"0'0","reported_seq":41,"reported_epoch":48,"state":"active+clean","last_fresh":"2023-08-01T19:55:30.993529+0000","last_change":"2023-08-01T19:54:04.064407+0000","last_active":"2023-08-01T19:55:30.993529+0000","last_peered":"2023-08-01T19:55:30.993529+0000","last_clean":"2023-08-01T19:55:30.993529+0000","last_became_active":"2023-08-01T19:54:04.064122+0000","last_became_peered":"2023-08-01T19:54:04.064122+0000","last_unstale":"2023-08-01T19:55:30.993529+0000","last_undegraded":"2023-08-01T19:55:30.993529+0000","last_fullsized":"2023-08-01T19:55:30.993529+0000","mapping_epoch":15,"log_start":"0'0","ondisk_log_start":"0'0","created":15,"last_epoch_clean":16,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-08-01T19:54:03.032665+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-08-01T19:54:03.032665+0000","last_clean_scrub_stamp":"2023-08-01T19:54:03.032665+0000","objects_scrubbed":0,"log_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-08-03T07:08:17.318689+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[2,1],"acting":[2,1],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":2,"acting_primary":2,"purged_snaps":[]},{"pgid":"4.7","version":"0'0","reported_seq":40,"reported_epoch":48,"state":"active+clean","last_fresh":"2023-08-01T19:55:31.006926+0000","last_change":"2023-08-01T19:54:04.469739+0000","last_active":"2023-08-01T19:55:31.006926+0000","last_peered":"2023-08-01T19:55:31.006926+0000","last_clean":"2023-08-01T19:55:31.006926+0000","last_became_active":"2023-08-01T19:54:04.468021+0000","last_became_peered":"2023-08-01T19:54:04.468021+0000","last_unstale":"2023-08-01T19:55:31.006926+0000","last_undegraded":"2023-08-01T19:55:31.006926+0000","last_fullsized":"2023-08-01T19:55:31.006926+0000","mapping_epoch":16,"log_start":"0'0","ondisk_log_start":"0'0","created":16,"last_epoch_clean":17,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-08-01T19:54:04.040663+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-08-01T19:54:04.040663+0000","last_clean_scrub_stamp":"2023-08-01T19:54:04.040663+0000","objects_scrubbed":0,"log_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-08-02T21:03:01.319028+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[0,2],"acting":[0,2],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":0,"acting_primary":0,"purged_snaps":[]},{"pgid":"5.4","version":"49'9577","reported_seq":9614,"reported_epoch":49,"state":"active+clean","last_fresh":"2023-08-01T19:55:36.080903+0000","last_change":"2023-08-01T19:54:23.138253+0000","last_active":"2023-08-01T19:55:36.080903+0000","last_peered":"2023-08-01T19:55:36.080903+0000","last_clean":"2023-08-01T19:55:36.080903+0000","last_became_active":"2023-08-01T19:54:23.137915+0000","last_became_peered":"2023-08-01T19:54:23.137915+0000","last_unstale":"2023-08-01T19:55:36.080903+0000","last_undegraded":"2023-08-01T19:55:36.080903+0000","last_fullsized":"2023-08-01T19:55:36.080903+0000","mapping_epoch":19,"log_start":"35'5600","ondisk_log_start":"35'5600","created":19,"last_epoch_clean":20,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-08-01T19:54:22.116710+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-08-01T19:54:22.116710+0000","last_clean_scrub_stamp":"2023-08-01T19:54:22.116710+0000","objects_scrubbed":0,"log_size":3977,"ondisk_log_size":3977,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-08-03T07:20:04.946515+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":453705728,"num_objects":6923,"num_object_clones":0,"num_object_copies":13846,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":6923,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":9577,"num_write_kb":528000,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[2,0],"acting":[2,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":2,"acting_primary":2,"purged_snaps":[]},{"pgid":"2.3","version":"0'0","reported_seq":44,"reported_epoch":48,"state":"active+clean","last_fresh":"2023-08-01T19:55:30.997161+0000","last_change":"2023-08-01T19:53:58.973768+0000","last_active":"2023-08-01T19:55:30.997161+0000","last_peered":"2023-08-01T19:55:30.997161+0000","last_clean":"2023-08-01T19:55:30.997161+0000","last_became_active":"2023-08-01T19:53:58.973492+0000","last_became_peered":"2023-08-01T19:53:58.973492+0000","last_unstale":"2023-08-01T19:55:30.997161+0000","last_undegraded":"2023-08-01T19:55:30.997161+0000","last_fullsized":"2023-08-01T19:55:30.997161+0000","mapping_epoch":12,"log_start":"0'0","ondisk_log_start":"0'0","created":12,"last_epoch_clean":13,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-08-01T19:53:57.959448+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-08-01T19:53:57.959448+0000","last_clean_scrub_stamp":"2023-08-01T19:53:57.959448+0000","objects_scrubbed":0,"log_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-08-03T02:04:52.034667+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[1,0],"acting":[1,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":1,"acting_primary":1,"purged_snaps":[]},{"pgid":"1.0","version":"10'157","reported_seq":243,"reported_epoch":48,"state":"active+clean","last_fresh":"2023-08-01T19:55:30.996176+0000","last_change":"2023-08-01T19:53:51.746910+0000","last_active":"2023-08-01T19:55:30.996176+0000","last_peered":"2023-08-01T19:55:30.996176+0000","last_clean":"2023-08-01T19:55:30.996176+0000","last_became_active":"2023-08-01T19:53:51.746590+0000","last_became_peered":"2023-08-01T19:53:51.746590+0000","last_unstale":"2023-08-01T19:55:30.996176+0000","last_undegraded":"2023-08-01T19:55:30.996176+0000","last_fullsized":"2023-08-01T19:55:30.996176+0000","mapping_epoch":9,"log_start":"0'0","ondisk_log_start":"0'0","created":9,"last_epoch_clean":10,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-08-01T19:53:50.735626+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-08-01T19:53:50.735626+0000","last_clean_scrub_stamp":"2023-08-01T19:53:50.735626+0000","objects_scrubbed":0,"log_size":157,"ondisk_log_size":157,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-08-03T02:56:50.228294+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":590368,"num_objects":2,"num_object_clones":0,"num_object_copies":4,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":2,"num_whiteouts":0,"num_read":136,"num_read_kb":118,"num_write":203,"num_write_kb":3460,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[1,2],"acting":[1,2],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":1,"acting_primary":1,"purged_snaps":[]},{"pgid":"3.2","version":"0'0","reported_seq":41,"reported_epoch":48,"state":"active+clean","last_fresh":"2023-08-01T19:55:31.007507+0000","last_change":"2023-08-01T19:54:04.064009+0000","last_active":"2023-08-01T19:55:31.007507+0000","last_peered":"2023-08-01T19:55:31.007507+0000","last_clean":"2023-08-01T19:55:31.007507+0000","last_became_active":"2023-08-01T19:54:04.063665+0000","last_became_peered":"2023-08-01T19:54:04.063665+0000","last_unstale":"2023-08-01T19:55:31.007507+0000","last_undegraded":"2023-08-01T19:55:31.007507+0000","last_fullsized":"2023-08-01T19:55:31.007507+0000","mapping_epoch":15,"log_start":"0'0","ondisk_log_start":"0'0","created":15,"last_epoch_clean":16,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-08-01T19:54:03.032665+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-08-01T19:54:03.032665+0000","last_clean_scrub_stamp":"2023-08-01T19:54:03.032665+0000","objects_scrubbed":0,"log_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-08-03T04:04:46.983253+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[0,2],"acting":[0,2],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":0,"acting_primary":0,"purged_snaps":[]},{"pgid":"4.5","version":"0'0","reported_seq":20,"reported_epoch":48,"state":"active+clean","last_fresh":"2023-08-01T19:55:30.993784+0000","last_change":"2023-08-01T19:55:11.590833+0000","last_active":"2023-08-01T19:55:30.993784+0000","last_peered":"2023-08-01T19:55:30.993784+0000","last_clean":"2023-08-01T19:55:30.993784+0000","last_became_active":"2023-08-01T19:55:11.590550+0000","last_became_peered":"2023-08-01T19:55:11.590550+0000","last_unstale":"2023-08-01T19:55:30.993784+0000","last_undegraded":"2023-08-01T19:55:30.993784+0000","last_fullsized":"2023-08-01T19:55:30.993784+0000","mapping_epoch":40,"log_start":"0'0","ondisk_log_start":"0'0","created":16,"last_epoch_clean":41,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-08-01T19:54:04.040663+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-08-01T19:54:04.040663+0000","last_clean_scrub_stamp":"2023-08-01T19:54:04.040663+0000","objects_scrubbed":0,"log_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-08-02T23:11:31.460615+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[2,1],"acting":[2,1],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":2,"acting_primary":2,"purged_snaps":[]},{"pgid":"5.7","version":"49'9568","reported_seq":9605,"reported_epoch":49,"state":"active+clean","last_fresh":"2023-08-01T19:55:34.936005+0000","last_change":"2023-08-01T19:54:23.138337+0000","last_active":"2023-08-01T19:55:34.936005+0000","last_peered":"2023-08-01T19:55:34.936005+0000","last_clean":"2023-08-01T19:55:34.936005+0000","last_became_active":"2023-08-01T19:54:23.138056+0000","last_became_peered":"2023-08-01T19:54:23.138056+0000","last_unstale":"2023-08-01T19:55:34.936005+0000","last_undegraded":"2023-08-01T19:55:34.936005+0000","last_fullsized":"2023-08-01T19:55:34.936005+0000","mapping_epoch":19,"log_start":"36'5800","ondisk_log_start":"36'5800","created":19,"last_epoch_clean":20,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-08-01T19:54:22.116710+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-08-01T19:54:22.116710+0000","last_clean_scrub_stamp":"2023-08-01T19:54:22.116710+0000","objects_scrubbed":0,"log_size":3768,"ondisk_log_size":3768,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-08-03T06:58:19.846492+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":467271680,"num_objects":7130,"num_object_clones":0,"num_object_copies":14260,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":7130,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":9568,"num_write_kb":534336,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[1,0],"acting":[1,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":1,"acting_primary":1,"purged_snaps":[]},{"pgid":"2.0","version":"0'0","reported_seq":44,"reported_epoch":48,"state":"active+clean","last_fresh":"2023-08-01T19:55:30.996250+0000","last_change":"2023-08-01T19:53:58.975968+0000","last_active":"2023-08-01T19:55:30.996250+0000","last_peered":"2023-08-01T19:55:30.996250+0000","last_clean":"2023-08-01T19:55:30.996250+0000","last_became_active":"2023-08-01T19:53:58.975706+0000","last_became_peered":"2023-08-01T19:53:58.975706+0000","last_unstale":"2023-08-01T19:55:30.996250+0000","last_undegraded":"2023-08-01T19:55:30.996250+0000","last_fullsized":"2023-08-01T19:55:30.996250+0000","mapping_epoch":12,"log_start":"0'0","ondisk_log_start":"0'0","created":12,"last_epoch_clean":13,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-08-01T19:53:57.959448+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-08-01T19:53:57.959448+0000","last_clean_scrub_stamp":"2023-08-01T19:53:57.959448+0000","objects_scrubbed":0,"log_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-08-03T00:02:15.204280+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[1,2],"acting":[1,2],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":1,"acting_primary":1,"purged_snaps":[]},{"pgid":"3.1","version":"0'0","reported_seq":41,"reported_epoch":48,"state":"active+clean","last_fresh":"2023-08-01T19:55:31.007435+0000","last_change":"2023-08-01T19:54:04.066707+0000","last_active":"2023-08-01T19:55:31.007435+0000","last_peered":"2023-08-01T19:55:31.007435+0000","last_clean":"2023-08-01T19:55:31.007435+0000","last_became_active":"2023-08-01T19:54:04.066334+0000","last_became_peered":"2023-08-01T19:54:04.066334+0000","last_unstale":"2023-08-01T19:55:31.007435+0000","last_undegraded":"2023-08-01T19:55:31.007435+0000","last_fullsized":"2023-08-01T19:55:31.007435+0000","mapping_epoch":15,"log_start":"0'0","ondisk_log_start":"0'0","created":15,"last_epoch_clean":16,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-08-01T19:54:03.032665+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-08-01T19:54:03.032665+0000","last_clean_scrub_stamp":"2023-08-01T19:54:03.032665+0000","objects_scrubbed":0,"log_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-08-03T02:40:15.210599+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[0,1],"acting":[0,1],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":0,"acting_primary":0,"purged_snaps":[]},{"pgid":"4.6","version":"0'0","reported_seq":40,"reported_epoch":48,"state":"active+clean","last_fresh":"2023-08-01T19:55:30.994467+0000","last_change":"2023-08-01T19:54:04.469877+0000","last_active":"2023-08-01T19:55:30.994467+0000","last_peered":"2023-08-01T19:55:30.994467+0000","last_clean":"2023-08-01T19:55:30.994467+0000","last_became_active":"2023-08-01T19:54:04.469528+0000","last_became_peered":"2023-08-01T19:54:04.469528+0000","last_unstale":"2023-08-01T19:55:30.994467+0000","last_undegraded":"2023-08-01T19:55:30.994467+0000","last_fullsized":"2023-08-01T19:55:30.994467+0000","mapping_epoch":16,"log_start":"0'0","ondisk_log_start":"0'0","created":16,"last_epoch_clean":17,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-08-01T19:54:04.040663+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-08-01T19:54:04.040663+0000","last_clean_scrub_stamp":"2023-08-01T19:54:04.040663+0000","objects_scrubbed":0,"log_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-08-03T02:24:19.067602+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[2,0],"acting":[2,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":2,"acting_primary":2,"purged_snaps":[]},{"pgid":"5.2","version":"49'9836","reported_seq":9884,"reported_epoch":49,"state":"active+clean","last_fresh":"2023-08-01T19:55:34.970659+0000","last_change":"2023-08-01T19:55:11.611309+0000","last_active":"2023-08-01T19:55:34.970659+0000","last_peered":"2023-08-01T19:55:34.970659+0000","last_clean":"2023-08-01T19:55:34.970659+0000","last_became_active":"2023-08-01T19:55:11.596072+0000","last_became_peered":"2023-08-01T19:55:11.596072+0000","last_unstale":"2023-08-01T19:55:34.970659+0000","last_undegraded":"2023-08-01T19:55:34.970659+0000","last_fullsized":"2023-08-01T19:55:34.970659+0000","mapping_epoch":40,"log_start":"37'6252","ondisk_log_start":"37'6252","created":19,"last_epoch_clean":41,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-08-01T19:54:22.116710+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-08-01T19:54:22.116710+0000","last_clean_scrub_stamp":"2023-08-01T19:54:22.116710+0000","objects_scrubbed":0,"log_size":3584,"ondisk_log_size":3584,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-08-02T20:43:09.187980+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":479723520,"num_objects":7320,"num_object_clones":0,"num_object_copies":14640,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":7320,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":9836,"num_write_kb":548992,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":1,"num_bytes_recovered":65536,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[0,1],"acting":[0,1],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":0,"acting_primary":0,"purged_snaps":[]},{"pgid":"2.5","version":"0'0","reported_seq":44,"reported_epoch":48,"state":"active+clean","last_fresh":"2023-08-01T19:55:30.995915+0000","last_change":"2023-08-01T19:53:58.970683+0000","last_active":"2023-08-01T19:55:30.995915+0000","last_peered":"2023-08-01T19:55:30.995915+0000","last_clean":"2023-08-01T19:55:30.995915+0000","last_became_active":"2023-08-01T19:53:58.970437+0000","last_became_peered":"2023-08-01T19:53:58.970437+0000","last_unstale":"2023-08-01T19:55:30.995915+0000","last_undegraded":"2023-08-01T19:55:30.995915+0000","last_fullsized":"2023-08-01T19:55:30.995915+0000","mapping_epoch":12,"log_start":"0'0","ondisk_log_start":"0'0","created":12,"last_epoch_clean":13,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-08-01T19:53:57.959448+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-08-01T19:53:57.959448+0000","last_clean_scrub_stamp":"2023-08-01T19:53:57.959448+0000","objects_scrubbed":0,"log_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-08-02T23:54:08.273426+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[2,0],"acting":[2,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":2,"acting_primary":2,"purged_snaps":[]},{"pgid":"3.4","version":"0'0","reported_seq":41,"reported_epoch":48,"state":"active+clean","last_fresh":"2023-08-01T19:55:31.009463+0000","last_change":"2023-08-01T19:54:04.062283+0000","last_active":"2023-08-01T19:55:31.009463+0000","last_peered":"2023-08-01T19:55:31.009463+0000","last_clean":"2023-08-01T19:55:31.009463+0000","last_became_active":"2023-08-01T19:54:04.061796+0000","last_became_peered":"2023-08-01T19:54:04.061796+0000","last_unstale":"2023-08-01T19:55:31.009463+0000","last_undegraded":"2023-08-01T19:55:31.009463+0000","last_fullsized":"2023-08-01T19:55:31.009463+0000","mapping_epoch":15,"log_start":"0'0","ondisk_log_start":"0'0","created":15,"last_epoch_clean":16,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-08-01T19:54:03.032665+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-08-01T19:54:03.032665+0000","last_clean_scrub_stamp":"2023-08-01T19:54:03.032665+0000","objects_scrubbed":0,"log_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-08-02T19:54:08.401797+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[0,2],"acting":[0,2],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":0,"acting_primary":0,"purged_snaps":[]},{"pgid":"4.3","version":"0'0","reported_seq":40,"reported_epoch":48,"state":"active+clean","last_fresh":"2023-08-01T19:55:30.993793+0000","last_change":"2023-08-01T19:54:04.473088+0000","last_active":"2023-08-01T19:55:30.993793+0000","last_peered":"2023-08-01T19:55:30.993793+0000","last_clean":"2023-08-01T19:55:30.993793+0000","last_became_active":"2023-08-01T19:54:04.472611+0000","last_became_peered":"2023-08-01T19:54:04.472611+0000","last_unstale":"2023-08-01T19:55:30.993793+0000","last_undegraded":"2023-08-01T19:55:30.993793+0000","last_fullsized":"2023-08-01T19:55:30.993793+0000","mapping_epoch":16,"log_start":"0'0","ondisk_log_start":"0'0","created":16,"last_epoch_clean":17,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-08-01T19:54:04.040663+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-08-01T19:54:04.040663+0000","last_clean_scrub_stamp":"2023-08-01T19:54:04.040663+0000","objects_scrubbed":0,"log_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-08-03T07:27:26.537518+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[2,1],"acting":[2,1],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":2,"acting_primary":2,"purged_snaps":[]},{"pgid":"5.1","version":"49'9533","reported_seq":9578,"reported_epoch":49,"state":"active+clean","last_fresh":"2023-08-01T19:55:34.963006+0000","last_change":"2023-08-01T19:55:11.612390+0000","last_active":"2023-08-01T19:55:34.963006+0000","last_peered":"2023-08-01T19:55:34.963006+0000","last_clean":"2023-08-01T19:55:34.963006+0000","last_became_active":"2023-08-01T19:55:11.593304+0000","last_became_peered":"2023-08-01T19:55:11.593304+0000","last_unstale":"2023-08-01T19:55:34.963006+0000","last_undegraded":"2023-08-01T19:55:34.963006+0000","last_fullsized":"2023-08-01T19:55:34.963006+0000","mapping_epoch":40,"log_start":"36'5978","ondisk_log_start":"36'5978","created":19,"last_epoch_clean":41,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-08-01T19:54:22.116710+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-08-01T19:54:22.116710+0000","last_clean_scrub_stamp":"2023-08-01T19:54:22.116710+0000","objects_scrubbed":0,"log_size":3555,"ondisk_log_size":3555,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-08-02T20:42:40.217025+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":459997184,"num_objects":7019,"num_object_clones":0,"num_object_copies":14038,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":7019,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":9533,"num_write_kb":529664,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[0,1],"acting":[0,1],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":0,"acting_primary":0,"purged_snaps":[]},{"pgid":"3.7","version":"17'2","reported_seq":43,"reported_epoch":48,"state":"active+clean","last_fresh":"2023-08-01T19:55:31.006596+0000","last_change":"2023-08-01T19:54:04.065147+0000","last_active":"2023-08-01T19:55:31.006596+0000","last_peered":"2023-08-01T19:55:31.006596+0000","last_clean":"2023-08-01T19:55:31.006596+0000","last_became_active":"2023-08-01T19:54:04.064779+0000","last_became_peered":"2023-08-01T19:54:04.064779+0000","last_unstale":"2023-08-01T19:55:31.006596+0000","last_undegraded":"2023-08-01T19:55:31.006596+0000","last_fullsized":"2023-08-01T19:55:31.006596+0000","mapping_epoch":15,"log_start":"0'0","ondisk_log_start":"0'0","created":15,"last_epoch_clean":16,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-08-01T19:54:03.032665+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-08-01T19:54:03.032665+0000","last_clean_scrub_stamp":"2023-08-01T19:54:03.032665+0000","objects_scrubbed":0,"log_size":2,"ondisk_log_size":2,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-08-03T03:43:45.667663+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":1,"num_object_clones":0,"num_object_copies":2,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":1,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":3,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":1,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[0,2],"acting":[0,2],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":0,"acting_primary":0,"purged_snaps":[]},{"pgid":"2.6","version":"0'0","reported_seq":44,"reported_epoch":48,"state":"active+clean","last_fresh":"2023-08-01T19:55:31.011165+0000","last_change":"2023-08-01T19:53:58.974077+0000","last_active":"2023-08-01T19:55:31.011165+0000","last_peered":"2023-08-01T19:55:31.011165+0000","last_clean":"2023-08-01T19:55:31.011165+0000","last_became_active":"2023-08-01T19:53:58.973396+0000","last_became_peered":"2023-08-01T19:53:58.973396+0000","last_unstale":"2023-08-01T19:55:31.011165+0000","last_undegraded":"2023-08-01T19:55:31.011165+0000","last_fullsized":"2023-08-01T19:55:31.011165+0000","mapping_epoch":12,"log_start":"0'0","ondisk_log_start":"0'0","created":12,"last_epoch_clean":13,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-08-01T19:53:57.959448+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-08-01T19:53:57.959448+0000","last_clean_scrub_stamp":"2023-08-01T19:53:57.959448+0000","objects_scrubbed":0,"log_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-08-02T22:13:50.940864+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[0,2],"acting":[0,2],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":0,"acting_primary":0,"purged_snaps":[]},{"pgid":"4.0","version":"0'0","reported_seq":40,"reported_epoch":48,"state":"active+clean","last_fresh":"2023-08-01T19:55:31.005969+0000","last_change":"2023-08-01T19:54:04.476807+0000","last_active":"2023-08-01T19:55:31.005969+0000","last_peered":"2023-08-01T19:55:31.005969+0000","last_clean":"2023-08-01T19:55:31.005969+0000","last_became_active":"2023-08-01T19:54:04.476453+0000","last_became_peered":"2023-08-01T19:54:04.476453+0000","last_unstale":"2023-08-01T19:55:31.005969+0000","last_undegraded":"2023-08-01T19:55:31.005969+0000","last_fullsized":"2023-08-01T19:55:31.005969+0000","mapping_epoch":16,"log_start":"0'0","ondisk_log_start":"0'0","created":16,"last_epoch_clean":17,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-08-01T19:54:04.040663+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-08-01T19:54:04.040663+0000","last_clean_scrub_stamp":"2023-08-01T19:54:04.040663+0000","objects_scrubbed":0,"log_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-08-02T20:20:59.989030+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[0,1],"acting":[0,1],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":0,"acting_primary":0,"purged_snaps":[]},{"pgid":"5.0","version":"49'9893","reported_seq":9929,"reported_epoch":49,"state":"active+clean","last_fresh":"2023-08-01T19:55:36.087712+0000","last_change":"2023-08-01T19:54:23.138369+0000","last_active":"2023-08-01T19:55:36.087712+0000","last_peered":"2023-08-01T19:55:36.087712+0000","last_clean":"2023-08-01T19:55:36.087712+0000","last_became_active":"2023-08-01T19:54:23.137857+0000","last_became_peered":"2023-08-01T19:54:23.137857+0000","last_unstale":"2023-08-01T19:55:36.087712+0000","last_undegraded":"2023-08-01T19:55:36.087712+0000","last_fullsized":"2023-08-01T19:55:36.087712+0000","mapping_epoch":19,"log_start":"36'5900","ondisk_log_start":"36'5900","created":19,"last_epoch_clean":20,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-08-01T19:54:22.116710+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-08-01T19:54:22.116710+0000","last_clean_scrub_stamp":"2023-08-01T19:54:22.116710+0000","objects_scrubbed":0,"log_size":3993,"ondisk_log_size":3993,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-08-03T06:02:44.391298+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":462749696,"num_objects":7061,"num_object_clones":0,"num_object_copies":14122,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":7061,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":9893,"num_write_kb":542528,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[2,0],"acting":[2,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":2,"acting_primary":2,"purged_snaps":[]},{"pgid":"2.7","version":"0'0","reported_seq":20,"reported_epoch":48,"state":"active+clean","last_fresh":"2023-08-01T19:55:30.994679+0000","last_change":"2023-08-01T19:55:11.594006+0000","last_active":"2023-08-01T19:55:30.994679+0000","last_peered":"2023-08-01T19:55:30.994679+0000","last_clean":"2023-08-01T19:55:30.994679+0000","last_became_active":"2023-08-01T19:55:11.590830+0000","last_became_peered":"2023-08-01T19:55:11.590830+0000","last_unstale":"2023-08-01T19:55:30.994679+0000","last_undegraded":"2023-08-01T19:55:30.994679+0000","last_fullsized":"2023-08-01T19:55:30.994679+0000","mapping_epoch":40,"log_start":"0'0","ondisk_log_start":"0'0","created":12,"last_epoch_clean":41,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-08-01T19:53:57.959448+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-08-01T19:53:57.959448+0000","last_clean_scrub_stamp":"2023-08-01T19:53:57.959448+0000","objects_scrubbed":0,"log_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-08-03T01:25:31.107580+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[2,1],"acting":[2,1],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":2,"acting_primary":2,"purged_snaps":[]},{"pgid":"3.6","version":"18'1","reported_seq":42,"reported_epoch":48,"state":"active+clean","last_fresh":"2023-08-01T19:55:31.010993+0000","last_change":"2023-08-01T19:54:04.068041+0000","last_active":"2023-08-01T19:55:31.010993+0000","last_peered":"2023-08-01T19:55:31.010993+0000","last_clean":"2023-08-01T19:55:31.010993+0000","last_became_active":"2023-08-01T19:54:04.067613+0000","last_became_peered":"2023-08-01T19:54:04.067613+0000","last_unstale":"2023-08-01T19:55:31.010993+0000","last_undegraded":"2023-08-01T19:55:31.010993+0000","last_fullsized":"2023-08-01T19:55:31.010993+0000","mapping_epoch":15,"log_start":"0'0","ondisk_log_start":"0'0","created":15,"last_epoch_clean":16,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-08-01T19:54:03.032665+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-08-01T19:54:03.032665+0000","last_clean_scrub_stamp":"2023-08-01T19:54:03.032665+0000","objects_scrubbed":0,"log_size":1,"ondisk_log_size":1,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-08-02T21:35:44.874727+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":1,"num_object_clones":0,"num_object_copies":2,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":1,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":1,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":1,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[0,1],"acting":[0,1],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":0,"acting_primary":0,"purged_snaps":[]},{"pgid":"4.1","version":"0'0","reported_seq":40,"reported_epoch":48,"state":"active+clean","last_fresh":"2023-08-01T19:55:30.993799+0000","last_change":"2023-08-01T19:54:04.469243+0000","last_active":"2023-08-01T19:55:30.993799+0000","last_peered":"2023-08-01T19:55:30.993799+0000","last_clean":"2023-08-01T19:55:30.993799+0000","last_became_active":"2023-08-01T19:54:04.468835+0000","last_became_peered":"2023-08-01T19:54:04.468835+0000","last_unstale":"2023-08-01T19:55:30.993799+0000","last_undegraded":"2023-08-01T19:55:30.993799+0000","last_fullsized":"2023-08-01T19:55:30.993799+0000","mapping_epoch":16,"log_start":"0'0","ondisk_log_start":"0'0","created":16,"last_epoch_clean":17,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-08-01T19:54:04.040663+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-08-01T19:54:04.040663+0000","last_clean_scrub_stamp":"2023-08-01T19:54:04.040663+0000","objects_scrubbed":0,"log_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-08-03T04:43:58.358628+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[2,1],"acting":[2,1],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":2,"acting_primary":2,"purged_snaps":[]},{"pgid":"3.1b","version":"17'1","reported_seq":42,"reported_epoch":48,"state":"active+clean","last_fresh":"2023-08-01T19:55:30.994090+0000","last_change":"2023-08-01T19:54:04.066748+0000","last_active":"2023-08-01T19:55:30.994090+0000","last_peered":"2023-08-01T19:55:30.994090+0000","last_clean":"2023-08-01T19:55:30.994090+0000","last_became_active":"2023-08-01T19:54:04.066483+0000","last_became_peered":"2023-08-01T19:54:04.066483+0000","last_unstale":"2023-08-01T19:55:30.994090+0000","last_undegraded":"2023-08-01T19:55:30.994090+0000","last_fullsized":"2023-08-01T19:55:30.994090+0000","mapping_epoch":15,"log_start":"0'0","ondisk_log_start":"0'0","created":15,"last_epoch_clean":16,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-08-01T19:54:03.032665+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-08-01T19:54:03.032665+0000","last_clean_scrub_stamp":"2023-08-01T19:54:03.032665+0000","objects_scrubbed":0,"log_size":1,"ondisk_log_size":1,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-08-03T03:08:26.880362+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[2,1],"acting":[2,1],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":2,"acting_primary":2,"purged_snaps":[]},{"pgid":"4.1c","version":"0'0","reported_seq":40,"reported_epoch":48,"state":"active+clean","last_fresh":"2023-08-01T19:55:30.996206+0000","last_change":"2023-08-01T19:54:04.466766+0000","last_active":"2023-08-01T19:55:30.996206+0000","last_peered":"2023-08-01T19:55:30.996206+0000","last_clean":"2023-08-01T19:55:30.996206+0000","last_became_active":"2023-08-01T19:54:04.466417+0000","last_became_peered":"2023-08-01T19:54:04.466417+0000","last_unstale":"2023-08-01T19:55:30.996206+0000","last_undegraded":"2023-08-01T19:55:30.996206+0000","last_fullsized":"2023-08-01T19:55:30.996206+0000","mapping_epoch":16,"log_start":"0'0","ondisk_log_start":"0'0","created":16,"last_epoch_clean":17,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-08-01T19:54:04.040663+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-08-01T19:54:04.040663+0000","last_clean_scrub_stamp":"2023-08-01T19:54:04.040663+0000","objects_scrubbed":0,"log_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-08-02T22:01:53.643825+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[2,0],"acting":[2,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":2,"acting_primary":2,"purged_snaps":[]},{"pgid":"3.1c","version":"17'2","reported_seq":28,"reported_epoch":48,"state":"active+clean","last_fresh":"2023-08-01T19:55:31.010784+0000","last_change":"2023-08-01T19:55:11.596197+0000","last_active":"2023-08-01T19:55:31.010784+0000","last_peered":"2023-08-01T19:55:31.010784+0000","last_clean":"2023-08-01T19:55:31.010784+0000","last_became_active":"2023-08-01T19:55:11.595843+0000","last_became_peered":"2023-08-01T19:55:11.595843+0000","last_unstale":"2023-08-01T19:55:31.010784+0000","last_undegraded":"2023-08-01T19:55:31.010784+0000","last_fullsized":"2023-08-01T19:55:31.010784+0000","mapping_epoch":40,"log_start":"0'0","ondisk_log_start":"0'0","created":15,"last_epoch_clean":41,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-08-01T19:54:03.032665+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-08-01T19:54:03.032665+0000","last_clean_scrub_stamp":"2023-08-01T19:54:03.032665+0000","objects_scrubbed":0,"log_size":2,"ondisk_log_size":2,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-08-03T06:44:08.638375+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":1,"num_object_clones":0,"num_object_copies":2,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":1,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":3,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":1,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[0,1],"acting":[0,1],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":0,"acting_primary":0,"purged_snaps":[]},{"pgid":"4.1b","version":"0'0","reported_seq":40,"reported_epoch":48,"state":"active+clean","last_fresh":"2023-08-01T19:55:30.997072+0000","last_change":"2023-08-01T19:54:04.474971+0000","last_active":"2023-08-01T19:55:30.997072+0000","last_peered":"2023-08-01T19:55:30.997072+0000","last_clean":"2023-08-01T19:55:30.997072+0000","last_became_active":"2023-08-01T19:54:04.473957+0000","last_became_peered":"2023-08-01T19:54:04.473957+0000","last_unstale":"2023-08-01T19:55:30.997072+0000","last_undegraded":"2023-08-01T19:55:30.997072+0000","last_fullsized":"2023-08-01T19:55:30.997072+0000","mapping_epoch":16,"log_start":"0'0","ondisk_log_start":"0'0","created":16,"last_epoch_clean":17,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-08-01T19:54:04.040663+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-08-01T19:54:04.040663+0000","last_clean_scrub_stamp":"2023-08-01T19:54:04.040663+0000","objects_scrubbed":0,"log_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-08-02T21:59:19.682560+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[1,0],"acting":[1,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":1,"acting_primary":1,"purged_snaps":[]},{"pgid":"3.1d","version":"17'2","reported_seq":43,"reported_epoch":48,"state":"active+clean","last_fresh":"2023-08-01T19:55:30.995987+0000","last_change":"2023-08-01T19:54:04.065591+0000","last_active":"2023-08-01T19:55:30.995987+0000","last_peered":"2023-08-01T19:55:30.995987+0000","last_clean":"2023-08-01T19:55:30.995987+0000","last_became_active":"2023-08-01T19:54:04.065306+0000","last_became_peered":"2023-08-01T19:54:04.065306+0000","last_unstale":"2023-08-01T19:55:30.995987+0000","last_undegraded":"2023-08-01T19:55:30.995987+0000","last_fullsized":"2023-08-01T19:55:30.995987+0000","mapping_epoch":15,"log_start":"0'0","ondisk_log_start":"0'0","created":15,"last_epoch_clean":16,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-08-01T19:54:03.032665+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-08-01T19:54:03.032665+0000","last_clean_scrub_stamp":"2023-08-01T19:54:03.032665+0000","objects_scrubbed":0,"log_size":2,"ondisk_log_size":2,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-08-02T21:32:10.389227+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":1,"num_object_clones":0,"num_object_copies":2,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":1,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":3,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":1,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[2,1],"acting":[2,1],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":2,"acting_primary":2,"purged_snaps":[]},{"pgid":"4.1a","version":"0'0","reported_seq":40,"reported_epoch":48,"state":"active+clean","last_fresh":"2023-08-01T19:55:30.996516+0000","last_change":"2023-08-01T19:54:04.473302+0000","last_active":"2023-08-01T19:55:30.996516+0000","last_peered":"2023-08-01T19:55:30.996516+0000","last_clean":"2023-08-01T19:55:30.996516+0000","last_became_active":"2023-08-01T19:54:04.472452+0000","last_became_peered":"2023-08-01T19:54:04.472452+0000","last_unstale":"2023-08-01T19:55:30.996516+0000","last_undegraded":"2023-08-01T19:55:30.996516+0000","last_fullsized":"2023-08-01T19:55:30.996516+0000","mapping_epoch":16,"log_start":"0'0","ondisk_log_start":"0'0","created":16,"last_epoch_clean":17,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-08-01T19:54:04.040663+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-08-01T19:54:04.040663+0000","last_clean_scrub_stamp":"2023-08-01T19:54:04.040663+0000","objects_scrubbed":0,"log_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-08-02T21:02:39.542019+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[1,0],"acting":[1,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":1,"acting_primary":1,"purged_snaps":[]},{"pgid":"3.1e","version":"17'1","reported_seq":42,"reported_epoch":48,"state":"active+clean","last_fresh":"2023-08-01T19:55:31.011117+0000","last_change":"2023-08-01T19:54:04.064378+0000","last_active":"2023-08-01T19:55:31.011117+0000","last_peered":"2023-08-01T19:55:31.011117+0000","last_clean":"2023-08-01T19:55:31.011117+0000","last_became_active":"2023-08-01T19:54:04.063988+0000","last_became_peered":"2023-08-01T19:54:04.063988+0000","last_unstale":"2023-08-01T19:55:31.011117+0000","last_undegraded":"2023-08-01T19:55:31.011117+0000","last_fullsized":"2023-08-01T19:55:31.011117+0000","mapping_epoch":15,"log_start":"0'0","ondisk_log_start":"0'0","created":15,"last_epoch_clean":16,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-08-01T19:54:03.032665+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-08-01T19:54:03.032665+0000","last_clean_scrub_stamp":"2023-08-01T19:54:03.032665+0000","objects_scrubbed":0,"log_size":1,"ondisk_log_size":1,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-08-02T22:28:51.936138+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[0,2],"acting":[0,2],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":0,"acting_primary":0,"purged_snaps":[]},{"pgid":"4.19","version":"0'0","reported_seq":40,"reported_epoch":48,"state":"active+clean","last_fresh":"2023-08-01T19:55:30.993979+0000","last_change":"2023-08-01T19:54:04.467017+0000","last_active":"2023-08-01T19:55:30.993979+0000","last_peered":"2023-08-01T19:55:30.993979+0000","last_clean":"2023-08-01T19:55:30.993979+0000","last_became_active":"2023-08-01T19:54:04.466339+0000","last_became_peered":"2023-08-01T19:54:04.466339+0000","last_unstale":"2023-08-01T19:55:30.993979+0000","last_undegraded":"2023-08-01T19:55:30.993979+0000","last_fullsized":"2023-08-01T19:55:30.993979+0000","mapping_epoch":16,"log_start":"0'0","ondisk_log_start":"0'0","created":16,"last_epoch_clean":17,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-08-01T19:54:04.040663+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-08-01T19:54:04.040663+0000","last_clean_scrub_stamp":"2023-08-01T19:54:04.040663+0000","objects_scrubbed":0,"log_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-08-03T04:07:57.222873+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[2,0],"acting":[2,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":2,"acting_primary":2,"purged_snaps":[]},{"pgid":"3.1f","version":"17'4","reported_seq":45,"reported_epoch":48,"state":"active+clean","last_fresh":"2023-08-01T19:55:31.006785+0000","last_change":"2023-08-01T19:54:04.067767+0000","last_active":"2023-08-01T19:55:31.006785+0000","last_peered":"2023-08-01T19:55:31.006785+0000","last_clean":"2023-08-01T19:55:31.006785+0000","last_became_active":"2023-08-01T19:54:04.067414+0000","last_became_peered":"2023-08-01T19:54:04.067414+0000","last_unstale":"2023-08-01T19:55:31.006785+0000","last_undegraded":"2023-08-01T19:55:31.006785+0000","last_fullsized":"2023-08-01T19:55:31.006785+0000","mapping_epoch":15,"log_start":"0'0","ondisk_log_start":"0'0","created":15,"last_epoch_clean":16,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-08-01T19:54:03.032665+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-08-01T19:54:03.032665+0000","last_clean_scrub_stamp":"2023-08-01T19:54:03.032665+0000","objects_scrubbed":0,"log_size":4,"ondisk_log_size":4,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-08-02T21:33:27.007118+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":554,"num_objects":2,"num_object_clones":0,"num_object_copies":4,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":2,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":4,"num_write_kb":1,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":1,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[0,1],"acting":[0,1],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":0,"acting_primary":0,"purged_snaps":[]},{"pgid":"4.18","version":"0'0","reported_seq":20,"reported_epoch":48,"state":"active+clean","last_fresh":"2023-08-01T19:55:31.006107+0000","last_change":"2023-08-01T19:55:11.593650+0000","last_active":"2023-08-01T19:55:31.006107+0000","last_peered":"2023-08-01T19:55:31.006107+0000","last_clean":"2023-08-01T19:55:31.006107+0000","last_became_active":"2023-08-01T19:55:11.593265+0000","last_became_peered":"2023-08-01T19:55:11.593265+0000","last_unstale":"2023-08-01T19:55:31.006107+0000","last_undegraded":"2023-08-01T19:55:31.006107+0000","last_fullsized":"2023-08-01T19:55:31.006107+0000","mapping_epoch":40,"log_start":"0'0","ondisk_log_start":"0'0","created":16,"last_epoch_clean":41,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-08-01T19:54:04.040663+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-08-01T19:54:04.040663+0000","last_clean_scrub_stamp":"2023-08-01T19:54:04.040663+0000","objects_scrubbed":0,"log_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-08-03T04:48:30.593120+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[0,1],"acting":[0,1],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":0,"acting_primary":0,"purged_snaps":[]},{"pgid":"4.20","version":"0'0","reported_seq":40,"reported_epoch":48,"state":"active+clean","last_fresh":"2023-08-01T19:55:30.996256+0000","last_change":"2023-08-01T19:54:04.477904+0000","last_active":"2023-08-01T19:55:30.996256+0000","last_peered":"2023-08-01T19:55:30.996256+0000","last_clean":"2023-08-01T19:55:30.996256+0000","last_became_active":"2023-08-01T19:54:04.476564+0000","last_became_peered":"2023-08-01T19:54:04.476564+0000","last_unstale":"2023-08-01T19:55:30.996256+0000","last_undegraded":"2023-08-01T19:55:30.996256+0000","last_fullsized":"2023-08-01T19:55:30.996256+0000","mapping_epoch":16,"log_start":"0'0","ondisk_log_start":"0'0","created":16,"last_epoch_clean":17,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-08-01T19:54:04.040663+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-08-01T19:54:04.040663+0000","last_clean_scrub_stamp":"2023-08-01T19:54:04.040663+0000","objects_scrubbed":0,"log_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-08-03T02:21:47.656072+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[1,0],"acting":[1,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":1,"acting_primary":1,"purged_snaps":[]},{"pgid":"4.21","version":"0'0","reported_seq":40,"reported_epoch":48,"state":"active+clean","last_fresh":"2023-08-01T19:55:31.007504+0000","last_change":"2023-08-01T19:54:04.466899+0000","last_active":"2023-08-01T19:55:31.007504+0000","last_peered":"2023-08-01T19:55:31.007504+0000","last_clean":"2023-08-01T19:55:31.007504+0000","last_became_active":"2023-08-01T19:54:04.466500+0000","last_became_peered":"2023-08-01T19:54:04.466500+0000","last_unstale":"2023-08-01T19:55:31.007504+0000","last_undegraded":"2023-08-01T19:55:31.007504+0000","last_fullsized":"2023-08-01T19:55:31.007504+0000","mapping_epoch":16,"log_start":"0'0","ondisk_log_start":"0'0","created":16,"last_epoch_clean":17,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-08-01T19:54:04.040663+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-08-01T19:54:04.040663+0000","last_clean_scrub_stamp":"2023-08-01T19:54:04.040663+0000","objects_scrubbed":0,"log_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-08-03T07:36:38.654701+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[0,2],"acting":[0,2],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":0,"acting_primary":0,"purged_snaps":[]},{"pgid":"4.22","version":"0'0","reported_seq":40,"reported_epoch":48,"state":"active+clean","last_fresh":"2023-08-01T19:55:30.993959+0000","last_change":"2023-08-01T19:54:04.471945+0000","last_active":"2023-08-01T19:55:30.993959+0000","last_peered":"2023-08-01T19:55:30.993959+0000","last_clean":"2023-08-01T19:55:30.993959+0000","last_became_active":"2023-08-01T19:54:04.471371+0000","last_became_peered":"2023-08-01T19:54:04.471371+0000","last_unstale":"2023-08-01T19:55:30.993959+0000","last_undegraded":"2023-08-01T19:55:30.993959+0000","last_fullsized":"2023-08-01T19:55:30.993959+0000","mapping_epoch":16,"log_start":"0'0","ondisk_log_start":"0'0","created":16,"last_epoch_clean":17,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-08-01T19:54:04.040663+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-08-01T19:54:04.040663+0000","last_clean_scrub_stamp":"2023-08-01T19:54:04.040663+0000","objects_scrubbed":0,"log_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-08-02T22:17:59.847819+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[2,1],"acting":[2,1],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":2,"acting_primary":2,"purged_snaps":[]},{"pgid":"4.23","version":"0'0","reported_seq":40,"reported_epoch":48,"state":"active+clean","last_fresh":"2023-08-01T19:55:31.007155+0000","last_change":"2023-08-01T19:54:04.467847+0000","last_active":"2023-08-01T19:55:31.007155+0000","last_peered":"2023-08-01T19:55:31.007155+0000","last_clean":"2023-08-01T19:55:31.007155+0000","last_became_active":"2023-08-01T19:54:04.467111+0000","last_became_peered":"2023-08-01T19:54:04.467111+0000","last_unstale":"2023-08-01T19:55:31.007155+0000","last_undegraded":"2023-08-01T19:55:31.007155+0000","last_fullsized":"2023-08-01T19:55:31.007155+0000","mapping_epoch":16,"log_start":"0'0","ondisk_log_start":"0'0","created":16,"last_epoch_clean":17,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-08-01T19:54:04.040663+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-08-01T19:54:04.040663+0000","last_clean_scrub_stamp":"2023-08-01T19:54:04.040663+0000","objects_scrubbed":0,"log_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-08-03T00:42:19.379348+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[0,2],"acting":[0,2],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":0,"acting_primary":0,"purged_snaps":[]},{"pgid":"4.24","version":"0'0","reported_seq":40,"reported_epoch":48,"state":"active+clean","last_fresh":"2023-08-01T19:55:30.996268+0000","last_change":"2023-08-01T19:54:04.477128+0000","last_active":"2023-08-01T19:55:30.996268+0000","last_peered":"2023-08-01T19:55:30.996268+0000","last_clean":"2023-08-01T19:55:30.996268+0000","last_became_active":"2023-08-01T19:54:04.476819+0000","last_became_peered":"2023-08-01T19:54:04.476819+0000","last_unstale":"2023-08-01T19:55:30.996268+0000","last_undegraded":"2023-08-01T19:55:30.996268+0000","last_fullsized":"2023-08-01T19:55:30.996268+0000","mapping_epoch":16,"log_start":"0'0","ondisk_log_start":"0'0","created":16,"last_epoch_clean":17,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-08-01T19:54:04.040663+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-08-01T19:54:04.040663+0000","last_clean_scrub_stamp":"2023-08-01T19:54:04.040663+0000","objects_scrubbed":0,"log_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-08-03T02:20:23.354054+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[2,1],"acting":[2,1],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":2,"acting_primary":2,"purged_snaps":[]}],"pool_stats":[{"poolid":5,"num_pg":16,"stat_sum":{"num_bytes":7389118488,"num_objects":112750,"num_object_clones":0,"num_object_copies":225500,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":112750,"num_whiteouts":0,"num_read":1,"num_read_kb":1,"num_write":154568,"num_write_kb":8554113,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":1,"num_bytes_recovered":65536,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"store_stats":{"total":0,"available":0,"internally_reserved":0,"allocated":927789056,"data_stored":14844493872,"data_compressed":71191138,"data_compressed_allocated":927780864,"data_compressed_original":14844493824,"omap_allocated":0,"internal_metadata":0},"log_size":60638,"ondisk_log_size":60638,"up":32,"acting":32,"num_store_stats":3},{"poolid":4,"num_pg":64,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"store_stats":{"total":0,"available":0,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},"log_size":0,"ondisk_log_size":0,"up":128,"acting":128,"num_store_stats":3},{"poolid":3,"num_pg":32,"stat_sum":{"num_bytes":2306,"num_objects":22,"num_object_clones":0,"num_object_copies":44,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":22,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":45,"num_write_kb":13,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":14,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"store_stats":{"total":0,"available":0,"internally_reserved":0,"allocated":65536,"data_stored":4612,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},"log_size":39,"ondisk_log_size":39,"up":64,"acting":64,"num_store_stats":3},{"poolid":1,"num_pg":1,"stat_sum":{"num_bytes":590368,"num_objects":2,"num_object_clones":0,"num_object_copies":4,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":2,"num_whiteouts":0,"num_read":136,"num_read_kb":118,"num_write":203,"num_write_kb":3460,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"store_stats":{"total":0,"available":0,"internally_reserved":0,"allocated":114688,"data_stored":1180736,"data_compressed":20662,"data_compressed_allocated":73728,"data_compressed_original":1146880,"omap_allocated":0,"internal_metadata":0},"log_size":157,"ondisk_log_size":157,"up":2,"acting":2,"num_store_stats":2},{"poolid":2,"num_pg":8,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"store_stats":{"total":0,"available":0,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},"log_size":0,"ondisk_log_size":0,"up":16,"acting":16,"num_store_stats":3}],"osd_stats":[{"osd":2,"up_from":9,"seq":38654705689,"num_pgs":76,"num_osds":1,"num_per_pool_osds":1,"num_per_pool_omap_osds":1,"kb":94371840,"kb_used":363068,"kb_used_data":253932,"kb_used_omap":0,"kb_used_meta":109120,"kb_avail":94008772,"statfs":{"total":96636764160,"available":96264982528,"internally_reserved":0,"allocated":260026368,"data_stored":4151250417,"data_compressed":19915156,"data_compressed_allocated":259440640,"data_compressed_original":4151033856,"omap_allocated":0,"internal_metadata":111738880},"hb_peers":[0,1],"snap_trim_queue_len":0,"num_snap_trimming":0,"num_shards_repaired":0,"op_queue_age_hist":{"histogram":[],"upper_bound":1},"perf_stat":{"commit_latency_ms":3,"apply_latency_ms":3,"commit_latency_ns":3000000,"apply_latency_ns":3000000},"alerts":[],"network_ping_times":[{"osd":0,"last update":"Tue Aug 1 19:54:53 2023","interfaces":[{"interface":"back","average":{"1min":0.48299999999999998,"5min":0.48299999999999998,"15min":0.48299999999999998},"min":{"1min":0.183,"5min":0.183,"15min":0.183},"max":{"1min":2.5529999999999999,"5min":2.5529999999999999,"15min":2.5529999999999999},"last":0.248},{"interface":"front","average":{"1min":0.434,"5min":0.434,"15min":0.434},"min":{"1min":0.193,"5min":0.193,"15min":0.193},"max":{"1min":0.80500000000000005,"5min":0.80500000000000005,"15min":0.80500000000000005},"last":0.34799999999999998}]},{"osd":1,"last update":"Tue Aug 1 19:54:53 2023","interfaces":[{"interface":"back","average":{"1min":0.45000000000000001,"5min":0.45000000000000001,"15min":0.45000000000000001},"min":{"1min":0.188,"5min":0.188,"15min":0.188},"max":{"1min":0.81200000000000006,"5min":0.81200000000000006,"15min":0.81200000000000006},"last":0.26300000000000001},{"interface":"front","average":{"1min":0.432,"5min":0.432,"15min":0.432},"min":{"1min":0.20000000000000001,"5min":0.20000000000000001,"15min":0.20000000000000001},"max":{"1min":0.98699999999999999,"5min":0.98699999999999999,"15min":0.98699999999999999},"last":0.21199999999999999}]}]},{"osd":0,"up_from":8,"seq":34359738392,"num_pgs":85,"num_osds":1,"num_per_pool_osds":1,"num_per_pool_omap_osds":1,"kb":94371840,"kb_used":512380,"kb_used_data":376348,"kb_used_omap":0,"kb_used_meta":136000,"kb_avail":93859460,"statfs":{"total":96636764160,"available":96112087040,"internally_reserved":0,"allocated":385380352,"data_stored":6157567823,"data_compressed":29528927,"data_compressed_allocated":384835584,"data_compressed_original":6157369344,"omap_allocated":0,"internal_metadata":139264000},"hb_peers":[1,2],"snap_trim_queue_len":0,"num_snap_trimming":0,"num_shards_repaired":0,"op_queue_age_hist":{"histogram":[],"upper_bound":1},"perf_stat":{"commit_latency_ms":4,"apply_latency_ms":4,"commit_latency_ns":4000000,"apply_latency_ns":4000000},"alerts":[],"network_ping_times":[{"osd":1,"last update":"Tue Aug 1 19:54:49 2023","interfaces":[{"interface":"back","average":{"1min":0.36299999999999999,"5min":0.36299999999999999,"15min":0.36299999999999999},"min":{"1min":0.17699999999999999,"5min":0.17699999999999999,"15min":0.17699999999999999},"max":{"1min":0.63700000000000001,"5min":0.63700000000000001,"15min":0.63700000000000001},"last":0.193},{"interface":"front","average":{"1min":0.39600000000000002,"5min":0.39600000000000002,"15min":0.39600000000000002},"min":{"1min":0.215,"5min":0.215,"15min":0.215},"max":{"1min":0.76000000000000001,"5min":0.76000000000000001,"15min":0.76000000000000001},"last":0.26100000000000001}]},{"osd":2,"last update":"Tue Aug 1 19:54:55 2023","interfaces":[{"interface":"back","average":{"1min":0.38600000000000001,"5min":0.38600000000000001,"15min":0.38600000000000001},"min":{"1min":0.20300000000000001,"5min":0.20300000000000001,"15min":0.20300000000000001},"max":{"1min":0.67400000000000004,"5min":0.67400000000000004,"15min":0.67400000000000004},"last":0.30499999999999999},{"interface":"front","average":{"1min":0.41099999999999998,"5min":0.41099999999999998,"15min":0.41099999999999998},"min":{"1min":0.218,"5min":0.218,"15min":0.218},"max":{"1min":0.76000000000000001,"5min":0.76000000000000001,"15min":0.76000000000000001},"last":0.28899999999999998}]}]},{"osd":1,"up_from":8,"seq":34359738391,"num_pgs":81,"num_osds":1,"num_per_pool_osds":1,"num_per_pool_omap_osds":1,"kb":94371840,"kb_used":402976,"kb_used_data":289420,"kb_used_omap":0,"kb_used_meta":113536,"kb_avail":93968864,"statfs":{"total":96636764160,"available":96224116736,"internally_reserved":0,"allocated":296366080,"data_stored":4732555325,"data_compressed":22702495,"data_compressed_allocated":295772160,"data_compressed_original":4732338176,"omap_allocated":0,"internal_metadata":116260864},"hb_peers":[0,2],"snap_trim_queue_len":0,"num_snap_trimming":0,"num_shards_repaired":0,"op_queue_age_hist":{"histogram":[],"upper_bound":1},"perf_stat":{"commit_latency_ms":3,"apply_latency_ms":3,"commit_latency_ns":3000000,"apply_latency_ns":3000000},"alerts":[],"network_ping_times":[{"osd":0,"last update":"Tue Aug 1 19:54:49 2023","interfaces":[{"interface":"back","average":{"1min":0.63900000000000001,"5min":0.63900000000000001,"15min":0.63900000000000001},"min":{"1min":0.17299999999999999,"5min":0.17299999999999999,"15min":0.17299999999999999},"max":{"1min":2.1709999999999998,"5min":2.1709999999999998,"15min":2.1709999999999998},"last":0.189},{"interface":"front","average":{"1min":0.36699999999999999,"5min":0.36699999999999999,"15min":0.36699999999999999},"min":{"1min":0.193,"5min":0.193,"15min":0.193},"max":{"1min":0.65600000000000003,"5min":0.65600000000000003,"15min":0.65600000000000003},"last":0.40400000000000003}]},{"osd":2,"last update":"Tue Aug 1 19:54:54 2023","interfaces":[{"interface":"back","average":{"1min":0.378,"5min":0.378,"15min":0.378},"min":{"1min":0.17599999999999999,"5min":0.17599999999999999,"15min":0.17599999999999999},"max":{"1min":0.84899999999999998,"5min":0.84899999999999998,"15min":0.84899999999999998},"last":0.23400000000000001},{"interface":"front","average":{"1min":0.45300000000000001,"5min":0.45300000000000001,"15min":0.45300000000000001},"min":{"1min":0.20999999999999999,"5min":0.20999999999999999,"15min":0.20999999999999999},"max":{"1min":1.468,"5min":1.468,"15min":1.468},"last":0.215}]}]}],"pool_statfs":[{"poolid":1,"osd":1,"total":0,"available":0,"internally_reserved":0,"allocated":57344,"data_stored":590368,"data_compressed":10331,"data_compressed_allocated":36864,"data_compressed_original":573440,"omap_allocated":0,"internal_metadata":0},{"poolid":1,"osd":2,"total":0,"available":0,"internally_reserved":0,"allocated":57344,"data_stored":590368,"data_compressed":10331,"data_compressed_allocated":36864,"data_compressed_original":573440,"omap_allocated":0,"internal_metadata":0},{"poolid":2,"osd":0,"total":0,"available":0,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":2,"osd":1,"total":0,"available":0,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":2,"osd":2,"total":0,"available":0,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":3,"osd":0,"total":0,"available":0,"internally_reserved":0,"allocated":8192,"data_stored":588,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":3,"osd":1,"total":0,"available":0,"internally_reserved":0,"allocated":32768,"data_stored":2306,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":3,"osd":2,"total":0,"available":0,"internally_reserved":0,"allocated":24576,"data_stored":1718,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":4,"osd":0,"total":0,"available":0,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":4,"osd":1,"total":0,"available":0,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":4,"osd":2,"total":0,"available":0,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":5,"osd":0,"total":0,"available":0,"internally_reserved":0,"allocated":379191296,"data_stored":6067060736,"data_compressed":29096235,"data_compressed_allocated":379191296,"data_compressed_original":6067060736,"omap_allocated":0,"internal_metadata":0},{"poolid":5,"osd":1,"total":0,"available":0,"internally_reserved":0,"allocated":291852288,"data_stored":4669571096,"data_compressed":22394178,"data_compressed_allocated":291848192,"data_compressed_original":4669571072,"omap_allocated":0,"internal_metadata":0},{"poolid":5,"osd":2,"total":0,"available":0,"internally_reserved":0,"allocated":256745472,"data_stored":4107862040,"data_compressed":19700725,"data_compressed_allocated":256741376,"data_compressed_original":4107862016,"omap_allocated":0,"internal_metadata":0}]}} 2023-08-01T19:55:37.677 INFO:tasks.thrashosds.thrasher:Setting 3.9 to [2, 0, 1] 2023-08-01T19:55:37.678 INFO:tasks.thrashosds.thrasher:cmd ['osd', 'pg-upmap-items', '3.9', '2', '0', '1'] 2023-08-01T19:55:37.678 DEBUG:teuthology.orchestra.run.smithi006:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 120 ceph --cluster ceph osd pg-upmap-items 3.9 2 0 1 2023-08-01T19:55:37.725 INFO:tasks.ceph.osd.0.smithi008.stderr:2023-08-01T19:55:37.723+0000 7f16a58f4700 -1 received signal: Hangup from /usr/bin/python3 /bin/daemon-helper kill ceph-osd -f --cluster ceph -i 0 (PID: 111179) UID: 0 2023-08-01T19:55:37.733 INFO:teuthology.orchestra.run.smithi008.stdout:ERROR: (22) Invalid argument 2023-08-01T19:55:37.733 INFO:teuthology.orchestra.run.smithi008.stdout:op_tracker tracking is not enabled now, so no ops are tracked currently, even those get stuck. Please enable "osd_enable_op_tracker", and the tracker will start to track new ops received afterwards. 2023-08-01T19:55:37.746 DEBUG:teuthology.orchestra.run.smithi008:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 30 ceph --cluster ceph --admin-daemon /var/run/ceph/ceph-osd.0.asok dump_blocked_ops 2023-08-01T19:55:37.826 INFO:tasks.ceph.osd.1.smithi101.stderr:2023-08-01T19:55:37.824+0000 7fb0cb7f6700 -1 received signal: Hangup from /usr/bin/python3 /bin/daemon-helper kill ceph-osd -f --cluster ceph -i 1 (PID: 111141) UID: 0 2023-08-01T19:55:37.927 INFO:tasks.ceph.osd.1.smithi101.stderr:2023-08-01T19:55:37.925+0000 7fb0cb7f6700 -1 received signal: Hangup from /usr/bin/python3 /bin/daemon-helper kill ceph-osd -f --cluster ceph -i 1 (PID: 111141) UID: 0 2023-08-01T19:55:37.965 INFO:teuthology.orchestra.run.smithi008.stdout:ERROR: (22) Invalid argument 2023-08-01T19:55:37.966 INFO:teuthology.orchestra.run.smithi008.stdout:op_tracker tracking is not enabled now, so no ops are tracked currently, even those get stuck. Please enable "osd_enable_op_tracker", and the tracker will start to track new ops received afterwards. 2023-08-01T19:55:37.982 DEBUG:teuthology.orchestra.run.smithi008:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 30 ceph --cluster ceph --admin-daemon /var/run/ceph/ceph-osd.0.asok dump_historic_ops 2023-08-01T19:55:38.028 INFO:tasks.ceph.osd.0.smithi008.stderr:2023-08-01T19:55:38.026+0000 7f16a58f4700 -1 received signal: Hangup from /usr/bin/python3 /bin/daemon-helper kill ceph-osd -f --cluster ceph -i 0 (PID: 111179) UID: 0 2023-08-01T19:55:38.069 INFO:teuthology.orchestra.run.smithi006.stderr:Error EINVAL: you must specify pairs of osd ids to be remapped 2023-08-01T19:55:38.072 DEBUG:teuthology.orchestra.run:got remote process result: 22 2023-08-01T19:55:38.073 INFO:tasks.thrashosds.thrasher:Failed to rm-pg-upmap-items, ignoring 2023-08-01T19:55:38.128 INFO:tasks.ceph.osd.0.smithi008.stderr:2023-08-01T19:55:38.127+0000 7f16a58f4700 -1 received signal: Hangup from /usr/bin/python3 /bin/daemon-helper kill ceph-osd -f --cluster ceph -i 0 (PID: 111179) UID: 0 2023-08-01T19:55:38.159 INFO:teuthology.orchestra.run.smithi008.stdout:ERROR: (22) Invalid argument 2023-08-01T19:55:38.159 INFO:teuthology.orchestra.run.smithi008.stdout:op_tracker tracking is not enabled now, so no ops are tracked currently, even those get stuck. Please enable "osd_enable_op_tracker", and the tracker will start to track new ops received afterwards. 2023-08-01T19:55:38.176 DEBUG:teuthology.orchestra.run.smithi101:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 30 ceph --cluster ceph --admin-daemon /var/run/ceph/ceph-osd.1.asok dump_ops_in_flight 2023-08-01T19:55:38.230 INFO:tasks.ceph.osd.1.smithi101.stderr:2023-08-01T19:55:38.229+0000 7fb0cb7f6700 -1 received signal: Hangup from /usr/bin/python3 /bin/daemon-helper kill ceph-osd -f --cluster ceph -i 1 (PID: 111141) UID: 0 2023-08-01T19:55:38.330 INFO:tasks.ceph.osd.0.smithi008.stderr:2023-08-01T19:55:38.328+0000 7f16a58f4700 -1 received signal: Hangup from /usr/bin/python3 /bin/daemon-helper kill ceph-osd -f --cluster ceph -i 0 (PID: 111179) UID: 0 2023-08-01T19:55:38.331 INFO:teuthology.orchestra.run.smithi101.stdout:ERROR: (22) Invalid argument 2023-08-01T19:55:38.331 INFO:teuthology.orchestra.run.smithi101.stdout:op_tracker tracking is not enabled now, so no ops are tracked currently, even those get stuck. Please enable "osd_enable_op_tracker", and the tracker will start to track new ops received afterwards. 2023-08-01T19:55:38.342 DEBUG:teuthology.orchestra.run.smithi101:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 30 ceph --cluster ceph --admin-daemon /var/run/ceph/ceph-osd.1.asok dump_blocked_ops 2023-08-01T19:55:38.431 INFO:tasks.ceph.osd.0.smithi008.stderr:2023-08-01T19:55:38.430+0000 7f16a58f4700 -1 received signal: Hangup from /usr/bin/python3 /bin/daemon-helper kill ceph-osd -f --cluster ceph -i 0 (PID: 111179) UID: 0 2023-08-01T19:55:38.529 INFO:teuthology.orchestra.run.smithi101.stdout:ERROR: (22) Invalid argument 2023-08-01T19:55:38.530 INFO:teuthology.orchestra.run.smithi101.stdout:op_tracker tracking is not enabled now, so no ops are tracked currently, even those get stuck. Please enable "osd_enable_op_tracker", and the tracker will start to track new ops received afterwards. 2023-08-01T19:55:38.532 INFO:tasks.ceph.osd.0.smithi008.stderr:2023-08-01T19:55:38.530+0000 7f16a58f4700 -1 received signal: Hangup from /usr/bin/python3 /bin/daemon-helper kill ceph-osd -f --cluster ceph -i 0 (PID: 111179) UID: 0 2023-08-01T19:55:38.542 DEBUG:teuthology.orchestra.run.smithi101:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 30 ceph --cluster ceph --admin-daemon /var/run/ceph/ceph-osd.1.asok dump_historic_ops 2023-08-01T19:55:38.633 INFO:tasks.ceph.osd.2.smithi155.stderr:2023-08-01T19:55:38.631+0000 7faa5c6ac700 -1 received signal: Hangup from /usr/bin/python3 /bin/daemon-helper kill ceph-osd -f --cluster ceph -i 2 (PID: 111337) UID: 0 2023-08-01T19:55:38.696 INFO:teuthology.orchestra.run.smithi101.stdout:ERROR: (22) Invalid argument 2023-08-01T19:55:38.696 INFO:teuthology.orchestra.run.smithi101.stdout:op_tracker tracking is not enabled now, so no ops are tracked currently, even those get stuck. Please enable "osd_enable_op_tracker", and the tracker will start to track new ops received afterwards. 2023-08-01T19:55:38.708 DEBUG:teuthology.orchestra.run.smithi155:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 30 ceph --cluster ceph --admin-daemon /var/run/ceph/ceph-osd.2.asok dump_ops_in_flight 2023-08-01T19:55:38.733 INFO:tasks.ceph.osd.1.smithi101.stderr:2023-08-01T19:55:38.733+0000 7fb0cb7f6700 -1 received signal: Hangup from /usr/bin/python3 /bin/daemon-helper kill ceph-osd -f --cluster ceph -i 1 (PID: 111141) UID: 0 2023-08-01T19:55:38.834 INFO:tasks.ceph.osd.0.smithi008.stderr:2023-08-01T19:55:38.832+0000 7f16a58f4700 -1 received signal: Hangup from /usr/bin/python3 /bin/daemon-helper kill ceph-osd -f --cluster ceph -i 0 (PID: 111179) UID: 0 2023-08-01T19:55:38.873 INFO:teuthology.orchestra.run.smithi155.stdout:ERROR: (22) Invalid argument 2023-08-01T19:55:38.873 INFO:teuthology.orchestra.run.smithi155.stdout:op_tracker tracking is not enabled now, so no ops are tracked currently, even those get stuck. Please enable "osd_enable_op_tracker", and the tracker will start to track new ops received afterwards. 2023-08-01T19:55:38.886 DEBUG:teuthology.orchestra.run.smithi155:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 30 ceph --cluster ceph --admin-daemon /var/run/ceph/ceph-osd.2.asok dump_blocked_ops 2023-08-01T19:55:38.935 INFO:tasks.ceph.osd.1.smithi101.stderr:2023-08-01T19:55:38.935+0000 7fb0cb7f6700 -1 received signal: Hangup from /usr/bin/python3 /bin/daemon-helper kill ceph-osd -f --cluster ceph -i 1 (PID: 111141) UID: 0 2023-08-01T19:55:39.036 INFO:tasks.ceph.osd.1.smithi101.stderr:2023-08-01T19:55:39.034+0000 7fb0cb7f6700 -1 received signal: Hangup from /usr/bin/python3 /bin/daemon-helper kill ceph-osd -f --cluster ceph -i 1 (PID: 111141) UID: 0 2023-08-01T19:55:39.045 INFO:teuthology.orchestra.run.smithi155.stdout:ERROR: (22) Invalid argument 2023-08-01T19:55:39.045 INFO:teuthology.orchestra.run.smithi155.stdout:op_tracker tracking is not enabled now, so no ops are tracked currently, even those get stuck. Please enable "osd_enable_op_tracker", and the tracker will start to track new ops received afterwards. 2023-08-01T19:55:39.059 DEBUG:teuthology.orchestra.run.smithi155:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 30 ceph --cluster ceph --admin-daemon /var/run/ceph/ceph-osd.2.asok dump_historic_ops 2023-08-01T19:55:39.132 DEBUG:teuthology.orchestra.run.smithi006:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 120 ceph --cluster ceph osd unset noscrub 2023-08-01T19:55:39.137 INFO:tasks.ceph.osd.1.smithi101.stderr:2023-08-01T19:55:39.135+0000 7fb0cb7f6700 -1 received signal: Hangup from /usr/bin/python3 /bin/daemon-helper kill ceph-osd -f --cluster ceph -i 1 (PID: 111141) UID: 0 2023-08-01T19:55:39.229 INFO:teuthology.orchestra.run.smithi155.stdout:ERROR: (22) Invalid argument 2023-08-01T19:55:39.230 INFO:teuthology.orchestra.run.smithi155.stdout:op_tracker tracking is not enabled now, so no ops are tracked currently, even those get stuck. Please enable "osd_enable_op_tracker", and the tracker will start to track new ops received afterwards. 2023-08-01T19:55:39.238 INFO:tasks.ceph.osd.2.smithi155.stderr:2023-08-01T19:55:39.236+0000 7faa5c6ac700 -1 received signal: Hangup from /usr/bin/python3 /bin/daemon-helper kill ceph-osd -f --cluster ceph -i 2 (PID: 111337) UID: 0 2023-08-01T19:55:39.242 DEBUG:teuthology.orchestra.run.smithi008:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 30 ceph --cluster ceph --admin-daemon /var/run/ceph/ceph-osd.0.asok dump_ops_in_flight 2023-08-01T19:55:39.338 INFO:tasks.ceph.osd.0.smithi008.stderr:2023-08-01T19:55:39.336+0000 7f16a58f4700 -1 received signal: Hangup from /usr/bin/python3 /bin/daemon-helper kill ceph-osd -f --cluster ceph -i 0 (PID: 111179) UID: 0 2023-08-01T19:55:39.367 DEBUG:teuthology.orchestra.run.smithi006:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 120 ceph --cluster ceph -- tell 'osd.*' injectargs --osd_enable_op_tracker=true 2023-08-01T19:55:39.433 INFO:teuthology.orchestra.run.smithi008.stdout:ERROR: (22) Invalid argument 2023-08-01T19:55:39.433 INFO:teuthology.orchestra.run.smithi008.stdout:op_tracker tracking is not enabled now, so no ops are tracked currently, even those get stuck. Please enable "osd_enable_op_tracker", and the tracker will start to track new ops received afterwards. 2023-08-01T19:55:39.439 INFO:tasks.ceph.osd.0.smithi008.stderr:2023-08-01T19:55:39.438+0000 7f16a58f4700 -1 received signal: Hangup from /usr/bin/python3 /bin/daemon-helper kill ceph-osd -f --cluster ceph -i 0 (PID: 111179) UID: 0 2023-08-01T19:55:39.450 DEBUG:teuthology.orchestra.run.smithi008:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 30 ceph --cluster ceph --admin-daemon /var/run/ceph/ceph-osd.0.asok dump_blocked_ops 2023-08-01T19:55:39.519 INFO:teuthology.orchestra.run.smithi006.stdout:osd.0: {} 2023-08-01T19:55:39.539 INFO:teuthology.orchestra.run.smithi006.stdout:osd.1: {} 2023-08-01T19:55:39.540 INFO:tasks.ceph.osd.2.smithi155.stderr:2023-08-01T19:55:39.538+0000 7faa5c6ac700 -1 received signal: Hangup from /usr/bin/python3 /bin/daemon-helper kill ceph-osd -f --cluster ceph -i 2 (PID: 111337) UID: 0 2023-08-01T19:55:39.559 INFO:teuthology.orchestra.run.smithi006.stdout:osd.2: {} 2023-08-01T19:55:39.561 INFO:teuthology.orchestra.run.smithi006.stderr:osd.0: osd_enable_op_tracker = 'true' 2023-08-01T19:55:39.561 INFO:teuthology.orchestra.run.smithi006.stderr:osd.1: osd_enable_op_tracker = 'true' 2023-08-01T19:55:39.561 INFO:teuthology.orchestra.run.smithi006.stderr:osd.2: osd_enable_op_tracker = 'true' 2023-08-01T19:55:39.641 INFO:tasks.ceph.osd.2.smithi155.stderr:2023-08-01T19:55:39.639+0000 7faa5c6ac700 -1 received signal: Hangup from /usr/bin/python3 /bin/daemon-helper kill ceph-osd -f --cluster ceph -i 2 (PID: 111337) UID: 0 2023-08-01T19:55:39.675 INFO:teuthology.orchestra.run.smithi008.stdout:{ 2023-08-01T19:55:39.676 INFO:teuthology.orchestra.run.smithi008.stdout: "ops": [], 2023-08-01T19:55:39.676 INFO:teuthology.orchestra.run.smithi008.stdout: "complaint_time": 30, 2023-08-01T19:55:39.676 INFO:teuthology.orchestra.run.smithi008.stdout: "num_blocked_ops": 0 2023-08-01T19:55:39.676 INFO:teuthology.orchestra.run.smithi008.stdout:} 2023-08-01T19:55:39.691 DEBUG:teuthology.orchestra.run.smithi008:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 30 ceph --cluster ceph --admin-daemon /var/run/ceph/ceph-osd.0.asok dump_historic_ops 2023-08-01T19:55:39.743 INFO:tasks.ceph.osd.0.smithi008.stderr:2023-08-01T19:55:39.742+0000 7f16a58f4700 -1 received signal: Hangup from /usr/bin/python3 /bin/daemon-helper kill ceph-osd -f --cluster ceph -i 0 (PID: 111179) UID: 0 2023-08-01T19:55:39.843 INFO:tasks.ceph.osd.0.smithi008.stderr:2023-08-01T19:55:39.841+0000 7f16a58f4700 -1 received signal: Hangup from /usr/bin/python3 /bin/daemon-helper kill ceph-osd -f --cluster ceph -i 0 (PID: 111179) UID: 0 2023-08-01T19:55:39.877 INFO:teuthology.orchestra.run.smithi008.stdout:{ 2023-08-01T19:55:39.877 INFO:teuthology.orchestra.run.smithi008.stdout: "size": 20, 2023-08-01T19:55:39.877 INFO:teuthology.orchestra.run.smithi008.stdout: "duration": 600, 2023-08-01T19:55:39.877 INFO:teuthology.orchestra.run.smithi008.stdout: "ops": [ 2023-08-01T19:55:39.877 INFO:teuthology.orchestra.run.smithi008.stdout: { 2023-08-01T19:55:39.877 INFO:teuthology.orchestra.run.smithi008.stdout: "description": "osd_op(client.4668.0:100240 5.a 5:5313c5b9:::benchmark_data_smithi006_114134_object100239:head [set-alloc-hint object_size 65536 write_size 65536,write 0~65536] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e37)", 2023-08-01T19:55:39.878 INFO:teuthology.orchestra.run.smithi008.stdout: "initiated_at": "2023-08-01T19:55:05.148399+0000", 2023-08-01T19:55:39.878 INFO:teuthology.orchestra.run.smithi008.stdout: "age": 34.724372850000002, 2023-08-01T19:55:39.878 INFO:teuthology.orchestra.run.smithi008.stdout: "duration": 0.077278904999999995, 2023-08-01T19:55:39.878 INFO:teuthology.orchestra.run.smithi008.stdout: "type_data": { 2023-08-01T19:55:39.878 INFO:teuthology.orchestra.run.smithi008.stdout: "flag_point": "commit sent; apply or cleanup", 2023-08-01T19:55:39.878 INFO:teuthology.orchestra.run.smithi008.stdout: "client_info": { 2023-08-01T19:55:39.878 INFO:teuthology.orchestra.run.smithi008.stdout: "client": "client.4668", 2023-08-01T19:55:39.879 INFO:teuthology.orchestra.run.smithi008.stdout: "client_addr": "172.21.15.6:0/1709472247", 2023-08-01T19:55:39.879 INFO:teuthology.orchestra.run.smithi008.stdout: "tid": 100240 2023-08-01T19:55:39.879 INFO:teuthology.orchestra.run.smithi008.stdout: }, 2023-08-01T19:55:39.879 INFO:teuthology.orchestra.run.smithi008.stdout: "events": [ 2023-08-01T19:55:39.879 INFO:teuthology.orchestra.run.smithi008.stdout: { 2023-08-01T19:55:39.879 INFO:teuthology.orchestra.run.smithi008.stdout: "event": "initiated", 2023-08-01T19:55:39.879 INFO:teuthology.orchestra.run.smithi008.stdout: "time": "2023-08-01T19:55:05.148399+0000", 2023-08-01T19:55:39.879 INFO:teuthology.orchestra.run.smithi008.stdout: "duration": 0 2023-08-01T19:55:39.880 INFO:teuthology.orchestra.run.smithi008.stdout: }, 2023-08-01T19:55:39.880 INFO:teuthology.orchestra.run.smithi008.stdout: { 2023-08-01T19:55:39.880 INFO:teuthology.orchestra.run.smithi008.stdout: "event": "throttled", 2023-08-01T19:55:39.880 INFO:teuthology.orchestra.run.smithi008.stdout: "time": "2023-08-01T19:55:05.148399+0000", 2023-08-01T19:55:39.880 INFO:teuthology.orchestra.run.smithi008.stdout: "duration": 0 2023-08-01T19:55:39.880 INFO:teuthology.orchestra.run.smithi008.stdout: }, 2023-08-01T19:55:39.880 INFO:teuthology.orchestra.run.smithi008.stdout: { 2023-08-01T19:55:39.881 INFO:teuthology.orchestra.run.smithi008.stdout: "event": "header_read", 2023-08-01T19:55:39.881 INFO:teuthology.orchestra.run.smithi008.stdout: "time": "2023-08-01T19:55:05.148398+0000", 2023-08-01T19:55:39.881 INFO:teuthology.orchestra.run.smithi008.stdout: "duration": 4294967295.999999 2023-08-01T19:55:39.881 INFO:teuthology.orchestra.run.smithi008.stdout: }, 2023-08-01T19:55:39.881 INFO:teuthology.orchestra.run.smithi008.stdout: { 2023-08-01T19:55:39.881 INFO:teuthology.orchestra.run.smithi008.stdout: "event": "all_read", 2023-08-01T19:55:39.881 INFO:teuthology.orchestra.run.smithi008.stdout: "time": "2023-08-01T19:55:05.148492+0000", 2023-08-01T19:55:39.881 INFO:teuthology.orchestra.run.smithi008.stdout: "duration": 9.3892000000000002e-05 2023-08-01T19:55:39.882 INFO:teuthology.orchestra.run.smithi008.stdout: }, 2023-08-01T19:55:39.882 INFO:teuthology.orchestra.run.smithi008.stdout: { 2023-08-01T19:55:39.882 INFO:teuthology.orchestra.run.smithi008.stdout: "event": "dispatched", 2023-08-01T19:55:39.882 INFO:teuthology.orchestra.run.smithi008.stdout: "time": "2023-08-01T19:55:05.148503+0000", 2023-08-01T19:55:39.882 INFO:teuthology.orchestra.run.smithi008.stdout: "duration": 1.0951000000000001e-05 2023-08-01T19:55:39.882 INFO:teuthology.orchestra.run.smithi008.stdout: }, 2023-08-01T19:55:39.882 INFO:teuthology.orchestra.run.smithi008.stdout: { 2023-08-01T19:55:39.882 INFO:teuthology.orchestra.run.smithi008.stdout: "event": "queued_for_pg", 2023-08-01T19:55:39.883 INFO:teuthology.orchestra.run.smithi008.stdout: "time": "2023-08-01T19:55:05.148508+0000", 2023-08-01T19:55:39.883 INFO:teuthology.orchestra.run.smithi008.stdout: "duration": 5.0080000000000002e-06 2023-08-01T19:55:39.883 INFO:teuthology.orchestra.run.smithi008.stdout: }, 2023-08-01T19:55:39.883 INFO:teuthology.orchestra.run.smithi008.stdout: { 2023-08-01T19:55:39.883 INFO:teuthology.orchestra.run.smithi008.stdout: "event": "reached_pg", 2023-08-01T19:55:39.883 INFO:teuthology.orchestra.run.smithi008.stdout: "time": "2023-08-01T19:55:05.148548+0000", 2023-08-01T19:55:39.883 INFO:teuthology.orchestra.run.smithi008.stdout: "duration": 4.0358999999999998e-05 2023-08-01T19:55:39.883 INFO:teuthology.orchestra.run.smithi008.stdout: }, 2023-08-01T19:55:39.884 INFO:teuthology.orchestra.run.smithi008.stdout: { 2023-08-01T19:55:39.884 INFO:teuthology.orchestra.run.smithi008.stdout: "event": "started", 2023-08-01T19:55:39.884 INFO:teuthology.orchestra.run.smithi008.stdout: "time": "2023-08-01T19:55:05.148666+0000", 2023-08-01T19:55:39.884 INFO:teuthology.orchestra.run.smithi008.stdout: "duration": 0.000117621 2023-08-01T19:55:39.884 INFO:teuthology.orchestra.run.smithi008.stdout: }, 2023-08-01T19:55:39.884 INFO:teuthology.orchestra.run.smithi008.stdout: { 2023-08-01T19:55:39.884 INFO:teuthology.orchestra.run.smithi008.stdout: "event": "waiting for subops from 2", 2023-08-01T19:55:39.885 INFO:teuthology.orchestra.run.smithi008.stdout: "time": "2023-08-01T19:55:05.148805+0000", 2023-08-01T19:55:39.885 INFO:teuthology.orchestra.run.smithi008.stdout: "duration": 0.000139176 2023-08-01T19:55:39.885 INFO:teuthology.orchestra.run.smithi008.stdout: }, 2023-08-01T19:55:39.885 INFO:teuthology.orchestra.run.smithi008.stdout: { 2023-08-01T19:55:39.885 INFO:teuthology.orchestra.run.smithi008.stdout: "event": "op_commit", 2023-08-01T19:55:39.885 INFO:teuthology.orchestra.run.smithi008.stdout: "time": "2023-08-01T19:55:05.156143+0000", 2023-08-01T19:55:39.885 INFO:teuthology.orchestra.run.smithi008.stdout: "duration": 0.007338041 2023-08-01T19:55:39.885 INFO:teuthology.orchestra.run.smithi008.stdout: }, 2023-08-01T19:55:39.886 INFO:teuthology.orchestra.run.smithi008.stdout: { 2023-08-01T19:55:39.886 INFO:teuthology.orchestra.run.smithi008.stdout: "event": "sub_op_commit_rec", 2023-08-01T19:55:39.886 INFO:teuthology.orchestra.run.smithi008.stdout: "time": "2023-08-01T19:55:05.225581+0000", 2023-08-01T19:55:39.886 INFO:teuthology.orchestra.run.smithi008.stdout: "duration": 0.069438402999999996 2023-08-01T19:55:39.886 INFO:teuthology.orchestra.run.smithi008.stdout: }, 2023-08-01T19:55:39.886 INFO:teuthology.orchestra.run.smithi008.stdout: { 2023-08-01T19:55:39.886 INFO:teuthology.orchestra.run.smithi008.stdout: "event": "commit_sent", 2023-08-01T19:55:39.886 INFO:teuthology.orchestra.run.smithi008.stdout: "time": "2023-08-01T19:55:05.225632+0000", 2023-08-01T19:55:39.887 INFO:teuthology.orchestra.run.smithi008.stdout: "duration": 5.0382e-05 2023-08-01T19:55:39.887 INFO:teuthology.orchestra.run.smithi008.stdout: }, 2023-08-01T19:55:39.887 INFO:teuthology.orchestra.run.smithi008.stdout: { 2023-08-01T19:55:39.887 INFO:teuthology.orchestra.run.smithi008.stdout: "event": "done", 2023-08-01T19:55:39.887 INFO:teuthology.orchestra.run.smithi008.stdout: "time": "2023-08-01T19:55:05.225677+0000", 2023-08-01T19:55:39.887 INFO:teuthology.orchestra.run.smithi008.stdout: "duration": 4.5893000000000003e-05 2023-08-01T19:55:39.887 INFO:teuthology.orchestra.run.smithi008.stdout: } 2023-08-01T19:55:39.887 INFO:teuthology.orchestra.run.smithi008.stdout: ] 2023-08-01T19:55:39.888 INFO:teuthology.orchestra.run.smithi008.stdout: } 2023-08-01T19:55:39.888 INFO:teuthology.orchestra.run.smithi008.stdout: }, 2023-08-01T19:55:39.888 INFO:teuthology.orchestra.run.smithi008.stdout: { 2023-08-01T19:55:39.888 INFO:teuthology.orchestra.run.smithi008.stdout: "description": "osd_op(client.4668.0:100243 5.a 5:5e8193b6:::benchmark_data_smithi006_114134_object100242:head [set-alloc-hint object_size 65536 write_size 65536,write 0~65536] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e37)", 2023-08-01T19:55:39.888 INFO:teuthology.orchestra.run.smithi008.stdout: "initiated_at": "2023-08-01T19:55:05.150737+0000", 2023-08-01T19:55:39.888 INFO:teuthology.orchestra.run.smithi008.stdout: "age": 34.722034395000001, 2023-08-01T19:55:39.888 INFO:teuthology.orchestra.run.smithi008.stdout: "duration": 0.075019885999999994, 2023-08-01T19:55:39.889 INFO:teuthology.orchestra.run.smithi008.stdout: "type_data": { 2023-08-01T19:55:39.889 INFO:teuthology.orchestra.run.smithi008.stdout: "flag_point": "commit sent; apply or cleanup", 2023-08-01T19:55:39.889 INFO:teuthology.orchestra.run.smithi008.stdout: "client_info": { 2023-08-01T19:55:39.889 INFO:teuthology.orchestra.run.smithi008.stdout: "client": "client.4668", 2023-08-01T19:55:39.889 INFO:teuthology.orchestra.run.smithi008.stdout: "client_addr": "172.21.15.6:0/1709472247", 2023-08-01T19:55:39.889 INFO:teuthology.orchestra.run.smithi008.stdout: "tid": 100243 2023-08-01T19:55:39.889 INFO:teuthology.orchestra.run.smithi008.stdout: }, 2023-08-01T19:55:39.889 INFO:teuthology.orchestra.run.smithi008.stdout: "events": [ 2023-08-01T19:55:39.890 INFO:teuthology.orchestra.run.smithi008.stdout: { 2023-08-01T19:55:39.890 INFO:teuthology.orchestra.run.smithi008.stdout: "event": "initiated", 2023-08-01T19:55:39.890 INFO:teuthology.orchestra.run.smithi008.stdout: "time": "2023-08-01T19:55:05.150737+0000", 2023-08-01T19:55:39.890 INFO:teuthology.orchestra.run.smithi008.stdout: "duration": 0 2023-08-01T19:55:39.890 INFO:teuthology.orchestra.run.smithi008.stdout: }, 2023-08-01T19:55:39.890 INFO:teuthology.orchestra.run.smithi008.stdout: { 2023-08-01T19:55:39.890 INFO:teuthology.orchestra.run.smithi008.stdout: "event": "throttled", 2023-08-01T19:55:39.890 INFO:teuthology.orchestra.run.smithi008.stdout: "time": "2023-08-01T19:55:05.150737+0000", 2023-08-01T19:55:39.891 INFO:teuthology.orchestra.run.smithi008.stdout: "duration": 0 2023-08-01T19:55:39.891 INFO:teuthology.orchestra.run.smithi008.stdout: }, 2023-08-01T19:55:39.891 INFO:teuthology.orchestra.run.smithi008.stdout: { 2023-08-01T19:55:39.891 INFO:teuthology.orchestra.run.smithi008.stdout: "event": "header_read", 2023-08-01T19:55:39.891 INFO:teuthology.orchestra.run.smithi008.stdout: "time": "2023-08-01T19:55:05.150736+0000", 2023-08-01T19:55:39.891 INFO:teuthology.orchestra.run.smithi008.stdout: "duration": 4294967295.999999 2023-08-01T19:55:39.891 INFO:teuthology.orchestra.run.smithi008.stdout: }, 2023-08-01T19:55:39.891 INFO:teuthology.orchestra.run.smithi008.stdout: { 2023-08-01T19:55:39.892 INFO:teuthology.orchestra.run.smithi008.stdout: "event": "all_read", 2023-08-01T19:55:39.892 INFO:teuthology.orchestra.run.smithi008.stdout: "time": "2023-08-01T19:55:05.150780+0000", 2023-08-01T19:55:39.892 INFO:teuthology.orchestra.run.smithi008.stdout: "duration": 4.3578999999999997e-05 2023-08-01T19:55:39.892 INFO:teuthology.orchestra.run.smithi008.stdout: }, 2023-08-01T19:55:39.892 INFO:teuthology.orchestra.run.smithi008.stdout: { 2023-08-01T19:55:39.892 INFO:teuthology.orchestra.run.smithi008.stdout: "event": "dispatched", 2023-08-01T19:55:39.892 INFO:teuthology.orchestra.run.smithi008.stdout: "time": "2023-08-01T19:55:05.150791+0000", 2023-08-01T19:55:39.893 INFO:teuthology.orchestra.run.smithi008.stdout: "duration": 1.0963e-05 2023-08-01T19:55:39.893 INFO:teuthology.orchestra.run.smithi008.stdout: }, 2023-08-01T19:55:39.893 INFO:teuthology.orchestra.run.smithi008.stdout: { 2023-08-01T19:55:39.893 INFO:teuthology.orchestra.run.smithi008.stdout: "event": "queued_for_pg", 2023-08-01T19:55:39.893 INFO:teuthology.orchestra.run.smithi008.stdout: "time": "2023-08-01T19:55:05.150797+0000", 2023-08-01T19:55:39.893 INFO:teuthology.orchestra.run.smithi008.stdout: "duration": 5.9780000000000002e-06 2023-08-01T19:55:39.893 INFO:teuthology.orchestra.run.smithi008.stdout: }, 2023-08-01T19:55:39.893 INFO:teuthology.orchestra.run.smithi008.stdout: { 2023-08-01T19:55:39.894 INFO:teuthology.orchestra.run.smithi008.stdout: "event": "reached_pg", 2023-08-01T19:55:39.894 INFO:teuthology.orchestra.run.smithi008.stdout: "time": "2023-08-01T19:55:05.150833+0000", 2023-08-01T19:55:39.894 INFO:teuthology.orchestra.run.smithi008.stdout: "duration": 3.6000000000000001e-05 2023-08-01T19:55:39.894 INFO:teuthology.orchestra.run.smithi008.stdout: }, 2023-08-01T19:55:39.894 INFO:teuthology.orchestra.run.smithi008.stdout: { 2023-08-01T19:55:39.894 INFO:teuthology.orchestra.run.smithi008.stdout: "event": "started", 2023-08-01T19:55:39.894 INFO:teuthology.orchestra.run.smithi008.stdout: "time": "2023-08-01T19:55:05.150951+0000", 2023-08-01T19:55:39.894 INFO:teuthology.orchestra.run.smithi008.stdout: "duration": 0.00011827799999999999 2023-08-01T19:55:39.895 INFO:teuthology.orchestra.run.smithi008.stdout: }, 2023-08-01T19:55:39.895 INFO:teuthology.orchestra.run.smithi008.stdout: { 2023-08-01T19:55:39.895 INFO:teuthology.orchestra.run.smithi008.stdout: "event": "waiting for subops from 2", 2023-08-01T19:55:39.895 INFO:teuthology.orchestra.run.smithi008.stdout: "time": "2023-08-01T19:55:05.151111+0000", 2023-08-01T19:55:39.895 INFO:teuthology.orchestra.run.smithi008.stdout: "duration": 0.00015961299999999999 2023-08-01T19:55:39.895 INFO:teuthology.orchestra.run.smithi008.stdout: }, 2023-08-01T19:55:39.895 INFO:teuthology.orchestra.run.smithi008.stdout: { 2023-08-01T19:55:39.895 INFO:teuthology.orchestra.run.smithi008.stdout: "event": "op_commit", 2023-08-01T19:55:39.896 INFO:teuthology.orchestra.run.smithi008.stdout: "time": "2023-08-01T19:55:05.156247+0000", 2023-08-01T19:55:39.896 INFO:teuthology.orchestra.run.smithi008.stdout: "duration": 0.005136524 2023-08-01T19:55:39.896 INFO:teuthology.orchestra.run.smithi008.stdout: }, 2023-08-01T19:55:39.896 INFO:teuthology.orchestra.run.smithi008.stdout: { 2023-08-01T19:55:39.896 INFO:teuthology.orchestra.run.smithi008.stdout: "event": "sub_op_commit_rec", 2023-08-01T19:55:39.896 INFO:teuthology.orchestra.run.smithi008.stdout: "time": "2023-08-01T19:55:05.225705+0000", 2023-08-01T19:55:39.896 INFO:teuthology.orchestra.run.smithi008.stdout: "duration": 0.069458377000000002 2023-08-01T19:55:39.896 INFO:teuthology.orchestra.run.smithi008.stdout: }, 2023-08-01T19:55:39.897 INFO:teuthology.orchestra.run.smithi008.stdout: { 2023-08-01T19:55:39.897 INFO:teuthology.orchestra.run.smithi008.stdout: "event": "commit_sent", 2023-08-01T19:55:39.897 INFO:teuthology.orchestra.run.smithi008.stdout: "time": "2023-08-01T19:55:05.225736+0000", 2023-08-01T19:55:39.897 INFO:teuthology.orchestra.run.smithi008.stdout: "duration": 3.0388000000000001e-05 2023-08-01T19:55:39.897 INFO:teuthology.orchestra.run.smithi008.stdout: }, 2023-08-01T19:55:39.897 INFO:teuthology.orchestra.run.smithi008.stdout: { 2023-08-01T19:55:39.897 INFO:teuthology.orchestra.run.smithi008.stdout: "event": "done", 2023-08-01T19:55:39.897 INFO:teuthology.orchestra.run.smithi008.stdout: "time": "2023-08-01T19:55:05.225757+0000", 2023-08-01T19:55:39.898 INFO:teuthology.orchestra.run.smithi008.stdout: "duration": 2.1090999999999998e-05 2023-08-01T19:55:39.898 INFO:teuthology.orchestra.run.smithi008.stdout: } 2023-08-01T19:55:39.898 INFO:teuthology.orchestra.run.smithi008.stdout: ] 2023-08-01T19:55:39.898 INFO:teuthology.orchestra.run.smithi008.stdout: } 2023-08-01T19:55:39.898 INFO:teuthology.orchestra.run.smithi008.stdout: }, 2023-08-01T19:55:39.898 INFO:teuthology.orchestra.run.smithi008.stdout: { 2023-08-01T19:55:39.898 INFO:teuthology.orchestra.run.smithi008.stdout: "description": "osd_op(client.4668.0:100261 5.a 5:562deedb:::benchmark_data_smithi006_114134_object100260:head [set-alloc-hint object_size 65536 write_size 65536,write 0~65536] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e37)", 2023-08-01T19:55:39.899 INFO:teuthology.orchestra.run.smithi008.stdout: "initiated_at": "2023-08-01T19:55:05.163316+0000", 2023-08-01T19:55:39.899 INFO:teuthology.orchestra.run.smithi008.stdout: "age": 34.709454979, 2023-08-01T19:55:39.899 INFO:teuthology.orchestra.run.smithi008.stdout: "duration": 0.063073012999999997, 2023-08-01T19:55:39.899 INFO:teuthology.orchestra.run.smithi008.stdout: "type_data": { 2023-08-01T19:55:39.899 INFO:teuthology.orchestra.run.smithi008.stdout: "flag_point": "commit sent; apply or cleanup", 2023-08-01T19:55:39.899 INFO:teuthology.orchestra.run.smithi008.stdout: "client_info": { 2023-08-01T19:55:39.899 INFO:teuthology.orchestra.run.smithi008.stdout: "client": "client.4668", 2023-08-01T19:55:39.899 INFO:teuthology.orchestra.run.smithi008.stdout: "client_addr": "172.21.15.6:0/1709472247", 2023-08-01T19:55:39.900 INFO:teuthology.orchestra.run.smithi008.stdout: "tid": 100261 2023-08-01T19:55:39.900 INFO:teuthology.orchestra.run.smithi008.stdout: }, 2023-08-01T19:55:39.900 INFO:teuthology.orchestra.run.smithi008.stdout: "events": [ 2023-08-01T19:55:39.900 INFO:teuthology.orchestra.run.smithi008.stdout: { 2023-08-01T19:55:39.900 INFO:teuthology.orchestra.run.smithi008.stdout: "event": "initiated", 2023-08-01T19:55:39.900 INFO:teuthology.orchestra.run.smithi008.stdout: "time": "2023-08-01T19:55:05.163316+0000", 2023-08-01T19:55:39.900 INFO:teuthology.orchestra.run.smithi008.stdout: "duration": 0 2023-08-01T19:55:39.900 INFO:teuthology.orchestra.run.smithi008.stdout: }, 2023-08-01T19:55:39.901 INFO:teuthology.orchestra.run.smithi008.stdout: { 2023-08-01T19:55:39.901 INFO:teuthology.orchestra.run.smithi008.stdout: "event": "throttled", 2023-08-01T19:55:39.901 INFO:teuthology.orchestra.run.smithi008.stdout: "time": "2023-08-01T19:55:05.163316+0000", 2023-08-01T19:55:39.901 INFO:teuthology.orchestra.run.smithi008.stdout: "duration": 0 2023-08-01T19:55:39.901 INFO:teuthology.orchestra.run.smithi008.stdout: }, 2023-08-01T19:55:39.901 INFO:teuthology.orchestra.run.smithi008.stdout: { 2023-08-01T19:55:39.901 INFO:teuthology.orchestra.run.smithi008.stdout: "event": "header_read", 2023-08-01T19:55:39.901 INFO:teuthology.orchestra.run.smithi008.stdout: "time": "2023-08-01T19:55:05.163316+0000", 2023-08-01T19:55:39.902 INFO:teuthology.orchestra.run.smithi008.stdout: "duration": 4294967295.999999 2023-08-01T19:55:39.902 INFO:teuthology.orchestra.run.smithi008.stdout: }, 2023-08-01T19:55:39.902 INFO:teuthology.orchestra.run.smithi008.stdout: { 2023-08-01T19:55:39.902 INFO:teuthology.orchestra.run.smithi008.stdout: "event": "all_read", 2023-08-01T19:55:39.902 INFO:teuthology.orchestra.run.smithi008.stdout: "time": "2023-08-01T19:55:05.163380+0000", 2023-08-01T19:55:39.902 INFO:teuthology.orchestra.run.smithi008.stdout: "duration": 6.4395999999999998e-05 2023-08-01T19:55:39.902 INFO:teuthology.orchestra.run.smithi008.stdout: }, 2023-08-01T19:55:39.903 INFO:teuthology.orchestra.run.smithi008.stdout: { 2023-08-01T19:55:39.903 INFO:teuthology.orchestra.run.smithi008.stdout: "event": "dispatched", 2023-08-01T19:55:39.903 INFO:teuthology.orchestra.run.smithi008.stdout: "time": "2023-08-01T19:55:05.163390+0000", 2023-08-01T19:55:39.903 INFO:teuthology.orchestra.run.smithi008.stdout: "duration": 1.0189e-05 2023-08-01T19:55:39.903 INFO:teuthology.orchestra.run.smithi008.stdout: }, 2023-08-01T19:55:39.903 INFO:teuthology.orchestra.run.smithi008.stdout: { 2023-08-01T19:55:39.903 INFO:teuthology.orchestra.run.smithi008.stdout: "event": "queued_for_pg", 2023-08-01T19:55:39.903 INFO:teuthology.orchestra.run.smithi008.stdout: "time": "2023-08-01T19:55:05.163395+0000", 2023-08-01T19:55:39.904 INFO:teuthology.orchestra.run.smithi008.stdout: "duration": 4.4059999999999998e-06 2023-08-01T19:55:39.904 INFO:teuthology.orchestra.run.smithi008.stdout: }, 2023-08-01T19:55:39.904 INFO:teuthology.orchestra.run.smithi008.stdout: { 2023-08-01T19:55:39.904 INFO:teuthology.orchestra.run.smithi008.stdout: "event": "reached_pg", 2023-08-01T19:55:39.904 INFO:teuthology.orchestra.run.smithi008.stdout: "time": "2023-08-01T19:55:05.163429+0000", 2023-08-01T19:55:39.904 INFO:teuthology.orchestra.run.smithi008.stdout: "duration": 3.4900000000000001e-05 2023-08-01T19:55:39.904 INFO:teuthology.orchestra.run.smithi008.stdout: }, 2023-08-01T19:55:39.904 INFO:teuthology.orchestra.run.smithi008.stdout: { 2023-08-01T19:55:39.905 INFO:teuthology.orchestra.run.smithi008.stdout: "event": "started", 2023-08-01T19:55:39.905 INFO:teuthology.orchestra.run.smithi008.stdout: "time": "2023-08-01T19:55:05.163512+0000", 2023-08-01T19:55:39.905 INFO:teuthology.orchestra.run.smithi008.stdout: "duration": 8.2987999999999999e-05 2023-08-01T19:55:39.905 INFO:teuthology.orchestra.run.smithi008.stdout: }, 2023-08-01T19:55:39.905 INFO:teuthology.orchestra.run.smithi008.stdout: { 2023-08-01T19:55:39.905 INFO:teuthology.orchestra.run.smithi008.stdout: "event": "waiting for subops from 2", 2023-08-01T19:55:39.905 INFO:teuthology.orchestra.run.smithi008.stdout: "time": "2023-08-01T19:55:05.163596+0000", 2023-08-01T19:55:39.905 INFO:teuthology.orchestra.run.smithi008.stdout: "duration": 8.3783999999999996e-05 2023-08-01T19:55:39.906 INFO:teuthology.orchestra.run.smithi008.stdout: }, 2023-08-01T19:55:39.906 INFO:teuthology.orchestra.run.smithi008.stdout: { 2023-08-01T19:55:39.906 INFO:teuthology.orchestra.run.smithi008.stdout: "event": "op_commit", 2023-08-01T19:55:39.906 INFO:teuthology.orchestra.run.smithi008.stdout: "time": "2023-08-01T19:55:05.167129+0000", 2023-08-01T19:55:39.906 INFO:teuthology.orchestra.run.smithi008.stdout: "duration": 0.0035328709999999999 2023-08-01T19:55:39.906 INFO:teuthology.orchestra.run.smithi008.stdout: }, 2023-08-01T19:55:39.906 INFO:teuthology.orchestra.run.smithi008.stdout: { 2023-08-01T19:55:39.907 INFO:teuthology.orchestra.run.smithi008.stdout: "event": "sub_op_commit_rec", 2023-08-01T19:55:39.907 INFO:teuthology.orchestra.run.smithi008.stdout: "time": "2023-08-01T19:55:05.226302+0000", 2023-08-01T19:55:39.907 INFO:teuthology.orchestra.run.smithi008.stdout: "duration": 0.059172711000000003 2023-08-01T19:55:39.907 INFO:teuthology.orchestra.run.smithi008.stdout: }, 2023-08-01T19:55:39.907 INFO:teuthology.orchestra.run.smithi008.stdout: { 2023-08-01T19:55:39.907 INFO:teuthology.orchestra.run.smithi008.stdout: "event": "commit_sent", 2023-08-01T19:55:39.907 INFO:teuthology.orchestra.run.smithi008.stdout: "time": "2023-08-01T19:55:05.226351+0000", 2023-08-01T19:55:39.907 INFO:teuthology.orchestra.run.smithi008.stdout: "duration": 4.969e-05 2023-08-01T19:55:39.908 INFO:teuthology.orchestra.run.smithi008.stdout: }, 2023-08-01T19:55:39.908 INFO:teuthology.orchestra.run.smithi008.stdout: { 2023-08-01T19:55:39.908 INFO:teuthology.orchestra.run.smithi008.stdout: "event": "done", 2023-08-01T19:55:39.908 INFO:teuthology.orchestra.run.smithi008.stdout: "time": "2023-08-01T19:55:05.226389+0000", 2023-08-01T19:55:39.908 INFO:teuthology.orchestra.run.smithi008.stdout: "duration": 3.7978000000000001e-05 2023-08-01T19:55:39.908 INFO:teuthology.orchestra.run.smithi008.stdout: } 2023-08-01T19:55:39.908 INFO:teuthology.orchestra.run.smithi008.stdout: ] 2023-08-01T19:55:39.908 INFO:teuthology.orchestra.run.smithi008.stdout: } 2023-08-01T19:55:39.909 INFO:teuthology.orchestra.run.smithi008.stdout: }, 2023-08-01T19:55:39.909 INFO:teuthology.orchestra.run.smithi008.stdout: { 2023-08-01T19:55:39.909 INFO:teuthology.orchestra.run.smithi008.stdout: "description": "osd_op(client.4668.0:100262 5.a 5:5c636b5d:::benchmark_data_smithi006_114134_object100261:head [set-alloc-hint object_size 65536 write_size 65536,write 0~65536] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e37)", 2023-08-01T19:55:39.909 INFO:teuthology.orchestra.run.smithi008.stdout: "initiated_at": "2023-08-01T19:55:05.165068+0000", 2023-08-01T19:55:39.909 INFO:teuthology.orchestra.run.smithi008.stdout: "age": 34.707703326000001, 2023-08-01T19:55:39.909 INFO:teuthology.orchestra.run.smithi008.stdout: "duration": 0.063919403, 2023-08-01T19:55:39.909 INFO:teuthology.orchestra.run.smithi008.stdout: "type_data": { 2023-08-01T19:55:39.909 INFO:teuthology.orchestra.run.smithi008.stdout: "flag_point": "commit sent; apply or cleanup", 2023-08-01T19:55:39.910 INFO:teuthology.orchestra.run.smithi008.stdout: "client_info": { 2023-08-01T19:55:39.910 INFO:teuthology.orchestra.run.smithi008.stdout: "client": "client.4668", 2023-08-01T19:55:39.910 INFO:teuthology.orchestra.run.smithi008.stdout: "client_addr": "172.21.15.6:0/1709472247", 2023-08-01T19:55:39.910 INFO:teuthology.orchestra.run.smithi008.stdout: "tid": 100262 2023-08-01T19:55:39.910 INFO:teuthology.orchestra.run.smithi008.stdout: }, 2023-08-01T19:55:39.910 INFO:teuthology.orchestra.run.smithi008.stdout: "events": [ 2023-08-01T19:55:39.910 INFO:teuthology.orchestra.run.smithi008.stdout: { 2023-08-01T19:55:39.910 INFO:teuthology.orchestra.run.smithi008.stdout: "event": "initiated", 2023-08-01T19:55:39.911 INFO:teuthology.orchestra.run.smithi008.stdout: "time": "2023-08-01T19:55:05.165068+0000", 2023-08-01T19:55:39.911 INFO:teuthology.orchestra.run.smithi008.stdout: "duration": 0 2023-08-01T19:55:39.911 INFO:teuthology.orchestra.run.smithi008.stdout: }, 2023-08-01T19:55:39.911 INFO:teuthology.orchestra.run.smithi008.stdout: { 2023-08-01T19:55:39.911 INFO:teuthology.orchestra.run.smithi008.stdout: "event": "throttled", 2023-08-01T19:55:39.911 INFO:teuthology.orchestra.run.smithi008.stdout: "time": "2023-08-01T19:55:05.165068+0000", 2023-08-01T19:55:39.911 INFO:teuthology.orchestra.run.smithi008.stdout: "duration": 0 2023-08-01T19:55:39.912 INFO:teuthology.orchestra.run.smithi008.stdout: }, 2023-08-01T19:55:39.912 INFO:teuthology.orchestra.run.smithi008.stdout: { 2023-08-01T19:55:39.912 INFO:teuthology.orchestra.run.smithi008.stdout: "event": "header_read", 2023-08-01T19:55:39.912 INFO:teuthology.orchestra.run.smithi008.stdout: "time": "2023-08-01T19:55:05.165067+0000", 2023-08-01T19:55:39.912 INFO:teuthology.orchestra.run.smithi008.stdout: "duration": 4294967295.999999 2023-08-01T19:55:39.912 INFO:teuthology.orchestra.run.smithi008.stdout: }, 2023-08-01T19:55:39.912 INFO:teuthology.orchestra.run.smithi008.stdout: { 2023-08-01T19:55:39.912 INFO:teuthology.orchestra.run.smithi008.stdout: "event": "all_read", 2023-08-01T19:55:39.913 INFO:teuthology.orchestra.run.smithi008.stdout: "time": "2023-08-01T19:55:05.165126+0000", 2023-08-01T19:55:39.913 INFO:teuthology.orchestra.run.smithi008.stdout: "duration": 5.9116000000000001e-05 2023-08-01T19:55:39.913 INFO:teuthology.orchestra.run.smithi008.stdout: }, 2023-08-01T19:55:39.913 INFO:teuthology.orchestra.run.smithi008.stdout: { 2023-08-01T19:55:39.913 INFO:teuthology.orchestra.run.smithi008.stdout: "event": "dispatched", 2023-08-01T19:55:39.913 INFO:teuthology.orchestra.run.smithi008.stdout: "time": "2023-08-01T19:55:05.165134+0000", 2023-08-01T19:55:39.913 INFO:teuthology.orchestra.run.smithi008.stdout: "duration": 7.9820000000000008e-06 2023-08-01T19:55:39.913 INFO:teuthology.orchestra.run.smithi008.stdout: }, 2023-08-01T19:55:39.914 INFO:teuthology.orchestra.run.smithi008.stdout: { 2023-08-01T19:55:39.914 INFO:teuthology.orchestra.run.smithi008.stdout: "event": "queued_for_pg", 2023-08-01T19:55:39.914 INFO:teuthology.orchestra.run.smithi008.stdout: "time": "2023-08-01T19:55:05.165139+0000", 2023-08-01T19:55:39.914 INFO:teuthology.orchestra.run.smithi008.stdout: "duration": 4.2560000000000004e-06 2023-08-01T19:55:39.914 INFO:teuthology.orchestra.run.smithi008.stdout: }, 2023-08-01T19:55:39.914 INFO:teuthology.orchestra.run.smithi008.stdout: { 2023-08-01T19:55:39.914 INFO:teuthology.orchestra.run.smithi008.stdout: "event": "reached_pg", 2023-08-01T19:55:39.914 INFO:teuthology.orchestra.run.smithi008.stdout: "time": "2023-08-01T19:55:05.165165+0000", 2023-08-01T19:55:39.915 INFO:teuthology.orchestra.run.smithi008.stdout: "duration": 2.6554e-05 2023-08-01T19:55:39.915 INFO:teuthology.orchestra.run.smithi008.stdout: }, 2023-08-01T19:55:39.915 INFO:teuthology.orchestra.run.smithi008.stdout: { 2023-08-01T19:55:39.915 INFO:teuthology.orchestra.run.smithi008.stdout: "event": "started", 2023-08-01T19:55:39.915 INFO:teuthology.orchestra.run.smithi008.stdout: "time": "2023-08-01T19:55:05.165243+0000", 2023-08-01T19:55:39.915 INFO:teuthology.orchestra.run.smithi008.stdout: "duration": 7.7877e-05 2023-08-01T19:55:39.915 INFO:teuthology.orchestra.run.smithi008.stdout: }, 2023-08-01T19:55:39.915 INFO:teuthology.orchestra.run.smithi008.stdout: { 2023-08-01T19:55:39.916 INFO:teuthology.orchestra.run.smithi008.stdout: "event": "waiting for subops from 2", 2023-08-01T19:55:39.916 INFO:teuthology.orchestra.run.smithi008.stdout: "time": "2023-08-01T19:55:05.165450+0000", 2023-08-01T19:55:39.916 INFO:teuthology.orchestra.run.smithi008.stdout: "duration": 0.00020655599999999999 2023-08-01T19:55:39.916 INFO:teuthology.orchestra.run.smithi008.stdout: }, 2023-08-01T19:55:39.916 INFO:teuthology.orchestra.run.smithi008.stdout: { 2023-08-01T19:55:39.916 INFO:teuthology.orchestra.run.smithi008.stdout: "event": "op_commit", 2023-08-01T19:55:39.916 INFO:teuthology.orchestra.run.smithi008.stdout: "time": "2023-08-01T19:55:05.168883+0000", 2023-08-01T19:55:39.917 INFO:teuthology.orchestra.run.smithi008.stdout: "duration": 0.0034333279999999998 2023-08-01T19:55:39.917 INFO:teuthology.orchestra.run.smithi008.stdout: }, 2023-08-01T19:55:39.917 INFO:teuthology.orchestra.run.smithi008.stdout: { 2023-08-01T19:55:39.917 INFO:teuthology.orchestra.run.smithi008.stdout: "event": "sub_op_commit_rec", 2023-08-01T19:55:39.917 INFO:teuthology.orchestra.run.smithi008.stdout: "time": "2023-08-01T19:55:05.228904+0000", 2023-08-01T19:55:39.917 INFO:teuthology.orchestra.run.smithi008.stdout: "duration": 0.060021370999999997 2023-08-01T19:55:39.917 INFO:teuthology.orchestra.run.smithi008.stdout: }, 2023-08-01T19:55:39.917 INFO:teuthology.orchestra.run.smithi008.stdout: { 2023-08-01T19:55:39.918 INFO:teuthology.orchestra.run.smithi008.stdout: "event": "commit_sent", 2023-08-01T19:55:39.918 INFO:teuthology.orchestra.run.smithi008.stdout: "time": "2023-08-01T19:55:05.228952+0000", 2023-08-01T19:55:39.918 INFO:teuthology.orchestra.run.smithi008.stdout: "duration": 4.8056999999999997e-05 2023-08-01T19:55:39.918 INFO:teuthology.orchestra.run.smithi008.stdout: }, 2023-08-01T19:55:39.918 INFO:teuthology.orchestra.run.smithi008.stdout: { 2023-08-01T19:55:39.918 INFO:teuthology.orchestra.run.smithi008.stdout: "event": "done", 2023-08-01T19:55:39.918 INFO:teuthology.orchestra.run.smithi008.stdout: "time": "2023-08-01T19:55:05.228987+0000", 2023-08-01T19:55:39.918 INFO:teuthology.orchestra.run.smithi008.stdout: "duration": 3.5083000000000003e-05 2023-08-01T19:55:39.919 INFO:teuthology.orchestra.run.smithi008.stdout: } 2023-08-01T19:55:39.919 INFO:teuthology.orchestra.run.smithi008.stdout: ] 2023-08-01T19:55:39.919 INFO:teuthology.orchestra.run.smithi008.stdout: } 2023-08-01T19:55:39.919 INFO:teuthology.orchestra.run.smithi008.stdout: }, 2023-08-01T19:55:39.919 INFO:teuthology.orchestra.run.smithi008.stdout: { 2023-08-01T19:55:39.919 INFO:teuthology.orchestra.run.smithi008.stdout: "description": "osd_op(client.4668.0:100929 5.3 5:c29f4adb:::benchmark_data_smithi006_114134_object100928:head [set-alloc-hint object_size 65536 write_size 65536,write 0~65536] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e37)", 2023-08-01T19:55:39.919 INFO:teuthology.orchestra.run.smithi008.stdout: "initiated_at": "2023-08-01T19:55:05.564759+0000", 2023-08-01T19:55:39.919 INFO:teuthology.orchestra.run.smithi008.stdout: "age": 34.308012687000002, 2023-08-01T19:55:39.920 INFO:teuthology.orchestra.run.smithi008.stdout: "duration": 0.062544635000000001, 2023-08-01T19:55:39.920 INFO:teuthology.orchestra.run.smithi008.stdout: "type_data": { 2023-08-01T19:55:39.920 INFO:teuthology.orchestra.run.smithi008.stdout: "flag_point": "commit sent; apply or cleanup", 2023-08-01T19:55:39.920 INFO:teuthology.orchestra.run.smithi008.stdout: "client_info": { 2023-08-01T19:55:39.920 INFO:teuthology.orchestra.run.smithi008.stdout: "client": "client.4668", 2023-08-01T19:55:39.920 INFO:teuthology.orchestra.run.smithi008.stdout: "client_addr": "172.21.15.6:0/1709472247", 2023-08-01T19:55:39.920 INFO:teuthology.orchestra.run.smithi008.stdout: "tid": 100929 2023-08-01T19:55:39.920 INFO:teuthology.orchestra.run.smithi008.stdout: }, 2023-08-01T19:55:39.921 INFO:teuthology.orchestra.run.smithi008.stdout: "events": [ 2023-08-01T19:55:39.921 INFO:teuthology.orchestra.run.smithi008.stdout: { 2023-08-01T19:55:39.921 INFO:teuthology.orchestra.run.smithi008.stdout: "event": "initiated", 2023-08-01T19:55:39.921 INFO:teuthology.orchestra.run.smithi008.stdout: "time": "2023-08-01T19:55:05.564759+0000", 2023-08-01T19:55:39.921 INFO:teuthology.orchestra.run.smithi008.stdout: "duration": 0 2023-08-01T19:55:39.921 INFO:teuthology.orchestra.run.smithi008.stdout: }, 2023-08-01T19:55:39.921 INFO:teuthology.orchestra.run.smithi008.stdout: { 2023-08-01T19:55:39.922 INFO:teuthology.orchestra.run.smithi008.stdout: "event": "throttled", 2023-08-01T19:55:39.922 INFO:teuthology.orchestra.run.smithi008.stdout: "time": "2023-08-01T19:55:05.564759+0000", 2023-08-01T19:55:39.922 INFO:teuthology.orchestra.run.smithi008.stdout: "duration": 0 2023-08-01T19:55:39.922 INFO:teuthology.orchestra.run.smithi008.stdout: }, 2023-08-01T19:55:39.922 INFO:teuthology.orchestra.run.smithi008.stdout: { 2023-08-01T19:55:39.922 INFO:teuthology.orchestra.run.smithi008.stdout: "event": "header_read", 2023-08-01T19:55:39.922 INFO:teuthology.orchestra.run.smithi008.stdout: "time": "2023-08-01T19:55:05.564758+0000", 2023-08-01T19:55:39.922 INFO:teuthology.orchestra.run.smithi008.stdout: "duration": 4294967295.999999 2023-08-01T19:55:39.923 INFO:teuthology.orchestra.run.smithi008.stdout: }, 2023-08-01T19:55:39.923 INFO:teuthology.orchestra.run.smithi008.stdout: { 2023-08-01T19:55:39.923 INFO:teuthology.orchestra.run.smithi008.stdout: "event": "all_read", 2023-08-01T19:55:39.923 INFO:teuthology.orchestra.run.smithi008.stdout: "time": "2023-08-01T19:55:05.564815+0000", 2023-08-01T19:55:39.923 INFO:teuthology.orchestra.run.smithi008.stdout: "duration": 5.7757000000000003e-05 2023-08-01T19:55:39.923 INFO:teuthology.orchestra.run.smithi008.stdout: }, 2023-08-01T19:55:39.923 INFO:teuthology.orchestra.run.smithi008.stdout: { 2023-08-01T19:55:39.923 INFO:teuthology.orchestra.run.smithi008.stdout: "event": "dispatched", 2023-08-01T19:55:39.924 INFO:teuthology.orchestra.run.smithi008.stdout: "time": "2023-08-01T19:55:05.564824+0000", 2023-08-01T19:55:39.924 INFO:teuthology.orchestra.run.smithi008.stdout: "duration": 8.6559999999999998e-06 2023-08-01T19:55:39.924 INFO:teuthology.orchestra.run.smithi008.stdout: }, 2023-08-01T19:55:39.924 INFO:teuthology.orchestra.run.smithi008.stdout: { 2023-08-01T19:55:39.924 INFO:teuthology.orchestra.run.smithi008.stdout: "event": "queued_for_pg", 2023-08-01T19:55:39.924 INFO:teuthology.orchestra.run.smithi008.stdout: "time": "2023-08-01T19:55:05.564829+0000", 2023-08-01T19:55:39.924 INFO:teuthology.orchestra.run.smithi008.stdout: "duration": 4.6160000000000004e-06 2023-08-01T19:55:39.924 INFO:teuthology.orchestra.run.smithi008.stdout: }, 2023-08-01T19:55:39.925 INFO:teuthology.orchestra.run.smithi008.stdout: { 2023-08-01T19:55:39.925 INFO:teuthology.orchestra.run.smithi008.stdout: "event": "reached_pg", 2023-08-01T19:55:39.925 INFO:teuthology.orchestra.run.smithi008.stdout: "time": "2023-08-01T19:55:05.564871+0000", 2023-08-01T19:55:39.925 INFO:teuthology.orchestra.run.smithi008.stdout: "duration": 4.2206000000000002e-05 2023-08-01T19:55:39.925 INFO:teuthology.orchestra.run.smithi008.stdout: }, 2023-08-01T19:55:39.925 INFO:teuthology.orchestra.run.smithi008.stdout: { 2023-08-01T19:55:39.925 INFO:teuthology.orchestra.run.smithi008.stdout: "event": "started", 2023-08-01T19:55:39.925 INFO:teuthology.orchestra.run.smithi008.stdout: "time": "2023-08-01T19:55:05.565011+0000", 2023-08-01T19:55:39.926 INFO:teuthology.orchestra.run.smithi008.stdout: "duration": 0.000140469 2023-08-01T19:55:39.926 INFO:teuthology.orchestra.run.smithi008.stdout: }, 2023-08-01T19:55:39.926 INFO:teuthology.orchestra.run.smithi008.stdout: { 2023-08-01T19:55:39.926 INFO:teuthology.orchestra.run.smithi008.stdout: "event": "waiting for subops from 1", 2023-08-01T19:55:39.926 INFO:teuthology.orchestra.run.smithi008.stdout: "time": "2023-08-01T19:55:05.565212+0000", 2023-08-01T19:55:39.926 INFO:teuthology.orchestra.run.smithi008.stdout: "duration": 0.00020106599999999999 2023-08-01T19:55:39.926 INFO:teuthology.orchestra.run.smithi008.stdout: }, 2023-08-01T19:55:39.927 INFO:teuthology.orchestra.run.smithi008.stdout: { 2023-08-01T19:55:39.927 INFO:teuthology.orchestra.run.smithi008.stdout: "event": "sub_op_commit_rec", 2023-08-01T19:55:39.927 INFO:teuthology.orchestra.run.smithi008.stdout: "time": "2023-08-01T19:55:05.626925+0000", 2023-08-01T19:55:39.927 INFO:teuthology.orchestra.run.smithi008.stdout: "duration": 0.061712111 2023-08-01T19:55:39.927 INFO:teuthology.orchestra.run.smithi008.stdout: }, 2023-08-01T19:55:39.927 INFO:teuthology.orchestra.run.smithi008.stdout: { 2023-08-01T19:55:39.927 INFO:teuthology.orchestra.run.smithi008.stdout: "event": "op_commit", 2023-08-01T19:55:39.927 INFO:teuthology.orchestra.run.smithi008.stdout: "time": "2023-08-01T19:55:05.627217+0000", 2023-08-01T19:55:39.928 INFO:teuthology.orchestra.run.smithi008.stdout: "duration": 0.00029265999999999998 2023-08-01T19:55:39.928 INFO:teuthology.orchestra.run.smithi008.stdout: }, 2023-08-01T19:55:39.928 INFO:teuthology.orchestra.run.smithi008.stdout: { 2023-08-01T19:55:39.928 INFO:teuthology.orchestra.run.smithi008.stdout: "event": "commit_sent", 2023-08-01T19:55:39.928 INFO:teuthology.orchestra.run.smithi008.stdout: "time": "2023-08-01T19:55:05.627264+0000", 2023-08-01T19:55:39.928 INFO:teuthology.orchestra.run.smithi008.stdout: "duration": 4.6260000000000001e-05 2023-08-01T19:55:39.928 INFO:teuthology.orchestra.run.smithi008.stdout: }, 2023-08-01T19:55:39.928 INFO:teuthology.orchestra.run.smithi008.stdout: { 2023-08-01T19:55:39.929 INFO:teuthology.orchestra.run.smithi008.stdout: "event": "done", 2023-08-01T19:55:39.929 INFO:teuthology.orchestra.run.smithi008.stdout: "time": "2023-08-01T19:55:05.627303+0000", 2023-08-01T19:55:39.929 INFO:teuthology.orchestra.run.smithi008.stdout: "duration": 3.9839999999999998e-05 2023-08-01T19:55:39.929 INFO:teuthology.orchestra.run.smithi008.stdout: } 2023-08-01T19:55:39.929 INFO:teuthology.orchestra.run.smithi008.stdout: ] 2023-08-01T19:55:39.929 INFO:teuthology.orchestra.run.smithi008.stdout: } 2023-08-01T19:55:39.929 INFO:teuthology.orchestra.run.smithi008.stdout: }, 2023-08-01T19:55:39.929 INFO:teuthology.orchestra.run.smithi008.stdout: { 2023-08-01T19:55:39.930 INFO:teuthology.orchestra.run.smithi008.stdout: "description": "osd_repop(client.4668.0:100928 5.7 e37/19 5:e61a7dfa:::benchmark_data_smithi006_114134_object100927:head v 37'6273, mlcod=37'6270)", 2023-08-01T19:55:39.930 INFO:teuthology.orchestra.run.smithi008.stdout: "initiated_at": "2023-08-01T19:55:05.565106+0000", 2023-08-01T19:55:39.930 INFO:teuthology.orchestra.run.smithi008.stdout: "age": 34.307665589000003, 2023-08-01T19:55:39.930 INFO:teuthology.orchestra.run.smithi008.stdout: "duration": 0.064091282999999999, 2023-08-01T19:55:39.930 INFO:teuthology.orchestra.run.smithi008.stdout: "type_data": { 2023-08-01T19:55:39.930 INFO:teuthology.orchestra.run.smithi008.stdout: "flag_point": "commit sent; apply or cleanup", 2023-08-01T19:55:39.930 INFO:teuthology.orchestra.run.smithi008.stdout: "events": [ 2023-08-01T19:55:39.931 INFO:teuthology.orchestra.run.smithi008.stdout: { 2023-08-01T19:55:39.931 INFO:teuthology.orchestra.run.smithi008.stdout: "event": "initiated", 2023-08-01T19:55:39.931 INFO:teuthology.orchestra.run.smithi008.stdout: "time": "2023-08-01T19:55:05.565106+0000", 2023-08-01T19:55:39.931 INFO:teuthology.orchestra.run.smithi008.stdout: "duration": 0 2023-08-01T19:55:39.931 INFO:teuthology.orchestra.run.smithi008.stdout: }, 2023-08-01T19:55:39.931 INFO:teuthology.orchestra.run.smithi008.stdout: { 2023-08-01T19:55:39.931 INFO:teuthology.orchestra.run.smithi008.stdout: "event": "throttled", 2023-08-01T19:55:39.931 INFO:teuthology.orchestra.run.smithi008.stdout: "time": "2023-08-01T19:55:05.565106+0000", 2023-08-01T19:55:39.932 INFO:teuthology.orchestra.run.smithi008.stdout: "duration": 0 2023-08-01T19:55:39.932 INFO:teuthology.orchestra.run.smithi008.stdout: }, 2023-08-01T19:55:39.932 INFO:teuthology.orchestra.run.smithi008.stdout: { 2023-08-01T19:55:39.932 INFO:teuthology.orchestra.run.smithi008.stdout: "event": "header_read", 2023-08-01T19:55:39.932 INFO:teuthology.orchestra.run.smithi008.stdout: "time": "2023-08-01T19:55:05.565105+0000", 2023-08-01T19:55:39.932 INFO:teuthology.orchestra.run.smithi008.stdout: "duration": 4294967295.9999995 2023-08-01T19:55:39.932 INFO:teuthology.orchestra.run.smithi008.stdout: }, 2023-08-01T19:55:39.932 INFO:teuthology.orchestra.run.smithi008.stdout: { 2023-08-01T19:55:39.933 INFO:teuthology.orchestra.run.smithi008.stdout: "event": "all_read", 2023-08-01T19:55:39.933 INFO:teuthology.orchestra.run.smithi008.stdout: "time": "2023-08-01T19:55:05.565173+0000", 2023-08-01T19:55:39.933 INFO:teuthology.orchestra.run.smithi008.stdout: "duration": 6.8186000000000001e-05 2023-08-01T19:55:39.933 INFO:teuthology.orchestra.run.smithi008.stdout: }, 2023-08-01T19:55:39.933 INFO:teuthology.orchestra.run.smithi008.stdout: { 2023-08-01T19:55:39.933 INFO:teuthology.orchestra.run.smithi008.stdout: "event": "dispatched", 2023-08-01T19:55:39.933 INFO:teuthology.orchestra.run.smithi008.stdout: "time": "2023-08-01T19:55:05.565182+0000", 2023-08-01T19:55:39.933 INFO:teuthology.orchestra.run.smithi008.stdout: "duration": 8.3620000000000006e-06 2023-08-01T19:55:39.934 INFO:teuthology.orchestra.run.smithi008.stdout: }, 2023-08-01T19:55:39.934 INFO:teuthology.orchestra.run.smithi008.stdout: { 2023-08-01T19:55:39.934 INFO:teuthology.orchestra.run.smithi008.stdout: "event": "queued_for_pg", 2023-08-01T19:55:39.934 INFO:teuthology.orchestra.run.smithi008.stdout: "time": "2023-08-01T19:55:05.565186+0000", 2023-08-01T19:55:39.934 INFO:teuthology.orchestra.run.smithi008.stdout: "duration": 3.7680000000000002e-06 2023-08-01T19:55:39.934 INFO:teuthology.orchestra.run.smithi008.stdout: }, 2023-08-01T19:55:39.934 INFO:teuthology.orchestra.run.smithi008.stdout: { 2023-08-01T19:55:39.935 INFO:teuthology.orchestra.run.smithi008.stdout: "event": "reached_pg", 2023-08-01T19:55:39.935 INFO:teuthology.orchestra.run.smithi008.stdout: "time": "2023-08-01T19:55:05.565212+0000", 2023-08-01T19:55:39.935 INFO:teuthology.orchestra.run.smithi008.stdout: "duration": 2.6230000000000001e-05 2023-08-01T19:55:39.935 INFO:teuthology.orchestra.run.smithi008.stdout: }, 2023-08-01T19:55:39.935 INFO:teuthology.orchestra.run.smithi008.stdout: { 2023-08-01T19:55:39.935 INFO:teuthology.orchestra.run.smithi008.stdout: "event": "started", 2023-08-01T19:55:39.935 INFO:teuthology.orchestra.run.smithi008.stdout: "time": "2023-08-01T19:55:05.565224+0000", 2023-08-01T19:55:39.935 INFO:teuthology.orchestra.run.smithi008.stdout: "duration": 1.2033e-05 2023-08-01T19:55:39.936 INFO:teuthology.orchestra.run.smithi008.stdout: }, 2023-08-01T19:55:39.936 INFO:teuthology.orchestra.run.smithi008.stdout: { 2023-08-01T19:55:39.936 INFO:teuthology.orchestra.run.smithi008.stdout: "event": "commit_sent", 2023-08-01T19:55:39.936 INFO:teuthology.orchestra.run.smithi008.stdout: "time": "2023-08-01T19:55:05.629152+0000", 2023-08-01T19:55:39.936 INFO:teuthology.orchestra.run.smithi008.stdout: "duration": 0.063928378999999994 2023-08-01T19:55:39.936 INFO:teuthology.orchestra.run.smithi008.stdout: }, 2023-08-01T19:55:39.936 INFO:teuthology.orchestra.run.smithi008.stdout: { 2023-08-01T19:55:39.936 INFO:teuthology.orchestra.run.smithi008.stdout: "event": "done", 2023-08-01T19:55:39.937 INFO:teuthology.orchestra.run.smithi008.stdout: "time": "2023-08-01T19:55:05.629197+0000", 2023-08-01T19:55:39.937 INFO:teuthology.orchestra.run.smithi008.stdout: "duration": 4.4894000000000001e-05 2023-08-01T19:55:39.937 INFO:teuthology.orchestra.run.smithi008.stdout: } 2023-08-01T19:55:39.937 INFO:teuthology.orchestra.run.smithi008.stdout: ] 2023-08-01T19:55:39.937 INFO:teuthology.orchestra.run.smithi008.stdout: } 2023-08-01T19:55:39.937 INFO:teuthology.orchestra.run.smithi008.stdout: }, 2023-08-01T19:55:39.937 INFO:teuthology.orchestra.run.smithi008.stdout: { 2023-08-01T19:55:39.937 INFO:teuthology.orchestra.run.smithi008.stdout: "description": "osd_repop(client.4668.0:100927 5.0 e37/19 5:00608ec6:::benchmark_data_smithi006_114134_object100926:head v 37'6408, mlcod=37'6403)", 2023-08-01T19:55:39.938 INFO:teuthology.orchestra.run.smithi008.stdout: "initiated_at": "2023-08-01T19:55:05.565153+0000", 2023-08-01T19:55:39.938 INFO:teuthology.orchestra.run.smithi008.stdout: "age": 34.307618851999997, 2023-08-01T19:55:39.938 INFO:teuthology.orchestra.run.smithi008.stdout: "duration": 0.062202714999999999, 2023-08-01T19:55:39.938 INFO:teuthology.orchestra.run.smithi008.stdout: "type_data": { 2023-08-01T19:55:39.938 INFO:teuthology.orchestra.run.smithi008.stdout: "flag_point": "commit sent; apply or cleanup", 2023-08-01T19:55:39.938 INFO:teuthology.orchestra.run.smithi008.stdout: "events": [ 2023-08-01T19:55:39.938 INFO:teuthology.orchestra.run.smithi008.stdout: { 2023-08-01T19:55:39.938 INFO:teuthology.orchestra.run.smithi008.stdout: "event": "initiated", 2023-08-01T19:55:39.939 INFO:teuthology.orchestra.run.smithi008.stdout: "time": "2023-08-01T19:55:05.565153+0000", 2023-08-01T19:55:39.939 INFO:teuthology.orchestra.run.smithi008.stdout: "duration": 0 2023-08-01T19:55:39.939 INFO:teuthology.orchestra.run.smithi008.stdout: }, 2023-08-01T19:55:39.939 INFO:teuthology.orchestra.run.smithi008.stdout: { 2023-08-01T19:55:39.939 INFO:teuthology.orchestra.run.smithi008.stdout: "event": "throttled", 2023-08-01T19:55:39.939 INFO:teuthology.orchestra.run.smithi008.stdout: "time": "2023-08-01T19:55:05.565153+0000", 2023-08-01T19:55:39.939 INFO:teuthology.orchestra.run.smithi008.stdout: "duration": 0 2023-08-01T19:55:39.939 INFO:teuthology.orchestra.run.smithi008.stdout: }, 2023-08-01T19:55:39.940 INFO:teuthology.orchestra.run.smithi008.stdout: { 2023-08-01T19:55:39.940 INFO:teuthology.orchestra.run.smithi008.stdout: "event": "header_read", 2023-08-01T19:55:39.940 INFO:teuthology.orchestra.run.smithi008.stdout: "time": "2023-08-01T19:55:05.565152+0000", 2023-08-01T19:55:39.940 INFO:teuthology.orchestra.run.smithi008.stdout: "duration": 4294967295.9999995 2023-08-01T19:55:39.940 INFO:teuthology.orchestra.run.smithi008.stdout: }, 2023-08-01T19:55:39.940 INFO:teuthology.orchestra.run.smithi008.stdout: { 2023-08-01T19:55:39.940 INFO:teuthology.orchestra.run.smithi008.stdout: "event": "all_read", 2023-08-01T19:55:39.941 INFO:teuthology.orchestra.run.smithi008.stdout: "time": "2023-08-01T19:55:05.565225+0000", 2023-08-01T19:55:39.941 INFO:teuthology.orchestra.run.smithi008.stdout: "duration": 7.2471000000000005e-05 2023-08-01T19:55:39.941 INFO:teuthology.orchestra.run.smithi008.stdout: }, 2023-08-01T19:55:39.941 INFO:teuthology.orchestra.run.smithi008.stdout: { 2023-08-01T19:55:39.941 INFO:teuthology.orchestra.run.smithi008.stdout: "event": "dispatched", 2023-08-01T19:55:39.941 INFO:teuthology.orchestra.run.smithi008.stdout: "time": "2023-08-01T19:55:05.565229+0000", 2023-08-01T19:55:39.941 INFO:teuthology.orchestra.run.smithi008.stdout: "duration": 4.5600000000000004e-06 2023-08-01T19:55:39.941 INFO:teuthology.orchestra.run.smithi008.stdout: }, 2023-08-01T19:55:39.942 INFO:teuthology.orchestra.run.smithi008.stdout: { 2023-08-01T19:55:39.942 INFO:teuthology.orchestra.run.smithi008.stdout: "event": "queued_for_pg", 2023-08-01T19:55:39.942 INFO:teuthology.orchestra.run.smithi008.stdout: "time": "2023-08-01T19:55:05.565232+0000", 2023-08-01T19:55:39.942 INFO:teuthology.orchestra.run.smithi008.stdout: "duration": 2.6900000000000001e-06 2023-08-01T19:55:39.942 INFO:teuthology.orchestra.run.smithi008.stdout: }, 2023-08-01T19:55:39.942 INFO:teuthology.orchestra.run.smithi008.stdout: { 2023-08-01T19:55:39.942 INFO:teuthology.orchestra.run.smithi008.stdout: "event": "reached_pg", 2023-08-01T19:55:39.942 INFO:teuthology.orchestra.run.smithi008.stdout: "time": "2023-08-01T19:55:05.565283+0000", 2023-08-01T19:55:39.943 INFO:teuthology.orchestra.run.smithi008.stdout: "duration": 5.1442e-05 2023-08-01T19:55:39.943 INFO:teuthology.orchestra.run.smithi008.stdout: }, 2023-08-01T19:55:39.943 INFO:teuthology.orchestra.run.smithi008.stdout: { 2023-08-01T19:55:39.943 INFO:teuthology.orchestra.run.smithi008.stdout: "event": "started", 2023-08-01T19:55:39.943 INFO:teuthology.orchestra.run.smithi008.stdout: "time": "2023-08-01T19:55:05.565301+0000", 2023-08-01T19:55:39.943 INFO:teuthology.orchestra.run.smithi008.stdout: "duration": 1.8029e-05 2023-08-01T19:55:39.943 INFO:teuthology.orchestra.run.smithi008.stdout: }, 2023-08-01T19:55:39.943 INFO:teuthology.orchestra.run.smithi008.stdout: { 2023-08-01T19:55:39.944 INFO:teuthology.orchestra.run.smithi008.stdout: "event": "commit_sent", 2023-08-01T19:55:39.944 INFO:teuthology.orchestra.run.smithi008.stdout: "time": "2023-08-01T19:55:05.627318+0000", 2023-08-01T19:55:39.944 INFO:teuthology.orchestra.run.smithi008.stdout: "duration": 0.062016763000000003 2023-08-01T19:55:39.944 INFO:teuthology.orchestra.run.smithi008.stdout: }, 2023-08-01T19:55:39.944 INFO:teuthology.orchestra.run.smithi008.stdout: { 2023-08-01T19:55:39.944 INFO:teuthology.orchestra.run.smithi008.stdout: "event": "done", 2023-08-01T19:55:39.944 INFO:teuthology.orchestra.run.smithi008.stdout: "time": "2023-08-01T19:55:05.627355+0000", 2023-08-01T19:55:39.945 INFO:teuthology.orchestra.run.smithi008.stdout: "duration": 3.7258999999999997e-05 2023-08-01T19:55:39.945 INFO:teuthology.orchestra.run.smithi008.stdout: } 2023-08-01T19:55:39.945 INFO:teuthology.orchestra.run.smithi008.stdout: ] 2023-08-01T19:55:39.945 INFO:teuthology.orchestra.run.smithi008.stdout: } 2023-08-01T19:55:39.945 INFO:teuthology.orchestra.run.smithi008.stdout: }, 2023-08-01T19:55:39.945 INFO:teuthology.orchestra.run.smithi008.stdout: { 2023-08-01T19:55:39.945 INFO:teuthology.orchestra.run.smithi008.stdout: "description": "osd_op(client.4668.0:100930 5.5 5:a7b64eb3:::benchmark_data_smithi006_114134_object100929:head [set-alloc-hint object_size 65536 write_size 65536,write 0~65536] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e37)", 2023-08-01T19:55:39.945 INFO:teuthology.orchestra.run.smithi008.stdout: "initiated_at": "2023-08-01T19:55:05.565766+0000", 2023-08-01T19:55:39.946 INFO:teuthology.orchestra.run.smithi008.stdout: "age": 34.307005066999999, 2023-08-01T19:55:39.946 INFO:teuthology.orchestra.run.smithi008.stdout: "duration": 0.063668735000000004, 2023-08-01T19:55:39.946 INFO:teuthology.orchestra.run.smithi008.stdout: "type_data": { 2023-08-01T19:55:39.946 INFO:teuthology.orchestra.run.smithi008.stdout: "flag_point": "commit sent; apply or cleanup", 2023-08-01T19:55:39.946 INFO:teuthology.orchestra.run.smithi008.stdout: "client_info": { 2023-08-01T19:55:39.946 INFO:teuthology.orchestra.run.smithi008.stdout: "client": "client.4668", 2023-08-01T19:55:39.946 INFO:teuthology.orchestra.run.smithi008.stdout: "client_addr": "172.21.15.6:0/1709472247", 2023-08-01T19:55:39.946 INFO:teuthology.orchestra.run.smithi008.stdout: "tid": 100930 2023-08-01T19:55:39.947 INFO:teuthology.orchestra.run.smithi008.stdout: }, 2023-08-01T19:55:39.947 INFO:teuthology.orchestra.run.smithi008.stdout: "events": [ 2023-08-01T19:55:39.947 INFO:teuthology.orchestra.run.smithi008.stdout: { 2023-08-01T19:55:39.947 INFO:teuthology.orchestra.run.smithi008.stdout: "event": "initiated", 2023-08-01T19:55:39.947 INFO:teuthology.orchestra.run.smithi008.stdout: "time": "2023-08-01T19:55:05.565766+0000", 2023-08-01T19:55:39.947 INFO:teuthology.orchestra.run.smithi008.stdout: "duration": 0 2023-08-01T19:55:39.947 INFO:teuthology.orchestra.run.smithi008.stdout: }, 2023-08-01T19:55:39.947 INFO:teuthology.orchestra.run.smithi008.stdout: { 2023-08-01T19:55:39.948 INFO:teuthology.orchestra.run.smithi008.stdout: "event": "throttled", 2023-08-01T19:55:39.948 INFO:teuthology.orchestra.run.smithi008.stdout: "time": "2023-08-01T19:55:05.565766+0000", 2023-08-01T19:55:39.948 INFO:teuthology.orchestra.run.smithi008.stdout: "duration": 0 2023-08-01T19:55:39.948 INFO:teuthology.orchestra.run.smithi008.stdout: }, 2023-08-01T19:55:39.948 INFO:teuthology.orchestra.run.smithi008.stdout: { 2023-08-01T19:55:39.948 INFO:teuthology.orchestra.run.smithi008.stdout: "event": "header_read", 2023-08-01T19:55:39.948 INFO:teuthology.orchestra.run.smithi008.stdout: "time": "2023-08-01T19:55:05.565766+0000", 2023-08-01T19:55:39.948 INFO:teuthology.orchestra.run.smithi008.stdout: "duration": 4294967295.999999 2023-08-01T19:55:39.949 INFO:teuthology.orchestra.run.smithi008.stdout: }, 2023-08-01T19:55:39.949 INFO:teuthology.orchestra.run.smithi008.stdout: { 2023-08-01T19:55:39.949 INFO:teuthology.orchestra.run.smithi008.stdout: "event": "all_read", 2023-08-01T19:55:39.949 INFO:teuthology.orchestra.run.smithi008.stdout: "time": "2023-08-01T19:55:05.565855+0000", 2023-08-01T19:55:39.949 INFO:teuthology.orchestra.run.smithi008.stdout: "duration": 8.9166999999999995e-05 2023-08-01T19:55:39.949 INFO:teuthology.orchestra.run.smithi008.stdout: }, 2023-08-01T19:55:39.949 INFO:teuthology.orchestra.run.smithi008.stdout: { 2023-08-01T19:55:39.949 INFO:teuthology.orchestra.run.smithi008.stdout: "event": "dispatched", 2023-08-01T19:55:39.950 INFO:teuthology.orchestra.run.smithi008.stdout: "time": "2023-08-01T19:55:05.565862+0000", 2023-08-01T19:55:39.950 INFO:teuthology.orchestra.run.smithi008.stdout: "duration": 7.4549999999999998e-06 2023-08-01T19:55:39.950 INFO:teuthology.orchestra.run.smithi008.stdout: }, 2023-08-01T19:55:39.950 INFO:teuthology.orchestra.run.smithi008.stdout: { 2023-08-01T19:55:39.950 INFO:teuthology.orchestra.run.smithi008.stdout: "event": "queued_for_pg", 2023-08-01T19:55:39.950 INFO:teuthology.orchestra.run.smithi008.stdout: "time": "2023-08-01T19:55:05.565866+0000", 2023-08-01T19:55:39.950 INFO:teuthology.orchestra.run.smithi008.stdout: "duration": 3.8060000000000001e-06 2023-08-01T19:55:39.951 INFO:teuthology.orchestra.run.smithi008.stdout: }, 2023-08-01T19:55:39.951 INFO:teuthology.orchestra.run.smithi008.stdout: { 2023-08-01T19:55:39.951 INFO:teuthology.orchestra.run.smithi008.stdout: "event": "reached_pg", 2023-08-01T19:55:39.951 INFO:teuthology.orchestra.run.smithi008.stdout: "time": "2023-08-01T19:55:05.565901+0000", 2023-08-01T19:55:39.951 INFO:teuthology.orchestra.run.smithi008.stdout: "duration": 3.5063e-05 2023-08-01T19:55:39.951 INFO:teuthology.orchestra.run.smithi008.stdout: }, 2023-08-01T19:55:39.951 INFO:teuthology.orchestra.run.smithi008.stdout: { 2023-08-01T19:55:39.951 INFO:teuthology.orchestra.run.smithi008.stdout: "event": "started", 2023-08-01T19:55:39.952 INFO:teuthology.orchestra.run.smithi008.stdout: "time": "2023-08-01T19:55:05.566016+0000", 2023-08-01T19:55:39.952 INFO:teuthology.orchestra.run.smithi008.stdout: "duration": 0.00011509400000000001 2023-08-01T19:55:39.952 INFO:teuthology.orchestra.run.smithi008.stdout: }, 2023-08-01T19:55:39.952 INFO:teuthology.orchestra.run.smithi008.stdout: { 2023-08-01T19:55:39.952 INFO:teuthology.orchestra.run.smithi008.stdout: "event": "waiting for subops from 1", 2023-08-01T19:55:39.952 INFO:teuthology.orchestra.run.smithi008.stdout: "time": "2023-08-01T19:55:05.566154+0000", 2023-08-01T19:55:39.952 INFO:teuthology.orchestra.run.smithi008.stdout: "duration": 0.000138052 2023-08-01T19:55:39.952 INFO:teuthology.orchestra.run.smithi008.stdout: }, 2023-08-01T19:55:39.953 INFO:teuthology.orchestra.run.smithi008.stdout: { 2023-08-01T19:55:39.953 INFO:teuthology.orchestra.run.smithi008.stdout: "event": "sub_op_commit_rec", 2023-08-01T19:55:39.953 INFO:teuthology.orchestra.run.smithi008.stdout: "time": "2023-08-01T19:55:05.629279+0000", 2023-08-01T19:55:39.953 INFO:teuthology.orchestra.run.smithi008.stdout: "duration": 0.063124531999999997 2023-08-01T19:55:39.953 INFO:teuthology.orchestra.run.smithi008.stdout: }, 2023-08-01T19:55:39.953 INFO:teuthology.orchestra.run.smithi008.stdout: { 2023-08-01T19:55:39.953 INFO:teuthology.orchestra.run.smithi008.stdout: "event": "op_commit", 2023-08-01T19:55:39.953 INFO:teuthology.orchestra.run.smithi008.stdout: "time": "2023-08-01T19:55:05.629333+0000", 2023-08-01T19:55:39.954 INFO:teuthology.orchestra.run.smithi008.stdout: "duration": 5.4694999999999997e-05 2023-08-01T19:55:39.954 INFO:teuthology.orchestra.run.smithi008.stdout: }, 2023-08-01T19:55:39.954 INFO:teuthology.orchestra.run.smithi008.stdout: { 2023-08-01T19:55:39.954 INFO:teuthology.orchestra.run.smithi008.stdout: "event": "commit_sent", 2023-08-01T19:55:39.954 INFO:teuthology.orchestra.run.smithi008.stdout: "time": "2023-08-01T19:55:05.629390+0000", 2023-08-01T19:55:39.954 INFO:teuthology.orchestra.run.smithi008.stdout: "duration": 5.6416000000000003e-05 2023-08-01T19:55:39.954 INFO:teuthology.orchestra.run.smithi008.stdout: }, 2023-08-01T19:55:39.954 INFO:teuthology.orchestra.run.smithi008.stdout: { 2023-08-01T19:55:39.955 INFO:teuthology.orchestra.run.smithi008.stdout: "event": "done", 2023-08-01T19:55:39.955 INFO:teuthology.orchestra.run.smithi008.stdout: "time": "2023-08-01T19:55:05.629435+0000", 2023-08-01T19:55:39.955 INFO:teuthology.orchestra.run.smithi008.stdout: "duration": 4.5170999999999998e-05 2023-08-01T19:55:39.955 INFO:teuthology.orchestra.run.smithi008.stdout: } 2023-08-01T19:55:39.955 INFO:teuthology.orchestra.run.smithi008.stdout: ] 2023-08-01T19:55:39.955 INFO:teuthology.orchestra.run.smithi008.stdout: } 2023-08-01T19:55:39.955 INFO:teuthology.orchestra.run.smithi008.stdout: }, 2023-08-01T19:55:39.955 INFO:teuthology.orchestra.run.smithi008.stdout: { 2023-08-01T19:55:39.956 INFO:teuthology.orchestra.run.smithi008.stdout: "description": "osd_op(client.4668.0:100933 5.5 5:af92e9f2:::benchmark_data_smithi006_114134_object100932:head [set-alloc-hint object_size 65536 write_size 65536,write 0~65536] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e37)", 2023-08-01T19:55:39.956 INFO:teuthology.orchestra.run.smithi008.stdout: "initiated_at": "2023-08-01T19:55:05.566634+0000", 2023-08-01T19:55:39.956 INFO:teuthology.orchestra.run.smithi008.stdout: "age": 34.306137524, 2023-08-01T19:55:39.956 INFO:teuthology.orchestra.run.smithi008.stdout: "duration": 0.065909364999999998, 2023-08-01T19:55:39.956 INFO:teuthology.orchestra.run.smithi008.stdout: "type_data": { 2023-08-01T19:55:39.956 INFO:teuthology.orchestra.run.smithi008.stdout: "flag_point": "commit sent; apply or cleanup", 2023-08-01T19:55:39.956 INFO:teuthology.orchestra.run.smithi008.stdout: "client_info": { 2023-08-01T19:55:39.957 INFO:teuthology.orchestra.run.smithi008.stdout: "client": "client.4668", 2023-08-01T19:55:39.957 INFO:teuthology.orchestra.run.smithi008.stdout: "client_addr": "172.21.15.6:0/1709472247", 2023-08-01T19:55:39.957 INFO:teuthology.orchestra.run.smithi008.stdout: "tid": 100933 2023-08-01T19:55:39.957 INFO:teuthology.orchestra.run.smithi008.stdout: }, 2023-08-01T19:55:39.957 INFO:teuthology.orchestra.run.smithi008.stdout: "events": [ 2023-08-01T19:55:39.957 INFO:teuthology.orchestra.run.smithi008.stdout: { 2023-08-01T19:55:39.957 INFO:teuthology.orchestra.run.smithi008.stdout: "event": "initiated", 2023-08-01T19:55:39.957 INFO:teuthology.orchestra.run.smithi008.stdout: "time": "2023-08-01T19:55:05.566634+0000", 2023-08-01T19:55:39.958 INFO:teuthology.orchestra.run.smithi008.stdout: "duration": 0 2023-08-01T19:55:39.958 INFO:teuthology.orchestra.run.smithi008.stdout: }, 2023-08-01T19:55:39.958 INFO:teuthology.orchestra.run.smithi008.stdout: { 2023-08-01T19:55:39.958 INFO:teuthology.orchestra.run.smithi008.stdout: "event": "throttled", 2023-08-01T19:55:39.958 INFO:teuthology.orchestra.run.smithi008.stdout: "time": "2023-08-01T19:55:05.566634+0000", 2023-08-01T19:55:39.958 INFO:teuthology.orchestra.run.smithi008.stdout: "duration": 0 2023-08-01T19:55:39.958 INFO:teuthology.orchestra.run.smithi008.stdout: }, 2023-08-01T19:55:39.958 INFO:teuthology.orchestra.run.smithi008.stdout: { 2023-08-01T19:55:39.959 INFO:teuthology.orchestra.run.smithi008.stdout: "event": "header_read", 2023-08-01T19:55:39.959 INFO:teuthology.orchestra.run.smithi008.stdout: "time": "2023-08-01T19:55:05.566630+0000", 2023-08-01T19:55:39.959 INFO:teuthology.orchestra.run.smithi008.stdout: "duration": 4294967295.9999962 2023-08-01T19:55:39.959 INFO:teuthology.orchestra.run.smithi008.stdout: }, 2023-08-01T19:55:39.959 INFO:teuthology.orchestra.run.smithi008.stdout: { 2023-08-01T19:55:39.959 INFO:teuthology.orchestra.run.smithi008.stdout: "event": "all_read", 2023-08-01T19:55:39.959 INFO:teuthology.orchestra.run.smithi008.stdout: "time": "2023-08-01T19:55:05.566736+0000", 2023-08-01T19:55:39.959 INFO:teuthology.orchestra.run.smithi008.stdout: "duration": 0.000105752 2023-08-01T19:55:39.960 INFO:teuthology.orchestra.run.smithi008.stdout: }, 2023-08-01T19:55:39.960 INFO:teuthology.orchestra.run.smithi008.stdout: { 2023-08-01T19:55:39.960 INFO:teuthology.orchestra.run.smithi008.stdout: "event": "dispatched", 2023-08-01T19:55:39.960 INFO:teuthology.orchestra.run.smithi008.stdout: "time": "2023-08-01T19:55:05.566742+0000", 2023-08-01T19:55:39.960 INFO:teuthology.orchestra.run.smithi008.stdout: "duration": 5.8209999999999998e-06 2023-08-01T19:55:39.960 INFO:teuthology.orchestra.run.smithi008.stdout: }, 2023-08-01T19:55:39.960 INFO:teuthology.orchestra.run.smithi008.stdout: { 2023-08-01T19:55:39.961 INFO:teuthology.orchestra.run.smithi008.stdout: "event": "queued_for_pg", 2023-08-01T19:55:39.961 INFO:teuthology.orchestra.run.smithi008.stdout: "time": "2023-08-01T19:55:05.566745+0000", 2023-08-01T19:55:39.961 INFO:teuthology.orchestra.run.smithi008.stdout: "duration": 3.337e-06 2023-08-01T19:55:39.961 INFO:teuthology.orchestra.run.smithi008.stdout: }, 2023-08-01T19:55:39.961 INFO:teuthology.orchestra.run.smithi008.stdout: { 2023-08-01T19:55:39.961 INFO:teuthology.orchestra.run.smithi008.stdout: "event": "reached_pg", 2023-08-01T19:55:39.961 INFO:teuthology.orchestra.run.smithi008.stdout: "time": "2023-08-01T19:55:05.568175+0000", 2023-08-01T19:55:39.961 INFO:teuthology.orchestra.run.smithi008.stdout: "duration": 0.001429647 2023-08-01T19:55:39.962 INFO:teuthology.orchestra.run.smithi008.stdout: }, 2023-08-01T19:55:39.962 INFO:teuthology.orchestra.run.smithi008.stdout: { 2023-08-01T19:55:39.962 INFO:teuthology.orchestra.run.smithi008.stdout: "event": "started", 2023-08-01T19:55:39.962 INFO:teuthology.orchestra.run.smithi008.stdout: "time": "2023-08-01T19:55:05.568288+0000", 2023-08-01T19:55:39.962 INFO:teuthology.orchestra.run.smithi008.stdout: "duration": 0.000113353 2023-08-01T19:55:39.962 INFO:teuthology.orchestra.run.smithi008.stdout: }, 2023-08-01T19:55:39.962 INFO:teuthology.orchestra.run.smithi008.stdout: { 2023-08-01T19:55:39.962 INFO:teuthology.orchestra.run.smithi008.stdout: "event": "waiting for subops from 1", 2023-08-01T19:55:39.963 INFO:teuthology.orchestra.run.smithi008.stdout: "time": "2023-08-01T19:55:05.568425+0000", 2023-08-01T19:55:39.963 INFO:teuthology.orchestra.run.smithi008.stdout: "duration": 0.000137346 2023-08-01T19:55:39.963 INFO:teuthology.orchestra.run.smithi008.stdout: }, 2023-08-01T19:55:39.963 INFO:teuthology.orchestra.run.smithi008.stdout: { 2023-08-01T19:55:39.963 INFO:teuthology.orchestra.run.smithi008.stdout: "event": "sub_op_commit_rec", 2023-08-01T19:55:39.963 INFO:teuthology.orchestra.run.smithi008.stdout: "time": "2023-08-01T19:55:05.629320+0000", 2023-08-01T19:55:39.963 INFO:teuthology.orchestra.run.smithi008.stdout: "duration": 0.060894491000000002 2023-08-01T19:55:39.963 INFO:teuthology.orchestra.run.smithi008.stdout: }, 2023-08-01T19:55:39.964 INFO:teuthology.orchestra.run.smithi008.stdout: { 2023-08-01T19:55:39.964 INFO:teuthology.orchestra.run.smithi008.stdout: "event": "op_commit", 2023-08-01T19:55:39.964 INFO:teuthology.orchestra.run.smithi008.stdout: "time": "2023-08-01T19:55:05.632452+0000", 2023-08-01T19:55:39.964 INFO:teuthology.orchestra.run.smithi008.stdout: "duration": 0.003131909 2023-08-01T19:55:39.964 INFO:teuthology.orchestra.run.smithi008.stdout: }, 2023-08-01T19:55:39.964 INFO:teuthology.orchestra.run.smithi008.stdout: { 2023-08-01T19:55:39.964 INFO:teuthology.orchestra.run.smithi008.stdout: "event": "commit_sent", 2023-08-01T19:55:39.964 INFO:teuthology.orchestra.run.smithi008.stdout: "time": "2023-08-01T19:55:05.632503+0000", 2023-08-01T19:55:39.965 INFO:teuthology.orchestra.run.smithi008.stdout: "duration": 5.1295000000000003e-05 2023-08-01T19:55:39.965 INFO:teuthology.orchestra.run.smithi008.stdout: }, 2023-08-01T19:55:39.965 INFO:teuthology.orchestra.run.smithi008.stdout: { 2023-08-01T19:55:39.965 INFO:teuthology.orchestra.run.smithi008.stdout: "event": "done", 2023-08-01T19:55:39.965 INFO:teuthology.orchestra.run.smithi008.stdout: "time": "2023-08-01T19:55:05.632543+0000", 2023-08-01T19:55:39.965 INFO:teuthology.orchestra.run.smithi008.stdout: "duration": 4.0234000000000001e-05 2023-08-01T19:55:39.965 INFO:teuthology.orchestra.run.smithi008.stdout: } 2023-08-01T19:55:39.965 INFO:teuthology.orchestra.run.smithi008.stdout: ] 2023-08-01T19:55:39.966 INFO:teuthology.orchestra.run.smithi008.stdout: } 2023-08-01T19:55:39.966 INFO:teuthology.orchestra.run.smithi008.stdout: }, 2023-08-01T19:55:39.966 INFO:teuthology.orchestra.run.smithi008.stdout: { 2023-08-01T19:55:39.966 INFO:teuthology.orchestra.run.smithi008.stdout: "description": "osd_repop(client.4668.0:100935 5.e e37/19 5:7895b14e:::benchmark_data_smithi006_114134_object100934:head v 37'6305, mlcod=37'6303)", 2023-08-01T19:55:39.966 INFO:teuthology.orchestra.run.smithi008.stdout: "initiated_at": "2023-08-01T19:55:05.567118+0000", 2023-08-01T19:55:39.966 INFO:teuthology.orchestra.run.smithi008.stdout: "age": 34.305653280999998, 2023-08-01T19:55:39.966 INFO:teuthology.orchestra.run.smithi008.stdout: "duration": 0.063691180999999999, 2023-08-01T19:55:39.966 INFO:teuthology.orchestra.run.smithi008.stdout: "type_data": { 2023-08-01T19:55:39.967 INFO:teuthology.orchestra.run.smithi008.stdout: "flag_point": "commit sent; apply or cleanup", 2023-08-01T19:55:39.967 INFO:teuthology.orchestra.run.smithi008.stdout: "events": [ 2023-08-01T19:55:39.967 INFO:teuthology.orchestra.run.smithi008.stdout: { 2023-08-01T19:55:39.967 INFO:teuthology.orchestra.run.smithi008.stdout: "event": "initiated", 2023-08-01T19:55:39.967 INFO:teuthology.orchestra.run.smithi008.stdout: "time": "2023-08-01T19:55:05.567118+0000", 2023-08-01T19:55:39.967 INFO:teuthology.orchestra.run.smithi008.stdout: "duration": 0 2023-08-01T19:55:39.967 INFO:teuthology.orchestra.run.smithi008.stdout: }, 2023-08-01T19:55:39.968 INFO:teuthology.orchestra.run.smithi008.stdout: { 2023-08-01T19:55:39.968 INFO:teuthology.orchestra.run.smithi008.stdout: "event": "throttled", 2023-08-01T19:55:39.968 INFO:teuthology.orchestra.run.smithi008.stdout: "time": "2023-08-01T19:55:05.567118+0000", 2023-08-01T19:55:39.968 INFO:teuthology.orchestra.run.smithi008.stdout: "duration": 0 2023-08-01T19:55:39.968 INFO:teuthology.orchestra.run.smithi008.stdout: }, 2023-08-01T19:55:39.968 INFO:teuthology.orchestra.run.smithi008.stdout: { 2023-08-01T19:55:39.968 INFO:teuthology.orchestra.run.smithi008.stdout: "event": "header_read", 2023-08-01T19:55:39.968 INFO:teuthology.orchestra.run.smithi008.stdout: "time": "2023-08-01T19:55:05.567117+0000", 2023-08-01T19:55:39.969 INFO:teuthology.orchestra.run.smithi008.stdout: "duration": 4294967295.999999 2023-08-01T19:55:39.969 INFO:teuthology.orchestra.run.smithi008.stdout: }, 2023-08-01T19:55:39.969 INFO:teuthology.orchestra.run.smithi008.stdout: { 2023-08-01T19:55:39.969 INFO:teuthology.orchestra.run.smithi008.stdout: "event": "all_read", 2023-08-01T19:55:39.969 INFO:teuthology.orchestra.run.smithi008.stdout: "time": "2023-08-01T19:55:05.567168+0000", 2023-08-01T19:55:39.969 INFO:teuthology.orchestra.run.smithi008.stdout: "duration": 5.0353999999999999e-05 2023-08-01T19:55:39.969 INFO:teuthology.orchestra.run.smithi008.stdout: }, 2023-08-01T19:55:39.969 INFO:teuthology.orchestra.run.smithi008.stdout: { 2023-08-01T19:55:39.970 INFO:teuthology.orchestra.run.smithi008.stdout: "event": "dispatched", 2023-08-01T19:55:39.970 INFO:teuthology.orchestra.run.smithi008.stdout: "time": "2023-08-01T19:55:05.567175+0000", 2023-08-01T19:55:39.970 INFO:teuthology.orchestra.run.smithi008.stdout: "duration": 7.3919999999999997e-06 2023-08-01T19:55:39.970 INFO:teuthology.orchestra.run.smithi008.stdout: }, 2023-08-01T19:55:39.970 INFO:teuthology.orchestra.run.smithi008.stdout: { 2023-08-01T19:55:39.970 INFO:teuthology.orchestra.run.smithi008.stdout: "event": "queued_for_pg", 2023-08-01T19:55:39.970 INFO:teuthology.orchestra.run.smithi008.stdout: "time": "2023-08-01T19:55:05.567180+0000", 2023-08-01T19:55:39.970 INFO:teuthology.orchestra.run.smithi008.stdout: "duration": 5.3090000000000003e-06 2023-08-01T19:55:39.971 INFO:teuthology.orchestra.run.smithi008.stdout: }, 2023-08-01T19:55:39.971 INFO:teuthology.orchestra.run.smithi008.stdout: { 2023-08-01T19:55:39.971 INFO:teuthology.orchestra.run.smithi008.stdout: "event": "reached_pg", 2023-08-01T19:55:39.971 INFO:teuthology.orchestra.run.smithi008.stdout: "time": "2023-08-01T19:55:05.567210+0000", 2023-08-01T19:55:39.971 INFO:teuthology.orchestra.run.smithi008.stdout: "duration": 3.0001999999999998e-05 2023-08-01T19:55:39.971 INFO:teuthology.orchestra.run.smithi008.stdout: }, 2023-08-01T19:55:39.971 INFO:teuthology.orchestra.run.smithi008.stdout: { 2023-08-01T19:55:39.971 INFO:teuthology.orchestra.run.smithi008.stdout: "event": "started", 2023-08-01T19:55:39.972 INFO:teuthology.orchestra.run.smithi008.stdout: "time": "2023-08-01T19:55:05.567222+0000", 2023-08-01T19:55:39.972 INFO:teuthology.orchestra.run.smithi008.stdout: "duration": 1.1499e-05 2023-08-01T19:55:39.972 INFO:teuthology.orchestra.run.smithi008.stdout: }, 2023-08-01T19:55:39.972 INFO:teuthology.orchestra.run.smithi008.stdout: { 2023-08-01T19:55:39.972 INFO:teuthology.orchestra.run.smithi008.stdout: "event": "commit_sent", 2023-08-01T19:55:39.972 INFO:teuthology.orchestra.run.smithi008.stdout: "time": "2023-08-01T19:55:05.630772+0000", 2023-08-01T19:55:39.972 INFO:teuthology.orchestra.run.smithi008.stdout: "duration": 0.063550572999999999 2023-08-01T19:55:39.973 INFO:teuthology.orchestra.run.smithi008.stdout: }, 2023-08-01T19:55:39.973 INFO:teuthology.orchestra.run.smithi008.stdout: { 2023-08-01T19:55:39.973 INFO:teuthology.orchestra.run.smithi008.stdout: "event": "done", 2023-08-01T19:55:39.973 INFO:teuthology.orchestra.run.smithi008.stdout: "time": "2023-08-01T19:55:05.630809+0000", 2023-08-01T19:55:39.973 INFO:teuthology.orchestra.run.smithi008.stdout: "duration": 3.7033000000000003e-05 2023-08-01T19:55:39.973 INFO:teuthology.orchestra.run.smithi008.stdout: } 2023-08-01T19:55:39.973 INFO:teuthology.orchestra.run.smithi008.stdout: ] 2023-08-01T19:55:39.973 INFO:teuthology.orchestra.run.smithi008.stdout: } 2023-08-01T19:55:39.974 INFO:teuthology.orchestra.run.smithi008.stdout: }, 2023-08-01T19:55:39.974 INFO:teuthology.orchestra.run.smithi008.stdout: { 2023-08-01T19:55:39.974 INFO:teuthology.orchestra.run.smithi008.stdout: "description": "osd_repop(client.4668.0:100936 5.1 e37/19 5:8f4e3576:::benchmark_data_smithi006_114134_object100935:head v 37'6263, mlcod=37'6261)", 2023-08-01T19:55:39.974 INFO:teuthology.orchestra.run.smithi008.stdout: "initiated_at": "2023-08-01T19:55:05.567617+0000", 2023-08-01T19:55:39.974 INFO:teuthology.orchestra.run.smithi008.stdout: "age": 34.305154018000003, 2023-08-01T19:55:39.974 INFO:teuthology.orchestra.run.smithi008.stdout: "duration": 0.062773918999999997, 2023-08-01T19:55:39.974 INFO:teuthology.orchestra.run.smithi008.stdout: "type_data": { 2023-08-01T19:55:39.974 INFO:teuthology.orchestra.run.smithi008.stdout: "flag_point": "commit sent; apply or cleanup", 2023-08-01T19:55:39.975 INFO:teuthology.orchestra.run.smithi008.stdout: "events": [ 2023-08-01T19:55:39.975 INFO:teuthology.orchestra.run.smithi008.stdout: { 2023-08-01T19:55:39.975 INFO:teuthology.orchestra.run.smithi008.stdout: "event": "initiated", 2023-08-01T19:55:39.975 INFO:teuthology.orchestra.run.smithi008.stdout: "time": "2023-08-01T19:55:05.567617+0000", 2023-08-01T19:55:39.975 INFO:teuthology.orchestra.run.smithi008.stdout: "duration": 0 2023-08-01T19:55:39.975 INFO:teuthology.orchestra.run.smithi008.stdout: }, 2023-08-01T19:55:39.975 INFO:teuthology.orchestra.run.smithi008.stdout: { 2023-08-01T19:55:39.975 INFO:teuthology.orchestra.run.smithi008.stdout: "event": "throttled", 2023-08-01T19:55:39.976 INFO:teuthology.orchestra.run.smithi008.stdout: "time": "2023-08-01T19:55:05.567617+0000", 2023-08-01T19:55:39.976 INFO:teuthology.orchestra.run.smithi008.stdout: "duration": 0 2023-08-01T19:55:39.976 INFO:teuthology.orchestra.run.smithi008.stdout: }, 2023-08-01T19:55:39.976 INFO:teuthology.orchestra.run.smithi008.stdout: { 2023-08-01T19:55:39.976 INFO:teuthology.orchestra.run.smithi008.stdout: "event": "header_read", 2023-08-01T19:55:39.976 INFO:teuthology.orchestra.run.smithi008.stdout: "time": "2023-08-01T19:55:05.567617+0000", 2023-08-01T19:55:39.976 INFO:teuthology.orchestra.run.smithi008.stdout: "duration": 4294967295.9999995 2023-08-01T19:55:39.977 INFO:teuthology.orchestra.run.smithi008.stdout: }, 2023-08-01T19:55:39.977 INFO:teuthology.orchestra.run.smithi008.stdout: { 2023-08-01T19:55:39.977 INFO:teuthology.orchestra.run.smithi008.stdout: "event": "all_read", 2023-08-01T19:55:39.977 INFO:teuthology.orchestra.run.smithi008.stdout: "time": "2023-08-01T19:55:05.567700+0000", 2023-08-01T19:55:39.977 INFO:teuthology.orchestra.run.smithi008.stdout: "duration": 8.3363999999999997e-05 2023-08-01T19:55:39.977 INFO:teuthology.orchestra.run.smithi008.stdout: }, 2023-08-01T19:55:39.977 INFO:teuthology.orchestra.run.smithi008.stdout: { 2023-08-01T19:55:39.977 INFO:teuthology.orchestra.run.smithi008.stdout: "event": "dispatched", 2023-08-01T19:55:39.978 INFO:teuthology.orchestra.run.smithi008.stdout: "time": "2023-08-01T19:55:05.567706+0000", 2023-08-01T19:55:39.978 INFO:teuthology.orchestra.run.smithi008.stdout: "duration": 5.9739999999999999e-06 2023-08-01T19:55:39.978 INFO:teuthology.orchestra.run.smithi008.stdout: }, 2023-08-01T19:55:39.978 INFO:teuthology.orchestra.run.smithi008.stdout: { 2023-08-01T19:55:39.978 INFO:teuthology.orchestra.run.smithi008.stdout: "event": "queued_for_pg", 2023-08-01T19:55:39.978 INFO:teuthology.orchestra.run.smithi008.stdout: "time": "2023-08-01T19:55:05.567709+0000", 2023-08-01T19:55:39.978 INFO:teuthology.orchestra.run.smithi008.stdout: "duration": 3.1420000000000002e-06 2023-08-01T19:55:39.978 INFO:teuthology.orchestra.run.smithi008.stdout: }, 2023-08-01T19:55:39.979 INFO:teuthology.orchestra.run.smithi008.stdout: { 2023-08-01T19:55:39.979 INFO:teuthology.orchestra.run.smithi008.stdout: "event": "reached_pg", 2023-08-01T19:55:39.979 INFO:teuthology.orchestra.run.smithi008.stdout: "time": "2023-08-01T19:55:05.567741+0000", 2023-08-01T19:55:39.979 INFO:teuthology.orchestra.run.smithi008.stdout: "duration": 3.1532999999999998e-05 2023-08-01T19:55:39.979 INFO:teuthology.orchestra.run.smithi008.stdout: }, 2023-08-01T19:55:39.979 INFO:teuthology.orchestra.run.smithi008.stdout: { 2023-08-01T19:55:39.979 INFO:teuthology.orchestra.run.smithi008.stdout: "event": "started", 2023-08-01T19:55:39.979 INFO:teuthology.orchestra.run.smithi008.stdout: "time": "2023-08-01T19:55:05.567752+0000", 2023-08-01T19:55:39.980 INFO:teuthology.orchestra.run.smithi008.stdout: "duration": 1.1266e-05 2023-08-01T19:55:39.980 INFO:teuthology.orchestra.run.smithi008.stdout: }, 2023-08-01T19:55:39.980 INFO:teuthology.orchestra.run.smithi008.stdout: { 2023-08-01T19:55:39.980 INFO:teuthology.orchestra.run.smithi008.stdout: "event": "commit_sent", 2023-08-01T19:55:39.980 INFO:teuthology.orchestra.run.smithi008.stdout: "time": "2023-08-01T19:55:05.630357+0000", 2023-08-01T19:55:39.980 INFO:teuthology.orchestra.run.smithi008.stdout: "duration": 0.062604554000000007 2023-08-01T19:55:39.980 INFO:teuthology.orchestra.run.smithi008.stdout: }, 2023-08-01T19:55:39.980 INFO:teuthology.orchestra.run.smithi008.stdout: { 2023-08-01T19:55:39.981 INFO:teuthology.orchestra.run.smithi008.stdout: "event": "done", 2023-08-01T19:55:39.981 INFO:teuthology.orchestra.run.smithi008.stdout: "time": "2023-08-01T19:55:05.630391+0000", 2023-08-01T19:55:39.981 INFO:teuthology.orchestra.run.smithi008.stdout: "duration": 3.4619000000000002e-05 2023-08-01T19:55:39.981 INFO:teuthology.orchestra.run.smithi008.stdout: } 2023-08-01T19:55:39.981 INFO:teuthology.orchestra.run.smithi008.stdout: ] 2023-08-01T19:55:39.981 INFO:teuthology.orchestra.run.smithi008.stdout: } 2023-08-01T19:55:39.981 INFO:teuthology.orchestra.run.smithi008.stdout: }, 2023-08-01T19:55:39.982 INFO:teuthology.orchestra.run.smithi008.stdout: { 2023-08-01T19:55:39.982 INFO:teuthology.orchestra.run.smithi008.stdout: "description": "osd_op(client.4668.0:100937 5.c 5:34445fc3:::benchmark_data_smithi006_114134_object100936:head [set-alloc-hint object_size 65536 write_size 65536,write 0~65536] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e37)", 2023-08-01T19:55:39.982 INFO:teuthology.orchestra.run.smithi008.stdout: "initiated_at": "2023-08-01T19:55:05.569198+0000", 2023-08-01T19:55:39.982 INFO:teuthology.orchestra.run.smithi008.stdout: "age": 34.303573395000001, 2023-08-01T19:55:39.982 INFO:teuthology.orchestra.run.smithi008.stdout: "duration": 0.063349390000000005, 2023-08-01T19:55:39.982 INFO:teuthology.orchestra.run.smithi008.stdout: "type_data": { 2023-08-01T19:55:39.982 INFO:teuthology.orchestra.run.smithi008.stdout: "flag_point": "commit sent; apply or cleanup", 2023-08-01T19:55:39.982 INFO:teuthology.orchestra.run.smithi008.stdout: "client_info": { 2023-08-01T19:55:39.983 INFO:teuthology.orchestra.run.smithi008.stdout: "client": "client.4668", 2023-08-01T19:55:39.983 INFO:teuthology.orchestra.run.smithi008.stdout: "client_addr": "172.21.15.6:0/1709472247", 2023-08-01T19:55:39.983 INFO:teuthology.orchestra.run.smithi008.stdout: "tid": 100937 2023-08-01T19:55:39.983 INFO:teuthology.orchestra.run.smithi008.stdout: }, 2023-08-01T19:55:39.983 INFO:teuthology.orchestra.run.smithi008.stdout: "events": [ 2023-08-01T19:55:39.983 INFO:teuthology.orchestra.run.smithi008.stdout: { 2023-08-01T19:55:39.983 INFO:teuthology.orchestra.run.smithi008.stdout: "event": "initiated", 2023-08-01T19:55:39.983 INFO:teuthology.orchestra.run.smithi008.stdout: "time": "2023-08-01T19:55:05.569198+0000", 2023-08-01T19:55:39.984 INFO:teuthology.orchestra.run.smithi008.stdout: "duration": 0 2023-08-01T19:55:39.984 INFO:teuthology.orchestra.run.smithi008.stdout: }, 2023-08-01T19:55:39.984 INFO:teuthology.orchestra.run.smithi008.stdout: { 2023-08-01T19:55:39.984 INFO:teuthology.orchestra.run.smithi008.stdout: "event": "throttled", 2023-08-01T19:55:39.984 INFO:teuthology.orchestra.run.smithi008.stdout: "time": "2023-08-01T19:55:05.569198+0000", 2023-08-01T19:55:39.984 INFO:teuthology.orchestra.run.smithi008.stdout: "duration": 0 2023-08-01T19:55:39.984 INFO:teuthology.orchestra.run.smithi008.stdout: }, 2023-08-01T19:55:39.984 INFO:teuthology.orchestra.run.smithi008.stdout: { 2023-08-01T19:55:39.985 INFO:teuthology.orchestra.run.smithi008.stdout: "event": "header_read", 2023-08-01T19:55:39.985 INFO:teuthology.orchestra.run.smithi008.stdout: "time": "2023-08-01T19:55:05.569197+0000", 2023-08-01T19:55:39.985 INFO:teuthology.orchestra.run.smithi008.stdout: "duration": 4294967295.999999 2023-08-01T19:55:39.985 INFO:teuthology.orchestra.run.smithi008.stdout: }, 2023-08-01T19:55:39.985 INFO:teuthology.orchestra.run.smithi008.stdout: { 2023-08-01T19:55:39.985 INFO:teuthology.orchestra.run.smithi008.stdout: "event": "all_read", 2023-08-01T19:55:39.985 INFO:teuthology.orchestra.run.smithi008.stdout: "time": "2023-08-01T19:55:05.569250+0000", 2023-08-01T19:55:39.985 INFO:teuthology.orchestra.run.smithi008.stdout: "duration": 5.3106000000000003e-05 2023-08-01T19:55:39.986 INFO:teuthology.orchestra.run.smithi008.stdout: }, 2023-08-01T19:55:39.986 INFO:teuthology.orchestra.run.smithi008.stdout: { 2023-08-01T19:55:39.986 INFO:teuthology.orchestra.run.smithi008.stdout: "event": "dispatched", 2023-08-01T19:55:39.986 INFO:teuthology.orchestra.run.smithi008.stdout: "time": "2023-08-01T19:55:05.569260+0000", 2023-08-01T19:55:39.986 INFO:teuthology.orchestra.run.smithi008.stdout: "duration": 9.533e-06 2023-08-01T19:55:39.986 INFO:teuthology.orchestra.run.smithi008.stdout: }, 2023-08-01T19:55:39.986 INFO:teuthology.orchestra.run.smithi008.stdout: { 2023-08-01T19:55:39.986 INFO:teuthology.orchestra.run.smithi008.stdout: "event": "queued_for_pg", 2023-08-01T19:55:39.987 INFO:teuthology.orchestra.run.smithi008.stdout: "time": "2023-08-01T19:55:05.569264+0000", 2023-08-01T19:55:39.987 INFO:teuthology.orchestra.run.smithi008.stdout: "duration": 4.6099999999999999e-06 2023-08-01T19:55:39.987 INFO:teuthology.orchestra.run.smithi008.stdout: }, 2023-08-01T19:55:39.987 INFO:teuthology.orchestra.run.smithi008.stdout: { 2023-08-01T19:55:39.987 INFO:teuthology.orchestra.run.smithi008.stdout: "event": "reached_pg", 2023-08-01T19:55:39.987 INFO:teuthology.orchestra.run.smithi008.stdout: "time": "2023-08-01T19:55:05.569293+0000", 2023-08-01T19:55:39.987 INFO:teuthology.orchestra.run.smithi008.stdout: "duration": 2.8181999999999999e-05 2023-08-01T19:55:39.988 INFO:teuthology.orchestra.run.smithi008.stdout: }, 2023-08-01T19:55:39.988 INFO:teuthology.orchestra.run.smithi008.stdout: { 2023-08-01T19:55:39.988 INFO:teuthology.orchestra.run.smithi008.stdout: "event": "started", 2023-08-01T19:55:39.988 INFO:teuthology.orchestra.run.smithi008.stdout: "time": "2023-08-01T19:55:05.569401+0000", 2023-08-01T19:55:39.988 INFO:teuthology.orchestra.run.smithi008.stdout: "duration": 0.000108065 2023-08-01T19:55:39.988 INFO:teuthology.orchestra.run.smithi008.stdout: }, 2023-08-01T19:55:39.988 INFO:teuthology.orchestra.run.smithi008.stdout: { 2023-08-01T19:55:39.988 INFO:teuthology.orchestra.run.smithi008.stdout: "event": "waiting for subops from 1", 2023-08-01T19:55:39.989 INFO:teuthology.orchestra.run.smithi008.stdout: "time": "2023-08-01T19:55:05.569521+0000", 2023-08-01T19:55:39.989 INFO:teuthology.orchestra.run.smithi008.stdout: "duration": 0.00012006900000000001 2023-08-01T19:55:39.989 INFO:teuthology.orchestra.run.smithi008.stdout: }, 2023-08-01T19:55:39.989 INFO:teuthology.orchestra.run.smithi008.stdout: { 2023-08-01T19:55:39.989 INFO:teuthology.orchestra.run.smithi008.stdout: "event": "sub_op_commit_rec", 2023-08-01T19:55:39.989 INFO:teuthology.orchestra.run.smithi008.stdout: "time": "2023-08-01T19:55:05.629421+0000", 2023-08-01T19:55:39.989 INFO:teuthology.orchestra.run.smithi008.stdout: "duration": 0.059900525000000003 2023-08-01T19:55:39.989 INFO:teuthology.orchestra.run.smithi008.stdout: }, 2023-08-01T19:55:39.990 INFO:teuthology.orchestra.run.smithi008.stdout: { 2023-08-01T19:55:39.990 INFO:teuthology.orchestra.run.smithi008.stdout: "event": "op_commit", 2023-08-01T19:55:39.990 INFO:teuthology.orchestra.run.smithi008.stdout: "time": "2023-08-01T19:55:05.632461+0000", 2023-08-01T19:55:39.990 INFO:teuthology.orchestra.run.smithi008.stdout: "duration": 0.0030401220000000001 2023-08-01T19:55:39.990 INFO:teuthology.orchestra.run.smithi008.stdout: }, 2023-08-01T19:55:39.990 INFO:teuthology.orchestra.run.smithi008.stdout: { 2023-08-01T19:55:39.990 INFO:teuthology.orchestra.run.smithi008.stdout: "event": "commit_sent", 2023-08-01T19:55:39.990 INFO:teuthology.orchestra.run.smithi008.stdout: "time": "2023-08-01T19:55:05.632507+0000", 2023-08-01T19:55:39.991 INFO:teuthology.orchestra.run.smithi008.stdout: "duration": 4.5361999999999997e-05 2023-08-01T19:55:39.991 INFO:teuthology.orchestra.run.smithi008.stdout: }, 2023-08-01T19:55:39.991 INFO:teuthology.orchestra.run.smithi008.stdout: { 2023-08-01T19:55:39.991 INFO:teuthology.orchestra.run.smithi008.stdout: "event": "done", 2023-08-01T19:55:39.991 INFO:teuthology.orchestra.run.smithi008.stdout: "time": "2023-08-01T19:55:05.632547+0000", 2023-08-01T19:55:39.991 INFO:teuthology.orchestra.run.smithi008.stdout: "duration": 4.0760999999999998e-05 2023-08-01T19:55:39.991 INFO:teuthology.orchestra.run.smithi008.stdout: } 2023-08-01T19:55:39.991 INFO:teuthology.orchestra.run.smithi008.stdout: ] 2023-08-01T19:55:39.992 INFO:teuthology.orchestra.run.smithi008.stdout: } 2023-08-01T19:55:39.992 INFO:teuthology.orchestra.run.smithi008.stdout: }, 2023-08-01T19:55:39.992 INFO:teuthology.orchestra.run.smithi008.stdout: { 2023-08-01T19:55:39.992 INFO:teuthology.orchestra.run.smithi008.stdout: "description": "osd_op(client.4668.0:100939 5.5 5:a75fa6e3:::benchmark_data_smithi006_114134_object100938:head [set-alloc-hint object_size 65536 write_size 65536,write 0~65536] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e37)", 2023-08-01T19:55:39.992 INFO:teuthology.orchestra.run.smithi008.stdout: "initiated_at": "2023-08-01T19:55:05.569740+0000", 2023-08-01T19:55:39.992 INFO:teuthology.orchestra.run.smithi008.stdout: "age": 34.303031853, 2023-08-01T19:55:39.992 INFO:teuthology.orchestra.run.smithi008.stdout: "duration": 0.067753412999999998, 2023-08-01T19:55:39.993 INFO:teuthology.orchestra.run.smithi008.stdout: "type_data": { 2023-08-01T19:55:39.993 INFO:teuthology.orchestra.run.smithi008.stdout: "flag_point": "commit sent; apply or cleanup", 2023-08-01T19:55:39.993 INFO:teuthology.orchestra.run.smithi008.stdout: "client_info": { 2023-08-01T19:55:39.993 INFO:teuthology.orchestra.run.smithi008.stdout: "client": "client.4668", 2023-08-01T19:55:39.993 INFO:teuthology.orchestra.run.smithi008.stdout: "client_addr": "172.21.15.6:0/1709472247", 2023-08-01T19:55:39.993 INFO:teuthology.orchestra.run.smithi008.stdout: "tid": 100939 2023-08-01T19:55:39.993 INFO:teuthology.orchestra.run.smithi008.stdout: }, 2023-08-01T19:55:39.993 INFO:teuthology.orchestra.run.smithi008.stdout: "events": [ 2023-08-01T19:55:39.994 INFO:teuthology.orchestra.run.smithi008.stdout: { 2023-08-01T19:55:39.994 INFO:teuthology.orchestra.run.smithi008.stdout: "event": "initiated", 2023-08-01T19:55:39.994 INFO:teuthology.orchestra.run.smithi008.stdout: "time": "2023-08-01T19:55:05.569740+0000", 2023-08-01T19:55:39.994 INFO:teuthology.orchestra.run.smithi008.stdout: "duration": 0 2023-08-01T19:55:39.994 INFO:teuthology.orchestra.run.smithi008.stdout: }, 2023-08-01T19:55:39.994 INFO:teuthology.orchestra.run.smithi008.stdout: { 2023-08-01T19:55:39.994 INFO:teuthology.orchestra.run.smithi008.stdout: "event": "throttled", 2023-08-01T19:55:39.994 INFO:teuthology.orchestra.run.smithi008.stdout: "time": "2023-08-01T19:55:05.569740+0000", 2023-08-01T19:55:39.995 INFO:teuthology.orchestra.run.smithi008.stdout: "duration": 0 2023-08-01T19:55:39.995 INFO:teuthology.orchestra.run.smithi008.stdout: }, 2023-08-01T19:55:39.995 INFO:teuthology.orchestra.run.smithi008.stdout: { 2023-08-01T19:55:39.995 INFO:teuthology.orchestra.run.smithi008.stdout: "event": "header_read", 2023-08-01T19:55:39.995 INFO:teuthology.orchestra.run.smithi008.stdout: "time": "2023-08-01T19:55:05.569739+0000", 2023-08-01T19:55:39.995 INFO:teuthology.orchestra.run.smithi008.stdout: "duration": 4294967295.9999995 2023-08-01T19:55:39.995 INFO:teuthology.orchestra.run.smithi008.stdout: }, 2023-08-01T19:55:39.995 INFO:teuthology.orchestra.run.smithi008.stdout: { 2023-08-01T19:55:39.996 INFO:teuthology.orchestra.run.smithi008.stdout: "event": "all_read", 2023-08-01T19:55:39.996 INFO:teuthology.orchestra.run.smithi008.stdout: "time": "2023-08-01T19:55:05.569839+0000", 2023-08-01T19:55:39.996 INFO:teuthology.orchestra.run.smithi008.stdout: "duration": 0.000100219 2023-08-01T19:55:39.996 INFO:teuthology.orchestra.run.smithi008.stdout: }, 2023-08-01T19:55:39.996 INFO:teuthology.orchestra.run.smithi008.stdout: { 2023-08-01T19:55:39.996 INFO:teuthology.orchestra.run.smithi008.stdout: "event": "dispatched", 2023-08-01T19:55:39.996 INFO:teuthology.orchestra.run.smithi008.stdout: "time": "2023-08-01T19:55:05.569846+0000", 2023-08-01T19:55:39.997 INFO:teuthology.orchestra.run.smithi008.stdout: "duration": 7.3150000000000003e-06 2023-08-01T19:55:39.997 INFO:teuthology.orchestra.run.smithi008.stdout: }, 2023-08-01T19:55:39.997 INFO:teuthology.orchestra.run.smithi008.stdout: { 2023-08-01T19:55:39.997 INFO:teuthology.orchestra.run.smithi008.stdout: "event": "queued_for_pg", 2023-08-01T19:55:39.997 INFO:teuthology.orchestra.run.smithi008.stdout: "time": "2023-08-01T19:55:05.569850+0000", 2023-08-01T19:55:39.997 INFO:teuthology.orchestra.run.smithi008.stdout: "duration": 3.3299999999999999e-06 2023-08-01T19:55:39.997 INFO:teuthology.orchestra.run.smithi008.stdout: }, 2023-08-01T19:55:39.997 INFO:teuthology.orchestra.run.smithi008.stdout: { 2023-08-01T19:55:39.998 INFO:teuthology.orchestra.run.smithi008.stdout: "event": "reached_pg", 2023-08-01T19:55:39.998 INFO:teuthology.orchestra.run.smithi008.stdout: "time": "2023-08-01T19:55:05.626991+0000", 2023-08-01T19:55:39.998 INFO:teuthology.orchestra.run.smithi008.stdout: "duration": 0.057141585000000002 2023-08-01T19:55:39.998 INFO:teuthology.orchestra.run.smithi008.stdout: }, 2023-08-01T19:55:39.998 INFO:teuthology.orchestra.run.smithi008.stdout: { 2023-08-01T19:55:39.998 INFO:teuthology.orchestra.run.smithi008.stdout: "event": "started", 2023-08-01T19:55:39.998 INFO:teuthology.orchestra.run.smithi008.stdout: "time": "2023-08-01T19:55:05.627111+0000", 2023-08-01T19:55:39.998 INFO:teuthology.orchestra.run.smithi008.stdout: "duration": 0.000119238 2023-08-01T19:55:39.999 INFO:teuthology.orchestra.run.smithi008.stdout: }, 2023-08-01T19:55:39.999 INFO:teuthology.orchestra.run.smithi008.stdout: { 2023-08-01T19:55:39.999 INFO:teuthology.orchestra.run.smithi008.stdout: "event": "waiting for subops from 1", 2023-08-01T19:55:39.999 INFO:teuthology.orchestra.run.smithi008.stdout: "time": "2023-08-01T19:55:05.627253+0000", 2023-08-01T19:55:39.999 INFO:teuthology.orchestra.run.smithi008.stdout: "duration": 0.000142822 2023-08-01T19:55:39.999 INFO:teuthology.orchestra.run.smithi008.stdout: }, 2023-08-01T19:55:39.999 INFO:teuthology.orchestra.run.smithi008.stdout: { 2023-08-01T19:55:40.000 INFO:teuthology.orchestra.run.smithi008.stdout: "event": "op_commit", 2023-08-01T19:55:40.000 INFO:teuthology.orchestra.run.smithi008.stdout: "time": "2023-08-01T19:55:05.632555+0000", 2023-08-01T19:55:40.000 INFO:teuthology.orchestra.run.smithi008.stdout: "duration": 0.0053012449999999996 2023-08-01T19:55:40.000 INFO:teuthology.orchestra.run.smithi008.stdout: }, 2023-08-01T19:55:40.000 INFO:teuthology.orchestra.run.smithi008.stdout: { 2023-08-01T19:55:40.000 INFO:teuthology.orchestra.run.smithi008.stdout: "event": "sub_op_commit_rec", 2023-08-01T19:55:40.000 INFO:teuthology.orchestra.run.smithi008.stdout: "time": "2023-08-01T19:55:05.637380+0000", 2023-08-01T19:55:40.000 INFO:teuthology.orchestra.run.smithi008.stdout: "duration": 0.0048257639999999997 2023-08-01T19:55:40.001 INFO:teuthology.orchestra.run.smithi008.stdout: }, 2023-08-01T19:55:40.001 INFO:teuthology.orchestra.run.smithi008.stdout: { 2023-08-01T19:55:40.001 INFO:teuthology.orchestra.run.smithi008.stdout: "event": "commit_sent", 2023-08-01T19:55:40.001 INFO:teuthology.orchestra.run.smithi008.stdout: "time": "2023-08-01T19:55:05.637454+0000", 2023-08-01T19:55:40.001 INFO:teuthology.orchestra.run.smithi008.stdout: "duration": 7.3578999999999995e-05 2023-08-01T19:55:40.001 INFO:teuthology.orchestra.run.smithi008.stdout: }, 2023-08-01T19:55:40.001 INFO:teuthology.orchestra.run.smithi008.stdout: { 2023-08-01T19:55:40.001 INFO:teuthology.orchestra.run.smithi008.stdout: "event": "done", 2023-08-01T19:55:40.002 INFO:teuthology.orchestra.run.smithi008.stdout: "time": "2023-08-01T19:55:05.637493+0000", 2023-08-01T19:55:40.002 INFO:teuthology.orchestra.run.smithi008.stdout: "duration": 3.8986999999999998e-05 2023-08-01T19:55:40.002 INFO:teuthology.orchestra.run.smithi008.stdout: } 2023-08-01T19:55:40.002 INFO:teuthology.orchestra.run.smithi008.stdout: ] 2023-08-01T19:55:40.002 INFO:teuthology.orchestra.run.smithi008.stdout: } 2023-08-01T19:55:40.002 INFO:teuthology.orchestra.run.smithi008.stdout: }, 2023-08-01T19:55:40.002 INFO:teuthology.orchestra.run.smithi008.stdout: { 2023-08-01T19:55:40.002 INFO:teuthology.orchestra.run.smithi008.stdout: "description": "osd_repop(client.4668.0:100941 5.e e37/19 5:736a6ac6:::benchmark_data_smithi006_114134_object100940:head v 37'6306, mlcod=37'6303)", 2023-08-01T19:55:40.003 INFO:teuthology.orchestra.run.smithi008.stdout: "initiated_at": "2023-08-01T19:55:05.570237+0000", 2023-08-01T19:55:40.003 INFO:teuthology.orchestra.run.smithi008.stdout: "age": 34.302534543, 2023-08-01T19:55:40.003 INFO:teuthology.orchestra.run.smithi008.stdout: "duration": 0.064830421999999999, 2023-08-01T19:55:40.003 INFO:teuthology.orchestra.run.smithi008.stdout: "type_data": { 2023-08-01T19:55:40.003 INFO:teuthology.orchestra.run.smithi008.stdout: "flag_point": "commit sent; apply or cleanup", 2023-08-01T19:55:40.003 INFO:teuthology.orchestra.run.smithi008.stdout: "events": [ 2023-08-01T19:55:40.003 INFO:teuthology.orchestra.run.smithi008.stdout: { 2023-08-01T19:55:40.003 INFO:teuthology.orchestra.run.smithi008.stdout: "event": "initiated", 2023-08-01T19:55:40.004 INFO:teuthology.orchestra.run.smithi008.stdout: "time": "2023-08-01T19:55:05.570237+0000", 2023-08-01T19:55:40.004 INFO:teuthology.orchestra.run.smithi008.stdout: "duration": 0 2023-08-01T19:55:40.004 INFO:teuthology.orchestra.run.smithi008.stdout: }, 2023-08-01T19:55:40.004 INFO:teuthology.orchestra.run.smithi008.stdout: { 2023-08-01T19:55:40.004 INFO:teuthology.orchestra.run.smithi008.stdout: "event": "throttled", 2023-08-01T19:55:40.004 INFO:teuthology.orchestra.run.smithi008.stdout: "time": "2023-08-01T19:55:05.570237+0000", 2023-08-01T19:55:40.004 INFO:teuthology.orchestra.run.smithi008.stdout: "duration": 0 2023-08-01T19:55:40.005 INFO:teuthology.orchestra.run.smithi008.stdout: }, 2023-08-01T19:55:40.005 INFO:teuthology.orchestra.run.smithi008.stdout: { 2023-08-01T19:55:40.005 INFO:teuthology.orchestra.run.smithi008.stdout: "event": "header_read", 2023-08-01T19:55:40.005 INFO:teuthology.orchestra.run.smithi008.stdout: "time": "2023-08-01T19:55:05.570236+0000", 2023-08-01T19:55:40.005 INFO:teuthology.orchestra.run.smithi008.stdout: "duration": 4294967295.9999995 2023-08-01T19:55:40.005 INFO:teuthology.orchestra.run.smithi008.stdout: }, 2023-08-01T19:55:40.005 INFO:teuthology.orchestra.run.smithi008.stdout: { 2023-08-01T19:55:40.005 INFO:teuthology.orchestra.run.smithi008.stdout: "event": "all_read", 2023-08-01T19:55:40.006 INFO:teuthology.orchestra.run.smithi008.stdout: "time": "2023-08-01T19:55:05.570354+0000", 2023-08-01T19:55:40.006 INFO:teuthology.orchestra.run.smithi008.stdout: "duration": 0.000118029 2023-08-01T19:55:40.006 INFO:teuthology.orchestra.run.smithi008.stdout: }, 2023-08-01T19:55:40.006 INFO:teuthology.orchestra.run.smithi008.stdout: { 2023-08-01T19:55:40.006 INFO:teuthology.orchestra.run.smithi008.stdout: "event": "dispatched", 2023-08-01T19:55:40.006 INFO:teuthology.orchestra.run.smithi008.stdout: "time": "2023-08-01T19:55:05.626649+0000", 2023-08-01T19:55:40.006 INFO:teuthology.orchestra.run.smithi008.stdout: "duration": 0.056294489000000003 2023-08-01T19:55:40.006 INFO:teuthology.orchestra.run.smithi008.stdout: }, 2023-08-01T19:55:40.007 INFO:teuthology.orchestra.run.smithi008.stdout: { 2023-08-01T19:55:40.007 INFO:teuthology.orchestra.run.smithi008.stdout: "event": "queued_for_pg", 2023-08-01T19:55:40.007 INFO:teuthology.orchestra.run.smithi008.stdout: "time": "2023-08-01T19:55:05.626676+0000", 2023-08-01T19:55:40.007 INFO:teuthology.orchestra.run.smithi008.stdout: "duration": 2.7228000000000001e-05 2023-08-01T19:55:40.007 INFO:teuthology.orchestra.run.smithi008.stdout: }, 2023-08-01T19:55:40.007 INFO:teuthology.orchestra.run.smithi008.stdout: { 2023-08-01T19:55:40.007 INFO:teuthology.orchestra.run.smithi008.stdout: "event": "reached_pg", 2023-08-01T19:55:40.007 INFO:teuthology.orchestra.run.smithi008.stdout: "time": "2023-08-01T19:55:05.626717+0000", 2023-08-01T19:55:40.008 INFO:teuthology.orchestra.run.smithi008.stdout: "duration": 4.1318e-05 2023-08-01T19:55:40.008 INFO:teuthology.orchestra.run.smithi008.stdout: }, 2023-08-01T19:55:40.008 INFO:teuthology.orchestra.run.smithi008.stdout: { 2023-08-01T19:55:40.008 INFO:teuthology.orchestra.run.smithi008.stdout: "event": "started", 2023-08-01T19:55:40.008 INFO:teuthology.orchestra.run.smithi008.stdout: "time": "2023-08-01T19:55:05.626737+0000", 2023-08-01T19:55:40.008 INFO:teuthology.orchestra.run.smithi008.stdout: "duration": 1.9415e-05 2023-08-01T19:55:40.008 INFO:teuthology.orchestra.run.smithi008.stdout: }, 2023-08-01T19:55:40.009 INFO:teuthology.orchestra.run.smithi008.stdout: { 2023-08-01T19:55:40.009 INFO:teuthology.orchestra.run.smithi008.stdout: "event": "commit_sent", 2023-08-01T19:55:40.009 INFO:teuthology.orchestra.run.smithi008.stdout: "time": "2023-08-01T19:55:05.635036+0000", 2023-08-01T19:55:40.009 INFO:teuthology.orchestra.run.smithi008.stdout: "duration": 0.0082987700000000005 2023-08-01T19:55:40.009 INFO:teuthology.orchestra.run.smithi008.stdout: }, 2023-08-01T19:55:40.009 INFO:teuthology.orchestra.run.smithi008.stdout: { 2023-08-01T19:55:40.009 INFO:teuthology.orchestra.run.smithi008.stdout: "event": "done", 2023-08-01T19:55:40.009 INFO:teuthology.orchestra.run.smithi008.stdout: "time": "2023-08-01T19:55:05.635067+0000", 2023-08-01T19:55:40.010 INFO:teuthology.orchestra.run.smithi008.stdout: "duration": 3.1786999999999999e-05 2023-08-01T19:55:40.010 INFO:teuthology.orchestra.run.smithi008.stdout: } 2023-08-01T19:55:40.010 INFO:teuthology.orchestra.run.smithi008.stdout: ] 2023-08-01T19:55:40.010 INFO:teuthology.orchestra.run.smithi008.stdout: } 2023-08-01T19:55:40.010 INFO:teuthology.orchestra.run.smithi008.stdout: }, 2023-08-01T19:55:40.010 INFO:teuthology.orchestra.run.smithi008.stdout: { 2023-08-01T19:55:40.010 INFO:teuthology.orchestra.run.smithi008.stdout: "description": "osd_op(client.4668.0:107863 5.3 5:cbdd875a:::benchmark_data_smithi006_114134_object107862:head [set-alloc-hint object_size 65536 write_size 65536,write 0~65536] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e38)", 2023-08-01T19:55:40.010 INFO:teuthology.orchestra.run.smithi008.stdout: "initiated_at": "2023-08-01T19:55:09.278851+0000", 2023-08-01T19:55:40.011 INFO:teuthology.orchestra.run.smithi008.stdout: "age": 30.593920112999999, 2023-08-01T19:55:40.011 INFO:teuthology.orchestra.run.smithi008.stdout: "duration": 0.071378853000000006, 2023-08-01T19:55:40.011 INFO:teuthology.orchestra.run.smithi008.stdout: "type_data": { 2023-08-01T19:55:40.011 INFO:teuthology.orchestra.run.smithi008.stdout: "flag_point": "commit sent; apply or cleanup", 2023-08-01T19:55:40.011 INFO:teuthology.orchestra.run.smithi008.stdout: "client_info": { 2023-08-01T19:55:40.011 INFO:teuthology.orchestra.run.smithi008.stdout: "client": "client.4668", 2023-08-01T19:55:40.011 INFO:teuthology.orchestra.run.smithi008.stdout: "client_addr": "172.21.15.6:0/1709472247", 2023-08-01T19:55:40.011 INFO:teuthology.orchestra.run.smithi008.stdout: "tid": 107863 2023-08-01T19:55:40.012 INFO:teuthology.orchestra.run.smithi008.stdout: }, 2023-08-01T19:55:40.012 INFO:teuthology.orchestra.run.smithi008.stdout: "events": [ 2023-08-01T19:55:40.012 INFO:teuthology.orchestra.run.smithi008.stdout: { 2023-08-01T19:55:40.012 INFO:teuthology.orchestra.run.smithi008.stdout: "event": "initiated", 2023-08-01T19:55:40.012 INFO:teuthology.orchestra.run.smithi008.stdout: "time": "2023-08-01T19:55:09.278851+0000", 2023-08-01T19:55:40.012 INFO:teuthology.orchestra.run.smithi008.stdout: "duration": 0 2023-08-01T19:55:40.012 INFO:teuthology.orchestra.run.smithi008.stdout: }, 2023-08-01T19:55:40.012 INFO:teuthology.orchestra.run.smithi008.stdout: { 2023-08-01T19:55:40.013 INFO:teuthology.orchestra.run.smithi008.stdout: "event": "throttled", 2023-08-01T19:55:40.013 INFO:teuthology.orchestra.run.smithi008.stdout: "time": "2023-08-01T19:55:09.278851+0000", 2023-08-01T19:55:40.013 INFO:teuthology.orchestra.run.smithi008.stdout: "duration": 0 2023-08-01T19:55:40.013 INFO:teuthology.orchestra.run.smithi008.stdout: }, 2023-08-01T19:55:40.013 INFO:teuthology.orchestra.run.smithi008.stdout: { 2023-08-01T19:55:40.013 INFO:teuthology.orchestra.run.smithi008.stdout: "event": "header_read", 2023-08-01T19:55:40.013 INFO:teuthology.orchestra.run.smithi008.stdout: "time": "2023-08-01T19:55:09.278850+0000", 2023-08-01T19:55:40.013 INFO:teuthology.orchestra.run.smithi008.stdout: "duration": 4294967295.999999 2023-08-01T19:55:40.014 INFO:teuthology.orchestra.run.smithi008.stdout: }, 2023-08-01T19:55:40.014 INFO:teuthology.orchestra.run.smithi008.stdout: { 2023-08-01T19:55:40.014 INFO:teuthology.orchestra.run.smithi008.stdout: "event": "all_read", 2023-08-01T19:55:40.014 INFO:teuthology.orchestra.run.smithi008.stdout: "time": "2023-08-01T19:55:09.278945+0000", 2023-08-01T19:55:40.014 INFO:teuthology.orchestra.run.smithi008.stdout: "duration": 9.4388000000000005e-05 2023-08-01T19:55:40.014 INFO:teuthology.orchestra.run.smithi008.stdout: }, 2023-08-01T19:55:40.014 INFO:teuthology.orchestra.run.smithi008.stdout: { 2023-08-01T19:55:40.015 INFO:teuthology.orchestra.run.smithi008.stdout: "event": "dispatched", 2023-08-01T19:55:40.015 INFO:teuthology.orchestra.run.smithi008.stdout: "time": "2023-08-01T19:55:09.278955+0000", 2023-08-01T19:55:40.015 INFO:teuthology.orchestra.run.smithi008.stdout: "duration": 1.0413e-05 2023-08-01T19:55:40.015 INFO:teuthology.orchestra.run.smithi008.stdout: }, 2023-08-01T19:55:40.015 INFO:teuthology.orchestra.run.smithi008.stdout: { 2023-08-01T19:55:40.015 INFO:teuthology.orchestra.run.smithi008.stdout: "event": "queued_for_pg", 2023-08-01T19:55:40.015 INFO:teuthology.orchestra.run.smithi008.stdout: "time": "2023-08-01T19:55:09.278962+0000", 2023-08-01T19:55:40.015 INFO:teuthology.orchestra.run.smithi008.stdout: "duration": 6.2169999999999999e-06 2023-08-01T19:55:40.016 INFO:teuthology.orchestra.run.smithi008.stdout: }, 2023-08-01T19:55:40.016 INFO:teuthology.orchestra.run.smithi008.stdout: { 2023-08-01T19:55:40.016 INFO:teuthology.orchestra.run.smithi008.stdout: "event": "reached_pg", 2023-08-01T19:55:40.016 INFO:teuthology.orchestra.run.smithi008.stdout: "time": "2023-08-01T19:55:09.280363+0000", 2023-08-01T19:55:40.016 INFO:teuthology.orchestra.run.smithi008.stdout: "duration": 0.0014014489999999999 2023-08-01T19:55:40.016 INFO:teuthology.orchestra.run.smithi008.stdout: }, 2023-08-01T19:55:40.016 INFO:teuthology.orchestra.run.smithi008.stdout: { 2023-08-01T19:55:40.016 INFO:teuthology.orchestra.run.smithi008.stdout: "event": "started", 2023-08-01T19:55:40.017 INFO:teuthology.orchestra.run.smithi008.stdout: "time": "2023-08-01T19:55:09.280488+0000", 2023-08-01T19:55:40.017 INFO:teuthology.orchestra.run.smithi008.stdout: "duration": 0.00012474099999999999 2023-08-01T19:55:40.017 INFO:teuthology.orchestra.run.smithi008.stdout: }, 2023-08-01T19:55:40.017 INFO:teuthology.orchestra.run.smithi008.stdout: { 2023-08-01T19:55:40.017 INFO:teuthology.orchestra.run.smithi008.stdout: "event": "waiting for subops from 1", 2023-08-01T19:55:40.017 INFO:teuthology.orchestra.run.smithi008.stdout: "time": "2023-08-01T19:55:09.280626+0000", 2023-08-01T19:55:40.017 INFO:teuthology.orchestra.run.smithi008.stdout: "duration": 0.000138193 2023-08-01T19:55:40.017 INFO:teuthology.orchestra.run.smithi008.stdout: }, 2023-08-01T19:55:40.018 INFO:teuthology.orchestra.run.smithi008.stdout: { 2023-08-01T19:55:40.018 INFO:teuthology.orchestra.run.smithi008.stdout: "event": "op_commit", 2023-08-01T19:55:40.018 INFO:teuthology.orchestra.run.smithi008.stdout: "time": "2023-08-01T19:55:09.285958+0000", 2023-08-01T19:55:40.018 INFO:teuthology.orchestra.run.smithi008.stdout: "duration": 0.0053317130000000001 2023-08-01T19:55:40.018 INFO:teuthology.orchestra.run.smithi008.stdout: }, 2023-08-01T19:55:40.018 INFO:teuthology.orchestra.run.smithi008.stdout: { 2023-08-01T19:55:40.018 INFO:teuthology.orchestra.run.smithi008.stdout: "event": "sub_op_commit_rec", 2023-08-01T19:55:40.018 INFO:teuthology.orchestra.run.smithi008.stdout: "time": "2023-08-01T19:55:09.350151+0000", 2023-08-01T19:55:40.019 INFO:teuthology.orchestra.run.smithi008.stdout: "duration": 0.064193202000000005 2023-08-01T19:55:40.019 INFO:teuthology.orchestra.run.smithi008.stdout: }, 2023-08-01T19:55:40.019 INFO:teuthology.orchestra.run.smithi008.stdout: { 2023-08-01T19:55:40.019 INFO:teuthology.orchestra.run.smithi008.stdout: "event": "commit_sent", 2023-08-01T19:55:40.019 INFO:teuthology.orchestra.run.smithi008.stdout: "time": "2023-08-01T19:55:09.350188+0000", 2023-08-01T19:55:40.019 INFO:teuthology.orchestra.run.smithi008.stdout: "duration": 3.7549999999999998e-05 2023-08-01T19:55:40.019 INFO:teuthology.orchestra.run.smithi008.stdout: }, 2023-08-01T19:55:40.019 INFO:teuthology.orchestra.run.smithi008.stdout: { 2023-08-01T19:55:40.020 INFO:teuthology.orchestra.run.smithi008.stdout: "event": "done", 2023-08-01T19:55:40.020 INFO:teuthology.orchestra.run.smithi008.stdout: "time": "2023-08-01T19:55:09.350230+0000", 2023-08-01T19:55:40.020 INFO:teuthology.orchestra.run.smithi008.stdout: "duration": 4.1804999999999997e-05 2023-08-01T19:55:40.020 INFO:teuthology.orchestra.run.smithi008.stdout: } 2023-08-01T19:55:40.020 INFO:teuthology.orchestra.run.smithi008.stdout: ] 2023-08-01T19:55:40.020 INFO:teuthology.orchestra.run.smithi008.stdout: } 2023-08-01T19:55:40.020 INFO:teuthology.orchestra.run.smithi008.stdout: }, 2023-08-01T19:55:40.021 INFO:teuthology.orchestra.run.smithi008.stdout: { 2023-08-01T19:55:40.021 INFO:teuthology.orchestra.run.smithi008.stdout: "description": "osd_op(client.4668.0:107865 5.3 5:c2ebb96d:::benchmark_data_smithi006_114134_object107864:head [set-alloc-hint object_size 65536 write_size 65536,write 0~65536] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e38)", 2023-08-01T19:55:40.021 INFO:teuthology.orchestra.run.smithi008.stdout: "initiated_at": "2023-08-01T19:55:09.279020+0000", 2023-08-01T19:55:40.021 INFO:teuthology.orchestra.run.smithi008.stdout: "age": 30.593751440999998, 2023-08-01T19:55:40.021 INFO:teuthology.orchestra.run.smithi008.stdout: "duration": 0.072892565000000006, 2023-08-01T19:55:40.021 INFO:teuthology.orchestra.run.smithi008.stdout: "type_data": { 2023-08-01T19:55:40.021 INFO:teuthology.orchestra.run.smithi008.stdout: "flag_point": "commit sent; apply or cleanup", 2023-08-01T19:55:40.021 INFO:teuthology.orchestra.run.smithi008.stdout: "client_info": { 2023-08-01T19:55:40.022 INFO:teuthology.orchestra.run.smithi008.stdout: "client": "client.4668", 2023-08-01T19:55:40.022 INFO:teuthology.orchestra.run.smithi008.stdout: "client_addr": "172.21.15.6:0/1709472247", 2023-08-01T19:55:40.022 INFO:teuthology.orchestra.run.smithi008.stdout: "tid": 107865 2023-08-01T19:55:40.022 INFO:teuthology.orchestra.run.smithi008.stdout: }, 2023-08-01T19:55:40.022 INFO:teuthology.orchestra.run.smithi008.stdout: "events": [ 2023-08-01T19:55:40.022 INFO:teuthology.orchestra.run.smithi008.stdout: { 2023-08-01T19:55:40.022 INFO:teuthology.orchestra.run.smithi008.stdout: "event": "initiated", 2023-08-01T19:55:40.022 INFO:teuthology.orchestra.run.smithi008.stdout: "time": "2023-08-01T19:55:09.279020+0000", 2023-08-01T19:55:40.023 INFO:teuthology.orchestra.run.smithi008.stdout: "duration": 0 2023-08-01T19:55:40.023 INFO:teuthology.orchestra.run.smithi008.stdout: }, 2023-08-01T19:55:40.023 INFO:teuthology.orchestra.run.smithi008.stdout: { 2023-08-01T19:55:40.023 INFO:teuthology.orchestra.run.smithi008.stdout: "event": "throttled", 2023-08-01T19:55:40.023 INFO:teuthology.orchestra.run.smithi008.stdout: "time": "2023-08-01T19:55:09.279020+0000", 2023-08-01T19:55:40.023 INFO:teuthology.orchestra.run.smithi008.stdout: "duration": 0 2023-08-01T19:55:40.023 INFO:teuthology.orchestra.run.smithi008.stdout: }, 2023-08-01T19:55:40.023 INFO:teuthology.orchestra.run.smithi008.stdout: { 2023-08-01T19:55:40.024 INFO:teuthology.orchestra.run.smithi008.stdout: "event": "header_read", 2023-08-01T19:55:40.024 INFO:teuthology.orchestra.run.smithi008.stdout: "time": "2023-08-01T19:55:09.279019+0000", 2023-08-01T19:55:40.024 INFO:teuthology.orchestra.run.smithi008.stdout: "duration": 4294967295.999999 2023-08-01T19:55:40.024 INFO:teuthology.orchestra.run.smithi008.stdout: }, 2023-08-01T19:55:40.024 INFO:teuthology.orchestra.run.smithi008.stdout: { 2023-08-01T19:55:40.024 INFO:teuthology.orchestra.run.smithi008.stdout: "event": "all_read", 2023-08-01T19:55:40.024 INFO:teuthology.orchestra.run.smithi008.stdout: "time": "2023-08-01T19:55:09.279087+0000", 2023-08-01T19:55:40.025 INFO:teuthology.orchestra.run.smithi008.stdout: "duration": 6.8392000000000005e-05 2023-08-01T19:55:40.025 INFO:teuthology.orchestra.run.smithi008.stdout: }, 2023-08-01T19:55:40.025 INFO:teuthology.orchestra.run.smithi008.stdout: { 2023-08-01T19:55:40.025 INFO:teuthology.orchestra.run.smithi008.stdout: "event": "dispatched", 2023-08-01T19:55:40.025 INFO:teuthology.orchestra.run.smithi008.stdout: "time": "2023-08-01T19:55:09.279095+0000", 2023-08-01T19:55:40.025 INFO:teuthology.orchestra.run.smithi008.stdout: "duration": 8.0989999999999999e-06 2023-08-01T19:55:40.025 INFO:teuthology.orchestra.run.smithi008.stdout: }, 2023-08-01T19:55:40.025 INFO:teuthology.orchestra.run.smithi008.stdout: { 2023-08-01T19:55:40.026 INFO:teuthology.orchestra.run.smithi008.stdout: "event": "queued_for_pg", 2023-08-01T19:55:40.026 INFO:teuthology.orchestra.run.smithi008.stdout: "time": "2023-08-01T19:55:09.279101+0000", 2023-08-01T19:55:40.026 INFO:teuthology.orchestra.run.smithi008.stdout: "duration": 5.0390000000000004e-06 2023-08-01T19:55:40.026 INFO:teuthology.orchestra.run.smithi008.stdout: }, 2023-08-01T19:55:40.026 INFO:teuthology.orchestra.run.smithi008.stdout: { 2023-08-01T19:55:40.026 INFO:teuthology.orchestra.run.smithi008.stdout: "event": "reached_pg", 2023-08-01T19:55:40.026 INFO:teuthology.orchestra.run.smithi008.stdout: "time": "2023-08-01T19:55:09.282574+0000", 2023-08-01T19:55:40.026 INFO:teuthology.orchestra.run.smithi008.stdout: "duration": 0.0034730619999999999 2023-08-01T19:55:40.027 INFO:teuthology.orchestra.run.smithi008.stdout: }, 2023-08-01T19:55:40.027 INFO:teuthology.orchestra.run.smithi008.stdout: { 2023-08-01T19:55:40.027 INFO:teuthology.orchestra.run.smithi008.stdout: "event": "started", 2023-08-01T19:55:40.027 INFO:teuthology.orchestra.run.smithi008.stdout: "time": "2023-08-01T19:55:09.282705+0000", 2023-08-01T19:55:40.027 INFO:teuthology.orchestra.run.smithi008.stdout: "duration": 0.00013133400000000001 2023-08-01T19:55:40.027 INFO:teuthology.orchestra.run.smithi008.stdout: }, 2023-08-01T19:55:40.027 INFO:teuthology.orchestra.run.smithi008.stdout: { 2023-08-01T19:55:40.027 INFO:teuthology.orchestra.run.smithi008.stdout: "event": "waiting for subops from 1", 2023-08-01T19:55:40.028 INFO:teuthology.orchestra.run.smithi008.stdout: "time": "2023-08-01T19:55:09.283067+0000", 2023-08-01T19:55:40.028 INFO:teuthology.orchestra.run.smithi008.stdout: "duration": 0.00036195299999999998 2023-08-01T19:55:40.028 INFO:teuthology.orchestra.run.smithi008.stdout: }, 2023-08-01T19:55:40.028 INFO:teuthology.orchestra.run.smithi008.stdout: { 2023-08-01T19:55:40.028 INFO:teuthology.orchestra.run.smithi008.stdout: "event": "op_commit", 2023-08-01T19:55:40.028 INFO:teuthology.orchestra.run.smithi008.stdout: "time": "2023-08-01T19:55:09.288196+0000", 2023-08-01T19:55:40.028 INFO:teuthology.orchestra.run.smithi008.stdout: "duration": 0.0051293780000000004 2023-08-01T19:55:40.029 INFO:teuthology.orchestra.run.smithi008.stdout: }, 2023-08-01T19:55:40.029 INFO:teuthology.orchestra.run.smithi008.stdout: { 2023-08-01T19:55:40.029 INFO:teuthology.orchestra.run.smithi008.stdout: "event": "sub_op_commit_rec", 2023-08-01T19:55:40.029 INFO:teuthology.orchestra.run.smithi008.stdout: "time": "2023-08-01T19:55:09.351832+0000", 2023-08-01T19:55:40.029 INFO:teuthology.orchestra.run.smithi008.stdout: "duration": 0.063636076 2023-08-01T19:55:40.029 INFO:teuthology.orchestra.run.smithi008.stdout: }, 2023-08-01T19:55:40.029 INFO:teuthology.orchestra.run.smithi008.stdout: { 2023-08-01T19:55:40.029 INFO:teuthology.orchestra.run.smithi008.stdout: "event": "commit_sent", 2023-08-01T19:55:40.030 INFO:teuthology.orchestra.run.smithi008.stdout: "time": "2023-08-01T19:55:09.351878+0000", 2023-08-01T19:55:40.030 INFO:teuthology.orchestra.run.smithi008.stdout: "duration": 4.5408999999999998e-05 2023-08-01T19:55:40.030 INFO:teuthology.orchestra.run.smithi008.stdout: }, 2023-08-01T19:55:40.030 INFO:teuthology.orchestra.run.smithi008.stdout: { 2023-08-01T19:55:40.030 INFO:teuthology.orchestra.run.smithi008.stdout: "event": "done", 2023-08-01T19:55:40.030 INFO:teuthology.orchestra.run.smithi008.stdout: "time": "2023-08-01T19:55:09.351913+0000", 2023-08-01T19:55:40.030 INFO:teuthology.orchestra.run.smithi008.stdout: "duration": 3.4808999999999998e-05 2023-08-01T19:55:40.030 INFO:teuthology.orchestra.run.smithi008.stdout: } 2023-08-01T19:55:40.031 INFO:teuthology.orchestra.run.smithi008.stdout: ] 2023-08-01T19:55:40.031 INFO:teuthology.orchestra.run.smithi008.stdout: } 2023-08-01T19:55:40.031 INFO:teuthology.orchestra.run.smithi008.stdout: }, 2023-08-01T19:55:40.031 INFO:teuthology.orchestra.run.smithi008.stdout: { 2023-08-01T19:55:40.031 INFO:teuthology.orchestra.run.smithi008.stdout: "description": "osd_op(client.4668.0:107869 5.c 5:31910384:::benchmark_data_smithi006_114134_object107868:head [set-alloc-hint object_size 65536 write_size 65536,write 0~65536] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e38)", 2023-08-01T19:55:40.031 INFO:teuthology.orchestra.run.smithi008.stdout: "initiated_at": "2023-08-01T19:55:09.283205+0000", 2023-08-01T19:55:40.031 INFO:teuthology.orchestra.run.smithi008.stdout: "age": 30.589566275999999, 2023-08-01T19:55:40.031 INFO:teuthology.orchestra.run.smithi008.stdout: "duration": 0.068611808999999996, 2023-08-01T19:55:40.032 INFO:teuthology.orchestra.run.smithi008.stdout: "type_data": { 2023-08-01T19:55:40.032 INFO:teuthology.orchestra.run.smithi008.stdout: "flag_point": "commit sent; apply or cleanup", 2023-08-01T19:55:40.032 INFO:teuthology.orchestra.run.smithi008.stdout: "client_info": { 2023-08-01T19:55:40.032 INFO:teuthology.orchestra.run.smithi008.stdout: "client": "client.4668", 2023-08-01T19:55:40.032 INFO:teuthology.orchestra.run.smithi008.stdout: "client_addr": "172.21.15.6:0/1709472247", 2023-08-01T19:55:40.032 INFO:teuthology.orchestra.run.smithi008.stdout: "tid": 107869 2023-08-01T19:55:40.032 INFO:teuthology.orchestra.run.smithi008.stdout: }, 2023-08-01T19:55:40.032 INFO:teuthology.orchestra.run.smithi008.stdout: "events": [ 2023-08-01T19:55:40.033 INFO:teuthology.orchestra.run.smithi008.stdout: { 2023-08-01T19:55:40.033 INFO:teuthology.orchestra.run.smithi008.stdout: "event": "initiated", 2023-08-01T19:55:40.033 INFO:teuthology.orchestra.run.smithi008.stdout: "time": "2023-08-01T19:55:09.283205+0000", 2023-08-01T19:55:40.033 INFO:teuthology.orchestra.run.smithi008.stdout: "duration": 0 2023-08-01T19:55:40.033 INFO:teuthology.orchestra.run.smithi008.stdout: }, 2023-08-01T19:55:40.033 INFO:teuthology.orchestra.run.smithi008.stdout: { 2023-08-01T19:55:40.033 INFO:teuthology.orchestra.run.smithi008.stdout: "event": "throttled", 2023-08-01T19:55:40.034 INFO:teuthology.orchestra.run.smithi008.stdout: "time": "2023-08-01T19:55:09.283205+0000", 2023-08-01T19:55:40.034 INFO:teuthology.orchestra.run.smithi008.stdout: "duration": 0 2023-08-01T19:55:40.034 INFO:teuthology.orchestra.run.smithi008.stdout: }, 2023-08-01T19:55:40.034 INFO:teuthology.orchestra.run.smithi008.stdout: { 2023-08-01T19:55:40.034 INFO:teuthology.orchestra.run.smithi008.stdout: "event": "header_read", 2023-08-01T19:55:40.034 INFO:teuthology.orchestra.run.smithi008.stdout: "time": "2023-08-01T19:55:09.283204+0000", 2023-08-01T19:55:40.034 INFO:teuthology.orchestra.run.smithi008.stdout: "duration": 4294967295.999999 2023-08-01T19:55:40.034 INFO:teuthology.orchestra.run.smithi008.stdout: }, 2023-08-01T19:55:40.035 INFO:teuthology.orchestra.run.smithi008.stdout: { 2023-08-01T19:55:40.035 INFO:teuthology.orchestra.run.smithi008.stdout: "event": "all_read", 2023-08-01T19:55:40.035 INFO:teuthology.orchestra.run.smithi008.stdout: "time": "2023-08-01T19:55:09.283300+0000", 2023-08-01T19:55:40.035 INFO:teuthology.orchestra.run.smithi008.stdout: "duration": 9.6280000000000007e-05 2023-08-01T19:55:40.035 INFO:teuthology.orchestra.run.smithi008.stdout: }, 2023-08-01T19:55:40.035 INFO:teuthology.orchestra.run.smithi008.stdout: { 2023-08-01T19:55:40.035 INFO:teuthology.orchestra.run.smithi008.stdout: "event": "dispatched", 2023-08-01T19:55:40.035 INFO:teuthology.orchestra.run.smithi008.stdout: "time": "2023-08-01T19:55:09.283314+0000", 2023-08-01T19:55:40.036 INFO:teuthology.orchestra.run.smithi008.stdout: "duration": 1.3344e-05 2023-08-01T19:55:40.036 INFO:teuthology.orchestra.run.smithi008.stdout: }, 2023-08-01T19:55:40.036 INFO:teuthology.orchestra.run.smithi008.stdout: { 2023-08-01T19:55:40.036 INFO:teuthology.orchestra.run.smithi008.stdout: "event": "queued_for_pg", 2023-08-01T19:55:40.036 INFO:teuthology.orchestra.run.smithi008.stdout: "time": "2023-08-01T19:55:09.283320+0000", 2023-08-01T19:55:40.036 INFO:teuthology.orchestra.run.smithi008.stdout: "duration": 6.0299999999999999e-06 2023-08-01T19:55:40.036 INFO:teuthology.orchestra.run.smithi008.stdout: }, 2023-08-01T19:55:40.036 INFO:teuthology.orchestra.run.smithi008.stdout: { 2023-08-01T19:55:40.037 INFO:teuthology.orchestra.run.smithi008.stdout: "event": "reached_pg", 2023-08-01T19:55:40.037 INFO:teuthology.orchestra.run.smithi008.stdout: "time": "2023-08-01T19:55:09.283365+0000", 2023-08-01T19:55:40.037 INFO:teuthology.orchestra.run.smithi008.stdout: "duration": 4.5578999999999998e-05 2023-08-01T19:55:40.037 INFO:teuthology.orchestra.run.smithi008.stdout: }, 2023-08-01T19:55:40.037 INFO:teuthology.orchestra.run.smithi008.stdout: { 2023-08-01T19:55:40.037 INFO:teuthology.orchestra.run.smithi008.stdout: "event": "started", 2023-08-01T19:55:40.037 INFO:teuthology.orchestra.run.smithi008.stdout: "time": "2023-08-01T19:55:09.283490+0000", 2023-08-01T19:55:40.037 INFO:teuthology.orchestra.run.smithi008.stdout: "duration": 0.00012473700000000001 2023-08-01T19:55:40.038 INFO:teuthology.orchestra.run.smithi008.stdout: }, 2023-08-01T19:55:40.038 INFO:teuthology.orchestra.run.smithi008.stdout: { 2023-08-01T19:55:40.038 INFO:teuthology.orchestra.run.smithi008.stdout: "event": "waiting for subops from 1", 2023-08-01T19:55:40.038 INFO:teuthology.orchestra.run.smithi008.stdout: "time": "2023-08-01T19:55:09.283637+0000", 2023-08-01T19:55:40.038 INFO:teuthology.orchestra.run.smithi008.stdout: "duration": 0.00014715600000000001 2023-08-01T19:55:40.038 INFO:teuthology.orchestra.run.smithi008.stdout: }, 2023-08-01T19:55:40.038 INFO:teuthology.orchestra.run.smithi008.stdout: { 2023-08-01T19:55:40.038 INFO:teuthology.orchestra.run.smithi008.stdout: "event": "op_commit", 2023-08-01T19:55:40.039 INFO:teuthology.orchestra.run.smithi008.stdout: "time": "2023-08-01T19:55:09.288214+0000", 2023-08-01T19:55:40.039 INFO:teuthology.orchestra.run.smithi008.stdout: "duration": 0.0045769560000000001 2023-08-01T19:55:40.039 INFO:teuthology.orchestra.run.smithi008.stdout: }, 2023-08-01T19:55:40.039 INFO:teuthology.orchestra.run.smithi008.stdout: { 2023-08-01T19:55:40.039 INFO:teuthology.orchestra.run.smithi008.stdout: "event": "sub_op_commit_rec", 2023-08-01T19:55:40.039 INFO:teuthology.orchestra.run.smithi008.stdout: "time": "2023-08-01T19:55:09.351721+0000", 2023-08-01T19:55:40.039 INFO:teuthology.orchestra.run.smithi008.stdout: "duration": 0.063507383000000001 2023-08-01T19:55:40.040 INFO:teuthology.orchestra.run.smithi008.stdout: }, 2023-08-01T19:55:40.040 INFO:teuthology.orchestra.run.smithi008.stdout: { 2023-08-01T19:55:40.040 INFO:teuthology.orchestra.run.smithi008.stdout: "event": "commit_sent", 2023-08-01T19:55:40.040 INFO:teuthology.orchestra.run.smithi008.stdout: "time": "2023-08-01T19:55:09.351777+0000", 2023-08-01T19:55:40.040 INFO:teuthology.orchestra.run.smithi008.stdout: "duration": 5.5733999999999999e-05 2023-08-01T19:55:40.040 INFO:teuthology.orchestra.run.smithi008.stdout: }, 2023-08-01T19:55:40.040 INFO:teuthology.orchestra.run.smithi008.stdout: { 2023-08-01T19:55:40.040 INFO:teuthology.orchestra.run.smithi008.stdout: "event": "done", 2023-08-01T19:55:40.041 INFO:teuthology.orchestra.run.smithi008.stdout: "time": "2023-08-01T19:55:09.351817+0000", 2023-08-01T19:55:40.041 INFO:teuthology.orchestra.run.smithi008.stdout: "duration": 3.9765000000000003e-05 2023-08-01T19:55:40.041 INFO:teuthology.orchestra.run.smithi008.stdout: } 2023-08-01T19:55:40.041 INFO:teuthology.orchestra.run.smithi008.stdout: ] 2023-08-01T19:55:40.041 INFO:teuthology.orchestra.run.smithi008.stdout: } 2023-08-01T19:55:40.041 INFO:teuthology.orchestra.run.smithi008.stdout: }, 2023-08-01T19:55:40.041 INFO:teuthology.orchestra.run.smithi008.stdout: { 2023-08-01T19:55:40.041 INFO:teuthology.orchestra.run.smithi008.stdout: "description": "osd_op(client.4668.0:107874 5.3 5:ce4c2799:::benchmark_data_smithi006_114134_object107873:head [set-alloc-hint object_size 65536 write_size 65536,write 0~65536] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e38)", 2023-08-01T19:55:40.042 INFO:teuthology.orchestra.run.smithi008.stdout: "initiated_at": "2023-08-01T19:55:09.286239+0000", 2023-08-01T19:55:40.042 INFO:teuthology.orchestra.run.smithi008.stdout: "age": 30.586532771000002, 2023-08-01T19:55:40.042 INFO:teuthology.orchestra.run.smithi008.stdout: "duration": 0.068224389999999996, 2023-08-01T19:55:40.042 INFO:teuthology.orchestra.run.smithi008.stdout: "type_data": { 2023-08-01T19:55:40.042 INFO:teuthology.orchestra.run.smithi008.stdout: "flag_point": "commit sent; apply or cleanup", 2023-08-01T19:55:40.042 INFO:teuthology.orchestra.run.smithi008.stdout: "client_info": { 2023-08-01T19:55:40.042 INFO:teuthology.orchestra.run.smithi008.stdout: "client": "client.4668", 2023-08-01T19:55:40.042 INFO:teuthology.orchestra.run.smithi008.stdout: "client_addr": "172.21.15.6:0/1709472247", 2023-08-01T19:55:40.043 INFO:teuthology.orchestra.run.smithi008.stdout: "tid": 107874 2023-08-01T19:55:40.043 INFO:teuthology.orchestra.run.smithi008.stdout: }, 2023-08-01T19:55:40.043 INFO:teuthology.orchestra.run.smithi008.stdout: "events": [ 2023-08-01T19:55:40.043 INFO:teuthology.orchestra.run.smithi008.stdout: { 2023-08-01T19:55:40.043 INFO:teuthology.orchestra.run.smithi008.stdout: "event": "initiated", 2023-08-01T19:55:40.043 INFO:teuthology.orchestra.run.smithi008.stdout: "time": "2023-08-01T19:55:09.286239+0000", 2023-08-01T19:55:40.043 INFO:teuthology.orchestra.run.smithi008.stdout: "duration": 0 2023-08-01T19:55:40.043 INFO:teuthology.orchestra.run.smithi008.stdout: }, 2023-08-01T19:55:40.044 INFO:teuthology.orchestra.run.smithi008.stdout: { 2023-08-01T19:55:40.044 INFO:teuthology.orchestra.run.smithi008.stdout: "event": "throttled", 2023-08-01T19:55:40.044 INFO:teuthology.orchestra.run.smithi008.stdout: "time": "2023-08-01T19:55:09.286239+0000", 2023-08-01T19:55:40.044 INFO:teuthology.orchestra.run.smithi008.stdout: "duration": 0 2023-08-01T19:55:40.044 INFO:teuthology.orchestra.run.smithi008.stdout: }, 2023-08-01T19:55:40.044 INFO:teuthology.orchestra.run.smithi008.stdout: { 2023-08-01T19:55:40.044 INFO:teuthology.orchestra.run.smithi008.stdout: "event": "header_read", 2023-08-01T19:55:40.045 INFO:teuthology.orchestra.run.smithi008.stdout: "time": "2023-08-01T19:55:09.286238+0000", 2023-08-01T19:55:40.045 INFO:teuthology.orchestra.run.smithi008.stdout: "duration": 4294967295.999999 2023-08-01T19:55:40.045 INFO:teuthology.orchestra.run.smithi008.stdout: }, 2023-08-01T19:55:40.045 INFO:teuthology.orchestra.run.smithi008.stdout: { 2023-08-01T19:55:40.045 INFO:teuthology.orchestra.run.smithi008.stdout: "event": "all_read", 2023-08-01T19:55:40.045 INFO:teuthology.orchestra.run.smithi008.stdout: "time": "2023-08-01T19:55:09.286310+0000", 2023-08-01T19:55:40.045 INFO:teuthology.orchestra.run.smithi008.stdout: "duration": 7.2583999999999995e-05 2023-08-01T19:55:40.045 INFO:teuthology.orchestra.run.smithi008.stdout: }, 2023-08-01T19:55:40.046 INFO:teuthology.orchestra.run.smithi008.stdout: { 2023-08-01T19:55:40.046 INFO:teuthology.orchestra.run.smithi008.stdout: "event": "dispatched", 2023-08-01T19:55:40.046 INFO:teuthology.orchestra.run.smithi008.stdout: "time": "2023-08-01T19:55:09.286323+0000", 2023-08-01T19:55:40.046 INFO:teuthology.orchestra.run.smithi008.stdout: "duration": 1.3151e-05 2023-08-01T19:55:40.046 INFO:teuthology.orchestra.run.smithi008.stdout: }, 2023-08-01T19:55:40.046 INFO:teuthology.orchestra.run.smithi008.stdout: { 2023-08-01T19:55:40.046 INFO:teuthology.orchestra.run.smithi008.stdout: "event": "queued_for_pg", 2023-08-01T19:55:40.046 INFO:teuthology.orchestra.run.smithi008.stdout: "time": "2023-08-01T19:55:09.286329+0000", 2023-08-01T19:55:40.047 INFO:teuthology.orchestra.run.smithi008.stdout: "duration": 5.8719999999999999e-06 2023-08-01T19:55:40.047 INFO:teuthology.orchestra.run.smithi008.stdout: }, 2023-08-01T19:55:40.047 INFO:teuthology.orchestra.run.smithi008.stdout: { 2023-08-01T19:55:40.047 INFO:teuthology.orchestra.run.smithi008.stdout: "event": "reached_pg", 2023-08-01T19:55:40.047 INFO:teuthology.orchestra.run.smithi008.stdout: "time": "2023-08-01T19:55:09.286392+0000", 2023-08-01T19:55:40.047 INFO:teuthology.orchestra.run.smithi008.stdout: "duration": 6.2378000000000005e-05 2023-08-01T19:55:40.047 INFO:teuthology.orchestra.run.smithi008.stdout: }, 2023-08-01T19:55:40.047 INFO:teuthology.orchestra.run.smithi008.stdout: { 2023-08-01T19:55:40.048 INFO:teuthology.orchestra.run.smithi008.stdout: "event": "started", 2023-08-01T19:55:40.048 INFO:teuthology.orchestra.run.smithi008.stdout: "time": "2023-08-01T19:55:09.286473+0000", 2023-08-01T19:55:40.048 INFO:teuthology.orchestra.run.smithi008.stdout: "duration": 8.1327000000000002e-05 2023-08-01T19:55:40.048 INFO:teuthology.orchestra.run.smithi008.stdout: }, 2023-08-01T19:55:40.048 INFO:teuthology.orchestra.run.smithi008.stdout: { 2023-08-01T19:55:40.048 INFO:teuthology.orchestra.run.smithi008.stdout: "event": "waiting for subops from 1", 2023-08-01T19:55:40.048 INFO:teuthology.orchestra.run.smithi008.stdout: "time": "2023-08-01T19:55:09.286557+0000", 2023-08-01T19:55:40.049 INFO:teuthology.orchestra.run.smithi008.stdout: "duration": 8.4140000000000004e-05 2023-08-01T19:55:40.049 INFO:teuthology.orchestra.run.smithi008.stdout: }, 2023-08-01T19:55:40.049 INFO:teuthology.orchestra.run.smithi008.stdout: { 2023-08-01T19:55:40.049 INFO:teuthology.orchestra.run.smithi008.stdout: "event": "op_commit", 2023-08-01T19:55:40.049 INFO:teuthology.orchestra.run.smithi008.stdout: "time": "2023-08-01T19:55:09.290681+0000", 2023-08-01T19:55:40.049 INFO:teuthology.orchestra.run.smithi008.stdout: "duration": 0.0041242420000000002 2023-08-01T19:55:40.049 INFO:teuthology.orchestra.run.smithi008.stdout: }, 2023-08-01T19:55:40.049 INFO:teuthology.orchestra.run.smithi008.stdout: { 2023-08-01T19:55:40.050 INFO:teuthology.orchestra.run.smithi008.stdout: "event": "sub_op_commit_rec", 2023-08-01T19:55:40.050 INFO:teuthology.orchestra.run.smithi008.stdout: "time": "2023-08-01T19:55:09.354372+0000", 2023-08-01T19:55:40.050 INFO:teuthology.orchestra.run.smithi008.stdout: "duration": 0.063690438000000002 2023-08-01T19:55:40.050 INFO:teuthology.orchestra.run.smithi008.stdout: }, 2023-08-01T19:55:40.050 INFO:teuthology.orchestra.run.smithi008.stdout: { 2023-08-01T19:55:40.050 INFO:teuthology.orchestra.run.smithi008.stdout: "event": "commit_sent", 2023-08-01T19:55:40.050 INFO:teuthology.orchestra.run.smithi008.stdout: "time": "2023-08-01T19:55:09.354421+0000", 2023-08-01T19:55:40.050 INFO:teuthology.orchestra.run.smithi008.stdout: "duration": 4.9413000000000003e-05 2023-08-01T19:55:40.051 INFO:teuthology.orchestra.run.smithi008.stdout: }, 2023-08-01T19:55:40.051 INFO:teuthology.orchestra.run.smithi008.stdout: { 2023-08-01T19:55:40.051 INFO:teuthology.orchestra.run.smithi008.stdout: "event": "done", 2023-08-01T19:55:40.051 INFO:teuthology.orchestra.run.smithi008.stdout: "time": "2023-08-01T19:55:09.354463+0000", 2023-08-01T19:55:40.051 INFO:teuthology.orchestra.run.smithi008.stdout: "duration": 4.1924e-05 2023-08-01T19:55:40.051 INFO:teuthology.orchestra.run.smithi008.stdout: } 2023-08-01T19:55:40.051 INFO:teuthology.orchestra.run.smithi008.stdout: ] 2023-08-01T19:55:40.051 INFO:teuthology.orchestra.run.smithi008.stdout: } 2023-08-01T19:55:40.052 INFO:teuthology.orchestra.run.smithi008.stdout: }, 2023-08-01T19:55:40.052 INFO:teuthology.orchestra.run.smithi008.stdout: { 2023-08-01T19:55:40.052 INFO:teuthology.orchestra.run.smithi008.stdout: "description": "osd_op(client.4668.0:107875 5.5 5:af4ec927:::benchmark_data_smithi006_114134_object107874:head [set-alloc-hint object_size 65536 write_size 65536,write 0~65536] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e38)", 2023-08-01T19:55:40.052 INFO:teuthology.orchestra.run.smithi008.stdout: "initiated_at": "2023-08-01T19:55:09.287186+0000", 2023-08-01T19:55:40.052 INFO:teuthology.orchestra.run.smithi008.stdout: "age": 30.585584984, 2023-08-01T19:55:40.052 INFO:teuthology.orchestra.run.smithi008.stdout: "duration": 0.064764719999999998, 2023-08-01T19:55:40.052 INFO:teuthology.orchestra.run.smithi008.stdout: "type_data": { 2023-08-01T19:55:40.053 INFO:teuthology.orchestra.run.smithi008.stdout: "flag_point": "commit sent; apply or cleanup", 2023-08-01T19:55:40.053 INFO:teuthology.orchestra.run.smithi008.stdout: "client_info": { 2023-08-01T19:55:40.053 INFO:teuthology.orchestra.run.smithi008.stdout: "client": "client.4668", 2023-08-01T19:55:40.053 INFO:teuthology.orchestra.run.smithi008.stdout: "client_addr": "172.21.15.6:0/1709472247", 2023-08-01T19:55:40.053 INFO:teuthology.orchestra.run.smithi008.stdout: "tid": 107875 2023-08-01T19:55:40.053 INFO:teuthology.orchestra.run.smithi008.stdout: }, 2023-08-01T19:55:40.053 INFO:teuthology.orchestra.run.smithi008.stdout: "events": [ 2023-08-01T19:55:40.053 INFO:teuthology.orchestra.run.smithi008.stdout: { 2023-08-01T19:55:40.054 INFO:teuthology.orchestra.run.smithi008.stdout: "event": "initiated", 2023-08-01T19:55:40.054 INFO:teuthology.orchestra.run.smithi008.stdout: "time": "2023-08-01T19:55:09.287186+0000", 2023-08-01T19:55:40.054 INFO:teuthology.orchestra.run.smithi008.stdout: "duration": 0 2023-08-01T19:55:40.054 INFO:teuthology.orchestra.run.smithi008.stdout: }, 2023-08-01T19:55:40.054 INFO:teuthology.orchestra.run.smithi008.stdout: { 2023-08-01T19:55:40.054 INFO:teuthology.orchestra.run.smithi008.stdout: "event": "throttled", 2023-08-01T19:55:40.054 INFO:teuthology.orchestra.run.smithi008.stdout: "time": "2023-08-01T19:55:09.287186+0000", 2023-08-01T19:55:40.054 INFO:teuthology.orchestra.run.smithi008.stdout: "duration": 0 2023-08-01T19:55:40.055 INFO:teuthology.orchestra.run.smithi008.stdout: }, 2023-08-01T19:55:40.055 INFO:teuthology.orchestra.run.smithi008.stdout: { 2023-08-01T19:55:40.055 INFO:teuthology.orchestra.run.smithi008.stdout: "event": "header_read", 2023-08-01T19:55:40.055 INFO:teuthology.orchestra.run.smithi008.stdout: "time": "2023-08-01T19:55:09.287186+0000", 2023-08-01T19:55:40.055 INFO:teuthology.orchestra.run.smithi008.stdout: "duration": 4294967295.999999 2023-08-01T19:55:40.055 INFO:teuthology.orchestra.run.smithi008.stdout: }, 2023-08-01T19:55:40.055 INFO:teuthology.orchestra.run.smithi008.stdout: { 2023-08-01T19:55:40.055 INFO:teuthology.orchestra.run.smithi008.stdout: "event": "all_read", 2023-08-01T19:55:40.056 INFO:teuthology.orchestra.run.smithi008.stdout: "time": "2023-08-01T19:55:09.287248+0000", 2023-08-01T19:55:40.056 INFO:teuthology.orchestra.run.smithi008.stdout: "duration": 6.2922000000000005e-05 2023-08-01T19:55:40.056 INFO:teuthology.orchestra.run.smithi008.stdout: }, 2023-08-01T19:55:40.056 INFO:teuthology.orchestra.run.smithi008.stdout: { 2023-08-01T19:55:40.056 INFO:teuthology.orchestra.run.smithi008.stdout: "event": "dispatched", 2023-08-01T19:55:40.056 INFO:teuthology.orchestra.run.smithi008.stdout: "time": "2023-08-01T19:55:09.287261+0000", 2023-08-01T19:55:40.056 INFO:teuthology.orchestra.run.smithi008.stdout: "duration": 1.2364000000000001e-05 2023-08-01T19:55:40.057 INFO:teuthology.orchestra.run.smithi008.stdout: }, 2023-08-01T19:55:40.057 INFO:teuthology.orchestra.run.smithi008.stdout: { 2023-08-01T19:55:40.057 INFO:teuthology.orchestra.run.smithi008.stdout: "event": "queued_for_pg", 2023-08-01T19:55:40.057 INFO:teuthology.orchestra.run.smithi008.stdout: "time": "2023-08-01T19:55:09.287267+0000", 2023-08-01T19:55:40.057 INFO:teuthology.orchestra.run.smithi008.stdout: "duration": 6.2580000000000001e-06 2023-08-01T19:55:40.057 INFO:teuthology.orchestra.run.smithi008.stdout: }, 2023-08-01T19:55:40.057 INFO:teuthology.orchestra.run.smithi008.stdout: { 2023-08-01T19:55:40.057 INFO:teuthology.orchestra.run.smithi008.stdout: "event": "reached_pg", 2023-08-01T19:55:40.058 INFO:teuthology.orchestra.run.smithi008.stdout: "time": "2023-08-01T19:55:09.287306+0000", 2023-08-01T19:55:40.058 INFO:teuthology.orchestra.run.smithi008.stdout: "duration": 3.9057999999999998e-05 2023-08-01T19:55:40.058 INFO:teuthology.orchestra.run.smithi008.stdout: }, 2023-08-01T19:55:40.058 INFO:teuthology.orchestra.run.smithi008.stdout: { 2023-08-01T19:55:40.058 INFO:teuthology.orchestra.run.smithi008.stdout: "event": "started", 2023-08-01T19:55:40.058 INFO:teuthology.orchestra.run.smithi008.stdout: "time": "2023-08-01T19:55:09.287419+0000", 2023-08-01T19:55:40.058 INFO:teuthology.orchestra.run.smithi008.stdout: "duration": 0.000112843 2023-08-01T19:55:40.058 INFO:teuthology.orchestra.run.smithi008.stdout: }, 2023-08-01T19:55:40.059 INFO:teuthology.orchestra.run.smithi008.stdout: { 2023-08-01T19:55:40.059 INFO:teuthology.orchestra.run.smithi008.stdout: "event": "waiting for subops from 1", 2023-08-01T19:55:40.059 INFO:teuthology.orchestra.run.smithi008.stdout: "time": "2023-08-01T19:55:09.287514+0000", 2023-08-01T19:55:40.059 INFO:teuthology.orchestra.run.smithi008.stdout: "duration": 9.5068000000000005e-05 2023-08-01T19:55:40.059 INFO:teuthology.orchestra.run.smithi008.stdout: }, 2023-08-01T19:55:40.059 INFO:teuthology.orchestra.run.smithi008.stdout: { 2023-08-01T19:55:40.059 INFO:teuthology.orchestra.run.smithi008.stdout: "event": "op_commit", 2023-08-01T19:55:40.059 INFO:teuthology.orchestra.run.smithi008.stdout: "time": "2023-08-01T19:55:09.293891+0000", 2023-08-01T19:55:40.060 INFO:teuthology.orchestra.run.smithi008.stdout: "duration": 0.00637712 2023-08-01T19:55:40.060 INFO:teuthology.orchestra.run.smithi008.stdout: }, 2023-08-01T19:55:40.060 INFO:teuthology.orchestra.run.smithi008.stdout: { 2023-08-01T19:55:40.060 INFO:teuthology.orchestra.run.smithi008.stdout: "event": "sub_op_commit_rec", 2023-08-01T19:55:40.060 INFO:teuthology.orchestra.run.smithi008.stdout: "time": "2023-08-01T19:55:09.351871+0000", 2023-08-01T19:55:40.060 INFO:teuthology.orchestra.run.smithi008.stdout: "duration": 0.057980054000000003 2023-08-01T19:55:40.060 INFO:teuthology.orchestra.run.smithi008.stdout: }, 2023-08-01T19:55:40.060 INFO:teuthology.orchestra.run.smithi008.stdout: { 2023-08-01T19:55:40.061 INFO:teuthology.orchestra.run.smithi008.stdout: "event": "commit_sent", 2023-08-01T19:55:40.061 INFO:teuthology.orchestra.run.smithi008.stdout: "time": "2023-08-01T19:55:09.351917+0000", 2023-08-01T19:55:40.061 INFO:teuthology.orchestra.run.smithi008.stdout: "duration": 4.5501999999999999e-05 2023-08-01T19:55:40.061 INFO:teuthology.orchestra.run.smithi008.stdout: }, 2023-08-01T19:55:40.061 INFO:teuthology.orchestra.run.smithi008.stdout: { 2023-08-01T19:55:40.061 INFO:teuthology.orchestra.run.smithi008.stdout: "event": "done", 2023-08-01T19:55:40.061 INFO:teuthology.orchestra.run.smithi008.stdout: "time": "2023-08-01T19:55:09.351951+0000", 2023-08-01T19:55:40.062 INFO:teuthology.orchestra.run.smithi008.stdout: "duration": 3.4450999999999999e-05 2023-08-01T19:55:40.062 INFO:teuthology.orchestra.run.smithi008.stdout: } 2023-08-01T19:55:40.062 INFO:teuthology.orchestra.run.smithi008.stdout: ] 2023-08-01T19:55:40.062 INFO:teuthology.orchestra.run.smithi008.stdout: } 2023-08-01T19:55:40.062 INFO:teuthology.orchestra.run.smithi008.stdout: }, 2023-08-01T19:55:40.062 INFO:teuthology.orchestra.run.smithi008.stdout: { 2023-08-01T19:55:40.062 INFO:teuthology.orchestra.run.smithi008.stdout: "description": "osd_op(client.4668.0:107880 5.5 5:a8d12d4b:::benchmark_data_smithi006_114134_object107879:head [set-alloc-hint object_size 65536 write_size 65536,write 0~65536] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e38)", 2023-08-01T19:55:40.062 INFO:teuthology.orchestra.run.smithi008.stdout: "initiated_at": "2023-08-01T19:55:09.292335+0000", 2023-08-01T19:55:40.063 INFO:teuthology.orchestra.run.smithi008.stdout: "age": 30.580436382999999, 2023-08-01T19:55:40.063 INFO:teuthology.orchestra.run.smithi008.stdout: "duration": 0.061350719999999997, 2023-08-01T19:55:40.063 INFO:teuthology.orchestra.run.smithi008.stdout: "type_data": { 2023-08-01T19:55:40.063 INFO:teuthology.orchestra.run.smithi008.stdout: "flag_point": "commit sent; apply or cleanup", 2023-08-01T19:55:40.063 INFO:teuthology.orchestra.run.smithi008.stdout: "client_info": { 2023-08-01T19:55:40.063 INFO:teuthology.orchestra.run.smithi008.stdout: "client": "client.4668", 2023-08-01T19:55:40.063 INFO:teuthology.orchestra.run.smithi008.stdout: "client_addr": "172.21.15.6:0/1709472247", 2023-08-01T19:55:40.063 INFO:teuthology.orchestra.run.smithi008.stdout: "tid": 107880 2023-08-01T19:55:40.064 INFO:teuthology.orchestra.run.smithi008.stdout: }, 2023-08-01T19:55:40.064 INFO:teuthology.orchestra.run.smithi008.stdout: "events": [ 2023-08-01T19:55:40.064 INFO:teuthology.orchestra.run.smithi008.stdout: { 2023-08-01T19:55:40.064 INFO:teuthology.orchestra.run.smithi008.stdout: "event": "initiated", 2023-08-01T19:55:40.064 INFO:teuthology.orchestra.run.smithi008.stdout: "time": "2023-08-01T19:55:09.292335+0000", 2023-08-01T19:55:40.064 INFO:teuthology.orchestra.run.smithi008.stdout: "duration": 0 2023-08-01T19:55:40.064 INFO:teuthology.orchestra.run.smithi008.stdout: }, 2023-08-01T19:55:40.064 INFO:teuthology.orchestra.run.smithi008.stdout: { 2023-08-01T19:55:40.065 INFO:teuthology.orchestra.run.smithi008.stdout: "event": "throttled", 2023-08-01T19:55:40.065 INFO:teuthology.orchestra.run.smithi008.stdout: "time": "2023-08-01T19:55:09.292335+0000", 2023-08-01T19:55:40.065 INFO:teuthology.orchestra.run.smithi008.stdout: "duration": 0 2023-08-01T19:55:40.065 INFO:teuthology.orchestra.run.smithi008.stdout: }, 2023-08-01T19:55:40.065 INFO:teuthology.orchestra.run.smithi008.stdout: { 2023-08-01T19:55:40.065 INFO:teuthology.orchestra.run.smithi008.stdout: "event": "header_read", 2023-08-01T19:55:40.065 INFO:teuthology.orchestra.run.smithi008.stdout: "time": "2023-08-01T19:55:09.292334+0000", 2023-08-01T19:55:40.065 INFO:teuthology.orchestra.run.smithi008.stdout: "duration": 4294967295.999999 2023-08-01T19:55:40.066 INFO:teuthology.orchestra.run.smithi008.stdout: }, 2023-08-01T19:55:40.066 INFO:teuthology.orchestra.run.smithi008.stdout: { 2023-08-01T19:55:40.066 INFO:teuthology.orchestra.run.smithi008.stdout: "event": "all_read", 2023-08-01T19:55:40.066 INFO:teuthology.orchestra.run.smithi008.stdout: "time": "2023-08-01T19:55:09.292449+0000", 2023-08-01T19:55:40.066 INFO:teuthology.orchestra.run.smithi008.stdout: "duration": 0.00011551400000000001 2023-08-01T19:55:40.066 INFO:teuthology.orchestra.run.smithi008.stdout: }, 2023-08-01T19:55:40.066 INFO:teuthology.orchestra.run.smithi008.stdout: { 2023-08-01T19:55:40.067 INFO:teuthology.orchestra.run.smithi008.stdout: "event": "dispatched", 2023-08-01T19:55:40.067 INFO:teuthology.orchestra.run.smithi008.stdout: "time": "2023-08-01T19:55:09.292461+0000", 2023-08-01T19:55:40.067 INFO:teuthology.orchestra.run.smithi008.stdout: "duration": 1.1287000000000001e-05 2023-08-01T19:55:40.067 INFO:teuthology.orchestra.run.smithi008.stdout: }, 2023-08-01T19:55:40.067 INFO:teuthology.orchestra.run.smithi008.stdout: { 2023-08-01T19:55:40.067 INFO:teuthology.orchestra.run.smithi008.stdout: "event": "queued_for_pg", 2023-08-01T19:55:40.067 INFO:teuthology.orchestra.run.smithi008.stdout: "time": "2023-08-01T19:55:09.292467+0000", 2023-08-01T19:55:40.067 INFO:teuthology.orchestra.run.smithi008.stdout: "duration": 6.4520000000000002e-06 2023-08-01T19:55:40.068 INFO:teuthology.orchestra.run.smithi008.stdout: }, 2023-08-01T19:55:40.068 INFO:teuthology.orchestra.run.smithi008.stdout: { 2023-08-01T19:55:40.068 INFO:teuthology.orchestra.run.smithi008.stdout: "event": "reached_pg", 2023-08-01T19:55:40.068 INFO:teuthology.orchestra.run.smithi008.stdout: "time": "2023-08-01T19:55:09.292510+0000", 2023-08-01T19:55:40.068 INFO:teuthology.orchestra.run.smithi008.stdout: "duration": 4.2502000000000001e-05 2023-08-01T19:55:40.068 INFO:teuthology.orchestra.run.smithi008.stdout: }, 2023-08-01T19:55:40.068 INFO:teuthology.orchestra.run.smithi008.stdout: { 2023-08-01T19:55:40.068 INFO:teuthology.orchestra.run.smithi008.stdout: "event": "started", 2023-08-01T19:55:40.069 INFO:teuthology.orchestra.run.smithi008.stdout: "time": "2023-08-01T19:55:09.292596+0000", 2023-08-01T19:55:40.069 INFO:teuthology.orchestra.run.smithi008.stdout: "duration": 8.6545000000000006e-05 2023-08-01T19:55:40.069 INFO:teuthology.orchestra.run.smithi008.stdout: }, 2023-08-01T19:55:40.069 INFO:teuthology.orchestra.run.smithi008.stdout: { 2023-08-01T19:55:40.069 INFO:teuthology.orchestra.run.smithi008.stdout: "event": "waiting for subops from 1", 2023-08-01T19:55:40.069 INFO:teuthology.orchestra.run.smithi008.stdout: "time": "2023-08-01T19:55:09.292697+0000", 2023-08-01T19:55:40.069 INFO:teuthology.orchestra.run.smithi008.stdout: "duration": 0.000100368 2023-08-01T19:55:40.069 INFO:teuthology.orchestra.run.smithi008.stdout: }, 2023-08-01T19:55:40.070 INFO:teuthology.orchestra.run.smithi008.stdout: { 2023-08-01T19:55:40.070 INFO:teuthology.orchestra.run.smithi008.stdout: "event": "op_commit", 2023-08-01T19:55:40.070 INFO:teuthology.orchestra.run.smithi008.stdout: "time": "2023-08-01T19:55:09.295658+0000", 2023-08-01T19:55:40.070 INFO:teuthology.orchestra.run.smithi008.stdout: "duration": 0.0029617290000000002 2023-08-01T19:55:40.070 INFO:teuthology.orchestra.run.smithi008.stdout: }, 2023-08-01T19:55:40.070 INFO:teuthology.orchestra.run.smithi008.stdout: { 2023-08-01T19:55:40.070 INFO:teuthology.orchestra.run.smithi008.stdout: "event": "sub_op_commit_rec", 2023-08-01T19:55:40.070 INFO:teuthology.orchestra.run.smithi008.stdout: "time": "2023-08-01T19:55:09.353604+0000", 2023-08-01T19:55:40.071 INFO:teuthology.orchestra.run.smithi008.stdout: "duration": 0.057945868999999997 2023-08-01T19:55:40.071 INFO:teuthology.orchestra.run.smithi008.stdout: }, 2023-08-01T19:55:40.071 INFO:teuthology.orchestra.run.smithi008.stdout: { 2023-08-01T19:55:40.071 INFO:teuthology.orchestra.run.smithi008.stdout: "event": "commit_sent", 2023-08-01T19:55:40.071 INFO:teuthology.orchestra.run.smithi008.stdout: "time": "2023-08-01T19:55:09.353650+0000", 2023-08-01T19:55:40.071 INFO:teuthology.orchestra.run.smithi008.stdout: "duration": 4.5698999999999997e-05 2023-08-01T19:55:40.071 INFO:teuthology.orchestra.run.smithi008.stdout: }, 2023-08-01T19:55:40.071 INFO:teuthology.orchestra.run.smithi008.stdout: { 2023-08-01T19:55:40.072 INFO:teuthology.orchestra.run.smithi008.stdout: "event": "done", 2023-08-01T19:55:40.072 INFO:teuthology.orchestra.run.smithi008.stdout: "time": "2023-08-01T19:55:09.353686+0000", 2023-08-01T19:55:40.072 INFO:teuthology.orchestra.run.smithi008.stdout: "duration": 3.5936999999999998e-05 2023-08-01T19:55:40.072 INFO:teuthology.orchestra.run.smithi008.stdout: } 2023-08-01T19:55:40.072 INFO:teuthology.orchestra.run.smithi008.stdout: ] 2023-08-01T19:55:40.072 INFO:teuthology.orchestra.run.smithi008.stdout: } 2023-08-01T19:55:40.072 INFO:teuthology.orchestra.run.smithi008.stdout: } 2023-08-01T19:55:40.073 INFO:teuthology.orchestra.run.smithi008.stdout: ] 2023-08-01T19:55:40.073 INFO:teuthology.orchestra.run.smithi008.stdout:} 2023-08-01T19:55:40.074 INFO:teuthology.orchestra.run.smithi006.stderr:noscrub is unset 2023-08-01T19:55:40.075 DEBUG:teuthology.orchestra.run.smithi101:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 30 ceph --cluster ceph --admin-daemon /var/run/ceph/ceph-osd.1.asok dump_ops_in_flight 2023-08-01T19:55:40.075 INFO:tasks.ceph.osd.0.smithi008.stderr:2023-08-01T19:55:40.072+0000 7f16a58f4700 -1 received signal: Hangup from /usr/bin/python3 /bin/daemon-helper kill ceph-osd -f --cluster ceph -i 0 (PID: 111179) UID: 0 2023-08-01T19:55:40.174 INFO:tasks.ceph.osd.0.smithi008.stderr:2023-08-01T19:55:40.172+0000 7f16a58f4700 -1 received signal: Hangup from /usr/bin/python3 /bin/daemon-helper kill ceph-osd -f --cluster ceph -i 0 (PID: 111179) UID: 0 2023-08-01T19:55:40.229 INFO:teuthology.orchestra.run.smithi101.stdout:{ 2023-08-01T19:55:40.229 INFO:teuthology.orchestra.run.smithi101.stdout: "ops": [ 2023-08-01T19:55:40.229 INFO:teuthology.orchestra.run.smithi101.stdout: { 2023-08-01T19:55:40.229 INFO:teuthology.orchestra.run.smithi101.stdout: "description": "osd_op(client.4668.0:164021 5.7 5:e7ddd909:::benchmark_data_smithi006_114134_object30360:head [delete] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e51)", 2023-08-01T19:55:40.230 INFO:teuthology.orchestra.run.smithi101.stdout: "initiated_at": "2023-08-01T19:55:40.220512+0000", 2023-08-01T19:55:40.230 INFO:teuthology.orchestra.run.smithi101.stdout: "age": 0.0069856670000000001, 2023-08-01T19:55:40.230 INFO:teuthology.orchestra.run.smithi101.stdout: "duration": 0.0070031019999999998, 2023-08-01T19:55:40.230 INFO:teuthology.orchestra.run.smithi101.stdout: "type_data": { 2023-08-01T19:55:40.230 INFO:teuthology.orchestra.run.smithi101.stdout: "flag_point": "waiting for sub ops", 2023-08-01T19:55:40.230 INFO:teuthology.orchestra.run.smithi101.stdout: "client_info": { 2023-08-01T19:55:40.230 INFO:teuthology.orchestra.run.smithi101.stdout: "client": "client.4668", 2023-08-01T19:55:40.230 INFO:teuthology.orchestra.run.smithi101.stdout: "client_addr": "172.21.15.6:0/1709472247", 2023-08-01T19:55:40.231 INFO:teuthology.orchestra.run.smithi101.stdout: "tid": 164021 2023-08-01T19:55:40.231 INFO:teuthology.orchestra.run.smithi101.stdout: }, 2023-08-01T19:55:40.231 INFO:teuthology.orchestra.run.smithi101.stdout: "events": [ 2023-08-01T19:55:40.231 INFO:teuthology.orchestra.run.smithi101.stdout: { 2023-08-01T19:55:40.231 INFO:teuthology.orchestra.run.smithi101.stdout: "event": "initiated", 2023-08-01T19:55:40.231 INFO:teuthology.orchestra.run.smithi101.stdout: "time": "2023-08-01T19:55:40.220512+0000", 2023-08-01T19:55:40.231 INFO:teuthology.orchestra.run.smithi101.stdout: "duration": 0 2023-08-01T19:55:40.231 INFO:teuthology.orchestra.run.smithi101.stdout: }, 2023-08-01T19:55:40.232 INFO:teuthology.orchestra.run.smithi101.stdout: { 2023-08-01T19:55:40.232 INFO:teuthology.orchestra.run.smithi101.stdout: "event": "throttled", 2023-08-01T19:55:40.232 INFO:teuthology.orchestra.run.smithi101.stdout: "time": "2023-08-01T19:55:40.220512+0000", 2023-08-01T19:55:40.232 INFO:teuthology.orchestra.run.smithi101.stdout: "duration": 0 2023-08-01T19:55:40.232 INFO:teuthology.orchestra.run.smithi101.stdout: }, 2023-08-01T19:55:40.232 INFO:teuthology.orchestra.run.smithi101.stdout: { 2023-08-01T19:55:40.232 INFO:teuthology.orchestra.run.smithi101.stdout: "event": "header_read", 2023-08-01T19:55:40.233 INFO:teuthology.orchestra.run.smithi101.stdout: "time": "2023-08-01T19:55:40.220511+0000", 2023-08-01T19:55:40.233 INFO:teuthology.orchestra.run.smithi101.stdout: "duration": 4294967295.999999 2023-08-01T19:55:40.233 INFO:teuthology.orchestra.run.smithi101.stdout: }, 2023-08-01T19:55:40.233 INFO:teuthology.orchestra.run.smithi101.stdout: { 2023-08-01T19:55:40.233 INFO:teuthology.orchestra.run.smithi101.stdout: "event": "all_read", 2023-08-01T19:55:40.233 INFO:teuthology.orchestra.run.smithi101.stdout: "time": "2023-08-01T19:55:40.220516+0000", 2023-08-01T19:55:40.233 INFO:teuthology.orchestra.run.smithi101.stdout: "duration": 4.8069999999999999e-06 2023-08-01T19:55:40.233 INFO:teuthology.orchestra.run.smithi101.stdout: }, 2023-08-01T19:55:40.234 INFO:teuthology.orchestra.run.smithi101.stdout: { 2023-08-01T19:55:40.234 INFO:teuthology.orchestra.run.smithi101.stdout: "event": "dispatched", 2023-08-01T19:55:40.234 INFO:teuthology.orchestra.run.smithi101.stdout: "time": "2023-08-01T19:55:40.220526+0000", 2023-08-01T19:55:40.234 INFO:teuthology.orchestra.run.smithi101.stdout: "duration": 9.9930000000000007e-06 2023-08-01T19:55:40.234 INFO:teuthology.orchestra.run.smithi101.stdout: }, 2023-08-01T19:55:40.234 INFO:teuthology.orchestra.run.smithi101.stdout: { 2023-08-01T19:55:40.234 INFO:teuthology.orchestra.run.smithi101.stdout: "event": "queued_for_pg", 2023-08-01T19:55:40.234 INFO:teuthology.orchestra.run.smithi101.stdout: "time": "2023-08-01T19:55:40.220531+0000", 2023-08-01T19:55:40.235 INFO:teuthology.orchestra.run.smithi101.stdout: "duration": 5.4310000000000002e-06 2023-08-01T19:55:40.235 INFO:teuthology.orchestra.run.smithi101.stdout: }, 2023-08-01T19:55:40.235 INFO:teuthology.orchestra.run.smithi101.stdout: { 2023-08-01T19:55:40.235 INFO:teuthology.orchestra.run.smithi101.stdout: "event": "reached_pg", 2023-08-01T19:55:40.235 INFO:teuthology.orchestra.run.smithi101.stdout: "time": "2023-08-01T19:55:40.220571+0000", 2023-08-01T19:55:40.235 INFO:teuthology.orchestra.run.smithi101.stdout: "duration": 4.0083999999999998e-05 2023-08-01T19:55:40.235 INFO:teuthology.orchestra.run.smithi101.stdout: }, 2023-08-01T19:55:40.236 INFO:teuthology.orchestra.run.smithi101.stdout: { 2023-08-01T19:55:40.236 INFO:teuthology.orchestra.run.smithi101.stdout: "event": "started", 2023-08-01T19:55:40.236 INFO:teuthology.orchestra.run.smithi101.stdout: "time": "2023-08-01T19:55:40.220713+0000", 2023-08-01T19:55:40.236 INFO:teuthology.orchestra.run.smithi101.stdout: "duration": 0.00014157300000000001 2023-08-01T19:55:40.236 INFO:teuthology.orchestra.run.smithi101.stdout: }, 2023-08-01T19:55:40.236 INFO:teuthology.orchestra.run.smithi101.stdout: { 2023-08-01T19:55:40.236 INFO:teuthology.orchestra.run.smithi101.stdout: "event": "waiting for subops from 0", 2023-08-01T19:55:40.236 INFO:teuthology.orchestra.run.smithi101.stdout: "time": "2023-08-01T19:55:40.220833+0000", 2023-08-01T19:55:40.237 INFO:teuthology.orchestra.run.smithi101.stdout: "duration": 0.00012036699999999999 2023-08-01T19:55:40.237 INFO:teuthology.orchestra.run.smithi101.stdout: }, 2023-08-01T19:55:40.237 INFO:teuthology.orchestra.run.smithi101.stdout: { 2023-08-01T19:55:40.237 INFO:teuthology.orchestra.run.smithi101.stdout: "event": "op_commit", 2023-08-01T19:55:40.237 INFO:teuthology.orchestra.run.smithi101.stdout: "time": "2023-08-01T19:55:40.224274+0000", 2023-08-01T19:55:40.237 INFO:teuthology.orchestra.run.smithi101.stdout: "duration": 0.0034403950000000002 2023-08-01T19:55:40.237 INFO:teuthology.orchestra.run.smithi101.stdout: } 2023-08-01T19:55:40.237 INFO:teuthology.orchestra.run.smithi101.stdout: ] 2023-08-01T19:55:40.238 INFO:teuthology.orchestra.run.smithi101.stdout: } 2023-08-01T19:55:40.238 INFO:teuthology.orchestra.run.smithi101.stdout: }, 2023-08-01T19:55:40.238 INFO:teuthology.orchestra.run.smithi101.stdout: { 2023-08-01T19:55:40.238 INFO:teuthology.orchestra.run.smithi101.stdout: "description": "osd_repop(client.4668.0:164027 5.f e51/40 5:f5b9387a:::benchmark_data_smithi006_114134_object30366:head v 51'10277, mlcod=51'10275)", 2023-08-01T19:55:40.238 INFO:teuthology.orchestra.run.smithi101.stdout: "initiated_at": "2023-08-01T19:55:40.224911+0000", 2023-08-01T19:55:40.238 INFO:teuthology.orchestra.run.smithi101.stdout: "age": 0.0025862490000000001, 2023-08-01T19:55:40.238 INFO:teuthology.orchestra.run.smithi101.stdout: "duration": 0.002659163, 2023-08-01T19:55:40.238 INFO:teuthology.orchestra.run.smithi101.stdout: "type_data": { 2023-08-01T19:55:40.239 INFO:teuthology.orchestra.run.smithi101.stdout: "flag_point": "started", 2023-08-01T19:55:40.239 INFO:teuthology.orchestra.run.smithi101.stdout: "events": [ 2023-08-01T19:55:40.239 INFO:teuthology.orchestra.run.smithi101.stdout: { 2023-08-01T19:55:40.239 INFO:teuthology.orchestra.run.smithi101.stdout: "event": "initiated", 2023-08-01T19:55:40.239 INFO:teuthology.orchestra.run.smithi101.stdout: "time": "2023-08-01T19:55:40.224911+0000", 2023-08-01T19:55:40.239 INFO:teuthology.orchestra.run.smithi101.stdout: "duration": 0 2023-08-01T19:55:40.239 INFO:teuthology.orchestra.run.smithi101.stdout: }, 2023-08-01T19:55:40.239 INFO:teuthology.orchestra.run.smithi101.stdout: { 2023-08-01T19:55:40.240 INFO:teuthology.orchestra.run.smithi101.stdout: "event": "throttled", 2023-08-01T19:55:40.240 INFO:teuthology.orchestra.run.smithi101.stdout: "time": "2023-08-01T19:55:40.224911+0000", 2023-08-01T19:55:40.240 INFO:teuthology.orchestra.run.smithi101.stdout: "duration": 0 2023-08-01T19:55:40.240 INFO:teuthology.orchestra.run.smithi101.stdout: }, 2023-08-01T19:55:40.240 INFO:teuthology.orchestra.run.smithi101.stdout: { 2023-08-01T19:55:40.240 INFO:teuthology.orchestra.run.smithi101.stdout: "event": "header_read", 2023-08-01T19:55:40.240 INFO:teuthology.orchestra.run.smithi101.stdout: "time": "2023-08-01T19:55:40.224911+0000", 2023-08-01T19:55:40.241 INFO:teuthology.orchestra.run.smithi101.stdout: "duration": 4294967295.9999995 2023-08-01T19:55:40.241 INFO:teuthology.orchestra.run.smithi101.stdout: }, 2023-08-01T19:55:40.241 INFO:teuthology.orchestra.run.smithi101.stdout: { 2023-08-01T19:55:40.241 INFO:teuthology.orchestra.run.smithi101.stdout: "event": "all_read", 2023-08-01T19:55:40.241 INFO:teuthology.orchestra.run.smithi101.stdout: "time": "2023-08-01T19:55:40.224915+0000", 2023-08-01T19:55:40.241 INFO:teuthology.orchestra.run.smithi101.stdout: "duration": 3.9870000000000001e-06 2023-08-01T19:55:40.241 INFO:teuthology.orchestra.run.smithi101.stdout: }, 2023-08-01T19:55:40.241 INFO:teuthology.orchestra.run.smithi101.stdout: { 2023-08-01T19:55:40.242 INFO:teuthology.orchestra.run.smithi101.stdout: "event": "dispatched", 2023-08-01T19:55:40.242 INFO:teuthology.orchestra.run.smithi101.stdout: "time": "2023-08-01T19:55:40.224922+0000", 2023-08-01T19:55:40.242 INFO:teuthology.orchestra.run.smithi101.stdout: "duration": 7.5179999999999998e-06 2023-08-01T19:55:40.242 INFO:teuthology.orchestra.run.smithi101.stdout: }, 2023-08-01T19:55:40.242 INFO:teuthology.orchestra.run.smithi101.stdout: { 2023-08-01T19:55:40.242 INFO:teuthology.orchestra.run.smithi101.stdout: "event": "queued_for_pg", 2023-08-01T19:55:40.242 INFO:teuthology.orchestra.run.smithi101.stdout: "time": "2023-08-01T19:55:40.224928+0000", 2023-08-01T19:55:40.242 INFO:teuthology.orchestra.run.smithi101.stdout: "duration": 5.2850000000000002e-06 2023-08-01T19:55:40.243 INFO:teuthology.orchestra.run.smithi101.stdout: }, 2023-08-01T19:55:40.243 INFO:teuthology.orchestra.run.smithi101.stdout: { 2023-08-01T19:55:40.243 INFO:teuthology.orchestra.run.smithi101.stdout: "event": "reached_pg", 2023-08-01T19:55:40.243 INFO:teuthology.orchestra.run.smithi101.stdout: "time": "2023-08-01T19:55:40.224964+0000", 2023-08-01T19:55:40.243 INFO:teuthology.orchestra.run.smithi101.stdout: "duration": 3.6409999999999999e-05 2023-08-01T19:55:40.243 INFO:teuthology.orchestra.run.smithi101.stdout: }, 2023-08-01T19:55:40.243 INFO:teuthology.orchestra.run.smithi101.stdout: { 2023-08-01T19:55:40.243 INFO:teuthology.orchestra.run.smithi101.stdout: "event": "started", 2023-08-01T19:55:40.244 INFO:teuthology.orchestra.run.smithi101.stdout: "time": "2023-08-01T19:55:40.224982+0000", 2023-08-01T19:55:40.244 INFO:teuthology.orchestra.run.smithi101.stdout: "duration": 1.838e-05 2023-08-01T19:55:40.244 INFO:teuthology.orchestra.run.smithi101.stdout: } 2023-08-01T19:55:40.244 INFO:teuthology.orchestra.run.smithi101.stdout: ] 2023-08-01T19:55:40.244 INFO:teuthology.orchestra.run.smithi101.stdout: } 2023-08-01T19:55:40.244 INFO:teuthology.orchestra.run.smithi101.stdout: }, 2023-08-01T19:55:40.244 INFO:teuthology.orchestra.run.smithi101.stdout: { 2023-08-01T19:55:40.244 INFO:teuthology.orchestra.run.smithi101.stdout: "description": "osd_repop(client.4668.0:164026 5.2 e51/40 5:435d36b1:::benchmark_data_smithi006_114134_object30365:head v 51'10534, mlcod=51'10530)", 2023-08-01T19:55:40.245 INFO:teuthology.orchestra.run.smithi101.stdout: "initiated_at": "2023-08-01T19:55:40.224953+0000", 2023-08-01T19:55:40.245 INFO:teuthology.orchestra.run.smithi101.stdout: "age": 0.002544129, 2023-08-01T19:55:40.245 INFO:teuthology.orchestra.run.smithi101.stdout: "duration": 0.0026592360000000002, 2023-08-01T19:55:40.245 INFO:teuthology.orchestra.run.smithi101.stdout: "type_data": { 2023-08-01T19:55:40.245 INFO:teuthology.orchestra.run.smithi101.stdout: "flag_point": "started", 2023-08-01T19:55:40.245 INFO:teuthology.orchestra.run.smithi101.stdout: "events": [ 2023-08-01T19:55:40.245 INFO:teuthology.orchestra.run.smithi101.stdout: { 2023-08-01T19:55:40.245 INFO:teuthology.orchestra.run.smithi101.stdout: "event": "initiated", 2023-08-01T19:55:40.246 INFO:teuthology.orchestra.run.smithi101.stdout: "time": "2023-08-01T19:55:40.224953+0000", 2023-08-01T19:55:40.246 INFO:teuthology.orchestra.run.smithi101.stdout: "duration": 0 2023-08-01T19:55:40.246 INFO:teuthology.orchestra.run.smithi101.stdout: }, 2023-08-01T19:55:40.246 INFO:teuthology.orchestra.run.smithi101.stdout: { 2023-08-01T19:55:40.246 INFO:teuthology.orchestra.run.smithi101.stdout: "event": "throttled", 2023-08-01T19:55:40.246 INFO:teuthology.orchestra.run.smithi101.stdout: "time": "2023-08-01T19:55:40.224953+0000", 2023-08-01T19:55:40.246 INFO:teuthology.orchestra.run.smithi101.stdout: "duration": 0 2023-08-01T19:55:40.247 INFO:teuthology.orchestra.run.smithi101.stdout: }, 2023-08-01T19:55:40.247 INFO:teuthology.orchestra.run.smithi101.stdout: { 2023-08-01T19:55:40.247 INFO:teuthology.orchestra.run.smithi101.stdout: "event": "header_read", 2023-08-01T19:55:40.247 INFO:teuthology.orchestra.run.smithi101.stdout: "time": "2023-08-01T19:55:40.224953+0000", 2023-08-01T19:55:40.247 INFO:teuthology.orchestra.run.smithi101.stdout: "duration": 4294967295.9999995 2023-08-01T19:55:40.247 INFO:teuthology.orchestra.run.smithi101.stdout: }, 2023-08-01T19:55:40.247 INFO:teuthology.orchestra.run.smithi101.stdout: { 2023-08-01T19:55:40.248 INFO:teuthology.orchestra.run.smithi101.stdout: "event": "all_read", 2023-08-01T19:55:40.248 INFO:teuthology.orchestra.run.smithi101.stdout: "time": "2023-08-01T19:55:40.224958+0000", 2023-08-01T19:55:40.248 INFO:teuthology.orchestra.run.smithi101.stdout: "duration": 5.57e-06 2023-08-01T19:55:40.248 INFO:teuthology.orchestra.run.smithi101.stdout: }, 2023-08-01T19:55:40.248 INFO:teuthology.orchestra.run.smithi101.stdout: { 2023-08-01T19:55:40.248 INFO:teuthology.orchestra.run.smithi101.stdout: "event": "dispatched", 2023-08-01T19:55:40.248 INFO:teuthology.orchestra.run.smithi101.stdout: "time": "2023-08-01T19:55:40.224966+0000", 2023-08-01T19:55:40.248 INFO:teuthology.orchestra.run.smithi101.stdout: "duration": 8.0649999999999999e-06 2023-08-01T19:55:40.249 INFO:teuthology.orchestra.run.smithi101.stdout: }, 2023-08-01T19:55:40.249 INFO:teuthology.orchestra.run.smithi101.stdout: { 2023-08-01T19:55:40.249 INFO:teuthology.orchestra.run.smithi101.stdout: "event": "queued_for_pg", 2023-08-01T19:55:40.249 INFO:teuthology.orchestra.run.smithi101.stdout: "time": "2023-08-01T19:55:40.224971+0000", 2023-08-01T19:55:40.249 INFO:teuthology.orchestra.run.smithi101.stdout: "duration": 4.7280000000000003e-06 2023-08-01T19:55:40.249 INFO:teuthology.orchestra.run.smithi101.stdout: }, 2023-08-01T19:55:40.249 INFO:teuthology.orchestra.run.smithi101.stdout: { 2023-08-01T19:55:40.249 INFO:teuthology.orchestra.run.smithi101.stdout: "event": "reached_pg", 2023-08-01T19:55:40.250 INFO:teuthology.orchestra.run.smithi101.stdout: "time": "2023-08-01T19:55:40.225003+0000", 2023-08-01T19:55:40.250 INFO:teuthology.orchestra.run.smithi101.stdout: "duration": 3.1668999999999998e-05 2023-08-01T19:55:40.250 INFO:teuthology.orchestra.run.smithi101.stdout: }, 2023-08-01T19:55:40.250 INFO:teuthology.orchestra.run.smithi101.stdout: { 2023-08-01T19:55:40.250 INFO:teuthology.orchestra.run.smithi101.stdout: "event": "started", 2023-08-01T19:55:40.250 INFO:teuthology.orchestra.run.smithi101.stdout: "time": "2023-08-01T19:55:40.225027+0000", 2023-08-01T19:55:40.250 INFO:teuthology.orchestra.run.smithi101.stdout: "duration": 2.3710000000000002e-05 2023-08-01T19:55:40.250 INFO:teuthology.orchestra.run.smithi101.stdout: } 2023-08-01T19:55:40.251 INFO:teuthology.orchestra.run.smithi101.stdout: ] 2023-08-01T19:55:40.251 INFO:teuthology.orchestra.run.smithi101.stdout: } 2023-08-01T19:55:40.251 INFO:teuthology.orchestra.run.smithi101.stdout: }, 2023-08-01T19:55:40.251 INFO:teuthology.orchestra.run.smithi101.stdout: { 2023-08-01T19:55:40.251 INFO:teuthology.orchestra.run.smithi101.stdout: "description": "osd_op(client.4668.0:164031 5.7 5:e4d60fb8:::benchmark_data_smithi006_114134_object30370:head [delete] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e51)", 2023-08-01T19:55:40.251 INFO:teuthology.orchestra.run.smithi101.stdout: "initiated_at": "2023-08-01T19:55:40.225108+0000", 2023-08-01T19:55:40.251 INFO:teuthology.orchestra.run.smithi101.stdout: "age": 0.0023899170000000001, 2023-08-01T19:55:40.251 INFO:teuthology.orchestra.run.smithi101.stdout: "duration": 0.0025474289999999999, 2023-08-01T19:55:40.252 INFO:teuthology.orchestra.run.smithi101.stdout: "type_data": { 2023-08-01T19:55:40.252 INFO:teuthology.orchestra.run.smithi101.stdout: "flag_point": "waiting for sub ops", 2023-08-01T19:55:40.252 INFO:teuthology.orchestra.run.smithi101.stdout: "client_info": { 2023-08-01T19:55:40.252 INFO:teuthology.orchestra.run.smithi101.stdout: "client": "client.4668", 2023-08-01T19:55:40.252 INFO:teuthology.orchestra.run.smithi101.stdout: "client_addr": "172.21.15.6:0/1709472247", 2023-08-01T19:55:40.252 INFO:teuthology.orchestra.run.smithi101.stdout: "tid": 164031 2023-08-01T19:55:40.252 INFO:teuthology.orchestra.run.smithi101.stdout: }, 2023-08-01T19:55:40.253 INFO:teuthology.orchestra.run.smithi101.stdout: "events": [ 2023-08-01T19:55:40.253 INFO:teuthology.orchestra.run.smithi101.stdout: { 2023-08-01T19:55:40.253 INFO:teuthology.orchestra.run.smithi101.stdout: "event": "initiated", 2023-08-01T19:55:40.253 INFO:teuthology.orchestra.run.smithi101.stdout: "time": "2023-08-01T19:55:40.225108+0000", 2023-08-01T19:55:40.253 INFO:teuthology.orchestra.run.smithi101.stdout: "duration": 0 2023-08-01T19:55:40.253 INFO:teuthology.orchestra.run.smithi101.stdout: }, 2023-08-01T19:55:40.253 INFO:teuthology.orchestra.run.smithi101.stdout: { 2023-08-01T19:55:40.253 INFO:teuthology.orchestra.run.smithi101.stdout: "event": "throttled", 2023-08-01T19:55:40.254 INFO:teuthology.orchestra.run.smithi101.stdout: "time": "2023-08-01T19:55:40.225108+0000", 2023-08-01T19:55:40.254 INFO:teuthology.orchestra.run.smithi101.stdout: "duration": 0 2023-08-01T19:55:40.254 INFO:teuthology.orchestra.run.smithi101.stdout: }, 2023-08-01T19:55:40.254 INFO:teuthology.orchestra.run.smithi101.stdout: { 2023-08-01T19:55:40.254 INFO:teuthology.orchestra.run.smithi101.stdout: "event": "header_read", 2023-08-01T19:55:40.254 INFO:teuthology.orchestra.run.smithi101.stdout: "time": "2023-08-01T19:55:40.225106+0000", 2023-08-01T19:55:40.254 INFO:teuthology.orchestra.run.smithi101.stdout: "duration": 4294967295.999999 2023-08-01T19:55:40.254 INFO:teuthology.orchestra.run.smithi101.stdout: }, 2023-08-01T19:55:40.255 INFO:teuthology.orchestra.run.smithi101.stdout: { 2023-08-01T19:55:40.255 INFO:teuthology.orchestra.run.smithi101.stdout: "event": "all_read", 2023-08-01T19:55:40.255 INFO:teuthology.orchestra.run.smithi101.stdout: "time": "2023-08-01T19:55:40.225112+0000", 2023-08-01T19:55:40.255 INFO:teuthology.orchestra.run.smithi101.stdout: "duration": 5.7910000000000001e-06 2023-08-01T19:55:40.255 INFO:teuthology.orchestra.run.smithi101.stdout: }, 2023-08-01T19:55:40.255 INFO:teuthology.orchestra.run.smithi101.stdout: { 2023-08-01T19:55:40.255 INFO:teuthology.orchestra.run.smithi101.stdout: "event": "dispatched", 2023-08-01T19:55:40.255 INFO:teuthology.orchestra.run.smithi101.stdout: "time": "2023-08-01T19:55:40.225122+0000", 2023-08-01T19:55:40.256 INFO:teuthology.orchestra.run.smithi101.stdout: "duration": 9.5459999999999997e-06 2023-08-01T19:55:40.256 INFO:teuthology.orchestra.run.smithi101.stdout: }, 2023-08-01T19:55:40.256 INFO:teuthology.orchestra.run.smithi101.stdout: { 2023-08-01T19:55:40.256 INFO:teuthology.orchestra.run.smithi101.stdout: "event": "queued_for_pg", 2023-08-01T19:55:40.256 INFO:teuthology.orchestra.run.smithi101.stdout: "time": "2023-08-01T19:55:40.225128+0000", 2023-08-01T19:55:40.256 INFO:teuthology.orchestra.run.smithi101.stdout: "duration": 5.7579999999999998e-06 2023-08-01T19:55:40.256 INFO:teuthology.orchestra.run.smithi101.stdout: }, 2023-08-01T19:55:40.257 INFO:teuthology.orchestra.run.smithi101.stdout: { 2023-08-01T19:55:40.257 INFO:teuthology.orchestra.run.smithi101.stdout: "event": "reached_pg", 2023-08-01T19:55:40.257 INFO:teuthology.orchestra.run.smithi101.stdout: "time": "2023-08-01T19:55:40.225160+0000", 2023-08-01T19:55:40.257 INFO:teuthology.orchestra.run.smithi101.stdout: "duration": 3.1999000000000003e-05 2023-08-01T19:55:40.257 INFO:teuthology.orchestra.run.smithi101.stdout: }, 2023-08-01T19:55:40.257 INFO:teuthology.orchestra.run.smithi101.stdout: { 2023-08-01T19:55:40.257 INFO:teuthology.orchestra.run.smithi101.stdout: "event": "started", 2023-08-01T19:55:40.257 INFO:teuthology.orchestra.run.smithi101.stdout: "time": "2023-08-01T19:55:40.225245+0000", 2023-08-01T19:55:40.258 INFO:teuthology.orchestra.run.smithi101.stdout: "duration": 8.5290000000000005e-05 2023-08-01T19:55:40.258 INFO:teuthology.orchestra.run.smithi101.stdout: }, 2023-08-01T19:55:40.258 INFO:teuthology.orchestra.run.smithi101.stdout: { 2023-08-01T19:55:40.258 INFO:teuthology.orchestra.run.smithi101.stdout: "event": "waiting for subops from 0", 2023-08-01T19:55:40.258 INFO:teuthology.orchestra.run.smithi101.stdout: "time": "2023-08-01T19:55:40.225313+0000", 2023-08-01T19:55:40.258 INFO:teuthology.orchestra.run.smithi101.stdout: "duration": 6.8473000000000007e-05 2023-08-01T19:55:40.258 INFO:teuthology.orchestra.run.smithi101.stdout: } 2023-08-01T19:55:40.258 INFO:teuthology.orchestra.run.smithi101.stdout: ] 2023-08-01T19:55:40.259 INFO:teuthology.orchestra.run.smithi101.stdout: } 2023-08-01T19:55:40.259 INFO:teuthology.orchestra.run.smithi101.stdout: }, 2023-08-01T19:55:40.259 INFO:teuthology.orchestra.run.smithi101.stdout: { 2023-08-01T19:55:40.259 INFO:teuthology.orchestra.run.smithi101.stdout: "description": "osd_op(client.4668.0:164032 5.7 5:e1a589db:::benchmark_data_smithi006_114134_object30371:head [delete] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e51)", 2023-08-01T19:55:40.259 INFO:teuthology.orchestra.run.smithi101.stdout: "initiated_at": "2023-08-01T19:55:40.225160+0000", 2023-08-01T19:55:40.259 INFO:teuthology.orchestra.run.smithi101.stdout: "age": 0.0023372900000000001, 2023-08-01T19:55:40.259 INFO:teuthology.orchestra.run.smithi101.stdout: "duration": 0.0025841879999999998, 2023-08-01T19:55:40.259 INFO:teuthology.orchestra.run.smithi101.stdout: "type_data": { 2023-08-01T19:55:40.260 INFO:teuthology.orchestra.run.smithi101.stdout: "flag_point": "waiting for sub ops", 2023-08-01T19:55:40.260 INFO:teuthology.orchestra.run.smithi101.stdout: "client_info": { 2023-08-01T19:55:40.260 INFO:teuthology.orchestra.run.smithi101.stdout: "client": "client.4668", 2023-08-01T19:55:40.260 INFO:teuthology.orchestra.run.smithi101.stdout: "client_addr": "172.21.15.6:0/1709472247", 2023-08-01T19:55:40.260 INFO:teuthology.orchestra.run.smithi101.stdout: "tid": 164032 2023-08-01T19:55:40.260 INFO:teuthology.orchestra.run.smithi101.stdout: }, 2023-08-01T19:55:40.260 INFO:teuthology.orchestra.run.smithi101.stdout: "events": [ 2023-08-01T19:55:40.261 INFO:teuthology.orchestra.run.smithi101.stdout: { 2023-08-01T19:55:40.261 INFO:teuthology.orchestra.run.smithi101.stdout: "event": "initiated", 2023-08-01T19:55:40.261 INFO:teuthology.orchestra.run.smithi101.stdout: "time": "2023-08-01T19:55:40.225160+0000", 2023-08-01T19:55:40.261 INFO:teuthology.orchestra.run.smithi101.stdout: "duration": 0 2023-08-01T19:55:40.261 INFO:teuthology.orchestra.run.smithi101.stdout: }, 2023-08-01T19:55:40.261 INFO:teuthology.orchestra.run.smithi101.stdout: { 2023-08-01T19:55:40.261 INFO:teuthology.orchestra.run.smithi101.stdout: "event": "throttled", 2023-08-01T19:55:40.261 INFO:teuthology.orchestra.run.smithi101.stdout: "time": "2023-08-01T19:55:40.225160+0000", 2023-08-01T19:55:40.262 INFO:teuthology.orchestra.run.smithi101.stdout: "duration": 0 2023-08-01T19:55:40.262 INFO:teuthology.orchestra.run.smithi101.stdout: }, 2023-08-01T19:55:40.262 INFO:teuthology.orchestra.run.smithi101.stdout: { 2023-08-01T19:55:40.262 INFO:teuthology.orchestra.run.smithi101.stdout: "event": "header_read", 2023-08-01T19:55:40.262 INFO:teuthology.orchestra.run.smithi101.stdout: "time": "2023-08-01T19:55:40.225160+0000", 2023-08-01T19:55:40.262 INFO:teuthology.orchestra.run.smithi101.stdout: "duration": 4294967295.9999995 2023-08-01T19:55:40.262 INFO:teuthology.orchestra.run.smithi101.stdout: }, 2023-08-01T19:55:40.262 INFO:teuthology.orchestra.run.smithi101.stdout: { 2023-08-01T19:55:40.263 INFO:teuthology.orchestra.run.smithi101.stdout: "event": "all_read", 2023-08-01T19:55:40.263 INFO:teuthology.orchestra.run.smithi101.stdout: "time": "2023-08-01T19:55:40.225163+0000", 2023-08-01T19:55:40.263 INFO:teuthology.orchestra.run.smithi101.stdout: "duration": 3.4920000000000002e-06 2023-08-01T19:55:40.263 INFO:teuthology.orchestra.run.smithi101.stdout: }, 2023-08-01T19:55:40.263 INFO:teuthology.orchestra.run.smithi101.stdout: { 2023-08-01T19:55:40.263 INFO:teuthology.orchestra.run.smithi101.stdout: "event": "dispatched", 2023-08-01T19:55:40.263 INFO:teuthology.orchestra.run.smithi101.stdout: "time": "2023-08-01T19:55:40.225171+0000", 2023-08-01T19:55:40.263 INFO:teuthology.orchestra.run.smithi101.stdout: "duration": 7.9289999999999998e-06 2023-08-01T19:55:40.264 INFO:teuthology.orchestra.run.smithi101.stdout: }, 2023-08-01T19:55:40.264 INFO:teuthology.orchestra.run.smithi101.stdout: { 2023-08-01T19:55:40.264 INFO:teuthology.orchestra.run.smithi101.stdout: "event": "queued_for_pg", 2023-08-01T19:55:40.264 INFO:teuthology.orchestra.run.smithi101.stdout: "time": "2023-08-01T19:55:40.225175+0000", 2023-08-01T19:55:40.264 INFO:teuthology.orchestra.run.smithi101.stdout: "duration": 4.2690000000000001e-06 2023-08-01T19:55:40.264 INFO:teuthology.orchestra.run.smithi101.stdout: }, 2023-08-01T19:55:40.264 INFO:teuthology.orchestra.run.smithi101.stdout: { 2023-08-01T19:55:40.264 INFO:teuthology.orchestra.run.smithi101.stdout: "event": "reached_pg", 2023-08-01T19:55:40.265 INFO:teuthology.orchestra.run.smithi101.stdout: "time": "2023-08-01T19:55:40.226625+0000", 2023-08-01T19:55:40.265 INFO:teuthology.orchestra.run.smithi101.stdout: "duration": 0.0014498149999999999 2023-08-01T19:55:40.265 INFO:teuthology.orchestra.run.smithi101.stdout: }, 2023-08-01T19:55:40.265 INFO:teuthology.orchestra.run.smithi101.stdout: { 2023-08-01T19:55:40.265 INFO:teuthology.orchestra.run.smithi101.stdout: "event": "started", 2023-08-01T19:55:40.265 INFO:teuthology.orchestra.run.smithi101.stdout: "time": "2023-08-01T19:55:40.226701+0000", 2023-08-01T19:55:40.265 INFO:teuthology.orchestra.run.smithi101.stdout: "duration": 7.6043000000000004e-05 2023-08-01T19:55:40.265 INFO:teuthology.orchestra.run.smithi101.stdout: }, 2023-08-01T19:55:40.266 INFO:teuthology.orchestra.run.smithi101.stdout: { 2023-08-01T19:55:40.266 INFO:teuthology.orchestra.run.smithi101.stdout: "event": "waiting for subops from 0", 2023-08-01T19:55:40.266 INFO:teuthology.orchestra.run.smithi101.stdout: "time": "2023-08-01T19:55:40.226790+0000", 2023-08-01T19:55:40.266 INFO:teuthology.orchestra.run.smithi101.stdout: "duration": 8.8911000000000003e-05 2023-08-01T19:55:40.266 INFO:teuthology.orchestra.run.smithi101.stdout: } 2023-08-01T19:55:40.266 INFO:teuthology.orchestra.run.smithi101.stdout: ] 2023-08-01T19:55:40.266 INFO:teuthology.orchestra.run.smithi101.stdout: } 2023-08-01T19:55:40.266 INFO:teuthology.orchestra.run.smithi101.stdout: }, 2023-08-01T19:55:40.267 INFO:teuthology.orchestra.run.smithi101.stdout: { 2023-08-01T19:55:40.267 INFO:teuthology.orchestra.run.smithi101.stdout: "description": "osd_repop(client.4668.0:164030 5.3 e51/19 5:cb5f6001:::benchmark_data_smithi006_114134_object30369:head v 51'10400, mlcod=51'10397)", 2023-08-01T19:55:40.267 INFO:teuthology.orchestra.run.smithi101.stdout: "initiated_at": "2023-08-01T19:55:40.225498+0000", 2023-08-01T19:55:40.267 INFO:teuthology.orchestra.run.smithi101.stdout: "age": 0.0019995450000000001, 2023-08-01T19:55:40.267 INFO:teuthology.orchestra.run.smithi101.stdout: "duration": 0.002327974, 2023-08-01T19:55:40.267 INFO:teuthology.orchestra.run.smithi101.stdout: "type_data": { 2023-08-01T19:55:40.267 INFO:teuthology.orchestra.run.smithi101.stdout: "flag_point": "started", 2023-08-01T19:55:40.268 INFO:teuthology.orchestra.run.smithi101.stdout: "events": [ 2023-08-01T19:55:40.268 INFO:teuthology.orchestra.run.smithi101.stdout: { 2023-08-01T19:55:40.268 INFO:teuthology.orchestra.run.smithi101.stdout: "event": "initiated", 2023-08-01T19:55:40.268 INFO:teuthology.orchestra.run.smithi101.stdout: "time": "2023-08-01T19:55:40.225498+0000", 2023-08-01T19:55:40.268 INFO:teuthology.orchestra.run.smithi101.stdout: "duration": 0 2023-08-01T19:55:40.268 INFO:teuthology.orchestra.run.smithi101.stdout: }, 2023-08-01T19:55:40.268 INFO:teuthology.orchestra.run.smithi101.stdout: { 2023-08-01T19:55:40.268 INFO:teuthology.orchestra.run.smithi101.stdout: "event": "throttled", 2023-08-01T19:55:40.269 INFO:teuthology.orchestra.run.smithi101.stdout: "time": "2023-08-01T19:55:40.225498+0000", 2023-08-01T19:55:40.269 INFO:teuthology.orchestra.run.smithi101.stdout: "duration": 0 2023-08-01T19:55:40.269 INFO:teuthology.orchestra.run.smithi101.stdout: }, 2023-08-01T19:55:40.269 INFO:teuthology.orchestra.run.smithi101.stdout: { 2023-08-01T19:55:40.269 INFO:teuthology.orchestra.run.smithi101.stdout: "event": "header_read", 2023-08-01T19:55:40.269 INFO:teuthology.orchestra.run.smithi101.stdout: "time": "2023-08-01T19:55:40.225497+0000", 2023-08-01T19:55:40.269 INFO:teuthology.orchestra.run.smithi101.stdout: "duration": 4294967295.9999995 2023-08-01T19:55:40.269 INFO:teuthology.orchestra.run.smithi101.stdout: }, 2023-08-01T19:55:40.270 INFO:teuthology.orchestra.run.smithi101.stdout: { 2023-08-01T19:55:40.270 INFO:teuthology.orchestra.run.smithi101.stdout: "event": "all_read", 2023-08-01T19:55:40.270 INFO:teuthology.orchestra.run.smithi101.stdout: "time": "2023-08-01T19:55:40.225502+0000", 2023-08-01T19:55:40.270 INFO:teuthology.orchestra.run.smithi101.stdout: "duration": 4.9180000000000002e-06 2023-08-01T19:55:40.270 INFO:teuthology.orchestra.run.smithi101.stdout: }, 2023-08-01T19:55:40.270 INFO:teuthology.orchestra.run.smithi101.stdout: { 2023-08-01T19:55:40.270 INFO:teuthology.orchestra.run.smithi101.stdout: "event": "dispatched", 2023-08-01T19:55:40.270 INFO:teuthology.orchestra.run.smithi101.stdout: "time": "2023-08-01T19:55:40.225513+0000", 2023-08-01T19:55:40.271 INFO:teuthology.orchestra.run.smithi101.stdout: "duration": 1.0299000000000001e-05 2023-08-01T19:55:40.271 INFO:teuthology.orchestra.run.smithi101.stdout: }, 2023-08-01T19:55:40.271 INFO:teuthology.orchestra.run.smithi101.stdout: { 2023-08-01T19:55:40.271 INFO:teuthology.orchestra.run.smithi101.stdout: "event": "queued_for_pg", 2023-08-01T19:55:40.271 INFO:teuthology.orchestra.run.smithi101.stdout: "time": "2023-08-01T19:55:40.225518+0000", 2023-08-01T19:55:40.271 INFO:teuthology.orchestra.run.smithi101.stdout: "duration": 5.1959999999999999e-06 2023-08-01T19:55:40.271 INFO:teuthology.orchestra.run.smithi101.stdout: }, 2023-08-01T19:55:40.271 INFO:teuthology.orchestra.run.smithi101.stdout: { 2023-08-01T19:55:40.272 INFO:teuthology.orchestra.run.smithi101.stdout: "event": "reached_pg", 2023-08-01T19:55:40.272 INFO:teuthology.orchestra.run.smithi101.stdout: "time": "2023-08-01T19:55:40.225550+0000", 2023-08-01T19:55:40.272 INFO:teuthology.orchestra.run.smithi101.stdout: "duration": 3.2064000000000003e-05 2023-08-01T19:55:40.272 INFO:teuthology.orchestra.run.smithi101.stdout: }, 2023-08-01T19:55:40.272 INFO:teuthology.orchestra.run.smithi101.stdout: { 2023-08-01T19:55:40.272 INFO:teuthology.orchestra.run.smithi101.stdout: "event": "started", 2023-08-01T19:55:40.272 INFO:teuthology.orchestra.run.smithi101.stdout: "time": "2023-08-01T19:55:40.225570+0000", 2023-08-01T19:55:40.273 INFO:teuthology.orchestra.run.smithi101.stdout: "duration": 2.0469e-05 2023-08-01T19:55:40.273 INFO:teuthology.orchestra.run.smithi101.stdout: } 2023-08-01T19:55:40.273 INFO:teuthology.orchestra.run.smithi101.stdout: ] 2023-08-01T19:55:40.273 INFO:teuthology.orchestra.run.smithi101.stdout: } 2023-08-01T19:55:40.273 INFO:teuthology.orchestra.run.smithi101.stdout: }, 2023-08-01T19:55:40.273 INFO:teuthology.orchestra.run.smithi101.stdout: { 2023-08-01T19:55:40.273 INFO:teuthology.orchestra.run.smithi101.stdout: "description": "osd_op(client.4668.0:164034 5.7 5.5db4b497 (undecoded) ondisk+write+known_if_redirected+supports_pool_eio e51)", 2023-08-01T19:55:40.273 INFO:teuthology.orchestra.run.smithi101.stdout: "initiated_at": "2023-08-01T19:55:40.227389+0000", 2023-08-01T19:55:40.274 INFO:teuthology.orchestra.run.smithi101.stdout: "age": 0.000108244, 2023-08-01T19:55:40.274 INFO:teuthology.orchestra.run.smithi101.stdout: "duration": 0.00050728899999999996, 2023-08-01T19:55:40.274 INFO:teuthology.orchestra.run.smithi101.stdout: "type_data": { 2023-08-01T19:55:40.274 INFO:teuthology.orchestra.run.smithi101.stdout: "flag_point": "queued for pg", 2023-08-01T19:55:40.274 INFO:teuthology.orchestra.run.smithi101.stdout: "client_info": { 2023-08-01T19:55:40.274 INFO:teuthology.orchestra.run.smithi101.stdout: "client": "client.4668", 2023-08-01T19:55:40.274 INFO:teuthology.orchestra.run.smithi101.stdout: "client_addr": "172.21.15.6:0/1709472247", 2023-08-01T19:55:40.274 INFO:teuthology.orchestra.run.smithi101.stdout: "tid": 164034 2023-08-01T19:55:40.275 INFO:teuthology.orchestra.run.smithi101.stdout: }, 2023-08-01T19:55:40.275 INFO:teuthology.orchestra.run.smithi101.stdout: "events": [ 2023-08-01T19:55:40.275 INFO:teuthology.orchestra.run.smithi101.stdout: { 2023-08-01T19:55:40.275 INFO:teuthology.orchestra.run.smithi101.stdout: "event": "initiated", 2023-08-01T19:55:40.275 INFO:teuthology.orchestra.run.smithi101.stdout: "time": "2023-08-01T19:55:40.227389+0000", 2023-08-01T19:55:40.275 INFO:teuthology.orchestra.run.smithi101.stdout: "duration": 0 2023-08-01T19:55:40.275 INFO:teuthology.orchestra.run.smithi101.stdout: }, 2023-08-01T19:55:40.275 INFO:teuthology.orchestra.run.smithi101.stdout: { 2023-08-01T19:55:40.276 INFO:teuthology.orchestra.run.smithi101.stdout: "event": "throttled", 2023-08-01T19:55:40.276 INFO:teuthology.orchestra.run.smithi101.stdout: "time": "2023-08-01T19:55:40.227389+0000", 2023-08-01T19:55:40.276 INFO:teuthology.orchestra.run.smithi101.stdout: "duration": 0 2023-08-01T19:55:40.276 INFO:teuthology.orchestra.run.smithi101.stdout: }, 2023-08-01T19:55:40.276 INFO:teuthology.orchestra.run.smithi101.stdout: { 2023-08-01T19:55:40.276 INFO:teuthology.orchestra.run.smithi101.stdout: "event": "header_read", 2023-08-01T19:55:40.276 INFO:teuthology.orchestra.run.smithi101.stdout: "time": "2023-08-01T19:55:40.227388+0000", 2023-08-01T19:55:40.276 INFO:teuthology.orchestra.run.smithi101.stdout: "duration": 4294967295.999999 2023-08-01T19:55:40.277 INFO:teuthology.orchestra.run.smithi101.stdout: }, 2023-08-01T19:55:40.277 INFO:teuthology.orchestra.run.smithi101.stdout: { 2023-08-01T19:55:40.277 INFO:teuthology.orchestra.run.smithi101.stdout: "event": "all_read", 2023-08-01T19:55:40.277 INFO:teuthology.orchestra.run.smithi101.stdout: "time": "2023-08-01T19:55:40.227392+0000", 2023-08-01T19:55:40.277 INFO:teuthology.orchestra.run.smithi101.stdout: "duration": 3.8990000000000003e-06 2023-08-01T19:55:40.277 INFO:teuthology.orchestra.run.smithi101.stdout: }, 2023-08-01T19:55:40.277 INFO:teuthology.orchestra.run.smithi101.stdout: { 2023-08-01T19:55:40.278 INFO:teuthology.orchestra.run.smithi101.stdout: "event": "dispatched", 2023-08-01T19:55:40.278 INFO:teuthology.orchestra.run.smithi101.stdout: "time": "2023-08-01T19:55:40.227402+0000", 2023-08-01T19:55:40.278 INFO:teuthology.orchestra.run.smithi101.stdout: "duration": 9.8449999999999998e-06 2023-08-01T19:55:40.278 INFO:teuthology.orchestra.run.smithi101.stdout: }, 2023-08-01T19:55:40.278 INFO:teuthology.orchestra.run.smithi101.stdout: { 2023-08-01T19:55:40.278 INFO:teuthology.orchestra.run.smithi101.stdout: "event": "queued_for_pg", 2023-08-01T19:55:40.278 INFO:teuthology.orchestra.run.smithi101.stdout: "time": "2023-08-01T19:55:40.227408+0000", 2023-08-01T19:55:40.278 INFO:teuthology.orchestra.run.smithi101.stdout: "duration": 5.959e-06 2023-08-01T19:55:40.279 INFO:teuthology.orchestra.run.smithi101.stdout: } 2023-08-01T19:55:40.279 INFO:teuthology.orchestra.run.smithi101.stdout: ] 2023-08-01T19:55:40.279 INFO:teuthology.orchestra.run.smithi101.stdout: } 2023-08-01T19:55:40.279 INFO:teuthology.orchestra.run.smithi101.stdout: }, 2023-08-01T19:55:40.279 INFO:teuthology.orchestra.run.smithi101.stdout: { 2023-08-01T19:55:40.279 INFO:teuthology.orchestra.run.smithi101.stdout: "description": "osd_repop(client.4668.0:164033 5.c e51/19 5:36e6b753:::benchmark_data_smithi006_114134_object30372:head v 51'10235, mlcod=51'10233)", 2023-08-01T19:55:40.279 INFO:teuthology.orchestra.run.smithi101.stdout: "initiated_at": "2023-08-01T19:55:40.227651+0000", 2023-08-01T19:55:40.279 INFO:teuthology.orchestra.run.smithi101.stdout: "age": 4294967295.9998465, 2023-08-01T19:55:40.280 INFO:teuthology.orchestra.run.smithi101.stdout: "duration": 0.00030706100000000002, 2023-08-01T19:55:40.280 INFO:teuthology.orchestra.run.smithi101.stdout: "type_data": { 2023-08-01T19:55:40.280 INFO:teuthology.orchestra.run.smithi101.stdout: "flag_point": "started", 2023-08-01T19:55:40.280 INFO:teuthology.orchestra.run.smithi101.stdout: "events": [ 2023-08-01T19:55:40.280 INFO:teuthology.orchestra.run.smithi101.stdout: { 2023-08-01T19:55:40.280 INFO:teuthology.orchestra.run.smithi101.stdout: "event": "initiated", 2023-08-01T19:55:40.280 INFO:teuthology.orchestra.run.smithi101.stdout: "time": "2023-08-01T19:55:40.227651+0000", 2023-08-01T19:55:40.280 INFO:teuthology.orchestra.run.smithi101.stdout: "duration": 0 2023-08-01T19:55:40.281 INFO:teuthology.orchestra.run.smithi101.stdout: }, 2023-08-01T19:55:40.281 INFO:teuthology.orchestra.run.smithi101.stdout: { 2023-08-01T19:55:40.281 INFO:teuthology.orchestra.run.smithi101.stdout: "event": "throttled", 2023-08-01T19:55:40.281 INFO:teuthology.orchestra.run.smithi101.stdout: "time": "2023-08-01T19:55:40.227651+0000", 2023-08-01T19:55:40.281 INFO:teuthology.orchestra.run.smithi101.stdout: "duration": 0 2023-08-01T19:55:40.281 INFO:teuthology.orchestra.run.smithi101.stdout: }, 2023-08-01T19:55:40.281 INFO:teuthology.orchestra.run.smithi101.stdout: { 2023-08-01T19:55:40.281 INFO:teuthology.orchestra.run.smithi101.stdout: "event": "header_read", 2023-08-01T19:55:40.282 INFO:teuthology.orchestra.run.smithi101.stdout: "time": "2023-08-01T19:55:40.227650+0000", 2023-08-01T19:55:40.282 INFO:teuthology.orchestra.run.smithi101.stdout: "duration": 4294967295.9999995 2023-08-01T19:55:40.282 INFO:teuthology.orchestra.run.smithi101.stdout: }, 2023-08-01T19:55:40.282 INFO:teuthology.orchestra.run.smithi101.stdout: { 2023-08-01T19:55:40.282 INFO:teuthology.orchestra.run.smithi101.stdout: "event": "all_read", 2023-08-01T19:55:40.282 INFO:teuthology.orchestra.run.smithi101.stdout: "time": "2023-08-01T19:55:40.227656+0000", 2023-08-01T19:55:40.282 INFO:teuthology.orchestra.run.smithi101.stdout: "duration": 5.2700000000000004e-06 2023-08-01T19:55:40.283 INFO:teuthology.orchestra.run.smithi101.stdout: }, 2023-08-01T19:55:40.283 INFO:teuthology.orchestra.run.smithi101.stdout: { 2023-08-01T19:55:40.283 INFO:teuthology.orchestra.run.smithi101.stdout: "event": "dispatched", 2023-08-01T19:55:40.283 INFO:teuthology.orchestra.run.smithi101.stdout: "time": "2023-08-01T19:55:40.227663+0000", 2023-08-01T19:55:40.283 INFO:teuthology.orchestra.run.smithi101.stdout: "duration": 7.5800000000000003e-06 2023-08-01T19:55:40.283 INFO:teuthology.orchestra.run.smithi101.stdout: }, 2023-08-01T19:55:40.283 INFO:teuthology.orchestra.run.smithi101.stdout: { 2023-08-01T19:55:40.283 INFO:teuthology.orchestra.run.smithi101.stdout: "event": "queued_for_pg", 2023-08-01T19:55:40.284 INFO:teuthology.orchestra.run.smithi101.stdout: "time": "2023-08-01T19:55:40.227667+0000", 2023-08-01T19:55:40.284 INFO:teuthology.orchestra.run.smithi101.stdout: "duration": 3.8829999999999999e-06 2023-08-01T19:55:40.284 INFO:teuthology.orchestra.run.smithi101.stdout: }, 2023-08-01T19:55:40.284 INFO:teuthology.orchestra.run.smithi101.stdout: { 2023-08-01T19:55:40.284 INFO:teuthology.orchestra.run.smithi101.stdout: "event": "reached_pg", 2023-08-01T19:55:40.284 INFO:teuthology.orchestra.run.smithi101.stdout: "time": "2023-08-01T19:55:40.227705+0000", 2023-08-01T19:55:40.284 INFO:teuthology.orchestra.run.smithi101.stdout: "duration": 3.7769999999999999e-05 2023-08-01T19:55:40.284 INFO:teuthology.orchestra.run.smithi101.stdout: }, 2023-08-01T19:55:40.285 INFO:teuthology.orchestra.run.smithi101.stdout: { 2023-08-01T19:55:40.285 INFO:teuthology.orchestra.run.smithi101.stdout: "event": "started", 2023-08-01T19:55:40.285 INFO:teuthology.orchestra.run.smithi101.stdout: "time": "2023-08-01T19:55:40.227726+0000", 2023-08-01T19:55:40.285 INFO:teuthology.orchestra.run.smithi101.stdout: "duration": 2.1160000000000001e-05 2023-08-01T19:55:40.285 INFO:teuthology.orchestra.run.smithi101.stdout: } 2023-08-01T19:55:40.285 INFO:teuthology.orchestra.run.smithi101.stdout: ] 2023-08-01T19:55:40.285 INFO:teuthology.orchestra.run.smithi101.stdout: } 2023-08-01T19:55:40.285 INFO:teuthology.orchestra.run.smithi101.stdout: }, 2023-08-01T19:55:40.286 INFO:teuthology.orchestra.run.smithi101.stdout: { 2023-08-01T19:55:40.286 INFO:teuthology.orchestra.run.smithi101.stdout: "description": "osd_repop(client.4668.0:164035 5.5 e51/19 5:a47dd863:::benchmark_data_smithi006_114134_object30374:head v 51'10100, mlcod=51'10097)", 2023-08-01T19:55:40.286 INFO:teuthology.orchestra.run.smithi101.stdout: "initiated_at": "2023-08-01T19:55:40.227818+0000", 2023-08-01T19:55:40.286 INFO:teuthology.orchestra.run.smithi101.stdout: "age": 4294967295.9996796, 2023-08-01T19:55:40.286 INFO:teuthology.orchestra.run.smithi101.stdout: "duration": 0.00017979899999999999, 2023-08-01T19:55:40.286 INFO:teuthology.orchestra.run.smithi101.stdout: "type_data": { 2023-08-01T19:55:40.286 INFO:teuthology.orchestra.run.smithi101.stdout: "flag_point": "started", 2023-08-01T19:55:40.286 INFO:teuthology.orchestra.run.smithi101.stdout: "events": [ 2023-08-01T19:55:40.287 INFO:teuthology.orchestra.run.smithi101.stdout: { 2023-08-01T19:55:40.287 INFO:teuthology.orchestra.run.smithi101.stdout: "event": "initiated", 2023-08-01T19:55:40.287 INFO:teuthology.orchestra.run.smithi101.stdout: "time": "2023-08-01T19:55:40.227818+0000", 2023-08-01T19:55:40.287 INFO:teuthology.orchestra.run.smithi101.stdout: "duration": 0 2023-08-01T19:55:40.287 INFO:teuthology.orchestra.run.smithi101.stdout: }, 2023-08-01T19:55:40.287 INFO:teuthology.orchestra.run.smithi101.stdout: { 2023-08-01T19:55:40.287 INFO:teuthology.orchestra.run.smithi101.stdout: "event": "throttled", 2023-08-01T19:55:40.287 INFO:teuthology.orchestra.run.smithi101.stdout: "time": "2023-08-01T19:55:40.227818+0000", 2023-08-01T19:55:40.288 INFO:teuthology.orchestra.run.smithi101.stdout: "duration": 0 2023-08-01T19:55:40.288 INFO:teuthology.orchestra.run.smithi101.stdout: }, 2023-08-01T19:55:40.288 INFO:teuthology.orchestra.run.smithi101.stdout: { 2023-08-01T19:55:40.288 INFO:teuthology.orchestra.run.smithi101.stdout: "event": "header_read", 2023-08-01T19:55:40.288 INFO:teuthology.orchestra.run.smithi101.stdout: "time": "2023-08-01T19:55:40.227817+0000", 2023-08-01T19:55:40.288 INFO:teuthology.orchestra.run.smithi101.stdout: "duration": 4294967295.9999995 2023-08-01T19:55:40.288 INFO:teuthology.orchestra.run.smithi101.stdout: }, 2023-08-01T19:55:40.289 INFO:teuthology.orchestra.run.smithi101.stdout: { 2023-08-01T19:55:40.289 INFO:teuthology.orchestra.run.smithi101.stdout: "event": "all_read", 2023-08-01T19:55:40.289 INFO:teuthology.orchestra.run.smithi101.stdout: "time": "2023-08-01T19:55:40.227821+0000", 2023-08-01T19:55:40.289 INFO:teuthology.orchestra.run.smithi101.stdout: "duration": 3.6909999999999999e-06 2023-08-01T19:55:40.289 INFO:teuthology.orchestra.run.smithi101.stdout: }, 2023-08-01T19:55:40.289 INFO:teuthology.orchestra.run.smithi101.stdout: { 2023-08-01T19:55:40.289 INFO:teuthology.orchestra.run.smithi101.stdout: "event": "dispatched", 2023-08-01T19:55:40.289 INFO:teuthology.orchestra.run.smithi101.stdout: "time": "2023-08-01T19:55:40.227826+0000", 2023-08-01T19:55:40.290 INFO:teuthology.orchestra.run.smithi101.stdout: "duration": 5.3970000000000002e-06 2023-08-01T19:55:40.290 INFO:teuthology.orchestra.run.smithi101.stdout: }, 2023-08-01T19:55:40.290 INFO:teuthology.orchestra.run.smithi101.stdout: { 2023-08-01T19:55:40.290 INFO:teuthology.orchestra.run.smithi101.stdout: "event": "queued_for_pg", 2023-08-01T19:55:40.290 INFO:teuthology.orchestra.run.smithi101.stdout: "time": "2023-08-01T19:55:40.227830+0000", 2023-08-01T19:55:40.290 INFO:teuthology.orchestra.run.smithi101.stdout: "duration": 3.326e-06 2023-08-01T19:55:40.290 INFO:teuthology.orchestra.run.smithi101.stdout: }, 2023-08-01T19:55:40.290 INFO:teuthology.orchestra.run.smithi101.stdout: { 2023-08-01T19:55:40.291 INFO:teuthology.orchestra.run.smithi101.stdout: "event": "reached_pg", 2023-08-01T19:55:40.291 INFO:teuthology.orchestra.run.smithi101.stdout: "time": "2023-08-01T19:55:40.227861+0000", 2023-08-01T19:55:40.291 INFO:teuthology.orchestra.run.smithi101.stdout: "duration": 3.1189999999999998e-05 2023-08-01T19:55:40.291 INFO:teuthology.orchestra.run.smithi101.stdout: }, 2023-08-01T19:55:40.291 INFO:teuthology.orchestra.run.smithi101.stdout: { 2023-08-01T19:55:40.291 INFO:teuthology.orchestra.run.smithi101.stdout: "event": "started", 2023-08-01T19:55:40.291 INFO:teuthology.orchestra.run.smithi101.stdout: "time": "2023-08-01T19:55:40.227875+0000", 2023-08-01T19:55:40.291 INFO:teuthology.orchestra.run.smithi101.stdout: "duration": 1.4124999999999999e-05 2023-08-01T19:55:40.292 INFO:teuthology.orchestra.run.smithi101.stdout: } 2023-08-01T19:55:40.292 INFO:teuthology.orchestra.run.smithi101.stdout: ] 2023-08-01T19:55:40.292 INFO:teuthology.orchestra.run.smithi101.stdout: } 2023-08-01T19:55:40.292 INFO:teuthology.orchestra.run.smithi101.stdout: } 2023-08-01T19:55:40.292 INFO:teuthology.orchestra.run.smithi101.stdout: ], 2023-08-01T19:55:40.292 INFO:teuthology.orchestra.run.smithi101.stdout: "num_ops": 9 2023-08-01T19:55:40.292 INFO:teuthology.orchestra.run.smithi101.stdout:} 2023-08-01T19:55:40.294 DEBUG:teuthology.orchestra.run.smithi101:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 30 ceph --cluster ceph --admin-daemon /var/run/ceph/ceph-osd.1.asok dump_blocked_ops 2023-08-01T19:55:40.294 INFO:tasks.ceph.osd.1.smithi101.stderr:2023-08-01T19:55:40.292+0000 7fb0cb7f6700 -1 received signal: Hangup from /usr/bin/python3 /bin/daemon-helper kill ceph-osd -f --cluster ceph -i 1 (PID: 111141) UID: 0 2023-08-01T19:55:40.394 INFO:tasks.ceph.osd.2.smithi155.stderr:2023-08-01T19:55:40.392+0000 7faa5c6ac700 -1 received signal: Hangup from /usr/bin/python3 /bin/daemon-helper kill ceph-osd -f --cluster ceph -i 2 (PID: 111337) UID: 0 2023-08-01T19:55:40.488 INFO:teuthology.orchestra.run.smithi101.stdout:{ 2023-08-01T19:55:40.488 INFO:teuthology.orchestra.run.smithi101.stdout: "ops": [], 2023-08-01T19:55:40.489 INFO:teuthology.orchestra.run.smithi101.stdout: "complaint_time": 30, 2023-08-01T19:55:40.489 INFO:teuthology.orchestra.run.smithi101.stdout: "num_blocked_ops": 0 2023-08-01T19:55:40.489 INFO:teuthology.orchestra.run.smithi101.stdout:} 2023-08-01T19:55:40.495 INFO:tasks.ceph.osd.0.smithi008.stderr:2023-08-01T19:55:40.493+0000 7f16a58f4700 -1 received signal: Hangup from /usr/bin/python3 /bin/daemon-helper kill ceph-osd -f --cluster ceph -i 0 (PID: 111179) UID: 0 2023-08-01T19:55:40.500 DEBUG:teuthology.orchestra.run.smithi101:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 30 ceph --cluster ceph --admin-daemon /var/run/ceph/ceph-osd.1.asok dump_historic_ops 2023-08-01T19:55:40.596 INFO:tasks.ceph.osd.2.smithi155.stderr:2023-08-01T19:55:40.594+0000 7faa5c6ac700 -1 received signal: Hangup from /usr/bin/python3 /bin/daemon-helper kill ceph-osd -f --cluster ceph -i 2 (PID: 111337) UID: 0 2023-08-01T19:55:40.676 INFO:teuthology.orchestra.run.smithi101.stdout:{ 2023-08-01T19:55:40.677 INFO:teuthology.orchestra.run.smithi101.stdout: "size": 20, 2023-08-01T19:55:40.677 INFO:teuthology.orchestra.run.smithi101.stdout: "duration": 600, 2023-08-01T19:55:40.677 INFO:teuthology.orchestra.run.smithi101.stdout: "ops": [ 2023-08-01T19:55:40.677 INFO:teuthology.orchestra.run.smithi101.stdout: { 2023-08-01T19:55:40.677 INFO:teuthology.orchestra.run.smithi101.stdout: "description": "osd_op(mds.0.3:11 3.10 3:0bd6d154:::602.00000000:head [create,setxattr parent (62) in=6b,setxattr layout (30) in=6b] snapc 0=[] ondisk+write+known_if_redirected+full_force+supports_pool_eio e17)", 2023-08-01T19:55:40.678 INFO:teuthology.orchestra.run.smithi101.stdout: "initiated_at": "2023-08-01T19:54:04.458960+0000", 2023-08-01T19:55:40.678 INFO:teuthology.orchestra.run.smithi101.stdout: "age": 96.213860167000007, 2023-08-01T19:55:40.678 INFO:teuthology.orchestra.run.smithi101.stdout: "duration": 0.019645459000000001, 2023-08-01T19:55:40.678 INFO:teuthology.orchestra.run.smithi101.stdout: "type_data": { 2023-08-01T19:55:40.678 INFO:teuthology.orchestra.run.smithi101.stdout: "flag_point": "commit sent; apply or cleanup", 2023-08-01T19:55:40.678 INFO:teuthology.orchestra.run.smithi101.stdout: "events": [ 2023-08-01T19:55:40.678 INFO:teuthology.orchestra.run.smithi101.stdout: { 2023-08-01T19:55:40.679 INFO:teuthology.orchestra.run.smithi101.stdout: "event": "initiated", 2023-08-01T19:55:40.679 INFO:teuthology.orchestra.run.smithi101.stdout: "time": "2023-08-01T19:54:04.458960+0000", 2023-08-01T19:55:40.679 INFO:teuthology.orchestra.run.smithi101.stdout: "duration": 0 2023-08-01T19:55:40.679 INFO:teuthology.orchestra.run.smithi101.stdout: }, 2023-08-01T19:55:40.679 INFO:teuthology.orchestra.run.smithi101.stdout: { 2023-08-01T19:55:40.679 INFO:teuthology.orchestra.run.smithi101.stdout: "event": "throttled", 2023-08-01T19:55:40.679 INFO:teuthology.orchestra.run.smithi101.stdout: "time": "2023-08-01T19:54:04.458960+0000", 2023-08-01T19:55:40.679 INFO:teuthology.orchestra.run.smithi101.stdout: "duration": 0 2023-08-01T19:55:40.680 INFO:teuthology.orchestra.run.smithi101.stdout: }, 2023-08-01T19:55:40.680 INFO:teuthology.orchestra.run.smithi101.stdout: { 2023-08-01T19:55:40.680 INFO:teuthology.orchestra.run.smithi101.stdout: "event": "header_read", 2023-08-01T19:55:40.680 INFO:teuthology.orchestra.run.smithi101.stdout: "time": "2023-08-01T19:54:04.458959+0000", 2023-08-01T19:55:40.680 INFO:teuthology.orchestra.run.smithi101.stdout: "duration": 4294967295.9999995 2023-08-01T19:55:40.680 INFO:teuthology.orchestra.run.smithi101.stdout: }, 2023-08-01T19:55:40.680 INFO:teuthology.orchestra.run.smithi101.stdout: { 2023-08-01T19:55:40.681 INFO:teuthology.orchestra.run.smithi101.stdout: "event": "all_read", 2023-08-01T19:55:40.681 INFO:teuthology.orchestra.run.smithi101.stdout: "time": "2023-08-01T19:54:04.458963+0000", 2023-08-01T19:55:40.681 INFO:teuthology.orchestra.run.smithi101.stdout: "duration": 3.9199999999999997e-06 2023-08-01T19:55:40.681 INFO:teuthology.orchestra.run.smithi101.stdout: }, 2023-08-01T19:55:40.681 INFO:teuthology.orchestra.run.smithi101.stdout: { 2023-08-01T19:55:40.681 INFO:teuthology.orchestra.run.smithi101.stdout: "event": "dispatched", 2023-08-01T19:55:40.681 INFO:teuthology.orchestra.run.smithi101.stdout: "time": "2023-08-01T19:54:04.458970+0000", 2023-08-01T19:55:40.681 INFO:teuthology.orchestra.run.smithi101.stdout: "duration": 7.0439999999999998e-06 2023-08-01T19:55:40.682 INFO:teuthology.orchestra.run.smithi101.stdout: }, 2023-08-01T19:55:40.682 INFO:teuthology.orchestra.run.smithi101.stdout: { 2023-08-01T19:55:40.682 INFO:teuthology.orchestra.run.smithi101.stdout: "event": "queued_for_pg", 2023-08-01T19:55:40.682 INFO:teuthology.orchestra.run.smithi101.stdout: "time": "2023-08-01T19:54:04.458976+0000", 2023-08-01T19:55:40.682 INFO:teuthology.orchestra.run.smithi101.stdout: "duration": 5.9540000000000001e-06 2023-08-01T19:55:40.682 INFO:teuthology.orchestra.run.smithi101.stdout: }, 2023-08-01T19:55:40.682 INFO:teuthology.orchestra.run.smithi101.stdout: { 2023-08-01T19:55:40.682 INFO:teuthology.orchestra.run.smithi101.stdout: "event": "reached_pg", 2023-08-01T19:55:40.683 INFO:teuthology.orchestra.run.smithi101.stdout: "time": "2023-08-01T19:54:04.459035+0000", 2023-08-01T19:55:40.683 INFO:teuthology.orchestra.run.smithi101.stdout: "duration": 5.8924e-05 2023-08-01T19:55:40.683 INFO:teuthology.orchestra.run.smithi101.stdout: }, 2023-08-01T19:55:40.683 INFO:teuthology.orchestra.run.smithi101.stdout: { 2023-08-01T19:55:40.683 INFO:teuthology.orchestra.run.smithi101.stdout: "event": "waiting_for_map not empty", 2023-08-01T19:55:40.683 INFO:teuthology.orchestra.run.smithi101.stdout: "time": "2023-08-01T19:54:04.459038+0000", 2023-08-01T19:55:40.683 INFO:teuthology.orchestra.run.smithi101.stdout: "duration": 3.2760000000000001e-06 2023-08-01T19:55:40.684 INFO:teuthology.orchestra.run.smithi101.stdout: }, 2023-08-01T19:55:40.684 INFO:teuthology.orchestra.run.smithi101.stdout: { 2023-08-01T19:55:40.684 INFO:teuthology.orchestra.run.smithi101.stdout: "event": "reached_pg", 2023-08-01T19:55:40.684 INFO:teuthology.orchestra.run.smithi101.stdout: "time": "2023-08-01T19:54:04.471511+0000", 2023-08-01T19:55:40.684 INFO:teuthology.orchestra.run.smithi101.stdout: "duration": 0.012473039999999999 2023-08-01T19:55:40.684 INFO:teuthology.orchestra.run.smithi101.stdout: }, 2023-08-01T19:55:40.684 INFO:teuthology.orchestra.run.smithi101.stdout: { 2023-08-01T19:55:40.684 INFO:teuthology.orchestra.run.smithi101.stdout: "event": "started", 2023-08-01T19:55:40.685 INFO:teuthology.orchestra.run.smithi101.stdout: "time": "2023-08-01T19:54:04.472086+0000", 2023-08-01T19:55:40.685 INFO:teuthology.orchestra.run.smithi101.stdout: "duration": 0.00057491699999999998 2023-08-01T19:55:40.685 INFO:teuthology.orchestra.run.smithi101.stdout: }, 2023-08-01T19:55:40.685 INFO:teuthology.orchestra.run.smithi101.stdout: { 2023-08-01T19:55:40.685 INFO:teuthology.orchestra.run.smithi101.stdout: "event": "waiting for subops from 2", 2023-08-01T19:55:40.685 INFO:teuthology.orchestra.run.smithi101.stdout: "time": "2023-08-01T19:54:04.472310+0000", 2023-08-01T19:55:40.685 INFO:teuthology.orchestra.run.smithi101.stdout: "duration": 0.00022396499999999999 2023-08-01T19:55:40.686 INFO:teuthology.orchestra.run.smithi101.stdout: }, 2023-08-01T19:55:40.686 INFO:teuthology.orchestra.run.smithi101.stdout: { 2023-08-01T19:55:40.686 INFO:teuthology.orchestra.run.smithi101.stdout: "event": "op_commit", 2023-08-01T19:55:40.686 INFO:teuthology.orchestra.run.smithi101.stdout: "time": "2023-08-01T19:54:04.478141+0000", 2023-08-01T19:55:40.686 INFO:teuthology.orchestra.run.smithi101.stdout: "duration": 0.0058312320000000004 2023-08-01T19:55:40.686 INFO:teuthology.orchestra.run.smithi101.stdout: }, 2023-08-01T19:55:40.686 INFO:teuthology.orchestra.run.smithi101.stdout: { 2023-08-01T19:55:40.687 INFO:teuthology.orchestra.run.smithi101.stdout: "event": "sub_op_commit_rec", 2023-08-01T19:55:40.687 INFO:teuthology.orchestra.run.smithi101.stdout: "time": "2023-08-01T19:54:04.478543+0000", 2023-08-01T19:55:40.687 INFO:teuthology.orchestra.run.smithi101.stdout: "duration": 0.00040160800000000002 2023-08-01T19:55:40.687 INFO:teuthology.orchestra.run.smithi101.stdout: }, 2023-08-01T19:55:40.687 INFO:teuthology.orchestra.run.smithi101.stdout: { 2023-08-01T19:55:40.687 INFO:teuthology.orchestra.run.smithi101.stdout: "event": "commit_sent", 2023-08-01T19:55:40.687 INFO:teuthology.orchestra.run.smithi101.stdout: "time": "2023-08-01T19:54:04.478584+0000", 2023-08-01T19:55:40.687 INFO:teuthology.orchestra.run.smithi101.stdout: "duration": 4.0989999999999999e-05 2023-08-01T19:55:40.688 INFO:teuthology.orchestra.run.smithi101.stdout: }, 2023-08-01T19:55:40.688 INFO:teuthology.orchestra.run.smithi101.stdout: { 2023-08-01T19:55:40.688 INFO:teuthology.orchestra.run.smithi101.stdout: "event": "done", 2023-08-01T19:55:40.688 INFO:teuthology.orchestra.run.smithi101.stdout: "time": "2023-08-01T19:54:04.478605+0000", 2023-08-01T19:55:40.688 INFO:teuthology.orchestra.run.smithi101.stdout: "duration": 2.1178e-05 2023-08-01T19:55:40.688 INFO:teuthology.orchestra.run.smithi101.stdout: } 2023-08-01T19:55:40.688 INFO:teuthology.orchestra.run.smithi101.stdout: ] 2023-08-01T19:55:40.689 INFO:teuthology.orchestra.run.smithi101.stdout: } 2023-08-01T19:55:40.689 INFO:teuthology.orchestra.run.smithi101.stdout: }, 2023-08-01T19:55:40.689 INFO:teuthology.orchestra.run.smithi101.stdout: { 2023-08-01T19:55:40.689 INFO:teuthology.orchestra.run.smithi101.stdout: "description": "osd_op(mds.0.3:12 3.10 3:0d89b25e:::603.00000000:head [omap-set-header] snapc 0=[] ondisk+write+known_if_redirected+full_force+supports_pool_eio e17)", 2023-08-01T19:55:40.689 INFO:teuthology.orchestra.run.smithi101.stdout: "initiated_at": "2023-08-01T19:54:04.458982+0000", 2023-08-01T19:55:40.689 INFO:teuthology.orchestra.run.smithi101.stdout: "age": 96.213837939000001, 2023-08-01T19:55:40.689 INFO:teuthology.orchestra.run.smithi101.stdout: "duration": 0.021266334000000001, 2023-08-01T19:55:40.689 INFO:teuthology.orchestra.run.smithi101.stdout: "type_data": { 2023-08-01T19:55:40.690 INFO:teuthology.orchestra.run.smithi101.stdout: "flag_point": "commit sent; apply or cleanup", 2023-08-01T19:55:40.690 INFO:teuthology.orchestra.run.smithi101.stdout: "events": [ 2023-08-01T19:55:40.690 INFO:teuthology.orchestra.run.smithi101.stdout: { 2023-08-01T19:55:40.690 INFO:teuthology.orchestra.run.smithi101.stdout: "event": "initiated", 2023-08-01T19:55:40.690 INFO:teuthology.orchestra.run.smithi101.stdout: "time": "2023-08-01T19:54:04.458982+0000", 2023-08-01T19:55:40.690 INFO:teuthology.orchestra.run.smithi101.stdout: "duration": 0 2023-08-01T19:55:40.690 INFO:teuthology.orchestra.run.smithi101.stdout: }, 2023-08-01T19:55:40.691 INFO:teuthology.orchestra.run.smithi101.stdout: { 2023-08-01T19:55:40.691 INFO:teuthology.orchestra.run.smithi101.stdout: "event": "throttled", 2023-08-01T19:55:40.691 INFO:teuthology.orchestra.run.smithi101.stdout: "time": "2023-08-01T19:54:04.458982+0000", 2023-08-01T19:55:40.691 INFO:teuthology.orchestra.run.smithi101.stdout: "duration": 0 2023-08-01T19:55:40.691 INFO:teuthology.orchestra.run.smithi101.stdout: }, 2023-08-01T19:55:40.691 INFO:teuthology.orchestra.run.smithi101.stdout: { 2023-08-01T19:55:40.691 INFO:teuthology.orchestra.run.smithi101.stdout: "event": "header_read", 2023-08-01T19:55:40.692 INFO:teuthology.orchestra.run.smithi101.stdout: "time": "2023-08-01T19:54:04.458982+0000", 2023-08-01T19:55:40.692 INFO:teuthology.orchestra.run.smithi101.stdout: "duration": 4294967295.9999995 2023-08-01T19:55:40.692 INFO:teuthology.orchestra.run.smithi101.stdout: }, 2023-08-01T19:55:40.692 INFO:teuthology.orchestra.run.smithi101.stdout: { 2023-08-01T19:55:40.692 INFO:teuthology.orchestra.run.smithi101.stdout: "event": "all_read", 2023-08-01T19:55:40.692 INFO:teuthology.orchestra.run.smithi101.stdout: "time": "2023-08-01T19:54:04.458985+0000", 2023-08-01T19:55:40.692 INFO:teuthology.orchestra.run.smithi101.stdout: "duration": 3.4800000000000001e-06 2023-08-01T19:55:40.692 INFO:teuthology.orchestra.run.smithi101.stdout: }, 2023-08-01T19:55:40.693 INFO:teuthology.orchestra.run.smithi101.stdout: { 2023-08-01T19:55:40.693 INFO:teuthology.orchestra.run.smithi101.stdout: "event": "dispatched", 2023-08-01T19:55:40.693 INFO:teuthology.orchestra.run.smithi101.stdout: "time": "2023-08-01T19:54:04.458992+0000", 2023-08-01T19:55:40.693 INFO:teuthology.orchestra.run.smithi101.stdout: "duration": 7.306e-06 2023-08-01T19:55:40.693 INFO:teuthology.orchestra.run.smithi101.stdout: }, 2023-08-01T19:55:40.693 INFO:teuthology.orchestra.run.smithi101.stdout: { 2023-08-01T19:55:40.693 INFO:teuthology.orchestra.run.smithi101.stdout: "event": "queued_for_pg", 2023-08-01T19:55:40.693 INFO:teuthology.orchestra.run.smithi101.stdout: "time": "2023-08-01T19:54:04.458997+0000", 2023-08-01T19:55:40.694 INFO:teuthology.orchestra.run.smithi101.stdout: "duration": 4.4530000000000004e-06 2023-08-01T19:55:40.694 INFO:teuthology.orchestra.run.smithi101.stdout: }, 2023-08-01T19:55:40.694 INFO:teuthology.orchestra.run.smithi101.stdout: { 2023-08-01T19:55:40.694 INFO:teuthology.orchestra.run.smithi101.stdout: "event": "reached_pg", 2023-08-01T19:55:40.694 INFO:teuthology.orchestra.run.smithi101.stdout: "time": "2023-08-01T19:54:04.459060+0000", 2023-08-01T19:55:40.694 INFO:teuthology.orchestra.run.smithi101.stdout: "duration": 6.3249000000000004e-05 2023-08-01T19:55:40.694 INFO:teuthology.orchestra.run.smithi101.stdout: }, 2023-08-01T19:55:40.694 INFO:teuthology.orchestra.run.smithi101.stdout: { 2023-08-01T19:55:40.695 INFO:teuthology.orchestra.run.smithi101.stdout: "event": "waiting_for_map not empty", 2023-08-01T19:55:40.695 INFO:teuthology.orchestra.run.smithi101.stdout: "time": "2023-08-01T19:54:04.459063+0000", 2023-08-01T19:55:40.695 INFO:teuthology.orchestra.run.smithi101.stdout: "duration": 2.717e-06 2023-08-01T19:55:40.695 INFO:teuthology.orchestra.run.smithi101.stdout: }, 2023-08-01T19:55:40.695 INFO:teuthology.orchestra.run.smithi101.stdout: { 2023-08-01T19:55:40.695 INFO:teuthology.orchestra.run.smithi101.stdout: "event": "reached_pg", 2023-08-01T19:55:40.695 INFO:teuthology.orchestra.run.smithi101.stdout: "time": "2023-08-01T19:54:04.473625+0000", 2023-08-01T19:55:40.696 INFO:teuthology.orchestra.run.smithi101.stdout: "duration": 0.014562007 2023-08-01T19:55:40.696 INFO:teuthology.orchestra.run.smithi101.stdout: }, 2023-08-01T19:55:40.696 INFO:teuthology.orchestra.run.smithi101.stdout: { 2023-08-01T19:55:40.696 INFO:teuthology.orchestra.run.smithi101.stdout: "event": "started", 2023-08-01T19:55:40.696 INFO:teuthology.orchestra.run.smithi101.stdout: "time": "2023-08-01T19:54:04.473757+0000", 2023-08-01T19:55:40.696 INFO:teuthology.orchestra.run.smithi101.stdout: "duration": 0.00013238599999999999 2023-08-01T19:55:40.696 INFO:teuthology.orchestra.run.smithi101.stdout: }, 2023-08-01T19:55:40.696 INFO:teuthology.orchestra.run.smithi101.stdout: { 2023-08-01T19:55:40.697 INFO:teuthology.orchestra.run.smithi101.stdout: "event": "waiting for subops from 2", 2023-08-01T19:55:40.697 INFO:teuthology.orchestra.run.smithi101.stdout: "time": "2023-08-01T19:54:04.473898+0000", 2023-08-01T19:55:40.697 INFO:teuthology.orchestra.run.smithi101.stdout: "duration": 0.00014039 2023-08-01T19:55:40.697 INFO:teuthology.orchestra.run.smithi101.stdout: }, 2023-08-01T19:55:40.697 INFO:teuthology.orchestra.run.smithi101.stdout: { 2023-08-01T19:55:40.697 INFO:teuthology.orchestra.run.smithi101.stdout: "event": "op_commit", 2023-08-01T19:55:40.697 INFO:teuthology.orchestra.run.smithi101.stdout: "time": "2023-08-01T19:54:04.478380+0000", 2023-08-01T19:55:40.697 INFO:teuthology.orchestra.run.smithi101.stdout: "duration": 0.0044827449999999998 2023-08-01T19:55:40.698 INFO:teuthology.orchestra.run.smithi101.stdout: }, 2023-08-01T19:55:40.698 INFO:teuthology.orchestra.run.smithi101.stdout: { 2023-08-01T19:55:40.698 INFO:teuthology.orchestra.run.smithi101.stdout: "event": "sub_op_commit_rec", 2023-08-01T19:55:40.698 INFO:teuthology.orchestra.run.smithi101.stdout: "time": "2023-08-01T19:54:04.480169+0000", 2023-08-01T19:55:40.698 INFO:teuthology.orchestra.run.smithi101.stdout: "duration": 0.0017886040000000001 2023-08-01T19:55:40.698 INFO:teuthology.orchestra.run.smithi101.stdout: }, 2023-08-01T19:55:40.698 INFO:teuthology.orchestra.run.smithi101.stdout: { 2023-08-01T19:55:40.698 INFO:teuthology.orchestra.run.smithi101.stdout: "event": "commit_sent", 2023-08-01T19:55:40.699 INFO:teuthology.orchestra.run.smithi101.stdout: "time": "2023-08-01T19:54:04.480212+0000", 2023-08-01T19:55:40.699 INFO:teuthology.orchestra.run.smithi101.stdout: "duration": 4.2687e-05 2023-08-01T19:55:40.699 INFO:teuthology.orchestra.run.smithi101.stdout: }, 2023-08-01T19:55:40.699 INFO:teuthology.orchestra.run.smithi101.stdout: { 2023-08-01T19:55:40.699 INFO:teuthology.orchestra.run.smithi101.stdout: "event": "done", 2023-08-01T19:55:40.699 INFO:teuthology.orchestra.run.smithi101.stdout: "time": "2023-08-01T19:54:04.480248+0000", 2023-08-01T19:55:40.699 INFO:teuthology.orchestra.run.smithi101.stdout: "duration": 3.6743999999999999e-05 2023-08-01T19:55:40.699 INFO:teuthology.orchestra.run.smithi101.stdout: } 2023-08-01T19:55:40.700 INFO:teuthology.orchestra.run.smithi101.stdout: ] 2023-08-01T19:55:40.700 INFO:teuthology.orchestra.run.smithi101.stdout: } 2023-08-01T19:55:40.700 INFO:teuthology.orchestra.run.smithi101.stdout: }, 2023-08-01T19:55:40.700 INFO:teuthology.orchestra.run.smithi101.stdout: { 2023-08-01T19:55:40.700 INFO:teuthology.orchestra.run.smithi101.stdout: "description": "osd_op(mds.0.3:13 3.10 3:0d89b25e:::603.00000000:head [create,setxattr parent (62) in=6b,setxattr layout (30) in=6b] snapc 0=[] ondisk+write+known_if_redirected+full_force+supports_pool_eio e17)", 2023-08-01T19:55:40.700 INFO:teuthology.orchestra.run.smithi101.stdout: "initiated_at": "2023-08-01T19:54:04.459010+0000", 2023-08-01T19:55:40.700 INFO:teuthology.orchestra.run.smithi101.stdout: "age": 96.213810218999996, 2023-08-01T19:55:40.701 INFO:teuthology.orchestra.run.smithi101.stdout: "duration": 0.021327220000000001, 2023-08-01T19:55:40.701 INFO:teuthology.orchestra.run.smithi101.stdout: "type_data": { 2023-08-01T19:55:40.701 INFO:teuthology.orchestra.run.smithi101.stdout: "flag_point": "commit sent; apply or cleanup", 2023-08-01T19:55:40.701 INFO:teuthology.orchestra.run.smithi101.stdout: "events": [ 2023-08-01T19:55:40.701 INFO:teuthology.orchestra.run.smithi101.stdout: { 2023-08-01T19:55:40.701 INFO:teuthology.orchestra.run.smithi101.stdout: "event": "initiated", 2023-08-01T19:55:40.701 INFO:teuthology.orchestra.run.smithi101.stdout: "time": "2023-08-01T19:54:04.459010+0000", 2023-08-01T19:55:40.701 INFO:teuthology.orchestra.run.smithi101.stdout: "duration": 0 2023-08-01T19:55:40.702 INFO:teuthology.orchestra.run.smithi101.stdout: }, 2023-08-01T19:55:40.702 INFO:teuthology.orchestra.run.smithi101.stdout: { 2023-08-01T19:55:40.702 INFO:teuthology.orchestra.run.smithi101.stdout: "event": "throttled", 2023-08-01T19:55:40.702 INFO:teuthology.orchestra.run.smithi101.stdout: "time": "2023-08-01T19:54:04.459010+0000", 2023-08-01T19:55:40.702 INFO:teuthology.orchestra.run.smithi101.stdout: "duration": 0 2023-08-01T19:55:40.702 INFO:teuthology.orchestra.run.smithi101.stdout: }, 2023-08-01T19:55:40.702 INFO:teuthology.orchestra.run.smithi101.stdout: { 2023-08-01T19:55:40.703 INFO:teuthology.orchestra.run.smithi101.stdout: "event": "header_read", 2023-08-01T19:55:40.703 INFO:teuthology.orchestra.run.smithi101.stdout: "time": "2023-08-01T19:54:04.459009+0000", 2023-08-01T19:55:40.703 INFO:teuthology.orchestra.run.smithi101.stdout: "duration": 4294967295.9999995 2023-08-01T19:55:40.703 INFO:teuthology.orchestra.run.smithi101.stdout: }, 2023-08-01T19:55:40.703 INFO:teuthology.orchestra.run.smithi101.stdout: { 2023-08-01T19:55:40.703 INFO:teuthology.orchestra.run.smithi101.stdout: "event": "all_read", 2023-08-01T19:55:40.703 INFO:teuthology.orchestra.run.smithi101.stdout: "time": "2023-08-01T19:54:04.459013+0000", 2023-08-01T19:55:40.703 INFO:teuthology.orchestra.run.smithi101.stdout: "duration": 3.8929999999999998e-06 2023-08-01T19:55:40.704 INFO:teuthology.orchestra.run.smithi101.stdout: }, 2023-08-01T19:55:40.704 INFO:teuthology.orchestra.run.smithi101.stdout: { 2023-08-01T19:55:40.704 INFO:teuthology.orchestra.run.smithi101.stdout: "event": "dispatched", 2023-08-01T19:55:40.704 INFO:teuthology.orchestra.run.smithi101.stdout: "time": "2023-08-01T19:54:04.459027+0000", 2023-08-01T19:55:40.704 INFO:teuthology.orchestra.run.smithi101.stdout: "duration": 1.3416e-05 2023-08-01T19:55:40.704 INFO:teuthology.orchestra.run.smithi101.stdout: }, 2023-08-01T19:55:40.704 INFO:teuthology.orchestra.run.smithi101.stdout: { 2023-08-01T19:55:40.704 INFO:teuthology.orchestra.run.smithi101.stdout: "event": "queued_for_pg", 2023-08-01T19:55:40.705 INFO:teuthology.orchestra.run.smithi101.stdout: "time": "2023-08-01T19:54:04.459033+0000", 2023-08-01T19:55:40.705 INFO:teuthology.orchestra.run.smithi101.stdout: "duration": 5.9800000000000003e-06 2023-08-01T19:55:40.705 INFO:teuthology.orchestra.run.smithi101.stdout: }, 2023-08-01T19:55:40.705 INFO:teuthology.orchestra.run.smithi101.stdout: { 2023-08-01T19:55:40.705 INFO:teuthology.orchestra.run.smithi101.stdout: "event": "reached_pg", 2023-08-01T19:55:40.705 INFO:teuthology.orchestra.run.smithi101.stdout: "time": "2023-08-01T19:54:04.459099+0000", 2023-08-01T19:55:40.705 INFO:teuthology.orchestra.run.smithi101.stdout: "duration": 6.6192999999999995e-05 2023-08-01T19:55:40.705 INFO:teuthology.orchestra.run.smithi101.stdout: }, 2023-08-01T19:55:40.706 INFO:teuthology.orchestra.run.smithi101.stdout: { 2023-08-01T19:55:40.706 INFO:teuthology.orchestra.run.smithi101.stdout: "event": "waiting_for_map not empty", 2023-08-01T19:55:40.706 INFO:teuthology.orchestra.run.smithi101.stdout: "time": "2023-08-01T19:54:04.459106+0000", 2023-08-01T19:55:40.706 INFO:teuthology.orchestra.run.smithi101.stdout: "duration": 6.8619999999999997e-06 2023-08-01T19:55:40.706 INFO:teuthology.orchestra.run.smithi101.stdout: }, 2023-08-01T19:55:40.706 INFO:teuthology.orchestra.run.smithi101.stdout: { 2023-08-01T19:55:40.706 INFO:teuthology.orchestra.run.smithi101.stdout: "event": "reached_pg", 2023-08-01T19:55:40.706 INFO:teuthology.orchestra.run.smithi101.stdout: "time": "2023-08-01T19:54:04.475182+0000", 2023-08-01T19:55:40.707 INFO:teuthology.orchestra.run.smithi101.stdout: "duration": 0.016076333000000002 2023-08-01T19:55:40.707 INFO:teuthology.orchestra.run.smithi101.stdout: }, 2023-08-01T19:55:40.707 INFO:teuthology.orchestra.run.smithi101.stdout: { 2023-08-01T19:55:40.707 INFO:teuthology.orchestra.run.smithi101.stdout: "event": "started", 2023-08-01T19:55:40.707 INFO:teuthology.orchestra.run.smithi101.stdout: "time": "2023-08-01T19:54:04.475353+0000", 2023-08-01T19:55:40.707 INFO:teuthology.orchestra.run.smithi101.stdout: "duration": 0.000171378 2023-08-01T19:55:40.707 INFO:teuthology.orchestra.run.smithi101.stdout: }, 2023-08-01T19:55:40.707 INFO:teuthology.orchestra.run.smithi101.stdout: { 2023-08-01T19:55:40.708 INFO:teuthology.orchestra.run.smithi101.stdout: "event": "waiting for subops from 2", 2023-08-01T19:55:40.708 INFO:teuthology.orchestra.run.smithi101.stdout: "time": "2023-08-01T19:54:04.475793+0000", 2023-08-01T19:55:40.708 INFO:teuthology.orchestra.run.smithi101.stdout: "duration": 0.000440123 2023-08-01T19:55:40.708 INFO:teuthology.orchestra.run.smithi101.stdout: }, 2023-08-01T19:55:40.708 INFO:teuthology.orchestra.run.smithi101.stdout: { 2023-08-01T19:55:40.708 INFO:teuthology.orchestra.run.smithi101.stdout: "event": "op_commit", 2023-08-01T19:55:40.708 INFO:teuthology.orchestra.run.smithi101.stdout: "time": "2023-08-01T19:54:04.478624+0000", 2023-08-01T19:55:40.709 INFO:teuthology.orchestra.run.smithi101.stdout: "duration": 0.0028305000000000001 2023-08-01T19:55:40.709 INFO:teuthology.orchestra.run.smithi101.stdout: }, 2023-08-01T19:55:40.709 INFO:teuthology.orchestra.run.smithi101.stdout: { 2023-08-01T19:55:40.709 INFO:teuthology.orchestra.run.smithi101.stdout: "event": "sub_op_commit_rec", 2023-08-01T19:55:40.709 INFO:teuthology.orchestra.run.smithi101.stdout: "time": "2023-08-01T19:54:04.480291+0000", 2023-08-01T19:55:40.709 INFO:teuthology.orchestra.run.smithi101.stdout: "duration": 0.0016670000000000001 2023-08-01T19:55:40.709 INFO:teuthology.orchestra.run.smithi101.stdout: }, 2023-08-01T19:55:40.709 INFO:teuthology.orchestra.run.smithi101.stdout: { 2023-08-01T19:55:40.710 INFO:teuthology.orchestra.run.smithi101.stdout: "event": "commit_sent", 2023-08-01T19:55:40.710 INFO:teuthology.orchestra.run.smithi101.stdout: "time": "2023-08-01T19:54:04.480318+0000", 2023-08-01T19:55:40.710 INFO:teuthology.orchestra.run.smithi101.stdout: "duration": 2.6815e-05 2023-08-01T19:55:40.710 INFO:teuthology.orchestra.run.smithi101.stdout: }, 2023-08-01T19:55:40.710 INFO:teuthology.orchestra.run.smithi101.stdout: { 2023-08-01T19:55:40.710 INFO:teuthology.orchestra.run.smithi101.stdout: "event": "done", 2023-08-01T19:55:40.710 INFO:teuthology.orchestra.run.smithi101.stdout: "time": "2023-08-01T19:54:04.480337+0000", 2023-08-01T19:55:40.710 INFO:teuthology.orchestra.run.smithi101.stdout: "duration": 1.9241000000000001e-05 2023-08-01T19:55:40.711 INFO:teuthology.orchestra.run.smithi101.stdout: } 2023-08-01T19:55:40.711 INFO:teuthology.orchestra.run.smithi101.stdout: ] 2023-08-01T19:55:40.711 INFO:teuthology.orchestra.run.smithi101.stdout: } 2023-08-01T19:55:40.711 INFO:teuthology.orchestra.run.smithi101.stdout: }, 2023-08-01T19:55:40.711 INFO:teuthology.orchestra.run.smithi101.stdout: { 2023-08-01T19:55:40.711 INFO:teuthology.orchestra.run.smithi101.stdout: "description": "osd_op(mds.0.3:1 3.14 3:292cf221:::200.00000000:head [writefull 0~90] snapc 0=[] ondisk+write+known_if_redirected+full_force+supports_pool_eio e17)", 2023-08-01T19:55:40.711 INFO:teuthology.orchestra.run.smithi101.stdout: "initiated_at": "2023-08-01T19:54:04.459177+0000", 2023-08-01T19:55:40.711 INFO:teuthology.orchestra.run.smithi101.stdout: "age": 96.213643320000003, 2023-08-01T19:55:40.712 INFO:teuthology.orchestra.run.smithi101.stdout: "duration": 0.021067196, 2023-08-01T19:55:40.712 INFO:teuthology.orchestra.run.smithi101.stdout: "type_data": { 2023-08-01T19:55:40.712 INFO:teuthology.orchestra.run.smithi101.stdout: "flag_point": "commit sent; apply or cleanup", 2023-08-01T19:55:40.712 INFO:teuthology.orchestra.run.smithi101.stdout: "events": [ 2023-08-01T19:55:40.712 INFO:teuthology.orchestra.run.smithi101.stdout: { 2023-08-01T19:55:40.712 INFO:teuthology.orchestra.run.smithi101.stdout: "event": "initiated", 2023-08-01T19:55:40.712 INFO:teuthology.orchestra.run.smithi101.stdout: "time": "2023-08-01T19:54:04.459177+0000", 2023-08-01T19:55:40.712 INFO:teuthology.orchestra.run.smithi101.stdout: "duration": 0 2023-08-01T19:55:40.713 INFO:teuthology.orchestra.run.smithi101.stdout: }, 2023-08-01T19:55:40.713 INFO:teuthology.orchestra.run.smithi101.stdout: { 2023-08-01T19:55:40.713 INFO:teuthology.orchestra.run.smithi101.stdout: "event": "throttled", 2023-08-01T19:55:40.713 INFO:teuthology.orchestra.run.smithi101.stdout: "time": "2023-08-01T19:54:04.459177+0000", 2023-08-01T19:55:40.713 INFO:teuthology.orchestra.run.smithi101.stdout: "duration": 0 2023-08-01T19:55:40.713 INFO:teuthology.orchestra.run.smithi101.stdout: }, 2023-08-01T19:55:40.713 INFO:teuthology.orchestra.run.smithi101.stdout: { 2023-08-01T19:55:40.714 INFO:teuthology.orchestra.run.smithi101.stdout: "event": "header_read", 2023-08-01T19:55:40.714 INFO:teuthology.orchestra.run.smithi101.stdout: "time": "2023-08-01T19:54:04.459176+0000", 2023-08-01T19:55:40.714 INFO:teuthology.orchestra.run.smithi101.stdout: "duration": 4294967295.9999995 2023-08-01T19:55:40.714 INFO:teuthology.orchestra.run.smithi101.stdout: }, 2023-08-01T19:55:40.714 INFO:teuthology.orchestra.run.smithi101.stdout: { 2023-08-01T19:55:40.714 INFO:teuthology.orchestra.run.smithi101.stdout: "event": "all_read", 2023-08-01T19:55:40.714 INFO:teuthology.orchestra.run.smithi101.stdout: "time": "2023-08-01T19:54:04.459181+0000", 2023-08-01T19:55:40.714 INFO:teuthology.orchestra.run.smithi101.stdout: "duration": 5.2109999999999997e-06 2023-08-01T19:55:40.715 INFO:teuthology.orchestra.run.smithi101.stdout: }, 2023-08-01T19:55:40.715 INFO:teuthology.orchestra.run.smithi101.stdout: { 2023-08-01T19:55:40.715 INFO:teuthology.orchestra.run.smithi101.stdout: "event": "dispatched", 2023-08-01T19:55:40.715 INFO:teuthology.orchestra.run.smithi101.stdout: "time": "2023-08-01T19:54:04.459188+0000", 2023-08-01T19:55:40.715 INFO:teuthology.orchestra.run.smithi101.stdout: "duration": 6.6680000000000004e-06 2023-08-01T19:55:40.715 INFO:teuthology.orchestra.run.smithi101.stdout: }, 2023-08-01T19:55:40.715 INFO:teuthology.orchestra.run.smithi101.stdout: { 2023-08-01T19:55:40.715 INFO:teuthology.orchestra.run.smithi101.stdout: "event": "queued_for_pg", 2023-08-01T19:55:40.716 INFO:teuthology.orchestra.run.smithi101.stdout: "time": "2023-08-01T19:54:04.459192+0000", 2023-08-01T19:55:40.716 INFO:teuthology.orchestra.run.smithi101.stdout: "duration": 4.228e-06 2023-08-01T19:55:40.716 INFO:teuthology.orchestra.run.smithi101.stdout: }, 2023-08-01T19:55:40.716 INFO:teuthology.orchestra.run.smithi101.stdout: { 2023-08-01T19:55:40.716 INFO:teuthology.orchestra.run.smithi101.stdout: "event": "reached_pg", 2023-08-01T19:55:40.716 INFO:teuthology.orchestra.run.smithi101.stdout: "time": "2023-08-01T19:54:04.459219+0000", 2023-08-01T19:55:40.716 INFO:teuthology.orchestra.run.smithi101.stdout: "duration": 2.6930000000000001e-05 2023-08-01T19:55:40.716 INFO:teuthology.orchestra.run.smithi101.stdout: }, 2023-08-01T19:55:40.717 INFO:teuthology.orchestra.run.smithi101.stdout: { 2023-08-01T19:55:40.717 INFO:teuthology.orchestra.run.smithi101.stdout: "event": "waiting_for_map not empty", 2023-08-01T19:55:40.717 INFO:teuthology.orchestra.run.smithi101.stdout: "time": "2023-08-01T19:54:04.459223+0000", 2023-08-01T19:55:40.717 INFO:teuthology.orchestra.run.smithi101.stdout: "duration": 3.8469999999999998e-06 2023-08-01T19:55:40.717 INFO:teuthology.orchestra.run.smithi101.stdout: }, 2023-08-01T19:55:40.717 INFO:teuthology.orchestra.run.smithi101.stdout: { 2023-08-01T19:55:40.717 INFO:teuthology.orchestra.run.smithi101.stdout: "event": "reached_pg", 2023-08-01T19:55:40.718 INFO:teuthology.orchestra.run.smithi101.stdout: "time": "2023-08-01T19:54:04.473347+0000", 2023-08-01T19:55:40.718 INFO:teuthology.orchestra.run.smithi101.stdout: "duration": 0.014124319 2023-08-01T19:55:40.718 INFO:teuthology.orchestra.run.smithi101.stdout: }, 2023-08-01T19:55:40.718 INFO:teuthology.orchestra.run.smithi101.stdout: { 2023-08-01T19:55:40.718 INFO:teuthology.orchestra.run.smithi101.stdout: "event": "started", 2023-08-01T19:55:40.718 INFO:teuthology.orchestra.run.smithi101.stdout: "time": "2023-08-01T19:54:04.473480+0000", 2023-08-01T19:55:40.718 INFO:teuthology.orchestra.run.smithi101.stdout: "duration": 0.00013276799999999999 2023-08-01T19:55:40.718 INFO:teuthology.orchestra.run.smithi101.stdout: }, 2023-08-01T19:55:40.719 INFO:teuthology.orchestra.run.smithi101.stdout: { 2023-08-01T19:55:40.719 INFO:teuthology.orchestra.run.smithi101.stdout: "event": "waiting for subops from 2", 2023-08-01T19:55:40.719 INFO:teuthology.orchestra.run.smithi101.stdout: "time": "2023-08-01T19:54:04.473622+0000", 2023-08-01T19:55:40.719 INFO:teuthology.orchestra.run.smithi101.stdout: "duration": 0.00014154799999999999 2023-08-01T19:55:40.719 INFO:teuthology.orchestra.run.smithi101.stdout: }, 2023-08-01T19:55:40.719 INFO:teuthology.orchestra.run.smithi101.stdout: { 2023-08-01T19:55:40.719 INFO:teuthology.orchestra.run.smithi101.stdout: "event": "op_commit", 2023-08-01T19:55:40.719 INFO:teuthology.orchestra.run.smithi101.stdout: "time": "2023-08-01T19:54:04.478281+0000", 2023-08-01T19:55:40.720 INFO:teuthology.orchestra.run.smithi101.stdout: "duration": 0.004659252 2023-08-01T19:55:40.720 INFO:teuthology.orchestra.run.smithi101.stdout: }, 2023-08-01T19:55:40.720 INFO:teuthology.orchestra.run.smithi101.stdout: { 2023-08-01T19:55:40.720 INFO:teuthology.orchestra.run.smithi101.stdout: "event": "sub_op_commit_rec", 2023-08-01T19:55:40.720 INFO:teuthology.orchestra.run.smithi101.stdout: "time": "2023-08-01T19:54:04.480180+0000", 2023-08-01T19:55:40.720 INFO:teuthology.orchestra.run.smithi101.stdout: "duration": 0.0018986859999999999 2023-08-01T19:55:40.720 INFO:teuthology.orchestra.run.smithi101.stdout: }, 2023-08-01T19:55:40.720 INFO:teuthology.orchestra.run.smithi101.stdout: { 2023-08-01T19:55:40.721 INFO:teuthology.orchestra.run.smithi101.stdout: "event": "commit_sent", 2023-08-01T19:55:40.721 INFO:teuthology.orchestra.run.smithi101.stdout: "time": "2023-08-01T19:54:04.480209+0000", 2023-08-01T19:55:40.721 INFO:teuthology.orchestra.run.smithi101.stdout: "duration": 2.9244999999999999e-05 2023-08-01T19:55:40.721 INFO:teuthology.orchestra.run.smithi101.stdout: }, 2023-08-01T19:55:40.721 INFO:teuthology.orchestra.run.smithi101.stdout: { 2023-08-01T19:55:40.721 INFO:teuthology.orchestra.run.smithi101.stdout: "event": "done", 2023-08-01T19:55:40.721 INFO:teuthology.orchestra.run.smithi101.stdout: "time": "2023-08-01T19:54:04.480244+0000", 2023-08-01T19:55:40.721 INFO:teuthology.orchestra.run.smithi101.stdout: "duration": 3.4875000000000001e-05 2023-08-01T19:55:40.722 INFO:teuthology.orchestra.run.smithi101.stdout: } 2023-08-01T19:55:40.722 INFO:teuthology.orchestra.run.smithi101.stdout: ] 2023-08-01T19:55:40.722 INFO:teuthology.orchestra.run.smithi101.stdout: } 2023-08-01T19:55:40.722 INFO:teuthology.orchestra.run.smithi101.stdout: }, 2023-08-01T19:55:40.722 INFO:teuthology.orchestra.run.smithi101.stdout: { 2023-08-01T19:55:40.722 INFO:teuthology.orchestra.run.smithi101.stdout: "description": "osd_op(mds.0.3:3 3.14 3:287034c4:::1.00000000.inode:head [writefull 0~554] snapc 0=[] ondisk+write+known_if_redirected+full_force+supports_pool_eio e17)", 2023-08-01T19:55:40.722 INFO:teuthology.orchestra.run.smithi101.stdout: "initiated_at": "2023-08-01T19:54:04.459226+0000", 2023-08-01T19:55:40.722 INFO:teuthology.orchestra.run.smithi101.stdout: "age": 96.213594240999996, 2023-08-01T19:55:40.723 INFO:teuthology.orchestra.run.smithi101.stdout: "duration": 0.021104531999999999, 2023-08-01T19:55:40.723 INFO:teuthology.orchestra.run.smithi101.stdout: "type_data": { 2023-08-01T19:55:40.723 INFO:teuthology.orchestra.run.smithi101.stdout: "flag_point": "commit sent; apply or cleanup", 2023-08-01T19:55:40.723 INFO:teuthology.orchestra.run.smithi101.stdout: "events": [ 2023-08-01T19:55:40.723 INFO:teuthology.orchestra.run.smithi101.stdout: { 2023-08-01T19:55:40.723 INFO:teuthology.orchestra.run.smithi101.stdout: "event": "initiated", 2023-08-01T19:55:40.723 INFO:teuthology.orchestra.run.smithi101.stdout: "time": "2023-08-01T19:54:04.459226+0000", 2023-08-01T19:55:40.724 INFO:teuthology.orchestra.run.smithi101.stdout: "duration": 0 2023-08-01T19:55:40.724 INFO:teuthology.orchestra.run.smithi101.stdout: }, 2023-08-01T19:55:40.724 INFO:teuthology.orchestra.run.smithi101.stdout: { 2023-08-01T19:55:40.724 INFO:teuthology.orchestra.run.smithi101.stdout: "event": "throttled", 2023-08-01T19:55:40.724 INFO:teuthology.orchestra.run.smithi101.stdout: "time": "2023-08-01T19:54:04.459226+0000", 2023-08-01T19:55:40.724 INFO:teuthology.orchestra.run.smithi101.stdout: "duration": 0 2023-08-01T19:55:40.724 INFO:teuthology.orchestra.run.smithi101.stdout: }, 2023-08-01T19:55:40.724 INFO:teuthology.orchestra.run.smithi101.stdout: { 2023-08-01T19:55:40.725 INFO:teuthology.orchestra.run.smithi101.stdout: "event": "header_read", 2023-08-01T19:55:40.725 INFO:teuthology.orchestra.run.smithi101.stdout: "time": "2023-08-01T19:54:04.459225+0000", 2023-08-01T19:55:40.725 INFO:teuthology.orchestra.run.smithi101.stdout: "duration": 4294967295.9999995 2023-08-01T19:55:40.725 INFO:teuthology.orchestra.run.smithi101.stdout: }, 2023-08-01T19:55:40.725 INFO:teuthology.orchestra.run.smithi101.stdout: { 2023-08-01T19:55:40.725 INFO:teuthology.orchestra.run.smithi101.stdout: "event": "all_read", 2023-08-01T19:55:40.725 INFO:teuthology.orchestra.run.smithi101.stdout: "time": "2023-08-01T19:54:04.459238+0000", 2023-08-01T19:55:40.725 INFO:teuthology.orchestra.run.smithi101.stdout: "duration": 1.2809000000000001e-05 2023-08-01T19:55:40.726 INFO:teuthology.orchestra.run.smithi101.stdout: }, 2023-08-01T19:55:40.726 INFO:teuthology.orchestra.run.smithi101.stdout: { 2023-08-01T19:55:40.726 INFO:teuthology.orchestra.run.smithi101.stdout: "event": "dispatched", 2023-08-01T19:55:40.726 INFO:teuthology.orchestra.run.smithi101.stdout: "time": "2023-08-01T19:54:04.459245+0000", 2023-08-01T19:55:40.726 INFO:teuthology.orchestra.run.smithi101.stdout: "duration": 6.6540000000000002e-06 2023-08-01T19:55:40.726 INFO:teuthology.orchestra.run.smithi101.stdout: }, 2023-08-01T19:55:40.726 INFO:teuthology.orchestra.run.smithi101.stdout: { 2023-08-01T19:55:40.726 INFO:teuthology.orchestra.run.smithi101.stdout: "event": "queued_for_pg", 2023-08-01T19:55:40.727 INFO:teuthology.orchestra.run.smithi101.stdout: "time": "2023-08-01T19:54:04.459249+0000", 2023-08-01T19:55:40.727 INFO:teuthology.orchestra.run.smithi101.stdout: "duration": 4.6e-06 2023-08-01T19:55:40.727 INFO:teuthology.orchestra.run.smithi101.stdout: }, 2023-08-01T19:55:40.727 INFO:teuthology.orchestra.run.smithi101.stdout: { 2023-08-01T19:55:40.727 INFO:teuthology.orchestra.run.smithi101.stdout: "event": "reached_pg", 2023-08-01T19:55:40.727 INFO:teuthology.orchestra.run.smithi101.stdout: "time": "2023-08-01T19:54:04.459276+0000", 2023-08-01T19:55:40.727 INFO:teuthology.orchestra.run.smithi101.stdout: "duration": 2.6373999999999999e-05 2023-08-01T19:55:40.728 INFO:teuthology.orchestra.run.smithi101.stdout: }, 2023-08-01T19:55:40.728 INFO:teuthology.orchestra.run.smithi101.stdout: { 2023-08-01T19:55:40.728 INFO:teuthology.orchestra.run.smithi101.stdout: "event": "waiting_for_map not empty", 2023-08-01T19:55:40.728 INFO:teuthology.orchestra.run.smithi101.stdout: "time": "2023-08-01T19:54:04.459278+0000", 2023-08-01T19:55:40.728 INFO:teuthology.orchestra.run.smithi101.stdout: "duration": 2.4980000000000001e-06 2023-08-01T19:55:40.728 INFO:teuthology.orchestra.run.smithi101.stdout: }, 2023-08-01T19:55:40.728 INFO:teuthology.orchestra.run.smithi101.stdout: { 2023-08-01T19:55:40.728 INFO:teuthology.orchestra.run.smithi101.stdout: "event": "reached_pg", 2023-08-01T19:55:40.729 INFO:teuthology.orchestra.run.smithi101.stdout: "time": "2023-08-01T19:54:04.474058+0000", 2023-08-01T19:55:40.729 INFO:teuthology.orchestra.run.smithi101.stdout: "duration": 0.014779979 2023-08-01T19:55:40.729 INFO:teuthology.orchestra.run.smithi101.stdout: }, 2023-08-01T19:55:40.729 INFO:teuthology.orchestra.run.smithi101.stdout: { 2023-08-01T19:55:40.729 INFO:teuthology.orchestra.run.smithi101.stdout: "event": "started", 2023-08-01T19:55:40.729 INFO:teuthology.orchestra.run.smithi101.stdout: "time": "2023-08-01T19:54:04.474614+0000", 2023-08-01T19:55:40.729 INFO:teuthology.orchestra.run.smithi101.stdout: "duration": 0.00055546899999999995 2023-08-01T19:55:40.729 INFO:teuthology.orchestra.run.smithi101.stdout: }, 2023-08-01T19:55:40.730 INFO:teuthology.orchestra.run.smithi101.stdout: { 2023-08-01T19:55:40.730 INFO:teuthology.orchestra.run.smithi101.stdout: "event": "waiting for subops from 2", 2023-08-01T19:55:40.730 INFO:teuthology.orchestra.run.smithi101.stdout: "time": "2023-08-01T19:54:04.474720+0000", 2023-08-01T19:55:40.730 INFO:teuthology.orchestra.run.smithi101.stdout: "duration": 0.00010645300000000001 2023-08-01T19:55:40.730 INFO:teuthology.orchestra.run.smithi101.stdout: }, 2023-08-01T19:55:40.730 INFO:teuthology.orchestra.run.smithi101.stdout: { 2023-08-01T19:55:40.730 INFO:teuthology.orchestra.run.smithi101.stdout: "event": "op_commit", 2023-08-01T19:55:40.730 INFO:teuthology.orchestra.run.smithi101.stdout: "time": "2023-08-01T19:54:04.478480+0000", 2023-08-01T19:55:40.731 INFO:teuthology.orchestra.run.smithi101.stdout: "duration": 0.0037600279999999999 2023-08-01T19:55:40.731 INFO:teuthology.orchestra.run.smithi101.stdout: }, 2023-08-01T19:55:40.731 INFO:teuthology.orchestra.run.smithi101.stdout: { 2023-08-01T19:55:40.731 INFO:teuthology.orchestra.run.smithi101.stdout: "event": "sub_op_commit_rec", 2023-08-01T19:55:40.731 INFO:teuthology.orchestra.run.smithi101.stdout: "time": "2023-08-01T19:54:04.480273+0000", 2023-08-01T19:55:40.731 INFO:teuthology.orchestra.run.smithi101.stdout: "duration": 0.001792465 2023-08-01T19:55:40.731 INFO:teuthology.orchestra.run.smithi101.stdout: }, 2023-08-01T19:55:40.731 INFO:teuthology.orchestra.run.smithi101.stdout: { 2023-08-01T19:55:40.732 INFO:teuthology.orchestra.run.smithi101.stdout: "event": "commit_sent", 2023-08-01T19:55:40.732 INFO:teuthology.orchestra.run.smithi101.stdout: "time": "2023-08-01T19:54:04.480304+0000", 2023-08-01T19:55:40.732 INFO:teuthology.orchestra.run.smithi101.stdout: "duration": 3.1708999999999997e-05 2023-08-01T19:55:40.732 INFO:teuthology.orchestra.run.smithi101.stdout: }, 2023-08-01T19:55:40.732 INFO:teuthology.orchestra.run.smithi101.stdout: { 2023-08-01T19:55:40.732 INFO:teuthology.orchestra.run.smithi101.stdout: "event": "done", 2023-08-01T19:55:40.732 INFO:teuthology.orchestra.run.smithi101.stdout: "time": "2023-08-01T19:54:04.480330+0000", 2023-08-01T19:55:40.733 INFO:teuthology.orchestra.run.smithi101.stdout: "duration": 2.5860999999999999e-05 2023-08-01T19:55:40.733 INFO:teuthology.orchestra.run.smithi101.stdout: } 2023-08-01T19:55:40.733 INFO:teuthology.orchestra.run.smithi101.stdout: ] 2023-08-01T19:55:40.733 INFO:teuthology.orchestra.run.smithi101.stdout: } 2023-08-01T19:55:40.733 INFO:teuthology.orchestra.run.smithi101.stdout: }, 2023-08-01T19:55:40.733 INFO:teuthology.orchestra.run.smithi101.stdout: { 2023-08-01T19:55:40.733 INFO:teuthology.orchestra.run.smithi101.stdout: "description": "osd_op(mds.0.3:32 3.14 3:2e2fa760:::200.00000001:head [delete] snapc 0=[] ondisk+write+known_if_redirected+full_force+supports_pool_eio e17)", 2023-08-01T19:55:40.733 INFO:teuthology.orchestra.run.smithi101.stdout: "initiated_at": "2023-08-01T19:54:04.459304+0000", 2023-08-01T19:55:40.734 INFO:teuthology.orchestra.run.smithi101.stdout: "age": 96.213515580000006, 2023-08-01T19:55:40.734 INFO:teuthology.orchestra.run.smithi101.stdout: "duration": 0.021110606000000001, 2023-08-01T19:55:40.734 INFO:teuthology.orchestra.run.smithi101.stdout: "type_data": { 2023-08-01T19:55:40.734 INFO:teuthology.orchestra.run.smithi101.stdout: "flag_point": "started", 2023-08-01T19:55:40.734 INFO:teuthology.orchestra.run.smithi101.stdout: "events": [ 2023-08-01T19:55:40.734 INFO:teuthology.orchestra.run.smithi101.stdout: { 2023-08-01T19:55:40.734 INFO:teuthology.orchestra.run.smithi101.stdout: "event": "initiated", 2023-08-01T19:55:40.734 INFO:teuthology.orchestra.run.smithi101.stdout: "time": "2023-08-01T19:54:04.459304+0000", 2023-08-01T19:55:40.735 INFO:teuthology.orchestra.run.smithi101.stdout: "duration": 0 2023-08-01T19:55:40.735 INFO:teuthology.orchestra.run.smithi101.stdout: }, 2023-08-01T19:55:40.735 INFO:teuthology.orchestra.run.smithi101.stdout: { 2023-08-01T19:55:40.735 INFO:teuthology.orchestra.run.smithi101.stdout: "event": "throttled", 2023-08-01T19:55:40.735 INFO:teuthology.orchestra.run.smithi101.stdout: "time": "2023-08-01T19:54:04.459304+0000", 2023-08-01T19:55:40.735 INFO:teuthology.orchestra.run.smithi101.stdout: "duration": 0 2023-08-01T19:55:40.735 INFO:teuthology.orchestra.run.smithi101.stdout: }, 2023-08-01T19:55:40.736 INFO:teuthology.orchestra.run.smithi101.stdout: { 2023-08-01T19:55:40.736 INFO:teuthology.orchestra.run.smithi101.stdout: "event": "header_read", 2023-08-01T19:55:40.736 INFO:teuthology.orchestra.run.smithi101.stdout: "time": "2023-08-01T19:54:04.459304+0000", 2023-08-01T19:55:40.736 INFO:teuthology.orchestra.run.smithi101.stdout: "duration": 4294967295.9999995 2023-08-01T19:55:40.736 INFO:teuthology.orchestra.run.smithi101.stdout: }, 2023-08-01T19:55:40.736 INFO:teuthology.orchestra.run.smithi101.stdout: { 2023-08-01T19:55:40.736 INFO:teuthology.orchestra.run.smithi101.stdout: "event": "all_read", 2023-08-01T19:55:40.736 INFO:teuthology.orchestra.run.smithi101.stdout: "time": "2023-08-01T19:54:04.459306+0000", 2023-08-01T19:55:40.737 INFO:teuthology.orchestra.run.smithi101.stdout: "duration": 2.3889999999999999e-06 2023-08-01T19:55:40.737 INFO:teuthology.orchestra.run.smithi101.stdout: }, 2023-08-01T19:55:40.737 INFO:teuthology.orchestra.run.smithi101.stdout: { 2023-08-01T19:55:40.737 INFO:teuthology.orchestra.run.smithi101.stdout: "event": "dispatched", 2023-08-01T19:55:40.737 INFO:teuthology.orchestra.run.smithi101.stdout: "time": "2023-08-01T19:54:04.459314+0000", 2023-08-01T19:55:40.737 INFO:teuthology.orchestra.run.smithi101.stdout: "duration": 7.1180000000000003e-06 2023-08-01T19:55:40.737 INFO:teuthology.orchestra.run.smithi101.stdout: }, 2023-08-01T19:55:40.737 INFO:teuthology.orchestra.run.smithi101.stdout: { 2023-08-01T19:55:40.738 INFO:teuthology.orchestra.run.smithi101.stdout: "event": "queued_for_pg", 2023-08-01T19:55:40.738 INFO:teuthology.orchestra.run.smithi101.stdout: "time": "2023-08-01T19:54:04.459318+0000", 2023-08-01T19:55:40.738 INFO:teuthology.orchestra.run.smithi101.stdout: "duration": 4.0239999999999999e-06 2023-08-01T19:55:40.738 INFO:teuthology.orchestra.run.smithi101.stdout: }, 2023-08-01T19:55:40.738 INFO:teuthology.orchestra.run.smithi101.stdout: { 2023-08-01T19:55:40.738 INFO:teuthology.orchestra.run.smithi101.stdout: "event": "reached_pg", 2023-08-01T19:55:40.738 INFO:teuthology.orchestra.run.smithi101.stdout: "time": "2023-08-01T19:54:04.459340+0000", 2023-08-01T19:55:40.738 INFO:teuthology.orchestra.run.smithi101.stdout: "duration": 2.2476e-05 2023-08-01T19:55:40.739 INFO:teuthology.orchestra.run.smithi101.stdout: }, 2023-08-01T19:55:40.739 INFO:teuthology.orchestra.run.smithi101.stdout: { 2023-08-01T19:55:40.739 INFO:teuthology.orchestra.run.smithi101.stdout: "event": "waiting_for_map not empty", 2023-08-01T19:55:40.739 INFO:teuthology.orchestra.run.smithi101.stdout: "time": "2023-08-01T19:54:04.459342+0000", 2023-08-01T19:55:40.739 INFO:teuthology.orchestra.run.smithi101.stdout: "duration": 2.272e-06 2023-08-01T19:55:40.739 INFO:teuthology.orchestra.run.smithi101.stdout: }, 2023-08-01T19:55:40.739 INFO:teuthology.orchestra.run.smithi101.stdout: { 2023-08-01T19:55:40.739 INFO:teuthology.orchestra.run.smithi101.stdout: "event": "reached_pg", 2023-08-01T19:55:40.740 INFO:teuthology.orchestra.run.smithi101.stdout: "time": "2023-08-01T19:54:04.475922+0000", 2023-08-01T19:55:40.740 INFO:teuthology.orchestra.run.smithi101.stdout: "duration": 0.016579388 2023-08-01T19:55:40.740 INFO:teuthology.orchestra.run.smithi101.stdout: }, 2023-08-01T19:55:40.740 INFO:teuthology.orchestra.run.smithi101.stdout: { 2023-08-01T19:55:40.740 INFO:teuthology.orchestra.run.smithi101.stdout: "event": "started", 2023-08-01T19:55:40.740 INFO:teuthology.orchestra.run.smithi101.stdout: "time": "2023-08-01T19:54:04.476107+0000", 2023-08-01T19:55:40.741 INFO:teuthology.orchestra.run.smithi101.stdout: "duration": 0.00018486300000000001 2023-08-01T19:55:40.741 INFO:teuthology.orchestra.run.smithi101.stdout: }, 2023-08-01T19:55:40.741 INFO:teuthology.orchestra.run.smithi101.stdout: { 2023-08-01T19:55:40.741 INFO:teuthology.orchestra.run.smithi101.stdout: "event": "done", 2023-08-01T19:55:40.741 INFO:teuthology.orchestra.run.smithi101.stdout: "time": "2023-08-01T19:54:04.480415+0000", 2023-08-01T19:55:40.741 INFO:teuthology.orchestra.run.smithi101.stdout: "duration": 0.0043084589999999997 2023-08-01T19:55:40.741 INFO:teuthology.orchestra.run.smithi101.stdout: } 2023-08-01T19:55:40.741 INFO:teuthology.orchestra.run.smithi101.stdout: ] 2023-08-01T19:55:40.742 INFO:teuthology.orchestra.run.smithi101.stdout: } 2023-08-01T19:55:40.742 INFO:teuthology.orchestra.run.smithi101.stdout: }, 2023-08-01T19:55:40.742 INFO:teuthology.orchestra.run.smithi101.stdout: { 2023-08-01T19:55:40.742 INFO:teuthology.orchestra.run.smithi101.stdout: "description": "osd_op(client.4668.0:70878 5.2 5:49b7d2be:::benchmark_data_smithi006_114134_object70877:head [set-alloc-hint object_size 65536 write_size 65536,write 0~65536] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e30)", 2023-08-01T19:55:40.742 INFO:teuthology.orchestra.run.smithi101.stdout: "initiated_at": "2023-08-01T19:54:50.210223+0000", 2023-08-01T19:55:40.742 INFO:teuthology.orchestra.run.smithi101.stdout: "age": 50.462597010000003, 2023-08-01T19:55:40.742 INFO:teuthology.orchestra.run.smithi101.stdout: "duration": 0.019884895, 2023-08-01T19:55:40.742 INFO:teuthology.orchestra.run.smithi101.stdout: "type_data": { 2023-08-01T19:55:40.743 INFO:teuthology.orchestra.run.smithi101.stdout: "flag_point": "commit sent; apply or cleanup", 2023-08-01T19:55:40.743 INFO:teuthology.orchestra.run.smithi101.stdout: "client_info": { 2023-08-01T19:55:40.743 INFO:teuthology.orchestra.run.smithi101.stdout: "client": "client.4668", 2023-08-01T19:55:40.743 INFO:teuthology.orchestra.run.smithi101.stdout: "client_addr": "172.21.15.6:0/1709472247", 2023-08-01T19:55:40.743 INFO:teuthology.orchestra.run.smithi101.stdout: "tid": 70878 2023-08-01T19:55:40.743 INFO:teuthology.orchestra.run.smithi101.stdout: }, 2023-08-01T19:55:40.743 INFO:teuthology.orchestra.run.smithi101.stdout: "events": [ 2023-08-01T19:55:40.744 INFO:teuthology.orchestra.run.smithi101.stdout: { 2023-08-01T19:55:40.744 INFO:teuthology.orchestra.run.smithi101.stdout: "event": "initiated", 2023-08-01T19:55:40.744 INFO:teuthology.orchestra.run.smithi101.stdout: "time": "2023-08-01T19:54:50.210223+0000", 2023-08-01T19:55:40.744 INFO:teuthology.orchestra.run.smithi101.stdout: "duration": 0 2023-08-01T19:55:40.744 INFO:teuthology.orchestra.run.smithi101.stdout: }, 2023-08-01T19:55:40.744 INFO:teuthology.orchestra.run.smithi101.stdout: { 2023-08-01T19:55:40.745 INFO:teuthology.orchestra.run.smithi101.stdout: "event": "throttled", 2023-08-01T19:55:40.745 INFO:teuthology.orchestra.run.smithi101.stdout: "time": "2023-08-01T19:54:50.210223+0000", 2023-08-01T19:55:40.745 INFO:teuthology.orchestra.run.smithi101.stdout: "duration": 0 2023-08-01T19:55:40.745 INFO:teuthology.orchestra.run.smithi101.stdout: }, 2023-08-01T19:55:40.745 INFO:teuthology.orchestra.run.smithi101.stdout: { 2023-08-01T19:55:40.745 INFO:teuthology.orchestra.run.smithi101.stdout: "event": "header_read", 2023-08-01T19:55:40.745 INFO:teuthology.orchestra.run.smithi101.stdout: "time": "2023-08-01T19:54:50.210222+0000", 2023-08-01T19:55:40.745 INFO:teuthology.orchestra.run.smithi101.stdout: "duration": 4294967295.999999 2023-08-01T19:55:40.746 INFO:teuthology.orchestra.run.smithi101.stdout: }, 2023-08-01T19:55:40.746 INFO:teuthology.orchestra.run.smithi101.stdout: { 2023-08-01T19:55:40.746 INFO:teuthology.orchestra.run.smithi101.stdout: "event": "all_read", 2023-08-01T19:55:40.746 INFO:teuthology.orchestra.run.smithi101.stdout: "time": "2023-08-01T19:54:50.210315+0000", 2023-08-01T19:55:40.746 INFO:teuthology.orchestra.run.smithi101.stdout: "duration": 9.2567999999999999e-05 2023-08-01T19:55:40.746 INFO:teuthology.orchestra.run.smithi101.stdout: }, 2023-08-01T19:55:40.747 INFO:teuthology.orchestra.run.smithi101.stdout: { 2023-08-01T19:55:40.747 INFO:teuthology.orchestra.run.smithi101.stdout: "event": "dispatched", 2023-08-01T19:55:40.747 INFO:teuthology.orchestra.run.smithi101.stdout: "time": "2023-08-01T19:54:50.210326+0000", 2023-08-01T19:55:40.747 INFO:teuthology.orchestra.run.smithi101.stdout: "duration": 1.1430000000000001e-05 2023-08-01T19:55:40.747 INFO:teuthology.orchestra.run.smithi101.stdout: }, 2023-08-01T19:55:40.747 INFO:teuthology.orchestra.run.smithi101.stdout: { 2023-08-01T19:55:40.747 INFO:teuthology.orchestra.run.smithi101.stdout: "event": "queued_for_pg", 2023-08-01T19:55:40.748 INFO:teuthology.orchestra.run.smithi101.stdout: "time": "2023-08-01T19:54:50.210332+0000", 2023-08-01T19:55:40.748 INFO:teuthology.orchestra.run.smithi101.stdout: "duration": 5.8479999999999997e-06 2023-08-01T19:55:40.748 INFO:teuthology.orchestra.run.smithi101.stdout: }, 2023-08-01T19:55:40.748 INFO:teuthology.orchestra.run.smithi101.stdout: { 2023-08-01T19:55:40.748 INFO:teuthology.orchestra.run.smithi101.stdout: "event": "reached_pg", 2023-08-01T19:55:40.748 INFO:teuthology.orchestra.run.smithi101.stdout: "time": "2023-08-01T19:54:50.214259+0000", 2023-08-01T19:55:40.748 INFO:teuthology.orchestra.run.smithi101.stdout: "duration": 0.003926789 2023-08-01T19:55:40.749 INFO:teuthology.orchestra.run.smithi101.stdout: }, 2023-08-01T19:55:40.749 INFO:teuthology.orchestra.run.smithi101.stdout: { 2023-08-01T19:55:40.749 INFO:teuthology.orchestra.run.smithi101.stdout: "event": "started", 2023-08-01T19:55:40.749 INFO:teuthology.orchestra.run.smithi101.stdout: "time": "2023-08-01T19:54:50.214387+0000", 2023-08-01T19:55:40.749 INFO:teuthology.orchestra.run.smithi101.stdout: "duration": 0.00012787599999999999 2023-08-01T19:55:40.749 INFO:teuthology.orchestra.run.smithi101.stdout: }, 2023-08-01T19:55:40.749 INFO:teuthology.orchestra.run.smithi101.stdout: { 2023-08-01T19:55:40.749 INFO:teuthology.orchestra.run.smithi101.stdout: "event": "waiting for subops from 0", 2023-08-01T19:55:40.750 INFO:teuthology.orchestra.run.smithi101.stdout: "time": "2023-08-01T19:54:50.214536+0000", 2023-08-01T19:55:40.750 INFO:teuthology.orchestra.run.smithi101.stdout: "duration": 0.00014935299999999999 2023-08-01T19:55:40.750 INFO:teuthology.orchestra.run.smithi101.stdout: }, 2023-08-01T19:55:40.750 INFO:teuthology.orchestra.run.smithi101.stdout: { 2023-08-01T19:55:40.750 INFO:teuthology.orchestra.run.smithi101.stdout: "event": "op_commit", 2023-08-01T19:55:40.750 INFO:teuthology.orchestra.run.smithi101.stdout: "time": "2023-08-01T19:54:50.217739+0000", 2023-08-01T19:55:40.750 INFO:teuthology.orchestra.run.smithi101.stdout: "duration": 0.0032034619999999998 2023-08-01T19:55:40.750 INFO:teuthology.orchestra.run.smithi101.stdout: }, 2023-08-01T19:55:40.751 INFO:teuthology.orchestra.run.smithi101.stdout: { 2023-08-01T19:55:40.751 INFO:teuthology.orchestra.run.smithi101.stdout: "event": "sub_op_commit_rec", 2023-08-01T19:55:40.751 INFO:teuthology.orchestra.run.smithi101.stdout: "time": "2023-08-01T19:54:50.230032+0000", 2023-08-01T19:55:40.751 INFO:teuthology.orchestra.run.smithi101.stdout: "duration": 0.012293068000000001 2023-08-01T19:55:40.751 INFO:teuthology.orchestra.run.smithi101.stdout: }, 2023-08-01T19:55:40.751 INFO:teuthology.orchestra.run.smithi101.stdout: { 2023-08-01T19:55:40.751 INFO:teuthology.orchestra.run.smithi101.stdout: "event": "commit_sent", 2023-08-01T19:55:40.751 INFO:teuthology.orchestra.run.smithi101.stdout: "time": "2023-08-01T19:54:50.230075+0000", 2023-08-01T19:55:40.752 INFO:teuthology.orchestra.run.smithi101.stdout: "duration": 4.3062999999999997e-05 2023-08-01T19:55:40.752 INFO:teuthology.orchestra.run.smithi101.stdout: }, 2023-08-01T19:55:40.752 INFO:teuthology.orchestra.run.smithi101.stdout: { 2023-08-01T19:55:40.752 INFO:teuthology.orchestra.run.smithi101.stdout: "event": "done", 2023-08-01T19:55:40.752 INFO:teuthology.orchestra.run.smithi101.stdout: "time": "2023-08-01T19:54:50.230108+0000", 2023-08-01T19:55:40.752 INFO:teuthology.orchestra.run.smithi101.stdout: "duration": 3.2366999999999997e-05 2023-08-01T19:55:40.752 INFO:teuthology.orchestra.run.smithi101.stdout: } 2023-08-01T19:55:40.753 INFO:teuthology.orchestra.run.smithi101.stdout: ] 2023-08-01T19:55:40.753 INFO:teuthology.orchestra.run.smithi101.stdout: } 2023-08-01T19:55:40.753 INFO:teuthology.orchestra.run.smithi101.stdout: }, 2023-08-01T19:55:40.753 INFO:teuthology.orchestra.run.smithi101.stdout: { 2023-08-01T19:55:40.753 INFO:teuthology.orchestra.run.smithi101.stdout: "description": "osd_op(client.4668.0:73460 5.f 5:ff4f0704:::benchmark_data_smithi006_114134_object73459:head [set-alloc-hint object_size 65536 write_size 65536,write 0~65536] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e31)", 2023-08-01T19:55:40.753 INFO:teuthology.orchestra.run.smithi101.stdout: "initiated_at": "2023-08-01T19:54:51.462968+0000", 2023-08-01T19:55:40.753 INFO:teuthology.orchestra.run.smithi101.stdout: "age": 49.209852130999998, 2023-08-01T19:55:40.753 INFO:teuthology.orchestra.run.smithi101.stdout: "duration": 0.020056502, 2023-08-01T19:55:40.754 INFO:teuthology.orchestra.run.smithi101.stdout: "type_data": { 2023-08-01T19:55:40.754 INFO:teuthology.orchestra.run.smithi101.stdout: "flag_point": "commit sent; apply or cleanup", 2023-08-01T19:55:40.754 INFO:teuthology.orchestra.run.smithi101.stdout: "client_info": { 2023-08-01T19:55:40.754 INFO:teuthology.orchestra.run.smithi101.stdout: "client": "client.4668", 2023-08-01T19:55:40.754 INFO:teuthology.orchestra.run.smithi101.stdout: "client_addr": "172.21.15.6:0/1709472247", 2023-08-01T19:55:40.754 INFO:teuthology.orchestra.run.smithi101.stdout: "tid": 73460 2023-08-01T19:55:40.754 INFO:teuthology.orchestra.run.smithi101.stdout: }, 2023-08-01T19:55:40.754 INFO:teuthology.orchestra.run.smithi101.stdout: "events": [ 2023-08-01T19:55:40.755 INFO:teuthology.orchestra.run.smithi101.stdout: { 2023-08-01T19:55:40.755 INFO:teuthology.orchestra.run.smithi101.stdout: "event": "initiated", 2023-08-01T19:55:40.755 INFO:teuthology.orchestra.run.smithi101.stdout: "time": "2023-08-01T19:54:51.462968+0000", 2023-08-01T19:55:40.755 INFO:teuthology.orchestra.run.smithi101.stdout: "duration": 0 2023-08-01T19:55:40.755 INFO:teuthology.orchestra.run.smithi101.stdout: }, 2023-08-01T19:55:40.755 INFO:teuthology.orchestra.run.smithi101.stdout: { 2023-08-01T19:55:40.755 INFO:teuthology.orchestra.run.smithi101.stdout: "event": "throttled", 2023-08-01T19:55:40.756 INFO:teuthology.orchestra.run.smithi101.stdout: "time": "2023-08-01T19:54:51.462968+0000", 2023-08-01T19:55:40.756 INFO:teuthology.orchestra.run.smithi101.stdout: "duration": 0 2023-08-01T19:55:40.756 INFO:teuthology.orchestra.run.smithi101.stdout: }, 2023-08-01T19:55:40.756 INFO:teuthology.orchestra.run.smithi101.stdout: { 2023-08-01T19:55:40.756 INFO:teuthology.orchestra.run.smithi101.stdout: "event": "header_read", 2023-08-01T19:55:40.756 INFO:teuthology.orchestra.run.smithi101.stdout: "time": "2023-08-01T19:54:51.462967+0000", 2023-08-01T19:55:40.756 INFO:teuthology.orchestra.run.smithi101.stdout: "duration": 4294967295.999999 2023-08-01T19:55:40.756 INFO:teuthology.orchestra.run.smithi101.stdout: }, 2023-08-01T19:55:40.757 INFO:teuthology.orchestra.run.smithi101.stdout: { 2023-08-01T19:55:40.757 INFO:teuthology.orchestra.run.smithi101.stdout: "event": "all_read", 2023-08-01T19:55:40.757 INFO:teuthology.orchestra.run.smithi101.stdout: "time": "2023-08-01T19:54:51.463009+0000", 2023-08-01T19:55:40.757 INFO:teuthology.orchestra.run.smithi101.stdout: "duration": 4.2106e-05 2023-08-01T19:55:40.757 INFO:teuthology.orchestra.run.smithi101.stdout: }, 2023-08-01T19:55:40.757 INFO:teuthology.orchestra.run.smithi101.stdout: { 2023-08-01T19:55:40.757 INFO:teuthology.orchestra.run.smithi101.stdout: "event": "dispatched", 2023-08-01T19:55:40.757 INFO:teuthology.orchestra.run.smithi101.stdout: "time": "2023-08-01T19:54:51.463017+0000", 2023-08-01T19:55:40.758 INFO:teuthology.orchestra.run.smithi101.stdout: "duration": 8.1529999999999997e-06 2023-08-01T19:55:40.758 INFO:teuthology.orchestra.run.smithi101.stdout: }, 2023-08-01T19:55:40.758 INFO:teuthology.orchestra.run.smithi101.stdout: { 2023-08-01T19:55:40.758 INFO:teuthology.orchestra.run.smithi101.stdout: "event": "queued_for_pg", 2023-08-01T19:55:40.758 INFO:teuthology.orchestra.run.smithi101.stdout: "time": "2023-08-01T19:54:51.463027+0000", 2023-08-01T19:55:40.758 INFO:teuthology.orchestra.run.smithi101.stdout: "duration": 9.5659999999999996e-06 2023-08-01T19:55:40.758 INFO:teuthology.orchestra.run.smithi101.stdout: }, 2023-08-01T19:55:40.758 INFO:teuthology.orchestra.run.smithi101.stdout: { 2023-08-01T19:55:40.759 INFO:teuthology.orchestra.run.smithi101.stdout: "event": "reached_pg", 2023-08-01T19:55:40.759 INFO:teuthology.orchestra.run.smithi101.stdout: "time": "2023-08-01T19:54:51.463062+0000", 2023-08-01T19:55:40.759 INFO:teuthology.orchestra.run.smithi101.stdout: "duration": 3.5442999999999999e-05 2023-08-01T19:55:40.759 INFO:teuthology.orchestra.run.smithi101.stdout: }, 2023-08-01T19:55:40.759 INFO:teuthology.orchestra.run.smithi101.stdout: { 2023-08-01T19:55:40.759 INFO:teuthology.orchestra.run.smithi101.stdout: "event": "started", 2023-08-01T19:55:40.759 INFO:teuthology.orchestra.run.smithi101.stdout: "time": "2023-08-01T19:54:51.463198+0000", 2023-08-01T19:55:40.760 INFO:teuthology.orchestra.run.smithi101.stdout: "duration": 0.000135628 2023-08-01T19:55:40.760 INFO:teuthology.orchestra.run.smithi101.stdout: }, 2023-08-01T19:55:40.760 INFO:teuthology.orchestra.run.smithi101.stdout: { 2023-08-01T19:55:40.760 INFO:teuthology.orchestra.run.smithi101.stdout: "event": "waiting for subops from 2", 2023-08-01T19:55:40.760 INFO:teuthology.orchestra.run.smithi101.stdout: "time": "2023-08-01T19:54:51.463341+0000", 2023-08-01T19:55:40.760 INFO:teuthology.orchestra.run.smithi101.stdout: "duration": 0.00014346500000000001 2023-08-01T19:55:40.760 INFO:teuthology.orchestra.run.smithi101.stdout: }, 2023-08-01T19:55:40.760 INFO:teuthology.orchestra.run.smithi101.stdout: { 2023-08-01T19:55:40.761 INFO:teuthology.orchestra.run.smithi101.stdout: "event": "op_commit", 2023-08-01T19:55:40.761 INFO:teuthology.orchestra.run.smithi101.stdout: "time": "2023-08-01T19:54:51.472684+0000", 2023-08-01T19:55:40.761 INFO:teuthology.orchestra.run.smithi101.stdout: "duration": 0.0093427900000000001 2023-08-01T19:55:40.761 INFO:teuthology.orchestra.run.smithi101.stdout: }, 2023-08-01T19:55:40.761 INFO:teuthology.orchestra.run.smithi101.stdout: { 2023-08-01T19:55:40.761 INFO:teuthology.orchestra.run.smithi101.stdout: "event": "sub_op_commit_rec", 2023-08-01T19:55:40.761 INFO:teuthology.orchestra.run.smithi101.stdout: "time": "2023-08-01T19:54:51.482937+0000", 2023-08-01T19:55:40.761 INFO:teuthology.orchestra.run.smithi101.stdout: "duration": 0.010252557000000001 2023-08-01T19:55:40.762 INFO:teuthology.orchestra.run.smithi101.stdout: }, 2023-08-01T19:55:40.762 INFO:teuthology.orchestra.run.smithi101.stdout: { 2023-08-01T19:55:40.762 INFO:teuthology.orchestra.run.smithi101.stdout: "event": "commit_sent", 2023-08-01T19:55:40.762 INFO:teuthology.orchestra.run.smithi101.stdout: "time": "2023-08-01T19:54:51.482984+0000", 2023-08-01T19:55:40.762 INFO:teuthology.orchestra.run.smithi101.stdout: "duration": 4.7394000000000001e-05 2023-08-01T19:55:40.762 INFO:teuthology.orchestra.run.smithi101.stdout: }, 2023-08-01T19:55:40.762 INFO:teuthology.orchestra.run.smithi101.stdout: { 2023-08-01T19:55:40.763 INFO:teuthology.orchestra.run.smithi101.stdout: "event": "done", 2023-08-01T19:55:40.763 INFO:teuthology.orchestra.run.smithi101.stdout: "time": "2023-08-01T19:54:51.483024+0000", 2023-08-01T19:55:40.763 INFO:teuthology.orchestra.run.smithi101.stdout: "duration": 4.0159e-05 2023-08-01T19:55:40.763 INFO:teuthology.orchestra.run.smithi101.stdout: } 2023-08-01T19:55:40.763 INFO:teuthology.orchestra.run.smithi101.stdout: ] 2023-08-01T19:55:40.763 INFO:teuthology.orchestra.run.smithi101.stdout: } 2023-08-01T19:55:40.763 INFO:teuthology.orchestra.run.smithi101.stdout: }, 2023-08-01T19:55:40.763 INFO:teuthology.orchestra.run.smithi101.stdout: { 2023-08-01T19:55:40.764 INFO:teuthology.orchestra.run.smithi101.stdout: "description": "osd_op(client.4668.0:92726 5.2 5:41e18163:::benchmark_data_smithi006_114134_object92725:head [set-alloc-hint object_size 65536 write_size 65536,write 0~65536] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e36)", 2023-08-01T19:55:40.764 INFO:teuthology.orchestra.run.smithi101.stdout: "initiated_at": "2023-08-01T19:55:01.256971+0000", 2023-08-01T19:55:40.764 INFO:teuthology.orchestra.run.smithi101.stdout: "age": 39.415849051999999, 2023-08-01T19:55:40.764 INFO:teuthology.orchestra.run.smithi101.stdout: "duration": 0.019854296, 2023-08-01T19:55:40.764 INFO:teuthology.orchestra.run.smithi101.stdout: "type_data": { 2023-08-01T19:55:40.764 INFO:teuthology.orchestra.run.smithi101.stdout: "flag_point": "commit sent; apply or cleanup", 2023-08-01T19:55:40.764 INFO:teuthology.orchestra.run.smithi101.stdout: "client_info": { 2023-08-01T19:55:40.764 INFO:teuthology.orchestra.run.smithi101.stdout: "client": "client.4668", 2023-08-01T19:55:40.765 INFO:teuthology.orchestra.run.smithi101.stdout: "client_addr": "172.21.15.6:0/1709472247", 2023-08-01T19:55:40.765 INFO:teuthology.orchestra.run.smithi101.stdout: "tid": 92726 2023-08-01T19:55:40.765 INFO:teuthology.orchestra.run.smithi101.stdout: }, 2023-08-01T19:55:40.765 INFO:teuthology.orchestra.run.smithi101.stdout: "events": [ 2023-08-01T19:55:40.765 INFO:teuthology.orchestra.run.smithi101.stdout: { 2023-08-01T19:55:40.765 INFO:teuthology.orchestra.run.smithi101.stdout: "event": "initiated", 2023-08-01T19:55:40.765 INFO:teuthology.orchestra.run.smithi101.stdout: "time": "2023-08-01T19:55:01.256971+0000", 2023-08-01T19:55:40.765 INFO:teuthology.orchestra.run.smithi101.stdout: "duration": 0 2023-08-01T19:55:40.766 INFO:teuthology.orchestra.run.smithi101.stdout: }, 2023-08-01T19:55:40.766 INFO:teuthology.orchestra.run.smithi101.stdout: { 2023-08-01T19:55:40.766 INFO:teuthology.orchestra.run.smithi101.stdout: "event": "throttled", 2023-08-01T19:55:40.766 INFO:teuthology.orchestra.run.smithi101.stdout: "time": "2023-08-01T19:55:01.256971+0000", 2023-08-01T19:55:40.766 INFO:teuthology.orchestra.run.smithi101.stdout: "duration": 0 2023-08-01T19:55:40.766 INFO:teuthology.orchestra.run.smithi101.stdout: }, 2023-08-01T19:55:40.766 INFO:teuthology.orchestra.run.smithi101.stdout: { 2023-08-01T19:55:40.766 INFO:teuthology.orchestra.run.smithi101.stdout: "event": "header_read", 2023-08-01T19:55:40.767 INFO:teuthology.orchestra.run.smithi101.stdout: "time": "2023-08-01T19:55:01.256970+0000", 2023-08-01T19:55:40.767 INFO:teuthology.orchestra.run.smithi101.stdout: "duration": 4294967295.9999995 2023-08-01T19:55:40.767 INFO:teuthology.orchestra.run.smithi101.stdout: }, 2023-08-01T19:55:40.767 INFO:teuthology.orchestra.run.smithi101.stdout: { 2023-08-01T19:55:40.767 INFO:teuthology.orchestra.run.smithi101.stdout: "event": "all_read", 2023-08-01T19:55:40.767 INFO:teuthology.orchestra.run.smithi101.stdout: "time": "2023-08-01T19:55:01.257057+0000", 2023-08-01T19:55:40.767 INFO:teuthology.orchestra.run.smithi101.stdout: "duration": 8.6627999999999998e-05 2023-08-01T19:55:40.767 INFO:teuthology.orchestra.run.smithi101.stdout: }, 2023-08-01T19:55:40.768 INFO:teuthology.orchestra.run.smithi101.stdout: { 2023-08-01T19:55:40.768 INFO:teuthology.orchestra.run.smithi101.stdout: "event": "dispatched", 2023-08-01T19:55:40.768 INFO:teuthology.orchestra.run.smithi101.stdout: "time": "2023-08-01T19:55:01.257063+0000", 2023-08-01T19:55:40.768 INFO:teuthology.orchestra.run.smithi101.stdout: "duration": 6.528e-06 2023-08-01T19:55:40.768 INFO:teuthology.orchestra.run.smithi101.stdout: }, 2023-08-01T19:55:40.768 INFO:teuthology.orchestra.run.smithi101.stdout: { 2023-08-01T19:55:40.768 INFO:teuthology.orchestra.run.smithi101.stdout: "event": "queued_for_pg", 2023-08-01T19:55:40.769 INFO:teuthology.orchestra.run.smithi101.stdout: "time": "2023-08-01T19:55:01.257067+0000", 2023-08-01T19:55:40.769 INFO:teuthology.orchestra.run.smithi101.stdout: "duration": 3.2739999999999999e-06 2023-08-01T19:55:40.769 INFO:teuthology.orchestra.run.smithi101.stdout: }, 2023-08-01T19:55:40.769 INFO:teuthology.orchestra.run.smithi101.stdout: { 2023-08-01T19:55:40.769 INFO:teuthology.orchestra.run.smithi101.stdout: "event": "reached_pg", 2023-08-01T19:55:40.769 INFO:teuthology.orchestra.run.smithi101.stdout: "time": "2023-08-01T19:55:01.259714+0000", 2023-08-01T19:55:40.769 INFO:teuthology.orchestra.run.smithi101.stdout: "duration": 0.0026476709999999999 2023-08-01T19:55:40.769 INFO:teuthology.orchestra.run.smithi101.stdout: }, 2023-08-01T19:55:40.770 INFO:teuthology.orchestra.run.smithi101.stdout: { 2023-08-01T19:55:40.770 INFO:teuthology.orchestra.run.smithi101.stdout: "event": "started", 2023-08-01T19:55:40.770 INFO:teuthology.orchestra.run.smithi101.stdout: "time": "2023-08-01T19:55:01.259829+0000", 2023-08-01T19:55:40.770 INFO:teuthology.orchestra.run.smithi101.stdout: "duration": 0.000114471 2023-08-01T19:55:40.770 INFO:teuthology.orchestra.run.smithi101.stdout: }, 2023-08-01T19:55:40.770 INFO:teuthology.orchestra.run.smithi101.stdout: { 2023-08-01T19:55:40.770 INFO:teuthology.orchestra.run.smithi101.stdout: "event": "waiting for subops from 0", 2023-08-01T19:55:40.770 INFO:teuthology.orchestra.run.smithi101.stdout: "time": "2023-08-01T19:55:01.259965+0000", 2023-08-01T19:55:40.771 INFO:teuthology.orchestra.run.smithi101.stdout: "duration": 0.00013597300000000001 2023-08-01T19:55:40.771 INFO:teuthology.orchestra.run.smithi101.stdout: }, 2023-08-01T19:55:40.771 INFO:teuthology.orchestra.run.smithi101.stdout: { 2023-08-01T19:55:40.771 INFO:teuthology.orchestra.run.smithi101.stdout: "event": "op_commit", 2023-08-01T19:55:40.771 INFO:teuthology.orchestra.run.smithi101.stdout: "time": "2023-08-01T19:55:01.264360+0000", 2023-08-01T19:55:40.771 INFO:teuthology.orchestra.run.smithi101.stdout: "duration": 0.0043956619999999998 2023-08-01T19:55:40.771 INFO:teuthology.orchestra.run.smithi101.stdout: }, 2023-08-01T19:55:40.771 INFO:teuthology.orchestra.run.smithi101.stdout: { 2023-08-01T19:55:40.772 INFO:teuthology.orchestra.run.smithi101.stdout: "event": "sub_op_commit_rec", 2023-08-01T19:55:40.772 INFO:teuthology.orchestra.run.smithi101.stdout: "time": "2023-08-01T19:55:01.276766+0000", 2023-08-01T19:55:40.772 INFO:teuthology.orchestra.run.smithi101.stdout: "duration": 0.012405736000000001 2023-08-01T19:55:40.772 INFO:teuthology.orchestra.run.smithi101.stdout: }, 2023-08-01T19:55:40.772 INFO:teuthology.orchestra.run.smithi101.stdout: { 2023-08-01T19:55:40.772 INFO:teuthology.orchestra.run.smithi101.stdout: "event": "commit_sent", 2023-08-01T19:55:40.772 INFO:teuthology.orchestra.run.smithi101.stdout: "time": "2023-08-01T19:55:01.276804+0000", 2023-08-01T19:55:40.772 INFO:teuthology.orchestra.run.smithi101.stdout: "duration": 3.7759999999999998e-05 2023-08-01T19:55:40.773 INFO:teuthology.orchestra.run.smithi101.stdout: }, 2023-08-01T19:55:40.773 INFO:teuthology.orchestra.run.smithi101.stdout: { 2023-08-01T19:55:40.773 INFO:teuthology.orchestra.run.smithi101.stdout: "event": "done", 2023-08-01T19:55:40.773 INFO:teuthology.orchestra.run.smithi101.stdout: "time": "2023-08-01T19:55:01.276825+0000", 2023-08-01T19:55:40.773 INFO:teuthology.orchestra.run.smithi101.stdout: "duration": 2.1299000000000001e-05 2023-08-01T19:55:40.773 INFO:teuthology.orchestra.run.smithi101.stdout: } 2023-08-01T19:55:40.773 INFO:teuthology.orchestra.run.smithi101.stdout: ] 2023-08-01T19:55:40.773 INFO:teuthology.orchestra.run.smithi101.stdout: } 2023-08-01T19:55:40.774 INFO:teuthology.orchestra.run.smithi101.stdout: }, 2023-08-01T19:55:40.774 INFO:teuthology.orchestra.run.smithi101.stdout: { 2023-08-01T19:55:40.774 INFO:teuthology.orchestra.run.smithi101.stdout: "description": "osd_op(client.4668.0:100244 5.9 5:92f56a12:::benchmark_data_smithi006_114134_object100243:head [set-alloc-hint object_size 65536 write_size 65536,write 0~65536] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e37)", 2023-08-01T19:55:40.774 INFO:teuthology.orchestra.run.smithi101.stdout: "initiated_at": "2023-08-01T19:55:05.150910+0000", 2023-08-01T19:55:40.774 INFO:teuthology.orchestra.run.smithi101.stdout: "age": 35.521910235999997, 2023-08-01T19:55:40.774 INFO:teuthology.orchestra.run.smithi101.stdout: "duration": 0.072864287, 2023-08-01T19:55:40.774 INFO:teuthology.orchestra.run.smithi101.stdout: "type_data": { 2023-08-01T19:55:40.775 INFO:teuthology.orchestra.run.smithi101.stdout: "flag_point": "commit sent; apply or cleanup", 2023-08-01T19:55:40.775 INFO:teuthology.orchestra.run.smithi101.stdout: "client_info": { 2023-08-01T19:55:40.775 INFO:teuthology.orchestra.run.smithi101.stdout: "client": "client.4668", 2023-08-01T19:55:40.775 INFO:teuthology.orchestra.run.smithi101.stdout: "client_addr": "172.21.15.6:0/1709472247", 2023-08-01T19:55:40.775 INFO:teuthology.orchestra.run.smithi101.stdout: "tid": 100244 2023-08-01T19:55:40.775 INFO:teuthology.orchestra.run.smithi101.stdout: }, 2023-08-01T19:55:40.775 INFO:teuthology.orchestra.run.smithi101.stdout: "events": [ 2023-08-01T19:55:40.775 INFO:teuthology.orchestra.run.smithi101.stdout: { 2023-08-01T19:55:40.776 INFO:teuthology.orchestra.run.smithi101.stdout: "event": "initiated", 2023-08-01T19:55:40.776 INFO:teuthology.orchestra.run.smithi101.stdout: "time": "2023-08-01T19:55:05.150910+0000", 2023-08-01T19:55:40.776 INFO:teuthology.orchestra.run.smithi101.stdout: "duration": 0 2023-08-01T19:55:40.776 INFO:teuthology.orchestra.run.smithi101.stdout: }, 2023-08-01T19:55:40.776 INFO:teuthology.orchestra.run.smithi101.stdout: { 2023-08-01T19:55:40.776 INFO:teuthology.orchestra.run.smithi101.stdout: "event": "throttled", 2023-08-01T19:55:40.776 INFO:teuthology.orchestra.run.smithi101.stdout: "time": "2023-08-01T19:55:05.150910+0000", 2023-08-01T19:55:40.776 INFO:teuthology.orchestra.run.smithi101.stdout: "duration": 0 2023-08-01T19:55:40.777 INFO:teuthology.orchestra.run.smithi101.stdout: }, 2023-08-01T19:55:40.777 INFO:teuthology.orchestra.run.smithi101.stdout: { 2023-08-01T19:55:40.777 INFO:teuthology.orchestra.run.smithi101.stdout: "event": "header_read", 2023-08-01T19:55:40.777 INFO:teuthology.orchestra.run.smithi101.stdout: "time": "2023-08-01T19:55:05.150909+0000", 2023-08-01T19:55:40.777 INFO:teuthology.orchestra.run.smithi101.stdout: "duration": 4294967295.999999 2023-08-01T19:55:40.777 INFO:teuthology.orchestra.run.smithi101.stdout: }, 2023-08-01T19:55:40.777 INFO:teuthology.orchestra.run.smithi101.stdout: { 2023-08-01T19:55:40.777 INFO:teuthology.orchestra.run.smithi101.stdout: "event": "all_read", 2023-08-01T19:55:40.778 INFO:teuthology.orchestra.run.smithi101.stdout: "time": "2023-08-01T19:55:05.150973+0000", 2023-08-01T19:55:40.778 INFO:teuthology.orchestra.run.smithi101.stdout: "duration": 6.4531999999999998e-05 2023-08-01T19:55:40.778 INFO:teuthology.orchestra.run.smithi101.stdout: }, 2023-08-01T19:55:40.778 INFO:teuthology.orchestra.run.smithi101.stdout: { 2023-08-01T19:55:40.778 INFO:teuthology.orchestra.run.smithi101.stdout: "event": "dispatched", 2023-08-01T19:55:40.778 INFO:teuthology.orchestra.run.smithi101.stdout: "time": "2023-08-01T19:55:05.150984+0000", 2023-08-01T19:55:40.778 INFO:teuthology.orchestra.run.smithi101.stdout: "duration": 1.0287e-05 2023-08-01T19:55:40.778 INFO:teuthology.orchestra.run.smithi101.stdout: }, 2023-08-01T19:55:40.779 INFO:teuthology.orchestra.run.smithi101.stdout: { 2023-08-01T19:55:40.779 INFO:teuthology.orchestra.run.smithi101.stdout: "event": "queued_for_pg", 2023-08-01T19:55:40.779 INFO:teuthology.orchestra.run.smithi101.stdout: "time": "2023-08-01T19:55:05.150989+0000", 2023-08-01T19:55:40.779 INFO:teuthology.orchestra.run.smithi101.stdout: "duration": 5.3929999999999999e-06 2023-08-01T19:55:40.779 INFO:teuthology.orchestra.run.smithi101.stdout: }, 2023-08-01T19:55:40.779 INFO:teuthology.orchestra.run.smithi101.stdout: { 2023-08-01T19:55:40.779 INFO:teuthology.orchestra.run.smithi101.stdout: "event": "reached_pg", 2023-08-01T19:55:40.780 INFO:teuthology.orchestra.run.smithi101.stdout: "time": "2023-08-01T19:55:05.151034+0000", 2023-08-01T19:55:40.780 INFO:teuthology.orchestra.run.smithi101.stdout: "duration": 4.4336999999999999e-05 2023-08-01T19:55:40.780 INFO:teuthology.orchestra.run.smithi101.stdout: }, 2023-08-01T19:55:40.780 INFO:teuthology.orchestra.run.smithi101.stdout: { 2023-08-01T19:55:40.780 INFO:teuthology.orchestra.run.smithi101.stdout: "event": "started", 2023-08-01T19:55:40.780 INFO:teuthology.orchestra.run.smithi101.stdout: "time": "2023-08-01T19:55:05.151167+0000", 2023-08-01T19:55:40.780 INFO:teuthology.orchestra.run.smithi101.stdout: "duration": 0.00013368899999999999 2023-08-01T19:55:40.780 INFO:teuthology.orchestra.run.smithi101.stdout: }, 2023-08-01T19:55:40.781 INFO:teuthology.orchestra.run.smithi101.stdout: { 2023-08-01T19:55:40.781 INFO:teuthology.orchestra.run.smithi101.stdout: "event": "waiting for subops from 2", 2023-08-01T19:55:40.781 INFO:teuthology.orchestra.run.smithi101.stdout: "time": "2023-08-01T19:55:05.151328+0000", 2023-08-01T19:55:40.781 INFO:teuthology.orchestra.run.smithi101.stdout: "duration": 0.00016122700000000001 2023-08-01T19:55:40.781 INFO:teuthology.orchestra.run.smithi101.stdout: }, 2023-08-01T19:55:40.781 INFO:teuthology.orchestra.run.smithi101.stdout: { 2023-08-01T19:55:40.781 INFO:teuthology.orchestra.run.smithi101.stdout: "event": "op_commit", 2023-08-01T19:55:40.781 INFO:teuthology.orchestra.run.smithi101.stdout: "time": "2023-08-01T19:55:05.156101+0000", 2023-08-01T19:55:40.782 INFO:teuthology.orchestra.run.smithi101.stdout: "duration": 0.0047724100000000004 2023-08-01T19:55:40.782 INFO:teuthology.orchestra.run.smithi101.stdout: }, 2023-08-01T19:55:40.782 INFO:teuthology.orchestra.run.smithi101.stdout: { 2023-08-01T19:55:40.782 INFO:teuthology.orchestra.run.smithi101.stdout: "event": "sub_op_commit_rec", 2023-08-01T19:55:40.782 INFO:teuthology.orchestra.run.smithi101.stdout: "time": "2023-08-01T19:55:05.223688+0000", 2023-08-01T19:55:40.782 INFO:teuthology.orchestra.run.smithi101.stdout: "duration": 0.067586937999999999 2023-08-01T19:55:40.782 INFO:teuthology.orchestra.run.smithi101.stdout: }, 2023-08-01T19:55:40.783 INFO:teuthology.orchestra.run.smithi101.stdout: { 2023-08-01T19:55:40.783 INFO:teuthology.orchestra.run.smithi101.stdout: "event": "commit_sent", 2023-08-01T19:55:40.783 INFO:teuthology.orchestra.run.smithi101.stdout: "time": "2023-08-01T19:55:05.223737+0000", 2023-08-01T19:55:40.783 INFO:teuthology.orchestra.run.smithi101.stdout: "duration": 4.8921999999999997e-05 2023-08-01T19:55:40.783 INFO:teuthology.orchestra.run.smithi101.stdout: }, 2023-08-01T19:55:40.783 INFO:teuthology.orchestra.run.smithi101.stdout: { 2023-08-01T19:55:40.783 INFO:teuthology.orchestra.run.smithi101.stdout: "event": "done", 2023-08-01T19:55:40.783 INFO:teuthology.orchestra.run.smithi101.stdout: "time": "2023-08-01T19:55:05.223774+0000", 2023-08-01T19:55:40.784 INFO:teuthology.orchestra.run.smithi101.stdout: "duration": 3.7342999999999998e-05 2023-08-01T19:55:40.784 INFO:teuthology.orchestra.run.smithi101.stdout: } 2023-08-01T19:55:40.784 INFO:teuthology.orchestra.run.smithi101.stdout: ] 2023-08-01T19:55:40.784 INFO:teuthology.orchestra.run.smithi101.stdout: } 2023-08-01T19:55:40.784 INFO:teuthology.orchestra.run.smithi101.stdout: }, 2023-08-01T19:55:40.784 INFO:teuthology.orchestra.run.smithi101.stdout: { 2023-08-01T19:55:40.784 INFO:teuthology.orchestra.run.smithi101.stdout: "description": "osd_op(client.4668.0:100253 5.f 5:f7bbce05:::benchmark_data_smithi006_114134_object100252:head [set-alloc-hint object_size 65536 write_size 65536,write 0~65536] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e37)", 2023-08-01T19:55:40.785 INFO:teuthology.orchestra.run.smithi101.stdout: "initiated_at": "2023-08-01T19:55:05.156562+0000", 2023-08-01T19:55:40.785 INFO:teuthology.orchestra.run.smithi101.stdout: "age": 35.516258203, 2023-08-01T19:55:40.785 INFO:teuthology.orchestra.run.smithi101.stdout: "duration": 0.068677503000000001, 2023-08-01T19:55:40.785 INFO:teuthology.orchestra.run.smithi101.stdout: "type_data": { 2023-08-01T19:55:40.785 INFO:teuthology.orchestra.run.smithi101.stdout: "flag_point": "commit sent; apply or cleanup", 2023-08-01T19:55:40.785 INFO:teuthology.orchestra.run.smithi101.stdout: "client_info": { 2023-08-01T19:55:40.785 INFO:teuthology.orchestra.run.smithi101.stdout: "client": "client.4668", 2023-08-01T19:55:40.785 INFO:teuthology.orchestra.run.smithi101.stdout: "client_addr": "172.21.15.6:0/1709472247", 2023-08-01T19:55:40.786 INFO:teuthology.orchestra.run.smithi101.stdout: "tid": 100253 2023-08-01T19:55:40.786 INFO:teuthology.orchestra.run.smithi101.stdout: }, 2023-08-01T19:55:40.786 INFO:teuthology.orchestra.run.smithi101.stdout: "events": [ 2023-08-01T19:55:40.786 INFO:teuthology.orchestra.run.smithi101.stdout: { 2023-08-01T19:55:40.786 INFO:teuthology.orchestra.run.smithi101.stdout: "event": "initiated", 2023-08-01T19:55:40.786 INFO:teuthology.orchestra.run.smithi101.stdout: "time": "2023-08-01T19:55:05.156562+0000", 2023-08-01T19:55:40.786 INFO:teuthology.orchestra.run.smithi101.stdout: "duration": 0 2023-08-01T19:55:40.786 INFO:teuthology.orchestra.run.smithi101.stdout: }, 2023-08-01T19:55:40.787 INFO:teuthology.orchestra.run.smithi101.stdout: { 2023-08-01T19:55:40.787 INFO:teuthology.orchestra.run.smithi101.stdout: "event": "throttled", 2023-08-01T19:55:40.787 INFO:teuthology.orchestra.run.smithi101.stdout: "time": "2023-08-01T19:55:05.156562+0000", 2023-08-01T19:55:40.787 INFO:teuthology.orchestra.run.smithi101.stdout: "duration": 0 2023-08-01T19:55:40.787 INFO:teuthology.orchestra.run.smithi101.stdout: }, 2023-08-01T19:55:40.787 INFO:teuthology.orchestra.run.smithi101.stdout: { 2023-08-01T19:55:40.787 INFO:teuthology.orchestra.run.smithi101.stdout: "event": "header_read", 2023-08-01T19:55:40.787 INFO:teuthology.orchestra.run.smithi101.stdout: "time": "2023-08-01T19:55:05.156561+0000", 2023-08-01T19:55:40.788 INFO:teuthology.orchestra.run.smithi101.stdout: "duration": 4294967295.999999 2023-08-01T19:55:40.788 INFO:teuthology.orchestra.run.smithi101.stdout: }, 2023-08-01T19:55:40.788 INFO:teuthology.orchestra.run.smithi101.stdout: { 2023-08-01T19:55:40.788 INFO:teuthology.orchestra.run.smithi101.stdout: "event": "all_read", 2023-08-01T19:55:40.788 INFO:teuthology.orchestra.run.smithi101.stdout: "time": "2023-08-01T19:55:05.156655+0000", 2023-08-01T19:55:40.788 INFO:teuthology.orchestra.run.smithi101.stdout: "duration": 9.4018999999999995e-05 2023-08-01T19:55:40.788 INFO:teuthology.orchestra.run.smithi101.stdout: }, 2023-08-01T19:55:40.788 INFO:teuthology.orchestra.run.smithi101.stdout: { 2023-08-01T19:55:40.789 INFO:teuthology.orchestra.run.smithi101.stdout: "event": "dispatched", 2023-08-01T19:55:40.789 INFO:teuthology.orchestra.run.smithi101.stdout: "time": "2023-08-01T19:55:05.156664+0000", 2023-08-01T19:55:40.789 INFO:teuthology.orchestra.run.smithi101.stdout: "duration": 9.4970000000000007e-06 2023-08-01T19:55:40.789 INFO:teuthology.orchestra.run.smithi101.stdout: }, 2023-08-01T19:55:40.789 INFO:teuthology.orchestra.run.smithi101.stdout: { 2023-08-01T19:55:40.789 INFO:teuthology.orchestra.run.smithi101.stdout: "event": "queued_for_pg", 2023-08-01T19:55:40.789 INFO:teuthology.orchestra.run.smithi101.stdout: "time": "2023-08-01T19:55:05.156671+0000", 2023-08-01T19:55:40.790 INFO:teuthology.orchestra.run.smithi101.stdout: "duration": 6.1929999999999998e-06 2023-08-01T19:55:40.790 INFO:teuthology.orchestra.run.smithi101.stdout: }, 2023-08-01T19:55:40.790 INFO:teuthology.orchestra.run.smithi101.stdout: { 2023-08-01T19:55:40.790 INFO:teuthology.orchestra.run.smithi101.stdout: "event": "reached_pg", 2023-08-01T19:55:40.790 INFO:teuthology.orchestra.run.smithi101.stdout: "time": "2023-08-01T19:55:05.156742+0000", 2023-08-01T19:55:40.790 INFO:teuthology.orchestra.run.smithi101.stdout: "duration": 7.1181999999999997e-05 2023-08-01T19:55:40.790 INFO:teuthology.orchestra.run.smithi101.stdout: }, 2023-08-01T19:55:40.790 INFO:teuthology.orchestra.run.smithi101.stdout: { 2023-08-01T19:55:40.791 INFO:teuthology.orchestra.run.smithi101.stdout: "event": "started", 2023-08-01T19:55:40.791 INFO:teuthology.orchestra.run.smithi101.stdout: "time": "2023-08-01T19:55:05.156839+0000", 2023-08-01T19:55:40.791 INFO:teuthology.orchestra.run.smithi101.stdout: "duration": 9.7182000000000006e-05 2023-08-01T19:55:40.791 INFO:teuthology.orchestra.run.smithi101.stdout: }, 2023-08-01T19:55:40.791 INFO:teuthology.orchestra.run.smithi101.stdout: { 2023-08-01T19:55:40.791 INFO:teuthology.orchestra.run.smithi101.stdout: "event": "waiting for subops from 2", 2023-08-01T19:55:40.791 INFO:teuthology.orchestra.run.smithi101.stdout: "time": "2023-08-01T19:55:05.156925+0000", 2023-08-01T19:55:40.791 INFO:teuthology.orchestra.run.smithi101.stdout: "duration": 8.5816000000000006e-05 2023-08-01T19:55:40.792 INFO:teuthology.orchestra.run.smithi101.stdout: }, 2023-08-01T19:55:40.792 INFO:teuthology.orchestra.run.smithi101.stdout: { 2023-08-01T19:55:40.792 INFO:teuthology.orchestra.run.smithi101.stdout: "event": "op_commit", 2023-08-01T19:55:40.792 INFO:teuthology.orchestra.run.smithi101.stdout: "time": "2023-08-01T19:55:05.160082+0000", 2023-08-01T19:55:40.792 INFO:teuthology.orchestra.run.smithi101.stdout: "duration": 0.0031573959999999998 2023-08-01T19:55:40.792 INFO:teuthology.orchestra.run.smithi101.stdout: }, 2023-08-01T19:55:40.792 INFO:teuthology.orchestra.run.smithi101.stdout: { 2023-08-01T19:55:40.793 INFO:teuthology.orchestra.run.smithi101.stdout: "event": "sub_op_commit_rec", 2023-08-01T19:55:40.793 INFO:teuthology.orchestra.run.smithi101.stdout: "time": "2023-08-01T19:55:05.225162+0000", 2023-08-01T19:55:40.793 INFO:teuthology.orchestra.run.smithi101.stdout: "duration": 0.065079466000000002 2023-08-01T19:55:40.793 INFO:teuthology.orchestra.run.smithi101.stdout: }, 2023-08-01T19:55:40.793 INFO:teuthology.orchestra.run.smithi101.stdout: { 2023-08-01T19:55:40.793 INFO:teuthology.orchestra.run.smithi101.stdout: "event": "commit_sent", 2023-08-01T19:55:40.793 INFO:teuthology.orchestra.run.smithi101.stdout: "time": "2023-08-01T19:55:05.225205+0000", 2023-08-01T19:55:40.794 INFO:teuthology.orchestra.run.smithi101.stdout: "duration": 4.3446999999999999e-05 2023-08-01T19:55:40.794 INFO:teuthology.orchestra.run.smithi101.stdout: }, 2023-08-01T19:55:40.794 INFO:teuthology.orchestra.run.smithi101.stdout: { 2023-08-01T19:55:40.794 INFO:teuthology.orchestra.run.smithi101.stdout: "event": "done", 2023-08-01T19:55:40.794 INFO:teuthology.orchestra.run.smithi101.stdout: "time": "2023-08-01T19:55:05.225239+0000", 2023-08-01T19:55:40.794 INFO:teuthology.orchestra.run.smithi101.stdout: "duration": 3.4121000000000001e-05 2023-08-01T19:55:40.794 INFO:teuthology.orchestra.run.smithi101.stdout: } 2023-08-01T19:55:40.794 INFO:teuthology.orchestra.run.smithi101.stdout: ] 2023-08-01T19:55:40.795 INFO:teuthology.orchestra.run.smithi101.stdout: } 2023-08-01T19:55:40.795 INFO:teuthology.orchestra.run.smithi101.stdout: }, 2023-08-01T19:55:40.795 INFO:teuthology.orchestra.run.smithi101.stdout: { 2023-08-01T19:55:40.795 INFO:teuthology.orchestra.run.smithi101.stdout: "description": "osd_op(client.4668.0:100928 5.7 5:e61a7dfa:::benchmark_data_smithi006_114134_object100927:head [set-alloc-hint object_size 65536 write_size 65536,write 0~65536] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e37)", 2023-08-01T19:55:40.795 INFO:teuthology.orchestra.run.smithi101.stdout: "initiated_at": "2023-08-01T19:55:05.564731+0000", 2023-08-01T19:55:40.795 INFO:teuthology.orchestra.run.smithi101.stdout: "age": 35.108088711000001, 2023-08-01T19:55:40.795 INFO:teuthology.orchestra.run.smithi101.stdout: "duration": 0.064686603999999995, 2023-08-01T19:55:40.795 INFO:teuthology.orchestra.run.smithi101.stdout: "type_data": { 2023-08-01T19:55:40.796 INFO:teuthology.orchestra.run.smithi101.stdout: "flag_point": "commit sent; apply or cleanup", 2023-08-01T19:55:40.796 INFO:teuthology.orchestra.run.smithi101.stdout: "client_info": { 2023-08-01T19:55:40.796 INFO:teuthology.orchestra.run.smithi101.stdout: "client": "client.4668", 2023-08-01T19:55:40.796 INFO:teuthology.orchestra.run.smithi101.stdout: "client_addr": "172.21.15.6:0/1709472247", 2023-08-01T19:55:40.796 INFO:teuthology.orchestra.run.smithi101.stdout: "tid": 100928 2023-08-01T19:55:40.796 INFO:teuthology.orchestra.run.smithi101.stdout: }, 2023-08-01T19:55:40.796 INFO:teuthology.orchestra.run.smithi101.stdout: "events": [ 2023-08-01T19:55:40.797 INFO:teuthology.orchestra.run.smithi101.stdout: { 2023-08-01T19:55:40.797 INFO:teuthology.orchestra.run.smithi101.stdout: "event": "initiated", 2023-08-01T19:55:40.797 INFO:teuthology.orchestra.run.smithi101.stdout: "time": "2023-08-01T19:55:05.564731+0000", 2023-08-01T19:55:40.797 INFO:teuthology.orchestra.run.smithi101.stdout: "duration": 0 2023-08-01T19:55:40.797 INFO:teuthology.orchestra.run.smithi101.stdout: }, 2023-08-01T19:55:40.797 INFO:teuthology.orchestra.run.smithi101.stdout: { 2023-08-01T19:55:40.797 INFO:teuthology.orchestra.run.smithi101.stdout: "event": "throttled", 2023-08-01T19:55:40.797 INFO:teuthology.orchestra.run.smithi101.stdout: "time": "2023-08-01T19:55:05.564731+0000", 2023-08-01T19:55:40.798 INFO:teuthology.orchestra.run.smithi101.stdout: "duration": 0 2023-08-01T19:55:40.798 INFO:teuthology.orchestra.run.smithi101.stdout: }, 2023-08-01T19:55:40.798 INFO:teuthology.orchestra.run.smithi101.stdout: { 2023-08-01T19:55:40.798 INFO:teuthology.orchestra.run.smithi101.stdout: "event": "header_read", 2023-08-01T19:55:40.798 INFO:teuthology.orchestra.run.smithi101.stdout: "time": "2023-08-01T19:55:05.564731+0000", 2023-08-01T19:55:40.798 INFO:teuthology.orchestra.run.smithi101.stdout: "duration": 4294967295.999999 2023-08-01T19:55:40.798 INFO:teuthology.orchestra.run.smithi101.stdout: }, 2023-08-01T19:55:40.798 INFO:teuthology.orchestra.run.smithi101.stdout: { 2023-08-01T19:55:40.799 INFO:teuthology.orchestra.run.smithi101.stdout: "event": "all_read", 2023-08-01T19:55:40.799 INFO:teuthology.orchestra.run.smithi101.stdout: "time": "2023-08-01T19:55:05.564832+0000", 2023-08-01T19:55:40.799 INFO:teuthology.orchestra.run.smithi101.stdout: "duration": 0.000101752 2023-08-01T19:55:40.799 INFO:teuthology.orchestra.run.smithi101.stdout: }, 2023-08-01T19:55:40.799 INFO:teuthology.orchestra.run.smithi101.stdout: { 2023-08-01T19:55:40.799 INFO:teuthology.orchestra.run.smithi101.stdout: "event": "dispatched", 2023-08-01T19:55:40.799 INFO:teuthology.orchestra.run.smithi101.stdout: "time": "2023-08-01T19:55:05.564840+0000", 2023-08-01T19:55:40.799 INFO:teuthology.orchestra.run.smithi101.stdout: "duration": 7.8590000000000005e-06 2023-08-01T19:55:40.800 INFO:teuthology.orchestra.run.smithi101.stdout: }, 2023-08-01T19:55:40.800 INFO:teuthology.orchestra.run.smithi101.stdout: { 2023-08-01T19:55:40.800 INFO:teuthology.orchestra.run.smithi101.stdout: "event": "queued_for_pg", 2023-08-01T19:55:40.800 INFO:teuthology.orchestra.run.smithi101.stdout: "time": "2023-08-01T19:55:05.564845+0000", 2023-08-01T19:55:40.800 INFO:teuthology.orchestra.run.smithi101.stdout: "duration": 4.9189999999999998e-06 2023-08-01T19:55:40.800 INFO:teuthology.orchestra.run.smithi101.stdout: }, 2023-08-01T19:55:40.800 INFO:teuthology.orchestra.run.smithi101.stdout: { 2023-08-01T19:55:40.801 INFO:teuthology.orchestra.run.smithi101.stdout: "event": "reached_pg", 2023-08-01T19:55:40.801 INFO:teuthology.orchestra.run.smithi101.stdout: "time": "2023-08-01T19:55:05.564883+0000", 2023-08-01T19:55:40.801 INFO:teuthology.orchestra.run.smithi101.stdout: "duration": 3.7481999999999998e-05 2023-08-01T19:55:40.801 INFO:teuthology.orchestra.run.smithi101.stdout: }, 2023-08-01T19:55:40.801 INFO:teuthology.orchestra.run.smithi101.stdout: { 2023-08-01T19:55:40.801 INFO:teuthology.orchestra.run.smithi101.stdout: "event": "started", 2023-08-01T19:55:40.801 INFO:teuthology.orchestra.run.smithi101.stdout: "time": "2023-08-01T19:55:05.564968+0000", 2023-08-01T19:55:40.801 INFO:teuthology.orchestra.run.smithi101.stdout: "duration": 8.5494999999999994e-05 2023-08-01T19:55:40.802 INFO:teuthology.orchestra.run.smithi101.stdout: }, 2023-08-01T19:55:40.802 INFO:teuthology.orchestra.run.smithi101.stdout: { 2023-08-01T19:55:40.802 INFO:teuthology.orchestra.run.smithi101.stdout: "event": "waiting for subops from 0", 2023-08-01T19:55:40.802 INFO:teuthology.orchestra.run.smithi101.stdout: "time": "2023-08-01T19:55:05.565062+0000", 2023-08-01T19:55:40.802 INFO:teuthology.orchestra.run.smithi101.stdout: "duration": 9.3478000000000002e-05 2023-08-01T19:55:40.802 INFO:teuthology.orchestra.run.smithi101.stdout: }, 2023-08-01T19:55:40.802 INFO:teuthology.orchestra.run.smithi101.stdout: { 2023-08-01T19:55:40.802 INFO:teuthology.orchestra.run.smithi101.stdout: "event": "op_commit", 2023-08-01T19:55:40.803 INFO:teuthology.orchestra.run.smithi101.stdout: "time": "2023-08-01T19:55:05.572061+0000", 2023-08-01T19:55:40.803 INFO:teuthology.orchestra.run.smithi101.stdout: "duration": 0.0069998250000000003 2023-08-01T19:55:40.803 INFO:teuthology.orchestra.run.smithi101.stdout: }, 2023-08-01T19:55:40.803 INFO:teuthology.orchestra.run.smithi101.stdout: { 2023-08-01T19:55:40.803 INFO:teuthology.orchestra.run.smithi101.stdout: "event": "sub_op_commit_rec", 2023-08-01T19:55:40.803 INFO:teuthology.orchestra.run.smithi101.stdout: "time": "2023-08-01T19:55:05.629362+0000", 2023-08-01T19:55:40.803 INFO:teuthology.orchestra.run.smithi101.stdout: "duration": 0.057300691000000001 2023-08-01T19:55:40.803 INFO:teuthology.orchestra.run.smithi101.stdout: }, 2023-08-01T19:55:40.804 INFO:teuthology.orchestra.run.smithi101.stdout: { 2023-08-01T19:55:40.804 INFO:teuthology.orchestra.run.smithi101.stdout: "event": "commit_sent", 2023-08-01T19:55:40.804 INFO:teuthology.orchestra.run.smithi101.stdout: "time": "2023-08-01T19:55:05.629395+0000", 2023-08-01T19:55:40.804 INFO:teuthology.orchestra.run.smithi101.stdout: "duration": 3.3124000000000003e-05 2023-08-01T19:55:40.804 INFO:teuthology.orchestra.run.smithi101.stdout: }, 2023-08-01T19:55:40.804 INFO:teuthology.orchestra.run.smithi101.stdout: { 2023-08-01T19:55:40.804 INFO:teuthology.orchestra.run.smithi101.stdout: "event": "done", 2023-08-01T19:55:40.805 INFO:teuthology.orchestra.run.smithi101.stdout: "time": "2023-08-01T19:55:05.629418+0000", 2023-08-01T19:55:40.805 INFO:teuthology.orchestra.run.smithi101.stdout: "duration": 2.2697999999999999e-05 2023-08-01T19:55:40.805 INFO:teuthology.orchestra.run.smithi101.stdout: } 2023-08-01T19:55:40.805 INFO:teuthology.orchestra.run.smithi101.stdout: ] 2023-08-01T19:55:40.805 INFO:teuthology.orchestra.run.smithi101.stdout: } 2023-08-01T19:55:40.805 INFO:teuthology.orchestra.run.smithi101.stdout: }, 2023-08-01T19:55:40.805 INFO:teuthology.orchestra.run.smithi101.stdout: { 2023-08-01T19:55:40.805 INFO:teuthology.orchestra.run.smithi101.stdout: "description": "osd_op(client.4668.0:100936 5.1 5:8f4e3576:::benchmark_data_smithi006_114134_object100935:head [set-alloc-hint object_size 65536 write_size 65536,write 0~65536] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e37)", 2023-08-01T19:55:40.806 INFO:teuthology.orchestra.run.smithi101.stdout: "initiated_at": "2023-08-01T19:55:05.567147+0000", 2023-08-01T19:55:40.806 INFO:teuthology.orchestra.run.smithi101.stdout: "age": 35.105673185000001, 2023-08-01T19:55:40.806 INFO:teuthology.orchestra.run.smithi101.stdout: "duration": 0.063466380000000003, 2023-08-01T19:55:40.806 INFO:teuthology.orchestra.run.smithi101.stdout: "type_data": { 2023-08-01T19:55:40.806 INFO:teuthology.orchestra.run.smithi101.stdout: "flag_point": "commit sent; apply or cleanup", 2023-08-01T19:55:40.806 INFO:teuthology.orchestra.run.smithi101.stdout: "client_info": { 2023-08-01T19:55:40.806 INFO:teuthology.orchestra.run.smithi101.stdout: "client": "client.4668", 2023-08-01T19:55:40.806 INFO:teuthology.orchestra.run.smithi101.stdout: "client_addr": "172.21.15.6:0/1709472247", 2023-08-01T19:55:40.807 INFO:teuthology.orchestra.run.smithi101.stdout: "tid": 100936 2023-08-01T19:55:40.807 INFO:teuthology.orchestra.run.smithi101.stdout: }, 2023-08-01T19:55:40.807 INFO:teuthology.orchestra.run.smithi101.stdout: "events": [ 2023-08-01T19:55:40.807 INFO:teuthology.orchestra.run.smithi101.stdout: { 2023-08-01T19:55:40.807 INFO:teuthology.orchestra.run.smithi101.stdout: "event": "initiated", 2023-08-01T19:55:40.807 INFO:teuthology.orchestra.run.smithi101.stdout: "time": "2023-08-01T19:55:05.567147+0000", 2023-08-01T19:55:40.807 INFO:teuthology.orchestra.run.smithi101.stdout: "duration": 0 2023-08-01T19:55:40.807 INFO:teuthology.orchestra.run.smithi101.stdout: }, 2023-08-01T19:55:40.808 INFO:teuthology.orchestra.run.smithi101.stdout: { 2023-08-01T19:55:40.808 INFO:teuthology.orchestra.run.smithi101.stdout: "event": "throttled", 2023-08-01T19:55:40.808 INFO:teuthology.orchestra.run.smithi101.stdout: "time": "2023-08-01T19:55:05.567147+0000", 2023-08-01T19:55:40.808 INFO:teuthology.orchestra.run.smithi101.stdout: "duration": 0 2023-08-01T19:55:40.808 INFO:teuthology.orchestra.run.smithi101.stdout: }, 2023-08-01T19:55:40.808 INFO:teuthology.orchestra.run.smithi101.stdout: { 2023-08-01T19:55:40.808 INFO:teuthology.orchestra.run.smithi101.stdout: "event": "header_read", 2023-08-01T19:55:40.808 INFO:teuthology.orchestra.run.smithi101.stdout: "time": "2023-08-01T19:55:05.567146+0000", 2023-08-01T19:55:40.809 INFO:teuthology.orchestra.run.smithi101.stdout: "duration": 4294967295.999999 2023-08-01T19:55:40.809 INFO:teuthology.orchestra.run.smithi101.stdout: }, 2023-08-01T19:55:40.809 INFO:teuthology.orchestra.run.smithi101.stdout: { 2023-08-01T19:55:40.809 INFO:teuthology.orchestra.run.smithi101.stdout: "event": "all_read", 2023-08-01T19:55:40.809 INFO:teuthology.orchestra.run.smithi101.stdout: "time": "2023-08-01T19:55:05.567224+0000", 2023-08-01T19:55:40.809 INFO:teuthology.orchestra.run.smithi101.stdout: "duration": 7.8460000000000004e-05 2023-08-01T19:55:40.809 INFO:teuthology.orchestra.run.smithi101.stdout: }, 2023-08-01T19:55:40.809 INFO:teuthology.orchestra.run.smithi101.stdout: { 2023-08-01T19:55:40.810 INFO:teuthology.orchestra.run.smithi101.stdout: "event": "dispatched", 2023-08-01T19:55:40.810 INFO:teuthology.orchestra.run.smithi101.stdout: "time": "2023-08-01T19:55:05.567234+0000", 2023-08-01T19:55:40.810 INFO:teuthology.orchestra.run.smithi101.stdout: "duration": 9.7110000000000007e-06 2023-08-01T19:55:40.810 INFO:teuthology.orchestra.run.smithi101.stdout: }, 2023-08-01T19:55:40.810 INFO:teuthology.orchestra.run.smithi101.stdout: { 2023-08-01T19:55:40.810 INFO:teuthology.orchestra.run.smithi101.stdout: "event": "queued_for_pg", 2023-08-01T19:55:40.810 INFO:teuthology.orchestra.run.smithi101.stdout: "time": "2023-08-01T19:55:05.567239+0000", 2023-08-01T19:55:40.811 INFO:teuthology.orchestra.run.smithi101.stdout: "duration": 5.237e-06 2023-08-01T19:55:40.811 INFO:teuthology.orchestra.run.smithi101.stdout: }, 2023-08-01T19:55:40.811 INFO:teuthology.orchestra.run.smithi101.stdout: { 2023-08-01T19:55:40.811 INFO:teuthology.orchestra.run.smithi101.stdout: "event": "reached_pg", 2023-08-01T19:55:40.811 INFO:teuthology.orchestra.run.smithi101.stdout: "time": "2023-08-01T19:55:05.567278+0000", 2023-08-01T19:55:40.811 INFO:teuthology.orchestra.run.smithi101.stdout: "duration": 3.9069999999999997e-05 2023-08-01T19:55:40.811 INFO:teuthology.orchestra.run.smithi101.stdout: }, 2023-08-01T19:55:40.811 INFO:teuthology.orchestra.run.smithi101.stdout: { 2023-08-01T19:55:40.812 INFO:teuthology.orchestra.run.smithi101.stdout: "event": "started", 2023-08-01T19:55:40.812 INFO:teuthology.orchestra.run.smithi101.stdout: "time": "2023-08-01T19:55:05.567402+0000", 2023-08-01T19:55:40.812 INFO:teuthology.orchestra.run.smithi101.stdout: "duration": 0.00012348700000000001 2023-08-01T19:55:40.812 INFO:teuthology.orchestra.run.smithi101.stdout: }, 2023-08-01T19:55:40.812 INFO:teuthology.orchestra.run.smithi101.stdout: { 2023-08-01T19:55:40.812 INFO:teuthology.orchestra.run.smithi101.stdout: "event": "waiting for subops from 0", 2023-08-01T19:55:40.812 INFO:teuthology.orchestra.run.smithi101.stdout: "time": "2023-08-01T19:55:05.567558+0000", 2023-08-01T19:55:40.812 INFO:teuthology.orchestra.run.smithi101.stdout: "duration": 0.000156179 2023-08-01T19:55:40.813 INFO:teuthology.orchestra.run.smithi101.stdout: }, 2023-08-01T19:55:40.813 INFO:teuthology.orchestra.run.smithi101.stdout: { 2023-08-01T19:55:40.813 INFO:teuthology.orchestra.run.smithi101.stdout: "event": "op_commit", 2023-08-01T19:55:40.813 INFO:teuthology.orchestra.run.smithi101.stdout: "time": "2023-08-01T19:55:05.573767+0000", 2023-08-01T19:55:40.813 INFO:teuthology.orchestra.run.smithi101.stdout: "duration": 0.0062092409999999999 2023-08-01T19:55:40.813 INFO:teuthology.orchestra.run.smithi101.stdout: }, 2023-08-01T19:55:40.813 INFO:teuthology.orchestra.run.smithi101.stdout: { 2023-08-01T19:55:40.813 INFO:teuthology.orchestra.run.smithi101.stdout: "event": "sub_op_commit_rec", 2023-08-01T19:55:40.814 INFO:teuthology.orchestra.run.smithi101.stdout: "time": "2023-08-01T19:55:05.630531+0000", 2023-08-01T19:55:40.814 INFO:teuthology.orchestra.run.smithi101.stdout: "duration": 0.056763409000000001 2023-08-01T19:55:40.814 INFO:teuthology.orchestra.run.smithi101.stdout: }, 2023-08-01T19:55:40.814 INFO:teuthology.orchestra.run.smithi101.stdout: { 2023-08-01T19:55:40.814 INFO:teuthology.orchestra.run.smithi101.stdout: "event": "commit_sent", 2023-08-01T19:55:40.814 INFO:teuthology.orchestra.run.smithi101.stdout: "time": "2023-08-01T19:55:05.630577+0000", 2023-08-01T19:55:40.814 INFO:teuthology.orchestra.run.smithi101.stdout: "duration": 4.6588000000000002e-05 2023-08-01T19:55:40.815 INFO:teuthology.orchestra.run.smithi101.stdout: }, 2023-08-01T19:55:40.815 INFO:teuthology.orchestra.run.smithi101.stdout: { 2023-08-01T19:55:40.815 INFO:teuthology.orchestra.run.smithi101.stdout: "event": "done", 2023-08-01T19:55:40.815 INFO:teuthology.orchestra.run.smithi101.stdout: "time": "2023-08-01T19:55:05.630613+0000", 2023-08-01T19:55:40.815 INFO:teuthology.orchestra.run.smithi101.stdout: "duration": 3.5802e-05 2023-08-01T19:55:40.815 INFO:teuthology.orchestra.run.smithi101.stdout: } 2023-08-01T19:55:40.815 INFO:teuthology.orchestra.run.smithi101.stdout: ] 2023-08-01T19:55:40.815 INFO:teuthology.orchestra.run.smithi101.stdout: } 2023-08-01T19:55:40.816 INFO:teuthology.orchestra.run.smithi101.stdout: }, 2023-08-01T19:55:40.816 INFO:teuthology.orchestra.run.smithi101.stdout: { 2023-08-01T19:55:40.816 INFO:teuthology.orchestra.run.smithi101.stdout: "description": "osd_op(client.4668.0:100943 5.7 5:e01743fe:::benchmark_data_smithi006_114134_object100942:head [set-alloc-hint object_size 65536 write_size 65536,write 0~65536] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e37)", 2023-08-01T19:55:40.816 INFO:teuthology.orchestra.run.smithi101.stdout: "initiated_at": "2023-08-01T19:55:05.574724+0000", 2023-08-01T19:55:40.816 INFO:teuthology.orchestra.run.smithi101.stdout: "age": 35.098096091999999, 2023-08-01T19:55:40.816 INFO:teuthology.orchestra.run.smithi101.stdout: "duration": 0.058761188999999998, 2023-08-01T19:55:40.816 INFO:teuthology.orchestra.run.smithi101.stdout: "type_data": { 2023-08-01T19:55:40.816 INFO:teuthology.orchestra.run.smithi101.stdout: "flag_point": "commit sent; apply or cleanup", 2023-08-01T19:55:40.817 INFO:teuthology.orchestra.run.smithi101.stdout: "client_info": { 2023-08-01T19:55:40.817 INFO:teuthology.orchestra.run.smithi101.stdout: "client": "client.4668", 2023-08-01T19:55:40.817 INFO:teuthology.orchestra.run.smithi101.stdout: "client_addr": "172.21.15.6:0/1709472247", 2023-08-01T19:55:40.817 INFO:teuthology.orchestra.run.smithi101.stdout: "tid": 100943 2023-08-01T19:55:40.817 INFO:teuthology.orchestra.run.smithi101.stdout: }, 2023-08-01T19:55:40.817 INFO:teuthology.orchestra.run.smithi101.stdout: "events": [ 2023-08-01T19:55:40.817 INFO:teuthology.orchestra.run.smithi101.stdout: { 2023-08-01T19:55:40.818 INFO:teuthology.orchestra.run.smithi101.stdout: "event": "initiated", 2023-08-01T19:55:40.818 INFO:teuthology.orchestra.run.smithi101.stdout: "time": "2023-08-01T19:55:05.574724+0000", 2023-08-01T19:55:40.818 INFO:teuthology.orchestra.run.smithi101.stdout: "duration": 0 2023-08-01T19:55:40.818 INFO:teuthology.orchestra.run.smithi101.stdout: }, 2023-08-01T19:55:40.818 INFO:teuthology.orchestra.run.smithi101.stdout: { 2023-08-01T19:55:40.818 INFO:teuthology.orchestra.run.smithi101.stdout: "event": "throttled", 2023-08-01T19:55:40.818 INFO:teuthology.orchestra.run.smithi101.stdout: "time": "2023-08-01T19:55:05.574724+0000", 2023-08-01T19:55:40.818 INFO:teuthology.orchestra.run.smithi101.stdout: "duration": 0 2023-08-01T19:55:40.819 INFO:teuthology.orchestra.run.smithi101.stdout: }, 2023-08-01T19:55:40.819 INFO:teuthology.orchestra.run.smithi101.stdout: { 2023-08-01T19:55:40.819 INFO:teuthology.orchestra.run.smithi101.stdout: "event": "header_read", 2023-08-01T19:55:40.819 INFO:teuthology.orchestra.run.smithi101.stdout: "time": "2023-08-01T19:55:05.574723+0000", 2023-08-01T19:55:40.819 INFO:teuthology.orchestra.run.smithi101.stdout: "duration": 4294967295.999999 2023-08-01T19:55:40.819 INFO:teuthology.orchestra.run.smithi101.stdout: }, 2023-08-01T19:55:40.819 INFO:teuthology.orchestra.run.smithi101.stdout: { 2023-08-01T19:55:40.819 INFO:teuthology.orchestra.run.smithi101.stdout: "event": "all_read", 2023-08-01T19:55:40.820 INFO:teuthology.orchestra.run.smithi101.stdout: "time": "2023-08-01T19:55:05.574773+0000", 2023-08-01T19:55:40.820 INFO:teuthology.orchestra.run.smithi101.stdout: "duration": 4.9469999999999999e-05 2023-08-01T19:55:40.820 INFO:teuthology.orchestra.run.smithi101.stdout: }, 2023-08-01T19:55:40.820 INFO:teuthology.orchestra.run.smithi101.stdout: { 2023-08-01T19:55:40.820 INFO:teuthology.orchestra.run.smithi101.stdout: "event": "dispatched", 2023-08-01T19:55:40.820 INFO:teuthology.orchestra.run.smithi101.stdout: "time": "2023-08-01T19:55:05.574780+0000", 2023-08-01T19:55:40.820 INFO:teuthology.orchestra.run.smithi101.stdout: "duration": 7.5059999999999998e-06 2023-08-01T19:55:40.820 INFO:teuthology.orchestra.run.smithi101.stdout: }, 2023-08-01T19:55:40.821 INFO:teuthology.orchestra.run.smithi101.stdout: { 2023-08-01T19:55:40.821 INFO:teuthology.orchestra.run.smithi101.stdout: "event": "queued_for_pg", 2023-08-01T19:55:40.821 INFO:teuthology.orchestra.run.smithi101.stdout: "time": "2023-08-01T19:55:05.574784+0000", 2023-08-01T19:55:40.821 INFO:teuthology.orchestra.run.smithi101.stdout: "duration": 3.5540000000000002e-06 2023-08-01T19:55:40.821 INFO:teuthology.orchestra.run.smithi101.stdout: }, 2023-08-01T19:55:40.821 INFO:teuthology.orchestra.run.smithi101.stdout: { 2023-08-01T19:55:40.821 INFO:teuthology.orchestra.run.smithi101.stdout: "event": "reached_pg", 2023-08-01T19:55:40.821 INFO:teuthology.orchestra.run.smithi101.stdout: "time": "2023-08-01T19:55:05.574805+0000", 2023-08-01T19:55:40.822 INFO:teuthology.orchestra.run.smithi101.stdout: "duration": 2.1257999999999999e-05 2023-08-01T19:55:40.822 INFO:teuthology.orchestra.run.smithi101.stdout: }, 2023-08-01T19:55:40.822 INFO:teuthology.orchestra.run.smithi101.stdout: { 2023-08-01T19:55:40.822 INFO:teuthology.orchestra.run.smithi101.stdout: "event": "started", 2023-08-01T19:55:40.822 INFO:teuthology.orchestra.run.smithi101.stdout: "time": "2023-08-01T19:55:05.574886+0000", 2023-08-01T19:55:40.822 INFO:teuthology.orchestra.run.smithi101.stdout: "duration": 8.1545999999999995e-05 2023-08-01T19:55:40.822 INFO:teuthology.orchestra.run.smithi101.stdout: }, 2023-08-01T19:55:40.822 INFO:teuthology.orchestra.run.smithi101.stdout: { 2023-08-01T19:55:40.823 INFO:teuthology.orchestra.run.smithi101.stdout: "event": "waiting for subops from 0", 2023-08-01T19:55:40.823 INFO:teuthology.orchestra.run.smithi101.stdout: "time": "2023-08-01T19:55:05.574973+0000", 2023-08-01T19:55:40.823 INFO:teuthology.orchestra.run.smithi101.stdout: "duration": 8.6998999999999998e-05 2023-08-01T19:55:40.823 INFO:teuthology.orchestra.run.smithi101.stdout: }, 2023-08-01T19:55:40.823 INFO:teuthology.orchestra.run.smithi101.stdout: { 2023-08-01T19:55:40.823 INFO:teuthology.orchestra.run.smithi101.stdout: "event": "op_commit", 2023-08-01T19:55:40.823 INFO:teuthology.orchestra.run.smithi101.stdout: "time": "2023-08-01T19:55:05.581580+0000", 2023-08-01T19:55:40.823 INFO:teuthology.orchestra.run.smithi101.stdout: "duration": 0.0066068790000000004 2023-08-01T19:55:40.824 INFO:teuthology.orchestra.run.smithi101.stdout: }, 2023-08-01T19:55:40.824 INFO:teuthology.orchestra.run.smithi101.stdout: { 2023-08-01T19:55:40.824 INFO:teuthology.orchestra.run.smithi101.stdout: "event": "sub_op_commit_rec", 2023-08-01T19:55:40.824 INFO:teuthology.orchestra.run.smithi101.stdout: "time": "2023-08-01T19:55:05.633422+0000", 2023-08-01T19:55:40.824 INFO:teuthology.orchestra.run.smithi101.stdout: "duration": 0.051841992000000003 2023-08-01T19:55:40.824 INFO:teuthology.orchestra.run.smithi101.stdout: }, 2023-08-01T19:55:40.824 INFO:teuthology.orchestra.run.smithi101.stdout: { 2023-08-01T19:55:40.825 INFO:teuthology.orchestra.run.smithi101.stdout: "event": "commit_sent", 2023-08-01T19:55:40.825 INFO:teuthology.orchestra.run.smithi101.stdout: "time": "2023-08-01T19:55:05.633461+0000", 2023-08-01T19:55:40.825 INFO:teuthology.orchestra.run.smithi101.stdout: "duration": 3.8330000000000001e-05 2023-08-01T19:55:40.825 INFO:teuthology.orchestra.run.smithi101.stdout: }, 2023-08-01T19:55:40.825 INFO:teuthology.orchestra.run.smithi101.stdout: { 2023-08-01T19:55:40.825 INFO:teuthology.orchestra.run.smithi101.stdout: "event": "done", 2023-08-01T19:55:40.825 INFO:teuthology.orchestra.run.smithi101.stdout: "time": "2023-08-01T19:55:05.633485+0000", 2023-08-01T19:55:40.825 INFO:teuthology.orchestra.run.smithi101.stdout: "duration": 2.4451e-05 2023-08-01T19:55:40.826 INFO:teuthology.orchestra.run.smithi101.stdout: } 2023-08-01T19:55:40.826 INFO:teuthology.orchestra.run.smithi101.stdout: ] 2023-08-01T19:55:40.826 INFO:teuthology.orchestra.run.smithi101.stdout: } 2023-08-01T19:55:40.826 INFO:teuthology.orchestra.run.smithi101.stdout: }, 2023-08-01T19:55:40.826 INFO:teuthology.orchestra.run.smithi101.stdout: { 2023-08-01T19:55:40.826 INFO:teuthology.orchestra.run.smithi101.stdout: "description": "osd_op(client.4668.0:107866 5.f 5:ffcbf9c4:::benchmark_data_smithi006_114134_object107865:head [set-alloc-hint object_size 65536 write_size 65536,write 0~65536] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e38)", 2023-08-01T19:55:40.826 INFO:teuthology.orchestra.run.smithi101.stdout: "initiated_at": "2023-08-01T19:55:09.280625+0000", 2023-08-01T19:55:40.826 INFO:teuthology.orchestra.run.smithi101.stdout: "age": 31.392194753999998, 2023-08-01T19:55:40.827 INFO:teuthology.orchestra.run.smithi101.stdout: "duration": 0.069869799999999996, 2023-08-01T19:55:40.827 INFO:teuthology.orchestra.run.smithi101.stdout: "type_data": { 2023-08-01T19:55:40.827 INFO:teuthology.orchestra.run.smithi101.stdout: "flag_point": "commit sent; apply or cleanup", 2023-08-01T19:55:40.827 INFO:teuthology.orchestra.run.smithi101.stdout: "client_info": { 2023-08-01T19:55:40.827 INFO:teuthology.orchestra.run.smithi101.stdout: "client": "client.4668", 2023-08-01T19:55:40.827 INFO:teuthology.orchestra.run.smithi101.stdout: "client_addr": "172.21.15.6:0/1709472247", 2023-08-01T19:55:40.827 INFO:teuthology.orchestra.run.smithi101.stdout: "tid": 107866 2023-08-01T19:55:40.827 INFO:teuthology.orchestra.run.smithi101.stdout: }, 2023-08-01T19:55:40.828 INFO:teuthology.orchestra.run.smithi101.stdout: "events": [ 2023-08-01T19:55:40.828 INFO:teuthology.orchestra.run.smithi101.stdout: { 2023-08-01T19:55:40.828 INFO:teuthology.orchestra.run.smithi101.stdout: "event": "initiated", 2023-08-01T19:55:40.828 INFO:teuthology.orchestra.run.smithi101.stdout: "time": "2023-08-01T19:55:09.280625+0000", 2023-08-01T19:55:40.828 INFO:teuthology.orchestra.run.smithi101.stdout: "duration": 0 2023-08-01T19:55:40.828 INFO:teuthology.orchestra.run.smithi101.stdout: }, 2023-08-01T19:55:40.828 INFO:teuthology.orchestra.run.smithi101.stdout: { 2023-08-01T19:55:40.829 INFO:teuthology.orchestra.run.smithi101.stdout: "event": "throttled", 2023-08-01T19:55:40.829 INFO:teuthology.orchestra.run.smithi101.stdout: "time": "2023-08-01T19:55:09.280625+0000", 2023-08-01T19:55:40.829 INFO:teuthology.orchestra.run.smithi101.stdout: "duration": 0 2023-08-01T19:55:40.829 INFO:teuthology.orchestra.run.smithi101.stdout: }, 2023-08-01T19:55:40.829 INFO:teuthology.orchestra.run.smithi101.stdout: { 2023-08-01T19:55:40.829 INFO:teuthology.orchestra.run.smithi101.stdout: "event": "header_read", 2023-08-01T19:55:40.829 INFO:teuthology.orchestra.run.smithi101.stdout: "time": "2023-08-01T19:55:09.280624+0000", 2023-08-01T19:55:40.829 INFO:teuthology.orchestra.run.smithi101.stdout: "duration": 4294967295.999999 2023-08-01T19:55:40.830 INFO:teuthology.orchestra.run.smithi101.stdout: }, 2023-08-01T19:55:40.830 INFO:teuthology.orchestra.run.smithi101.stdout: { 2023-08-01T19:55:40.830 INFO:teuthology.orchestra.run.smithi101.stdout: "event": "all_read", 2023-08-01T19:55:40.830 INFO:teuthology.orchestra.run.smithi101.stdout: "time": "2023-08-01T19:55:09.280648+0000", 2023-08-01T19:55:40.830 INFO:teuthology.orchestra.run.smithi101.stdout: "duration": 2.3521999999999999e-05 2023-08-01T19:55:40.830 INFO:teuthology.orchestra.run.smithi101.stdout: }, 2023-08-01T19:55:40.830 INFO:teuthology.orchestra.run.smithi101.stdout: { 2023-08-01T19:55:40.830 INFO:teuthology.orchestra.run.smithi101.stdout: "event": "dispatched", 2023-08-01T19:55:40.831 INFO:teuthology.orchestra.run.smithi101.stdout: "time": "2023-08-01T19:55:09.280658+0000", 2023-08-01T19:55:40.831 INFO:teuthology.orchestra.run.smithi101.stdout: "duration": 9.8660000000000001e-06 2023-08-01T19:55:40.831 INFO:teuthology.orchestra.run.smithi101.stdout: }, 2023-08-01T19:55:40.831 INFO:teuthology.orchestra.run.smithi101.stdout: { 2023-08-01T19:55:40.831 INFO:teuthology.orchestra.run.smithi101.stdout: "event": "queued_for_pg", 2023-08-01T19:55:40.831 INFO:teuthology.orchestra.run.smithi101.stdout: "time": "2023-08-01T19:55:09.280663+0000", 2023-08-01T19:55:40.831 INFO:teuthology.orchestra.run.smithi101.stdout: "duration": 4.8369999999999996e-06 2023-08-01T19:55:40.832 INFO:teuthology.orchestra.run.smithi101.stdout: }, 2023-08-01T19:55:40.832 INFO:teuthology.orchestra.run.smithi101.stdout: { 2023-08-01T19:55:40.832 INFO:teuthology.orchestra.run.smithi101.stdout: "event": "reached_pg", 2023-08-01T19:55:40.832 INFO:teuthology.orchestra.run.smithi101.stdout: "time": "2023-08-01T19:55:09.280690+0000", 2023-08-01T19:55:40.832 INFO:teuthology.orchestra.run.smithi101.stdout: "duration": 2.7534000000000001e-05 2023-08-01T19:55:40.832 INFO:teuthology.orchestra.run.smithi101.stdout: }, 2023-08-01T19:55:40.832 INFO:teuthology.orchestra.run.smithi101.stdout: { 2023-08-01T19:55:40.832 INFO:teuthology.orchestra.run.smithi101.stdout: "event": "started", 2023-08-01T19:55:40.833 INFO:teuthology.orchestra.run.smithi101.stdout: "time": "2023-08-01T19:55:09.280825+0000", 2023-08-01T19:55:40.833 INFO:teuthology.orchestra.run.smithi101.stdout: "duration": 0.000135399 2023-08-01T19:55:40.833 INFO:teuthology.orchestra.run.smithi101.stdout: }, 2023-08-01T19:55:40.833 INFO:teuthology.orchestra.run.smithi101.stdout: { 2023-08-01T19:55:40.833 INFO:teuthology.orchestra.run.smithi101.stdout: "event": "waiting for subops from 2", 2023-08-01T19:55:40.833 INFO:teuthology.orchestra.run.smithi101.stdout: "time": "2023-08-01T19:55:09.280929+0000", 2023-08-01T19:55:40.833 INFO:teuthology.orchestra.run.smithi101.stdout: "duration": 0.000103328 2023-08-01T19:55:40.833 INFO:teuthology.orchestra.run.smithi101.stdout: }, 2023-08-01T19:55:40.834 INFO:teuthology.orchestra.run.smithi101.stdout: { 2023-08-01T19:55:40.834 INFO:teuthology.orchestra.run.smithi101.stdout: "event": "sub_op_commit_rec", 2023-08-01T19:55:40.834 INFO:teuthology.orchestra.run.smithi101.stdout: "time": "2023-08-01T19:55:09.348321+0000", 2023-08-01T19:55:40.834 INFO:teuthology.orchestra.run.smithi101.stdout: "duration": 0.067392176999999998 2023-08-01T19:55:40.834 INFO:teuthology.orchestra.run.smithi101.stdout: }, 2023-08-01T19:55:40.834 INFO:teuthology.orchestra.run.smithi101.stdout: { 2023-08-01T19:55:40.834 INFO:teuthology.orchestra.run.smithi101.stdout: "event": "op_commit", 2023-08-01T19:55:40.834 INFO:teuthology.orchestra.run.smithi101.stdout: "time": "2023-08-01T19:55:09.350431+0000", 2023-08-01T19:55:40.835 INFO:teuthology.orchestra.run.smithi101.stdout: "duration": 0.0021096980000000001 2023-08-01T19:55:40.835 INFO:teuthology.orchestra.run.smithi101.stdout: }, 2023-08-01T19:55:40.835 INFO:teuthology.orchestra.run.smithi101.stdout: { 2023-08-01T19:55:40.835 INFO:teuthology.orchestra.run.smithi101.stdout: "event": "commit_sent", 2023-08-01T19:55:40.835 INFO:teuthology.orchestra.run.smithi101.stdout: "time": "2023-08-01T19:55:09.350469+0000", 2023-08-01T19:55:40.835 INFO:teuthology.orchestra.run.smithi101.stdout: "duration": 3.8625999999999999e-05 2023-08-01T19:55:40.835 INFO:teuthology.orchestra.run.smithi101.stdout: }, 2023-08-01T19:55:40.836 INFO:teuthology.orchestra.run.smithi101.stdout: { 2023-08-01T19:55:40.836 INFO:teuthology.orchestra.run.smithi101.stdout: "event": "done", 2023-08-01T19:55:40.836 INFO:teuthology.orchestra.run.smithi101.stdout: "time": "2023-08-01T19:55:09.350495+0000", 2023-08-01T19:55:40.836 INFO:teuthology.orchestra.run.smithi101.stdout: "duration": 2.5698999999999999e-05 2023-08-01T19:55:40.836 INFO:teuthology.orchestra.run.smithi101.stdout: } 2023-08-01T19:55:40.836 INFO:teuthology.orchestra.run.smithi101.stdout: ] 2023-08-01T19:55:40.836 INFO:teuthology.orchestra.run.smithi101.stdout: } 2023-08-01T19:55:40.836 INFO:teuthology.orchestra.run.smithi101.stdout: }, 2023-08-01T19:55:40.837 INFO:teuthology.orchestra.run.smithi101.stdout: { 2023-08-01T19:55:40.837 INFO:teuthology.orchestra.run.smithi101.stdout: "description": "osd_op(client.4668.0:107867 5.f 5:ff29bbf7:::benchmark_data_smithi006_114134_object107866:head [set-alloc-hint object_size 65536 write_size 65536,write 0~65536] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e38)", 2023-08-01T19:55:40.837 INFO:teuthology.orchestra.run.smithi101.stdout: "initiated_at": "2023-08-01T19:55:09.280670+0000", 2023-08-01T19:55:40.837 INFO:teuthology.orchestra.run.smithi101.stdout: "age": 31.39214982, 2023-08-01T19:55:40.837 INFO:teuthology.orchestra.run.smithi101.stdout: "duration": 0.069898092999999994, 2023-08-01T19:55:40.837 INFO:teuthology.orchestra.run.smithi101.stdout: "type_data": { 2023-08-01T19:55:40.837 INFO:teuthology.orchestra.run.smithi101.stdout: "flag_point": "commit sent; apply or cleanup", 2023-08-01T19:55:40.838 INFO:teuthology.orchestra.run.smithi101.stdout: "client_info": { 2023-08-01T19:55:40.838 INFO:teuthology.orchestra.run.smithi101.stdout: "client": "client.4668", 2023-08-01T19:55:40.838 INFO:teuthology.orchestra.run.smithi101.stdout: "client_addr": "172.21.15.6:0/1709472247", 2023-08-01T19:55:40.838 INFO:teuthology.orchestra.run.smithi101.stdout: "tid": 107867 2023-08-01T19:55:40.838 INFO:teuthology.orchestra.run.smithi101.stdout: }, 2023-08-01T19:55:40.838 INFO:teuthology.orchestra.run.smithi101.stdout: "events": [ 2023-08-01T19:55:40.838 INFO:teuthology.orchestra.run.smithi101.stdout: { 2023-08-01T19:55:40.839 INFO:teuthology.orchestra.run.smithi101.stdout: "event": "initiated", 2023-08-01T19:55:40.839 INFO:teuthology.orchestra.run.smithi101.stdout: "time": "2023-08-01T19:55:09.280670+0000", 2023-08-01T19:55:40.839 INFO:teuthology.orchestra.run.smithi101.stdout: "duration": 0 2023-08-01T19:55:40.839 INFO:teuthology.orchestra.run.smithi101.stdout: }, 2023-08-01T19:55:40.839 INFO:teuthology.orchestra.run.smithi101.stdout: { 2023-08-01T19:55:40.839 INFO:teuthology.orchestra.run.smithi101.stdout: "event": "throttled", 2023-08-01T19:55:40.839 INFO:teuthology.orchestra.run.smithi101.stdout: "time": "2023-08-01T19:55:09.280670+0000", 2023-08-01T19:55:40.839 INFO:teuthology.orchestra.run.smithi101.stdout: "duration": 0 2023-08-01T19:55:40.840 INFO:teuthology.orchestra.run.smithi101.stdout: }, 2023-08-01T19:55:40.840 INFO:teuthology.orchestra.run.smithi101.stdout: { 2023-08-01T19:55:40.840 INFO:teuthology.orchestra.run.smithi101.stdout: "event": "header_read", 2023-08-01T19:55:40.840 INFO:teuthology.orchestra.run.smithi101.stdout: "time": "2023-08-01T19:55:09.280670+0000", 2023-08-01T19:55:40.840 INFO:teuthology.orchestra.run.smithi101.stdout: "duration": 4294967295.9999995 2023-08-01T19:55:40.840 INFO:teuthology.orchestra.run.smithi101.stdout: }, 2023-08-01T19:55:40.840 INFO:teuthology.orchestra.run.smithi101.stdout: { 2023-08-01T19:55:40.840 INFO:teuthology.orchestra.run.smithi101.stdout: "event": "all_read", 2023-08-01T19:55:40.841 INFO:teuthology.orchestra.run.smithi101.stdout: "time": "2023-08-01T19:55:09.280690+0000", 2023-08-01T19:55:40.841 INFO:teuthology.orchestra.run.smithi101.stdout: "duration": 2.0526e-05 2023-08-01T19:55:40.841 INFO:teuthology.orchestra.run.smithi101.stdout: }, 2023-08-01T19:55:40.841 INFO:teuthology.orchestra.run.smithi101.stdout: { 2023-08-01T19:55:40.841 INFO:teuthology.orchestra.run.smithi101.stdout: "event": "dispatched", 2023-08-01T19:55:40.841 INFO:teuthology.orchestra.run.smithi101.stdout: "time": "2023-08-01T19:55:09.280695+0000", 2023-08-01T19:55:40.841 INFO:teuthology.orchestra.run.smithi101.stdout: "duration": 4.5140000000000003e-06 2023-08-01T19:55:40.841 INFO:teuthology.orchestra.run.smithi101.stdout: }, 2023-08-01T19:55:40.842 INFO:teuthology.orchestra.run.smithi101.stdout: { 2023-08-01T19:55:40.842 INFO:teuthology.orchestra.run.smithi101.stdout: "event": "queued_for_pg", 2023-08-01T19:55:40.842 INFO:teuthology.orchestra.run.smithi101.stdout: "time": "2023-08-01T19:55:09.280697+0000", 2023-08-01T19:55:40.842 INFO:teuthology.orchestra.run.smithi101.stdout: "duration": 2.6290000000000002e-06 2023-08-01T19:55:40.842 INFO:teuthology.orchestra.run.smithi101.stdout: }, 2023-08-01T19:55:40.842 INFO:teuthology.orchestra.run.smithi101.stdout: { 2023-08-01T19:55:40.842 INFO:teuthology.orchestra.run.smithi101.stdout: "event": "reached_pg", 2023-08-01T19:55:40.843 INFO:teuthology.orchestra.run.smithi101.stdout: "time": "2023-08-01T19:55:09.282392+0000", 2023-08-01T19:55:40.843 INFO:teuthology.orchestra.run.smithi101.stdout: "duration": 0.0016948709999999999 2023-08-01T19:55:40.843 INFO:teuthology.orchestra.run.smithi101.stdout: }, 2023-08-01T19:55:40.843 INFO:teuthology.orchestra.run.smithi101.stdout: { 2023-08-01T19:55:40.843 INFO:teuthology.orchestra.run.smithi101.stdout: "event": "started", 2023-08-01T19:55:40.843 INFO:teuthology.orchestra.run.smithi101.stdout: "time": "2023-08-01T19:55:09.282514+0000", 2023-08-01T19:55:40.843 INFO:teuthology.orchestra.run.smithi101.stdout: "duration": 0.000121839 2023-08-01T19:55:40.844 INFO:teuthology.orchestra.run.smithi101.stdout: }, 2023-08-01T19:55:40.844 INFO:teuthology.orchestra.run.smithi101.stdout: { 2023-08-01T19:55:40.844 INFO:teuthology.orchestra.run.smithi101.stdout: "event": "waiting for subops from 2", 2023-08-01T19:55:40.844 INFO:teuthology.orchestra.run.smithi101.stdout: "time": "2023-08-01T19:55:09.282664+0000", 2023-08-01T19:55:40.844 INFO:teuthology.orchestra.run.smithi101.stdout: "duration": 0.00014968699999999999 2023-08-01T19:55:40.844 INFO:teuthology.orchestra.run.smithi101.stdout: }, 2023-08-01T19:55:40.844 INFO:teuthology.orchestra.run.smithi101.stdout: { 2023-08-01T19:55:40.844 INFO:teuthology.orchestra.run.smithi101.stdout: "event": "sub_op_commit_rec", 2023-08-01T19:55:40.845 INFO:teuthology.orchestra.run.smithi101.stdout: "time": "2023-08-01T19:55:09.348344+0000", 2023-08-01T19:55:40.845 INFO:teuthology.orchestra.run.smithi101.stdout: "duration": 0.065680247999999997 2023-08-01T19:55:40.845 INFO:teuthology.orchestra.run.smithi101.stdout: }, 2023-08-01T19:55:40.845 INFO:teuthology.orchestra.run.smithi101.stdout: { 2023-08-01T19:55:40.845 INFO:teuthology.orchestra.run.smithi101.stdout: "event": "op_commit", 2023-08-01T19:55:40.845 INFO:teuthology.orchestra.run.smithi101.stdout: "time": "2023-08-01T19:55:09.350502+0000", 2023-08-01T19:55:40.845 INFO:teuthology.orchestra.run.smithi101.stdout: "duration": 0.0021578140000000001 2023-08-01T19:55:40.846 INFO:teuthology.orchestra.run.smithi101.stdout: }, 2023-08-01T19:55:40.846 INFO:teuthology.orchestra.run.smithi101.stdout: { 2023-08-01T19:55:40.846 INFO:teuthology.orchestra.run.smithi101.stdout: "event": "commit_sent", 2023-08-01T19:55:40.846 INFO:teuthology.orchestra.run.smithi101.stdout: "time": "2023-08-01T19:55:09.350529+0000", 2023-08-01T19:55:40.846 INFO:teuthology.orchestra.run.smithi101.stdout: "duration": 2.6838e-05 2023-08-01T19:55:40.846 INFO:teuthology.orchestra.run.smithi101.stdout: }, 2023-08-01T19:55:40.846 INFO:teuthology.orchestra.run.smithi101.stdout: { 2023-08-01T19:55:40.846 INFO:teuthology.orchestra.run.smithi101.stdout: "event": "done", 2023-08-01T19:55:40.847 INFO:teuthology.orchestra.run.smithi101.stdout: "time": "2023-08-01T19:55:09.350568+0000", 2023-08-01T19:55:40.847 INFO:teuthology.orchestra.run.smithi101.stdout: "duration": 3.9477000000000002e-05 2023-08-01T19:55:40.847 INFO:teuthology.orchestra.run.smithi101.stdout: } 2023-08-01T19:55:40.847 INFO:teuthology.orchestra.run.smithi101.stdout: ] 2023-08-01T19:55:40.847 INFO:teuthology.orchestra.run.smithi101.stdout: } 2023-08-01T19:55:40.847 INFO:teuthology.orchestra.run.smithi101.stdout: }, 2023-08-01T19:55:40.847 INFO:teuthology.orchestra.run.smithi101.stdout: { 2023-08-01T19:55:40.847 INFO:teuthology.orchestra.run.smithi101.stdout: "description": "osd_repop(client.4668.0:107863 5.3 e38/19 5:cbdd875a:::benchmark_data_smithi006_114134_object107862:head v 38'6829, mlcod=38'6826)", 2023-08-01T19:55:40.848 INFO:teuthology.orchestra.run.smithi101.stdout: "initiated_at": "2023-08-01T19:55:09.280747+0000", 2023-08-01T19:55:40.848 INFO:teuthology.orchestra.run.smithi101.stdout: "age": 31.392072871, 2023-08-01T19:55:40.848 INFO:teuthology.orchestra.run.smithi101.stdout: "duration": 0.069343305999999993, 2023-08-01T19:55:40.848 INFO:teuthology.orchestra.run.smithi101.stdout: "type_data": { 2023-08-01T19:55:40.848 INFO:teuthology.orchestra.run.smithi101.stdout: "flag_point": "commit sent; apply or cleanup", 2023-08-01T19:55:40.848 INFO:teuthology.orchestra.run.smithi101.stdout: "events": [ 2023-08-01T19:55:40.848 INFO:teuthology.orchestra.run.smithi101.stdout: { 2023-08-01T19:55:40.848 INFO:teuthology.orchestra.run.smithi101.stdout: "event": "initiated", 2023-08-01T19:55:40.849 INFO:teuthology.orchestra.run.smithi101.stdout: "time": "2023-08-01T19:55:09.280747+0000", 2023-08-01T19:55:40.849 INFO:teuthology.orchestra.run.smithi101.stdout: "duration": 0 2023-08-01T19:55:40.849 INFO:teuthology.orchestra.run.smithi101.stdout: }, 2023-08-01T19:55:40.849 INFO:teuthology.orchestra.run.smithi101.stdout: { 2023-08-01T19:55:40.849 INFO:teuthology.orchestra.run.smithi101.stdout: "event": "throttled", 2023-08-01T19:55:40.849 INFO:teuthology.orchestra.run.smithi101.stdout: "time": "2023-08-01T19:55:09.280747+0000", 2023-08-01T19:55:40.849 INFO:teuthology.orchestra.run.smithi101.stdout: "duration": 0 2023-08-01T19:55:40.850 INFO:teuthology.orchestra.run.smithi101.stdout: }, 2023-08-01T19:55:40.850 INFO:teuthology.orchestra.run.smithi101.stdout: { 2023-08-01T19:55:40.850 INFO:teuthology.orchestra.run.smithi101.stdout: "event": "header_read", 2023-08-01T19:55:40.850 INFO:teuthology.orchestra.run.smithi101.stdout: "time": "2023-08-01T19:55:09.280746+0000", 2023-08-01T19:55:40.850 INFO:teuthology.orchestra.run.smithi101.stdout: "duration": 4294967295.9999995 2023-08-01T19:55:40.850 INFO:teuthology.orchestra.run.smithi101.stdout: }, 2023-08-01T19:55:40.850 INFO:teuthology.orchestra.run.smithi101.stdout: { 2023-08-01T19:55:40.850 INFO:teuthology.orchestra.run.smithi101.stdout: "event": "all_read", 2023-08-01T19:55:40.851 INFO:teuthology.orchestra.run.smithi101.stdout: "time": "2023-08-01T19:55:09.280798+0000", 2023-08-01T19:55:40.851 INFO:teuthology.orchestra.run.smithi101.stdout: "duration": 5.1706000000000003e-05 2023-08-01T19:55:40.851 INFO:teuthology.orchestra.run.smithi101.stdout: }, 2023-08-01T19:55:40.851 INFO:teuthology.orchestra.run.smithi101.stdout: { 2023-08-01T19:55:40.851 INFO:teuthology.orchestra.run.smithi101.stdout: "event": "dispatched", 2023-08-01T19:55:40.851 INFO:teuthology.orchestra.run.smithi101.stdout: "time": "2023-08-01T19:55:09.280807+0000", 2023-08-01T19:55:40.851 INFO:teuthology.orchestra.run.smithi101.stdout: "duration": 8.4889999999999995e-06 2023-08-01T19:55:40.851 INFO:teuthology.orchestra.run.smithi101.stdout: }, 2023-08-01T19:55:40.852 INFO:teuthology.orchestra.run.smithi101.stdout: { 2023-08-01T19:55:40.852 INFO:teuthology.orchestra.run.smithi101.stdout: "event": "queued_for_pg", 2023-08-01T19:55:40.852 INFO:teuthology.orchestra.run.smithi101.stdout: "time": "2023-08-01T19:55:09.280812+0000", 2023-08-01T19:55:40.852 INFO:teuthology.orchestra.run.smithi101.stdout: "duration": 5.2120000000000002e-06 2023-08-01T19:55:40.852 INFO:teuthology.orchestra.run.smithi101.stdout: }, 2023-08-01T19:55:40.852 INFO:teuthology.orchestra.run.smithi101.stdout: { 2023-08-01T19:55:40.853 INFO:teuthology.orchestra.run.smithi101.stdout: "event": "reached_pg", 2023-08-01T19:55:40.853 INFO:teuthology.orchestra.run.smithi101.stdout: "time": "2023-08-01T19:55:09.280843+0000", 2023-08-01T19:55:40.853 INFO:teuthology.orchestra.run.smithi101.stdout: "duration": 3.1406999999999999e-05 2023-08-01T19:55:40.853 INFO:teuthology.orchestra.run.smithi101.stdout: }, 2023-08-01T19:55:40.853 INFO:teuthology.orchestra.run.smithi101.stdout: { 2023-08-01T19:55:40.853 INFO:teuthology.orchestra.run.smithi101.stdout: "event": "started", 2023-08-01T19:55:40.853 INFO:teuthology.orchestra.run.smithi101.stdout: "time": "2023-08-01T19:55:09.280860+0000", 2023-08-01T19:55:40.853 INFO:teuthology.orchestra.run.smithi101.stdout: "duration": 1.6283999999999999e-05 2023-08-01T19:55:40.854 INFO:teuthology.orchestra.run.smithi101.stdout: }, 2023-08-01T19:55:40.854 INFO:teuthology.orchestra.run.smithi101.stdout: { 2023-08-01T19:55:40.854 INFO:teuthology.orchestra.run.smithi101.stdout: "event": "commit_sent", 2023-08-01T19:55:40.854 INFO:teuthology.orchestra.run.smithi101.stdout: "time": "2023-08-01T19:55:09.350059+0000", 2023-08-01T19:55:40.854 INFO:teuthology.orchestra.run.smithi101.stdout: "duration": 0.069199094000000003 2023-08-01T19:55:40.854 INFO:teuthology.orchestra.run.smithi101.stdout: }, 2023-08-01T19:55:40.854 INFO:teuthology.orchestra.run.smithi101.stdout: { 2023-08-01T19:55:40.854 INFO:teuthology.orchestra.run.smithi101.stdout: "event": "done", 2023-08-01T19:55:40.855 INFO:teuthology.orchestra.run.smithi101.stdout: "time": "2023-08-01T19:55:09.350090+0000", 2023-08-01T19:55:40.855 INFO:teuthology.orchestra.run.smithi101.stdout: "duration": 3.1736000000000002e-05 2023-08-01T19:55:40.855 INFO:teuthology.orchestra.run.smithi101.stdout: } 2023-08-01T19:55:40.855 INFO:teuthology.orchestra.run.smithi101.stdout: ] 2023-08-01T19:55:40.855 INFO:teuthology.orchestra.run.smithi101.stdout: } 2023-08-01T19:55:40.855 INFO:teuthology.orchestra.run.smithi101.stdout: }, 2023-08-01T19:55:40.855 INFO:teuthology.orchestra.run.smithi101.stdout: { 2023-08-01T19:55:40.856 INFO:teuthology.orchestra.run.smithi101.stdout: "description": "osd_repop(client.4668.0:107865 5.3 e38/19 5:c2ebb96d:::benchmark_data_smithi006_114134_object107864:head v 38'6830, mlcod=38'6826)", 2023-08-01T19:55:40.856 INFO:teuthology.orchestra.run.smithi101.stdout: "initiated_at": "2023-08-01T19:55:09.283182+0000", 2023-08-01T19:55:40.856 INFO:teuthology.orchestra.run.smithi101.stdout: "age": 31.389637563000001, 2023-08-01T19:55:40.856 INFO:teuthology.orchestra.run.smithi101.stdout: "duration": 0.068554793000000003, 2023-08-01T19:55:40.856 INFO:teuthology.orchestra.run.smithi101.stdout: "type_data": { 2023-08-01T19:55:40.856 INFO:teuthology.orchestra.run.smithi101.stdout: "flag_point": "commit sent; apply or cleanup", 2023-08-01T19:55:40.856 INFO:teuthology.orchestra.run.smithi101.stdout: "events": [ 2023-08-01T19:55:40.857 INFO:teuthology.orchestra.run.smithi101.stdout: { 2023-08-01T19:55:40.857 INFO:teuthology.orchestra.run.smithi101.stdout: "event": "initiated", 2023-08-01T19:55:40.857 INFO:teuthology.orchestra.run.smithi101.stdout: "time": "2023-08-01T19:55:09.283182+0000", 2023-08-01T19:55:40.857 INFO:teuthology.orchestra.run.smithi101.stdout: "duration": 0 2023-08-01T19:55:40.857 INFO:teuthology.orchestra.run.smithi101.stdout: }, 2023-08-01T19:55:40.857 INFO:teuthology.orchestra.run.smithi101.stdout: { 2023-08-01T19:55:40.857 INFO:teuthology.orchestra.run.smithi101.stdout: "event": "throttled", 2023-08-01T19:55:40.857 INFO:teuthology.orchestra.run.smithi101.stdout: "time": "2023-08-01T19:55:09.283182+0000", 2023-08-01T19:55:40.858 INFO:teuthology.orchestra.run.smithi101.stdout: "duration": 0 2023-08-01T19:55:40.858 INFO:teuthology.orchestra.run.smithi101.stdout: }, 2023-08-01T19:55:40.858 INFO:teuthology.orchestra.run.smithi101.stdout: { 2023-08-01T19:55:40.858 INFO:teuthology.orchestra.run.smithi101.stdout: "event": "header_read", 2023-08-01T19:55:40.858 INFO:teuthology.orchestra.run.smithi101.stdout: "time": "2023-08-01T19:55:09.283182+0000", 2023-08-01T19:55:40.858 INFO:teuthology.orchestra.run.smithi101.stdout: "duration": 4294967295.9999995 2023-08-01T19:55:40.858 INFO:teuthology.orchestra.run.smithi101.stdout: }, 2023-08-01T19:55:40.858 INFO:teuthology.orchestra.run.smithi101.stdout: { 2023-08-01T19:55:40.859 INFO:teuthology.orchestra.run.smithi101.stdout: "event": "all_read", 2023-08-01T19:55:40.859 INFO:teuthology.orchestra.run.smithi101.stdout: "time": "2023-08-01T19:55:09.283233+0000", 2023-08-01T19:55:40.859 INFO:teuthology.orchestra.run.smithi101.stdout: "duration": 5.1511999999999997e-05 2023-08-01T19:55:40.859 INFO:teuthology.orchestra.run.smithi101.stdout: }, 2023-08-01T19:55:40.859 INFO:teuthology.orchestra.run.smithi101.stdout: { 2023-08-01T19:55:40.859 INFO:teuthology.orchestra.run.smithi101.stdout: "event": "dispatched", 2023-08-01T19:55:40.859 INFO:teuthology.orchestra.run.smithi101.stdout: "time": "2023-08-01T19:55:09.283239+0000", 2023-08-01T19:55:40.860 INFO:teuthology.orchestra.run.smithi101.stdout: "duration": 5.6640000000000003e-06 2023-08-01T19:55:40.860 INFO:teuthology.orchestra.run.smithi101.stdout: }, 2023-08-01T19:55:40.860 INFO:teuthology.orchestra.run.smithi101.stdout: { 2023-08-01T19:55:40.860 INFO:teuthology.orchestra.run.smithi101.stdout: "event": "queued_for_pg", 2023-08-01T19:55:40.860 INFO:teuthology.orchestra.run.smithi101.stdout: "time": "2023-08-01T19:55:09.283242+0000", 2023-08-01T19:55:40.860 INFO:teuthology.orchestra.run.smithi101.stdout: "duration": 2.9639999999999999e-06 2023-08-01T19:55:40.860 INFO:teuthology.orchestra.run.smithi101.stdout: }, 2023-08-01T19:55:40.861 INFO:teuthology.orchestra.run.smithi101.stdout: { 2023-08-01T19:55:40.861 INFO:teuthology.orchestra.run.smithi101.stdout: "event": "reached_pg", 2023-08-01T19:55:40.861 INFO:teuthology.orchestra.run.smithi101.stdout: "time": "2023-08-01T19:55:09.283276+0000", 2023-08-01T19:55:40.861 INFO:teuthology.orchestra.run.smithi101.stdout: "duration": 3.3631999999999999e-05 2023-08-01T19:55:40.861 INFO:teuthology.orchestra.run.smithi101.stdout: }, 2023-08-01T19:55:40.861 INFO:teuthology.orchestra.run.smithi101.stdout: { 2023-08-01T19:55:40.861 INFO:teuthology.orchestra.run.smithi101.stdout: "event": "started", 2023-08-01T19:55:40.861 INFO:teuthology.orchestra.run.smithi101.stdout: "time": "2023-08-01T19:55:09.283288+0000", 2023-08-01T19:55:40.862 INFO:teuthology.orchestra.run.smithi101.stdout: "duration": 1.1816e-05 2023-08-01T19:55:40.862 INFO:teuthology.orchestra.run.smithi101.stdout: }, 2023-08-01T19:55:40.862 INFO:teuthology.orchestra.run.smithi101.stdout: { 2023-08-01T19:55:40.862 INFO:teuthology.orchestra.run.smithi101.stdout: "event": "commit_sent", 2023-08-01T19:55:40.862 INFO:teuthology.orchestra.run.smithi101.stdout: "time": "2023-08-01T19:55:09.351712+0000", 2023-08-01T19:55:40.862 INFO:teuthology.orchestra.run.smithi101.stdout: "duration": 0.068424311000000002 2023-08-01T19:55:40.862 INFO:teuthology.orchestra.run.smithi101.stdout: }, 2023-08-01T19:55:40.862 INFO:teuthology.orchestra.run.smithi101.stdout: { 2023-08-01T19:55:40.863 INFO:teuthology.orchestra.run.smithi101.stdout: "event": "done", 2023-08-01T19:55:40.863 INFO:teuthology.orchestra.run.smithi101.stdout: "time": "2023-08-01T19:55:09.351737+0000", 2023-08-01T19:55:40.863 INFO:teuthology.orchestra.run.smithi101.stdout: "duration": 2.5364999999999999e-05 2023-08-01T19:55:40.863 INFO:teuthology.orchestra.run.smithi101.stdout: } 2023-08-01T19:55:40.863 INFO:teuthology.orchestra.run.smithi101.stdout: ] 2023-08-01T19:55:40.863 INFO:teuthology.orchestra.run.smithi101.stdout: } 2023-08-01T19:55:40.863 INFO:teuthology.orchestra.run.smithi101.stdout: }, 2023-08-01T19:55:40.863 INFO:teuthology.orchestra.run.smithi101.stdout: { 2023-08-01T19:55:40.864 INFO:teuthology.orchestra.run.smithi101.stdout: "description": "osd_repop(client.4668.0:107869 5.c e38/19 5:31910384:::benchmark_data_smithi006_114134_object107868:head v 38'6761, mlcod=38'6759)", 2023-08-01T19:55:40.864 INFO:teuthology.orchestra.run.smithi101.stdout: "initiated_at": "2023-08-01T19:55:09.283762+0000", 2023-08-01T19:55:40.864 INFO:teuthology.orchestra.run.smithi101.stdout: "age": 31.389058227, 2023-08-01T19:55:40.864 INFO:teuthology.orchestra.run.smithi101.stdout: "duration": 0.067877541, 2023-08-01T19:55:40.864 INFO:teuthology.orchestra.run.smithi101.stdout: "type_data": { 2023-08-01T19:55:40.864 INFO:teuthology.orchestra.run.smithi101.stdout: "flag_point": "commit sent; apply or cleanup", 2023-08-01T19:55:40.864 INFO:teuthology.orchestra.run.smithi101.stdout: "events": [ 2023-08-01T19:55:40.864 INFO:teuthology.orchestra.run.smithi101.stdout: { 2023-08-01T19:55:40.865 INFO:teuthology.orchestra.run.smithi101.stdout: "event": "initiated", 2023-08-01T19:55:40.865 INFO:teuthology.orchestra.run.smithi101.stdout: "time": "2023-08-01T19:55:09.283762+0000", 2023-08-01T19:55:40.865 INFO:teuthology.orchestra.run.smithi101.stdout: "duration": 0 2023-08-01T19:55:40.865 INFO:teuthology.orchestra.run.smithi101.stdout: }, 2023-08-01T19:55:40.865 INFO:teuthology.orchestra.run.smithi101.stdout: { 2023-08-01T19:55:40.865 INFO:teuthology.orchestra.run.smithi101.stdout: "event": "throttled", 2023-08-01T19:55:40.865 INFO:teuthology.orchestra.run.smithi101.stdout: "time": "2023-08-01T19:55:09.283762+0000", 2023-08-01T19:55:40.865 INFO:teuthology.orchestra.run.smithi101.stdout: "duration": 0 2023-08-01T19:55:40.866 INFO:teuthology.orchestra.run.smithi101.stdout: }, 2023-08-01T19:55:40.866 INFO:teuthology.orchestra.run.smithi101.stdout: { 2023-08-01T19:55:40.866 INFO:teuthology.orchestra.run.smithi101.stdout: "event": "header_read", 2023-08-01T19:55:40.866 INFO:teuthology.orchestra.run.smithi101.stdout: "time": "2023-08-01T19:55:09.283761+0000", 2023-08-01T19:55:40.866 INFO:teuthology.orchestra.run.smithi101.stdout: "duration": 4294967295.9999995 2023-08-01T19:55:40.866 INFO:teuthology.orchestra.run.smithi101.stdout: }, 2023-08-01T19:55:40.866 INFO:teuthology.orchestra.run.smithi101.stdout: { 2023-08-01T19:55:40.867 INFO:teuthology.orchestra.run.smithi101.stdout: "event": "all_read", 2023-08-01T19:55:40.867 INFO:teuthology.orchestra.run.smithi101.stdout: "time": "2023-08-01T19:55:09.283825+0000", 2023-08-01T19:55:40.867 INFO:teuthology.orchestra.run.smithi101.stdout: "duration": 6.3200000000000005e-05 2023-08-01T19:55:40.867 INFO:teuthology.orchestra.run.smithi101.stdout: }, 2023-08-01T19:55:40.867 INFO:teuthology.orchestra.run.smithi101.stdout: { 2023-08-01T19:55:40.867 INFO:teuthology.orchestra.run.smithi101.stdout: "event": "dispatched", 2023-08-01T19:55:40.867 INFO:teuthology.orchestra.run.smithi101.stdout: "time": "2023-08-01T19:55:09.345759+0000", 2023-08-01T19:55:40.867 INFO:teuthology.orchestra.run.smithi101.stdout: "duration": 0.061934221999999997 2023-08-01T19:55:40.868 INFO:teuthology.orchestra.run.smithi101.stdout: }, 2023-08-01T19:55:40.868 INFO:teuthology.orchestra.run.smithi101.stdout: { 2023-08-01T19:55:40.868 INFO:teuthology.orchestra.run.smithi101.stdout: "event": "queued_for_pg", 2023-08-01T19:55:40.868 INFO:teuthology.orchestra.run.smithi101.stdout: "time": "2023-08-01T19:55:09.345768+0000", 2023-08-01T19:55:40.868 INFO:teuthology.orchestra.run.smithi101.stdout: "duration": 8.7099999999999996e-06 2023-08-01T19:55:40.868 INFO:teuthology.orchestra.run.smithi101.stdout: }, 2023-08-01T19:55:40.868 INFO:teuthology.orchestra.run.smithi101.stdout: { 2023-08-01T19:55:40.868 INFO:teuthology.orchestra.run.smithi101.stdout: "event": "reached_pg", 2023-08-01T19:55:40.869 INFO:teuthology.orchestra.run.smithi101.stdout: "time": "2023-08-01T19:55:09.345832+0000", 2023-08-01T19:55:40.869 INFO:teuthology.orchestra.run.smithi101.stdout: "duration": 6.4769000000000003e-05 2023-08-01T19:55:40.869 INFO:teuthology.orchestra.run.smithi101.stdout: }, 2023-08-01T19:55:40.869 INFO:teuthology.orchestra.run.smithi101.stdout: { 2023-08-01T19:55:40.869 INFO:teuthology.orchestra.run.smithi101.stdout: "event": "started", 2023-08-01T19:55:40.869 INFO:teuthology.orchestra.run.smithi101.stdout: "time": "2023-08-01T19:55:09.345851+0000", 2023-08-01T19:55:40.869 INFO:teuthology.orchestra.run.smithi101.stdout: "duration": 1.9049e-05 2023-08-01T19:55:40.869 INFO:teuthology.orchestra.run.smithi101.stdout: }, 2023-08-01T19:55:40.870 INFO:teuthology.orchestra.run.smithi101.stdout: { 2023-08-01T19:55:40.870 INFO:teuthology.orchestra.run.smithi101.stdout: "event": "commit_sent", 2023-08-01T19:55:40.870 INFO:teuthology.orchestra.run.smithi101.stdout: "time": "2023-08-01T19:55:09.351601+0000", 2023-08-01T19:55:40.870 INFO:teuthology.orchestra.run.smithi101.stdout: "duration": 0.0057499930000000001 2023-08-01T19:55:40.870 INFO:teuthology.orchestra.run.smithi101.stdout: }, 2023-08-01T19:55:40.870 INFO:teuthology.orchestra.run.smithi101.stdout: { 2023-08-01T19:55:40.870 INFO:teuthology.orchestra.run.smithi101.stdout: "event": "done", 2023-08-01T19:55:40.871 INFO:teuthology.orchestra.run.smithi101.stdout: "time": "2023-08-01T19:55:09.351639+0000", 2023-08-01T19:55:40.871 INFO:teuthology.orchestra.run.smithi101.stdout: "duration": 3.7941000000000001e-05 2023-08-01T19:55:40.871 INFO:teuthology.orchestra.run.smithi101.stdout: } 2023-08-01T19:55:40.871 INFO:teuthology.orchestra.run.smithi101.stdout: ] 2023-08-01T19:55:40.871 INFO:teuthology.orchestra.run.smithi101.stdout: } 2023-08-01T19:55:40.871 INFO:teuthology.orchestra.run.smithi101.stdout: }, 2023-08-01T19:55:40.871 INFO:teuthology.orchestra.run.smithi101.stdout: { 2023-08-01T19:55:40.871 INFO:teuthology.orchestra.run.smithi101.stdout: "description": "osd_op(client.4668.0:107876 5.1 5:8d2344a3:::benchmark_data_smithi006_114134_object107875:head [set-alloc-hint object_size 65536 write_size 65536,write 0~65536] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e38)", 2023-08-01T19:55:40.872 INFO:teuthology.orchestra.run.smithi101.stdout: "initiated_at": "2023-08-01T19:55:09.287802+0000", 2023-08-01T19:55:40.872 INFO:teuthology.orchestra.run.smithi101.stdout: "age": 31.385017907000002, 2023-08-01T19:55:40.872 INFO:teuthology.orchestra.run.smithi101.stdout: "duration": 0.066738461999999998, 2023-08-01T19:55:40.872 INFO:teuthology.orchestra.run.smithi101.stdout: "type_data": { 2023-08-01T19:55:40.872 INFO:teuthology.orchestra.run.smithi101.stdout: "flag_point": "commit sent; apply or cleanup", 2023-08-01T19:55:40.872 INFO:teuthology.orchestra.run.smithi101.stdout: "client_info": { 2023-08-01T19:55:40.872 INFO:teuthology.orchestra.run.smithi101.stdout: "client": "client.4668", 2023-08-01T19:55:40.873 INFO:teuthology.orchestra.run.smithi101.stdout: "client_addr": "172.21.15.6:0/1709472247", 2023-08-01T19:55:40.873 INFO:teuthology.orchestra.run.smithi101.stdout: "tid": 107876 2023-08-01T19:55:40.873 INFO:teuthology.orchestra.run.smithi101.stdout: }, 2023-08-01T19:55:40.873 INFO:teuthology.orchestra.run.smithi101.stdout: "events": [ 2023-08-01T19:55:40.873 INFO:teuthology.orchestra.run.smithi101.stdout: { 2023-08-01T19:55:40.873 INFO:teuthology.orchestra.run.smithi101.stdout: "event": "initiated", 2023-08-01T19:55:40.873 INFO:teuthology.orchestra.run.smithi101.stdout: "time": "2023-08-01T19:55:09.287802+0000", 2023-08-01T19:55:40.873 INFO:teuthology.orchestra.run.smithi101.stdout: "duration": 0 2023-08-01T19:55:40.874 INFO:teuthology.orchestra.run.smithi101.stdout: }, 2023-08-01T19:55:40.874 INFO:teuthology.orchestra.run.smithi101.stdout: { 2023-08-01T19:55:40.874 INFO:teuthology.orchestra.run.smithi101.stdout: "event": "throttled", 2023-08-01T19:55:40.874 INFO:teuthology.orchestra.run.smithi101.stdout: "time": "2023-08-01T19:55:09.287802+0000", 2023-08-01T19:55:40.874 INFO:teuthology.orchestra.run.smithi101.stdout: "duration": 0 2023-08-01T19:55:40.874 INFO:teuthology.orchestra.run.smithi101.stdout: }, 2023-08-01T19:55:40.874 INFO:teuthology.orchestra.run.smithi101.stdout: { 2023-08-01T19:55:40.874 INFO:teuthology.orchestra.run.smithi101.stdout: "event": "header_read", 2023-08-01T19:55:40.875 INFO:teuthology.orchestra.run.smithi101.stdout: "time": "2023-08-01T19:55:09.287800+0000", 2023-08-01T19:55:40.875 INFO:teuthology.orchestra.run.smithi101.stdout: "duration": 4294967295.9999981 2023-08-01T19:55:40.875 INFO:teuthology.orchestra.run.smithi101.stdout: }, 2023-08-01T19:55:40.875 INFO:teuthology.orchestra.run.smithi101.stdout: { 2023-08-01T19:55:40.875 INFO:teuthology.orchestra.run.smithi101.stdout: "event": "all_read", 2023-08-01T19:55:40.875 INFO:teuthology.orchestra.run.smithi101.stdout: "time": "2023-08-01T19:55:09.287847+0000", 2023-08-01T19:55:40.875 INFO:teuthology.orchestra.run.smithi101.stdout: "duration": 4.6455999999999997e-05 2023-08-01T19:55:40.876 INFO:teuthology.orchestra.run.smithi101.stdout: }, 2023-08-01T19:55:40.876 INFO:teuthology.orchestra.run.smithi101.stdout: { 2023-08-01T19:55:40.876 INFO:teuthology.orchestra.run.smithi101.stdout: "event": "dispatched", 2023-08-01T19:55:40.876 INFO:teuthology.orchestra.run.smithi101.stdout: "time": "2023-08-01T19:55:09.345732+0000", 2023-08-01T19:55:40.876 INFO:teuthology.orchestra.run.smithi101.stdout: "duration": 0.057885955000000003 2023-08-01T19:55:40.876 INFO:teuthology.orchestra.run.smithi101.stdout: }, 2023-08-01T19:55:40.876 INFO:teuthology.orchestra.run.smithi101.stdout: { 2023-08-01T19:55:40.877 INFO:teuthology.orchestra.run.smithi101.stdout: "event": "queued_for_pg", 2023-08-01T19:55:40.877 INFO:teuthology.orchestra.run.smithi101.stdout: "time": "2023-08-01T19:55:09.345802+0000", 2023-08-01T19:55:40.877 INFO:teuthology.orchestra.run.smithi101.stdout: "duration": 6.9845000000000006e-05 2023-08-01T19:55:40.877 INFO:teuthology.orchestra.run.smithi101.stdout: }, 2023-08-01T19:55:40.877 INFO:teuthology.orchestra.run.smithi101.stdout: { 2023-08-01T19:55:40.877 INFO:teuthology.orchestra.run.smithi101.stdout: "event": "reached_pg", 2023-08-01T19:55:40.877 INFO:teuthology.orchestra.run.smithi101.stdout: "time": "2023-08-01T19:55:09.345841+0000", 2023-08-01T19:55:40.878 INFO:teuthology.orchestra.run.smithi101.stdout: "duration": 3.8719e-05 2023-08-01T19:55:40.878 INFO:teuthology.orchestra.run.smithi101.stdout: }, 2023-08-01T19:55:40.878 INFO:teuthology.orchestra.run.smithi101.stdout: { 2023-08-01T19:55:40.878 INFO:teuthology.orchestra.run.smithi101.stdout: "event": "started", 2023-08-01T19:55:40.878 INFO:teuthology.orchestra.run.smithi101.stdout: "time": "2023-08-01T19:55:09.345965+0000", 2023-08-01T19:55:40.878 INFO:teuthology.orchestra.run.smithi101.stdout: "duration": 0.00012353099999999999 2023-08-01T19:55:40.878 INFO:teuthology.orchestra.run.smithi101.stdout: }, 2023-08-01T19:55:40.878 INFO:teuthology.orchestra.run.smithi101.stdout: { 2023-08-01T19:55:40.879 INFO:teuthology.orchestra.run.smithi101.stdout: "event": "waiting for subops from 0", 2023-08-01T19:55:40.879 INFO:teuthology.orchestra.run.smithi101.stdout: "time": "2023-08-01T19:55:09.346113+0000", 2023-08-01T19:55:40.879 INFO:teuthology.orchestra.run.smithi101.stdout: "duration": 0.000148496 2023-08-01T19:55:40.879 INFO:teuthology.orchestra.run.smithi101.stdout: }, 2023-08-01T19:55:40.879 INFO:teuthology.orchestra.run.smithi101.stdout: { 2023-08-01T19:55:40.879 INFO:teuthology.orchestra.run.smithi101.stdout: "event": "sub_op_commit_rec", 2023-08-01T19:55:40.879 INFO:teuthology.orchestra.run.smithi101.stdout: "time": "2023-08-01T19:55:09.352561+0000", 2023-08-01T19:55:40.879 INFO:teuthology.orchestra.run.smithi101.stdout: "duration": 0.0064478890000000001 2023-08-01T19:55:40.880 INFO:teuthology.orchestra.run.smithi101.stdout: }, 2023-08-01T19:55:40.880 INFO:teuthology.orchestra.run.smithi101.stdout: { 2023-08-01T19:55:40.880 INFO:teuthology.orchestra.run.smithi101.stdout: "event": "op_commit", 2023-08-01T19:55:40.880 INFO:teuthology.orchestra.run.smithi101.stdout: "time": "2023-08-01T19:55:09.354475+0000", 2023-08-01T19:55:40.880 INFO:teuthology.orchestra.run.smithi101.stdout: "duration": 0.001913903 2023-08-01T19:55:40.880 INFO:teuthology.orchestra.run.smithi101.stdout: }, 2023-08-01T19:55:40.880 INFO:teuthology.orchestra.run.smithi101.stdout: { 2023-08-01T19:55:40.881 INFO:teuthology.orchestra.run.smithi101.stdout: "event": "commit_sent", 2023-08-01T19:55:40.881 INFO:teuthology.orchestra.run.smithi101.stdout: "time": "2023-08-01T19:55:09.354514+0000", 2023-08-01T19:55:40.881 INFO:teuthology.orchestra.run.smithi101.stdout: "duration": 3.8680999999999998e-05 2023-08-01T19:55:40.881 INFO:teuthology.orchestra.run.smithi101.stdout: }, 2023-08-01T19:55:40.881 INFO:teuthology.orchestra.run.smithi101.stdout: { 2023-08-01T19:55:40.881 INFO:teuthology.orchestra.run.smithi101.stdout: "event": "done", 2023-08-01T19:55:40.881 INFO:teuthology.orchestra.run.smithi101.stdout: "time": "2023-08-01T19:55:09.354541+0000", 2023-08-01T19:55:40.881 INFO:teuthology.orchestra.run.smithi101.stdout: "duration": 2.6976999999999999e-05 2023-08-01T19:55:40.882 INFO:teuthology.orchestra.run.smithi101.stdout: } 2023-08-01T19:55:40.882 INFO:teuthology.orchestra.run.smithi101.stdout: ] 2023-08-01T19:55:40.882 INFO:teuthology.orchestra.run.smithi101.stdout: } 2023-08-01T19:55:40.882 INFO:teuthology.orchestra.run.smithi101.stdout: } 2023-08-01T19:55:40.882 INFO:teuthology.orchestra.run.smithi101.stdout: ] 2023-08-01T19:55:40.882 INFO:teuthology.orchestra.run.smithi101.stdout:} 2023-08-01T19:55:40.884 DEBUG:teuthology.orchestra.run.smithi155:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 30 ceph --cluster ceph --admin-daemon /var/run/ceph/ceph-osd.2.asok dump_ops_in_flight 2023-08-01T19:55:40.884 INFO:tasks.ceph.osd.1.smithi101.stderr:2023-08-01T19:55:40.882+0000 7fb0cb7f6700 -1 received signal: Hangup from /usr/bin/python3 /bin/daemon-helper kill ceph-osd -f --cluster ceph -i 1 (PID: 111141) UID: 0 2023-08-01T19:55:40.984 INFO:tasks.ceph.osd.1.smithi101.stderr:2023-08-01T19:55:40.983+0000 7fb0cb7f6700 -1 received signal: Hangup from /usr/bin/python3 /bin/daemon-helper kill ceph-osd -f --cluster ceph -i 1 (PID: 111141) UID: 0 2023-08-01T19:55:41.051 INFO:teuthology.orchestra.run.smithi155.stdout:{ 2023-08-01T19:55:41.051 INFO:teuthology.orchestra.run.smithi155.stdout: "ops": [ 2023-08-01T19:55:41.051 INFO:teuthology.orchestra.run.smithi155.stdout: { 2023-08-01T19:55:41.052 INFO:teuthology.orchestra.run.smithi155.stdout: "description": "osd_op(client.4668.0:165732 5.e 5:73b58491:::benchmark_data_smithi006_114134_object32071:head [delete] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e51)", 2023-08-01T19:55:41.052 INFO:teuthology.orchestra.run.smithi155.stdout: "initiated_at": "2023-08-01T19:55:41.045065+0000", 2023-08-01T19:55:41.052 INFO:teuthology.orchestra.run.smithi155.stdout: "age": 0.0044239250000000004, 2023-08-01T19:55:41.052 INFO:teuthology.orchestra.run.smithi155.stdout: "duration": 0.0044502869999999998, 2023-08-01T19:55:41.052 INFO:teuthology.orchestra.run.smithi155.stdout: "type_data": { 2023-08-01T19:55:41.052 INFO:teuthology.orchestra.run.smithi155.stdout: "flag_point": "waiting for sub ops", 2023-08-01T19:55:41.052 INFO:teuthology.orchestra.run.smithi155.stdout: "client_info": { 2023-08-01T19:55:41.053 INFO:teuthology.orchestra.run.smithi155.stdout: "client": "client.4668", 2023-08-01T19:55:41.053 INFO:teuthology.orchestra.run.smithi155.stdout: "client_addr": "172.21.15.6:0/1709472247", 2023-08-01T19:55:41.053 INFO:teuthology.orchestra.run.smithi155.stdout: "tid": 165732 2023-08-01T19:55:41.053 INFO:teuthology.orchestra.run.smithi155.stdout: }, 2023-08-01T19:55:41.053 INFO:teuthology.orchestra.run.smithi155.stdout: "events": [ 2023-08-01T19:55:41.053 INFO:teuthology.orchestra.run.smithi155.stdout: { 2023-08-01T19:55:41.053 INFO:teuthology.orchestra.run.smithi155.stdout: "event": "initiated", 2023-08-01T19:55:41.054 INFO:teuthology.orchestra.run.smithi155.stdout: "time": "2023-08-01T19:55:41.045065+0000", 2023-08-01T19:55:41.054 INFO:teuthology.orchestra.run.smithi155.stdout: "duration": 0 2023-08-01T19:55:41.054 INFO:teuthology.orchestra.run.smithi155.stdout: }, 2023-08-01T19:55:41.054 INFO:teuthology.orchestra.run.smithi155.stdout: { 2023-08-01T19:55:41.054 INFO:teuthology.orchestra.run.smithi155.stdout: "event": "throttled", 2023-08-01T19:55:41.054 INFO:teuthology.orchestra.run.smithi155.stdout: "time": "2023-08-01T19:55:41.045065+0000", 2023-08-01T19:55:41.054 INFO:teuthology.orchestra.run.smithi155.stdout: "duration": 0 2023-08-01T19:55:41.054 INFO:teuthology.orchestra.run.smithi155.stdout: }, 2023-08-01T19:55:41.055 INFO:teuthology.orchestra.run.smithi155.stdout: { 2023-08-01T19:55:41.055 INFO:teuthology.orchestra.run.smithi155.stdout: "event": "header_read", 2023-08-01T19:55:41.055 INFO:teuthology.orchestra.run.smithi155.stdout: "time": "2023-08-01T19:55:41.045064+0000", 2023-08-01T19:55:41.055 INFO:teuthology.orchestra.run.smithi155.stdout: "duration": 4294967295.9999995 2023-08-01T19:55:41.055 INFO:teuthology.orchestra.run.smithi155.stdout: }, 2023-08-01T19:55:41.055 INFO:teuthology.orchestra.run.smithi155.stdout: { 2023-08-01T19:55:41.055 INFO:teuthology.orchestra.run.smithi155.stdout: "event": "all_read", 2023-08-01T19:55:41.056 INFO:teuthology.orchestra.run.smithi155.stdout: "time": "2023-08-01T19:55:41.045068+0000", 2023-08-01T19:55:41.056 INFO:teuthology.orchestra.run.smithi155.stdout: "duration": 3.6059999999999999e-06 2023-08-01T19:55:41.056 INFO:teuthology.orchestra.run.smithi155.stdout: }, 2023-08-01T19:55:41.056 INFO:teuthology.orchestra.run.smithi155.stdout: { 2023-08-01T19:55:41.056 INFO:teuthology.orchestra.run.smithi155.stdout: "event": "dispatched", 2023-08-01T19:55:41.056 INFO:teuthology.orchestra.run.smithi155.stdout: "time": "2023-08-01T19:55:41.045077+0000", 2023-08-01T19:55:41.056 INFO:teuthology.orchestra.run.smithi155.stdout: "duration": 9.2380000000000003e-06 2023-08-01T19:55:41.056 INFO:teuthology.orchestra.run.smithi155.stdout: }, 2023-08-01T19:55:41.057 INFO:teuthology.orchestra.run.smithi155.stdout: { 2023-08-01T19:55:41.057 INFO:teuthology.orchestra.run.smithi155.stdout: "event": "queued_for_pg", 2023-08-01T19:55:41.057 INFO:teuthology.orchestra.run.smithi155.stdout: "time": "2023-08-01T19:55:41.045081+0000", 2023-08-01T19:55:41.057 INFO:teuthology.orchestra.run.smithi155.stdout: "duration": 4.1289999999999998e-06 2023-08-01T19:55:41.057 INFO:teuthology.orchestra.run.smithi155.stdout: }, 2023-08-01T19:55:41.057 INFO:teuthology.orchestra.run.smithi155.stdout: { 2023-08-01T19:55:41.057 INFO:teuthology.orchestra.run.smithi155.stdout: "event": "reached_pg", 2023-08-01T19:55:41.057 INFO:teuthology.orchestra.run.smithi155.stdout: "time": "2023-08-01T19:55:41.046541+0000", 2023-08-01T19:55:41.058 INFO:teuthology.orchestra.run.smithi155.stdout: "duration": 0.001460189 2023-08-01T19:55:41.058 INFO:teuthology.orchestra.run.smithi155.stdout: }, 2023-08-01T19:55:41.058 INFO:teuthology.orchestra.run.smithi155.stdout: { 2023-08-01T19:55:41.058 INFO:teuthology.orchestra.run.smithi155.stdout: "event": "started", 2023-08-01T19:55:41.058 INFO:teuthology.orchestra.run.smithi155.stdout: "time": "2023-08-01T19:55:41.046651+0000", 2023-08-01T19:55:41.058 INFO:teuthology.orchestra.run.smithi155.stdout: "duration": 0.000109054 2023-08-01T19:55:41.058 INFO:teuthology.orchestra.run.smithi155.stdout: }, 2023-08-01T19:55:41.059 INFO:teuthology.orchestra.run.smithi155.stdout: { 2023-08-01T19:55:41.059 INFO:teuthology.orchestra.run.smithi155.stdout: "event": "waiting for subops from 0", 2023-08-01T19:55:41.059 INFO:teuthology.orchestra.run.smithi155.stdout: "time": "2023-08-01T19:55:41.046753+0000", 2023-08-01T19:55:41.059 INFO:teuthology.orchestra.run.smithi155.stdout: "duration": 0.000102166 2023-08-01T19:55:41.059 INFO:teuthology.orchestra.run.smithi155.stdout: } 2023-08-01T19:55:41.059 INFO:teuthology.orchestra.run.smithi155.stdout: ] 2023-08-01T19:55:41.059 INFO:teuthology.orchestra.run.smithi155.stdout: } 2023-08-01T19:55:41.059 INFO:teuthology.orchestra.run.smithi155.stdout: }, 2023-08-01T19:55:41.060 INFO:teuthology.orchestra.run.smithi155.stdout: { 2023-08-01T19:55:41.060 INFO:teuthology.orchestra.run.smithi155.stdout: "description": "osd_op(client.4668.0:165733 5.b 5:dbeb8627:::benchmark_data_smithi006_114134_object32072:head [delete] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e51)", 2023-08-01T19:55:41.060 INFO:teuthology.orchestra.run.smithi155.stdout: "initiated_at": "2023-08-01T19:55:41.047103+0000", 2023-08-01T19:55:41.060 INFO:teuthology.orchestra.run.smithi155.stdout: "age": 0.0023856300000000001, 2023-08-01T19:55:41.060 INFO:teuthology.orchestra.run.smithi155.stdout: "duration": 0.002500445, 2023-08-01T19:55:41.060 INFO:teuthology.orchestra.run.smithi155.stdout: "type_data": { 2023-08-01T19:55:41.060 INFO:teuthology.orchestra.run.smithi155.stdout: "flag_point": "waiting for sub ops", 2023-08-01T19:55:41.060 INFO:teuthology.orchestra.run.smithi155.stdout: "client_info": { 2023-08-01T19:55:41.061 INFO:teuthology.orchestra.run.smithi155.stdout: "client": "client.4668", 2023-08-01T19:55:41.061 INFO:teuthology.orchestra.run.smithi155.stdout: "client_addr": "172.21.15.6:0/1709472247", 2023-08-01T19:55:41.061 INFO:teuthology.orchestra.run.smithi155.stdout: "tid": 165733 2023-08-01T19:55:41.061 INFO:teuthology.orchestra.run.smithi155.stdout: }, 2023-08-01T19:55:41.061 INFO:teuthology.orchestra.run.smithi155.stdout: "events": [ 2023-08-01T19:55:41.061 INFO:teuthology.orchestra.run.smithi155.stdout: { 2023-08-01T19:55:41.061 INFO:teuthology.orchestra.run.smithi155.stdout: "event": "initiated", 2023-08-01T19:55:41.061 INFO:teuthology.orchestra.run.smithi155.stdout: "time": "2023-08-01T19:55:41.047103+0000", 2023-08-01T19:55:41.062 INFO:teuthology.orchestra.run.smithi155.stdout: "duration": 0 2023-08-01T19:55:41.062 INFO:teuthology.orchestra.run.smithi155.stdout: }, 2023-08-01T19:55:41.062 INFO:teuthology.orchestra.run.smithi155.stdout: { 2023-08-01T19:55:41.062 INFO:teuthology.orchestra.run.smithi155.stdout: "event": "throttled", 2023-08-01T19:55:41.062 INFO:teuthology.orchestra.run.smithi155.stdout: "time": "2023-08-01T19:55:41.047103+0000", 2023-08-01T19:55:41.062 INFO:teuthology.orchestra.run.smithi155.stdout: "duration": 0 2023-08-01T19:55:41.062 INFO:teuthology.orchestra.run.smithi155.stdout: }, 2023-08-01T19:55:41.063 INFO:teuthology.orchestra.run.smithi155.stdout: { 2023-08-01T19:55:41.063 INFO:teuthology.orchestra.run.smithi155.stdout: "event": "header_read", 2023-08-01T19:55:41.063 INFO:teuthology.orchestra.run.smithi155.stdout: "time": "2023-08-01T19:55:41.047102+0000", 2023-08-01T19:55:41.063 INFO:teuthology.orchestra.run.smithi155.stdout: "duration": 4294967295.999999 2023-08-01T19:55:41.063 INFO:teuthology.orchestra.run.smithi155.stdout: }, 2023-08-01T19:55:41.063 INFO:teuthology.orchestra.run.smithi155.stdout: { 2023-08-01T19:55:41.063 INFO:teuthology.orchestra.run.smithi155.stdout: "event": "all_read", 2023-08-01T19:55:41.064 INFO:teuthology.orchestra.run.smithi155.stdout: "time": "2023-08-01T19:55:41.047109+0000", 2023-08-01T19:55:41.064 INFO:teuthology.orchestra.run.smithi155.stdout: "duration": 6.9299999999999997e-06 2023-08-01T19:55:41.064 INFO:teuthology.orchestra.run.smithi155.stdout: }, 2023-08-01T19:55:41.064 INFO:teuthology.orchestra.run.smithi155.stdout: { 2023-08-01T19:55:41.064 INFO:teuthology.orchestra.run.smithi155.stdout: "event": "dispatched", 2023-08-01T19:55:41.064 INFO:teuthology.orchestra.run.smithi155.stdout: "time": "2023-08-01T19:55:41.047117+0000", 2023-08-01T19:55:41.064 INFO:teuthology.orchestra.run.smithi155.stdout: "duration": 8.0609999999999996e-06 2023-08-01T19:55:41.064 INFO:teuthology.orchestra.run.smithi155.stdout: }, 2023-08-01T19:55:41.065 INFO:teuthology.orchestra.run.smithi155.stdout: { 2023-08-01T19:55:41.065 INFO:teuthology.orchestra.run.smithi155.stdout: "event": "queued_for_pg", 2023-08-01T19:55:41.065 INFO:teuthology.orchestra.run.smithi155.stdout: "time": "2023-08-01T19:55:41.047123+0000", 2023-08-01T19:55:41.065 INFO:teuthology.orchestra.run.smithi155.stdout: "duration": 5.2789999999999998e-06 2023-08-01T19:55:41.065 INFO:teuthology.orchestra.run.smithi155.stdout: }, 2023-08-01T19:55:41.065 INFO:teuthology.orchestra.run.smithi155.stdout: { 2023-08-01T19:55:41.065 INFO:teuthology.orchestra.run.smithi155.stdout: "event": "reached_pg", 2023-08-01T19:55:41.065 INFO:teuthology.orchestra.run.smithi155.stdout: "time": "2023-08-01T19:55:41.047155+0000", 2023-08-01T19:55:41.066 INFO:teuthology.orchestra.run.smithi155.stdout: "duration": 3.2453999999999998e-05 2023-08-01T19:55:41.066 INFO:teuthology.orchestra.run.smithi155.stdout: }, 2023-08-01T19:55:41.066 INFO:teuthology.orchestra.run.smithi155.stdout: { 2023-08-01T19:55:41.066 INFO:teuthology.orchestra.run.smithi155.stdout: "event": "started", 2023-08-01T19:55:41.066 INFO:teuthology.orchestra.run.smithi155.stdout: "time": "2023-08-01T19:55:41.047273+0000", 2023-08-01T19:55:41.066 INFO:teuthology.orchestra.run.smithi155.stdout: "duration": 0.00011822799999999999 2023-08-01T19:55:41.066 INFO:teuthology.orchestra.run.smithi155.stdout: }, 2023-08-01T19:55:41.066 INFO:teuthology.orchestra.run.smithi155.stdout: { 2023-08-01T19:55:41.067 INFO:teuthology.orchestra.run.smithi155.stdout: "event": "waiting for subops from 0", 2023-08-01T19:55:41.067 INFO:teuthology.orchestra.run.smithi155.stdout: "time": "2023-08-01T19:55:41.047379+0000", 2023-08-01T19:55:41.067 INFO:teuthology.orchestra.run.smithi155.stdout: "duration": 0.000105485 2023-08-01T19:55:41.067 INFO:teuthology.orchestra.run.smithi155.stdout: } 2023-08-01T19:55:41.067 INFO:teuthology.orchestra.run.smithi155.stdout: ] 2023-08-01T19:55:41.067 INFO:teuthology.orchestra.run.smithi155.stdout: } 2023-08-01T19:55:41.067 INFO:teuthology.orchestra.run.smithi155.stdout: }, 2023-08-01T19:55:41.067 INFO:teuthology.orchestra.run.smithi155.stdout: { 2023-08-01T19:55:41.068 INFO:teuthology.orchestra.run.smithi155.stdout: "description": "osd_op(client.4668.0:165734 5.e 5:77e23877:::benchmark_data_smithi006_114134_object32073:head [delete] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e51)", 2023-08-01T19:55:41.068 INFO:teuthology.orchestra.run.smithi155.stdout: "initiated_at": "2023-08-01T19:55:41.047132+0000", 2023-08-01T19:55:41.068 INFO:teuthology.orchestra.run.smithi155.stdout: "age": 0.0023571, 2023-08-01T19:55:41.068 INFO:teuthology.orchestra.run.smithi155.stdout: "duration": 0.0025526379999999999, 2023-08-01T19:55:41.068 INFO:teuthology.orchestra.run.smithi155.stdout: "type_data": { 2023-08-01T19:55:41.068 INFO:teuthology.orchestra.run.smithi155.stdout: "flag_point": "waiting for sub ops", 2023-08-01T19:55:41.068 INFO:teuthology.orchestra.run.smithi155.stdout: "client_info": { 2023-08-01T19:55:41.069 INFO:teuthology.orchestra.run.smithi155.stdout: "client": "client.4668", 2023-08-01T19:55:41.069 INFO:teuthology.orchestra.run.smithi155.stdout: "client_addr": "172.21.15.6:0/1709472247", 2023-08-01T19:55:41.069 INFO:teuthology.orchestra.run.smithi155.stdout: "tid": 165734 2023-08-01T19:55:41.069 INFO:teuthology.orchestra.run.smithi155.stdout: }, 2023-08-01T19:55:41.069 INFO:teuthology.orchestra.run.smithi155.stdout: "events": [ 2023-08-01T19:55:41.069 INFO:teuthology.orchestra.run.smithi155.stdout: { 2023-08-01T19:55:41.069 INFO:teuthology.orchestra.run.smithi155.stdout: "event": "initiated", 2023-08-01T19:55:41.069 INFO:teuthology.orchestra.run.smithi155.stdout: "time": "2023-08-01T19:55:41.047132+0000", 2023-08-01T19:55:41.070 INFO:teuthology.orchestra.run.smithi155.stdout: "duration": 0 2023-08-01T19:55:41.070 INFO:teuthology.orchestra.run.smithi155.stdout: }, 2023-08-01T19:55:41.070 INFO:teuthology.orchestra.run.smithi155.stdout: { 2023-08-01T19:55:41.070 INFO:teuthology.orchestra.run.smithi155.stdout: "event": "throttled", 2023-08-01T19:55:41.070 INFO:teuthology.orchestra.run.smithi155.stdout: "time": "2023-08-01T19:55:41.047132+0000", 2023-08-01T19:55:41.070 INFO:teuthology.orchestra.run.smithi155.stdout: "duration": 0 2023-08-01T19:55:41.070 INFO:teuthology.orchestra.run.smithi155.stdout: }, 2023-08-01T19:55:41.070 INFO:teuthology.orchestra.run.smithi155.stdout: { 2023-08-01T19:55:41.071 INFO:teuthology.orchestra.run.smithi155.stdout: "event": "header_read", 2023-08-01T19:55:41.071 INFO:teuthology.orchestra.run.smithi155.stdout: "time": "2023-08-01T19:55:41.047131+0000", 2023-08-01T19:55:41.071 INFO:teuthology.orchestra.run.smithi155.stdout: "duration": 4294967295.9999995 2023-08-01T19:55:41.071 INFO:teuthology.orchestra.run.smithi155.stdout: }, 2023-08-01T19:55:41.071 INFO:teuthology.orchestra.run.smithi155.stdout: { 2023-08-01T19:55:41.071 INFO:teuthology.orchestra.run.smithi155.stdout: "event": "all_read", 2023-08-01T19:55:41.071 INFO:teuthology.orchestra.run.smithi155.stdout: "time": "2023-08-01T19:55:41.047134+0000", 2023-08-01T19:55:41.072 INFO:teuthology.orchestra.run.smithi155.stdout: "duration": 2.689e-06 2023-08-01T19:55:41.072 INFO:teuthology.orchestra.run.smithi155.stdout: }, 2023-08-01T19:55:41.072 INFO:teuthology.orchestra.run.smithi155.stdout: { 2023-08-01T19:55:41.072 INFO:teuthology.orchestra.run.smithi155.stdout: "event": "dispatched", 2023-08-01T19:55:41.072 INFO:teuthology.orchestra.run.smithi155.stdout: "time": "2023-08-01T19:55:41.047140+0000", 2023-08-01T19:55:41.072 INFO:teuthology.orchestra.run.smithi155.stdout: "duration": 6.144e-06 2023-08-01T19:55:41.072 INFO:teuthology.orchestra.run.smithi155.stdout: }, 2023-08-01T19:55:41.072 INFO:teuthology.orchestra.run.smithi155.stdout: { 2023-08-01T19:55:41.073 INFO:teuthology.orchestra.run.smithi155.stdout: "event": "queued_for_pg", 2023-08-01T19:55:41.073 INFO:teuthology.orchestra.run.smithi155.stdout: "time": "2023-08-01T19:55:41.047145+0000", 2023-08-01T19:55:41.073 INFO:teuthology.orchestra.run.smithi155.stdout: "duration": 5.0309999999999998e-06 2023-08-01T19:55:41.073 INFO:teuthology.orchestra.run.smithi155.stdout: }, 2023-08-01T19:55:41.073 INFO:teuthology.orchestra.run.smithi155.stdout: { 2023-08-01T19:55:41.073 INFO:teuthology.orchestra.run.smithi155.stdout: "event": "reached_pg", 2023-08-01T19:55:41.073 INFO:teuthology.orchestra.run.smithi155.stdout: "time": "2023-08-01T19:55:41.048315+0000", 2023-08-01T19:55:41.073 INFO:teuthology.orchestra.run.smithi155.stdout: "duration": 0.001170255 2023-08-01T19:55:41.074 INFO:teuthology.orchestra.run.smithi155.stdout: }, 2023-08-01T19:55:41.074 INFO:teuthology.orchestra.run.smithi155.stdout: { 2023-08-01T19:55:41.074 INFO:teuthology.orchestra.run.smithi155.stdout: "event": "started", 2023-08-01T19:55:41.074 INFO:teuthology.orchestra.run.smithi155.stdout: "time": "2023-08-01T19:55:41.048427+0000", 2023-08-01T19:55:41.074 INFO:teuthology.orchestra.run.smithi155.stdout: "duration": 0.000111842 2023-08-01T19:55:41.074 INFO:teuthology.orchestra.run.smithi155.stdout: }, 2023-08-01T19:55:41.074 INFO:teuthology.orchestra.run.smithi155.stdout: { 2023-08-01T19:55:41.074 INFO:teuthology.orchestra.run.smithi155.stdout: "event": "waiting for subops from 0", 2023-08-01T19:55:41.075 INFO:teuthology.orchestra.run.smithi155.stdout: "time": "2023-08-01T19:55:41.048530+0000", 2023-08-01T19:55:41.075 INFO:teuthology.orchestra.run.smithi155.stdout: "duration": 0.000102848 2023-08-01T19:55:41.075 INFO:teuthology.orchestra.run.smithi155.stdout: } 2023-08-01T19:55:41.075 INFO:teuthology.orchestra.run.smithi155.stdout: ] 2023-08-01T19:55:41.075 INFO:teuthology.orchestra.run.smithi155.stdout: } 2023-08-01T19:55:41.075 INFO:teuthology.orchestra.run.smithi155.stdout: }, 2023-08-01T19:55:41.075 INFO:teuthology.orchestra.run.smithi155.stdout: { 2023-08-01T19:55:41.075 INFO:teuthology.orchestra.run.smithi155.stdout: "description": "osd_op(client.4668.0:165736 5.4 5:20872743:::benchmark_data_smithi006_114134_object32075:head [delete] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e51)", 2023-08-01T19:55:41.076 INFO:teuthology.orchestra.run.smithi155.stdout: "initiated_at": "2023-08-01T19:55:41.047154+0000", 2023-08-01T19:55:41.076 INFO:teuthology.orchestra.run.smithi155.stdout: "age": 0.0023343460000000002, 2023-08-01T19:55:41.076 INFO:teuthology.orchestra.run.smithi155.stdout: "duration": 0.0026110870000000002, 2023-08-01T19:55:41.076 INFO:teuthology.orchestra.run.smithi155.stdout: "type_data": { 2023-08-01T19:55:41.076 INFO:teuthology.orchestra.run.smithi155.stdout: "flag_point": "waiting for sub ops", 2023-08-01T19:55:41.076 INFO:teuthology.orchestra.run.smithi155.stdout: "client_info": { 2023-08-01T19:55:41.076 INFO:teuthology.orchestra.run.smithi155.stdout: "client": "client.4668", 2023-08-01T19:55:41.077 INFO:teuthology.orchestra.run.smithi155.stdout: "client_addr": "172.21.15.6:0/1709472247", 2023-08-01T19:55:41.077 INFO:teuthology.orchestra.run.smithi155.stdout: "tid": 165736 2023-08-01T19:55:41.077 INFO:teuthology.orchestra.run.smithi155.stdout: }, 2023-08-01T19:55:41.077 INFO:teuthology.orchestra.run.smithi155.stdout: "events": [ 2023-08-01T19:55:41.077 INFO:teuthology.orchestra.run.smithi155.stdout: { 2023-08-01T19:55:41.077 INFO:teuthology.orchestra.run.smithi155.stdout: "event": "initiated", 2023-08-01T19:55:41.077 INFO:teuthology.orchestra.run.smithi155.stdout: "time": "2023-08-01T19:55:41.047154+0000", 2023-08-01T19:55:41.077 INFO:teuthology.orchestra.run.smithi155.stdout: "duration": 0 2023-08-01T19:55:41.078 INFO:teuthology.orchestra.run.smithi155.stdout: }, 2023-08-01T19:55:41.078 INFO:teuthology.orchestra.run.smithi155.stdout: { 2023-08-01T19:55:41.078 INFO:teuthology.orchestra.run.smithi155.stdout: "event": "throttled", 2023-08-01T19:55:41.078 INFO:teuthology.orchestra.run.smithi155.stdout: "time": "2023-08-01T19:55:41.047154+0000", 2023-08-01T19:55:41.078 INFO:teuthology.orchestra.run.smithi155.stdout: "duration": 0 2023-08-01T19:55:41.078 INFO:teuthology.orchestra.run.smithi155.stdout: }, 2023-08-01T19:55:41.078 INFO:teuthology.orchestra.run.smithi155.stdout: { 2023-08-01T19:55:41.079 INFO:teuthology.orchestra.run.smithi155.stdout: "event": "header_read", 2023-08-01T19:55:41.079 INFO:teuthology.orchestra.run.smithi155.stdout: "time": "2023-08-01T19:55:41.047154+0000", 2023-08-01T19:55:41.079 INFO:teuthology.orchestra.run.smithi155.stdout: "duration": 4294967295.9999995 2023-08-01T19:55:41.079 INFO:teuthology.orchestra.run.smithi155.stdout: }, 2023-08-01T19:55:41.079 INFO:teuthology.orchestra.run.smithi155.stdout: { 2023-08-01T19:55:41.079 INFO:teuthology.orchestra.run.smithi155.stdout: "event": "all_read", 2023-08-01T19:55:41.079 INFO:teuthology.orchestra.run.smithi155.stdout: "time": "2023-08-01T19:55:41.047157+0000", 2023-08-01T19:55:41.079 INFO:teuthology.orchestra.run.smithi155.stdout: "duration": 2.6800000000000002e-06 2023-08-01T19:55:41.080 INFO:teuthology.orchestra.run.smithi155.stdout: }, 2023-08-01T19:55:41.080 INFO:teuthology.orchestra.run.smithi155.stdout: { 2023-08-01T19:55:41.080 INFO:teuthology.orchestra.run.smithi155.stdout: "event": "dispatched", 2023-08-01T19:55:41.080 INFO:teuthology.orchestra.run.smithi155.stdout: "time": "2023-08-01T19:55:41.047162+0000", 2023-08-01T19:55:41.080 INFO:teuthology.orchestra.run.smithi155.stdout: "duration": 5.4709999999999998e-06 2023-08-01T19:55:41.080 INFO:teuthology.orchestra.run.smithi155.stdout: }, 2023-08-01T19:55:41.080 INFO:teuthology.orchestra.run.smithi155.stdout: { 2023-08-01T19:55:41.081 INFO:teuthology.orchestra.run.smithi155.stdout: "event": "queued_for_pg", 2023-08-01T19:55:41.081 INFO:teuthology.orchestra.run.smithi155.stdout: "time": "2023-08-01T19:55:41.047165+0000", 2023-08-01T19:55:41.081 INFO:teuthology.orchestra.run.smithi155.stdout: "duration": 2.334e-06 2023-08-01T19:55:41.081 INFO:teuthology.orchestra.run.smithi155.stdout: }, 2023-08-01T19:55:41.081 INFO:teuthology.orchestra.run.smithi155.stdout: { 2023-08-01T19:55:41.081 INFO:teuthology.orchestra.run.smithi155.stdout: "event": "reached_pg", 2023-08-01T19:55:41.081 INFO:teuthology.orchestra.run.smithi155.stdout: "time": "2023-08-01T19:55:41.047196+0000", 2023-08-01T19:55:41.081 INFO:teuthology.orchestra.run.smithi155.stdout: "duration": 3.1322000000000003e-05 2023-08-01T19:55:41.082 INFO:teuthology.orchestra.run.smithi155.stdout: }, 2023-08-01T19:55:41.082 INFO:teuthology.orchestra.run.smithi155.stdout: { 2023-08-01T19:55:41.082 INFO:teuthology.orchestra.run.smithi155.stdout: "event": "started", 2023-08-01T19:55:41.082 INFO:teuthology.orchestra.run.smithi155.stdout: "time": "2023-08-01T19:55:41.047280+0000", 2023-08-01T19:55:41.082 INFO:teuthology.orchestra.run.smithi155.stdout: "duration": 8.3768000000000002e-05 2023-08-01T19:55:41.082 INFO:teuthology.orchestra.run.smithi155.stdout: }, 2023-08-01T19:55:41.082 INFO:teuthology.orchestra.run.smithi155.stdout: { 2023-08-01T19:55:41.082 INFO:teuthology.orchestra.run.smithi155.stdout: "event": "waiting for subops from 0", 2023-08-01T19:55:41.083 INFO:teuthology.orchestra.run.smithi155.stdout: "time": "2023-08-01T19:55:41.047346+0000", 2023-08-01T19:55:41.083 INFO:teuthology.orchestra.run.smithi155.stdout: "duration": 6.6216000000000004e-05 2023-08-01T19:55:41.083 INFO:teuthology.orchestra.run.smithi155.stdout: } 2023-08-01T19:55:41.083 INFO:teuthology.orchestra.run.smithi155.stdout: ] 2023-08-01T19:55:41.083 INFO:teuthology.orchestra.run.smithi155.stdout: } 2023-08-01T19:55:41.083 INFO:teuthology.orchestra.run.smithi155.stdout: }, 2023-08-01T19:55:41.083 INFO:teuthology.orchestra.run.smithi155.stdout: { 2023-08-01T19:55:41.084 INFO:teuthology.orchestra.run.smithi155.stdout: "description": "osd_repop(client.4668.0:165735 5.a e51/19 5:5a04d5ba:::benchmark_data_smithi006_114134_object32074:head v 51'10260, mlcod=51'10258)", 2023-08-01T19:55:41.084 INFO:teuthology.orchestra.run.smithi155.stdout: "initiated_at": "2023-08-01T19:55:41.047448+0000", 2023-08-01T19:55:41.084 INFO:teuthology.orchestra.run.smithi155.stdout: "age": 0.0020407720000000002, 2023-08-01T19:55:41.084 INFO:teuthology.orchestra.run.smithi155.stdout: "duration": 0.0023980059999999998, 2023-08-01T19:55:41.084 INFO:teuthology.orchestra.run.smithi155.stdout: "type_data": { 2023-08-01T19:55:41.084 INFO:teuthology.orchestra.run.smithi155.stdout: "flag_point": "started", 2023-08-01T19:55:41.085 INFO:teuthology.orchestra.run.smithi155.stdout: "events": [ 2023-08-01T19:55:41.085 INFO:teuthology.orchestra.run.smithi155.stdout: { 2023-08-01T19:55:41.085 INFO:teuthology.orchestra.run.smithi155.stdout: "event": "initiated", 2023-08-01T19:55:41.085 INFO:teuthology.orchestra.run.smithi155.stdout: "time": "2023-08-01T19:55:41.047448+0000", 2023-08-01T19:55:41.085 INFO:teuthology.orchestra.run.smithi155.stdout: "duration": 0 2023-08-01T19:55:41.085 INFO:teuthology.orchestra.run.smithi155.stdout: }, 2023-08-01T19:55:41.085 INFO:teuthology.orchestra.run.smithi155.stdout: { 2023-08-01T19:55:41.085 INFO:teuthology.orchestra.run.smithi155.stdout: "event": "throttled", 2023-08-01T19:55:41.086 INFO:teuthology.orchestra.run.smithi155.stdout: "time": "2023-08-01T19:55:41.047448+0000", 2023-08-01T19:55:41.086 INFO:teuthology.orchestra.run.smithi155.stdout: "duration": 0 2023-08-01T19:55:41.086 INFO:teuthology.orchestra.run.smithi155.stdout: }, 2023-08-01T19:55:41.086 INFO:teuthology.orchestra.run.smithi155.stdout: { 2023-08-01T19:55:41.086 INFO:teuthology.orchestra.run.smithi155.stdout: "event": "header_read", 2023-08-01T19:55:41.086 INFO:teuthology.orchestra.run.smithi155.stdout: "time": "2023-08-01T19:55:41.047447+0000", 2023-08-01T19:55:41.086 INFO:teuthology.orchestra.run.smithi155.stdout: "duration": 4294967295.9999995 2023-08-01T19:55:41.086 INFO:teuthology.orchestra.run.smithi155.stdout: }, 2023-08-01T19:55:41.087 INFO:teuthology.orchestra.run.smithi155.stdout: { 2023-08-01T19:55:41.087 INFO:teuthology.orchestra.run.smithi155.stdout: "event": "all_read", 2023-08-01T19:55:41.087 INFO:teuthology.orchestra.run.smithi155.stdout: "time": "2023-08-01T19:55:41.047454+0000", 2023-08-01T19:55:41.087 INFO:teuthology.orchestra.run.smithi155.stdout: "duration": 6.1099999999999999e-06 2023-08-01T19:55:41.087 INFO:teuthology.orchestra.run.smithi155.stdout: }, 2023-08-01T19:55:41.087 INFO:teuthology.orchestra.run.smithi155.stdout: { 2023-08-01T19:55:41.087 INFO:teuthology.orchestra.run.smithi155.stdout: "event": "dispatched", 2023-08-01T19:55:41.088 INFO:teuthology.orchestra.run.smithi155.stdout: "time": "2023-08-01T19:55:41.047463+0000", 2023-08-01T19:55:41.088 INFO:teuthology.orchestra.run.smithi155.stdout: "duration": 8.9940000000000006e-06 2023-08-01T19:55:41.088 INFO:teuthology.orchestra.run.smithi155.stdout: }, 2023-08-01T19:55:41.088 INFO:teuthology.orchestra.run.smithi155.stdout: { 2023-08-01T19:55:41.088 INFO:teuthology.orchestra.run.smithi155.stdout: "event": "queued_for_pg", 2023-08-01T19:55:41.088 INFO:teuthology.orchestra.run.smithi155.stdout: "time": "2023-08-01T19:55:41.047468+0000", 2023-08-01T19:55:41.088 INFO:teuthology.orchestra.run.smithi155.stdout: "duration": 4.9629999999999997e-06 2023-08-01T19:55:41.088 INFO:teuthology.orchestra.run.smithi155.stdout: }, 2023-08-01T19:55:41.089 INFO:teuthology.orchestra.run.smithi155.stdout: { 2023-08-01T19:55:41.089 INFO:teuthology.orchestra.run.smithi155.stdout: "event": "reached_pg", 2023-08-01T19:55:41.089 INFO:teuthology.orchestra.run.smithi155.stdout: "time": "2023-08-01T19:55:41.047501+0000", 2023-08-01T19:55:41.089 INFO:teuthology.orchestra.run.smithi155.stdout: "duration": 3.3281999999999997e-05 2023-08-01T19:55:41.089 INFO:teuthology.orchestra.run.smithi155.stdout: }, 2023-08-01T19:55:41.089 INFO:teuthology.orchestra.run.smithi155.stdout: { 2023-08-01T19:55:41.089 INFO:teuthology.orchestra.run.smithi155.stdout: "event": "started", 2023-08-01T19:55:41.089 INFO:teuthology.orchestra.run.smithi155.stdout: "time": "2023-08-01T19:55:41.047522+0000", 2023-08-01T19:55:41.090 INFO:teuthology.orchestra.run.smithi155.stdout: "duration": 2.1463000000000001e-05 2023-08-01T19:55:41.090 INFO:teuthology.orchestra.run.smithi155.stdout: } 2023-08-01T19:55:41.090 INFO:teuthology.orchestra.run.smithi155.stdout: ] 2023-08-01T19:55:41.090 INFO:teuthology.orchestra.run.smithi155.stdout: } 2023-08-01T19:55:41.090 INFO:teuthology.orchestra.run.smithi155.stdout: }, 2023-08-01T19:55:41.090 INFO:teuthology.orchestra.run.smithi155.stdout: { 2023-08-01T19:55:41.090 INFO:teuthology.orchestra.run.smithi155.stdout: "description": "osd_repop_reply(client.4668.0:165722 5.9 e51/40 ondisk, result = 0)", 2023-08-01T19:55:41.090 INFO:teuthology.orchestra.run.smithi155.stdout: "initiated_at": "2023-08-01T19:55:41.049827+0000", 2023-08-01T19:55:41.091 INFO:teuthology.orchestra.run.smithi155.stdout: "age": 4294967295.9996614, 2023-08-01T19:55:41.091 INFO:teuthology.orchestra.run.smithi155.stdout: "duration": 8.7041999999999998e-05, 2023-08-01T19:55:41.091 INFO:teuthology.orchestra.run.smithi155.stdout: "type_data": { 2023-08-01T19:55:41.091 INFO:teuthology.orchestra.run.smithi155.stdout: "flag_point": "started", 2023-08-01T19:55:41.091 INFO:teuthology.orchestra.run.smithi155.stdout: "events": [ 2023-08-01T19:55:41.091 INFO:teuthology.orchestra.run.smithi155.stdout: { 2023-08-01T19:55:41.091 INFO:teuthology.orchestra.run.smithi155.stdout: "event": "initiated", 2023-08-01T19:55:41.092 INFO:teuthology.orchestra.run.smithi155.stdout: "time": "2023-08-01T19:55:41.049827+0000", 2023-08-01T19:55:41.092 INFO:teuthology.orchestra.run.smithi155.stdout: "duration": 0 2023-08-01T19:55:41.092 INFO:teuthology.orchestra.run.smithi155.stdout: }, 2023-08-01T19:55:41.092 INFO:teuthology.orchestra.run.smithi155.stdout: { 2023-08-01T19:55:41.092 INFO:teuthology.orchestra.run.smithi155.stdout: "event": "throttled", 2023-08-01T19:55:41.092 INFO:teuthology.orchestra.run.smithi155.stdout: "time": "2023-08-01T19:55:41.049827+0000", 2023-08-01T19:55:41.093 INFO:teuthology.orchestra.run.smithi155.stdout: "duration": 0 2023-08-01T19:55:41.093 INFO:teuthology.orchestra.run.smithi155.stdout: }, 2023-08-01T19:55:41.093 INFO:teuthology.orchestra.run.smithi155.stdout: { 2023-08-01T19:55:41.093 INFO:teuthology.orchestra.run.smithi155.stdout: "event": "header_read", 2023-08-01T19:55:41.093 INFO:teuthology.orchestra.run.smithi155.stdout: "time": "2023-08-01T19:55:41.049827+0000", 2023-08-01T19:55:41.093 INFO:teuthology.orchestra.run.smithi155.stdout: "duration": 4294967295.9999995 2023-08-01T19:55:41.093 INFO:teuthology.orchestra.run.smithi155.stdout: }, 2023-08-01T19:55:41.093 INFO:teuthology.orchestra.run.smithi155.stdout: { 2023-08-01T19:55:41.094 INFO:teuthology.orchestra.run.smithi155.stdout: "event": "all_read", 2023-08-01T19:55:41.094 INFO:teuthology.orchestra.run.smithi155.stdout: "time": "2023-08-01T19:55:41.049830+0000", 2023-08-01T19:55:41.094 INFO:teuthology.orchestra.run.smithi155.stdout: "duration": 3.7270000000000001e-06 2023-08-01T19:55:41.094 INFO:teuthology.orchestra.run.smithi155.stdout: }, 2023-08-01T19:55:41.094 INFO:teuthology.orchestra.run.smithi155.stdout: { 2023-08-01T19:55:41.094 INFO:teuthology.orchestra.run.smithi155.stdout: "event": "dispatched", 2023-08-01T19:55:41.094 INFO:teuthology.orchestra.run.smithi155.stdout: "time": "2023-08-01T19:55:41.049841+0000", 2023-08-01T19:55:41.094 INFO:teuthology.orchestra.run.smithi155.stdout: "duration": 1.0468999999999999e-05 2023-08-01T19:55:41.095 INFO:teuthology.orchestra.run.smithi155.stdout: }, 2023-08-01T19:55:41.095 INFO:teuthology.orchestra.run.smithi155.stdout: { 2023-08-01T19:55:41.095 INFO:teuthology.orchestra.run.smithi155.stdout: "event": "queued_for_pg", 2023-08-01T19:55:41.095 INFO:teuthology.orchestra.run.smithi155.stdout: "time": "2023-08-01T19:55:41.049845+0000", 2023-08-01T19:55:41.095 INFO:teuthology.orchestra.run.smithi155.stdout: "duration": 3.6820000000000001e-06 2023-08-01T19:55:41.095 INFO:teuthology.orchestra.run.smithi155.stdout: }, 2023-08-01T19:55:41.095 INFO:teuthology.orchestra.run.smithi155.stdout: { 2023-08-01T19:55:41.095 INFO:teuthology.orchestra.run.smithi155.stdout: "event": "reached_pg", 2023-08-01T19:55:41.096 INFO:teuthology.orchestra.run.smithi155.stdout: "time": "2023-08-01T19:55:41.049877+0000", 2023-08-01T19:55:41.096 INFO:teuthology.orchestra.run.smithi155.stdout: "duration": 3.2342999999999998e-05 2023-08-01T19:55:41.096 INFO:teuthology.orchestra.run.smithi155.stdout: }, 2023-08-01T19:55:41.096 INFO:teuthology.orchestra.run.smithi155.stdout: { 2023-08-01T19:55:41.096 INFO:teuthology.orchestra.run.smithi155.stdout: "event": "started", 2023-08-01T19:55:41.096 INFO:teuthology.orchestra.run.smithi155.stdout: "time": "2023-08-01T19:55:41.049884+0000", 2023-08-01T19:55:41.096 INFO:teuthology.orchestra.run.smithi155.stdout: "duration": 7.0350000000000004e-06 2023-08-01T19:55:41.097 INFO:teuthology.orchestra.run.smithi155.stdout: } 2023-08-01T19:55:41.097 INFO:teuthology.orchestra.run.smithi155.stdout: ] 2023-08-01T19:55:41.097 INFO:teuthology.orchestra.run.smithi155.stdout: } 2023-08-01T19:55:41.097 INFO:teuthology.orchestra.run.smithi155.stdout: }, 2023-08-01T19:55:41.097 INFO:teuthology.orchestra.run.smithi155.stdout: { 2023-08-01T19:55:41.097 INFO:teuthology.orchestra.run.smithi155.stdout: "description": "osd_op(client.4668.0:165725 5.e 5:71e5d234:::benchmark_data_smithi006_114134_object32064:head [delete] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e51)", 2023-08-01T19:55:41.097 INFO:teuthology.orchestra.run.smithi155.stdout: "initiated_at": "2023-08-01T19:55:41.042310+0000", 2023-08-01T19:55:41.097 INFO:teuthology.orchestra.run.smithi155.stdout: "age": 0.0071791379999999998, 2023-08-01T19:55:41.098 INFO:teuthology.orchestra.run.smithi155.stdout: "duration": 0.0076900529999999996, 2023-08-01T19:55:41.098 INFO:teuthology.orchestra.run.smithi155.stdout: "type_data": { 2023-08-01T19:55:41.098 INFO:teuthology.orchestra.run.smithi155.stdout: "flag_point": "waiting for sub ops", 2023-08-01T19:55:41.098 INFO:teuthology.orchestra.run.smithi155.stdout: "client_info": { 2023-08-01T19:55:41.098 INFO:teuthology.orchestra.run.smithi155.stdout: "client": "client.4668", 2023-08-01T19:55:41.098 INFO:teuthology.orchestra.run.smithi155.stdout: "client_addr": "172.21.15.6:0/1709472247", 2023-08-01T19:55:41.098 INFO:teuthology.orchestra.run.smithi155.stdout: "tid": 165725 2023-08-01T19:55:41.098 INFO:teuthology.orchestra.run.smithi155.stdout: }, 2023-08-01T19:55:41.099 INFO:teuthology.orchestra.run.smithi155.stdout: "events": [ 2023-08-01T19:55:41.099 INFO:teuthology.orchestra.run.smithi155.stdout: { 2023-08-01T19:55:41.099 INFO:teuthology.orchestra.run.smithi155.stdout: "event": "initiated", 2023-08-01T19:55:41.099 INFO:teuthology.orchestra.run.smithi155.stdout: "time": "2023-08-01T19:55:41.042310+0000", 2023-08-01T19:55:41.099 INFO:teuthology.orchestra.run.smithi155.stdout: "duration": 0 2023-08-01T19:55:41.099 INFO:teuthology.orchestra.run.smithi155.stdout: }, 2023-08-01T19:55:41.099 INFO:teuthology.orchestra.run.smithi155.stdout: { 2023-08-01T19:55:41.099 INFO:teuthology.orchestra.run.smithi155.stdout: "event": "throttled", 2023-08-01T19:55:41.100 INFO:teuthology.orchestra.run.smithi155.stdout: "time": "2023-08-01T19:55:41.042310+0000", 2023-08-01T19:55:41.100 INFO:teuthology.orchestra.run.smithi155.stdout: "duration": 0 2023-08-01T19:55:41.100 INFO:teuthology.orchestra.run.smithi155.stdout: }, 2023-08-01T19:55:41.100 INFO:teuthology.orchestra.run.smithi155.stdout: { 2023-08-01T19:55:41.100 INFO:teuthology.orchestra.run.smithi155.stdout: "event": "header_read", 2023-08-01T19:55:41.100 INFO:teuthology.orchestra.run.smithi155.stdout: "time": "2023-08-01T19:55:41.042309+0000", 2023-08-01T19:55:41.100 INFO:teuthology.orchestra.run.smithi155.stdout: "duration": 4294967295.9999995 2023-08-01T19:55:41.101 INFO:teuthology.orchestra.run.smithi155.stdout: }, 2023-08-01T19:55:41.101 INFO:teuthology.orchestra.run.smithi155.stdout: { 2023-08-01T19:55:41.101 INFO:teuthology.orchestra.run.smithi155.stdout: "event": "all_read", 2023-08-01T19:55:41.101 INFO:teuthology.orchestra.run.smithi155.stdout: "time": "2023-08-01T19:55:41.042312+0000", 2023-08-01T19:55:41.101 INFO:teuthology.orchestra.run.smithi155.stdout: "duration": 2.6910000000000002e-06 2023-08-01T19:55:41.101 INFO:teuthology.orchestra.run.smithi155.stdout: }, 2023-08-01T19:55:41.101 INFO:teuthology.orchestra.run.smithi155.stdout: { 2023-08-01T19:55:41.101 INFO:teuthology.orchestra.run.smithi155.stdout: "event": "dispatched", 2023-08-01T19:55:41.102 INFO:teuthology.orchestra.run.smithi155.stdout: "time": "2023-08-01T19:55:41.042319+0000", 2023-08-01T19:55:41.102 INFO:teuthology.orchestra.run.smithi155.stdout: "duration": 6.759e-06 2023-08-01T19:55:41.102 INFO:teuthology.orchestra.run.smithi155.stdout: }, 2023-08-01T19:55:41.102 INFO:teuthology.orchestra.run.smithi155.stdout: { 2023-08-01T19:55:41.102 INFO:teuthology.orchestra.run.smithi155.stdout: "event": "queued_for_pg", 2023-08-01T19:55:41.102 INFO:teuthology.orchestra.run.smithi155.stdout: "time": "2023-08-01T19:55:41.042323+0000", 2023-08-01T19:55:41.102 INFO:teuthology.orchestra.run.smithi155.stdout: "duration": 4.1749999999999998e-06 2023-08-01T19:55:41.102 INFO:teuthology.orchestra.run.smithi155.stdout: }, 2023-08-01T19:55:41.103 INFO:teuthology.orchestra.run.smithi155.stdout: { 2023-08-01T19:55:41.103 INFO:teuthology.orchestra.run.smithi155.stdout: "event": "reached_pg", 2023-08-01T19:55:41.103 INFO:teuthology.orchestra.run.smithi155.stdout: "time": "2023-08-01T19:55:41.044540+0000", 2023-08-01T19:55:41.103 INFO:teuthology.orchestra.run.smithi155.stdout: "duration": 0.002217082 2023-08-01T19:55:41.103 INFO:teuthology.orchestra.run.smithi155.stdout: }, 2023-08-01T19:55:41.103 INFO:teuthology.orchestra.run.smithi155.stdout: { 2023-08-01T19:55:41.103 INFO:teuthology.orchestra.run.smithi155.stdout: "event": "started", 2023-08-01T19:55:41.103 INFO:teuthology.orchestra.run.smithi155.stdout: "time": "2023-08-01T19:55:41.044649+0000", 2023-08-01T19:55:41.104 INFO:teuthology.orchestra.run.smithi155.stdout: "duration": 0.0001091 2023-08-01T19:55:41.104 INFO:teuthology.orchestra.run.smithi155.stdout: }, 2023-08-01T19:55:41.104 INFO:teuthology.orchestra.run.smithi155.stdout: { 2023-08-01T19:55:41.104 INFO:teuthology.orchestra.run.smithi155.stdout: "event": "waiting for subops from 0", 2023-08-01T19:55:41.104 INFO:teuthology.orchestra.run.smithi155.stdout: "time": "2023-08-01T19:55:41.044716+0000", 2023-08-01T19:55:41.104 INFO:teuthology.orchestra.run.smithi155.stdout: "duration": 6.6709000000000001e-05 2023-08-01T19:55:41.104 INFO:teuthology.orchestra.run.smithi155.stdout: } 2023-08-01T19:55:41.105 INFO:teuthology.orchestra.run.smithi155.stdout: ] 2023-08-01T19:55:41.105 INFO:teuthology.orchestra.run.smithi155.stdout: } 2023-08-01T19:55:41.105 INFO:teuthology.orchestra.run.smithi155.stdout: }, 2023-08-01T19:55:41.105 INFO:teuthology.orchestra.run.smithi155.stdout: { 2023-08-01T19:55:41.105 INFO:teuthology.orchestra.run.smithi155.stdout: "description": "osd_op(client.4668.0:165726 5.8 5:1cfd626e:::benchmark_data_smithi006_114134_object32065:head [delete] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e51)", 2023-08-01T19:55:41.105 INFO:teuthology.orchestra.run.smithi155.stdout: "initiated_at": "2023-08-01T19:55:41.042328+0000", 2023-08-01T19:55:41.105 INFO:teuthology.orchestra.run.smithi155.stdout: "age": 0.0071609459999999996, 2023-08-01T19:55:41.105 INFO:teuthology.orchestra.run.smithi155.stdout: "duration": 0.0077671090000000003, 2023-08-01T19:55:41.106 INFO:teuthology.orchestra.run.smithi155.stdout: "type_data": { 2023-08-01T19:55:41.106 INFO:teuthology.orchestra.run.smithi155.stdout: "flag_point": "waiting for sub ops", 2023-08-01T19:55:41.106 INFO:teuthology.orchestra.run.smithi155.stdout: "client_info": { 2023-08-01T19:55:41.106 INFO:teuthology.orchestra.run.smithi155.stdout: "client": "client.4668", 2023-08-01T19:55:41.106 INFO:teuthology.orchestra.run.smithi155.stdout: "client_addr": "172.21.15.6:0/1709472247", 2023-08-01T19:55:41.106 INFO:teuthology.orchestra.run.smithi155.stdout: "tid": 165726 2023-08-01T19:55:41.106 INFO:teuthology.orchestra.run.smithi155.stdout: }, 2023-08-01T19:55:41.106 INFO:teuthology.orchestra.run.smithi155.stdout: "events": [ 2023-08-01T19:55:41.107 INFO:teuthology.orchestra.run.smithi155.stdout: { 2023-08-01T19:55:41.107 INFO:teuthology.orchestra.run.smithi155.stdout: "event": "initiated", 2023-08-01T19:55:41.107 INFO:teuthology.orchestra.run.smithi155.stdout: "time": "2023-08-01T19:55:41.042328+0000", 2023-08-01T19:55:41.107 INFO:teuthology.orchestra.run.smithi155.stdout: "duration": 0 2023-08-01T19:55:41.107 INFO:teuthology.orchestra.run.smithi155.stdout: }, 2023-08-01T19:55:41.107 INFO:teuthology.orchestra.run.smithi155.stdout: { 2023-08-01T19:55:41.107 INFO:teuthology.orchestra.run.smithi155.stdout: "event": "throttled", 2023-08-01T19:55:41.107 INFO:teuthology.orchestra.run.smithi155.stdout: "time": "2023-08-01T19:55:41.042328+0000", 2023-08-01T19:55:41.108 INFO:teuthology.orchestra.run.smithi155.stdout: "duration": 0 2023-08-01T19:55:41.108 INFO:teuthology.orchestra.run.smithi155.stdout: }, 2023-08-01T19:55:41.108 INFO:teuthology.orchestra.run.smithi155.stdout: { 2023-08-01T19:55:41.108 INFO:teuthology.orchestra.run.smithi155.stdout: "event": "header_read", 2023-08-01T19:55:41.108 INFO:teuthology.orchestra.run.smithi155.stdout: "time": "2023-08-01T19:55:41.042327+0000", 2023-08-01T19:55:41.108 INFO:teuthology.orchestra.run.smithi155.stdout: "duration": 4294967295.9999995 2023-08-01T19:55:41.108 INFO:teuthology.orchestra.run.smithi155.stdout: }, 2023-08-01T19:55:41.108 INFO:teuthology.orchestra.run.smithi155.stdout: { 2023-08-01T19:55:41.109 INFO:teuthology.orchestra.run.smithi155.stdout: "event": "all_read", 2023-08-01T19:55:41.109 INFO:teuthology.orchestra.run.smithi155.stdout: "time": "2023-08-01T19:55:41.042330+0000", 2023-08-01T19:55:41.109 INFO:teuthology.orchestra.run.smithi155.stdout: "duration": 2.4109999999999999e-06 2023-08-01T19:55:41.109 INFO:teuthology.orchestra.run.smithi155.stdout: }, 2023-08-01T19:55:41.109 INFO:teuthology.orchestra.run.smithi155.stdout: { 2023-08-01T19:55:41.109 INFO:teuthology.orchestra.run.smithi155.stdout: "event": "dispatched", 2023-08-01T19:55:41.109 INFO:teuthology.orchestra.run.smithi155.stdout: "time": "2023-08-01T19:55:41.042337+0000", 2023-08-01T19:55:41.110 INFO:teuthology.orchestra.run.smithi155.stdout: "duration": 6.6730000000000003e-06 2023-08-01T19:55:41.110 INFO:teuthology.orchestra.run.smithi155.stdout: }, 2023-08-01T19:55:41.110 INFO:teuthology.orchestra.run.smithi155.stdout: { 2023-08-01T19:55:41.110 INFO:teuthology.orchestra.run.smithi155.stdout: "event": "queued_for_pg", 2023-08-01T19:55:41.110 INFO:teuthology.orchestra.run.smithi155.stdout: "time": "2023-08-01T19:55:41.042340+0000", 2023-08-01T19:55:41.110 INFO:teuthology.orchestra.run.smithi155.stdout: "duration": 3.856e-06 2023-08-01T19:55:41.110 INFO:teuthology.orchestra.run.smithi155.stdout: }, 2023-08-01T19:55:41.110 INFO:teuthology.orchestra.run.smithi155.stdout: { 2023-08-01T19:55:41.111 INFO:teuthology.orchestra.run.smithi155.stdout: "event": "reached_pg", 2023-08-01T19:55:41.111 INFO:teuthology.orchestra.run.smithi155.stdout: "time": "2023-08-01T19:55:41.042376+0000", 2023-08-01T19:55:41.111 INFO:teuthology.orchestra.run.smithi155.stdout: "duration": 3.5407000000000002e-05 2023-08-01T19:55:41.111 INFO:teuthology.orchestra.run.smithi155.stdout: }, 2023-08-01T19:55:41.111 INFO:teuthology.orchestra.run.smithi155.stdout: { 2023-08-01T19:55:41.111 INFO:teuthology.orchestra.run.smithi155.stdout: "event": "started", 2023-08-01T19:55:41.111 INFO:teuthology.orchestra.run.smithi155.stdout: "time": "2023-08-01T19:55:41.042471+0000", 2023-08-01T19:55:41.111 INFO:teuthology.orchestra.run.smithi155.stdout: "duration": 9.5672000000000002e-05 2023-08-01T19:55:41.112 INFO:teuthology.orchestra.run.smithi155.stdout: }, 2023-08-01T19:55:41.112 INFO:teuthology.orchestra.run.smithi155.stdout: { 2023-08-01T19:55:41.112 INFO:teuthology.orchestra.run.smithi155.stdout: "event": "waiting for subops from 0", 2023-08-01T19:55:41.112 INFO:teuthology.orchestra.run.smithi155.stdout: "time": "2023-08-01T19:55:41.042538+0000", 2023-08-01T19:55:41.112 INFO:teuthology.orchestra.run.smithi155.stdout: "duration": 6.6674999999999994e-05 2023-08-01T19:55:41.113 INFO:teuthology.orchestra.run.smithi155.stdout: }, 2023-08-01T19:55:41.113 INFO:teuthology.orchestra.run.smithi155.stdout: { 2023-08-01T19:55:41.113 INFO:teuthology.orchestra.run.smithi155.stdout: "event": "op_commit", 2023-08-01T19:55:41.113 INFO:teuthology.orchestra.run.smithi155.stdout: "time": "2023-08-01T19:55:41.049348+0000", 2023-08-01T19:55:41.113 INFO:teuthology.orchestra.run.smithi155.stdout: "duration": 0.00681016 2023-08-01T19:55:41.113 INFO:teuthology.orchestra.run.smithi155.stdout: } 2023-08-01T19:55:41.113 INFO:teuthology.orchestra.run.smithi155.stdout: ] 2023-08-01T19:55:41.114 INFO:teuthology.orchestra.run.smithi155.stdout: } 2023-08-01T19:55:41.114 INFO:teuthology.orchestra.run.smithi155.stdout: }, 2023-08-01T19:55:41.114 INFO:teuthology.orchestra.run.smithi155.stdout: { 2023-08-01T19:55:41.114 INFO:teuthology.orchestra.run.smithi155.stdout: "description": "osd_op(client.4668.0:165728 5.0 5:081dae9c:::benchmark_data_smithi006_114134_object32067:head [delete] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e51)", 2023-08-01T19:55:41.114 INFO:teuthology.orchestra.run.smithi155.stdout: "initiated_at": "2023-08-01T19:55:41.044721+0000", 2023-08-01T19:55:41.114 INFO:teuthology.orchestra.run.smithi155.stdout: "age": 0.0047678490000000002, 2023-08-01T19:55:41.114 INFO:teuthology.orchestra.run.smithi155.stdout: "duration": 0.0054758460000000004, 2023-08-01T19:55:41.114 INFO:teuthology.orchestra.run.smithi155.stdout: "type_data": { 2023-08-01T19:55:41.115 INFO:teuthology.orchestra.run.smithi155.stdout: "flag_point": "waiting for sub ops", 2023-08-01T19:55:41.115 INFO:teuthology.orchestra.run.smithi155.stdout: "client_info": { 2023-08-01T19:55:41.115 INFO:teuthology.orchestra.run.smithi155.stdout: "client": "client.4668", 2023-08-01T19:55:41.115 INFO:teuthology.orchestra.run.smithi155.stdout: "client_addr": "172.21.15.6:0/1709472247", 2023-08-01T19:55:41.115 INFO:teuthology.orchestra.run.smithi155.stdout: "tid": 165728 2023-08-01T19:55:41.115 INFO:teuthology.orchestra.run.smithi155.stdout: }, 2023-08-01T19:55:41.115 INFO:teuthology.orchestra.run.smithi155.stdout: "events": [ 2023-08-01T19:55:41.116 INFO:teuthology.orchestra.run.smithi155.stdout: { 2023-08-01T19:55:41.116 INFO:teuthology.orchestra.run.smithi155.stdout: "event": "initiated", 2023-08-01T19:55:41.116 INFO:teuthology.orchestra.run.smithi155.stdout: "time": "2023-08-01T19:55:41.044721+0000", 2023-08-01T19:55:41.116 INFO:teuthology.orchestra.run.smithi155.stdout: "duration": 0 2023-08-01T19:55:41.116 INFO:teuthology.orchestra.run.smithi155.stdout: }, 2023-08-01T19:55:41.116 INFO:teuthology.orchestra.run.smithi155.stdout: { 2023-08-01T19:55:41.116 INFO:teuthology.orchestra.run.smithi155.stdout: "event": "throttled", 2023-08-01T19:55:41.116 INFO:teuthology.orchestra.run.smithi155.stdout: "time": "2023-08-01T19:55:41.044721+0000", 2023-08-01T19:55:41.117 INFO:teuthology.orchestra.run.smithi155.stdout: "duration": 0 2023-08-01T19:55:41.117 INFO:teuthology.orchestra.run.smithi155.stdout: }, 2023-08-01T19:55:41.117 INFO:teuthology.orchestra.run.smithi155.stdout: { 2023-08-01T19:55:41.117 INFO:teuthology.orchestra.run.smithi155.stdout: "event": "header_read", 2023-08-01T19:55:41.117 INFO:teuthology.orchestra.run.smithi155.stdout: "time": "2023-08-01T19:55:41.044720+0000", 2023-08-01T19:55:41.117 INFO:teuthology.orchestra.run.smithi155.stdout: "duration": 4294967295.999999 2023-08-01T19:55:41.117 INFO:teuthology.orchestra.run.smithi155.stdout: }, 2023-08-01T19:55:41.117 INFO:teuthology.orchestra.run.smithi155.stdout: { 2023-08-01T19:55:41.118 INFO:teuthology.orchestra.run.smithi155.stdout: "event": "all_read", 2023-08-01T19:55:41.118 INFO:teuthology.orchestra.run.smithi155.stdout: "time": "2023-08-01T19:55:41.044724+0000", 2023-08-01T19:55:41.118 INFO:teuthology.orchestra.run.smithi155.stdout: "duration": 4.2230000000000001e-06 2023-08-01T19:55:41.118 INFO:teuthology.orchestra.run.smithi155.stdout: }, 2023-08-01T19:55:41.118 INFO:teuthology.orchestra.run.smithi155.stdout: { 2023-08-01T19:55:41.118 INFO:teuthology.orchestra.run.smithi155.stdout: "event": "dispatched", 2023-08-01T19:55:41.118 INFO:teuthology.orchestra.run.smithi155.stdout: "time": "2023-08-01T19:55:41.044733+0000", 2023-08-01T19:55:41.118 INFO:teuthology.orchestra.run.smithi155.stdout: "duration": 8.1929999999999993e-06 2023-08-01T19:55:41.119 INFO:teuthology.orchestra.run.smithi155.stdout: }, 2023-08-01T19:55:41.119 INFO:teuthology.orchestra.run.smithi155.stdout: { 2023-08-01T19:55:41.119 INFO:teuthology.orchestra.run.smithi155.stdout: "event": "queued_for_pg", 2023-08-01T19:55:41.119 INFO:teuthology.orchestra.run.smithi155.stdout: "time": "2023-08-01T19:55:41.044737+0000", 2023-08-01T19:55:41.119 INFO:teuthology.orchestra.run.smithi155.stdout: "duration": 4.8019999999999999e-06 2023-08-01T19:55:41.119 INFO:teuthology.orchestra.run.smithi155.stdout: }, 2023-08-01T19:55:41.119 INFO:teuthology.orchestra.run.smithi155.stdout: { 2023-08-01T19:55:41.119 INFO:teuthology.orchestra.run.smithi155.stdout: "event": "reached_pg", 2023-08-01T19:55:41.120 INFO:teuthology.orchestra.run.smithi155.stdout: "time": "2023-08-01T19:55:41.044776+0000", 2023-08-01T19:55:41.120 INFO:teuthology.orchestra.run.smithi155.stdout: "duration": 3.9048000000000003e-05 2023-08-01T19:55:41.120 INFO:teuthology.orchestra.run.smithi155.stdout: }, 2023-08-01T19:55:41.120 INFO:teuthology.orchestra.run.smithi155.stdout: { 2023-08-01T19:55:41.120 INFO:teuthology.orchestra.run.smithi155.stdout: "event": "started", 2023-08-01T19:55:41.120 INFO:teuthology.orchestra.run.smithi155.stdout: "time": "2023-08-01T19:55:41.044883+0000", 2023-08-01T19:55:41.120 INFO:teuthology.orchestra.run.smithi155.stdout: "duration": 0.000106445 2023-08-01T19:55:41.121 INFO:teuthology.orchestra.run.smithi155.stdout: }, 2023-08-01T19:55:41.121 INFO:teuthology.orchestra.run.smithi155.stdout: { 2023-08-01T19:55:41.121 INFO:teuthology.orchestra.run.smithi155.stdout: "event": "waiting for subops from 0", 2023-08-01T19:55:41.121 INFO:teuthology.orchestra.run.smithi155.stdout: "time": "2023-08-01T19:55:41.044984+0000", 2023-08-01T19:55:41.121 INFO:teuthology.orchestra.run.smithi155.stdout: "duration": 0.000100647 2023-08-01T19:55:41.121 INFO:teuthology.orchestra.run.smithi155.stdout: } 2023-08-01T19:55:41.121 INFO:teuthology.orchestra.run.smithi155.stdout: ] 2023-08-01T19:55:41.121 INFO:teuthology.orchestra.run.smithi155.stdout: } 2023-08-01T19:55:41.122 INFO:teuthology.orchestra.run.smithi155.stdout: }, 2023-08-01T19:55:41.122 INFO:teuthology.orchestra.run.smithi155.stdout: { 2023-08-01T19:55:41.122 INFO:teuthology.orchestra.run.smithi155.stdout: "description": "osd_op(client.4668.0:165729 5.d 5:bf5385e2:::benchmark_data_smithi006_114134_object32068:head [delete] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e51)", 2023-08-01T19:55:41.122 INFO:teuthology.orchestra.run.smithi155.stdout: "initiated_at": "2023-08-01T19:55:41.044923+0000", 2023-08-01T19:55:41.122 INFO:teuthology.orchestra.run.smithi155.stdout: "age": 0.0045661629999999998, 2023-08-01T19:55:41.122 INFO:teuthology.orchestra.run.smithi155.stdout: "duration": 0.0053724710000000002, 2023-08-01T19:55:41.122 INFO:teuthology.orchestra.run.smithi155.stdout: "type_data": { 2023-08-01T19:55:41.122 INFO:teuthology.orchestra.run.smithi155.stdout: "flag_point": "waiting for sub ops", 2023-08-01T19:55:41.123 INFO:teuthology.orchestra.run.smithi155.stdout: "client_info": { 2023-08-01T19:55:41.123 INFO:teuthology.orchestra.run.smithi155.stdout: "client": "client.4668", 2023-08-01T19:55:41.123 INFO:teuthology.orchestra.run.smithi155.stdout: "client_addr": "172.21.15.6:0/1709472247", 2023-08-01T19:55:41.123 INFO:teuthology.orchestra.run.smithi155.stdout: "tid": 165729 2023-08-01T19:55:41.123 INFO:teuthology.orchestra.run.smithi155.stdout: }, 2023-08-01T19:55:41.123 INFO:teuthology.orchestra.run.smithi155.stdout: "events": [ 2023-08-01T19:55:41.123 INFO:teuthology.orchestra.run.smithi155.stdout: { 2023-08-01T19:55:41.123 INFO:teuthology.orchestra.run.smithi155.stdout: "event": "initiated", 2023-08-01T19:55:41.124 INFO:teuthology.orchestra.run.smithi155.stdout: "time": "2023-08-01T19:55:41.044923+0000", 2023-08-01T19:55:41.124 INFO:teuthology.orchestra.run.smithi155.stdout: "duration": 0 2023-08-01T19:55:41.124 INFO:teuthology.orchestra.run.smithi155.stdout: }, 2023-08-01T19:55:41.124 INFO:teuthology.orchestra.run.smithi155.stdout: { 2023-08-01T19:55:41.124 INFO:teuthology.orchestra.run.smithi155.stdout: "event": "throttled", 2023-08-01T19:55:41.124 INFO:teuthology.orchestra.run.smithi155.stdout: "time": "2023-08-01T19:55:41.044923+0000", 2023-08-01T19:55:41.124 INFO:teuthology.orchestra.run.smithi155.stdout: "duration": 0 2023-08-01T19:55:41.124 INFO:teuthology.orchestra.run.smithi155.stdout: }, 2023-08-01T19:55:41.125 INFO:teuthology.orchestra.run.smithi155.stdout: { 2023-08-01T19:55:41.125 INFO:teuthology.orchestra.run.smithi155.stdout: "event": "header_read", 2023-08-01T19:55:41.125 INFO:teuthology.orchestra.run.smithi155.stdout: "time": "2023-08-01T19:55:41.044922+0000", 2023-08-01T19:55:41.125 INFO:teuthology.orchestra.run.smithi155.stdout: "duration": 4294967295.9999995 2023-08-01T19:55:41.125 INFO:teuthology.orchestra.run.smithi155.stdout: }, 2023-08-01T19:55:41.125 INFO:teuthology.orchestra.run.smithi155.stdout: { 2023-08-01T19:55:41.125 INFO:teuthology.orchestra.run.smithi155.stdout: "event": "all_read", 2023-08-01T19:55:41.125 INFO:teuthology.orchestra.run.smithi155.stdout: "time": "2023-08-01T19:55:41.044927+0000", 2023-08-01T19:55:41.126 INFO:teuthology.orchestra.run.smithi155.stdout: "duration": 4.6369999999999998e-06 2023-08-01T19:55:41.126 INFO:teuthology.orchestra.run.smithi155.stdout: }, 2023-08-01T19:55:41.126 INFO:teuthology.orchestra.run.smithi155.stdout: { 2023-08-01T19:55:41.126 INFO:teuthology.orchestra.run.smithi155.stdout: "event": "dispatched", 2023-08-01T19:55:41.126 INFO:teuthology.orchestra.run.smithi155.stdout: "time": "2023-08-01T19:55:41.044935+0000", 2023-08-01T19:55:41.126 INFO:teuthology.orchestra.run.smithi155.stdout: "duration": 8.4290000000000001e-06 2023-08-01T19:55:41.126 INFO:teuthology.orchestra.run.smithi155.stdout: }, 2023-08-01T19:55:41.126 INFO:teuthology.orchestra.run.smithi155.stdout: { 2023-08-01T19:55:41.127 INFO:teuthology.orchestra.run.smithi155.stdout: "event": "queued_for_pg", 2023-08-01T19:55:41.127 INFO:teuthology.orchestra.run.smithi155.stdout: "time": "2023-08-01T19:55:41.044941+0000", 2023-08-01T19:55:41.127 INFO:teuthology.orchestra.run.smithi155.stdout: "duration": 5.5099999999999998e-06 2023-08-01T19:55:41.127 INFO:teuthology.orchestra.run.smithi155.stdout: }, 2023-08-01T19:55:41.127 INFO:teuthology.orchestra.run.smithi155.stdout: { 2023-08-01T19:55:41.127 INFO:teuthology.orchestra.run.smithi155.stdout: "event": "reached_pg", 2023-08-01T19:55:41.127 INFO:teuthology.orchestra.run.smithi155.stdout: "time": "2023-08-01T19:55:41.044987+0000", 2023-08-01T19:55:41.128 INFO:teuthology.orchestra.run.smithi155.stdout: "duration": 4.6609e-05 2023-08-01T19:55:41.128 INFO:teuthology.orchestra.run.smithi155.stdout: }, 2023-08-01T19:55:41.128 INFO:teuthology.orchestra.run.smithi155.stdout: { 2023-08-01T19:55:41.128 INFO:teuthology.orchestra.run.smithi155.stdout: "event": "started", 2023-08-01T19:55:41.128 INFO:teuthology.orchestra.run.smithi155.stdout: "time": "2023-08-01T19:55:41.045102+0000", 2023-08-01T19:55:41.128 INFO:teuthology.orchestra.run.smithi155.stdout: "duration": 0.000115346 2023-08-01T19:55:41.128 INFO:teuthology.orchestra.run.smithi155.stdout: }, 2023-08-01T19:55:41.128 INFO:teuthology.orchestra.run.smithi155.stdout: { 2023-08-01T19:55:41.129 INFO:teuthology.orchestra.run.smithi155.stdout: "event": "waiting for subops from 1", 2023-08-01T19:55:41.129 INFO:teuthology.orchestra.run.smithi155.stdout: "time": "2023-08-01T19:55:41.045225+0000", 2023-08-01T19:55:41.129 INFO:teuthology.orchestra.run.smithi155.stdout: "duration": 0.000122717 2023-08-01T19:55:41.129 INFO:teuthology.orchestra.run.smithi155.stdout: } 2023-08-01T19:55:41.129 INFO:teuthology.orchestra.run.smithi155.stdout: ] 2023-08-01T19:55:41.129 INFO:teuthology.orchestra.run.smithi155.stdout: } 2023-08-01T19:55:41.129 INFO:teuthology.orchestra.run.smithi155.stdout: } 2023-08-01T19:55:41.129 INFO:teuthology.orchestra.run.smithi155.stdout: ], 2023-08-01T19:55:41.130 INFO:teuthology.orchestra.run.smithi155.stdout: "num_ops": 10 2023-08-01T19:55:41.130 INFO:teuthology.orchestra.run.smithi155.stdout:} 2023-08-01T19:55:41.131 DEBUG:teuthology.orchestra.run.smithi155:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 30 ceph --cluster ceph --admin-daemon /var/run/ceph/ceph-osd.2.asok dump_blocked_ops 2023-08-01T19:55:41.131 INFO:tasks.ceph.osd.2.smithi155.stderr:2023-08-01T19:55:41.129+0000 7faa5c6ac700 -1 received signal: Hangup from /usr/bin/python3 /bin/daemon-helper kill ceph-osd -f --cluster ceph -i 2 (PID: 111337) UID: 0 2023-08-01T19:55:41.232 INFO:tasks.ceph.osd.2.smithi155.stderr:2023-08-01T19:55:41.230+0000 7faa5c6ac700 -1 received signal: Hangup from /usr/bin/python3 /bin/daemon-helper kill ceph-osd -f --cluster ceph -i 2 (PID: 111337) UID: 0 2023-08-01T19:55:41.333 INFO:tasks.ceph.osd.2.smithi155.stderr:2023-08-01T19:55:41.331+0000 7faa5c6ac700 -1 received signal: Hangup from /usr/bin/python3 /bin/daemon-helper kill ceph-osd -f --cluster ceph -i 2 (PID: 111337) UID: 0 2023-08-01T19:55:41.340 INFO:teuthology.orchestra.run.smithi155.stdout:{ 2023-08-01T19:55:41.340 INFO:teuthology.orchestra.run.smithi155.stdout: "ops": [], 2023-08-01T19:55:41.340 INFO:teuthology.orchestra.run.smithi155.stdout: "complaint_time": 30, 2023-08-01T19:55:41.340 INFO:teuthology.orchestra.run.smithi155.stdout: "num_blocked_ops": 0 2023-08-01T19:55:41.340 INFO:teuthology.orchestra.run.smithi155.stdout:} 2023-08-01T19:55:41.353 DEBUG:teuthology.orchestra.run.smithi155:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 30 ceph --cluster ceph --admin-daemon /var/run/ceph/ceph-osd.2.asok dump_historic_ops 2023-08-01T19:55:41.436 INFO:tasks.ceph.osd.2.smithi155.stderr:2023-08-01T19:55:41.435+0000 7faa5c6ac700 -1 received signal: Hangup from /usr/bin/python3 /bin/daemon-helper kill ceph-osd -f --cluster ceph -i 2 (PID: 111337) UID: 0 2023-08-01T19:55:41.535 INFO:tasks.ceph.osd.0.smithi008.stderr:2023-08-01T19:55:41.533+0000 7f16a58f4700 -1 received signal: Hangup from /usr/bin/python3 /bin/daemon-helper kill ceph-osd -f --cluster ceph -i 0 (PID: 111179) UID: 0 2023-08-01T19:55:41.572 DEBUG:teuthology.orchestra.run.smithi006:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 120 ceph --cluster ceph -- tell 'osd.*' injectargs --osd_enable_op_tracker=false 2023-08-01T19:55:41.574 INFO:teuthology.orchestra.run.smithi155.stdout:{ 2023-08-01T19:55:41.574 INFO:teuthology.orchestra.run.smithi155.stdout: "size": 20, 2023-08-01T19:55:41.574 INFO:teuthology.orchestra.run.smithi155.stdout: "duration": 600, 2023-08-01T19:55:41.574 INFO:teuthology.orchestra.run.smithi155.stdout: "ops": [ 2023-08-01T19:55:41.575 INFO:teuthology.orchestra.run.smithi155.stdout: { 2023-08-01T19:55:41.575 INFO:teuthology.orchestra.run.smithi155.stdout: "description": "osd_op(client.4668.0:73454 5.8 5:15596b2f:::benchmark_data_smithi006_114134_object73453:head [set-alloc-hint object_size 65536 write_size 65536,write 0~65536] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e31)", 2023-08-01T19:55:41.575 INFO:teuthology.orchestra.run.smithi155.stdout: "initiated_at": "2023-08-01T19:54:51.460020+0000", 2023-08-01T19:55:41.575 INFO:teuthology.orchestra.run.smithi155.stdout: "age": 50.111606078999998, 2023-08-01T19:55:41.575 INFO:teuthology.orchestra.run.smithi155.stdout: "duration": 0.022889436999999999, 2023-08-01T19:55:41.575 INFO:teuthology.orchestra.run.smithi155.stdout: "type_data": { 2023-08-01T19:55:41.575 INFO:teuthology.orchestra.run.smithi155.stdout: "flag_point": "commit sent; apply or cleanup", 2023-08-01T19:55:41.576 INFO:teuthology.orchestra.run.smithi155.stdout: "client_info": { 2023-08-01T19:55:41.576 INFO:teuthology.orchestra.run.smithi155.stdout: "client": "client.4668", 2023-08-01T19:55:41.576 INFO:teuthology.orchestra.run.smithi155.stdout: "client_addr": "172.21.15.6:0/1709472247", 2023-08-01T19:55:41.576 INFO:teuthology.orchestra.run.smithi155.stdout: "tid": 73454 2023-08-01T19:55:41.576 INFO:teuthology.orchestra.run.smithi155.stdout: }, 2023-08-01T19:55:41.576 INFO:teuthology.orchestra.run.smithi155.stdout: "events": [ 2023-08-01T19:55:41.576 INFO:teuthology.orchestra.run.smithi155.stdout: { 2023-08-01T19:55:41.576 INFO:teuthology.orchestra.run.smithi155.stdout: "event": "initiated", 2023-08-01T19:55:41.577 INFO:teuthology.orchestra.run.smithi155.stdout: "time": "2023-08-01T19:54:51.460020+0000", 2023-08-01T19:55:41.577 INFO:teuthology.orchestra.run.smithi155.stdout: "duration": 0 2023-08-01T19:55:41.577 INFO:teuthology.orchestra.run.smithi155.stdout: }, 2023-08-01T19:55:41.577 INFO:teuthology.orchestra.run.smithi155.stdout: { 2023-08-01T19:55:41.577 INFO:teuthology.orchestra.run.smithi155.stdout: "event": "throttled", 2023-08-01T19:55:41.577 INFO:teuthology.orchestra.run.smithi155.stdout: "time": "2023-08-01T19:54:51.460020+0000", 2023-08-01T19:55:41.577 INFO:teuthology.orchestra.run.smithi155.stdout: "duration": 0 2023-08-01T19:55:41.578 INFO:teuthology.orchestra.run.smithi155.stdout: }, 2023-08-01T19:55:41.578 INFO:teuthology.orchestra.run.smithi155.stdout: { 2023-08-01T19:55:41.578 INFO:teuthology.orchestra.run.smithi155.stdout: "event": "header_read", 2023-08-01T19:55:41.578 INFO:teuthology.orchestra.run.smithi155.stdout: "time": "2023-08-01T19:54:51.460019+0000", 2023-08-01T19:55:41.578 INFO:teuthology.orchestra.run.smithi155.stdout: "duration": 4294967295.9999995 2023-08-01T19:55:41.578 INFO:teuthology.orchestra.run.smithi155.stdout: }, 2023-08-01T19:55:41.578 INFO:teuthology.orchestra.run.smithi155.stdout: { 2023-08-01T19:55:41.578 INFO:teuthology.orchestra.run.smithi155.stdout: "event": "all_read", 2023-08-01T19:55:41.579 INFO:teuthology.orchestra.run.smithi155.stdout: "time": "2023-08-01T19:54:51.460051+0000", 2023-08-01T19:55:41.579 INFO:teuthology.orchestra.run.smithi155.stdout: "duration": 3.1736000000000002e-05 2023-08-01T19:55:41.579 INFO:teuthology.orchestra.run.smithi155.stdout: }, 2023-08-01T19:55:41.579 INFO:teuthology.orchestra.run.smithi155.stdout: { 2023-08-01T19:55:41.579 INFO:teuthology.orchestra.run.smithi155.stdout: "event": "dispatched", 2023-08-01T19:55:41.579 INFO:teuthology.orchestra.run.smithi155.stdout: "time": "2023-08-01T19:54:51.460058+0000", 2023-08-01T19:55:41.579 INFO:teuthology.orchestra.run.smithi155.stdout: "duration": 7.3869999999999997e-06 2023-08-01T19:55:41.579 INFO:teuthology.orchestra.run.smithi155.stdout: }, 2023-08-01T19:55:41.580 INFO:teuthology.orchestra.run.smithi155.stdout: { 2023-08-01T19:55:41.580 INFO:teuthology.orchestra.run.smithi155.stdout: "event": "queued_for_pg", 2023-08-01T19:55:41.580 INFO:teuthology.orchestra.run.smithi155.stdout: "time": "2023-08-01T19:54:51.460062+0000", 2023-08-01T19:55:41.580 INFO:teuthology.orchestra.run.smithi155.stdout: "duration": 4.352e-06 2023-08-01T19:55:41.580 INFO:teuthology.orchestra.run.smithi155.stdout: }, 2023-08-01T19:55:41.580 INFO:teuthology.orchestra.run.smithi155.stdout: { 2023-08-01T19:55:41.580 INFO:teuthology.orchestra.run.smithi155.stdout: "event": "reached_pg", 2023-08-01T19:55:41.581 INFO:teuthology.orchestra.run.smithi155.stdout: "time": "2023-08-01T19:54:51.460101+0000", 2023-08-01T19:55:41.581 INFO:teuthology.orchestra.run.smithi155.stdout: "duration": 3.8705000000000003e-05 2023-08-01T19:55:41.581 INFO:teuthology.orchestra.run.smithi155.stdout: }, 2023-08-01T19:55:41.581 INFO:teuthology.orchestra.run.smithi155.stdout: { 2023-08-01T19:55:41.581 INFO:teuthology.orchestra.run.smithi155.stdout: "event": "started", 2023-08-01T19:55:41.581 INFO:teuthology.orchestra.run.smithi155.stdout: "time": "2023-08-01T19:54:51.460236+0000", 2023-08-01T19:55:41.581 INFO:teuthology.orchestra.run.smithi155.stdout: "duration": 0.00013463599999999999 2023-08-01T19:55:41.582 INFO:teuthology.orchestra.run.smithi155.stdout: }, 2023-08-01T19:55:41.582 INFO:teuthology.orchestra.run.smithi155.stdout: { 2023-08-01T19:55:41.582 INFO:teuthology.orchestra.run.smithi155.stdout: "event": "waiting for subops from 0", 2023-08-01T19:55:41.582 INFO:teuthology.orchestra.run.smithi155.stdout: "time": "2023-08-01T19:54:51.460391+0000", 2023-08-01T19:55:41.582 INFO:teuthology.orchestra.run.smithi155.stdout: "duration": 0.00015525000000000001 2023-08-01T19:55:41.582 INFO:teuthology.orchestra.run.smithi155.stdout: }, 2023-08-01T19:55:41.582 INFO:teuthology.orchestra.run.smithi155.stdout: { 2023-08-01T19:55:41.582 INFO:teuthology.orchestra.run.smithi155.stdout: "event": "sub_op_commit_rec", 2023-08-01T19:55:41.583 INFO:teuthology.orchestra.run.smithi155.stdout: "time": "2023-08-01T19:54:51.468393+0000", 2023-08-01T19:55:41.583 INFO:teuthology.orchestra.run.smithi155.stdout: "duration": 0.00800208 2023-08-01T19:55:41.583 INFO:teuthology.orchestra.run.smithi155.stdout: }, 2023-08-01T19:55:41.583 INFO:teuthology.orchestra.run.smithi155.stdout: { 2023-08-01T19:55:41.583 INFO:teuthology.orchestra.run.smithi155.stdout: "event": "op_commit", 2023-08-01T19:55:41.583 INFO:teuthology.orchestra.run.smithi155.stdout: "time": "2023-08-01T19:54:51.482815+0000", 2023-08-01T19:55:41.583 INFO:teuthology.orchestra.run.smithi155.stdout: "duration": 0.01442148 2023-08-01T19:55:41.583 INFO:teuthology.orchestra.run.smithi155.stdout: }, 2023-08-01T19:55:41.584 INFO:teuthology.orchestra.run.smithi155.stdout: { 2023-08-01T19:55:41.584 INFO:teuthology.orchestra.run.smithi155.stdout: "event": "commit_sent", 2023-08-01T19:55:41.584 INFO:teuthology.orchestra.run.smithi155.stdout: "time": "2023-08-01T19:54:51.482866+0000", 2023-08-01T19:55:41.584 INFO:teuthology.orchestra.run.smithi155.stdout: "duration": 5.1842999999999998e-05 2023-08-01T19:55:41.584 INFO:teuthology.orchestra.run.smithi155.stdout: }, 2023-08-01T19:55:41.584 INFO:teuthology.orchestra.run.smithi155.stdout: { 2023-08-01T19:55:41.584 INFO:teuthology.orchestra.run.smithi155.stdout: "event": "done", 2023-08-01T19:55:41.585 INFO:teuthology.orchestra.run.smithi155.stdout: "time": "2023-08-01T19:54:51.482909+0000", 2023-08-01T19:55:41.585 INFO:teuthology.orchestra.run.smithi155.stdout: "duration": 4.2663000000000001e-05 2023-08-01T19:55:41.585 INFO:teuthology.orchestra.run.smithi155.stdout: } 2023-08-01T19:55:41.585 INFO:teuthology.orchestra.run.smithi155.stdout: ] 2023-08-01T19:55:41.585 INFO:teuthology.orchestra.run.smithi155.stdout: } 2023-08-01T19:55:41.585 INFO:teuthology.orchestra.run.smithi155.stdout: }, 2023-08-01T19:55:41.585 INFO:teuthology.orchestra.run.smithi155.stdout: { 2023-08-01T19:55:41.585 INFO:teuthology.orchestra.run.smithi155.stdout: "description": "osd_op(client.4668.0:73455 5.b 5:de51121e:::benchmark_data_smithi006_114134_object73454:head [set-alloc-hint object_size 65536 write_size 65536,write 0~65536] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e31)", 2023-08-01T19:55:41.586 INFO:teuthology.orchestra.run.smithi155.stdout: "initiated_at": "2023-08-01T19:54:51.460078+0000", 2023-08-01T19:55:41.586 INFO:teuthology.orchestra.run.smithi155.stdout: "age": 50.111548104999997, 2023-08-01T19:55:41.586 INFO:teuthology.orchestra.run.smithi155.stdout: "duration": 0.022689121999999999, 2023-08-01T19:55:41.586 INFO:teuthology.orchestra.run.smithi155.stdout: "type_data": { 2023-08-01T19:55:41.586 INFO:teuthology.orchestra.run.smithi155.stdout: "flag_point": "commit sent; apply or cleanup", 2023-08-01T19:55:41.586 INFO:teuthology.orchestra.run.smithi155.stdout: "client_info": { 2023-08-01T19:55:41.586 INFO:teuthology.orchestra.run.smithi155.stdout: "client": "client.4668", 2023-08-01T19:55:41.586 INFO:teuthology.orchestra.run.smithi155.stdout: "client_addr": "172.21.15.6:0/1709472247", 2023-08-01T19:55:41.587 INFO:teuthology.orchestra.run.smithi155.stdout: "tid": 73455 2023-08-01T19:55:41.587 INFO:teuthology.orchestra.run.smithi155.stdout: }, 2023-08-01T19:55:41.587 INFO:teuthology.orchestra.run.smithi155.stdout: "events": [ 2023-08-01T19:55:41.587 INFO:teuthology.orchestra.run.smithi155.stdout: { 2023-08-01T19:55:41.587 INFO:teuthology.orchestra.run.smithi155.stdout: "event": "initiated", 2023-08-01T19:55:41.587 INFO:teuthology.orchestra.run.smithi155.stdout: "time": "2023-08-01T19:54:51.460078+0000", 2023-08-01T19:55:41.587 INFO:teuthology.orchestra.run.smithi155.stdout: "duration": 0 2023-08-01T19:55:41.588 INFO:teuthology.orchestra.run.smithi155.stdout: }, 2023-08-01T19:55:41.588 INFO:teuthology.orchestra.run.smithi155.stdout: { 2023-08-01T19:55:41.588 INFO:teuthology.orchestra.run.smithi155.stdout: "event": "throttled", 2023-08-01T19:55:41.588 INFO:teuthology.orchestra.run.smithi155.stdout: "time": "2023-08-01T19:54:51.460078+0000", 2023-08-01T19:55:41.588 INFO:teuthology.orchestra.run.smithi155.stdout: "duration": 0 2023-08-01T19:55:41.588 INFO:teuthology.orchestra.run.smithi155.stdout: }, 2023-08-01T19:55:41.588 INFO:teuthology.orchestra.run.smithi155.stdout: { 2023-08-01T19:55:41.588 INFO:teuthology.orchestra.run.smithi155.stdout: "event": "header_read", 2023-08-01T19:55:41.589 INFO:teuthology.orchestra.run.smithi155.stdout: "time": "2023-08-01T19:54:51.460077+0000", 2023-08-01T19:55:41.589 INFO:teuthology.orchestra.run.smithi155.stdout: "duration": 4294967295.9999995 2023-08-01T19:55:41.589 INFO:teuthology.orchestra.run.smithi155.stdout: }, 2023-08-01T19:55:41.589 INFO:teuthology.orchestra.run.smithi155.stdout: { 2023-08-01T19:55:41.589 INFO:teuthology.orchestra.run.smithi155.stdout: "event": "all_read", 2023-08-01T19:55:41.589 INFO:teuthology.orchestra.run.smithi155.stdout: "time": "2023-08-01T19:54:51.460102+0000", 2023-08-01T19:55:41.589 INFO:teuthology.orchestra.run.smithi155.stdout: "duration": 2.4933e-05 2023-08-01T19:55:41.589 INFO:teuthology.orchestra.run.smithi155.stdout: }, 2023-08-01T19:55:41.590 INFO:teuthology.orchestra.run.smithi155.stdout: { 2023-08-01T19:55:41.590 INFO:teuthology.orchestra.run.smithi155.stdout: "event": "dispatched", 2023-08-01T19:55:41.590 INFO:teuthology.orchestra.run.smithi155.stdout: "time": "2023-08-01T19:54:51.460109+0000", 2023-08-01T19:55:41.590 INFO:teuthology.orchestra.run.smithi155.stdout: "duration": 7.0720000000000002e-06 2023-08-01T19:55:41.590 INFO:teuthology.orchestra.run.smithi155.stdout: }, 2023-08-01T19:55:41.590 INFO:teuthology.orchestra.run.smithi155.stdout: { 2023-08-01T19:55:41.590 INFO:teuthology.orchestra.run.smithi155.stdout: "event": "queued_for_pg", 2023-08-01T19:55:41.590 INFO:teuthology.orchestra.run.smithi155.stdout: "time": "2023-08-01T19:54:51.460113+0000", 2023-08-01T19:55:41.591 INFO:teuthology.orchestra.run.smithi155.stdout: "duration": 4.3220000000000003e-06 2023-08-01T19:55:41.591 INFO:teuthology.orchestra.run.smithi155.stdout: }, 2023-08-01T19:55:41.591 INFO:teuthology.orchestra.run.smithi155.stdout: { 2023-08-01T19:55:41.591 INFO:teuthology.orchestra.run.smithi155.stdout: "event": "reached_pg", 2023-08-01T19:55:41.591 INFO:teuthology.orchestra.run.smithi155.stdout: "time": "2023-08-01T19:54:51.460955+0000", 2023-08-01T19:55:41.591 INFO:teuthology.orchestra.run.smithi155.stdout: "duration": 0.00084142500000000003 2023-08-01T19:55:41.591 INFO:teuthology.orchestra.run.smithi155.stdout: }, 2023-08-01T19:55:41.592 INFO:teuthology.orchestra.run.smithi155.stdout: { 2023-08-01T19:55:41.592 INFO:teuthology.orchestra.run.smithi155.stdout: "event": "started", 2023-08-01T19:55:41.592 INFO:teuthology.orchestra.run.smithi155.stdout: "time": "2023-08-01T19:54:51.461079+0000", 2023-08-01T19:55:41.592 INFO:teuthology.orchestra.run.smithi155.stdout: "duration": 0.000123826 2023-08-01T19:55:41.592 INFO:teuthology.orchestra.run.smithi155.stdout: }, 2023-08-01T19:55:41.592 INFO:teuthology.orchestra.run.smithi155.stdout: { 2023-08-01T19:55:41.592 INFO:teuthology.orchestra.run.smithi155.stdout: "event": "waiting for subops from 0", 2023-08-01T19:55:41.592 INFO:teuthology.orchestra.run.smithi155.stdout: "time": "2023-08-01T19:54:51.461233+0000", 2023-08-01T19:55:41.593 INFO:teuthology.orchestra.run.smithi155.stdout: "duration": 0.00015431900000000001 2023-08-01T19:55:41.593 INFO:teuthology.orchestra.run.smithi155.stdout: }, 2023-08-01T19:55:41.593 INFO:teuthology.orchestra.run.smithi155.stdout: { 2023-08-01T19:55:41.593 INFO:teuthology.orchestra.run.smithi155.stdout: "event": "sub_op_commit_rec", 2023-08-01T19:55:41.593 INFO:teuthology.orchestra.run.smithi155.stdout: "time": "2023-08-01T19:54:51.468509+0000", 2023-08-01T19:55:41.593 INFO:teuthology.orchestra.run.smithi155.stdout: "duration": 0.0072759859999999999 2023-08-01T19:55:41.593 INFO:teuthology.orchestra.run.smithi155.stdout: }, 2023-08-01T19:55:41.594 INFO:teuthology.orchestra.run.smithi155.stdout: { 2023-08-01T19:55:41.594 INFO:teuthology.orchestra.run.smithi155.stdout: "event": "op_commit", 2023-08-01T19:55:41.594 INFO:teuthology.orchestra.run.smithi155.stdout: "time": "2023-08-01T19:54:51.482704+0000", 2023-08-01T19:55:41.594 INFO:teuthology.orchestra.run.smithi155.stdout: "duration": 0.01419545 2023-08-01T19:55:41.594 INFO:teuthology.orchestra.run.smithi155.stdout: }, 2023-08-01T19:55:41.594 INFO:teuthology.orchestra.run.smithi155.stdout: { 2023-08-01T19:55:41.594 INFO:teuthology.orchestra.run.smithi155.stdout: "event": "commit_sent", 2023-08-01T19:55:41.594 INFO:teuthology.orchestra.run.smithi155.stdout: "time": "2023-08-01T19:54:51.482747+0000", 2023-08-01T19:55:41.595 INFO:teuthology.orchestra.run.smithi155.stdout: "duration": 4.2413999999999997e-05 2023-08-01T19:55:41.595 INFO:teuthology.orchestra.run.smithi155.stdout: }, 2023-08-01T19:55:41.595 INFO:teuthology.orchestra.run.smithi155.stdout: { 2023-08-01T19:55:41.595 INFO:teuthology.orchestra.run.smithi155.stdout: "event": "done", 2023-08-01T19:55:41.595 INFO:teuthology.orchestra.run.smithi155.stdout: "time": "2023-08-01T19:54:51.482767+0000", 2023-08-01T19:55:41.595 INFO:teuthology.orchestra.run.smithi155.stdout: "duration": 1.9908999999999999e-05 2023-08-01T19:55:41.596 INFO:teuthology.orchestra.run.smithi155.stdout: } 2023-08-01T19:55:41.596 INFO:teuthology.orchestra.run.smithi155.stdout: ] 2023-08-01T19:55:41.596 INFO:teuthology.orchestra.run.smithi155.stdout: } 2023-08-01T19:55:41.596 INFO:teuthology.orchestra.run.smithi155.stdout: }, 2023-08-01T19:55:41.596 INFO:teuthology.orchestra.run.smithi155.stdout: { 2023-08-01T19:55:41.596 INFO:teuthology.orchestra.run.smithi155.stdout: "description": "osd_op(client.4668.0:73456 5.0 5:0164baf4:::benchmark_data_smithi006_114134_object73455:head [set-alloc-hint object_size 65536 write_size 65536,write 0~65536] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e31)", 2023-08-01T19:55:41.596 INFO:teuthology.orchestra.run.smithi155.stdout: "initiated_at": "2023-08-01T19:54:51.461520+0000", 2023-08-01T19:55:41.596 INFO:teuthology.orchestra.run.smithi155.stdout: "age": 50.110106115000001, 2023-08-01T19:55:41.597 INFO:teuthology.orchestra.run.smithi155.stdout: "duration": 0.023899916, 2023-08-01T19:55:41.597 INFO:teuthology.orchestra.run.smithi155.stdout: "type_data": { 2023-08-01T19:55:41.597 INFO:teuthology.orchestra.run.smithi155.stdout: "flag_point": "commit sent; apply or cleanup", 2023-08-01T19:55:41.597 INFO:teuthology.orchestra.run.smithi155.stdout: "client_info": { 2023-08-01T19:55:41.597 INFO:teuthology.orchestra.run.smithi155.stdout: "client": "client.4668", 2023-08-01T19:55:41.597 INFO:teuthology.orchestra.run.smithi155.stdout: "client_addr": "172.21.15.6:0/1709472247", 2023-08-01T19:55:41.597 INFO:teuthology.orchestra.run.smithi155.stdout: "tid": 73456 2023-08-01T19:55:41.597 INFO:teuthology.orchestra.run.smithi155.stdout: }, 2023-08-01T19:55:41.598 INFO:teuthology.orchestra.run.smithi155.stdout: "events": [ 2023-08-01T19:55:41.598 INFO:teuthology.orchestra.run.smithi155.stdout: { 2023-08-01T19:55:41.598 INFO:teuthology.orchestra.run.smithi155.stdout: "event": "initiated", 2023-08-01T19:55:41.598 INFO:teuthology.orchestra.run.smithi155.stdout: "time": "2023-08-01T19:54:51.461520+0000", 2023-08-01T19:55:41.598 INFO:teuthology.orchestra.run.smithi155.stdout: "duration": 0 2023-08-01T19:55:41.598 INFO:teuthology.orchestra.run.smithi155.stdout: }, 2023-08-01T19:55:41.598 INFO:teuthology.orchestra.run.smithi155.stdout: { 2023-08-01T19:55:41.598 INFO:teuthology.orchestra.run.smithi155.stdout: "event": "throttled", 2023-08-01T19:55:41.599 INFO:teuthology.orchestra.run.smithi155.stdout: "time": "2023-08-01T19:54:51.461520+0000", 2023-08-01T19:55:41.599 INFO:teuthology.orchestra.run.smithi155.stdout: "duration": 0 2023-08-01T19:55:41.599 INFO:teuthology.orchestra.run.smithi155.stdout: }, 2023-08-01T19:55:41.599 INFO:teuthology.orchestra.run.smithi155.stdout: { 2023-08-01T19:55:41.599 INFO:teuthology.orchestra.run.smithi155.stdout: "event": "header_read", 2023-08-01T19:55:41.599 INFO:teuthology.orchestra.run.smithi155.stdout: "time": "2023-08-01T19:54:51.461519+0000", 2023-08-01T19:55:41.599 INFO:teuthology.orchestra.run.smithi155.stdout: "duration": 4294967295.999999 2023-08-01T19:55:41.600 INFO:teuthology.orchestra.run.smithi155.stdout: }, 2023-08-01T19:55:41.600 INFO:teuthology.orchestra.run.smithi155.stdout: { 2023-08-01T19:55:41.600 INFO:teuthology.orchestra.run.smithi155.stdout: "event": "all_read", 2023-08-01T19:55:41.600 INFO:teuthology.orchestra.run.smithi155.stdout: "time": "2023-08-01T19:54:51.461633+0000", 2023-08-01T19:55:41.600 INFO:teuthology.orchestra.run.smithi155.stdout: "duration": 0.000114015 2023-08-01T19:55:41.600 INFO:teuthology.orchestra.run.smithi155.stdout: }, 2023-08-01T19:55:41.600 INFO:teuthology.orchestra.run.smithi155.stdout: { 2023-08-01T19:55:41.600 INFO:teuthology.orchestra.run.smithi155.stdout: "event": "dispatched", 2023-08-01T19:55:41.601 INFO:teuthology.orchestra.run.smithi155.stdout: "time": "2023-08-01T19:54:51.461643+0000", 2023-08-01T19:55:41.601 INFO:teuthology.orchestra.run.smithi155.stdout: "duration": 1.0217000000000001e-05 2023-08-01T19:55:41.601 INFO:teuthology.orchestra.run.smithi155.stdout: }, 2023-08-01T19:55:41.601 INFO:teuthology.orchestra.run.smithi155.stdout: { 2023-08-01T19:55:41.601 INFO:teuthology.orchestra.run.smithi155.stdout: "event": "queued_for_pg", 2023-08-01T19:55:41.601 INFO:teuthology.orchestra.run.smithi155.stdout: "time": "2023-08-01T19:54:51.461649+0000", 2023-08-01T19:55:41.601 INFO:teuthology.orchestra.run.smithi155.stdout: "duration": 5.8850000000000004e-06 2023-08-01T19:55:41.601 INFO:teuthology.orchestra.run.smithi155.stdout: }, 2023-08-01T19:55:41.602 INFO:teuthology.orchestra.run.smithi155.stdout: { 2023-08-01T19:55:41.602 INFO:teuthology.orchestra.run.smithi155.stdout: "event": "reached_pg", 2023-08-01T19:55:41.602 INFO:teuthology.orchestra.run.smithi155.stdout: "time": "2023-08-01T19:54:51.461686+0000", 2023-08-01T19:55:41.602 INFO:teuthology.orchestra.run.smithi155.stdout: "duration": 3.7319e-05 2023-08-01T19:55:41.602 INFO:teuthology.orchestra.run.smithi155.stdout: }, 2023-08-01T19:55:41.602 INFO:teuthology.orchestra.run.smithi155.stdout: { 2023-08-01T19:55:41.602 INFO:teuthology.orchestra.run.smithi155.stdout: "event": "started", 2023-08-01T19:55:41.602 INFO:teuthology.orchestra.run.smithi155.stdout: "time": "2023-08-01T19:54:51.461802+0000", 2023-08-01T19:55:41.603 INFO:teuthology.orchestra.run.smithi155.stdout: "duration": 0.000115604 2023-08-01T19:55:41.603 INFO:teuthology.orchestra.run.smithi155.stdout: }, 2023-08-01T19:55:41.603 INFO:teuthology.orchestra.run.smithi155.stdout: { 2023-08-01T19:55:41.603 INFO:teuthology.orchestra.run.smithi155.stdout: "event": "waiting for subops from 0", 2023-08-01T19:55:41.603 INFO:teuthology.orchestra.run.smithi155.stdout: "time": "2023-08-01T19:54:51.461933+0000", 2023-08-01T19:55:41.603 INFO:teuthology.orchestra.run.smithi155.stdout: "duration": 0.000131175 2023-08-01T19:55:41.603 INFO:teuthology.orchestra.run.smithi155.stdout: }, 2023-08-01T19:55:41.604 INFO:teuthology.orchestra.run.smithi155.stdout: { 2023-08-01T19:55:41.604 INFO:teuthology.orchestra.run.smithi155.stdout: "event": "sub_op_commit_rec", 2023-08-01T19:55:41.604 INFO:teuthology.orchestra.run.smithi155.stdout: "time": "2023-08-01T19:54:51.468411+0000", 2023-08-01T19:55:41.604 INFO:teuthology.orchestra.run.smithi155.stdout: "duration": 0.0064775850000000001 2023-08-01T19:55:41.604 INFO:teuthology.orchestra.run.smithi155.stdout: }, 2023-08-01T19:55:41.604 INFO:teuthology.orchestra.run.smithi155.stdout: { 2023-08-01T19:55:41.604 INFO:teuthology.orchestra.run.smithi155.stdout: "event": "op_commit", 2023-08-01T19:55:41.604 INFO:teuthology.orchestra.run.smithi155.stdout: "time": "2023-08-01T19:54:51.485340+0000", 2023-08-01T19:55:41.605 INFO:teuthology.orchestra.run.smithi155.stdout: "duration": 0.016928907 2023-08-01T19:55:41.605 INFO:teuthology.orchestra.run.smithi155.stdout: }, 2023-08-01T19:55:41.605 INFO:teuthology.orchestra.run.smithi155.stdout: { 2023-08-01T19:55:41.605 INFO:teuthology.orchestra.run.smithi155.stdout: "event": "commit_sent", 2023-08-01T19:55:41.605 INFO:teuthology.orchestra.run.smithi155.stdout: "time": "2023-08-01T19:54:51.485385+0000", 2023-08-01T19:55:41.605 INFO:teuthology.orchestra.run.smithi155.stdout: "duration": 4.5222000000000002e-05 2023-08-01T19:55:41.605 INFO:teuthology.orchestra.run.smithi155.stdout: }, 2023-08-01T19:55:41.605 INFO:teuthology.orchestra.run.smithi155.stdout: { 2023-08-01T19:55:41.606 INFO:teuthology.orchestra.run.smithi155.stdout: "event": "done", 2023-08-01T19:55:41.606 INFO:teuthology.orchestra.run.smithi155.stdout: "time": "2023-08-01T19:54:51.485420+0000", 2023-08-01T19:55:41.606 INFO:teuthology.orchestra.run.smithi155.stdout: "duration": 3.4717e-05 2023-08-01T19:55:41.606 INFO:teuthology.orchestra.run.smithi155.stdout: } 2023-08-01T19:55:41.606 INFO:teuthology.orchestra.run.smithi155.stdout: ] 2023-08-01T19:55:41.606 INFO:teuthology.orchestra.run.smithi155.stdout: } 2023-08-01T19:55:41.606 INFO:teuthology.orchestra.run.smithi155.stdout: }, 2023-08-01T19:55:41.606 INFO:teuthology.orchestra.run.smithi155.stdout: { 2023-08-01T19:55:41.607 INFO:teuthology.orchestra.run.smithi155.stdout: "description": "osd_op(client.4668.0:100237 5.4 5:2d68bec9:::benchmark_data_smithi006_114134_object100236:head [set-alloc-hint object_size 65536 write_size 65536,write 0~65536] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e37)", 2023-08-01T19:55:41.607 INFO:teuthology.orchestra.run.smithi155.stdout: "initiated_at": "2023-08-01T19:55:05.147736+0000", 2023-08-01T19:55:41.607 INFO:teuthology.orchestra.run.smithi155.stdout: "age": 36.423889402, 2023-08-01T19:55:41.607 INFO:teuthology.orchestra.run.smithi155.stdout: "duration": 0.071299464000000007, 2023-08-01T19:55:41.607 INFO:teuthology.orchestra.run.smithi155.stdout: "type_data": { 2023-08-01T19:55:41.607 INFO:teuthology.orchestra.run.smithi155.stdout: "flag_point": "commit sent; apply or cleanup", 2023-08-01T19:55:41.607 INFO:teuthology.orchestra.run.smithi155.stdout: "client_info": { 2023-08-01T19:55:41.607 INFO:teuthology.orchestra.run.smithi155.stdout: "client": "client.4668", 2023-08-01T19:55:41.608 INFO:teuthology.orchestra.run.smithi155.stdout: "client_addr": "172.21.15.6:0/1709472247", 2023-08-01T19:55:41.608 INFO:teuthology.orchestra.run.smithi155.stdout: "tid": 100237 2023-08-01T19:55:41.608 INFO:teuthology.orchestra.run.smithi155.stdout: }, 2023-08-01T19:55:41.608 INFO:teuthology.orchestra.run.smithi155.stdout: "events": [ 2023-08-01T19:55:41.609 INFO:teuthology.orchestra.run.smithi155.stdout: { 2023-08-01T19:55:41.609 INFO:teuthology.orchestra.run.smithi155.stdout: "event": "initiated", 2023-08-01T19:55:41.609 INFO:teuthology.orchestra.run.smithi155.stdout: "time": "2023-08-01T19:55:05.147736+0000", 2023-08-01T19:55:41.609 INFO:teuthology.orchestra.run.smithi155.stdout: "duration": 0 2023-08-01T19:55:41.609 INFO:teuthology.orchestra.run.smithi155.stdout: }, 2023-08-01T19:55:41.610 INFO:teuthology.orchestra.run.smithi155.stdout: { 2023-08-01T19:55:41.610 INFO:teuthology.orchestra.run.smithi155.stdout: "event": "throttled", 2023-08-01T19:55:41.610 INFO:teuthology.orchestra.run.smithi155.stdout: "time": "2023-08-01T19:55:05.147736+0000", 2023-08-01T19:55:41.610 INFO:teuthology.orchestra.run.smithi155.stdout: "duration": 0 2023-08-01T19:55:41.610 INFO:teuthology.orchestra.run.smithi155.stdout: }, 2023-08-01T19:55:41.610 INFO:teuthology.orchestra.run.smithi155.stdout: { 2023-08-01T19:55:41.610 INFO:teuthology.orchestra.run.smithi155.stdout: "event": "header_read", 2023-08-01T19:55:41.611 INFO:teuthology.orchestra.run.smithi155.stdout: "time": "2023-08-01T19:55:05.147736+0000", 2023-08-01T19:55:41.611 INFO:teuthology.orchestra.run.smithi155.stdout: "duration": 4294967295.9999995 2023-08-01T19:55:41.611 INFO:teuthology.orchestra.run.smithi155.stdout: }, 2023-08-01T19:55:41.611 INFO:teuthology.orchestra.run.smithi155.stdout: { 2023-08-01T19:55:41.611 INFO:teuthology.orchestra.run.smithi155.stdout: "event": "all_read", 2023-08-01T19:55:41.611 INFO:teuthology.orchestra.run.smithi155.stdout: "time": "2023-08-01T19:55:05.147766+0000", 2023-08-01T19:55:41.611 INFO:teuthology.orchestra.run.smithi155.stdout: "duration": 3.0394000000000001e-05 2023-08-01T19:55:41.612 INFO:teuthology.orchestra.run.smithi155.stdout: }, 2023-08-01T19:55:41.612 INFO:teuthology.orchestra.run.smithi155.stdout: { 2023-08-01T19:55:41.612 INFO:teuthology.orchestra.run.smithi155.stdout: "event": "dispatched", 2023-08-01T19:55:41.612 INFO:teuthology.orchestra.run.smithi155.stdout: "time": "2023-08-01T19:55:05.147771+0000", 2023-08-01T19:55:41.612 INFO:teuthology.orchestra.run.smithi155.stdout: "duration": 4.25e-06 2023-08-01T19:55:41.612 INFO:teuthology.orchestra.run.smithi155.stdout: }, 2023-08-01T19:55:41.612 INFO:teuthology.orchestra.run.smithi155.stdout: { 2023-08-01T19:55:41.613 INFO:teuthology.orchestra.run.smithi155.stdout: "event": "queued_for_pg", 2023-08-01T19:55:41.613 INFO:teuthology.orchestra.run.smithi155.stdout: "time": "2023-08-01T19:55:05.147773+0000", 2023-08-01T19:55:41.613 INFO:teuthology.orchestra.run.smithi155.stdout: "duration": 2.4159999999999998e-06 2023-08-01T19:55:41.613 INFO:teuthology.orchestra.run.smithi155.stdout: }, 2023-08-01T19:55:41.613 INFO:teuthology.orchestra.run.smithi155.stdout: { 2023-08-01T19:55:41.613 INFO:teuthology.orchestra.run.smithi155.stdout: "event": "reached_pg", 2023-08-01T19:55:41.613 INFO:teuthology.orchestra.run.smithi155.stdout: "time": "2023-08-01T19:55:05.149903+0000", 2023-08-01T19:55:41.614 INFO:teuthology.orchestra.run.smithi155.stdout: "duration": 0.002129948 2023-08-01T19:55:41.614 INFO:teuthology.orchestra.run.smithi155.stdout: }, 2023-08-01T19:55:41.614 INFO:teuthology.orchestra.run.smithi155.stdout: { 2023-08-01T19:55:41.614 INFO:teuthology.orchestra.run.smithi155.stdout: "event": "started", 2023-08-01T19:55:41.614 INFO:teuthology.orchestra.run.smithi155.stdout: "time": "2023-08-01T19:55:05.149982+0000", 2023-08-01T19:55:41.614 INFO:teuthology.orchestra.run.smithi155.stdout: "duration": 7.8706000000000002e-05 2023-08-01T19:55:41.614 INFO:teuthology.orchestra.run.smithi155.stdout: }, 2023-08-01T19:55:41.614 INFO:teuthology.orchestra.run.smithi155.stdout: { 2023-08-01T19:55:41.615 INFO:teuthology.orchestra.run.smithi155.stdout: "event": "waiting for subops from 0", 2023-08-01T19:55:41.615 INFO:teuthology.orchestra.run.smithi155.stdout: "time": "2023-08-01T19:55:05.150066+0000", 2023-08-01T19:55:41.615 INFO:teuthology.orchestra.run.smithi155.stdout: "duration": 8.4241999999999997e-05 2023-08-01T19:55:41.615 INFO:teuthology.orchestra.run.smithi155.stdout: }, 2023-08-01T19:55:41.615 INFO:teuthology.orchestra.run.smithi155.stdout: { 2023-08-01T19:55:41.615 INFO:teuthology.orchestra.run.smithi155.stdout: "event": "op_commit", 2023-08-01T19:55:41.615 INFO:teuthology.orchestra.run.smithi155.stdout: "time": "2023-08-01T19:55:05.154994+0000", 2023-08-01T19:55:41.615 INFO:teuthology.orchestra.run.smithi155.stdout: "duration": 0.0049277050000000001 2023-08-01T19:55:41.616 INFO:teuthology.orchestra.run.smithi155.stdout: }, 2023-08-01T19:55:41.616 INFO:teuthology.orchestra.run.smithi155.stdout: { 2023-08-01T19:55:41.616 INFO:teuthology.orchestra.run.smithi155.stdout: "event": "sub_op_commit_rec", 2023-08-01T19:55:41.616 INFO:teuthology.orchestra.run.smithi155.stdout: "time": "2023-08-01T19:55:05.218933+0000", 2023-08-01T19:55:41.616 INFO:teuthology.orchestra.run.smithi155.stdout: "duration": 0.063939916999999999 2023-08-01T19:55:41.616 INFO:teuthology.orchestra.run.smithi155.stdout: }, 2023-08-01T19:55:41.616 INFO:teuthology.orchestra.run.smithi155.stdout: { 2023-08-01T19:55:41.616 INFO:teuthology.orchestra.run.smithi155.stdout: "event": "commit_sent", 2023-08-01T19:55:41.617 INFO:teuthology.orchestra.run.smithi155.stdout: "time": "2023-08-01T19:55:05.218989+0000", 2023-08-01T19:55:41.617 INFO:teuthology.orchestra.run.smithi155.stdout: "duration": 5.5772000000000001e-05 2023-08-01T19:55:41.617 INFO:teuthology.orchestra.run.smithi155.stdout: }, 2023-08-01T19:55:41.617 INFO:teuthology.orchestra.run.smithi155.stdout: { 2023-08-01T19:55:41.617 INFO:teuthology.orchestra.run.smithi155.stdout: "event": "done", 2023-08-01T19:55:41.617 INFO:teuthology.orchestra.run.smithi155.stdout: "time": "2023-08-01T19:55:05.219036+0000", 2023-08-01T19:55:41.617 INFO:teuthology.orchestra.run.smithi155.stdout: "duration": 4.6526000000000001e-05 2023-08-01T19:55:41.617 INFO:teuthology.orchestra.run.smithi155.stdout: } 2023-08-01T19:55:41.618 INFO:teuthology.orchestra.run.smithi155.stdout: ] 2023-08-01T19:55:41.618 INFO:teuthology.orchestra.run.smithi155.stdout: } 2023-08-01T19:55:41.618 INFO:teuthology.orchestra.run.smithi155.stdout: }, 2023-08-01T19:55:41.618 INFO:teuthology.orchestra.run.smithi155.stdout: { 2023-08-01T19:55:41.618 INFO:teuthology.orchestra.run.smithi155.stdout: "description": "osd_op(client.4668.0:100242 5.8 5:16a314b8:::benchmark_data_smithi006_114134_object100241:head [set-alloc-hint object_size 65536 write_size 65536,write 0~65536] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e37)", 2023-08-01T19:55:41.618 INFO:teuthology.orchestra.run.smithi155.stdout: "initiated_at": "2023-08-01T19:55:05.150616+0000", 2023-08-01T19:55:41.618 INFO:teuthology.orchestra.run.smithi155.stdout: "age": 36.421009771999998, 2023-08-01T19:55:41.619 INFO:teuthology.orchestra.run.smithi155.stdout: "duration": 0.071105065999999995, 2023-08-01T19:55:41.619 INFO:teuthology.orchestra.run.smithi155.stdout: "type_data": { 2023-08-01T19:55:41.619 INFO:teuthology.orchestra.run.smithi155.stdout: "flag_point": "commit sent; apply or cleanup", 2023-08-01T19:55:41.619 INFO:teuthology.orchestra.run.smithi155.stdout: "client_info": { 2023-08-01T19:55:41.619 INFO:teuthology.orchestra.run.smithi155.stdout: "client": "client.4668", 2023-08-01T19:55:41.619 INFO:teuthology.orchestra.run.smithi155.stdout: "client_addr": "172.21.15.6:0/1709472247", 2023-08-01T19:55:41.619 INFO:teuthology.orchestra.run.smithi155.stdout: "tid": 100242 2023-08-01T19:55:41.619 INFO:teuthology.orchestra.run.smithi155.stdout: }, 2023-08-01T19:55:41.620 INFO:teuthology.orchestra.run.smithi155.stdout: "events": [ 2023-08-01T19:55:41.620 INFO:teuthology.orchestra.run.smithi155.stdout: { 2023-08-01T19:55:41.620 INFO:teuthology.orchestra.run.smithi155.stdout: "event": "initiated", 2023-08-01T19:55:41.620 INFO:teuthology.orchestra.run.smithi155.stdout: "time": "2023-08-01T19:55:05.150616+0000", 2023-08-01T19:55:41.620 INFO:teuthology.orchestra.run.smithi155.stdout: "duration": 0 2023-08-01T19:55:41.620 INFO:teuthology.orchestra.run.smithi155.stdout: }, 2023-08-01T19:55:41.620 INFO:teuthology.orchestra.run.smithi155.stdout: { 2023-08-01T19:55:41.620 INFO:teuthology.orchestra.run.smithi155.stdout: "event": "throttled", 2023-08-01T19:55:41.621 INFO:teuthology.orchestra.run.smithi155.stdout: "time": "2023-08-01T19:55:05.150616+0000", 2023-08-01T19:55:41.621 INFO:teuthology.orchestra.run.smithi155.stdout: "duration": 0 2023-08-01T19:55:41.621 INFO:teuthology.orchestra.run.smithi155.stdout: }, 2023-08-01T19:55:41.621 INFO:teuthology.orchestra.run.smithi155.stdout: { 2023-08-01T19:55:41.621 INFO:teuthology.orchestra.run.smithi155.stdout: "event": "header_read", 2023-08-01T19:55:41.621 INFO:teuthology.orchestra.run.smithi155.stdout: "time": "2023-08-01T19:55:05.150615+0000", 2023-08-01T19:55:41.621 INFO:teuthology.orchestra.run.smithi155.stdout: "duration": 4294967295.999999 2023-08-01T19:55:41.621 INFO:teuthology.orchestra.run.smithi155.stdout: }, 2023-08-01T19:55:41.622 INFO:teuthology.orchestra.run.smithi155.stdout: { 2023-08-01T19:55:41.622 INFO:teuthology.orchestra.run.smithi155.stdout: "event": "all_read", 2023-08-01T19:55:41.622 INFO:teuthology.orchestra.run.smithi155.stdout: "time": "2023-08-01T19:55:05.150696+0000", 2023-08-01T19:55:41.622 INFO:teuthology.orchestra.run.smithi155.stdout: "duration": 8.0852000000000004e-05 2023-08-01T19:55:41.622 INFO:teuthology.orchestra.run.smithi155.stdout: }, 2023-08-01T19:55:41.622 INFO:teuthology.orchestra.run.smithi155.stdout: { 2023-08-01T19:55:41.622 INFO:teuthology.orchestra.run.smithi155.stdout: "event": "dispatched", 2023-08-01T19:55:41.622 INFO:teuthology.orchestra.run.smithi155.stdout: "time": "2023-08-01T19:55:05.150708+0000", 2023-08-01T19:55:41.623 INFO:teuthology.orchestra.run.smithi155.stdout: "duration": 1.2116999999999999e-05 2023-08-01T19:55:41.623 INFO:teuthology.orchestra.run.smithi155.stdout: }, 2023-08-01T19:55:41.623 INFO:teuthology.orchestra.run.smithi155.stdout: { 2023-08-01T19:55:41.623 INFO:teuthology.orchestra.run.smithi155.stdout: "event": "queued_for_pg", 2023-08-01T19:55:41.623 INFO:teuthology.orchestra.run.smithi155.stdout: "time": "2023-08-01T19:55:05.150713+0000", 2023-08-01T19:55:41.623 INFO:teuthology.orchestra.run.smithi155.stdout: "duration": 5.4620000000000004e-06 2023-08-01T19:55:41.623 INFO:teuthology.orchestra.run.smithi155.stdout: }, 2023-08-01T19:55:41.623 INFO:teuthology.orchestra.run.smithi155.stdout: { 2023-08-01T19:55:41.624 INFO:teuthology.orchestra.run.smithi155.stdout: "event": "reached_pg", 2023-08-01T19:55:41.624 INFO:teuthology.orchestra.run.smithi155.stdout: "time": "2023-08-01T19:55:05.150761+0000", 2023-08-01T19:55:41.624 INFO:teuthology.orchestra.run.smithi155.stdout: "duration": 4.7429000000000003e-05 2023-08-01T19:55:41.624 INFO:teuthology.orchestra.run.smithi155.stdout: }, 2023-08-01T19:55:41.624 INFO:teuthology.orchestra.run.smithi155.stdout: { 2023-08-01T19:55:41.624 INFO:teuthology.orchestra.run.smithi155.stdout: "event": "started", 2023-08-01T19:55:41.624 INFO:teuthology.orchestra.run.smithi155.stdout: "time": "2023-08-01T19:55:05.150856+0000", 2023-08-01T19:55:41.625 INFO:teuthology.orchestra.run.smithi155.stdout: "duration": 9.5356e-05 2023-08-01T19:55:41.625 INFO:teuthology.orchestra.run.smithi155.stdout: }, 2023-08-01T19:55:41.625 INFO:teuthology.orchestra.run.smithi155.stdout: { 2023-08-01T19:55:41.625 INFO:teuthology.orchestra.run.smithi155.stdout: "event": "waiting for subops from 0", 2023-08-01T19:55:41.625 INFO:teuthology.orchestra.run.smithi155.stdout: "time": "2023-08-01T19:55:05.150999+0000", 2023-08-01T19:55:41.625 INFO:teuthology.orchestra.run.smithi155.stdout: "duration": 0.00014234499999999999 2023-08-01T19:55:41.625 INFO:teuthology.orchestra.run.smithi155.stdout: }, 2023-08-01T19:55:41.625 INFO:teuthology.orchestra.run.smithi155.stdout: { 2023-08-01T19:55:41.626 INFO:teuthology.orchestra.run.smithi155.stdout: "event": "sub_op_commit_rec", 2023-08-01T19:55:41.626 INFO:teuthology.orchestra.run.smithi155.stdout: "time": "2023-08-01T19:55:05.219001+0000", 2023-08-01T19:55:41.626 INFO:teuthology.orchestra.run.smithi155.stdout: "duration": 0.068002776000000001 2023-08-01T19:55:41.626 INFO:teuthology.orchestra.run.smithi155.stdout: }, 2023-08-01T19:55:41.626 INFO:teuthology.orchestra.run.smithi155.stdout: { 2023-08-01T19:55:41.626 INFO:teuthology.orchestra.run.smithi155.stdout: "event": "op_commit", 2023-08-01T19:55:41.626 INFO:teuthology.orchestra.run.smithi155.stdout: "time": "2023-08-01T19:55:05.221635+0000", 2023-08-01T19:55:41.626 INFO:teuthology.orchestra.run.smithi155.stdout: "duration": 0.0026340579999999999 2023-08-01T19:55:41.627 INFO:teuthology.orchestra.run.smithi155.stdout: }, 2023-08-01T19:55:41.627 INFO:teuthology.orchestra.run.smithi155.stdout: { 2023-08-01T19:55:41.627 INFO:teuthology.orchestra.run.smithi155.stdout: "event": "commit_sent", 2023-08-01T19:55:41.627 INFO:teuthology.orchestra.run.smithi155.stdout: "time": "2023-08-01T19:55:05.221682+0000", 2023-08-01T19:55:41.627 INFO:teuthology.orchestra.run.smithi155.stdout: "duration": 4.7123999999999998e-05 2023-08-01T19:55:41.627 INFO:teuthology.orchestra.run.smithi155.stdout: }, 2023-08-01T19:55:41.627 INFO:teuthology.orchestra.run.smithi155.stdout: { 2023-08-01T19:55:41.627 INFO:teuthology.orchestra.run.smithi155.stdout: "event": "done", 2023-08-01T19:55:41.628 INFO:teuthology.orchestra.run.smithi155.stdout: "time": "2023-08-01T19:55:05.221721+0000", 2023-08-01T19:55:41.628 INFO:teuthology.orchestra.run.smithi155.stdout: "duration": 3.8529999999999999e-05 2023-08-01T19:55:41.628 INFO:teuthology.orchestra.run.smithi155.stdout: } 2023-08-01T19:55:41.628 INFO:teuthology.orchestra.run.smithi155.stdout: ] 2023-08-01T19:55:41.628 INFO:teuthology.orchestra.run.smithi155.stdout: } 2023-08-01T19:55:41.628 INFO:teuthology.orchestra.run.smithi155.stdout: }, 2023-08-01T19:55:41.628 INFO:teuthology.orchestra.run.smithi155.stdout: { 2023-08-01T19:55:41.628 INFO:teuthology.orchestra.run.smithi155.stdout: "description": "osd_repop(client.4668.0:100240 5.a e37/19 5:5313c5b9:::benchmark_data_smithi006_114134_object100239:head v 37'6227, mlcod=37'6225)", 2023-08-01T19:55:41.629 INFO:teuthology.orchestra.run.smithi155.stdout: "initiated_at": "2023-08-01T19:55:05.150778+0000", 2023-08-01T19:55:41.629 INFO:teuthology.orchestra.run.smithi155.stdout: "age": 36.420847571000003, 2023-08-01T19:55:41.629 INFO:teuthology.orchestra.run.smithi155.stdout: "duration": 0.073362533999999993, 2023-08-01T19:55:41.629 INFO:teuthology.orchestra.run.smithi155.stdout: "type_data": { 2023-08-01T19:55:41.629 INFO:teuthology.orchestra.run.smithi155.stdout: "flag_point": "commit sent; apply or cleanup", 2023-08-01T19:55:41.629 INFO:teuthology.orchestra.run.smithi155.stdout: "events": [ 2023-08-01T19:55:41.629 INFO:teuthology.orchestra.run.smithi155.stdout: { 2023-08-01T19:55:41.630 INFO:teuthology.orchestra.run.smithi155.stdout: "event": "initiated", 2023-08-01T19:55:41.630 INFO:teuthology.orchestra.run.smithi155.stdout: "time": "2023-08-01T19:55:05.150778+0000", 2023-08-01T19:55:41.630 INFO:teuthology.orchestra.run.smithi155.stdout: "duration": 0 2023-08-01T19:55:41.630 INFO:teuthology.orchestra.run.smithi155.stdout: }, 2023-08-01T19:55:41.630 INFO:teuthology.orchestra.run.smithi155.stdout: { 2023-08-01T19:55:41.630 INFO:teuthology.orchestra.run.smithi155.stdout: "event": "throttled", 2023-08-01T19:55:41.630 INFO:teuthology.orchestra.run.smithi155.stdout: "time": "2023-08-01T19:55:05.150778+0000", 2023-08-01T19:55:41.630 INFO:teuthology.orchestra.run.smithi155.stdout: "duration": 0 2023-08-01T19:55:41.631 INFO:teuthology.orchestra.run.smithi155.stdout: }, 2023-08-01T19:55:41.631 INFO:teuthology.orchestra.run.smithi155.stdout: { 2023-08-01T19:55:41.631 INFO:teuthology.orchestra.run.smithi155.stdout: "event": "header_read", 2023-08-01T19:55:41.631 INFO:teuthology.orchestra.run.smithi155.stdout: "time": "2023-08-01T19:55:05.150778+0000", 2023-08-01T19:55:41.631 INFO:teuthology.orchestra.run.smithi155.stdout: "duration": 4294967295.9999995 2023-08-01T19:55:41.631 INFO:teuthology.orchestra.run.smithi155.stdout: }, 2023-08-01T19:55:41.631 INFO:teuthology.orchestra.run.smithi155.stdout: { 2023-08-01T19:55:41.631 INFO:teuthology.orchestra.run.smithi155.stdout: "event": "all_read", 2023-08-01T19:55:41.632 INFO:teuthology.orchestra.run.smithi155.stdout: "time": "2023-08-01T19:55:05.150811+0000", 2023-08-01T19:55:41.632 INFO:teuthology.orchestra.run.smithi155.stdout: "duration": 3.3664000000000002e-05 2023-08-01T19:55:41.632 INFO:teuthology.orchestra.run.smithi155.stdout: }, 2023-08-01T19:55:41.632 INFO:teuthology.orchestra.run.smithi155.stdout: { 2023-08-01T19:55:41.632 INFO:teuthology.orchestra.run.smithi155.stdout: "event": "dispatched", 2023-08-01T19:55:41.632 INFO:teuthology.orchestra.run.smithi155.stdout: "time": "2023-08-01T19:55:05.150818+0000", 2023-08-01T19:55:41.632 INFO:teuthology.orchestra.run.smithi155.stdout: "duration": 6.5769999999999999e-06 2023-08-01T19:55:41.632 INFO:teuthology.orchestra.run.smithi155.stdout: }, 2023-08-01T19:55:41.633 INFO:teuthology.orchestra.run.smithi155.stdout: { 2023-08-01T19:55:41.633 INFO:teuthology.orchestra.run.smithi155.stdout: "event": "queued_for_pg", 2023-08-01T19:55:41.633 INFO:teuthology.orchestra.run.smithi155.stdout: "time": "2023-08-01T19:55:05.150822+0000", 2023-08-01T19:55:41.633 INFO:teuthology.orchestra.run.smithi155.stdout: "duration": 4.0060000000000003e-06 2023-08-01T19:55:41.633 INFO:teuthology.orchestra.run.smithi155.stdout: }, 2023-08-01T19:55:41.633 INFO:teuthology.orchestra.run.smithi155.stdout: { 2023-08-01T19:55:41.633 INFO:teuthology.orchestra.run.smithi155.stdout: "event": "reached_pg", 2023-08-01T19:55:41.633 INFO:teuthology.orchestra.run.smithi155.stdout: "time": "2023-08-01T19:55:05.150855+0000", 2023-08-01T19:55:41.634 INFO:teuthology.orchestra.run.smithi155.stdout: "duration": 3.3204999999999998e-05 2023-08-01T19:55:41.634 INFO:teuthology.orchestra.run.smithi155.stdout: }, 2023-08-01T19:55:41.634 INFO:teuthology.orchestra.run.smithi155.stdout: { 2023-08-01T19:55:41.634 INFO:teuthology.orchestra.run.smithi155.stdout: "event": "started", 2023-08-01T19:55:41.634 INFO:teuthology.orchestra.run.smithi155.stdout: "time": "2023-08-01T19:55:05.150873+0000", 2023-08-01T19:55:41.634 INFO:teuthology.orchestra.run.smithi155.stdout: "duration": 1.8139999999999999e-05 2023-08-01T19:55:41.634 INFO:teuthology.orchestra.run.smithi155.stdout: }, 2023-08-01T19:55:41.634 INFO:teuthology.orchestra.run.smithi155.stdout: { 2023-08-01T19:55:41.635 INFO:teuthology.orchestra.run.smithi155.stdout: "event": "commit_sent", 2023-08-01T19:55:41.635 INFO:teuthology.orchestra.run.smithi155.stdout: "time": "2023-08-01T19:55:05.224095+0000", 2023-08-01T19:55:41.635 INFO:teuthology.orchestra.run.smithi155.stdout: "duration": 0.073221895999999995 2023-08-01T19:55:41.635 INFO:teuthology.orchestra.run.smithi155.stdout: }, 2023-08-01T19:55:41.635 INFO:teuthology.orchestra.run.smithi155.stdout: { 2023-08-01T19:55:41.635 INFO:teuthology.orchestra.run.smithi155.stdout: "event": "done", 2023-08-01T19:55:41.635 INFO:teuthology.orchestra.run.smithi155.stdout: "time": "2023-08-01T19:55:05.224141+0000", 2023-08-01T19:55:41.636 INFO:teuthology.orchestra.run.smithi155.stdout: "duration": 4.5385e-05 2023-08-01T19:55:41.636 INFO:teuthology.orchestra.run.smithi155.stdout: } 2023-08-01T19:55:41.636 INFO:teuthology.orchestra.run.smithi155.stdout: ] 2023-08-01T19:55:41.636 INFO:teuthology.orchestra.run.smithi155.stdout: } 2023-08-01T19:55:41.636 INFO:teuthology.orchestra.run.smithi155.stdout: }, 2023-08-01T19:55:41.636 INFO:teuthology.orchestra.run.smithi155.stdout: { 2023-08-01T19:55:41.636 INFO:teuthology.orchestra.run.smithi155.stdout: "description": "osd_op(client.4668.0:100245 5.e 5:71869c66:::benchmark_data_smithi006_114134_object100244:head [set-alloc-hint object_size 65536 write_size 65536,write 0~65536] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e37)", 2023-08-01T19:55:41.636 INFO:teuthology.orchestra.run.smithi155.stdout: "initiated_at": "2023-08-01T19:55:05.150991+0000", 2023-08-01T19:55:41.637 INFO:teuthology.orchestra.run.smithi155.stdout: "age": 36.420634784000001, 2023-08-01T19:55:41.637 INFO:teuthology.orchestra.run.smithi155.stdout: "duration": 0.070734490999999997, 2023-08-01T19:55:41.637 INFO:teuthology.orchestra.run.smithi155.stdout: "type_data": { 2023-08-01T19:55:41.637 INFO:teuthology.orchestra.run.smithi155.stdout: "flag_point": "commit sent; apply or cleanup", 2023-08-01T19:55:41.637 INFO:teuthology.orchestra.run.smithi155.stdout: "client_info": { 2023-08-01T19:55:41.637 INFO:teuthology.orchestra.run.smithi155.stdout: "client": "client.4668", 2023-08-01T19:55:41.637 INFO:teuthology.orchestra.run.smithi155.stdout: "client_addr": "172.21.15.6:0/1709472247", 2023-08-01T19:55:41.637 INFO:teuthology.orchestra.run.smithi155.stdout: "tid": 100245 2023-08-01T19:55:41.638 INFO:teuthology.orchestra.run.smithi155.stdout: }, 2023-08-01T19:55:41.638 INFO:teuthology.orchestra.run.smithi155.stdout: "events": [ 2023-08-01T19:55:41.638 INFO:teuthology.orchestra.run.smithi155.stdout: { 2023-08-01T19:55:41.638 INFO:teuthology.orchestra.run.smithi155.stdout: "event": "initiated", 2023-08-01T19:55:41.638 INFO:teuthology.orchestra.run.smithi155.stdout: "time": "2023-08-01T19:55:05.150991+0000", 2023-08-01T19:55:41.638 INFO:teuthology.orchestra.run.smithi155.stdout: "duration": 0 2023-08-01T19:55:41.638 INFO:teuthology.orchestra.run.smithi155.stdout: }, 2023-08-01T19:55:41.638 INFO:teuthology.orchestra.run.smithi155.stdout: { 2023-08-01T19:55:41.639 INFO:teuthology.orchestra.run.smithi155.stdout: "event": "throttled", 2023-08-01T19:55:41.639 INFO:teuthology.orchestra.run.smithi155.stdout: "time": "2023-08-01T19:55:05.150991+0000", 2023-08-01T19:55:41.639 INFO:teuthology.orchestra.run.smithi155.stdout: "duration": 0 2023-08-01T19:55:41.639 INFO:teuthology.orchestra.run.smithi155.stdout: }, 2023-08-01T19:55:41.639 INFO:teuthology.orchestra.run.smithi155.stdout: { 2023-08-01T19:55:41.639 INFO:teuthology.orchestra.run.smithi155.stdout: "event": "header_read", 2023-08-01T19:55:41.639 INFO:teuthology.orchestra.run.smithi155.stdout: "time": "2023-08-01T19:55:05.150990+0000", 2023-08-01T19:55:41.639 INFO:teuthology.orchestra.run.smithi155.stdout: "duration": 4294967295.999999 2023-08-01T19:55:41.640 INFO:teuthology.orchestra.run.smithi155.stdout: }, 2023-08-01T19:55:41.640 INFO:teuthology.orchestra.run.smithi155.stdout: { 2023-08-01T19:55:41.640 INFO:teuthology.orchestra.run.smithi155.stdout: "event": "all_read", 2023-08-01T19:55:41.640 INFO:teuthology.orchestra.run.smithi155.stdout: "time": "2023-08-01T19:55:05.151108+0000", 2023-08-01T19:55:41.640 INFO:teuthology.orchestra.run.smithi155.stdout: "duration": 0.00011849300000000001 2023-08-01T19:55:41.640 INFO:teuthology.orchestra.run.smithi155.stdout: }, 2023-08-01T19:55:41.640 INFO:teuthology.orchestra.run.smithi155.stdout: { 2023-08-01T19:55:41.640 INFO:teuthology.orchestra.run.smithi155.stdout: "event": "dispatched", 2023-08-01T19:55:41.641 INFO:teuthology.orchestra.run.smithi155.stdout: "time": "2023-08-01T19:55:05.151117+0000", 2023-08-01T19:55:41.641 INFO:teuthology.orchestra.run.smithi155.stdout: "duration": 8.1040000000000007e-06 2023-08-01T19:55:41.641 INFO:teuthology.orchestra.run.smithi155.stdout: }, 2023-08-01T19:55:41.641 INFO:teuthology.orchestra.run.smithi155.stdout: { 2023-08-01T19:55:41.641 INFO:teuthology.orchestra.run.smithi155.stdout: "event": "queued_for_pg", 2023-08-01T19:55:41.641 INFO:teuthology.orchestra.run.smithi155.stdout: "time": "2023-08-01T19:55:05.151121+0000", 2023-08-01T19:55:41.641 INFO:teuthology.orchestra.run.smithi155.stdout: "duration": 4.2019999999999997e-06 2023-08-01T19:55:41.642 INFO:teuthology.orchestra.run.smithi155.stdout: }, 2023-08-01T19:55:41.642 INFO:teuthology.orchestra.run.smithi155.stdout: { 2023-08-01T19:55:41.642 INFO:teuthology.orchestra.run.smithi155.stdout: "event": "reached_pg", 2023-08-01T19:55:41.642 INFO:teuthology.orchestra.run.smithi155.stdout: "time": "2023-08-01T19:55:05.151162+0000", 2023-08-01T19:55:41.642 INFO:teuthology.orchestra.run.smithi155.stdout: "duration": 4.1448e-05 2023-08-01T19:55:41.642 INFO:teuthology.orchestra.run.smithi155.stdout: }, 2023-08-01T19:55:41.642 INFO:teuthology.orchestra.run.smithi155.stdout: { 2023-08-01T19:55:41.643 INFO:teuthology.orchestra.run.smithi155.stdout: "event": "started", 2023-08-01T19:55:41.643 INFO:teuthology.orchestra.run.smithi155.stdout: "time": "2023-08-01T19:55:05.151281+0000", 2023-08-01T19:55:41.643 INFO:teuthology.orchestra.run.smithi155.stdout: "duration": 0.000119141 2023-08-01T19:55:41.643 INFO:teuthology.orchestra.run.smithi155.stdout: }, 2023-08-01T19:55:41.643 INFO:teuthology.orchestra.run.smithi155.stdout: { 2023-08-01T19:55:41.643 INFO:teuthology.orchestra.run.smithi155.stdout: "event": "waiting for subops from 0", 2023-08-01T19:55:41.643 INFO:teuthology.orchestra.run.smithi155.stdout: "time": "2023-08-01T19:55:05.151443+0000", 2023-08-01T19:55:41.643 INFO:teuthology.orchestra.run.smithi155.stdout: "duration": 0.00016181600000000001 2023-08-01T19:55:41.644 INFO:teuthology.orchestra.run.smithi155.stdout: }, 2023-08-01T19:55:41.644 INFO:teuthology.orchestra.run.smithi155.stdout: { 2023-08-01T19:55:41.644 INFO:teuthology.orchestra.run.smithi155.stdout: "event": "sub_op_commit_rec", 2023-08-01T19:55:41.644 INFO:teuthology.orchestra.run.smithi155.stdout: "time": "2023-08-01T19:55:05.219101+0000", 2023-08-01T19:55:41.644 INFO:teuthology.orchestra.run.smithi155.stdout: "duration": 0.067658037000000004 2023-08-01T19:55:41.644 INFO:teuthology.orchestra.run.smithi155.stdout: }, 2023-08-01T19:55:41.644 INFO:teuthology.orchestra.run.smithi155.stdout: { 2023-08-01T19:55:41.645 INFO:teuthology.orchestra.run.smithi155.stdout: "event": "op_commit", 2023-08-01T19:55:41.645 INFO:teuthology.orchestra.run.smithi155.stdout: "time": "2023-08-01T19:55:05.221646+0000", 2023-08-01T19:55:41.645 INFO:teuthology.orchestra.run.smithi155.stdout: "duration": 0.0025450540000000002 2023-08-01T19:55:41.645 INFO:teuthology.orchestra.run.smithi155.stdout: }, 2023-08-01T19:55:41.645 INFO:teuthology.orchestra.run.smithi155.stdout: { 2023-08-01T19:55:41.645 INFO:teuthology.orchestra.run.smithi155.stdout: "event": "commit_sent", 2023-08-01T19:55:41.645 INFO:teuthology.orchestra.run.smithi155.stdout: "time": "2023-08-01T19:55:05.221689+0000", 2023-08-01T19:55:41.646 INFO:teuthology.orchestra.run.smithi155.stdout: "duration": 4.3078999999999999e-05 2023-08-01T19:55:41.646 INFO:teuthology.orchestra.run.smithi155.stdout: }, 2023-08-01T19:55:41.646 INFO:teuthology.orchestra.run.smithi155.stdout: { 2023-08-01T19:55:41.646 INFO:teuthology.orchestra.run.smithi155.stdout: "event": "done", 2023-08-01T19:55:41.646 INFO:teuthology.orchestra.run.smithi155.stdout: "time": "2023-08-01T19:55:05.221725+0000", 2023-08-01T19:55:41.646 INFO:teuthology.orchestra.run.smithi155.stdout: "duration": 3.6137999999999999e-05 2023-08-01T19:55:41.646 INFO:teuthology.orchestra.run.smithi155.stdout: } 2023-08-01T19:55:41.646 INFO:teuthology.orchestra.run.smithi155.stdout: ] 2023-08-01T19:55:41.647 INFO:teuthology.orchestra.run.smithi155.stdout: } 2023-08-01T19:55:41.647 INFO:teuthology.orchestra.run.smithi155.stdout: }, 2023-08-01T19:55:41.647 INFO:teuthology.orchestra.run.smithi155.stdout: { 2023-08-01T19:55:41.647 INFO:teuthology.orchestra.run.smithi155.stdout: "description": "osd_repop(client.4668.0:100243 5.a e37/19 5:5e8193b6:::benchmark_data_smithi006_114134_object100242:head v 37'6228, mlcod=37'6225)", 2023-08-01T19:55:41.647 INFO:teuthology.orchestra.run.smithi155.stdout: "initiated_at": "2023-08-01T19:55:05.151148+0000", 2023-08-01T19:55:41.647 INFO:teuthology.orchestra.run.smithi155.stdout: "age": 36.420477773000002, 2023-08-01T19:55:41.647 INFO:teuthology.orchestra.run.smithi155.stdout: "duration": 0.073020370000000001, 2023-08-01T19:55:41.647 INFO:teuthology.orchestra.run.smithi155.stdout: "type_data": { 2023-08-01T19:55:41.648 INFO:teuthology.orchestra.run.smithi155.stdout: "flag_point": "commit sent; apply or cleanup", 2023-08-01T19:55:41.648 INFO:teuthology.orchestra.run.smithi155.stdout: "events": [ 2023-08-01T19:55:41.648 INFO:teuthology.orchestra.run.smithi155.stdout: { 2023-08-01T19:55:41.648 INFO:teuthology.orchestra.run.smithi155.stdout: "event": "initiated", 2023-08-01T19:55:41.648 INFO:teuthology.orchestra.run.smithi155.stdout: "time": "2023-08-01T19:55:05.151148+0000", 2023-08-01T19:55:41.648 INFO:teuthology.orchestra.run.smithi155.stdout: "duration": 0 2023-08-01T19:55:41.648 INFO:teuthology.orchestra.run.smithi155.stdout: }, 2023-08-01T19:55:41.649 INFO:teuthology.orchestra.run.smithi155.stdout: { 2023-08-01T19:55:41.649 INFO:teuthology.orchestra.run.smithi155.stdout: "event": "throttled", 2023-08-01T19:55:41.649 INFO:teuthology.orchestra.run.smithi155.stdout: "time": "2023-08-01T19:55:05.151148+0000", 2023-08-01T19:55:41.649 INFO:teuthology.orchestra.run.smithi155.stdout: "duration": 0 2023-08-01T19:55:41.649 INFO:teuthology.orchestra.run.smithi155.stdout: }, 2023-08-01T19:55:41.649 INFO:teuthology.orchestra.run.smithi155.stdout: { 2023-08-01T19:55:41.649 INFO:teuthology.orchestra.run.smithi155.stdout: "event": "header_read", 2023-08-01T19:55:41.649 INFO:teuthology.orchestra.run.smithi155.stdout: "time": "2023-08-01T19:55:05.151147+0000", 2023-08-01T19:55:41.650 INFO:teuthology.orchestra.run.smithi155.stdout: "duration": 4294967295.9999995 2023-08-01T19:55:41.650 INFO:teuthology.orchestra.run.smithi155.stdout: }, 2023-08-01T19:55:41.650 INFO:teuthology.orchestra.run.smithi155.stdout: { 2023-08-01T19:55:41.650 INFO:teuthology.orchestra.run.smithi155.stdout: "event": "all_read", 2023-08-01T19:55:41.650 INFO:teuthology.orchestra.run.smithi155.stdout: "time": "2023-08-01T19:55:05.151231+0000", 2023-08-01T19:55:41.650 INFO:teuthology.orchestra.run.smithi155.stdout: "duration": 8.3135999999999998e-05 2023-08-01T19:55:41.650 INFO:teuthology.orchestra.run.smithi155.stdout: }, 2023-08-01T19:55:41.650 INFO:teuthology.orchestra.run.smithi155.stdout: { 2023-08-01T19:55:41.651 INFO:teuthology.orchestra.run.smithi155.stdout: "event": "dispatched", 2023-08-01T19:55:41.651 INFO:teuthology.orchestra.run.smithi155.stdout: "time": "2023-08-01T19:55:05.151239+0000", 2023-08-01T19:55:41.651 INFO:teuthology.orchestra.run.smithi155.stdout: "duration": 8.7469999999999994e-06 2023-08-01T19:55:41.651 INFO:teuthology.orchestra.run.smithi155.stdout: }, 2023-08-01T19:55:41.651 INFO:teuthology.orchestra.run.smithi155.stdout: { 2023-08-01T19:55:41.651 INFO:teuthology.orchestra.run.smithi155.stdout: "event": "queued_for_pg", 2023-08-01T19:55:41.652 INFO:teuthology.orchestra.run.smithi155.stdout: "time": "2023-08-01T19:55:05.151244+0000", 2023-08-01T19:55:41.652 INFO:teuthology.orchestra.run.smithi155.stdout: "duration": 4.4800000000000003e-06 2023-08-01T19:55:41.652 INFO:teuthology.orchestra.run.smithi155.stdout: }, 2023-08-01T19:55:41.652 INFO:teuthology.orchestra.run.smithi155.stdout: { 2023-08-01T19:55:41.652 INFO:teuthology.orchestra.run.smithi155.stdout: "event": "reached_pg", 2023-08-01T19:55:41.652 INFO:teuthology.orchestra.run.smithi155.stdout: "time": "2023-08-01T19:55:05.152938+0000", 2023-08-01T19:55:41.653 INFO:teuthology.orchestra.run.smithi155.stdout: "duration": 0.001693824 2023-08-01T19:55:41.653 INFO:teuthology.orchestra.run.smithi155.stdout: }, 2023-08-01T19:55:41.653 INFO:teuthology.orchestra.run.smithi155.stdout: { 2023-08-01T19:55:41.653 INFO:teuthology.orchestra.run.smithi155.stdout: "event": "started", 2023-08-01T19:55:41.653 INFO:teuthology.orchestra.run.smithi155.stdout: "time": "2023-08-01T19:55:05.152956+0000", 2023-08-01T19:55:41.653 INFO:teuthology.orchestra.run.smithi155.stdout: "duration": 1.8287e-05 2023-08-01T19:55:41.653 INFO:teuthology.orchestra.run.smithi155.stdout: }, 2023-08-01T19:55:41.654 INFO:teuthology.orchestra.run.smithi155.stdout: { 2023-08-01T19:55:41.654 INFO:teuthology.orchestra.run.smithi155.stdout: "event": "commit_sent", 2023-08-01T19:55:41.654 INFO:teuthology.orchestra.run.smithi155.stdout: "time": "2023-08-01T19:55:05.224145+0000", 2023-08-01T19:55:41.654 INFO:teuthology.orchestra.run.smithi155.stdout: "duration": 0.071189447000000003 2023-08-01T19:55:41.654 INFO:teuthology.orchestra.run.smithi155.stdout: }, 2023-08-01T19:55:41.654 INFO:teuthology.orchestra.run.smithi155.stdout: { 2023-08-01T19:55:41.654 INFO:teuthology.orchestra.run.smithi155.stdout: "event": "done", 2023-08-01T19:55:41.654 INFO:teuthology.orchestra.run.smithi155.stdout: "time": "2023-08-01T19:55:05.224168+0000", 2023-08-01T19:55:41.655 INFO:teuthology.orchestra.run.smithi155.stdout: "duration": 2.3008999999999999e-05 2023-08-01T19:55:41.655 INFO:teuthology.orchestra.run.smithi155.stdout: } 2023-08-01T19:55:41.655 INFO:teuthology.orchestra.run.smithi155.stdout: ] 2023-08-01T19:55:41.655 INFO:teuthology.orchestra.run.smithi155.stdout: } 2023-08-01T19:55:41.655 INFO:teuthology.orchestra.run.smithi155.stdout: }, 2023-08-01T19:55:41.655 INFO:teuthology.orchestra.run.smithi155.stdout: { 2023-08-01T19:55:41.655 INFO:teuthology.orchestra.run.smithi155.stdout: "description": "osd_repop(client.4668.0:100244 5.9 e37/19 5:92f56a12:::benchmark_data_smithi006_114134_object100243:head v 37'6294, mlcod=37'6292)", 2023-08-01T19:55:41.655 INFO:teuthology.orchestra.run.smithi155.stdout: "initiated_at": "2023-08-01T19:55:05.151325+0000", 2023-08-01T19:55:41.656 INFO:teuthology.orchestra.run.smithi155.stdout: "age": 36.420300427999997, 2023-08-01T19:55:41.656 INFO:teuthology.orchestra.run.smithi155.stdout: "duration": 0.071883673999999995, 2023-08-01T19:55:41.656 INFO:teuthology.orchestra.run.smithi155.stdout: "type_data": { 2023-08-01T19:55:41.656 INFO:teuthology.orchestra.run.smithi155.stdout: "flag_point": "commit sent; apply or cleanup", 2023-08-01T19:55:41.656 INFO:teuthology.orchestra.run.smithi155.stdout: "events": [ 2023-08-01T19:55:41.656 INFO:teuthology.orchestra.run.smithi155.stdout: { 2023-08-01T19:55:41.656 INFO:teuthology.orchestra.run.smithi155.stdout: "event": "initiated", 2023-08-01T19:55:41.657 INFO:teuthology.orchestra.run.smithi155.stdout: "time": "2023-08-01T19:55:05.151325+0000", 2023-08-01T19:55:41.657 INFO:teuthology.orchestra.run.smithi155.stdout: "duration": 0 2023-08-01T19:55:41.657 INFO:teuthology.orchestra.run.smithi155.stdout: }, 2023-08-01T19:55:41.657 INFO:teuthology.orchestra.run.smithi155.stdout: { 2023-08-01T19:55:41.657 INFO:teuthology.orchestra.run.smithi155.stdout: "event": "throttled", 2023-08-01T19:55:41.657 INFO:teuthology.orchestra.run.smithi155.stdout: "time": "2023-08-01T19:55:05.151325+0000", 2023-08-01T19:55:41.657 INFO:teuthology.orchestra.run.smithi155.stdout: "duration": 0 2023-08-01T19:55:41.658 INFO:teuthology.orchestra.run.smithi155.stdout: }, 2023-08-01T19:55:41.658 INFO:teuthology.orchestra.run.smithi155.stdout: { 2023-08-01T19:55:41.658 INFO:teuthology.orchestra.run.smithi155.stdout: "event": "header_read", 2023-08-01T19:55:41.658 INFO:teuthology.orchestra.run.smithi155.stdout: "time": "2023-08-01T19:55:05.151325+0000", 2023-08-01T19:55:41.658 INFO:teuthology.orchestra.run.smithi155.stdout: "duration": 4294967295.9999995 2023-08-01T19:55:41.658 INFO:teuthology.orchestra.run.smithi155.stdout: }, 2023-08-01T19:55:41.658 INFO:teuthology.orchestra.run.smithi155.stdout: { 2023-08-01T19:55:41.658 INFO:teuthology.orchestra.run.smithi155.stdout: "event": "all_read", 2023-08-01T19:55:41.659 INFO:teuthology.orchestra.run.smithi155.stdout: "time": "2023-08-01T19:55:05.151390+0000", 2023-08-01T19:55:41.659 INFO:teuthology.orchestra.run.smithi155.stdout: "duration": 6.5456999999999993e-05 2023-08-01T19:55:41.659 INFO:teuthology.orchestra.run.smithi155.stdout: }, 2023-08-01T19:55:41.659 INFO:teuthology.orchestra.run.smithi155.stdout: { 2023-08-01T19:55:41.659 INFO:teuthology.orchestra.run.smithi155.stdout: "event": "dispatched", 2023-08-01T19:55:41.659 INFO:teuthology.orchestra.run.smithi155.stdout: "time": "2023-08-01T19:55:05.151396+0000", 2023-08-01T19:55:41.659 INFO:teuthology.orchestra.run.smithi155.stdout: "duration": 5.9190000000000004e-06 2023-08-01T19:55:41.659 INFO:teuthology.orchestra.run.smithi155.stdout: }, 2023-08-01T19:55:41.660 INFO:teuthology.orchestra.run.smithi155.stdout: { 2023-08-01T19:55:41.660 INFO:teuthology.orchestra.run.smithi155.stdout: "event": "queued_for_pg", 2023-08-01T19:55:41.660 INFO:teuthology.orchestra.run.smithi155.stdout: "time": "2023-08-01T19:55:05.151400+0000", 2023-08-01T19:55:41.660 INFO:teuthology.orchestra.run.smithi155.stdout: "duration": 4.1030000000000004e-06 2023-08-01T19:55:41.660 INFO:teuthology.orchestra.run.smithi155.stdout: }, 2023-08-01T19:55:41.660 INFO:teuthology.orchestra.run.smithi155.stdout: { 2023-08-01T19:55:41.660 INFO:teuthology.orchestra.run.smithi155.stdout: "event": "reached_pg", 2023-08-01T19:55:41.661 INFO:teuthology.orchestra.run.smithi155.stdout: "time": "2023-08-01T19:55:05.151452+0000", 2023-08-01T19:55:41.661 INFO:teuthology.orchestra.run.smithi155.stdout: "duration": 5.2136999999999999e-05 2023-08-01T19:55:41.661 INFO:teuthology.orchestra.run.smithi155.stdout: }, 2023-08-01T19:55:41.661 INFO:teuthology.orchestra.run.smithi155.stdout: { 2023-08-01T19:55:41.661 INFO:teuthology.orchestra.run.smithi155.stdout: "event": "started", 2023-08-01T19:55:41.661 INFO:teuthology.orchestra.run.smithi155.stdout: "time": "2023-08-01T19:55:05.151470+0000", 2023-08-01T19:55:41.661 INFO:teuthology.orchestra.run.smithi155.stdout: "duration": 1.8e-05 2023-08-01T19:55:41.661 INFO:teuthology.orchestra.run.smithi155.stdout: }, 2023-08-01T19:55:41.662 INFO:teuthology.orchestra.run.smithi155.stdout: { 2023-08-01T19:55:41.662 INFO:teuthology.orchestra.run.smithi155.stdout: "event": "commit_sent", 2023-08-01T19:55:41.662 INFO:teuthology.orchestra.run.smithi155.stdout: "time": "2023-08-01T19:55:05.223183+0000", 2023-08-01T19:55:41.662 INFO:teuthology.orchestra.run.smithi155.stdout: "duration": 0.071712622000000004 2023-08-01T19:55:41.662 INFO:teuthology.orchestra.run.smithi155.stdout: }, 2023-08-01T19:55:41.662 INFO:teuthology.orchestra.run.smithi155.stdout: { 2023-08-01T19:55:41.662 INFO:teuthology.orchestra.run.smithi155.stdout: "event": "done", 2023-08-01T19:55:41.662 INFO:teuthology.orchestra.run.smithi155.stdout: "time": "2023-08-01T19:55:05.223209+0000", 2023-08-01T19:55:41.663 INFO:teuthology.orchestra.run.smithi155.stdout: "duration": 2.5956e-05 2023-08-01T19:55:41.663 INFO:teuthology.orchestra.run.smithi155.stdout: } 2023-08-01T19:55:41.663 INFO:teuthology.orchestra.run.smithi155.stdout: ] 2023-08-01T19:55:41.663 INFO:teuthology.orchestra.run.smithi155.stdout: } 2023-08-01T19:55:41.663 INFO:teuthology.orchestra.run.smithi155.stdout: }, 2023-08-01T19:55:41.663 INFO:teuthology.orchestra.run.smithi155.stdout: { 2023-08-01T19:55:41.663 INFO:teuthology.orchestra.run.smithi155.stdout: "description": "osd_op(client.4668.0:100249 5.b 5:d0666827:::benchmark_data_smithi006_114134_object100248:head [set-alloc-hint object_size 65536 write_size 65536,write 0~65536] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e37)", 2023-08-01T19:55:41.663 INFO:teuthology.orchestra.run.smithi155.stdout: "initiated_at": "2023-08-01T19:55:05.153614+0000", 2023-08-01T19:55:41.664 INFO:teuthology.orchestra.run.smithi155.stdout: "age": 36.418012003000001, 2023-08-01T19:55:41.664 INFO:teuthology.orchestra.run.smithi155.stdout: "duration": 0.069286118999999993, 2023-08-01T19:55:41.664 INFO:teuthology.orchestra.run.smithi155.stdout: "type_data": { 2023-08-01T19:55:41.664 INFO:teuthology.orchestra.run.smithi155.stdout: "flag_point": "commit sent; apply or cleanup", 2023-08-01T19:55:41.664 INFO:teuthology.orchestra.run.smithi155.stdout: "client_info": { 2023-08-01T19:55:41.664 INFO:teuthology.orchestra.run.smithi155.stdout: "client": "client.4668", 2023-08-01T19:55:41.664 INFO:teuthology.orchestra.run.smithi155.stdout: "client_addr": "172.21.15.6:0/1709472247", 2023-08-01T19:55:41.664 INFO:teuthology.orchestra.run.smithi155.stdout: "tid": 100249 2023-08-01T19:55:41.665 INFO:teuthology.orchestra.run.smithi155.stdout: }, 2023-08-01T19:55:41.665 INFO:teuthology.orchestra.run.smithi155.stdout: "events": [ 2023-08-01T19:55:41.665 INFO:teuthology.orchestra.run.smithi155.stdout: { 2023-08-01T19:55:41.665 INFO:teuthology.orchestra.run.smithi155.stdout: "event": "initiated", 2023-08-01T19:55:41.665 INFO:teuthology.orchestra.run.smithi155.stdout: "time": "2023-08-01T19:55:05.153614+0000", 2023-08-01T19:55:41.665 INFO:teuthology.orchestra.run.smithi155.stdout: "duration": 0 2023-08-01T19:55:41.665 INFO:teuthology.orchestra.run.smithi155.stdout: }, 2023-08-01T19:55:41.666 INFO:teuthology.orchestra.run.smithi155.stdout: { 2023-08-01T19:55:41.666 INFO:teuthology.orchestra.run.smithi155.stdout: "event": "throttled", 2023-08-01T19:55:41.666 INFO:teuthology.orchestra.run.smithi155.stdout: "time": "2023-08-01T19:55:05.153614+0000", 2023-08-01T19:55:41.666 INFO:teuthology.orchestra.run.smithi155.stdout: "duration": 0 2023-08-01T19:55:41.666 INFO:teuthology.orchestra.run.smithi155.stdout: }, 2023-08-01T19:55:41.666 INFO:teuthology.orchestra.run.smithi155.stdout: { 2023-08-01T19:55:41.666 INFO:teuthology.orchestra.run.smithi155.stdout: "event": "header_read", 2023-08-01T19:55:41.666 INFO:teuthology.orchestra.run.smithi155.stdout: "time": "2023-08-01T19:55:05.153612+0000", 2023-08-01T19:55:41.667 INFO:teuthology.orchestra.run.smithi155.stdout: "duration": 4294967295.9999986 2023-08-01T19:55:41.667 INFO:teuthology.orchestra.run.smithi155.stdout: }, 2023-08-01T19:55:41.667 INFO:teuthology.orchestra.run.smithi155.stdout: { 2023-08-01T19:55:41.667 INFO:teuthology.orchestra.run.smithi155.stdout: "event": "all_read", 2023-08-01T19:55:41.667 INFO:teuthology.orchestra.run.smithi155.stdout: "time": "2023-08-01T19:55:05.153694+0000", 2023-08-01T19:55:41.667 INFO:teuthology.orchestra.run.smithi155.stdout: "duration": 8.1618000000000004e-05 2023-08-01T19:55:41.667 INFO:teuthology.orchestra.run.smithi155.stdout: }, 2023-08-01T19:55:41.667 INFO:teuthology.orchestra.run.smithi155.stdout: { 2023-08-01T19:55:41.668 INFO:teuthology.orchestra.run.smithi155.stdout: "event": "dispatched", 2023-08-01T19:55:41.668 INFO:teuthology.orchestra.run.smithi155.stdout: "time": "2023-08-01T19:55:05.153713+0000", 2023-08-01T19:55:41.668 INFO:teuthology.orchestra.run.smithi155.stdout: "duration": 1.9069999999999999e-05 2023-08-01T19:55:41.668 INFO:teuthology.orchestra.run.smithi155.stdout: }, 2023-08-01T19:55:41.668 INFO:teuthology.orchestra.run.smithi155.stdout: { 2023-08-01T19:55:41.668 INFO:teuthology.orchestra.run.smithi155.stdout: "event": "queued_for_pg", 2023-08-01T19:55:41.668 INFO:teuthology.orchestra.run.smithi155.stdout: "time": "2023-08-01T19:55:05.153726+0000", 2023-08-01T19:55:41.669 INFO:teuthology.orchestra.run.smithi155.stdout: "duration": 1.238e-05 2023-08-01T19:55:41.669 INFO:teuthology.orchestra.run.smithi155.stdout: }, 2023-08-01T19:55:41.669 INFO:teuthology.orchestra.run.smithi155.stdout: { 2023-08-01T19:55:41.669 INFO:teuthology.orchestra.run.smithi155.stdout: "event": "reached_pg", 2023-08-01T19:55:41.669 INFO:teuthology.orchestra.run.smithi155.stdout: "time": "2023-08-01T19:55:05.153761+0000", 2023-08-01T19:55:41.669 INFO:teuthology.orchestra.run.smithi155.stdout: "duration": 3.5046999999999998e-05 2023-08-01T19:55:41.670 INFO:teuthology.orchestra.run.smithi155.stdout: }, 2023-08-01T19:55:41.670 INFO:teuthology.orchestra.run.smithi155.stdout: { 2023-08-01T19:55:41.670 INFO:teuthology.orchestra.run.smithi155.stdout: "event": "started", 2023-08-01T19:55:41.670 INFO:teuthology.orchestra.run.smithi155.stdout: "time": "2023-08-01T19:55:05.153896+0000", 2023-08-01T19:55:41.670 INFO:teuthology.orchestra.run.smithi155.stdout: "duration": 0.00013575800000000001 2023-08-01T19:55:41.671 INFO:teuthology.orchestra.run.smithi155.stdout: }, 2023-08-01T19:55:41.671 INFO:teuthology.orchestra.run.smithi155.stdout: { 2023-08-01T19:55:41.671 INFO:teuthology.orchestra.run.smithi155.stdout: "event": "waiting for subops from 0", 2023-08-01T19:55:41.671 INFO:teuthology.orchestra.run.smithi155.stdout: "time": "2023-08-01T19:55:05.154043+0000", 2023-08-01T19:55:41.671 INFO:teuthology.orchestra.run.smithi155.stdout: "duration": 0.00014650700000000001 2023-08-01T19:55:41.671 INFO:teuthology.orchestra.run.smithi155.stdout: }, 2023-08-01T19:55:41.672 INFO:teuthology.orchestra.run.smithi155.stdout: { 2023-08-01T19:55:41.672 INFO:teuthology.orchestra.run.smithi155.stdout: "event": "sub_op_commit_rec", 2023-08-01T19:55:41.672 INFO:teuthology.orchestra.run.smithi155.stdout: "time": "2023-08-01T19:55:05.221876+0000", 2023-08-01T19:55:41.672 INFO:teuthology.orchestra.run.smithi155.stdout: "duration": 0.067832796000000001 2023-08-01T19:55:41.672 INFO:teuthology.orchestra.run.smithi155.stdout: }, 2023-08-01T19:55:41.672 INFO:teuthology.orchestra.run.smithi155.stdout: { 2023-08-01T19:55:41.672 INFO:teuthology.orchestra.run.smithi155.stdout: "event": "op_commit", 2023-08-01T19:55:41.672 INFO:teuthology.orchestra.run.smithi155.stdout: "time": "2023-08-01T19:55:05.222813+0000", 2023-08-01T19:55:41.673 INFO:teuthology.orchestra.run.smithi155.stdout: "duration": 0.00093755300000000004 2023-08-01T19:55:41.673 INFO:teuthology.orchestra.run.smithi155.stdout: }, 2023-08-01T19:55:41.673 INFO:teuthology.orchestra.run.smithi155.stdout: { 2023-08-01T19:55:41.673 INFO:teuthology.orchestra.run.smithi155.stdout: "event": "commit_sent", 2023-08-01T19:55:41.673 INFO:teuthology.orchestra.run.smithi155.stdout: "time": "2023-08-01T19:55:05.222861+0000", 2023-08-01T19:55:41.673 INFO:teuthology.orchestra.run.smithi155.stdout: "duration": 4.8013999999999998e-05 2023-08-01T19:55:41.673 INFO:teuthology.orchestra.run.smithi155.stdout: }, 2023-08-01T19:55:41.673 INFO:teuthology.orchestra.run.smithi155.stdout: { 2023-08-01T19:55:41.674 INFO:teuthology.orchestra.run.smithi155.stdout: "event": "done", 2023-08-01T19:55:41.674 INFO:teuthology.orchestra.run.smithi155.stdout: "time": "2023-08-01T19:55:05.222900+0000", 2023-08-01T19:55:41.674 INFO:teuthology.orchestra.run.smithi155.stdout: "duration": 3.8634999999999999e-05 2023-08-01T19:55:41.674 INFO:teuthology.orchestra.run.smithi155.stdout: } 2023-08-01T19:55:41.674 INFO:teuthology.orchestra.run.smithi155.stdout: ] 2023-08-01T19:55:41.674 INFO:teuthology.orchestra.run.smithi155.stdout: } 2023-08-01T19:55:41.674 INFO:teuthology.orchestra.run.smithi155.stdout: }, 2023-08-01T19:55:41.674 INFO:teuthology.orchestra.run.smithi155.stdout: { 2023-08-01T19:55:41.675 INFO:teuthology.orchestra.run.smithi155.stdout: "description": "osd_op(client.4668.0:100251 5.b 5:d853df24:::benchmark_data_smithi006_114134_object100250:head [set-alloc-hint object_size 65536 write_size 65536,write 0~65536] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e37)", 2023-08-01T19:55:41.675 INFO:teuthology.orchestra.run.smithi155.stdout: "initiated_at": "2023-08-01T19:55:05.153737+0000", 2023-08-01T19:55:41.675 INFO:teuthology.orchestra.run.smithi155.stdout: "age": 36.417888988999998, 2023-08-01T19:55:41.675 INFO:teuthology.orchestra.run.smithi155.stdout: "duration": 0.071366545000000003, 2023-08-01T19:55:41.675 INFO:teuthology.orchestra.run.smithi155.stdout: "type_data": { 2023-08-01T19:55:41.675 INFO:teuthology.orchestra.run.smithi155.stdout: "flag_point": "commit sent; apply or cleanup", 2023-08-01T19:55:41.675 INFO:teuthology.orchestra.run.smithi155.stdout: "client_info": { 2023-08-01T19:55:41.676 INFO:teuthology.orchestra.run.smithi155.stdout: "client": "client.4668", 2023-08-01T19:55:41.676 INFO:teuthology.orchestra.run.smithi155.stdout: "client_addr": "172.21.15.6:0/1709472247", 2023-08-01T19:55:41.676 INFO:teuthology.orchestra.run.smithi155.stdout: "tid": 100251 2023-08-01T19:55:41.676 INFO:teuthology.orchestra.run.smithi155.stdout: }, 2023-08-01T19:55:41.676 INFO:teuthology.orchestra.run.smithi155.stdout: "events": [ 2023-08-01T19:55:41.676 INFO:teuthology.orchestra.run.smithi155.stdout: { 2023-08-01T19:55:41.676 INFO:teuthology.orchestra.run.smithi155.stdout: "event": "initiated", 2023-08-01T19:55:41.676 INFO:teuthology.orchestra.run.smithi155.stdout: "time": "2023-08-01T19:55:05.153737+0000", 2023-08-01T19:55:41.677 INFO:teuthology.orchestra.run.smithi155.stdout: "duration": 0 2023-08-01T19:55:41.677 INFO:teuthology.orchestra.run.smithi155.stdout: }, 2023-08-01T19:55:41.677 INFO:teuthology.orchestra.run.smithi155.stdout: { 2023-08-01T19:55:41.677 INFO:teuthology.orchestra.run.smithi155.stdout: "event": "throttled", 2023-08-01T19:55:41.677 INFO:teuthology.orchestra.run.smithi155.stdout: "time": "2023-08-01T19:55:05.153737+0000", 2023-08-01T19:55:41.677 INFO:teuthology.orchestra.run.smithi155.stdout: "duration": 0 2023-08-01T19:55:41.677 INFO:teuthology.orchestra.run.smithi155.stdout: }, 2023-08-01T19:55:41.678 INFO:teuthology.orchestra.run.smithi155.stdout: { 2023-08-01T19:55:41.678 INFO:teuthology.orchestra.run.smithi155.stdout: "event": "header_read", 2023-08-01T19:55:41.678 INFO:teuthology.orchestra.run.smithi155.stdout: "time": "2023-08-01T19:55:05.153736+0000", 2023-08-01T19:55:41.678 INFO:teuthology.orchestra.run.smithi155.stdout: "duration": 4294967295.9999995 2023-08-01T19:55:41.678 INFO:teuthology.orchestra.run.smithi155.stdout: }, 2023-08-01T19:55:41.678 INFO:teuthology.orchestra.run.smithi155.stdout: { 2023-08-01T19:55:41.678 INFO:teuthology.orchestra.run.smithi155.stdout: "event": "all_read", 2023-08-01T19:55:41.679 INFO:teuthology.orchestra.run.smithi155.stdout: "time": "2023-08-01T19:55:05.153784+0000", 2023-08-01T19:55:41.679 INFO:teuthology.orchestra.run.smithi155.stdout: "duration": 4.7660000000000001e-05 2023-08-01T19:55:41.679 INFO:teuthology.orchestra.run.smithi155.stdout: }, 2023-08-01T19:55:41.679 INFO:teuthology.orchestra.run.smithi155.stdout: { 2023-08-01T19:55:41.679 INFO:teuthology.orchestra.run.smithi155.stdout: "event": "dispatched", 2023-08-01T19:55:41.679 INFO:teuthology.orchestra.run.smithi155.stdout: "time": "2023-08-01T19:55:05.153793+0000", 2023-08-01T19:55:41.679 INFO:teuthology.orchestra.run.smithi155.stdout: "duration": 8.7150000000000004e-06 2023-08-01T19:55:41.679 INFO:teuthology.orchestra.run.smithi155.stdout: }, 2023-08-01T19:55:41.680 INFO:teuthology.orchestra.run.smithi155.stdout: { 2023-08-01T19:55:41.680 INFO:teuthology.orchestra.run.smithi155.stdout: "event": "queued_for_pg", 2023-08-01T19:55:41.680 INFO:teuthology.orchestra.run.smithi155.stdout: "time": "2023-08-01T19:55:05.153800+0000", 2023-08-01T19:55:41.680 INFO:teuthology.orchestra.run.smithi155.stdout: "duration": 7.2459999999999997e-06 2023-08-01T19:55:41.680 INFO:teuthology.orchestra.run.smithi155.stdout: }, 2023-08-01T19:55:41.680 INFO:teuthology.orchestra.run.smithi155.stdout: { 2023-08-01T19:55:41.680 INFO:teuthology.orchestra.run.smithi155.stdout: "event": "reached_pg", 2023-08-01T19:55:41.680 INFO:teuthology.orchestra.run.smithi155.stdout: "time": "2023-08-01T19:55:05.156241+0000", 2023-08-01T19:55:41.681 INFO:teuthology.orchestra.run.smithi155.stdout: "duration": 0.0024415359999999998 2023-08-01T19:55:41.681 INFO:teuthology.orchestra.run.smithi155.stdout: }, 2023-08-01T19:55:41.681 INFO:teuthology.orchestra.run.smithi155.stdout: { 2023-08-01T19:55:41.681 INFO:teuthology.orchestra.run.smithi155.stdout: "event": "started", 2023-08-01T19:55:41.681 INFO:teuthology.orchestra.run.smithi155.stdout: "time": "2023-08-01T19:55:05.219045+0000", 2023-08-01T19:55:41.681 INFO:teuthology.orchestra.run.smithi155.stdout: "duration": 0.062803855000000006 2023-08-01T19:55:41.681 INFO:teuthology.orchestra.run.smithi155.stdout: }, 2023-08-01T19:55:41.681 INFO:teuthology.orchestra.run.smithi155.stdout: { 2023-08-01T19:55:41.682 INFO:teuthology.orchestra.run.smithi155.stdout: "event": "waiting for subops from 0", 2023-08-01T19:55:41.682 INFO:teuthology.orchestra.run.smithi155.stdout: "time": "2023-08-01T19:55:05.219238+0000", 2023-08-01T19:55:41.682 INFO:teuthology.orchestra.run.smithi155.stdout: "duration": 0.00019241500000000001 2023-08-01T19:55:41.682 INFO:teuthology.orchestra.run.smithi155.stdout: }, 2023-08-01T19:55:41.682 INFO:teuthology.orchestra.run.smithi155.stdout: { 2023-08-01T19:55:41.682 INFO:teuthology.orchestra.run.smithi155.stdout: "event": "sub_op_commit_rec", 2023-08-01T19:55:41.682 INFO:teuthology.orchestra.run.smithi155.stdout: "time": "2023-08-01T19:55:05.223300+0000", 2023-08-01T19:55:41.683 INFO:teuthology.orchestra.run.smithi155.stdout: "duration": 0.0040626509999999996 2023-08-01T19:55:41.683 INFO:teuthology.orchestra.run.smithi155.stdout: }, 2023-08-01T19:55:41.683 INFO:teuthology.orchestra.run.smithi155.stdout: { 2023-08-01T19:55:41.683 INFO:teuthology.orchestra.run.smithi155.stdout: "event": "op_commit", 2023-08-01T19:55:41.683 INFO:teuthology.orchestra.run.smithi155.stdout: "time": "2023-08-01T19:55:05.225020+0000", 2023-08-01T19:55:41.683 INFO:teuthology.orchestra.run.smithi155.stdout: "duration": 0.0017201 2023-08-01T19:55:41.683 INFO:teuthology.orchestra.run.smithi155.stdout: }, 2023-08-01T19:55:41.683 INFO:teuthology.orchestra.run.smithi155.stdout: { 2023-08-01T19:55:41.684 INFO:teuthology.orchestra.run.smithi155.stdout: "event": "commit_sent", 2023-08-01T19:55:41.684 INFO:teuthology.orchestra.run.smithi155.stdout: "time": "2023-08-01T19:55:05.225066+0000", 2023-08-01T19:55:41.684 INFO:teuthology.orchestra.run.smithi155.stdout: "duration": 4.6143000000000002e-05 2023-08-01T19:55:41.684 INFO:teuthology.orchestra.run.smithi155.stdout: }, 2023-08-01T19:55:41.684 INFO:teuthology.orchestra.run.smithi155.stdout: { 2023-08-01T19:55:41.684 INFO:teuthology.orchestra.run.smithi155.stdout: "event": "done", 2023-08-01T19:55:41.684 INFO:teuthology.orchestra.run.smithi155.stdout: "time": "2023-08-01T19:55:05.225103+0000", 2023-08-01T19:55:41.684 INFO:teuthology.orchestra.run.smithi155.stdout: "duration": 3.6789999999999998e-05 2023-08-01T19:55:41.685 INFO:teuthology.orchestra.run.smithi155.stdout: } 2023-08-01T19:55:41.685 INFO:teuthology.orchestra.run.smithi155.stdout: ] 2023-08-01T19:55:41.685 INFO:teuthology.orchestra.run.smithi155.stdout: } 2023-08-01T19:55:41.685 INFO:teuthology.orchestra.run.smithi155.stdout: }, 2023-08-01T19:55:41.685 INFO:teuthology.orchestra.run.smithi155.stdout: { 2023-08-01T19:55:41.685 INFO:teuthology.orchestra.run.smithi155.stdout: "description": "osd_op(client.4668.0:100252 5.0 5:01f90c3c:::benchmark_data_smithi006_114134_object100251:head [set-alloc-hint object_size 65536 write_size 65536,write 0~65536] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e37)", 2023-08-01T19:55:41.685 INFO:teuthology.orchestra.run.smithi155.stdout: "initiated_at": "2023-08-01T19:55:05.154048+0000", 2023-08-01T19:55:41.686 INFO:teuthology.orchestra.run.smithi155.stdout: "age": 36.417577741999999, 2023-08-01T19:55:41.686 INFO:teuthology.orchestra.run.smithi155.stdout: "duration": 0.070156683999999997, 2023-08-01T19:55:41.686 INFO:teuthology.orchestra.run.smithi155.stdout: "type_data": { 2023-08-01T19:55:41.686 INFO:teuthology.orchestra.run.smithi155.stdout: "flag_point": "commit sent; apply or cleanup", 2023-08-01T19:55:41.686 INFO:teuthology.orchestra.run.smithi155.stdout: "client_info": { 2023-08-01T19:55:41.686 INFO:teuthology.orchestra.run.smithi155.stdout: "client": "client.4668", 2023-08-01T19:55:41.686 INFO:teuthology.orchestra.run.smithi155.stdout: "client_addr": "172.21.15.6:0/1709472247", 2023-08-01T19:55:41.686 INFO:teuthology.orchestra.run.smithi155.stdout: "tid": 100252 2023-08-01T19:55:41.687 INFO:teuthology.orchestra.run.smithi155.stdout: }, 2023-08-01T19:55:41.687 INFO:teuthology.orchestra.run.smithi155.stdout: "events": [ 2023-08-01T19:55:41.687 INFO:teuthology.orchestra.run.smithi155.stdout: { 2023-08-01T19:55:41.687 INFO:teuthology.orchestra.run.smithi155.stdout: "event": "initiated", 2023-08-01T19:55:41.687 INFO:teuthology.orchestra.run.smithi155.stdout: "time": "2023-08-01T19:55:05.154048+0000", 2023-08-01T19:55:41.687 INFO:teuthology.orchestra.run.smithi155.stdout: "duration": 0 2023-08-01T19:55:41.687 INFO:teuthology.orchestra.run.smithi155.stdout: }, 2023-08-01T19:55:41.687 INFO:teuthology.orchestra.run.smithi155.stdout: { 2023-08-01T19:55:41.688 INFO:teuthology.orchestra.run.smithi155.stdout: "event": "throttled", 2023-08-01T19:55:41.688 INFO:teuthology.orchestra.run.smithi155.stdout: "time": "2023-08-01T19:55:05.154048+0000", 2023-08-01T19:55:41.688 INFO:teuthology.orchestra.run.smithi155.stdout: "duration": 0 2023-08-01T19:55:41.688 INFO:teuthology.orchestra.run.smithi155.stdout: }, 2023-08-01T19:55:41.688 INFO:teuthology.orchestra.run.smithi155.stdout: { 2023-08-01T19:55:41.688 INFO:teuthology.orchestra.run.smithi155.stdout: "event": "header_read", 2023-08-01T19:55:41.688 INFO:teuthology.orchestra.run.smithi155.stdout: "time": "2023-08-01T19:55:05.154047+0000", 2023-08-01T19:55:41.689 INFO:teuthology.orchestra.run.smithi155.stdout: "duration": 4294967295.999999 2023-08-01T19:55:41.689 INFO:teuthology.orchestra.run.smithi155.stdout: }, 2023-08-01T19:55:41.689 INFO:teuthology.orchestra.run.smithi155.stdout: { 2023-08-01T19:55:41.689 INFO:teuthology.orchestra.run.smithi155.stdout: "event": "all_read", 2023-08-01T19:55:41.689 INFO:teuthology.orchestra.run.smithi155.stdout: "time": "2023-08-01T19:55:05.154115+0000", 2023-08-01T19:55:41.690 INFO:teuthology.orchestra.run.smithi155.stdout: "duration": 6.7545999999999993e-05 2023-08-01T19:55:41.690 INFO:teuthology.orchestra.run.smithi155.stdout: }, 2023-08-01T19:55:41.690 INFO:teuthology.orchestra.run.smithi155.stdout: { 2023-08-01T19:55:41.690 INFO:teuthology.orchestra.run.smithi155.stdout: "event": "dispatched", 2023-08-01T19:55:41.690 INFO:teuthology.orchestra.run.smithi155.stdout: "time": "2023-08-01T19:55:05.154125+0000", 2023-08-01T19:55:41.690 INFO:teuthology.orchestra.run.smithi155.stdout: "duration": 1.0669000000000001e-05 2023-08-01T19:55:41.690 INFO:teuthology.orchestra.run.smithi155.stdout: }, 2023-08-01T19:55:41.690 INFO:teuthology.orchestra.run.smithi155.stdout: { 2023-08-01T19:55:41.691 INFO:teuthology.orchestra.run.smithi155.stdout: "event": "queued_for_pg", 2023-08-01T19:55:41.691 INFO:teuthology.orchestra.run.smithi155.stdout: "time": "2023-08-01T19:55:05.154131+0000", 2023-08-01T19:55:41.691 INFO:teuthology.orchestra.run.smithi155.stdout: "duration": 6.0349999999999998e-06 2023-08-01T19:55:41.691 INFO:teuthology.orchestra.run.smithi155.stdout: }, 2023-08-01T19:55:41.691 INFO:teuthology.orchestra.run.smithi155.stdout: { 2023-08-01T19:55:41.691 INFO:teuthology.orchestra.run.smithi155.stdout: "event": "reached_pg", 2023-08-01T19:55:41.691 INFO:teuthology.orchestra.run.smithi155.stdout: "time": "2023-08-01T19:55:05.154174+0000", 2023-08-01T19:55:41.691 INFO:teuthology.orchestra.run.smithi155.stdout: "duration": 4.2429000000000003e-05 2023-08-01T19:55:41.692 INFO:teuthology.orchestra.run.smithi155.stdout: }, 2023-08-01T19:55:41.692 INFO:teuthology.orchestra.run.smithi155.stdout: { 2023-08-01T19:55:41.692 INFO:teuthology.orchestra.run.smithi155.stdout: "event": "started", 2023-08-01T19:55:41.692 INFO:teuthology.orchestra.run.smithi155.stdout: "time": "2023-08-01T19:55:05.154287+0000", 2023-08-01T19:55:41.692 INFO:teuthology.orchestra.run.smithi155.stdout: "duration": 0.000113138 2023-08-01T19:55:41.692 INFO:teuthology.orchestra.run.smithi155.stdout: }, 2023-08-01T19:55:41.693 INFO:teuthology.orchestra.run.smithi155.stdout: { 2023-08-01T19:55:41.693 INFO:teuthology.orchestra.run.smithi155.stdout: "event": "waiting for subops from 0", 2023-08-01T19:55:41.693 INFO:teuthology.orchestra.run.smithi155.stdout: "time": "2023-08-01T19:55:05.154420+0000", 2023-08-01T19:55:41.693 INFO:teuthology.orchestra.run.smithi155.stdout: "duration": 0.000133292 2023-08-01T19:55:41.693 INFO:teuthology.orchestra.run.smithi155.stdout: }, 2023-08-01T19:55:41.693 INFO:teuthology.orchestra.run.smithi155.stdout: { 2023-08-01T19:55:41.693 INFO:teuthology.orchestra.run.smithi155.stdout: "event": "sub_op_commit_rec", 2023-08-01T19:55:41.693 INFO:teuthology.orchestra.run.smithi155.stdout: "time": "2023-08-01T19:55:05.219034+0000", 2023-08-01T19:55:41.694 INFO:teuthology.orchestra.run.smithi155.stdout: "duration": 0.064613429999999999 2023-08-01T19:55:41.694 INFO:teuthology.orchestra.run.smithi155.stdout: }, 2023-08-01T19:55:41.694 INFO:teuthology.orchestra.run.smithi155.stdout: { 2023-08-01T19:55:41.694 INFO:teuthology.orchestra.run.smithi155.stdout: "event": "op_commit", 2023-08-01T19:55:41.694 INFO:teuthology.orchestra.run.smithi155.stdout: "time": "2023-08-01T19:55:05.224138+0000", 2023-08-01T19:55:41.694 INFO:teuthology.orchestra.run.smithi155.stdout: "duration": 0.0051041999999999997 2023-08-01T19:55:41.694 INFO:teuthology.orchestra.run.smithi155.stdout: }, 2023-08-01T19:55:41.694 INFO:teuthology.orchestra.run.smithi155.stdout: { 2023-08-01T19:55:41.695 INFO:teuthology.orchestra.run.smithi155.stdout: "event": "commit_sent", 2023-08-01T19:55:41.695 INFO:teuthology.orchestra.run.smithi155.stdout: "time": "2023-08-01T19:55:05.224171+0000", 2023-08-01T19:55:41.695 INFO:teuthology.orchestra.run.smithi155.stdout: "duration": 3.3345e-05 2023-08-01T19:55:41.695 INFO:teuthology.orchestra.run.smithi155.stdout: }, 2023-08-01T19:55:41.695 INFO:teuthology.orchestra.run.smithi155.stdout: { 2023-08-01T19:55:41.695 INFO:teuthology.orchestra.run.smithi155.stdout: "event": "done", 2023-08-01T19:55:41.695 INFO:teuthology.orchestra.run.smithi155.stdout: "time": "2023-08-01T19:55:05.224205+0000", 2023-08-01T19:55:41.696 INFO:teuthology.orchestra.run.smithi155.stdout: "duration": 3.3525999999999997e-05 2023-08-01T19:55:41.696 INFO:teuthology.orchestra.run.smithi155.stdout: } 2023-08-01T19:55:41.696 INFO:teuthology.orchestra.run.smithi155.stdout: ] 2023-08-01T19:55:41.696 INFO:teuthology.orchestra.run.smithi155.stdout: } 2023-08-01T19:55:41.696 INFO:teuthology.orchestra.run.smithi155.stdout: }, 2023-08-01T19:55:41.696 INFO:teuthology.orchestra.run.smithi155.stdout: { 2023-08-01T19:55:41.696 INFO:teuthology.orchestra.run.smithi155.stdout: "description": "osd_repop_reply(client.4668.0:100237 5.4 e37/19 ondisk, result = 0)", 2023-08-01T19:55:41.696 INFO:teuthology.orchestra.run.smithi155.stdout: "initiated_at": "2023-08-01T19:55:05.156249+0000", 2023-08-01T19:55:41.697 INFO:teuthology.orchestra.run.smithi155.stdout: "age": 36.415376797, 2023-08-01T19:55:41.697 INFO:teuthology.orchestra.run.smithi155.stdout: "duration": 0.062792549000000003, 2023-08-01T19:55:41.697 INFO:teuthology.orchestra.run.smithi155.stdout: "type_data": { 2023-08-01T19:55:41.697 INFO:teuthology.orchestra.run.smithi155.stdout: "flag_point": "started", 2023-08-01T19:55:41.697 INFO:teuthology.orchestra.run.smithi155.stdout: "events": [ 2023-08-01T19:55:41.697 INFO:teuthology.orchestra.run.smithi155.stdout: { 2023-08-01T19:55:41.697 INFO:teuthology.orchestra.run.smithi155.stdout: "event": "initiated", 2023-08-01T19:55:41.697 INFO:teuthology.orchestra.run.smithi155.stdout: "time": "2023-08-01T19:55:05.156249+0000", 2023-08-01T19:55:41.698 INFO:teuthology.orchestra.run.smithi155.stdout: "duration": 0 2023-08-01T19:55:41.698 INFO:teuthology.orchestra.run.smithi155.stdout: }, 2023-08-01T19:55:41.698 INFO:teuthology.orchestra.run.smithi155.stdout: { 2023-08-01T19:55:41.698 INFO:teuthology.orchestra.run.smithi155.stdout: "event": "throttled", 2023-08-01T19:55:41.698 INFO:teuthology.orchestra.run.smithi155.stdout: "time": "2023-08-01T19:55:05.156249+0000", 2023-08-01T19:55:41.698 INFO:teuthology.orchestra.run.smithi155.stdout: "duration": 0 2023-08-01T19:55:41.698 INFO:teuthology.orchestra.run.smithi155.stdout: }, 2023-08-01T19:55:41.698 INFO:teuthology.orchestra.run.smithi155.stdout: { 2023-08-01T19:55:41.699 INFO:teuthology.orchestra.run.smithi155.stdout: "event": "header_read", 2023-08-01T19:55:41.699 INFO:teuthology.orchestra.run.smithi155.stdout: "time": "2023-08-01T19:55:05.156248+0000", 2023-08-01T19:55:41.699 INFO:teuthology.orchestra.run.smithi155.stdout: "duration": 4294967295.9999995 2023-08-01T19:55:41.699 INFO:teuthology.orchestra.run.smithi155.stdout: }, 2023-08-01T19:55:41.700 INFO:teuthology.orchestra.run.smithi155.stdout: { 2023-08-01T19:55:41.700 INFO:teuthology.orchestra.run.smithi155.stdout: "event": "all_read", 2023-08-01T19:55:41.700 INFO:teuthology.orchestra.run.smithi155.stdout: "time": "2023-08-01T19:55:05.156252+0000", 2023-08-01T19:55:41.700 INFO:teuthology.orchestra.run.smithi155.stdout: "duration": 3.9999999999999998e-06 2023-08-01T19:55:41.701 INFO:teuthology.orchestra.run.smithi155.stdout: }, 2023-08-01T19:55:41.701 INFO:teuthology.orchestra.run.smithi155.stdout: { 2023-08-01T19:55:41.701 INFO:teuthology.orchestra.run.smithi155.stdout: "event": "dispatched", 2023-08-01T19:55:41.701 INFO:teuthology.orchestra.run.smithi155.stdout: "time": "2023-08-01T19:55:05.218844+0000", 2023-08-01T19:55:41.702 INFO:teuthology.orchestra.run.smithi155.stdout: "duration": 0.062591516999999999 2023-08-01T19:55:41.702 INFO:teuthology.orchestra.run.smithi155.stdout: }, 2023-08-01T19:55:41.702 INFO:teuthology.orchestra.run.smithi155.stdout: { 2023-08-01T19:55:41.702 INFO:teuthology.orchestra.run.smithi155.stdout: "event": "queued_for_pg", 2023-08-01T19:55:41.703 INFO:teuthology.orchestra.run.smithi155.stdout: "time": "2023-08-01T19:55:05.218862+0000", 2023-08-01T19:55:41.703 INFO:teuthology.orchestra.run.smithi155.stdout: "duration": 1.7666e-05 2023-08-01T19:55:41.703 INFO:teuthology.orchestra.run.smithi155.stdout: }, 2023-08-01T19:55:41.703 INFO:teuthology.orchestra.run.smithi155.stdout: { 2023-08-01T19:55:41.704 INFO:teuthology.orchestra.run.smithi155.stdout: "event": "reached_pg", 2023-08-01T19:55:41.704 INFO:teuthology.orchestra.run.smithi155.stdout: "time": "2023-08-01T19:55:05.218914+0000", 2023-08-01T19:55:41.704 INFO:teuthology.orchestra.run.smithi155.stdout: "duration": 5.2565999999999998e-05 2023-08-01T19:55:41.705 INFO:teuthology.orchestra.run.smithi155.stdout: }, 2023-08-01T19:55:41.705 INFO:teuthology.orchestra.run.smithi155.stdout: { 2023-08-01T19:55:41.705 INFO:teuthology.orchestra.run.smithi155.stdout: "event": "started", 2023-08-01T19:55:41.705 INFO:teuthology.orchestra.run.smithi155.stdout: "time": "2023-08-01T19:55:05.218925+0000", 2023-08-01T19:55:41.706 INFO:teuthology.orchestra.run.smithi155.stdout: "duration": 1.1375e-05 2023-08-01T19:55:41.706 INFO:teuthology.orchestra.run.smithi155.stdout: }, 2023-08-01T19:55:41.706 INFO:teuthology.orchestra.run.smithi155.stdout: { 2023-08-01T19:55:41.706 INFO:teuthology.orchestra.run.smithi155.stdout: "event": "done", 2023-08-01T19:55:41.707 INFO:teuthology.orchestra.run.smithi155.stdout: "time": "2023-08-01T19:55:05.219041+0000", 2023-08-01T19:55:41.707 INFO:teuthology.orchestra.run.smithi155.stdout: "duration": 0.000115977 2023-08-01T19:55:41.707 INFO:teuthology.orchestra.run.smithi155.stdout: } 2023-08-01T19:55:41.707 INFO:teuthology.orchestra.run.smithi155.stdout: ] 2023-08-01T19:55:41.708 INFO:teuthology.orchestra.run.smithi155.stdout: } 2023-08-01T19:55:41.708 INFO:teuthology.orchestra.run.smithi155.stdout: }, 2023-08-01T19:55:41.708 INFO:teuthology.orchestra.run.smithi155.stdout: { 2023-08-01T19:55:41.708 INFO:teuthology.orchestra.run.smithi155.stdout: "description": "osd_repop(client.4668.0:100253 5.f e37/19 5:f7bbce05:::benchmark_data_smithi006_114134_object100252:head v 37'6323, mlcod=37'6321)", 2023-08-01T19:55:41.709 INFO:teuthology.orchestra.run.smithi155.stdout: "initiated_at": "2023-08-01T19:55:05.156952+0000", 2023-08-01T19:55:41.709 INFO:teuthology.orchestra.run.smithi155.stdout: "age": 36.414673733999997, 2023-08-01T19:55:41.709 INFO:teuthology.orchestra.run.smithi155.stdout: "duration": 0.068018577999999996, 2023-08-01T19:55:41.709 INFO:teuthology.orchestra.run.smithi155.stdout: "type_data": { 2023-08-01T19:55:41.710 INFO:teuthology.orchestra.run.smithi155.stdout: "flag_point": "commit sent; apply or cleanup", 2023-08-01T19:55:41.710 INFO:teuthology.orchestra.run.smithi155.stdout: "events": [ 2023-08-01T19:55:41.710 INFO:teuthology.orchestra.run.smithi155.stdout: { 2023-08-01T19:55:41.710 INFO:teuthology.orchestra.run.smithi155.stdout: "event": "initiated", 2023-08-01T19:55:41.711 INFO:teuthology.orchestra.run.smithi155.stdout: "time": "2023-08-01T19:55:05.156952+0000", 2023-08-01T19:55:41.711 INFO:teuthology.orchestra.run.smithi155.stdout: "duration": 0 2023-08-01T19:55:41.711 INFO:teuthology.orchestra.run.smithi155.stdout: }, 2023-08-01T19:55:41.711 INFO:teuthology.orchestra.run.smithi155.stdout: { 2023-08-01T19:55:41.712 INFO:teuthology.orchestra.run.smithi155.stdout: "event": "throttled", 2023-08-01T19:55:41.712 INFO:teuthology.orchestra.run.smithi155.stdout: "time": "2023-08-01T19:55:05.156952+0000", 2023-08-01T19:55:41.712 INFO:teuthology.orchestra.run.smithi155.stdout: "duration": 0 2023-08-01T19:55:41.712 INFO:teuthology.orchestra.run.smithi155.stdout: }, 2023-08-01T19:55:41.713 INFO:teuthology.orchestra.run.smithi155.stdout: { 2023-08-01T19:55:41.713 INFO:teuthology.orchestra.run.smithi155.stdout: "event": "header_read", 2023-08-01T19:55:41.713 INFO:teuthology.orchestra.run.smithi155.stdout: "time": "2023-08-01T19:55:05.156951+0000", 2023-08-01T19:55:41.713 INFO:teuthology.orchestra.run.smithi155.stdout: "duration": 4294967295.999999 2023-08-01T19:55:41.714 INFO:teuthology.orchestra.run.smithi155.stdout: }, 2023-08-01T19:55:41.714 INFO:teuthology.orchestra.run.smithi155.stdout: { 2023-08-01T19:55:41.714 INFO:teuthology.orchestra.run.smithi155.stdout: "event": "all_read", 2023-08-01T19:55:41.714 INFO:teuthology.orchestra.run.smithi155.stdout: "time": "2023-08-01T19:55:05.156989+0000", 2023-08-01T19:55:41.715 INFO:teuthology.orchestra.run.smithi155.stdout: "duration": 3.8175e-05 2023-08-01T19:55:41.715 INFO:teuthology.orchestra.run.smithi155.stdout: }, 2023-08-01T19:55:41.715 INFO:teuthology.orchestra.run.smithi155.stdout: { 2023-08-01T19:55:41.715 INFO:teuthology.orchestra.run.smithi155.stdout: "event": "dispatched", 2023-08-01T19:55:41.716 INFO:teuthology.orchestra.run.smithi155.stdout: "time": "2023-08-01T19:55:05.218842+0000", 2023-08-01T19:55:41.716 INFO:teuthology.orchestra.run.smithi155.stdout: "duration": 0.061852299999999999 2023-08-01T19:55:41.716 INFO:teuthology.orchestra.run.smithi155.stdout: }, 2023-08-01T19:55:41.716 INFO:teuthology.orchestra.run.smithi155.stdout: { 2023-08-01T19:55:41.717 INFO:teuthology.orchestra.run.smithi155.stdout: "event": "queued_for_pg", 2023-08-01T19:55:41.717 INFO:teuthology.orchestra.run.smithi155.stdout: "time": "2023-08-01T19:55:05.218862+0000", 2023-08-01T19:55:41.717 INFO:teuthology.orchestra.run.smithi155.stdout: "duration": 1.9854999999999999e-05 2023-08-01T19:55:41.717 INFO:teuthology.orchestra.run.smithi155.stdout: }, 2023-08-01T19:55:41.718 INFO:teuthology.orchestra.run.smithi155.stdout: { 2023-08-01T19:55:41.718 INFO:teuthology.orchestra.run.smithi155.stdout: "event": "reached_pg", 2023-08-01T19:55:41.718 INFO:teuthology.orchestra.run.smithi155.stdout: "time": "2023-08-01T19:55:05.218918+0000", 2023-08-01T19:55:41.718 INFO:teuthology.orchestra.run.smithi155.stdout: "duration": 5.6570000000000002e-05 2023-08-01T19:55:41.719 INFO:teuthology.orchestra.run.smithi155.stdout: }, 2023-08-01T19:55:41.719 INFO:teuthology.orchestra.run.smithi155.stdout: { 2023-08-01T19:55:41.719 INFO:teuthology.orchestra.run.smithi155.stdout: "event": "started", 2023-08-01T19:55:41.719 INFO:teuthology.orchestra.run.smithi155.stdout: "time": "2023-08-01T19:55:05.218940+0000", 2023-08-01T19:55:41.720 INFO:teuthology.orchestra.run.smithi155.stdout: "duration": 2.1804e-05 2023-08-01T19:55:41.720 INFO:teuthology.orchestra.run.smithi155.stdout: }, 2023-08-01T19:55:41.720 INFO:teuthology.orchestra.run.smithi155.stdout: { 2023-08-01T19:55:41.720 INFO:teuthology.orchestra.run.smithi155.stdout: "event": "commit_sent", 2023-08-01T19:55:41.721 INFO:teuthology.orchestra.run.smithi155.stdout: "time": "2023-08-01T19:55:05.224928+0000", 2023-08-01T19:55:41.721 INFO:teuthology.orchestra.run.smithi155.stdout: "duration": 0.0059876759999999999 2023-08-01T19:55:41.721 INFO:teuthology.orchestra.run.smithi155.stdout: }, 2023-08-01T19:55:41.721 INFO:teuthology.orchestra.run.smithi155.stdout: { 2023-08-01T19:55:41.722 INFO:teuthology.orchestra.run.smithi155.stdout: "event": "done", 2023-08-01T19:55:41.722 INFO:teuthology.orchestra.run.smithi155.stdout: "time": "2023-08-01T19:55:05.224971+0000", 2023-08-01T19:55:41.722 INFO:teuthology.orchestra.run.smithi155.stdout: "duration": 4.2929999999999997e-05 2023-08-01T19:55:41.722 INFO:teuthology.orchestra.run.smithi155.stdout: } 2023-08-01T19:55:41.723 INFO:teuthology.orchestra.run.smithi155.stdout: ] 2023-08-01T19:55:41.723 INFO:teuthology.orchestra.run.smithi155.stdout: } 2023-08-01T19:55:41.723 INFO:teuthology.orchestra.run.smithi155.stdout: }, 2023-08-01T19:55:41.723 INFO:teuthology.orchestra.run.smithi155.stdout: { 2023-08-01T19:55:41.724 INFO:teuthology.orchestra.run.smithi155.stdout: "description": "osd_op(client.4668.0:100927 5.0 5:00608ec6:::benchmark_data_smithi006_114134_object100926:head [set-alloc-hint object_size 65536 write_size 65536,write 0~65536] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e37)", 2023-08-01T19:55:41.724 INFO:teuthology.orchestra.run.smithi155.stdout: "initiated_at": "2023-08-01T19:55:05.561169+0000", 2023-08-01T19:55:41.724 INFO:teuthology.orchestra.run.smithi155.stdout: "age": 36.010456830999999, 2023-08-01T19:55:41.724 INFO:teuthology.orchestra.run.smithi155.stdout: "duration": 0.066411687999999997, 2023-08-01T19:55:41.725 INFO:teuthology.orchestra.run.smithi155.stdout: "type_data": { 2023-08-01T19:55:41.725 INFO:teuthology.orchestra.run.smithi155.stdout: "flag_point": "commit sent; apply or cleanup", 2023-08-01T19:55:41.725 INFO:teuthology.orchestra.run.smithi155.stdout: "client_info": { 2023-08-01T19:55:41.725 INFO:teuthology.orchestra.run.smithi155.stdout: "client": "client.4668", 2023-08-01T19:55:41.726 INFO:teuthology.orchestra.run.smithi155.stdout: "client_addr": "172.21.15.6:0/1709472247", 2023-08-01T19:55:41.726 INFO:teuthology.orchestra.run.smithi155.stdout: "tid": 100927 2023-08-01T19:55:41.726 INFO:teuthology.orchestra.run.smithi155.stdout: }, 2023-08-01T19:55:41.726 INFO:teuthology.orchestra.run.smithi155.stdout: "events": [ 2023-08-01T19:55:41.727 INFO:teuthology.orchestra.run.smithi155.stdout: { 2023-08-01T19:55:41.727 INFO:teuthology.orchestra.run.smithi155.stdout: "event": "initiated", 2023-08-01T19:55:41.727 INFO:teuthology.orchestra.run.smithi155.stdout: "time": "2023-08-01T19:55:05.561169+0000", 2023-08-01T19:55:41.727 INFO:teuthology.orchestra.run.smithi155.stdout: "duration": 0 2023-08-01T19:55:41.728 INFO:teuthology.orchestra.run.smithi155.stdout: }, 2023-08-01T19:55:41.728 INFO:teuthology.orchestra.run.smithi155.stdout: { 2023-08-01T19:55:41.728 INFO:teuthology.orchestra.run.smithi155.stdout: "event": "throttled", 2023-08-01T19:55:41.729 INFO:teuthology.orchestra.run.smithi155.stdout: "time": "2023-08-01T19:55:05.561169+0000", 2023-08-01T19:55:41.729 INFO:teuthology.orchestra.run.smithi155.stdout: "duration": 0 2023-08-01T19:55:41.729 INFO:teuthology.orchestra.run.smithi155.stdout: }, 2023-08-01T19:55:41.729 INFO:teuthology.orchestra.run.smithi155.stdout: { 2023-08-01T19:55:41.730 INFO:teuthology.orchestra.run.smithi155.stdout: "event": "header_read", 2023-08-01T19:55:41.730 INFO:teuthology.orchestra.run.smithi155.stdout: "time": "2023-08-01T19:55:05.561168+0000", 2023-08-01T19:55:41.730 INFO:teuthology.orchestra.run.smithi155.stdout: "duration": 4294967295.9999995 2023-08-01T19:55:41.730 INFO:teuthology.orchestra.run.smithi155.stdout: }, 2023-08-01T19:55:41.731 INFO:teuthology.orchestra.run.smithi155.stdout: { 2023-08-01T19:55:41.731 INFO:teuthology.orchestra.run.smithi155.stdout: "event": "all_read", 2023-08-01T19:55:41.731 INFO:teuthology.orchestra.run.smithi155.stdout: "time": "2023-08-01T19:55:05.561218+0000", 2023-08-01T19:55:41.731 INFO:teuthology.orchestra.run.smithi155.stdout: "duration": 4.9379999999999998e-05 2023-08-01T19:55:41.732 INFO:teuthology.orchestra.run.smithi155.stdout: }, 2023-08-01T19:55:41.732 INFO:teuthology.orchestra.run.smithi155.stdout: { 2023-08-01T19:55:41.732 INFO:teuthology.orchestra.run.smithi155.stdout: "event": "dispatched", 2023-08-01T19:55:41.732 INFO:teuthology.orchestra.run.smithi155.stdout: "time": "2023-08-01T19:55:05.561225+0000", 2023-08-01T19:55:41.733 INFO:teuthology.orchestra.run.smithi155.stdout: "duration": 7.114e-06 2023-08-01T19:55:41.733 INFO:teuthology.orchestra.run.smithi155.stdout: }, 2023-08-01T19:55:41.733 INFO:teuthology.orchestra.run.smithi155.stdout: { 2023-08-01T19:55:41.733 INFO:teuthology.orchestra.run.smithi155.stdout: "event": "queued_for_pg", 2023-08-01T19:55:41.734 INFO:teuthology.orchestra.run.smithi155.stdout: "time": "2023-08-01T19:55:05.561229+0000", 2023-08-01T19:55:41.734 INFO:teuthology.orchestra.run.smithi155.stdout: "duration": 4.2180000000000001e-06 2023-08-01T19:55:41.734 INFO:teuthology.orchestra.run.smithi155.stdout: }, 2023-08-01T19:55:41.734 INFO:teuthology.orchestra.run.smithi155.stdout: { 2023-08-01T19:55:41.735 INFO:teuthology.orchestra.run.smithi155.stdout: "event": "reached_pg", 2023-08-01T19:55:41.735 INFO:teuthology.orchestra.run.smithi155.stdout: "time": "2023-08-01T19:55:05.564737+0000", 2023-08-01T19:55:41.735 INFO:teuthology.orchestra.run.smithi155.stdout: "duration": 0.0035081869999999999 2023-08-01T19:55:41.735 INFO:teuthology.orchestra.run.smithi155.stdout: }, 2023-08-01T19:55:41.736 INFO:teuthology.orchestra.run.smithi155.stdout: { 2023-08-01T19:55:41.736 INFO:teuthology.orchestra.run.smithi155.stdout: "event": "started", 2023-08-01T19:55:41.736 INFO:teuthology.orchestra.run.smithi155.stdout: "time": "2023-08-01T19:55:05.564859+0000", 2023-08-01T19:55:41.736 INFO:teuthology.orchestra.run.smithi155.stdout: "duration": 0.00012165800000000001 2023-08-01T19:55:41.737 INFO:teuthology.orchestra.run.smithi155.stdout: }, 2023-08-01T19:55:41.737 INFO:teuthology.orchestra.run.smithi155.stdout: { 2023-08-01T19:55:41.737 INFO:teuthology.orchestra.run.smithi155.stdout: "event": "waiting for subops from 0", 2023-08-01T19:55:41.737 INFO:teuthology.orchestra.run.smithi155.stdout: "time": "2023-08-01T19:55:05.565009+0000", 2023-08-01T19:55:41.738 INFO:teuthology.orchestra.run.smithi155.stdout: "duration": 0.00014979699999999999 2023-08-01T19:55:41.738 INFO:teuthology.orchestra.run.smithi155.stdout: }, 2023-08-01T19:55:41.738 INFO:teuthology.orchestra.run.smithi155.stdout: { 2023-08-01T19:55:41.738 INFO:teuthology.orchestra.run.smithi155.stdout: "event": "op_commit", 2023-08-01T19:55:41.739 INFO:teuthology.orchestra.run.smithi155.stdout: "time": "2023-08-01T19:55:05.568007+0000", 2023-08-01T19:55:41.739 INFO:teuthology.orchestra.run.smithi155.stdout: "duration": 0.00299796 2023-08-01T19:55:41.739 INFO:teuthology.orchestra.run.smithi155.stdout: }, 2023-08-01T19:55:41.739 INFO:teuthology.orchestra.run.smithi155.stdout: { 2023-08-01T19:55:41.740 INFO:teuthology.orchestra.run.smithi155.stdout: "event": "sub_op_commit_rec", 2023-08-01T19:55:41.740 INFO:teuthology.orchestra.run.smithi155.stdout: "time": "2023-08-01T19:55:05.627520+0000", 2023-08-01T19:55:41.740 INFO:teuthology.orchestra.run.smithi155.stdout: "duration": 0.059513636000000002 2023-08-01T19:55:41.740 INFO:teuthology.orchestra.run.smithi155.stdout: }, 2023-08-01T19:55:41.741 INFO:teuthology.orchestra.run.smithi155.stdout: { 2023-08-01T19:55:41.741 INFO:teuthology.orchestra.run.smithi155.stdout: "event": "commit_sent", 2023-08-01T19:55:41.741 INFO:teuthology.orchestra.run.smithi155.stdout: "time": "2023-08-01T19:55:05.627553+0000", 2023-08-01T19:55:41.741 INFO:teuthology.orchestra.run.smithi155.stdout: "duration": 3.2635999999999997e-05 2023-08-01T19:55:41.742 INFO:teuthology.orchestra.run.smithi155.stdout: }, 2023-08-01T19:55:41.742 INFO:teuthology.orchestra.run.smithi155.stdout: { 2023-08-01T19:55:41.742 INFO:teuthology.orchestra.run.smithi155.stdout: "event": "done", 2023-08-01T19:55:41.742 INFO:teuthology.orchestra.run.smithi155.stdout: "time": "2023-08-01T19:55:05.627581+0000", 2023-08-01T19:55:41.743 INFO:teuthology.orchestra.run.smithi155.stdout: "duration": 2.7681000000000001e-05 2023-08-01T19:55:41.743 INFO:teuthology.orchestra.run.smithi155.stdout: } 2023-08-01T19:55:41.743 INFO:teuthology.orchestra.run.smithi155.stdout: ] 2023-08-01T19:55:41.743 INFO:teuthology.orchestra.run.smithi155.stdout: } 2023-08-01T19:55:41.744 INFO:teuthology.orchestra.run.smithi155.stdout: }, 2023-08-01T19:55:41.744 INFO:teuthology.orchestra.run.smithi155.stdout: { 2023-08-01T19:55:41.744 INFO:teuthology.orchestra.run.smithi155.stdout: "description": "osd_op(client.4668.0:100935 5.e 5:7895b14e:::benchmark_data_smithi006_114134_object100934:head [set-alloc-hint object_size 65536 write_size 65536,write 0~65536] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e37)", 2023-08-01T19:55:41.744 INFO:teuthology.orchestra.run.smithi155.stdout: "initiated_at": "2023-08-01T19:55:05.566666+0000", 2023-08-01T19:55:41.745 INFO:teuthology.orchestra.run.smithi155.stdout: "age": 36.004959530999997, 2023-08-01T19:55:41.745 INFO:teuthology.orchestra.run.smithi155.stdout: "duration": 0.064309016999999996, 2023-08-01T19:55:41.745 INFO:teuthology.orchestra.run.smithi155.stdout: "type_data": { 2023-08-01T19:55:41.745 INFO:teuthology.orchestra.run.smithi155.stdout: "flag_point": "commit sent; apply or cleanup", 2023-08-01T19:55:41.746 INFO:teuthology.orchestra.run.smithi155.stdout: "client_info": { 2023-08-01T19:55:41.746 INFO:teuthology.orchestra.run.smithi155.stdout: "client": "client.4668", 2023-08-01T19:55:41.746 INFO:teuthology.orchestra.run.smithi155.stdout: "client_addr": "172.21.15.6:0/1709472247", 2023-08-01T19:55:41.746 INFO:teuthology.orchestra.run.smithi155.stdout: "tid": 100935 2023-08-01T19:55:41.747 INFO:teuthology.orchestra.run.smithi155.stdout: }, 2023-08-01T19:55:41.747 INFO:teuthology.orchestra.run.smithi155.stdout: "events": [ 2023-08-01T19:55:41.747 INFO:teuthology.orchestra.run.smithi155.stdout: { 2023-08-01T19:55:41.747 INFO:teuthology.orchestra.run.smithi155.stdout: "event": "initiated", 2023-08-01T19:55:41.748 INFO:teuthology.orchestra.run.smithi155.stdout: "time": "2023-08-01T19:55:05.566666+0000", 2023-08-01T19:55:41.748 INFO:teuthology.orchestra.run.smithi155.stdout: "duration": 0 2023-08-01T19:55:41.748 INFO:teuthology.orchestra.run.smithi155.stdout: }, 2023-08-01T19:55:41.748 INFO:teuthology.orchestra.run.smithi155.stdout: { 2023-08-01T19:55:41.749 INFO:teuthology.orchestra.run.smithi155.stdout: "event": "throttled", 2023-08-01T19:55:41.749 INFO:teuthology.orchestra.run.smithi155.stdout: "time": "2023-08-01T19:55:05.566666+0000", 2023-08-01T19:55:41.749 INFO:teuthology.orchestra.run.smithi155.stdout: "duration": 0 2023-08-01T19:55:41.749 INFO:teuthology.orchestra.run.smithi155.stdout: }, 2023-08-01T19:55:41.750 INFO:teuthology.orchestra.run.smithi155.stdout: { 2023-08-01T19:55:41.750 INFO:teuthology.orchestra.run.smithi155.stdout: "event": "header_read", 2023-08-01T19:55:41.750 INFO:teuthology.orchestra.run.smithi155.stdout: "time": "2023-08-01T19:55:05.566665+0000", 2023-08-01T19:55:41.750 INFO:teuthology.orchestra.run.smithi155.stdout: "duration": 4294967295.9999986 2023-08-01T19:55:41.750 INFO:teuthology.orchestra.run.smithi155.stdout: }, 2023-08-01T19:55:41.751 INFO:teuthology.orchestra.run.smithi155.stdout: { 2023-08-01T19:55:41.751 INFO:teuthology.orchestra.run.smithi155.stdout: "event": "all_read", 2023-08-01T19:55:41.751 INFO:teuthology.orchestra.run.smithi155.stdout: "time": "2023-08-01T19:55:05.566754+0000", 2023-08-01T19:55:41.751 INFO:teuthology.orchestra.run.smithi155.stdout: "duration": 8.9425999999999994e-05 2023-08-01T19:55:41.751 INFO:teuthology.orchestra.run.smithi155.stdout: }, 2023-08-01T19:55:41.751 INFO:teuthology.orchestra.run.smithi155.stdout: { 2023-08-01T19:55:41.751 INFO:teuthology.orchestra.run.smithi155.stdout: "event": "dispatched", 2023-08-01T19:55:41.751 INFO:teuthology.orchestra.run.smithi155.stdout: "time": "2023-08-01T19:55:05.566766+0000", 2023-08-01T19:55:41.752 INFO:teuthology.orchestra.run.smithi155.stdout: "duration": 1.2018000000000001e-05 2023-08-01T19:55:41.752 INFO:teuthology.orchestra.run.smithi155.stdout: }, 2023-08-01T19:55:41.752 INFO:teuthology.orchestra.run.smithi155.stdout: { 2023-08-01T19:55:41.752 INFO:teuthology.orchestra.run.smithi155.stdout: "event": "queued_for_pg", 2023-08-01T19:55:41.752 INFO:teuthology.orchestra.run.smithi155.stdout: "time": "2023-08-01T19:55:05.566772+0000", 2023-08-01T19:55:41.752 INFO:teuthology.orchestra.run.smithi155.stdout: "duration": 6.0190000000000003e-06 2023-08-01T19:55:41.752 INFO:teuthology.orchestra.run.smithi155.stdout: }, 2023-08-01T19:55:41.753 INFO:teuthology.orchestra.run.smithi155.stdout: { 2023-08-01T19:55:41.753 INFO:teuthology.orchestra.run.smithi155.stdout: "event": "reached_pg", 2023-08-01T19:55:41.753 INFO:teuthology.orchestra.run.smithi155.stdout: "time": "2023-08-01T19:55:05.566800+0000", 2023-08-01T19:55:41.753 INFO:teuthology.orchestra.run.smithi155.stdout: "duration": 2.7835999999999999e-05 2023-08-01T19:55:41.753 INFO:teuthology.orchestra.run.smithi155.stdout: }, 2023-08-01T19:55:41.753 INFO:teuthology.orchestra.run.smithi155.stdout: { 2023-08-01T19:55:41.753 INFO:teuthology.orchestra.run.smithi155.stdout: "event": "started", 2023-08-01T19:55:41.753 INFO:teuthology.orchestra.run.smithi155.stdout: "time": "2023-08-01T19:55:05.566879+0000", 2023-08-01T19:55:41.754 INFO:teuthology.orchestra.run.smithi155.stdout: "duration": 7.9105999999999998e-05 2023-08-01T19:55:41.754 INFO:teuthology.orchestra.run.smithi155.stdout: }, 2023-08-01T19:55:41.754 INFO:teuthology.orchestra.run.smithi155.stdout: { 2023-08-01T19:55:41.754 INFO:teuthology.orchestra.run.smithi155.stdout: "event": "waiting for subops from 0", 2023-08-01T19:55:41.754 INFO:teuthology.orchestra.run.smithi155.stdout: "time": "2023-08-01T19:55:05.566971+0000", 2023-08-01T19:55:41.754 INFO:teuthology.orchestra.run.smithi155.stdout: "duration": 9.1817999999999994e-05 2023-08-01T19:55:41.754 INFO:teuthology.orchestra.run.smithi155.stdout: }, 2023-08-01T19:55:41.754 INFO:teuthology.orchestra.run.smithi155.stdout: { 2023-08-01T19:55:41.755 INFO:teuthology.orchestra.run.smithi155.stdout: "event": "op_commit", 2023-08-01T19:55:41.755 INFO:teuthology.orchestra.run.smithi155.stdout: "time": "2023-08-01T19:55:05.571475+0000", 2023-08-01T19:55:41.755 INFO:teuthology.orchestra.run.smithi155.stdout: "duration": 0.0045039499999999996 2023-08-01T19:55:41.755 INFO:teuthology.orchestra.run.smithi155.stdout: }, 2023-08-01T19:55:41.755 INFO:teuthology.orchestra.run.smithi155.stdout: { 2023-08-01T19:55:41.755 INFO:teuthology.orchestra.run.smithi155.stdout: "event": "sub_op_commit_rec", 2023-08-01T19:55:41.755 INFO:teuthology.orchestra.run.smithi155.stdout: "time": "2023-08-01T19:55:05.630884+0000", 2023-08-01T19:55:41.755 INFO:teuthology.orchestra.run.smithi155.stdout: "duration": 0.059409181999999998 2023-08-01T19:55:41.756 INFO:teuthology.orchestra.run.smithi155.stdout: }, 2023-08-01T19:55:41.756 INFO:teuthology.orchestra.run.smithi155.stdout: { 2023-08-01T19:55:41.756 INFO:teuthology.orchestra.run.smithi155.stdout: "event": "commit_sent", 2023-08-01T19:55:41.756 INFO:teuthology.orchestra.run.smithi155.stdout: "time": "2023-08-01T19:55:05.630930+0000", 2023-08-01T19:55:41.756 INFO:teuthology.orchestra.run.smithi155.stdout: "duration": 4.5507999999999999e-05 2023-08-01T19:55:41.756 INFO:teuthology.orchestra.run.smithi155.stdout: }, 2023-08-01T19:55:41.756 INFO:teuthology.orchestra.run.smithi155.stdout: { 2023-08-01T19:55:41.756 INFO:teuthology.orchestra.run.smithi155.stdout: "event": "done", 2023-08-01T19:55:41.757 INFO:teuthology.orchestra.run.smithi155.stdout: "time": "2023-08-01T19:55:05.630975+0000", 2023-08-01T19:55:41.757 INFO:teuthology.orchestra.run.smithi155.stdout: "duration": 4.5441000000000001e-05 2023-08-01T19:55:41.757 INFO:teuthology.orchestra.run.smithi155.stdout: } 2023-08-01T19:55:41.757 INFO:teuthology.orchestra.run.smithi155.stdout: ] 2023-08-01T19:55:41.757 INFO:teuthology.orchestra.run.smithi155.stdout: } 2023-08-01T19:55:41.757 INFO:teuthology.orchestra.run.smithi155.stdout: }, 2023-08-01T19:55:41.757 INFO:teuthology.orchestra.run.smithi155.stdout: { 2023-08-01T19:55:41.757 INFO:teuthology.orchestra.run.smithi155.stdout: "description": "osd_op(client.4668.0:100941 5.e 5:736a6ac6:::benchmark_data_smithi006_114134_object100940:head [set-alloc-hint object_size 65536 write_size 65536,write 0~65536] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e37)", 2023-08-01T19:55:41.758 INFO:teuthology.orchestra.run.smithi155.stdout: "initiated_at": "2023-08-01T19:55:05.569750+0000", 2023-08-01T19:55:41.758 INFO:teuthology.orchestra.run.smithi155.stdout: "age": 36.001875638000001, 2023-08-01T19:55:41.758 INFO:teuthology.orchestra.run.smithi155.stdout: "duration": 0.065431331999999995, 2023-08-01T19:55:41.758 INFO:teuthology.orchestra.run.smithi155.stdout: "type_data": { 2023-08-01T19:55:41.758 INFO:teuthology.orchestra.run.smithi155.stdout: "flag_point": "commit sent; apply or cleanup", 2023-08-01T19:55:41.758 INFO:teuthology.orchestra.run.smithi155.stdout: "client_info": { 2023-08-01T19:55:41.758 INFO:teuthology.orchestra.run.smithi155.stdout: "client": "client.4668", 2023-08-01T19:55:41.759 INFO:teuthology.orchestra.run.smithi155.stdout: "client_addr": "172.21.15.6:0/1709472247", 2023-08-01T19:55:41.759 INFO:teuthology.orchestra.run.smithi155.stdout: "tid": 100941 2023-08-01T19:55:41.759 INFO:teuthology.orchestra.run.smithi155.stdout: }, 2023-08-01T19:55:41.759 INFO:teuthology.orchestra.run.smithi155.stdout: "events": [ 2023-08-01T19:55:41.759 INFO:teuthology.orchestra.run.smithi155.stdout: { 2023-08-01T19:55:41.759 INFO:teuthology.orchestra.run.smithi155.stdout: "event": "initiated", 2023-08-01T19:55:41.759 INFO:teuthology.orchestra.run.smithi155.stdout: "time": "2023-08-01T19:55:05.569750+0000", 2023-08-01T19:55:41.759 INFO:teuthology.orchestra.run.smithi155.stdout: "duration": 0 2023-08-01T19:55:41.760 INFO:teuthology.orchestra.run.smithi155.stdout: }, 2023-08-01T19:55:41.760 INFO:teuthology.orchestra.run.smithi155.stdout: { 2023-08-01T19:55:41.760 INFO:teuthology.orchestra.run.smithi155.stdout: "event": "throttled", 2023-08-01T19:55:41.760 INFO:teuthology.orchestra.run.smithi155.stdout: "time": "2023-08-01T19:55:05.569750+0000", 2023-08-01T19:55:41.760 INFO:teuthology.orchestra.run.smithi155.stdout: "duration": 0 2023-08-01T19:55:41.760 INFO:teuthology.orchestra.run.smithi155.stdout: }, 2023-08-01T19:55:41.760 INFO:teuthology.orchestra.run.smithi155.stdout: { 2023-08-01T19:55:41.760 INFO:teuthology.orchestra.run.smithi155.stdout: "event": "header_read", 2023-08-01T19:55:41.761 INFO:teuthology.orchestra.run.smithi155.stdout: "time": "2023-08-01T19:55:05.569749+0000", 2023-08-01T19:55:41.761 INFO:teuthology.orchestra.run.smithi155.stdout: "duration": 4294967295.999999 2023-08-01T19:55:41.761 INFO:teuthology.orchestra.run.smithi155.stdout: }, 2023-08-01T19:55:41.761 INFO:teuthology.orchestra.run.smithi155.stdout: { 2023-08-01T19:55:41.761 INFO:teuthology.orchestra.run.smithi155.stdout: "event": "all_read", 2023-08-01T19:55:41.761 INFO:teuthology.orchestra.run.smithi155.stdout: "time": "2023-08-01T19:55:05.569861+0000", 2023-08-01T19:55:41.761 INFO:teuthology.orchestra.run.smithi155.stdout: "duration": 0.000111333 2023-08-01T19:55:41.761 INFO:teuthology.orchestra.run.smithi155.stdout: }, 2023-08-01T19:55:41.762 INFO:teuthology.orchestra.run.smithi155.stdout: { 2023-08-01T19:55:41.762 INFO:teuthology.orchestra.run.smithi155.stdout: "event": "dispatched", 2023-08-01T19:55:41.762 INFO:teuthology.orchestra.run.smithi155.stdout: "time": "2023-08-01T19:55:05.569869+0000", 2023-08-01T19:55:41.762 INFO:teuthology.orchestra.run.smithi155.stdout: "duration": 8.8589999999999994e-06 2023-08-01T19:55:41.762 INFO:teuthology.orchestra.run.smithi155.stdout: }, 2023-08-01T19:55:41.762 INFO:teuthology.orchestra.run.smithi155.stdout: { 2023-08-01T19:55:41.762 INFO:teuthology.orchestra.run.smithi155.stdout: "event": "queued_for_pg", 2023-08-01T19:55:41.762 INFO:teuthology.orchestra.run.smithi155.stdout: "time": "2023-08-01T19:55:05.569874+0000", 2023-08-01T19:55:41.763 INFO:teuthology.orchestra.run.smithi155.stdout: "duration": 4.1679999999999997e-06 2023-08-01T19:55:41.763 INFO:teuthology.orchestra.run.smithi155.stdout: }, 2023-08-01T19:55:41.763 INFO:teuthology.orchestra.run.smithi155.stdout: { 2023-08-01T19:55:41.763 INFO:teuthology.orchestra.run.smithi155.stdout: "event": "reached_pg", 2023-08-01T19:55:41.763 INFO:teuthology.orchestra.run.smithi155.stdout: "time": "2023-08-01T19:55:05.569904+0000", 2023-08-01T19:55:41.763 INFO:teuthology.orchestra.run.smithi155.stdout: "duration": 3.0920999999999998e-05 2023-08-01T19:55:41.763 INFO:teuthology.orchestra.run.smithi155.stdout: }, 2023-08-01T19:55:41.764 INFO:teuthology.orchestra.run.smithi155.stdout: { 2023-08-01T19:55:41.764 INFO:teuthology.orchestra.run.smithi155.stdout: "event": "started", 2023-08-01T19:55:41.764 INFO:teuthology.orchestra.run.smithi155.stdout: "time": "2023-08-01T19:55:05.569998+0000", 2023-08-01T19:55:41.764 INFO:teuthology.orchestra.run.smithi155.stdout: "duration": 9.3086999999999998e-05 2023-08-01T19:55:41.764 INFO:teuthology.orchestra.run.smithi155.stdout: }, 2023-08-01T19:55:41.764 INFO:teuthology.orchestra.run.smithi155.stdout: { 2023-08-01T19:55:41.764 INFO:teuthology.orchestra.run.smithi155.stdout: "event": "waiting for subops from 0", 2023-08-01T19:55:41.764 INFO:teuthology.orchestra.run.smithi155.stdout: "time": "2023-08-01T19:55:05.570093+0000", 2023-08-01T19:55:41.765 INFO:teuthology.orchestra.run.smithi155.stdout: "duration": 9.5768999999999997e-05 2023-08-01T19:55:41.765 INFO:teuthology.orchestra.run.smithi155.stdout: }, 2023-08-01T19:55:41.765 INFO:teuthology.orchestra.run.smithi155.stdout: { 2023-08-01T19:55:41.765 INFO:teuthology.orchestra.run.smithi155.stdout: "event": "op_commit", 2023-08-01T19:55:41.765 INFO:teuthology.orchestra.run.smithi155.stdout: "time": "2023-08-01T19:55:05.572839+0000", 2023-08-01T19:55:41.765 INFO:teuthology.orchestra.run.smithi155.stdout: "duration": 0.0027460050000000001 2023-08-01T19:55:41.765 INFO:teuthology.orchestra.run.smithi155.stdout: }, 2023-08-01T19:55:41.765 INFO:teuthology.orchestra.run.smithi155.stdout: { 2023-08-01T19:55:41.766 INFO:teuthology.orchestra.run.smithi155.stdout: "event": "sub_op_commit_rec", 2023-08-01T19:55:41.766 INFO:teuthology.orchestra.run.smithi155.stdout: "time": "2023-08-01T19:55:05.635114+0000", 2023-08-01T19:55:41.766 INFO:teuthology.orchestra.run.smithi155.stdout: "duration": 0.062274297999999999 2023-08-01T19:55:41.766 INFO:teuthology.orchestra.run.smithi155.stdout: }, 2023-08-01T19:55:41.766 INFO:teuthology.orchestra.run.smithi155.stdout: { 2023-08-01T19:55:41.766 INFO:teuthology.orchestra.run.smithi155.stdout: "event": "commit_sent", 2023-08-01T19:55:41.766 INFO:teuthology.orchestra.run.smithi155.stdout: "time": "2023-08-01T19:55:05.635143+0000", 2023-08-01T19:55:41.766 INFO:teuthology.orchestra.run.smithi155.stdout: "duration": 2.9430000000000001e-05 2023-08-01T19:55:41.767 INFO:teuthology.orchestra.run.smithi155.stdout: }, 2023-08-01T19:55:41.767 INFO:teuthology.orchestra.run.smithi155.stdout: { 2023-08-01T19:55:41.767 INFO:teuthology.orchestra.run.smithi155.stdout: "event": "done", 2023-08-01T19:55:41.767 INFO:teuthology.orchestra.run.smithi155.stdout: "time": "2023-08-01T19:55:05.635181+0000", 2023-08-01T19:55:41.767 INFO:teuthology.orchestra.run.smithi155.stdout: "duration": 3.8352000000000001e-05 2023-08-01T19:55:41.767 INFO:teuthology.orchestra.run.smithi155.stdout: } 2023-08-01T19:55:41.767 INFO:teuthology.orchestra.run.smithi155.stdout: ] 2023-08-01T19:55:41.767 INFO:teuthology.orchestra.run.smithi155.stdout: } 2023-08-01T19:55:41.768 INFO:teuthology.orchestra.run.smithi155.stdout: }, 2023-08-01T19:55:41.768 INFO:teuthology.orchestra.run.smithi155.stdout: { 2023-08-01T19:55:41.768 INFO:teuthology.orchestra.run.smithi155.stdout: "description": "osd_op(client.4668.0:100944 5.4 5:25fae865:::benchmark_data_smithi006_114134_object100943:head [set-alloc-hint object_size 65536 write_size 65536,write 0~65536] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e37)", 2023-08-01T19:55:41.768 INFO:teuthology.orchestra.run.smithi155.stdout: "initiated_at": "2023-08-01T19:55:05.576662+0000", 2023-08-01T19:55:41.768 INFO:teuthology.orchestra.run.smithi155.stdout: "age": 35.994963941000002, 2023-08-01T19:55:41.768 INFO:teuthology.orchestra.run.smithi155.stdout: "duration": 0.056054925999999998, 2023-08-01T19:55:41.768 INFO:teuthology.orchestra.run.smithi155.stdout: "type_data": { 2023-08-01T19:55:41.769 INFO:teuthology.orchestra.run.smithi155.stdout: "flag_point": "commit sent; apply or cleanup", 2023-08-01T19:55:41.769 INFO:teuthology.orchestra.run.smithi155.stdout: "client_info": { 2023-08-01T19:55:41.769 INFO:teuthology.orchestra.run.smithi155.stdout: "client": "client.4668", 2023-08-01T19:55:41.769 INFO:teuthology.orchestra.run.smithi155.stdout: "client_addr": "172.21.15.6:0/1709472247", 2023-08-01T19:55:41.769 INFO:teuthology.orchestra.run.smithi155.stdout: "tid": 100944 2023-08-01T19:55:41.769 INFO:teuthology.orchestra.run.smithi155.stdout: }, 2023-08-01T19:55:41.769 INFO:teuthology.orchestra.run.smithi155.stdout: "events": [ 2023-08-01T19:55:41.769 INFO:teuthology.orchestra.run.smithi155.stdout: { 2023-08-01T19:55:41.770 INFO:teuthology.orchestra.run.smithi155.stdout: "event": "initiated", 2023-08-01T19:55:41.770 INFO:teuthology.orchestra.run.smithi155.stdout: "time": "2023-08-01T19:55:05.576662+0000", 2023-08-01T19:55:41.770 INFO:teuthology.orchestra.run.smithi155.stdout: "duration": 0 2023-08-01T19:55:41.770 INFO:teuthology.orchestra.run.smithi155.stdout: }, 2023-08-01T19:55:41.770 INFO:teuthology.orchestra.run.smithi155.stdout: { 2023-08-01T19:55:41.770 INFO:teuthology.orchestra.run.smithi155.stdout: "event": "throttled", 2023-08-01T19:55:41.770 INFO:teuthology.orchestra.run.smithi155.stdout: "time": "2023-08-01T19:55:05.576662+0000", 2023-08-01T19:55:41.770 INFO:teuthology.orchestra.run.smithi155.stdout: "duration": 0 2023-08-01T19:55:41.771 INFO:teuthology.orchestra.run.smithi155.stdout: }, 2023-08-01T19:55:41.771 INFO:teuthology.orchestra.run.smithi155.stdout: { 2023-08-01T19:55:41.771 INFO:teuthology.orchestra.run.smithi155.stdout: "event": "header_read", 2023-08-01T19:55:41.771 INFO:teuthology.orchestra.run.smithi155.stdout: "time": "2023-08-01T19:55:05.576661+0000", 2023-08-01T19:55:41.771 INFO:teuthology.orchestra.run.smithi155.stdout: "duration": 4294967295.999999 2023-08-01T19:55:41.771 INFO:teuthology.orchestra.run.smithi155.stdout: }, 2023-08-01T19:55:41.771 INFO:teuthology.orchestra.run.smithi155.stdout: { 2023-08-01T19:55:41.771 INFO:teuthology.orchestra.run.smithi155.stdout: "event": "all_read", 2023-08-01T19:55:41.772 INFO:teuthology.orchestra.run.smithi155.stdout: "time": "2023-08-01T19:55:05.576725+0000", 2023-08-01T19:55:41.772 INFO:teuthology.orchestra.run.smithi155.stdout: "duration": 6.4435000000000002e-05 2023-08-01T19:55:41.772 INFO:teuthology.orchestra.run.smithi155.stdout: }, 2023-08-01T19:55:41.772 INFO:teuthology.orchestra.run.smithi155.stdout: { 2023-08-01T19:55:41.772 INFO:teuthology.orchestra.run.smithi155.stdout: "event": "dispatched", 2023-08-01T19:55:41.772 INFO:teuthology.orchestra.run.smithi155.stdout: "time": "2023-08-01T19:55:05.576744+0000", 2023-08-01T19:55:41.772 INFO:teuthology.orchestra.run.smithi155.stdout: "duration": 1.8502999999999999e-05 2023-08-01T19:55:41.772 INFO:teuthology.orchestra.run.smithi155.stdout: }, 2023-08-01T19:55:41.773 INFO:teuthology.orchestra.run.smithi155.stdout: { 2023-08-01T19:55:41.773 INFO:teuthology.orchestra.run.smithi155.stdout: "event": "queued_for_pg", 2023-08-01T19:55:41.773 INFO:teuthology.orchestra.run.smithi155.stdout: "time": "2023-08-01T19:55:05.576772+0000", 2023-08-01T19:55:41.773 INFO:teuthology.orchestra.run.smithi155.stdout: "duration": 2.8354999999999999e-05 2023-08-01T19:55:41.773 INFO:teuthology.orchestra.run.smithi155.stdout: }, 2023-08-01T19:55:41.773 INFO:teuthology.orchestra.run.smithi155.stdout: { 2023-08-01T19:55:41.773 INFO:teuthology.orchestra.run.smithi155.stdout: "event": "reached_pg", 2023-08-01T19:55:41.773 INFO:teuthology.orchestra.run.smithi155.stdout: "time": "2023-08-01T19:55:05.576815+0000", 2023-08-01T19:55:41.774 INFO:teuthology.orchestra.run.smithi155.stdout: "duration": 4.3223999999999998e-05 2023-08-01T19:55:41.774 INFO:teuthology.orchestra.run.smithi155.stdout: }, 2023-08-01T19:55:41.774 INFO:teuthology.orchestra.run.smithi155.stdout: { 2023-08-01T19:55:41.774 INFO:teuthology.orchestra.run.smithi155.stdout: "event": "started", 2023-08-01T19:55:41.774 INFO:teuthology.orchestra.run.smithi155.stdout: "time": "2023-08-01T19:55:05.576961+0000", 2023-08-01T19:55:41.774 INFO:teuthology.orchestra.run.smithi155.stdout: "duration": 0.000145043 2023-08-01T19:55:41.774 INFO:teuthology.orchestra.run.smithi155.stdout: }, 2023-08-01T19:55:41.774 INFO:teuthology.orchestra.run.smithi155.stdout: { 2023-08-01T19:55:41.775 INFO:teuthology.orchestra.run.smithi155.stdout: "event": "waiting for subops from 0", 2023-08-01T19:55:41.775 INFO:teuthology.orchestra.run.smithi155.stdout: "time": "2023-08-01T19:55:05.577343+0000", 2023-08-01T19:55:41.775 INFO:teuthology.orchestra.run.smithi155.stdout: "duration": 0.00038249699999999998 2023-08-01T19:55:41.775 INFO:teuthology.orchestra.run.smithi155.stdout: }, 2023-08-01T19:55:41.775 INFO:teuthology.orchestra.run.smithi155.stdout: { 2023-08-01T19:55:41.775 INFO:teuthology.orchestra.run.smithi155.stdout: "event": "op_commit", 2023-08-01T19:55:41.775 INFO:teuthology.orchestra.run.smithi155.stdout: "time": "2023-08-01T19:55:05.582349+0000", 2023-08-01T19:55:41.776 INFO:teuthology.orchestra.run.smithi155.stdout: "duration": 0.0050062880000000002 2023-08-01T19:55:41.776 INFO:teuthology.orchestra.run.smithi155.stdout: }, 2023-08-01T19:55:41.776 INFO:teuthology.orchestra.run.smithi155.stdout: { 2023-08-01T19:55:41.776 INFO:teuthology.orchestra.run.smithi155.stdout: "event": "sub_op_commit_rec", 2023-08-01T19:55:41.776 INFO:teuthology.orchestra.run.smithi155.stdout: "time": "2023-08-01T19:55:05.632659+0000", 2023-08-01T19:55:41.776 INFO:teuthology.orchestra.run.smithi155.stdout: "duration": 0.050309185999999999 2023-08-01T19:55:41.776 INFO:teuthology.orchestra.run.smithi155.stdout: }, 2023-08-01T19:55:41.776 INFO:teuthology.orchestra.run.smithi155.stdout: { 2023-08-01T19:55:41.777 INFO:teuthology.orchestra.run.smithi155.stdout: "event": "commit_sent", 2023-08-01T19:55:41.777 INFO:teuthology.orchestra.run.smithi155.stdout: "time": "2023-08-01T19:55:05.632692+0000", 2023-08-01T19:55:41.777 INFO:teuthology.orchestra.run.smithi155.stdout: "duration": 3.3077999999999997e-05 2023-08-01T19:55:41.777 INFO:teuthology.orchestra.run.smithi155.stdout: }, 2023-08-01T19:55:41.777 INFO:teuthology.orchestra.run.smithi155.stdout: { 2023-08-01T19:55:41.777 INFO:teuthology.orchestra.run.smithi155.stdout: "event": "done", 2023-08-01T19:55:41.777 INFO:teuthology.orchestra.run.smithi155.stdout: "time": "2023-08-01T19:55:05.632717+0000", 2023-08-01T19:55:41.777 INFO:teuthology.orchestra.run.smithi155.stdout: "duration": 2.5119000000000001e-05 2023-08-01T19:55:41.778 INFO:teuthology.orchestra.run.smithi155.stdout: } 2023-08-01T19:55:41.778 INFO:teuthology.orchestra.run.smithi155.stdout: ] 2023-08-01T19:55:41.778 INFO:teuthology.orchestra.run.smithi155.stdout: } 2023-08-01T19:55:41.778 INFO:teuthology.orchestra.run.smithi155.stdout: }, 2023-08-01T19:55:41.778 INFO:teuthology.orchestra.run.smithi155.stdout: { 2023-08-01T19:55:41.778 INFO:teuthology.orchestra.run.smithi155.stdout: "description": "osd_op(client.4668.0:100945 5.e 5:73df68dd:::benchmark_data_smithi006_114134_object100944:head [set-alloc-hint object_size 65536 write_size 65536,write 0~65536] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e37)", 2023-08-01T19:55:41.778 INFO:teuthology.orchestra.run.smithi155.stdout: "initiated_at": "2023-08-01T19:55:05.576784+0000", 2023-08-01T19:55:41.778 INFO:teuthology.orchestra.run.smithi155.stdout: "age": 35.994842052999999, 2023-08-01T19:55:41.779 INFO:teuthology.orchestra.run.smithi155.stdout: "duration": 0.058512994999999998, 2023-08-01T19:55:41.779 INFO:teuthology.orchestra.run.smithi155.stdout: "type_data": { 2023-08-01T19:55:41.779 INFO:teuthology.orchestra.run.smithi155.stdout: "flag_point": "commit sent; apply or cleanup", 2023-08-01T19:55:41.779 INFO:teuthology.orchestra.run.smithi155.stdout: "client_info": { 2023-08-01T19:55:41.779 INFO:teuthology.orchestra.run.smithi155.stdout: "client": "client.4668", 2023-08-01T19:55:41.779 INFO:teuthology.orchestra.run.smithi155.stdout: "client_addr": "172.21.15.6:0/1709472247", 2023-08-01T19:55:41.779 INFO:teuthology.orchestra.run.smithi155.stdout: "tid": 100945 2023-08-01T19:55:41.779 INFO:teuthology.orchestra.run.smithi155.stdout: }, 2023-08-01T19:55:41.780 INFO:teuthology.orchestra.run.smithi155.stdout: "events": [ 2023-08-01T19:55:41.780 INFO:teuthology.orchestra.run.smithi155.stdout: { 2023-08-01T19:55:41.780 INFO:teuthology.orchestra.run.smithi155.stdout: "event": "initiated", 2023-08-01T19:55:41.780 INFO:teuthology.orchestra.run.smithi155.stdout: "time": "2023-08-01T19:55:05.576784+0000", 2023-08-01T19:55:41.780 INFO:teuthology.orchestra.run.smithi155.stdout: "duration": 0 2023-08-01T19:55:41.780 INFO:teuthology.orchestra.run.smithi155.stdout: }, 2023-08-01T19:55:41.780 INFO:teuthology.orchestra.run.smithi155.stdout: { 2023-08-01T19:55:41.781 INFO:teuthology.orchestra.run.smithi155.stdout: "event": "throttled", 2023-08-01T19:55:41.781 INFO:teuthology.orchestra.run.smithi155.stdout: "time": "2023-08-01T19:55:05.576784+0000", 2023-08-01T19:55:41.781 INFO:teuthology.orchestra.run.smithi155.stdout: "duration": 0 2023-08-01T19:55:41.781 INFO:teuthology.orchestra.run.smithi155.stdout: }, 2023-08-01T19:55:41.781 INFO:teuthology.orchestra.run.smithi155.stdout: { 2023-08-01T19:55:41.781 INFO:teuthology.orchestra.run.smithi155.stdout: "event": "header_read", 2023-08-01T19:55:41.781 INFO:teuthology.orchestra.run.smithi155.stdout: "time": "2023-08-01T19:55:05.576783+0000", 2023-08-01T19:55:41.781 INFO:teuthology.orchestra.run.smithi155.stdout: "duration": 4294967295.9999995 2023-08-01T19:55:41.782 INFO:teuthology.orchestra.run.smithi155.stdout: }, 2023-08-01T19:55:41.782 INFO:teuthology.orchestra.run.smithi155.stdout: { 2023-08-01T19:55:41.782 INFO:teuthology.orchestra.run.smithi155.stdout: "event": "all_read", 2023-08-01T19:55:41.782 INFO:teuthology.orchestra.run.smithi155.stdout: "time": "2023-08-01T19:55:05.576807+0000", 2023-08-01T19:55:41.782 INFO:teuthology.orchestra.run.smithi155.stdout: "duration": 2.3651000000000001e-05 2023-08-01T19:55:41.782 INFO:teuthology.orchestra.run.smithi155.stdout: }, 2023-08-01T19:55:41.782 INFO:teuthology.orchestra.run.smithi155.stdout: { 2023-08-01T19:55:41.782 INFO:teuthology.orchestra.run.smithi155.stdout: "event": "dispatched", 2023-08-01T19:55:41.783 INFO:teuthology.orchestra.run.smithi155.stdout: "time": "2023-08-01T19:55:05.576817+0000", 2023-08-01T19:55:41.783 INFO:teuthology.orchestra.run.smithi155.stdout: "duration": 9.9389999999999992e-06 2023-08-01T19:55:41.783 INFO:teuthology.orchestra.run.smithi155.stdout: }, 2023-08-01T19:55:41.783 INFO:teuthology.orchestra.run.smithi155.stdout: { 2023-08-01T19:55:41.783 INFO:teuthology.orchestra.run.smithi155.stdout: "event": "queued_for_pg", 2023-08-01T19:55:41.783 INFO:teuthology.orchestra.run.smithi155.stdout: "time": "2023-08-01T19:55:05.576820+0000", 2023-08-01T19:55:41.783 INFO:teuthology.orchestra.run.smithi155.stdout: "duration": 3.2619999999999999e-06 2023-08-01T19:55:41.783 INFO:teuthology.orchestra.run.smithi155.stdout: }, 2023-08-01T19:55:41.784 INFO:teuthology.orchestra.run.smithi155.stdout: { 2023-08-01T19:55:41.784 INFO:teuthology.orchestra.run.smithi155.stdout: "event": "reached_pg", 2023-08-01T19:55:41.784 INFO:teuthology.orchestra.run.smithi155.stdout: "time": "2023-08-01T19:55:05.576849+0000", 2023-08-01T19:55:41.784 INFO:teuthology.orchestra.run.smithi155.stdout: "duration": 2.8880000000000001e-05 2023-08-01T19:55:41.784 INFO:teuthology.orchestra.run.smithi155.stdout: }, 2023-08-01T19:55:41.784 INFO:teuthology.orchestra.run.smithi155.stdout: { 2023-08-01T19:55:41.784 INFO:teuthology.orchestra.run.smithi155.stdout: "event": "started", 2023-08-01T19:55:41.784 INFO:teuthology.orchestra.run.smithi155.stdout: "time": "2023-08-01T19:55:05.576940+0000", 2023-08-01T19:55:41.785 INFO:teuthology.orchestra.run.smithi155.stdout: "duration": 9.0570999999999997e-05 2023-08-01T19:55:41.785 INFO:teuthology.orchestra.run.smithi155.stdout: }, 2023-08-01T19:55:41.785 INFO:teuthology.orchestra.run.smithi155.stdout: { 2023-08-01T19:55:41.785 INFO:teuthology.orchestra.run.smithi155.stdout: "event": "waiting for subops from 0", 2023-08-01T19:55:41.785 INFO:teuthology.orchestra.run.smithi155.stdout: "time": "2023-08-01T19:55:05.577027+0000", 2023-08-01T19:55:41.785 INFO:teuthology.orchestra.run.smithi155.stdout: "duration": 8.7237999999999994e-05 2023-08-01T19:55:41.785 INFO:teuthology.orchestra.run.smithi155.stdout: }, 2023-08-01T19:55:41.786 INFO:teuthology.orchestra.run.smithi155.stdout: { 2023-08-01T19:55:41.786 INFO:teuthology.orchestra.run.smithi155.stdout: "event": "op_commit", 2023-08-01T19:55:41.786 INFO:teuthology.orchestra.run.smithi155.stdout: "time": "2023-08-01T19:55:05.579624+0000", 2023-08-01T19:55:41.786 INFO:teuthology.orchestra.run.smithi155.stdout: "duration": 0.0025971200000000001 2023-08-01T19:55:41.786 INFO:teuthology.orchestra.run.smithi155.stdout: }, 2023-08-01T19:55:41.786 INFO:teuthology.orchestra.run.smithi155.stdout: { 2023-08-01T19:55:41.786 INFO:teuthology.orchestra.run.smithi155.stdout: "event": "sub_op_commit_rec", 2023-08-01T19:55:41.786 INFO:teuthology.orchestra.run.smithi155.stdout: "time": "2023-08-01T19:55:05.635218+0000", 2023-08-01T19:55:41.787 INFO:teuthology.orchestra.run.smithi155.stdout: "duration": 0.055594487999999997 2023-08-01T19:55:41.787 INFO:teuthology.orchestra.run.smithi155.stdout: }, 2023-08-01T19:55:41.787 INFO:teuthology.orchestra.run.smithi155.stdout: { 2023-08-01T19:55:41.787 INFO:teuthology.orchestra.run.smithi155.stdout: "event": "commit_sent", 2023-08-01T19:55:41.787 INFO:teuthology.orchestra.run.smithi155.stdout: "time": "2023-08-01T19:55:05.635262+0000", 2023-08-01T19:55:41.787 INFO:teuthology.orchestra.run.smithi155.stdout: "duration": 4.3380999999999997e-05 2023-08-01T19:55:41.787 INFO:teuthology.orchestra.run.smithi155.stdout: }, 2023-08-01T19:55:41.787 INFO:teuthology.orchestra.run.smithi155.stdout: { 2023-08-01T19:55:41.788 INFO:teuthology.orchestra.run.smithi155.stdout: "event": "done", 2023-08-01T19:55:41.788 INFO:teuthology.orchestra.run.smithi155.stdout: "time": "2023-08-01T19:55:05.635297+0000", 2023-08-01T19:55:41.788 INFO:teuthology.orchestra.run.smithi155.stdout: "duration": 3.4842000000000003e-05 2023-08-01T19:55:41.788 INFO:teuthology.orchestra.run.smithi155.stdout: } 2023-08-01T19:55:41.788 INFO:teuthology.orchestra.run.smithi155.stdout: ] 2023-08-01T19:55:41.788 INFO:teuthology.orchestra.run.smithi155.stdout: } 2023-08-01T19:55:41.788 INFO:teuthology.orchestra.run.smithi155.stdout: }, 2023-08-01T19:55:41.788 INFO:teuthology.orchestra.run.smithi155.stdout: { 2023-08-01T19:55:41.789 INFO:teuthology.orchestra.run.smithi155.stdout: "description": "osd_op(client.4668.0:100947 5.4 5:23e8fc27:::benchmark_data_smithi006_114134_object100946:head [set-alloc-hint object_size 65536 write_size 65536,write 0~65536] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e37)", 2023-08-01T19:55:41.789 INFO:teuthology.orchestra.run.smithi155.stdout: "initiated_at": "2023-08-01T19:55:05.576840+0000", 2023-08-01T19:55:41.789 INFO:teuthology.orchestra.run.smithi155.stdout: "age": 35.994785997999998, 2023-08-01T19:55:41.789 INFO:teuthology.orchestra.run.smithi155.stdout: "duration": 0.058423127999999998, 2023-08-01T19:55:41.789 INFO:teuthology.orchestra.run.smithi155.stdout: "type_data": { 2023-08-01T19:55:41.789 INFO:teuthology.orchestra.run.smithi155.stdout: "flag_point": "commit sent; apply or cleanup", 2023-08-01T19:55:41.789 INFO:teuthology.orchestra.run.smithi155.stdout: "client_info": { 2023-08-01T19:55:41.789 INFO:teuthology.orchestra.run.smithi155.stdout: "client": "client.4668", 2023-08-01T19:55:41.790 INFO:teuthology.orchestra.run.smithi155.stdout: "client_addr": "172.21.15.6:0/1709472247", 2023-08-01T19:55:41.790 INFO:teuthology.orchestra.run.smithi155.stdout: "tid": 100947 2023-08-01T19:55:41.790 INFO:teuthology.orchestra.run.smithi155.stdout: }, 2023-08-01T19:55:41.790 INFO:teuthology.orchestra.run.smithi155.stdout: "events": [ 2023-08-01T19:55:41.790 INFO:teuthology.orchestra.run.smithi155.stdout: { 2023-08-01T19:55:41.790 INFO:teuthology.orchestra.run.smithi155.stdout: "event": "initiated", 2023-08-01T19:55:41.790 INFO:teuthology.orchestra.run.smithi155.stdout: "time": "2023-08-01T19:55:05.576840+0000", 2023-08-01T19:55:41.790 INFO:teuthology.orchestra.run.smithi155.stdout: "duration": 0 2023-08-01T19:55:41.791 INFO:teuthology.orchestra.run.smithi155.stdout: }, 2023-08-01T19:55:41.791 INFO:teuthology.orchestra.run.smithi155.stdout: { 2023-08-01T19:55:41.791 INFO:teuthology.orchestra.run.smithi155.stdout: "event": "throttled", 2023-08-01T19:55:41.791 INFO:teuthology.orchestra.run.smithi155.stdout: "time": "2023-08-01T19:55:05.576840+0000", 2023-08-01T19:55:41.791 INFO:teuthology.orchestra.run.smithi155.stdout: "duration": 0 2023-08-01T19:55:41.791 INFO:teuthology.orchestra.run.smithi155.stdout: }, 2023-08-01T19:55:41.791 INFO:teuthology.orchestra.run.smithi155.stdout: { 2023-08-01T19:55:41.791 INFO:teuthology.orchestra.run.smithi155.stdout: "event": "header_read", 2023-08-01T19:55:41.792 INFO:teuthology.orchestra.run.smithi155.stdout: "time": "2023-08-01T19:55:05.576839+0000", 2023-08-01T19:55:41.792 INFO:teuthology.orchestra.run.smithi155.stdout: "duration": 4294967295.9999995 2023-08-01T19:55:41.792 INFO:teuthology.orchestra.run.smithi155.stdout: }, 2023-08-01T19:55:41.792 INFO:teuthology.orchestra.run.smithi155.stdout: { 2023-08-01T19:55:41.792 INFO:teuthology.orchestra.run.smithi155.stdout: "event": "all_read", 2023-08-01T19:55:41.792 INFO:teuthology.orchestra.run.smithi155.stdout: "time": "2023-08-01T19:55:05.576893+0000", 2023-08-01T19:55:41.792 INFO:teuthology.orchestra.run.smithi155.stdout: "duration": 5.3893000000000001e-05 2023-08-01T19:55:41.793 INFO:teuthology.orchestra.run.smithi155.stdout: }, 2023-08-01T19:55:41.793 INFO:teuthology.orchestra.run.smithi155.stdout: { 2023-08-01T19:55:41.793 INFO:teuthology.orchestra.run.smithi155.stdout: "event": "dispatched", 2023-08-01T19:55:41.793 INFO:teuthology.orchestra.run.smithi155.stdout: "time": "2023-08-01T19:55:05.576902+0000", 2023-08-01T19:55:41.793 INFO:teuthology.orchestra.run.smithi155.stdout: "duration": 8.7520000000000002e-06 2023-08-01T19:55:41.793 INFO:teuthology.orchestra.run.smithi155.stdout: }, 2023-08-01T19:55:41.793 INFO:teuthology.orchestra.run.smithi155.stdout: { 2023-08-01T19:55:41.793 INFO:teuthology.orchestra.run.smithi155.stdout: "event": "queued_for_pg", 2023-08-01T19:55:41.794 INFO:teuthology.orchestra.run.smithi155.stdout: "time": "2023-08-01T19:55:05.576905+0000", 2023-08-01T19:55:41.794 INFO:teuthology.orchestra.run.smithi155.stdout: "duration": 3.01e-06 2023-08-01T19:55:41.794 INFO:teuthology.orchestra.run.smithi155.stdout: }, 2023-08-01T19:55:41.794 INFO:teuthology.orchestra.run.smithi155.stdout: { 2023-08-01T19:55:41.794 INFO:teuthology.orchestra.run.smithi155.stdout: "event": "reached_pg", 2023-08-01T19:55:41.794 INFO:teuthology.orchestra.run.smithi155.stdout: "time": "2023-08-01T19:55:05.579641+0000", 2023-08-01T19:55:41.794 INFO:teuthology.orchestra.run.smithi155.stdout: "duration": 0.0027366880000000001 2023-08-01T19:55:41.794 INFO:teuthology.orchestra.run.smithi155.stdout: }, 2023-08-01T19:55:41.795 INFO:teuthology.orchestra.run.smithi155.stdout: { 2023-08-01T19:55:41.795 INFO:teuthology.orchestra.run.smithi155.stdout: "event": "started", 2023-08-01T19:55:41.795 INFO:teuthology.orchestra.run.smithi155.stdout: "time": "2023-08-01T19:55:05.579734+0000", 2023-08-01T19:55:41.795 INFO:teuthology.orchestra.run.smithi155.stdout: "duration": 9.2590000000000006e-05 2023-08-01T19:55:41.795 INFO:teuthology.orchestra.run.smithi155.stdout: }, 2023-08-01T19:55:41.795 INFO:teuthology.orchestra.run.smithi155.stdout: { 2023-08-01T19:55:41.795 INFO:teuthology.orchestra.run.smithi155.stdout: "event": "waiting for subops from 0", 2023-08-01T19:55:41.795 INFO:teuthology.orchestra.run.smithi155.stdout: "time": "2023-08-01T19:55:05.579825+0000", 2023-08-01T19:55:41.796 INFO:teuthology.orchestra.run.smithi155.stdout: "duration": 9.0964999999999994e-05 2023-08-01T19:55:41.796 INFO:teuthology.orchestra.run.smithi155.stdout: }, 2023-08-01T19:55:41.796 INFO:teuthology.orchestra.run.smithi155.stdout: { 2023-08-01T19:55:41.796 INFO:teuthology.orchestra.run.smithi155.stdout: "event": "op_commit", 2023-08-01T19:55:41.796 INFO:teuthology.orchestra.run.smithi155.stdout: "time": "2023-08-01T19:55:05.585041+0000", 2023-08-01T19:55:41.796 INFO:teuthology.orchestra.run.smithi155.stdout: "duration": 0.0052159670000000002 2023-08-01T19:55:41.796 INFO:teuthology.orchestra.run.smithi155.stdout: }, 2023-08-01T19:55:41.796 INFO:teuthology.orchestra.run.smithi155.stdout: { 2023-08-01T19:55:41.797 INFO:teuthology.orchestra.run.smithi155.stdout: "event": "sub_op_commit_rec", 2023-08-01T19:55:41.797 INFO:teuthology.orchestra.run.smithi155.stdout: "time": "2023-08-01T19:55:05.635199+0000", 2023-08-01T19:55:41.797 INFO:teuthology.orchestra.run.smithi155.stdout: "duration": 0.050158023000000003 2023-08-01T19:55:41.797 INFO:teuthology.orchestra.run.smithi155.stdout: }, 2023-08-01T19:55:41.797 INFO:teuthology.orchestra.run.smithi155.stdout: { 2023-08-01T19:55:41.797 INFO:teuthology.orchestra.run.smithi155.stdout: "event": "commit_sent", 2023-08-01T19:55:41.797 INFO:teuthology.orchestra.run.smithi155.stdout: "time": "2023-08-01T19:55:05.635227+0000", 2023-08-01T19:55:41.797 INFO:teuthology.orchestra.run.smithi155.stdout: "duration": 2.7821e-05 2023-08-01T19:55:41.798 INFO:teuthology.orchestra.run.smithi155.stdout: }, 2023-08-01T19:55:41.798 INFO:teuthology.orchestra.run.smithi155.stdout: { 2023-08-01T19:55:41.798 INFO:teuthology.orchestra.run.smithi155.stdout: "event": "done", 2023-08-01T19:55:41.798 INFO:teuthology.orchestra.run.smithi155.stdout: "time": "2023-08-01T19:55:05.635263+0000", 2023-08-01T19:55:41.798 INFO:teuthology.orchestra.run.smithi155.stdout: "duration": 3.6081000000000002e-05 2023-08-01T19:55:41.798 INFO:teuthology.orchestra.run.smithi155.stdout: } 2023-08-01T19:55:41.798 INFO:teuthology.orchestra.run.smithi155.stdout: ] 2023-08-01T19:55:41.799 INFO:teuthology.orchestra.run.smithi155.stdout: } 2023-08-01T19:55:41.799 INFO:teuthology.orchestra.run.smithi155.stdout: } 2023-08-01T19:55:41.799 INFO:teuthology.orchestra.run.smithi155.stdout: ] 2023-08-01T19:55:41.799 INFO:teuthology.orchestra.run.smithi155.stdout:} 2023-08-01T19:55:41.800 INFO:tasks.ceph.osd.0.smithi008.stderr:2023-08-01T19:55:41.798+0000 7f16a58f4700 -1 received signal: Hangup from /usr/bin/python3 /bin/daemon-helper kill ceph-osd -f --cluster ceph -i 0 (PID: 111179) UID: 0 2023-08-01T19:55:41.801 DEBUG:teuthology.orchestra.run.smithi008:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 30 ceph --cluster ceph --admin-daemon /var/run/ceph/ceph-osd.0.asok dump_ops_in_flight 2023-08-01T19:55:41.901 INFO:tasks.ceph.osd.1.smithi101.stderr:2023-08-01T19:55:41.900+0000 7fb0cb7f6700 -1 received signal: Hangup from /usr/bin/python3 /bin/daemon-helper kill ceph-osd -f --cluster ceph -i 1 (PID: 111141) UID: 0 2023-08-01T19:55:41.948 INFO:teuthology.orchestra.run.smithi006.stdout:osd.0: {} 2023-08-01T19:55:41.967 INFO:teuthology.orchestra.run.smithi006.stdout:osd.1: {} 2023-08-01T19:55:41.985 INFO:teuthology.orchestra.run.smithi008.stdout:ERROR: (22) Invalid argument 2023-08-01T19:55:41.985 INFO:teuthology.orchestra.run.smithi008.stdout:op_tracker tracking is not enabled now, so no ops are tracked currently, even those get stuck. Please enable "osd_enable_op_tracker", and the tracker will start to track new ops received afterwards. 2023-08-01T19:55:41.988 INFO:teuthology.orchestra.run.smithi006.stdout:osd.2: {} 2023-08-01T19:55:41.989 INFO:teuthology.orchestra.run.smithi006.stderr:osd.0: osd_enable_op_tracker = 'false' 2023-08-01T19:55:41.989 INFO:teuthology.orchestra.run.smithi006.stderr:osd.1: osd_enable_op_tracker = 'false' 2023-08-01T19:55:41.989 INFO:teuthology.orchestra.run.smithi006.stderr:osd.2: osd_enable_op_tracker = 'false' 2023-08-01T19:55:42.000 DEBUG:teuthology.orchestra.run.smithi008:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 30 ceph --cluster ceph --admin-daemon /var/run/ceph/ceph-osd.0.asok dump_blocked_ops 2023-08-01T19:55:42.001 INFO:tasks.ceph.osd.2.smithi155.stderr:2023-08-01T19:55:42.000+0000 7faa5c6ac700 -1 received signal: Hangup from /usr/bin/python3 /bin/daemon-helper kill ceph-osd -f --cluster ceph -i 2 (PID: 111337) UID: 0 2023-08-01T19:55:42.077 DEBUG:teuthology.orchestra.run.smithi006:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 120 ceph --cluster ceph osd unset nodeep-scrub 2023-08-01T19:55:42.102 INFO:tasks.ceph.osd.2.smithi155.stderr:2023-08-01T19:55:42.101+0000 7faa5c6ac700 -1 received signal: Hangup from /usr/bin/python3 /bin/daemon-helper kill ceph-osd -f --cluster ceph -i 2 (PID: 111337) UID: 0 2023-08-01T19:55:42.181 INFO:teuthology.orchestra.run.smithi008.stdout:ERROR: (22) Invalid argument 2023-08-01T19:55:42.181 INFO:teuthology.orchestra.run.smithi008.stdout:op_tracker tracking is not enabled now, so no ops are tracked currently, even those get stuck. Please enable "osd_enable_op_tracker", and the tracker will start to track new ops received afterwards. 2023-08-01T19:55:42.196 DEBUG:teuthology.orchestra.run.smithi008:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 30 ceph --cluster ceph --admin-daemon /var/run/ceph/ceph-osd.0.asok dump_historic_ops 2023-08-01T19:55:42.203 INFO:tasks.ceph.osd.2.smithi155.stderr:2023-08-01T19:55:42.201+0000 7faa5c6ac700 -1 received signal: Hangup from /usr/bin/python3 /bin/daemon-helper kill ceph-osd -f --cluster ceph -i 2 (PID: 111337) UID: 0 2023-08-01T19:55:42.304 INFO:tasks.ceph.osd.1.smithi101.stderr:2023-08-01T19:55:42.303+0000 7fb0cb7f6700 -1 received signal: Hangup from /usr/bin/python3 /bin/daemon-helper kill ceph-osd -f --cluster ceph -i 1 (PID: 111141) UID: 0 2023-08-01T19:55:42.386 INFO:teuthology.orchestra.run.smithi008.stdout:ERROR: (22) Invalid argument 2023-08-01T19:55:42.387 INFO:teuthology.orchestra.run.smithi008.stdout:op_tracker tracking is not enabled now, so no ops are tracked currently, even those get stuck. Please enable "osd_enable_op_tracker", and the tracker will start to track new ops received afterwards. 2023-08-01T19:55:42.400 DEBUG:teuthology.orchestra.run.smithi101:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 30 ceph --cluster ceph --admin-daemon /var/run/ceph/ceph-osd.1.asok dump_ops_in_flight 2023-08-01T19:55:42.405 INFO:tasks.ceph.osd.0.smithi008.stderr:2023-08-01T19:55:42.403+0000 7f16a58f4700 -1 received signal: Hangup from /usr/bin/python3 /bin/daemon-helper kill ceph-osd -f --cluster ceph -i 0 (PID: 111179) UID: 0 2023-08-01T19:55:42.505 INFO:tasks.ceph.osd.0.smithi008.stderr:2023-08-01T19:55:42.504+0000 7f16a58f4700 -1 received signal: Hangup from /usr/bin/python3 /bin/daemon-helper kill ceph-osd -f --cluster ceph -i 0 (PID: 111179) UID: 0 2023-08-01T19:55:42.562 INFO:teuthology.orchestra.run.smithi101.stdout:ERROR: (22) Invalid argument 2023-08-01T19:55:42.562 INFO:teuthology.orchestra.run.smithi101.stdout:op_tracker tracking is not enabled now, so no ops are tracked currently, even those get stuck. Please enable "osd_enable_op_tracker", and the tracker will start to track new ops received afterwards. 2023-08-01T19:55:42.575 DEBUG:teuthology.orchestra.run.smithi101:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 30 ceph --cluster ceph --admin-daemon /var/run/ceph/ceph-osd.1.asok dump_blocked_ops 2023-08-01T19:55:42.606 INFO:tasks.ceph.osd.2.smithi155.stderr:2023-08-01T19:55:42.604+0000 7faa5c6ac700 -1 received signal: Hangup from /usr/bin/python3 /bin/daemon-helper kill ceph-osd -f --cluster ceph -i 2 (PID: 111337) UID: 0 2023-08-01T19:55:42.706 INFO:tasks.ceph.osd.1.smithi101.stderr:2023-08-01T19:55:42.705+0000 7fb0cb7f6700 -1 received signal: Hangup from /usr/bin/python3 /bin/daemon-helper kill ceph-osd -f --cluster ceph -i 1 (PID: 111141) UID: 0 2023-08-01T19:55:42.744 INFO:teuthology.orchestra.run.smithi101.stdout:ERROR: (22) Invalid argument 2023-08-01T19:55:42.745 INFO:teuthology.orchestra.run.smithi101.stdout:op_tracker tracking is not enabled now, so no ops are tracked currently, even those get stuck. Please enable "osd_enable_op_tracker", and the tracker will start to track new ops received afterwards. 2023-08-01T19:55:42.758 DEBUG:teuthology.orchestra.run.smithi101:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 30 ceph --cluster ceph --admin-daemon /var/run/ceph/ceph-osd.1.asok dump_historic_ops 2023-08-01T19:55:42.807 INFO:tasks.ceph.osd.2.smithi155.stderr:2023-08-01T19:55:42.806+0000 7faa5c6ac700 -1 received signal: Hangup from /usr/bin/python3 /bin/daemon-helper kill ceph-osd -f --cluster ceph -i 2 (PID: 111337) UID: 0 2023-08-01T19:55:42.908 INFO:tasks.ceph.osd.1.smithi101.stderr:2023-08-01T19:55:42.906+0000 7fb0cb7f6700 -1 received signal: Hangup from /usr/bin/python3 /bin/daemon-helper kill ceph-osd -f --cluster ceph -i 1 (PID: 111141) UID: 0 2023-08-01T19:55:42.968 INFO:teuthology.orchestra.run.smithi101.stdout:ERROR: (22) Invalid argument 2023-08-01T19:55:42.968 INFO:teuthology.orchestra.run.smithi101.stdout:op_tracker tracking is not enabled now, so no ops are tracked currently, even those get stuck. Please enable "osd_enable_op_tracker", and the tracker will start to track new ops received afterwards. 2023-08-01T19:55:42.981 DEBUG:teuthology.orchestra.run.smithi155:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 30 ceph --cluster ceph --admin-daemon /var/run/ceph/ceph-osd.2.asok dump_ops_in_flight 2023-08-01T19:55:43.023 INFO:tasks.ceph.osd.2.smithi155.stderr:2023-08-01T19:55:43.022+0000 7faa5c6ac700 -1 received signal: Hangup from /usr/bin/python3 /bin/daemon-helper kill ceph-osd -f --cluster ceph -i 2 (PID: 111337) UID: 0 2023-08-01T19:55:43.068 INFO:teuthology.orchestra.run.smithi006.stderr:nodeep-scrub is unset 2023-08-01T19:55:43.075 INFO:tasks.thrashosds.thrasher:in_osds: [0, 1, 2] out_osds: [] dead_osds: [] live_osds: [0, 1, 2] 2023-08-01T19:55:43.075 INFO:tasks.thrashosds.thrasher:choose_action: min_in 4 min_out 0 min_live 2 min_dead 0 chance_down 1.00 2023-08-01T19:55:43.075 INFO:tasks.thrashosds.thrasher:primary_affinity 2023-08-01T19:55:43.075 INFO:tasks.thrashosds.thrasher:Setting osd 0 primary_affinity to 0.419323 2023-08-01T19:55:43.075 DEBUG:teuthology.orchestra.run.smithi006:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 120 ceph --cluster ceph osd primary-affinity 0 0.4193232918146439 2023-08-01T19:55:43.109 INFO:tasks.ceph.osd.1.smithi101.stderr:2023-08-01T19:55:43.108+0000 7fb0cb7f6700 -1 received signal: Hangup from /usr/bin/python3 /bin/daemon-helper kill ceph-osd -f --cluster ceph -i 1 (PID: 111141) UID: 0 2023-08-01T19:55:43.151 INFO:teuthology.orchestra.run.smithi155.stdout:ERROR: (22) Invalid argument 2023-08-01T19:55:43.151 INFO:teuthology.orchestra.run.smithi155.stdout:op_tracker tracking is not enabled now, so no ops are tracked currently, even those get stuck. Please enable "osd_enable_op_tracker", and the tracker will start to track new ops received afterwards. 2023-08-01T19:55:43.164 DEBUG:teuthology.orchestra.run.smithi155:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 30 ceph --cluster ceph --admin-daemon /var/run/ceph/ceph-osd.2.asok dump_blocked_ops 2023-08-01T19:55:43.210 INFO:tasks.ceph.osd.1.smithi101.stderr:2023-08-01T19:55:43.209+0000 7fb0cb7f6700 -1 received signal: Hangup from /usr/bin/python3 /bin/daemon-helper kill ceph-osd -f --cluster ceph -i 1 (PID: 111141) UID: 0 2023-08-01T19:55:43.311 INFO:tasks.ceph.osd.0.smithi008.stderr:2023-08-01T19:55:43.309+0000 7f16a58f4700 -1 received signal: Hangup from /usr/bin/python3 /bin/daemon-helper kill ceph-osd -f --cluster ceph -i 0 (PID: 111179) UID: 0 2023-08-01T19:55:43.379 INFO:teuthology.orchestra.run.smithi155.stdout:ERROR: (22) Invalid argument 2023-08-01T19:55:43.379 INFO:teuthology.orchestra.run.smithi155.stdout:op_tracker tracking is not enabled now, so no ops are tracked currently, even those get stuck. Please enable "osd_enable_op_tracker", and the tracker will start to track new ops received afterwards. 2023-08-01T19:55:43.393 DEBUG:teuthology.orchestra.run.smithi155:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 30 ceph --cluster ceph --admin-daemon /var/run/ceph/ceph-osd.2.asok dump_historic_ops 2023-08-01T19:55:43.412 INFO:tasks.ceph.osd.0.smithi008.stderr:2023-08-01T19:55:43.410+0000 7f16a58f4700 -1 received signal: Hangup from /usr/bin/python3 /bin/daemon-helper kill ceph-osd -f --cluster ceph -i 0 (PID: 111179) UID: 0 2023-08-01T19:55:43.512 INFO:tasks.ceph.osd.1.smithi101.stderr:2023-08-01T19:55:43.511+0000 7fb0cb7f6700 -1 received signal: Hangup from /usr/bin/python3 /bin/daemon-helper kill ceph-osd -f --cluster ceph -i 1 (PID: 111141) UID: 0 2023-08-01T19:55:43.556 INFO:teuthology.orchestra.run.smithi155.stdout:ERROR: (22) Invalid argument 2023-08-01T19:55:43.556 INFO:teuthology.orchestra.run.smithi155.stdout:op_tracker tracking is not enabled now, so no ops are tracked currently, even those get stuck. Please enable "osd_enable_op_tracker", and the tracker will start to track new ops received afterwards. 2023-08-01T19:55:43.571 DEBUG:teuthology.orchestra.run.smithi008:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 30 ceph --cluster ceph --admin-daemon /var/run/ceph/ceph-osd.0.asok dump_ops_in_flight 2023-08-01T19:55:43.613 INFO:tasks.ceph.osd.2.smithi155.stderr:2023-08-01T19:55:43.611+0000 7faa5c6ac700 -1 received signal: Hangup from /usr/bin/python3 /bin/daemon-helper kill ceph-osd -f --cluster ceph -i 2 (PID: 111337) UID: 0 2023-08-01T19:55:43.713 INFO:tasks.ceph.osd.2.smithi155.stderr:2023-08-01T19:55:43.712+0000 7faa5c6ac700 -1 received signal: Hangup from /usr/bin/python3 /bin/daemon-helper kill ceph-osd -f --cluster ceph -i 2 (PID: 111337) UID: 0 2023-08-01T19:55:43.756 INFO:teuthology.orchestra.run.smithi008.stdout:ERROR: (22) Invalid argument 2023-08-01T19:55:43.756 INFO:teuthology.orchestra.run.smithi008.stdout:op_tracker tracking is not enabled now, so no ops are tracked currently, even those get stuck. Please enable "osd_enable_op_tracker", and the tracker will start to track new ops received afterwards. 2023-08-01T19:55:43.770 DEBUG:teuthology.orchestra.run.smithi008:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 30 ceph --cluster ceph --admin-daemon /var/run/ceph/ceph-osd.0.asok dump_blocked_ops 2023-08-01T19:55:43.814 INFO:tasks.ceph.osd.0.smithi008.stderr:2023-08-01T19:55:43.813+0000 7f16a58f4700 -1 received signal: Hangup from /usr/bin/python3 /bin/daemon-helper kill ceph-osd -f --cluster ceph -i 0 (PID: 111179) UID: 0 2023-08-01T19:55:43.915 INFO:tasks.ceph.osd.0.smithi008.stderr:2023-08-01T19:55:43.913+0000 7f16a58f4700 -1 received signal: Hangup from /usr/bin/python3 /bin/daemon-helper kill ceph-osd -f --cluster ceph -i 0 (PID: 111179) UID: 0 2023-08-01T19:55:43.952 INFO:teuthology.orchestra.run.smithi008.stdout:ERROR: (22) Invalid argument 2023-08-01T19:55:43.952 INFO:teuthology.orchestra.run.smithi008.stdout:op_tracker tracking is not enabled now, so no ops are tracked currently, even those get stuck. Please enable "osd_enable_op_tracker", and the tracker will start to track new ops received afterwards. 2023-08-01T19:55:43.968 DEBUG:teuthology.orchestra.run.smithi008:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 30 ceph --cluster ceph --admin-daemon /var/run/ceph/ceph-osd.0.asok dump_historic_ops 2023-08-01T19:55:44.002 DEBUG:teuthology.orchestra.run.smithi006:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 120 ceph --cluster ceph -- tell 'osd.*' injectargs --osd_enable_op_tracker=true 2023-08-01T19:55:44.051 INFO:tasks.ceph.osd.0.smithi008.stderr:2023-08-01T19:55:44.049+0000 7f16a58f4700 -1 received signal: Hangup from /usr/bin/python3 /bin/daemon-helper kill ceph-osd -f --cluster ceph -i 0 (PID: 111179) UID: 0 2023-08-01T19:55:44.070 INFO:teuthology.orchestra.run.smithi006.stderr:set osd.0 primary-affinity to 0.419323 (8274802) 2023-08-01T19:55:44.116 INFO:tasks.ceph.osd.2.smithi155.stderr:2023-08-01T19:55:44.114+0000 7faa5c6ac700 -1 received signal: Hangup from /usr/bin/python3 /bin/daemon-helper kill ceph-osd -f --cluster ceph -i 2 (PID: 111337) UID: 0 2023-08-01T19:55:44.153 INFO:teuthology.orchestra.run.smithi006.stdout:osd.0: {} 2023-08-01T19:55:44.165 INFO:teuthology.orchestra.run.smithi008.stdout:{ 2023-08-01T19:55:44.165 INFO:teuthology.orchestra.run.smithi008.stdout: "size": 20, 2023-08-01T19:55:44.165 INFO:teuthology.orchestra.run.smithi008.stdout: "duration": 600, 2023-08-01T19:55:44.165 INFO:teuthology.orchestra.run.smithi008.stdout: "ops": [ 2023-08-01T19:55:44.166 INFO:teuthology.orchestra.run.smithi008.stdout: { 2023-08-01T19:55:44.166 INFO:teuthology.orchestra.run.smithi008.stdout: "description": "osd_op(client.4668.0:100240 5.a 5:5313c5b9:::benchmark_data_smithi006_114134_object100239:head [set-alloc-hint object_size 65536 write_size 65536,write 0~65536] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e37)", 2023-08-01T19:55:44.166 INFO:teuthology.orchestra.run.smithi008.stdout: "initiated_at": "2023-08-01T19:55:05.148399+0000", 2023-08-01T19:55:44.166 INFO:teuthology.orchestra.run.smithi008.stdout: "age": 39.014475992999998, 2023-08-01T19:55:44.166 INFO:teuthology.orchestra.run.smithi008.stdout: "duration": 0.077278904999999995, 2023-08-01T19:55:44.166 INFO:teuthology.orchestra.run.smithi008.stdout: "type_data": { 2023-08-01T19:55:44.166 INFO:teuthology.orchestra.run.smithi008.stdout: "flag_point": "commit sent; apply or cleanup", 2023-08-01T19:55:44.167 INFO:teuthology.orchestra.run.smithi008.stdout: "client_info": { 2023-08-01T19:55:44.167 INFO:teuthology.orchestra.run.smithi008.stdout: "client": "client.4668", 2023-08-01T19:55:44.167 INFO:teuthology.orchestra.run.smithi008.stdout: "client_addr": "172.21.15.6:0/1709472247", 2023-08-01T19:55:44.167 INFO:teuthology.orchestra.run.smithi008.stdout: "tid": 100240 2023-08-01T19:55:44.167 INFO:teuthology.orchestra.run.smithi008.stdout: }, 2023-08-01T19:55:44.167 INFO:teuthology.orchestra.run.smithi008.stdout: "events": [ 2023-08-01T19:55:44.167 INFO:teuthology.orchestra.run.smithi008.stdout: { 2023-08-01T19:55:44.167 INFO:teuthology.orchestra.run.smithi008.stdout: "event": "initiated", 2023-08-01T19:55:44.168 INFO:teuthology.orchestra.run.smithi008.stdout: "time": "2023-08-01T19:55:05.148399+0000", 2023-08-01T19:55:44.168 INFO:teuthology.orchestra.run.smithi008.stdout: "duration": 0 2023-08-01T19:55:44.168 INFO:teuthology.orchestra.run.smithi008.stdout: }, 2023-08-01T19:55:44.168 INFO:teuthology.orchestra.run.smithi008.stdout: { 2023-08-01T19:55:44.168 INFO:teuthology.orchestra.run.smithi008.stdout: "event": "throttled", 2023-08-01T19:55:44.168 INFO:teuthology.orchestra.run.smithi008.stdout: "time": "2023-08-01T19:55:05.148399+0000", 2023-08-01T19:55:44.168 INFO:teuthology.orchestra.run.smithi008.stdout: "duration": 0 2023-08-01T19:55:44.169 INFO:teuthology.orchestra.run.smithi008.stdout: }, 2023-08-01T19:55:44.169 INFO:teuthology.orchestra.run.smithi008.stdout: { 2023-08-01T19:55:44.169 INFO:teuthology.orchestra.run.smithi008.stdout: "event": "header_read", 2023-08-01T19:55:44.169 INFO:teuthology.orchestra.run.smithi008.stdout: "time": "2023-08-01T19:55:05.148398+0000", 2023-08-01T19:55:44.169 INFO:teuthology.orchestra.run.smithi008.stdout: "duration": 4294967295.999999 2023-08-01T19:55:44.169 INFO:teuthology.orchestra.run.smithi008.stdout: }, 2023-08-01T19:55:44.169 INFO:teuthology.orchestra.run.smithi008.stdout: { 2023-08-01T19:55:44.169 INFO:teuthology.orchestra.run.smithi008.stdout: "event": "all_read", 2023-08-01T19:55:44.170 INFO:teuthology.orchestra.run.smithi008.stdout: "time": "2023-08-01T19:55:05.148492+0000", 2023-08-01T19:55:44.170 INFO:teuthology.orchestra.run.smithi008.stdout: "duration": 9.3892000000000002e-05 2023-08-01T19:55:44.170 INFO:teuthology.orchestra.run.smithi008.stdout: }, 2023-08-01T19:55:44.170 INFO:teuthology.orchestra.run.smithi008.stdout: { 2023-08-01T19:55:44.170 INFO:teuthology.orchestra.run.smithi008.stdout: "event": "dispatched", 2023-08-01T19:55:44.170 INFO:teuthology.orchestra.run.smithi008.stdout: "time": "2023-08-01T19:55:05.148503+0000", 2023-08-01T19:55:44.170 INFO:teuthology.orchestra.run.smithi008.stdout: "duration": 1.0951000000000001e-05 2023-08-01T19:55:44.170 INFO:teuthology.orchestra.run.smithi008.stdout: }, 2023-08-01T19:55:44.171 INFO:teuthology.orchestra.run.smithi008.stdout: { 2023-08-01T19:55:44.171 INFO:teuthology.orchestra.run.smithi008.stdout: "event": "queued_for_pg", 2023-08-01T19:55:44.171 INFO:teuthology.orchestra.run.smithi008.stdout: "time": "2023-08-01T19:55:05.148508+0000", 2023-08-01T19:55:44.171 INFO:teuthology.orchestra.run.smithi008.stdout: "duration": 5.0080000000000002e-06 2023-08-01T19:55:44.171 INFO:teuthology.orchestra.run.smithi008.stdout: }, 2023-08-01T19:55:44.171 INFO:teuthology.orchestra.run.smithi008.stdout: { 2023-08-01T19:55:44.171 INFO:teuthology.orchestra.run.smithi008.stdout: "event": "reached_pg", 2023-08-01T19:55:44.171 INFO:teuthology.orchestra.run.smithi008.stdout: "time": "2023-08-01T19:55:05.148548+0000", 2023-08-01T19:55:44.172 INFO:teuthology.orchestra.run.smithi008.stdout: "duration": 4.0358999999999998e-05 2023-08-01T19:55:44.172 INFO:teuthology.orchestra.run.smithi008.stdout: }, 2023-08-01T19:55:44.172 INFO:teuthology.orchestra.run.smithi008.stdout: { 2023-08-01T19:55:44.172 INFO:teuthology.orchestra.run.smithi008.stdout: "event": "started", 2023-08-01T19:55:44.172 INFO:teuthology.orchestra.run.smithi008.stdout: "time": "2023-08-01T19:55:05.148666+0000", 2023-08-01T19:55:44.172 INFO:teuthology.orchestra.run.smithi008.stdout: "duration": 0.000117621 2023-08-01T19:55:44.172 INFO:teuthology.orchestra.run.smithi008.stdout: }, 2023-08-01T19:55:44.173 INFO:teuthology.orchestra.run.smithi008.stdout: { 2023-08-01T19:55:44.173 INFO:teuthology.orchestra.run.smithi008.stdout: "event": "waiting for subops from 2", 2023-08-01T19:55:44.173 INFO:teuthology.orchestra.run.smithi008.stdout: "time": "2023-08-01T19:55:05.148805+0000", 2023-08-01T19:55:44.173 INFO:teuthology.orchestra.run.smithi008.stdout: "duration": 0.000139176 2023-08-01T19:55:44.173 INFO:teuthology.orchestra.run.smithi008.stdout: }, 2023-08-01T19:55:44.173 INFO:teuthology.orchestra.run.smithi008.stdout: { 2023-08-01T19:55:44.173 INFO:teuthology.orchestra.run.smithi008.stdout: "event": "op_commit", 2023-08-01T19:55:44.173 INFO:teuthology.orchestra.run.smithi008.stdout: "time": "2023-08-01T19:55:05.156143+0000", 2023-08-01T19:55:44.174 INFO:teuthology.orchestra.run.smithi008.stdout: "duration": 0.007338041 2023-08-01T19:55:44.174 INFO:teuthology.orchestra.run.smithi008.stdout: }, 2023-08-01T19:55:44.174 INFO:teuthology.orchestra.run.smithi008.stdout: { 2023-08-01T19:55:44.174 INFO:teuthology.orchestra.run.smithi008.stdout: "event": "sub_op_commit_rec", 2023-08-01T19:55:44.174 INFO:teuthology.orchestra.run.smithi008.stdout: "time": "2023-08-01T19:55:05.225581+0000", 2023-08-01T19:55:44.174 INFO:teuthology.orchestra.run.smithi008.stdout: "duration": 0.069438402999999996 2023-08-01T19:55:44.174 INFO:teuthology.orchestra.run.smithi008.stdout: }, 2023-08-01T19:55:44.174 INFO:teuthology.orchestra.run.smithi008.stdout: { 2023-08-01T19:55:44.175 INFO:teuthology.orchestra.run.smithi008.stdout: "event": "commit_sent", 2023-08-01T19:55:44.175 INFO:teuthology.orchestra.run.smithi008.stdout: "time": "2023-08-01T19:55:05.225632+0000", 2023-08-01T19:55:44.175 INFO:teuthology.orchestra.run.smithi008.stdout: "duration": 5.0382e-05 2023-08-01T19:55:44.175 INFO:teuthology.orchestra.run.smithi008.stdout: }, 2023-08-01T19:55:44.175 INFO:teuthology.orchestra.run.smithi008.stdout: { 2023-08-01T19:55:44.175 INFO:teuthology.orchestra.run.smithi008.stdout: "event": "done", 2023-08-01T19:55:44.175 INFO:teuthology.orchestra.run.smithi008.stdout: "time": "2023-08-01T19:55:05.225677+0000", 2023-08-01T19:55:44.175 INFO:teuthology.orchestra.run.smithi008.stdout: "duration": 4.5893000000000003e-05 2023-08-01T19:55:44.176 INFO:teuthology.orchestra.run.smithi008.stdout: } 2023-08-01T19:55:44.176 INFO:teuthology.orchestra.run.smithi008.stdout: ] 2023-08-01T19:55:44.176 INFO:teuthology.orchestra.run.smithi008.stdout: } 2023-08-01T19:55:44.176 INFO:teuthology.orchestra.run.smithi008.stdout: }, 2023-08-01T19:55:44.176 INFO:teuthology.orchestra.run.smithi008.stdout: { 2023-08-01T19:55:44.176 INFO:teuthology.orchestra.run.smithi008.stdout: "description": "osd_op(client.4668.0:100243 5.a 5:5e8193b6:::benchmark_data_smithi006_114134_object100242:head [set-alloc-hint object_size 65536 write_size 65536,write 0~65536] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e37)", 2023-08-01T19:55:44.176 INFO:teuthology.orchestra.run.smithi008.stdout: "initiated_at": "2023-08-01T19:55:05.150737+0000", 2023-08-01T19:55:44.177 INFO:teuthology.orchestra.run.smithi008.stdout: "age": 39.012137537999998, 2023-08-01T19:55:44.177 INFO:teuthology.orchestra.run.smithi008.stdout: "duration": 0.075019885999999994, 2023-08-01T19:55:44.177 INFO:teuthology.orchestra.run.smithi008.stdout: "type_data": { 2023-08-01T19:55:44.177 INFO:teuthology.orchestra.run.smithi008.stdout: "flag_point": "commit sent; apply or cleanup", 2023-08-01T19:55:44.177 INFO:teuthology.orchestra.run.smithi008.stdout: "client_info": { 2023-08-01T19:55:44.177 INFO:teuthology.orchestra.run.smithi008.stdout: "client": "client.4668", 2023-08-01T19:55:44.177 INFO:teuthology.orchestra.run.smithi008.stdout: "client_addr": "172.21.15.6:0/1709472247", 2023-08-01T19:55:44.177 INFO:teuthology.orchestra.run.smithi008.stdout: "tid": 100243 2023-08-01T19:55:44.178 INFO:teuthology.orchestra.run.smithi008.stdout: }, 2023-08-01T19:55:44.178 INFO:teuthology.orchestra.run.smithi008.stdout: "events": [ 2023-08-01T19:55:44.178 INFO:teuthology.orchestra.run.smithi008.stdout: { 2023-08-01T19:55:44.178 INFO:teuthology.orchestra.run.smithi008.stdout: "event": "initiated", 2023-08-01T19:55:44.178 INFO:teuthology.orchestra.run.smithi008.stdout: "time": "2023-08-01T19:55:05.150737+0000", 2023-08-01T19:55:44.178 INFO:teuthology.orchestra.run.smithi008.stdout: "duration": 0 2023-08-01T19:55:44.178 INFO:teuthology.orchestra.run.smithi008.stdout: }, 2023-08-01T19:55:44.178 INFO:teuthology.orchestra.run.smithi008.stdout: { 2023-08-01T19:55:44.179 INFO:teuthology.orchestra.run.smithi008.stdout: "event": "throttled", 2023-08-01T19:55:44.179 INFO:teuthology.orchestra.run.smithi008.stdout: "time": "2023-08-01T19:55:05.150737+0000", 2023-08-01T19:55:44.179 INFO:teuthology.orchestra.run.smithi008.stdout: "duration": 0 2023-08-01T19:55:44.179 INFO:teuthology.orchestra.run.smithi008.stdout: }, 2023-08-01T19:55:44.179 INFO:teuthology.orchestra.run.smithi008.stdout: { 2023-08-01T19:55:44.179 INFO:teuthology.orchestra.run.smithi008.stdout: "event": "header_read", 2023-08-01T19:55:44.179 INFO:teuthology.orchestra.run.smithi008.stdout: "time": "2023-08-01T19:55:05.150736+0000", 2023-08-01T19:55:44.179 INFO:teuthology.orchestra.run.smithi008.stdout: "duration": 4294967295.999999 2023-08-01T19:55:44.180 INFO:teuthology.orchestra.run.smithi008.stdout: }, 2023-08-01T19:55:44.180 INFO:teuthology.orchestra.run.smithi008.stdout: { 2023-08-01T19:55:44.180 INFO:teuthology.orchestra.run.smithi008.stdout: "event": "all_read", 2023-08-01T19:55:44.180 INFO:teuthology.orchestra.run.smithi008.stdout: "time": "2023-08-01T19:55:05.150780+0000", 2023-08-01T19:55:44.180 INFO:teuthology.orchestra.run.smithi008.stdout: "duration": 4.3578999999999997e-05 2023-08-01T19:55:44.180 INFO:teuthology.orchestra.run.smithi008.stdout: }, 2023-08-01T19:55:44.180 INFO:teuthology.orchestra.run.smithi008.stdout: { 2023-08-01T19:55:44.181 INFO:teuthology.orchestra.run.smithi008.stdout: "event": "dispatched", 2023-08-01T19:55:44.181 INFO:teuthology.orchestra.run.smithi008.stdout: "time": "2023-08-01T19:55:05.150791+0000", 2023-08-01T19:55:44.181 INFO:teuthology.orchestra.run.smithi008.stdout: "duration": 1.0963e-05 2023-08-01T19:55:44.181 INFO:teuthology.orchestra.run.smithi008.stdout: }, 2023-08-01T19:55:44.181 INFO:teuthology.orchestra.run.smithi008.stdout: { 2023-08-01T19:55:44.181 INFO:teuthology.orchestra.run.smithi008.stdout: "event": "queued_for_pg", 2023-08-01T19:55:44.181 INFO:teuthology.orchestra.run.smithi008.stdout: "time": "2023-08-01T19:55:05.150797+0000", 2023-08-01T19:55:44.181 INFO:teuthology.orchestra.run.smithi008.stdout: "duration": 5.9780000000000002e-06 2023-08-01T19:55:44.182 INFO:teuthology.orchestra.run.smithi008.stdout: }, 2023-08-01T19:55:44.182 INFO:teuthology.orchestra.run.smithi008.stdout: { 2023-08-01T19:55:44.182 INFO:teuthology.orchestra.run.smithi008.stdout: "event": "reached_pg", 2023-08-01T19:55:44.182 INFO:teuthology.orchestra.run.smithi008.stdout: "time": "2023-08-01T19:55:05.150833+0000", 2023-08-01T19:55:44.182 INFO:teuthology.orchestra.run.smithi008.stdout: "duration": 3.6000000000000001e-05 2023-08-01T19:55:44.182 INFO:teuthology.orchestra.run.smithi008.stdout: }, 2023-08-01T19:55:44.182 INFO:teuthology.orchestra.run.smithi008.stdout: { 2023-08-01T19:55:44.182 INFO:teuthology.orchestra.run.smithi008.stdout: "event": "started", 2023-08-01T19:55:44.183 INFO:teuthology.orchestra.run.smithi008.stdout: "time": "2023-08-01T19:55:05.150951+0000", 2023-08-01T19:55:44.183 INFO:teuthology.orchestra.run.smithi008.stdout: "duration": 0.00011827799999999999 2023-08-01T19:55:44.183 INFO:teuthology.orchestra.run.smithi008.stdout: }, 2023-08-01T19:55:44.183 INFO:teuthology.orchestra.run.smithi008.stdout: { 2023-08-01T19:55:44.183 INFO:teuthology.orchestra.run.smithi008.stdout: "event": "waiting for subops from 2", 2023-08-01T19:55:44.183 INFO:teuthology.orchestra.run.smithi008.stdout: "time": "2023-08-01T19:55:05.151111+0000", 2023-08-01T19:55:44.183 INFO:teuthology.orchestra.run.smithi008.stdout: "duration": 0.00015961299999999999 2023-08-01T19:55:44.183 INFO:teuthology.orchestra.run.smithi008.stdout: }, 2023-08-01T19:55:44.184 INFO:teuthology.orchestra.run.smithi008.stdout: { 2023-08-01T19:55:44.184 INFO:teuthology.orchestra.run.smithi008.stdout: "event": "op_commit", 2023-08-01T19:55:44.184 INFO:teuthology.orchestra.run.smithi008.stdout: "time": "2023-08-01T19:55:05.156247+0000", 2023-08-01T19:55:44.184 INFO:teuthology.orchestra.run.smithi008.stdout: "duration": 0.005136524 2023-08-01T19:55:44.184 INFO:teuthology.orchestra.run.smithi008.stdout: }, 2023-08-01T19:55:44.184 INFO:teuthology.orchestra.run.smithi008.stdout: { 2023-08-01T19:55:44.184 INFO:teuthology.orchestra.run.smithi008.stdout: "event": "sub_op_commit_rec", 2023-08-01T19:55:44.185 INFO:teuthology.orchestra.run.smithi008.stdout: "time": "2023-08-01T19:55:05.225705+0000", 2023-08-01T19:55:44.185 INFO:teuthology.orchestra.run.smithi008.stdout: "duration": 0.069458377000000002 2023-08-01T19:55:44.185 INFO:teuthology.orchestra.run.smithi008.stdout: }, 2023-08-01T19:55:44.185 INFO:teuthology.orchestra.run.smithi008.stdout: { 2023-08-01T19:55:44.185 INFO:teuthology.orchestra.run.smithi008.stdout: "event": "commit_sent", 2023-08-01T19:55:44.185 INFO:teuthology.orchestra.run.smithi008.stdout: "time": "2023-08-01T19:55:05.225736+0000", 2023-08-01T19:55:44.185 INFO:teuthology.orchestra.run.smithi008.stdout: "duration": 3.0388000000000001e-05 2023-08-01T19:55:44.186 INFO:teuthology.orchestra.run.smithi008.stdout: }, 2023-08-01T19:55:44.186 INFO:teuthology.orchestra.run.smithi008.stdout: { 2023-08-01T19:55:44.186 INFO:teuthology.orchestra.run.smithi008.stdout: "event": "done", 2023-08-01T19:55:44.186 INFO:teuthology.orchestra.run.smithi008.stdout: "time": "2023-08-01T19:55:05.225757+0000", 2023-08-01T19:55:44.186 INFO:teuthology.orchestra.run.smithi008.stdout: "duration": 2.1090999999999998e-05 2023-08-01T19:55:44.186 INFO:teuthology.orchestra.run.smithi008.stdout: } 2023-08-01T19:55:44.186 INFO:teuthology.orchestra.run.smithi008.stdout: ] 2023-08-01T19:55:44.186 INFO:teuthology.orchestra.run.smithi008.stdout: } 2023-08-01T19:55:44.187 INFO:teuthology.orchestra.run.smithi008.stdout: }, 2023-08-01T19:55:44.187 INFO:teuthology.orchestra.run.smithi008.stdout: { 2023-08-01T19:55:44.187 INFO:teuthology.orchestra.run.smithi008.stdout: "description": "osd_op(client.4668.0:100261 5.a 5:562deedb:::benchmark_data_smithi006_114134_object100260:head [set-alloc-hint object_size 65536 write_size 65536,write 0~65536] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e37)", 2023-08-01T19:55:44.187 INFO:teuthology.orchestra.run.smithi008.stdout: "initiated_at": "2023-08-01T19:55:05.163316+0000", 2023-08-01T19:55:44.187 INFO:teuthology.orchestra.run.smithi008.stdout: "age": 38.999558122000003, 2023-08-01T19:55:44.187 INFO:teuthology.orchestra.run.smithi008.stdout: "duration": 0.063073012999999997, 2023-08-01T19:55:44.187 INFO:teuthology.orchestra.run.smithi008.stdout: "type_data": { 2023-08-01T19:55:44.188 INFO:teuthology.orchestra.run.smithi008.stdout: "flag_point": "commit sent; apply or cleanup", 2023-08-01T19:55:44.188 INFO:teuthology.orchestra.run.smithi008.stdout: "client_info": { 2023-08-01T19:55:44.188 INFO:teuthology.orchestra.run.smithi008.stdout: "client": "client.4668", 2023-08-01T19:55:44.188 INFO:teuthology.orchestra.run.smithi008.stdout: "client_addr": "172.21.15.6:0/1709472247", 2023-08-01T19:55:44.188 INFO:teuthology.orchestra.run.smithi008.stdout: "tid": 100261 2023-08-01T19:55:44.188 INFO:teuthology.orchestra.run.smithi008.stdout: }, 2023-08-01T19:55:44.188 INFO:teuthology.orchestra.run.smithi008.stdout: "events": [ 2023-08-01T19:55:44.188 INFO:teuthology.orchestra.run.smithi008.stdout: { 2023-08-01T19:55:44.189 INFO:teuthology.orchestra.run.smithi008.stdout: "event": "initiated", 2023-08-01T19:55:44.189 INFO:teuthology.orchestra.run.smithi008.stdout: "time": "2023-08-01T19:55:05.163316+0000", 2023-08-01T19:55:44.189 INFO:teuthology.orchestra.run.smithi008.stdout: "duration": 0 2023-08-01T19:55:44.189 INFO:teuthology.orchestra.run.smithi008.stdout: }, 2023-08-01T19:55:44.189 INFO:teuthology.orchestra.run.smithi008.stdout: { 2023-08-01T19:55:44.189 INFO:teuthology.orchestra.run.smithi008.stdout: "event": "throttled", 2023-08-01T19:55:44.189 INFO:teuthology.orchestra.run.smithi008.stdout: "time": "2023-08-01T19:55:05.163316+0000", 2023-08-01T19:55:44.189 INFO:teuthology.orchestra.run.smithi008.stdout: "duration": 0 2023-08-01T19:55:44.190 INFO:teuthology.orchestra.run.smithi008.stdout: }, 2023-08-01T19:55:44.190 INFO:teuthology.orchestra.run.smithi008.stdout: { 2023-08-01T19:55:44.190 INFO:teuthology.orchestra.run.smithi008.stdout: "event": "header_read", 2023-08-01T19:55:44.190 INFO:teuthology.orchestra.run.smithi008.stdout: "time": "2023-08-01T19:55:05.163316+0000", 2023-08-01T19:55:44.190 INFO:teuthology.orchestra.run.smithi008.stdout: "duration": 4294967295.999999 2023-08-01T19:55:44.190 INFO:teuthology.orchestra.run.smithi008.stdout: }, 2023-08-01T19:55:44.190 INFO:teuthology.orchestra.run.smithi008.stdout: { 2023-08-01T19:55:44.191 INFO:teuthology.orchestra.run.smithi008.stdout: "event": "all_read", 2023-08-01T19:55:44.191 INFO:teuthology.orchestra.run.smithi008.stdout: "time": "2023-08-01T19:55:05.163380+0000", 2023-08-01T19:55:44.191 INFO:teuthology.orchestra.run.smithi008.stdout: "duration": 6.4395999999999998e-05 2023-08-01T19:55:44.191 INFO:teuthology.orchestra.run.smithi008.stdout: }, 2023-08-01T19:55:44.191 INFO:teuthology.orchestra.run.smithi008.stdout: { 2023-08-01T19:55:44.191 INFO:teuthology.orchestra.run.smithi008.stdout: "event": "dispatched", 2023-08-01T19:55:44.191 INFO:teuthology.orchestra.run.smithi008.stdout: "time": "2023-08-01T19:55:05.163390+0000", 2023-08-01T19:55:44.191 INFO:teuthology.orchestra.run.smithi008.stdout: "duration": 1.0189e-05 2023-08-01T19:55:44.192 INFO:teuthology.orchestra.run.smithi008.stdout: }, 2023-08-01T19:55:44.192 INFO:teuthology.orchestra.run.smithi008.stdout: { 2023-08-01T19:55:44.192 INFO:teuthology.orchestra.run.smithi008.stdout: "event": "queued_for_pg", 2023-08-01T19:55:44.192 INFO:teuthology.orchestra.run.smithi008.stdout: "time": "2023-08-01T19:55:05.163395+0000", 2023-08-01T19:55:44.192 INFO:teuthology.orchestra.run.smithi008.stdout: "duration": 4.4059999999999998e-06 2023-08-01T19:55:44.192 INFO:teuthology.orchestra.run.smithi008.stdout: }, 2023-08-01T19:55:44.192 INFO:teuthology.orchestra.run.smithi008.stdout: { 2023-08-01T19:55:44.193 INFO:teuthology.orchestra.run.smithi008.stdout: "event": "reached_pg", 2023-08-01T19:55:44.193 INFO:teuthology.orchestra.run.smithi008.stdout: "time": "2023-08-01T19:55:05.163429+0000", 2023-08-01T19:55:44.193 INFO:teuthology.orchestra.run.smithi008.stdout: "duration": 3.4900000000000001e-05 2023-08-01T19:55:44.193 INFO:teuthology.orchestra.run.smithi008.stdout: }, 2023-08-01T19:55:44.193 INFO:teuthology.orchestra.run.smithi008.stdout: { 2023-08-01T19:55:44.193 INFO:teuthology.orchestra.run.smithi008.stdout: "event": "started", 2023-08-01T19:55:44.193 INFO:teuthology.orchestra.run.smithi008.stdout: "time": "2023-08-01T19:55:05.163512+0000", 2023-08-01T19:55:44.193 INFO:teuthology.orchestra.run.smithi008.stdout: "duration": 8.2987999999999999e-05 2023-08-01T19:55:44.194 INFO:teuthology.orchestra.run.smithi008.stdout: }, 2023-08-01T19:55:44.194 INFO:teuthology.orchestra.run.smithi008.stdout: { 2023-08-01T19:55:44.194 INFO:teuthology.orchestra.run.smithi008.stdout: "event": "waiting for subops from 2", 2023-08-01T19:55:44.194 INFO:teuthology.orchestra.run.smithi008.stdout: "time": "2023-08-01T19:55:05.163596+0000", 2023-08-01T19:55:44.194 INFO:teuthology.orchestra.run.smithi008.stdout: "duration": 8.3783999999999996e-05 2023-08-01T19:55:44.194 INFO:teuthology.orchestra.run.smithi008.stdout: }, 2023-08-01T19:55:44.194 INFO:teuthology.orchestra.run.smithi008.stdout: { 2023-08-01T19:55:44.194 INFO:teuthology.orchestra.run.smithi008.stdout: "event": "op_commit", 2023-08-01T19:55:44.195 INFO:teuthology.orchestra.run.smithi008.stdout: "time": "2023-08-01T19:55:05.167129+0000", 2023-08-01T19:55:44.195 INFO:teuthology.orchestra.run.smithi008.stdout: "duration": 0.0035328709999999999 2023-08-01T19:55:44.195 INFO:teuthology.orchestra.run.smithi008.stdout: }, 2023-08-01T19:55:44.195 INFO:teuthology.orchestra.run.smithi008.stdout: { 2023-08-01T19:55:44.195 INFO:teuthology.orchestra.run.smithi008.stdout: "event": "sub_op_commit_rec", 2023-08-01T19:55:44.195 INFO:teuthology.orchestra.run.smithi008.stdout: "time": "2023-08-01T19:55:05.226302+0000", 2023-08-01T19:55:44.195 INFO:teuthology.orchestra.run.smithi008.stdout: "duration": 0.059172711000000003 2023-08-01T19:55:44.195 INFO:teuthology.orchestra.run.smithi008.stdout: }, 2023-08-01T19:55:44.196 INFO:teuthology.orchestra.run.smithi008.stdout: { 2023-08-01T19:55:44.196 INFO:teuthology.orchestra.run.smithi008.stdout: "event": "commit_sent", 2023-08-01T19:55:44.196 INFO:teuthology.orchestra.run.smithi008.stdout: "time": "2023-08-01T19:55:05.226351+0000", 2023-08-01T19:55:44.196 INFO:teuthology.orchestra.run.smithi008.stdout: "duration": 4.969e-05 2023-08-01T19:55:44.196 INFO:teuthology.orchestra.run.smithi008.stdout: }, 2023-08-01T19:55:44.196 INFO:teuthology.orchestra.run.smithi008.stdout: { 2023-08-01T19:55:44.196 INFO:teuthology.orchestra.run.smithi008.stdout: "event": "done", 2023-08-01T19:55:44.197 INFO:teuthology.orchestra.run.smithi008.stdout: "time": "2023-08-01T19:55:05.226389+0000", 2023-08-01T19:55:44.197 INFO:teuthology.orchestra.run.smithi008.stdout: "duration": 3.7978000000000001e-05 2023-08-01T19:55:44.197 INFO:teuthology.orchestra.run.smithi008.stdout: } 2023-08-01T19:55:44.197 INFO:teuthology.orchestra.run.smithi008.stdout: ] 2023-08-01T19:55:44.197 INFO:teuthology.orchestra.run.smithi008.stdout: } 2023-08-01T19:55:44.197 INFO:teuthology.orchestra.run.smithi008.stdout: }, 2023-08-01T19:55:44.197 INFO:teuthology.orchestra.run.smithi008.stdout: { 2023-08-01T19:55:44.197 INFO:teuthology.orchestra.run.smithi008.stdout: "description": "osd_op(client.4668.0:100262 5.a 5:5c636b5d:::benchmark_data_smithi006_114134_object100261:head [set-alloc-hint object_size 65536 write_size 65536,write 0~65536] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e37)", 2023-08-01T19:55:44.198 INFO:teuthology.orchestra.run.smithi008.stdout: "initiated_at": "2023-08-01T19:55:05.165068+0000", 2023-08-01T19:55:44.198 INFO:teuthology.orchestra.run.smithi008.stdout: "age": 38.997806468999997, 2023-08-01T19:55:44.198 INFO:teuthology.orchestra.run.smithi008.stdout: "duration": 0.063919403, 2023-08-01T19:55:44.198 INFO:teuthology.orchestra.run.smithi008.stdout: "type_data": { 2023-08-01T19:55:44.198 INFO:teuthology.orchestra.run.smithi008.stdout: "flag_point": "commit sent; apply or cleanup", 2023-08-01T19:55:44.198 INFO:teuthology.orchestra.run.smithi008.stdout: "client_info": { 2023-08-01T19:55:44.198 INFO:teuthology.orchestra.run.smithi008.stdout: "client": "client.4668", 2023-08-01T19:55:44.198 INFO:teuthology.orchestra.run.smithi008.stdout: "client_addr": "172.21.15.6:0/1709472247", 2023-08-01T19:55:44.199 INFO:teuthology.orchestra.run.smithi008.stdout: "tid": 100262 2023-08-01T19:55:44.199 INFO:teuthology.orchestra.run.smithi008.stdout: }, 2023-08-01T19:55:44.199 INFO:teuthology.orchestra.run.smithi008.stdout: "events": [ 2023-08-01T19:55:44.199 INFO:teuthology.orchestra.run.smithi008.stdout: { 2023-08-01T19:55:44.199 INFO:teuthology.orchestra.run.smithi008.stdout: "event": "initiated", 2023-08-01T19:55:44.199 INFO:teuthology.orchestra.run.smithi008.stdout: "time": "2023-08-01T19:55:05.165068+0000", 2023-08-01T19:55:44.199 INFO:teuthology.orchestra.run.smithi008.stdout: "duration": 0 2023-08-01T19:55:44.199 INFO:teuthology.orchestra.run.smithi008.stdout: }, 2023-08-01T19:55:44.200 INFO:teuthology.orchestra.run.smithi008.stdout: { 2023-08-01T19:55:44.200 INFO:teuthology.orchestra.run.smithi008.stdout: "event": "throttled", 2023-08-01T19:55:44.200 INFO:teuthology.orchestra.run.smithi008.stdout: "time": "2023-08-01T19:55:05.165068+0000", 2023-08-01T19:55:44.200 INFO:teuthology.orchestra.run.smithi008.stdout: "duration": 0 2023-08-01T19:55:44.200 INFO:teuthology.orchestra.run.smithi008.stdout: }, 2023-08-01T19:55:44.200 INFO:teuthology.orchestra.run.smithi008.stdout: { 2023-08-01T19:55:44.200 INFO:teuthology.orchestra.run.smithi008.stdout: "event": "header_read", 2023-08-01T19:55:44.200 INFO:teuthology.orchestra.run.smithi008.stdout: "time": "2023-08-01T19:55:05.165067+0000", 2023-08-01T19:55:44.201 INFO:teuthology.orchestra.run.smithi008.stdout: "duration": 4294967295.999999 2023-08-01T19:55:44.201 INFO:teuthology.orchestra.run.smithi008.stdout: }, 2023-08-01T19:55:44.201 INFO:teuthology.orchestra.run.smithi008.stdout: { 2023-08-01T19:55:44.201 INFO:teuthology.orchestra.run.smithi008.stdout: "event": "all_read", 2023-08-01T19:55:44.201 INFO:teuthology.orchestra.run.smithi008.stdout: "time": "2023-08-01T19:55:05.165126+0000", 2023-08-01T19:55:44.201 INFO:teuthology.orchestra.run.smithi008.stdout: "duration": 5.9116000000000001e-05 2023-08-01T19:55:44.201 INFO:teuthology.orchestra.run.smithi008.stdout: }, 2023-08-01T19:55:44.202 INFO:teuthology.orchestra.run.smithi008.stdout: { 2023-08-01T19:55:44.202 INFO:teuthology.orchestra.run.smithi008.stdout: "event": "dispatched", 2023-08-01T19:55:44.202 INFO:teuthology.orchestra.run.smithi008.stdout: "time": "2023-08-01T19:55:05.165134+0000", 2023-08-01T19:55:44.202 INFO:teuthology.orchestra.run.smithi008.stdout: "duration": 7.9820000000000008e-06 2023-08-01T19:55:44.202 INFO:teuthology.orchestra.run.smithi008.stdout: }, 2023-08-01T19:55:44.202 INFO:teuthology.orchestra.run.smithi008.stdout: { 2023-08-01T19:55:44.202 INFO:teuthology.orchestra.run.smithi008.stdout: "event": "queued_for_pg", 2023-08-01T19:55:44.202 INFO:teuthology.orchestra.run.smithi008.stdout: "time": "2023-08-01T19:55:05.165139+0000", 2023-08-01T19:55:44.203 INFO:teuthology.orchestra.run.smithi008.stdout: "duration": 4.2560000000000004e-06 2023-08-01T19:55:44.203 INFO:teuthology.orchestra.run.smithi008.stdout: }, 2023-08-01T19:55:44.203 INFO:teuthology.orchestra.run.smithi008.stdout: { 2023-08-01T19:55:44.203 INFO:teuthology.orchestra.run.smithi008.stdout: "event": "reached_pg", 2023-08-01T19:55:44.203 INFO:teuthology.orchestra.run.smithi008.stdout: "time": "2023-08-01T19:55:05.165165+0000", 2023-08-01T19:55:44.203 INFO:teuthology.orchestra.run.smithi008.stdout: "duration": 2.6554e-05 2023-08-01T19:55:44.203 INFO:teuthology.orchestra.run.smithi008.stdout: }, 2023-08-01T19:55:44.203 INFO:teuthology.orchestra.run.smithi008.stdout: { 2023-08-01T19:55:44.204 INFO:teuthology.orchestra.run.smithi008.stdout: "event": "started", 2023-08-01T19:55:44.204 INFO:teuthology.orchestra.run.smithi008.stdout: "time": "2023-08-01T19:55:05.165243+0000", 2023-08-01T19:55:44.204 INFO:teuthology.orchestra.run.smithi008.stdout: "duration": 7.7877e-05 2023-08-01T19:55:44.204 INFO:teuthology.orchestra.run.smithi008.stdout: }, 2023-08-01T19:55:44.204 INFO:teuthology.orchestra.run.smithi008.stdout: { 2023-08-01T19:55:44.204 INFO:teuthology.orchestra.run.smithi008.stdout: "event": "waiting for subops from 2", 2023-08-01T19:55:44.204 INFO:teuthology.orchestra.run.smithi008.stdout: "time": "2023-08-01T19:55:05.165450+0000", 2023-08-01T19:55:44.204 INFO:teuthology.orchestra.run.smithi008.stdout: "duration": 0.00020655599999999999 2023-08-01T19:55:44.205 INFO:teuthology.orchestra.run.smithi008.stdout: }, 2023-08-01T19:55:44.205 INFO:teuthology.orchestra.run.smithi008.stdout: { 2023-08-01T19:55:44.205 INFO:teuthology.orchestra.run.smithi008.stdout: "event": "op_commit", 2023-08-01T19:55:44.205 INFO:teuthology.orchestra.run.smithi008.stdout: "time": "2023-08-01T19:55:05.168883+0000", 2023-08-01T19:55:44.205 INFO:teuthology.orchestra.run.smithi008.stdout: "duration": 0.0034333279999999998 2023-08-01T19:55:44.205 INFO:teuthology.orchestra.run.smithi008.stdout: }, 2023-08-01T19:55:44.205 INFO:teuthology.orchestra.run.smithi008.stdout: { 2023-08-01T19:55:44.205 INFO:teuthology.orchestra.run.smithi008.stdout: "event": "sub_op_commit_rec", 2023-08-01T19:55:44.206 INFO:teuthology.orchestra.run.smithi008.stdout: "time": "2023-08-01T19:55:05.228904+0000", 2023-08-01T19:55:44.206 INFO:teuthology.orchestra.run.smithi008.stdout: "duration": 0.060021370999999997 2023-08-01T19:55:44.206 INFO:teuthology.orchestra.run.smithi008.stdout: }, 2023-08-01T19:55:44.206 INFO:teuthology.orchestra.run.smithi008.stdout: { 2023-08-01T19:55:44.206 INFO:teuthology.orchestra.run.smithi008.stdout: "event": "commit_sent", 2023-08-01T19:55:44.206 INFO:teuthology.orchestra.run.smithi008.stdout: "time": "2023-08-01T19:55:05.228952+0000", 2023-08-01T19:55:44.206 INFO:teuthology.orchestra.run.smithi008.stdout: "duration": 4.8056999999999997e-05 2023-08-01T19:55:44.207 INFO:teuthology.orchestra.run.smithi008.stdout: }, 2023-08-01T19:55:44.207 INFO:teuthology.orchestra.run.smithi008.stdout: { 2023-08-01T19:55:44.207 INFO:teuthology.orchestra.run.smithi008.stdout: "event": "done", 2023-08-01T19:55:44.207 INFO:teuthology.orchestra.run.smithi008.stdout: "time": "2023-08-01T19:55:05.228987+0000", 2023-08-01T19:55:44.207 INFO:teuthology.orchestra.run.smithi008.stdout: "duration": 3.5083000000000003e-05 2023-08-01T19:55:44.207 INFO:teuthology.orchestra.run.smithi008.stdout: } 2023-08-01T19:55:44.207 INFO:teuthology.orchestra.run.smithi008.stdout: ] 2023-08-01T19:55:44.207 INFO:teuthology.orchestra.run.smithi008.stdout: } 2023-08-01T19:55:44.208 INFO:teuthology.orchestra.run.smithi008.stdout: }, 2023-08-01T19:55:44.208 INFO:teuthology.orchestra.run.smithi008.stdout: { 2023-08-01T19:55:44.208 INFO:teuthology.orchestra.run.smithi008.stdout: "description": "osd_op(client.4668.0:100929 5.3 5:c29f4adb:::benchmark_data_smithi006_114134_object100928:head [set-alloc-hint object_size 65536 write_size 65536,write 0~65536] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e37)", 2023-08-01T19:55:44.208 INFO:teuthology.orchestra.run.smithi008.stdout: "initiated_at": "2023-08-01T19:55:05.564759+0000", 2023-08-01T19:55:44.208 INFO:teuthology.orchestra.run.smithi008.stdout: "age": 38.598115829999998, 2023-08-01T19:55:44.208 INFO:teuthology.orchestra.run.smithi008.stdout: "duration": 0.062544635000000001, 2023-08-01T19:55:44.208 INFO:teuthology.orchestra.run.smithi008.stdout: "type_data": { 2023-08-01T19:55:44.208 INFO:teuthology.orchestra.run.smithi008.stdout: "flag_point": "commit sent; apply or cleanup", 2023-08-01T19:55:44.209 INFO:teuthology.orchestra.run.smithi008.stdout: "client_info": { 2023-08-01T19:55:44.209 INFO:teuthology.orchestra.run.smithi008.stdout: "client": "client.4668", 2023-08-01T19:55:44.209 INFO:teuthology.orchestra.run.smithi008.stdout: "client_addr": "172.21.15.6:0/1709472247", 2023-08-01T19:55:44.209 INFO:teuthology.orchestra.run.smithi008.stdout: "tid": 100929 2023-08-01T19:55:44.209 INFO:teuthology.orchestra.run.smithi008.stdout: }, 2023-08-01T19:55:44.209 INFO:teuthology.orchestra.run.smithi008.stdout: "events": [ 2023-08-01T19:55:44.209 INFO:teuthology.orchestra.run.smithi008.stdout: { 2023-08-01T19:55:44.209 INFO:teuthology.orchestra.run.smithi008.stdout: "event": "initiated", 2023-08-01T19:55:44.210 INFO:teuthology.orchestra.run.smithi008.stdout: "time": "2023-08-01T19:55:05.564759+0000", 2023-08-01T19:55:44.210 INFO:teuthology.orchestra.run.smithi008.stdout: "duration": 0 2023-08-01T19:55:44.210 INFO:teuthology.orchestra.run.smithi008.stdout: }, 2023-08-01T19:55:44.210 INFO:teuthology.orchestra.run.smithi008.stdout: { 2023-08-01T19:55:44.210 INFO:teuthology.orchestra.run.smithi008.stdout: "event": "throttled", 2023-08-01T19:55:44.210 INFO:teuthology.orchestra.run.smithi008.stdout: "time": "2023-08-01T19:55:05.564759+0000", 2023-08-01T19:55:44.210 INFO:teuthology.orchestra.run.smithi008.stdout: "duration": 0 2023-08-01T19:55:44.210 INFO:teuthology.orchestra.run.smithi008.stdout: }, 2023-08-01T19:55:44.211 INFO:teuthology.orchestra.run.smithi008.stdout: { 2023-08-01T19:55:44.211 INFO:teuthology.orchestra.run.smithi008.stdout: "event": "header_read", 2023-08-01T19:55:44.211 INFO:teuthology.orchestra.run.smithi008.stdout: "time": "2023-08-01T19:55:05.564758+0000", 2023-08-01T19:55:44.211 INFO:teuthology.orchestra.run.smithi008.stdout: "duration": 4294967295.999999 2023-08-01T19:55:44.211 INFO:teuthology.orchestra.run.smithi008.stdout: }, 2023-08-01T19:55:44.211 INFO:teuthology.orchestra.run.smithi008.stdout: { 2023-08-01T19:55:44.211 INFO:teuthology.orchestra.run.smithi008.stdout: "event": "all_read", 2023-08-01T19:55:44.211 INFO:teuthology.orchestra.run.smithi008.stdout: "time": "2023-08-01T19:55:05.564815+0000", 2023-08-01T19:55:44.212 INFO:teuthology.orchestra.run.smithi008.stdout: "duration": 5.7757000000000003e-05 2023-08-01T19:55:44.212 INFO:teuthology.orchestra.run.smithi008.stdout: }, 2023-08-01T19:55:44.212 INFO:teuthology.orchestra.run.smithi008.stdout: { 2023-08-01T19:55:44.212 INFO:teuthology.orchestra.run.smithi008.stdout: "event": "dispatched", 2023-08-01T19:55:44.212 INFO:teuthology.orchestra.run.smithi008.stdout: "time": "2023-08-01T19:55:05.564824+0000", 2023-08-01T19:55:44.212 INFO:teuthology.orchestra.run.smithi008.stdout: "duration": 8.6559999999999998e-06 2023-08-01T19:55:44.212 INFO:teuthology.orchestra.run.smithi008.stdout: }, 2023-08-01T19:55:44.213 INFO:teuthology.orchestra.run.smithi008.stdout: { 2023-08-01T19:55:44.213 INFO:teuthology.orchestra.run.smithi008.stdout: "event": "queued_for_pg", 2023-08-01T19:55:44.213 INFO:teuthology.orchestra.run.smithi008.stdout: "time": "2023-08-01T19:55:05.564829+0000", 2023-08-01T19:55:44.213 INFO:teuthology.orchestra.run.smithi008.stdout: "duration": 4.6160000000000004e-06 2023-08-01T19:55:44.213 INFO:teuthology.orchestra.run.smithi008.stdout: }, 2023-08-01T19:55:44.213 INFO:teuthology.orchestra.run.smithi008.stdout: { 2023-08-01T19:55:44.213 INFO:teuthology.orchestra.run.smithi008.stdout: "event": "reached_pg", 2023-08-01T19:55:44.213 INFO:teuthology.orchestra.run.smithi008.stdout: "time": "2023-08-01T19:55:05.564871+0000", 2023-08-01T19:55:44.214 INFO:teuthology.orchestra.run.smithi008.stdout: "duration": 4.2206000000000002e-05 2023-08-01T19:55:44.214 INFO:teuthology.orchestra.run.smithi008.stdout: }, 2023-08-01T19:55:44.214 INFO:teuthology.orchestra.run.smithi008.stdout: { 2023-08-01T19:55:44.214 INFO:teuthology.orchestra.run.smithi008.stdout: "event": "started", 2023-08-01T19:55:44.214 INFO:teuthology.orchestra.run.smithi008.stdout: "time": "2023-08-01T19:55:05.565011+0000", 2023-08-01T19:55:44.214 INFO:teuthology.orchestra.run.smithi008.stdout: "duration": 0.000140469 2023-08-01T19:55:44.214 INFO:teuthology.orchestra.run.smithi008.stdout: }, 2023-08-01T19:55:44.214 INFO:teuthology.orchestra.run.smithi008.stdout: { 2023-08-01T19:55:44.215 INFO:teuthology.orchestra.run.smithi008.stdout: "event": "waiting for subops from 1", 2023-08-01T19:55:44.215 INFO:teuthology.orchestra.run.smithi008.stdout: "time": "2023-08-01T19:55:05.565212+0000", 2023-08-01T19:55:44.215 INFO:teuthology.orchestra.run.smithi008.stdout: "duration": 0.00020106599999999999 2023-08-01T19:55:44.215 INFO:teuthology.orchestra.run.smithi008.stdout: }, 2023-08-01T19:55:44.215 INFO:teuthology.orchestra.run.smithi008.stdout: { 2023-08-01T19:55:44.215 INFO:teuthology.orchestra.run.smithi008.stdout: "event": "sub_op_commit_rec", 2023-08-01T19:55:44.215 INFO:teuthology.orchestra.run.smithi008.stdout: "time": "2023-08-01T19:55:05.626925+0000", 2023-08-01T19:55:44.215 INFO:teuthology.orchestra.run.smithi008.stdout: "duration": 0.061712111 2023-08-01T19:55:44.216 INFO:teuthology.orchestra.run.smithi008.stdout: }, 2023-08-01T19:55:44.216 INFO:teuthology.orchestra.run.smithi008.stdout: { 2023-08-01T19:55:44.216 INFO:teuthology.orchestra.run.smithi008.stdout: "event": "op_commit", 2023-08-01T19:55:44.216 INFO:teuthology.orchestra.run.smithi008.stdout: "time": "2023-08-01T19:55:05.627217+0000", 2023-08-01T19:55:44.216 INFO:teuthology.orchestra.run.smithi008.stdout: "duration": 0.00029265999999999998 2023-08-01T19:55:44.216 INFO:teuthology.orchestra.run.smithi008.stdout: }, 2023-08-01T19:55:44.216 INFO:teuthology.orchestra.run.smithi008.stdout: { 2023-08-01T19:55:44.217 INFO:teuthology.orchestra.run.smithi008.stdout: "event": "commit_sent", 2023-08-01T19:55:44.217 INFO:teuthology.orchestra.run.smithi008.stdout: "time": "2023-08-01T19:55:05.627264+0000", 2023-08-01T19:55:44.217 INFO:teuthology.orchestra.run.smithi008.stdout: "duration": 4.6260000000000001e-05 2023-08-01T19:55:44.217 INFO:teuthology.orchestra.run.smithi008.stdout: }, 2023-08-01T19:55:44.217 INFO:teuthology.orchestra.run.smithi008.stdout: { 2023-08-01T19:55:44.217 INFO:teuthology.orchestra.run.smithi008.stdout: "event": "done", 2023-08-01T19:55:44.217 INFO:teuthology.orchestra.run.smithi008.stdout: "time": "2023-08-01T19:55:05.627303+0000", 2023-08-01T19:55:44.218 INFO:teuthology.orchestra.run.smithi008.stdout: "duration": 3.9839999999999998e-05 2023-08-01T19:55:44.218 INFO:teuthology.orchestra.run.smithi008.stdout: } 2023-08-01T19:55:44.218 INFO:teuthology.orchestra.run.smithi008.stdout: ] 2023-08-01T19:55:44.218 INFO:teuthology.orchestra.run.smithi008.stdout: } 2023-08-01T19:55:44.218 INFO:teuthology.orchestra.run.smithi008.stdout: }, 2023-08-01T19:55:44.218 INFO:teuthology.orchestra.run.smithi008.stdout: { 2023-08-01T19:55:44.218 INFO:teuthology.orchestra.run.smithi008.stdout: "description": "osd_repop(client.4668.0:100928 5.7 e37/19 5:e61a7dfa:::benchmark_data_smithi006_114134_object100927:head v 37'6273, mlcod=37'6270)", 2023-08-01T19:55:44.218 INFO:teuthology.orchestra.run.smithi008.stdout: "initiated_at": "2023-08-01T19:55:05.565106+0000", 2023-08-01T19:55:44.219 INFO:teuthology.orchestra.run.smithi008.stdout: "age": 38.597768731999999, 2023-08-01T19:55:44.219 INFO:teuthology.orchestra.run.smithi008.stdout: "duration": 0.064091282999999999, 2023-08-01T19:55:44.219 INFO:teuthology.orchestra.run.smithi008.stdout: "type_data": { 2023-08-01T19:55:44.219 INFO:teuthology.orchestra.run.smithi008.stdout: "flag_point": "commit sent; apply or cleanup", 2023-08-01T19:55:44.219 INFO:teuthology.orchestra.run.smithi008.stdout: "events": [ 2023-08-01T19:55:44.219 INFO:teuthology.orchestra.run.smithi008.stdout: { 2023-08-01T19:55:44.219 INFO:teuthology.orchestra.run.smithi008.stdout: "event": "initiated", 2023-08-01T19:55:44.219 INFO:teuthology.orchestra.run.smithi008.stdout: "time": "2023-08-01T19:55:05.565106+0000", 2023-08-01T19:55:44.220 INFO:teuthology.orchestra.run.smithi008.stdout: "duration": 0 2023-08-01T19:55:44.220 INFO:teuthology.orchestra.run.smithi008.stdout: }, 2023-08-01T19:55:44.220 INFO:teuthology.orchestra.run.smithi008.stdout: { 2023-08-01T19:55:44.220 INFO:teuthology.orchestra.run.smithi008.stdout: "event": "throttled", 2023-08-01T19:55:44.220 INFO:teuthology.orchestra.run.smithi008.stdout: "time": "2023-08-01T19:55:05.565106+0000", 2023-08-01T19:55:44.220 INFO:teuthology.orchestra.run.smithi008.stdout: "duration": 0 2023-08-01T19:55:44.220 INFO:teuthology.orchestra.run.smithi008.stdout: }, 2023-08-01T19:55:44.220 INFO:teuthology.orchestra.run.smithi008.stdout: { 2023-08-01T19:55:44.221 INFO:teuthology.orchestra.run.smithi008.stdout: "event": "header_read", 2023-08-01T19:55:44.221 INFO:teuthology.orchestra.run.smithi008.stdout: "time": "2023-08-01T19:55:05.565105+0000", 2023-08-01T19:55:44.221 INFO:teuthology.orchestra.run.smithi008.stdout: "duration": 4294967295.9999995 2023-08-01T19:55:44.221 INFO:teuthology.orchestra.run.smithi008.stdout: }, 2023-08-01T19:55:44.221 INFO:teuthology.orchestra.run.smithi008.stdout: { 2023-08-01T19:55:44.221 INFO:teuthology.orchestra.run.smithi008.stdout: "event": "all_read", 2023-08-01T19:55:44.221 INFO:teuthology.orchestra.run.smithi008.stdout: "time": "2023-08-01T19:55:05.565173+0000", 2023-08-01T19:55:44.221 INFO:teuthology.orchestra.run.smithi008.stdout: "duration": 6.8186000000000001e-05 2023-08-01T19:55:44.222 INFO:teuthology.orchestra.run.smithi008.stdout: }, 2023-08-01T19:55:44.222 INFO:teuthology.orchestra.run.smithi008.stdout: { 2023-08-01T19:55:44.222 INFO:teuthology.orchestra.run.smithi008.stdout: "event": "dispatched", 2023-08-01T19:55:44.222 INFO:teuthology.orchestra.run.smithi008.stdout: "time": "2023-08-01T19:55:05.565182+0000", 2023-08-01T19:55:44.222 INFO:teuthology.orchestra.run.smithi008.stdout: "duration": 8.3620000000000006e-06 2023-08-01T19:55:44.222 INFO:teuthology.orchestra.run.smithi008.stdout: }, 2023-08-01T19:55:44.222 INFO:teuthology.orchestra.run.smithi008.stdout: { 2023-08-01T19:55:44.223 INFO:teuthology.orchestra.run.smithi008.stdout: "event": "queued_for_pg", 2023-08-01T19:55:44.223 INFO:teuthology.orchestra.run.smithi008.stdout: "time": "2023-08-01T19:55:05.565186+0000", 2023-08-01T19:55:44.223 INFO:teuthology.orchestra.run.smithi008.stdout: "duration": 3.7680000000000002e-06 2023-08-01T19:55:44.223 INFO:teuthology.orchestra.run.smithi008.stdout: }, 2023-08-01T19:55:44.223 INFO:teuthology.orchestra.run.smithi008.stdout: { 2023-08-01T19:55:44.223 INFO:teuthology.orchestra.run.smithi008.stdout: "event": "reached_pg", 2023-08-01T19:55:44.223 INFO:teuthology.orchestra.run.smithi008.stdout: "time": "2023-08-01T19:55:05.565212+0000", 2023-08-01T19:55:44.223 INFO:teuthology.orchestra.run.smithi008.stdout: "duration": 2.6230000000000001e-05 2023-08-01T19:55:44.224 INFO:teuthology.orchestra.run.smithi008.stdout: }, 2023-08-01T19:55:44.224 INFO:teuthology.orchestra.run.smithi008.stdout: { 2023-08-01T19:55:44.224 INFO:teuthology.orchestra.run.smithi008.stdout: "event": "started", 2023-08-01T19:55:44.224 INFO:teuthology.orchestra.run.smithi008.stdout: "time": "2023-08-01T19:55:05.565224+0000", 2023-08-01T19:55:44.224 INFO:teuthology.orchestra.run.smithi008.stdout: "duration": 1.2033e-05 2023-08-01T19:55:44.224 INFO:teuthology.orchestra.run.smithi008.stdout: }, 2023-08-01T19:55:44.224 INFO:teuthology.orchestra.run.smithi008.stdout: { 2023-08-01T19:55:44.224 INFO:teuthology.orchestra.run.smithi008.stdout: "event": "commit_sent", 2023-08-01T19:55:44.225 INFO:teuthology.orchestra.run.smithi008.stdout: "time": "2023-08-01T19:55:05.629152+0000", 2023-08-01T19:55:44.225 INFO:teuthology.orchestra.run.smithi008.stdout: "duration": 0.063928378999999994 2023-08-01T19:55:44.225 INFO:teuthology.orchestra.run.smithi008.stdout: }, 2023-08-01T19:55:44.225 INFO:teuthology.orchestra.run.smithi008.stdout: { 2023-08-01T19:55:44.225 INFO:teuthology.orchestra.run.smithi008.stdout: "event": "done", 2023-08-01T19:55:44.225 INFO:teuthology.orchestra.run.smithi008.stdout: "time": "2023-08-01T19:55:05.629197+0000", 2023-08-01T19:55:44.225 INFO:teuthology.orchestra.run.smithi008.stdout: "duration": 4.4894000000000001e-05 2023-08-01T19:55:44.225 INFO:teuthology.orchestra.run.smithi008.stdout: } 2023-08-01T19:55:44.226 INFO:teuthology.orchestra.run.smithi008.stdout: ] 2023-08-01T19:55:44.226 INFO:teuthology.orchestra.run.smithi008.stdout: } 2023-08-01T19:55:44.226 INFO:teuthology.orchestra.run.smithi008.stdout: }, 2023-08-01T19:55:44.226 INFO:teuthology.orchestra.run.smithi008.stdout: { 2023-08-01T19:55:44.226 INFO:teuthology.orchestra.run.smithi008.stdout: "description": "osd_repop(client.4668.0:100927 5.0 e37/19 5:00608ec6:::benchmark_data_smithi006_114134_object100926:head v 37'6408, mlcod=37'6403)", 2023-08-01T19:55:44.226 INFO:teuthology.orchestra.run.smithi008.stdout: "initiated_at": "2023-08-01T19:55:05.565153+0000", 2023-08-01T19:55:44.226 INFO:teuthology.orchestra.run.smithi008.stdout: "age": 38.597721995000001, 2023-08-01T19:55:44.226 INFO:teuthology.orchestra.run.smithi008.stdout: "duration": 0.062202714999999999, 2023-08-01T19:55:44.227 INFO:teuthology.orchestra.run.smithi008.stdout: "type_data": { 2023-08-01T19:55:44.227 INFO:teuthology.orchestra.run.smithi008.stdout: "flag_point": "commit sent; apply or cleanup", 2023-08-01T19:55:44.227 INFO:teuthology.orchestra.run.smithi008.stdout: "events": [ 2023-08-01T19:55:44.227 INFO:teuthology.orchestra.run.smithi008.stdout: { 2023-08-01T19:55:44.227 INFO:teuthology.orchestra.run.smithi008.stdout: "event": "initiated", 2023-08-01T19:55:44.227 INFO:teuthology.orchestra.run.smithi008.stdout: "time": "2023-08-01T19:55:05.565153+0000", 2023-08-01T19:55:44.227 INFO:teuthology.orchestra.run.smithi008.stdout: "duration": 0 2023-08-01T19:55:44.228 INFO:teuthology.orchestra.run.smithi008.stdout: }, 2023-08-01T19:55:44.228 INFO:teuthology.orchestra.run.smithi008.stdout: { 2023-08-01T19:55:44.228 INFO:teuthology.orchestra.run.smithi008.stdout: "event": "throttled", 2023-08-01T19:55:44.228 INFO:teuthology.orchestra.run.smithi008.stdout: "time": "2023-08-01T19:55:05.565153+0000", 2023-08-01T19:55:44.228 INFO:teuthology.orchestra.run.smithi008.stdout: "duration": 0 2023-08-01T19:55:44.228 INFO:teuthology.orchestra.run.smithi008.stdout: }, 2023-08-01T19:55:44.228 INFO:teuthology.orchestra.run.smithi008.stdout: { 2023-08-01T19:55:44.228 INFO:teuthology.orchestra.run.smithi008.stdout: "event": "header_read", 2023-08-01T19:55:44.229 INFO:teuthology.orchestra.run.smithi008.stdout: "time": "2023-08-01T19:55:05.565152+0000", 2023-08-01T19:55:44.229 INFO:teuthology.orchestra.run.smithi008.stdout: "duration": 4294967295.9999995 2023-08-01T19:55:44.229 INFO:teuthology.orchestra.run.smithi008.stdout: }, 2023-08-01T19:55:44.229 INFO:teuthology.orchestra.run.smithi008.stdout: { 2023-08-01T19:55:44.229 INFO:teuthology.orchestra.run.smithi008.stdout: "event": "all_read", 2023-08-01T19:55:44.229 INFO:teuthology.orchestra.run.smithi008.stdout: "time": "2023-08-01T19:55:05.565225+0000", 2023-08-01T19:55:44.229 INFO:teuthology.orchestra.run.smithi008.stdout: "duration": 7.2471000000000005e-05 2023-08-01T19:55:44.229 INFO:teuthology.orchestra.run.smithi008.stdout: }, 2023-08-01T19:55:44.230 INFO:teuthology.orchestra.run.smithi008.stdout: { 2023-08-01T19:55:44.230 INFO:teuthology.orchestra.run.smithi008.stdout: "event": "dispatched", 2023-08-01T19:55:44.230 INFO:teuthology.orchestra.run.smithi008.stdout: "time": "2023-08-01T19:55:05.565229+0000", 2023-08-01T19:55:44.230 INFO:teuthology.orchestra.run.smithi008.stdout: "duration": 4.5600000000000004e-06 2023-08-01T19:55:44.230 INFO:teuthology.orchestra.run.smithi008.stdout: }, 2023-08-01T19:55:44.230 INFO:teuthology.orchestra.run.smithi008.stdout: { 2023-08-01T19:55:44.230 INFO:teuthology.orchestra.run.smithi008.stdout: "event": "queued_for_pg", 2023-08-01T19:55:44.230 INFO:teuthology.orchestra.run.smithi008.stdout: "time": "2023-08-01T19:55:05.565232+0000", 2023-08-01T19:55:44.231 INFO:teuthology.orchestra.run.smithi008.stdout: "duration": 2.6900000000000001e-06 2023-08-01T19:55:44.231 INFO:teuthology.orchestra.run.smithi008.stdout: }, 2023-08-01T19:55:44.231 INFO:teuthology.orchestra.run.smithi008.stdout: { 2023-08-01T19:55:44.231 INFO:teuthology.orchestra.run.smithi008.stdout: "event": "reached_pg", 2023-08-01T19:55:44.231 INFO:teuthology.orchestra.run.smithi008.stdout: "time": "2023-08-01T19:55:05.565283+0000", 2023-08-01T19:55:44.231 INFO:teuthology.orchestra.run.smithi008.stdout: "duration": 5.1442e-05 2023-08-01T19:55:44.231 INFO:teuthology.orchestra.run.smithi008.stdout: }, 2023-08-01T19:55:44.231 INFO:teuthology.orchestra.run.smithi008.stdout: { 2023-08-01T19:55:44.232 INFO:teuthology.orchestra.run.smithi008.stdout: "event": "started", 2023-08-01T19:55:44.232 INFO:teuthology.orchestra.run.smithi008.stdout: "time": "2023-08-01T19:55:05.565301+0000", 2023-08-01T19:55:44.232 INFO:teuthology.orchestra.run.smithi008.stdout: "duration": 1.8029e-05 2023-08-01T19:55:44.232 INFO:teuthology.orchestra.run.smithi008.stdout: }, 2023-08-01T19:55:44.232 INFO:teuthology.orchestra.run.smithi008.stdout: { 2023-08-01T19:55:44.232 INFO:teuthology.orchestra.run.smithi008.stdout: "event": "commit_sent", 2023-08-01T19:55:44.232 INFO:teuthology.orchestra.run.smithi008.stdout: "time": "2023-08-01T19:55:05.627318+0000", 2023-08-01T19:55:44.233 INFO:teuthology.orchestra.run.smithi008.stdout: "duration": 0.062016763000000003 2023-08-01T19:55:44.233 INFO:teuthology.orchestra.run.smithi008.stdout: }, 2023-08-01T19:55:44.233 INFO:teuthology.orchestra.run.smithi008.stdout: { 2023-08-01T19:55:44.233 INFO:teuthology.orchestra.run.smithi008.stdout: "event": "done", 2023-08-01T19:55:44.233 INFO:teuthology.orchestra.run.smithi008.stdout: "time": "2023-08-01T19:55:05.627355+0000", 2023-08-01T19:55:44.233 INFO:teuthology.orchestra.run.smithi008.stdout: "duration": 3.7258999999999997e-05 2023-08-01T19:55:44.233 INFO:teuthology.orchestra.run.smithi008.stdout: } 2023-08-01T19:55:44.233 INFO:teuthology.orchestra.run.smithi008.stdout: ] 2023-08-01T19:55:44.234 INFO:teuthology.orchestra.run.smithi008.stdout: } 2023-08-01T19:55:44.234 INFO:teuthology.orchestra.run.smithi008.stdout: }, 2023-08-01T19:55:44.234 INFO:teuthology.orchestra.run.smithi008.stdout: { 2023-08-01T19:55:44.234 INFO:teuthology.orchestra.run.smithi008.stdout: "description": "osd_op(client.4668.0:100930 5.5 5:a7b64eb3:::benchmark_data_smithi006_114134_object100929:head [set-alloc-hint object_size 65536 write_size 65536,write 0~65536] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e37)", 2023-08-01T19:55:44.234 INFO:teuthology.orchestra.run.smithi008.stdout: "initiated_at": "2023-08-01T19:55:05.565766+0000", 2023-08-01T19:55:44.234 INFO:teuthology.orchestra.run.smithi008.stdout: "age": 38.597108210000002, 2023-08-01T19:55:44.234 INFO:teuthology.orchestra.run.smithi008.stdout: "duration": 0.063668735000000004, 2023-08-01T19:55:44.234 INFO:teuthology.orchestra.run.smithi008.stdout: "type_data": { 2023-08-01T19:55:44.235 INFO:teuthology.orchestra.run.smithi008.stdout: "flag_point": "commit sent; apply or cleanup", 2023-08-01T19:55:44.235 INFO:teuthology.orchestra.run.smithi008.stdout: "client_info": { 2023-08-01T19:55:44.235 INFO:teuthology.orchestra.run.smithi008.stdout: "client": "client.4668", 2023-08-01T19:55:44.235 INFO:teuthology.orchestra.run.smithi008.stdout: "client_addr": "172.21.15.6:0/1709472247", 2023-08-01T19:55:44.235 INFO:teuthology.orchestra.run.smithi008.stdout: "tid": 100930 2023-08-01T19:55:44.235 INFO:teuthology.orchestra.run.smithi008.stdout: }, 2023-08-01T19:55:44.235 INFO:teuthology.orchestra.run.smithi008.stdout: "events": [ 2023-08-01T19:55:44.235 INFO:teuthology.orchestra.run.smithi008.stdout: { 2023-08-01T19:55:44.236 INFO:teuthology.orchestra.run.smithi008.stdout: "event": "initiated", 2023-08-01T19:55:44.236 INFO:teuthology.orchestra.run.smithi008.stdout: "time": "2023-08-01T19:55:05.565766+0000", 2023-08-01T19:55:44.236 INFO:teuthology.orchestra.run.smithi008.stdout: "duration": 0 2023-08-01T19:55:44.236 INFO:teuthology.orchestra.run.smithi008.stdout: }, 2023-08-01T19:55:44.236 INFO:teuthology.orchestra.run.smithi008.stdout: { 2023-08-01T19:55:44.236 INFO:teuthology.orchestra.run.smithi008.stdout: "event": "throttled", 2023-08-01T19:55:44.236 INFO:teuthology.orchestra.run.smithi008.stdout: "time": "2023-08-01T19:55:05.565766+0000", 2023-08-01T19:55:44.236 INFO:teuthology.orchestra.run.smithi008.stdout: "duration": 0 2023-08-01T19:55:44.237 INFO:teuthology.orchestra.run.smithi008.stdout: }, 2023-08-01T19:55:44.237 INFO:teuthology.orchestra.run.smithi008.stdout: { 2023-08-01T19:55:44.237 INFO:teuthology.orchestra.run.smithi008.stdout: "event": "header_read", 2023-08-01T19:55:44.237 INFO:teuthology.orchestra.run.smithi008.stdout: "time": "2023-08-01T19:55:05.565766+0000", 2023-08-01T19:55:44.237 INFO:teuthology.orchestra.run.smithi008.stdout: "duration": 4294967295.999999 2023-08-01T19:55:44.237 INFO:teuthology.orchestra.run.smithi008.stdout: }, 2023-08-01T19:55:44.237 INFO:teuthology.orchestra.run.smithi008.stdout: { 2023-08-01T19:55:44.237 INFO:teuthology.orchestra.run.smithi008.stdout: "event": "all_read", 2023-08-01T19:55:44.238 INFO:teuthology.orchestra.run.smithi008.stdout: "time": "2023-08-01T19:55:05.565855+0000", 2023-08-01T19:55:44.238 INFO:teuthology.orchestra.run.smithi008.stdout: "duration": 8.9166999999999995e-05 2023-08-01T19:55:44.238 INFO:teuthology.orchestra.run.smithi008.stdout: }, 2023-08-01T19:55:44.238 INFO:teuthology.orchestra.run.smithi008.stdout: { 2023-08-01T19:55:44.238 INFO:teuthology.orchestra.run.smithi008.stdout: "event": "dispatched", 2023-08-01T19:55:44.238 INFO:teuthology.orchestra.run.smithi008.stdout: "time": "2023-08-01T19:55:05.565862+0000", 2023-08-01T19:55:44.238 INFO:teuthology.orchestra.run.smithi008.stdout: "duration": 7.4549999999999998e-06 2023-08-01T19:55:44.239 INFO:teuthology.orchestra.run.smithi008.stdout: }, 2023-08-01T19:55:44.239 INFO:teuthology.orchestra.run.smithi008.stdout: { 2023-08-01T19:55:44.239 INFO:teuthology.orchestra.run.smithi008.stdout: "event": "queued_for_pg", 2023-08-01T19:55:44.239 INFO:teuthology.orchestra.run.smithi008.stdout: "time": "2023-08-01T19:55:05.565866+0000", 2023-08-01T19:55:44.239 INFO:teuthology.orchestra.run.smithi008.stdout: "duration": 3.8060000000000001e-06 2023-08-01T19:55:44.239 INFO:teuthology.orchestra.run.smithi008.stdout: }, 2023-08-01T19:55:44.239 INFO:teuthology.orchestra.run.smithi008.stdout: { 2023-08-01T19:55:44.239 INFO:teuthology.orchestra.run.smithi008.stdout: "event": "reached_pg", 2023-08-01T19:55:44.240 INFO:teuthology.orchestra.run.smithi008.stdout: "time": "2023-08-01T19:55:05.565901+0000", 2023-08-01T19:55:44.240 INFO:teuthology.orchestra.run.smithi008.stdout: "duration": 3.5063e-05 2023-08-01T19:55:44.240 INFO:teuthology.orchestra.run.smithi008.stdout: }, 2023-08-01T19:55:44.240 INFO:teuthology.orchestra.run.smithi008.stdout: { 2023-08-01T19:55:44.240 INFO:teuthology.orchestra.run.smithi008.stdout: "event": "started", 2023-08-01T19:55:44.240 INFO:teuthology.orchestra.run.smithi008.stdout: "time": "2023-08-01T19:55:05.566016+0000", 2023-08-01T19:55:44.240 INFO:teuthology.orchestra.run.smithi008.stdout: "duration": 0.00011509400000000001 2023-08-01T19:55:44.240 INFO:teuthology.orchestra.run.smithi008.stdout: }, 2023-08-01T19:55:44.241 INFO:teuthology.orchestra.run.smithi008.stdout: { 2023-08-01T19:55:44.241 INFO:teuthology.orchestra.run.smithi008.stdout: "event": "waiting for subops from 1", 2023-08-01T19:55:44.241 INFO:teuthology.orchestra.run.smithi008.stdout: "time": "2023-08-01T19:55:05.566154+0000", 2023-08-01T19:55:44.241 INFO:teuthology.orchestra.run.smithi008.stdout: "duration": 0.000138052 2023-08-01T19:55:44.241 INFO:teuthology.orchestra.run.smithi008.stdout: }, 2023-08-01T19:55:44.241 INFO:teuthology.orchestra.run.smithi008.stdout: { 2023-08-01T19:55:44.241 INFO:teuthology.orchestra.run.smithi008.stdout: "event": "sub_op_commit_rec", 2023-08-01T19:55:44.242 INFO:teuthology.orchestra.run.smithi008.stdout: "time": "2023-08-01T19:55:05.629279+0000", 2023-08-01T19:55:44.242 INFO:teuthology.orchestra.run.smithi008.stdout: "duration": 0.063124531999999997 2023-08-01T19:55:44.242 INFO:teuthology.orchestra.run.smithi008.stdout: }, 2023-08-01T19:55:44.242 INFO:teuthology.orchestra.run.smithi008.stdout: { 2023-08-01T19:55:44.242 INFO:teuthology.orchestra.run.smithi008.stdout: "event": "op_commit", 2023-08-01T19:55:44.242 INFO:teuthology.orchestra.run.smithi008.stdout: "time": "2023-08-01T19:55:05.629333+0000", 2023-08-01T19:55:44.242 INFO:teuthology.orchestra.run.smithi008.stdout: "duration": 5.4694999999999997e-05 2023-08-01T19:55:44.242 INFO:teuthology.orchestra.run.smithi008.stdout: }, 2023-08-01T19:55:44.243 INFO:teuthology.orchestra.run.smithi008.stdout: { 2023-08-01T19:55:44.243 INFO:teuthology.orchestra.run.smithi008.stdout: "event": "commit_sent", 2023-08-01T19:55:44.243 INFO:teuthology.orchestra.run.smithi008.stdout: "time": "2023-08-01T19:55:05.629390+0000", 2023-08-01T19:55:44.243 INFO:teuthology.orchestra.run.smithi008.stdout: "duration": 5.6416000000000003e-05 2023-08-01T19:55:44.243 INFO:teuthology.orchestra.run.smithi008.stdout: }, 2023-08-01T19:55:44.243 INFO:teuthology.orchestra.run.smithi008.stdout: { 2023-08-01T19:55:44.243 INFO:teuthology.orchestra.run.smithi008.stdout: "event": "done", 2023-08-01T19:55:44.243 INFO:teuthology.orchestra.run.smithi008.stdout: "time": "2023-08-01T19:55:05.629435+0000", 2023-08-01T19:55:44.244 INFO:teuthology.orchestra.run.smithi008.stdout: "duration": 4.5170999999999998e-05 2023-08-01T19:55:44.244 INFO:teuthology.orchestra.run.smithi008.stdout: } 2023-08-01T19:55:44.244 INFO:teuthology.orchestra.run.smithi008.stdout: ] 2023-08-01T19:55:44.244 INFO:teuthology.orchestra.run.smithi008.stdout: } 2023-08-01T19:55:44.244 INFO:teuthology.orchestra.run.smithi008.stdout: }, 2023-08-01T19:55:44.244 INFO:teuthology.orchestra.run.smithi008.stdout: { 2023-08-01T19:55:44.244 INFO:teuthology.orchestra.run.smithi008.stdout: "description": "osd_op(client.4668.0:100933 5.5 5:af92e9f2:::benchmark_data_smithi006_114134_object100932:head [set-alloc-hint object_size 65536 write_size 65536,write 0~65536] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e37)", 2023-08-01T19:55:44.244 INFO:teuthology.orchestra.run.smithi008.stdout: "initiated_at": "2023-08-01T19:55:05.566634+0000", 2023-08-01T19:55:44.245 INFO:teuthology.orchestra.run.smithi008.stdout: "age": 38.596240667000004, 2023-08-01T19:55:44.245 INFO:teuthology.orchestra.run.smithi008.stdout: "duration": 0.065909364999999998, 2023-08-01T19:55:44.245 INFO:teuthology.orchestra.run.smithi008.stdout: "type_data": { 2023-08-01T19:55:44.245 INFO:teuthology.orchestra.run.smithi008.stdout: "flag_point": "commit sent; apply or cleanup", 2023-08-01T19:55:44.245 INFO:teuthology.orchestra.run.smithi008.stdout: "client_info": { 2023-08-01T19:55:44.245 INFO:teuthology.orchestra.run.smithi008.stdout: "client": "client.4668", 2023-08-01T19:55:44.245 INFO:teuthology.orchestra.run.smithi008.stdout: "client_addr": "172.21.15.6:0/1709472247", 2023-08-01T19:55:44.245 INFO:teuthology.orchestra.run.smithi008.stdout: "tid": 100933 2023-08-01T19:55:44.246 INFO:teuthology.orchestra.run.smithi008.stdout: }, 2023-08-01T19:55:44.246 INFO:teuthology.orchestra.run.smithi008.stdout: "events": [ 2023-08-01T19:55:44.246 INFO:teuthology.orchestra.run.smithi008.stdout: { 2023-08-01T19:55:44.246 INFO:teuthology.orchestra.run.smithi008.stdout: "event": "initiated", 2023-08-01T19:55:44.246 INFO:teuthology.orchestra.run.smithi008.stdout: "time": "2023-08-01T19:55:05.566634+0000", 2023-08-01T19:55:44.246 INFO:teuthology.orchestra.run.smithi008.stdout: "duration": 0 2023-08-01T19:55:44.246 INFO:teuthology.orchestra.run.smithi008.stdout: }, 2023-08-01T19:55:44.247 INFO:teuthology.orchestra.run.smithi008.stdout: { 2023-08-01T19:55:44.247 INFO:teuthology.orchestra.run.smithi008.stdout: "event": "throttled", 2023-08-01T19:55:44.247 INFO:teuthology.orchestra.run.smithi008.stdout: "time": "2023-08-01T19:55:05.566634+0000", 2023-08-01T19:55:44.247 INFO:teuthology.orchestra.run.smithi008.stdout: "duration": 0 2023-08-01T19:55:44.247 INFO:teuthology.orchestra.run.smithi008.stdout: }, 2023-08-01T19:55:44.247 INFO:teuthology.orchestra.run.smithi008.stdout: { 2023-08-01T19:55:44.247 INFO:teuthology.orchestra.run.smithi008.stdout: "event": "header_read", 2023-08-01T19:55:44.247 INFO:teuthology.orchestra.run.smithi008.stdout: "time": "2023-08-01T19:55:05.566630+0000", 2023-08-01T19:55:44.248 INFO:teuthology.orchestra.run.smithi008.stdout: "duration": 4294967295.9999962 2023-08-01T19:55:44.248 INFO:teuthology.orchestra.run.smithi008.stdout: }, 2023-08-01T19:55:44.248 INFO:teuthology.orchestra.run.smithi008.stdout: { 2023-08-01T19:55:44.248 INFO:teuthology.orchestra.run.smithi008.stdout: "event": "all_read", 2023-08-01T19:55:44.248 INFO:teuthology.orchestra.run.smithi008.stdout: "time": "2023-08-01T19:55:05.566736+0000", 2023-08-01T19:55:44.248 INFO:teuthology.orchestra.run.smithi008.stdout: "duration": 0.000105752 2023-08-01T19:55:44.248 INFO:teuthology.orchestra.run.smithi008.stdout: }, 2023-08-01T19:55:44.248 INFO:teuthology.orchestra.run.smithi008.stdout: { 2023-08-01T19:55:44.249 INFO:teuthology.orchestra.run.smithi008.stdout: "event": "dispatched", 2023-08-01T19:55:44.249 INFO:teuthology.orchestra.run.smithi008.stdout: "time": "2023-08-01T19:55:05.566742+0000", 2023-08-01T19:55:44.249 INFO:teuthology.orchestra.run.smithi008.stdout: "duration": 5.8209999999999998e-06 2023-08-01T19:55:44.249 INFO:teuthology.orchestra.run.smithi008.stdout: }, 2023-08-01T19:55:44.249 INFO:teuthology.orchestra.run.smithi008.stdout: { 2023-08-01T19:55:44.249 INFO:teuthology.orchestra.run.smithi008.stdout: "event": "queued_for_pg", 2023-08-01T19:55:44.249 INFO:teuthology.orchestra.run.smithi008.stdout: "time": "2023-08-01T19:55:05.566745+0000", 2023-08-01T19:55:44.249 INFO:teuthology.orchestra.run.smithi008.stdout: "duration": 3.337e-06 2023-08-01T19:55:44.250 INFO:teuthology.orchestra.run.smithi008.stdout: }, 2023-08-01T19:55:44.250 INFO:teuthology.orchestra.run.smithi008.stdout: { 2023-08-01T19:55:44.250 INFO:teuthology.orchestra.run.smithi008.stdout: "event": "reached_pg", 2023-08-01T19:55:44.250 INFO:teuthology.orchestra.run.smithi008.stdout: "time": "2023-08-01T19:55:05.568175+0000", 2023-08-01T19:55:44.250 INFO:teuthology.orchestra.run.smithi008.stdout: "duration": 0.001429647 2023-08-01T19:55:44.250 INFO:teuthology.orchestra.run.smithi008.stdout: }, 2023-08-01T19:55:44.250 INFO:teuthology.orchestra.run.smithi008.stdout: { 2023-08-01T19:55:44.250 INFO:teuthology.orchestra.run.smithi008.stdout: "event": "started", 2023-08-01T19:55:44.251 INFO:teuthology.orchestra.run.smithi008.stdout: "time": "2023-08-01T19:55:05.568288+0000", 2023-08-01T19:55:44.251 INFO:teuthology.orchestra.run.smithi008.stdout: "duration": 0.000113353 2023-08-01T19:55:44.251 INFO:teuthology.orchestra.run.smithi008.stdout: }, 2023-08-01T19:55:44.251 INFO:teuthology.orchestra.run.smithi008.stdout: { 2023-08-01T19:55:44.251 INFO:teuthology.orchestra.run.smithi008.stdout: "event": "waiting for subops from 1", 2023-08-01T19:55:44.251 INFO:teuthology.orchestra.run.smithi008.stdout: "time": "2023-08-01T19:55:05.568425+0000", 2023-08-01T19:55:44.251 INFO:teuthology.orchestra.run.smithi008.stdout: "duration": 0.000137346 2023-08-01T19:55:44.251 INFO:teuthology.orchestra.run.smithi008.stdout: }, 2023-08-01T19:55:44.252 INFO:teuthology.orchestra.run.smithi008.stdout: { 2023-08-01T19:55:44.252 INFO:teuthology.orchestra.run.smithi008.stdout: "event": "sub_op_commit_rec", 2023-08-01T19:55:44.252 INFO:teuthology.orchestra.run.smithi008.stdout: "time": "2023-08-01T19:55:05.629320+0000", 2023-08-01T19:55:44.252 INFO:teuthology.orchestra.run.smithi008.stdout: "duration": 0.060894491000000002 2023-08-01T19:55:44.252 INFO:teuthology.orchestra.run.smithi008.stdout: }, 2023-08-01T19:55:44.252 INFO:teuthology.orchestra.run.smithi008.stdout: { 2023-08-01T19:55:44.252 INFO:teuthology.orchestra.run.smithi008.stdout: "event": "op_commit", 2023-08-01T19:55:44.253 INFO:teuthology.orchestra.run.smithi008.stdout: "time": "2023-08-01T19:55:05.632452+0000", 2023-08-01T19:55:44.253 INFO:teuthology.orchestra.run.smithi008.stdout: "duration": 0.003131909 2023-08-01T19:55:44.253 INFO:teuthology.orchestra.run.smithi008.stdout: }, 2023-08-01T19:55:44.253 INFO:teuthology.orchestra.run.smithi008.stdout: { 2023-08-01T19:55:44.253 INFO:teuthology.orchestra.run.smithi008.stdout: "event": "commit_sent", 2023-08-01T19:55:44.253 INFO:teuthology.orchestra.run.smithi008.stdout: "time": "2023-08-01T19:55:05.632503+0000", 2023-08-01T19:55:44.253 INFO:teuthology.orchestra.run.smithi008.stdout: "duration": 5.1295000000000003e-05 2023-08-01T19:55:44.253 INFO:teuthology.orchestra.run.smithi008.stdout: }, 2023-08-01T19:55:44.254 INFO:teuthology.orchestra.run.smithi008.stdout: { 2023-08-01T19:55:44.254 INFO:teuthology.orchestra.run.smithi008.stdout: "event": "done", 2023-08-01T19:55:44.254 INFO:teuthology.orchestra.run.smithi008.stdout: "time": "2023-08-01T19:55:05.632543+0000", 2023-08-01T19:55:44.254 INFO:teuthology.orchestra.run.smithi008.stdout: "duration": 4.0234000000000001e-05 2023-08-01T19:55:44.254 INFO:teuthology.orchestra.run.smithi008.stdout: } 2023-08-01T19:55:44.254 INFO:teuthology.orchestra.run.smithi008.stdout: ] 2023-08-01T19:55:44.254 INFO:teuthology.orchestra.run.smithi008.stdout: } 2023-08-01T19:55:44.254 INFO:teuthology.orchestra.run.smithi008.stdout: }, 2023-08-01T19:55:44.255 INFO:teuthology.orchestra.run.smithi008.stdout: { 2023-08-01T19:55:44.255 INFO:teuthology.orchestra.run.smithi008.stdout: "description": "osd_repop(client.4668.0:100935 5.e e37/19 5:7895b14e:::benchmark_data_smithi006_114134_object100934:head v 37'6305, mlcod=37'6303)", 2023-08-01T19:55:44.255 INFO:teuthology.orchestra.run.smithi008.stdout: "initiated_at": "2023-08-01T19:55:05.567118+0000", 2023-08-01T19:55:44.255 INFO:teuthology.orchestra.run.smithi008.stdout: "age": 38.595756424000001, 2023-08-01T19:55:44.255 INFO:teuthology.orchestra.run.smithi008.stdout: "duration": 0.063691180999999999, 2023-08-01T19:55:44.255 INFO:teuthology.orchestra.run.smithi008.stdout: "type_data": { 2023-08-01T19:55:44.255 INFO:teuthology.orchestra.run.smithi008.stdout: "flag_point": "commit sent; apply or cleanup", 2023-08-01T19:55:44.255 INFO:teuthology.orchestra.run.smithi008.stdout: "events": [ 2023-08-01T19:55:44.256 INFO:teuthology.orchestra.run.smithi008.stdout: { 2023-08-01T19:55:44.256 INFO:teuthology.orchestra.run.smithi008.stdout: "event": "initiated", 2023-08-01T19:55:44.256 INFO:teuthology.orchestra.run.smithi008.stdout: "time": "2023-08-01T19:55:05.567118+0000", 2023-08-01T19:55:44.256 INFO:teuthology.orchestra.run.smithi008.stdout: "duration": 0 2023-08-01T19:55:44.256 INFO:teuthology.orchestra.run.smithi008.stdout: }, 2023-08-01T19:55:44.256 INFO:teuthology.orchestra.run.smithi008.stdout: { 2023-08-01T19:55:44.256 INFO:teuthology.orchestra.run.smithi008.stdout: "event": "throttled", 2023-08-01T19:55:44.256 INFO:teuthology.orchestra.run.smithi008.stdout: "time": "2023-08-01T19:55:05.567118+0000", 2023-08-01T19:55:44.257 INFO:teuthology.orchestra.run.smithi008.stdout: "duration": 0 2023-08-01T19:55:44.257 INFO:teuthology.orchestra.run.smithi008.stdout: }, 2023-08-01T19:55:44.257 INFO:teuthology.orchestra.run.smithi008.stdout: { 2023-08-01T19:55:44.257 INFO:teuthology.orchestra.run.smithi008.stdout: "event": "header_read", 2023-08-01T19:55:44.257 INFO:teuthology.orchestra.run.smithi008.stdout: "time": "2023-08-01T19:55:05.567117+0000", 2023-08-01T19:55:44.257 INFO:teuthology.orchestra.run.smithi008.stdout: "duration": 4294967295.999999 2023-08-01T19:55:44.257 INFO:teuthology.orchestra.run.smithi008.stdout: }, 2023-08-01T19:55:44.257 INFO:teuthology.orchestra.run.smithi008.stdout: { 2023-08-01T19:55:44.258 INFO:teuthology.orchestra.run.smithi008.stdout: "event": "all_read", 2023-08-01T19:55:44.258 INFO:teuthology.orchestra.run.smithi008.stdout: "time": "2023-08-01T19:55:05.567168+0000", 2023-08-01T19:55:44.258 INFO:teuthology.orchestra.run.smithi008.stdout: "duration": 5.0353999999999999e-05 2023-08-01T19:55:44.258 INFO:teuthology.orchestra.run.smithi008.stdout: }, 2023-08-01T19:55:44.258 INFO:teuthology.orchestra.run.smithi008.stdout: { 2023-08-01T19:55:44.258 INFO:teuthology.orchestra.run.smithi008.stdout: "event": "dispatched", 2023-08-01T19:55:44.258 INFO:teuthology.orchestra.run.smithi008.stdout: "time": "2023-08-01T19:55:05.567175+0000", 2023-08-01T19:55:44.258 INFO:teuthology.orchestra.run.smithi008.stdout: "duration": 7.3919999999999997e-06 2023-08-01T19:55:44.259 INFO:teuthology.orchestra.run.smithi008.stdout: }, 2023-08-01T19:55:44.259 INFO:teuthology.orchestra.run.smithi008.stdout: { 2023-08-01T19:55:44.259 INFO:teuthology.orchestra.run.smithi008.stdout: "event": "queued_for_pg", 2023-08-01T19:55:44.259 INFO:teuthology.orchestra.run.smithi008.stdout: "time": "2023-08-01T19:55:05.567180+0000", 2023-08-01T19:55:44.259 INFO:teuthology.orchestra.run.smithi008.stdout: "duration": 5.3090000000000003e-06 2023-08-01T19:55:44.259 INFO:teuthology.orchestra.run.smithi008.stdout: }, 2023-08-01T19:55:44.259 INFO:teuthology.orchestra.run.smithi008.stdout: { 2023-08-01T19:55:44.260 INFO:teuthology.orchestra.run.smithi008.stdout: "event": "reached_pg", 2023-08-01T19:55:44.260 INFO:teuthology.orchestra.run.smithi008.stdout: "time": "2023-08-01T19:55:05.567210+0000", 2023-08-01T19:55:44.260 INFO:teuthology.orchestra.run.smithi008.stdout: "duration": 3.0001999999999998e-05 2023-08-01T19:55:44.260 INFO:teuthology.orchestra.run.smithi008.stdout: }, 2023-08-01T19:55:44.260 INFO:teuthology.orchestra.run.smithi008.stdout: { 2023-08-01T19:55:44.260 INFO:teuthology.orchestra.run.smithi008.stdout: "event": "started", 2023-08-01T19:55:44.260 INFO:teuthology.orchestra.run.smithi008.stdout: "time": "2023-08-01T19:55:05.567222+0000", 2023-08-01T19:55:44.260 INFO:teuthology.orchestra.run.smithi008.stdout: "duration": 1.1499e-05 2023-08-01T19:55:44.261 INFO:teuthology.orchestra.run.smithi008.stdout: }, 2023-08-01T19:55:44.261 INFO:teuthology.orchestra.run.smithi008.stdout: { 2023-08-01T19:55:44.261 INFO:teuthology.orchestra.run.smithi008.stdout: "event": "commit_sent", 2023-08-01T19:55:44.261 INFO:teuthology.orchestra.run.smithi008.stdout: "time": "2023-08-01T19:55:05.630772+0000", 2023-08-01T19:55:44.261 INFO:teuthology.orchestra.run.smithi008.stdout: "duration": 0.063550572999999999 2023-08-01T19:55:44.261 INFO:teuthology.orchestra.run.smithi008.stdout: }, 2023-08-01T19:55:44.261 INFO:teuthology.orchestra.run.smithi008.stdout: { 2023-08-01T19:55:44.261 INFO:teuthology.orchestra.run.smithi008.stdout: "event": "done", 2023-08-01T19:55:44.262 INFO:teuthology.orchestra.run.smithi008.stdout: "time": "2023-08-01T19:55:05.630809+0000", 2023-08-01T19:55:44.262 INFO:teuthology.orchestra.run.smithi008.stdout: "duration": 3.7033000000000003e-05 2023-08-01T19:55:44.262 INFO:teuthology.orchestra.run.smithi008.stdout: } 2023-08-01T19:55:44.262 INFO:teuthology.orchestra.run.smithi008.stdout: ] 2023-08-01T19:55:44.262 INFO:teuthology.orchestra.run.smithi008.stdout: } 2023-08-01T19:55:44.262 INFO:teuthology.orchestra.run.smithi008.stdout: }, 2023-08-01T19:55:44.262 INFO:teuthology.orchestra.run.smithi008.stdout: { 2023-08-01T19:55:44.262 INFO:teuthology.orchestra.run.smithi008.stdout: "description": "osd_repop(client.4668.0:100936 5.1 e37/19 5:8f4e3576:::benchmark_data_smithi006_114134_object100935:head v 37'6263, mlcod=37'6261)", 2023-08-01T19:55:44.263 INFO:teuthology.orchestra.run.smithi008.stdout: "initiated_at": "2023-08-01T19:55:05.567617+0000", 2023-08-01T19:55:44.263 INFO:teuthology.orchestra.run.smithi008.stdout: "age": 38.595257160999999, 2023-08-01T19:55:44.263 INFO:teuthology.orchestra.run.smithi008.stdout: "duration": 0.062773918999999997, 2023-08-01T19:55:44.263 INFO:teuthology.orchestra.run.smithi008.stdout: "type_data": { 2023-08-01T19:55:44.263 INFO:teuthology.orchestra.run.smithi008.stdout: "flag_point": "commit sent; apply or cleanup", 2023-08-01T19:55:44.263 INFO:teuthology.orchestra.run.smithi008.stdout: "events": [ 2023-08-01T19:55:44.263 INFO:teuthology.orchestra.run.smithi008.stdout: { 2023-08-01T19:55:44.263 INFO:teuthology.orchestra.run.smithi008.stdout: "event": "initiated", 2023-08-01T19:55:44.264 INFO:teuthology.orchestra.run.smithi008.stdout: "time": "2023-08-01T19:55:05.567617+0000", 2023-08-01T19:55:44.264 INFO:teuthology.orchestra.run.smithi008.stdout: "duration": 0 2023-08-01T19:55:44.264 INFO:teuthology.orchestra.run.smithi008.stdout: }, 2023-08-01T19:55:44.264 INFO:teuthology.orchestra.run.smithi008.stdout: { 2023-08-01T19:55:44.264 INFO:teuthology.orchestra.run.smithi008.stdout: "event": "throttled", 2023-08-01T19:55:44.264 INFO:teuthology.orchestra.run.smithi008.stdout: "time": "2023-08-01T19:55:05.567617+0000", 2023-08-01T19:55:44.264 INFO:teuthology.orchestra.run.smithi008.stdout: "duration": 0 2023-08-01T19:55:44.265 INFO:teuthology.orchestra.run.smithi008.stdout: }, 2023-08-01T19:55:44.265 INFO:teuthology.orchestra.run.smithi008.stdout: { 2023-08-01T19:55:44.265 INFO:teuthology.orchestra.run.smithi008.stdout: "event": "header_read", 2023-08-01T19:55:44.265 INFO:teuthology.orchestra.run.smithi008.stdout: "time": "2023-08-01T19:55:05.567617+0000", 2023-08-01T19:55:44.265 INFO:teuthology.orchestra.run.smithi008.stdout: "duration": 4294967295.9999995 2023-08-01T19:55:44.265 INFO:teuthology.orchestra.run.smithi008.stdout: }, 2023-08-01T19:55:44.265 INFO:teuthology.orchestra.run.smithi008.stdout: { 2023-08-01T19:55:44.265 INFO:teuthology.orchestra.run.smithi008.stdout: "event": "all_read", 2023-08-01T19:55:44.266 INFO:teuthology.orchestra.run.smithi008.stdout: "time": "2023-08-01T19:55:05.567700+0000", 2023-08-01T19:55:44.266 INFO:teuthology.orchestra.run.smithi008.stdout: "duration": 8.3363999999999997e-05 2023-08-01T19:55:44.266 INFO:teuthology.orchestra.run.smithi008.stdout: }, 2023-08-01T19:55:44.266 INFO:teuthology.orchestra.run.smithi008.stdout: { 2023-08-01T19:55:44.266 INFO:teuthology.orchestra.run.smithi008.stdout: "event": "dispatched", 2023-08-01T19:55:44.266 INFO:teuthology.orchestra.run.smithi008.stdout: "time": "2023-08-01T19:55:05.567706+0000", 2023-08-01T19:55:44.266 INFO:teuthology.orchestra.run.smithi008.stdout: "duration": 5.9739999999999999e-06 2023-08-01T19:55:44.266 INFO:teuthology.orchestra.run.smithi008.stdout: }, 2023-08-01T19:55:44.267 INFO:teuthology.orchestra.run.smithi008.stdout: { 2023-08-01T19:55:44.267 INFO:teuthology.orchestra.run.smithi008.stdout: "event": "queued_for_pg", 2023-08-01T19:55:44.267 INFO:teuthology.orchestra.run.smithi008.stdout: "time": "2023-08-01T19:55:05.567709+0000", 2023-08-01T19:55:44.267 INFO:teuthology.orchestra.run.smithi008.stdout: "duration": 3.1420000000000002e-06 2023-08-01T19:55:44.267 INFO:teuthology.orchestra.run.smithi008.stdout: }, 2023-08-01T19:55:44.267 INFO:teuthology.orchestra.run.smithi008.stdout: { 2023-08-01T19:55:44.267 INFO:teuthology.orchestra.run.smithi008.stdout: "event": "reached_pg", 2023-08-01T19:55:44.267 INFO:teuthology.orchestra.run.smithi008.stdout: "time": "2023-08-01T19:55:05.567741+0000", 2023-08-01T19:55:44.268 INFO:teuthology.orchestra.run.smithi008.stdout: "duration": 3.1532999999999998e-05 2023-08-01T19:55:44.268 INFO:teuthology.orchestra.run.smithi008.stdout: }, 2023-08-01T19:55:44.268 INFO:teuthology.orchestra.run.smithi008.stdout: { 2023-08-01T19:55:44.268 INFO:teuthology.orchestra.run.smithi008.stdout: "event": "started", 2023-08-01T19:55:44.268 INFO:teuthology.orchestra.run.smithi008.stdout: "time": "2023-08-01T19:55:05.567752+0000", 2023-08-01T19:55:44.268 INFO:teuthology.orchestra.run.smithi008.stdout: "duration": 1.1266e-05 2023-08-01T19:55:44.268 INFO:teuthology.orchestra.run.smithi008.stdout: }, 2023-08-01T19:55:44.268 INFO:teuthology.orchestra.run.smithi008.stdout: { 2023-08-01T19:55:44.269 INFO:teuthology.orchestra.run.smithi008.stdout: "event": "commit_sent", 2023-08-01T19:55:44.269 INFO:teuthology.orchestra.run.smithi008.stdout: "time": "2023-08-01T19:55:05.630357+0000", 2023-08-01T19:55:44.269 INFO:teuthology.orchestra.run.smithi008.stdout: "duration": 0.062604554000000007 2023-08-01T19:55:44.269 INFO:teuthology.orchestra.run.smithi008.stdout: }, 2023-08-01T19:55:44.269 INFO:teuthology.orchestra.run.smithi008.stdout: { 2023-08-01T19:55:44.269 INFO:teuthology.orchestra.run.smithi008.stdout: "event": "done", 2023-08-01T19:55:44.269 INFO:teuthology.orchestra.run.smithi008.stdout: "time": "2023-08-01T19:55:05.630391+0000", 2023-08-01T19:55:44.269 INFO:teuthology.orchestra.run.smithi008.stdout: "duration": 3.4619000000000002e-05 2023-08-01T19:55:44.270 INFO:teuthology.orchestra.run.smithi008.stdout: } 2023-08-01T19:55:44.270 INFO:teuthology.orchestra.run.smithi008.stdout: ] 2023-08-01T19:55:44.270 INFO:teuthology.orchestra.run.smithi008.stdout: } 2023-08-01T19:55:44.270 INFO:teuthology.orchestra.run.smithi008.stdout: }, 2023-08-01T19:55:44.270 INFO:teuthology.orchestra.run.smithi008.stdout: { 2023-08-01T19:55:44.270 INFO:teuthology.orchestra.run.smithi008.stdout: "description": "osd_op(client.4668.0:100937 5.c 5:34445fc3:::benchmark_data_smithi006_114134_object100936:head [set-alloc-hint object_size 65536 write_size 65536,write 0~65536] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e37)", 2023-08-01T19:55:44.270 INFO:teuthology.orchestra.run.smithi008.stdout: "initiated_at": "2023-08-01T19:55:05.569198+0000", 2023-08-01T19:55:44.271 INFO:teuthology.orchestra.run.smithi008.stdout: "age": 38.593676537999997, 2023-08-01T19:55:44.271 INFO:teuthology.orchestra.run.smithi008.stdout: "duration": 0.063349390000000005, 2023-08-01T19:55:44.271 INFO:teuthology.orchestra.run.smithi008.stdout: "type_data": { 2023-08-01T19:55:44.271 INFO:teuthology.orchestra.run.smithi008.stdout: "flag_point": "commit sent; apply or cleanup", 2023-08-01T19:55:44.271 INFO:teuthology.orchestra.run.smithi008.stdout: "client_info": { 2023-08-01T19:55:44.271 INFO:teuthology.orchestra.run.smithi008.stdout: "client": "client.4668", 2023-08-01T19:55:44.271 INFO:teuthology.orchestra.run.smithi008.stdout: "client_addr": "172.21.15.6:0/1709472247", 2023-08-01T19:55:44.271 INFO:teuthology.orchestra.run.smithi008.stdout: "tid": 100937 2023-08-01T19:55:44.272 INFO:teuthology.orchestra.run.smithi008.stdout: }, 2023-08-01T19:55:44.272 INFO:teuthology.orchestra.run.smithi008.stdout: "events": [ 2023-08-01T19:55:44.272 INFO:teuthology.orchestra.run.smithi008.stdout: { 2023-08-01T19:55:44.272 INFO:teuthology.orchestra.run.smithi008.stdout: "event": "initiated", 2023-08-01T19:55:44.272 INFO:teuthology.orchestra.run.smithi008.stdout: "time": "2023-08-01T19:55:05.569198+0000", 2023-08-01T19:55:44.272 INFO:teuthology.orchestra.run.smithi008.stdout: "duration": 0 2023-08-01T19:55:44.272 INFO:teuthology.orchestra.run.smithi008.stdout: }, 2023-08-01T19:55:44.273 INFO:teuthology.orchestra.run.smithi008.stdout: { 2023-08-01T19:55:44.273 INFO:teuthology.orchestra.run.smithi008.stdout: "event": "throttled", 2023-08-01T19:55:44.273 INFO:teuthology.orchestra.run.smithi008.stdout: "time": "2023-08-01T19:55:05.569198+0000", 2023-08-01T19:55:44.273 INFO:teuthology.orchestra.run.smithi008.stdout: "duration": 0 2023-08-01T19:55:44.273 INFO:teuthology.orchestra.run.smithi008.stdout: }, 2023-08-01T19:55:44.273 INFO:teuthology.orchestra.run.smithi008.stdout: { 2023-08-01T19:55:44.273 INFO:teuthology.orchestra.run.smithi008.stdout: "event": "header_read", 2023-08-01T19:55:44.273 INFO:teuthology.orchestra.run.smithi008.stdout: "time": "2023-08-01T19:55:05.569197+0000", 2023-08-01T19:55:44.274 INFO:teuthology.orchestra.run.smithi008.stdout: "duration": 4294967295.999999 2023-08-01T19:55:44.274 INFO:teuthology.orchestra.run.smithi008.stdout: }, 2023-08-01T19:55:44.274 INFO:teuthology.orchestra.run.smithi008.stdout: { 2023-08-01T19:55:44.274 INFO:teuthology.orchestra.run.smithi008.stdout: "event": "all_read", 2023-08-01T19:55:44.274 INFO:teuthology.orchestra.run.smithi008.stdout: "time": "2023-08-01T19:55:05.569250+0000", 2023-08-01T19:55:44.274 INFO:teuthology.orchestra.run.smithi008.stdout: "duration": 5.3106000000000003e-05 2023-08-01T19:55:44.274 INFO:teuthology.orchestra.run.smithi008.stdout: }, 2023-08-01T19:55:44.274 INFO:teuthology.orchestra.run.smithi008.stdout: { 2023-08-01T19:55:44.275 INFO:teuthology.orchestra.run.smithi008.stdout: "event": "dispatched", 2023-08-01T19:55:44.275 INFO:teuthology.orchestra.run.smithi008.stdout: "time": "2023-08-01T19:55:05.569260+0000", 2023-08-01T19:55:44.275 INFO:teuthology.orchestra.run.smithi008.stdout: "duration": 9.533e-06 2023-08-01T19:55:44.275 INFO:teuthology.orchestra.run.smithi008.stdout: }, 2023-08-01T19:55:44.275 INFO:teuthology.orchestra.run.smithi008.stdout: { 2023-08-01T19:55:44.275 INFO:teuthology.orchestra.run.smithi008.stdout: "event": "queued_for_pg", 2023-08-01T19:55:44.275 INFO:teuthology.orchestra.run.smithi008.stdout: "time": "2023-08-01T19:55:05.569264+0000", 2023-08-01T19:55:44.275 INFO:teuthology.orchestra.run.smithi008.stdout: "duration": 4.6099999999999999e-06 2023-08-01T19:55:44.276 INFO:teuthology.orchestra.run.smithi008.stdout: }, 2023-08-01T19:55:44.276 INFO:teuthology.orchestra.run.smithi008.stdout: { 2023-08-01T19:55:44.276 INFO:teuthology.orchestra.run.smithi008.stdout: "event": "reached_pg", 2023-08-01T19:55:44.276 INFO:teuthology.orchestra.run.smithi008.stdout: "time": "2023-08-01T19:55:05.569293+0000", 2023-08-01T19:55:44.276 INFO:teuthology.orchestra.run.smithi008.stdout: "duration": 2.8181999999999999e-05 2023-08-01T19:55:44.276 INFO:teuthology.orchestra.run.smithi008.stdout: }, 2023-08-01T19:55:44.276 INFO:teuthology.orchestra.run.smithi008.stdout: { 2023-08-01T19:55:44.277 INFO:teuthology.orchestra.run.smithi008.stdout: "event": "started", 2023-08-01T19:55:44.277 INFO:teuthology.orchestra.run.smithi008.stdout: "time": "2023-08-01T19:55:05.569401+0000", 2023-08-01T19:55:44.277 INFO:teuthology.orchestra.run.smithi008.stdout: "duration": 0.000108065 2023-08-01T19:55:44.277 INFO:teuthology.orchestra.run.smithi008.stdout: }, 2023-08-01T19:55:44.277 INFO:teuthology.orchestra.run.smithi008.stdout: { 2023-08-01T19:55:44.277 INFO:teuthology.orchestra.run.smithi008.stdout: "event": "waiting for subops from 1", 2023-08-01T19:55:44.277 INFO:teuthology.orchestra.run.smithi008.stdout: "time": "2023-08-01T19:55:05.569521+0000", 2023-08-01T19:55:44.277 INFO:teuthology.orchestra.run.smithi008.stdout: "duration": 0.00012006900000000001 2023-08-01T19:55:44.278 INFO:teuthology.orchestra.run.smithi008.stdout: }, 2023-08-01T19:55:44.278 INFO:teuthology.orchestra.run.smithi008.stdout: { 2023-08-01T19:55:44.278 INFO:teuthology.orchestra.run.smithi008.stdout: "event": "sub_op_commit_rec", 2023-08-01T19:55:44.278 INFO:teuthology.orchestra.run.smithi008.stdout: "time": "2023-08-01T19:55:05.629421+0000", 2023-08-01T19:55:44.278 INFO:teuthology.orchestra.run.smithi008.stdout: "duration": 0.059900525000000003 2023-08-01T19:55:44.278 INFO:teuthology.orchestra.run.smithi008.stdout: }, 2023-08-01T19:55:44.278 INFO:teuthology.orchestra.run.smithi008.stdout: { 2023-08-01T19:55:44.278 INFO:teuthology.orchestra.run.smithi008.stdout: "event": "op_commit", 2023-08-01T19:55:44.279 INFO:teuthology.orchestra.run.smithi008.stdout: "time": "2023-08-01T19:55:05.632461+0000", 2023-08-01T19:55:44.279 INFO:teuthology.orchestra.run.smithi008.stdout: "duration": 0.0030401220000000001 2023-08-01T19:55:44.279 INFO:teuthology.orchestra.run.smithi008.stdout: }, 2023-08-01T19:55:44.279 INFO:teuthology.orchestra.run.smithi008.stdout: { 2023-08-01T19:55:44.279 INFO:teuthology.orchestra.run.smithi008.stdout: "event": "commit_sent", 2023-08-01T19:55:44.279 INFO:teuthology.orchestra.run.smithi008.stdout: "time": "2023-08-01T19:55:05.632507+0000", 2023-08-01T19:55:44.279 INFO:teuthology.orchestra.run.smithi008.stdout: "duration": 4.5361999999999997e-05 2023-08-01T19:55:44.279 INFO:teuthology.orchestra.run.smithi008.stdout: }, 2023-08-01T19:55:44.280 INFO:teuthology.orchestra.run.smithi008.stdout: { 2023-08-01T19:55:44.280 INFO:teuthology.orchestra.run.smithi008.stdout: "event": "done", 2023-08-01T19:55:44.280 INFO:teuthology.orchestra.run.smithi008.stdout: "time": "2023-08-01T19:55:05.632547+0000", 2023-08-01T19:55:44.280 INFO:teuthology.orchestra.run.smithi008.stdout: "duration": 4.0760999999999998e-05 2023-08-01T19:55:44.280 INFO:teuthology.orchestra.run.smithi008.stdout: } 2023-08-01T19:55:44.280 INFO:teuthology.orchestra.run.smithi008.stdout: ] 2023-08-01T19:55:44.280 INFO:teuthology.orchestra.run.smithi008.stdout: } 2023-08-01T19:55:44.280 INFO:teuthology.orchestra.run.smithi008.stdout: }, 2023-08-01T19:55:44.281 INFO:teuthology.orchestra.run.smithi008.stdout: { 2023-08-01T19:55:44.281 INFO:teuthology.orchestra.run.smithi008.stdout: "description": "osd_op(client.4668.0:100939 5.5 5:a75fa6e3:::benchmark_data_smithi006_114134_object100938:head [set-alloc-hint object_size 65536 write_size 65536,write 0~65536] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e37)", 2023-08-01T19:55:44.281 INFO:teuthology.orchestra.run.smithi008.stdout: "initiated_at": "2023-08-01T19:55:05.569740+0000", 2023-08-01T19:55:44.281 INFO:teuthology.orchestra.run.smithi008.stdout: "age": 38.593134996000003, 2023-08-01T19:55:44.281 INFO:teuthology.orchestra.run.smithi008.stdout: "duration": 0.067753412999999998, 2023-08-01T19:55:44.281 INFO:teuthology.orchestra.run.smithi008.stdout: "type_data": { 2023-08-01T19:55:44.281 INFO:teuthology.orchestra.run.smithi008.stdout: "flag_point": "commit sent; apply or cleanup", 2023-08-01T19:55:44.282 INFO:teuthology.orchestra.run.smithi008.stdout: "client_info": { 2023-08-01T19:55:44.282 INFO:teuthology.orchestra.run.smithi008.stdout: "client": "client.4668", 2023-08-01T19:55:44.282 INFO:teuthology.orchestra.run.smithi008.stdout: "client_addr": "172.21.15.6:0/1709472247", 2023-08-01T19:55:44.282 INFO:teuthology.orchestra.run.smithi008.stdout: "tid": 100939 2023-08-01T19:55:44.282 INFO:teuthology.orchestra.run.smithi008.stdout: }, 2023-08-01T19:55:44.282 INFO:teuthology.orchestra.run.smithi008.stdout: "events": [ 2023-08-01T19:55:44.282 INFO:teuthology.orchestra.run.smithi008.stdout: { 2023-08-01T19:55:44.282 INFO:teuthology.orchestra.run.smithi008.stdout: "event": "initiated", 2023-08-01T19:55:44.283 INFO:teuthology.orchestra.run.smithi008.stdout: "time": "2023-08-01T19:55:05.569740+0000", 2023-08-01T19:55:44.283 INFO:teuthology.orchestra.run.smithi008.stdout: "duration": 0 2023-08-01T19:55:44.283 INFO:teuthology.orchestra.run.smithi008.stdout: }, 2023-08-01T19:55:44.283 INFO:teuthology.orchestra.run.smithi008.stdout: { 2023-08-01T19:55:44.283 INFO:teuthology.orchestra.run.smithi008.stdout: "event": "throttled", 2023-08-01T19:55:44.283 INFO:teuthology.orchestra.run.smithi008.stdout: "time": "2023-08-01T19:55:05.569740+0000", 2023-08-01T19:55:44.283 INFO:teuthology.orchestra.run.smithi008.stdout: "duration": 0 2023-08-01T19:55:44.283 INFO:teuthology.orchestra.run.smithi008.stdout: }, 2023-08-01T19:55:44.284 INFO:teuthology.orchestra.run.smithi008.stdout: { 2023-08-01T19:55:44.284 INFO:teuthology.orchestra.run.smithi008.stdout: "event": "header_read", 2023-08-01T19:55:44.284 INFO:teuthology.orchestra.run.smithi008.stdout: "time": "2023-08-01T19:55:05.569739+0000", 2023-08-01T19:55:44.284 INFO:teuthology.orchestra.run.smithi008.stdout: "duration": 4294967295.9999995 2023-08-01T19:55:44.284 INFO:teuthology.orchestra.run.smithi008.stdout: }, 2023-08-01T19:55:44.284 INFO:teuthology.orchestra.run.smithi008.stdout: { 2023-08-01T19:55:44.284 INFO:teuthology.orchestra.run.smithi008.stdout: "event": "all_read", 2023-08-01T19:55:44.284 INFO:teuthology.orchestra.run.smithi008.stdout: "time": "2023-08-01T19:55:05.569839+0000", 2023-08-01T19:55:44.285 INFO:teuthology.orchestra.run.smithi008.stdout: "duration": 0.000100219 2023-08-01T19:55:44.285 INFO:teuthology.orchestra.run.smithi008.stdout: }, 2023-08-01T19:55:44.285 INFO:teuthology.orchestra.run.smithi008.stdout: { 2023-08-01T19:55:44.285 INFO:teuthology.orchestra.run.smithi008.stdout: "event": "dispatched", 2023-08-01T19:55:44.285 INFO:teuthology.orchestra.run.smithi008.stdout: "time": "2023-08-01T19:55:05.569846+0000", 2023-08-01T19:55:44.285 INFO:teuthology.orchestra.run.smithi008.stdout: "duration": 7.3150000000000003e-06 2023-08-01T19:55:44.286 INFO:teuthology.orchestra.run.smithi008.stdout: }, 2023-08-01T19:55:44.286 INFO:teuthology.orchestra.run.smithi008.stdout: { 2023-08-01T19:55:44.286 INFO:teuthology.orchestra.run.smithi008.stdout: "event": "queued_for_pg", 2023-08-01T19:55:44.286 INFO:teuthology.orchestra.run.smithi008.stdout: "time": "2023-08-01T19:55:05.569850+0000", 2023-08-01T19:55:44.286 INFO:teuthology.orchestra.run.smithi008.stdout: "duration": 3.3299999999999999e-06 2023-08-01T19:55:44.286 INFO:teuthology.orchestra.run.smithi008.stdout: }, 2023-08-01T19:55:44.286 INFO:teuthology.orchestra.run.smithi008.stdout: { 2023-08-01T19:55:44.286 INFO:teuthology.orchestra.run.smithi008.stdout: "event": "reached_pg", 2023-08-01T19:55:44.287 INFO:teuthology.orchestra.run.smithi008.stdout: "time": "2023-08-01T19:55:05.626991+0000", 2023-08-01T19:55:44.287 INFO:teuthology.orchestra.run.smithi008.stdout: "duration": 0.057141585000000002 2023-08-01T19:55:44.287 INFO:teuthology.orchestra.run.smithi008.stdout: }, 2023-08-01T19:55:44.287 INFO:teuthology.orchestra.run.smithi008.stdout: { 2023-08-01T19:55:44.287 INFO:teuthology.orchestra.run.smithi008.stdout: "event": "started", 2023-08-01T19:55:44.287 INFO:teuthology.orchestra.run.smithi008.stdout: "time": "2023-08-01T19:55:05.627111+0000", 2023-08-01T19:55:44.287 INFO:teuthology.orchestra.run.smithi008.stdout: "duration": 0.000119238 2023-08-01T19:55:44.287 INFO:teuthology.orchestra.run.smithi008.stdout: }, 2023-08-01T19:55:44.288 INFO:teuthology.orchestra.run.smithi008.stdout: { 2023-08-01T19:55:44.288 INFO:teuthology.orchestra.run.smithi008.stdout: "event": "waiting for subops from 1", 2023-08-01T19:55:44.288 INFO:teuthology.orchestra.run.smithi008.stdout: "time": "2023-08-01T19:55:05.627253+0000", 2023-08-01T19:55:44.288 INFO:teuthology.orchestra.run.smithi008.stdout: "duration": 0.000142822 2023-08-01T19:55:44.288 INFO:teuthology.orchestra.run.smithi008.stdout: }, 2023-08-01T19:55:44.288 INFO:teuthology.orchestra.run.smithi008.stdout: { 2023-08-01T19:55:44.288 INFO:teuthology.orchestra.run.smithi008.stdout: "event": "op_commit", 2023-08-01T19:55:44.289 INFO:teuthology.orchestra.run.smithi008.stdout: "time": "2023-08-01T19:55:05.632555+0000", 2023-08-01T19:55:44.289 INFO:teuthology.orchestra.run.smithi008.stdout: "duration": 0.0053012449999999996 2023-08-01T19:55:44.289 INFO:teuthology.orchestra.run.smithi008.stdout: }, 2023-08-01T19:55:44.289 INFO:teuthology.orchestra.run.smithi008.stdout: { 2023-08-01T19:55:44.289 INFO:teuthology.orchestra.run.smithi008.stdout: "event": "sub_op_commit_rec", 2023-08-01T19:55:44.289 INFO:teuthology.orchestra.run.smithi008.stdout: "time": "2023-08-01T19:55:05.637380+0000", 2023-08-01T19:55:44.289 INFO:teuthology.orchestra.run.smithi008.stdout: "duration": 0.0048257639999999997 2023-08-01T19:55:44.289 INFO:teuthology.orchestra.run.smithi008.stdout: }, 2023-08-01T19:55:44.290 INFO:teuthology.orchestra.run.smithi008.stdout: { 2023-08-01T19:55:44.290 INFO:teuthology.orchestra.run.smithi008.stdout: "event": "commit_sent", 2023-08-01T19:55:44.290 INFO:teuthology.orchestra.run.smithi008.stdout: "time": "2023-08-01T19:55:05.637454+0000", 2023-08-01T19:55:44.290 INFO:teuthology.orchestra.run.smithi008.stdout: "duration": 7.3578999999999995e-05 2023-08-01T19:55:44.290 INFO:teuthology.orchestra.run.smithi008.stdout: }, 2023-08-01T19:55:44.290 INFO:teuthology.orchestra.run.smithi008.stdout: { 2023-08-01T19:55:44.290 INFO:teuthology.orchestra.run.smithi008.stdout: "event": "done", 2023-08-01T19:55:44.290 INFO:teuthology.orchestra.run.smithi008.stdout: "time": "2023-08-01T19:55:05.637493+0000", 2023-08-01T19:55:44.291 INFO:teuthology.orchestra.run.smithi008.stdout: "duration": 3.8986999999999998e-05 2023-08-01T19:55:44.291 INFO:teuthology.orchestra.run.smithi008.stdout: } 2023-08-01T19:55:44.291 INFO:teuthology.orchestra.run.smithi008.stdout: ] 2023-08-01T19:55:44.291 INFO:teuthology.orchestra.run.smithi008.stdout: } 2023-08-01T19:55:44.291 INFO:teuthology.orchestra.run.smithi008.stdout: }, 2023-08-01T19:55:44.291 INFO:teuthology.orchestra.run.smithi008.stdout: { 2023-08-01T19:55:44.291 INFO:teuthology.orchestra.run.smithi008.stdout: "description": "osd_repop(client.4668.0:100941 5.e e37/19 5:736a6ac6:::benchmark_data_smithi006_114134_object100940:head v 37'6306, mlcod=37'6303)", 2023-08-01T19:55:44.291 INFO:teuthology.orchestra.run.smithi008.stdout: "initiated_at": "2023-08-01T19:55:05.570237+0000", 2023-08-01T19:55:44.292 INFO:teuthology.orchestra.run.smithi008.stdout: "age": 38.592637686000003, 2023-08-01T19:55:44.292 INFO:teuthology.orchestra.run.smithi008.stdout: "duration": 0.064830421999999999, 2023-08-01T19:55:44.292 INFO:teuthology.orchestra.run.smithi008.stdout: "type_data": { 2023-08-01T19:55:44.292 INFO:teuthology.orchestra.run.smithi008.stdout: "flag_point": "commit sent; apply or cleanup", 2023-08-01T19:55:44.292 INFO:teuthology.orchestra.run.smithi008.stdout: "events": [ 2023-08-01T19:55:44.292 INFO:teuthology.orchestra.run.smithi008.stdout: { 2023-08-01T19:55:44.292 INFO:teuthology.orchestra.run.smithi008.stdout: "event": "initiated", 2023-08-01T19:55:44.293 INFO:teuthology.orchestra.run.smithi008.stdout: "time": "2023-08-01T19:55:05.570237+0000", 2023-08-01T19:55:44.293 INFO:teuthology.orchestra.run.smithi008.stdout: "duration": 0 2023-08-01T19:55:44.293 INFO:teuthology.orchestra.run.smithi008.stdout: }, 2023-08-01T19:55:44.293 INFO:teuthology.orchestra.run.smithi008.stdout: { 2023-08-01T19:55:44.293 INFO:teuthology.orchestra.run.smithi008.stdout: "event": "throttled", 2023-08-01T19:55:44.293 INFO:teuthology.orchestra.run.smithi008.stdout: "time": "2023-08-01T19:55:05.570237+0000", 2023-08-01T19:55:44.293 INFO:teuthology.orchestra.run.smithi008.stdout: "duration": 0 2023-08-01T19:55:44.293 INFO:teuthology.orchestra.run.smithi008.stdout: }, 2023-08-01T19:55:44.294 INFO:teuthology.orchestra.run.smithi008.stdout: { 2023-08-01T19:55:44.294 INFO:teuthology.orchestra.run.smithi008.stdout: "event": "header_read", 2023-08-01T19:55:44.294 INFO:teuthology.orchestra.run.smithi008.stdout: "time": "2023-08-01T19:55:05.570236+0000", 2023-08-01T19:55:44.294 INFO:teuthology.orchestra.run.smithi008.stdout: "duration": 4294967295.9999995 2023-08-01T19:55:44.294 INFO:teuthology.orchestra.run.smithi008.stdout: }, 2023-08-01T19:55:44.294 INFO:teuthology.orchestra.run.smithi008.stdout: { 2023-08-01T19:55:44.294 INFO:teuthology.orchestra.run.smithi008.stdout: "event": "all_read", 2023-08-01T19:55:44.294 INFO:teuthology.orchestra.run.smithi008.stdout: "time": "2023-08-01T19:55:05.570354+0000", 2023-08-01T19:55:44.295 INFO:teuthology.orchestra.run.smithi008.stdout: "duration": 0.000118029 2023-08-01T19:55:44.295 INFO:teuthology.orchestra.run.smithi008.stdout: }, 2023-08-01T19:55:44.295 INFO:teuthology.orchestra.run.smithi008.stdout: { 2023-08-01T19:55:44.295 INFO:teuthology.orchestra.run.smithi008.stdout: "event": "dispatched", 2023-08-01T19:55:44.295 INFO:teuthology.orchestra.run.smithi008.stdout: "time": "2023-08-01T19:55:05.626649+0000", 2023-08-01T19:55:44.295 INFO:teuthology.orchestra.run.smithi008.stdout: "duration": 0.056294489000000003 2023-08-01T19:55:44.295 INFO:teuthology.orchestra.run.smithi008.stdout: }, 2023-08-01T19:55:44.295 INFO:teuthology.orchestra.run.smithi008.stdout: { 2023-08-01T19:55:44.296 INFO:teuthology.orchestra.run.smithi008.stdout: "event": "queued_for_pg", 2023-08-01T19:55:44.296 INFO:teuthology.orchestra.run.smithi008.stdout: "time": "2023-08-01T19:55:05.626676+0000", 2023-08-01T19:55:44.296 INFO:teuthology.orchestra.run.smithi008.stdout: "duration": 2.7228000000000001e-05 2023-08-01T19:55:44.296 INFO:teuthology.orchestra.run.smithi008.stdout: }, 2023-08-01T19:55:44.296 INFO:teuthology.orchestra.run.smithi008.stdout: { 2023-08-01T19:55:44.296 INFO:teuthology.orchestra.run.smithi008.stdout: "event": "reached_pg", 2023-08-01T19:55:44.296 INFO:teuthology.orchestra.run.smithi008.stdout: "time": "2023-08-01T19:55:05.626717+0000", 2023-08-01T19:55:44.297 INFO:teuthology.orchestra.run.smithi008.stdout: "duration": 4.1318e-05 2023-08-01T19:55:44.297 INFO:teuthology.orchestra.run.smithi008.stdout: }, 2023-08-01T19:55:44.297 INFO:teuthology.orchestra.run.smithi008.stdout: { 2023-08-01T19:55:44.297 INFO:teuthology.orchestra.run.smithi008.stdout: "event": "started", 2023-08-01T19:55:44.297 INFO:teuthology.orchestra.run.smithi008.stdout: "time": "2023-08-01T19:55:05.626737+0000", 2023-08-01T19:55:44.297 INFO:teuthology.orchestra.run.smithi008.stdout: "duration": 1.9415e-05 2023-08-01T19:55:44.297 INFO:teuthology.orchestra.run.smithi008.stdout: }, 2023-08-01T19:55:44.297 INFO:teuthology.orchestra.run.smithi008.stdout: { 2023-08-01T19:55:44.298 INFO:teuthology.orchestra.run.smithi008.stdout: "event": "commit_sent", 2023-08-01T19:55:44.298 INFO:teuthology.orchestra.run.smithi008.stdout: "time": "2023-08-01T19:55:05.635036+0000", 2023-08-01T19:55:44.298 INFO:teuthology.orchestra.run.smithi008.stdout: "duration": 0.0082987700000000005 2023-08-01T19:55:44.298 INFO:teuthology.orchestra.run.smithi008.stdout: }, 2023-08-01T19:55:44.298 INFO:teuthology.orchestra.run.smithi008.stdout: { 2023-08-01T19:55:44.298 INFO:teuthology.orchestra.run.smithi008.stdout: "event": "done", 2023-08-01T19:55:44.298 INFO:teuthology.orchestra.run.smithi008.stdout: "time": "2023-08-01T19:55:05.635067+0000", 2023-08-01T19:55:44.298 INFO:teuthology.orchestra.run.smithi008.stdout: "duration": 3.1786999999999999e-05 2023-08-01T19:55:44.299 INFO:teuthology.orchestra.run.smithi008.stdout: } 2023-08-01T19:55:44.299 INFO:teuthology.orchestra.run.smithi008.stdout: ] 2023-08-01T19:55:44.299 INFO:teuthology.orchestra.run.smithi008.stdout: } 2023-08-01T19:55:44.299 INFO:teuthology.orchestra.run.smithi008.stdout: }, 2023-08-01T19:55:44.299 INFO:teuthology.orchestra.run.smithi008.stdout: { 2023-08-01T19:55:44.299 INFO:teuthology.orchestra.run.smithi008.stdout: "description": "osd_op(client.4668.0:107863 5.3 5:cbdd875a:::benchmark_data_smithi006_114134_object107862:head [set-alloc-hint object_size 65536 write_size 65536,write 0~65536] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e38)", 2023-08-01T19:55:44.299 INFO:teuthology.orchestra.run.smithi008.stdout: "initiated_at": "2023-08-01T19:55:09.278851+0000", 2023-08-01T19:55:44.299 INFO:teuthology.orchestra.run.smithi008.stdout: "age": 34.884023255999999, 2023-08-01T19:55:44.300 INFO:teuthology.orchestra.run.smithi008.stdout: "duration": 0.071378853000000006, 2023-08-01T19:55:44.300 INFO:teuthology.orchestra.run.smithi008.stdout: "type_data": { 2023-08-01T19:55:44.300 INFO:teuthology.orchestra.run.smithi008.stdout: "flag_point": "commit sent; apply or cleanup", 2023-08-01T19:55:44.300 INFO:teuthology.orchestra.run.smithi008.stdout: "client_info": { 2023-08-01T19:55:44.300 INFO:teuthology.orchestra.run.smithi008.stdout: "client": "client.4668", 2023-08-01T19:55:44.300 INFO:teuthology.orchestra.run.smithi008.stdout: "client_addr": "172.21.15.6:0/1709472247", 2023-08-01T19:55:44.300 INFO:teuthology.orchestra.run.smithi008.stdout: "tid": 107863 2023-08-01T19:55:44.300 INFO:teuthology.orchestra.run.smithi008.stdout: }, 2023-08-01T19:55:44.301 INFO:teuthology.orchestra.run.smithi008.stdout: "events": [ 2023-08-01T19:55:44.301 INFO:teuthology.orchestra.run.smithi008.stdout: { 2023-08-01T19:55:44.301 INFO:teuthology.orchestra.run.smithi008.stdout: "event": "initiated", 2023-08-01T19:55:44.301 INFO:teuthology.orchestra.run.smithi008.stdout: "time": "2023-08-01T19:55:09.278851+0000", 2023-08-01T19:55:44.301 INFO:teuthology.orchestra.run.smithi008.stdout: "duration": 0 2023-08-01T19:55:44.301 INFO:teuthology.orchestra.run.smithi008.stdout: }, 2023-08-01T19:55:44.301 INFO:teuthology.orchestra.run.smithi008.stdout: { 2023-08-01T19:55:44.301 INFO:teuthology.orchestra.run.smithi008.stdout: "event": "throttled", 2023-08-01T19:55:44.302 INFO:teuthology.orchestra.run.smithi008.stdout: "time": "2023-08-01T19:55:09.278851+0000", 2023-08-01T19:55:44.302 INFO:teuthology.orchestra.run.smithi008.stdout: "duration": 0 2023-08-01T19:55:44.302 INFO:teuthology.orchestra.run.smithi008.stdout: }, 2023-08-01T19:55:44.302 INFO:teuthology.orchestra.run.smithi008.stdout: { 2023-08-01T19:55:44.302 INFO:teuthology.orchestra.run.smithi008.stdout: "event": "header_read", 2023-08-01T19:55:44.302 INFO:teuthology.orchestra.run.smithi008.stdout: "time": "2023-08-01T19:55:09.278850+0000", 2023-08-01T19:55:44.302 INFO:teuthology.orchestra.run.smithi008.stdout: "duration": 4294967295.999999 2023-08-01T19:55:44.303 INFO:teuthology.orchestra.run.smithi008.stdout: }, 2023-08-01T19:55:44.303 INFO:teuthology.orchestra.run.smithi008.stdout: { 2023-08-01T19:55:44.303 INFO:teuthology.orchestra.run.smithi008.stdout: "event": "all_read", 2023-08-01T19:55:44.303 INFO:teuthology.orchestra.run.smithi008.stdout: "time": "2023-08-01T19:55:09.278945+0000", 2023-08-01T19:55:44.303 INFO:teuthology.orchestra.run.smithi008.stdout: "duration": 9.4388000000000005e-05 2023-08-01T19:55:44.303 INFO:teuthology.orchestra.run.smithi008.stdout: }, 2023-08-01T19:55:44.303 INFO:teuthology.orchestra.run.smithi008.stdout: { 2023-08-01T19:55:44.303 INFO:teuthology.orchestra.run.smithi008.stdout: "event": "dispatched", 2023-08-01T19:55:44.304 INFO:teuthology.orchestra.run.smithi008.stdout: "time": "2023-08-01T19:55:09.278955+0000", 2023-08-01T19:55:44.304 INFO:teuthology.orchestra.run.smithi008.stdout: "duration": 1.0413e-05 2023-08-01T19:55:44.304 INFO:teuthology.orchestra.run.smithi008.stdout: }, 2023-08-01T19:55:44.304 INFO:teuthology.orchestra.run.smithi008.stdout: { 2023-08-01T19:55:44.304 INFO:teuthology.orchestra.run.smithi008.stdout: "event": "queued_for_pg", 2023-08-01T19:55:44.304 INFO:teuthology.orchestra.run.smithi008.stdout: "time": "2023-08-01T19:55:09.278962+0000", 2023-08-01T19:55:44.304 INFO:teuthology.orchestra.run.smithi008.stdout: "duration": 6.2169999999999999e-06 2023-08-01T19:55:44.304 INFO:teuthology.orchestra.run.smithi008.stdout: }, 2023-08-01T19:55:44.305 INFO:teuthology.orchestra.run.smithi008.stdout: { 2023-08-01T19:55:44.305 INFO:teuthology.orchestra.run.smithi008.stdout: "event": "reached_pg", 2023-08-01T19:55:44.305 INFO:teuthology.orchestra.run.smithi008.stdout: "time": "2023-08-01T19:55:09.280363+0000", 2023-08-01T19:55:44.305 INFO:teuthology.orchestra.run.smithi008.stdout: "duration": 0.0014014489999999999 2023-08-01T19:55:44.305 INFO:teuthology.orchestra.run.smithi008.stdout: }, 2023-08-01T19:55:44.305 INFO:teuthology.orchestra.run.smithi008.stdout: { 2023-08-01T19:55:44.305 INFO:teuthology.orchestra.run.smithi008.stdout: "event": "started", 2023-08-01T19:55:44.305 INFO:teuthology.orchestra.run.smithi008.stdout: "time": "2023-08-01T19:55:09.280488+0000", 2023-08-01T19:55:44.306 INFO:teuthology.orchestra.run.smithi008.stdout: "duration": 0.00012474099999999999 2023-08-01T19:55:44.306 INFO:teuthology.orchestra.run.smithi008.stdout: }, 2023-08-01T19:55:44.306 INFO:teuthology.orchestra.run.smithi008.stdout: { 2023-08-01T19:55:44.306 INFO:teuthology.orchestra.run.smithi008.stdout: "event": "waiting for subops from 1", 2023-08-01T19:55:44.306 INFO:teuthology.orchestra.run.smithi008.stdout: "time": "2023-08-01T19:55:09.280626+0000", 2023-08-01T19:55:44.306 INFO:teuthology.orchestra.run.smithi008.stdout: "duration": 0.000138193 2023-08-01T19:55:44.306 INFO:teuthology.orchestra.run.smithi008.stdout: }, 2023-08-01T19:55:44.306 INFO:teuthology.orchestra.run.smithi008.stdout: { 2023-08-01T19:55:44.307 INFO:teuthology.orchestra.run.smithi008.stdout: "event": "op_commit", 2023-08-01T19:55:44.307 INFO:teuthology.orchestra.run.smithi008.stdout: "time": "2023-08-01T19:55:09.285958+0000", 2023-08-01T19:55:44.307 INFO:teuthology.orchestra.run.smithi008.stdout: "duration": 0.0053317130000000001 2023-08-01T19:55:44.307 INFO:teuthology.orchestra.run.smithi008.stdout: }, 2023-08-01T19:55:44.307 INFO:teuthology.orchestra.run.smithi008.stdout: { 2023-08-01T19:55:44.307 INFO:teuthology.orchestra.run.smithi008.stdout: "event": "sub_op_commit_rec", 2023-08-01T19:55:44.307 INFO:teuthology.orchestra.run.smithi008.stdout: "time": "2023-08-01T19:55:09.350151+0000", 2023-08-01T19:55:44.307 INFO:teuthology.orchestra.run.smithi008.stdout: "duration": 0.064193202000000005 2023-08-01T19:55:44.308 INFO:teuthology.orchestra.run.smithi008.stdout: }, 2023-08-01T19:55:44.308 INFO:teuthology.orchestra.run.smithi008.stdout: { 2023-08-01T19:55:44.308 INFO:teuthology.orchestra.run.smithi008.stdout: "event": "commit_sent", 2023-08-01T19:55:44.308 INFO:teuthology.orchestra.run.smithi008.stdout: "time": "2023-08-01T19:55:09.350188+0000", 2023-08-01T19:55:44.308 INFO:teuthology.orchestra.run.smithi008.stdout: "duration": 3.7549999999999998e-05 2023-08-01T19:55:44.308 INFO:teuthology.orchestra.run.smithi008.stdout: }, 2023-08-01T19:55:44.308 INFO:teuthology.orchestra.run.smithi008.stdout: { 2023-08-01T19:55:44.309 INFO:teuthology.orchestra.run.smithi008.stdout: "event": "done", 2023-08-01T19:55:44.309 INFO:teuthology.orchestra.run.smithi008.stdout: "time": "2023-08-01T19:55:09.350230+0000", 2023-08-01T19:55:44.309 INFO:teuthology.orchestra.run.smithi008.stdout: "duration": 4.1804999999999997e-05 2023-08-01T19:55:44.309 INFO:teuthology.orchestra.run.smithi008.stdout: } 2023-08-01T19:55:44.309 INFO:teuthology.orchestra.run.smithi008.stdout: ] 2023-08-01T19:55:44.309 INFO:teuthology.orchestra.run.smithi008.stdout: } 2023-08-01T19:55:44.309 INFO:teuthology.orchestra.run.smithi008.stdout: }, 2023-08-01T19:55:44.309 INFO:teuthology.orchestra.run.smithi008.stdout: { 2023-08-01T19:55:44.310 INFO:teuthology.orchestra.run.smithi008.stdout: "description": "osd_op(client.4668.0:107865 5.3 5:c2ebb96d:::benchmark_data_smithi006_114134_object107864:head [set-alloc-hint object_size 65536 write_size 65536,write 0~65536] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e38)", 2023-08-01T19:55:44.310 INFO:teuthology.orchestra.run.smithi008.stdout: "initiated_at": "2023-08-01T19:55:09.279020+0000", 2023-08-01T19:55:44.310 INFO:teuthology.orchestra.run.smithi008.stdout: "age": 34.883854583999998, 2023-08-01T19:55:44.310 INFO:teuthology.orchestra.run.smithi008.stdout: "duration": 0.072892565000000006, 2023-08-01T19:55:44.310 INFO:teuthology.orchestra.run.smithi008.stdout: "type_data": { 2023-08-01T19:55:44.310 INFO:teuthology.orchestra.run.smithi008.stdout: "flag_point": "commit sent; apply or cleanup", 2023-08-01T19:55:44.310 INFO:teuthology.orchestra.run.smithi008.stdout: "client_info": { 2023-08-01T19:55:44.310 INFO:teuthology.orchestra.run.smithi008.stdout: "client": "client.4668", 2023-08-01T19:55:44.311 INFO:teuthology.orchestra.run.smithi008.stdout: "client_addr": "172.21.15.6:0/1709472247", 2023-08-01T19:55:44.311 INFO:teuthology.orchestra.run.smithi008.stdout: "tid": 107865 2023-08-01T19:55:44.311 INFO:teuthology.orchestra.run.smithi008.stdout: }, 2023-08-01T19:55:44.311 INFO:teuthology.orchestra.run.smithi008.stdout: "events": [ 2023-08-01T19:55:44.311 INFO:teuthology.orchestra.run.smithi008.stdout: { 2023-08-01T19:55:44.311 INFO:teuthology.orchestra.run.smithi008.stdout: "event": "initiated", 2023-08-01T19:55:44.311 INFO:teuthology.orchestra.run.smithi008.stdout: "time": "2023-08-01T19:55:09.279020+0000", 2023-08-01T19:55:44.311 INFO:teuthology.orchestra.run.smithi008.stdout: "duration": 0 2023-08-01T19:55:44.312 INFO:teuthology.orchestra.run.smithi008.stdout: }, 2023-08-01T19:55:44.312 INFO:teuthology.orchestra.run.smithi008.stdout: { 2023-08-01T19:55:44.312 INFO:teuthology.orchestra.run.smithi008.stdout: "event": "throttled", 2023-08-01T19:55:44.312 INFO:teuthology.orchestra.run.smithi008.stdout: "time": "2023-08-01T19:55:09.279020+0000", 2023-08-01T19:55:44.312 INFO:teuthology.orchestra.run.smithi008.stdout: "duration": 0 2023-08-01T19:55:44.312 INFO:teuthology.orchestra.run.smithi008.stdout: }, 2023-08-01T19:55:44.312 INFO:teuthology.orchestra.run.smithi008.stdout: { 2023-08-01T19:55:44.313 INFO:teuthology.orchestra.run.smithi008.stdout: "event": "header_read", 2023-08-01T19:55:44.313 INFO:teuthology.orchestra.run.smithi008.stdout: "time": "2023-08-01T19:55:09.279019+0000", 2023-08-01T19:55:44.313 INFO:teuthology.orchestra.run.smithi008.stdout: "duration": 4294967295.999999 2023-08-01T19:55:44.313 INFO:teuthology.orchestra.run.smithi008.stdout: }, 2023-08-01T19:55:44.313 INFO:teuthology.orchestra.run.smithi008.stdout: { 2023-08-01T19:55:44.313 INFO:teuthology.orchestra.run.smithi008.stdout: "event": "all_read", 2023-08-01T19:55:44.313 INFO:teuthology.orchestra.run.smithi008.stdout: "time": "2023-08-01T19:55:09.279087+0000", 2023-08-01T19:55:44.313 INFO:teuthology.orchestra.run.smithi008.stdout: "duration": 6.8392000000000005e-05 2023-08-01T19:55:44.314 INFO:teuthology.orchestra.run.smithi008.stdout: }, 2023-08-01T19:55:44.314 INFO:teuthology.orchestra.run.smithi008.stdout: { 2023-08-01T19:55:44.314 INFO:teuthology.orchestra.run.smithi008.stdout: "event": "dispatched", 2023-08-01T19:55:44.314 INFO:teuthology.orchestra.run.smithi008.stdout: "time": "2023-08-01T19:55:09.279095+0000", 2023-08-01T19:55:44.314 INFO:teuthology.orchestra.run.smithi008.stdout: "duration": 8.0989999999999999e-06 2023-08-01T19:55:44.314 INFO:teuthology.orchestra.run.smithi008.stdout: }, 2023-08-01T19:55:44.314 INFO:teuthology.orchestra.run.smithi008.stdout: { 2023-08-01T19:55:44.314 INFO:teuthology.orchestra.run.smithi008.stdout: "event": "queued_for_pg", 2023-08-01T19:55:44.315 INFO:teuthology.orchestra.run.smithi008.stdout: "time": "2023-08-01T19:55:09.279101+0000", 2023-08-01T19:55:44.315 INFO:teuthology.orchestra.run.smithi008.stdout: "duration": 5.0390000000000004e-06 2023-08-01T19:55:44.315 INFO:teuthology.orchestra.run.smithi008.stdout: }, 2023-08-01T19:55:44.315 INFO:teuthology.orchestra.run.smithi008.stdout: { 2023-08-01T19:55:44.315 INFO:teuthology.orchestra.run.smithi008.stdout: "event": "reached_pg", 2023-08-01T19:55:44.315 INFO:teuthology.orchestra.run.smithi008.stdout: "time": "2023-08-01T19:55:09.282574+0000", 2023-08-01T19:55:44.315 INFO:teuthology.orchestra.run.smithi008.stdout: "duration": 0.0034730619999999999 2023-08-01T19:55:44.315 INFO:teuthology.orchestra.run.smithi008.stdout: }, 2023-08-01T19:55:44.316 INFO:teuthology.orchestra.run.smithi008.stdout: { 2023-08-01T19:55:44.316 INFO:teuthology.orchestra.run.smithi008.stdout: "event": "started", 2023-08-01T19:55:44.316 INFO:teuthology.orchestra.run.smithi008.stdout: "time": "2023-08-01T19:55:09.282705+0000", 2023-08-01T19:55:44.316 INFO:teuthology.orchestra.run.smithi008.stdout: "duration": 0.00013133400000000001 2023-08-01T19:55:44.316 INFO:teuthology.orchestra.run.smithi008.stdout: }, 2023-08-01T19:55:44.316 INFO:teuthology.orchestra.run.smithi008.stdout: { 2023-08-01T19:55:44.316 INFO:teuthology.orchestra.run.smithi008.stdout: "event": "waiting for subops from 1", 2023-08-01T19:55:44.316 INFO:teuthology.orchestra.run.smithi008.stdout: "time": "2023-08-01T19:55:09.283067+0000", 2023-08-01T19:55:44.317 INFO:teuthology.orchestra.run.smithi008.stdout: "duration": 0.00036195299999999998 2023-08-01T19:55:44.317 INFO:teuthology.orchestra.run.smithi008.stdout: }, 2023-08-01T19:55:44.317 INFO:teuthology.orchestra.run.smithi008.stdout: { 2023-08-01T19:55:44.317 INFO:teuthology.orchestra.run.smithi008.stdout: "event": "op_commit", 2023-08-01T19:55:44.317 INFO:teuthology.orchestra.run.smithi008.stdout: "time": "2023-08-01T19:55:09.288196+0000", 2023-08-01T19:55:44.317 INFO:teuthology.orchestra.run.smithi008.stdout: "duration": 0.0051293780000000004 2023-08-01T19:55:44.317 INFO:teuthology.orchestra.run.smithi008.stdout: }, 2023-08-01T19:55:44.318 INFO:teuthology.orchestra.run.smithi008.stdout: { 2023-08-01T19:55:44.318 INFO:teuthology.orchestra.run.smithi008.stdout: "event": "sub_op_commit_rec", 2023-08-01T19:55:44.318 INFO:teuthology.orchestra.run.smithi008.stdout: "time": "2023-08-01T19:55:09.351832+0000", 2023-08-01T19:55:44.318 INFO:teuthology.orchestra.run.smithi008.stdout: "duration": 0.063636076 2023-08-01T19:55:44.318 INFO:teuthology.orchestra.run.smithi008.stdout: }, 2023-08-01T19:55:44.318 INFO:teuthology.orchestra.run.smithi008.stdout: { 2023-08-01T19:55:44.318 INFO:teuthology.orchestra.run.smithi008.stdout: "event": "commit_sent", 2023-08-01T19:55:44.318 INFO:teuthology.orchestra.run.smithi008.stdout: "time": "2023-08-01T19:55:09.351878+0000", 2023-08-01T19:55:44.319 INFO:teuthology.orchestra.run.smithi008.stdout: "duration": 4.5408999999999998e-05 2023-08-01T19:55:44.319 INFO:teuthology.orchestra.run.smithi008.stdout: }, 2023-08-01T19:55:44.319 INFO:teuthology.orchestra.run.smithi008.stdout: { 2023-08-01T19:55:44.319 INFO:teuthology.orchestra.run.smithi008.stdout: "event": "done", 2023-08-01T19:55:44.319 INFO:teuthology.orchestra.run.smithi008.stdout: "time": "2023-08-01T19:55:09.351913+0000", 2023-08-01T19:55:44.319 INFO:teuthology.orchestra.run.smithi008.stdout: "duration": 3.4808999999999998e-05 2023-08-01T19:55:44.319 INFO:teuthology.orchestra.run.smithi008.stdout: } 2023-08-01T19:55:44.319 INFO:teuthology.orchestra.run.smithi008.stdout: ] 2023-08-01T19:55:44.320 INFO:teuthology.orchestra.run.smithi008.stdout: } 2023-08-01T19:55:44.320 INFO:teuthology.orchestra.run.smithi008.stdout: }, 2023-08-01T19:55:44.320 INFO:teuthology.orchestra.run.smithi008.stdout: { 2023-08-01T19:55:44.320 INFO:teuthology.orchestra.run.smithi008.stdout: "description": "osd_op(client.4668.0:107869 5.c 5:31910384:::benchmark_data_smithi006_114134_object107868:head [set-alloc-hint object_size 65536 write_size 65536,write 0~65536] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e38)", 2023-08-01T19:55:44.320 INFO:teuthology.orchestra.run.smithi008.stdout: "initiated_at": "2023-08-01T19:55:09.283205+0000", 2023-08-01T19:55:44.320 INFO:teuthology.orchestra.run.smithi008.stdout: "age": 34.879669419000003, 2023-08-01T19:55:44.320 INFO:teuthology.orchestra.run.smithi008.stdout: "duration": 0.068611808999999996, 2023-08-01T19:55:44.320 INFO:teuthology.orchestra.run.smithi008.stdout: "type_data": { 2023-08-01T19:55:44.321 INFO:teuthology.orchestra.run.smithi008.stdout: "flag_point": "commit sent; apply or cleanup", 2023-08-01T19:55:44.321 INFO:teuthology.orchestra.run.smithi008.stdout: "client_info": { 2023-08-01T19:55:44.321 INFO:teuthology.orchestra.run.smithi008.stdout: "client": "client.4668", 2023-08-01T19:55:44.321 INFO:teuthology.orchestra.run.smithi008.stdout: "client_addr": "172.21.15.6:0/1709472247", 2023-08-01T19:55:44.321 INFO:teuthology.orchestra.run.smithi008.stdout: "tid": 107869 2023-08-01T19:55:44.321 INFO:teuthology.orchestra.run.smithi008.stdout: }, 2023-08-01T19:55:44.321 INFO:teuthology.orchestra.run.smithi008.stdout: "events": [ 2023-08-01T19:55:44.321 INFO:teuthology.orchestra.run.smithi008.stdout: { 2023-08-01T19:55:44.322 INFO:teuthology.orchestra.run.smithi008.stdout: "event": "initiated", 2023-08-01T19:55:44.322 INFO:teuthology.orchestra.run.smithi008.stdout: "time": "2023-08-01T19:55:09.283205+0000", 2023-08-01T19:55:44.322 INFO:teuthology.orchestra.run.smithi008.stdout: "duration": 0 2023-08-01T19:55:44.322 INFO:teuthology.orchestra.run.smithi008.stdout: }, 2023-08-01T19:55:44.322 INFO:teuthology.orchestra.run.smithi008.stdout: { 2023-08-01T19:55:44.322 INFO:teuthology.orchestra.run.smithi008.stdout: "event": "throttled", 2023-08-01T19:55:44.322 INFO:teuthology.orchestra.run.smithi008.stdout: "time": "2023-08-01T19:55:09.283205+0000", 2023-08-01T19:55:44.323 INFO:teuthology.orchestra.run.smithi008.stdout: "duration": 0 2023-08-01T19:55:44.323 INFO:teuthology.orchestra.run.smithi008.stdout: }, 2023-08-01T19:55:44.323 INFO:teuthology.orchestra.run.smithi008.stdout: { 2023-08-01T19:55:44.323 INFO:teuthology.orchestra.run.smithi008.stdout: "event": "header_read", 2023-08-01T19:55:44.323 INFO:teuthology.orchestra.run.smithi008.stdout: "time": "2023-08-01T19:55:09.283204+0000", 2023-08-01T19:55:44.323 INFO:teuthology.orchestra.run.smithi008.stdout: "duration": 4294967295.999999 2023-08-01T19:55:44.323 INFO:teuthology.orchestra.run.smithi008.stdout: }, 2023-08-01T19:55:44.323 INFO:teuthology.orchestra.run.smithi008.stdout: { 2023-08-01T19:55:44.324 INFO:teuthology.orchestra.run.smithi008.stdout: "event": "all_read", 2023-08-01T19:55:44.324 INFO:teuthology.orchestra.run.smithi008.stdout: "time": "2023-08-01T19:55:09.283300+0000", 2023-08-01T19:55:44.324 INFO:teuthology.orchestra.run.smithi008.stdout: "duration": 9.6280000000000007e-05 2023-08-01T19:55:44.324 INFO:teuthology.orchestra.run.smithi008.stdout: }, 2023-08-01T19:55:44.324 INFO:teuthology.orchestra.run.smithi008.stdout: { 2023-08-01T19:55:44.324 INFO:teuthology.orchestra.run.smithi008.stdout: "event": "dispatched", 2023-08-01T19:55:44.324 INFO:teuthology.orchestra.run.smithi008.stdout: "time": "2023-08-01T19:55:09.283314+0000", 2023-08-01T19:55:44.324 INFO:teuthology.orchestra.run.smithi008.stdout: "duration": 1.3344e-05 2023-08-01T19:55:44.325 INFO:teuthology.orchestra.run.smithi008.stdout: }, 2023-08-01T19:55:44.325 INFO:teuthology.orchestra.run.smithi008.stdout: { 2023-08-01T19:55:44.325 INFO:teuthology.orchestra.run.smithi008.stdout: "event": "queued_for_pg", 2023-08-01T19:55:44.325 INFO:teuthology.orchestra.run.smithi008.stdout: "time": "2023-08-01T19:55:09.283320+0000", 2023-08-01T19:55:44.325 INFO:teuthology.orchestra.run.smithi008.stdout: "duration": 6.0299999999999999e-06 2023-08-01T19:55:44.325 INFO:teuthology.orchestra.run.smithi008.stdout: }, 2023-08-01T19:55:44.325 INFO:teuthology.orchestra.run.smithi008.stdout: { 2023-08-01T19:55:44.325 INFO:teuthology.orchestra.run.smithi008.stdout: "event": "reached_pg", 2023-08-01T19:55:44.326 INFO:teuthology.orchestra.run.smithi008.stdout: "time": "2023-08-01T19:55:09.283365+0000", 2023-08-01T19:55:44.326 INFO:teuthology.orchestra.run.smithi008.stdout: "duration": 4.5578999999999998e-05 2023-08-01T19:55:44.326 INFO:teuthology.orchestra.run.smithi008.stdout: }, 2023-08-01T19:55:44.326 INFO:teuthology.orchestra.run.smithi008.stdout: { 2023-08-01T19:55:44.326 INFO:teuthology.orchestra.run.smithi008.stdout: "event": "started", 2023-08-01T19:55:44.326 INFO:teuthology.orchestra.run.smithi008.stdout: "time": "2023-08-01T19:55:09.283490+0000", 2023-08-01T19:55:44.326 INFO:teuthology.orchestra.run.smithi008.stdout: "duration": 0.00012473700000000001 2023-08-01T19:55:44.326 INFO:teuthology.orchestra.run.smithi008.stdout: }, 2023-08-01T19:55:44.327 INFO:teuthology.orchestra.run.smithi008.stdout: { 2023-08-01T19:55:44.327 INFO:teuthology.orchestra.run.smithi008.stdout: "event": "waiting for subops from 1", 2023-08-01T19:55:44.327 INFO:teuthology.orchestra.run.smithi008.stdout: "time": "2023-08-01T19:55:09.283637+0000", 2023-08-01T19:55:44.327 INFO:teuthology.orchestra.run.smithi008.stdout: "duration": 0.00014715600000000001 2023-08-01T19:55:44.327 INFO:teuthology.orchestra.run.smithi008.stdout: }, 2023-08-01T19:55:44.327 INFO:teuthology.orchestra.run.smithi008.stdout: { 2023-08-01T19:55:44.327 INFO:teuthology.orchestra.run.smithi008.stdout: "event": "op_commit", 2023-08-01T19:55:44.327 INFO:teuthology.orchestra.run.smithi008.stdout: "time": "2023-08-01T19:55:09.288214+0000", 2023-08-01T19:55:44.328 INFO:teuthology.orchestra.run.smithi008.stdout: "duration": 0.0045769560000000001 2023-08-01T19:55:44.328 INFO:teuthology.orchestra.run.smithi008.stdout: }, 2023-08-01T19:55:44.328 INFO:teuthology.orchestra.run.smithi008.stdout: { 2023-08-01T19:55:44.328 INFO:teuthology.orchestra.run.smithi008.stdout: "event": "sub_op_commit_rec", 2023-08-01T19:55:44.328 INFO:teuthology.orchestra.run.smithi008.stdout: "time": "2023-08-01T19:55:09.351721+0000", 2023-08-01T19:55:44.328 INFO:teuthology.orchestra.run.smithi008.stdout: "duration": 0.063507383000000001 2023-08-01T19:55:44.328 INFO:teuthology.orchestra.run.smithi008.stdout: }, 2023-08-01T19:55:44.329 INFO:teuthology.orchestra.run.smithi008.stdout: { 2023-08-01T19:55:44.329 INFO:teuthology.orchestra.run.smithi008.stdout: "event": "commit_sent", 2023-08-01T19:55:44.329 INFO:teuthology.orchestra.run.smithi008.stdout: "time": "2023-08-01T19:55:09.351777+0000", 2023-08-01T19:55:44.329 INFO:teuthology.orchestra.run.smithi008.stdout: "duration": 5.5733999999999999e-05 2023-08-01T19:55:44.329 INFO:teuthology.orchestra.run.smithi008.stdout: }, 2023-08-01T19:55:44.329 INFO:teuthology.orchestra.run.smithi008.stdout: { 2023-08-01T19:55:44.329 INFO:teuthology.orchestra.run.smithi008.stdout: "event": "done", 2023-08-01T19:55:44.329 INFO:teuthology.orchestra.run.smithi008.stdout: "time": "2023-08-01T19:55:09.351817+0000", 2023-08-01T19:55:44.330 INFO:teuthology.orchestra.run.smithi008.stdout: "duration": 3.9765000000000003e-05 2023-08-01T19:55:44.330 INFO:teuthology.orchestra.run.smithi008.stdout: } 2023-08-01T19:55:44.330 INFO:teuthology.orchestra.run.smithi008.stdout: ] 2023-08-01T19:55:44.330 INFO:teuthology.orchestra.run.smithi008.stdout: } 2023-08-01T19:55:44.330 INFO:teuthology.orchestra.run.smithi008.stdout: }, 2023-08-01T19:55:44.330 INFO:teuthology.orchestra.run.smithi008.stdout: { 2023-08-01T19:55:44.330 INFO:teuthology.orchestra.run.smithi008.stdout: "description": "osd_op(client.4668.0:107874 5.3 5:ce4c2799:::benchmark_data_smithi006_114134_object107873:head [set-alloc-hint object_size 65536 write_size 65536,write 0~65536] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e38)", 2023-08-01T19:55:44.330 INFO:teuthology.orchestra.run.smithi008.stdout: "initiated_at": "2023-08-01T19:55:09.286239+0000", 2023-08-01T19:55:44.331 INFO:teuthology.orchestra.run.smithi008.stdout: "age": 34.876635913999998, 2023-08-01T19:55:44.331 INFO:teuthology.orchestra.run.smithi008.stdout: "duration": 0.068224389999999996, 2023-08-01T19:55:44.331 INFO:teuthology.orchestra.run.smithi008.stdout: "type_data": { 2023-08-01T19:55:44.331 INFO:teuthology.orchestra.run.smithi008.stdout: "flag_point": "commit sent; apply or cleanup", 2023-08-01T19:55:44.331 INFO:teuthology.orchestra.run.smithi008.stdout: "client_info": { 2023-08-01T19:55:44.331 INFO:teuthology.orchestra.run.smithi008.stdout: "client": "client.4668", 2023-08-01T19:55:44.331 INFO:teuthology.orchestra.run.smithi008.stdout: "client_addr": "172.21.15.6:0/1709472247", 2023-08-01T19:55:44.331 INFO:teuthology.orchestra.run.smithi008.stdout: "tid": 107874 2023-08-01T19:55:44.332 INFO:teuthology.orchestra.run.smithi008.stdout: }, 2023-08-01T19:55:44.332 INFO:teuthology.orchestra.run.smithi008.stdout: "events": [ 2023-08-01T19:55:44.332 INFO:teuthology.orchestra.run.smithi008.stdout: { 2023-08-01T19:55:44.332 INFO:teuthology.orchestra.run.smithi008.stdout: "event": "initiated", 2023-08-01T19:55:44.332 INFO:teuthology.orchestra.run.smithi008.stdout: "time": "2023-08-01T19:55:09.286239+0000", 2023-08-01T19:55:44.332 INFO:teuthology.orchestra.run.smithi008.stdout: "duration": 0 2023-08-01T19:55:44.332 INFO:teuthology.orchestra.run.smithi008.stdout: }, 2023-08-01T19:55:44.333 INFO:teuthology.orchestra.run.smithi008.stdout: { 2023-08-01T19:55:44.333 INFO:teuthology.orchestra.run.smithi008.stdout: "event": "throttled", 2023-08-01T19:55:44.333 INFO:teuthology.orchestra.run.smithi008.stdout: "time": "2023-08-01T19:55:09.286239+0000", 2023-08-01T19:55:44.333 INFO:teuthology.orchestra.run.smithi008.stdout: "duration": 0 2023-08-01T19:55:44.333 INFO:teuthology.orchestra.run.smithi008.stdout: }, 2023-08-01T19:55:44.333 INFO:teuthology.orchestra.run.smithi008.stdout: { 2023-08-01T19:55:44.333 INFO:teuthology.orchestra.run.smithi008.stdout: "event": "header_read", 2023-08-01T19:55:44.333 INFO:teuthology.orchestra.run.smithi008.stdout: "time": "2023-08-01T19:55:09.286238+0000", 2023-08-01T19:55:44.334 INFO:teuthology.orchestra.run.smithi008.stdout: "duration": 4294967295.999999 2023-08-01T19:55:44.334 INFO:teuthology.orchestra.run.smithi008.stdout: }, 2023-08-01T19:55:44.334 INFO:teuthology.orchestra.run.smithi008.stdout: { 2023-08-01T19:55:44.334 INFO:teuthology.orchestra.run.smithi008.stdout: "event": "all_read", 2023-08-01T19:55:44.334 INFO:teuthology.orchestra.run.smithi008.stdout: "time": "2023-08-01T19:55:09.286310+0000", 2023-08-01T19:55:44.334 INFO:teuthology.orchestra.run.smithi008.stdout: "duration": 7.2583999999999995e-05 2023-08-01T19:55:44.334 INFO:teuthology.orchestra.run.smithi008.stdout: }, 2023-08-01T19:55:44.334 INFO:teuthology.orchestra.run.smithi008.stdout: { 2023-08-01T19:55:44.335 INFO:teuthology.orchestra.run.smithi008.stdout: "event": "dispatched", 2023-08-01T19:55:44.335 INFO:teuthology.orchestra.run.smithi008.stdout: "time": "2023-08-01T19:55:09.286323+0000", 2023-08-01T19:55:44.335 INFO:teuthology.orchestra.run.smithi008.stdout: "duration": 1.3151e-05 2023-08-01T19:55:44.335 INFO:teuthology.orchestra.run.smithi008.stdout: }, 2023-08-01T19:55:44.335 INFO:teuthology.orchestra.run.smithi008.stdout: { 2023-08-01T19:55:44.335 INFO:teuthology.orchestra.run.smithi008.stdout: "event": "queued_for_pg", 2023-08-01T19:55:44.335 INFO:teuthology.orchestra.run.smithi008.stdout: "time": "2023-08-01T19:55:09.286329+0000", 2023-08-01T19:55:44.335 INFO:teuthology.orchestra.run.smithi008.stdout: "duration": 5.8719999999999999e-06 2023-08-01T19:55:44.336 INFO:teuthology.orchestra.run.smithi008.stdout: }, 2023-08-01T19:55:44.336 INFO:teuthology.orchestra.run.smithi008.stdout: { 2023-08-01T19:55:44.336 INFO:teuthology.orchestra.run.smithi008.stdout: "event": "reached_pg", 2023-08-01T19:55:44.336 INFO:teuthology.orchestra.run.smithi008.stdout: "time": "2023-08-01T19:55:09.286392+0000", 2023-08-01T19:55:44.336 INFO:teuthology.orchestra.run.smithi008.stdout: "duration": 6.2378000000000005e-05 2023-08-01T19:55:44.336 INFO:teuthology.orchestra.run.smithi008.stdout: }, 2023-08-01T19:55:44.336 INFO:teuthology.orchestra.run.smithi008.stdout: { 2023-08-01T19:55:44.336 INFO:teuthology.orchestra.run.smithi008.stdout: "event": "started", 2023-08-01T19:55:44.337 INFO:teuthology.orchestra.run.smithi008.stdout: "time": "2023-08-01T19:55:09.286473+0000", 2023-08-01T19:55:44.337 INFO:teuthology.orchestra.run.smithi008.stdout: "duration": 8.1327000000000002e-05 2023-08-01T19:55:44.337 INFO:teuthology.orchestra.run.smithi008.stdout: }, 2023-08-01T19:55:44.337 INFO:teuthology.orchestra.run.smithi008.stdout: { 2023-08-01T19:55:44.337 INFO:teuthology.orchestra.run.smithi008.stdout: "event": "waiting for subops from 1", 2023-08-01T19:55:44.337 INFO:teuthology.orchestra.run.smithi008.stdout: "time": "2023-08-01T19:55:09.286557+0000", 2023-08-01T19:55:44.337 INFO:teuthology.orchestra.run.smithi008.stdout: "duration": 8.4140000000000004e-05 2023-08-01T19:55:44.338 INFO:teuthology.orchestra.run.smithi008.stdout: }, 2023-08-01T19:55:44.338 INFO:teuthology.orchestra.run.smithi008.stdout: { 2023-08-01T19:55:44.338 INFO:teuthology.orchestra.run.smithi008.stdout: "event": "op_commit", 2023-08-01T19:55:44.338 INFO:teuthology.orchestra.run.smithi008.stdout: "time": "2023-08-01T19:55:09.290681+0000", 2023-08-01T19:55:44.338 INFO:teuthology.orchestra.run.smithi008.stdout: "duration": 0.0041242420000000002 2023-08-01T19:55:44.338 INFO:teuthology.orchestra.run.smithi008.stdout: }, 2023-08-01T19:55:44.338 INFO:teuthology.orchestra.run.smithi008.stdout: { 2023-08-01T19:55:44.338 INFO:teuthology.orchestra.run.smithi008.stdout: "event": "sub_op_commit_rec", 2023-08-01T19:55:44.339 INFO:teuthology.orchestra.run.smithi008.stdout: "time": "2023-08-01T19:55:09.354372+0000", 2023-08-01T19:55:44.339 INFO:teuthology.orchestra.run.smithi008.stdout: "duration": 0.063690438000000002 2023-08-01T19:55:44.339 INFO:teuthology.orchestra.run.smithi008.stdout: }, 2023-08-01T19:55:44.339 INFO:teuthology.orchestra.run.smithi008.stdout: { 2023-08-01T19:55:44.339 INFO:teuthology.orchestra.run.smithi008.stdout: "event": "commit_sent", 2023-08-01T19:55:44.339 INFO:teuthology.orchestra.run.smithi008.stdout: "time": "2023-08-01T19:55:09.354421+0000", 2023-08-01T19:55:44.339 INFO:teuthology.orchestra.run.smithi008.stdout: "duration": 4.9413000000000003e-05 2023-08-01T19:55:44.339 INFO:teuthology.orchestra.run.smithi008.stdout: }, 2023-08-01T19:55:44.340 INFO:teuthology.orchestra.run.smithi008.stdout: { 2023-08-01T19:55:44.340 INFO:teuthology.orchestra.run.smithi008.stdout: "event": "done", 2023-08-01T19:55:44.340 INFO:teuthology.orchestra.run.smithi008.stdout: "time": "2023-08-01T19:55:09.354463+0000", 2023-08-01T19:55:44.340 INFO:teuthology.orchestra.run.smithi008.stdout: "duration": 4.1924e-05 2023-08-01T19:55:44.340 INFO:teuthology.orchestra.run.smithi008.stdout: } 2023-08-01T19:55:44.340 INFO:teuthology.orchestra.run.smithi008.stdout: ] 2023-08-01T19:55:44.340 INFO:teuthology.orchestra.run.smithi008.stdout: } 2023-08-01T19:55:44.340 INFO:teuthology.orchestra.run.smithi008.stdout: }, 2023-08-01T19:55:44.341 INFO:teuthology.orchestra.run.smithi008.stdout: { 2023-08-01T19:55:44.341 INFO:teuthology.orchestra.run.smithi008.stdout: "description": "osd_op(client.4668.0:107875 5.5 5:af4ec927:::benchmark_data_smithi006_114134_object107874:head [set-alloc-hint object_size 65536 write_size 65536,write 0~65536] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e38)", 2023-08-01T19:55:44.341 INFO:teuthology.orchestra.run.smithi008.stdout: "initiated_at": "2023-08-01T19:55:09.287186+0000", 2023-08-01T19:55:44.341 INFO:teuthology.orchestra.run.smithi008.stdout: "age": 34.875688126999997, 2023-08-01T19:55:44.341 INFO:teuthology.orchestra.run.smithi008.stdout: "duration": 0.064764719999999998, 2023-08-01T19:55:44.341 INFO:teuthology.orchestra.run.smithi008.stdout: "type_data": { 2023-08-01T19:55:44.341 INFO:teuthology.orchestra.run.smithi008.stdout: "flag_point": "commit sent; apply or cleanup", 2023-08-01T19:55:44.341 INFO:teuthology.orchestra.run.smithi008.stdout: "client_info": { 2023-08-01T19:55:44.342 INFO:teuthology.orchestra.run.smithi008.stdout: "client": "client.4668", 2023-08-01T19:55:44.342 INFO:teuthology.orchestra.run.smithi008.stdout: "client_addr": "172.21.15.6:0/1709472247", 2023-08-01T19:55:44.342 INFO:teuthology.orchestra.run.smithi008.stdout: "tid": 107875 2023-08-01T19:55:44.342 INFO:teuthology.orchestra.run.smithi008.stdout: }, 2023-08-01T19:55:44.342 INFO:teuthology.orchestra.run.smithi008.stdout: "events": [ 2023-08-01T19:55:44.342 INFO:teuthology.orchestra.run.smithi008.stdout: { 2023-08-01T19:55:44.342 INFO:teuthology.orchestra.run.smithi008.stdout: "event": "initiated", 2023-08-01T19:55:44.342 INFO:teuthology.orchestra.run.smithi008.stdout: "time": "2023-08-01T19:55:09.287186+0000", 2023-08-01T19:55:44.343 INFO:teuthology.orchestra.run.smithi008.stdout: "duration": 0 2023-08-01T19:55:44.343 INFO:teuthology.orchestra.run.smithi008.stdout: }, 2023-08-01T19:55:44.343 INFO:teuthology.orchestra.run.smithi008.stdout: { 2023-08-01T19:55:44.343 INFO:teuthology.orchestra.run.smithi008.stdout: "event": "throttled", 2023-08-01T19:55:44.343 INFO:teuthology.orchestra.run.smithi008.stdout: "time": "2023-08-01T19:55:09.287186+0000", 2023-08-01T19:55:44.343 INFO:teuthology.orchestra.run.smithi008.stdout: "duration": 0 2023-08-01T19:55:44.343 INFO:teuthology.orchestra.run.smithi008.stdout: }, 2023-08-01T19:55:44.343 INFO:teuthology.orchestra.run.smithi008.stdout: { 2023-08-01T19:55:44.344 INFO:teuthology.orchestra.run.smithi008.stdout: "event": "header_read", 2023-08-01T19:55:44.344 INFO:teuthology.orchestra.run.smithi008.stdout: "time": "2023-08-01T19:55:09.287186+0000", 2023-08-01T19:55:44.344 INFO:teuthology.orchestra.run.smithi008.stdout: "duration": 4294967295.999999 2023-08-01T19:55:44.344 INFO:teuthology.orchestra.run.smithi008.stdout: }, 2023-08-01T19:55:44.344 INFO:teuthology.orchestra.run.smithi008.stdout: { 2023-08-01T19:55:44.344 INFO:teuthology.orchestra.run.smithi008.stdout: "event": "all_read", 2023-08-01T19:55:44.344 INFO:teuthology.orchestra.run.smithi008.stdout: "time": "2023-08-01T19:55:09.287248+0000", 2023-08-01T19:55:44.345 INFO:teuthology.orchestra.run.smithi008.stdout: "duration": 6.2922000000000005e-05 2023-08-01T19:55:44.345 INFO:teuthology.orchestra.run.smithi008.stdout: }, 2023-08-01T19:55:44.345 INFO:teuthology.orchestra.run.smithi008.stdout: { 2023-08-01T19:55:44.345 INFO:teuthology.orchestra.run.smithi008.stdout: "event": "dispatched", 2023-08-01T19:55:44.345 INFO:teuthology.orchestra.run.smithi008.stdout: "time": "2023-08-01T19:55:09.287261+0000", 2023-08-01T19:55:44.345 INFO:teuthology.orchestra.run.smithi008.stdout: "duration": 1.2364000000000001e-05 2023-08-01T19:55:44.345 INFO:teuthology.orchestra.run.smithi008.stdout: }, 2023-08-01T19:55:44.345 INFO:teuthology.orchestra.run.smithi008.stdout: { 2023-08-01T19:55:44.346 INFO:teuthology.orchestra.run.smithi008.stdout: "event": "queued_for_pg", 2023-08-01T19:55:44.346 INFO:teuthology.orchestra.run.smithi008.stdout: "time": "2023-08-01T19:55:09.287267+0000", 2023-08-01T19:55:44.346 INFO:teuthology.orchestra.run.smithi008.stdout: "duration": 6.2580000000000001e-06 2023-08-01T19:55:44.346 INFO:teuthology.orchestra.run.smithi008.stdout: }, 2023-08-01T19:55:44.346 INFO:teuthology.orchestra.run.smithi008.stdout: { 2023-08-01T19:55:44.346 INFO:teuthology.orchestra.run.smithi008.stdout: "event": "reached_pg", 2023-08-01T19:55:44.346 INFO:teuthology.orchestra.run.smithi008.stdout: "time": "2023-08-01T19:55:09.287306+0000", 2023-08-01T19:55:44.346 INFO:teuthology.orchestra.run.smithi008.stdout: "duration": 3.9057999999999998e-05 2023-08-01T19:55:44.347 INFO:teuthology.orchestra.run.smithi008.stdout: }, 2023-08-01T19:55:44.347 INFO:teuthology.orchestra.run.smithi008.stdout: { 2023-08-01T19:55:44.347 INFO:teuthology.orchestra.run.smithi008.stdout: "event": "started", 2023-08-01T19:55:44.347 INFO:teuthology.orchestra.run.smithi008.stdout: "time": "2023-08-01T19:55:09.287419+0000", 2023-08-01T19:55:44.347 INFO:teuthology.orchestra.run.smithi008.stdout: "duration": 0.000112843 2023-08-01T19:55:44.347 INFO:teuthology.orchestra.run.smithi008.stdout: }, 2023-08-01T19:55:44.347 INFO:teuthology.orchestra.run.smithi008.stdout: { 2023-08-01T19:55:44.347 INFO:teuthology.orchestra.run.smithi008.stdout: "event": "waiting for subops from 1", 2023-08-01T19:55:44.348 INFO:teuthology.orchestra.run.smithi008.stdout: "time": "2023-08-01T19:55:09.287514+0000", 2023-08-01T19:55:44.348 INFO:teuthology.orchestra.run.smithi008.stdout: "duration": 9.5068000000000005e-05 2023-08-01T19:55:44.348 INFO:teuthology.orchestra.run.smithi008.stdout: }, 2023-08-01T19:55:44.348 INFO:teuthology.orchestra.run.smithi008.stdout: { 2023-08-01T19:55:44.348 INFO:teuthology.orchestra.run.smithi008.stdout: "event": "op_commit", 2023-08-01T19:55:44.348 INFO:teuthology.orchestra.run.smithi008.stdout: "time": "2023-08-01T19:55:09.293891+0000", 2023-08-01T19:55:44.348 INFO:teuthology.orchestra.run.smithi008.stdout: "duration": 0.00637712 2023-08-01T19:55:44.348 INFO:teuthology.orchestra.run.smithi008.stdout: }, 2023-08-01T19:55:44.349 INFO:teuthology.orchestra.run.smithi008.stdout: { 2023-08-01T19:55:44.349 INFO:teuthology.orchestra.run.smithi008.stdout: "event": "sub_op_commit_rec", 2023-08-01T19:55:44.349 INFO:teuthology.orchestra.run.smithi008.stdout: "time": "2023-08-01T19:55:09.351871+0000", 2023-08-01T19:55:44.349 INFO:teuthology.orchestra.run.smithi008.stdout: "duration": 0.057980054000000003 2023-08-01T19:55:44.349 INFO:teuthology.orchestra.run.smithi008.stdout: }, 2023-08-01T19:55:44.349 INFO:teuthology.orchestra.run.smithi008.stdout: { 2023-08-01T19:55:44.349 INFO:teuthology.orchestra.run.smithi008.stdout: "event": "commit_sent", 2023-08-01T19:55:44.349 INFO:teuthology.orchestra.run.smithi008.stdout: "time": "2023-08-01T19:55:09.351917+0000", 2023-08-01T19:55:44.350 INFO:teuthology.orchestra.run.smithi008.stdout: "duration": 4.5501999999999999e-05 2023-08-01T19:55:44.350 INFO:teuthology.orchestra.run.smithi008.stdout: }, 2023-08-01T19:55:44.350 INFO:teuthology.orchestra.run.smithi008.stdout: { 2023-08-01T19:55:44.350 INFO:teuthology.orchestra.run.smithi008.stdout: "event": "done", 2023-08-01T19:55:44.350 INFO:teuthology.orchestra.run.smithi008.stdout: "time": "2023-08-01T19:55:09.351951+0000", 2023-08-01T19:55:44.350 INFO:teuthology.orchestra.run.smithi008.stdout: "duration": 3.4450999999999999e-05 2023-08-01T19:55:44.350 INFO:teuthology.orchestra.run.smithi008.stdout: } 2023-08-01T19:55:44.350 INFO:teuthology.orchestra.run.smithi008.stdout: ] 2023-08-01T19:55:44.351 INFO:teuthology.orchestra.run.smithi008.stdout: } 2023-08-01T19:55:44.351 INFO:teuthology.orchestra.run.smithi008.stdout: }, 2023-08-01T19:55:44.351 INFO:teuthology.orchestra.run.smithi008.stdout: { 2023-08-01T19:55:44.351 INFO:teuthology.orchestra.run.smithi008.stdout: "description": "osd_op(client.4668.0:107880 5.5 5:a8d12d4b:::benchmark_data_smithi006_114134_object107879:head [set-alloc-hint object_size 65536 write_size 65536,write 0~65536] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e38)", 2023-08-01T19:55:44.351 INFO:teuthology.orchestra.run.smithi008.stdout: "initiated_at": "2023-08-01T19:55:09.292335+0000", 2023-08-01T19:55:44.351 INFO:teuthology.orchestra.run.smithi008.stdout: "age": 34.870539526000002, 2023-08-01T19:55:44.351 INFO:teuthology.orchestra.run.smithi008.stdout: "duration": 0.061350719999999997, 2023-08-01T19:55:44.352 INFO:teuthology.orchestra.run.smithi008.stdout: "type_data": { 2023-08-01T19:55:44.352 INFO:teuthology.orchestra.run.smithi008.stdout: "flag_point": "commit sent; apply or cleanup", 2023-08-01T19:55:44.352 INFO:teuthology.orchestra.run.smithi008.stdout: "client_info": { 2023-08-01T19:55:44.352 INFO:teuthology.orchestra.run.smithi008.stdout: "client": "client.4668", 2023-08-01T19:55:44.352 INFO:teuthology.orchestra.run.smithi008.stdout: "client_addr": "172.21.15.6:0/1709472247", 2023-08-01T19:55:44.352 INFO:teuthology.orchestra.run.smithi008.stdout: "tid": 107880 2023-08-01T19:55:44.352 INFO:teuthology.orchestra.run.smithi008.stdout: }, 2023-08-01T19:55:44.352 INFO:teuthology.orchestra.run.smithi008.stdout: "events": [ 2023-08-01T19:55:44.353 INFO:teuthology.orchestra.run.smithi008.stdout: { 2023-08-01T19:55:44.353 INFO:teuthology.orchestra.run.smithi008.stdout: "event": "initiated", 2023-08-01T19:55:44.353 INFO:teuthology.orchestra.run.smithi008.stdout: "time": "2023-08-01T19:55:09.292335+0000", 2023-08-01T19:55:44.353 INFO:teuthology.orchestra.run.smithi008.stdout: "duration": 0 2023-08-01T19:55:44.353 INFO:teuthology.orchestra.run.smithi008.stdout: }, 2023-08-01T19:55:44.353 INFO:teuthology.orchestra.run.smithi008.stdout: { 2023-08-01T19:55:44.353 INFO:teuthology.orchestra.run.smithi008.stdout: "event": "throttled", 2023-08-01T19:55:44.353 INFO:teuthology.orchestra.run.smithi008.stdout: "time": "2023-08-01T19:55:09.292335+0000", 2023-08-01T19:55:44.354 INFO:teuthology.orchestra.run.smithi008.stdout: "duration": 0 2023-08-01T19:55:44.354 INFO:teuthology.orchestra.run.smithi008.stdout: }, 2023-08-01T19:55:44.354 INFO:teuthology.orchestra.run.smithi008.stdout: { 2023-08-01T19:55:44.354 INFO:teuthology.orchestra.run.smithi008.stdout: "event": "header_read", 2023-08-01T19:55:44.354 INFO:teuthology.orchestra.run.smithi008.stdout: "time": "2023-08-01T19:55:09.292334+0000", 2023-08-01T19:55:44.354 INFO:teuthology.orchestra.run.smithi008.stdout: "duration": 4294967295.999999 2023-08-01T19:55:44.354 INFO:teuthology.orchestra.run.smithi008.stdout: }, 2023-08-01T19:55:44.354 INFO:teuthology.orchestra.run.smithi008.stdout: { 2023-08-01T19:55:44.355 INFO:teuthology.orchestra.run.smithi008.stdout: "event": "all_read", 2023-08-01T19:55:44.355 INFO:teuthology.orchestra.run.smithi008.stdout: "time": "2023-08-01T19:55:09.292449+0000", 2023-08-01T19:55:44.355 INFO:teuthology.orchestra.run.smithi008.stdout: "duration": 0.00011551400000000001 2023-08-01T19:55:44.355 INFO:teuthology.orchestra.run.smithi008.stdout: }, 2023-08-01T19:55:44.355 INFO:teuthology.orchestra.run.smithi008.stdout: { 2023-08-01T19:55:44.355 INFO:teuthology.orchestra.run.smithi008.stdout: "event": "dispatched", 2023-08-01T19:55:44.355 INFO:teuthology.orchestra.run.smithi008.stdout: "time": "2023-08-01T19:55:09.292461+0000", 2023-08-01T19:55:44.355 INFO:teuthology.orchestra.run.smithi008.stdout: "duration": 1.1287000000000001e-05 2023-08-01T19:55:44.356 INFO:teuthology.orchestra.run.smithi008.stdout: }, 2023-08-01T19:55:44.356 INFO:teuthology.orchestra.run.smithi008.stdout: { 2023-08-01T19:55:44.356 INFO:teuthology.orchestra.run.smithi008.stdout: "event": "queued_for_pg", 2023-08-01T19:55:44.356 INFO:teuthology.orchestra.run.smithi008.stdout: "time": "2023-08-01T19:55:09.292467+0000", 2023-08-01T19:55:44.356 INFO:teuthology.orchestra.run.smithi008.stdout: "duration": 6.4520000000000002e-06 2023-08-01T19:55:44.356 INFO:teuthology.orchestra.run.smithi008.stdout: }, 2023-08-01T19:55:44.356 INFO:teuthology.orchestra.run.smithi008.stdout: { 2023-08-01T19:55:44.356 INFO:teuthology.orchestra.run.smithi008.stdout: "event": "reached_pg", 2023-08-01T19:55:44.357 INFO:teuthology.orchestra.run.smithi008.stdout: "time": "2023-08-01T19:55:09.292510+0000", 2023-08-01T19:55:44.357 INFO:teuthology.orchestra.run.smithi008.stdout: "duration": 4.2502000000000001e-05 2023-08-01T19:55:44.357 INFO:teuthology.orchestra.run.smithi008.stdout: }, 2023-08-01T19:55:44.357 INFO:teuthology.orchestra.run.smithi008.stdout: { 2023-08-01T19:55:44.357 INFO:teuthology.orchestra.run.smithi008.stdout: "event": "started", 2023-08-01T19:55:44.357 INFO:teuthology.orchestra.run.smithi008.stdout: "time": "2023-08-01T19:55:09.292596+0000", 2023-08-01T19:55:44.357 INFO:teuthology.orchestra.run.smithi008.stdout: "duration": 8.6545000000000006e-05 2023-08-01T19:55:44.358 INFO:teuthology.orchestra.run.smithi008.stdout: }, 2023-08-01T19:55:44.358 INFO:teuthology.orchestra.run.smithi008.stdout: { 2023-08-01T19:55:44.358 INFO:teuthology.orchestra.run.smithi008.stdout: "event": "waiting for subops from 1", 2023-08-01T19:55:44.358 INFO:teuthology.orchestra.run.smithi008.stdout: "time": "2023-08-01T19:55:09.292697+0000", 2023-08-01T19:55:44.358 INFO:teuthology.orchestra.run.smithi008.stdout: "duration": 0.000100368 2023-08-01T19:55:44.358 INFO:teuthology.orchestra.run.smithi008.stdout: }, 2023-08-01T19:55:44.358 INFO:teuthology.orchestra.run.smithi008.stdout: { 2023-08-01T19:55:44.358 INFO:teuthology.orchestra.run.smithi008.stdout: "event": "op_commit", 2023-08-01T19:55:44.359 INFO:teuthology.orchestra.run.smithi008.stdout: "time": "2023-08-01T19:55:09.295658+0000", 2023-08-01T19:55:44.359 INFO:teuthology.orchestra.run.smithi008.stdout: "duration": 0.0029617290000000002 2023-08-01T19:55:44.359 INFO:teuthology.orchestra.run.smithi008.stdout: }, 2023-08-01T19:55:44.359 INFO:teuthology.orchestra.run.smithi008.stdout: { 2023-08-01T19:55:44.359 INFO:teuthology.orchestra.run.smithi008.stdout: "event": "sub_op_commit_rec", 2023-08-01T19:55:44.359 INFO:teuthology.orchestra.run.smithi008.stdout: "time": "2023-08-01T19:55:09.353604+0000", 2023-08-01T19:55:44.359 INFO:teuthology.orchestra.run.smithi008.stdout: "duration": 0.057945868999999997 2023-08-01T19:55:44.359 INFO:teuthology.orchestra.run.smithi008.stdout: }, 2023-08-01T19:55:44.360 INFO:teuthology.orchestra.run.smithi008.stdout: { 2023-08-01T19:55:44.360 INFO:teuthology.orchestra.run.smithi008.stdout: "event": "commit_sent", 2023-08-01T19:55:44.360 INFO:teuthology.orchestra.run.smithi008.stdout: "time": "2023-08-01T19:55:09.353650+0000", 2023-08-01T19:55:44.360 INFO:teuthology.orchestra.run.smithi008.stdout: "duration": 4.5698999999999997e-05 2023-08-01T19:55:44.360 INFO:teuthology.orchestra.run.smithi008.stdout: }, 2023-08-01T19:55:44.360 INFO:teuthology.orchestra.run.smithi008.stdout: { 2023-08-01T19:55:44.360 INFO:teuthology.orchestra.run.smithi008.stdout: "event": "done", 2023-08-01T19:55:44.360 INFO:teuthology.orchestra.run.smithi008.stdout: "time": "2023-08-01T19:55:09.353686+0000", 2023-08-01T19:55:44.361 INFO:teuthology.orchestra.run.smithi008.stdout: "duration": 3.5936999999999998e-05 2023-08-01T19:55:44.361 INFO:teuthology.orchestra.run.smithi008.stdout: } 2023-08-01T19:55:44.361 INFO:teuthology.orchestra.run.smithi008.stdout: ] 2023-08-01T19:55:44.361 INFO:teuthology.orchestra.run.smithi008.stdout: } 2023-08-01T19:55:44.361 INFO:teuthology.orchestra.run.smithi008.stdout: } 2023-08-01T19:55:44.361 INFO:teuthology.orchestra.run.smithi008.stdout: ] 2023-08-01T19:55:44.361 INFO:teuthology.orchestra.run.smithi008.stdout:} 2023-08-01T19:55:44.362 INFO:teuthology.orchestra.run.smithi006.stdout:osd.1: {} 2023-08-01T19:55:44.363 INFO:teuthology.orchestra.run.smithi006.stdout:osd.2: {} 2023-08-01T19:55:44.363 DEBUG:teuthology.orchestra.run.smithi101:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 30 ceph --cluster ceph --admin-daemon /var/run/ceph/ceph-osd.1.asok dump_ops_in_flight 2023-08-01T19:55:44.364 INFO:teuthology.orchestra.run.smithi006.stderr:osd.0: osd_enable_op_tracker = 'true' 2023-08-01T19:55:44.364 INFO:teuthology.orchestra.run.smithi006.stderr:osd.1: osd_enable_op_tracker = 'true' 2023-08-01T19:55:44.364 INFO:teuthology.orchestra.run.smithi006.stderr:osd.2: osd_enable_op_tracker = 'true' 2023-08-01T19:55:44.365 INFO:tasks.ceph.osd.1.smithi101.stderr:2023-08-01T19:55:44.361+0000 7fb0cb7f6700 -1 received signal: Hangup from /usr/bin/python3 /bin/daemon-helper kill ceph-osd -f --cluster ceph -i 1 (PID: 111141) UID: 0 2023-08-01T19:55:44.464 INFO:tasks.ceph.osd.0.smithi008.stderr:2023-08-01T19:55:44.462+0000 7f16a58f4700 -1 received signal: Hangup from /usr/bin/python3 /bin/daemon-helper kill ceph-osd -f --cluster ceph -i 0 (PID: 111179) UID: 0 2023-08-01T19:55:44.488 INFO:teuthology.orchestra.run.smithi101.stdout:{ 2023-08-01T19:55:44.488 INFO:teuthology.orchestra.run.smithi101.stdout: "ops": [], 2023-08-01T19:55:44.488 INFO:teuthology.orchestra.run.smithi101.stdout: "num_ops": 0 2023-08-01T19:55:44.488 INFO:teuthology.orchestra.run.smithi101.stdout:} 2023-08-01T19:55:44.498 DEBUG:teuthology.orchestra.run.smithi101:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 30 ceph --cluster ceph --admin-daemon /var/run/ceph/ceph-osd.1.asok dump_blocked_ops 2023-08-01T19:55:44.565 INFO:tasks.ceph.osd.2.smithi155.stderr:2023-08-01T19:55:44.563+0000 7faa5c6ac700 -1 received signal: Hangup from /usr/bin/python3 /bin/daemon-helper kill ceph-osd -f --cluster ceph -i 2 (PID: 111337) UID: 0 2023-08-01T19:55:44.619 INFO:teuthology.orchestra.run.smithi101.stdout:{ 2023-08-01T19:55:44.619 INFO:teuthology.orchestra.run.smithi101.stdout: "ops": [], 2023-08-01T19:55:44.619 INFO:teuthology.orchestra.run.smithi101.stdout: "complaint_time": 30, 2023-08-01T19:55:44.620 INFO:teuthology.orchestra.run.smithi101.stdout: "num_blocked_ops": 0 2023-08-01T19:55:44.620 INFO:teuthology.orchestra.run.smithi101.stdout:} 2023-08-01T19:55:44.629 DEBUG:teuthology.orchestra.run.smithi101:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 30 ceph --cluster ceph --admin-daemon /var/run/ceph/ceph-osd.1.asok dump_historic_ops 2023-08-01T19:55:44.666 INFO:tasks.ceph.osd.2.smithi155.stderr:2023-08-01T19:55:44.664+0000 7faa5c6ac700 -1 received signal: Hangup from /usr/bin/python3 /bin/daemon-helper kill ceph-osd -f --cluster ceph -i 2 (PID: 111337) UID: 0 2023-08-01T19:55:44.754 INFO:teuthology.orchestra.run.smithi101.stdout:{ 2023-08-01T19:55:44.754 INFO:teuthology.orchestra.run.smithi101.stdout: "size": 20, 2023-08-01T19:55:44.754 INFO:teuthology.orchestra.run.smithi101.stdout: "duration": 600, 2023-08-01T19:55:44.754 INFO:teuthology.orchestra.run.smithi101.stdout: "ops": [ 2023-08-01T19:55:44.754 INFO:teuthology.orchestra.run.smithi101.stdout: { 2023-08-01T19:55:44.754 INFO:teuthology.orchestra.run.smithi101.stdout: "description": "osd_op(mds.0.3:11 3.10 3:0bd6d154:::602.00000000:head [create,setxattr parent (62) in=6b,setxattr layout (30) in=6b] snapc 0=[] ondisk+write+known_if_redirected+full_force+supports_pool_eio e17)", 2023-08-01T19:55:44.755 INFO:teuthology.orchestra.run.smithi101.stdout: "initiated_at": "2023-08-01T19:54:04.458960+0000", 2023-08-01T19:55:44.755 INFO:teuthology.orchestra.run.smithi101.stdout: "age": 100.292399007, 2023-08-01T19:55:44.755 INFO:teuthology.orchestra.run.smithi101.stdout: "duration": 0.019645459000000001, 2023-08-01T19:55:44.755 INFO:teuthology.orchestra.run.smithi101.stdout: "type_data": { 2023-08-01T19:55:44.755 INFO:teuthology.orchestra.run.smithi101.stdout: "flag_point": "commit sent; apply or cleanup", 2023-08-01T19:55:44.755 INFO:teuthology.orchestra.run.smithi101.stdout: "events": [ 2023-08-01T19:55:44.755 INFO:teuthology.orchestra.run.smithi101.stdout: { 2023-08-01T19:55:44.755 INFO:teuthology.orchestra.run.smithi101.stdout: "event": "initiated", 2023-08-01T19:55:44.756 INFO:teuthology.orchestra.run.smithi101.stdout: "time": "2023-08-01T19:54:04.458960+0000", 2023-08-01T19:55:44.756 INFO:teuthology.orchestra.run.smithi101.stdout: "duration": 0 2023-08-01T19:55:44.756 INFO:teuthology.orchestra.run.smithi101.stdout: }, 2023-08-01T19:55:44.756 INFO:teuthology.orchestra.run.smithi101.stdout: { 2023-08-01T19:55:44.756 INFO:teuthology.orchestra.run.smithi101.stdout: "event": "throttled", 2023-08-01T19:55:44.756 INFO:teuthology.orchestra.run.smithi101.stdout: "time": "2023-08-01T19:54:04.458960+0000", 2023-08-01T19:55:44.756 INFO:teuthology.orchestra.run.smithi101.stdout: "duration": 0 2023-08-01T19:55:44.757 INFO:teuthology.orchestra.run.smithi101.stdout: }, 2023-08-01T19:55:44.757 INFO:teuthology.orchestra.run.smithi101.stdout: { 2023-08-01T19:55:44.757 INFO:teuthology.orchestra.run.smithi101.stdout: "event": "header_read", 2023-08-01T19:55:44.757 INFO:teuthology.orchestra.run.smithi101.stdout: "time": "2023-08-01T19:54:04.458959+0000", 2023-08-01T19:55:44.757 INFO:teuthology.orchestra.run.smithi101.stdout: "duration": 4294967295.9999995 2023-08-01T19:55:44.757 INFO:teuthology.orchestra.run.smithi101.stdout: }, 2023-08-01T19:55:44.757 INFO:teuthology.orchestra.run.smithi101.stdout: { 2023-08-01T19:55:44.757 INFO:teuthology.orchestra.run.smithi101.stdout: "event": "all_read", 2023-08-01T19:55:44.758 INFO:teuthology.orchestra.run.smithi101.stdout: "time": "2023-08-01T19:54:04.458963+0000", 2023-08-01T19:55:44.758 INFO:teuthology.orchestra.run.smithi101.stdout: "duration": 3.9199999999999997e-06 2023-08-01T19:55:44.758 INFO:teuthology.orchestra.run.smithi101.stdout: }, 2023-08-01T19:55:44.758 INFO:teuthology.orchestra.run.smithi101.stdout: { 2023-08-01T19:55:44.758 INFO:teuthology.orchestra.run.smithi101.stdout: "event": "dispatched", 2023-08-01T19:55:44.758 INFO:teuthology.orchestra.run.smithi101.stdout: "time": "2023-08-01T19:54:04.458970+0000", 2023-08-01T19:55:44.758 INFO:teuthology.orchestra.run.smithi101.stdout: "duration": 7.0439999999999998e-06 2023-08-01T19:55:44.759 INFO:teuthology.orchestra.run.smithi101.stdout: }, 2023-08-01T19:55:44.759 INFO:teuthology.orchestra.run.smithi101.stdout: { 2023-08-01T19:55:44.759 INFO:teuthology.orchestra.run.smithi101.stdout: "event": "queued_for_pg", 2023-08-01T19:55:44.759 INFO:teuthology.orchestra.run.smithi101.stdout: "time": "2023-08-01T19:54:04.458976+0000", 2023-08-01T19:55:44.759 INFO:teuthology.orchestra.run.smithi101.stdout: "duration": 5.9540000000000001e-06 2023-08-01T19:55:44.759 INFO:teuthology.orchestra.run.smithi101.stdout: }, 2023-08-01T19:55:44.759 INFO:teuthology.orchestra.run.smithi101.stdout: { 2023-08-01T19:55:44.759 INFO:teuthology.orchestra.run.smithi101.stdout: "event": "reached_pg", 2023-08-01T19:55:44.760 INFO:teuthology.orchestra.run.smithi101.stdout: "time": "2023-08-01T19:54:04.459035+0000", 2023-08-01T19:55:44.760 INFO:teuthology.orchestra.run.smithi101.stdout: "duration": 5.8924e-05 2023-08-01T19:55:44.760 INFO:teuthology.orchestra.run.smithi101.stdout: }, 2023-08-01T19:55:44.760 INFO:teuthology.orchestra.run.smithi101.stdout: { 2023-08-01T19:55:44.760 INFO:teuthology.orchestra.run.smithi101.stdout: "event": "waiting_for_map not empty", 2023-08-01T19:55:44.760 INFO:teuthology.orchestra.run.smithi101.stdout: "time": "2023-08-01T19:54:04.459038+0000", 2023-08-01T19:55:44.760 INFO:teuthology.orchestra.run.smithi101.stdout: "duration": 3.2760000000000001e-06 2023-08-01T19:55:44.760 INFO:teuthology.orchestra.run.smithi101.stdout: }, 2023-08-01T19:55:44.761 INFO:teuthology.orchestra.run.smithi101.stdout: { 2023-08-01T19:55:44.761 INFO:teuthology.orchestra.run.smithi101.stdout: "event": "reached_pg", 2023-08-01T19:55:44.761 INFO:teuthology.orchestra.run.smithi101.stdout: "time": "2023-08-01T19:54:04.471511+0000", 2023-08-01T19:55:44.761 INFO:teuthology.orchestra.run.smithi101.stdout: "duration": 0.012473039999999999 2023-08-01T19:55:44.761 INFO:teuthology.orchestra.run.smithi101.stdout: }, 2023-08-01T19:55:44.761 INFO:teuthology.orchestra.run.smithi101.stdout: { 2023-08-01T19:55:44.761 INFO:teuthology.orchestra.run.smithi101.stdout: "event": "started", 2023-08-01T19:55:44.762 INFO:teuthology.orchestra.run.smithi101.stdout: "time": "2023-08-01T19:54:04.472086+0000", 2023-08-01T19:55:44.762 INFO:teuthology.orchestra.run.smithi101.stdout: "duration": 0.00057491699999999998 2023-08-01T19:55:44.762 INFO:teuthology.orchestra.run.smithi101.stdout: }, 2023-08-01T19:55:44.762 INFO:teuthology.orchestra.run.smithi101.stdout: { 2023-08-01T19:55:44.762 INFO:teuthology.orchestra.run.smithi101.stdout: "event": "waiting for subops from 2", 2023-08-01T19:55:44.762 INFO:teuthology.orchestra.run.smithi101.stdout: "time": "2023-08-01T19:54:04.472310+0000", 2023-08-01T19:55:44.762 INFO:teuthology.orchestra.run.smithi101.stdout: "duration": 0.00022396499999999999 2023-08-01T19:55:44.762 INFO:teuthology.orchestra.run.smithi101.stdout: }, 2023-08-01T19:55:44.763 INFO:teuthology.orchestra.run.smithi101.stdout: { 2023-08-01T19:55:44.763 INFO:teuthology.orchestra.run.smithi101.stdout: "event": "op_commit", 2023-08-01T19:55:44.763 INFO:teuthology.orchestra.run.smithi101.stdout: "time": "2023-08-01T19:54:04.478141+0000", 2023-08-01T19:55:44.763 INFO:teuthology.orchestra.run.smithi101.stdout: "duration": 0.0058312320000000004 2023-08-01T19:55:44.763 INFO:teuthology.orchestra.run.smithi101.stdout: }, 2023-08-01T19:55:44.763 INFO:teuthology.orchestra.run.smithi101.stdout: { 2023-08-01T19:55:44.763 INFO:teuthology.orchestra.run.smithi101.stdout: "event": "sub_op_commit_rec", 2023-08-01T19:55:44.763 INFO:teuthology.orchestra.run.smithi101.stdout: "time": "2023-08-01T19:54:04.478543+0000", 2023-08-01T19:55:44.764 INFO:teuthology.orchestra.run.smithi101.stdout: "duration": 0.00040160800000000002 2023-08-01T19:55:44.764 INFO:teuthology.orchestra.run.smithi101.stdout: }, 2023-08-01T19:55:44.764 INFO:teuthology.orchestra.run.smithi101.stdout: { 2023-08-01T19:55:44.764 INFO:teuthology.orchestra.run.smithi101.stdout: "event": "commit_sent", 2023-08-01T19:55:44.764 INFO:teuthology.orchestra.run.smithi101.stdout: "time": "2023-08-01T19:54:04.478584+0000", 2023-08-01T19:55:44.764 INFO:teuthology.orchestra.run.smithi101.stdout: "duration": 4.0989999999999999e-05 2023-08-01T19:55:44.764 INFO:teuthology.orchestra.run.smithi101.stdout: }, 2023-08-01T19:55:44.764 INFO:teuthology.orchestra.run.smithi101.stdout: { 2023-08-01T19:55:44.765 INFO:teuthology.orchestra.run.smithi101.stdout: "event": "done", 2023-08-01T19:55:44.765 INFO:teuthology.orchestra.run.smithi101.stdout: "time": "2023-08-01T19:54:04.478605+0000", 2023-08-01T19:55:44.765 INFO:teuthology.orchestra.run.smithi101.stdout: "duration": 2.1178e-05 2023-08-01T19:55:44.765 INFO:teuthology.orchestra.run.smithi101.stdout: } 2023-08-01T19:55:44.765 INFO:teuthology.orchestra.run.smithi101.stdout: ] 2023-08-01T19:55:44.765 INFO:teuthology.orchestra.run.smithi101.stdout: } 2023-08-01T19:55:44.765 INFO:teuthology.orchestra.run.smithi101.stdout: }, 2023-08-01T19:55:44.765 INFO:teuthology.orchestra.run.smithi101.stdout: { 2023-08-01T19:55:44.766 INFO:teuthology.orchestra.run.smithi101.stdout: "description": "osd_op(mds.0.3:12 3.10 3:0d89b25e:::603.00000000:head [omap-set-header] snapc 0=[] ondisk+write+known_if_redirected+full_force+supports_pool_eio e17)", 2023-08-01T19:55:44.766 INFO:teuthology.orchestra.run.smithi101.stdout: "initiated_at": "2023-08-01T19:54:04.458982+0000", 2023-08-01T19:55:44.766 INFO:teuthology.orchestra.run.smithi101.stdout: "age": 100.29237677899999, 2023-08-01T19:55:44.766 INFO:teuthology.orchestra.run.smithi101.stdout: "duration": 0.021266334000000001, 2023-08-01T19:55:44.766 INFO:teuthology.orchestra.run.smithi101.stdout: "type_data": { 2023-08-01T19:55:44.766 INFO:teuthology.orchestra.run.smithi101.stdout: "flag_point": "commit sent; apply or cleanup", 2023-08-01T19:55:44.766 INFO:teuthology.orchestra.run.smithi101.stdout: "events": [ 2023-08-01T19:55:44.766 INFO:teuthology.orchestra.run.smithi101.stdout: { 2023-08-01T19:55:44.767 INFO:teuthology.orchestra.run.smithi101.stdout: "event": "initiated", 2023-08-01T19:55:44.767 INFO:teuthology.orchestra.run.smithi101.stdout: "time": "2023-08-01T19:54:04.458982+0000", 2023-08-01T19:55:44.767 INFO:teuthology.orchestra.run.smithi101.stdout: "duration": 0 2023-08-01T19:55:44.767 INFO:teuthology.orchestra.run.smithi101.stdout: }, 2023-08-01T19:55:44.767 INFO:teuthology.orchestra.run.smithi101.stdout: { 2023-08-01T19:55:44.767 INFO:teuthology.orchestra.run.smithi101.stdout: "event": "throttled", 2023-08-01T19:55:44.767 INFO:teuthology.orchestra.run.smithi101.stdout: "time": "2023-08-01T19:54:04.458982+0000", 2023-08-01T19:55:44.768 INFO:teuthology.orchestra.run.smithi101.stdout: "duration": 0 2023-08-01T19:55:44.768 INFO:teuthology.orchestra.run.smithi101.stdout: }, 2023-08-01T19:55:44.768 INFO:teuthology.orchestra.run.smithi101.stdout: { 2023-08-01T19:55:44.768 INFO:teuthology.orchestra.run.smithi101.stdout: "event": "header_read", 2023-08-01T19:55:44.768 INFO:teuthology.orchestra.run.smithi101.stdout: "time": "2023-08-01T19:54:04.458982+0000", 2023-08-01T19:55:44.768 INFO:teuthology.orchestra.run.smithi101.stdout: "duration": 4294967295.9999995 2023-08-01T19:55:44.768 INFO:teuthology.orchestra.run.smithi101.stdout: }, 2023-08-01T19:55:44.768 INFO:teuthology.orchestra.run.smithi101.stdout: { 2023-08-01T19:55:44.769 INFO:teuthology.orchestra.run.smithi101.stdout: "event": "all_read", 2023-08-01T19:55:44.769 INFO:teuthology.orchestra.run.smithi101.stdout: "time": "2023-08-01T19:54:04.458985+0000", 2023-08-01T19:55:44.769 INFO:teuthology.orchestra.run.smithi101.stdout: "duration": 3.4800000000000001e-06 2023-08-01T19:55:44.769 INFO:teuthology.orchestra.run.smithi101.stdout: }, 2023-08-01T19:55:44.769 INFO:teuthology.orchestra.run.smithi101.stdout: { 2023-08-01T19:55:44.769 INFO:teuthology.orchestra.run.smithi101.stdout: "event": "dispatched", 2023-08-01T19:55:44.769 INFO:teuthology.orchestra.run.smithi101.stdout: "time": "2023-08-01T19:54:04.458992+0000", 2023-08-01T19:55:44.769 INFO:teuthology.orchestra.run.smithi101.stdout: "duration": 7.306e-06 2023-08-01T19:55:44.770 INFO:teuthology.orchestra.run.smithi101.stdout: }, 2023-08-01T19:55:44.770 INFO:teuthology.orchestra.run.smithi101.stdout: { 2023-08-01T19:55:44.770 INFO:teuthology.orchestra.run.smithi101.stdout: "event": "queued_for_pg", 2023-08-01T19:55:44.770 INFO:teuthology.orchestra.run.smithi101.stdout: "time": "2023-08-01T19:54:04.458997+0000", 2023-08-01T19:55:44.770 INFO:teuthology.orchestra.run.smithi101.stdout: "duration": 4.4530000000000004e-06 2023-08-01T19:55:44.770 INFO:teuthology.orchestra.run.smithi101.stdout: }, 2023-08-01T19:55:44.770 INFO:teuthology.orchestra.run.smithi101.stdout: { 2023-08-01T19:55:44.770 INFO:teuthology.orchestra.run.smithi101.stdout: "event": "reached_pg", 2023-08-01T19:55:44.771 INFO:teuthology.orchestra.run.smithi101.stdout: "time": "2023-08-01T19:54:04.459060+0000", 2023-08-01T19:55:44.771 INFO:teuthology.orchestra.run.smithi101.stdout: "duration": 6.3249000000000004e-05 2023-08-01T19:55:44.771 INFO:teuthology.orchestra.run.smithi101.stdout: }, 2023-08-01T19:55:44.771 INFO:teuthology.orchestra.run.smithi101.stdout: { 2023-08-01T19:55:44.771 INFO:teuthology.orchestra.run.smithi101.stdout: "event": "waiting_for_map not empty", 2023-08-01T19:55:44.771 INFO:teuthology.orchestra.run.smithi101.stdout: "time": "2023-08-01T19:54:04.459063+0000", 2023-08-01T19:55:44.771 INFO:teuthology.orchestra.run.smithi101.stdout: "duration": 2.717e-06 2023-08-01T19:55:44.771 INFO:teuthology.orchestra.run.smithi101.stdout: }, 2023-08-01T19:55:44.772 INFO:teuthology.orchestra.run.smithi101.stdout: { 2023-08-01T19:55:44.772 INFO:teuthology.orchestra.run.smithi101.stdout: "event": "reached_pg", 2023-08-01T19:55:44.772 INFO:teuthology.orchestra.run.smithi101.stdout: "time": "2023-08-01T19:54:04.473625+0000", 2023-08-01T19:55:44.772 INFO:teuthology.orchestra.run.smithi101.stdout: "duration": 0.014562007 2023-08-01T19:55:44.772 INFO:teuthology.orchestra.run.smithi101.stdout: }, 2023-08-01T19:55:44.772 INFO:teuthology.orchestra.run.smithi101.stdout: { 2023-08-01T19:55:44.772 INFO:teuthology.orchestra.run.smithi101.stdout: "event": "started", 2023-08-01T19:55:44.773 INFO:teuthology.orchestra.run.smithi101.stdout: "time": "2023-08-01T19:54:04.473757+0000", 2023-08-01T19:55:44.773 INFO:teuthology.orchestra.run.smithi101.stdout: "duration": 0.00013238599999999999 2023-08-01T19:55:44.773 INFO:teuthology.orchestra.run.smithi101.stdout: }, 2023-08-01T19:55:44.773 INFO:teuthology.orchestra.run.smithi101.stdout: { 2023-08-01T19:55:44.773 INFO:teuthology.orchestra.run.smithi101.stdout: "event": "waiting for subops from 2", 2023-08-01T19:55:44.773 INFO:teuthology.orchestra.run.smithi101.stdout: "time": "2023-08-01T19:54:04.473898+0000", 2023-08-01T19:55:44.773 INFO:teuthology.orchestra.run.smithi101.stdout: "duration": 0.00014039 2023-08-01T19:55:44.773 INFO:teuthology.orchestra.run.smithi101.stdout: }, 2023-08-01T19:55:44.774 INFO:teuthology.orchestra.run.smithi101.stdout: { 2023-08-01T19:55:44.774 INFO:teuthology.orchestra.run.smithi101.stdout: "event": "op_commit", 2023-08-01T19:55:44.774 INFO:teuthology.orchestra.run.smithi101.stdout: "time": "2023-08-01T19:54:04.478380+0000", 2023-08-01T19:55:44.774 INFO:teuthology.orchestra.run.smithi101.stdout: "duration": 0.0044827449999999998 2023-08-01T19:55:44.774 INFO:teuthology.orchestra.run.smithi101.stdout: }, 2023-08-01T19:55:44.774 INFO:teuthology.orchestra.run.smithi101.stdout: { 2023-08-01T19:55:44.774 INFO:teuthology.orchestra.run.smithi101.stdout: "event": "sub_op_commit_rec", 2023-08-01T19:55:44.774 INFO:teuthology.orchestra.run.smithi101.stdout: "time": "2023-08-01T19:54:04.480169+0000", 2023-08-01T19:55:44.775 INFO:teuthology.orchestra.run.smithi101.stdout: "duration": 0.0017886040000000001 2023-08-01T19:55:44.775 INFO:teuthology.orchestra.run.smithi101.stdout: }, 2023-08-01T19:55:44.775 INFO:teuthology.orchestra.run.smithi101.stdout: { 2023-08-01T19:55:44.775 INFO:teuthology.orchestra.run.smithi101.stdout: "event": "commit_sent", 2023-08-01T19:55:44.775 INFO:teuthology.orchestra.run.smithi101.stdout: "time": "2023-08-01T19:54:04.480212+0000", 2023-08-01T19:55:44.775 INFO:teuthology.orchestra.run.smithi101.stdout: "duration": 4.2687e-05 2023-08-01T19:55:44.775 INFO:teuthology.orchestra.run.smithi101.stdout: }, 2023-08-01T19:55:44.775 INFO:teuthology.orchestra.run.smithi101.stdout: { 2023-08-01T19:55:44.776 INFO:teuthology.orchestra.run.smithi101.stdout: "event": "done", 2023-08-01T19:55:44.776 INFO:teuthology.orchestra.run.smithi101.stdout: "time": "2023-08-01T19:54:04.480248+0000", 2023-08-01T19:55:44.776 INFO:teuthology.orchestra.run.smithi101.stdout: "duration": 3.6743999999999999e-05 2023-08-01T19:55:44.776 INFO:teuthology.orchestra.run.smithi101.stdout: } 2023-08-01T19:55:44.776 INFO:teuthology.orchestra.run.smithi101.stdout: ] 2023-08-01T19:55:44.776 INFO:teuthology.orchestra.run.smithi101.stdout: } 2023-08-01T19:55:44.776 INFO:teuthology.orchestra.run.smithi101.stdout: }, 2023-08-01T19:55:44.776 INFO:teuthology.orchestra.run.smithi101.stdout: { 2023-08-01T19:55:44.777 INFO:teuthology.orchestra.run.smithi101.stdout: "description": "osd_op(mds.0.3:13 3.10 3:0d89b25e:::603.00000000:head [create,setxattr parent (62) in=6b,setxattr layout (30) in=6b] snapc 0=[] ondisk+write+known_if_redirected+full_force+supports_pool_eio e17)", 2023-08-01T19:55:44.777 INFO:teuthology.orchestra.run.smithi101.stdout: "initiated_at": "2023-08-01T19:54:04.459010+0000", 2023-08-01T19:55:44.777 INFO:teuthology.orchestra.run.smithi101.stdout: "age": 100.292349059, 2023-08-01T19:55:44.777 INFO:teuthology.orchestra.run.smithi101.stdout: "duration": 0.021327220000000001, 2023-08-01T19:55:44.777 INFO:teuthology.orchestra.run.smithi101.stdout: "type_data": { 2023-08-01T19:55:44.777 INFO:teuthology.orchestra.run.smithi101.stdout: "flag_point": "commit sent; apply or cleanup", 2023-08-01T19:55:44.777 INFO:teuthology.orchestra.run.smithi101.stdout: "events": [ 2023-08-01T19:55:44.778 INFO:teuthology.orchestra.run.smithi101.stdout: { 2023-08-01T19:55:44.778 INFO:teuthology.orchestra.run.smithi101.stdout: "event": "initiated", 2023-08-01T19:55:44.778 INFO:teuthology.orchestra.run.smithi101.stdout: "time": "2023-08-01T19:54:04.459010+0000", 2023-08-01T19:55:44.778 INFO:teuthology.orchestra.run.smithi101.stdout: "duration": 0 2023-08-01T19:55:44.778 INFO:teuthology.orchestra.run.smithi101.stdout: }, 2023-08-01T19:55:44.778 INFO:teuthology.orchestra.run.smithi101.stdout: { 2023-08-01T19:55:44.778 INFO:teuthology.orchestra.run.smithi101.stdout: "event": "throttled", 2023-08-01T19:55:44.778 INFO:teuthology.orchestra.run.smithi101.stdout: "time": "2023-08-01T19:54:04.459010+0000", 2023-08-01T19:55:44.779 INFO:teuthology.orchestra.run.smithi101.stdout: "duration": 0 2023-08-01T19:55:44.779 INFO:teuthology.orchestra.run.smithi101.stdout: }, 2023-08-01T19:55:44.779 INFO:teuthology.orchestra.run.smithi101.stdout: { 2023-08-01T19:55:44.779 INFO:teuthology.orchestra.run.smithi101.stdout: "event": "header_read", 2023-08-01T19:55:44.779 INFO:teuthology.orchestra.run.smithi101.stdout: "time": "2023-08-01T19:54:04.459009+0000", 2023-08-01T19:55:44.779 INFO:teuthology.orchestra.run.smithi101.stdout: "duration": 4294967295.9999995 2023-08-01T19:55:44.779 INFO:teuthology.orchestra.run.smithi101.stdout: }, 2023-08-01T19:55:44.779 INFO:teuthology.orchestra.run.smithi101.stdout: { 2023-08-01T19:55:44.780 INFO:teuthology.orchestra.run.smithi101.stdout: "event": "all_read", 2023-08-01T19:55:44.780 INFO:teuthology.orchestra.run.smithi101.stdout: "time": "2023-08-01T19:54:04.459013+0000", 2023-08-01T19:55:44.780 INFO:teuthology.orchestra.run.smithi101.stdout: "duration": 3.8929999999999998e-06 2023-08-01T19:55:44.780 INFO:teuthology.orchestra.run.smithi101.stdout: }, 2023-08-01T19:55:44.780 INFO:teuthology.orchestra.run.smithi101.stdout: { 2023-08-01T19:55:44.780 INFO:teuthology.orchestra.run.smithi101.stdout: "event": "dispatched", 2023-08-01T19:55:44.780 INFO:teuthology.orchestra.run.smithi101.stdout: "time": "2023-08-01T19:54:04.459027+0000", 2023-08-01T19:55:44.781 INFO:teuthology.orchestra.run.smithi101.stdout: "duration": 1.3416e-05 2023-08-01T19:55:44.781 INFO:teuthology.orchestra.run.smithi101.stdout: }, 2023-08-01T19:55:44.781 INFO:teuthology.orchestra.run.smithi101.stdout: { 2023-08-01T19:55:44.781 INFO:teuthology.orchestra.run.smithi101.stdout: "event": "queued_for_pg", 2023-08-01T19:55:44.781 INFO:teuthology.orchestra.run.smithi101.stdout: "time": "2023-08-01T19:54:04.459033+0000", 2023-08-01T19:55:44.781 INFO:teuthology.orchestra.run.smithi101.stdout: "duration": 5.9800000000000003e-06 2023-08-01T19:55:44.781 INFO:teuthology.orchestra.run.smithi101.stdout: }, 2023-08-01T19:55:44.781 INFO:teuthology.orchestra.run.smithi101.stdout: { 2023-08-01T19:55:44.782 INFO:teuthology.orchestra.run.smithi101.stdout: "event": "reached_pg", 2023-08-01T19:55:44.782 INFO:teuthology.orchestra.run.smithi101.stdout: "time": "2023-08-01T19:54:04.459099+0000", 2023-08-01T19:55:44.782 INFO:teuthology.orchestra.run.smithi101.stdout: "duration": 6.6192999999999995e-05 2023-08-01T19:55:44.782 INFO:teuthology.orchestra.run.smithi101.stdout: }, 2023-08-01T19:55:44.782 INFO:teuthology.orchestra.run.smithi101.stdout: { 2023-08-01T19:55:44.782 INFO:teuthology.orchestra.run.smithi101.stdout: "event": "waiting_for_map not empty", 2023-08-01T19:55:44.782 INFO:teuthology.orchestra.run.smithi101.stdout: "time": "2023-08-01T19:54:04.459106+0000", 2023-08-01T19:55:44.782 INFO:teuthology.orchestra.run.smithi101.stdout: "duration": 6.8619999999999997e-06 2023-08-01T19:55:44.783 INFO:teuthology.orchestra.run.smithi101.stdout: }, 2023-08-01T19:55:44.783 INFO:teuthology.orchestra.run.smithi101.stdout: { 2023-08-01T19:55:44.783 INFO:teuthology.orchestra.run.smithi101.stdout: "event": "reached_pg", 2023-08-01T19:55:44.783 INFO:teuthology.orchestra.run.smithi101.stdout: "time": "2023-08-01T19:54:04.475182+0000", 2023-08-01T19:55:44.783 INFO:teuthology.orchestra.run.smithi101.stdout: "duration": 0.016076333000000002 2023-08-01T19:55:44.783 INFO:teuthology.orchestra.run.smithi101.stdout: }, 2023-08-01T19:55:44.783 INFO:teuthology.orchestra.run.smithi101.stdout: { 2023-08-01T19:55:44.784 INFO:teuthology.orchestra.run.smithi101.stdout: "event": "started", 2023-08-01T19:55:44.784 INFO:teuthology.orchestra.run.smithi101.stdout: "time": "2023-08-01T19:54:04.475353+0000", 2023-08-01T19:55:44.784 INFO:teuthology.orchestra.run.smithi101.stdout: "duration": 0.000171378 2023-08-01T19:55:44.784 INFO:teuthology.orchestra.run.smithi101.stdout: }, 2023-08-01T19:55:44.784 INFO:teuthology.orchestra.run.smithi101.stdout: { 2023-08-01T19:55:44.784 INFO:teuthology.orchestra.run.smithi101.stdout: "event": "waiting for subops from 2", 2023-08-01T19:55:44.784 INFO:teuthology.orchestra.run.smithi101.stdout: "time": "2023-08-01T19:54:04.475793+0000", 2023-08-01T19:55:44.784 INFO:teuthology.orchestra.run.smithi101.stdout: "duration": 0.000440123 2023-08-01T19:55:44.785 INFO:teuthology.orchestra.run.smithi101.stdout: }, 2023-08-01T19:55:44.785 INFO:teuthology.orchestra.run.smithi101.stdout: { 2023-08-01T19:55:44.785 INFO:teuthology.orchestra.run.smithi101.stdout: "event": "op_commit", 2023-08-01T19:55:44.785 INFO:teuthology.orchestra.run.smithi101.stdout: "time": "2023-08-01T19:54:04.478624+0000", 2023-08-01T19:55:44.785 INFO:teuthology.orchestra.run.smithi101.stdout: "duration": 0.0028305000000000001 2023-08-01T19:55:44.785 INFO:teuthology.orchestra.run.smithi101.stdout: }, 2023-08-01T19:55:44.785 INFO:teuthology.orchestra.run.smithi101.stdout: { 2023-08-01T19:55:44.785 INFO:teuthology.orchestra.run.smithi101.stdout: "event": "sub_op_commit_rec", 2023-08-01T19:55:44.786 INFO:teuthology.orchestra.run.smithi101.stdout: "time": "2023-08-01T19:54:04.480291+0000", 2023-08-01T19:55:44.786 INFO:teuthology.orchestra.run.smithi101.stdout: "duration": 0.0016670000000000001 2023-08-01T19:55:44.786 INFO:teuthology.orchestra.run.smithi101.stdout: }, 2023-08-01T19:55:44.786 INFO:teuthology.orchestra.run.smithi101.stdout: { 2023-08-01T19:55:44.786 INFO:teuthology.orchestra.run.smithi101.stdout: "event": "commit_sent", 2023-08-01T19:55:44.786 INFO:teuthology.orchestra.run.smithi101.stdout: "time": "2023-08-01T19:54:04.480318+0000", 2023-08-01T19:55:44.786 INFO:teuthology.orchestra.run.smithi101.stdout: "duration": 2.6815e-05 2023-08-01T19:55:44.787 INFO:teuthology.orchestra.run.smithi101.stdout: }, 2023-08-01T19:55:44.787 INFO:teuthology.orchestra.run.smithi101.stdout: { 2023-08-01T19:55:44.787 INFO:teuthology.orchestra.run.smithi101.stdout: "event": "done", 2023-08-01T19:55:44.787 INFO:teuthology.orchestra.run.smithi101.stdout: "time": "2023-08-01T19:54:04.480337+0000", 2023-08-01T19:55:44.787 INFO:teuthology.orchestra.run.smithi101.stdout: "duration": 1.9241000000000001e-05 2023-08-01T19:55:44.787 INFO:teuthology.orchestra.run.smithi101.stdout: } 2023-08-01T19:55:44.787 INFO:teuthology.orchestra.run.smithi101.stdout: ] 2023-08-01T19:55:44.788 INFO:teuthology.orchestra.run.smithi101.stdout: } 2023-08-01T19:55:44.788 INFO:teuthology.orchestra.run.smithi101.stdout: }, 2023-08-01T19:55:44.788 INFO:teuthology.orchestra.run.smithi101.stdout: { 2023-08-01T19:55:44.788 INFO:teuthology.orchestra.run.smithi101.stdout: "description": "osd_op(mds.0.3:1 3.14 3:292cf221:::200.00000000:head [writefull 0~90] snapc 0=[] ondisk+write+known_if_redirected+full_force+supports_pool_eio e17)", 2023-08-01T19:55:44.788 INFO:teuthology.orchestra.run.smithi101.stdout: "initiated_at": "2023-08-01T19:54:04.459177+0000", 2023-08-01T19:55:44.788 INFO:teuthology.orchestra.run.smithi101.stdout: "age": 100.29218216, 2023-08-01T19:55:44.788 INFO:teuthology.orchestra.run.smithi101.stdout: "duration": 0.021067196, 2023-08-01T19:55:44.788 INFO:teuthology.orchestra.run.smithi101.stdout: "type_data": { 2023-08-01T19:55:44.789 INFO:teuthology.orchestra.run.smithi101.stdout: "flag_point": "commit sent; apply or cleanup", 2023-08-01T19:55:44.789 INFO:teuthology.orchestra.run.smithi101.stdout: "events": [ 2023-08-01T19:55:44.789 INFO:teuthology.orchestra.run.smithi101.stdout: { 2023-08-01T19:55:44.789 INFO:teuthology.orchestra.run.smithi101.stdout: "event": "initiated", 2023-08-01T19:55:44.789 INFO:teuthology.orchestra.run.smithi101.stdout: "time": "2023-08-01T19:54:04.459177+0000", 2023-08-01T19:55:44.789 INFO:teuthology.orchestra.run.smithi101.stdout: "duration": 0 2023-08-01T19:55:44.789 INFO:teuthology.orchestra.run.smithi101.stdout: }, 2023-08-01T19:55:44.789 INFO:teuthology.orchestra.run.smithi101.stdout: { 2023-08-01T19:55:44.790 INFO:teuthology.orchestra.run.smithi101.stdout: "event": "throttled", 2023-08-01T19:55:44.790 INFO:teuthology.orchestra.run.smithi101.stdout: "time": "2023-08-01T19:54:04.459177+0000", 2023-08-01T19:55:44.790 INFO:teuthology.orchestra.run.smithi101.stdout: "duration": 0 2023-08-01T19:55:44.790 INFO:teuthology.orchestra.run.smithi101.stdout: }, 2023-08-01T19:55:44.790 INFO:teuthology.orchestra.run.smithi101.stdout: { 2023-08-01T19:55:44.790 INFO:teuthology.orchestra.run.smithi101.stdout: "event": "header_read", 2023-08-01T19:55:44.790 INFO:teuthology.orchestra.run.smithi101.stdout: "time": "2023-08-01T19:54:04.459176+0000", 2023-08-01T19:55:44.790 INFO:teuthology.orchestra.run.smithi101.stdout: "duration": 4294967295.9999995 2023-08-01T19:55:44.791 INFO:teuthology.orchestra.run.smithi101.stdout: }, 2023-08-01T19:55:44.791 INFO:teuthology.orchestra.run.smithi101.stdout: { 2023-08-01T19:55:44.791 INFO:teuthology.orchestra.run.smithi101.stdout: "event": "all_read", 2023-08-01T19:55:44.791 INFO:teuthology.orchestra.run.smithi101.stdout: "time": "2023-08-01T19:54:04.459181+0000", 2023-08-01T19:55:44.791 INFO:teuthology.orchestra.run.smithi101.stdout: "duration": 5.2109999999999997e-06 2023-08-01T19:55:44.791 INFO:teuthology.orchestra.run.smithi101.stdout: }, 2023-08-01T19:55:44.791 INFO:teuthology.orchestra.run.smithi101.stdout: { 2023-08-01T19:55:44.792 INFO:teuthology.orchestra.run.smithi101.stdout: "event": "dispatched", 2023-08-01T19:55:44.792 INFO:teuthology.orchestra.run.smithi101.stdout: "time": "2023-08-01T19:54:04.459188+0000", 2023-08-01T19:55:44.792 INFO:teuthology.orchestra.run.smithi101.stdout: "duration": 6.6680000000000004e-06 2023-08-01T19:55:44.792 INFO:teuthology.orchestra.run.smithi101.stdout: }, 2023-08-01T19:55:44.792 INFO:teuthology.orchestra.run.smithi101.stdout: { 2023-08-01T19:55:44.792 INFO:teuthology.orchestra.run.smithi101.stdout: "event": "queued_for_pg", 2023-08-01T19:55:44.792 INFO:teuthology.orchestra.run.smithi101.stdout: "time": "2023-08-01T19:54:04.459192+0000", 2023-08-01T19:55:44.792 INFO:teuthology.orchestra.run.smithi101.stdout: "duration": 4.228e-06 2023-08-01T19:55:44.793 INFO:teuthology.orchestra.run.smithi101.stdout: }, 2023-08-01T19:55:44.793 INFO:teuthology.orchestra.run.smithi101.stdout: { 2023-08-01T19:55:44.793 INFO:teuthology.orchestra.run.smithi101.stdout: "event": "reached_pg", 2023-08-01T19:55:44.793 INFO:teuthology.orchestra.run.smithi101.stdout: "time": "2023-08-01T19:54:04.459219+0000", 2023-08-01T19:55:44.793 INFO:teuthology.orchestra.run.smithi101.stdout: "duration": 2.6930000000000001e-05 2023-08-01T19:55:44.793 INFO:teuthology.orchestra.run.smithi101.stdout: }, 2023-08-01T19:55:44.793 INFO:teuthology.orchestra.run.smithi101.stdout: { 2023-08-01T19:55:44.793 INFO:teuthology.orchestra.run.smithi101.stdout: "event": "waiting_for_map not empty", 2023-08-01T19:55:44.794 INFO:teuthology.orchestra.run.smithi101.stdout: "time": "2023-08-01T19:54:04.459223+0000", 2023-08-01T19:55:44.794 INFO:teuthology.orchestra.run.smithi101.stdout: "duration": 3.8469999999999998e-06 2023-08-01T19:55:44.794 INFO:teuthology.orchestra.run.smithi101.stdout: }, 2023-08-01T19:55:44.794 INFO:teuthology.orchestra.run.smithi101.stdout: { 2023-08-01T19:55:44.794 INFO:teuthology.orchestra.run.smithi101.stdout: "event": "reached_pg", 2023-08-01T19:55:44.794 INFO:teuthology.orchestra.run.smithi101.stdout: "time": "2023-08-01T19:54:04.473347+0000", 2023-08-01T19:55:44.794 INFO:teuthology.orchestra.run.smithi101.stdout: "duration": 0.014124319 2023-08-01T19:55:44.795 INFO:teuthology.orchestra.run.smithi101.stdout: }, 2023-08-01T19:55:44.795 INFO:teuthology.orchestra.run.smithi101.stdout: { 2023-08-01T19:55:44.795 INFO:teuthology.orchestra.run.smithi101.stdout: "event": "started", 2023-08-01T19:55:44.795 INFO:teuthology.orchestra.run.smithi101.stdout: "time": "2023-08-01T19:54:04.473480+0000", 2023-08-01T19:55:44.795 INFO:teuthology.orchestra.run.smithi101.stdout: "duration": 0.00013276799999999999 2023-08-01T19:55:44.795 INFO:teuthology.orchestra.run.smithi101.stdout: }, 2023-08-01T19:55:44.795 INFO:teuthology.orchestra.run.smithi101.stdout: { 2023-08-01T19:55:44.795 INFO:teuthology.orchestra.run.smithi101.stdout: "event": "waiting for subops from 2", 2023-08-01T19:55:44.796 INFO:teuthology.orchestra.run.smithi101.stdout: "time": "2023-08-01T19:54:04.473622+0000", 2023-08-01T19:55:44.796 INFO:teuthology.orchestra.run.smithi101.stdout: "duration": 0.00014154799999999999 2023-08-01T19:55:44.796 INFO:teuthology.orchestra.run.smithi101.stdout: }, 2023-08-01T19:55:44.796 INFO:teuthology.orchestra.run.smithi101.stdout: { 2023-08-01T19:55:44.796 INFO:teuthology.orchestra.run.smithi101.stdout: "event": "op_commit", 2023-08-01T19:55:44.796 INFO:teuthology.orchestra.run.smithi101.stdout: "time": "2023-08-01T19:54:04.478281+0000", 2023-08-01T19:55:44.796 INFO:teuthology.orchestra.run.smithi101.stdout: "duration": 0.004659252 2023-08-01T19:55:44.796 INFO:teuthology.orchestra.run.smithi101.stdout: }, 2023-08-01T19:55:44.797 INFO:teuthology.orchestra.run.smithi101.stdout: { 2023-08-01T19:55:44.797 INFO:teuthology.orchestra.run.smithi101.stdout: "event": "sub_op_commit_rec", 2023-08-01T19:55:44.797 INFO:teuthology.orchestra.run.smithi101.stdout: "time": "2023-08-01T19:54:04.480180+0000", 2023-08-01T19:55:44.797 INFO:teuthology.orchestra.run.smithi101.stdout: "duration": 0.0018986859999999999 2023-08-01T19:55:44.797 INFO:teuthology.orchestra.run.smithi101.stdout: }, 2023-08-01T19:55:44.797 INFO:teuthology.orchestra.run.smithi101.stdout: { 2023-08-01T19:55:44.797 INFO:teuthology.orchestra.run.smithi101.stdout: "event": "commit_sent", 2023-08-01T19:55:44.797 INFO:teuthology.orchestra.run.smithi101.stdout: "time": "2023-08-01T19:54:04.480209+0000", 2023-08-01T19:55:44.798 INFO:teuthology.orchestra.run.smithi101.stdout: "duration": 2.9244999999999999e-05 2023-08-01T19:55:44.798 INFO:teuthology.orchestra.run.smithi101.stdout: }, 2023-08-01T19:55:44.798 INFO:teuthology.orchestra.run.smithi101.stdout: { 2023-08-01T19:55:44.798 INFO:teuthology.orchestra.run.smithi101.stdout: "event": "done", 2023-08-01T19:55:44.798 INFO:teuthology.orchestra.run.smithi101.stdout: "time": "2023-08-01T19:54:04.480244+0000", 2023-08-01T19:55:44.798 INFO:teuthology.orchestra.run.smithi101.stdout: "duration": 3.4875000000000001e-05 2023-08-01T19:55:44.798 INFO:teuthology.orchestra.run.smithi101.stdout: } 2023-08-01T19:55:44.798 INFO:teuthology.orchestra.run.smithi101.stdout: ] 2023-08-01T19:55:44.799 INFO:teuthology.orchestra.run.smithi101.stdout: } 2023-08-01T19:55:44.799 INFO:teuthology.orchestra.run.smithi101.stdout: }, 2023-08-01T19:55:44.799 INFO:teuthology.orchestra.run.smithi101.stdout: { 2023-08-01T19:55:44.799 INFO:teuthology.orchestra.run.smithi101.stdout: "description": "osd_op(mds.0.3:3 3.14 3:287034c4:::1.00000000.inode:head [writefull 0~554] snapc 0=[] ondisk+write+known_if_redirected+full_force+supports_pool_eio e17)", 2023-08-01T19:55:44.799 INFO:teuthology.orchestra.run.smithi101.stdout: "initiated_at": "2023-08-01T19:54:04.459226+0000", 2023-08-01T19:55:44.799 INFO:teuthology.orchestra.run.smithi101.stdout: "age": 100.292133081, 2023-08-01T19:55:44.799 INFO:teuthology.orchestra.run.smithi101.stdout: "duration": 0.021104531999999999, 2023-08-01T19:55:44.799 INFO:teuthology.orchestra.run.smithi101.stdout: "type_data": { 2023-08-01T19:55:44.800 INFO:teuthology.orchestra.run.smithi101.stdout: "flag_point": "commit sent; apply or cleanup", 2023-08-01T19:55:44.800 INFO:teuthology.orchestra.run.smithi101.stdout: "events": [ 2023-08-01T19:55:44.800 INFO:teuthology.orchestra.run.smithi101.stdout: { 2023-08-01T19:55:44.800 INFO:teuthology.orchestra.run.smithi101.stdout: "event": "initiated", 2023-08-01T19:55:44.800 INFO:teuthology.orchestra.run.smithi101.stdout: "time": "2023-08-01T19:54:04.459226+0000", 2023-08-01T19:55:44.800 INFO:teuthology.orchestra.run.smithi101.stdout: "duration": 0 2023-08-01T19:55:44.800 INFO:teuthology.orchestra.run.smithi101.stdout: }, 2023-08-01T19:55:44.801 INFO:teuthology.orchestra.run.smithi101.stdout: { 2023-08-01T19:55:44.801 INFO:teuthology.orchestra.run.smithi101.stdout: "event": "throttled", 2023-08-01T19:55:44.801 INFO:teuthology.orchestra.run.smithi101.stdout: "time": "2023-08-01T19:54:04.459226+0000", 2023-08-01T19:55:44.801 INFO:teuthology.orchestra.run.smithi101.stdout: "duration": 0 2023-08-01T19:55:44.801 INFO:teuthology.orchestra.run.smithi101.stdout: }, 2023-08-01T19:55:44.801 INFO:teuthology.orchestra.run.smithi101.stdout: { 2023-08-01T19:55:44.801 INFO:teuthology.orchestra.run.smithi101.stdout: "event": "header_read", 2023-08-01T19:55:44.801 INFO:teuthology.orchestra.run.smithi101.stdout: "time": "2023-08-01T19:54:04.459225+0000", 2023-08-01T19:55:44.802 INFO:teuthology.orchestra.run.smithi101.stdout: "duration": 4294967295.9999995 2023-08-01T19:55:44.802 INFO:teuthology.orchestra.run.smithi101.stdout: }, 2023-08-01T19:55:44.802 INFO:teuthology.orchestra.run.smithi101.stdout: { 2023-08-01T19:55:44.802 INFO:teuthology.orchestra.run.smithi101.stdout: "event": "all_read", 2023-08-01T19:55:44.802 INFO:teuthology.orchestra.run.smithi101.stdout: "time": "2023-08-01T19:54:04.459238+0000", 2023-08-01T19:55:44.802 INFO:teuthology.orchestra.run.smithi101.stdout: "duration": 1.2809000000000001e-05 2023-08-01T19:55:44.802 INFO:teuthology.orchestra.run.smithi101.stdout: }, 2023-08-01T19:55:44.802 INFO:teuthology.orchestra.run.smithi101.stdout: { 2023-08-01T19:55:44.803 INFO:teuthology.orchestra.run.smithi101.stdout: "event": "dispatched", 2023-08-01T19:55:44.803 INFO:teuthology.orchestra.run.smithi101.stdout: "time": "2023-08-01T19:54:04.459245+0000", 2023-08-01T19:55:44.803 INFO:teuthology.orchestra.run.smithi101.stdout: "duration": 6.6540000000000002e-06 2023-08-01T19:55:44.803 INFO:teuthology.orchestra.run.smithi101.stdout: }, 2023-08-01T19:55:44.803 INFO:teuthology.orchestra.run.smithi101.stdout: { 2023-08-01T19:55:44.803 INFO:teuthology.orchestra.run.smithi101.stdout: "event": "queued_for_pg", 2023-08-01T19:55:44.803 INFO:teuthology.orchestra.run.smithi101.stdout: "time": "2023-08-01T19:54:04.459249+0000", 2023-08-01T19:55:44.803 INFO:teuthology.orchestra.run.smithi101.stdout: "duration": 4.6e-06 2023-08-01T19:55:44.804 INFO:teuthology.orchestra.run.smithi101.stdout: }, 2023-08-01T19:55:44.804 INFO:teuthology.orchestra.run.smithi101.stdout: { 2023-08-01T19:55:44.804 INFO:teuthology.orchestra.run.smithi101.stdout: "event": "reached_pg", 2023-08-01T19:55:44.804 INFO:teuthology.orchestra.run.smithi101.stdout: "time": "2023-08-01T19:54:04.459276+0000", 2023-08-01T19:55:44.804 INFO:teuthology.orchestra.run.smithi101.stdout: "duration": 2.6373999999999999e-05 2023-08-01T19:55:44.804 INFO:teuthology.orchestra.run.smithi101.stdout: }, 2023-08-01T19:55:44.804 INFO:teuthology.orchestra.run.smithi101.stdout: { 2023-08-01T19:55:44.805 INFO:teuthology.orchestra.run.smithi101.stdout: "event": "waiting_for_map not empty", 2023-08-01T19:55:44.805 INFO:teuthology.orchestra.run.smithi101.stdout: "time": "2023-08-01T19:54:04.459278+0000", 2023-08-01T19:55:44.805 INFO:teuthology.orchestra.run.smithi101.stdout: "duration": 2.4980000000000001e-06 2023-08-01T19:55:44.805 INFO:teuthology.orchestra.run.smithi101.stdout: }, 2023-08-01T19:55:44.805 INFO:teuthology.orchestra.run.smithi101.stdout: { 2023-08-01T19:55:44.805 INFO:teuthology.orchestra.run.smithi101.stdout: "event": "reached_pg", 2023-08-01T19:55:44.805 INFO:teuthology.orchestra.run.smithi101.stdout: "time": "2023-08-01T19:54:04.474058+0000", 2023-08-01T19:55:44.805 INFO:teuthology.orchestra.run.smithi101.stdout: "duration": 0.014779979 2023-08-01T19:55:44.806 INFO:teuthology.orchestra.run.smithi101.stdout: }, 2023-08-01T19:55:44.806 INFO:teuthology.orchestra.run.smithi101.stdout: { 2023-08-01T19:55:44.806 INFO:teuthology.orchestra.run.smithi101.stdout: "event": "started", 2023-08-01T19:55:44.806 INFO:teuthology.orchestra.run.smithi101.stdout: "time": "2023-08-01T19:54:04.474614+0000", 2023-08-01T19:55:44.807 INFO:teuthology.orchestra.run.smithi101.stdout: "duration": 0.00055546899999999995 2023-08-01T19:55:44.807 INFO:teuthology.orchestra.run.smithi101.stdout: }, 2023-08-01T19:55:44.807 INFO:teuthology.orchestra.run.smithi101.stdout: { 2023-08-01T19:55:44.807 INFO:teuthology.orchestra.run.smithi101.stdout: "event": "waiting for subops from 2", 2023-08-01T19:55:44.807 INFO:teuthology.orchestra.run.smithi101.stdout: "time": "2023-08-01T19:54:04.474720+0000", 2023-08-01T19:55:44.807 INFO:teuthology.orchestra.run.smithi101.stdout: "duration": 0.00010645300000000001 2023-08-01T19:55:44.807 INFO:teuthology.orchestra.run.smithi101.stdout: }, 2023-08-01T19:55:44.807 INFO:teuthology.orchestra.run.smithi101.stdout: { 2023-08-01T19:55:44.808 INFO:teuthology.orchestra.run.smithi101.stdout: "event": "op_commit", 2023-08-01T19:55:44.808 INFO:teuthology.orchestra.run.smithi101.stdout: "time": "2023-08-01T19:54:04.478480+0000", 2023-08-01T19:55:44.808 INFO:teuthology.orchestra.run.smithi101.stdout: "duration": 0.0037600279999999999 2023-08-01T19:55:44.808 INFO:teuthology.orchestra.run.smithi101.stdout: }, 2023-08-01T19:55:44.809 INFO:teuthology.orchestra.run.smithi101.stdout: { 2023-08-01T19:55:44.809 INFO:teuthology.orchestra.run.smithi101.stdout: "event": "sub_op_commit_rec", 2023-08-01T19:55:44.809 INFO:teuthology.orchestra.run.smithi101.stdout: "time": "2023-08-01T19:54:04.480273+0000", 2023-08-01T19:55:44.809 INFO:teuthology.orchestra.run.smithi101.stdout: "duration": 0.001792465 2023-08-01T19:55:44.810 INFO:teuthology.orchestra.run.smithi101.stdout: }, 2023-08-01T19:55:44.810 INFO:teuthology.orchestra.run.smithi101.stdout: { 2023-08-01T19:55:44.810 INFO:teuthology.orchestra.run.smithi101.stdout: "event": "commit_sent", 2023-08-01T19:55:44.810 INFO:teuthology.orchestra.run.smithi101.stdout: "time": "2023-08-01T19:54:04.480304+0000", 2023-08-01T19:55:44.811 INFO:teuthology.orchestra.run.smithi101.stdout: "duration": 3.1708999999999997e-05 2023-08-01T19:55:44.811 INFO:teuthology.orchestra.run.smithi101.stdout: }, 2023-08-01T19:55:44.811 INFO:teuthology.orchestra.run.smithi101.stdout: { 2023-08-01T19:55:44.811 INFO:teuthology.orchestra.run.smithi101.stdout: "event": "done", 2023-08-01T19:55:44.811 INFO:teuthology.orchestra.run.smithi101.stdout: "time": "2023-08-01T19:54:04.480330+0000", 2023-08-01T19:55:44.811 INFO:teuthology.orchestra.run.smithi101.stdout: "duration": 2.5860999999999999e-05 2023-08-01T19:55:44.811 INFO:teuthology.orchestra.run.smithi101.stdout: } 2023-08-01T19:55:44.812 INFO:teuthology.orchestra.run.smithi101.stdout: ] 2023-08-01T19:55:44.812 INFO:teuthology.orchestra.run.smithi101.stdout: } 2023-08-01T19:55:44.812 INFO:teuthology.orchestra.run.smithi101.stdout: }, 2023-08-01T19:55:44.812 INFO:teuthology.orchestra.run.smithi101.stdout: { 2023-08-01T19:55:44.813 INFO:teuthology.orchestra.run.smithi101.stdout: "description": "osd_op(mds.0.3:32 3.14 3:2e2fa760:::200.00000001:head [delete] snapc 0=[] ondisk+write+known_if_redirected+full_force+supports_pool_eio e17)", 2023-08-01T19:55:44.813 INFO:teuthology.orchestra.run.smithi101.stdout: "initiated_at": "2023-08-01T19:54:04.459304+0000", 2023-08-01T19:55:44.813 INFO:teuthology.orchestra.run.smithi101.stdout: "age": 100.29205442, 2023-08-01T19:55:44.813 INFO:teuthology.orchestra.run.smithi101.stdout: "duration": 0.021110606000000001, 2023-08-01T19:55:44.813 INFO:teuthology.orchestra.run.smithi101.stdout: "type_data": { 2023-08-01T19:55:44.813 INFO:teuthology.orchestra.run.smithi101.stdout: "flag_point": "started", 2023-08-01T19:55:44.813 INFO:teuthology.orchestra.run.smithi101.stdout: "events": [ 2023-08-01T19:55:44.813 INFO:teuthology.orchestra.run.smithi101.stdout: { 2023-08-01T19:55:44.814 INFO:teuthology.orchestra.run.smithi101.stdout: "event": "initiated", 2023-08-01T19:55:44.814 INFO:teuthology.orchestra.run.smithi101.stdout: "time": "2023-08-01T19:54:04.459304+0000", 2023-08-01T19:55:44.814 INFO:teuthology.orchestra.run.smithi101.stdout: "duration": 0 2023-08-01T19:55:44.814 INFO:teuthology.orchestra.run.smithi101.stdout: }, 2023-08-01T19:55:44.814 INFO:teuthology.orchestra.run.smithi101.stdout: { 2023-08-01T19:55:44.814 INFO:teuthology.orchestra.run.smithi101.stdout: "event": "throttled", 2023-08-01T19:55:44.814 INFO:teuthology.orchestra.run.smithi101.stdout: "time": "2023-08-01T19:54:04.459304+0000", 2023-08-01T19:55:44.814 INFO:teuthology.orchestra.run.smithi101.stdout: "duration": 0 2023-08-01T19:55:44.815 INFO:teuthology.orchestra.run.smithi101.stdout: }, 2023-08-01T19:55:44.815 INFO:teuthology.orchestra.run.smithi101.stdout: { 2023-08-01T19:55:44.815 INFO:teuthology.orchestra.run.smithi101.stdout: "event": "header_read", 2023-08-01T19:55:44.815 INFO:teuthology.orchestra.run.smithi101.stdout: "time": "2023-08-01T19:54:04.459304+0000", 2023-08-01T19:55:44.815 INFO:teuthology.orchestra.run.smithi101.stdout: "duration": 4294967295.9999995 2023-08-01T19:55:44.815 INFO:teuthology.orchestra.run.smithi101.stdout: }, 2023-08-01T19:55:44.815 INFO:teuthology.orchestra.run.smithi101.stdout: { 2023-08-01T19:55:44.815 INFO:teuthology.orchestra.run.smithi101.stdout: "event": "all_read", 2023-08-01T19:55:44.816 INFO:teuthology.orchestra.run.smithi101.stdout: "time": "2023-08-01T19:54:04.459306+0000", 2023-08-01T19:55:44.816 INFO:teuthology.orchestra.run.smithi101.stdout: "duration": 2.3889999999999999e-06 2023-08-01T19:55:44.816 INFO:teuthology.orchestra.run.smithi101.stdout: }, 2023-08-01T19:55:44.816 INFO:teuthology.orchestra.run.smithi101.stdout: { 2023-08-01T19:55:44.816 INFO:teuthology.orchestra.run.smithi101.stdout: "event": "dispatched", 2023-08-01T19:55:44.816 INFO:teuthology.orchestra.run.smithi101.stdout: "time": "2023-08-01T19:54:04.459314+0000", 2023-08-01T19:55:44.816 INFO:teuthology.orchestra.run.smithi101.stdout: "duration": 7.1180000000000003e-06 2023-08-01T19:55:44.817 INFO:teuthology.orchestra.run.smithi101.stdout: }, 2023-08-01T19:55:44.817 INFO:teuthology.orchestra.run.smithi101.stdout: { 2023-08-01T19:55:44.817 INFO:teuthology.orchestra.run.smithi101.stdout: "event": "queued_for_pg", 2023-08-01T19:55:44.817 INFO:teuthology.orchestra.run.smithi101.stdout: "time": "2023-08-01T19:54:04.459318+0000", 2023-08-01T19:55:44.817 INFO:teuthology.orchestra.run.smithi101.stdout: "duration": 4.0239999999999999e-06 2023-08-01T19:55:44.817 INFO:teuthology.orchestra.run.smithi101.stdout: }, 2023-08-01T19:55:44.817 INFO:teuthology.orchestra.run.smithi101.stdout: { 2023-08-01T19:55:44.817 INFO:teuthology.orchestra.run.smithi101.stdout: "event": "reached_pg", 2023-08-01T19:55:44.818 INFO:teuthology.orchestra.run.smithi101.stdout: "time": "2023-08-01T19:54:04.459340+0000", 2023-08-01T19:55:44.818 INFO:teuthology.orchestra.run.smithi101.stdout: "duration": 2.2476e-05 2023-08-01T19:55:44.818 INFO:teuthology.orchestra.run.smithi101.stdout: }, 2023-08-01T19:55:44.818 INFO:teuthology.orchestra.run.smithi101.stdout: { 2023-08-01T19:55:44.818 INFO:teuthology.orchestra.run.smithi101.stdout: "event": "waiting_for_map not empty", 2023-08-01T19:55:44.818 INFO:teuthology.orchestra.run.smithi101.stdout: "time": "2023-08-01T19:54:04.459342+0000", 2023-08-01T19:55:44.818 INFO:teuthology.orchestra.run.smithi101.stdout: "duration": 2.272e-06 2023-08-01T19:55:44.818 INFO:teuthology.orchestra.run.smithi101.stdout: }, 2023-08-01T19:55:44.819 INFO:teuthology.orchestra.run.smithi101.stdout: { 2023-08-01T19:55:44.819 INFO:teuthology.orchestra.run.smithi101.stdout: "event": "reached_pg", 2023-08-01T19:55:44.819 INFO:teuthology.orchestra.run.smithi101.stdout: "time": "2023-08-01T19:54:04.475922+0000", 2023-08-01T19:55:44.819 INFO:teuthology.orchestra.run.smithi101.stdout: "duration": 0.016579388 2023-08-01T19:55:44.819 INFO:teuthology.orchestra.run.smithi101.stdout: }, 2023-08-01T19:55:44.819 INFO:teuthology.orchestra.run.smithi101.stdout: { 2023-08-01T19:55:44.819 INFO:teuthology.orchestra.run.smithi101.stdout: "event": "started", 2023-08-01T19:55:44.819 INFO:teuthology.orchestra.run.smithi101.stdout: "time": "2023-08-01T19:54:04.476107+0000", 2023-08-01T19:55:44.820 INFO:teuthology.orchestra.run.smithi101.stdout: "duration": 0.00018486300000000001 2023-08-01T19:55:44.820 INFO:teuthology.orchestra.run.smithi101.stdout: }, 2023-08-01T19:55:44.820 INFO:teuthology.orchestra.run.smithi101.stdout: { 2023-08-01T19:55:44.820 INFO:teuthology.orchestra.run.smithi101.stdout: "event": "done", 2023-08-01T19:55:44.820 INFO:teuthology.orchestra.run.smithi101.stdout: "time": "2023-08-01T19:54:04.480415+0000", 2023-08-01T19:55:44.820 INFO:teuthology.orchestra.run.smithi101.stdout: "duration": 0.0043084589999999997 2023-08-01T19:55:44.820 INFO:teuthology.orchestra.run.smithi101.stdout: } 2023-08-01T19:55:44.820 INFO:teuthology.orchestra.run.smithi101.stdout: ] 2023-08-01T19:55:44.821 INFO:teuthology.orchestra.run.smithi101.stdout: } 2023-08-01T19:55:44.821 INFO:teuthology.orchestra.run.smithi101.stdout: }, 2023-08-01T19:55:44.821 INFO:teuthology.orchestra.run.smithi101.stdout: { 2023-08-01T19:55:44.821 INFO:teuthology.orchestra.run.smithi101.stdout: "description": "osd_op(client.4668.0:70878 5.2 5:49b7d2be:::benchmark_data_smithi006_114134_object70877:head [set-alloc-hint object_size 65536 write_size 65536,write 0~65536] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e30)", 2023-08-01T19:55:44.821 INFO:teuthology.orchestra.run.smithi101.stdout: "initiated_at": "2023-08-01T19:54:50.210223+0000", 2023-08-01T19:55:44.821 INFO:teuthology.orchestra.run.smithi101.stdout: "age": 54.541135850000003, 2023-08-01T19:55:44.821 INFO:teuthology.orchestra.run.smithi101.stdout: "duration": 0.019884895, 2023-08-01T19:55:44.822 INFO:teuthology.orchestra.run.smithi101.stdout: "type_data": { 2023-08-01T19:55:44.822 INFO:teuthology.orchestra.run.smithi101.stdout: "flag_point": "commit sent; apply or cleanup", 2023-08-01T19:55:44.822 INFO:teuthology.orchestra.run.smithi101.stdout: "client_info": { 2023-08-01T19:55:44.822 INFO:teuthology.orchestra.run.smithi101.stdout: "client": "client.4668", 2023-08-01T19:55:44.822 INFO:teuthology.orchestra.run.smithi101.stdout: "client_addr": "172.21.15.6:0/1709472247", 2023-08-01T19:55:44.822 INFO:teuthology.orchestra.run.smithi101.stdout: "tid": 70878 2023-08-01T19:55:44.822 INFO:teuthology.orchestra.run.smithi101.stdout: }, 2023-08-01T19:55:44.822 INFO:teuthology.orchestra.run.smithi101.stdout: "events": [ 2023-08-01T19:55:44.823 INFO:teuthology.orchestra.run.smithi101.stdout: { 2023-08-01T19:55:44.823 INFO:teuthology.orchestra.run.smithi101.stdout: "event": "initiated", 2023-08-01T19:55:44.823 INFO:teuthology.orchestra.run.smithi101.stdout: "time": "2023-08-01T19:54:50.210223+0000", 2023-08-01T19:55:44.823 INFO:teuthology.orchestra.run.smithi101.stdout: "duration": 0 2023-08-01T19:55:44.823 INFO:teuthology.orchestra.run.smithi101.stdout: }, 2023-08-01T19:55:44.823 INFO:teuthology.orchestra.run.smithi101.stdout: { 2023-08-01T19:55:44.823 INFO:teuthology.orchestra.run.smithi101.stdout: "event": "throttled", 2023-08-01T19:55:44.823 INFO:teuthology.orchestra.run.smithi101.stdout: "time": "2023-08-01T19:54:50.210223+0000", 2023-08-01T19:55:44.824 INFO:teuthology.orchestra.run.smithi101.stdout: "duration": 0 2023-08-01T19:55:44.824 INFO:teuthology.orchestra.run.smithi101.stdout: }, 2023-08-01T19:55:44.824 INFO:teuthology.orchestra.run.smithi101.stdout: { 2023-08-01T19:55:44.824 INFO:teuthology.orchestra.run.smithi101.stdout: "event": "header_read", 2023-08-01T19:55:44.824 INFO:teuthology.orchestra.run.smithi101.stdout: "time": "2023-08-01T19:54:50.210222+0000", 2023-08-01T19:55:44.824 INFO:teuthology.orchestra.run.smithi101.stdout: "duration": 4294967295.999999 2023-08-01T19:55:44.824 INFO:teuthology.orchestra.run.smithi101.stdout: }, 2023-08-01T19:55:44.824 INFO:teuthology.orchestra.run.smithi101.stdout: { 2023-08-01T19:55:44.825 INFO:teuthology.orchestra.run.smithi101.stdout: "event": "all_read", 2023-08-01T19:55:44.825 INFO:teuthology.orchestra.run.smithi101.stdout: "time": "2023-08-01T19:54:50.210315+0000", 2023-08-01T19:55:44.825 INFO:teuthology.orchestra.run.smithi101.stdout: "duration": 9.2567999999999999e-05 2023-08-01T19:55:44.825 INFO:teuthology.orchestra.run.smithi101.stdout: }, 2023-08-01T19:55:44.825 INFO:teuthology.orchestra.run.smithi101.stdout: { 2023-08-01T19:55:44.825 INFO:teuthology.orchestra.run.smithi101.stdout: "event": "dispatched", 2023-08-01T19:55:44.825 INFO:teuthology.orchestra.run.smithi101.stdout: "time": "2023-08-01T19:54:50.210326+0000", 2023-08-01T19:55:44.825 INFO:teuthology.orchestra.run.smithi101.stdout: "duration": 1.1430000000000001e-05 2023-08-01T19:55:44.826 INFO:teuthology.orchestra.run.smithi101.stdout: }, 2023-08-01T19:55:44.826 INFO:teuthology.orchestra.run.smithi101.stdout: { 2023-08-01T19:55:44.826 INFO:teuthology.orchestra.run.smithi101.stdout: "event": "queued_for_pg", 2023-08-01T19:55:44.826 INFO:teuthology.orchestra.run.smithi101.stdout: "time": "2023-08-01T19:54:50.210332+0000", 2023-08-01T19:55:44.826 INFO:teuthology.orchestra.run.smithi101.stdout: "duration": 5.8479999999999997e-06 2023-08-01T19:55:44.826 INFO:teuthology.orchestra.run.smithi101.stdout: }, 2023-08-01T19:55:44.826 INFO:teuthology.orchestra.run.smithi101.stdout: { 2023-08-01T19:55:44.826 INFO:teuthology.orchestra.run.smithi101.stdout: "event": "reached_pg", 2023-08-01T19:55:44.827 INFO:teuthology.orchestra.run.smithi101.stdout: "time": "2023-08-01T19:54:50.214259+0000", 2023-08-01T19:55:44.827 INFO:teuthology.orchestra.run.smithi101.stdout: "duration": 0.003926789 2023-08-01T19:55:44.827 INFO:teuthology.orchestra.run.smithi101.stdout: }, 2023-08-01T19:55:44.827 INFO:teuthology.orchestra.run.smithi101.stdout: { 2023-08-01T19:55:44.827 INFO:teuthology.orchestra.run.smithi101.stdout: "event": "started", 2023-08-01T19:55:44.827 INFO:teuthology.orchestra.run.smithi101.stdout: "time": "2023-08-01T19:54:50.214387+0000", 2023-08-01T19:55:44.827 INFO:teuthology.orchestra.run.smithi101.stdout: "duration": 0.00012787599999999999 2023-08-01T19:55:44.827 INFO:teuthology.orchestra.run.smithi101.stdout: }, 2023-08-01T19:55:44.828 INFO:teuthology.orchestra.run.smithi101.stdout: { 2023-08-01T19:55:44.828 INFO:teuthology.orchestra.run.smithi101.stdout: "event": "waiting for subops from 0", 2023-08-01T19:55:44.828 INFO:teuthology.orchestra.run.smithi101.stdout: "time": "2023-08-01T19:54:50.214536+0000", 2023-08-01T19:55:44.828 INFO:teuthology.orchestra.run.smithi101.stdout: "duration": 0.00014935299999999999 2023-08-01T19:55:44.828 INFO:teuthology.orchestra.run.smithi101.stdout: }, 2023-08-01T19:55:44.828 INFO:teuthology.orchestra.run.smithi101.stdout: { 2023-08-01T19:55:44.828 INFO:teuthology.orchestra.run.smithi101.stdout: "event": "op_commit", 2023-08-01T19:55:44.828 INFO:teuthology.orchestra.run.smithi101.stdout: "time": "2023-08-01T19:54:50.217739+0000", 2023-08-01T19:55:44.829 INFO:teuthology.orchestra.run.smithi101.stdout: "duration": 0.0032034619999999998 2023-08-01T19:55:44.829 INFO:teuthology.orchestra.run.smithi101.stdout: }, 2023-08-01T19:55:44.829 INFO:teuthology.orchestra.run.smithi101.stdout: { 2023-08-01T19:55:44.829 INFO:teuthology.orchestra.run.smithi101.stdout: "event": "sub_op_commit_rec", 2023-08-01T19:55:44.829 INFO:teuthology.orchestra.run.smithi101.stdout: "time": "2023-08-01T19:54:50.230032+0000", 2023-08-01T19:55:44.829 INFO:teuthology.orchestra.run.smithi101.stdout: "duration": 0.012293068000000001 2023-08-01T19:55:44.829 INFO:teuthology.orchestra.run.smithi101.stdout: }, 2023-08-01T19:55:44.830 INFO:teuthology.orchestra.run.smithi101.stdout: { 2023-08-01T19:55:44.830 INFO:teuthology.orchestra.run.smithi101.stdout: "event": "commit_sent", 2023-08-01T19:55:44.830 INFO:teuthology.orchestra.run.smithi101.stdout: "time": "2023-08-01T19:54:50.230075+0000", 2023-08-01T19:55:44.830 INFO:teuthology.orchestra.run.smithi101.stdout: "duration": 4.3062999999999997e-05 2023-08-01T19:55:44.830 INFO:teuthology.orchestra.run.smithi101.stdout: }, 2023-08-01T19:55:44.830 INFO:teuthology.orchestra.run.smithi101.stdout: { 2023-08-01T19:55:44.830 INFO:teuthology.orchestra.run.smithi101.stdout: "event": "done", 2023-08-01T19:55:44.830 INFO:teuthology.orchestra.run.smithi101.stdout: "time": "2023-08-01T19:54:50.230108+0000", 2023-08-01T19:55:44.831 INFO:teuthology.orchestra.run.smithi101.stdout: "duration": 3.2366999999999997e-05 2023-08-01T19:55:44.831 INFO:teuthology.orchestra.run.smithi101.stdout: } 2023-08-01T19:55:44.831 INFO:teuthology.orchestra.run.smithi101.stdout: ] 2023-08-01T19:55:44.831 INFO:teuthology.orchestra.run.smithi101.stdout: } 2023-08-01T19:55:44.831 INFO:teuthology.orchestra.run.smithi101.stdout: }, 2023-08-01T19:55:44.831 INFO:teuthology.orchestra.run.smithi101.stdout: { 2023-08-01T19:55:44.831 INFO:teuthology.orchestra.run.smithi101.stdout: "description": "osd_op(client.4668.0:73460 5.f 5:ff4f0704:::benchmark_data_smithi006_114134_object73459:head [set-alloc-hint object_size 65536 write_size 65536,write 0~65536] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e31)", 2023-08-01T19:55:44.831 INFO:teuthology.orchestra.run.smithi101.stdout: "initiated_at": "2023-08-01T19:54:51.462968+0000", 2023-08-01T19:55:44.832 INFO:teuthology.orchestra.run.smithi101.stdout: "age": 53.288390970999998, 2023-08-01T19:55:44.832 INFO:teuthology.orchestra.run.smithi101.stdout: "duration": 0.020056502, 2023-08-01T19:55:44.832 INFO:teuthology.orchestra.run.smithi101.stdout: "type_data": { 2023-08-01T19:55:44.832 INFO:teuthology.orchestra.run.smithi101.stdout: "flag_point": "commit sent; apply or cleanup", 2023-08-01T19:55:44.832 INFO:teuthology.orchestra.run.smithi101.stdout: "client_info": { 2023-08-01T19:55:44.832 INFO:teuthology.orchestra.run.smithi101.stdout: "client": "client.4668", 2023-08-01T19:55:44.832 INFO:teuthology.orchestra.run.smithi101.stdout: "client_addr": "172.21.15.6:0/1709472247", 2023-08-01T19:55:44.832 INFO:teuthology.orchestra.run.smithi101.stdout: "tid": 73460 2023-08-01T19:55:44.833 INFO:teuthology.orchestra.run.smithi101.stdout: }, 2023-08-01T19:55:44.833 INFO:teuthology.orchestra.run.smithi101.stdout: "events": [ 2023-08-01T19:55:44.833 INFO:teuthology.orchestra.run.smithi101.stdout: { 2023-08-01T19:55:44.833 INFO:teuthology.orchestra.run.smithi101.stdout: "event": "initiated", 2023-08-01T19:55:44.833 INFO:teuthology.orchestra.run.smithi101.stdout: "time": "2023-08-01T19:54:51.462968+0000", 2023-08-01T19:55:44.833 INFO:teuthology.orchestra.run.smithi101.stdout: "duration": 0 2023-08-01T19:55:44.833 INFO:teuthology.orchestra.run.smithi101.stdout: }, 2023-08-01T19:55:44.833 INFO:teuthology.orchestra.run.smithi101.stdout: { 2023-08-01T19:55:44.834 INFO:teuthology.orchestra.run.smithi101.stdout: "event": "throttled", 2023-08-01T19:55:44.834 INFO:teuthology.orchestra.run.smithi101.stdout: "time": "2023-08-01T19:54:51.462968+0000", 2023-08-01T19:55:44.834 INFO:teuthology.orchestra.run.smithi101.stdout: "duration": 0 2023-08-01T19:55:44.834 INFO:teuthology.orchestra.run.smithi101.stdout: }, 2023-08-01T19:55:44.834 INFO:teuthology.orchestra.run.smithi101.stdout: { 2023-08-01T19:55:44.834 INFO:teuthology.orchestra.run.smithi101.stdout: "event": "header_read", 2023-08-01T19:55:44.834 INFO:teuthology.orchestra.run.smithi101.stdout: "time": "2023-08-01T19:54:51.462967+0000", 2023-08-01T19:55:44.835 INFO:teuthology.orchestra.run.smithi101.stdout: "duration": 4294967295.999999 2023-08-01T19:55:44.835 INFO:teuthology.orchestra.run.smithi101.stdout: }, 2023-08-01T19:55:44.835 INFO:teuthology.orchestra.run.smithi101.stdout: { 2023-08-01T19:55:44.835 INFO:teuthology.orchestra.run.smithi101.stdout: "event": "all_read", 2023-08-01T19:55:44.835 INFO:teuthology.orchestra.run.smithi101.stdout: "time": "2023-08-01T19:54:51.463009+0000", 2023-08-01T19:55:44.835 INFO:teuthology.orchestra.run.smithi101.stdout: "duration": 4.2106e-05 2023-08-01T19:55:44.835 INFO:teuthology.orchestra.run.smithi101.stdout: }, 2023-08-01T19:55:44.835 INFO:teuthology.orchestra.run.smithi101.stdout: { 2023-08-01T19:55:44.836 INFO:teuthology.orchestra.run.smithi101.stdout: "event": "dispatched", 2023-08-01T19:55:44.836 INFO:teuthology.orchestra.run.smithi101.stdout: "time": "2023-08-01T19:54:51.463017+0000", 2023-08-01T19:55:44.836 INFO:teuthology.orchestra.run.smithi101.stdout: "duration": 8.1529999999999997e-06 2023-08-01T19:55:44.836 INFO:teuthology.orchestra.run.smithi101.stdout: }, 2023-08-01T19:55:44.836 INFO:teuthology.orchestra.run.smithi101.stdout: { 2023-08-01T19:55:44.836 INFO:teuthology.orchestra.run.smithi101.stdout: "event": "queued_for_pg", 2023-08-01T19:55:44.837 INFO:teuthology.orchestra.run.smithi101.stdout: "time": "2023-08-01T19:54:51.463027+0000", 2023-08-01T19:55:44.837 INFO:teuthology.orchestra.run.smithi101.stdout: "duration": 9.5659999999999996e-06 2023-08-01T19:55:44.837 INFO:teuthology.orchestra.run.smithi101.stdout: }, 2023-08-01T19:55:44.837 INFO:teuthology.orchestra.run.smithi101.stdout: { 2023-08-01T19:55:44.837 INFO:teuthology.orchestra.run.smithi101.stdout: "event": "reached_pg", 2023-08-01T19:55:44.837 INFO:teuthology.orchestra.run.smithi101.stdout: "time": "2023-08-01T19:54:51.463062+0000", 2023-08-01T19:55:44.838 INFO:teuthology.orchestra.run.smithi101.stdout: "duration": 3.5442999999999999e-05 2023-08-01T19:55:44.838 INFO:teuthology.orchestra.run.smithi101.stdout: }, 2023-08-01T19:55:44.838 INFO:teuthology.orchestra.run.smithi101.stdout: { 2023-08-01T19:55:44.838 INFO:teuthology.orchestra.run.smithi101.stdout: "event": "started", 2023-08-01T19:55:44.838 INFO:teuthology.orchestra.run.smithi101.stdout: "time": "2023-08-01T19:54:51.463198+0000", 2023-08-01T19:55:44.838 INFO:teuthology.orchestra.run.smithi101.stdout: "duration": 0.000135628 2023-08-01T19:55:44.838 INFO:teuthology.orchestra.run.smithi101.stdout: }, 2023-08-01T19:55:44.839 INFO:teuthology.orchestra.run.smithi101.stdout: { 2023-08-01T19:55:44.839 INFO:teuthology.orchestra.run.smithi101.stdout: "event": "waiting for subops from 2", 2023-08-01T19:55:44.839 INFO:teuthology.orchestra.run.smithi101.stdout: "time": "2023-08-01T19:54:51.463341+0000", 2023-08-01T19:55:44.839 INFO:teuthology.orchestra.run.smithi101.stdout: "duration": 0.00014346500000000001 2023-08-01T19:55:44.839 INFO:teuthology.orchestra.run.smithi101.stdout: }, 2023-08-01T19:55:44.839 INFO:teuthology.orchestra.run.smithi101.stdout: { 2023-08-01T19:55:44.839 INFO:teuthology.orchestra.run.smithi101.stdout: "event": "op_commit", 2023-08-01T19:55:44.839 INFO:teuthology.orchestra.run.smithi101.stdout: "time": "2023-08-01T19:54:51.472684+0000", 2023-08-01T19:55:44.840 INFO:teuthology.orchestra.run.smithi101.stdout: "duration": 0.0093427900000000001 2023-08-01T19:55:44.840 INFO:teuthology.orchestra.run.smithi101.stdout: }, 2023-08-01T19:55:44.840 INFO:teuthology.orchestra.run.smithi101.stdout: { 2023-08-01T19:55:44.840 INFO:teuthology.orchestra.run.smithi101.stdout: "event": "sub_op_commit_rec", 2023-08-01T19:55:44.840 INFO:teuthology.orchestra.run.smithi101.stdout: "time": "2023-08-01T19:54:51.482937+0000", 2023-08-01T19:55:44.840 INFO:teuthology.orchestra.run.smithi101.stdout: "duration": 0.010252557000000001 2023-08-01T19:55:44.840 INFO:teuthology.orchestra.run.smithi101.stdout: }, 2023-08-01T19:55:44.840 INFO:teuthology.orchestra.run.smithi101.stdout: { 2023-08-01T19:55:44.841 INFO:teuthology.orchestra.run.smithi101.stdout: "event": "commit_sent", 2023-08-01T19:55:44.841 INFO:teuthology.orchestra.run.smithi101.stdout: "time": "2023-08-01T19:54:51.482984+0000", 2023-08-01T19:55:44.841 INFO:teuthology.orchestra.run.smithi101.stdout: "duration": 4.7394000000000001e-05 2023-08-01T19:55:44.841 INFO:teuthology.orchestra.run.smithi101.stdout: }, 2023-08-01T19:55:44.841 INFO:teuthology.orchestra.run.smithi101.stdout: { 2023-08-01T19:55:44.841 INFO:teuthology.orchestra.run.smithi101.stdout: "event": "done", 2023-08-01T19:55:44.841 INFO:teuthology.orchestra.run.smithi101.stdout: "time": "2023-08-01T19:54:51.483024+0000", 2023-08-01T19:55:44.841 INFO:teuthology.orchestra.run.smithi101.stdout: "duration": 4.0159e-05 2023-08-01T19:55:44.842 INFO:teuthology.orchestra.run.smithi101.stdout: } 2023-08-01T19:55:44.842 INFO:teuthology.orchestra.run.smithi101.stdout: ] 2023-08-01T19:55:44.842 INFO:teuthology.orchestra.run.smithi101.stdout: } 2023-08-01T19:55:44.842 INFO:teuthology.orchestra.run.smithi101.stdout: }, 2023-08-01T19:55:44.842 INFO:teuthology.orchestra.run.smithi101.stdout: { 2023-08-01T19:55:44.842 INFO:teuthology.orchestra.run.smithi101.stdout: "description": "osd_op(client.4668.0:92726 5.2 5:41e18163:::benchmark_data_smithi006_114134_object92725:head [set-alloc-hint object_size 65536 write_size 65536,write 0~65536] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e36)", 2023-08-01T19:55:44.842 INFO:teuthology.orchestra.run.smithi101.stdout: "initiated_at": "2023-08-01T19:55:01.256971+0000", 2023-08-01T19:55:44.842 INFO:teuthology.orchestra.run.smithi101.stdout: "age": 43.494387891999999, 2023-08-01T19:55:44.843 INFO:teuthology.orchestra.run.smithi101.stdout: "duration": 0.019854296, 2023-08-01T19:55:44.843 INFO:teuthology.orchestra.run.smithi101.stdout: "type_data": { 2023-08-01T19:55:44.843 INFO:teuthology.orchestra.run.smithi101.stdout: "flag_point": "commit sent; apply or cleanup", 2023-08-01T19:55:44.843 INFO:teuthology.orchestra.run.smithi101.stdout: "client_info": { 2023-08-01T19:55:44.843 INFO:teuthology.orchestra.run.smithi101.stdout: "client": "client.4668", 2023-08-01T19:55:44.843 INFO:teuthology.orchestra.run.smithi101.stdout: "client_addr": "172.21.15.6:0/1709472247", 2023-08-01T19:55:44.843 INFO:teuthology.orchestra.run.smithi101.stdout: "tid": 92726 2023-08-01T19:55:44.844 INFO:teuthology.orchestra.run.smithi101.stdout: }, 2023-08-01T19:55:44.844 INFO:teuthology.orchestra.run.smithi101.stdout: "events": [ 2023-08-01T19:55:44.844 INFO:teuthology.orchestra.run.smithi101.stdout: { 2023-08-01T19:55:44.844 INFO:teuthology.orchestra.run.smithi101.stdout: "event": "initiated", 2023-08-01T19:55:44.844 INFO:teuthology.orchestra.run.smithi101.stdout: "time": "2023-08-01T19:55:01.256971+0000", 2023-08-01T19:55:44.844 INFO:teuthology.orchestra.run.smithi101.stdout: "duration": 0 2023-08-01T19:55:44.844 INFO:teuthology.orchestra.run.smithi101.stdout: }, 2023-08-01T19:55:44.844 INFO:teuthology.orchestra.run.smithi101.stdout: { 2023-08-01T19:55:44.845 INFO:teuthology.orchestra.run.smithi101.stdout: "event": "throttled", 2023-08-01T19:55:44.845 INFO:teuthology.orchestra.run.smithi101.stdout: "time": "2023-08-01T19:55:01.256971+0000", 2023-08-01T19:55:44.845 INFO:teuthology.orchestra.run.smithi101.stdout: "duration": 0 2023-08-01T19:55:44.845 INFO:teuthology.orchestra.run.smithi101.stdout: }, 2023-08-01T19:55:44.845 INFO:teuthology.orchestra.run.smithi101.stdout: { 2023-08-01T19:55:44.845 INFO:teuthology.orchestra.run.smithi101.stdout: "event": "header_read", 2023-08-01T19:55:44.845 INFO:teuthology.orchestra.run.smithi101.stdout: "time": "2023-08-01T19:55:01.256970+0000", 2023-08-01T19:55:44.845 INFO:teuthology.orchestra.run.smithi101.stdout: "duration": 4294967295.9999995 2023-08-01T19:55:44.846 INFO:teuthology.orchestra.run.smithi101.stdout: }, 2023-08-01T19:55:44.846 INFO:teuthology.orchestra.run.smithi101.stdout: { 2023-08-01T19:55:44.846 INFO:teuthology.orchestra.run.smithi101.stdout: "event": "all_read", 2023-08-01T19:55:44.846 INFO:teuthology.orchestra.run.smithi101.stdout: "time": "2023-08-01T19:55:01.257057+0000", 2023-08-01T19:55:44.846 INFO:teuthology.orchestra.run.smithi101.stdout: "duration": 8.6627999999999998e-05 2023-08-01T19:55:44.846 INFO:teuthology.orchestra.run.smithi101.stdout: }, 2023-08-01T19:55:44.846 INFO:teuthology.orchestra.run.smithi101.stdout: { 2023-08-01T19:55:44.846 INFO:teuthology.orchestra.run.smithi101.stdout: "event": "dispatched", 2023-08-01T19:55:44.847 INFO:teuthology.orchestra.run.smithi101.stdout: "time": "2023-08-01T19:55:01.257063+0000", 2023-08-01T19:55:44.847 INFO:teuthology.orchestra.run.smithi101.stdout: "duration": 6.528e-06 2023-08-01T19:55:44.847 INFO:teuthology.orchestra.run.smithi101.stdout: }, 2023-08-01T19:55:44.847 INFO:teuthology.orchestra.run.smithi101.stdout: { 2023-08-01T19:55:44.847 INFO:teuthology.orchestra.run.smithi101.stdout: "event": "queued_for_pg", 2023-08-01T19:55:44.847 INFO:teuthology.orchestra.run.smithi101.stdout: "time": "2023-08-01T19:55:01.257067+0000", 2023-08-01T19:55:44.847 INFO:teuthology.orchestra.run.smithi101.stdout: "duration": 3.2739999999999999e-06 2023-08-01T19:55:44.847 INFO:teuthology.orchestra.run.smithi101.stdout: }, 2023-08-01T19:55:44.848 INFO:teuthology.orchestra.run.smithi101.stdout: { 2023-08-01T19:55:44.848 INFO:teuthology.orchestra.run.smithi101.stdout: "event": "reached_pg", 2023-08-01T19:55:44.848 INFO:teuthology.orchestra.run.smithi101.stdout: "time": "2023-08-01T19:55:01.259714+0000", 2023-08-01T19:55:44.848 INFO:teuthology.orchestra.run.smithi101.stdout: "duration": 0.0026476709999999999 2023-08-01T19:55:44.848 INFO:teuthology.orchestra.run.smithi101.stdout: }, 2023-08-01T19:55:44.848 INFO:teuthology.orchestra.run.smithi101.stdout: { 2023-08-01T19:55:44.848 INFO:teuthology.orchestra.run.smithi101.stdout: "event": "started", 2023-08-01T19:55:44.848 INFO:teuthology.orchestra.run.smithi101.stdout: "time": "2023-08-01T19:55:01.259829+0000", 2023-08-01T19:55:44.849 INFO:teuthology.orchestra.run.smithi101.stdout: "duration": 0.000114471 2023-08-01T19:55:44.849 INFO:teuthology.orchestra.run.smithi101.stdout: }, 2023-08-01T19:55:44.849 INFO:teuthology.orchestra.run.smithi101.stdout: { 2023-08-01T19:55:44.849 INFO:teuthology.orchestra.run.smithi101.stdout: "event": "waiting for subops from 0", 2023-08-01T19:55:44.849 INFO:teuthology.orchestra.run.smithi101.stdout: "time": "2023-08-01T19:55:01.259965+0000", 2023-08-01T19:55:44.849 INFO:teuthology.orchestra.run.smithi101.stdout: "duration": 0.00013597300000000001 2023-08-01T19:55:44.849 INFO:teuthology.orchestra.run.smithi101.stdout: }, 2023-08-01T19:55:44.850 INFO:teuthology.orchestra.run.smithi101.stdout: { 2023-08-01T19:55:44.850 INFO:teuthology.orchestra.run.smithi101.stdout: "event": "op_commit", 2023-08-01T19:55:44.850 INFO:teuthology.orchestra.run.smithi101.stdout: "time": "2023-08-01T19:55:01.264360+0000", 2023-08-01T19:55:44.850 INFO:teuthology.orchestra.run.smithi101.stdout: "duration": 0.0043956619999999998 2023-08-01T19:55:44.850 INFO:teuthology.orchestra.run.smithi101.stdout: }, 2023-08-01T19:55:44.850 INFO:teuthology.orchestra.run.smithi101.stdout: { 2023-08-01T19:55:44.850 INFO:teuthology.orchestra.run.smithi101.stdout: "event": "sub_op_commit_rec", 2023-08-01T19:55:44.850 INFO:teuthology.orchestra.run.smithi101.stdout: "time": "2023-08-01T19:55:01.276766+0000", 2023-08-01T19:55:44.851 INFO:teuthology.orchestra.run.smithi101.stdout: "duration": 0.012405736000000001 2023-08-01T19:55:44.851 INFO:teuthology.orchestra.run.smithi101.stdout: }, 2023-08-01T19:55:44.851 INFO:teuthology.orchestra.run.smithi101.stdout: { 2023-08-01T19:55:44.851 INFO:teuthology.orchestra.run.smithi101.stdout: "event": "commit_sent", 2023-08-01T19:55:44.851 INFO:teuthology.orchestra.run.smithi101.stdout: "time": "2023-08-01T19:55:01.276804+0000", 2023-08-01T19:55:44.851 INFO:teuthology.orchestra.run.smithi101.stdout: "duration": 3.7759999999999998e-05 2023-08-01T19:55:44.851 INFO:teuthology.orchestra.run.smithi101.stdout: }, 2023-08-01T19:55:44.851 INFO:teuthology.orchestra.run.smithi101.stdout: { 2023-08-01T19:55:44.852 INFO:teuthology.orchestra.run.smithi101.stdout: "event": "done", 2023-08-01T19:55:44.852 INFO:teuthology.orchestra.run.smithi101.stdout: "time": "2023-08-01T19:55:01.276825+0000", 2023-08-01T19:55:44.852 INFO:teuthology.orchestra.run.smithi101.stdout: "duration": 2.1299000000000001e-05 2023-08-01T19:55:44.852 INFO:teuthology.orchestra.run.smithi101.stdout: } 2023-08-01T19:55:44.852 INFO:teuthology.orchestra.run.smithi101.stdout: ] 2023-08-01T19:55:44.852 INFO:teuthology.orchestra.run.smithi101.stdout: } 2023-08-01T19:55:44.852 INFO:teuthology.orchestra.run.smithi101.stdout: }, 2023-08-01T19:55:44.852 INFO:teuthology.orchestra.run.smithi101.stdout: { 2023-08-01T19:55:44.853 INFO:teuthology.orchestra.run.smithi101.stdout: "description": "osd_op(client.4668.0:100244 5.9 5:92f56a12:::benchmark_data_smithi006_114134_object100243:head [set-alloc-hint object_size 65536 write_size 65536,write 0~65536] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e37)", 2023-08-01T19:55:44.853 INFO:teuthology.orchestra.run.smithi101.stdout: "initiated_at": "2023-08-01T19:55:05.150910+0000", 2023-08-01T19:55:44.853 INFO:teuthology.orchestra.run.smithi101.stdout: "age": 39.600449075999997, 2023-08-01T19:55:44.853 INFO:teuthology.orchestra.run.smithi101.stdout: "duration": 0.072864287, 2023-08-01T19:55:44.853 INFO:teuthology.orchestra.run.smithi101.stdout: "type_data": { 2023-08-01T19:55:44.853 INFO:teuthology.orchestra.run.smithi101.stdout: "flag_point": "commit sent; apply or cleanup", 2023-08-01T19:55:44.853 INFO:teuthology.orchestra.run.smithi101.stdout: "client_info": { 2023-08-01T19:55:44.853 INFO:teuthology.orchestra.run.smithi101.stdout: "client": "client.4668", 2023-08-01T19:55:44.854 INFO:teuthology.orchestra.run.smithi101.stdout: "client_addr": "172.21.15.6:0/1709472247", 2023-08-01T19:55:44.854 INFO:teuthology.orchestra.run.smithi101.stdout: "tid": 100244 2023-08-01T19:55:44.854 INFO:teuthology.orchestra.run.smithi101.stdout: }, 2023-08-01T19:55:44.854 INFO:teuthology.orchestra.run.smithi101.stdout: "events": [ 2023-08-01T19:55:44.854 INFO:teuthology.orchestra.run.smithi101.stdout: { 2023-08-01T19:55:44.854 INFO:teuthology.orchestra.run.smithi101.stdout: "event": "initiated", 2023-08-01T19:55:44.854 INFO:teuthology.orchestra.run.smithi101.stdout: "time": "2023-08-01T19:55:05.150910+0000", 2023-08-01T19:55:44.855 INFO:teuthology.orchestra.run.smithi101.stdout: "duration": 0 2023-08-01T19:55:44.855 INFO:teuthology.orchestra.run.smithi101.stdout: }, 2023-08-01T19:55:44.855 INFO:teuthology.orchestra.run.smithi101.stdout: { 2023-08-01T19:55:44.855 INFO:teuthology.orchestra.run.smithi101.stdout: "event": "throttled", 2023-08-01T19:55:44.855 INFO:teuthology.orchestra.run.smithi101.stdout: "time": "2023-08-01T19:55:05.150910+0000", 2023-08-01T19:55:44.855 INFO:teuthology.orchestra.run.smithi101.stdout: "duration": 0 2023-08-01T19:55:44.855 INFO:teuthology.orchestra.run.smithi101.stdout: }, 2023-08-01T19:55:44.855 INFO:teuthology.orchestra.run.smithi101.stdout: { 2023-08-01T19:55:44.856 INFO:teuthology.orchestra.run.smithi101.stdout: "event": "header_read", 2023-08-01T19:55:44.856 INFO:teuthology.orchestra.run.smithi101.stdout: "time": "2023-08-01T19:55:05.150909+0000", 2023-08-01T19:55:44.856 INFO:teuthology.orchestra.run.smithi101.stdout: "duration": 4294967295.999999 2023-08-01T19:55:44.856 INFO:teuthology.orchestra.run.smithi101.stdout: }, 2023-08-01T19:55:44.856 INFO:teuthology.orchestra.run.smithi101.stdout: { 2023-08-01T19:55:44.856 INFO:teuthology.orchestra.run.smithi101.stdout: "event": "all_read", 2023-08-01T19:55:44.856 INFO:teuthology.orchestra.run.smithi101.stdout: "time": "2023-08-01T19:55:05.150973+0000", 2023-08-01T19:55:44.856 INFO:teuthology.orchestra.run.smithi101.stdout: "duration": 6.4531999999999998e-05 2023-08-01T19:55:44.857 INFO:teuthology.orchestra.run.smithi101.stdout: }, 2023-08-01T19:55:44.857 INFO:teuthology.orchestra.run.smithi101.stdout: { 2023-08-01T19:55:44.857 INFO:teuthology.orchestra.run.smithi101.stdout: "event": "dispatched", 2023-08-01T19:55:44.857 INFO:teuthology.orchestra.run.smithi101.stdout: "time": "2023-08-01T19:55:05.150984+0000", 2023-08-01T19:55:44.857 INFO:teuthology.orchestra.run.smithi101.stdout: "duration": 1.0287e-05 2023-08-01T19:55:44.857 INFO:teuthology.orchestra.run.smithi101.stdout: }, 2023-08-01T19:55:44.857 INFO:teuthology.orchestra.run.smithi101.stdout: { 2023-08-01T19:55:44.857 INFO:teuthology.orchestra.run.smithi101.stdout: "event": "queued_for_pg", 2023-08-01T19:55:44.858 INFO:teuthology.orchestra.run.smithi101.stdout: "time": "2023-08-01T19:55:05.150989+0000", 2023-08-01T19:55:44.858 INFO:teuthology.orchestra.run.smithi101.stdout: "duration": 5.3929999999999999e-06 2023-08-01T19:55:44.858 INFO:teuthology.orchestra.run.smithi101.stdout: }, 2023-08-01T19:55:44.858 INFO:teuthology.orchestra.run.smithi101.stdout: { 2023-08-01T19:55:44.858 INFO:teuthology.orchestra.run.smithi101.stdout: "event": "reached_pg", 2023-08-01T19:55:44.858 INFO:teuthology.orchestra.run.smithi101.stdout: "time": "2023-08-01T19:55:05.151034+0000", 2023-08-01T19:55:44.858 INFO:teuthology.orchestra.run.smithi101.stdout: "duration": 4.4336999999999999e-05 2023-08-01T19:55:44.858 INFO:teuthology.orchestra.run.smithi101.stdout: }, 2023-08-01T19:55:44.859 INFO:teuthology.orchestra.run.smithi101.stdout: { 2023-08-01T19:55:44.859 INFO:teuthology.orchestra.run.smithi101.stdout: "event": "started", 2023-08-01T19:55:44.859 INFO:teuthology.orchestra.run.smithi101.stdout: "time": "2023-08-01T19:55:05.151167+0000", 2023-08-01T19:55:44.859 INFO:teuthology.orchestra.run.smithi101.stdout: "duration": 0.00013368899999999999 2023-08-01T19:55:44.859 INFO:teuthology.orchestra.run.smithi101.stdout: }, 2023-08-01T19:55:44.859 INFO:teuthology.orchestra.run.smithi101.stdout: { 2023-08-01T19:55:44.859 INFO:teuthology.orchestra.run.smithi101.stdout: "event": "waiting for subops from 2", 2023-08-01T19:55:44.859 INFO:teuthology.orchestra.run.smithi101.stdout: "time": "2023-08-01T19:55:05.151328+0000", 2023-08-01T19:55:44.860 INFO:teuthology.orchestra.run.smithi101.stdout: "duration": 0.00016122700000000001 2023-08-01T19:55:44.860 INFO:teuthology.orchestra.run.smithi101.stdout: }, 2023-08-01T19:55:44.860 INFO:teuthology.orchestra.run.smithi101.stdout: { 2023-08-01T19:55:44.860 INFO:teuthology.orchestra.run.smithi101.stdout: "event": "op_commit", 2023-08-01T19:55:44.860 INFO:teuthology.orchestra.run.smithi101.stdout: "time": "2023-08-01T19:55:05.156101+0000", 2023-08-01T19:55:44.860 INFO:teuthology.orchestra.run.smithi101.stdout: "duration": 0.0047724100000000004 2023-08-01T19:55:44.860 INFO:teuthology.orchestra.run.smithi101.stdout: }, 2023-08-01T19:55:44.861 INFO:teuthology.orchestra.run.smithi101.stdout: { 2023-08-01T19:55:44.861 INFO:teuthology.orchestra.run.smithi101.stdout: "event": "sub_op_commit_rec", 2023-08-01T19:55:44.861 INFO:teuthology.orchestra.run.smithi101.stdout: "time": "2023-08-01T19:55:05.223688+0000", 2023-08-01T19:55:44.861 INFO:teuthology.orchestra.run.smithi101.stdout: "duration": 0.067586937999999999 2023-08-01T19:55:44.861 INFO:teuthology.orchestra.run.smithi101.stdout: }, 2023-08-01T19:55:44.861 INFO:teuthology.orchestra.run.smithi101.stdout: { 2023-08-01T19:55:44.861 INFO:teuthology.orchestra.run.smithi101.stdout: "event": "commit_sent", 2023-08-01T19:55:44.861 INFO:teuthology.orchestra.run.smithi101.stdout: "time": "2023-08-01T19:55:05.223737+0000", 2023-08-01T19:55:44.862 INFO:teuthology.orchestra.run.smithi101.stdout: "duration": 4.8921999999999997e-05 2023-08-01T19:55:44.862 INFO:teuthology.orchestra.run.smithi101.stdout: }, 2023-08-01T19:55:44.862 INFO:teuthology.orchestra.run.smithi101.stdout: { 2023-08-01T19:55:44.862 INFO:teuthology.orchestra.run.smithi101.stdout: "event": "done", 2023-08-01T19:55:44.862 INFO:teuthology.orchestra.run.smithi101.stdout: "time": "2023-08-01T19:55:05.223774+0000", 2023-08-01T19:55:44.862 INFO:teuthology.orchestra.run.smithi101.stdout: "duration": 3.7342999999999998e-05 2023-08-01T19:55:44.862 INFO:teuthology.orchestra.run.smithi101.stdout: } 2023-08-01T19:55:44.862 INFO:teuthology.orchestra.run.smithi101.stdout: ] 2023-08-01T19:55:44.863 INFO:teuthology.orchestra.run.smithi101.stdout: } 2023-08-01T19:55:44.863 INFO:teuthology.orchestra.run.smithi101.stdout: }, 2023-08-01T19:55:44.863 INFO:teuthology.orchestra.run.smithi101.stdout: { 2023-08-01T19:55:44.863 INFO:teuthology.orchestra.run.smithi101.stdout: "description": "osd_op(client.4668.0:100253 5.f 5:f7bbce05:::benchmark_data_smithi006_114134_object100252:head [set-alloc-hint object_size 65536 write_size 65536,write 0~65536] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e37)", 2023-08-01T19:55:44.863 INFO:teuthology.orchestra.run.smithi101.stdout: "initiated_at": "2023-08-01T19:55:05.156562+0000", 2023-08-01T19:55:44.863 INFO:teuthology.orchestra.run.smithi101.stdout: "age": 39.594797043, 2023-08-01T19:55:44.863 INFO:teuthology.orchestra.run.smithi101.stdout: "duration": 0.068677503000000001, 2023-08-01T19:55:44.863 INFO:teuthology.orchestra.run.smithi101.stdout: "type_data": { 2023-08-01T19:55:44.864 INFO:teuthology.orchestra.run.smithi101.stdout: "flag_point": "commit sent; apply or cleanup", 2023-08-01T19:55:44.864 INFO:teuthology.orchestra.run.smithi101.stdout: "client_info": { 2023-08-01T19:55:44.864 INFO:teuthology.orchestra.run.smithi101.stdout: "client": "client.4668", 2023-08-01T19:55:44.864 INFO:teuthology.orchestra.run.smithi101.stdout: "client_addr": "172.21.15.6:0/1709472247", 2023-08-01T19:55:44.864 INFO:teuthology.orchestra.run.smithi101.stdout: "tid": 100253 2023-08-01T19:55:44.864 INFO:teuthology.orchestra.run.smithi101.stdout: }, 2023-08-01T19:55:44.864 INFO:teuthology.orchestra.run.smithi101.stdout: "events": [ 2023-08-01T19:55:44.864 INFO:teuthology.orchestra.run.smithi101.stdout: { 2023-08-01T19:55:44.865 INFO:teuthology.orchestra.run.smithi101.stdout: "event": "initiated", 2023-08-01T19:55:44.865 INFO:teuthology.orchestra.run.smithi101.stdout: "time": "2023-08-01T19:55:05.156562+0000", 2023-08-01T19:55:44.865 INFO:teuthology.orchestra.run.smithi101.stdout: "duration": 0 2023-08-01T19:55:44.865 INFO:teuthology.orchestra.run.smithi101.stdout: }, 2023-08-01T19:55:44.865 INFO:teuthology.orchestra.run.smithi101.stdout: { 2023-08-01T19:55:44.865 INFO:teuthology.orchestra.run.smithi101.stdout: "event": "throttled", 2023-08-01T19:55:44.865 INFO:teuthology.orchestra.run.smithi101.stdout: "time": "2023-08-01T19:55:05.156562+0000", 2023-08-01T19:55:44.865 INFO:teuthology.orchestra.run.smithi101.stdout: "duration": 0 2023-08-01T19:55:44.866 INFO:teuthology.orchestra.run.smithi101.stdout: }, 2023-08-01T19:55:44.866 INFO:teuthology.orchestra.run.smithi101.stdout: { 2023-08-01T19:55:44.866 INFO:teuthology.orchestra.run.smithi101.stdout: "event": "header_read", 2023-08-01T19:55:44.866 INFO:teuthology.orchestra.run.smithi101.stdout: "time": "2023-08-01T19:55:05.156561+0000", 2023-08-01T19:55:44.866 INFO:teuthology.orchestra.run.smithi101.stdout: "duration": 4294967295.999999 2023-08-01T19:55:44.866 INFO:teuthology.orchestra.run.smithi101.stdout: }, 2023-08-01T19:55:44.866 INFO:teuthology.orchestra.run.smithi101.stdout: { 2023-08-01T19:55:44.867 INFO:teuthology.orchestra.run.smithi101.stdout: "event": "all_read", 2023-08-01T19:55:44.867 INFO:teuthology.orchestra.run.smithi101.stdout: "time": "2023-08-01T19:55:05.156655+0000", 2023-08-01T19:55:44.867 INFO:teuthology.orchestra.run.smithi101.stdout: "duration": 9.4018999999999995e-05 2023-08-01T19:55:44.867 INFO:teuthology.orchestra.run.smithi101.stdout: }, 2023-08-01T19:55:44.867 INFO:teuthology.orchestra.run.smithi101.stdout: { 2023-08-01T19:55:44.867 INFO:teuthology.orchestra.run.smithi101.stdout: "event": "dispatched", 2023-08-01T19:55:44.867 INFO:teuthology.orchestra.run.smithi101.stdout: "time": "2023-08-01T19:55:05.156664+0000", 2023-08-01T19:55:44.867 INFO:teuthology.orchestra.run.smithi101.stdout: "duration": 9.4970000000000007e-06 2023-08-01T19:55:44.868 INFO:teuthology.orchestra.run.smithi101.stdout: }, 2023-08-01T19:55:44.868 INFO:teuthology.orchestra.run.smithi101.stdout: { 2023-08-01T19:55:44.868 INFO:teuthology.orchestra.run.smithi101.stdout: "event": "queued_for_pg", 2023-08-01T19:55:44.868 INFO:teuthology.orchestra.run.smithi101.stdout: "time": "2023-08-01T19:55:05.156671+0000", 2023-08-01T19:55:44.868 INFO:teuthology.orchestra.run.smithi101.stdout: "duration": 6.1929999999999998e-06 2023-08-01T19:55:44.868 INFO:teuthology.orchestra.run.smithi101.stdout: }, 2023-08-01T19:55:44.868 INFO:teuthology.orchestra.run.smithi101.stdout: { 2023-08-01T19:55:44.868 INFO:teuthology.orchestra.run.smithi101.stdout: "event": "reached_pg", 2023-08-01T19:55:44.869 INFO:teuthology.orchestra.run.smithi101.stdout: "time": "2023-08-01T19:55:05.156742+0000", 2023-08-01T19:55:44.869 INFO:teuthology.orchestra.run.smithi101.stdout: "duration": 7.1181999999999997e-05 2023-08-01T19:55:44.869 INFO:teuthology.orchestra.run.smithi101.stdout: }, 2023-08-01T19:55:44.869 INFO:teuthology.orchestra.run.smithi101.stdout: { 2023-08-01T19:55:44.869 INFO:teuthology.orchestra.run.smithi101.stdout: "event": "started", 2023-08-01T19:55:44.869 INFO:teuthology.orchestra.run.smithi101.stdout: "time": "2023-08-01T19:55:05.156839+0000", 2023-08-01T19:55:44.869 INFO:teuthology.orchestra.run.smithi101.stdout: "duration": 9.7182000000000006e-05 2023-08-01T19:55:44.869 INFO:teuthology.orchestra.run.smithi101.stdout: }, 2023-08-01T19:55:44.870 INFO:teuthology.orchestra.run.smithi101.stdout: { 2023-08-01T19:55:44.870 INFO:teuthology.orchestra.run.smithi101.stdout: "event": "waiting for subops from 2", 2023-08-01T19:55:44.870 INFO:teuthology.orchestra.run.smithi101.stdout: "time": "2023-08-01T19:55:05.156925+0000", 2023-08-01T19:55:44.870 INFO:teuthology.orchestra.run.smithi101.stdout: "duration": 8.5816000000000006e-05 2023-08-01T19:55:44.870 INFO:teuthology.orchestra.run.smithi101.stdout: }, 2023-08-01T19:55:44.870 INFO:teuthology.orchestra.run.smithi101.stdout: { 2023-08-01T19:55:44.870 INFO:teuthology.orchestra.run.smithi101.stdout: "event": "op_commit", 2023-08-01T19:55:44.870 INFO:teuthology.orchestra.run.smithi101.stdout: "time": "2023-08-01T19:55:05.160082+0000", 2023-08-01T19:55:44.871 INFO:teuthology.orchestra.run.smithi101.stdout: "duration": 0.0031573959999999998 2023-08-01T19:55:44.871 INFO:teuthology.orchestra.run.smithi101.stdout: }, 2023-08-01T19:55:44.871 INFO:teuthology.orchestra.run.smithi101.stdout: { 2023-08-01T19:55:44.871 INFO:teuthology.orchestra.run.smithi101.stdout: "event": "sub_op_commit_rec", 2023-08-01T19:55:44.871 INFO:teuthology.orchestra.run.smithi101.stdout: "time": "2023-08-01T19:55:05.225162+0000", 2023-08-01T19:55:44.871 INFO:teuthology.orchestra.run.smithi101.stdout: "duration": 0.065079466000000002 2023-08-01T19:55:44.871 INFO:teuthology.orchestra.run.smithi101.stdout: }, 2023-08-01T19:55:44.871 INFO:teuthology.orchestra.run.smithi101.stdout: { 2023-08-01T19:55:44.872 INFO:teuthology.orchestra.run.smithi101.stdout: "event": "commit_sent", 2023-08-01T19:55:44.872 INFO:teuthology.orchestra.run.smithi101.stdout: "time": "2023-08-01T19:55:05.225205+0000", 2023-08-01T19:55:44.872 INFO:teuthology.orchestra.run.smithi101.stdout: "duration": 4.3446999999999999e-05 2023-08-01T19:55:44.872 INFO:teuthology.orchestra.run.smithi101.stdout: }, 2023-08-01T19:55:44.872 INFO:teuthology.orchestra.run.smithi101.stdout: { 2023-08-01T19:55:44.872 INFO:teuthology.orchestra.run.smithi101.stdout: "event": "done", 2023-08-01T19:55:44.872 INFO:teuthology.orchestra.run.smithi101.stdout: "time": "2023-08-01T19:55:05.225239+0000", 2023-08-01T19:55:44.872 INFO:teuthology.orchestra.run.smithi101.stdout: "duration": 3.4121000000000001e-05 2023-08-01T19:55:44.873 INFO:teuthology.orchestra.run.smithi101.stdout: } 2023-08-01T19:55:44.873 INFO:teuthology.orchestra.run.smithi101.stdout: ] 2023-08-01T19:55:44.873 INFO:teuthology.orchestra.run.smithi101.stdout: } 2023-08-01T19:55:44.873 INFO:teuthology.orchestra.run.smithi101.stdout: }, 2023-08-01T19:55:44.873 INFO:teuthology.orchestra.run.smithi101.stdout: { 2023-08-01T19:55:44.873 INFO:teuthology.orchestra.run.smithi101.stdout: "description": "osd_op(client.4668.0:100928 5.7 5:e61a7dfa:::benchmark_data_smithi006_114134_object100927:head [set-alloc-hint object_size 65536 write_size 65536,write 0~65536] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e37)", 2023-08-01T19:55:44.873 INFO:teuthology.orchestra.run.smithi101.stdout: "initiated_at": "2023-08-01T19:55:05.564731+0000", 2023-08-01T19:55:44.873 INFO:teuthology.orchestra.run.smithi101.stdout: "age": 39.186627551000001, 2023-08-01T19:55:44.874 INFO:teuthology.orchestra.run.smithi101.stdout: "duration": 0.064686603999999995, 2023-08-01T19:55:44.874 INFO:teuthology.orchestra.run.smithi101.stdout: "type_data": { 2023-08-01T19:55:44.874 INFO:teuthology.orchestra.run.smithi101.stdout: "flag_point": "commit sent; apply or cleanup", 2023-08-01T19:55:44.874 INFO:teuthology.orchestra.run.smithi101.stdout: "client_info": { 2023-08-01T19:55:44.874 INFO:teuthology.orchestra.run.smithi101.stdout: "client": "client.4668", 2023-08-01T19:55:44.874 INFO:teuthology.orchestra.run.smithi101.stdout: "client_addr": "172.21.15.6:0/1709472247", 2023-08-01T19:55:44.874 INFO:teuthology.orchestra.run.smithi101.stdout: "tid": 100928 2023-08-01T19:55:44.875 INFO:teuthology.orchestra.run.smithi101.stdout: }, 2023-08-01T19:55:44.875 INFO:teuthology.orchestra.run.smithi101.stdout: "events": [ 2023-08-01T19:55:44.875 INFO:teuthology.orchestra.run.smithi101.stdout: { 2023-08-01T19:55:44.875 INFO:teuthology.orchestra.run.smithi101.stdout: "event": "initiated", 2023-08-01T19:55:44.875 INFO:teuthology.orchestra.run.smithi101.stdout: "time": "2023-08-01T19:55:05.564731+0000", 2023-08-01T19:55:44.875 INFO:teuthology.orchestra.run.smithi101.stdout: "duration": 0 2023-08-01T19:55:44.875 INFO:teuthology.orchestra.run.smithi101.stdout: }, 2023-08-01T19:55:44.875 INFO:teuthology.orchestra.run.smithi101.stdout: { 2023-08-01T19:55:44.876 INFO:teuthology.orchestra.run.smithi101.stdout: "event": "throttled", 2023-08-01T19:55:44.876 INFO:teuthology.orchestra.run.smithi101.stdout: "time": "2023-08-01T19:55:05.564731+0000", 2023-08-01T19:55:44.876 INFO:teuthology.orchestra.run.smithi101.stdout: "duration": 0 2023-08-01T19:55:44.876 INFO:teuthology.orchestra.run.smithi101.stdout: }, 2023-08-01T19:55:44.876 INFO:teuthology.orchestra.run.smithi101.stdout: { 2023-08-01T19:55:44.876 INFO:teuthology.orchestra.run.smithi101.stdout: "event": "header_read", 2023-08-01T19:55:44.876 INFO:teuthology.orchestra.run.smithi101.stdout: "time": "2023-08-01T19:55:05.564731+0000", 2023-08-01T19:55:44.876 INFO:teuthology.orchestra.run.smithi101.stdout: "duration": 4294967295.999999 2023-08-01T19:55:44.877 INFO:teuthology.orchestra.run.smithi101.stdout: }, 2023-08-01T19:55:44.877 INFO:teuthology.orchestra.run.smithi101.stdout: { 2023-08-01T19:55:44.877 INFO:teuthology.orchestra.run.smithi101.stdout: "event": "all_read", 2023-08-01T19:55:44.877 INFO:teuthology.orchestra.run.smithi101.stdout: "time": "2023-08-01T19:55:05.564832+0000", 2023-08-01T19:55:44.877 INFO:teuthology.orchestra.run.smithi101.stdout: "duration": 0.000101752 2023-08-01T19:55:44.877 INFO:teuthology.orchestra.run.smithi101.stdout: }, 2023-08-01T19:55:44.877 INFO:teuthology.orchestra.run.smithi101.stdout: { 2023-08-01T19:55:44.877 INFO:teuthology.orchestra.run.smithi101.stdout: "event": "dispatched", 2023-08-01T19:55:44.878 INFO:teuthology.orchestra.run.smithi101.stdout: "time": "2023-08-01T19:55:05.564840+0000", 2023-08-01T19:55:44.878 INFO:teuthology.orchestra.run.smithi101.stdout: "duration": 7.8590000000000005e-06 2023-08-01T19:55:44.878 INFO:teuthology.orchestra.run.smithi101.stdout: }, 2023-08-01T19:55:44.878 INFO:teuthology.orchestra.run.smithi101.stdout: { 2023-08-01T19:55:44.878 INFO:teuthology.orchestra.run.smithi101.stdout: "event": "queued_for_pg", 2023-08-01T19:55:44.878 INFO:teuthology.orchestra.run.smithi101.stdout: "time": "2023-08-01T19:55:05.564845+0000", 2023-08-01T19:55:44.878 INFO:teuthology.orchestra.run.smithi101.stdout: "duration": 4.9189999999999998e-06 2023-08-01T19:55:44.878 INFO:teuthology.orchestra.run.smithi101.stdout: }, 2023-08-01T19:55:44.879 INFO:teuthology.orchestra.run.smithi101.stdout: { 2023-08-01T19:55:44.879 INFO:teuthology.orchestra.run.smithi101.stdout: "event": "reached_pg", 2023-08-01T19:55:44.879 INFO:teuthology.orchestra.run.smithi101.stdout: "time": "2023-08-01T19:55:05.564883+0000", 2023-08-01T19:55:44.879 INFO:teuthology.orchestra.run.smithi101.stdout: "duration": 3.7481999999999998e-05 2023-08-01T19:55:44.879 INFO:teuthology.orchestra.run.smithi101.stdout: }, 2023-08-01T19:55:44.879 INFO:teuthology.orchestra.run.smithi101.stdout: { 2023-08-01T19:55:44.879 INFO:teuthology.orchestra.run.smithi101.stdout: "event": "started", 2023-08-01T19:55:44.879 INFO:teuthology.orchestra.run.smithi101.stdout: "time": "2023-08-01T19:55:05.564968+0000", 2023-08-01T19:55:44.880 INFO:teuthology.orchestra.run.smithi101.stdout: "duration": 8.5494999999999994e-05 2023-08-01T19:55:44.880 INFO:teuthology.orchestra.run.smithi101.stdout: }, 2023-08-01T19:55:44.880 INFO:teuthology.orchestra.run.smithi101.stdout: { 2023-08-01T19:55:44.880 INFO:teuthology.orchestra.run.smithi101.stdout: "event": "waiting for subops from 0", 2023-08-01T19:55:44.880 INFO:teuthology.orchestra.run.smithi101.stdout: "time": "2023-08-01T19:55:05.565062+0000", 2023-08-01T19:55:44.880 INFO:teuthology.orchestra.run.smithi101.stdout: "duration": 9.3478000000000002e-05 2023-08-01T19:55:44.880 INFO:teuthology.orchestra.run.smithi101.stdout: }, 2023-08-01T19:55:44.881 INFO:teuthology.orchestra.run.smithi101.stdout: { 2023-08-01T19:55:44.881 INFO:teuthology.orchestra.run.smithi101.stdout: "event": "op_commit", 2023-08-01T19:55:44.881 INFO:teuthology.orchestra.run.smithi101.stdout: "time": "2023-08-01T19:55:05.572061+0000", 2023-08-01T19:55:44.881 INFO:teuthology.orchestra.run.smithi101.stdout: "duration": 0.0069998250000000003 2023-08-01T19:55:44.881 INFO:teuthology.orchestra.run.smithi101.stdout: }, 2023-08-01T19:55:44.881 INFO:teuthology.orchestra.run.smithi101.stdout: { 2023-08-01T19:55:44.881 INFO:teuthology.orchestra.run.smithi101.stdout: "event": "sub_op_commit_rec", 2023-08-01T19:55:44.881 INFO:teuthology.orchestra.run.smithi101.stdout: "time": "2023-08-01T19:55:05.629362+0000", 2023-08-01T19:55:44.882 INFO:teuthology.orchestra.run.smithi101.stdout: "duration": 0.057300691000000001 2023-08-01T19:55:44.882 INFO:teuthology.orchestra.run.smithi101.stdout: }, 2023-08-01T19:55:44.882 INFO:teuthology.orchestra.run.smithi101.stdout: { 2023-08-01T19:55:44.882 INFO:teuthology.orchestra.run.smithi101.stdout: "event": "commit_sent", 2023-08-01T19:55:44.882 INFO:teuthology.orchestra.run.smithi101.stdout: "time": "2023-08-01T19:55:05.629395+0000", 2023-08-01T19:55:44.882 INFO:teuthology.orchestra.run.smithi101.stdout: "duration": 3.3124000000000003e-05 2023-08-01T19:55:44.882 INFO:teuthology.orchestra.run.smithi101.stdout: }, 2023-08-01T19:55:44.882 INFO:teuthology.orchestra.run.smithi101.stdout: { 2023-08-01T19:55:44.883 INFO:teuthology.orchestra.run.smithi101.stdout: "event": "done", 2023-08-01T19:55:44.883 INFO:teuthology.orchestra.run.smithi101.stdout: "time": "2023-08-01T19:55:05.629418+0000", 2023-08-01T19:55:44.883 INFO:teuthology.orchestra.run.smithi101.stdout: "duration": 2.2697999999999999e-05 2023-08-01T19:55:44.883 INFO:teuthology.orchestra.run.smithi101.stdout: } 2023-08-01T19:55:44.883 INFO:teuthology.orchestra.run.smithi101.stdout: ] 2023-08-01T19:55:44.883 INFO:teuthology.orchestra.run.smithi101.stdout: } 2023-08-01T19:55:44.883 INFO:teuthology.orchestra.run.smithi101.stdout: }, 2023-08-01T19:55:44.883 INFO:teuthology.orchestra.run.smithi101.stdout: { 2023-08-01T19:55:44.884 INFO:teuthology.orchestra.run.smithi101.stdout: "description": "osd_op(client.4668.0:100936 5.1 5:8f4e3576:::benchmark_data_smithi006_114134_object100935:head [set-alloc-hint object_size 65536 write_size 65536,write 0~65536] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e37)", 2023-08-01T19:55:44.884 INFO:teuthology.orchestra.run.smithi101.stdout: "initiated_at": "2023-08-01T19:55:05.567147+0000", 2023-08-01T19:55:44.884 INFO:teuthology.orchestra.run.smithi101.stdout: "age": 39.184212025000001, 2023-08-01T19:55:44.884 INFO:teuthology.orchestra.run.smithi101.stdout: "duration": 0.063466380000000003, 2023-08-01T19:55:44.884 INFO:teuthology.orchestra.run.smithi101.stdout: "type_data": { 2023-08-01T19:55:44.884 INFO:teuthology.orchestra.run.smithi101.stdout: "flag_point": "commit sent; apply or cleanup", 2023-08-01T19:55:44.884 INFO:teuthology.orchestra.run.smithi101.stdout: "client_info": { 2023-08-01T19:55:44.884 INFO:teuthology.orchestra.run.smithi101.stdout: "client": "client.4668", 2023-08-01T19:55:44.885 INFO:teuthology.orchestra.run.smithi101.stdout: "client_addr": "172.21.15.6:0/1709472247", 2023-08-01T19:55:44.885 INFO:teuthology.orchestra.run.smithi101.stdout: "tid": 100936 2023-08-01T19:55:44.885 INFO:teuthology.orchestra.run.smithi101.stdout: }, 2023-08-01T19:55:44.885 INFO:teuthology.orchestra.run.smithi101.stdout: "events": [ 2023-08-01T19:55:44.885 INFO:teuthology.orchestra.run.smithi101.stdout: { 2023-08-01T19:55:44.885 INFO:teuthology.orchestra.run.smithi101.stdout: "event": "initiated", 2023-08-01T19:55:44.885 INFO:teuthology.orchestra.run.smithi101.stdout: "time": "2023-08-01T19:55:05.567147+0000", 2023-08-01T19:55:44.885 INFO:teuthology.orchestra.run.smithi101.stdout: "duration": 0 2023-08-01T19:55:44.886 INFO:teuthology.orchestra.run.smithi101.stdout: }, 2023-08-01T19:55:44.886 INFO:teuthology.orchestra.run.smithi101.stdout: { 2023-08-01T19:55:44.886 INFO:teuthology.orchestra.run.smithi101.stdout: "event": "throttled", 2023-08-01T19:55:44.886 INFO:teuthology.orchestra.run.smithi101.stdout: "time": "2023-08-01T19:55:05.567147+0000", 2023-08-01T19:55:44.886 INFO:teuthology.orchestra.run.smithi101.stdout: "duration": 0 2023-08-01T19:55:44.886 INFO:teuthology.orchestra.run.smithi101.stdout: }, 2023-08-01T19:55:44.886 INFO:teuthology.orchestra.run.smithi101.stdout: { 2023-08-01T19:55:44.887 INFO:teuthology.orchestra.run.smithi101.stdout: "event": "header_read", 2023-08-01T19:55:44.887 INFO:teuthology.orchestra.run.smithi101.stdout: "time": "2023-08-01T19:55:05.567146+0000", 2023-08-01T19:55:44.887 INFO:teuthology.orchestra.run.smithi101.stdout: "duration": 4294967295.999999 2023-08-01T19:55:44.887 INFO:teuthology.orchestra.run.smithi101.stdout: }, 2023-08-01T19:55:44.887 INFO:teuthology.orchestra.run.smithi101.stdout: { 2023-08-01T19:55:44.887 INFO:teuthology.orchestra.run.smithi101.stdout: "event": "all_read", 2023-08-01T19:55:44.887 INFO:teuthology.orchestra.run.smithi101.stdout: "time": "2023-08-01T19:55:05.567224+0000", 2023-08-01T19:55:44.888 INFO:teuthology.orchestra.run.smithi101.stdout: "duration": 7.8460000000000004e-05 2023-08-01T19:55:44.888 INFO:teuthology.orchestra.run.smithi101.stdout: }, 2023-08-01T19:55:44.888 INFO:teuthology.orchestra.run.smithi101.stdout: { 2023-08-01T19:55:44.888 INFO:teuthology.orchestra.run.smithi101.stdout: "event": "dispatched", 2023-08-01T19:55:44.888 INFO:teuthology.orchestra.run.smithi101.stdout: "time": "2023-08-01T19:55:05.567234+0000", 2023-08-01T19:55:44.888 INFO:teuthology.orchestra.run.smithi101.stdout: "duration": 9.7110000000000007e-06 2023-08-01T19:55:44.888 INFO:teuthology.orchestra.run.smithi101.stdout: }, 2023-08-01T19:55:44.888 INFO:teuthology.orchestra.run.smithi101.stdout: { 2023-08-01T19:55:44.889 INFO:teuthology.orchestra.run.smithi101.stdout: "event": "queued_for_pg", 2023-08-01T19:55:44.889 INFO:teuthology.orchestra.run.smithi101.stdout: "time": "2023-08-01T19:55:05.567239+0000", 2023-08-01T19:55:44.889 INFO:teuthology.orchestra.run.smithi101.stdout: "duration": 5.237e-06 2023-08-01T19:55:44.889 INFO:teuthology.orchestra.run.smithi101.stdout: }, 2023-08-01T19:55:44.889 INFO:teuthology.orchestra.run.smithi101.stdout: { 2023-08-01T19:55:44.889 INFO:teuthology.orchestra.run.smithi101.stdout: "event": "reached_pg", 2023-08-01T19:55:44.889 INFO:teuthology.orchestra.run.smithi101.stdout: "time": "2023-08-01T19:55:05.567278+0000", 2023-08-01T19:55:44.890 INFO:teuthology.orchestra.run.smithi101.stdout: "duration": 3.9069999999999997e-05 2023-08-01T19:55:44.890 INFO:teuthology.orchestra.run.smithi101.stdout: }, 2023-08-01T19:55:44.890 INFO:teuthology.orchestra.run.smithi101.stdout: { 2023-08-01T19:55:44.890 INFO:teuthology.orchestra.run.smithi101.stdout: "event": "started", 2023-08-01T19:55:44.890 INFO:teuthology.orchestra.run.smithi101.stdout: "time": "2023-08-01T19:55:05.567402+0000", 2023-08-01T19:55:44.890 INFO:teuthology.orchestra.run.smithi101.stdout: "duration": 0.00012348700000000001 2023-08-01T19:55:44.890 INFO:teuthology.orchestra.run.smithi101.stdout: }, 2023-08-01T19:55:44.890 INFO:teuthology.orchestra.run.smithi101.stdout: { 2023-08-01T19:55:44.891 INFO:teuthology.orchestra.run.smithi101.stdout: "event": "waiting for subops from 0", 2023-08-01T19:55:44.891 INFO:teuthology.orchestra.run.smithi101.stdout: "time": "2023-08-01T19:55:05.567558+0000", 2023-08-01T19:55:44.891 INFO:teuthology.orchestra.run.smithi101.stdout: "duration": 0.000156179 2023-08-01T19:55:44.891 INFO:teuthology.orchestra.run.smithi101.stdout: }, 2023-08-01T19:55:44.891 INFO:teuthology.orchestra.run.smithi101.stdout: { 2023-08-01T19:55:44.891 INFO:teuthology.orchestra.run.smithi101.stdout: "event": "op_commit", 2023-08-01T19:55:44.891 INFO:teuthology.orchestra.run.smithi101.stdout: "time": "2023-08-01T19:55:05.573767+0000", 2023-08-01T19:55:44.891 INFO:teuthology.orchestra.run.smithi101.stdout: "duration": 0.0062092409999999999 2023-08-01T19:55:44.892 INFO:teuthology.orchestra.run.smithi101.stdout: }, 2023-08-01T19:55:44.892 INFO:teuthology.orchestra.run.smithi101.stdout: { 2023-08-01T19:55:44.892 INFO:teuthology.orchestra.run.smithi101.stdout: "event": "sub_op_commit_rec", 2023-08-01T19:55:44.892 INFO:teuthology.orchestra.run.smithi101.stdout: "time": "2023-08-01T19:55:05.630531+0000", 2023-08-01T19:55:44.892 INFO:teuthology.orchestra.run.smithi101.stdout: "duration": 0.056763409000000001 2023-08-01T19:55:44.892 INFO:teuthology.orchestra.run.smithi101.stdout: }, 2023-08-01T19:55:44.892 INFO:teuthology.orchestra.run.smithi101.stdout: { 2023-08-01T19:55:44.893 INFO:teuthology.orchestra.run.smithi101.stdout: "event": "commit_sent", 2023-08-01T19:55:44.893 INFO:teuthology.orchestra.run.smithi101.stdout: "time": "2023-08-01T19:55:05.630577+0000", 2023-08-01T19:55:44.893 INFO:teuthology.orchestra.run.smithi101.stdout: "duration": 4.6588000000000002e-05 2023-08-01T19:55:44.893 INFO:teuthology.orchestra.run.smithi101.stdout: }, 2023-08-01T19:55:44.893 INFO:teuthology.orchestra.run.smithi101.stdout: { 2023-08-01T19:55:44.893 INFO:teuthology.orchestra.run.smithi101.stdout: "event": "done", 2023-08-01T19:55:44.893 INFO:teuthology.orchestra.run.smithi101.stdout: "time": "2023-08-01T19:55:05.630613+0000", 2023-08-01T19:55:44.893 INFO:teuthology.orchestra.run.smithi101.stdout: "duration": 3.5802e-05 2023-08-01T19:55:44.894 INFO:teuthology.orchestra.run.smithi101.stdout: } 2023-08-01T19:55:44.894 INFO:teuthology.orchestra.run.smithi101.stdout: ] 2023-08-01T19:55:44.894 INFO:teuthology.orchestra.run.smithi101.stdout: } 2023-08-01T19:55:44.894 INFO:teuthology.orchestra.run.smithi101.stdout: }, 2023-08-01T19:55:44.894 INFO:teuthology.orchestra.run.smithi101.stdout: { 2023-08-01T19:55:44.894 INFO:teuthology.orchestra.run.smithi101.stdout: "description": "osd_op(client.4668.0:100943 5.7 5:e01743fe:::benchmark_data_smithi006_114134_object100942:head [set-alloc-hint object_size 65536 write_size 65536,write 0~65536] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e37)", 2023-08-01T19:55:44.894 INFO:teuthology.orchestra.run.smithi101.stdout: "initiated_at": "2023-08-01T19:55:05.574724+0000", 2023-08-01T19:55:44.894 INFO:teuthology.orchestra.run.smithi101.stdout: "age": 39.176634931999999, 2023-08-01T19:55:44.895 INFO:teuthology.orchestra.run.smithi101.stdout: "duration": 0.058761188999999998, 2023-08-01T19:55:44.895 INFO:teuthology.orchestra.run.smithi101.stdout: "type_data": { 2023-08-01T19:55:44.895 INFO:teuthology.orchestra.run.smithi101.stdout: "flag_point": "commit sent; apply or cleanup", 2023-08-01T19:55:44.895 INFO:teuthology.orchestra.run.smithi101.stdout: "client_info": { 2023-08-01T19:55:44.895 INFO:teuthology.orchestra.run.smithi101.stdout: "client": "client.4668", 2023-08-01T19:55:44.895 INFO:teuthology.orchestra.run.smithi101.stdout: "client_addr": "172.21.15.6:0/1709472247", 2023-08-01T19:55:44.895 INFO:teuthology.orchestra.run.smithi101.stdout: "tid": 100943 2023-08-01T19:55:44.895 INFO:teuthology.orchestra.run.smithi101.stdout: }, 2023-08-01T19:55:44.896 INFO:teuthology.orchestra.run.smithi101.stdout: "events": [ 2023-08-01T19:55:44.896 INFO:teuthology.orchestra.run.smithi101.stdout: { 2023-08-01T19:55:44.896 INFO:teuthology.orchestra.run.smithi101.stdout: "event": "initiated", 2023-08-01T19:55:44.896 INFO:teuthology.orchestra.run.smithi101.stdout: "time": "2023-08-01T19:55:05.574724+0000", 2023-08-01T19:55:44.896 INFO:teuthology.orchestra.run.smithi101.stdout: "duration": 0 2023-08-01T19:55:44.896 INFO:teuthology.orchestra.run.smithi101.stdout: }, 2023-08-01T19:55:44.896 INFO:teuthology.orchestra.run.smithi101.stdout: { 2023-08-01T19:55:44.896 INFO:teuthology.orchestra.run.smithi101.stdout: "event": "throttled", 2023-08-01T19:55:44.897 INFO:teuthology.orchestra.run.smithi101.stdout: "time": "2023-08-01T19:55:05.574724+0000", 2023-08-01T19:55:44.897 INFO:teuthology.orchestra.run.smithi101.stdout: "duration": 0 2023-08-01T19:55:44.897 INFO:teuthology.orchestra.run.smithi101.stdout: }, 2023-08-01T19:55:44.897 INFO:teuthology.orchestra.run.smithi101.stdout: { 2023-08-01T19:55:44.897 INFO:teuthology.orchestra.run.smithi101.stdout: "event": "header_read", 2023-08-01T19:55:44.897 INFO:teuthology.orchestra.run.smithi101.stdout: "time": "2023-08-01T19:55:05.574723+0000", 2023-08-01T19:55:44.897 INFO:teuthology.orchestra.run.smithi101.stdout: "duration": 4294967295.999999 2023-08-01T19:55:44.898 INFO:teuthology.orchestra.run.smithi101.stdout: }, 2023-08-01T19:55:44.898 INFO:teuthology.orchestra.run.smithi101.stdout: { 2023-08-01T19:55:44.898 INFO:teuthology.orchestra.run.smithi101.stdout: "event": "all_read", 2023-08-01T19:55:44.898 INFO:teuthology.orchestra.run.smithi101.stdout: "time": "2023-08-01T19:55:05.574773+0000", 2023-08-01T19:55:44.898 INFO:teuthology.orchestra.run.smithi101.stdout: "duration": 4.9469999999999999e-05 2023-08-01T19:55:44.898 INFO:teuthology.orchestra.run.smithi101.stdout: }, 2023-08-01T19:55:44.898 INFO:teuthology.orchestra.run.smithi101.stdout: { 2023-08-01T19:55:44.898 INFO:teuthology.orchestra.run.smithi101.stdout: "event": "dispatched", 2023-08-01T19:55:44.899 INFO:teuthology.orchestra.run.smithi101.stdout: "time": "2023-08-01T19:55:05.574780+0000", 2023-08-01T19:55:44.899 INFO:teuthology.orchestra.run.smithi101.stdout: "duration": 7.5059999999999998e-06 2023-08-01T19:55:44.899 INFO:teuthology.orchestra.run.smithi101.stdout: }, 2023-08-01T19:55:44.899 INFO:teuthology.orchestra.run.smithi101.stdout: { 2023-08-01T19:55:44.899 INFO:teuthology.orchestra.run.smithi101.stdout: "event": "queued_for_pg", 2023-08-01T19:55:44.899 INFO:teuthology.orchestra.run.smithi101.stdout: "time": "2023-08-01T19:55:05.574784+0000", 2023-08-01T19:55:44.899 INFO:teuthology.orchestra.run.smithi101.stdout: "duration": 3.5540000000000002e-06 2023-08-01T19:55:44.899 INFO:teuthology.orchestra.run.smithi101.stdout: }, 2023-08-01T19:55:44.900 INFO:teuthology.orchestra.run.smithi101.stdout: { 2023-08-01T19:55:44.900 INFO:teuthology.orchestra.run.smithi101.stdout: "event": "reached_pg", 2023-08-01T19:55:44.900 INFO:teuthology.orchestra.run.smithi101.stdout: "time": "2023-08-01T19:55:05.574805+0000", 2023-08-01T19:55:44.900 INFO:teuthology.orchestra.run.smithi101.stdout: "duration": 2.1257999999999999e-05 2023-08-01T19:55:44.900 INFO:teuthology.orchestra.run.smithi101.stdout: }, 2023-08-01T19:55:44.900 INFO:teuthology.orchestra.run.smithi101.stdout: { 2023-08-01T19:55:44.900 INFO:teuthology.orchestra.run.smithi101.stdout: "event": "started", 2023-08-01T19:55:44.900 INFO:teuthology.orchestra.run.smithi101.stdout: "time": "2023-08-01T19:55:05.574886+0000", 2023-08-01T19:55:44.901 INFO:teuthology.orchestra.run.smithi101.stdout: "duration": 8.1545999999999995e-05 2023-08-01T19:55:44.901 INFO:teuthology.orchestra.run.smithi101.stdout: }, 2023-08-01T19:55:44.901 INFO:teuthology.orchestra.run.smithi101.stdout: { 2023-08-01T19:55:44.901 INFO:teuthology.orchestra.run.smithi101.stdout: "event": "waiting for subops from 0", 2023-08-01T19:55:44.901 INFO:teuthology.orchestra.run.smithi101.stdout: "time": "2023-08-01T19:55:05.574973+0000", 2023-08-01T19:55:44.901 INFO:teuthology.orchestra.run.smithi101.stdout: "duration": 8.6998999999999998e-05 2023-08-01T19:55:44.901 INFO:teuthology.orchestra.run.smithi101.stdout: }, 2023-08-01T19:55:44.901 INFO:teuthology.orchestra.run.smithi101.stdout: { 2023-08-01T19:55:44.902 INFO:teuthology.orchestra.run.smithi101.stdout: "event": "op_commit", 2023-08-01T19:55:44.902 INFO:teuthology.orchestra.run.smithi101.stdout: "time": "2023-08-01T19:55:05.581580+0000", 2023-08-01T19:55:44.902 INFO:teuthology.orchestra.run.smithi101.stdout: "duration": 0.0066068790000000004 2023-08-01T19:55:44.902 INFO:teuthology.orchestra.run.smithi101.stdout: }, 2023-08-01T19:55:44.902 INFO:teuthology.orchestra.run.smithi101.stdout: { 2023-08-01T19:55:44.902 INFO:teuthology.orchestra.run.smithi101.stdout: "event": "sub_op_commit_rec", 2023-08-01T19:55:44.902 INFO:teuthology.orchestra.run.smithi101.stdout: "time": "2023-08-01T19:55:05.633422+0000", 2023-08-01T19:55:44.902 INFO:teuthology.orchestra.run.smithi101.stdout: "duration": 0.051841992000000003 2023-08-01T19:55:44.903 INFO:teuthology.orchestra.run.smithi101.stdout: }, 2023-08-01T19:55:44.903 INFO:teuthology.orchestra.run.smithi101.stdout: { 2023-08-01T19:55:44.903 INFO:teuthology.orchestra.run.smithi101.stdout: "event": "commit_sent", 2023-08-01T19:55:44.903 INFO:teuthology.orchestra.run.smithi101.stdout: "time": "2023-08-01T19:55:05.633461+0000", 2023-08-01T19:55:44.903 INFO:teuthology.orchestra.run.smithi101.stdout: "duration": 3.8330000000000001e-05 2023-08-01T19:55:44.903 INFO:teuthology.orchestra.run.smithi101.stdout: }, 2023-08-01T19:55:44.903 INFO:teuthology.orchestra.run.smithi101.stdout: { 2023-08-01T19:55:44.903 INFO:teuthology.orchestra.run.smithi101.stdout: "event": "done", 2023-08-01T19:55:44.904 INFO:teuthology.orchestra.run.smithi101.stdout: "time": "2023-08-01T19:55:05.633485+0000", 2023-08-01T19:55:44.904 INFO:teuthology.orchestra.run.smithi101.stdout: "duration": 2.4451e-05 2023-08-01T19:55:44.904 INFO:teuthology.orchestra.run.smithi101.stdout: } 2023-08-01T19:55:44.904 INFO:teuthology.orchestra.run.smithi101.stdout: ] 2023-08-01T19:55:44.904 INFO:teuthology.orchestra.run.smithi101.stdout: } 2023-08-01T19:55:44.904 INFO:teuthology.orchestra.run.smithi101.stdout: }, 2023-08-01T19:55:44.904 INFO:teuthology.orchestra.run.smithi101.stdout: { 2023-08-01T19:55:44.905 INFO:teuthology.orchestra.run.smithi101.stdout: "description": "osd_op(client.4668.0:107866 5.f 5:ffcbf9c4:::benchmark_data_smithi006_114134_object107865:head [set-alloc-hint object_size 65536 write_size 65536,write 0~65536] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e38)", 2023-08-01T19:55:44.905 INFO:teuthology.orchestra.run.smithi101.stdout: "initiated_at": "2023-08-01T19:55:09.280625+0000", 2023-08-01T19:55:44.905 INFO:teuthology.orchestra.run.smithi101.stdout: "age": 35.470733594000002, 2023-08-01T19:55:44.905 INFO:teuthology.orchestra.run.smithi101.stdout: "duration": 0.069869799999999996, 2023-08-01T19:55:44.905 INFO:teuthology.orchestra.run.smithi101.stdout: "type_data": { 2023-08-01T19:55:44.905 INFO:teuthology.orchestra.run.smithi101.stdout: "flag_point": "commit sent; apply or cleanup", 2023-08-01T19:55:44.905 INFO:teuthology.orchestra.run.smithi101.stdout: "client_info": { 2023-08-01T19:55:44.905 INFO:teuthology.orchestra.run.smithi101.stdout: "client": "client.4668", 2023-08-01T19:55:44.906 INFO:teuthology.orchestra.run.smithi101.stdout: "client_addr": "172.21.15.6:0/1709472247", 2023-08-01T19:55:44.906 INFO:teuthology.orchestra.run.smithi101.stdout: "tid": 107866 2023-08-01T19:55:44.906 INFO:teuthology.orchestra.run.smithi101.stdout: }, 2023-08-01T19:55:44.906 INFO:teuthology.orchestra.run.smithi101.stdout: "events": [ 2023-08-01T19:55:44.906 INFO:teuthology.orchestra.run.smithi101.stdout: { 2023-08-01T19:55:44.906 INFO:teuthology.orchestra.run.smithi101.stdout: "event": "initiated", 2023-08-01T19:55:44.906 INFO:teuthology.orchestra.run.smithi101.stdout: "time": "2023-08-01T19:55:09.280625+0000", 2023-08-01T19:55:44.906 INFO:teuthology.orchestra.run.smithi101.stdout: "duration": 0 2023-08-01T19:55:44.907 INFO:teuthology.orchestra.run.smithi101.stdout: }, 2023-08-01T19:55:44.907 INFO:teuthology.orchestra.run.smithi101.stdout: { 2023-08-01T19:55:44.907 INFO:teuthology.orchestra.run.smithi101.stdout: "event": "throttled", 2023-08-01T19:55:44.907 INFO:teuthology.orchestra.run.smithi101.stdout: "time": "2023-08-01T19:55:09.280625+0000", 2023-08-01T19:55:44.907 INFO:teuthology.orchestra.run.smithi101.stdout: "duration": 0 2023-08-01T19:55:44.907 INFO:teuthology.orchestra.run.smithi101.stdout: }, 2023-08-01T19:55:44.907 INFO:teuthology.orchestra.run.smithi101.stdout: { 2023-08-01T19:55:44.907 INFO:teuthology.orchestra.run.smithi101.stdout: "event": "header_read", 2023-08-01T19:55:44.908 INFO:teuthology.orchestra.run.smithi101.stdout: "time": "2023-08-01T19:55:09.280624+0000", 2023-08-01T19:55:44.908 INFO:teuthology.orchestra.run.smithi101.stdout: "duration": 4294967295.999999 2023-08-01T19:55:44.908 INFO:teuthology.orchestra.run.smithi101.stdout: }, 2023-08-01T19:55:44.908 INFO:teuthology.orchestra.run.smithi101.stdout: { 2023-08-01T19:55:44.908 INFO:teuthology.orchestra.run.smithi101.stdout: "event": "all_read", 2023-08-01T19:55:44.908 INFO:teuthology.orchestra.run.smithi101.stdout: "time": "2023-08-01T19:55:09.280648+0000", 2023-08-01T19:55:44.908 INFO:teuthology.orchestra.run.smithi101.stdout: "duration": 2.3521999999999999e-05 2023-08-01T19:55:44.909 INFO:teuthology.orchestra.run.smithi101.stdout: }, 2023-08-01T19:55:44.909 INFO:teuthology.orchestra.run.smithi101.stdout: { 2023-08-01T19:55:44.909 INFO:teuthology.orchestra.run.smithi101.stdout: "event": "dispatched", 2023-08-01T19:55:44.909 INFO:teuthology.orchestra.run.smithi101.stdout: "time": "2023-08-01T19:55:09.280658+0000", 2023-08-01T19:55:44.910 INFO:teuthology.orchestra.run.smithi101.stdout: "duration": 9.8660000000000001e-06 2023-08-01T19:55:44.910 INFO:teuthology.orchestra.run.smithi101.stdout: }, 2023-08-01T19:55:44.910 INFO:teuthology.orchestra.run.smithi101.stdout: { 2023-08-01T19:55:44.910 INFO:teuthology.orchestra.run.smithi101.stdout: "event": "queued_for_pg", 2023-08-01T19:55:44.910 INFO:teuthology.orchestra.run.smithi101.stdout: "time": "2023-08-01T19:55:09.280663+0000", 2023-08-01T19:55:44.910 INFO:teuthology.orchestra.run.smithi101.stdout: "duration": 4.8369999999999996e-06 2023-08-01T19:55:44.910 INFO:teuthology.orchestra.run.smithi101.stdout: }, 2023-08-01T19:55:44.910 INFO:teuthology.orchestra.run.smithi101.stdout: { 2023-08-01T19:55:44.911 INFO:teuthology.orchestra.run.smithi101.stdout: "event": "reached_pg", 2023-08-01T19:55:44.911 INFO:teuthology.orchestra.run.smithi101.stdout: "time": "2023-08-01T19:55:09.280690+0000", 2023-08-01T19:55:44.911 INFO:teuthology.orchestra.run.smithi101.stdout: "duration": 2.7534000000000001e-05 2023-08-01T19:55:44.911 INFO:teuthology.orchestra.run.smithi101.stdout: }, 2023-08-01T19:55:44.911 INFO:teuthology.orchestra.run.smithi101.stdout: { 2023-08-01T19:55:44.912 INFO:teuthology.orchestra.run.smithi101.stdout: "event": "started", 2023-08-01T19:55:44.912 INFO:teuthology.orchestra.run.smithi101.stdout: "time": "2023-08-01T19:55:09.280825+0000", 2023-08-01T19:55:44.912 INFO:teuthology.orchestra.run.smithi101.stdout: "duration": 0.000135399 2023-08-01T19:55:44.913 INFO:teuthology.orchestra.run.smithi101.stdout: }, 2023-08-01T19:55:44.913 INFO:teuthology.orchestra.run.smithi101.stdout: { 2023-08-01T19:55:44.913 INFO:teuthology.orchestra.run.smithi101.stdout: "event": "waiting for subops from 2", 2023-08-01T19:55:44.913 INFO:teuthology.orchestra.run.smithi101.stdout: "time": "2023-08-01T19:55:09.280929+0000", 2023-08-01T19:55:44.914 INFO:teuthology.orchestra.run.smithi101.stdout: "duration": 0.000103328 2023-08-01T19:55:44.914 INFO:teuthology.orchestra.run.smithi101.stdout: }, 2023-08-01T19:55:44.914 INFO:teuthology.orchestra.run.smithi101.stdout: { 2023-08-01T19:55:44.914 INFO:teuthology.orchestra.run.smithi101.stdout: "event": "sub_op_commit_rec", 2023-08-01T19:55:44.914 INFO:teuthology.orchestra.run.smithi101.stdout: "time": "2023-08-01T19:55:09.348321+0000", 2023-08-01T19:55:44.915 INFO:teuthology.orchestra.run.smithi101.stdout: "duration": 0.067392176999999998 2023-08-01T19:55:44.915 INFO:teuthology.orchestra.run.smithi101.stdout: }, 2023-08-01T19:55:44.915 INFO:teuthology.orchestra.run.smithi101.stdout: { 2023-08-01T19:55:44.915 INFO:teuthology.orchestra.run.smithi101.stdout: "event": "op_commit", 2023-08-01T19:55:44.915 INFO:teuthology.orchestra.run.smithi101.stdout: "time": "2023-08-01T19:55:09.350431+0000", 2023-08-01T19:55:44.915 INFO:teuthology.orchestra.run.smithi101.stdout: "duration": 0.0021096980000000001 2023-08-01T19:55:44.915 INFO:teuthology.orchestra.run.smithi101.stdout: }, 2023-08-01T19:55:44.916 INFO:teuthology.orchestra.run.smithi101.stdout: { 2023-08-01T19:55:44.916 INFO:teuthology.orchestra.run.smithi101.stdout: "event": "commit_sent", 2023-08-01T19:55:44.916 INFO:teuthology.orchestra.run.smithi101.stdout: "time": "2023-08-01T19:55:09.350469+0000", 2023-08-01T19:55:44.916 INFO:teuthology.orchestra.run.smithi101.stdout: "duration": 3.8625999999999999e-05 2023-08-01T19:55:44.916 INFO:teuthology.orchestra.run.smithi101.stdout: }, 2023-08-01T19:55:44.916 INFO:teuthology.orchestra.run.smithi101.stdout: { 2023-08-01T19:55:44.916 INFO:teuthology.orchestra.run.smithi101.stdout: "event": "done", 2023-08-01T19:55:44.917 INFO:teuthology.orchestra.run.smithi101.stdout: "time": "2023-08-01T19:55:09.350495+0000", 2023-08-01T19:55:44.917 INFO:teuthology.orchestra.run.smithi101.stdout: "duration": 2.5698999999999999e-05 2023-08-01T19:55:44.917 INFO:teuthology.orchestra.run.smithi101.stdout: } 2023-08-01T19:55:44.917 INFO:teuthology.orchestra.run.smithi101.stdout: ] 2023-08-01T19:55:44.917 INFO:teuthology.orchestra.run.smithi101.stdout: } 2023-08-01T19:55:44.917 INFO:teuthology.orchestra.run.smithi101.stdout: }, 2023-08-01T19:55:44.917 INFO:teuthology.orchestra.run.smithi101.stdout: { 2023-08-01T19:55:44.917 INFO:teuthology.orchestra.run.smithi101.stdout: "description": "osd_op(client.4668.0:107867 5.f 5:ff29bbf7:::benchmark_data_smithi006_114134_object107866:head [set-alloc-hint object_size 65536 write_size 65536,write 0~65536] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e38)", 2023-08-01T19:55:44.918 INFO:teuthology.orchestra.run.smithi101.stdout: "initiated_at": "2023-08-01T19:55:09.280670+0000", 2023-08-01T19:55:44.918 INFO:teuthology.orchestra.run.smithi101.stdout: "age": 35.47068866, 2023-08-01T19:55:44.918 INFO:teuthology.orchestra.run.smithi101.stdout: "duration": 0.069898092999999994, 2023-08-01T19:55:44.918 INFO:teuthology.orchestra.run.smithi101.stdout: "type_data": { 2023-08-01T19:55:44.918 INFO:teuthology.orchestra.run.smithi101.stdout: "flag_point": "commit sent; apply or cleanup", 2023-08-01T19:55:44.918 INFO:teuthology.orchestra.run.smithi101.stdout: "client_info": { 2023-08-01T19:55:44.918 INFO:teuthology.orchestra.run.smithi101.stdout: "client": "client.4668", 2023-08-01T19:55:44.919 INFO:teuthology.orchestra.run.smithi101.stdout: "client_addr": "172.21.15.6:0/1709472247", 2023-08-01T19:55:44.919 INFO:teuthology.orchestra.run.smithi101.stdout: "tid": 107867 2023-08-01T19:55:44.919 INFO:teuthology.orchestra.run.smithi101.stdout: }, 2023-08-01T19:55:44.919 INFO:teuthology.orchestra.run.smithi101.stdout: "events": [ 2023-08-01T19:55:44.919 INFO:teuthology.orchestra.run.smithi101.stdout: { 2023-08-01T19:55:44.919 INFO:teuthology.orchestra.run.smithi101.stdout: "event": "initiated", 2023-08-01T19:55:44.919 INFO:teuthology.orchestra.run.smithi101.stdout: "time": "2023-08-01T19:55:09.280670+0000", 2023-08-01T19:55:44.919 INFO:teuthology.orchestra.run.smithi101.stdout: "duration": 0 2023-08-01T19:55:44.920 INFO:teuthology.orchestra.run.smithi101.stdout: }, 2023-08-01T19:55:44.920 INFO:teuthology.orchestra.run.smithi101.stdout: { 2023-08-01T19:55:44.920 INFO:teuthology.orchestra.run.smithi101.stdout: "event": "throttled", 2023-08-01T19:55:44.920 INFO:teuthology.orchestra.run.smithi101.stdout: "time": "2023-08-01T19:55:09.280670+0000", 2023-08-01T19:55:44.920 INFO:teuthology.orchestra.run.smithi101.stdout: "duration": 0 2023-08-01T19:55:44.920 INFO:teuthology.orchestra.run.smithi101.stdout: }, 2023-08-01T19:55:44.920 INFO:teuthology.orchestra.run.smithi101.stdout: { 2023-08-01T19:55:44.920 INFO:teuthology.orchestra.run.smithi101.stdout: "event": "header_read", 2023-08-01T19:55:44.921 INFO:teuthology.orchestra.run.smithi101.stdout: "time": "2023-08-01T19:55:09.280670+0000", 2023-08-01T19:55:44.921 INFO:teuthology.orchestra.run.smithi101.stdout: "duration": 4294967295.9999995 2023-08-01T19:55:44.921 INFO:teuthology.orchestra.run.smithi101.stdout: }, 2023-08-01T19:55:44.921 INFO:teuthology.orchestra.run.smithi101.stdout: { 2023-08-01T19:55:44.921 INFO:teuthology.orchestra.run.smithi101.stdout: "event": "all_read", 2023-08-01T19:55:44.921 INFO:teuthology.orchestra.run.smithi101.stdout: "time": "2023-08-01T19:55:09.280690+0000", 2023-08-01T19:55:44.921 INFO:teuthology.orchestra.run.smithi101.stdout: "duration": 2.0526e-05 2023-08-01T19:55:44.921 INFO:teuthology.orchestra.run.smithi101.stdout: }, 2023-08-01T19:55:44.922 INFO:teuthology.orchestra.run.smithi101.stdout: { 2023-08-01T19:55:44.922 INFO:teuthology.orchestra.run.smithi101.stdout: "event": "dispatched", 2023-08-01T19:55:44.922 INFO:teuthology.orchestra.run.smithi101.stdout: "time": "2023-08-01T19:55:09.280695+0000", 2023-08-01T19:55:44.922 INFO:teuthology.orchestra.run.smithi101.stdout: "duration": 4.5140000000000003e-06 2023-08-01T19:55:44.922 INFO:teuthology.orchestra.run.smithi101.stdout: }, 2023-08-01T19:55:44.922 INFO:teuthology.orchestra.run.smithi101.stdout: { 2023-08-01T19:55:44.922 INFO:teuthology.orchestra.run.smithi101.stdout: "event": "queued_for_pg", 2023-08-01T19:55:44.922 INFO:teuthology.orchestra.run.smithi101.stdout: "time": "2023-08-01T19:55:09.280697+0000", 2023-08-01T19:55:44.923 INFO:teuthology.orchestra.run.smithi101.stdout: "duration": 2.6290000000000002e-06 2023-08-01T19:55:44.923 INFO:teuthology.orchestra.run.smithi101.stdout: }, 2023-08-01T19:55:44.923 INFO:teuthology.orchestra.run.smithi101.stdout: { 2023-08-01T19:55:44.923 INFO:teuthology.orchestra.run.smithi101.stdout: "event": "reached_pg", 2023-08-01T19:55:44.923 INFO:teuthology.orchestra.run.smithi101.stdout: "time": "2023-08-01T19:55:09.282392+0000", 2023-08-01T19:55:44.923 INFO:teuthology.orchestra.run.smithi101.stdout: "duration": 0.0016948709999999999 2023-08-01T19:55:44.923 INFO:teuthology.orchestra.run.smithi101.stdout: }, 2023-08-01T19:55:44.923 INFO:teuthology.orchestra.run.smithi101.stdout: { 2023-08-01T19:55:44.924 INFO:teuthology.orchestra.run.smithi101.stdout: "event": "started", 2023-08-01T19:55:44.924 INFO:teuthology.orchestra.run.smithi101.stdout: "time": "2023-08-01T19:55:09.282514+0000", 2023-08-01T19:55:44.924 INFO:teuthology.orchestra.run.smithi101.stdout: "duration": 0.000121839 2023-08-01T19:55:44.924 INFO:teuthology.orchestra.run.smithi101.stdout: }, 2023-08-01T19:55:44.924 INFO:teuthology.orchestra.run.smithi101.stdout: { 2023-08-01T19:55:44.924 INFO:teuthology.orchestra.run.smithi101.stdout: "event": "waiting for subops from 2", 2023-08-01T19:55:44.924 INFO:teuthology.orchestra.run.smithi101.stdout: "time": "2023-08-01T19:55:09.282664+0000", 2023-08-01T19:55:44.925 INFO:teuthology.orchestra.run.smithi101.stdout: "duration": 0.00014968699999999999 2023-08-01T19:55:44.925 INFO:teuthology.orchestra.run.smithi101.stdout: }, 2023-08-01T19:55:44.925 INFO:teuthology.orchestra.run.smithi101.stdout: { 2023-08-01T19:55:44.925 INFO:teuthology.orchestra.run.smithi101.stdout: "event": "sub_op_commit_rec", 2023-08-01T19:55:44.925 INFO:teuthology.orchestra.run.smithi101.stdout: "time": "2023-08-01T19:55:09.348344+0000", 2023-08-01T19:55:44.925 INFO:teuthology.orchestra.run.smithi101.stdout: "duration": 0.065680247999999997 2023-08-01T19:55:44.925 INFO:teuthology.orchestra.run.smithi101.stdout: }, 2023-08-01T19:55:44.925 INFO:teuthology.orchestra.run.smithi101.stdout: { 2023-08-01T19:55:44.926 INFO:teuthology.orchestra.run.smithi101.stdout: "event": "op_commit", 2023-08-01T19:55:44.926 INFO:teuthology.orchestra.run.smithi101.stdout: "time": "2023-08-01T19:55:09.350502+0000", 2023-08-01T19:55:44.926 INFO:teuthology.orchestra.run.smithi101.stdout: "duration": 0.0021578140000000001 2023-08-01T19:55:44.926 INFO:teuthology.orchestra.run.smithi101.stdout: }, 2023-08-01T19:55:44.926 INFO:teuthology.orchestra.run.smithi101.stdout: { 2023-08-01T19:55:44.926 INFO:teuthology.orchestra.run.smithi101.stdout: "event": "commit_sent", 2023-08-01T19:55:44.926 INFO:teuthology.orchestra.run.smithi101.stdout: "time": "2023-08-01T19:55:09.350529+0000", 2023-08-01T19:55:44.926 INFO:teuthology.orchestra.run.smithi101.stdout: "duration": 2.6838e-05 2023-08-01T19:55:44.927 INFO:teuthology.orchestra.run.smithi101.stdout: }, 2023-08-01T19:55:44.927 INFO:teuthology.orchestra.run.smithi101.stdout: { 2023-08-01T19:55:44.927 INFO:teuthology.orchestra.run.smithi101.stdout: "event": "done", 2023-08-01T19:55:44.927 INFO:teuthology.orchestra.run.smithi101.stdout: "time": "2023-08-01T19:55:09.350568+0000", 2023-08-01T19:55:44.927 INFO:teuthology.orchestra.run.smithi101.stdout: "duration": 3.9477000000000002e-05 2023-08-01T19:55:44.927 INFO:teuthology.orchestra.run.smithi101.stdout: } 2023-08-01T19:55:44.927 INFO:teuthology.orchestra.run.smithi101.stdout: ] 2023-08-01T19:55:44.927 INFO:teuthology.orchestra.run.smithi101.stdout: } 2023-08-01T19:55:44.928 INFO:teuthology.orchestra.run.smithi101.stdout: }, 2023-08-01T19:55:44.928 INFO:teuthology.orchestra.run.smithi101.stdout: { 2023-08-01T19:55:44.928 INFO:teuthology.orchestra.run.smithi101.stdout: "description": "osd_repop(client.4668.0:107863 5.3 e38/19 5:cbdd875a:::benchmark_data_smithi006_114134_object107862:head v 38'6829, mlcod=38'6826)", 2023-08-01T19:55:44.928 INFO:teuthology.orchestra.run.smithi101.stdout: "initiated_at": "2023-08-01T19:55:09.280747+0000", 2023-08-01T19:55:44.928 INFO:teuthology.orchestra.run.smithi101.stdout: "age": 35.470611710999997, 2023-08-01T19:55:44.928 INFO:teuthology.orchestra.run.smithi101.stdout: "duration": 0.069343305999999993, 2023-08-01T19:55:44.928 INFO:teuthology.orchestra.run.smithi101.stdout: "type_data": { 2023-08-01T19:55:44.928 INFO:teuthology.orchestra.run.smithi101.stdout: "flag_point": "commit sent; apply or cleanup", 2023-08-01T19:55:44.929 INFO:teuthology.orchestra.run.smithi101.stdout: "events": [ 2023-08-01T19:55:44.929 INFO:teuthology.orchestra.run.smithi101.stdout: { 2023-08-01T19:55:44.929 INFO:teuthology.orchestra.run.smithi101.stdout: "event": "initiated", 2023-08-01T19:55:44.929 INFO:teuthology.orchestra.run.smithi101.stdout: "time": "2023-08-01T19:55:09.280747+0000", 2023-08-01T19:55:44.929 INFO:teuthology.orchestra.run.smithi101.stdout: "duration": 0 2023-08-01T19:55:44.929 INFO:teuthology.orchestra.run.smithi101.stdout: }, 2023-08-01T19:55:44.929 INFO:teuthology.orchestra.run.smithi101.stdout: { 2023-08-01T19:55:44.929 INFO:teuthology.orchestra.run.smithi101.stdout: "event": "throttled", 2023-08-01T19:55:44.930 INFO:teuthology.orchestra.run.smithi101.stdout: "time": "2023-08-01T19:55:09.280747+0000", 2023-08-01T19:55:44.930 INFO:teuthology.orchestra.run.smithi101.stdout: "duration": 0 2023-08-01T19:55:44.930 INFO:teuthology.orchestra.run.smithi101.stdout: }, 2023-08-01T19:55:44.930 INFO:teuthology.orchestra.run.smithi101.stdout: { 2023-08-01T19:55:44.930 INFO:teuthology.orchestra.run.smithi101.stdout: "event": "header_read", 2023-08-01T19:55:44.930 INFO:teuthology.orchestra.run.smithi101.stdout: "time": "2023-08-01T19:55:09.280746+0000", 2023-08-01T19:55:44.930 INFO:teuthology.orchestra.run.smithi101.stdout: "duration": 4294967295.9999995 2023-08-01T19:55:44.931 INFO:teuthology.orchestra.run.smithi101.stdout: }, 2023-08-01T19:55:44.931 INFO:teuthology.orchestra.run.smithi101.stdout: { 2023-08-01T19:55:44.931 INFO:teuthology.orchestra.run.smithi101.stdout: "event": "all_read", 2023-08-01T19:55:44.931 INFO:teuthology.orchestra.run.smithi101.stdout: "time": "2023-08-01T19:55:09.280798+0000", 2023-08-01T19:55:44.931 INFO:teuthology.orchestra.run.smithi101.stdout: "duration": 5.1706000000000003e-05 2023-08-01T19:55:44.931 INFO:teuthology.orchestra.run.smithi101.stdout: }, 2023-08-01T19:55:44.931 INFO:teuthology.orchestra.run.smithi101.stdout: { 2023-08-01T19:55:44.931 INFO:teuthology.orchestra.run.smithi101.stdout: "event": "dispatched", 2023-08-01T19:55:44.932 INFO:teuthology.orchestra.run.smithi101.stdout: "time": "2023-08-01T19:55:09.280807+0000", 2023-08-01T19:55:44.932 INFO:teuthology.orchestra.run.smithi101.stdout: "duration": 8.4889999999999995e-06 2023-08-01T19:55:44.932 INFO:teuthology.orchestra.run.smithi101.stdout: }, 2023-08-01T19:55:44.932 INFO:teuthology.orchestra.run.smithi101.stdout: { 2023-08-01T19:55:44.932 INFO:teuthology.orchestra.run.smithi101.stdout: "event": "queued_for_pg", 2023-08-01T19:55:44.932 INFO:teuthology.orchestra.run.smithi101.stdout: "time": "2023-08-01T19:55:09.280812+0000", 2023-08-01T19:55:44.932 INFO:teuthology.orchestra.run.smithi101.stdout: "duration": 5.2120000000000002e-06 2023-08-01T19:55:44.933 INFO:teuthology.orchestra.run.smithi101.stdout: }, 2023-08-01T19:55:44.933 INFO:teuthology.orchestra.run.smithi101.stdout: { 2023-08-01T19:55:44.933 INFO:teuthology.orchestra.run.smithi101.stdout: "event": "reached_pg", 2023-08-01T19:55:44.933 INFO:teuthology.orchestra.run.smithi101.stdout: "time": "2023-08-01T19:55:09.280843+0000", 2023-08-01T19:55:44.933 INFO:teuthology.orchestra.run.smithi101.stdout: "duration": 3.1406999999999999e-05 2023-08-01T19:55:44.933 INFO:teuthology.orchestra.run.smithi101.stdout: }, 2023-08-01T19:55:44.933 INFO:teuthology.orchestra.run.smithi101.stdout: { 2023-08-01T19:55:44.933 INFO:teuthology.orchestra.run.smithi101.stdout: "event": "started", 2023-08-01T19:55:44.934 INFO:teuthology.orchestra.run.smithi101.stdout: "time": "2023-08-01T19:55:09.280860+0000", 2023-08-01T19:55:44.934 INFO:teuthology.orchestra.run.smithi101.stdout: "duration": 1.6283999999999999e-05 2023-08-01T19:55:44.934 INFO:teuthology.orchestra.run.smithi101.stdout: }, 2023-08-01T19:55:44.934 INFO:teuthology.orchestra.run.smithi101.stdout: { 2023-08-01T19:55:44.934 INFO:teuthology.orchestra.run.smithi101.stdout: "event": "commit_sent", 2023-08-01T19:55:44.934 INFO:teuthology.orchestra.run.smithi101.stdout: "time": "2023-08-01T19:55:09.350059+0000", 2023-08-01T19:55:44.934 INFO:teuthology.orchestra.run.smithi101.stdout: "duration": 0.069199094000000003 2023-08-01T19:55:44.934 INFO:teuthology.orchestra.run.smithi101.stdout: }, 2023-08-01T19:55:44.935 INFO:teuthology.orchestra.run.smithi101.stdout: { 2023-08-01T19:55:44.935 INFO:teuthology.orchestra.run.smithi101.stdout: "event": "done", 2023-08-01T19:55:44.935 INFO:teuthology.orchestra.run.smithi101.stdout: "time": "2023-08-01T19:55:09.350090+0000", 2023-08-01T19:55:44.935 INFO:teuthology.orchestra.run.smithi101.stdout: "duration": 3.1736000000000002e-05 2023-08-01T19:55:44.935 INFO:teuthology.orchestra.run.smithi101.stdout: } 2023-08-01T19:55:44.935 INFO:teuthology.orchestra.run.smithi101.stdout: ] 2023-08-01T19:55:44.935 INFO:teuthology.orchestra.run.smithi101.stdout: } 2023-08-01T19:55:44.935 INFO:teuthology.orchestra.run.smithi101.stdout: }, 2023-08-01T19:55:44.936 INFO:teuthology.orchestra.run.smithi101.stdout: { 2023-08-01T19:55:44.936 INFO:teuthology.orchestra.run.smithi101.stdout: "description": "osd_repop(client.4668.0:107865 5.3 e38/19 5:c2ebb96d:::benchmark_data_smithi006_114134_object107864:head v 38'6830, mlcod=38'6826)", 2023-08-01T19:55:44.936 INFO:teuthology.orchestra.run.smithi101.stdout: "initiated_at": "2023-08-01T19:55:09.283182+0000", 2023-08-01T19:55:44.936 INFO:teuthology.orchestra.run.smithi101.stdout: "age": 35.468176403000001, 2023-08-01T19:55:44.936 INFO:teuthology.orchestra.run.smithi101.stdout: "duration": 0.068554793000000003, 2023-08-01T19:55:44.936 INFO:teuthology.orchestra.run.smithi101.stdout: "type_data": { 2023-08-01T19:55:44.936 INFO:teuthology.orchestra.run.smithi101.stdout: "flag_point": "commit sent; apply or cleanup", 2023-08-01T19:55:44.937 INFO:teuthology.orchestra.run.smithi101.stdout: "events": [ 2023-08-01T19:55:44.937 INFO:teuthology.orchestra.run.smithi101.stdout: { 2023-08-01T19:55:44.937 INFO:teuthology.orchestra.run.smithi101.stdout: "event": "initiated", 2023-08-01T19:55:44.937 INFO:teuthology.orchestra.run.smithi101.stdout: "time": "2023-08-01T19:55:09.283182+0000", 2023-08-01T19:55:44.937 INFO:teuthology.orchestra.run.smithi101.stdout: "duration": 0 2023-08-01T19:55:44.937 INFO:teuthology.orchestra.run.smithi101.stdout: }, 2023-08-01T19:55:44.937 INFO:teuthology.orchestra.run.smithi101.stdout: { 2023-08-01T19:55:44.937 INFO:teuthology.orchestra.run.smithi101.stdout: "event": "throttled", 2023-08-01T19:55:44.938 INFO:teuthology.orchestra.run.smithi101.stdout: "time": "2023-08-01T19:55:09.283182+0000", 2023-08-01T19:55:44.938 INFO:teuthology.orchestra.run.smithi101.stdout: "duration": 0 2023-08-01T19:55:44.938 INFO:teuthology.orchestra.run.smithi101.stdout: }, 2023-08-01T19:55:44.938 INFO:teuthology.orchestra.run.smithi101.stdout: { 2023-08-01T19:55:44.938 INFO:teuthology.orchestra.run.smithi101.stdout: "event": "header_read", 2023-08-01T19:55:44.939 INFO:teuthology.orchestra.run.smithi101.stdout: "time": "2023-08-01T19:55:09.283182+0000", 2023-08-01T19:55:44.939 INFO:teuthology.orchestra.run.smithi101.stdout: "duration": 4294967295.9999995 2023-08-01T19:55:44.939 INFO:teuthology.orchestra.run.smithi101.stdout: }, 2023-08-01T19:55:44.939 INFO:teuthology.orchestra.run.smithi101.stdout: { 2023-08-01T19:55:44.939 INFO:teuthology.orchestra.run.smithi101.stdout: "event": "all_read", 2023-08-01T19:55:44.939 INFO:teuthology.orchestra.run.smithi101.stdout: "time": "2023-08-01T19:55:09.283233+0000", 2023-08-01T19:55:44.939 INFO:teuthology.orchestra.run.smithi101.stdout: "duration": 5.1511999999999997e-05 2023-08-01T19:55:44.940 INFO:teuthology.orchestra.run.smithi101.stdout: }, 2023-08-01T19:55:44.940 INFO:teuthology.orchestra.run.smithi101.stdout: { 2023-08-01T19:55:44.940 INFO:teuthology.orchestra.run.smithi101.stdout: "event": "dispatched", 2023-08-01T19:55:44.940 INFO:teuthology.orchestra.run.smithi101.stdout: "time": "2023-08-01T19:55:09.283239+0000", 2023-08-01T19:55:44.940 INFO:teuthology.orchestra.run.smithi101.stdout: "duration": 5.6640000000000003e-06 2023-08-01T19:55:44.940 INFO:teuthology.orchestra.run.smithi101.stdout: }, 2023-08-01T19:55:44.940 INFO:teuthology.orchestra.run.smithi101.stdout: { 2023-08-01T19:55:44.941 INFO:teuthology.orchestra.run.smithi101.stdout: "event": "queued_for_pg", 2023-08-01T19:55:44.941 INFO:teuthology.orchestra.run.smithi101.stdout: "time": "2023-08-01T19:55:09.283242+0000", 2023-08-01T19:55:44.941 INFO:teuthology.orchestra.run.smithi101.stdout: "duration": 2.9639999999999999e-06 2023-08-01T19:55:44.941 INFO:teuthology.orchestra.run.smithi101.stdout: }, 2023-08-01T19:55:44.941 INFO:teuthology.orchestra.run.smithi101.stdout: { 2023-08-01T19:55:44.941 INFO:teuthology.orchestra.run.smithi101.stdout: "event": "reached_pg", 2023-08-01T19:55:44.941 INFO:teuthology.orchestra.run.smithi101.stdout: "time": "2023-08-01T19:55:09.283276+0000", 2023-08-01T19:55:44.941 INFO:teuthology.orchestra.run.smithi101.stdout: "duration": 3.3631999999999999e-05 2023-08-01T19:55:44.942 INFO:teuthology.orchestra.run.smithi101.stdout: }, 2023-08-01T19:55:44.942 INFO:teuthology.orchestra.run.smithi101.stdout: { 2023-08-01T19:55:44.942 INFO:teuthology.orchestra.run.smithi101.stdout: "event": "started", 2023-08-01T19:55:44.942 INFO:teuthology.orchestra.run.smithi101.stdout: "time": "2023-08-01T19:55:09.283288+0000", 2023-08-01T19:55:44.942 INFO:teuthology.orchestra.run.smithi101.stdout: "duration": 1.1816e-05 2023-08-01T19:55:44.942 INFO:teuthology.orchestra.run.smithi101.stdout: }, 2023-08-01T19:55:44.942 INFO:teuthology.orchestra.run.smithi101.stdout: { 2023-08-01T19:55:44.942 INFO:teuthology.orchestra.run.smithi101.stdout: "event": "commit_sent", 2023-08-01T19:55:44.943 INFO:teuthology.orchestra.run.smithi101.stdout: "time": "2023-08-01T19:55:09.351712+0000", 2023-08-01T19:55:44.943 INFO:teuthology.orchestra.run.smithi101.stdout: "duration": 0.068424311000000002 2023-08-01T19:55:44.943 INFO:teuthology.orchestra.run.smithi101.stdout: }, 2023-08-01T19:55:44.943 INFO:teuthology.orchestra.run.smithi101.stdout: { 2023-08-01T19:55:44.943 INFO:teuthology.orchestra.run.smithi101.stdout: "event": "done", 2023-08-01T19:55:44.943 INFO:teuthology.orchestra.run.smithi101.stdout: "time": "2023-08-01T19:55:09.351737+0000", 2023-08-01T19:55:44.943 INFO:teuthology.orchestra.run.smithi101.stdout: "duration": 2.5364999999999999e-05 2023-08-01T19:55:44.943 INFO:teuthology.orchestra.run.smithi101.stdout: } 2023-08-01T19:55:44.944 INFO:teuthology.orchestra.run.smithi101.stdout: ] 2023-08-01T19:55:44.944 INFO:teuthology.orchestra.run.smithi101.stdout: } 2023-08-01T19:55:44.944 INFO:teuthology.orchestra.run.smithi101.stdout: }, 2023-08-01T19:55:44.944 INFO:teuthology.orchestra.run.smithi101.stdout: { 2023-08-01T19:55:44.944 INFO:teuthology.orchestra.run.smithi101.stdout: "description": "osd_repop(client.4668.0:107869 5.c e38/19 5:31910384:::benchmark_data_smithi006_114134_object107868:head v 38'6761, mlcod=38'6759)", 2023-08-01T19:55:44.944 INFO:teuthology.orchestra.run.smithi101.stdout: "initiated_at": "2023-08-01T19:55:09.283762+0000", 2023-08-01T19:55:44.944 INFO:teuthology.orchestra.run.smithi101.stdout: "age": 35.467597067, 2023-08-01T19:55:44.945 INFO:teuthology.orchestra.run.smithi101.stdout: "duration": 0.067877541, 2023-08-01T19:55:44.945 INFO:teuthology.orchestra.run.smithi101.stdout: "type_data": { 2023-08-01T19:55:44.945 INFO:teuthology.orchestra.run.smithi101.stdout: "flag_point": "commit sent; apply or cleanup", 2023-08-01T19:55:44.945 INFO:teuthology.orchestra.run.smithi101.stdout: "events": [ 2023-08-01T19:55:44.945 INFO:teuthology.orchestra.run.smithi101.stdout: { 2023-08-01T19:55:44.945 INFO:teuthology.orchestra.run.smithi101.stdout: "event": "initiated", 2023-08-01T19:55:44.945 INFO:teuthology.orchestra.run.smithi101.stdout: "time": "2023-08-01T19:55:09.283762+0000", 2023-08-01T19:55:44.945 INFO:teuthology.orchestra.run.smithi101.stdout: "duration": 0 2023-08-01T19:55:44.946 INFO:teuthology.orchestra.run.smithi101.stdout: }, 2023-08-01T19:55:44.946 INFO:teuthology.orchestra.run.smithi101.stdout: { 2023-08-01T19:55:44.946 INFO:teuthology.orchestra.run.smithi101.stdout: "event": "throttled", 2023-08-01T19:55:44.946 INFO:teuthology.orchestra.run.smithi101.stdout: "time": "2023-08-01T19:55:09.283762+0000", 2023-08-01T19:55:44.946 INFO:teuthology.orchestra.run.smithi101.stdout: "duration": 0 2023-08-01T19:55:44.946 INFO:teuthology.orchestra.run.smithi101.stdout: }, 2023-08-01T19:55:44.946 INFO:teuthology.orchestra.run.smithi101.stdout: { 2023-08-01T19:55:44.946 INFO:teuthology.orchestra.run.smithi101.stdout: "event": "header_read", 2023-08-01T19:55:44.947 INFO:teuthology.orchestra.run.smithi101.stdout: "time": "2023-08-01T19:55:09.283761+0000", 2023-08-01T19:55:44.947 INFO:teuthology.orchestra.run.smithi101.stdout: "duration": 4294967295.9999995 2023-08-01T19:55:44.947 INFO:teuthology.orchestra.run.smithi101.stdout: }, 2023-08-01T19:55:44.947 INFO:teuthology.orchestra.run.smithi101.stdout: { 2023-08-01T19:55:44.947 INFO:teuthology.orchestra.run.smithi101.stdout: "event": "all_read", 2023-08-01T19:55:44.947 INFO:teuthology.orchestra.run.smithi101.stdout: "time": "2023-08-01T19:55:09.283825+0000", 2023-08-01T19:55:44.947 INFO:teuthology.orchestra.run.smithi101.stdout: "duration": 6.3200000000000005e-05 2023-08-01T19:55:44.947 INFO:teuthology.orchestra.run.smithi101.stdout: }, 2023-08-01T19:55:44.948 INFO:teuthology.orchestra.run.smithi101.stdout: { 2023-08-01T19:55:44.948 INFO:teuthology.orchestra.run.smithi101.stdout: "event": "dispatched", 2023-08-01T19:55:44.948 INFO:teuthology.orchestra.run.smithi101.stdout: "time": "2023-08-01T19:55:09.345759+0000", 2023-08-01T19:55:44.948 INFO:teuthology.orchestra.run.smithi101.stdout: "duration": 0.061934221999999997 2023-08-01T19:55:44.948 INFO:teuthology.orchestra.run.smithi101.stdout: }, 2023-08-01T19:55:44.948 INFO:teuthology.orchestra.run.smithi101.stdout: { 2023-08-01T19:55:44.948 INFO:teuthology.orchestra.run.smithi101.stdout: "event": "queued_for_pg", 2023-08-01T19:55:44.949 INFO:teuthology.orchestra.run.smithi101.stdout: "time": "2023-08-01T19:55:09.345768+0000", 2023-08-01T19:55:44.949 INFO:teuthology.orchestra.run.smithi101.stdout: "duration": 8.7099999999999996e-06 2023-08-01T19:55:44.949 INFO:teuthology.orchestra.run.smithi101.stdout: }, 2023-08-01T19:55:44.949 INFO:teuthology.orchestra.run.smithi101.stdout: { 2023-08-01T19:55:44.949 INFO:teuthology.orchestra.run.smithi101.stdout: "event": "reached_pg", 2023-08-01T19:55:44.949 INFO:teuthology.orchestra.run.smithi101.stdout: "time": "2023-08-01T19:55:09.345832+0000", 2023-08-01T19:55:44.949 INFO:teuthology.orchestra.run.smithi101.stdout: "duration": 6.4769000000000003e-05 2023-08-01T19:55:44.949 INFO:teuthology.orchestra.run.smithi101.stdout: }, 2023-08-01T19:55:44.950 INFO:teuthology.orchestra.run.smithi101.stdout: { 2023-08-01T19:55:44.950 INFO:teuthology.orchestra.run.smithi101.stdout: "event": "started", 2023-08-01T19:55:44.950 INFO:teuthology.orchestra.run.smithi101.stdout: "time": "2023-08-01T19:55:09.345851+0000", 2023-08-01T19:55:44.950 INFO:teuthology.orchestra.run.smithi101.stdout: "duration": 1.9049e-05 2023-08-01T19:55:44.950 INFO:teuthology.orchestra.run.smithi101.stdout: }, 2023-08-01T19:55:44.950 INFO:teuthology.orchestra.run.smithi101.stdout: { 2023-08-01T19:55:44.950 INFO:teuthology.orchestra.run.smithi101.stdout: "event": "commit_sent", 2023-08-01T19:55:44.950 INFO:teuthology.orchestra.run.smithi101.stdout: "time": "2023-08-01T19:55:09.351601+0000", 2023-08-01T19:55:44.951 INFO:teuthology.orchestra.run.smithi101.stdout: "duration": 0.0057499930000000001 2023-08-01T19:55:44.951 INFO:teuthology.orchestra.run.smithi101.stdout: }, 2023-08-01T19:55:44.951 INFO:teuthology.orchestra.run.smithi101.stdout: { 2023-08-01T19:55:44.951 INFO:teuthology.orchestra.run.smithi101.stdout: "event": "done", 2023-08-01T19:55:44.951 INFO:teuthology.orchestra.run.smithi101.stdout: "time": "2023-08-01T19:55:09.351639+0000", 2023-08-01T19:55:44.951 INFO:teuthology.orchestra.run.smithi101.stdout: "duration": 3.7941000000000001e-05 2023-08-01T19:55:44.951 INFO:teuthology.orchestra.run.smithi101.stdout: } 2023-08-01T19:55:44.951 INFO:teuthology.orchestra.run.smithi101.stdout: ] 2023-08-01T19:55:44.952 INFO:teuthology.orchestra.run.smithi101.stdout: } 2023-08-01T19:55:44.952 INFO:teuthology.orchestra.run.smithi101.stdout: }, 2023-08-01T19:55:44.952 INFO:teuthology.orchestra.run.smithi101.stdout: { 2023-08-01T19:55:44.952 INFO:teuthology.orchestra.run.smithi101.stdout: "description": "osd_op(client.4668.0:107876 5.1 5:8d2344a3:::benchmark_data_smithi006_114134_object107875:head [set-alloc-hint object_size 65536 write_size 65536,write 0~65536] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e38)", 2023-08-01T19:55:44.952 INFO:teuthology.orchestra.run.smithi101.stdout: "initiated_at": "2023-08-01T19:55:09.287802+0000", 2023-08-01T19:55:44.952 INFO:teuthology.orchestra.run.smithi101.stdout: "age": 35.463556746999998, 2023-08-01T19:55:44.952 INFO:teuthology.orchestra.run.smithi101.stdout: "duration": 0.066738461999999998, 2023-08-01T19:55:44.952 INFO:teuthology.orchestra.run.smithi101.stdout: "type_data": { 2023-08-01T19:55:44.953 INFO:teuthology.orchestra.run.smithi101.stdout: "flag_point": "commit sent; apply or cleanup", 2023-08-01T19:55:44.953 INFO:teuthology.orchestra.run.smithi101.stdout: "client_info": { 2023-08-01T19:55:44.953 INFO:teuthology.orchestra.run.smithi101.stdout: "client": "client.4668", 2023-08-01T19:55:44.953 INFO:teuthology.orchestra.run.smithi101.stdout: "client_addr": "172.21.15.6:0/1709472247", 2023-08-01T19:55:44.953 INFO:teuthology.orchestra.run.smithi101.stdout: "tid": 107876 2023-08-01T19:55:44.953 INFO:teuthology.orchestra.run.smithi101.stdout: }, 2023-08-01T19:55:44.953 INFO:teuthology.orchestra.run.smithi101.stdout: "events": [ 2023-08-01T19:55:44.953 INFO:teuthology.orchestra.run.smithi101.stdout: { 2023-08-01T19:55:44.954 INFO:teuthology.orchestra.run.smithi101.stdout: "event": "initiated", 2023-08-01T19:55:44.954 INFO:teuthology.orchestra.run.smithi101.stdout: "time": "2023-08-01T19:55:09.287802+0000", 2023-08-01T19:55:44.954 INFO:teuthology.orchestra.run.smithi101.stdout: "duration": 0 2023-08-01T19:55:44.954 INFO:teuthology.orchestra.run.smithi101.stdout: }, 2023-08-01T19:55:44.954 INFO:teuthology.orchestra.run.smithi101.stdout: { 2023-08-01T19:55:44.954 INFO:teuthology.orchestra.run.smithi101.stdout: "event": "throttled", 2023-08-01T19:55:44.954 INFO:teuthology.orchestra.run.smithi101.stdout: "time": "2023-08-01T19:55:09.287802+0000", 2023-08-01T19:55:44.955 INFO:teuthology.orchestra.run.smithi101.stdout: "duration": 0 2023-08-01T19:55:44.955 INFO:teuthology.orchestra.run.smithi101.stdout: }, 2023-08-01T19:55:44.955 INFO:teuthology.orchestra.run.smithi101.stdout: { 2023-08-01T19:55:44.955 INFO:teuthology.orchestra.run.smithi101.stdout: "event": "header_read", 2023-08-01T19:55:44.955 INFO:teuthology.orchestra.run.smithi101.stdout: "time": "2023-08-01T19:55:09.287800+0000", 2023-08-01T19:55:44.955 INFO:teuthology.orchestra.run.smithi101.stdout: "duration": 4294967295.9999981 2023-08-01T19:55:44.955 INFO:teuthology.orchestra.run.smithi101.stdout: }, 2023-08-01T19:55:44.955 INFO:teuthology.orchestra.run.smithi101.stdout: { 2023-08-01T19:55:44.956 INFO:teuthology.orchestra.run.smithi101.stdout: "event": "all_read", 2023-08-01T19:55:44.956 INFO:teuthology.orchestra.run.smithi101.stdout: "time": "2023-08-01T19:55:09.287847+0000", 2023-08-01T19:55:44.956 INFO:teuthology.orchestra.run.smithi101.stdout: "duration": 4.6455999999999997e-05 2023-08-01T19:55:44.956 INFO:teuthology.orchestra.run.smithi101.stdout: }, 2023-08-01T19:55:44.956 INFO:teuthology.orchestra.run.smithi101.stdout: { 2023-08-01T19:55:44.956 INFO:teuthology.orchestra.run.smithi101.stdout: "event": "dispatched", 2023-08-01T19:55:44.956 INFO:teuthology.orchestra.run.smithi101.stdout: "time": "2023-08-01T19:55:09.345732+0000", 2023-08-01T19:55:44.956 INFO:teuthology.orchestra.run.smithi101.stdout: "duration": 0.057885955000000003 2023-08-01T19:55:44.957 INFO:teuthology.orchestra.run.smithi101.stdout: }, 2023-08-01T19:55:44.957 INFO:teuthology.orchestra.run.smithi101.stdout: { 2023-08-01T19:55:44.957 INFO:teuthology.orchestra.run.smithi101.stdout: "event": "queued_for_pg", 2023-08-01T19:55:44.957 INFO:teuthology.orchestra.run.smithi101.stdout: "time": "2023-08-01T19:55:09.345802+0000", 2023-08-01T19:55:44.957 INFO:teuthology.orchestra.run.smithi101.stdout: "duration": 6.9845000000000006e-05 2023-08-01T19:55:44.957 INFO:teuthology.orchestra.run.smithi101.stdout: }, 2023-08-01T19:55:44.957 INFO:teuthology.orchestra.run.smithi101.stdout: { 2023-08-01T19:55:44.957 INFO:teuthology.orchestra.run.smithi101.stdout: "event": "reached_pg", 2023-08-01T19:55:44.958 INFO:teuthology.orchestra.run.smithi101.stdout: "time": "2023-08-01T19:55:09.345841+0000", 2023-08-01T19:55:44.958 INFO:teuthology.orchestra.run.smithi101.stdout: "duration": 3.8719e-05 2023-08-01T19:55:44.958 INFO:teuthology.orchestra.run.smithi101.stdout: }, 2023-08-01T19:55:44.958 INFO:teuthology.orchestra.run.smithi101.stdout: { 2023-08-01T19:55:44.958 INFO:teuthology.orchestra.run.smithi101.stdout: "event": "started", 2023-08-01T19:55:44.958 INFO:teuthology.orchestra.run.smithi101.stdout: "time": "2023-08-01T19:55:09.345965+0000", 2023-08-01T19:55:44.958 INFO:teuthology.orchestra.run.smithi101.stdout: "duration": 0.00012353099999999999 2023-08-01T19:55:44.958 INFO:teuthology.orchestra.run.smithi101.stdout: }, 2023-08-01T19:55:44.959 INFO:teuthology.orchestra.run.smithi101.stdout: { 2023-08-01T19:55:44.959 INFO:teuthology.orchestra.run.smithi101.stdout: "event": "waiting for subops from 0", 2023-08-01T19:55:44.959 INFO:teuthology.orchestra.run.smithi101.stdout: "time": "2023-08-01T19:55:09.346113+0000", 2023-08-01T19:55:44.959 INFO:teuthology.orchestra.run.smithi101.stdout: "duration": 0.000148496 2023-08-01T19:55:44.959 INFO:teuthology.orchestra.run.smithi101.stdout: }, 2023-08-01T19:55:44.959 INFO:teuthology.orchestra.run.smithi101.stdout: { 2023-08-01T19:55:44.959 INFO:teuthology.orchestra.run.smithi101.stdout: "event": "sub_op_commit_rec", 2023-08-01T19:55:44.959 INFO:teuthology.orchestra.run.smithi101.stdout: "time": "2023-08-01T19:55:09.352561+0000", 2023-08-01T19:55:44.960 INFO:teuthology.orchestra.run.smithi101.stdout: "duration": 0.0064478890000000001 2023-08-01T19:55:44.960 INFO:teuthology.orchestra.run.smithi101.stdout: }, 2023-08-01T19:55:44.960 INFO:teuthology.orchestra.run.smithi101.stdout: { 2023-08-01T19:55:44.960 INFO:teuthology.orchestra.run.smithi101.stdout: "event": "op_commit", 2023-08-01T19:55:44.960 INFO:teuthology.orchestra.run.smithi101.stdout: "time": "2023-08-01T19:55:09.354475+0000", 2023-08-01T19:55:44.960 INFO:teuthology.orchestra.run.smithi101.stdout: "duration": 0.001913903 2023-08-01T19:55:44.960 INFO:teuthology.orchestra.run.smithi101.stdout: }, 2023-08-01T19:55:44.961 INFO:teuthology.orchestra.run.smithi101.stdout: { 2023-08-01T19:55:44.961 INFO:teuthology.orchestra.run.smithi101.stdout: "event": "commit_sent", 2023-08-01T19:55:44.961 INFO:teuthology.orchestra.run.smithi101.stdout: "time": "2023-08-01T19:55:09.354514+0000", 2023-08-01T19:55:44.961 INFO:teuthology.orchestra.run.smithi101.stdout: "duration": 3.8680999999999998e-05 2023-08-01T19:55:44.961 INFO:teuthology.orchestra.run.smithi101.stdout: }, 2023-08-01T19:55:44.961 INFO:teuthology.orchestra.run.smithi101.stdout: { 2023-08-01T19:55:44.961 INFO:teuthology.orchestra.run.smithi101.stdout: "event": "done", 2023-08-01T19:55:44.961 INFO:teuthology.orchestra.run.smithi101.stdout: "time": "2023-08-01T19:55:09.354541+0000", 2023-08-01T19:55:44.962 INFO:teuthology.orchestra.run.smithi101.stdout: "duration": 2.6976999999999999e-05 2023-08-01T19:55:44.962 INFO:teuthology.orchestra.run.smithi101.stdout: } 2023-08-01T19:55:44.962 INFO:teuthology.orchestra.run.smithi101.stdout: ] 2023-08-01T19:55:44.962 INFO:teuthology.orchestra.run.smithi101.stdout: } 2023-08-01T19:55:44.962 INFO:teuthology.orchestra.run.smithi101.stdout: } 2023-08-01T19:55:44.962 INFO:teuthology.orchestra.run.smithi101.stdout: ] 2023-08-01T19:55:44.962 INFO:teuthology.orchestra.run.smithi101.stdout:} 2023-08-01T19:55:44.963 DEBUG:teuthology.orchestra.run.smithi155:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 30 ceph --cluster ceph --admin-daemon /var/run/ceph/ceph-osd.2.asok dump_ops_in_flight 2023-08-01T19:55:44.964 INFO:tasks.ceph.osd.2.smithi155.stderr:2023-08-01T19:55:44.962+0000 7faa5c6ac700 -1 received signal: Hangup from /usr/bin/python3 /bin/daemon-helper kill ceph-osd -f --cluster ceph -i 2 (PID: 111337) UID: 0 2023-08-01T19:55:45.064 INFO:tasks.ceph.osd.0.smithi008.stderr:2023-08-01T19:55:45.063+0000 7f16a58f4700 -1 received signal: Hangup from /usr/bin/python3 /bin/daemon-helper kill ceph-osd -f --cluster ceph -i 0 (PID: 111179) UID: 0 2023-08-01T19:55:45.080 DEBUG:teuthology.orchestra.run.smithi006:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 120 ceph --cluster ceph osd set noscrub 2023-08-01T19:55:45.102 INFO:teuthology.orchestra.run.smithi155.stdout:{ 2023-08-01T19:55:45.102 INFO:teuthology.orchestra.run.smithi155.stdout: "ops": [], 2023-08-01T19:55:45.102 INFO:teuthology.orchestra.run.smithi155.stdout: "num_ops": 0 2023-08-01T19:55:45.103 INFO:teuthology.orchestra.run.smithi155.stdout:} 2023-08-01T19:55:45.114 DEBUG:teuthology.orchestra.run.smithi155:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 30 ceph --cluster ceph --admin-daemon /var/run/ceph/ceph-osd.2.asok dump_blocked_ops 2023-08-01T19:55:45.165 INFO:tasks.ceph.osd.2.smithi155.stderr:2023-08-01T19:55:45.163+0000 7faa5c6ac700 -1 received signal: Hangup from /usr/bin/python3 /bin/daemon-helper kill ceph-osd -f --cluster ceph -i 2 (PID: 111337) UID: 0 2023-08-01T19:55:45.266 INFO:tasks.ceph.osd.1.smithi101.stderr:2023-08-01T19:55:45.265+0000 7fb0cb7f6700 -1 received signal: Hangup from /usr/bin/python3 /bin/daemon-helper kill ceph-osd -f --cluster ceph -i 1 (PID: 111141) UID: 0 2023-08-01T19:55:45.278 INFO:teuthology.orchestra.run.smithi155.stdout:{ 2023-08-01T19:55:45.278 INFO:teuthology.orchestra.run.smithi155.stdout: "ops": [], 2023-08-01T19:55:45.278 INFO:teuthology.orchestra.run.smithi155.stdout: "complaint_time": 30, 2023-08-01T19:55:45.279 INFO:teuthology.orchestra.run.smithi155.stdout: "num_blocked_ops": 0 2023-08-01T19:55:45.279 INFO:teuthology.orchestra.run.smithi155.stdout:} 2023-08-01T19:55:45.291 DEBUG:teuthology.orchestra.run.smithi155:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 30 ceph --cluster ceph --admin-daemon /var/run/ceph/ceph-osd.2.asok dump_historic_ops 2023-08-01T19:55:45.367 INFO:tasks.ceph.osd.1.smithi101.stderr:2023-08-01T19:55:45.366+0000 7fb0cb7f6700 -1 received signal: Hangup from /usr/bin/python3 /bin/daemon-helper kill ceph-osd -f --cluster ceph -i 1 (PID: 111141) UID: 0 2023-08-01T19:55:45.468 INFO:tasks.ceph.osd.2.smithi155.stderr:2023-08-01T19:55:45.466+0000 7faa5c6ac700 -1 received signal: Hangup from /usr/bin/python3 /bin/daemon-helper kill ceph-osd -f --cluster ceph -i 2 (PID: 111337) UID: 0 2023-08-01T19:55:45.504 INFO:teuthology.orchestra.run.smithi155.stdout:{ 2023-08-01T19:55:45.504 INFO:teuthology.orchestra.run.smithi155.stdout: "size": 20, 2023-08-01T19:55:45.504 INFO:teuthology.orchestra.run.smithi155.stdout: "duration": 600, 2023-08-01T19:55:45.505 INFO:teuthology.orchestra.run.smithi155.stdout: "ops": [ 2023-08-01T19:55:45.505 INFO:teuthology.orchestra.run.smithi155.stdout: { 2023-08-01T19:55:45.505 INFO:teuthology.orchestra.run.smithi155.stdout: "description": "osd_op(client.4668.0:73454 5.8 5:15596b2f:::benchmark_data_smithi006_114134_object73453:head [set-alloc-hint object_size 65536 write_size 65536,write 0~65536] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e31)", 2023-08-01T19:55:45.505 INFO:teuthology.orchestra.run.smithi155.stdout: "initiated_at": "2023-08-01T19:54:51.460020+0000", 2023-08-01T19:55:45.505 INFO:teuthology.orchestra.run.smithi155.stdout: "age": 54.041124168000003, 2023-08-01T19:55:45.506 INFO:teuthology.orchestra.run.smithi155.stdout: "duration": 0.022889436999999999, 2023-08-01T19:55:45.506 INFO:teuthology.orchestra.run.smithi155.stdout: "type_data": { 2023-08-01T19:55:45.506 INFO:teuthology.orchestra.run.smithi155.stdout: "flag_point": "commit sent; apply or cleanup", 2023-08-01T19:55:45.506 INFO:teuthology.orchestra.run.smithi155.stdout: "client_info": { 2023-08-01T19:55:45.506 INFO:teuthology.orchestra.run.smithi155.stdout: "client": "client.4668", 2023-08-01T19:55:45.506 INFO:teuthology.orchestra.run.smithi155.stdout: "client_addr": "172.21.15.6:0/1709472247", 2023-08-01T19:55:45.506 INFO:teuthology.orchestra.run.smithi155.stdout: "tid": 73454 2023-08-01T19:55:45.507 INFO:teuthology.orchestra.run.smithi155.stdout: }, 2023-08-01T19:55:45.507 INFO:teuthology.orchestra.run.smithi155.stdout: "events": [ 2023-08-01T19:55:45.507 INFO:teuthology.orchestra.run.smithi155.stdout: { 2023-08-01T19:55:45.507 INFO:teuthology.orchestra.run.smithi155.stdout: "event": "initiated", 2023-08-01T19:55:45.507 INFO:teuthology.orchestra.run.smithi155.stdout: "time": "2023-08-01T19:54:51.460020+0000", 2023-08-01T19:55:45.507 INFO:teuthology.orchestra.run.smithi155.stdout: "duration": 0 2023-08-01T19:55:45.507 INFO:teuthology.orchestra.run.smithi155.stdout: }, 2023-08-01T19:55:45.507 INFO:teuthology.orchestra.run.smithi155.stdout: { 2023-08-01T19:55:45.508 INFO:teuthology.orchestra.run.smithi155.stdout: "event": "throttled", 2023-08-01T19:55:45.508 INFO:teuthology.orchestra.run.smithi155.stdout: "time": "2023-08-01T19:54:51.460020+0000", 2023-08-01T19:55:45.508 INFO:teuthology.orchestra.run.smithi155.stdout: "duration": 0 2023-08-01T19:55:45.508 INFO:teuthology.orchestra.run.smithi155.stdout: }, 2023-08-01T19:55:45.508 INFO:teuthology.orchestra.run.smithi155.stdout: { 2023-08-01T19:55:45.508 INFO:teuthology.orchestra.run.smithi155.stdout: "event": "header_read", 2023-08-01T19:55:45.508 INFO:teuthology.orchestra.run.smithi155.stdout: "time": "2023-08-01T19:54:51.460019+0000", 2023-08-01T19:55:45.509 INFO:teuthology.orchestra.run.smithi155.stdout: "duration": 4294967295.9999995 2023-08-01T19:55:45.509 INFO:teuthology.orchestra.run.smithi155.stdout: }, 2023-08-01T19:55:45.509 INFO:teuthology.orchestra.run.smithi155.stdout: { 2023-08-01T19:55:45.509 INFO:teuthology.orchestra.run.smithi155.stdout: "event": "all_read", 2023-08-01T19:55:45.509 INFO:teuthology.orchestra.run.smithi155.stdout: "time": "2023-08-01T19:54:51.460051+0000", 2023-08-01T19:55:45.509 INFO:teuthology.orchestra.run.smithi155.stdout: "duration": 3.1736000000000002e-05 2023-08-01T19:55:45.509 INFO:teuthology.orchestra.run.smithi155.stdout: }, 2023-08-01T19:55:45.510 INFO:teuthology.orchestra.run.smithi155.stdout: { 2023-08-01T19:55:45.510 INFO:teuthology.orchestra.run.smithi155.stdout: "event": "dispatched", 2023-08-01T19:55:45.510 INFO:teuthology.orchestra.run.smithi155.stdout: "time": "2023-08-01T19:54:51.460058+0000", 2023-08-01T19:55:45.510 INFO:teuthology.orchestra.run.smithi155.stdout: "duration": 7.3869999999999997e-06 2023-08-01T19:55:45.510 INFO:teuthology.orchestra.run.smithi155.stdout: }, 2023-08-01T19:55:45.510 INFO:teuthology.orchestra.run.smithi155.stdout: { 2023-08-01T19:55:45.510 INFO:teuthology.orchestra.run.smithi155.stdout: "event": "queued_for_pg", 2023-08-01T19:55:45.510 INFO:teuthology.orchestra.run.smithi155.stdout: "time": "2023-08-01T19:54:51.460062+0000", 2023-08-01T19:55:45.511 INFO:teuthology.orchestra.run.smithi155.stdout: "duration": 4.352e-06 2023-08-01T19:55:45.511 INFO:teuthology.orchestra.run.smithi155.stdout: }, 2023-08-01T19:55:45.511 INFO:teuthology.orchestra.run.smithi155.stdout: { 2023-08-01T19:55:45.511 INFO:teuthology.orchestra.run.smithi155.stdout: "event": "reached_pg", 2023-08-01T19:55:45.511 INFO:teuthology.orchestra.run.smithi155.stdout: "time": "2023-08-01T19:54:51.460101+0000", 2023-08-01T19:55:45.511 INFO:teuthology.orchestra.run.smithi155.stdout: "duration": 3.8705000000000003e-05 2023-08-01T19:55:45.511 INFO:teuthology.orchestra.run.smithi155.stdout: }, 2023-08-01T19:55:45.511 INFO:teuthology.orchestra.run.smithi155.stdout: { 2023-08-01T19:55:45.512 INFO:teuthology.orchestra.run.smithi155.stdout: "event": "started", 2023-08-01T19:55:45.512 INFO:teuthology.orchestra.run.smithi155.stdout: "time": "2023-08-01T19:54:51.460236+0000", 2023-08-01T19:55:45.512 INFO:teuthology.orchestra.run.smithi155.stdout: "duration": 0.00013463599999999999 2023-08-01T19:55:45.512 INFO:teuthology.orchestra.run.smithi155.stdout: }, 2023-08-01T19:55:45.512 INFO:teuthology.orchestra.run.smithi155.stdout: { 2023-08-01T19:55:45.512 INFO:teuthology.orchestra.run.smithi155.stdout: "event": "waiting for subops from 0", 2023-08-01T19:55:45.512 INFO:teuthology.orchestra.run.smithi155.stdout: "time": "2023-08-01T19:54:51.460391+0000", 2023-08-01T19:55:45.512 INFO:teuthology.orchestra.run.smithi155.stdout: "duration": 0.00015525000000000001 2023-08-01T19:55:45.513 INFO:teuthology.orchestra.run.smithi155.stdout: }, 2023-08-01T19:55:45.513 INFO:teuthology.orchestra.run.smithi155.stdout: { 2023-08-01T19:55:45.513 INFO:teuthology.orchestra.run.smithi155.stdout: "event": "sub_op_commit_rec", 2023-08-01T19:55:45.513 INFO:teuthology.orchestra.run.smithi155.stdout: "time": "2023-08-01T19:54:51.468393+0000", 2023-08-01T19:55:45.513 INFO:teuthology.orchestra.run.smithi155.stdout: "duration": 0.00800208 2023-08-01T19:55:45.513 INFO:teuthology.orchestra.run.smithi155.stdout: }, 2023-08-01T19:55:45.513 INFO:teuthology.orchestra.run.smithi155.stdout: { 2023-08-01T19:55:45.514 INFO:teuthology.orchestra.run.smithi155.stdout: "event": "op_commit", 2023-08-01T19:55:45.514 INFO:teuthology.orchestra.run.smithi155.stdout: "time": "2023-08-01T19:54:51.482815+0000", 2023-08-01T19:55:45.514 INFO:teuthology.orchestra.run.smithi155.stdout: "duration": 0.01442148 2023-08-01T19:55:45.514 INFO:teuthology.orchestra.run.smithi155.stdout: }, 2023-08-01T19:55:45.514 INFO:teuthology.orchestra.run.smithi155.stdout: { 2023-08-01T19:55:45.514 INFO:teuthology.orchestra.run.smithi155.stdout: "event": "commit_sent", 2023-08-01T19:55:45.514 INFO:teuthology.orchestra.run.smithi155.stdout: "time": "2023-08-01T19:54:51.482866+0000", 2023-08-01T19:55:45.514 INFO:teuthology.orchestra.run.smithi155.stdout: "duration": 5.1842999999999998e-05 2023-08-01T19:55:45.515 INFO:teuthology.orchestra.run.smithi155.stdout: }, 2023-08-01T19:55:45.515 INFO:teuthology.orchestra.run.smithi155.stdout: { 2023-08-01T19:55:45.515 INFO:teuthology.orchestra.run.smithi155.stdout: "event": "done", 2023-08-01T19:55:45.515 INFO:teuthology.orchestra.run.smithi155.stdout: "time": "2023-08-01T19:54:51.482909+0000", 2023-08-01T19:55:45.515 INFO:teuthology.orchestra.run.smithi155.stdout: "duration": 4.2663000000000001e-05 2023-08-01T19:55:45.515 INFO:teuthology.orchestra.run.smithi155.stdout: } 2023-08-01T19:55:45.515 INFO:teuthology.orchestra.run.smithi155.stdout: ] 2023-08-01T19:55:45.515 INFO:teuthology.orchestra.run.smithi155.stdout: } 2023-08-01T19:55:45.516 INFO:teuthology.orchestra.run.smithi155.stdout: }, 2023-08-01T19:55:45.516 INFO:teuthology.orchestra.run.smithi155.stdout: { 2023-08-01T19:55:45.516 INFO:teuthology.orchestra.run.smithi155.stdout: "description": "osd_op(client.4668.0:73455 5.b 5:de51121e:::benchmark_data_smithi006_114134_object73454:head [set-alloc-hint object_size 65536 write_size 65536,write 0~65536] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e31)", 2023-08-01T19:55:45.516 INFO:teuthology.orchestra.run.smithi155.stdout: "initiated_at": "2023-08-01T19:54:51.460078+0000", 2023-08-01T19:55:45.516 INFO:teuthology.orchestra.run.smithi155.stdout: "age": 54.041066194000003, 2023-08-01T19:55:45.516 INFO:teuthology.orchestra.run.smithi155.stdout: "duration": 0.022689121999999999, 2023-08-01T19:55:45.516 INFO:teuthology.orchestra.run.smithi155.stdout: "type_data": { 2023-08-01T19:55:45.516 INFO:teuthology.orchestra.run.smithi155.stdout: "flag_point": "commit sent; apply or cleanup", 2023-08-01T19:55:45.517 INFO:teuthology.orchestra.run.smithi155.stdout: "client_info": { 2023-08-01T19:55:45.517 INFO:teuthology.orchestra.run.smithi155.stdout: "client": "client.4668", 2023-08-01T19:55:45.517 INFO:teuthology.orchestra.run.smithi155.stdout: "client_addr": "172.21.15.6:0/1709472247", 2023-08-01T19:55:45.517 INFO:teuthology.orchestra.run.smithi155.stdout: "tid": 73455 2023-08-01T19:55:45.517 INFO:teuthology.orchestra.run.smithi155.stdout: }, 2023-08-01T19:55:45.517 INFO:teuthology.orchestra.run.smithi155.stdout: "events": [ 2023-08-01T19:55:45.517 INFO:teuthology.orchestra.run.smithi155.stdout: { 2023-08-01T19:55:45.517 INFO:teuthology.orchestra.run.smithi155.stdout: "event": "initiated", 2023-08-01T19:55:45.518 INFO:teuthology.orchestra.run.smithi155.stdout: "time": "2023-08-01T19:54:51.460078+0000", 2023-08-01T19:55:45.518 INFO:teuthology.orchestra.run.smithi155.stdout: "duration": 0 2023-08-01T19:55:45.518 INFO:teuthology.orchestra.run.smithi155.stdout: }, 2023-08-01T19:55:45.518 INFO:teuthology.orchestra.run.smithi155.stdout: { 2023-08-01T19:55:45.518 INFO:teuthology.orchestra.run.smithi155.stdout: "event": "throttled", 2023-08-01T19:55:45.518 INFO:teuthology.orchestra.run.smithi155.stdout: "time": "2023-08-01T19:54:51.460078+0000", 2023-08-01T19:55:45.518 INFO:teuthology.orchestra.run.smithi155.stdout: "duration": 0 2023-08-01T19:55:45.518 INFO:teuthology.orchestra.run.smithi155.stdout: }, 2023-08-01T19:55:45.519 INFO:teuthology.orchestra.run.smithi155.stdout: { 2023-08-01T19:55:45.519 INFO:teuthology.orchestra.run.smithi155.stdout: "event": "header_read", 2023-08-01T19:55:45.519 INFO:teuthology.orchestra.run.smithi155.stdout: "time": "2023-08-01T19:54:51.460077+0000", 2023-08-01T19:55:45.519 INFO:teuthology.orchestra.run.smithi155.stdout: "duration": 4294967295.9999995 2023-08-01T19:55:45.519 INFO:teuthology.orchestra.run.smithi155.stdout: }, 2023-08-01T19:55:45.519 INFO:teuthology.orchestra.run.smithi155.stdout: { 2023-08-01T19:55:45.519 INFO:teuthology.orchestra.run.smithi155.stdout: "event": "all_read", 2023-08-01T19:55:45.519 INFO:teuthology.orchestra.run.smithi155.stdout: "time": "2023-08-01T19:54:51.460102+0000", 2023-08-01T19:55:45.520 INFO:teuthology.orchestra.run.smithi155.stdout: "duration": 2.4933e-05 2023-08-01T19:55:45.520 INFO:teuthology.orchestra.run.smithi155.stdout: }, 2023-08-01T19:55:45.520 INFO:teuthology.orchestra.run.smithi155.stdout: { 2023-08-01T19:55:45.520 INFO:teuthology.orchestra.run.smithi155.stdout: "event": "dispatched", 2023-08-01T19:55:45.520 INFO:teuthology.orchestra.run.smithi155.stdout: "time": "2023-08-01T19:54:51.460109+0000", 2023-08-01T19:55:45.520 INFO:teuthology.orchestra.run.smithi155.stdout: "duration": 7.0720000000000002e-06 2023-08-01T19:55:45.520 INFO:teuthology.orchestra.run.smithi155.stdout: }, 2023-08-01T19:55:45.521 INFO:teuthology.orchestra.run.smithi155.stdout: { 2023-08-01T19:55:45.521 INFO:teuthology.orchestra.run.smithi155.stdout: "event": "queued_for_pg", 2023-08-01T19:55:45.521 INFO:teuthology.orchestra.run.smithi155.stdout: "time": "2023-08-01T19:54:51.460113+0000", 2023-08-01T19:55:45.521 INFO:teuthology.orchestra.run.smithi155.stdout: "duration": 4.3220000000000003e-06 2023-08-01T19:55:45.521 INFO:teuthology.orchestra.run.smithi155.stdout: }, 2023-08-01T19:55:45.521 INFO:teuthology.orchestra.run.smithi155.stdout: { 2023-08-01T19:55:45.521 INFO:teuthology.orchestra.run.smithi155.stdout: "event": "reached_pg", 2023-08-01T19:55:45.521 INFO:teuthology.orchestra.run.smithi155.stdout: "time": "2023-08-01T19:54:51.460955+0000", 2023-08-01T19:55:45.523 INFO:teuthology.orchestra.run.smithi155.stdout: "duration": 0.00084142500000000003 2023-08-01T19:55:45.523 INFO:teuthology.orchestra.run.smithi155.stdout: }, 2023-08-01T19:55:45.523 INFO:teuthology.orchestra.run.smithi155.stdout: { 2023-08-01T19:55:45.523 INFO:teuthology.orchestra.run.smithi155.stdout: "event": "started", 2023-08-01T19:55:45.524 INFO:teuthology.orchestra.run.smithi155.stdout: "time": "2023-08-01T19:54:51.461079+0000", 2023-08-01T19:55:45.524 INFO:teuthology.orchestra.run.smithi155.stdout: "duration": 0.000123826 2023-08-01T19:55:45.524 INFO:teuthology.orchestra.run.smithi155.stdout: }, 2023-08-01T19:55:45.524 INFO:teuthology.orchestra.run.smithi155.stdout: { 2023-08-01T19:55:45.524 INFO:teuthology.orchestra.run.smithi155.stdout: "event": "waiting for subops from 0", 2023-08-01T19:55:45.524 INFO:teuthology.orchestra.run.smithi155.stdout: "time": "2023-08-01T19:54:51.461233+0000", 2023-08-01T19:55:45.524 INFO:teuthology.orchestra.run.smithi155.stdout: "duration": 0.00015431900000000001 2023-08-01T19:55:45.525 INFO:teuthology.orchestra.run.smithi155.stdout: }, 2023-08-01T19:55:45.525 INFO:teuthology.orchestra.run.smithi155.stdout: { 2023-08-01T19:55:45.525 INFO:teuthology.orchestra.run.smithi155.stdout: "event": "sub_op_commit_rec", 2023-08-01T19:55:45.525 INFO:teuthology.orchestra.run.smithi155.stdout: "time": "2023-08-01T19:54:51.468509+0000", 2023-08-01T19:55:45.525 INFO:teuthology.orchestra.run.smithi155.stdout: "duration": 0.0072759859999999999 2023-08-01T19:55:45.525 INFO:teuthology.orchestra.run.smithi155.stdout: }, 2023-08-01T19:55:45.525 INFO:teuthology.orchestra.run.smithi155.stdout: { 2023-08-01T19:55:45.525 INFO:teuthology.orchestra.run.smithi155.stdout: "event": "op_commit", 2023-08-01T19:55:45.526 INFO:teuthology.orchestra.run.smithi155.stdout: "time": "2023-08-01T19:54:51.482704+0000", 2023-08-01T19:55:45.526 INFO:teuthology.orchestra.run.smithi155.stdout: "duration": 0.01419545 2023-08-01T19:55:45.526 INFO:teuthology.orchestra.run.smithi155.stdout: }, 2023-08-01T19:55:45.526 INFO:teuthology.orchestra.run.smithi155.stdout: { 2023-08-01T19:55:45.526 INFO:teuthology.orchestra.run.smithi155.stdout: "event": "commit_sent", 2023-08-01T19:55:45.526 INFO:teuthology.orchestra.run.smithi155.stdout: "time": "2023-08-01T19:54:51.482747+0000", 2023-08-01T19:55:45.526 INFO:teuthology.orchestra.run.smithi155.stdout: "duration": 4.2413999999999997e-05 2023-08-01T19:55:45.526 INFO:teuthology.orchestra.run.smithi155.stdout: }, 2023-08-01T19:55:45.527 INFO:teuthology.orchestra.run.smithi155.stdout: { 2023-08-01T19:55:45.527 INFO:teuthology.orchestra.run.smithi155.stdout: "event": "done", 2023-08-01T19:55:45.527 INFO:teuthology.orchestra.run.smithi155.stdout: "time": "2023-08-01T19:54:51.482767+0000", 2023-08-01T19:55:45.527 INFO:teuthology.orchestra.run.smithi155.stdout: "duration": 1.9908999999999999e-05 2023-08-01T19:55:45.527 INFO:teuthology.orchestra.run.smithi155.stdout: } 2023-08-01T19:55:45.527 INFO:teuthology.orchestra.run.smithi155.stdout: ] 2023-08-01T19:55:45.527 INFO:teuthology.orchestra.run.smithi155.stdout: } 2023-08-01T19:55:45.527 INFO:teuthology.orchestra.run.smithi155.stdout: }, 2023-08-01T19:55:45.528 INFO:teuthology.orchestra.run.smithi155.stdout: { 2023-08-01T19:55:45.528 INFO:teuthology.orchestra.run.smithi155.stdout: "description": "osd_op(client.4668.0:73456 5.0 5:0164baf4:::benchmark_data_smithi006_114134_object73455:head [set-alloc-hint object_size 65536 write_size 65536,write 0~65536] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e31)", 2023-08-01T19:55:45.528 INFO:teuthology.orchestra.run.smithi155.stdout: "initiated_at": "2023-08-01T19:54:51.461520+0000", 2023-08-01T19:55:45.528 INFO:teuthology.orchestra.run.smithi155.stdout: "age": 54.039624203999999, 2023-08-01T19:55:45.528 INFO:teuthology.orchestra.run.smithi155.stdout: "duration": 0.023899916, 2023-08-01T19:55:45.528 INFO:teuthology.orchestra.run.smithi155.stdout: "type_data": { 2023-08-01T19:55:45.528 INFO:teuthology.orchestra.run.smithi155.stdout: "flag_point": "commit sent; apply or cleanup", 2023-08-01T19:55:45.528 INFO:teuthology.orchestra.run.smithi155.stdout: "client_info": { 2023-08-01T19:55:45.529 INFO:teuthology.orchestra.run.smithi155.stdout: "client": "client.4668", 2023-08-01T19:55:45.529 INFO:teuthology.orchestra.run.smithi155.stdout: "client_addr": "172.21.15.6:0/1709472247", 2023-08-01T19:55:45.529 INFO:teuthology.orchestra.run.smithi155.stdout: "tid": 73456 2023-08-01T19:55:45.529 INFO:teuthology.orchestra.run.smithi155.stdout: }, 2023-08-01T19:55:45.529 INFO:teuthology.orchestra.run.smithi155.stdout: "events": [ 2023-08-01T19:55:45.529 INFO:teuthology.orchestra.run.smithi155.stdout: { 2023-08-01T19:55:45.529 INFO:teuthology.orchestra.run.smithi155.stdout: "event": "initiated", 2023-08-01T19:55:45.529 INFO:teuthology.orchestra.run.smithi155.stdout: "time": "2023-08-01T19:54:51.461520+0000", 2023-08-01T19:55:45.530 INFO:teuthology.orchestra.run.smithi155.stdout: "duration": 0 2023-08-01T19:55:45.530 INFO:teuthology.orchestra.run.smithi155.stdout: }, 2023-08-01T19:55:45.530 INFO:teuthology.orchestra.run.smithi155.stdout: { 2023-08-01T19:55:45.530 INFO:teuthology.orchestra.run.smithi155.stdout: "event": "throttled", 2023-08-01T19:55:45.530 INFO:teuthology.orchestra.run.smithi155.stdout: "time": "2023-08-01T19:54:51.461520+0000", 2023-08-01T19:55:45.530 INFO:teuthology.orchestra.run.smithi155.stdout: "duration": 0 2023-08-01T19:55:45.530 INFO:teuthology.orchestra.run.smithi155.stdout: }, 2023-08-01T19:55:45.531 INFO:teuthology.orchestra.run.smithi155.stdout: { 2023-08-01T19:55:45.531 INFO:teuthology.orchestra.run.smithi155.stdout: "event": "header_read", 2023-08-01T19:55:45.531 INFO:teuthology.orchestra.run.smithi155.stdout: "time": "2023-08-01T19:54:51.461519+0000", 2023-08-01T19:55:45.531 INFO:teuthology.orchestra.run.smithi155.stdout: "duration": 4294967295.999999 2023-08-01T19:55:45.531 INFO:teuthology.orchestra.run.smithi155.stdout: }, 2023-08-01T19:55:45.531 INFO:teuthology.orchestra.run.smithi155.stdout: { 2023-08-01T19:55:45.531 INFO:teuthology.orchestra.run.smithi155.stdout: "event": "all_read", 2023-08-01T19:55:45.531 INFO:teuthology.orchestra.run.smithi155.stdout: "time": "2023-08-01T19:54:51.461633+0000", 2023-08-01T19:55:45.532 INFO:teuthology.orchestra.run.smithi155.stdout: "duration": 0.000114015 2023-08-01T19:55:45.532 INFO:teuthology.orchestra.run.smithi155.stdout: }, 2023-08-01T19:55:45.532 INFO:teuthology.orchestra.run.smithi155.stdout: { 2023-08-01T19:55:45.532 INFO:teuthology.orchestra.run.smithi155.stdout: "event": "dispatched", 2023-08-01T19:55:45.532 INFO:teuthology.orchestra.run.smithi155.stdout: "time": "2023-08-01T19:54:51.461643+0000", 2023-08-01T19:55:45.532 INFO:teuthology.orchestra.run.smithi155.stdout: "duration": 1.0217000000000001e-05 2023-08-01T19:55:45.532 INFO:teuthology.orchestra.run.smithi155.stdout: }, 2023-08-01T19:55:45.532 INFO:teuthology.orchestra.run.smithi155.stdout: { 2023-08-01T19:55:45.533 INFO:teuthology.orchestra.run.smithi155.stdout: "event": "queued_for_pg", 2023-08-01T19:55:45.533 INFO:teuthology.orchestra.run.smithi155.stdout: "time": "2023-08-01T19:54:51.461649+0000", 2023-08-01T19:55:45.533 INFO:teuthology.orchestra.run.smithi155.stdout: "duration": 5.8850000000000004e-06 2023-08-01T19:55:45.533 INFO:teuthology.orchestra.run.smithi155.stdout: }, 2023-08-01T19:55:45.533 INFO:teuthology.orchestra.run.smithi155.stdout: { 2023-08-01T19:55:45.533 INFO:teuthology.orchestra.run.smithi155.stdout: "event": "reached_pg", 2023-08-01T19:55:45.533 INFO:teuthology.orchestra.run.smithi155.stdout: "time": "2023-08-01T19:54:51.461686+0000", 2023-08-01T19:55:45.533 INFO:teuthology.orchestra.run.smithi155.stdout: "duration": 3.7319e-05 2023-08-01T19:55:45.534 INFO:teuthology.orchestra.run.smithi155.stdout: }, 2023-08-01T19:55:45.534 INFO:teuthology.orchestra.run.smithi155.stdout: { 2023-08-01T19:55:45.534 INFO:teuthology.orchestra.run.smithi155.stdout: "event": "started", 2023-08-01T19:55:45.534 INFO:teuthology.orchestra.run.smithi155.stdout: "time": "2023-08-01T19:54:51.461802+0000", 2023-08-01T19:55:45.534 INFO:teuthology.orchestra.run.smithi155.stdout: "duration": 0.000115604 2023-08-01T19:55:45.534 INFO:teuthology.orchestra.run.smithi155.stdout: }, 2023-08-01T19:55:45.534 INFO:teuthology.orchestra.run.smithi155.stdout: { 2023-08-01T19:55:45.534 INFO:teuthology.orchestra.run.smithi155.stdout: "event": "waiting for subops from 0", 2023-08-01T19:55:45.535 INFO:teuthology.orchestra.run.smithi155.stdout: "time": "2023-08-01T19:54:51.461933+0000", 2023-08-01T19:55:45.535 INFO:teuthology.orchestra.run.smithi155.stdout: "duration": 0.000131175 2023-08-01T19:55:45.535 INFO:teuthology.orchestra.run.smithi155.stdout: }, 2023-08-01T19:55:45.535 INFO:teuthology.orchestra.run.smithi155.stdout: { 2023-08-01T19:55:45.535 INFO:teuthology.orchestra.run.smithi155.stdout: "event": "sub_op_commit_rec", 2023-08-01T19:55:45.535 INFO:teuthology.orchestra.run.smithi155.stdout: "time": "2023-08-01T19:54:51.468411+0000", 2023-08-01T19:55:45.535 INFO:teuthology.orchestra.run.smithi155.stdout: "duration": 0.0064775850000000001 2023-08-01T19:55:45.535 INFO:teuthology.orchestra.run.smithi155.stdout: }, 2023-08-01T19:55:45.536 INFO:teuthology.orchestra.run.smithi155.stdout: { 2023-08-01T19:55:45.536 INFO:teuthology.orchestra.run.smithi155.stdout: "event": "op_commit", 2023-08-01T19:55:45.536 INFO:teuthology.orchestra.run.smithi155.stdout: "time": "2023-08-01T19:54:51.485340+0000", 2023-08-01T19:55:45.536 INFO:teuthology.orchestra.run.smithi155.stdout: "duration": 0.016928907 2023-08-01T19:55:45.536 INFO:teuthology.orchestra.run.smithi155.stdout: }, 2023-08-01T19:55:45.536 INFO:teuthology.orchestra.run.smithi155.stdout: { 2023-08-01T19:55:45.536 INFO:teuthology.orchestra.run.smithi155.stdout: "event": "commit_sent", 2023-08-01T19:55:45.537 INFO:teuthology.orchestra.run.smithi155.stdout: "time": "2023-08-01T19:54:51.485385+0000", 2023-08-01T19:55:45.537 INFO:teuthology.orchestra.run.smithi155.stdout: "duration": 4.5222000000000002e-05 2023-08-01T19:55:45.537 INFO:teuthology.orchestra.run.smithi155.stdout: }, 2023-08-01T19:55:45.537 INFO:teuthology.orchestra.run.smithi155.stdout: { 2023-08-01T19:55:45.537 INFO:teuthology.orchestra.run.smithi155.stdout: "event": "done", 2023-08-01T19:55:45.537 INFO:teuthology.orchestra.run.smithi155.stdout: "time": "2023-08-01T19:54:51.485420+0000", 2023-08-01T19:55:45.537 INFO:teuthology.orchestra.run.smithi155.stdout: "duration": 3.4717e-05 2023-08-01T19:55:45.537 INFO:teuthology.orchestra.run.smithi155.stdout: } 2023-08-01T19:55:45.538 INFO:teuthology.orchestra.run.smithi155.stdout: ] 2023-08-01T19:55:45.538 INFO:teuthology.orchestra.run.smithi155.stdout: } 2023-08-01T19:55:45.538 INFO:teuthology.orchestra.run.smithi155.stdout: }, 2023-08-01T19:55:45.538 INFO:teuthology.orchestra.run.smithi155.stdout: { 2023-08-01T19:55:45.538 INFO:teuthology.orchestra.run.smithi155.stdout: "description": "osd_op(client.4668.0:100237 5.4 5:2d68bec9:::benchmark_data_smithi006_114134_object100236:head [set-alloc-hint object_size 65536 write_size 65536,write 0~65536] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e37)", 2023-08-01T19:55:45.538 INFO:teuthology.orchestra.run.smithi155.stdout: "initiated_at": "2023-08-01T19:55:05.147736+0000", 2023-08-01T19:55:45.538 INFO:teuthology.orchestra.run.smithi155.stdout: "age": 40.353407490999999, 2023-08-01T19:55:45.538 INFO:teuthology.orchestra.run.smithi155.stdout: "duration": 0.071299464000000007, 2023-08-01T19:55:45.539 INFO:teuthology.orchestra.run.smithi155.stdout: "type_data": { 2023-08-01T19:55:45.539 INFO:teuthology.orchestra.run.smithi155.stdout: "flag_point": "commit sent; apply or cleanup", 2023-08-01T19:55:45.539 INFO:teuthology.orchestra.run.smithi155.stdout: "client_info": { 2023-08-01T19:55:45.539 INFO:teuthology.orchestra.run.smithi155.stdout: "client": "client.4668", 2023-08-01T19:55:45.539 INFO:teuthology.orchestra.run.smithi155.stdout: "client_addr": "172.21.15.6:0/1709472247", 2023-08-01T19:55:45.539 INFO:teuthology.orchestra.run.smithi155.stdout: "tid": 100237 2023-08-01T19:55:45.539 INFO:teuthology.orchestra.run.smithi155.stdout: }, 2023-08-01T19:55:45.539 INFO:teuthology.orchestra.run.smithi155.stdout: "events": [ 2023-08-01T19:55:45.540 INFO:teuthology.orchestra.run.smithi155.stdout: { 2023-08-01T19:55:45.540 INFO:teuthology.orchestra.run.smithi155.stdout: "event": "initiated", 2023-08-01T19:55:45.540 INFO:teuthology.orchestra.run.smithi155.stdout: "time": "2023-08-01T19:55:05.147736+0000", 2023-08-01T19:55:45.540 INFO:teuthology.orchestra.run.smithi155.stdout: "duration": 0 2023-08-01T19:55:45.540 INFO:teuthology.orchestra.run.smithi155.stdout: }, 2023-08-01T19:55:45.540 INFO:teuthology.orchestra.run.smithi155.stdout: { 2023-08-01T19:55:45.540 INFO:teuthology.orchestra.run.smithi155.stdout: "event": "throttled", 2023-08-01T19:55:45.540 INFO:teuthology.orchestra.run.smithi155.stdout: "time": "2023-08-01T19:55:05.147736+0000", 2023-08-01T19:55:45.541 INFO:teuthology.orchestra.run.smithi155.stdout: "duration": 0 2023-08-01T19:55:45.541 INFO:teuthology.orchestra.run.smithi155.stdout: }, 2023-08-01T19:55:45.541 INFO:teuthology.orchestra.run.smithi155.stdout: { 2023-08-01T19:55:45.541 INFO:teuthology.orchestra.run.smithi155.stdout: "event": "header_read", 2023-08-01T19:55:45.541 INFO:teuthology.orchestra.run.smithi155.stdout: "time": "2023-08-01T19:55:05.147736+0000", 2023-08-01T19:55:45.541 INFO:teuthology.orchestra.run.smithi155.stdout: "duration": 4294967295.9999995 2023-08-01T19:55:45.541 INFO:teuthology.orchestra.run.smithi155.stdout: }, 2023-08-01T19:55:45.542 INFO:teuthology.orchestra.run.smithi155.stdout: { 2023-08-01T19:55:45.542 INFO:teuthology.orchestra.run.smithi155.stdout: "event": "all_read", 2023-08-01T19:55:45.542 INFO:teuthology.orchestra.run.smithi155.stdout: "time": "2023-08-01T19:55:05.147766+0000", 2023-08-01T19:55:45.542 INFO:teuthology.orchestra.run.smithi155.stdout: "duration": 3.0394000000000001e-05 2023-08-01T19:55:45.542 INFO:teuthology.orchestra.run.smithi155.stdout: }, 2023-08-01T19:55:45.542 INFO:teuthology.orchestra.run.smithi155.stdout: { 2023-08-01T19:55:45.542 INFO:teuthology.orchestra.run.smithi155.stdout: "event": "dispatched", 2023-08-01T19:55:45.542 INFO:teuthology.orchestra.run.smithi155.stdout: "time": "2023-08-01T19:55:05.147771+0000", 2023-08-01T19:55:45.543 INFO:teuthology.orchestra.run.smithi155.stdout: "duration": 4.25e-06 2023-08-01T19:55:45.543 INFO:teuthology.orchestra.run.smithi155.stdout: }, 2023-08-01T19:55:45.543 INFO:teuthology.orchestra.run.smithi155.stdout: { 2023-08-01T19:55:45.543 INFO:teuthology.orchestra.run.smithi155.stdout: "event": "queued_for_pg", 2023-08-01T19:55:45.543 INFO:teuthology.orchestra.run.smithi155.stdout: "time": "2023-08-01T19:55:05.147773+0000", 2023-08-01T19:55:45.543 INFO:teuthology.orchestra.run.smithi155.stdout: "duration": 2.4159999999999998e-06 2023-08-01T19:55:45.543 INFO:teuthology.orchestra.run.smithi155.stdout: }, 2023-08-01T19:55:45.543 INFO:teuthology.orchestra.run.smithi155.stdout: { 2023-08-01T19:55:45.544 INFO:teuthology.orchestra.run.smithi155.stdout: "event": "reached_pg", 2023-08-01T19:55:45.544 INFO:teuthology.orchestra.run.smithi155.stdout: "time": "2023-08-01T19:55:05.149903+0000", 2023-08-01T19:55:45.544 INFO:teuthology.orchestra.run.smithi155.stdout: "duration": 0.002129948 2023-08-01T19:55:45.544 INFO:teuthology.orchestra.run.smithi155.stdout: }, 2023-08-01T19:55:45.544 INFO:teuthology.orchestra.run.smithi155.stdout: { 2023-08-01T19:55:45.544 INFO:teuthology.orchestra.run.smithi155.stdout: "event": "started", 2023-08-01T19:55:45.545 INFO:teuthology.orchestra.run.smithi155.stdout: "time": "2023-08-01T19:55:05.149982+0000", 2023-08-01T19:55:45.545 INFO:teuthology.orchestra.run.smithi155.stdout: "duration": 7.8706000000000002e-05 2023-08-01T19:55:45.545 INFO:teuthology.orchestra.run.smithi155.stdout: }, 2023-08-01T19:55:45.545 INFO:teuthology.orchestra.run.smithi155.stdout: { 2023-08-01T19:55:45.545 INFO:teuthology.orchestra.run.smithi155.stdout: "event": "waiting for subops from 0", 2023-08-01T19:55:45.545 INFO:teuthology.orchestra.run.smithi155.stdout: "time": "2023-08-01T19:55:05.150066+0000", 2023-08-01T19:55:45.546 INFO:teuthology.orchestra.run.smithi155.stdout: "duration": 8.4241999999999997e-05 2023-08-01T19:55:45.546 INFO:teuthology.orchestra.run.smithi155.stdout: }, 2023-08-01T19:55:45.546 INFO:teuthology.orchestra.run.smithi155.stdout: { 2023-08-01T19:55:45.546 INFO:teuthology.orchestra.run.smithi155.stdout: "event": "op_commit", 2023-08-01T19:55:45.546 INFO:teuthology.orchestra.run.smithi155.stdout: "time": "2023-08-01T19:55:05.154994+0000", 2023-08-01T19:55:45.546 INFO:teuthology.orchestra.run.smithi155.stdout: "duration": 0.0049277050000000001 2023-08-01T19:55:45.546 INFO:teuthology.orchestra.run.smithi155.stdout: }, 2023-08-01T19:55:45.546 INFO:teuthology.orchestra.run.smithi155.stdout: { 2023-08-01T19:55:45.547 INFO:teuthology.orchestra.run.smithi155.stdout: "event": "sub_op_commit_rec", 2023-08-01T19:55:45.547 INFO:teuthology.orchestra.run.smithi155.stdout: "time": "2023-08-01T19:55:05.218933+0000", 2023-08-01T19:55:45.547 INFO:teuthology.orchestra.run.smithi155.stdout: "duration": 0.063939916999999999 2023-08-01T19:55:45.547 INFO:teuthology.orchestra.run.smithi155.stdout: }, 2023-08-01T19:55:45.547 INFO:teuthology.orchestra.run.smithi155.stdout: { 2023-08-01T19:55:45.547 INFO:teuthology.orchestra.run.smithi155.stdout: "event": "commit_sent", 2023-08-01T19:55:45.547 INFO:teuthology.orchestra.run.smithi155.stdout: "time": "2023-08-01T19:55:05.218989+0000", 2023-08-01T19:55:45.548 INFO:teuthology.orchestra.run.smithi155.stdout: "duration": 5.5772000000000001e-05 2023-08-01T19:55:45.548 INFO:teuthology.orchestra.run.smithi155.stdout: }, 2023-08-01T19:55:45.548 INFO:teuthology.orchestra.run.smithi155.stdout: { 2023-08-01T19:55:45.548 INFO:teuthology.orchestra.run.smithi155.stdout: "event": "done", 2023-08-01T19:55:45.548 INFO:teuthology.orchestra.run.smithi155.stdout: "time": "2023-08-01T19:55:05.219036+0000", 2023-08-01T19:55:45.548 INFO:teuthology.orchestra.run.smithi155.stdout: "duration": 4.6526000000000001e-05 2023-08-01T19:55:45.548 INFO:teuthology.orchestra.run.smithi155.stdout: } 2023-08-01T19:55:45.548 INFO:teuthology.orchestra.run.smithi155.stdout: ] 2023-08-01T19:55:45.549 INFO:teuthology.orchestra.run.smithi155.stdout: } 2023-08-01T19:55:45.549 INFO:teuthology.orchestra.run.smithi155.stdout: }, 2023-08-01T19:55:45.549 INFO:teuthology.orchestra.run.smithi155.stdout: { 2023-08-01T19:55:45.549 INFO:teuthology.orchestra.run.smithi155.stdout: "description": "osd_op(client.4668.0:100242 5.8 5:16a314b8:::benchmark_data_smithi006_114134_object100241:head [set-alloc-hint object_size 65536 write_size 65536,write 0~65536] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e37)", 2023-08-01T19:55:45.549 INFO:teuthology.orchestra.run.smithi155.stdout: "initiated_at": "2023-08-01T19:55:05.150616+0000", 2023-08-01T19:55:45.549 INFO:teuthology.orchestra.run.smithi155.stdout: "age": 40.350527861000003, 2023-08-01T19:55:45.549 INFO:teuthology.orchestra.run.smithi155.stdout: "duration": 0.071105065999999995, 2023-08-01T19:55:45.549 INFO:teuthology.orchestra.run.smithi155.stdout: "type_data": { 2023-08-01T19:55:45.550 INFO:teuthology.orchestra.run.smithi155.stdout: "flag_point": "commit sent; apply or cleanup", 2023-08-01T19:55:45.550 INFO:teuthology.orchestra.run.smithi155.stdout: "client_info": { 2023-08-01T19:55:45.550 INFO:teuthology.orchestra.run.smithi155.stdout: "client": "client.4668", 2023-08-01T19:55:45.550 INFO:teuthology.orchestra.run.smithi155.stdout: "client_addr": "172.21.15.6:0/1709472247", 2023-08-01T19:55:45.550 INFO:teuthology.orchestra.run.smithi155.stdout: "tid": 100242 2023-08-01T19:55:45.550 INFO:teuthology.orchestra.run.smithi155.stdout: }, 2023-08-01T19:55:45.550 INFO:teuthology.orchestra.run.smithi155.stdout: "events": [ 2023-08-01T19:55:45.550 INFO:teuthology.orchestra.run.smithi155.stdout: { 2023-08-01T19:55:45.551 INFO:teuthology.orchestra.run.smithi155.stdout: "event": "initiated", 2023-08-01T19:55:45.551 INFO:teuthology.orchestra.run.smithi155.stdout: "time": "2023-08-01T19:55:05.150616+0000", 2023-08-01T19:55:45.551 INFO:teuthology.orchestra.run.smithi155.stdout: "duration": 0 2023-08-01T19:55:45.551 INFO:teuthology.orchestra.run.smithi155.stdout: }, 2023-08-01T19:55:45.551 INFO:teuthology.orchestra.run.smithi155.stdout: { 2023-08-01T19:55:45.551 INFO:teuthology.orchestra.run.smithi155.stdout: "event": "throttled", 2023-08-01T19:55:45.551 INFO:teuthology.orchestra.run.smithi155.stdout: "time": "2023-08-01T19:55:05.150616+0000", 2023-08-01T19:55:45.551 INFO:teuthology.orchestra.run.smithi155.stdout: "duration": 0 2023-08-01T19:55:45.552 INFO:teuthology.orchestra.run.smithi155.stdout: }, 2023-08-01T19:55:45.552 INFO:teuthology.orchestra.run.smithi155.stdout: { 2023-08-01T19:55:45.552 INFO:teuthology.orchestra.run.smithi155.stdout: "event": "header_read", 2023-08-01T19:55:45.552 INFO:teuthology.orchestra.run.smithi155.stdout: "time": "2023-08-01T19:55:05.150615+0000", 2023-08-01T19:55:45.552 INFO:teuthology.orchestra.run.smithi155.stdout: "duration": 4294967295.999999 2023-08-01T19:55:45.552 INFO:teuthology.orchestra.run.smithi155.stdout: }, 2023-08-01T19:55:45.552 INFO:teuthology.orchestra.run.smithi155.stdout: { 2023-08-01T19:55:45.553 INFO:teuthology.orchestra.run.smithi155.stdout: "event": "all_read", 2023-08-01T19:55:45.553 INFO:teuthology.orchestra.run.smithi155.stdout: "time": "2023-08-01T19:55:05.150696+0000", 2023-08-01T19:55:45.553 INFO:teuthology.orchestra.run.smithi155.stdout: "duration": 8.0852000000000004e-05 2023-08-01T19:55:45.553 INFO:teuthology.orchestra.run.smithi155.stdout: }, 2023-08-01T19:55:45.553 INFO:teuthology.orchestra.run.smithi155.stdout: { 2023-08-01T19:55:45.553 INFO:teuthology.orchestra.run.smithi155.stdout: "event": "dispatched", 2023-08-01T19:55:45.553 INFO:teuthology.orchestra.run.smithi155.stdout: "time": "2023-08-01T19:55:05.150708+0000", 2023-08-01T19:55:45.553 INFO:teuthology.orchestra.run.smithi155.stdout: "duration": 1.2116999999999999e-05 2023-08-01T19:55:45.554 INFO:teuthology.orchestra.run.smithi155.stdout: }, 2023-08-01T19:55:45.554 INFO:teuthology.orchestra.run.smithi155.stdout: { 2023-08-01T19:55:45.554 INFO:teuthology.orchestra.run.smithi155.stdout: "event": "queued_for_pg", 2023-08-01T19:55:45.554 INFO:teuthology.orchestra.run.smithi155.stdout: "time": "2023-08-01T19:55:05.150713+0000", 2023-08-01T19:55:45.554 INFO:teuthology.orchestra.run.smithi155.stdout: "duration": 5.4620000000000004e-06 2023-08-01T19:55:45.554 INFO:teuthology.orchestra.run.smithi155.stdout: }, 2023-08-01T19:55:45.554 INFO:teuthology.orchestra.run.smithi155.stdout: { 2023-08-01T19:55:45.554 INFO:teuthology.orchestra.run.smithi155.stdout: "event": "reached_pg", 2023-08-01T19:55:45.555 INFO:teuthology.orchestra.run.smithi155.stdout: "time": "2023-08-01T19:55:05.150761+0000", 2023-08-01T19:55:45.555 INFO:teuthology.orchestra.run.smithi155.stdout: "duration": 4.7429000000000003e-05 2023-08-01T19:55:45.555 INFO:teuthology.orchestra.run.smithi155.stdout: }, 2023-08-01T19:55:45.555 INFO:teuthology.orchestra.run.smithi155.stdout: { 2023-08-01T19:55:45.555 INFO:teuthology.orchestra.run.smithi155.stdout: "event": "started", 2023-08-01T19:55:45.555 INFO:teuthology.orchestra.run.smithi155.stdout: "time": "2023-08-01T19:55:05.150856+0000", 2023-08-01T19:55:45.555 INFO:teuthology.orchestra.run.smithi155.stdout: "duration": 9.5356e-05 2023-08-01T19:55:45.555 INFO:teuthology.orchestra.run.smithi155.stdout: }, 2023-08-01T19:55:45.556 INFO:teuthology.orchestra.run.smithi155.stdout: { 2023-08-01T19:55:45.556 INFO:teuthology.orchestra.run.smithi155.stdout: "event": "waiting for subops from 0", 2023-08-01T19:55:45.556 INFO:teuthology.orchestra.run.smithi155.stdout: "time": "2023-08-01T19:55:05.150999+0000", 2023-08-01T19:55:45.556 INFO:teuthology.orchestra.run.smithi155.stdout: "duration": 0.00014234499999999999 2023-08-01T19:55:45.556 INFO:teuthology.orchestra.run.smithi155.stdout: }, 2023-08-01T19:55:45.556 INFO:teuthology.orchestra.run.smithi155.stdout: { 2023-08-01T19:55:45.556 INFO:teuthology.orchestra.run.smithi155.stdout: "event": "sub_op_commit_rec", 2023-08-01T19:55:45.556 INFO:teuthology.orchestra.run.smithi155.stdout: "time": "2023-08-01T19:55:05.219001+0000", 2023-08-01T19:55:45.557 INFO:teuthology.orchestra.run.smithi155.stdout: "duration": 0.068002776000000001 2023-08-01T19:55:45.557 INFO:teuthology.orchestra.run.smithi155.stdout: }, 2023-08-01T19:55:45.557 INFO:teuthology.orchestra.run.smithi155.stdout: { 2023-08-01T19:55:45.557 INFO:teuthology.orchestra.run.smithi155.stdout: "event": "op_commit", 2023-08-01T19:55:45.557 INFO:teuthology.orchestra.run.smithi155.stdout: "time": "2023-08-01T19:55:05.221635+0000", 2023-08-01T19:55:45.557 INFO:teuthology.orchestra.run.smithi155.stdout: "duration": 0.0026340579999999999 2023-08-01T19:55:45.557 INFO:teuthology.orchestra.run.smithi155.stdout: }, 2023-08-01T19:55:45.558 INFO:teuthology.orchestra.run.smithi155.stdout: { 2023-08-01T19:55:45.558 INFO:teuthology.orchestra.run.smithi155.stdout: "event": "commit_sent", 2023-08-01T19:55:45.558 INFO:teuthology.orchestra.run.smithi155.stdout: "time": "2023-08-01T19:55:05.221682+0000", 2023-08-01T19:55:45.558 INFO:teuthology.orchestra.run.smithi155.stdout: "duration": 4.7123999999999998e-05 2023-08-01T19:55:45.558 INFO:teuthology.orchestra.run.smithi155.stdout: }, 2023-08-01T19:55:45.558 INFO:teuthology.orchestra.run.smithi155.stdout: { 2023-08-01T19:55:45.558 INFO:teuthology.orchestra.run.smithi155.stdout: "event": "done", 2023-08-01T19:55:45.558 INFO:teuthology.orchestra.run.smithi155.stdout: "time": "2023-08-01T19:55:05.221721+0000", 2023-08-01T19:55:45.559 INFO:teuthology.orchestra.run.smithi155.stdout: "duration": 3.8529999999999999e-05 2023-08-01T19:55:45.559 INFO:teuthology.orchestra.run.smithi155.stdout: } 2023-08-01T19:55:45.559 INFO:teuthology.orchestra.run.smithi155.stdout: ] 2023-08-01T19:55:45.559 INFO:teuthology.orchestra.run.smithi155.stdout: } 2023-08-01T19:55:45.559 INFO:teuthology.orchestra.run.smithi155.stdout: }, 2023-08-01T19:55:45.559 INFO:teuthology.orchestra.run.smithi155.stdout: { 2023-08-01T19:55:45.559 INFO:teuthology.orchestra.run.smithi155.stdout: "description": "osd_repop(client.4668.0:100240 5.a e37/19 5:5313c5b9:::benchmark_data_smithi006_114134_object100239:head v 37'6227, mlcod=37'6225)", 2023-08-01T19:55:45.559 INFO:teuthology.orchestra.run.smithi155.stdout: "initiated_at": "2023-08-01T19:55:05.150778+0000", 2023-08-01T19:55:45.560 INFO:teuthology.orchestra.run.smithi155.stdout: "age": 40.350365660000001, 2023-08-01T19:55:45.560 INFO:teuthology.orchestra.run.smithi155.stdout: "duration": 0.073362533999999993, 2023-08-01T19:55:45.560 INFO:teuthology.orchestra.run.smithi155.stdout: "type_data": { 2023-08-01T19:55:45.560 INFO:teuthology.orchestra.run.smithi155.stdout: "flag_point": "commit sent; apply or cleanup", 2023-08-01T19:55:45.560 INFO:teuthology.orchestra.run.smithi155.stdout: "events": [ 2023-08-01T19:55:45.560 INFO:teuthology.orchestra.run.smithi155.stdout: { 2023-08-01T19:55:45.560 INFO:teuthology.orchestra.run.smithi155.stdout: "event": "initiated", 2023-08-01T19:55:45.560 INFO:teuthology.orchestra.run.smithi155.stdout: "time": "2023-08-01T19:55:05.150778+0000", 2023-08-01T19:55:45.561 INFO:teuthology.orchestra.run.smithi155.stdout: "duration": 0 2023-08-01T19:55:45.561 INFO:teuthology.orchestra.run.smithi155.stdout: }, 2023-08-01T19:55:45.561 INFO:teuthology.orchestra.run.smithi155.stdout: { 2023-08-01T19:55:45.561 INFO:teuthology.orchestra.run.smithi155.stdout: "event": "throttled", 2023-08-01T19:55:45.561 INFO:teuthology.orchestra.run.smithi155.stdout: "time": "2023-08-01T19:55:05.150778+0000", 2023-08-01T19:55:45.561 INFO:teuthology.orchestra.run.smithi155.stdout: "duration": 0 2023-08-01T19:55:45.561 INFO:teuthology.orchestra.run.smithi155.stdout: }, 2023-08-01T19:55:45.561 INFO:teuthology.orchestra.run.smithi155.stdout: { 2023-08-01T19:55:45.562 INFO:teuthology.orchestra.run.smithi155.stdout: "event": "header_read", 2023-08-01T19:55:45.562 INFO:teuthology.orchestra.run.smithi155.stdout: "time": "2023-08-01T19:55:05.150778+0000", 2023-08-01T19:55:45.562 INFO:teuthology.orchestra.run.smithi155.stdout: "duration": 4294967295.9999995 2023-08-01T19:55:45.562 INFO:teuthology.orchestra.run.smithi155.stdout: }, 2023-08-01T19:55:45.562 INFO:teuthology.orchestra.run.smithi155.stdout: { 2023-08-01T19:55:45.562 INFO:teuthology.orchestra.run.smithi155.stdout: "event": "all_read", 2023-08-01T19:55:45.562 INFO:teuthology.orchestra.run.smithi155.stdout: "time": "2023-08-01T19:55:05.150811+0000", 2023-08-01T19:55:45.562 INFO:teuthology.orchestra.run.smithi155.stdout: "duration": 3.3664000000000002e-05 2023-08-01T19:55:45.563 INFO:teuthology.orchestra.run.smithi155.stdout: }, 2023-08-01T19:55:45.563 INFO:teuthology.orchestra.run.smithi155.stdout: { 2023-08-01T19:55:45.563 INFO:teuthology.orchestra.run.smithi155.stdout: "event": "dispatched", 2023-08-01T19:55:45.563 INFO:teuthology.orchestra.run.smithi155.stdout: "time": "2023-08-01T19:55:05.150818+0000", 2023-08-01T19:55:45.563 INFO:teuthology.orchestra.run.smithi155.stdout: "duration": 6.5769999999999999e-06 2023-08-01T19:55:45.563 INFO:teuthology.orchestra.run.smithi155.stdout: }, 2023-08-01T19:55:45.563 INFO:teuthology.orchestra.run.smithi155.stdout: { 2023-08-01T19:55:45.564 INFO:teuthology.orchestra.run.smithi155.stdout: "event": "queued_for_pg", 2023-08-01T19:55:45.564 INFO:teuthology.orchestra.run.smithi155.stdout: "time": "2023-08-01T19:55:05.150822+0000", 2023-08-01T19:55:45.564 INFO:teuthology.orchestra.run.smithi155.stdout: "duration": 4.0060000000000003e-06 2023-08-01T19:55:45.564 INFO:teuthology.orchestra.run.smithi155.stdout: }, 2023-08-01T19:55:45.564 INFO:teuthology.orchestra.run.smithi155.stdout: { 2023-08-01T19:55:45.564 INFO:teuthology.orchestra.run.smithi155.stdout: "event": "reached_pg", 2023-08-01T19:55:45.564 INFO:teuthology.orchestra.run.smithi155.stdout: "time": "2023-08-01T19:55:05.150855+0000", 2023-08-01T19:55:45.564 INFO:teuthology.orchestra.run.smithi155.stdout: "duration": 3.3204999999999998e-05 2023-08-01T19:55:45.565 INFO:teuthology.orchestra.run.smithi155.stdout: }, 2023-08-01T19:55:45.565 INFO:teuthology.orchestra.run.smithi155.stdout: { 2023-08-01T19:55:45.565 INFO:teuthology.orchestra.run.smithi155.stdout: "event": "started", 2023-08-01T19:55:45.565 INFO:teuthology.orchestra.run.smithi155.stdout: "time": "2023-08-01T19:55:05.150873+0000", 2023-08-01T19:55:45.565 INFO:teuthology.orchestra.run.smithi155.stdout: "duration": 1.8139999999999999e-05 2023-08-01T19:55:45.565 INFO:teuthology.orchestra.run.smithi155.stdout: }, 2023-08-01T19:55:45.565 INFO:teuthology.orchestra.run.smithi155.stdout: { 2023-08-01T19:55:45.565 INFO:teuthology.orchestra.run.smithi155.stdout: "event": "commit_sent", 2023-08-01T19:55:45.566 INFO:teuthology.orchestra.run.smithi155.stdout: "time": "2023-08-01T19:55:05.224095+0000", 2023-08-01T19:55:45.566 INFO:teuthology.orchestra.run.smithi155.stdout: "duration": 0.073221895999999995 2023-08-01T19:55:45.566 INFO:teuthology.orchestra.run.smithi155.stdout: }, 2023-08-01T19:55:45.566 INFO:teuthology.orchestra.run.smithi155.stdout: { 2023-08-01T19:55:45.566 INFO:teuthology.orchestra.run.smithi155.stdout: "event": "done", 2023-08-01T19:55:45.566 INFO:teuthology.orchestra.run.smithi155.stdout: "time": "2023-08-01T19:55:05.224141+0000", 2023-08-01T19:55:45.566 INFO:teuthology.orchestra.run.smithi155.stdout: "duration": 4.5385e-05 2023-08-01T19:55:45.567 INFO:teuthology.orchestra.run.smithi155.stdout: } 2023-08-01T19:55:45.567 INFO:teuthology.orchestra.run.smithi155.stdout: ] 2023-08-01T19:55:45.567 INFO:teuthology.orchestra.run.smithi155.stdout: } 2023-08-01T19:55:45.567 INFO:teuthology.orchestra.run.smithi155.stdout: }, 2023-08-01T19:55:45.567 INFO:teuthology.orchestra.run.smithi155.stdout: { 2023-08-01T19:55:45.567 INFO:teuthology.orchestra.run.smithi155.stdout: "description": "osd_op(client.4668.0:100245 5.e 5:71869c66:::benchmark_data_smithi006_114134_object100244:head [set-alloc-hint object_size 65536 write_size 65536,write 0~65536] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e37)", 2023-08-01T19:55:45.567 INFO:teuthology.orchestra.run.smithi155.stdout: "initiated_at": "2023-08-01T19:55:05.150991+0000", 2023-08-01T19:55:45.567 INFO:teuthology.orchestra.run.smithi155.stdout: "age": 40.350152872999999, 2023-08-01T19:55:45.568 INFO:teuthology.orchestra.run.smithi155.stdout: "duration": 0.070734490999999997, 2023-08-01T19:55:45.568 INFO:teuthology.orchestra.run.smithi155.stdout: "type_data": { 2023-08-01T19:55:45.568 INFO:teuthology.orchestra.run.smithi155.stdout: "flag_point": "commit sent; apply or cleanup", 2023-08-01T19:55:45.568 INFO:teuthology.orchestra.run.smithi155.stdout: "client_info": { 2023-08-01T19:55:45.568 INFO:teuthology.orchestra.run.smithi155.stdout: "client": "client.4668", 2023-08-01T19:55:45.568 INFO:teuthology.orchestra.run.smithi155.stdout: "client_addr": "172.21.15.6:0/1709472247", 2023-08-01T19:55:45.568 INFO:teuthology.orchestra.run.smithi155.stdout: "tid": 100245 2023-08-01T19:55:45.568 INFO:teuthology.orchestra.run.smithi155.stdout: }, 2023-08-01T19:55:45.569 INFO:teuthology.orchestra.run.smithi155.stdout: "events": [ 2023-08-01T19:55:45.569 INFO:teuthology.orchestra.run.smithi155.stdout: { 2023-08-01T19:55:45.569 INFO:teuthology.orchestra.run.smithi155.stdout: "event": "initiated", 2023-08-01T19:55:45.569 INFO:teuthology.orchestra.run.smithi155.stdout: "time": "2023-08-01T19:55:05.150991+0000", 2023-08-01T19:55:45.569 INFO:teuthology.orchestra.run.smithi155.stdout: "duration": 0 2023-08-01T19:55:45.569 INFO:teuthology.orchestra.run.smithi155.stdout: }, 2023-08-01T19:55:45.569 INFO:teuthology.orchestra.run.smithi155.stdout: { 2023-08-01T19:55:45.569 INFO:teuthology.orchestra.run.smithi155.stdout: "event": "throttled", 2023-08-01T19:55:45.570 INFO:teuthology.orchestra.run.smithi155.stdout: "time": "2023-08-01T19:55:05.150991+0000", 2023-08-01T19:55:45.570 INFO:teuthology.orchestra.run.smithi155.stdout: "duration": 0 2023-08-01T19:55:45.570 INFO:teuthology.orchestra.run.smithi155.stdout: }, 2023-08-01T19:55:45.570 INFO:teuthology.orchestra.run.smithi155.stdout: { 2023-08-01T19:55:45.570 INFO:teuthology.orchestra.run.smithi155.stdout: "event": "header_read", 2023-08-01T19:55:45.570 INFO:teuthology.orchestra.run.smithi155.stdout: "time": "2023-08-01T19:55:05.150990+0000", 2023-08-01T19:55:45.570 INFO:teuthology.orchestra.run.smithi155.stdout: "duration": 4294967295.999999 2023-08-01T19:55:45.570 INFO:teuthology.orchestra.run.smithi155.stdout: }, 2023-08-01T19:55:45.571 INFO:teuthology.orchestra.run.smithi155.stdout: { 2023-08-01T19:55:45.571 INFO:teuthology.orchestra.run.smithi155.stdout: "event": "all_read", 2023-08-01T19:55:45.571 INFO:teuthology.orchestra.run.smithi155.stdout: "time": "2023-08-01T19:55:05.151108+0000", 2023-08-01T19:55:45.571 INFO:teuthology.orchestra.run.smithi155.stdout: "duration": 0.00011849300000000001 2023-08-01T19:55:45.571 INFO:teuthology.orchestra.run.smithi155.stdout: }, 2023-08-01T19:55:45.571 INFO:teuthology.orchestra.run.smithi155.stdout: { 2023-08-01T19:55:45.571 INFO:teuthology.orchestra.run.smithi155.stdout: "event": "dispatched", 2023-08-01T19:55:45.571 INFO:teuthology.orchestra.run.smithi155.stdout: "time": "2023-08-01T19:55:05.151117+0000", 2023-08-01T19:55:45.572 INFO:teuthology.orchestra.run.smithi155.stdout: "duration": 8.1040000000000007e-06 2023-08-01T19:55:45.572 INFO:teuthology.orchestra.run.smithi155.stdout: }, 2023-08-01T19:55:45.572 INFO:teuthology.orchestra.run.smithi155.stdout: { 2023-08-01T19:55:45.572 INFO:teuthology.orchestra.run.smithi155.stdout: "event": "queued_for_pg", 2023-08-01T19:55:45.572 INFO:teuthology.orchestra.run.smithi155.stdout: "time": "2023-08-01T19:55:05.151121+0000", 2023-08-01T19:55:45.572 INFO:teuthology.orchestra.run.smithi155.stdout: "duration": 4.2019999999999997e-06 2023-08-01T19:55:45.572 INFO:teuthology.orchestra.run.smithi155.stdout: }, 2023-08-01T19:55:45.573 INFO:teuthology.orchestra.run.smithi155.stdout: { 2023-08-01T19:55:45.573 INFO:teuthology.orchestra.run.smithi155.stdout: "event": "reached_pg", 2023-08-01T19:55:45.573 INFO:teuthology.orchestra.run.smithi155.stdout: "time": "2023-08-01T19:55:05.151162+0000", 2023-08-01T19:55:45.573 INFO:teuthology.orchestra.run.smithi155.stdout: "duration": 4.1448e-05 2023-08-01T19:55:45.573 INFO:teuthology.orchestra.run.smithi155.stdout: }, 2023-08-01T19:55:45.573 INFO:teuthology.orchestra.run.smithi155.stdout: { 2023-08-01T19:55:45.573 INFO:teuthology.orchestra.run.smithi155.stdout: "event": "started", 2023-08-01T19:55:45.573 INFO:teuthology.orchestra.run.smithi155.stdout: "time": "2023-08-01T19:55:05.151281+0000", 2023-08-01T19:55:45.574 INFO:teuthology.orchestra.run.smithi155.stdout: "duration": 0.000119141 2023-08-01T19:55:45.574 INFO:teuthology.orchestra.run.smithi155.stdout: }, 2023-08-01T19:55:45.574 INFO:teuthology.orchestra.run.smithi155.stdout: { 2023-08-01T19:55:45.574 INFO:teuthology.orchestra.run.smithi155.stdout: "event": "waiting for subops from 0", 2023-08-01T19:55:45.574 INFO:teuthology.orchestra.run.smithi155.stdout: "time": "2023-08-01T19:55:05.151443+0000", 2023-08-01T19:55:45.574 INFO:teuthology.orchestra.run.smithi155.stdout: "duration": 0.00016181600000000001 2023-08-01T19:55:45.574 INFO:teuthology.orchestra.run.smithi155.stdout: }, 2023-08-01T19:55:45.574 INFO:teuthology.orchestra.run.smithi155.stdout: { 2023-08-01T19:55:45.575 INFO:teuthology.orchestra.run.smithi155.stdout: "event": "sub_op_commit_rec", 2023-08-01T19:55:45.575 INFO:teuthology.orchestra.run.smithi155.stdout: "time": "2023-08-01T19:55:05.219101+0000", 2023-08-01T19:55:45.575 INFO:teuthology.orchestra.run.smithi155.stdout: "duration": 0.067658037000000004 2023-08-01T19:55:45.575 INFO:teuthology.orchestra.run.smithi155.stdout: }, 2023-08-01T19:55:45.575 INFO:teuthology.orchestra.run.smithi155.stdout: { 2023-08-01T19:55:45.575 INFO:teuthology.orchestra.run.smithi155.stdout: "event": "op_commit", 2023-08-01T19:55:45.575 INFO:teuthology.orchestra.run.smithi155.stdout: "time": "2023-08-01T19:55:05.221646+0000", 2023-08-01T19:55:45.575 INFO:teuthology.orchestra.run.smithi155.stdout: "duration": 0.0025450540000000002 2023-08-01T19:55:45.576 INFO:teuthology.orchestra.run.smithi155.stdout: }, 2023-08-01T19:55:45.576 INFO:teuthology.orchestra.run.smithi155.stdout: { 2023-08-01T19:55:45.576 INFO:teuthology.orchestra.run.smithi155.stdout: "event": "commit_sent", 2023-08-01T19:55:45.576 INFO:teuthology.orchestra.run.smithi155.stdout: "time": "2023-08-01T19:55:05.221689+0000", 2023-08-01T19:55:45.576 INFO:teuthology.orchestra.run.smithi155.stdout: "duration": 4.3078999999999999e-05 2023-08-01T19:55:45.576 INFO:teuthology.orchestra.run.smithi155.stdout: }, 2023-08-01T19:55:45.576 INFO:teuthology.orchestra.run.smithi155.stdout: { 2023-08-01T19:55:45.576 INFO:teuthology.orchestra.run.smithi155.stdout: "event": "done", 2023-08-01T19:55:45.577 INFO:teuthology.orchestra.run.smithi155.stdout: "time": "2023-08-01T19:55:05.221725+0000", 2023-08-01T19:55:45.577 INFO:teuthology.orchestra.run.smithi155.stdout: "duration": 3.6137999999999999e-05 2023-08-01T19:55:45.577 INFO:teuthology.orchestra.run.smithi155.stdout: } 2023-08-01T19:55:45.577 INFO:teuthology.orchestra.run.smithi155.stdout: ] 2023-08-01T19:55:45.577 INFO:teuthology.orchestra.run.smithi155.stdout: } 2023-08-01T19:55:45.577 INFO:teuthology.orchestra.run.smithi155.stdout: }, 2023-08-01T19:55:45.577 INFO:teuthology.orchestra.run.smithi155.stdout: { 2023-08-01T19:55:45.577 INFO:teuthology.orchestra.run.smithi155.stdout: "description": "osd_repop(client.4668.0:100243 5.a e37/19 5:5e8193b6:::benchmark_data_smithi006_114134_object100242:head v 37'6228, mlcod=37'6225)", 2023-08-01T19:55:45.578 INFO:teuthology.orchestra.run.smithi155.stdout: "initiated_at": "2023-08-01T19:55:05.151148+0000", 2023-08-01T19:55:45.578 INFO:teuthology.orchestra.run.smithi155.stdout: "age": 40.349995862, 2023-08-01T19:55:45.578 INFO:teuthology.orchestra.run.smithi155.stdout: "duration": 0.073020370000000001, 2023-08-01T19:55:45.578 INFO:teuthology.orchestra.run.smithi155.stdout: "type_data": { 2023-08-01T19:55:45.578 INFO:teuthology.orchestra.run.smithi155.stdout: "flag_point": "commit sent; apply or cleanup", 2023-08-01T19:55:45.578 INFO:teuthology.orchestra.run.smithi155.stdout: "events": [ 2023-08-01T19:55:45.578 INFO:teuthology.orchestra.run.smithi155.stdout: { 2023-08-01T19:55:45.578 INFO:teuthology.orchestra.run.smithi155.stdout: "event": "initiated", 2023-08-01T19:55:45.579 INFO:teuthology.orchestra.run.smithi155.stdout: "time": "2023-08-01T19:55:05.151148+0000", 2023-08-01T19:55:45.579 INFO:teuthology.orchestra.run.smithi155.stdout: "duration": 0 2023-08-01T19:55:45.579 INFO:teuthology.orchestra.run.smithi155.stdout: }, 2023-08-01T19:55:45.579 INFO:teuthology.orchestra.run.smithi155.stdout: { 2023-08-01T19:55:45.579 INFO:teuthology.orchestra.run.smithi155.stdout: "event": "throttled", 2023-08-01T19:55:45.579 INFO:teuthology.orchestra.run.smithi155.stdout: "time": "2023-08-01T19:55:05.151148+0000", 2023-08-01T19:55:45.579 INFO:teuthology.orchestra.run.smithi155.stdout: "duration": 0 2023-08-01T19:55:45.580 INFO:teuthology.orchestra.run.smithi155.stdout: }, 2023-08-01T19:55:45.580 INFO:teuthology.orchestra.run.smithi155.stdout: { 2023-08-01T19:55:45.580 INFO:teuthology.orchestra.run.smithi155.stdout: "event": "header_read", 2023-08-01T19:55:45.580 INFO:teuthology.orchestra.run.smithi155.stdout: "time": "2023-08-01T19:55:05.151147+0000", 2023-08-01T19:55:45.580 INFO:teuthology.orchestra.run.smithi155.stdout: "duration": 4294967295.9999995 2023-08-01T19:55:45.580 INFO:teuthology.orchestra.run.smithi155.stdout: }, 2023-08-01T19:55:45.580 INFO:teuthology.orchestra.run.smithi155.stdout: { 2023-08-01T19:55:45.580 INFO:teuthology.orchestra.run.smithi155.stdout: "event": "all_read", 2023-08-01T19:55:45.581 INFO:teuthology.orchestra.run.smithi155.stdout: "time": "2023-08-01T19:55:05.151231+0000", 2023-08-01T19:55:45.581 INFO:teuthology.orchestra.run.smithi155.stdout: "duration": 8.3135999999999998e-05 2023-08-01T19:55:45.581 INFO:teuthology.orchestra.run.smithi155.stdout: }, 2023-08-01T19:55:45.581 INFO:teuthology.orchestra.run.smithi155.stdout: { 2023-08-01T19:55:45.581 INFO:teuthology.orchestra.run.smithi155.stdout: "event": "dispatched", 2023-08-01T19:55:45.581 INFO:teuthology.orchestra.run.smithi155.stdout: "time": "2023-08-01T19:55:05.151239+0000", 2023-08-01T19:55:45.581 INFO:teuthology.orchestra.run.smithi155.stdout: "duration": 8.7469999999999994e-06 2023-08-01T19:55:45.581 INFO:teuthology.orchestra.run.smithi155.stdout: }, 2023-08-01T19:55:45.582 INFO:teuthology.orchestra.run.smithi155.stdout: { 2023-08-01T19:55:45.582 INFO:teuthology.orchestra.run.smithi155.stdout: "event": "queued_for_pg", 2023-08-01T19:55:45.582 INFO:teuthology.orchestra.run.smithi155.stdout: "time": "2023-08-01T19:55:05.151244+0000", 2023-08-01T19:55:45.582 INFO:teuthology.orchestra.run.smithi155.stdout: "duration": 4.4800000000000003e-06 2023-08-01T19:55:45.582 INFO:teuthology.orchestra.run.smithi155.stdout: }, 2023-08-01T19:55:45.582 INFO:teuthology.orchestra.run.smithi155.stdout: { 2023-08-01T19:55:45.582 INFO:teuthology.orchestra.run.smithi155.stdout: "event": "reached_pg", 2023-08-01T19:55:45.582 INFO:teuthology.orchestra.run.smithi155.stdout: "time": "2023-08-01T19:55:05.152938+0000", 2023-08-01T19:55:45.583 INFO:teuthology.orchestra.run.smithi155.stdout: "duration": 0.001693824 2023-08-01T19:55:45.583 INFO:teuthology.orchestra.run.smithi155.stdout: }, 2023-08-01T19:55:45.583 INFO:teuthology.orchestra.run.smithi155.stdout: { 2023-08-01T19:55:45.583 INFO:teuthology.orchestra.run.smithi155.stdout: "event": "started", 2023-08-01T19:55:45.583 INFO:teuthology.orchestra.run.smithi155.stdout: "time": "2023-08-01T19:55:05.152956+0000", 2023-08-01T19:55:45.583 INFO:teuthology.orchestra.run.smithi155.stdout: "duration": 1.8287e-05 2023-08-01T19:55:45.583 INFO:teuthology.orchestra.run.smithi155.stdout: }, 2023-08-01T19:55:45.583 INFO:teuthology.orchestra.run.smithi155.stdout: { 2023-08-01T19:55:45.584 INFO:teuthology.orchestra.run.smithi155.stdout: "event": "commit_sent", 2023-08-01T19:55:45.584 INFO:teuthology.orchestra.run.smithi155.stdout: "time": "2023-08-01T19:55:05.224145+0000", 2023-08-01T19:55:45.584 INFO:teuthology.orchestra.run.smithi155.stdout: "duration": 0.071189447000000003 2023-08-01T19:55:45.584 INFO:teuthology.orchestra.run.smithi155.stdout: }, 2023-08-01T19:55:45.584 INFO:teuthology.orchestra.run.smithi155.stdout: { 2023-08-01T19:55:45.584 INFO:teuthology.orchestra.run.smithi155.stdout: "event": "done", 2023-08-01T19:55:45.584 INFO:teuthology.orchestra.run.smithi155.stdout: "time": "2023-08-01T19:55:05.224168+0000", 2023-08-01T19:55:45.585 INFO:teuthology.orchestra.run.smithi155.stdout: "duration": 2.3008999999999999e-05 2023-08-01T19:55:45.585 INFO:teuthology.orchestra.run.smithi155.stdout: } 2023-08-01T19:55:45.585 INFO:teuthology.orchestra.run.smithi155.stdout: ] 2023-08-01T19:55:45.585 INFO:teuthology.orchestra.run.smithi155.stdout: } 2023-08-01T19:55:45.585 INFO:teuthology.orchestra.run.smithi155.stdout: }, 2023-08-01T19:55:45.585 INFO:teuthology.orchestra.run.smithi155.stdout: { 2023-08-01T19:55:45.585 INFO:teuthology.orchestra.run.smithi155.stdout: "description": "osd_repop(client.4668.0:100244 5.9 e37/19 5:92f56a12:::benchmark_data_smithi006_114134_object100243:head v 37'6294, mlcod=37'6292)", 2023-08-01T19:55:45.585 INFO:teuthology.orchestra.run.smithi155.stdout: "initiated_at": "2023-08-01T19:55:05.151325+0000", 2023-08-01T19:55:45.586 INFO:teuthology.orchestra.run.smithi155.stdout: "age": 40.349818517000003, 2023-08-01T19:55:45.586 INFO:teuthology.orchestra.run.smithi155.stdout: "duration": 0.071883673999999995, 2023-08-01T19:55:45.586 INFO:teuthology.orchestra.run.smithi155.stdout: "type_data": { 2023-08-01T19:55:45.586 INFO:teuthology.orchestra.run.smithi155.stdout: "flag_point": "commit sent; apply or cleanup", 2023-08-01T19:55:45.586 INFO:teuthology.orchestra.run.smithi155.stdout: "events": [ 2023-08-01T19:55:45.586 INFO:teuthology.orchestra.run.smithi155.stdout: { 2023-08-01T19:55:45.586 INFO:teuthology.orchestra.run.smithi155.stdout: "event": "initiated", 2023-08-01T19:55:45.586 INFO:teuthology.orchestra.run.smithi155.stdout: "time": "2023-08-01T19:55:05.151325+0000", 2023-08-01T19:55:45.587 INFO:teuthology.orchestra.run.smithi155.stdout: "duration": 0 2023-08-01T19:55:45.587 INFO:teuthology.orchestra.run.smithi155.stdout: }, 2023-08-01T19:55:45.587 INFO:teuthology.orchestra.run.smithi155.stdout: { 2023-08-01T19:55:45.587 INFO:teuthology.orchestra.run.smithi155.stdout: "event": "throttled", 2023-08-01T19:55:45.587 INFO:teuthology.orchestra.run.smithi155.stdout: "time": "2023-08-01T19:55:05.151325+0000", 2023-08-01T19:55:45.587 INFO:teuthology.orchestra.run.smithi155.stdout: "duration": 0 2023-08-01T19:55:45.587 INFO:teuthology.orchestra.run.smithi155.stdout: }, 2023-08-01T19:55:45.587 INFO:teuthology.orchestra.run.smithi155.stdout: { 2023-08-01T19:55:45.588 INFO:teuthology.orchestra.run.smithi155.stdout: "event": "header_read", 2023-08-01T19:55:45.588 INFO:teuthology.orchestra.run.smithi155.stdout: "time": "2023-08-01T19:55:05.151325+0000", 2023-08-01T19:55:45.588 INFO:teuthology.orchestra.run.smithi155.stdout: "duration": 4294967295.9999995 2023-08-01T19:55:45.588 INFO:teuthology.orchestra.run.smithi155.stdout: }, 2023-08-01T19:55:45.588 INFO:teuthology.orchestra.run.smithi155.stdout: { 2023-08-01T19:55:45.588 INFO:teuthology.orchestra.run.smithi155.stdout: "event": "all_read", 2023-08-01T19:55:45.588 INFO:teuthology.orchestra.run.smithi155.stdout: "time": "2023-08-01T19:55:05.151390+0000", 2023-08-01T19:55:45.589 INFO:teuthology.orchestra.run.smithi155.stdout: "duration": 6.5456999999999993e-05 2023-08-01T19:55:45.589 INFO:teuthology.orchestra.run.smithi155.stdout: }, 2023-08-01T19:55:45.589 INFO:teuthology.orchestra.run.smithi155.stdout: { 2023-08-01T19:55:45.589 INFO:teuthology.orchestra.run.smithi155.stdout: "event": "dispatched", 2023-08-01T19:55:45.589 INFO:teuthology.orchestra.run.smithi155.stdout: "time": "2023-08-01T19:55:05.151396+0000", 2023-08-01T19:55:45.589 INFO:teuthology.orchestra.run.smithi155.stdout: "duration": 5.9190000000000004e-06 2023-08-01T19:55:45.589 INFO:teuthology.orchestra.run.smithi155.stdout: }, 2023-08-01T19:55:45.590 INFO:teuthology.orchestra.run.smithi155.stdout: { 2023-08-01T19:55:45.590 INFO:teuthology.orchestra.run.smithi155.stdout: "event": "queued_for_pg", 2023-08-01T19:55:45.590 INFO:teuthology.orchestra.run.smithi155.stdout: "time": "2023-08-01T19:55:05.151400+0000", 2023-08-01T19:55:45.590 INFO:teuthology.orchestra.run.smithi155.stdout: "duration": 4.1030000000000004e-06 2023-08-01T19:55:45.590 INFO:teuthology.orchestra.run.smithi155.stdout: }, 2023-08-01T19:55:45.590 INFO:teuthology.orchestra.run.smithi155.stdout: { 2023-08-01T19:55:45.590 INFO:teuthology.orchestra.run.smithi155.stdout: "event": "reached_pg", 2023-08-01T19:55:45.590 INFO:teuthology.orchestra.run.smithi155.stdout: "time": "2023-08-01T19:55:05.151452+0000", 2023-08-01T19:55:45.591 INFO:teuthology.orchestra.run.smithi155.stdout: "duration": 5.2136999999999999e-05 2023-08-01T19:55:45.591 INFO:teuthology.orchestra.run.smithi155.stdout: }, 2023-08-01T19:55:45.591 INFO:teuthology.orchestra.run.smithi155.stdout: { 2023-08-01T19:55:45.591 INFO:teuthology.orchestra.run.smithi155.stdout: "event": "started", 2023-08-01T19:55:45.591 INFO:teuthology.orchestra.run.smithi155.stdout: "time": "2023-08-01T19:55:05.151470+0000", 2023-08-01T19:55:45.591 INFO:teuthology.orchestra.run.smithi155.stdout: "duration": 1.8e-05 2023-08-01T19:55:45.591 INFO:teuthology.orchestra.run.smithi155.stdout: }, 2023-08-01T19:55:45.592 INFO:teuthology.orchestra.run.smithi155.stdout: { 2023-08-01T19:55:45.592 INFO:teuthology.orchestra.run.smithi155.stdout: "event": "commit_sent", 2023-08-01T19:55:45.592 INFO:teuthology.orchestra.run.smithi155.stdout: "time": "2023-08-01T19:55:05.223183+0000", 2023-08-01T19:55:45.592 INFO:teuthology.orchestra.run.smithi155.stdout: "duration": 0.071712622000000004 2023-08-01T19:55:45.592 INFO:teuthology.orchestra.run.smithi155.stdout: }, 2023-08-01T19:55:45.593 INFO:teuthology.orchestra.run.smithi155.stdout: { 2023-08-01T19:55:45.593 INFO:teuthology.orchestra.run.smithi155.stdout: "event": "done", 2023-08-01T19:55:45.593 INFO:teuthology.orchestra.run.smithi155.stdout: "time": "2023-08-01T19:55:05.223209+0000", 2023-08-01T19:55:45.593 INFO:teuthology.orchestra.run.smithi155.stdout: "duration": 2.5956e-05 2023-08-01T19:55:45.593 INFO:teuthology.orchestra.run.smithi155.stdout: } 2023-08-01T19:55:45.593 INFO:teuthology.orchestra.run.smithi155.stdout: ] 2023-08-01T19:55:45.593 INFO:teuthology.orchestra.run.smithi155.stdout: } 2023-08-01T19:55:45.594 INFO:teuthology.orchestra.run.smithi155.stdout: }, 2023-08-01T19:55:45.594 INFO:teuthology.orchestra.run.smithi155.stdout: { 2023-08-01T19:55:45.594 INFO:teuthology.orchestra.run.smithi155.stdout: "description": "osd_op(client.4668.0:100249 5.b 5:d0666827:::benchmark_data_smithi006_114134_object100248:head [set-alloc-hint object_size 65536 write_size 65536,write 0~65536] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e37)", 2023-08-01T19:55:45.594 INFO:teuthology.orchestra.run.smithi155.stdout: "initiated_at": "2023-08-01T19:55:05.153614+0000", 2023-08-01T19:55:45.594 INFO:teuthology.orchestra.run.smithi155.stdout: "age": 40.347530092, 2023-08-01T19:55:45.595 INFO:teuthology.orchestra.run.smithi155.stdout: "duration": 0.069286118999999993, 2023-08-01T19:55:45.595 INFO:teuthology.orchestra.run.smithi155.stdout: "type_data": { 2023-08-01T19:55:45.595 INFO:teuthology.orchestra.run.smithi155.stdout: "flag_point": "commit sent; apply or cleanup", 2023-08-01T19:55:45.595 INFO:teuthology.orchestra.run.smithi155.stdout: "client_info": { 2023-08-01T19:55:45.596 INFO:teuthology.orchestra.run.smithi155.stdout: "client": "client.4668", 2023-08-01T19:55:45.596 INFO:teuthology.orchestra.run.smithi155.stdout: "client_addr": "172.21.15.6:0/1709472247", 2023-08-01T19:55:45.596 INFO:teuthology.orchestra.run.smithi155.stdout: "tid": 100249 2023-08-01T19:55:45.596 INFO:teuthology.orchestra.run.smithi155.stdout: }, 2023-08-01T19:55:45.597 INFO:teuthology.orchestra.run.smithi155.stdout: "events": [ 2023-08-01T19:55:45.597 INFO:teuthology.orchestra.run.smithi155.stdout: { 2023-08-01T19:55:45.597 INFO:teuthology.orchestra.run.smithi155.stdout: "event": "initiated", 2023-08-01T19:55:45.597 INFO:teuthology.orchestra.run.smithi155.stdout: "time": "2023-08-01T19:55:05.153614+0000", 2023-08-01T19:55:45.597 INFO:teuthology.orchestra.run.smithi155.stdout: "duration": 0 2023-08-01T19:55:45.598 INFO:teuthology.orchestra.run.smithi155.stdout: }, 2023-08-01T19:55:45.598 INFO:teuthology.orchestra.run.smithi155.stdout: { 2023-08-01T19:55:45.598 INFO:teuthology.orchestra.run.smithi155.stdout: "event": "throttled", 2023-08-01T19:55:45.598 INFO:teuthology.orchestra.run.smithi155.stdout: "time": "2023-08-01T19:55:05.153614+0000", 2023-08-01T19:55:45.598 INFO:teuthology.orchestra.run.smithi155.stdout: "duration": 0 2023-08-01T19:55:45.598 INFO:teuthology.orchestra.run.smithi155.stdout: }, 2023-08-01T19:55:45.599 INFO:teuthology.orchestra.run.smithi155.stdout: { 2023-08-01T19:55:45.599 INFO:teuthology.orchestra.run.smithi155.stdout: "event": "header_read", 2023-08-01T19:55:45.599 INFO:teuthology.orchestra.run.smithi155.stdout: "time": "2023-08-01T19:55:05.153612+0000", 2023-08-01T19:55:45.599 INFO:teuthology.orchestra.run.smithi155.stdout: "duration": 4294967295.9999986 2023-08-01T19:55:45.599 INFO:teuthology.orchestra.run.smithi155.stdout: }, 2023-08-01T19:55:45.599 INFO:teuthology.orchestra.run.smithi155.stdout: { 2023-08-01T19:55:45.599 INFO:teuthology.orchestra.run.smithi155.stdout: "event": "all_read", 2023-08-01T19:55:45.599 INFO:teuthology.orchestra.run.smithi155.stdout: "time": "2023-08-01T19:55:05.153694+0000", 2023-08-01T19:55:45.600 INFO:teuthology.orchestra.run.smithi155.stdout: "duration": 8.1618000000000004e-05 2023-08-01T19:55:45.600 INFO:teuthology.orchestra.run.smithi155.stdout: }, 2023-08-01T19:55:45.600 INFO:teuthology.orchestra.run.smithi155.stdout: { 2023-08-01T19:55:45.600 INFO:teuthology.orchestra.run.smithi155.stdout: "event": "dispatched", 2023-08-01T19:55:45.600 INFO:teuthology.orchestra.run.smithi155.stdout: "time": "2023-08-01T19:55:05.153713+0000", 2023-08-01T19:55:45.600 INFO:teuthology.orchestra.run.smithi155.stdout: "duration": 1.9069999999999999e-05 2023-08-01T19:55:45.600 INFO:teuthology.orchestra.run.smithi155.stdout: }, 2023-08-01T19:55:45.601 INFO:teuthology.orchestra.run.smithi155.stdout: { 2023-08-01T19:55:45.601 INFO:teuthology.orchestra.run.smithi155.stdout: "event": "queued_for_pg", 2023-08-01T19:55:45.601 INFO:teuthology.orchestra.run.smithi155.stdout: "time": "2023-08-01T19:55:05.153726+0000", 2023-08-01T19:55:45.601 INFO:teuthology.orchestra.run.smithi155.stdout: "duration": 1.238e-05 2023-08-01T19:55:45.601 INFO:teuthology.orchestra.run.smithi155.stdout: }, 2023-08-01T19:55:45.601 INFO:teuthology.orchestra.run.smithi155.stdout: { 2023-08-01T19:55:45.601 INFO:teuthology.orchestra.run.smithi155.stdout: "event": "reached_pg", 2023-08-01T19:55:45.601 INFO:teuthology.orchestra.run.smithi155.stdout: "time": "2023-08-01T19:55:05.153761+0000", 2023-08-01T19:55:45.602 INFO:teuthology.orchestra.run.smithi155.stdout: "duration": 3.5046999999999998e-05 2023-08-01T19:55:45.602 INFO:teuthology.orchestra.run.smithi155.stdout: }, 2023-08-01T19:55:45.602 INFO:teuthology.orchestra.run.smithi155.stdout: { 2023-08-01T19:55:45.602 INFO:teuthology.orchestra.run.smithi155.stdout: "event": "started", 2023-08-01T19:55:45.602 INFO:teuthology.orchestra.run.smithi155.stdout: "time": "2023-08-01T19:55:05.153896+0000", 2023-08-01T19:55:45.602 INFO:teuthology.orchestra.run.smithi155.stdout: "duration": 0.00013575800000000001 2023-08-01T19:55:45.602 INFO:teuthology.orchestra.run.smithi155.stdout: }, 2023-08-01T19:55:45.603 INFO:teuthology.orchestra.run.smithi155.stdout: { 2023-08-01T19:55:45.603 INFO:teuthology.orchestra.run.smithi155.stdout: "event": "waiting for subops from 0", 2023-08-01T19:55:45.603 INFO:teuthology.orchestra.run.smithi155.stdout: "time": "2023-08-01T19:55:05.154043+0000", 2023-08-01T19:55:45.603 INFO:teuthology.orchestra.run.smithi155.stdout: "duration": 0.00014650700000000001 2023-08-01T19:55:45.603 INFO:teuthology.orchestra.run.smithi155.stdout: }, 2023-08-01T19:55:45.603 INFO:teuthology.orchestra.run.smithi155.stdout: { 2023-08-01T19:55:45.603 INFO:teuthology.orchestra.run.smithi155.stdout: "event": "sub_op_commit_rec", 2023-08-01T19:55:45.603 INFO:teuthology.orchestra.run.smithi155.stdout: "time": "2023-08-01T19:55:05.221876+0000", 2023-08-01T19:55:45.604 INFO:teuthology.orchestra.run.smithi155.stdout: "duration": 0.067832796000000001 2023-08-01T19:55:45.604 INFO:teuthology.orchestra.run.smithi155.stdout: }, 2023-08-01T19:55:45.604 INFO:teuthology.orchestra.run.smithi155.stdout: { 2023-08-01T19:55:45.604 INFO:teuthology.orchestra.run.smithi155.stdout: "event": "op_commit", 2023-08-01T19:55:45.604 INFO:teuthology.orchestra.run.smithi155.stdout: "time": "2023-08-01T19:55:05.222813+0000", 2023-08-01T19:55:45.604 INFO:teuthology.orchestra.run.smithi155.stdout: "duration": 0.00093755300000000004 2023-08-01T19:55:45.604 INFO:teuthology.orchestra.run.smithi155.stdout: }, 2023-08-01T19:55:45.605 INFO:teuthology.orchestra.run.smithi155.stdout: { 2023-08-01T19:55:45.605 INFO:teuthology.orchestra.run.smithi155.stdout: "event": "commit_sent", 2023-08-01T19:55:45.605 INFO:teuthology.orchestra.run.smithi155.stdout: "time": "2023-08-01T19:55:05.222861+0000", 2023-08-01T19:55:45.605 INFO:teuthology.orchestra.run.smithi155.stdout: "duration": 4.8013999999999998e-05 2023-08-01T19:55:45.605 INFO:teuthology.orchestra.run.smithi155.stdout: }, 2023-08-01T19:55:45.605 INFO:teuthology.orchestra.run.smithi155.stdout: { 2023-08-01T19:55:45.605 INFO:teuthology.orchestra.run.smithi155.stdout: "event": "done", 2023-08-01T19:55:45.605 INFO:teuthology.orchestra.run.smithi155.stdout: "time": "2023-08-01T19:55:05.222900+0000", 2023-08-01T19:55:45.606 INFO:teuthology.orchestra.run.smithi155.stdout: "duration": 3.8634999999999999e-05 2023-08-01T19:55:45.606 INFO:teuthology.orchestra.run.smithi155.stdout: } 2023-08-01T19:55:45.606 INFO:teuthology.orchestra.run.smithi155.stdout: ] 2023-08-01T19:55:45.606 INFO:teuthology.orchestra.run.smithi155.stdout: } 2023-08-01T19:55:45.606 INFO:teuthology.orchestra.run.smithi155.stdout: }, 2023-08-01T19:55:45.606 INFO:teuthology.orchestra.run.smithi155.stdout: { 2023-08-01T19:55:45.606 INFO:teuthology.orchestra.run.smithi155.stdout: "description": "osd_op(client.4668.0:100251 5.b 5:d853df24:::benchmark_data_smithi006_114134_object100250:head [set-alloc-hint object_size 65536 write_size 65536,write 0~65536] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e37)", 2023-08-01T19:55:45.606 INFO:teuthology.orchestra.run.smithi155.stdout: "initiated_at": "2023-08-01T19:55:05.153737+0000", 2023-08-01T19:55:45.607 INFO:teuthology.orchestra.run.smithi155.stdout: "age": 40.347407078000003, 2023-08-01T19:55:45.607 INFO:teuthology.orchestra.run.smithi155.stdout: "duration": 0.071366545000000003, 2023-08-01T19:55:45.607 INFO:teuthology.orchestra.run.smithi155.stdout: "type_data": { 2023-08-01T19:55:45.607 INFO:teuthology.orchestra.run.smithi155.stdout: "flag_point": "commit sent; apply or cleanup", 2023-08-01T19:55:45.607 INFO:teuthology.orchestra.run.smithi155.stdout: "client_info": { 2023-08-01T19:55:45.607 INFO:teuthology.orchestra.run.smithi155.stdout: "client": "client.4668", 2023-08-01T19:55:45.607 INFO:teuthology.orchestra.run.smithi155.stdout: "client_addr": "172.21.15.6:0/1709472247", 2023-08-01T19:55:45.607 INFO:teuthology.orchestra.run.smithi155.stdout: "tid": 100251 2023-08-01T19:55:45.608 INFO:teuthology.orchestra.run.smithi155.stdout: }, 2023-08-01T19:55:45.608 INFO:teuthology.orchestra.run.smithi155.stdout: "events": [ 2023-08-01T19:55:45.608 INFO:teuthology.orchestra.run.smithi155.stdout: { 2023-08-01T19:55:45.608 INFO:teuthology.orchestra.run.smithi155.stdout: "event": "initiated", 2023-08-01T19:55:45.608 INFO:teuthology.orchestra.run.smithi155.stdout: "time": "2023-08-01T19:55:05.153737+0000", 2023-08-01T19:55:45.608 INFO:teuthology.orchestra.run.smithi155.stdout: "duration": 0 2023-08-01T19:55:45.608 INFO:teuthology.orchestra.run.smithi155.stdout: }, 2023-08-01T19:55:45.609 INFO:teuthology.orchestra.run.smithi155.stdout: { 2023-08-01T19:55:45.609 INFO:teuthology.orchestra.run.smithi155.stdout: "event": "throttled", 2023-08-01T19:55:45.609 INFO:teuthology.orchestra.run.smithi155.stdout: "time": "2023-08-01T19:55:05.153737+0000", 2023-08-01T19:55:45.609 INFO:teuthology.orchestra.run.smithi155.stdout: "duration": 0 2023-08-01T19:55:45.609 INFO:teuthology.orchestra.run.smithi155.stdout: }, 2023-08-01T19:55:45.609 INFO:teuthology.orchestra.run.smithi155.stdout: { 2023-08-01T19:55:45.609 INFO:teuthology.orchestra.run.smithi155.stdout: "event": "header_read", 2023-08-01T19:55:45.609 INFO:teuthology.orchestra.run.smithi155.stdout: "time": "2023-08-01T19:55:05.153736+0000", 2023-08-01T19:55:45.610 INFO:teuthology.orchestra.run.smithi155.stdout: "duration": 4294967295.9999995 2023-08-01T19:55:45.610 INFO:teuthology.orchestra.run.smithi155.stdout: }, 2023-08-01T19:55:45.610 INFO:teuthology.orchestra.run.smithi155.stdout: { 2023-08-01T19:55:45.610 INFO:teuthology.orchestra.run.smithi155.stdout: "event": "all_read", 2023-08-01T19:55:45.610 INFO:teuthology.orchestra.run.smithi155.stdout: "time": "2023-08-01T19:55:05.153784+0000", 2023-08-01T19:55:45.610 INFO:teuthology.orchestra.run.smithi155.stdout: "duration": 4.7660000000000001e-05 2023-08-01T19:55:45.610 INFO:teuthology.orchestra.run.smithi155.stdout: }, 2023-08-01T19:55:45.610 INFO:teuthology.orchestra.run.smithi155.stdout: { 2023-08-01T19:55:45.611 INFO:teuthology.orchestra.run.smithi155.stdout: "event": "dispatched", 2023-08-01T19:55:45.611 INFO:teuthology.orchestra.run.smithi155.stdout: "time": "2023-08-01T19:55:05.153793+0000", 2023-08-01T19:55:45.611 INFO:teuthology.orchestra.run.smithi155.stdout: "duration": 8.7150000000000004e-06 2023-08-01T19:55:45.611 INFO:teuthology.orchestra.run.smithi155.stdout: }, 2023-08-01T19:55:45.611 INFO:teuthology.orchestra.run.smithi155.stdout: { 2023-08-01T19:55:45.611 INFO:teuthology.orchestra.run.smithi155.stdout: "event": "queued_for_pg", 2023-08-01T19:55:45.611 INFO:teuthology.orchestra.run.smithi155.stdout: "time": "2023-08-01T19:55:05.153800+0000", 2023-08-01T19:55:45.611 INFO:teuthology.orchestra.run.smithi155.stdout: "duration": 7.2459999999999997e-06 2023-08-01T19:55:45.612 INFO:teuthology.orchestra.run.smithi155.stdout: }, 2023-08-01T19:55:45.612 INFO:teuthology.orchestra.run.smithi155.stdout: { 2023-08-01T19:55:45.612 INFO:teuthology.orchestra.run.smithi155.stdout: "event": "reached_pg", 2023-08-01T19:55:45.612 INFO:teuthology.orchestra.run.smithi155.stdout: "time": "2023-08-01T19:55:05.156241+0000", 2023-08-01T19:55:45.612 INFO:teuthology.orchestra.run.smithi155.stdout: "duration": 0.0024415359999999998 2023-08-01T19:55:45.612 INFO:teuthology.orchestra.run.smithi155.stdout: }, 2023-08-01T19:55:45.612 INFO:teuthology.orchestra.run.smithi155.stdout: { 2023-08-01T19:55:45.613 INFO:teuthology.orchestra.run.smithi155.stdout: "event": "started", 2023-08-01T19:55:45.613 INFO:teuthology.orchestra.run.smithi155.stdout: "time": "2023-08-01T19:55:05.219045+0000", 2023-08-01T19:55:45.613 INFO:teuthology.orchestra.run.smithi155.stdout: "duration": 0.062803855000000006 2023-08-01T19:55:45.613 INFO:teuthology.orchestra.run.smithi155.stdout: }, 2023-08-01T19:55:45.613 INFO:teuthology.orchestra.run.smithi155.stdout: { 2023-08-01T19:55:45.613 INFO:teuthology.orchestra.run.smithi155.stdout: "event": "waiting for subops from 0", 2023-08-01T19:55:45.613 INFO:teuthology.orchestra.run.smithi155.stdout: "time": "2023-08-01T19:55:05.219238+0000", 2023-08-01T19:55:45.613 INFO:teuthology.orchestra.run.smithi155.stdout: "duration": 0.00019241500000000001 2023-08-01T19:55:45.614 INFO:teuthology.orchestra.run.smithi155.stdout: }, 2023-08-01T19:55:45.614 INFO:teuthology.orchestra.run.smithi155.stdout: { 2023-08-01T19:55:45.614 INFO:teuthology.orchestra.run.smithi155.stdout: "event": "sub_op_commit_rec", 2023-08-01T19:55:45.614 INFO:teuthology.orchestra.run.smithi155.stdout: "time": "2023-08-01T19:55:05.223300+0000", 2023-08-01T19:55:45.614 INFO:teuthology.orchestra.run.smithi155.stdout: "duration": 0.0040626509999999996 2023-08-01T19:55:45.614 INFO:teuthology.orchestra.run.smithi155.stdout: }, 2023-08-01T19:55:45.614 INFO:teuthology.orchestra.run.smithi155.stdout: { 2023-08-01T19:55:45.614 INFO:teuthology.orchestra.run.smithi155.stdout: "event": "op_commit", 2023-08-01T19:55:45.615 INFO:teuthology.orchestra.run.smithi155.stdout: "time": "2023-08-01T19:55:05.225020+0000", 2023-08-01T19:55:45.615 INFO:teuthology.orchestra.run.smithi155.stdout: "duration": 0.0017201 2023-08-01T19:55:45.615 INFO:teuthology.orchestra.run.smithi155.stdout: }, 2023-08-01T19:55:45.615 INFO:teuthology.orchestra.run.smithi155.stdout: { 2023-08-01T19:55:45.615 INFO:teuthology.orchestra.run.smithi155.stdout: "event": "commit_sent", 2023-08-01T19:55:45.615 INFO:teuthology.orchestra.run.smithi155.stdout: "time": "2023-08-01T19:55:05.225066+0000", 2023-08-01T19:55:45.615 INFO:teuthology.orchestra.run.smithi155.stdout: "duration": 4.6143000000000002e-05 2023-08-01T19:55:45.615 INFO:teuthology.orchestra.run.smithi155.stdout: }, 2023-08-01T19:55:45.616 INFO:teuthology.orchestra.run.smithi155.stdout: { 2023-08-01T19:55:45.616 INFO:teuthology.orchestra.run.smithi155.stdout: "event": "done", 2023-08-01T19:55:45.616 INFO:teuthology.orchestra.run.smithi155.stdout: "time": "2023-08-01T19:55:05.225103+0000", 2023-08-01T19:55:45.616 INFO:teuthology.orchestra.run.smithi155.stdout: "duration": 3.6789999999999998e-05 2023-08-01T19:55:45.616 INFO:teuthology.orchestra.run.smithi155.stdout: } 2023-08-01T19:55:45.616 INFO:teuthology.orchestra.run.smithi155.stdout: ] 2023-08-01T19:55:45.616 INFO:teuthology.orchestra.run.smithi155.stdout: } 2023-08-01T19:55:45.616 INFO:teuthology.orchestra.run.smithi155.stdout: }, 2023-08-01T19:55:45.617 INFO:teuthology.orchestra.run.smithi155.stdout: { 2023-08-01T19:55:45.617 INFO:teuthology.orchestra.run.smithi155.stdout: "description": "osd_op(client.4668.0:100252 5.0 5:01f90c3c:::benchmark_data_smithi006_114134_object100251:head [set-alloc-hint object_size 65536 write_size 65536,write 0~65536] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e37)", 2023-08-01T19:55:45.617 INFO:teuthology.orchestra.run.smithi155.stdout: "initiated_at": "2023-08-01T19:55:05.154048+0000", 2023-08-01T19:55:45.617 INFO:teuthology.orchestra.run.smithi155.stdout: "age": 40.347095830999997, 2023-08-01T19:55:45.617 INFO:teuthology.orchestra.run.smithi155.stdout: "duration": 0.070156683999999997, 2023-08-01T19:55:45.617 INFO:teuthology.orchestra.run.smithi155.stdout: "type_data": { 2023-08-01T19:55:45.617 INFO:teuthology.orchestra.run.smithi155.stdout: "flag_point": "commit sent; apply or cleanup", 2023-08-01T19:55:45.618 INFO:teuthology.orchestra.run.smithi155.stdout: "client_info": { 2023-08-01T19:55:45.618 INFO:teuthology.orchestra.run.smithi155.stdout: "client": "client.4668", 2023-08-01T19:55:45.618 INFO:teuthology.orchestra.run.smithi155.stdout: "client_addr": "172.21.15.6:0/1709472247", 2023-08-01T19:55:45.618 INFO:teuthology.orchestra.run.smithi155.stdout: "tid": 100252 2023-08-01T19:55:45.618 INFO:teuthology.orchestra.run.smithi155.stdout: }, 2023-08-01T19:55:45.618 INFO:teuthology.orchestra.run.smithi155.stdout: "events": [ 2023-08-01T19:55:45.618 INFO:teuthology.orchestra.run.smithi155.stdout: { 2023-08-01T19:55:45.618 INFO:teuthology.orchestra.run.smithi155.stdout: "event": "initiated", 2023-08-01T19:55:45.619 INFO:teuthology.orchestra.run.smithi155.stdout: "time": "2023-08-01T19:55:05.154048+0000", 2023-08-01T19:55:45.619 INFO:teuthology.orchestra.run.smithi155.stdout: "duration": 0 2023-08-01T19:55:45.619 INFO:teuthology.orchestra.run.smithi155.stdout: }, 2023-08-01T19:55:45.619 INFO:teuthology.orchestra.run.smithi155.stdout: { 2023-08-01T19:55:45.619 INFO:teuthology.orchestra.run.smithi155.stdout: "event": "throttled", 2023-08-01T19:55:45.619 INFO:teuthology.orchestra.run.smithi155.stdout: "time": "2023-08-01T19:55:05.154048+0000", 2023-08-01T19:55:45.619 INFO:teuthology.orchestra.run.smithi155.stdout: "duration": 0 2023-08-01T19:55:45.619 INFO:teuthology.orchestra.run.smithi155.stdout: }, 2023-08-01T19:55:45.620 INFO:teuthology.orchestra.run.smithi155.stdout: { 2023-08-01T19:55:45.620 INFO:teuthology.orchestra.run.smithi155.stdout: "event": "header_read", 2023-08-01T19:55:45.620 INFO:teuthology.orchestra.run.smithi155.stdout: "time": "2023-08-01T19:55:05.154047+0000", 2023-08-01T19:55:45.620 INFO:teuthology.orchestra.run.smithi155.stdout: "duration": 4294967295.999999 2023-08-01T19:55:45.620 INFO:teuthology.orchestra.run.smithi155.stdout: }, 2023-08-01T19:55:45.620 INFO:teuthology.orchestra.run.smithi155.stdout: { 2023-08-01T19:55:45.620 INFO:teuthology.orchestra.run.smithi155.stdout: "event": "all_read", 2023-08-01T19:55:45.621 INFO:teuthology.orchestra.run.smithi155.stdout: "time": "2023-08-01T19:55:05.154115+0000", 2023-08-01T19:55:45.621 INFO:teuthology.orchestra.run.smithi155.stdout: "duration": 6.7545999999999993e-05 2023-08-01T19:55:45.621 INFO:teuthology.orchestra.run.smithi155.stdout: }, 2023-08-01T19:55:45.621 INFO:teuthology.orchestra.run.smithi155.stdout: { 2023-08-01T19:55:45.621 INFO:teuthology.orchestra.run.smithi155.stdout: "event": "dispatched", 2023-08-01T19:55:45.621 INFO:teuthology.orchestra.run.smithi155.stdout: "time": "2023-08-01T19:55:05.154125+0000", 2023-08-01T19:55:45.621 INFO:teuthology.orchestra.run.smithi155.stdout: "duration": 1.0669000000000001e-05 2023-08-01T19:55:45.621 INFO:teuthology.orchestra.run.smithi155.stdout: }, 2023-08-01T19:55:45.622 INFO:teuthology.orchestra.run.smithi155.stdout: { 2023-08-01T19:55:45.622 INFO:teuthology.orchestra.run.smithi155.stdout: "event": "queued_for_pg", 2023-08-01T19:55:45.622 INFO:teuthology.orchestra.run.smithi155.stdout: "time": "2023-08-01T19:55:05.154131+0000", 2023-08-01T19:55:45.622 INFO:teuthology.orchestra.run.smithi155.stdout: "duration": 6.0349999999999998e-06 2023-08-01T19:55:45.622 INFO:teuthology.orchestra.run.smithi155.stdout: }, 2023-08-01T19:55:45.622 INFO:teuthology.orchestra.run.smithi155.stdout: { 2023-08-01T19:55:45.622 INFO:teuthology.orchestra.run.smithi155.stdout: "event": "reached_pg", 2023-08-01T19:55:45.622 INFO:teuthology.orchestra.run.smithi155.stdout: "time": "2023-08-01T19:55:05.154174+0000", 2023-08-01T19:55:45.623 INFO:teuthology.orchestra.run.smithi155.stdout: "duration": 4.2429000000000003e-05 2023-08-01T19:55:45.623 INFO:teuthology.orchestra.run.smithi155.stdout: }, 2023-08-01T19:55:45.623 INFO:teuthology.orchestra.run.smithi155.stdout: { 2023-08-01T19:55:45.623 INFO:teuthology.orchestra.run.smithi155.stdout: "event": "started", 2023-08-01T19:55:45.623 INFO:teuthology.orchestra.run.smithi155.stdout: "time": "2023-08-01T19:55:05.154287+0000", 2023-08-01T19:55:45.623 INFO:teuthology.orchestra.run.smithi155.stdout: "duration": 0.000113138 2023-08-01T19:55:45.623 INFO:teuthology.orchestra.run.smithi155.stdout: }, 2023-08-01T19:55:45.623 INFO:teuthology.orchestra.run.smithi155.stdout: { 2023-08-01T19:55:45.624 INFO:teuthology.orchestra.run.smithi155.stdout: "event": "waiting for subops from 0", 2023-08-01T19:55:45.624 INFO:teuthology.orchestra.run.smithi155.stdout: "time": "2023-08-01T19:55:05.154420+0000", 2023-08-01T19:55:45.624 INFO:teuthology.orchestra.run.smithi155.stdout: "duration": 0.000133292 2023-08-01T19:55:45.624 INFO:teuthology.orchestra.run.smithi155.stdout: }, 2023-08-01T19:55:45.624 INFO:teuthology.orchestra.run.smithi155.stdout: { 2023-08-01T19:55:45.624 INFO:teuthology.orchestra.run.smithi155.stdout: "event": "sub_op_commit_rec", 2023-08-01T19:55:45.624 INFO:teuthology.orchestra.run.smithi155.stdout: "time": "2023-08-01T19:55:05.219034+0000", 2023-08-01T19:55:45.624 INFO:teuthology.orchestra.run.smithi155.stdout: "duration": 0.064613429999999999 2023-08-01T19:55:45.625 INFO:teuthology.orchestra.run.smithi155.stdout: }, 2023-08-01T19:55:45.625 INFO:teuthology.orchestra.run.smithi155.stdout: { 2023-08-01T19:55:45.625 INFO:teuthology.orchestra.run.smithi155.stdout: "event": "op_commit", 2023-08-01T19:55:45.625 INFO:teuthology.orchestra.run.smithi155.stdout: "time": "2023-08-01T19:55:05.224138+0000", 2023-08-01T19:55:45.625 INFO:teuthology.orchestra.run.smithi155.stdout: "duration": 0.0051041999999999997 2023-08-01T19:55:45.625 INFO:teuthology.orchestra.run.smithi155.stdout: }, 2023-08-01T19:55:45.625 INFO:teuthology.orchestra.run.smithi155.stdout: { 2023-08-01T19:55:45.626 INFO:teuthology.orchestra.run.smithi155.stdout: "event": "commit_sent", 2023-08-01T19:55:45.626 INFO:teuthology.orchestra.run.smithi155.stdout: "time": "2023-08-01T19:55:05.224171+0000", 2023-08-01T19:55:45.626 INFO:teuthology.orchestra.run.smithi155.stdout: "duration": 3.3345e-05 2023-08-01T19:55:45.626 INFO:teuthology.orchestra.run.smithi155.stdout: }, 2023-08-01T19:55:45.626 INFO:teuthology.orchestra.run.smithi155.stdout: { 2023-08-01T19:55:45.626 INFO:teuthology.orchestra.run.smithi155.stdout: "event": "done", 2023-08-01T19:55:45.626 INFO:teuthology.orchestra.run.smithi155.stdout: "time": "2023-08-01T19:55:05.224205+0000", 2023-08-01T19:55:45.626 INFO:teuthology.orchestra.run.smithi155.stdout: "duration": 3.3525999999999997e-05 2023-08-01T19:55:45.627 INFO:teuthology.orchestra.run.smithi155.stdout: } 2023-08-01T19:55:45.627 INFO:teuthology.orchestra.run.smithi155.stdout: ] 2023-08-01T19:55:45.627 INFO:teuthology.orchestra.run.smithi155.stdout: } 2023-08-01T19:55:45.627 INFO:teuthology.orchestra.run.smithi155.stdout: }, 2023-08-01T19:55:45.627 INFO:teuthology.orchestra.run.smithi155.stdout: { 2023-08-01T19:55:45.627 INFO:teuthology.orchestra.run.smithi155.stdout: "description": "osd_repop_reply(client.4668.0:100237 5.4 e37/19 ondisk, result = 0)", 2023-08-01T19:55:45.627 INFO:teuthology.orchestra.run.smithi155.stdout: "initiated_at": "2023-08-01T19:55:05.156249+0000", 2023-08-01T19:55:45.627 INFO:teuthology.orchestra.run.smithi155.stdout: "age": 40.344894885999999, 2023-08-01T19:55:45.628 INFO:teuthology.orchestra.run.smithi155.stdout: "duration": 0.062792549000000003, 2023-08-01T19:55:45.628 INFO:teuthology.orchestra.run.smithi155.stdout: "type_data": { 2023-08-01T19:55:45.628 INFO:teuthology.orchestra.run.smithi155.stdout: "flag_point": "started", 2023-08-01T19:55:45.628 INFO:teuthology.orchestra.run.smithi155.stdout: "events": [ 2023-08-01T19:55:45.628 INFO:teuthology.orchestra.run.smithi155.stdout: { 2023-08-01T19:55:45.628 INFO:teuthology.orchestra.run.smithi155.stdout: "event": "initiated", 2023-08-01T19:55:45.628 INFO:teuthology.orchestra.run.smithi155.stdout: "time": "2023-08-01T19:55:05.156249+0000", 2023-08-01T19:55:45.628 INFO:teuthology.orchestra.run.smithi155.stdout: "duration": 0 2023-08-01T19:55:45.629 INFO:teuthology.orchestra.run.smithi155.stdout: }, 2023-08-01T19:55:45.629 INFO:teuthology.orchestra.run.smithi155.stdout: { 2023-08-01T19:55:45.629 INFO:teuthology.orchestra.run.smithi155.stdout: "event": "throttled", 2023-08-01T19:55:45.629 INFO:teuthology.orchestra.run.smithi155.stdout: "time": "2023-08-01T19:55:05.156249+0000", 2023-08-01T19:55:45.629 INFO:teuthology.orchestra.run.smithi155.stdout: "duration": 0 2023-08-01T19:55:45.629 INFO:teuthology.orchestra.run.smithi155.stdout: }, 2023-08-01T19:55:45.629 INFO:teuthology.orchestra.run.smithi155.stdout: { 2023-08-01T19:55:45.629 INFO:teuthology.orchestra.run.smithi155.stdout: "event": "header_read", 2023-08-01T19:55:45.630 INFO:teuthology.orchestra.run.smithi155.stdout: "time": "2023-08-01T19:55:05.156248+0000", 2023-08-01T19:55:45.630 INFO:teuthology.orchestra.run.smithi155.stdout: "duration": 4294967295.9999995 2023-08-01T19:55:45.630 INFO:teuthology.orchestra.run.smithi155.stdout: }, 2023-08-01T19:55:45.630 INFO:teuthology.orchestra.run.smithi155.stdout: { 2023-08-01T19:55:45.630 INFO:teuthology.orchestra.run.smithi155.stdout: "event": "all_read", 2023-08-01T19:55:45.630 INFO:teuthology.orchestra.run.smithi155.stdout: "time": "2023-08-01T19:55:05.156252+0000", 2023-08-01T19:55:45.630 INFO:teuthology.orchestra.run.smithi155.stdout: "duration": 3.9999999999999998e-06 2023-08-01T19:55:45.630 INFO:teuthology.orchestra.run.smithi155.stdout: }, 2023-08-01T19:55:45.631 INFO:teuthology.orchestra.run.smithi155.stdout: { 2023-08-01T19:55:45.631 INFO:teuthology.orchestra.run.smithi155.stdout: "event": "dispatched", 2023-08-01T19:55:45.631 INFO:teuthology.orchestra.run.smithi155.stdout: "time": "2023-08-01T19:55:05.218844+0000", 2023-08-01T19:55:45.631 INFO:teuthology.orchestra.run.smithi155.stdout: "duration": 0.062591516999999999 2023-08-01T19:55:45.631 INFO:teuthology.orchestra.run.smithi155.stdout: }, 2023-08-01T19:55:45.631 INFO:teuthology.orchestra.run.smithi155.stdout: { 2023-08-01T19:55:45.631 INFO:teuthology.orchestra.run.smithi155.stdout: "event": "queued_for_pg", 2023-08-01T19:55:45.632 INFO:teuthology.orchestra.run.smithi155.stdout: "time": "2023-08-01T19:55:05.218862+0000", 2023-08-01T19:55:45.632 INFO:teuthology.orchestra.run.smithi155.stdout: "duration": 1.7666e-05 2023-08-01T19:55:45.632 INFO:teuthology.orchestra.run.smithi155.stdout: }, 2023-08-01T19:55:45.632 INFO:teuthology.orchestra.run.smithi155.stdout: { 2023-08-01T19:55:45.632 INFO:teuthology.orchestra.run.smithi155.stdout: "event": "reached_pg", 2023-08-01T19:55:45.632 INFO:teuthology.orchestra.run.smithi155.stdout: "time": "2023-08-01T19:55:05.218914+0000", 2023-08-01T19:55:45.632 INFO:teuthology.orchestra.run.smithi155.stdout: "duration": 5.2565999999999998e-05 2023-08-01T19:55:45.632 INFO:teuthology.orchestra.run.smithi155.stdout: }, 2023-08-01T19:55:45.633 INFO:teuthology.orchestra.run.smithi155.stdout: { 2023-08-01T19:55:45.633 INFO:teuthology.orchestra.run.smithi155.stdout: "event": "started", 2023-08-01T19:55:45.633 INFO:teuthology.orchestra.run.smithi155.stdout: "time": "2023-08-01T19:55:05.218925+0000", 2023-08-01T19:55:45.633 INFO:teuthology.orchestra.run.smithi155.stdout: "duration": 1.1375e-05 2023-08-01T19:55:45.633 INFO:teuthology.orchestra.run.smithi155.stdout: }, 2023-08-01T19:55:45.633 INFO:teuthology.orchestra.run.smithi155.stdout: { 2023-08-01T19:55:45.633 INFO:teuthology.orchestra.run.smithi155.stdout: "event": "done", 2023-08-01T19:55:45.633 INFO:teuthology.orchestra.run.smithi155.stdout: "time": "2023-08-01T19:55:05.219041+0000", 2023-08-01T19:55:45.634 INFO:teuthology.orchestra.run.smithi155.stdout: "duration": 0.000115977 2023-08-01T19:55:45.634 INFO:teuthology.orchestra.run.smithi155.stdout: } 2023-08-01T19:55:45.634 INFO:teuthology.orchestra.run.smithi155.stdout: ] 2023-08-01T19:55:45.634 INFO:teuthology.orchestra.run.smithi155.stdout: } 2023-08-01T19:55:45.634 INFO:teuthology.orchestra.run.smithi155.stdout: }, 2023-08-01T19:55:45.634 INFO:teuthology.orchestra.run.smithi155.stdout: { 2023-08-01T19:55:45.634 INFO:teuthology.orchestra.run.smithi155.stdout: "description": "osd_repop(client.4668.0:100253 5.f e37/19 5:f7bbce05:::benchmark_data_smithi006_114134_object100252:head v 37'6323, mlcod=37'6321)", 2023-08-01T19:55:45.634 INFO:teuthology.orchestra.run.smithi155.stdout: "initiated_at": "2023-08-01T19:55:05.156952+0000", 2023-08-01T19:55:45.635 INFO:teuthology.orchestra.run.smithi155.stdout: "age": 40.344191823000003, 2023-08-01T19:55:45.635 INFO:teuthology.orchestra.run.smithi155.stdout: "duration": 0.068018577999999996, 2023-08-01T19:55:45.635 INFO:teuthology.orchestra.run.smithi155.stdout: "type_data": { 2023-08-01T19:55:45.635 INFO:teuthology.orchestra.run.smithi155.stdout: "flag_point": "commit sent; apply or cleanup", 2023-08-01T19:55:45.635 INFO:teuthology.orchestra.run.smithi155.stdout: "events": [ 2023-08-01T19:55:45.635 INFO:teuthology.orchestra.run.smithi155.stdout: { 2023-08-01T19:55:45.635 INFO:teuthology.orchestra.run.smithi155.stdout: "event": "initiated", 2023-08-01T19:55:45.635 INFO:teuthology.orchestra.run.smithi155.stdout: "time": "2023-08-01T19:55:05.156952+0000", 2023-08-01T19:55:45.636 INFO:teuthology.orchestra.run.smithi155.stdout: "duration": 0 2023-08-01T19:55:45.636 INFO:teuthology.orchestra.run.smithi155.stdout: }, 2023-08-01T19:55:45.636 INFO:teuthology.orchestra.run.smithi155.stdout: { 2023-08-01T19:55:45.636 INFO:teuthology.orchestra.run.smithi155.stdout: "event": "throttled", 2023-08-01T19:55:45.636 INFO:teuthology.orchestra.run.smithi155.stdout: "time": "2023-08-01T19:55:05.156952+0000", 2023-08-01T19:55:45.636 INFO:teuthology.orchestra.run.smithi155.stdout: "duration": 0 2023-08-01T19:55:45.636 INFO:teuthology.orchestra.run.smithi155.stdout: }, 2023-08-01T19:55:45.637 INFO:teuthology.orchestra.run.smithi155.stdout: { 2023-08-01T19:55:45.637 INFO:teuthology.orchestra.run.smithi155.stdout: "event": "header_read", 2023-08-01T19:55:45.637 INFO:teuthology.orchestra.run.smithi155.stdout: "time": "2023-08-01T19:55:05.156951+0000", 2023-08-01T19:55:45.637 INFO:teuthology.orchestra.run.smithi155.stdout: "duration": 4294967295.999999 2023-08-01T19:55:45.637 INFO:teuthology.orchestra.run.smithi155.stdout: }, 2023-08-01T19:55:45.637 INFO:teuthology.orchestra.run.smithi155.stdout: { 2023-08-01T19:55:45.637 INFO:teuthology.orchestra.run.smithi155.stdout: "event": "all_read", 2023-08-01T19:55:45.637 INFO:teuthology.orchestra.run.smithi155.stdout: "time": "2023-08-01T19:55:05.156989+0000", 2023-08-01T19:55:45.638 INFO:teuthology.orchestra.run.smithi155.stdout: "duration": 3.8175e-05 2023-08-01T19:55:45.638 INFO:teuthology.orchestra.run.smithi155.stdout: }, 2023-08-01T19:55:45.638 INFO:teuthology.orchestra.run.smithi155.stdout: { 2023-08-01T19:55:45.638 INFO:teuthology.orchestra.run.smithi155.stdout: "event": "dispatched", 2023-08-01T19:55:45.638 INFO:teuthology.orchestra.run.smithi155.stdout: "time": "2023-08-01T19:55:05.218842+0000", 2023-08-01T19:55:45.638 INFO:teuthology.orchestra.run.smithi155.stdout: "duration": 0.061852299999999999 2023-08-01T19:55:45.638 INFO:teuthology.orchestra.run.smithi155.stdout: }, 2023-08-01T19:55:45.638 INFO:teuthology.orchestra.run.smithi155.stdout: { 2023-08-01T19:55:45.639 INFO:teuthology.orchestra.run.smithi155.stdout: "event": "queued_for_pg", 2023-08-01T19:55:45.639 INFO:teuthology.orchestra.run.smithi155.stdout: "time": "2023-08-01T19:55:05.218862+0000", 2023-08-01T19:55:45.639 INFO:teuthology.orchestra.run.smithi155.stdout: "duration": 1.9854999999999999e-05 2023-08-01T19:55:45.639 INFO:teuthology.orchestra.run.smithi155.stdout: }, 2023-08-01T19:55:45.639 INFO:teuthology.orchestra.run.smithi155.stdout: { 2023-08-01T19:55:45.639 INFO:teuthology.orchestra.run.smithi155.stdout: "event": "reached_pg", 2023-08-01T19:55:45.639 INFO:teuthology.orchestra.run.smithi155.stdout: "time": "2023-08-01T19:55:05.218918+0000", 2023-08-01T19:55:45.639 INFO:teuthology.orchestra.run.smithi155.stdout: "duration": 5.6570000000000002e-05 2023-08-01T19:55:45.640 INFO:teuthology.orchestra.run.smithi155.stdout: }, 2023-08-01T19:55:45.640 INFO:teuthology.orchestra.run.smithi155.stdout: { 2023-08-01T19:55:45.640 INFO:teuthology.orchestra.run.smithi155.stdout: "event": "started", 2023-08-01T19:55:45.640 INFO:teuthology.orchestra.run.smithi155.stdout: "time": "2023-08-01T19:55:05.218940+0000", 2023-08-01T19:55:45.640 INFO:teuthology.orchestra.run.smithi155.stdout: "duration": 2.1804e-05 2023-08-01T19:55:45.640 INFO:teuthology.orchestra.run.smithi155.stdout: }, 2023-08-01T19:55:45.640 INFO:teuthology.orchestra.run.smithi155.stdout: { 2023-08-01T19:55:45.640 INFO:teuthology.orchestra.run.smithi155.stdout: "event": "commit_sent", 2023-08-01T19:55:45.641 INFO:teuthology.orchestra.run.smithi155.stdout: "time": "2023-08-01T19:55:05.224928+0000", 2023-08-01T19:55:45.641 INFO:teuthology.orchestra.run.smithi155.stdout: "duration": 0.0059876759999999999 2023-08-01T19:55:45.641 INFO:teuthology.orchestra.run.smithi155.stdout: }, 2023-08-01T19:55:45.641 INFO:teuthology.orchestra.run.smithi155.stdout: { 2023-08-01T19:55:45.641 INFO:teuthology.orchestra.run.smithi155.stdout: "event": "done", 2023-08-01T19:55:45.641 INFO:teuthology.orchestra.run.smithi155.stdout: "time": "2023-08-01T19:55:05.224971+0000", 2023-08-01T19:55:45.641 INFO:teuthology.orchestra.run.smithi155.stdout: "duration": 4.2929999999999997e-05 2023-08-01T19:55:45.641 INFO:teuthology.orchestra.run.smithi155.stdout: } 2023-08-01T19:55:45.642 INFO:teuthology.orchestra.run.smithi155.stdout: ] 2023-08-01T19:55:45.642 INFO:teuthology.orchestra.run.smithi155.stdout: } 2023-08-01T19:55:45.642 INFO:teuthology.orchestra.run.smithi155.stdout: }, 2023-08-01T19:55:45.642 INFO:teuthology.orchestra.run.smithi155.stdout: { 2023-08-01T19:55:45.642 INFO:teuthology.orchestra.run.smithi155.stdout: "description": "osd_op(client.4668.0:100927 5.0 5:00608ec6:::benchmark_data_smithi006_114134_object100926:head [set-alloc-hint object_size 65536 write_size 65536,write 0~65536] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e37)", 2023-08-01T19:55:45.642 INFO:teuthology.orchestra.run.smithi155.stdout: "initiated_at": "2023-08-01T19:55:05.561169+0000", 2023-08-01T19:55:45.642 INFO:teuthology.orchestra.run.smithi155.stdout: "age": 39.939974919999997, 2023-08-01T19:55:45.642 INFO:teuthology.orchestra.run.smithi155.stdout: "duration": 0.066411687999999997, 2023-08-01T19:55:45.643 INFO:teuthology.orchestra.run.smithi155.stdout: "type_data": { 2023-08-01T19:55:45.643 INFO:teuthology.orchestra.run.smithi155.stdout: "flag_point": "commit sent; apply or cleanup", 2023-08-01T19:55:45.643 INFO:teuthology.orchestra.run.smithi155.stdout: "client_info": { 2023-08-01T19:55:45.643 INFO:teuthology.orchestra.run.smithi155.stdout: "client": "client.4668", 2023-08-01T19:55:45.643 INFO:teuthology.orchestra.run.smithi155.stdout: "client_addr": "172.21.15.6:0/1709472247", 2023-08-01T19:55:45.643 INFO:teuthology.orchestra.run.smithi155.stdout: "tid": 100927 2023-08-01T19:55:45.643 INFO:teuthology.orchestra.run.smithi155.stdout: }, 2023-08-01T19:55:45.643 INFO:teuthology.orchestra.run.smithi155.stdout: "events": [ 2023-08-01T19:55:45.644 INFO:teuthology.orchestra.run.smithi155.stdout: { 2023-08-01T19:55:45.644 INFO:teuthology.orchestra.run.smithi155.stdout: "event": "initiated", 2023-08-01T19:55:45.644 INFO:teuthology.orchestra.run.smithi155.stdout: "time": "2023-08-01T19:55:05.561169+0000", 2023-08-01T19:55:45.644 INFO:teuthology.orchestra.run.smithi155.stdout: "duration": 0 2023-08-01T19:55:45.644 INFO:teuthology.orchestra.run.smithi155.stdout: }, 2023-08-01T19:55:45.644 INFO:teuthology.orchestra.run.smithi155.stdout: { 2023-08-01T19:55:45.644 INFO:teuthology.orchestra.run.smithi155.stdout: "event": "throttled", 2023-08-01T19:55:45.645 INFO:teuthology.orchestra.run.smithi155.stdout: "time": "2023-08-01T19:55:05.561169+0000", 2023-08-01T19:55:45.645 INFO:teuthology.orchestra.run.smithi155.stdout: "duration": 0 2023-08-01T19:55:45.645 INFO:teuthology.orchestra.run.smithi155.stdout: }, 2023-08-01T19:55:45.645 INFO:teuthology.orchestra.run.smithi155.stdout: { 2023-08-01T19:55:45.645 INFO:teuthology.orchestra.run.smithi155.stdout: "event": "header_read", 2023-08-01T19:55:45.645 INFO:teuthology.orchestra.run.smithi155.stdout: "time": "2023-08-01T19:55:05.561168+0000", 2023-08-01T19:55:45.646 INFO:teuthology.orchestra.run.smithi155.stdout: "duration": 4294967295.9999995 2023-08-01T19:55:45.646 INFO:teuthology.orchestra.run.smithi155.stdout: }, 2023-08-01T19:55:45.646 INFO:teuthology.orchestra.run.smithi155.stdout: { 2023-08-01T19:55:45.646 INFO:teuthology.orchestra.run.smithi155.stdout: "event": "all_read", 2023-08-01T19:55:45.646 INFO:teuthology.orchestra.run.smithi155.stdout: "time": "2023-08-01T19:55:05.561218+0000", 2023-08-01T19:55:45.646 INFO:teuthology.orchestra.run.smithi155.stdout: "duration": 4.9379999999999998e-05 2023-08-01T19:55:45.647 INFO:teuthology.orchestra.run.smithi155.stdout: }, 2023-08-01T19:55:45.647 INFO:teuthology.orchestra.run.smithi155.stdout: { 2023-08-01T19:55:45.647 INFO:teuthology.orchestra.run.smithi155.stdout: "event": "dispatched", 2023-08-01T19:55:45.647 INFO:teuthology.orchestra.run.smithi155.stdout: "time": "2023-08-01T19:55:05.561225+0000", 2023-08-01T19:55:45.647 INFO:teuthology.orchestra.run.smithi155.stdout: "duration": 7.114e-06 2023-08-01T19:55:45.647 INFO:teuthology.orchestra.run.smithi155.stdout: }, 2023-08-01T19:55:45.647 INFO:teuthology.orchestra.run.smithi155.stdout: { 2023-08-01T19:55:45.647 INFO:teuthology.orchestra.run.smithi155.stdout: "event": "queued_for_pg", 2023-08-01T19:55:45.648 INFO:teuthology.orchestra.run.smithi155.stdout: "time": "2023-08-01T19:55:05.561229+0000", 2023-08-01T19:55:45.648 INFO:teuthology.orchestra.run.smithi155.stdout: "duration": 4.2180000000000001e-06 2023-08-01T19:55:45.648 INFO:teuthology.orchestra.run.smithi155.stdout: }, 2023-08-01T19:55:45.648 INFO:teuthology.orchestra.run.smithi155.stdout: { 2023-08-01T19:55:45.648 INFO:teuthology.orchestra.run.smithi155.stdout: "event": "reached_pg", 2023-08-01T19:55:45.648 INFO:teuthology.orchestra.run.smithi155.stdout: "time": "2023-08-01T19:55:05.564737+0000", 2023-08-01T19:55:45.648 INFO:teuthology.orchestra.run.smithi155.stdout: "duration": 0.0035081869999999999 2023-08-01T19:55:45.649 INFO:teuthology.orchestra.run.smithi155.stdout: }, 2023-08-01T19:55:45.649 INFO:teuthology.orchestra.run.smithi155.stdout: { 2023-08-01T19:55:45.649 INFO:teuthology.orchestra.run.smithi155.stdout: "event": "started", 2023-08-01T19:55:45.649 INFO:teuthology.orchestra.run.smithi155.stdout: "time": "2023-08-01T19:55:05.564859+0000", 2023-08-01T19:55:45.649 INFO:teuthology.orchestra.run.smithi155.stdout: "duration": 0.00012165800000000001 2023-08-01T19:55:45.649 INFO:teuthology.orchestra.run.smithi155.stdout: }, 2023-08-01T19:55:45.649 INFO:teuthology.orchestra.run.smithi155.stdout: { 2023-08-01T19:55:45.649 INFO:teuthology.orchestra.run.smithi155.stdout: "event": "waiting for subops from 0", 2023-08-01T19:55:45.650 INFO:teuthology.orchestra.run.smithi155.stdout: "time": "2023-08-01T19:55:05.565009+0000", 2023-08-01T19:55:45.650 INFO:teuthology.orchestra.run.smithi155.stdout: "duration": 0.00014979699999999999 2023-08-01T19:55:45.650 INFO:teuthology.orchestra.run.smithi155.stdout: }, 2023-08-01T19:55:45.650 INFO:teuthology.orchestra.run.smithi155.stdout: { 2023-08-01T19:55:45.650 INFO:teuthology.orchestra.run.smithi155.stdout: "event": "op_commit", 2023-08-01T19:55:45.650 INFO:teuthology.orchestra.run.smithi155.stdout: "time": "2023-08-01T19:55:05.568007+0000", 2023-08-01T19:55:45.650 INFO:teuthology.orchestra.run.smithi155.stdout: "duration": 0.00299796 2023-08-01T19:55:45.650 INFO:teuthology.orchestra.run.smithi155.stdout: }, 2023-08-01T19:55:45.651 INFO:teuthology.orchestra.run.smithi155.stdout: { 2023-08-01T19:55:45.651 INFO:teuthology.orchestra.run.smithi155.stdout: "event": "sub_op_commit_rec", 2023-08-01T19:55:45.651 INFO:teuthology.orchestra.run.smithi155.stdout: "time": "2023-08-01T19:55:05.627520+0000", 2023-08-01T19:55:45.651 INFO:teuthology.orchestra.run.smithi155.stdout: "duration": 0.059513636000000002 2023-08-01T19:55:45.651 INFO:teuthology.orchestra.run.smithi155.stdout: }, 2023-08-01T19:55:45.651 INFO:teuthology.orchestra.run.smithi155.stdout: { 2023-08-01T19:55:45.651 INFO:teuthology.orchestra.run.smithi155.stdout: "event": "commit_sent", 2023-08-01T19:55:45.651 INFO:teuthology.orchestra.run.smithi155.stdout: "time": "2023-08-01T19:55:05.627553+0000", 2023-08-01T19:55:45.652 INFO:teuthology.orchestra.run.smithi155.stdout: "duration": 3.2635999999999997e-05 2023-08-01T19:55:45.652 INFO:teuthology.orchestra.run.smithi155.stdout: }, 2023-08-01T19:55:45.652 INFO:teuthology.orchestra.run.smithi155.stdout: { 2023-08-01T19:55:45.652 INFO:teuthology.orchestra.run.smithi155.stdout: "event": "done", 2023-08-01T19:55:45.652 INFO:teuthology.orchestra.run.smithi155.stdout: "time": "2023-08-01T19:55:05.627581+0000", 2023-08-01T19:55:45.652 INFO:teuthology.orchestra.run.smithi155.stdout: "duration": 2.7681000000000001e-05 2023-08-01T19:55:45.652 INFO:teuthology.orchestra.run.smithi155.stdout: } 2023-08-01T19:55:45.652 INFO:teuthology.orchestra.run.smithi155.stdout: ] 2023-08-01T19:55:45.653 INFO:teuthology.orchestra.run.smithi155.stdout: } 2023-08-01T19:55:45.653 INFO:teuthology.orchestra.run.smithi155.stdout: }, 2023-08-01T19:55:45.653 INFO:teuthology.orchestra.run.smithi155.stdout: { 2023-08-01T19:55:45.653 INFO:teuthology.orchestra.run.smithi155.stdout: "description": "osd_op(client.4668.0:100935 5.e 5:7895b14e:::benchmark_data_smithi006_114134_object100934:head [set-alloc-hint object_size 65536 write_size 65536,write 0~65536] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e37)", 2023-08-01T19:55:45.653 INFO:teuthology.orchestra.run.smithi155.stdout: "initiated_at": "2023-08-01T19:55:05.566666+0000", 2023-08-01T19:55:45.653 INFO:teuthology.orchestra.run.smithi155.stdout: "age": 39.934477620000003, 2023-08-01T19:55:45.653 INFO:teuthology.orchestra.run.smithi155.stdout: "duration": 0.064309016999999996, 2023-08-01T19:55:45.653 INFO:teuthology.orchestra.run.smithi155.stdout: "type_data": { 2023-08-01T19:55:45.654 INFO:teuthology.orchestra.run.smithi155.stdout: "flag_point": "commit sent; apply or cleanup", 2023-08-01T19:55:45.654 INFO:teuthology.orchestra.run.smithi155.stdout: "client_info": { 2023-08-01T19:55:45.654 INFO:teuthology.orchestra.run.smithi155.stdout: "client": "client.4668", 2023-08-01T19:55:45.654 INFO:teuthology.orchestra.run.smithi155.stdout: "client_addr": "172.21.15.6:0/1709472247", 2023-08-01T19:55:45.654 INFO:teuthology.orchestra.run.smithi155.stdout: "tid": 100935 2023-08-01T19:55:45.654 INFO:teuthology.orchestra.run.smithi155.stdout: }, 2023-08-01T19:55:45.654 INFO:teuthology.orchestra.run.smithi155.stdout: "events": [ 2023-08-01T19:55:45.655 INFO:teuthology.orchestra.run.smithi155.stdout: { 2023-08-01T19:55:45.655 INFO:teuthology.orchestra.run.smithi155.stdout: "event": "initiated", 2023-08-01T19:55:45.655 INFO:teuthology.orchestra.run.smithi155.stdout: "time": "2023-08-01T19:55:05.566666+0000", 2023-08-01T19:55:45.655 INFO:teuthology.orchestra.run.smithi155.stdout: "duration": 0 2023-08-01T19:55:45.655 INFO:teuthology.orchestra.run.smithi155.stdout: }, 2023-08-01T19:55:45.655 INFO:teuthology.orchestra.run.smithi155.stdout: { 2023-08-01T19:55:45.655 INFO:teuthology.orchestra.run.smithi155.stdout: "event": "throttled", 2023-08-01T19:55:45.655 INFO:teuthology.orchestra.run.smithi155.stdout: "time": "2023-08-01T19:55:05.566666+0000", 2023-08-01T19:55:45.656 INFO:teuthology.orchestra.run.smithi155.stdout: "duration": 0 2023-08-01T19:55:45.656 INFO:teuthology.orchestra.run.smithi155.stdout: }, 2023-08-01T19:55:45.656 INFO:teuthology.orchestra.run.smithi155.stdout: { 2023-08-01T19:55:45.656 INFO:teuthology.orchestra.run.smithi155.stdout: "event": "header_read", 2023-08-01T19:55:45.656 INFO:teuthology.orchestra.run.smithi155.stdout: "time": "2023-08-01T19:55:05.566665+0000", 2023-08-01T19:55:45.656 INFO:teuthology.orchestra.run.smithi155.stdout: "duration": 4294967295.9999986 2023-08-01T19:55:45.656 INFO:teuthology.orchestra.run.smithi155.stdout: }, 2023-08-01T19:55:45.656 INFO:teuthology.orchestra.run.smithi155.stdout: { 2023-08-01T19:55:45.657 INFO:teuthology.orchestra.run.smithi155.stdout: "event": "all_read", 2023-08-01T19:55:45.657 INFO:teuthology.orchestra.run.smithi155.stdout: "time": "2023-08-01T19:55:05.566754+0000", 2023-08-01T19:55:45.657 INFO:teuthology.orchestra.run.smithi155.stdout: "duration": 8.9425999999999994e-05 2023-08-01T19:55:45.657 INFO:teuthology.orchestra.run.smithi155.stdout: }, 2023-08-01T19:55:45.657 INFO:teuthology.orchestra.run.smithi155.stdout: { 2023-08-01T19:55:45.657 INFO:teuthology.orchestra.run.smithi155.stdout: "event": "dispatched", 2023-08-01T19:55:45.657 INFO:teuthology.orchestra.run.smithi155.stdout: "time": "2023-08-01T19:55:05.566766+0000", 2023-08-01T19:55:45.657 INFO:teuthology.orchestra.run.smithi155.stdout: "duration": 1.2018000000000001e-05 2023-08-01T19:55:45.658 INFO:teuthology.orchestra.run.smithi155.stdout: }, 2023-08-01T19:55:45.658 INFO:teuthology.orchestra.run.smithi155.stdout: { 2023-08-01T19:55:45.658 INFO:teuthology.orchestra.run.smithi155.stdout: "event": "queued_for_pg", 2023-08-01T19:55:45.658 INFO:teuthology.orchestra.run.smithi155.stdout: "time": "2023-08-01T19:55:05.566772+0000", 2023-08-01T19:55:45.658 INFO:teuthology.orchestra.run.smithi155.stdout: "duration": 6.0190000000000003e-06 2023-08-01T19:55:45.658 INFO:teuthology.orchestra.run.smithi155.stdout: }, 2023-08-01T19:55:45.658 INFO:teuthology.orchestra.run.smithi155.stdout: { 2023-08-01T19:55:45.658 INFO:teuthology.orchestra.run.smithi155.stdout: "event": "reached_pg", 2023-08-01T19:55:45.659 INFO:teuthology.orchestra.run.smithi155.stdout: "time": "2023-08-01T19:55:05.566800+0000", 2023-08-01T19:55:45.659 INFO:teuthology.orchestra.run.smithi155.stdout: "duration": 2.7835999999999999e-05 2023-08-01T19:55:45.659 INFO:teuthology.orchestra.run.smithi155.stdout: }, 2023-08-01T19:55:45.659 INFO:teuthology.orchestra.run.smithi155.stdout: { 2023-08-01T19:55:45.659 INFO:teuthology.orchestra.run.smithi155.stdout: "event": "started", 2023-08-01T19:55:45.659 INFO:teuthology.orchestra.run.smithi155.stdout: "time": "2023-08-01T19:55:05.566879+0000", 2023-08-01T19:55:45.659 INFO:teuthology.orchestra.run.smithi155.stdout: "duration": 7.9105999999999998e-05 2023-08-01T19:55:45.659 INFO:teuthology.orchestra.run.smithi155.stdout: }, 2023-08-01T19:55:45.660 INFO:teuthology.orchestra.run.smithi155.stdout: { 2023-08-01T19:55:45.660 INFO:teuthology.orchestra.run.smithi155.stdout: "event": "waiting for subops from 0", 2023-08-01T19:55:45.660 INFO:teuthology.orchestra.run.smithi155.stdout: "time": "2023-08-01T19:55:05.566971+0000", 2023-08-01T19:55:45.660 INFO:teuthology.orchestra.run.smithi155.stdout: "duration": 9.1817999999999994e-05 2023-08-01T19:55:45.660 INFO:teuthology.orchestra.run.smithi155.stdout: }, 2023-08-01T19:55:45.660 INFO:teuthology.orchestra.run.smithi155.stdout: { 2023-08-01T19:55:45.660 INFO:teuthology.orchestra.run.smithi155.stdout: "event": "op_commit", 2023-08-01T19:55:45.661 INFO:teuthology.orchestra.run.smithi155.stdout: "time": "2023-08-01T19:55:05.571475+0000", 2023-08-01T19:55:45.661 INFO:teuthology.orchestra.run.smithi155.stdout: "duration": 0.0045039499999999996 2023-08-01T19:55:45.661 INFO:teuthology.orchestra.run.smithi155.stdout: }, 2023-08-01T19:55:45.661 INFO:teuthology.orchestra.run.smithi155.stdout: { 2023-08-01T19:55:45.661 INFO:teuthology.orchestra.run.smithi155.stdout: "event": "sub_op_commit_rec", 2023-08-01T19:55:45.661 INFO:teuthology.orchestra.run.smithi155.stdout: "time": "2023-08-01T19:55:05.630884+0000", 2023-08-01T19:55:45.661 INFO:teuthology.orchestra.run.smithi155.stdout: "duration": 0.059409181999999998 2023-08-01T19:55:45.661 INFO:teuthology.orchestra.run.smithi155.stdout: }, 2023-08-01T19:55:45.662 INFO:teuthology.orchestra.run.smithi155.stdout: { 2023-08-01T19:55:45.662 INFO:teuthology.orchestra.run.smithi155.stdout: "event": "commit_sent", 2023-08-01T19:55:45.662 INFO:teuthology.orchestra.run.smithi155.stdout: "time": "2023-08-01T19:55:05.630930+0000", 2023-08-01T19:55:45.662 INFO:teuthology.orchestra.run.smithi155.stdout: "duration": 4.5507999999999999e-05 2023-08-01T19:55:45.662 INFO:teuthology.orchestra.run.smithi155.stdout: }, 2023-08-01T19:55:45.662 INFO:teuthology.orchestra.run.smithi155.stdout: { 2023-08-01T19:55:45.662 INFO:teuthology.orchestra.run.smithi155.stdout: "event": "done", 2023-08-01T19:55:45.662 INFO:teuthology.orchestra.run.smithi155.stdout: "time": "2023-08-01T19:55:05.630975+0000", 2023-08-01T19:55:45.663 INFO:teuthology.orchestra.run.smithi155.stdout: "duration": 4.5441000000000001e-05 2023-08-01T19:55:45.663 INFO:teuthology.orchestra.run.smithi155.stdout: } 2023-08-01T19:55:45.663 INFO:teuthology.orchestra.run.smithi155.stdout: ] 2023-08-01T19:55:45.663 INFO:teuthology.orchestra.run.smithi155.stdout: } 2023-08-01T19:55:45.663 INFO:teuthology.orchestra.run.smithi155.stdout: }, 2023-08-01T19:55:45.663 INFO:teuthology.orchestra.run.smithi155.stdout: { 2023-08-01T19:55:45.663 INFO:teuthology.orchestra.run.smithi155.stdout: "description": "osd_op(client.4668.0:100941 5.e 5:736a6ac6:::benchmark_data_smithi006_114134_object100940:head [set-alloc-hint object_size 65536 write_size 65536,write 0~65536] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e37)", 2023-08-01T19:55:45.663 INFO:teuthology.orchestra.run.smithi155.stdout: "initiated_at": "2023-08-01T19:55:05.569750+0000", 2023-08-01T19:55:45.664 INFO:teuthology.orchestra.run.smithi155.stdout: "age": 39.931393727, 2023-08-01T19:55:45.664 INFO:teuthology.orchestra.run.smithi155.stdout: "duration": 0.065431331999999995, 2023-08-01T19:55:45.664 INFO:teuthology.orchestra.run.smithi155.stdout: "type_data": { 2023-08-01T19:55:45.664 INFO:teuthology.orchestra.run.smithi155.stdout: "flag_point": "commit sent; apply or cleanup", 2023-08-01T19:55:45.664 INFO:teuthology.orchestra.run.smithi155.stdout: "client_info": { 2023-08-01T19:55:45.664 INFO:teuthology.orchestra.run.smithi155.stdout: "client": "client.4668", 2023-08-01T19:55:45.664 INFO:teuthology.orchestra.run.smithi155.stdout: "client_addr": "172.21.15.6:0/1709472247", 2023-08-01T19:55:45.664 INFO:teuthology.orchestra.run.smithi155.stdout: "tid": 100941 2023-08-01T19:55:45.665 INFO:teuthology.orchestra.run.smithi155.stdout: }, 2023-08-01T19:55:45.665 INFO:teuthology.orchestra.run.smithi155.stdout: "events": [ 2023-08-01T19:55:45.665 INFO:teuthology.orchestra.run.smithi155.stdout: { 2023-08-01T19:55:45.665 INFO:teuthology.orchestra.run.smithi155.stdout: "event": "initiated", 2023-08-01T19:55:45.665 INFO:teuthology.orchestra.run.smithi155.stdout: "time": "2023-08-01T19:55:05.569750+0000", 2023-08-01T19:55:45.665 INFO:teuthology.orchestra.run.smithi155.stdout: "duration": 0 2023-08-01T19:55:45.665 INFO:teuthology.orchestra.run.smithi155.stdout: }, 2023-08-01T19:55:45.665 INFO:teuthology.orchestra.run.smithi155.stdout: { 2023-08-01T19:55:45.666 INFO:teuthology.orchestra.run.smithi155.stdout: "event": "throttled", 2023-08-01T19:55:45.666 INFO:teuthology.orchestra.run.smithi155.stdout: "time": "2023-08-01T19:55:05.569750+0000", 2023-08-01T19:55:45.666 INFO:teuthology.orchestra.run.smithi155.stdout: "duration": 0 2023-08-01T19:55:45.666 INFO:teuthology.orchestra.run.smithi155.stdout: }, 2023-08-01T19:55:45.666 INFO:teuthology.orchestra.run.smithi155.stdout: { 2023-08-01T19:55:45.666 INFO:teuthology.orchestra.run.smithi155.stdout: "event": "header_read", 2023-08-01T19:55:45.666 INFO:teuthology.orchestra.run.smithi155.stdout: "time": "2023-08-01T19:55:05.569749+0000", 2023-08-01T19:55:45.666 INFO:teuthology.orchestra.run.smithi155.stdout: "duration": 4294967295.999999 2023-08-01T19:55:45.667 INFO:teuthology.orchestra.run.smithi155.stdout: }, 2023-08-01T19:55:45.667 INFO:teuthology.orchestra.run.smithi155.stdout: { 2023-08-01T19:55:45.667 INFO:teuthology.orchestra.run.smithi155.stdout: "event": "all_read", 2023-08-01T19:55:45.667 INFO:teuthology.orchestra.run.smithi155.stdout: "time": "2023-08-01T19:55:05.569861+0000", 2023-08-01T19:55:45.667 INFO:teuthology.orchestra.run.smithi155.stdout: "duration": 0.000111333 2023-08-01T19:55:45.667 INFO:teuthology.orchestra.run.smithi155.stdout: }, 2023-08-01T19:55:45.667 INFO:teuthology.orchestra.run.smithi155.stdout: { 2023-08-01T19:55:45.667 INFO:teuthology.orchestra.run.smithi155.stdout: "event": "dispatched", 2023-08-01T19:55:45.668 INFO:teuthology.orchestra.run.smithi155.stdout: "time": "2023-08-01T19:55:05.569869+0000", 2023-08-01T19:55:45.668 INFO:teuthology.orchestra.run.smithi155.stdout: "duration": 8.8589999999999994e-06 2023-08-01T19:55:45.668 INFO:teuthology.orchestra.run.smithi155.stdout: }, 2023-08-01T19:55:45.668 INFO:teuthology.orchestra.run.smithi155.stdout: { 2023-08-01T19:55:45.668 INFO:teuthology.orchestra.run.smithi155.stdout: "event": "queued_for_pg", 2023-08-01T19:55:45.668 INFO:teuthology.orchestra.run.smithi155.stdout: "time": "2023-08-01T19:55:05.569874+0000", 2023-08-01T19:55:45.668 INFO:teuthology.orchestra.run.smithi155.stdout: "duration": 4.1679999999999997e-06 2023-08-01T19:55:45.669 INFO:teuthology.orchestra.run.smithi155.stdout: }, 2023-08-01T19:55:45.669 INFO:teuthology.orchestra.run.smithi155.stdout: { 2023-08-01T19:55:45.669 INFO:teuthology.orchestra.run.smithi155.stdout: "event": "reached_pg", 2023-08-01T19:55:45.669 INFO:teuthology.orchestra.run.smithi155.stdout: "time": "2023-08-01T19:55:05.569904+0000", 2023-08-01T19:55:45.669 INFO:teuthology.orchestra.run.smithi155.stdout: "duration": 3.0920999999999998e-05 2023-08-01T19:55:45.669 INFO:teuthology.orchestra.run.smithi155.stdout: }, 2023-08-01T19:55:45.669 INFO:teuthology.orchestra.run.smithi155.stdout: { 2023-08-01T19:55:45.669 INFO:teuthology.orchestra.run.smithi155.stdout: "event": "started", 2023-08-01T19:55:45.670 INFO:teuthology.orchestra.run.smithi155.stdout: "time": "2023-08-01T19:55:05.569998+0000", 2023-08-01T19:55:45.670 INFO:teuthology.orchestra.run.smithi155.stdout: "duration": 9.3086999999999998e-05 2023-08-01T19:55:45.670 INFO:teuthology.orchestra.run.smithi155.stdout: }, 2023-08-01T19:55:45.670 INFO:teuthology.orchestra.run.smithi155.stdout: { 2023-08-01T19:55:45.670 INFO:teuthology.orchestra.run.smithi155.stdout: "event": "waiting for subops from 0", 2023-08-01T19:55:45.670 INFO:teuthology.orchestra.run.smithi155.stdout: "time": "2023-08-01T19:55:05.570093+0000", 2023-08-01T19:55:45.670 INFO:teuthology.orchestra.run.smithi155.stdout: "duration": 9.5768999999999997e-05 2023-08-01T19:55:45.670 INFO:teuthology.orchestra.run.smithi155.stdout: }, 2023-08-01T19:55:45.671 INFO:teuthology.orchestra.run.smithi155.stdout: { 2023-08-01T19:55:45.671 INFO:teuthology.orchestra.run.smithi155.stdout: "event": "op_commit", 2023-08-01T19:55:45.671 INFO:teuthology.orchestra.run.smithi155.stdout: "time": "2023-08-01T19:55:05.572839+0000", 2023-08-01T19:55:45.671 INFO:teuthology.orchestra.run.smithi155.stdout: "duration": 0.0027460050000000001 2023-08-01T19:55:45.671 INFO:teuthology.orchestra.run.smithi155.stdout: }, 2023-08-01T19:55:45.671 INFO:teuthology.orchestra.run.smithi155.stdout: { 2023-08-01T19:55:45.671 INFO:teuthology.orchestra.run.smithi155.stdout: "event": "sub_op_commit_rec", 2023-08-01T19:55:45.671 INFO:teuthology.orchestra.run.smithi155.stdout: "time": "2023-08-01T19:55:05.635114+0000", 2023-08-01T19:55:45.672 INFO:teuthology.orchestra.run.smithi155.stdout: "duration": 0.062274297999999999 2023-08-01T19:55:45.672 INFO:teuthology.orchestra.run.smithi155.stdout: }, 2023-08-01T19:55:45.672 INFO:teuthology.orchestra.run.smithi155.stdout: { 2023-08-01T19:55:45.672 INFO:teuthology.orchestra.run.smithi155.stdout: "event": "commit_sent", 2023-08-01T19:55:45.672 INFO:teuthology.orchestra.run.smithi155.stdout: "time": "2023-08-01T19:55:05.635143+0000", 2023-08-01T19:55:45.672 INFO:teuthology.orchestra.run.smithi155.stdout: "duration": 2.9430000000000001e-05 2023-08-01T19:55:45.672 INFO:teuthology.orchestra.run.smithi155.stdout: }, 2023-08-01T19:55:45.672 INFO:teuthology.orchestra.run.smithi155.stdout: { 2023-08-01T19:55:45.673 INFO:teuthology.orchestra.run.smithi155.stdout: "event": "done", 2023-08-01T19:55:45.673 INFO:teuthology.orchestra.run.smithi155.stdout: "time": "2023-08-01T19:55:05.635181+0000", 2023-08-01T19:55:45.673 INFO:teuthology.orchestra.run.smithi155.stdout: "duration": 3.8352000000000001e-05 2023-08-01T19:55:45.673 INFO:teuthology.orchestra.run.smithi155.stdout: } 2023-08-01T19:55:45.673 INFO:teuthology.orchestra.run.smithi155.stdout: ] 2023-08-01T19:55:45.673 INFO:teuthology.orchestra.run.smithi155.stdout: } 2023-08-01T19:55:45.673 INFO:teuthology.orchestra.run.smithi155.stdout: }, 2023-08-01T19:55:45.673 INFO:teuthology.orchestra.run.smithi155.stdout: { 2023-08-01T19:55:45.674 INFO:teuthology.orchestra.run.smithi155.stdout: "description": "osd_op(client.4668.0:100944 5.4 5:25fae865:::benchmark_data_smithi006_114134_object100943:head [set-alloc-hint object_size 65536 write_size 65536,write 0~65536] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e37)", 2023-08-01T19:55:45.674 INFO:teuthology.orchestra.run.smithi155.stdout: "initiated_at": "2023-08-01T19:55:05.576662+0000", 2023-08-01T19:55:45.674 INFO:teuthology.orchestra.run.smithi155.stdout: "age": 39.92448203, 2023-08-01T19:55:45.674 INFO:teuthology.orchestra.run.smithi155.stdout: "duration": 0.056054925999999998, 2023-08-01T19:55:45.674 INFO:teuthology.orchestra.run.smithi155.stdout: "type_data": { 2023-08-01T19:55:45.674 INFO:teuthology.orchestra.run.smithi155.stdout: "flag_point": "commit sent; apply or cleanup", 2023-08-01T19:55:45.674 INFO:teuthology.orchestra.run.smithi155.stdout: "client_info": { 2023-08-01T19:55:45.675 INFO:teuthology.orchestra.run.smithi155.stdout: "client": "client.4668", 2023-08-01T19:55:45.675 INFO:teuthology.orchestra.run.smithi155.stdout: "client_addr": "172.21.15.6:0/1709472247", 2023-08-01T19:55:45.675 INFO:teuthology.orchestra.run.smithi155.stdout: "tid": 100944 2023-08-01T19:55:45.675 INFO:teuthology.orchestra.run.smithi155.stdout: }, 2023-08-01T19:55:45.675 INFO:teuthology.orchestra.run.smithi155.stdout: "events": [ 2023-08-01T19:55:45.675 INFO:teuthology.orchestra.run.smithi155.stdout: { 2023-08-01T19:55:45.675 INFO:teuthology.orchestra.run.smithi155.stdout: "event": "initiated", 2023-08-01T19:55:45.675 INFO:teuthology.orchestra.run.smithi155.stdout: "time": "2023-08-01T19:55:05.576662+0000", 2023-08-01T19:55:45.676 INFO:teuthology.orchestra.run.smithi155.stdout: "duration": 0 2023-08-01T19:55:45.676 INFO:teuthology.orchestra.run.smithi155.stdout: }, 2023-08-01T19:55:45.676 INFO:teuthology.orchestra.run.smithi155.stdout: { 2023-08-01T19:55:45.676 INFO:teuthology.orchestra.run.smithi155.stdout: "event": "throttled", 2023-08-01T19:55:45.676 INFO:teuthology.orchestra.run.smithi155.stdout: "time": "2023-08-01T19:55:05.576662+0000", 2023-08-01T19:55:45.676 INFO:teuthology.orchestra.run.smithi155.stdout: "duration": 0 2023-08-01T19:55:45.676 INFO:teuthology.orchestra.run.smithi155.stdout: }, 2023-08-01T19:55:45.677 INFO:teuthology.orchestra.run.smithi155.stdout: { 2023-08-01T19:55:45.677 INFO:teuthology.orchestra.run.smithi155.stdout: "event": "header_read", 2023-08-01T19:55:45.677 INFO:teuthology.orchestra.run.smithi155.stdout: "time": "2023-08-01T19:55:05.576661+0000", 2023-08-01T19:55:45.677 INFO:teuthology.orchestra.run.smithi155.stdout: "duration": 4294967295.999999 2023-08-01T19:55:45.677 INFO:teuthology.orchestra.run.smithi155.stdout: }, 2023-08-01T19:55:45.677 INFO:teuthology.orchestra.run.smithi155.stdout: { 2023-08-01T19:55:45.677 INFO:teuthology.orchestra.run.smithi155.stdout: "event": "all_read", 2023-08-01T19:55:45.677 INFO:teuthology.orchestra.run.smithi155.stdout: "time": "2023-08-01T19:55:05.576725+0000", 2023-08-01T19:55:45.678 INFO:teuthology.orchestra.run.smithi155.stdout: "duration": 6.4435000000000002e-05 2023-08-01T19:55:45.678 INFO:teuthology.orchestra.run.smithi155.stdout: }, 2023-08-01T19:55:45.678 INFO:teuthology.orchestra.run.smithi155.stdout: { 2023-08-01T19:55:45.678 INFO:teuthology.orchestra.run.smithi155.stdout: "event": "dispatched", 2023-08-01T19:55:45.678 INFO:teuthology.orchestra.run.smithi155.stdout: "time": "2023-08-01T19:55:05.576744+0000", 2023-08-01T19:55:45.678 INFO:teuthology.orchestra.run.smithi155.stdout: "duration": 1.8502999999999999e-05 2023-08-01T19:55:45.678 INFO:teuthology.orchestra.run.smithi155.stdout: }, 2023-08-01T19:55:45.678 INFO:teuthology.orchestra.run.smithi155.stdout: { 2023-08-01T19:55:45.679 INFO:teuthology.orchestra.run.smithi155.stdout: "event": "queued_for_pg", 2023-08-01T19:55:45.679 INFO:teuthology.orchestra.run.smithi155.stdout: "time": "2023-08-01T19:55:05.576772+0000", 2023-08-01T19:55:45.679 INFO:teuthology.orchestra.run.smithi155.stdout: "duration": 2.8354999999999999e-05 2023-08-01T19:55:45.679 INFO:teuthology.orchestra.run.smithi155.stdout: }, 2023-08-01T19:55:45.679 INFO:teuthology.orchestra.run.smithi155.stdout: { 2023-08-01T19:55:45.679 INFO:teuthology.orchestra.run.smithi155.stdout: "event": "reached_pg", 2023-08-01T19:55:45.679 INFO:teuthology.orchestra.run.smithi155.stdout: "time": "2023-08-01T19:55:05.576815+0000", 2023-08-01T19:55:45.679 INFO:teuthology.orchestra.run.smithi155.stdout: "duration": 4.3223999999999998e-05 2023-08-01T19:55:45.680 INFO:teuthology.orchestra.run.smithi155.stdout: }, 2023-08-01T19:55:45.680 INFO:teuthology.orchestra.run.smithi155.stdout: { 2023-08-01T19:55:45.680 INFO:teuthology.orchestra.run.smithi155.stdout: "event": "started", 2023-08-01T19:55:45.680 INFO:teuthology.orchestra.run.smithi155.stdout: "time": "2023-08-01T19:55:05.576961+0000", 2023-08-01T19:55:45.680 INFO:teuthology.orchestra.run.smithi155.stdout: "duration": 0.000145043 2023-08-01T19:55:45.680 INFO:teuthology.orchestra.run.smithi155.stdout: }, 2023-08-01T19:55:45.680 INFO:teuthology.orchestra.run.smithi155.stdout: { 2023-08-01T19:55:45.681 INFO:teuthology.orchestra.run.smithi155.stdout: "event": "waiting for subops from 0", 2023-08-01T19:55:45.681 INFO:teuthology.orchestra.run.smithi155.stdout: "time": "2023-08-01T19:55:05.577343+0000", 2023-08-01T19:55:45.681 INFO:teuthology.orchestra.run.smithi155.stdout: "duration": 0.00038249699999999998 2023-08-01T19:55:45.681 INFO:teuthology.orchestra.run.smithi155.stdout: }, 2023-08-01T19:55:45.681 INFO:teuthology.orchestra.run.smithi155.stdout: { 2023-08-01T19:55:45.681 INFO:teuthology.orchestra.run.smithi155.stdout: "event": "op_commit", 2023-08-01T19:55:45.681 INFO:teuthology.orchestra.run.smithi155.stdout: "time": "2023-08-01T19:55:05.582349+0000", 2023-08-01T19:55:45.681 INFO:teuthology.orchestra.run.smithi155.stdout: "duration": 0.0050062880000000002 2023-08-01T19:55:45.682 INFO:teuthology.orchestra.run.smithi155.stdout: }, 2023-08-01T19:55:45.682 INFO:teuthology.orchestra.run.smithi155.stdout: { 2023-08-01T19:55:45.682 INFO:teuthology.orchestra.run.smithi155.stdout: "event": "sub_op_commit_rec", 2023-08-01T19:55:45.682 INFO:teuthology.orchestra.run.smithi155.stdout: "time": "2023-08-01T19:55:05.632659+0000", 2023-08-01T19:55:45.682 INFO:teuthology.orchestra.run.smithi155.stdout: "duration": 0.050309185999999999 2023-08-01T19:55:45.682 INFO:teuthology.orchestra.run.smithi155.stdout: }, 2023-08-01T19:55:45.682 INFO:teuthology.orchestra.run.smithi155.stdout: { 2023-08-01T19:55:45.682 INFO:teuthology.orchestra.run.smithi155.stdout: "event": "commit_sent", 2023-08-01T19:55:45.683 INFO:teuthology.orchestra.run.smithi155.stdout: "time": "2023-08-01T19:55:05.632692+0000", 2023-08-01T19:55:45.683 INFO:teuthology.orchestra.run.smithi155.stdout: "duration": 3.3077999999999997e-05 2023-08-01T19:55:45.683 INFO:teuthology.orchestra.run.smithi155.stdout: }, 2023-08-01T19:55:45.683 INFO:teuthology.orchestra.run.smithi155.stdout: { 2023-08-01T19:55:45.683 INFO:teuthology.orchestra.run.smithi155.stdout: "event": "done", 2023-08-01T19:55:45.683 INFO:teuthology.orchestra.run.smithi155.stdout: "time": "2023-08-01T19:55:05.632717+0000", 2023-08-01T19:55:45.683 INFO:teuthology.orchestra.run.smithi155.stdout: "duration": 2.5119000000000001e-05 2023-08-01T19:55:45.683 INFO:teuthology.orchestra.run.smithi155.stdout: } 2023-08-01T19:55:45.684 INFO:teuthology.orchestra.run.smithi155.stdout: ] 2023-08-01T19:55:45.684 INFO:teuthology.orchestra.run.smithi155.stdout: } 2023-08-01T19:55:45.684 INFO:teuthology.orchestra.run.smithi155.stdout: }, 2023-08-01T19:55:45.684 INFO:teuthology.orchestra.run.smithi155.stdout: { 2023-08-01T19:55:45.684 INFO:teuthology.orchestra.run.smithi155.stdout: "description": "osd_op(client.4668.0:100945 5.e 5:73df68dd:::benchmark_data_smithi006_114134_object100944:head [set-alloc-hint object_size 65536 write_size 65536,write 0~65536] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e37)", 2023-08-01T19:55:45.684 INFO:teuthology.orchestra.run.smithi155.stdout: "initiated_at": "2023-08-01T19:55:05.576784+0000", 2023-08-01T19:55:45.684 INFO:teuthology.orchestra.run.smithi155.stdout: "age": 39.924360141999998, 2023-08-01T19:55:45.684 INFO:teuthology.orchestra.run.smithi155.stdout: "duration": 0.058512994999999998, 2023-08-01T19:55:45.685 INFO:teuthology.orchestra.run.smithi155.stdout: "type_data": { 2023-08-01T19:55:45.685 INFO:teuthology.orchestra.run.smithi155.stdout: "flag_point": "commit sent; apply or cleanup", 2023-08-01T19:55:45.685 INFO:teuthology.orchestra.run.smithi155.stdout: "client_info": { 2023-08-01T19:55:45.685 INFO:teuthology.orchestra.run.smithi155.stdout: "client": "client.4668", 2023-08-01T19:55:45.685 INFO:teuthology.orchestra.run.smithi155.stdout: "client_addr": "172.21.15.6:0/1709472247", 2023-08-01T19:55:45.685 INFO:teuthology.orchestra.run.smithi155.stdout: "tid": 100945 2023-08-01T19:55:45.685 INFO:teuthology.orchestra.run.smithi155.stdout: }, 2023-08-01T19:55:45.685 INFO:teuthology.orchestra.run.smithi155.stdout: "events": [ 2023-08-01T19:55:45.686 INFO:teuthology.orchestra.run.smithi155.stdout: { 2023-08-01T19:55:45.686 INFO:teuthology.orchestra.run.smithi155.stdout: "event": "initiated", 2023-08-01T19:55:45.686 INFO:teuthology.orchestra.run.smithi155.stdout: "time": "2023-08-01T19:55:05.576784+0000", 2023-08-01T19:55:45.686 INFO:teuthology.orchestra.run.smithi155.stdout: "duration": 0 2023-08-01T19:55:45.686 INFO:teuthology.orchestra.run.smithi155.stdout: }, 2023-08-01T19:55:45.686 INFO:teuthology.orchestra.run.smithi155.stdout: { 2023-08-01T19:55:45.686 INFO:teuthology.orchestra.run.smithi155.stdout: "event": "throttled", 2023-08-01T19:55:45.686 INFO:teuthology.orchestra.run.smithi155.stdout: "time": "2023-08-01T19:55:05.576784+0000", 2023-08-01T19:55:45.687 INFO:teuthology.orchestra.run.smithi155.stdout: "duration": 0 2023-08-01T19:55:45.687 INFO:teuthology.orchestra.run.smithi155.stdout: }, 2023-08-01T19:55:45.687 INFO:teuthology.orchestra.run.smithi155.stdout: { 2023-08-01T19:55:45.687 INFO:teuthology.orchestra.run.smithi155.stdout: "event": "header_read", 2023-08-01T19:55:45.687 INFO:teuthology.orchestra.run.smithi155.stdout: "time": "2023-08-01T19:55:05.576783+0000", 2023-08-01T19:55:45.687 INFO:teuthology.orchestra.run.smithi155.stdout: "duration": 4294967295.9999995 2023-08-01T19:55:45.687 INFO:teuthology.orchestra.run.smithi155.stdout: }, 2023-08-01T19:55:45.687 INFO:teuthology.orchestra.run.smithi155.stdout: { 2023-08-01T19:55:45.688 INFO:teuthology.orchestra.run.smithi155.stdout: "event": "all_read", 2023-08-01T19:55:45.688 INFO:teuthology.orchestra.run.smithi155.stdout: "time": "2023-08-01T19:55:05.576807+0000", 2023-08-01T19:55:45.688 INFO:teuthology.orchestra.run.smithi155.stdout: "duration": 2.3651000000000001e-05 2023-08-01T19:55:45.688 INFO:teuthology.orchestra.run.smithi155.stdout: }, 2023-08-01T19:55:45.688 INFO:teuthology.orchestra.run.smithi155.stdout: { 2023-08-01T19:55:45.688 INFO:teuthology.orchestra.run.smithi155.stdout: "event": "dispatched", 2023-08-01T19:55:45.689 INFO:teuthology.orchestra.run.smithi155.stdout: "time": "2023-08-01T19:55:05.576817+0000", 2023-08-01T19:55:45.689 INFO:teuthology.orchestra.run.smithi155.stdout: "duration": 9.9389999999999992e-06 2023-08-01T19:55:45.689 INFO:teuthology.orchestra.run.smithi155.stdout: }, 2023-08-01T19:55:45.689 INFO:teuthology.orchestra.run.smithi155.stdout: { 2023-08-01T19:55:45.689 INFO:teuthology.orchestra.run.smithi155.stdout: "event": "queued_for_pg", 2023-08-01T19:55:45.690 INFO:teuthology.orchestra.run.smithi155.stdout: "time": "2023-08-01T19:55:05.576820+0000", 2023-08-01T19:55:45.690 INFO:teuthology.orchestra.run.smithi155.stdout: "duration": 3.2619999999999999e-06 2023-08-01T19:55:45.690 INFO:teuthology.orchestra.run.smithi155.stdout: }, 2023-08-01T19:55:45.690 INFO:teuthology.orchestra.run.smithi155.stdout: { 2023-08-01T19:55:45.690 INFO:teuthology.orchestra.run.smithi155.stdout: "event": "reached_pg", 2023-08-01T19:55:45.690 INFO:teuthology.orchestra.run.smithi155.stdout: "time": "2023-08-01T19:55:05.576849+0000", 2023-08-01T19:55:45.690 INFO:teuthology.orchestra.run.smithi155.stdout: "duration": 2.8880000000000001e-05 2023-08-01T19:55:45.691 INFO:teuthology.orchestra.run.smithi155.stdout: }, 2023-08-01T19:55:45.691 INFO:teuthology.orchestra.run.smithi155.stdout: { 2023-08-01T19:55:45.691 INFO:teuthology.orchestra.run.smithi155.stdout: "event": "started", 2023-08-01T19:55:45.691 INFO:teuthology.orchestra.run.smithi155.stdout: "time": "2023-08-01T19:55:05.576940+0000", 2023-08-01T19:55:45.692 INFO:teuthology.orchestra.run.smithi155.stdout: "duration": 9.0570999999999997e-05 2023-08-01T19:55:45.692 INFO:teuthology.orchestra.run.smithi155.stdout: }, 2023-08-01T19:55:45.692 INFO:teuthology.orchestra.run.smithi155.stdout: { 2023-08-01T19:55:45.693 INFO:teuthology.orchestra.run.smithi155.stdout: "event": "waiting for subops from 0", 2023-08-01T19:55:45.693 INFO:teuthology.orchestra.run.smithi155.stdout: "time": "2023-08-01T19:55:05.577027+0000", 2023-08-01T19:55:45.693 INFO:teuthology.orchestra.run.smithi155.stdout: "duration": 8.7237999999999994e-05 2023-08-01T19:55:45.693 INFO:teuthology.orchestra.run.smithi155.stdout: }, 2023-08-01T19:55:45.693 INFO:teuthology.orchestra.run.smithi155.stdout: { 2023-08-01T19:55:45.694 INFO:teuthology.orchestra.run.smithi155.stdout: "event": "op_commit", 2023-08-01T19:55:45.694 INFO:teuthology.orchestra.run.smithi155.stdout: "time": "2023-08-01T19:55:05.579624+0000", 2023-08-01T19:55:45.694 INFO:teuthology.orchestra.run.smithi155.stdout: "duration": 0.0025971200000000001 2023-08-01T19:55:45.694 INFO:teuthology.orchestra.run.smithi155.stdout: }, 2023-08-01T19:55:45.694 INFO:teuthology.orchestra.run.smithi155.stdout: { 2023-08-01T19:55:45.694 INFO:teuthology.orchestra.run.smithi155.stdout: "event": "sub_op_commit_rec", 2023-08-01T19:55:45.695 INFO:teuthology.orchestra.run.smithi155.stdout: "time": "2023-08-01T19:55:05.635218+0000", 2023-08-01T19:55:45.695 INFO:teuthology.orchestra.run.smithi155.stdout: "duration": 0.055594487999999997 2023-08-01T19:55:45.695 INFO:teuthology.orchestra.run.smithi155.stdout: }, 2023-08-01T19:55:45.695 INFO:teuthology.orchestra.run.smithi155.stdout: { 2023-08-01T19:55:45.695 INFO:teuthology.orchestra.run.smithi155.stdout: "event": "commit_sent", 2023-08-01T19:55:45.695 INFO:teuthology.orchestra.run.smithi155.stdout: "time": "2023-08-01T19:55:05.635262+0000", 2023-08-01T19:55:45.696 INFO:teuthology.orchestra.run.smithi155.stdout: "duration": 4.3380999999999997e-05 2023-08-01T19:55:45.696 INFO:teuthology.orchestra.run.smithi155.stdout: }, 2023-08-01T19:55:45.696 INFO:teuthology.orchestra.run.smithi155.stdout: { 2023-08-01T19:55:45.696 INFO:teuthology.orchestra.run.smithi155.stdout: "event": "done", 2023-08-01T19:55:45.696 INFO:teuthology.orchestra.run.smithi155.stdout: "time": "2023-08-01T19:55:05.635297+0000", 2023-08-01T19:55:45.696 INFO:teuthology.orchestra.run.smithi155.stdout: "duration": 3.4842000000000003e-05 2023-08-01T19:55:45.696 INFO:teuthology.orchestra.run.smithi155.stdout: } 2023-08-01T19:55:45.697 INFO:teuthology.orchestra.run.smithi155.stdout: ] 2023-08-01T19:55:45.697 INFO:teuthology.orchestra.run.smithi155.stdout: } 2023-08-01T19:55:45.697 INFO:teuthology.orchestra.run.smithi155.stdout: }, 2023-08-01T19:55:45.697 INFO:teuthology.orchestra.run.smithi155.stdout: { 2023-08-01T19:55:45.697 INFO:teuthology.orchestra.run.smithi155.stdout: "description": "osd_op(client.4668.0:100947 5.4 5:23e8fc27:::benchmark_data_smithi006_114134_object100946:head [set-alloc-hint object_size 65536 write_size 65536,write 0~65536] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e37)", 2023-08-01T19:55:45.697 INFO:teuthology.orchestra.run.smithi155.stdout: "initiated_at": "2023-08-01T19:55:05.576840+0000", 2023-08-01T19:55:45.697 INFO:teuthology.orchestra.run.smithi155.stdout: "age": 39.924304087000003, 2023-08-01T19:55:45.697 INFO:teuthology.orchestra.run.smithi155.stdout: "duration": 0.058423127999999998, 2023-08-01T19:55:45.698 INFO:teuthology.orchestra.run.smithi155.stdout: "type_data": { 2023-08-01T19:55:45.698 INFO:teuthology.orchestra.run.smithi155.stdout: "flag_point": "commit sent; apply or cleanup", 2023-08-01T19:55:45.698 INFO:teuthology.orchestra.run.smithi155.stdout: "client_info": { 2023-08-01T19:55:45.698 INFO:teuthology.orchestra.run.smithi155.stdout: "client": "client.4668", 2023-08-01T19:55:45.698 INFO:teuthology.orchestra.run.smithi155.stdout: "client_addr": "172.21.15.6:0/1709472247", 2023-08-01T19:55:45.698 INFO:teuthology.orchestra.run.smithi155.stdout: "tid": 100947 2023-08-01T19:55:45.698 INFO:teuthology.orchestra.run.smithi155.stdout: }, 2023-08-01T19:55:45.698 INFO:teuthology.orchestra.run.smithi155.stdout: "events": [ 2023-08-01T19:55:45.699 INFO:teuthology.orchestra.run.smithi155.stdout: { 2023-08-01T19:55:45.699 INFO:teuthology.orchestra.run.smithi155.stdout: "event": "initiated", 2023-08-01T19:55:45.699 INFO:teuthology.orchestra.run.smithi155.stdout: "time": "2023-08-01T19:55:05.576840+0000", 2023-08-01T19:55:45.699 INFO:teuthology.orchestra.run.smithi155.stdout: "duration": 0 2023-08-01T19:55:45.699 INFO:teuthology.orchestra.run.smithi155.stdout: }, 2023-08-01T19:55:45.699 INFO:teuthology.orchestra.run.smithi155.stdout: { 2023-08-01T19:55:45.699 INFO:teuthology.orchestra.run.smithi155.stdout: "event": "throttled", 2023-08-01T19:55:45.699 INFO:teuthology.orchestra.run.smithi155.stdout: "time": "2023-08-01T19:55:05.576840+0000", 2023-08-01T19:55:45.700 INFO:teuthology.orchestra.run.smithi155.stdout: "duration": 0 2023-08-01T19:55:45.700 INFO:teuthology.orchestra.run.smithi155.stdout: }, 2023-08-01T19:55:45.700 INFO:teuthology.orchestra.run.smithi155.stdout: { 2023-08-01T19:55:45.700 INFO:teuthology.orchestra.run.smithi155.stdout: "event": "header_read", 2023-08-01T19:55:45.700 INFO:teuthology.orchestra.run.smithi155.stdout: "time": "2023-08-01T19:55:05.576839+0000", 2023-08-01T19:55:45.700 INFO:teuthology.orchestra.run.smithi155.stdout: "duration": 4294967295.9999995 2023-08-01T19:55:45.700 INFO:teuthology.orchestra.run.smithi155.stdout: }, 2023-08-01T19:55:45.701 INFO:teuthology.orchestra.run.smithi155.stdout: { 2023-08-01T19:55:45.701 INFO:teuthology.orchestra.run.smithi155.stdout: "event": "all_read", 2023-08-01T19:55:45.701 INFO:teuthology.orchestra.run.smithi155.stdout: "time": "2023-08-01T19:55:05.576893+0000", 2023-08-01T19:55:45.701 INFO:teuthology.orchestra.run.smithi155.stdout: "duration": 5.3893000000000001e-05 2023-08-01T19:55:45.701 INFO:teuthology.orchestra.run.smithi155.stdout: }, 2023-08-01T19:55:45.701 INFO:teuthology.orchestra.run.smithi155.stdout: { 2023-08-01T19:55:45.701 INFO:teuthology.orchestra.run.smithi155.stdout: "event": "dispatched", 2023-08-01T19:55:45.701 INFO:teuthology.orchestra.run.smithi155.stdout: "time": "2023-08-01T19:55:05.576902+0000", 2023-08-01T19:55:45.702 INFO:teuthology.orchestra.run.smithi155.stdout: "duration": 8.7520000000000002e-06 2023-08-01T19:55:45.702 INFO:teuthology.orchestra.run.smithi155.stdout: }, 2023-08-01T19:55:45.702 INFO:teuthology.orchestra.run.smithi155.stdout: { 2023-08-01T19:55:45.702 INFO:teuthology.orchestra.run.smithi155.stdout: "event": "queued_for_pg", 2023-08-01T19:55:45.702 INFO:teuthology.orchestra.run.smithi155.stdout: "time": "2023-08-01T19:55:05.576905+0000", 2023-08-01T19:55:45.702 INFO:teuthology.orchestra.run.smithi155.stdout: "duration": 3.01e-06 2023-08-01T19:55:45.702 INFO:teuthology.orchestra.run.smithi155.stdout: }, 2023-08-01T19:55:45.702 INFO:teuthology.orchestra.run.smithi155.stdout: { 2023-08-01T19:55:45.703 INFO:teuthology.orchestra.run.smithi155.stdout: "event": "reached_pg", 2023-08-01T19:55:45.703 INFO:teuthology.orchestra.run.smithi155.stdout: "time": "2023-08-01T19:55:05.579641+0000", 2023-08-01T19:55:45.703 INFO:teuthology.orchestra.run.smithi155.stdout: "duration": 0.0027366880000000001 2023-08-01T19:55:45.703 INFO:teuthology.orchestra.run.smithi155.stdout: }, 2023-08-01T19:55:45.703 INFO:teuthology.orchestra.run.smithi155.stdout: { 2023-08-01T19:55:45.703 INFO:teuthology.orchestra.run.smithi155.stdout: "event": "started", 2023-08-01T19:55:45.703 INFO:teuthology.orchestra.run.smithi155.stdout: "time": "2023-08-01T19:55:05.579734+0000", 2023-08-01T19:55:45.703 INFO:teuthology.orchestra.run.smithi155.stdout: "duration": 9.2590000000000006e-05 2023-08-01T19:55:45.704 INFO:teuthology.orchestra.run.smithi155.stdout: }, 2023-08-01T19:55:45.704 INFO:teuthology.orchestra.run.smithi155.stdout: { 2023-08-01T19:55:45.704 INFO:teuthology.orchestra.run.smithi155.stdout: "event": "waiting for subops from 0", 2023-08-01T19:55:45.704 INFO:teuthology.orchestra.run.smithi155.stdout: "time": "2023-08-01T19:55:05.579825+0000", 2023-08-01T19:55:45.704 INFO:teuthology.orchestra.run.smithi155.stdout: "duration": 9.0964999999999994e-05 2023-08-01T19:55:45.704 INFO:teuthology.orchestra.run.smithi155.stdout: }, 2023-08-01T19:55:45.704 INFO:teuthology.orchestra.run.smithi155.stdout: { 2023-08-01T19:55:45.704 INFO:teuthology.orchestra.run.smithi155.stdout: "event": "op_commit", 2023-08-01T19:55:45.705 INFO:teuthology.orchestra.run.smithi155.stdout: "time": "2023-08-01T19:55:05.585041+0000", 2023-08-01T19:55:45.705 INFO:teuthology.orchestra.run.smithi155.stdout: "duration": 0.0052159670000000002 2023-08-01T19:55:45.705 INFO:teuthology.orchestra.run.smithi155.stdout: }, 2023-08-01T19:55:45.705 INFO:teuthology.orchestra.run.smithi155.stdout: { 2023-08-01T19:55:45.705 INFO:teuthology.orchestra.run.smithi155.stdout: "event": "sub_op_commit_rec", 2023-08-01T19:55:45.705 INFO:teuthology.orchestra.run.smithi155.stdout: "time": "2023-08-01T19:55:05.635199+0000", 2023-08-01T19:55:45.705 INFO:teuthology.orchestra.run.smithi155.stdout: "duration": 0.050158023000000003 2023-08-01T19:55:45.706 INFO:teuthology.orchestra.run.smithi155.stdout: }, 2023-08-01T19:55:45.706 INFO:teuthology.orchestra.run.smithi155.stdout: { 2023-08-01T19:55:45.706 INFO:teuthology.orchestra.run.smithi155.stdout: "event": "commit_sent", 2023-08-01T19:55:45.706 INFO:teuthology.orchestra.run.smithi155.stdout: "time": "2023-08-01T19:55:05.635227+0000", 2023-08-01T19:55:45.706 INFO:teuthology.orchestra.run.smithi155.stdout: "duration": 2.7821e-05 2023-08-01T19:55:45.706 INFO:teuthology.orchestra.run.smithi155.stdout: }, 2023-08-01T19:55:45.706 INFO:teuthology.orchestra.run.smithi155.stdout: { 2023-08-01T19:55:45.706 INFO:teuthology.orchestra.run.smithi155.stdout: "event": "done", 2023-08-01T19:55:45.707 INFO:teuthology.orchestra.run.smithi155.stdout: "time": "2023-08-01T19:55:05.635263+0000", 2023-08-01T19:55:45.707 INFO:teuthology.orchestra.run.smithi155.stdout: "duration": 3.6081000000000002e-05 2023-08-01T19:55:45.707 INFO:teuthology.orchestra.run.smithi155.stdout: } 2023-08-01T19:55:45.707 INFO:teuthology.orchestra.run.smithi155.stdout: ] 2023-08-01T19:55:45.707 INFO:teuthology.orchestra.run.smithi155.stdout: } 2023-08-01T19:55:45.707 INFO:teuthology.orchestra.run.smithi155.stdout: } 2023-08-01T19:55:45.707 INFO:teuthology.orchestra.run.smithi155.stdout: ] 2023-08-01T19:55:45.707 INFO:teuthology.orchestra.run.smithi155.stdout:} 2023-08-01T19:55:45.709 INFO:tasks.ceph.osd.2.smithi155.stderr:2023-08-01T19:55:45.707+0000 7faa5c6ac700 -1 received signal: Hangup from /usr/bin/python3 /bin/daemon-helper kill ceph-osd -f --cluster ceph -i 2 (PID: 111337) UID: 0 2023-08-01T19:55:45.709 DEBUG:teuthology.orchestra.run.smithi008:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 30 ceph --cluster ceph --admin-daemon /var/run/ceph/ceph-osd.0.asok dump_ops_in_flight 2023-08-01T19:55:45.809 INFO:tasks.ceph.osd.2.smithi155.stderr:2023-08-01T19:55:45.807+0000 7faa5c6ac700 -1 received signal: Hangup from /usr/bin/python3 /bin/daemon-helper kill ceph-osd -f --cluster ceph -i 2 (PID: 111337) UID: 0 2023-08-01T19:55:45.900 INFO:teuthology.orchestra.run.smithi008.stdout:{ 2023-08-01T19:55:45.900 INFO:teuthology.orchestra.run.smithi008.stdout: "ops": [ 2023-08-01T19:55:45.900 INFO:teuthology.orchestra.run.smithi008.stdout: { 2023-08-01T19:55:45.901 INFO:teuthology.orchestra.run.smithi008.stdout: "description": "osd_repop(client.4668.0:173558 5.0 e54/19 5:03caa219:::benchmark_data_smithi006_114134_object39897:head v 54'11019, mlcod=54'11017)", 2023-08-01T19:55:45.901 INFO:teuthology.orchestra.run.smithi008.stdout: "initiated_at": "2023-08-01T19:55:45.890852+0000", 2023-08-01T19:55:45.901 INFO:teuthology.orchestra.run.smithi008.stdout: "age": 0.007246761, 2023-08-01T19:55:45.901 INFO:teuthology.orchestra.run.smithi008.stdout: "duration": 0.007270355, 2023-08-01T19:55:45.901 INFO:teuthology.orchestra.run.smithi008.stdout: "type_data": { 2023-08-01T19:55:45.901 INFO:teuthology.orchestra.run.smithi008.stdout: "flag_point": "started", 2023-08-01T19:55:45.901 INFO:teuthology.orchestra.run.smithi008.stdout: "events": [ 2023-08-01T19:55:45.901 INFO:teuthology.orchestra.run.smithi008.stdout: { 2023-08-01T19:55:45.902 INFO:teuthology.orchestra.run.smithi008.stdout: "event": "initiated", 2023-08-01T19:55:45.902 INFO:teuthology.orchestra.run.smithi008.stdout: "time": "2023-08-01T19:55:45.890852+0000", 2023-08-01T19:55:45.902 INFO:teuthology.orchestra.run.smithi008.stdout: "duration": 0 2023-08-01T19:55:45.902 INFO:teuthology.orchestra.run.smithi008.stdout: }, 2023-08-01T19:55:45.902 INFO:teuthology.orchestra.run.smithi008.stdout: { 2023-08-01T19:55:45.902 INFO:teuthology.orchestra.run.smithi008.stdout: "event": "throttled", 2023-08-01T19:55:45.902 INFO:teuthology.orchestra.run.smithi008.stdout: "time": "2023-08-01T19:55:45.890852+0000", 2023-08-01T19:55:45.902 INFO:teuthology.orchestra.run.smithi008.stdout: "duration": 0 2023-08-01T19:55:45.903 INFO:teuthology.orchestra.run.smithi008.stdout: }, 2023-08-01T19:55:45.903 INFO:teuthology.orchestra.run.smithi008.stdout: { 2023-08-01T19:55:45.903 INFO:teuthology.orchestra.run.smithi008.stdout: "event": "header_read", 2023-08-01T19:55:45.903 INFO:teuthology.orchestra.run.smithi008.stdout: "time": "2023-08-01T19:55:45.890851+0000", 2023-08-01T19:55:45.903 INFO:teuthology.orchestra.run.smithi008.stdout: "duration": 4294967295.9999995 2023-08-01T19:55:45.903 INFO:teuthology.orchestra.run.smithi008.stdout: }, 2023-08-01T19:55:45.903 INFO:teuthology.orchestra.run.smithi008.stdout: { 2023-08-01T19:55:45.904 INFO:teuthology.orchestra.run.smithi008.stdout: "event": "all_read", 2023-08-01T19:55:45.904 INFO:teuthology.orchestra.run.smithi008.stdout: "time": "2023-08-01T19:55:45.890857+0000", 2023-08-01T19:55:45.904 INFO:teuthology.orchestra.run.smithi008.stdout: "duration": 5.6919999999999999e-06 2023-08-01T19:55:45.904 INFO:teuthology.orchestra.run.smithi008.stdout: }, 2023-08-01T19:55:45.904 INFO:teuthology.orchestra.run.smithi008.stdout: { 2023-08-01T19:55:45.904 INFO:teuthology.orchestra.run.smithi008.stdout: "event": "dispatched", 2023-08-01T19:55:45.904 INFO:teuthology.orchestra.run.smithi008.stdout: "time": "2023-08-01T19:55:45.890868+0000", 2023-08-01T19:55:45.904 INFO:teuthology.orchestra.run.smithi008.stdout: "duration": 1.133e-05 2023-08-01T19:55:45.905 INFO:teuthology.orchestra.run.smithi008.stdout: }, 2023-08-01T19:55:45.905 INFO:teuthology.orchestra.run.smithi008.stdout: { 2023-08-01T19:55:45.905 INFO:teuthology.orchestra.run.smithi008.stdout: "event": "queued_for_pg", 2023-08-01T19:55:45.905 INFO:teuthology.orchestra.run.smithi008.stdout: "time": "2023-08-01T19:55:45.890874+0000", 2023-08-01T19:55:45.905 INFO:teuthology.orchestra.run.smithi008.stdout: "duration": 5.5659999999999997e-06 2023-08-01T19:55:45.905 INFO:teuthology.orchestra.run.smithi008.stdout: }, 2023-08-01T19:55:45.905 INFO:teuthology.orchestra.run.smithi008.stdout: { 2023-08-01T19:55:45.905 INFO:teuthology.orchestra.run.smithi008.stdout: "event": "reached_pg", 2023-08-01T19:55:45.906 INFO:teuthology.orchestra.run.smithi008.stdout: "time": "2023-08-01T19:55:45.890906+0000", 2023-08-01T19:55:45.906 INFO:teuthology.orchestra.run.smithi008.stdout: "duration": 3.1702000000000002e-05 2023-08-01T19:55:45.906 INFO:teuthology.orchestra.run.smithi008.stdout: }, 2023-08-01T19:55:45.906 INFO:teuthology.orchestra.run.smithi008.stdout: { 2023-08-01T19:55:45.906 INFO:teuthology.orchestra.run.smithi008.stdout: "event": "started", 2023-08-01T19:55:45.906 INFO:teuthology.orchestra.run.smithi008.stdout: "time": "2023-08-01T19:55:45.890927+0000", 2023-08-01T19:55:45.906 INFO:teuthology.orchestra.run.smithi008.stdout: "duration": 2.1520000000000001e-05 2023-08-01T19:55:45.906 INFO:teuthology.orchestra.run.smithi008.stdout: } 2023-08-01T19:55:45.907 INFO:teuthology.orchestra.run.smithi008.stdout: ] 2023-08-01T19:55:45.907 INFO:teuthology.orchestra.run.smithi008.stdout: } 2023-08-01T19:55:45.907 INFO:teuthology.orchestra.run.smithi008.stdout: }, 2023-08-01T19:55:45.907 INFO:teuthology.orchestra.run.smithi008.stdout: { 2023-08-01T19:55:45.907 INFO:teuthology.orchestra.run.smithi008.stdout: "description": "osd_repop(client.4668.0:173556 5.4 e54/19 5:2ae2b303:::benchmark_data_smithi006_114134_object39895:head v 54'10725, mlcod=54'10723)", 2023-08-01T19:55:45.907 INFO:teuthology.orchestra.run.smithi008.stdout: "initiated_at": "2023-08-01T19:55:45.890930+0000", 2023-08-01T19:55:45.907 INFO:teuthology.orchestra.run.smithi008.stdout: "age": 0.0071683119999999996, 2023-08-01T19:55:45.908 INFO:teuthology.orchestra.run.smithi008.stdout: "duration": 0.0072636749999999998, 2023-08-01T19:55:45.908 INFO:teuthology.orchestra.run.smithi008.stdout: "type_data": { 2023-08-01T19:55:45.908 INFO:teuthology.orchestra.run.smithi008.stdout: "flag_point": "started", 2023-08-01T19:55:45.908 INFO:teuthology.orchestra.run.smithi008.stdout: "events": [ 2023-08-01T19:55:45.908 INFO:teuthology.orchestra.run.smithi008.stdout: { 2023-08-01T19:55:45.908 INFO:teuthology.orchestra.run.smithi008.stdout: "event": "initiated", 2023-08-01T19:55:45.908 INFO:teuthology.orchestra.run.smithi008.stdout: "time": "2023-08-01T19:55:45.890930+0000", 2023-08-01T19:55:45.909 INFO:teuthology.orchestra.run.smithi008.stdout: "duration": 0 2023-08-01T19:55:45.909 INFO:teuthology.orchestra.run.smithi008.stdout: }, 2023-08-01T19:55:45.909 INFO:teuthology.orchestra.run.smithi008.stdout: { 2023-08-01T19:55:45.909 INFO:teuthology.orchestra.run.smithi008.stdout: "event": "throttled", 2023-08-01T19:55:45.909 INFO:teuthology.orchestra.run.smithi008.stdout: "time": "2023-08-01T19:55:45.890930+0000", 2023-08-01T19:55:45.909 INFO:teuthology.orchestra.run.smithi008.stdout: "duration": 0 2023-08-01T19:55:45.909 INFO:teuthology.orchestra.run.smithi008.stdout: }, 2023-08-01T19:55:45.910 INFO:teuthology.orchestra.run.smithi008.stdout: { 2023-08-01T19:55:45.910 INFO:teuthology.orchestra.run.smithi008.stdout: "event": "header_read", 2023-08-01T19:55:45.910 INFO:teuthology.orchestra.run.smithi008.stdout: "time": "2023-08-01T19:55:45.890930+0000", 2023-08-01T19:55:45.910 INFO:teuthology.orchestra.run.smithi008.stdout: "duration": 4294967295.9999995 2023-08-01T19:55:45.910 INFO:teuthology.orchestra.run.smithi008.stdout: }, 2023-08-01T19:55:45.910 INFO:teuthology.orchestra.run.smithi008.stdout: { 2023-08-01T19:55:45.910 INFO:teuthology.orchestra.run.smithi008.stdout: "event": "all_read", 2023-08-01T19:55:45.910 INFO:teuthology.orchestra.run.smithi008.stdout: "time": "2023-08-01T19:55:45.890935+0000", 2023-08-01T19:55:45.911 INFO:teuthology.orchestra.run.smithi008.stdout: "duration": 4.9520000000000002e-06 2023-08-01T19:55:45.911 INFO:teuthology.orchestra.run.smithi008.stdout: }, 2023-08-01T19:55:45.911 INFO:teuthology.orchestra.run.smithi008.stdout: { 2023-08-01T19:55:45.911 INFO:teuthology.orchestra.run.smithi008.stdout: "event": "dispatched", 2023-08-01T19:55:45.911 INFO:teuthology.orchestra.run.smithi008.stdout: "time": "2023-08-01T19:55:45.890945+0000", 2023-08-01T19:55:45.911 INFO:teuthology.orchestra.run.smithi008.stdout: "duration": 9.9650000000000003e-06 2023-08-01T19:55:45.911 INFO:teuthology.orchestra.run.smithi008.stdout: }, 2023-08-01T19:55:45.911 INFO:teuthology.orchestra.run.smithi008.stdout: { 2023-08-01T19:55:45.912 INFO:teuthology.orchestra.run.smithi008.stdout: "event": "queued_for_pg", 2023-08-01T19:55:45.912 INFO:teuthology.orchestra.run.smithi008.stdout: "time": "2023-08-01T19:55:45.890950+0000", 2023-08-01T19:55:45.912 INFO:teuthology.orchestra.run.smithi008.stdout: "duration": 4.9949999999999996e-06 2023-08-01T19:55:45.912 INFO:teuthology.orchestra.run.smithi008.stdout: }, 2023-08-01T19:55:45.912 INFO:teuthology.orchestra.run.smithi008.stdout: { 2023-08-01T19:55:45.912 INFO:teuthology.orchestra.run.smithi008.stdout: "event": "reached_pg", 2023-08-01T19:55:45.912 INFO:teuthology.orchestra.run.smithi008.stdout: "time": "2023-08-01T19:55:45.891000+0000", 2023-08-01T19:55:45.912 INFO:teuthology.orchestra.run.smithi008.stdout: "duration": 5.0747e-05 2023-08-01T19:55:45.913 INFO:teuthology.orchestra.run.smithi008.stdout: }, 2023-08-01T19:55:45.913 INFO:teuthology.orchestra.run.smithi008.stdout: { 2023-08-01T19:55:45.913 INFO:teuthology.orchestra.run.smithi008.stdout: "event": "started", 2023-08-01T19:55:45.913 INFO:teuthology.orchestra.run.smithi008.stdout: "time": "2023-08-01T19:55:45.891020+0000", 2023-08-01T19:55:45.913 INFO:teuthology.orchestra.run.smithi008.stdout: "duration": 1.9289000000000001e-05 2023-08-01T19:55:45.913 INFO:teuthology.orchestra.run.smithi008.stdout: } 2023-08-01T19:55:45.913 INFO:teuthology.orchestra.run.smithi008.stdout: ] 2023-08-01T19:55:45.913 INFO:teuthology.orchestra.run.smithi008.stdout: } 2023-08-01T19:55:45.914 INFO:teuthology.orchestra.run.smithi008.stdout: }, 2023-08-01T19:55:45.914 INFO:teuthology.orchestra.run.smithi008.stdout: { 2023-08-01T19:55:45.914 INFO:teuthology.orchestra.run.smithi008.stdout: "description": "osd_repop(client.4668.0:173559 5.1 e54/53 5:8cfaf072:::benchmark_data_smithi006_114134_object39898:head v 54'10779, mlcod=54'10776)", 2023-08-01T19:55:45.914 INFO:teuthology.orchestra.run.smithi008.stdout: "initiated_at": "2023-08-01T19:55:45.890968+0000", 2023-08-01T19:55:45.914 INFO:teuthology.orchestra.run.smithi008.stdout: "age": 0.0071304790000000003, 2023-08-01T19:55:45.914 INFO:teuthology.orchestra.run.smithi008.stdout: "duration": 0.0072897680000000003, 2023-08-01T19:55:45.914 INFO:teuthology.orchestra.run.smithi008.stdout: "type_data": { 2023-08-01T19:55:45.914 INFO:teuthology.orchestra.run.smithi008.stdout: "flag_point": "started", 2023-08-01T19:55:45.915 INFO:teuthology.orchestra.run.smithi008.stdout: "events": [ 2023-08-01T19:55:45.915 INFO:teuthology.orchestra.run.smithi008.stdout: { 2023-08-01T19:55:45.915 INFO:teuthology.orchestra.run.smithi008.stdout: "event": "initiated", 2023-08-01T19:55:45.915 INFO:teuthology.orchestra.run.smithi008.stdout: "time": "2023-08-01T19:55:45.890968+0000", 2023-08-01T19:55:45.915 INFO:teuthology.orchestra.run.smithi008.stdout: "duration": 0 2023-08-01T19:55:45.915 INFO:teuthology.orchestra.run.smithi008.stdout: }, 2023-08-01T19:55:45.915 INFO:teuthology.orchestra.run.smithi008.stdout: { 2023-08-01T19:55:45.915 INFO:teuthology.orchestra.run.smithi008.stdout: "event": "throttled", 2023-08-01T19:55:45.916 INFO:teuthology.orchestra.run.smithi008.stdout: "time": "2023-08-01T19:55:45.890968+0000", 2023-08-01T19:55:45.916 INFO:teuthology.orchestra.run.smithi008.stdout: "duration": 0 2023-08-01T19:55:45.916 INFO:teuthology.orchestra.run.smithi008.stdout: }, 2023-08-01T19:55:45.916 INFO:teuthology.orchestra.run.smithi008.stdout: { 2023-08-01T19:55:45.916 INFO:teuthology.orchestra.run.smithi008.stdout: "event": "header_read", 2023-08-01T19:55:45.916 INFO:teuthology.orchestra.run.smithi008.stdout: "time": "2023-08-01T19:55:45.890968+0000", 2023-08-01T19:55:45.916 INFO:teuthology.orchestra.run.smithi008.stdout: "duration": 4294967295.9999995 2023-08-01T19:55:45.917 INFO:teuthology.orchestra.run.smithi008.stdout: }, 2023-08-01T19:55:45.917 INFO:teuthology.orchestra.run.smithi008.stdout: { 2023-08-01T19:55:45.917 INFO:teuthology.orchestra.run.smithi008.stdout: "event": "all_read", 2023-08-01T19:55:45.917 INFO:teuthology.orchestra.run.smithi008.stdout: "time": "2023-08-01T19:55:45.890973+0000", 2023-08-01T19:55:45.917 INFO:teuthology.orchestra.run.smithi008.stdout: "duration": 4.797e-06 2023-08-01T19:55:45.917 INFO:teuthology.orchestra.run.smithi008.stdout: }, 2023-08-01T19:55:45.917 INFO:teuthology.orchestra.run.smithi008.stdout: { 2023-08-01T19:55:45.917 INFO:teuthology.orchestra.run.smithi008.stdout: "event": "dispatched", 2023-08-01T19:55:45.918 INFO:teuthology.orchestra.run.smithi008.stdout: "time": "2023-08-01T19:55:45.890982+0000", 2023-08-01T19:55:45.918 INFO:teuthology.orchestra.run.smithi008.stdout: "duration": 9.2650000000000002e-06 2023-08-01T19:55:45.918 INFO:teuthology.orchestra.run.smithi008.stdout: }, 2023-08-01T19:55:45.918 INFO:teuthology.orchestra.run.smithi008.stdout: { 2023-08-01T19:55:45.918 INFO:teuthology.orchestra.run.smithi008.stdout: "event": "queued_for_pg", 2023-08-01T19:55:45.918 INFO:teuthology.orchestra.run.smithi008.stdout: "time": "2023-08-01T19:55:45.890987+0000", 2023-08-01T19:55:45.918 INFO:teuthology.orchestra.run.smithi008.stdout: "duration": 5.4759999999999997e-06 2023-08-01T19:55:45.919 INFO:teuthology.orchestra.run.smithi008.stdout: }, 2023-08-01T19:55:45.919 INFO:teuthology.orchestra.run.smithi008.stdout: { 2023-08-01T19:55:45.919 INFO:teuthology.orchestra.run.smithi008.stdout: "event": "reached_pg", 2023-08-01T19:55:45.919 INFO:teuthology.orchestra.run.smithi008.stdout: "time": "2023-08-01T19:55:45.891018+0000", 2023-08-01T19:55:45.919 INFO:teuthology.orchestra.run.smithi008.stdout: "duration": 3.0378999999999998e-05 2023-08-01T19:55:45.919 INFO:teuthology.orchestra.run.smithi008.stdout: }, 2023-08-01T19:55:45.919 INFO:teuthology.orchestra.run.smithi008.stdout: { 2023-08-01T19:55:45.920 INFO:teuthology.orchestra.run.smithi008.stdout: "event": "started", 2023-08-01T19:55:45.920 INFO:teuthology.orchestra.run.smithi008.stdout: "time": "2023-08-01T19:55:45.891035+0000", 2023-08-01T19:55:45.920 INFO:teuthology.orchestra.run.smithi008.stdout: "duration": 1.7305000000000001e-05 2023-08-01T19:55:45.920 INFO:teuthology.orchestra.run.smithi008.stdout: } 2023-08-01T19:55:45.920 INFO:teuthology.orchestra.run.smithi008.stdout: ] 2023-08-01T19:55:45.920 INFO:teuthology.orchestra.run.smithi008.stdout: } 2023-08-01T19:55:45.920 INFO:teuthology.orchestra.run.smithi008.stdout: }, 2023-08-01T19:55:45.920 INFO:teuthology.orchestra.run.smithi008.stdout: { 2023-08-01T19:55:45.921 INFO:teuthology.orchestra.run.smithi008.stdout: "description": "osd_repop(client.4668.0:173557 5.5 e54/53 5:a2e5f839:::benchmark_data_smithi006_114134_object39896:head v 54'10692, mlcod=54'10689)", 2023-08-01T19:55:45.921 INFO:teuthology.orchestra.run.smithi008.stdout: "initiated_at": "2023-08-01T19:55:45.891040+0000", 2023-08-01T19:55:45.921 INFO:teuthology.orchestra.run.smithi008.stdout: "age": 0.0070589229999999999, 2023-08-01T19:55:45.921 INFO:teuthology.orchestra.run.smithi008.stdout: "duration": 0.0072824109999999999, 2023-08-01T19:55:45.921 INFO:teuthology.orchestra.run.smithi008.stdout: "type_data": { 2023-08-01T19:55:45.921 INFO:teuthology.orchestra.run.smithi008.stdout: "flag_point": "started", 2023-08-01T19:55:45.921 INFO:teuthology.orchestra.run.smithi008.stdout: "events": [ 2023-08-01T19:55:45.921 INFO:teuthology.orchestra.run.smithi008.stdout: { 2023-08-01T19:55:45.922 INFO:teuthology.orchestra.run.smithi008.stdout: "event": "initiated", 2023-08-01T19:55:45.922 INFO:teuthology.orchestra.run.smithi008.stdout: "time": "2023-08-01T19:55:45.891040+0000", 2023-08-01T19:55:45.922 INFO:teuthology.orchestra.run.smithi008.stdout: "duration": 0 2023-08-01T19:55:45.922 INFO:teuthology.orchestra.run.smithi008.stdout: }, 2023-08-01T19:55:45.922 INFO:teuthology.orchestra.run.smithi008.stdout: { 2023-08-01T19:55:45.922 INFO:teuthology.orchestra.run.smithi008.stdout: "event": "throttled", 2023-08-01T19:55:45.922 INFO:teuthology.orchestra.run.smithi008.stdout: "time": "2023-08-01T19:55:45.891040+0000", 2023-08-01T19:55:45.923 INFO:teuthology.orchestra.run.smithi008.stdout: "duration": 0 2023-08-01T19:55:45.923 INFO:teuthology.orchestra.run.smithi008.stdout: }, 2023-08-01T19:55:45.923 INFO:teuthology.orchestra.run.smithi008.stdout: { 2023-08-01T19:55:45.923 INFO:teuthology.orchestra.run.smithi008.stdout: "event": "header_read", 2023-08-01T19:55:45.923 INFO:teuthology.orchestra.run.smithi008.stdout: "time": "2023-08-01T19:55:45.891039+0000", 2023-08-01T19:55:45.923 INFO:teuthology.orchestra.run.smithi008.stdout: "duration": 4294967295.9999995 2023-08-01T19:55:45.923 INFO:teuthology.orchestra.run.smithi008.stdout: }, 2023-08-01T19:55:45.923 INFO:teuthology.orchestra.run.smithi008.stdout: { 2023-08-01T19:55:45.924 INFO:teuthology.orchestra.run.smithi008.stdout: "event": "all_read", 2023-08-01T19:55:45.924 INFO:teuthology.orchestra.run.smithi008.stdout: "time": "2023-08-01T19:55:45.891044+0000", 2023-08-01T19:55:45.924 INFO:teuthology.orchestra.run.smithi008.stdout: "duration": 4.9069999999999998e-06 2023-08-01T19:55:45.924 INFO:teuthology.orchestra.run.smithi008.stdout: }, 2023-08-01T19:55:45.924 INFO:teuthology.orchestra.run.smithi008.stdout: { 2023-08-01T19:55:45.924 INFO:teuthology.orchestra.run.smithi008.stdout: "event": "dispatched", 2023-08-01T19:55:45.924 INFO:teuthology.orchestra.run.smithi008.stdout: "time": "2023-08-01T19:55:45.891053+0000", 2023-08-01T19:55:45.924 INFO:teuthology.orchestra.run.smithi008.stdout: "duration": 8.5290000000000008e-06 2023-08-01T19:55:45.925 INFO:teuthology.orchestra.run.smithi008.stdout: }, 2023-08-01T19:55:45.925 INFO:teuthology.orchestra.run.smithi008.stdout: { 2023-08-01T19:55:45.925 INFO:teuthology.orchestra.run.smithi008.stdout: "event": "queued_for_pg", 2023-08-01T19:55:45.925 INFO:teuthology.orchestra.run.smithi008.stdout: "time": "2023-08-01T19:55:45.891058+0000", 2023-08-01T19:55:45.925 INFO:teuthology.orchestra.run.smithi008.stdout: "duration": 4.95e-06 2023-08-01T19:55:45.925 INFO:teuthology.orchestra.run.smithi008.stdout: }, 2023-08-01T19:55:45.925 INFO:teuthology.orchestra.run.smithi008.stdout: { 2023-08-01T19:55:45.925 INFO:teuthology.orchestra.run.smithi008.stdout: "event": "reached_pg", 2023-08-01T19:55:45.926 INFO:teuthology.orchestra.run.smithi008.stdout: "time": "2023-08-01T19:55:45.891097+0000", 2023-08-01T19:55:45.926 INFO:teuthology.orchestra.run.smithi008.stdout: "duration": 3.9351999999999999e-05 2023-08-01T19:55:45.926 INFO:teuthology.orchestra.run.smithi008.stdout: }, 2023-08-01T19:55:45.926 INFO:teuthology.orchestra.run.smithi008.stdout: { 2023-08-01T19:55:45.926 INFO:teuthology.orchestra.run.smithi008.stdout: "event": "started", 2023-08-01T19:55:45.926 INFO:teuthology.orchestra.run.smithi008.stdout: "time": "2023-08-01T19:55:45.891116+0000", 2023-08-01T19:55:45.926 INFO:teuthology.orchestra.run.smithi008.stdout: "duration": 1.8816000000000001e-05 2023-08-01T19:55:45.926 INFO:teuthology.orchestra.run.smithi008.stdout: } 2023-08-01T19:55:45.927 INFO:teuthology.orchestra.run.smithi008.stdout: ] 2023-08-01T19:55:45.927 INFO:teuthology.orchestra.run.smithi008.stdout: } 2023-08-01T19:55:45.927 INFO:teuthology.orchestra.run.smithi008.stdout: }, 2023-08-01T19:55:45.927 INFO:teuthology.orchestra.run.smithi008.stdout: { 2023-08-01T19:55:45.927 INFO:teuthology.orchestra.run.smithi008.stdout: "description": "osd_repop(client.4668.0:173560 5.1 e54/53 5:867fec5e:::benchmark_data_smithi006_114134_object39899:head v 54'10780, mlcod=54'10776)", 2023-08-01T19:55:45.927 INFO:teuthology.orchestra.run.smithi008.stdout: "initiated_at": "2023-08-01T19:55:45.892461+0000", 2023-08-01T19:55:45.927 INFO:teuthology.orchestra.run.smithi008.stdout: "age": 0.0056379220000000001, 2023-08-01T19:55:45.928 INFO:teuthology.orchestra.run.smithi008.stdout: "duration": 0.005930538, 2023-08-01T19:55:45.928 INFO:teuthology.orchestra.run.smithi008.stdout: "type_data": { 2023-08-01T19:55:45.928 INFO:teuthology.orchestra.run.smithi008.stdout: "flag_point": "started", 2023-08-01T19:55:45.928 INFO:teuthology.orchestra.run.smithi008.stdout: "events": [ 2023-08-01T19:55:45.928 INFO:teuthology.orchestra.run.smithi008.stdout: { 2023-08-01T19:55:45.928 INFO:teuthology.orchestra.run.smithi008.stdout: "event": "initiated", 2023-08-01T19:55:45.928 INFO:teuthology.orchestra.run.smithi008.stdout: "time": "2023-08-01T19:55:45.892461+0000", 2023-08-01T19:55:45.928 INFO:teuthology.orchestra.run.smithi008.stdout: "duration": 0 2023-08-01T19:55:45.929 INFO:teuthology.orchestra.run.smithi008.stdout: }, 2023-08-01T19:55:45.929 INFO:teuthology.orchestra.run.smithi008.stdout: { 2023-08-01T19:55:45.929 INFO:teuthology.orchestra.run.smithi008.stdout: "event": "throttled", 2023-08-01T19:55:45.929 INFO:teuthology.orchestra.run.smithi008.stdout: "time": "2023-08-01T19:55:45.892461+0000", 2023-08-01T19:55:45.929 INFO:teuthology.orchestra.run.smithi008.stdout: "duration": 0 2023-08-01T19:55:45.930 INFO:teuthology.orchestra.run.smithi008.stdout: }, 2023-08-01T19:55:45.930 INFO:teuthology.orchestra.run.smithi008.stdout: { 2023-08-01T19:55:45.930 INFO:teuthology.orchestra.run.smithi008.stdout: "event": "header_read", 2023-08-01T19:55:45.930 INFO:teuthology.orchestra.run.smithi008.stdout: "time": "2023-08-01T19:55:45.892460+0000", 2023-08-01T19:55:45.930 INFO:teuthology.orchestra.run.smithi008.stdout: "duration": 4294967295.9999995 2023-08-01T19:55:45.930 INFO:teuthology.orchestra.run.smithi008.stdout: }, 2023-08-01T19:55:45.930 INFO:teuthology.orchestra.run.smithi008.stdout: { 2023-08-01T19:55:45.930 INFO:teuthology.orchestra.run.smithi008.stdout: "event": "all_read", 2023-08-01T19:55:45.931 INFO:teuthology.orchestra.run.smithi008.stdout: "time": "2023-08-01T19:55:45.892466+0000", 2023-08-01T19:55:45.931 INFO:teuthology.orchestra.run.smithi008.stdout: "duration": 6.1449999999999996e-06 2023-08-01T19:55:45.931 INFO:teuthology.orchestra.run.smithi008.stdout: }, 2023-08-01T19:55:45.931 INFO:teuthology.orchestra.run.smithi008.stdout: { 2023-08-01T19:55:45.931 INFO:teuthology.orchestra.run.smithi008.stdout: "event": "dispatched", 2023-08-01T19:55:45.931 INFO:teuthology.orchestra.run.smithi008.stdout: "time": "2023-08-01T19:55:45.892489+0000", 2023-08-01T19:55:45.931 INFO:teuthology.orchestra.run.smithi008.stdout: "duration": 2.3095000000000002e-05 2023-08-01T19:55:45.931 INFO:teuthology.orchestra.run.smithi008.stdout: }, 2023-08-01T19:55:45.932 INFO:teuthology.orchestra.run.smithi008.stdout: { 2023-08-01T19:55:45.932 INFO:teuthology.orchestra.run.smithi008.stdout: "event": "queued_for_pg", 2023-08-01T19:55:45.932 INFO:teuthology.orchestra.run.smithi008.stdout: "time": "2023-08-01T19:55:45.892497+0000", 2023-08-01T19:55:45.932 INFO:teuthology.orchestra.run.smithi008.stdout: "duration": 7.1500000000000002e-06 2023-08-01T19:55:45.932 INFO:teuthology.orchestra.run.smithi008.stdout: }, 2023-08-01T19:55:45.932 INFO:teuthology.orchestra.run.smithi008.stdout: { 2023-08-01T19:55:45.932 INFO:teuthology.orchestra.run.smithi008.stdout: "event": "reached_pg", 2023-08-01T19:55:45.933 INFO:teuthology.orchestra.run.smithi008.stdout: "time": "2023-08-01T19:55:45.892877+0000", 2023-08-01T19:55:45.933 INFO:teuthology.orchestra.run.smithi008.stdout: "duration": 0.000380811 2023-08-01T19:55:45.933 INFO:teuthology.orchestra.run.smithi008.stdout: }, 2023-08-01T19:55:45.933 INFO:teuthology.orchestra.run.smithi008.stdout: { 2023-08-01T19:55:45.933 INFO:teuthology.orchestra.run.smithi008.stdout: "event": "started", 2023-08-01T19:55:45.933 INFO:teuthology.orchestra.run.smithi008.stdout: "time": "2023-08-01T19:55:45.892895+0000", 2023-08-01T19:55:45.933 INFO:teuthology.orchestra.run.smithi008.stdout: "duration": 1.7473e-05 2023-08-01T19:55:45.933 INFO:teuthology.orchestra.run.smithi008.stdout: } 2023-08-01T19:55:45.934 INFO:teuthology.orchestra.run.smithi008.stdout: ] 2023-08-01T19:55:45.934 INFO:teuthology.orchestra.run.smithi008.stdout: } 2023-08-01T19:55:45.934 INFO:teuthology.orchestra.run.smithi008.stdout: }, 2023-08-01T19:55:45.934 INFO:teuthology.orchestra.run.smithi008.stdout: { 2023-08-01T19:55:45.934 INFO:teuthology.orchestra.run.smithi008.stdout: "description": "osd_op(client.4668.0:173561 5.c 5:3ebb3cd5:::benchmark_data_smithi006_114134_object39900:head [delete] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e54)", 2023-08-01T19:55:45.934 INFO:teuthology.orchestra.run.smithi008.stdout: "initiated_at": "2023-08-01T19:55:45.892597+0000", 2023-08-01T19:55:45.934 INFO:teuthology.orchestra.run.smithi008.stdout: "age": 0.0055020809999999998, 2023-08-01T19:55:45.935 INFO:teuthology.orchestra.run.smithi008.stdout: "duration": 0.0058595920000000003, 2023-08-01T19:55:45.935 INFO:teuthology.orchestra.run.smithi008.stdout: "type_data": { 2023-08-01T19:55:45.935 INFO:teuthology.orchestra.run.smithi008.stdout: "flag_point": "waiting for sub ops", 2023-08-01T19:55:45.935 INFO:teuthology.orchestra.run.smithi008.stdout: "client_info": { 2023-08-01T19:55:45.935 INFO:teuthology.orchestra.run.smithi008.stdout: "client": "client.4668", 2023-08-01T19:55:45.935 INFO:teuthology.orchestra.run.smithi008.stdout: "client_addr": "172.21.15.6:0/1709472247", 2023-08-01T19:55:45.935 INFO:teuthology.orchestra.run.smithi008.stdout: "tid": 173561 2023-08-01T19:55:45.936 INFO:teuthology.orchestra.run.smithi008.stdout: }, 2023-08-01T19:55:45.936 INFO:teuthology.orchestra.run.smithi008.stdout: "events": [ 2023-08-01T19:55:45.936 INFO:teuthology.orchestra.run.smithi008.stdout: { 2023-08-01T19:55:45.936 INFO:teuthology.orchestra.run.smithi008.stdout: "event": "initiated", 2023-08-01T19:55:45.936 INFO:teuthology.orchestra.run.smithi008.stdout: "time": "2023-08-01T19:55:45.892597+0000", 2023-08-01T19:55:45.936 INFO:teuthology.orchestra.run.smithi008.stdout: "duration": 0 2023-08-01T19:55:45.936 INFO:teuthology.orchestra.run.smithi008.stdout: }, 2023-08-01T19:55:45.936 INFO:teuthology.orchestra.run.smithi008.stdout: { 2023-08-01T19:55:45.937 INFO:teuthology.orchestra.run.smithi008.stdout: "event": "throttled", 2023-08-01T19:55:45.937 INFO:teuthology.orchestra.run.smithi008.stdout: "time": "2023-08-01T19:55:45.892597+0000", 2023-08-01T19:55:45.937 INFO:teuthology.orchestra.run.smithi008.stdout: "duration": 0 2023-08-01T19:55:45.937 INFO:teuthology.orchestra.run.smithi008.stdout: }, 2023-08-01T19:55:45.937 INFO:teuthology.orchestra.run.smithi008.stdout: { 2023-08-01T19:55:45.937 INFO:teuthology.orchestra.run.smithi008.stdout: "event": "header_read", 2023-08-01T19:55:45.937 INFO:teuthology.orchestra.run.smithi008.stdout: "time": "2023-08-01T19:55:45.892595+0000", 2023-08-01T19:55:45.937 INFO:teuthology.orchestra.run.smithi008.stdout: "duration": 4294967295.999999 2023-08-01T19:55:45.938 INFO:teuthology.orchestra.run.smithi008.stdout: }, 2023-08-01T19:55:45.938 INFO:teuthology.orchestra.run.smithi008.stdout: { 2023-08-01T19:55:45.938 INFO:teuthology.orchestra.run.smithi008.stdout: "event": "all_read", 2023-08-01T19:55:45.938 INFO:teuthology.orchestra.run.smithi008.stdout: "time": "2023-08-01T19:55:45.892601+0000", 2023-08-01T19:55:45.938 INFO:teuthology.orchestra.run.smithi008.stdout: "duration": 5.5459999999999999e-06 2023-08-01T19:55:45.938 INFO:teuthology.orchestra.run.smithi008.stdout: }, 2023-08-01T19:55:45.938 INFO:teuthology.orchestra.run.smithi008.stdout: { 2023-08-01T19:55:45.939 INFO:teuthology.orchestra.run.smithi008.stdout: "event": "dispatched", 2023-08-01T19:55:45.939 INFO:teuthology.orchestra.run.smithi008.stdout: "time": "2023-08-01T19:55:45.892612+0000", 2023-08-01T19:55:45.939 INFO:teuthology.orchestra.run.smithi008.stdout: "duration": 1.0504e-05 2023-08-01T19:55:45.939 INFO:teuthology.orchestra.run.smithi008.stdout: }, 2023-08-01T19:55:45.939 INFO:teuthology.orchestra.run.smithi008.stdout: { 2023-08-01T19:55:45.939 INFO:teuthology.orchestra.run.smithi008.stdout: "event": "queued_for_pg", 2023-08-01T19:55:45.939 INFO:teuthology.orchestra.run.smithi008.stdout: "time": "2023-08-01T19:55:45.892616+0000", 2023-08-01T19:55:45.939 INFO:teuthology.orchestra.run.smithi008.stdout: "duration": 4.2969999999999997e-06 2023-08-01T19:55:45.940 INFO:teuthology.orchestra.run.smithi008.stdout: }, 2023-08-01T19:55:45.940 INFO:teuthology.orchestra.run.smithi008.stdout: { 2023-08-01T19:55:45.940 INFO:teuthology.orchestra.run.smithi008.stdout: "event": "reached_pg", 2023-08-01T19:55:45.940 INFO:teuthology.orchestra.run.smithi008.stdout: "time": "2023-08-01T19:55:45.892645+0000", 2023-08-01T19:55:45.940 INFO:teuthology.orchestra.run.smithi008.stdout: "duration": 2.9631000000000001e-05 2023-08-01T19:55:45.940 INFO:teuthology.orchestra.run.smithi008.stdout: }, 2023-08-01T19:55:45.940 INFO:teuthology.orchestra.run.smithi008.stdout: { 2023-08-01T19:55:45.940 INFO:teuthology.orchestra.run.smithi008.stdout: "event": "started", 2023-08-01T19:55:45.941 INFO:teuthology.orchestra.run.smithi008.stdout: "time": "2023-08-01T19:55:45.892735+0000", 2023-08-01T19:55:45.941 INFO:teuthology.orchestra.run.smithi008.stdout: "duration": 8.9610000000000004e-05 2023-08-01T19:55:45.941 INFO:teuthology.orchestra.run.smithi008.stdout: }, 2023-08-01T19:55:45.941 INFO:teuthology.orchestra.run.smithi008.stdout: { 2023-08-01T19:55:45.941 INFO:teuthology.orchestra.run.smithi008.stdout: "event": "waiting for subops from 1", 2023-08-01T19:55:45.941 INFO:teuthology.orchestra.run.smithi008.stdout: "time": "2023-08-01T19:55:45.892802+0000", 2023-08-01T19:55:45.941 INFO:teuthology.orchestra.run.smithi008.stdout: "duration": 6.6680000000000005e-05 2023-08-01T19:55:45.941 INFO:teuthology.orchestra.run.smithi008.stdout: }, 2023-08-01T19:55:45.942 INFO:teuthology.orchestra.run.smithi008.stdout: { 2023-08-01T19:55:45.942 INFO:teuthology.orchestra.run.smithi008.stdout: "event": "sub_op_commit_rec", 2023-08-01T19:55:45.942 INFO:teuthology.orchestra.run.smithi008.stdout: "time": "2023-08-01T19:55:45.897974+0000", 2023-08-01T19:55:45.942 INFO:teuthology.orchestra.run.smithi008.stdout: "duration": 0.0051720710000000003 2023-08-01T19:55:45.942 INFO:teuthology.orchestra.run.smithi008.stdout: } 2023-08-01T19:55:45.942 INFO:teuthology.orchestra.run.smithi008.stdout: ] 2023-08-01T19:55:45.942 INFO:teuthology.orchestra.run.smithi008.stdout: } 2023-08-01T19:55:45.943 INFO:teuthology.orchestra.run.smithi008.stdout: }, 2023-08-01T19:55:45.943 INFO:teuthology.orchestra.run.smithi008.stdout: { 2023-08-01T19:55:45.943 INFO:teuthology.orchestra.run.smithi008.stdout: "description": "osd_repop(client.4668.0:173562 5.2 e54/53 5:49d922d5:::benchmark_data_smithi006_114134_object39901:head v 54'11146, mlcod=54'11143)", 2023-08-01T19:55:45.943 INFO:teuthology.orchestra.run.smithi008.stdout: "initiated_at": "2023-08-01T19:55:45.893490+0000", 2023-08-01T19:55:45.943 INFO:teuthology.orchestra.run.smithi008.stdout: "age": 0.0046090740000000003, 2023-08-01T19:55:45.943 INFO:teuthology.orchestra.run.smithi008.stdout: "duration": 0.0050495310000000003, 2023-08-01T19:55:45.943 INFO:teuthology.orchestra.run.smithi008.stdout: "type_data": { 2023-08-01T19:55:45.943 INFO:teuthology.orchestra.run.smithi008.stdout: "flag_point": "started", 2023-08-01T19:55:45.944 INFO:teuthology.orchestra.run.smithi008.stdout: "events": [ 2023-08-01T19:55:45.944 INFO:teuthology.orchestra.run.smithi008.stdout: { 2023-08-01T19:55:45.944 INFO:teuthology.orchestra.run.smithi008.stdout: "event": "initiated", 2023-08-01T19:55:45.944 INFO:teuthology.orchestra.run.smithi008.stdout: "time": "2023-08-01T19:55:45.893490+0000", 2023-08-01T19:55:45.944 INFO:teuthology.orchestra.run.smithi008.stdout: "duration": 0 2023-08-01T19:55:45.944 INFO:teuthology.orchestra.run.smithi008.stdout: }, 2023-08-01T19:55:45.944 INFO:teuthology.orchestra.run.smithi008.stdout: { 2023-08-01T19:55:45.944 INFO:teuthology.orchestra.run.smithi008.stdout: "event": "throttled", 2023-08-01T19:55:45.945 INFO:teuthology.orchestra.run.smithi008.stdout: "time": "2023-08-01T19:55:45.893490+0000", 2023-08-01T19:55:45.945 INFO:teuthology.orchestra.run.smithi008.stdout: "duration": 0 2023-08-01T19:55:45.945 INFO:teuthology.orchestra.run.smithi008.stdout: }, 2023-08-01T19:55:45.945 INFO:teuthology.orchestra.run.smithi008.stdout: { 2023-08-01T19:55:45.945 INFO:teuthology.orchestra.run.smithi008.stdout: "event": "header_read", 2023-08-01T19:55:45.946 INFO:teuthology.orchestra.run.smithi008.stdout: "time": "2023-08-01T19:55:45.893489+0000", 2023-08-01T19:55:45.946 INFO:teuthology.orchestra.run.smithi008.stdout: "duration": 4294967295.9999995 2023-08-01T19:55:45.946 INFO:teuthology.orchestra.run.smithi008.stdout: }, 2023-08-01T19:55:45.946 INFO:teuthology.orchestra.run.smithi008.stdout: { 2023-08-01T19:55:45.946 INFO:teuthology.orchestra.run.smithi008.stdout: "event": "all_read", 2023-08-01T19:55:45.947 INFO:teuthology.orchestra.run.smithi008.stdout: "time": "2023-08-01T19:55:45.893495+0000", 2023-08-01T19:55:45.947 INFO:teuthology.orchestra.run.smithi008.stdout: "duration": 5.942e-06 2023-08-01T19:55:45.947 INFO:teuthology.orchestra.run.smithi008.stdout: }, 2023-08-01T19:55:45.947 INFO:teuthology.orchestra.run.smithi008.stdout: { 2023-08-01T19:55:45.947 INFO:teuthology.orchestra.run.smithi008.stdout: "event": "dispatched", 2023-08-01T19:55:45.947 INFO:teuthology.orchestra.run.smithi008.stdout: "time": "2023-08-01T19:55:45.893506+0000", 2023-08-01T19:55:45.947 INFO:teuthology.orchestra.run.smithi008.stdout: "duration": 1.1148999999999999e-05 2023-08-01T19:55:45.948 INFO:teuthology.orchestra.run.smithi008.stdout: }, 2023-08-01T19:55:45.948 INFO:teuthology.orchestra.run.smithi008.stdout: { 2023-08-01T19:55:45.948 INFO:teuthology.orchestra.run.smithi008.stdout: "event": "queued_for_pg", 2023-08-01T19:55:45.948 INFO:teuthology.orchestra.run.smithi008.stdout: "time": "2023-08-01T19:55:45.893512+0000", 2023-08-01T19:55:45.948 INFO:teuthology.orchestra.run.smithi008.stdout: "duration": 5.6790000000000002e-06 2023-08-01T19:55:45.948 INFO:teuthology.orchestra.run.smithi008.stdout: }, 2023-08-01T19:55:45.948 INFO:teuthology.orchestra.run.smithi008.stdout: { 2023-08-01T19:55:45.948 INFO:teuthology.orchestra.run.smithi008.stdout: "event": "reached_pg", 2023-08-01T19:55:45.949 INFO:teuthology.orchestra.run.smithi008.stdout: "time": "2023-08-01T19:55:45.893545+0000", 2023-08-01T19:55:45.949 INFO:teuthology.orchestra.run.smithi008.stdout: "duration": 3.3095000000000001e-05 2023-08-01T19:55:45.949 INFO:teuthology.orchestra.run.smithi008.stdout: }, 2023-08-01T19:55:45.949 INFO:teuthology.orchestra.run.smithi008.stdout: { 2023-08-01T19:55:45.949 INFO:teuthology.orchestra.run.smithi008.stdout: "event": "started", 2023-08-01T19:55:45.949 INFO:teuthology.orchestra.run.smithi008.stdout: "time": "2023-08-01T19:55:45.893556+0000", 2023-08-01T19:55:45.949 INFO:teuthology.orchestra.run.smithi008.stdout: "duration": 1.1263999999999999e-05 2023-08-01T19:55:45.950 INFO:teuthology.orchestra.run.smithi008.stdout: } 2023-08-01T19:55:45.950 INFO:teuthology.orchestra.run.smithi008.stdout: ] 2023-08-01T19:55:45.950 INFO:teuthology.orchestra.run.smithi008.stdout: } 2023-08-01T19:55:45.950 INFO:teuthology.orchestra.run.smithi008.stdout: }, 2023-08-01T19:55:45.950 INFO:teuthology.orchestra.run.smithi008.stdout: { 2023-08-01T19:55:45.950 INFO:teuthology.orchestra.run.smithi008.stdout: "description": "osd_repop(client.4668.0:173563 5.b e54/19 5:d0dc08b3:::benchmark_data_smithi006_114134_object39902:head v 54'10765, mlcod=54'10763)", 2023-08-01T19:55:45.950 INFO:teuthology.orchestra.run.smithi008.stdout: "initiated_at": "2023-08-01T19:55:45.893602+0000", 2023-08-01T19:55:45.950 INFO:teuthology.orchestra.run.smithi008.stdout: "age": 0.0044967790000000002, 2023-08-01T19:55:45.951 INFO:teuthology.orchestra.run.smithi008.stdout: "duration": 0.0049990970000000001, 2023-08-01T19:55:45.951 INFO:teuthology.orchestra.run.smithi008.stdout: "type_data": { 2023-08-01T19:55:45.951 INFO:teuthology.orchestra.run.smithi008.stdout: "flag_point": "started", 2023-08-01T19:55:45.951 INFO:teuthology.orchestra.run.smithi008.stdout: "events": [ 2023-08-01T19:55:45.951 INFO:teuthology.orchestra.run.smithi008.stdout: { 2023-08-01T19:55:45.951 INFO:teuthology.orchestra.run.smithi008.stdout: "event": "initiated", 2023-08-01T19:55:45.951 INFO:teuthology.orchestra.run.smithi008.stdout: "time": "2023-08-01T19:55:45.893602+0000", 2023-08-01T19:55:45.951 INFO:teuthology.orchestra.run.smithi008.stdout: "duration": 0 2023-08-01T19:55:45.952 INFO:teuthology.orchestra.run.smithi008.stdout: }, 2023-08-01T19:55:45.952 INFO:teuthology.orchestra.run.smithi008.stdout: { 2023-08-01T19:55:45.952 INFO:teuthology.orchestra.run.smithi008.stdout: "event": "throttled", 2023-08-01T19:55:45.952 INFO:teuthology.orchestra.run.smithi008.stdout: "time": "2023-08-01T19:55:45.893602+0000", 2023-08-01T19:55:45.953 INFO:teuthology.orchestra.run.smithi008.stdout: "duration": 0 2023-08-01T19:55:45.953 INFO:teuthology.orchestra.run.smithi008.stdout: }, 2023-08-01T19:55:45.953 INFO:teuthology.orchestra.run.smithi008.stdout: { 2023-08-01T19:55:45.953 INFO:teuthology.orchestra.run.smithi008.stdout: "event": "header_read", 2023-08-01T19:55:45.953 INFO:teuthology.orchestra.run.smithi008.stdout: "time": "2023-08-01T19:55:45.893601+0000", 2023-08-01T19:55:45.953 INFO:teuthology.orchestra.run.smithi008.stdout: "duration": 4294967295.9999995 2023-08-01T19:55:45.954 INFO:teuthology.orchestra.run.smithi008.stdout: }, 2023-08-01T19:55:45.954 INFO:teuthology.orchestra.run.smithi008.stdout: { 2023-08-01T19:55:45.954 INFO:teuthology.orchestra.run.smithi008.stdout: "event": "all_read", 2023-08-01T19:55:45.954 INFO:teuthology.orchestra.run.smithi008.stdout: "time": "2023-08-01T19:55:45.893606+0000", 2023-08-01T19:55:45.954 INFO:teuthology.orchestra.run.smithi008.stdout: "duration": 4.6399999999999996e-06 2023-08-01T19:55:45.954 INFO:teuthology.orchestra.run.smithi008.stdout: }, 2023-08-01T19:55:45.954 INFO:teuthology.orchestra.run.smithi008.stdout: { 2023-08-01T19:55:45.954 INFO:teuthology.orchestra.run.smithi008.stdout: "event": "dispatched", 2023-08-01T19:55:45.955 INFO:teuthology.orchestra.run.smithi008.stdout: "time": "2023-08-01T19:55:45.893613+0000", 2023-08-01T19:55:45.955 INFO:teuthology.orchestra.run.smithi008.stdout: "duration": 7.2370000000000003e-06 2023-08-01T19:55:45.955 INFO:teuthology.orchestra.run.smithi008.stdout: }, 2023-08-01T19:55:45.955 INFO:teuthology.orchestra.run.smithi008.stdout: { 2023-08-01T19:55:45.955 INFO:teuthology.orchestra.run.smithi008.stdout: "event": "queued_for_pg", 2023-08-01T19:55:45.955 INFO:teuthology.orchestra.run.smithi008.stdout: "time": "2023-08-01T19:55:45.893618+0000", 2023-08-01T19:55:45.955 INFO:teuthology.orchestra.run.smithi008.stdout: "duration": 4.4129999999999999e-06 2023-08-01T19:55:45.956 INFO:teuthology.orchestra.run.smithi008.stdout: }, 2023-08-01T19:55:45.956 INFO:teuthology.orchestra.run.smithi008.stdout: { 2023-08-01T19:55:45.956 INFO:teuthology.orchestra.run.smithi008.stdout: "event": "reached_pg", 2023-08-01T19:55:45.956 INFO:teuthology.orchestra.run.smithi008.stdout: "time": "2023-08-01T19:55:45.893651+0000", 2023-08-01T19:55:45.956 INFO:teuthology.orchestra.run.smithi008.stdout: "duration": 3.3025000000000003e-05 2023-08-01T19:55:45.956 INFO:teuthology.orchestra.run.smithi008.stdout: }, 2023-08-01T19:55:45.956 INFO:teuthology.orchestra.run.smithi008.stdout: { 2023-08-01T19:55:45.956 INFO:teuthology.orchestra.run.smithi008.stdout: "event": "started", 2023-08-01T19:55:45.957 INFO:teuthology.orchestra.run.smithi008.stdout: "time": "2023-08-01T19:55:45.893666+0000", 2023-08-01T19:55:45.957 INFO:teuthology.orchestra.run.smithi008.stdout: "duration": 1.5358000000000001e-05 2023-08-01T19:55:45.957 INFO:teuthology.orchestra.run.smithi008.stdout: } 2023-08-01T19:55:45.957 INFO:teuthology.orchestra.run.smithi008.stdout: ] 2023-08-01T19:55:45.957 INFO:teuthology.orchestra.run.smithi008.stdout: } 2023-08-01T19:55:45.957 INFO:teuthology.orchestra.run.smithi008.stdout: }, 2023-08-01T19:55:45.957 INFO:teuthology.orchestra.run.smithi008.stdout: { 2023-08-01T19:55:45.957 INFO:teuthology.orchestra.run.smithi008.stdout: "description": "osd_repop(client.4668.0:173564 5.0 e54/19 5:081572ac:::benchmark_data_smithi006_114134_object39903:head v 54'11020, mlcod=54'11017)", 2023-08-01T19:55:45.958 INFO:teuthology.orchestra.run.smithi008.stdout: "initiated_at": "2023-08-01T19:55:45.894085+0000", 2023-08-01T19:55:45.958 INFO:teuthology.orchestra.run.smithi008.stdout: "age": 0.0040141150000000004, 2023-08-01T19:55:45.958 INFO:teuthology.orchestra.run.smithi008.stdout: "duration": 0.0045804729999999998, 2023-08-01T19:55:45.958 INFO:teuthology.orchestra.run.smithi008.stdout: "type_data": { 2023-08-01T19:55:45.958 INFO:teuthology.orchestra.run.smithi008.stdout: "flag_point": "started", 2023-08-01T19:55:45.958 INFO:teuthology.orchestra.run.smithi008.stdout: "events": [ 2023-08-01T19:55:45.958 INFO:teuthology.orchestra.run.smithi008.stdout: { 2023-08-01T19:55:45.959 INFO:teuthology.orchestra.run.smithi008.stdout: "event": "initiated", 2023-08-01T19:55:45.959 INFO:teuthology.orchestra.run.smithi008.stdout: "time": "2023-08-01T19:55:45.894085+0000", 2023-08-01T19:55:45.959 INFO:teuthology.orchestra.run.smithi008.stdout: "duration": 0 2023-08-01T19:55:45.959 INFO:teuthology.orchestra.run.smithi008.stdout: }, 2023-08-01T19:55:45.959 INFO:teuthology.orchestra.run.smithi008.stdout: { 2023-08-01T19:55:45.959 INFO:teuthology.orchestra.run.smithi008.stdout: "event": "throttled", 2023-08-01T19:55:45.959 INFO:teuthology.orchestra.run.smithi008.stdout: "time": "2023-08-01T19:55:45.894085+0000", 2023-08-01T19:55:45.959 INFO:teuthology.orchestra.run.smithi008.stdout: "duration": 0 2023-08-01T19:55:45.960 INFO:teuthology.orchestra.run.smithi008.stdout: }, 2023-08-01T19:55:45.960 INFO:teuthology.orchestra.run.smithi008.stdout: { 2023-08-01T19:55:45.960 INFO:teuthology.orchestra.run.smithi008.stdout: "event": "header_read", 2023-08-01T19:55:45.960 INFO:teuthology.orchestra.run.smithi008.stdout: "time": "2023-08-01T19:55:45.894084+0000", 2023-08-01T19:55:45.960 INFO:teuthology.orchestra.run.smithi008.stdout: "duration": 4294967295.9999995 2023-08-01T19:55:45.960 INFO:teuthology.orchestra.run.smithi008.stdout: }, 2023-08-01T19:55:45.960 INFO:teuthology.orchestra.run.smithi008.stdout: { 2023-08-01T19:55:45.960 INFO:teuthology.orchestra.run.smithi008.stdout: "event": "all_read", 2023-08-01T19:55:45.961 INFO:teuthology.orchestra.run.smithi008.stdout: "time": "2023-08-01T19:55:45.894090+0000", 2023-08-01T19:55:45.961 INFO:teuthology.orchestra.run.smithi008.stdout: "duration": 6.3899999999999998e-06 2023-08-01T19:55:45.961 INFO:teuthology.orchestra.run.smithi008.stdout: }, 2023-08-01T19:55:45.961 INFO:teuthology.orchestra.run.smithi008.stdout: { 2023-08-01T19:55:45.961 INFO:teuthology.orchestra.run.smithi008.stdout: "event": "dispatched", 2023-08-01T19:55:45.961 INFO:teuthology.orchestra.run.smithi008.stdout: "time": "2023-08-01T19:55:45.894098+0000", 2023-08-01T19:55:45.962 INFO:teuthology.orchestra.run.smithi008.stdout: "duration": 7.5399999999999998e-06 2023-08-01T19:55:45.962 INFO:teuthology.orchestra.run.smithi008.stdout: }, 2023-08-01T19:55:45.962 INFO:teuthology.orchestra.run.smithi008.stdout: { 2023-08-01T19:55:45.963 INFO:teuthology.orchestra.run.smithi008.stdout: "event": "queued_for_pg", 2023-08-01T19:55:45.963 INFO:teuthology.orchestra.run.smithi008.stdout: "time": "2023-08-01T19:55:45.894103+0000", 2023-08-01T19:55:45.963 INFO:teuthology.orchestra.run.smithi008.stdout: "duration": 5.5500000000000002e-06 2023-08-01T19:55:45.963 INFO:teuthology.orchestra.run.smithi008.stdout: }, 2023-08-01T19:55:45.964 INFO:teuthology.orchestra.run.smithi008.stdout: { 2023-08-01T19:55:45.964 INFO:teuthology.orchestra.run.smithi008.stdout: "event": "reached_pg", 2023-08-01T19:55:45.964 INFO:teuthology.orchestra.run.smithi008.stdout: "time": "2023-08-01T19:55:45.894142+0000", 2023-08-01T19:55:45.964 INFO:teuthology.orchestra.run.smithi008.stdout: "duration": 3.8278000000000002e-05 2023-08-01T19:55:45.964 INFO:teuthology.orchestra.run.smithi008.stdout: }, 2023-08-01T19:55:45.964 INFO:teuthology.orchestra.run.smithi008.stdout: { 2023-08-01T19:55:45.965 INFO:teuthology.orchestra.run.smithi008.stdout: "event": "started", 2023-08-01T19:55:45.965 INFO:teuthology.orchestra.run.smithi008.stdout: "time": "2023-08-01T19:55:45.894164+0000", 2023-08-01T19:55:45.965 INFO:teuthology.orchestra.run.smithi008.stdout: "duration": 2.2674999999999999e-05 2023-08-01T19:55:45.965 INFO:teuthology.orchestra.run.smithi008.stdout: } 2023-08-01T19:55:45.965 INFO:teuthology.orchestra.run.smithi008.stdout: ] 2023-08-01T19:55:45.966 INFO:teuthology.orchestra.run.smithi008.stdout: } 2023-08-01T19:55:45.966 INFO:teuthology.orchestra.run.smithi008.stdout: }, 2023-08-01T19:55:45.966 INFO:teuthology.orchestra.run.smithi008.stdout: { 2023-08-01T19:55:45.966 INFO:teuthology.orchestra.run.smithi008.stdout: "description": "osd_repop(client.4668.0:173565 5.1 e54/53 5:8bb35a7b:::benchmark_data_smithi006_114134_object39904:head v 54'10781, mlcod=54'10777)", 2023-08-01T19:55:45.966 INFO:teuthology.orchestra.run.smithi008.stdout: "initiated_at": "2023-08-01T19:55:45.894235+0000", 2023-08-01T19:55:45.966 INFO:teuthology.orchestra.run.smithi008.stdout: "age": 0.00386317, 2023-08-01T19:55:45.966 INFO:teuthology.orchestra.run.smithi008.stdout: "duration": 0.0044909679999999997, 2023-08-01T19:55:45.967 INFO:teuthology.orchestra.run.smithi008.stdout: "type_data": { 2023-08-01T19:55:45.967 INFO:teuthology.orchestra.run.smithi008.stdout: "flag_point": "started", 2023-08-01T19:55:45.967 INFO:teuthology.orchestra.run.smithi008.stdout: "events": [ 2023-08-01T19:55:45.967 INFO:teuthology.orchestra.run.smithi008.stdout: { 2023-08-01T19:55:45.967 INFO:teuthology.orchestra.run.smithi008.stdout: "event": "initiated", 2023-08-01T19:55:45.967 INFO:teuthology.orchestra.run.smithi008.stdout: "time": "2023-08-01T19:55:45.894235+0000", 2023-08-01T19:55:45.967 INFO:teuthology.orchestra.run.smithi008.stdout: "duration": 0 2023-08-01T19:55:45.967 INFO:teuthology.orchestra.run.smithi008.stdout: }, 2023-08-01T19:55:45.968 INFO:teuthology.orchestra.run.smithi008.stdout: { 2023-08-01T19:55:45.968 INFO:teuthology.orchestra.run.smithi008.stdout: "event": "throttled", 2023-08-01T19:55:45.968 INFO:teuthology.orchestra.run.smithi008.stdout: "time": "2023-08-01T19:55:45.894235+0000", 2023-08-01T19:55:45.968 INFO:teuthology.orchestra.run.smithi008.stdout: "duration": 0 2023-08-01T19:55:45.968 INFO:teuthology.orchestra.run.smithi008.stdout: }, 2023-08-01T19:55:45.968 INFO:teuthology.orchestra.run.smithi008.stdout: { 2023-08-01T19:55:45.968 INFO:teuthology.orchestra.run.smithi008.stdout: "event": "header_read", 2023-08-01T19:55:45.969 INFO:teuthology.orchestra.run.smithi008.stdout: "time": "2023-08-01T19:55:45.894235+0000", 2023-08-01T19:55:45.969 INFO:teuthology.orchestra.run.smithi008.stdout: "duration": 4294967295.9999995 2023-08-01T19:55:45.969 INFO:teuthology.orchestra.run.smithi008.stdout: }, 2023-08-01T19:55:45.969 INFO:teuthology.orchestra.run.smithi008.stdout: { 2023-08-01T19:55:45.969 INFO:teuthology.orchestra.run.smithi008.stdout: "event": "all_read", 2023-08-01T19:55:45.969 INFO:teuthology.orchestra.run.smithi008.stdout: "time": "2023-08-01T19:55:45.894240+0000", 2023-08-01T19:55:45.969 INFO:teuthology.orchestra.run.smithi008.stdout: "duration": 5.3569999999999997e-06 2023-08-01T19:55:45.969 INFO:teuthology.orchestra.run.smithi008.stdout: }, 2023-08-01T19:55:45.970 INFO:teuthology.orchestra.run.smithi008.stdout: { 2023-08-01T19:55:45.970 INFO:teuthology.orchestra.run.smithi008.stdout: "event": "dispatched", 2023-08-01T19:55:45.970 INFO:teuthology.orchestra.run.smithi008.stdout: "time": "2023-08-01T19:55:45.894248+0000", 2023-08-01T19:55:45.970 INFO:teuthology.orchestra.run.smithi008.stdout: "duration": 8.208e-06 2023-08-01T19:55:45.970 INFO:teuthology.orchestra.run.smithi008.stdout: }, 2023-08-01T19:55:45.970 INFO:teuthology.orchestra.run.smithi008.stdout: { 2023-08-01T19:55:45.970 INFO:teuthology.orchestra.run.smithi008.stdout: "event": "queued_for_pg", 2023-08-01T19:55:45.970 INFO:teuthology.orchestra.run.smithi008.stdout: "time": "2023-08-01T19:55:45.894253+0000", 2023-08-01T19:55:45.971 INFO:teuthology.orchestra.run.smithi008.stdout: "duration": 4.8110000000000002e-06 2023-08-01T19:55:45.971 INFO:teuthology.orchestra.run.smithi008.stdout: }, 2023-08-01T19:55:45.971 INFO:teuthology.orchestra.run.smithi008.stdout: { 2023-08-01T19:55:45.971 INFO:teuthology.orchestra.run.smithi008.stdout: "event": "reached_pg", 2023-08-01T19:55:45.971 INFO:teuthology.orchestra.run.smithi008.stdout: "time": "2023-08-01T19:55:45.894596+0000", 2023-08-01T19:55:45.971 INFO:teuthology.orchestra.run.smithi008.stdout: "duration": 0.00034311600000000003 2023-08-01T19:55:45.971 INFO:teuthology.orchestra.run.smithi008.stdout: }, 2023-08-01T19:55:45.971 INFO:teuthology.orchestra.run.smithi008.stdout: { 2023-08-01T19:55:45.972 INFO:teuthology.orchestra.run.smithi008.stdout: "event": "started", 2023-08-01T19:55:45.972 INFO:teuthology.orchestra.run.smithi008.stdout: "time": "2023-08-01T19:55:45.894618+0000", 2023-08-01T19:55:45.972 INFO:teuthology.orchestra.run.smithi008.stdout: "duration": 2.1263999999999998e-05 2023-08-01T19:55:45.972 INFO:teuthology.orchestra.run.smithi008.stdout: } 2023-08-01T19:55:45.972 INFO:teuthology.orchestra.run.smithi008.stdout: ] 2023-08-01T19:55:45.972 INFO:teuthology.orchestra.run.smithi008.stdout: } 2023-08-01T19:55:45.972 INFO:teuthology.orchestra.run.smithi008.stdout: }, 2023-08-01T19:55:45.972 INFO:teuthology.orchestra.run.smithi008.stdout: { 2023-08-01T19:55:45.973 INFO:teuthology.orchestra.run.smithi008.stdout: "description": "osd_repop(client.4668.0:173567 5.e e54/19 5:7600b010:::benchmark_data_smithi006_114134_object39906:head v 54'10903, mlcod=54'10901)", 2023-08-01T19:55:45.973 INFO:teuthology.orchestra.run.smithi008.stdout: "initiated_at": "2023-08-01T19:55:45.895355+0000", 2023-08-01T19:55:45.973 INFO:teuthology.orchestra.run.smithi008.stdout: "age": 0.002744149, 2023-08-01T19:55:45.973 INFO:teuthology.orchestra.run.smithi008.stdout: "duration": 0.003433752, 2023-08-01T19:55:45.973 INFO:teuthology.orchestra.run.smithi008.stdout: "type_data": { 2023-08-01T19:55:45.973 INFO:teuthology.orchestra.run.smithi008.stdout: "flag_point": "started", 2023-08-01T19:55:45.973 INFO:teuthology.orchestra.run.smithi008.stdout: "events": [ 2023-08-01T19:55:45.974 INFO:teuthology.orchestra.run.smithi008.stdout: { 2023-08-01T19:55:45.974 INFO:teuthology.orchestra.run.smithi008.stdout: "event": "initiated", 2023-08-01T19:55:45.974 INFO:teuthology.orchestra.run.smithi008.stdout: "time": "2023-08-01T19:55:45.895355+0000", 2023-08-01T19:55:45.974 INFO:teuthology.orchestra.run.smithi008.stdout: "duration": 0 2023-08-01T19:55:45.974 INFO:teuthology.orchestra.run.smithi008.stdout: }, 2023-08-01T19:55:45.974 INFO:teuthology.orchestra.run.smithi008.stdout: { 2023-08-01T19:55:45.974 INFO:teuthology.orchestra.run.smithi008.stdout: "event": "throttled", 2023-08-01T19:55:45.974 INFO:teuthology.orchestra.run.smithi008.stdout: "time": "2023-08-01T19:55:45.895355+0000", 2023-08-01T19:55:45.975 INFO:teuthology.orchestra.run.smithi008.stdout: "duration": 0 2023-08-01T19:55:45.975 INFO:teuthology.orchestra.run.smithi008.stdout: }, 2023-08-01T19:55:45.975 INFO:teuthology.orchestra.run.smithi008.stdout: { 2023-08-01T19:55:45.975 INFO:teuthology.orchestra.run.smithi008.stdout: "event": "header_read", 2023-08-01T19:55:45.975 INFO:teuthology.orchestra.run.smithi008.stdout: "time": "2023-08-01T19:55:45.895354+0000", 2023-08-01T19:55:45.975 INFO:teuthology.orchestra.run.smithi008.stdout: "duration": 4294967295.9999995 2023-08-01T19:55:45.975 INFO:teuthology.orchestra.run.smithi008.stdout: }, 2023-08-01T19:55:45.975 INFO:teuthology.orchestra.run.smithi008.stdout: { 2023-08-01T19:55:45.976 INFO:teuthology.orchestra.run.smithi008.stdout: "event": "all_read", 2023-08-01T19:55:45.976 INFO:teuthology.orchestra.run.smithi008.stdout: "time": "2023-08-01T19:55:45.895359+0000", 2023-08-01T19:55:45.976 INFO:teuthology.orchestra.run.smithi008.stdout: "duration": 5.5450000000000003e-06 2023-08-01T19:55:45.976 INFO:teuthology.orchestra.run.smithi008.stdout: }, 2023-08-01T19:55:45.976 INFO:teuthology.orchestra.run.smithi008.stdout: { 2023-08-01T19:55:45.976 INFO:teuthology.orchestra.run.smithi008.stdout: "event": "dispatched", 2023-08-01T19:55:45.976 INFO:teuthology.orchestra.run.smithi008.stdout: "time": "2023-08-01T19:55:45.895372+0000", 2023-08-01T19:55:45.976 INFO:teuthology.orchestra.run.smithi008.stdout: "duration": 1.2626000000000001e-05 2023-08-01T19:55:45.977 INFO:teuthology.orchestra.run.smithi008.stdout: }, 2023-08-01T19:55:45.977 INFO:teuthology.orchestra.run.smithi008.stdout: { 2023-08-01T19:55:45.977 INFO:teuthology.orchestra.run.smithi008.stdout: "event": "queued_for_pg", 2023-08-01T19:55:45.977 INFO:teuthology.orchestra.run.smithi008.stdout: "time": "2023-08-01T19:55:45.895376+0000", 2023-08-01T19:55:45.977 INFO:teuthology.orchestra.run.smithi008.stdout: "duration": 4.425e-06 2023-08-01T19:55:45.977 INFO:teuthology.orchestra.run.smithi008.stdout: }, 2023-08-01T19:55:45.977 INFO:teuthology.orchestra.run.smithi008.stdout: { 2023-08-01T19:55:45.977 INFO:teuthology.orchestra.run.smithi008.stdout: "event": "reached_pg", 2023-08-01T19:55:45.978 INFO:teuthology.orchestra.run.smithi008.stdout: "time": "2023-08-01T19:55:45.895407+0000", 2023-08-01T19:55:45.978 INFO:teuthology.orchestra.run.smithi008.stdout: "duration": 3.0951999999999998e-05 2023-08-01T19:55:45.978 INFO:teuthology.orchestra.run.smithi008.stdout: }, 2023-08-01T19:55:45.978 INFO:teuthology.orchestra.run.smithi008.stdout: { 2023-08-01T19:55:45.978 INFO:teuthology.orchestra.run.smithi008.stdout: "event": "started", 2023-08-01T19:55:45.978 INFO:teuthology.orchestra.run.smithi008.stdout: "time": "2023-08-01T19:55:45.895420+0000", 2023-08-01T19:55:45.978 INFO:teuthology.orchestra.run.smithi008.stdout: "duration": 1.2553e-05 2023-08-01T19:55:45.978 INFO:teuthology.orchestra.run.smithi008.stdout: } 2023-08-01T19:55:45.979 INFO:teuthology.orchestra.run.smithi008.stdout: ] 2023-08-01T19:55:45.979 INFO:teuthology.orchestra.run.smithi008.stdout: } 2023-08-01T19:55:45.979 INFO:teuthology.orchestra.run.smithi008.stdout: }, 2023-08-01T19:55:45.979 INFO:teuthology.orchestra.run.smithi008.stdout: { 2023-08-01T19:55:45.979 INFO:teuthology.orchestra.run.smithi008.stdout: "description": "osd_repop(client.4668.0:173566 5.1 e54/53 5:8858f5e3:::benchmark_data_smithi006_114134_object39905:head v 54'10782, mlcod=54'10777)", 2023-08-01T19:55:45.979 INFO:teuthology.orchestra.run.smithi008.stdout: "initiated_at": "2023-08-01T19:55:45.895574+0000", 2023-08-01T19:55:45.979 INFO:teuthology.orchestra.run.smithi008.stdout: "age": 0.002524699, 2023-08-01T19:55:45.980 INFO:teuthology.orchestra.run.smithi008.stdout: "duration": 0.0032752660000000002, 2023-08-01T19:55:45.980 INFO:teuthology.orchestra.run.smithi008.stdout: "type_data": { 2023-08-01T19:55:45.980 INFO:teuthology.orchestra.run.smithi008.stdout: "flag_point": "started", 2023-08-01T19:55:45.980 INFO:teuthology.orchestra.run.smithi008.stdout: "events": [ 2023-08-01T19:55:45.980 INFO:teuthology.orchestra.run.smithi008.stdout: { 2023-08-01T19:55:45.980 INFO:teuthology.orchestra.run.smithi008.stdout: "event": "initiated", 2023-08-01T19:55:45.980 INFO:teuthology.orchestra.run.smithi008.stdout: "time": "2023-08-01T19:55:45.895574+0000", 2023-08-01T19:55:45.980 INFO:teuthology.orchestra.run.smithi008.stdout: "duration": 0 2023-08-01T19:55:45.981 INFO:teuthology.orchestra.run.smithi008.stdout: }, 2023-08-01T19:55:45.981 INFO:teuthology.orchestra.run.smithi008.stdout: { 2023-08-01T19:55:45.981 INFO:teuthology.orchestra.run.smithi008.stdout: "event": "throttled", 2023-08-01T19:55:45.981 INFO:teuthology.orchestra.run.smithi008.stdout: "time": "2023-08-01T19:55:45.895574+0000", 2023-08-01T19:55:45.981 INFO:teuthology.orchestra.run.smithi008.stdout: "duration": 0 2023-08-01T19:55:45.981 INFO:teuthology.orchestra.run.smithi008.stdout: }, 2023-08-01T19:55:45.981 INFO:teuthology.orchestra.run.smithi008.stdout: { 2023-08-01T19:55:45.981 INFO:teuthology.orchestra.run.smithi008.stdout: "event": "header_read", 2023-08-01T19:55:45.982 INFO:teuthology.orchestra.run.smithi008.stdout: "time": "2023-08-01T19:55:45.895573+0000", 2023-08-01T19:55:45.982 INFO:teuthology.orchestra.run.smithi008.stdout: "duration": 4294967295.9999995 2023-08-01T19:55:45.982 INFO:teuthology.orchestra.run.smithi008.stdout: }, 2023-08-01T19:55:45.982 INFO:teuthology.orchestra.run.smithi008.stdout: { 2023-08-01T19:55:45.982 INFO:teuthology.orchestra.run.smithi008.stdout: "event": "all_read", 2023-08-01T19:55:45.982 INFO:teuthology.orchestra.run.smithi008.stdout: "time": "2023-08-01T19:55:45.895579+0000", 2023-08-01T19:55:45.982 INFO:teuthology.orchestra.run.smithi008.stdout: "duration": 5.4920000000000001e-06 2023-08-01T19:55:45.982 INFO:teuthology.orchestra.run.smithi008.stdout: }, 2023-08-01T19:55:45.983 INFO:teuthology.orchestra.run.smithi008.stdout: { 2023-08-01T19:55:45.983 INFO:teuthology.orchestra.run.smithi008.stdout: "event": "dispatched", 2023-08-01T19:55:45.983 INFO:teuthology.orchestra.run.smithi008.stdout: "time": "2023-08-01T19:55:45.895589+0000", 2023-08-01T19:55:45.983 INFO:teuthology.orchestra.run.smithi008.stdout: "duration": 1.0409e-05 2023-08-01T19:55:45.983 INFO:teuthology.orchestra.run.smithi008.stdout: }, 2023-08-01T19:55:45.983 INFO:teuthology.orchestra.run.smithi008.stdout: { 2023-08-01T19:55:45.983 INFO:teuthology.orchestra.run.smithi008.stdout: "event": "queued_for_pg", 2023-08-01T19:55:45.983 INFO:teuthology.orchestra.run.smithi008.stdout: "time": "2023-08-01T19:55:45.895595+0000", 2023-08-01T19:55:45.984 INFO:teuthology.orchestra.run.smithi008.stdout: "duration": 5.2519999999999999e-06 2023-08-01T19:55:45.984 INFO:teuthology.orchestra.run.smithi008.stdout: }, 2023-08-01T19:55:45.984 INFO:teuthology.orchestra.run.smithi008.stdout: { 2023-08-01T19:55:45.984 INFO:teuthology.orchestra.run.smithi008.stdout: "event": "reached_pg", 2023-08-01T19:55:45.984 INFO:teuthology.orchestra.run.smithi008.stdout: "time": "2023-08-01T19:55:45.895762+0000", 2023-08-01T19:55:45.984 INFO:teuthology.orchestra.run.smithi008.stdout: "duration": 0.000167558 2023-08-01T19:55:45.984 INFO:teuthology.orchestra.run.smithi008.stdout: }, 2023-08-01T19:55:45.985 INFO:teuthology.orchestra.run.smithi008.stdout: { 2023-08-01T19:55:45.985 INFO:teuthology.orchestra.run.smithi008.stdout: "event": "started", 2023-08-01T19:55:45.985 INFO:teuthology.orchestra.run.smithi008.stdout: "time": "2023-08-01T19:55:45.895781+0000", 2023-08-01T19:55:45.985 INFO:teuthology.orchestra.run.smithi008.stdout: "duration": 1.8589000000000001e-05 2023-08-01T19:55:45.985 INFO:teuthology.orchestra.run.smithi008.stdout: } 2023-08-01T19:55:45.985 INFO:teuthology.orchestra.run.smithi008.stdout: ] 2023-08-01T19:55:45.985 INFO:teuthology.orchestra.run.smithi008.stdout: } 2023-08-01T19:55:45.985 INFO:teuthology.orchestra.run.smithi008.stdout: }, 2023-08-01T19:55:45.986 INFO:teuthology.orchestra.run.smithi008.stdout: { 2023-08-01T19:55:45.986 INFO:teuthology.orchestra.run.smithi008.stdout: "description": "osd_repop(client.4668.0:173570 5.b e54/19 5:d10c1be1:::benchmark_data_smithi006_114134_object39909:head v 54'10766, mlcod=54'10763)", 2023-08-01T19:55:45.986 INFO:teuthology.orchestra.run.smithi008.stdout: "initiated_at": "2023-08-01T19:55:45.897658+0000", 2023-08-01T19:55:45.986 INFO:teuthology.orchestra.run.smithi008.stdout: "age": 0.00044111600000000002, 2023-08-01T19:55:45.986 INFO:teuthology.orchestra.run.smithi008.stdout: "duration": 0.0012509929999999999, 2023-08-01T19:55:45.986 INFO:teuthology.orchestra.run.smithi008.stdout: "type_data": { 2023-08-01T19:55:45.986 INFO:teuthology.orchestra.run.smithi008.stdout: "flag_point": "started", 2023-08-01T19:55:45.986 INFO:teuthology.orchestra.run.smithi008.stdout: "events": [ 2023-08-01T19:55:45.987 INFO:teuthology.orchestra.run.smithi008.stdout: { 2023-08-01T19:55:45.987 INFO:teuthology.orchestra.run.smithi008.stdout: "event": "initiated", 2023-08-01T19:55:45.987 INFO:teuthology.orchestra.run.smithi008.stdout: "time": "2023-08-01T19:55:45.897658+0000", 2023-08-01T19:55:45.987 INFO:teuthology.orchestra.run.smithi008.stdout: "duration": 0 2023-08-01T19:55:45.987 INFO:teuthology.orchestra.run.smithi008.stdout: }, 2023-08-01T19:55:45.987 INFO:teuthology.orchestra.run.smithi008.stdout: { 2023-08-01T19:55:45.987 INFO:teuthology.orchestra.run.smithi008.stdout: "event": "throttled", 2023-08-01T19:55:45.987 INFO:teuthology.orchestra.run.smithi008.stdout: "time": "2023-08-01T19:55:45.897658+0000", 2023-08-01T19:55:45.988 INFO:teuthology.orchestra.run.smithi008.stdout: "duration": 0 2023-08-01T19:55:45.988 INFO:teuthology.orchestra.run.smithi008.stdout: }, 2023-08-01T19:55:45.988 INFO:teuthology.orchestra.run.smithi008.stdout: { 2023-08-01T19:55:45.988 INFO:teuthology.orchestra.run.smithi008.stdout: "event": "header_read", 2023-08-01T19:55:45.988 INFO:teuthology.orchestra.run.smithi008.stdout: "time": "2023-08-01T19:55:45.897657+0000", 2023-08-01T19:55:45.988 INFO:teuthology.orchestra.run.smithi008.stdout: "duration": 4294967295.9999995 2023-08-01T19:55:45.988 INFO:teuthology.orchestra.run.smithi008.stdout: }, 2023-08-01T19:55:45.989 INFO:teuthology.orchestra.run.smithi008.stdout: { 2023-08-01T19:55:45.989 INFO:teuthology.orchestra.run.smithi008.stdout: "event": "all_read", 2023-08-01T19:55:45.989 INFO:teuthology.orchestra.run.smithi008.stdout: "time": "2023-08-01T19:55:45.897661+0000", 2023-08-01T19:55:45.989 INFO:teuthology.orchestra.run.smithi008.stdout: "duration": 4.2939999999999999e-06 2023-08-01T19:55:45.989 INFO:teuthology.orchestra.run.smithi008.stdout: }, 2023-08-01T19:55:45.989 INFO:teuthology.orchestra.run.smithi008.stdout: { 2023-08-01T19:55:45.989 INFO:teuthology.orchestra.run.smithi008.stdout: "event": "dispatched", 2023-08-01T19:55:45.989 INFO:teuthology.orchestra.run.smithi008.stdout: "time": "2023-08-01T19:55:45.897669+0000", 2023-08-01T19:55:45.990 INFO:teuthology.orchestra.run.smithi008.stdout: "duration": 7.7819999999999994e-06 2023-08-01T19:55:45.990 INFO:teuthology.orchestra.run.smithi008.stdout: }, 2023-08-01T19:55:45.990 INFO:teuthology.orchestra.run.smithi008.stdout: { 2023-08-01T19:55:45.990 INFO:teuthology.orchestra.run.smithi008.stdout: "event": "queued_for_pg", 2023-08-01T19:55:45.990 INFO:teuthology.orchestra.run.smithi008.stdout: "time": "2023-08-01T19:55:45.897673+0000", 2023-08-01T19:55:45.990 INFO:teuthology.orchestra.run.smithi008.stdout: "duration": 3.9999999999999998e-06 2023-08-01T19:55:45.990 INFO:teuthology.orchestra.run.smithi008.stdout: }, 2023-08-01T19:55:45.990 INFO:teuthology.orchestra.run.smithi008.stdout: { 2023-08-01T19:55:45.991 INFO:teuthology.orchestra.run.smithi008.stdout: "event": "reached_pg", 2023-08-01T19:55:45.991 INFO:teuthology.orchestra.run.smithi008.stdout: "time": "2023-08-01T19:55:45.897710+0000", 2023-08-01T19:55:45.991 INFO:teuthology.orchestra.run.smithi008.stdout: "duration": 3.7320000000000002e-05 2023-08-01T19:55:45.991 INFO:teuthology.orchestra.run.smithi008.stdout: }, 2023-08-01T19:55:45.991 INFO:teuthology.orchestra.run.smithi008.stdout: { 2023-08-01T19:55:45.991 INFO:teuthology.orchestra.run.smithi008.stdout: "event": "started", 2023-08-01T19:55:45.991 INFO:teuthology.orchestra.run.smithi008.stdout: "time": "2023-08-01T19:55:45.897728+0000", 2023-08-01T19:55:45.992 INFO:teuthology.orchestra.run.smithi008.stdout: "duration": 1.7169000000000001e-05 2023-08-01T19:55:45.992 INFO:teuthology.orchestra.run.smithi008.stdout: } 2023-08-01T19:55:45.992 INFO:teuthology.orchestra.run.smithi008.stdout: ] 2023-08-01T19:55:45.992 INFO:teuthology.orchestra.run.smithi008.stdout: } 2023-08-01T19:55:45.992 INFO:teuthology.orchestra.run.smithi008.stdout: }, 2023-08-01T19:55:45.992 INFO:teuthology.orchestra.run.smithi008.stdout: { 2023-08-01T19:55:45.992 INFO:teuthology.orchestra.run.smithi008.stdout: "description": "osd_repop(client.4668.0:173568 5.0 e54/19 5:0d34052a:::benchmark_data_smithi006_114134_object39907:head v 54'11021, mlcod=54'11017)", 2023-08-01T19:55:45.992 INFO:teuthology.orchestra.run.smithi008.stdout: "initiated_at": "2023-08-01T19:55:45.897682+0000", 2023-08-01T19:55:45.993 INFO:teuthology.orchestra.run.smithi008.stdout: "age": 0.00041666400000000002, 2023-08-01T19:55:45.993 INFO:teuthology.orchestra.run.smithi008.stdout: "duration": 0.001286361, 2023-08-01T19:55:45.993 INFO:teuthology.orchestra.run.smithi008.stdout: "type_data": { 2023-08-01T19:55:45.993 INFO:teuthology.orchestra.run.smithi008.stdout: "flag_point": "started", 2023-08-01T19:55:45.993 INFO:teuthology.orchestra.run.smithi008.stdout: "events": [ 2023-08-01T19:55:45.993 INFO:teuthology.orchestra.run.smithi008.stdout: { 2023-08-01T19:55:45.993 INFO:teuthology.orchestra.run.smithi008.stdout: "event": "initiated", 2023-08-01T19:55:45.994 INFO:teuthology.orchestra.run.smithi008.stdout: "time": "2023-08-01T19:55:45.897682+0000", 2023-08-01T19:55:45.994 INFO:teuthology.orchestra.run.smithi008.stdout: "duration": 0 2023-08-01T19:55:45.994 INFO:teuthology.orchestra.run.smithi008.stdout: }, 2023-08-01T19:55:45.994 INFO:teuthology.orchestra.run.smithi008.stdout: { 2023-08-01T19:55:45.994 INFO:teuthology.orchestra.run.smithi008.stdout: "event": "throttled", 2023-08-01T19:55:45.994 INFO:teuthology.orchestra.run.smithi008.stdout: "time": "2023-08-01T19:55:45.897682+0000", 2023-08-01T19:55:45.994 INFO:teuthology.orchestra.run.smithi008.stdout: "duration": 0 2023-08-01T19:55:45.994 INFO:teuthology.orchestra.run.smithi008.stdout: }, 2023-08-01T19:55:45.995 INFO:teuthology.orchestra.run.smithi008.stdout: { 2023-08-01T19:55:45.995 INFO:teuthology.orchestra.run.smithi008.stdout: "event": "header_read", 2023-08-01T19:55:45.995 INFO:teuthology.orchestra.run.smithi008.stdout: "time": "2023-08-01T19:55:45.897682+0000", 2023-08-01T19:55:45.995 INFO:teuthology.orchestra.run.smithi008.stdout: "duration": 4294967295.9999995 2023-08-01T19:55:45.995 INFO:teuthology.orchestra.run.smithi008.stdout: }, 2023-08-01T19:55:45.995 INFO:teuthology.orchestra.run.smithi008.stdout: { 2023-08-01T19:55:45.995 INFO:teuthology.orchestra.run.smithi008.stdout: "event": "all_read", 2023-08-01T19:55:45.995 INFO:teuthology.orchestra.run.smithi008.stdout: "time": "2023-08-01T19:55:45.897685+0000", 2023-08-01T19:55:45.996 INFO:teuthology.orchestra.run.smithi008.stdout: "duration": 2.864e-06 2023-08-01T19:55:45.996 INFO:teuthology.orchestra.run.smithi008.stdout: }, 2023-08-01T19:55:45.996 INFO:teuthology.orchestra.run.smithi008.stdout: { 2023-08-01T19:55:45.996 INFO:teuthology.orchestra.run.smithi008.stdout: "event": "dispatched", 2023-08-01T19:55:45.996 INFO:teuthology.orchestra.run.smithi008.stdout: "time": "2023-08-01T19:55:45.897688+0000", 2023-08-01T19:55:45.996 INFO:teuthology.orchestra.run.smithi008.stdout: "duration": 3.5549999999999998e-06 2023-08-01T19:55:45.996 INFO:teuthology.orchestra.run.smithi008.stdout: }, 2023-08-01T19:55:45.997 INFO:teuthology.orchestra.run.smithi008.stdout: { 2023-08-01T19:55:45.997 INFO:teuthology.orchestra.run.smithi008.stdout: "event": "queued_for_pg", 2023-08-01T19:55:45.997 INFO:teuthology.orchestra.run.smithi008.stdout: "time": "2023-08-01T19:55:45.897691+0000", 2023-08-01T19:55:45.997 INFO:teuthology.orchestra.run.smithi008.stdout: "duration": 3.3450000000000002e-06 2023-08-01T19:55:45.997 INFO:teuthology.orchestra.run.smithi008.stdout: }, 2023-08-01T19:55:45.997 INFO:teuthology.orchestra.run.smithi008.stdout: { 2023-08-01T19:55:45.997 INFO:teuthology.orchestra.run.smithi008.stdout: "event": "reached_pg", 2023-08-01T19:55:45.997 INFO:teuthology.orchestra.run.smithi008.stdout: "time": "2023-08-01T19:55:45.897731+0000", 2023-08-01T19:55:45.998 INFO:teuthology.orchestra.run.smithi008.stdout: "duration": 3.9591000000000001e-05 2023-08-01T19:55:45.998 INFO:teuthology.orchestra.run.smithi008.stdout: }, 2023-08-01T19:55:45.998 INFO:teuthology.orchestra.run.smithi008.stdout: { 2023-08-01T19:55:45.998 INFO:teuthology.orchestra.run.smithi008.stdout: "event": "started", 2023-08-01T19:55:45.998 INFO:teuthology.orchestra.run.smithi008.stdout: "time": "2023-08-01T19:55:45.897749+0000", 2023-08-01T19:55:45.998 INFO:teuthology.orchestra.run.smithi008.stdout: "duration": 1.8437e-05 2023-08-01T19:55:45.998 INFO:teuthology.orchestra.run.smithi008.stdout: } 2023-08-01T19:55:45.998 INFO:teuthology.orchestra.run.smithi008.stdout: ] 2023-08-01T19:55:45.999 INFO:teuthology.orchestra.run.smithi008.stdout: } 2023-08-01T19:55:45.999 INFO:teuthology.orchestra.run.smithi008.stdout: }, 2023-08-01T19:55:45.999 INFO:teuthology.orchestra.run.smithi008.stdout: { 2023-08-01T19:55:45.999 INFO:teuthology.orchestra.run.smithi008.stdout: "description": "osd_repop(client.4668.0:173569 5.4 e54/19 5:209b4b60:::benchmark_data_smithi006_114134_object39908:head v 54'10726, mlcod=54'10723)", 2023-08-01T19:55:45.999 INFO:teuthology.orchestra.run.smithi008.stdout: "initiated_at": "2023-08-01T19:55:45.897700+0000", 2023-08-01T19:55:45.999 INFO:teuthology.orchestra.run.smithi008.stdout: "age": 0.00039911599999999998, 2023-08-01T19:55:45.999 INFO:teuthology.orchestra.run.smithi008.stdout: "duration": 0.0013284530000000001, 2023-08-01T19:55:45.999 INFO:teuthology.orchestra.run.smithi008.stdout: "type_data": { 2023-08-01T19:55:46.000 INFO:teuthology.orchestra.run.smithi008.stdout: "flag_point": "started", 2023-08-01T19:55:46.000 INFO:teuthology.orchestra.run.smithi008.stdout: "events": [ 2023-08-01T19:55:46.000 INFO:teuthology.orchestra.run.smithi008.stdout: { 2023-08-01T19:55:46.000 INFO:teuthology.orchestra.run.smithi008.stdout: "event": "initiated", 2023-08-01T19:55:46.000 INFO:teuthology.orchestra.run.smithi008.stdout: "time": "2023-08-01T19:55:45.897700+0000", 2023-08-01T19:55:46.000 INFO:teuthology.orchestra.run.smithi008.stdout: "duration": 0 2023-08-01T19:55:46.000 INFO:teuthology.orchestra.run.smithi008.stdout: }, 2023-08-01T19:55:46.001 INFO:teuthology.orchestra.run.smithi008.stdout: { 2023-08-01T19:55:46.001 INFO:teuthology.orchestra.run.smithi008.stdout: "event": "throttled", 2023-08-01T19:55:46.001 INFO:teuthology.orchestra.run.smithi008.stdout: "time": "2023-08-01T19:55:45.897700+0000", 2023-08-01T19:55:46.001 INFO:teuthology.orchestra.run.smithi008.stdout: "duration": 0 2023-08-01T19:55:46.001 INFO:teuthology.orchestra.run.smithi008.stdout: }, 2023-08-01T19:55:46.001 INFO:teuthology.orchestra.run.smithi008.stdout: { 2023-08-01T19:55:46.001 INFO:teuthology.orchestra.run.smithi008.stdout: "event": "header_read", 2023-08-01T19:55:46.001 INFO:teuthology.orchestra.run.smithi008.stdout: "time": "2023-08-01T19:55:45.897699+0000", 2023-08-01T19:55:46.002 INFO:teuthology.orchestra.run.smithi008.stdout: "duration": 4294967296 2023-08-01T19:55:46.002 INFO:teuthology.orchestra.run.smithi008.stdout: }, 2023-08-01T19:55:46.002 INFO:teuthology.orchestra.run.smithi008.stdout: { 2023-08-01T19:55:46.002 INFO:teuthology.orchestra.run.smithi008.stdout: "event": "all_read", 2023-08-01T19:55:46.002 INFO:teuthology.orchestra.run.smithi008.stdout: "time": "2023-08-01T19:55:45.897702+0000", 2023-08-01T19:55:46.002 INFO:teuthology.orchestra.run.smithi008.stdout: "duration": 2.4260000000000002e-06 2023-08-01T19:55:46.002 INFO:teuthology.orchestra.run.smithi008.stdout: }, 2023-08-01T19:55:46.002 INFO:teuthology.orchestra.run.smithi008.stdout: { 2023-08-01T19:55:46.003 INFO:teuthology.orchestra.run.smithi008.stdout: "event": "dispatched", 2023-08-01T19:55:46.003 INFO:teuthology.orchestra.run.smithi008.stdout: "time": "2023-08-01T19:55:45.897705+0000", 2023-08-01T19:55:46.003 INFO:teuthology.orchestra.run.smithi008.stdout: "duration": 3.3440000000000001e-06 2023-08-01T19:55:46.003 INFO:teuthology.orchestra.run.smithi008.stdout: }, 2023-08-01T19:55:46.003 INFO:teuthology.orchestra.run.smithi008.stdout: { 2023-08-01T19:55:46.003 INFO:teuthology.orchestra.run.smithi008.stdout: "event": "queued_for_pg", 2023-08-01T19:55:46.003 INFO:teuthology.orchestra.run.smithi008.stdout: "time": "2023-08-01T19:55:45.897722+0000", 2023-08-01T19:55:46.003 INFO:teuthology.orchestra.run.smithi008.stdout: "duration": 1.7255e-05 2023-08-01T19:55:46.004 INFO:teuthology.orchestra.run.smithi008.stdout: }, 2023-08-01T19:55:46.004 INFO:teuthology.orchestra.run.smithi008.stdout: { 2023-08-01T19:55:46.004 INFO:teuthology.orchestra.run.smithi008.stdout: "event": "reached_pg", 2023-08-01T19:55:46.004 INFO:teuthology.orchestra.run.smithi008.stdout: "time": "2023-08-01T19:55:45.897755+0000", 2023-08-01T19:55:46.004 INFO:teuthology.orchestra.run.smithi008.stdout: "duration": 3.2855999999999998e-05 2023-08-01T19:55:46.004 INFO:teuthology.orchestra.run.smithi008.stdout: }, 2023-08-01T19:55:46.004 INFO:teuthology.orchestra.run.smithi008.stdout: { 2023-08-01T19:55:46.005 INFO:teuthology.orchestra.run.smithi008.stdout: "event": "started", 2023-08-01T19:55:46.005 INFO:teuthology.orchestra.run.smithi008.stdout: "time": "2023-08-01T19:55:45.897766+0000", 2023-08-01T19:55:46.005 INFO:teuthology.orchestra.run.smithi008.stdout: "duration": 1.1219999999999999e-05 2023-08-01T19:55:46.005 INFO:teuthology.orchestra.run.smithi008.stdout: } 2023-08-01T19:55:46.005 INFO:teuthology.orchestra.run.smithi008.stdout: ] 2023-08-01T19:55:46.005 INFO:teuthology.orchestra.run.smithi008.stdout: } 2023-08-01T19:55:46.005 INFO:teuthology.orchestra.run.smithi008.stdout: }, 2023-08-01T19:55:46.005 INFO:teuthology.orchestra.run.smithi008.stdout: { 2023-08-01T19:55:46.006 INFO:teuthology.orchestra.run.smithi008.stdout: "description": "osd_repop(client.4668.0:173571 5.8 e54/19 5:1b408e26:::benchmark_data_smithi006_114134_object39910:head v 54'10901, mlcod=54'10899)", 2023-08-01T19:55:46.006 INFO:teuthology.orchestra.run.smithi008.stdout: "initiated_at": "2023-08-01T19:55:45.897999+0000", 2023-08-01T19:55:46.006 INFO:teuthology.orchestra.run.smithi008.stdout: "age": 9.9758000000000003e-05, 2023-08-01T19:55:46.006 INFO:teuthology.orchestra.run.smithi008.stdout: "duration": 0.0010925100000000001, 2023-08-01T19:55:46.006 INFO:teuthology.orchestra.run.smithi008.stdout: "type_data": { 2023-08-01T19:55:46.006 INFO:teuthology.orchestra.run.smithi008.stdout: "flag_point": "started", 2023-08-01T19:55:46.006 INFO:teuthology.orchestra.run.smithi008.stdout: "events": [ 2023-08-01T19:55:46.007 INFO:teuthology.orchestra.run.smithi008.stdout: { 2023-08-01T19:55:46.007 INFO:teuthology.orchestra.run.smithi008.stdout: "event": "initiated", 2023-08-01T19:55:46.007 INFO:teuthology.orchestra.run.smithi008.stdout: "time": "2023-08-01T19:55:45.897999+0000", 2023-08-01T19:55:46.007 INFO:teuthology.orchestra.run.smithi008.stdout: "duration": 0 2023-08-01T19:55:46.007 INFO:teuthology.orchestra.run.smithi008.stdout: }, 2023-08-01T19:55:46.007 INFO:teuthology.orchestra.run.smithi008.stdout: { 2023-08-01T19:55:46.007 INFO:teuthology.orchestra.run.smithi008.stdout: "event": "throttled", 2023-08-01T19:55:46.008 INFO:teuthology.orchestra.run.smithi008.stdout: "time": "2023-08-01T19:55:45.897999+0000", 2023-08-01T19:55:46.008 INFO:teuthology.orchestra.run.smithi008.stdout: "duration": 0 2023-08-01T19:55:46.008 INFO:teuthology.orchestra.run.smithi008.stdout: }, 2023-08-01T19:55:46.008 INFO:teuthology.orchestra.run.smithi008.stdout: { 2023-08-01T19:55:46.008 INFO:teuthology.orchestra.run.smithi008.stdout: "event": "header_read", 2023-08-01T19:55:46.008 INFO:teuthology.orchestra.run.smithi008.stdout: "time": "2023-08-01T19:55:45.897998+0000", 2023-08-01T19:55:46.009 INFO:teuthology.orchestra.run.smithi008.stdout: "duration": 4294967295.9999995 2023-08-01T19:55:46.009 INFO:teuthology.orchestra.run.smithi008.stdout: }, 2023-08-01T19:55:46.009 INFO:teuthology.orchestra.run.smithi008.stdout: { 2023-08-01T19:55:46.009 INFO:teuthology.orchestra.run.smithi008.stdout: "event": "all_read", 2023-08-01T19:55:46.009 INFO:teuthology.orchestra.run.smithi008.stdout: "time": "2023-08-01T19:55:45.898003+0000", 2023-08-01T19:55:46.009 INFO:teuthology.orchestra.run.smithi008.stdout: "duration": 5.0730000000000004e-06 2023-08-01T19:55:46.009 INFO:teuthology.orchestra.run.smithi008.stdout: }, 2023-08-01T19:55:46.010 INFO:teuthology.orchestra.run.smithi008.stdout: { 2023-08-01T19:55:46.010 INFO:teuthology.orchestra.run.smithi008.stdout: "event": "dispatched", 2023-08-01T19:55:46.010 INFO:teuthology.orchestra.run.smithi008.stdout: "time": "2023-08-01T19:55:45.898014+0000", 2023-08-01T19:55:46.010 INFO:teuthology.orchestra.run.smithi008.stdout: "duration": 1.0556e-05 2023-08-01T19:55:46.010 INFO:teuthology.orchestra.run.smithi008.stdout: }, 2023-08-01T19:55:46.010 INFO:teuthology.orchestra.run.smithi008.stdout: { 2023-08-01T19:55:46.010 INFO:teuthology.orchestra.run.smithi008.stdout: "event": "queued_for_pg", 2023-08-01T19:55:46.010 INFO:teuthology.orchestra.run.smithi008.stdout: "time": "2023-08-01T19:55:45.898019+0000", 2023-08-01T19:55:46.011 INFO:teuthology.orchestra.run.smithi008.stdout: "duration": 4.8130000000000003e-06 2023-08-01T19:55:46.011 INFO:teuthology.orchestra.run.smithi008.stdout: }, 2023-08-01T19:55:46.011 INFO:teuthology.orchestra.run.smithi008.stdout: { 2023-08-01T19:55:46.011 INFO:teuthology.orchestra.run.smithi008.stdout: "event": "reached_pg", 2023-08-01T19:55:46.011 INFO:teuthology.orchestra.run.smithi008.stdout: "time": "2023-08-01T19:55:45.898054+0000", 2023-08-01T19:55:46.011 INFO:teuthology.orchestra.run.smithi008.stdout: "duration": 3.5703e-05 2023-08-01T19:55:46.011 INFO:teuthology.orchestra.run.smithi008.stdout: }, 2023-08-01T19:55:46.011 INFO:teuthology.orchestra.run.smithi008.stdout: { 2023-08-01T19:55:46.012 INFO:teuthology.orchestra.run.smithi008.stdout: "event": "started", 2023-08-01T19:55:46.012 INFO:teuthology.orchestra.run.smithi008.stdout: "time": "2023-08-01T19:55:45.898073+0000", 2023-08-01T19:55:46.012 INFO:teuthology.orchestra.run.smithi008.stdout: "duration": 1.8882999999999999e-05 2023-08-01T19:55:46.012 INFO:teuthology.orchestra.run.smithi008.stdout: } 2023-08-01T19:55:46.012 INFO:teuthology.orchestra.run.smithi008.stdout: ] 2023-08-01T19:55:46.012 INFO:teuthology.orchestra.run.smithi008.stdout: } 2023-08-01T19:55:46.012 INFO:teuthology.orchestra.run.smithi008.stdout: } 2023-08-01T19:55:46.012 INFO:teuthology.orchestra.run.smithi008.stdout: ], 2023-08-01T19:55:46.013 INFO:teuthology.orchestra.run.smithi008.stdout: "num_ops": 16 2023-08-01T19:55:46.013 INFO:teuthology.orchestra.run.smithi008.stdout:} 2023-08-01T19:55:46.014 DEBUG:teuthology.orchestra.run.smithi008:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 30 ceph --cluster ceph --admin-daemon /var/run/ceph/ceph-osd.0.asok dump_blocked_ops 2023-08-01T19:55:46.015 INFO:tasks.ceph.osd.1.smithi101.stderr:2023-08-01T19:55:46.012+0000 7fb0cb7f6700 -1 received signal: Hangup from /usr/bin/python3 /bin/daemon-helper kill ceph-osd -f --cluster ceph -i 1 (PID: 111141) UID: 0 2023-08-01T19:55:46.081 INFO:teuthology.orchestra.run.smithi006.stderr:noscrub is set 2023-08-01T19:55:46.114 INFO:tasks.ceph.osd.2.smithi155.stderr:2023-08-01T19:55:46.113+0000 7faa5c6ac700 -1 received signal: Hangup from /usr/bin/python3 /bin/daemon-helper kill ceph-osd -f --cluster ceph -i 2 (PID: 111337) UID: 0 2023-08-01T19:55:46.203 INFO:teuthology.orchestra.run.smithi008.stdout:{ 2023-08-01T19:55:46.203 INFO:teuthology.orchestra.run.smithi008.stdout: "ops": [], 2023-08-01T19:55:46.203 INFO:teuthology.orchestra.run.smithi008.stdout: "complaint_time": 30, 2023-08-01T19:55:46.203 INFO:teuthology.orchestra.run.smithi008.stdout: "num_blocked_ops": 0 2023-08-01T19:55:46.204 INFO:teuthology.orchestra.run.smithi008.stdout:} 2023-08-01T19:55:46.216 INFO:tasks.ceph.osd.0.smithi008.stderr:2023-08-01T19:55:46.215+0000 7f16a58f4700 -1 received signal: Hangup from /usr/bin/python3 /bin/daemon-helper kill ceph-osd -f --cluster ceph -i 0 (PID: 111179) UID: 0 2023-08-01T19:55:46.218 DEBUG:teuthology.orchestra.run.smithi008:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 30 ceph --cluster ceph --admin-daemon /var/run/ceph/ceph-osd.0.asok dump_historic_ops 2023-08-01T19:55:46.316 INFO:tasks.ceph.osd.1.smithi101.stderr:2023-08-01T19:55:46.315+0000 7fb0cb7f6700 -1 received signal: Hangup from /usr/bin/python3 /bin/daemon-helper kill ceph-osd -f --cluster ceph -i 1 (PID: 111141) UID: 0 2023-08-01T19:55:46.366 DEBUG:teuthology.orchestra.run.smithi006:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 120 ceph --cluster ceph -- tell 'osd.*' injectargs --osd_enable_op_tracker=false 2023-08-01T19:55:46.417 INFO:tasks.ceph.osd.0.smithi008.stderr:2023-08-01T19:55:46.415+0000 7f16a58f4700 -1 received signal: Hangup from /usr/bin/python3 /bin/daemon-helper kill ceph-osd -f --cluster ceph -i 0 (PID: 111179) UID: 0 2023-08-01T19:55:46.452 INFO:teuthology.orchestra.run.smithi008.stdout:{ 2023-08-01T19:55:46.452 INFO:teuthology.orchestra.run.smithi008.stdout: "size": 20, 2023-08-01T19:55:46.452 INFO:teuthology.orchestra.run.smithi008.stdout: "duration": 600, 2023-08-01T19:55:46.453 INFO:teuthology.orchestra.run.smithi008.stdout: "ops": [ 2023-08-01T19:55:46.453 INFO:teuthology.orchestra.run.smithi008.stdout: { 2023-08-01T19:55:46.453 INFO:teuthology.orchestra.run.smithi008.stdout: "description": "osd_op(client.4668.0:100240 5.a 5:5313c5b9:::benchmark_data_smithi006_114134_object100239:head [set-alloc-hint object_size 65536 write_size 65536,write 0~65536] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e37)", 2023-08-01T19:55:46.453 INFO:teuthology.orchestra.run.smithi008.stdout: "initiated_at": "2023-08-01T19:55:05.148399+0000", 2023-08-01T19:55:46.453 INFO:teuthology.orchestra.run.smithi008.stdout: "age": 41.299572624, 2023-08-01T19:55:46.453 INFO:teuthology.orchestra.run.smithi008.stdout: "duration": 0.077278904999999995, 2023-08-01T19:55:46.454 INFO:teuthology.orchestra.run.smithi008.stdout: "type_data": { 2023-08-01T19:55:46.454 INFO:teuthology.orchestra.run.smithi008.stdout: "flag_point": "commit sent; apply or cleanup", 2023-08-01T19:55:46.454 INFO:teuthology.orchestra.run.smithi008.stdout: "client_info": { 2023-08-01T19:55:46.454 INFO:teuthology.orchestra.run.smithi008.stdout: "client": "client.4668", 2023-08-01T19:55:46.454 INFO:teuthology.orchestra.run.smithi008.stdout: "client_addr": "172.21.15.6:0/1709472247", 2023-08-01T19:55:46.455 INFO:teuthology.orchestra.run.smithi008.stdout: "tid": 100240 2023-08-01T19:55:46.455 INFO:teuthology.orchestra.run.smithi008.stdout: }, 2023-08-01T19:55:46.455 INFO:teuthology.orchestra.run.smithi008.stdout: "events": [ 2023-08-01T19:55:46.455 INFO:teuthology.orchestra.run.smithi008.stdout: { 2023-08-01T19:55:46.455 INFO:teuthology.orchestra.run.smithi008.stdout: "event": "initiated", 2023-08-01T19:55:46.455 INFO:teuthology.orchestra.run.smithi008.stdout: "time": "2023-08-01T19:55:05.148399+0000", 2023-08-01T19:55:46.455 INFO:teuthology.orchestra.run.smithi008.stdout: "duration": 0 2023-08-01T19:55:46.456 INFO:teuthology.orchestra.run.smithi008.stdout: }, 2023-08-01T19:55:46.456 INFO:teuthology.orchestra.run.smithi008.stdout: { 2023-08-01T19:55:46.456 INFO:teuthology.orchestra.run.smithi008.stdout: "event": "throttled", 2023-08-01T19:55:46.456 INFO:teuthology.orchestra.run.smithi008.stdout: "time": "2023-08-01T19:55:05.148399+0000", 2023-08-01T19:55:46.456 INFO:teuthology.orchestra.run.smithi008.stdout: "duration": 0 2023-08-01T19:55:46.456 INFO:teuthology.orchestra.run.smithi008.stdout: }, 2023-08-01T19:55:46.456 INFO:teuthology.orchestra.run.smithi008.stdout: { 2023-08-01T19:55:46.457 INFO:teuthology.orchestra.run.smithi008.stdout: "event": "header_read", 2023-08-01T19:55:46.457 INFO:teuthology.orchestra.run.smithi008.stdout: "time": "2023-08-01T19:55:05.148398+0000", 2023-08-01T19:55:46.457 INFO:teuthology.orchestra.run.smithi008.stdout: "duration": 4294967295.999999 2023-08-01T19:55:46.457 INFO:teuthology.orchestra.run.smithi008.stdout: }, 2023-08-01T19:55:46.457 INFO:teuthology.orchestra.run.smithi008.stdout: { 2023-08-01T19:55:46.457 INFO:teuthology.orchestra.run.smithi008.stdout: "event": "all_read", 2023-08-01T19:55:46.457 INFO:teuthology.orchestra.run.smithi008.stdout: "time": "2023-08-01T19:55:05.148492+0000", 2023-08-01T19:55:46.457 INFO:teuthology.orchestra.run.smithi008.stdout: "duration": 9.3892000000000002e-05 2023-08-01T19:55:46.458 INFO:teuthology.orchestra.run.smithi008.stdout: }, 2023-08-01T19:55:46.458 INFO:teuthology.orchestra.run.smithi008.stdout: { 2023-08-01T19:55:46.458 INFO:teuthology.orchestra.run.smithi008.stdout: "event": "dispatched", 2023-08-01T19:55:46.458 INFO:teuthology.orchestra.run.smithi008.stdout: "time": "2023-08-01T19:55:05.148503+0000", 2023-08-01T19:55:46.458 INFO:teuthology.orchestra.run.smithi008.stdout: "duration": 1.0951000000000001e-05 2023-08-01T19:55:46.458 INFO:teuthology.orchestra.run.smithi008.stdout: }, 2023-08-01T19:55:46.458 INFO:teuthology.orchestra.run.smithi008.stdout: { 2023-08-01T19:55:46.459 INFO:teuthology.orchestra.run.smithi008.stdout: "event": "queued_for_pg", 2023-08-01T19:55:46.459 INFO:teuthology.orchestra.run.smithi008.stdout: "time": "2023-08-01T19:55:05.148508+0000", 2023-08-01T19:55:46.459 INFO:teuthology.orchestra.run.smithi008.stdout: "duration": 5.0080000000000002e-06 2023-08-01T19:55:46.459 INFO:teuthology.orchestra.run.smithi008.stdout: }, 2023-08-01T19:55:46.459 INFO:teuthology.orchestra.run.smithi008.stdout: { 2023-08-01T19:55:46.459 INFO:teuthology.orchestra.run.smithi008.stdout: "event": "reached_pg", 2023-08-01T19:55:46.459 INFO:teuthology.orchestra.run.smithi008.stdout: "time": "2023-08-01T19:55:05.148548+0000", 2023-08-01T19:55:46.459 INFO:teuthology.orchestra.run.smithi008.stdout: "duration": 4.0358999999999998e-05 2023-08-01T19:55:46.460 INFO:teuthology.orchestra.run.smithi008.stdout: }, 2023-08-01T19:55:46.460 INFO:teuthology.orchestra.run.smithi008.stdout: { 2023-08-01T19:55:46.460 INFO:teuthology.orchestra.run.smithi008.stdout: "event": "started", 2023-08-01T19:55:46.460 INFO:teuthology.orchestra.run.smithi008.stdout: "time": "2023-08-01T19:55:05.148666+0000", 2023-08-01T19:55:46.460 INFO:teuthology.orchestra.run.smithi008.stdout: "duration": 0.000117621 2023-08-01T19:55:46.460 INFO:teuthology.orchestra.run.smithi008.stdout: }, 2023-08-01T19:55:46.460 INFO:teuthology.orchestra.run.smithi008.stdout: { 2023-08-01T19:55:46.461 INFO:teuthology.orchestra.run.smithi008.stdout: "event": "waiting for subops from 2", 2023-08-01T19:55:46.461 INFO:teuthology.orchestra.run.smithi008.stdout: "time": "2023-08-01T19:55:05.148805+0000", 2023-08-01T19:55:46.461 INFO:teuthology.orchestra.run.smithi008.stdout: "duration": 0.000139176 2023-08-01T19:55:46.461 INFO:teuthology.orchestra.run.smithi008.stdout: }, 2023-08-01T19:55:46.461 INFO:teuthology.orchestra.run.smithi008.stdout: { 2023-08-01T19:55:46.461 INFO:teuthology.orchestra.run.smithi008.stdout: "event": "op_commit", 2023-08-01T19:55:46.461 INFO:teuthology.orchestra.run.smithi008.stdout: "time": "2023-08-01T19:55:05.156143+0000", 2023-08-01T19:55:46.462 INFO:teuthology.orchestra.run.smithi008.stdout: "duration": 0.007338041 2023-08-01T19:55:46.462 INFO:teuthology.orchestra.run.smithi008.stdout: }, 2023-08-01T19:55:46.462 INFO:teuthology.orchestra.run.smithi008.stdout: { 2023-08-01T19:55:46.462 INFO:teuthology.orchestra.run.smithi008.stdout: "event": "sub_op_commit_rec", 2023-08-01T19:55:46.462 INFO:teuthology.orchestra.run.smithi008.stdout: "time": "2023-08-01T19:55:05.225581+0000", 2023-08-01T19:55:46.462 INFO:teuthology.orchestra.run.smithi008.stdout: "duration": 0.069438402999999996 2023-08-01T19:55:46.462 INFO:teuthology.orchestra.run.smithi008.stdout: }, 2023-08-01T19:55:46.462 INFO:teuthology.orchestra.run.smithi008.stdout: { 2023-08-01T19:55:46.463 INFO:teuthology.orchestra.run.smithi008.stdout: "event": "commit_sent", 2023-08-01T19:55:46.463 INFO:teuthology.orchestra.run.smithi008.stdout: "time": "2023-08-01T19:55:05.225632+0000", 2023-08-01T19:55:46.463 INFO:teuthology.orchestra.run.smithi008.stdout: "duration": 5.0382e-05 2023-08-01T19:55:46.463 INFO:teuthology.orchestra.run.smithi008.stdout: }, 2023-08-01T19:55:46.463 INFO:teuthology.orchestra.run.smithi008.stdout: { 2023-08-01T19:55:46.463 INFO:teuthology.orchestra.run.smithi008.stdout: "event": "done", 2023-08-01T19:55:46.463 INFO:teuthology.orchestra.run.smithi008.stdout: "time": "2023-08-01T19:55:05.225677+0000", 2023-08-01T19:55:46.464 INFO:teuthology.orchestra.run.smithi008.stdout: "duration": 4.5893000000000003e-05 2023-08-01T19:55:46.464 INFO:teuthology.orchestra.run.smithi008.stdout: } 2023-08-01T19:55:46.464 INFO:teuthology.orchestra.run.smithi008.stdout: ] 2023-08-01T19:55:46.464 INFO:teuthology.orchestra.run.smithi008.stdout: } 2023-08-01T19:55:46.464 INFO:teuthology.orchestra.run.smithi008.stdout: }, 2023-08-01T19:55:46.464 INFO:teuthology.orchestra.run.smithi008.stdout: { 2023-08-01T19:55:46.464 INFO:teuthology.orchestra.run.smithi008.stdout: "description": "osd_op(client.4668.0:100243 5.a 5:5e8193b6:::benchmark_data_smithi006_114134_object100242:head [set-alloc-hint object_size 65536 write_size 65536,write 0~65536] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e37)", 2023-08-01T19:55:46.465 INFO:teuthology.orchestra.run.smithi008.stdout: "initiated_at": "2023-08-01T19:55:05.150737+0000", 2023-08-01T19:55:46.465 INFO:teuthology.orchestra.run.smithi008.stdout: "age": 41.297234168999999, 2023-08-01T19:55:46.465 INFO:teuthology.orchestra.run.smithi008.stdout: "duration": 0.075019885999999994, 2023-08-01T19:55:46.465 INFO:teuthology.orchestra.run.smithi008.stdout: "type_data": { 2023-08-01T19:55:46.465 INFO:teuthology.orchestra.run.smithi008.stdout: "flag_point": "commit sent; apply or cleanup", 2023-08-01T19:55:46.465 INFO:teuthology.orchestra.run.smithi008.stdout: "client_info": { 2023-08-01T19:55:46.465 INFO:teuthology.orchestra.run.smithi008.stdout: "client": "client.4668", 2023-08-01T19:55:46.465 INFO:teuthology.orchestra.run.smithi008.stdout: "client_addr": "172.21.15.6:0/1709472247", 2023-08-01T19:55:46.466 INFO:teuthology.orchestra.run.smithi008.stdout: "tid": 100243 2023-08-01T19:55:46.466 INFO:teuthology.orchestra.run.smithi008.stdout: }, 2023-08-01T19:55:46.466 INFO:teuthology.orchestra.run.smithi008.stdout: "events": [ 2023-08-01T19:55:46.466 INFO:teuthology.orchestra.run.smithi008.stdout: { 2023-08-01T19:55:46.466 INFO:teuthology.orchestra.run.smithi008.stdout: "event": "initiated", 2023-08-01T19:55:46.466 INFO:teuthology.orchestra.run.smithi008.stdout: "time": "2023-08-01T19:55:05.150737+0000", 2023-08-01T19:55:46.466 INFO:teuthology.orchestra.run.smithi008.stdout: "duration": 0 2023-08-01T19:55:46.466 INFO:teuthology.orchestra.run.smithi008.stdout: }, 2023-08-01T19:55:46.467 INFO:teuthology.orchestra.run.smithi008.stdout: { 2023-08-01T19:55:46.467 INFO:teuthology.orchestra.run.smithi008.stdout: "event": "throttled", 2023-08-01T19:55:46.467 INFO:teuthology.orchestra.run.smithi008.stdout: "time": "2023-08-01T19:55:05.150737+0000", 2023-08-01T19:55:46.467 INFO:teuthology.orchestra.run.smithi008.stdout: "duration": 0 2023-08-01T19:55:46.467 INFO:teuthology.orchestra.run.smithi008.stdout: }, 2023-08-01T19:55:46.467 INFO:teuthology.orchestra.run.smithi008.stdout: { 2023-08-01T19:55:46.467 INFO:teuthology.orchestra.run.smithi008.stdout: "event": "header_read", 2023-08-01T19:55:46.467 INFO:teuthology.orchestra.run.smithi008.stdout: "time": "2023-08-01T19:55:05.150736+0000", 2023-08-01T19:55:46.468 INFO:teuthology.orchestra.run.smithi008.stdout: "duration": 4294967295.999999 2023-08-01T19:55:46.468 INFO:teuthology.orchestra.run.smithi008.stdout: }, 2023-08-01T19:55:46.468 INFO:teuthology.orchestra.run.smithi008.stdout: { 2023-08-01T19:55:46.468 INFO:teuthology.orchestra.run.smithi008.stdout: "event": "all_read", 2023-08-01T19:55:46.468 INFO:teuthology.orchestra.run.smithi008.stdout: "time": "2023-08-01T19:55:05.150780+0000", 2023-08-01T19:55:46.468 INFO:teuthology.orchestra.run.smithi008.stdout: "duration": 4.3578999999999997e-05 2023-08-01T19:55:46.469 INFO:teuthology.orchestra.run.smithi008.stdout: }, 2023-08-01T19:55:46.469 INFO:teuthology.orchestra.run.smithi008.stdout: { 2023-08-01T19:55:46.469 INFO:teuthology.orchestra.run.smithi008.stdout: "event": "dispatched", 2023-08-01T19:55:46.469 INFO:teuthology.orchestra.run.smithi008.stdout: "time": "2023-08-01T19:55:05.150791+0000", 2023-08-01T19:55:46.469 INFO:teuthology.orchestra.run.smithi008.stdout: "duration": 1.0963e-05 2023-08-01T19:55:46.469 INFO:teuthology.orchestra.run.smithi008.stdout: }, 2023-08-01T19:55:46.469 INFO:teuthology.orchestra.run.smithi008.stdout: { 2023-08-01T19:55:46.469 INFO:teuthology.orchestra.run.smithi008.stdout: "event": "queued_for_pg", 2023-08-01T19:55:46.470 INFO:teuthology.orchestra.run.smithi008.stdout: "time": "2023-08-01T19:55:05.150797+0000", 2023-08-01T19:55:46.470 INFO:teuthology.orchestra.run.smithi008.stdout: "duration": 5.9780000000000002e-06 2023-08-01T19:55:46.470 INFO:teuthology.orchestra.run.smithi008.stdout: }, 2023-08-01T19:55:46.470 INFO:teuthology.orchestra.run.smithi008.stdout: { 2023-08-01T19:55:46.470 INFO:teuthology.orchestra.run.smithi008.stdout: "event": "reached_pg", 2023-08-01T19:55:46.470 INFO:teuthology.orchestra.run.smithi008.stdout: "time": "2023-08-01T19:55:05.150833+0000", 2023-08-01T19:55:46.470 INFO:teuthology.orchestra.run.smithi008.stdout: "duration": 3.6000000000000001e-05 2023-08-01T19:55:46.471 INFO:teuthology.orchestra.run.smithi008.stdout: }, 2023-08-01T19:55:46.471 INFO:teuthology.orchestra.run.smithi008.stdout: { 2023-08-01T19:55:46.471 INFO:teuthology.orchestra.run.smithi008.stdout: "event": "started", 2023-08-01T19:55:46.471 INFO:teuthology.orchestra.run.smithi008.stdout: "time": "2023-08-01T19:55:05.150951+0000", 2023-08-01T19:55:46.471 INFO:teuthology.orchestra.run.smithi008.stdout: "duration": 0.00011827799999999999 2023-08-01T19:55:46.471 INFO:teuthology.orchestra.run.smithi008.stdout: }, 2023-08-01T19:55:46.471 INFO:teuthology.orchestra.run.smithi008.stdout: { 2023-08-01T19:55:46.471 INFO:teuthology.orchestra.run.smithi008.stdout: "event": "waiting for subops from 2", 2023-08-01T19:55:46.472 INFO:teuthology.orchestra.run.smithi008.stdout: "time": "2023-08-01T19:55:05.151111+0000", 2023-08-01T19:55:46.472 INFO:teuthology.orchestra.run.smithi008.stdout: "duration": 0.00015961299999999999 2023-08-01T19:55:46.472 INFO:teuthology.orchestra.run.smithi008.stdout: }, 2023-08-01T19:55:46.472 INFO:teuthology.orchestra.run.smithi008.stdout: { 2023-08-01T19:55:46.472 INFO:teuthology.orchestra.run.smithi008.stdout: "event": "op_commit", 2023-08-01T19:55:46.472 INFO:teuthology.orchestra.run.smithi008.stdout: "time": "2023-08-01T19:55:05.156247+0000", 2023-08-01T19:55:46.472 INFO:teuthology.orchestra.run.smithi008.stdout: "duration": 0.005136524 2023-08-01T19:55:46.473 INFO:teuthology.orchestra.run.smithi008.stdout: }, 2023-08-01T19:55:46.473 INFO:teuthology.orchestra.run.smithi008.stdout: { 2023-08-01T19:55:46.473 INFO:teuthology.orchestra.run.smithi008.stdout: "event": "sub_op_commit_rec", 2023-08-01T19:55:46.473 INFO:teuthology.orchestra.run.smithi008.stdout: "time": "2023-08-01T19:55:05.225705+0000", 2023-08-01T19:55:46.473 INFO:teuthology.orchestra.run.smithi008.stdout: "duration": 0.069458377000000002 2023-08-01T19:55:46.473 INFO:teuthology.orchestra.run.smithi008.stdout: }, 2023-08-01T19:55:46.473 INFO:teuthology.orchestra.run.smithi008.stdout: { 2023-08-01T19:55:46.474 INFO:teuthology.orchestra.run.smithi008.stdout: "event": "commit_sent", 2023-08-01T19:55:46.474 INFO:teuthology.orchestra.run.smithi008.stdout: "time": "2023-08-01T19:55:05.225736+0000", 2023-08-01T19:55:46.474 INFO:teuthology.orchestra.run.smithi008.stdout: "duration": 3.0388000000000001e-05 2023-08-01T19:55:46.474 INFO:teuthology.orchestra.run.smithi008.stdout: }, 2023-08-01T19:55:46.474 INFO:teuthology.orchestra.run.smithi008.stdout: { 2023-08-01T19:55:46.474 INFO:teuthology.orchestra.run.smithi008.stdout: "event": "done", 2023-08-01T19:55:46.474 INFO:teuthology.orchestra.run.smithi008.stdout: "time": "2023-08-01T19:55:05.225757+0000", 2023-08-01T19:55:46.474 INFO:teuthology.orchestra.run.smithi008.stdout: "duration": 2.1090999999999998e-05 2023-08-01T19:55:46.475 INFO:teuthology.orchestra.run.smithi008.stdout: } 2023-08-01T19:55:46.475 INFO:teuthology.orchestra.run.smithi008.stdout: ] 2023-08-01T19:55:46.475 INFO:teuthology.orchestra.run.smithi008.stdout: } 2023-08-01T19:55:46.475 INFO:teuthology.orchestra.run.smithi008.stdout: }, 2023-08-01T19:55:46.475 INFO:teuthology.orchestra.run.smithi008.stdout: { 2023-08-01T19:55:46.475 INFO:teuthology.orchestra.run.smithi008.stdout: "description": "osd_op(client.4668.0:100261 5.a 5:562deedb:::benchmark_data_smithi006_114134_object100260:head [set-alloc-hint object_size 65536 write_size 65536,write 0~65536] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e37)", 2023-08-01T19:55:46.475 INFO:teuthology.orchestra.run.smithi008.stdout: "initiated_at": "2023-08-01T19:55:05.163316+0000", 2023-08-01T19:55:46.475 INFO:teuthology.orchestra.run.smithi008.stdout: "age": 41.284654752999998, 2023-08-01T19:55:46.476 INFO:teuthology.orchestra.run.smithi008.stdout: "duration": 0.063073012999999997, 2023-08-01T19:55:46.476 INFO:teuthology.orchestra.run.smithi008.stdout: "type_data": { 2023-08-01T19:55:46.476 INFO:teuthology.orchestra.run.smithi008.stdout: "flag_point": "commit sent; apply or cleanup", 2023-08-01T19:55:46.476 INFO:teuthology.orchestra.run.smithi008.stdout: "client_info": { 2023-08-01T19:55:46.476 INFO:teuthology.orchestra.run.smithi008.stdout: "client": "client.4668", 2023-08-01T19:55:46.476 INFO:teuthology.orchestra.run.smithi008.stdout: "client_addr": "172.21.15.6:0/1709472247", 2023-08-01T19:55:46.476 INFO:teuthology.orchestra.run.smithi008.stdout: "tid": 100261 2023-08-01T19:55:46.477 INFO:teuthology.orchestra.run.smithi008.stdout: }, 2023-08-01T19:55:46.477 INFO:teuthology.orchestra.run.smithi008.stdout: "events": [ 2023-08-01T19:55:46.477 INFO:teuthology.orchestra.run.smithi008.stdout: { 2023-08-01T19:55:46.477 INFO:teuthology.orchestra.run.smithi008.stdout: "event": "initiated", 2023-08-01T19:55:46.477 INFO:teuthology.orchestra.run.smithi008.stdout: "time": "2023-08-01T19:55:05.163316+0000", 2023-08-01T19:55:46.477 INFO:teuthology.orchestra.run.smithi008.stdout: "duration": 0 2023-08-01T19:55:46.477 INFO:teuthology.orchestra.run.smithi008.stdout: }, 2023-08-01T19:55:46.477 INFO:teuthology.orchestra.run.smithi008.stdout: { 2023-08-01T19:55:46.478 INFO:teuthology.orchestra.run.smithi008.stdout: "event": "throttled", 2023-08-01T19:55:46.478 INFO:teuthology.orchestra.run.smithi008.stdout: "time": "2023-08-01T19:55:05.163316+0000", 2023-08-01T19:55:46.478 INFO:teuthology.orchestra.run.smithi008.stdout: "duration": 0 2023-08-01T19:55:46.478 INFO:teuthology.orchestra.run.smithi008.stdout: }, 2023-08-01T19:55:46.478 INFO:teuthology.orchestra.run.smithi008.stdout: { 2023-08-01T19:55:46.478 INFO:teuthology.orchestra.run.smithi008.stdout: "event": "header_read", 2023-08-01T19:55:46.478 INFO:teuthology.orchestra.run.smithi008.stdout: "time": "2023-08-01T19:55:05.163316+0000", 2023-08-01T19:55:46.479 INFO:teuthology.orchestra.run.smithi008.stdout: "duration": 4294967295.999999 2023-08-01T19:55:46.479 INFO:teuthology.orchestra.run.smithi008.stdout: }, 2023-08-01T19:55:46.479 INFO:teuthology.orchestra.run.smithi008.stdout: { 2023-08-01T19:55:46.479 INFO:teuthology.orchestra.run.smithi008.stdout: "event": "all_read", 2023-08-01T19:55:46.479 INFO:teuthology.orchestra.run.smithi008.stdout: "time": "2023-08-01T19:55:05.163380+0000", 2023-08-01T19:55:46.479 INFO:teuthology.orchestra.run.smithi008.stdout: "duration": 6.4395999999999998e-05 2023-08-01T19:55:46.479 INFO:teuthology.orchestra.run.smithi008.stdout: }, 2023-08-01T19:55:46.479 INFO:teuthology.orchestra.run.smithi008.stdout: { 2023-08-01T19:55:46.480 INFO:teuthology.orchestra.run.smithi008.stdout: "event": "dispatched", 2023-08-01T19:55:46.480 INFO:teuthology.orchestra.run.smithi008.stdout: "time": "2023-08-01T19:55:05.163390+0000", 2023-08-01T19:55:46.480 INFO:teuthology.orchestra.run.smithi008.stdout: "duration": 1.0189e-05 2023-08-01T19:55:46.480 INFO:teuthology.orchestra.run.smithi008.stdout: }, 2023-08-01T19:55:46.480 INFO:teuthology.orchestra.run.smithi008.stdout: { 2023-08-01T19:55:46.480 INFO:teuthology.orchestra.run.smithi008.stdout: "event": "queued_for_pg", 2023-08-01T19:55:46.481 INFO:teuthology.orchestra.run.smithi008.stdout: "time": "2023-08-01T19:55:05.163395+0000", 2023-08-01T19:55:46.481 INFO:teuthology.orchestra.run.smithi008.stdout: "duration": 4.4059999999999998e-06 2023-08-01T19:55:46.481 INFO:teuthology.orchestra.run.smithi008.stdout: }, 2023-08-01T19:55:46.481 INFO:teuthology.orchestra.run.smithi008.stdout: { 2023-08-01T19:55:46.481 INFO:teuthology.orchestra.run.smithi008.stdout: "event": "reached_pg", 2023-08-01T19:55:46.481 INFO:teuthology.orchestra.run.smithi008.stdout: "time": "2023-08-01T19:55:05.163429+0000", 2023-08-01T19:55:46.481 INFO:teuthology.orchestra.run.smithi008.stdout: "duration": 3.4900000000000001e-05 2023-08-01T19:55:46.481 INFO:teuthology.orchestra.run.smithi008.stdout: }, 2023-08-01T19:55:46.482 INFO:teuthology.orchestra.run.smithi008.stdout: { 2023-08-01T19:55:46.482 INFO:teuthology.orchestra.run.smithi008.stdout: "event": "started", 2023-08-01T19:55:46.482 INFO:teuthology.orchestra.run.smithi008.stdout: "time": "2023-08-01T19:55:05.163512+0000", 2023-08-01T19:55:46.482 INFO:teuthology.orchestra.run.smithi008.stdout: "duration": 8.2987999999999999e-05 2023-08-01T19:55:46.482 INFO:teuthology.orchestra.run.smithi008.stdout: }, 2023-08-01T19:55:46.482 INFO:teuthology.orchestra.run.smithi008.stdout: { 2023-08-01T19:55:46.482 INFO:teuthology.orchestra.run.smithi008.stdout: "event": "waiting for subops from 2", 2023-08-01T19:55:46.483 INFO:teuthology.orchestra.run.smithi008.stdout: "time": "2023-08-01T19:55:05.163596+0000", 2023-08-01T19:55:46.483 INFO:teuthology.orchestra.run.smithi008.stdout: "duration": 8.3783999999999996e-05 2023-08-01T19:55:46.483 INFO:teuthology.orchestra.run.smithi008.stdout: }, 2023-08-01T19:55:46.483 INFO:teuthology.orchestra.run.smithi008.stdout: { 2023-08-01T19:55:46.483 INFO:teuthology.orchestra.run.smithi008.stdout: "event": "op_commit", 2023-08-01T19:55:46.483 INFO:teuthology.orchestra.run.smithi008.stdout: "time": "2023-08-01T19:55:05.167129+0000", 2023-08-01T19:55:46.483 INFO:teuthology.orchestra.run.smithi008.stdout: "duration": 0.0035328709999999999 2023-08-01T19:55:46.483 INFO:teuthology.orchestra.run.smithi008.stdout: }, 2023-08-01T19:55:46.484 INFO:teuthology.orchestra.run.smithi008.stdout: { 2023-08-01T19:55:46.484 INFO:teuthology.orchestra.run.smithi008.stdout: "event": "sub_op_commit_rec", 2023-08-01T19:55:46.484 INFO:teuthology.orchestra.run.smithi008.stdout: "time": "2023-08-01T19:55:05.226302+0000", 2023-08-01T19:55:46.485 INFO:teuthology.orchestra.run.smithi008.stdout: "duration": 0.059172711000000003 2023-08-01T19:55:46.485 INFO:teuthology.orchestra.run.smithi008.stdout: }, 2023-08-01T19:55:46.485 INFO:teuthology.orchestra.run.smithi008.stdout: { 2023-08-01T19:55:46.485 INFO:teuthology.orchestra.run.smithi008.stdout: "event": "commit_sent", 2023-08-01T19:55:46.486 INFO:teuthology.orchestra.run.smithi008.stdout: "time": "2023-08-01T19:55:05.226351+0000", 2023-08-01T19:55:46.486 INFO:teuthology.orchestra.run.smithi008.stdout: "duration": 4.969e-05 2023-08-01T19:55:46.486 INFO:teuthology.orchestra.run.smithi008.stdout: }, 2023-08-01T19:55:46.486 INFO:teuthology.orchestra.run.smithi008.stdout: { 2023-08-01T19:55:46.487 INFO:teuthology.orchestra.run.smithi008.stdout: "event": "done", 2023-08-01T19:55:46.487 INFO:teuthology.orchestra.run.smithi008.stdout: "time": "2023-08-01T19:55:05.226389+0000", 2023-08-01T19:55:46.487 INFO:teuthology.orchestra.run.smithi008.stdout: "duration": 3.7978000000000001e-05 2023-08-01T19:55:46.487 INFO:teuthology.orchestra.run.smithi008.stdout: } 2023-08-01T19:55:46.487 INFO:teuthology.orchestra.run.smithi008.stdout: ] 2023-08-01T19:55:46.487 INFO:teuthology.orchestra.run.smithi008.stdout: } 2023-08-01T19:55:46.487 INFO:teuthology.orchestra.run.smithi008.stdout: }, 2023-08-01T19:55:46.488 INFO:teuthology.orchestra.run.smithi008.stdout: { 2023-08-01T19:55:46.488 INFO:teuthology.orchestra.run.smithi008.stdout: "description": "osd_op(client.4668.0:100262 5.a 5:5c636b5d:::benchmark_data_smithi006_114134_object100261:head [set-alloc-hint object_size 65536 write_size 65536,write 0~65536] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e37)", 2023-08-01T19:55:46.488 INFO:teuthology.orchestra.run.smithi008.stdout: "initiated_at": "2023-08-01T19:55:05.165068+0000", 2023-08-01T19:55:46.488 INFO:teuthology.orchestra.run.smithi008.stdout: "age": 41.282903099999999, 2023-08-01T19:55:46.488 INFO:teuthology.orchestra.run.smithi008.stdout: "duration": 0.063919403, 2023-08-01T19:55:46.488 INFO:teuthology.orchestra.run.smithi008.stdout: "type_data": { 2023-08-01T19:55:46.488 INFO:teuthology.orchestra.run.smithi008.stdout: "flag_point": "commit sent; apply or cleanup", 2023-08-01T19:55:46.489 INFO:teuthology.orchestra.run.smithi008.stdout: "client_info": { 2023-08-01T19:55:46.489 INFO:teuthology.orchestra.run.smithi008.stdout: "client": "client.4668", 2023-08-01T19:55:46.489 INFO:teuthology.orchestra.run.smithi008.stdout: "client_addr": "172.21.15.6:0/1709472247", 2023-08-01T19:55:46.489 INFO:teuthology.orchestra.run.smithi008.stdout: "tid": 100262 2023-08-01T19:55:46.489 INFO:teuthology.orchestra.run.smithi008.stdout: }, 2023-08-01T19:55:46.489 INFO:teuthology.orchestra.run.smithi008.stdout: "events": [ 2023-08-01T19:55:46.489 INFO:teuthology.orchestra.run.smithi008.stdout: { 2023-08-01T19:55:46.489 INFO:teuthology.orchestra.run.smithi008.stdout: "event": "initiated", 2023-08-01T19:55:46.490 INFO:teuthology.orchestra.run.smithi008.stdout: "time": "2023-08-01T19:55:05.165068+0000", 2023-08-01T19:55:46.490 INFO:teuthology.orchestra.run.smithi008.stdout: "duration": 0 2023-08-01T19:55:46.490 INFO:teuthology.orchestra.run.smithi008.stdout: }, 2023-08-01T19:55:46.490 INFO:teuthology.orchestra.run.smithi008.stdout: { 2023-08-01T19:55:46.490 INFO:teuthology.orchestra.run.smithi008.stdout: "event": "throttled", 2023-08-01T19:55:46.490 INFO:teuthology.orchestra.run.smithi008.stdout: "time": "2023-08-01T19:55:05.165068+0000", 2023-08-01T19:55:46.490 INFO:teuthology.orchestra.run.smithi008.stdout: "duration": 0 2023-08-01T19:55:46.491 INFO:teuthology.orchestra.run.smithi008.stdout: }, 2023-08-01T19:55:46.491 INFO:teuthology.orchestra.run.smithi008.stdout: { 2023-08-01T19:55:46.491 INFO:teuthology.orchestra.run.smithi008.stdout: "event": "header_read", 2023-08-01T19:55:46.491 INFO:teuthology.orchestra.run.smithi008.stdout: "time": "2023-08-01T19:55:05.165067+0000", 2023-08-01T19:55:46.491 INFO:teuthology.orchestra.run.smithi008.stdout: "duration": 4294967295.999999 2023-08-01T19:55:46.491 INFO:teuthology.orchestra.run.smithi008.stdout: }, 2023-08-01T19:55:46.491 INFO:teuthology.orchestra.run.smithi008.stdout: { 2023-08-01T19:55:46.492 INFO:teuthology.orchestra.run.smithi008.stdout: "event": "all_read", 2023-08-01T19:55:46.492 INFO:teuthology.orchestra.run.smithi008.stdout: "time": "2023-08-01T19:55:05.165126+0000", 2023-08-01T19:55:46.492 INFO:teuthology.orchestra.run.smithi008.stdout: "duration": 5.9116000000000001e-05 2023-08-01T19:55:46.492 INFO:teuthology.orchestra.run.smithi008.stdout: }, 2023-08-01T19:55:46.492 INFO:teuthology.orchestra.run.smithi008.stdout: { 2023-08-01T19:55:46.492 INFO:teuthology.orchestra.run.smithi008.stdout: "event": "dispatched", 2023-08-01T19:55:46.492 INFO:teuthology.orchestra.run.smithi008.stdout: "time": "2023-08-01T19:55:05.165134+0000", 2023-08-01T19:55:46.493 INFO:teuthology.orchestra.run.smithi008.stdout: "duration": 7.9820000000000008e-06 2023-08-01T19:55:46.493 INFO:teuthology.orchestra.run.smithi008.stdout: }, 2023-08-01T19:55:46.493 INFO:teuthology.orchestra.run.smithi008.stdout: { 2023-08-01T19:55:46.493 INFO:teuthology.orchestra.run.smithi008.stdout: "event": "queued_for_pg", 2023-08-01T19:55:46.493 INFO:teuthology.orchestra.run.smithi008.stdout: "time": "2023-08-01T19:55:05.165139+0000", 2023-08-01T19:55:46.493 INFO:teuthology.orchestra.run.smithi008.stdout: "duration": 4.2560000000000004e-06 2023-08-01T19:55:46.493 INFO:teuthology.orchestra.run.smithi008.stdout: }, 2023-08-01T19:55:46.493 INFO:teuthology.orchestra.run.smithi008.stdout: { 2023-08-01T19:55:46.494 INFO:teuthology.orchestra.run.smithi008.stdout: "event": "reached_pg", 2023-08-01T19:55:46.494 INFO:teuthology.orchestra.run.smithi008.stdout: "time": "2023-08-01T19:55:05.165165+0000", 2023-08-01T19:55:46.494 INFO:teuthology.orchestra.run.smithi008.stdout: "duration": 2.6554e-05 2023-08-01T19:55:46.494 INFO:teuthology.orchestra.run.smithi008.stdout: }, 2023-08-01T19:55:46.494 INFO:teuthology.orchestra.run.smithi008.stdout: { 2023-08-01T19:55:46.494 INFO:teuthology.orchestra.run.smithi008.stdout: "event": "started", 2023-08-01T19:55:46.494 INFO:teuthology.orchestra.run.smithi008.stdout: "time": "2023-08-01T19:55:05.165243+0000", 2023-08-01T19:55:46.495 INFO:teuthology.orchestra.run.smithi008.stdout: "duration": 7.7877e-05 2023-08-01T19:55:46.495 INFO:teuthology.orchestra.run.smithi008.stdout: }, 2023-08-01T19:55:46.495 INFO:teuthology.orchestra.run.smithi008.stdout: { 2023-08-01T19:55:46.495 INFO:teuthology.orchestra.run.smithi008.stdout: "event": "waiting for subops from 2", 2023-08-01T19:55:46.495 INFO:teuthology.orchestra.run.smithi008.stdout: "time": "2023-08-01T19:55:05.165450+0000", 2023-08-01T19:55:46.495 INFO:teuthology.orchestra.run.smithi008.stdout: "duration": 0.00020655599999999999 2023-08-01T19:55:46.495 INFO:teuthology.orchestra.run.smithi008.stdout: }, 2023-08-01T19:55:46.495 INFO:teuthology.orchestra.run.smithi008.stdout: { 2023-08-01T19:55:46.496 INFO:teuthology.orchestra.run.smithi008.stdout: "event": "op_commit", 2023-08-01T19:55:46.496 INFO:teuthology.orchestra.run.smithi008.stdout: "time": "2023-08-01T19:55:05.168883+0000", 2023-08-01T19:55:46.496 INFO:teuthology.orchestra.run.smithi008.stdout: "duration": 0.0034333279999999998 2023-08-01T19:55:46.496 INFO:teuthology.orchestra.run.smithi008.stdout: }, 2023-08-01T19:55:46.496 INFO:teuthology.orchestra.run.smithi008.stdout: { 2023-08-01T19:55:46.496 INFO:teuthology.orchestra.run.smithi008.stdout: "event": "sub_op_commit_rec", 2023-08-01T19:55:46.496 INFO:teuthology.orchestra.run.smithi008.stdout: "time": "2023-08-01T19:55:05.228904+0000", 2023-08-01T19:55:46.497 INFO:teuthology.orchestra.run.smithi008.stdout: "duration": 0.060021370999999997 2023-08-01T19:55:46.497 INFO:teuthology.orchestra.run.smithi008.stdout: }, 2023-08-01T19:55:46.497 INFO:teuthology.orchestra.run.smithi008.stdout: { 2023-08-01T19:55:46.497 INFO:teuthology.orchestra.run.smithi008.stdout: "event": "commit_sent", 2023-08-01T19:55:46.497 INFO:teuthology.orchestra.run.smithi008.stdout: "time": "2023-08-01T19:55:05.228952+0000", 2023-08-01T19:55:46.497 INFO:teuthology.orchestra.run.smithi008.stdout: "duration": 4.8056999999999997e-05 2023-08-01T19:55:46.497 INFO:teuthology.orchestra.run.smithi008.stdout: }, 2023-08-01T19:55:46.497 INFO:teuthology.orchestra.run.smithi008.stdout: { 2023-08-01T19:55:46.498 INFO:teuthology.orchestra.run.smithi008.stdout: "event": "done", 2023-08-01T19:55:46.498 INFO:teuthology.orchestra.run.smithi008.stdout: "time": "2023-08-01T19:55:05.228987+0000", 2023-08-01T19:55:46.498 INFO:teuthology.orchestra.run.smithi008.stdout: "duration": 3.5083000000000003e-05 2023-08-01T19:55:46.498 INFO:teuthology.orchestra.run.smithi008.stdout: } 2023-08-01T19:55:46.498 INFO:teuthology.orchestra.run.smithi008.stdout: ] 2023-08-01T19:55:46.498 INFO:teuthology.orchestra.run.smithi008.stdout: } 2023-08-01T19:55:46.498 INFO:teuthology.orchestra.run.smithi008.stdout: }, 2023-08-01T19:55:46.498 INFO:teuthology.orchestra.run.smithi008.stdout: { 2023-08-01T19:55:46.499 INFO:teuthology.orchestra.run.smithi008.stdout: "description": "osd_op(client.4668.0:100929 5.3 5:c29f4adb:::benchmark_data_smithi006_114134_object100928:head [set-alloc-hint object_size 65536 write_size 65536,write 0~65536] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e37)", 2023-08-01T19:55:46.499 INFO:teuthology.orchestra.run.smithi008.stdout: "initiated_at": "2023-08-01T19:55:05.564759+0000", 2023-08-01T19:55:46.499 INFO:teuthology.orchestra.run.smithi008.stdout: "age": 40.883212460999999, 2023-08-01T19:55:46.499 INFO:teuthology.orchestra.run.smithi008.stdout: "duration": 0.062544635000000001, 2023-08-01T19:55:46.499 INFO:teuthology.orchestra.run.smithi008.stdout: "type_data": { 2023-08-01T19:55:46.499 INFO:teuthology.orchestra.run.smithi008.stdout: "flag_point": "commit sent; apply or cleanup", 2023-08-01T19:55:46.499 INFO:teuthology.orchestra.run.smithi008.stdout: "client_info": { 2023-08-01T19:55:46.500 INFO:teuthology.orchestra.run.smithi008.stdout: "client": "client.4668", 2023-08-01T19:55:46.500 INFO:teuthology.orchestra.run.smithi008.stdout: "client_addr": "172.21.15.6:0/1709472247", 2023-08-01T19:55:46.500 INFO:teuthology.orchestra.run.smithi008.stdout: "tid": 100929 2023-08-01T19:55:46.500 INFO:teuthology.orchestra.run.smithi008.stdout: }, 2023-08-01T19:55:46.500 INFO:teuthology.orchestra.run.smithi008.stdout: "events": [ 2023-08-01T19:55:46.500 INFO:teuthology.orchestra.run.smithi008.stdout: { 2023-08-01T19:55:46.500 INFO:teuthology.orchestra.run.smithi008.stdout: "event": "initiated", 2023-08-01T19:55:46.500 INFO:teuthology.orchestra.run.smithi008.stdout: "time": "2023-08-01T19:55:05.564759+0000", 2023-08-01T19:55:46.501 INFO:teuthology.orchestra.run.smithi008.stdout: "duration": 0 2023-08-01T19:55:46.501 INFO:teuthology.orchestra.run.smithi008.stdout: }, 2023-08-01T19:55:46.501 INFO:teuthology.orchestra.run.smithi008.stdout: { 2023-08-01T19:55:46.501 INFO:teuthology.orchestra.run.smithi008.stdout: "event": "throttled", 2023-08-01T19:55:46.501 INFO:teuthology.orchestra.run.smithi008.stdout: "time": "2023-08-01T19:55:05.564759+0000", 2023-08-01T19:55:46.501 INFO:teuthology.orchestra.run.smithi008.stdout: "duration": 0 2023-08-01T19:55:46.501 INFO:teuthology.orchestra.run.smithi008.stdout: }, 2023-08-01T19:55:46.502 INFO:teuthology.orchestra.run.smithi008.stdout: { 2023-08-01T19:55:46.502 INFO:teuthology.orchestra.run.smithi008.stdout: "event": "header_read", 2023-08-01T19:55:46.502 INFO:teuthology.orchestra.run.smithi008.stdout: "time": "2023-08-01T19:55:05.564758+0000", 2023-08-01T19:55:46.502 INFO:teuthology.orchestra.run.smithi008.stdout: "duration": 4294967295.999999 2023-08-01T19:55:46.502 INFO:teuthology.orchestra.run.smithi008.stdout: }, 2023-08-01T19:55:46.502 INFO:teuthology.orchestra.run.smithi008.stdout: { 2023-08-01T19:55:46.502 INFO:teuthology.orchestra.run.smithi008.stdout: "event": "all_read", 2023-08-01T19:55:46.502 INFO:teuthology.orchestra.run.smithi008.stdout: "time": "2023-08-01T19:55:05.564815+0000", 2023-08-01T19:55:46.503 INFO:teuthology.orchestra.run.smithi008.stdout: "duration": 5.7757000000000003e-05 2023-08-01T19:55:46.503 INFO:teuthology.orchestra.run.smithi008.stdout: }, 2023-08-01T19:55:46.503 INFO:teuthology.orchestra.run.smithi008.stdout: { 2023-08-01T19:55:46.503 INFO:teuthology.orchestra.run.smithi008.stdout: "event": "dispatched", 2023-08-01T19:55:46.503 INFO:teuthology.orchestra.run.smithi008.stdout: "time": "2023-08-01T19:55:05.564824+0000", 2023-08-01T19:55:46.503 INFO:teuthology.orchestra.run.smithi008.stdout: "duration": 8.6559999999999998e-06 2023-08-01T19:55:46.503 INFO:teuthology.orchestra.run.smithi008.stdout: }, 2023-08-01T19:55:46.504 INFO:teuthology.orchestra.run.smithi008.stdout: { 2023-08-01T19:55:46.504 INFO:teuthology.orchestra.run.smithi008.stdout: "event": "queued_for_pg", 2023-08-01T19:55:46.504 INFO:teuthology.orchestra.run.smithi008.stdout: "time": "2023-08-01T19:55:05.564829+0000", 2023-08-01T19:55:46.504 INFO:teuthology.orchestra.run.smithi008.stdout: "duration": 4.6160000000000004e-06 2023-08-01T19:55:46.504 INFO:teuthology.orchestra.run.smithi008.stdout: }, 2023-08-01T19:55:46.504 INFO:teuthology.orchestra.run.smithi008.stdout: { 2023-08-01T19:55:46.504 INFO:teuthology.orchestra.run.smithi008.stdout: "event": "reached_pg", 2023-08-01T19:55:46.504 INFO:teuthology.orchestra.run.smithi008.stdout: "time": "2023-08-01T19:55:05.564871+0000", 2023-08-01T19:55:46.505 INFO:teuthology.orchestra.run.smithi008.stdout: "duration": 4.2206000000000002e-05 2023-08-01T19:55:46.505 INFO:teuthology.orchestra.run.smithi008.stdout: }, 2023-08-01T19:55:46.505 INFO:teuthology.orchestra.run.smithi008.stdout: { 2023-08-01T19:55:46.505 INFO:teuthology.orchestra.run.smithi008.stdout: "event": "started", 2023-08-01T19:55:46.505 INFO:teuthology.orchestra.run.smithi008.stdout: "time": "2023-08-01T19:55:05.565011+0000", 2023-08-01T19:55:46.505 INFO:teuthology.orchestra.run.smithi008.stdout: "duration": 0.000140469 2023-08-01T19:55:46.505 INFO:teuthology.orchestra.run.smithi008.stdout: }, 2023-08-01T19:55:46.506 INFO:teuthology.orchestra.run.smithi008.stdout: { 2023-08-01T19:55:46.506 INFO:teuthology.orchestra.run.smithi008.stdout: "event": "waiting for subops from 1", 2023-08-01T19:55:46.506 INFO:teuthology.orchestra.run.smithi008.stdout: "time": "2023-08-01T19:55:05.565212+0000", 2023-08-01T19:55:46.506 INFO:teuthology.orchestra.run.smithi008.stdout: "duration": 0.00020106599999999999 2023-08-01T19:55:46.506 INFO:teuthology.orchestra.run.smithi008.stdout: }, 2023-08-01T19:55:46.506 INFO:teuthology.orchestra.run.smithi008.stdout: { 2023-08-01T19:55:46.506 INFO:teuthology.orchestra.run.smithi008.stdout: "event": "sub_op_commit_rec", 2023-08-01T19:55:46.506 INFO:teuthology.orchestra.run.smithi008.stdout: "time": "2023-08-01T19:55:05.626925+0000", 2023-08-01T19:55:46.507 INFO:teuthology.orchestra.run.smithi008.stdout: "duration": 0.061712111 2023-08-01T19:55:46.507 INFO:teuthology.orchestra.run.smithi008.stdout: }, 2023-08-01T19:55:46.507 INFO:teuthology.orchestra.run.smithi008.stdout: { 2023-08-01T19:55:46.507 INFO:teuthology.orchestra.run.smithi008.stdout: "event": "op_commit", 2023-08-01T19:55:46.507 INFO:teuthology.orchestra.run.smithi008.stdout: "time": "2023-08-01T19:55:05.627217+0000", 2023-08-01T19:55:46.507 INFO:teuthology.orchestra.run.smithi008.stdout: "duration": 0.00029265999999999998 2023-08-01T19:55:46.507 INFO:teuthology.orchestra.run.smithi008.stdout: }, 2023-08-01T19:55:46.507 INFO:teuthology.orchestra.run.smithi008.stdout: { 2023-08-01T19:55:46.508 INFO:teuthology.orchestra.run.smithi008.stdout: "event": "commit_sent", 2023-08-01T19:55:46.508 INFO:teuthology.orchestra.run.smithi008.stdout: "time": "2023-08-01T19:55:05.627264+0000", 2023-08-01T19:55:46.508 INFO:teuthology.orchestra.run.smithi008.stdout: "duration": 4.6260000000000001e-05 2023-08-01T19:55:46.508 INFO:teuthology.orchestra.run.smithi008.stdout: }, 2023-08-01T19:55:46.508 INFO:teuthology.orchestra.run.smithi008.stdout: { 2023-08-01T19:55:46.508 INFO:teuthology.orchestra.run.smithi008.stdout: "event": "done", 2023-08-01T19:55:46.508 INFO:teuthology.orchestra.run.smithi008.stdout: "time": "2023-08-01T19:55:05.627303+0000", 2023-08-01T19:55:46.508 INFO:teuthology.orchestra.run.smithi008.stdout: "duration": 3.9839999999999998e-05 2023-08-01T19:55:46.509 INFO:teuthology.orchestra.run.smithi008.stdout: } 2023-08-01T19:55:46.509 INFO:teuthology.orchestra.run.smithi008.stdout: ] 2023-08-01T19:55:46.509 INFO:teuthology.orchestra.run.smithi008.stdout: } 2023-08-01T19:55:46.509 INFO:teuthology.orchestra.run.smithi008.stdout: }, 2023-08-01T19:55:46.509 INFO:teuthology.orchestra.run.smithi008.stdout: { 2023-08-01T19:55:46.509 INFO:teuthology.orchestra.run.smithi008.stdout: "description": "osd_repop(client.4668.0:100928 5.7 e37/19 5:e61a7dfa:::benchmark_data_smithi006_114134_object100927:head v 37'6273, mlcod=37'6270)", 2023-08-01T19:55:46.509 INFO:teuthology.orchestra.run.smithi008.stdout: "initiated_at": "2023-08-01T19:55:05.565106+0000", 2023-08-01T19:55:46.510 INFO:teuthology.orchestra.run.smithi008.stdout: "age": 40.882865363000001, 2023-08-01T19:55:46.510 INFO:teuthology.orchestra.run.smithi008.stdout: "duration": 0.064091282999999999, 2023-08-01T19:55:46.510 INFO:teuthology.orchestra.run.smithi008.stdout: "type_data": { 2023-08-01T19:55:46.510 INFO:teuthology.orchestra.run.smithi008.stdout: "flag_point": "commit sent; apply or cleanup", 2023-08-01T19:55:46.510 INFO:teuthology.orchestra.run.smithi008.stdout: "events": [ 2023-08-01T19:55:46.510 INFO:teuthology.orchestra.run.smithi008.stdout: { 2023-08-01T19:55:46.510 INFO:teuthology.orchestra.run.smithi008.stdout: "event": "initiated", 2023-08-01T19:55:46.511 INFO:teuthology.orchestra.run.smithi008.stdout: "time": "2023-08-01T19:55:05.565106+0000", 2023-08-01T19:55:46.511 INFO:teuthology.orchestra.run.smithi008.stdout: "duration": 0 2023-08-01T19:55:46.511 INFO:teuthology.orchestra.run.smithi008.stdout: }, 2023-08-01T19:55:46.511 INFO:teuthology.orchestra.run.smithi008.stdout: { 2023-08-01T19:55:46.511 INFO:teuthology.orchestra.run.smithi008.stdout: "event": "throttled", 2023-08-01T19:55:46.511 INFO:teuthology.orchestra.run.smithi008.stdout: "time": "2023-08-01T19:55:05.565106+0000", 2023-08-01T19:55:46.511 INFO:teuthology.orchestra.run.smithi008.stdout: "duration": 0 2023-08-01T19:55:46.511 INFO:teuthology.orchestra.run.smithi008.stdout: }, 2023-08-01T19:55:46.512 INFO:teuthology.orchestra.run.smithi008.stdout: { 2023-08-01T19:55:46.512 INFO:teuthology.orchestra.run.smithi008.stdout: "event": "header_read", 2023-08-01T19:55:46.512 INFO:teuthology.orchestra.run.smithi008.stdout: "time": "2023-08-01T19:55:05.565105+0000", 2023-08-01T19:55:46.512 INFO:teuthology.orchestra.run.smithi008.stdout: "duration": 4294967295.9999995 2023-08-01T19:55:46.512 INFO:teuthology.orchestra.run.smithi008.stdout: }, 2023-08-01T19:55:46.512 INFO:teuthology.orchestra.run.smithi008.stdout: { 2023-08-01T19:55:46.512 INFO:teuthology.orchestra.run.smithi008.stdout: "event": "all_read", 2023-08-01T19:55:46.512 INFO:teuthology.orchestra.run.smithi008.stdout: "time": "2023-08-01T19:55:05.565173+0000", 2023-08-01T19:55:46.513 INFO:teuthology.orchestra.run.smithi008.stdout: "duration": 6.8186000000000001e-05 2023-08-01T19:55:46.513 INFO:teuthology.orchestra.run.smithi008.stdout: }, 2023-08-01T19:55:46.513 INFO:teuthology.orchestra.run.smithi008.stdout: { 2023-08-01T19:55:46.513 INFO:teuthology.orchestra.run.smithi008.stdout: "event": "dispatched", 2023-08-01T19:55:46.513 INFO:teuthology.orchestra.run.smithi008.stdout: "time": "2023-08-01T19:55:05.565182+0000", 2023-08-01T19:55:46.513 INFO:teuthology.orchestra.run.smithi008.stdout: "duration": 8.3620000000000006e-06 2023-08-01T19:55:46.513 INFO:teuthology.orchestra.run.smithi008.stdout: }, 2023-08-01T19:55:46.514 INFO:teuthology.orchestra.run.smithi008.stdout: { 2023-08-01T19:55:46.514 INFO:teuthology.orchestra.run.smithi008.stdout: "event": "queued_for_pg", 2023-08-01T19:55:46.514 INFO:teuthology.orchestra.run.smithi008.stdout: "time": "2023-08-01T19:55:05.565186+0000", 2023-08-01T19:55:46.514 INFO:teuthology.orchestra.run.smithi008.stdout: "duration": 3.7680000000000002e-06 2023-08-01T19:55:46.514 INFO:teuthology.orchestra.run.smithi008.stdout: }, 2023-08-01T19:55:46.514 INFO:teuthology.orchestra.run.smithi008.stdout: { 2023-08-01T19:55:46.514 INFO:teuthology.orchestra.run.smithi008.stdout: "event": "reached_pg", 2023-08-01T19:55:46.514 INFO:teuthology.orchestra.run.smithi008.stdout: "time": "2023-08-01T19:55:05.565212+0000", 2023-08-01T19:55:46.515 INFO:teuthology.orchestra.run.smithi008.stdout: "duration": 2.6230000000000001e-05 2023-08-01T19:55:46.515 INFO:teuthology.orchestra.run.smithi008.stdout: }, 2023-08-01T19:55:46.515 INFO:teuthology.orchestra.run.smithi008.stdout: { 2023-08-01T19:55:46.515 INFO:teuthology.orchestra.run.smithi008.stdout: "event": "started", 2023-08-01T19:55:46.515 INFO:teuthology.orchestra.run.smithi008.stdout: "time": "2023-08-01T19:55:05.565224+0000", 2023-08-01T19:55:46.515 INFO:teuthology.orchestra.run.smithi008.stdout: "duration": 1.2033e-05 2023-08-01T19:55:46.515 INFO:teuthology.orchestra.run.smithi008.stdout: }, 2023-08-01T19:55:46.515 INFO:teuthology.orchestra.run.smithi008.stdout: { 2023-08-01T19:55:46.516 INFO:teuthology.orchestra.run.smithi008.stdout: "event": "commit_sent", 2023-08-01T19:55:46.516 INFO:teuthology.orchestra.run.smithi008.stdout: "time": "2023-08-01T19:55:05.629152+0000", 2023-08-01T19:55:46.516 INFO:teuthology.orchestra.run.smithi008.stdout: "duration": 0.063928378999999994 2023-08-01T19:55:46.516 INFO:teuthology.orchestra.run.smithi008.stdout: }, 2023-08-01T19:55:46.516 INFO:teuthology.orchestra.run.smithi008.stdout: { 2023-08-01T19:55:46.516 INFO:teuthology.orchestra.run.smithi008.stdout: "event": "done", 2023-08-01T19:55:46.516 INFO:teuthology.orchestra.run.smithi008.stdout: "time": "2023-08-01T19:55:05.629197+0000", 2023-08-01T19:55:46.516 INFO:teuthology.orchestra.run.smithi008.stdout: "duration": 4.4894000000000001e-05 2023-08-01T19:55:46.517 INFO:teuthology.orchestra.run.smithi008.stdout: } 2023-08-01T19:55:46.517 INFO:teuthology.orchestra.run.smithi008.stdout: ] 2023-08-01T19:55:46.517 INFO:teuthology.orchestra.run.smithi008.stdout: } 2023-08-01T19:55:46.517 INFO:teuthology.orchestra.run.smithi008.stdout: }, 2023-08-01T19:55:46.517 INFO:teuthology.orchestra.run.smithi008.stdout: { 2023-08-01T19:55:46.517 INFO:teuthology.orchestra.run.smithi008.stdout: "description": "osd_repop(client.4668.0:100927 5.0 e37/19 5:00608ec6:::benchmark_data_smithi006_114134_object100926:head v 37'6408, mlcod=37'6403)", 2023-08-01T19:55:46.517 INFO:teuthology.orchestra.run.smithi008.stdout: "initiated_at": "2023-08-01T19:55:05.565153+0000", 2023-08-01T19:55:46.517 INFO:teuthology.orchestra.run.smithi008.stdout: "age": 40.882818626000002, 2023-08-01T19:55:46.518 INFO:teuthology.orchestra.run.smithi008.stdout: "duration": 0.062202714999999999, 2023-08-01T19:55:46.518 INFO:teuthology.orchestra.run.smithi008.stdout: "type_data": { 2023-08-01T19:55:46.518 INFO:teuthology.orchestra.run.smithi008.stdout: "flag_point": "commit sent; apply or cleanup", 2023-08-01T19:55:46.518 INFO:teuthology.orchestra.run.smithi008.stdout: "events": [ 2023-08-01T19:55:46.518 INFO:teuthology.orchestra.run.smithi008.stdout: { 2023-08-01T19:55:46.518 INFO:teuthology.orchestra.run.smithi008.stdout: "event": "initiated", 2023-08-01T19:55:46.518 INFO:teuthology.orchestra.run.smithi008.stdout: "time": "2023-08-01T19:55:05.565153+0000", 2023-08-01T19:55:46.518 INFO:teuthology.orchestra.run.smithi008.stdout: "duration": 0 2023-08-01T19:55:46.519 INFO:teuthology.orchestra.run.smithi008.stdout: }, 2023-08-01T19:55:46.519 INFO:teuthology.orchestra.run.smithi008.stdout: { 2023-08-01T19:55:46.519 INFO:teuthology.orchestra.run.smithi008.stdout: "event": "throttled", 2023-08-01T19:55:46.519 INFO:teuthology.orchestra.run.smithi008.stdout: "time": "2023-08-01T19:55:05.565153+0000", 2023-08-01T19:55:46.519 INFO:teuthology.orchestra.run.smithi008.stdout: "duration": 0 2023-08-01T19:55:46.519 INFO:teuthology.orchestra.run.smithi008.stdout: }, 2023-08-01T19:55:46.519 INFO:teuthology.orchestra.run.smithi008.stdout: { 2023-08-01T19:55:46.520 INFO:teuthology.orchestra.run.smithi008.stdout: "event": "header_read", 2023-08-01T19:55:46.520 INFO:teuthology.orchestra.run.smithi008.stdout: "time": "2023-08-01T19:55:05.565152+0000", 2023-08-01T19:55:46.520 INFO:teuthology.orchestra.run.smithi008.stdout: "duration": 4294967295.9999995 2023-08-01T19:55:46.520 INFO:teuthology.orchestra.run.smithi008.stdout: }, 2023-08-01T19:55:46.520 INFO:teuthology.orchestra.run.smithi008.stdout: { 2023-08-01T19:55:46.520 INFO:teuthology.orchestra.run.smithi008.stdout: "event": "all_read", 2023-08-01T19:55:46.520 INFO:teuthology.orchestra.run.smithi008.stdout: "time": "2023-08-01T19:55:05.565225+0000", 2023-08-01T19:55:46.520 INFO:teuthology.orchestra.run.smithi008.stdout: "duration": 7.2471000000000005e-05 2023-08-01T19:55:46.521 INFO:teuthology.orchestra.run.smithi008.stdout: }, 2023-08-01T19:55:46.521 INFO:teuthology.orchestra.run.smithi008.stdout: { 2023-08-01T19:55:46.521 INFO:teuthology.orchestra.run.smithi008.stdout: "event": "dispatched", 2023-08-01T19:55:46.521 INFO:teuthology.orchestra.run.smithi008.stdout: "time": "2023-08-01T19:55:05.565229+0000", 2023-08-01T19:55:46.521 INFO:teuthology.orchestra.run.smithi008.stdout: "duration": 4.5600000000000004e-06 2023-08-01T19:55:46.521 INFO:teuthology.orchestra.run.smithi008.stdout: }, 2023-08-01T19:55:46.521 INFO:teuthology.orchestra.run.smithi008.stdout: { 2023-08-01T19:55:46.521 INFO:teuthology.orchestra.run.smithi008.stdout: "event": "queued_for_pg", 2023-08-01T19:55:46.522 INFO:teuthology.orchestra.run.smithi008.stdout: "time": "2023-08-01T19:55:05.565232+0000", 2023-08-01T19:55:46.522 INFO:teuthology.orchestra.run.smithi008.stdout: "duration": 2.6900000000000001e-06 2023-08-01T19:55:46.522 INFO:teuthology.orchestra.run.smithi008.stdout: }, 2023-08-01T19:55:46.522 INFO:teuthology.orchestra.run.smithi008.stdout: { 2023-08-01T19:55:46.522 INFO:teuthology.orchestra.run.smithi008.stdout: "event": "reached_pg", 2023-08-01T19:55:46.522 INFO:teuthology.orchestra.run.smithi008.stdout: "time": "2023-08-01T19:55:05.565283+0000", 2023-08-01T19:55:46.522 INFO:teuthology.orchestra.run.smithi008.stdout: "duration": 5.1442e-05 2023-08-01T19:55:46.522 INFO:teuthology.orchestra.run.smithi008.stdout: }, 2023-08-01T19:55:46.523 INFO:teuthology.orchestra.run.smithi008.stdout: { 2023-08-01T19:55:46.523 INFO:teuthology.orchestra.run.smithi008.stdout: "event": "started", 2023-08-01T19:55:46.523 INFO:teuthology.orchestra.run.smithi008.stdout: "time": "2023-08-01T19:55:05.565301+0000", 2023-08-01T19:55:46.523 INFO:teuthology.orchestra.run.smithi008.stdout: "duration": 1.8029e-05 2023-08-01T19:55:46.523 INFO:teuthology.orchestra.run.smithi008.stdout: }, 2023-08-01T19:55:46.523 INFO:teuthology.orchestra.run.smithi008.stdout: { 2023-08-01T19:55:46.523 INFO:teuthology.orchestra.run.smithi008.stdout: "event": "commit_sent", 2023-08-01T19:55:46.523 INFO:teuthology.orchestra.run.smithi008.stdout: "time": "2023-08-01T19:55:05.627318+0000", 2023-08-01T19:55:46.524 INFO:teuthology.orchestra.run.smithi008.stdout: "duration": 0.062016763000000003 2023-08-01T19:55:46.524 INFO:teuthology.orchestra.run.smithi008.stdout: }, 2023-08-01T19:55:46.524 INFO:teuthology.orchestra.run.smithi008.stdout: { 2023-08-01T19:55:46.524 INFO:teuthology.orchestra.run.smithi008.stdout: "event": "done", 2023-08-01T19:55:46.524 INFO:teuthology.orchestra.run.smithi008.stdout: "time": "2023-08-01T19:55:05.627355+0000", 2023-08-01T19:55:46.524 INFO:teuthology.orchestra.run.smithi008.stdout: "duration": 3.7258999999999997e-05 2023-08-01T19:55:46.524 INFO:teuthology.orchestra.run.smithi008.stdout: } 2023-08-01T19:55:46.525 INFO:teuthology.orchestra.run.smithi008.stdout: ] 2023-08-01T19:55:46.525 INFO:teuthology.orchestra.run.smithi008.stdout: } 2023-08-01T19:55:46.525 INFO:teuthology.orchestra.run.smithi008.stdout: }, 2023-08-01T19:55:46.525 INFO:teuthology.orchestra.run.smithi008.stdout: { 2023-08-01T19:55:46.525 INFO:teuthology.orchestra.run.smithi008.stdout: "description": "osd_op(client.4668.0:100930 5.5 5:a7b64eb3:::benchmark_data_smithi006_114134_object100929:head [set-alloc-hint object_size 65536 write_size 65536,write 0~65536] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e37)", 2023-08-01T19:55:46.526 INFO:teuthology.orchestra.run.smithi008.stdout: "initiated_at": "2023-08-01T19:55:05.565766+0000", 2023-08-01T19:55:46.526 INFO:teuthology.orchestra.run.smithi008.stdout: "age": 40.882204840999997, 2023-08-01T19:55:46.526 INFO:teuthology.orchestra.run.smithi008.stdout: "duration": 0.063668735000000004, 2023-08-01T19:55:46.526 INFO:teuthology.orchestra.run.smithi008.stdout: "type_data": { 2023-08-01T19:55:46.526 INFO:teuthology.orchestra.run.smithi008.stdout: "flag_point": "commit sent; apply or cleanup", 2023-08-01T19:55:46.526 INFO:teuthology.orchestra.run.smithi008.stdout: "client_info": { 2023-08-01T19:55:46.526 INFO:teuthology.orchestra.run.smithi008.stdout: "client": "client.4668", 2023-08-01T19:55:46.527 INFO:teuthology.orchestra.run.smithi008.stdout: "client_addr": "172.21.15.6:0/1709472247", 2023-08-01T19:55:46.527 INFO:teuthology.orchestra.run.smithi008.stdout: "tid": 100930 2023-08-01T19:55:46.527 INFO:teuthology.orchestra.run.smithi008.stdout: }, 2023-08-01T19:55:46.527 INFO:teuthology.orchestra.run.smithi008.stdout: "events": [ 2023-08-01T19:55:46.527 INFO:teuthology.orchestra.run.smithi008.stdout: { 2023-08-01T19:55:46.528 INFO:teuthology.orchestra.run.smithi008.stdout: "event": "initiated", 2023-08-01T19:55:46.528 INFO:teuthology.orchestra.run.smithi008.stdout: "time": "2023-08-01T19:55:05.565766+0000", 2023-08-01T19:55:46.528 INFO:teuthology.orchestra.run.smithi008.stdout: "duration": 0 2023-08-01T19:55:46.528 INFO:teuthology.orchestra.run.smithi008.stdout: }, 2023-08-01T19:55:46.528 INFO:teuthology.orchestra.run.smithi008.stdout: { 2023-08-01T19:55:46.528 INFO:teuthology.orchestra.run.smithi008.stdout: "event": "throttled", 2023-08-01T19:55:46.529 INFO:teuthology.orchestra.run.smithi008.stdout: "time": "2023-08-01T19:55:05.565766+0000", 2023-08-01T19:55:46.529 INFO:teuthology.orchestra.run.smithi008.stdout: "duration": 0 2023-08-01T19:55:46.529 INFO:teuthology.orchestra.run.smithi008.stdout: }, 2023-08-01T19:55:46.529 INFO:teuthology.orchestra.run.smithi008.stdout: { 2023-08-01T19:55:46.529 INFO:teuthology.orchestra.run.smithi008.stdout: "event": "header_read", 2023-08-01T19:55:46.529 INFO:teuthology.orchestra.run.smithi008.stdout: "time": "2023-08-01T19:55:05.565766+0000", 2023-08-01T19:55:46.529 INFO:teuthology.orchestra.run.smithi008.stdout: "duration": 4294967295.999999 2023-08-01T19:55:46.529 INFO:teuthology.orchestra.run.smithi008.stdout: }, 2023-08-01T19:55:46.530 INFO:teuthology.orchestra.run.smithi008.stdout: { 2023-08-01T19:55:46.530 INFO:teuthology.orchestra.run.smithi008.stdout: "event": "all_read", 2023-08-01T19:55:46.530 INFO:teuthology.orchestra.run.smithi008.stdout: "time": "2023-08-01T19:55:05.565855+0000", 2023-08-01T19:55:46.530 INFO:teuthology.orchestra.run.smithi008.stdout: "duration": 8.9166999999999995e-05 2023-08-01T19:55:46.530 INFO:teuthology.orchestra.run.smithi008.stdout: }, 2023-08-01T19:55:46.530 INFO:teuthology.orchestra.run.smithi008.stdout: { 2023-08-01T19:55:46.530 INFO:teuthology.orchestra.run.smithi008.stdout: "event": "dispatched", 2023-08-01T19:55:46.530 INFO:teuthology.orchestra.run.smithi008.stdout: "time": "2023-08-01T19:55:05.565862+0000", 2023-08-01T19:55:46.531 INFO:teuthology.orchestra.run.smithi008.stdout: "duration": 7.4549999999999998e-06 2023-08-01T19:55:46.531 INFO:teuthology.orchestra.run.smithi008.stdout: }, 2023-08-01T19:55:46.531 INFO:teuthology.orchestra.run.smithi008.stdout: { 2023-08-01T19:55:46.531 INFO:teuthology.orchestra.run.smithi008.stdout: "event": "queued_for_pg", 2023-08-01T19:55:46.531 INFO:teuthology.orchestra.run.smithi008.stdout: "time": "2023-08-01T19:55:05.565866+0000", 2023-08-01T19:55:46.531 INFO:teuthology.orchestra.run.smithi008.stdout: "duration": 3.8060000000000001e-06 2023-08-01T19:55:46.531 INFO:teuthology.orchestra.run.smithi008.stdout: }, 2023-08-01T19:55:46.532 INFO:teuthology.orchestra.run.smithi008.stdout: { 2023-08-01T19:55:46.532 INFO:teuthology.orchestra.run.smithi008.stdout: "event": "reached_pg", 2023-08-01T19:55:46.532 INFO:teuthology.orchestra.run.smithi008.stdout: "time": "2023-08-01T19:55:05.565901+0000", 2023-08-01T19:55:46.532 INFO:teuthology.orchestra.run.smithi008.stdout: "duration": 3.5063e-05 2023-08-01T19:55:46.532 INFO:teuthology.orchestra.run.smithi008.stdout: }, 2023-08-01T19:55:46.532 INFO:teuthology.orchestra.run.smithi008.stdout: { 2023-08-01T19:55:46.532 INFO:teuthology.orchestra.run.smithi008.stdout: "event": "started", 2023-08-01T19:55:46.533 INFO:teuthology.orchestra.run.smithi008.stdout: "time": "2023-08-01T19:55:05.566016+0000", 2023-08-01T19:55:46.533 INFO:teuthology.orchestra.run.smithi008.stdout: "duration": 0.00011509400000000001 2023-08-01T19:55:46.533 INFO:teuthology.orchestra.run.smithi008.stdout: }, 2023-08-01T19:55:46.533 INFO:teuthology.orchestra.run.smithi008.stdout: { 2023-08-01T19:55:46.533 INFO:teuthology.orchestra.run.smithi008.stdout: "event": "waiting for subops from 1", 2023-08-01T19:55:46.533 INFO:teuthology.orchestra.run.smithi008.stdout: "time": "2023-08-01T19:55:05.566154+0000", 2023-08-01T19:55:46.533 INFO:teuthology.orchestra.run.smithi008.stdout: "duration": 0.000138052 2023-08-01T19:55:46.534 INFO:teuthology.orchestra.run.smithi008.stdout: }, 2023-08-01T19:55:46.534 INFO:teuthology.orchestra.run.smithi008.stdout: { 2023-08-01T19:55:46.534 INFO:teuthology.orchestra.run.smithi008.stdout: "event": "sub_op_commit_rec", 2023-08-01T19:55:46.534 INFO:teuthology.orchestra.run.smithi008.stdout: "time": "2023-08-01T19:55:05.629279+0000", 2023-08-01T19:55:46.534 INFO:teuthology.orchestra.run.smithi008.stdout: "duration": 0.063124531999999997 2023-08-01T19:55:46.534 INFO:teuthology.orchestra.run.smithi008.stdout: }, 2023-08-01T19:55:46.534 INFO:teuthology.orchestra.run.smithi008.stdout: { 2023-08-01T19:55:46.535 INFO:teuthology.orchestra.run.smithi008.stdout: "event": "op_commit", 2023-08-01T19:55:46.535 INFO:teuthology.orchestra.run.smithi008.stdout: "time": "2023-08-01T19:55:05.629333+0000", 2023-08-01T19:55:46.535 INFO:teuthology.orchestra.run.smithi008.stdout: "duration": 5.4694999999999997e-05 2023-08-01T19:55:46.535 INFO:teuthology.orchestra.run.smithi008.stdout: }, 2023-08-01T19:55:46.535 INFO:teuthology.orchestra.run.smithi008.stdout: { 2023-08-01T19:55:46.535 INFO:teuthology.orchestra.run.smithi008.stdout: "event": "commit_sent", 2023-08-01T19:55:46.535 INFO:teuthology.orchestra.run.smithi008.stdout: "time": "2023-08-01T19:55:05.629390+0000", 2023-08-01T19:55:46.535 INFO:teuthology.orchestra.run.smithi008.stdout: "duration": 5.6416000000000003e-05 2023-08-01T19:55:46.536 INFO:teuthology.orchestra.run.smithi008.stdout: }, 2023-08-01T19:55:46.536 INFO:teuthology.orchestra.run.smithi008.stdout: { 2023-08-01T19:55:46.536 INFO:teuthology.orchestra.run.smithi008.stdout: "event": "done", 2023-08-01T19:55:46.536 INFO:teuthology.orchestra.run.smithi008.stdout: "time": "2023-08-01T19:55:05.629435+0000", 2023-08-01T19:55:46.536 INFO:teuthology.orchestra.run.smithi008.stdout: "duration": 4.5170999999999998e-05 2023-08-01T19:55:46.536 INFO:teuthology.orchestra.run.smithi008.stdout: } 2023-08-01T19:55:46.536 INFO:teuthology.orchestra.run.smithi008.stdout: ] 2023-08-01T19:55:46.536 INFO:teuthology.orchestra.run.smithi008.stdout: } 2023-08-01T19:55:46.537 INFO:teuthology.orchestra.run.smithi008.stdout: }, 2023-08-01T19:55:46.537 INFO:teuthology.orchestra.run.smithi008.stdout: { 2023-08-01T19:55:46.537 INFO:teuthology.orchestra.run.smithi008.stdout: "description": "osd_op(client.4668.0:100933 5.5 5:af92e9f2:::benchmark_data_smithi006_114134_object100932:head [set-alloc-hint object_size 65536 write_size 65536,write 0~65536] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e37)", 2023-08-01T19:55:46.537 INFO:teuthology.orchestra.run.smithi008.stdout: "initiated_at": "2023-08-01T19:55:05.566634+0000", 2023-08-01T19:55:46.537 INFO:teuthology.orchestra.run.smithi008.stdout: "age": 40.881337297999998, 2023-08-01T19:55:46.537 INFO:teuthology.orchestra.run.smithi008.stdout: "duration": 0.065909364999999998, 2023-08-01T19:55:46.537 INFO:teuthology.orchestra.run.smithi008.stdout: "type_data": { 2023-08-01T19:55:46.538 INFO:teuthology.orchestra.run.smithi008.stdout: "flag_point": "commit sent; apply or cleanup", 2023-08-01T19:55:46.538 INFO:teuthology.orchestra.run.smithi008.stdout: "client_info": { 2023-08-01T19:55:46.538 INFO:teuthology.orchestra.run.smithi008.stdout: "client": "client.4668", 2023-08-01T19:55:46.538 INFO:teuthology.orchestra.run.smithi008.stdout: "client_addr": "172.21.15.6:0/1709472247", 2023-08-01T19:55:46.538 INFO:teuthology.orchestra.run.smithi008.stdout: "tid": 100933 2023-08-01T19:55:46.538 INFO:teuthology.orchestra.run.smithi008.stdout: }, 2023-08-01T19:55:46.538 INFO:teuthology.orchestra.run.smithi008.stdout: "events": [ 2023-08-01T19:55:46.538 INFO:teuthology.orchestra.run.smithi008.stdout: { 2023-08-01T19:55:46.539 INFO:teuthology.orchestra.run.smithi008.stdout: "event": "initiated", 2023-08-01T19:55:46.539 INFO:teuthology.orchestra.run.smithi008.stdout: "time": "2023-08-01T19:55:05.566634+0000", 2023-08-01T19:55:46.539 INFO:teuthology.orchestra.run.smithi008.stdout: "duration": 0 2023-08-01T19:55:46.539 INFO:teuthology.orchestra.run.smithi008.stdout: }, 2023-08-01T19:55:46.539 INFO:teuthology.orchestra.run.smithi008.stdout: { 2023-08-01T19:55:46.539 INFO:teuthology.orchestra.run.smithi008.stdout: "event": "throttled", 2023-08-01T19:55:46.539 INFO:teuthology.orchestra.run.smithi008.stdout: "time": "2023-08-01T19:55:05.566634+0000", 2023-08-01T19:55:46.539 INFO:teuthology.orchestra.run.smithi008.stdout: "duration": 0 2023-08-01T19:55:46.540 INFO:teuthology.orchestra.run.smithi008.stdout: }, 2023-08-01T19:55:46.540 INFO:teuthology.orchestra.run.smithi008.stdout: { 2023-08-01T19:55:46.540 INFO:teuthology.orchestra.run.smithi008.stdout: "event": "header_read", 2023-08-01T19:55:46.540 INFO:teuthology.orchestra.run.smithi008.stdout: "time": "2023-08-01T19:55:05.566630+0000", 2023-08-01T19:55:46.540 INFO:teuthology.orchestra.run.smithi008.stdout: "duration": 4294967295.9999962 2023-08-01T19:55:46.540 INFO:teuthology.orchestra.run.smithi008.stdout: }, 2023-08-01T19:55:46.540 INFO:teuthology.orchestra.run.smithi008.stdout: { 2023-08-01T19:55:46.540 INFO:teuthology.orchestra.run.smithi008.stdout: "event": "all_read", 2023-08-01T19:55:46.541 INFO:teuthology.orchestra.run.smithi008.stdout: "time": "2023-08-01T19:55:05.566736+0000", 2023-08-01T19:55:46.541 INFO:teuthology.orchestra.run.smithi008.stdout: "duration": 0.000105752 2023-08-01T19:55:46.541 INFO:teuthology.orchestra.run.smithi008.stdout: }, 2023-08-01T19:55:46.541 INFO:teuthology.orchestra.run.smithi008.stdout: { 2023-08-01T19:55:46.541 INFO:teuthology.orchestra.run.smithi008.stdout: "event": "dispatched", 2023-08-01T19:55:46.541 INFO:teuthology.orchestra.run.smithi008.stdout: "time": "2023-08-01T19:55:05.566742+0000", 2023-08-01T19:55:46.541 INFO:teuthology.orchestra.run.smithi008.stdout: "duration": 5.8209999999999998e-06 2023-08-01T19:55:46.541 INFO:teuthology.orchestra.run.smithi008.stdout: }, 2023-08-01T19:55:46.542 INFO:teuthology.orchestra.run.smithi008.stdout: { 2023-08-01T19:55:46.542 INFO:teuthology.orchestra.run.smithi008.stdout: "event": "queued_for_pg", 2023-08-01T19:55:46.542 INFO:teuthology.orchestra.run.smithi008.stdout: "time": "2023-08-01T19:55:05.566745+0000", 2023-08-01T19:55:46.542 INFO:teuthology.orchestra.run.smithi008.stdout: "duration": 3.337e-06 2023-08-01T19:55:46.542 INFO:teuthology.orchestra.run.smithi008.stdout: }, 2023-08-01T19:55:46.542 INFO:teuthology.orchestra.run.smithi008.stdout: { 2023-08-01T19:55:46.542 INFO:teuthology.orchestra.run.smithi008.stdout: "event": "reached_pg", 2023-08-01T19:55:46.543 INFO:teuthology.orchestra.run.smithi008.stdout: "time": "2023-08-01T19:55:05.568175+0000", 2023-08-01T19:55:46.543 INFO:teuthology.orchestra.run.smithi008.stdout: "duration": 0.001429647 2023-08-01T19:55:46.543 INFO:teuthology.orchestra.run.smithi008.stdout: }, 2023-08-01T19:55:46.543 INFO:teuthology.orchestra.run.smithi008.stdout: { 2023-08-01T19:55:46.543 INFO:teuthology.orchestra.run.smithi008.stdout: "event": "started", 2023-08-01T19:55:46.543 INFO:teuthology.orchestra.run.smithi008.stdout: "time": "2023-08-01T19:55:05.568288+0000", 2023-08-01T19:55:46.543 INFO:teuthology.orchestra.run.smithi008.stdout: "duration": 0.000113353 2023-08-01T19:55:46.543 INFO:teuthology.orchestra.run.smithi008.stdout: }, 2023-08-01T19:55:46.544 INFO:teuthology.orchestra.run.smithi008.stdout: { 2023-08-01T19:55:46.544 INFO:teuthology.orchestra.run.smithi008.stdout: "event": "waiting for subops from 1", 2023-08-01T19:55:46.544 INFO:teuthology.orchestra.run.smithi008.stdout: "time": "2023-08-01T19:55:05.568425+0000", 2023-08-01T19:55:46.544 INFO:teuthology.orchestra.run.smithi008.stdout: "duration": 0.000137346 2023-08-01T19:55:46.544 INFO:teuthology.orchestra.run.smithi008.stdout: }, 2023-08-01T19:55:46.544 INFO:teuthology.orchestra.run.smithi008.stdout: { 2023-08-01T19:55:46.544 INFO:teuthology.orchestra.run.smithi008.stdout: "event": "sub_op_commit_rec", 2023-08-01T19:55:46.544 INFO:teuthology.orchestra.run.smithi008.stdout: "time": "2023-08-01T19:55:05.629320+0000", 2023-08-01T19:55:46.545 INFO:teuthology.orchestra.run.smithi008.stdout: "duration": 0.060894491000000002 2023-08-01T19:55:46.545 INFO:teuthology.orchestra.run.smithi008.stdout: }, 2023-08-01T19:55:46.545 INFO:teuthology.orchestra.run.smithi008.stdout: { 2023-08-01T19:55:46.545 INFO:teuthology.orchestra.run.smithi008.stdout: "event": "op_commit", 2023-08-01T19:55:46.545 INFO:teuthology.orchestra.run.smithi008.stdout: "time": "2023-08-01T19:55:05.632452+0000", 2023-08-01T19:55:46.545 INFO:teuthology.orchestra.run.smithi008.stdout: "duration": 0.003131909 2023-08-01T19:55:46.545 INFO:teuthology.orchestra.run.smithi008.stdout: }, 2023-08-01T19:55:46.546 INFO:teuthology.orchestra.run.smithi008.stdout: { 2023-08-01T19:55:46.546 INFO:teuthology.orchestra.run.smithi008.stdout: "event": "commit_sent", 2023-08-01T19:55:46.546 INFO:teuthology.orchestra.run.smithi008.stdout: "time": "2023-08-01T19:55:05.632503+0000", 2023-08-01T19:55:46.546 INFO:teuthology.orchestra.run.smithi008.stdout: "duration": 5.1295000000000003e-05 2023-08-01T19:55:46.546 INFO:teuthology.orchestra.run.smithi008.stdout: }, 2023-08-01T19:55:46.546 INFO:teuthology.orchestra.run.smithi008.stdout: { 2023-08-01T19:55:46.546 INFO:teuthology.orchestra.run.smithi008.stdout: "event": "done", 2023-08-01T19:55:46.546 INFO:teuthology.orchestra.run.smithi008.stdout: "time": "2023-08-01T19:55:05.632543+0000", 2023-08-01T19:55:46.547 INFO:teuthology.orchestra.run.smithi008.stdout: "duration": 4.0234000000000001e-05 2023-08-01T19:55:46.547 INFO:teuthology.orchestra.run.smithi008.stdout: } 2023-08-01T19:55:46.547 INFO:teuthology.orchestra.run.smithi008.stdout: ] 2023-08-01T19:55:46.547 INFO:teuthology.orchestra.run.smithi008.stdout: } 2023-08-01T19:55:46.547 INFO:teuthology.orchestra.run.smithi008.stdout: }, 2023-08-01T19:55:46.547 INFO:teuthology.orchestra.run.smithi008.stdout: { 2023-08-01T19:55:46.547 INFO:teuthology.orchestra.run.smithi008.stdout: "description": "osd_repop(client.4668.0:100935 5.e e37/19 5:7895b14e:::benchmark_data_smithi006_114134_object100934:head v 37'6305, mlcod=37'6303)", 2023-08-01T19:55:46.547 INFO:teuthology.orchestra.run.smithi008.stdout: "initiated_at": "2023-08-01T19:55:05.567118+0000", 2023-08-01T19:55:46.548 INFO:teuthology.orchestra.run.smithi008.stdout: "age": 40.880853055000003, 2023-08-01T19:55:46.548 INFO:teuthology.orchestra.run.smithi008.stdout: "duration": 0.063691180999999999, 2023-08-01T19:55:46.548 INFO:teuthology.orchestra.run.smithi008.stdout: "type_data": { 2023-08-01T19:55:46.548 INFO:teuthology.orchestra.run.smithi008.stdout: "flag_point": "commit sent; apply or cleanup", 2023-08-01T19:55:46.548 INFO:teuthology.orchestra.run.smithi008.stdout: "events": [ 2023-08-01T19:55:46.548 INFO:teuthology.orchestra.run.smithi008.stdout: { 2023-08-01T19:55:46.548 INFO:teuthology.orchestra.run.smithi008.stdout: "event": "initiated", 2023-08-01T19:55:46.548 INFO:teuthology.orchestra.run.smithi008.stdout: "time": "2023-08-01T19:55:05.567118+0000", 2023-08-01T19:55:46.549 INFO:teuthology.orchestra.run.smithi008.stdout: "duration": 0 2023-08-01T19:55:46.549 INFO:teuthology.orchestra.run.smithi008.stdout: }, 2023-08-01T19:55:46.549 INFO:teuthology.orchestra.run.smithi008.stdout: { 2023-08-01T19:55:46.549 INFO:teuthology.orchestra.run.smithi008.stdout: "event": "throttled", 2023-08-01T19:55:46.549 INFO:teuthology.orchestra.run.smithi008.stdout: "time": "2023-08-01T19:55:05.567118+0000", 2023-08-01T19:55:46.549 INFO:teuthology.orchestra.run.smithi008.stdout: "duration": 0 2023-08-01T19:55:46.549 INFO:teuthology.orchestra.run.smithi008.stdout: }, 2023-08-01T19:55:46.549 INFO:teuthology.orchestra.run.smithi008.stdout: { 2023-08-01T19:55:46.550 INFO:teuthology.orchestra.run.smithi008.stdout: "event": "header_read", 2023-08-01T19:55:46.550 INFO:teuthology.orchestra.run.smithi008.stdout: "time": "2023-08-01T19:55:05.567117+0000", 2023-08-01T19:55:46.550 INFO:teuthology.orchestra.run.smithi008.stdout: "duration": 4294967295.999999 2023-08-01T19:55:46.550 INFO:teuthology.orchestra.run.smithi008.stdout: }, 2023-08-01T19:55:46.550 INFO:teuthology.orchestra.run.smithi008.stdout: { 2023-08-01T19:55:46.550 INFO:teuthology.orchestra.run.smithi008.stdout: "event": "all_read", 2023-08-01T19:55:46.550 INFO:teuthology.orchestra.run.smithi008.stdout: "time": "2023-08-01T19:55:05.567168+0000", 2023-08-01T19:55:46.551 INFO:teuthology.orchestra.run.smithi008.stdout: "duration": 5.0353999999999999e-05 2023-08-01T19:55:46.551 INFO:teuthology.orchestra.run.smithi008.stdout: }, 2023-08-01T19:55:46.551 INFO:teuthology.orchestra.run.smithi008.stdout: { 2023-08-01T19:55:46.551 INFO:teuthology.orchestra.run.smithi008.stdout: "event": "dispatched", 2023-08-01T19:55:46.551 INFO:teuthology.orchestra.run.smithi008.stdout: "time": "2023-08-01T19:55:05.567175+0000", 2023-08-01T19:55:46.551 INFO:teuthology.orchestra.run.smithi008.stdout: "duration": 7.3919999999999997e-06 2023-08-01T19:55:46.551 INFO:teuthology.orchestra.run.smithi008.stdout: }, 2023-08-01T19:55:46.552 INFO:teuthology.orchestra.run.smithi008.stdout: { 2023-08-01T19:55:46.552 INFO:teuthology.orchestra.run.smithi008.stdout: "event": "queued_for_pg", 2023-08-01T19:55:46.552 INFO:teuthology.orchestra.run.smithi008.stdout: "time": "2023-08-01T19:55:05.567180+0000", 2023-08-01T19:55:46.552 INFO:teuthology.orchestra.run.smithi008.stdout: "duration": 5.3090000000000003e-06 2023-08-01T19:55:46.552 INFO:teuthology.orchestra.run.smithi008.stdout: }, 2023-08-01T19:55:46.552 INFO:teuthology.orchestra.run.smithi008.stdout: { 2023-08-01T19:55:46.552 INFO:teuthology.orchestra.run.smithi008.stdout: "event": "reached_pg", 2023-08-01T19:55:46.553 INFO:teuthology.orchestra.run.smithi008.stdout: "time": "2023-08-01T19:55:05.567210+0000", 2023-08-01T19:55:46.553 INFO:teuthology.orchestra.run.smithi008.stdout: "duration": 3.0001999999999998e-05 2023-08-01T19:55:46.553 INFO:teuthology.orchestra.run.smithi008.stdout: }, 2023-08-01T19:55:46.553 INFO:teuthology.orchestra.run.smithi008.stdout: { 2023-08-01T19:55:46.553 INFO:teuthology.orchestra.run.smithi008.stdout: "event": "started", 2023-08-01T19:55:46.553 INFO:teuthology.orchestra.run.smithi008.stdout: "time": "2023-08-01T19:55:05.567222+0000", 2023-08-01T19:55:46.553 INFO:teuthology.orchestra.run.smithi008.stdout: "duration": 1.1499e-05 2023-08-01T19:55:46.553 INFO:teuthology.orchestra.run.smithi008.stdout: }, 2023-08-01T19:55:46.554 INFO:teuthology.orchestra.run.smithi008.stdout: { 2023-08-01T19:55:46.554 INFO:teuthology.orchestra.run.smithi008.stdout: "event": "commit_sent", 2023-08-01T19:55:46.554 INFO:teuthology.orchestra.run.smithi008.stdout: "time": "2023-08-01T19:55:05.630772+0000", 2023-08-01T19:55:46.554 INFO:teuthology.orchestra.run.smithi008.stdout: "duration": 0.063550572999999999 2023-08-01T19:55:46.554 INFO:teuthology.orchestra.run.smithi008.stdout: }, 2023-08-01T19:55:46.554 INFO:teuthology.orchestra.run.smithi008.stdout: { 2023-08-01T19:55:46.554 INFO:teuthology.orchestra.run.smithi008.stdout: "event": "done", 2023-08-01T19:55:46.554 INFO:teuthology.orchestra.run.smithi008.stdout: "time": "2023-08-01T19:55:05.630809+0000", 2023-08-01T19:55:46.555 INFO:teuthology.orchestra.run.smithi008.stdout: "duration": 3.7033000000000003e-05 2023-08-01T19:55:46.555 INFO:teuthology.orchestra.run.smithi008.stdout: } 2023-08-01T19:55:46.555 INFO:teuthology.orchestra.run.smithi008.stdout: ] 2023-08-01T19:55:46.555 INFO:teuthology.orchestra.run.smithi008.stdout: } 2023-08-01T19:55:46.555 INFO:teuthology.orchestra.run.smithi008.stdout: }, 2023-08-01T19:55:46.555 INFO:teuthology.orchestra.run.smithi008.stdout: { 2023-08-01T19:55:46.555 INFO:teuthology.orchestra.run.smithi008.stdout: "description": "osd_repop(client.4668.0:100936 5.1 e37/19 5:8f4e3576:::benchmark_data_smithi006_114134_object100935:head v 37'6263, mlcod=37'6261)", 2023-08-01T19:55:46.556 INFO:teuthology.orchestra.run.smithi008.stdout: "initiated_at": "2023-08-01T19:55:05.567617+0000", 2023-08-01T19:55:46.556 INFO:teuthology.orchestra.run.smithi008.stdout: "age": 40.880353792000001, 2023-08-01T19:55:46.556 INFO:teuthology.orchestra.run.smithi008.stdout: "duration": 0.062773918999999997, 2023-08-01T19:55:46.556 INFO:teuthology.orchestra.run.smithi008.stdout: "type_data": { 2023-08-01T19:55:46.556 INFO:teuthology.orchestra.run.smithi008.stdout: "flag_point": "commit sent; apply or cleanup", 2023-08-01T19:55:46.556 INFO:teuthology.orchestra.run.smithi008.stdout: "events": [ 2023-08-01T19:55:46.556 INFO:teuthology.orchestra.run.smithi008.stdout: { 2023-08-01T19:55:46.557 INFO:teuthology.orchestra.run.smithi008.stdout: "event": "initiated", 2023-08-01T19:55:46.557 INFO:teuthology.orchestra.run.smithi008.stdout: "time": "2023-08-01T19:55:05.567617+0000", 2023-08-01T19:55:46.557 INFO:teuthology.orchestra.run.smithi008.stdout: "duration": 0 2023-08-01T19:55:46.557 INFO:teuthology.orchestra.run.smithi008.stdout: }, 2023-08-01T19:55:46.557 INFO:teuthology.orchestra.run.smithi008.stdout: { 2023-08-01T19:55:46.557 INFO:teuthology.orchestra.run.smithi008.stdout: "event": "throttled", 2023-08-01T19:55:46.557 INFO:teuthology.orchestra.run.smithi008.stdout: "time": "2023-08-01T19:55:05.567617+0000", 2023-08-01T19:55:46.558 INFO:teuthology.orchestra.run.smithi008.stdout: "duration": 0 2023-08-01T19:55:46.558 INFO:teuthology.orchestra.run.smithi008.stdout: }, 2023-08-01T19:55:46.558 INFO:teuthology.orchestra.run.smithi008.stdout: { 2023-08-01T19:55:46.558 INFO:teuthology.orchestra.run.smithi008.stdout: "event": "header_read", 2023-08-01T19:55:46.558 INFO:teuthology.orchestra.run.smithi008.stdout: "time": "2023-08-01T19:55:05.567617+0000", 2023-08-01T19:55:46.558 INFO:teuthology.orchestra.run.smithi008.stdout: "duration": 4294967295.9999995 2023-08-01T19:55:46.558 INFO:teuthology.orchestra.run.smithi008.stdout: }, 2023-08-01T19:55:46.558 INFO:teuthology.orchestra.run.smithi008.stdout: { 2023-08-01T19:55:46.559 INFO:teuthology.orchestra.run.smithi008.stdout: "event": "all_read", 2023-08-01T19:55:46.559 INFO:teuthology.orchestra.run.smithi008.stdout: "time": "2023-08-01T19:55:05.567700+0000", 2023-08-01T19:55:46.559 INFO:teuthology.orchestra.run.smithi008.stdout: "duration": 8.3363999999999997e-05 2023-08-01T19:55:46.559 INFO:teuthology.orchestra.run.smithi008.stdout: }, 2023-08-01T19:55:46.559 INFO:teuthology.orchestra.run.smithi008.stdout: { 2023-08-01T19:55:46.559 INFO:teuthology.orchestra.run.smithi008.stdout: "event": "dispatched", 2023-08-01T19:55:46.559 INFO:teuthology.orchestra.run.smithi008.stdout: "time": "2023-08-01T19:55:05.567706+0000", 2023-08-01T19:55:46.559 INFO:teuthology.orchestra.run.smithi008.stdout: "duration": 5.9739999999999999e-06 2023-08-01T19:55:46.560 INFO:teuthology.orchestra.run.smithi008.stdout: }, 2023-08-01T19:55:46.560 INFO:teuthology.orchestra.run.smithi008.stdout: { 2023-08-01T19:55:46.560 INFO:teuthology.orchestra.run.smithi008.stdout: "event": "queued_for_pg", 2023-08-01T19:55:46.560 INFO:teuthology.orchestra.run.smithi008.stdout: "time": "2023-08-01T19:55:05.567709+0000", 2023-08-01T19:55:46.560 INFO:teuthology.orchestra.run.smithi008.stdout: "duration": 3.1420000000000002e-06 2023-08-01T19:55:46.560 INFO:teuthology.orchestra.run.smithi008.stdout: }, 2023-08-01T19:55:46.560 INFO:teuthology.orchestra.run.smithi008.stdout: { 2023-08-01T19:55:46.561 INFO:teuthology.orchestra.run.smithi008.stdout: "event": "reached_pg", 2023-08-01T19:55:46.561 INFO:teuthology.orchestra.run.smithi008.stdout: "time": "2023-08-01T19:55:05.567741+0000", 2023-08-01T19:55:46.561 INFO:teuthology.orchestra.run.smithi008.stdout: "duration": 3.1532999999999998e-05 2023-08-01T19:55:46.561 INFO:teuthology.orchestra.run.smithi008.stdout: }, 2023-08-01T19:55:46.561 INFO:teuthology.orchestra.run.smithi008.stdout: { 2023-08-01T19:55:46.561 INFO:teuthology.orchestra.run.smithi008.stdout: "event": "started", 2023-08-01T19:55:46.561 INFO:teuthology.orchestra.run.smithi008.stdout: "time": "2023-08-01T19:55:05.567752+0000", 2023-08-01T19:55:46.561 INFO:teuthology.orchestra.run.smithi008.stdout: "duration": 1.1266e-05 2023-08-01T19:55:46.562 INFO:teuthology.orchestra.run.smithi008.stdout: }, 2023-08-01T19:55:46.562 INFO:teuthology.orchestra.run.smithi008.stdout: { 2023-08-01T19:55:46.562 INFO:teuthology.orchestra.run.smithi008.stdout: "event": "commit_sent", 2023-08-01T19:55:46.562 INFO:teuthology.orchestra.run.smithi008.stdout: "time": "2023-08-01T19:55:05.630357+0000", 2023-08-01T19:55:46.562 INFO:teuthology.orchestra.run.smithi008.stdout: "duration": 0.062604554000000007 2023-08-01T19:55:46.562 INFO:teuthology.orchestra.run.smithi008.stdout: }, 2023-08-01T19:55:46.562 INFO:teuthology.orchestra.run.smithi008.stdout: { 2023-08-01T19:55:46.562 INFO:teuthology.orchestra.run.smithi008.stdout: "event": "done", 2023-08-01T19:55:46.563 INFO:teuthology.orchestra.run.smithi008.stdout: "time": "2023-08-01T19:55:05.630391+0000", 2023-08-01T19:55:46.563 INFO:teuthology.orchestra.run.smithi008.stdout: "duration": 3.4619000000000002e-05 2023-08-01T19:55:46.563 INFO:teuthology.orchestra.run.smithi008.stdout: } 2023-08-01T19:55:46.563 INFO:teuthology.orchestra.run.smithi008.stdout: ] 2023-08-01T19:55:46.563 INFO:teuthology.orchestra.run.smithi008.stdout: } 2023-08-01T19:55:46.563 INFO:teuthology.orchestra.run.smithi008.stdout: }, 2023-08-01T19:55:46.563 INFO:teuthology.orchestra.run.smithi008.stdout: { 2023-08-01T19:55:46.564 INFO:teuthology.orchestra.run.smithi008.stdout: "description": "osd_op(client.4668.0:100937 5.c 5:34445fc3:::benchmark_data_smithi006_114134_object100936:head [set-alloc-hint object_size 65536 write_size 65536,write 0~65536] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e37)", 2023-08-01T19:55:46.564 INFO:teuthology.orchestra.run.smithi008.stdout: "initiated_at": "2023-08-01T19:55:05.569198+0000", 2023-08-01T19:55:46.564 INFO:teuthology.orchestra.run.smithi008.stdout: "age": 40.878773168999999, 2023-08-01T19:55:46.564 INFO:teuthology.orchestra.run.smithi008.stdout: "duration": 0.063349390000000005, 2023-08-01T19:55:46.564 INFO:teuthology.orchestra.run.smithi008.stdout: "type_data": { 2023-08-01T19:55:46.564 INFO:teuthology.orchestra.run.smithi008.stdout: "flag_point": "commit sent; apply or cleanup", 2023-08-01T19:55:46.564 INFO:teuthology.orchestra.run.smithi008.stdout: "client_info": { 2023-08-01T19:55:46.565 INFO:teuthology.orchestra.run.smithi008.stdout: "client": "client.4668", 2023-08-01T19:55:46.565 INFO:teuthology.orchestra.run.smithi008.stdout: "client_addr": "172.21.15.6:0/1709472247", 2023-08-01T19:55:46.565 INFO:teuthology.orchestra.run.smithi008.stdout: "tid": 100937 2023-08-01T19:55:46.565 INFO:teuthology.orchestra.run.smithi008.stdout: }, 2023-08-01T19:55:46.566 INFO:teuthology.orchestra.run.smithi008.stdout: "events": [ 2023-08-01T19:55:46.566 INFO:teuthology.orchestra.run.smithi008.stdout: { 2023-08-01T19:55:46.566 INFO:teuthology.orchestra.run.smithi008.stdout: "event": "initiated", 2023-08-01T19:55:46.567 INFO:teuthology.orchestra.run.smithi008.stdout: "time": "2023-08-01T19:55:05.569198+0000", 2023-08-01T19:55:46.567 INFO:teuthology.orchestra.run.smithi008.stdout: "duration": 0 2023-08-01T19:55:46.567 INFO:teuthology.orchestra.run.smithi008.stdout: }, 2023-08-01T19:55:46.567 INFO:teuthology.orchestra.run.smithi008.stdout: { 2023-08-01T19:55:46.567 INFO:teuthology.orchestra.run.smithi008.stdout: "event": "throttled", 2023-08-01T19:55:46.568 INFO:teuthology.orchestra.run.smithi008.stdout: "time": "2023-08-01T19:55:05.569198+0000", 2023-08-01T19:55:46.568 INFO:teuthology.orchestra.run.smithi008.stdout: "duration": 0 2023-08-01T19:55:46.568 INFO:teuthology.orchestra.run.smithi008.stdout: }, 2023-08-01T19:55:46.568 INFO:teuthology.orchestra.run.smithi008.stdout: { 2023-08-01T19:55:46.568 INFO:teuthology.orchestra.run.smithi008.stdout: "event": "header_read", 2023-08-01T19:55:46.568 INFO:teuthology.orchestra.run.smithi008.stdout: "time": "2023-08-01T19:55:05.569197+0000", 2023-08-01T19:55:46.569 INFO:teuthology.orchestra.run.smithi008.stdout: "duration": 4294967295.999999 2023-08-01T19:55:46.569 INFO:teuthology.orchestra.run.smithi008.stdout: }, 2023-08-01T19:55:46.569 INFO:teuthology.orchestra.run.smithi008.stdout: { 2023-08-01T19:55:46.569 INFO:teuthology.orchestra.run.smithi008.stdout: "event": "all_read", 2023-08-01T19:55:46.569 INFO:teuthology.orchestra.run.smithi008.stdout: "time": "2023-08-01T19:55:05.569250+0000", 2023-08-01T19:55:46.569 INFO:teuthology.orchestra.run.smithi008.stdout: "duration": 5.3106000000000003e-05 2023-08-01T19:55:46.569 INFO:teuthology.orchestra.run.smithi008.stdout: }, 2023-08-01T19:55:46.570 INFO:teuthology.orchestra.run.smithi008.stdout: { 2023-08-01T19:55:46.570 INFO:teuthology.orchestra.run.smithi008.stdout: "event": "dispatched", 2023-08-01T19:55:46.570 INFO:teuthology.orchestra.run.smithi008.stdout: "time": "2023-08-01T19:55:05.569260+0000", 2023-08-01T19:55:46.570 INFO:teuthology.orchestra.run.smithi008.stdout: "duration": 9.533e-06 2023-08-01T19:55:46.570 INFO:teuthology.orchestra.run.smithi008.stdout: }, 2023-08-01T19:55:46.570 INFO:teuthology.orchestra.run.smithi008.stdout: { 2023-08-01T19:55:46.570 INFO:teuthology.orchestra.run.smithi008.stdout: "event": "queued_for_pg", 2023-08-01T19:55:46.570 INFO:teuthology.orchestra.run.smithi008.stdout: "time": "2023-08-01T19:55:05.569264+0000", 2023-08-01T19:55:46.571 INFO:teuthology.orchestra.run.smithi008.stdout: "duration": 4.6099999999999999e-06 2023-08-01T19:55:46.571 INFO:teuthology.orchestra.run.smithi008.stdout: }, 2023-08-01T19:55:46.571 INFO:teuthology.orchestra.run.smithi008.stdout: { 2023-08-01T19:55:46.571 INFO:teuthology.orchestra.run.smithi008.stdout: "event": "reached_pg", 2023-08-01T19:55:46.571 INFO:teuthology.orchestra.run.smithi008.stdout: "time": "2023-08-01T19:55:05.569293+0000", 2023-08-01T19:55:46.571 INFO:teuthology.orchestra.run.smithi008.stdout: "duration": 2.8181999999999999e-05 2023-08-01T19:55:46.571 INFO:teuthology.orchestra.run.smithi008.stdout: }, 2023-08-01T19:55:46.572 INFO:teuthology.orchestra.run.smithi008.stdout: { 2023-08-01T19:55:46.572 INFO:teuthology.orchestra.run.smithi008.stdout: "event": "started", 2023-08-01T19:55:46.572 INFO:teuthology.orchestra.run.smithi008.stdout: "time": "2023-08-01T19:55:05.569401+0000", 2023-08-01T19:55:46.572 INFO:teuthology.orchestra.run.smithi008.stdout: "duration": 0.000108065 2023-08-01T19:55:46.572 INFO:teuthology.orchestra.run.smithi008.stdout: }, 2023-08-01T19:55:46.572 INFO:teuthology.orchestra.run.smithi008.stdout: { 2023-08-01T19:55:46.572 INFO:teuthology.orchestra.run.smithi008.stdout: "event": "waiting for subops from 1", 2023-08-01T19:55:46.573 INFO:teuthology.orchestra.run.smithi008.stdout: "time": "2023-08-01T19:55:05.569521+0000", 2023-08-01T19:55:46.573 INFO:teuthology.orchestra.run.smithi008.stdout: "duration": 0.00012006900000000001 2023-08-01T19:55:46.573 INFO:teuthology.orchestra.run.smithi008.stdout: }, 2023-08-01T19:55:46.573 INFO:teuthology.orchestra.run.smithi008.stdout: { 2023-08-01T19:55:46.573 INFO:teuthology.orchestra.run.smithi008.stdout: "event": "sub_op_commit_rec", 2023-08-01T19:55:46.573 INFO:teuthology.orchestra.run.smithi008.stdout: "time": "2023-08-01T19:55:05.629421+0000", 2023-08-01T19:55:46.573 INFO:teuthology.orchestra.run.smithi008.stdout: "duration": 0.059900525000000003 2023-08-01T19:55:46.573 INFO:teuthology.orchestra.run.smithi008.stdout: }, 2023-08-01T19:55:46.574 INFO:teuthology.orchestra.run.smithi008.stdout: { 2023-08-01T19:55:46.574 INFO:teuthology.orchestra.run.smithi008.stdout: "event": "op_commit", 2023-08-01T19:55:46.574 INFO:teuthology.orchestra.run.smithi008.stdout: "time": "2023-08-01T19:55:05.632461+0000", 2023-08-01T19:55:46.574 INFO:teuthology.orchestra.run.smithi008.stdout: "duration": 0.0030401220000000001 2023-08-01T19:55:46.574 INFO:teuthology.orchestra.run.smithi008.stdout: }, 2023-08-01T19:55:46.574 INFO:teuthology.orchestra.run.smithi008.stdout: { 2023-08-01T19:55:46.574 INFO:teuthology.orchestra.run.smithi008.stdout: "event": "commit_sent", 2023-08-01T19:55:46.575 INFO:teuthology.orchestra.run.smithi008.stdout: "time": "2023-08-01T19:55:05.632507+0000", 2023-08-01T19:55:46.575 INFO:teuthology.orchestra.run.smithi008.stdout: "duration": 4.5361999999999997e-05 2023-08-01T19:55:46.575 INFO:teuthology.orchestra.run.smithi008.stdout: }, 2023-08-01T19:55:46.575 INFO:teuthology.orchestra.run.smithi008.stdout: { 2023-08-01T19:55:46.575 INFO:teuthology.orchestra.run.smithi008.stdout: "event": "done", 2023-08-01T19:55:46.575 INFO:teuthology.orchestra.run.smithi008.stdout: "time": "2023-08-01T19:55:05.632547+0000", 2023-08-01T19:55:46.575 INFO:teuthology.orchestra.run.smithi008.stdout: "duration": 4.0760999999999998e-05 2023-08-01T19:55:46.575 INFO:teuthology.orchestra.run.smithi008.stdout: } 2023-08-01T19:55:46.576 INFO:teuthology.orchestra.run.smithi008.stdout: ] 2023-08-01T19:55:46.576 INFO:teuthology.orchestra.run.smithi008.stdout: } 2023-08-01T19:55:46.576 INFO:teuthology.orchestra.run.smithi008.stdout: }, 2023-08-01T19:55:46.576 INFO:teuthology.orchestra.run.smithi008.stdout: { 2023-08-01T19:55:46.576 INFO:teuthology.orchestra.run.smithi008.stdout: "description": "osd_op(client.4668.0:100939 5.5 5:a75fa6e3:::benchmark_data_smithi006_114134_object100938:head [set-alloc-hint object_size 65536 write_size 65536,write 0~65536] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e37)", 2023-08-01T19:55:46.576 INFO:teuthology.orchestra.run.smithi008.stdout: "initiated_at": "2023-08-01T19:55:05.569740+0000", 2023-08-01T19:55:46.576 INFO:teuthology.orchestra.run.smithi008.stdout: "age": 40.878231626999998, 2023-08-01T19:55:46.576 INFO:teuthology.orchestra.run.smithi008.stdout: "duration": 0.067753412999999998, 2023-08-01T19:55:46.577 INFO:teuthology.orchestra.run.smithi008.stdout: "type_data": { 2023-08-01T19:55:46.577 INFO:teuthology.orchestra.run.smithi008.stdout: "flag_point": "commit sent; apply or cleanup", 2023-08-01T19:55:46.577 INFO:teuthology.orchestra.run.smithi008.stdout: "client_info": { 2023-08-01T19:55:46.577 INFO:teuthology.orchestra.run.smithi008.stdout: "client": "client.4668", 2023-08-01T19:55:46.577 INFO:teuthology.orchestra.run.smithi008.stdout: "client_addr": "172.21.15.6:0/1709472247", 2023-08-01T19:55:46.577 INFO:teuthology.orchestra.run.smithi008.stdout: "tid": 100939 2023-08-01T19:55:46.577 INFO:teuthology.orchestra.run.smithi008.stdout: }, 2023-08-01T19:55:46.577 INFO:teuthology.orchestra.run.smithi008.stdout: "events": [ 2023-08-01T19:55:46.578 INFO:teuthology.orchestra.run.smithi008.stdout: { 2023-08-01T19:55:46.578 INFO:teuthology.orchestra.run.smithi008.stdout: "event": "initiated", 2023-08-01T19:55:46.578 INFO:teuthology.orchestra.run.smithi008.stdout: "time": "2023-08-01T19:55:05.569740+0000", 2023-08-01T19:55:46.578 INFO:teuthology.orchestra.run.smithi008.stdout: "duration": 0 2023-08-01T19:55:46.578 INFO:teuthology.orchestra.run.smithi008.stdout: }, 2023-08-01T19:55:46.578 INFO:teuthology.orchestra.run.smithi008.stdout: { 2023-08-01T19:55:46.578 INFO:teuthology.orchestra.run.smithi008.stdout: "event": "throttled", 2023-08-01T19:55:46.579 INFO:teuthology.orchestra.run.smithi008.stdout: "time": "2023-08-01T19:55:05.569740+0000", 2023-08-01T19:55:46.579 INFO:teuthology.orchestra.run.smithi008.stdout: "duration": 0 2023-08-01T19:55:46.579 INFO:teuthology.orchestra.run.smithi008.stdout: }, 2023-08-01T19:55:46.579 INFO:teuthology.orchestra.run.smithi008.stdout: { 2023-08-01T19:55:46.579 INFO:teuthology.orchestra.run.smithi008.stdout: "event": "header_read", 2023-08-01T19:55:46.579 INFO:teuthology.orchestra.run.smithi008.stdout: "time": "2023-08-01T19:55:05.569739+0000", 2023-08-01T19:55:46.579 INFO:teuthology.orchestra.run.smithi008.stdout: "duration": 4294967295.9999995 2023-08-01T19:55:46.579 INFO:teuthology.orchestra.run.smithi008.stdout: }, 2023-08-01T19:55:46.580 INFO:teuthology.orchestra.run.smithi008.stdout: { 2023-08-01T19:55:46.580 INFO:teuthology.orchestra.run.smithi008.stdout: "event": "all_read", 2023-08-01T19:55:46.580 INFO:teuthology.orchestra.run.smithi008.stdout: "time": "2023-08-01T19:55:05.569839+0000", 2023-08-01T19:55:46.580 INFO:teuthology.orchestra.run.smithi008.stdout: "duration": 0.000100219 2023-08-01T19:55:46.580 INFO:teuthology.orchestra.run.smithi008.stdout: }, 2023-08-01T19:55:46.580 INFO:teuthology.orchestra.run.smithi008.stdout: { 2023-08-01T19:55:46.580 INFO:teuthology.orchestra.run.smithi008.stdout: "event": "dispatched", 2023-08-01T19:55:46.581 INFO:teuthology.orchestra.run.smithi008.stdout: "time": "2023-08-01T19:55:05.569846+0000", 2023-08-01T19:55:46.581 INFO:teuthology.orchestra.run.smithi008.stdout: "duration": 7.3150000000000003e-06 2023-08-01T19:55:46.581 INFO:teuthology.orchestra.run.smithi008.stdout: }, 2023-08-01T19:55:46.581 INFO:teuthology.orchestra.run.smithi008.stdout: { 2023-08-01T19:55:46.581 INFO:teuthology.orchestra.run.smithi008.stdout: "event": "queued_for_pg", 2023-08-01T19:55:46.581 INFO:teuthology.orchestra.run.smithi008.stdout: "time": "2023-08-01T19:55:05.569850+0000", 2023-08-01T19:55:46.581 INFO:teuthology.orchestra.run.smithi008.stdout: "duration": 3.3299999999999999e-06 2023-08-01T19:55:46.581 INFO:teuthology.orchestra.run.smithi008.stdout: }, 2023-08-01T19:55:46.582 INFO:teuthology.orchestra.run.smithi008.stdout: { 2023-08-01T19:55:46.582 INFO:teuthology.orchestra.run.smithi008.stdout: "event": "reached_pg", 2023-08-01T19:55:46.582 INFO:teuthology.orchestra.run.smithi008.stdout: "time": "2023-08-01T19:55:05.626991+0000", 2023-08-01T19:55:46.582 INFO:teuthology.orchestra.run.smithi008.stdout: "duration": 0.057141585000000002 2023-08-01T19:55:46.582 INFO:teuthology.orchestra.run.smithi008.stdout: }, 2023-08-01T19:55:46.582 INFO:teuthology.orchestra.run.smithi008.stdout: { 2023-08-01T19:55:46.582 INFO:teuthology.orchestra.run.smithi008.stdout: "event": "started", 2023-08-01T19:55:46.583 INFO:teuthology.orchestra.run.smithi008.stdout: "time": "2023-08-01T19:55:05.627111+0000", 2023-08-01T19:55:46.583 INFO:teuthology.orchestra.run.smithi008.stdout: "duration": 0.000119238 2023-08-01T19:55:46.583 INFO:teuthology.orchestra.run.smithi008.stdout: }, 2023-08-01T19:55:46.583 INFO:teuthology.orchestra.run.smithi008.stdout: { 2023-08-01T19:55:46.583 INFO:teuthology.orchestra.run.smithi008.stdout: "event": "waiting for subops from 1", 2023-08-01T19:55:46.583 INFO:teuthology.orchestra.run.smithi008.stdout: "time": "2023-08-01T19:55:05.627253+0000", 2023-08-01T19:55:46.583 INFO:teuthology.orchestra.run.smithi008.stdout: "duration": 0.000142822 2023-08-01T19:55:46.584 INFO:teuthology.orchestra.run.smithi008.stdout: }, 2023-08-01T19:55:46.584 INFO:teuthology.orchestra.run.smithi008.stdout: { 2023-08-01T19:55:46.584 INFO:teuthology.orchestra.run.smithi008.stdout: "event": "op_commit", 2023-08-01T19:55:46.584 INFO:teuthology.orchestra.run.smithi008.stdout: "time": "2023-08-01T19:55:05.632555+0000", 2023-08-01T19:55:46.584 INFO:teuthology.orchestra.run.smithi008.stdout: "duration": 0.0053012449999999996 2023-08-01T19:55:46.584 INFO:teuthology.orchestra.run.smithi008.stdout: }, 2023-08-01T19:55:46.584 INFO:teuthology.orchestra.run.smithi008.stdout: { 2023-08-01T19:55:46.585 INFO:teuthology.orchestra.run.smithi008.stdout: "event": "sub_op_commit_rec", 2023-08-01T19:55:46.585 INFO:teuthology.orchestra.run.smithi008.stdout: "time": "2023-08-01T19:55:05.637380+0000", 2023-08-01T19:55:46.585 INFO:teuthology.orchestra.run.smithi008.stdout: "duration": 0.0048257639999999997 2023-08-01T19:55:46.585 INFO:teuthology.orchestra.run.smithi008.stdout: }, 2023-08-01T19:55:46.585 INFO:teuthology.orchestra.run.smithi008.stdout: { 2023-08-01T19:55:46.585 INFO:teuthology.orchestra.run.smithi008.stdout: "event": "commit_sent", 2023-08-01T19:55:46.585 INFO:teuthology.orchestra.run.smithi008.stdout: "time": "2023-08-01T19:55:05.637454+0000", 2023-08-01T19:55:46.585 INFO:teuthology.orchestra.run.smithi008.stdout: "duration": 7.3578999999999995e-05 2023-08-01T19:55:46.586 INFO:teuthology.orchestra.run.smithi008.stdout: }, 2023-08-01T19:55:46.586 INFO:teuthology.orchestra.run.smithi008.stdout: { 2023-08-01T19:55:46.586 INFO:teuthology.orchestra.run.smithi008.stdout: "event": "done", 2023-08-01T19:55:46.586 INFO:teuthology.orchestra.run.smithi008.stdout: "time": "2023-08-01T19:55:05.637493+0000", 2023-08-01T19:55:46.586 INFO:teuthology.orchestra.run.smithi008.stdout: "duration": 3.8986999999999998e-05 2023-08-01T19:55:46.586 INFO:teuthology.orchestra.run.smithi008.stdout: } 2023-08-01T19:55:46.586 INFO:teuthology.orchestra.run.smithi008.stdout: ] 2023-08-01T19:55:46.587 INFO:teuthology.orchestra.run.smithi008.stdout: } 2023-08-01T19:55:46.587 INFO:teuthology.orchestra.run.smithi008.stdout: }, 2023-08-01T19:55:46.587 INFO:teuthology.orchestra.run.smithi008.stdout: { 2023-08-01T19:55:46.587 INFO:teuthology.orchestra.run.smithi008.stdout: "description": "osd_repop(client.4668.0:100941 5.e e37/19 5:736a6ac6:::benchmark_data_smithi006_114134_object100940:head v 37'6306, mlcod=37'6303)", 2023-08-01T19:55:46.587 INFO:teuthology.orchestra.run.smithi008.stdout: "initiated_at": "2023-08-01T19:55:05.570237+0000", 2023-08-01T19:55:46.587 INFO:teuthology.orchestra.run.smithi008.stdout: "age": 40.877734316999998, 2023-08-01T19:55:46.587 INFO:teuthology.orchestra.run.smithi008.stdout: "duration": 0.064830421999999999, 2023-08-01T19:55:46.587 INFO:teuthology.orchestra.run.smithi008.stdout: "type_data": { 2023-08-01T19:55:46.588 INFO:teuthology.orchestra.run.smithi008.stdout: "flag_point": "commit sent; apply or cleanup", 2023-08-01T19:55:46.588 INFO:teuthology.orchestra.run.smithi008.stdout: "events": [ 2023-08-01T19:55:46.588 INFO:teuthology.orchestra.run.smithi008.stdout: { 2023-08-01T19:55:46.588 INFO:teuthology.orchestra.run.smithi008.stdout: "event": "initiated", 2023-08-01T19:55:46.588 INFO:teuthology.orchestra.run.smithi008.stdout: "time": "2023-08-01T19:55:05.570237+0000", 2023-08-01T19:55:46.588 INFO:teuthology.orchestra.run.smithi008.stdout: "duration": 0 2023-08-01T19:55:46.588 INFO:teuthology.orchestra.run.smithi008.stdout: }, 2023-08-01T19:55:46.588 INFO:teuthology.orchestra.run.smithi008.stdout: { 2023-08-01T19:55:46.589 INFO:teuthology.orchestra.run.smithi008.stdout: "event": "throttled", 2023-08-01T19:55:46.589 INFO:teuthology.orchestra.run.smithi008.stdout: "time": "2023-08-01T19:55:05.570237+0000", 2023-08-01T19:55:46.589 INFO:teuthology.orchestra.run.smithi008.stdout: "duration": 0 2023-08-01T19:55:46.589 INFO:teuthology.orchestra.run.smithi008.stdout: }, 2023-08-01T19:55:46.589 INFO:teuthology.orchestra.run.smithi008.stdout: { 2023-08-01T19:55:46.589 INFO:teuthology.orchestra.run.smithi008.stdout: "event": "header_read", 2023-08-01T19:55:46.589 INFO:teuthology.orchestra.run.smithi008.stdout: "time": "2023-08-01T19:55:05.570236+0000", 2023-08-01T19:55:46.589 INFO:teuthology.orchestra.run.smithi008.stdout: "duration": 4294967295.9999995 2023-08-01T19:55:46.590 INFO:teuthology.orchestra.run.smithi008.stdout: }, 2023-08-01T19:55:46.590 INFO:teuthology.orchestra.run.smithi008.stdout: { 2023-08-01T19:55:46.590 INFO:teuthology.orchestra.run.smithi008.stdout: "event": "all_read", 2023-08-01T19:55:46.590 INFO:teuthology.orchestra.run.smithi008.stdout: "time": "2023-08-01T19:55:05.570354+0000", 2023-08-01T19:55:46.590 INFO:teuthology.orchestra.run.smithi008.stdout: "duration": 0.000118029 2023-08-01T19:55:46.590 INFO:teuthology.orchestra.run.smithi008.stdout: }, 2023-08-01T19:55:46.590 INFO:teuthology.orchestra.run.smithi008.stdout: { 2023-08-01T19:55:46.591 INFO:teuthology.orchestra.run.smithi008.stdout: "event": "dispatched", 2023-08-01T19:55:46.591 INFO:teuthology.orchestra.run.smithi008.stdout: "time": "2023-08-01T19:55:05.626649+0000", 2023-08-01T19:55:46.591 INFO:teuthology.orchestra.run.smithi008.stdout: "duration": 0.056294489000000003 2023-08-01T19:55:46.591 INFO:teuthology.orchestra.run.smithi008.stdout: }, 2023-08-01T19:55:46.591 INFO:teuthology.orchestra.run.smithi008.stdout: { 2023-08-01T19:55:46.591 INFO:teuthology.orchestra.run.smithi008.stdout: "event": "queued_for_pg", 2023-08-01T19:55:46.591 INFO:teuthology.orchestra.run.smithi008.stdout: "time": "2023-08-01T19:55:05.626676+0000", 2023-08-01T19:55:46.591 INFO:teuthology.orchestra.run.smithi008.stdout: "duration": 2.7228000000000001e-05 2023-08-01T19:55:46.592 INFO:teuthology.orchestra.run.smithi008.stdout: }, 2023-08-01T19:55:46.592 INFO:teuthology.orchestra.run.smithi008.stdout: { 2023-08-01T19:55:46.592 INFO:teuthology.orchestra.run.smithi008.stdout: "event": "reached_pg", 2023-08-01T19:55:46.592 INFO:teuthology.orchestra.run.smithi008.stdout: "time": "2023-08-01T19:55:05.626717+0000", 2023-08-01T19:55:46.592 INFO:teuthology.orchestra.run.smithi008.stdout: "duration": 4.1318e-05 2023-08-01T19:55:46.592 INFO:teuthology.orchestra.run.smithi008.stdout: }, 2023-08-01T19:55:46.592 INFO:teuthology.orchestra.run.smithi008.stdout: { 2023-08-01T19:55:46.592 INFO:teuthology.orchestra.run.smithi008.stdout: "event": "started", 2023-08-01T19:55:46.593 INFO:teuthology.orchestra.run.smithi008.stdout: "time": "2023-08-01T19:55:05.626737+0000", 2023-08-01T19:55:46.593 INFO:teuthology.orchestra.run.smithi008.stdout: "duration": 1.9415e-05 2023-08-01T19:55:46.593 INFO:teuthology.orchestra.run.smithi008.stdout: }, 2023-08-01T19:55:46.593 INFO:teuthology.orchestra.run.smithi008.stdout: { 2023-08-01T19:55:46.593 INFO:teuthology.orchestra.run.smithi008.stdout: "event": "commit_sent", 2023-08-01T19:55:46.593 INFO:teuthology.orchestra.run.smithi008.stdout: "time": "2023-08-01T19:55:05.635036+0000", 2023-08-01T19:55:46.593 INFO:teuthology.orchestra.run.smithi008.stdout: "duration": 0.0082987700000000005 2023-08-01T19:55:46.593 INFO:teuthology.orchestra.run.smithi008.stdout: }, 2023-08-01T19:55:46.594 INFO:teuthology.orchestra.run.smithi008.stdout: { 2023-08-01T19:55:46.594 INFO:teuthology.orchestra.run.smithi008.stdout: "event": "done", 2023-08-01T19:55:46.594 INFO:teuthology.orchestra.run.smithi008.stdout: "time": "2023-08-01T19:55:05.635067+0000", 2023-08-01T19:55:46.594 INFO:teuthology.orchestra.run.smithi008.stdout: "duration": 3.1786999999999999e-05 2023-08-01T19:55:46.594 INFO:teuthology.orchestra.run.smithi008.stdout: } 2023-08-01T19:55:46.594 INFO:teuthology.orchestra.run.smithi008.stdout: ] 2023-08-01T19:55:46.594 INFO:teuthology.orchestra.run.smithi008.stdout: } 2023-08-01T19:55:46.594 INFO:teuthology.orchestra.run.smithi008.stdout: }, 2023-08-01T19:55:46.595 INFO:teuthology.orchestra.run.smithi008.stdout: { 2023-08-01T19:55:46.595 INFO:teuthology.orchestra.run.smithi008.stdout: "description": "osd_op(client.4668.0:107863 5.3 5:cbdd875a:::benchmark_data_smithi006_114134_object107862:head [set-alloc-hint object_size 65536 write_size 65536,write 0~65536] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e38)", 2023-08-01T19:55:46.595 INFO:teuthology.orchestra.run.smithi008.stdout: "initiated_at": "2023-08-01T19:55:09.278851+0000", 2023-08-01T19:55:46.595 INFO:teuthology.orchestra.run.smithi008.stdout: "age": 37.169119887000001, 2023-08-01T19:55:46.595 INFO:teuthology.orchestra.run.smithi008.stdout: "duration": 0.071378853000000006, 2023-08-01T19:55:46.595 INFO:teuthology.orchestra.run.smithi008.stdout: "type_data": { 2023-08-01T19:55:46.595 INFO:teuthology.orchestra.run.smithi008.stdout: "flag_point": "commit sent; apply or cleanup", 2023-08-01T19:55:46.596 INFO:teuthology.orchestra.run.smithi008.stdout: "client_info": { 2023-08-01T19:55:46.596 INFO:teuthology.orchestra.run.smithi008.stdout: "client": "client.4668", 2023-08-01T19:55:46.596 INFO:teuthology.orchestra.run.smithi008.stdout: "client_addr": "172.21.15.6:0/1709472247", 2023-08-01T19:55:46.596 INFO:teuthology.orchestra.run.smithi008.stdout: "tid": 107863 2023-08-01T19:55:46.596 INFO:teuthology.orchestra.run.smithi008.stdout: }, 2023-08-01T19:55:46.596 INFO:teuthology.orchestra.run.smithi008.stdout: "events": [ 2023-08-01T19:55:46.596 INFO:teuthology.orchestra.run.smithi008.stdout: { 2023-08-01T19:55:46.596 INFO:teuthology.orchestra.run.smithi008.stdout: "event": "initiated", 2023-08-01T19:55:46.597 INFO:teuthology.orchestra.run.smithi008.stdout: "time": "2023-08-01T19:55:09.278851+0000", 2023-08-01T19:55:46.597 INFO:teuthology.orchestra.run.smithi008.stdout: "duration": 0 2023-08-01T19:55:46.597 INFO:teuthology.orchestra.run.smithi008.stdout: }, 2023-08-01T19:55:46.597 INFO:teuthology.orchestra.run.smithi008.stdout: { 2023-08-01T19:55:46.597 INFO:teuthology.orchestra.run.smithi008.stdout: "event": "throttled", 2023-08-01T19:55:46.597 INFO:teuthology.orchestra.run.smithi008.stdout: "time": "2023-08-01T19:55:09.278851+0000", 2023-08-01T19:55:46.597 INFO:teuthology.orchestra.run.smithi008.stdout: "duration": 0 2023-08-01T19:55:46.597 INFO:teuthology.orchestra.run.smithi008.stdout: }, 2023-08-01T19:55:46.598 INFO:teuthology.orchestra.run.smithi008.stdout: { 2023-08-01T19:55:46.598 INFO:teuthology.orchestra.run.smithi008.stdout: "event": "header_read", 2023-08-01T19:55:46.598 INFO:teuthology.orchestra.run.smithi008.stdout: "time": "2023-08-01T19:55:09.278850+0000", 2023-08-01T19:55:46.598 INFO:teuthology.orchestra.run.smithi008.stdout: "duration": 4294967295.999999 2023-08-01T19:55:46.598 INFO:teuthology.orchestra.run.smithi008.stdout: }, 2023-08-01T19:55:46.598 INFO:teuthology.orchestra.run.smithi008.stdout: { 2023-08-01T19:55:46.598 INFO:teuthology.orchestra.run.smithi008.stdout: "event": "all_read", 2023-08-01T19:55:46.598 INFO:teuthology.orchestra.run.smithi008.stdout: "time": "2023-08-01T19:55:09.278945+0000", 2023-08-01T19:55:46.599 INFO:teuthology.orchestra.run.smithi008.stdout: "duration": 9.4388000000000005e-05 2023-08-01T19:55:46.599 INFO:teuthology.orchestra.run.smithi008.stdout: }, 2023-08-01T19:55:46.599 INFO:teuthology.orchestra.run.smithi008.stdout: { 2023-08-01T19:55:46.599 INFO:teuthology.orchestra.run.smithi008.stdout: "event": "dispatched", 2023-08-01T19:55:46.599 INFO:teuthology.orchestra.run.smithi008.stdout: "time": "2023-08-01T19:55:09.278955+0000", 2023-08-01T19:55:46.599 INFO:teuthology.orchestra.run.smithi008.stdout: "duration": 1.0413e-05 2023-08-01T19:55:46.599 INFO:teuthology.orchestra.run.smithi008.stdout: }, 2023-08-01T19:55:46.600 INFO:teuthology.orchestra.run.smithi008.stdout: { 2023-08-01T19:55:46.600 INFO:teuthology.orchestra.run.smithi008.stdout: "event": "queued_for_pg", 2023-08-01T19:55:46.600 INFO:teuthology.orchestra.run.smithi008.stdout: "time": "2023-08-01T19:55:09.278962+0000", 2023-08-01T19:55:46.600 INFO:teuthology.orchestra.run.smithi008.stdout: "duration": 6.2169999999999999e-06 2023-08-01T19:55:46.600 INFO:teuthology.orchestra.run.smithi008.stdout: }, 2023-08-01T19:55:46.600 INFO:teuthology.orchestra.run.smithi008.stdout: { 2023-08-01T19:55:46.600 INFO:teuthology.orchestra.run.smithi008.stdout: "event": "reached_pg", 2023-08-01T19:55:46.600 INFO:teuthology.orchestra.run.smithi008.stdout: "time": "2023-08-01T19:55:09.280363+0000", 2023-08-01T19:55:46.601 INFO:teuthology.orchestra.run.smithi008.stdout: "duration": 0.0014014489999999999 2023-08-01T19:55:46.601 INFO:teuthology.orchestra.run.smithi008.stdout: }, 2023-08-01T19:55:46.601 INFO:teuthology.orchestra.run.smithi008.stdout: { 2023-08-01T19:55:46.601 INFO:teuthology.orchestra.run.smithi008.stdout: "event": "started", 2023-08-01T19:55:46.601 INFO:teuthology.orchestra.run.smithi008.stdout: "time": "2023-08-01T19:55:09.280488+0000", 2023-08-01T19:55:46.601 INFO:teuthology.orchestra.run.smithi008.stdout: "duration": 0.00012474099999999999 2023-08-01T19:55:46.601 INFO:teuthology.orchestra.run.smithi008.stdout: }, 2023-08-01T19:55:46.601 INFO:teuthology.orchestra.run.smithi008.stdout: { 2023-08-01T19:55:46.602 INFO:teuthology.orchestra.run.smithi008.stdout: "event": "waiting for subops from 1", 2023-08-01T19:55:46.602 INFO:teuthology.orchestra.run.smithi008.stdout: "time": "2023-08-01T19:55:09.280626+0000", 2023-08-01T19:55:46.602 INFO:teuthology.orchestra.run.smithi008.stdout: "duration": 0.000138193 2023-08-01T19:55:46.602 INFO:teuthology.orchestra.run.smithi008.stdout: }, 2023-08-01T19:55:46.602 INFO:teuthology.orchestra.run.smithi008.stdout: { 2023-08-01T19:55:46.602 INFO:teuthology.orchestra.run.smithi008.stdout: "event": "op_commit", 2023-08-01T19:55:46.602 INFO:teuthology.orchestra.run.smithi008.stdout: "time": "2023-08-01T19:55:09.285958+0000", 2023-08-01T19:55:46.603 INFO:teuthology.orchestra.run.smithi008.stdout: "duration": 0.0053317130000000001 2023-08-01T19:55:46.603 INFO:teuthology.orchestra.run.smithi008.stdout: }, 2023-08-01T19:55:46.603 INFO:teuthology.orchestra.run.smithi008.stdout: { 2023-08-01T19:55:46.603 INFO:teuthology.orchestra.run.smithi008.stdout: "event": "sub_op_commit_rec", 2023-08-01T19:55:46.603 INFO:teuthology.orchestra.run.smithi008.stdout: "time": "2023-08-01T19:55:09.350151+0000", 2023-08-01T19:55:46.603 INFO:teuthology.orchestra.run.smithi008.stdout: "duration": 0.064193202000000005 2023-08-01T19:55:46.603 INFO:teuthology.orchestra.run.smithi008.stdout: }, 2023-08-01T19:55:46.603 INFO:teuthology.orchestra.run.smithi008.stdout: { 2023-08-01T19:55:46.604 INFO:teuthology.orchestra.run.smithi008.stdout: "event": "commit_sent", 2023-08-01T19:55:46.604 INFO:teuthology.orchestra.run.smithi008.stdout: "time": "2023-08-01T19:55:09.350188+0000", 2023-08-01T19:55:46.604 INFO:teuthology.orchestra.run.smithi008.stdout: "duration": 3.7549999999999998e-05 2023-08-01T19:55:46.604 INFO:teuthology.orchestra.run.smithi008.stdout: }, 2023-08-01T19:55:46.604 INFO:teuthology.orchestra.run.smithi008.stdout: { 2023-08-01T19:55:46.604 INFO:teuthology.orchestra.run.smithi008.stdout: "event": "done", 2023-08-01T19:55:46.604 INFO:teuthology.orchestra.run.smithi008.stdout: "time": "2023-08-01T19:55:09.350230+0000", 2023-08-01T19:55:46.604 INFO:teuthology.orchestra.run.smithi008.stdout: "duration": 4.1804999999999997e-05 2023-08-01T19:55:46.605 INFO:teuthology.orchestra.run.smithi008.stdout: } 2023-08-01T19:55:46.605 INFO:teuthology.orchestra.run.smithi008.stdout: ] 2023-08-01T19:55:46.605 INFO:teuthology.orchestra.run.smithi008.stdout: } 2023-08-01T19:55:46.605 INFO:teuthology.orchestra.run.smithi008.stdout: }, 2023-08-01T19:55:46.605 INFO:teuthology.orchestra.run.smithi008.stdout: { 2023-08-01T19:55:46.605 INFO:teuthology.orchestra.run.smithi008.stdout: "description": "osd_op(client.4668.0:107865 5.3 5:c2ebb96d:::benchmark_data_smithi006_114134_object107864:head [set-alloc-hint object_size 65536 write_size 65536,write 0~65536] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e38)", 2023-08-01T19:55:46.605 INFO:teuthology.orchestra.run.smithi008.stdout: "initiated_at": "2023-08-01T19:55:09.279020+0000", 2023-08-01T19:55:46.605 INFO:teuthology.orchestra.run.smithi008.stdout: "age": 37.168951215, 2023-08-01T19:55:46.606 INFO:teuthology.orchestra.run.smithi008.stdout: "duration": 0.072892565000000006, 2023-08-01T19:55:46.606 INFO:teuthology.orchestra.run.smithi008.stdout: "type_data": { 2023-08-01T19:55:46.606 INFO:teuthology.orchestra.run.smithi008.stdout: "flag_point": "commit sent; apply or cleanup", 2023-08-01T19:55:46.606 INFO:teuthology.orchestra.run.smithi008.stdout: "client_info": { 2023-08-01T19:55:46.606 INFO:teuthology.orchestra.run.smithi008.stdout: "client": "client.4668", 2023-08-01T19:55:46.606 INFO:teuthology.orchestra.run.smithi008.stdout: "client_addr": "172.21.15.6:0/1709472247", 2023-08-01T19:55:46.606 INFO:teuthology.orchestra.run.smithi008.stdout: "tid": 107865 2023-08-01T19:55:46.606 INFO:teuthology.orchestra.run.smithi008.stdout: }, 2023-08-01T19:55:46.607 INFO:teuthology.orchestra.run.smithi008.stdout: "events": [ 2023-08-01T19:55:46.607 INFO:teuthology.orchestra.run.smithi008.stdout: { 2023-08-01T19:55:46.607 INFO:teuthology.orchestra.run.smithi008.stdout: "event": "initiated", 2023-08-01T19:55:46.607 INFO:teuthology.orchestra.run.smithi008.stdout: "time": "2023-08-01T19:55:09.279020+0000", 2023-08-01T19:55:46.607 INFO:teuthology.orchestra.run.smithi008.stdout: "duration": 0 2023-08-01T19:55:46.607 INFO:teuthology.orchestra.run.smithi008.stdout: }, 2023-08-01T19:55:46.607 INFO:teuthology.orchestra.run.smithi008.stdout: { 2023-08-01T19:55:46.608 INFO:teuthology.orchestra.run.smithi008.stdout: "event": "throttled", 2023-08-01T19:55:46.608 INFO:teuthology.orchestra.run.smithi008.stdout: "time": "2023-08-01T19:55:09.279020+0000", 2023-08-01T19:55:46.608 INFO:teuthology.orchestra.run.smithi008.stdout: "duration": 0 2023-08-01T19:55:46.608 INFO:teuthology.orchestra.run.smithi008.stdout: }, 2023-08-01T19:55:46.608 INFO:teuthology.orchestra.run.smithi008.stdout: { 2023-08-01T19:55:46.608 INFO:teuthology.orchestra.run.smithi008.stdout: "event": "header_read", 2023-08-01T19:55:46.608 INFO:teuthology.orchestra.run.smithi008.stdout: "time": "2023-08-01T19:55:09.279019+0000", 2023-08-01T19:55:46.608 INFO:teuthology.orchestra.run.smithi008.stdout: "duration": 4294967295.999999 2023-08-01T19:55:46.609 INFO:teuthology.orchestra.run.smithi008.stdout: }, 2023-08-01T19:55:46.609 INFO:teuthology.orchestra.run.smithi008.stdout: { 2023-08-01T19:55:46.609 INFO:teuthology.orchestra.run.smithi008.stdout: "event": "all_read", 2023-08-01T19:55:46.609 INFO:teuthology.orchestra.run.smithi008.stdout: "time": "2023-08-01T19:55:09.279087+0000", 2023-08-01T19:55:46.609 INFO:teuthology.orchestra.run.smithi008.stdout: "duration": 6.8392000000000005e-05 2023-08-01T19:55:46.609 INFO:teuthology.orchestra.run.smithi008.stdout: }, 2023-08-01T19:55:46.609 INFO:teuthology.orchestra.run.smithi008.stdout: { 2023-08-01T19:55:46.609 INFO:teuthology.orchestra.run.smithi008.stdout: "event": "dispatched", 2023-08-01T19:55:46.610 INFO:teuthology.orchestra.run.smithi008.stdout: "time": "2023-08-01T19:55:09.279095+0000", 2023-08-01T19:55:46.610 INFO:teuthology.orchestra.run.smithi008.stdout: "duration": 8.0989999999999999e-06 2023-08-01T19:55:46.610 INFO:teuthology.orchestra.run.smithi008.stdout: }, 2023-08-01T19:55:46.610 INFO:teuthology.orchestra.run.smithi008.stdout: { 2023-08-01T19:55:46.610 INFO:teuthology.orchestra.run.smithi008.stdout: "event": "queued_for_pg", 2023-08-01T19:55:46.610 INFO:teuthology.orchestra.run.smithi008.stdout: "time": "2023-08-01T19:55:09.279101+0000", 2023-08-01T19:55:46.610 INFO:teuthology.orchestra.run.smithi008.stdout: "duration": 5.0390000000000004e-06 2023-08-01T19:55:46.610 INFO:teuthology.orchestra.run.smithi008.stdout: }, 2023-08-01T19:55:46.611 INFO:teuthology.orchestra.run.smithi008.stdout: { 2023-08-01T19:55:46.611 INFO:teuthology.orchestra.run.smithi008.stdout: "event": "reached_pg", 2023-08-01T19:55:46.611 INFO:teuthology.orchestra.run.smithi008.stdout: "time": "2023-08-01T19:55:09.282574+0000", 2023-08-01T19:55:46.611 INFO:teuthology.orchestra.run.smithi008.stdout: "duration": 0.0034730619999999999 2023-08-01T19:55:46.611 INFO:teuthology.orchestra.run.smithi008.stdout: }, 2023-08-01T19:55:46.611 INFO:teuthology.orchestra.run.smithi008.stdout: { 2023-08-01T19:55:46.611 INFO:teuthology.orchestra.run.smithi008.stdout: "event": "started", 2023-08-01T19:55:46.611 INFO:teuthology.orchestra.run.smithi008.stdout: "time": "2023-08-01T19:55:09.282705+0000", 2023-08-01T19:55:46.612 INFO:teuthology.orchestra.run.smithi008.stdout: "duration": 0.00013133400000000001 2023-08-01T19:55:46.612 INFO:teuthology.orchestra.run.smithi008.stdout: }, 2023-08-01T19:55:46.612 INFO:teuthology.orchestra.run.smithi008.stdout: { 2023-08-01T19:55:46.612 INFO:teuthology.orchestra.run.smithi008.stdout: "event": "waiting for subops from 1", 2023-08-01T19:55:46.612 INFO:teuthology.orchestra.run.smithi008.stdout: "time": "2023-08-01T19:55:09.283067+0000", 2023-08-01T19:55:46.612 INFO:teuthology.orchestra.run.smithi008.stdout: "duration": 0.00036195299999999998 2023-08-01T19:55:46.612 INFO:teuthology.orchestra.run.smithi008.stdout: }, 2023-08-01T19:55:46.613 INFO:teuthology.orchestra.run.smithi008.stdout: { 2023-08-01T19:55:46.613 INFO:teuthology.orchestra.run.smithi008.stdout: "event": "op_commit", 2023-08-01T19:55:46.613 INFO:teuthology.orchestra.run.smithi008.stdout: "time": "2023-08-01T19:55:09.288196+0000", 2023-08-01T19:55:46.613 INFO:teuthology.orchestra.run.smithi008.stdout: "duration": 0.0051293780000000004 2023-08-01T19:55:46.613 INFO:teuthology.orchestra.run.smithi008.stdout: }, 2023-08-01T19:55:46.613 INFO:teuthology.orchestra.run.smithi008.stdout: { 2023-08-01T19:55:46.613 INFO:teuthology.orchestra.run.smithi008.stdout: "event": "sub_op_commit_rec", 2023-08-01T19:55:46.614 INFO:teuthology.orchestra.run.smithi008.stdout: "time": "2023-08-01T19:55:09.351832+0000", 2023-08-01T19:55:46.614 INFO:teuthology.orchestra.run.smithi008.stdout: "duration": 0.063636076 2023-08-01T19:55:46.614 INFO:teuthology.orchestra.run.smithi008.stdout: }, 2023-08-01T19:55:46.614 INFO:teuthology.orchestra.run.smithi008.stdout: { 2023-08-01T19:55:46.614 INFO:teuthology.orchestra.run.smithi008.stdout: "event": "commit_sent", 2023-08-01T19:55:46.614 INFO:teuthology.orchestra.run.smithi008.stdout: "time": "2023-08-01T19:55:09.351878+0000", 2023-08-01T19:55:46.614 INFO:teuthology.orchestra.run.smithi008.stdout: "duration": 4.5408999999999998e-05 2023-08-01T19:55:46.614 INFO:teuthology.orchestra.run.smithi008.stdout: }, 2023-08-01T19:55:46.615 INFO:teuthology.orchestra.run.smithi008.stdout: { 2023-08-01T19:55:46.615 INFO:teuthology.orchestra.run.smithi008.stdout: "event": "done", 2023-08-01T19:55:46.615 INFO:teuthology.orchestra.run.smithi008.stdout: "time": "2023-08-01T19:55:09.351913+0000", 2023-08-01T19:55:46.615 INFO:teuthology.orchestra.run.smithi008.stdout: "duration": 3.4808999999999998e-05 2023-08-01T19:55:46.615 INFO:teuthology.orchestra.run.smithi008.stdout: } 2023-08-01T19:55:46.615 INFO:teuthology.orchestra.run.smithi008.stdout: ] 2023-08-01T19:55:46.615 INFO:teuthology.orchestra.run.smithi008.stdout: } 2023-08-01T19:55:46.615 INFO:teuthology.orchestra.run.smithi008.stdout: }, 2023-08-01T19:55:46.616 INFO:teuthology.orchestra.run.smithi008.stdout: { 2023-08-01T19:55:46.616 INFO:teuthology.orchestra.run.smithi008.stdout: "description": "osd_op(client.4668.0:107869 5.c 5:31910384:::benchmark_data_smithi006_114134_object107868:head [set-alloc-hint object_size 65536 write_size 65536,write 0~65536] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e38)", 2023-08-01T19:55:46.616 INFO:teuthology.orchestra.run.smithi008.stdout: "initiated_at": "2023-08-01T19:55:09.283205+0000", 2023-08-01T19:55:46.616 INFO:teuthology.orchestra.run.smithi008.stdout: "age": 37.164766049999997, 2023-08-01T19:55:46.616 INFO:teuthology.orchestra.run.smithi008.stdout: "duration": 0.068611808999999996, 2023-08-01T19:55:46.616 INFO:teuthology.orchestra.run.smithi008.stdout: "type_data": { 2023-08-01T19:55:46.617 INFO:teuthology.orchestra.run.smithi008.stdout: "flag_point": "commit sent; apply or cleanup", 2023-08-01T19:55:46.617 INFO:teuthology.orchestra.run.smithi008.stdout: "client_info": { 2023-08-01T19:55:46.617 INFO:teuthology.orchestra.run.smithi008.stdout: "client": "client.4668", 2023-08-01T19:55:46.617 INFO:teuthology.orchestra.run.smithi008.stdout: "client_addr": "172.21.15.6:0/1709472247", 2023-08-01T19:55:46.617 INFO:teuthology.orchestra.run.smithi008.stdout: "tid": 107869 2023-08-01T19:55:46.617 INFO:teuthology.orchestra.run.smithi008.stdout: }, 2023-08-01T19:55:46.617 INFO:teuthology.orchestra.run.smithi008.stdout: "events": [ 2023-08-01T19:55:46.617 INFO:teuthology.orchestra.run.smithi008.stdout: { 2023-08-01T19:55:46.618 INFO:teuthology.orchestra.run.smithi008.stdout: "event": "initiated", 2023-08-01T19:55:46.618 INFO:teuthology.orchestra.run.smithi008.stdout: "time": "2023-08-01T19:55:09.283205+0000", 2023-08-01T19:55:46.618 INFO:teuthology.orchestra.run.smithi008.stdout: "duration": 0 2023-08-01T19:55:46.618 INFO:teuthology.orchestra.run.smithi008.stdout: }, 2023-08-01T19:55:46.618 INFO:teuthology.orchestra.run.smithi008.stdout: { 2023-08-01T19:55:46.618 INFO:teuthology.orchestra.run.smithi008.stdout: "event": "throttled", 2023-08-01T19:55:46.618 INFO:teuthology.orchestra.run.smithi008.stdout: "time": "2023-08-01T19:55:09.283205+0000", 2023-08-01T19:55:46.619 INFO:teuthology.orchestra.run.smithi008.stdout: "duration": 0 2023-08-01T19:55:46.619 INFO:teuthology.orchestra.run.smithi008.stdout: }, 2023-08-01T19:55:46.619 INFO:teuthology.orchestra.run.smithi008.stdout: { 2023-08-01T19:55:46.619 INFO:teuthology.orchestra.run.smithi008.stdout: "event": "header_read", 2023-08-01T19:55:46.619 INFO:teuthology.orchestra.run.smithi008.stdout: "time": "2023-08-01T19:55:09.283204+0000", 2023-08-01T19:55:46.619 INFO:teuthology.orchestra.run.smithi008.stdout: "duration": 4294967295.999999 2023-08-01T19:55:46.619 INFO:teuthology.orchestra.run.smithi008.stdout: }, 2023-08-01T19:55:46.619 INFO:teuthology.orchestra.run.smithi008.stdout: { 2023-08-01T19:55:46.620 INFO:teuthology.orchestra.run.smithi008.stdout: "event": "all_read", 2023-08-01T19:55:46.620 INFO:teuthology.orchestra.run.smithi008.stdout: "time": "2023-08-01T19:55:09.283300+0000", 2023-08-01T19:55:46.620 INFO:teuthology.orchestra.run.smithi008.stdout: "duration": 9.6280000000000007e-05 2023-08-01T19:55:46.620 INFO:teuthology.orchestra.run.smithi008.stdout: }, 2023-08-01T19:55:46.620 INFO:teuthology.orchestra.run.smithi008.stdout: { 2023-08-01T19:55:46.620 INFO:teuthology.orchestra.run.smithi008.stdout: "event": "dispatched", 2023-08-01T19:55:46.620 INFO:teuthology.orchestra.run.smithi008.stdout: "time": "2023-08-01T19:55:09.283314+0000", 2023-08-01T19:55:46.621 INFO:teuthology.orchestra.run.smithi008.stdout: "duration": 1.3344e-05 2023-08-01T19:55:46.621 INFO:teuthology.orchestra.run.smithi008.stdout: }, 2023-08-01T19:55:46.621 INFO:teuthology.orchestra.run.smithi008.stdout: { 2023-08-01T19:55:46.621 INFO:teuthology.orchestra.run.smithi008.stdout: "event": "queued_for_pg", 2023-08-01T19:55:46.621 INFO:teuthology.orchestra.run.smithi008.stdout: "time": "2023-08-01T19:55:09.283320+0000", 2023-08-01T19:55:46.621 INFO:teuthology.orchestra.run.smithi008.stdout: "duration": 6.0299999999999999e-06 2023-08-01T19:55:46.621 INFO:teuthology.orchestra.run.smithi008.stdout: }, 2023-08-01T19:55:46.621 INFO:teuthology.orchestra.run.smithi008.stdout: { 2023-08-01T19:55:46.622 INFO:teuthology.orchestra.run.smithi008.stdout: "event": "reached_pg", 2023-08-01T19:55:46.622 INFO:teuthology.orchestra.run.smithi008.stdout: "time": "2023-08-01T19:55:09.283365+0000", 2023-08-01T19:55:46.622 INFO:teuthology.orchestra.run.smithi008.stdout: "duration": 4.5578999999999998e-05 2023-08-01T19:55:46.622 INFO:teuthology.orchestra.run.smithi008.stdout: }, 2023-08-01T19:55:46.622 INFO:teuthology.orchestra.run.smithi008.stdout: { 2023-08-01T19:55:46.622 INFO:teuthology.orchestra.run.smithi008.stdout: "event": "started", 2023-08-01T19:55:46.622 INFO:teuthology.orchestra.run.smithi008.stdout: "time": "2023-08-01T19:55:09.283490+0000", 2023-08-01T19:55:46.622 INFO:teuthology.orchestra.run.smithi008.stdout: "duration": 0.00012473700000000001 2023-08-01T19:55:46.623 INFO:teuthology.orchestra.run.smithi008.stdout: }, 2023-08-01T19:55:46.623 INFO:teuthology.orchestra.run.smithi008.stdout: { 2023-08-01T19:55:46.623 INFO:teuthology.orchestra.run.smithi008.stdout: "event": "waiting for subops from 1", 2023-08-01T19:55:46.623 INFO:teuthology.orchestra.run.smithi008.stdout: "time": "2023-08-01T19:55:09.283637+0000", 2023-08-01T19:55:46.623 INFO:teuthology.orchestra.run.smithi008.stdout: "duration": 0.00014715600000000001 2023-08-01T19:55:46.623 INFO:teuthology.orchestra.run.smithi008.stdout: }, 2023-08-01T19:55:46.623 INFO:teuthology.orchestra.run.smithi008.stdout: { 2023-08-01T19:55:46.623 INFO:teuthology.orchestra.run.smithi008.stdout: "event": "op_commit", 2023-08-01T19:55:46.624 INFO:teuthology.orchestra.run.smithi008.stdout: "time": "2023-08-01T19:55:09.288214+0000", 2023-08-01T19:55:46.624 INFO:teuthology.orchestra.run.smithi008.stdout: "duration": 0.0045769560000000001 2023-08-01T19:55:46.624 INFO:teuthology.orchestra.run.smithi008.stdout: }, 2023-08-01T19:55:46.624 INFO:teuthology.orchestra.run.smithi008.stdout: { 2023-08-01T19:55:46.624 INFO:teuthology.orchestra.run.smithi008.stdout: "event": "sub_op_commit_rec", 2023-08-01T19:55:46.624 INFO:teuthology.orchestra.run.smithi008.stdout: "time": "2023-08-01T19:55:09.351721+0000", 2023-08-01T19:55:46.624 INFO:teuthology.orchestra.run.smithi008.stdout: "duration": 0.063507383000000001 2023-08-01T19:55:46.624 INFO:teuthology.orchestra.run.smithi008.stdout: }, 2023-08-01T19:55:46.625 INFO:teuthology.orchestra.run.smithi008.stdout: { 2023-08-01T19:55:46.625 INFO:teuthology.orchestra.run.smithi008.stdout: "event": "commit_sent", 2023-08-01T19:55:46.625 INFO:teuthology.orchestra.run.smithi008.stdout: "time": "2023-08-01T19:55:09.351777+0000", 2023-08-01T19:55:46.625 INFO:teuthology.orchestra.run.smithi008.stdout: "duration": 5.5733999999999999e-05 2023-08-01T19:55:46.625 INFO:teuthology.orchestra.run.smithi008.stdout: }, 2023-08-01T19:55:46.625 INFO:teuthology.orchestra.run.smithi008.stdout: { 2023-08-01T19:55:46.625 INFO:teuthology.orchestra.run.smithi008.stdout: "event": "done", 2023-08-01T19:55:46.625 INFO:teuthology.orchestra.run.smithi008.stdout: "time": "2023-08-01T19:55:09.351817+0000", 2023-08-01T19:55:46.626 INFO:teuthology.orchestra.run.smithi008.stdout: "duration": 3.9765000000000003e-05 2023-08-01T19:55:46.626 INFO:teuthology.orchestra.run.smithi008.stdout: } 2023-08-01T19:55:46.626 INFO:teuthology.orchestra.run.smithi008.stdout: ] 2023-08-01T19:55:46.626 INFO:teuthology.orchestra.run.smithi008.stdout: } 2023-08-01T19:55:46.626 INFO:teuthology.orchestra.run.smithi008.stdout: }, 2023-08-01T19:55:46.626 INFO:teuthology.orchestra.run.smithi008.stdout: { 2023-08-01T19:55:46.626 INFO:teuthology.orchestra.run.smithi008.stdout: "description": "osd_op(client.4668.0:107874 5.3 5:ce4c2799:::benchmark_data_smithi006_114134_object107873:head [set-alloc-hint object_size 65536 write_size 65536,write 0~65536] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e38)", 2023-08-01T19:55:46.626 INFO:teuthology.orchestra.run.smithi008.stdout: "initiated_at": "2023-08-01T19:55:09.286239+0000", 2023-08-01T19:55:46.627 INFO:teuthology.orchestra.run.smithi008.stdout: "age": 37.161732545, 2023-08-01T19:55:46.627 INFO:teuthology.orchestra.run.smithi008.stdout: "duration": 0.068224389999999996, 2023-08-01T19:55:46.627 INFO:teuthology.orchestra.run.smithi008.stdout: "type_data": { 2023-08-01T19:55:46.627 INFO:teuthology.orchestra.run.smithi008.stdout: "flag_point": "commit sent; apply or cleanup", 2023-08-01T19:55:46.627 INFO:teuthology.orchestra.run.smithi008.stdout: "client_info": { 2023-08-01T19:55:46.627 INFO:teuthology.orchestra.run.smithi008.stdout: "client": "client.4668", 2023-08-01T19:55:46.627 INFO:teuthology.orchestra.run.smithi008.stdout: "client_addr": "172.21.15.6:0/1709472247", 2023-08-01T19:55:46.628 INFO:teuthology.orchestra.run.smithi008.stdout: "tid": 107874 2023-08-01T19:55:46.628 INFO:teuthology.orchestra.run.smithi008.stdout: }, 2023-08-01T19:55:46.628 INFO:teuthology.orchestra.run.smithi008.stdout: "events": [ 2023-08-01T19:55:46.628 INFO:teuthology.orchestra.run.smithi008.stdout: { 2023-08-01T19:55:46.628 INFO:teuthology.orchestra.run.smithi008.stdout: "event": "initiated", 2023-08-01T19:55:46.628 INFO:teuthology.orchestra.run.smithi008.stdout: "time": "2023-08-01T19:55:09.286239+0000", 2023-08-01T19:55:46.628 INFO:teuthology.orchestra.run.smithi008.stdout: "duration": 0 2023-08-01T19:55:46.628 INFO:teuthology.orchestra.run.smithi008.stdout: }, 2023-08-01T19:55:46.629 INFO:teuthology.orchestra.run.smithi008.stdout: { 2023-08-01T19:55:46.629 INFO:teuthology.orchestra.run.smithi008.stdout: "event": "throttled", 2023-08-01T19:55:46.629 INFO:teuthology.orchestra.run.smithi008.stdout: "time": "2023-08-01T19:55:09.286239+0000", 2023-08-01T19:55:46.629 INFO:teuthology.orchestra.run.smithi008.stdout: "duration": 0 2023-08-01T19:55:46.629 INFO:teuthology.orchestra.run.smithi008.stdout: }, 2023-08-01T19:55:46.629 INFO:teuthology.orchestra.run.smithi008.stdout: { 2023-08-01T19:55:46.629 INFO:teuthology.orchestra.run.smithi008.stdout: "event": "header_read", 2023-08-01T19:55:46.629 INFO:teuthology.orchestra.run.smithi008.stdout: "time": "2023-08-01T19:55:09.286238+0000", 2023-08-01T19:55:46.630 INFO:teuthology.orchestra.run.smithi008.stdout: "duration": 4294967295.999999 2023-08-01T19:55:46.630 INFO:teuthology.orchestra.run.smithi008.stdout: }, 2023-08-01T19:55:46.630 INFO:teuthology.orchestra.run.smithi008.stdout: { 2023-08-01T19:55:46.630 INFO:teuthology.orchestra.run.smithi008.stdout: "event": "all_read", 2023-08-01T19:55:46.630 INFO:teuthology.orchestra.run.smithi008.stdout: "time": "2023-08-01T19:55:09.286310+0000", 2023-08-01T19:55:46.630 INFO:teuthology.orchestra.run.smithi008.stdout: "duration": 7.2583999999999995e-05 2023-08-01T19:55:46.630 INFO:teuthology.orchestra.run.smithi008.stdout: }, 2023-08-01T19:55:46.630 INFO:teuthology.orchestra.run.smithi008.stdout: { 2023-08-01T19:55:46.631 INFO:teuthology.orchestra.run.smithi008.stdout: "event": "dispatched", 2023-08-01T19:55:46.631 INFO:teuthology.orchestra.run.smithi008.stdout: "time": "2023-08-01T19:55:09.286323+0000", 2023-08-01T19:55:46.631 INFO:teuthology.orchestra.run.smithi008.stdout: "duration": 1.3151e-05 2023-08-01T19:55:46.631 INFO:teuthology.orchestra.run.smithi008.stdout: }, 2023-08-01T19:55:46.631 INFO:teuthology.orchestra.run.smithi008.stdout: { 2023-08-01T19:55:46.631 INFO:teuthology.orchestra.run.smithi008.stdout: "event": "queued_for_pg", 2023-08-01T19:55:46.631 INFO:teuthology.orchestra.run.smithi008.stdout: "time": "2023-08-01T19:55:09.286329+0000", 2023-08-01T19:55:46.631 INFO:teuthology.orchestra.run.smithi008.stdout: "duration": 5.8719999999999999e-06 2023-08-01T19:55:46.632 INFO:teuthology.orchestra.run.smithi008.stdout: }, 2023-08-01T19:55:46.632 INFO:teuthology.orchestra.run.smithi008.stdout: { 2023-08-01T19:55:46.632 INFO:teuthology.orchestra.run.smithi008.stdout: "event": "reached_pg", 2023-08-01T19:55:46.632 INFO:teuthology.orchestra.run.smithi008.stdout: "time": "2023-08-01T19:55:09.286392+0000", 2023-08-01T19:55:46.632 INFO:teuthology.orchestra.run.smithi008.stdout: "duration": 6.2378000000000005e-05 2023-08-01T19:55:46.632 INFO:teuthology.orchestra.run.smithi008.stdout: }, 2023-08-01T19:55:46.632 INFO:teuthology.orchestra.run.smithi008.stdout: { 2023-08-01T19:55:46.633 INFO:teuthology.orchestra.run.smithi008.stdout: "event": "started", 2023-08-01T19:55:46.633 INFO:teuthology.orchestra.run.smithi008.stdout: "time": "2023-08-01T19:55:09.286473+0000", 2023-08-01T19:55:46.633 INFO:teuthology.orchestra.run.smithi008.stdout: "duration": 8.1327000000000002e-05 2023-08-01T19:55:46.633 INFO:teuthology.orchestra.run.smithi008.stdout: }, 2023-08-01T19:55:46.633 INFO:teuthology.orchestra.run.smithi008.stdout: { 2023-08-01T19:55:46.633 INFO:teuthology.orchestra.run.smithi008.stdout: "event": "waiting for subops from 1", 2023-08-01T19:55:46.633 INFO:teuthology.orchestra.run.smithi008.stdout: "time": "2023-08-01T19:55:09.286557+0000", 2023-08-01T19:55:46.633 INFO:teuthology.orchestra.run.smithi008.stdout: "duration": 8.4140000000000004e-05 2023-08-01T19:55:46.634 INFO:teuthology.orchestra.run.smithi008.stdout: }, 2023-08-01T19:55:46.634 INFO:teuthology.orchestra.run.smithi008.stdout: { 2023-08-01T19:55:46.634 INFO:teuthology.orchestra.run.smithi008.stdout: "event": "op_commit", 2023-08-01T19:55:46.634 INFO:teuthology.orchestra.run.smithi008.stdout: "time": "2023-08-01T19:55:09.290681+0000", 2023-08-01T19:55:46.634 INFO:teuthology.orchestra.run.smithi008.stdout: "duration": 0.0041242420000000002 2023-08-01T19:55:46.634 INFO:teuthology.orchestra.run.smithi008.stdout: }, 2023-08-01T19:55:46.634 INFO:teuthology.orchestra.run.smithi008.stdout: { 2023-08-01T19:55:46.634 INFO:teuthology.orchestra.run.smithi008.stdout: "event": "sub_op_commit_rec", 2023-08-01T19:55:46.635 INFO:teuthology.orchestra.run.smithi008.stdout: "time": "2023-08-01T19:55:09.354372+0000", 2023-08-01T19:55:46.635 INFO:teuthology.orchestra.run.smithi008.stdout: "duration": 0.063690438000000002 2023-08-01T19:55:46.635 INFO:teuthology.orchestra.run.smithi008.stdout: }, 2023-08-01T19:55:46.635 INFO:teuthology.orchestra.run.smithi008.stdout: { 2023-08-01T19:55:46.635 INFO:teuthology.orchestra.run.smithi008.stdout: "event": "commit_sent", 2023-08-01T19:55:46.635 INFO:teuthology.orchestra.run.smithi008.stdout: "time": "2023-08-01T19:55:09.354421+0000", 2023-08-01T19:55:46.635 INFO:teuthology.orchestra.run.smithi008.stdout: "duration": 4.9413000000000003e-05 2023-08-01T19:55:46.636 INFO:teuthology.orchestra.run.smithi008.stdout: }, 2023-08-01T19:55:46.636 INFO:teuthology.orchestra.run.smithi008.stdout: { 2023-08-01T19:55:46.636 INFO:teuthology.orchestra.run.smithi008.stdout: "event": "done", 2023-08-01T19:55:46.636 INFO:teuthology.orchestra.run.smithi008.stdout: "time": "2023-08-01T19:55:09.354463+0000", 2023-08-01T19:55:46.636 INFO:teuthology.orchestra.run.smithi008.stdout: "duration": 4.1924e-05 2023-08-01T19:55:46.636 INFO:teuthology.orchestra.run.smithi008.stdout: } 2023-08-01T19:55:46.636 INFO:teuthology.orchestra.run.smithi008.stdout: ] 2023-08-01T19:55:46.636 INFO:teuthology.orchestra.run.smithi008.stdout: } 2023-08-01T19:55:46.637 INFO:teuthology.orchestra.run.smithi008.stdout: }, 2023-08-01T19:55:46.637 INFO:teuthology.orchestra.run.smithi008.stdout: { 2023-08-01T19:55:46.637 INFO:teuthology.orchestra.run.smithi008.stdout: "description": "osd_op(client.4668.0:107875 5.5 5:af4ec927:::benchmark_data_smithi006_114134_object107874:head [set-alloc-hint object_size 65536 write_size 65536,write 0~65536] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e38)", 2023-08-01T19:55:46.637 INFO:teuthology.orchestra.run.smithi008.stdout: "initiated_at": "2023-08-01T19:55:09.287186+0000", 2023-08-01T19:55:46.637 INFO:teuthology.orchestra.run.smithi008.stdout: "age": 37.160784757999998, 2023-08-01T19:55:46.637 INFO:teuthology.orchestra.run.smithi008.stdout: "duration": 0.064764719999999998, 2023-08-01T19:55:46.637 INFO:teuthology.orchestra.run.smithi008.stdout: "type_data": { 2023-08-01T19:55:46.637 INFO:teuthology.orchestra.run.smithi008.stdout: "flag_point": "commit sent; apply or cleanup", 2023-08-01T19:55:46.638 INFO:teuthology.orchestra.run.smithi008.stdout: "client_info": { 2023-08-01T19:55:46.638 INFO:teuthology.orchestra.run.smithi008.stdout: "client": "client.4668", 2023-08-01T19:55:46.638 INFO:teuthology.orchestra.run.smithi008.stdout: "client_addr": "172.21.15.6:0/1709472247", 2023-08-01T19:55:46.638 INFO:teuthology.orchestra.run.smithi008.stdout: "tid": 107875 2023-08-01T19:55:46.638 INFO:teuthology.orchestra.run.smithi008.stdout: }, 2023-08-01T19:55:46.638 INFO:teuthology.orchestra.run.smithi008.stdout: "events": [ 2023-08-01T19:55:46.638 INFO:teuthology.orchestra.run.smithi008.stdout: { 2023-08-01T19:55:46.638 INFO:teuthology.orchestra.run.smithi008.stdout: "event": "initiated", 2023-08-01T19:55:46.639 INFO:teuthology.orchestra.run.smithi008.stdout: "time": "2023-08-01T19:55:09.287186+0000", 2023-08-01T19:55:46.639 INFO:teuthology.orchestra.run.smithi008.stdout: "duration": 0 2023-08-01T19:55:46.639 INFO:teuthology.orchestra.run.smithi008.stdout: }, 2023-08-01T19:55:46.639 INFO:teuthology.orchestra.run.smithi008.stdout: { 2023-08-01T19:55:46.639 INFO:teuthology.orchestra.run.smithi008.stdout: "event": "throttled", 2023-08-01T19:55:46.639 INFO:teuthology.orchestra.run.smithi008.stdout: "time": "2023-08-01T19:55:09.287186+0000", 2023-08-01T19:55:46.639 INFO:teuthology.orchestra.run.smithi008.stdout: "duration": 0 2023-08-01T19:55:46.639 INFO:teuthology.orchestra.run.smithi008.stdout: }, 2023-08-01T19:55:46.640 INFO:teuthology.orchestra.run.smithi008.stdout: { 2023-08-01T19:55:46.640 INFO:teuthology.orchestra.run.smithi008.stdout: "event": "header_read", 2023-08-01T19:55:46.640 INFO:teuthology.orchestra.run.smithi008.stdout: "time": "2023-08-01T19:55:09.287186+0000", 2023-08-01T19:55:46.640 INFO:teuthology.orchestra.run.smithi008.stdout: "duration": 4294967295.999999 2023-08-01T19:55:46.640 INFO:teuthology.orchestra.run.smithi008.stdout: }, 2023-08-01T19:55:46.640 INFO:teuthology.orchestra.run.smithi008.stdout: { 2023-08-01T19:55:46.640 INFO:teuthology.orchestra.run.smithi008.stdout: "event": "all_read", 2023-08-01T19:55:46.641 INFO:teuthology.orchestra.run.smithi008.stdout: "time": "2023-08-01T19:55:09.287248+0000", 2023-08-01T19:55:46.641 INFO:teuthology.orchestra.run.smithi008.stdout: "duration": 6.2922000000000005e-05 2023-08-01T19:55:46.641 INFO:teuthology.orchestra.run.smithi008.stdout: }, 2023-08-01T19:55:46.641 INFO:teuthology.orchestra.run.smithi008.stdout: { 2023-08-01T19:55:46.641 INFO:teuthology.orchestra.run.smithi008.stdout: "event": "dispatched", 2023-08-01T19:55:46.641 INFO:teuthology.orchestra.run.smithi008.stdout: "time": "2023-08-01T19:55:09.287261+0000", 2023-08-01T19:55:46.641 INFO:teuthology.orchestra.run.smithi008.stdout: "duration": 1.2364000000000001e-05 2023-08-01T19:55:46.641 INFO:teuthology.orchestra.run.smithi008.stdout: }, 2023-08-01T19:55:46.642 INFO:teuthology.orchestra.run.smithi008.stdout: { 2023-08-01T19:55:46.642 INFO:teuthology.orchestra.run.smithi008.stdout: "event": "queued_for_pg", 2023-08-01T19:55:46.642 INFO:teuthology.orchestra.run.smithi008.stdout: "time": "2023-08-01T19:55:09.287267+0000", 2023-08-01T19:55:46.642 INFO:teuthology.orchestra.run.smithi008.stdout: "duration": 6.2580000000000001e-06 2023-08-01T19:55:46.642 INFO:teuthology.orchestra.run.smithi008.stdout: }, 2023-08-01T19:55:46.642 INFO:teuthology.orchestra.run.smithi008.stdout: { 2023-08-01T19:55:46.642 INFO:teuthology.orchestra.run.smithi008.stdout: "event": "reached_pg", 2023-08-01T19:55:46.642 INFO:teuthology.orchestra.run.smithi008.stdout: "time": "2023-08-01T19:55:09.287306+0000", 2023-08-01T19:55:46.643 INFO:teuthology.orchestra.run.smithi008.stdout: "duration": 3.9057999999999998e-05 2023-08-01T19:55:46.643 INFO:teuthology.orchestra.run.smithi008.stdout: }, 2023-08-01T19:55:46.643 INFO:teuthology.orchestra.run.smithi008.stdout: { 2023-08-01T19:55:46.643 INFO:teuthology.orchestra.run.smithi008.stdout: "event": "started", 2023-08-01T19:55:46.643 INFO:teuthology.orchestra.run.smithi008.stdout: "time": "2023-08-01T19:55:09.287419+0000", 2023-08-01T19:55:46.643 INFO:teuthology.orchestra.run.smithi008.stdout: "duration": 0.000112843 2023-08-01T19:55:46.643 INFO:teuthology.orchestra.run.smithi008.stdout: }, 2023-08-01T19:55:46.643 INFO:teuthology.orchestra.run.smithi008.stdout: { 2023-08-01T19:55:46.644 INFO:teuthology.orchestra.run.smithi008.stdout: "event": "waiting for subops from 1", 2023-08-01T19:55:46.644 INFO:teuthology.orchestra.run.smithi008.stdout: "time": "2023-08-01T19:55:09.287514+0000", 2023-08-01T19:55:46.644 INFO:teuthology.orchestra.run.smithi008.stdout: "duration": 9.5068000000000005e-05 2023-08-01T19:55:46.644 INFO:teuthology.orchestra.run.smithi008.stdout: }, 2023-08-01T19:55:46.644 INFO:teuthology.orchestra.run.smithi008.stdout: { 2023-08-01T19:55:46.644 INFO:teuthology.orchestra.run.smithi008.stdout: "event": "op_commit", 2023-08-01T19:55:46.644 INFO:teuthology.orchestra.run.smithi008.stdout: "time": "2023-08-01T19:55:09.293891+0000", 2023-08-01T19:55:46.644 INFO:teuthology.orchestra.run.smithi008.stdout: "duration": 0.00637712 2023-08-01T19:55:46.645 INFO:teuthology.orchestra.run.smithi008.stdout: }, 2023-08-01T19:55:46.645 INFO:teuthology.orchestra.run.smithi008.stdout: { 2023-08-01T19:55:46.645 INFO:teuthology.orchestra.run.smithi008.stdout: "event": "sub_op_commit_rec", 2023-08-01T19:55:46.645 INFO:teuthology.orchestra.run.smithi008.stdout: "time": "2023-08-01T19:55:09.351871+0000", 2023-08-01T19:55:46.645 INFO:teuthology.orchestra.run.smithi008.stdout: "duration": 0.057980054000000003 2023-08-01T19:55:46.645 INFO:teuthology.orchestra.run.smithi008.stdout: }, 2023-08-01T19:55:46.645 INFO:teuthology.orchestra.run.smithi008.stdout: { 2023-08-01T19:55:46.645 INFO:teuthology.orchestra.run.smithi008.stdout: "event": "commit_sent", 2023-08-01T19:55:46.646 INFO:teuthology.orchestra.run.smithi008.stdout: "time": "2023-08-01T19:55:09.351917+0000", 2023-08-01T19:55:46.646 INFO:teuthology.orchestra.run.smithi008.stdout: "duration": 4.5501999999999999e-05 2023-08-01T19:55:46.646 INFO:teuthology.orchestra.run.smithi008.stdout: }, 2023-08-01T19:55:46.646 INFO:teuthology.orchestra.run.smithi008.stdout: { 2023-08-01T19:55:46.646 INFO:teuthology.orchestra.run.smithi008.stdout: "event": "done", 2023-08-01T19:55:46.646 INFO:teuthology.orchestra.run.smithi008.stdout: "time": "2023-08-01T19:55:09.351951+0000", 2023-08-01T19:55:46.646 INFO:teuthology.orchestra.run.smithi008.stdout: "duration": 3.4450999999999999e-05 2023-08-01T19:55:46.646 INFO:teuthology.orchestra.run.smithi008.stdout: } 2023-08-01T19:55:46.647 INFO:teuthology.orchestra.run.smithi008.stdout: ] 2023-08-01T19:55:46.647 INFO:teuthology.orchestra.run.smithi008.stdout: } 2023-08-01T19:55:46.647 INFO:teuthology.orchestra.run.smithi008.stdout: }, 2023-08-01T19:55:46.647 INFO:teuthology.orchestra.run.smithi008.stdout: { 2023-08-01T19:55:46.647 INFO:teuthology.orchestra.run.smithi008.stdout: "description": "osd_op(client.4668.0:107880 5.5 5:a8d12d4b:::benchmark_data_smithi006_114134_object107879:head [set-alloc-hint object_size 65536 write_size 65536,write 0~65536] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e38)", 2023-08-01T19:55:46.647 INFO:teuthology.orchestra.run.smithi008.stdout: "initiated_at": "2023-08-01T19:55:09.292335+0000", 2023-08-01T19:55:46.647 INFO:teuthology.orchestra.run.smithi008.stdout: "age": 37.155636157000004, 2023-08-01T19:55:46.648 INFO:teuthology.orchestra.run.smithi008.stdout: "duration": 0.061350719999999997, 2023-08-01T19:55:46.648 INFO:teuthology.orchestra.run.smithi008.stdout: "type_data": { 2023-08-01T19:55:46.648 INFO:teuthology.orchestra.run.smithi008.stdout: "flag_point": "commit sent; apply or cleanup", 2023-08-01T19:55:46.648 INFO:teuthology.orchestra.run.smithi008.stdout: "client_info": { 2023-08-01T19:55:46.648 INFO:teuthology.orchestra.run.smithi008.stdout: "client": "client.4668", 2023-08-01T19:55:46.648 INFO:teuthology.orchestra.run.smithi008.stdout: "client_addr": "172.21.15.6:0/1709472247", 2023-08-01T19:55:46.648 INFO:teuthology.orchestra.run.smithi008.stdout: "tid": 107880 2023-08-01T19:55:46.648 INFO:teuthology.orchestra.run.smithi008.stdout: }, 2023-08-01T19:55:46.649 INFO:teuthology.orchestra.run.smithi008.stdout: "events": [ 2023-08-01T19:55:46.649 INFO:teuthology.orchestra.run.smithi008.stdout: { 2023-08-01T19:55:46.649 INFO:teuthology.orchestra.run.smithi008.stdout: "event": "initiated", 2023-08-01T19:55:46.649 INFO:teuthology.orchestra.run.smithi008.stdout: "time": "2023-08-01T19:55:09.292335+0000", 2023-08-01T19:55:46.649 INFO:teuthology.orchestra.run.smithi008.stdout: "duration": 0 2023-08-01T19:55:46.649 INFO:teuthology.orchestra.run.smithi008.stdout: }, 2023-08-01T19:55:46.649 INFO:teuthology.orchestra.run.smithi008.stdout: { 2023-08-01T19:55:46.649 INFO:teuthology.orchestra.run.smithi008.stdout: "event": "throttled", 2023-08-01T19:55:46.650 INFO:teuthology.orchestra.run.smithi008.stdout: "time": "2023-08-01T19:55:09.292335+0000", 2023-08-01T19:55:46.650 INFO:teuthology.orchestra.run.smithi008.stdout: "duration": 0 2023-08-01T19:55:46.650 INFO:teuthology.orchestra.run.smithi008.stdout: }, 2023-08-01T19:55:46.650 INFO:teuthology.orchestra.run.smithi008.stdout: { 2023-08-01T19:55:46.650 INFO:teuthology.orchestra.run.smithi008.stdout: "event": "header_read", 2023-08-01T19:55:46.650 INFO:teuthology.orchestra.run.smithi008.stdout: "time": "2023-08-01T19:55:09.292334+0000", 2023-08-01T19:55:46.650 INFO:teuthology.orchestra.run.smithi008.stdout: "duration": 4294967295.999999 2023-08-01T19:55:46.650 INFO:teuthology.orchestra.run.smithi008.stdout: }, 2023-08-01T19:55:46.651 INFO:teuthology.orchestra.run.smithi008.stdout: { 2023-08-01T19:55:46.651 INFO:teuthology.orchestra.run.smithi008.stdout: "event": "all_read", 2023-08-01T19:55:46.651 INFO:teuthology.orchestra.run.smithi008.stdout: "time": "2023-08-01T19:55:09.292449+0000", 2023-08-01T19:55:46.651 INFO:teuthology.orchestra.run.smithi008.stdout: "duration": 0.00011551400000000001 2023-08-01T19:55:46.651 INFO:teuthology.orchestra.run.smithi008.stdout: }, 2023-08-01T19:55:46.651 INFO:teuthology.orchestra.run.smithi008.stdout: { 2023-08-01T19:55:46.651 INFO:teuthology.orchestra.run.smithi008.stdout: "event": "dispatched", 2023-08-01T19:55:46.652 INFO:teuthology.orchestra.run.smithi008.stdout: "time": "2023-08-01T19:55:09.292461+0000", 2023-08-01T19:55:46.652 INFO:teuthology.orchestra.run.smithi008.stdout: "duration": 1.1287000000000001e-05 2023-08-01T19:55:46.652 INFO:teuthology.orchestra.run.smithi008.stdout: }, 2023-08-01T19:55:46.652 INFO:teuthology.orchestra.run.smithi008.stdout: { 2023-08-01T19:55:46.652 INFO:teuthology.orchestra.run.smithi008.stdout: "event": "queued_for_pg", 2023-08-01T19:55:46.652 INFO:teuthology.orchestra.run.smithi008.stdout: "time": "2023-08-01T19:55:09.292467+0000", 2023-08-01T19:55:46.652 INFO:teuthology.orchestra.run.smithi008.stdout: "duration": 6.4520000000000002e-06 2023-08-01T19:55:46.653 INFO:teuthology.orchestra.run.smithi008.stdout: }, 2023-08-01T19:55:46.653 INFO:teuthology.orchestra.run.smithi008.stdout: { 2023-08-01T19:55:46.653 INFO:teuthology.orchestra.run.smithi008.stdout: "event": "reached_pg", 2023-08-01T19:55:46.653 INFO:teuthology.orchestra.run.smithi008.stdout: "time": "2023-08-01T19:55:09.292510+0000", 2023-08-01T19:55:46.653 INFO:teuthology.orchestra.run.smithi008.stdout: "duration": 4.2502000000000001e-05 2023-08-01T19:55:46.653 INFO:teuthology.orchestra.run.smithi008.stdout: }, 2023-08-01T19:55:46.653 INFO:teuthology.orchestra.run.smithi008.stdout: { 2023-08-01T19:55:46.653 INFO:teuthology.orchestra.run.smithi008.stdout: "event": "started", 2023-08-01T19:55:46.654 INFO:teuthology.orchestra.run.smithi008.stdout: "time": "2023-08-01T19:55:09.292596+0000", 2023-08-01T19:55:46.654 INFO:teuthology.orchestra.run.smithi008.stdout: "duration": 8.6545000000000006e-05 2023-08-01T19:55:46.654 INFO:teuthology.orchestra.run.smithi008.stdout: }, 2023-08-01T19:55:46.654 INFO:teuthology.orchestra.run.smithi008.stdout: { 2023-08-01T19:55:46.654 INFO:teuthology.orchestra.run.smithi008.stdout: "event": "waiting for subops from 1", 2023-08-01T19:55:46.654 INFO:teuthology.orchestra.run.smithi008.stdout: "time": "2023-08-01T19:55:09.292697+0000", 2023-08-01T19:55:46.654 INFO:teuthology.orchestra.run.smithi008.stdout: "duration": 0.000100368 2023-08-01T19:55:46.654 INFO:teuthology.orchestra.run.smithi008.stdout: }, 2023-08-01T19:55:46.655 INFO:teuthology.orchestra.run.smithi008.stdout: { 2023-08-01T19:55:46.655 INFO:teuthology.orchestra.run.smithi008.stdout: "event": "op_commit", 2023-08-01T19:55:46.655 INFO:teuthology.orchestra.run.smithi008.stdout: "time": "2023-08-01T19:55:09.295658+0000", 2023-08-01T19:55:46.655 INFO:teuthology.orchestra.run.smithi008.stdout: "duration": 0.0029617290000000002 2023-08-01T19:55:46.655 INFO:teuthology.orchestra.run.smithi008.stdout: }, 2023-08-01T19:55:46.655 INFO:teuthology.orchestra.run.smithi008.stdout: { 2023-08-01T19:55:46.655 INFO:teuthology.orchestra.run.smithi008.stdout: "event": "sub_op_commit_rec", 2023-08-01T19:55:46.656 INFO:teuthology.orchestra.run.smithi008.stdout: "time": "2023-08-01T19:55:09.353604+0000", 2023-08-01T19:55:46.657 INFO:tasks.ceph.osd.1.smithi101.stderr:2023-08-01T19:55:46.655+0000 7fb0cb7f6700 -1 received signal: Hangup from /usr/bin/python3 /bin/daemon-helper kill ceph-osd -f --cluster ceph -i 1 (PID: 111141) UID: 0 2023-08-01T19:55:46.657 INFO:teuthology.orchestra.run.smithi006.stdout:osd.0: {} 2023-08-01T19:55:46.657 INFO:teuthology.orchestra.run.smithi006.stdout:osd.1: {} 2023-08-01T19:55:46.658 INFO:teuthology.orchestra.run.smithi006.stdout:osd.2: {} 2023-08-01T19:55:46.658 INFO:teuthology.orchestra.run.smithi008.stdout: "duration": 0.057945868999999997 2023-08-01T19:55:46.658 INFO:teuthology.orchestra.run.smithi008.stdout: }, 2023-08-01T19:55:46.658 INFO:teuthology.orchestra.run.smithi008.stdout: { 2023-08-01T19:55:46.659 INFO:teuthology.orchestra.run.smithi008.stdout: "event": "commit_sent", 2023-08-01T19:55:46.659 INFO:teuthology.orchestra.run.smithi008.stdout: "time": "2023-08-01T19:55:09.353650+0000", 2023-08-01T19:55:46.659 INFO:teuthology.orchestra.run.smithi008.stdout: "duration": 4.5698999999999997e-05 2023-08-01T19:55:46.659 INFO:teuthology.orchestra.run.smithi008.stdout: }, 2023-08-01T19:55:46.659 INFO:teuthology.orchestra.run.smithi008.stdout: { 2023-08-01T19:55:46.659 INFO:teuthology.orchestra.run.smithi008.stdout: "event": "done", 2023-08-01T19:55:46.659 INFO:teuthology.orchestra.run.smithi008.stdout: "time": "2023-08-01T19:55:09.353686+0000", 2023-08-01T19:55:46.660 INFO:teuthology.orchestra.run.smithi008.stdout: "duration": 3.5936999999999998e-05 2023-08-01T19:55:46.660 INFO:teuthology.orchestra.run.smithi008.stdout: } 2023-08-01T19:55:46.660 INFO:teuthology.orchestra.run.smithi008.stdout: ] 2023-08-01T19:55:46.660 INFO:teuthology.orchestra.run.smithi008.stdout: } 2023-08-01T19:55:46.660 INFO:teuthology.orchestra.run.smithi008.stdout: } 2023-08-01T19:55:46.660 INFO:teuthology.orchestra.run.smithi008.stdout: ] 2023-08-01T19:55:46.660 INFO:teuthology.orchestra.run.smithi008.stdout:} 2023-08-01T19:55:46.661 DEBUG:teuthology.orchestra.run.smithi101:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 30 ceph --cluster ceph --admin-daemon /var/run/ceph/ceph-osd.1.asok dump_ops_in_flight 2023-08-01T19:55:46.662 INFO:teuthology.orchestra.run.smithi006.stderr:osd.0: osd_enable_op_tracker = 'false' 2023-08-01T19:55:46.662 INFO:teuthology.orchestra.run.smithi006.stderr:osd.1: osd_enable_op_tracker = 'false' 2023-08-01T19:55:46.662 INFO:teuthology.orchestra.run.smithi006.stderr:osd.2: osd_enable_op_tracker = 'false' 2023-08-01T19:55:46.757 INFO:tasks.ceph.osd.0.smithi008.stderr:2023-08-01T19:55:46.756+0000 7f16a58f4700 -1 received signal: Hangup from /usr/bin/python3 /bin/daemon-helper kill ceph-osd -f --cluster ceph -i 0 (PID: 111179) UID: 0 2023-08-01T19:55:46.841 INFO:teuthology.orchestra.run.smithi101.stdout:ERROR: (22) Invalid argument 2023-08-01T19:55:46.841 INFO:teuthology.orchestra.run.smithi101.stdout:op_tracker tracking is not enabled now, so no ops are tracked currently, even those get stuck. Please enable "osd_enable_op_tracker", and the tracker will start to track new ops received afterwards. 2023-08-01T19:55:46.856 DEBUG:teuthology.orchestra.run.smithi101:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 30 ceph --cluster ceph --admin-daemon /var/run/ceph/ceph-osd.1.asok dump_blocked_ops 2023-08-01T19:55:46.858 INFO:tasks.ceph.osd.0.smithi008.stderr:2023-08-01T19:55:46.856+0000 7f16a58f4700 -1 received signal: Hangup from /usr/bin/python3 /bin/daemon-helper kill ceph-osd -f --cluster ceph -i 0 (PID: 111179) UID: 0 2023-08-01T19:55:46.959 INFO:tasks.ceph.osd.2.smithi155.stderr:2023-08-01T19:55:46.957+0000 7faa5c6ac700 -1 received signal: Hangup from /usr/bin/python3 /bin/daemon-helper kill ceph-osd -f --cluster ceph -i 2 (PID: 111337) UID: 0 2023-08-01T19:55:47.016 INFO:teuthology.orchestra.run.smithi101.stdout:ERROR: (22) Invalid argument 2023-08-01T19:55:47.016 INFO:teuthology.orchestra.run.smithi101.stdout:op_tracker tracking is not enabled now, so no ops are tracked currently, even those get stuck. Please enable "osd_enable_op_tracker", and the tracker will start to track new ops received afterwards. 2023-08-01T19:55:47.032 DEBUG:teuthology.orchestra.run.smithi101:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 30 ceph --cluster ceph --admin-daemon /var/run/ceph/ceph-osd.1.asok dump_historic_ops 2023-08-01T19:55:47.060 INFO:tasks.ceph.osd.2.smithi155.stderr:2023-08-01T19:55:47.058+0000 7faa5c6ac700 -1 received signal: Hangup from /usr/bin/python3 /bin/daemon-helper kill ceph-osd -f --cluster ceph -i 2 (PID: 111337) UID: 0 2023-08-01T19:55:47.160 INFO:tasks.ceph.osd.1.smithi101.stderr:2023-08-01T19:55:47.159+0000 7fb0cb7f6700 -1 received signal: Hangup from /usr/bin/python3 /bin/daemon-helper kill ceph-osd -f --cluster ceph -i 1 (PID: 111141) UID: 0 2023-08-01T19:55:47.191 INFO:teuthology.orchestra.run.smithi101.stdout:ERROR: (22) Invalid argument 2023-08-01T19:55:47.191 INFO:teuthology.orchestra.run.smithi101.stdout:op_tracker tracking is not enabled now, so no ops are tracked currently, even those get stuck. Please enable "osd_enable_op_tracker", and the tracker will start to track new ops received afterwards. 2023-08-01T19:55:47.204 DEBUG:teuthology.orchestra.run.smithi155:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 30 ceph --cluster ceph --admin-daemon /var/run/ceph/ceph-osd.2.asok dump_ops_in_flight 2023-08-01T19:55:47.262 INFO:tasks.ceph.osd.1.smithi101.stderr:2023-08-01T19:55:47.260+0000 7fb0cb7f6700 -1 received signal: Hangup from /usr/bin/python3 /bin/daemon-helper kill ceph-osd -f --cluster ceph -i 1 (PID: 111141) UID: 0 2023-08-01T19:55:47.362 INFO:tasks.ceph.osd.0.smithi008.stderr:2023-08-01T19:55:47.360+0000 7f16a58f4700 -1 received signal: Hangup from /usr/bin/python3 /bin/daemon-helper kill ceph-osd -f --cluster ceph -i 0 (PID: 111179) UID: 0 2023-08-01T19:55:47.383 INFO:teuthology.orchestra.run.smithi155.stdout:ERROR: (22) Invalid argument 2023-08-01T19:55:47.383 INFO:teuthology.orchestra.run.smithi155.stdout:op_tracker tracking is not enabled now, so no ops are tracked currently, even those get stuck. Please enable "osd_enable_op_tracker", and the tracker will start to track new ops received afterwards. 2023-08-01T19:55:47.397 DEBUG:teuthology.orchestra.run.smithi155:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 30 ceph --cluster ceph --admin-daemon /var/run/ceph/ceph-osd.2.asok dump_blocked_ops 2023-08-01T19:55:47.463 INFO:tasks.ceph.osd.1.smithi101.stderr:2023-08-01T19:55:47.462+0000 7fb0cb7f6700 -1 received signal: Hangup from /usr/bin/python3 /bin/daemon-helper kill ceph-osd -f --cluster ceph -i 1 (PID: 111141) UID: 0 2023-08-01T19:55:47.559 INFO:teuthology.orchestra.run.smithi155.stdout:ERROR: (22) Invalid argument 2023-08-01T19:55:47.560 INFO:teuthology.orchestra.run.smithi155.stdout:op_tracker tracking is not enabled now, so no ops are tracked currently, even those get stuck. Please enable "osd_enable_op_tracker", and the tracker will start to track new ops received afterwards. 2023-08-01T19:55:47.564 INFO:tasks.ceph.osd.0.smithi008.stderr:2023-08-01T19:55:47.563+0000 7f16a58f4700 -1 received signal: Hangup from /usr/bin/python3 /bin/daemon-helper kill ceph-osd -f --cluster ceph -i 0 (PID: 111179) UID: 0 2023-08-01T19:55:47.573 DEBUG:teuthology.orchestra.run.smithi155:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 30 ceph --cluster ceph --admin-daemon /var/run/ceph/ceph-osd.2.asok dump_historic_ops 2023-08-01T19:55:47.665 INFO:tasks.ceph.osd.2.smithi155.stderr:2023-08-01T19:55:47.664+0000 7faa5c6ac700 -1 received signal: Hangup from /usr/bin/python3 /bin/daemon-helper kill ceph-osd -f --cluster ceph -i 2 (PID: 111337) UID: 0 2023-08-01T19:55:47.736 INFO:teuthology.orchestra.run.smithi155.stdout:ERROR: (22) Invalid argument 2023-08-01T19:55:47.736 INFO:teuthology.orchestra.run.smithi155.stdout:op_tracker tracking is not enabled now, so no ops are tracked currently, even those get stuck. Please enable "osd_enable_op_tracker", and the tracker will start to track new ops received afterwards. 2023-08-01T19:55:47.748 DEBUG:teuthology.orchestra.run.smithi008:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 30 ceph --cluster ceph --admin-daemon /var/run/ceph/ceph-osd.0.asok dump_ops_in_flight 2023-08-01T19:55:47.789 INFO:tasks.ceph.osd.2.smithi155.stderr:2023-08-01T19:55:47.788+0000 7faa5c6ac700 -1 received signal: Hangup from /usr/bin/python3 /bin/daemon-helper kill ceph-osd -f --cluster ceph -i 2 (PID: 111337) UID: 0 2023-08-01T19:55:47.868 INFO:tasks.ceph.osd.0.smithi008.stderr:2023-08-01T19:55:47.866+0000 7f16a58f4700 -1 received signal: Hangup from /usr/bin/python3 /bin/daemon-helper kill ceph-osd -f --cluster ceph -i 0 (PID: 111179) UID: 0 2023-08-01T19:55:47.933 INFO:teuthology.orchestra.run.smithi008.stdout:ERROR: (22) Invalid argument 2023-08-01T19:55:47.933 INFO:teuthology.orchestra.run.smithi008.stdout:op_tracker tracking is not enabled now, so no ops are tracked currently, even those get stuck. Please enable "osd_enable_op_tracker", and the tracker will start to track new ops received afterwards. 2023-08-01T19:55:47.948 DEBUG:teuthology.orchestra.run.smithi008:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 30 ceph --cluster ceph --admin-daemon /var/run/ceph/ceph-osd.0.asok dump_blocked_ops 2023-08-01T19:55:47.968 INFO:tasks.ceph.osd.1.smithi101.stderr:2023-08-01T19:55:47.967+0000 7fb0cb7f6700 -1 received signal: Hangup from /usr/bin/python3 /bin/daemon-helper kill ceph-osd -f --cluster ceph -i 1 (PID: 111141) UID: 0 2023-08-01T19:55:48.069 INFO:tasks.ceph.osd.0.smithi008.stderr:2023-08-01T19:55:48.067+0000 7f16a58f4700 -1 received signal: Hangup from /usr/bin/python3 /bin/daemon-helper kill ceph-osd -f --cluster ceph -i 0 (PID: 111179) UID: 0 2023-08-01T19:55:48.093 DEBUG:teuthology.orchestra.run.smithi006:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 120 ceph --cluster ceph osd set nodeep-scrub 2023-08-01T19:55:48.169 INFO:tasks.ceph.osd.2.smithi155.stderr:2023-08-01T19:55:48.168+0000 7faa5c6ac700 -1 received signal: Hangup from /usr/bin/python3 /bin/daemon-helper kill ceph-osd -f --cluster ceph -i 2 (PID: 111337) UID: 0 2023-08-01T19:55:48.175 INFO:teuthology.orchestra.run.smithi008.stdout:ERROR: (22) Invalid argument 2023-08-01T19:55:48.175 INFO:teuthology.orchestra.run.smithi008.stdout:op_tracker tracking is not enabled now, so no ops are tracked currently, even those get stuck. Please enable "osd_enable_op_tracker", and the tracker will start to track new ops received afterwards. 2023-08-01T19:55:48.190 DEBUG:teuthology.orchestra.run.smithi008:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 30 ceph --cluster ceph --admin-daemon /var/run/ceph/ceph-osd.0.asok dump_historic_ops 2023-08-01T19:55:48.276 INFO:tasks.ceph.osd.0.smithi008.stderr:2023-08-01T19:55:48.274+0000 7f16a58f4700 -1 received signal: Hangup from /usr/bin/python3 /bin/daemon-helper kill ceph-osd -f --cluster ceph -i 0 (PID: 111179) UID: 0 2023-08-01T19:55:48.371 INFO:tasks.ceph.osd.2.smithi155.stderr:2023-08-01T19:55:48.370+0000 7faa5c6ac700 -1 received signal: Hangup from /usr/bin/python3 /bin/daemon-helper kill ceph-osd -f --cluster ceph -i 2 (PID: 111337) UID: 0 2023-08-01T19:55:48.412 INFO:teuthology.orchestra.run.smithi008.stdout:ERROR: (22) Invalid argument 2023-08-01T19:55:48.413 INFO:teuthology.orchestra.run.smithi008.stdout:op_tracker tracking is not enabled now, so no ops are tracked currently, even those get stuck. Please enable "osd_enable_op_tracker", and the tracker will start to track new ops received afterwards. 2023-08-01T19:55:48.426 DEBUG:teuthology.orchestra.run.smithi101:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 30 ceph --cluster ceph --admin-daemon /var/run/ceph/ceph-osd.1.asok dump_ops_in_flight 2023-08-01T19:55:48.472 INFO:tasks.ceph.osd.0.smithi008.stderr:2023-08-01T19:55:48.471+0000 7f16a58f4700 -1 received signal: Hangup from /usr/bin/python3 /bin/daemon-helper kill ceph-osd -f --cluster ceph -i 0 (PID: 111179) UID: 0 2023-08-01T19:55:48.573 INFO:tasks.ceph.osd.1.smithi101.stderr:2023-08-01T19:55:48.571+0000 7fb0cb7f6700 -1 received signal: Hangup from /usr/bin/python3 /bin/daemon-helper kill ceph-osd -f --cluster ceph -i 1 (PID: 111141) UID: 0 2023-08-01T19:55:48.591 INFO:teuthology.orchestra.run.smithi101.stdout:ERROR: (22) Invalid argument 2023-08-01T19:55:48.591 INFO:teuthology.orchestra.run.smithi101.stdout:op_tracker tracking is not enabled now, so no ops are tracked currently, even those get stuck. Please enable "osd_enable_op_tracker", and the tracker will start to track new ops received afterwards. 2023-08-01T19:55:48.605 DEBUG:teuthology.orchestra.run.smithi101:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 30 ceph --cluster ceph --admin-daemon /var/run/ceph/ceph-osd.1.asok dump_blocked_ops 2023-08-01T19:55:48.664 DEBUG:teuthology.orchestra.run.smithi006:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 120 ceph --cluster ceph -- tell 'osd.*' injectargs --osd_enable_op_tracker=true 2023-08-01T19:55:48.673 INFO:tasks.ceph.osd.2.smithi155.stderr:2023-08-01T19:55:48.672+0000 7faa5c6ac700 -1 received signal: Hangup from /usr/bin/python3 /bin/daemon-helper kill ceph-osd -f --cluster ceph -i 2 (PID: 111337) UID: 0 2023-08-01T19:55:48.774 INFO:tasks.ceph.osd.2.smithi155.stderr:2023-08-01T19:55:48.772+0000 7faa5c6ac700 -1 received signal: Hangup from /usr/bin/python3 /bin/daemon-helper kill ceph-osd -f --cluster ceph -i 2 (PID: 111337) UID: 0 2023-08-01T19:55:48.811 INFO:teuthology.orchestra.run.smithi006.stdout:osd.0: {} 2023-08-01T19:55:48.811 INFO:teuthology.orchestra.run.smithi101.stdout:ERROR: (22) Invalid argument 2023-08-01T19:55:48.812 INFO:teuthology.orchestra.run.smithi101.stdout:op_tracker tracking is not enabled now, so no ops are tracked currently, even those get stuck. Please enable "osd_enable_op_tracker", and the tracker will start to track new ops received afterwards. 2023-08-01T19:55:48.825 DEBUG:teuthology.orchestra.run.smithi101:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 30 ceph --cluster ceph --admin-daemon /var/run/ceph/ceph-osd.1.asok dump_historic_ops 2023-08-01T19:55:48.830 INFO:teuthology.orchestra.run.smithi006.stdout:osd.1: {} 2023-08-01T19:55:48.850 INFO:teuthology.orchestra.run.smithi006.stdout:osd.2: {} 2023-08-01T19:55:48.851 INFO:teuthology.orchestra.run.smithi006.stderr:osd.0: osd_enable_op_tracker = 'true' 2023-08-01T19:55:48.851 INFO:teuthology.orchestra.run.smithi006.stderr:osd.1: osd_enable_op_tracker = 'true' 2023-08-01T19:55:48.851 INFO:teuthology.orchestra.run.smithi006.stderr:osd.2: osd_enable_op_tracker = 'true' 2023-08-01T19:55:48.874 INFO:tasks.ceph.osd.2.smithi155.stderr:2023-08-01T19:55:48.873+0000 7faa5c6ac700 -1 received signal: Hangup from /usr/bin/python3 /bin/daemon-helper kill ceph-osd -f --cluster ceph -i 2 (PID: 111337) UID: 0 2023-08-01T19:55:48.977 INFO:tasks.ceph.osd.1.smithi101.stderr:2023-08-01T19:55:48.976+0000 7fb0cb7f6700 -1 received signal: Hangup from /usr/bin/python3 /bin/daemon-helper kill ceph-osd -f --cluster ceph -i 1 (PID: 111141) UID: 0 2023-08-01T19:55:48.989 INFO:teuthology.orchestra.run.smithi101.stdout:{ 2023-08-01T19:55:48.989 INFO:teuthology.orchestra.run.smithi101.stdout: "size": 20, 2023-08-01T19:55:48.989 INFO:teuthology.orchestra.run.smithi101.stdout: "duration": 600, 2023-08-01T19:55:48.989 INFO:teuthology.orchestra.run.smithi101.stdout: "ops": [ 2023-08-01T19:55:48.989 INFO:teuthology.orchestra.run.smithi101.stdout: { 2023-08-01T19:55:48.990 INFO:teuthology.orchestra.run.smithi101.stdout: "description": "osd_op(mds.0.3:11 3.10 3:0bd6d154:::602.00000000:head [create,setxattr parent (62) in=6b,setxattr layout (30) in=6b] snapc 0=[] ondisk+write+known_if_redirected+full_force+supports_pool_eio e17)", 2023-08-01T19:55:48.990 INFO:teuthology.orchestra.run.smithi101.stdout: "initiated_at": "2023-08-01T19:54:04.458960+0000", 2023-08-01T19:55:48.990 INFO:teuthology.orchestra.run.smithi101.stdout: "age": 104.527548006, 2023-08-01T19:55:48.990 INFO:teuthology.orchestra.run.smithi101.stdout: "duration": 0.019645459000000001, 2023-08-01T19:55:48.990 INFO:teuthology.orchestra.run.smithi101.stdout: "type_data": { 2023-08-01T19:55:48.990 INFO:teuthology.orchestra.run.smithi101.stdout: "flag_point": "commit sent; apply or cleanup", 2023-08-01T19:55:48.990 INFO:teuthology.orchestra.run.smithi101.stdout: "events": [ 2023-08-01T19:55:48.990 INFO:teuthology.orchestra.run.smithi101.stdout: { 2023-08-01T19:55:48.991 INFO:teuthology.orchestra.run.smithi101.stdout: "event": "initiated", 2023-08-01T19:55:48.991 INFO:teuthology.orchestra.run.smithi101.stdout: "time": "2023-08-01T19:54:04.458960+0000", 2023-08-01T19:55:48.991 INFO:teuthology.orchestra.run.smithi101.stdout: "duration": 0 2023-08-01T19:55:48.991 INFO:teuthology.orchestra.run.smithi101.stdout: }, 2023-08-01T19:55:48.991 INFO:teuthology.orchestra.run.smithi101.stdout: { 2023-08-01T19:55:48.991 INFO:teuthology.orchestra.run.smithi101.stdout: "event": "throttled", 2023-08-01T19:55:48.991 INFO:teuthology.orchestra.run.smithi101.stdout: "time": "2023-08-01T19:54:04.458960+0000", 2023-08-01T19:55:48.991 INFO:teuthology.orchestra.run.smithi101.stdout: "duration": 0 2023-08-01T19:55:48.992 INFO:teuthology.orchestra.run.smithi101.stdout: }, 2023-08-01T19:55:48.992 INFO:teuthology.orchestra.run.smithi101.stdout: { 2023-08-01T19:55:48.992 INFO:teuthology.orchestra.run.smithi101.stdout: "event": "header_read", 2023-08-01T19:55:48.992 INFO:teuthology.orchestra.run.smithi101.stdout: "time": "2023-08-01T19:54:04.458959+0000", 2023-08-01T19:55:48.992 INFO:teuthology.orchestra.run.smithi101.stdout: "duration": 4294967295.9999995 2023-08-01T19:55:48.992 INFO:teuthology.orchestra.run.smithi101.stdout: }, 2023-08-01T19:55:48.992 INFO:teuthology.orchestra.run.smithi101.stdout: { 2023-08-01T19:55:48.993 INFO:teuthology.orchestra.run.smithi101.stdout: "event": "all_read", 2023-08-01T19:55:48.993 INFO:teuthology.orchestra.run.smithi101.stdout: "time": "2023-08-01T19:54:04.458963+0000", 2023-08-01T19:55:48.993 INFO:teuthology.orchestra.run.smithi101.stdout: "duration": 3.9199999999999997e-06 2023-08-01T19:55:48.993 INFO:teuthology.orchestra.run.smithi101.stdout: }, 2023-08-01T19:55:48.993 INFO:teuthology.orchestra.run.smithi101.stdout: { 2023-08-01T19:55:48.993 INFO:teuthology.orchestra.run.smithi101.stdout: "event": "dispatched", 2023-08-01T19:55:48.993 INFO:teuthology.orchestra.run.smithi101.stdout: "time": "2023-08-01T19:54:04.458970+0000", 2023-08-01T19:55:48.993 INFO:teuthology.orchestra.run.smithi101.stdout: "duration": 7.0439999999999998e-06 2023-08-01T19:55:48.994 INFO:teuthology.orchestra.run.smithi101.stdout: }, 2023-08-01T19:55:48.994 INFO:teuthology.orchestra.run.smithi101.stdout: { 2023-08-01T19:55:48.994 INFO:teuthology.orchestra.run.smithi101.stdout: "event": "queued_for_pg", 2023-08-01T19:55:48.994 INFO:teuthology.orchestra.run.smithi101.stdout: "time": "2023-08-01T19:54:04.458976+0000", 2023-08-01T19:55:48.994 INFO:teuthology.orchestra.run.smithi101.stdout: "duration": 5.9540000000000001e-06 2023-08-01T19:55:48.994 INFO:teuthology.orchestra.run.smithi101.stdout: }, 2023-08-01T19:55:48.994 INFO:teuthology.orchestra.run.smithi101.stdout: { 2023-08-01T19:55:48.994 INFO:teuthology.orchestra.run.smithi101.stdout: "event": "reached_pg", 2023-08-01T19:55:48.995 INFO:teuthology.orchestra.run.smithi101.stdout: "time": "2023-08-01T19:54:04.459035+0000", 2023-08-01T19:55:48.995 INFO:teuthology.orchestra.run.smithi101.stdout: "duration": 5.8924e-05 2023-08-01T19:55:48.995 INFO:teuthology.orchestra.run.smithi101.stdout: }, 2023-08-01T19:55:48.995 INFO:teuthology.orchestra.run.smithi101.stdout: { 2023-08-01T19:55:48.995 INFO:teuthology.orchestra.run.smithi101.stdout: "event": "waiting_for_map not empty", 2023-08-01T19:55:48.995 INFO:teuthology.orchestra.run.smithi101.stdout: "time": "2023-08-01T19:54:04.459038+0000", 2023-08-01T19:55:48.995 INFO:teuthology.orchestra.run.smithi101.stdout: "duration": 3.2760000000000001e-06 2023-08-01T19:55:48.996 INFO:teuthology.orchestra.run.smithi101.stdout: }, 2023-08-01T19:55:48.996 INFO:teuthology.orchestra.run.smithi101.stdout: { 2023-08-01T19:55:48.996 INFO:teuthology.orchestra.run.smithi101.stdout: "event": "reached_pg", 2023-08-01T19:55:48.996 INFO:teuthology.orchestra.run.smithi101.stdout: "time": "2023-08-01T19:54:04.471511+0000", 2023-08-01T19:55:48.996 INFO:teuthology.orchestra.run.smithi101.stdout: "duration": 0.012473039999999999 2023-08-01T19:55:48.996 INFO:teuthology.orchestra.run.smithi101.stdout: }, 2023-08-01T19:55:48.996 INFO:teuthology.orchestra.run.smithi101.stdout: { 2023-08-01T19:55:48.996 INFO:teuthology.orchestra.run.smithi101.stdout: "event": "started", 2023-08-01T19:55:48.997 INFO:teuthology.orchestra.run.smithi101.stdout: "time": "2023-08-01T19:54:04.472086+0000", 2023-08-01T19:55:48.997 INFO:teuthology.orchestra.run.smithi101.stdout: "duration": 0.00057491699999999998 2023-08-01T19:55:48.997 INFO:teuthology.orchestra.run.smithi101.stdout: }, 2023-08-01T19:55:48.997 INFO:teuthology.orchestra.run.smithi101.stdout: { 2023-08-01T19:55:48.997 INFO:teuthology.orchestra.run.smithi101.stdout: "event": "waiting for subops from 2", 2023-08-01T19:55:48.997 INFO:teuthology.orchestra.run.smithi101.stdout: "time": "2023-08-01T19:54:04.472310+0000", 2023-08-01T19:55:48.997 INFO:teuthology.orchestra.run.smithi101.stdout: "duration": 0.00022396499999999999 2023-08-01T19:55:48.997 INFO:teuthology.orchestra.run.smithi101.stdout: }, 2023-08-01T19:55:48.998 INFO:teuthology.orchestra.run.smithi101.stdout: { 2023-08-01T19:55:48.998 INFO:teuthology.orchestra.run.smithi101.stdout: "event": "op_commit", 2023-08-01T19:55:48.998 INFO:teuthology.orchestra.run.smithi101.stdout: "time": "2023-08-01T19:54:04.478141+0000", 2023-08-01T19:55:48.998 INFO:teuthology.orchestra.run.smithi101.stdout: "duration": 0.0058312320000000004 2023-08-01T19:55:48.998 INFO:teuthology.orchestra.run.smithi101.stdout: }, 2023-08-01T19:55:48.998 INFO:teuthology.orchestra.run.smithi101.stdout: { 2023-08-01T19:55:48.998 INFO:teuthology.orchestra.run.smithi101.stdout: "event": "sub_op_commit_rec", 2023-08-01T19:55:48.998 INFO:teuthology.orchestra.run.smithi101.stdout: "time": "2023-08-01T19:54:04.478543+0000", 2023-08-01T19:55:48.999 INFO:teuthology.orchestra.run.smithi101.stdout: "duration": 0.00040160800000000002 2023-08-01T19:55:48.999 INFO:teuthology.orchestra.run.smithi101.stdout: }, 2023-08-01T19:55:48.999 INFO:teuthology.orchestra.run.smithi101.stdout: { 2023-08-01T19:55:48.999 INFO:teuthology.orchestra.run.smithi101.stdout: "event": "commit_sent", 2023-08-01T19:55:48.999 INFO:teuthology.orchestra.run.smithi101.stdout: "time": "2023-08-01T19:54:04.478584+0000", 2023-08-01T19:55:48.999 INFO:teuthology.orchestra.run.smithi101.stdout: "duration": 4.0989999999999999e-05 2023-08-01T19:55:48.999 INFO:teuthology.orchestra.run.smithi101.stdout: }, 2023-08-01T19:55:49.000 INFO:teuthology.orchestra.run.smithi101.stdout: { 2023-08-01T19:55:49.000 INFO:teuthology.orchestra.run.smithi101.stdout: "event": "done", 2023-08-01T19:55:49.000 INFO:teuthology.orchestra.run.smithi101.stdout: "time": "2023-08-01T19:54:04.478605+0000", 2023-08-01T19:55:49.000 INFO:teuthology.orchestra.run.smithi101.stdout: "duration": 2.1178e-05 2023-08-01T19:55:49.000 INFO:teuthology.orchestra.run.smithi101.stdout: } 2023-08-01T19:55:49.000 INFO:teuthology.orchestra.run.smithi101.stdout: ] 2023-08-01T19:55:49.000 INFO:teuthology.orchestra.run.smithi101.stdout: } 2023-08-01T19:55:49.000 INFO:teuthology.orchestra.run.smithi101.stdout: }, 2023-08-01T19:55:49.001 INFO:teuthology.orchestra.run.smithi101.stdout: { 2023-08-01T19:55:49.001 INFO:teuthology.orchestra.run.smithi101.stdout: "description": "osd_op(mds.0.3:12 3.10 3:0d89b25e:::603.00000000:head [omap-set-header] snapc 0=[] ondisk+write+known_if_redirected+full_force+supports_pool_eio e17)", 2023-08-01T19:55:49.001 INFO:teuthology.orchestra.run.smithi101.stdout: "initiated_at": "2023-08-01T19:54:04.458982+0000", 2023-08-01T19:55:49.001 INFO:teuthology.orchestra.run.smithi101.stdout: "age": 104.527525778, 2023-08-01T19:55:49.001 INFO:teuthology.orchestra.run.smithi101.stdout: "duration": 0.021266334000000001, 2023-08-01T19:55:49.001 INFO:teuthology.orchestra.run.smithi101.stdout: "type_data": { 2023-08-01T19:55:49.001 INFO:teuthology.orchestra.run.smithi101.stdout: "flag_point": "commit sent; apply or cleanup", 2023-08-01T19:55:49.002 INFO:teuthology.orchestra.run.smithi101.stdout: "events": [ 2023-08-01T19:55:49.002 INFO:teuthology.orchestra.run.smithi101.stdout: { 2023-08-01T19:55:49.002 INFO:teuthology.orchestra.run.smithi101.stdout: "event": "initiated", 2023-08-01T19:55:49.002 INFO:teuthology.orchestra.run.smithi101.stdout: "time": "2023-08-01T19:54:04.458982+0000", 2023-08-01T19:55:49.002 INFO:teuthology.orchestra.run.smithi101.stdout: "duration": 0 2023-08-01T19:55:49.002 INFO:teuthology.orchestra.run.smithi101.stdout: }, 2023-08-01T19:55:49.002 INFO:teuthology.orchestra.run.smithi101.stdout: { 2023-08-01T19:55:49.002 INFO:teuthology.orchestra.run.smithi101.stdout: "event": "throttled", 2023-08-01T19:55:49.003 INFO:teuthology.orchestra.run.smithi101.stdout: "time": "2023-08-01T19:54:04.458982+0000", 2023-08-01T19:55:49.003 INFO:teuthology.orchestra.run.smithi101.stdout: "duration": 0 2023-08-01T19:55:49.003 INFO:teuthology.orchestra.run.smithi101.stdout: }, 2023-08-01T19:55:49.003 INFO:teuthology.orchestra.run.smithi101.stdout: { 2023-08-01T19:55:49.003 INFO:teuthology.orchestra.run.smithi101.stdout: "event": "header_read", 2023-08-01T19:55:49.003 INFO:teuthology.orchestra.run.smithi101.stdout: "time": "2023-08-01T19:54:04.458982+0000", 2023-08-01T19:55:49.003 INFO:teuthology.orchestra.run.smithi101.stdout: "duration": 4294967295.9999995 2023-08-01T19:55:49.003 INFO:teuthology.orchestra.run.smithi101.stdout: }, 2023-08-01T19:55:49.004 INFO:teuthology.orchestra.run.smithi101.stdout: { 2023-08-01T19:55:49.004 INFO:teuthology.orchestra.run.smithi101.stdout: "event": "all_read", 2023-08-01T19:55:49.004 INFO:teuthology.orchestra.run.smithi101.stdout: "time": "2023-08-01T19:54:04.458985+0000", 2023-08-01T19:55:49.004 INFO:teuthology.orchestra.run.smithi101.stdout: "duration": 3.4800000000000001e-06 2023-08-01T19:55:49.004 INFO:teuthology.orchestra.run.smithi101.stdout: }, 2023-08-01T19:55:49.004 INFO:teuthology.orchestra.run.smithi101.stdout: { 2023-08-01T19:55:49.004 INFO:teuthology.orchestra.run.smithi101.stdout: "event": "dispatched", 2023-08-01T19:55:49.004 INFO:teuthology.orchestra.run.smithi101.stdout: "time": "2023-08-01T19:54:04.458992+0000", 2023-08-01T19:55:49.005 INFO:teuthology.orchestra.run.smithi101.stdout: "duration": 7.306e-06 2023-08-01T19:55:49.005 INFO:teuthology.orchestra.run.smithi101.stdout: }, 2023-08-01T19:55:49.005 INFO:teuthology.orchestra.run.smithi101.stdout: { 2023-08-01T19:55:49.005 INFO:teuthology.orchestra.run.smithi101.stdout: "event": "queued_for_pg", 2023-08-01T19:55:49.005 INFO:teuthology.orchestra.run.smithi101.stdout: "time": "2023-08-01T19:54:04.458997+0000", 2023-08-01T19:55:49.005 INFO:teuthology.orchestra.run.smithi101.stdout: "duration": 4.4530000000000004e-06 2023-08-01T19:55:49.005 INFO:teuthology.orchestra.run.smithi101.stdout: }, 2023-08-01T19:55:49.006 INFO:teuthology.orchestra.run.smithi101.stdout: { 2023-08-01T19:55:49.006 INFO:teuthology.orchestra.run.smithi101.stdout: "event": "reached_pg", 2023-08-01T19:55:49.006 INFO:teuthology.orchestra.run.smithi101.stdout: "time": "2023-08-01T19:54:04.459060+0000", 2023-08-01T19:55:49.006 INFO:teuthology.orchestra.run.smithi101.stdout: "duration": 6.3249000000000004e-05 2023-08-01T19:55:49.006 INFO:teuthology.orchestra.run.smithi101.stdout: }, 2023-08-01T19:55:49.006 INFO:teuthology.orchestra.run.smithi101.stdout: { 2023-08-01T19:55:49.006 INFO:teuthology.orchestra.run.smithi101.stdout: "event": "waiting_for_map not empty", 2023-08-01T19:55:49.006 INFO:teuthology.orchestra.run.smithi101.stdout: "time": "2023-08-01T19:54:04.459063+0000", 2023-08-01T19:55:49.007 INFO:teuthology.orchestra.run.smithi101.stdout: "duration": 2.717e-06 2023-08-01T19:55:49.007 INFO:teuthology.orchestra.run.smithi101.stdout: }, 2023-08-01T19:55:49.007 INFO:teuthology.orchestra.run.smithi101.stdout: { 2023-08-01T19:55:49.007 INFO:teuthology.orchestra.run.smithi101.stdout: "event": "reached_pg", 2023-08-01T19:55:49.007 INFO:teuthology.orchestra.run.smithi101.stdout: "time": "2023-08-01T19:54:04.473625+0000", 2023-08-01T19:55:49.007 INFO:teuthology.orchestra.run.smithi101.stdout: "duration": 0.014562007 2023-08-01T19:55:49.007 INFO:teuthology.orchestra.run.smithi101.stdout: }, 2023-08-01T19:55:49.007 INFO:teuthology.orchestra.run.smithi101.stdout: { 2023-08-01T19:55:49.008 INFO:teuthology.orchestra.run.smithi101.stdout: "event": "started", 2023-08-01T19:55:49.008 INFO:teuthology.orchestra.run.smithi101.stdout: "time": "2023-08-01T19:54:04.473757+0000", 2023-08-01T19:55:49.008 INFO:teuthology.orchestra.run.smithi101.stdout: "duration": 0.00013238599999999999 2023-08-01T19:55:49.008 INFO:teuthology.orchestra.run.smithi101.stdout: }, 2023-08-01T19:55:49.008 INFO:teuthology.orchestra.run.smithi101.stdout: { 2023-08-01T19:55:49.008 INFO:teuthology.orchestra.run.smithi101.stdout: "event": "waiting for subops from 2", 2023-08-01T19:55:49.008 INFO:teuthology.orchestra.run.smithi101.stdout: "time": "2023-08-01T19:54:04.473898+0000", 2023-08-01T19:55:49.008 INFO:teuthology.orchestra.run.smithi101.stdout: "duration": 0.00014039 2023-08-01T19:55:49.009 INFO:teuthology.orchestra.run.smithi101.stdout: }, 2023-08-01T19:55:49.009 INFO:teuthology.orchestra.run.smithi101.stdout: { 2023-08-01T19:55:49.009 INFO:teuthology.orchestra.run.smithi101.stdout: "event": "op_commit", 2023-08-01T19:55:49.009 INFO:teuthology.orchestra.run.smithi101.stdout: "time": "2023-08-01T19:54:04.478380+0000", 2023-08-01T19:55:49.009 INFO:teuthology.orchestra.run.smithi101.stdout: "duration": 0.0044827449999999998 2023-08-01T19:55:49.009 INFO:teuthology.orchestra.run.smithi101.stdout: }, 2023-08-01T19:55:49.009 INFO:teuthology.orchestra.run.smithi101.stdout: { 2023-08-01T19:55:49.009 INFO:teuthology.orchestra.run.smithi101.stdout: "event": "sub_op_commit_rec", 2023-08-01T19:55:49.010 INFO:teuthology.orchestra.run.smithi101.stdout: "time": "2023-08-01T19:54:04.480169+0000", 2023-08-01T19:55:49.010 INFO:teuthology.orchestra.run.smithi101.stdout: "duration": 0.0017886040000000001 2023-08-01T19:55:49.010 INFO:teuthology.orchestra.run.smithi101.stdout: }, 2023-08-01T19:55:49.010 INFO:teuthology.orchestra.run.smithi101.stdout: { 2023-08-01T19:55:49.010 INFO:teuthology.orchestra.run.smithi101.stdout: "event": "commit_sent", 2023-08-01T19:55:49.010 INFO:teuthology.orchestra.run.smithi101.stdout: "time": "2023-08-01T19:54:04.480212+0000", 2023-08-01T19:55:49.010 INFO:teuthology.orchestra.run.smithi101.stdout: "duration": 4.2687e-05 2023-08-01T19:55:49.010 INFO:teuthology.orchestra.run.smithi101.stdout: }, 2023-08-01T19:55:49.011 INFO:teuthology.orchestra.run.smithi101.stdout: { 2023-08-01T19:55:49.011 INFO:teuthology.orchestra.run.smithi101.stdout: "event": "done", 2023-08-01T19:55:49.011 INFO:teuthology.orchestra.run.smithi101.stdout: "time": "2023-08-01T19:54:04.480248+0000", 2023-08-01T19:55:49.011 INFO:teuthology.orchestra.run.smithi101.stdout: "duration": 3.6743999999999999e-05 2023-08-01T19:55:49.011 INFO:teuthology.orchestra.run.smithi101.stdout: } 2023-08-01T19:55:49.011 INFO:teuthology.orchestra.run.smithi101.stdout: ] 2023-08-01T19:55:49.011 INFO:teuthology.orchestra.run.smithi101.stdout: } 2023-08-01T19:55:49.012 INFO:teuthology.orchestra.run.smithi101.stdout: }, 2023-08-01T19:55:49.012 INFO:teuthology.orchestra.run.smithi101.stdout: { 2023-08-01T19:55:49.012 INFO:teuthology.orchestra.run.smithi101.stdout: "description": "osd_op(mds.0.3:13 3.10 3:0d89b25e:::603.00000000:head [create,setxattr parent (62) in=6b,setxattr layout (30) in=6b] snapc 0=[] ondisk+write+known_if_redirected+full_force+supports_pool_eio e17)", 2023-08-01T19:55:49.012 INFO:teuthology.orchestra.run.smithi101.stdout: "initiated_at": "2023-08-01T19:54:04.459010+0000", 2023-08-01T19:55:49.012 INFO:teuthology.orchestra.run.smithi101.stdout: "age": 104.52749805800001, 2023-08-01T19:55:49.012 INFO:teuthology.orchestra.run.smithi101.stdout: "duration": 0.021327220000000001, 2023-08-01T19:55:49.012 INFO:teuthology.orchestra.run.smithi101.stdout: "type_data": { 2023-08-01T19:55:49.012 INFO:teuthology.orchestra.run.smithi101.stdout: "flag_point": "commit sent; apply or cleanup", 2023-08-01T19:55:49.013 INFO:teuthology.orchestra.run.smithi101.stdout: "events": [ 2023-08-01T19:55:49.013 INFO:teuthology.orchestra.run.smithi101.stdout: { 2023-08-01T19:55:49.013 INFO:teuthology.orchestra.run.smithi101.stdout: "event": "initiated", 2023-08-01T19:55:49.013 INFO:teuthology.orchestra.run.smithi101.stdout: "time": "2023-08-01T19:54:04.459010+0000", 2023-08-01T19:55:49.013 INFO:teuthology.orchestra.run.smithi101.stdout: "duration": 0 2023-08-01T19:55:49.013 INFO:teuthology.orchestra.run.smithi101.stdout: }, 2023-08-01T19:55:49.013 INFO:teuthology.orchestra.run.smithi101.stdout: { 2023-08-01T19:55:49.013 INFO:teuthology.orchestra.run.smithi101.stdout: "event": "throttled", 2023-08-01T19:55:49.014 INFO:teuthology.orchestra.run.smithi101.stdout: "time": "2023-08-01T19:54:04.459010+0000", 2023-08-01T19:55:49.014 INFO:teuthology.orchestra.run.smithi101.stdout: "duration": 0 2023-08-01T19:55:49.014 INFO:teuthology.orchestra.run.smithi101.stdout: }, 2023-08-01T19:55:49.014 INFO:teuthology.orchestra.run.smithi101.stdout: { 2023-08-01T19:55:49.014 INFO:teuthology.orchestra.run.smithi101.stdout: "event": "header_read", 2023-08-01T19:55:49.014 INFO:teuthology.orchestra.run.smithi101.stdout: "time": "2023-08-01T19:54:04.459009+0000", 2023-08-01T19:55:49.014 INFO:teuthology.orchestra.run.smithi101.stdout: "duration": 4294967295.9999995 2023-08-01T19:55:49.014 INFO:teuthology.orchestra.run.smithi101.stdout: }, 2023-08-01T19:55:49.015 INFO:teuthology.orchestra.run.smithi101.stdout: { 2023-08-01T19:55:49.015 INFO:teuthology.orchestra.run.smithi101.stdout: "event": "all_read", 2023-08-01T19:55:49.015 INFO:teuthology.orchestra.run.smithi101.stdout: "time": "2023-08-01T19:54:04.459013+0000", 2023-08-01T19:55:49.015 INFO:teuthology.orchestra.run.smithi101.stdout: "duration": 3.8929999999999998e-06 2023-08-01T19:55:49.015 INFO:teuthology.orchestra.run.smithi101.stdout: }, 2023-08-01T19:55:49.015 INFO:teuthology.orchestra.run.smithi101.stdout: { 2023-08-01T19:55:49.015 INFO:teuthology.orchestra.run.smithi101.stdout: "event": "dispatched", 2023-08-01T19:55:49.016 INFO:teuthology.orchestra.run.smithi101.stdout: "time": "2023-08-01T19:54:04.459027+0000", 2023-08-01T19:55:49.016 INFO:teuthology.orchestra.run.smithi101.stdout: "duration": 1.3416e-05 2023-08-01T19:55:49.016 INFO:teuthology.orchestra.run.smithi101.stdout: }, 2023-08-01T19:55:49.016 INFO:teuthology.orchestra.run.smithi101.stdout: { 2023-08-01T19:55:49.016 INFO:teuthology.orchestra.run.smithi101.stdout: "event": "queued_for_pg", 2023-08-01T19:55:49.016 INFO:teuthology.orchestra.run.smithi101.stdout: "time": "2023-08-01T19:54:04.459033+0000", 2023-08-01T19:55:49.016 INFO:teuthology.orchestra.run.smithi101.stdout: "duration": 5.9800000000000003e-06 2023-08-01T19:55:49.016 INFO:teuthology.orchestra.run.smithi101.stdout: }, 2023-08-01T19:55:49.017 INFO:teuthology.orchestra.run.smithi101.stdout: { 2023-08-01T19:55:49.017 INFO:teuthology.orchestra.run.smithi101.stdout: "event": "reached_pg", 2023-08-01T19:55:49.017 INFO:teuthology.orchestra.run.smithi101.stdout: "time": "2023-08-01T19:54:04.459099+0000", 2023-08-01T19:55:49.017 INFO:teuthology.orchestra.run.smithi101.stdout: "duration": 6.6192999999999995e-05 2023-08-01T19:55:49.017 INFO:teuthology.orchestra.run.smithi101.stdout: }, 2023-08-01T19:55:49.017 INFO:teuthology.orchestra.run.smithi101.stdout: { 2023-08-01T19:55:49.017 INFO:teuthology.orchestra.run.smithi101.stdout: "event": "waiting_for_map not empty", 2023-08-01T19:55:49.017 INFO:teuthology.orchestra.run.smithi101.stdout: "time": "2023-08-01T19:54:04.459106+0000", 2023-08-01T19:55:49.018 INFO:teuthology.orchestra.run.smithi101.stdout: "duration": 6.8619999999999997e-06 2023-08-01T19:55:49.018 INFO:teuthology.orchestra.run.smithi101.stdout: }, 2023-08-01T19:55:49.018 INFO:teuthology.orchestra.run.smithi101.stdout: { 2023-08-01T19:55:49.018 INFO:teuthology.orchestra.run.smithi101.stdout: "event": "reached_pg", 2023-08-01T19:55:49.018 INFO:teuthology.orchestra.run.smithi101.stdout: "time": "2023-08-01T19:54:04.475182+0000", 2023-08-01T19:55:49.018 INFO:teuthology.orchestra.run.smithi101.stdout: "duration": 0.016076333000000002 2023-08-01T19:55:49.019 INFO:teuthology.orchestra.run.smithi101.stdout: }, 2023-08-01T19:55:49.019 INFO:teuthology.orchestra.run.smithi101.stdout: { 2023-08-01T19:55:49.019 INFO:teuthology.orchestra.run.smithi101.stdout: "event": "started", 2023-08-01T19:55:49.019 INFO:teuthology.orchestra.run.smithi101.stdout: "time": "2023-08-01T19:54:04.475353+0000", 2023-08-01T19:55:49.019 INFO:teuthology.orchestra.run.smithi101.stdout: "duration": 0.000171378 2023-08-01T19:55:49.019 INFO:teuthology.orchestra.run.smithi101.stdout: }, 2023-08-01T19:55:49.019 INFO:teuthology.orchestra.run.smithi101.stdout: { 2023-08-01T19:55:49.019 INFO:teuthology.orchestra.run.smithi101.stdout: "event": "waiting for subops from 2", 2023-08-01T19:55:49.020 INFO:teuthology.orchestra.run.smithi101.stdout: "time": "2023-08-01T19:54:04.475793+0000", 2023-08-01T19:55:49.020 INFO:teuthology.orchestra.run.smithi101.stdout: "duration": 0.000440123 2023-08-01T19:55:49.020 INFO:teuthology.orchestra.run.smithi101.stdout: }, 2023-08-01T19:55:49.020 INFO:teuthology.orchestra.run.smithi101.stdout: { 2023-08-01T19:55:49.020 INFO:teuthology.orchestra.run.smithi101.stdout: "event": "op_commit", 2023-08-01T19:55:49.020 INFO:teuthology.orchestra.run.smithi101.stdout: "time": "2023-08-01T19:54:04.478624+0000", 2023-08-01T19:55:49.020 INFO:teuthology.orchestra.run.smithi101.stdout: "duration": 0.0028305000000000001 2023-08-01T19:55:49.020 INFO:teuthology.orchestra.run.smithi101.stdout: }, 2023-08-01T19:55:49.021 INFO:teuthology.orchestra.run.smithi101.stdout: { 2023-08-01T19:55:49.021 INFO:teuthology.orchestra.run.smithi101.stdout: "event": "sub_op_commit_rec", 2023-08-01T19:55:49.021 INFO:teuthology.orchestra.run.smithi101.stdout: "time": "2023-08-01T19:54:04.480291+0000", 2023-08-01T19:55:49.021 INFO:teuthology.orchestra.run.smithi101.stdout: "duration": 0.0016670000000000001 2023-08-01T19:55:49.021 INFO:teuthology.orchestra.run.smithi101.stdout: }, 2023-08-01T19:55:49.021 INFO:teuthology.orchestra.run.smithi101.stdout: { 2023-08-01T19:55:49.021 INFO:teuthology.orchestra.run.smithi101.stdout: "event": "commit_sent", 2023-08-01T19:55:49.022 INFO:teuthology.orchestra.run.smithi101.stdout: "time": "2023-08-01T19:54:04.480318+0000", 2023-08-01T19:55:49.022 INFO:teuthology.orchestra.run.smithi101.stdout: "duration": 2.6815e-05 2023-08-01T19:55:49.022 INFO:teuthology.orchestra.run.smithi101.stdout: }, 2023-08-01T19:55:49.022 INFO:teuthology.orchestra.run.smithi101.stdout: { 2023-08-01T19:55:49.022 INFO:teuthology.orchestra.run.smithi101.stdout: "event": "done", 2023-08-01T19:55:49.022 INFO:teuthology.orchestra.run.smithi101.stdout: "time": "2023-08-01T19:54:04.480337+0000", 2023-08-01T19:55:49.022 INFO:teuthology.orchestra.run.smithi101.stdout: "duration": 1.9241000000000001e-05 2023-08-01T19:55:49.022 INFO:teuthology.orchestra.run.smithi101.stdout: } 2023-08-01T19:55:49.023 INFO:teuthology.orchestra.run.smithi101.stdout: ] 2023-08-01T19:55:49.023 INFO:teuthology.orchestra.run.smithi101.stdout: } 2023-08-01T19:55:49.023 INFO:teuthology.orchestra.run.smithi101.stdout: }, 2023-08-01T19:55:49.023 INFO:teuthology.orchestra.run.smithi101.stdout: { 2023-08-01T19:55:49.023 INFO:teuthology.orchestra.run.smithi101.stdout: "description": "osd_op(mds.0.3:1 3.14 3:292cf221:::200.00000000:head [writefull 0~90] snapc 0=[] ondisk+write+known_if_redirected+full_force+supports_pool_eio e17)", 2023-08-01T19:55:49.023 INFO:teuthology.orchestra.run.smithi101.stdout: "initiated_at": "2023-08-01T19:54:04.459177+0000", 2023-08-01T19:55:49.023 INFO:teuthology.orchestra.run.smithi101.stdout: "age": 104.527331159, 2023-08-01T19:55:49.023 INFO:teuthology.orchestra.run.smithi101.stdout: "duration": 0.021067196, 2023-08-01T19:55:49.024 INFO:teuthology.orchestra.run.smithi101.stdout: "type_data": { 2023-08-01T19:55:49.024 INFO:teuthology.orchestra.run.smithi101.stdout: "flag_point": "commit sent; apply or cleanup", 2023-08-01T19:55:49.024 INFO:teuthology.orchestra.run.smithi101.stdout: "events": [ 2023-08-01T19:55:49.024 INFO:teuthology.orchestra.run.smithi101.stdout: { 2023-08-01T19:55:49.024 INFO:teuthology.orchestra.run.smithi101.stdout: "event": "initiated", 2023-08-01T19:55:49.024 INFO:teuthology.orchestra.run.smithi101.stdout: "time": "2023-08-01T19:54:04.459177+0000", 2023-08-01T19:55:49.024 INFO:teuthology.orchestra.run.smithi101.stdout: "duration": 0 2023-08-01T19:55:49.024 INFO:teuthology.orchestra.run.smithi101.stdout: }, 2023-08-01T19:55:49.025 INFO:teuthology.orchestra.run.smithi101.stdout: { 2023-08-01T19:55:49.025 INFO:teuthology.orchestra.run.smithi101.stdout: "event": "throttled", 2023-08-01T19:55:49.025 INFO:teuthology.orchestra.run.smithi101.stdout: "time": "2023-08-01T19:54:04.459177+0000", 2023-08-01T19:55:49.025 INFO:teuthology.orchestra.run.smithi101.stdout: "duration": 0 2023-08-01T19:55:49.025 INFO:teuthology.orchestra.run.smithi101.stdout: }, 2023-08-01T19:55:49.025 INFO:teuthology.orchestra.run.smithi101.stdout: { 2023-08-01T19:55:49.025 INFO:teuthology.orchestra.run.smithi101.stdout: "event": "header_read", 2023-08-01T19:55:49.025 INFO:teuthology.orchestra.run.smithi101.stdout: "time": "2023-08-01T19:54:04.459176+0000", 2023-08-01T19:55:49.026 INFO:teuthology.orchestra.run.smithi101.stdout: "duration": 4294967295.9999995 2023-08-01T19:55:49.026 INFO:teuthology.orchestra.run.smithi101.stdout: }, 2023-08-01T19:55:49.026 INFO:teuthology.orchestra.run.smithi101.stdout: { 2023-08-01T19:55:49.026 INFO:teuthology.orchestra.run.smithi101.stdout: "event": "all_read", 2023-08-01T19:55:49.026 INFO:teuthology.orchestra.run.smithi101.stdout: "time": "2023-08-01T19:54:04.459181+0000", 2023-08-01T19:55:49.026 INFO:teuthology.orchestra.run.smithi101.stdout: "duration": 5.2109999999999997e-06 2023-08-01T19:55:49.026 INFO:teuthology.orchestra.run.smithi101.stdout: }, 2023-08-01T19:55:49.027 INFO:teuthology.orchestra.run.smithi101.stdout: { 2023-08-01T19:55:49.027 INFO:teuthology.orchestra.run.smithi101.stdout: "event": "dispatched", 2023-08-01T19:55:49.027 INFO:teuthology.orchestra.run.smithi101.stdout: "time": "2023-08-01T19:54:04.459188+0000", 2023-08-01T19:55:49.027 INFO:teuthology.orchestra.run.smithi101.stdout: "duration": 6.6680000000000004e-06 2023-08-01T19:55:49.027 INFO:teuthology.orchestra.run.smithi101.stdout: }, 2023-08-01T19:55:49.027 INFO:teuthology.orchestra.run.smithi101.stdout: { 2023-08-01T19:55:49.027 INFO:teuthology.orchestra.run.smithi101.stdout: "event": "queued_for_pg", 2023-08-01T19:55:49.027 INFO:teuthology.orchestra.run.smithi101.stdout: "time": "2023-08-01T19:54:04.459192+0000", 2023-08-01T19:55:49.028 INFO:teuthology.orchestra.run.smithi101.stdout: "duration": 4.228e-06 2023-08-01T19:55:49.028 INFO:teuthology.orchestra.run.smithi101.stdout: }, 2023-08-01T19:55:49.028 INFO:teuthology.orchestra.run.smithi101.stdout: { 2023-08-01T19:55:49.028 INFO:teuthology.orchestra.run.smithi101.stdout: "event": "reached_pg", 2023-08-01T19:55:49.028 INFO:teuthology.orchestra.run.smithi101.stdout: "time": "2023-08-01T19:54:04.459219+0000", 2023-08-01T19:55:49.028 INFO:teuthology.orchestra.run.smithi101.stdout: "duration": 2.6930000000000001e-05 2023-08-01T19:55:49.028 INFO:teuthology.orchestra.run.smithi101.stdout: }, 2023-08-01T19:55:49.028 INFO:teuthology.orchestra.run.smithi101.stdout: { 2023-08-01T19:55:49.029 INFO:teuthology.orchestra.run.smithi101.stdout: "event": "waiting_for_map not empty", 2023-08-01T19:55:49.029 INFO:teuthology.orchestra.run.smithi101.stdout: "time": "2023-08-01T19:54:04.459223+0000", 2023-08-01T19:55:49.029 INFO:teuthology.orchestra.run.smithi101.stdout: "duration": 3.8469999999999998e-06 2023-08-01T19:55:49.029 INFO:teuthology.orchestra.run.smithi101.stdout: }, 2023-08-01T19:55:49.029 INFO:teuthology.orchestra.run.smithi101.stdout: { 2023-08-01T19:55:49.029 INFO:teuthology.orchestra.run.smithi101.stdout: "event": "reached_pg", 2023-08-01T19:55:49.029 INFO:teuthology.orchestra.run.smithi101.stdout: "time": "2023-08-01T19:54:04.473347+0000", 2023-08-01T19:55:49.030 INFO:teuthology.orchestra.run.smithi101.stdout: "duration": 0.014124319 2023-08-01T19:55:49.030 INFO:teuthology.orchestra.run.smithi101.stdout: }, 2023-08-01T19:55:49.030 INFO:teuthology.orchestra.run.smithi101.stdout: { 2023-08-01T19:55:49.030 INFO:teuthology.orchestra.run.smithi101.stdout: "event": "started", 2023-08-01T19:55:49.030 INFO:teuthology.orchestra.run.smithi101.stdout: "time": "2023-08-01T19:54:04.473480+0000", 2023-08-01T19:55:49.030 INFO:teuthology.orchestra.run.smithi101.stdout: "duration": 0.00013276799999999999 2023-08-01T19:55:49.030 INFO:teuthology.orchestra.run.smithi101.stdout: }, 2023-08-01T19:55:49.030 INFO:teuthology.orchestra.run.smithi101.stdout: { 2023-08-01T19:55:49.031 INFO:teuthology.orchestra.run.smithi101.stdout: "event": "waiting for subops from 2", 2023-08-01T19:55:49.031 INFO:teuthology.orchestra.run.smithi101.stdout: "time": "2023-08-01T19:54:04.473622+0000", 2023-08-01T19:55:49.031 INFO:teuthology.orchestra.run.smithi101.stdout: "duration": 0.00014154799999999999 2023-08-01T19:55:49.031 INFO:teuthology.orchestra.run.smithi101.stdout: }, 2023-08-01T19:55:49.031 INFO:teuthology.orchestra.run.smithi101.stdout: { 2023-08-01T19:55:49.031 INFO:teuthology.orchestra.run.smithi101.stdout: "event": "op_commit", 2023-08-01T19:55:49.031 INFO:teuthology.orchestra.run.smithi101.stdout: "time": "2023-08-01T19:54:04.478281+0000", 2023-08-01T19:55:49.031 INFO:teuthology.orchestra.run.smithi101.stdout: "duration": 0.004659252 2023-08-01T19:55:49.032 INFO:teuthology.orchestra.run.smithi101.stdout: }, 2023-08-01T19:55:49.032 INFO:teuthology.orchestra.run.smithi101.stdout: { 2023-08-01T19:55:49.032 INFO:teuthology.orchestra.run.smithi101.stdout: "event": "sub_op_commit_rec", 2023-08-01T19:55:49.032 INFO:teuthology.orchestra.run.smithi101.stdout: "time": "2023-08-01T19:54:04.480180+0000", 2023-08-01T19:55:49.032 INFO:teuthology.orchestra.run.smithi101.stdout: "duration": 0.0018986859999999999 2023-08-01T19:55:49.032 INFO:teuthology.orchestra.run.smithi101.stdout: }, 2023-08-01T19:55:49.032 INFO:teuthology.orchestra.run.smithi101.stdout: { 2023-08-01T19:55:49.033 INFO:teuthology.orchestra.run.smithi101.stdout: "event": "commit_sent", 2023-08-01T19:55:49.033 INFO:teuthology.orchestra.run.smithi101.stdout: "time": "2023-08-01T19:54:04.480209+0000", 2023-08-01T19:55:49.033 INFO:teuthology.orchestra.run.smithi101.stdout: "duration": 2.9244999999999999e-05 2023-08-01T19:55:49.033 INFO:teuthology.orchestra.run.smithi101.stdout: }, 2023-08-01T19:55:49.033 INFO:teuthology.orchestra.run.smithi101.stdout: { 2023-08-01T19:55:49.033 INFO:teuthology.orchestra.run.smithi101.stdout: "event": "done", 2023-08-01T19:55:49.033 INFO:teuthology.orchestra.run.smithi101.stdout: "time": "2023-08-01T19:54:04.480244+0000", 2023-08-01T19:55:49.033 INFO:teuthology.orchestra.run.smithi101.stdout: "duration": 3.4875000000000001e-05 2023-08-01T19:55:49.034 INFO:teuthology.orchestra.run.smithi101.stdout: } 2023-08-01T19:55:49.034 INFO:teuthology.orchestra.run.smithi101.stdout: ] 2023-08-01T19:55:49.034 INFO:teuthology.orchestra.run.smithi101.stdout: } 2023-08-01T19:55:49.034 INFO:teuthology.orchestra.run.smithi101.stdout: }, 2023-08-01T19:55:49.034 INFO:teuthology.orchestra.run.smithi101.stdout: { 2023-08-01T19:55:49.034 INFO:teuthology.orchestra.run.smithi101.stdout: "description": "osd_op(mds.0.3:3 3.14 3:287034c4:::1.00000000.inode:head [writefull 0~554] snapc 0=[] ondisk+write+known_if_redirected+full_force+supports_pool_eio e17)", 2023-08-01T19:55:49.034 INFO:teuthology.orchestra.run.smithi101.stdout: "initiated_at": "2023-08-01T19:54:04.459226+0000", 2023-08-01T19:55:49.034 INFO:teuthology.orchestra.run.smithi101.stdout: "age": 104.52728208000001, 2023-08-01T19:55:49.035 INFO:teuthology.orchestra.run.smithi101.stdout: "duration": 0.021104531999999999, 2023-08-01T19:55:49.035 INFO:teuthology.orchestra.run.smithi101.stdout: "type_data": { 2023-08-01T19:55:49.035 INFO:teuthology.orchestra.run.smithi101.stdout: "flag_point": "commit sent; apply or cleanup", 2023-08-01T19:55:49.035 INFO:teuthology.orchestra.run.smithi101.stdout: "events": [ 2023-08-01T19:55:49.035 INFO:teuthology.orchestra.run.smithi101.stdout: { 2023-08-01T19:55:49.035 INFO:teuthology.orchestra.run.smithi101.stdout: "event": "initiated", 2023-08-01T19:55:49.035 INFO:teuthology.orchestra.run.smithi101.stdout: "time": "2023-08-01T19:54:04.459226+0000", 2023-08-01T19:55:49.036 INFO:teuthology.orchestra.run.smithi101.stdout: "duration": 0 2023-08-01T19:55:49.036 INFO:teuthology.orchestra.run.smithi101.stdout: }, 2023-08-01T19:55:49.036 INFO:teuthology.orchestra.run.smithi101.stdout: { 2023-08-01T19:55:49.036 INFO:teuthology.orchestra.run.smithi101.stdout: "event": "throttled", 2023-08-01T19:55:49.036 INFO:teuthology.orchestra.run.smithi101.stdout: "time": "2023-08-01T19:54:04.459226+0000", 2023-08-01T19:55:49.036 INFO:teuthology.orchestra.run.smithi101.stdout: "duration": 0 2023-08-01T19:55:49.036 INFO:teuthology.orchestra.run.smithi101.stdout: }, 2023-08-01T19:55:49.036 INFO:teuthology.orchestra.run.smithi101.stdout: { 2023-08-01T19:55:49.037 INFO:teuthology.orchestra.run.smithi101.stdout: "event": "header_read", 2023-08-01T19:55:49.037 INFO:teuthology.orchestra.run.smithi101.stdout: "time": "2023-08-01T19:54:04.459225+0000", 2023-08-01T19:55:49.037 INFO:teuthology.orchestra.run.smithi101.stdout: "duration": 4294967295.9999995 2023-08-01T19:55:49.037 INFO:teuthology.orchestra.run.smithi101.stdout: }, 2023-08-01T19:55:49.037 INFO:teuthology.orchestra.run.smithi101.stdout: { 2023-08-01T19:55:49.037 INFO:teuthology.orchestra.run.smithi101.stdout: "event": "all_read", 2023-08-01T19:55:49.037 INFO:teuthology.orchestra.run.smithi101.stdout: "time": "2023-08-01T19:54:04.459238+0000", 2023-08-01T19:55:49.038 INFO:teuthology.orchestra.run.smithi101.stdout: "duration": 1.2809000000000001e-05 2023-08-01T19:55:49.038 INFO:teuthology.orchestra.run.smithi101.stdout: }, 2023-08-01T19:55:49.038 INFO:teuthology.orchestra.run.smithi101.stdout: { 2023-08-01T19:55:49.038 INFO:teuthology.orchestra.run.smithi101.stdout: "event": "dispatched", 2023-08-01T19:55:49.038 INFO:teuthology.orchestra.run.smithi101.stdout: "time": "2023-08-01T19:54:04.459245+0000", 2023-08-01T19:55:49.038 INFO:teuthology.orchestra.run.smithi101.stdout: "duration": 6.6540000000000002e-06 2023-08-01T19:55:49.038 INFO:teuthology.orchestra.run.smithi101.stdout: }, 2023-08-01T19:55:49.038 INFO:teuthology.orchestra.run.smithi101.stdout: { 2023-08-01T19:55:49.039 INFO:teuthology.orchestra.run.smithi101.stdout: "event": "queued_for_pg", 2023-08-01T19:55:49.039 INFO:teuthology.orchestra.run.smithi101.stdout: "time": "2023-08-01T19:54:04.459249+0000", 2023-08-01T19:55:49.039 INFO:teuthology.orchestra.run.smithi101.stdout: "duration": 4.6e-06 2023-08-01T19:55:49.039 INFO:teuthology.orchestra.run.smithi101.stdout: }, 2023-08-01T19:55:49.039 INFO:teuthology.orchestra.run.smithi101.stdout: { 2023-08-01T19:55:49.039 INFO:teuthology.orchestra.run.smithi101.stdout: "event": "reached_pg", 2023-08-01T19:55:49.039 INFO:teuthology.orchestra.run.smithi101.stdout: "time": "2023-08-01T19:54:04.459276+0000", 2023-08-01T19:55:49.039 INFO:teuthology.orchestra.run.smithi101.stdout: "duration": 2.6373999999999999e-05 2023-08-01T19:55:49.040 INFO:teuthology.orchestra.run.smithi101.stdout: }, 2023-08-01T19:55:49.040 INFO:teuthology.orchestra.run.smithi101.stdout: { 2023-08-01T19:55:49.040 INFO:teuthology.orchestra.run.smithi101.stdout: "event": "waiting_for_map not empty", 2023-08-01T19:55:49.040 INFO:teuthology.orchestra.run.smithi101.stdout: "time": "2023-08-01T19:54:04.459278+0000", 2023-08-01T19:55:49.040 INFO:teuthology.orchestra.run.smithi101.stdout: "duration": 2.4980000000000001e-06 2023-08-01T19:55:49.040 INFO:teuthology.orchestra.run.smithi101.stdout: }, 2023-08-01T19:55:49.040 INFO:teuthology.orchestra.run.smithi101.stdout: { 2023-08-01T19:55:49.041 INFO:teuthology.orchestra.run.smithi101.stdout: "event": "reached_pg", 2023-08-01T19:55:49.041 INFO:teuthology.orchestra.run.smithi101.stdout: "time": "2023-08-01T19:54:04.474058+0000", 2023-08-01T19:55:49.041 INFO:teuthology.orchestra.run.smithi101.stdout: "duration": 0.014779979 2023-08-01T19:55:49.041 INFO:teuthology.orchestra.run.smithi101.stdout: }, 2023-08-01T19:55:49.041 INFO:teuthology.orchestra.run.smithi101.stdout: { 2023-08-01T19:55:49.041 INFO:teuthology.orchestra.run.smithi101.stdout: "event": "started", 2023-08-01T19:55:49.041 INFO:teuthology.orchestra.run.smithi101.stdout: "time": "2023-08-01T19:54:04.474614+0000", 2023-08-01T19:55:49.041 INFO:teuthology.orchestra.run.smithi101.stdout: "duration": 0.00055546899999999995 2023-08-01T19:55:49.042 INFO:teuthology.orchestra.run.smithi101.stdout: }, 2023-08-01T19:55:49.042 INFO:teuthology.orchestra.run.smithi101.stdout: { 2023-08-01T19:55:49.042 INFO:teuthology.orchestra.run.smithi101.stdout: "event": "waiting for subops from 2", 2023-08-01T19:55:49.042 INFO:teuthology.orchestra.run.smithi101.stdout: "time": "2023-08-01T19:54:04.474720+0000", 2023-08-01T19:55:49.042 INFO:teuthology.orchestra.run.smithi101.stdout: "duration": 0.00010645300000000001 2023-08-01T19:55:49.042 INFO:teuthology.orchestra.run.smithi101.stdout: }, 2023-08-01T19:55:49.042 INFO:teuthology.orchestra.run.smithi101.stdout: { 2023-08-01T19:55:49.042 INFO:teuthology.orchestra.run.smithi101.stdout: "event": "op_commit", 2023-08-01T19:55:49.043 INFO:teuthology.orchestra.run.smithi101.stdout: "time": "2023-08-01T19:54:04.478480+0000", 2023-08-01T19:55:49.043 INFO:teuthology.orchestra.run.smithi101.stdout: "duration": 0.0037600279999999999 2023-08-01T19:55:49.043 INFO:teuthology.orchestra.run.smithi101.stdout: }, 2023-08-01T19:55:49.043 INFO:teuthology.orchestra.run.smithi101.stdout: { 2023-08-01T19:55:49.043 INFO:teuthology.orchestra.run.smithi101.stdout: "event": "sub_op_commit_rec", 2023-08-01T19:55:49.043 INFO:teuthology.orchestra.run.smithi101.stdout: "time": "2023-08-01T19:54:04.480273+0000", 2023-08-01T19:55:49.043 INFO:teuthology.orchestra.run.smithi101.stdout: "duration": 0.001792465 2023-08-01T19:55:49.043 INFO:teuthology.orchestra.run.smithi101.stdout: }, 2023-08-01T19:55:49.044 INFO:teuthology.orchestra.run.smithi101.stdout: { 2023-08-01T19:55:49.044 INFO:teuthology.orchestra.run.smithi101.stdout: "event": "commit_sent", 2023-08-01T19:55:49.044 INFO:teuthology.orchestra.run.smithi101.stdout: "time": "2023-08-01T19:54:04.480304+0000", 2023-08-01T19:55:49.044 INFO:teuthology.orchestra.run.smithi101.stdout: "duration": 3.1708999999999997e-05 2023-08-01T19:55:49.044 INFO:teuthology.orchestra.run.smithi101.stdout: }, 2023-08-01T19:55:49.044 INFO:teuthology.orchestra.run.smithi101.stdout: { 2023-08-01T19:55:49.044 INFO:teuthology.orchestra.run.smithi101.stdout: "event": "done", 2023-08-01T19:55:49.045 INFO:teuthology.orchestra.run.smithi101.stdout: "time": "2023-08-01T19:54:04.480330+0000", 2023-08-01T19:55:49.045 INFO:teuthology.orchestra.run.smithi101.stdout: "duration": 2.5860999999999999e-05 2023-08-01T19:55:49.045 INFO:teuthology.orchestra.run.smithi101.stdout: } 2023-08-01T19:55:49.045 INFO:teuthology.orchestra.run.smithi101.stdout: ] 2023-08-01T19:55:49.045 INFO:teuthology.orchestra.run.smithi101.stdout: } 2023-08-01T19:55:49.045 INFO:teuthology.orchestra.run.smithi101.stdout: }, 2023-08-01T19:55:49.045 INFO:teuthology.orchestra.run.smithi101.stdout: { 2023-08-01T19:55:49.045 INFO:teuthology.orchestra.run.smithi101.stdout: "description": "osd_op(mds.0.3:32 3.14 3:2e2fa760:::200.00000001:head [delete] snapc 0=[] ondisk+write+known_if_redirected+full_force+supports_pool_eio e17)", 2023-08-01T19:55:49.046 INFO:teuthology.orchestra.run.smithi101.stdout: "initiated_at": "2023-08-01T19:54:04.459304+0000", 2023-08-01T19:55:49.046 INFO:teuthology.orchestra.run.smithi101.stdout: "age": 104.527203419, 2023-08-01T19:55:49.046 INFO:teuthology.orchestra.run.smithi101.stdout: "duration": 0.021110606000000001, 2023-08-01T19:55:49.046 INFO:teuthology.orchestra.run.smithi101.stdout: "type_data": { 2023-08-01T19:55:49.046 INFO:teuthology.orchestra.run.smithi101.stdout: "flag_point": "started", 2023-08-01T19:55:49.046 INFO:teuthology.orchestra.run.smithi101.stdout: "events": [ 2023-08-01T19:55:49.046 INFO:teuthology.orchestra.run.smithi101.stdout: { 2023-08-01T19:55:49.046 INFO:teuthology.orchestra.run.smithi101.stdout: "event": "initiated", 2023-08-01T19:55:49.047 INFO:teuthology.orchestra.run.smithi101.stdout: "time": "2023-08-01T19:54:04.459304+0000", 2023-08-01T19:55:49.047 INFO:teuthology.orchestra.run.smithi101.stdout: "duration": 0 2023-08-01T19:55:49.047 INFO:teuthology.orchestra.run.smithi101.stdout: }, 2023-08-01T19:55:49.047 INFO:teuthology.orchestra.run.smithi101.stdout: { 2023-08-01T19:55:49.047 INFO:teuthology.orchestra.run.smithi101.stdout: "event": "throttled", 2023-08-01T19:55:49.047 INFO:teuthology.orchestra.run.smithi101.stdout: "time": "2023-08-01T19:54:04.459304+0000", 2023-08-01T19:55:49.047 INFO:teuthology.orchestra.run.smithi101.stdout: "duration": 0 2023-08-01T19:55:49.048 INFO:teuthology.orchestra.run.smithi101.stdout: }, 2023-08-01T19:55:49.048 INFO:teuthology.orchestra.run.smithi101.stdout: { 2023-08-01T19:55:49.048 INFO:teuthology.orchestra.run.smithi101.stdout: "event": "header_read", 2023-08-01T19:55:49.048 INFO:teuthology.orchestra.run.smithi101.stdout: "time": "2023-08-01T19:54:04.459304+0000", 2023-08-01T19:55:49.048 INFO:teuthology.orchestra.run.smithi101.stdout: "duration": 4294967295.9999995 2023-08-01T19:55:49.048 INFO:teuthology.orchestra.run.smithi101.stdout: }, 2023-08-01T19:55:49.048 INFO:teuthology.orchestra.run.smithi101.stdout: { 2023-08-01T19:55:49.048 INFO:teuthology.orchestra.run.smithi101.stdout: "event": "all_read", 2023-08-01T19:55:49.049 INFO:teuthology.orchestra.run.smithi101.stdout: "time": "2023-08-01T19:54:04.459306+0000", 2023-08-01T19:55:49.049 INFO:teuthology.orchestra.run.smithi101.stdout: "duration": 2.3889999999999999e-06 2023-08-01T19:55:49.049 INFO:teuthology.orchestra.run.smithi101.stdout: }, 2023-08-01T19:55:49.049 INFO:teuthology.orchestra.run.smithi101.stdout: { 2023-08-01T19:55:49.049 INFO:teuthology.orchestra.run.smithi101.stdout: "event": "dispatched", 2023-08-01T19:55:49.049 INFO:teuthology.orchestra.run.smithi101.stdout: "time": "2023-08-01T19:54:04.459314+0000", 2023-08-01T19:55:49.049 INFO:teuthology.orchestra.run.smithi101.stdout: "duration": 7.1180000000000003e-06 2023-08-01T19:55:49.049 INFO:teuthology.orchestra.run.smithi101.stdout: }, 2023-08-01T19:55:49.050 INFO:teuthology.orchestra.run.smithi101.stdout: { 2023-08-01T19:55:49.050 INFO:teuthology.orchestra.run.smithi101.stdout: "event": "queued_for_pg", 2023-08-01T19:55:49.050 INFO:teuthology.orchestra.run.smithi101.stdout: "time": "2023-08-01T19:54:04.459318+0000", 2023-08-01T19:55:49.050 INFO:teuthology.orchestra.run.smithi101.stdout: "duration": 4.0239999999999999e-06 2023-08-01T19:55:49.050 INFO:teuthology.orchestra.run.smithi101.stdout: }, 2023-08-01T19:55:49.050 INFO:teuthology.orchestra.run.smithi101.stdout: { 2023-08-01T19:55:49.050 INFO:teuthology.orchestra.run.smithi101.stdout: "event": "reached_pg", 2023-08-01T19:55:49.051 INFO:teuthology.orchestra.run.smithi101.stdout: "time": "2023-08-01T19:54:04.459340+0000", 2023-08-01T19:55:49.051 INFO:teuthology.orchestra.run.smithi101.stdout: "duration": 2.2476e-05 2023-08-01T19:55:49.051 INFO:teuthology.orchestra.run.smithi101.stdout: }, 2023-08-01T19:55:49.051 INFO:teuthology.orchestra.run.smithi101.stdout: { 2023-08-01T19:55:49.051 INFO:teuthology.orchestra.run.smithi101.stdout: "event": "waiting_for_map not empty", 2023-08-01T19:55:49.051 INFO:teuthology.orchestra.run.smithi101.stdout: "time": "2023-08-01T19:54:04.459342+0000", 2023-08-01T19:55:49.051 INFO:teuthology.orchestra.run.smithi101.stdout: "duration": 2.272e-06 2023-08-01T19:55:49.051 INFO:teuthology.orchestra.run.smithi101.stdout: }, 2023-08-01T19:55:49.052 INFO:teuthology.orchestra.run.smithi101.stdout: { 2023-08-01T19:55:49.052 INFO:teuthology.orchestra.run.smithi101.stdout: "event": "reached_pg", 2023-08-01T19:55:49.052 INFO:teuthology.orchestra.run.smithi101.stdout: "time": "2023-08-01T19:54:04.475922+0000", 2023-08-01T19:55:49.052 INFO:teuthology.orchestra.run.smithi101.stdout: "duration": 0.016579388 2023-08-01T19:55:49.052 INFO:teuthology.orchestra.run.smithi101.stdout: }, 2023-08-01T19:55:49.052 INFO:teuthology.orchestra.run.smithi101.stdout: { 2023-08-01T19:55:49.052 INFO:teuthology.orchestra.run.smithi101.stdout: "event": "started", 2023-08-01T19:55:49.053 INFO:teuthology.orchestra.run.smithi101.stdout: "time": "2023-08-01T19:54:04.476107+0000", 2023-08-01T19:55:49.053 INFO:teuthology.orchestra.run.smithi101.stdout: "duration": 0.00018486300000000001 2023-08-01T19:55:49.053 INFO:teuthology.orchestra.run.smithi101.stdout: }, 2023-08-01T19:55:49.053 INFO:teuthology.orchestra.run.smithi101.stdout: { 2023-08-01T19:55:49.053 INFO:teuthology.orchestra.run.smithi101.stdout: "event": "done", 2023-08-01T19:55:49.053 INFO:teuthology.orchestra.run.smithi101.stdout: "time": "2023-08-01T19:54:04.480415+0000", 2023-08-01T19:55:49.053 INFO:teuthology.orchestra.run.smithi101.stdout: "duration": 0.0043084589999999997 2023-08-01T19:55:49.053 INFO:teuthology.orchestra.run.smithi101.stdout: } 2023-08-01T19:55:49.054 INFO:teuthology.orchestra.run.smithi101.stdout: ] 2023-08-01T19:55:49.054 INFO:teuthology.orchestra.run.smithi101.stdout: } 2023-08-01T19:55:49.054 INFO:teuthology.orchestra.run.smithi101.stdout: }, 2023-08-01T19:55:49.054 INFO:teuthology.orchestra.run.smithi101.stdout: { 2023-08-01T19:55:49.054 INFO:teuthology.orchestra.run.smithi101.stdout: "description": "osd_op(client.4668.0:70878 5.2 5:49b7d2be:::benchmark_data_smithi006_114134_object70877:head [set-alloc-hint object_size 65536 write_size 65536,write 0~65536] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e30)", 2023-08-01T19:55:49.054 INFO:teuthology.orchestra.run.smithi101.stdout: "initiated_at": "2023-08-01T19:54:50.210223+0000", 2023-08-01T19:55:49.054 INFO:teuthology.orchestra.run.smithi101.stdout: "age": 58.776284849, 2023-08-01T19:55:49.055 INFO:teuthology.orchestra.run.smithi101.stdout: "duration": 0.019884895, 2023-08-01T19:55:49.055 INFO:teuthology.orchestra.run.smithi101.stdout: "type_data": { 2023-08-01T19:55:49.055 INFO:teuthology.orchestra.run.smithi101.stdout: "flag_point": "commit sent; apply or cleanup", 2023-08-01T19:55:49.055 INFO:teuthology.orchestra.run.smithi101.stdout: "client_info": { 2023-08-01T19:55:49.055 INFO:teuthology.orchestra.run.smithi101.stdout: "client": "client.4668", 2023-08-01T19:55:49.055 INFO:teuthology.orchestra.run.smithi101.stdout: "client_addr": "172.21.15.6:0/1709472247", 2023-08-01T19:55:49.055 INFO:teuthology.orchestra.run.smithi101.stdout: "tid": 70878 2023-08-01T19:55:49.055 INFO:teuthology.orchestra.run.smithi101.stdout: }, 2023-08-01T19:55:49.056 INFO:teuthology.orchestra.run.smithi101.stdout: "events": [ 2023-08-01T19:55:49.056 INFO:teuthology.orchestra.run.smithi101.stdout: { 2023-08-01T19:55:49.056 INFO:teuthology.orchestra.run.smithi101.stdout: "event": "initiated", 2023-08-01T19:55:49.056 INFO:teuthology.orchestra.run.smithi101.stdout: "time": "2023-08-01T19:54:50.210223+0000", 2023-08-01T19:55:49.056 INFO:teuthology.orchestra.run.smithi101.stdout: "duration": 0 2023-08-01T19:55:49.056 INFO:teuthology.orchestra.run.smithi101.stdout: }, 2023-08-01T19:55:49.056 INFO:teuthology.orchestra.run.smithi101.stdout: { 2023-08-01T19:55:49.057 INFO:teuthology.orchestra.run.smithi101.stdout: "event": "throttled", 2023-08-01T19:55:49.057 INFO:teuthology.orchestra.run.smithi101.stdout: "time": "2023-08-01T19:54:50.210223+0000", 2023-08-01T19:55:49.057 INFO:teuthology.orchestra.run.smithi101.stdout: "duration": 0 2023-08-01T19:55:49.057 INFO:teuthology.orchestra.run.smithi101.stdout: }, 2023-08-01T19:55:49.057 INFO:teuthology.orchestra.run.smithi101.stdout: { 2023-08-01T19:55:49.057 INFO:teuthology.orchestra.run.smithi101.stdout: "event": "header_read", 2023-08-01T19:55:49.057 INFO:teuthology.orchestra.run.smithi101.stdout: "time": "2023-08-01T19:54:50.210222+0000", 2023-08-01T19:55:49.057 INFO:teuthology.orchestra.run.smithi101.stdout: "duration": 4294967295.999999 2023-08-01T19:55:49.058 INFO:teuthology.orchestra.run.smithi101.stdout: }, 2023-08-01T19:55:49.058 INFO:teuthology.orchestra.run.smithi101.stdout: { 2023-08-01T19:55:49.058 INFO:teuthology.orchestra.run.smithi101.stdout: "event": "all_read", 2023-08-01T19:55:49.058 INFO:teuthology.orchestra.run.smithi101.stdout: "time": "2023-08-01T19:54:50.210315+0000", 2023-08-01T19:55:49.058 INFO:teuthology.orchestra.run.smithi101.stdout: "duration": 9.2567999999999999e-05 2023-08-01T19:55:49.058 INFO:teuthology.orchestra.run.smithi101.stdout: }, 2023-08-01T19:55:49.058 INFO:teuthology.orchestra.run.smithi101.stdout: { 2023-08-01T19:55:49.058 INFO:teuthology.orchestra.run.smithi101.stdout: "event": "dispatched", 2023-08-01T19:55:49.059 INFO:teuthology.orchestra.run.smithi101.stdout: "time": "2023-08-01T19:54:50.210326+0000", 2023-08-01T19:55:49.059 INFO:teuthology.orchestra.run.smithi101.stdout: "duration": 1.1430000000000001e-05 2023-08-01T19:55:49.059 INFO:teuthology.orchestra.run.smithi101.stdout: }, 2023-08-01T19:55:49.059 INFO:teuthology.orchestra.run.smithi101.stdout: { 2023-08-01T19:55:49.059 INFO:teuthology.orchestra.run.smithi101.stdout: "event": "queued_for_pg", 2023-08-01T19:55:49.059 INFO:teuthology.orchestra.run.smithi101.stdout: "time": "2023-08-01T19:54:50.210332+0000", 2023-08-01T19:55:49.059 INFO:teuthology.orchestra.run.smithi101.stdout: "duration": 5.8479999999999997e-06 2023-08-01T19:55:49.060 INFO:teuthology.orchestra.run.smithi101.stdout: }, 2023-08-01T19:55:49.060 INFO:teuthology.orchestra.run.smithi101.stdout: { 2023-08-01T19:55:49.060 INFO:teuthology.orchestra.run.smithi101.stdout: "event": "reached_pg", 2023-08-01T19:55:49.060 INFO:teuthology.orchestra.run.smithi101.stdout: "time": "2023-08-01T19:54:50.214259+0000", 2023-08-01T19:55:49.060 INFO:teuthology.orchestra.run.smithi101.stdout: "duration": 0.003926789 2023-08-01T19:55:49.060 INFO:teuthology.orchestra.run.smithi101.stdout: }, 2023-08-01T19:55:49.060 INFO:teuthology.orchestra.run.smithi101.stdout: { 2023-08-01T19:55:49.060 INFO:teuthology.orchestra.run.smithi101.stdout: "event": "started", 2023-08-01T19:55:49.061 INFO:teuthology.orchestra.run.smithi101.stdout: "time": "2023-08-01T19:54:50.214387+0000", 2023-08-01T19:55:49.061 INFO:teuthology.orchestra.run.smithi101.stdout: "duration": 0.00012787599999999999 2023-08-01T19:55:49.061 INFO:teuthology.orchestra.run.smithi101.stdout: }, 2023-08-01T19:55:49.061 INFO:teuthology.orchestra.run.smithi101.stdout: { 2023-08-01T19:55:49.061 INFO:teuthology.orchestra.run.smithi101.stdout: "event": "waiting for subops from 0", 2023-08-01T19:55:49.061 INFO:teuthology.orchestra.run.smithi101.stdout: "time": "2023-08-01T19:54:50.214536+0000", 2023-08-01T19:55:49.061 INFO:teuthology.orchestra.run.smithi101.stdout: "duration": 0.00014935299999999999 2023-08-01T19:55:49.061 INFO:teuthology.orchestra.run.smithi101.stdout: }, 2023-08-01T19:55:49.062 INFO:teuthology.orchestra.run.smithi101.stdout: { 2023-08-01T19:55:49.062 INFO:teuthology.orchestra.run.smithi101.stdout: "event": "op_commit", 2023-08-01T19:55:49.062 INFO:teuthology.orchestra.run.smithi101.stdout: "time": "2023-08-01T19:54:50.217739+0000", 2023-08-01T19:55:49.062 INFO:teuthology.orchestra.run.smithi101.stdout: "duration": 0.0032034619999999998 2023-08-01T19:55:49.062 INFO:teuthology.orchestra.run.smithi101.stdout: }, 2023-08-01T19:55:49.062 INFO:teuthology.orchestra.run.smithi101.stdout: { 2023-08-01T19:55:49.062 INFO:teuthology.orchestra.run.smithi101.stdout: "event": "sub_op_commit_rec", 2023-08-01T19:55:49.062 INFO:teuthology.orchestra.run.smithi101.stdout: "time": "2023-08-01T19:54:50.230032+0000", 2023-08-01T19:55:49.063 INFO:teuthology.orchestra.run.smithi101.stdout: "duration": 0.012293068000000001 2023-08-01T19:55:49.063 INFO:teuthology.orchestra.run.smithi101.stdout: }, 2023-08-01T19:55:49.063 INFO:teuthology.orchestra.run.smithi101.stdout: { 2023-08-01T19:55:49.063 INFO:teuthology.orchestra.run.smithi101.stdout: "event": "commit_sent", 2023-08-01T19:55:49.063 INFO:teuthology.orchestra.run.smithi101.stdout: "time": "2023-08-01T19:54:50.230075+0000", 2023-08-01T19:55:49.063 INFO:teuthology.orchestra.run.smithi101.stdout: "duration": 4.3062999999999997e-05 2023-08-01T19:55:49.063 INFO:teuthology.orchestra.run.smithi101.stdout: }, 2023-08-01T19:55:49.064 INFO:teuthology.orchestra.run.smithi101.stdout: { 2023-08-01T19:55:49.064 INFO:teuthology.orchestra.run.smithi101.stdout: "event": "done", 2023-08-01T19:55:49.064 INFO:teuthology.orchestra.run.smithi101.stdout: "time": "2023-08-01T19:54:50.230108+0000", 2023-08-01T19:55:49.064 INFO:teuthology.orchestra.run.smithi101.stdout: "duration": 3.2366999999999997e-05 2023-08-01T19:55:49.064 INFO:teuthology.orchestra.run.smithi101.stdout: } 2023-08-01T19:55:49.064 INFO:teuthology.orchestra.run.smithi101.stdout: ] 2023-08-01T19:55:49.064 INFO:teuthology.orchestra.run.smithi101.stdout: } 2023-08-01T19:55:49.064 INFO:teuthology.orchestra.run.smithi101.stdout: }, 2023-08-01T19:55:49.065 INFO:teuthology.orchestra.run.smithi101.stdout: { 2023-08-01T19:55:49.065 INFO:teuthology.orchestra.run.smithi101.stdout: "description": "osd_op(client.4668.0:73460 5.f 5:ff4f0704:::benchmark_data_smithi006_114134_object73459:head [set-alloc-hint object_size 65536 write_size 65536,write 0~65536] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e31)", 2023-08-01T19:55:49.065 INFO:teuthology.orchestra.run.smithi101.stdout: "initiated_at": "2023-08-01T19:54:51.462968+0000", 2023-08-01T19:55:49.065 INFO:teuthology.orchestra.run.smithi101.stdout: "age": 57.523539970000002, 2023-08-01T19:55:49.065 INFO:teuthology.orchestra.run.smithi101.stdout: "duration": 0.020056502, 2023-08-01T19:55:49.065 INFO:teuthology.orchestra.run.smithi101.stdout: "type_data": { 2023-08-01T19:55:49.065 INFO:teuthology.orchestra.run.smithi101.stdout: "flag_point": "commit sent; apply or cleanup", 2023-08-01T19:55:49.065 INFO:teuthology.orchestra.run.smithi101.stdout: "client_info": { 2023-08-01T19:55:49.066 INFO:teuthology.orchestra.run.smithi101.stdout: "client": "client.4668", 2023-08-01T19:55:49.066 INFO:teuthology.orchestra.run.smithi101.stdout: "client_addr": "172.21.15.6:0/1709472247", 2023-08-01T19:55:49.066 INFO:teuthology.orchestra.run.smithi101.stdout: "tid": 73460 2023-08-01T19:55:49.066 INFO:teuthology.orchestra.run.smithi101.stdout: }, 2023-08-01T19:55:49.066 INFO:teuthology.orchestra.run.smithi101.stdout: "events": [ 2023-08-01T19:55:49.066 INFO:teuthology.orchestra.run.smithi101.stdout: { 2023-08-01T19:55:49.066 INFO:teuthology.orchestra.run.smithi101.stdout: "event": "initiated", 2023-08-01T19:55:49.067 INFO:teuthology.orchestra.run.smithi101.stdout: "time": "2023-08-01T19:54:51.462968+0000", 2023-08-01T19:55:49.067 INFO:teuthology.orchestra.run.smithi101.stdout: "duration": 0 2023-08-01T19:55:49.067 INFO:teuthology.orchestra.run.smithi101.stdout: }, 2023-08-01T19:55:49.067 INFO:teuthology.orchestra.run.smithi101.stdout: { 2023-08-01T19:55:49.067 INFO:teuthology.orchestra.run.smithi101.stdout: "event": "throttled", 2023-08-01T19:55:49.067 INFO:teuthology.orchestra.run.smithi101.stdout: "time": "2023-08-01T19:54:51.462968+0000", 2023-08-01T19:55:49.067 INFO:teuthology.orchestra.run.smithi101.stdout: "duration": 0 2023-08-01T19:55:49.067 INFO:teuthology.orchestra.run.smithi101.stdout: }, 2023-08-01T19:55:49.068 INFO:teuthology.orchestra.run.smithi101.stdout: { 2023-08-01T19:55:49.068 INFO:teuthology.orchestra.run.smithi101.stdout: "event": "header_read", 2023-08-01T19:55:49.068 INFO:teuthology.orchestra.run.smithi101.stdout: "time": "2023-08-01T19:54:51.462967+0000", 2023-08-01T19:55:49.068 INFO:teuthology.orchestra.run.smithi101.stdout: "duration": 4294967295.999999 2023-08-01T19:55:49.068 INFO:teuthology.orchestra.run.smithi101.stdout: }, 2023-08-01T19:55:49.068 INFO:teuthology.orchestra.run.smithi101.stdout: { 2023-08-01T19:55:49.068 INFO:teuthology.orchestra.run.smithi101.stdout: "event": "all_read", 2023-08-01T19:55:49.069 INFO:teuthology.orchestra.run.smithi101.stdout: "time": "2023-08-01T19:54:51.463009+0000", 2023-08-01T19:55:49.069 INFO:teuthology.orchestra.run.smithi101.stdout: "duration": 4.2106e-05 2023-08-01T19:55:49.069 INFO:teuthology.orchestra.run.smithi101.stdout: }, 2023-08-01T19:55:49.069 INFO:teuthology.orchestra.run.smithi101.stdout: { 2023-08-01T19:55:49.069 INFO:teuthology.orchestra.run.smithi101.stdout: "event": "dispatched", 2023-08-01T19:55:49.069 INFO:teuthology.orchestra.run.smithi101.stdout: "time": "2023-08-01T19:54:51.463017+0000", 2023-08-01T19:55:49.069 INFO:teuthology.orchestra.run.smithi101.stdout: "duration": 8.1529999999999997e-06 2023-08-01T19:55:49.069 INFO:teuthology.orchestra.run.smithi101.stdout: }, 2023-08-01T19:55:49.070 INFO:teuthology.orchestra.run.smithi101.stdout: { 2023-08-01T19:55:49.070 INFO:teuthology.orchestra.run.smithi101.stdout: "event": "queued_for_pg", 2023-08-01T19:55:49.070 INFO:teuthology.orchestra.run.smithi101.stdout: "time": "2023-08-01T19:54:51.463027+0000", 2023-08-01T19:55:49.070 INFO:teuthology.orchestra.run.smithi101.stdout: "duration": 9.5659999999999996e-06 2023-08-01T19:55:49.070 INFO:teuthology.orchestra.run.smithi101.stdout: }, 2023-08-01T19:55:49.070 INFO:teuthology.orchestra.run.smithi101.stdout: { 2023-08-01T19:55:49.070 INFO:teuthology.orchestra.run.smithi101.stdout: "event": "reached_pg", 2023-08-01T19:55:49.070 INFO:teuthology.orchestra.run.smithi101.stdout: "time": "2023-08-01T19:54:51.463062+0000", 2023-08-01T19:55:49.071 INFO:teuthology.orchestra.run.smithi101.stdout: "duration": 3.5442999999999999e-05 2023-08-01T19:55:49.071 INFO:teuthology.orchestra.run.smithi101.stdout: }, 2023-08-01T19:55:49.071 INFO:teuthology.orchestra.run.smithi101.stdout: { 2023-08-01T19:55:49.071 INFO:teuthology.orchestra.run.smithi101.stdout: "event": "started", 2023-08-01T19:55:49.071 INFO:teuthology.orchestra.run.smithi101.stdout: "time": "2023-08-01T19:54:51.463198+0000", 2023-08-01T19:55:49.071 INFO:teuthology.orchestra.run.smithi101.stdout: "duration": 0.000135628 2023-08-01T19:55:49.071 INFO:teuthology.orchestra.run.smithi101.stdout: }, 2023-08-01T19:55:49.072 INFO:teuthology.orchestra.run.smithi101.stdout: { 2023-08-01T19:55:49.072 INFO:teuthology.orchestra.run.smithi101.stdout: "event": "waiting for subops from 2", 2023-08-01T19:55:49.072 INFO:teuthology.orchestra.run.smithi101.stdout: "time": "2023-08-01T19:54:51.463341+0000", 2023-08-01T19:55:49.072 INFO:teuthology.orchestra.run.smithi101.stdout: "duration": 0.00014346500000000001 2023-08-01T19:55:49.072 INFO:teuthology.orchestra.run.smithi101.stdout: }, 2023-08-01T19:55:49.072 INFO:teuthology.orchestra.run.smithi101.stdout: { 2023-08-01T19:55:49.072 INFO:teuthology.orchestra.run.smithi101.stdout: "event": "op_commit", 2023-08-01T19:55:49.073 INFO:teuthology.orchestra.run.smithi101.stdout: "time": "2023-08-01T19:54:51.472684+0000", 2023-08-01T19:55:49.073 INFO:teuthology.orchestra.run.smithi101.stdout: "duration": 0.0093427900000000001 2023-08-01T19:55:49.073 INFO:teuthology.orchestra.run.smithi101.stdout: }, 2023-08-01T19:55:49.073 INFO:teuthology.orchestra.run.smithi101.stdout: { 2023-08-01T19:55:49.073 INFO:teuthology.orchestra.run.smithi101.stdout: "event": "sub_op_commit_rec", 2023-08-01T19:55:49.073 INFO:teuthology.orchestra.run.smithi101.stdout: "time": "2023-08-01T19:54:51.482937+0000", 2023-08-01T19:55:49.073 INFO:teuthology.orchestra.run.smithi101.stdout: "duration": 0.010252557000000001 2023-08-01T19:55:49.073 INFO:teuthology.orchestra.run.smithi101.stdout: }, 2023-08-01T19:55:49.074 INFO:teuthology.orchestra.run.smithi101.stdout: { 2023-08-01T19:55:49.074 INFO:teuthology.orchestra.run.smithi101.stdout: "event": "commit_sent", 2023-08-01T19:55:49.074 INFO:teuthology.orchestra.run.smithi101.stdout: "time": "2023-08-01T19:54:51.482984+0000", 2023-08-01T19:55:49.074 INFO:teuthology.orchestra.run.smithi101.stdout: "duration": 4.7394000000000001e-05 2023-08-01T19:55:49.074 INFO:teuthology.orchestra.run.smithi101.stdout: }, 2023-08-01T19:55:49.074 INFO:teuthology.orchestra.run.smithi101.stdout: { 2023-08-01T19:55:49.074 INFO:teuthology.orchestra.run.smithi101.stdout: "event": "done", 2023-08-01T19:55:49.075 INFO:teuthology.orchestra.run.smithi101.stdout: "time": "2023-08-01T19:54:51.483024+0000", 2023-08-01T19:55:49.075 INFO:teuthology.orchestra.run.smithi101.stdout: "duration": 4.0159e-05 2023-08-01T19:55:49.075 INFO:teuthology.orchestra.run.smithi101.stdout: } 2023-08-01T19:55:49.075 INFO:teuthology.orchestra.run.smithi101.stdout: ] 2023-08-01T19:55:49.075 INFO:teuthology.orchestra.run.smithi101.stdout: } 2023-08-01T19:55:49.075 INFO:teuthology.orchestra.run.smithi101.stdout: }, 2023-08-01T19:55:49.075 INFO:teuthology.orchestra.run.smithi101.stdout: { 2023-08-01T19:55:49.075 INFO:teuthology.orchestra.run.smithi101.stdout: "description": "osd_op(client.4668.0:92726 5.2 5:41e18163:::benchmark_data_smithi006_114134_object92725:head [set-alloc-hint object_size 65536 write_size 65536,write 0~65536] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e36)", 2023-08-01T19:55:49.076 INFO:teuthology.orchestra.run.smithi101.stdout: "initiated_at": "2023-08-01T19:55:01.256971+0000", 2023-08-01T19:55:49.076 INFO:teuthology.orchestra.run.smithi101.stdout: "age": 47.729536891000002, 2023-08-01T19:55:49.076 INFO:teuthology.orchestra.run.smithi101.stdout: "duration": 0.019854296, 2023-08-01T19:55:49.076 INFO:teuthology.orchestra.run.smithi101.stdout: "type_data": { 2023-08-01T19:55:49.076 INFO:teuthology.orchestra.run.smithi101.stdout: "flag_point": "commit sent; apply or cleanup", 2023-08-01T19:55:49.076 INFO:teuthology.orchestra.run.smithi101.stdout: "client_info": { 2023-08-01T19:55:49.076 INFO:teuthology.orchestra.run.smithi101.stdout: "client": "client.4668", 2023-08-01T19:55:49.077 INFO:teuthology.orchestra.run.smithi101.stdout: "client_addr": "172.21.15.6:0/1709472247", 2023-08-01T19:55:49.077 INFO:teuthology.orchestra.run.smithi101.stdout: "tid": 92726 2023-08-01T19:55:49.077 INFO:teuthology.orchestra.run.smithi101.stdout: }, 2023-08-01T19:55:49.077 INFO:teuthology.orchestra.run.smithi101.stdout: "events": [ 2023-08-01T19:55:49.077 INFO:teuthology.orchestra.run.smithi101.stdout: { 2023-08-01T19:55:49.077 INFO:teuthology.orchestra.run.smithi101.stdout: "event": "initiated", 2023-08-01T19:55:49.077 INFO:teuthology.orchestra.run.smithi101.stdout: "time": "2023-08-01T19:55:01.256971+0000", 2023-08-01T19:55:49.077 INFO:teuthology.orchestra.run.smithi101.stdout: "duration": 0 2023-08-01T19:55:49.078 INFO:teuthology.orchestra.run.smithi101.stdout: }, 2023-08-01T19:55:49.078 INFO:teuthology.orchestra.run.smithi101.stdout: { 2023-08-01T19:55:49.078 INFO:teuthology.orchestra.run.smithi101.stdout: "event": "throttled", 2023-08-01T19:55:49.078 INFO:teuthology.orchestra.run.smithi101.stdout: "time": "2023-08-01T19:55:01.256971+0000", 2023-08-01T19:55:49.078 INFO:teuthology.orchestra.run.smithi101.stdout: "duration": 0 2023-08-01T19:55:49.078 INFO:teuthology.orchestra.run.smithi101.stdout: }, 2023-08-01T19:55:49.078 INFO:teuthology.orchestra.run.smithi101.stdout: { 2023-08-01T19:55:49.078 INFO:teuthology.orchestra.run.smithi101.stdout: "event": "header_read", 2023-08-01T19:55:49.079 INFO:teuthology.orchestra.run.smithi101.stdout: "time": "2023-08-01T19:55:01.256970+0000", 2023-08-01T19:55:49.079 INFO:teuthology.orchestra.run.smithi101.stdout: "duration": 4294967295.9999995 2023-08-01T19:55:49.079 INFO:teuthology.orchestra.run.smithi101.stdout: }, 2023-08-01T19:55:49.079 INFO:teuthology.orchestra.run.smithi101.stdout: { 2023-08-01T19:55:49.079 INFO:teuthology.orchestra.run.smithi101.stdout: "event": "all_read", 2023-08-01T19:55:49.079 INFO:teuthology.orchestra.run.smithi101.stdout: "time": "2023-08-01T19:55:01.257057+0000", 2023-08-01T19:55:49.079 INFO:teuthology.orchestra.run.smithi101.stdout: "duration": 8.6627999999999998e-05 2023-08-01T19:55:49.079 INFO:teuthology.orchestra.run.smithi101.stdout: }, 2023-08-01T19:55:49.080 INFO:teuthology.orchestra.run.smithi101.stdout: { 2023-08-01T19:55:49.080 INFO:teuthology.orchestra.run.smithi101.stdout: "event": "dispatched", 2023-08-01T19:55:49.080 INFO:teuthology.orchestra.run.smithi101.stdout: "time": "2023-08-01T19:55:01.257063+0000", 2023-08-01T19:55:49.080 INFO:teuthology.orchestra.run.smithi101.stdout: "duration": 6.528e-06 2023-08-01T19:55:49.080 INFO:teuthology.orchestra.run.smithi101.stdout: }, 2023-08-01T19:55:49.080 INFO:teuthology.orchestra.run.smithi101.stdout: { 2023-08-01T19:55:49.080 INFO:teuthology.orchestra.run.smithi101.stdout: "event": "queued_for_pg", 2023-08-01T19:55:49.081 INFO:teuthology.orchestra.run.smithi101.stdout: "time": "2023-08-01T19:55:01.257067+0000", 2023-08-01T19:55:49.081 INFO:teuthology.orchestra.run.smithi101.stdout: "duration": 3.2739999999999999e-06 2023-08-01T19:55:49.081 INFO:teuthology.orchestra.run.smithi101.stdout: }, 2023-08-01T19:55:49.081 INFO:teuthology.orchestra.run.smithi101.stdout: { 2023-08-01T19:55:49.081 INFO:teuthology.orchestra.run.smithi101.stdout: "event": "reached_pg", 2023-08-01T19:55:49.081 INFO:teuthology.orchestra.run.smithi101.stdout: "time": "2023-08-01T19:55:01.259714+0000", 2023-08-01T19:55:49.081 INFO:teuthology.orchestra.run.smithi101.stdout: "duration": 0.0026476709999999999 2023-08-01T19:55:49.081 INFO:teuthology.orchestra.run.smithi101.stdout: }, 2023-08-01T19:55:49.082 INFO:teuthology.orchestra.run.smithi101.stdout: { 2023-08-01T19:55:49.082 INFO:teuthology.orchestra.run.smithi101.stdout: "event": "started", 2023-08-01T19:55:49.082 INFO:teuthology.orchestra.run.smithi101.stdout: "time": "2023-08-01T19:55:01.259829+0000", 2023-08-01T19:55:49.082 INFO:teuthology.orchestra.run.smithi101.stdout: "duration": 0.000114471 2023-08-01T19:55:49.082 INFO:teuthology.orchestra.run.smithi101.stdout: }, 2023-08-01T19:55:49.082 INFO:teuthology.orchestra.run.smithi101.stdout: { 2023-08-01T19:55:49.082 INFO:teuthology.orchestra.run.smithi101.stdout: "event": "waiting for subops from 0", 2023-08-01T19:55:49.082 INFO:teuthology.orchestra.run.smithi101.stdout: "time": "2023-08-01T19:55:01.259965+0000", 2023-08-01T19:55:49.083 INFO:teuthology.orchestra.run.smithi101.stdout: "duration": 0.00013597300000000001 2023-08-01T19:55:49.083 INFO:teuthology.orchestra.run.smithi101.stdout: }, 2023-08-01T19:55:49.083 INFO:teuthology.orchestra.run.smithi101.stdout: { 2023-08-01T19:55:49.083 INFO:teuthology.orchestra.run.smithi101.stdout: "event": "op_commit", 2023-08-01T19:55:49.083 INFO:teuthology.orchestra.run.smithi101.stdout: "time": "2023-08-01T19:55:01.264360+0000", 2023-08-01T19:55:49.083 INFO:teuthology.orchestra.run.smithi101.stdout: "duration": 0.0043956619999999998 2023-08-01T19:55:49.083 INFO:teuthology.orchestra.run.smithi101.stdout: }, 2023-08-01T19:55:49.083 INFO:teuthology.orchestra.run.smithi101.stdout: { 2023-08-01T19:55:49.084 INFO:teuthology.orchestra.run.smithi101.stdout: "event": "sub_op_commit_rec", 2023-08-01T19:55:49.084 INFO:teuthology.orchestra.run.smithi101.stdout: "time": "2023-08-01T19:55:01.276766+0000", 2023-08-01T19:55:49.084 INFO:teuthology.orchestra.run.smithi101.stdout: "duration": 0.012405736000000001 2023-08-01T19:55:49.084 INFO:teuthology.orchestra.run.smithi101.stdout: }, 2023-08-01T19:55:49.084 INFO:teuthology.orchestra.run.smithi101.stdout: { 2023-08-01T19:55:49.084 INFO:teuthology.orchestra.run.smithi101.stdout: "event": "commit_sent", 2023-08-01T19:55:49.084 INFO:teuthology.orchestra.run.smithi101.stdout: "time": "2023-08-01T19:55:01.276804+0000", 2023-08-01T19:55:49.085 INFO:teuthology.orchestra.run.smithi101.stdout: "duration": 3.7759999999999998e-05 2023-08-01T19:55:49.085 INFO:teuthology.orchestra.run.smithi101.stdout: }, 2023-08-01T19:55:49.085 INFO:teuthology.orchestra.run.smithi101.stdout: { 2023-08-01T19:55:49.085 INFO:teuthology.orchestra.run.smithi101.stdout: "event": "done", 2023-08-01T19:55:49.085 INFO:teuthology.orchestra.run.smithi101.stdout: "time": "2023-08-01T19:55:01.276825+0000", 2023-08-01T19:55:49.085 INFO:teuthology.orchestra.run.smithi101.stdout: "duration": 2.1299000000000001e-05 2023-08-01T19:55:49.085 INFO:teuthology.orchestra.run.smithi101.stdout: } 2023-08-01T19:55:49.085 INFO:teuthology.orchestra.run.smithi101.stdout: ] 2023-08-01T19:55:49.086 INFO:teuthology.orchestra.run.smithi101.stdout: } 2023-08-01T19:55:49.086 INFO:teuthology.orchestra.run.smithi101.stdout: }, 2023-08-01T19:55:49.086 INFO:teuthology.orchestra.run.smithi101.stdout: { 2023-08-01T19:55:49.086 INFO:teuthology.orchestra.run.smithi101.stdout: "description": "osd_op(client.4668.0:100244 5.9 5:92f56a12:::benchmark_data_smithi006_114134_object100243:head [set-alloc-hint object_size 65536 write_size 65536,write 0~65536] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e37)", 2023-08-01T19:55:49.086 INFO:teuthology.orchestra.run.smithi101.stdout: "initiated_at": "2023-08-01T19:55:05.150910+0000", 2023-08-01T19:55:49.086 INFO:teuthology.orchestra.run.smithi101.stdout: "age": 43.835598075, 2023-08-01T19:55:49.086 INFO:teuthology.orchestra.run.smithi101.stdout: "duration": 0.072864287, 2023-08-01T19:55:49.086 INFO:teuthology.orchestra.run.smithi101.stdout: "type_data": { 2023-08-01T19:55:49.087 INFO:teuthology.orchestra.run.smithi101.stdout: "flag_point": "commit sent; apply or cleanup", 2023-08-01T19:55:49.087 INFO:teuthology.orchestra.run.smithi101.stdout: "client_info": { 2023-08-01T19:55:49.087 INFO:teuthology.orchestra.run.smithi101.stdout: "client": "client.4668", 2023-08-01T19:55:49.087 INFO:teuthology.orchestra.run.smithi101.stdout: "client_addr": "172.21.15.6:0/1709472247", 2023-08-01T19:55:49.087 INFO:teuthology.orchestra.run.smithi101.stdout: "tid": 100244 2023-08-01T19:55:49.087 INFO:teuthology.orchestra.run.smithi101.stdout: }, 2023-08-01T19:55:49.087 INFO:teuthology.orchestra.run.smithi101.stdout: "events": [ 2023-08-01T19:55:49.087 INFO:teuthology.orchestra.run.smithi101.stdout: { 2023-08-01T19:55:49.088 INFO:teuthology.orchestra.run.smithi101.stdout: "event": "initiated", 2023-08-01T19:55:49.088 INFO:teuthology.orchestra.run.smithi101.stdout: "time": "2023-08-01T19:55:05.150910+0000", 2023-08-01T19:55:49.088 INFO:teuthology.orchestra.run.smithi101.stdout: "duration": 0 2023-08-01T19:55:49.088 INFO:teuthology.orchestra.run.smithi101.stdout: }, 2023-08-01T19:55:49.088 INFO:teuthology.orchestra.run.smithi101.stdout: { 2023-08-01T19:55:49.088 INFO:teuthology.orchestra.run.smithi101.stdout: "event": "throttled", 2023-08-01T19:55:49.088 INFO:teuthology.orchestra.run.smithi101.stdout: "time": "2023-08-01T19:55:05.150910+0000", 2023-08-01T19:55:49.089 INFO:teuthology.orchestra.run.smithi101.stdout: "duration": 0 2023-08-01T19:55:49.089 INFO:teuthology.orchestra.run.smithi101.stdout: }, 2023-08-01T19:55:49.089 INFO:teuthology.orchestra.run.smithi101.stdout: { 2023-08-01T19:55:49.089 INFO:teuthology.orchestra.run.smithi101.stdout: "event": "header_read", 2023-08-01T19:55:49.089 INFO:teuthology.orchestra.run.smithi101.stdout: "time": "2023-08-01T19:55:05.150909+0000", 2023-08-01T19:55:49.089 INFO:teuthology.orchestra.run.smithi101.stdout: "duration": 4294967295.999999 2023-08-01T19:55:49.089 INFO:teuthology.orchestra.run.smithi101.stdout: }, 2023-08-01T19:55:49.089 INFO:teuthology.orchestra.run.smithi101.stdout: { 2023-08-01T19:55:49.090 INFO:teuthology.orchestra.run.smithi101.stdout: "event": "all_read", 2023-08-01T19:55:49.090 INFO:teuthology.orchestra.run.smithi101.stdout: "time": "2023-08-01T19:55:05.150973+0000", 2023-08-01T19:55:49.090 INFO:teuthology.orchestra.run.smithi101.stdout: "duration": 6.4531999999999998e-05 2023-08-01T19:55:49.090 INFO:teuthology.orchestra.run.smithi101.stdout: }, 2023-08-01T19:55:49.090 INFO:teuthology.orchestra.run.smithi101.stdout: { 2023-08-01T19:55:49.090 INFO:teuthology.orchestra.run.smithi101.stdout: "event": "dispatched", 2023-08-01T19:55:49.090 INFO:teuthology.orchestra.run.smithi101.stdout: "time": "2023-08-01T19:55:05.150984+0000", 2023-08-01T19:55:49.090 INFO:teuthology.orchestra.run.smithi101.stdout: "duration": 1.0287e-05 2023-08-01T19:55:49.091 INFO:teuthology.orchestra.run.smithi101.stdout: }, 2023-08-01T19:55:49.091 INFO:teuthology.orchestra.run.smithi101.stdout: { 2023-08-01T19:55:49.091 INFO:teuthology.orchestra.run.smithi101.stdout: "event": "queued_for_pg", 2023-08-01T19:55:49.091 INFO:teuthology.orchestra.run.smithi101.stdout: "time": "2023-08-01T19:55:05.150989+0000", 2023-08-01T19:55:49.091 INFO:teuthology.orchestra.run.smithi101.stdout: "duration": 5.3929999999999999e-06 2023-08-01T19:55:49.091 INFO:teuthology.orchestra.run.smithi101.stdout: }, 2023-08-01T19:55:49.091 INFO:teuthology.orchestra.run.smithi101.stdout: { 2023-08-01T19:55:49.091 INFO:teuthology.orchestra.run.smithi101.stdout: "event": "reached_pg", 2023-08-01T19:55:49.092 INFO:teuthology.orchestra.run.smithi101.stdout: "time": "2023-08-01T19:55:05.151034+0000", 2023-08-01T19:55:49.092 INFO:teuthology.orchestra.run.smithi101.stdout: "duration": 4.4336999999999999e-05 2023-08-01T19:55:49.092 INFO:teuthology.orchestra.run.smithi101.stdout: }, 2023-08-01T19:55:49.092 INFO:teuthology.orchestra.run.smithi101.stdout: { 2023-08-01T19:55:49.092 INFO:teuthology.orchestra.run.smithi101.stdout: "event": "started", 2023-08-01T19:55:49.092 INFO:teuthology.orchestra.run.smithi101.stdout: "time": "2023-08-01T19:55:05.151167+0000", 2023-08-01T19:55:49.092 INFO:teuthology.orchestra.run.smithi101.stdout: "duration": 0.00013368899999999999 2023-08-01T19:55:49.093 INFO:teuthology.orchestra.run.smithi101.stdout: }, 2023-08-01T19:55:49.093 INFO:teuthology.orchestra.run.smithi101.stdout: { 2023-08-01T19:55:49.093 INFO:teuthology.orchestra.run.smithi101.stdout: "event": "waiting for subops from 2", 2023-08-01T19:55:49.093 INFO:teuthology.orchestra.run.smithi101.stdout: "time": "2023-08-01T19:55:05.151328+0000", 2023-08-01T19:55:49.093 INFO:teuthology.orchestra.run.smithi101.stdout: "duration": 0.00016122700000000001 2023-08-01T19:55:49.093 INFO:teuthology.orchestra.run.smithi101.stdout: }, 2023-08-01T19:55:49.093 INFO:teuthology.orchestra.run.smithi101.stdout: { 2023-08-01T19:55:49.093 INFO:teuthology.orchestra.run.smithi101.stdout: "event": "op_commit", 2023-08-01T19:55:49.094 INFO:teuthology.orchestra.run.smithi101.stdout: "time": "2023-08-01T19:55:05.156101+0000", 2023-08-01T19:55:49.094 INFO:teuthology.orchestra.run.smithi101.stdout: "duration": 0.0047724100000000004 2023-08-01T19:55:49.094 INFO:teuthology.orchestra.run.smithi101.stdout: }, 2023-08-01T19:55:49.094 INFO:teuthology.orchestra.run.smithi101.stdout: { 2023-08-01T19:55:49.094 INFO:teuthology.orchestra.run.smithi101.stdout: "event": "sub_op_commit_rec", 2023-08-01T19:55:49.094 INFO:teuthology.orchestra.run.smithi101.stdout: "time": "2023-08-01T19:55:05.223688+0000", 2023-08-01T19:55:49.094 INFO:teuthology.orchestra.run.smithi101.stdout: "duration": 0.067586937999999999 2023-08-01T19:55:49.094 INFO:teuthology.orchestra.run.smithi101.stdout: }, 2023-08-01T19:55:49.095 INFO:teuthology.orchestra.run.smithi101.stdout: { 2023-08-01T19:55:49.095 INFO:teuthology.orchestra.run.smithi101.stdout: "event": "commit_sent", 2023-08-01T19:55:49.095 INFO:teuthology.orchestra.run.smithi101.stdout: "time": "2023-08-01T19:55:05.223737+0000", 2023-08-01T19:55:49.095 INFO:teuthology.orchestra.run.smithi101.stdout: "duration": 4.8921999999999997e-05 2023-08-01T19:55:49.095 INFO:teuthology.orchestra.run.smithi101.stdout: }, 2023-08-01T19:55:49.095 INFO:teuthology.orchestra.run.smithi101.stdout: { 2023-08-01T19:55:49.095 INFO:teuthology.orchestra.run.smithi101.stdout: "event": "done", 2023-08-01T19:55:49.095 INFO:teuthology.orchestra.run.smithi101.stdout: "time": "2023-08-01T19:55:05.223774+0000", 2023-08-01T19:55:49.096 INFO:teuthology.orchestra.run.smithi101.stdout: "duration": 3.7342999999999998e-05 2023-08-01T19:55:49.096 INFO:teuthology.orchestra.run.smithi101.stdout: } 2023-08-01T19:55:49.096 INFO:teuthology.orchestra.run.smithi101.stdout: ] 2023-08-01T19:55:49.096 INFO:teuthology.orchestra.run.smithi101.stdout: } 2023-08-01T19:55:49.096 INFO:teuthology.orchestra.run.smithi101.stdout: }, 2023-08-01T19:55:49.096 INFO:teuthology.orchestra.run.smithi101.stdout: { 2023-08-01T19:55:49.096 INFO:teuthology.orchestra.run.smithi101.stdout: "description": "osd_op(client.4668.0:100253 5.f 5:f7bbce05:::benchmark_data_smithi006_114134_object100252:head [set-alloc-hint object_size 65536 write_size 65536,write 0~65536] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e37)", 2023-08-01T19:55:49.097 INFO:teuthology.orchestra.run.smithi101.stdout: "initiated_at": "2023-08-01T19:55:05.156562+0000", 2023-08-01T19:55:49.097 INFO:teuthology.orchestra.run.smithi101.stdout: "age": 43.829946042000003, 2023-08-01T19:55:49.097 INFO:teuthology.orchestra.run.smithi101.stdout: "duration": 0.068677503000000001, 2023-08-01T19:55:49.097 INFO:teuthology.orchestra.run.smithi101.stdout: "type_data": { 2023-08-01T19:55:49.097 INFO:teuthology.orchestra.run.smithi101.stdout: "flag_point": "commit sent; apply or cleanup", 2023-08-01T19:55:49.097 INFO:teuthology.orchestra.run.smithi101.stdout: "client_info": { 2023-08-01T19:55:49.097 INFO:teuthology.orchestra.run.smithi101.stdout: "client": "client.4668", 2023-08-01T19:55:49.097 INFO:teuthology.orchestra.run.smithi101.stdout: "client_addr": "172.21.15.6:0/1709472247", 2023-08-01T19:55:49.098 INFO:teuthology.orchestra.run.smithi101.stdout: "tid": 100253 2023-08-01T19:55:49.098 INFO:teuthology.orchestra.run.smithi101.stdout: }, 2023-08-01T19:55:49.098 INFO:teuthology.orchestra.run.smithi101.stdout: "events": [ 2023-08-01T19:55:49.098 INFO:teuthology.orchestra.run.smithi101.stdout: { 2023-08-01T19:55:49.098 INFO:teuthology.orchestra.run.smithi101.stdout: "event": "initiated", 2023-08-01T19:55:49.098 INFO:teuthology.orchestra.run.smithi101.stdout: "time": "2023-08-01T19:55:05.156562+0000", 2023-08-01T19:55:49.098 INFO:teuthology.orchestra.run.smithi101.stdout: "duration": 0 2023-08-01T19:55:49.098 INFO:teuthology.orchestra.run.smithi101.stdout: }, 2023-08-01T19:55:49.099 INFO:teuthology.orchestra.run.smithi101.stdout: { 2023-08-01T19:55:49.099 INFO:teuthology.orchestra.run.smithi101.stdout: "event": "throttled", 2023-08-01T19:55:49.099 INFO:teuthology.orchestra.run.smithi101.stdout: "time": "2023-08-01T19:55:05.156562+0000", 2023-08-01T19:55:49.099 INFO:teuthology.orchestra.run.smithi101.stdout: "duration": 0 2023-08-01T19:55:49.099 INFO:teuthology.orchestra.run.smithi101.stdout: }, 2023-08-01T19:55:49.099 INFO:teuthology.orchestra.run.smithi101.stdout: { 2023-08-01T19:55:49.099 INFO:teuthology.orchestra.run.smithi101.stdout: "event": "header_read", 2023-08-01T19:55:49.099 INFO:teuthology.orchestra.run.smithi101.stdout: "time": "2023-08-01T19:55:05.156561+0000", 2023-08-01T19:55:49.100 INFO:teuthology.orchestra.run.smithi101.stdout: "duration": 4294967295.999999 2023-08-01T19:55:49.100 INFO:teuthology.orchestra.run.smithi101.stdout: }, 2023-08-01T19:55:49.100 INFO:teuthology.orchestra.run.smithi101.stdout: { 2023-08-01T19:55:49.100 INFO:teuthology.orchestra.run.smithi101.stdout: "event": "all_read", 2023-08-01T19:55:49.100 INFO:teuthology.orchestra.run.smithi101.stdout: "time": "2023-08-01T19:55:05.156655+0000", 2023-08-01T19:55:49.100 INFO:teuthology.orchestra.run.smithi101.stdout: "duration": 9.4018999999999995e-05 2023-08-01T19:55:49.100 INFO:teuthology.orchestra.run.smithi101.stdout: }, 2023-08-01T19:55:49.101 INFO:teuthology.orchestra.run.smithi101.stdout: { 2023-08-01T19:55:49.101 INFO:teuthology.orchestra.run.smithi101.stdout: "event": "dispatched", 2023-08-01T19:55:49.101 INFO:teuthology.orchestra.run.smithi101.stdout: "time": "2023-08-01T19:55:05.156664+0000", 2023-08-01T19:55:49.101 INFO:teuthology.orchestra.run.smithi101.stdout: "duration": 9.4970000000000007e-06 2023-08-01T19:55:49.101 INFO:teuthology.orchestra.run.smithi101.stdout: }, 2023-08-01T19:55:49.101 INFO:teuthology.orchestra.run.smithi101.stdout: { 2023-08-01T19:55:49.101 INFO:teuthology.orchestra.run.smithi101.stdout: "event": "queued_for_pg", 2023-08-01T19:55:49.101 INFO:teuthology.orchestra.run.smithi101.stdout: "time": "2023-08-01T19:55:05.156671+0000", 2023-08-01T19:55:49.102 INFO:teuthology.orchestra.run.smithi101.stdout: "duration": 6.1929999999999998e-06 2023-08-01T19:55:49.102 INFO:teuthology.orchestra.run.smithi101.stdout: }, 2023-08-01T19:55:49.102 INFO:teuthology.orchestra.run.smithi101.stdout: { 2023-08-01T19:55:49.102 INFO:teuthology.orchestra.run.smithi101.stdout: "event": "reached_pg", 2023-08-01T19:55:49.102 INFO:teuthology.orchestra.run.smithi101.stdout: "time": "2023-08-01T19:55:05.156742+0000", 2023-08-01T19:55:49.102 INFO:teuthology.orchestra.run.smithi101.stdout: "duration": 7.1181999999999997e-05 2023-08-01T19:55:49.102 INFO:teuthology.orchestra.run.smithi101.stdout: }, 2023-08-01T19:55:49.102 INFO:teuthology.orchestra.run.smithi101.stdout: { 2023-08-01T19:55:49.103 INFO:teuthology.orchestra.run.smithi101.stdout: "event": "started", 2023-08-01T19:55:49.103 INFO:teuthology.orchestra.run.smithi101.stdout: "time": "2023-08-01T19:55:05.156839+0000", 2023-08-01T19:55:49.103 INFO:teuthology.orchestra.run.smithi101.stdout: "duration": 9.7182000000000006e-05 2023-08-01T19:55:49.103 INFO:teuthology.orchestra.run.smithi101.stdout: }, 2023-08-01T19:55:49.103 INFO:teuthology.orchestra.run.smithi101.stdout: { 2023-08-01T19:55:49.103 INFO:teuthology.orchestra.run.smithi101.stdout: "event": "waiting for subops from 2", 2023-08-01T19:55:49.103 INFO:teuthology.orchestra.run.smithi101.stdout: "time": "2023-08-01T19:55:05.156925+0000", 2023-08-01T19:55:49.103 INFO:teuthology.orchestra.run.smithi101.stdout: "duration": 8.5816000000000006e-05 2023-08-01T19:55:49.104 INFO:teuthology.orchestra.run.smithi101.stdout: }, 2023-08-01T19:55:49.104 INFO:teuthology.orchestra.run.smithi101.stdout: { 2023-08-01T19:55:49.104 INFO:teuthology.orchestra.run.smithi101.stdout: "event": "op_commit", 2023-08-01T19:55:49.104 INFO:teuthology.orchestra.run.smithi101.stdout: "time": "2023-08-01T19:55:05.160082+0000", 2023-08-01T19:55:49.104 INFO:teuthology.orchestra.run.smithi101.stdout: "duration": 0.0031573959999999998 2023-08-01T19:55:49.104 INFO:teuthology.orchestra.run.smithi101.stdout: }, 2023-08-01T19:55:49.104 INFO:teuthology.orchestra.run.smithi101.stdout: { 2023-08-01T19:55:49.105 INFO:teuthology.orchestra.run.smithi101.stdout: "event": "sub_op_commit_rec", 2023-08-01T19:55:49.105 INFO:teuthology.orchestra.run.smithi101.stdout: "time": "2023-08-01T19:55:05.225162+0000", 2023-08-01T19:55:49.105 INFO:teuthology.orchestra.run.smithi101.stdout: "duration": 0.065079466000000002 2023-08-01T19:55:49.105 INFO:teuthology.orchestra.run.smithi101.stdout: }, 2023-08-01T19:55:49.105 INFO:teuthology.orchestra.run.smithi101.stdout: { 2023-08-01T19:55:49.105 INFO:teuthology.orchestra.run.smithi101.stdout: "event": "commit_sent", 2023-08-01T19:55:49.105 INFO:teuthology.orchestra.run.smithi101.stdout: "time": "2023-08-01T19:55:05.225205+0000", 2023-08-01T19:55:49.105 INFO:teuthology.orchestra.run.smithi101.stdout: "duration": 4.3446999999999999e-05 2023-08-01T19:55:49.106 INFO:teuthology.orchestra.run.smithi101.stdout: }, 2023-08-01T19:55:49.106 INFO:teuthology.orchestra.run.smithi101.stdout: { 2023-08-01T19:55:49.106 INFO:teuthology.orchestra.run.smithi101.stdout: "event": "done", 2023-08-01T19:55:49.106 INFO:teuthology.orchestra.run.smithi101.stdout: "time": "2023-08-01T19:55:05.225239+0000", 2023-08-01T19:55:49.106 INFO:teuthology.orchestra.run.smithi101.stdout: "duration": 3.4121000000000001e-05 2023-08-01T19:55:49.106 INFO:teuthology.orchestra.run.smithi101.stdout: } 2023-08-01T19:55:49.106 INFO:teuthology.orchestra.run.smithi101.stdout: ] 2023-08-01T19:55:49.106 INFO:teuthology.orchestra.run.smithi101.stdout: } 2023-08-01T19:55:49.107 INFO:teuthology.orchestra.run.smithi101.stdout: }, 2023-08-01T19:55:49.107 INFO:teuthology.orchestra.run.smithi101.stdout: { 2023-08-01T19:55:49.107 INFO:teuthology.orchestra.run.smithi101.stdout: "description": "osd_op(client.4668.0:100928 5.7 5:e61a7dfa:::benchmark_data_smithi006_114134_object100927:head [set-alloc-hint object_size 65536 write_size 65536,write 0~65536] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e37)", 2023-08-01T19:55:49.107 INFO:teuthology.orchestra.run.smithi101.stdout: "initiated_at": "2023-08-01T19:55:05.564731+0000", 2023-08-01T19:55:49.107 INFO:teuthology.orchestra.run.smithi101.stdout: "age": 43.421776549999997, 2023-08-01T19:55:49.107 INFO:teuthology.orchestra.run.smithi101.stdout: "duration": 0.064686603999999995, 2023-08-01T19:55:49.107 INFO:teuthology.orchestra.run.smithi101.stdout: "type_data": { 2023-08-01T19:55:49.107 INFO:teuthology.orchestra.run.smithi101.stdout: "flag_point": "commit sent; apply or cleanup", 2023-08-01T19:55:49.108 INFO:teuthology.orchestra.run.smithi101.stdout: "client_info": { 2023-08-01T19:55:49.108 INFO:teuthology.orchestra.run.smithi101.stdout: "client": "client.4668", 2023-08-01T19:55:49.108 INFO:teuthology.orchestra.run.smithi101.stdout: "client_addr": "172.21.15.6:0/1709472247", 2023-08-01T19:55:49.108 INFO:teuthology.orchestra.run.smithi101.stdout: "tid": 100928 2023-08-01T19:55:49.108 INFO:teuthology.orchestra.run.smithi101.stdout: }, 2023-08-01T19:55:49.108 INFO:teuthology.orchestra.run.smithi101.stdout: "events": [ 2023-08-01T19:55:49.108 INFO:teuthology.orchestra.run.smithi101.stdout: { 2023-08-01T19:55:49.108 INFO:teuthology.orchestra.run.smithi101.stdout: "event": "initiated", 2023-08-01T19:55:49.109 INFO:teuthology.orchestra.run.smithi101.stdout: "time": "2023-08-01T19:55:05.564731+0000", 2023-08-01T19:55:49.109 INFO:teuthology.orchestra.run.smithi101.stdout: "duration": 0 2023-08-01T19:55:49.109 INFO:teuthology.orchestra.run.smithi101.stdout: }, 2023-08-01T19:55:49.109 INFO:teuthology.orchestra.run.smithi101.stdout: { 2023-08-01T19:55:49.109 INFO:teuthology.orchestra.run.smithi101.stdout: "event": "throttled", 2023-08-01T19:55:49.109 INFO:teuthology.orchestra.run.smithi101.stdout: "time": "2023-08-01T19:55:05.564731+0000", 2023-08-01T19:55:49.109 INFO:teuthology.orchestra.run.smithi101.stdout: "duration": 0 2023-08-01T19:55:49.110 INFO:teuthology.orchestra.run.smithi101.stdout: }, 2023-08-01T19:55:49.110 INFO:teuthology.orchestra.run.smithi101.stdout: { 2023-08-01T19:55:49.110 INFO:teuthology.orchestra.run.smithi101.stdout: "event": "header_read", 2023-08-01T19:55:49.110 INFO:teuthology.orchestra.run.smithi101.stdout: "time": "2023-08-01T19:55:05.564731+0000", 2023-08-01T19:55:49.110 INFO:teuthology.orchestra.run.smithi101.stdout: "duration": 4294967295.999999 2023-08-01T19:55:49.110 INFO:teuthology.orchestra.run.smithi101.stdout: }, 2023-08-01T19:55:49.110 INFO:teuthology.orchestra.run.smithi101.stdout: { 2023-08-01T19:55:49.110 INFO:teuthology.orchestra.run.smithi101.stdout: "event": "all_read", 2023-08-01T19:55:49.111 INFO:teuthology.orchestra.run.smithi101.stdout: "time": "2023-08-01T19:55:05.564832+0000", 2023-08-01T19:55:49.111 INFO:teuthology.orchestra.run.smithi101.stdout: "duration": 0.000101752 2023-08-01T19:55:49.111 INFO:teuthology.orchestra.run.smithi101.stdout: }, 2023-08-01T19:55:49.111 INFO:teuthology.orchestra.run.smithi101.stdout: { 2023-08-01T19:55:49.111 INFO:teuthology.orchestra.run.smithi101.stdout: "event": "dispatched", 2023-08-01T19:55:49.111 INFO:teuthology.orchestra.run.smithi101.stdout: "time": "2023-08-01T19:55:05.564840+0000", 2023-08-01T19:55:49.111 INFO:teuthology.orchestra.run.smithi101.stdout: "duration": 7.8590000000000005e-06 2023-08-01T19:55:49.111 INFO:teuthology.orchestra.run.smithi101.stdout: }, 2023-08-01T19:55:49.112 INFO:teuthology.orchestra.run.smithi101.stdout: { 2023-08-01T19:55:49.112 INFO:teuthology.orchestra.run.smithi101.stdout: "event": "queued_for_pg", 2023-08-01T19:55:49.112 INFO:teuthology.orchestra.run.smithi101.stdout: "time": "2023-08-01T19:55:05.564845+0000", 2023-08-01T19:55:49.112 INFO:teuthology.orchestra.run.smithi101.stdout: "duration": 4.9189999999999998e-06 2023-08-01T19:55:49.112 INFO:teuthology.orchestra.run.smithi101.stdout: }, 2023-08-01T19:55:49.112 INFO:teuthology.orchestra.run.smithi101.stdout: { 2023-08-01T19:55:49.112 INFO:teuthology.orchestra.run.smithi101.stdout: "event": "reached_pg", 2023-08-01T19:55:49.113 INFO:teuthology.orchestra.run.smithi101.stdout: "time": "2023-08-01T19:55:05.564883+0000", 2023-08-01T19:55:49.113 INFO:teuthology.orchestra.run.smithi101.stdout: "duration": 3.7481999999999998e-05 2023-08-01T19:55:49.113 INFO:teuthology.orchestra.run.smithi101.stdout: }, 2023-08-01T19:55:49.113 INFO:teuthology.orchestra.run.smithi101.stdout: { 2023-08-01T19:55:49.113 INFO:teuthology.orchestra.run.smithi101.stdout: "event": "started", 2023-08-01T19:55:49.113 INFO:teuthology.orchestra.run.smithi101.stdout: "time": "2023-08-01T19:55:05.564968+0000", 2023-08-01T19:55:49.113 INFO:teuthology.orchestra.run.smithi101.stdout: "duration": 8.5494999999999994e-05 2023-08-01T19:55:49.113 INFO:teuthology.orchestra.run.smithi101.stdout: }, 2023-08-01T19:55:49.114 INFO:teuthology.orchestra.run.smithi101.stdout: { 2023-08-01T19:55:49.114 INFO:teuthology.orchestra.run.smithi101.stdout: "event": "waiting for subops from 0", 2023-08-01T19:55:49.114 INFO:teuthology.orchestra.run.smithi101.stdout: "time": "2023-08-01T19:55:05.565062+0000", 2023-08-01T19:55:49.114 INFO:teuthology.orchestra.run.smithi101.stdout: "duration": 9.3478000000000002e-05 2023-08-01T19:55:49.114 INFO:teuthology.orchestra.run.smithi101.stdout: }, 2023-08-01T19:55:49.114 INFO:teuthology.orchestra.run.smithi101.stdout: { 2023-08-01T19:55:49.114 INFO:teuthology.orchestra.run.smithi101.stdout: "event": "op_commit", 2023-08-01T19:55:49.114 INFO:teuthology.orchestra.run.smithi101.stdout: "time": "2023-08-01T19:55:05.572061+0000", 2023-08-01T19:55:49.115 INFO:teuthology.orchestra.run.smithi101.stdout: "duration": 0.0069998250000000003 2023-08-01T19:55:49.115 INFO:teuthology.orchestra.run.smithi101.stdout: }, 2023-08-01T19:55:49.115 INFO:teuthology.orchestra.run.smithi101.stdout: { 2023-08-01T19:55:49.115 INFO:teuthology.orchestra.run.smithi101.stdout: "event": "sub_op_commit_rec", 2023-08-01T19:55:49.115 INFO:teuthology.orchestra.run.smithi101.stdout: "time": "2023-08-01T19:55:05.629362+0000", 2023-08-01T19:55:49.115 INFO:teuthology.orchestra.run.smithi101.stdout: "duration": 0.057300691000000001 2023-08-01T19:55:49.115 INFO:teuthology.orchestra.run.smithi101.stdout: }, 2023-08-01T19:55:49.115 INFO:teuthology.orchestra.run.smithi101.stdout: { 2023-08-01T19:55:49.116 INFO:teuthology.orchestra.run.smithi101.stdout: "event": "commit_sent", 2023-08-01T19:55:49.116 INFO:teuthology.orchestra.run.smithi101.stdout: "time": "2023-08-01T19:55:05.629395+0000", 2023-08-01T19:55:49.116 INFO:teuthology.orchestra.run.smithi101.stdout: "duration": 3.3124000000000003e-05 2023-08-01T19:55:49.116 INFO:teuthology.orchestra.run.smithi101.stdout: }, 2023-08-01T19:55:49.116 INFO:teuthology.orchestra.run.smithi101.stdout: { 2023-08-01T19:55:49.116 INFO:teuthology.orchestra.run.smithi101.stdout: "event": "done", 2023-08-01T19:55:49.116 INFO:teuthology.orchestra.run.smithi101.stdout: "time": "2023-08-01T19:55:05.629418+0000", 2023-08-01T19:55:49.117 INFO:teuthology.orchestra.run.smithi101.stdout: "duration": 2.2697999999999999e-05 2023-08-01T19:55:49.117 INFO:teuthology.orchestra.run.smithi101.stdout: } 2023-08-01T19:55:49.117 INFO:teuthology.orchestra.run.smithi101.stdout: ] 2023-08-01T19:55:49.117 INFO:teuthology.orchestra.run.smithi101.stdout: } 2023-08-01T19:55:49.117 INFO:teuthology.orchestra.run.smithi101.stdout: }, 2023-08-01T19:55:49.117 INFO:teuthology.orchestra.run.smithi101.stdout: { 2023-08-01T19:55:49.117 INFO:teuthology.orchestra.run.smithi101.stdout: "description": "osd_op(client.4668.0:100936 5.1 5:8f4e3576:::benchmark_data_smithi006_114134_object100935:head [set-alloc-hint object_size 65536 write_size 65536,write 0~65536] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e37)", 2023-08-01T19:55:49.117 INFO:teuthology.orchestra.run.smithi101.stdout: "initiated_at": "2023-08-01T19:55:05.567147+0000", 2023-08-01T19:55:49.118 INFO:teuthology.orchestra.run.smithi101.stdout: "age": 43.419361023999997, 2023-08-01T19:55:49.118 INFO:teuthology.orchestra.run.smithi101.stdout: "duration": 0.063466380000000003, 2023-08-01T19:55:49.118 INFO:teuthology.orchestra.run.smithi101.stdout: "type_data": { 2023-08-01T19:55:49.118 INFO:teuthology.orchestra.run.smithi101.stdout: "flag_point": "commit sent; apply or cleanup", 2023-08-01T19:55:49.118 INFO:teuthology.orchestra.run.smithi101.stdout: "client_info": { 2023-08-01T19:55:49.118 INFO:teuthology.orchestra.run.smithi101.stdout: "client": "client.4668", 2023-08-01T19:55:49.118 INFO:teuthology.orchestra.run.smithi101.stdout: "client_addr": "172.21.15.6:0/1709472247", 2023-08-01T19:55:49.118 INFO:teuthology.orchestra.run.smithi101.stdout: "tid": 100936 2023-08-01T19:55:49.119 INFO:teuthology.orchestra.run.smithi101.stdout: }, 2023-08-01T19:55:49.119 INFO:teuthology.orchestra.run.smithi101.stdout: "events": [ 2023-08-01T19:55:49.119 INFO:teuthology.orchestra.run.smithi101.stdout: { 2023-08-01T19:55:49.119 INFO:teuthology.orchestra.run.smithi101.stdout: "event": "initiated", 2023-08-01T19:55:49.119 INFO:teuthology.orchestra.run.smithi101.stdout: "time": "2023-08-01T19:55:05.567147+0000", 2023-08-01T19:55:49.119 INFO:teuthology.orchestra.run.smithi101.stdout: "duration": 0 2023-08-01T19:55:49.119 INFO:teuthology.orchestra.run.smithi101.stdout: }, 2023-08-01T19:55:49.119 INFO:teuthology.orchestra.run.smithi101.stdout: { 2023-08-01T19:55:49.120 INFO:teuthology.orchestra.run.smithi101.stdout: "event": "throttled", 2023-08-01T19:55:49.120 INFO:teuthology.orchestra.run.smithi101.stdout: "time": "2023-08-01T19:55:05.567147+0000", 2023-08-01T19:55:49.120 INFO:teuthology.orchestra.run.smithi101.stdout: "duration": 0 2023-08-01T19:55:49.120 INFO:teuthology.orchestra.run.smithi101.stdout: }, 2023-08-01T19:55:49.120 INFO:teuthology.orchestra.run.smithi101.stdout: { 2023-08-01T19:55:49.120 INFO:teuthology.orchestra.run.smithi101.stdout: "event": "header_read", 2023-08-01T19:55:49.120 INFO:teuthology.orchestra.run.smithi101.stdout: "time": "2023-08-01T19:55:05.567146+0000", 2023-08-01T19:55:49.120 INFO:teuthology.orchestra.run.smithi101.stdout: "duration": 4294967295.999999 2023-08-01T19:55:49.121 INFO:teuthology.orchestra.run.smithi101.stdout: }, 2023-08-01T19:55:49.121 INFO:teuthology.orchestra.run.smithi101.stdout: { 2023-08-01T19:55:49.121 INFO:teuthology.orchestra.run.smithi101.stdout: "event": "all_read", 2023-08-01T19:55:49.121 INFO:teuthology.orchestra.run.smithi101.stdout: "time": "2023-08-01T19:55:05.567224+0000", 2023-08-01T19:55:49.121 INFO:teuthology.orchestra.run.smithi101.stdout: "duration": 7.8460000000000004e-05 2023-08-01T19:55:49.121 INFO:teuthology.orchestra.run.smithi101.stdout: }, 2023-08-01T19:55:49.121 INFO:teuthology.orchestra.run.smithi101.stdout: { 2023-08-01T19:55:49.122 INFO:teuthology.orchestra.run.smithi101.stdout: "event": "dispatched", 2023-08-01T19:55:49.122 INFO:teuthology.orchestra.run.smithi101.stdout: "time": "2023-08-01T19:55:05.567234+0000", 2023-08-01T19:55:49.122 INFO:teuthology.orchestra.run.smithi101.stdout: "duration": 9.7110000000000007e-06 2023-08-01T19:55:49.122 INFO:teuthology.orchestra.run.smithi101.stdout: }, 2023-08-01T19:55:49.122 INFO:teuthology.orchestra.run.smithi101.stdout: { 2023-08-01T19:55:49.122 INFO:teuthology.orchestra.run.smithi101.stdout: "event": "queued_for_pg", 2023-08-01T19:55:49.122 INFO:teuthology.orchestra.run.smithi101.stdout: "time": "2023-08-01T19:55:05.567239+0000", 2023-08-01T19:55:49.122 INFO:teuthology.orchestra.run.smithi101.stdout: "duration": 5.237e-06 2023-08-01T19:55:49.123 INFO:teuthology.orchestra.run.smithi101.stdout: }, 2023-08-01T19:55:49.123 INFO:teuthology.orchestra.run.smithi101.stdout: { 2023-08-01T19:55:49.123 INFO:teuthology.orchestra.run.smithi101.stdout: "event": "reached_pg", 2023-08-01T19:55:49.123 INFO:teuthology.orchestra.run.smithi101.stdout: "time": "2023-08-01T19:55:05.567278+0000", 2023-08-01T19:55:49.123 INFO:teuthology.orchestra.run.smithi101.stdout: "duration": 3.9069999999999997e-05 2023-08-01T19:55:49.123 INFO:teuthology.orchestra.run.smithi101.stdout: }, 2023-08-01T19:55:49.123 INFO:teuthology.orchestra.run.smithi101.stdout: { 2023-08-01T19:55:49.123 INFO:teuthology.orchestra.run.smithi101.stdout: "event": "started", 2023-08-01T19:55:49.124 INFO:teuthology.orchestra.run.smithi101.stdout: "time": "2023-08-01T19:55:05.567402+0000", 2023-08-01T19:55:49.124 INFO:teuthology.orchestra.run.smithi101.stdout: "duration": 0.00012348700000000001 2023-08-01T19:55:49.124 INFO:teuthology.orchestra.run.smithi101.stdout: }, 2023-08-01T19:55:49.124 INFO:teuthology.orchestra.run.smithi101.stdout: { 2023-08-01T19:55:49.124 INFO:teuthology.orchestra.run.smithi101.stdout: "event": "waiting for subops from 0", 2023-08-01T19:55:49.124 INFO:teuthology.orchestra.run.smithi101.stdout: "time": "2023-08-01T19:55:05.567558+0000", 2023-08-01T19:55:49.124 INFO:teuthology.orchestra.run.smithi101.stdout: "duration": 0.000156179 2023-08-01T19:55:49.124 INFO:teuthology.orchestra.run.smithi101.stdout: }, 2023-08-01T19:55:49.125 INFO:teuthology.orchestra.run.smithi101.stdout: { 2023-08-01T19:55:49.125 INFO:teuthology.orchestra.run.smithi101.stdout: "event": "op_commit", 2023-08-01T19:55:49.125 INFO:teuthology.orchestra.run.smithi101.stdout: "time": "2023-08-01T19:55:05.573767+0000", 2023-08-01T19:55:49.125 INFO:teuthology.orchestra.run.smithi101.stdout: "duration": 0.0062092409999999999 2023-08-01T19:55:49.125 INFO:teuthology.orchestra.run.smithi101.stdout: }, 2023-08-01T19:55:49.125 INFO:teuthology.orchestra.run.smithi101.stdout: { 2023-08-01T19:55:49.125 INFO:teuthology.orchestra.run.smithi101.stdout: "event": "sub_op_commit_rec", 2023-08-01T19:55:49.125 INFO:teuthology.orchestra.run.smithi101.stdout: "time": "2023-08-01T19:55:05.630531+0000", 2023-08-01T19:55:49.126 INFO:teuthology.orchestra.run.smithi101.stdout: "duration": 0.056763409000000001 2023-08-01T19:55:49.126 INFO:teuthology.orchestra.run.smithi101.stdout: }, 2023-08-01T19:55:49.126 INFO:teuthology.orchestra.run.smithi101.stdout: { 2023-08-01T19:55:49.126 INFO:teuthology.orchestra.run.smithi101.stdout: "event": "commit_sent", 2023-08-01T19:55:49.126 INFO:teuthology.orchestra.run.smithi101.stdout: "time": "2023-08-01T19:55:05.630577+0000", 2023-08-01T19:55:49.126 INFO:teuthology.orchestra.run.smithi101.stdout: "duration": 4.6588000000000002e-05 2023-08-01T19:55:49.126 INFO:teuthology.orchestra.run.smithi101.stdout: }, 2023-08-01T19:55:49.126 INFO:teuthology.orchestra.run.smithi101.stdout: { 2023-08-01T19:55:49.127 INFO:teuthology.orchestra.run.smithi101.stdout: "event": "done", 2023-08-01T19:55:49.127 INFO:teuthology.orchestra.run.smithi101.stdout: "time": "2023-08-01T19:55:05.630613+0000", 2023-08-01T19:55:49.127 INFO:teuthology.orchestra.run.smithi101.stdout: "duration": 3.5802e-05 2023-08-01T19:55:49.127 INFO:teuthology.orchestra.run.smithi101.stdout: } 2023-08-01T19:55:49.127 INFO:teuthology.orchestra.run.smithi101.stdout: ] 2023-08-01T19:55:49.127 INFO:teuthology.orchestra.run.smithi101.stdout: } 2023-08-01T19:55:49.127 INFO:teuthology.orchestra.run.smithi101.stdout: }, 2023-08-01T19:55:49.128 INFO:teuthology.orchestra.run.smithi101.stdout: { 2023-08-01T19:55:49.128 INFO:teuthology.orchestra.run.smithi101.stdout: "description": "osd_op(client.4668.0:100943 5.7 5:e01743fe:::benchmark_data_smithi006_114134_object100942:head [set-alloc-hint object_size 65536 write_size 65536,write 0~65536] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e37)", 2023-08-01T19:55:49.128 INFO:teuthology.orchestra.run.smithi101.stdout: "initiated_at": "2023-08-01T19:55:05.574724+0000", 2023-08-01T19:55:49.128 INFO:teuthology.orchestra.run.smithi101.stdout: "age": 43.411783931000002, 2023-08-01T19:55:49.128 INFO:teuthology.orchestra.run.smithi101.stdout: "duration": 0.058761188999999998, 2023-08-01T19:55:49.128 INFO:teuthology.orchestra.run.smithi101.stdout: "type_data": { 2023-08-01T19:55:49.128 INFO:teuthology.orchestra.run.smithi101.stdout: "flag_point": "commit sent; apply or cleanup", 2023-08-01T19:55:49.128 INFO:teuthology.orchestra.run.smithi101.stdout: "client_info": { 2023-08-01T19:55:49.129 INFO:teuthology.orchestra.run.smithi101.stdout: "client": "client.4668", 2023-08-01T19:55:49.129 INFO:teuthology.orchestra.run.smithi101.stdout: "client_addr": "172.21.15.6:0/1709472247", 2023-08-01T19:55:49.129 INFO:teuthology.orchestra.run.smithi101.stdout: "tid": 100943 2023-08-01T19:55:49.129 INFO:teuthology.orchestra.run.smithi101.stdout: }, 2023-08-01T19:55:49.129 INFO:teuthology.orchestra.run.smithi101.stdout: "events": [ 2023-08-01T19:55:49.129 INFO:teuthology.orchestra.run.smithi101.stdout: { 2023-08-01T19:55:49.129 INFO:teuthology.orchestra.run.smithi101.stdout: "event": "initiated", 2023-08-01T19:55:49.129 INFO:teuthology.orchestra.run.smithi101.stdout: "time": "2023-08-01T19:55:05.574724+0000", 2023-08-01T19:55:49.130 INFO:teuthology.orchestra.run.smithi101.stdout: "duration": 0 2023-08-01T19:55:49.130 INFO:teuthology.orchestra.run.smithi101.stdout: }, 2023-08-01T19:55:49.130 INFO:teuthology.orchestra.run.smithi101.stdout: { 2023-08-01T19:55:49.130 INFO:teuthology.orchestra.run.smithi101.stdout: "event": "throttled", 2023-08-01T19:55:49.130 INFO:teuthology.orchestra.run.smithi101.stdout: "time": "2023-08-01T19:55:05.574724+0000", 2023-08-01T19:55:49.130 INFO:teuthology.orchestra.run.smithi101.stdout: "duration": 0 2023-08-01T19:55:49.130 INFO:teuthology.orchestra.run.smithi101.stdout: }, 2023-08-01T19:55:49.131 INFO:teuthology.orchestra.run.smithi101.stdout: { 2023-08-01T19:55:49.131 INFO:teuthology.orchestra.run.smithi101.stdout: "event": "header_read", 2023-08-01T19:55:49.131 INFO:teuthology.orchestra.run.smithi101.stdout: "time": "2023-08-01T19:55:05.574723+0000", 2023-08-01T19:55:49.131 INFO:teuthology.orchestra.run.smithi101.stdout: "duration": 4294967295.999999 2023-08-01T19:55:49.131 INFO:teuthology.orchestra.run.smithi101.stdout: }, 2023-08-01T19:55:49.131 INFO:teuthology.orchestra.run.smithi101.stdout: { 2023-08-01T19:55:49.131 INFO:teuthology.orchestra.run.smithi101.stdout: "event": "all_read", 2023-08-01T19:55:49.131 INFO:teuthology.orchestra.run.smithi101.stdout: "time": "2023-08-01T19:55:05.574773+0000", 2023-08-01T19:55:49.132 INFO:teuthology.orchestra.run.smithi101.stdout: "duration": 4.9469999999999999e-05 2023-08-01T19:55:49.132 INFO:teuthology.orchestra.run.smithi101.stdout: }, 2023-08-01T19:55:49.132 INFO:teuthology.orchestra.run.smithi101.stdout: { 2023-08-01T19:55:49.132 INFO:teuthology.orchestra.run.smithi101.stdout: "event": "dispatched", 2023-08-01T19:55:49.132 INFO:teuthology.orchestra.run.smithi101.stdout: "time": "2023-08-01T19:55:05.574780+0000", 2023-08-01T19:55:49.132 INFO:teuthology.orchestra.run.smithi101.stdout: "duration": 7.5059999999999998e-06 2023-08-01T19:55:49.132 INFO:teuthology.orchestra.run.smithi101.stdout: }, 2023-08-01T19:55:49.133 INFO:teuthology.orchestra.run.smithi101.stdout: { 2023-08-01T19:55:49.133 INFO:teuthology.orchestra.run.smithi101.stdout: "event": "queued_for_pg", 2023-08-01T19:55:49.133 INFO:teuthology.orchestra.run.smithi101.stdout: "time": "2023-08-01T19:55:05.574784+0000", 2023-08-01T19:55:49.133 INFO:teuthology.orchestra.run.smithi101.stdout: "duration": 3.5540000000000002e-06 2023-08-01T19:55:49.133 INFO:teuthology.orchestra.run.smithi101.stdout: }, 2023-08-01T19:55:49.133 INFO:teuthology.orchestra.run.smithi101.stdout: { 2023-08-01T19:55:49.133 INFO:teuthology.orchestra.run.smithi101.stdout: "event": "reached_pg", 2023-08-01T19:55:49.133 INFO:teuthology.orchestra.run.smithi101.stdout: "time": "2023-08-01T19:55:05.574805+0000", 2023-08-01T19:55:49.134 INFO:teuthology.orchestra.run.smithi101.stdout: "duration": 2.1257999999999999e-05 2023-08-01T19:55:49.134 INFO:teuthology.orchestra.run.smithi101.stdout: }, 2023-08-01T19:55:49.134 INFO:teuthology.orchestra.run.smithi101.stdout: { 2023-08-01T19:55:49.134 INFO:teuthology.orchestra.run.smithi101.stdout: "event": "started", 2023-08-01T19:55:49.134 INFO:teuthology.orchestra.run.smithi101.stdout: "time": "2023-08-01T19:55:05.574886+0000", 2023-08-01T19:55:49.134 INFO:teuthology.orchestra.run.smithi101.stdout: "duration": 8.1545999999999995e-05 2023-08-01T19:55:49.134 INFO:teuthology.orchestra.run.smithi101.stdout: }, 2023-08-01T19:55:49.134 INFO:teuthology.orchestra.run.smithi101.stdout: { 2023-08-01T19:55:49.135 INFO:teuthology.orchestra.run.smithi101.stdout: "event": "waiting for subops from 0", 2023-08-01T19:55:49.135 INFO:teuthology.orchestra.run.smithi101.stdout: "time": "2023-08-01T19:55:05.574973+0000", 2023-08-01T19:55:49.135 INFO:teuthology.orchestra.run.smithi101.stdout: "duration": 8.6998999999999998e-05 2023-08-01T19:55:49.135 INFO:teuthology.orchestra.run.smithi101.stdout: }, 2023-08-01T19:55:49.135 INFO:teuthology.orchestra.run.smithi101.stdout: { 2023-08-01T19:55:49.135 INFO:teuthology.orchestra.run.smithi101.stdout: "event": "op_commit", 2023-08-01T19:55:49.135 INFO:teuthology.orchestra.run.smithi101.stdout: "time": "2023-08-01T19:55:05.581580+0000", 2023-08-01T19:55:49.135 INFO:teuthology.orchestra.run.smithi101.stdout: "duration": 0.0066068790000000004 2023-08-01T19:55:49.136 INFO:teuthology.orchestra.run.smithi101.stdout: }, 2023-08-01T19:55:49.136 INFO:teuthology.orchestra.run.smithi101.stdout: { 2023-08-01T19:55:49.136 INFO:teuthology.orchestra.run.smithi101.stdout: "event": "sub_op_commit_rec", 2023-08-01T19:55:49.136 INFO:teuthology.orchestra.run.smithi101.stdout: "time": "2023-08-01T19:55:05.633422+0000", 2023-08-01T19:55:49.136 INFO:teuthology.orchestra.run.smithi101.stdout: "duration": 0.051841992000000003 2023-08-01T19:55:49.136 INFO:teuthology.orchestra.run.smithi101.stdout: }, 2023-08-01T19:55:49.136 INFO:teuthology.orchestra.run.smithi101.stdout: { 2023-08-01T19:55:49.137 INFO:teuthology.orchestra.run.smithi101.stdout: "event": "commit_sent", 2023-08-01T19:55:49.137 INFO:teuthology.orchestra.run.smithi101.stdout: "time": "2023-08-01T19:55:05.633461+0000", 2023-08-01T19:55:49.137 INFO:teuthology.orchestra.run.smithi101.stdout: "duration": 3.8330000000000001e-05 2023-08-01T19:55:49.137 INFO:teuthology.orchestra.run.smithi101.stdout: }, 2023-08-01T19:55:49.137 INFO:teuthology.orchestra.run.smithi101.stdout: { 2023-08-01T19:55:49.137 INFO:teuthology.orchestra.run.smithi101.stdout: "event": "done", 2023-08-01T19:55:49.137 INFO:teuthology.orchestra.run.smithi101.stdout: "time": "2023-08-01T19:55:05.633485+0000", 2023-08-01T19:55:49.137 INFO:teuthology.orchestra.run.smithi101.stdout: "duration": 2.4451e-05 2023-08-01T19:55:49.138 INFO:teuthology.orchestra.run.smithi101.stdout: } 2023-08-01T19:55:49.138 INFO:teuthology.orchestra.run.smithi101.stdout: ] 2023-08-01T19:55:49.138 INFO:teuthology.orchestra.run.smithi101.stdout: } 2023-08-01T19:55:49.138 INFO:teuthology.orchestra.run.smithi101.stdout: }, 2023-08-01T19:55:49.138 INFO:teuthology.orchestra.run.smithi101.stdout: { 2023-08-01T19:55:49.138 INFO:teuthology.orchestra.run.smithi101.stdout: "description": "osd_op(client.4668.0:107866 5.f 5:ffcbf9c4:::benchmark_data_smithi006_114134_object107865:head [set-alloc-hint object_size 65536 write_size 65536,write 0~65536] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e38)", 2023-08-01T19:55:49.138 INFO:teuthology.orchestra.run.smithi101.stdout: "initiated_at": "2023-08-01T19:55:09.280625+0000", 2023-08-01T19:55:49.138 INFO:teuthology.orchestra.run.smithi101.stdout: "age": 39.705882592999998, 2023-08-01T19:55:49.139 INFO:teuthology.orchestra.run.smithi101.stdout: "duration": 0.069869799999999996, 2023-08-01T19:55:49.139 INFO:teuthology.orchestra.run.smithi101.stdout: "type_data": { 2023-08-01T19:55:49.139 INFO:teuthology.orchestra.run.smithi101.stdout: "flag_point": "commit sent; apply or cleanup", 2023-08-01T19:55:49.139 INFO:teuthology.orchestra.run.smithi101.stdout: "client_info": { 2023-08-01T19:55:49.139 INFO:teuthology.orchestra.run.smithi101.stdout: "client": "client.4668", 2023-08-01T19:55:49.139 INFO:teuthology.orchestra.run.smithi101.stdout: "client_addr": "172.21.15.6:0/1709472247", 2023-08-01T19:55:49.139 INFO:teuthology.orchestra.run.smithi101.stdout: "tid": 107866 2023-08-01T19:55:49.140 INFO:teuthology.orchestra.run.smithi101.stdout: }, 2023-08-01T19:55:49.140 INFO:teuthology.orchestra.run.smithi101.stdout: "events": [ 2023-08-01T19:55:49.140 INFO:teuthology.orchestra.run.smithi101.stdout: { 2023-08-01T19:55:49.140 INFO:teuthology.orchestra.run.smithi101.stdout: "event": "initiated", 2023-08-01T19:55:49.140 INFO:teuthology.orchestra.run.smithi101.stdout: "time": "2023-08-01T19:55:09.280625+0000", 2023-08-01T19:55:49.140 INFO:teuthology.orchestra.run.smithi101.stdout: "duration": 0 2023-08-01T19:55:49.140 INFO:teuthology.orchestra.run.smithi101.stdout: }, 2023-08-01T19:55:49.140 INFO:teuthology.orchestra.run.smithi101.stdout: { 2023-08-01T19:55:49.141 INFO:teuthology.orchestra.run.smithi101.stdout: "event": "throttled", 2023-08-01T19:55:49.141 INFO:teuthology.orchestra.run.smithi101.stdout: "time": "2023-08-01T19:55:09.280625+0000", 2023-08-01T19:55:49.141 INFO:teuthology.orchestra.run.smithi101.stdout: "duration": 0 2023-08-01T19:55:49.141 INFO:teuthology.orchestra.run.smithi101.stdout: }, 2023-08-01T19:55:49.141 INFO:teuthology.orchestra.run.smithi101.stdout: { 2023-08-01T19:55:49.141 INFO:teuthology.orchestra.run.smithi101.stdout: "event": "header_read", 2023-08-01T19:55:49.141 INFO:teuthology.orchestra.run.smithi101.stdout: "time": "2023-08-01T19:55:09.280624+0000", 2023-08-01T19:55:49.142 INFO:teuthology.orchestra.run.smithi101.stdout: "duration": 4294967295.999999 2023-08-01T19:55:49.142 INFO:teuthology.orchestra.run.smithi101.stdout: }, 2023-08-01T19:55:49.142 INFO:teuthology.orchestra.run.smithi101.stdout: { 2023-08-01T19:55:49.142 INFO:teuthology.orchestra.run.smithi101.stdout: "event": "all_read", 2023-08-01T19:55:49.142 INFO:teuthology.orchestra.run.smithi101.stdout: "time": "2023-08-01T19:55:09.280648+0000", 2023-08-01T19:55:49.142 INFO:teuthology.orchestra.run.smithi101.stdout: "duration": 2.3521999999999999e-05 2023-08-01T19:55:49.142 INFO:teuthology.orchestra.run.smithi101.stdout: }, 2023-08-01T19:55:49.142 INFO:teuthology.orchestra.run.smithi101.stdout: { 2023-08-01T19:55:49.143 INFO:teuthology.orchestra.run.smithi101.stdout: "event": "dispatched", 2023-08-01T19:55:49.143 INFO:teuthology.orchestra.run.smithi101.stdout: "time": "2023-08-01T19:55:09.280658+0000", 2023-08-01T19:55:49.143 INFO:teuthology.orchestra.run.smithi101.stdout: "duration": 9.8660000000000001e-06 2023-08-01T19:55:49.143 INFO:teuthology.orchestra.run.smithi101.stdout: }, 2023-08-01T19:55:49.143 INFO:teuthology.orchestra.run.smithi101.stdout: { 2023-08-01T19:55:49.143 INFO:teuthology.orchestra.run.smithi101.stdout: "event": "queued_for_pg", 2023-08-01T19:55:49.143 INFO:teuthology.orchestra.run.smithi101.stdout: "time": "2023-08-01T19:55:09.280663+0000", 2023-08-01T19:55:49.143 INFO:teuthology.orchestra.run.smithi101.stdout: "duration": 4.8369999999999996e-06 2023-08-01T19:55:49.144 INFO:teuthology.orchestra.run.smithi101.stdout: }, 2023-08-01T19:55:49.144 INFO:teuthology.orchestra.run.smithi101.stdout: { 2023-08-01T19:55:49.144 INFO:teuthology.orchestra.run.smithi101.stdout: "event": "reached_pg", 2023-08-01T19:55:49.144 INFO:teuthology.orchestra.run.smithi101.stdout: "time": "2023-08-01T19:55:09.280690+0000", 2023-08-01T19:55:49.144 INFO:teuthology.orchestra.run.smithi101.stdout: "duration": 2.7534000000000001e-05 2023-08-01T19:55:49.144 INFO:teuthology.orchestra.run.smithi101.stdout: }, 2023-08-01T19:55:49.144 INFO:teuthology.orchestra.run.smithi101.stdout: { 2023-08-01T19:55:49.144 INFO:teuthology.orchestra.run.smithi101.stdout: "event": "started", 2023-08-01T19:55:49.145 INFO:teuthology.orchestra.run.smithi101.stdout: "time": "2023-08-01T19:55:09.280825+0000", 2023-08-01T19:55:49.145 INFO:teuthology.orchestra.run.smithi101.stdout: "duration": 0.000135399 2023-08-01T19:55:49.145 INFO:teuthology.orchestra.run.smithi101.stdout: }, 2023-08-01T19:55:49.145 INFO:teuthology.orchestra.run.smithi101.stdout: { 2023-08-01T19:55:49.145 INFO:teuthology.orchestra.run.smithi101.stdout: "event": "waiting for subops from 2", 2023-08-01T19:55:49.145 INFO:teuthology.orchestra.run.smithi101.stdout: "time": "2023-08-01T19:55:09.280929+0000", 2023-08-01T19:55:49.145 INFO:teuthology.orchestra.run.smithi101.stdout: "duration": 0.000103328 2023-08-01T19:55:49.145 INFO:teuthology.orchestra.run.smithi101.stdout: }, 2023-08-01T19:55:49.146 INFO:teuthology.orchestra.run.smithi101.stdout: { 2023-08-01T19:55:49.146 INFO:teuthology.orchestra.run.smithi101.stdout: "event": "sub_op_commit_rec", 2023-08-01T19:55:49.146 INFO:teuthology.orchestra.run.smithi101.stdout: "time": "2023-08-01T19:55:09.348321+0000", 2023-08-01T19:55:49.146 INFO:teuthology.orchestra.run.smithi101.stdout: "duration": 0.067392176999999998 2023-08-01T19:55:49.146 INFO:teuthology.orchestra.run.smithi101.stdout: }, 2023-08-01T19:55:49.146 INFO:teuthology.orchestra.run.smithi101.stdout: { 2023-08-01T19:55:49.146 INFO:teuthology.orchestra.run.smithi101.stdout: "event": "op_commit", 2023-08-01T19:55:49.146 INFO:teuthology.orchestra.run.smithi101.stdout: "time": "2023-08-01T19:55:09.350431+0000", 2023-08-01T19:55:49.147 INFO:teuthology.orchestra.run.smithi101.stdout: "duration": 0.0021096980000000001 2023-08-01T19:55:49.147 INFO:teuthology.orchestra.run.smithi101.stdout: }, 2023-08-01T19:55:49.147 INFO:teuthology.orchestra.run.smithi101.stdout: { 2023-08-01T19:55:49.147 INFO:teuthology.orchestra.run.smithi101.stdout: "event": "commit_sent", 2023-08-01T19:55:49.147 INFO:teuthology.orchestra.run.smithi101.stdout: "time": "2023-08-01T19:55:09.350469+0000", 2023-08-01T19:55:49.147 INFO:teuthology.orchestra.run.smithi101.stdout: "duration": 3.8625999999999999e-05 2023-08-01T19:55:49.147 INFO:teuthology.orchestra.run.smithi101.stdout: }, 2023-08-01T19:55:49.148 INFO:teuthology.orchestra.run.smithi101.stdout: { 2023-08-01T19:55:49.148 INFO:teuthology.orchestra.run.smithi101.stdout: "event": "done", 2023-08-01T19:55:49.148 INFO:teuthology.orchestra.run.smithi101.stdout: "time": "2023-08-01T19:55:09.350495+0000", 2023-08-01T19:55:49.148 INFO:teuthology.orchestra.run.smithi101.stdout: "duration": 2.5698999999999999e-05 2023-08-01T19:55:49.148 INFO:teuthology.orchestra.run.smithi101.stdout: } 2023-08-01T19:55:49.148 INFO:teuthology.orchestra.run.smithi101.stdout: ] 2023-08-01T19:55:49.148 INFO:teuthology.orchestra.run.smithi101.stdout: } 2023-08-01T19:55:49.148 INFO:teuthology.orchestra.run.smithi101.stdout: }, 2023-08-01T19:55:49.149 INFO:teuthology.orchestra.run.smithi101.stdout: { 2023-08-01T19:55:49.149 INFO:teuthology.orchestra.run.smithi101.stdout: "description": "osd_op(client.4668.0:107867 5.f 5:ff29bbf7:::benchmark_data_smithi006_114134_object107866:head [set-alloc-hint object_size 65536 write_size 65536,write 0~65536] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e38)", 2023-08-01T19:55:49.149 INFO:teuthology.orchestra.run.smithi101.stdout: "initiated_at": "2023-08-01T19:55:09.280670+0000", 2023-08-01T19:55:49.149 INFO:teuthology.orchestra.run.smithi101.stdout: "age": 39.705837658999997, 2023-08-01T19:55:49.149 INFO:teuthology.orchestra.run.smithi101.stdout: "duration": 0.069898092999999994, 2023-08-01T19:55:49.149 INFO:teuthology.orchestra.run.smithi101.stdout: "type_data": { 2023-08-01T19:55:49.149 INFO:teuthology.orchestra.run.smithi101.stdout: "flag_point": "commit sent; apply or cleanup", 2023-08-01T19:55:49.149 INFO:teuthology.orchestra.run.smithi101.stdout: "client_info": { 2023-08-01T19:55:49.150 INFO:teuthology.orchestra.run.smithi101.stdout: "client": "client.4668", 2023-08-01T19:55:49.150 INFO:teuthology.orchestra.run.smithi101.stdout: "client_addr": "172.21.15.6:0/1709472247", 2023-08-01T19:55:49.150 INFO:teuthology.orchestra.run.smithi101.stdout: "tid": 107867 2023-08-01T19:55:49.150 INFO:teuthology.orchestra.run.smithi101.stdout: }, 2023-08-01T19:55:49.150 INFO:teuthology.orchestra.run.smithi101.stdout: "events": [ 2023-08-01T19:55:49.150 INFO:teuthology.orchestra.run.smithi101.stdout: { 2023-08-01T19:55:49.150 INFO:teuthology.orchestra.run.smithi101.stdout: "event": "initiated", 2023-08-01T19:55:49.150 INFO:teuthology.orchestra.run.smithi101.stdout: "time": "2023-08-01T19:55:09.280670+0000", 2023-08-01T19:55:49.151 INFO:teuthology.orchestra.run.smithi101.stdout: "duration": 0 2023-08-01T19:55:49.151 INFO:teuthology.orchestra.run.smithi101.stdout: }, 2023-08-01T19:55:49.151 INFO:teuthology.orchestra.run.smithi101.stdout: { 2023-08-01T19:55:49.151 INFO:teuthology.orchestra.run.smithi101.stdout: "event": "throttled", 2023-08-01T19:55:49.151 INFO:teuthology.orchestra.run.smithi101.stdout: "time": "2023-08-01T19:55:09.280670+0000", 2023-08-01T19:55:49.151 INFO:teuthology.orchestra.run.smithi101.stdout: "duration": 0 2023-08-01T19:55:49.151 INFO:teuthology.orchestra.run.smithi101.stdout: }, 2023-08-01T19:55:49.151 INFO:teuthology.orchestra.run.smithi101.stdout: { 2023-08-01T19:55:49.152 INFO:teuthology.orchestra.run.smithi101.stdout: "event": "header_read", 2023-08-01T19:55:49.152 INFO:teuthology.orchestra.run.smithi101.stdout: "time": "2023-08-01T19:55:09.280670+0000", 2023-08-01T19:55:49.152 INFO:teuthology.orchestra.run.smithi101.stdout: "duration": 4294967295.9999995 2023-08-01T19:55:49.152 INFO:teuthology.orchestra.run.smithi101.stdout: }, 2023-08-01T19:55:49.152 INFO:teuthology.orchestra.run.smithi101.stdout: { 2023-08-01T19:55:49.152 INFO:teuthology.orchestra.run.smithi101.stdout: "event": "all_read", 2023-08-01T19:55:49.152 INFO:teuthology.orchestra.run.smithi101.stdout: "time": "2023-08-01T19:55:09.280690+0000", 2023-08-01T19:55:49.153 INFO:teuthology.orchestra.run.smithi101.stdout: "duration": 2.0526e-05 2023-08-01T19:55:49.153 INFO:teuthology.orchestra.run.smithi101.stdout: }, 2023-08-01T19:55:49.153 INFO:teuthology.orchestra.run.smithi101.stdout: { 2023-08-01T19:55:49.153 INFO:teuthology.orchestra.run.smithi101.stdout: "event": "dispatched", 2023-08-01T19:55:49.153 INFO:teuthology.orchestra.run.smithi101.stdout: "time": "2023-08-01T19:55:09.280695+0000", 2023-08-01T19:55:49.153 INFO:teuthology.orchestra.run.smithi101.stdout: "duration": 4.5140000000000003e-06 2023-08-01T19:55:49.153 INFO:teuthology.orchestra.run.smithi101.stdout: }, 2023-08-01T19:55:49.153 INFO:teuthology.orchestra.run.smithi101.stdout: { 2023-08-01T19:55:49.154 INFO:teuthology.orchestra.run.smithi101.stdout: "event": "queued_for_pg", 2023-08-01T19:55:49.154 INFO:teuthology.orchestra.run.smithi101.stdout: "time": "2023-08-01T19:55:09.280697+0000", 2023-08-01T19:55:49.154 INFO:teuthology.orchestra.run.smithi101.stdout: "duration": 2.6290000000000002e-06 2023-08-01T19:55:49.154 INFO:teuthology.orchestra.run.smithi101.stdout: }, 2023-08-01T19:55:49.154 INFO:teuthology.orchestra.run.smithi101.stdout: { 2023-08-01T19:55:49.154 INFO:teuthology.orchestra.run.smithi101.stdout: "event": "reached_pg", 2023-08-01T19:55:49.154 INFO:teuthology.orchestra.run.smithi101.stdout: "time": "2023-08-01T19:55:09.282392+0000", 2023-08-01T19:55:49.154 INFO:teuthology.orchestra.run.smithi101.stdout: "duration": 0.0016948709999999999 2023-08-01T19:55:49.155 INFO:teuthology.orchestra.run.smithi101.stdout: }, 2023-08-01T19:55:49.155 INFO:teuthology.orchestra.run.smithi101.stdout: { 2023-08-01T19:55:49.155 INFO:teuthology.orchestra.run.smithi101.stdout: "event": "started", 2023-08-01T19:55:49.155 INFO:teuthology.orchestra.run.smithi101.stdout: "time": "2023-08-01T19:55:09.282514+0000", 2023-08-01T19:55:49.155 INFO:teuthology.orchestra.run.smithi101.stdout: "duration": 0.000121839 2023-08-01T19:55:49.155 INFO:teuthology.orchestra.run.smithi101.stdout: }, 2023-08-01T19:55:49.155 INFO:teuthology.orchestra.run.smithi101.stdout: { 2023-08-01T19:55:49.155 INFO:teuthology.orchestra.run.smithi101.stdout: "event": "waiting for subops from 2", 2023-08-01T19:55:49.156 INFO:teuthology.orchestra.run.smithi101.stdout: "time": "2023-08-01T19:55:09.282664+0000", 2023-08-01T19:55:49.156 INFO:teuthology.orchestra.run.smithi101.stdout: "duration": 0.00014968699999999999 2023-08-01T19:55:49.156 INFO:teuthology.orchestra.run.smithi101.stdout: }, 2023-08-01T19:55:49.156 INFO:teuthology.orchestra.run.smithi101.stdout: { 2023-08-01T19:55:49.156 INFO:teuthology.orchestra.run.smithi101.stdout: "event": "sub_op_commit_rec", 2023-08-01T19:55:49.156 INFO:teuthology.orchestra.run.smithi101.stdout: "time": "2023-08-01T19:55:09.348344+0000", 2023-08-01T19:55:49.156 INFO:teuthology.orchestra.run.smithi101.stdout: "duration": 0.065680247999999997 2023-08-01T19:55:49.156 INFO:teuthology.orchestra.run.smithi101.stdout: }, 2023-08-01T19:55:49.157 INFO:teuthology.orchestra.run.smithi101.stdout: { 2023-08-01T19:55:49.157 INFO:teuthology.orchestra.run.smithi101.stdout: "event": "op_commit", 2023-08-01T19:55:49.157 INFO:teuthology.orchestra.run.smithi101.stdout: "time": "2023-08-01T19:55:09.350502+0000", 2023-08-01T19:55:49.157 INFO:teuthology.orchestra.run.smithi101.stdout: "duration": 0.0021578140000000001 2023-08-01T19:55:49.157 INFO:teuthology.orchestra.run.smithi101.stdout: }, 2023-08-01T19:55:49.157 INFO:teuthology.orchestra.run.smithi101.stdout: { 2023-08-01T19:55:49.157 INFO:teuthology.orchestra.run.smithi101.stdout: "event": "commit_sent", 2023-08-01T19:55:49.158 INFO:teuthology.orchestra.run.smithi101.stdout: "time": "2023-08-01T19:55:09.350529+0000", 2023-08-01T19:55:49.158 INFO:teuthology.orchestra.run.smithi101.stdout: "duration": 2.6838e-05 2023-08-01T19:55:49.158 INFO:teuthology.orchestra.run.smithi101.stdout: }, 2023-08-01T19:55:49.158 INFO:teuthology.orchestra.run.smithi101.stdout: { 2023-08-01T19:55:49.158 INFO:teuthology.orchestra.run.smithi101.stdout: "event": "done", 2023-08-01T19:55:49.158 INFO:teuthology.orchestra.run.smithi101.stdout: "time": "2023-08-01T19:55:09.350568+0000", 2023-08-01T19:55:49.158 INFO:teuthology.orchestra.run.smithi101.stdout: "duration": 3.9477000000000002e-05 2023-08-01T19:55:49.159 INFO:teuthology.orchestra.run.smithi101.stdout: } 2023-08-01T19:55:49.159 INFO:teuthology.orchestra.run.smithi101.stdout: ] 2023-08-01T19:55:49.159 INFO:teuthology.orchestra.run.smithi101.stdout: } 2023-08-01T19:55:49.159 INFO:teuthology.orchestra.run.smithi101.stdout: }, 2023-08-01T19:55:49.159 INFO:teuthology.orchestra.run.smithi101.stdout: { 2023-08-01T19:55:49.159 INFO:teuthology.orchestra.run.smithi101.stdout: "description": "osd_repop(client.4668.0:107863 5.3 e38/19 5:cbdd875a:::benchmark_data_smithi006_114134_object107862:head v 38'6829, mlcod=38'6826)", 2023-08-01T19:55:49.159 INFO:teuthology.orchestra.run.smithi101.stdout: "initiated_at": "2023-08-01T19:55:09.280747+0000", 2023-08-01T19:55:49.159 INFO:teuthology.orchestra.run.smithi101.stdout: "age": 39.70576071, 2023-08-01T19:55:49.160 INFO:teuthology.orchestra.run.smithi101.stdout: "duration": 0.069343305999999993, 2023-08-01T19:55:49.160 INFO:teuthology.orchestra.run.smithi101.stdout: "type_data": { 2023-08-01T19:55:49.160 INFO:teuthology.orchestra.run.smithi101.stdout: "flag_point": "commit sent; apply or cleanup", 2023-08-01T19:55:49.160 INFO:teuthology.orchestra.run.smithi101.stdout: "events": [ 2023-08-01T19:55:49.160 INFO:teuthology.orchestra.run.smithi101.stdout: { 2023-08-01T19:55:49.160 INFO:teuthology.orchestra.run.smithi101.stdout: "event": "initiated", 2023-08-01T19:55:49.160 INFO:teuthology.orchestra.run.smithi101.stdout: "time": "2023-08-01T19:55:09.280747+0000", 2023-08-01T19:55:49.161 INFO:teuthology.orchestra.run.smithi101.stdout: "duration": 0 2023-08-01T19:55:49.161 INFO:teuthology.orchestra.run.smithi101.stdout: }, 2023-08-01T19:55:49.161 INFO:teuthology.orchestra.run.smithi101.stdout: { 2023-08-01T19:55:49.161 INFO:teuthology.orchestra.run.smithi101.stdout: "event": "throttled", 2023-08-01T19:55:49.161 INFO:teuthology.orchestra.run.smithi101.stdout: "time": "2023-08-01T19:55:09.280747+0000", 2023-08-01T19:55:49.161 INFO:teuthology.orchestra.run.smithi101.stdout: "duration": 0 2023-08-01T19:55:49.161 INFO:teuthology.orchestra.run.smithi101.stdout: }, 2023-08-01T19:55:49.161 INFO:teuthology.orchestra.run.smithi101.stdout: { 2023-08-01T19:55:49.162 INFO:teuthology.orchestra.run.smithi101.stdout: "event": "header_read", 2023-08-01T19:55:49.162 INFO:teuthology.orchestra.run.smithi101.stdout: "time": "2023-08-01T19:55:09.280746+0000", 2023-08-01T19:55:49.162 INFO:teuthology.orchestra.run.smithi101.stdout: "duration": 4294967295.9999995 2023-08-01T19:55:49.162 INFO:teuthology.orchestra.run.smithi101.stdout: }, 2023-08-01T19:55:49.162 INFO:teuthology.orchestra.run.smithi101.stdout: { 2023-08-01T19:55:49.162 INFO:teuthology.orchestra.run.smithi101.stdout: "event": "all_read", 2023-08-01T19:55:49.162 INFO:teuthology.orchestra.run.smithi101.stdout: "time": "2023-08-01T19:55:09.280798+0000", 2023-08-01T19:55:49.162 INFO:teuthology.orchestra.run.smithi101.stdout: "duration": 5.1706000000000003e-05 2023-08-01T19:55:49.163 INFO:teuthology.orchestra.run.smithi101.stdout: }, 2023-08-01T19:55:49.163 INFO:teuthology.orchestra.run.smithi101.stdout: { 2023-08-01T19:55:49.163 INFO:teuthology.orchestra.run.smithi101.stdout: "event": "dispatched", 2023-08-01T19:55:49.163 INFO:teuthology.orchestra.run.smithi101.stdout: "time": "2023-08-01T19:55:09.280807+0000", 2023-08-01T19:55:49.163 INFO:teuthology.orchestra.run.smithi101.stdout: "duration": 8.4889999999999995e-06 2023-08-01T19:55:49.163 INFO:teuthology.orchestra.run.smithi101.stdout: }, 2023-08-01T19:55:49.163 INFO:teuthology.orchestra.run.smithi101.stdout: { 2023-08-01T19:55:49.164 INFO:teuthology.orchestra.run.smithi101.stdout: "event": "queued_for_pg", 2023-08-01T19:55:49.164 INFO:teuthology.orchestra.run.smithi101.stdout: "time": "2023-08-01T19:55:09.280812+0000", 2023-08-01T19:55:49.164 INFO:teuthology.orchestra.run.smithi101.stdout: "duration": 5.2120000000000002e-06 2023-08-01T19:55:49.164 INFO:teuthology.orchestra.run.smithi101.stdout: }, 2023-08-01T19:55:49.164 INFO:teuthology.orchestra.run.smithi101.stdout: { 2023-08-01T19:55:49.164 INFO:teuthology.orchestra.run.smithi101.stdout: "event": "reached_pg", 2023-08-01T19:55:49.164 INFO:teuthology.orchestra.run.smithi101.stdout: "time": "2023-08-01T19:55:09.280843+0000", 2023-08-01T19:55:49.164 INFO:teuthology.orchestra.run.smithi101.stdout: "duration": 3.1406999999999999e-05 2023-08-01T19:55:49.165 INFO:teuthology.orchestra.run.smithi101.stdout: }, 2023-08-01T19:55:49.165 INFO:teuthology.orchestra.run.smithi101.stdout: { 2023-08-01T19:55:49.165 INFO:teuthology.orchestra.run.smithi101.stdout: "event": "started", 2023-08-01T19:55:49.165 INFO:teuthology.orchestra.run.smithi101.stdout: "time": "2023-08-01T19:55:09.280860+0000", 2023-08-01T19:55:49.165 INFO:teuthology.orchestra.run.smithi101.stdout: "duration": 1.6283999999999999e-05 2023-08-01T19:55:49.165 INFO:teuthology.orchestra.run.smithi101.stdout: }, 2023-08-01T19:55:49.165 INFO:teuthology.orchestra.run.smithi101.stdout: { 2023-08-01T19:55:49.166 INFO:teuthology.orchestra.run.smithi101.stdout: "event": "commit_sent", 2023-08-01T19:55:49.166 INFO:teuthology.orchestra.run.smithi101.stdout: "time": "2023-08-01T19:55:09.350059+0000", 2023-08-01T19:55:49.166 INFO:teuthology.orchestra.run.smithi101.stdout: "duration": 0.069199094000000003 2023-08-01T19:55:49.166 INFO:teuthology.orchestra.run.smithi101.stdout: }, 2023-08-01T19:55:49.166 INFO:teuthology.orchestra.run.smithi101.stdout: { 2023-08-01T19:55:49.166 INFO:teuthology.orchestra.run.smithi101.stdout: "event": "done", 2023-08-01T19:55:49.166 INFO:teuthology.orchestra.run.smithi101.stdout: "time": "2023-08-01T19:55:09.350090+0000", 2023-08-01T19:55:49.166 INFO:teuthology.orchestra.run.smithi101.stdout: "duration": 3.1736000000000002e-05 2023-08-01T19:55:49.167 INFO:teuthology.orchestra.run.smithi101.stdout: } 2023-08-01T19:55:49.167 INFO:teuthology.orchestra.run.smithi101.stdout: ] 2023-08-01T19:55:49.167 INFO:teuthology.orchestra.run.smithi101.stdout: } 2023-08-01T19:55:49.167 INFO:teuthology.orchestra.run.smithi101.stdout: }, 2023-08-01T19:55:49.167 INFO:teuthology.orchestra.run.smithi101.stdout: { 2023-08-01T19:55:49.167 INFO:teuthology.orchestra.run.smithi101.stdout: "description": "osd_repop(client.4668.0:107865 5.3 e38/19 5:c2ebb96d:::benchmark_data_smithi006_114134_object107864:head v 38'6830, mlcod=38'6826)", 2023-08-01T19:55:49.167 INFO:teuthology.orchestra.run.smithi101.stdout: "initiated_at": "2023-08-01T19:55:09.283182+0000", 2023-08-01T19:55:49.167 INFO:teuthology.orchestra.run.smithi101.stdout: "age": 39.703325401999997, 2023-08-01T19:55:49.168 INFO:teuthology.orchestra.run.smithi101.stdout: "duration": 0.068554793000000003, 2023-08-01T19:55:49.168 INFO:teuthology.orchestra.run.smithi101.stdout: "type_data": { 2023-08-01T19:55:49.168 INFO:teuthology.orchestra.run.smithi101.stdout: "flag_point": "commit sent; apply or cleanup", 2023-08-01T19:55:49.168 INFO:teuthology.orchestra.run.smithi101.stdout: "events": [ 2023-08-01T19:55:49.168 INFO:teuthology.orchestra.run.smithi101.stdout: { 2023-08-01T19:55:49.168 INFO:teuthology.orchestra.run.smithi101.stdout: "event": "initiated", 2023-08-01T19:55:49.168 INFO:teuthology.orchestra.run.smithi101.stdout: "time": "2023-08-01T19:55:09.283182+0000", 2023-08-01T19:55:49.169 INFO:teuthology.orchestra.run.smithi101.stdout: "duration": 0 2023-08-01T19:55:49.169 INFO:teuthology.orchestra.run.smithi101.stdout: }, 2023-08-01T19:55:49.169 INFO:teuthology.orchestra.run.smithi101.stdout: { 2023-08-01T19:55:49.169 INFO:teuthology.orchestra.run.smithi101.stdout: "event": "throttled", 2023-08-01T19:55:49.169 INFO:teuthology.orchestra.run.smithi101.stdout: "time": "2023-08-01T19:55:09.283182+0000", 2023-08-01T19:55:49.169 INFO:teuthology.orchestra.run.smithi101.stdout: "duration": 0 2023-08-01T19:55:49.169 INFO:teuthology.orchestra.run.smithi101.stdout: }, 2023-08-01T19:55:49.169 INFO:teuthology.orchestra.run.smithi101.stdout: { 2023-08-01T19:55:49.170 INFO:teuthology.orchestra.run.smithi101.stdout: "event": "header_read", 2023-08-01T19:55:49.170 INFO:teuthology.orchestra.run.smithi101.stdout: "time": "2023-08-01T19:55:09.283182+0000", 2023-08-01T19:55:49.170 INFO:teuthology.orchestra.run.smithi101.stdout: "duration": 4294967295.9999995 2023-08-01T19:55:49.170 INFO:teuthology.orchestra.run.smithi101.stdout: }, 2023-08-01T19:55:49.170 INFO:teuthology.orchestra.run.smithi101.stdout: { 2023-08-01T19:55:49.170 INFO:teuthology.orchestra.run.smithi101.stdout: "event": "all_read", 2023-08-01T19:55:49.170 INFO:teuthology.orchestra.run.smithi101.stdout: "time": "2023-08-01T19:55:09.283233+0000", 2023-08-01T19:55:49.170 INFO:teuthology.orchestra.run.smithi101.stdout: "duration": 5.1511999999999997e-05 2023-08-01T19:55:49.171 INFO:teuthology.orchestra.run.smithi101.stdout: }, 2023-08-01T19:55:49.171 INFO:teuthology.orchestra.run.smithi101.stdout: { 2023-08-01T19:55:49.171 INFO:teuthology.orchestra.run.smithi101.stdout: "event": "dispatched", 2023-08-01T19:55:49.171 INFO:teuthology.orchestra.run.smithi101.stdout: "time": "2023-08-01T19:55:09.283239+0000", 2023-08-01T19:55:49.171 INFO:teuthology.orchestra.run.smithi101.stdout: "duration": 5.6640000000000003e-06 2023-08-01T19:55:49.171 INFO:teuthology.orchestra.run.smithi101.stdout: }, 2023-08-01T19:55:49.171 INFO:teuthology.orchestra.run.smithi101.stdout: { 2023-08-01T19:55:49.172 INFO:teuthology.orchestra.run.smithi101.stdout: "event": "queued_for_pg", 2023-08-01T19:55:49.172 INFO:teuthology.orchestra.run.smithi101.stdout: "time": "2023-08-01T19:55:09.283242+0000", 2023-08-01T19:55:49.172 INFO:teuthology.orchestra.run.smithi101.stdout: "duration": 2.9639999999999999e-06 2023-08-01T19:55:49.172 INFO:teuthology.orchestra.run.smithi101.stdout: }, 2023-08-01T19:55:49.172 INFO:teuthology.orchestra.run.smithi101.stdout: { 2023-08-01T19:55:49.172 INFO:teuthology.orchestra.run.smithi101.stdout: "event": "reached_pg", 2023-08-01T19:55:49.172 INFO:teuthology.orchestra.run.smithi101.stdout: "time": "2023-08-01T19:55:09.283276+0000", 2023-08-01T19:55:49.173 INFO:teuthology.orchestra.run.smithi101.stdout: "duration": 3.3631999999999999e-05 2023-08-01T19:55:49.173 INFO:teuthology.orchestra.run.smithi101.stdout: }, 2023-08-01T19:55:49.173 INFO:teuthology.orchestra.run.smithi101.stdout: { 2023-08-01T19:55:49.173 INFO:teuthology.orchestra.run.smithi101.stdout: "event": "started", 2023-08-01T19:55:49.173 INFO:teuthology.orchestra.run.smithi101.stdout: "time": "2023-08-01T19:55:09.283288+0000", 2023-08-01T19:55:49.173 INFO:teuthology.orchestra.run.smithi101.stdout: "duration": 1.1816e-05 2023-08-01T19:55:49.173 INFO:teuthology.orchestra.run.smithi101.stdout: }, 2023-08-01T19:55:49.173 INFO:teuthology.orchestra.run.smithi101.stdout: { 2023-08-01T19:55:49.174 INFO:teuthology.orchestra.run.smithi101.stdout: "event": "commit_sent", 2023-08-01T19:55:49.174 INFO:teuthology.orchestra.run.smithi101.stdout: "time": "2023-08-01T19:55:09.351712+0000", 2023-08-01T19:55:49.174 INFO:teuthology.orchestra.run.smithi101.stdout: "duration": 0.068424311000000002 2023-08-01T19:55:49.174 INFO:teuthology.orchestra.run.smithi101.stdout: }, 2023-08-01T19:55:49.174 INFO:teuthology.orchestra.run.smithi101.stdout: { 2023-08-01T19:55:49.174 INFO:teuthology.orchestra.run.smithi101.stdout: "event": "done", 2023-08-01T19:55:49.174 INFO:teuthology.orchestra.run.smithi101.stdout: "time": "2023-08-01T19:55:09.351737+0000", 2023-08-01T19:55:49.174 INFO:teuthology.orchestra.run.smithi101.stdout: "duration": 2.5364999999999999e-05 2023-08-01T19:55:49.175 INFO:teuthology.orchestra.run.smithi101.stdout: } 2023-08-01T19:55:49.175 INFO:teuthology.orchestra.run.smithi101.stdout: ] 2023-08-01T19:55:49.175 INFO:teuthology.orchestra.run.smithi101.stdout: } 2023-08-01T19:55:49.175 INFO:teuthology.orchestra.run.smithi101.stdout: }, 2023-08-01T19:55:49.175 INFO:teuthology.orchestra.run.smithi101.stdout: { 2023-08-01T19:55:49.175 INFO:teuthology.orchestra.run.smithi101.stdout: "description": "osd_repop(client.4668.0:107869 5.c e38/19 5:31910384:::benchmark_data_smithi006_114134_object107868:head v 38'6761, mlcod=38'6759)", 2023-08-01T19:55:49.175 INFO:teuthology.orchestra.run.smithi101.stdout: "initiated_at": "2023-08-01T19:55:09.283762+0000", 2023-08-01T19:55:49.176 INFO:teuthology.orchestra.run.smithi101.stdout: "age": 39.702746066000003, 2023-08-01T19:55:49.176 INFO:teuthology.orchestra.run.smithi101.stdout: "duration": 0.067877541, 2023-08-01T19:55:49.176 INFO:teuthology.orchestra.run.smithi101.stdout: "type_data": { 2023-08-01T19:55:49.176 INFO:teuthology.orchestra.run.smithi101.stdout: "flag_point": "commit sent; apply or cleanup", 2023-08-01T19:55:49.176 INFO:teuthology.orchestra.run.smithi101.stdout: "events": [ 2023-08-01T19:55:49.176 INFO:teuthology.orchestra.run.smithi101.stdout: { 2023-08-01T19:55:49.176 INFO:teuthology.orchestra.run.smithi101.stdout: "event": "initiated", 2023-08-01T19:55:49.176 INFO:teuthology.orchestra.run.smithi101.stdout: "time": "2023-08-01T19:55:09.283762+0000", 2023-08-01T19:55:49.177 INFO:teuthology.orchestra.run.smithi101.stdout: "duration": 0 2023-08-01T19:55:49.177 INFO:teuthology.orchestra.run.smithi101.stdout: }, 2023-08-01T19:55:49.177 INFO:teuthology.orchestra.run.smithi101.stdout: { 2023-08-01T19:55:49.177 INFO:teuthology.orchestra.run.smithi101.stdout: "event": "throttled", 2023-08-01T19:55:49.177 INFO:teuthology.orchestra.run.smithi101.stdout: "time": "2023-08-01T19:55:09.283762+0000", 2023-08-01T19:55:49.177 INFO:teuthology.orchestra.run.smithi101.stdout: "duration": 0 2023-08-01T19:55:49.177 INFO:teuthology.orchestra.run.smithi101.stdout: }, 2023-08-01T19:55:49.177 INFO:teuthology.orchestra.run.smithi101.stdout: { 2023-08-01T19:55:49.178 INFO:teuthology.orchestra.run.smithi101.stdout: "event": "header_read", 2023-08-01T19:55:49.178 INFO:teuthology.orchestra.run.smithi101.stdout: "time": "2023-08-01T19:55:09.283761+0000", 2023-08-01T19:55:49.178 INFO:teuthology.orchestra.run.smithi101.stdout: "duration": 4294967295.9999995 2023-08-01T19:55:49.178 INFO:teuthology.orchestra.run.smithi101.stdout: }, 2023-08-01T19:55:49.178 INFO:teuthology.orchestra.run.smithi101.stdout: { 2023-08-01T19:55:49.178 INFO:teuthology.orchestra.run.smithi101.stdout: "event": "all_read", 2023-08-01T19:55:49.178 INFO:teuthology.orchestra.run.smithi101.stdout: "time": "2023-08-01T19:55:09.283825+0000", 2023-08-01T19:55:49.178 INFO:teuthology.orchestra.run.smithi101.stdout: "duration": 6.3200000000000005e-05 2023-08-01T19:55:49.179 INFO:teuthology.orchestra.run.smithi101.stdout: }, 2023-08-01T19:55:49.179 INFO:teuthology.orchestra.run.smithi101.stdout: { 2023-08-01T19:55:49.179 INFO:teuthology.orchestra.run.smithi101.stdout: "event": "dispatched", 2023-08-01T19:55:49.179 INFO:teuthology.orchestra.run.smithi101.stdout: "time": "2023-08-01T19:55:09.345759+0000", 2023-08-01T19:55:49.179 INFO:teuthology.orchestra.run.smithi101.stdout: "duration": 0.061934221999999997 2023-08-01T19:55:49.179 INFO:teuthology.orchestra.run.smithi101.stdout: }, 2023-08-01T19:55:49.179 INFO:teuthology.orchestra.run.smithi101.stdout: { 2023-08-01T19:55:49.179 INFO:teuthology.orchestra.run.smithi101.stdout: "event": "queued_for_pg", 2023-08-01T19:55:49.180 INFO:teuthology.orchestra.run.smithi101.stdout: "time": "2023-08-01T19:55:09.345768+0000", 2023-08-01T19:55:49.180 INFO:teuthology.orchestra.run.smithi101.stdout: "duration": 8.7099999999999996e-06 2023-08-01T19:55:49.180 INFO:teuthology.orchestra.run.smithi101.stdout: }, 2023-08-01T19:55:49.180 INFO:teuthology.orchestra.run.smithi101.stdout: { 2023-08-01T19:55:49.180 INFO:teuthology.orchestra.run.smithi101.stdout: "event": "reached_pg", 2023-08-01T19:55:49.180 INFO:teuthology.orchestra.run.smithi101.stdout: "time": "2023-08-01T19:55:09.345832+0000", 2023-08-01T19:55:49.180 INFO:teuthology.orchestra.run.smithi101.stdout: "duration": 6.4769000000000003e-05 2023-08-01T19:55:49.181 INFO:teuthology.orchestra.run.smithi101.stdout: }, 2023-08-01T19:55:49.181 INFO:teuthology.orchestra.run.smithi101.stdout: { 2023-08-01T19:55:49.181 INFO:teuthology.orchestra.run.smithi101.stdout: "event": "started", 2023-08-01T19:55:49.181 INFO:teuthology.orchestra.run.smithi101.stdout: "time": "2023-08-01T19:55:09.345851+0000", 2023-08-01T19:55:49.181 INFO:teuthology.orchestra.run.smithi101.stdout: "duration": 1.9049e-05 2023-08-01T19:55:49.181 INFO:teuthology.orchestra.run.smithi101.stdout: }, 2023-08-01T19:55:49.181 INFO:teuthology.orchestra.run.smithi101.stdout: { 2023-08-01T19:55:49.181 INFO:teuthology.orchestra.run.smithi101.stdout: "event": "commit_sent", 2023-08-01T19:55:49.182 INFO:teuthology.orchestra.run.smithi101.stdout: "time": "2023-08-01T19:55:09.351601+0000", 2023-08-01T19:55:49.182 INFO:teuthology.orchestra.run.smithi101.stdout: "duration": 0.0057499930000000001 2023-08-01T19:55:49.182 INFO:teuthology.orchestra.run.smithi101.stdout: }, 2023-08-01T19:55:49.182 INFO:teuthology.orchestra.run.smithi101.stdout: { 2023-08-01T19:55:49.182 INFO:teuthology.orchestra.run.smithi101.stdout: "event": "done", 2023-08-01T19:55:49.182 INFO:teuthology.orchestra.run.smithi101.stdout: "time": "2023-08-01T19:55:09.351639+0000", 2023-08-01T19:55:49.182 INFO:teuthology.orchestra.run.smithi101.stdout: "duration": 3.7941000000000001e-05 2023-08-01T19:55:49.182 INFO:teuthology.orchestra.run.smithi101.stdout: } 2023-08-01T19:55:49.183 INFO:teuthology.orchestra.run.smithi101.stdout: ] 2023-08-01T19:55:49.183 INFO:teuthology.orchestra.run.smithi101.stdout: } 2023-08-01T19:55:49.183 INFO:teuthology.orchestra.run.smithi101.stdout: }, 2023-08-01T19:55:49.183 INFO:teuthology.orchestra.run.smithi101.stdout: { 2023-08-01T19:55:49.183 INFO:teuthology.orchestra.run.smithi101.stdout: "description": "osd_op(client.4668.0:107876 5.1 5:8d2344a3:::benchmark_data_smithi006_114134_object107875:head [set-alloc-hint object_size 65536 write_size 65536,write 0~65536] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e38)", 2023-08-01T19:55:49.183 INFO:teuthology.orchestra.run.smithi101.stdout: "initiated_at": "2023-08-01T19:55:09.287802+0000", 2023-08-01T19:55:49.183 INFO:teuthology.orchestra.run.smithi101.stdout: "age": 39.698705746000002, 2023-08-01T19:55:49.183 INFO:teuthology.orchestra.run.smithi101.stdout: "duration": 0.066738461999999998, 2023-08-01T19:55:49.184 INFO:teuthology.orchestra.run.smithi101.stdout: "type_data": { 2023-08-01T19:55:49.184 INFO:teuthology.orchestra.run.smithi101.stdout: "flag_point": "commit sent; apply or cleanup", 2023-08-01T19:55:49.184 INFO:teuthology.orchestra.run.smithi101.stdout: "client_info": { 2023-08-01T19:55:49.184 INFO:teuthology.orchestra.run.smithi101.stdout: "client": "client.4668", 2023-08-01T19:55:49.184 INFO:teuthology.orchestra.run.smithi101.stdout: "client_addr": "172.21.15.6:0/1709472247", 2023-08-01T19:55:49.184 INFO:teuthology.orchestra.run.smithi101.stdout: "tid": 107876 2023-08-01T19:55:49.184 INFO:teuthology.orchestra.run.smithi101.stdout: }, 2023-08-01T19:55:49.185 INFO:teuthology.orchestra.run.smithi101.stdout: "events": [ 2023-08-01T19:55:49.185 INFO:teuthology.orchestra.run.smithi101.stdout: { 2023-08-01T19:55:49.185 INFO:teuthology.orchestra.run.smithi101.stdout: "event": "initiated", 2023-08-01T19:55:49.185 INFO:teuthology.orchestra.run.smithi101.stdout: "time": "2023-08-01T19:55:09.287802+0000", 2023-08-01T19:55:49.185 INFO:teuthology.orchestra.run.smithi101.stdout: "duration": 0 2023-08-01T19:55:49.185 INFO:teuthology.orchestra.run.smithi101.stdout: }, 2023-08-01T19:55:49.185 INFO:teuthology.orchestra.run.smithi101.stdout: { 2023-08-01T19:55:49.185 INFO:teuthology.orchestra.run.smithi101.stdout: "event": "throttled", 2023-08-01T19:55:49.186 INFO:teuthology.orchestra.run.smithi101.stdout: "time": "2023-08-01T19:55:09.287802+0000", 2023-08-01T19:55:49.186 INFO:teuthology.orchestra.run.smithi101.stdout: "duration": 0 2023-08-01T19:55:49.186 INFO:teuthology.orchestra.run.smithi101.stdout: }, 2023-08-01T19:55:49.186 INFO:teuthology.orchestra.run.smithi101.stdout: { 2023-08-01T19:55:49.186 INFO:teuthology.orchestra.run.smithi101.stdout: "event": "header_read", 2023-08-01T19:55:49.186 INFO:teuthology.orchestra.run.smithi101.stdout: "time": "2023-08-01T19:55:09.287800+0000", 2023-08-01T19:55:49.186 INFO:teuthology.orchestra.run.smithi101.stdout: "duration": 4294967295.9999981 2023-08-01T19:55:49.186 INFO:teuthology.orchestra.run.smithi101.stdout: }, 2023-08-01T19:55:49.187 INFO:teuthology.orchestra.run.smithi101.stdout: { 2023-08-01T19:55:49.187 INFO:teuthology.orchestra.run.smithi101.stdout: "event": "all_read", 2023-08-01T19:55:49.187 INFO:teuthology.orchestra.run.smithi101.stdout: "time": "2023-08-01T19:55:09.287847+0000", 2023-08-01T19:55:49.187 INFO:teuthology.orchestra.run.smithi101.stdout: "duration": 4.6455999999999997e-05 2023-08-01T19:55:49.187 INFO:teuthology.orchestra.run.smithi101.stdout: }, 2023-08-01T19:55:49.187 INFO:teuthology.orchestra.run.smithi101.stdout: { 2023-08-01T19:55:49.187 INFO:teuthology.orchestra.run.smithi101.stdout: "event": "dispatched", 2023-08-01T19:55:49.187 INFO:teuthology.orchestra.run.smithi101.stdout: "time": "2023-08-01T19:55:09.345732+0000", 2023-08-01T19:55:49.188 INFO:teuthology.orchestra.run.smithi101.stdout: "duration": 0.057885955000000003 2023-08-01T19:55:49.188 INFO:teuthology.orchestra.run.smithi101.stdout: }, 2023-08-01T19:55:49.188 INFO:teuthology.orchestra.run.smithi101.stdout: { 2023-08-01T19:55:49.188 INFO:teuthology.orchestra.run.smithi101.stdout: "event": "queued_for_pg", 2023-08-01T19:55:49.188 INFO:teuthology.orchestra.run.smithi101.stdout: "time": "2023-08-01T19:55:09.345802+0000", 2023-08-01T19:55:49.188 INFO:teuthology.orchestra.run.smithi101.stdout: "duration": 6.9845000000000006e-05 2023-08-01T19:55:49.188 INFO:teuthology.orchestra.run.smithi101.stdout: }, 2023-08-01T19:55:49.188 INFO:teuthology.orchestra.run.smithi101.stdout: { 2023-08-01T19:55:49.189 INFO:teuthology.orchestra.run.smithi101.stdout: "event": "reached_pg", 2023-08-01T19:55:49.189 INFO:teuthology.orchestra.run.smithi101.stdout: "time": "2023-08-01T19:55:09.345841+0000", 2023-08-01T19:55:49.189 INFO:teuthology.orchestra.run.smithi101.stdout: "duration": 3.8719e-05 2023-08-01T19:55:49.189 INFO:teuthology.orchestra.run.smithi101.stdout: }, 2023-08-01T19:55:49.189 INFO:teuthology.orchestra.run.smithi101.stdout: { 2023-08-01T19:55:49.189 INFO:teuthology.orchestra.run.smithi101.stdout: "event": "started", 2023-08-01T19:55:49.189 INFO:teuthology.orchestra.run.smithi101.stdout: "time": "2023-08-01T19:55:09.345965+0000", 2023-08-01T19:55:49.190 INFO:teuthology.orchestra.run.smithi101.stdout: "duration": 0.00012353099999999999 2023-08-01T19:55:49.190 INFO:teuthology.orchestra.run.smithi101.stdout: }, 2023-08-01T19:55:49.190 INFO:teuthology.orchestra.run.smithi101.stdout: { 2023-08-01T19:55:49.190 INFO:teuthology.orchestra.run.smithi101.stdout: "event": "waiting for subops from 0", 2023-08-01T19:55:49.190 INFO:teuthology.orchestra.run.smithi101.stdout: "time": "2023-08-01T19:55:09.346113+0000", 2023-08-01T19:55:49.190 INFO:teuthology.orchestra.run.smithi101.stdout: "duration": 0.000148496 2023-08-01T19:55:49.190 INFO:teuthology.orchestra.run.smithi101.stdout: }, 2023-08-01T19:55:49.190 INFO:teuthology.orchestra.run.smithi101.stdout: { 2023-08-01T19:55:49.191 INFO:teuthology.orchestra.run.smithi101.stdout: "event": "sub_op_commit_rec", 2023-08-01T19:55:49.191 INFO:teuthology.orchestra.run.smithi101.stdout: "time": "2023-08-01T19:55:09.352561+0000", 2023-08-01T19:55:49.191 INFO:teuthology.orchestra.run.smithi101.stdout: "duration": 0.0064478890000000001 2023-08-01T19:55:49.191 INFO:teuthology.orchestra.run.smithi101.stdout: }, 2023-08-01T19:55:49.191 INFO:teuthology.orchestra.run.smithi101.stdout: { 2023-08-01T19:55:49.191 INFO:teuthology.orchestra.run.smithi101.stdout: "event": "op_commit", 2023-08-01T19:55:49.191 INFO:teuthology.orchestra.run.smithi101.stdout: "time": "2023-08-01T19:55:09.354475+0000", 2023-08-01T19:55:49.191 INFO:teuthology.orchestra.run.smithi101.stdout: "duration": 0.001913903 2023-08-01T19:55:49.192 INFO:teuthology.orchestra.run.smithi101.stdout: }, 2023-08-01T19:55:49.192 INFO:teuthology.orchestra.run.smithi101.stdout: { 2023-08-01T19:55:49.192 INFO:teuthology.orchestra.run.smithi101.stdout: "event": "commit_sent", 2023-08-01T19:55:49.192 INFO:teuthology.orchestra.run.smithi101.stdout: "time": "2023-08-01T19:55:09.354514+0000", 2023-08-01T19:55:49.192 INFO:teuthology.orchestra.run.smithi101.stdout: "duration": 3.8680999999999998e-05 2023-08-01T19:55:49.192 INFO:teuthology.orchestra.run.smithi101.stdout: }, 2023-08-01T19:55:49.192 INFO:teuthology.orchestra.run.smithi101.stdout: { 2023-08-01T19:55:49.192 INFO:teuthology.orchestra.run.smithi101.stdout: "event": "done", 2023-08-01T19:55:49.193 INFO:teuthology.orchestra.run.smithi101.stdout: "time": "2023-08-01T19:55:09.354541+0000", 2023-08-01T19:55:49.193 INFO:teuthology.orchestra.run.smithi101.stdout: "duration": 2.6976999999999999e-05 2023-08-01T19:55:49.193 INFO:teuthology.orchestra.run.smithi101.stdout: } 2023-08-01T19:55:49.193 INFO:teuthology.orchestra.run.smithi101.stdout: ] 2023-08-01T19:55:49.193 INFO:teuthology.orchestra.run.smithi101.stdout: } 2023-08-01T19:55:49.193 INFO:teuthology.orchestra.run.smithi101.stdout: } 2023-08-01T19:55:49.193 INFO:teuthology.orchestra.run.smithi101.stdout: ] 2023-08-01T19:55:49.193 INFO:teuthology.orchestra.run.smithi101.stdout:} 2023-08-01T19:55:49.194 INFO:tasks.thrashosds.thrasher:in_osds: [0, 1, 2] out_osds: [] dead_osds: [] live_osds: [0, 1, 2] 2023-08-01T19:55:49.194 INFO:tasks.thrashosds.thrasher:choose_action: min_in 4 min_out 0 min_live 2 min_dead 0 chance_down 1.00 2023-08-01T19:55:49.194 INFO:tasks.thrashosds.thrasher:primary_affinity 2023-08-01T19:55:49.194 INFO:tasks.thrashosds.thrasher:Setting osd 0 primary_affinity to 0.822061 2023-08-01T19:55:49.195 DEBUG:teuthology.orchestra.run.smithi006:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 120 ceph --cluster ceph osd primary-affinity 0 0.8220614072873532 2023-08-01T19:55:49.196 INFO:tasks.ceph.osd.0.smithi008.stderr:2023-08-01T19:55:49.193+0000 7f16a58f4700 -1 received signal: Hangup from /usr/bin/python3 /bin/daemon-helper kill ceph-osd -f --cluster ceph -i 0 (PID: 111179) UID: 0 2023-08-01T19:55:49.197 INFO:teuthology.orchestra.run.smithi006.stderr:nodeep-scrub is set 2023-08-01T19:55:49.197 DEBUG:teuthology.orchestra.run.smithi155:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 30 ceph --cluster ceph --admin-daemon /var/run/ceph/ceph-osd.2.asok dump_ops_in_flight 2023-08-01T19:55:49.295 INFO:tasks.ceph.osd.0.smithi008.stderr:2023-08-01T19:55:49.293+0000 7f16a58f4700 -1 received signal: Hangup from /usr/bin/python3 /bin/daemon-helper kill ceph-osd -f --cluster ceph -i 0 (PID: 111179) UID: 0 2023-08-01T19:55:49.360 INFO:teuthology.orchestra.run.smithi155.stdout:{ 2023-08-01T19:55:49.360 INFO:teuthology.orchestra.run.smithi155.stdout: "ops": [ 2023-08-01T19:55:49.360 INFO:teuthology.orchestra.run.smithi155.stdout: { 2023-08-01T19:55:49.360 INFO:teuthology.orchestra.run.smithi155.stdout: "description": "osd_op(client.4668.0:180662 5.b 5:d2312d94:::benchmark_data_smithi006_114134_object47001:head [delete] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e56)", 2023-08-01T19:55:49.360 INFO:teuthology.orchestra.run.smithi155.stdout: "initiated_at": "2023-08-01T19:55:49.352735+0000", 2023-08-01T19:55:49.361 INFO:teuthology.orchestra.run.smithi155.stdout: "age": 0.0061698810000000003, 2023-08-01T19:55:49.361 INFO:teuthology.orchestra.run.smithi155.stdout: "duration": 0.0061902440000000001, 2023-08-01T19:55:49.361 INFO:teuthology.orchestra.run.smithi155.stdout: "type_data": { 2023-08-01T19:55:49.361 INFO:teuthology.orchestra.run.smithi155.stdout: "flag_point": "waiting for sub ops", 2023-08-01T19:55:49.361 INFO:teuthology.orchestra.run.smithi155.stdout: "client_info": { 2023-08-01T19:55:49.361 INFO:teuthology.orchestra.run.smithi155.stdout: "client": "client.4668", 2023-08-01T19:55:49.361 INFO:teuthology.orchestra.run.smithi155.stdout: "client_addr": "172.21.15.6:0/1709472247", 2023-08-01T19:55:49.361 INFO:teuthology.orchestra.run.smithi155.stdout: "tid": 180662 2023-08-01T19:55:49.362 INFO:teuthology.orchestra.run.smithi155.stdout: }, 2023-08-01T19:55:49.362 INFO:teuthology.orchestra.run.smithi155.stdout: "events": [ 2023-08-01T19:55:49.362 INFO:teuthology.orchestra.run.smithi155.stdout: { 2023-08-01T19:55:49.362 INFO:teuthology.orchestra.run.smithi155.stdout: "event": "initiated", 2023-08-01T19:55:49.362 INFO:teuthology.orchestra.run.smithi155.stdout: "time": "2023-08-01T19:55:49.352735+0000", 2023-08-01T19:55:49.362 INFO:teuthology.orchestra.run.smithi155.stdout: "duration": 0 2023-08-01T19:55:49.362 INFO:teuthology.orchestra.run.smithi155.stdout: }, 2023-08-01T19:55:49.363 INFO:teuthology.orchestra.run.smithi155.stdout: { 2023-08-01T19:55:49.363 INFO:teuthology.orchestra.run.smithi155.stdout: "event": "throttled", 2023-08-01T19:55:49.363 INFO:teuthology.orchestra.run.smithi155.stdout: "time": "2023-08-01T19:55:49.352735+0000", 2023-08-01T19:55:49.363 INFO:teuthology.orchestra.run.smithi155.stdout: "duration": 0 2023-08-01T19:55:49.363 INFO:teuthology.orchestra.run.smithi155.stdout: }, 2023-08-01T19:55:49.363 INFO:teuthology.orchestra.run.smithi155.stdout: { 2023-08-01T19:55:49.363 INFO:teuthology.orchestra.run.smithi155.stdout: "event": "header_read", 2023-08-01T19:55:49.363 INFO:teuthology.orchestra.run.smithi155.stdout: "time": "2023-08-01T19:55:49.352734+0000", 2023-08-01T19:55:49.364 INFO:teuthology.orchestra.run.smithi155.stdout: "duration": 4294967295.999999 2023-08-01T19:55:49.364 INFO:teuthology.orchestra.run.smithi155.stdout: }, 2023-08-01T19:55:49.364 INFO:teuthology.orchestra.run.smithi155.stdout: { 2023-08-01T19:55:49.364 INFO:teuthology.orchestra.run.smithi155.stdout: "event": "all_read", 2023-08-01T19:55:49.364 INFO:teuthology.orchestra.run.smithi155.stdout: "time": "2023-08-01T19:55:49.352739+0000", 2023-08-01T19:55:49.364 INFO:teuthology.orchestra.run.smithi155.stdout: "duration": 4.6120000000000001e-06 2023-08-01T19:55:49.364 INFO:teuthology.orchestra.run.smithi155.stdout: }, 2023-08-01T19:55:49.364 INFO:teuthology.orchestra.run.smithi155.stdout: { 2023-08-01T19:55:49.365 INFO:teuthology.orchestra.run.smithi155.stdout: "event": "dispatched", 2023-08-01T19:55:49.365 INFO:teuthology.orchestra.run.smithi155.stdout: "time": "2023-08-01T19:55:49.352746+0000", 2023-08-01T19:55:49.365 INFO:teuthology.orchestra.run.smithi155.stdout: "duration": 7.5970000000000003e-06 2023-08-01T19:55:49.365 INFO:teuthology.orchestra.run.smithi155.stdout: }, 2023-08-01T19:55:49.365 INFO:teuthology.orchestra.run.smithi155.stdout: { 2023-08-01T19:55:49.365 INFO:teuthology.orchestra.run.smithi155.stdout: "event": "queued_for_pg", 2023-08-01T19:55:49.365 INFO:teuthology.orchestra.run.smithi155.stdout: "time": "2023-08-01T19:55:49.352750+0000", 2023-08-01T19:55:49.365 INFO:teuthology.orchestra.run.smithi155.stdout: "duration": 3.9400000000000004e-06 2023-08-01T19:55:49.366 INFO:teuthology.orchestra.run.smithi155.stdout: }, 2023-08-01T19:55:49.366 INFO:teuthology.orchestra.run.smithi155.stdout: { 2023-08-01T19:55:49.366 INFO:teuthology.orchestra.run.smithi155.stdout: "event": "reached_pg", 2023-08-01T19:55:49.366 INFO:teuthology.orchestra.run.smithi155.stdout: "time": "2023-08-01T19:55:49.352792+0000", 2023-08-01T19:55:49.366 INFO:teuthology.orchestra.run.smithi155.stdout: "duration": 4.2110000000000002e-05 2023-08-01T19:55:49.366 INFO:teuthology.orchestra.run.smithi155.stdout: }, 2023-08-01T19:55:49.366 INFO:teuthology.orchestra.run.smithi155.stdout: { 2023-08-01T19:55:49.367 INFO:teuthology.orchestra.run.smithi155.stdout: "event": "started", 2023-08-01T19:55:49.367 INFO:teuthology.orchestra.run.smithi155.stdout: "time": "2023-08-01T19:55:49.352918+0000", 2023-08-01T19:55:49.367 INFO:teuthology.orchestra.run.smithi155.stdout: "duration": 0.00012549100000000001 2023-08-01T19:55:49.367 INFO:teuthology.orchestra.run.smithi155.stdout: }, 2023-08-01T19:55:49.367 INFO:teuthology.orchestra.run.smithi155.stdout: { 2023-08-01T19:55:49.367 INFO:teuthology.orchestra.run.smithi155.stdout: "event": "waiting for subops from 0", 2023-08-01T19:55:49.367 INFO:teuthology.orchestra.run.smithi155.stdout: "time": "2023-08-01T19:55:49.353031+0000", 2023-08-01T19:55:49.367 INFO:teuthology.orchestra.run.smithi155.stdout: "duration": 0.000112984 2023-08-01T19:55:49.368 INFO:teuthology.orchestra.run.smithi155.stdout: }, 2023-08-01T19:55:49.368 INFO:teuthology.orchestra.run.smithi155.stdout: { 2023-08-01T19:55:49.368 INFO:teuthology.orchestra.run.smithi155.stdout: "event": "op_commit", 2023-08-01T19:55:49.368 INFO:teuthology.orchestra.run.smithi155.stdout: "time": "2023-08-01T19:55:49.358904+0000", 2023-08-01T19:55:49.368 INFO:teuthology.orchestra.run.smithi155.stdout: "duration": 0.0058734709999999999 2023-08-01T19:55:49.368 INFO:teuthology.orchestra.run.smithi155.stdout: } 2023-08-01T19:55:49.368 INFO:teuthology.orchestra.run.smithi155.stdout: ] 2023-08-01T19:55:49.368 INFO:teuthology.orchestra.run.smithi155.stdout: } 2023-08-01T19:55:49.369 INFO:teuthology.orchestra.run.smithi155.stdout: }, 2023-08-01T19:55:49.369 INFO:teuthology.orchestra.run.smithi155.stdout: { 2023-08-01T19:55:49.369 INFO:teuthology.orchestra.run.smithi155.stdout: "description": "osd_op(client.4668.0:180664 5.9 5:989b2697:::benchmark_data_smithi006_114134_object47003:head [delete] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e56)", 2023-08-01T19:55:49.369 INFO:teuthology.orchestra.run.smithi155.stdout: "initiated_at": "2023-08-01T19:55:49.352823+0000", 2023-08-01T19:55:49.369 INFO:teuthology.orchestra.run.smithi155.stdout: "age": 0.0060820620000000001, 2023-08-01T19:55:49.369 INFO:teuthology.orchestra.run.smithi155.stdout: "duration": 0.0061542360000000004, 2023-08-01T19:55:49.369 INFO:teuthology.orchestra.run.smithi155.stdout: "type_data": { 2023-08-01T19:55:49.369 INFO:teuthology.orchestra.run.smithi155.stdout: "flag_point": "waiting for sub ops", 2023-08-01T19:55:49.370 INFO:teuthology.orchestra.run.smithi155.stdout: "client_info": { 2023-08-01T19:55:49.370 INFO:teuthology.orchestra.run.smithi155.stdout: "client": "client.4668", 2023-08-01T19:55:49.370 INFO:teuthology.orchestra.run.smithi155.stdout: "client_addr": "172.21.15.6:0/1709472247", 2023-08-01T19:55:49.370 INFO:teuthology.orchestra.run.smithi155.stdout: "tid": 180664 2023-08-01T19:55:49.370 INFO:teuthology.orchestra.run.smithi155.stdout: }, 2023-08-01T19:55:49.370 INFO:teuthology.orchestra.run.smithi155.stdout: "events": [ 2023-08-01T19:55:49.370 INFO:teuthology.orchestra.run.smithi155.stdout: { 2023-08-01T19:55:49.370 INFO:teuthology.orchestra.run.smithi155.stdout: "event": "initiated", 2023-08-01T19:55:49.371 INFO:teuthology.orchestra.run.smithi155.stdout: "time": "2023-08-01T19:55:49.352823+0000", 2023-08-01T19:55:49.371 INFO:teuthology.orchestra.run.smithi155.stdout: "duration": 0 2023-08-01T19:55:49.371 INFO:teuthology.orchestra.run.smithi155.stdout: }, 2023-08-01T19:55:49.371 INFO:teuthology.orchestra.run.smithi155.stdout: { 2023-08-01T19:55:49.371 INFO:teuthology.orchestra.run.smithi155.stdout: "event": "throttled", 2023-08-01T19:55:49.371 INFO:teuthology.orchestra.run.smithi155.stdout: "time": "2023-08-01T19:55:49.352823+0000", 2023-08-01T19:55:49.371 INFO:teuthology.orchestra.run.smithi155.stdout: "duration": 0 2023-08-01T19:55:49.372 INFO:teuthology.orchestra.run.smithi155.stdout: }, 2023-08-01T19:55:49.372 INFO:teuthology.orchestra.run.smithi155.stdout: { 2023-08-01T19:55:49.372 INFO:teuthology.orchestra.run.smithi155.stdout: "event": "header_read", 2023-08-01T19:55:49.372 INFO:teuthology.orchestra.run.smithi155.stdout: "time": "2023-08-01T19:55:49.352822+0000", 2023-08-01T19:55:49.372 INFO:teuthology.orchestra.run.smithi155.stdout: "duration": 4294967295.9999995 2023-08-01T19:55:49.372 INFO:teuthology.orchestra.run.smithi155.stdout: }, 2023-08-01T19:55:49.372 INFO:teuthology.orchestra.run.smithi155.stdout: { 2023-08-01T19:55:49.372 INFO:teuthology.orchestra.run.smithi155.stdout: "event": "all_read", 2023-08-01T19:55:49.373 INFO:teuthology.orchestra.run.smithi155.stdout: "time": "2023-08-01T19:55:49.352825+0000", 2023-08-01T19:55:49.373 INFO:teuthology.orchestra.run.smithi155.stdout: "duration": 3.3569999999999998e-06 2023-08-01T19:55:49.373 INFO:teuthology.orchestra.run.smithi155.stdout: }, 2023-08-01T19:55:49.373 INFO:teuthology.orchestra.run.smithi155.stdout: { 2023-08-01T19:55:49.373 INFO:teuthology.orchestra.run.smithi155.stdout: "event": "dispatched", 2023-08-01T19:55:49.373 INFO:teuthology.orchestra.run.smithi155.stdout: "time": "2023-08-01T19:55:49.352833+0000", 2023-08-01T19:55:49.373 INFO:teuthology.orchestra.run.smithi155.stdout: "duration": 7.0709999999999997e-06 2023-08-01T19:55:49.374 INFO:teuthology.orchestra.run.smithi155.stdout: }, 2023-08-01T19:55:49.374 INFO:teuthology.orchestra.run.smithi155.stdout: { 2023-08-01T19:55:49.374 INFO:teuthology.orchestra.run.smithi155.stdout: "event": "queued_for_pg", 2023-08-01T19:55:49.374 INFO:teuthology.orchestra.run.smithi155.stdout: "time": "2023-08-01T19:55:49.352836+0000", 2023-08-01T19:55:49.374 INFO:teuthology.orchestra.run.smithi155.stdout: "duration": 3.252e-06 2023-08-01T19:55:49.374 INFO:teuthology.orchestra.run.smithi155.stdout: }, 2023-08-01T19:55:49.374 INFO:teuthology.orchestra.run.smithi155.stdout: { 2023-08-01T19:55:49.375 INFO:teuthology.orchestra.run.smithi155.stdout: "event": "reached_pg", 2023-08-01T19:55:49.375 INFO:teuthology.orchestra.run.smithi155.stdout: "time": "2023-08-01T19:55:49.352866+0000", 2023-08-01T19:55:49.375 INFO:teuthology.orchestra.run.smithi155.stdout: "duration": 2.9824000000000001e-05 2023-08-01T19:55:49.375 INFO:teuthology.orchestra.run.smithi155.stdout: }, 2023-08-01T19:55:49.375 INFO:teuthology.orchestra.run.smithi155.stdout: { 2023-08-01T19:55:49.375 INFO:teuthology.orchestra.run.smithi155.stdout: "event": "started", 2023-08-01T19:55:49.375 INFO:teuthology.orchestra.run.smithi155.stdout: "time": "2023-08-01T19:55:49.352942+0000", 2023-08-01T19:55:49.375 INFO:teuthology.orchestra.run.smithi155.stdout: "duration": 7.6834000000000003e-05 2023-08-01T19:55:49.376 INFO:teuthology.orchestra.run.smithi155.stdout: }, 2023-08-01T19:55:49.376 INFO:teuthology.orchestra.run.smithi155.stdout: { 2023-08-01T19:55:49.376 INFO:teuthology.orchestra.run.smithi155.stdout: "event": "waiting for subops from 1", 2023-08-01T19:55:49.376 INFO:teuthology.orchestra.run.smithi155.stdout: "time": "2023-08-01T19:55:49.353003+0000", 2023-08-01T19:55:49.376 INFO:teuthology.orchestra.run.smithi155.stdout: "duration": 6.0584999999999997e-05 2023-08-01T19:55:49.376 INFO:teuthology.orchestra.run.smithi155.stdout: }, 2023-08-01T19:55:49.376 INFO:teuthology.orchestra.run.smithi155.stdout: { 2023-08-01T19:55:49.377 INFO:teuthology.orchestra.run.smithi155.stdout: "event": "op_commit", 2023-08-01T19:55:49.377 INFO:teuthology.orchestra.run.smithi155.stdout: "time": "2023-08-01T19:55:49.358882+0000", 2023-08-01T19:55:49.377 INFO:teuthology.orchestra.run.smithi155.stdout: "duration": 0.0058792690000000003 2023-08-01T19:55:49.377 INFO:teuthology.orchestra.run.smithi155.stdout: } 2023-08-01T19:55:49.377 INFO:teuthology.orchestra.run.smithi155.stdout: ] 2023-08-01T19:55:49.377 INFO:teuthology.orchestra.run.smithi155.stdout: } 2023-08-01T19:55:49.377 INFO:teuthology.orchestra.run.smithi155.stdout: }, 2023-08-01T19:55:49.378 INFO:teuthology.orchestra.run.smithi155.stdout: { 2023-08-01T19:55:49.378 INFO:teuthology.orchestra.run.smithi155.stdout: "description": "osd_op(client.4668.0:180665 5.8 5:1fd1f95e:::benchmark_data_smithi006_114134_object47004:head [delete] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e56)", 2023-08-01T19:55:49.378 INFO:teuthology.orchestra.run.smithi155.stdout: "initiated_at": "2023-08-01T19:55:49.355206+0000", 2023-08-01T19:55:49.378 INFO:teuthology.orchestra.run.smithi155.stdout: "age": 0.0036989689999999999, 2023-08-01T19:55:49.378 INFO:teuthology.orchestra.run.smithi155.stdout: "duration": 0.0038380979999999999, 2023-08-01T19:55:49.378 INFO:teuthology.orchestra.run.smithi155.stdout: "type_data": { 2023-08-01T19:55:49.378 INFO:teuthology.orchestra.run.smithi155.stdout: "flag_point": "waiting for sub ops", 2023-08-01T19:55:49.378 INFO:teuthology.orchestra.run.smithi155.stdout: "client_info": { 2023-08-01T19:55:49.379 INFO:teuthology.orchestra.run.smithi155.stdout: "client": "client.4668", 2023-08-01T19:55:49.379 INFO:teuthology.orchestra.run.smithi155.stdout: "client_addr": "172.21.15.6:0/1709472247", 2023-08-01T19:55:49.379 INFO:teuthology.orchestra.run.smithi155.stdout: "tid": 180665 2023-08-01T19:55:49.379 INFO:teuthology.orchestra.run.smithi155.stdout: }, 2023-08-01T19:55:49.379 INFO:teuthology.orchestra.run.smithi155.stdout: "events": [ 2023-08-01T19:55:49.379 INFO:teuthology.orchestra.run.smithi155.stdout: { 2023-08-01T19:55:49.379 INFO:teuthology.orchestra.run.smithi155.stdout: "event": "initiated", 2023-08-01T19:55:49.380 INFO:teuthology.orchestra.run.smithi155.stdout: "time": "2023-08-01T19:55:49.355206+0000", 2023-08-01T19:55:49.380 INFO:teuthology.orchestra.run.smithi155.stdout: "duration": 0 2023-08-01T19:55:49.380 INFO:teuthology.orchestra.run.smithi155.stdout: }, 2023-08-01T19:55:49.380 INFO:teuthology.orchestra.run.smithi155.stdout: { 2023-08-01T19:55:49.380 INFO:teuthology.orchestra.run.smithi155.stdout: "event": "throttled", 2023-08-01T19:55:49.380 INFO:teuthology.orchestra.run.smithi155.stdout: "time": "2023-08-01T19:55:49.355206+0000", 2023-08-01T19:55:49.380 INFO:teuthology.orchestra.run.smithi155.stdout: "duration": 0 2023-08-01T19:55:49.380 INFO:teuthology.orchestra.run.smithi155.stdout: }, 2023-08-01T19:55:49.381 INFO:teuthology.orchestra.run.smithi155.stdout: { 2023-08-01T19:55:49.381 INFO:teuthology.orchestra.run.smithi155.stdout: "event": "header_read", 2023-08-01T19:55:49.381 INFO:teuthology.orchestra.run.smithi155.stdout: "time": "2023-08-01T19:55:49.355205+0000", 2023-08-01T19:55:49.381 INFO:teuthology.orchestra.run.smithi155.stdout: "duration": 4294967295.999999 2023-08-01T19:55:49.381 INFO:teuthology.orchestra.run.smithi155.stdout: }, 2023-08-01T19:55:49.381 INFO:teuthology.orchestra.run.smithi155.stdout: { 2023-08-01T19:55:49.381 INFO:teuthology.orchestra.run.smithi155.stdout: "event": "all_read", 2023-08-01T19:55:49.382 INFO:teuthology.orchestra.run.smithi155.stdout: "time": "2023-08-01T19:55:49.355210+0000", 2023-08-01T19:55:49.382 INFO:teuthology.orchestra.run.smithi155.stdout: "duration": 4.792e-06 2023-08-01T19:55:49.382 INFO:teuthology.orchestra.run.smithi155.stdout: }, 2023-08-01T19:55:49.382 INFO:teuthology.orchestra.run.smithi155.stdout: { 2023-08-01T19:55:49.382 INFO:teuthology.orchestra.run.smithi155.stdout: "event": "dispatched", 2023-08-01T19:55:49.382 INFO:teuthology.orchestra.run.smithi155.stdout: "time": "2023-08-01T19:55:49.355219+0000", 2023-08-01T19:55:49.382 INFO:teuthology.orchestra.run.smithi155.stdout: "duration": 9.7569999999999999e-06 2023-08-01T19:55:49.382 INFO:teuthology.orchestra.run.smithi155.stdout: }, 2023-08-01T19:55:49.383 INFO:teuthology.orchestra.run.smithi155.stdout: { 2023-08-01T19:55:49.383 INFO:teuthology.orchestra.run.smithi155.stdout: "event": "queued_for_pg", 2023-08-01T19:55:49.383 INFO:teuthology.orchestra.run.smithi155.stdout: "time": "2023-08-01T19:55:49.355225+0000", 2023-08-01T19:55:49.383 INFO:teuthology.orchestra.run.smithi155.stdout: "duration": 5.857e-06 2023-08-01T19:55:49.383 INFO:teuthology.orchestra.run.smithi155.stdout: }, 2023-08-01T19:55:49.383 INFO:teuthology.orchestra.run.smithi155.stdout: { 2023-08-01T19:55:49.383 INFO:teuthology.orchestra.run.smithi155.stdout: "event": "reached_pg", 2023-08-01T19:55:49.383 INFO:teuthology.orchestra.run.smithi155.stdout: "time": "2023-08-01T19:55:49.355262+0000", 2023-08-01T19:55:49.384 INFO:teuthology.orchestra.run.smithi155.stdout: "duration": 3.6421999999999998e-05 2023-08-01T19:55:49.384 INFO:teuthology.orchestra.run.smithi155.stdout: }, 2023-08-01T19:55:49.384 INFO:teuthology.orchestra.run.smithi155.stdout: { 2023-08-01T19:55:49.384 INFO:teuthology.orchestra.run.smithi155.stdout: "event": "started", 2023-08-01T19:55:49.384 INFO:teuthology.orchestra.run.smithi155.stdout: "time": "2023-08-01T19:55:49.355391+0000", 2023-08-01T19:55:49.384 INFO:teuthology.orchestra.run.smithi155.stdout: "duration": 0.00012936100000000001 2023-08-01T19:55:49.384 INFO:teuthology.orchestra.run.smithi155.stdout: }, 2023-08-01T19:55:49.385 INFO:teuthology.orchestra.run.smithi155.stdout: { 2023-08-01T19:55:49.385 INFO:teuthology.orchestra.run.smithi155.stdout: "event": "waiting for subops from 0", 2023-08-01T19:55:49.385 INFO:teuthology.orchestra.run.smithi155.stdout: "time": "2023-08-01T19:55:49.355731+0000", 2023-08-01T19:55:49.385 INFO:teuthology.orchestra.run.smithi155.stdout: "duration": 0.00034008900000000002 2023-08-01T19:55:49.385 INFO:teuthology.orchestra.run.smithi155.stdout: } 2023-08-01T19:55:49.385 INFO:teuthology.orchestra.run.smithi155.stdout: ] 2023-08-01T19:55:49.385 INFO:teuthology.orchestra.run.smithi155.stdout: } 2023-08-01T19:55:49.386 INFO:teuthology.orchestra.run.smithi155.stdout: }, 2023-08-01T19:55:49.386 INFO:teuthology.orchestra.run.smithi155.stdout: { 2023-08-01T19:55:49.386 INFO:teuthology.orchestra.run.smithi155.stdout: "description": "osd_op(client.4668.0:180667 5.9 5:9726ade0:::benchmark_data_smithi006_114134_object47006:head [delete] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e56)", 2023-08-01T19:55:49.386 INFO:teuthology.orchestra.run.smithi155.stdout: "initiated_at": "2023-08-01T19:55:49.355389+0000", 2023-08-01T19:55:49.386 INFO:teuthology.orchestra.run.smithi155.stdout: "age": 0.00351593, 2023-08-01T19:55:49.386 INFO:teuthology.orchestra.run.smithi155.stdout: "duration": 0.0037062689999999999, 2023-08-01T19:55:49.386 INFO:teuthology.orchestra.run.smithi155.stdout: "type_data": { 2023-08-01T19:55:49.386 INFO:teuthology.orchestra.run.smithi155.stdout: "flag_point": "waiting for sub ops", 2023-08-01T19:55:49.387 INFO:teuthology.orchestra.run.smithi155.stdout: "client_info": { 2023-08-01T19:55:49.387 INFO:teuthology.orchestra.run.smithi155.stdout: "client": "client.4668", 2023-08-01T19:55:49.387 INFO:teuthology.orchestra.run.smithi155.stdout: "client_addr": "172.21.15.6:0/1709472247", 2023-08-01T19:55:49.387 INFO:teuthology.orchestra.run.smithi155.stdout: "tid": 180667 2023-08-01T19:55:49.387 INFO:teuthology.orchestra.run.smithi155.stdout: }, 2023-08-01T19:55:49.387 INFO:teuthology.orchestra.run.smithi155.stdout: "events": [ 2023-08-01T19:55:49.387 INFO:teuthology.orchestra.run.smithi155.stdout: { 2023-08-01T19:55:49.387 INFO:teuthology.orchestra.run.smithi155.stdout: "event": "initiated", 2023-08-01T19:55:49.388 INFO:teuthology.orchestra.run.smithi155.stdout: "time": "2023-08-01T19:55:49.355389+0000", 2023-08-01T19:55:49.388 INFO:teuthology.orchestra.run.smithi155.stdout: "duration": 0 2023-08-01T19:55:49.388 INFO:teuthology.orchestra.run.smithi155.stdout: }, 2023-08-01T19:55:49.388 INFO:teuthology.orchestra.run.smithi155.stdout: { 2023-08-01T19:55:49.388 INFO:teuthology.orchestra.run.smithi155.stdout: "event": "throttled", 2023-08-01T19:55:49.388 INFO:teuthology.orchestra.run.smithi155.stdout: "time": "2023-08-01T19:55:49.355389+0000", 2023-08-01T19:55:49.388 INFO:teuthology.orchestra.run.smithi155.stdout: "duration": 0 2023-08-01T19:55:49.389 INFO:teuthology.orchestra.run.smithi155.stdout: }, 2023-08-01T19:55:49.389 INFO:teuthology.orchestra.run.smithi155.stdout: { 2023-08-01T19:55:49.389 INFO:teuthology.orchestra.run.smithi155.stdout: "event": "header_read", 2023-08-01T19:55:49.389 INFO:teuthology.orchestra.run.smithi155.stdout: "time": "2023-08-01T19:55:49.355388+0000", 2023-08-01T19:55:49.389 INFO:teuthology.orchestra.run.smithi155.stdout: "duration": 4294967295.9999995 2023-08-01T19:55:49.389 INFO:teuthology.orchestra.run.smithi155.stdout: }, 2023-08-01T19:55:49.389 INFO:teuthology.orchestra.run.smithi155.stdout: { 2023-08-01T19:55:49.389 INFO:teuthology.orchestra.run.smithi155.stdout: "event": "all_read", 2023-08-01T19:55:49.390 INFO:teuthology.orchestra.run.smithi155.stdout: "time": "2023-08-01T19:55:49.355392+0000", 2023-08-01T19:55:49.390 INFO:teuthology.orchestra.run.smithi155.stdout: "duration": 3.9319999999999998e-06 2023-08-01T19:55:49.390 INFO:teuthology.orchestra.run.smithi155.stdout: }, 2023-08-01T19:55:49.390 INFO:teuthology.orchestra.run.smithi155.stdout: { 2023-08-01T19:55:49.390 INFO:teuthology.orchestra.run.smithi155.stdout: "event": "dispatched", 2023-08-01T19:55:49.390 INFO:teuthology.orchestra.run.smithi155.stdout: "time": "2023-08-01T19:55:49.355400+0000", 2023-08-01T19:55:49.390 INFO:teuthology.orchestra.run.smithi155.stdout: "duration": 8.0600000000000008e-06 2023-08-01T19:55:49.390 INFO:teuthology.orchestra.run.smithi155.stdout: }, 2023-08-01T19:55:49.391 INFO:teuthology.orchestra.run.smithi155.stdout: { 2023-08-01T19:55:49.391 INFO:teuthology.orchestra.run.smithi155.stdout: "event": "queued_for_pg", 2023-08-01T19:55:49.391 INFO:teuthology.orchestra.run.smithi155.stdout: "time": "2023-08-01T19:55:49.355405+0000", 2023-08-01T19:55:49.391 INFO:teuthology.orchestra.run.smithi155.stdout: "duration": 4.848e-06 2023-08-01T19:55:49.391 INFO:teuthology.orchestra.run.smithi155.stdout: }, 2023-08-01T19:55:49.391 INFO:teuthology.orchestra.run.smithi155.stdout: { 2023-08-01T19:55:49.391 INFO:teuthology.orchestra.run.smithi155.stdout: "event": "reached_pg", 2023-08-01T19:55:49.391 INFO:teuthology.orchestra.run.smithi155.stdout: "time": "2023-08-01T19:55:49.355436+0000", 2023-08-01T19:55:49.392 INFO:teuthology.orchestra.run.smithi155.stdout: "duration": 3.0732999999999999e-05 2023-08-01T19:55:49.392 INFO:teuthology.orchestra.run.smithi155.stdout: }, 2023-08-01T19:55:49.392 INFO:teuthology.orchestra.run.smithi155.stdout: { 2023-08-01T19:55:49.392 INFO:teuthology.orchestra.run.smithi155.stdout: "event": "started", 2023-08-01T19:55:49.392 INFO:teuthology.orchestra.run.smithi155.stdout: "time": "2023-08-01T19:55:49.355557+0000", 2023-08-01T19:55:49.392 INFO:teuthology.orchestra.run.smithi155.stdout: "duration": 0.000121314 2023-08-01T19:55:49.392 INFO:teuthology.orchestra.run.smithi155.stdout: }, 2023-08-01T19:55:49.393 INFO:teuthology.orchestra.run.smithi155.stdout: { 2023-08-01T19:55:49.393 INFO:teuthology.orchestra.run.smithi155.stdout: "event": "waiting for subops from 1", 2023-08-01T19:55:49.393 INFO:teuthology.orchestra.run.smithi155.stdout: "time": "2023-08-01T19:55:49.355682+0000", 2023-08-01T19:55:49.393 INFO:teuthology.orchestra.run.smithi155.stdout: "duration": 0.00012498199999999999 2023-08-01T19:55:49.393 INFO:teuthology.orchestra.run.smithi155.stdout: } 2023-08-01T19:55:49.393 INFO:teuthology.orchestra.run.smithi155.stdout: ] 2023-08-01T19:55:49.393 INFO:teuthology.orchestra.run.smithi155.stdout: } 2023-08-01T19:55:49.393 INFO:teuthology.orchestra.run.smithi155.stdout: }, 2023-08-01T19:55:49.394 INFO:teuthology.orchestra.run.smithi155.stdout: { 2023-08-01T19:55:49.394 INFO:teuthology.orchestra.run.smithi155.stdout: "description": "osd_op(client.4668.0:180672 5.9 5:916aee29:::benchmark_data_smithi006_114134_object47011:head [delete] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e56)", 2023-08-01T19:55:49.394 INFO:teuthology.orchestra.run.smithi155.stdout: "initiated_at": "2023-08-01T19:55:49.356378+0000", 2023-08-01T19:55:49.394 INFO:teuthology.orchestra.run.smithi155.stdout: "age": 0.0025264520000000002, 2023-08-01T19:55:49.394 INFO:teuthology.orchestra.run.smithi155.stdout: "duration": 0.0027608279999999999, 2023-08-01T19:55:49.394 INFO:teuthology.orchestra.run.smithi155.stdout: "type_data": { 2023-08-01T19:55:49.394 INFO:teuthology.orchestra.run.smithi155.stdout: "flag_point": "waiting for sub ops", 2023-08-01T19:55:49.394 INFO:teuthology.orchestra.run.smithi155.stdout: "client_info": { 2023-08-01T19:55:49.395 INFO:teuthology.orchestra.run.smithi155.stdout: "client": "client.4668", 2023-08-01T19:55:49.395 INFO:teuthology.orchestra.run.smithi155.stdout: "client_addr": "172.21.15.6:0/1709472247", 2023-08-01T19:55:49.395 INFO:teuthology.orchestra.run.smithi155.stdout: "tid": 180672 2023-08-01T19:55:49.395 INFO:teuthology.orchestra.run.smithi155.stdout: }, 2023-08-01T19:55:49.395 INFO:teuthology.orchestra.run.smithi155.stdout: "events": [ 2023-08-01T19:55:49.395 INFO:teuthology.orchestra.run.smithi155.stdout: { 2023-08-01T19:55:49.395 INFO:teuthology.orchestra.run.smithi155.stdout: "event": "initiated", 2023-08-01T19:55:49.395 INFO:teuthology.orchestra.run.smithi155.stdout: "time": "2023-08-01T19:55:49.356378+0000", 2023-08-01T19:55:49.396 INFO:teuthology.orchestra.run.smithi155.stdout: "duration": 0 2023-08-01T19:55:49.396 INFO:teuthology.orchestra.run.smithi155.stdout: }, 2023-08-01T19:55:49.396 INFO:teuthology.orchestra.run.smithi155.stdout: { 2023-08-01T19:55:49.396 INFO:teuthology.orchestra.run.smithi155.stdout: "event": "throttled", 2023-08-01T19:55:49.396 INFO:teuthology.orchestra.run.smithi155.stdout: "time": "2023-08-01T19:55:49.356378+0000", 2023-08-01T19:55:49.396 INFO:teuthology.orchestra.run.smithi155.stdout: "duration": 0 2023-08-01T19:55:49.396 INFO:teuthology.orchestra.run.smithi155.stdout: }, 2023-08-01T19:55:49.396 INFO:teuthology.orchestra.run.smithi155.stdout: { 2023-08-01T19:55:49.397 INFO:teuthology.orchestra.run.smithi155.stdout: "event": "header_read", 2023-08-01T19:55:49.397 INFO:teuthology.orchestra.run.smithi155.stdout: "time": "2023-08-01T19:55:49.356378+0000", 2023-08-01T19:55:49.397 INFO:teuthology.orchestra.run.smithi155.stdout: "duration": 4294967295.9999995 2023-08-01T19:55:49.397 INFO:teuthology.orchestra.run.smithi155.stdout: }, 2023-08-01T19:55:49.397 INFO:teuthology.orchestra.run.smithi155.stdout: { 2023-08-01T19:55:49.397 INFO:teuthology.orchestra.run.smithi155.stdout: "event": "all_read", 2023-08-01T19:55:49.397 INFO:teuthology.orchestra.run.smithi155.stdout: "time": "2023-08-01T19:55:49.356382+0000", 2023-08-01T19:55:49.398 INFO:teuthology.orchestra.run.smithi155.stdout: "duration": 3.907e-06 2023-08-01T19:55:49.398 INFO:teuthology.orchestra.run.smithi155.stdout: }, 2023-08-01T19:55:49.398 INFO:teuthology.orchestra.run.smithi155.stdout: { 2023-08-01T19:55:49.398 INFO:teuthology.orchestra.run.smithi155.stdout: "event": "dispatched", 2023-08-01T19:55:49.398 INFO:teuthology.orchestra.run.smithi155.stdout: "time": "2023-08-01T19:55:49.356389+0000", 2023-08-01T19:55:49.398 INFO:teuthology.orchestra.run.smithi155.stdout: "duration": 7.7880000000000007e-06 2023-08-01T19:55:49.398 INFO:teuthology.orchestra.run.smithi155.stdout: }, 2023-08-01T19:55:49.398 INFO:teuthology.orchestra.run.smithi155.stdout: { 2023-08-01T19:55:49.399 INFO:teuthology.orchestra.run.smithi155.stdout: "event": "queued_for_pg", 2023-08-01T19:55:49.399 INFO:teuthology.orchestra.run.smithi155.stdout: "time": "2023-08-01T19:55:49.356393+0000", 2023-08-01T19:55:49.399 INFO:teuthology.orchestra.run.smithi155.stdout: "duration": 3.4589999999999998e-06 2023-08-01T19:55:49.399 INFO:teuthology.orchestra.run.smithi155.stdout: }, 2023-08-01T19:55:49.399 INFO:teuthology.orchestra.run.smithi155.stdout: { 2023-08-01T19:55:49.399 INFO:teuthology.orchestra.run.smithi155.stdout: "event": "reached_pg", 2023-08-01T19:55:49.399 INFO:teuthology.orchestra.run.smithi155.stdout: "time": "2023-08-01T19:55:49.357194+0000", 2023-08-01T19:55:49.399 INFO:teuthology.orchestra.run.smithi155.stdout: "duration": 0.00080066800000000004 2023-08-01T19:55:49.400 INFO:teuthology.orchestra.run.smithi155.stdout: }, 2023-08-01T19:55:49.400 INFO:teuthology.orchestra.run.smithi155.stdout: { 2023-08-01T19:55:49.400 INFO:teuthology.orchestra.run.smithi155.stdout: "event": "started", 2023-08-01T19:55:49.400 INFO:teuthology.orchestra.run.smithi155.stdout: "time": "2023-08-01T19:55:49.357269+0000", 2023-08-01T19:55:49.400 INFO:teuthology.orchestra.run.smithi155.stdout: "duration": 7.5211999999999997e-05 2023-08-01T19:55:49.400 INFO:teuthology.orchestra.run.smithi155.stdout: }, 2023-08-01T19:55:49.400 INFO:teuthology.orchestra.run.smithi155.stdout: { 2023-08-01T19:55:49.400 INFO:teuthology.orchestra.run.smithi155.stdout: "event": "waiting for subops from 1", 2023-08-01T19:55:49.401 INFO:teuthology.orchestra.run.smithi155.stdout: "time": "2023-08-01T19:55:49.357335+0000", 2023-08-01T19:55:49.401 INFO:teuthology.orchestra.run.smithi155.stdout: "duration": 6.6019000000000006e-05 2023-08-01T19:55:49.401 INFO:teuthology.orchestra.run.smithi155.stdout: } 2023-08-01T19:55:49.401 INFO:teuthology.orchestra.run.smithi155.stdout: ] 2023-08-01T19:55:49.401 INFO:teuthology.orchestra.run.smithi155.stdout: } 2023-08-01T19:55:49.401 INFO:teuthology.orchestra.run.smithi155.stdout: }, 2023-08-01T19:55:49.401 INFO:teuthology.orchestra.run.smithi155.stdout: { 2023-08-01T19:55:49.402 INFO:teuthology.orchestra.run.smithi155.stdout: "description": "osd_op(client.4668.0:180676 5.8 5:1b594d28:::benchmark_data_smithi006_114134_object47015:head [delete] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e56)", 2023-08-01T19:55:49.402 INFO:teuthology.orchestra.run.smithi155.stdout: "initiated_at": "2023-08-01T19:55:49.358313+0000", 2023-08-01T19:55:49.402 INFO:teuthology.orchestra.run.smithi155.stdout: "age": 0.00059190600000000001, 2023-08-01T19:55:49.402 INFO:teuthology.orchestra.run.smithi155.stdout: "duration": 0.00087671500000000002, 2023-08-01T19:55:49.402 INFO:teuthology.orchestra.run.smithi155.stdout: "type_data": { 2023-08-01T19:55:49.402 INFO:teuthology.orchestra.run.smithi155.stdout: "flag_point": "waiting for sub ops", 2023-08-01T19:55:49.402 INFO:teuthology.orchestra.run.smithi155.stdout: "client_info": { 2023-08-01T19:55:49.402 INFO:teuthology.orchestra.run.smithi155.stdout: "client": "client.4668", 2023-08-01T19:55:49.403 INFO:teuthology.orchestra.run.smithi155.stdout: "client_addr": "172.21.15.6:0/1709472247", 2023-08-01T19:55:49.403 INFO:teuthology.orchestra.run.smithi155.stdout: "tid": 180676 2023-08-01T19:55:49.403 INFO:teuthology.orchestra.run.smithi155.stdout: }, 2023-08-01T19:55:49.403 INFO:teuthology.orchestra.run.smithi155.stdout: "events": [ 2023-08-01T19:55:49.403 INFO:teuthology.orchestra.run.smithi155.stdout: { 2023-08-01T19:55:49.403 INFO:teuthology.orchestra.run.smithi155.stdout: "event": "initiated", 2023-08-01T19:55:49.403 INFO:teuthology.orchestra.run.smithi155.stdout: "time": "2023-08-01T19:55:49.358313+0000", 2023-08-01T19:55:49.403 INFO:teuthology.orchestra.run.smithi155.stdout: "duration": 0 2023-08-01T19:55:49.404 INFO:teuthology.orchestra.run.smithi155.stdout: }, 2023-08-01T19:55:49.404 INFO:teuthology.orchestra.run.smithi155.stdout: { 2023-08-01T19:55:49.404 INFO:teuthology.orchestra.run.smithi155.stdout: "event": "throttled", 2023-08-01T19:55:49.404 INFO:teuthology.orchestra.run.smithi155.stdout: "time": "2023-08-01T19:55:49.358313+0000", 2023-08-01T19:55:49.404 INFO:teuthology.orchestra.run.smithi155.stdout: "duration": 0 2023-08-01T19:55:49.404 INFO:teuthology.orchestra.run.smithi155.stdout: }, 2023-08-01T19:55:49.404 INFO:teuthology.orchestra.run.smithi155.stdout: { 2023-08-01T19:55:49.405 INFO:teuthology.orchestra.run.smithi155.stdout: "event": "header_read", 2023-08-01T19:55:49.405 INFO:teuthology.orchestra.run.smithi155.stdout: "time": "2023-08-01T19:55:49.358312+0000", 2023-08-01T19:55:49.405 INFO:teuthology.orchestra.run.smithi155.stdout: "duration": 4294967295.999999 2023-08-01T19:55:49.405 INFO:teuthology.orchestra.run.smithi155.stdout: }, 2023-08-01T19:55:49.405 INFO:teuthology.orchestra.run.smithi155.stdout: { 2023-08-01T19:55:49.405 INFO:teuthology.orchestra.run.smithi155.stdout: "event": "all_read", 2023-08-01T19:55:49.405 INFO:teuthology.orchestra.run.smithi155.stdout: "time": "2023-08-01T19:55:49.358317+0000", 2023-08-01T19:55:49.405 INFO:teuthology.orchestra.run.smithi155.stdout: "duration": 4.7509999999999999e-06 2023-08-01T19:55:49.406 INFO:teuthology.orchestra.run.smithi155.stdout: }, 2023-08-01T19:55:49.406 INFO:teuthology.orchestra.run.smithi155.stdout: { 2023-08-01T19:55:49.406 INFO:teuthology.orchestra.run.smithi155.stdout: "event": "dispatched", 2023-08-01T19:55:49.406 INFO:teuthology.orchestra.run.smithi155.stdout: "time": "2023-08-01T19:55:49.358330+0000", 2023-08-01T19:55:49.406 INFO:teuthology.orchestra.run.smithi155.stdout: "duration": 1.3719e-05 2023-08-01T19:55:49.406 INFO:teuthology.orchestra.run.smithi155.stdout: }, 2023-08-01T19:55:49.406 INFO:teuthology.orchestra.run.smithi155.stdout: { 2023-08-01T19:55:49.407 INFO:teuthology.orchestra.run.smithi155.stdout: "event": "queued_for_pg", 2023-08-01T19:55:49.407 INFO:teuthology.orchestra.run.smithi155.stdout: "time": "2023-08-01T19:55:49.358336+0000", 2023-08-01T19:55:49.407 INFO:teuthology.orchestra.run.smithi155.stdout: "duration": 5.998e-06 2023-08-01T19:55:49.407 INFO:teuthology.orchestra.run.smithi155.stdout: }, 2023-08-01T19:55:49.407 INFO:teuthology.orchestra.run.smithi155.stdout: { 2023-08-01T19:55:49.407 INFO:teuthology.orchestra.run.smithi155.stdout: "event": "reached_pg", 2023-08-01T19:55:49.407 INFO:teuthology.orchestra.run.smithi155.stdout: "time": "2023-08-01T19:55:49.358369+0000", 2023-08-01T19:55:49.407 INFO:teuthology.orchestra.run.smithi155.stdout: "duration": 3.2592000000000002e-05 2023-08-01T19:55:49.408 INFO:teuthology.orchestra.run.smithi155.stdout: }, 2023-08-01T19:55:49.408 INFO:teuthology.orchestra.run.smithi155.stdout: { 2023-08-01T19:55:49.408 INFO:teuthology.orchestra.run.smithi155.stdout: "event": "started", 2023-08-01T19:55:49.408 INFO:teuthology.orchestra.run.smithi155.stdout: "time": "2023-08-01T19:55:49.358483+0000", 2023-08-01T19:55:49.408 INFO:teuthology.orchestra.run.smithi155.stdout: "duration": 0.00011414800000000001 2023-08-01T19:55:49.408 INFO:teuthology.orchestra.run.smithi155.stdout: }, 2023-08-01T19:55:49.408 INFO:teuthology.orchestra.run.smithi155.stdout: { 2023-08-01T19:55:49.408 INFO:teuthology.orchestra.run.smithi155.stdout: "event": "waiting for subops from 0", 2023-08-01T19:55:49.409 INFO:teuthology.orchestra.run.smithi155.stdout: "time": "2023-08-01T19:55:49.358596+0000", 2023-08-01T19:55:49.409 INFO:teuthology.orchestra.run.smithi155.stdout: "duration": 0.000112897 2023-08-01T19:55:49.409 INFO:teuthology.orchestra.run.smithi155.stdout: } 2023-08-01T19:55:49.409 INFO:teuthology.orchestra.run.smithi155.stdout: ] 2023-08-01T19:55:49.409 INFO:teuthology.orchestra.run.smithi155.stdout: } 2023-08-01T19:55:49.409 INFO:teuthology.orchestra.run.smithi155.stdout: } 2023-08-01T19:55:49.409 INFO:teuthology.orchestra.run.smithi155.stdout: ], 2023-08-01T19:55:49.410 INFO:teuthology.orchestra.run.smithi155.stdout: "num_ops": 6 2023-08-01T19:55:49.410 INFO:teuthology.orchestra.run.smithi155.stdout:} 2023-08-01T19:55:49.411 DEBUG:teuthology.orchestra.run.smithi155:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 30 ceph --cluster ceph --admin-daemon /var/run/ceph/ceph-osd.2.asok dump_blocked_ops 2023-08-01T19:55:49.411 INFO:tasks.ceph.osd.2.smithi155.stderr:2023-08-01T19:55:49.409+0000 7faa5c6ac700 -1 received signal: Hangup from /usr/bin/python3 /bin/daemon-helper kill ceph-osd -f --cluster ceph -i 2 (PID: 111337) UID: 0 2023-08-01T19:55:49.512 INFO:tasks.ceph.osd.2.smithi155.stderr:2023-08-01T19:55:49.510+0000 7faa5c6ac700 -1 received signal: Hangup from /usr/bin/python3 /bin/daemon-helper kill ceph-osd -f --cluster ceph -i 2 (PID: 111337) UID: 0 2023-08-01T19:55:49.607 INFO:teuthology.orchestra.run.smithi155.stdout:{ 2023-08-01T19:55:49.607 INFO:teuthology.orchestra.run.smithi155.stdout: "ops": [], 2023-08-01T19:55:49.607 INFO:teuthology.orchestra.run.smithi155.stdout: "complaint_time": 30, 2023-08-01T19:55:49.608 INFO:teuthology.orchestra.run.smithi155.stdout: "num_blocked_ops": 0 2023-08-01T19:55:49.608 INFO:teuthology.orchestra.run.smithi155.stdout:} 2023-08-01T19:55:49.613 INFO:tasks.ceph.osd.0.smithi008.stderr:2023-08-01T19:55:49.611+0000 7f16a58f4700 -1 received signal: Hangup from /usr/bin/python3 /bin/daemon-helper kill ceph-osd -f --cluster ceph -i 0 (PID: 111179) UID: 0 2023-08-01T19:55:49.621 DEBUG:teuthology.orchestra.run.smithi155:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 30 ceph --cluster ceph --admin-daemon /var/run/ceph/ceph-osd.2.asok dump_historic_ops 2023-08-01T19:55:49.713 INFO:tasks.ceph.osd.2.smithi155.stderr:2023-08-01T19:55:49.712+0000 7faa5c6ac700 -1 received signal: Hangup from /usr/bin/python3 /bin/daemon-helper kill ceph-osd -f --cluster ceph -i 2 (PID: 111337) UID: 0 2023-08-01T19:55:49.815 INFO:tasks.ceph.osd.0.smithi008.stderr:2023-08-01T19:55:49.813+0000 7f16a58f4700 -1 received signal: Hangup from /usr/bin/python3 /bin/daemon-helper kill ceph-osd -f --cluster ceph -i 0 (PID: 111179) UID: 0 2023-08-01T19:55:49.834 INFO:teuthology.orchestra.run.smithi155.stdout:{ 2023-08-01T19:55:49.834 INFO:teuthology.orchestra.run.smithi155.stdout: "size": 20, 2023-08-01T19:55:49.834 INFO:teuthology.orchestra.run.smithi155.stdout: "duration": 600, 2023-08-01T19:55:49.834 INFO:teuthology.orchestra.run.smithi155.stdout: "ops": [ 2023-08-01T19:55:49.834 INFO:teuthology.orchestra.run.smithi155.stdout: { 2023-08-01T19:55:49.835 INFO:teuthology.orchestra.run.smithi155.stdout: "description": "osd_op(client.4668.0:73454 5.8 5:15596b2f:::benchmark_data_smithi006_114134_object73453:head [set-alloc-hint object_size 65536 write_size 65536,write 0~65536] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e31)", 2023-08-01T19:55:49.835 INFO:teuthology.orchestra.run.smithi155.stdout: "initiated_at": "2023-08-01T19:54:51.460020+0000", 2023-08-01T19:55:49.835 INFO:teuthology.orchestra.run.smithi155.stdout: "age": 58.371046217999996, 2023-08-01T19:55:49.835 INFO:teuthology.orchestra.run.smithi155.stdout: "duration": 0.022889436999999999, 2023-08-01T19:55:49.835 INFO:teuthology.orchestra.run.smithi155.stdout: "type_data": { 2023-08-01T19:55:49.835 INFO:teuthology.orchestra.run.smithi155.stdout: "flag_point": "commit sent; apply or cleanup", 2023-08-01T19:55:49.835 INFO:teuthology.orchestra.run.smithi155.stdout: "client_info": { 2023-08-01T19:55:49.836 INFO:teuthology.orchestra.run.smithi155.stdout: "client": "client.4668", 2023-08-01T19:55:49.836 INFO:teuthology.orchestra.run.smithi155.stdout: "client_addr": "172.21.15.6:0/1709472247", 2023-08-01T19:55:49.836 INFO:teuthology.orchestra.run.smithi155.stdout: "tid": 73454 2023-08-01T19:55:49.836 INFO:teuthology.orchestra.run.smithi155.stdout: }, 2023-08-01T19:55:49.836 INFO:teuthology.orchestra.run.smithi155.stdout: "events": [ 2023-08-01T19:55:49.836 INFO:teuthology.orchestra.run.smithi155.stdout: { 2023-08-01T19:55:49.836 INFO:teuthology.orchestra.run.smithi155.stdout: "event": "initiated", 2023-08-01T19:55:49.837 INFO:teuthology.orchestra.run.smithi155.stdout: "time": "2023-08-01T19:54:51.460020+0000", 2023-08-01T19:55:49.837 INFO:teuthology.orchestra.run.smithi155.stdout: "duration": 0 2023-08-01T19:55:49.837 INFO:teuthology.orchestra.run.smithi155.stdout: }, 2023-08-01T19:55:49.837 INFO:teuthology.orchestra.run.smithi155.stdout: { 2023-08-01T19:55:49.837 INFO:teuthology.orchestra.run.smithi155.stdout: "event": "throttled", 2023-08-01T19:55:49.837 INFO:teuthology.orchestra.run.smithi155.stdout: "time": "2023-08-01T19:54:51.460020+0000", 2023-08-01T19:55:49.838 INFO:teuthology.orchestra.run.smithi155.stdout: "duration": 0 2023-08-01T19:55:49.838 INFO:teuthology.orchestra.run.smithi155.stdout: }, 2023-08-01T19:55:49.838 INFO:teuthology.orchestra.run.smithi155.stdout: { 2023-08-01T19:55:49.838 INFO:teuthology.orchestra.run.smithi155.stdout: "event": "header_read", 2023-08-01T19:55:49.838 INFO:teuthology.orchestra.run.smithi155.stdout: "time": "2023-08-01T19:54:51.460019+0000", 2023-08-01T19:55:49.838 INFO:teuthology.orchestra.run.smithi155.stdout: "duration": 4294967295.9999995 2023-08-01T19:55:49.839 INFO:teuthology.orchestra.run.smithi155.stdout: }, 2023-08-01T19:55:49.839 INFO:teuthology.orchestra.run.smithi155.stdout: { 2023-08-01T19:55:49.839 INFO:teuthology.orchestra.run.smithi155.stdout: "event": "all_read", 2023-08-01T19:55:49.839 INFO:teuthology.orchestra.run.smithi155.stdout: "time": "2023-08-01T19:54:51.460051+0000", 2023-08-01T19:55:49.839 INFO:teuthology.orchestra.run.smithi155.stdout: "duration": 3.1736000000000002e-05 2023-08-01T19:55:49.839 INFO:teuthology.orchestra.run.smithi155.stdout: }, 2023-08-01T19:55:49.839 INFO:teuthology.orchestra.run.smithi155.stdout: { 2023-08-01T19:55:49.840 INFO:teuthology.orchestra.run.smithi155.stdout: "event": "dispatched", 2023-08-01T19:55:49.840 INFO:teuthology.orchestra.run.smithi155.stdout: "time": "2023-08-01T19:54:51.460058+0000", 2023-08-01T19:55:49.840 INFO:teuthology.orchestra.run.smithi155.stdout: "duration": 7.3869999999999997e-06 2023-08-01T19:55:49.840 INFO:teuthology.orchestra.run.smithi155.stdout: }, 2023-08-01T19:55:49.840 INFO:teuthology.orchestra.run.smithi155.stdout: { 2023-08-01T19:55:49.840 INFO:teuthology.orchestra.run.smithi155.stdout: "event": "queued_for_pg", 2023-08-01T19:55:49.841 INFO:teuthology.orchestra.run.smithi155.stdout: "time": "2023-08-01T19:54:51.460062+0000", 2023-08-01T19:55:49.841 INFO:teuthology.orchestra.run.smithi155.stdout: "duration": 4.352e-06 2023-08-01T19:55:49.841 INFO:teuthology.orchestra.run.smithi155.stdout: }, 2023-08-01T19:55:49.841 INFO:teuthology.orchestra.run.smithi155.stdout: { 2023-08-01T19:55:49.841 INFO:teuthology.orchestra.run.smithi155.stdout: "event": "reached_pg", 2023-08-01T19:55:49.841 INFO:teuthology.orchestra.run.smithi155.stdout: "time": "2023-08-01T19:54:51.460101+0000", 2023-08-01T19:55:49.842 INFO:teuthology.orchestra.run.smithi155.stdout: "duration": 3.8705000000000003e-05 2023-08-01T19:55:49.842 INFO:teuthology.orchestra.run.smithi155.stdout: }, 2023-08-01T19:55:49.842 INFO:teuthology.orchestra.run.smithi155.stdout: { 2023-08-01T19:55:49.842 INFO:teuthology.orchestra.run.smithi155.stdout: "event": "started", 2023-08-01T19:55:49.842 INFO:teuthology.orchestra.run.smithi155.stdout: "time": "2023-08-01T19:54:51.460236+0000", 2023-08-01T19:55:49.842 INFO:teuthology.orchestra.run.smithi155.stdout: "duration": 0.00013463599999999999 2023-08-01T19:55:49.842 INFO:teuthology.orchestra.run.smithi155.stdout: }, 2023-08-01T19:55:49.842 INFO:teuthology.orchestra.run.smithi155.stdout: { 2023-08-01T19:55:49.843 INFO:teuthology.orchestra.run.smithi155.stdout: "event": "waiting for subops from 0", 2023-08-01T19:55:49.843 INFO:teuthology.orchestra.run.smithi155.stdout: "time": "2023-08-01T19:54:51.460391+0000", 2023-08-01T19:55:49.843 INFO:teuthology.orchestra.run.smithi155.stdout: "duration": 0.00015525000000000001 2023-08-01T19:55:49.843 INFO:teuthology.orchestra.run.smithi155.stdout: }, 2023-08-01T19:55:49.843 INFO:teuthology.orchestra.run.smithi155.stdout: { 2023-08-01T19:55:49.843 INFO:teuthology.orchestra.run.smithi155.stdout: "event": "sub_op_commit_rec", 2023-08-01T19:55:49.844 INFO:teuthology.orchestra.run.smithi155.stdout: "time": "2023-08-01T19:54:51.468393+0000", 2023-08-01T19:55:49.844 INFO:teuthology.orchestra.run.smithi155.stdout: "duration": 0.00800208 2023-08-01T19:55:49.844 INFO:teuthology.orchestra.run.smithi155.stdout: }, 2023-08-01T19:55:49.844 INFO:teuthology.orchestra.run.smithi155.stdout: { 2023-08-01T19:55:49.844 INFO:teuthology.orchestra.run.smithi155.stdout: "event": "op_commit", 2023-08-01T19:55:49.844 INFO:teuthology.orchestra.run.smithi155.stdout: "time": "2023-08-01T19:54:51.482815+0000", 2023-08-01T19:55:49.844 INFO:teuthology.orchestra.run.smithi155.stdout: "duration": 0.01442148 2023-08-01T19:55:49.845 INFO:teuthology.orchestra.run.smithi155.stdout: }, 2023-08-01T19:55:49.845 INFO:teuthology.orchestra.run.smithi155.stdout: { 2023-08-01T19:55:49.845 INFO:teuthology.orchestra.run.smithi155.stdout: "event": "commit_sent", 2023-08-01T19:55:49.845 INFO:teuthology.orchestra.run.smithi155.stdout: "time": "2023-08-01T19:54:51.482866+0000", 2023-08-01T19:55:49.845 INFO:teuthology.orchestra.run.smithi155.stdout: "duration": 5.1842999999999998e-05 2023-08-01T19:55:49.845 INFO:teuthology.orchestra.run.smithi155.stdout: }, 2023-08-01T19:55:49.845 INFO:teuthology.orchestra.run.smithi155.stdout: { 2023-08-01T19:55:49.846 INFO:teuthology.orchestra.run.smithi155.stdout: "event": "done", 2023-08-01T19:55:49.846 INFO:teuthology.orchestra.run.smithi155.stdout: "time": "2023-08-01T19:54:51.482909+0000", 2023-08-01T19:55:49.846 INFO:teuthology.orchestra.run.smithi155.stdout: "duration": 4.2663000000000001e-05 2023-08-01T19:55:49.846 INFO:teuthology.orchestra.run.smithi155.stdout: } 2023-08-01T19:55:49.846 INFO:teuthology.orchestra.run.smithi155.stdout: ] 2023-08-01T19:55:49.846 INFO:teuthology.orchestra.run.smithi155.stdout: } 2023-08-01T19:55:49.846 INFO:teuthology.orchestra.run.smithi155.stdout: }, 2023-08-01T19:55:49.847 INFO:teuthology.orchestra.run.smithi155.stdout: { 2023-08-01T19:55:49.847 INFO:teuthology.orchestra.run.smithi155.stdout: "description": "osd_op(client.4668.0:73455 5.b 5:de51121e:::benchmark_data_smithi006_114134_object73454:head [set-alloc-hint object_size 65536 write_size 65536,write 0~65536] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e31)", 2023-08-01T19:55:49.847 INFO:teuthology.orchestra.run.smithi155.stdout: "initiated_at": "2023-08-01T19:54:51.460078+0000", 2023-08-01T19:55:49.847 INFO:teuthology.orchestra.run.smithi155.stdout: "age": 58.370988244000003, 2023-08-01T19:55:49.847 INFO:teuthology.orchestra.run.smithi155.stdout: "duration": 0.022689121999999999, 2023-08-01T19:55:49.847 INFO:teuthology.orchestra.run.smithi155.stdout: "type_data": { 2023-08-01T19:55:49.847 INFO:teuthology.orchestra.run.smithi155.stdout: "flag_point": "commit sent; apply or cleanup", 2023-08-01T19:55:49.848 INFO:teuthology.orchestra.run.smithi155.stdout: "client_info": { 2023-08-01T19:55:49.848 INFO:teuthology.orchestra.run.smithi155.stdout: "client": "client.4668", 2023-08-01T19:55:49.848 INFO:teuthology.orchestra.run.smithi155.stdout: "client_addr": "172.21.15.6:0/1709472247", 2023-08-01T19:55:49.848 INFO:teuthology.orchestra.run.smithi155.stdout: "tid": 73455 2023-08-01T19:55:49.848 INFO:teuthology.orchestra.run.smithi155.stdout: }, 2023-08-01T19:55:49.848 INFO:teuthology.orchestra.run.smithi155.stdout: "events": [ 2023-08-01T19:55:49.848 INFO:teuthology.orchestra.run.smithi155.stdout: { 2023-08-01T19:55:49.849 INFO:teuthology.orchestra.run.smithi155.stdout: "event": "initiated", 2023-08-01T19:55:49.849 INFO:teuthology.orchestra.run.smithi155.stdout: "time": "2023-08-01T19:54:51.460078+0000", 2023-08-01T19:55:49.849 INFO:teuthology.orchestra.run.smithi155.stdout: "duration": 0 2023-08-01T19:55:49.849 INFO:teuthology.orchestra.run.smithi155.stdout: }, 2023-08-01T19:55:49.849 INFO:teuthology.orchestra.run.smithi155.stdout: { 2023-08-01T19:55:49.849 INFO:teuthology.orchestra.run.smithi155.stdout: "event": "throttled", 2023-08-01T19:55:49.850 INFO:teuthology.orchestra.run.smithi155.stdout: "time": "2023-08-01T19:54:51.460078+0000", 2023-08-01T19:55:49.850 INFO:teuthology.orchestra.run.smithi155.stdout: "duration": 0 2023-08-01T19:55:49.850 INFO:teuthology.orchestra.run.smithi155.stdout: }, 2023-08-01T19:55:49.850 INFO:teuthology.orchestra.run.smithi155.stdout: { 2023-08-01T19:55:49.850 INFO:teuthology.orchestra.run.smithi155.stdout: "event": "header_read", 2023-08-01T19:55:49.850 INFO:teuthology.orchestra.run.smithi155.stdout: "time": "2023-08-01T19:54:51.460077+0000", 2023-08-01T19:55:49.850 INFO:teuthology.orchestra.run.smithi155.stdout: "duration": 4294967295.9999995 2023-08-01T19:55:49.851 INFO:teuthology.orchestra.run.smithi155.stdout: }, 2023-08-01T19:55:49.851 INFO:teuthology.orchestra.run.smithi155.stdout: { 2023-08-01T19:55:49.851 INFO:teuthology.orchestra.run.smithi155.stdout: "event": "all_read", 2023-08-01T19:55:49.851 INFO:teuthology.orchestra.run.smithi155.stdout: "time": "2023-08-01T19:54:51.460102+0000", 2023-08-01T19:55:49.851 INFO:teuthology.orchestra.run.smithi155.stdout: "duration": 2.4933e-05 2023-08-01T19:55:49.851 INFO:teuthology.orchestra.run.smithi155.stdout: }, 2023-08-01T19:55:49.851 INFO:teuthology.orchestra.run.smithi155.stdout: { 2023-08-01T19:55:49.851 INFO:teuthology.orchestra.run.smithi155.stdout: "event": "dispatched", 2023-08-01T19:55:49.852 INFO:teuthology.orchestra.run.smithi155.stdout: "time": "2023-08-01T19:54:51.460109+0000", 2023-08-01T19:55:49.852 INFO:teuthology.orchestra.run.smithi155.stdout: "duration": 7.0720000000000002e-06 2023-08-01T19:55:49.852 INFO:teuthology.orchestra.run.smithi155.stdout: }, 2023-08-01T19:55:49.852 INFO:teuthology.orchestra.run.smithi155.stdout: { 2023-08-01T19:55:49.852 INFO:teuthology.orchestra.run.smithi155.stdout: "event": "queued_for_pg", 2023-08-01T19:55:49.852 INFO:teuthology.orchestra.run.smithi155.stdout: "time": "2023-08-01T19:54:51.460113+0000", 2023-08-01T19:55:49.852 INFO:teuthology.orchestra.run.smithi155.stdout: "duration": 4.3220000000000003e-06 2023-08-01T19:55:49.853 INFO:teuthology.orchestra.run.smithi155.stdout: }, 2023-08-01T19:55:49.853 INFO:teuthology.orchestra.run.smithi155.stdout: { 2023-08-01T19:55:49.853 INFO:teuthology.orchestra.run.smithi155.stdout: "event": "reached_pg", 2023-08-01T19:55:49.853 INFO:teuthology.orchestra.run.smithi155.stdout: "time": "2023-08-01T19:54:51.460955+0000", 2023-08-01T19:55:49.853 INFO:teuthology.orchestra.run.smithi155.stdout: "duration": 0.00084142500000000003 2023-08-01T19:55:49.853 INFO:teuthology.orchestra.run.smithi155.stdout: }, 2023-08-01T19:55:49.853 INFO:teuthology.orchestra.run.smithi155.stdout: { 2023-08-01T19:55:49.854 INFO:teuthology.orchestra.run.smithi155.stdout: "event": "started", 2023-08-01T19:55:49.854 INFO:teuthology.orchestra.run.smithi155.stdout: "time": "2023-08-01T19:54:51.461079+0000", 2023-08-01T19:55:49.854 INFO:teuthology.orchestra.run.smithi155.stdout: "duration": 0.000123826 2023-08-01T19:55:49.854 INFO:teuthology.orchestra.run.smithi155.stdout: }, 2023-08-01T19:55:49.854 INFO:teuthology.orchestra.run.smithi155.stdout: { 2023-08-01T19:55:49.854 INFO:teuthology.orchestra.run.smithi155.stdout: "event": "waiting for subops from 0", 2023-08-01T19:55:49.854 INFO:teuthology.orchestra.run.smithi155.stdout: "time": "2023-08-01T19:54:51.461233+0000", 2023-08-01T19:55:49.855 INFO:teuthology.orchestra.run.smithi155.stdout: "duration": 0.00015431900000000001 2023-08-01T19:55:49.855 INFO:teuthology.orchestra.run.smithi155.stdout: }, 2023-08-01T19:55:49.855 INFO:teuthology.orchestra.run.smithi155.stdout: { 2023-08-01T19:55:49.855 INFO:teuthology.orchestra.run.smithi155.stdout: "event": "sub_op_commit_rec", 2023-08-01T19:55:49.855 INFO:teuthology.orchestra.run.smithi155.stdout: "time": "2023-08-01T19:54:51.468509+0000", 2023-08-01T19:55:49.855 INFO:teuthology.orchestra.run.smithi155.stdout: "duration": 0.0072759859999999999 2023-08-01T19:55:49.855 INFO:teuthology.orchestra.run.smithi155.stdout: }, 2023-08-01T19:55:49.856 INFO:teuthology.orchestra.run.smithi155.stdout: { 2023-08-01T19:55:49.856 INFO:teuthology.orchestra.run.smithi155.stdout: "event": "op_commit", 2023-08-01T19:55:49.856 INFO:teuthology.orchestra.run.smithi155.stdout: "time": "2023-08-01T19:54:51.482704+0000", 2023-08-01T19:55:49.856 INFO:teuthology.orchestra.run.smithi155.stdout: "duration": 0.01419545 2023-08-01T19:55:49.856 INFO:teuthology.orchestra.run.smithi155.stdout: }, 2023-08-01T19:55:49.856 INFO:teuthology.orchestra.run.smithi155.stdout: { 2023-08-01T19:55:49.856 INFO:teuthology.orchestra.run.smithi155.stdout: "event": "commit_sent", 2023-08-01T19:55:49.857 INFO:teuthology.orchestra.run.smithi155.stdout: "time": "2023-08-01T19:54:51.482747+0000", 2023-08-01T19:55:49.857 INFO:teuthology.orchestra.run.smithi155.stdout: "duration": 4.2413999999999997e-05 2023-08-01T19:55:49.857 INFO:teuthology.orchestra.run.smithi155.stdout: }, 2023-08-01T19:55:49.857 INFO:teuthology.orchestra.run.smithi155.stdout: { 2023-08-01T19:55:49.857 INFO:teuthology.orchestra.run.smithi155.stdout: "event": "done", 2023-08-01T19:55:49.857 INFO:teuthology.orchestra.run.smithi155.stdout: "time": "2023-08-01T19:54:51.482767+0000", 2023-08-01T19:55:49.857 INFO:teuthology.orchestra.run.smithi155.stdout: "duration": 1.9908999999999999e-05 2023-08-01T19:55:49.857 INFO:teuthology.orchestra.run.smithi155.stdout: } 2023-08-01T19:55:49.858 INFO:teuthology.orchestra.run.smithi155.stdout: ] 2023-08-01T19:55:49.858 INFO:teuthology.orchestra.run.smithi155.stdout: } 2023-08-01T19:55:49.858 INFO:teuthology.orchestra.run.smithi155.stdout: }, 2023-08-01T19:55:49.858 INFO:teuthology.orchestra.run.smithi155.stdout: { 2023-08-01T19:55:49.858 INFO:teuthology.orchestra.run.smithi155.stdout: "description": "osd_op(client.4668.0:73456 5.0 5:0164baf4:::benchmark_data_smithi006_114134_object73455:head [set-alloc-hint object_size 65536 write_size 65536,write 0~65536] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e31)", 2023-08-01T19:55:49.858 INFO:teuthology.orchestra.run.smithi155.stdout: "initiated_at": "2023-08-01T19:54:51.461520+0000", 2023-08-01T19:55:49.858 INFO:teuthology.orchestra.run.smithi155.stdout: "age": 58.369546253999999, 2023-08-01T19:55:49.859 INFO:teuthology.orchestra.run.smithi155.stdout: "duration": 0.023899916, 2023-08-01T19:55:49.859 INFO:teuthology.orchestra.run.smithi155.stdout: "type_data": { 2023-08-01T19:55:49.859 INFO:teuthology.orchestra.run.smithi155.stdout: "flag_point": "commit sent; apply or cleanup", 2023-08-01T19:55:49.859 INFO:teuthology.orchestra.run.smithi155.stdout: "client_info": { 2023-08-01T19:55:49.859 INFO:teuthology.orchestra.run.smithi155.stdout: "client": "client.4668", 2023-08-01T19:55:49.859 INFO:teuthology.orchestra.run.smithi155.stdout: "client_addr": "172.21.15.6:0/1709472247", 2023-08-01T19:55:49.859 INFO:teuthology.orchestra.run.smithi155.stdout: "tid": 73456 2023-08-01T19:55:49.860 INFO:teuthology.orchestra.run.smithi155.stdout: }, 2023-08-01T19:55:49.860 INFO:teuthology.orchestra.run.smithi155.stdout: "events": [ 2023-08-01T19:55:49.860 INFO:teuthology.orchestra.run.smithi155.stdout: { 2023-08-01T19:55:49.860 INFO:teuthology.orchestra.run.smithi155.stdout: "event": "initiated", 2023-08-01T19:55:49.860 INFO:teuthology.orchestra.run.smithi155.stdout: "time": "2023-08-01T19:54:51.461520+0000", 2023-08-01T19:55:49.860 INFO:teuthology.orchestra.run.smithi155.stdout: "duration": 0 2023-08-01T19:55:49.860 INFO:teuthology.orchestra.run.smithi155.stdout: }, 2023-08-01T19:55:49.861 INFO:teuthology.orchestra.run.smithi155.stdout: { 2023-08-01T19:55:49.861 INFO:teuthology.orchestra.run.smithi155.stdout: "event": "throttled", 2023-08-01T19:55:49.861 INFO:teuthology.orchestra.run.smithi155.stdout: "time": "2023-08-01T19:54:51.461520+0000", 2023-08-01T19:55:49.861 INFO:teuthology.orchestra.run.smithi155.stdout: "duration": 0 2023-08-01T19:55:49.861 INFO:teuthology.orchestra.run.smithi155.stdout: }, 2023-08-01T19:55:49.861 INFO:teuthology.orchestra.run.smithi155.stdout: { 2023-08-01T19:55:49.861 INFO:teuthology.orchestra.run.smithi155.stdout: "event": "header_read", 2023-08-01T19:55:49.862 INFO:teuthology.orchestra.run.smithi155.stdout: "time": "2023-08-01T19:54:51.461519+0000", 2023-08-01T19:55:49.862 INFO:teuthology.orchestra.run.smithi155.stdout: "duration": 4294967295.999999 2023-08-01T19:55:49.862 INFO:teuthology.orchestra.run.smithi155.stdout: }, 2023-08-01T19:55:49.862 INFO:teuthology.orchestra.run.smithi155.stdout: { 2023-08-01T19:55:49.862 INFO:teuthology.orchestra.run.smithi155.stdout: "event": "all_read", 2023-08-01T19:55:49.862 INFO:teuthology.orchestra.run.smithi155.stdout: "time": "2023-08-01T19:54:51.461633+0000", 2023-08-01T19:55:49.862 INFO:teuthology.orchestra.run.smithi155.stdout: "duration": 0.000114015 2023-08-01T19:55:49.863 INFO:teuthology.orchestra.run.smithi155.stdout: }, 2023-08-01T19:55:49.863 INFO:teuthology.orchestra.run.smithi155.stdout: { 2023-08-01T19:55:49.863 INFO:teuthology.orchestra.run.smithi155.stdout: "event": "dispatched", 2023-08-01T19:55:49.863 INFO:teuthology.orchestra.run.smithi155.stdout: "time": "2023-08-01T19:54:51.461643+0000", 2023-08-01T19:55:49.863 INFO:teuthology.orchestra.run.smithi155.stdout: "duration": 1.0217000000000001e-05 2023-08-01T19:55:49.863 INFO:teuthology.orchestra.run.smithi155.stdout: }, 2023-08-01T19:55:49.863 INFO:teuthology.orchestra.run.smithi155.stdout: { 2023-08-01T19:55:49.864 INFO:teuthology.orchestra.run.smithi155.stdout: "event": "queued_for_pg", 2023-08-01T19:55:49.864 INFO:teuthology.orchestra.run.smithi155.stdout: "time": "2023-08-01T19:54:51.461649+0000", 2023-08-01T19:55:49.864 INFO:teuthology.orchestra.run.smithi155.stdout: "duration": 5.8850000000000004e-06 2023-08-01T19:55:49.864 INFO:teuthology.orchestra.run.smithi155.stdout: }, 2023-08-01T19:55:49.864 INFO:teuthology.orchestra.run.smithi155.stdout: { 2023-08-01T19:55:49.864 INFO:teuthology.orchestra.run.smithi155.stdout: "event": "reached_pg", 2023-08-01T19:55:49.864 INFO:teuthology.orchestra.run.smithi155.stdout: "time": "2023-08-01T19:54:51.461686+0000", 2023-08-01T19:55:49.865 INFO:teuthology.orchestra.run.smithi155.stdout: "duration": 3.7319e-05 2023-08-01T19:55:49.865 INFO:teuthology.orchestra.run.smithi155.stdout: }, 2023-08-01T19:55:49.865 INFO:teuthology.orchestra.run.smithi155.stdout: { 2023-08-01T19:55:49.865 INFO:teuthology.orchestra.run.smithi155.stdout: "event": "started", 2023-08-01T19:55:49.865 INFO:teuthology.orchestra.run.smithi155.stdout: "time": "2023-08-01T19:54:51.461802+0000", 2023-08-01T19:55:49.865 INFO:teuthology.orchestra.run.smithi155.stdout: "duration": 0.000115604 2023-08-01T19:55:49.865 INFO:teuthology.orchestra.run.smithi155.stdout: }, 2023-08-01T19:55:49.865 INFO:teuthology.orchestra.run.smithi155.stdout: { 2023-08-01T19:55:49.866 INFO:teuthology.orchestra.run.smithi155.stdout: "event": "waiting for subops from 0", 2023-08-01T19:55:49.866 INFO:teuthology.orchestra.run.smithi155.stdout: "time": "2023-08-01T19:54:51.461933+0000", 2023-08-01T19:55:49.866 INFO:teuthology.orchestra.run.smithi155.stdout: "duration": 0.000131175 2023-08-01T19:55:49.866 INFO:teuthology.orchestra.run.smithi155.stdout: }, 2023-08-01T19:55:49.866 INFO:teuthology.orchestra.run.smithi155.stdout: { 2023-08-01T19:55:49.866 INFO:teuthology.orchestra.run.smithi155.stdout: "event": "sub_op_commit_rec", 2023-08-01T19:55:49.866 INFO:teuthology.orchestra.run.smithi155.stdout: "time": "2023-08-01T19:54:51.468411+0000", 2023-08-01T19:55:49.867 INFO:teuthology.orchestra.run.smithi155.stdout: "duration": 0.0064775850000000001 2023-08-01T19:55:49.867 INFO:teuthology.orchestra.run.smithi155.stdout: }, 2023-08-01T19:55:49.867 INFO:teuthology.orchestra.run.smithi155.stdout: { 2023-08-01T19:55:49.867 INFO:teuthology.orchestra.run.smithi155.stdout: "event": "op_commit", 2023-08-01T19:55:49.867 INFO:teuthology.orchestra.run.smithi155.stdout: "time": "2023-08-01T19:54:51.485340+0000", 2023-08-01T19:55:49.867 INFO:teuthology.orchestra.run.smithi155.stdout: "duration": 0.016928907 2023-08-01T19:55:49.867 INFO:teuthology.orchestra.run.smithi155.stdout: }, 2023-08-01T19:55:49.868 INFO:teuthology.orchestra.run.smithi155.stdout: { 2023-08-01T19:55:49.868 INFO:teuthology.orchestra.run.smithi155.stdout: "event": "commit_sent", 2023-08-01T19:55:49.868 INFO:teuthology.orchestra.run.smithi155.stdout: "time": "2023-08-01T19:54:51.485385+0000", 2023-08-01T19:55:49.868 INFO:teuthology.orchestra.run.smithi155.stdout: "duration": 4.5222000000000002e-05 2023-08-01T19:55:49.868 INFO:teuthology.orchestra.run.smithi155.stdout: }, 2023-08-01T19:55:49.868 INFO:teuthology.orchestra.run.smithi155.stdout: { 2023-08-01T19:55:49.868 INFO:teuthology.orchestra.run.smithi155.stdout: "event": "done", 2023-08-01T19:55:49.869 INFO:teuthology.orchestra.run.smithi155.stdout: "time": "2023-08-01T19:54:51.485420+0000", 2023-08-01T19:55:49.869 INFO:teuthology.orchestra.run.smithi155.stdout: "duration": 3.4717e-05 2023-08-01T19:55:49.869 INFO:teuthology.orchestra.run.smithi155.stdout: } 2023-08-01T19:55:49.869 INFO:teuthology.orchestra.run.smithi155.stdout: ] 2023-08-01T19:55:49.869 INFO:teuthology.orchestra.run.smithi155.stdout: } 2023-08-01T19:55:49.869 INFO:teuthology.orchestra.run.smithi155.stdout: }, 2023-08-01T19:55:49.869 INFO:teuthology.orchestra.run.smithi155.stdout: { 2023-08-01T19:55:49.870 INFO:teuthology.orchestra.run.smithi155.stdout: "description": "osd_op(client.4668.0:100237 5.4 5:2d68bec9:::benchmark_data_smithi006_114134_object100236:head [set-alloc-hint object_size 65536 write_size 65536,write 0~65536] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e37)", 2023-08-01T19:55:49.870 INFO:teuthology.orchestra.run.smithi155.stdout: "initiated_at": "2023-08-01T19:55:05.147736+0000", 2023-08-01T19:55:49.870 INFO:teuthology.orchestra.run.smithi155.stdout: "age": 44.683329540999999, 2023-08-01T19:55:49.870 INFO:teuthology.orchestra.run.smithi155.stdout: "duration": 0.071299464000000007, 2023-08-01T19:55:49.870 INFO:teuthology.orchestra.run.smithi155.stdout: "type_data": { 2023-08-01T19:55:49.870 INFO:teuthology.orchestra.run.smithi155.stdout: "flag_point": "commit sent; apply or cleanup", 2023-08-01T19:55:49.870 INFO:teuthology.orchestra.run.smithi155.stdout: "client_info": { 2023-08-01T19:55:49.870 INFO:teuthology.orchestra.run.smithi155.stdout: "client": "client.4668", 2023-08-01T19:55:49.871 INFO:teuthology.orchestra.run.smithi155.stdout: "client_addr": "172.21.15.6:0/1709472247", 2023-08-01T19:55:49.871 INFO:teuthology.orchestra.run.smithi155.stdout: "tid": 100237 2023-08-01T19:55:49.871 INFO:teuthology.orchestra.run.smithi155.stdout: }, 2023-08-01T19:55:49.871 INFO:teuthology.orchestra.run.smithi155.stdout: "events": [ 2023-08-01T19:55:49.871 INFO:teuthology.orchestra.run.smithi155.stdout: { 2023-08-01T19:55:49.871 INFO:teuthology.orchestra.run.smithi155.stdout: "event": "initiated", 2023-08-01T19:55:49.871 INFO:teuthology.orchestra.run.smithi155.stdout: "time": "2023-08-01T19:55:05.147736+0000", 2023-08-01T19:55:49.872 INFO:teuthology.orchestra.run.smithi155.stdout: "duration": 0 2023-08-01T19:55:49.872 INFO:teuthology.orchestra.run.smithi155.stdout: }, 2023-08-01T19:55:49.872 INFO:teuthology.orchestra.run.smithi155.stdout: { 2023-08-01T19:55:49.872 INFO:teuthology.orchestra.run.smithi155.stdout: "event": "throttled", 2023-08-01T19:55:49.872 INFO:teuthology.orchestra.run.smithi155.stdout: "time": "2023-08-01T19:55:05.147736+0000", 2023-08-01T19:55:49.872 INFO:teuthology.orchestra.run.smithi155.stdout: "duration": 0 2023-08-01T19:55:49.872 INFO:teuthology.orchestra.run.smithi155.stdout: }, 2023-08-01T19:55:49.873 INFO:teuthology.orchestra.run.smithi155.stdout: { 2023-08-01T19:55:49.873 INFO:teuthology.orchestra.run.smithi155.stdout: "event": "header_read", 2023-08-01T19:55:49.873 INFO:teuthology.orchestra.run.smithi155.stdout: "time": "2023-08-01T19:55:05.147736+0000", 2023-08-01T19:55:49.873 INFO:teuthology.orchestra.run.smithi155.stdout: "duration": 4294967295.9999995 2023-08-01T19:55:49.873 INFO:teuthology.orchestra.run.smithi155.stdout: }, 2023-08-01T19:55:49.873 INFO:teuthology.orchestra.run.smithi155.stdout: { 2023-08-01T19:55:49.873 INFO:teuthology.orchestra.run.smithi155.stdout: "event": "all_read", 2023-08-01T19:55:49.874 INFO:teuthology.orchestra.run.smithi155.stdout: "time": "2023-08-01T19:55:05.147766+0000", 2023-08-01T19:55:49.874 INFO:teuthology.orchestra.run.smithi155.stdout: "duration": 3.0394000000000001e-05 2023-08-01T19:55:49.874 INFO:teuthology.orchestra.run.smithi155.stdout: }, 2023-08-01T19:55:49.874 INFO:teuthology.orchestra.run.smithi155.stdout: { 2023-08-01T19:55:49.874 INFO:teuthology.orchestra.run.smithi155.stdout: "event": "dispatched", 2023-08-01T19:55:49.874 INFO:teuthology.orchestra.run.smithi155.stdout: "time": "2023-08-01T19:55:05.147771+0000", 2023-08-01T19:55:49.874 INFO:teuthology.orchestra.run.smithi155.stdout: "duration": 4.25e-06 2023-08-01T19:55:49.875 INFO:teuthology.orchestra.run.smithi155.stdout: }, 2023-08-01T19:55:49.875 INFO:teuthology.orchestra.run.smithi155.stdout: { 2023-08-01T19:55:49.875 INFO:teuthology.orchestra.run.smithi155.stdout: "event": "queued_for_pg", 2023-08-01T19:55:49.875 INFO:teuthology.orchestra.run.smithi155.stdout: "time": "2023-08-01T19:55:05.147773+0000", 2023-08-01T19:55:49.876 INFO:teuthology.orchestra.run.smithi155.stdout: "duration": 2.4159999999999998e-06 2023-08-01T19:55:49.876 INFO:teuthology.orchestra.run.smithi155.stdout: }, 2023-08-01T19:55:49.876 INFO:teuthology.orchestra.run.smithi155.stdout: { 2023-08-01T19:55:49.876 INFO:teuthology.orchestra.run.smithi155.stdout: "event": "reached_pg", 2023-08-01T19:55:49.876 INFO:teuthology.orchestra.run.smithi155.stdout: "time": "2023-08-01T19:55:05.149903+0000", 2023-08-01T19:55:49.876 INFO:teuthology.orchestra.run.smithi155.stdout: "duration": 0.002129948 2023-08-01T19:55:49.877 INFO:teuthology.orchestra.run.smithi155.stdout: }, 2023-08-01T19:55:49.877 INFO:teuthology.orchestra.run.smithi155.stdout: { 2023-08-01T19:55:49.877 INFO:teuthology.orchestra.run.smithi155.stdout: "event": "started", 2023-08-01T19:55:49.877 INFO:teuthology.orchestra.run.smithi155.stdout: "time": "2023-08-01T19:55:05.149982+0000", 2023-08-01T19:55:49.877 INFO:teuthology.orchestra.run.smithi155.stdout: "duration": 7.8706000000000002e-05 2023-08-01T19:55:49.877 INFO:teuthology.orchestra.run.smithi155.stdout: }, 2023-08-01T19:55:49.877 INFO:teuthology.orchestra.run.smithi155.stdout: { 2023-08-01T19:55:49.878 INFO:teuthology.orchestra.run.smithi155.stdout: "event": "waiting for subops from 0", 2023-08-01T19:55:49.878 INFO:teuthology.orchestra.run.smithi155.stdout: "time": "2023-08-01T19:55:05.150066+0000", 2023-08-01T19:55:49.878 INFO:teuthology.orchestra.run.smithi155.stdout: "duration": 8.4241999999999997e-05 2023-08-01T19:55:49.878 INFO:teuthology.orchestra.run.smithi155.stdout: }, 2023-08-01T19:55:49.878 INFO:teuthology.orchestra.run.smithi155.stdout: { 2023-08-01T19:55:49.878 INFO:teuthology.orchestra.run.smithi155.stdout: "event": "op_commit", 2023-08-01T19:55:49.878 INFO:teuthology.orchestra.run.smithi155.stdout: "time": "2023-08-01T19:55:05.154994+0000", 2023-08-01T19:55:49.879 INFO:teuthology.orchestra.run.smithi155.stdout: "duration": 0.0049277050000000001 2023-08-01T19:55:49.879 INFO:teuthology.orchestra.run.smithi155.stdout: }, 2023-08-01T19:55:49.879 INFO:teuthology.orchestra.run.smithi155.stdout: { 2023-08-01T19:55:49.879 INFO:teuthology.orchestra.run.smithi155.stdout: "event": "sub_op_commit_rec", 2023-08-01T19:55:49.879 INFO:teuthology.orchestra.run.smithi155.stdout: "time": "2023-08-01T19:55:05.218933+0000", 2023-08-01T19:55:49.879 INFO:teuthology.orchestra.run.smithi155.stdout: "duration": 0.063939916999999999 2023-08-01T19:55:49.879 INFO:teuthology.orchestra.run.smithi155.stdout: }, 2023-08-01T19:55:49.879 INFO:teuthology.orchestra.run.smithi155.stdout: { 2023-08-01T19:55:49.880 INFO:teuthology.orchestra.run.smithi155.stdout: "event": "commit_sent", 2023-08-01T19:55:49.880 INFO:teuthology.orchestra.run.smithi155.stdout: "time": "2023-08-01T19:55:05.218989+0000", 2023-08-01T19:55:49.880 INFO:teuthology.orchestra.run.smithi155.stdout: "duration": 5.5772000000000001e-05 2023-08-01T19:55:49.880 INFO:teuthology.orchestra.run.smithi155.stdout: }, 2023-08-01T19:55:49.880 INFO:teuthology.orchestra.run.smithi155.stdout: { 2023-08-01T19:55:49.880 INFO:teuthology.orchestra.run.smithi155.stdout: "event": "done", 2023-08-01T19:55:49.881 INFO:teuthology.orchestra.run.smithi155.stdout: "time": "2023-08-01T19:55:05.219036+0000", 2023-08-01T19:55:49.881 INFO:teuthology.orchestra.run.smithi155.stdout: "duration": 4.6526000000000001e-05 2023-08-01T19:55:49.881 INFO:teuthology.orchestra.run.smithi155.stdout: } 2023-08-01T19:55:49.881 INFO:teuthology.orchestra.run.smithi155.stdout: ] 2023-08-01T19:55:49.881 INFO:teuthology.orchestra.run.smithi155.stdout: } 2023-08-01T19:55:49.881 INFO:teuthology.orchestra.run.smithi155.stdout: }, 2023-08-01T19:55:49.881 INFO:teuthology.orchestra.run.smithi155.stdout: { 2023-08-01T19:55:49.882 INFO:teuthology.orchestra.run.smithi155.stdout: "description": "osd_op(client.4668.0:100242 5.8 5:16a314b8:::benchmark_data_smithi006_114134_object100241:head [set-alloc-hint object_size 65536 write_size 65536,write 0~65536] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e37)", 2023-08-01T19:55:49.882 INFO:teuthology.orchestra.run.smithi155.stdout: "initiated_at": "2023-08-01T19:55:05.150616+0000", 2023-08-01T19:55:49.882 INFO:teuthology.orchestra.run.smithi155.stdout: "age": 44.680449910999997, 2023-08-01T19:55:49.882 INFO:teuthology.orchestra.run.smithi155.stdout: "duration": 0.071105065999999995, 2023-08-01T19:55:49.882 INFO:teuthology.orchestra.run.smithi155.stdout: "type_data": { 2023-08-01T19:55:49.882 INFO:teuthology.orchestra.run.smithi155.stdout: "flag_point": "commit sent; apply or cleanup", 2023-08-01T19:55:49.882 INFO:teuthology.orchestra.run.smithi155.stdout: "client_info": { 2023-08-01T19:55:49.883 INFO:teuthology.orchestra.run.smithi155.stdout: "client": "client.4668", 2023-08-01T19:55:49.883 INFO:teuthology.orchestra.run.smithi155.stdout: "client_addr": "172.21.15.6:0/1709472247", 2023-08-01T19:55:49.883 INFO:teuthology.orchestra.run.smithi155.stdout: "tid": 100242 2023-08-01T19:55:49.883 INFO:teuthology.orchestra.run.smithi155.stdout: }, 2023-08-01T19:55:49.883 INFO:teuthology.orchestra.run.smithi155.stdout: "events": [ 2023-08-01T19:55:49.883 INFO:teuthology.orchestra.run.smithi155.stdout: { 2023-08-01T19:55:49.883 INFO:teuthology.orchestra.run.smithi155.stdout: "event": "initiated", 2023-08-01T19:55:49.883 INFO:teuthology.orchestra.run.smithi155.stdout: "time": "2023-08-01T19:55:05.150616+0000", 2023-08-01T19:55:49.884 INFO:teuthology.orchestra.run.smithi155.stdout: "duration": 0 2023-08-01T19:55:49.884 INFO:teuthology.orchestra.run.smithi155.stdout: }, 2023-08-01T19:55:49.884 INFO:teuthology.orchestra.run.smithi155.stdout: { 2023-08-01T19:55:49.884 INFO:teuthology.orchestra.run.smithi155.stdout: "event": "throttled", 2023-08-01T19:55:49.884 INFO:teuthology.orchestra.run.smithi155.stdout: "time": "2023-08-01T19:55:05.150616+0000", 2023-08-01T19:55:49.884 INFO:teuthology.orchestra.run.smithi155.stdout: "duration": 0 2023-08-01T19:55:49.885 INFO:teuthology.orchestra.run.smithi155.stdout: }, 2023-08-01T19:55:49.885 INFO:teuthology.orchestra.run.smithi155.stdout: { 2023-08-01T19:55:49.885 INFO:teuthology.orchestra.run.smithi155.stdout: "event": "header_read", 2023-08-01T19:55:49.885 INFO:teuthology.orchestra.run.smithi155.stdout: "time": "2023-08-01T19:55:05.150615+0000", 2023-08-01T19:55:49.885 INFO:teuthology.orchestra.run.smithi155.stdout: "duration": 4294967295.999999 2023-08-01T19:55:49.885 INFO:teuthology.orchestra.run.smithi155.stdout: }, 2023-08-01T19:55:49.885 INFO:teuthology.orchestra.run.smithi155.stdout: { 2023-08-01T19:55:49.885 INFO:teuthology.orchestra.run.smithi155.stdout: "event": "all_read", 2023-08-01T19:55:49.886 INFO:teuthology.orchestra.run.smithi155.stdout: "time": "2023-08-01T19:55:05.150696+0000", 2023-08-01T19:55:49.886 INFO:teuthology.orchestra.run.smithi155.stdout: "duration": 8.0852000000000004e-05 2023-08-01T19:55:49.886 INFO:teuthology.orchestra.run.smithi155.stdout: }, 2023-08-01T19:55:49.886 INFO:teuthology.orchestra.run.smithi155.stdout: { 2023-08-01T19:55:49.886 INFO:teuthology.orchestra.run.smithi155.stdout: "event": "dispatched", 2023-08-01T19:55:49.886 INFO:teuthology.orchestra.run.smithi155.stdout: "time": "2023-08-01T19:55:05.150708+0000", 2023-08-01T19:55:49.887 INFO:teuthology.orchestra.run.smithi155.stdout: "duration": 1.2116999999999999e-05 2023-08-01T19:55:49.887 INFO:teuthology.orchestra.run.smithi155.stdout: }, 2023-08-01T19:55:49.887 INFO:teuthology.orchestra.run.smithi155.stdout: { 2023-08-01T19:55:49.887 INFO:teuthology.orchestra.run.smithi155.stdout: "event": "queued_for_pg", 2023-08-01T19:55:49.887 INFO:teuthology.orchestra.run.smithi155.stdout: "time": "2023-08-01T19:55:05.150713+0000", 2023-08-01T19:55:49.887 INFO:teuthology.orchestra.run.smithi155.stdout: "duration": 5.4620000000000004e-06 2023-08-01T19:55:49.887 INFO:teuthology.orchestra.run.smithi155.stdout: }, 2023-08-01T19:55:49.888 INFO:teuthology.orchestra.run.smithi155.stdout: { 2023-08-01T19:55:49.888 INFO:teuthology.orchestra.run.smithi155.stdout: "event": "reached_pg", 2023-08-01T19:55:49.888 INFO:teuthology.orchestra.run.smithi155.stdout: "time": "2023-08-01T19:55:05.150761+0000", 2023-08-01T19:55:49.888 INFO:teuthology.orchestra.run.smithi155.stdout: "duration": 4.7429000000000003e-05 2023-08-01T19:55:49.888 INFO:teuthology.orchestra.run.smithi155.stdout: }, 2023-08-01T19:55:49.888 INFO:teuthology.orchestra.run.smithi155.stdout: { 2023-08-01T19:55:49.889 INFO:teuthology.orchestra.run.smithi155.stdout: "event": "started", 2023-08-01T19:55:49.889 INFO:teuthology.orchestra.run.smithi155.stdout: "time": "2023-08-01T19:55:05.150856+0000", 2023-08-01T19:55:49.889 INFO:teuthology.orchestra.run.smithi155.stdout: "duration": 9.5356e-05 2023-08-01T19:55:49.889 INFO:teuthology.orchestra.run.smithi155.stdout: }, 2023-08-01T19:55:49.889 INFO:teuthology.orchestra.run.smithi155.stdout: { 2023-08-01T19:55:49.889 INFO:teuthology.orchestra.run.smithi155.stdout: "event": "waiting for subops from 0", 2023-08-01T19:55:49.889 INFO:teuthology.orchestra.run.smithi155.stdout: "time": "2023-08-01T19:55:05.150999+0000", 2023-08-01T19:55:49.889 INFO:teuthology.orchestra.run.smithi155.stdout: "duration": 0.00014234499999999999 2023-08-01T19:55:49.890 INFO:teuthology.orchestra.run.smithi155.stdout: }, 2023-08-01T19:55:49.890 INFO:teuthology.orchestra.run.smithi155.stdout: { 2023-08-01T19:55:49.890 INFO:teuthology.orchestra.run.smithi155.stdout: "event": "sub_op_commit_rec", 2023-08-01T19:55:49.890 INFO:teuthology.orchestra.run.smithi155.stdout: "time": "2023-08-01T19:55:05.219001+0000", 2023-08-01T19:55:49.890 INFO:teuthology.orchestra.run.smithi155.stdout: "duration": 0.068002776000000001 2023-08-01T19:55:49.890 INFO:teuthology.orchestra.run.smithi155.stdout: }, 2023-08-01T19:55:49.890 INFO:teuthology.orchestra.run.smithi155.stdout: { 2023-08-01T19:55:49.891 INFO:teuthology.orchestra.run.smithi155.stdout: "event": "op_commit", 2023-08-01T19:55:49.891 INFO:teuthology.orchestra.run.smithi155.stdout: "time": "2023-08-01T19:55:05.221635+0000", 2023-08-01T19:55:49.891 INFO:teuthology.orchestra.run.smithi155.stdout: "duration": 0.0026340579999999999 2023-08-01T19:55:49.891 INFO:teuthology.orchestra.run.smithi155.stdout: }, 2023-08-01T19:55:49.891 INFO:teuthology.orchestra.run.smithi155.stdout: { 2023-08-01T19:55:49.891 INFO:teuthology.orchestra.run.smithi155.stdout: "event": "commit_sent", 2023-08-01T19:55:49.891 INFO:teuthology.orchestra.run.smithi155.stdout: "time": "2023-08-01T19:55:05.221682+0000", 2023-08-01T19:55:49.892 INFO:teuthology.orchestra.run.smithi155.stdout: "duration": 4.7123999999999998e-05 2023-08-01T19:55:49.892 INFO:teuthology.orchestra.run.smithi155.stdout: }, 2023-08-01T19:55:49.892 INFO:teuthology.orchestra.run.smithi155.stdout: { 2023-08-01T19:55:49.892 INFO:teuthology.orchestra.run.smithi155.stdout: "event": "done", 2023-08-01T19:55:49.892 INFO:teuthology.orchestra.run.smithi155.stdout: "time": "2023-08-01T19:55:05.221721+0000", 2023-08-01T19:55:49.892 INFO:teuthology.orchestra.run.smithi155.stdout: "duration": 3.8529999999999999e-05 2023-08-01T19:55:49.892 INFO:teuthology.orchestra.run.smithi155.stdout: } 2023-08-01T19:55:49.893 INFO:teuthology.orchestra.run.smithi155.stdout: ] 2023-08-01T19:55:49.893 INFO:teuthology.orchestra.run.smithi155.stdout: } 2023-08-01T19:55:49.893 INFO:teuthology.orchestra.run.smithi155.stdout: }, 2023-08-01T19:55:49.893 INFO:teuthology.orchestra.run.smithi155.stdout: { 2023-08-01T19:55:49.893 INFO:teuthology.orchestra.run.smithi155.stdout: "description": "osd_repop(client.4668.0:100240 5.a e37/19 5:5313c5b9:::benchmark_data_smithi006_114134_object100239:head v 37'6227, mlcod=37'6225)", 2023-08-01T19:55:49.893 INFO:teuthology.orchestra.run.smithi155.stdout: "initiated_at": "2023-08-01T19:55:05.150778+0000", 2023-08-01T19:55:49.893 INFO:teuthology.orchestra.run.smithi155.stdout: "age": 44.680287710000002, 2023-08-01T19:55:49.894 INFO:teuthology.orchestra.run.smithi155.stdout: "duration": 0.073362533999999993, 2023-08-01T19:55:49.894 INFO:teuthology.orchestra.run.smithi155.stdout: "type_data": { 2023-08-01T19:55:49.894 INFO:teuthology.orchestra.run.smithi155.stdout: "flag_point": "commit sent; apply or cleanup", 2023-08-01T19:55:49.894 INFO:teuthology.orchestra.run.smithi155.stdout: "events": [ 2023-08-01T19:55:49.894 INFO:teuthology.orchestra.run.smithi155.stdout: { 2023-08-01T19:55:49.894 INFO:teuthology.orchestra.run.smithi155.stdout: "event": "initiated", 2023-08-01T19:55:49.894 INFO:teuthology.orchestra.run.smithi155.stdout: "time": "2023-08-01T19:55:05.150778+0000", 2023-08-01T19:55:49.895 INFO:teuthology.orchestra.run.smithi155.stdout: "duration": 0 2023-08-01T19:55:49.895 INFO:teuthology.orchestra.run.smithi155.stdout: }, 2023-08-01T19:55:49.895 INFO:teuthology.orchestra.run.smithi155.stdout: { 2023-08-01T19:55:49.895 INFO:teuthology.orchestra.run.smithi155.stdout: "event": "throttled", 2023-08-01T19:55:49.895 INFO:teuthology.orchestra.run.smithi155.stdout: "time": "2023-08-01T19:55:05.150778+0000", 2023-08-01T19:55:49.895 INFO:teuthology.orchestra.run.smithi155.stdout: "duration": 0 2023-08-01T19:55:49.895 INFO:teuthology.orchestra.run.smithi155.stdout: }, 2023-08-01T19:55:49.896 INFO:teuthology.orchestra.run.smithi155.stdout: { 2023-08-01T19:55:49.896 INFO:teuthology.orchestra.run.smithi155.stdout: "event": "header_read", 2023-08-01T19:55:49.896 INFO:teuthology.orchestra.run.smithi155.stdout: "time": "2023-08-01T19:55:05.150778+0000", 2023-08-01T19:55:49.896 INFO:teuthology.orchestra.run.smithi155.stdout: "duration": 4294967295.9999995 2023-08-01T19:55:49.896 INFO:teuthology.orchestra.run.smithi155.stdout: }, 2023-08-01T19:55:49.896 INFO:teuthology.orchestra.run.smithi155.stdout: { 2023-08-01T19:55:49.896 INFO:teuthology.orchestra.run.smithi155.stdout: "event": "all_read", 2023-08-01T19:55:49.897 INFO:teuthology.orchestra.run.smithi155.stdout: "time": "2023-08-01T19:55:05.150811+0000", 2023-08-01T19:55:49.897 INFO:teuthology.orchestra.run.smithi155.stdout: "duration": 3.3664000000000002e-05 2023-08-01T19:55:49.897 INFO:teuthology.orchestra.run.smithi155.stdout: }, 2023-08-01T19:55:49.897 INFO:teuthology.orchestra.run.smithi155.stdout: { 2023-08-01T19:55:49.897 INFO:teuthology.orchestra.run.smithi155.stdout: "event": "dispatched", 2023-08-01T19:55:49.897 INFO:teuthology.orchestra.run.smithi155.stdout: "time": "2023-08-01T19:55:05.150818+0000", 2023-08-01T19:55:49.897 INFO:teuthology.orchestra.run.smithi155.stdout: "duration": 6.5769999999999999e-06 2023-08-01T19:55:49.898 INFO:teuthology.orchestra.run.smithi155.stdout: }, 2023-08-01T19:55:49.898 INFO:teuthology.orchestra.run.smithi155.stdout: { 2023-08-01T19:55:49.898 INFO:teuthology.orchestra.run.smithi155.stdout: "event": "queued_for_pg", 2023-08-01T19:55:49.898 INFO:teuthology.orchestra.run.smithi155.stdout: "time": "2023-08-01T19:55:05.150822+0000", 2023-08-01T19:55:49.898 INFO:teuthology.orchestra.run.smithi155.stdout: "duration": 4.0060000000000003e-06 2023-08-01T19:55:49.898 INFO:teuthology.orchestra.run.smithi155.stdout: }, 2023-08-01T19:55:49.898 INFO:teuthology.orchestra.run.smithi155.stdout: { 2023-08-01T19:55:49.899 INFO:teuthology.orchestra.run.smithi155.stdout: "event": "reached_pg", 2023-08-01T19:55:49.899 INFO:teuthology.orchestra.run.smithi155.stdout: "time": "2023-08-01T19:55:05.150855+0000", 2023-08-01T19:55:49.899 INFO:teuthology.orchestra.run.smithi155.stdout: "duration": 3.3204999999999998e-05 2023-08-01T19:55:49.899 INFO:teuthology.orchestra.run.smithi155.stdout: }, 2023-08-01T19:55:49.899 INFO:teuthology.orchestra.run.smithi155.stdout: { 2023-08-01T19:55:49.899 INFO:teuthology.orchestra.run.smithi155.stdout: "event": "started", 2023-08-01T19:55:49.899 INFO:teuthology.orchestra.run.smithi155.stdout: "time": "2023-08-01T19:55:05.150873+0000", 2023-08-01T19:55:49.900 INFO:teuthology.orchestra.run.smithi155.stdout: "duration": 1.8139999999999999e-05 2023-08-01T19:55:49.900 INFO:teuthology.orchestra.run.smithi155.stdout: }, 2023-08-01T19:55:49.900 INFO:teuthology.orchestra.run.smithi155.stdout: { 2023-08-01T19:55:49.900 INFO:teuthology.orchestra.run.smithi155.stdout: "event": "commit_sent", 2023-08-01T19:55:49.900 INFO:teuthology.orchestra.run.smithi155.stdout: "time": "2023-08-01T19:55:05.224095+0000", 2023-08-01T19:55:49.900 INFO:teuthology.orchestra.run.smithi155.stdout: "duration": 0.073221895999999995 2023-08-01T19:55:49.900 INFO:teuthology.orchestra.run.smithi155.stdout: }, 2023-08-01T19:55:49.901 INFO:teuthology.orchestra.run.smithi155.stdout: { 2023-08-01T19:55:49.901 INFO:teuthology.orchestra.run.smithi155.stdout: "event": "done", 2023-08-01T19:55:49.901 INFO:teuthology.orchestra.run.smithi155.stdout: "time": "2023-08-01T19:55:05.224141+0000", 2023-08-01T19:55:49.901 INFO:teuthology.orchestra.run.smithi155.stdout: "duration": 4.5385e-05 2023-08-01T19:55:49.901 INFO:teuthology.orchestra.run.smithi155.stdout: } 2023-08-01T19:55:49.901 INFO:teuthology.orchestra.run.smithi155.stdout: ] 2023-08-01T19:55:49.901 INFO:teuthology.orchestra.run.smithi155.stdout: } 2023-08-01T19:55:49.902 INFO:teuthology.orchestra.run.smithi155.stdout: }, 2023-08-01T19:55:49.902 INFO:teuthology.orchestra.run.smithi155.stdout: { 2023-08-01T19:55:49.902 INFO:teuthology.orchestra.run.smithi155.stdout: "description": "osd_op(client.4668.0:100245 5.e 5:71869c66:::benchmark_data_smithi006_114134_object100244:head [set-alloc-hint object_size 65536 write_size 65536,write 0~65536] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e37)", 2023-08-01T19:55:49.902 INFO:teuthology.orchestra.run.smithi155.stdout: "initiated_at": "2023-08-01T19:55:05.150991+0000", 2023-08-01T19:55:49.902 INFO:teuthology.orchestra.run.smithi155.stdout: "age": 44.680074922999999, 2023-08-01T19:55:49.902 INFO:teuthology.orchestra.run.smithi155.stdout: "duration": 0.070734490999999997, 2023-08-01T19:55:49.902 INFO:teuthology.orchestra.run.smithi155.stdout: "type_data": { 2023-08-01T19:55:49.903 INFO:teuthology.orchestra.run.smithi155.stdout: "flag_point": "commit sent; apply or cleanup", 2023-08-01T19:55:49.903 INFO:teuthology.orchestra.run.smithi155.stdout: "client_info": { 2023-08-01T19:55:49.903 INFO:teuthology.orchestra.run.smithi155.stdout: "client": "client.4668", 2023-08-01T19:55:49.903 INFO:teuthology.orchestra.run.smithi155.stdout: "client_addr": "172.21.15.6:0/1709472247", 2023-08-01T19:55:49.903 INFO:teuthology.orchestra.run.smithi155.stdout: "tid": 100245 2023-08-01T19:55:49.903 INFO:teuthology.orchestra.run.smithi155.stdout: }, 2023-08-01T19:55:49.903 INFO:teuthology.orchestra.run.smithi155.stdout: "events": [ 2023-08-01T19:55:49.904 INFO:teuthology.orchestra.run.smithi155.stdout: { 2023-08-01T19:55:49.904 INFO:teuthology.orchestra.run.smithi155.stdout: "event": "initiated", 2023-08-01T19:55:49.904 INFO:teuthology.orchestra.run.smithi155.stdout: "time": "2023-08-01T19:55:05.150991+0000", 2023-08-01T19:55:49.904 INFO:teuthology.orchestra.run.smithi155.stdout: "duration": 0 2023-08-01T19:55:49.904 INFO:teuthology.orchestra.run.smithi155.stdout: }, 2023-08-01T19:55:49.904 INFO:teuthology.orchestra.run.smithi155.stdout: { 2023-08-01T19:55:49.904 INFO:teuthology.orchestra.run.smithi155.stdout: "event": "throttled", 2023-08-01T19:55:49.905 INFO:teuthology.orchestra.run.smithi155.stdout: "time": "2023-08-01T19:55:05.150991+0000", 2023-08-01T19:55:49.905 INFO:teuthology.orchestra.run.smithi155.stdout: "duration": 0 2023-08-01T19:55:49.905 INFO:teuthology.orchestra.run.smithi155.stdout: }, 2023-08-01T19:55:49.905 INFO:teuthology.orchestra.run.smithi155.stdout: { 2023-08-01T19:55:49.905 INFO:teuthology.orchestra.run.smithi155.stdout: "event": "header_read", 2023-08-01T19:55:49.905 INFO:teuthology.orchestra.run.smithi155.stdout: "time": "2023-08-01T19:55:05.150990+0000", 2023-08-01T19:55:49.905 INFO:teuthology.orchestra.run.smithi155.stdout: "duration": 4294967295.999999 2023-08-01T19:55:49.906 INFO:teuthology.orchestra.run.smithi155.stdout: }, 2023-08-01T19:55:49.906 INFO:teuthology.orchestra.run.smithi155.stdout: { 2023-08-01T19:55:49.906 INFO:teuthology.orchestra.run.smithi155.stdout: "event": "all_read", 2023-08-01T19:55:49.906 INFO:teuthology.orchestra.run.smithi155.stdout: "time": "2023-08-01T19:55:05.151108+0000", 2023-08-01T19:55:49.906 INFO:teuthology.orchestra.run.smithi155.stdout: "duration": 0.00011849300000000001 2023-08-01T19:55:49.906 INFO:teuthology.orchestra.run.smithi155.stdout: }, 2023-08-01T19:55:49.906 INFO:teuthology.orchestra.run.smithi155.stdout: { 2023-08-01T19:55:49.906 INFO:teuthology.orchestra.run.smithi155.stdout: "event": "dispatched", 2023-08-01T19:55:49.907 INFO:teuthology.orchestra.run.smithi155.stdout: "time": "2023-08-01T19:55:05.151117+0000", 2023-08-01T19:55:49.907 INFO:teuthology.orchestra.run.smithi155.stdout: "duration": 8.1040000000000007e-06 2023-08-01T19:55:49.907 INFO:teuthology.orchestra.run.smithi155.stdout: }, 2023-08-01T19:55:49.907 INFO:teuthology.orchestra.run.smithi155.stdout: { 2023-08-01T19:55:49.907 INFO:teuthology.orchestra.run.smithi155.stdout: "event": "queued_for_pg", 2023-08-01T19:55:49.907 INFO:teuthology.orchestra.run.smithi155.stdout: "time": "2023-08-01T19:55:05.151121+0000", 2023-08-01T19:55:49.907 INFO:teuthology.orchestra.run.smithi155.stdout: "duration": 4.2019999999999997e-06 2023-08-01T19:55:49.908 INFO:teuthology.orchestra.run.smithi155.stdout: }, 2023-08-01T19:55:49.908 INFO:teuthology.orchestra.run.smithi155.stdout: { 2023-08-01T19:55:49.908 INFO:teuthology.orchestra.run.smithi155.stdout: "event": "reached_pg", 2023-08-01T19:55:49.908 INFO:teuthology.orchestra.run.smithi155.stdout: "time": "2023-08-01T19:55:05.151162+0000", 2023-08-01T19:55:49.908 INFO:teuthology.orchestra.run.smithi155.stdout: "duration": 4.1448e-05 2023-08-01T19:55:49.908 INFO:teuthology.orchestra.run.smithi155.stdout: }, 2023-08-01T19:55:49.908 INFO:teuthology.orchestra.run.smithi155.stdout: { 2023-08-01T19:55:49.909 INFO:teuthology.orchestra.run.smithi155.stdout: "event": "started", 2023-08-01T19:55:49.909 INFO:teuthology.orchestra.run.smithi155.stdout: "time": "2023-08-01T19:55:05.151281+0000", 2023-08-01T19:55:49.909 INFO:teuthology.orchestra.run.smithi155.stdout: "duration": 0.000119141 2023-08-01T19:55:49.909 INFO:teuthology.orchestra.run.smithi155.stdout: }, 2023-08-01T19:55:49.909 INFO:teuthology.orchestra.run.smithi155.stdout: { 2023-08-01T19:55:49.909 INFO:teuthology.orchestra.run.smithi155.stdout: "event": "waiting for subops from 0", 2023-08-01T19:55:49.909 INFO:teuthology.orchestra.run.smithi155.stdout: "time": "2023-08-01T19:55:05.151443+0000", 2023-08-01T19:55:49.910 INFO:teuthology.orchestra.run.smithi155.stdout: "duration": 0.00016181600000000001 2023-08-01T19:55:49.910 INFO:teuthology.orchestra.run.smithi155.stdout: }, 2023-08-01T19:55:49.910 INFO:teuthology.orchestra.run.smithi155.stdout: { 2023-08-01T19:55:49.910 INFO:teuthology.orchestra.run.smithi155.stdout: "event": "sub_op_commit_rec", 2023-08-01T19:55:49.910 INFO:teuthology.orchestra.run.smithi155.stdout: "time": "2023-08-01T19:55:05.219101+0000", 2023-08-01T19:55:49.910 INFO:teuthology.orchestra.run.smithi155.stdout: "duration": 0.067658037000000004 2023-08-01T19:55:49.910 INFO:teuthology.orchestra.run.smithi155.stdout: }, 2023-08-01T19:55:49.911 INFO:teuthology.orchestra.run.smithi155.stdout: { 2023-08-01T19:55:49.911 INFO:teuthology.orchestra.run.smithi155.stdout: "event": "op_commit", 2023-08-01T19:55:49.911 INFO:teuthology.orchestra.run.smithi155.stdout: "time": "2023-08-01T19:55:05.221646+0000", 2023-08-01T19:55:49.911 INFO:teuthology.orchestra.run.smithi155.stdout: "duration": 0.0025450540000000002 2023-08-01T19:55:49.911 INFO:teuthology.orchestra.run.smithi155.stdout: }, 2023-08-01T19:55:49.911 INFO:teuthology.orchestra.run.smithi155.stdout: { 2023-08-01T19:55:49.911 INFO:teuthology.orchestra.run.smithi155.stdout: "event": "commit_sent", 2023-08-01T19:55:49.912 INFO:teuthology.orchestra.run.smithi155.stdout: "time": "2023-08-01T19:55:05.221689+0000", 2023-08-01T19:55:49.912 INFO:teuthology.orchestra.run.smithi155.stdout: "duration": 4.3078999999999999e-05 2023-08-01T19:55:49.912 INFO:teuthology.orchestra.run.smithi155.stdout: }, 2023-08-01T19:55:49.912 INFO:teuthology.orchestra.run.smithi155.stdout: { 2023-08-01T19:55:49.912 INFO:teuthology.orchestra.run.smithi155.stdout: "event": "done", 2023-08-01T19:55:49.912 INFO:teuthology.orchestra.run.smithi155.stdout: "time": "2023-08-01T19:55:05.221725+0000", 2023-08-01T19:55:49.913 INFO:teuthology.orchestra.run.smithi155.stdout: "duration": 3.6137999999999999e-05 2023-08-01T19:55:49.913 INFO:teuthology.orchestra.run.smithi155.stdout: } 2023-08-01T19:55:49.913 INFO:teuthology.orchestra.run.smithi155.stdout: ] 2023-08-01T19:55:49.913 INFO:teuthology.orchestra.run.smithi155.stdout: } 2023-08-01T19:55:49.913 INFO:teuthology.orchestra.run.smithi155.stdout: }, 2023-08-01T19:55:49.913 INFO:teuthology.orchestra.run.smithi155.stdout: { 2023-08-01T19:55:49.913 INFO:teuthology.orchestra.run.smithi155.stdout: "description": "osd_repop(client.4668.0:100243 5.a e37/19 5:5e8193b6:::benchmark_data_smithi006_114134_object100242:head v 37'6228, mlcod=37'6225)", 2023-08-01T19:55:49.914 INFO:teuthology.orchestra.run.smithi155.stdout: "initiated_at": "2023-08-01T19:55:05.151148+0000", 2023-08-01T19:55:49.914 INFO:teuthology.orchestra.run.smithi155.stdout: "age": 44.679917912000001, 2023-08-01T19:55:49.914 INFO:teuthology.orchestra.run.smithi155.stdout: "duration": 0.073020370000000001, 2023-08-01T19:55:49.914 INFO:teuthology.orchestra.run.smithi155.stdout: "type_data": { 2023-08-01T19:55:49.914 INFO:teuthology.orchestra.run.smithi155.stdout: "flag_point": "commit sent; apply or cleanup", 2023-08-01T19:55:49.914 INFO:teuthology.orchestra.run.smithi155.stdout: "events": [ 2023-08-01T19:55:49.914 INFO:teuthology.orchestra.run.smithi155.stdout: { 2023-08-01T19:55:49.915 INFO:teuthology.orchestra.run.smithi155.stdout: "event": "initiated", 2023-08-01T19:55:49.915 INFO:teuthology.orchestra.run.smithi155.stdout: "time": "2023-08-01T19:55:05.151148+0000", 2023-08-01T19:55:49.915 INFO:teuthology.orchestra.run.smithi155.stdout: "duration": 0 2023-08-01T19:55:49.915 INFO:teuthology.orchestra.run.smithi155.stdout: }, 2023-08-01T19:55:49.915 INFO:teuthology.orchestra.run.smithi155.stdout: { 2023-08-01T19:55:49.915 INFO:teuthology.orchestra.run.smithi155.stdout: "event": "throttled", 2023-08-01T19:55:49.916 INFO:teuthology.orchestra.run.smithi155.stdout: "time": "2023-08-01T19:55:05.151148+0000", 2023-08-01T19:55:49.916 INFO:teuthology.orchestra.run.smithi155.stdout: "duration": 0 2023-08-01T19:55:49.916 INFO:teuthology.orchestra.run.smithi155.stdout: }, 2023-08-01T19:55:49.916 INFO:teuthology.orchestra.run.smithi155.stdout: { 2023-08-01T19:55:49.916 INFO:teuthology.orchestra.run.smithi155.stdout: "event": "header_read", 2023-08-01T19:55:49.916 INFO:teuthology.orchestra.run.smithi155.stdout: "time": "2023-08-01T19:55:05.151147+0000", 2023-08-01T19:55:49.916 INFO:teuthology.orchestra.run.smithi155.stdout: "duration": 4294967295.9999995 2023-08-01T19:55:49.917 INFO:teuthology.orchestra.run.smithi155.stdout: }, 2023-08-01T19:55:49.917 INFO:teuthology.orchestra.run.smithi155.stdout: { 2023-08-01T19:55:49.917 INFO:teuthology.orchestra.run.smithi155.stdout: "event": "all_read", 2023-08-01T19:55:49.917 INFO:teuthology.orchestra.run.smithi155.stdout: "time": "2023-08-01T19:55:05.151231+0000", 2023-08-01T19:55:49.917 INFO:teuthology.orchestra.run.smithi155.stdout: "duration": 8.3135999999999998e-05 2023-08-01T19:55:49.917 INFO:teuthology.orchestra.run.smithi155.stdout: }, 2023-08-01T19:55:49.917 INFO:teuthology.orchestra.run.smithi155.stdout: { 2023-08-01T19:55:49.918 INFO:teuthology.orchestra.run.smithi155.stdout: "event": "dispatched", 2023-08-01T19:55:49.918 INFO:teuthology.orchestra.run.smithi155.stdout: "time": "2023-08-01T19:55:05.151239+0000", 2023-08-01T19:55:49.918 INFO:teuthology.orchestra.run.smithi155.stdout: "duration": 8.7469999999999994e-06 2023-08-01T19:55:49.918 INFO:teuthology.orchestra.run.smithi155.stdout: }, 2023-08-01T19:55:49.918 INFO:teuthology.orchestra.run.smithi155.stdout: { 2023-08-01T19:55:49.918 INFO:teuthology.orchestra.run.smithi155.stdout: "event": "queued_for_pg", 2023-08-01T19:55:49.918 INFO:teuthology.orchestra.run.smithi155.stdout: "time": "2023-08-01T19:55:05.151244+0000", 2023-08-01T19:55:49.919 INFO:teuthology.orchestra.run.smithi155.stdout: "duration": 4.4800000000000003e-06 2023-08-01T19:55:49.919 INFO:teuthology.orchestra.run.smithi155.stdout: }, 2023-08-01T19:55:49.919 INFO:teuthology.orchestra.run.smithi155.stdout: { 2023-08-01T19:55:49.919 INFO:teuthology.orchestra.run.smithi155.stdout: "event": "reached_pg", 2023-08-01T19:55:49.919 INFO:teuthology.orchestra.run.smithi155.stdout: "time": "2023-08-01T19:55:05.152938+0000", 2023-08-01T19:55:49.919 INFO:teuthology.orchestra.run.smithi155.stdout: "duration": 0.001693824 2023-08-01T19:55:49.919 INFO:teuthology.orchestra.run.smithi155.stdout: }, 2023-08-01T19:55:49.920 INFO:teuthology.orchestra.run.smithi155.stdout: { 2023-08-01T19:55:49.920 INFO:teuthology.orchestra.run.smithi155.stdout: "event": "started", 2023-08-01T19:55:49.920 INFO:teuthology.orchestra.run.smithi155.stdout: "time": "2023-08-01T19:55:05.152956+0000", 2023-08-01T19:55:49.920 INFO:teuthology.orchestra.run.smithi155.stdout: "duration": 1.8287e-05 2023-08-01T19:55:49.920 INFO:teuthology.orchestra.run.smithi155.stdout: }, 2023-08-01T19:55:49.920 INFO:teuthology.orchestra.run.smithi155.stdout: { 2023-08-01T19:55:49.920 INFO:teuthology.orchestra.run.smithi155.stdout: "event": "commit_sent", 2023-08-01T19:55:49.921 INFO:teuthology.orchestra.run.smithi155.stdout: "time": "2023-08-01T19:55:05.224145+0000", 2023-08-01T19:55:49.921 INFO:teuthology.orchestra.run.smithi155.stdout: "duration": 0.071189447000000003 2023-08-01T19:55:49.921 INFO:teuthology.orchestra.run.smithi155.stdout: }, 2023-08-01T19:55:49.921 INFO:teuthology.orchestra.run.smithi155.stdout: { 2023-08-01T19:55:49.921 INFO:teuthology.orchestra.run.smithi155.stdout: "event": "done", 2023-08-01T19:55:49.921 INFO:teuthology.orchestra.run.smithi155.stdout: "time": "2023-08-01T19:55:05.224168+0000", 2023-08-01T19:55:49.921 INFO:teuthology.orchestra.run.smithi155.stdout: "duration": 2.3008999999999999e-05 2023-08-01T19:55:49.922 INFO:teuthology.orchestra.run.smithi155.stdout: } 2023-08-01T19:55:49.922 INFO:teuthology.orchestra.run.smithi155.stdout: ] 2023-08-01T19:55:49.922 INFO:teuthology.orchestra.run.smithi155.stdout: } 2023-08-01T19:55:49.922 INFO:teuthology.orchestra.run.smithi155.stdout: }, 2023-08-01T19:55:49.922 INFO:teuthology.orchestra.run.smithi155.stdout: { 2023-08-01T19:55:49.922 INFO:teuthology.orchestra.run.smithi155.stdout: "description": "osd_repop(client.4668.0:100244 5.9 e37/19 5:92f56a12:::benchmark_data_smithi006_114134_object100243:head v 37'6294, mlcod=37'6292)", 2023-08-01T19:55:49.922 INFO:teuthology.orchestra.run.smithi155.stdout: "initiated_at": "2023-08-01T19:55:05.151325+0000", 2023-08-01T19:55:49.923 INFO:teuthology.orchestra.run.smithi155.stdout: "age": 44.679740567000003, 2023-08-01T19:55:49.923 INFO:teuthology.orchestra.run.smithi155.stdout: "duration": 0.071883673999999995, 2023-08-01T19:55:49.923 INFO:teuthology.orchestra.run.smithi155.stdout: "type_data": { 2023-08-01T19:55:49.923 INFO:teuthology.orchestra.run.smithi155.stdout: "flag_point": "commit sent; apply or cleanup", 2023-08-01T19:55:49.923 INFO:teuthology.orchestra.run.smithi155.stdout: "events": [ 2023-08-01T19:55:49.923 INFO:teuthology.orchestra.run.smithi155.stdout: { 2023-08-01T19:55:49.923 INFO:teuthology.orchestra.run.smithi155.stdout: "event": "initiated", 2023-08-01T19:55:49.924 INFO:teuthology.orchestra.run.smithi155.stdout: "time": "2023-08-01T19:55:05.151325+0000", 2023-08-01T19:55:49.924 INFO:teuthology.orchestra.run.smithi155.stdout: "duration": 0 2023-08-01T19:55:49.924 INFO:teuthology.orchestra.run.smithi155.stdout: }, 2023-08-01T19:55:49.924 INFO:teuthology.orchestra.run.smithi155.stdout: { 2023-08-01T19:55:49.924 INFO:teuthology.orchestra.run.smithi155.stdout: "event": "throttled", 2023-08-01T19:55:49.924 INFO:teuthology.orchestra.run.smithi155.stdout: "time": "2023-08-01T19:55:05.151325+0000", 2023-08-01T19:55:49.925 INFO:teuthology.orchestra.run.smithi155.stdout: "duration": 0 2023-08-01T19:55:49.925 INFO:teuthology.orchestra.run.smithi155.stdout: }, 2023-08-01T19:55:49.925 INFO:teuthology.orchestra.run.smithi155.stdout: { 2023-08-01T19:55:49.925 INFO:teuthology.orchestra.run.smithi155.stdout: "event": "header_read", 2023-08-01T19:55:49.925 INFO:teuthology.orchestra.run.smithi155.stdout: "time": "2023-08-01T19:55:05.151325+0000", 2023-08-01T19:55:49.925 INFO:teuthology.orchestra.run.smithi155.stdout: "duration": 4294967295.9999995 2023-08-01T19:55:49.926 INFO:teuthology.orchestra.run.smithi155.stdout: }, 2023-08-01T19:55:49.926 INFO:teuthology.orchestra.run.smithi155.stdout: { 2023-08-01T19:55:49.926 INFO:teuthology.orchestra.run.smithi155.stdout: "event": "all_read", 2023-08-01T19:55:49.926 INFO:teuthology.orchestra.run.smithi155.stdout: "time": "2023-08-01T19:55:05.151390+0000", 2023-08-01T19:55:49.926 INFO:teuthology.orchestra.run.smithi155.stdout: "duration": 6.5456999999999993e-05 2023-08-01T19:55:49.926 INFO:teuthology.orchestra.run.smithi155.stdout: }, 2023-08-01T19:55:49.926 INFO:teuthology.orchestra.run.smithi155.stdout: { 2023-08-01T19:55:49.927 INFO:teuthology.orchestra.run.smithi155.stdout: "event": "dispatched", 2023-08-01T19:55:49.927 INFO:teuthology.orchestra.run.smithi155.stdout: "time": "2023-08-01T19:55:05.151396+0000", 2023-08-01T19:55:49.927 INFO:teuthology.orchestra.run.smithi155.stdout: "duration": 5.9190000000000004e-06 2023-08-01T19:55:49.927 INFO:teuthology.orchestra.run.smithi155.stdout: }, 2023-08-01T19:55:49.927 INFO:teuthology.orchestra.run.smithi155.stdout: { 2023-08-01T19:55:49.927 INFO:teuthology.orchestra.run.smithi155.stdout: "event": "queued_for_pg", 2023-08-01T19:55:49.927 INFO:teuthology.orchestra.run.smithi155.stdout: "time": "2023-08-01T19:55:05.151400+0000", 2023-08-01T19:55:49.928 INFO:teuthology.orchestra.run.smithi155.stdout: "duration": 4.1030000000000004e-06 2023-08-01T19:55:49.928 INFO:teuthology.orchestra.run.smithi155.stdout: }, 2023-08-01T19:55:49.928 INFO:teuthology.orchestra.run.smithi155.stdout: { 2023-08-01T19:55:49.928 INFO:teuthology.orchestra.run.smithi155.stdout: "event": "reached_pg", 2023-08-01T19:55:49.928 INFO:teuthology.orchestra.run.smithi155.stdout: "time": "2023-08-01T19:55:05.151452+0000", 2023-08-01T19:55:49.928 INFO:teuthology.orchestra.run.smithi155.stdout: "duration": 5.2136999999999999e-05 2023-08-01T19:55:49.929 INFO:teuthology.orchestra.run.smithi155.stdout: }, 2023-08-01T19:55:49.929 INFO:teuthology.orchestra.run.smithi155.stdout: { 2023-08-01T19:55:49.929 INFO:teuthology.orchestra.run.smithi155.stdout: "event": "started", 2023-08-01T19:55:49.929 INFO:teuthology.orchestra.run.smithi155.stdout: "time": "2023-08-01T19:55:05.151470+0000", 2023-08-01T19:55:49.929 INFO:teuthology.orchestra.run.smithi155.stdout: "duration": 1.8e-05 2023-08-01T19:55:49.929 INFO:teuthology.orchestra.run.smithi155.stdout: }, 2023-08-01T19:55:49.929 INFO:teuthology.orchestra.run.smithi155.stdout: { 2023-08-01T19:55:49.930 INFO:teuthology.orchestra.run.smithi155.stdout: "event": "commit_sent", 2023-08-01T19:55:49.930 INFO:teuthology.orchestra.run.smithi155.stdout: "time": "2023-08-01T19:55:05.223183+0000", 2023-08-01T19:55:49.930 INFO:teuthology.orchestra.run.smithi155.stdout: "duration": 0.071712622000000004 2023-08-01T19:55:49.930 INFO:teuthology.orchestra.run.smithi155.stdout: }, 2023-08-01T19:55:49.930 INFO:teuthology.orchestra.run.smithi155.stdout: { 2023-08-01T19:55:49.930 INFO:teuthology.orchestra.run.smithi155.stdout: "event": "done", 2023-08-01T19:55:49.930 INFO:teuthology.orchestra.run.smithi155.stdout: "time": "2023-08-01T19:55:05.223209+0000", 2023-08-01T19:55:49.931 INFO:teuthology.orchestra.run.smithi155.stdout: "duration": 2.5956e-05 2023-08-01T19:55:49.931 INFO:teuthology.orchestra.run.smithi155.stdout: } 2023-08-01T19:55:49.931 INFO:teuthology.orchestra.run.smithi155.stdout: ] 2023-08-01T19:55:49.931 INFO:teuthology.orchestra.run.smithi155.stdout: } 2023-08-01T19:55:49.931 INFO:teuthology.orchestra.run.smithi155.stdout: }, 2023-08-01T19:55:49.931 INFO:teuthology.orchestra.run.smithi155.stdout: { 2023-08-01T19:55:49.931 INFO:teuthology.orchestra.run.smithi155.stdout: "description": "osd_op(client.4668.0:100249 5.b 5:d0666827:::benchmark_data_smithi006_114134_object100248:head [set-alloc-hint object_size 65536 write_size 65536,write 0~65536] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e37)", 2023-08-01T19:55:49.931 INFO:teuthology.orchestra.run.smithi155.stdout: "initiated_at": "2023-08-01T19:55:05.153614+0000", 2023-08-01T19:55:49.932 INFO:teuthology.orchestra.run.smithi155.stdout: "age": 44.677452142, 2023-08-01T19:55:49.932 INFO:teuthology.orchestra.run.smithi155.stdout: "duration": 0.069286118999999993, 2023-08-01T19:55:49.932 INFO:teuthology.orchestra.run.smithi155.stdout: "type_data": { 2023-08-01T19:55:49.932 INFO:teuthology.orchestra.run.smithi155.stdout: "flag_point": "commit sent; apply or cleanup", 2023-08-01T19:55:49.932 INFO:teuthology.orchestra.run.smithi155.stdout: "client_info": { 2023-08-01T19:55:49.932 INFO:teuthology.orchestra.run.smithi155.stdout: "client": "client.4668", 2023-08-01T19:55:49.932 INFO:teuthology.orchestra.run.smithi155.stdout: "client_addr": "172.21.15.6:0/1709472247", 2023-08-01T19:55:49.933 INFO:teuthology.orchestra.run.smithi155.stdout: "tid": 100249 2023-08-01T19:55:49.933 INFO:teuthology.orchestra.run.smithi155.stdout: }, 2023-08-01T19:55:49.933 INFO:teuthology.orchestra.run.smithi155.stdout: "events": [ 2023-08-01T19:55:49.933 INFO:teuthology.orchestra.run.smithi155.stdout: { 2023-08-01T19:55:49.933 INFO:teuthology.orchestra.run.smithi155.stdout: "event": "initiated", 2023-08-01T19:55:49.933 INFO:teuthology.orchestra.run.smithi155.stdout: "time": "2023-08-01T19:55:05.153614+0000", 2023-08-01T19:55:49.933 INFO:teuthology.orchestra.run.smithi155.stdout: "duration": 0 2023-08-01T19:55:49.934 INFO:teuthology.orchestra.run.smithi155.stdout: }, 2023-08-01T19:55:49.934 INFO:teuthology.orchestra.run.smithi155.stdout: { 2023-08-01T19:55:49.934 INFO:teuthology.orchestra.run.smithi155.stdout: "event": "throttled", 2023-08-01T19:55:49.934 INFO:teuthology.orchestra.run.smithi155.stdout: "time": "2023-08-01T19:55:05.153614+0000", 2023-08-01T19:55:49.934 INFO:teuthology.orchestra.run.smithi155.stdout: "duration": 0 2023-08-01T19:55:49.934 INFO:teuthology.orchestra.run.smithi155.stdout: }, 2023-08-01T19:55:49.934 INFO:teuthology.orchestra.run.smithi155.stdout: { 2023-08-01T19:55:49.935 INFO:teuthology.orchestra.run.smithi155.stdout: "event": "header_read", 2023-08-01T19:55:49.935 INFO:teuthology.orchestra.run.smithi155.stdout: "time": "2023-08-01T19:55:05.153612+0000", 2023-08-01T19:55:49.935 INFO:teuthology.orchestra.run.smithi155.stdout: "duration": 4294967295.9999986 2023-08-01T19:55:49.935 INFO:teuthology.orchestra.run.smithi155.stdout: }, 2023-08-01T19:55:49.935 INFO:teuthology.orchestra.run.smithi155.stdout: { 2023-08-01T19:55:49.935 INFO:teuthology.orchestra.run.smithi155.stdout: "event": "all_read", 2023-08-01T19:55:49.935 INFO:teuthology.orchestra.run.smithi155.stdout: "time": "2023-08-01T19:55:05.153694+0000", 2023-08-01T19:55:49.936 INFO:teuthology.orchestra.run.smithi155.stdout: "duration": 8.1618000000000004e-05 2023-08-01T19:55:49.936 INFO:teuthology.orchestra.run.smithi155.stdout: }, 2023-08-01T19:55:49.936 INFO:teuthology.orchestra.run.smithi155.stdout: { 2023-08-01T19:55:49.936 INFO:teuthology.orchestra.run.smithi155.stdout: "event": "dispatched", 2023-08-01T19:55:49.936 INFO:teuthology.orchestra.run.smithi155.stdout: "time": "2023-08-01T19:55:05.153713+0000", 2023-08-01T19:55:49.936 INFO:teuthology.orchestra.run.smithi155.stdout: "duration": 1.9069999999999999e-05 2023-08-01T19:55:49.936 INFO:teuthology.orchestra.run.smithi155.stdout: }, 2023-08-01T19:55:49.937 INFO:teuthology.orchestra.run.smithi155.stdout: { 2023-08-01T19:55:49.937 INFO:teuthology.orchestra.run.smithi155.stdout: "event": "queued_for_pg", 2023-08-01T19:55:49.937 INFO:teuthology.orchestra.run.smithi155.stdout: "time": "2023-08-01T19:55:05.153726+0000", 2023-08-01T19:55:49.937 INFO:teuthology.orchestra.run.smithi155.stdout: "duration": 1.238e-05 2023-08-01T19:55:49.937 INFO:teuthology.orchestra.run.smithi155.stdout: }, 2023-08-01T19:55:49.937 INFO:teuthology.orchestra.run.smithi155.stdout: { 2023-08-01T19:55:49.937 INFO:teuthology.orchestra.run.smithi155.stdout: "event": "reached_pg", 2023-08-01T19:55:49.938 INFO:teuthology.orchestra.run.smithi155.stdout: "time": "2023-08-01T19:55:05.153761+0000", 2023-08-01T19:55:49.938 INFO:teuthology.orchestra.run.smithi155.stdout: "duration": 3.5046999999999998e-05 2023-08-01T19:55:49.938 INFO:teuthology.orchestra.run.smithi155.stdout: }, 2023-08-01T19:55:49.938 INFO:teuthology.orchestra.run.smithi155.stdout: { 2023-08-01T19:55:49.938 INFO:teuthology.orchestra.run.smithi155.stdout: "event": "started", 2023-08-01T19:55:49.938 INFO:teuthology.orchestra.run.smithi155.stdout: "time": "2023-08-01T19:55:05.153896+0000", 2023-08-01T19:55:49.938 INFO:teuthology.orchestra.run.smithi155.stdout: "duration": 0.00013575800000000001 2023-08-01T19:55:49.939 INFO:teuthology.orchestra.run.smithi155.stdout: }, 2023-08-01T19:55:49.939 INFO:teuthology.orchestra.run.smithi155.stdout: { 2023-08-01T19:55:49.939 INFO:teuthology.orchestra.run.smithi155.stdout: "event": "waiting for subops from 0", 2023-08-01T19:55:49.939 INFO:teuthology.orchestra.run.smithi155.stdout: "time": "2023-08-01T19:55:05.154043+0000", 2023-08-01T19:55:49.939 INFO:teuthology.orchestra.run.smithi155.stdout: "duration": 0.00014650700000000001 2023-08-01T19:55:49.939 INFO:teuthology.orchestra.run.smithi155.stdout: }, 2023-08-01T19:55:49.939 INFO:teuthology.orchestra.run.smithi155.stdout: { 2023-08-01T19:55:49.940 INFO:teuthology.orchestra.run.smithi155.stdout: "event": "sub_op_commit_rec", 2023-08-01T19:55:49.940 INFO:teuthology.orchestra.run.smithi155.stdout: "time": "2023-08-01T19:55:05.221876+0000", 2023-08-01T19:55:49.940 INFO:teuthology.orchestra.run.smithi155.stdout: "duration": 0.067832796000000001 2023-08-01T19:55:49.940 INFO:teuthology.orchestra.run.smithi155.stdout: }, 2023-08-01T19:55:49.940 INFO:teuthology.orchestra.run.smithi155.stdout: { 2023-08-01T19:55:49.940 INFO:teuthology.orchestra.run.smithi155.stdout: "event": "op_commit", 2023-08-01T19:55:49.940 INFO:teuthology.orchestra.run.smithi155.stdout: "time": "2023-08-01T19:55:05.222813+0000", 2023-08-01T19:55:49.941 INFO:teuthology.orchestra.run.smithi155.stdout: "duration": 0.00093755300000000004 2023-08-01T19:55:49.941 INFO:teuthology.orchestra.run.smithi155.stdout: }, 2023-08-01T19:55:49.941 INFO:teuthology.orchestra.run.smithi155.stdout: { 2023-08-01T19:55:49.941 INFO:teuthology.orchestra.run.smithi155.stdout: "event": "commit_sent", 2023-08-01T19:55:49.941 INFO:teuthology.orchestra.run.smithi155.stdout: "time": "2023-08-01T19:55:05.222861+0000", 2023-08-01T19:55:49.941 INFO:teuthology.orchestra.run.smithi155.stdout: "duration": 4.8013999999999998e-05 2023-08-01T19:55:49.941 INFO:teuthology.orchestra.run.smithi155.stdout: }, 2023-08-01T19:55:49.942 INFO:teuthology.orchestra.run.smithi155.stdout: { 2023-08-01T19:55:49.942 INFO:teuthology.orchestra.run.smithi155.stdout: "event": "done", 2023-08-01T19:55:49.942 INFO:teuthology.orchestra.run.smithi155.stdout: "time": "2023-08-01T19:55:05.222900+0000", 2023-08-01T19:55:49.942 INFO:teuthology.orchestra.run.smithi155.stdout: "duration": 3.8634999999999999e-05 2023-08-01T19:55:49.942 INFO:teuthology.orchestra.run.smithi155.stdout: } 2023-08-01T19:55:49.942 INFO:teuthology.orchestra.run.smithi155.stdout: ] 2023-08-01T19:55:49.942 INFO:teuthology.orchestra.run.smithi155.stdout: } 2023-08-01T19:55:49.943 INFO:teuthology.orchestra.run.smithi155.stdout: }, 2023-08-01T19:55:49.943 INFO:teuthology.orchestra.run.smithi155.stdout: { 2023-08-01T19:55:49.943 INFO:teuthology.orchestra.run.smithi155.stdout: "description": "osd_op(client.4668.0:100251 5.b 5:d853df24:::benchmark_data_smithi006_114134_object100250:head [set-alloc-hint object_size 65536 write_size 65536,write 0~65536] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e37)", 2023-08-01T19:55:49.943 INFO:teuthology.orchestra.run.smithi155.stdout: "initiated_at": "2023-08-01T19:55:05.153737+0000", 2023-08-01T19:55:49.943 INFO:teuthology.orchestra.run.smithi155.stdout: "age": 44.677329127999997, 2023-08-01T19:55:49.943 INFO:teuthology.orchestra.run.smithi155.stdout: "duration": 0.071366545000000003, 2023-08-01T19:55:49.944 INFO:teuthology.orchestra.run.smithi155.stdout: "type_data": { 2023-08-01T19:55:49.944 INFO:teuthology.orchestra.run.smithi155.stdout: "flag_point": "commit sent; apply or cleanup", 2023-08-01T19:55:49.944 INFO:teuthology.orchestra.run.smithi155.stdout: "client_info": { 2023-08-01T19:55:49.944 INFO:teuthology.orchestra.run.smithi155.stdout: "client": "client.4668", 2023-08-01T19:55:49.944 INFO:teuthology.orchestra.run.smithi155.stdout: "client_addr": "172.21.15.6:0/1709472247", 2023-08-01T19:55:49.944 INFO:teuthology.orchestra.run.smithi155.stdout: "tid": 100251 2023-08-01T19:55:49.944 INFO:teuthology.orchestra.run.smithi155.stdout: }, 2023-08-01T19:55:49.945 INFO:teuthology.orchestra.run.smithi155.stdout: "events": [ 2023-08-01T19:55:49.945 INFO:teuthology.orchestra.run.smithi155.stdout: { 2023-08-01T19:55:49.945 INFO:teuthology.orchestra.run.smithi155.stdout: "event": "initiated", 2023-08-01T19:55:49.945 INFO:teuthology.orchestra.run.smithi155.stdout: "time": "2023-08-01T19:55:05.153737+0000", 2023-08-01T19:55:49.945 INFO:teuthology.orchestra.run.smithi155.stdout: "duration": 0 2023-08-01T19:55:49.945 INFO:teuthology.orchestra.run.smithi155.stdout: }, 2023-08-01T19:55:49.945 INFO:teuthology.orchestra.run.smithi155.stdout: { 2023-08-01T19:55:49.946 INFO:teuthology.orchestra.run.smithi155.stdout: "event": "throttled", 2023-08-01T19:55:49.946 INFO:teuthology.orchestra.run.smithi155.stdout: "time": "2023-08-01T19:55:05.153737+0000", 2023-08-01T19:55:49.946 INFO:teuthology.orchestra.run.smithi155.stdout: "duration": 0 2023-08-01T19:55:49.946 INFO:teuthology.orchestra.run.smithi155.stdout: }, 2023-08-01T19:55:49.946 INFO:teuthology.orchestra.run.smithi155.stdout: { 2023-08-01T19:55:49.946 INFO:teuthology.orchestra.run.smithi155.stdout: "event": "header_read", 2023-08-01T19:55:49.946 INFO:teuthology.orchestra.run.smithi155.stdout: "time": "2023-08-01T19:55:05.153736+0000", 2023-08-01T19:55:49.946 INFO:teuthology.orchestra.run.smithi155.stdout: "duration": 4294967295.9999995 2023-08-01T19:55:49.947 INFO:teuthology.orchestra.run.smithi155.stdout: }, 2023-08-01T19:55:49.947 INFO:teuthology.orchestra.run.smithi155.stdout: { 2023-08-01T19:55:49.947 INFO:teuthology.orchestra.run.smithi155.stdout: "event": "all_read", 2023-08-01T19:55:49.947 INFO:teuthology.orchestra.run.smithi155.stdout: "time": "2023-08-01T19:55:05.153784+0000", 2023-08-01T19:55:49.947 INFO:teuthology.orchestra.run.smithi155.stdout: "duration": 4.7660000000000001e-05 2023-08-01T19:55:49.947 INFO:teuthology.orchestra.run.smithi155.stdout: }, 2023-08-01T19:55:49.947 INFO:teuthology.orchestra.run.smithi155.stdout: { 2023-08-01T19:55:49.948 INFO:teuthology.orchestra.run.smithi155.stdout: "event": "dispatched", 2023-08-01T19:55:49.948 INFO:teuthology.orchestra.run.smithi155.stdout: "time": "2023-08-01T19:55:05.153793+0000", 2023-08-01T19:55:49.948 INFO:teuthology.orchestra.run.smithi155.stdout: "duration": 8.7150000000000004e-06 2023-08-01T19:55:49.948 INFO:teuthology.orchestra.run.smithi155.stdout: }, 2023-08-01T19:55:49.948 INFO:teuthology.orchestra.run.smithi155.stdout: { 2023-08-01T19:55:49.948 INFO:teuthology.orchestra.run.smithi155.stdout: "event": "queued_for_pg", 2023-08-01T19:55:49.948 INFO:teuthology.orchestra.run.smithi155.stdout: "time": "2023-08-01T19:55:05.153800+0000", 2023-08-01T19:55:49.949 INFO:teuthology.orchestra.run.smithi155.stdout: "duration": 7.2459999999999997e-06 2023-08-01T19:55:49.949 INFO:teuthology.orchestra.run.smithi155.stdout: }, 2023-08-01T19:55:49.949 INFO:teuthology.orchestra.run.smithi155.stdout: { 2023-08-01T19:55:49.949 INFO:teuthology.orchestra.run.smithi155.stdout: "event": "reached_pg", 2023-08-01T19:55:49.949 INFO:teuthology.orchestra.run.smithi155.stdout: "time": "2023-08-01T19:55:05.156241+0000", 2023-08-01T19:55:49.949 INFO:teuthology.orchestra.run.smithi155.stdout: "duration": 0.0024415359999999998 2023-08-01T19:55:49.949 INFO:teuthology.orchestra.run.smithi155.stdout: }, 2023-08-01T19:55:49.950 INFO:teuthology.orchestra.run.smithi155.stdout: { 2023-08-01T19:55:49.950 INFO:teuthology.orchestra.run.smithi155.stdout: "event": "started", 2023-08-01T19:55:49.950 INFO:teuthology.orchestra.run.smithi155.stdout: "time": "2023-08-01T19:55:05.219045+0000", 2023-08-01T19:55:49.950 INFO:teuthology.orchestra.run.smithi155.stdout: "duration": 0.062803855000000006 2023-08-01T19:55:49.950 INFO:teuthology.orchestra.run.smithi155.stdout: }, 2023-08-01T19:55:49.950 INFO:teuthology.orchestra.run.smithi155.stdout: { 2023-08-01T19:55:49.951 INFO:teuthology.orchestra.run.smithi155.stdout: "event": "waiting for subops from 0", 2023-08-01T19:55:49.951 INFO:teuthology.orchestra.run.smithi155.stdout: "time": "2023-08-01T19:55:05.219238+0000", 2023-08-01T19:55:49.951 INFO:teuthology.orchestra.run.smithi155.stdout: "duration": 0.00019241500000000001 2023-08-01T19:55:49.951 INFO:teuthology.orchestra.run.smithi155.stdout: }, 2023-08-01T19:55:49.951 INFO:teuthology.orchestra.run.smithi155.stdout: { 2023-08-01T19:55:49.951 INFO:teuthology.orchestra.run.smithi155.stdout: "event": "sub_op_commit_rec", 2023-08-01T19:55:49.951 INFO:teuthology.orchestra.run.smithi155.stdout: "time": "2023-08-01T19:55:05.223300+0000", 2023-08-01T19:55:49.952 INFO:teuthology.orchestra.run.smithi155.stdout: "duration": 0.0040626509999999996 2023-08-01T19:55:49.952 INFO:teuthology.orchestra.run.smithi155.stdout: }, 2023-08-01T19:55:49.952 INFO:teuthology.orchestra.run.smithi155.stdout: { 2023-08-01T19:55:49.952 INFO:teuthology.orchestra.run.smithi155.stdout: "event": "op_commit", 2023-08-01T19:55:49.952 INFO:teuthology.orchestra.run.smithi155.stdout: "time": "2023-08-01T19:55:05.225020+0000", 2023-08-01T19:55:49.952 INFO:teuthology.orchestra.run.smithi155.stdout: "duration": 0.0017201 2023-08-01T19:55:49.952 INFO:teuthology.orchestra.run.smithi155.stdout: }, 2023-08-01T19:55:49.953 INFO:teuthology.orchestra.run.smithi155.stdout: { 2023-08-01T19:55:49.953 INFO:teuthology.orchestra.run.smithi155.stdout: "event": "commit_sent", 2023-08-01T19:55:49.953 INFO:teuthology.orchestra.run.smithi155.stdout: "time": "2023-08-01T19:55:05.225066+0000", 2023-08-01T19:55:49.953 INFO:teuthology.orchestra.run.smithi155.stdout: "duration": 4.6143000000000002e-05 2023-08-01T19:55:49.953 INFO:teuthology.orchestra.run.smithi155.stdout: }, 2023-08-01T19:55:49.953 INFO:teuthology.orchestra.run.smithi155.stdout: { 2023-08-01T19:55:49.953 INFO:teuthology.orchestra.run.smithi155.stdout: "event": "done", 2023-08-01T19:55:49.953 INFO:teuthology.orchestra.run.smithi155.stdout: "time": "2023-08-01T19:55:05.225103+0000", 2023-08-01T19:55:49.954 INFO:teuthology.orchestra.run.smithi155.stdout: "duration": 3.6789999999999998e-05 2023-08-01T19:55:49.954 INFO:teuthology.orchestra.run.smithi155.stdout: } 2023-08-01T19:55:49.954 INFO:teuthology.orchestra.run.smithi155.stdout: ] 2023-08-01T19:55:49.954 INFO:teuthology.orchestra.run.smithi155.stdout: } 2023-08-01T19:55:49.954 INFO:teuthology.orchestra.run.smithi155.stdout: }, 2023-08-01T19:55:49.954 INFO:teuthology.orchestra.run.smithi155.stdout: { 2023-08-01T19:55:49.954 INFO:teuthology.orchestra.run.smithi155.stdout: "description": "osd_op(client.4668.0:100252 5.0 5:01f90c3c:::benchmark_data_smithi006_114134_object100251:head [set-alloc-hint object_size 65536 write_size 65536,write 0~65536] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e37)", 2023-08-01T19:55:49.955 INFO:teuthology.orchestra.run.smithi155.stdout: "initiated_at": "2023-08-01T19:55:05.154048+0000", 2023-08-01T19:55:49.955 INFO:teuthology.orchestra.run.smithi155.stdout: "age": 44.677017880999998, 2023-08-01T19:55:49.955 INFO:teuthology.orchestra.run.smithi155.stdout: "duration": 0.070156683999999997, 2023-08-01T19:55:49.955 INFO:teuthology.orchestra.run.smithi155.stdout: "type_data": { 2023-08-01T19:55:49.955 INFO:teuthology.orchestra.run.smithi155.stdout: "flag_point": "commit sent; apply or cleanup", 2023-08-01T19:55:49.955 INFO:teuthology.orchestra.run.smithi155.stdout: "client_info": { 2023-08-01T19:55:49.955 INFO:teuthology.orchestra.run.smithi155.stdout: "client": "client.4668", 2023-08-01T19:55:49.956 INFO:teuthology.orchestra.run.smithi155.stdout: "client_addr": "172.21.15.6:0/1709472247", 2023-08-01T19:55:49.956 INFO:teuthology.orchestra.run.smithi155.stdout: "tid": 100252 2023-08-01T19:55:49.956 INFO:teuthology.orchestra.run.smithi155.stdout: }, 2023-08-01T19:55:49.956 INFO:teuthology.orchestra.run.smithi155.stdout: "events": [ 2023-08-01T19:55:49.956 INFO:teuthology.orchestra.run.smithi155.stdout: { 2023-08-01T19:55:49.956 INFO:teuthology.orchestra.run.smithi155.stdout: "event": "initiated", 2023-08-01T19:55:49.957 INFO:teuthology.orchestra.run.smithi155.stdout: "time": "2023-08-01T19:55:05.154048+0000", 2023-08-01T19:55:49.957 INFO:teuthology.orchestra.run.smithi155.stdout: "duration": 0 2023-08-01T19:55:49.957 INFO:teuthology.orchestra.run.smithi155.stdout: }, 2023-08-01T19:55:49.957 INFO:teuthology.orchestra.run.smithi155.stdout: { 2023-08-01T19:55:49.957 INFO:teuthology.orchestra.run.smithi155.stdout: "event": "throttled", 2023-08-01T19:55:49.957 INFO:teuthology.orchestra.run.smithi155.stdout: "time": "2023-08-01T19:55:05.154048+0000", 2023-08-01T19:55:49.957 INFO:teuthology.orchestra.run.smithi155.stdout: "duration": 0 2023-08-01T19:55:49.958 INFO:teuthology.orchestra.run.smithi155.stdout: }, 2023-08-01T19:55:49.958 INFO:teuthology.orchestra.run.smithi155.stdout: { 2023-08-01T19:55:49.958 INFO:teuthology.orchestra.run.smithi155.stdout: "event": "header_read", 2023-08-01T19:55:49.958 INFO:teuthology.orchestra.run.smithi155.stdout: "time": "2023-08-01T19:55:05.154047+0000", 2023-08-01T19:55:49.958 INFO:teuthology.orchestra.run.smithi155.stdout: "duration": 4294967295.999999 2023-08-01T19:55:49.958 INFO:teuthology.orchestra.run.smithi155.stdout: }, 2023-08-01T19:55:49.958 INFO:teuthology.orchestra.run.smithi155.stdout: { 2023-08-01T19:55:49.958 INFO:teuthology.orchestra.run.smithi155.stdout: "event": "all_read", 2023-08-01T19:55:49.959 INFO:teuthology.orchestra.run.smithi155.stdout: "time": "2023-08-01T19:55:05.154115+0000", 2023-08-01T19:55:49.959 INFO:teuthology.orchestra.run.smithi155.stdout: "duration": 6.7545999999999993e-05 2023-08-01T19:55:49.959 INFO:teuthology.orchestra.run.smithi155.stdout: }, 2023-08-01T19:55:49.959 INFO:teuthology.orchestra.run.smithi155.stdout: { 2023-08-01T19:55:49.959 INFO:teuthology.orchestra.run.smithi155.stdout: "event": "dispatched", 2023-08-01T19:55:49.959 INFO:teuthology.orchestra.run.smithi155.stdout: "time": "2023-08-01T19:55:05.154125+0000", 2023-08-01T19:55:49.959 INFO:teuthology.orchestra.run.smithi155.stdout: "duration": 1.0669000000000001e-05 2023-08-01T19:55:49.960 INFO:teuthology.orchestra.run.smithi155.stdout: }, 2023-08-01T19:55:49.960 INFO:teuthology.orchestra.run.smithi155.stdout: { 2023-08-01T19:55:49.960 INFO:teuthology.orchestra.run.smithi155.stdout: "event": "queued_for_pg", 2023-08-01T19:55:49.960 INFO:teuthology.orchestra.run.smithi155.stdout: "time": "2023-08-01T19:55:05.154131+0000", 2023-08-01T19:55:49.960 INFO:teuthology.orchestra.run.smithi155.stdout: "duration": 6.0349999999999998e-06 2023-08-01T19:55:49.960 INFO:teuthology.orchestra.run.smithi155.stdout: }, 2023-08-01T19:55:49.960 INFO:teuthology.orchestra.run.smithi155.stdout: { 2023-08-01T19:55:49.961 INFO:teuthology.orchestra.run.smithi155.stdout: "event": "reached_pg", 2023-08-01T19:55:49.961 INFO:teuthology.orchestra.run.smithi155.stdout: "time": "2023-08-01T19:55:05.154174+0000", 2023-08-01T19:55:49.961 INFO:teuthology.orchestra.run.smithi155.stdout: "duration": 4.2429000000000003e-05 2023-08-01T19:55:49.961 INFO:teuthology.orchestra.run.smithi155.stdout: }, 2023-08-01T19:55:49.961 INFO:teuthology.orchestra.run.smithi155.stdout: { 2023-08-01T19:55:49.961 INFO:teuthology.orchestra.run.smithi155.stdout: "event": "started", 2023-08-01T19:55:49.961 INFO:teuthology.orchestra.run.smithi155.stdout: "time": "2023-08-01T19:55:05.154287+0000", 2023-08-01T19:55:49.962 INFO:teuthology.orchestra.run.smithi155.stdout: "duration": 0.000113138 2023-08-01T19:55:49.962 INFO:teuthology.orchestra.run.smithi155.stdout: }, 2023-08-01T19:55:49.962 INFO:teuthology.orchestra.run.smithi155.stdout: { 2023-08-01T19:55:49.962 INFO:teuthology.orchestra.run.smithi155.stdout: "event": "waiting for subops from 0", 2023-08-01T19:55:49.962 INFO:teuthology.orchestra.run.smithi155.stdout: "time": "2023-08-01T19:55:05.154420+0000", 2023-08-01T19:55:49.962 INFO:teuthology.orchestra.run.smithi155.stdout: "duration": 0.000133292 2023-08-01T19:55:49.962 INFO:teuthology.orchestra.run.smithi155.stdout: }, 2023-08-01T19:55:49.963 INFO:teuthology.orchestra.run.smithi155.stdout: { 2023-08-01T19:55:49.963 INFO:teuthology.orchestra.run.smithi155.stdout: "event": "sub_op_commit_rec", 2023-08-01T19:55:49.963 INFO:teuthology.orchestra.run.smithi155.stdout: "time": "2023-08-01T19:55:05.219034+0000", 2023-08-01T19:55:49.963 INFO:teuthology.orchestra.run.smithi155.stdout: "duration": 0.064613429999999999 2023-08-01T19:55:49.963 INFO:teuthology.orchestra.run.smithi155.stdout: }, 2023-08-01T19:55:49.963 INFO:teuthology.orchestra.run.smithi155.stdout: { 2023-08-01T19:55:49.963 INFO:teuthology.orchestra.run.smithi155.stdout: "event": "op_commit", 2023-08-01T19:55:49.964 INFO:teuthology.orchestra.run.smithi155.stdout: "time": "2023-08-01T19:55:05.224138+0000", 2023-08-01T19:55:49.964 INFO:teuthology.orchestra.run.smithi155.stdout: "duration": 0.0051041999999999997 2023-08-01T19:55:49.964 INFO:teuthology.orchestra.run.smithi155.stdout: }, 2023-08-01T19:55:49.964 INFO:teuthology.orchestra.run.smithi155.stdout: { 2023-08-01T19:55:49.964 INFO:teuthology.orchestra.run.smithi155.stdout: "event": "commit_sent", 2023-08-01T19:55:49.964 INFO:teuthology.orchestra.run.smithi155.stdout: "time": "2023-08-01T19:55:05.224171+0000", 2023-08-01T19:55:49.964 INFO:teuthology.orchestra.run.smithi155.stdout: "duration": 3.3345e-05 2023-08-01T19:55:49.965 INFO:teuthology.orchestra.run.smithi155.stdout: }, 2023-08-01T19:55:49.965 INFO:teuthology.orchestra.run.smithi155.stdout: { 2023-08-01T19:55:49.965 INFO:teuthology.orchestra.run.smithi155.stdout: "event": "done", 2023-08-01T19:55:49.965 INFO:teuthology.orchestra.run.smithi155.stdout: "time": "2023-08-01T19:55:05.224205+0000", 2023-08-01T19:55:49.965 INFO:teuthology.orchestra.run.smithi155.stdout: "duration": 3.3525999999999997e-05 2023-08-01T19:55:49.965 INFO:teuthology.orchestra.run.smithi155.stdout: } 2023-08-01T19:55:49.965 INFO:teuthology.orchestra.run.smithi155.stdout: ] 2023-08-01T19:55:49.966 INFO:teuthology.orchestra.run.smithi155.stdout: } 2023-08-01T19:55:49.966 INFO:teuthology.orchestra.run.smithi155.stdout: }, 2023-08-01T19:55:49.966 INFO:teuthology.orchestra.run.smithi155.stdout: { 2023-08-01T19:55:49.966 INFO:teuthology.orchestra.run.smithi155.stdout: "description": "osd_repop_reply(client.4668.0:100237 5.4 e37/19 ondisk, result = 0)", 2023-08-01T19:55:49.966 INFO:teuthology.orchestra.run.smithi155.stdout: "initiated_at": "2023-08-01T19:55:05.156249+0000", 2023-08-01T19:55:49.966 INFO:teuthology.orchestra.run.smithi155.stdout: "age": 44.674816935999999, 2023-08-01T19:55:49.966 INFO:teuthology.orchestra.run.smithi155.stdout: "duration": 0.062792549000000003, 2023-08-01T19:55:49.966 INFO:teuthology.orchestra.run.smithi155.stdout: "type_data": { 2023-08-01T19:55:49.967 INFO:teuthology.orchestra.run.smithi155.stdout: "flag_point": "started", 2023-08-01T19:55:49.967 INFO:teuthology.orchestra.run.smithi155.stdout: "events": [ 2023-08-01T19:55:49.967 INFO:teuthology.orchestra.run.smithi155.stdout: { 2023-08-01T19:55:49.967 INFO:teuthology.orchestra.run.smithi155.stdout: "event": "initiated", 2023-08-01T19:55:49.967 INFO:teuthology.orchestra.run.smithi155.stdout: "time": "2023-08-01T19:55:05.156249+0000", 2023-08-01T19:55:49.967 INFO:teuthology.orchestra.run.smithi155.stdout: "duration": 0 2023-08-01T19:55:49.967 INFO:teuthology.orchestra.run.smithi155.stdout: }, 2023-08-01T19:55:49.968 INFO:teuthology.orchestra.run.smithi155.stdout: { 2023-08-01T19:55:49.968 INFO:teuthology.orchestra.run.smithi155.stdout: "event": "throttled", 2023-08-01T19:55:49.968 INFO:teuthology.orchestra.run.smithi155.stdout: "time": "2023-08-01T19:55:05.156249+0000", 2023-08-01T19:55:49.968 INFO:teuthology.orchestra.run.smithi155.stdout: "duration": 0 2023-08-01T19:55:49.968 INFO:teuthology.orchestra.run.smithi155.stdout: }, 2023-08-01T19:55:49.968 INFO:teuthology.orchestra.run.smithi155.stdout: { 2023-08-01T19:55:49.968 INFO:teuthology.orchestra.run.smithi155.stdout: "event": "header_read", 2023-08-01T19:55:49.969 INFO:teuthology.orchestra.run.smithi155.stdout: "time": "2023-08-01T19:55:05.156248+0000", 2023-08-01T19:55:49.969 INFO:teuthology.orchestra.run.smithi155.stdout: "duration": 4294967295.9999995 2023-08-01T19:55:49.969 INFO:teuthology.orchestra.run.smithi155.stdout: }, 2023-08-01T19:55:49.969 INFO:teuthology.orchestra.run.smithi155.stdout: { 2023-08-01T19:55:49.969 INFO:teuthology.orchestra.run.smithi155.stdout: "event": "all_read", 2023-08-01T19:55:49.969 INFO:teuthology.orchestra.run.smithi155.stdout: "time": "2023-08-01T19:55:05.156252+0000", 2023-08-01T19:55:49.969 INFO:teuthology.orchestra.run.smithi155.stdout: "duration": 3.9999999999999998e-06 2023-08-01T19:55:49.970 INFO:teuthology.orchestra.run.smithi155.stdout: }, 2023-08-01T19:55:49.970 INFO:teuthology.orchestra.run.smithi155.stdout: { 2023-08-01T19:55:49.970 INFO:teuthology.orchestra.run.smithi155.stdout: "event": "dispatched", 2023-08-01T19:55:49.970 INFO:teuthology.orchestra.run.smithi155.stdout: "time": "2023-08-01T19:55:05.218844+0000", 2023-08-01T19:55:49.970 INFO:teuthology.orchestra.run.smithi155.stdout: "duration": 0.062591516999999999 2023-08-01T19:55:49.970 INFO:teuthology.orchestra.run.smithi155.stdout: }, 2023-08-01T19:55:49.970 INFO:teuthology.orchestra.run.smithi155.stdout: { 2023-08-01T19:55:49.971 INFO:teuthology.orchestra.run.smithi155.stdout: "event": "queued_for_pg", 2023-08-01T19:55:49.971 INFO:teuthology.orchestra.run.smithi155.stdout: "time": "2023-08-01T19:55:05.218862+0000", 2023-08-01T19:55:49.971 INFO:teuthology.orchestra.run.smithi155.stdout: "duration": 1.7666e-05 2023-08-01T19:55:49.971 INFO:teuthology.orchestra.run.smithi155.stdout: }, 2023-08-01T19:55:49.971 INFO:teuthology.orchestra.run.smithi155.stdout: { 2023-08-01T19:55:49.971 INFO:teuthology.orchestra.run.smithi155.stdout: "event": "reached_pg", 2023-08-01T19:55:49.971 INFO:teuthology.orchestra.run.smithi155.stdout: "time": "2023-08-01T19:55:05.218914+0000", 2023-08-01T19:55:49.972 INFO:teuthology.orchestra.run.smithi155.stdout: "duration": 5.2565999999999998e-05 2023-08-01T19:55:49.972 INFO:teuthology.orchestra.run.smithi155.stdout: }, 2023-08-01T19:55:49.972 INFO:teuthology.orchestra.run.smithi155.stdout: { 2023-08-01T19:55:49.972 INFO:teuthology.orchestra.run.smithi155.stdout: "event": "started", 2023-08-01T19:55:49.972 INFO:teuthology.orchestra.run.smithi155.stdout: "time": "2023-08-01T19:55:05.218925+0000", 2023-08-01T19:55:49.972 INFO:teuthology.orchestra.run.smithi155.stdout: "duration": 1.1375e-05 2023-08-01T19:55:49.972 INFO:teuthology.orchestra.run.smithi155.stdout: }, 2023-08-01T19:55:49.972 INFO:teuthology.orchestra.run.smithi155.stdout: { 2023-08-01T19:55:49.973 INFO:teuthology.orchestra.run.smithi155.stdout: "event": "done", 2023-08-01T19:55:49.973 INFO:teuthology.orchestra.run.smithi155.stdout: "time": "2023-08-01T19:55:05.219041+0000", 2023-08-01T19:55:49.973 INFO:teuthology.orchestra.run.smithi155.stdout: "duration": 0.000115977 2023-08-01T19:55:49.973 INFO:teuthology.orchestra.run.smithi155.stdout: } 2023-08-01T19:55:49.973 INFO:teuthology.orchestra.run.smithi155.stdout: ] 2023-08-01T19:55:49.973 INFO:teuthology.orchestra.run.smithi155.stdout: } 2023-08-01T19:55:49.973 INFO:teuthology.orchestra.run.smithi155.stdout: }, 2023-08-01T19:55:49.974 INFO:teuthology.orchestra.run.smithi155.stdout: { 2023-08-01T19:55:49.974 INFO:teuthology.orchestra.run.smithi155.stdout: "description": "osd_repop(client.4668.0:100253 5.f e37/19 5:f7bbce05:::benchmark_data_smithi006_114134_object100252:head v 37'6323, mlcod=37'6321)", 2023-08-01T19:55:49.974 INFO:teuthology.orchestra.run.smithi155.stdout: "initiated_at": "2023-08-01T19:55:05.156952+0000", 2023-08-01T19:55:49.974 INFO:teuthology.orchestra.run.smithi155.stdout: "age": 44.674113873000003, 2023-08-01T19:55:49.974 INFO:teuthology.orchestra.run.smithi155.stdout: "duration": 0.068018577999999996, 2023-08-01T19:55:49.974 INFO:teuthology.orchestra.run.smithi155.stdout: "type_data": { 2023-08-01T19:55:49.974 INFO:teuthology.orchestra.run.smithi155.stdout: "flag_point": "commit sent; apply or cleanup", 2023-08-01T19:55:49.975 INFO:teuthology.orchestra.run.smithi155.stdout: "events": [ 2023-08-01T19:55:49.975 INFO:teuthology.orchestra.run.smithi155.stdout: { 2023-08-01T19:55:49.975 INFO:teuthology.orchestra.run.smithi155.stdout: "event": "initiated", 2023-08-01T19:55:49.975 INFO:teuthology.orchestra.run.smithi155.stdout: "time": "2023-08-01T19:55:05.156952+0000", 2023-08-01T19:55:49.975 INFO:teuthology.orchestra.run.smithi155.stdout: "duration": 0 2023-08-01T19:55:49.975 INFO:teuthology.orchestra.run.smithi155.stdout: }, 2023-08-01T19:55:49.975 INFO:teuthology.orchestra.run.smithi155.stdout: { 2023-08-01T19:55:49.976 INFO:teuthology.orchestra.run.smithi155.stdout: "event": "throttled", 2023-08-01T19:55:49.976 INFO:teuthology.orchestra.run.smithi155.stdout: "time": "2023-08-01T19:55:05.156952+0000", 2023-08-01T19:55:49.976 INFO:teuthology.orchestra.run.smithi155.stdout: "duration": 0 2023-08-01T19:55:49.976 INFO:teuthology.orchestra.run.smithi155.stdout: }, 2023-08-01T19:55:49.976 INFO:teuthology.orchestra.run.smithi155.stdout: { 2023-08-01T19:55:49.976 INFO:teuthology.orchestra.run.smithi155.stdout: "event": "header_read", 2023-08-01T19:55:49.976 INFO:teuthology.orchestra.run.smithi155.stdout: "time": "2023-08-01T19:55:05.156951+0000", 2023-08-01T19:55:49.977 INFO:teuthology.orchestra.run.smithi155.stdout: "duration": 4294967295.999999 2023-08-01T19:55:49.977 INFO:teuthology.orchestra.run.smithi155.stdout: }, 2023-08-01T19:55:49.977 INFO:teuthology.orchestra.run.smithi155.stdout: { 2023-08-01T19:55:49.977 INFO:teuthology.orchestra.run.smithi155.stdout: "event": "all_read", 2023-08-01T19:55:49.977 INFO:teuthology.orchestra.run.smithi155.stdout: "time": "2023-08-01T19:55:05.156989+0000", 2023-08-01T19:55:49.977 INFO:teuthology.orchestra.run.smithi155.stdout: "duration": 3.8175e-05 2023-08-01T19:55:49.977 INFO:teuthology.orchestra.run.smithi155.stdout: }, 2023-08-01T19:55:49.978 INFO:teuthology.orchestra.run.smithi155.stdout: { 2023-08-01T19:55:49.978 INFO:teuthology.orchestra.run.smithi155.stdout: "event": "dispatched", 2023-08-01T19:55:49.978 INFO:teuthology.orchestra.run.smithi155.stdout: "time": "2023-08-01T19:55:05.218842+0000", 2023-08-01T19:55:49.978 INFO:teuthology.orchestra.run.smithi155.stdout: "duration": 0.061852299999999999 2023-08-01T19:55:49.978 INFO:teuthology.orchestra.run.smithi155.stdout: }, 2023-08-01T19:55:49.978 INFO:teuthology.orchestra.run.smithi155.stdout: { 2023-08-01T19:55:49.978 INFO:teuthology.orchestra.run.smithi155.stdout: "event": "queued_for_pg", 2023-08-01T19:55:49.979 INFO:teuthology.orchestra.run.smithi155.stdout: "time": "2023-08-01T19:55:05.218862+0000", 2023-08-01T19:55:49.979 INFO:teuthology.orchestra.run.smithi155.stdout: "duration": 1.9854999999999999e-05 2023-08-01T19:55:49.979 INFO:teuthology.orchestra.run.smithi155.stdout: }, 2023-08-01T19:55:49.979 INFO:teuthology.orchestra.run.smithi155.stdout: { 2023-08-01T19:55:49.979 INFO:teuthology.orchestra.run.smithi155.stdout: "event": "reached_pg", 2023-08-01T19:55:49.979 INFO:teuthology.orchestra.run.smithi155.stdout: "time": "2023-08-01T19:55:05.218918+0000", 2023-08-01T19:55:49.979 INFO:teuthology.orchestra.run.smithi155.stdout: "duration": 5.6570000000000002e-05 2023-08-01T19:55:49.979 INFO:teuthology.orchestra.run.smithi155.stdout: }, 2023-08-01T19:55:49.980 INFO:teuthology.orchestra.run.smithi155.stdout: { 2023-08-01T19:55:49.980 INFO:teuthology.orchestra.run.smithi155.stdout: "event": "started", 2023-08-01T19:55:49.980 INFO:teuthology.orchestra.run.smithi155.stdout: "time": "2023-08-01T19:55:05.218940+0000", 2023-08-01T19:55:49.980 INFO:teuthology.orchestra.run.smithi155.stdout: "duration": 2.1804e-05 2023-08-01T19:55:49.980 INFO:teuthology.orchestra.run.smithi155.stdout: }, 2023-08-01T19:55:49.980 INFO:teuthology.orchestra.run.smithi155.stdout: { 2023-08-01T19:55:49.980 INFO:teuthology.orchestra.run.smithi155.stdout: "event": "commit_sent", 2023-08-01T19:55:49.981 INFO:teuthology.orchestra.run.smithi155.stdout: "time": "2023-08-01T19:55:05.224928+0000", 2023-08-01T19:55:49.981 INFO:teuthology.orchestra.run.smithi155.stdout: "duration": 0.0059876759999999999 2023-08-01T19:55:49.981 INFO:teuthology.orchestra.run.smithi155.stdout: }, 2023-08-01T19:55:49.981 INFO:teuthology.orchestra.run.smithi155.stdout: { 2023-08-01T19:55:49.981 INFO:teuthology.orchestra.run.smithi155.stdout: "event": "done", 2023-08-01T19:55:49.982 INFO:teuthology.orchestra.run.smithi155.stdout: "time": "2023-08-01T19:55:05.224971+0000", 2023-08-01T19:55:49.982 INFO:teuthology.orchestra.run.smithi155.stdout: "duration": 4.2929999999999997e-05 2023-08-01T19:55:49.982 INFO:teuthology.orchestra.run.smithi155.stdout: } 2023-08-01T19:55:49.982 INFO:teuthology.orchestra.run.smithi155.stdout: ] 2023-08-01T19:55:49.982 INFO:teuthology.orchestra.run.smithi155.stdout: } 2023-08-01T19:55:49.983 INFO:teuthology.orchestra.run.smithi155.stdout: }, 2023-08-01T19:55:49.983 INFO:teuthology.orchestra.run.smithi155.stdout: { 2023-08-01T19:55:49.983 INFO:teuthology.orchestra.run.smithi155.stdout: "description": "osd_op(client.4668.0:100927 5.0 5:00608ec6:::benchmark_data_smithi006_114134_object100926:head [set-alloc-hint object_size 65536 write_size 65536,write 0~65536] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e37)", 2023-08-01T19:55:49.983 INFO:teuthology.orchestra.run.smithi155.stdout: "initiated_at": "2023-08-01T19:55:05.561169+0000", 2023-08-01T19:55:49.983 INFO:teuthology.orchestra.run.smithi155.stdout: "age": 44.269896969999998, 2023-08-01T19:55:49.984 INFO:teuthology.orchestra.run.smithi155.stdout: "duration": 0.066411687999999997, 2023-08-01T19:55:49.984 INFO:teuthology.orchestra.run.smithi155.stdout: "type_data": { 2023-08-01T19:55:49.984 INFO:teuthology.orchestra.run.smithi155.stdout: "flag_point": "commit sent; apply or cleanup", 2023-08-01T19:55:49.984 INFO:teuthology.orchestra.run.smithi155.stdout: "client_info": { 2023-08-01T19:55:49.984 INFO:teuthology.orchestra.run.smithi155.stdout: "client": "client.4668", 2023-08-01T19:55:49.984 INFO:teuthology.orchestra.run.smithi155.stdout: "client_addr": "172.21.15.6:0/1709472247", 2023-08-01T19:55:49.984 INFO:teuthology.orchestra.run.smithi155.stdout: "tid": 100927 2023-08-01T19:55:49.985 INFO:teuthology.orchestra.run.smithi155.stdout: }, 2023-08-01T19:55:49.985 INFO:teuthology.orchestra.run.smithi155.stdout: "events": [ 2023-08-01T19:55:49.985 INFO:teuthology.orchestra.run.smithi155.stdout: { 2023-08-01T19:55:49.985 INFO:teuthology.orchestra.run.smithi155.stdout: "event": "initiated", 2023-08-01T19:55:49.985 INFO:teuthology.orchestra.run.smithi155.stdout: "time": "2023-08-01T19:55:05.561169+0000", 2023-08-01T19:55:49.985 INFO:teuthology.orchestra.run.smithi155.stdout: "duration": 0 2023-08-01T19:55:49.985 INFO:teuthology.orchestra.run.smithi155.stdout: }, 2023-08-01T19:55:49.986 INFO:teuthology.orchestra.run.smithi155.stdout: { 2023-08-01T19:55:49.986 INFO:teuthology.orchestra.run.smithi155.stdout: "event": "throttled", 2023-08-01T19:55:49.986 INFO:teuthology.orchestra.run.smithi155.stdout: "time": "2023-08-01T19:55:05.561169+0000", 2023-08-01T19:55:49.986 INFO:teuthology.orchestra.run.smithi155.stdout: "duration": 0 2023-08-01T19:55:49.986 INFO:teuthology.orchestra.run.smithi155.stdout: }, 2023-08-01T19:55:49.986 INFO:teuthology.orchestra.run.smithi155.stdout: { 2023-08-01T19:55:49.986 INFO:teuthology.orchestra.run.smithi155.stdout: "event": "header_read", 2023-08-01T19:55:49.987 INFO:teuthology.orchestra.run.smithi155.stdout: "time": "2023-08-01T19:55:05.561168+0000", 2023-08-01T19:55:49.987 INFO:teuthology.orchestra.run.smithi155.stdout: "duration": 4294967295.9999995 2023-08-01T19:55:49.987 INFO:teuthology.orchestra.run.smithi155.stdout: }, 2023-08-01T19:55:49.987 INFO:teuthology.orchestra.run.smithi155.stdout: { 2023-08-01T19:55:49.987 INFO:teuthology.orchestra.run.smithi155.stdout: "event": "all_read", 2023-08-01T19:55:49.987 INFO:teuthology.orchestra.run.smithi155.stdout: "time": "2023-08-01T19:55:05.561218+0000", 2023-08-01T19:55:49.987 INFO:teuthology.orchestra.run.smithi155.stdout: "duration": 4.9379999999999998e-05 2023-08-01T19:55:49.988 INFO:teuthology.orchestra.run.smithi155.stdout: }, 2023-08-01T19:55:49.988 INFO:teuthology.orchestra.run.smithi155.stdout: { 2023-08-01T19:55:49.988 INFO:teuthology.orchestra.run.smithi155.stdout: "event": "dispatched", 2023-08-01T19:55:49.988 INFO:teuthology.orchestra.run.smithi155.stdout: "time": "2023-08-01T19:55:05.561225+0000", 2023-08-01T19:55:49.988 INFO:teuthology.orchestra.run.smithi155.stdout: "duration": 7.114e-06 2023-08-01T19:55:49.988 INFO:teuthology.orchestra.run.smithi155.stdout: }, 2023-08-01T19:55:49.988 INFO:teuthology.orchestra.run.smithi155.stdout: { 2023-08-01T19:55:49.989 INFO:teuthology.orchestra.run.smithi155.stdout: "event": "queued_for_pg", 2023-08-01T19:55:49.989 INFO:teuthology.orchestra.run.smithi155.stdout: "time": "2023-08-01T19:55:05.561229+0000", 2023-08-01T19:55:49.989 INFO:teuthology.orchestra.run.smithi155.stdout: "duration": 4.2180000000000001e-06 2023-08-01T19:55:49.989 INFO:teuthology.orchestra.run.smithi155.stdout: }, 2023-08-01T19:55:49.989 INFO:teuthology.orchestra.run.smithi155.stdout: { 2023-08-01T19:55:49.989 INFO:teuthology.orchestra.run.smithi155.stdout: "event": "reached_pg", 2023-08-01T19:55:49.989 INFO:teuthology.orchestra.run.smithi155.stdout: "time": "2023-08-01T19:55:05.564737+0000", 2023-08-01T19:55:49.990 INFO:teuthology.orchestra.run.smithi155.stdout: "duration": 0.0035081869999999999 2023-08-01T19:55:49.990 INFO:teuthology.orchestra.run.smithi155.stdout: }, 2023-08-01T19:55:49.990 INFO:teuthology.orchestra.run.smithi155.stdout: { 2023-08-01T19:55:49.990 INFO:teuthology.orchestra.run.smithi155.stdout: "event": "started", 2023-08-01T19:55:49.990 INFO:teuthology.orchestra.run.smithi155.stdout: "time": "2023-08-01T19:55:05.564859+0000", 2023-08-01T19:55:49.990 INFO:teuthology.orchestra.run.smithi155.stdout: "duration": 0.00012165800000000001 2023-08-01T19:55:49.990 INFO:teuthology.orchestra.run.smithi155.stdout: }, 2023-08-01T19:55:49.991 INFO:teuthology.orchestra.run.smithi155.stdout: { 2023-08-01T19:55:49.991 INFO:teuthology.orchestra.run.smithi155.stdout: "event": "waiting for subops from 0", 2023-08-01T19:55:49.991 INFO:teuthology.orchestra.run.smithi155.stdout: "time": "2023-08-01T19:55:05.565009+0000", 2023-08-01T19:55:49.991 INFO:teuthology.orchestra.run.smithi155.stdout: "duration": 0.00014979699999999999 2023-08-01T19:55:49.991 INFO:teuthology.orchestra.run.smithi155.stdout: }, 2023-08-01T19:55:49.991 INFO:teuthology.orchestra.run.smithi155.stdout: { 2023-08-01T19:55:49.992 INFO:teuthology.orchestra.run.smithi155.stdout: "event": "op_commit", 2023-08-01T19:55:49.992 INFO:teuthology.orchestra.run.smithi155.stdout: "time": "2023-08-01T19:55:05.568007+0000", 2023-08-01T19:55:49.992 INFO:teuthology.orchestra.run.smithi155.stdout: "duration": 0.00299796 2023-08-01T19:55:49.992 INFO:teuthology.orchestra.run.smithi155.stdout: }, 2023-08-01T19:55:49.992 INFO:teuthology.orchestra.run.smithi155.stdout: { 2023-08-01T19:55:49.992 INFO:teuthology.orchestra.run.smithi155.stdout: "event": "sub_op_commit_rec", 2023-08-01T19:55:49.992 INFO:teuthology.orchestra.run.smithi155.stdout: "time": "2023-08-01T19:55:05.627520+0000", 2023-08-01T19:55:49.992 INFO:teuthology.orchestra.run.smithi155.stdout: "duration": 0.059513636000000002 2023-08-01T19:55:49.993 INFO:teuthology.orchestra.run.smithi155.stdout: }, 2023-08-01T19:55:49.993 INFO:teuthology.orchestra.run.smithi155.stdout: { 2023-08-01T19:55:49.993 INFO:teuthology.orchestra.run.smithi155.stdout: "event": "commit_sent", 2023-08-01T19:55:49.993 INFO:teuthology.orchestra.run.smithi155.stdout: "time": "2023-08-01T19:55:05.627553+0000", 2023-08-01T19:55:49.993 INFO:teuthology.orchestra.run.smithi155.stdout: "duration": 3.2635999999999997e-05 2023-08-01T19:55:49.993 INFO:teuthology.orchestra.run.smithi155.stdout: }, 2023-08-01T19:55:49.993 INFO:teuthology.orchestra.run.smithi155.stdout: { 2023-08-01T19:55:49.994 INFO:teuthology.orchestra.run.smithi155.stdout: "event": "done", 2023-08-01T19:55:49.994 INFO:teuthology.orchestra.run.smithi155.stdout: "time": "2023-08-01T19:55:05.627581+0000", 2023-08-01T19:55:49.994 INFO:teuthology.orchestra.run.smithi155.stdout: "duration": 2.7681000000000001e-05 2023-08-01T19:55:49.994 INFO:teuthology.orchestra.run.smithi155.stdout: } 2023-08-01T19:55:49.994 INFO:teuthology.orchestra.run.smithi155.stdout: ] 2023-08-01T19:55:49.994 INFO:teuthology.orchestra.run.smithi155.stdout: } 2023-08-01T19:55:49.994 INFO:teuthology.orchestra.run.smithi155.stdout: }, 2023-08-01T19:55:49.995 INFO:teuthology.orchestra.run.smithi155.stdout: { 2023-08-01T19:55:49.995 INFO:teuthology.orchestra.run.smithi155.stdout: "description": "osd_op(client.4668.0:100935 5.e 5:7895b14e:::benchmark_data_smithi006_114134_object100934:head [set-alloc-hint object_size 65536 write_size 65536,write 0~65536] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e37)", 2023-08-01T19:55:49.995 INFO:teuthology.orchestra.run.smithi155.stdout: "initiated_at": "2023-08-01T19:55:05.566666+0000", 2023-08-01T19:55:49.995 INFO:teuthology.orchestra.run.smithi155.stdout: "age": 44.264399670000003, 2023-08-01T19:55:49.995 INFO:teuthology.orchestra.run.smithi155.stdout: "duration": 0.064309016999999996, 2023-08-01T19:55:49.995 INFO:teuthology.orchestra.run.smithi155.stdout: "type_data": { 2023-08-01T19:55:49.995 INFO:teuthology.orchestra.run.smithi155.stdout: "flag_point": "commit sent; apply or cleanup", 2023-08-01T19:55:49.996 INFO:teuthology.orchestra.run.smithi155.stdout: "client_info": { 2023-08-01T19:55:49.996 INFO:teuthology.orchestra.run.smithi155.stdout: "client": "client.4668", 2023-08-01T19:55:49.996 INFO:teuthology.orchestra.run.smithi155.stdout: "client_addr": "172.21.15.6:0/1709472247", 2023-08-01T19:55:49.996 INFO:teuthology.orchestra.run.smithi155.stdout: "tid": 100935 2023-08-01T19:55:49.996 INFO:teuthology.orchestra.run.smithi155.stdout: }, 2023-08-01T19:55:49.996 INFO:teuthology.orchestra.run.smithi155.stdout: "events": [ 2023-08-01T19:55:49.996 INFO:teuthology.orchestra.run.smithi155.stdout: { 2023-08-01T19:55:49.997 INFO:teuthology.orchestra.run.smithi155.stdout: "event": "initiated", 2023-08-01T19:55:49.997 INFO:teuthology.orchestra.run.smithi155.stdout: "time": "2023-08-01T19:55:05.566666+0000", 2023-08-01T19:55:49.997 INFO:teuthology.orchestra.run.smithi155.stdout: "duration": 0 2023-08-01T19:55:49.997 INFO:teuthology.orchestra.run.smithi155.stdout: }, 2023-08-01T19:55:49.997 INFO:teuthology.orchestra.run.smithi155.stdout: { 2023-08-01T19:55:49.997 INFO:teuthology.orchestra.run.smithi155.stdout: "event": "throttled", 2023-08-01T19:55:49.997 INFO:teuthology.orchestra.run.smithi155.stdout: "time": "2023-08-01T19:55:05.566666+0000", 2023-08-01T19:55:49.997 INFO:teuthology.orchestra.run.smithi155.stdout: "duration": 0 2023-08-01T19:55:49.998 INFO:teuthology.orchestra.run.smithi155.stdout: }, 2023-08-01T19:55:49.998 INFO:teuthology.orchestra.run.smithi155.stdout: { 2023-08-01T19:55:49.998 INFO:teuthology.orchestra.run.smithi155.stdout: "event": "header_read", 2023-08-01T19:55:49.998 INFO:teuthology.orchestra.run.smithi155.stdout: "time": "2023-08-01T19:55:05.566665+0000", 2023-08-01T19:55:49.998 INFO:teuthology.orchestra.run.smithi155.stdout: "duration": 4294967295.9999986 2023-08-01T19:55:49.998 INFO:teuthology.orchestra.run.smithi155.stdout: }, 2023-08-01T19:55:49.998 INFO:teuthology.orchestra.run.smithi155.stdout: { 2023-08-01T19:55:49.999 INFO:teuthology.orchestra.run.smithi155.stdout: "event": "all_read", 2023-08-01T19:55:49.999 INFO:teuthology.orchestra.run.smithi155.stdout: "time": "2023-08-01T19:55:05.566754+0000", 2023-08-01T19:55:49.999 INFO:teuthology.orchestra.run.smithi155.stdout: "duration": 8.9425999999999994e-05 2023-08-01T19:55:49.999 INFO:teuthology.orchestra.run.smithi155.stdout: }, 2023-08-01T19:55:49.999 INFO:teuthology.orchestra.run.smithi155.stdout: { 2023-08-01T19:55:49.999 INFO:teuthology.orchestra.run.smithi155.stdout: "event": "dispatched", 2023-08-01T19:55:49.999 INFO:teuthology.orchestra.run.smithi155.stdout: "time": "2023-08-01T19:55:05.566766+0000", 2023-08-01T19:55:50.000 INFO:teuthology.orchestra.run.smithi155.stdout: "duration": 1.2018000000000001e-05 2023-08-01T19:55:50.000 INFO:teuthology.orchestra.run.smithi155.stdout: }, 2023-08-01T19:55:50.000 INFO:teuthology.orchestra.run.smithi155.stdout: { 2023-08-01T19:55:50.000 INFO:teuthology.orchestra.run.smithi155.stdout: "event": "queued_for_pg", 2023-08-01T19:55:50.000 INFO:teuthology.orchestra.run.smithi155.stdout: "time": "2023-08-01T19:55:05.566772+0000", 2023-08-01T19:55:50.000 INFO:teuthology.orchestra.run.smithi155.stdout: "duration": 6.0190000000000003e-06 2023-08-01T19:55:50.000 INFO:teuthology.orchestra.run.smithi155.stdout: }, 2023-08-01T19:55:50.001 INFO:teuthology.orchestra.run.smithi155.stdout: { 2023-08-01T19:55:50.001 INFO:teuthology.orchestra.run.smithi155.stdout: "event": "reached_pg", 2023-08-01T19:55:50.001 INFO:teuthology.orchestra.run.smithi155.stdout: "time": "2023-08-01T19:55:05.566800+0000", 2023-08-01T19:55:50.001 INFO:teuthology.orchestra.run.smithi155.stdout: "duration": 2.7835999999999999e-05 2023-08-01T19:55:50.001 INFO:teuthology.orchestra.run.smithi155.stdout: }, 2023-08-01T19:55:50.001 INFO:teuthology.orchestra.run.smithi155.stdout: { 2023-08-01T19:55:50.001 INFO:teuthology.orchestra.run.smithi155.stdout: "event": "started", 2023-08-01T19:55:50.002 INFO:teuthology.orchestra.run.smithi155.stdout: "time": "2023-08-01T19:55:05.566879+0000", 2023-08-01T19:55:50.002 INFO:teuthology.orchestra.run.smithi155.stdout: "duration": 7.9105999999999998e-05 2023-08-01T19:55:50.002 INFO:teuthology.orchestra.run.smithi155.stdout: }, 2023-08-01T19:55:50.002 INFO:teuthology.orchestra.run.smithi155.stdout: { 2023-08-01T19:55:50.002 INFO:teuthology.orchestra.run.smithi155.stdout: "event": "waiting for subops from 0", 2023-08-01T19:55:50.002 INFO:teuthology.orchestra.run.smithi155.stdout: "time": "2023-08-01T19:55:05.566971+0000", 2023-08-01T19:55:50.002 INFO:teuthology.orchestra.run.smithi155.stdout: "duration": 9.1817999999999994e-05 2023-08-01T19:55:50.003 INFO:teuthology.orchestra.run.smithi155.stdout: }, 2023-08-01T19:55:50.003 INFO:teuthology.orchestra.run.smithi155.stdout: { 2023-08-01T19:55:50.003 INFO:teuthology.orchestra.run.smithi155.stdout: "event": "op_commit", 2023-08-01T19:55:50.003 INFO:teuthology.orchestra.run.smithi155.stdout: "time": "2023-08-01T19:55:05.571475+0000", 2023-08-01T19:55:50.003 INFO:teuthology.orchestra.run.smithi155.stdout: "duration": 0.0045039499999999996 2023-08-01T19:55:50.003 INFO:teuthology.orchestra.run.smithi155.stdout: }, 2023-08-01T19:55:50.003 INFO:teuthology.orchestra.run.smithi155.stdout: { 2023-08-01T19:55:50.004 INFO:teuthology.orchestra.run.smithi155.stdout: "event": "sub_op_commit_rec", 2023-08-01T19:55:50.004 INFO:teuthology.orchestra.run.smithi155.stdout: "time": "2023-08-01T19:55:05.630884+0000", 2023-08-01T19:55:50.004 INFO:teuthology.orchestra.run.smithi155.stdout: "duration": 0.059409181999999998 2023-08-01T19:55:50.004 INFO:teuthology.orchestra.run.smithi155.stdout: }, 2023-08-01T19:55:50.004 INFO:teuthology.orchestra.run.smithi155.stdout: { 2023-08-01T19:55:50.004 INFO:teuthology.orchestra.run.smithi155.stdout: "event": "commit_sent", 2023-08-01T19:55:50.005 INFO:teuthology.orchestra.run.smithi155.stdout: "time": "2023-08-01T19:55:05.630930+0000", 2023-08-01T19:55:50.005 INFO:teuthology.orchestra.run.smithi155.stdout: "duration": 4.5507999999999999e-05 2023-08-01T19:55:50.005 INFO:teuthology.orchestra.run.smithi155.stdout: }, 2023-08-01T19:55:50.005 INFO:teuthology.orchestra.run.smithi155.stdout: { 2023-08-01T19:55:50.005 INFO:teuthology.orchestra.run.smithi155.stdout: "event": "done", 2023-08-01T19:55:50.006 INFO:teuthology.orchestra.run.smithi155.stdout: "time": "2023-08-01T19:55:05.630975+0000", 2023-08-01T19:55:50.006 INFO:teuthology.orchestra.run.smithi155.stdout: "duration": 4.5441000000000001e-05 2023-08-01T19:55:50.006 INFO:teuthology.orchestra.run.smithi155.stdout: } 2023-08-01T19:55:50.006 INFO:teuthology.orchestra.run.smithi155.stdout: ] 2023-08-01T19:55:50.006 INFO:teuthology.orchestra.run.smithi155.stdout: } 2023-08-01T19:55:50.006 INFO:teuthology.orchestra.run.smithi155.stdout: }, 2023-08-01T19:55:50.007 INFO:teuthology.orchestra.run.smithi155.stdout: { 2023-08-01T19:55:50.007 INFO:teuthology.orchestra.run.smithi155.stdout: "description": "osd_op(client.4668.0:100941 5.e 5:736a6ac6:::benchmark_data_smithi006_114134_object100940:head [set-alloc-hint object_size 65536 write_size 65536,write 0~65536] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e37)", 2023-08-01T19:55:50.007 INFO:teuthology.orchestra.run.smithi155.stdout: "initiated_at": "2023-08-01T19:55:05.569750+0000", 2023-08-01T19:55:50.007 INFO:teuthology.orchestra.run.smithi155.stdout: "age": 44.261315777, 2023-08-01T19:55:50.007 INFO:teuthology.orchestra.run.smithi155.stdout: "duration": 0.065431331999999995, 2023-08-01T19:55:50.007 INFO:teuthology.orchestra.run.smithi155.stdout: "type_data": { 2023-08-01T19:55:50.008 INFO:teuthology.orchestra.run.smithi155.stdout: "flag_point": "commit sent; apply or cleanup", 2023-08-01T19:55:50.008 INFO:teuthology.orchestra.run.smithi155.stdout: "client_info": { 2023-08-01T19:55:50.008 INFO:teuthology.orchestra.run.smithi155.stdout: "client": "client.4668", 2023-08-01T19:55:50.008 INFO:teuthology.orchestra.run.smithi155.stdout: "client_addr": "172.21.15.6:0/1709472247", 2023-08-01T19:55:50.008 INFO:teuthology.orchestra.run.smithi155.stdout: "tid": 100941 2023-08-01T19:55:50.009 INFO:teuthology.orchestra.run.smithi155.stdout: }, 2023-08-01T19:55:50.009 INFO:teuthology.orchestra.run.smithi155.stdout: "events": [ 2023-08-01T19:55:50.009 INFO:teuthology.orchestra.run.smithi155.stdout: { 2023-08-01T19:55:50.009 INFO:teuthology.orchestra.run.smithi155.stdout: "event": "initiated", 2023-08-01T19:55:50.009 INFO:teuthology.orchestra.run.smithi155.stdout: "time": "2023-08-01T19:55:05.569750+0000", 2023-08-01T19:55:50.009 INFO:teuthology.orchestra.run.smithi155.stdout: "duration": 0 2023-08-01T19:55:50.009 INFO:teuthology.orchestra.run.smithi155.stdout: }, 2023-08-01T19:55:50.010 INFO:teuthology.orchestra.run.smithi155.stdout: { 2023-08-01T19:55:50.010 INFO:teuthology.orchestra.run.smithi155.stdout: "event": "throttled", 2023-08-01T19:55:50.010 INFO:teuthology.orchestra.run.smithi155.stdout: "time": "2023-08-01T19:55:05.569750+0000", 2023-08-01T19:55:50.010 INFO:teuthology.orchestra.run.smithi155.stdout: "duration": 0 2023-08-01T19:55:50.010 INFO:teuthology.orchestra.run.smithi155.stdout: }, 2023-08-01T19:55:50.010 INFO:teuthology.orchestra.run.smithi155.stdout: { 2023-08-01T19:55:50.010 INFO:teuthology.orchestra.run.smithi155.stdout: "event": "header_read", 2023-08-01T19:55:50.011 INFO:teuthology.orchestra.run.smithi155.stdout: "time": "2023-08-01T19:55:05.569749+0000", 2023-08-01T19:55:50.011 INFO:teuthology.orchestra.run.smithi155.stdout: "duration": 4294967295.999999 2023-08-01T19:55:50.011 INFO:teuthology.orchestra.run.smithi155.stdout: }, 2023-08-01T19:55:50.011 INFO:teuthology.orchestra.run.smithi155.stdout: { 2023-08-01T19:55:50.011 INFO:teuthology.orchestra.run.smithi155.stdout: "event": "all_read", 2023-08-01T19:55:50.011 INFO:teuthology.orchestra.run.smithi155.stdout: "time": "2023-08-01T19:55:05.569861+0000", 2023-08-01T19:55:50.011 INFO:teuthology.orchestra.run.smithi155.stdout: "duration": 0.000111333 2023-08-01T19:55:50.012 INFO:teuthology.orchestra.run.smithi155.stdout: }, 2023-08-01T19:55:50.012 INFO:teuthology.orchestra.run.smithi155.stdout: { 2023-08-01T19:55:50.012 INFO:teuthology.orchestra.run.smithi155.stdout: "event": "dispatched", 2023-08-01T19:55:50.012 INFO:teuthology.orchestra.run.smithi155.stdout: "time": "2023-08-01T19:55:05.569869+0000", 2023-08-01T19:55:50.012 INFO:teuthology.orchestra.run.smithi155.stdout: "duration": 8.8589999999999994e-06 2023-08-01T19:55:50.012 INFO:teuthology.orchestra.run.smithi155.stdout: }, 2023-08-01T19:55:50.012 INFO:teuthology.orchestra.run.smithi155.stdout: { 2023-08-01T19:55:50.013 INFO:teuthology.orchestra.run.smithi155.stdout: "event": "queued_for_pg", 2023-08-01T19:55:50.013 INFO:teuthology.orchestra.run.smithi155.stdout: "time": "2023-08-01T19:55:05.569874+0000", 2023-08-01T19:55:50.013 INFO:teuthology.orchestra.run.smithi155.stdout: "duration": 4.1679999999999997e-06 2023-08-01T19:55:50.013 INFO:teuthology.orchestra.run.smithi155.stdout: }, 2023-08-01T19:55:50.013 INFO:teuthology.orchestra.run.smithi155.stdout: { 2023-08-01T19:55:50.013 INFO:teuthology.orchestra.run.smithi155.stdout: "event": "reached_pg", 2023-08-01T19:55:50.013 INFO:teuthology.orchestra.run.smithi155.stdout: "time": "2023-08-01T19:55:05.569904+0000", 2023-08-01T19:55:50.014 INFO:teuthology.orchestra.run.smithi155.stdout: "duration": 3.0920999999999998e-05 2023-08-01T19:55:50.014 INFO:teuthology.orchestra.run.smithi155.stdout: }, 2023-08-01T19:55:50.014 INFO:teuthology.orchestra.run.smithi155.stdout: { 2023-08-01T19:55:50.014 INFO:teuthology.orchestra.run.smithi155.stdout: "event": "started", 2023-08-01T19:55:50.014 INFO:teuthology.orchestra.run.smithi155.stdout: "time": "2023-08-01T19:55:05.569998+0000", 2023-08-01T19:55:50.014 INFO:teuthology.orchestra.run.smithi155.stdout: "duration": 9.3086999999999998e-05 2023-08-01T19:55:50.014 INFO:teuthology.orchestra.run.smithi155.stdout: }, 2023-08-01T19:55:50.015 INFO:teuthology.orchestra.run.smithi155.stdout: { 2023-08-01T19:55:50.015 INFO:teuthology.orchestra.run.smithi155.stdout: "event": "waiting for subops from 0", 2023-08-01T19:55:50.015 INFO:teuthology.orchestra.run.smithi155.stdout: "time": "2023-08-01T19:55:05.570093+0000", 2023-08-01T19:55:50.015 INFO:teuthology.orchestra.run.smithi155.stdout: "duration": 9.5768999999999997e-05 2023-08-01T19:55:50.015 INFO:teuthology.orchestra.run.smithi155.stdout: }, 2023-08-01T19:55:50.015 INFO:teuthology.orchestra.run.smithi155.stdout: { 2023-08-01T19:55:50.015 INFO:teuthology.orchestra.run.smithi155.stdout: "event": "op_commit", 2023-08-01T19:55:50.015 INFO:teuthology.orchestra.run.smithi155.stdout: "time": "2023-08-01T19:55:05.572839+0000", 2023-08-01T19:55:50.016 INFO:teuthology.orchestra.run.smithi155.stdout: "duration": 0.0027460050000000001 2023-08-01T19:55:50.016 INFO:teuthology.orchestra.run.smithi155.stdout: }, 2023-08-01T19:55:50.016 INFO:teuthology.orchestra.run.smithi155.stdout: { 2023-08-01T19:55:50.016 INFO:teuthology.orchestra.run.smithi155.stdout: "event": "sub_op_commit_rec", 2023-08-01T19:55:50.016 INFO:teuthology.orchestra.run.smithi155.stdout: "time": "2023-08-01T19:55:05.635114+0000", 2023-08-01T19:55:50.016 INFO:teuthology.orchestra.run.smithi155.stdout: "duration": 0.062274297999999999 2023-08-01T19:55:50.016 INFO:teuthology.orchestra.run.smithi155.stdout: }, 2023-08-01T19:55:50.017 INFO:teuthology.orchestra.run.smithi155.stdout: { 2023-08-01T19:55:50.017 INFO:teuthology.orchestra.run.smithi155.stdout: "event": "commit_sent", 2023-08-01T19:55:50.017 INFO:teuthology.orchestra.run.smithi155.stdout: "time": "2023-08-01T19:55:05.635143+0000", 2023-08-01T19:55:50.017 INFO:teuthology.orchestra.run.smithi155.stdout: "duration": 2.9430000000000001e-05 2023-08-01T19:55:50.017 INFO:teuthology.orchestra.run.smithi155.stdout: }, 2023-08-01T19:55:50.017 INFO:teuthology.orchestra.run.smithi155.stdout: { 2023-08-01T19:55:50.017 INFO:teuthology.orchestra.run.smithi155.stdout: "event": "done", 2023-08-01T19:55:50.018 INFO:teuthology.orchestra.run.smithi155.stdout: "time": "2023-08-01T19:55:05.635181+0000", 2023-08-01T19:55:50.018 INFO:teuthology.orchestra.run.smithi155.stdout: "duration": 3.8352000000000001e-05 2023-08-01T19:55:50.018 INFO:teuthology.orchestra.run.smithi155.stdout: } 2023-08-01T19:55:50.018 INFO:teuthology.orchestra.run.smithi155.stdout: ] 2023-08-01T19:55:50.018 INFO:teuthology.orchestra.run.smithi155.stdout: } 2023-08-01T19:55:50.018 INFO:teuthology.orchestra.run.smithi155.stdout: }, 2023-08-01T19:55:50.018 INFO:teuthology.orchestra.run.smithi155.stdout: { 2023-08-01T19:55:50.019 INFO:teuthology.orchestra.run.smithi155.stdout: "description": "osd_op(client.4668.0:100944 5.4 5:25fae865:::benchmark_data_smithi006_114134_object100943:head [set-alloc-hint object_size 65536 write_size 65536,write 0~65536] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e37)", 2023-08-01T19:55:50.019 INFO:teuthology.orchestra.run.smithi155.stdout: "initiated_at": "2023-08-01T19:55:05.576662+0000", 2023-08-01T19:55:50.019 INFO:teuthology.orchestra.run.smithi155.stdout: "age": 44.25440408, 2023-08-01T19:55:50.019 INFO:teuthology.orchestra.run.smithi155.stdout: "duration": 0.056054925999999998, 2023-08-01T19:55:50.019 INFO:teuthology.orchestra.run.smithi155.stdout: "type_data": { 2023-08-01T19:55:50.019 INFO:teuthology.orchestra.run.smithi155.stdout: "flag_point": "commit sent; apply or cleanup", 2023-08-01T19:55:50.019 INFO:teuthology.orchestra.run.smithi155.stdout: "client_info": { 2023-08-01T19:55:50.020 INFO:teuthology.orchestra.run.smithi155.stdout: "client": "client.4668", 2023-08-01T19:55:50.020 INFO:teuthology.orchestra.run.smithi155.stdout: "client_addr": "172.21.15.6:0/1709472247", 2023-08-01T19:55:50.020 INFO:teuthology.orchestra.run.smithi155.stdout: "tid": 100944 2023-08-01T19:55:50.020 INFO:teuthology.orchestra.run.smithi155.stdout: }, 2023-08-01T19:55:50.020 INFO:teuthology.orchestra.run.smithi155.stdout: "events": [ 2023-08-01T19:55:50.020 INFO:teuthology.orchestra.run.smithi155.stdout: { 2023-08-01T19:55:50.020 INFO:teuthology.orchestra.run.smithi155.stdout: "event": "initiated", 2023-08-01T19:55:50.021 INFO:teuthology.orchestra.run.smithi155.stdout: "time": "2023-08-01T19:55:05.576662+0000", 2023-08-01T19:55:50.021 INFO:teuthology.orchestra.run.smithi155.stdout: "duration": 0 2023-08-01T19:55:50.021 INFO:teuthology.orchestra.run.smithi155.stdout: }, 2023-08-01T19:55:50.021 INFO:teuthology.orchestra.run.smithi155.stdout: { 2023-08-01T19:55:50.021 INFO:teuthology.orchestra.run.smithi155.stdout: "event": "throttled", 2023-08-01T19:55:50.021 INFO:teuthology.orchestra.run.smithi155.stdout: "time": "2023-08-01T19:55:05.576662+0000", 2023-08-01T19:55:50.022 INFO:teuthology.orchestra.run.smithi155.stdout: "duration": 0 2023-08-01T19:55:50.022 INFO:teuthology.orchestra.run.smithi155.stdout: }, 2023-08-01T19:55:50.022 INFO:teuthology.orchestra.run.smithi155.stdout: { 2023-08-01T19:55:50.022 INFO:teuthology.orchestra.run.smithi155.stdout: "event": "header_read", 2023-08-01T19:55:50.022 INFO:teuthology.orchestra.run.smithi155.stdout: "time": "2023-08-01T19:55:05.576661+0000", 2023-08-01T19:55:50.022 INFO:teuthology.orchestra.run.smithi155.stdout: "duration": 4294967295.999999 2023-08-01T19:55:50.022 INFO:teuthology.orchestra.run.smithi155.stdout: }, 2023-08-01T19:55:50.022 INFO:teuthology.orchestra.run.smithi155.stdout: { 2023-08-01T19:55:50.023 INFO:teuthology.orchestra.run.smithi155.stdout: "event": "all_read", 2023-08-01T19:55:50.023 INFO:teuthology.orchestra.run.smithi155.stdout: "time": "2023-08-01T19:55:05.576725+0000", 2023-08-01T19:55:50.023 INFO:teuthology.orchestra.run.smithi155.stdout: "duration": 6.4435000000000002e-05 2023-08-01T19:55:50.023 INFO:teuthology.orchestra.run.smithi155.stdout: }, 2023-08-01T19:55:50.023 INFO:teuthology.orchestra.run.smithi155.stdout: { 2023-08-01T19:55:50.023 INFO:teuthology.orchestra.run.smithi155.stdout: "event": "dispatched", 2023-08-01T19:55:50.024 INFO:teuthology.orchestra.run.smithi155.stdout: "time": "2023-08-01T19:55:05.576744+0000", 2023-08-01T19:55:50.024 INFO:teuthology.orchestra.run.smithi155.stdout: "duration": 1.8502999999999999e-05 2023-08-01T19:55:50.024 INFO:teuthology.orchestra.run.smithi155.stdout: }, 2023-08-01T19:55:50.024 INFO:teuthology.orchestra.run.smithi155.stdout: { 2023-08-01T19:55:50.025 INFO:teuthology.orchestra.run.smithi155.stdout: "event": "queued_for_pg", 2023-08-01T19:55:50.025 INFO:teuthology.orchestra.run.smithi155.stdout: "time": "2023-08-01T19:55:05.576772+0000", 2023-08-01T19:55:50.025 INFO:teuthology.orchestra.run.smithi155.stdout: "duration": 2.8354999999999999e-05 2023-08-01T19:55:50.025 INFO:teuthology.orchestra.run.smithi155.stdout: }, 2023-08-01T19:55:50.025 INFO:teuthology.orchestra.run.smithi155.stdout: { 2023-08-01T19:55:50.025 INFO:teuthology.orchestra.run.smithi155.stdout: "event": "reached_pg", 2023-08-01T19:55:50.026 INFO:teuthology.orchestra.run.smithi155.stdout: "time": "2023-08-01T19:55:05.576815+0000", 2023-08-01T19:55:50.026 INFO:teuthology.orchestra.run.smithi155.stdout: "duration": 4.3223999999999998e-05 2023-08-01T19:55:50.026 INFO:teuthology.orchestra.run.smithi155.stdout: }, 2023-08-01T19:55:50.026 INFO:teuthology.orchestra.run.smithi155.stdout: { 2023-08-01T19:55:50.026 INFO:teuthology.orchestra.run.smithi155.stdout: "event": "started", 2023-08-01T19:55:50.026 INFO:teuthology.orchestra.run.smithi155.stdout: "time": "2023-08-01T19:55:05.576961+0000", 2023-08-01T19:55:50.027 INFO:teuthology.orchestra.run.smithi155.stdout: "duration": 0.000145043 2023-08-01T19:55:50.027 INFO:teuthology.orchestra.run.smithi155.stdout: }, 2023-08-01T19:55:50.027 INFO:teuthology.orchestra.run.smithi155.stdout: { 2023-08-01T19:55:50.027 INFO:teuthology.orchestra.run.smithi155.stdout: "event": "waiting for subops from 0", 2023-08-01T19:55:50.027 INFO:teuthology.orchestra.run.smithi155.stdout: "time": "2023-08-01T19:55:05.577343+0000", 2023-08-01T19:55:50.027 INFO:teuthology.orchestra.run.smithi155.stdout: "duration": 0.00038249699999999998 2023-08-01T19:55:50.027 INFO:teuthology.orchestra.run.smithi155.stdout: }, 2023-08-01T19:55:50.028 INFO:teuthology.orchestra.run.smithi155.stdout: { 2023-08-01T19:55:50.028 INFO:teuthology.orchestra.run.smithi155.stdout: "event": "op_commit", 2023-08-01T19:55:50.028 INFO:teuthology.orchestra.run.smithi155.stdout: "time": "2023-08-01T19:55:05.582349+0000", 2023-08-01T19:55:50.028 INFO:teuthology.orchestra.run.smithi155.stdout: "duration": 0.0050062880000000002 2023-08-01T19:55:50.028 INFO:teuthology.orchestra.run.smithi155.stdout: }, 2023-08-01T19:55:50.028 INFO:teuthology.orchestra.run.smithi155.stdout: { 2023-08-01T19:55:50.028 INFO:teuthology.orchestra.run.smithi155.stdout: "event": "sub_op_commit_rec", 2023-08-01T19:55:50.029 INFO:teuthology.orchestra.run.smithi155.stdout: "time": "2023-08-01T19:55:05.632659+0000", 2023-08-01T19:55:50.029 INFO:teuthology.orchestra.run.smithi155.stdout: "duration": 0.050309185999999999 2023-08-01T19:55:50.029 INFO:teuthology.orchestra.run.smithi155.stdout: }, 2023-08-01T19:55:50.029 INFO:teuthology.orchestra.run.smithi155.stdout: { 2023-08-01T19:55:50.029 INFO:teuthology.orchestra.run.smithi155.stdout: "event": "commit_sent", 2023-08-01T19:55:50.029 INFO:teuthology.orchestra.run.smithi155.stdout: "time": "2023-08-01T19:55:05.632692+0000", 2023-08-01T19:55:50.029 INFO:teuthology.orchestra.run.smithi155.stdout: "duration": 3.3077999999999997e-05 2023-08-01T19:55:50.030 INFO:teuthology.orchestra.run.smithi155.stdout: }, 2023-08-01T19:55:50.030 INFO:teuthology.orchestra.run.smithi155.stdout: { 2023-08-01T19:55:50.030 INFO:teuthology.orchestra.run.smithi155.stdout: "event": "done", 2023-08-01T19:55:50.030 INFO:teuthology.orchestra.run.smithi155.stdout: "time": "2023-08-01T19:55:05.632717+0000", 2023-08-01T19:55:50.030 INFO:teuthology.orchestra.run.smithi155.stdout: "duration": 2.5119000000000001e-05 2023-08-01T19:55:50.030 INFO:teuthology.orchestra.run.smithi155.stdout: } 2023-08-01T19:55:50.030 INFO:teuthology.orchestra.run.smithi155.stdout: ] 2023-08-01T19:55:50.031 INFO:teuthology.orchestra.run.smithi155.stdout: } 2023-08-01T19:55:50.031 INFO:teuthology.orchestra.run.smithi155.stdout: }, 2023-08-01T19:55:50.031 INFO:teuthology.orchestra.run.smithi155.stdout: { 2023-08-01T19:55:50.031 INFO:teuthology.orchestra.run.smithi155.stdout: "description": "osd_op(client.4668.0:100945 5.e 5:73df68dd:::benchmark_data_smithi006_114134_object100944:head [set-alloc-hint object_size 65536 write_size 65536,write 0~65536] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e37)", 2023-08-01T19:55:50.031 INFO:teuthology.orchestra.run.smithi155.stdout: "initiated_at": "2023-08-01T19:55:05.576784+0000", 2023-08-01T19:55:50.031 INFO:teuthology.orchestra.run.smithi155.stdout: "age": 44.254282191999998, 2023-08-01T19:55:50.031 INFO:teuthology.orchestra.run.smithi155.stdout: "duration": 0.058512994999999998, 2023-08-01T19:55:50.032 INFO:teuthology.orchestra.run.smithi155.stdout: "type_data": { 2023-08-01T19:55:50.032 INFO:teuthology.orchestra.run.smithi155.stdout: "flag_point": "commit sent; apply or cleanup", 2023-08-01T19:55:50.032 INFO:teuthology.orchestra.run.smithi155.stdout: "client_info": { 2023-08-01T19:55:50.032 INFO:teuthology.orchestra.run.smithi155.stdout: "client": "client.4668", 2023-08-01T19:55:50.032 INFO:teuthology.orchestra.run.smithi155.stdout: "client_addr": "172.21.15.6:0/1709472247", 2023-08-01T19:55:50.032 INFO:teuthology.orchestra.run.smithi155.stdout: "tid": 100945 2023-08-01T19:55:50.033 INFO:teuthology.orchestra.run.smithi155.stdout: }, 2023-08-01T19:55:50.033 INFO:teuthology.orchestra.run.smithi155.stdout: "events": [ 2023-08-01T19:55:50.033 INFO:teuthology.orchestra.run.smithi155.stdout: { 2023-08-01T19:55:50.033 INFO:teuthology.orchestra.run.smithi155.stdout: "event": "initiated", 2023-08-01T19:55:50.033 INFO:teuthology.orchestra.run.smithi155.stdout: "time": "2023-08-01T19:55:05.576784+0000", 2023-08-01T19:55:50.033 INFO:teuthology.orchestra.run.smithi155.stdout: "duration": 0 2023-08-01T19:55:50.033 INFO:teuthology.orchestra.run.smithi155.stdout: }, 2023-08-01T19:55:50.034 INFO:teuthology.orchestra.run.smithi155.stdout: { 2023-08-01T19:55:50.034 INFO:teuthology.orchestra.run.smithi155.stdout: "event": "throttled", 2023-08-01T19:55:50.034 INFO:teuthology.orchestra.run.smithi155.stdout: "time": "2023-08-01T19:55:05.576784+0000", 2023-08-01T19:55:50.034 INFO:teuthology.orchestra.run.smithi155.stdout: "duration": 0 2023-08-01T19:55:50.034 INFO:teuthology.orchestra.run.smithi155.stdout: }, 2023-08-01T19:55:50.034 INFO:teuthology.orchestra.run.smithi155.stdout: { 2023-08-01T19:55:50.034 INFO:teuthology.orchestra.run.smithi155.stdout: "event": "header_read", 2023-08-01T19:55:50.035 INFO:teuthology.orchestra.run.smithi155.stdout: "time": "2023-08-01T19:55:05.576783+0000", 2023-08-01T19:55:50.035 INFO:teuthology.orchestra.run.smithi155.stdout: "duration": 4294967295.9999995 2023-08-01T19:55:50.035 INFO:teuthology.orchestra.run.smithi155.stdout: }, 2023-08-01T19:55:50.035 INFO:teuthology.orchestra.run.smithi155.stdout: { 2023-08-01T19:55:50.035 INFO:teuthology.orchestra.run.smithi155.stdout: "event": "all_read", 2023-08-01T19:55:50.035 INFO:teuthology.orchestra.run.smithi155.stdout: "time": "2023-08-01T19:55:05.576807+0000", 2023-08-01T19:55:50.036 INFO:teuthology.orchestra.run.smithi155.stdout: "duration": 2.3651000000000001e-05 2023-08-01T19:55:50.036 INFO:teuthology.orchestra.run.smithi155.stdout: }, 2023-08-01T19:55:50.036 INFO:teuthology.orchestra.run.smithi155.stdout: { 2023-08-01T19:55:50.036 INFO:teuthology.orchestra.run.smithi155.stdout: "event": "dispatched", 2023-08-01T19:55:50.036 INFO:teuthology.orchestra.run.smithi155.stdout: "time": "2023-08-01T19:55:05.576817+0000", 2023-08-01T19:55:50.036 INFO:teuthology.orchestra.run.smithi155.stdout: "duration": 9.9389999999999992e-06 2023-08-01T19:55:50.036 INFO:teuthology.orchestra.run.smithi155.stdout: }, 2023-08-01T19:55:50.037 INFO:teuthology.orchestra.run.smithi155.stdout: { 2023-08-01T19:55:50.037 INFO:teuthology.orchestra.run.smithi155.stdout: "event": "queued_for_pg", 2023-08-01T19:55:50.037 INFO:teuthology.orchestra.run.smithi155.stdout: "time": "2023-08-01T19:55:05.576820+0000", 2023-08-01T19:55:50.037 INFO:teuthology.orchestra.run.smithi155.stdout: "duration": 3.2619999999999999e-06 2023-08-01T19:55:50.037 INFO:teuthology.orchestra.run.smithi155.stdout: }, 2023-08-01T19:55:50.038 INFO:teuthology.orchestra.run.smithi155.stdout: { 2023-08-01T19:55:50.038 INFO:teuthology.orchestra.run.smithi155.stdout: "event": "reached_pg", 2023-08-01T19:55:50.038 INFO:teuthology.orchestra.run.smithi155.stdout: "time": "2023-08-01T19:55:05.576849+0000", 2023-08-01T19:55:50.038 INFO:teuthology.orchestra.run.smithi155.stdout: "duration": 2.8880000000000001e-05 2023-08-01T19:55:50.039 INFO:teuthology.orchestra.run.smithi155.stdout: }, 2023-08-01T19:55:50.039 INFO:teuthology.orchestra.run.smithi155.stdout: { 2023-08-01T19:55:50.039 INFO:teuthology.orchestra.run.smithi155.stdout: "event": "started", 2023-08-01T19:55:50.040 INFO:teuthology.orchestra.run.smithi155.stdout: "time": "2023-08-01T19:55:05.576940+0000", 2023-08-01T19:55:50.040 INFO:teuthology.orchestra.run.smithi155.stdout: "duration": 9.0570999999999997e-05 2023-08-01T19:55:50.040 INFO:teuthology.orchestra.run.smithi155.stdout: }, 2023-08-01T19:55:50.040 INFO:teuthology.orchestra.run.smithi155.stdout: { 2023-08-01T19:55:50.041 INFO:teuthology.orchestra.run.smithi155.stdout: "event": "waiting for subops from 0", 2023-08-01T19:55:50.041 INFO:teuthology.orchestra.run.smithi155.stdout: "time": "2023-08-01T19:55:05.577027+0000", 2023-08-01T19:55:50.041 INFO:teuthology.orchestra.run.smithi155.stdout: "duration": 8.7237999999999994e-05 2023-08-01T19:55:50.041 INFO:teuthology.orchestra.run.smithi155.stdout: }, 2023-08-01T19:55:50.042 INFO:teuthology.orchestra.run.smithi155.stdout: { 2023-08-01T19:55:50.042 INFO:teuthology.orchestra.run.smithi155.stdout: "event": "op_commit", 2023-08-01T19:55:50.042 INFO:teuthology.orchestra.run.smithi155.stdout: "time": "2023-08-01T19:55:05.579624+0000", 2023-08-01T19:55:50.042 INFO:teuthology.orchestra.run.smithi155.stdout: "duration": 0.0025971200000000001 2023-08-01T19:55:50.043 INFO:teuthology.orchestra.run.smithi155.stdout: }, 2023-08-01T19:55:50.043 INFO:teuthology.orchestra.run.smithi155.stdout: { 2023-08-01T19:55:50.043 INFO:teuthology.orchestra.run.smithi155.stdout: "event": "sub_op_commit_rec", 2023-08-01T19:55:50.044 INFO:teuthology.orchestra.run.smithi155.stdout: "time": "2023-08-01T19:55:05.635218+0000", 2023-08-01T19:55:50.044 INFO:teuthology.orchestra.run.smithi155.stdout: "duration": 0.055594487999999997 2023-08-01T19:55:50.044 INFO:teuthology.orchestra.run.smithi155.stdout: }, 2023-08-01T19:55:50.044 INFO:teuthology.orchestra.run.smithi155.stdout: { 2023-08-01T19:55:50.045 INFO:teuthology.orchestra.run.smithi155.stdout: "event": "commit_sent", 2023-08-01T19:55:50.045 INFO:teuthology.orchestra.run.smithi155.stdout: "time": "2023-08-01T19:55:05.635262+0000", 2023-08-01T19:55:50.045 INFO:teuthology.orchestra.run.smithi155.stdout: "duration": 4.3380999999999997e-05 2023-08-01T19:55:50.045 INFO:teuthology.orchestra.run.smithi155.stdout: }, 2023-08-01T19:55:50.046 INFO:teuthology.orchestra.run.smithi155.stdout: { 2023-08-01T19:55:50.046 INFO:teuthology.orchestra.run.smithi155.stdout: "event": "done", 2023-08-01T19:55:50.046 INFO:teuthology.orchestra.run.smithi155.stdout: "time": "2023-08-01T19:55:05.635297+0000", 2023-08-01T19:55:50.046 INFO:teuthology.orchestra.run.smithi155.stdout: "duration": 3.4842000000000003e-05 2023-08-01T19:55:50.047 INFO:teuthology.orchestra.run.smithi155.stdout: } 2023-08-01T19:55:50.047 INFO:teuthology.orchestra.run.smithi155.stdout: ] 2023-08-01T19:55:50.047 INFO:teuthology.orchestra.run.smithi155.stdout: } 2023-08-01T19:55:50.048 INFO:teuthology.orchestra.run.smithi155.stdout: }, 2023-08-01T19:55:50.048 INFO:teuthology.orchestra.run.smithi155.stdout: { 2023-08-01T19:55:50.048 INFO:teuthology.orchestra.run.smithi155.stdout: "description": "osd_op(client.4668.0:100947 5.4 5:23e8fc27:::benchmark_data_smithi006_114134_object100946:head [set-alloc-hint object_size 65536 write_size 65536,write 0~65536] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e37)", 2023-08-01T19:55:50.048 INFO:teuthology.orchestra.run.smithi155.stdout: "initiated_at": "2023-08-01T19:55:05.576840+0000", 2023-08-01T19:55:50.049 INFO:teuthology.orchestra.run.smithi155.stdout: "age": 44.254226137000003, 2023-08-01T19:55:50.049 INFO:teuthology.orchestra.run.smithi155.stdout: "duration": 0.058423127999999998, 2023-08-01T19:55:50.049 INFO:teuthology.orchestra.run.smithi155.stdout: "type_data": { 2023-08-01T19:55:50.049 INFO:teuthology.orchestra.run.smithi155.stdout: "flag_point": "commit sent; apply or cleanup", 2023-08-01T19:55:50.050 INFO:teuthology.orchestra.run.smithi155.stdout: "client_info": { 2023-08-01T19:55:50.050 INFO:teuthology.orchestra.run.smithi155.stdout: "client": "client.4668", 2023-08-01T19:55:50.050 INFO:teuthology.orchestra.run.smithi155.stdout: "client_addr": "172.21.15.6:0/1709472247", 2023-08-01T19:55:50.050 INFO:teuthology.orchestra.run.smithi155.stdout: "tid": 100947 2023-08-01T19:55:50.051 INFO:teuthology.orchestra.run.smithi155.stdout: }, 2023-08-01T19:55:50.051 INFO:teuthology.orchestra.run.smithi155.stdout: "events": [ 2023-08-01T19:55:50.051 INFO:teuthology.orchestra.run.smithi155.stdout: { 2023-08-01T19:55:50.052 INFO:teuthology.orchestra.run.smithi155.stdout: "event": "initiated", 2023-08-01T19:55:50.052 INFO:teuthology.orchestra.run.smithi155.stdout: "time": "2023-08-01T19:55:05.576840+0000", 2023-08-01T19:55:50.052 INFO:teuthology.orchestra.run.smithi155.stdout: "duration": 0 2023-08-01T19:55:50.052 INFO:teuthology.orchestra.run.smithi155.stdout: }, 2023-08-01T19:55:50.053 INFO:teuthology.orchestra.run.smithi155.stdout: { 2023-08-01T19:55:50.053 INFO:teuthology.orchestra.run.smithi155.stdout: "event": "throttled", 2023-08-01T19:55:50.053 INFO:teuthology.orchestra.run.smithi155.stdout: "time": "2023-08-01T19:55:05.576840+0000", 2023-08-01T19:55:50.053 INFO:teuthology.orchestra.run.smithi155.stdout: "duration": 0 2023-08-01T19:55:50.054 INFO:teuthology.orchestra.run.smithi155.stdout: }, 2023-08-01T19:55:50.054 INFO:teuthology.orchestra.run.smithi155.stdout: { 2023-08-01T19:55:50.054 INFO:teuthology.orchestra.run.smithi155.stdout: "event": "header_read", 2023-08-01T19:55:50.054 INFO:teuthology.orchestra.run.smithi155.stdout: "time": "2023-08-01T19:55:05.576839+0000", 2023-08-01T19:55:50.055 INFO:teuthology.orchestra.run.smithi155.stdout: "duration": 4294967295.9999995 2023-08-01T19:55:50.055 INFO:teuthology.orchestra.run.smithi155.stdout: }, 2023-08-01T19:55:50.055 INFO:teuthology.orchestra.run.smithi155.stdout: { 2023-08-01T19:55:50.056 INFO:teuthology.orchestra.run.smithi155.stdout: "event": "all_read", 2023-08-01T19:55:50.056 INFO:teuthology.orchestra.run.smithi155.stdout: "time": "2023-08-01T19:55:05.576893+0000", 2023-08-01T19:55:50.056 INFO:teuthology.orchestra.run.smithi155.stdout: "duration": 5.3893000000000001e-05 2023-08-01T19:55:50.056 INFO:teuthology.orchestra.run.smithi155.stdout: }, 2023-08-01T19:55:50.057 INFO:teuthology.orchestra.run.smithi155.stdout: { 2023-08-01T19:55:50.057 INFO:teuthology.orchestra.run.smithi155.stdout: "event": "dispatched", 2023-08-01T19:55:50.057 INFO:teuthology.orchestra.run.smithi155.stdout: "time": "2023-08-01T19:55:05.576902+0000", 2023-08-01T19:55:50.057 INFO:teuthology.orchestra.run.smithi155.stdout: "duration": 8.7520000000000002e-06 2023-08-01T19:55:50.058 INFO:teuthology.orchestra.run.smithi155.stdout: }, 2023-08-01T19:55:50.058 INFO:teuthology.orchestra.run.smithi155.stdout: { 2023-08-01T19:55:50.058 INFO:teuthology.orchestra.run.smithi155.stdout: "event": "queued_for_pg", 2023-08-01T19:55:50.058 INFO:teuthology.orchestra.run.smithi155.stdout: "time": "2023-08-01T19:55:05.576905+0000", 2023-08-01T19:55:50.059 INFO:teuthology.orchestra.run.smithi155.stdout: "duration": 3.01e-06 2023-08-01T19:55:50.059 INFO:teuthology.orchestra.run.smithi155.stdout: }, 2023-08-01T19:55:50.059 INFO:teuthology.orchestra.run.smithi155.stdout: { 2023-08-01T19:55:50.059 INFO:teuthology.orchestra.run.smithi155.stdout: "event": "reached_pg", 2023-08-01T19:55:50.060 INFO:teuthology.orchestra.run.smithi155.stdout: "time": "2023-08-01T19:55:05.579641+0000", 2023-08-01T19:55:50.060 INFO:teuthology.orchestra.run.smithi155.stdout: "duration": 0.0027366880000000001 2023-08-01T19:55:50.060 INFO:teuthology.orchestra.run.smithi155.stdout: }, 2023-08-01T19:55:50.061 INFO:teuthology.orchestra.run.smithi155.stdout: { 2023-08-01T19:55:50.061 INFO:teuthology.orchestra.run.smithi155.stdout: "event": "started", 2023-08-01T19:55:50.061 INFO:teuthology.orchestra.run.smithi155.stdout: "time": "2023-08-01T19:55:05.579734+0000", 2023-08-01T19:55:50.061 INFO:teuthology.orchestra.run.smithi155.stdout: "duration": 9.2590000000000006e-05 2023-08-01T19:55:50.062 INFO:teuthology.orchestra.run.smithi155.stdout: }, 2023-08-01T19:55:50.062 INFO:teuthology.orchestra.run.smithi155.stdout: { 2023-08-01T19:55:50.062 INFO:teuthology.orchestra.run.smithi155.stdout: "event": "waiting for subops from 0", 2023-08-01T19:55:50.062 INFO:teuthology.orchestra.run.smithi155.stdout: "time": "2023-08-01T19:55:05.579825+0000", 2023-08-01T19:55:50.063 INFO:teuthology.orchestra.run.smithi155.stdout: "duration": 9.0964999999999994e-05 2023-08-01T19:55:50.063 INFO:teuthology.orchestra.run.smithi155.stdout: }, 2023-08-01T19:55:50.063 INFO:teuthology.orchestra.run.smithi155.stdout: { 2023-08-01T19:55:50.063 INFO:teuthology.orchestra.run.smithi155.stdout: "event": "op_commit", 2023-08-01T19:55:50.064 INFO:teuthology.orchestra.run.smithi155.stdout: "time": "2023-08-01T19:55:05.585041+0000", 2023-08-01T19:55:50.064 INFO:teuthology.orchestra.run.smithi155.stdout: "duration": 0.0052159670000000002 2023-08-01T19:55:50.064 INFO:teuthology.orchestra.run.smithi155.stdout: }, 2023-08-01T19:55:50.065 INFO:teuthology.orchestra.run.smithi155.stdout: { 2023-08-01T19:55:50.065 INFO:teuthology.orchestra.run.smithi155.stdout: "event": "sub_op_commit_rec", 2023-08-01T19:55:50.065 INFO:teuthology.orchestra.run.smithi155.stdout: "time": "2023-08-01T19:55:05.635199+0000", 2023-08-01T19:55:50.065 INFO:teuthology.orchestra.run.smithi155.stdout: "duration": 0.050158023000000003 2023-08-01T19:55:50.066 INFO:teuthology.orchestra.run.smithi155.stdout: }, 2023-08-01T19:55:50.066 INFO:teuthology.orchestra.run.smithi155.stdout: { 2023-08-01T19:55:50.066 INFO:teuthology.orchestra.run.smithi155.stdout: "event": "commit_sent", 2023-08-01T19:55:50.066 INFO:teuthology.orchestra.run.smithi155.stdout: "time": "2023-08-01T19:55:05.635227+0000", 2023-08-01T19:55:50.067 INFO:teuthology.orchestra.run.smithi155.stdout: "duration": 2.7821e-05 2023-08-01T19:55:50.067 INFO:teuthology.orchestra.run.smithi155.stdout: }, 2023-08-01T19:55:50.067 INFO:teuthology.orchestra.run.smithi155.stdout: { 2023-08-01T19:55:50.067 INFO:teuthology.orchestra.run.smithi155.stdout: "event": "done", 2023-08-01T19:55:50.068 INFO:teuthology.orchestra.run.smithi155.stdout: "time": "2023-08-01T19:55:05.635263+0000", 2023-08-01T19:55:50.068 INFO:teuthology.orchestra.run.smithi155.stdout: "duration": 3.6081000000000002e-05 2023-08-01T19:55:50.068 INFO:teuthology.orchestra.run.smithi155.stdout: } 2023-08-01T19:55:50.069 INFO:teuthology.orchestra.run.smithi155.stdout: ] 2023-08-01T19:55:50.069 INFO:teuthology.orchestra.run.smithi155.stdout: } 2023-08-01T19:55:50.069 INFO:teuthology.orchestra.run.smithi155.stdout: } 2023-08-01T19:55:50.069 INFO:teuthology.orchestra.run.smithi155.stdout: ] 2023-08-01T19:55:50.070 INFO:teuthology.orchestra.run.smithi155.stdout:} 2023-08-01T19:55:50.071 INFO:tasks.ceph.osd.1.smithi101.stderr:2023-08-01T19:55:50.069+0000 7fb0cb7f6700 -1 received signal: Hangup from /usr/bin/python3 /bin/daemon-helper kill ceph-osd -f --cluster ceph -i 1 (PID: 111141) UID: 0 2023-08-01T19:55:50.072 DEBUG:teuthology.orchestra.run.smithi008:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 30 ceph --cluster ceph --admin-daemon /var/run/ceph/ceph-osd.0.asok dump_ops_in_flight 2023-08-01T19:55:50.100 INFO:teuthology.orchestra.run.smithi006.stderr:set osd.0 primary-affinity to 0.822061 (8538742) 2023-08-01T19:55:50.172 INFO:tasks.ceph.osd.1.smithi101.stderr:2023-08-01T19:55:50.170+0000 7fb0cb7f6700 -1 received signal: Hangup from /usr/bin/python3 /bin/daemon-helper kill ceph-osd -f --cluster ceph -i 1 (PID: 111141) UID: 0 2023-08-01T19:55:50.233 INFO:teuthology.orchestra.run.smithi008.stdout:{ 2023-08-01T19:55:50.233 INFO:teuthology.orchestra.run.smithi008.stdout: "ops": [ 2023-08-01T19:55:50.233 INFO:teuthology.orchestra.run.smithi008.stdout: { 2023-08-01T19:55:50.234 INFO:teuthology.orchestra.run.smithi008.stdout: "description": "osd_op(client.4668.0:182285 5.1 5.f56afa11 (undecoded) ondisk+write+known_if_redirected+supports_pool_eio e57)", 2023-08-01T19:55:50.234 INFO:teuthology.orchestra.run.smithi008.stdout: "initiated_at": "2023-08-01T19:55:50.133111+0000", 2023-08-01T19:55:50.234 INFO:teuthology.orchestra.run.smithi008.stdout: "age": 0.097605201000000003, 2023-08-01T19:55:50.234 INFO:teuthology.orchestra.run.smithi008.stdout: "duration": 0.097621652000000003, 2023-08-01T19:55:50.235 INFO:teuthology.orchestra.run.smithi008.stdout: "type_data": { 2023-08-01T19:55:50.235 INFO:teuthology.orchestra.run.smithi008.stdout: "flag_point": "delayed", 2023-08-01T19:55:50.235 INFO:teuthology.orchestra.run.smithi008.stdout: "client_info": { 2023-08-01T19:55:50.236 INFO:teuthology.orchestra.run.smithi008.stdout: "client": "client.4668", 2023-08-01T19:55:50.236 INFO:teuthology.orchestra.run.smithi008.stdout: "client_addr": "172.21.15.6:0/1709472247", 2023-08-01T19:55:50.236 INFO:teuthology.orchestra.run.smithi008.stdout: "tid": 182285 2023-08-01T19:55:50.236 INFO:teuthology.orchestra.run.smithi008.stdout: }, 2023-08-01T19:55:50.237 INFO:teuthology.orchestra.run.smithi008.stdout: "events": [ 2023-08-01T19:55:50.237 INFO:teuthology.orchestra.run.smithi008.stdout: { 2023-08-01T19:55:50.237 INFO:teuthology.orchestra.run.smithi008.stdout: "event": "initiated", 2023-08-01T19:55:50.237 INFO:teuthology.orchestra.run.smithi008.stdout: "time": "2023-08-01T19:55:50.133111+0000", 2023-08-01T19:55:50.238 INFO:teuthology.orchestra.run.smithi008.stdout: "duration": 0 2023-08-01T19:55:50.238 INFO:teuthology.orchestra.run.smithi008.stdout: }, 2023-08-01T19:55:50.238 INFO:teuthology.orchestra.run.smithi008.stdout: { 2023-08-01T19:55:50.238 INFO:teuthology.orchestra.run.smithi008.stdout: "event": "throttled", 2023-08-01T19:55:50.239 INFO:teuthology.orchestra.run.smithi008.stdout: "time": "2023-08-01T19:55:50.133111+0000", 2023-08-01T19:55:50.239 INFO:teuthology.orchestra.run.smithi008.stdout: "duration": 0 2023-08-01T19:55:50.239 INFO:teuthology.orchestra.run.smithi008.stdout: }, 2023-08-01T19:55:50.240 INFO:teuthology.orchestra.run.smithi008.stdout: { 2023-08-01T19:55:50.240 INFO:teuthology.orchestra.run.smithi008.stdout: "event": "header_read", 2023-08-01T19:55:50.240 INFO:teuthology.orchestra.run.smithi008.stdout: "time": "2023-08-01T19:55:50.133110+0000", 2023-08-01T19:55:50.240 INFO:teuthology.orchestra.run.smithi008.stdout: "duration": 4294967295.999999 2023-08-01T19:55:50.241 INFO:teuthology.orchestra.run.smithi008.stdout: }, 2023-08-01T19:55:50.241 INFO:teuthology.orchestra.run.smithi008.stdout: { 2023-08-01T19:55:50.241 INFO:teuthology.orchestra.run.smithi008.stdout: "event": "all_read", 2023-08-01T19:55:50.241 INFO:teuthology.orchestra.run.smithi008.stdout: "time": "2023-08-01T19:55:50.133116+0000", 2023-08-01T19:55:50.242 INFO:teuthology.orchestra.run.smithi008.stdout: "duration": 6.0070000000000003e-06 2023-08-01T19:55:50.242 INFO:teuthology.orchestra.run.smithi008.stdout: }, 2023-08-01T19:55:50.242 INFO:teuthology.orchestra.run.smithi008.stdout: { 2023-08-01T19:55:50.242 INFO:teuthology.orchestra.run.smithi008.stdout: "event": "dispatched", 2023-08-01T19:55:50.243 INFO:teuthology.orchestra.run.smithi008.stdout: "time": "2023-08-01T19:55:50.133129+0000", 2023-08-01T19:55:50.243 INFO:teuthology.orchestra.run.smithi008.stdout: "duration": 1.2201000000000001e-05 2023-08-01T19:55:50.243 INFO:teuthology.orchestra.run.smithi008.stdout: }, 2023-08-01T19:55:50.244 INFO:teuthology.orchestra.run.smithi008.stdout: { 2023-08-01T19:55:50.244 INFO:teuthology.orchestra.run.smithi008.stdout: "event": "queued_for_pg", 2023-08-01T19:55:50.244 INFO:teuthology.orchestra.run.smithi008.stdout: "time": "2023-08-01T19:55:50.133134+0000", 2023-08-01T19:55:50.244 INFO:teuthology.orchestra.run.smithi008.stdout: "duration": 5.8610000000000003e-06 2023-08-01T19:55:50.245 INFO:teuthology.orchestra.run.smithi008.stdout: }, 2023-08-01T19:55:50.245 INFO:teuthology.orchestra.run.smithi008.stdout: { 2023-08-01T19:55:50.245 INFO:teuthology.orchestra.run.smithi008.stdout: "event": "reached_pg", 2023-08-01T19:55:50.245 INFO:teuthology.orchestra.run.smithi008.stdout: "time": "2023-08-01T19:55:50.133173+0000", 2023-08-01T19:55:50.246 INFO:teuthology.orchestra.run.smithi008.stdout: "duration": 3.8321000000000001e-05 2023-08-01T19:55:50.246 INFO:teuthology.orchestra.run.smithi008.stdout: }, 2023-08-01T19:55:50.246 INFO:teuthology.orchestra.run.smithi008.stdout: { 2023-08-01T19:55:50.247 INFO:teuthology.orchestra.run.smithi008.stdout: "event": "waiting for peered", 2023-08-01T19:55:50.247 INFO:teuthology.orchestra.run.smithi008.stdout: "time": "2023-08-01T19:55:50.133178+0000", 2023-08-01T19:55:50.247 INFO:teuthology.orchestra.run.smithi008.stdout: "duration": 5.6250000000000004e-06 2023-08-01T19:55:50.247 INFO:teuthology.orchestra.run.smithi008.stdout: } 2023-08-01T19:55:50.248 INFO:teuthology.orchestra.run.smithi008.stdout: ] 2023-08-01T19:55:50.248 INFO:teuthology.orchestra.run.smithi008.stdout: } 2023-08-01T19:55:50.248 INFO:teuthology.orchestra.run.smithi008.stdout: }, 2023-08-01T19:55:50.248 INFO:teuthology.orchestra.run.smithi008.stdout: { 2023-08-01T19:55:50.249 INFO:teuthology.orchestra.run.smithi008.stdout: "description": "osd_repop(client.4668.0:182365 5.b e57/19 5:dc88aadb:::benchmark_data_smithi006_114134_object48704:head v 57'11319, mlcod=57'11317)", 2023-08-01T19:55:50.249 INFO:teuthology.orchestra.run.smithi008.stdout: "initiated_at": "2023-08-01T19:55:50.229520+0000", 2023-08-01T19:55:50.249 INFO:teuthology.orchestra.run.smithi008.stdout: "age": 0.001196976, 2023-08-01T19:55:50.249 INFO:teuthology.orchestra.run.smithi008.stdout: "duration": 0.0012591970000000001, 2023-08-01T19:55:50.250 INFO:teuthology.orchestra.run.smithi008.stdout: "type_data": { 2023-08-01T19:55:50.250 INFO:teuthology.orchestra.run.smithi008.stdout: "flag_point": "started", 2023-08-01T19:55:50.250 INFO:teuthology.orchestra.run.smithi008.stdout: "events": [ 2023-08-01T19:55:50.251 INFO:teuthology.orchestra.run.smithi008.stdout: { 2023-08-01T19:55:50.251 INFO:teuthology.orchestra.run.smithi008.stdout: "event": "initiated", 2023-08-01T19:55:50.251 INFO:teuthology.orchestra.run.smithi008.stdout: "time": "2023-08-01T19:55:50.229520+0000", 2023-08-01T19:55:50.251 INFO:teuthology.orchestra.run.smithi008.stdout: "duration": 0 2023-08-01T19:55:50.252 INFO:teuthology.orchestra.run.smithi008.stdout: }, 2023-08-01T19:55:50.252 INFO:teuthology.orchestra.run.smithi008.stdout: { 2023-08-01T19:55:50.252 INFO:teuthology.orchestra.run.smithi008.stdout: "event": "throttled", 2023-08-01T19:55:50.252 INFO:teuthology.orchestra.run.smithi008.stdout: "time": "2023-08-01T19:55:50.229520+0000", 2023-08-01T19:55:50.253 INFO:teuthology.orchestra.run.smithi008.stdout: "duration": 0 2023-08-01T19:55:50.253 INFO:teuthology.orchestra.run.smithi008.stdout: }, 2023-08-01T19:55:50.253 INFO:teuthology.orchestra.run.smithi008.stdout: { 2023-08-01T19:55:50.254 INFO:teuthology.orchestra.run.smithi008.stdout: "event": "header_read", 2023-08-01T19:55:50.254 INFO:teuthology.orchestra.run.smithi008.stdout: "time": "2023-08-01T19:55:50.229519+0000", 2023-08-01T19:55:50.254 INFO:teuthology.orchestra.run.smithi008.stdout: "duration": 4294967295.9999995 2023-08-01T19:55:50.254 INFO:teuthology.orchestra.run.smithi008.stdout: }, 2023-08-01T19:55:50.255 INFO:teuthology.orchestra.run.smithi008.stdout: { 2023-08-01T19:55:50.255 INFO:teuthology.orchestra.run.smithi008.stdout: "event": "all_read", 2023-08-01T19:55:50.255 INFO:teuthology.orchestra.run.smithi008.stdout: "time": "2023-08-01T19:55:50.229524+0000", 2023-08-01T19:55:50.255 INFO:teuthology.orchestra.run.smithi008.stdout: "duration": 5.1059999999999999e-06 2023-08-01T19:55:50.256 INFO:teuthology.orchestra.run.smithi008.stdout: }, 2023-08-01T19:55:50.256 INFO:teuthology.orchestra.run.smithi008.stdout: { 2023-08-01T19:55:50.256 INFO:teuthology.orchestra.run.smithi008.stdout: "event": "dispatched", 2023-08-01T19:55:50.257 INFO:teuthology.orchestra.run.smithi008.stdout: "time": "2023-08-01T19:55:50.229534+0000", 2023-08-01T19:55:50.257 INFO:teuthology.orchestra.run.smithi008.stdout: "duration": 1.0033e-05 2023-08-01T19:55:50.257 INFO:teuthology.orchestra.run.smithi008.stdout: }, 2023-08-01T19:55:50.257 INFO:teuthology.orchestra.run.smithi008.stdout: { 2023-08-01T19:55:50.258 INFO:teuthology.orchestra.run.smithi008.stdout: "event": "queued_for_pg", 2023-08-01T19:55:50.258 INFO:teuthology.orchestra.run.smithi008.stdout: "time": "2023-08-01T19:55:50.229538+0000", 2023-08-01T19:55:50.258 INFO:teuthology.orchestra.run.smithi008.stdout: "duration": 4.1690000000000002e-06 2023-08-01T19:55:50.258 INFO:teuthology.orchestra.run.smithi008.stdout: }, 2023-08-01T19:55:50.259 INFO:teuthology.orchestra.run.smithi008.stdout: { 2023-08-01T19:55:50.259 INFO:teuthology.orchestra.run.smithi008.stdout: "event": "reached_pg", 2023-08-01T19:55:50.259 INFO:teuthology.orchestra.run.smithi008.stdout: "time": "2023-08-01T19:55:50.229574+0000", 2023-08-01T19:55:50.259 INFO:teuthology.orchestra.run.smithi008.stdout: "duration": 3.608e-05 2023-08-01T19:55:50.260 INFO:teuthology.orchestra.run.smithi008.stdout: }, 2023-08-01T19:55:50.260 INFO:teuthology.orchestra.run.smithi008.stdout: { 2023-08-01T19:55:50.260 INFO:teuthology.orchestra.run.smithi008.stdout: "event": "started", 2023-08-01T19:55:50.261 INFO:teuthology.orchestra.run.smithi008.stdout: "time": "2023-08-01T19:55:50.229588+0000", 2023-08-01T19:55:50.261 INFO:teuthology.orchestra.run.smithi008.stdout: "duration": 1.3721e-05 2023-08-01T19:55:50.261 INFO:teuthology.orchestra.run.smithi008.stdout: } 2023-08-01T19:55:50.261 INFO:teuthology.orchestra.run.smithi008.stdout: ] 2023-08-01T19:55:50.262 INFO:teuthology.orchestra.run.smithi008.stdout: } 2023-08-01T19:55:50.262 INFO:teuthology.orchestra.run.smithi008.stdout: }, 2023-08-01T19:55:50.262 INFO:teuthology.orchestra.run.smithi008.stdout: { 2023-08-01T19:55:50.262 INFO:teuthology.orchestra.run.smithi008.stdout: "description": "osd_op(client.4668.0:182342 5.5 5.59810b85 (undecoded) ondisk+write+known_if_redirected+supports_pool_eio e57)", 2023-08-01T19:55:50.263 INFO:teuthology.orchestra.run.smithi008.stdout: "initiated_at": "2023-08-01T19:55:50.175692+0000", 2023-08-01T19:55:50.263 INFO:teuthology.orchestra.run.smithi008.stdout: "age": 0.055024753000000003, 2023-08-01T19:55:50.263 INFO:teuthology.orchestra.run.smithi008.stdout: "duration": 0.055122806000000003, 2023-08-01T19:55:50.263 INFO:teuthology.orchestra.run.smithi008.stdout: "type_data": { 2023-08-01T19:55:50.264 INFO:teuthology.orchestra.run.smithi008.stdout: "flag_point": "delayed", 2023-08-01T19:55:50.264 INFO:teuthology.orchestra.run.smithi008.stdout: "client_info": { 2023-08-01T19:55:50.264 INFO:teuthology.orchestra.run.smithi008.stdout: "client": "client.4668", 2023-08-01T19:55:50.265 INFO:teuthology.orchestra.run.smithi008.stdout: "client_addr": "172.21.15.6:0/1709472247", 2023-08-01T19:55:50.265 INFO:teuthology.orchestra.run.smithi008.stdout: "tid": 182342 2023-08-01T19:55:50.265 INFO:teuthology.orchestra.run.smithi008.stdout: }, 2023-08-01T19:55:50.265 INFO:teuthology.orchestra.run.smithi008.stdout: "events": [ 2023-08-01T19:55:50.266 INFO:teuthology.orchestra.run.smithi008.stdout: { 2023-08-01T19:55:50.266 INFO:teuthology.orchestra.run.smithi008.stdout: "event": "initiated", 2023-08-01T19:55:50.266 INFO:teuthology.orchestra.run.smithi008.stdout: "time": "2023-08-01T19:55:50.175692+0000", 2023-08-01T19:55:50.267 INFO:teuthology.orchestra.run.smithi008.stdout: "duration": 0 2023-08-01T19:55:50.267 INFO:teuthology.orchestra.run.smithi008.stdout: }, 2023-08-01T19:55:50.267 INFO:teuthology.orchestra.run.smithi008.stdout: { 2023-08-01T19:55:50.267 INFO:teuthology.orchestra.run.smithi008.stdout: "event": "throttled", 2023-08-01T19:55:50.268 INFO:teuthology.orchestra.run.smithi008.stdout: "time": "2023-08-01T19:55:50.175692+0000", 2023-08-01T19:55:50.268 INFO:teuthology.orchestra.run.smithi008.stdout: "duration": 0 2023-08-01T19:55:50.268 INFO:teuthology.orchestra.run.smithi008.stdout: }, 2023-08-01T19:55:50.268 INFO:teuthology.orchestra.run.smithi008.stdout: { 2023-08-01T19:55:50.269 INFO:teuthology.orchestra.run.smithi008.stdout: "event": "header_read", 2023-08-01T19:55:50.269 INFO:teuthology.orchestra.run.smithi008.stdout: "time": "2023-08-01T19:55:50.175691+0000", 2023-08-01T19:55:50.269 INFO:teuthology.orchestra.run.smithi008.stdout: "duration": 4294967295.999999 2023-08-01T19:55:50.269 INFO:teuthology.orchestra.run.smithi008.stdout: }, 2023-08-01T19:55:50.270 INFO:teuthology.orchestra.run.smithi008.stdout: { 2023-08-01T19:55:50.270 INFO:teuthology.orchestra.run.smithi008.stdout: "event": "all_read", 2023-08-01T19:55:50.270 INFO:teuthology.orchestra.run.smithi008.stdout: "time": "2023-08-01T19:55:50.175696+0000", 2023-08-01T19:55:50.270 INFO:teuthology.orchestra.run.smithi008.stdout: "duration": 4.685e-06 2023-08-01T19:55:50.271 INFO:teuthology.orchestra.run.smithi008.stdout: }, 2023-08-01T19:55:50.271 INFO:teuthology.orchestra.run.smithi008.stdout: { 2023-08-01T19:55:50.271 INFO:teuthology.orchestra.run.smithi008.stdout: "event": "dispatched", 2023-08-01T19:55:50.272 INFO:teuthology.orchestra.run.smithi008.stdout: "time": "2023-08-01T19:55:50.175706+0000", 2023-08-01T19:55:50.272 INFO:teuthology.orchestra.run.smithi008.stdout: "duration": 9.7540000000000001e-06 2023-08-01T19:55:50.272 INFO:teuthology.orchestra.run.smithi008.stdout: }, 2023-08-01T19:55:50.272 INFO:teuthology.orchestra.run.smithi008.stdout: { 2023-08-01T19:55:50.273 INFO:teuthology.orchestra.run.smithi008.stdout: "event": "queued_for_pg", 2023-08-01T19:55:50.273 INFO:teuthology.orchestra.run.smithi008.stdout: "time": "2023-08-01T19:55:50.175710+0000", 2023-08-01T19:55:50.273 INFO:teuthology.orchestra.run.smithi008.stdout: "duration": 4.3170000000000003e-06 2023-08-01T19:55:50.273 INFO:teuthology.orchestra.run.smithi008.stdout: }, 2023-08-01T19:55:50.274 INFO:teuthology.orchestra.run.smithi008.stdout: { 2023-08-01T19:55:50.274 INFO:teuthology.orchestra.run.smithi008.stdout: "event": "reached_pg", 2023-08-01T19:55:50.274 INFO:teuthology.orchestra.run.smithi008.stdout: "time": "2023-08-01T19:55:50.175756+0000", 2023-08-01T19:55:50.274 INFO:teuthology.orchestra.run.smithi008.stdout: "duration": 4.6300000000000001e-05 2023-08-01T19:55:50.275 INFO:teuthology.orchestra.run.smithi008.stdout: }, 2023-08-01T19:55:50.275 INFO:teuthology.orchestra.run.smithi008.stdout: { 2023-08-01T19:55:50.275 INFO:teuthology.orchestra.run.smithi008.stdout: "event": "waiting for peered", 2023-08-01T19:55:50.276 INFO:teuthology.orchestra.run.smithi008.stdout: "time": "2023-08-01T19:55:50.175767+0000", 2023-08-01T19:55:50.276 INFO:teuthology.orchestra.run.smithi008.stdout: "duration": 1.0740000000000001e-05 2023-08-01T19:55:50.276 INFO:teuthology.orchestra.run.smithi008.stdout: } 2023-08-01T19:55:50.276 INFO:teuthology.orchestra.run.smithi008.stdout: ] 2023-08-01T19:55:50.277 INFO:teuthology.orchestra.run.smithi008.stdout: } 2023-08-01T19:55:50.277 INFO:teuthology.orchestra.run.smithi008.stdout: }, 2023-08-01T19:55:50.277 INFO:teuthology.orchestra.run.smithi008.stdout: { 2023-08-01T19:55:50.277 INFO:teuthology.orchestra.run.smithi008.stdout: "description": "osd_op(client.4668.0:182264 5.1 5.78c06111 (undecoded) ondisk+write+known_if_redirected+supports_pool_eio e57)", 2023-08-01T19:55:50.278 INFO:teuthology.orchestra.run.smithi008.stdout: "initiated_at": "2023-08-01T19:55:50.121388+0000", 2023-08-01T19:55:50.278 INFO:teuthology.orchestra.run.smithi008.stdout: "age": 0.109328971, 2023-08-01T19:55:50.278 INFO:teuthology.orchestra.run.smithi008.stdout: "duration": 0.109464572, 2023-08-01T19:55:50.278 INFO:teuthology.orchestra.run.smithi008.stdout: "type_data": { 2023-08-01T19:55:50.279 INFO:teuthology.orchestra.run.smithi008.stdout: "flag_point": "delayed", 2023-08-01T19:55:50.279 INFO:teuthology.orchestra.run.smithi008.stdout: "client_info": { 2023-08-01T19:55:50.279 INFO:teuthology.orchestra.run.smithi008.stdout: "client": "client.4668", 2023-08-01T19:55:50.279 INFO:teuthology.orchestra.run.smithi008.stdout: "client_addr": "172.21.15.6:0/1709472247", 2023-08-01T19:55:50.280 INFO:teuthology.orchestra.run.smithi008.stdout: "tid": 182264 2023-08-01T19:55:50.280 INFO:teuthology.orchestra.run.smithi008.stdout: }, 2023-08-01T19:55:50.280 INFO:teuthology.orchestra.run.smithi008.stdout: "events": [ 2023-08-01T19:55:50.281 INFO:teuthology.orchestra.run.smithi008.stdout: { 2023-08-01T19:55:50.281 INFO:teuthology.orchestra.run.smithi008.stdout: "event": "initiated", 2023-08-01T19:55:50.281 INFO:teuthology.orchestra.run.smithi008.stdout: "time": "2023-08-01T19:55:50.121388+0000", 2023-08-01T19:55:50.281 INFO:teuthology.orchestra.run.smithi008.stdout: "duration": 0 2023-08-01T19:55:50.282 INFO:teuthology.orchestra.run.smithi008.stdout: }, 2023-08-01T19:55:50.282 INFO:teuthology.orchestra.run.smithi008.stdout: { 2023-08-01T19:55:50.282 INFO:teuthology.orchestra.run.smithi008.stdout: "event": "throttled", 2023-08-01T19:55:50.282 INFO:teuthology.orchestra.run.smithi008.stdout: "time": "2023-08-01T19:55:50.121388+0000", 2023-08-01T19:55:50.283 INFO:teuthology.orchestra.run.smithi008.stdout: "duration": 0 2023-08-01T19:55:50.283 INFO:teuthology.orchestra.run.smithi008.stdout: }, 2023-08-01T19:55:50.283 INFO:teuthology.orchestra.run.smithi008.stdout: { 2023-08-01T19:55:50.283 INFO:teuthology.orchestra.run.smithi008.stdout: "event": "header_read", 2023-08-01T19:55:50.284 INFO:teuthology.orchestra.run.smithi008.stdout: "time": "2023-08-01T19:55:50.121387+0000", 2023-08-01T19:55:50.284 INFO:teuthology.orchestra.run.smithi008.stdout: "duration": 4294967295.999999 2023-08-01T19:55:50.284 INFO:teuthology.orchestra.run.smithi008.stdout: }, 2023-08-01T19:55:50.285 INFO:teuthology.orchestra.run.smithi008.stdout: { 2023-08-01T19:55:50.285 INFO:teuthology.orchestra.run.smithi008.stdout: "event": "all_read", 2023-08-01T19:55:50.285 INFO:teuthology.orchestra.run.smithi008.stdout: "time": "2023-08-01T19:55:50.121392+0000", 2023-08-01T19:55:50.285 INFO:teuthology.orchestra.run.smithi008.stdout: "duration": 4.9479999999999999e-06 2023-08-01T19:55:50.286 INFO:teuthology.orchestra.run.smithi008.stdout: }, 2023-08-01T19:55:50.286 INFO:teuthology.orchestra.run.smithi008.stdout: { 2023-08-01T19:55:50.286 INFO:teuthology.orchestra.run.smithi008.stdout: "event": "dispatched", 2023-08-01T19:55:50.286 INFO:teuthology.orchestra.run.smithi008.stdout: "time": "2023-08-01T19:55:50.121403+0000", 2023-08-01T19:55:50.287 INFO:teuthology.orchestra.run.smithi008.stdout: "duration": 1.1131000000000001e-05 2023-08-01T19:55:50.287 INFO:teuthology.orchestra.run.smithi008.stdout: }, 2023-08-01T19:55:50.287 INFO:teuthology.orchestra.run.smithi008.stdout: { 2023-08-01T19:55:50.287 INFO:teuthology.orchestra.run.smithi008.stdout: "event": "queued_for_pg", 2023-08-01T19:55:50.288 INFO:teuthology.orchestra.run.smithi008.stdout: "time": "2023-08-01T19:55:50.121409+0000", 2023-08-01T19:55:50.288 INFO:teuthology.orchestra.run.smithi008.stdout: "duration": 5.7359999999999998e-06 2023-08-01T19:55:50.288 INFO:teuthology.orchestra.run.smithi008.stdout: }, 2023-08-01T19:55:50.289 INFO:teuthology.orchestra.run.smithi008.stdout: { 2023-08-01T19:55:50.289 INFO:teuthology.orchestra.run.smithi008.stdout: "event": "reached_pg", 2023-08-01T19:55:50.289 INFO:teuthology.orchestra.run.smithi008.stdout: "time": "2023-08-01T19:55:50.121440+0000", 2023-08-01T19:55:50.289 INFO:teuthology.orchestra.run.smithi008.stdout: "duration": 3.1257000000000002e-05 2023-08-01T19:55:50.290 INFO:teuthology.orchestra.run.smithi008.stdout: }, 2023-08-01T19:55:50.290 INFO:teuthology.orchestra.run.smithi008.stdout: { 2023-08-01T19:55:50.290 INFO:teuthology.orchestra.run.smithi008.stdout: "event": "waiting for peered", 2023-08-01T19:55:50.290 INFO:teuthology.orchestra.run.smithi008.stdout: "time": "2023-08-01T19:55:50.121446+0000", 2023-08-01T19:55:50.291 INFO:teuthology.orchestra.run.smithi008.stdout: "duration": 6.686e-06 2023-08-01T19:55:50.291 INFO:teuthology.orchestra.run.smithi008.stdout: } 2023-08-01T19:55:50.291 INFO:teuthology.orchestra.run.smithi008.stdout: ] 2023-08-01T19:55:50.291 INFO:teuthology.orchestra.run.smithi008.stdout: } 2023-08-01T19:55:50.292 INFO:teuthology.orchestra.run.smithi008.stdout: }, 2023-08-01T19:55:50.292 INFO:teuthology.orchestra.run.smithi008.stdout: { 2023-08-01T19:55:50.292 INFO:teuthology.orchestra.run.smithi008.stdout: "description": "osd_op(client.4668.0:182317 5.1 5.71c14081 (undecoded) ondisk+write+known_if_redirected+supports_pool_eio e57)", 2023-08-01T19:55:50.293 INFO:teuthology.orchestra.run.smithi008.stdout: "initiated_at": "2023-08-01T19:55:50.154517+0000", 2023-08-01T19:55:50.293 INFO:teuthology.orchestra.run.smithi008.stdout: "age": 0.076199830999999996, 2023-08-01T19:55:50.293 INFO:teuthology.orchestra.run.smithi008.stdout: "duration": 0.076373099, 2023-08-01T19:55:50.293 INFO:teuthology.orchestra.run.smithi008.stdout: "type_data": { 2023-08-01T19:55:50.294 INFO:teuthology.orchestra.run.smithi008.stdout: "flag_point": "delayed", 2023-08-01T19:55:50.294 INFO:teuthology.orchestra.run.smithi008.stdout: "client_info": { 2023-08-01T19:55:50.294 INFO:teuthology.orchestra.run.smithi008.stdout: "client": "client.4668", 2023-08-01T19:55:50.294 INFO:teuthology.orchestra.run.smithi008.stdout: "client_addr": "172.21.15.6:0/1709472247", 2023-08-01T19:55:50.295 INFO:teuthology.orchestra.run.smithi008.stdout: "tid": 182317 2023-08-01T19:55:50.295 INFO:teuthology.orchestra.run.smithi008.stdout: }, 2023-08-01T19:55:50.295 INFO:teuthology.orchestra.run.smithi008.stdout: "events": [ 2023-08-01T19:55:50.295 INFO:teuthology.orchestra.run.smithi008.stdout: { 2023-08-01T19:55:50.295 INFO:teuthology.orchestra.run.smithi008.stdout: "event": "initiated", 2023-08-01T19:55:50.295 INFO:teuthology.orchestra.run.smithi008.stdout: "time": "2023-08-01T19:55:50.154517+0000", 2023-08-01T19:55:50.295 INFO:teuthology.orchestra.run.smithi008.stdout: "duration": 0 2023-08-01T19:55:50.296 INFO:teuthology.orchestra.run.smithi008.stdout: }, 2023-08-01T19:55:50.296 INFO:teuthology.orchestra.run.smithi008.stdout: { 2023-08-01T19:55:50.296 INFO:teuthology.orchestra.run.smithi008.stdout: "event": "throttled", 2023-08-01T19:55:50.296 INFO:teuthology.orchestra.run.smithi008.stdout: "time": "2023-08-01T19:55:50.154517+0000", 2023-08-01T19:55:50.296 INFO:teuthology.orchestra.run.smithi008.stdout: "duration": 0 2023-08-01T19:55:50.296 INFO:teuthology.orchestra.run.smithi008.stdout: }, 2023-08-01T19:55:50.296 INFO:teuthology.orchestra.run.smithi008.stdout: { 2023-08-01T19:55:50.296 INFO:teuthology.orchestra.run.smithi008.stdout: "event": "header_read", 2023-08-01T19:55:50.297 INFO:teuthology.orchestra.run.smithi008.stdout: "time": "2023-08-01T19:55:50.154516+0000", 2023-08-01T19:55:50.297 INFO:teuthology.orchestra.run.smithi008.stdout: "duration": 4294967295.999999 2023-08-01T19:55:50.297 INFO:teuthology.orchestra.run.smithi008.stdout: }, 2023-08-01T19:55:50.297 INFO:teuthology.orchestra.run.smithi008.stdout: { 2023-08-01T19:55:50.297 INFO:teuthology.orchestra.run.smithi008.stdout: "event": "all_read", 2023-08-01T19:55:50.297 INFO:teuthology.orchestra.run.smithi008.stdout: "time": "2023-08-01T19:55:50.154521+0000", 2023-08-01T19:55:50.297 INFO:teuthology.orchestra.run.smithi008.stdout: "duration": 4.6879999999999998e-06 2023-08-01T19:55:50.297 INFO:teuthology.orchestra.run.smithi008.stdout: }, 2023-08-01T19:55:50.298 INFO:teuthology.orchestra.run.smithi008.stdout: { 2023-08-01T19:55:50.298 INFO:teuthology.orchestra.run.smithi008.stdout: "event": "dispatched", 2023-08-01T19:55:50.298 INFO:teuthology.orchestra.run.smithi008.stdout: "time": "2023-08-01T19:55:50.154530+0000", 2023-08-01T19:55:50.298 INFO:teuthology.orchestra.run.smithi008.stdout: "duration": 9.1120000000000002e-06 2023-08-01T19:55:50.298 INFO:teuthology.orchestra.run.smithi008.stdout: }, 2023-08-01T19:55:50.298 INFO:teuthology.orchestra.run.smithi008.stdout: { 2023-08-01T19:55:50.298 INFO:teuthology.orchestra.run.smithi008.stdout: "event": "queued_for_pg", 2023-08-01T19:55:50.299 INFO:teuthology.orchestra.run.smithi008.stdout: "time": "2023-08-01T19:55:50.154534+0000", 2023-08-01T19:55:50.299 INFO:teuthology.orchestra.run.smithi008.stdout: "duration": 4.031e-06 2023-08-01T19:55:50.299 INFO:teuthology.orchestra.run.smithi008.stdout: }, 2023-08-01T19:55:50.299 INFO:teuthology.orchestra.run.smithi008.stdout: { 2023-08-01T19:55:50.299 INFO:teuthology.orchestra.run.smithi008.stdout: "event": "reached_pg", 2023-08-01T19:55:50.299 INFO:teuthology.orchestra.run.smithi008.stdout: "time": "2023-08-01T19:55:50.154582+0000", 2023-08-01T19:55:50.299 INFO:teuthology.orchestra.run.smithi008.stdout: "duration": 4.8449999999999999e-05 2023-08-01T19:55:50.299 INFO:teuthology.orchestra.run.smithi008.stdout: }, 2023-08-01T19:55:50.300 INFO:teuthology.orchestra.run.smithi008.stdout: { 2023-08-01T19:55:50.300 INFO:teuthology.orchestra.run.smithi008.stdout: "event": "waiting for peered", 2023-08-01T19:55:50.300 INFO:teuthology.orchestra.run.smithi008.stdout: "time": "2023-08-01T19:55:50.154590+0000", 2023-08-01T19:55:50.300 INFO:teuthology.orchestra.run.smithi008.stdout: "duration": 8.0809999999999994e-06 2023-08-01T19:55:50.300 INFO:teuthology.orchestra.run.smithi008.stdout: } 2023-08-01T19:55:50.300 INFO:teuthology.orchestra.run.smithi008.stdout: ] 2023-08-01T19:55:50.300 INFO:teuthology.orchestra.run.smithi008.stdout: } 2023-08-01T19:55:50.300 INFO:teuthology.orchestra.run.smithi008.stdout: }, 2023-08-01T19:55:50.301 INFO:teuthology.orchestra.run.smithi008.stdout: { 2023-08-01T19:55:50.301 INFO:teuthology.orchestra.run.smithi008.stdout: "description": "osd_op(client.4668.0:182347 5.5 5.f2fc4d95 (undecoded) ondisk+write+known_if_redirected+supports_pool_eio e57)", 2023-08-01T19:55:50.301 INFO:teuthology.orchestra.run.smithi008.stdout: "initiated_at": "2023-08-01T19:55:50.181528+0000", 2023-08-01T19:55:50.301 INFO:teuthology.orchestra.run.smithi008.stdout: "age": 0.049188586999999999, 2023-08-01T19:55:50.301 INFO:teuthology.orchestra.run.smithi008.stdout: "duration": 0.049398404999999999, 2023-08-01T19:55:50.301 INFO:teuthology.orchestra.run.smithi008.stdout: "type_data": { 2023-08-01T19:55:50.301 INFO:teuthology.orchestra.run.smithi008.stdout: "flag_point": "delayed", 2023-08-01T19:55:50.301 INFO:teuthology.orchestra.run.smithi008.stdout: "client_info": { 2023-08-01T19:55:50.302 INFO:teuthology.orchestra.run.smithi008.stdout: "client": "client.4668", 2023-08-01T19:55:50.302 INFO:teuthology.orchestra.run.smithi008.stdout: "client_addr": "172.21.15.6:0/1709472247", 2023-08-01T19:55:50.302 INFO:teuthology.orchestra.run.smithi008.stdout: "tid": 182347 2023-08-01T19:55:50.302 INFO:teuthology.orchestra.run.smithi008.stdout: }, 2023-08-01T19:55:50.302 INFO:teuthology.orchestra.run.smithi008.stdout: "events": [ 2023-08-01T19:55:50.302 INFO:teuthology.orchestra.run.smithi008.stdout: { 2023-08-01T19:55:50.302 INFO:teuthology.orchestra.run.smithi008.stdout: "event": "initiated", 2023-08-01T19:55:50.303 INFO:teuthology.orchestra.run.smithi008.stdout: "time": "2023-08-01T19:55:50.181528+0000", 2023-08-01T19:55:50.303 INFO:teuthology.orchestra.run.smithi008.stdout: "duration": 0 2023-08-01T19:55:50.303 INFO:teuthology.orchestra.run.smithi008.stdout: }, 2023-08-01T19:55:50.303 INFO:teuthology.orchestra.run.smithi008.stdout: { 2023-08-01T19:55:50.303 INFO:teuthology.orchestra.run.smithi008.stdout: "event": "throttled", 2023-08-01T19:55:50.303 INFO:teuthology.orchestra.run.smithi008.stdout: "time": "2023-08-01T19:55:50.181528+0000", 2023-08-01T19:55:50.303 INFO:teuthology.orchestra.run.smithi008.stdout: "duration": 0 2023-08-01T19:55:50.303 INFO:teuthology.orchestra.run.smithi008.stdout: }, 2023-08-01T19:55:50.304 INFO:teuthology.orchestra.run.smithi008.stdout: { 2023-08-01T19:55:50.304 INFO:teuthology.orchestra.run.smithi008.stdout: "event": "header_read", 2023-08-01T19:55:50.304 INFO:teuthology.orchestra.run.smithi008.stdout: "time": "2023-08-01T19:55:50.181527+0000", 2023-08-01T19:55:50.304 INFO:teuthology.orchestra.run.smithi008.stdout: "duration": 4294967295.9999995 2023-08-01T19:55:50.304 INFO:teuthology.orchestra.run.smithi008.stdout: }, 2023-08-01T19:55:50.304 INFO:teuthology.orchestra.run.smithi008.stdout: { 2023-08-01T19:55:50.304 INFO:teuthology.orchestra.run.smithi008.stdout: "event": "all_read", 2023-08-01T19:55:50.304 INFO:teuthology.orchestra.run.smithi008.stdout: "time": "2023-08-01T19:55:50.181532+0000", 2023-08-01T19:55:50.305 INFO:teuthology.orchestra.run.smithi008.stdout: "duration": 4.3610000000000003e-06 2023-08-01T19:55:50.305 INFO:teuthology.orchestra.run.smithi008.stdout: }, 2023-08-01T19:55:50.305 INFO:teuthology.orchestra.run.smithi008.stdout: { 2023-08-01T19:55:50.305 INFO:teuthology.orchestra.run.smithi008.stdout: "event": "dispatched", 2023-08-01T19:55:50.305 INFO:teuthology.orchestra.run.smithi008.stdout: "time": "2023-08-01T19:55:50.181541+0000", 2023-08-01T19:55:50.305 INFO:teuthology.orchestra.run.smithi008.stdout: "duration": 9.3770000000000002e-06 2023-08-01T19:55:50.305 INFO:teuthology.orchestra.run.smithi008.stdout: }, 2023-08-01T19:55:50.305 INFO:teuthology.orchestra.run.smithi008.stdout: { 2023-08-01T19:55:50.306 INFO:teuthology.orchestra.run.smithi008.stdout: "event": "queued_for_pg", 2023-08-01T19:55:50.306 INFO:teuthology.orchestra.run.smithi008.stdout: "time": "2023-08-01T19:55:50.181545+0000", 2023-08-01T19:55:50.306 INFO:teuthology.orchestra.run.smithi008.stdout: "duration": 4.4499999999999997e-06 2023-08-01T19:55:50.306 INFO:teuthology.orchestra.run.smithi008.stdout: }, 2023-08-01T19:55:50.306 INFO:teuthology.orchestra.run.smithi008.stdout: { 2023-08-01T19:55:50.306 INFO:teuthology.orchestra.run.smithi008.stdout: "event": "reached_pg", 2023-08-01T19:55:50.306 INFO:teuthology.orchestra.run.smithi008.stdout: "time": "2023-08-01T19:55:50.181595+0000", 2023-08-01T19:55:50.307 INFO:teuthology.orchestra.run.smithi008.stdout: "duration": 4.9397000000000002e-05 2023-08-01T19:55:50.307 INFO:teuthology.orchestra.run.smithi008.stdout: }, 2023-08-01T19:55:50.307 INFO:teuthology.orchestra.run.smithi008.stdout: { 2023-08-01T19:55:50.307 INFO:teuthology.orchestra.run.smithi008.stdout: "event": "waiting for peered", 2023-08-01T19:55:50.307 INFO:teuthology.orchestra.run.smithi008.stdout: "time": "2023-08-01T19:55:50.181605+0000", 2023-08-01T19:55:50.307 INFO:teuthology.orchestra.run.smithi008.stdout: "duration": 1.0039e-05 2023-08-01T19:55:50.307 INFO:teuthology.orchestra.run.smithi008.stdout: } 2023-08-01T19:55:50.307 INFO:teuthology.orchestra.run.smithi008.stdout: ] 2023-08-01T19:55:50.308 INFO:teuthology.orchestra.run.smithi008.stdout: } 2023-08-01T19:55:50.308 INFO:teuthology.orchestra.run.smithi008.stdout: }, 2023-08-01T19:55:50.308 INFO:teuthology.orchestra.run.smithi008.stdout: { 2023-08-01T19:55:50.308 INFO:teuthology.orchestra.run.smithi008.stdout: "description": "osd_op(client.4668.0:182348 5.1 5.af0a7651 (undecoded) ondisk+write+known_if_redirected+supports_pool_eio e57)", 2023-08-01T19:55:50.308 INFO:teuthology.orchestra.run.smithi008.stdout: "initiated_at": "2023-08-01T19:55:50.182593+0000", 2023-08-01T19:55:50.308 INFO:teuthology.orchestra.run.smithi008.stdout: "age": 0.048123843999999999, 2023-08-01T19:55:50.308 INFO:teuthology.orchestra.run.smithi008.stdout: "duration": 0.048371083000000002, 2023-08-01T19:55:50.309 INFO:teuthology.orchestra.run.smithi008.stdout: "type_data": { 2023-08-01T19:55:50.309 INFO:teuthology.orchestra.run.smithi008.stdout: "flag_point": "delayed", 2023-08-01T19:55:50.309 INFO:teuthology.orchestra.run.smithi008.stdout: "client_info": { 2023-08-01T19:55:50.309 INFO:teuthology.orchestra.run.smithi008.stdout: "client": "client.4668", 2023-08-01T19:55:50.309 INFO:teuthology.orchestra.run.smithi008.stdout: "client_addr": "172.21.15.6:0/1709472247", 2023-08-01T19:55:50.309 INFO:teuthology.orchestra.run.smithi008.stdout: "tid": 182348 2023-08-01T19:55:50.309 INFO:teuthology.orchestra.run.smithi008.stdout: }, 2023-08-01T19:55:50.309 INFO:teuthology.orchestra.run.smithi008.stdout: "events": [ 2023-08-01T19:55:50.310 INFO:teuthology.orchestra.run.smithi008.stdout: { 2023-08-01T19:55:50.310 INFO:teuthology.orchestra.run.smithi008.stdout: "event": "initiated", 2023-08-01T19:55:50.310 INFO:teuthology.orchestra.run.smithi008.stdout: "time": "2023-08-01T19:55:50.182593+0000", 2023-08-01T19:55:50.310 INFO:teuthology.orchestra.run.smithi008.stdout: "duration": 0 2023-08-01T19:55:50.310 INFO:teuthology.orchestra.run.smithi008.stdout: }, 2023-08-01T19:55:50.310 INFO:teuthology.orchestra.run.smithi008.stdout: { 2023-08-01T19:55:50.310 INFO:teuthology.orchestra.run.smithi008.stdout: "event": "throttled", 2023-08-01T19:55:50.310 INFO:teuthology.orchestra.run.smithi008.stdout: "time": "2023-08-01T19:55:50.182593+0000", 2023-08-01T19:55:50.311 INFO:teuthology.orchestra.run.smithi008.stdout: "duration": 0 2023-08-01T19:55:50.311 INFO:teuthology.orchestra.run.smithi008.stdout: }, 2023-08-01T19:55:50.311 INFO:teuthology.orchestra.run.smithi008.stdout: { 2023-08-01T19:55:50.311 INFO:teuthology.orchestra.run.smithi008.stdout: "event": "header_read", 2023-08-01T19:55:50.311 INFO:teuthology.orchestra.run.smithi008.stdout: "time": "2023-08-01T19:55:50.182592+0000", 2023-08-01T19:55:50.311 INFO:teuthology.orchestra.run.smithi008.stdout: "duration": 4294967295.9999995 2023-08-01T19:55:50.311 INFO:teuthology.orchestra.run.smithi008.stdout: }, 2023-08-01T19:55:50.312 INFO:teuthology.orchestra.run.smithi008.stdout: { 2023-08-01T19:55:50.312 INFO:teuthology.orchestra.run.smithi008.stdout: "event": "all_read", 2023-08-01T19:55:50.312 INFO:teuthology.orchestra.run.smithi008.stdout: "time": "2023-08-01T19:55:50.182596+0000", 2023-08-01T19:55:50.312 INFO:teuthology.orchestra.run.smithi008.stdout: "duration": 3.9419999999999997e-06 2023-08-01T19:55:50.312 INFO:teuthology.orchestra.run.smithi008.stdout: }, 2023-08-01T19:55:50.312 INFO:teuthology.orchestra.run.smithi008.stdout: { 2023-08-01T19:55:50.312 INFO:teuthology.orchestra.run.smithi008.stdout: "event": "dispatched", 2023-08-01T19:55:50.313 INFO:teuthology.orchestra.run.smithi008.stdout: "time": "2023-08-01T19:55:50.182605+0000", 2023-08-01T19:55:50.313 INFO:teuthology.orchestra.run.smithi008.stdout: "duration": 8.585e-06 2023-08-01T19:55:50.313 INFO:teuthology.orchestra.run.smithi008.stdout: }, 2023-08-01T19:55:50.313 INFO:teuthology.orchestra.run.smithi008.stdout: { 2023-08-01T19:55:50.313 INFO:teuthology.orchestra.run.smithi008.stdout: "event": "queued_for_pg", 2023-08-01T19:55:50.313 INFO:teuthology.orchestra.run.smithi008.stdout: "time": "2023-08-01T19:55:50.182608+0000", 2023-08-01T19:55:50.313 INFO:teuthology.orchestra.run.smithi008.stdout: "duration": 3.856e-06 2023-08-01T19:55:50.313 INFO:teuthology.orchestra.run.smithi008.stdout: }, 2023-08-01T19:55:50.314 INFO:teuthology.orchestra.run.smithi008.stdout: { 2023-08-01T19:55:50.314 INFO:teuthology.orchestra.run.smithi008.stdout: "event": "reached_pg", 2023-08-01T19:55:50.314 INFO:teuthology.orchestra.run.smithi008.stdout: "time": "2023-08-01T19:55:50.182642+0000", 2023-08-01T19:55:50.314 INFO:teuthology.orchestra.run.smithi008.stdout: "duration": 3.3754999999999998e-05 2023-08-01T19:55:50.314 INFO:teuthology.orchestra.run.smithi008.stdout: }, 2023-08-01T19:55:50.314 INFO:teuthology.orchestra.run.smithi008.stdout: { 2023-08-01T19:55:50.314 INFO:teuthology.orchestra.run.smithi008.stdout: "event": "waiting for peered", 2023-08-01T19:55:50.314 INFO:teuthology.orchestra.run.smithi008.stdout: "time": "2023-08-01T19:55:50.182648+0000", 2023-08-01T19:55:50.315 INFO:teuthology.orchestra.run.smithi008.stdout: "duration": 5.5929999999999996e-06 2023-08-01T19:55:50.315 INFO:teuthology.orchestra.run.smithi008.stdout: } 2023-08-01T19:55:50.315 INFO:teuthology.orchestra.run.smithi008.stdout: ] 2023-08-01T19:55:50.315 INFO:teuthology.orchestra.run.smithi008.stdout: } 2023-08-01T19:55:50.315 INFO:teuthology.orchestra.run.smithi008.stdout: }, 2023-08-01T19:55:50.315 INFO:teuthology.orchestra.run.smithi008.stdout: { 2023-08-01T19:55:50.315 INFO:teuthology.orchestra.run.smithi008.stdout: "description": "osd_op(client.4668.0:182350 5.5 5.72f43b15 (undecoded) ondisk+write+known_if_redirected+supports_pool_eio e57)", 2023-08-01T19:55:50.315 INFO:teuthology.orchestra.run.smithi008.stdout: "initiated_at": "2023-08-01T19:55:50.184429+0000", 2023-08-01T19:55:50.316 INFO:teuthology.orchestra.run.smithi008.stdout: "age": 0.046287412999999999, 2023-08-01T19:55:50.316 INFO:teuthology.orchestra.run.smithi008.stdout: "duration": 0.046571209000000002, 2023-08-01T19:55:50.316 INFO:teuthology.orchestra.run.smithi008.stdout: "type_data": { 2023-08-01T19:55:50.316 INFO:teuthology.orchestra.run.smithi008.stdout: "flag_point": "delayed", 2023-08-01T19:55:50.316 INFO:teuthology.orchestra.run.smithi008.stdout: "client_info": { 2023-08-01T19:55:50.316 INFO:teuthology.orchestra.run.smithi008.stdout: "client": "client.4668", 2023-08-01T19:55:50.316 INFO:teuthology.orchestra.run.smithi008.stdout: "client_addr": "172.21.15.6:0/1709472247", 2023-08-01T19:55:50.317 INFO:teuthology.orchestra.run.smithi008.stdout: "tid": 182350 2023-08-01T19:55:50.317 INFO:teuthology.orchestra.run.smithi008.stdout: }, 2023-08-01T19:55:50.317 INFO:teuthology.orchestra.run.smithi008.stdout: "events": [ 2023-08-01T19:55:50.317 INFO:teuthology.orchestra.run.smithi008.stdout: { 2023-08-01T19:55:50.317 INFO:teuthology.orchestra.run.smithi008.stdout: "event": "initiated", 2023-08-01T19:55:50.317 INFO:teuthology.orchestra.run.smithi008.stdout: "time": "2023-08-01T19:55:50.184429+0000", 2023-08-01T19:55:50.317 INFO:teuthology.orchestra.run.smithi008.stdout: "duration": 0 2023-08-01T19:55:50.317 INFO:teuthology.orchestra.run.smithi008.stdout: }, 2023-08-01T19:55:50.318 INFO:teuthology.orchestra.run.smithi008.stdout: { 2023-08-01T19:55:50.318 INFO:teuthology.orchestra.run.smithi008.stdout: "event": "throttled", 2023-08-01T19:55:50.318 INFO:teuthology.orchestra.run.smithi008.stdout: "time": "2023-08-01T19:55:50.184429+0000", 2023-08-01T19:55:50.318 INFO:teuthology.orchestra.run.smithi008.stdout: "duration": 0 2023-08-01T19:55:50.318 INFO:teuthology.orchestra.run.smithi008.stdout: }, 2023-08-01T19:55:50.318 INFO:teuthology.orchestra.run.smithi008.stdout: { 2023-08-01T19:55:50.318 INFO:teuthology.orchestra.run.smithi008.stdout: "event": "header_read", 2023-08-01T19:55:50.318 INFO:teuthology.orchestra.run.smithi008.stdout: "time": "2023-08-01T19:55:50.184429+0000", 2023-08-01T19:55:50.319 INFO:teuthology.orchestra.run.smithi008.stdout: "duration": 4294967295.9999995 2023-08-01T19:55:50.319 INFO:teuthology.orchestra.run.smithi008.stdout: }, 2023-08-01T19:55:50.319 INFO:teuthology.orchestra.run.smithi008.stdout: { 2023-08-01T19:55:50.319 INFO:teuthology.orchestra.run.smithi008.stdout: "event": "all_read", 2023-08-01T19:55:50.319 INFO:teuthology.orchestra.run.smithi008.stdout: "time": "2023-08-01T19:55:50.184433+0000", 2023-08-01T19:55:50.319 INFO:teuthology.orchestra.run.smithi008.stdout: "duration": 4.07e-06 2023-08-01T19:55:50.319 INFO:teuthology.orchestra.run.smithi008.stdout: }, 2023-08-01T19:55:50.319 INFO:teuthology.orchestra.run.smithi008.stdout: { 2023-08-01T19:55:50.320 INFO:teuthology.orchestra.run.smithi008.stdout: "event": "dispatched", 2023-08-01T19:55:50.320 INFO:teuthology.orchestra.run.smithi008.stdout: "time": "2023-08-01T19:55:50.184441+0000", 2023-08-01T19:55:50.320 INFO:teuthology.orchestra.run.smithi008.stdout: "duration": 8.8300000000000002e-06 2023-08-01T19:55:50.320 INFO:teuthology.orchestra.run.smithi008.stdout: }, 2023-08-01T19:55:50.320 INFO:teuthology.orchestra.run.smithi008.stdout: { 2023-08-01T19:55:50.320 INFO:teuthology.orchestra.run.smithi008.stdout: "event": "queued_for_pg", 2023-08-01T19:55:50.320 INFO:teuthology.orchestra.run.smithi008.stdout: "time": "2023-08-01T19:55:50.184446+0000", 2023-08-01T19:55:50.321 INFO:teuthology.orchestra.run.smithi008.stdout: "duration": 4.0849999999999999e-06 2023-08-01T19:55:50.321 INFO:teuthology.orchestra.run.smithi008.stdout: }, 2023-08-01T19:55:50.321 INFO:teuthology.orchestra.run.smithi008.stdout: { 2023-08-01T19:55:50.321 INFO:teuthology.orchestra.run.smithi008.stdout: "event": "reached_pg", 2023-08-01T19:55:50.321 INFO:teuthology.orchestra.run.smithi008.stdout: "time": "2023-08-01T19:55:50.184475+0000", 2023-08-01T19:55:50.321 INFO:teuthology.orchestra.run.smithi008.stdout: "duration": 2.9105999999999999e-05 2023-08-01T19:55:50.321 INFO:teuthology.orchestra.run.smithi008.stdout: }, 2023-08-01T19:55:50.321 INFO:teuthology.orchestra.run.smithi008.stdout: { 2023-08-01T19:55:50.322 INFO:teuthology.orchestra.run.smithi008.stdout: "event": "waiting for peered", 2023-08-01T19:55:50.322 INFO:teuthology.orchestra.run.smithi008.stdout: "time": "2023-08-01T19:55:50.184480+0000", 2023-08-01T19:55:50.322 INFO:teuthology.orchestra.run.smithi008.stdout: "duration": 5.3619999999999997e-06 2023-08-01T19:55:50.322 INFO:teuthology.orchestra.run.smithi008.stdout: } 2023-08-01T19:55:50.322 INFO:teuthology.orchestra.run.smithi008.stdout: ] 2023-08-01T19:55:50.322 INFO:teuthology.orchestra.run.smithi008.stdout: } 2023-08-01T19:55:50.322 INFO:teuthology.orchestra.run.smithi008.stdout: }, 2023-08-01T19:55:50.322 INFO:teuthology.orchestra.run.smithi008.stdout: { 2023-08-01T19:55:50.323 INFO:teuthology.orchestra.run.smithi008.stdout: "description": "osd_op(client.4668.0:182249 5.5 5.66190aa5 (undecoded) ondisk+write+known_if_redirected+supports_pool_eio e57)", 2023-08-01T19:55:50.323 INFO:teuthology.orchestra.run.smithi008.stdout: "initiated_at": "2023-08-01T19:55:50.104941+0000", 2023-08-01T19:55:50.323 INFO:teuthology.orchestra.run.smithi008.stdout: "age": 0.12577580199999999, 2023-08-01T19:55:50.323 INFO:teuthology.orchestra.run.smithi008.stdout: "duration": 0.126097452, 2023-08-01T19:55:50.323 INFO:teuthology.orchestra.run.smithi008.stdout: "type_data": { 2023-08-01T19:55:50.323 INFO:teuthology.orchestra.run.smithi008.stdout: "flag_point": "delayed", 2023-08-01T19:55:50.323 INFO:teuthology.orchestra.run.smithi008.stdout: "client_info": { 2023-08-01T19:55:50.323 INFO:teuthology.orchestra.run.smithi008.stdout: "client": "client.4668", 2023-08-01T19:55:50.324 INFO:teuthology.orchestra.run.smithi008.stdout: "client_addr": "172.21.15.6:0/1709472247", 2023-08-01T19:55:50.324 INFO:teuthology.orchestra.run.smithi008.stdout: "tid": 182249 2023-08-01T19:55:50.324 INFO:teuthology.orchestra.run.smithi008.stdout: }, 2023-08-01T19:55:50.324 INFO:teuthology.orchestra.run.smithi008.stdout: "events": [ 2023-08-01T19:55:50.324 INFO:teuthology.orchestra.run.smithi008.stdout: { 2023-08-01T19:55:50.324 INFO:teuthology.orchestra.run.smithi008.stdout: "event": "initiated", 2023-08-01T19:55:50.324 INFO:teuthology.orchestra.run.smithi008.stdout: "time": "2023-08-01T19:55:50.104941+0000", 2023-08-01T19:55:50.325 INFO:teuthology.orchestra.run.smithi008.stdout: "duration": 0 2023-08-01T19:55:50.325 INFO:teuthology.orchestra.run.smithi008.stdout: }, 2023-08-01T19:55:50.325 INFO:teuthology.orchestra.run.smithi008.stdout: { 2023-08-01T19:55:50.325 INFO:teuthology.orchestra.run.smithi008.stdout: "event": "throttled", 2023-08-01T19:55:50.325 INFO:teuthology.orchestra.run.smithi008.stdout: "time": "2023-08-01T19:55:50.104941+0000", 2023-08-01T19:55:50.325 INFO:teuthology.orchestra.run.smithi008.stdout: "duration": 0 2023-08-01T19:55:50.325 INFO:teuthology.orchestra.run.smithi008.stdout: }, 2023-08-01T19:55:50.325 INFO:teuthology.orchestra.run.smithi008.stdout: { 2023-08-01T19:55:50.326 INFO:teuthology.orchestra.run.smithi008.stdout: "event": "header_read", 2023-08-01T19:55:50.326 INFO:teuthology.orchestra.run.smithi008.stdout: "time": "2023-08-01T19:55:50.104940+0000", 2023-08-01T19:55:50.326 INFO:teuthology.orchestra.run.smithi008.stdout: "duration": 4294967295.999999 2023-08-01T19:55:50.326 INFO:teuthology.orchestra.run.smithi008.stdout: }, 2023-08-01T19:55:50.326 INFO:teuthology.orchestra.run.smithi008.stdout: { 2023-08-01T19:55:50.326 INFO:teuthology.orchestra.run.smithi008.stdout: "event": "all_read", 2023-08-01T19:55:50.326 INFO:teuthology.orchestra.run.smithi008.stdout: "time": "2023-08-01T19:55:50.104945+0000", 2023-08-01T19:55:50.326 INFO:teuthology.orchestra.run.smithi008.stdout: "duration": 4.9320000000000004e-06 2023-08-01T19:55:50.327 INFO:teuthology.orchestra.run.smithi008.stdout: }, 2023-08-01T19:55:50.327 INFO:teuthology.orchestra.run.smithi008.stdout: { 2023-08-01T19:55:50.327 INFO:teuthology.orchestra.run.smithi008.stdout: "event": "dispatched", 2023-08-01T19:55:50.327 INFO:teuthology.orchestra.run.smithi008.stdout: "time": "2023-08-01T19:55:50.104954+0000", 2023-08-01T19:55:50.327 INFO:teuthology.orchestra.run.smithi008.stdout: "duration": 9.5980000000000003e-06 2023-08-01T19:55:50.327 INFO:teuthology.orchestra.run.smithi008.stdout: }, 2023-08-01T19:55:50.327 INFO:teuthology.orchestra.run.smithi008.stdout: { 2023-08-01T19:55:50.327 INFO:teuthology.orchestra.run.smithi008.stdout: "event": "queued_for_pg", 2023-08-01T19:55:50.328 INFO:teuthology.orchestra.run.smithi008.stdout: "time": "2023-08-01T19:55:50.104959+0000", 2023-08-01T19:55:50.328 INFO:teuthology.orchestra.run.smithi008.stdout: "duration": 4.5889999999999996e-06 2023-08-01T19:55:50.328 INFO:teuthology.orchestra.run.smithi008.stdout: }, 2023-08-01T19:55:50.328 INFO:teuthology.orchestra.run.smithi008.stdout: { 2023-08-01T19:55:50.328 INFO:teuthology.orchestra.run.smithi008.stdout: "event": "reached_pg", 2023-08-01T19:55:50.328 INFO:teuthology.orchestra.run.smithi008.stdout: "time": "2023-08-01T19:55:50.105005+0000", 2023-08-01T19:55:50.328 INFO:teuthology.orchestra.run.smithi008.stdout: "duration": 4.5513000000000003e-05 2023-08-01T19:55:50.328 INFO:teuthology.orchestra.run.smithi008.stdout: }, 2023-08-01T19:55:50.329 INFO:teuthology.orchestra.run.smithi008.stdout: { 2023-08-01T19:55:50.329 INFO:teuthology.orchestra.run.smithi008.stdout: "event": "op must wait for map", 2023-08-01T19:55:50.329 INFO:teuthology.orchestra.run.smithi008.stdout: "time": "2023-08-01T19:55:50.105013+0000", 2023-08-01T19:55:50.329 INFO:teuthology.orchestra.run.smithi008.stdout: "duration": 8.2670000000000006e-06 2023-08-01T19:55:50.329 INFO:teuthology.orchestra.run.smithi008.stdout: }, 2023-08-01T19:55:50.329 INFO:teuthology.orchestra.run.smithi008.stdout: { 2023-08-01T19:55:50.329 INFO:teuthology.orchestra.run.smithi008.stdout: "event": "reached_pg", 2023-08-01T19:55:50.330 INFO:teuthology.orchestra.run.smithi008.stdout: "time": "2023-08-01T19:55:50.109104+0000", 2023-08-01T19:55:50.330 INFO:teuthology.orchestra.run.smithi008.stdout: "duration": 0.004090794 2023-08-01T19:55:50.330 INFO:teuthology.orchestra.run.smithi008.stdout: }, 2023-08-01T19:55:50.330 INFO:teuthology.orchestra.run.smithi008.stdout: { 2023-08-01T19:55:50.330 INFO:teuthology.orchestra.run.smithi008.stdout: "event": "waiting for peered", 2023-08-01T19:55:50.330 INFO:teuthology.orchestra.run.smithi008.stdout: "time": "2023-08-01T19:55:50.109112+0000", 2023-08-01T19:55:50.330 INFO:teuthology.orchestra.run.smithi008.stdout: "duration": 8.5930000000000006e-06 2023-08-01T19:55:50.330 INFO:teuthology.orchestra.run.smithi008.stdout: } 2023-08-01T19:55:50.331 INFO:teuthology.orchestra.run.smithi008.stdout: ] 2023-08-01T19:55:50.331 INFO:teuthology.orchestra.run.smithi008.stdout: } 2023-08-01T19:55:50.331 INFO:teuthology.orchestra.run.smithi008.stdout: }, 2023-08-01T19:55:50.331 INFO:teuthology.orchestra.run.smithi008.stdout: { 2023-08-01T19:55:50.331 INFO:teuthology.orchestra.run.smithi008.stdout: "description": "osd_op(client.4668.0:182301 5.5 5.77c601c5 (undecoded) ondisk+write+known_if_redirected+supports_pool_eio e57)", 2023-08-01T19:55:50.331 INFO:teuthology.orchestra.run.smithi008.stdout: "initiated_at": "2023-08-01T19:55:50.141821+0000", 2023-08-01T19:55:50.331 INFO:teuthology.orchestra.run.smithi008.stdout: "age": 0.088895736000000003, 2023-08-01T19:55:50.331 INFO:teuthology.orchestra.run.smithi008.stdout: "duration": 0.089260447000000007, 2023-08-01T19:55:50.332 INFO:teuthology.orchestra.run.smithi008.stdout: "type_data": { 2023-08-01T19:55:50.332 INFO:teuthology.orchestra.run.smithi008.stdout: "flag_point": "delayed", 2023-08-01T19:55:50.332 INFO:teuthology.orchestra.run.smithi008.stdout: "client_info": { 2023-08-01T19:55:50.332 INFO:teuthology.orchestra.run.smithi008.stdout: "client": "client.4668", 2023-08-01T19:55:50.332 INFO:teuthology.orchestra.run.smithi008.stdout: "client_addr": "172.21.15.6:0/1709472247", 2023-08-01T19:55:50.332 INFO:teuthology.orchestra.run.smithi008.stdout: "tid": 182301 2023-08-01T19:55:50.332 INFO:teuthology.orchestra.run.smithi008.stdout: }, 2023-08-01T19:55:50.332 INFO:teuthology.orchestra.run.smithi008.stdout: "events": [ 2023-08-01T19:55:50.333 INFO:teuthology.orchestra.run.smithi008.stdout: { 2023-08-01T19:55:50.333 INFO:teuthology.orchestra.run.smithi008.stdout: "event": "initiated", 2023-08-01T19:55:50.333 INFO:teuthology.orchestra.run.smithi008.stdout: "time": "2023-08-01T19:55:50.141821+0000", 2023-08-01T19:55:50.333 INFO:teuthology.orchestra.run.smithi008.stdout: "duration": 0 2023-08-01T19:55:50.333 INFO:teuthology.orchestra.run.smithi008.stdout: }, 2023-08-01T19:55:50.333 INFO:teuthology.orchestra.run.smithi008.stdout: { 2023-08-01T19:55:50.333 INFO:teuthology.orchestra.run.smithi008.stdout: "event": "throttled", 2023-08-01T19:55:50.334 INFO:teuthology.orchestra.run.smithi008.stdout: "time": "2023-08-01T19:55:50.141821+0000", 2023-08-01T19:55:50.334 INFO:teuthology.orchestra.run.smithi008.stdout: "duration": 0 2023-08-01T19:55:50.334 INFO:teuthology.orchestra.run.smithi008.stdout: }, 2023-08-01T19:55:50.334 INFO:teuthology.orchestra.run.smithi008.stdout: { 2023-08-01T19:55:50.334 INFO:teuthology.orchestra.run.smithi008.stdout: "event": "header_read", 2023-08-01T19:55:50.334 INFO:teuthology.orchestra.run.smithi008.stdout: "time": "2023-08-01T19:55:50.141821+0000", 2023-08-01T19:55:50.334 INFO:teuthology.orchestra.run.smithi008.stdout: "duration": 4294967295.9999995 2023-08-01T19:55:50.334 INFO:teuthology.orchestra.run.smithi008.stdout: }, 2023-08-01T19:55:50.335 INFO:teuthology.orchestra.run.smithi008.stdout: { 2023-08-01T19:55:50.335 INFO:teuthology.orchestra.run.smithi008.stdout: "event": "all_read", 2023-08-01T19:55:50.335 INFO:teuthology.orchestra.run.smithi008.stdout: "time": "2023-08-01T19:55:50.141822+0000", 2023-08-01T19:55:50.335 INFO:teuthology.orchestra.run.smithi008.stdout: "duration": 1.728e-06 2023-08-01T19:55:50.335 INFO:teuthology.orchestra.run.smithi008.stdout: }, 2023-08-01T19:55:50.335 INFO:teuthology.orchestra.run.smithi008.stdout: { 2023-08-01T19:55:50.335 INFO:teuthology.orchestra.run.smithi008.stdout: "event": "dispatched", 2023-08-01T19:55:50.336 INFO:teuthology.orchestra.run.smithi008.stdout: "time": "2023-08-01T19:55:50.141826+0000", 2023-08-01T19:55:50.336 INFO:teuthology.orchestra.run.smithi008.stdout: "duration": 3.202e-06 2023-08-01T19:55:50.336 INFO:teuthology.orchestra.run.smithi008.stdout: }, 2023-08-01T19:55:50.336 INFO:teuthology.orchestra.run.smithi008.stdout: { 2023-08-01T19:55:50.336 INFO:teuthology.orchestra.run.smithi008.stdout: "event": "queued_for_pg", 2023-08-01T19:55:50.336 INFO:teuthology.orchestra.run.smithi008.stdout: "time": "2023-08-01T19:55:50.141828+0000", 2023-08-01T19:55:50.336 INFO:teuthology.orchestra.run.smithi008.stdout: "duration": 2.1969999999999999e-06 2023-08-01T19:55:50.337 INFO:teuthology.orchestra.run.smithi008.stdout: }, 2023-08-01T19:55:50.337 INFO:teuthology.orchestra.run.smithi008.stdout: { 2023-08-01T19:55:50.337 INFO:teuthology.orchestra.run.smithi008.stdout: "event": "reached_pg", 2023-08-01T19:55:50.337 INFO:teuthology.orchestra.run.smithi008.stdout: "time": "2023-08-01T19:55:50.141860+0000", 2023-08-01T19:55:50.337 INFO:teuthology.orchestra.run.smithi008.stdout: "duration": 3.2373000000000003e-05 2023-08-01T19:55:50.337 INFO:teuthology.orchestra.run.smithi008.stdout: }, 2023-08-01T19:55:50.338 INFO:teuthology.orchestra.run.smithi008.stdout: { 2023-08-01T19:55:50.338 INFO:teuthology.orchestra.run.smithi008.stdout: "event": "waiting for peered", 2023-08-01T19:55:50.338 INFO:teuthology.orchestra.run.smithi008.stdout: "time": "2023-08-01T19:55:50.141866+0000", 2023-08-01T19:55:50.338 INFO:teuthology.orchestra.run.smithi008.stdout: "duration": 5.8989999999999998e-06 2023-08-01T19:55:50.338 INFO:teuthology.orchestra.run.smithi008.stdout: } 2023-08-01T19:55:50.338 INFO:teuthology.orchestra.run.smithi008.stdout: ] 2023-08-01T19:55:50.338 INFO:teuthology.orchestra.run.smithi008.stdout: } 2023-08-01T19:55:50.339 INFO:teuthology.orchestra.run.smithi008.stdout: }, 2023-08-01T19:55:50.339 INFO:teuthology.orchestra.run.smithi008.stdout: { 2023-08-01T19:55:50.339 INFO:teuthology.orchestra.run.smithi008.stdout: "description": "osd_op(client.4668.0:182326 5.1 5.7a22af1 (undecoded) ondisk+write+known_if_redirected+supports_pool_eio e57)", 2023-08-01T19:55:50.339 INFO:teuthology.orchestra.run.smithi008.stdout: "initiated_at": "2023-08-01T19:55:50.160860+0000", 2023-08-01T19:55:50.339 INFO:teuthology.orchestra.run.smithi008.stdout: "age": 0.069856382999999994, 2023-08-01T19:55:50.339 INFO:teuthology.orchestra.run.smithi008.stdout: "duration": 0.070258137999999998, 2023-08-01T19:55:50.339 INFO:teuthology.orchestra.run.smithi008.stdout: "type_data": { 2023-08-01T19:55:50.340 INFO:teuthology.orchestra.run.smithi008.stdout: "flag_point": "delayed", 2023-08-01T19:55:50.340 INFO:teuthology.orchestra.run.smithi008.stdout: "client_info": { 2023-08-01T19:55:50.340 INFO:teuthology.orchestra.run.smithi008.stdout: "client": "client.4668", 2023-08-01T19:55:50.340 INFO:teuthology.orchestra.run.smithi008.stdout: "client_addr": "172.21.15.6:0/1709472247", 2023-08-01T19:55:50.340 INFO:teuthology.orchestra.run.smithi008.stdout: "tid": 182326 2023-08-01T19:55:50.340 INFO:teuthology.orchestra.run.smithi008.stdout: }, 2023-08-01T19:55:50.341 INFO:teuthology.orchestra.run.smithi008.stdout: "events": [ 2023-08-01T19:55:50.341 INFO:teuthology.orchestra.run.smithi008.stdout: { 2023-08-01T19:55:50.341 INFO:teuthology.orchestra.run.smithi008.stdout: "event": "initiated", 2023-08-01T19:55:50.341 INFO:teuthology.orchestra.run.smithi008.stdout: "time": "2023-08-01T19:55:50.160860+0000", 2023-08-01T19:55:50.341 INFO:teuthology.orchestra.run.smithi008.stdout: "duration": 0 2023-08-01T19:55:50.341 INFO:teuthology.orchestra.run.smithi008.stdout: }, 2023-08-01T19:55:50.341 INFO:teuthology.orchestra.run.smithi008.stdout: { 2023-08-01T19:55:50.342 INFO:teuthology.orchestra.run.smithi008.stdout: "event": "throttled", 2023-08-01T19:55:50.342 INFO:teuthology.orchestra.run.smithi008.stdout: "time": "2023-08-01T19:55:50.160860+0000", 2023-08-01T19:55:50.342 INFO:teuthology.orchestra.run.smithi008.stdout: "duration": 0 2023-08-01T19:55:50.342 INFO:teuthology.orchestra.run.smithi008.stdout: }, 2023-08-01T19:55:50.342 INFO:teuthology.orchestra.run.smithi008.stdout: { 2023-08-01T19:55:50.342 INFO:teuthology.orchestra.run.smithi008.stdout: "event": "header_read", 2023-08-01T19:55:50.342 INFO:teuthology.orchestra.run.smithi008.stdout: "time": "2023-08-01T19:55:50.160859+0000", 2023-08-01T19:55:50.342 INFO:teuthology.orchestra.run.smithi008.stdout: "duration": 4294967295.9999995 2023-08-01T19:55:50.343 INFO:teuthology.orchestra.run.smithi008.stdout: }, 2023-08-01T19:55:50.343 INFO:teuthology.orchestra.run.smithi008.stdout: { 2023-08-01T19:55:50.343 INFO:teuthology.orchestra.run.smithi008.stdout: "event": "all_read", 2023-08-01T19:55:50.343 INFO:teuthology.orchestra.run.smithi008.stdout: "time": "2023-08-01T19:55:50.160864+0000", 2023-08-01T19:55:50.343 INFO:teuthology.orchestra.run.smithi008.stdout: "duration": 4.5879999999999999e-06 2023-08-01T19:55:50.343 INFO:teuthology.orchestra.run.smithi008.stdout: }, 2023-08-01T19:55:50.343 INFO:teuthology.orchestra.run.smithi008.stdout: { 2023-08-01T19:55:50.344 INFO:teuthology.orchestra.run.smithi008.stdout: "event": "dispatched", 2023-08-01T19:55:50.344 INFO:teuthology.orchestra.run.smithi008.stdout: "time": "2023-08-01T19:55:50.160873+0000", 2023-08-01T19:55:50.344 INFO:teuthology.orchestra.run.smithi008.stdout: "duration": 9.1630000000000002e-06 2023-08-01T19:55:50.344 INFO:teuthology.orchestra.run.smithi008.stdout: }, 2023-08-01T19:55:50.344 INFO:teuthology.orchestra.run.smithi008.stdout: { 2023-08-01T19:55:50.344 INFO:teuthology.orchestra.run.smithi008.stdout: "event": "queued_for_pg", 2023-08-01T19:55:50.344 INFO:teuthology.orchestra.run.smithi008.stdout: "time": "2023-08-01T19:55:50.160878+0000", 2023-08-01T19:55:50.344 INFO:teuthology.orchestra.run.smithi008.stdout: "duration": 4.2769999999999999e-06 2023-08-01T19:55:50.345 INFO:teuthology.orchestra.run.smithi008.stdout: }, 2023-08-01T19:55:50.345 INFO:teuthology.orchestra.run.smithi008.stdout: { 2023-08-01T19:55:50.345 INFO:teuthology.orchestra.run.smithi008.stdout: "event": "reached_pg", 2023-08-01T19:55:50.345 INFO:teuthology.orchestra.run.smithi008.stdout: "time": "2023-08-01T19:55:50.160927+0000", 2023-08-01T19:55:50.345 INFO:teuthology.orchestra.run.smithi008.stdout: "duration": 4.9497999999999999e-05 2023-08-01T19:55:50.345 INFO:teuthology.orchestra.run.smithi008.stdout: }, 2023-08-01T19:55:50.345 INFO:teuthology.orchestra.run.smithi008.stdout: { 2023-08-01T19:55:50.345 INFO:teuthology.orchestra.run.smithi008.stdout: "event": "waiting for peered", 2023-08-01T19:55:50.346 INFO:teuthology.orchestra.run.smithi008.stdout: "time": "2023-08-01T19:55:50.160936+0000", 2023-08-01T19:55:50.346 INFO:teuthology.orchestra.run.smithi008.stdout: "duration": 9.3810000000000005e-06 2023-08-01T19:55:50.346 INFO:teuthology.orchestra.run.smithi008.stdout: } 2023-08-01T19:55:50.346 INFO:teuthology.orchestra.run.smithi008.stdout: ] 2023-08-01T19:55:50.346 INFO:teuthology.orchestra.run.smithi008.stdout: } 2023-08-01T19:55:50.346 INFO:teuthology.orchestra.run.smithi008.stdout: }, 2023-08-01T19:55:50.346 INFO:teuthology.orchestra.run.smithi008.stdout: { 2023-08-01T19:55:50.346 INFO:teuthology.orchestra.run.smithi008.stdout: "description": "osd_op(client.4668.0:182303 5.1 5.91777741 (undecoded) ondisk+write+known_if_redirected+supports_pool_eio e57)", 2023-08-01T19:55:50.347 INFO:teuthology.orchestra.run.smithi008.stdout: "initiated_at": "2023-08-01T19:55:50.144482+0000", 2023-08-01T19:55:50.347 INFO:teuthology.orchestra.run.smithi008.stdout: "age": 0.086234837999999994, 2023-08-01T19:55:50.347 INFO:teuthology.orchestra.run.smithi008.stdout: "duration": 0.086691463999999996, 2023-08-01T19:55:50.347 INFO:teuthology.orchestra.run.smithi008.stdout: "type_data": { 2023-08-01T19:55:50.347 INFO:teuthology.orchestra.run.smithi008.stdout: "flag_point": "delayed", 2023-08-01T19:55:50.347 INFO:teuthology.orchestra.run.smithi008.stdout: "client_info": { 2023-08-01T19:55:50.347 INFO:teuthology.orchestra.run.smithi008.stdout: "client": "client.4668", 2023-08-01T19:55:50.348 INFO:teuthology.orchestra.run.smithi008.stdout: "client_addr": "172.21.15.6:0/1709472247", 2023-08-01T19:55:50.348 INFO:teuthology.orchestra.run.smithi008.stdout: "tid": 182303 2023-08-01T19:55:50.348 INFO:teuthology.orchestra.run.smithi008.stdout: }, 2023-08-01T19:55:50.348 INFO:teuthology.orchestra.run.smithi008.stdout: "events": [ 2023-08-01T19:55:50.348 INFO:teuthology.orchestra.run.smithi008.stdout: { 2023-08-01T19:55:50.348 INFO:teuthology.orchestra.run.smithi008.stdout: "event": "initiated", 2023-08-01T19:55:50.348 INFO:teuthology.orchestra.run.smithi008.stdout: "time": "2023-08-01T19:55:50.144482+0000", 2023-08-01T19:55:50.348 INFO:teuthology.orchestra.run.smithi008.stdout: "duration": 0 2023-08-01T19:55:50.349 INFO:teuthology.orchestra.run.smithi008.stdout: }, 2023-08-01T19:55:50.349 INFO:teuthology.orchestra.run.smithi008.stdout: { 2023-08-01T19:55:50.349 INFO:teuthology.orchestra.run.smithi008.stdout: "event": "throttled", 2023-08-01T19:55:50.349 INFO:teuthology.orchestra.run.smithi008.stdout: "time": "2023-08-01T19:55:50.144482+0000", 2023-08-01T19:55:50.349 INFO:teuthology.orchestra.run.smithi008.stdout: "duration": 0 2023-08-01T19:55:50.349 INFO:teuthology.orchestra.run.smithi008.stdout: }, 2023-08-01T19:55:50.349 INFO:teuthology.orchestra.run.smithi008.stdout: { 2023-08-01T19:55:50.350 INFO:teuthology.orchestra.run.smithi008.stdout: "event": "header_read", 2023-08-01T19:55:50.350 INFO:teuthology.orchestra.run.smithi008.stdout: "time": "2023-08-01T19:55:50.144481+0000", 2023-08-01T19:55:50.350 INFO:teuthology.orchestra.run.smithi008.stdout: "duration": 4294967295.999999 2023-08-01T19:55:50.350 INFO:teuthology.orchestra.run.smithi008.stdout: }, 2023-08-01T19:55:50.350 INFO:teuthology.orchestra.run.smithi008.stdout: { 2023-08-01T19:55:50.350 INFO:teuthology.orchestra.run.smithi008.stdout: "event": "all_read", 2023-08-01T19:55:50.350 INFO:teuthology.orchestra.run.smithi008.stdout: "time": "2023-08-01T19:55:50.144485+0000", 2023-08-01T19:55:50.350 INFO:teuthology.orchestra.run.smithi008.stdout: "duration": 4.6550000000000003e-06 2023-08-01T19:55:50.351 INFO:teuthology.orchestra.run.smithi008.stdout: }, 2023-08-01T19:55:50.351 INFO:teuthology.orchestra.run.smithi008.stdout: { 2023-08-01T19:55:50.351 INFO:teuthology.orchestra.run.smithi008.stdout: "event": "dispatched", 2023-08-01T19:55:50.351 INFO:teuthology.orchestra.run.smithi008.stdout: "time": "2023-08-01T19:55:50.144495+0000", 2023-08-01T19:55:50.351 INFO:teuthology.orchestra.run.smithi008.stdout: "duration": 9.4029999999999996e-06 2023-08-01T19:55:50.351 INFO:teuthology.orchestra.run.smithi008.stdout: }, 2023-08-01T19:55:50.351 INFO:teuthology.orchestra.run.smithi008.stdout: { 2023-08-01T19:55:50.351 INFO:teuthology.orchestra.run.smithi008.stdout: "event": "queued_for_pg", 2023-08-01T19:55:50.352 INFO:teuthology.orchestra.run.smithi008.stdout: "time": "2023-08-01T19:55:50.144499+0000", 2023-08-01T19:55:50.352 INFO:teuthology.orchestra.run.smithi008.stdout: "duration": 4.2100000000000003e-06 2023-08-01T19:55:50.352 INFO:teuthology.orchestra.run.smithi008.stdout: }, 2023-08-01T19:55:50.352 INFO:teuthology.orchestra.run.smithi008.stdout: { 2023-08-01T19:55:50.352 INFO:teuthology.orchestra.run.smithi008.stdout: "event": "reached_pg", 2023-08-01T19:55:50.352 INFO:teuthology.orchestra.run.smithi008.stdout: "time": "2023-08-01T19:55:50.144540+0000", 2023-08-01T19:55:50.352 INFO:teuthology.orchestra.run.smithi008.stdout: "duration": 4.1343e-05 2023-08-01T19:55:50.353 INFO:teuthology.orchestra.run.smithi008.stdout: }, 2023-08-01T19:55:50.353 INFO:teuthology.orchestra.run.smithi008.stdout: { 2023-08-01T19:55:50.353 INFO:teuthology.orchestra.run.smithi008.stdout: "event": "waiting for peered", 2023-08-01T19:55:50.353 INFO:teuthology.orchestra.run.smithi008.stdout: "time": "2023-08-01T19:55:50.144546+0000", 2023-08-01T19:55:50.353 INFO:teuthology.orchestra.run.smithi008.stdout: "duration": 6.0209999999999996e-06 2023-08-01T19:55:50.353 INFO:teuthology.orchestra.run.smithi008.stdout: } 2023-08-01T19:55:50.353 INFO:teuthology.orchestra.run.smithi008.stdout: ] 2023-08-01T19:55:50.353 INFO:teuthology.orchestra.run.smithi008.stdout: } 2023-08-01T19:55:50.354 INFO:teuthology.orchestra.run.smithi008.stdout: }, 2023-08-01T19:55:50.354 INFO:teuthology.orchestra.run.smithi008.stdout: { 2023-08-01T19:55:50.354 INFO:teuthology.orchestra.run.smithi008.stdout: "description": "osd_op(client.4668.0:182357 5.5 5.54093325 (undecoded) ondisk+write+known_if_redirected+supports_pool_eio e57)", 2023-08-01T19:55:50.354 INFO:teuthology.orchestra.run.smithi008.stdout: "initiated_at": "2023-08-01T19:55:50.197928+0000", 2023-08-01T19:55:50.354 INFO:teuthology.orchestra.run.smithi008.stdout: "age": 0.032788110000000002, 2023-08-01T19:55:50.354 INFO:teuthology.orchestra.run.smithi008.stdout: "duration": 0.033320477000000001, 2023-08-01T19:55:50.354 INFO:teuthology.orchestra.run.smithi008.stdout: "type_data": { 2023-08-01T19:55:50.354 INFO:teuthology.orchestra.run.smithi008.stdout: "flag_point": "delayed", 2023-08-01T19:55:50.355 INFO:teuthology.orchestra.run.smithi008.stdout: "client_info": { 2023-08-01T19:55:50.355 INFO:teuthology.orchestra.run.smithi008.stdout: "client": "client.4668", 2023-08-01T19:55:50.355 INFO:teuthology.orchestra.run.smithi008.stdout: "client_addr": "172.21.15.6:0/1709472247", 2023-08-01T19:55:50.355 INFO:teuthology.orchestra.run.smithi008.stdout: "tid": 182357 2023-08-01T19:55:50.355 INFO:teuthology.orchestra.run.smithi008.stdout: }, 2023-08-01T19:55:50.355 INFO:teuthology.orchestra.run.smithi008.stdout: "events": [ 2023-08-01T19:55:50.355 INFO:teuthology.orchestra.run.smithi008.stdout: { 2023-08-01T19:55:50.356 INFO:teuthology.orchestra.run.smithi008.stdout: "event": "initiated", 2023-08-01T19:55:50.356 INFO:teuthology.orchestra.run.smithi008.stdout: "time": "2023-08-01T19:55:50.197928+0000", 2023-08-01T19:55:50.356 INFO:teuthology.orchestra.run.smithi008.stdout: "duration": 0 2023-08-01T19:55:50.356 INFO:teuthology.orchestra.run.smithi008.stdout: }, 2023-08-01T19:55:50.356 INFO:teuthology.orchestra.run.smithi008.stdout: { 2023-08-01T19:55:50.356 INFO:teuthology.orchestra.run.smithi008.stdout: "event": "throttled", 2023-08-01T19:55:50.356 INFO:teuthology.orchestra.run.smithi008.stdout: "time": "2023-08-01T19:55:50.197928+0000", 2023-08-01T19:55:50.356 INFO:teuthology.orchestra.run.smithi008.stdout: "duration": 0 2023-08-01T19:55:50.357 INFO:teuthology.orchestra.run.smithi008.stdout: }, 2023-08-01T19:55:50.357 INFO:teuthology.orchestra.run.smithi008.stdout: { 2023-08-01T19:55:50.357 INFO:teuthology.orchestra.run.smithi008.stdout: "event": "header_read", 2023-08-01T19:55:50.357 INFO:teuthology.orchestra.run.smithi008.stdout: "time": "2023-08-01T19:55:50.197928+0000", 2023-08-01T19:55:50.357 INFO:teuthology.orchestra.run.smithi008.stdout: "duration": 4294967295.999999 2023-08-01T19:55:50.357 INFO:teuthology.orchestra.run.smithi008.stdout: }, 2023-08-01T19:55:50.357 INFO:teuthology.orchestra.run.smithi008.stdout: { 2023-08-01T19:55:50.357 INFO:teuthology.orchestra.run.smithi008.stdout: "event": "all_read", 2023-08-01T19:55:50.358 INFO:teuthology.orchestra.run.smithi008.stdout: "time": "2023-08-01T19:55:50.197932+0000", 2023-08-01T19:55:50.358 INFO:teuthology.orchestra.run.smithi008.stdout: "duration": 4.8670000000000002e-06 2023-08-01T19:55:50.358 INFO:teuthology.orchestra.run.smithi008.stdout: }, 2023-08-01T19:55:50.358 INFO:teuthology.orchestra.run.smithi008.stdout: { 2023-08-01T19:55:50.358 INFO:teuthology.orchestra.run.smithi008.stdout: "event": "dispatched", 2023-08-01T19:55:50.358 INFO:teuthology.orchestra.run.smithi008.stdout: "time": "2023-08-01T19:55:50.197943+0000", 2023-08-01T19:55:50.358 INFO:teuthology.orchestra.run.smithi008.stdout: "duration": 1.096e-05 2023-08-01T19:55:50.359 INFO:teuthology.orchestra.run.smithi008.stdout: }, 2023-08-01T19:55:50.359 INFO:teuthology.orchestra.run.smithi008.stdout: { 2023-08-01T19:55:50.359 INFO:teuthology.orchestra.run.smithi008.stdout: "event": "queued_for_pg", 2023-08-01T19:55:50.359 INFO:teuthology.orchestra.run.smithi008.stdout: "time": "2023-08-01T19:55:50.197949+0000", 2023-08-01T19:55:50.359 INFO:teuthology.orchestra.run.smithi008.stdout: "duration": 5.2630000000000003e-06 2023-08-01T19:55:50.359 INFO:teuthology.orchestra.run.smithi008.stdout: }, 2023-08-01T19:55:50.359 INFO:teuthology.orchestra.run.smithi008.stdout: { 2023-08-01T19:55:50.359 INFO:teuthology.orchestra.run.smithi008.stdout: "event": "reached_pg", 2023-08-01T19:55:50.360 INFO:teuthology.orchestra.run.smithi008.stdout: "time": "2023-08-01T19:55:50.197985+0000", 2023-08-01T19:55:50.360 INFO:teuthology.orchestra.run.smithi008.stdout: "duration": 3.6548999999999999e-05 2023-08-01T19:55:50.360 INFO:teuthology.orchestra.run.smithi008.stdout: }, 2023-08-01T19:55:50.360 INFO:teuthology.orchestra.run.smithi008.stdout: { 2023-08-01T19:55:50.360 INFO:teuthology.orchestra.run.smithi008.stdout: "event": "waiting for peered", 2023-08-01T19:55:50.360 INFO:teuthology.orchestra.run.smithi008.stdout: "time": "2023-08-01T19:55:50.197991+0000", 2023-08-01T19:55:50.360 INFO:teuthology.orchestra.run.smithi008.stdout: "duration": 5.9059999999999999e-06 2023-08-01T19:55:50.361 INFO:teuthology.orchestra.run.smithi008.stdout: } 2023-08-01T19:55:50.361 INFO:teuthology.orchestra.run.smithi008.stdout: ] 2023-08-01T19:55:50.361 INFO:teuthology.orchestra.run.smithi008.stdout: } 2023-08-01T19:55:50.361 INFO:teuthology.orchestra.run.smithi008.stdout: }, 2023-08-01T19:55:50.361 INFO:teuthology.orchestra.run.smithi008.stdout: { 2023-08-01T19:55:50.361 INFO:teuthology.orchestra.run.smithi008.stdout: "description": "osd_op(client.4668.0:182254 5.5 5.2ee11045 (undecoded) ondisk+write+known_if_redirected+supports_pool_eio e57)", 2023-08-01T19:55:50.361 INFO:teuthology.orchestra.run.smithi008.stdout: "initiated_at": "2023-08-01T19:55:50.106909+0000", 2023-08-01T19:55:50.361 INFO:teuthology.orchestra.run.smithi008.stdout: "age": 0.123807191, 2023-08-01T19:55:50.362 INFO:teuthology.orchestra.run.smithi008.stdout: "duration": 0.124411249, 2023-08-01T19:55:50.362 INFO:teuthology.orchestra.run.smithi008.stdout: "type_data": { 2023-08-01T19:55:50.362 INFO:teuthology.orchestra.run.smithi008.stdout: "flag_point": "delayed", 2023-08-01T19:55:50.362 INFO:teuthology.orchestra.run.smithi008.stdout: "client_info": { 2023-08-01T19:55:50.362 INFO:teuthology.orchestra.run.smithi008.stdout: "client": "client.4668", 2023-08-01T19:55:50.362 INFO:teuthology.orchestra.run.smithi008.stdout: "client_addr": "172.21.15.6:0/1709472247", 2023-08-01T19:55:50.362 INFO:teuthology.orchestra.run.smithi008.stdout: "tid": 182254 2023-08-01T19:55:50.362 INFO:teuthology.orchestra.run.smithi008.stdout: }, 2023-08-01T19:55:50.363 INFO:teuthology.orchestra.run.smithi008.stdout: "events": [ 2023-08-01T19:55:50.363 INFO:teuthology.orchestra.run.smithi008.stdout: { 2023-08-01T19:55:50.363 INFO:teuthology.orchestra.run.smithi008.stdout: "event": "initiated", 2023-08-01T19:55:50.363 INFO:teuthology.orchestra.run.smithi008.stdout: "time": "2023-08-01T19:55:50.106909+0000", 2023-08-01T19:55:50.363 INFO:teuthology.orchestra.run.smithi008.stdout: "duration": 0 2023-08-01T19:55:50.363 INFO:teuthology.orchestra.run.smithi008.stdout: }, 2023-08-01T19:55:50.363 INFO:teuthology.orchestra.run.smithi008.stdout: { 2023-08-01T19:55:50.364 INFO:teuthology.orchestra.run.smithi008.stdout: "event": "throttled", 2023-08-01T19:55:50.364 INFO:teuthology.orchestra.run.smithi008.stdout: "time": "2023-08-01T19:55:50.106909+0000", 2023-08-01T19:55:50.364 INFO:teuthology.orchestra.run.smithi008.stdout: "duration": 0 2023-08-01T19:55:50.364 INFO:teuthology.orchestra.run.smithi008.stdout: }, 2023-08-01T19:55:50.364 INFO:teuthology.orchestra.run.smithi008.stdout: { 2023-08-01T19:55:50.364 INFO:teuthology.orchestra.run.smithi008.stdout: "event": "header_read", 2023-08-01T19:55:50.364 INFO:teuthology.orchestra.run.smithi008.stdout: "time": "2023-08-01T19:55:50.106909+0000", 2023-08-01T19:55:50.364 INFO:teuthology.orchestra.run.smithi008.stdout: "duration": 4294967295.999999 2023-08-01T19:55:50.365 INFO:teuthology.orchestra.run.smithi008.stdout: }, 2023-08-01T19:55:50.365 INFO:teuthology.orchestra.run.smithi008.stdout: { 2023-08-01T19:55:50.365 INFO:teuthology.orchestra.run.smithi008.stdout: "event": "all_read", 2023-08-01T19:55:50.365 INFO:teuthology.orchestra.run.smithi008.stdout: "time": "2023-08-01T19:55:50.106914+0000", 2023-08-01T19:55:50.365 INFO:teuthology.orchestra.run.smithi008.stdout: "duration": 5.3489999999999999e-06 2023-08-01T19:55:50.365 INFO:teuthology.orchestra.run.smithi008.stdout: }, 2023-08-01T19:55:50.365 INFO:teuthology.orchestra.run.smithi008.stdout: { 2023-08-01T19:55:50.365 INFO:teuthology.orchestra.run.smithi008.stdout: "event": "dispatched", 2023-08-01T19:55:50.366 INFO:teuthology.orchestra.run.smithi008.stdout: "time": "2023-08-01T19:55:50.106924+0000", 2023-08-01T19:55:50.366 INFO:teuthology.orchestra.run.smithi008.stdout: "duration": 1.0397000000000001e-05 2023-08-01T19:55:50.366 INFO:teuthology.orchestra.run.smithi008.stdout: }, 2023-08-01T19:55:50.366 INFO:teuthology.orchestra.run.smithi008.stdout: { 2023-08-01T19:55:50.366 INFO:teuthology.orchestra.run.smithi008.stdout: "event": "queued_for_pg", 2023-08-01T19:55:50.366 INFO:teuthology.orchestra.run.smithi008.stdout: "time": "2023-08-01T19:55:50.106931+0000", 2023-08-01T19:55:50.366 INFO:teuthology.orchestra.run.smithi008.stdout: "duration": 6.7680000000000003e-06 2023-08-01T19:55:50.366 INFO:teuthology.orchestra.run.smithi008.stdout: }, 2023-08-01T19:55:50.367 INFO:teuthology.orchestra.run.smithi008.stdout: { 2023-08-01T19:55:50.367 INFO:teuthology.orchestra.run.smithi008.stdout: "event": "reached_pg", 2023-08-01T19:55:50.367 INFO:teuthology.orchestra.run.smithi008.stdout: "time": "2023-08-01T19:55:50.109556+0000", 2023-08-01T19:55:50.367 INFO:teuthology.orchestra.run.smithi008.stdout: "duration": 0.0026246939999999999 2023-08-01T19:55:50.367 INFO:teuthology.orchestra.run.smithi008.stdout: }, 2023-08-01T19:55:50.367 INFO:teuthology.orchestra.run.smithi008.stdout: { 2023-08-01T19:55:50.367 INFO:teuthology.orchestra.run.smithi008.stdout: "event": "waiting for peered", 2023-08-01T19:55:50.367 INFO:teuthology.orchestra.run.smithi008.stdout: "time": "2023-08-01T19:55:50.109564+0000", 2023-08-01T19:55:50.368 INFO:teuthology.orchestra.run.smithi008.stdout: "duration": 7.9140000000000008e-06 2023-08-01T19:55:50.368 INFO:teuthology.orchestra.run.smithi008.stdout: } 2023-08-01T19:55:50.368 INFO:teuthology.orchestra.run.smithi008.stdout: ] 2023-08-01T19:55:50.368 INFO:teuthology.orchestra.run.smithi008.stdout: } 2023-08-01T19:55:50.368 INFO:teuthology.orchestra.run.smithi008.stdout: }, 2023-08-01T19:55:50.368 INFO:teuthology.orchestra.run.smithi008.stdout: { 2023-08-01T19:55:50.368 INFO:teuthology.orchestra.run.smithi008.stdout: "description": "osd_op(client.4668.0:182278 5.5 5.f0f3e1f5 (undecoded) ondisk+write+known_if_redirected+supports_pool_eio e57)", 2023-08-01T19:55:50.369 INFO:teuthology.orchestra.run.smithi008.stdout: "initiated_at": "2023-08-01T19:55:50.129964+0000", 2023-08-01T19:55:50.369 INFO:teuthology.orchestra.run.smithi008.stdout: "age": 0.100752391, 2023-08-01T19:55:50.369 INFO:teuthology.orchestra.run.smithi008.stdout: "duration": 0.101437659, 2023-08-01T19:55:50.369 INFO:teuthology.orchestra.run.smithi008.stdout: "type_data": { 2023-08-01T19:55:50.369 INFO:teuthology.orchestra.run.smithi008.stdout: "flag_point": "delayed", 2023-08-01T19:55:50.369 INFO:teuthology.orchestra.run.smithi008.stdout: "client_info": { 2023-08-01T19:55:50.369 INFO:teuthology.orchestra.run.smithi008.stdout: "client": "client.4668", 2023-08-01T19:55:50.369 INFO:teuthology.orchestra.run.smithi008.stdout: "client_addr": "172.21.15.6:0/1709472247", 2023-08-01T19:55:50.370 INFO:teuthology.orchestra.run.smithi008.stdout: "tid": 182278 2023-08-01T19:55:50.370 INFO:teuthology.orchestra.run.smithi008.stdout: }, 2023-08-01T19:55:50.370 INFO:teuthology.orchestra.run.smithi008.stdout: "events": [ 2023-08-01T19:55:50.370 INFO:teuthology.orchestra.run.smithi008.stdout: { 2023-08-01T19:55:50.370 INFO:teuthology.orchestra.run.smithi008.stdout: "event": "initiated", 2023-08-01T19:55:50.370 INFO:teuthology.orchestra.run.smithi008.stdout: "time": "2023-08-01T19:55:50.129964+0000", 2023-08-01T19:55:50.370 INFO:teuthology.orchestra.run.smithi008.stdout: "duration": 0 2023-08-01T19:55:50.370 INFO:teuthology.orchestra.run.smithi008.stdout: }, 2023-08-01T19:55:50.371 INFO:teuthology.orchestra.run.smithi008.stdout: { 2023-08-01T19:55:50.371 INFO:teuthology.orchestra.run.smithi008.stdout: "event": "throttled", 2023-08-01T19:55:50.371 INFO:teuthology.orchestra.run.smithi008.stdout: "time": "2023-08-01T19:55:50.129964+0000", 2023-08-01T19:55:50.371 INFO:teuthology.orchestra.run.smithi008.stdout: "duration": 0 2023-08-01T19:55:50.371 INFO:teuthology.orchestra.run.smithi008.stdout: }, 2023-08-01T19:55:50.371 INFO:teuthology.orchestra.run.smithi008.stdout: { 2023-08-01T19:55:50.371 INFO:teuthology.orchestra.run.smithi008.stdout: "event": "header_read", 2023-08-01T19:55:50.372 INFO:teuthology.orchestra.run.smithi008.stdout: "time": "2023-08-01T19:55:50.129963+0000", 2023-08-01T19:55:50.372 INFO:teuthology.orchestra.run.smithi008.stdout: "duration": 4294967295.999999 2023-08-01T19:55:50.372 INFO:teuthology.orchestra.run.smithi008.stdout: }, 2023-08-01T19:55:50.372 INFO:teuthology.orchestra.run.smithi008.stdout: { 2023-08-01T19:55:50.372 INFO:teuthology.orchestra.run.smithi008.stdout: "event": "all_read", 2023-08-01T19:55:50.372 INFO:teuthology.orchestra.run.smithi008.stdout: "time": "2023-08-01T19:55:50.129968+0000", 2023-08-01T19:55:50.372 INFO:teuthology.orchestra.run.smithi008.stdout: "duration": 5.13e-06 2023-08-01T19:55:50.372 INFO:teuthology.orchestra.run.smithi008.stdout: }, 2023-08-01T19:55:50.373 INFO:teuthology.orchestra.run.smithi008.stdout: { 2023-08-01T19:55:50.373 INFO:teuthology.orchestra.run.smithi008.stdout: "event": "dispatched", 2023-08-01T19:55:50.373 INFO:teuthology.orchestra.run.smithi008.stdout: "time": "2023-08-01T19:55:50.129978+0000", 2023-08-01T19:55:50.373 INFO:teuthology.orchestra.run.smithi008.stdout: "duration": 9.2269999999999999e-06 2023-08-01T19:55:50.373 INFO:teuthology.orchestra.run.smithi008.stdout: }, 2023-08-01T19:55:50.373 INFO:teuthology.orchestra.run.smithi008.stdout: { 2023-08-01T19:55:50.373 INFO:teuthology.orchestra.run.smithi008.stdout: "event": "queued_for_pg", 2023-08-01T19:55:50.373 INFO:teuthology.orchestra.run.smithi008.stdout: "time": "2023-08-01T19:55:50.129982+0000", 2023-08-01T19:55:50.374 INFO:teuthology.orchestra.run.smithi008.stdout: "duration": 4.2189999999999998e-06 2023-08-01T19:55:50.374 INFO:teuthology.orchestra.run.smithi008.stdout: }, 2023-08-01T19:55:50.374 INFO:teuthology.orchestra.run.smithi008.stdout: { 2023-08-01T19:55:50.374 INFO:teuthology.orchestra.run.smithi008.stdout: "event": "reached_pg", 2023-08-01T19:55:50.374 INFO:teuthology.orchestra.run.smithi008.stdout: "time": "2023-08-01T19:55:50.130034+0000", 2023-08-01T19:55:50.374 INFO:teuthology.orchestra.run.smithi008.stdout: "duration": 5.2073000000000001e-05 2023-08-01T19:55:50.374 INFO:teuthology.orchestra.run.smithi008.stdout: }, 2023-08-01T19:55:50.375 INFO:teuthology.orchestra.run.smithi008.stdout: { 2023-08-01T19:55:50.375 INFO:teuthology.orchestra.run.smithi008.stdout: "event": "waiting for peered", 2023-08-01T19:55:50.375 INFO:teuthology.orchestra.run.smithi008.stdout: "time": "2023-08-01T19:55:50.130043+0000", 2023-08-01T19:55:50.375 INFO:teuthology.orchestra.run.smithi008.stdout: "duration": 9.3340000000000008e-06 2023-08-01T19:55:50.375 INFO:teuthology.orchestra.run.smithi008.stdout: } 2023-08-01T19:55:50.375 INFO:teuthology.orchestra.run.smithi008.stdout: ] 2023-08-01T19:55:50.375 INFO:teuthology.orchestra.run.smithi008.stdout: } 2023-08-01T19:55:50.375 INFO:teuthology.orchestra.run.smithi008.stdout: }, 2023-08-01T19:55:50.376 INFO:teuthology.orchestra.run.smithi008.stdout: { 2023-08-01T19:55:50.376 INFO:teuthology.orchestra.run.smithi008.stdout: "description": "osd_op(client.4668.0:182256 5.1 5.1277d301 (undecoded) ondisk+write+known_if_redirected+supports_pool_eio e57)", 2023-08-01T19:55:50.376 INFO:teuthology.orchestra.run.smithi008.stdout: "initiated_at": "2023-08-01T19:55:50.108159+0000", 2023-08-01T19:55:50.376 INFO:teuthology.orchestra.run.smithi008.stdout: "age": 0.12255711800000001, 2023-08-01T19:55:50.376 INFO:teuthology.orchestra.run.smithi008.stdout: "duration": 0.123313771, 2023-08-01T19:55:50.376 INFO:teuthology.orchestra.run.smithi008.stdout: "type_data": { 2023-08-01T19:55:50.376 INFO:teuthology.orchestra.run.smithi008.stdout: "flag_point": "delayed", 2023-08-01T19:55:50.376 INFO:teuthology.orchestra.run.smithi008.stdout: "client_info": { 2023-08-01T19:55:50.377 INFO:teuthology.orchestra.run.smithi008.stdout: "client": "client.4668", 2023-08-01T19:55:50.377 INFO:teuthology.orchestra.run.smithi008.stdout: "client_addr": "172.21.15.6:0/1709472247", 2023-08-01T19:55:50.377 INFO:teuthology.orchestra.run.smithi008.stdout: "tid": 182256 2023-08-01T19:55:50.377 INFO:teuthology.orchestra.run.smithi008.stdout: }, 2023-08-01T19:55:50.377 INFO:teuthology.orchestra.run.smithi008.stdout: "events": [ 2023-08-01T19:55:50.377 INFO:teuthology.orchestra.run.smithi008.stdout: { 2023-08-01T19:55:50.377 INFO:teuthology.orchestra.run.smithi008.stdout: "event": "initiated", 2023-08-01T19:55:50.378 INFO:teuthology.orchestra.run.smithi008.stdout: "time": "2023-08-01T19:55:50.108159+0000", 2023-08-01T19:55:50.378 INFO:teuthology.orchestra.run.smithi008.stdout: "duration": 0 2023-08-01T19:55:50.378 INFO:teuthology.orchestra.run.smithi008.stdout: }, 2023-08-01T19:55:50.378 INFO:teuthology.orchestra.run.smithi008.stdout: { 2023-08-01T19:55:50.378 INFO:teuthology.orchestra.run.smithi008.stdout: "event": "throttled", 2023-08-01T19:55:50.378 INFO:teuthology.orchestra.run.smithi008.stdout: "time": "2023-08-01T19:55:50.108159+0000", 2023-08-01T19:55:50.378 INFO:teuthology.orchestra.run.smithi008.stdout: "duration": 0 2023-08-01T19:55:50.378 INFO:teuthology.orchestra.run.smithi008.stdout: }, 2023-08-01T19:55:50.379 INFO:teuthology.orchestra.run.smithi008.stdout: { 2023-08-01T19:55:50.379 INFO:teuthology.orchestra.run.smithi008.stdout: "event": "header_read", 2023-08-01T19:55:50.379 INFO:teuthology.orchestra.run.smithi008.stdout: "time": "2023-08-01T19:55:50.108159+0000", 2023-08-01T19:55:50.379 INFO:teuthology.orchestra.run.smithi008.stdout: "duration": 4294967295.999999 2023-08-01T19:55:50.379 INFO:teuthology.orchestra.run.smithi008.stdout: }, 2023-08-01T19:55:50.379 INFO:teuthology.orchestra.run.smithi008.stdout: { 2023-08-01T19:55:50.379 INFO:teuthology.orchestra.run.smithi008.stdout: "event": "all_read", 2023-08-01T19:55:50.379 INFO:teuthology.orchestra.run.smithi008.stdout: "time": "2023-08-01T19:55:50.108164+0000", 2023-08-01T19:55:50.380 INFO:teuthology.orchestra.run.smithi008.stdout: "duration": 5.66e-06 2023-08-01T19:55:50.380 INFO:teuthology.orchestra.run.smithi008.stdout: }, 2023-08-01T19:55:50.380 INFO:teuthology.orchestra.run.smithi008.stdout: { 2023-08-01T19:55:50.380 INFO:teuthology.orchestra.run.smithi008.stdout: "event": "dispatched", 2023-08-01T19:55:50.380 INFO:teuthology.orchestra.run.smithi008.stdout: "time": "2023-08-01T19:55:50.108174+0000", 2023-08-01T19:55:50.380 INFO:teuthology.orchestra.run.smithi008.stdout: "duration": 1.01e-05 2023-08-01T19:55:50.380 INFO:teuthology.orchestra.run.smithi008.stdout: }, 2023-08-01T19:55:50.380 INFO:teuthology.orchestra.run.smithi008.stdout: { 2023-08-01T19:55:50.381 INFO:teuthology.orchestra.run.smithi008.stdout: "event": "queued_for_pg", 2023-08-01T19:55:50.381 INFO:teuthology.orchestra.run.smithi008.stdout: "time": "2023-08-01T19:55:50.108181+0000", 2023-08-01T19:55:50.381 INFO:teuthology.orchestra.run.smithi008.stdout: "duration": 7.0040000000000002e-06 2023-08-01T19:55:50.381 INFO:teuthology.orchestra.run.smithi008.stdout: }, 2023-08-01T19:55:50.381 INFO:teuthology.orchestra.run.smithi008.stdout: { 2023-08-01T19:55:50.381 INFO:teuthology.orchestra.run.smithi008.stdout: "event": "reached_pg", 2023-08-01T19:55:50.381 INFO:teuthology.orchestra.run.smithi008.stdout: "time": "2023-08-01T19:55:50.116748+0000", 2023-08-01T19:55:50.382 INFO:teuthology.orchestra.run.smithi008.stdout: "duration": 0.0085662989999999994 2023-08-01T19:55:50.382 INFO:teuthology.orchestra.run.smithi008.stdout: }, 2023-08-01T19:55:50.382 INFO:teuthology.orchestra.run.smithi008.stdout: { 2023-08-01T19:55:50.382 INFO:teuthology.orchestra.run.smithi008.stdout: "event": "waiting for peered", 2023-08-01T19:55:50.382 INFO:teuthology.orchestra.run.smithi008.stdout: "time": "2023-08-01T19:55:50.116757+0000", 2023-08-01T19:55:50.382 INFO:teuthology.orchestra.run.smithi008.stdout: "duration": 8.9320000000000002e-06 2023-08-01T19:55:50.382 INFO:teuthology.orchestra.run.smithi008.stdout: } 2023-08-01T19:55:50.382 INFO:teuthology.orchestra.run.smithi008.stdout: ] 2023-08-01T19:55:50.383 INFO:teuthology.orchestra.run.smithi008.stdout: } 2023-08-01T19:55:50.383 INFO:teuthology.orchestra.run.smithi008.stdout: } 2023-08-01T19:55:50.383 INFO:teuthology.orchestra.run.smithi008.stdout: ], 2023-08-01T19:55:50.383 INFO:teuthology.orchestra.run.smithi008.stdout: "num_ops": 16 2023-08-01T19:55:50.383 INFO:teuthology.orchestra.run.smithi008.stdout:} 2023-08-01T19:55:50.384 DEBUG:teuthology.orchestra.run.smithi008:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 30 ceph --cluster ceph --admin-daemon /var/run/ceph/ceph-osd.0.asok dump_blocked_ops 2023-08-01T19:55:50.385 INFO:tasks.ceph.osd.0.smithi008.stderr:2023-08-01T19:55:50.383+0000 7f16a58f4700 -1 received signal: Hangup from /usr/bin/python3 /bin/daemon-helper kill ceph-osd -f --cluster ceph -i 0 (PID: 111179) UID: 0 2023-08-01T19:55:50.484 INFO:tasks.ceph.osd.0.smithi008.stderr:2023-08-01T19:55:50.483+0000 7f16a58f4700 -1 received signal: Hangup from /usr/bin/python3 /bin/daemon-helper kill ceph-osd -f --cluster ceph -i 0 (PID: 111179) UID: 0 2023-08-01T19:55:50.554 INFO:teuthology.orchestra.run.smithi008.stdout:{ 2023-08-01T19:55:50.554 INFO:teuthology.orchestra.run.smithi008.stdout: "ops": [], 2023-08-01T19:55:50.555 INFO:teuthology.orchestra.run.smithi008.stdout: "complaint_time": 30, 2023-08-01T19:55:50.555 INFO:teuthology.orchestra.run.smithi008.stdout: "num_blocked_ops": 0 2023-08-01T19:55:50.555 INFO:teuthology.orchestra.run.smithi008.stdout:} 2023-08-01T19:55:50.564 DEBUG:teuthology.orchestra.run.smithi008:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 30 ceph --cluster ceph --admin-daemon /var/run/ceph/ceph-osd.0.asok dump_historic_ops 2023-08-01T19:55:50.585 INFO:tasks.ceph.osd.1.smithi101.stderr:2023-08-01T19:55:50.584+0000 7fb0cb7f6700 -1 received signal: Hangup from /usr/bin/python3 /bin/daemon-helper kill ceph-osd -f --cluster ceph -i 1 (PID: 111141) UID: 0 2023-08-01T19:55:50.686 INFO:tasks.ceph.osd.1.smithi101.stderr:2023-08-01T19:55:50.684+0000 7fb0cb7f6700 -1 received signal: Hangup from /usr/bin/python3 /bin/daemon-helper kill ceph-osd -f --cluster ceph -i 1 (PID: 111141) UID: 0 2023-08-01T19:55:50.733 INFO:teuthology.orchestra.run.smithi008.stdout:{ 2023-08-01T19:55:50.733 INFO:teuthology.orchestra.run.smithi008.stdout: "size": 20, 2023-08-01T19:55:50.733 INFO:teuthology.orchestra.run.smithi008.stdout: "duration": 600, 2023-08-01T19:55:50.734 INFO:teuthology.orchestra.run.smithi008.stdout: "ops": [ 2023-08-01T19:55:50.734 INFO:teuthology.orchestra.run.smithi008.stdout: { 2023-08-01T19:55:50.734 INFO:teuthology.orchestra.run.smithi008.stdout: "description": "osd_op(client.4668.0:100240 5.a 5:5313c5b9:::benchmark_data_smithi006_114134_object100239:head [set-alloc-hint object_size 65536 write_size 65536,write 0~65536] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e37)", 2023-08-01T19:55:50.734 INFO:teuthology.orchestra.run.smithi008.stdout: "initiated_at": "2023-08-01T19:55:05.148399+0000", 2023-08-01T19:55:50.734 INFO:teuthology.orchestra.run.smithi008.stdout: "age": 45.582580268999997, 2023-08-01T19:55:50.734 INFO:teuthology.orchestra.run.smithi008.stdout: "duration": 0.077278904999999995, 2023-08-01T19:55:50.734 INFO:teuthology.orchestra.run.smithi008.stdout: "type_data": { 2023-08-01T19:55:50.735 INFO:teuthology.orchestra.run.smithi008.stdout: "flag_point": "commit sent; apply or cleanup", 2023-08-01T19:55:50.735 INFO:teuthology.orchestra.run.smithi008.stdout: "client_info": { 2023-08-01T19:55:50.735 INFO:teuthology.orchestra.run.smithi008.stdout: "client": "client.4668", 2023-08-01T19:55:50.735 INFO:teuthology.orchestra.run.smithi008.stdout: "client_addr": "172.21.15.6:0/1709472247", 2023-08-01T19:55:50.735 INFO:teuthology.orchestra.run.smithi008.stdout: "tid": 100240 2023-08-01T19:55:50.735 INFO:teuthology.orchestra.run.smithi008.stdout: }, 2023-08-01T19:55:50.735 INFO:teuthology.orchestra.run.smithi008.stdout: "events": [ 2023-08-01T19:55:50.735 INFO:teuthology.orchestra.run.smithi008.stdout: { 2023-08-01T19:55:50.736 INFO:teuthology.orchestra.run.smithi008.stdout: "event": "initiated", 2023-08-01T19:55:50.736 INFO:teuthology.orchestra.run.smithi008.stdout: "time": "2023-08-01T19:55:05.148399+0000", 2023-08-01T19:55:50.736 INFO:teuthology.orchestra.run.smithi008.stdout: "duration": 0 2023-08-01T19:55:50.736 INFO:teuthology.orchestra.run.smithi008.stdout: }, 2023-08-01T19:55:50.736 INFO:teuthology.orchestra.run.smithi008.stdout: { 2023-08-01T19:55:50.736 INFO:teuthology.orchestra.run.smithi008.stdout: "event": "throttled", 2023-08-01T19:55:50.736 INFO:teuthology.orchestra.run.smithi008.stdout: "time": "2023-08-01T19:55:05.148399+0000", 2023-08-01T19:55:50.737 INFO:teuthology.orchestra.run.smithi008.stdout: "duration": 0 2023-08-01T19:55:50.737 INFO:teuthology.orchestra.run.smithi008.stdout: }, 2023-08-01T19:55:50.737 INFO:teuthology.orchestra.run.smithi008.stdout: { 2023-08-01T19:55:50.737 INFO:teuthology.orchestra.run.smithi008.stdout: "event": "header_read", 2023-08-01T19:55:50.737 INFO:teuthology.orchestra.run.smithi008.stdout: "time": "2023-08-01T19:55:05.148398+0000", 2023-08-01T19:55:50.737 INFO:teuthology.orchestra.run.smithi008.stdout: "duration": 4294967295.999999 2023-08-01T19:55:50.737 INFO:teuthology.orchestra.run.smithi008.stdout: }, 2023-08-01T19:55:50.737 INFO:teuthology.orchestra.run.smithi008.stdout: { 2023-08-01T19:55:50.738 INFO:teuthology.orchestra.run.smithi008.stdout: "event": "all_read", 2023-08-01T19:55:50.738 INFO:teuthology.orchestra.run.smithi008.stdout: "time": "2023-08-01T19:55:05.148492+0000", 2023-08-01T19:55:50.738 INFO:teuthology.orchestra.run.smithi008.stdout: "duration": 9.3892000000000002e-05 2023-08-01T19:55:50.738 INFO:teuthology.orchestra.run.smithi008.stdout: }, 2023-08-01T19:55:50.738 INFO:teuthology.orchestra.run.smithi008.stdout: { 2023-08-01T19:55:50.738 INFO:teuthology.orchestra.run.smithi008.stdout: "event": "dispatched", 2023-08-01T19:55:50.738 INFO:teuthology.orchestra.run.smithi008.stdout: "time": "2023-08-01T19:55:05.148503+0000", 2023-08-01T19:55:50.738 INFO:teuthology.orchestra.run.smithi008.stdout: "duration": 1.0951000000000001e-05 2023-08-01T19:55:50.739 INFO:teuthology.orchestra.run.smithi008.stdout: }, 2023-08-01T19:55:50.739 INFO:teuthology.orchestra.run.smithi008.stdout: { 2023-08-01T19:55:50.739 INFO:teuthology.orchestra.run.smithi008.stdout: "event": "queued_for_pg", 2023-08-01T19:55:50.739 INFO:teuthology.orchestra.run.smithi008.stdout: "time": "2023-08-01T19:55:05.148508+0000", 2023-08-01T19:55:50.739 INFO:teuthology.orchestra.run.smithi008.stdout: "duration": 5.0080000000000002e-06 2023-08-01T19:55:50.739 INFO:teuthology.orchestra.run.smithi008.stdout: }, 2023-08-01T19:55:50.739 INFO:teuthology.orchestra.run.smithi008.stdout: { 2023-08-01T19:55:50.739 INFO:teuthology.orchestra.run.smithi008.stdout: "event": "reached_pg", 2023-08-01T19:55:50.740 INFO:teuthology.orchestra.run.smithi008.stdout: "time": "2023-08-01T19:55:05.148548+0000", 2023-08-01T19:55:50.740 INFO:teuthology.orchestra.run.smithi008.stdout: "duration": 4.0358999999999998e-05 2023-08-01T19:55:50.740 INFO:teuthology.orchestra.run.smithi008.stdout: }, 2023-08-01T19:55:50.740 INFO:teuthology.orchestra.run.smithi008.stdout: { 2023-08-01T19:55:50.740 INFO:teuthology.orchestra.run.smithi008.stdout: "event": "started", 2023-08-01T19:55:50.740 INFO:teuthology.orchestra.run.smithi008.stdout: "time": "2023-08-01T19:55:05.148666+0000", 2023-08-01T19:55:50.740 INFO:teuthology.orchestra.run.smithi008.stdout: "duration": 0.000117621 2023-08-01T19:55:50.741 INFO:teuthology.orchestra.run.smithi008.stdout: }, 2023-08-01T19:55:50.741 INFO:teuthology.orchestra.run.smithi008.stdout: { 2023-08-01T19:55:50.741 INFO:teuthology.orchestra.run.smithi008.stdout: "event": "waiting for subops from 2", 2023-08-01T19:55:50.741 INFO:teuthology.orchestra.run.smithi008.stdout: "time": "2023-08-01T19:55:05.148805+0000", 2023-08-01T19:55:50.741 INFO:teuthology.orchestra.run.smithi008.stdout: "duration": 0.000139176 2023-08-01T19:55:50.741 INFO:teuthology.orchestra.run.smithi008.stdout: }, 2023-08-01T19:55:50.741 INFO:teuthology.orchestra.run.smithi008.stdout: { 2023-08-01T19:55:50.741 INFO:teuthology.orchestra.run.smithi008.stdout: "event": "op_commit", 2023-08-01T19:55:50.742 INFO:teuthology.orchestra.run.smithi008.stdout: "time": "2023-08-01T19:55:05.156143+0000", 2023-08-01T19:55:50.742 INFO:teuthology.orchestra.run.smithi008.stdout: "duration": 0.007338041 2023-08-01T19:55:50.742 INFO:teuthology.orchestra.run.smithi008.stdout: }, 2023-08-01T19:55:50.742 INFO:teuthology.orchestra.run.smithi008.stdout: { 2023-08-01T19:55:50.742 INFO:teuthology.orchestra.run.smithi008.stdout: "event": "sub_op_commit_rec", 2023-08-01T19:55:50.742 INFO:teuthology.orchestra.run.smithi008.stdout: "time": "2023-08-01T19:55:05.225581+0000", 2023-08-01T19:55:50.742 INFO:teuthology.orchestra.run.smithi008.stdout: "duration": 0.069438402999999996 2023-08-01T19:55:50.742 INFO:teuthology.orchestra.run.smithi008.stdout: }, 2023-08-01T19:55:50.743 INFO:teuthology.orchestra.run.smithi008.stdout: { 2023-08-01T19:55:50.743 INFO:teuthology.orchestra.run.smithi008.stdout: "event": "commit_sent", 2023-08-01T19:55:50.743 INFO:teuthology.orchestra.run.smithi008.stdout: "time": "2023-08-01T19:55:05.225632+0000", 2023-08-01T19:55:50.743 INFO:teuthology.orchestra.run.smithi008.stdout: "duration": 5.0382e-05 2023-08-01T19:55:50.743 INFO:teuthology.orchestra.run.smithi008.stdout: }, 2023-08-01T19:55:50.743 INFO:teuthology.orchestra.run.smithi008.stdout: { 2023-08-01T19:55:50.743 INFO:teuthology.orchestra.run.smithi008.stdout: "event": "done", 2023-08-01T19:55:50.743 INFO:teuthology.orchestra.run.smithi008.stdout: "time": "2023-08-01T19:55:05.225677+0000", 2023-08-01T19:55:50.744 INFO:teuthology.orchestra.run.smithi008.stdout: "duration": 4.5893000000000003e-05 2023-08-01T19:55:50.744 INFO:teuthology.orchestra.run.smithi008.stdout: } 2023-08-01T19:55:50.744 INFO:teuthology.orchestra.run.smithi008.stdout: ] 2023-08-01T19:55:50.744 INFO:teuthology.orchestra.run.smithi008.stdout: } 2023-08-01T19:55:50.744 INFO:teuthology.orchestra.run.smithi008.stdout: }, 2023-08-01T19:55:50.744 INFO:teuthology.orchestra.run.smithi008.stdout: { 2023-08-01T19:55:50.744 INFO:teuthology.orchestra.run.smithi008.stdout: "description": "osd_op(client.4668.0:100243 5.a 5:5e8193b6:::benchmark_data_smithi006_114134_object100242:head [set-alloc-hint object_size 65536 write_size 65536,write 0~65536] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e37)", 2023-08-01T19:55:50.744 INFO:teuthology.orchestra.run.smithi008.stdout: "initiated_at": "2023-08-01T19:55:05.150737+0000", 2023-08-01T19:55:50.745 INFO:teuthology.orchestra.run.smithi008.stdout: "age": 45.580241813999997, 2023-08-01T19:55:50.745 INFO:teuthology.orchestra.run.smithi008.stdout: "duration": 0.075019885999999994, 2023-08-01T19:55:50.745 INFO:teuthology.orchestra.run.smithi008.stdout: "type_data": { 2023-08-01T19:55:50.745 INFO:teuthology.orchestra.run.smithi008.stdout: "flag_point": "commit sent; apply or cleanup", 2023-08-01T19:55:50.745 INFO:teuthology.orchestra.run.smithi008.stdout: "client_info": { 2023-08-01T19:55:50.745 INFO:teuthology.orchestra.run.smithi008.stdout: "client": "client.4668", 2023-08-01T19:55:50.745 INFO:teuthology.orchestra.run.smithi008.stdout: "client_addr": "172.21.15.6:0/1709472247", 2023-08-01T19:55:50.746 INFO:teuthology.orchestra.run.smithi008.stdout: "tid": 100243 2023-08-01T19:55:50.746 INFO:teuthology.orchestra.run.smithi008.stdout: }, 2023-08-01T19:55:50.746 INFO:teuthology.orchestra.run.smithi008.stdout: "events": [ 2023-08-01T19:55:50.746 INFO:teuthology.orchestra.run.smithi008.stdout: { 2023-08-01T19:55:50.746 INFO:teuthology.orchestra.run.smithi008.stdout: "event": "initiated", 2023-08-01T19:55:50.746 INFO:teuthology.orchestra.run.smithi008.stdout: "time": "2023-08-01T19:55:05.150737+0000", 2023-08-01T19:55:50.746 INFO:teuthology.orchestra.run.smithi008.stdout: "duration": 0 2023-08-01T19:55:50.746 INFO:teuthology.orchestra.run.smithi008.stdout: }, 2023-08-01T19:55:50.747 INFO:teuthology.orchestra.run.smithi008.stdout: { 2023-08-01T19:55:50.747 INFO:teuthology.orchestra.run.smithi008.stdout: "event": "throttled", 2023-08-01T19:55:50.747 INFO:teuthology.orchestra.run.smithi008.stdout: "time": "2023-08-01T19:55:05.150737+0000", 2023-08-01T19:55:50.747 INFO:teuthology.orchestra.run.smithi008.stdout: "duration": 0 2023-08-01T19:55:50.747 INFO:teuthology.orchestra.run.smithi008.stdout: }, 2023-08-01T19:55:50.747 INFO:teuthology.orchestra.run.smithi008.stdout: { 2023-08-01T19:55:50.747 INFO:teuthology.orchestra.run.smithi008.stdout: "event": "header_read", 2023-08-01T19:55:50.747 INFO:teuthology.orchestra.run.smithi008.stdout: "time": "2023-08-01T19:55:05.150736+0000", 2023-08-01T19:55:50.748 INFO:teuthology.orchestra.run.smithi008.stdout: "duration": 4294967295.999999 2023-08-01T19:55:50.748 INFO:teuthology.orchestra.run.smithi008.stdout: }, 2023-08-01T19:55:50.748 INFO:teuthology.orchestra.run.smithi008.stdout: { 2023-08-01T19:55:50.748 INFO:teuthology.orchestra.run.smithi008.stdout: "event": "all_read", 2023-08-01T19:55:50.748 INFO:teuthology.orchestra.run.smithi008.stdout: "time": "2023-08-01T19:55:05.150780+0000", 2023-08-01T19:55:50.748 INFO:teuthology.orchestra.run.smithi008.stdout: "duration": 4.3578999999999997e-05 2023-08-01T19:55:50.748 INFO:teuthology.orchestra.run.smithi008.stdout: }, 2023-08-01T19:55:50.748 INFO:teuthology.orchestra.run.smithi008.stdout: { 2023-08-01T19:55:50.749 INFO:teuthology.orchestra.run.smithi008.stdout: "event": "dispatched", 2023-08-01T19:55:50.749 INFO:teuthology.orchestra.run.smithi008.stdout: "time": "2023-08-01T19:55:05.150791+0000", 2023-08-01T19:55:50.749 INFO:teuthology.orchestra.run.smithi008.stdout: "duration": 1.0963e-05 2023-08-01T19:55:50.749 INFO:teuthology.orchestra.run.smithi008.stdout: }, 2023-08-01T19:55:50.749 INFO:teuthology.orchestra.run.smithi008.stdout: { 2023-08-01T19:55:50.749 INFO:teuthology.orchestra.run.smithi008.stdout: "event": "queued_for_pg", 2023-08-01T19:55:50.749 INFO:teuthology.orchestra.run.smithi008.stdout: "time": "2023-08-01T19:55:05.150797+0000", 2023-08-01T19:55:50.749 INFO:teuthology.orchestra.run.smithi008.stdout: "duration": 5.9780000000000002e-06 2023-08-01T19:55:50.750 INFO:teuthology.orchestra.run.smithi008.stdout: }, 2023-08-01T19:55:50.750 INFO:teuthology.orchestra.run.smithi008.stdout: { 2023-08-01T19:55:50.750 INFO:teuthology.orchestra.run.smithi008.stdout: "event": "reached_pg", 2023-08-01T19:55:50.750 INFO:teuthology.orchestra.run.smithi008.stdout: "time": "2023-08-01T19:55:05.150833+0000", 2023-08-01T19:55:50.750 INFO:teuthology.orchestra.run.smithi008.stdout: "duration": 3.6000000000000001e-05 2023-08-01T19:55:50.750 INFO:teuthology.orchestra.run.smithi008.stdout: }, 2023-08-01T19:55:50.750 INFO:teuthology.orchestra.run.smithi008.stdout: { 2023-08-01T19:55:50.750 INFO:teuthology.orchestra.run.smithi008.stdout: "event": "started", 2023-08-01T19:55:50.751 INFO:teuthology.orchestra.run.smithi008.stdout: "time": "2023-08-01T19:55:05.150951+0000", 2023-08-01T19:55:50.751 INFO:teuthology.orchestra.run.smithi008.stdout: "duration": 0.00011827799999999999 2023-08-01T19:55:50.751 INFO:teuthology.orchestra.run.smithi008.stdout: }, 2023-08-01T19:55:50.751 INFO:teuthology.orchestra.run.smithi008.stdout: { 2023-08-01T19:55:50.751 INFO:teuthology.orchestra.run.smithi008.stdout: "event": "waiting for subops from 2", 2023-08-01T19:55:50.751 INFO:teuthology.orchestra.run.smithi008.stdout: "time": "2023-08-01T19:55:05.151111+0000", 2023-08-01T19:55:50.751 INFO:teuthology.orchestra.run.smithi008.stdout: "duration": 0.00015961299999999999 2023-08-01T19:55:50.751 INFO:teuthology.orchestra.run.smithi008.stdout: }, 2023-08-01T19:55:50.752 INFO:teuthology.orchestra.run.smithi008.stdout: { 2023-08-01T19:55:50.752 INFO:teuthology.orchestra.run.smithi008.stdout: "event": "op_commit", 2023-08-01T19:55:50.752 INFO:teuthology.orchestra.run.smithi008.stdout: "time": "2023-08-01T19:55:05.156247+0000", 2023-08-01T19:55:50.752 INFO:teuthology.orchestra.run.smithi008.stdout: "duration": 0.005136524 2023-08-01T19:55:50.752 INFO:teuthology.orchestra.run.smithi008.stdout: }, 2023-08-01T19:55:50.752 INFO:teuthology.orchestra.run.smithi008.stdout: { 2023-08-01T19:55:50.752 INFO:teuthology.orchestra.run.smithi008.stdout: "event": "sub_op_commit_rec", 2023-08-01T19:55:50.753 INFO:teuthology.orchestra.run.smithi008.stdout: "time": "2023-08-01T19:55:05.225705+0000", 2023-08-01T19:55:50.753 INFO:teuthology.orchestra.run.smithi008.stdout: "duration": 0.069458377000000002 2023-08-01T19:55:50.753 INFO:teuthology.orchestra.run.smithi008.stdout: }, 2023-08-01T19:55:50.753 INFO:teuthology.orchestra.run.smithi008.stdout: { 2023-08-01T19:55:50.753 INFO:teuthology.orchestra.run.smithi008.stdout: "event": "commit_sent", 2023-08-01T19:55:50.753 INFO:teuthology.orchestra.run.smithi008.stdout: "time": "2023-08-01T19:55:05.225736+0000", 2023-08-01T19:55:50.753 INFO:teuthology.orchestra.run.smithi008.stdout: "duration": 3.0388000000000001e-05 2023-08-01T19:55:50.753 INFO:teuthology.orchestra.run.smithi008.stdout: }, 2023-08-01T19:55:50.754 INFO:teuthology.orchestra.run.smithi008.stdout: { 2023-08-01T19:55:50.754 INFO:teuthology.orchestra.run.smithi008.stdout: "event": "done", 2023-08-01T19:55:50.754 INFO:teuthology.orchestra.run.smithi008.stdout: "time": "2023-08-01T19:55:05.225757+0000", 2023-08-01T19:55:50.754 INFO:teuthology.orchestra.run.smithi008.stdout: "duration": 2.1090999999999998e-05 2023-08-01T19:55:50.754 INFO:teuthology.orchestra.run.smithi008.stdout: } 2023-08-01T19:55:50.754 INFO:teuthology.orchestra.run.smithi008.stdout: ] 2023-08-01T19:55:50.754 INFO:teuthology.orchestra.run.smithi008.stdout: } 2023-08-01T19:55:50.754 INFO:teuthology.orchestra.run.smithi008.stdout: }, 2023-08-01T19:55:50.755 INFO:teuthology.orchestra.run.smithi008.stdout: { 2023-08-01T19:55:50.755 INFO:teuthology.orchestra.run.smithi008.stdout: "description": "osd_op(client.4668.0:100261 5.a 5:562deedb:::benchmark_data_smithi006_114134_object100260:head [set-alloc-hint object_size 65536 write_size 65536,write 0~65536] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e37)", 2023-08-01T19:55:50.755 INFO:teuthology.orchestra.run.smithi008.stdout: "initiated_at": "2023-08-01T19:55:05.163316+0000", 2023-08-01T19:55:50.755 INFO:teuthology.orchestra.run.smithi008.stdout: "age": 45.567662398000003, 2023-08-01T19:55:50.755 INFO:teuthology.orchestra.run.smithi008.stdout: "duration": 0.063073012999999997, 2023-08-01T19:55:50.755 INFO:teuthology.orchestra.run.smithi008.stdout: "type_data": { 2023-08-01T19:55:50.755 INFO:teuthology.orchestra.run.smithi008.stdout: "flag_point": "commit sent; apply or cleanup", 2023-08-01T19:55:50.755 INFO:teuthology.orchestra.run.smithi008.stdout: "client_info": { 2023-08-01T19:55:50.756 INFO:teuthology.orchestra.run.smithi008.stdout: "client": "client.4668", 2023-08-01T19:55:50.756 INFO:teuthology.orchestra.run.smithi008.stdout: "client_addr": "172.21.15.6:0/1709472247", 2023-08-01T19:55:50.756 INFO:teuthology.orchestra.run.smithi008.stdout: "tid": 100261 2023-08-01T19:55:50.756 INFO:teuthology.orchestra.run.smithi008.stdout: }, 2023-08-01T19:55:50.756 INFO:teuthology.orchestra.run.smithi008.stdout: "events": [ 2023-08-01T19:55:50.756 INFO:teuthology.orchestra.run.smithi008.stdout: { 2023-08-01T19:55:50.756 INFO:teuthology.orchestra.run.smithi008.stdout: "event": "initiated", 2023-08-01T19:55:50.757 INFO:teuthology.orchestra.run.smithi008.stdout: "time": "2023-08-01T19:55:05.163316+0000", 2023-08-01T19:55:50.757 INFO:teuthology.orchestra.run.smithi008.stdout: "duration": 0 2023-08-01T19:55:50.757 INFO:teuthology.orchestra.run.smithi008.stdout: }, 2023-08-01T19:55:50.757 INFO:teuthology.orchestra.run.smithi008.stdout: { 2023-08-01T19:55:50.757 INFO:teuthology.orchestra.run.smithi008.stdout: "event": "throttled", 2023-08-01T19:55:50.757 INFO:teuthology.orchestra.run.smithi008.stdout: "time": "2023-08-01T19:55:05.163316+0000", 2023-08-01T19:55:50.757 INFO:teuthology.orchestra.run.smithi008.stdout: "duration": 0 2023-08-01T19:55:50.757 INFO:teuthology.orchestra.run.smithi008.stdout: }, 2023-08-01T19:55:50.758 INFO:teuthology.orchestra.run.smithi008.stdout: { 2023-08-01T19:55:50.758 INFO:teuthology.orchestra.run.smithi008.stdout: "event": "header_read", 2023-08-01T19:55:50.758 INFO:teuthology.orchestra.run.smithi008.stdout: "time": "2023-08-01T19:55:05.163316+0000", 2023-08-01T19:55:50.758 INFO:teuthology.orchestra.run.smithi008.stdout: "duration": 4294967295.999999 2023-08-01T19:55:50.758 INFO:teuthology.orchestra.run.smithi008.stdout: }, 2023-08-01T19:55:50.758 INFO:teuthology.orchestra.run.smithi008.stdout: { 2023-08-01T19:55:50.758 INFO:teuthology.orchestra.run.smithi008.stdout: "event": "all_read", 2023-08-01T19:55:50.758 INFO:teuthology.orchestra.run.smithi008.stdout: "time": "2023-08-01T19:55:05.163380+0000", 2023-08-01T19:55:50.759 INFO:teuthology.orchestra.run.smithi008.stdout: "duration": 6.4395999999999998e-05 2023-08-01T19:55:50.759 INFO:teuthology.orchestra.run.smithi008.stdout: }, 2023-08-01T19:55:50.759 INFO:teuthology.orchestra.run.smithi008.stdout: { 2023-08-01T19:55:50.759 INFO:teuthology.orchestra.run.smithi008.stdout: "event": "dispatched", 2023-08-01T19:55:50.759 INFO:teuthology.orchestra.run.smithi008.stdout: "time": "2023-08-01T19:55:05.163390+0000", 2023-08-01T19:55:50.759 INFO:teuthology.orchestra.run.smithi008.stdout: "duration": 1.0189e-05 2023-08-01T19:55:50.759 INFO:teuthology.orchestra.run.smithi008.stdout: }, 2023-08-01T19:55:50.759 INFO:teuthology.orchestra.run.smithi008.stdout: { 2023-08-01T19:55:50.760 INFO:teuthology.orchestra.run.smithi008.stdout: "event": "queued_for_pg", 2023-08-01T19:55:50.760 INFO:teuthology.orchestra.run.smithi008.stdout: "time": "2023-08-01T19:55:05.163395+0000", 2023-08-01T19:55:50.760 INFO:teuthology.orchestra.run.smithi008.stdout: "duration": 4.4059999999999998e-06 2023-08-01T19:55:50.760 INFO:teuthology.orchestra.run.smithi008.stdout: }, 2023-08-01T19:55:50.760 INFO:teuthology.orchestra.run.smithi008.stdout: { 2023-08-01T19:55:50.760 INFO:teuthology.orchestra.run.smithi008.stdout: "event": "reached_pg", 2023-08-01T19:55:50.760 INFO:teuthology.orchestra.run.smithi008.stdout: "time": "2023-08-01T19:55:05.163429+0000", 2023-08-01T19:55:50.761 INFO:teuthology.orchestra.run.smithi008.stdout: "duration": 3.4900000000000001e-05 2023-08-01T19:55:50.761 INFO:teuthology.orchestra.run.smithi008.stdout: }, 2023-08-01T19:55:50.761 INFO:teuthology.orchestra.run.smithi008.stdout: { 2023-08-01T19:55:50.761 INFO:teuthology.orchestra.run.smithi008.stdout: "event": "started", 2023-08-01T19:55:50.761 INFO:teuthology.orchestra.run.smithi008.stdout: "time": "2023-08-01T19:55:05.163512+0000", 2023-08-01T19:55:50.761 INFO:teuthology.orchestra.run.smithi008.stdout: "duration": 8.2987999999999999e-05 2023-08-01T19:55:50.761 INFO:teuthology.orchestra.run.smithi008.stdout: }, 2023-08-01T19:55:50.761 INFO:teuthology.orchestra.run.smithi008.stdout: { 2023-08-01T19:55:50.762 INFO:teuthology.orchestra.run.smithi008.stdout: "event": "waiting for subops from 2", 2023-08-01T19:55:50.762 INFO:teuthology.orchestra.run.smithi008.stdout: "time": "2023-08-01T19:55:05.163596+0000", 2023-08-01T19:55:50.762 INFO:teuthology.orchestra.run.smithi008.stdout: "duration": 8.3783999999999996e-05 2023-08-01T19:55:50.762 INFO:teuthology.orchestra.run.smithi008.stdout: }, 2023-08-01T19:55:50.762 INFO:teuthology.orchestra.run.smithi008.stdout: { 2023-08-01T19:55:50.762 INFO:teuthology.orchestra.run.smithi008.stdout: "event": "op_commit", 2023-08-01T19:55:50.762 INFO:teuthology.orchestra.run.smithi008.stdout: "time": "2023-08-01T19:55:05.167129+0000", 2023-08-01T19:55:50.762 INFO:teuthology.orchestra.run.smithi008.stdout: "duration": 0.0035328709999999999 2023-08-01T19:55:50.763 INFO:teuthology.orchestra.run.smithi008.stdout: }, 2023-08-01T19:55:50.763 INFO:teuthology.orchestra.run.smithi008.stdout: { 2023-08-01T19:55:50.763 INFO:teuthology.orchestra.run.smithi008.stdout: "event": "sub_op_commit_rec", 2023-08-01T19:55:50.763 INFO:teuthology.orchestra.run.smithi008.stdout: "time": "2023-08-01T19:55:05.226302+0000", 2023-08-01T19:55:50.763 INFO:teuthology.orchestra.run.smithi008.stdout: "duration": 0.059172711000000003 2023-08-01T19:55:50.763 INFO:teuthology.orchestra.run.smithi008.stdout: }, 2023-08-01T19:55:50.763 INFO:teuthology.orchestra.run.smithi008.stdout: { 2023-08-01T19:55:50.763 INFO:teuthology.orchestra.run.smithi008.stdout: "event": "commit_sent", 2023-08-01T19:55:50.764 INFO:teuthology.orchestra.run.smithi008.stdout: "time": "2023-08-01T19:55:05.226351+0000", 2023-08-01T19:55:50.764 INFO:teuthology.orchestra.run.smithi008.stdout: "duration": 4.969e-05 2023-08-01T19:55:50.764 INFO:teuthology.orchestra.run.smithi008.stdout: }, 2023-08-01T19:55:50.764 INFO:teuthology.orchestra.run.smithi008.stdout: { 2023-08-01T19:55:50.764 INFO:teuthology.orchestra.run.smithi008.stdout: "event": "done", 2023-08-01T19:55:50.764 INFO:teuthology.orchestra.run.smithi008.stdout: "time": "2023-08-01T19:55:05.226389+0000", 2023-08-01T19:55:50.764 INFO:teuthology.orchestra.run.smithi008.stdout: "duration": 3.7978000000000001e-05 2023-08-01T19:55:50.764 INFO:teuthology.orchestra.run.smithi008.stdout: } 2023-08-01T19:55:50.765 INFO:teuthology.orchestra.run.smithi008.stdout: ] 2023-08-01T19:55:50.765 INFO:teuthology.orchestra.run.smithi008.stdout: } 2023-08-01T19:55:50.765 INFO:teuthology.orchestra.run.smithi008.stdout: }, 2023-08-01T19:55:50.765 INFO:teuthology.orchestra.run.smithi008.stdout: { 2023-08-01T19:55:50.765 INFO:teuthology.orchestra.run.smithi008.stdout: "description": "osd_op(client.4668.0:100262 5.a 5:5c636b5d:::benchmark_data_smithi006_114134_object100261:head [set-alloc-hint object_size 65536 write_size 65536,write 0~65536] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e37)", 2023-08-01T19:55:50.765 INFO:teuthology.orchestra.run.smithi008.stdout: "initiated_at": "2023-08-01T19:55:05.165068+0000", 2023-08-01T19:55:50.765 INFO:teuthology.orchestra.run.smithi008.stdout: "age": 45.565910744999996, 2023-08-01T19:55:50.765 INFO:teuthology.orchestra.run.smithi008.stdout: "duration": 0.063919403, 2023-08-01T19:55:50.766 INFO:teuthology.orchestra.run.smithi008.stdout: "type_data": { 2023-08-01T19:55:50.766 INFO:teuthology.orchestra.run.smithi008.stdout: "flag_point": "commit sent; apply or cleanup", 2023-08-01T19:55:50.766 INFO:teuthology.orchestra.run.smithi008.stdout: "client_info": { 2023-08-01T19:55:50.766 INFO:teuthology.orchestra.run.smithi008.stdout: "client": "client.4668", 2023-08-01T19:55:50.766 INFO:teuthology.orchestra.run.smithi008.stdout: "client_addr": "172.21.15.6:0/1709472247", 2023-08-01T19:55:50.766 INFO:teuthology.orchestra.run.smithi008.stdout: "tid": 100262 2023-08-01T19:55:50.766 INFO:teuthology.orchestra.run.smithi008.stdout: }, 2023-08-01T19:55:50.767 INFO:teuthology.orchestra.run.smithi008.stdout: "events": [ 2023-08-01T19:55:50.767 INFO:teuthology.orchestra.run.smithi008.stdout: { 2023-08-01T19:55:50.767 INFO:teuthology.orchestra.run.smithi008.stdout: "event": "initiated", 2023-08-01T19:55:50.767 INFO:teuthology.orchestra.run.smithi008.stdout: "time": "2023-08-01T19:55:05.165068+0000", 2023-08-01T19:55:50.767 INFO:teuthology.orchestra.run.smithi008.stdout: "duration": 0 2023-08-01T19:55:50.767 INFO:teuthology.orchestra.run.smithi008.stdout: }, 2023-08-01T19:55:50.767 INFO:teuthology.orchestra.run.smithi008.stdout: { 2023-08-01T19:55:50.767 INFO:teuthology.orchestra.run.smithi008.stdout: "event": "throttled", 2023-08-01T19:55:50.768 INFO:teuthology.orchestra.run.smithi008.stdout: "time": "2023-08-01T19:55:05.165068+0000", 2023-08-01T19:55:50.768 INFO:teuthology.orchestra.run.smithi008.stdout: "duration": 0 2023-08-01T19:55:50.768 INFO:teuthology.orchestra.run.smithi008.stdout: }, 2023-08-01T19:55:50.768 INFO:teuthology.orchestra.run.smithi008.stdout: { 2023-08-01T19:55:50.768 INFO:teuthology.orchestra.run.smithi008.stdout: "event": "header_read", 2023-08-01T19:55:50.768 INFO:teuthology.orchestra.run.smithi008.stdout: "time": "2023-08-01T19:55:05.165067+0000", 2023-08-01T19:55:50.768 INFO:teuthology.orchestra.run.smithi008.stdout: "duration": 4294967295.999999 2023-08-01T19:55:50.769 INFO:teuthology.orchestra.run.smithi008.stdout: }, 2023-08-01T19:55:50.769 INFO:teuthology.orchestra.run.smithi008.stdout: { 2023-08-01T19:55:50.769 INFO:teuthology.orchestra.run.smithi008.stdout: "event": "all_read", 2023-08-01T19:55:50.769 INFO:teuthology.orchestra.run.smithi008.stdout: "time": "2023-08-01T19:55:05.165126+0000", 2023-08-01T19:55:50.769 INFO:teuthology.orchestra.run.smithi008.stdout: "duration": 5.9116000000000001e-05 2023-08-01T19:55:50.769 INFO:teuthology.orchestra.run.smithi008.stdout: }, 2023-08-01T19:55:50.769 INFO:teuthology.orchestra.run.smithi008.stdout: { 2023-08-01T19:55:50.769 INFO:teuthology.orchestra.run.smithi008.stdout: "event": "dispatched", 2023-08-01T19:55:50.770 INFO:teuthology.orchestra.run.smithi008.stdout: "time": "2023-08-01T19:55:05.165134+0000", 2023-08-01T19:55:50.770 INFO:teuthology.orchestra.run.smithi008.stdout: "duration": 7.9820000000000008e-06 2023-08-01T19:55:50.770 INFO:teuthology.orchestra.run.smithi008.stdout: }, 2023-08-01T19:55:50.770 INFO:teuthology.orchestra.run.smithi008.stdout: { 2023-08-01T19:55:50.770 INFO:teuthology.orchestra.run.smithi008.stdout: "event": "queued_for_pg", 2023-08-01T19:55:50.770 INFO:teuthology.orchestra.run.smithi008.stdout: "time": "2023-08-01T19:55:05.165139+0000", 2023-08-01T19:55:50.770 INFO:teuthology.orchestra.run.smithi008.stdout: "duration": 4.2560000000000004e-06 2023-08-01T19:55:50.770 INFO:teuthology.orchestra.run.smithi008.stdout: }, 2023-08-01T19:55:50.771 INFO:teuthology.orchestra.run.smithi008.stdout: { 2023-08-01T19:55:50.771 INFO:teuthology.orchestra.run.smithi008.stdout: "event": "reached_pg", 2023-08-01T19:55:50.771 INFO:teuthology.orchestra.run.smithi008.stdout: "time": "2023-08-01T19:55:05.165165+0000", 2023-08-01T19:55:50.771 INFO:teuthology.orchestra.run.smithi008.stdout: "duration": 2.6554e-05 2023-08-01T19:55:50.771 INFO:teuthology.orchestra.run.smithi008.stdout: }, 2023-08-01T19:55:50.771 INFO:teuthology.orchestra.run.smithi008.stdout: { 2023-08-01T19:55:50.771 INFO:teuthology.orchestra.run.smithi008.stdout: "event": "started", 2023-08-01T19:55:50.771 INFO:teuthology.orchestra.run.smithi008.stdout: "time": "2023-08-01T19:55:05.165243+0000", 2023-08-01T19:55:50.772 INFO:teuthology.orchestra.run.smithi008.stdout: "duration": 7.7877e-05 2023-08-01T19:55:50.772 INFO:teuthology.orchestra.run.smithi008.stdout: }, 2023-08-01T19:55:50.772 INFO:teuthology.orchestra.run.smithi008.stdout: { 2023-08-01T19:55:50.772 INFO:teuthology.orchestra.run.smithi008.stdout: "event": "waiting for subops from 2", 2023-08-01T19:55:50.772 INFO:teuthology.orchestra.run.smithi008.stdout: "time": "2023-08-01T19:55:05.165450+0000", 2023-08-01T19:55:50.772 INFO:teuthology.orchestra.run.smithi008.stdout: "duration": 0.00020655599999999999 2023-08-01T19:55:50.772 INFO:teuthology.orchestra.run.smithi008.stdout: }, 2023-08-01T19:55:50.772 INFO:teuthology.orchestra.run.smithi008.stdout: { 2023-08-01T19:55:50.773 INFO:teuthology.orchestra.run.smithi008.stdout: "event": "op_commit", 2023-08-01T19:55:50.773 INFO:teuthology.orchestra.run.smithi008.stdout: "time": "2023-08-01T19:55:05.168883+0000", 2023-08-01T19:55:50.773 INFO:teuthology.orchestra.run.smithi008.stdout: "duration": 0.0034333279999999998 2023-08-01T19:55:50.773 INFO:teuthology.orchestra.run.smithi008.stdout: }, 2023-08-01T19:55:50.773 INFO:teuthology.orchestra.run.smithi008.stdout: { 2023-08-01T19:55:50.773 INFO:teuthology.orchestra.run.smithi008.stdout: "event": "sub_op_commit_rec", 2023-08-01T19:55:50.773 INFO:teuthology.orchestra.run.smithi008.stdout: "time": "2023-08-01T19:55:05.228904+0000", 2023-08-01T19:55:50.774 INFO:teuthology.orchestra.run.smithi008.stdout: "duration": 0.060021370999999997 2023-08-01T19:55:50.774 INFO:teuthology.orchestra.run.smithi008.stdout: }, 2023-08-01T19:55:50.774 INFO:teuthology.orchestra.run.smithi008.stdout: { 2023-08-01T19:55:50.774 INFO:teuthology.orchestra.run.smithi008.stdout: "event": "commit_sent", 2023-08-01T19:55:50.774 INFO:teuthology.orchestra.run.smithi008.stdout: "time": "2023-08-01T19:55:05.228952+0000", 2023-08-01T19:55:50.774 INFO:teuthology.orchestra.run.smithi008.stdout: "duration": 4.8056999999999997e-05 2023-08-01T19:55:50.774 INFO:teuthology.orchestra.run.smithi008.stdout: }, 2023-08-01T19:55:50.774 INFO:teuthology.orchestra.run.smithi008.stdout: { 2023-08-01T19:55:50.775 INFO:teuthology.orchestra.run.smithi008.stdout: "event": "done", 2023-08-01T19:55:50.775 INFO:teuthology.orchestra.run.smithi008.stdout: "time": "2023-08-01T19:55:05.228987+0000", 2023-08-01T19:55:50.775 INFO:teuthology.orchestra.run.smithi008.stdout: "duration": 3.5083000000000003e-05 2023-08-01T19:55:50.775 INFO:teuthology.orchestra.run.smithi008.stdout: } 2023-08-01T19:55:50.775 INFO:teuthology.orchestra.run.smithi008.stdout: ] 2023-08-01T19:55:50.775 INFO:teuthology.orchestra.run.smithi008.stdout: } 2023-08-01T19:55:50.775 INFO:teuthology.orchestra.run.smithi008.stdout: }, 2023-08-01T19:55:50.775 INFO:teuthology.orchestra.run.smithi008.stdout: { 2023-08-01T19:55:50.776 INFO:teuthology.orchestra.run.smithi008.stdout: "description": "osd_op(client.4668.0:100929 5.3 5:c29f4adb:::benchmark_data_smithi006_114134_object100928:head [set-alloc-hint object_size 65536 write_size 65536,write 0~65536] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e37)", 2023-08-01T19:55:50.776 INFO:teuthology.orchestra.run.smithi008.stdout: "initiated_at": "2023-08-01T19:55:05.564759+0000", 2023-08-01T19:55:50.776 INFO:teuthology.orchestra.run.smithi008.stdout: "age": 45.166220105999997, 2023-08-01T19:55:50.776 INFO:teuthology.orchestra.run.smithi008.stdout: "duration": 0.062544635000000001, 2023-08-01T19:55:50.776 INFO:teuthology.orchestra.run.smithi008.stdout: "type_data": { 2023-08-01T19:55:50.776 INFO:teuthology.orchestra.run.smithi008.stdout: "flag_point": "commit sent; apply or cleanup", 2023-08-01T19:55:50.776 INFO:teuthology.orchestra.run.smithi008.stdout: "client_info": { 2023-08-01T19:55:50.776 INFO:teuthology.orchestra.run.smithi008.stdout: "client": "client.4668", 2023-08-01T19:55:50.777 INFO:teuthology.orchestra.run.smithi008.stdout: "client_addr": "172.21.15.6:0/1709472247", 2023-08-01T19:55:50.777 INFO:teuthology.orchestra.run.smithi008.stdout: "tid": 100929 2023-08-01T19:55:50.777 INFO:teuthology.orchestra.run.smithi008.stdout: }, 2023-08-01T19:55:50.777 INFO:teuthology.orchestra.run.smithi008.stdout: "events": [ 2023-08-01T19:55:50.777 INFO:teuthology.orchestra.run.smithi008.stdout: { 2023-08-01T19:55:50.777 INFO:teuthology.orchestra.run.smithi008.stdout: "event": "initiated", 2023-08-01T19:55:50.777 INFO:teuthology.orchestra.run.smithi008.stdout: "time": "2023-08-01T19:55:05.564759+0000", 2023-08-01T19:55:50.777 INFO:teuthology.orchestra.run.smithi008.stdout: "duration": 0 2023-08-01T19:55:50.778 INFO:teuthology.orchestra.run.smithi008.stdout: }, 2023-08-01T19:55:50.778 INFO:teuthology.orchestra.run.smithi008.stdout: { 2023-08-01T19:55:50.778 INFO:teuthology.orchestra.run.smithi008.stdout: "event": "throttled", 2023-08-01T19:55:50.778 INFO:teuthology.orchestra.run.smithi008.stdout: "time": "2023-08-01T19:55:05.564759+0000", 2023-08-01T19:55:50.778 INFO:teuthology.orchestra.run.smithi008.stdout: "duration": 0 2023-08-01T19:55:50.778 INFO:teuthology.orchestra.run.smithi008.stdout: }, 2023-08-01T19:55:50.778 INFO:teuthology.orchestra.run.smithi008.stdout: { 2023-08-01T19:55:50.778 INFO:teuthology.orchestra.run.smithi008.stdout: "event": "header_read", 2023-08-01T19:55:50.779 INFO:teuthology.orchestra.run.smithi008.stdout: "time": "2023-08-01T19:55:05.564758+0000", 2023-08-01T19:55:50.779 INFO:teuthology.orchestra.run.smithi008.stdout: "duration": 4294967295.999999 2023-08-01T19:55:50.779 INFO:teuthology.orchestra.run.smithi008.stdout: }, 2023-08-01T19:55:50.779 INFO:teuthology.orchestra.run.smithi008.stdout: { 2023-08-01T19:55:50.779 INFO:teuthology.orchestra.run.smithi008.stdout: "event": "all_read", 2023-08-01T19:55:50.779 INFO:teuthology.orchestra.run.smithi008.stdout: "time": "2023-08-01T19:55:05.564815+0000", 2023-08-01T19:55:50.779 INFO:teuthology.orchestra.run.smithi008.stdout: "duration": 5.7757000000000003e-05 2023-08-01T19:55:50.779 INFO:teuthology.orchestra.run.smithi008.stdout: }, 2023-08-01T19:55:50.780 INFO:teuthology.orchestra.run.smithi008.stdout: { 2023-08-01T19:55:50.780 INFO:teuthology.orchestra.run.smithi008.stdout: "event": "dispatched", 2023-08-01T19:55:50.780 INFO:teuthology.orchestra.run.smithi008.stdout: "time": "2023-08-01T19:55:05.564824+0000", 2023-08-01T19:55:50.780 INFO:teuthology.orchestra.run.smithi008.stdout: "duration": 8.6559999999999998e-06 2023-08-01T19:55:50.780 INFO:teuthology.orchestra.run.smithi008.stdout: }, 2023-08-01T19:55:50.780 INFO:teuthology.orchestra.run.smithi008.stdout: { 2023-08-01T19:55:50.780 INFO:teuthology.orchestra.run.smithi008.stdout: "event": "queued_for_pg", 2023-08-01T19:55:50.781 INFO:teuthology.orchestra.run.smithi008.stdout: "time": "2023-08-01T19:55:05.564829+0000", 2023-08-01T19:55:50.781 INFO:teuthology.orchestra.run.smithi008.stdout: "duration": 4.6160000000000004e-06 2023-08-01T19:55:50.781 INFO:teuthology.orchestra.run.smithi008.stdout: }, 2023-08-01T19:55:50.781 INFO:teuthology.orchestra.run.smithi008.stdout: { 2023-08-01T19:55:50.781 INFO:teuthology.orchestra.run.smithi008.stdout: "event": "reached_pg", 2023-08-01T19:55:50.781 INFO:teuthology.orchestra.run.smithi008.stdout: "time": "2023-08-01T19:55:05.564871+0000", 2023-08-01T19:55:50.781 INFO:teuthology.orchestra.run.smithi008.stdout: "duration": 4.2206000000000002e-05 2023-08-01T19:55:50.781 INFO:teuthology.orchestra.run.smithi008.stdout: }, 2023-08-01T19:55:50.782 INFO:teuthology.orchestra.run.smithi008.stdout: { 2023-08-01T19:55:50.782 INFO:teuthology.orchestra.run.smithi008.stdout: "event": "started", 2023-08-01T19:55:50.782 INFO:teuthology.orchestra.run.smithi008.stdout: "time": "2023-08-01T19:55:05.565011+0000", 2023-08-01T19:55:50.782 INFO:teuthology.orchestra.run.smithi008.stdout: "duration": 0.000140469 2023-08-01T19:55:50.782 INFO:teuthology.orchestra.run.smithi008.stdout: }, 2023-08-01T19:55:50.782 INFO:teuthology.orchestra.run.smithi008.stdout: { 2023-08-01T19:55:50.782 INFO:teuthology.orchestra.run.smithi008.stdout: "event": "waiting for subops from 1", 2023-08-01T19:55:50.782 INFO:teuthology.orchestra.run.smithi008.stdout: "time": "2023-08-01T19:55:05.565212+0000", 2023-08-01T19:55:50.783 INFO:teuthology.orchestra.run.smithi008.stdout: "duration": 0.00020106599999999999 2023-08-01T19:55:50.783 INFO:teuthology.orchestra.run.smithi008.stdout: }, 2023-08-01T19:55:50.783 INFO:teuthology.orchestra.run.smithi008.stdout: { 2023-08-01T19:55:50.783 INFO:teuthology.orchestra.run.smithi008.stdout: "event": "sub_op_commit_rec", 2023-08-01T19:55:50.783 INFO:teuthology.orchestra.run.smithi008.stdout: "time": "2023-08-01T19:55:05.626925+0000", 2023-08-01T19:55:50.783 INFO:teuthology.orchestra.run.smithi008.stdout: "duration": 0.061712111 2023-08-01T19:55:50.783 INFO:teuthology.orchestra.run.smithi008.stdout: }, 2023-08-01T19:55:50.783 INFO:teuthology.orchestra.run.smithi008.stdout: { 2023-08-01T19:55:50.784 INFO:teuthology.orchestra.run.smithi008.stdout: "event": "op_commit", 2023-08-01T19:55:50.784 INFO:teuthology.orchestra.run.smithi008.stdout: "time": "2023-08-01T19:55:05.627217+0000", 2023-08-01T19:55:50.784 INFO:teuthology.orchestra.run.smithi008.stdout: "duration": 0.00029265999999999998 2023-08-01T19:55:50.784 INFO:teuthology.orchestra.run.smithi008.stdout: }, 2023-08-01T19:55:50.784 INFO:teuthology.orchestra.run.smithi008.stdout: { 2023-08-01T19:55:50.784 INFO:teuthology.orchestra.run.smithi008.stdout: "event": "commit_sent", 2023-08-01T19:55:50.784 INFO:teuthology.orchestra.run.smithi008.stdout: "time": "2023-08-01T19:55:05.627264+0000", 2023-08-01T19:55:50.785 INFO:teuthology.orchestra.run.smithi008.stdout: "duration": 4.6260000000000001e-05 2023-08-01T19:55:50.785 INFO:teuthology.orchestra.run.smithi008.stdout: }, 2023-08-01T19:55:50.785 INFO:teuthology.orchestra.run.smithi008.stdout: { 2023-08-01T19:55:50.785 INFO:teuthology.orchestra.run.smithi008.stdout: "event": "done", 2023-08-01T19:55:50.785 INFO:teuthology.orchestra.run.smithi008.stdout: "time": "2023-08-01T19:55:05.627303+0000", 2023-08-01T19:55:50.785 INFO:teuthology.orchestra.run.smithi008.stdout: "duration": 3.9839999999999998e-05 2023-08-01T19:55:50.785 INFO:teuthology.orchestra.run.smithi008.stdout: } 2023-08-01T19:55:50.785 INFO:teuthology.orchestra.run.smithi008.stdout: ] 2023-08-01T19:55:50.786 INFO:teuthology.orchestra.run.smithi008.stdout: } 2023-08-01T19:55:50.786 INFO:teuthology.orchestra.run.smithi008.stdout: }, 2023-08-01T19:55:50.786 INFO:teuthology.orchestra.run.smithi008.stdout: { 2023-08-01T19:55:50.786 INFO:teuthology.orchestra.run.smithi008.stdout: "description": "osd_repop(client.4668.0:100928 5.7 e37/19 5:e61a7dfa:::benchmark_data_smithi006_114134_object100927:head v 37'6273, mlcod=37'6270)", 2023-08-01T19:55:50.786 INFO:teuthology.orchestra.run.smithi008.stdout: "initiated_at": "2023-08-01T19:55:05.565106+0000", 2023-08-01T19:55:50.786 INFO:teuthology.orchestra.run.smithi008.stdout: "age": 45.165873007999998, 2023-08-01T19:55:50.786 INFO:teuthology.orchestra.run.smithi008.stdout: "duration": 0.064091282999999999, 2023-08-01T19:55:50.786 INFO:teuthology.orchestra.run.smithi008.stdout: "type_data": { 2023-08-01T19:55:50.787 INFO:teuthology.orchestra.run.smithi008.stdout: "flag_point": "commit sent; apply or cleanup", 2023-08-01T19:55:50.787 INFO:teuthology.orchestra.run.smithi008.stdout: "events": [ 2023-08-01T19:55:50.787 INFO:teuthology.orchestra.run.smithi008.stdout: { 2023-08-01T19:55:50.787 INFO:teuthology.orchestra.run.smithi008.stdout: "event": "initiated", 2023-08-01T19:55:50.787 INFO:teuthology.orchestra.run.smithi008.stdout: "time": "2023-08-01T19:55:05.565106+0000", 2023-08-01T19:55:50.787 INFO:teuthology.orchestra.run.smithi008.stdout: "duration": 0 2023-08-01T19:55:50.787 INFO:teuthology.orchestra.run.smithi008.stdout: }, 2023-08-01T19:55:50.787 INFO:teuthology.orchestra.run.smithi008.stdout: { 2023-08-01T19:55:50.788 INFO:teuthology.orchestra.run.smithi008.stdout: "event": "throttled", 2023-08-01T19:55:50.788 INFO:teuthology.orchestra.run.smithi008.stdout: "time": "2023-08-01T19:55:05.565106+0000", 2023-08-01T19:55:50.788 INFO:teuthology.orchestra.run.smithi008.stdout: "duration": 0 2023-08-01T19:55:50.788 INFO:teuthology.orchestra.run.smithi008.stdout: }, 2023-08-01T19:55:50.788 INFO:teuthology.orchestra.run.smithi008.stdout: { 2023-08-01T19:55:50.788 INFO:teuthology.orchestra.run.smithi008.stdout: "event": "header_read", 2023-08-01T19:55:50.788 INFO:teuthology.orchestra.run.smithi008.stdout: "time": "2023-08-01T19:55:05.565105+0000", 2023-08-01T19:55:50.788 INFO:teuthology.orchestra.run.smithi008.stdout: "duration": 4294967295.9999995 2023-08-01T19:55:50.789 INFO:teuthology.orchestra.run.smithi008.stdout: }, 2023-08-01T19:55:50.789 INFO:teuthology.orchestra.run.smithi008.stdout: { 2023-08-01T19:55:50.789 INFO:teuthology.orchestra.run.smithi008.stdout: "event": "all_read", 2023-08-01T19:55:50.789 INFO:teuthology.orchestra.run.smithi008.stdout: "time": "2023-08-01T19:55:05.565173+0000", 2023-08-01T19:55:50.789 INFO:teuthology.orchestra.run.smithi008.stdout: "duration": 6.8186000000000001e-05 2023-08-01T19:55:50.789 INFO:teuthology.orchestra.run.smithi008.stdout: }, 2023-08-01T19:55:50.789 INFO:teuthology.orchestra.run.smithi008.stdout: { 2023-08-01T19:55:50.790 INFO:teuthology.orchestra.run.smithi008.stdout: "event": "dispatched", 2023-08-01T19:55:50.790 INFO:teuthology.orchestra.run.smithi008.stdout: "time": "2023-08-01T19:55:05.565182+0000", 2023-08-01T19:55:50.790 INFO:teuthology.orchestra.run.smithi008.stdout: "duration": 8.3620000000000006e-06 2023-08-01T19:55:50.790 INFO:teuthology.orchestra.run.smithi008.stdout: }, 2023-08-01T19:55:50.790 INFO:teuthology.orchestra.run.smithi008.stdout: { 2023-08-01T19:55:50.790 INFO:teuthology.orchestra.run.smithi008.stdout: "event": "queued_for_pg", 2023-08-01T19:55:50.790 INFO:teuthology.orchestra.run.smithi008.stdout: "time": "2023-08-01T19:55:05.565186+0000", 2023-08-01T19:55:50.790 INFO:teuthology.orchestra.run.smithi008.stdout: "duration": 3.7680000000000002e-06 2023-08-01T19:55:50.791 INFO:teuthology.orchestra.run.smithi008.stdout: }, 2023-08-01T19:55:50.791 INFO:teuthology.orchestra.run.smithi008.stdout: { 2023-08-01T19:55:50.791 INFO:teuthology.orchestra.run.smithi008.stdout: "event": "reached_pg", 2023-08-01T19:55:50.791 INFO:teuthology.orchestra.run.smithi008.stdout: "time": "2023-08-01T19:55:05.565212+0000", 2023-08-01T19:55:50.791 INFO:teuthology.orchestra.run.smithi008.stdout: "duration": 2.6230000000000001e-05 2023-08-01T19:55:50.791 INFO:teuthology.orchestra.run.smithi008.stdout: }, 2023-08-01T19:55:50.791 INFO:teuthology.orchestra.run.smithi008.stdout: { 2023-08-01T19:55:50.792 INFO:teuthology.orchestra.run.smithi008.stdout: "event": "started", 2023-08-01T19:55:50.792 INFO:teuthology.orchestra.run.smithi008.stdout: "time": "2023-08-01T19:55:05.565224+0000", 2023-08-01T19:55:50.792 INFO:teuthology.orchestra.run.smithi008.stdout: "duration": 1.2033e-05 2023-08-01T19:55:50.792 INFO:teuthology.orchestra.run.smithi008.stdout: }, 2023-08-01T19:55:50.792 INFO:teuthology.orchestra.run.smithi008.stdout: { 2023-08-01T19:55:50.792 INFO:teuthology.orchestra.run.smithi008.stdout: "event": "commit_sent", 2023-08-01T19:55:50.792 INFO:teuthology.orchestra.run.smithi008.stdout: "time": "2023-08-01T19:55:05.629152+0000", 2023-08-01T19:55:50.792 INFO:teuthology.orchestra.run.smithi008.stdout: "duration": 0.063928378999999994 2023-08-01T19:55:50.793 INFO:teuthology.orchestra.run.smithi008.stdout: }, 2023-08-01T19:55:50.793 INFO:teuthology.orchestra.run.smithi008.stdout: { 2023-08-01T19:55:50.793 INFO:teuthology.orchestra.run.smithi008.stdout: "event": "done", 2023-08-01T19:55:50.793 INFO:teuthology.orchestra.run.smithi008.stdout: "time": "2023-08-01T19:55:05.629197+0000", 2023-08-01T19:55:50.793 INFO:teuthology.orchestra.run.smithi008.stdout: "duration": 4.4894000000000001e-05 2023-08-01T19:55:50.793 INFO:teuthology.orchestra.run.smithi008.stdout: } 2023-08-01T19:55:50.793 INFO:teuthology.orchestra.run.smithi008.stdout: ] 2023-08-01T19:55:50.794 INFO:teuthology.orchestra.run.smithi008.stdout: } 2023-08-01T19:55:50.794 INFO:teuthology.orchestra.run.smithi008.stdout: }, 2023-08-01T19:55:50.794 INFO:teuthology.orchestra.run.smithi008.stdout: { 2023-08-01T19:55:50.794 INFO:teuthology.orchestra.run.smithi008.stdout: "description": "osd_repop(client.4668.0:100927 5.0 e37/19 5:00608ec6:::benchmark_data_smithi006_114134_object100926:head v 37'6408, mlcod=37'6403)", 2023-08-01T19:55:50.794 INFO:teuthology.orchestra.run.smithi008.stdout: "initiated_at": "2023-08-01T19:55:05.565153+0000", 2023-08-01T19:55:50.794 INFO:teuthology.orchestra.run.smithi008.stdout: "age": 45.165826271, 2023-08-01T19:55:50.794 INFO:teuthology.orchestra.run.smithi008.stdout: "duration": 0.062202714999999999, 2023-08-01T19:55:50.794 INFO:teuthology.orchestra.run.smithi008.stdout: "type_data": { 2023-08-01T19:55:50.795 INFO:teuthology.orchestra.run.smithi008.stdout: "flag_point": "commit sent; apply or cleanup", 2023-08-01T19:55:50.795 INFO:teuthology.orchestra.run.smithi008.stdout: "events": [ 2023-08-01T19:55:50.795 INFO:teuthology.orchestra.run.smithi008.stdout: { 2023-08-01T19:55:50.795 INFO:teuthology.orchestra.run.smithi008.stdout: "event": "initiated", 2023-08-01T19:55:50.795 INFO:teuthology.orchestra.run.smithi008.stdout: "time": "2023-08-01T19:55:05.565153+0000", 2023-08-01T19:55:50.795 INFO:teuthology.orchestra.run.smithi008.stdout: "duration": 0 2023-08-01T19:55:50.795 INFO:teuthology.orchestra.run.smithi008.stdout: }, 2023-08-01T19:55:50.795 INFO:teuthology.orchestra.run.smithi008.stdout: { 2023-08-01T19:55:50.796 INFO:teuthology.orchestra.run.smithi008.stdout: "event": "throttled", 2023-08-01T19:55:50.796 INFO:teuthology.orchestra.run.smithi008.stdout: "time": "2023-08-01T19:55:05.565153+0000", 2023-08-01T19:55:50.796 INFO:teuthology.orchestra.run.smithi008.stdout: "duration": 0 2023-08-01T19:55:50.796 INFO:teuthology.orchestra.run.smithi008.stdout: }, 2023-08-01T19:55:50.796 INFO:teuthology.orchestra.run.smithi008.stdout: { 2023-08-01T19:55:50.796 INFO:teuthology.orchestra.run.smithi008.stdout: "event": "header_read", 2023-08-01T19:55:50.796 INFO:teuthology.orchestra.run.smithi008.stdout: "time": "2023-08-01T19:55:05.565152+0000", 2023-08-01T19:55:50.797 INFO:teuthology.orchestra.run.smithi008.stdout: "duration": 4294967295.9999995 2023-08-01T19:55:50.797 INFO:teuthology.orchestra.run.smithi008.stdout: }, 2023-08-01T19:55:50.797 INFO:teuthology.orchestra.run.smithi008.stdout: { 2023-08-01T19:55:50.797 INFO:teuthology.orchestra.run.smithi008.stdout: "event": "all_read", 2023-08-01T19:55:50.797 INFO:teuthology.orchestra.run.smithi008.stdout: "time": "2023-08-01T19:55:05.565225+0000", 2023-08-01T19:55:50.797 INFO:teuthology.orchestra.run.smithi008.stdout: "duration": 7.2471000000000005e-05 2023-08-01T19:55:50.797 INFO:teuthology.orchestra.run.smithi008.stdout: }, 2023-08-01T19:55:50.797 INFO:teuthology.orchestra.run.smithi008.stdout: { 2023-08-01T19:55:50.798 INFO:teuthology.orchestra.run.smithi008.stdout: "event": "dispatched", 2023-08-01T19:55:50.798 INFO:teuthology.orchestra.run.smithi008.stdout: "time": "2023-08-01T19:55:05.565229+0000", 2023-08-01T19:55:50.798 INFO:teuthology.orchestra.run.smithi008.stdout: "duration": 4.5600000000000004e-06 2023-08-01T19:55:50.798 INFO:teuthology.orchestra.run.smithi008.stdout: }, 2023-08-01T19:55:50.798 INFO:teuthology.orchestra.run.smithi008.stdout: { 2023-08-01T19:55:50.798 INFO:teuthology.orchestra.run.smithi008.stdout: "event": "queued_for_pg", 2023-08-01T19:55:50.798 INFO:teuthology.orchestra.run.smithi008.stdout: "time": "2023-08-01T19:55:05.565232+0000", 2023-08-01T19:55:50.798 INFO:teuthology.orchestra.run.smithi008.stdout: "duration": 2.6900000000000001e-06 2023-08-01T19:55:50.799 INFO:teuthology.orchestra.run.smithi008.stdout: }, 2023-08-01T19:55:50.799 INFO:teuthology.orchestra.run.smithi008.stdout: { 2023-08-01T19:55:50.799 INFO:teuthology.orchestra.run.smithi008.stdout: "event": "reached_pg", 2023-08-01T19:55:50.799 INFO:teuthology.orchestra.run.smithi008.stdout: "time": "2023-08-01T19:55:05.565283+0000", 2023-08-01T19:55:50.799 INFO:teuthology.orchestra.run.smithi008.stdout: "duration": 5.1442e-05 2023-08-01T19:55:50.799 INFO:teuthology.orchestra.run.smithi008.stdout: }, 2023-08-01T19:55:50.799 INFO:teuthology.orchestra.run.smithi008.stdout: { 2023-08-01T19:55:50.799 INFO:teuthology.orchestra.run.smithi008.stdout: "event": "started", 2023-08-01T19:55:50.800 INFO:teuthology.orchestra.run.smithi008.stdout: "time": "2023-08-01T19:55:05.565301+0000", 2023-08-01T19:55:50.800 INFO:teuthology.orchestra.run.smithi008.stdout: "duration": 1.8029e-05 2023-08-01T19:55:50.800 INFO:teuthology.orchestra.run.smithi008.stdout: }, 2023-08-01T19:55:50.800 INFO:teuthology.orchestra.run.smithi008.stdout: { 2023-08-01T19:55:50.800 INFO:teuthology.orchestra.run.smithi008.stdout: "event": "commit_sent", 2023-08-01T19:55:50.800 INFO:teuthology.orchestra.run.smithi008.stdout: "time": "2023-08-01T19:55:05.627318+0000", 2023-08-01T19:55:50.800 INFO:teuthology.orchestra.run.smithi008.stdout: "duration": 0.062016763000000003 2023-08-01T19:55:50.800 INFO:teuthology.orchestra.run.smithi008.stdout: }, 2023-08-01T19:55:50.801 INFO:teuthology.orchestra.run.smithi008.stdout: { 2023-08-01T19:55:50.801 INFO:teuthology.orchestra.run.smithi008.stdout: "event": "done", 2023-08-01T19:55:50.801 INFO:teuthology.orchestra.run.smithi008.stdout: "time": "2023-08-01T19:55:05.627355+0000", 2023-08-01T19:55:50.801 INFO:teuthology.orchestra.run.smithi008.stdout: "duration": 3.7258999999999997e-05 2023-08-01T19:55:50.801 INFO:teuthology.orchestra.run.smithi008.stdout: } 2023-08-01T19:55:50.801 INFO:teuthology.orchestra.run.smithi008.stdout: ] 2023-08-01T19:55:50.801 INFO:teuthology.orchestra.run.smithi008.stdout: } 2023-08-01T19:55:50.801 INFO:teuthology.orchestra.run.smithi008.stdout: }, 2023-08-01T19:55:50.802 INFO:teuthology.orchestra.run.smithi008.stdout: { 2023-08-01T19:55:50.802 INFO:teuthology.orchestra.run.smithi008.stdout: "description": "osd_op(client.4668.0:100930 5.5 5:a7b64eb3:::benchmark_data_smithi006_114134_object100929:head [set-alloc-hint object_size 65536 write_size 65536,write 0~65536] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e37)", 2023-08-01T19:55:50.802 INFO:teuthology.orchestra.run.smithi008.stdout: "initiated_at": "2023-08-01T19:55:05.565766+0000", 2023-08-01T19:55:50.802 INFO:teuthology.orchestra.run.smithi008.stdout: "age": 45.165212486000001, 2023-08-01T19:55:50.802 INFO:teuthology.orchestra.run.smithi008.stdout: "duration": 0.063668735000000004, 2023-08-01T19:55:50.802 INFO:teuthology.orchestra.run.smithi008.stdout: "type_data": { 2023-08-01T19:55:50.802 INFO:teuthology.orchestra.run.smithi008.stdout: "flag_point": "commit sent; apply or cleanup", 2023-08-01T19:55:50.803 INFO:teuthology.orchestra.run.smithi008.stdout: "client_info": { 2023-08-01T19:55:50.803 INFO:teuthology.orchestra.run.smithi008.stdout: "client": "client.4668", 2023-08-01T19:55:50.803 INFO:teuthology.orchestra.run.smithi008.stdout: "client_addr": "172.21.15.6:0/1709472247", 2023-08-01T19:55:50.803 INFO:teuthology.orchestra.run.smithi008.stdout: "tid": 100930 2023-08-01T19:55:50.803 INFO:teuthology.orchestra.run.smithi008.stdout: }, 2023-08-01T19:55:50.803 INFO:teuthology.orchestra.run.smithi008.stdout: "events": [ 2023-08-01T19:55:50.803 INFO:teuthology.orchestra.run.smithi008.stdout: { 2023-08-01T19:55:50.804 INFO:teuthology.orchestra.run.smithi008.stdout: "event": "initiated", 2023-08-01T19:55:50.804 INFO:teuthology.orchestra.run.smithi008.stdout: "time": "2023-08-01T19:55:05.565766+0000", 2023-08-01T19:55:50.804 INFO:teuthology.orchestra.run.smithi008.stdout: "duration": 0 2023-08-01T19:55:50.804 INFO:teuthology.orchestra.run.smithi008.stdout: }, 2023-08-01T19:55:50.804 INFO:teuthology.orchestra.run.smithi008.stdout: { 2023-08-01T19:55:50.804 INFO:teuthology.orchestra.run.smithi008.stdout: "event": "throttled", 2023-08-01T19:55:50.804 INFO:teuthology.orchestra.run.smithi008.stdout: "time": "2023-08-01T19:55:05.565766+0000", 2023-08-01T19:55:50.804 INFO:teuthology.orchestra.run.smithi008.stdout: "duration": 0 2023-08-01T19:55:50.805 INFO:teuthology.orchestra.run.smithi008.stdout: }, 2023-08-01T19:55:50.805 INFO:teuthology.orchestra.run.smithi008.stdout: { 2023-08-01T19:55:50.805 INFO:teuthology.orchestra.run.smithi008.stdout: "event": "header_read", 2023-08-01T19:55:50.805 INFO:teuthology.orchestra.run.smithi008.stdout: "time": "2023-08-01T19:55:05.565766+0000", 2023-08-01T19:55:50.805 INFO:teuthology.orchestra.run.smithi008.stdout: "duration": 4294967295.999999 2023-08-01T19:55:50.805 INFO:teuthology.orchestra.run.smithi008.stdout: }, 2023-08-01T19:55:50.805 INFO:teuthology.orchestra.run.smithi008.stdout: { 2023-08-01T19:55:50.805 INFO:teuthology.orchestra.run.smithi008.stdout: "event": "all_read", 2023-08-01T19:55:50.806 INFO:teuthology.orchestra.run.smithi008.stdout: "time": "2023-08-01T19:55:05.565855+0000", 2023-08-01T19:55:50.806 INFO:teuthology.orchestra.run.smithi008.stdout: "duration": 8.9166999999999995e-05 2023-08-01T19:55:50.806 INFO:teuthology.orchestra.run.smithi008.stdout: }, 2023-08-01T19:55:50.806 INFO:teuthology.orchestra.run.smithi008.stdout: { 2023-08-01T19:55:50.806 INFO:teuthology.orchestra.run.smithi008.stdout: "event": "dispatched", 2023-08-01T19:55:50.806 INFO:teuthology.orchestra.run.smithi008.stdout: "time": "2023-08-01T19:55:05.565862+0000", 2023-08-01T19:55:50.806 INFO:teuthology.orchestra.run.smithi008.stdout: "duration": 7.4549999999999998e-06 2023-08-01T19:55:50.807 INFO:teuthology.orchestra.run.smithi008.stdout: }, 2023-08-01T19:55:50.807 INFO:teuthology.orchestra.run.smithi008.stdout: { 2023-08-01T19:55:50.807 INFO:teuthology.orchestra.run.smithi008.stdout: "event": "queued_for_pg", 2023-08-01T19:55:50.807 INFO:teuthology.orchestra.run.smithi008.stdout: "time": "2023-08-01T19:55:05.565866+0000", 2023-08-01T19:55:50.807 INFO:teuthology.orchestra.run.smithi008.stdout: "duration": 3.8060000000000001e-06 2023-08-01T19:55:50.807 INFO:teuthology.orchestra.run.smithi008.stdout: }, 2023-08-01T19:55:50.807 INFO:teuthology.orchestra.run.smithi008.stdout: { 2023-08-01T19:55:50.808 INFO:teuthology.orchestra.run.smithi008.stdout: "event": "reached_pg", 2023-08-01T19:55:50.808 INFO:teuthology.orchestra.run.smithi008.stdout: "time": "2023-08-01T19:55:05.565901+0000", 2023-08-01T19:55:50.808 INFO:teuthology.orchestra.run.smithi008.stdout: "duration": 3.5063e-05 2023-08-01T19:55:50.808 INFO:teuthology.orchestra.run.smithi008.stdout: }, 2023-08-01T19:55:50.808 INFO:teuthology.orchestra.run.smithi008.stdout: { 2023-08-01T19:55:50.808 INFO:teuthology.orchestra.run.smithi008.stdout: "event": "started", 2023-08-01T19:55:50.808 INFO:teuthology.orchestra.run.smithi008.stdout: "time": "2023-08-01T19:55:05.566016+0000", 2023-08-01T19:55:50.808 INFO:teuthology.orchestra.run.smithi008.stdout: "duration": 0.00011509400000000001 2023-08-01T19:55:50.809 INFO:teuthology.orchestra.run.smithi008.stdout: }, 2023-08-01T19:55:50.809 INFO:teuthology.orchestra.run.smithi008.stdout: { 2023-08-01T19:55:50.809 INFO:teuthology.orchestra.run.smithi008.stdout: "event": "waiting for subops from 1", 2023-08-01T19:55:50.809 INFO:teuthology.orchestra.run.smithi008.stdout: "time": "2023-08-01T19:55:05.566154+0000", 2023-08-01T19:55:50.809 INFO:teuthology.orchestra.run.smithi008.stdout: "duration": 0.000138052 2023-08-01T19:55:50.809 INFO:teuthology.orchestra.run.smithi008.stdout: }, 2023-08-01T19:55:50.809 INFO:teuthology.orchestra.run.smithi008.stdout: { 2023-08-01T19:55:50.809 INFO:teuthology.orchestra.run.smithi008.stdout: "event": "sub_op_commit_rec", 2023-08-01T19:55:50.810 INFO:teuthology.orchestra.run.smithi008.stdout: "time": "2023-08-01T19:55:05.629279+0000", 2023-08-01T19:55:50.810 INFO:teuthology.orchestra.run.smithi008.stdout: "duration": 0.063124531999999997 2023-08-01T19:55:50.810 INFO:teuthology.orchestra.run.smithi008.stdout: }, 2023-08-01T19:55:50.810 INFO:teuthology.orchestra.run.smithi008.stdout: { 2023-08-01T19:55:50.810 INFO:teuthology.orchestra.run.smithi008.stdout: "event": "op_commit", 2023-08-01T19:55:50.810 INFO:teuthology.orchestra.run.smithi008.stdout: "time": "2023-08-01T19:55:05.629333+0000", 2023-08-01T19:55:50.810 INFO:teuthology.orchestra.run.smithi008.stdout: "duration": 5.4694999999999997e-05 2023-08-01T19:55:50.811 INFO:teuthology.orchestra.run.smithi008.stdout: }, 2023-08-01T19:55:50.811 INFO:teuthology.orchestra.run.smithi008.stdout: { 2023-08-01T19:55:50.811 INFO:teuthology.orchestra.run.smithi008.stdout: "event": "commit_sent", 2023-08-01T19:55:50.811 INFO:teuthology.orchestra.run.smithi008.stdout: "time": "2023-08-01T19:55:05.629390+0000", 2023-08-01T19:55:50.811 INFO:teuthology.orchestra.run.smithi008.stdout: "duration": 5.6416000000000003e-05 2023-08-01T19:55:50.811 INFO:teuthology.orchestra.run.smithi008.stdout: }, 2023-08-01T19:55:50.811 INFO:teuthology.orchestra.run.smithi008.stdout: { 2023-08-01T19:55:50.811 INFO:teuthology.orchestra.run.smithi008.stdout: "event": "done", 2023-08-01T19:55:50.812 INFO:teuthology.orchestra.run.smithi008.stdout: "time": "2023-08-01T19:55:05.629435+0000", 2023-08-01T19:55:50.812 INFO:teuthology.orchestra.run.smithi008.stdout: "duration": 4.5170999999999998e-05 2023-08-01T19:55:50.812 INFO:teuthology.orchestra.run.smithi008.stdout: } 2023-08-01T19:55:50.812 INFO:teuthology.orchestra.run.smithi008.stdout: ] 2023-08-01T19:55:50.812 INFO:teuthology.orchestra.run.smithi008.stdout: } 2023-08-01T19:55:50.812 INFO:teuthology.orchestra.run.smithi008.stdout: }, 2023-08-01T19:55:50.812 INFO:teuthology.orchestra.run.smithi008.stdout: { 2023-08-01T19:55:50.812 INFO:teuthology.orchestra.run.smithi008.stdout: "description": "osd_op(client.4668.0:100933 5.5 5:af92e9f2:::benchmark_data_smithi006_114134_object100932:head [set-alloc-hint object_size 65536 write_size 65536,write 0~65536] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e37)", 2023-08-01T19:55:50.813 INFO:teuthology.orchestra.run.smithi008.stdout: "initiated_at": "2023-08-01T19:55:05.566634+0000", 2023-08-01T19:55:50.813 INFO:teuthology.orchestra.run.smithi008.stdout: "age": 45.164344943000003, 2023-08-01T19:55:50.813 INFO:teuthology.orchestra.run.smithi008.stdout: "duration": 0.065909364999999998, 2023-08-01T19:55:50.813 INFO:teuthology.orchestra.run.smithi008.stdout: "type_data": { 2023-08-01T19:55:50.813 INFO:teuthology.orchestra.run.smithi008.stdout: "flag_point": "commit sent; apply or cleanup", 2023-08-01T19:55:50.813 INFO:teuthology.orchestra.run.smithi008.stdout: "client_info": { 2023-08-01T19:55:50.813 INFO:teuthology.orchestra.run.smithi008.stdout: "client": "client.4668", 2023-08-01T19:55:50.813 INFO:teuthology.orchestra.run.smithi008.stdout: "client_addr": "172.21.15.6:0/1709472247", 2023-08-01T19:55:50.814 INFO:teuthology.orchestra.run.smithi008.stdout: "tid": 100933 2023-08-01T19:55:50.814 INFO:teuthology.orchestra.run.smithi008.stdout: }, 2023-08-01T19:55:50.814 INFO:teuthology.orchestra.run.smithi008.stdout: "events": [ 2023-08-01T19:55:50.814 INFO:teuthology.orchestra.run.smithi008.stdout: { 2023-08-01T19:55:50.814 INFO:teuthology.orchestra.run.smithi008.stdout: "event": "initiated", 2023-08-01T19:55:50.814 INFO:teuthology.orchestra.run.smithi008.stdout: "time": "2023-08-01T19:55:05.566634+0000", 2023-08-01T19:55:50.814 INFO:teuthology.orchestra.run.smithi008.stdout: "duration": 0 2023-08-01T19:55:50.814 INFO:teuthology.orchestra.run.smithi008.stdout: }, 2023-08-01T19:55:50.815 INFO:teuthology.orchestra.run.smithi008.stdout: { 2023-08-01T19:55:50.815 INFO:teuthology.orchestra.run.smithi008.stdout: "event": "throttled", 2023-08-01T19:55:50.815 INFO:teuthology.orchestra.run.smithi008.stdout: "time": "2023-08-01T19:55:05.566634+0000", 2023-08-01T19:55:50.815 INFO:teuthology.orchestra.run.smithi008.stdout: "duration": 0 2023-08-01T19:55:50.815 INFO:teuthology.orchestra.run.smithi008.stdout: }, 2023-08-01T19:55:50.815 INFO:teuthology.orchestra.run.smithi008.stdout: { 2023-08-01T19:55:50.815 INFO:teuthology.orchestra.run.smithi008.stdout: "event": "header_read", 2023-08-01T19:55:50.815 INFO:teuthology.orchestra.run.smithi008.stdout: "time": "2023-08-01T19:55:05.566630+0000", 2023-08-01T19:55:50.816 INFO:teuthology.orchestra.run.smithi008.stdout: "duration": 4294967295.9999962 2023-08-01T19:55:50.816 INFO:teuthology.orchestra.run.smithi008.stdout: }, 2023-08-01T19:55:50.816 INFO:teuthology.orchestra.run.smithi008.stdout: { 2023-08-01T19:55:50.816 INFO:teuthology.orchestra.run.smithi008.stdout: "event": "all_read", 2023-08-01T19:55:50.816 INFO:teuthology.orchestra.run.smithi008.stdout: "time": "2023-08-01T19:55:05.566736+0000", 2023-08-01T19:55:50.816 INFO:teuthology.orchestra.run.smithi008.stdout: "duration": 0.000105752 2023-08-01T19:55:50.816 INFO:teuthology.orchestra.run.smithi008.stdout: }, 2023-08-01T19:55:50.817 INFO:teuthology.orchestra.run.smithi008.stdout: { 2023-08-01T19:55:50.817 INFO:teuthology.orchestra.run.smithi008.stdout: "event": "dispatched", 2023-08-01T19:55:50.817 INFO:teuthology.orchestra.run.smithi008.stdout: "time": "2023-08-01T19:55:05.566742+0000", 2023-08-01T19:55:50.817 INFO:teuthology.orchestra.run.smithi008.stdout: "duration": 5.8209999999999998e-06 2023-08-01T19:55:50.817 INFO:teuthology.orchestra.run.smithi008.stdout: }, 2023-08-01T19:55:50.817 INFO:teuthology.orchestra.run.smithi008.stdout: { 2023-08-01T19:55:50.817 INFO:teuthology.orchestra.run.smithi008.stdout: "event": "queued_for_pg", 2023-08-01T19:55:50.817 INFO:teuthology.orchestra.run.smithi008.stdout: "time": "2023-08-01T19:55:05.566745+0000", 2023-08-01T19:55:50.818 INFO:teuthology.orchestra.run.smithi008.stdout: "duration": 3.337e-06 2023-08-01T19:55:50.818 INFO:teuthology.orchestra.run.smithi008.stdout: }, 2023-08-01T19:55:50.818 INFO:teuthology.orchestra.run.smithi008.stdout: { 2023-08-01T19:55:50.818 INFO:teuthology.orchestra.run.smithi008.stdout: "event": "reached_pg", 2023-08-01T19:55:50.818 INFO:teuthology.orchestra.run.smithi008.stdout: "time": "2023-08-01T19:55:05.568175+0000", 2023-08-01T19:55:50.818 INFO:teuthology.orchestra.run.smithi008.stdout: "duration": 0.001429647 2023-08-01T19:55:50.818 INFO:teuthology.orchestra.run.smithi008.stdout: }, 2023-08-01T19:55:50.818 INFO:teuthology.orchestra.run.smithi008.stdout: { 2023-08-01T19:55:50.819 INFO:teuthology.orchestra.run.smithi008.stdout: "event": "started", 2023-08-01T19:55:50.819 INFO:teuthology.orchestra.run.smithi008.stdout: "time": "2023-08-01T19:55:05.568288+0000", 2023-08-01T19:55:50.819 INFO:teuthology.orchestra.run.smithi008.stdout: "duration": 0.000113353 2023-08-01T19:55:50.819 INFO:teuthology.orchestra.run.smithi008.stdout: }, 2023-08-01T19:55:50.819 INFO:teuthology.orchestra.run.smithi008.stdout: { 2023-08-01T19:55:50.819 INFO:teuthology.orchestra.run.smithi008.stdout: "event": "waiting for subops from 1", 2023-08-01T19:55:50.819 INFO:teuthology.orchestra.run.smithi008.stdout: "time": "2023-08-01T19:55:05.568425+0000", 2023-08-01T19:55:50.819 INFO:teuthology.orchestra.run.smithi008.stdout: "duration": 0.000137346 2023-08-01T19:55:50.820 INFO:teuthology.orchestra.run.smithi008.stdout: }, 2023-08-01T19:55:50.820 INFO:teuthology.orchestra.run.smithi008.stdout: { 2023-08-01T19:55:50.820 INFO:teuthology.orchestra.run.smithi008.stdout: "event": "sub_op_commit_rec", 2023-08-01T19:55:50.820 INFO:teuthology.orchestra.run.smithi008.stdout: "time": "2023-08-01T19:55:05.629320+0000", 2023-08-01T19:55:50.820 INFO:teuthology.orchestra.run.smithi008.stdout: "duration": 0.060894491000000002 2023-08-01T19:55:50.820 INFO:teuthology.orchestra.run.smithi008.stdout: }, 2023-08-01T19:55:50.820 INFO:teuthology.orchestra.run.smithi008.stdout: { 2023-08-01T19:55:50.820 INFO:teuthology.orchestra.run.smithi008.stdout: "event": "op_commit", 2023-08-01T19:55:50.821 INFO:teuthology.orchestra.run.smithi008.stdout: "time": "2023-08-01T19:55:05.632452+0000", 2023-08-01T19:55:50.821 INFO:teuthology.orchestra.run.smithi008.stdout: "duration": 0.003131909 2023-08-01T19:55:50.821 INFO:teuthology.orchestra.run.smithi008.stdout: }, 2023-08-01T19:55:50.821 INFO:teuthology.orchestra.run.smithi008.stdout: { 2023-08-01T19:55:50.821 INFO:teuthology.orchestra.run.smithi008.stdout: "event": "commit_sent", 2023-08-01T19:55:50.821 INFO:teuthology.orchestra.run.smithi008.stdout: "time": "2023-08-01T19:55:05.632503+0000", 2023-08-01T19:55:50.821 INFO:teuthology.orchestra.run.smithi008.stdout: "duration": 5.1295000000000003e-05 2023-08-01T19:55:50.821 INFO:teuthology.orchestra.run.smithi008.stdout: }, 2023-08-01T19:55:50.822 INFO:teuthology.orchestra.run.smithi008.stdout: { 2023-08-01T19:55:50.822 INFO:teuthology.orchestra.run.smithi008.stdout: "event": "done", 2023-08-01T19:55:50.822 INFO:teuthology.orchestra.run.smithi008.stdout: "time": "2023-08-01T19:55:05.632543+0000", 2023-08-01T19:55:50.822 INFO:teuthology.orchestra.run.smithi008.stdout: "duration": 4.0234000000000001e-05 2023-08-01T19:55:50.822 INFO:teuthology.orchestra.run.smithi008.stdout: } 2023-08-01T19:55:50.822 INFO:teuthology.orchestra.run.smithi008.stdout: ] 2023-08-01T19:55:50.822 INFO:teuthology.orchestra.run.smithi008.stdout: } 2023-08-01T19:55:50.823 INFO:teuthology.orchestra.run.smithi008.stdout: }, 2023-08-01T19:55:50.823 INFO:teuthology.orchestra.run.smithi008.stdout: { 2023-08-01T19:55:50.823 INFO:teuthology.orchestra.run.smithi008.stdout: "description": "osd_repop(client.4668.0:100935 5.e e37/19 5:7895b14e:::benchmark_data_smithi006_114134_object100934:head v 37'6305, mlcod=37'6303)", 2023-08-01T19:55:50.823 INFO:teuthology.orchestra.run.smithi008.stdout: "initiated_at": "2023-08-01T19:55:05.567118+0000", 2023-08-01T19:55:50.823 INFO:teuthology.orchestra.run.smithi008.stdout: "age": 45.163860700000001, 2023-08-01T19:55:50.823 INFO:teuthology.orchestra.run.smithi008.stdout: "duration": 0.063691180999999999, 2023-08-01T19:55:50.823 INFO:teuthology.orchestra.run.smithi008.stdout: "type_data": { 2023-08-01T19:55:50.823 INFO:teuthology.orchestra.run.smithi008.stdout: "flag_point": "commit sent; apply or cleanup", 2023-08-01T19:55:50.824 INFO:teuthology.orchestra.run.smithi008.stdout: "events": [ 2023-08-01T19:55:50.824 INFO:teuthology.orchestra.run.smithi008.stdout: { 2023-08-01T19:55:50.824 INFO:teuthology.orchestra.run.smithi008.stdout: "event": "initiated", 2023-08-01T19:55:50.824 INFO:teuthology.orchestra.run.smithi008.stdout: "time": "2023-08-01T19:55:05.567118+0000", 2023-08-01T19:55:50.824 INFO:teuthology.orchestra.run.smithi008.stdout: "duration": 0 2023-08-01T19:55:50.824 INFO:teuthology.orchestra.run.smithi008.stdout: }, 2023-08-01T19:55:50.824 INFO:teuthology.orchestra.run.smithi008.stdout: { 2023-08-01T19:55:50.824 INFO:teuthology.orchestra.run.smithi008.stdout: "event": "throttled", 2023-08-01T19:55:50.825 INFO:teuthology.orchestra.run.smithi008.stdout: "time": "2023-08-01T19:55:05.567118+0000", 2023-08-01T19:55:50.825 INFO:teuthology.orchestra.run.smithi008.stdout: "duration": 0 2023-08-01T19:55:50.825 INFO:teuthology.orchestra.run.smithi008.stdout: }, 2023-08-01T19:55:50.825 INFO:teuthology.orchestra.run.smithi008.stdout: { 2023-08-01T19:55:50.825 INFO:teuthology.orchestra.run.smithi008.stdout: "event": "header_read", 2023-08-01T19:55:50.825 INFO:teuthology.orchestra.run.smithi008.stdout: "time": "2023-08-01T19:55:05.567117+0000", 2023-08-01T19:55:50.825 INFO:teuthology.orchestra.run.smithi008.stdout: "duration": 4294967295.999999 2023-08-01T19:55:50.825 INFO:teuthology.orchestra.run.smithi008.stdout: }, 2023-08-01T19:55:50.826 INFO:teuthology.orchestra.run.smithi008.stdout: { 2023-08-01T19:55:50.826 INFO:teuthology.orchestra.run.smithi008.stdout: "event": "all_read", 2023-08-01T19:55:50.826 INFO:teuthology.orchestra.run.smithi008.stdout: "time": "2023-08-01T19:55:05.567168+0000", 2023-08-01T19:55:50.826 INFO:teuthology.orchestra.run.smithi008.stdout: "duration": 5.0353999999999999e-05 2023-08-01T19:55:50.826 INFO:teuthology.orchestra.run.smithi008.stdout: }, 2023-08-01T19:55:50.826 INFO:teuthology.orchestra.run.smithi008.stdout: { 2023-08-01T19:55:50.826 INFO:teuthology.orchestra.run.smithi008.stdout: "event": "dispatched", 2023-08-01T19:55:50.826 INFO:teuthology.orchestra.run.smithi008.stdout: "time": "2023-08-01T19:55:05.567175+0000", 2023-08-01T19:55:50.827 INFO:teuthology.orchestra.run.smithi008.stdout: "duration": 7.3919999999999997e-06 2023-08-01T19:55:50.827 INFO:teuthology.orchestra.run.smithi008.stdout: }, 2023-08-01T19:55:50.827 INFO:teuthology.orchestra.run.smithi008.stdout: { 2023-08-01T19:55:50.827 INFO:teuthology.orchestra.run.smithi008.stdout: "event": "queued_for_pg", 2023-08-01T19:55:50.827 INFO:teuthology.orchestra.run.smithi008.stdout: "time": "2023-08-01T19:55:05.567180+0000", 2023-08-01T19:55:50.827 INFO:teuthology.orchestra.run.smithi008.stdout: "duration": 5.3090000000000003e-06 2023-08-01T19:55:50.827 INFO:teuthology.orchestra.run.smithi008.stdout: }, 2023-08-01T19:55:50.827 INFO:teuthology.orchestra.run.smithi008.stdout: { 2023-08-01T19:55:50.828 INFO:teuthology.orchestra.run.smithi008.stdout: "event": "reached_pg", 2023-08-01T19:55:50.828 INFO:teuthology.orchestra.run.smithi008.stdout: "time": "2023-08-01T19:55:05.567210+0000", 2023-08-01T19:55:50.828 INFO:teuthology.orchestra.run.smithi008.stdout: "duration": 3.0001999999999998e-05 2023-08-01T19:55:50.828 INFO:teuthology.orchestra.run.smithi008.stdout: }, 2023-08-01T19:55:50.828 INFO:teuthology.orchestra.run.smithi008.stdout: { 2023-08-01T19:55:50.828 INFO:teuthology.orchestra.run.smithi008.stdout: "event": "started", 2023-08-01T19:55:50.828 INFO:teuthology.orchestra.run.smithi008.stdout: "time": "2023-08-01T19:55:05.567222+0000", 2023-08-01T19:55:50.828 INFO:teuthology.orchestra.run.smithi008.stdout: "duration": 1.1499e-05 2023-08-01T19:55:50.829 INFO:teuthology.orchestra.run.smithi008.stdout: }, 2023-08-01T19:55:50.829 INFO:teuthology.orchestra.run.smithi008.stdout: { 2023-08-01T19:55:50.829 INFO:teuthology.orchestra.run.smithi008.stdout: "event": "commit_sent", 2023-08-01T19:55:50.829 INFO:teuthology.orchestra.run.smithi008.stdout: "time": "2023-08-01T19:55:05.630772+0000", 2023-08-01T19:55:50.829 INFO:teuthology.orchestra.run.smithi008.stdout: "duration": 0.063550572999999999 2023-08-01T19:55:50.829 INFO:teuthology.orchestra.run.smithi008.stdout: }, 2023-08-01T19:55:50.829 INFO:teuthology.orchestra.run.smithi008.stdout: { 2023-08-01T19:55:50.829 INFO:teuthology.orchestra.run.smithi008.stdout: "event": "done", 2023-08-01T19:55:50.830 INFO:teuthology.orchestra.run.smithi008.stdout: "time": "2023-08-01T19:55:05.630809+0000", 2023-08-01T19:55:50.830 INFO:teuthology.orchestra.run.smithi008.stdout: "duration": 3.7033000000000003e-05 2023-08-01T19:55:50.830 INFO:teuthology.orchestra.run.smithi008.stdout: } 2023-08-01T19:55:50.830 INFO:teuthology.orchestra.run.smithi008.stdout: ] 2023-08-01T19:55:50.830 INFO:teuthology.orchestra.run.smithi008.stdout: } 2023-08-01T19:55:50.830 INFO:teuthology.orchestra.run.smithi008.stdout: }, 2023-08-01T19:55:50.830 INFO:teuthology.orchestra.run.smithi008.stdout: { 2023-08-01T19:55:50.831 INFO:teuthology.orchestra.run.smithi008.stdout: "description": "osd_repop(client.4668.0:100936 5.1 e37/19 5:8f4e3576:::benchmark_data_smithi006_114134_object100935:head v 37'6263, mlcod=37'6261)", 2023-08-01T19:55:50.831 INFO:teuthology.orchestra.run.smithi008.stdout: "initiated_at": "2023-08-01T19:55:05.567617+0000", 2023-08-01T19:55:50.831 INFO:teuthology.orchestra.run.smithi008.stdout: "age": 45.163361436999999, 2023-08-01T19:55:50.831 INFO:teuthology.orchestra.run.smithi008.stdout: "duration": 0.062773918999999997, 2023-08-01T19:55:50.831 INFO:teuthology.orchestra.run.smithi008.stdout: "type_data": { 2023-08-01T19:55:50.831 INFO:teuthology.orchestra.run.smithi008.stdout: "flag_point": "commit sent; apply or cleanup", 2023-08-01T19:55:50.831 INFO:teuthology.orchestra.run.smithi008.stdout: "events": [ 2023-08-01T19:55:50.831 INFO:teuthology.orchestra.run.smithi008.stdout: { 2023-08-01T19:55:50.832 INFO:teuthology.orchestra.run.smithi008.stdout: "event": "initiated", 2023-08-01T19:55:50.832 INFO:teuthology.orchestra.run.smithi008.stdout: "time": "2023-08-01T19:55:05.567617+0000", 2023-08-01T19:55:50.832 INFO:teuthology.orchestra.run.smithi008.stdout: "duration": 0 2023-08-01T19:55:50.832 INFO:teuthology.orchestra.run.smithi008.stdout: }, 2023-08-01T19:55:50.832 INFO:teuthology.orchestra.run.smithi008.stdout: { 2023-08-01T19:55:50.832 INFO:teuthology.orchestra.run.smithi008.stdout: "event": "throttled", 2023-08-01T19:55:50.832 INFO:teuthology.orchestra.run.smithi008.stdout: "time": "2023-08-01T19:55:05.567617+0000", 2023-08-01T19:55:50.832 INFO:teuthology.orchestra.run.smithi008.stdout: "duration": 0 2023-08-01T19:55:50.833 INFO:teuthology.orchestra.run.smithi008.stdout: }, 2023-08-01T19:55:50.833 INFO:teuthology.orchestra.run.smithi008.stdout: { 2023-08-01T19:55:50.833 INFO:teuthology.orchestra.run.smithi008.stdout: "event": "header_read", 2023-08-01T19:55:50.833 INFO:teuthology.orchestra.run.smithi008.stdout: "time": "2023-08-01T19:55:05.567617+0000", 2023-08-01T19:55:50.833 INFO:teuthology.orchestra.run.smithi008.stdout: "duration": 4294967295.9999995 2023-08-01T19:55:50.833 INFO:teuthology.orchestra.run.smithi008.stdout: }, 2023-08-01T19:55:50.833 INFO:teuthology.orchestra.run.smithi008.stdout: { 2023-08-01T19:55:50.833 INFO:teuthology.orchestra.run.smithi008.stdout: "event": "all_read", 2023-08-01T19:55:50.834 INFO:teuthology.orchestra.run.smithi008.stdout: "time": "2023-08-01T19:55:05.567700+0000", 2023-08-01T19:55:50.834 INFO:teuthology.orchestra.run.smithi008.stdout: "duration": 8.3363999999999997e-05 2023-08-01T19:55:50.834 INFO:teuthology.orchestra.run.smithi008.stdout: }, 2023-08-01T19:55:50.834 INFO:teuthology.orchestra.run.smithi008.stdout: { 2023-08-01T19:55:50.834 INFO:teuthology.orchestra.run.smithi008.stdout: "event": "dispatched", 2023-08-01T19:55:50.834 INFO:teuthology.orchestra.run.smithi008.stdout: "time": "2023-08-01T19:55:05.567706+0000", 2023-08-01T19:55:50.834 INFO:teuthology.orchestra.run.smithi008.stdout: "duration": 5.9739999999999999e-06 2023-08-01T19:55:50.835 INFO:teuthology.orchestra.run.smithi008.stdout: }, 2023-08-01T19:55:50.835 INFO:teuthology.orchestra.run.smithi008.stdout: { 2023-08-01T19:55:50.835 INFO:teuthology.orchestra.run.smithi008.stdout: "event": "queued_for_pg", 2023-08-01T19:55:50.835 INFO:teuthology.orchestra.run.smithi008.stdout: "time": "2023-08-01T19:55:05.567709+0000", 2023-08-01T19:55:50.835 INFO:teuthology.orchestra.run.smithi008.stdout: "duration": 3.1420000000000002e-06 2023-08-01T19:55:50.835 INFO:teuthology.orchestra.run.smithi008.stdout: }, 2023-08-01T19:55:50.835 INFO:teuthology.orchestra.run.smithi008.stdout: { 2023-08-01T19:55:50.835 INFO:teuthology.orchestra.run.smithi008.stdout: "event": "reached_pg", 2023-08-01T19:55:50.836 INFO:teuthology.orchestra.run.smithi008.stdout: "time": "2023-08-01T19:55:05.567741+0000", 2023-08-01T19:55:50.836 INFO:teuthology.orchestra.run.smithi008.stdout: "duration": 3.1532999999999998e-05 2023-08-01T19:55:50.836 INFO:teuthology.orchestra.run.smithi008.stdout: }, 2023-08-01T19:55:50.836 INFO:teuthology.orchestra.run.smithi008.stdout: { 2023-08-01T19:55:50.836 INFO:teuthology.orchestra.run.smithi008.stdout: "event": "started", 2023-08-01T19:55:50.836 INFO:teuthology.orchestra.run.smithi008.stdout: "time": "2023-08-01T19:55:05.567752+0000", 2023-08-01T19:55:50.836 INFO:teuthology.orchestra.run.smithi008.stdout: "duration": 1.1266e-05 2023-08-01T19:55:50.836 INFO:teuthology.orchestra.run.smithi008.stdout: }, 2023-08-01T19:55:50.837 INFO:teuthology.orchestra.run.smithi008.stdout: { 2023-08-01T19:55:50.837 INFO:teuthology.orchestra.run.smithi008.stdout: "event": "commit_sent", 2023-08-01T19:55:50.837 INFO:teuthology.orchestra.run.smithi008.stdout: "time": "2023-08-01T19:55:05.630357+0000", 2023-08-01T19:55:50.837 INFO:teuthology.orchestra.run.smithi008.stdout: "duration": 0.062604554000000007 2023-08-01T19:55:50.837 INFO:teuthology.orchestra.run.smithi008.stdout: }, 2023-08-01T19:55:50.837 INFO:teuthology.orchestra.run.smithi008.stdout: { 2023-08-01T19:55:50.837 INFO:teuthology.orchestra.run.smithi008.stdout: "event": "done", 2023-08-01T19:55:50.837 INFO:teuthology.orchestra.run.smithi008.stdout: "time": "2023-08-01T19:55:05.630391+0000", 2023-08-01T19:55:50.838 INFO:teuthology.orchestra.run.smithi008.stdout: "duration": 3.4619000000000002e-05 2023-08-01T19:55:50.838 INFO:teuthology.orchestra.run.smithi008.stdout: } 2023-08-01T19:55:50.838 INFO:teuthology.orchestra.run.smithi008.stdout: ] 2023-08-01T19:55:50.838 INFO:teuthology.orchestra.run.smithi008.stdout: } 2023-08-01T19:55:50.838 INFO:teuthology.orchestra.run.smithi008.stdout: }, 2023-08-01T19:55:50.838 INFO:teuthology.orchestra.run.smithi008.stdout: { 2023-08-01T19:55:50.838 INFO:teuthology.orchestra.run.smithi008.stdout: "description": "osd_op(client.4668.0:100937 5.c 5:34445fc3:::benchmark_data_smithi006_114134_object100936:head [set-alloc-hint object_size 65536 write_size 65536,write 0~65536] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e37)", 2023-08-01T19:55:50.838 INFO:teuthology.orchestra.run.smithi008.stdout: "initiated_at": "2023-08-01T19:55:05.569198+0000", 2023-08-01T19:55:50.839 INFO:teuthology.orchestra.run.smithi008.stdout: "age": 45.161780813999997, 2023-08-01T19:55:50.839 INFO:teuthology.orchestra.run.smithi008.stdout: "duration": 0.063349390000000005, 2023-08-01T19:55:50.839 INFO:teuthology.orchestra.run.smithi008.stdout: "type_data": { 2023-08-01T19:55:50.839 INFO:teuthology.orchestra.run.smithi008.stdout: "flag_point": "commit sent; apply or cleanup", 2023-08-01T19:55:50.839 INFO:teuthology.orchestra.run.smithi008.stdout: "client_info": { 2023-08-01T19:55:50.839 INFO:teuthology.orchestra.run.smithi008.stdout: "client": "client.4668", 2023-08-01T19:55:50.839 INFO:teuthology.orchestra.run.smithi008.stdout: "client_addr": "172.21.15.6:0/1709472247", 2023-08-01T19:55:50.839 INFO:teuthology.orchestra.run.smithi008.stdout: "tid": 100937 2023-08-01T19:55:50.840 INFO:teuthology.orchestra.run.smithi008.stdout: }, 2023-08-01T19:55:50.840 INFO:teuthology.orchestra.run.smithi008.stdout: "events": [ 2023-08-01T19:55:50.840 INFO:teuthology.orchestra.run.smithi008.stdout: { 2023-08-01T19:55:50.840 INFO:teuthology.orchestra.run.smithi008.stdout: "event": "initiated", 2023-08-01T19:55:50.840 INFO:teuthology.orchestra.run.smithi008.stdout: "time": "2023-08-01T19:55:05.569198+0000", 2023-08-01T19:55:50.840 INFO:teuthology.orchestra.run.smithi008.stdout: "duration": 0 2023-08-01T19:55:50.840 INFO:teuthology.orchestra.run.smithi008.stdout: }, 2023-08-01T19:55:50.841 INFO:teuthology.orchestra.run.smithi008.stdout: { 2023-08-01T19:55:50.841 INFO:teuthology.orchestra.run.smithi008.stdout: "event": "throttled", 2023-08-01T19:55:50.841 INFO:teuthology.orchestra.run.smithi008.stdout: "time": "2023-08-01T19:55:05.569198+0000", 2023-08-01T19:55:50.841 INFO:teuthology.orchestra.run.smithi008.stdout: "duration": 0 2023-08-01T19:55:50.841 INFO:teuthology.orchestra.run.smithi008.stdout: }, 2023-08-01T19:55:50.841 INFO:teuthology.orchestra.run.smithi008.stdout: { 2023-08-01T19:55:50.841 INFO:teuthology.orchestra.run.smithi008.stdout: "event": "header_read", 2023-08-01T19:55:50.841 INFO:teuthology.orchestra.run.smithi008.stdout: "time": "2023-08-01T19:55:05.569197+0000", 2023-08-01T19:55:50.842 INFO:teuthology.orchestra.run.smithi008.stdout: "duration": 4294967295.999999 2023-08-01T19:55:50.842 INFO:teuthology.orchestra.run.smithi008.stdout: }, 2023-08-01T19:55:50.842 INFO:teuthology.orchestra.run.smithi008.stdout: { 2023-08-01T19:55:50.842 INFO:teuthology.orchestra.run.smithi008.stdout: "event": "all_read", 2023-08-01T19:55:50.842 INFO:teuthology.orchestra.run.smithi008.stdout: "time": "2023-08-01T19:55:05.569250+0000", 2023-08-01T19:55:50.842 INFO:teuthology.orchestra.run.smithi008.stdout: "duration": 5.3106000000000003e-05 2023-08-01T19:55:50.842 INFO:teuthology.orchestra.run.smithi008.stdout: }, 2023-08-01T19:55:50.842 INFO:teuthology.orchestra.run.smithi008.stdout: { 2023-08-01T19:55:50.843 INFO:teuthology.orchestra.run.smithi008.stdout: "event": "dispatched", 2023-08-01T19:55:50.843 INFO:teuthology.orchestra.run.smithi008.stdout: "time": "2023-08-01T19:55:05.569260+0000", 2023-08-01T19:55:50.843 INFO:teuthology.orchestra.run.smithi008.stdout: "duration": 9.533e-06 2023-08-01T19:55:50.843 INFO:teuthology.orchestra.run.smithi008.stdout: }, 2023-08-01T19:55:50.843 INFO:teuthology.orchestra.run.smithi008.stdout: { 2023-08-01T19:55:50.843 INFO:teuthology.orchestra.run.smithi008.stdout: "event": "queued_for_pg", 2023-08-01T19:55:50.843 INFO:teuthology.orchestra.run.smithi008.stdout: "time": "2023-08-01T19:55:05.569264+0000", 2023-08-01T19:55:50.843 INFO:teuthology.orchestra.run.smithi008.stdout: "duration": 4.6099999999999999e-06 2023-08-01T19:55:50.844 INFO:teuthology.orchestra.run.smithi008.stdout: }, 2023-08-01T19:55:50.844 INFO:teuthology.orchestra.run.smithi008.stdout: { 2023-08-01T19:55:50.844 INFO:teuthology.orchestra.run.smithi008.stdout: "event": "reached_pg", 2023-08-01T19:55:50.844 INFO:teuthology.orchestra.run.smithi008.stdout: "time": "2023-08-01T19:55:05.569293+0000", 2023-08-01T19:55:50.844 INFO:teuthology.orchestra.run.smithi008.stdout: "duration": 2.8181999999999999e-05 2023-08-01T19:55:50.844 INFO:teuthology.orchestra.run.smithi008.stdout: }, 2023-08-01T19:55:50.844 INFO:teuthology.orchestra.run.smithi008.stdout: { 2023-08-01T19:55:50.844 INFO:teuthology.orchestra.run.smithi008.stdout: "event": "started", 2023-08-01T19:55:50.845 INFO:teuthology.orchestra.run.smithi008.stdout: "time": "2023-08-01T19:55:05.569401+0000", 2023-08-01T19:55:50.845 INFO:teuthology.orchestra.run.smithi008.stdout: "duration": 0.000108065 2023-08-01T19:55:50.845 INFO:teuthology.orchestra.run.smithi008.stdout: }, 2023-08-01T19:55:50.845 INFO:teuthology.orchestra.run.smithi008.stdout: { 2023-08-01T19:55:50.845 INFO:teuthology.orchestra.run.smithi008.stdout: "event": "waiting for subops from 1", 2023-08-01T19:55:50.845 INFO:teuthology.orchestra.run.smithi008.stdout: "time": "2023-08-01T19:55:05.569521+0000", 2023-08-01T19:55:50.845 INFO:teuthology.orchestra.run.smithi008.stdout: "duration": 0.00012006900000000001 2023-08-01T19:55:50.846 INFO:teuthology.orchestra.run.smithi008.stdout: }, 2023-08-01T19:55:50.846 INFO:teuthology.orchestra.run.smithi008.stdout: { 2023-08-01T19:55:50.846 INFO:teuthology.orchestra.run.smithi008.stdout: "event": "sub_op_commit_rec", 2023-08-01T19:55:50.846 INFO:teuthology.orchestra.run.smithi008.stdout: "time": "2023-08-01T19:55:05.629421+0000", 2023-08-01T19:55:50.846 INFO:teuthology.orchestra.run.smithi008.stdout: "duration": 0.059900525000000003 2023-08-01T19:55:50.846 INFO:teuthology.orchestra.run.smithi008.stdout: }, 2023-08-01T19:55:50.846 INFO:teuthology.orchestra.run.smithi008.stdout: { 2023-08-01T19:55:50.846 INFO:teuthology.orchestra.run.smithi008.stdout: "event": "op_commit", 2023-08-01T19:55:50.847 INFO:teuthology.orchestra.run.smithi008.stdout: "time": "2023-08-01T19:55:05.632461+0000", 2023-08-01T19:55:50.847 INFO:teuthology.orchestra.run.smithi008.stdout: "duration": 0.0030401220000000001 2023-08-01T19:55:50.847 INFO:teuthology.orchestra.run.smithi008.stdout: }, 2023-08-01T19:55:50.847 INFO:teuthology.orchestra.run.smithi008.stdout: { 2023-08-01T19:55:50.847 INFO:teuthology.orchestra.run.smithi008.stdout: "event": "commit_sent", 2023-08-01T19:55:50.847 INFO:teuthology.orchestra.run.smithi008.stdout: "time": "2023-08-01T19:55:05.632507+0000", 2023-08-01T19:55:50.847 INFO:teuthology.orchestra.run.smithi008.stdout: "duration": 4.5361999999999997e-05 2023-08-01T19:55:50.847 INFO:teuthology.orchestra.run.smithi008.stdout: }, 2023-08-01T19:55:50.848 INFO:teuthology.orchestra.run.smithi008.stdout: { 2023-08-01T19:55:50.848 INFO:teuthology.orchestra.run.smithi008.stdout: "event": "done", 2023-08-01T19:55:50.848 INFO:teuthology.orchestra.run.smithi008.stdout: "time": "2023-08-01T19:55:05.632547+0000", 2023-08-01T19:55:50.848 INFO:teuthology.orchestra.run.smithi008.stdout: "duration": 4.0760999999999998e-05 2023-08-01T19:55:50.848 INFO:teuthology.orchestra.run.smithi008.stdout: } 2023-08-01T19:55:50.848 INFO:teuthology.orchestra.run.smithi008.stdout: ] 2023-08-01T19:55:50.848 INFO:teuthology.orchestra.run.smithi008.stdout: } 2023-08-01T19:55:50.848 INFO:teuthology.orchestra.run.smithi008.stdout: }, 2023-08-01T19:55:50.849 INFO:teuthology.orchestra.run.smithi008.stdout: { 2023-08-01T19:55:50.849 INFO:teuthology.orchestra.run.smithi008.stdout: "description": "osd_op(client.4668.0:100939 5.5 5:a75fa6e3:::benchmark_data_smithi006_114134_object100938:head [set-alloc-hint object_size 65536 write_size 65536,write 0~65536] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e37)", 2023-08-01T19:55:50.849 INFO:teuthology.orchestra.run.smithi008.stdout: "initiated_at": "2023-08-01T19:55:05.569740+0000", 2023-08-01T19:55:50.849 INFO:teuthology.orchestra.run.smithi008.stdout: "age": 45.161239272000003, 2023-08-01T19:55:50.849 INFO:teuthology.orchestra.run.smithi008.stdout: "duration": 0.067753412999999998, 2023-08-01T19:55:50.849 INFO:teuthology.orchestra.run.smithi008.stdout: "type_data": { 2023-08-01T19:55:50.849 INFO:teuthology.orchestra.run.smithi008.stdout: "flag_point": "commit sent; apply or cleanup", 2023-08-01T19:55:50.849 INFO:teuthology.orchestra.run.smithi008.stdout: "client_info": { 2023-08-01T19:55:50.850 INFO:teuthology.orchestra.run.smithi008.stdout: "client": "client.4668", 2023-08-01T19:55:50.850 INFO:teuthology.orchestra.run.smithi008.stdout: "client_addr": "172.21.15.6:0/1709472247", 2023-08-01T19:55:50.850 INFO:teuthology.orchestra.run.smithi008.stdout: "tid": 100939 2023-08-01T19:55:50.850 INFO:teuthology.orchestra.run.smithi008.stdout: }, 2023-08-01T19:55:50.850 INFO:teuthology.orchestra.run.smithi008.stdout: "events": [ 2023-08-01T19:55:50.850 INFO:teuthology.orchestra.run.smithi008.stdout: { 2023-08-01T19:55:50.850 INFO:teuthology.orchestra.run.smithi008.stdout: "event": "initiated", 2023-08-01T19:55:50.850 INFO:teuthology.orchestra.run.smithi008.stdout: "time": "2023-08-01T19:55:05.569740+0000", 2023-08-01T19:55:50.851 INFO:teuthology.orchestra.run.smithi008.stdout: "duration": 0 2023-08-01T19:55:50.851 INFO:teuthology.orchestra.run.smithi008.stdout: }, 2023-08-01T19:55:50.851 INFO:teuthology.orchestra.run.smithi008.stdout: { 2023-08-01T19:55:50.851 INFO:teuthology.orchestra.run.smithi008.stdout: "event": "throttled", 2023-08-01T19:55:50.851 INFO:teuthology.orchestra.run.smithi008.stdout: "time": "2023-08-01T19:55:05.569740+0000", 2023-08-01T19:55:50.851 INFO:teuthology.orchestra.run.smithi008.stdout: "duration": 0 2023-08-01T19:55:50.851 INFO:teuthology.orchestra.run.smithi008.stdout: }, 2023-08-01T19:55:50.851 INFO:teuthology.orchestra.run.smithi008.stdout: { 2023-08-01T19:55:50.852 INFO:teuthology.orchestra.run.smithi008.stdout: "event": "header_read", 2023-08-01T19:55:50.852 INFO:teuthology.orchestra.run.smithi008.stdout: "time": "2023-08-01T19:55:05.569739+0000", 2023-08-01T19:55:50.852 INFO:teuthology.orchestra.run.smithi008.stdout: "duration": 4294967295.9999995 2023-08-01T19:55:50.852 INFO:teuthology.orchestra.run.smithi008.stdout: }, 2023-08-01T19:55:50.852 INFO:teuthology.orchestra.run.smithi008.stdout: { 2023-08-01T19:55:50.852 INFO:teuthology.orchestra.run.smithi008.stdout: "event": "all_read", 2023-08-01T19:55:50.852 INFO:teuthology.orchestra.run.smithi008.stdout: "time": "2023-08-01T19:55:05.569839+0000", 2023-08-01T19:55:50.852 INFO:teuthology.orchestra.run.smithi008.stdout: "duration": 0.000100219 2023-08-01T19:55:50.853 INFO:teuthology.orchestra.run.smithi008.stdout: }, 2023-08-01T19:55:50.853 INFO:teuthology.orchestra.run.smithi008.stdout: { 2023-08-01T19:55:50.853 INFO:teuthology.orchestra.run.smithi008.stdout: "event": "dispatched", 2023-08-01T19:55:50.853 INFO:teuthology.orchestra.run.smithi008.stdout: "time": "2023-08-01T19:55:05.569846+0000", 2023-08-01T19:55:50.853 INFO:teuthology.orchestra.run.smithi008.stdout: "duration": 7.3150000000000003e-06 2023-08-01T19:55:50.853 INFO:teuthology.orchestra.run.smithi008.stdout: }, 2023-08-01T19:55:50.853 INFO:teuthology.orchestra.run.smithi008.stdout: { 2023-08-01T19:55:50.854 INFO:teuthology.orchestra.run.smithi008.stdout: "event": "queued_for_pg", 2023-08-01T19:55:50.854 INFO:teuthology.orchestra.run.smithi008.stdout: "time": "2023-08-01T19:55:05.569850+0000", 2023-08-01T19:55:50.854 INFO:teuthology.orchestra.run.smithi008.stdout: "duration": 3.3299999999999999e-06 2023-08-01T19:55:50.854 INFO:teuthology.orchestra.run.smithi008.stdout: }, 2023-08-01T19:55:50.854 INFO:teuthology.orchestra.run.smithi008.stdout: { 2023-08-01T19:55:50.854 INFO:teuthology.orchestra.run.smithi008.stdout: "event": "reached_pg", 2023-08-01T19:55:50.854 INFO:teuthology.orchestra.run.smithi008.stdout: "time": "2023-08-01T19:55:05.626991+0000", 2023-08-01T19:55:50.854 INFO:teuthology.orchestra.run.smithi008.stdout: "duration": 0.057141585000000002 2023-08-01T19:55:50.855 INFO:teuthology.orchestra.run.smithi008.stdout: }, 2023-08-01T19:55:50.855 INFO:teuthology.orchestra.run.smithi008.stdout: { 2023-08-01T19:55:50.855 INFO:teuthology.orchestra.run.smithi008.stdout: "event": "started", 2023-08-01T19:55:50.855 INFO:teuthology.orchestra.run.smithi008.stdout: "time": "2023-08-01T19:55:05.627111+0000", 2023-08-01T19:55:50.855 INFO:teuthology.orchestra.run.smithi008.stdout: "duration": 0.000119238 2023-08-01T19:55:50.855 INFO:teuthology.orchestra.run.smithi008.stdout: }, 2023-08-01T19:55:50.855 INFO:teuthology.orchestra.run.smithi008.stdout: { 2023-08-01T19:55:50.855 INFO:teuthology.orchestra.run.smithi008.stdout: "event": "waiting for subops from 1", 2023-08-01T19:55:50.856 INFO:teuthology.orchestra.run.smithi008.stdout: "time": "2023-08-01T19:55:05.627253+0000", 2023-08-01T19:55:50.856 INFO:teuthology.orchestra.run.smithi008.stdout: "duration": 0.000142822 2023-08-01T19:55:50.856 INFO:teuthology.orchestra.run.smithi008.stdout: }, 2023-08-01T19:55:50.856 INFO:teuthology.orchestra.run.smithi008.stdout: { 2023-08-01T19:55:50.856 INFO:teuthology.orchestra.run.smithi008.stdout: "event": "op_commit", 2023-08-01T19:55:50.856 INFO:teuthology.orchestra.run.smithi008.stdout: "time": "2023-08-01T19:55:05.632555+0000", 2023-08-01T19:55:50.856 INFO:teuthology.orchestra.run.smithi008.stdout: "duration": 0.0053012449999999996 2023-08-01T19:55:50.856 INFO:teuthology.orchestra.run.smithi008.stdout: }, 2023-08-01T19:55:50.857 INFO:teuthology.orchestra.run.smithi008.stdout: { 2023-08-01T19:55:50.857 INFO:teuthology.orchestra.run.smithi008.stdout: "event": "sub_op_commit_rec", 2023-08-01T19:55:50.857 INFO:teuthology.orchestra.run.smithi008.stdout: "time": "2023-08-01T19:55:05.637380+0000", 2023-08-01T19:55:50.857 INFO:teuthology.orchestra.run.smithi008.stdout: "duration": 0.0048257639999999997 2023-08-01T19:55:50.857 INFO:teuthology.orchestra.run.smithi008.stdout: }, 2023-08-01T19:55:50.857 INFO:teuthology.orchestra.run.smithi008.stdout: { 2023-08-01T19:55:50.857 INFO:teuthology.orchestra.run.smithi008.stdout: "event": "commit_sent", 2023-08-01T19:55:50.858 INFO:teuthology.orchestra.run.smithi008.stdout: "time": "2023-08-01T19:55:05.637454+0000", 2023-08-01T19:55:50.858 INFO:teuthology.orchestra.run.smithi008.stdout: "duration": 7.3578999999999995e-05 2023-08-01T19:55:50.858 INFO:teuthology.orchestra.run.smithi008.stdout: }, 2023-08-01T19:55:50.858 INFO:teuthology.orchestra.run.smithi008.stdout: { 2023-08-01T19:55:50.858 INFO:teuthology.orchestra.run.smithi008.stdout: "event": "done", 2023-08-01T19:55:50.858 INFO:teuthology.orchestra.run.smithi008.stdout: "time": "2023-08-01T19:55:05.637493+0000", 2023-08-01T19:55:50.858 INFO:teuthology.orchestra.run.smithi008.stdout: "duration": 3.8986999999999998e-05 2023-08-01T19:55:50.858 INFO:teuthology.orchestra.run.smithi008.stdout: } 2023-08-01T19:55:50.859 INFO:teuthology.orchestra.run.smithi008.stdout: ] 2023-08-01T19:55:50.859 INFO:teuthology.orchestra.run.smithi008.stdout: } 2023-08-01T19:55:50.859 INFO:teuthology.orchestra.run.smithi008.stdout: }, 2023-08-01T19:55:50.859 INFO:teuthology.orchestra.run.smithi008.stdout: { 2023-08-01T19:55:50.859 INFO:teuthology.orchestra.run.smithi008.stdout: "description": "osd_repop(client.4668.0:100941 5.e e37/19 5:736a6ac6:::benchmark_data_smithi006_114134_object100940:head v 37'6306, mlcod=37'6303)", 2023-08-01T19:55:50.859 INFO:teuthology.orchestra.run.smithi008.stdout: "initiated_at": "2023-08-01T19:55:05.570237+0000", 2023-08-01T19:55:50.859 INFO:teuthology.orchestra.run.smithi008.stdout: "age": 45.160741962000003, 2023-08-01T19:55:50.859 INFO:teuthology.orchestra.run.smithi008.stdout: "duration": 0.064830421999999999, 2023-08-01T19:55:50.860 INFO:teuthology.orchestra.run.smithi008.stdout: "type_data": { 2023-08-01T19:55:50.860 INFO:teuthology.orchestra.run.smithi008.stdout: "flag_point": "commit sent; apply or cleanup", 2023-08-01T19:55:50.860 INFO:teuthology.orchestra.run.smithi008.stdout: "events": [ 2023-08-01T19:55:50.860 INFO:teuthology.orchestra.run.smithi008.stdout: { 2023-08-01T19:55:50.860 INFO:teuthology.orchestra.run.smithi008.stdout: "event": "initiated", 2023-08-01T19:55:50.860 INFO:teuthology.orchestra.run.smithi008.stdout: "time": "2023-08-01T19:55:05.570237+0000", 2023-08-01T19:55:50.860 INFO:teuthology.orchestra.run.smithi008.stdout: "duration": 0 2023-08-01T19:55:50.860 INFO:teuthology.orchestra.run.smithi008.stdout: }, 2023-08-01T19:55:50.861 INFO:teuthology.orchestra.run.smithi008.stdout: { 2023-08-01T19:55:50.861 INFO:teuthology.orchestra.run.smithi008.stdout: "event": "throttled", 2023-08-01T19:55:50.861 INFO:teuthology.orchestra.run.smithi008.stdout: "time": "2023-08-01T19:55:05.570237+0000", 2023-08-01T19:55:50.861 INFO:teuthology.orchestra.run.smithi008.stdout: "duration": 0 2023-08-01T19:55:50.861 INFO:teuthology.orchestra.run.smithi008.stdout: }, 2023-08-01T19:55:50.861 INFO:teuthology.orchestra.run.smithi008.stdout: { 2023-08-01T19:55:50.861 INFO:teuthology.orchestra.run.smithi008.stdout: "event": "header_read", 2023-08-01T19:55:50.861 INFO:teuthology.orchestra.run.smithi008.stdout: "time": "2023-08-01T19:55:05.570236+0000", 2023-08-01T19:55:50.862 INFO:teuthology.orchestra.run.smithi008.stdout: "duration": 4294967295.9999995 2023-08-01T19:55:50.862 INFO:teuthology.orchestra.run.smithi008.stdout: }, 2023-08-01T19:55:50.862 INFO:teuthology.orchestra.run.smithi008.stdout: { 2023-08-01T19:55:50.862 INFO:teuthology.orchestra.run.smithi008.stdout: "event": "all_read", 2023-08-01T19:55:50.862 INFO:teuthology.orchestra.run.smithi008.stdout: "time": "2023-08-01T19:55:05.570354+0000", 2023-08-01T19:55:50.862 INFO:teuthology.orchestra.run.smithi008.stdout: "duration": 0.000118029 2023-08-01T19:55:50.862 INFO:teuthology.orchestra.run.smithi008.stdout: }, 2023-08-01T19:55:50.862 INFO:teuthology.orchestra.run.smithi008.stdout: { 2023-08-01T19:55:50.863 INFO:teuthology.orchestra.run.smithi008.stdout: "event": "dispatched", 2023-08-01T19:55:50.863 INFO:teuthology.orchestra.run.smithi008.stdout: "time": "2023-08-01T19:55:05.626649+0000", 2023-08-01T19:55:50.863 INFO:teuthology.orchestra.run.smithi008.stdout: "duration": 0.056294489000000003 2023-08-01T19:55:50.863 INFO:teuthology.orchestra.run.smithi008.stdout: }, 2023-08-01T19:55:50.863 INFO:teuthology.orchestra.run.smithi008.stdout: { 2023-08-01T19:55:50.863 INFO:teuthology.orchestra.run.smithi008.stdout: "event": "queued_for_pg", 2023-08-01T19:55:50.863 INFO:teuthology.orchestra.run.smithi008.stdout: "time": "2023-08-01T19:55:05.626676+0000", 2023-08-01T19:55:50.863 INFO:teuthology.orchestra.run.smithi008.stdout: "duration": 2.7228000000000001e-05 2023-08-01T19:55:50.864 INFO:teuthology.orchestra.run.smithi008.stdout: }, 2023-08-01T19:55:50.864 INFO:teuthology.orchestra.run.smithi008.stdout: { 2023-08-01T19:55:50.864 INFO:teuthology.orchestra.run.smithi008.stdout: "event": "reached_pg", 2023-08-01T19:55:50.864 INFO:teuthology.orchestra.run.smithi008.stdout: "time": "2023-08-01T19:55:05.626717+0000", 2023-08-01T19:55:50.864 INFO:teuthology.orchestra.run.smithi008.stdout: "duration": 4.1318e-05 2023-08-01T19:55:50.864 INFO:teuthology.orchestra.run.smithi008.stdout: }, 2023-08-01T19:55:50.864 INFO:teuthology.orchestra.run.smithi008.stdout: { 2023-08-01T19:55:50.865 INFO:teuthology.orchestra.run.smithi008.stdout: "event": "started", 2023-08-01T19:55:50.865 INFO:teuthology.orchestra.run.smithi008.stdout: "time": "2023-08-01T19:55:05.626737+0000", 2023-08-01T19:55:50.865 INFO:teuthology.orchestra.run.smithi008.stdout: "duration": 1.9415e-05 2023-08-01T19:55:50.865 INFO:teuthology.orchestra.run.smithi008.stdout: }, 2023-08-01T19:55:50.865 INFO:teuthology.orchestra.run.smithi008.stdout: { 2023-08-01T19:55:50.865 INFO:teuthology.orchestra.run.smithi008.stdout: "event": "commit_sent", 2023-08-01T19:55:50.865 INFO:teuthology.orchestra.run.smithi008.stdout: "time": "2023-08-01T19:55:05.635036+0000", 2023-08-01T19:55:50.865 INFO:teuthology.orchestra.run.smithi008.stdout: "duration": 0.0082987700000000005 2023-08-01T19:55:50.866 INFO:teuthology.orchestra.run.smithi008.stdout: }, 2023-08-01T19:55:50.866 INFO:teuthology.orchestra.run.smithi008.stdout: { 2023-08-01T19:55:50.866 INFO:teuthology.orchestra.run.smithi008.stdout: "event": "done", 2023-08-01T19:55:50.866 INFO:teuthology.orchestra.run.smithi008.stdout: "time": "2023-08-01T19:55:05.635067+0000", 2023-08-01T19:55:50.866 INFO:teuthology.orchestra.run.smithi008.stdout: "duration": 3.1786999999999999e-05 2023-08-01T19:55:50.866 INFO:teuthology.orchestra.run.smithi008.stdout: } 2023-08-01T19:55:50.866 INFO:teuthology.orchestra.run.smithi008.stdout: ] 2023-08-01T19:55:50.866 INFO:teuthology.orchestra.run.smithi008.stdout: } 2023-08-01T19:55:50.867 INFO:teuthology.orchestra.run.smithi008.stdout: }, 2023-08-01T19:55:50.867 INFO:teuthology.orchestra.run.smithi008.stdout: { 2023-08-01T19:55:50.867 INFO:teuthology.orchestra.run.smithi008.stdout: "description": "osd_op(client.4668.0:107863 5.3 5:cbdd875a:::benchmark_data_smithi006_114134_object107862:head [set-alloc-hint object_size 65536 write_size 65536,write 0~65536] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e38)", 2023-08-01T19:55:50.867 INFO:teuthology.orchestra.run.smithi008.stdout: "initiated_at": "2023-08-01T19:55:09.278851+0000", 2023-08-01T19:55:50.867 INFO:teuthology.orchestra.run.smithi008.stdout: "age": 41.452127531999999, 2023-08-01T19:55:50.867 INFO:teuthology.orchestra.run.smithi008.stdout: "duration": 0.071378853000000006, 2023-08-01T19:55:50.867 INFO:teuthology.orchestra.run.smithi008.stdout: "type_data": { 2023-08-01T19:55:50.867 INFO:teuthology.orchestra.run.smithi008.stdout: "flag_point": "commit sent; apply or cleanup", 2023-08-01T19:55:50.868 INFO:teuthology.orchestra.run.smithi008.stdout: "client_info": { 2023-08-01T19:55:50.868 INFO:teuthology.orchestra.run.smithi008.stdout: "client": "client.4668", 2023-08-01T19:55:50.868 INFO:teuthology.orchestra.run.smithi008.stdout: "client_addr": "172.21.15.6:0/1709472247", 2023-08-01T19:55:50.868 INFO:teuthology.orchestra.run.smithi008.stdout: "tid": 107863 2023-08-01T19:55:50.868 INFO:teuthology.orchestra.run.smithi008.stdout: }, 2023-08-01T19:55:50.868 INFO:teuthology.orchestra.run.smithi008.stdout: "events": [ 2023-08-01T19:55:50.868 INFO:teuthology.orchestra.run.smithi008.stdout: { 2023-08-01T19:55:50.868 INFO:teuthology.orchestra.run.smithi008.stdout: "event": "initiated", 2023-08-01T19:55:50.869 INFO:teuthology.orchestra.run.smithi008.stdout: "time": "2023-08-01T19:55:09.278851+0000", 2023-08-01T19:55:50.869 INFO:teuthology.orchestra.run.smithi008.stdout: "duration": 0 2023-08-01T19:55:50.869 INFO:teuthology.orchestra.run.smithi008.stdout: }, 2023-08-01T19:55:50.869 INFO:teuthology.orchestra.run.smithi008.stdout: { 2023-08-01T19:55:50.869 INFO:teuthology.orchestra.run.smithi008.stdout: "event": "throttled", 2023-08-01T19:55:50.869 INFO:teuthology.orchestra.run.smithi008.stdout: "time": "2023-08-01T19:55:09.278851+0000", 2023-08-01T19:55:50.869 INFO:teuthology.orchestra.run.smithi008.stdout: "duration": 0 2023-08-01T19:55:50.869 INFO:teuthology.orchestra.run.smithi008.stdout: }, 2023-08-01T19:55:50.870 INFO:teuthology.orchestra.run.smithi008.stdout: { 2023-08-01T19:55:50.870 INFO:teuthology.orchestra.run.smithi008.stdout: "event": "header_read", 2023-08-01T19:55:50.870 INFO:teuthology.orchestra.run.smithi008.stdout: "time": "2023-08-01T19:55:09.278850+0000", 2023-08-01T19:55:50.870 INFO:teuthology.orchestra.run.smithi008.stdout: "duration": 4294967295.999999 2023-08-01T19:55:50.870 INFO:teuthology.orchestra.run.smithi008.stdout: }, 2023-08-01T19:55:50.870 INFO:teuthology.orchestra.run.smithi008.stdout: { 2023-08-01T19:55:50.870 INFO:teuthology.orchestra.run.smithi008.stdout: "event": "all_read", 2023-08-01T19:55:50.870 INFO:teuthology.orchestra.run.smithi008.stdout: "time": "2023-08-01T19:55:09.278945+0000", 2023-08-01T19:55:50.871 INFO:teuthology.orchestra.run.smithi008.stdout: "duration": 9.4388000000000005e-05 2023-08-01T19:55:50.871 INFO:teuthology.orchestra.run.smithi008.stdout: }, 2023-08-01T19:55:50.871 INFO:teuthology.orchestra.run.smithi008.stdout: { 2023-08-01T19:55:50.871 INFO:teuthology.orchestra.run.smithi008.stdout: "event": "dispatched", 2023-08-01T19:55:50.871 INFO:teuthology.orchestra.run.smithi008.stdout: "time": "2023-08-01T19:55:09.278955+0000", 2023-08-01T19:55:50.871 INFO:teuthology.orchestra.run.smithi008.stdout: "duration": 1.0413e-05 2023-08-01T19:55:50.871 INFO:teuthology.orchestra.run.smithi008.stdout: }, 2023-08-01T19:55:50.871 INFO:teuthology.orchestra.run.smithi008.stdout: { 2023-08-01T19:55:50.872 INFO:teuthology.orchestra.run.smithi008.stdout: "event": "queued_for_pg", 2023-08-01T19:55:50.872 INFO:teuthology.orchestra.run.smithi008.stdout: "time": "2023-08-01T19:55:09.278962+0000", 2023-08-01T19:55:50.872 INFO:teuthology.orchestra.run.smithi008.stdout: "duration": 6.2169999999999999e-06 2023-08-01T19:55:50.872 INFO:teuthology.orchestra.run.smithi008.stdout: }, 2023-08-01T19:55:50.872 INFO:teuthology.orchestra.run.smithi008.stdout: { 2023-08-01T19:55:50.872 INFO:teuthology.orchestra.run.smithi008.stdout: "event": "reached_pg", 2023-08-01T19:55:50.872 INFO:teuthology.orchestra.run.smithi008.stdout: "time": "2023-08-01T19:55:09.280363+0000", 2023-08-01T19:55:50.873 INFO:teuthology.orchestra.run.smithi008.stdout: "duration": 0.0014014489999999999 2023-08-01T19:55:50.873 INFO:teuthology.orchestra.run.smithi008.stdout: }, 2023-08-01T19:55:50.873 INFO:teuthology.orchestra.run.smithi008.stdout: { 2023-08-01T19:55:50.873 INFO:teuthology.orchestra.run.smithi008.stdout: "event": "started", 2023-08-01T19:55:50.873 INFO:teuthology.orchestra.run.smithi008.stdout: "time": "2023-08-01T19:55:09.280488+0000", 2023-08-01T19:55:50.873 INFO:teuthology.orchestra.run.smithi008.stdout: "duration": 0.00012474099999999999 2023-08-01T19:55:50.873 INFO:teuthology.orchestra.run.smithi008.stdout: }, 2023-08-01T19:55:50.873 INFO:teuthology.orchestra.run.smithi008.stdout: { 2023-08-01T19:55:50.874 INFO:teuthology.orchestra.run.smithi008.stdout: "event": "waiting for subops from 1", 2023-08-01T19:55:50.874 INFO:teuthology.orchestra.run.smithi008.stdout: "time": "2023-08-01T19:55:09.280626+0000", 2023-08-01T19:55:50.874 INFO:teuthology.orchestra.run.smithi008.stdout: "duration": 0.000138193 2023-08-01T19:55:50.874 INFO:teuthology.orchestra.run.smithi008.stdout: }, 2023-08-01T19:55:50.874 INFO:teuthology.orchestra.run.smithi008.stdout: { 2023-08-01T19:55:50.874 INFO:teuthology.orchestra.run.smithi008.stdout: "event": "op_commit", 2023-08-01T19:55:50.874 INFO:teuthology.orchestra.run.smithi008.stdout: "time": "2023-08-01T19:55:09.285958+0000", 2023-08-01T19:55:50.874 INFO:teuthology.orchestra.run.smithi008.stdout: "duration": 0.0053317130000000001 2023-08-01T19:55:50.875 INFO:teuthology.orchestra.run.smithi008.stdout: }, 2023-08-01T19:55:50.875 INFO:teuthology.orchestra.run.smithi008.stdout: { 2023-08-01T19:55:50.875 INFO:teuthology.orchestra.run.smithi008.stdout: "event": "sub_op_commit_rec", 2023-08-01T19:55:50.875 INFO:teuthology.orchestra.run.smithi008.stdout: "time": "2023-08-01T19:55:09.350151+0000", 2023-08-01T19:55:50.875 INFO:teuthology.orchestra.run.smithi008.stdout: "duration": 0.064193202000000005 2023-08-01T19:55:50.875 INFO:teuthology.orchestra.run.smithi008.stdout: }, 2023-08-01T19:55:50.875 INFO:teuthology.orchestra.run.smithi008.stdout: { 2023-08-01T19:55:50.875 INFO:teuthology.orchestra.run.smithi008.stdout: "event": "commit_sent", 2023-08-01T19:55:50.876 INFO:teuthology.orchestra.run.smithi008.stdout: "time": "2023-08-01T19:55:09.350188+0000", 2023-08-01T19:55:50.876 INFO:teuthology.orchestra.run.smithi008.stdout: "duration": 3.7549999999999998e-05 2023-08-01T19:55:50.876 INFO:teuthology.orchestra.run.smithi008.stdout: }, 2023-08-01T19:55:50.876 INFO:teuthology.orchestra.run.smithi008.stdout: { 2023-08-01T19:55:50.876 INFO:teuthology.orchestra.run.smithi008.stdout: "event": "done", 2023-08-01T19:55:50.876 INFO:teuthology.orchestra.run.smithi008.stdout: "time": "2023-08-01T19:55:09.350230+0000", 2023-08-01T19:55:50.876 INFO:teuthology.orchestra.run.smithi008.stdout: "duration": 4.1804999999999997e-05 2023-08-01T19:55:50.876 INFO:teuthology.orchestra.run.smithi008.stdout: } 2023-08-01T19:55:50.877 INFO:teuthology.orchestra.run.smithi008.stdout: ] 2023-08-01T19:55:50.877 INFO:teuthology.orchestra.run.smithi008.stdout: } 2023-08-01T19:55:50.877 INFO:teuthology.orchestra.run.smithi008.stdout: }, 2023-08-01T19:55:50.877 INFO:teuthology.orchestra.run.smithi008.stdout: { 2023-08-01T19:55:50.877 INFO:teuthology.orchestra.run.smithi008.stdout: "description": "osd_op(client.4668.0:107865 5.3 5:c2ebb96d:::benchmark_data_smithi006_114134_object107864:head [set-alloc-hint object_size 65536 write_size 65536,write 0~65536] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e38)", 2023-08-01T19:55:50.877 INFO:teuthology.orchestra.run.smithi008.stdout: "initiated_at": "2023-08-01T19:55:09.279020+0000", 2023-08-01T19:55:50.877 INFO:teuthology.orchestra.run.smithi008.stdout: "age": 41.451958859999998, 2023-08-01T19:55:50.877 INFO:teuthology.orchestra.run.smithi008.stdout: "duration": 0.072892565000000006, 2023-08-01T19:55:50.878 INFO:teuthology.orchestra.run.smithi008.stdout: "type_data": { 2023-08-01T19:55:50.878 INFO:teuthology.orchestra.run.smithi008.stdout: "flag_point": "commit sent; apply or cleanup", 2023-08-01T19:55:50.878 INFO:teuthology.orchestra.run.smithi008.stdout: "client_info": { 2023-08-01T19:55:50.878 INFO:teuthology.orchestra.run.smithi008.stdout: "client": "client.4668", 2023-08-01T19:55:50.878 INFO:teuthology.orchestra.run.smithi008.stdout: "client_addr": "172.21.15.6:0/1709472247", 2023-08-01T19:55:50.878 INFO:teuthology.orchestra.run.smithi008.stdout: "tid": 107865 2023-08-01T19:55:50.878 INFO:teuthology.orchestra.run.smithi008.stdout: }, 2023-08-01T19:55:50.878 INFO:teuthology.orchestra.run.smithi008.stdout: "events": [ 2023-08-01T19:55:50.879 INFO:teuthology.orchestra.run.smithi008.stdout: { 2023-08-01T19:55:50.879 INFO:teuthology.orchestra.run.smithi008.stdout: "event": "initiated", 2023-08-01T19:55:50.879 INFO:teuthology.orchestra.run.smithi008.stdout: "time": "2023-08-01T19:55:09.279020+0000", 2023-08-01T19:55:50.879 INFO:teuthology.orchestra.run.smithi008.stdout: "duration": 0 2023-08-01T19:55:50.879 INFO:teuthology.orchestra.run.smithi008.stdout: }, 2023-08-01T19:55:50.879 INFO:teuthology.orchestra.run.smithi008.stdout: { 2023-08-01T19:55:50.879 INFO:teuthology.orchestra.run.smithi008.stdout: "event": "throttled", 2023-08-01T19:55:50.880 INFO:teuthology.orchestra.run.smithi008.stdout: "time": "2023-08-01T19:55:09.279020+0000", 2023-08-01T19:55:50.880 INFO:teuthology.orchestra.run.smithi008.stdout: "duration": 0 2023-08-01T19:55:50.880 INFO:teuthology.orchestra.run.smithi008.stdout: }, 2023-08-01T19:55:50.880 INFO:teuthology.orchestra.run.smithi008.stdout: { 2023-08-01T19:55:50.880 INFO:teuthology.orchestra.run.smithi008.stdout: "event": "header_read", 2023-08-01T19:55:50.880 INFO:teuthology.orchestra.run.smithi008.stdout: "time": "2023-08-01T19:55:09.279019+0000", 2023-08-01T19:55:50.880 INFO:teuthology.orchestra.run.smithi008.stdout: "duration": 4294967295.999999 2023-08-01T19:55:50.880 INFO:teuthology.orchestra.run.smithi008.stdout: }, 2023-08-01T19:55:50.881 INFO:teuthology.orchestra.run.smithi008.stdout: { 2023-08-01T19:55:50.881 INFO:teuthology.orchestra.run.smithi008.stdout: "event": "all_read", 2023-08-01T19:55:50.881 INFO:teuthology.orchestra.run.smithi008.stdout: "time": "2023-08-01T19:55:09.279087+0000", 2023-08-01T19:55:50.881 INFO:teuthology.orchestra.run.smithi008.stdout: "duration": 6.8392000000000005e-05 2023-08-01T19:55:50.881 INFO:teuthology.orchestra.run.smithi008.stdout: }, 2023-08-01T19:55:50.881 INFO:teuthology.orchestra.run.smithi008.stdout: { 2023-08-01T19:55:50.881 INFO:teuthology.orchestra.run.smithi008.stdout: "event": "dispatched", 2023-08-01T19:55:50.881 INFO:teuthology.orchestra.run.smithi008.stdout: "time": "2023-08-01T19:55:09.279095+0000", 2023-08-01T19:55:50.882 INFO:teuthology.orchestra.run.smithi008.stdout: "duration": 8.0989999999999999e-06 2023-08-01T19:55:50.882 INFO:teuthology.orchestra.run.smithi008.stdout: }, 2023-08-01T19:55:50.882 INFO:teuthology.orchestra.run.smithi008.stdout: { 2023-08-01T19:55:50.882 INFO:teuthology.orchestra.run.smithi008.stdout: "event": "queued_for_pg", 2023-08-01T19:55:50.882 INFO:teuthology.orchestra.run.smithi008.stdout: "time": "2023-08-01T19:55:09.279101+0000", 2023-08-01T19:55:50.882 INFO:teuthology.orchestra.run.smithi008.stdout: "duration": 5.0390000000000004e-06 2023-08-01T19:55:50.882 INFO:teuthology.orchestra.run.smithi008.stdout: }, 2023-08-01T19:55:50.883 INFO:teuthology.orchestra.run.smithi008.stdout: { 2023-08-01T19:55:50.883 INFO:teuthology.orchestra.run.smithi008.stdout: "event": "reached_pg", 2023-08-01T19:55:50.883 INFO:teuthology.orchestra.run.smithi008.stdout: "time": "2023-08-01T19:55:09.282574+0000", 2023-08-01T19:55:50.883 INFO:teuthology.orchestra.run.smithi008.stdout: "duration": 0.0034730619999999999 2023-08-01T19:55:50.883 INFO:teuthology.orchestra.run.smithi008.stdout: }, 2023-08-01T19:55:50.883 INFO:teuthology.orchestra.run.smithi008.stdout: { 2023-08-01T19:55:50.883 INFO:teuthology.orchestra.run.smithi008.stdout: "event": "started", 2023-08-01T19:55:50.883 INFO:teuthology.orchestra.run.smithi008.stdout: "time": "2023-08-01T19:55:09.282705+0000", 2023-08-01T19:55:50.884 INFO:teuthology.orchestra.run.smithi008.stdout: "duration": 0.00013133400000000001 2023-08-01T19:55:50.884 INFO:teuthology.orchestra.run.smithi008.stdout: }, 2023-08-01T19:55:50.884 INFO:teuthology.orchestra.run.smithi008.stdout: { 2023-08-01T19:55:50.884 INFO:teuthology.orchestra.run.smithi008.stdout: "event": "waiting for subops from 1", 2023-08-01T19:55:50.884 INFO:teuthology.orchestra.run.smithi008.stdout: "time": "2023-08-01T19:55:09.283067+0000", 2023-08-01T19:55:50.884 INFO:teuthology.orchestra.run.smithi008.stdout: "duration": 0.00036195299999999998 2023-08-01T19:55:50.884 INFO:teuthology.orchestra.run.smithi008.stdout: }, 2023-08-01T19:55:50.885 INFO:teuthology.orchestra.run.smithi008.stdout: { 2023-08-01T19:55:50.885 INFO:teuthology.orchestra.run.smithi008.stdout: "event": "op_commit", 2023-08-01T19:55:50.885 INFO:teuthology.orchestra.run.smithi008.stdout: "time": "2023-08-01T19:55:09.288196+0000", 2023-08-01T19:55:50.885 INFO:teuthology.orchestra.run.smithi008.stdout: "duration": 0.0051293780000000004 2023-08-01T19:55:50.885 INFO:teuthology.orchestra.run.smithi008.stdout: }, 2023-08-01T19:55:50.885 INFO:teuthology.orchestra.run.smithi008.stdout: { 2023-08-01T19:55:50.885 INFO:teuthology.orchestra.run.smithi008.stdout: "event": "sub_op_commit_rec", 2023-08-01T19:55:50.885 INFO:teuthology.orchestra.run.smithi008.stdout: "time": "2023-08-01T19:55:09.351832+0000", 2023-08-01T19:55:50.886 INFO:teuthology.orchestra.run.smithi008.stdout: "duration": 0.063636076 2023-08-01T19:55:50.886 INFO:teuthology.orchestra.run.smithi008.stdout: }, 2023-08-01T19:55:50.886 INFO:teuthology.orchestra.run.smithi008.stdout: { 2023-08-01T19:55:50.886 INFO:teuthology.orchestra.run.smithi008.stdout: "event": "commit_sent", 2023-08-01T19:55:50.886 INFO:teuthology.orchestra.run.smithi008.stdout: "time": "2023-08-01T19:55:09.351878+0000", 2023-08-01T19:55:50.886 INFO:teuthology.orchestra.run.smithi008.stdout: "duration": 4.5408999999999998e-05 2023-08-01T19:55:50.886 INFO:teuthology.orchestra.run.smithi008.stdout: }, 2023-08-01T19:55:50.886 INFO:teuthology.orchestra.run.smithi008.stdout: { 2023-08-01T19:55:50.887 INFO:teuthology.orchestra.run.smithi008.stdout: "event": "done", 2023-08-01T19:55:50.887 INFO:teuthology.orchestra.run.smithi008.stdout: "time": "2023-08-01T19:55:09.351913+0000", 2023-08-01T19:55:50.887 INFO:teuthology.orchestra.run.smithi008.stdout: "duration": 3.4808999999999998e-05 2023-08-01T19:55:50.887 INFO:teuthology.orchestra.run.smithi008.stdout: } 2023-08-01T19:55:50.887 INFO:teuthology.orchestra.run.smithi008.stdout: ] 2023-08-01T19:55:50.887 INFO:teuthology.orchestra.run.smithi008.stdout: } 2023-08-01T19:55:50.887 INFO:teuthology.orchestra.run.smithi008.stdout: }, 2023-08-01T19:55:50.887 INFO:teuthology.orchestra.run.smithi008.stdout: { 2023-08-01T19:55:50.888 INFO:teuthology.orchestra.run.smithi008.stdout: "description": "osd_op(client.4668.0:107869 5.c 5:31910384:::benchmark_data_smithi006_114134_object107868:head [set-alloc-hint object_size 65536 write_size 65536,write 0~65536] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e38)", 2023-08-01T19:55:50.888 INFO:teuthology.orchestra.run.smithi008.stdout: "initiated_at": "2023-08-01T19:55:09.283205+0000", 2023-08-01T19:55:50.888 INFO:teuthology.orchestra.run.smithi008.stdout: "age": 41.447773695000002, 2023-08-01T19:55:50.888 INFO:teuthology.orchestra.run.smithi008.stdout: "duration": 0.068611808999999996, 2023-08-01T19:55:50.888 INFO:teuthology.orchestra.run.smithi008.stdout: "type_data": { 2023-08-01T19:55:50.888 INFO:teuthology.orchestra.run.smithi008.stdout: "flag_point": "commit sent; apply or cleanup", 2023-08-01T19:55:50.888 INFO:teuthology.orchestra.run.smithi008.stdout: "client_info": { 2023-08-01T19:55:50.889 INFO:teuthology.orchestra.run.smithi008.stdout: "client": "client.4668", 2023-08-01T19:55:50.889 INFO:teuthology.orchestra.run.smithi008.stdout: "client_addr": "172.21.15.6:0/1709472247", 2023-08-01T19:55:50.889 INFO:teuthology.orchestra.run.smithi008.stdout: "tid": 107869 2023-08-01T19:55:50.889 INFO:teuthology.orchestra.run.smithi008.stdout: }, 2023-08-01T19:55:50.889 INFO:teuthology.orchestra.run.smithi008.stdout: "events": [ 2023-08-01T19:55:50.889 INFO:teuthology.orchestra.run.smithi008.stdout: { 2023-08-01T19:55:50.889 INFO:teuthology.orchestra.run.smithi008.stdout: "event": "initiated", 2023-08-01T19:55:50.889 INFO:teuthology.orchestra.run.smithi008.stdout: "time": "2023-08-01T19:55:09.283205+0000", 2023-08-01T19:55:50.890 INFO:teuthology.orchestra.run.smithi008.stdout: "duration": 0 2023-08-01T19:55:50.890 INFO:teuthology.orchestra.run.smithi008.stdout: }, 2023-08-01T19:55:50.890 INFO:teuthology.orchestra.run.smithi008.stdout: { 2023-08-01T19:55:50.890 INFO:teuthology.orchestra.run.smithi008.stdout: "event": "throttled", 2023-08-01T19:55:50.890 INFO:teuthology.orchestra.run.smithi008.stdout: "time": "2023-08-01T19:55:09.283205+0000", 2023-08-01T19:55:50.890 INFO:teuthology.orchestra.run.smithi008.stdout: "duration": 0 2023-08-01T19:55:50.890 INFO:teuthology.orchestra.run.smithi008.stdout: }, 2023-08-01T19:55:50.890 INFO:teuthology.orchestra.run.smithi008.stdout: { 2023-08-01T19:55:50.891 INFO:teuthology.orchestra.run.smithi008.stdout: "event": "header_read", 2023-08-01T19:55:50.891 INFO:teuthology.orchestra.run.smithi008.stdout: "time": "2023-08-01T19:55:09.283204+0000", 2023-08-01T19:55:50.891 INFO:teuthology.orchestra.run.smithi008.stdout: "duration": 4294967295.999999 2023-08-01T19:55:50.891 INFO:teuthology.orchestra.run.smithi008.stdout: }, 2023-08-01T19:55:50.891 INFO:teuthology.orchestra.run.smithi008.stdout: { 2023-08-01T19:55:50.891 INFO:teuthology.orchestra.run.smithi008.stdout: "event": "all_read", 2023-08-01T19:55:50.891 INFO:teuthology.orchestra.run.smithi008.stdout: "time": "2023-08-01T19:55:09.283300+0000", 2023-08-01T19:55:50.891 INFO:teuthology.orchestra.run.smithi008.stdout: "duration": 9.6280000000000007e-05 2023-08-01T19:55:50.892 INFO:teuthology.orchestra.run.smithi008.stdout: }, 2023-08-01T19:55:50.892 INFO:teuthology.orchestra.run.smithi008.stdout: { 2023-08-01T19:55:50.892 INFO:teuthology.orchestra.run.smithi008.stdout: "event": "dispatched", 2023-08-01T19:55:50.892 INFO:teuthology.orchestra.run.smithi008.stdout: "time": "2023-08-01T19:55:09.283314+0000", 2023-08-01T19:55:50.892 INFO:teuthology.orchestra.run.smithi008.stdout: "duration": 1.3344e-05 2023-08-01T19:55:50.892 INFO:teuthology.orchestra.run.smithi008.stdout: }, 2023-08-01T19:55:50.892 INFO:teuthology.orchestra.run.smithi008.stdout: { 2023-08-01T19:55:50.893 INFO:teuthology.orchestra.run.smithi008.stdout: "event": "queued_for_pg", 2023-08-01T19:55:50.893 INFO:teuthology.orchestra.run.smithi008.stdout: "time": "2023-08-01T19:55:09.283320+0000", 2023-08-01T19:55:50.893 INFO:teuthology.orchestra.run.smithi008.stdout: "duration": 6.0299999999999999e-06 2023-08-01T19:55:50.893 INFO:teuthology.orchestra.run.smithi008.stdout: }, 2023-08-01T19:55:50.893 INFO:teuthology.orchestra.run.smithi008.stdout: { 2023-08-01T19:55:50.893 INFO:teuthology.orchestra.run.smithi008.stdout: "event": "reached_pg", 2023-08-01T19:55:50.893 INFO:teuthology.orchestra.run.smithi008.stdout: "time": "2023-08-01T19:55:09.283365+0000", 2023-08-01T19:55:50.893 INFO:teuthology.orchestra.run.smithi008.stdout: "duration": 4.5578999999999998e-05 2023-08-01T19:55:50.894 INFO:teuthology.orchestra.run.smithi008.stdout: }, 2023-08-01T19:55:50.894 INFO:teuthology.orchestra.run.smithi008.stdout: { 2023-08-01T19:55:50.894 INFO:teuthology.orchestra.run.smithi008.stdout: "event": "started", 2023-08-01T19:55:50.894 INFO:teuthology.orchestra.run.smithi008.stdout: "time": "2023-08-01T19:55:09.283490+0000", 2023-08-01T19:55:50.894 INFO:teuthology.orchestra.run.smithi008.stdout: "duration": 0.00012473700000000001 2023-08-01T19:55:50.894 INFO:teuthology.orchestra.run.smithi008.stdout: }, 2023-08-01T19:55:50.894 INFO:teuthology.orchestra.run.smithi008.stdout: { 2023-08-01T19:55:50.894 INFO:teuthology.orchestra.run.smithi008.stdout: "event": "waiting for subops from 1", 2023-08-01T19:55:50.895 INFO:teuthology.orchestra.run.smithi008.stdout: "time": "2023-08-01T19:55:09.283637+0000", 2023-08-01T19:55:50.895 INFO:teuthology.orchestra.run.smithi008.stdout: "duration": 0.00014715600000000001 2023-08-01T19:55:50.895 INFO:teuthology.orchestra.run.smithi008.stdout: }, 2023-08-01T19:55:50.895 INFO:teuthology.orchestra.run.smithi008.stdout: { 2023-08-01T19:55:50.895 INFO:teuthology.orchestra.run.smithi008.stdout: "event": "op_commit", 2023-08-01T19:55:50.895 INFO:teuthology.orchestra.run.smithi008.stdout: "time": "2023-08-01T19:55:09.288214+0000", 2023-08-01T19:55:50.895 INFO:teuthology.orchestra.run.smithi008.stdout: "duration": 0.0045769560000000001 2023-08-01T19:55:50.895 INFO:teuthology.orchestra.run.smithi008.stdout: }, 2023-08-01T19:55:50.896 INFO:teuthology.orchestra.run.smithi008.stdout: { 2023-08-01T19:55:50.896 INFO:teuthology.orchestra.run.smithi008.stdout: "event": "sub_op_commit_rec", 2023-08-01T19:55:50.896 INFO:teuthology.orchestra.run.smithi008.stdout: "time": "2023-08-01T19:55:09.351721+0000", 2023-08-01T19:55:50.896 INFO:teuthology.orchestra.run.smithi008.stdout: "duration": 0.063507383000000001 2023-08-01T19:55:50.896 INFO:teuthology.orchestra.run.smithi008.stdout: }, 2023-08-01T19:55:50.896 INFO:teuthology.orchestra.run.smithi008.stdout: { 2023-08-01T19:55:50.896 INFO:teuthology.orchestra.run.smithi008.stdout: "event": "commit_sent", 2023-08-01T19:55:50.897 INFO:teuthology.orchestra.run.smithi008.stdout: "time": "2023-08-01T19:55:09.351777+0000", 2023-08-01T19:55:50.897 INFO:teuthology.orchestra.run.smithi008.stdout: "duration": 5.5733999999999999e-05 2023-08-01T19:55:50.897 INFO:teuthology.orchestra.run.smithi008.stdout: }, 2023-08-01T19:55:50.897 INFO:teuthology.orchestra.run.smithi008.stdout: { 2023-08-01T19:55:50.897 INFO:teuthology.orchestra.run.smithi008.stdout: "event": "done", 2023-08-01T19:55:50.897 INFO:teuthology.orchestra.run.smithi008.stdout: "time": "2023-08-01T19:55:09.351817+0000", 2023-08-01T19:55:50.897 INFO:teuthology.orchestra.run.smithi008.stdout: "duration": 3.9765000000000003e-05 2023-08-01T19:55:50.897 INFO:teuthology.orchestra.run.smithi008.stdout: } 2023-08-01T19:55:50.898 INFO:teuthology.orchestra.run.smithi008.stdout: ] 2023-08-01T19:55:50.898 INFO:teuthology.orchestra.run.smithi008.stdout: } 2023-08-01T19:55:50.898 INFO:teuthology.orchestra.run.smithi008.stdout: }, 2023-08-01T19:55:50.898 INFO:teuthology.orchestra.run.smithi008.stdout: { 2023-08-01T19:55:50.898 INFO:teuthology.orchestra.run.smithi008.stdout: "description": "osd_op(client.4668.0:107874 5.3 5:ce4c2799:::benchmark_data_smithi006_114134_object107873:head [set-alloc-hint object_size 65536 write_size 65536,write 0~65536] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e38)", 2023-08-01T19:55:50.898 INFO:teuthology.orchestra.run.smithi008.stdout: "initiated_at": "2023-08-01T19:55:09.286239+0000", 2023-08-01T19:55:50.898 INFO:teuthology.orchestra.run.smithi008.stdout: "age": 41.444740189999997, 2023-08-01T19:55:50.898 INFO:teuthology.orchestra.run.smithi008.stdout: "duration": 0.068224389999999996, 2023-08-01T19:55:50.899 INFO:teuthology.orchestra.run.smithi008.stdout: "type_data": { 2023-08-01T19:55:50.899 INFO:teuthology.orchestra.run.smithi008.stdout: "flag_point": "commit sent; apply or cleanup", 2023-08-01T19:55:50.899 INFO:teuthology.orchestra.run.smithi008.stdout: "client_info": { 2023-08-01T19:55:50.899 INFO:teuthology.orchestra.run.smithi008.stdout: "client": "client.4668", 2023-08-01T19:55:50.899 INFO:teuthology.orchestra.run.smithi008.stdout: "client_addr": "172.21.15.6:0/1709472247", 2023-08-01T19:55:50.899 INFO:teuthology.orchestra.run.smithi008.stdout: "tid": 107874 2023-08-01T19:55:50.899 INFO:teuthology.orchestra.run.smithi008.stdout: }, 2023-08-01T19:55:50.900 INFO:teuthology.orchestra.run.smithi008.stdout: "events": [ 2023-08-01T19:55:50.900 INFO:teuthology.orchestra.run.smithi008.stdout: { 2023-08-01T19:55:50.900 INFO:teuthology.orchestra.run.smithi008.stdout: "event": "initiated", 2023-08-01T19:55:50.900 INFO:teuthology.orchestra.run.smithi008.stdout: "time": "2023-08-01T19:55:09.286239+0000", 2023-08-01T19:55:50.900 INFO:teuthology.orchestra.run.smithi008.stdout: "duration": 0 2023-08-01T19:55:50.900 INFO:teuthology.orchestra.run.smithi008.stdout: }, 2023-08-01T19:55:50.900 INFO:teuthology.orchestra.run.smithi008.stdout: { 2023-08-01T19:55:50.900 INFO:teuthology.orchestra.run.smithi008.stdout: "event": "throttled", 2023-08-01T19:55:50.901 INFO:teuthology.orchestra.run.smithi008.stdout: "time": "2023-08-01T19:55:09.286239+0000", 2023-08-01T19:55:50.901 INFO:teuthology.orchestra.run.smithi008.stdout: "duration": 0 2023-08-01T19:55:50.901 INFO:teuthology.orchestra.run.smithi008.stdout: }, 2023-08-01T19:55:50.901 INFO:teuthology.orchestra.run.smithi008.stdout: { 2023-08-01T19:55:50.901 INFO:teuthology.orchestra.run.smithi008.stdout: "event": "header_read", 2023-08-01T19:55:50.901 INFO:teuthology.orchestra.run.smithi008.stdout: "time": "2023-08-01T19:55:09.286238+0000", 2023-08-01T19:55:50.901 INFO:teuthology.orchestra.run.smithi008.stdout: "duration": 4294967295.999999 2023-08-01T19:55:50.902 INFO:teuthology.orchestra.run.smithi008.stdout: }, 2023-08-01T19:55:50.902 INFO:teuthology.orchestra.run.smithi008.stdout: { 2023-08-01T19:55:50.902 INFO:teuthology.orchestra.run.smithi008.stdout: "event": "all_read", 2023-08-01T19:55:50.902 INFO:teuthology.orchestra.run.smithi008.stdout: "time": "2023-08-01T19:55:09.286310+0000", 2023-08-01T19:55:50.902 INFO:teuthology.orchestra.run.smithi008.stdout: "duration": 7.2583999999999995e-05 2023-08-01T19:55:50.902 INFO:teuthology.orchestra.run.smithi008.stdout: }, 2023-08-01T19:55:50.902 INFO:teuthology.orchestra.run.smithi008.stdout: { 2023-08-01T19:55:50.902 INFO:teuthology.orchestra.run.smithi008.stdout: "event": "dispatched", 2023-08-01T19:55:50.903 INFO:teuthology.orchestra.run.smithi008.stdout: "time": "2023-08-01T19:55:09.286323+0000", 2023-08-01T19:55:50.903 INFO:teuthology.orchestra.run.smithi008.stdout: "duration": 1.3151e-05 2023-08-01T19:55:50.903 INFO:teuthology.orchestra.run.smithi008.stdout: }, 2023-08-01T19:55:50.903 INFO:teuthology.orchestra.run.smithi008.stdout: { 2023-08-01T19:55:50.903 INFO:teuthology.orchestra.run.smithi008.stdout: "event": "queued_for_pg", 2023-08-01T19:55:50.903 INFO:teuthology.orchestra.run.smithi008.stdout: "time": "2023-08-01T19:55:09.286329+0000", 2023-08-01T19:55:50.903 INFO:teuthology.orchestra.run.smithi008.stdout: "duration": 5.8719999999999999e-06 2023-08-01T19:55:50.903 INFO:teuthology.orchestra.run.smithi008.stdout: }, 2023-08-01T19:55:50.904 INFO:teuthology.orchestra.run.smithi008.stdout: { 2023-08-01T19:55:50.904 INFO:teuthology.orchestra.run.smithi008.stdout: "event": "reached_pg", 2023-08-01T19:55:50.904 INFO:teuthology.orchestra.run.smithi008.stdout: "time": "2023-08-01T19:55:09.286392+0000", 2023-08-01T19:55:50.904 INFO:teuthology.orchestra.run.smithi008.stdout: "duration": 6.2378000000000005e-05 2023-08-01T19:55:50.904 INFO:teuthology.orchestra.run.smithi008.stdout: }, 2023-08-01T19:55:50.904 INFO:teuthology.orchestra.run.smithi008.stdout: { 2023-08-01T19:55:50.904 INFO:teuthology.orchestra.run.smithi008.stdout: "event": "started", 2023-08-01T19:55:50.904 INFO:teuthology.orchestra.run.smithi008.stdout: "time": "2023-08-01T19:55:09.286473+0000", 2023-08-01T19:55:50.905 INFO:teuthology.orchestra.run.smithi008.stdout: "duration": 8.1327000000000002e-05 2023-08-01T19:55:50.905 INFO:teuthology.orchestra.run.smithi008.stdout: }, 2023-08-01T19:55:50.905 INFO:teuthology.orchestra.run.smithi008.stdout: { 2023-08-01T19:55:50.905 INFO:teuthology.orchestra.run.smithi008.stdout: "event": "waiting for subops from 1", 2023-08-01T19:55:50.905 INFO:teuthology.orchestra.run.smithi008.stdout: "time": "2023-08-01T19:55:09.286557+0000", 2023-08-01T19:55:50.905 INFO:teuthology.orchestra.run.smithi008.stdout: "duration": 8.4140000000000004e-05 2023-08-01T19:55:50.905 INFO:teuthology.orchestra.run.smithi008.stdout: }, 2023-08-01T19:55:50.906 INFO:teuthology.orchestra.run.smithi008.stdout: { 2023-08-01T19:55:50.906 INFO:teuthology.orchestra.run.smithi008.stdout: "event": "op_commit", 2023-08-01T19:55:50.906 INFO:teuthology.orchestra.run.smithi008.stdout: "time": "2023-08-01T19:55:09.290681+0000", 2023-08-01T19:55:50.906 INFO:teuthology.orchestra.run.smithi008.stdout: "duration": 0.0041242420000000002 2023-08-01T19:55:50.906 INFO:teuthology.orchestra.run.smithi008.stdout: }, 2023-08-01T19:55:50.906 INFO:teuthology.orchestra.run.smithi008.stdout: { 2023-08-01T19:55:50.906 INFO:teuthology.orchestra.run.smithi008.stdout: "event": "sub_op_commit_rec", 2023-08-01T19:55:50.906 INFO:teuthology.orchestra.run.smithi008.stdout: "time": "2023-08-01T19:55:09.354372+0000", 2023-08-01T19:55:50.907 INFO:teuthology.orchestra.run.smithi008.stdout: "duration": 0.063690438000000002 2023-08-01T19:55:50.907 INFO:teuthology.orchestra.run.smithi008.stdout: }, 2023-08-01T19:55:50.907 INFO:teuthology.orchestra.run.smithi008.stdout: { 2023-08-01T19:55:50.907 INFO:teuthology.orchestra.run.smithi008.stdout: "event": "commit_sent", 2023-08-01T19:55:50.907 INFO:teuthology.orchestra.run.smithi008.stdout: "time": "2023-08-01T19:55:09.354421+0000", 2023-08-01T19:55:50.907 INFO:teuthology.orchestra.run.smithi008.stdout: "duration": 4.9413000000000003e-05 2023-08-01T19:55:50.907 INFO:teuthology.orchestra.run.smithi008.stdout: }, 2023-08-01T19:55:50.907 INFO:teuthology.orchestra.run.smithi008.stdout: { 2023-08-01T19:55:50.908 INFO:teuthology.orchestra.run.smithi008.stdout: "event": "done", 2023-08-01T19:55:50.908 INFO:teuthology.orchestra.run.smithi008.stdout: "time": "2023-08-01T19:55:09.354463+0000", 2023-08-01T19:55:50.908 INFO:teuthology.orchestra.run.smithi008.stdout: "duration": 4.1924e-05 2023-08-01T19:55:50.908 INFO:teuthology.orchestra.run.smithi008.stdout: } 2023-08-01T19:55:50.908 INFO:teuthology.orchestra.run.smithi008.stdout: ] 2023-08-01T19:55:50.908 INFO:teuthology.orchestra.run.smithi008.stdout: } 2023-08-01T19:55:50.908 INFO:teuthology.orchestra.run.smithi008.stdout: }, 2023-08-01T19:55:50.908 INFO:teuthology.orchestra.run.smithi008.stdout: { 2023-08-01T19:55:50.909 INFO:teuthology.orchestra.run.smithi008.stdout: "description": "osd_op(client.4668.0:107875 5.5 5:af4ec927:::benchmark_data_smithi006_114134_object107874:head [set-alloc-hint object_size 65536 write_size 65536,write 0~65536] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e38)", 2023-08-01T19:55:50.909 INFO:teuthology.orchestra.run.smithi008.stdout: "initiated_at": "2023-08-01T19:55:09.287186+0000", 2023-08-01T19:55:50.909 INFO:teuthology.orchestra.run.smithi008.stdout: "age": 41.443792403000003, 2023-08-01T19:55:50.909 INFO:teuthology.orchestra.run.smithi008.stdout: "duration": 0.064764719999999998, 2023-08-01T19:55:50.909 INFO:teuthology.orchestra.run.smithi008.stdout: "type_data": { 2023-08-01T19:55:50.909 INFO:teuthology.orchestra.run.smithi008.stdout: "flag_point": "commit sent; apply or cleanup", 2023-08-01T19:55:50.909 INFO:teuthology.orchestra.run.smithi008.stdout: "client_info": { 2023-08-01T19:55:50.909 INFO:teuthology.orchestra.run.smithi008.stdout: "client": "client.4668", 2023-08-01T19:55:50.910 INFO:teuthology.orchestra.run.smithi008.stdout: "client_addr": "172.21.15.6:0/1709472247", 2023-08-01T19:55:50.910 INFO:teuthology.orchestra.run.smithi008.stdout: "tid": 107875 2023-08-01T19:55:50.910 INFO:teuthology.orchestra.run.smithi008.stdout: }, 2023-08-01T19:55:50.910 INFO:teuthology.orchestra.run.smithi008.stdout: "events": [ 2023-08-01T19:55:50.910 INFO:teuthology.orchestra.run.smithi008.stdout: { 2023-08-01T19:55:50.910 INFO:teuthology.orchestra.run.smithi008.stdout: "event": "initiated", 2023-08-01T19:55:50.910 INFO:teuthology.orchestra.run.smithi008.stdout: "time": "2023-08-01T19:55:09.287186+0000", 2023-08-01T19:55:50.911 INFO:teuthology.orchestra.run.smithi008.stdout: "duration": 0 2023-08-01T19:55:50.911 INFO:teuthology.orchestra.run.smithi008.stdout: }, 2023-08-01T19:55:50.911 INFO:teuthology.orchestra.run.smithi008.stdout: { 2023-08-01T19:55:50.911 INFO:teuthology.orchestra.run.smithi008.stdout: "event": "throttled", 2023-08-01T19:55:50.911 INFO:teuthology.orchestra.run.smithi008.stdout: "time": "2023-08-01T19:55:09.287186+0000", 2023-08-01T19:55:50.911 INFO:teuthology.orchestra.run.smithi008.stdout: "duration": 0 2023-08-01T19:55:50.911 INFO:teuthology.orchestra.run.smithi008.stdout: }, 2023-08-01T19:55:50.912 INFO:teuthology.orchestra.run.smithi008.stdout: { 2023-08-01T19:55:50.912 INFO:teuthology.orchestra.run.smithi008.stdout: "event": "header_read", 2023-08-01T19:55:50.912 INFO:teuthology.orchestra.run.smithi008.stdout: "time": "2023-08-01T19:55:09.287186+0000", 2023-08-01T19:55:50.912 INFO:teuthology.orchestra.run.smithi008.stdout: "duration": 4294967295.999999 2023-08-01T19:55:50.912 INFO:teuthology.orchestra.run.smithi008.stdout: }, 2023-08-01T19:55:50.912 INFO:teuthology.orchestra.run.smithi008.stdout: { 2023-08-01T19:55:50.912 INFO:teuthology.orchestra.run.smithi008.stdout: "event": "all_read", 2023-08-01T19:55:50.912 INFO:teuthology.orchestra.run.smithi008.stdout: "time": "2023-08-01T19:55:09.287248+0000", 2023-08-01T19:55:50.913 INFO:teuthology.orchestra.run.smithi008.stdout: "duration": 6.2922000000000005e-05 2023-08-01T19:55:50.913 INFO:teuthology.orchestra.run.smithi008.stdout: }, 2023-08-01T19:55:50.913 INFO:teuthology.orchestra.run.smithi008.stdout: { 2023-08-01T19:55:50.913 INFO:teuthology.orchestra.run.smithi008.stdout: "event": "dispatched", 2023-08-01T19:55:50.913 INFO:teuthology.orchestra.run.smithi008.stdout: "time": "2023-08-01T19:55:09.287261+0000", 2023-08-01T19:55:50.913 INFO:teuthology.orchestra.run.smithi008.stdout: "duration": 1.2364000000000001e-05 2023-08-01T19:55:50.913 INFO:teuthology.orchestra.run.smithi008.stdout: }, 2023-08-01T19:55:50.913 INFO:teuthology.orchestra.run.smithi008.stdout: { 2023-08-01T19:55:50.914 INFO:teuthology.orchestra.run.smithi008.stdout: "event": "queued_for_pg", 2023-08-01T19:55:50.914 INFO:teuthology.orchestra.run.smithi008.stdout: "time": "2023-08-01T19:55:09.287267+0000", 2023-08-01T19:55:50.914 INFO:teuthology.orchestra.run.smithi008.stdout: "duration": 6.2580000000000001e-06 2023-08-01T19:55:50.914 INFO:teuthology.orchestra.run.smithi008.stdout: }, 2023-08-01T19:55:50.914 INFO:teuthology.orchestra.run.smithi008.stdout: { 2023-08-01T19:55:50.914 INFO:teuthology.orchestra.run.smithi008.stdout: "event": "reached_pg", 2023-08-01T19:55:50.914 INFO:teuthology.orchestra.run.smithi008.stdout: "time": "2023-08-01T19:55:09.287306+0000", 2023-08-01T19:55:50.915 INFO:teuthology.orchestra.run.smithi008.stdout: "duration": 3.9057999999999998e-05 2023-08-01T19:55:50.915 INFO:teuthology.orchestra.run.smithi008.stdout: }, 2023-08-01T19:55:50.915 INFO:teuthology.orchestra.run.smithi008.stdout: { 2023-08-01T19:55:50.915 INFO:teuthology.orchestra.run.smithi008.stdout: "event": "started", 2023-08-01T19:55:50.915 INFO:teuthology.orchestra.run.smithi008.stdout: "time": "2023-08-01T19:55:09.287419+0000", 2023-08-01T19:55:50.915 INFO:teuthology.orchestra.run.smithi008.stdout: "duration": 0.000112843 2023-08-01T19:55:50.915 INFO:teuthology.orchestra.run.smithi008.stdout: }, 2023-08-01T19:55:50.915 INFO:teuthology.orchestra.run.smithi008.stdout: { 2023-08-01T19:55:50.916 INFO:teuthology.orchestra.run.smithi008.stdout: "event": "waiting for subops from 1", 2023-08-01T19:55:50.916 INFO:teuthology.orchestra.run.smithi008.stdout: "time": "2023-08-01T19:55:09.287514+0000", 2023-08-01T19:55:50.916 INFO:teuthology.orchestra.run.smithi008.stdout: "duration": 9.5068000000000005e-05 2023-08-01T19:55:50.916 INFO:teuthology.orchestra.run.smithi008.stdout: }, 2023-08-01T19:55:50.916 INFO:teuthology.orchestra.run.smithi008.stdout: { 2023-08-01T19:55:50.916 INFO:teuthology.orchestra.run.smithi008.stdout: "event": "op_commit", 2023-08-01T19:55:50.916 INFO:teuthology.orchestra.run.smithi008.stdout: "time": "2023-08-01T19:55:09.293891+0000", 2023-08-01T19:55:50.916 INFO:teuthology.orchestra.run.smithi008.stdout: "duration": 0.00637712 2023-08-01T19:55:50.917 INFO:teuthology.orchestra.run.smithi008.stdout: }, 2023-08-01T19:55:50.917 INFO:teuthology.orchestra.run.smithi008.stdout: { 2023-08-01T19:55:50.917 INFO:teuthology.orchestra.run.smithi008.stdout: "event": "sub_op_commit_rec", 2023-08-01T19:55:50.917 INFO:teuthology.orchestra.run.smithi008.stdout: "time": "2023-08-01T19:55:09.351871+0000", 2023-08-01T19:55:50.917 INFO:teuthology.orchestra.run.smithi008.stdout: "duration": 0.057980054000000003 2023-08-01T19:55:50.917 INFO:teuthology.orchestra.run.smithi008.stdout: }, 2023-08-01T19:55:50.917 INFO:teuthology.orchestra.run.smithi008.stdout: { 2023-08-01T19:55:50.917 INFO:teuthology.orchestra.run.smithi008.stdout: "event": "commit_sent", 2023-08-01T19:55:50.918 INFO:teuthology.orchestra.run.smithi008.stdout: "time": "2023-08-01T19:55:09.351917+0000", 2023-08-01T19:55:50.918 INFO:teuthology.orchestra.run.smithi008.stdout: "duration": 4.5501999999999999e-05 2023-08-01T19:55:50.918 INFO:teuthology.orchestra.run.smithi008.stdout: }, 2023-08-01T19:55:50.918 INFO:teuthology.orchestra.run.smithi008.stdout: { 2023-08-01T19:55:50.918 INFO:teuthology.orchestra.run.smithi008.stdout: "event": "done", 2023-08-01T19:55:50.918 INFO:teuthology.orchestra.run.smithi008.stdout: "time": "2023-08-01T19:55:09.351951+0000", 2023-08-01T19:55:50.918 INFO:teuthology.orchestra.run.smithi008.stdout: "duration": 3.4450999999999999e-05 2023-08-01T19:55:50.918 INFO:teuthology.orchestra.run.smithi008.stdout: } 2023-08-01T19:55:50.919 INFO:teuthology.orchestra.run.smithi008.stdout: ] 2023-08-01T19:55:50.919 INFO:teuthology.orchestra.run.smithi008.stdout: } 2023-08-01T19:55:50.919 INFO:teuthology.orchestra.run.smithi008.stdout: }, 2023-08-01T19:55:50.919 INFO:teuthology.orchestra.run.smithi008.stdout: { 2023-08-01T19:55:50.919 INFO:teuthology.orchestra.run.smithi008.stdout: "description": "osd_op(client.4668.0:107880 5.5 5:a8d12d4b:::benchmark_data_smithi006_114134_object107879:head [set-alloc-hint object_size 65536 write_size 65536,write 0~65536] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e38)", 2023-08-01T19:55:50.919 INFO:teuthology.orchestra.run.smithi008.stdout: "initiated_at": "2023-08-01T19:55:09.292335+0000", 2023-08-01T19:55:50.919 INFO:teuthology.orchestra.run.smithi008.stdout: "age": 41.438643802000001, 2023-08-01T19:55:50.919 INFO:teuthology.orchestra.run.smithi008.stdout: "duration": 0.061350719999999997, 2023-08-01T19:55:50.920 INFO:teuthology.orchestra.run.smithi008.stdout: "type_data": { 2023-08-01T19:55:50.920 INFO:teuthology.orchestra.run.smithi008.stdout: "flag_point": "commit sent; apply or cleanup", 2023-08-01T19:55:50.920 INFO:teuthology.orchestra.run.smithi008.stdout: "client_info": { 2023-08-01T19:55:50.920 INFO:teuthology.orchestra.run.smithi008.stdout: "client": "client.4668", 2023-08-01T19:55:50.920 INFO:teuthology.orchestra.run.smithi008.stdout: "client_addr": "172.21.15.6:0/1709472247", 2023-08-01T19:55:50.920 INFO:teuthology.orchestra.run.smithi008.stdout: "tid": 107880 2023-08-01T19:55:50.920 INFO:teuthology.orchestra.run.smithi008.stdout: }, 2023-08-01T19:55:50.921 INFO:teuthology.orchestra.run.smithi008.stdout: "events": [ 2023-08-01T19:55:50.921 INFO:teuthology.orchestra.run.smithi008.stdout: { 2023-08-01T19:55:50.921 INFO:teuthology.orchestra.run.smithi008.stdout: "event": "initiated", 2023-08-01T19:55:50.921 INFO:teuthology.orchestra.run.smithi008.stdout: "time": "2023-08-01T19:55:09.292335+0000", 2023-08-01T19:55:50.921 INFO:teuthology.orchestra.run.smithi008.stdout: "duration": 0 2023-08-01T19:55:50.921 INFO:teuthology.orchestra.run.smithi008.stdout: }, 2023-08-01T19:55:50.921 INFO:teuthology.orchestra.run.smithi008.stdout: { 2023-08-01T19:55:50.921 INFO:teuthology.orchestra.run.smithi008.stdout: "event": "throttled", 2023-08-01T19:55:50.922 INFO:teuthology.orchestra.run.smithi008.stdout: "time": "2023-08-01T19:55:09.292335+0000", 2023-08-01T19:55:50.922 INFO:teuthology.orchestra.run.smithi008.stdout: "duration": 0 2023-08-01T19:55:50.922 INFO:teuthology.orchestra.run.smithi008.stdout: }, 2023-08-01T19:55:50.922 INFO:teuthology.orchestra.run.smithi008.stdout: { 2023-08-01T19:55:50.922 INFO:teuthology.orchestra.run.smithi008.stdout: "event": "header_read", 2023-08-01T19:55:50.922 INFO:teuthology.orchestra.run.smithi008.stdout: "time": "2023-08-01T19:55:09.292334+0000", 2023-08-01T19:55:50.922 INFO:teuthology.orchestra.run.smithi008.stdout: "duration": 4294967295.999999 2023-08-01T19:55:50.922 INFO:teuthology.orchestra.run.smithi008.stdout: }, 2023-08-01T19:55:50.923 INFO:teuthology.orchestra.run.smithi008.stdout: { 2023-08-01T19:55:50.923 INFO:teuthology.orchestra.run.smithi008.stdout: "event": "all_read", 2023-08-01T19:55:50.923 INFO:teuthology.orchestra.run.smithi008.stdout: "time": "2023-08-01T19:55:09.292449+0000", 2023-08-01T19:55:50.923 INFO:teuthology.orchestra.run.smithi008.stdout: "duration": 0.00011551400000000001 2023-08-01T19:55:50.923 INFO:teuthology.orchestra.run.smithi008.stdout: }, 2023-08-01T19:55:50.923 INFO:teuthology.orchestra.run.smithi008.stdout: { 2023-08-01T19:55:50.923 INFO:teuthology.orchestra.run.smithi008.stdout: "event": "dispatched", 2023-08-01T19:55:50.923 INFO:teuthology.orchestra.run.smithi008.stdout: "time": "2023-08-01T19:55:09.292461+0000", 2023-08-01T19:55:50.924 INFO:teuthology.orchestra.run.smithi008.stdout: "duration": 1.1287000000000001e-05 2023-08-01T19:55:50.924 INFO:teuthology.orchestra.run.smithi008.stdout: }, 2023-08-01T19:55:50.924 INFO:teuthology.orchestra.run.smithi008.stdout: { 2023-08-01T19:55:50.924 INFO:teuthology.orchestra.run.smithi008.stdout: "event": "queued_for_pg", 2023-08-01T19:55:50.924 INFO:teuthology.orchestra.run.smithi008.stdout: "time": "2023-08-01T19:55:09.292467+0000", 2023-08-01T19:55:50.924 INFO:teuthology.orchestra.run.smithi008.stdout: "duration": 6.4520000000000002e-06 2023-08-01T19:55:50.924 INFO:teuthology.orchestra.run.smithi008.stdout: }, 2023-08-01T19:55:50.924 INFO:teuthology.orchestra.run.smithi008.stdout: { 2023-08-01T19:55:50.925 INFO:teuthology.orchestra.run.smithi008.stdout: "event": "reached_pg", 2023-08-01T19:55:50.925 INFO:teuthology.orchestra.run.smithi008.stdout: "time": "2023-08-01T19:55:09.292510+0000", 2023-08-01T19:55:50.925 INFO:teuthology.orchestra.run.smithi008.stdout: "duration": 4.2502000000000001e-05 2023-08-01T19:55:50.925 INFO:teuthology.orchestra.run.smithi008.stdout: }, 2023-08-01T19:55:50.925 INFO:teuthology.orchestra.run.smithi008.stdout: { 2023-08-01T19:55:50.925 INFO:teuthology.orchestra.run.smithi008.stdout: "event": "started", 2023-08-01T19:55:50.925 INFO:teuthology.orchestra.run.smithi008.stdout: "time": "2023-08-01T19:55:09.292596+0000", 2023-08-01T19:55:50.925 INFO:teuthology.orchestra.run.smithi008.stdout: "duration": 8.6545000000000006e-05 2023-08-01T19:55:50.926 INFO:teuthology.orchestra.run.smithi008.stdout: }, 2023-08-01T19:55:50.926 INFO:teuthology.orchestra.run.smithi008.stdout: { 2023-08-01T19:55:50.926 INFO:teuthology.orchestra.run.smithi008.stdout: "event": "waiting for subops from 1", 2023-08-01T19:55:50.926 INFO:teuthology.orchestra.run.smithi008.stdout: "time": "2023-08-01T19:55:09.292697+0000", 2023-08-01T19:55:50.926 INFO:teuthology.orchestra.run.smithi008.stdout: "duration": 0.000100368 2023-08-01T19:55:50.926 INFO:teuthology.orchestra.run.smithi008.stdout: }, 2023-08-01T19:55:50.926 INFO:teuthology.orchestra.run.smithi008.stdout: { 2023-08-01T19:55:50.926 INFO:teuthology.orchestra.run.smithi008.stdout: "event": "op_commit", 2023-08-01T19:55:50.927 INFO:teuthology.orchestra.run.smithi008.stdout: "time": "2023-08-01T19:55:09.295658+0000", 2023-08-01T19:55:50.927 INFO:teuthology.orchestra.run.smithi008.stdout: "duration": 0.0029617290000000002 2023-08-01T19:55:50.927 INFO:teuthology.orchestra.run.smithi008.stdout: }, 2023-08-01T19:55:50.927 INFO:teuthology.orchestra.run.smithi008.stdout: { 2023-08-01T19:55:50.927 INFO:teuthology.orchestra.run.smithi008.stdout: "event": "sub_op_commit_rec", 2023-08-01T19:55:50.927 INFO:teuthology.orchestra.run.smithi008.stdout: "time": "2023-08-01T19:55:09.353604+0000", 2023-08-01T19:55:50.927 INFO:teuthology.orchestra.run.smithi008.stdout: "duration": 0.057945868999999997 2023-08-01T19:55:50.928 INFO:teuthology.orchestra.run.smithi008.stdout: }, 2023-08-01T19:55:50.928 INFO:teuthology.orchestra.run.smithi008.stdout: { 2023-08-01T19:55:50.928 INFO:teuthology.orchestra.run.smithi008.stdout: "event": "commit_sent", 2023-08-01T19:55:50.928 INFO:teuthology.orchestra.run.smithi008.stdout: "time": "2023-08-01T19:55:09.353650+0000", 2023-08-01T19:55:50.928 INFO:teuthology.orchestra.run.smithi008.stdout: "duration": 4.5698999999999997e-05 2023-08-01T19:55:50.928 INFO:teuthology.orchestra.run.smithi008.stdout: }, 2023-08-01T19:55:50.928 INFO:teuthology.orchestra.run.smithi008.stdout: { 2023-08-01T19:55:50.928 INFO:teuthology.orchestra.run.smithi008.stdout: "event": "done", 2023-08-01T19:55:50.929 INFO:teuthology.orchestra.run.smithi008.stdout: "time": "2023-08-01T19:55:09.353686+0000", 2023-08-01T19:55:50.929 INFO:teuthology.orchestra.run.smithi008.stdout: "duration": 3.5936999999999998e-05 2023-08-01T19:55:50.929 INFO:teuthology.orchestra.run.smithi008.stdout: } 2023-08-01T19:55:50.929 INFO:teuthology.orchestra.run.smithi008.stdout: ] 2023-08-01T19:55:50.929 INFO:teuthology.orchestra.run.smithi008.stdout: } 2023-08-01T19:55:50.929 INFO:teuthology.orchestra.run.smithi008.stdout: } 2023-08-01T19:55:50.929 INFO:teuthology.orchestra.run.smithi008.stdout: ] 2023-08-01T19:55:50.929 INFO:teuthology.orchestra.run.smithi008.stdout:} 2023-08-01T19:55:50.930 DEBUG:teuthology.orchestra.run.smithi006:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 120 ceph --cluster ceph -- tell 'osd.*' injectargs --osd_enable_op_tracker=false 2023-08-01T19:55:50.931 INFO:tasks.ceph.osd.1.smithi101.stderr:2023-08-01T19:55:50.929+0000 7fb0cb7f6700 -1 received signal: Hangup from /usr/bin/python3 /bin/daemon-helper kill ceph-osd -f --cluster ceph -i 1 (PID: 111141) UID: 0 2023-08-01T19:55:50.932 DEBUG:teuthology.orchestra.run.smithi101:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 30 ceph --cluster ceph --admin-daemon /var/run/ceph/ceph-osd.1.asok dump_ops_in_flight 2023-08-01T19:55:51.031 INFO:tasks.ceph.osd.1.smithi101.stderr:2023-08-01T19:55:51.030+0000 7fb0cb7f6700 -1 received signal: Hangup from /usr/bin/python3 /bin/daemon-helper kill ceph-osd -f --cluster ceph -i 1 (PID: 111141) UID: 0 2023-08-01T19:55:51.059 INFO:teuthology.orchestra.run.smithi101.stdout:{ 2023-08-01T19:55:51.060 INFO:teuthology.orchestra.run.smithi101.stdout: "ops": [], 2023-08-01T19:55:51.060 INFO:teuthology.orchestra.run.smithi101.stdout: "num_ops": 0 2023-08-01T19:55:51.060 INFO:teuthology.orchestra.run.smithi101.stdout:} 2023-08-01T19:55:51.069 DEBUG:teuthology.orchestra.run.smithi101:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 30 ceph --cluster ceph --admin-daemon /var/run/ceph/ceph-osd.1.asok dump_blocked_ops 2023-08-01T19:55:51.091 INFO:teuthology.orchestra.run.smithi006.stdout:osd.0: {} 2023-08-01T19:55:51.111 INFO:teuthology.orchestra.run.smithi006.stdout:osd.1: {} 2023-08-01T19:55:51.130 INFO:teuthology.orchestra.run.smithi006.stdout:osd.2: {} 2023-08-01T19:55:51.131 INFO:tasks.ceph.osd.2.smithi155.stderr:2023-08-01T19:55:51.130+0000 7faa5c6ac700 -1 received signal: Hangup from /usr/bin/python3 /bin/daemon-helper kill ceph-osd -f --cluster ceph -i 2 (PID: 111337) UID: 0 2023-08-01T19:55:51.132 INFO:teuthology.orchestra.run.smithi006.stderr:osd.0: osd_enable_op_tracker = 'false' 2023-08-01T19:55:51.132 INFO:teuthology.orchestra.run.smithi006.stderr:osd.1: osd_enable_op_tracker = 'false' 2023-08-01T19:55:51.132 INFO:teuthology.orchestra.run.smithi006.stderr:osd.2: osd_enable_op_tracker = 'false' 2023-08-01T19:55:51.198 DEBUG:teuthology.orchestra.run.smithi006:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 120 ceph --cluster ceph osd unset noscrub 2023-08-01T19:55:51.232 INFO:tasks.ceph.osd.2.smithi155.stderr:2023-08-01T19:55:51.231+0000 7faa5c6ac700 -1 received signal: Hangup from /usr/bin/python3 /bin/daemon-helper kill ceph-osd -f --cluster ceph -i 2 (PID: 111337) UID: 0 2023-08-01T19:55:51.275 INFO:teuthology.orchestra.run.smithi101.stdout:ERROR: (22) Invalid argument 2023-08-01T19:55:51.275 INFO:teuthology.orchestra.run.smithi101.stdout:op_tracker tracking is not enabled now, so no ops are tracked currently, even those get stuck. Please enable "osd_enable_op_tracker", and the tracker will start to track new ops received afterwards. 2023-08-01T19:55:51.289 DEBUG:teuthology.orchestra.run.smithi101:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 30 ceph --cluster ceph --admin-daemon /var/run/ceph/ceph-osd.1.asok dump_historic_ops 2023-08-01T19:55:51.333 INFO:tasks.ceph.osd.2.smithi155.stderr:2023-08-01T19:55:51.332+0000 7faa5c6ac700 -1 received signal: Hangup from /usr/bin/python3 /bin/daemon-helper kill ceph-osd -f --cluster ceph -i 2 (PID: 111337) UID: 0 2023-08-01T19:55:51.434 INFO:tasks.ceph.osd.1.smithi101.stderr:2023-08-01T19:55:51.432+0000 7fb0cb7f6700 -1 received signal: Hangup from /usr/bin/python3 /bin/daemon-helper kill ceph-osd -f --cluster ceph -i 1 (PID: 111141) UID: 0 2023-08-01T19:55:51.451 INFO:teuthology.orchestra.run.smithi101.stdout:ERROR: (22) Invalid argument 2023-08-01T19:55:51.451 INFO:teuthology.orchestra.run.smithi101.stdout:op_tracker tracking is not enabled now, so no ops are tracked currently, even those get stuck. Please enable "osd_enable_op_tracker", and the tracker will start to track new ops received afterwards. 2023-08-01T19:55:51.463 DEBUG:teuthology.orchestra.run.smithi155:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 30 ceph --cluster ceph --admin-daemon /var/run/ceph/ceph-osd.2.asok dump_ops_in_flight 2023-08-01T19:55:51.535 INFO:tasks.ceph.osd.1.smithi101.stderr:2023-08-01T19:55:51.533+0000 7fb0cb7f6700 -1 received signal: Hangup from /usr/bin/python3 /bin/daemon-helper kill ceph-osd -f --cluster ceph -i 1 (PID: 111141) UID: 0 2023-08-01T19:55:51.629 INFO:teuthology.orchestra.run.smithi155.stdout:ERROR: (22) Invalid argument 2023-08-01T19:55:51.629 INFO:teuthology.orchestra.run.smithi155.stdout:op_tracker tracking is not enabled now, so no ops are tracked currently, even those get stuck. Please enable "osd_enable_op_tracker", and the tracker will start to track new ops received afterwards. 2023-08-01T19:55:51.635 INFO:tasks.ceph.osd.1.smithi101.stderr:2023-08-01T19:55:51.634+0000 7fb0cb7f6700 -1 received signal: Hangup from /usr/bin/python3 /bin/daemon-helper kill ceph-osd -f --cluster ceph -i 1 (PID: 111141) UID: 0 2023-08-01T19:55:51.642 DEBUG:teuthology.orchestra.run.smithi155:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 30 ceph --cluster ceph --admin-daemon /var/run/ceph/ceph-osd.2.asok dump_blocked_ops 2023-08-01T19:55:51.736 INFO:tasks.ceph.osd.1.smithi101.stderr:2023-08-01T19:55:51.735+0000 7fb0cb7f6700 -1 received signal: Hangup from /usr/bin/python3 /bin/daemon-helper kill ceph-osd -f --cluster ceph -i 1 (PID: 111141) UID: 0 2023-08-01T19:55:51.806 INFO:teuthology.orchestra.run.smithi155.stdout:ERROR: (22) Invalid argument 2023-08-01T19:55:51.806 INFO:teuthology.orchestra.run.smithi155.stdout:op_tracker tracking is not enabled now, so no ops are tracked currently, even those get stuck. Please enable "osd_enable_op_tracker", and the tracker will start to track new ops received afterwards. 2023-08-01T19:55:51.818 DEBUG:teuthology.orchestra.run.smithi155:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 30 ceph --cluster ceph --admin-daemon /var/run/ceph/ceph-osd.2.asok dump_historic_ops 2023-08-01T19:55:51.837 INFO:tasks.ceph.osd.1.smithi101.stderr:2023-08-01T19:55:51.836+0000 7fb0cb7f6700 -1 received signal: Hangup from /usr/bin/python3 /bin/daemon-helper kill ceph-osd -f --cluster ceph -i 1 (PID: 111141) UID: 0 2023-08-01T19:55:51.938 INFO:tasks.ceph.osd.0.smithi008.stderr:2023-08-01T19:55:51.936+0000 7f16a58f4700 -1 received signal: Hangup from /usr/bin/python3 /bin/daemon-helper kill ceph-osd -f --cluster ceph -i 0 (PID: 111179) UID: 0 2023-08-01T19:55:51.985 INFO:teuthology.orchestra.run.smithi155.stdout:ERROR: (22) Invalid argument 2023-08-01T19:55:51.985 INFO:teuthology.orchestra.run.smithi155.stdout:op_tracker tracking is not enabled now, so no ops are tracked currently, even those get stuck. Please enable "osd_enable_op_tracker", and the tracker will start to track new ops received afterwards. 2023-08-01T19:55:51.998 DEBUG:teuthology.orchestra.run.smithi008:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 30 ceph --cluster ceph --admin-daemon /var/run/ceph/ceph-osd.0.asok dump_ops_in_flight 2023-08-01T19:55:52.041 INFO:tasks.ceph.osd.0.smithi008.stderr:2023-08-01T19:55:52.040+0000 7f16a58f4700 -1 received signal: Hangup from /usr/bin/python3 /bin/daemon-helper kill ceph-osd -f --cluster ceph -i 0 (PID: 111179) UID: 0 2023-08-01T19:55:52.128 INFO:teuthology.orchestra.run.smithi006.stderr:noscrub is unset 2023-08-01T19:55:52.139 INFO:tasks.ceph.osd.2.smithi155.stderr:2023-08-01T19:55:52.137+0000 7faa5c6ac700 -1 received signal: Hangup from /usr/bin/python3 /bin/daemon-helper kill ceph-osd -f --cluster ceph -i 2 (PID: 111337) UID: 0 2023-08-01T19:55:52.187 INFO:teuthology.orchestra.run.smithi008.stdout:ERROR: (22) Invalid argument 2023-08-01T19:55:52.188 INFO:teuthology.orchestra.run.smithi008.stdout:op_tracker tracking is not enabled now, so no ops are tracked currently, even those get stuck. Please enable "osd_enable_op_tracker", and the tracker will start to track new ops received afterwards. 2023-08-01T19:55:52.200 DEBUG:teuthology.orchestra.run.smithi008:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 30 ceph --cluster ceph --admin-daemon /var/run/ceph/ceph-osd.0.asok dump_blocked_ops 2023-08-01T19:55:52.239 INFO:tasks.ceph.osd.2.smithi155.stderr:2023-08-01T19:55:52.238+0000 7faa5c6ac700 -1 received signal: Hangup from /usr/bin/python3 /bin/daemon-helper kill ceph-osd -f --cluster ceph -i 2 (PID: 111337) UID: 0 2023-08-01T19:55:52.340 INFO:tasks.ceph.osd.0.smithi008.stderr:2023-08-01T19:55:52.339+0000 7f16a58f4700 -1 received signal: Hangup from /usr/bin/python3 /bin/daemon-helper kill ceph-osd -f --cluster ceph -i 0 (PID: 111179) UID: 0 2023-08-01T19:55:52.433 INFO:teuthology.orchestra.run.smithi008.stdout:ERROR: (22) Invalid argument 2023-08-01T19:55:52.433 INFO:teuthology.orchestra.run.smithi008.stdout:op_tracker tracking is not enabled now, so no ops are tracked currently, even those get stuck. Please enable "osd_enable_op_tracker", and the tracker will start to track new ops received afterwards. 2023-08-01T19:55:52.441 INFO:tasks.ceph.osd.0.smithi008.stderr:2023-08-01T19:55:52.439+0000 7f16a58f4700 -1 received signal: Hangup from /usr/bin/python3 /bin/daemon-helper kill ceph-osd -f --cluster ceph -i 0 (PID: 111179) UID: 0 2023-08-01T19:55:52.446 DEBUG:teuthology.orchestra.run.smithi008:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 30 ceph --cluster ceph --admin-daemon /var/run/ceph/ceph-osd.0.asok dump_historic_ops 2023-08-01T19:55:52.542 INFO:tasks.ceph.osd.1.smithi101.stderr:2023-08-01T19:55:52.540+0000 7fb0cb7f6700 -1 received signal: Hangup from /usr/bin/python3 /bin/daemon-helper kill ceph-osd -f --cluster ceph -i 1 (PID: 111141) UID: 0 2023-08-01T19:55:52.642 INFO:tasks.ceph.osd.2.smithi155.stderr:2023-08-01T19:55:52.640+0000 7faa5c6ac700 -1 received signal: Hangup from /usr/bin/python3 /bin/daemon-helper kill ceph-osd -f --cluster ceph -i 2 (PID: 111337) UID: 0 2023-08-01T19:55:52.664 INFO:teuthology.orchestra.run.smithi008.stdout:ERROR: (22) Invalid argument 2023-08-01T19:55:52.664 INFO:teuthology.orchestra.run.smithi008.stdout:op_tracker tracking is not enabled now, so no ops are tracked currently, even those get stuck. Please enable "osd_enable_op_tracker", and the tracker will start to track new ops received afterwards. 2023-08-01T19:55:52.678 DEBUG:teuthology.orchestra.run.smithi101:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 30 ceph --cluster ceph --admin-daemon /var/run/ceph/ceph-osd.1.asok dump_ops_in_flight 2023-08-01T19:55:52.743 INFO:tasks.ceph.osd.1.smithi101.stderr:2023-08-01T19:55:52.742+0000 7fb0cb7f6700 -1 received signal: Hangup from /usr/bin/python3 /bin/daemon-helper kill ceph-osd -f --cluster ceph -i 1 (PID: 111141) UID: 0 2023-08-01T19:55:52.844 INFO:tasks.ceph.osd.1.smithi101.stderr:2023-08-01T19:55:52.843+0000 7fb0cb7f6700 -1 received signal: Hangup from /usr/bin/python3 /bin/daemon-helper kill ceph-osd -f --cluster ceph -i 1 (PID: 111141) UID: 0 2023-08-01T19:55:52.846 INFO:teuthology.orchestra.run.smithi101.stdout:ERROR: (22) Invalid argument 2023-08-01T19:55:52.846 INFO:teuthology.orchestra.run.smithi101.stdout:op_tracker tracking is not enabled now, so no ops are tracked currently, even those get stuck. Please enable "osd_enable_op_tracker", and the tracker will start to track new ops received afterwards. 2023-08-01T19:55:52.859 DEBUG:teuthology.orchestra.run.smithi101:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 30 ceph --cluster ceph --admin-daemon /var/run/ceph/ceph-osd.1.asok dump_blocked_ops 2023-08-01T19:55:52.945 INFO:tasks.ceph.osd.2.smithi155.stderr:2023-08-01T19:55:52.943+0000 7faa5c6ac700 -1 received signal: Hangup from /usr/bin/python3 /bin/daemon-helper kill ceph-osd -f --cluster ceph -i 2 (PID: 111337) UID: 0 2023-08-01T19:55:53.048 INFO:tasks.ceph.osd.0.smithi008.stderr:2023-08-01T19:55:53.046+0000 7f16a58f4700 -1 received signal: Hangup from /usr/bin/python3 /bin/daemon-helper kill ceph-osd -f --cluster ceph -i 0 (PID: 111179) UID: 0 2023-08-01T19:55:53.055 INFO:teuthology.orchestra.run.smithi101.stdout:ERROR: (22) Invalid argument 2023-08-01T19:55:53.055 INFO:teuthology.orchestra.run.smithi101.stdout:op_tracker tracking is not enabled now, so no ops are tracked currently, even those get stuck. Please enable "osd_enable_op_tracker", and the tracker will start to track new ops received afterwards. 2023-08-01T19:55:53.067 DEBUG:teuthology.orchestra.run.smithi101:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 30 ceph --cluster ceph --admin-daemon /var/run/ceph/ceph-osd.1.asok dump_historic_ops 2023-08-01T19:55:53.143 DEBUG:teuthology.orchestra.run.smithi006:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 120 ceph --cluster ceph -- tell 'osd.*' injectargs --osd_enable_op_tracker=true 2023-08-01T19:55:53.147 INFO:tasks.ceph.osd.2.smithi155.stderr:2023-08-01T19:55:53.145+0000 7faa5c6ac700 -1 received signal: Hangup from /usr/bin/python3 /bin/daemon-helper kill ceph-osd -f --cluster ceph -i 2 (PID: 111337) UID: 0 2023-08-01T19:55:53.234 INFO:teuthology.orchestra.run.smithi101.stdout:ERROR: (22) Invalid argument 2023-08-01T19:55:53.234 INFO:teuthology.orchestra.run.smithi101.stdout:op_tracker tracking is not enabled now, so no ops are tracked currently, even those get stuck. Please enable "osd_enable_op_tracker", and the tracker will start to track new ops received afterwards. 2023-08-01T19:55:53.247 DEBUG:teuthology.orchestra.run.smithi155:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 30 ceph --cluster ceph --admin-daemon /var/run/ceph/ceph-osd.2.asok dump_ops_in_flight 2023-08-01T19:55:53.248 INFO:tasks.ceph.osd.1.smithi101.stderr:2023-08-01T19:55:53.246+0000 7fb0cb7f6700 -1 received signal: Hangup from /usr/bin/python3 /bin/daemon-helper kill ceph-osd -f --cluster ceph -i 1 (PID: 111141) UID: 0 2023-08-01T19:55:53.292 INFO:teuthology.orchestra.run.smithi006.stdout:osd.0: {} 2023-08-01T19:55:53.311 INFO:teuthology.orchestra.run.smithi006.stdout:osd.1: {} 2023-08-01T19:55:53.332 INFO:teuthology.orchestra.run.smithi006.stdout:osd.2: {} 2023-08-01T19:55:53.334 INFO:teuthology.orchestra.run.smithi006.stderr:osd.0: osd_enable_op_tracker = 'true' 2023-08-01T19:55:53.334 INFO:teuthology.orchestra.run.smithi006.stderr:osd.1: osd_enable_op_tracker = 'true' 2023-08-01T19:55:53.334 INFO:teuthology.orchestra.run.smithi006.stderr:osd.2: osd_enable_op_tracker = 'true' 2023-08-01T19:55:53.348 INFO:tasks.ceph.osd.2.smithi155.stderr:2023-08-01T19:55:53.347+0000 7faa5c6ac700 -1 received signal: Hangup from /usr/bin/python3 /bin/daemon-helper kill ceph-osd -f --cluster ceph -i 2 (PID: 111337) UID: 0 2023-08-01T19:55:53.410 INFO:teuthology.orchestra.run.smithi155.stdout:{ 2023-08-01T19:55:53.411 INFO:teuthology.orchestra.run.smithi155.stdout: "ops": [ 2023-08-01T19:55:53.411 INFO:teuthology.orchestra.run.smithi155.stdout: { 2023-08-01T19:55:53.411 INFO:teuthology.orchestra.run.smithi155.stdout: "description": "osd_op(client.4668.0:186980 5.9 5:95c0291f:::benchmark_data_smithi006_114134_object53319:head [delete] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e59)", 2023-08-01T19:55:53.411 INFO:teuthology.orchestra.run.smithi155.stdout: "initiated_at": "2023-08-01T19:55:53.400041+0000", 2023-08-01T19:55:53.411 INFO:teuthology.orchestra.run.smithi155.stdout: "age": 0.0085694240000000008, 2023-08-01T19:55:53.411 INFO:teuthology.orchestra.run.smithi155.stdout: "duration": 0.0085938070000000002, 2023-08-01T19:55:53.411 INFO:teuthology.orchestra.run.smithi155.stdout: "type_data": { 2023-08-01T19:55:53.412 INFO:teuthology.orchestra.run.smithi155.stdout: "flag_point": "commit sent; apply or cleanup", 2023-08-01T19:55:53.412 INFO:teuthology.orchestra.run.smithi155.stdout: "client_info": { 2023-08-01T19:55:53.412 INFO:teuthology.orchestra.run.smithi155.stdout: "client": "client.4668", 2023-08-01T19:55:53.412 INFO:teuthology.orchestra.run.smithi155.stdout: "client_addr": "172.21.15.6:0/1709472247", 2023-08-01T19:55:53.412 INFO:teuthology.orchestra.run.smithi155.stdout: "tid": 186980 2023-08-01T19:55:53.412 INFO:teuthology.orchestra.run.smithi155.stdout: }, 2023-08-01T19:55:53.412 INFO:teuthology.orchestra.run.smithi155.stdout: "events": [ 2023-08-01T19:55:53.412 INFO:teuthology.orchestra.run.smithi155.stdout: { 2023-08-01T19:55:53.413 INFO:teuthology.orchestra.run.smithi155.stdout: "event": "initiated", 2023-08-01T19:55:53.413 INFO:teuthology.orchestra.run.smithi155.stdout: "time": "2023-08-01T19:55:53.400041+0000", 2023-08-01T19:55:53.413 INFO:teuthology.orchestra.run.smithi155.stdout: "duration": 0 2023-08-01T19:55:53.413 INFO:teuthology.orchestra.run.smithi155.stdout: }, 2023-08-01T19:55:53.413 INFO:teuthology.orchestra.run.smithi155.stdout: { 2023-08-01T19:55:53.413 INFO:teuthology.orchestra.run.smithi155.stdout: "event": "throttled", 2023-08-01T19:55:53.413 INFO:teuthology.orchestra.run.smithi155.stdout: "time": "2023-08-01T19:55:53.400041+0000", 2023-08-01T19:55:53.413 INFO:teuthology.orchestra.run.smithi155.stdout: "duration": 0 2023-08-01T19:55:53.414 INFO:teuthology.orchestra.run.smithi155.stdout: }, 2023-08-01T19:55:53.414 INFO:teuthology.orchestra.run.smithi155.stdout: { 2023-08-01T19:55:53.414 INFO:teuthology.orchestra.run.smithi155.stdout: "event": "header_read", 2023-08-01T19:55:53.414 INFO:teuthology.orchestra.run.smithi155.stdout: "time": "2023-08-01T19:55:53.400041+0000", 2023-08-01T19:55:53.414 INFO:teuthology.orchestra.run.smithi155.stdout: "duration": 4294967295.999999 2023-08-01T19:55:53.414 INFO:teuthology.orchestra.run.smithi155.stdout: }, 2023-08-01T19:55:53.414 INFO:teuthology.orchestra.run.smithi155.stdout: { 2023-08-01T19:55:53.415 INFO:teuthology.orchestra.run.smithi155.stdout: "event": "all_read", 2023-08-01T19:55:53.415 INFO:teuthology.orchestra.run.smithi155.stdout: "time": "2023-08-01T19:55:53.400045+0000", 2023-08-01T19:55:53.415 INFO:teuthology.orchestra.run.smithi155.stdout: "duration": 4.7249999999999997e-06 2023-08-01T19:55:53.415 INFO:teuthology.orchestra.run.smithi155.stdout: }, 2023-08-01T19:55:53.415 INFO:teuthology.orchestra.run.smithi155.stdout: { 2023-08-01T19:55:53.415 INFO:teuthology.orchestra.run.smithi155.stdout: "event": "dispatched", 2023-08-01T19:55:53.415 INFO:teuthology.orchestra.run.smithi155.stdout: "time": "2023-08-01T19:55:53.400056+0000", 2023-08-01T19:55:53.416 INFO:teuthology.orchestra.run.smithi155.stdout: "duration": 1.1185999999999999e-05 2023-08-01T19:55:53.416 INFO:teuthology.orchestra.run.smithi155.stdout: }, 2023-08-01T19:55:53.416 INFO:teuthology.orchestra.run.smithi155.stdout: { 2023-08-01T19:55:53.416 INFO:teuthology.orchestra.run.smithi155.stdout: "event": "queued_for_pg", 2023-08-01T19:55:53.416 INFO:teuthology.orchestra.run.smithi155.stdout: "time": "2023-08-01T19:55:53.400062+0000", 2023-08-01T19:55:53.416 INFO:teuthology.orchestra.run.smithi155.stdout: "duration": 6.0530000000000003e-06 2023-08-01T19:55:53.416 INFO:teuthology.orchestra.run.smithi155.stdout: }, 2023-08-01T19:55:53.416 INFO:teuthology.orchestra.run.smithi155.stdout: { 2023-08-01T19:55:53.417 INFO:teuthology.orchestra.run.smithi155.stdout: "event": "reached_pg", 2023-08-01T19:55:53.417 INFO:teuthology.orchestra.run.smithi155.stdout: "time": "2023-08-01T19:55:53.400096+0000", 2023-08-01T19:55:53.417 INFO:teuthology.orchestra.run.smithi155.stdout: "duration": 3.3745000000000003e-05 2023-08-01T19:55:53.417 INFO:teuthology.orchestra.run.smithi155.stdout: }, 2023-08-01T19:55:53.417 INFO:teuthology.orchestra.run.smithi155.stdout: { 2023-08-01T19:55:53.417 INFO:teuthology.orchestra.run.smithi155.stdout: "event": "started", 2023-08-01T19:55:53.417 INFO:teuthology.orchestra.run.smithi155.stdout: "time": "2023-08-01T19:55:53.400210+0000", 2023-08-01T19:55:53.417 INFO:teuthology.orchestra.run.smithi155.stdout: "duration": 0.00011424 2023-08-01T19:55:53.418 INFO:teuthology.orchestra.run.smithi155.stdout: }, 2023-08-01T19:55:53.418 INFO:teuthology.orchestra.run.smithi155.stdout: { 2023-08-01T19:55:53.418 INFO:teuthology.orchestra.run.smithi155.stdout: "event": "waiting for subops from 1", 2023-08-01T19:55:53.418 INFO:teuthology.orchestra.run.smithi155.stdout: "time": "2023-08-01T19:55:53.400308+0000", 2023-08-01T19:55:53.418 INFO:teuthology.orchestra.run.smithi155.stdout: "duration": 9.7936000000000006e-05 2023-08-01T19:55:53.418 INFO:teuthology.orchestra.run.smithi155.stdout: }, 2023-08-01T19:55:53.418 INFO:teuthology.orchestra.run.smithi155.stdout: { 2023-08-01T19:55:53.419 INFO:teuthology.orchestra.run.smithi155.stdout: "event": "sub_op_commit_rec", 2023-08-01T19:55:53.419 INFO:teuthology.orchestra.run.smithi155.stdout: "time": "2023-08-01T19:55:53.405646+0000", 2023-08-01T19:55:53.419 INFO:teuthology.orchestra.run.smithi155.stdout: "duration": 0.0053380279999999999 2023-08-01T19:55:53.419 INFO:teuthology.orchestra.run.smithi155.stdout: }, 2023-08-01T19:55:53.419 INFO:teuthology.orchestra.run.smithi155.stdout: { 2023-08-01T19:55:53.419 INFO:teuthology.orchestra.run.smithi155.stdout: "event": "op_commit", 2023-08-01T19:55:53.419 INFO:teuthology.orchestra.run.smithi155.stdout: "time": "2023-08-01T19:55:53.408560+0000", 2023-08-01T19:55:53.419 INFO:teuthology.orchestra.run.smithi155.stdout: "duration": 0.0029140189999999999 2023-08-01T19:55:53.420 INFO:teuthology.orchestra.run.smithi155.stdout: }, 2023-08-01T19:55:53.420 INFO:teuthology.orchestra.run.smithi155.stdout: { 2023-08-01T19:55:53.420 INFO:teuthology.orchestra.run.smithi155.stdout: "event": "commit_sent", 2023-08-01T19:55:53.420 INFO:teuthology.orchestra.run.smithi155.stdout: "time": "2023-08-01T19:55:53.408597+0000", 2023-08-01T19:55:53.420 INFO:teuthology.orchestra.run.smithi155.stdout: "duration": 3.6303999999999997e-05 2023-08-01T19:55:53.420 INFO:teuthology.orchestra.run.smithi155.stdout: }, 2023-08-01T19:55:53.420 INFO:teuthology.orchestra.run.smithi155.stdout: { 2023-08-01T19:55:53.420 INFO:teuthology.orchestra.run.smithi155.stdout: "event": "done", 2023-08-01T19:55:53.421 INFO:teuthology.orchestra.run.smithi155.stdout: "time": "2023-08-01T19:55:53.408635+0000", 2023-08-01T19:55:53.421 INFO:teuthology.orchestra.run.smithi155.stdout: "duration": 3.8470000000000003e-05 2023-08-01T19:55:53.421 INFO:teuthology.orchestra.run.smithi155.stdout: } 2023-08-01T19:55:53.421 INFO:teuthology.orchestra.run.smithi155.stdout: ] 2023-08-01T19:55:53.421 INFO:teuthology.orchestra.run.smithi155.stdout: } 2023-08-01T19:55:53.421 INFO:teuthology.orchestra.run.smithi155.stdout: }, 2023-08-01T19:55:53.421 INFO:teuthology.orchestra.run.smithi155.stdout: { 2023-08-01T19:55:53.421 INFO:teuthology.orchestra.run.smithi155.stdout: "description": "osd_op(client.4668.0:186982 5.9 5:94fa0b6d:::benchmark_data_smithi006_114134_object53321:head [delete] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e59)", 2023-08-01T19:55:53.422 INFO:teuthology.orchestra.run.smithi155.stdout: "initiated_at": "2023-08-01T19:55:53.401409+0000", 2023-08-01T19:55:53.422 INFO:teuthology.orchestra.run.smithi155.stdout: "age": 0.007201865, 2023-08-01T19:55:53.422 INFO:teuthology.orchestra.run.smithi155.stdout: "duration": 0.0073284759999999996, 2023-08-01T19:55:53.422 INFO:teuthology.orchestra.run.smithi155.stdout: "type_data": { 2023-08-01T19:55:53.422 INFO:teuthology.orchestra.run.smithi155.stdout: "flag_point": "waiting for sub ops", 2023-08-01T19:55:53.422 INFO:teuthology.orchestra.run.smithi155.stdout: "client_info": { 2023-08-01T19:55:53.422 INFO:teuthology.orchestra.run.smithi155.stdout: "client": "client.4668", 2023-08-01T19:55:53.423 INFO:teuthology.orchestra.run.smithi155.stdout: "client_addr": "172.21.15.6:0/1709472247", 2023-08-01T19:55:53.423 INFO:teuthology.orchestra.run.smithi155.stdout: "tid": 186982 2023-08-01T19:55:53.423 INFO:teuthology.orchestra.run.smithi155.stdout: }, 2023-08-01T19:55:53.423 INFO:teuthology.orchestra.run.smithi155.stdout: "events": [ 2023-08-01T19:55:53.423 INFO:teuthology.orchestra.run.smithi155.stdout: { 2023-08-01T19:55:53.423 INFO:teuthology.orchestra.run.smithi155.stdout: "event": "initiated", 2023-08-01T19:55:53.423 INFO:teuthology.orchestra.run.smithi155.stdout: "time": "2023-08-01T19:55:53.401409+0000", 2023-08-01T19:55:53.423 INFO:teuthology.orchestra.run.smithi155.stdout: "duration": 0 2023-08-01T19:55:53.424 INFO:teuthology.orchestra.run.smithi155.stdout: }, 2023-08-01T19:55:53.424 INFO:teuthology.orchestra.run.smithi155.stdout: { 2023-08-01T19:55:53.424 INFO:teuthology.orchestra.run.smithi155.stdout: "event": "throttled", 2023-08-01T19:55:53.424 INFO:teuthology.orchestra.run.smithi155.stdout: "time": "2023-08-01T19:55:53.401409+0000", 2023-08-01T19:55:53.424 INFO:teuthology.orchestra.run.smithi155.stdout: "duration": 0 2023-08-01T19:55:53.424 INFO:teuthology.orchestra.run.smithi155.stdout: }, 2023-08-01T19:55:53.424 INFO:teuthology.orchestra.run.smithi155.stdout: { 2023-08-01T19:55:53.424 INFO:teuthology.orchestra.run.smithi155.stdout: "event": "header_read", 2023-08-01T19:55:53.425 INFO:teuthology.orchestra.run.smithi155.stdout: "time": "2023-08-01T19:55:53.401408+0000", 2023-08-01T19:55:53.425 INFO:teuthology.orchestra.run.smithi155.stdout: "duration": 4294967295.9999995 2023-08-01T19:55:53.425 INFO:teuthology.orchestra.run.smithi155.stdout: }, 2023-08-01T19:55:53.425 INFO:teuthology.orchestra.run.smithi155.stdout: { 2023-08-01T19:55:53.425 INFO:teuthology.orchestra.run.smithi155.stdout: "event": "all_read", 2023-08-01T19:55:53.425 INFO:teuthology.orchestra.run.smithi155.stdout: "time": "2023-08-01T19:55:53.401415+0000", 2023-08-01T19:55:53.426 INFO:teuthology.orchestra.run.smithi155.stdout: "duration": 7.0480000000000001e-06 2023-08-01T19:55:53.426 INFO:teuthology.orchestra.run.smithi155.stdout: }, 2023-08-01T19:55:53.426 INFO:teuthology.orchestra.run.smithi155.stdout: { 2023-08-01T19:55:53.426 INFO:teuthology.orchestra.run.smithi155.stdout: "event": "dispatched", 2023-08-01T19:55:53.426 INFO:teuthology.orchestra.run.smithi155.stdout: "time": "2023-08-01T19:55:53.401423+0000", 2023-08-01T19:55:53.426 INFO:teuthology.orchestra.run.smithi155.stdout: "duration": 8.0530000000000007e-06 2023-08-01T19:55:53.426 INFO:teuthology.orchestra.run.smithi155.stdout: }, 2023-08-01T19:55:53.426 INFO:teuthology.orchestra.run.smithi155.stdout: { 2023-08-01T19:55:53.427 INFO:teuthology.orchestra.run.smithi155.stdout: "event": "queued_for_pg", 2023-08-01T19:55:53.427 INFO:teuthology.orchestra.run.smithi155.stdout: "time": "2023-08-01T19:55:53.401427+0000", 2023-08-01T19:55:53.427 INFO:teuthology.orchestra.run.smithi155.stdout: "duration": 3.9219999999999999e-06 2023-08-01T19:55:53.427 INFO:teuthology.orchestra.run.smithi155.stdout: }, 2023-08-01T19:55:53.427 INFO:teuthology.orchestra.run.smithi155.stdout: { 2023-08-01T19:55:53.427 INFO:teuthology.orchestra.run.smithi155.stdout: "event": "reached_pg", 2023-08-01T19:55:53.427 INFO:teuthology.orchestra.run.smithi155.stdout: "time": "2023-08-01T19:55:53.401726+0000", 2023-08-01T19:55:53.427 INFO:teuthology.orchestra.run.smithi155.stdout: "duration": 0.00029871900000000002 2023-08-01T19:55:53.428 INFO:teuthology.orchestra.run.smithi155.stdout: }, 2023-08-01T19:55:53.428 INFO:teuthology.orchestra.run.smithi155.stdout: { 2023-08-01T19:55:53.428 INFO:teuthology.orchestra.run.smithi155.stdout: "event": "started", 2023-08-01T19:55:53.428 INFO:teuthology.orchestra.run.smithi155.stdout: "time": "2023-08-01T19:55:53.401801+0000", 2023-08-01T19:55:53.428 INFO:teuthology.orchestra.run.smithi155.stdout: "duration": 7.4672000000000006e-05 2023-08-01T19:55:53.428 INFO:teuthology.orchestra.run.smithi155.stdout: }, 2023-08-01T19:55:53.428 INFO:teuthology.orchestra.run.smithi155.stdout: { 2023-08-01T19:55:53.429 INFO:teuthology.orchestra.run.smithi155.stdout: "event": "waiting for subops from 1", 2023-08-01T19:55:53.429 INFO:teuthology.orchestra.run.smithi155.stdout: "time": "2023-08-01T19:55:53.401862+0000", 2023-08-01T19:55:53.429 INFO:teuthology.orchestra.run.smithi155.stdout: "duration": 6.1161000000000006e-05 2023-08-01T19:55:53.429 INFO:teuthology.orchestra.run.smithi155.stdout: }, 2023-08-01T19:55:53.429 INFO:teuthology.orchestra.run.smithi155.stdout: { 2023-08-01T19:55:53.429 INFO:teuthology.orchestra.run.smithi155.stdout: "event": "sub_op_commit_rec", 2023-08-01T19:55:53.429 INFO:teuthology.orchestra.run.smithi155.stdout: "time": "2023-08-01T19:55:53.406932+0000", 2023-08-01T19:55:53.429 INFO:teuthology.orchestra.run.smithi155.stdout: "duration": 0.0050704679999999999 2023-08-01T19:55:53.430 INFO:teuthology.orchestra.run.smithi155.stdout: }, 2023-08-01T19:55:53.430 INFO:teuthology.orchestra.run.smithi155.stdout: { 2023-08-01T19:55:53.430 INFO:teuthology.orchestra.run.smithi155.stdout: "event": "op_commit", 2023-08-01T19:55:53.430 INFO:teuthology.orchestra.run.smithi155.stdout: "time": "2023-08-01T19:55:53.408738+0000", 2023-08-01T19:55:53.430 INFO:teuthology.orchestra.run.smithi155.stdout: "duration": 0.0018057870000000001 2023-08-01T19:55:53.430 INFO:teuthology.orchestra.run.smithi155.stdout: } 2023-08-01T19:55:53.430 INFO:teuthology.orchestra.run.smithi155.stdout: ] 2023-08-01T19:55:53.431 INFO:teuthology.orchestra.run.smithi155.stdout: } 2023-08-01T19:55:53.431 INFO:teuthology.orchestra.run.smithi155.stdout: }, 2023-08-01T19:55:53.431 INFO:teuthology.orchestra.run.smithi155.stdout: { 2023-08-01T19:55:53.431 INFO:teuthology.orchestra.run.smithi155.stdout: "description": "osd_repop(client.4668.0:186984 5.a e59/19 5:5892c6a4:::benchmark_data_smithi006_114134_object53323:head v 59'11597, mlcod=59'11594)", 2023-08-01T19:55:53.431 INFO:teuthology.orchestra.run.smithi155.stdout: "initiated_at": "2023-08-01T19:55:53.402458+0000", 2023-08-01T19:55:53.431 INFO:teuthology.orchestra.run.smithi155.stdout: "age": 0.0061530780000000002, 2023-08-01T19:55:53.431 INFO:teuthology.orchestra.run.smithi155.stdout: "duration": 0.0063860690000000003, 2023-08-01T19:55:53.432 INFO:teuthology.orchestra.run.smithi155.stdout: "type_data": { 2023-08-01T19:55:53.432 INFO:teuthology.orchestra.run.smithi155.stdout: "flag_point": "started", 2023-08-01T19:55:53.432 INFO:teuthology.orchestra.run.smithi155.stdout: "events": [ 2023-08-01T19:55:53.432 INFO:teuthology.orchestra.run.smithi155.stdout: { 2023-08-01T19:55:53.432 INFO:teuthology.orchestra.run.smithi155.stdout: "event": "initiated", 2023-08-01T19:55:53.432 INFO:teuthology.orchestra.run.smithi155.stdout: "time": "2023-08-01T19:55:53.402458+0000", 2023-08-01T19:55:53.432 INFO:teuthology.orchestra.run.smithi155.stdout: "duration": 0 2023-08-01T19:55:53.432 INFO:teuthology.orchestra.run.smithi155.stdout: }, 2023-08-01T19:55:53.433 INFO:teuthology.orchestra.run.smithi155.stdout: { 2023-08-01T19:55:53.433 INFO:teuthology.orchestra.run.smithi155.stdout: "event": "throttled", 2023-08-01T19:55:53.433 INFO:teuthology.orchestra.run.smithi155.stdout: "time": "2023-08-01T19:55:53.402458+0000", 2023-08-01T19:55:53.433 INFO:teuthology.orchestra.run.smithi155.stdout: "duration": 0 2023-08-01T19:55:53.433 INFO:teuthology.orchestra.run.smithi155.stdout: }, 2023-08-01T19:55:53.433 INFO:teuthology.orchestra.run.smithi155.stdout: { 2023-08-01T19:55:53.433 INFO:teuthology.orchestra.run.smithi155.stdout: "event": "header_read", 2023-08-01T19:55:53.434 INFO:teuthology.orchestra.run.smithi155.stdout: "time": "2023-08-01T19:55:53.402457+0000", 2023-08-01T19:55:53.434 INFO:teuthology.orchestra.run.smithi155.stdout: "duration": 4294967295.9999995 2023-08-01T19:55:53.434 INFO:teuthology.orchestra.run.smithi155.stdout: }, 2023-08-01T19:55:53.434 INFO:teuthology.orchestra.run.smithi155.stdout: { 2023-08-01T19:55:53.434 INFO:teuthology.orchestra.run.smithi155.stdout: "event": "all_read", 2023-08-01T19:55:53.434 INFO:teuthology.orchestra.run.smithi155.stdout: "time": "2023-08-01T19:55:53.402466+0000", 2023-08-01T19:55:53.434 INFO:teuthology.orchestra.run.smithi155.stdout: "duration": 9.0010000000000007e-06 2023-08-01T19:55:53.435 INFO:teuthology.orchestra.run.smithi155.stdout: }, 2023-08-01T19:55:53.435 INFO:teuthology.orchestra.run.smithi155.stdout: { 2023-08-01T19:55:53.435 INFO:teuthology.orchestra.run.smithi155.stdout: "event": "dispatched", 2023-08-01T19:55:53.435 INFO:teuthology.orchestra.run.smithi155.stdout: "time": "2023-08-01T19:55:53.402476+0000", 2023-08-01T19:55:53.435 INFO:teuthology.orchestra.run.smithi155.stdout: "duration": 9.8160000000000005e-06 2023-08-01T19:55:53.435 INFO:teuthology.orchestra.run.smithi155.stdout: }, 2023-08-01T19:55:53.435 INFO:teuthology.orchestra.run.smithi155.stdout: { 2023-08-01T19:55:53.435 INFO:teuthology.orchestra.run.smithi155.stdout: "event": "queued_for_pg", 2023-08-01T19:55:53.436 INFO:teuthology.orchestra.run.smithi155.stdout: "time": "2023-08-01T19:55:53.402480+0000", 2023-08-01T19:55:53.436 INFO:teuthology.orchestra.run.smithi155.stdout: "duration": 4.4070000000000003e-06 2023-08-01T19:55:53.436 INFO:teuthology.orchestra.run.smithi155.stdout: }, 2023-08-01T19:55:53.436 INFO:teuthology.orchestra.run.smithi155.stdout: { 2023-08-01T19:55:53.436 INFO:teuthology.orchestra.run.smithi155.stdout: "event": "reached_pg", 2023-08-01T19:55:53.436 INFO:teuthology.orchestra.run.smithi155.stdout: "time": "2023-08-01T19:55:53.402514+0000", 2023-08-01T19:55:53.436 INFO:teuthology.orchestra.run.smithi155.stdout: "duration": 3.3389999999999997e-05 2023-08-01T19:55:53.437 INFO:teuthology.orchestra.run.smithi155.stdout: }, 2023-08-01T19:55:53.437 INFO:teuthology.orchestra.run.smithi155.stdout: { 2023-08-01T19:55:53.437 INFO:teuthology.orchestra.run.smithi155.stdout: "event": "started", 2023-08-01T19:55:53.437 INFO:teuthology.orchestra.run.smithi155.stdout: "time": "2023-08-01T19:55:53.402533+0000", 2023-08-01T19:55:53.437 INFO:teuthology.orchestra.run.smithi155.stdout: "duration": 1.8873999999999999e-05 2023-08-01T19:55:53.437 INFO:teuthology.orchestra.run.smithi155.stdout: } 2023-08-01T19:55:53.437 INFO:teuthology.orchestra.run.smithi155.stdout: ] 2023-08-01T19:55:53.437 INFO:teuthology.orchestra.run.smithi155.stdout: } 2023-08-01T19:55:53.438 INFO:teuthology.orchestra.run.smithi155.stdout: }, 2023-08-01T19:55:53.438 INFO:teuthology.orchestra.run.smithi155.stdout: { 2023-08-01T19:55:53.438 INFO:teuthology.orchestra.run.smithi155.stdout: "description": "osd_op(client.4668.0:186985 5.f 5:f0658125:::benchmark_data_smithi006_114134_object53324:head [delete] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e59)", 2023-08-01T19:55:53.438 INFO:teuthology.orchestra.run.smithi155.stdout: "initiated_at": "2023-08-01T19:55:53.404123+0000", 2023-08-01T19:55:53.438 INFO:teuthology.orchestra.run.smithi155.stdout: "age": 0.0044880170000000004, 2023-08-01T19:55:53.438 INFO:teuthology.orchestra.run.smithi155.stdout: "duration": 0.0047980009999999997, 2023-08-01T19:55:53.438 INFO:teuthology.orchestra.run.smithi155.stdout: "type_data": { 2023-08-01T19:55:53.438 INFO:teuthology.orchestra.run.smithi155.stdout: "flag_point": "waiting for sub ops", 2023-08-01T19:55:53.439 INFO:teuthology.orchestra.run.smithi155.stdout: "client_info": { 2023-08-01T19:55:53.439 INFO:teuthology.orchestra.run.smithi155.stdout: "client": "client.4668", 2023-08-01T19:55:53.439 INFO:teuthology.orchestra.run.smithi155.stdout: "client_addr": "172.21.15.6:0/1709472247", 2023-08-01T19:55:53.439 INFO:teuthology.orchestra.run.smithi155.stdout: "tid": 186985 2023-08-01T19:55:53.439 INFO:teuthology.orchestra.run.smithi155.stdout: }, 2023-08-01T19:55:53.439 INFO:teuthology.orchestra.run.smithi155.stdout: "events": [ 2023-08-01T19:55:53.439 INFO:teuthology.orchestra.run.smithi155.stdout: { 2023-08-01T19:55:53.440 INFO:teuthology.orchestra.run.smithi155.stdout: "event": "initiated", 2023-08-01T19:55:53.440 INFO:teuthology.orchestra.run.smithi155.stdout: "time": "2023-08-01T19:55:53.404123+0000", 2023-08-01T19:55:53.440 INFO:teuthology.orchestra.run.smithi155.stdout: "duration": 0 2023-08-01T19:55:53.440 INFO:teuthology.orchestra.run.smithi155.stdout: }, 2023-08-01T19:55:53.440 INFO:teuthology.orchestra.run.smithi155.stdout: { 2023-08-01T19:55:53.440 INFO:teuthology.orchestra.run.smithi155.stdout: "event": "throttled", 2023-08-01T19:55:53.440 INFO:teuthology.orchestra.run.smithi155.stdout: "time": "2023-08-01T19:55:53.404123+0000", 2023-08-01T19:55:53.440 INFO:teuthology.orchestra.run.smithi155.stdout: "duration": 0 2023-08-01T19:55:53.441 INFO:teuthology.orchestra.run.smithi155.stdout: }, 2023-08-01T19:55:53.441 INFO:teuthology.orchestra.run.smithi155.stdout: { 2023-08-01T19:55:53.441 INFO:teuthology.orchestra.run.smithi155.stdout: "event": "header_read", 2023-08-01T19:55:53.441 INFO:teuthology.orchestra.run.smithi155.stdout: "time": "2023-08-01T19:55:53.404122+0000", 2023-08-01T19:55:53.441 INFO:teuthology.orchestra.run.smithi155.stdout: "duration": 4294967295.999999 2023-08-01T19:55:53.441 INFO:teuthology.orchestra.run.smithi155.stdout: }, 2023-08-01T19:55:53.441 INFO:teuthology.orchestra.run.smithi155.stdout: { 2023-08-01T19:55:53.441 INFO:teuthology.orchestra.run.smithi155.stdout: "event": "all_read", 2023-08-01T19:55:53.442 INFO:teuthology.orchestra.run.smithi155.stdout: "time": "2023-08-01T19:55:53.404128+0000", 2023-08-01T19:55:53.442 INFO:teuthology.orchestra.run.smithi155.stdout: "duration": 6.0179999999999998e-06 2023-08-01T19:55:53.442 INFO:teuthology.orchestra.run.smithi155.stdout: }, 2023-08-01T19:55:53.442 INFO:teuthology.orchestra.run.smithi155.stdout: { 2023-08-01T19:55:53.442 INFO:teuthology.orchestra.run.smithi155.stdout: "event": "dispatched", 2023-08-01T19:55:53.442 INFO:teuthology.orchestra.run.smithi155.stdout: "time": "2023-08-01T19:55:53.404136+0000", 2023-08-01T19:55:53.442 INFO:teuthology.orchestra.run.smithi155.stdout: "duration": 8.3729999999999993e-06 2023-08-01T19:55:53.442 INFO:teuthology.orchestra.run.smithi155.stdout: }, 2023-08-01T19:55:53.443 INFO:teuthology.orchestra.run.smithi155.stdout: { 2023-08-01T19:55:53.443 INFO:teuthology.orchestra.run.smithi155.stdout: "event": "queued_for_pg", 2023-08-01T19:55:53.443 INFO:teuthology.orchestra.run.smithi155.stdout: "time": "2023-08-01T19:55:53.404141+0000", 2023-08-01T19:55:53.443 INFO:teuthology.orchestra.run.smithi155.stdout: "duration": 4.1300000000000003e-06 2023-08-01T19:55:53.443 INFO:teuthology.orchestra.run.smithi155.stdout: }, 2023-08-01T19:55:53.443 INFO:teuthology.orchestra.run.smithi155.stdout: { 2023-08-01T19:55:53.443 INFO:teuthology.orchestra.run.smithi155.stdout: "event": "reached_pg", 2023-08-01T19:55:53.443 INFO:teuthology.orchestra.run.smithi155.stdout: "time": "2023-08-01T19:55:53.404183+0000", 2023-08-01T19:55:53.444 INFO:teuthology.orchestra.run.smithi155.stdout: "duration": 4.2588e-05 2023-08-01T19:55:53.444 INFO:teuthology.orchestra.run.smithi155.stdout: }, 2023-08-01T19:55:53.444 INFO:teuthology.orchestra.run.smithi155.stdout: { 2023-08-01T19:55:53.444 INFO:teuthology.orchestra.run.smithi155.stdout: "event": "started", 2023-08-01T19:55:53.444 INFO:teuthology.orchestra.run.smithi155.stdout: "time": "2023-08-01T19:55:53.404314+0000", 2023-08-01T19:55:53.444 INFO:teuthology.orchestra.run.smithi155.stdout: "duration": 0.00013062600000000001 2023-08-01T19:55:53.444 INFO:teuthology.orchestra.run.smithi155.stdout: }, 2023-08-01T19:55:53.445 INFO:teuthology.orchestra.run.smithi155.stdout: { 2023-08-01T19:55:53.445 INFO:teuthology.orchestra.run.smithi155.stdout: "event": "waiting for subops from 1", 2023-08-01T19:55:53.445 INFO:teuthology.orchestra.run.smithi155.stdout: "time": "2023-08-01T19:55:53.404414+0000", 2023-08-01T19:55:53.445 INFO:teuthology.orchestra.run.smithi155.stdout: "duration": 0.000100457 2023-08-01T19:55:53.445 INFO:teuthology.orchestra.run.smithi155.stdout: } 2023-08-01T19:55:53.445 INFO:teuthology.orchestra.run.smithi155.stdout: ] 2023-08-01T19:55:53.445 INFO:teuthology.orchestra.run.smithi155.stdout: } 2023-08-01T19:55:53.446 INFO:teuthology.orchestra.run.smithi155.stdout: }, 2023-08-01T19:55:53.446 INFO:teuthology.orchestra.run.smithi155.stdout: { 2023-08-01T19:55:53.446 INFO:teuthology.orchestra.run.smithi155.stdout: "description": "osd_op(client.4668.0:186987 5.e 5:7cdbc0f8:::benchmark_data_smithi006_114134_object53326:head [delete] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e59)", 2023-08-01T19:55:53.446 INFO:teuthology.orchestra.run.smithi155.stdout: "initiated_at": "2023-08-01T19:55:53.404148+0000", 2023-08-01T19:55:53.446 INFO:teuthology.orchestra.run.smithi155.stdout: "age": 0.0044627859999999998, 2023-08-01T19:55:53.446 INFO:teuthology.orchestra.run.smithi155.stdout: "duration": 0.0048623440000000002, 2023-08-01T19:55:53.446 INFO:teuthology.orchestra.run.smithi155.stdout: "type_data": { 2023-08-01T19:55:53.446 INFO:teuthology.orchestra.run.smithi155.stdout: "flag_point": "waiting for sub ops", 2023-08-01T19:55:53.447 INFO:teuthology.orchestra.run.smithi155.stdout: "client_info": { 2023-08-01T19:55:53.447 INFO:teuthology.orchestra.run.smithi155.stdout: "client": "client.4668", 2023-08-01T19:55:53.447 INFO:teuthology.orchestra.run.smithi155.stdout: "client_addr": "172.21.15.6:0/1709472247", 2023-08-01T19:55:53.447 INFO:teuthology.orchestra.run.smithi155.stdout: "tid": 186987 2023-08-01T19:55:53.447 INFO:teuthology.orchestra.run.smithi155.stdout: }, 2023-08-01T19:55:53.447 INFO:teuthology.orchestra.run.smithi155.stdout: "events": [ 2023-08-01T19:55:53.447 INFO:teuthology.orchestra.run.smithi155.stdout: { 2023-08-01T19:55:53.447 INFO:teuthology.orchestra.run.smithi155.stdout: "event": "initiated", 2023-08-01T19:55:53.448 INFO:teuthology.orchestra.run.smithi155.stdout: "time": "2023-08-01T19:55:53.404148+0000", 2023-08-01T19:55:53.448 INFO:teuthology.orchestra.run.smithi155.stdout: "duration": 0 2023-08-01T19:55:53.448 INFO:teuthology.orchestra.run.smithi155.stdout: }, 2023-08-01T19:55:53.448 INFO:teuthology.orchestra.run.smithi155.stdout: { 2023-08-01T19:55:53.448 INFO:teuthology.orchestra.run.smithi155.stdout: "event": "throttled", 2023-08-01T19:55:53.448 INFO:teuthology.orchestra.run.smithi155.stdout: "time": "2023-08-01T19:55:53.404148+0000", 2023-08-01T19:55:53.448 INFO:teuthology.orchestra.run.smithi155.stdout: "duration": 0 2023-08-01T19:55:53.449 INFO:teuthology.orchestra.run.smithi155.stdout: }, 2023-08-01T19:55:53.449 INFO:teuthology.orchestra.run.smithi155.stdout: { 2023-08-01T19:55:53.449 INFO:teuthology.orchestra.run.smithi155.stdout: "event": "header_read", 2023-08-01T19:55:53.449 INFO:teuthology.orchestra.run.smithi155.stdout: "time": "2023-08-01T19:55:53.404148+0000", 2023-08-01T19:55:53.449 INFO:teuthology.orchestra.run.smithi155.stdout: "duration": 4294967295.9999995 2023-08-01T19:55:53.449 INFO:teuthology.orchestra.run.smithi155.stdout: }, 2023-08-01T19:55:53.449 INFO:teuthology.orchestra.run.smithi155.stdout: { 2023-08-01T19:55:53.449 INFO:teuthology.orchestra.run.smithi155.stdout: "event": "all_read", 2023-08-01T19:55:53.450 INFO:teuthology.orchestra.run.smithi155.stdout: "time": "2023-08-01T19:55:53.404150+0000", 2023-08-01T19:55:53.450 INFO:teuthology.orchestra.run.smithi155.stdout: "duration": 2.8059999999999999e-06 2023-08-01T19:55:53.450 INFO:teuthology.orchestra.run.smithi155.stdout: }, 2023-08-01T19:55:53.450 INFO:teuthology.orchestra.run.smithi155.stdout: { 2023-08-01T19:55:53.450 INFO:teuthology.orchestra.run.smithi155.stdout: "event": "dispatched", 2023-08-01T19:55:53.450 INFO:teuthology.orchestra.run.smithi155.stdout: "time": "2023-08-01T19:55:53.404157+0000", 2023-08-01T19:55:53.450 INFO:teuthology.orchestra.run.smithi155.stdout: "duration": 7.0330000000000003e-06 2023-08-01T19:55:53.451 INFO:teuthology.orchestra.run.smithi155.stdout: }, 2023-08-01T19:55:53.451 INFO:teuthology.orchestra.run.smithi155.stdout: { 2023-08-01T19:55:53.451 INFO:teuthology.orchestra.run.smithi155.stdout: "event": "queued_for_pg", 2023-08-01T19:55:53.451 INFO:teuthology.orchestra.run.smithi155.stdout: "time": "2023-08-01T19:55:53.404160+0000", 2023-08-01T19:55:53.451 INFO:teuthology.orchestra.run.smithi155.stdout: "duration": 2.9699999999999999e-06 2023-08-01T19:55:53.451 INFO:teuthology.orchestra.run.smithi155.stdout: }, 2023-08-01T19:55:53.451 INFO:teuthology.orchestra.run.smithi155.stdout: { 2023-08-01T19:55:53.452 INFO:teuthology.orchestra.run.smithi155.stdout: "event": "reached_pg", 2023-08-01T19:55:53.452 INFO:teuthology.orchestra.run.smithi155.stdout: "time": "2023-08-01T19:55:53.404193+0000", 2023-08-01T19:55:53.452 INFO:teuthology.orchestra.run.smithi155.stdout: "duration": 3.2276000000000001e-05 2023-08-01T19:55:53.452 INFO:teuthology.orchestra.run.smithi155.stdout: }, 2023-08-01T19:55:53.452 INFO:teuthology.orchestra.run.smithi155.stdout: { 2023-08-01T19:55:53.452 INFO:teuthology.orchestra.run.smithi155.stdout: "event": "started", 2023-08-01T19:55:53.452 INFO:teuthology.orchestra.run.smithi155.stdout: "time": "2023-08-01T19:55:53.404307+0000", 2023-08-01T19:55:53.452 INFO:teuthology.orchestra.run.smithi155.stdout: "duration": 0.000114639 2023-08-01T19:55:53.453 INFO:teuthology.orchestra.run.smithi155.stdout: }, 2023-08-01T19:55:53.453 INFO:teuthology.orchestra.run.smithi155.stdout: { 2023-08-01T19:55:53.453 INFO:teuthology.orchestra.run.smithi155.stdout: "event": "waiting for subops from 0", 2023-08-01T19:55:53.453 INFO:teuthology.orchestra.run.smithi155.stdout: "time": "2023-08-01T19:55:53.404414+0000", 2023-08-01T19:55:53.453 INFO:teuthology.orchestra.run.smithi155.stdout: "duration": 0.00010685599999999999 2023-08-01T19:55:53.453 INFO:teuthology.orchestra.run.smithi155.stdout: } 2023-08-01T19:55:53.453 INFO:teuthology.orchestra.run.smithi155.stdout: ] 2023-08-01T19:55:53.453 INFO:teuthology.orchestra.run.smithi155.stdout: } 2023-08-01T19:55:53.454 INFO:teuthology.orchestra.run.smithi155.stdout: }, 2023-08-01T19:55:53.454 INFO:teuthology.orchestra.run.smithi155.stdout: { 2023-08-01T19:55:53.454 INFO:teuthology.orchestra.run.smithi155.stdout: "description": "osd_op(client.4668.0:186989 5.9 5:957a2252:::benchmark_data_smithi006_114134_object53328:head [delete] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e59)", 2023-08-01T19:55:53.454 INFO:teuthology.orchestra.run.smithi155.stdout: "initiated_at": "2023-08-01T19:55:53.404290+0000", 2023-08-01T19:55:53.454 INFO:teuthology.orchestra.run.smithi155.stdout: "age": 0.0043208359999999998, 2023-08-01T19:55:53.454 INFO:teuthology.orchestra.run.smithi155.stdout: "duration": 0.0048072310000000004, 2023-08-01T19:55:53.454 INFO:teuthology.orchestra.run.smithi155.stdout: "type_data": { 2023-08-01T19:55:53.454 INFO:teuthology.orchestra.run.smithi155.stdout: "flag_point": "waiting for sub ops", 2023-08-01T19:55:53.455 INFO:teuthology.orchestra.run.smithi155.stdout: "client_info": { 2023-08-01T19:55:53.455 INFO:teuthology.orchestra.run.smithi155.stdout: "client": "client.4668", 2023-08-01T19:55:53.455 INFO:teuthology.orchestra.run.smithi155.stdout: "client_addr": "172.21.15.6:0/1709472247", 2023-08-01T19:55:53.455 INFO:teuthology.orchestra.run.smithi155.stdout: "tid": 186989 2023-08-01T19:55:53.455 INFO:teuthology.orchestra.run.smithi155.stdout: }, 2023-08-01T19:55:53.455 INFO:teuthology.orchestra.run.smithi155.stdout: "events": [ 2023-08-01T19:55:53.455 INFO:teuthology.orchestra.run.smithi155.stdout: { 2023-08-01T19:55:53.456 INFO:teuthology.orchestra.run.smithi155.stdout: "event": "initiated", 2023-08-01T19:55:53.456 INFO:teuthology.orchestra.run.smithi155.stdout: "time": "2023-08-01T19:55:53.404290+0000", 2023-08-01T19:55:53.456 INFO:teuthology.orchestra.run.smithi155.stdout: "duration": 0 2023-08-01T19:55:53.456 INFO:teuthology.orchestra.run.smithi155.stdout: }, 2023-08-01T19:55:53.456 INFO:teuthology.orchestra.run.smithi155.stdout: { 2023-08-01T19:55:53.456 INFO:teuthology.orchestra.run.smithi155.stdout: "event": "throttled", 2023-08-01T19:55:53.456 INFO:teuthology.orchestra.run.smithi155.stdout: "time": "2023-08-01T19:55:53.404290+0000", 2023-08-01T19:55:53.456 INFO:teuthology.orchestra.run.smithi155.stdout: "duration": 0 2023-08-01T19:55:53.457 INFO:teuthology.orchestra.run.smithi155.stdout: }, 2023-08-01T19:55:53.457 INFO:teuthology.orchestra.run.smithi155.stdout: { 2023-08-01T19:55:53.457 INFO:teuthology.orchestra.run.smithi155.stdout: "event": "header_read", 2023-08-01T19:55:53.457 INFO:teuthology.orchestra.run.smithi155.stdout: "time": "2023-08-01T19:55:53.404290+0000", 2023-08-01T19:55:53.457 INFO:teuthology.orchestra.run.smithi155.stdout: "duration": 4294967295.9999995 2023-08-01T19:55:53.457 INFO:teuthology.orchestra.run.smithi155.stdout: }, 2023-08-01T19:55:53.457 INFO:teuthology.orchestra.run.smithi155.stdout: { 2023-08-01T19:55:53.457 INFO:teuthology.orchestra.run.smithi155.stdout: "event": "all_read", 2023-08-01T19:55:53.458 INFO:teuthology.orchestra.run.smithi155.stdout: "time": "2023-08-01T19:55:53.404292+0000", 2023-08-01T19:55:53.458 INFO:teuthology.orchestra.run.smithi155.stdout: "duration": 2.751e-06 2023-08-01T19:55:53.458 INFO:teuthology.orchestra.run.smithi155.stdout: }, 2023-08-01T19:55:53.458 INFO:teuthology.orchestra.run.smithi155.stdout: { 2023-08-01T19:55:53.458 INFO:teuthology.orchestra.run.smithi155.stdout: "event": "dispatched", 2023-08-01T19:55:53.458 INFO:teuthology.orchestra.run.smithi155.stdout: "time": "2023-08-01T19:55:53.404297+0000", 2023-08-01T19:55:53.458 INFO:teuthology.orchestra.run.smithi155.stdout: "duration": 4.6890000000000003e-06 2023-08-01T19:55:53.458 INFO:teuthology.orchestra.run.smithi155.stdout: }, 2023-08-01T19:55:53.459 INFO:teuthology.orchestra.run.smithi155.stdout: { 2023-08-01T19:55:53.459 INFO:teuthology.orchestra.run.smithi155.stdout: "event": "queued_for_pg", 2023-08-01T19:55:53.459 INFO:teuthology.orchestra.run.smithi155.stdout: "time": "2023-08-01T19:55:53.404300+0000", 2023-08-01T19:55:53.459 INFO:teuthology.orchestra.run.smithi155.stdout: "duration": 2.8490000000000002e-06 2023-08-01T19:55:53.459 INFO:teuthology.orchestra.run.smithi155.stdout: }, 2023-08-01T19:55:53.459 INFO:teuthology.orchestra.run.smithi155.stdout: { 2023-08-01T19:55:53.459 INFO:teuthology.orchestra.run.smithi155.stdout: "event": "reached_pg", 2023-08-01T19:55:53.459 INFO:teuthology.orchestra.run.smithi155.stdout: "time": "2023-08-01T19:55:53.404342+0000", 2023-08-01T19:55:53.460 INFO:teuthology.orchestra.run.smithi155.stdout: "duration": 4.1844999999999997e-05 2023-08-01T19:55:53.460 INFO:teuthology.orchestra.run.smithi155.stdout: }, 2023-08-01T19:55:53.460 INFO:teuthology.orchestra.run.smithi155.stdout: { 2023-08-01T19:55:53.460 INFO:teuthology.orchestra.run.smithi155.stdout: "event": "started", 2023-08-01T19:55:53.460 INFO:teuthology.orchestra.run.smithi155.stdout: "time": "2023-08-01T19:55:53.404412+0000", 2023-08-01T19:55:53.460 INFO:teuthology.orchestra.run.smithi155.stdout: "duration": 7.0528e-05 2023-08-01T19:55:53.460 INFO:teuthology.orchestra.run.smithi155.stdout: }, 2023-08-01T19:55:53.461 INFO:teuthology.orchestra.run.smithi155.stdout: { 2023-08-01T19:55:53.461 INFO:teuthology.orchestra.run.smithi155.stdout: "event": "waiting for subops from 1", 2023-08-01T19:55:53.461 INFO:teuthology.orchestra.run.smithi155.stdout: "time": "2023-08-01T19:55:53.404495+0000", 2023-08-01T19:55:53.461 INFO:teuthology.orchestra.run.smithi155.stdout: "duration": 8.2647999999999999e-05 2023-08-01T19:55:53.461 INFO:teuthology.orchestra.run.smithi155.stdout: } 2023-08-01T19:55:53.461 INFO:teuthology.orchestra.run.smithi155.stdout: ] 2023-08-01T19:55:53.461 INFO:teuthology.orchestra.run.smithi155.stdout: } 2023-08-01T19:55:53.461 INFO:teuthology.orchestra.run.smithi155.stdout: }, 2023-08-01T19:55:53.462 INFO:teuthology.orchestra.run.smithi155.stdout: { 2023-08-01T19:55:53.462 INFO:teuthology.orchestra.run.smithi155.stdout: "description": "osd_op(client.4668.0:186990 5.e 5:75bfdd73:::benchmark_data_smithi006_114134_object53329:head [delete] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e59)", 2023-08-01T19:55:53.462 INFO:teuthology.orchestra.run.smithi155.stdout: "initiated_at": "2023-08-01T19:55:53.404316+0000", 2023-08-01T19:55:53.462 INFO:teuthology.orchestra.run.smithi155.stdout: "age": 0.0042950000000000002, 2023-08-01T19:55:53.462 INFO:teuthology.orchestra.run.smithi155.stdout: "duration": 0.0048780619999999998, 2023-08-01T19:55:53.462 INFO:teuthology.orchestra.run.smithi155.stdout: "type_data": { 2023-08-01T19:55:53.462 INFO:teuthology.orchestra.run.smithi155.stdout: "flag_point": "waiting for sub ops", 2023-08-01T19:55:53.462 INFO:teuthology.orchestra.run.smithi155.stdout: "client_info": { 2023-08-01T19:55:53.463 INFO:teuthology.orchestra.run.smithi155.stdout: "client": "client.4668", 2023-08-01T19:55:53.463 INFO:teuthology.orchestra.run.smithi155.stdout: "client_addr": "172.21.15.6:0/1709472247", 2023-08-01T19:55:53.463 INFO:teuthology.orchestra.run.smithi155.stdout: "tid": 186990 2023-08-01T19:55:53.463 INFO:teuthology.orchestra.run.smithi155.stdout: }, 2023-08-01T19:55:53.463 INFO:teuthology.orchestra.run.smithi155.stdout: "events": [ 2023-08-01T19:55:53.463 INFO:teuthology.orchestra.run.smithi155.stdout: { 2023-08-01T19:55:53.463 INFO:teuthology.orchestra.run.smithi155.stdout: "event": "initiated", 2023-08-01T19:55:53.464 INFO:teuthology.orchestra.run.smithi155.stdout: "time": "2023-08-01T19:55:53.404316+0000", 2023-08-01T19:55:53.464 INFO:teuthology.orchestra.run.smithi155.stdout: "duration": 0 2023-08-01T19:55:53.464 INFO:teuthology.orchestra.run.smithi155.stdout: }, 2023-08-01T19:55:53.464 INFO:teuthology.orchestra.run.smithi155.stdout: { 2023-08-01T19:55:53.464 INFO:teuthology.orchestra.run.smithi155.stdout: "event": "throttled", 2023-08-01T19:55:53.464 INFO:teuthology.orchestra.run.smithi155.stdout: "time": "2023-08-01T19:55:53.404316+0000", 2023-08-01T19:55:53.464 INFO:teuthology.orchestra.run.smithi155.stdout: "duration": 0 2023-08-01T19:55:53.464 INFO:teuthology.orchestra.run.smithi155.stdout: }, 2023-08-01T19:55:53.465 INFO:teuthology.orchestra.run.smithi155.stdout: { 2023-08-01T19:55:53.465 INFO:teuthology.orchestra.run.smithi155.stdout: "event": "header_read", 2023-08-01T19:55:53.465 INFO:teuthology.orchestra.run.smithi155.stdout: "time": "2023-08-01T19:55:53.404316+0000", 2023-08-01T19:55:53.465 INFO:teuthology.orchestra.run.smithi155.stdout: "duration": 4294967295.9999995 2023-08-01T19:55:53.465 INFO:teuthology.orchestra.run.smithi155.stdout: }, 2023-08-01T19:55:53.465 INFO:teuthology.orchestra.run.smithi155.stdout: { 2023-08-01T19:55:53.465 INFO:teuthology.orchestra.run.smithi155.stdout: "event": "all_read", 2023-08-01T19:55:53.465 INFO:teuthology.orchestra.run.smithi155.stdout: "time": "2023-08-01T19:55:53.404318+0000", 2023-08-01T19:55:53.466 INFO:teuthology.orchestra.run.smithi155.stdout: "duration": 1.9980000000000002e-06 2023-08-01T19:55:53.466 INFO:teuthology.orchestra.run.smithi155.stdout: }, 2023-08-01T19:55:53.466 INFO:teuthology.orchestra.run.smithi155.stdout: { 2023-08-01T19:55:53.466 INFO:teuthology.orchestra.run.smithi155.stdout: "event": "dispatched", 2023-08-01T19:55:53.466 INFO:teuthology.orchestra.run.smithi155.stdout: "time": "2023-08-01T19:55:53.404327+0000", 2023-08-01T19:55:53.466 INFO:teuthology.orchestra.run.smithi155.stdout: "duration": 9.2669999999999995e-06 2023-08-01T19:55:53.466 INFO:teuthology.orchestra.run.smithi155.stdout: }, 2023-08-01T19:55:53.466 INFO:teuthology.orchestra.run.smithi155.stdout: { 2023-08-01T19:55:53.467 INFO:teuthology.orchestra.run.smithi155.stdout: "event": "queued_for_pg", 2023-08-01T19:55:53.467 INFO:teuthology.orchestra.run.smithi155.stdout: "time": "2023-08-01T19:55:53.404331+0000", 2023-08-01T19:55:53.467 INFO:teuthology.orchestra.run.smithi155.stdout: "duration": 4.0840000000000002e-06 2023-08-01T19:55:53.467 INFO:teuthology.orchestra.run.smithi155.stdout: }, 2023-08-01T19:55:53.467 INFO:teuthology.orchestra.run.smithi155.stdout: { 2023-08-01T19:55:53.467 INFO:teuthology.orchestra.run.smithi155.stdout: "event": "reached_pg", 2023-08-01T19:55:53.467 INFO:teuthology.orchestra.run.smithi155.stdout: "time": "2023-08-01T19:55:53.406421+0000", 2023-08-01T19:55:53.468 INFO:teuthology.orchestra.run.smithi155.stdout: "duration": 0.0020897910000000001 2023-08-01T19:55:53.468 INFO:teuthology.orchestra.run.smithi155.stdout: }, 2023-08-01T19:55:53.468 INFO:teuthology.orchestra.run.smithi155.stdout: { 2023-08-01T19:55:53.468 INFO:teuthology.orchestra.run.smithi155.stdout: "event": "started", 2023-08-01T19:55:53.468 INFO:teuthology.orchestra.run.smithi155.stdout: "time": "2023-08-01T19:55:53.406529+0000", 2023-08-01T19:55:53.468 INFO:teuthology.orchestra.run.smithi155.stdout: "duration": 0.000107874 2023-08-01T19:55:53.468 INFO:teuthology.orchestra.run.smithi155.stdout: }, 2023-08-01T19:55:53.468 INFO:teuthology.orchestra.run.smithi155.stdout: { 2023-08-01T19:55:53.469 INFO:teuthology.orchestra.run.smithi155.stdout: "event": "waiting for subops from 0", 2023-08-01T19:55:53.469 INFO:teuthology.orchestra.run.smithi155.stdout: "time": "2023-08-01T19:55:53.406630+0000", 2023-08-01T19:55:53.469 INFO:teuthology.orchestra.run.smithi155.stdout: "duration": 0.000101519 2023-08-01T19:55:53.469 INFO:teuthology.orchestra.run.smithi155.stdout: } 2023-08-01T19:55:53.469 INFO:teuthology.orchestra.run.smithi155.stdout: ] 2023-08-01T19:55:53.469 INFO:teuthology.orchestra.run.smithi155.stdout: } 2023-08-01T19:55:53.469 INFO:teuthology.orchestra.run.smithi155.stdout: }, 2023-08-01T19:55:53.469 INFO:teuthology.orchestra.run.smithi155.stdout: { 2023-08-01T19:55:53.470 INFO:teuthology.orchestra.run.smithi155.stdout: "description": "osd_op(client.4668.0:186991 5.d 5:b7ed20e9:::benchmark_data_smithi006_114134_object53330:head [delete] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e59)", 2023-08-01T19:55:53.470 INFO:teuthology.orchestra.run.smithi155.stdout: "initiated_at": "2023-08-01T19:55:53.405203+0000", 2023-08-01T19:55:53.470 INFO:teuthology.orchestra.run.smithi155.stdout: "age": 0.0034079520000000001, 2023-08-01T19:55:53.470 INFO:teuthology.orchestra.run.smithi155.stdout: "duration": 0.0040706739999999998, 2023-08-01T19:55:53.470 INFO:teuthology.orchestra.run.smithi155.stdout: "type_data": { 2023-08-01T19:55:53.470 INFO:teuthology.orchestra.run.smithi155.stdout: "flag_point": "waiting for sub ops", 2023-08-01T19:55:53.470 INFO:teuthology.orchestra.run.smithi155.stdout: "client_info": { 2023-08-01T19:55:53.470 INFO:teuthology.orchestra.run.smithi155.stdout: "client": "client.4668", 2023-08-01T19:55:53.471 INFO:teuthology.orchestra.run.smithi155.stdout: "client_addr": "172.21.15.6:0/1709472247", 2023-08-01T19:55:53.471 INFO:teuthology.orchestra.run.smithi155.stdout: "tid": 186991 2023-08-01T19:55:53.471 INFO:teuthology.orchestra.run.smithi155.stdout: }, 2023-08-01T19:55:53.471 INFO:teuthology.orchestra.run.smithi155.stdout: "events": [ 2023-08-01T19:55:53.471 INFO:teuthology.orchestra.run.smithi155.stdout: { 2023-08-01T19:55:53.471 INFO:teuthology.orchestra.run.smithi155.stdout: "event": "initiated", 2023-08-01T19:55:53.471 INFO:teuthology.orchestra.run.smithi155.stdout: "time": "2023-08-01T19:55:53.405203+0000", 2023-08-01T19:55:53.472 INFO:teuthology.orchestra.run.smithi155.stdout: "duration": 0 2023-08-01T19:55:53.472 INFO:teuthology.orchestra.run.smithi155.stdout: }, 2023-08-01T19:55:53.472 INFO:teuthology.orchestra.run.smithi155.stdout: { 2023-08-01T19:55:53.472 INFO:teuthology.orchestra.run.smithi155.stdout: "event": "throttled", 2023-08-01T19:55:53.472 INFO:teuthology.orchestra.run.smithi155.stdout: "time": "2023-08-01T19:55:53.405203+0000", 2023-08-01T19:55:53.472 INFO:teuthology.orchestra.run.smithi155.stdout: "duration": 0 2023-08-01T19:55:53.472 INFO:teuthology.orchestra.run.smithi155.stdout: }, 2023-08-01T19:55:53.473 INFO:teuthology.orchestra.run.smithi155.stdout: { 2023-08-01T19:55:53.473 INFO:teuthology.orchestra.run.smithi155.stdout: "event": "header_read", 2023-08-01T19:55:53.473 INFO:teuthology.orchestra.run.smithi155.stdout: "time": "2023-08-01T19:55:53.405202+0000", 2023-08-01T19:55:53.473 INFO:teuthology.orchestra.run.smithi155.stdout: "duration": 4294967295.999999 2023-08-01T19:55:53.473 INFO:teuthology.orchestra.run.smithi155.stdout: }, 2023-08-01T19:55:53.473 INFO:teuthology.orchestra.run.smithi155.stdout: { 2023-08-01T19:55:53.473 INFO:teuthology.orchestra.run.smithi155.stdout: "event": "all_read", 2023-08-01T19:55:53.473 INFO:teuthology.orchestra.run.smithi155.stdout: "time": "2023-08-01T19:55:53.405206+0000", 2023-08-01T19:55:53.474 INFO:teuthology.orchestra.run.smithi155.stdout: "duration": 4.2379999999999999e-06 2023-08-01T19:55:53.474 INFO:teuthology.orchestra.run.smithi155.stdout: }, 2023-08-01T19:55:53.474 INFO:teuthology.orchestra.run.smithi155.stdout: { 2023-08-01T19:55:53.474 INFO:teuthology.orchestra.run.smithi155.stdout: "event": "dispatched", 2023-08-01T19:55:53.474 INFO:teuthology.orchestra.run.smithi155.stdout: "time": "2023-08-01T19:55:53.405215+0000", 2023-08-01T19:55:53.474 INFO:teuthology.orchestra.run.smithi155.stdout: "duration": 8.8750000000000006e-06 2023-08-01T19:55:53.475 INFO:teuthology.orchestra.run.smithi155.stdout: }, 2023-08-01T19:55:53.475 INFO:teuthology.orchestra.run.smithi155.stdout: { 2023-08-01T19:55:53.475 INFO:teuthology.orchestra.run.smithi155.stdout: "event": "queued_for_pg", 2023-08-01T19:55:53.475 INFO:teuthology.orchestra.run.smithi155.stdout: "time": "2023-08-01T19:55:53.405219+0000", 2023-08-01T19:55:53.475 INFO:teuthology.orchestra.run.smithi155.stdout: "duration": 3.941e-06 2023-08-01T19:55:53.475 INFO:teuthology.orchestra.run.smithi155.stdout: }, 2023-08-01T19:55:53.475 INFO:teuthology.orchestra.run.smithi155.stdout: { 2023-08-01T19:55:53.476 INFO:teuthology.orchestra.run.smithi155.stdout: "event": "reached_pg", 2023-08-01T19:55:53.476 INFO:teuthology.orchestra.run.smithi155.stdout: "time": "2023-08-01T19:55:53.405253+0000", 2023-08-01T19:55:53.476 INFO:teuthology.orchestra.run.smithi155.stdout: "duration": 3.3315999999999997e-05 2023-08-01T19:55:53.476 INFO:teuthology.orchestra.run.smithi155.stdout: }, 2023-08-01T19:55:53.476 INFO:teuthology.orchestra.run.smithi155.stdout: { 2023-08-01T19:55:53.476 INFO:teuthology.orchestra.run.smithi155.stdout: "event": "started", 2023-08-01T19:55:53.476 INFO:teuthology.orchestra.run.smithi155.stdout: "time": "2023-08-01T19:55:53.405371+0000", 2023-08-01T19:55:53.477 INFO:teuthology.orchestra.run.smithi155.stdout: "duration": 0.00011802399999999999 2023-08-01T19:55:53.477 INFO:teuthology.orchestra.run.smithi155.stdout: }, 2023-08-01T19:55:53.477 INFO:teuthology.orchestra.run.smithi155.stdout: { 2023-08-01T19:55:53.477 INFO:teuthology.orchestra.run.smithi155.stdout: "event": "waiting for subops from 1", 2023-08-01T19:55:53.477 INFO:teuthology.orchestra.run.smithi155.stdout: "time": "2023-08-01T19:55:53.405480+0000", 2023-08-01T19:55:53.477 INFO:teuthology.orchestra.run.smithi155.stdout: "duration": 0.000109174 2023-08-01T19:55:53.477 INFO:teuthology.orchestra.run.smithi155.stdout: } 2023-08-01T19:55:53.478 INFO:teuthology.orchestra.run.smithi155.stdout: ] 2023-08-01T19:55:53.478 INFO:teuthology.orchestra.run.smithi155.stdout: } 2023-08-01T19:55:53.478 INFO:teuthology.orchestra.run.smithi155.stdout: }, 2023-08-01T19:55:53.478 INFO:teuthology.orchestra.run.smithi155.stdout: { 2023-08-01T19:55:53.478 INFO:teuthology.orchestra.run.smithi155.stdout: "description": "osd_op(client.4668.0:186992 5.b 5:d05da879:::benchmark_data_smithi006_114134_object53331:head [delete] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e59)", 2023-08-01T19:55:53.478 INFO:teuthology.orchestra.run.smithi155.stdout: "initiated_at": "2023-08-01T19:55:53.405227+0000", 2023-08-01T19:55:53.478 INFO:teuthology.orchestra.run.smithi155.stdout: "age": 0.0033834849999999999, 2023-08-01T19:55:53.478 INFO:teuthology.orchestra.run.smithi155.stdout: "duration": 0.0041173659999999999, 2023-08-01T19:55:53.479 INFO:teuthology.orchestra.run.smithi155.stdout: "type_data": { 2023-08-01T19:55:53.479 INFO:teuthology.orchestra.run.smithi155.stdout: "flag_point": "waiting for sub ops", 2023-08-01T19:55:53.479 INFO:teuthology.orchestra.run.smithi155.stdout: "client_info": { 2023-08-01T19:55:53.479 INFO:teuthology.orchestra.run.smithi155.stdout: "client": "client.4668", 2023-08-01T19:55:53.479 INFO:teuthology.orchestra.run.smithi155.stdout: "client_addr": "172.21.15.6:0/1709472247", 2023-08-01T19:55:53.479 INFO:teuthology.orchestra.run.smithi155.stdout: "tid": 186992 2023-08-01T19:55:53.479 INFO:teuthology.orchestra.run.smithi155.stdout: }, 2023-08-01T19:55:53.480 INFO:teuthology.orchestra.run.smithi155.stdout: "events": [ 2023-08-01T19:55:53.480 INFO:teuthology.orchestra.run.smithi155.stdout: { 2023-08-01T19:55:53.480 INFO:teuthology.orchestra.run.smithi155.stdout: "event": "initiated", 2023-08-01T19:55:53.480 INFO:teuthology.orchestra.run.smithi155.stdout: "time": "2023-08-01T19:55:53.405227+0000", 2023-08-01T19:55:53.480 INFO:teuthology.orchestra.run.smithi155.stdout: "duration": 0 2023-08-01T19:55:53.480 INFO:teuthology.orchestra.run.smithi155.stdout: }, 2023-08-01T19:55:53.480 INFO:teuthology.orchestra.run.smithi155.stdout: { 2023-08-01T19:55:53.480 INFO:teuthology.orchestra.run.smithi155.stdout: "event": "throttled", 2023-08-01T19:55:53.481 INFO:teuthology.orchestra.run.smithi155.stdout: "time": "2023-08-01T19:55:53.405227+0000", 2023-08-01T19:55:53.481 INFO:teuthology.orchestra.run.smithi155.stdout: "duration": 0 2023-08-01T19:55:53.481 INFO:teuthology.orchestra.run.smithi155.stdout: }, 2023-08-01T19:55:53.481 INFO:teuthology.orchestra.run.smithi155.stdout: { 2023-08-01T19:55:53.481 INFO:teuthology.orchestra.run.smithi155.stdout: "event": "header_read", 2023-08-01T19:55:53.481 INFO:teuthology.orchestra.run.smithi155.stdout: "time": "2023-08-01T19:55:53.405227+0000", 2023-08-01T19:55:53.481 INFO:teuthology.orchestra.run.smithi155.stdout: "duration": 4294967295.9999995 2023-08-01T19:55:53.481 INFO:teuthology.orchestra.run.smithi155.stdout: }, 2023-08-01T19:55:53.482 INFO:teuthology.orchestra.run.smithi155.stdout: { 2023-08-01T19:55:53.482 INFO:teuthology.orchestra.run.smithi155.stdout: "event": "all_read", 2023-08-01T19:55:53.482 INFO:teuthology.orchestra.run.smithi155.stdout: "time": "2023-08-01T19:55:53.405230+0000", 2023-08-01T19:55:53.482 INFO:teuthology.orchestra.run.smithi155.stdout: "duration": 2.6309999999999999e-06 2023-08-01T19:55:53.482 INFO:teuthology.orchestra.run.smithi155.stdout: }, 2023-08-01T19:55:53.482 INFO:teuthology.orchestra.run.smithi155.stdout: { 2023-08-01T19:55:53.482 INFO:teuthology.orchestra.run.smithi155.stdout: "event": "dispatched", 2023-08-01T19:55:53.483 INFO:teuthology.orchestra.run.smithi155.stdout: "time": "2023-08-01T19:55:53.405235+0000", 2023-08-01T19:55:53.483 INFO:teuthology.orchestra.run.smithi155.stdout: "duration": 5.9150000000000001e-06 2023-08-01T19:55:53.483 INFO:teuthology.orchestra.run.smithi155.stdout: }, 2023-08-01T19:55:53.483 INFO:teuthology.orchestra.run.smithi155.stdout: { 2023-08-01T19:55:53.483 INFO:teuthology.orchestra.run.smithi155.stdout: "event": "queued_for_pg", 2023-08-01T19:55:53.483 INFO:teuthology.orchestra.run.smithi155.stdout: "time": "2023-08-01T19:55:53.405240+0000", 2023-08-01T19:55:53.483 INFO:teuthology.orchestra.run.smithi155.stdout: "duration": 4.1500000000000001e-06 2023-08-01T19:55:53.483 INFO:teuthology.orchestra.run.smithi155.stdout: }, 2023-08-01T19:55:53.484 INFO:teuthology.orchestra.run.smithi155.stdout: { 2023-08-01T19:55:53.484 INFO:teuthology.orchestra.run.smithi155.stdout: "event": "reached_pg", 2023-08-01T19:55:53.484 INFO:teuthology.orchestra.run.smithi155.stdout: "time": "2023-08-01T19:55:53.405272+0000", 2023-08-01T19:55:53.484 INFO:teuthology.orchestra.run.smithi155.stdout: "duration": 3.1922999999999999e-05 2023-08-01T19:55:53.484 INFO:teuthology.orchestra.run.smithi155.stdout: }, 2023-08-01T19:55:53.484 INFO:teuthology.orchestra.run.smithi155.stdout: { 2023-08-01T19:55:53.484 INFO:teuthology.orchestra.run.smithi155.stdout: "event": "started", 2023-08-01T19:55:53.485 INFO:teuthology.orchestra.run.smithi155.stdout: "time": "2023-08-01T19:55:53.405371+0000", 2023-08-01T19:55:53.485 INFO:teuthology.orchestra.run.smithi155.stdout: "duration": 9.9397999999999999e-05 2023-08-01T19:55:53.485 INFO:teuthology.orchestra.run.smithi155.stdout: }, 2023-08-01T19:55:53.485 INFO:teuthology.orchestra.run.smithi155.stdout: { 2023-08-01T19:55:53.485 INFO:teuthology.orchestra.run.smithi155.stdout: "event": "waiting for subops from 0", 2023-08-01T19:55:53.485 INFO:teuthology.orchestra.run.smithi155.stdout: "time": "2023-08-01T19:55:53.405480+0000", 2023-08-01T19:55:53.485 INFO:teuthology.orchestra.run.smithi155.stdout: "duration": 0.00010875899999999999 2023-08-01T19:55:53.485 INFO:teuthology.orchestra.run.smithi155.stdout: } 2023-08-01T19:55:53.486 INFO:teuthology.orchestra.run.smithi155.stdout: ] 2023-08-01T19:55:53.486 INFO:teuthology.orchestra.run.smithi155.stdout: } 2023-08-01T19:55:53.486 INFO:teuthology.orchestra.run.smithi155.stdout: }, 2023-08-01T19:55:53.486 INFO:teuthology.orchestra.run.smithi155.stdout: { 2023-08-01T19:55:53.486 INFO:teuthology.orchestra.run.smithi155.stdout: "description": "osd_op(client.4668.0:186994 5.f 5:f5dd3aa6:::benchmark_data_smithi006_114134_object53333:head [delete] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e59)", 2023-08-01T19:55:53.486 INFO:teuthology.orchestra.run.smithi155.stdout: "initiated_at": "2023-08-01T19:55:53.405309+0000", 2023-08-01T19:55:53.486 INFO:teuthology.orchestra.run.smithi155.stdout: "age": 0.0033020969999999999, 2023-08-01T19:55:53.486 INFO:teuthology.orchestra.run.smithi155.stdout: "duration": 0.0040792119999999996, 2023-08-01T19:55:53.487 INFO:teuthology.orchestra.run.smithi155.stdout: "type_data": { 2023-08-01T19:55:53.487 INFO:teuthology.orchestra.run.smithi155.stdout: "flag_point": "waiting for sub ops", 2023-08-01T19:55:53.487 INFO:teuthology.orchestra.run.smithi155.stdout: "client_info": { 2023-08-01T19:55:53.487 INFO:teuthology.orchestra.run.smithi155.stdout: "client": "client.4668", 2023-08-01T19:55:53.487 INFO:teuthology.orchestra.run.smithi155.stdout: "client_addr": "172.21.15.6:0/1709472247", 2023-08-01T19:55:53.487 INFO:teuthology.orchestra.run.smithi155.stdout: "tid": 186994 2023-08-01T19:55:53.487 INFO:teuthology.orchestra.run.smithi155.stdout: }, 2023-08-01T19:55:53.488 INFO:teuthology.orchestra.run.smithi155.stdout: "events": [ 2023-08-01T19:55:53.488 INFO:teuthology.orchestra.run.smithi155.stdout: { 2023-08-01T19:55:53.488 INFO:teuthology.orchestra.run.smithi155.stdout: "event": "initiated", 2023-08-01T19:55:53.488 INFO:teuthology.orchestra.run.smithi155.stdout: "time": "2023-08-01T19:55:53.405309+0000", 2023-08-01T19:55:53.488 INFO:teuthology.orchestra.run.smithi155.stdout: "duration": 0 2023-08-01T19:55:53.488 INFO:teuthology.orchestra.run.smithi155.stdout: }, 2023-08-01T19:55:53.488 INFO:teuthology.orchestra.run.smithi155.stdout: { 2023-08-01T19:55:53.488 INFO:teuthology.orchestra.run.smithi155.stdout: "event": "throttled", 2023-08-01T19:55:53.489 INFO:teuthology.orchestra.run.smithi155.stdout: "time": "2023-08-01T19:55:53.405309+0000", 2023-08-01T19:55:53.489 INFO:teuthology.orchestra.run.smithi155.stdout: "duration": 0 2023-08-01T19:55:53.489 INFO:teuthology.orchestra.run.smithi155.stdout: }, 2023-08-01T19:55:53.489 INFO:teuthology.orchestra.run.smithi155.stdout: { 2023-08-01T19:55:53.489 INFO:teuthology.orchestra.run.smithi155.stdout: "event": "header_read", 2023-08-01T19:55:53.489 INFO:teuthology.orchestra.run.smithi155.stdout: "time": "2023-08-01T19:55:53.405308+0000", 2023-08-01T19:55:53.489 INFO:teuthology.orchestra.run.smithi155.stdout: "duration": 4294967295.999999 2023-08-01T19:55:53.489 INFO:teuthology.orchestra.run.smithi155.stdout: }, 2023-08-01T19:55:53.490 INFO:teuthology.orchestra.run.smithi155.stdout: { 2023-08-01T19:55:53.490 INFO:teuthology.orchestra.run.smithi155.stdout: "event": "all_read", 2023-08-01T19:55:53.490 INFO:teuthology.orchestra.run.smithi155.stdout: "time": "2023-08-01T19:55:53.405316+0000", 2023-08-01T19:55:53.490 INFO:teuthology.orchestra.run.smithi155.stdout: "duration": 7.9629999999999998e-06 2023-08-01T19:55:53.490 INFO:teuthology.orchestra.run.smithi155.stdout: }, 2023-08-01T19:55:53.490 INFO:teuthology.orchestra.run.smithi155.stdout: { 2023-08-01T19:55:53.490 INFO:teuthology.orchestra.run.smithi155.stdout: "event": "dispatched", 2023-08-01T19:55:53.490 INFO:teuthology.orchestra.run.smithi155.stdout: "time": "2023-08-01T19:55:53.405325+0000", 2023-08-01T19:55:53.491 INFO:teuthology.orchestra.run.smithi155.stdout: "duration": 9.1249999999999999e-06 2023-08-01T19:55:53.491 INFO:teuthology.orchestra.run.smithi155.stdout: }, 2023-08-01T19:55:53.491 INFO:teuthology.orchestra.run.smithi155.stdout: { 2023-08-01T19:55:53.491 INFO:teuthology.orchestra.run.smithi155.stdout: "event": "queued_for_pg", 2023-08-01T19:55:53.491 INFO:teuthology.orchestra.run.smithi155.stdout: "time": "2023-08-01T19:55:53.405330+0000", 2023-08-01T19:55:53.491 INFO:teuthology.orchestra.run.smithi155.stdout: "duration": 5.1370000000000001e-06 2023-08-01T19:55:53.491 INFO:teuthology.orchestra.run.smithi155.stdout: }, 2023-08-01T19:55:53.492 INFO:teuthology.orchestra.run.smithi155.stdout: { 2023-08-01T19:55:53.492 INFO:teuthology.orchestra.run.smithi155.stdout: "event": "reached_pg", 2023-08-01T19:55:53.492 INFO:teuthology.orchestra.run.smithi155.stdout: "time": "2023-08-01T19:55:53.406448+0000", 2023-08-01T19:55:53.492 INFO:teuthology.orchestra.run.smithi155.stdout: "duration": 0.001117589 2023-08-01T19:55:53.492 INFO:teuthology.orchestra.run.smithi155.stdout: }, 2023-08-01T19:55:53.492 INFO:teuthology.orchestra.run.smithi155.stdout: { 2023-08-01T19:55:53.492 INFO:teuthology.orchestra.run.smithi155.stdout: "event": "started", 2023-08-01T19:55:53.492 INFO:teuthology.orchestra.run.smithi155.stdout: "time": "2023-08-01T19:55:53.406525+0000", 2023-08-01T19:55:53.493 INFO:teuthology.orchestra.run.smithi155.stdout: "duration": 7.6847000000000005e-05 2023-08-01T19:55:53.493 INFO:teuthology.orchestra.run.smithi155.stdout: }, 2023-08-01T19:55:53.493 INFO:teuthology.orchestra.run.smithi155.stdout: { 2023-08-01T19:55:53.493 INFO:teuthology.orchestra.run.smithi155.stdout: "event": "waiting for subops from 1", 2023-08-01T19:55:53.493 INFO:teuthology.orchestra.run.smithi155.stdout: "time": "2023-08-01T19:55:53.406589+0000", 2023-08-01T19:55:53.493 INFO:teuthology.orchestra.run.smithi155.stdout: "duration": 6.4821999999999997e-05 2023-08-01T19:55:53.493 INFO:teuthology.orchestra.run.smithi155.stdout: } 2023-08-01T19:55:53.494 INFO:teuthology.orchestra.run.smithi155.stdout: ] 2023-08-01T19:55:53.494 INFO:teuthology.orchestra.run.smithi155.stdout: } 2023-08-01T19:55:53.494 INFO:teuthology.orchestra.run.smithi155.stdout: }, 2023-08-01T19:55:53.494 INFO:teuthology.orchestra.run.smithi155.stdout: { 2023-08-01T19:55:53.494 INFO:teuthology.orchestra.run.smithi155.stdout: "description": "osd_op(client.4668.0:186995 5.e 5:755d5043:::benchmark_data_smithi006_114134_object53334:head [delete] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e59)", 2023-08-01T19:55:53.494 INFO:teuthology.orchestra.run.smithi155.stdout: "initiated_at": "2023-08-01T19:55:53.405497+0000", 2023-08-01T19:55:53.494 INFO:teuthology.orchestra.run.smithi155.stdout: "age": 0.0031133879999999999, 2023-08-01T19:55:53.494 INFO:teuthology.orchestra.run.smithi155.stdout: "duration": 0.003937177, 2023-08-01T19:55:53.495 INFO:teuthology.orchestra.run.smithi155.stdout: "type_data": { 2023-08-01T19:55:53.495 INFO:teuthology.orchestra.run.smithi155.stdout: "flag_point": "waiting for sub ops", 2023-08-01T19:55:53.495 INFO:teuthology.orchestra.run.smithi155.stdout: "client_info": { 2023-08-01T19:55:53.495 INFO:teuthology.orchestra.run.smithi155.stdout: "client": "client.4668", 2023-08-01T19:55:53.495 INFO:teuthology.orchestra.run.smithi155.stdout: "client_addr": "172.21.15.6:0/1709472247", 2023-08-01T19:55:53.495 INFO:teuthology.orchestra.run.smithi155.stdout: "tid": 186995 2023-08-01T19:55:53.495 INFO:teuthology.orchestra.run.smithi155.stdout: }, 2023-08-01T19:55:53.495 INFO:teuthology.orchestra.run.smithi155.stdout: "events": [ 2023-08-01T19:55:53.496 INFO:teuthology.orchestra.run.smithi155.stdout: { 2023-08-01T19:55:53.496 INFO:teuthology.orchestra.run.smithi155.stdout: "event": "initiated", 2023-08-01T19:55:53.496 INFO:teuthology.orchestra.run.smithi155.stdout: "time": "2023-08-01T19:55:53.405497+0000", 2023-08-01T19:55:53.496 INFO:teuthology.orchestra.run.smithi155.stdout: "duration": 0 2023-08-01T19:55:53.496 INFO:teuthology.orchestra.run.smithi155.stdout: }, 2023-08-01T19:55:53.496 INFO:teuthology.orchestra.run.smithi155.stdout: { 2023-08-01T19:55:53.496 INFO:teuthology.orchestra.run.smithi155.stdout: "event": "throttled", 2023-08-01T19:55:53.496 INFO:teuthology.orchestra.run.smithi155.stdout: "time": "2023-08-01T19:55:53.405497+0000", 2023-08-01T19:55:53.497 INFO:teuthology.orchestra.run.smithi155.stdout: "duration": 0 2023-08-01T19:55:53.497 INFO:teuthology.orchestra.run.smithi155.stdout: }, 2023-08-01T19:55:53.497 INFO:teuthology.orchestra.run.smithi155.stdout: { 2023-08-01T19:55:53.497 INFO:teuthology.orchestra.run.smithi155.stdout: "event": "header_read", 2023-08-01T19:55:53.497 INFO:teuthology.orchestra.run.smithi155.stdout: "time": "2023-08-01T19:55:53.405497+0000", 2023-08-01T19:55:53.497 INFO:teuthology.orchestra.run.smithi155.stdout: "duration": 4294967295.999999 2023-08-01T19:55:53.497 INFO:teuthology.orchestra.run.smithi155.stdout: }, 2023-08-01T19:55:53.497 INFO:teuthology.orchestra.run.smithi155.stdout: { 2023-08-01T19:55:53.498 INFO:teuthology.orchestra.run.smithi155.stdout: "event": "all_read", 2023-08-01T19:55:53.498 INFO:teuthology.orchestra.run.smithi155.stdout: "time": "2023-08-01T19:55:53.405501+0000", 2023-08-01T19:55:53.498 INFO:teuthology.orchestra.run.smithi155.stdout: "duration": 3.8139999999999998e-06 2023-08-01T19:55:53.498 INFO:teuthology.orchestra.run.smithi155.stdout: }, 2023-08-01T19:55:53.498 INFO:teuthology.orchestra.run.smithi155.stdout: { 2023-08-01T19:55:53.498 INFO:teuthology.orchestra.run.smithi155.stdout: "event": "dispatched", 2023-08-01T19:55:53.498 INFO:teuthology.orchestra.run.smithi155.stdout: "time": "2023-08-01T19:55:53.405512+0000", 2023-08-01T19:55:53.499 INFO:teuthology.orchestra.run.smithi155.stdout: "duration": 1.128e-05 2023-08-01T19:55:53.499 INFO:teuthology.orchestra.run.smithi155.stdout: }, 2023-08-01T19:55:53.499 INFO:teuthology.orchestra.run.smithi155.stdout: { 2023-08-01T19:55:53.499 INFO:teuthology.orchestra.run.smithi155.stdout: "event": "queued_for_pg", 2023-08-01T19:55:53.499 INFO:teuthology.orchestra.run.smithi155.stdout: "time": "2023-08-01T19:55:53.405516+0000", 2023-08-01T19:55:53.499 INFO:teuthology.orchestra.run.smithi155.stdout: "duration": 4.5460000000000002e-06 2023-08-01T19:55:53.499 INFO:teuthology.orchestra.run.smithi155.stdout: }, 2023-08-01T19:55:53.499 INFO:teuthology.orchestra.run.smithi155.stdout: { 2023-08-01T19:55:53.500 INFO:teuthology.orchestra.run.smithi155.stdout: "event": "reached_pg", 2023-08-01T19:55:53.500 INFO:teuthology.orchestra.run.smithi155.stdout: "time": "2023-08-01T19:55:53.408155+0000", 2023-08-01T19:55:53.500 INFO:teuthology.orchestra.run.smithi155.stdout: "duration": 0.0026391169999999999 2023-08-01T19:55:53.500 INFO:teuthology.orchestra.run.smithi155.stdout: }, 2023-08-01T19:55:53.500 INFO:teuthology.orchestra.run.smithi155.stdout: { 2023-08-01T19:55:53.500 INFO:teuthology.orchestra.run.smithi155.stdout: "event": "started", 2023-08-01T19:55:53.500 INFO:teuthology.orchestra.run.smithi155.stdout: "time": "2023-08-01T19:55:53.408269+0000", 2023-08-01T19:55:53.501 INFO:teuthology.orchestra.run.smithi155.stdout: "duration": 0.000113688 2023-08-01T19:55:53.501 INFO:teuthology.orchestra.run.smithi155.stdout: }, 2023-08-01T19:55:53.501 INFO:teuthology.orchestra.run.smithi155.stdout: { 2023-08-01T19:55:53.501 INFO:teuthology.orchestra.run.smithi155.stdout: "event": "waiting for subops from 0", 2023-08-01T19:55:53.501 INFO:teuthology.orchestra.run.smithi155.stdout: "time": "2023-08-01T19:55:53.408367+0000", 2023-08-01T19:55:53.501 INFO:teuthology.orchestra.run.smithi155.stdout: "duration": 9.8159000000000007e-05 2023-08-01T19:55:53.501 INFO:teuthology.orchestra.run.smithi155.stdout: } 2023-08-01T19:55:53.502 INFO:teuthology.orchestra.run.smithi155.stdout: ] 2023-08-01T19:55:53.502 INFO:teuthology.orchestra.run.smithi155.stdout: } 2023-08-01T19:55:53.502 INFO:teuthology.orchestra.run.smithi155.stdout: }, 2023-08-01T19:55:53.502 INFO:teuthology.orchestra.run.smithi155.stdout: { 2023-08-01T19:55:53.502 INFO:teuthology.orchestra.run.smithi155.stdout: "description": "osd_op(client.4668.0:186997 5.d 5:b1381451:::benchmark_data_smithi006_114134_object53336:head [delete] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e59)", 2023-08-01T19:55:53.502 INFO:teuthology.orchestra.run.smithi155.stdout: "initiated_at": "2023-08-01T19:55:53.408764+0000", 2023-08-01T19:55:53.502 INFO:teuthology.orchestra.run.smithi155.stdout: "age": 4294967295.9998474, 2023-08-01T19:55:53.502 INFO:teuthology.orchestra.run.smithi155.stdout: "duration": 0.000714633, 2023-08-01T19:55:53.503 INFO:teuthology.orchestra.run.smithi155.stdout: "type_data": { 2023-08-01T19:55:53.503 INFO:teuthology.orchestra.run.smithi155.stdout: "flag_point": "waiting for sub ops", 2023-08-01T19:55:53.503 INFO:teuthology.orchestra.run.smithi155.stdout: "client_info": { 2023-08-01T19:55:53.503 INFO:teuthology.orchestra.run.smithi155.stdout: "client": "client.4668", 2023-08-01T19:55:53.503 INFO:teuthology.orchestra.run.smithi155.stdout: "client_addr": "172.21.15.6:0/1709472247", 2023-08-01T19:55:53.503 INFO:teuthology.orchestra.run.smithi155.stdout: "tid": 186997 2023-08-01T19:55:53.503 INFO:teuthology.orchestra.run.smithi155.stdout: }, 2023-08-01T19:55:53.504 INFO:teuthology.orchestra.run.smithi155.stdout: "events": [ 2023-08-01T19:55:53.504 INFO:teuthology.orchestra.run.smithi155.stdout: { 2023-08-01T19:55:53.504 INFO:teuthology.orchestra.run.smithi155.stdout: "event": "initiated", 2023-08-01T19:55:53.504 INFO:teuthology.orchestra.run.smithi155.stdout: "time": "2023-08-01T19:55:53.408764+0000", 2023-08-01T19:55:53.504 INFO:teuthology.orchestra.run.smithi155.stdout: "duration": 0 2023-08-01T19:55:53.504 INFO:teuthology.orchestra.run.smithi155.stdout: }, 2023-08-01T19:55:53.504 INFO:teuthology.orchestra.run.smithi155.stdout: { 2023-08-01T19:55:53.505 INFO:teuthology.orchestra.run.smithi155.stdout: "event": "throttled", 2023-08-01T19:55:53.505 INFO:teuthology.orchestra.run.smithi155.stdout: "time": "2023-08-01T19:55:53.408764+0000", 2023-08-01T19:55:53.505 INFO:teuthology.orchestra.run.smithi155.stdout: "duration": 0 2023-08-01T19:55:53.505 INFO:teuthology.orchestra.run.smithi155.stdout: }, 2023-08-01T19:55:53.505 INFO:teuthology.orchestra.run.smithi155.stdout: { 2023-08-01T19:55:53.505 INFO:teuthology.orchestra.run.smithi155.stdout: "event": "header_read", 2023-08-01T19:55:53.505 INFO:teuthology.orchestra.run.smithi155.stdout: "time": "2023-08-01T19:55:53.408763+0000", 2023-08-01T19:55:53.506 INFO:teuthology.orchestra.run.smithi155.stdout: "duration": 4294967295.999999 2023-08-01T19:55:53.506 INFO:teuthology.orchestra.run.smithi155.stdout: }, 2023-08-01T19:55:53.506 INFO:teuthology.orchestra.run.smithi155.stdout: { 2023-08-01T19:55:53.506 INFO:teuthology.orchestra.run.smithi155.stdout: "event": "all_read", 2023-08-01T19:55:53.506 INFO:teuthology.orchestra.run.smithi155.stdout: "time": "2023-08-01T19:55:53.408768+0000", 2023-08-01T19:55:53.506 INFO:teuthology.orchestra.run.smithi155.stdout: "duration": 5.1599999999999997e-06 2023-08-01T19:55:53.507 INFO:teuthology.orchestra.run.smithi155.stdout: }, 2023-08-01T19:55:53.507 INFO:teuthology.orchestra.run.smithi155.stdout: { 2023-08-01T19:55:53.507 INFO:teuthology.orchestra.run.smithi155.stdout: "event": "dispatched", 2023-08-01T19:55:53.507 INFO:teuthology.orchestra.run.smithi155.stdout: "time": "2023-08-01T19:55:53.408775+0000", 2023-08-01T19:55:53.507 INFO:teuthology.orchestra.run.smithi155.stdout: "duration": 7.6120000000000001e-06 2023-08-01T19:55:53.507 INFO:teuthology.orchestra.run.smithi155.stdout: }, 2023-08-01T19:55:53.507 INFO:teuthology.orchestra.run.smithi155.stdout: { 2023-08-01T19:55:53.507 INFO:teuthology.orchestra.run.smithi155.stdout: "event": "queued_for_pg", 2023-08-01T19:55:53.508 INFO:teuthology.orchestra.run.smithi155.stdout: "time": "2023-08-01T19:55:53.408779+0000", 2023-08-01T19:55:53.508 INFO:teuthology.orchestra.run.smithi155.stdout: "duration": 3.9480000000000001e-06 2023-08-01T19:55:53.508 INFO:teuthology.orchestra.run.smithi155.stdout: }, 2023-08-01T19:55:53.508 INFO:teuthology.orchestra.run.smithi155.stdout: { 2023-08-01T19:55:53.508 INFO:teuthology.orchestra.run.smithi155.stdout: "event": "reached_pg", 2023-08-01T19:55:53.508 INFO:teuthology.orchestra.run.smithi155.stdout: "time": "2023-08-01T19:55:53.408817+0000", 2023-08-01T19:55:53.508 INFO:teuthology.orchestra.run.smithi155.stdout: "duration": 3.7687e-05 2023-08-01T19:55:53.509 INFO:teuthology.orchestra.run.smithi155.stdout: }, 2023-08-01T19:55:53.509 INFO:teuthology.orchestra.run.smithi155.stdout: { 2023-08-01T19:55:53.509 INFO:teuthology.orchestra.run.smithi155.stdout: "event": "started", 2023-08-01T19:55:53.509 INFO:teuthology.orchestra.run.smithi155.stdout: "time": "2023-08-01T19:55:53.408930+0000", 2023-08-01T19:55:53.509 INFO:teuthology.orchestra.run.smithi155.stdout: "duration": 0.00011336 2023-08-01T19:55:53.509 INFO:teuthology.orchestra.run.smithi155.stdout: }, 2023-08-01T19:55:53.509 INFO:teuthology.orchestra.run.smithi155.stdout: { 2023-08-01T19:55:53.509 INFO:teuthology.orchestra.run.smithi155.stdout: "event": "waiting for subops from 1", 2023-08-01T19:55:53.510 INFO:teuthology.orchestra.run.smithi155.stdout: "time": "2023-08-01T19:55:53.409040+0000", 2023-08-01T19:55:53.510 INFO:teuthology.orchestra.run.smithi155.stdout: "duration": 0.0001098 2023-08-01T19:55:53.510 INFO:teuthology.orchestra.run.smithi155.stdout: } 2023-08-01T19:55:53.510 INFO:teuthology.orchestra.run.smithi155.stdout: ] 2023-08-01T19:55:53.510 INFO:teuthology.orchestra.run.smithi155.stdout: } 2023-08-01T19:55:53.510 INFO:teuthology.orchestra.run.smithi155.stdout: } 2023-08-01T19:55:53.510 INFO:teuthology.orchestra.run.smithi155.stdout: ], 2023-08-01T19:55:53.511 INFO:teuthology.orchestra.run.smithi155.stdout: "num_ops": 12 2023-08-01T19:55:53.511 INFO:teuthology.orchestra.run.smithi155.stdout:} 2023-08-01T19:55:53.512 INFO:tasks.ceph.osd.1.smithi101.stderr:2023-08-01T19:55:53.510+0000 7fb0cb7f6700 -1 received signal: Hangup from /usr/bin/python3 /bin/daemon-helper kill ceph-osd -f --cluster ceph -i 1 (PID: 111141) UID: 0 2023-08-01T19:55:53.512 DEBUG:teuthology.orchestra.run.smithi155:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 30 ceph --cluster ceph --admin-daemon /var/run/ceph/ceph-osd.2.asok dump_blocked_ops 2023-08-01T19:55:53.612 INFO:tasks.ceph.osd.1.smithi101.stderr:2023-08-01T19:55:53.611+0000 7fb0cb7f6700 -1 received signal: Hangup from /usr/bin/python3 /bin/daemon-helper kill ceph-osd -f --cluster ceph -i 1 (PID: 111141) UID: 0 2023-08-01T19:55:53.714 INFO:tasks.ceph.osd.1.smithi101.stderr:2023-08-01T19:55:53.712+0000 7fb0cb7f6700 -1 received signal: Hangup from /usr/bin/python3 /bin/daemon-helper kill ceph-osd -f --cluster ceph -i 1 (PID: 111141) UID: 0 2023-08-01T19:55:53.716 INFO:teuthology.orchestra.run.smithi155.stdout:{ 2023-08-01T19:55:53.717 INFO:teuthology.orchestra.run.smithi155.stdout: "ops": [], 2023-08-01T19:55:53.717 INFO:teuthology.orchestra.run.smithi155.stdout: "complaint_time": 30, 2023-08-01T19:55:53.717 INFO:teuthology.orchestra.run.smithi155.stdout: "num_blocked_ops": 0 2023-08-01T19:55:53.717 INFO:teuthology.orchestra.run.smithi155.stdout:} 2023-08-01T19:55:53.729 DEBUG:teuthology.orchestra.run.smithi155:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 30 ceph --cluster ceph --admin-daemon /var/run/ceph/ceph-osd.2.asok dump_historic_ops 2023-08-01T19:55:53.815 INFO:tasks.ceph.osd.2.smithi155.stderr:2023-08-01T19:55:53.813+0000 7faa5c6ac700 -1 received signal: Hangup from /usr/bin/python3 /bin/daemon-helper kill ceph-osd -f --cluster ceph -i 2 (PID: 111337) UID: 0 2023-08-01T19:55:53.891 INFO:teuthology.orchestra.run.smithi155.stdout:{ 2023-08-01T19:55:53.892 INFO:teuthology.orchestra.run.smithi155.stdout: "size": 20, 2023-08-01T19:55:53.892 INFO:teuthology.orchestra.run.smithi155.stdout: "duration": 600, 2023-08-01T19:55:53.892 INFO:teuthology.orchestra.run.smithi155.stdout: "ops": [ 2023-08-01T19:55:53.892 INFO:teuthology.orchestra.run.smithi155.stdout: { 2023-08-01T19:55:53.892 INFO:teuthology.orchestra.run.smithi155.stdout: "description": "osd_op(client.4668.0:73454 5.8 5:15596b2f:::benchmark_data_smithi006_114134_object73453:head [set-alloc-hint object_size 65536 write_size 65536,write 0~65536] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e31)", 2023-08-01T19:55:53.893 INFO:teuthology.orchestra.run.smithi155.stdout: "initiated_at": "2023-08-01T19:54:51.460020+0000", 2023-08-01T19:55:53.893 INFO:teuthology.orchestra.run.smithi155.stdout: "age": 62.428468629000001, 2023-08-01T19:55:53.893 INFO:teuthology.orchestra.run.smithi155.stdout: "duration": 0.022889436999999999, 2023-08-01T19:55:53.893 INFO:teuthology.orchestra.run.smithi155.stdout: "type_data": { 2023-08-01T19:55:53.893 INFO:teuthology.orchestra.run.smithi155.stdout: "flag_point": "commit sent; apply or cleanup", 2023-08-01T19:55:53.893 INFO:teuthology.orchestra.run.smithi155.stdout: "client_info": { 2023-08-01T19:55:53.893 INFO:teuthology.orchestra.run.smithi155.stdout: "client": "client.4668", 2023-08-01T19:55:53.893 INFO:teuthology.orchestra.run.smithi155.stdout: "client_addr": "172.21.15.6:0/1709472247", 2023-08-01T19:55:53.894 INFO:teuthology.orchestra.run.smithi155.stdout: "tid": 73454 2023-08-01T19:55:53.894 INFO:teuthology.orchestra.run.smithi155.stdout: }, 2023-08-01T19:55:53.894 INFO:teuthology.orchestra.run.smithi155.stdout: "events": [ 2023-08-01T19:55:53.894 INFO:teuthology.orchestra.run.smithi155.stdout: { 2023-08-01T19:55:53.894 INFO:teuthology.orchestra.run.smithi155.stdout: "event": "initiated", 2023-08-01T19:55:53.894 INFO:teuthology.orchestra.run.smithi155.stdout: "time": "2023-08-01T19:54:51.460020+0000", 2023-08-01T19:55:53.894 INFO:teuthology.orchestra.run.smithi155.stdout: "duration": 0 2023-08-01T19:55:53.894 INFO:teuthology.orchestra.run.smithi155.stdout: }, 2023-08-01T19:55:53.895 INFO:teuthology.orchestra.run.smithi155.stdout: { 2023-08-01T19:55:53.895 INFO:teuthology.orchestra.run.smithi155.stdout: "event": "throttled", 2023-08-01T19:55:53.895 INFO:teuthology.orchestra.run.smithi155.stdout: "time": "2023-08-01T19:54:51.460020+0000", 2023-08-01T19:55:53.895 INFO:teuthology.orchestra.run.smithi155.stdout: "duration": 0 2023-08-01T19:55:53.895 INFO:teuthology.orchestra.run.smithi155.stdout: }, 2023-08-01T19:55:53.895 INFO:teuthology.orchestra.run.smithi155.stdout: { 2023-08-01T19:55:53.895 INFO:teuthology.orchestra.run.smithi155.stdout: "event": "header_read", 2023-08-01T19:55:53.896 INFO:teuthology.orchestra.run.smithi155.stdout: "time": "2023-08-01T19:54:51.460019+0000", 2023-08-01T19:55:53.896 INFO:teuthology.orchestra.run.smithi155.stdout: "duration": 4294967295.9999995 2023-08-01T19:55:53.896 INFO:teuthology.orchestra.run.smithi155.stdout: }, 2023-08-01T19:55:53.896 INFO:teuthology.orchestra.run.smithi155.stdout: { 2023-08-01T19:55:53.896 INFO:teuthology.orchestra.run.smithi155.stdout: "event": "all_read", 2023-08-01T19:55:53.896 INFO:teuthology.orchestra.run.smithi155.stdout: "time": "2023-08-01T19:54:51.460051+0000", 2023-08-01T19:55:53.896 INFO:teuthology.orchestra.run.smithi155.stdout: "duration": 3.1736000000000002e-05 2023-08-01T19:55:53.896 INFO:teuthology.orchestra.run.smithi155.stdout: }, 2023-08-01T19:55:53.897 INFO:teuthology.orchestra.run.smithi155.stdout: { 2023-08-01T19:55:53.897 INFO:teuthology.orchestra.run.smithi155.stdout: "event": "dispatched", 2023-08-01T19:55:53.897 INFO:teuthology.orchestra.run.smithi155.stdout: "time": "2023-08-01T19:54:51.460058+0000", 2023-08-01T19:55:53.897 INFO:teuthology.orchestra.run.smithi155.stdout: "duration": 7.3869999999999997e-06 2023-08-01T19:55:53.897 INFO:teuthology.orchestra.run.smithi155.stdout: }, 2023-08-01T19:55:53.897 INFO:teuthology.orchestra.run.smithi155.stdout: { 2023-08-01T19:55:53.897 INFO:teuthology.orchestra.run.smithi155.stdout: "event": "queued_for_pg", 2023-08-01T19:55:53.897 INFO:teuthology.orchestra.run.smithi155.stdout: "time": "2023-08-01T19:54:51.460062+0000", 2023-08-01T19:55:53.898 INFO:teuthology.orchestra.run.smithi155.stdout: "duration": 4.352e-06 2023-08-01T19:55:53.898 INFO:teuthology.orchestra.run.smithi155.stdout: }, 2023-08-01T19:55:53.898 INFO:teuthology.orchestra.run.smithi155.stdout: { 2023-08-01T19:55:53.898 INFO:teuthology.orchestra.run.smithi155.stdout: "event": "reached_pg", 2023-08-01T19:55:53.898 INFO:teuthology.orchestra.run.smithi155.stdout: "time": "2023-08-01T19:54:51.460101+0000", 2023-08-01T19:55:53.898 INFO:teuthology.orchestra.run.smithi155.stdout: "duration": 3.8705000000000003e-05 2023-08-01T19:55:53.898 INFO:teuthology.orchestra.run.smithi155.stdout: }, 2023-08-01T19:55:53.898 INFO:teuthology.orchestra.run.smithi155.stdout: { 2023-08-01T19:55:53.899 INFO:teuthology.orchestra.run.smithi155.stdout: "event": "started", 2023-08-01T19:55:53.899 INFO:teuthology.orchestra.run.smithi155.stdout: "time": "2023-08-01T19:54:51.460236+0000", 2023-08-01T19:55:53.899 INFO:teuthology.orchestra.run.smithi155.stdout: "duration": 0.00013463599999999999 2023-08-01T19:55:53.899 INFO:teuthology.orchestra.run.smithi155.stdout: }, 2023-08-01T19:55:53.899 INFO:teuthology.orchestra.run.smithi155.stdout: { 2023-08-01T19:55:53.899 INFO:teuthology.orchestra.run.smithi155.stdout: "event": "waiting for subops from 0", 2023-08-01T19:55:53.899 INFO:teuthology.orchestra.run.smithi155.stdout: "time": "2023-08-01T19:54:51.460391+0000", 2023-08-01T19:55:53.899 INFO:teuthology.orchestra.run.smithi155.stdout: "duration": 0.00015525000000000001 2023-08-01T19:55:53.900 INFO:teuthology.orchestra.run.smithi155.stdout: }, 2023-08-01T19:55:53.900 INFO:teuthology.orchestra.run.smithi155.stdout: { 2023-08-01T19:55:53.900 INFO:teuthology.orchestra.run.smithi155.stdout: "event": "sub_op_commit_rec", 2023-08-01T19:55:53.900 INFO:teuthology.orchestra.run.smithi155.stdout: "time": "2023-08-01T19:54:51.468393+0000", 2023-08-01T19:55:53.900 INFO:teuthology.orchestra.run.smithi155.stdout: "duration": 0.00800208 2023-08-01T19:55:53.900 INFO:teuthology.orchestra.run.smithi155.stdout: }, 2023-08-01T19:55:53.900 INFO:teuthology.orchestra.run.smithi155.stdout: { 2023-08-01T19:55:53.901 INFO:teuthology.orchestra.run.smithi155.stdout: "event": "op_commit", 2023-08-01T19:55:53.901 INFO:teuthology.orchestra.run.smithi155.stdout: "time": "2023-08-01T19:54:51.482815+0000", 2023-08-01T19:55:53.901 INFO:teuthology.orchestra.run.smithi155.stdout: "duration": 0.01442148 2023-08-01T19:55:53.901 INFO:teuthology.orchestra.run.smithi155.stdout: }, 2023-08-01T19:55:53.901 INFO:teuthology.orchestra.run.smithi155.stdout: { 2023-08-01T19:55:53.901 INFO:teuthology.orchestra.run.smithi155.stdout: "event": "commit_sent", 2023-08-01T19:55:53.901 INFO:teuthology.orchestra.run.smithi155.stdout: "time": "2023-08-01T19:54:51.482866+0000", 2023-08-01T19:55:53.901 INFO:teuthology.orchestra.run.smithi155.stdout: "duration": 5.1842999999999998e-05 2023-08-01T19:55:53.902 INFO:teuthology.orchestra.run.smithi155.stdout: }, 2023-08-01T19:55:53.902 INFO:teuthology.orchestra.run.smithi155.stdout: { 2023-08-01T19:55:53.902 INFO:teuthology.orchestra.run.smithi155.stdout: "event": "done", 2023-08-01T19:55:53.902 INFO:teuthology.orchestra.run.smithi155.stdout: "time": "2023-08-01T19:54:51.482909+0000", 2023-08-01T19:55:53.902 INFO:teuthology.orchestra.run.smithi155.stdout: "duration": 4.2663000000000001e-05 2023-08-01T19:55:53.902 INFO:teuthology.orchestra.run.smithi155.stdout: } 2023-08-01T19:55:53.902 INFO:teuthology.orchestra.run.smithi155.stdout: ] 2023-08-01T19:55:53.902 INFO:teuthology.orchestra.run.smithi155.stdout: } 2023-08-01T19:55:53.903 INFO:teuthology.orchestra.run.smithi155.stdout: }, 2023-08-01T19:55:53.903 INFO:teuthology.orchestra.run.smithi155.stdout: { 2023-08-01T19:55:53.903 INFO:teuthology.orchestra.run.smithi155.stdout: "description": "osd_op(client.4668.0:73455 5.b 5:de51121e:::benchmark_data_smithi006_114134_object73454:head [set-alloc-hint object_size 65536 write_size 65536,write 0~65536] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e31)", 2023-08-01T19:55:53.903 INFO:teuthology.orchestra.run.smithi155.stdout: "initiated_at": "2023-08-01T19:54:51.460078+0000", 2023-08-01T19:55:53.903 INFO:teuthology.orchestra.run.smithi155.stdout: "age": 62.428410655, 2023-08-01T19:55:53.903 INFO:teuthology.orchestra.run.smithi155.stdout: "duration": 0.022689121999999999, 2023-08-01T19:55:53.903 INFO:teuthology.orchestra.run.smithi155.stdout: "type_data": { 2023-08-01T19:55:53.903 INFO:teuthology.orchestra.run.smithi155.stdout: "flag_point": "commit sent; apply or cleanup", 2023-08-01T19:55:53.904 INFO:teuthology.orchestra.run.smithi155.stdout: "client_info": { 2023-08-01T19:55:53.904 INFO:teuthology.orchestra.run.smithi155.stdout: "client": "client.4668", 2023-08-01T19:55:53.904 INFO:teuthology.orchestra.run.smithi155.stdout: "client_addr": "172.21.15.6:0/1709472247", 2023-08-01T19:55:53.904 INFO:teuthology.orchestra.run.smithi155.stdout: "tid": 73455 2023-08-01T19:55:53.904 INFO:teuthology.orchestra.run.smithi155.stdout: }, 2023-08-01T19:55:53.904 INFO:teuthology.orchestra.run.smithi155.stdout: "events": [ 2023-08-01T19:55:53.904 INFO:teuthology.orchestra.run.smithi155.stdout: { 2023-08-01T19:55:53.904 INFO:teuthology.orchestra.run.smithi155.stdout: "event": "initiated", 2023-08-01T19:55:53.905 INFO:teuthology.orchestra.run.smithi155.stdout: "time": "2023-08-01T19:54:51.460078+0000", 2023-08-01T19:55:53.905 INFO:teuthology.orchestra.run.smithi155.stdout: "duration": 0 2023-08-01T19:55:53.905 INFO:teuthology.orchestra.run.smithi155.stdout: }, 2023-08-01T19:55:53.905 INFO:teuthology.orchestra.run.smithi155.stdout: { 2023-08-01T19:55:53.905 INFO:teuthology.orchestra.run.smithi155.stdout: "event": "throttled", 2023-08-01T19:55:53.905 INFO:teuthology.orchestra.run.smithi155.stdout: "time": "2023-08-01T19:54:51.460078+0000", 2023-08-01T19:55:53.905 INFO:teuthology.orchestra.run.smithi155.stdout: "duration": 0 2023-08-01T19:55:53.905 INFO:teuthology.orchestra.run.smithi155.stdout: }, 2023-08-01T19:55:53.906 INFO:teuthology.orchestra.run.smithi155.stdout: { 2023-08-01T19:55:53.906 INFO:teuthology.orchestra.run.smithi155.stdout: "event": "header_read", 2023-08-01T19:55:53.906 INFO:teuthology.orchestra.run.smithi155.stdout: "time": "2023-08-01T19:54:51.460077+0000", 2023-08-01T19:55:53.906 INFO:teuthology.orchestra.run.smithi155.stdout: "duration": 4294967295.9999995 2023-08-01T19:55:53.906 INFO:teuthology.orchestra.run.smithi155.stdout: }, 2023-08-01T19:55:53.906 INFO:teuthology.orchestra.run.smithi155.stdout: { 2023-08-01T19:55:53.906 INFO:teuthology.orchestra.run.smithi155.stdout: "event": "all_read", 2023-08-01T19:55:53.906 INFO:teuthology.orchestra.run.smithi155.stdout: "time": "2023-08-01T19:54:51.460102+0000", 2023-08-01T19:55:53.907 INFO:teuthology.orchestra.run.smithi155.stdout: "duration": 2.4933e-05 2023-08-01T19:55:53.907 INFO:teuthology.orchestra.run.smithi155.stdout: }, 2023-08-01T19:55:53.907 INFO:teuthology.orchestra.run.smithi155.stdout: { 2023-08-01T19:55:53.907 INFO:teuthology.orchestra.run.smithi155.stdout: "event": "dispatched", 2023-08-01T19:55:53.907 INFO:teuthology.orchestra.run.smithi155.stdout: "time": "2023-08-01T19:54:51.460109+0000", 2023-08-01T19:55:53.907 INFO:teuthology.orchestra.run.smithi155.stdout: "duration": 7.0720000000000002e-06 2023-08-01T19:55:53.907 INFO:teuthology.orchestra.run.smithi155.stdout: }, 2023-08-01T19:55:53.908 INFO:teuthology.orchestra.run.smithi155.stdout: { 2023-08-01T19:55:53.908 INFO:teuthology.orchestra.run.smithi155.stdout: "event": "queued_for_pg", 2023-08-01T19:55:53.908 INFO:teuthology.orchestra.run.smithi155.stdout: "time": "2023-08-01T19:54:51.460113+0000", 2023-08-01T19:55:53.908 INFO:teuthology.orchestra.run.smithi155.stdout: "duration": 4.3220000000000003e-06 2023-08-01T19:55:53.908 INFO:teuthology.orchestra.run.smithi155.stdout: }, 2023-08-01T19:55:53.908 INFO:teuthology.orchestra.run.smithi155.stdout: { 2023-08-01T19:55:53.908 INFO:teuthology.orchestra.run.smithi155.stdout: "event": "reached_pg", 2023-08-01T19:55:53.908 INFO:teuthology.orchestra.run.smithi155.stdout: "time": "2023-08-01T19:54:51.460955+0000", 2023-08-01T19:55:53.909 INFO:teuthology.orchestra.run.smithi155.stdout: "duration": 0.00084142500000000003 2023-08-01T19:55:53.909 INFO:teuthology.orchestra.run.smithi155.stdout: }, 2023-08-01T19:55:53.909 INFO:teuthology.orchestra.run.smithi155.stdout: { 2023-08-01T19:55:53.909 INFO:teuthology.orchestra.run.smithi155.stdout: "event": "started", 2023-08-01T19:55:53.909 INFO:teuthology.orchestra.run.smithi155.stdout: "time": "2023-08-01T19:54:51.461079+0000", 2023-08-01T19:55:53.909 INFO:teuthology.orchestra.run.smithi155.stdout: "duration": 0.000123826 2023-08-01T19:55:53.909 INFO:teuthology.orchestra.run.smithi155.stdout: }, 2023-08-01T19:55:53.909 INFO:teuthology.orchestra.run.smithi155.stdout: { 2023-08-01T19:55:53.910 INFO:teuthology.orchestra.run.smithi155.stdout: "event": "waiting for subops from 0", 2023-08-01T19:55:53.910 INFO:teuthology.orchestra.run.smithi155.stdout: "time": "2023-08-01T19:54:51.461233+0000", 2023-08-01T19:55:53.910 INFO:teuthology.orchestra.run.smithi155.stdout: "duration": 0.00015431900000000001 2023-08-01T19:55:53.910 INFO:teuthology.orchestra.run.smithi155.stdout: }, 2023-08-01T19:55:53.910 INFO:teuthology.orchestra.run.smithi155.stdout: { 2023-08-01T19:55:53.910 INFO:teuthology.orchestra.run.smithi155.stdout: "event": "sub_op_commit_rec", 2023-08-01T19:55:53.910 INFO:teuthology.orchestra.run.smithi155.stdout: "time": "2023-08-01T19:54:51.468509+0000", 2023-08-01T19:55:53.910 INFO:teuthology.orchestra.run.smithi155.stdout: "duration": 0.0072759859999999999 2023-08-01T19:55:53.911 INFO:teuthology.orchestra.run.smithi155.stdout: }, 2023-08-01T19:55:53.911 INFO:teuthology.orchestra.run.smithi155.stdout: { 2023-08-01T19:55:53.911 INFO:teuthology.orchestra.run.smithi155.stdout: "event": "op_commit", 2023-08-01T19:55:53.911 INFO:teuthology.orchestra.run.smithi155.stdout: "time": "2023-08-01T19:54:51.482704+0000", 2023-08-01T19:55:53.911 INFO:teuthology.orchestra.run.smithi155.stdout: "duration": 0.01419545 2023-08-01T19:55:53.911 INFO:teuthology.orchestra.run.smithi155.stdout: }, 2023-08-01T19:55:53.911 INFO:teuthology.orchestra.run.smithi155.stdout: { 2023-08-01T19:55:53.912 INFO:teuthology.orchestra.run.smithi155.stdout: "event": "commit_sent", 2023-08-01T19:55:53.912 INFO:teuthology.orchestra.run.smithi155.stdout: "time": "2023-08-01T19:54:51.482747+0000", 2023-08-01T19:55:53.912 INFO:teuthology.orchestra.run.smithi155.stdout: "duration": 4.2413999999999997e-05 2023-08-01T19:55:53.912 INFO:teuthology.orchestra.run.smithi155.stdout: }, 2023-08-01T19:55:53.912 INFO:teuthology.orchestra.run.smithi155.stdout: { 2023-08-01T19:55:53.912 INFO:teuthology.orchestra.run.smithi155.stdout: "event": "done", 2023-08-01T19:55:53.912 INFO:teuthology.orchestra.run.smithi155.stdout: "time": "2023-08-01T19:54:51.482767+0000", 2023-08-01T19:55:53.912 INFO:teuthology.orchestra.run.smithi155.stdout: "duration": 1.9908999999999999e-05 2023-08-01T19:55:53.913 INFO:teuthology.orchestra.run.smithi155.stdout: } 2023-08-01T19:55:53.913 INFO:teuthology.orchestra.run.smithi155.stdout: ] 2023-08-01T19:55:53.913 INFO:teuthology.orchestra.run.smithi155.stdout: } 2023-08-01T19:55:53.913 INFO:teuthology.orchestra.run.smithi155.stdout: }, 2023-08-01T19:55:53.913 INFO:teuthology.orchestra.run.smithi155.stdout: { 2023-08-01T19:55:53.913 INFO:teuthology.orchestra.run.smithi155.stdout: "description": "osd_op(client.4668.0:73456 5.0 5:0164baf4:::benchmark_data_smithi006_114134_object73455:head [set-alloc-hint object_size 65536 write_size 65536,write 0~65536] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e31)", 2023-08-01T19:55:53.913 INFO:teuthology.orchestra.run.smithi155.stdout: "initiated_at": "2023-08-01T19:54:51.461520+0000", 2023-08-01T19:55:53.913 INFO:teuthology.orchestra.run.smithi155.stdout: "age": 62.426968664999997, 2023-08-01T19:55:53.914 INFO:teuthology.orchestra.run.smithi155.stdout: "duration": 0.023899916, 2023-08-01T19:55:53.914 INFO:teuthology.orchestra.run.smithi155.stdout: "type_data": { 2023-08-01T19:55:53.914 INFO:teuthology.orchestra.run.smithi155.stdout: "flag_point": "commit sent; apply or cleanup", 2023-08-01T19:55:53.914 INFO:teuthology.orchestra.run.smithi155.stdout: "client_info": { 2023-08-01T19:55:53.914 INFO:teuthology.orchestra.run.smithi155.stdout: "client": "client.4668", 2023-08-01T19:55:53.914 INFO:teuthology.orchestra.run.smithi155.stdout: "client_addr": "172.21.15.6:0/1709472247", 2023-08-01T19:55:53.914 INFO:teuthology.orchestra.run.smithi155.stdout: "tid": 73456 2023-08-01T19:55:53.914 INFO:teuthology.orchestra.run.smithi155.stdout: }, 2023-08-01T19:55:53.915 INFO:teuthology.orchestra.run.smithi155.stdout: "events": [ 2023-08-01T19:55:53.915 INFO:teuthology.orchestra.run.smithi155.stdout: { 2023-08-01T19:55:53.915 INFO:teuthology.orchestra.run.smithi155.stdout: "event": "initiated", 2023-08-01T19:55:53.915 INFO:teuthology.orchestra.run.smithi155.stdout: "time": "2023-08-01T19:54:51.461520+0000", 2023-08-01T19:55:53.915 INFO:teuthology.orchestra.run.smithi155.stdout: "duration": 0 2023-08-01T19:55:53.915 INFO:teuthology.orchestra.run.smithi155.stdout: }, 2023-08-01T19:55:53.915 INFO:teuthology.orchestra.run.smithi155.stdout: { 2023-08-01T19:55:53.915 INFO:teuthology.orchestra.run.smithi155.stdout: "event": "throttled", 2023-08-01T19:55:53.916 INFO:teuthology.orchestra.run.smithi155.stdout: "time": "2023-08-01T19:54:51.461520+0000", 2023-08-01T19:55:53.916 INFO:teuthology.orchestra.run.smithi155.stdout: "duration": 0 2023-08-01T19:55:53.916 INFO:teuthology.orchestra.run.smithi155.stdout: }, 2023-08-01T19:55:53.916 INFO:teuthology.orchestra.run.smithi155.stdout: { 2023-08-01T19:55:53.916 INFO:teuthology.orchestra.run.smithi155.stdout: "event": "header_read", 2023-08-01T19:55:53.916 INFO:teuthology.orchestra.run.smithi155.stdout: "time": "2023-08-01T19:54:51.461519+0000", 2023-08-01T19:55:53.916 INFO:teuthology.orchestra.run.smithi155.stdout: "duration": 4294967295.999999 2023-08-01T19:55:53.917 INFO:teuthology.orchestra.run.smithi155.stdout: }, 2023-08-01T19:55:53.917 INFO:teuthology.orchestra.run.smithi155.stdout: { 2023-08-01T19:55:53.917 INFO:teuthology.orchestra.run.smithi155.stdout: "event": "all_read", 2023-08-01T19:55:53.917 INFO:teuthology.orchestra.run.smithi155.stdout: "time": "2023-08-01T19:54:51.461633+0000", 2023-08-01T19:55:53.917 INFO:teuthology.orchestra.run.smithi155.stdout: "duration": 0.000114015 2023-08-01T19:55:53.917 INFO:teuthology.orchestra.run.smithi155.stdout: }, 2023-08-01T19:55:53.917 INFO:teuthology.orchestra.run.smithi155.stdout: { 2023-08-01T19:55:53.917 INFO:teuthology.orchestra.run.smithi155.stdout: "event": "dispatched", 2023-08-01T19:55:53.918 INFO:teuthology.orchestra.run.smithi155.stdout: "time": "2023-08-01T19:54:51.461643+0000", 2023-08-01T19:55:53.918 INFO:teuthology.orchestra.run.smithi155.stdout: "duration": 1.0217000000000001e-05 2023-08-01T19:55:53.918 INFO:teuthology.orchestra.run.smithi155.stdout: }, 2023-08-01T19:55:53.918 INFO:teuthology.orchestra.run.smithi155.stdout: { 2023-08-01T19:55:53.918 INFO:teuthology.orchestra.run.smithi155.stdout: "event": "queued_for_pg", 2023-08-01T19:55:53.918 INFO:teuthology.orchestra.run.smithi155.stdout: "time": "2023-08-01T19:54:51.461649+0000", 2023-08-01T19:55:53.918 INFO:teuthology.orchestra.run.smithi155.stdout: "duration": 5.8850000000000004e-06 2023-08-01T19:55:53.918 INFO:teuthology.orchestra.run.smithi155.stdout: }, 2023-08-01T19:55:53.919 INFO:teuthology.orchestra.run.smithi155.stdout: { 2023-08-01T19:55:53.919 INFO:teuthology.orchestra.run.smithi155.stdout: "event": "reached_pg", 2023-08-01T19:55:53.919 INFO:teuthology.orchestra.run.smithi155.stdout: "time": "2023-08-01T19:54:51.461686+0000", 2023-08-01T19:55:53.919 INFO:teuthology.orchestra.run.smithi155.stdout: "duration": 3.7319e-05 2023-08-01T19:55:53.919 INFO:teuthology.orchestra.run.smithi155.stdout: }, 2023-08-01T19:55:53.919 INFO:teuthology.orchestra.run.smithi155.stdout: { 2023-08-01T19:55:53.919 INFO:teuthology.orchestra.run.smithi155.stdout: "event": "started", 2023-08-01T19:55:53.919 INFO:teuthology.orchestra.run.smithi155.stdout: "time": "2023-08-01T19:54:51.461802+0000", 2023-08-01T19:55:53.920 INFO:teuthology.orchestra.run.smithi155.stdout: "duration": 0.000115604 2023-08-01T19:55:53.920 INFO:teuthology.orchestra.run.smithi155.stdout: }, 2023-08-01T19:55:53.920 INFO:teuthology.orchestra.run.smithi155.stdout: { 2023-08-01T19:55:53.920 INFO:teuthology.orchestra.run.smithi155.stdout: "event": "waiting for subops from 0", 2023-08-01T19:55:53.920 INFO:teuthology.orchestra.run.smithi155.stdout: "time": "2023-08-01T19:54:51.461933+0000", 2023-08-01T19:55:53.920 INFO:teuthology.orchestra.run.smithi155.stdout: "duration": 0.000131175 2023-08-01T19:55:53.920 INFO:teuthology.orchestra.run.smithi155.stdout: }, 2023-08-01T19:55:53.921 INFO:teuthology.orchestra.run.smithi155.stdout: { 2023-08-01T19:55:53.921 INFO:teuthology.orchestra.run.smithi155.stdout: "event": "sub_op_commit_rec", 2023-08-01T19:55:53.921 INFO:teuthology.orchestra.run.smithi155.stdout: "time": "2023-08-01T19:54:51.468411+0000", 2023-08-01T19:55:53.921 INFO:teuthology.orchestra.run.smithi155.stdout: "duration": 0.0064775850000000001 2023-08-01T19:55:53.921 INFO:teuthology.orchestra.run.smithi155.stdout: }, 2023-08-01T19:55:53.921 INFO:teuthology.orchestra.run.smithi155.stdout: { 2023-08-01T19:55:53.921 INFO:teuthology.orchestra.run.smithi155.stdout: "event": "op_commit", 2023-08-01T19:55:53.921 INFO:teuthology.orchestra.run.smithi155.stdout: "time": "2023-08-01T19:54:51.485340+0000", 2023-08-01T19:55:53.922 INFO:teuthology.orchestra.run.smithi155.stdout: "duration": 0.016928907 2023-08-01T19:55:53.922 INFO:teuthology.orchestra.run.smithi155.stdout: }, 2023-08-01T19:55:53.922 INFO:teuthology.orchestra.run.smithi155.stdout: { 2023-08-01T19:55:53.922 INFO:teuthology.orchestra.run.smithi155.stdout: "event": "commit_sent", 2023-08-01T19:55:53.922 INFO:teuthology.orchestra.run.smithi155.stdout: "time": "2023-08-01T19:54:51.485385+0000", 2023-08-01T19:55:53.922 INFO:teuthology.orchestra.run.smithi155.stdout: "duration": 4.5222000000000002e-05 2023-08-01T19:55:53.922 INFO:teuthology.orchestra.run.smithi155.stdout: }, 2023-08-01T19:55:53.922 INFO:teuthology.orchestra.run.smithi155.stdout: { 2023-08-01T19:55:53.923 INFO:teuthology.orchestra.run.smithi155.stdout: "event": "done", 2023-08-01T19:55:53.923 INFO:teuthology.orchestra.run.smithi155.stdout: "time": "2023-08-01T19:54:51.485420+0000", 2023-08-01T19:55:53.923 INFO:teuthology.orchestra.run.smithi155.stdout: "duration": 3.4717e-05 2023-08-01T19:55:53.923 INFO:teuthology.orchestra.run.smithi155.stdout: } 2023-08-01T19:55:53.923 INFO:teuthology.orchestra.run.smithi155.stdout: ] 2023-08-01T19:55:53.923 INFO:teuthology.orchestra.run.smithi155.stdout: } 2023-08-01T19:55:53.923 INFO:teuthology.orchestra.run.smithi155.stdout: }, 2023-08-01T19:55:53.923 INFO:teuthology.orchestra.run.smithi155.stdout: { 2023-08-01T19:55:53.924 INFO:teuthology.orchestra.run.smithi155.stdout: "description": "osd_op(client.4668.0:100237 5.4 5:2d68bec9:::benchmark_data_smithi006_114134_object100236:head [set-alloc-hint object_size 65536 write_size 65536,write 0~65536] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e37)", 2023-08-01T19:55:53.924 INFO:teuthology.orchestra.run.smithi155.stdout: "initiated_at": "2023-08-01T19:55:05.147736+0000", 2023-08-01T19:55:53.924 INFO:teuthology.orchestra.run.smithi155.stdout: "age": 48.740751951999997, 2023-08-01T19:55:53.924 INFO:teuthology.orchestra.run.smithi155.stdout: "duration": 0.071299464000000007, 2023-08-01T19:55:53.924 INFO:teuthology.orchestra.run.smithi155.stdout: "type_data": { 2023-08-01T19:55:53.924 INFO:teuthology.orchestra.run.smithi155.stdout: "flag_point": "commit sent; apply or cleanup", 2023-08-01T19:55:53.924 INFO:teuthology.orchestra.run.smithi155.stdout: "client_info": { 2023-08-01T19:55:53.924 INFO:teuthology.orchestra.run.smithi155.stdout: "client": "client.4668", 2023-08-01T19:55:53.925 INFO:teuthology.orchestra.run.smithi155.stdout: "client_addr": "172.21.15.6:0/1709472247", 2023-08-01T19:55:53.925 INFO:teuthology.orchestra.run.smithi155.stdout: "tid": 100237 2023-08-01T19:55:53.925 INFO:teuthology.orchestra.run.smithi155.stdout: }, 2023-08-01T19:55:53.925 INFO:teuthology.orchestra.run.smithi155.stdout: "events": [ 2023-08-01T19:55:53.925 INFO:teuthology.orchestra.run.smithi155.stdout: { 2023-08-01T19:55:53.925 INFO:teuthology.orchestra.run.smithi155.stdout: "event": "initiated", 2023-08-01T19:55:53.925 INFO:teuthology.orchestra.run.smithi155.stdout: "time": "2023-08-01T19:55:05.147736+0000", 2023-08-01T19:55:53.926 INFO:teuthology.orchestra.run.smithi155.stdout: "duration": 0 2023-08-01T19:55:53.926 INFO:teuthology.orchestra.run.smithi155.stdout: }, 2023-08-01T19:55:53.926 INFO:teuthology.orchestra.run.smithi155.stdout: { 2023-08-01T19:55:53.926 INFO:teuthology.orchestra.run.smithi155.stdout: "event": "throttled", 2023-08-01T19:55:53.926 INFO:teuthology.orchestra.run.smithi155.stdout: "time": "2023-08-01T19:55:05.147736+0000", 2023-08-01T19:55:53.926 INFO:teuthology.orchestra.run.smithi155.stdout: "duration": 0 2023-08-01T19:55:53.926 INFO:teuthology.orchestra.run.smithi155.stdout: }, 2023-08-01T19:55:53.926 INFO:teuthology.orchestra.run.smithi155.stdout: { 2023-08-01T19:55:53.927 INFO:teuthology.orchestra.run.smithi155.stdout: "event": "header_read", 2023-08-01T19:55:53.927 INFO:teuthology.orchestra.run.smithi155.stdout: "time": "2023-08-01T19:55:05.147736+0000", 2023-08-01T19:55:53.927 INFO:teuthology.orchestra.run.smithi155.stdout: "duration": 4294967295.9999995 2023-08-01T19:55:53.927 INFO:teuthology.orchestra.run.smithi155.stdout: }, 2023-08-01T19:55:53.927 INFO:teuthology.orchestra.run.smithi155.stdout: { 2023-08-01T19:55:53.927 INFO:teuthology.orchestra.run.smithi155.stdout: "event": "all_read", 2023-08-01T19:55:53.927 INFO:teuthology.orchestra.run.smithi155.stdout: "time": "2023-08-01T19:55:05.147766+0000", 2023-08-01T19:55:53.927 INFO:teuthology.orchestra.run.smithi155.stdout: "duration": 3.0394000000000001e-05 2023-08-01T19:55:53.928 INFO:teuthology.orchestra.run.smithi155.stdout: }, 2023-08-01T19:55:53.928 INFO:teuthology.orchestra.run.smithi155.stdout: { 2023-08-01T19:55:53.928 INFO:teuthology.orchestra.run.smithi155.stdout: "event": "dispatched", 2023-08-01T19:55:53.928 INFO:teuthology.orchestra.run.smithi155.stdout: "time": "2023-08-01T19:55:05.147771+0000", 2023-08-01T19:55:53.928 INFO:teuthology.orchestra.run.smithi155.stdout: "duration": 4.25e-06 2023-08-01T19:55:53.928 INFO:teuthology.orchestra.run.smithi155.stdout: }, 2023-08-01T19:55:53.928 INFO:teuthology.orchestra.run.smithi155.stdout: { 2023-08-01T19:55:53.928 INFO:teuthology.orchestra.run.smithi155.stdout: "event": "queued_for_pg", 2023-08-01T19:55:53.929 INFO:teuthology.orchestra.run.smithi155.stdout: "time": "2023-08-01T19:55:05.147773+0000", 2023-08-01T19:55:53.929 INFO:teuthology.orchestra.run.smithi155.stdout: "duration": 2.4159999999999998e-06 2023-08-01T19:55:53.929 INFO:teuthology.orchestra.run.smithi155.stdout: }, 2023-08-01T19:55:53.929 INFO:teuthology.orchestra.run.smithi155.stdout: { 2023-08-01T19:55:53.929 INFO:teuthology.orchestra.run.smithi155.stdout: "event": "reached_pg", 2023-08-01T19:55:53.929 INFO:teuthology.orchestra.run.smithi155.stdout: "time": "2023-08-01T19:55:05.149903+0000", 2023-08-01T19:55:53.929 INFO:teuthology.orchestra.run.smithi155.stdout: "duration": 0.002129948 2023-08-01T19:55:53.929 INFO:teuthology.orchestra.run.smithi155.stdout: }, 2023-08-01T19:55:53.930 INFO:teuthology.orchestra.run.smithi155.stdout: { 2023-08-01T19:55:53.930 INFO:teuthology.orchestra.run.smithi155.stdout: "event": "started", 2023-08-01T19:55:53.930 INFO:teuthology.orchestra.run.smithi155.stdout: "time": "2023-08-01T19:55:05.149982+0000", 2023-08-01T19:55:53.930 INFO:teuthology.orchestra.run.smithi155.stdout: "duration": 7.8706000000000002e-05 2023-08-01T19:55:53.930 INFO:teuthology.orchestra.run.smithi155.stdout: }, 2023-08-01T19:55:53.930 INFO:teuthology.orchestra.run.smithi155.stdout: { 2023-08-01T19:55:53.930 INFO:teuthology.orchestra.run.smithi155.stdout: "event": "waiting for subops from 0", 2023-08-01T19:55:53.930 INFO:teuthology.orchestra.run.smithi155.stdout: "time": "2023-08-01T19:55:05.150066+0000", 2023-08-01T19:55:53.931 INFO:teuthology.orchestra.run.smithi155.stdout: "duration": 8.4241999999999997e-05 2023-08-01T19:55:53.931 INFO:teuthology.orchestra.run.smithi155.stdout: }, 2023-08-01T19:55:53.931 INFO:teuthology.orchestra.run.smithi155.stdout: { 2023-08-01T19:55:53.931 INFO:teuthology.orchestra.run.smithi155.stdout: "event": "op_commit", 2023-08-01T19:55:53.931 INFO:teuthology.orchestra.run.smithi155.stdout: "time": "2023-08-01T19:55:05.154994+0000", 2023-08-01T19:55:53.931 INFO:teuthology.orchestra.run.smithi155.stdout: "duration": 0.0049277050000000001 2023-08-01T19:55:53.931 INFO:teuthology.orchestra.run.smithi155.stdout: }, 2023-08-01T19:55:53.931 INFO:teuthology.orchestra.run.smithi155.stdout: { 2023-08-01T19:55:53.932 INFO:teuthology.orchestra.run.smithi155.stdout: "event": "sub_op_commit_rec", 2023-08-01T19:55:53.932 INFO:teuthology.orchestra.run.smithi155.stdout: "time": "2023-08-01T19:55:05.218933+0000", 2023-08-01T19:55:53.932 INFO:teuthology.orchestra.run.smithi155.stdout: "duration": 0.063939916999999999 2023-08-01T19:55:53.932 INFO:teuthology.orchestra.run.smithi155.stdout: }, 2023-08-01T19:55:53.932 INFO:teuthology.orchestra.run.smithi155.stdout: { 2023-08-01T19:55:53.932 INFO:teuthology.orchestra.run.smithi155.stdout: "event": "commit_sent", 2023-08-01T19:55:53.932 INFO:teuthology.orchestra.run.smithi155.stdout: "time": "2023-08-01T19:55:05.218989+0000", 2023-08-01T19:55:53.933 INFO:teuthology.orchestra.run.smithi155.stdout: "duration": 5.5772000000000001e-05 2023-08-01T19:55:53.933 INFO:teuthology.orchestra.run.smithi155.stdout: }, 2023-08-01T19:55:53.933 INFO:teuthology.orchestra.run.smithi155.stdout: { 2023-08-01T19:55:53.933 INFO:teuthology.orchestra.run.smithi155.stdout: "event": "done", 2023-08-01T19:55:53.933 INFO:teuthology.orchestra.run.smithi155.stdout: "time": "2023-08-01T19:55:05.219036+0000", 2023-08-01T19:55:53.933 INFO:teuthology.orchestra.run.smithi155.stdout: "duration": 4.6526000000000001e-05 2023-08-01T19:55:53.933 INFO:teuthology.orchestra.run.smithi155.stdout: } 2023-08-01T19:55:53.933 INFO:teuthology.orchestra.run.smithi155.stdout: ] 2023-08-01T19:55:53.934 INFO:teuthology.orchestra.run.smithi155.stdout: } 2023-08-01T19:55:53.934 INFO:teuthology.orchestra.run.smithi155.stdout: }, 2023-08-01T19:55:53.934 INFO:teuthology.orchestra.run.smithi155.stdout: { 2023-08-01T19:55:53.934 INFO:teuthology.orchestra.run.smithi155.stdout: "description": "osd_op(client.4668.0:100242 5.8 5:16a314b8:::benchmark_data_smithi006_114134_object100241:head [set-alloc-hint object_size 65536 write_size 65536,write 0~65536] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e37)", 2023-08-01T19:55:53.934 INFO:teuthology.orchestra.run.smithi155.stdout: "initiated_at": "2023-08-01T19:55:05.150616+0000", 2023-08-01T19:55:53.934 INFO:teuthology.orchestra.run.smithi155.stdout: "age": 48.737872322000001, 2023-08-01T19:55:53.934 INFO:teuthology.orchestra.run.smithi155.stdout: "duration": 0.071105065999999995, 2023-08-01T19:55:53.934 INFO:teuthology.orchestra.run.smithi155.stdout: "type_data": { 2023-08-01T19:55:53.935 INFO:teuthology.orchestra.run.smithi155.stdout: "flag_point": "commit sent; apply or cleanup", 2023-08-01T19:55:53.935 INFO:teuthology.orchestra.run.smithi155.stdout: "client_info": { 2023-08-01T19:55:53.935 INFO:teuthology.orchestra.run.smithi155.stdout: "client": "client.4668", 2023-08-01T19:55:53.935 INFO:teuthology.orchestra.run.smithi155.stdout: "client_addr": "172.21.15.6:0/1709472247", 2023-08-01T19:55:53.935 INFO:teuthology.orchestra.run.smithi155.stdout: "tid": 100242 2023-08-01T19:55:53.935 INFO:teuthology.orchestra.run.smithi155.stdout: }, 2023-08-01T19:55:53.935 INFO:teuthology.orchestra.run.smithi155.stdout: "events": [ 2023-08-01T19:55:53.935 INFO:teuthology.orchestra.run.smithi155.stdout: { 2023-08-01T19:55:53.936 INFO:teuthology.orchestra.run.smithi155.stdout: "event": "initiated", 2023-08-01T19:55:53.936 INFO:teuthology.orchestra.run.smithi155.stdout: "time": "2023-08-01T19:55:05.150616+0000", 2023-08-01T19:55:53.936 INFO:teuthology.orchestra.run.smithi155.stdout: "duration": 0 2023-08-01T19:55:53.936 INFO:teuthology.orchestra.run.smithi155.stdout: }, 2023-08-01T19:55:53.936 INFO:teuthology.orchestra.run.smithi155.stdout: { 2023-08-01T19:55:53.936 INFO:teuthology.orchestra.run.smithi155.stdout: "event": "throttled", 2023-08-01T19:55:53.936 INFO:teuthology.orchestra.run.smithi155.stdout: "time": "2023-08-01T19:55:05.150616+0000", 2023-08-01T19:55:53.936 INFO:teuthology.orchestra.run.smithi155.stdout: "duration": 0 2023-08-01T19:55:53.937 INFO:teuthology.orchestra.run.smithi155.stdout: }, 2023-08-01T19:55:53.937 INFO:teuthology.orchestra.run.smithi155.stdout: { 2023-08-01T19:55:53.937 INFO:teuthology.orchestra.run.smithi155.stdout: "event": "header_read", 2023-08-01T19:55:53.937 INFO:teuthology.orchestra.run.smithi155.stdout: "time": "2023-08-01T19:55:05.150615+0000", 2023-08-01T19:55:53.937 INFO:teuthology.orchestra.run.smithi155.stdout: "duration": 4294967295.999999 2023-08-01T19:55:53.937 INFO:teuthology.orchestra.run.smithi155.stdout: }, 2023-08-01T19:55:53.937 INFO:teuthology.orchestra.run.smithi155.stdout: { 2023-08-01T19:55:53.937 INFO:teuthology.orchestra.run.smithi155.stdout: "event": "all_read", 2023-08-01T19:55:53.938 INFO:teuthology.orchestra.run.smithi155.stdout: "time": "2023-08-01T19:55:05.150696+0000", 2023-08-01T19:55:53.938 INFO:teuthology.orchestra.run.smithi155.stdout: "duration": 8.0852000000000004e-05 2023-08-01T19:55:53.938 INFO:teuthology.orchestra.run.smithi155.stdout: }, 2023-08-01T19:55:53.938 INFO:teuthology.orchestra.run.smithi155.stdout: { 2023-08-01T19:55:53.938 INFO:teuthology.orchestra.run.smithi155.stdout: "event": "dispatched", 2023-08-01T19:55:53.938 INFO:teuthology.orchestra.run.smithi155.stdout: "time": "2023-08-01T19:55:05.150708+0000", 2023-08-01T19:55:53.938 INFO:teuthology.orchestra.run.smithi155.stdout: "duration": 1.2116999999999999e-05 2023-08-01T19:55:53.938 INFO:teuthology.orchestra.run.smithi155.stdout: }, 2023-08-01T19:55:53.939 INFO:teuthology.orchestra.run.smithi155.stdout: { 2023-08-01T19:55:53.939 INFO:teuthology.orchestra.run.smithi155.stdout: "event": "queued_for_pg", 2023-08-01T19:55:53.939 INFO:teuthology.orchestra.run.smithi155.stdout: "time": "2023-08-01T19:55:05.150713+0000", 2023-08-01T19:55:53.939 INFO:teuthology.orchestra.run.smithi155.stdout: "duration": 5.4620000000000004e-06 2023-08-01T19:55:53.939 INFO:teuthology.orchestra.run.smithi155.stdout: }, 2023-08-01T19:55:53.939 INFO:teuthology.orchestra.run.smithi155.stdout: { 2023-08-01T19:55:53.939 INFO:teuthology.orchestra.run.smithi155.stdout: "event": "reached_pg", 2023-08-01T19:55:53.940 INFO:teuthology.orchestra.run.smithi155.stdout: "time": "2023-08-01T19:55:05.150761+0000", 2023-08-01T19:55:53.940 INFO:teuthology.orchestra.run.smithi155.stdout: "duration": 4.7429000000000003e-05 2023-08-01T19:55:53.940 INFO:teuthology.orchestra.run.smithi155.stdout: }, 2023-08-01T19:55:53.940 INFO:teuthology.orchestra.run.smithi155.stdout: { 2023-08-01T19:55:53.940 INFO:teuthology.orchestra.run.smithi155.stdout: "event": "started", 2023-08-01T19:55:53.940 INFO:teuthology.orchestra.run.smithi155.stdout: "time": "2023-08-01T19:55:05.150856+0000", 2023-08-01T19:55:53.940 INFO:teuthology.orchestra.run.smithi155.stdout: "duration": 9.5356e-05 2023-08-01T19:55:53.940 INFO:teuthology.orchestra.run.smithi155.stdout: }, 2023-08-01T19:55:53.941 INFO:teuthology.orchestra.run.smithi155.stdout: { 2023-08-01T19:55:53.941 INFO:teuthology.orchestra.run.smithi155.stdout: "event": "waiting for subops from 0", 2023-08-01T19:55:53.941 INFO:teuthology.orchestra.run.smithi155.stdout: "time": "2023-08-01T19:55:05.150999+0000", 2023-08-01T19:55:53.941 INFO:teuthology.orchestra.run.smithi155.stdout: "duration": 0.00014234499999999999 2023-08-01T19:55:53.941 INFO:teuthology.orchestra.run.smithi155.stdout: }, 2023-08-01T19:55:53.941 INFO:teuthology.orchestra.run.smithi155.stdout: { 2023-08-01T19:55:53.941 INFO:teuthology.orchestra.run.smithi155.stdout: "event": "sub_op_commit_rec", 2023-08-01T19:55:53.941 INFO:teuthology.orchestra.run.smithi155.stdout: "time": "2023-08-01T19:55:05.219001+0000", 2023-08-01T19:55:53.942 INFO:teuthology.orchestra.run.smithi155.stdout: "duration": 0.068002776000000001 2023-08-01T19:55:53.942 INFO:teuthology.orchestra.run.smithi155.stdout: }, 2023-08-01T19:55:53.942 INFO:teuthology.orchestra.run.smithi155.stdout: { 2023-08-01T19:55:53.942 INFO:teuthology.orchestra.run.smithi155.stdout: "event": "op_commit", 2023-08-01T19:55:53.942 INFO:teuthology.orchestra.run.smithi155.stdout: "time": "2023-08-01T19:55:05.221635+0000", 2023-08-01T19:55:53.942 INFO:teuthology.orchestra.run.smithi155.stdout: "duration": 0.0026340579999999999 2023-08-01T19:55:53.942 INFO:teuthology.orchestra.run.smithi155.stdout: }, 2023-08-01T19:55:53.942 INFO:teuthology.orchestra.run.smithi155.stdout: { 2023-08-01T19:55:53.943 INFO:teuthology.orchestra.run.smithi155.stdout: "event": "commit_sent", 2023-08-01T19:55:53.943 INFO:teuthology.orchestra.run.smithi155.stdout: "time": "2023-08-01T19:55:05.221682+0000", 2023-08-01T19:55:53.943 INFO:teuthology.orchestra.run.smithi155.stdout: "duration": 4.7123999999999998e-05 2023-08-01T19:55:53.943 INFO:teuthology.orchestra.run.smithi155.stdout: }, 2023-08-01T19:55:53.943 INFO:teuthology.orchestra.run.smithi155.stdout: { 2023-08-01T19:55:53.943 INFO:teuthology.orchestra.run.smithi155.stdout: "event": "done", 2023-08-01T19:55:53.943 INFO:teuthology.orchestra.run.smithi155.stdout: "time": "2023-08-01T19:55:05.221721+0000", 2023-08-01T19:55:53.943 INFO:teuthology.orchestra.run.smithi155.stdout: "duration": 3.8529999999999999e-05 2023-08-01T19:55:53.944 INFO:teuthology.orchestra.run.smithi155.stdout: } 2023-08-01T19:55:53.944 INFO:teuthology.orchestra.run.smithi155.stdout: ] 2023-08-01T19:55:53.944 INFO:teuthology.orchestra.run.smithi155.stdout: } 2023-08-01T19:55:53.944 INFO:teuthology.orchestra.run.smithi155.stdout: }, 2023-08-01T19:55:53.944 INFO:teuthology.orchestra.run.smithi155.stdout: { 2023-08-01T19:55:53.944 INFO:teuthology.orchestra.run.smithi155.stdout: "description": "osd_repop(client.4668.0:100240 5.a e37/19 5:5313c5b9:::benchmark_data_smithi006_114134_object100239:head v 37'6227, mlcod=37'6225)", 2023-08-01T19:55:53.944 INFO:teuthology.orchestra.run.smithi155.stdout: "initiated_at": "2023-08-01T19:55:05.150778+0000", 2023-08-01T19:55:53.945 INFO:teuthology.orchestra.run.smithi155.stdout: "age": 48.737710120999999, 2023-08-01T19:55:53.945 INFO:teuthology.orchestra.run.smithi155.stdout: "duration": 0.073362533999999993, 2023-08-01T19:55:53.945 INFO:teuthology.orchestra.run.smithi155.stdout: "type_data": { 2023-08-01T19:55:53.945 INFO:teuthology.orchestra.run.smithi155.stdout: "flag_point": "commit sent; apply or cleanup", 2023-08-01T19:55:53.945 INFO:teuthology.orchestra.run.smithi155.stdout: "events": [ 2023-08-01T19:55:53.945 INFO:teuthology.orchestra.run.smithi155.stdout: { 2023-08-01T19:55:53.945 INFO:teuthology.orchestra.run.smithi155.stdout: "event": "initiated", 2023-08-01T19:55:53.945 INFO:teuthology.orchestra.run.smithi155.stdout: "time": "2023-08-01T19:55:05.150778+0000", 2023-08-01T19:55:53.946 INFO:teuthology.orchestra.run.smithi155.stdout: "duration": 0 2023-08-01T19:55:53.946 INFO:teuthology.orchestra.run.smithi155.stdout: }, 2023-08-01T19:55:53.946 INFO:teuthology.orchestra.run.smithi155.stdout: { 2023-08-01T19:55:53.946 INFO:teuthology.orchestra.run.smithi155.stdout: "event": "throttled", 2023-08-01T19:55:53.946 INFO:teuthology.orchestra.run.smithi155.stdout: "time": "2023-08-01T19:55:05.150778+0000", 2023-08-01T19:55:53.946 INFO:teuthology.orchestra.run.smithi155.stdout: "duration": 0 2023-08-01T19:55:53.946 INFO:teuthology.orchestra.run.smithi155.stdout: }, 2023-08-01T19:55:53.946 INFO:teuthology.orchestra.run.smithi155.stdout: { 2023-08-01T19:55:53.947 INFO:teuthology.orchestra.run.smithi155.stdout: "event": "header_read", 2023-08-01T19:55:53.947 INFO:teuthology.orchestra.run.smithi155.stdout: "time": "2023-08-01T19:55:05.150778+0000", 2023-08-01T19:55:53.947 INFO:teuthology.orchestra.run.smithi155.stdout: "duration": 4294967295.9999995 2023-08-01T19:55:53.947 INFO:teuthology.orchestra.run.smithi155.stdout: }, 2023-08-01T19:55:53.947 INFO:teuthology.orchestra.run.smithi155.stdout: { 2023-08-01T19:55:53.947 INFO:teuthology.orchestra.run.smithi155.stdout: "event": "all_read", 2023-08-01T19:55:53.947 INFO:teuthology.orchestra.run.smithi155.stdout: "time": "2023-08-01T19:55:05.150811+0000", 2023-08-01T19:55:53.947 INFO:teuthology.orchestra.run.smithi155.stdout: "duration": 3.3664000000000002e-05 2023-08-01T19:55:53.948 INFO:teuthology.orchestra.run.smithi155.stdout: }, 2023-08-01T19:55:53.948 INFO:teuthology.orchestra.run.smithi155.stdout: { 2023-08-01T19:55:53.948 INFO:teuthology.orchestra.run.smithi155.stdout: "event": "dispatched", 2023-08-01T19:55:53.948 INFO:teuthology.orchestra.run.smithi155.stdout: "time": "2023-08-01T19:55:05.150818+0000", 2023-08-01T19:55:53.948 INFO:teuthology.orchestra.run.smithi155.stdout: "duration": 6.5769999999999999e-06 2023-08-01T19:55:53.948 INFO:teuthology.orchestra.run.smithi155.stdout: }, 2023-08-01T19:55:53.948 INFO:teuthology.orchestra.run.smithi155.stdout: { 2023-08-01T19:55:53.949 INFO:teuthology.orchestra.run.smithi155.stdout: "event": "queued_for_pg", 2023-08-01T19:55:53.949 INFO:teuthology.orchestra.run.smithi155.stdout: "time": "2023-08-01T19:55:05.150822+0000", 2023-08-01T19:55:53.949 INFO:teuthology.orchestra.run.smithi155.stdout: "duration": 4.0060000000000003e-06 2023-08-01T19:55:53.949 INFO:teuthology.orchestra.run.smithi155.stdout: }, 2023-08-01T19:55:53.949 INFO:teuthology.orchestra.run.smithi155.stdout: { 2023-08-01T19:55:53.949 INFO:teuthology.orchestra.run.smithi155.stdout: "event": "reached_pg", 2023-08-01T19:55:53.949 INFO:teuthology.orchestra.run.smithi155.stdout: "time": "2023-08-01T19:55:05.150855+0000", 2023-08-01T19:55:53.949 INFO:teuthology.orchestra.run.smithi155.stdout: "duration": 3.3204999999999998e-05 2023-08-01T19:55:53.950 INFO:teuthology.orchestra.run.smithi155.stdout: }, 2023-08-01T19:55:53.950 INFO:teuthology.orchestra.run.smithi155.stdout: { 2023-08-01T19:55:53.950 INFO:teuthology.orchestra.run.smithi155.stdout: "event": "started", 2023-08-01T19:55:53.950 INFO:teuthology.orchestra.run.smithi155.stdout: "time": "2023-08-01T19:55:05.150873+0000", 2023-08-01T19:55:53.950 INFO:teuthology.orchestra.run.smithi155.stdout: "duration": 1.8139999999999999e-05 2023-08-01T19:55:53.950 INFO:teuthology.orchestra.run.smithi155.stdout: }, 2023-08-01T19:55:53.950 INFO:teuthology.orchestra.run.smithi155.stdout: { 2023-08-01T19:55:53.950 INFO:teuthology.orchestra.run.smithi155.stdout: "event": "commit_sent", 2023-08-01T19:55:53.951 INFO:teuthology.orchestra.run.smithi155.stdout: "time": "2023-08-01T19:55:05.224095+0000", 2023-08-01T19:55:53.951 INFO:teuthology.orchestra.run.smithi155.stdout: "duration": 0.073221895999999995 2023-08-01T19:55:53.951 INFO:teuthology.orchestra.run.smithi155.stdout: }, 2023-08-01T19:55:53.951 INFO:teuthology.orchestra.run.smithi155.stdout: { 2023-08-01T19:55:53.951 INFO:teuthology.orchestra.run.smithi155.stdout: "event": "done", 2023-08-01T19:55:53.951 INFO:teuthology.orchestra.run.smithi155.stdout: "time": "2023-08-01T19:55:05.224141+0000", 2023-08-01T19:55:53.951 INFO:teuthology.orchestra.run.smithi155.stdout: "duration": 4.5385e-05 2023-08-01T19:55:53.951 INFO:teuthology.orchestra.run.smithi155.stdout: } 2023-08-01T19:55:53.952 INFO:teuthology.orchestra.run.smithi155.stdout: ] 2023-08-01T19:55:53.952 INFO:teuthology.orchestra.run.smithi155.stdout: } 2023-08-01T19:55:53.952 INFO:teuthology.orchestra.run.smithi155.stdout: }, 2023-08-01T19:55:53.952 INFO:teuthology.orchestra.run.smithi155.stdout: { 2023-08-01T19:55:53.952 INFO:teuthology.orchestra.run.smithi155.stdout: "description": "osd_op(client.4668.0:100245 5.e 5:71869c66:::benchmark_data_smithi006_114134_object100244:head [set-alloc-hint object_size 65536 write_size 65536,write 0~65536] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e37)", 2023-08-01T19:55:53.952 INFO:teuthology.orchestra.run.smithi155.stdout: "initiated_at": "2023-08-01T19:55:05.150991+0000", 2023-08-01T19:55:53.952 INFO:teuthology.orchestra.run.smithi155.stdout: "age": 48.737497333999997, 2023-08-01T19:55:53.952 INFO:teuthology.orchestra.run.smithi155.stdout: "duration": 0.070734490999999997, 2023-08-01T19:55:53.953 INFO:teuthology.orchestra.run.smithi155.stdout: "type_data": { 2023-08-01T19:55:53.953 INFO:teuthology.orchestra.run.smithi155.stdout: "flag_point": "commit sent; apply or cleanup", 2023-08-01T19:55:53.953 INFO:teuthology.orchestra.run.smithi155.stdout: "client_info": { 2023-08-01T19:55:53.953 INFO:teuthology.orchestra.run.smithi155.stdout: "client": "client.4668", 2023-08-01T19:55:53.953 INFO:teuthology.orchestra.run.smithi155.stdout: "client_addr": "172.21.15.6:0/1709472247", 2023-08-01T19:55:53.953 INFO:teuthology.orchestra.run.smithi155.stdout: "tid": 100245 2023-08-01T19:55:53.953 INFO:teuthology.orchestra.run.smithi155.stdout: }, 2023-08-01T19:55:53.953 INFO:teuthology.orchestra.run.smithi155.stdout: "events": [ 2023-08-01T19:55:53.954 INFO:teuthology.orchestra.run.smithi155.stdout: { 2023-08-01T19:55:53.954 INFO:teuthology.orchestra.run.smithi155.stdout: "event": "initiated", 2023-08-01T19:55:53.954 INFO:teuthology.orchestra.run.smithi155.stdout: "time": "2023-08-01T19:55:05.150991+0000", 2023-08-01T19:55:53.954 INFO:teuthology.orchestra.run.smithi155.stdout: "duration": 0 2023-08-01T19:55:53.954 INFO:teuthology.orchestra.run.smithi155.stdout: }, 2023-08-01T19:55:53.954 INFO:teuthology.orchestra.run.smithi155.stdout: { 2023-08-01T19:55:53.954 INFO:teuthology.orchestra.run.smithi155.stdout: "event": "throttled", 2023-08-01T19:55:53.955 INFO:teuthology.orchestra.run.smithi155.stdout: "time": "2023-08-01T19:55:05.150991+0000", 2023-08-01T19:55:53.955 INFO:teuthology.orchestra.run.smithi155.stdout: "duration": 0 2023-08-01T19:55:53.955 INFO:teuthology.orchestra.run.smithi155.stdout: }, 2023-08-01T19:55:53.955 INFO:teuthology.orchestra.run.smithi155.stdout: { 2023-08-01T19:55:53.955 INFO:teuthology.orchestra.run.smithi155.stdout: "event": "header_read", 2023-08-01T19:55:53.955 INFO:teuthology.orchestra.run.smithi155.stdout: "time": "2023-08-01T19:55:05.150990+0000", 2023-08-01T19:55:53.955 INFO:teuthology.orchestra.run.smithi155.stdout: "duration": 4294967295.999999 2023-08-01T19:55:53.955 INFO:teuthology.orchestra.run.smithi155.stdout: }, 2023-08-01T19:55:53.956 INFO:teuthology.orchestra.run.smithi155.stdout: { 2023-08-01T19:55:53.956 INFO:teuthology.orchestra.run.smithi155.stdout: "event": "all_read", 2023-08-01T19:55:53.956 INFO:teuthology.orchestra.run.smithi155.stdout: "time": "2023-08-01T19:55:05.151108+0000", 2023-08-01T19:55:53.956 INFO:teuthology.orchestra.run.smithi155.stdout: "duration": 0.00011849300000000001 2023-08-01T19:55:53.956 INFO:teuthology.orchestra.run.smithi155.stdout: }, 2023-08-01T19:55:53.956 INFO:teuthology.orchestra.run.smithi155.stdout: { 2023-08-01T19:55:53.956 INFO:teuthology.orchestra.run.smithi155.stdout: "event": "dispatched", 2023-08-01T19:55:53.956 INFO:teuthology.orchestra.run.smithi155.stdout: "time": "2023-08-01T19:55:05.151117+0000", 2023-08-01T19:55:53.957 INFO:teuthology.orchestra.run.smithi155.stdout: "duration": 8.1040000000000007e-06 2023-08-01T19:55:53.957 INFO:teuthology.orchestra.run.smithi155.stdout: }, 2023-08-01T19:55:53.957 INFO:teuthology.orchestra.run.smithi155.stdout: { 2023-08-01T19:55:53.957 INFO:teuthology.orchestra.run.smithi155.stdout: "event": "queued_for_pg", 2023-08-01T19:55:53.957 INFO:teuthology.orchestra.run.smithi155.stdout: "time": "2023-08-01T19:55:05.151121+0000", 2023-08-01T19:55:53.957 INFO:teuthology.orchestra.run.smithi155.stdout: "duration": 4.2019999999999997e-06 2023-08-01T19:55:53.957 INFO:teuthology.orchestra.run.smithi155.stdout: }, 2023-08-01T19:55:53.957 INFO:teuthology.orchestra.run.smithi155.stdout: { 2023-08-01T19:55:53.958 INFO:teuthology.orchestra.run.smithi155.stdout: "event": "reached_pg", 2023-08-01T19:55:53.958 INFO:teuthology.orchestra.run.smithi155.stdout: "time": "2023-08-01T19:55:05.151162+0000", 2023-08-01T19:55:53.958 INFO:teuthology.orchestra.run.smithi155.stdout: "duration": 4.1448e-05 2023-08-01T19:55:53.958 INFO:teuthology.orchestra.run.smithi155.stdout: }, 2023-08-01T19:55:53.958 INFO:teuthology.orchestra.run.smithi155.stdout: { 2023-08-01T19:55:53.958 INFO:teuthology.orchestra.run.smithi155.stdout: "event": "started", 2023-08-01T19:55:53.958 INFO:teuthology.orchestra.run.smithi155.stdout: "time": "2023-08-01T19:55:05.151281+0000", 2023-08-01T19:55:53.958 INFO:teuthology.orchestra.run.smithi155.stdout: "duration": 0.000119141 2023-08-01T19:55:53.959 INFO:teuthology.orchestra.run.smithi155.stdout: }, 2023-08-01T19:55:53.959 INFO:teuthology.orchestra.run.smithi155.stdout: { 2023-08-01T19:55:53.959 INFO:teuthology.orchestra.run.smithi155.stdout: "event": "waiting for subops from 0", 2023-08-01T19:55:53.959 INFO:teuthology.orchestra.run.smithi155.stdout: "time": "2023-08-01T19:55:05.151443+0000", 2023-08-01T19:55:53.959 INFO:teuthology.orchestra.run.smithi155.stdout: "duration": 0.00016181600000000001 2023-08-01T19:55:53.959 INFO:teuthology.orchestra.run.smithi155.stdout: }, 2023-08-01T19:55:53.959 INFO:teuthology.orchestra.run.smithi155.stdout: { 2023-08-01T19:55:53.959 INFO:teuthology.orchestra.run.smithi155.stdout: "event": "sub_op_commit_rec", 2023-08-01T19:55:53.960 INFO:teuthology.orchestra.run.smithi155.stdout: "time": "2023-08-01T19:55:05.219101+0000", 2023-08-01T19:55:53.960 INFO:teuthology.orchestra.run.smithi155.stdout: "duration": 0.067658037000000004 2023-08-01T19:55:53.960 INFO:teuthology.orchestra.run.smithi155.stdout: }, 2023-08-01T19:55:53.960 INFO:teuthology.orchestra.run.smithi155.stdout: { 2023-08-01T19:55:53.960 INFO:teuthology.orchestra.run.smithi155.stdout: "event": "op_commit", 2023-08-01T19:55:53.960 INFO:teuthology.orchestra.run.smithi155.stdout: "time": "2023-08-01T19:55:05.221646+0000", 2023-08-01T19:55:53.960 INFO:teuthology.orchestra.run.smithi155.stdout: "duration": 0.0025450540000000002 2023-08-01T19:55:53.960 INFO:teuthology.orchestra.run.smithi155.stdout: }, 2023-08-01T19:55:53.961 INFO:teuthology.orchestra.run.smithi155.stdout: { 2023-08-01T19:55:53.961 INFO:teuthology.orchestra.run.smithi155.stdout: "event": "commit_sent", 2023-08-01T19:55:53.961 INFO:teuthology.orchestra.run.smithi155.stdout: "time": "2023-08-01T19:55:05.221689+0000", 2023-08-01T19:55:53.961 INFO:teuthology.orchestra.run.smithi155.stdout: "duration": 4.3078999999999999e-05 2023-08-01T19:55:53.961 INFO:teuthology.orchestra.run.smithi155.stdout: }, 2023-08-01T19:55:53.961 INFO:teuthology.orchestra.run.smithi155.stdout: { 2023-08-01T19:55:53.961 INFO:teuthology.orchestra.run.smithi155.stdout: "event": "done", 2023-08-01T19:55:53.962 INFO:teuthology.orchestra.run.smithi155.stdout: "time": "2023-08-01T19:55:05.221725+0000", 2023-08-01T19:55:53.962 INFO:teuthology.orchestra.run.smithi155.stdout: "duration": 3.6137999999999999e-05 2023-08-01T19:55:53.962 INFO:teuthology.orchestra.run.smithi155.stdout: } 2023-08-01T19:55:53.962 INFO:teuthology.orchestra.run.smithi155.stdout: ] 2023-08-01T19:55:53.962 INFO:teuthology.orchestra.run.smithi155.stdout: } 2023-08-01T19:55:53.962 INFO:teuthology.orchestra.run.smithi155.stdout: }, 2023-08-01T19:55:53.962 INFO:teuthology.orchestra.run.smithi155.stdout: { 2023-08-01T19:55:53.962 INFO:teuthology.orchestra.run.smithi155.stdout: "description": "osd_repop(client.4668.0:100243 5.a e37/19 5:5e8193b6:::benchmark_data_smithi006_114134_object100242:head v 37'6228, mlcod=37'6225)", 2023-08-01T19:55:53.963 INFO:teuthology.orchestra.run.smithi155.stdout: "initiated_at": "2023-08-01T19:55:05.151148+0000", 2023-08-01T19:55:53.963 INFO:teuthology.orchestra.run.smithi155.stdout: "age": 48.737340322999998, 2023-08-01T19:55:53.963 INFO:teuthology.orchestra.run.smithi155.stdout: "duration": 0.073020370000000001, 2023-08-01T19:55:53.963 INFO:teuthology.orchestra.run.smithi155.stdout: "type_data": { 2023-08-01T19:55:53.963 INFO:teuthology.orchestra.run.smithi155.stdout: "flag_point": "commit sent; apply or cleanup", 2023-08-01T19:55:53.963 INFO:teuthology.orchestra.run.smithi155.stdout: "events": [ 2023-08-01T19:55:53.963 INFO:teuthology.orchestra.run.smithi155.stdout: { 2023-08-01T19:55:53.963 INFO:teuthology.orchestra.run.smithi155.stdout: "event": "initiated", 2023-08-01T19:55:53.964 INFO:teuthology.orchestra.run.smithi155.stdout: "time": "2023-08-01T19:55:05.151148+0000", 2023-08-01T19:55:53.964 INFO:teuthology.orchestra.run.smithi155.stdout: "duration": 0 2023-08-01T19:55:53.964 INFO:teuthology.orchestra.run.smithi155.stdout: }, 2023-08-01T19:55:53.964 INFO:teuthology.orchestra.run.smithi155.stdout: { 2023-08-01T19:55:53.964 INFO:teuthology.orchestra.run.smithi155.stdout: "event": "throttled", 2023-08-01T19:55:53.964 INFO:teuthology.orchestra.run.smithi155.stdout: "time": "2023-08-01T19:55:05.151148+0000", 2023-08-01T19:55:53.964 INFO:teuthology.orchestra.run.smithi155.stdout: "duration": 0 2023-08-01T19:55:53.964 INFO:teuthology.orchestra.run.smithi155.stdout: }, 2023-08-01T19:55:53.965 INFO:teuthology.orchestra.run.smithi155.stdout: { 2023-08-01T19:55:53.965 INFO:teuthology.orchestra.run.smithi155.stdout: "event": "header_read", 2023-08-01T19:55:53.965 INFO:teuthology.orchestra.run.smithi155.stdout: "time": "2023-08-01T19:55:05.151147+0000", 2023-08-01T19:55:53.965 INFO:teuthology.orchestra.run.smithi155.stdout: "duration": 4294967295.9999995 2023-08-01T19:55:53.965 INFO:teuthology.orchestra.run.smithi155.stdout: }, 2023-08-01T19:55:53.965 INFO:teuthology.orchestra.run.smithi155.stdout: { 2023-08-01T19:55:53.965 INFO:teuthology.orchestra.run.smithi155.stdout: "event": "all_read", 2023-08-01T19:55:53.966 INFO:teuthology.orchestra.run.smithi155.stdout: "time": "2023-08-01T19:55:05.151231+0000", 2023-08-01T19:55:53.966 INFO:teuthology.orchestra.run.smithi155.stdout: "duration": 8.3135999999999998e-05 2023-08-01T19:55:53.966 INFO:teuthology.orchestra.run.smithi155.stdout: }, 2023-08-01T19:55:53.966 INFO:teuthology.orchestra.run.smithi155.stdout: { 2023-08-01T19:55:53.966 INFO:teuthology.orchestra.run.smithi155.stdout: "event": "dispatched", 2023-08-01T19:55:53.966 INFO:teuthology.orchestra.run.smithi155.stdout: "time": "2023-08-01T19:55:05.151239+0000", 2023-08-01T19:55:53.966 INFO:teuthology.orchestra.run.smithi155.stdout: "duration": 8.7469999999999994e-06 2023-08-01T19:55:53.966 INFO:teuthology.orchestra.run.smithi155.stdout: }, 2023-08-01T19:55:53.967 INFO:teuthology.orchestra.run.smithi155.stdout: { 2023-08-01T19:55:53.967 INFO:teuthology.orchestra.run.smithi155.stdout: "event": "queued_for_pg", 2023-08-01T19:55:53.967 INFO:teuthology.orchestra.run.smithi155.stdout: "time": "2023-08-01T19:55:05.151244+0000", 2023-08-01T19:55:53.967 INFO:teuthology.orchestra.run.smithi155.stdout: "duration": 4.4800000000000003e-06 2023-08-01T19:55:53.967 INFO:teuthology.orchestra.run.smithi155.stdout: }, 2023-08-01T19:55:53.967 INFO:teuthology.orchestra.run.smithi155.stdout: { 2023-08-01T19:55:53.967 INFO:teuthology.orchestra.run.smithi155.stdout: "event": "reached_pg", 2023-08-01T19:55:53.967 INFO:teuthology.orchestra.run.smithi155.stdout: "time": "2023-08-01T19:55:05.152938+0000", 2023-08-01T19:55:53.968 INFO:teuthology.orchestra.run.smithi155.stdout: "duration": 0.001693824 2023-08-01T19:55:53.968 INFO:teuthology.orchestra.run.smithi155.stdout: }, 2023-08-01T19:55:53.968 INFO:teuthology.orchestra.run.smithi155.stdout: { 2023-08-01T19:55:53.968 INFO:teuthology.orchestra.run.smithi155.stdout: "event": "started", 2023-08-01T19:55:53.968 INFO:teuthology.orchestra.run.smithi155.stdout: "time": "2023-08-01T19:55:05.152956+0000", 2023-08-01T19:55:53.968 INFO:teuthology.orchestra.run.smithi155.stdout: "duration": 1.8287e-05 2023-08-01T19:55:53.968 INFO:teuthology.orchestra.run.smithi155.stdout: }, 2023-08-01T19:55:53.968 INFO:teuthology.orchestra.run.smithi155.stdout: { 2023-08-01T19:55:53.969 INFO:teuthology.orchestra.run.smithi155.stdout: "event": "commit_sent", 2023-08-01T19:55:53.969 INFO:teuthology.orchestra.run.smithi155.stdout: "time": "2023-08-01T19:55:05.224145+0000", 2023-08-01T19:55:53.969 INFO:teuthology.orchestra.run.smithi155.stdout: "duration": 0.071189447000000003 2023-08-01T19:55:53.969 INFO:teuthology.orchestra.run.smithi155.stdout: }, 2023-08-01T19:55:53.969 INFO:teuthology.orchestra.run.smithi155.stdout: { 2023-08-01T19:55:53.969 INFO:teuthology.orchestra.run.smithi155.stdout: "event": "done", 2023-08-01T19:55:53.969 INFO:teuthology.orchestra.run.smithi155.stdout: "time": "2023-08-01T19:55:05.224168+0000", 2023-08-01T19:55:53.969 INFO:teuthology.orchestra.run.smithi155.stdout: "duration": 2.3008999999999999e-05 2023-08-01T19:55:53.970 INFO:teuthology.orchestra.run.smithi155.stdout: } 2023-08-01T19:55:53.970 INFO:teuthology.orchestra.run.smithi155.stdout: ] 2023-08-01T19:55:53.970 INFO:teuthology.orchestra.run.smithi155.stdout: } 2023-08-01T19:55:53.970 INFO:teuthology.orchestra.run.smithi155.stdout: }, 2023-08-01T19:55:53.970 INFO:teuthology.orchestra.run.smithi155.stdout: { 2023-08-01T19:55:53.970 INFO:teuthology.orchestra.run.smithi155.stdout: "description": "osd_repop(client.4668.0:100244 5.9 e37/19 5:92f56a12:::benchmark_data_smithi006_114134_object100243:head v 37'6294, mlcod=37'6292)", 2023-08-01T19:55:53.970 INFO:teuthology.orchestra.run.smithi155.stdout: "initiated_at": "2023-08-01T19:55:05.151325+0000", 2023-08-01T19:55:53.970 INFO:teuthology.orchestra.run.smithi155.stdout: "age": 48.737162978000001, 2023-08-01T19:55:53.971 INFO:teuthology.orchestra.run.smithi155.stdout: "duration": 0.071883673999999995, 2023-08-01T19:55:53.971 INFO:teuthology.orchestra.run.smithi155.stdout: "type_data": { 2023-08-01T19:55:53.971 INFO:teuthology.orchestra.run.smithi155.stdout: "flag_point": "commit sent; apply or cleanup", 2023-08-01T19:55:53.971 INFO:teuthology.orchestra.run.smithi155.stdout: "events": [ 2023-08-01T19:55:53.971 INFO:teuthology.orchestra.run.smithi155.stdout: { 2023-08-01T19:55:53.971 INFO:teuthology.orchestra.run.smithi155.stdout: "event": "initiated", 2023-08-01T19:55:53.971 INFO:teuthology.orchestra.run.smithi155.stdout: "time": "2023-08-01T19:55:05.151325+0000", 2023-08-01T19:55:53.972 INFO:teuthology.orchestra.run.smithi155.stdout: "duration": 0 2023-08-01T19:55:53.972 INFO:teuthology.orchestra.run.smithi155.stdout: }, 2023-08-01T19:55:53.972 INFO:teuthology.orchestra.run.smithi155.stdout: { 2023-08-01T19:55:53.972 INFO:teuthology.orchestra.run.smithi155.stdout: "event": "throttled", 2023-08-01T19:55:53.972 INFO:teuthology.orchestra.run.smithi155.stdout: "time": "2023-08-01T19:55:05.151325+0000", 2023-08-01T19:55:53.972 INFO:teuthology.orchestra.run.smithi155.stdout: "duration": 0 2023-08-01T19:55:53.972 INFO:teuthology.orchestra.run.smithi155.stdout: }, 2023-08-01T19:55:53.972 INFO:teuthology.orchestra.run.smithi155.stdout: { 2023-08-01T19:55:53.973 INFO:teuthology.orchestra.run.smithi155.stdout: "event": "header_read", 2023-08-01T19:55:53.973 INFO:teuthology.orchestra.run.smithi155.stdout: "time": "2023-08-01T19:55:05.151325+0000", 2023-08-01T19:55:53.973 INFO:teuthology.orchestra.run.smithi155.stdout: "duration": 4294967295.9999995 2023-08-01T19:55:53.973 INFO:teuthology.orchestra.run.smithi155.stdout: }, 2023-08-01T19:55:53.973 INFO:teuthology.orchestra.run.smithi155.stdout: { 2023-08-01T19:55:53.973 INFO:teuthology.orchestra.run.smithi155.stdout: "event": "all_read", 2023-08-01T19:55:53.973 INFO:teuthology.orchestra.run.smithi155.stdout: "time": "2023-08-01T19:55:05.151390+0000", 2023-08-01T19:55:53.973 INFO:teuthology.orchestra.run.smithi155.stdout: "duration": 6.5456999999999993e-05 2023-08-01T19:55:53.974 INFO:teuthology.orchestra.run.smithi155.stdout: }, 2023-08-01T19:55:53.974 INFO:teuthology.orchestra.run.smithi155.stdout: { 2023-08-01T19:55:53.974 INFO:teuthology.orchestra.run.smithi155.stdout: "event": "dispatched", 2023-08-01T19:55:53.974 INFO:teuthology.orchestra.run.smithi155.stdout: "time": "2023-08-01T19:55:05.151396+0000", 2023-08-01T19:55:53.974 INFO:teuthology.orchestra.run.smithi155.stdout: "duration": 5.9190000000000004e-06 2023-08-01T19:55:53.974 INFO:teuthology.orchestra.run.smithi155.stdout: }, 2023-08-01T19:55:53.974 INFO:teuthology.orchestra.run.smithi155.stdout: { 2023-08-01T19:55:53.974 INFO:teuthology.orchestra.run.smithi155.stdout: "event": "queued_for_pg", 2023-08-01T19:55:53.975 INFO:teuthology.orchestra.run.smithi155.stdout: "time": "2023-08-01T19:55:05.151400+0000", 2023-08-01T19:55:53.975 INFO:teuthology.orchestra.run.smithi155.stdout: "duration": 4.1030000000000004e-06 2023-08-01T19:55:53.975 INFO:teuthology.orchestra.run.smithi155.stdout: }, 2023-08-01T19:55:53.975 INFO:teuthology.orchestra.run.smithi155.stdout: { 2023-08-01T19:55:53.975 INFO:teuthology.orchestra.run.smithi155.stdout: "event": "reached_pg", 2023-08-01T19:55:53.975 INFO:teuthology.orchestra.run.smithi155.stdout: "time": "2023-08-01T19:55:05.151452+0000", 2023-08-01T19:55:53.975 INFO:teuthology.orchestra.run.smithi155.stdout: "duration": 5.2136999999999999e-05 2023-08-01T19:55:53.975 INFO:teuthology.orchestra.run.smithi155.stdout: }, 2023-08-01T19:55:53.976 INFO:teuthology.orchestra.run.smithi155.stdout: { 2023-08-01T19:55:53.976 INFO:teuthology.orchestra.run.smithi155.stdout: "event": "started", 2023-08-01T19:55:53.976 INFO:teuthology.orchestra.run.smithi155.stdout: "time": "2023-08-01T19:55:05.151470+0000", 2023-08-01T19:55:53.976 INFO:teuthology.orchestra.run.smithi155.stdout: "duration": 1.8e-05 2023-08-01T19:55:53.976 INFO:teuthology.orchestra.run.smithi155.stdout: }, 2023-08-01T19:55:53.976 INFO:teuthology.orchestra.run.smithi155.stdout: { 2023-08-01T19:55:53.976 INFO:teuthology.orchestra.run.smithi155.stdout: "event": "commit_sent", 2023-08-01T19:55:53.976 INFO:teuthology.orchestra.run.smithi155.stdout: "time": "2023-08-01T19:55:05.223183+0000", 2023-08-01T19:55:53.977 INFO:teuthology.orchestra.run.smithi155.stdout: "duration": 0.071712622000000004 2023-08-01T19:55:53.977 INFO:teuthology.orchestra.run.smithi155.stdout: }, 2023-08-01T19:55:53.977 INFO:teuthology.orchestra.run.smithi155.stdout: { 2023-08-01T19:55:53.977 INFO:teuthology.orchestra.run.smithi155.stdout: "event": "done", 2023-08-01T19:55:53.977 INFO:teuthology.orchestra.run.smithi155.stdout: "time": "2023-08-01T19:55:05.223209+0000", 2023-08-01T19:55:53.977 INFO:teuthology.orchestra.run.smithi155.stdout: "duration": 2.5956e-05 2023-08-01T19:55:53.977 INFO:teuthology.orchestra.run.smithi155.stdout: } 2023-08-01T19:55:53.977 INFO:teuthology.orchestra.run.smithi155.stdout: ] 2023-08-01T19:55:53.978 INFO:teuthology.orchestra.run.smithi155.stdout: } 2023-08-01T19:55:53.978 INFO:teuthology.orchestra.run.smithi155.stdout: }, 2023-08-01T19:55:53.978 INFO:teuthology.orchestra.run.smithi155.stdout: { 2023-08-01T19:55:53.978 INFO:teuthology.orchestra.run.smithi155.stdout: "description": "osd_op(client.4668.0:100249 5.b 5:d0666827:::benchmark_data_smithi006_114134_object100248:head [set-alloc-hint object_size 65536 write_size 65536,write 0~65536] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e37)", 2023-08-01T19:55:53.978 INFO:teuthology.orchestra.run.smithi155.stdout: "initiated_at": "2023-08-01T19:55:05.153614+0000", 2023-08-01T19:55:53.978 INFO:teuthology.orchestra.run.smithi155.stdout: "age": 48.734874552999997, 2023-08-01T19:55:53.978 INFO:teuthology.orchestra.run.smithi155.stdout: "duration": 0.069286118999999993, 2023-08-01T19:55:53.979 INFO:teuthology.orchestra.run.smithi155.stdout: "type_data": { 2023-08-01T19:55:53.979 INFO:teuthology.orchestra.run.smithi155.stdout: "flag_point": "commit sent; apply or cleanup", 2023-08-01T19:55:53.979 INFO:teuthology.orchestra.run.smithi155.stdout: "client_info": { 2023-08-01T19:55:53.979 INFO:teuthology.orchestra.run.smithi155.stdout: "client": "client.4668", 2023-08-01T19:55:53.979 INFO:teuthology.orchestra.run.smithi155.stdout: "client_addr": "172.21.15.6:0/1709472247", 2023-08-01T19:55:53.979 INFO:teuthology.orchestra.run.smithi155.stdout: "tid": 100249 2023-08-01T19:55:53.979 INFO:teuthology.orchestra.run.smithi155.stdout: }, 2023-08-01T19:55:53.979 INFO:teuthology.orchestra.run.smithi155.stdout: "events": [ 2023-08-01T19:55:53.980 INFO:teuthology.orchestra.run.smithi155.stdout: { 2023-08-01T19:55:53.980 INFO:teuthology.orchestra.run.smithi155.stdout: "event": "initiated", 2023-08-01T19:55:53.980 INFO:teuthology.orchestra.run.smithi155.stdout: "time": "2023-08-01T19:55:05.153614+0000", 2023-08-01T19:55:53.980 INFO:teuthology.orchestra.run.smithi155.stdout: "duration": 0 2023-08-01T19:55:53.980 INFO:teuthology.orchestra.run.smithi155.stdout: }, 2023-08-01T19:55:53.980 INFO:teuthology.orchestra.run.smithi155.stdout: { 2023-08-01T19:55:53.980 INFO:teuthology.orchestra.run.smithi155.stdout: "event": "throttled", 2023-08-01T19:55:53.980 INFO:teuthology.orchestra.run.smithi155.stdout: "time": "2023-08-01T19:55:05.153614+0000", 2023-08-01T19:55:53.981 INFO:teuthology.orchestra.run.smithi155.stdout: "duration": 0 2023-08-01T19:55:53.981 INFO:teuthology.orchestra.run.smithi155.stdout: }, 2023-08-01T19:55:53.981 INFO:teuthology.orchestra.run.smithi155.stdout: { 2023-08-01T19:55:53.981 INFO:teuthology.orchestra.run.smithi155.stdout: "event": "header_read", 2023-08-01T19:55:53.981 INFO:teuthology.orchestra.run.smithi155.stdout: "time": "2023-08-01T19:55:05.153612+0000", 2023-08-01T19:55:53.981 INFO:teuthology.orchestra.run.smithi155.stdout: "duration": 4294967295.9999986 2023-08-01T19:55:53.981 INFO:teuthology.orchestra.run.smithi155.stdout: }, 2023-08-01T19:55:53.981 INFO:teuthology.orchestra.run.smithi155.stdout: { 2023-08-01T19:55:53.982 INFO:teuthology.orchestra.run.smithi155.stdout: "event": "all_read", 2023-08-01T19:55:53.982 INFO:teuthology.orchestra.run.smithi155.stdout: "time": "2023-08-01T19:55:05.153694+0000", 2023-08-01T19:55:53.982 INFO:teuthology.orchestra.run.smithi155.stdout: "duration": 8.1618000000000004e-05 2023-08-01T19:55:53.982 INFO:teuthology.orchestra.run.smithi155.stdout: }, 2023-08-01T19:55:53.982 INFO:teuthology.orchestra.run.smithi155.stdout: { 2023-08-01T19:55:53.982 INFO:teuthology.orchestra.run.smithi155.stdout: "event": "dispatched", 2023-08-01T19:55:53.982 INFO:teuthology.orchestra.run.smithi155.stdout: "time": "2023-08-01T19:55:05.153713+0000", 2023-08-01T19:55:53.983 INFO:teuthology.orchestra.run.smithi155.stdout: "duration": 1.9069999999999999e-05 2023-08-01T19:55:53.983 INFO:teuthology.orchestra.run.smithi155.stdout: }, 2023-08-01T19:55:53.983 INFO:teuthology.orchestra.run.smithi155.stdout: { 2023-08-01T19:55:53.983 INFO:teuthology.orchestra.run.smithi155.stdout: "event": "queued_for_pg", 2023-08-01T19:55:53.983 INFO:teuthology.orchestra.run.smithi155.stdout: "time": "2023-08-01T19:55:05.153726+0000", 2023-08-01T19:55:53.983 INFO:teuthology.orchestra.run.smithi155.stdout: "duration": 1.238e-05 2023-08-01T19:55:53.983 INFO:teuthology.orchestra.run.smithi155.stdout: }, 2023-08-01T19:55:53.983 INFO:teuthology.orchestra.run.smithi155.stdout: { 2023-08-01T19:55:53.984 INFO:teuthology.orchestra.run.smithi155.stdout: "event": "reached_pg", 2023-08-01T19:55:53.984 INFO:teuthology.orchestra.run.smithi155.stdout: "time": "2023-08-01T19:55:05.153761+0000", 2023-08-01T19:55:53.984 INFO:teuthology.orchestra.run.smithi155.stdout: "duration": 3.5046999999999998e-05 2023-08-01T19:55:53.984 INFO:teuthology.orchestra.run.smithi155.stdout: }, 2023-08-01T19:55:53.984 INFO:teuthology.orchestra.run.smithi155.stdout: { 2023-08-01T19:55:53.984 INFO:teuthology.orchestra.run.smithi155.stdout: "event": "started", 2023-08-01T19:55:53.984 INFO:teuthology.orchestra.run.smithi155.stdout: "time": "2023-08-01T19:55:05.153896+0000", 2023-08-01T19:55:53.984 INFO:teuthology.orchestra.run.smithi155.stdout: "duration": 0.00013575800000000001 2023-08-01T19:55:53.985 INFO:teuthology.orchestra.run.smithi155.stdout: }, 2023-08-01T19:55:53.985 INFO:teuthology.orchestra.run.smithi155.stdout: { 2023-08-01T19:55:53.985 INFO:teuthology.orchestra.run.smithi155.stdout: "event": "waiting for subops from 0", 2023-08-01T19:55:53.985 INFO:teuthology.orchestra.run.smithi155.stdout: "time": "2023-08-01T19:55:05.154043+0000", 2023-08-01T19:55:53.985 INFO:teuthology.orchestra.run.smithi155.stdout: "duration": 0.00014650700000000001 2023-08-01T19:55:53.985 INFO:teuthology.orchestra.run.smithi155.stdout: }, 2023-08-01T19:55:53.985 INFO:teuthology.orchestra.run.smithi155.stdout: { 2023-08-01T19:55:53.985 INFO:teuthology.orchestra.run.smithi155.stdout: "event": "sub_op_commit_rec", 2023-08-01T19:55:53.986 INFO:teuthology.orchestra.run.smithi155.stdout: "time": "2023-08-01T19:55:05.221876+0000", 2023-08-01T19:55:53.986 INFO:teuthology.orchestra.run.smithi155.stdout: "duration": 0.067832796000000001 2023-08-01T19:55:53.986 INFO:teuthology.orchestra.run.smithi155.stdout: }, 2023-08-01T19:55:53.986 INFO:teuthology.orchestra.run.smithi155.stdout: { 2023-08-01T19:55:53.986 INFO:teuthology.orchestra.run.smithi155.stdout: "event": "op_commit", 2023-08-01T19:55:53.986 INFO:teuthology.orchestra.run.smithi155.stdout: "time": "2023-08-01T19:55:05.222813+0000", 2023-08-01T19:55:53.986 INFO:teuthology.orchestra.run.smithi155.stdout: "duration": 0.00093755300000000004 2023-08-01T19:55:53.986 INFO:teuthology.orchestra.run.smithi155.stdout: }, 2023-08-01T19:55:53.987 INFO:teuthology.orchestra.run.smithi155.stdout: { 2023-08-01T19:55:53.987 INFO:teuthology.orchestra.run.smithi155.stdout: "event": "commit_sent", 2023-08-01T19:55:53.987 INFO:teuthology.orchestra.run.smithi155.stdout: "time": "2023-08-01T19:55:05.222861+0000", 2023-08-01T19:55:53.987 INFO:teuthology.orchestra.run.smithi155.stdout: "duration": 4.8013999999999998e-05 2023-08-01T19:55:53.987 INFO:teuthology.orchestra.run.smithi155.stdout: }, 2023-08-01T19:55:53.987 INFO:teuthology.orchestra.run.smithi155.stdout: { 2023-08-01T19:55:53.987 INFO:teuthology.orchestra.run.smithi155.stdout: "event": "done", 2023-08-01T19:55:53.987 INFO:teuthology.orchestra.run.smithi155.stdout: "time": "2023-08-01T19:55:05.222900+0000", 2023-08-01T19:55:53.988 INFO:teuthology.orchestra.run.smithi155.stdout: "duration": 3.8634999999999999e-05 2023-08-01T19:55:53.988 INFO:teuthology.orchestra.run.smithi155.stdout: } 2023-08-01T19:55:53.988 INFO:teuthology.orchestra.run.smithi155.stdout: ] 2023-08-01T19:55:53.988 INFO:teuthology.orchestra.run.smithi155.stdout: } 2023-08-01T19:55:53.988 INFO:teuthology.orchestra.run.smithi155.stdout: }, 2023-08-01T19:55:53.988 INFO:teuthology.orchestra.run.smithi155.stdout: { 2023-08-01T19:55:53.988 INFO:teuthology.orchestra.run.smithi155.stdout: "description": "osd_op(client.4668.0:100251 5.b 5:d853df24:::benchmark_data_smithi006_114134_object100250:head [set-alloc-hint object_size 65536 write_size 65536,write 0~65536] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e37)", 2023-08-01T19:55:53.989 INFO:teuthology.orchestra.run.smithi155.stdout: "initiated_at": "2023-08-01T19:55:05.153737+0000", 2023-08-01T19:55:53.989 INFO:teuthology.orchestra.run.smithi155.stdout: "age": 48.734751539000001, 2023-08-01T19:55:53.989 INFO:teuthology.orchestra.run.smithi155.stdout: "duration": 0.071366545000000003, 2023-08-01T19:55:53.989 INFO:teuthology.orchestra.run.smithi155.stdout: "type_data": { 2023-08-01T19:55:53.989 INFO:teuthology.orchestra.run.smithi155.stdout: "flag_point": "commit sent; apply or cleanup", 2023-08-01T19:55:53.989 INFO:teuthology.orchestra.run.smithi155.stdout: "client_info": { 2023-08-01T19:55:53.989 INFO:teuthology.orchestra.run.smithi155.stdout: "client": "client.4668", 2023-08-01T19:55:53.989 INFO:teuthology.orchestra.run.smithi155.stdout: "client_addr": "172.21.15.6:0/1709472247", 2023-08-01T19:55:53.990 INFO:teuthology.orchestra.run.smithi155.stdout: "tid": 100251 2023-08-01T19:55:53.990 INFO:teuthology.orchestra.run.smithi155.stdout: }, 2023-08-01T19:55:53.990 INFO:teuthology.orchestra.run.smithi155.stdout: "events": [ 2023-08-01T19:55:53.990 INFO:teuthology.orchestra.run.smithi155.stdout: { 2023-08-01T19:55:53.990 INFO:teuthology.orchestra.run.smithi155.stdout: "event": "initiated", 2023-08-01T19:55:53.990 INFO:teuthology.orchestra.run.smithi155.stdout: "time": "2023-08-01T19:55:05.153737+0000", 2023-08-01T19:55:53.990 INFO:teuthology.orchestra.run.smithi155.stdout: "duration": 0 2023-08-01T19:55:53.990 INFO:teuthology.orchestra.run.smithi155.stdout: }, 2023-08-01T19:55:53.991 INFO:teuthology.orchestra.run.smithi155.stdout: { 2023-08-01T19:55:53.991 INFO:teuthology.orchestra.run.smithi155.stdout: "event": "throttled", 2023-08-01T19:55:53.991 INFO:teuthology.orchestra.run.smithi155.stdout: "time": "2023-08-01T19:55:05.153737+0000", 2023-08-01T19:55:53.991 INFO:teuthology.orchestra.run.smithi155.stdout: "duration": 0 2023-08-01T19:55:53.991 INFO:teuthology.orchestra.run.smithi155.stdout: }, 2023-08-01T19:55:53.991 INFO:teuthology.orchestra.run.smithi155.stdout: { 2023-08-01T19:55:53.991 INFO:teuthology.orchestra.run.smithi155.stdout: "event": "header_read", 2023-08-01T19:55:53.991 INFO:teuthology.orchestra.run.smithi155.stdout: "time": "2023-08-01T19:55:05.153736+0000", 2023-08-01T19:55:53.992 INFO:teuthology.orchestra.run.smithi155.stdout: "duration": 4294967295.9999995 2023-08-01T19:55:53.992 INFO:teuthology.orchestra.run.smithi155.stdout: }, 2023-08-01T19:55:53.992 INFO:teuthology.orchestra.run.smithi155.stdout: { 2023-08-01T19:55:53.992 INFO:teuthology.orchestra.run.smithi155.stdout: "event": "all_read", 2023-08-01T19:55:53.992 INFO:teuthology.orchestra.run.smithi155.stdout: "time": "2023-08-01T19:55:05.153784+0000", 2023-08-01T19:55:53.992 INFO:teuthology.orchestra.run.smithi155.stdout: "duration": 4.7660000000000001e-05 2023-08-01T19:55:53.992 INFO:teuthology.orchestra.run.smithi155.stdout: }, 2023-08-01T19:55:53.993 INFO:teuthology.orchestra.run.smithi155.stdout: { 2023-08-01T19:55:53.993 INFO:teuthology.orchestra.run.smithi155.stdout: "event": "dispatched", 2023-08-01T19:55:53.993 INFO:teuthology.orchestra.run.smithi155.stdout: "time": "2023-08-01T19:55:05.153793+0000", 2023-08-01T19:55:53.993 INFO:teuthology.orchestra.run.smithi155.stdout: "duration": 8.7150000000000004e-06 2023-08-01T19:55:53.993 INFO:teuthology.orchestra.run.smithi155.stdout: }, 2023-08-01T19:55:53.993 INFO:teuthology.orchestra.run.smithi155.stdout: { 2023-08-01T19:55:53.993 INFO:teuthology.orchestra.run.smithi155.stdout: "event": "queued_for_pg", 2023-08-01T19:55:53.993 INFO:teuthology.orchestra.run.smithi155.stdout: "time": "2023-08-01T19:55:05.153800+0000", 2023-08-01T19:55:53.994 INFO:teuthology.orchestra.run.smithi155.stdout: "duration": 7.2459999999999997e-06 2023-08-01T19:55:53.994 INFO:teuthology.orchestra.run.smithi155.stdout: }, 2023-08-01T19:55:53.994 INFO:teuthology.orchestra.run.smithi155.stdout: { 2023-08-01T19:55:53.994 INFO:teuthology.orchestra.run.smithi155.stdout: "event": "reached_pg", 2023-08-01T19:55:53.994 INFO:teuthology.orchestra.run.smithi155.stdout: "time": "2023-08-01T19:55:05.156241+0000", 2023-08-01T19:55:53.994 INFO:teuthology.orchestra.run.smithi155.stdout: "duration": 0.0024415359999999998 2023-08-01T19:55:53.994 INFO:teuthology.orchestra.run.smithi155.stdout: }, 2023-08-01T19:55:53.994 INFO:teuthology.orchestra.run.smithi155.stdout: { 2023-08-01T19:55:53.995 INFO:teuthology.orchestra.run.smithi155.stdout: "event": "started", 2023-08-01T19:55:53.995 INFO:teuthology.orchestra.run.smithi155.stdout: "time": "2023-08-01T19:55:05.219045+0000", 2023-08-01T19:55:53.995 INFO:teuthology.orchestra.run.smithi155.stdout: "duration": 0.062803855000000006 2023-08-01T19:55:53.995 INFO:teuthology.orchestra.run.smithi155.stdout: }, 2023-08-01T19:55:53.995 INFO:teuthology.orchestra.run.smithi155.stdout: { 2023-08-01T19:55:53.995 INFO:teuthology.orchestra.run.smithi155.stdout: "event": "waiting for subops from 0", 2023-08-01T19:55:53.995 INFO:teuthology.orchestra.run.smithi155.stdout: "time": "2023-08-01T19:55:05.219238+0000", 2023-08-01T19:55:53.995 INFO:teuthology.orchestra.run.smithi155.stdout: "duration": 0.00019241500000000001 2023-08-01T19:55:53.996 INFO:teuthology.orchestra.run.smithi155.stdout: }, 2023-08-01T19:55:53.996 INFO:teuthology.orchestra.run.smithi155.stdout: { 2023-08-01T19:55:53.996 INFO:teuthology.orchestra.run.smithi155.stdout: "event": "sub_op_commit_rec", 2023-08-01T19:55:53.996 INFO:teuthology.orchestra.run.smithi155.stdout: "time": "2023-08-01T19:55:05.223300+0000", 2023-08-01T19:55:53.996 INFO:teuthology.orchestra.run.smithi155.stdout: "duration": 0.0040626509999999996 2023-08-01T19:55:53.996 INFO:teuthology.orchestra.run.smithi155.stdout: }, 2023-08-01T19:55:53.996 INFO:teuthology.orchestra.run.smithi155.stdout: { 2023-08-01T19:55:53.996 INFO:teuthology.orchestra.run.smithi155.stdout: "event": "op_commit", 2023-08-01T19:55:53.997 INFO:teuthology.orchestra.run.smithi155.stdout: "time": "2023-08-01T19:55:05.225020+0000", 2023-08-01T19:55:53.997 INFO:teuthology.orchestra.run.smithi155.stdout: "duration": 0.0017201 2023-08-01T19:55:53.997 INFO:teuthology.orchestra.run.smithi155.stdout: }, 2023-08-01T19:55:53.997 INFO:teuthology.orchestra.run.smithi155.stdout: { 2023-08-01T19:55:53.997 INFO:teuthology.orchestra.run.smithi155.stdout: "event": "commit_sent", 2023-08-01T19:55:53.997 INFO:teuthology.orchestra.run.smithi155.stdout: "time": "2023-08-01T19:55:05.225066+0000", 2023-08-01T19:55:53.997 INFO:teuthology.orchestra.run.smithi155.stdout: "duration": 4.6143000000000002e-05 2023-08-01T19:55:53.998 INFO:teuthology.orchestra.run.smithi155.stdout: }, 2023-08-01T19:55:53.998 INFO:teuthology.orchestra.run.smithi155.stdout: { 2023-08-01T19:55:53.998 INFO:teuthology.orchestra.run.smithi155.stdout: "event": "done", 2023-08-01T19:55:53.998 INFO:teuthology.orchestra.run.smithi155.stdout: "time": "2023-08-01T19:55:05.225103+0000", 2023-08-01T19:55:53.998 INFO:teuthology.orchestra.run.smithi155.stdout: "duration": 3.6789999999999998e-05 2023-08-01T19:55:53.998 INFO:teuthology.orchestra.run.smithi155.stdout: } 2023-08-01T19:55:53.998 INFO:teuthology.orchestra.run.smithi155.stdout: ] 2023-08-01T19:55:53.998 INFO:teuthology.orchestra.run.smithi155.stdout: } 2023-08-01T19:55:53.999 INFO:teuthology.orchestra.run.smithi155.stdout: }, 2023-08-01T19:55:53.999 INFO:teuthology.orchestra.run.smithi155.stdout: { 2023-08-01T19:55:53.999 INFO:teuthology.orchestra.run.smithi155.stdout: "description": "osd_op(client.4668.0:100252 5.0 5:01f90c3c:::benchmark_data_smithi006_114134_object100251:head [set-alloc-hint object_size 65536 write_size 65536,write 0~65536] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e37)", 2023-08-01T19:55:53.999 INFO:teuthology.orchestra.run.smithi155.stdout: "initiated_at": "2023-08-01T19:55:05.154048+0000", 2023-08-01T19:55:53.999 INFO:teuthology.orchestra.run.smithi155.stdout: "age": 48.734440292000002, 2023-08-01T19:55:53.999 INFO:teuthology.orchestra.run.smithi155.stdout: "duration": 0.070156683999999997, 2023-08-01T19:55:53.999 INFO:teuthology.orchestra.run.smithi155.stdout: "type_data": { 2023-08-01T19:55:53.999 INFO:teuthology.orchestra.run.smithi155.stdout: "flag_point": "commit sent; apply or cleanup", 2023-08-01T19:55:54.000 INFO:teuthology.orchestra.run.smithi155.stdout: "client_info": { 2023-08-01T19:55:54.000 INFO:teuthology.orchestra.run.smithi155.stdout: "client": "client.4668", 2023-08-01T19:55:54.000 INFO:teuthology.orchestra.run.smithi155.stdout: "client_addr": "172.21.15.6:0/1709472247", 2023-08-01T19:55:54.000 INFO:teuthology.orchestra.run.smithi155.stdout: "tid": 100252 2023-08-01T19:55:54.000 INFO:teuthology.orchestra.run.smithi155.stdout: }, 2023-08-01T19:55:54.000 INFO:teuthology.orchestra.run.smithi155.stdout: "events": [ 2023-08-01T19:55:54.000 INFO:teuthology.orchestra.run.smithi155.stdout: { 2023-08-01T19:55:54.000 INFO:teuthology.orchestra.run.smithi155.stdout: "event": "initiated", 2023-08-01T19:55:54.001 INFO:teuthology.orchestra.run.smithi155.stdout: "time": "2023-08-01T19:55:05.154048+0000", 2023-08-01T19:55:54.001 INFO:teuthology.orchestra.run.smithi155.stdout: "duration": 0 2023-08-01T19:55:54.001 INFO:teuthology.orchestra.run.smithi155.stdout: }, 2023-08-01T19:55:54.001 INFO:teuthology.orchestra.run.smithi155.stdout: { 2023-08-01T19:55:54.001 INFO:teuthology.orchestra.run.smithi155.stdout: "event": "throttled", 2023-08-01T19:55:54.001 INFO:teuthology.orchestra.run.smithi155.stdout: "time": "2023-08-01T19:55:05.154048+0000", 2023-08-01T19:55:54.001 INFO:teuthology.orchestra.run.smithi155.stdout: "duration": 0 2023-08-01T19:55:54.002 INFO:teuthology.orchestra.run.smithi155.stdout: }, 2023-08-01T19:55:54.002 INFO:teuthology.orchestra.run.smithi155.stdout: { 2023-08-01T19:55:54.002 INFO:teuthology.orchestra.run.smithi155.stdout: "event": "header_read", 2023-08-01T19:55:54.002 INFO:teuthology.orchestra.run.smithi155.stdout: "time": "2023-08-01T19:55:05.154047+0000", 2023-08-01T19:55:54.002 INFO:teuthology.orchestra.run.smithi155.stdout: "duration": 4294967295.999999 2023-08-01T19:55:54.002 INFO:teuthology.orchestra.run.smithi155.stdout: }, 2023-08-01T19:55:54.002 INFO:teuthology.orchestra.run.smithi155.stdout: { 2023-08-01T19:55:54.002 INFO:teuthology.orchestra.run.smithi155.stdout: "event": "all_read", 2023-08-01T19:55:54.003 INFO:teuthology.orchestra.run.smithi155.stdout: "time": "2023-08-01T19:55:05.154115+0000", 2023-08-01T19:55:54.003 INFO:teuthology.orchestra.run.smithi155.stdout: "duration": 6.7545999999999993e-05 2023-08-01T19:55:54.003 INFO:teuthology.orchestra.run.smithi155.stdout: }, 2023-08-01T19:55:54.003 INFO:teuthology.orchestra.run.smithi155.stdout: { 2023-08-01T19:55:54.003 INFO:teuthology.orchestra.run.smithi155.stdout: "event": "dispatched", 2023-08-01T19:55:54.003 INFO:teuthology.orchestra.run.smithi155.stdout: "time": "2023-08-01T19:55:05.154125+0000", 2023-08-01T19:55:54.003 INFO:teuthology.orchestra.run.smithi155.stdout: "duration": 1.0669000000000001e-05 2023-08-01T19:55:54.003 INFO:teuthology.orchestra.run.smithi155.stdout: }, 2023-08-01T19:55:54.004 INFO:teuthology.orchestra.run.smithi155.stdout: { 2023-08-01T19:55:54.004 INFO:teuthology.orchestra.run.smithi155.stdout: "event": "queued_for_pg", 2023-08-01T19:55:54.004 INFO:teuthology.orchestra.run.smithi155.stdout: "time": "2023-08-01T19:55:05.154131+0000", 2023-08-01T19:55:54.004 INFO:teuthology.orchestra.run.smithi155.stdout: "duration": 6.0349999999999998e-06 2023-08-01T19:55:54.004 INFO:teuthology.orchestra.run.smithi155.stdout: }, 2023-08-01T19:55:54.004 INFO:teuthology.orchestra.run.smithi155.stdout: { 2023-08-01T19:55:54.004 INFO:teuthology.orchestra.run.smithi155.stdout: "event": "reached_pg", 2023-08-01T19:55:54.004 INFO:teuthology.orchestra.run.smithi155.stdout: "time": "2023-08-01T19:55:05.154174+0000", 2023-08-01T19:55:54.005 INFO:teuthology.orchestra.run.smithi155.stdout: "duration": 4.2429000000000003e-05 2023-08-01T19:55:54.005 INFO:teuthology.orchestra.run.smithi155.stdout: }, 2023-08-01T19:55:54.005 INFO:teuthology.orchestra.run.smithi155.stdout: { 2023-08-01T19:55:54.005 INFO:teuthology.orchestra.run.smithi155.stdout: "event": "started", 2023-08-01T19:55:54.005 INFO:teuthology.orchestra.run.smithi155.stdout: "time": "2023-08-01T19:55:05.154287+0000", 2023-08-01T19:55:54.005 INFO:teuthology.orchestra.run.smithi155.stdout: "duration": 0.000113138 2023-08-01T19:55:54.005 INFO:teuthology.orchestra.run.smithi155.stdout: }, 2023-08-01T19:55:54.005 INFO:teuthology.orchestra.run.smithi155.stdout: { 2023-08-01T19:55:54.006 INFO:teuthology.orchestra.run.smithi155.stdout: "event": "waiting for subops from 0", 2023-08-01T19:55:54.006 INFO:teuthology.orchestra.run.smithi155.stdout: "time": "2023-08-01T19:55:05.154420+0000", 2023-08-01T19:55:54.006 INFO:teuthology.orchestra.run.smithi155.stdout: "duration": 0.000133292 2023-08-01T19:55:54.006 INFO:teuthology.orchestra.run.smithi155.stdout: }, 2023-08-01T19:55:54.006 INFO:teuthology.orchestra.run.smithi155.stdout: { 2023-08-01T19:55:54.006 INFO:teuthology.orchestra.run.smithi155.stdout: "event": "sub_op_commit_rec", 2023-08-01T19:55:54.006 INFO:teuthology.orchestra.run.smithi155.stdout: "time": "2023-08-01T19:55:05.219034+0000", 2023-08-01T19:55:54.006 INFO:teuthology.orchestra.run.smithi155.stdout: "duration": 0.064613429999999999 2023-08-01T19:55:54.007 INFO:teuthology.orchestra.run.smithi155.stdout: }, 2023-08-01T19:55:54.007 INFO:teuthology.orchestra.run.smithi155.stdout: { 2023-08-01T19:55:54.007 INFO:teuthology.orchestra.run.smithi155.stdout: "event": "op_commit", 2023-08-01T19:55:54.007 INFO:teuthology.orchestra.run.smithi155.stdout: "time": "2023-08-01T19:55:05.224138+0000", 2023-08-01T19:55:54.007 INFO:teuthology.orchestra.run.smithi155.stdout: "duration": 0.0051041999999999997 2023-08-01T19:55:54.007 INFO:teuthology.orchestra.run.smithi155.stdout: }, 2023-08-01T19:55:54.007 INFO:teuthology.orchestra.run.smithi155.stdout: { 2023-08-01T19:55:54.008 INFO:teuthology.orchestra.run.smithi155.stdout: "event": "commit_sent", 2023-08-01T19:55:54.008 INFO:teuthology.orchestra.run.smithi155.stdout: "time": "2023-08-01T19:55:05.224171+0000", 2023-08-01T19:55:54.008 INFO:teuthology.orchestra.run.smithi155.stdout: "duration": 3.3345e-05 2023-08-01T19:55:54.008 INFO:teuthology.orchestra.run.smithi155.stdout: }, 2023-08-01T19:55:54.008 INFO:teuthology.orchestra.run.smithi155.stdout: { 2023-08-01T19:55:54.008 INFO:teuthology.orchestra.run.smithi155.stdout: "event": "done", 2023-08-01T19:55:54.008 INFO:teuthology.orchestra.run.smithi155.stdout: "time": "2023-08-01T19:55:05.224205+0000", 2023-08-01T19:55:54.008 INFO:teuthology.orchestra.run.smithi155.stdout: "duration": 3.3525999999999997e-05 2023-08-01T19:55:54.009 INFO:teuthology.orchestra.run.smithi155.stdout: } 2023-08-01T19:55:54.009 INFO:teuthology.orchestra.run.smithi155.stdout: ] 2023-08-01T19:55:54.009 INFO:teuthology.orchestra.run.smithi155.stdout: } 2023-08-01T19:55:54.009 INFO:teuthology.orchestra.run.smithi155.stdout: }, 2023-08-01T19:55:54.009 INFO:teuthology.orchestra.run.smithi155.stdout: { 2023-08-01T19:55:54.009 INFO:teuthology.orchestra.run.smithi155.stdout: "description": "osd_repop_reply(client.4668.0:100237 5.4 e37/19 ondisk, result = 0)", 2023-08-01T19:55:54.009 INFO:teuthology.orchestra.run.smithi155.stdout: "initiated_at": "2023-08-01T19:55:05.156249+0000", 2023-08-01T19:55:54.009 INFO:teuthology.orchestra.run.smithi155.stdout: "age": 48.732239346999997, 2023-08-01T19:55:54.010 INFO:teuthology.orchestra.run.smithi155.stdout: "duration": 0.062792549000000003, 2023-08-01T19:55:54.010 INFO:teuthology.orchestra.run.smithi155.stdout: "type_data": { 2023-08-01T19:55:54.010 INFO:teuthology.orchestra.run.smithi155.stdout: "flag_point": "started", 2023-08-01T19:55:54.010 INFO:teuthology.orchestra.run.smithi155.stdout: "events": [ 2023-08-01T19:55:54.010 INFO:teuthology.orchestra.run.smithi155.stdout: { 2023-08-01T19:55:54.010 INFO:teuthology.orchestra.run.smithi155.stdout: "event": "initiated", 2023-08-01T19:55:54.010 INFO:teuthology.orchestra.run.smithi155.stdout: "time": "2023-08-01T19:55:05.156249+0000", 2023-08-01T19:55:54.010 INFO:teuthology.orchestra.run.smithi155.stdout: "duration": 0 2023-08-01T19:55:54.011 INFO:teuthology.orchestra.run.smithi155.stdout: }, 2023-08-01T19:55:54.011 INFO:teuthology.orchestra.run.smithi155.stdout: { 2023-08-01T19:55:54.011 INFO:teuthology.orchestra.run.smithi155.stdout: "event": "throttled", 2023-08-01T19:55:54.011 INFO:teuthology.orchestra.run.smithi155.stdout: "time": "2023-08-01T19:55:05.156249+0000", 2023-08-01T19:55:54.011 INFO:teuthology.orchestra.run.smithi155.stdout: "duration": 0 2023-08-01T19:55:54.011 INFO:teuthology.orchestra.run.smithi155.stdout: }, 2023-08-01T19:55:54.011 INFO:teuthology.orchestra.run.smithi155.stdout: { 2023-08-01T19:55:54.011 INFO:teuthology.orchestra.run.smithi155.stdout: "event": "header_read", 2023-08-01T19:55:54.012 INFO:teuthology.orchestra.run.smithi155.stdout: "time": "2023-08-01T19:55:05.156248+0000", 2023-08-01T19:55:54.012 INFO:teuthology.orchestra.run.smithi155.stdout: "duration": 4294967295.9999995 2023-08-01T19:55:54.012 INFO:teuthology.orchestra.run.smithi155.stdout: }, 2023-08-01T19:55:54.012 INFO:teuthology.orchestra.run.smithi155.stdout: { 2023-08-01T19:55:54.012 INFO:teuthology.orchestra.run.smithi155.stdout: "event": "all_read", 2023-08-01T19:55:54.012 INFO:teuthology.orchestra.run.smithi155.stdout: "time": "2023-08-01T19:55:05.156252+0000", 2023-08-01T19:55:54.012 INFO:teuthology.orchestra.run.smithi155.stdout: "duration": 3.9999999999999998e-06 2023-08-01T19:55:54.013 INFO:teuthology.orchestra.run.smithi155.stdout: }, 2023-08-01T19:55:54.013 INFO:teuthology.orchestra.run.smithi155.stdout: { 2023-08-01T19:55:54.013 INFO:teuthology.orchestra.run.smithi155.stdout: "event": "dispatched", 2023-08-01T19:55:54.013 INFO:teuthology.orchestra.run.smithi155.stdout: "time": "2023-08-01T19:55:05.218844+0000", 2023-08-01T19:55:54.013 INFO:teuthology.orchestra.run.smithi155.stdout: "duration": 0.062591516999999999 2023-08-01T19:55:54.013 INFO:teuthology.orchestra.run.smithi155.stdout: }, 2023-08-01T19:55:54.013 INFO:teuthology.orchestra.run.smithi155.stdout: { 2023-08-01T19:55:54.013 INFO:teuthology.orchestra.run.smithi155.stdout: "event": "queued_for_pg", 2023-08-01T19:55:54.014 INFO:teuthology.orchestra.run.smithi155.stdout: "time": "2023-08-01T19:55:05.218862+0000", 2023-08-01T19:55:54.014 INFO:teuthology.orchestra.run.smithi155.stdout: "duration": 1.7666e-05 2023-08-01T19:55:54.014 INFO:teuthology.orchestra.run.smithi155.stdout: }, 2023-08-01T19:55:54.014 INFO:teuthology.orchestra.run.smithi155.stdout: { 2023-08-01T19:55:54.014 INFO:teuthology.orchestra.run.smithi155.stdout: "event": "reached_pg", 2023-08-01T19:55:54.014 INFO:teuthology.orchestra.run.smithi155.stdout: "time": "2023-08-01T19:55:05.218914+0000", 2023-08-01T19:55:54.014 INFO:teuthology.orchestra.run.smithi155.stdout: "duration": 5.2565999999999998e-05 2023-08-01T19:55:54.014 INFO:teuthology.orchestra.run.smithi155.stdout: }, 2023-08-01T19:55:54.015 INFO:teuthology.orchestra.run.smithi155.stdout: { 2023-08-01T19:55:54.015 INFO:teuthology.orchestra.run.smithi155.stdout: "event": "started", 2023-08-01T19:55:54.015 INFO:teuthology.orchestra.run.smithi155.stdout: "time": "2023-08-01T19:55:05.218925+0000", 2023-08-01T19:55:54.015 INFO:teuthology.orchestra.run.smithi155.stdout: "duration": 1.1375e-05 2023-08-01T19:55:54.015 INFO:teuthology.orchestra.run.smithi155.stdout: }, 2023-08-01T19:55:54.015 INFO:teuthology.orchestra.run.smithi155.stdout: { 2023-08-01T19:55:54.015 INFO:teuthology.orchestra.run.smithi155.stdout: "event": "done", 2023-08-01T19:55:54.015 INFO:teuthology.orchestra.run.smithi155.stdout: "time": "2023-08-01T19:55:05.219041+0000", 2023-08-01T19:55:54.016 INFO:teuthology.orchestra.run.smithi155.stdout: "duration": 0.000115977 2023-08-01T19:55:54.016 INFO:teuthology.orchestra.run.smithi155.stdout: } 2023-08-01T19:55:54.016 INFO:teuthology.orchestra.run.smithi155.stdout: ] 2023-08-01T19:55:54.016 INFO:teuthology.orchestra.run.smithi155.stdout: } 2023-08-01T19:55:54.016 INFO:teuthology.orchestra.run.smithi155.stdout: }, 2023-08-01T19:55:54.016 INFO:teuthology.orchestra.run.smithi155.stdout: { 2023-08-01T19:55:54.016 INFO:teuthology.orchestra.run.smithi155.stdout: "description": "osd_repop(client.4668.0:100253 5.f e37/19 5:f7bbce05:::benchmark_data_smithi006_114134_object100252:head v 37'6323, mlcod=37'6321)", 2023-08-01T19:55:54.016 INFO:teuthology.orchestra.run.smithi155.stdout: "initiated_at": "2023-08-01T19:55:05.156952+0000", 2023-08-01T19:55:54.017 INFO:teuthology.orchestra.run.smithi155.stdout: "age": 48.731536284000001, 2023-08-01T19:55:54.017 INFO:teuthology.orchestra.run.smithi155.stdout: "duration": 0.068018577999999996, 2023-08-01T19:55:54.017 INFO:teuthology.orchestra.run.smithi155.stdout: "type_data": { 2023-08-01T19:55:54.017 INFO:teuthology.orchestra.run.smithi155.stdout: "flag_point": "commit sent; apply or cleanup", 2023-08-01T19:55:54.017 INFO:teuthology.orchestra.run.smithi155.stdout: "events": [ 2023-08-01T19:55:54.017 INFO:teuthology.orchestra.run.smithi155.stdout: { 2023-08-01T19:55:54.017 INFO:teuthology.orchestra.run.smithi155.stdout: "event": "initiated", 2023-08-01T19:55:54.018 INFO:teuthology.orchestra.run.smithi155.stdout: "time": "2023-08-01T19:55:05.156952+0000", 2023-08-01T19:55:54.018 INFO:teuthology.orchestra.run.smithi155.stdout: "duration": 0 2023-08-01T19:55:54.018 INFO:teuthology.orchestra.run.smithi155.stdout: }, 2023-08-01T19:55:54.018 INFO:teuthology.orchestra.run.smithi155.stdout: { 2023-08-01T19:55:54.018 INFO:teuthology.orchestra.run.smithi155.stdout: "event": "throttled", 2023-08-01T19:55:54.018 INFO:teuthology.orchestra.run.smithi155.stdout: "time": "2023-08-01T19:55:05.156952+0000", 2023-08-01T19:55:54.018 INFO:teuthology.orchestra.run.smithi155.stdout: "duration": 0 2023-08-01T19:55:54.018 INFO:teuthology.orchestra.run.smithi155.stdout: }, 2023-08-01T19:55:54.019 INFO:teuthology.orchestra.run.smithi155.stdout: { 2023-08-01T19:55:54.019 INFO:teuthology.orchestra.run.smithi155.stdout: "event": "header_read", 2023-08-01T19:55:54.019 INFO:teuthology.orchestra.run.smithi155.stdout: "time": "2023-08-01T19:55:05.156951+0000", 2023-08-01T19:55:54.019 INFO:teuthology.orchestra.run.smithi155.stdout: "duration": 4294967295.999999 2023-08-01T19:55:54.019 INFO:teuthology.orchestra.run.smithi155.stdout: }, 2023-08-01T19:55:54.019 INFO:teuthology.orchestra.run.smithi155.stdout: { 2023-08-01T19:55:54.019 INFO:teuthology.orchestra.run.smithi155.stdout: "event": "all_read", 2023-08-01T19:55:54.019 INFO:teuthology.orchestra.run.smithi155.stdout: "time": "2023-08-01T19:55:05.156989+0000", 2023-08-01T19:55:54.020 INFO:teuthology.orchestra.run.smithi155.stdout: "duration": 3.8175e-05 2023-08-01T19:55:54.020 INFO:teuthology.orchestra.run.smithi155.stdout: }, 2023-08-01T19:55:54.020 INFO:teuthology.orchestra.run.smithi155.stdout: { 2023-08-01T19:55:54.020 INFO:teuthology.orchestra.run.smithi155.stdout: "event": "dispatched", 2023-08-01T19:55:54.020 INFO:teuthology.orchestra.run.smithi155.stdout: "time": "2023-08-01T19:55:05.218842+0000", 2023-08-01T19:55:54.020 INFO:teuthology.orchestra.run.smithi155.stdout: "duration": 0.061852299999999999 2023-08-01T19:55:54.020 INFO:teuthology.orchestra.run.smithi155.stdout: }, 2023-08-01T19:55:54.020 INFO:teuthology.orchestra.run.smithi155.stdout: { 2023-08-01T19:55:54.021 INFO:teuthology.orchestra.run.smithi155.stdout: "event": "queued_for_pg", 2023-08-01T19:55:54.021 INFO:teuthology.orchestra.run.smithi155.stdout: "time": "2023-08-01T19:55:05.218862+0000", 2023-08-01T19:55:54.021 INFO:teuthology.orchestra.run.smithi155.stdout: "duration": 1.9854999999999999e-05 2023-08-01T19:55:54.021 INFO:teuthology.orchestra.run.smithi155.stdout: }, 2023-08-01T19:55:54.021 INFO:teuthology.orchestra.run.smithi155.stdout: { 2023-08-01T19:55:54.021 INFO:teuthology.orchestra.run.smithi155.stdout: "event": "reached_pg", 2023-08-01T19:55:54.021 INFO:teuthology.orchestra.run.smithi155.stdout: "time": "2023-08-01T19:55:05.218918+0000", 2023-08-01T19:55:54.021 INFO:teuthology.orchestra.run.smithi155.stdout: "duration": 5.6570000000000002e-05 2023-08-01T19:55:54.022 INFO:teuthology.orchestra.run.smithi155.stdout: }, 2023-08-01T19:55:54.022 INFO:teuthology.orchestra.run.smithi155.stdout: { 2023-08-01T19:55:54.022 INFO:teuthology.orchestra.run.smithi155.stdout: "event": "started", 2023-08-01T19:55:54.022 INFO:teuthology.orchestra.run.smithi155.stdout: "time": "2023-08-01T19:55:05.218940+0000", 2023-08-01T19:55:54.022 INFO:teuthology.orchestra.run.smithi155.stdout: "duration": 2.1804e-05 2023-08-01T19:55:54.022 INFO:teuthology.orchestra.run.smithi155.stdout: }, 2023-08-01T19:55:54.022 INFO:teuthology.orchestra.run.smithi155.stdout: { 2023-08-01T19:55:54.023 INFO:teuthology.orchestra.run.smithi155.stdout: "event": "commit_sent", 2023-08-01T19:55:54.023 INFO:teuthology.orchestra.run.smithi155.stdout: "time": "2023-08-01T19:55:05.224928+0000", 2023-08-01T19:55:54.023 INFO:teuthology.orchestra.run.smithi155.stdout: "duration": 0.0059876759999999999 2023-08-01T19:55:54.023 INFO:teuthology.orchestra.run.smithi155.stdout: }, 2023-08-01T19:55:54.023 INFO:teuthology.orchestra.run.smithi155.stdout: { 2023-08-01T19:55:54.023 INFO:teuthology.orchestra.run.smithi155.stdout: "event": "done", 2023-08-01T19:55:54.023 INFO:teuthology.orchestra.run.smithi155.stdout: "time": "2023-08-01T19:55:05.224971+0000", 2023-08-01T19:55:54.023 INFO:teuthology.orchestra.run.smithi155.stdout: "duration": 4.2929999999999997e-05 2023-08-01T19:55:54.024 INFO:teuthology.orchestra.run.smithi155.stdout: } 2023-08-01T19:55:54.024 INFO:teuthology.orchestra.run.smithi155.stdout: ] 2023-08-01T19:55:54.024 INFO:teuthology.orchestra.run.smithi155.stdout: } 2023-08-01T19:55:54.024 INFO:teuthology.orchestra.run.smithi155.stdout: }, 2023-08-01T19:55:54.024 INFO:teuthology.orchestra.run.smithi155.stdout: { 2023-08-01T19:55:54.024 INFO:teuthology.orchestra.run.smithi155.stdout: "description": "osd_op(client.4668.0:100927 5.0 5:00608ec6:::benchmark_data_smithi006_114134_object100926:head [set-alloc-hint object_size 65536 write_size 65536,write 0~65536] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e37)", 2023-08-01T19:55:54.024 INFO:teuthology.orchestra.run.smithi155.stdout: "initiated_at": "2023-08-01T19:55:05.561169+0000", 2023-08-01T19:55:54.024 INFO:teuthology.orchestra.run.smithi155.stdout: "age": 48.327319381000002, 2023-08-01T19:55:54.025 INFO:teuthology.orchestra.run.smithi155.stdout: "duration": 0.066411687999999997, 2023-08-01T19:55:54.025 INFO:teuthology.orchestra.run.smithi155.stdout: "type_data": { 2023-08-01T19:55:54.025 INFO:teuthology.orchestra.run.smithi155.stdout: "flag_point": "commit sent; apply or cleanup", 2023-08-01T19:55:54.025 INFO:teuthology.orchestra.run.smithi155.stdout: "client_info": { 2023-08-01T19:55:54.025 INFO:teuthology.orchestra.run.smithi155.stdout: "client": "client.4668", 2023-08-01T19:55:54.025 INFO:teuthology.orchestra.run.smithi155.stdout: "client_addr": "172.21.15.6:0/1709472247", 2023-08-01T19:55:54.025 INFO:teuthology.orchestra.run.smithi155.stdout: "tid": 100927 2023-08-01T19:55:54.025 INFO:teuthology.orchestra.run.smithi155.stdout: }, 2023-08-01T19:55:54.026 INFO:teuthology.orchestra.run.smithi155.stdout: "events": [ 2023-08-01T19:55:54.026 INFO:teuthology.orchestra.run.smithi155.stdout: { 2023-08-01T19:55:54.026 INFO:teuthology.orchestra.run.smithi155.stdout: "event": "initiated", 2023-08-01T19:55:54.026 INFO:teuthology.orchestra.run.smithi155.stdout: "time": "2023-08-01T19:55:05.561169+0000", 2023-08-01T19:55:54.026 INFO:teuthology.orchestra.run.smithi155.stdout: "duration": 0 2023-08-01T19:55:54.026 INFO:teuthology.orchestra.run.smithi155.stdout: }, 2023-08-01T19:55:54.026 INFO:teuthology.orchestra.run.smithi155.stdout: { 2023-08-01T19:55:54.026 INFO:teuthology.orchestra.run.smithi155.stdout: "event": "throttled", 2023-08-01T19:55:54.027 INFO:teuthology.orchestra.run.smithi155.stdout: "time": "2023-08-01T19:55:05.561169+0000", 2023-08-01T19:55:54.027 INFO:teuthology.orchestra.run.smithi155.stdout: "duration": 0 2023-08-01T19:55:54.027 INFO:teuthology.orchestra.run.smithi155.stdout: }, 2023-08-01T19:55:54.027 INFO:teuthology.orchestra.run.smithi155.stdout: { 2023-08-01T19:55:54.027 INFO:teuthology.orchestra.run.smithi155.stdout: "event": "header_read", 2023-08-01T19:55:54.027 INFO:teuthology.orchestra.run.smithi155.stdout: "time": "2023-08-01T19:55:05.561168+0000", 2023-08-01T19:55:54.027 INFO:teuthology.orchestra.run.smithi155.stdout: "duration": 4294967295.9999995 2023-08-01T19:55:54.027 INFO:teuthology.orchestra.run.smithi155.stdout: }, 2023-08-01T19:55:54.028 INFO:teuthology.orchestra.run.smithi155.stdout: { 2023-08-01T19:55:54.028 INFO:teuthology.orchestra.run.smithi155.stdout: "event": "all_read", 2023-08-01T19:55:54.028 INFO:teuthology.orchestra.run.smithi155.stdout: "time": "2023-08-01T19:55:05.561218+0000", 2023-08-01T19:55:54.028 INFO:teuthology.orchestra.run.smithi155.stdout: "duration": 4.9379999999999998e-05 2023-08-01T19:55:54.028 INFO:teuthology.orchestra.run.smithi155.stdout: }, 2023-08-01T19:55:54.028 INFO:teuthology.orchestra.run.smithi155.stdout: { 2023-08-01T19:55:54.028 INFO:teuthology.orchestra.run.smithi155.stdout: "event": "dispatched", 2023-08-01T19:55:54.029 INFO:teuthology.orchestra.run.smithi155.stdout: "time": "2023-08-01T19:55:05.561225+0000", 2023-08-01T19:55:54.029 INFO:teuthology.orchestra.run.smithi155.stdout: "duration": 7.114e-06 2023-08-01T19:55:54.029 INFO:teuthology.orchestra.run.smithi155.stdout: }, 2023-08-01T19:55:54.029 INFO:teuthology.orchestra.run.smithi155.stdout: { 2023-08-01T19:55:54.029 INFO:teuthology.orchestra.run.smithi155.stdout: "event": "queued_for_pg", 2023-08-01T19:55:54.029 INFO:teuthology.orchestra.run.smithi155.stdout: "time": "2023-08-01T19:55:05.561229+0000", 2023-08-01T19:55:54.029 INFO:teuthology.orchestra.run.smithi155.stdout: "duration": 4.2180000000000001e-06 2023-08-01T19:55:54.029 INFO:teuthology.orchestra.run.smithi155.stdout: }, 2023-08-01T19:55:54.030 INFO:teuthology.orchestra.run.smithi155.stdout: { 2023-08-01T19:55:54.030 INFO:teuthology.orchestra.run.smithi155.stdout: "event": "reached_pg", 2023-08-01T19:55:54.030 INFO:teuthology.orchestra.run.smithi155.stdout: "time": "2023-08-01T19:55:05.564737+0000", 2023-08-01T19:55:54.030 INFO:teuthology.orchestra.run.smithi155.stdout: "duration": 0.0035081869999999999 2023-08-01T19:55:54.030 INFO:teuthology.orchestra.run.smithi155.stdout: }, 2023-08-01T19:55:54.030 INFO:teuthology.orchestra.run.smithi155.stdout: { 2023-08-01T19:55:54.030 INFO:teuthology.orchestra.run.smithi155.stdout: "event": "started", 2023-08-01T19:55:54.030 INFO:teuthology.orchestra.run.smithi155.stdout: "time": "2023-08-01T19:55:05.564859+0000", 2023-08-01T19:55:54.031 INFO:teuthology.orchestra.run.smithi155.stdout: "duration": 0.00012165800000000001 2023-08-01T19:55:54.031 INFO:teuthology.orchestra.run.smithi155.stdout: }, 2023-08-01T19:55:54.031 INFO:teuthology.orchestra.run.smithi155.stdout: { 2023-08-01T19:55:54.031 INFO:teuthology.orchestra.run.smithi155.stdout: "event": "waiting for subops from 0", 2023-08-01T19:55:54.031 INFO:teuthology.orchestra.run.smithi155.stdout: "time": "2023-08-01T19:55:05.565009+0000", 2023-08-01T19:55:54.031 INFO:teuthology.orchestra.run.smithi155.stdout: "duration": 0.00014979699999999999 2023-08-01T19:55:54.031 INFO:teuthology.orchestra.run.smithi155.stdout: }, 2023-08-01T19:55:54.031 INFO:teuthology.orchestra.run.smithi155.stdout: { 2023-08-01T19:55:54.032 INFO:teuthology.orchestra.run.smithi155.stdout: "event": "op_commit", 2023-08-01T19:55:54.032 INFO:teuthology.orchestra.run.smithi155.stdout: "time": "2023-08-01T19:55:05.568007+0000", 2023-08-01T19:55:54.032 INFO:teuthology.orchestra.run.smithi155.stdout: "duration": 0.00299796 2023-08-01T19:55:54.032 INFO:teuthology.orchestra.run.smithi155.stdout: }, 2023-08-01T19:55:54.032 INFO:teuthology.orchestra.run.smithi155.stdout: { 2023-08-01T19:55:54.032 INFO:teuthology.orchestra.run.smithi155.stdout: "event": "sub_op_commit_rec", 2023-08-01T19:55:54.032 INFO:teuthology.orchestra.run.smithi155.stdout: "time": "2023-08-01T19:55:05.627520+0000", 2023-08-01T19:55:54.032 INFO:teuthology.orchestra.run.smithi155.stdout: "duration": 0.059513636000000002 2023-08-01T19:55:54.033 INFO:teuthology.orchestra.run.smithi155.stdout: }, 2023-08-01T19:55:54.033 INFO:teuthology.orchestra.run.smithi155.stdout: { 2023-08-01T19:55:54.033 INFO:teuthology.orchestra.run.smithi155.stdout: "event": "commit_sent", 2023-08-01T19:55:54.033 INFO:teuthology.orchestra.run.smithi155.stdout: "time": "2023-08-01T19:55:05.627553+0000", 2023-08-01T19:55:54.033 INFO:teuthology.orchestra.run.smithi155.stdout: "duration": 3.2635999999999997e-05 2023-08-01T19:55:54.033 INFO:teuthology.orchestra.run.smithi155.stdout: }, 2023-08-01T19:55:54.033 INFO:teuthology.orchestra.run.smithi155.stdout: { 2023-08-01T19:55:54.033 INFO:teuthology.orchestra.run.smithi155.stdout: "event": "done", 2023-08-01T19:55:54.034 INFO:teuthology.orchestra.run.smithi155.stdout: "time": "2023-08-01T19:55:05.627581+0000", 2023-08-01T19:55:54.034 INFO:teuthology.orchestra.run.smithi155.stdout: "duration": 2.7681000000000001e-05 2023-08-01T19:55:54.034 INFO:teuthology.orchestra.run.smithi155.stdout: } 2023-08-01T19:55:54.034 INFO:teuthology.orchestra.run.smithi155.stdout: ] 2023-08-01T19:55:54.034 INFO:teuthology.orchestra.run.smithi155.stdout: } 2023-08-01T19:55:54.034 INFO:teuthology.orchestra.run.smithi155.stdout: }, 2023-08-01T19:55:54.034 INFO:teuthology.orchestra.run.smithi155.stdout: { 2023-08-01T19:55:54.034 INFO:teuthology.orchestra.run.smithi155.stdout: "description": "osd_op(client.4668.0:100935 5.e 5:7895b14e:::benchmark_data_smithi006_114134_object100934:head [set-alloc-hint object_size 65536 write_size 65536,write 0~65536] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e37)", 2023-08-01T19:55:54.035 INFO:teuthology.orchestra.run.smithi155.stdout: "initiated_at": "2023-08-01T19:55:05.566666+0000", 2023-08-01T19:55:54.035 INFO:teuthology.orchestra.run.smithi155.stdout: "age": 48.321822081000001, 2023-08-01T19:55:54.035 INFO:teuthology.orchestra.run.smithi155.stdout: "duration": 0.064309016999999996, 2023-08-01T19:55:54.035 INFO:teuthology.orchestra.run.smithi155.stdout: "type_data": { 2023-08-01T19:55:54.035 INFO:teuthology.orchestra.run.smithi155.stdout: "flag_point": "commit sent; apply or cleanup", 2023-08-01T19:55:54.035 INFO:teuthology.orchestra.run.smithi155.stdout: "client_info": { 2023-08-01T19:55:54.035 INFO:teuthology.orchestra.run.smithi155.stdout: "client": "client.4668", 2023-08-01T19:55:54.036 INFO:teuthology.orchestra.run.smithi155.stdout: "client_addr": "172.21.15.6:0/1709472247", 2023-08-01T19:55:54.036 INFO:teuthology.orchestra.run.smithi155.stdout: "tid": 100935 2023-08-01T19:55:54.036 INFO:teuthology.orchestra.run.smithi155.stdout: }, 2023-08-01T19:55:54.036 INFO:teuthology.orchestra.run.smithi155.stdout: "events": [ 2023-08-01T19:55:54.036 INFO:teuthology.orchestra.run.smithi155.stdout: { 2023-08-01T19:55:54.036 INFO:teuthology.orchestra.run.smithi155.stdout: "event": "initiated", 2023-08-01T19:55:54.036 INFO:teuthology.orchestra.run.smithi155.stdout: "time": "2023-08-01T19:55:05.566666+0000", 2023-08-01T19:55:54.036 INFO:teuthology.orchestra.run.smithi155.stdout: "duration": 0 2023-08-01T19:55:54.037 INFO:teuthology.orchestra.run.smithi155.stdout: }, 2023-08-01T19:55:54.037 INFO:teuthology.orchestra.run.smithi155.stdout: { 2023-08-01T19:55:54.037 INFO:teuthology.orchestra.run.smithi155.stdout: "event": "throttled", 2023-08-01T19:55:54.037 INFO:teuthology.orchestra.run.smithi155.stdout: "time": "2023-08-01T19:55:05.566666+0000", 2023-08-01T19:55:54.037 INFO:teuthology.orchestra.run.smithi155.stdout: "duration": 0 2023-08-01T19:55:54.037 INFO:teuthology.orchestra.run.smithi155.stdout: }, 2023-08-01T19:55:54.037 INFO:teuthology.orchestra.run.smithi155.stdout: { 2023-08-01T19:55:54.037 INFO:teuthology.orchestra.run.smithi155.stdout: "event": "header_read", 2023-08-01T19:55:54.038 INFO:teuthology.orchestra.run.smithi155.stdout: "time": "2023-08-01T19:55:05.566665+0000", 2023-08-01T19:55:54.038 INFO:teuthology.orchestra.run.smithi155.stdout: "duration": 4294967295.9999986 2023-08-01T19:55:54.038 INFO:teuthology.orchestra.run.smithi155.stdout: }, 2023-08-01T19:55:54.038 INFO:teuthology.orchestra.run.smithi155.stdout: { 2023-08-01T19:55:54.038 INFO:teuthology.orchestra.run.smithi155.stdout: "event": "all_read", 2023-08-01T19:55:54.038 INFO:teuthology.orchestra.run.smithi155.stdout: "time": "2023-08-01T19:55:05.566754+0000", 2023-08-01T19:55:54.038 INFO:teuthology.orchestra.run.smithi155.stdout: "duration": 8.9425999999999994e-05 2023-08-01T19:55:54.038 INFO:teuthology.orchestra.run.smithi155.stdout: }, 2023-08-01T19:55:54.039 INFO:teuthology.orchestra.run.smithi155.stdout: { 2023-08-01T19:55:54.039 INFO:teuthology.orchestra.run.smithi155.stdout: "event": "dispatched", 2023-08-01T19:55:54.039 INFO:teuthology.orchestra.run.smithi155.stdout: "time": "2023-08-01T19:55:05.566766+0000", 2023-08-01T19:55:54.039 INFO:teuthology.orchestra.run.smithi155.stdout: "duration": 1.2018000000000001e-05 2023-08-01T19:55:54.039 INFO:teuthology.orchestra.run.smithi155.stdout: }, 2023-08-01T19:55:54.039 INFO:teuthology.orchestra.run.smithi155.stdout: { 2023-08-01T19:55:54.039 INFO:teuthology.orchestra.run.smithi155.stdout: "event": "queued_for_pg", 2023-08-01T19:55:54.040 INFO:teuthology.orchestra.run.smithi155.stdout: "time": "2023-08-01T19:55:05.566772+0000", 2023-08-01T19:55:54.040 INFO:teuthology.orchestra.run.smithi155.stdout: "duration": 6.0190000000000003e-06 2023-08-01T19:55:54.040 INFO:teuthology.orchestra.run.smithi155.stdout: }, 2023-08-01T19:55:54.040 INFO:teuthology.orchestra.run.smithi155.stdout: { 2023-08-01T19:55:54.040 INFO:teuthology.orchestra.run.smithi155.stdout: "event": "reached_pg", 2023-08-01T19:55:54.040 INFO:teuthology.orchestra.run.smithi155.stdout: "time": "2023-08-01T19:55:05.566800+0000", 2023-08-01T19:55:54.040 INFO:teuthology.orchestra.run.smithi155.stdout: "duration": 2.7835999999999999e-05 2023-08-01T19:55:54.040 INFO:teuthology.orchestra.run.smithi155.stdout: }, 2023-08-01T19:55:54.041 INFO:teuthology.orchestra.run.smithi155.stdout: { 2023-08-01T19:55:54.041 INFO:teuthology.orchestra.run.smithi155.stdout: "event": "started", 2023-08-01T19:55:54.041 INFO:teuthology.orchestra.run.smithi155.stdout: "time": "2023-08-01T19:55:05.566879+0000", 2023-08-01T19:55:54.041 INFO:teuthology.orchestra.run.smithi155.stdout: "duration": 7.9105999999999998e-05 2023-08-01T19:55:54.041 INFO:teuthology.orchestra.run.smithi155.stdout: }, 2023-08-01T19:55:54.041 INFO:teuthology.orchestra.run.smithi155.stdout: { 2023-08-01T19:55:54.041 INFO:teuthology.orchestra.run.smithi155.stdout: "event": "waiting for subops from 0", 2023-08-01T19:55:54.041 INFO:teuthology.orchestra.run.smithi155.stdout: "time": "2023-08-01T19:55:05.566971+0000", 2023-08-01T19:55:54.042 INFO:teuthology.orchestra.run.smithi155.stdout: "duration": 9.1817999999999994e-05 2023-08-01T19:55:54.042 INFO:teuthology.orchestra.run.smithi155.stdout: }, 2023-08-01T19:55:54.042 INFO:teuthology.orchestra.run.smithi155.stdout: { 2023-08-01T19:55:54.042 INFO:teuthology.orchestra.run.smithi155.stdout: "event": "op_commit", 2023-08-01T19:55:54.042 INFO:teuthology.orchestra.run.smithi155.stdout: "time": "2023-08-01T19:55:05.571475+0000", 2023-08-01T19:55:54.042 INFO:teuthology.orchestra.run.smithi155.stdout: "duration": 0.0045039499999999996 2023-08-01T19:55:54.042 INFO:teuthology.orchestra.run.smithi155.stdout: }, 2023-08-01T19:55:54.042 INFO:teuthology.orchestra.run.smithi155.stdout: { 2023-08-01T19:55:54.043 INFO:teuthology.orchestra.run.smithi155.stdout: "event": "sub_op_commit_rec", 2023-08-01T19:55:54.043 INFO:teuthology.orchestra.run.smithi155.stdout: "time": "2023-08-01T19:55:05.630884+0000", 2023-08-01T19:55:54.043 INFO:teuthology.orchestra.run.smithi155.stdout: "duration": 0.059409181999999998 2023-08-01T19:55:54.043 INFO:teuthology.orchestra.run.smithi155.stdout: }, 2023-08-01T19:55:54.043 INFO:teuthology.orchestra.run.smithi155.stdout: { 2023-08-01T19:55:54.043 INFO:teuthology.orchestra.run.smithi155.stdout: "event": "commit_sent", 2023-08-01T19:55:54.043 INFO:teuthology.orchestra.run.smithi155.stdout: "time": "2023-08-01T19:55:05.630930+0000", 2023-08-01T19:55:54.043 INFO:teuthology.orchestra.run.smithi155.stdout: "duration": 4.5507999999999999e-05 2023-08-01T19:55:54.044 INFO:teuthology.orchestra.run.smithi155.stdout: }, 2023-08-01T19:55:54.044 INFO:teuthology.orchestra.run.smithi155.stdout: { 2023-08-01T19:55:54.044 INFO:teuthology.orchestra.run.smithi155.stdout: "event": "done", 2023-08-01T19:55:54.044 INFO:teuthology.orchestra.run.smithi155.stdout: "time": "2023-08-01T19:55:05.630975+0000", 2023-08-01T19:55:54.044 INFO:teuthology.orchestra.run.smithi155.stdout: "duration": 4.5441000000000001e-05 2023-08-01T19:55:54.044 INFO:teuthology.orchestra.run.smithi155.stdout: } 2023-08-01T19:55:54.044 INFO:teuthology.orchestra.run.smithi155.stdout: ] 2023-08-01T19:55:54.045 INFO:teuthology.orchestra.run.smithi155.stdout: } 2023-08-01T19:55:54.045 INFO:teuthology.orchestra.run.smithi155.stdout: }, 2023-08-01T19:55:54.045 INFO:teuthology.orchestra.run.smithi155.stdout: { 2023-08-01T19:55:54.045 INFO:teuthology.orchestra.run.smithi155.stdout: "description": "osd_op(client.4668.0:100941 5.e 5:736a6ac6:::benchmark_data_smithi006_114134_object100940:head [set-alloc-hint object_size 65536 write_size 65536,write 0~65536] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e37)", 2023-08-01T19:55:54.045 INFO:teuthology.orchestra.run.smithi155.stdout: "initiated_at": "2023-08-01T19:55:05.569750+0000", 2023-08-01T19:55:54.045 INFO:teuthology.orchestra.run.smithi155.stdout: "age": 48.318738187999998, 2023-08-01T19:55:54.045 INFO:teuthology.orchestra.run.smithi155.stdout: "duration": 0.065431331999999995, 2023-08-01T19:55:54.045 INFO:teuthology.orchestra.run.smithi155.stdout: "type_data": { 2023-08-01T19:55:54.046 INFO:teuthology.orchestra.run.smithi155.stdout: "flag_point": "commit sent; apply or cleanup", 2023-08-01T19:55:54.046 INFO:teuthology.orchestra.run.smithi155.stdout: "client_info": { 2023-08-01T19:55:54.046 INFO:teuthology.orchestra.run.smithi155.stdout: "client": "client.4668", 2023-08-01T19:55:54.046 INFO:teuthology.orchestra.run.smithi155.stdout: "client_addr": "172.21.15.6:0/1709472247", 2023-08-01T19:55:54.046 INFO:teuthology.orchestra.run.smithi155.stdout: "tid": 100941 2023-08-01T19:55:54.046 INFO:teuthology.orchestra.run.smithi155.stdout: }, 2023-08-01T19:55:54.046 INFO:teuthology.orchestra.run.smithi155.stdout: "events": [ 2023-08-01T19:55:54.046 INFO:teuthology.orchestra.run.smithi155.stdout: { 2023-08-01T19:55:54.047 INFO:teuthology.orchestra.run.smithi155.stdout: "event": "initiated", 2023-08-01T19:55:54.047 INFO:teuthology.orchestra.run.smithi155.stdout: "time": "2023-08-01T19:55:05.569750+0000", 2023-08-01T19:55:54.047 INFO:teuthology.orchestra.run.smithi155.stdout: "duration": 0 2023-08-01T19:55:54.047 INFO:teuthology.orchestra.run.smithi155.stdout: }, 2023-08-01T19:55:54.047 INFO:teuthology.orchestra.run.smithi155.stdout: { 2023-08-01T19:55:54.047 INFO:teuthology.orchestra.run.smithi155.stdout: "event": "throttled", 2023-08-01T19:55:54.047 INFO:teuthology.orchestra.run.smithi155.stdout: "time": "2023-08-01T19:55:05.569750+0000", 2023-08-01T19:55:54.047 INFO:teuthology.orchestra.run.smithi155.stdout: "duration": 0 2023-08-01T19:55:54.048 INFO:teuthology.orchestra.run.smithi155.stdout: }, 2023-08-01T19:55:54.048 INFO:teuthology.orchestra.run.smithi155.stdout: { 2023-08-01T19:55:54.048 INFO:teuthology.orchestra.run.smithi155.stdout: "event": "header_read", 2023-08-01T19:55:54.048 INFO:teuthology.orchestra.run.smithi155.stdout: "time": "2023-08-01T19:55:05.569749+0000", 2023-08-01T19:55:54.048 INFO:teuthology.orchestra.run.smithi155.stdout: "duration": 4294967295.999999 2023-08-01T19:55:54.048 INFO:teuthology.orchestra.run.smithi155.stdout: }, 2023-08-01T19:55:54.048 INFO:teuthology.orchestra.run.smithi155.stdout: { 2023-08-01T19:55:54.048 INFO:teuthology.orchestra.run.smithi155.stdout: "event": "all_read", 2023-08-01T19:55:54.049 INFO:teuthology.orchestra.run.smithi155.stdout: "time": "2023-08-01T19:55:05.569861+0000", 2023-08-01T19:55:54.049 INFO:teuthology.orchestra.run.smithi155.stdout: "duration": 0.000111333 2023-08-01T19:55:54.049 INFO:teuthology.orchestra.run.smithi155.stdout: }, 2023-08-01T19:55:54.049 INFO:teuthology.orchestra.run.smithi155.stdout: { 2023-08-01T19:55:54.049 INFO:teuthology.orchestra.run.smithi155.stdout: "event": "dispatched", 2023-08-01T19:55:54.049 INFO:teuthology.orchestra.run.smithi155.stdout: "time": "2023-08-01T19:55:05.569869+0000", 2023-08-01T19:55:54.049 INFO:teuthology.orchestra.run.smithi155.stdout: "duration": 8.8589999999999994e-06 2023-08-01T19:55:54.050 INFO:teuthology.orchestra.run.smithi155.stdout: }, 2023-08-01T19:55:54.050 INFO:teuthology.orchestra.run.smithi155.stdout: { 2023-08-01T19:55:54.050 INFO:teuthology.orchestra.run.smithi155.stdout: "event": "queued_for_pg", 2023-08-01T19:55:54.050 INFO:teuthology.orchestra.run.smithi155.stdout: "time": "2023-08-01T19:55:05.569874+0000", 2023-08-01T19:55:54.050 INFO:teuthology.orchestra.run.smithi155.stdout: "duration": 4.1679999999999997e-06 2023-08-01T19:55:54.050 INFO:teuthology.orchestra.run.smithi155.stdout: }, 2023-08-01T19:55:54.050 INFO:teuthology.orchestra.run.smithi155.stdout: { 2023-08-01T19:55:54.050 INFO:teuthology.orchestra.run.smithi155.stdout: "event": "reached_pg", 2023-08-01T19:55:54.051 INFO:teuthology.orchestra.run.smithi155.stdout: "time": "2023-08-01T19:55:05.569904+0000", 2023-08-01T19:55:54.051 INFO:teuthology.orchestra.run.smithi155.stdout: "duration": 3.0920999999999998e-05 2023-08-01T19:55:54.051 INFO:teuthology.orchestra.run.smithi155.stdout: }, 2023-08-01T19:55:54.051 INFO:teuthology.orchestra.run.smithi155.stdout: { 2023-08-01T19:55:54.051 INFO:teuthology.orchestra.run.smithi155.stdout: "event": "started", 2023-08-01T19:55:54.051 INFO:teuthology.orchestra.run.smithi155.stdout: "time": "2023-08-01T19:55:05.569998+0000", 2023-08-01T19:55:54.051 INFO:teuthology.orchestra.run.smithi155.stdout: "duration": 9.3086999999999998e-05 2023-08-01T19:55:54.051 INFO:teuthology.orchestra.run.smithi155.stdout: }, 2023-08-01T19:55:54.052 INFO:teuthology.orchestra.run.smithi155.stdout: { 2023-08-01T19:55:54.052 INFO:teuthology.orchestra.run.smithi155.stdout: "event": "waiting for subops from 0", 2023-08-01T19:55:54.052 INFO:teuthology.orchestra.run.smithi155.stdout: "time": "2023-08-01T19:55:05.570093+0000", 2023-08-01T19:55:54.052 INFO:teuthology.orchestra.run.smithi155.stdout: "duration": 9.5768999999999997e-05 2023-08-01T19:55:54.052 INFO:teuthology.orchestra.run.smithi155.stdout: }, 2023-08-01T19:55:54.052 INFO:teuthology.orchestra.run.smithi155.stdout: { 2023-08-01T19:55:54.052 INFO:teuthology.orchestra.run.smithi155.stdout: "event": "op_commit", 2023-08-01T19:55:54.052 INFO:teuthology.orchestra.run.smithi155.stdout: "time": "2023-08-01T19:55:05.572839+0000", 2023-08-01T19:55:54.053 INFO:teuthology.orchestra.run.smithi155.stdout: "duration": 0.0027460050000000001 2023-08-01T19:55:54.053 INFO:teuthology.orchestra.run.smithi155.stdout: }, 2023-08-01T19:55:54.053 INFO:teuthology.orchestra.run.smithi155.stdout: { 2023-08-01T19:55:54.053 INFO:teuthology.orchestra.run.smithi155.stdout: "event": "sub_op_commit_rec", 2023-08-01T19:55:54.053 INFO:teuthology.orchestra.run.smithi155.stdout: "time": "2023-08-01T19:55:05.635114+0000", 2023-08-01T19:55:54.053 INFO:teuthology.orchestra.run.smithi155.stdout: "duration": 0.062274297999999999 2023-08-01T19:55:54.053 INFO:teuthology.orchestra.run.smithi155.stdout: }, 2023-08-01T19:55:54.053 INFO:teuthology.orchestra.run.smithi155.stdout: { 2023-08-01T19:55:54.054 INFO:teuthology.orchestra.run.smithi155.stdout: "event": "commit_sent", 2023-08-01T19:55:54.054 INFO:teuthology.orchestra.run.smithi155.stdout: "time": "2023-08-01T19:55:05.635143+0000", 2023-08-01T19:55:54.054 INFO:teuthology.orchestra.run.smithi155.stdout: "duration": 2.9430000000000001e-05 2023-08-01T19:55:54.054 INFO:teuthology.orchestra.run.smithi155.stdout: }, 2023-08-01T19:55:54.054 INFO:teuthology.orchestra.run.smithi155.stdout: { 2023-08-01T19:55:54.054 INFO:teuthology.orchestra.run.smithi155.stdout: "event": "done", 2023-08-01T19:55:54.054 INFO:teuthology.orchestra.run.smithi155.stdout: "time": "2023-08-01T19:55:05.635181+0000", 2023-08-01T19:55:54.054 INFO:teuthology.orchestra.run.smithi155.stdout: "duration": 3.8352000000000001e-05 2023-08-01T19:55:54.055 INFO:teuthology.orchestra.run.smithi155.stdout: } 2023-08-01T19:55:54.055 INFO:teuthology.orchestra.run.smithi155.stdout: ] 2023-08-01T19:55:54.055 INFO:teuthology.orchestra.run.smithi155.stdout: } 2023-08-01T19:55:54.055 INFO:teuthology.orchestra.run.smithi155.stdout: }, 2023-08-01T19:55:54.055 INFO:teuthology.orchestra.run.smithi155.stdout: { 2023-08-01T19:55:54.055 INFO:teuthology.orchestra.run.smithi155.stdout: "description": "osd_op(client.4668.0:100944 5.4 5:25fae865:::benchmark_data_smithi006_114134_object100943:head [set-alloc-hint object_size 65536 write_size 65536,write 0~65536] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e37)", 2023-08-01T19:55:54.055 INFO:teuthology.orchestra.run.smithi155.stdout: "initiated_at": "2023-08-01T19:55:05.576662+0000", 2023-08-01T19:55:54.055 INFO:teuthology.orchestra.run.smithi155.stdout: "age": 48.311826490999998, 2023-08-01T19:55:54.056 INFO:teuthology.orchestra.run.smithi155.stdout: "duration": 0.056054925999999998, 2023-08-01T19:55:54.056 INFO:teuthology.orchestra.run.smithi155.stdout: "type_data": { 2023-08-01T19:55:54.056 INFO:teuthology.orchestra.run.smithi155.stdout: "flag_point": "commit sent; apply or cleanup", 2023-08-01T19:55:54.056 INFO:teuthology.orchestra.run.smithi155.stdout: "client_info": { 2023-08-01T19:55:54.056 INFO:teuthology.orchestra.run.smithi155.stdout: "client": "client.4668", 2023-08-01T19:55:54.056 INFO:teuthology.orchestra.run.smithi155.stdout: "client_addr": "172.21.15.6:0/1709472247", 2023-08-01T19:55:54.056 INFO:teuthology.orchestra.run.smithi155.stdout: "tid": 100944 2023-08-01T19:55:54.057 INFO:teuthology.orchestra.run.smithi155.stdout: }, 2023-08-01T19:55:54.057 INFO:teuthology.orchestra.run.smithi155.stdout: "events": [ 2023-08-01T19:55:54.057 INFO:teuthology.orchestra.run.smithi155.stdout: { 2023-08-01T19:55:54.057 INFO:teuthology.orchestra.run.smithi155.stdout: "event": "initiated", 2023-08-01T19:55:54.057 INFO:teuthology.orchestra.run.smithi155.stdout: "time": "2023-08-01T19:55:05.576662+0000", 2023-08-01T19:55:54.057 INFO:teuthology.orchestra.run.smithi155.stdout: "duration": 0 2023-08-01T19:55:54.057 INFO:teuthology.orchestra.run.smithi155.stdout: }, 2023-08-01T19:55:54.057 INFO:teuthology.orchestra.run.smithi155.stdout: { 2023-08-01T19:55:54.058 INFO:teuthology.orchestra.run.smithi155.stdout: "event": "throttled", 2023-08-01T19:55:54.058 INFO:teuthology.orchestra.run.smithi155.stdout: "time": "2023-08-01T19:55:05.576662+0000", 2023-08-01T19:55:54.058 INFO:teuthology.orchestra.run.smithi155.stdout: "duration": 0 2023-08-01T19:55:54.058 INFO:teuthology.orchestra.run.smithi155.stdout: }, 2023-08-01T19:55:54.058 INFO:teuthology.orchestra.run.smithi155.stdout: { 2023-08-01T19:55:54.058 INFO:teuthology.orchestra.run.smithi155.stdout: "event": "header_read", 2023-08-01T19:55:54.058 INFO:teuthology.orchestra.run.smithi155.stdout: "time": "2023-08-01T19:55:05.576661+0000", 2023-08-01T19:55:54.058 INFO:teuthology.orchestra.run.smithi155.stdout: "duration": 4294967295.999999 2023-08-01T19:55:54.059 INFO:teuthology.orchestra.run.smithi155.stdout: }, 2023-08-01T19:55:54.059 INFO:teuthology.orchestra.run.smithi155.stdout: { 2023-08-01T19:55:54.059 INFO:teuthology.orchestra.run.smithi155.stdout: "event": "all_read", 2023-08-01T19:55:54.059 INFO:teuthology.orchestra.run.smithi155.stdout: "time": "2023-08-01T19:55:05.576725+0000", 2023-08-01T19:55:54.059 INFO:teuthology.orchestra.run.smithi155.stdout: "duration": 6.4435000000000002e-05 2023-08-01T19:55:54.059 INFO:teuthology.orchestra.run.smithi155.stdout: }, 2023-08-01T19:55:54.059 INFO:teuthology.orchestra.run.smithi155.stdout: { 2023-08-01T19:55:54.059 INFO:teuthology.orchestra.run.smithi155.stdout: "event": "dispatched", 2023-08-01T19:55:54.060 INFO:teuthology.orchestra.run.smithi155.stdout: "time": "2023-08-01T19:55:05.576744+0000", 2023-08-01T19:55:54.060 INFO:teuthology.orchestra.run.smithi155.stdout: "duration": 1.8502999999999999e-05 2023-08-01T19:55:54.060 INFO:teuthology.orchestra.run.smithi155.stdout: }, 2023-08-01T19:55:54.060 INFO:teuthology.orchestra.run.smithi155.stdout: { 2023-08-01T19:55:54.060 INFO:teuthology.orchestra.run.smithi155.stdout: "event": "queued_for_pg", 2023-08-01T19:55:54.060 INFO:teuthology.orchestra.run.smithi155.stdout: "time": "2023-08-01T19:55:05.576772+0000", 2023-08-01T19:55:54.060 INFO:teuthology.orchestra.run.smithi155.stdout: "duration": 2.8354999999999999e-05 2023-08-01T19:55:54.061 INFO:teuthology.orchestra.run.smithi155.stdout: }, 2023-08-01T19:55:54.061 INFO:teuthology.orchestra.run.smithi155.stdout: { 2023-08-01T19:55:54.061 INFO:teuthology.orchestra.run.smithi155.stdout: "event": "reached_pg", 2023-08-01T19:55:54.061 INFO:teuthology.orchestra.run.smithi155.stdout: "time": "2023-08-01T19:55:05.576815+0000", 2023-08-01T19:55:54.061 INFO:teuthology.orchestra.run.smithi155.stdout: "duration": 4.3223999999999998e-05 2023-08-01T19:55:54.061 INFO:teuthology.orchestra.run.smithi155.stdout: }, 2023-08-01T19:55:54.061 INFO:teuthology.orchestra.run.smithi155.stdout: { 2023-08-01T19:55:54.061 INFO:teuthology.orchestra.run.smithi155.stdout: "event": "started", 2023-08-01T19:55:54.062 INFO:teuthology.orchestra.run.smithi155.stdout: "time": "2023-08-01T19:55:05.576961+0000", 2023-08-01T19:55:54.062 INFO:teuthology.orchestra.run.smithi155.stdout: "duration": 0.000145043 2023-08-01T19:55:54.062 INFO:teuthology.orchestra.run.smithi155.stdout: }, 2023-08-01T19:55:54.062 INFO:teuthology.orchestra.run.smithi155.stdout: { 2023-08-01T19:55:54.062 INFO:teuthology.orchestra.run.smithi155.stdout: "event": "waiting for subops from 0", 2023-08-01T19:55:54.062 INFO:teuthology.orchestra.run.smithi155.stdout: "time": "2023-08-01T19:55:05.577343+0000", 2023-08-01T19:55:54.062 INFO:teuthology.orchestra.run.smithi155.stdout: "duration": 0.00038249699999999998 2023-08-01T19:55:54.062 INFO:teuthology.orchestra.run.smithi155.stdout: }, 2023-08-01T19:55:54.063 INFO:teuthology.orchestra.run.smithi155.stdout: { 2023-08-01T19:55:54.063 INFO:teuthology.orchestra.run.smithi155.stdout: "event": "op_commit", 2023-08-01T19:55:54.063 INFO:teuthology.orchestra.run.smithi155.stdout: "time": "2023-08-01T19:55:05.582349+0000", 2023-08-01T19:55:54.063 INFO:teuthology.orchestra.run.smithi155.stdout: "duration": 0.0050062880000000002 2023-08-01T19:55:54.063 INFO:teuthology.orchestra.run.smithi155.stdout: }, 2023-08-01T19:55:54.063 INFO:teuthology.orchestra.run.smithi155.stdout: { 2023-08-01T19:55:54.063 INFO:teuthology.orchestra.run.smithi155.stdout: "event": "sub_op_commit_rec", 2023-08-01T19:55:54.063 INFO:teuthology.orchestra.run.smithi155.stdout: "time": "2023-08-01T19:55:05.632659+0000", 2023-08-01T19:55:54.064 INFO:teuthology.orchestra.run.smithi155.stdout: "duration": 0.050309185999999999 2023-08-01T19:55:54.064 INFO:teuthology.orchestra.run.smithi155.stdout: }, 2023-08-01T19:55:54.064 INFO:teuthology.orchestra.run.smithi155.stdout: { 2023-08-01T19:55:54.064 INFO:teuthology.orchestra.run.smithi155.stdout: "event": "commit_sent", 2023-08-01T19:55:54.064 INFO:teuthology.orchestra.run.smithi155.stdout: "time": "2023-08-01T19:55:05.632692+0000", 2023-08-01T19:55:54.064 INFO:teuthology.orchestra.run.smithi155.stdout: "duration": 3.3077999999999997e-05 2023-08-01T19:55:54.064 INFO:teuthology.orchestra.run.smithi155.stdout: }, 2023-08-01T19:55:54.065 INFO:teuthology.orchestra.run.smithi155.stdout: { 2023-08-01T19:55:54.065 INFO:teuthology.orchestra.run.smithi155.stdout: "event": "done", 2023-08-01T19:55:54.065 INFO:teuthology.orchestra.run.smithi155.stdout: "time": "2023-08-01T19:55:05.632717+0000", 2023-08-01T19:55:54.065 INFO:teuthology.orchestra.run.smithi155.stdout: "duration": 2.5119000000000001e-05 2023-08-01T19:55:54.065 INFO:teuthology.orchestra.run.smithi155.stdout: } 2023-08-01T19:55:54.065 INFO:teuthology.orchestra.run.smithi155.stdout: ] 2023-08-01T19:55:54.065 INFO:teuthology.orchestra.run.smithi155.stdout: } 2023-08-01T19:55:54.065 INFO:teuthology.orchestra.run.smithi155.stdout: }, 2023-08-01T19:55:54.066 INFO:teuthology.orchestra.run.smithi155.stdout: { 2023-08-01T19:55:54.066 INFO:teuthology.orchestra.run.smithi155.stdout: "description": "osd_op(client.4668.0:100945 5.e 5:73df68dd:::benchmark_data_smithi006_114134_object100944:head [set-alloc-hint object_size 65536 write_size 65536,write 0~65536] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e37)", 2023-08-01T19:55:54.066 INFO:teuthology.orchestra.run.smithi155.stdout: "initiated_at": "2023-08-01T19:55:05.576784+0000", 2023-08-01T19:55:54.066 INFO:teuthology.orchestra.run.smithi155.stdout: "age": 48.311704603000003, 2023-08-01T19:55:54.066 INFO:teuthology.orchestra.run.smithi155.stdout: "duration": 0.058512994999999998, 2023-08-01T19:55:54.066 INFO:teuthology.orchestra.run.smithi155.stdout: "type_data": { 2023-08-01T19:55:54.066 INFO:teuthology.orchestra.run.smithi155.stdout: "flag_point": "commit sent; apply or cleanup", 2023-08-01T19:55:54.066 INFO:teuthology.orchestra.run.smithi155.stdout: "client_info": { 2023-08-01T19:55:54.067 INFO:teuthology.orchestra.run.smithi155.stdout: "client": "client.4668", 2023-08-01T19:55:54.067 INFO:teuthology.orchestra.run.smithi155.stdout: "client_addr": "172.21.15.6:0/1709472247", 2023-08-01T19:55:54.067 INFO:teuthology.orchestra.run.smithi155.stdout: "tid": 100945 2023-08-01T19:55:54.067 INFO:teuthology.orchestra.run.smithi155.stdout: }, 2023-08-01T19:55:54.067 INFO:teuthology.orchestra.run.smithi155.stdout: "events": [ 2023-08-01T19:55:54.067 INFO:teuthology.orchestra.run.smithi155.stdout: { 2023-08-01T19:55:54.067 INFO:teuthology.orchestra.run.smithi155.stdout: "event": "initiated", 2023-08-01T19:55:54.067 INFO:teuthology.orchestra.run.smithi155.stdout: "time": "2023-08-01T19:55:05.576784+0000", 2023-08-01T19:55:54.068 INFO:teuthology.orchestra.run.smithi155.stdout: "duration": 0 2023-08-01T19:55:54.068 INFO:teuthology.orchestra.run.smithi155.stdout: }, 2023-08-01T19:55:54.068 INFO:teuthology.orchestra.run.smithi155.stdout: { 2023-08-01T19:55:54.068 INFO:teuthology.orchestra.run.smithi155.stdout: "event": "throttled", 2023-08-01T19:55:54.068 INFO:teuthology.orchestra.run.smithi155.stdout: "time": "2023-08-01T19:55:05.576784+0000", 2023-08-01T19:55:54.068 INFO:teuthology.orchestra.run.smithi155.stdout: "duration": 0 2023-08-01T19:55:54.068 INFO:teuthology.orchestra.run.smithi155.stdout: }, 2023-08-01T19:55:54.068 INFO:teuthology.orchestra.run.smithi155.stdout: { 2023-08-01T19:55:54.069 INFO:teuthology.orchestra.run.smithi155.stdout: "event": "header_read", 2023-08-01T19:55:54.069 INFO:teuthology.orchestra.run.smithi155.stdout: "time": "2023-08-01T19:55:05.576783+0000", 2023-08-01T19:55:54.069 INFO:teuthology.orchestra.run.smithi155.stdout: "duration": 4294967295.9999995 2023-08-01T19:55:54.069 INFO:teuthology.orchestra.run.smithi155.stdout: }, 2023-08-01T19:55:54.069 INFO:teuthology.orchestra.run.smithi155.stdout: { 2023-08-01T19:55:54.069 INFO:teuthology.orchestra.run.smithi155.stdout: "event": "all_read", 2023-08-01T19:55:54.069 INFO:teuthology.orchestra.run.smithi155.stdout: "time": "2023-08-01T19:55:05.576807+0000", 2023-08-01T19:55:54.070 INFO:teuthology.orchestra.run.smithi155.stdout: "duration": 2.3651000000000001e-05 2023-08-01T19:55:54.070 INFO:teuthology.orchestra.run.smithi155.stdout: }, 2023-08-01T19:55:54.070 INFO:teuthology.orchestra.run.smithi155.stdout: { 2023-08-01T19:55:54.070 INFO:teuthology.orchestra.run.smithi155.stdout: "event": "dispatched", 2023-08-01T19:55:54.070 INFO:teuthology.orchestra.run.smithi155.stdout: "time": "2023-08-01T19:55:05.576817+0000", 2023-08-01T19:55:54.070 INFO:teuthology.orchestra.run.smithi155.stdout: "duration": 9.9389999999999992e-06 2023-08-01T19:55:54.070 INFO:teuthology.orchestra.run.smithi155.stdout: }, 2023-08-01T19:55:54.070 INFO:teuthology.orchestra.run.smithi155.stdout: { 2023-08-01T19:55:54.071 INFO:teuthology.orchestra.run.smithi155.stdout: "event": "queued_for_pg", 2023-08-01T19:55:54.071 INFO:teuthology.orchestra.run.smithi155.stdout: "time": "2023-08-01T19:55:05.576820+0000", 2023-08-01T19:55:54.071 INFO:teuthology.orchestra.run.smithi155.stdout: "duration": 3.2619999999999999e-06 2023-08-01T19:55:54.071 INFO:teuthology.orchestra.run.smithi155.stdout: }, 2023-08-01T19:55:54.071 INFO:teuthology.orchestra.run.smithi155.stdout: { 2023-08-01T19:55:54.071 INFO:teuthology.orchestra.run.smithi155.stdout: "event": "reached_pg", 2023-08-01T19:55:54.071 INFO:teuthology.orchestra.run.smithi155.stdout: "time": "2023-08-01T19:55:05.576849+0000", 2023-08-01T19:55:54.071 INFO:teuthology.orchestra.run.smithi155.stdout: "duration": 2.8880000000000001e-05 2023-08-01T19:55:54.072 INFO:teuthology.orchestra.run.smithi155.stdout: }, 2023-08-01T19:55:54.072 INFO:teuthology.orchestra.run.smithi155.stdout: { 2023-08-01T19:55:54.072 INFO:teuthology.orchestra.run.smithi155.stdout: "event": "started", 2023-08-01T19:55:54.072 INFO:teuthology.orchestra.run.smithi155.stdout: "time": "2023-08-01T19:55:05.576940+0000", 2023-08-01T19:55:54.072 INFO:teuthology.orchestra.run.smithi155.stdout: "duration": 9.0570999999999997e-05 2023-08-01T19:55:54.072 INFO:teuthology.orchestra.run.smithi155.stdout: }, 2023-08-01T19:55:54.072 INFO:teuthology.orchestra.run.smithi155.stdout: { 2023-08-01T19:55:54.072 INFO:teuthology.orchestra.run.smithi155.stdout: "event": "waiting for subops from 0", 2023-08-01T19:55:54.073 INFO:teuthology.orchestra.run.smithi155.stdout: "time": "2023-08-01T19:55:05.577027+0000", 2023-08-01T19:55:54.073 INFO:teuthology.orchestra.run.smithi155.stdout: "duration": 8.7237999999999994e-05 2023-08-01T19:55:54.073 INFO:teuthology.orchestra.run.smithi155.stdout: }, 2023-08-01T19:55:54.073 INFO:teuthology.orchestra.run.smithi155.stdout: { 2023-08-01T19:55:54.073 INFO:teuthology.orchestra.run.smithi155.stdout: "event": "op_commit", 2023-08-01T19:55:54.073 INFO:teuthology.orchestra.run.smithi155.stdout: "time": "2023-08-01T19:55:05.579624+0000", 2023-08-01T19:55:54.073 INFO:teuthology.orchestra.run.smithi155.stdout: "duration": 0.0025971200000000001 2023-08-01T19:55:54.073 INFO:teuthology.orchestra.run.smithi155.stdout: }, 2023-08-01T19:55:54.074 INFO:teuthology.orchestra.run.smithi155.stdout: { 2023-08-01T19:55:54.074 INFO:teuthology.orchestra.run.smithi155.stdout: "event": "sub_op_commit_rec", 2023-08-01T19:55:54.074 INFO:teuthology.orchestra.run.smithi155.stdout: "time": "2023-08-01T19:55:05.635218+0000", 2023-08-01T19:55:54.074 INFO:teuthology.orchestra.run.smithi155.stdout: "duration": 0.055594487999999997 2023-08-01T19:55:54.074 INFO:teuthology.orchestra.run.smithi155.stdout: }, 2023-08-01T19:55:54.074 INFO:teuthology.orchestra.run.smithi155.stdout: { 2023-08-01T19:55:54.074 INFO:teuthology.orchestra.run.smithi155.stdout: "event": "commit_sent", 2023-08-01T19:55:54.074 INFO:teuthology.orchestra.run.smithi155.stdout: "time": "2023-08-01T19:55:05.635262+0000", 2023-08-01T19:55:54.075 INFO:teuthology.orchestra.run.smithi155.stdout: "duration": 4.3380999999999997e-05 2023-08-01T19:55:54.075 INFO:teuthology.orchestra.run.smithi155.stdout: }, 2023-08-01T19:55:54.075 INFO:teuthology.orchestra.run.smithi155.stdout: { 2023-08-01T19:55:54.075 INFO:teuthology.orchestra.run.smithi155.stdout: "event": "done", 2023-08-01T19:55:54.075 INFO:teuthology.orchestra.run.smithi155.stdout: "time": "2023-08-01T19:55:05.635297+0000", 2023-08-01T19:55:54.075 INFO:teuthology.orchestra.run.smithi155.stdout: "duration": 3.4842000000000003e-05 2023-08-01T19:55:54.075 INFO:teuthology.orchestra.run.smithi155.stdout: } 2023-08-01T19:55:54.075 INFO:teuthology.orchestra.run.smithi155.stdout: ] 2023-08-01T19:55:54.076 INFO:teuthology.orchestra.run.smithi155.stdout: } 2023-08-01T19:55:54.076 INFO:teuthology.orchestra.run.smithi155.stdout: }, 2023-08-01T19:55:54.076 INFO:teuthology.orchestra.run.smithi155.stdout: { 2023-08-01T19:55:54.076 INFO:teuthology.orchestra.run.smithi155.stdout: "description": "osd_op(client.4668.0:100947 5.4 5:23e8fc27:::benchmark_data_smithi006_114134_object100946:head [set-alloc-hint object_size 65536 write_size 65536,write 0~65536] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e37)", 2023-08-01T19:55:54.076 INFO:teuthology.orchestra.run.smithi155.stdout: "initiated_at": "2023-08-01T19:55:05.576840+0000", 2023-08-01T19:55:54.076 INFO:teuthology.orchestra.run.smithi155.stdout: "age": 48.311648548000001, 2023-08-01T19:55:54.076 INFO:teuthology.orchestra.run.smithi155.stdout: "duration": 0.058423127999999998, 2023-08-01T19:55:54.077 INFO:teuthology.orchestra.run.smithi155.stdout: "type_data": { 2023-08-01T19:55:54.077 INFO:teuthology.orchestra.run.smithi155.stdout: "flag_point": "commit sent; apply or cleanup", 2023-08-01T19:55:54.077 INFO:teuthology.orchestra.run.smithi155.stdout: "client_info": { 2023-08-01T19:55:54.077 INFO:teuthology.orchestra.run.smithi155.stdout: "client": "client.4668", 2023-08-01T19:55:54.077 INFO:teuthology.orchestra.run.smithi155.stdout: "client_addr": "172.21.15.6:0/1709472247", 2023-08-01T19:55:54.077 INFO:teuthology.orchestra.run.smithi155.stdout: "tid": 100947 2023-08-01T19:55:54.077 INFO:teuthology.orchestra.run.smithi155.stdout: }, 2023-08-01T19:55:54.077 INFO:teuthology.orchestra.run.smithi155.stdout: "events": [ 2023-08-01T19:55:54.078 INFO:teuthology.orchestra.run.smithi155.stdout: { 2023-08-01T19:55:54.078 INFO:teuthology.orchestra.run.smithi155.stdout: "event": "initiated", 2023-08-01T19:55:54.078 INFO:teuthology.orchestra.run.smithi155.stdout: "time": "2023-08-01T19:55:05.576840+0000", 2023-08-01T19:55:54.078 INFO:teuthology.orchestra.run.smithi155.stdout: "duration": 0 2023-08-01T19:55:54.078 INFO:teuthology.orchestra.run.smithi155.stdout: }, 2023-08-01T19:55:54.078 INFO:teuthology.orchestra.run.smithi155.stdout: { 2023-08-01T19:55:54.078 INFO:teuthology.orchestra.run.smithi155.stdout: "event": "throttled", 2023-08-01T19:55:54.078 INFO:teuthology.orchestra.run.smithi155.stdout: "time": "2023-08-01T19:55:05.576840+0000", 2023-08-01T19:55:54.079 INFO:teuthology.orchestra.run.smithi155.stdout: "duration": 0 2023-08-01T19:55:54.079 INFO:teuthology.orchestra.run.smithi155.stdout: }, 2023-08-01T19:55:54.079 INFO:teuthology.orchestra.run.smithi155.stdout: { 2023-08-01T19:55:54.079 INFO:teuthology.orchestra.run.smithi155.stdout: "event": "header_read", 2023-08-01T19:55:54.079 INFO:teuthology.orchestra.run.smithi155.stdout: "time": "2023-08-01T19:55:05.576839+0000", 2023-08-01T19:55:54.079 INFO:teuthology.orchestra.run.smithi155.stdout: "duration": 4294967295.9999995 2023-08-01T19:55:54.079 INFO:teuthology.orchestra.run.smithi155.stdout: }, 2023-08-01T19:55:54.079 INFO:teuthology.orchestra.run.smithi155.stdout: { 2023-08-01T19:55:54.080 INFO:teuthology.orchestra.run.smithi155.stdout: "event": "all_read", 2023-08-01T19:55:54.080 INFO:teuthology.orchestra.run.smithi155.stdout: "time": "2023-08-01T19:55:05.576893+0000", 2023-08-01T19:55:54.080 INFO:teuthology.orchestra.run.smithi155.stdout: "duration": 5.3893000000000001e-05 2023-08-01T19:55:54.080 INFO:teuthology.orchestra.run.smithi155.stdout: }, 2023-08-01T19:55:54.080 INFO:teuthology.orchestra.run.smithi155.stdout: { 2023-08-01T19:55:54.080 INFO:teuthology.orchestra.run.smithi155.stdout: "event": "dispatched", 2023-08-01T19:55:54.080 INFO:teuthology.orchestra.run.smithi155.stdout: "time": "2023-08-01T19:55:05.576902+0000", 2023-08-01T19:55:54.080 INFO:teuthology.orchestra.run.smithi155.stdout: "duration": 8.7520000000000002e-06 2023-08-01T19:55:54.081 INFO:teuthology.orchestra.run.smithi155.stdout: }, 2023-08-01T19:55:54.081 INFO:teuthology.orchestra.run.smithi155.stdout: { 2023-08-01T19:55:54.081 INFO:teuthology.orchestra.run.smithi155.stdout: "event": "queued_for_pg", 2023-08-01T19:55:54.081 INFO:teuthology.orchestra.run.smithi155.stdout: "time": "2023-08-01T19:55:05.576905+0000", 2023-08-01T19:55:54.081 INFO:teuthology.orchestra.run.smithi155.stdout: "duration": 3.01e-06 2023-08-01T19:55:54.081 INFO:teuthology.orchestra.run.smithi155.stdout: }, 2023-08-01T19:55:54.081 INFO:teuthology.orchestra.run.smithi155.stdout: { 2023-08-01T19:55:54.081 INFO:teuthology.orchestra.run.smithi155.stdout: "event": "reached_pg", 2023-08-01T19:55:54.082 INFO:teuthology.orchestra.run.smithi155.stdout: "time": "2023-08-01T19:55:05.579641+0000", 2023-08-01T19:55:54.082 INFO:teuthology.orchestra.run.smithi155.stdout: "duration": 0.0027366880000000001 2023-08-01T19:55:54.082 INFO:teuthology.orchestra.run.smithi155.stdout: }, 2023-08-01T19:55:54.082 INFO:teuthology.orchestra.run.smithi155.stdout: { 2023-08-01T19:55:54.082 INFO:teuthology.orchestra.run.smithi155.stdout: "event": "started", 2023-08-01T19:55:54.082 INFO:teuthology.orchestra.run.smithi155.stdout: "time": "2023-08-01T19:55:05.579734+0000", 2023-08-01T19:55:54.082 INFO:teuthology.orchestra.run.smithi155.stdout: "duration": 9.2590000000000006e-05 2023-08-01T19:55:54.082 INFO:teuthology.orchestra.run.smithi155.stdout: }, 2023-08-01T19:55:54.083 INFO:teuthology.orchestra.run.smithi155.stdout: { 2023-08-01T19:55:54.083 INFO:teuthology.orchestra.run.smithi155.stdout: "event": "waiting for subops from 0", 2023-08-01T19:55:54.083 INFO:teuthology.orchestra.run.smithi155.stdout: "time": "2023-08-01T19:55:05.579825+0000", 2023-08-01T19:55:54.083 INFO:teuthology.orchestra.run.smithi155.stdout: "duration": 9.0964999999999994e-05 2023-08-01T19:55:54.083 INFO:teuthology.orchestra.run.smithi155.stdout: }, 2023-08-01T19:55:54.083 INFO:teuthology.orchestra.run.smithi155.stdout: { 2023-08-01T19:55:54.083 INFO:teuthology.orchestra.run.smithi155.stdout: "event": "op_commit", 2023-08-01T19:55:54.083 INFO:teuthology.orchestra.run.smithi155.stdout: "time": "2023-08-01T19:55:05.585041+0000", 2023-08-01T19:55:54.084 INFO:teuthology.orchestra.run.smithi155.stdout: "duration": 0.0052159670000000002 2023-08-01T19:55:54.084 INFO:teuthology.orchestra.run.smithi155.stdout: }, 2023-08-01T19:55:54.084 INFO:teuthology.orchestra.run.smithi155.stdout: { 2023-08-01T19:55:54.084 INFO:teuthology.orchestra.run.smithi155.stdout: "event": "sub_op_commit_rec", 2023-08-01T19:55:54.084 INFO:teuthology.orchestra.run.smithi155.stdout: "time": "2023-08-01T19:55:05.635199+0000", 2023-08-01T19:55:54.084 INFO:teuthology.orchestra.run.smithi155.stdout: "duration": 0.050158023000000003 2023-08-01T19:55:54.084 INFO:teuthology.orchestra.run.smithi155.stdout: }, 2023-08-01T19:55:54.085 INFO:teuthology.orchestra.run.smithi155.stdout: { 2023-08-01T19:55:54.085 INFO:teuthology.orchestra.run.smithi155.stdout: "event": "commit_sent", 2023-08-01T19:55:54.085 INFO:teuthology.orchestra.run.smithi155.stdout: "time": "2023-08-01T19:55:05.635227+0000", 2023-08-01T19:55:54.085 INFO:teuthology.orchestra.run.smithi155.stdout: "duration": 2.7821e-05 2023-08-01T19:55:54.085 INFO:teuthology.orchestra.run.smithi155.stdout: }, 2023-08-01T19:55:54.085 INFO:teuthology.orchestra.run.smithi155.stdout: { 2023-08-01T19:55:54.085 INFO:teuthology.orchestra.run.smithi155.stdout: "event": "done", 2023-08-01T19:55:54.085 INFO:teuthology.orchestra.run.smithi155.stdout: "time": "2023-08-01T19:55:05.635263+0000", 2023-08-01T19:55:54.086 INFO:teuthology.orchestra.run.smithi155.stdout: "duration": 3.6081000000000002e-05 2023-08-01T19:55:54.086 INFO:teuthology.orchestra.run.smithi155.stdout: } 2023-08-01T19:55:54.086 INFO:teuthology.orchestra.run.smithi155.stdout: ] 2023-08-01T19:55:54.086 INFO:teuthology.orchestra.run.smithi155.stdout: } 2023-08-01T19:55:54.086 INFO:teuthology.orchestra.run.smithi155.stdout: } 2023-08-01T19:55:54.086 INFO:teuthology.orchestra.run.smithi155.stdout: ] 2023-08-01T19:55:54.086 INFO:teuthology.orchestra.run.smithi155.stdout:} 2023-08-01T19:55:54.087 INFO:tasks.ceph.osd.1.smithi101.stderr:2023-08-01T19:55:54.086+0000 7fb0cb7f6700 -1 received signal: Hangup from /usr/bin/python3 /bin/daemon-helper kill ceph-osd -f --cluster ceph -i 1 (PID: 111141) UID: 0 2023-08-01T19:55:54.088 DEBUG:teuthology.orchestra.run.smithi008:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 30 ceph --cluster ceph --admin-daemon /var/run/ceph/ceph-osd.0.asok dump_ops_in_flight 2023-08-01T19:55:54.140 DEBUG:teuthology.orchestra.run.smithi006:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 120 ceph --cluster ceph osd unset nodeep-scrub 2023-08-01T19:55:54.188 INFO:tasks.ceph.osd.2.smithi155.stderr:2023-08-01T19:55:54.186+0000 7faa5c6ac700 -1 received signal: Hangup from /usr/bin/python3 /bin/daemon-helper kill ceph-osd -f --cluster ceph -i 2 (PID: 111337) UID: 0 2023-08-01T19:55:54.272 INFO:teuthology.orchestra.run.smithi008.stdout:{ 2023-08-01T19:55:54.272 INFO:teuthology.orchestra.run.smithi008.stdout: "ops": [ 2023-08-01T19:55:54.273 INFO:teuthology.orchestra.run.smithi008.stdout: { 2023-08-01T19:55:54.273 INFO:teuthology.orchestra.run.smithi008.stdout: "description": "osd_op(client.4668.0:188771 5.1 5:8b8e28ff:::benchmark_data_smithi006_114134_object55110:head [delete] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e59)", 2023-08-01T19:55:54.273 INFO:teuthology.orchestra.run.smithi008.stdout: "initiated_at": "2023-08-01T19:55:54.263229+0000", 2023-08-01T19:55:54.273 INFO:teuthology.orchestra.run.smithi008.stdout: "age": 0.0050568540000000004, 2023-08-01T19:55:54.273 INFO:teuthology.orchestra.run.smithi008.stdout: "duration": 0.0050846559999999999, 2023-08-01T19:55:54.273 INFO:teuthology.orchestra.run.smithi008.stdout: "type_data": { 2023-08-01T19:55:54.273 INFO:teuthology.orchestra.run.smithi008.stdout: "flag_point": "waiting for sub ops", 2023-08-01T19:55:54.274 INFO:teuthology.orchestra.run.smithi008.stdout: "client_info": { 2023-08-01T19:55:54.274 INFO:teuthology.orchestra.run.smithi008.stdout: "client": "client.4668", 2023-08-01T19:55:54.274 INFO:teuthology.orchestra.run.smithi008.stdout: "client_addr": "172.21.15.6:0/1709472247", 2023-08-01T19:55:54.274 INFO:teuthology.orchestra.run.smithi008.stdout: "tid": 188771 2023-08-01T19:55:54.274 INFO:teuthology.orchestra.run.smithi008.stdout: }, 2023-08-01T19:55:54.274 INFO:teuthology.orchestra.run.smithi008.stdout: "events": [ 2023-08-01T19:55:54.274 INFO:teuthology.orchestra.run.smithi008.stdout: { 2023-08-01T19:55:54.275 INFO:teuthology.orchestra.run.smithi008.stdout: "event": "initiated", 2023-08-01T19:55:54.275 INFO:teuthology.orchestra.run.smithi008.stdout: "time": "2023-08-01T19:55:54.263229+0000", 2023-08-01T19:55:54.275 INFO:teuthology.orchestra.run.smithi008.stdout: "duration": 0 2023-08-01T19:55:54.275 INFO:teuthology.orchestra.run.smithi008.stdout: }, 2023-08-01T19:55:54.275 INFO:teuthology.orchestra.run.smithi008.stdout: { 2023-08-01T19:55:54.275 INFO:teuthology.orchestra.run.smithi008.stdout: "event": "throttled", 2023-08-01T19:55:54.275 INFO:teuthology.orchestra.run.smithi008.stdout: "time": "2023-08-01T19:55:54.263229+0000", 2023-08-01T19:55:54.275 INFO:teuthology.orchestra.run.smithi008.stdout: "duration": 0 2023-08-01T19:55:54.276 INFO:teuthology.orchestra.run.smithi008.stdout: }, 2023-08-01T19:55:54.276 INFO:teuthology.orchestra.run.smithi008.stdout: { 2023-08-01T19:55:54.276 INFO:teuthology.orchestra.run.smithi008.stdout: "event": "header_read", 2023-08-01T19:55:54.276 INFO:teuthology.orchestra.run.smithi008.stdout: "time": "2023-08-01T19:55:54.263228+0000", 2023-08-01T19:55:54.276 INFO:teuthology.orchestra.run.smithi008.stdout: "duration": 4294967295.999999 2023-08-01T19:55:54.276 INFO:teuthology.orchestra.run.smithi008.stdout: }, 2023-08-01T19:55:54.276 INFO:teuthology.orchestra.run.smithi008.stdout: { 2023-08-01T19:55:54.276 INFO:teuthology.orchestra.run.smithi008.stdout: "event": "all_read", 2023-08-01T19:55:54.277 INFO:teuthology.orchestra.run.smithi008.stdout: "time": "2023-08-01T19:55:54.263234+0000", 2023-08-01T19:55:54.277 INFO:teuthology.orchestra.run.smithi008.stdout: "duration": 5.8200000000000002e-06 2023-08-01T19:55:54.277 INFO:teuthology.orchestra.run.smithi008.stdout: }, 2023-08-01T19:55:54.277 INFO:teuthology.orchestra.run.smithi008.stdout: { 2023-08-01T19:55:54.277 INFO:teuthology.orchestra.run.smithi008.stdout: "event": "dispatched", 2023-08-01T19:55:54.277 INFO:teuthology.orchestra.run.smithi008.stdout: "time": "2023-08-01T19:55:54.263247+0000", 2023-08-01T19:55:54.277 INFO:teuthology.orchestra.run.smithi008.stdout: "duration": 1.3067999999999999e-05 2023-08-01T19:55:54.278 INFO:teuthology.orchestra.run.smithi008.stdout: }, 2023-08-01T19:55:54.278 INFO:teuthology.orchestra.run.smithi008.stdout: { 2023-08-01T19:55:54.278 INFO:teuthology.orchestra.run.smithi008.stdout: "event": "queued_for_pg", 2023-08-01T19:55:54.278 INFO:teuthology.orchestra.run.smithi008.stdout: "time": "2023-08-01T19:55:54.263253+0000", 2023-08-01T19:55:54.278 INFO:teuthology.orchestra.run.smithi008.stdout: "duration": 5.8810000000000001e-06 2023-08-01T19:55:54.278 INFO:teuthology.orchestra.run.smithi008.stdout: }, 2023-08-01T19:55:54.278 INFO:teuthology.orchestra.run.smithi008.stdout: { 2023-08-01T19:55:54.278 INFO:teuthology.orchestra.run.smithi008.stdout: "event": "reached_pg", 2023-08-01T19:55:54.279 INFO:teuthology.orchestra.run.smithi008.stdout: "time": "2023-08-01T19:55:54.263292+0000", 2023-08-01T19:55:54.279 INFO:teuthology.orchestra.run.smithi008.stdout: "duration": 3.9811999999999998e-05 2023-08-01T19:55:54.279 INFO:teuthology.orchestra.run.smithi008.stdout: }, 2023-08-01T19:55:54.279 INFO:teuthology.orchestra.run.smithi008.stdout: { 2023-08-01T19:55:54.279 INFO:teuthology.orchestra.run.smithi008.stdout: "event": "started", 2023-08-01T19:55:54.279 INFO:teuthology.orchestra.run.smithi008.stdout: "time": "2023-08-01T19:55:54.263417+0000", 2023-08-01T19:55:54.279 INFO:teuthology.orchestra.run.smithi008.stdout: "duration": 0.00012445300000000001 2023-08-01T19:55:54.279 INFO:teuthology.orchestra.run.smithi008.stdout: }, 2023-08-01T19:55:54.280 INFO:teuthology.orchestra.run.smithi008.stdout: { 2023-08-01T19:55:54.280 INFO:teuthology.orchestra.run.smithi008.stdout: "event": "waiting for subops from 1", 2023-08-01T19:55:54.280 INFO:teuthology.orchestra.run.smithi008.stdout: "time": "2023-08-01T19:55:54.263535+0000", 2023-08-01T19:55:54.280 INFO:teuthology.orchestra.run.smithi008.stdout: "duration": 0.000117992 2023-08-01T19:55:54.280 INFO:teuthology.orchestra.run.smithi008.stdout: } 2023-08-01T19:55:54.280 INFO:teuthology.orchestra.run.smithi008.stdout: ] 2023-08-01T19:55:54.280 INFO:teuthology.orchestra.run.smithi008.stdout: } 2023-08-01T19:55:54.281 INFO:teuthology.orchestra.run.smithi008.stdout: }, 2023-08-01T19:55:54.281 INFO:teuthology.orchestra.run.smithi008.stdout: { 2023-08-01T19:55:54.281 INFO:teuthology.orchestra.run.smithi008.stdout: "description": "osd_repop(client.4668.0:188770 5.e e59/19 5:78299d84:::benchmark_data_smithi006_114134_object55109:head v 59'11828, mlcod=59'11826)", 2023-08-01T19:55:54.281 INFO:teuthology.orchestra.run.smithi008.stdout: "initiated_at": "2023-08-01T19:55:54.264795+0000", 2023-08-01T19:55:54.281 INFO:teuthology.orchestra.run.smithi008.stdout: "age": 0.0034902790000000002, 2023-08-01T19:55:54.281 INFO:teuthology.orchestra.run.smithi008.stdout: "duration": 0.003616878, 2023-08-01T19:55:54.281 INFO:teuthology.orchestra.run.smithi008.stdout: "type_data": { 2023-08-01T19:55:54.281 INFO:teuthology.orchestra.run.smithi008.stdout: "flag_point": "started", 2023-08-01T19:55:54.282 INFO:teuthology.orchestra.run.smithi008.stdout: "events": [ 2023-08-01T19:55:54.282 INFO:teuthology.orchestra.run.smithi008.stdout: { 2023-08-01T19:55:54.282 INFO:teuthology.orchestra.run.smithi008.stdout: "event": "initiated", 2023-08-01T19:55:54.282 INFO:teuthology.orchestra.run.smithi008.stdout: "time": "2023-08-01T19:55:54.264795+0000", 2023-08-01T19:55:54.282 INFO:teuthology.orchestra.run.smithi008.stdout: "duration": 0 2023-08-01T19:55:54.282 INFO:teuthology.orchestra.run.smithi008.stdout: }, 2023-08-01T19:55:54.282 INFO:teuthology.orchestra.run.smithi008.stdout: { 2023-08-01T19:55:54.282 INFO:teuthology.orchestra.run.smithi008.stdout: "event": "throttled", 2023-08-01T19:55:54.283 INFO:teuthology.orchestra.run.smithi008.stdout: "time": "2023-08-01T19:55:54.264795+0000", 2023-08-01T19:55:54.283 INFO:teuthology.orchestra.run.smithi008.stdout: "duration": 0 2023-08-01T19:55:54.283 INFO:teuthology.orchestra.run.smithi008.stdout: }, 2023-08-01T19:55:54.283 INFO:teuthology.orchestra.run.smithi008.stdout: { 2023-08-01T19:55:54.283 INFO:teuthology.orchestra.run.smithi008.stdout: "event": "header_read", 2023-08-01T19:55:54.283 INFO:teuthology.orchestra.run.smithi008.stdout: "time": "2023-08-01T19:55:54.264795+0000", 2023-08-01T19:55:54.283 INFO:teuthology.orchestra.run.smithi008.stdout: "duration": 4294967295.9999995 2023-08-01T19:55:54.283 INFO:teuthology.orchestra.run.smithi008.stdout: }, 2023-08-01T19:55:54.284 INFO:teuthology.orchestra.run.smithi008.stdout: { 2023-08-01T19:55:54.284 INFO:teuthology.orchestra.run.smithi008.stdout: "event": "all_read", 2023-08-01T19:55:54.284 INFO:teuthology.orchestra.run.smithi008.stdout: "time": "2023-08-01T19:55:54.264799+0000", 2023-08-01T19:55:54.284 INFO:teuthology.orchestra.run.smithi008.stdout: "duration": 3.8929999999999998e-06 2023-08-01T19:55:54.284 INFO:teuthology.orchestra.run.smithi008.stdout: }, 2023-08-01T19:55:54.284 INFO:teuthology.orchestra.run.smithi008.stdout: { 2023-08-01T19:55:54.284 INFO:teuthology.orchestra.run.smithi008.stdout: "event": "dispatched", 2023-08-01T19:55:54.284 INFO:teuthology.orchestra.run.smithi008.stdout: "time": "2023-08-01T19:55:54.264810+0000", 2023-08-01T19:55:54.285 INFO:teuthology.orchestra.run.smithi008.stdout: "duration": 1.1311000000000001e-05 2023-08-01T19:55:54.285 INFO:teuthology.orchestra.run.smithi008.stdout: }, 2023-08-01T19:55:54.285 INFO:teuthology.orchestra.run.smithi008.stdout: { 2023-08-01T19:55:54.285 INFO:teuthology.orchestra.run.smithi008.stdout: "event": "queued_for_pg", 2023-08-01T19:55:54.285 INFO:teuthology.orchestra.run.smithi008.stdout: "time": "2023-08-01T19:55:54.264815+0000", 2023-08-01T19:55:54.285 INFO:teuthology.orchestra.run.smithi008.stdout: "duration": 4.2989999999999998e-06 2023-08-01T19:55:54.285 INFO:teuthology.orchestra.run.smithi008.stdout: }, 2023-08-01T19:55:54.286 INFO:teuthology.orchestra.run.smithi008.stdout: { 2023-08-01T19:55:54.286 INFO:teuthology.orchestra.run.smithi008.stdout: "event": "reached_pg", 2023-08-01T19:55:54.286 INFO:teuthology.orchestra.run.smithi008.stdout: "time": "2023-08-01T19:55:54.264847+0000", 2023-08-01T19:55:54.286 INFO:teuthology.orchestra.run.smithi008.stdout: "duration": 3.2477000000000001e-05 2023-08-01T19:55:54.286 INFO:teuthology.orchestra.run.smithi008.stdout: }, 2023-08-01T19:55:54.286 INFO:teuthology.orchestra.run.smithi008.stdout: { 2023-08-01T19:55:54.286 INFO:teuthology.orchestra.run.smithi008.stdout: "event": "started", 2023-08-01T19:55:54.286 INFO:teuthology.orchestra.run.smithi008.stdout: "time": "2023-08-01T19:55:54.264865+0000", 2023-08-01T19:55:54.287 INFO:teuthology.orchestra.run.smithi008.stdout: "duration": 1.8445999999999999e-05 2023-08-01T19:55:54.287 INFO:teuthology.orchestra.run.smithi008.stdout: } 2023-08-01T19:55:54.287 INFO:teuthology.orchestra.run.smithi008.stdout: ] 2023-08-01T19:55:54.287 INFO:teuthology.orchestra.run.smithi008.stdout: } 2023-08-01T19:55:54.287 INFO:teuthology.orchestra.run.smithi008.stdout: }, 2023-08-01T19:55:54.287 INFO:teuthology.orchestra.run.smithi008.stdout: { 2023-08-01T19:55:54.287 INFO:teuthology.orchestra.run.smithi008.stdout: "description": "osd_repop(client.4668.0:188773 5.2 e59/53 5:41a523a5:::benchmark_data_smithi006_114134_object55112:head v 59'12128, mlcod=59'12126)", 2023-08-01T19:55:54.287 INFO:teuthology.orchestra.run.smithi008.stdout: "initiated_at": "2023-08-01T19:55:54.264898+0000", 2023-08-01T19:55:54.288 INFO:teuthology.orchestra.run.smithi008.stdout: "age": 0.003387368, 2023-08-01T19:55:54.288 INFO:teuthology.orchestra.run.smithi008.stdout: "duration": 0.0035857900000000002, 2023-08-01T19:55:54.288 INFO:teuthology.orchestra.run.smithi008.stdout: "type_data": { 2023-08-01T19:55:54.288 INFO:teuthology.orchestra.run.smithi008.stdout: "flag_point": "started", 2023-08-01T19:55:54.288 INFO:teuthology.orchestra.run.smithi008.stdout: "events": [ 2023-08-01T19:55:54.288 INFO:teuthology.orchestra.run.smithi008.stdout: { 2023-08-01T19:55:54.288 INFO:teuthology.orchestra.run.smithi008.stdout: "event": "initiated", 2023-08-01T19:55:54.288 INFO:teuthology.orchestra.run.smithi008.stdout: "time": "2023-08-01T19:55:54.264898+0000", 2023-08-01T19:55:54.289 INFO:teuthology.orchestra.run.smithi008.stdout: "duration": 0 2023-08-01T19:55:54.289 INFO:teuthology.orchestra.run.smithi008.stdout: }, 2023-08-01T19:55:54.289 INFO:teuthology.orchestra.run.smithi008.stdout: { 2023-08-01T19:55:54.289 INFO:teuthology.orchestra.run.smithi008.stdout: "event": "throttled", 2023-08-01T19:55:54.289 INFO:teuthology.orchestra.run.smithi008.stdout: "time": "2023-08-01T19:55:54.264898+0000", 2023-08-01T19:55:54.289 INFO:teuthology.orchestra.run.smithi008.stdout: "duration": 0 2023-08-01T19:55:54.289 INFO:teuthology.orchestra.run.smithi008.stdout: }, 2023-08-01T19:55:54.289 INFO:teuthology.orchestra.run.smithi008.stdout: { 2023-08-01T19:55:54.290 INFO:teuthology.orchestra.run.smithi008.stdout: "event": "header_read", 2023-08-01T19:55:54.290 INFO:teuthology.orchestra.run.smithi008.stdout: "time": "2023-08-01T19:55:54.264898+0000", 2023-08-01T19:55:54.290 INFO:teuthology.orchestra.run.smithi008.stdout: "duration": 4294967295.9999995 2023-08-01T19:55:54.290 INFO:teuthology.orchestra.run.smithi008.stdout: }, 2023-08-01T19:55:54.290 INFO:teuthology.orchestra.run.smithi008.stdout: { 2023-08-01T19:55:54.290 INFO:teuthology.orchestra.run.smithi008.stdout: "event": "all_read", 2023-08-01T19:55:54.290 INFO:teuthology.orchestra.run.smithi008.stdout: "time": "2023-08-01T19:55:54.264902+0000", 2023-08-01T19:55:54.290 INFO:teuthology.orchestra.run.smithi008.stdout: "duration": 3.929e-06 2023-08-01T19:55:54.291 INFO:teuthology.orchestra.run.smithi008.stdout: }, 2023-08-01T19:55:54.291 INFO:teuthology.orchestra.run.smithi008.stdout: { 2023-08-01T19:55:54.291 INFO:teuthology.orchestra.run.smithi008.stdout: "event": "dispatched", 2023-08-01T19:55:54.291 INFO:teuthology.orchestra.run.smithi008.stdout: "time": "2023-08-01T19:55:54.264908+0000", 2023-08-01T19:55:54.291 INFO:teuthology.orchestra.run.smithi008.stdout: "duration": 6.3409999999999999e-06 2023-08-01T19:55:54.291 INFO:teuthology.orchestra.run.smithi008.stdout: }, 2023-08-01T19:55:54.291 INFO:teuthology.orchestra.run.smithi008.stdout: { 2023-08-01T19:55:54.291 INFO:teuthology.orchestra.run.smithi008.stdout: "event": "queued_for_pg", 2023-08-01T19:55:54.292 INFO:teuthology.orchestra.run.smithi008.stdout: "time": "2023-08-01T19:55:54.264913+0000", 2023-08-01T19:55:54.292 INFO:teuthology.orchestra.run.smithi008.stdout: "duration": 4.8269999999999997e-06 2023-08-01T19:55:54.292 INFO:teuthology.orchestra.run.smithi008.stdout: }, 2023-08-01T19:55:54.292 INFO:teuthology.orchestra.run.smithi008.stdout: { 2023-08-01T19:55:54.292 INFO:teuthology.orchestra.run.smithi008.stdout: "event": "reached_pg", 2023-08-01T19:55:54.292 INFO:teuthology.orchestra.run.smithi008.stdout: "time": "2023-08-01T19:55:54.264971+0000", 2023-08-01T19:55:54.292 INFO:teuthology.orchestra.run.smithi008.stdout: "duration": 5.8003e-05 2023-08-01T19:55:54.293 INFO:teuthology.orchestra.run.smithi008.stdout: }, 2023-08-01T19:55:54.293 INFO:teuthology.orchestra.run.smithi008.stdout: { 2023-08-01T19:55:54.293 INFO:teuthology.orchestra.run.smithi008.stdout: "event": "started", 2023-08-01T19:55:54.293 INFO:teuthology.orchestra.run.smithi008.stdout: "time": "2023-08-01T19:55:54.264982+0000", 2023-08-01T19:55:54.293 INFO:teuthology.orchestra.run.smithi008.stdout: "duration": 1.1083e-05 2023-08-01T19:55:54.293 INFO:teuthology.orchestra.run.smithi008.stdout: } 2023-08-01T19:55:54.293 INFO:teuthology.orchestra.run.smithi008.stdout: ] 2023-08-01T19:55:54.293 INFO:teuthology.orchestra.run.smithi008.stdout: } 2023-08-01T19:55:54.294 INFO:teuthology.orchestra.run.smithi008.stdout: }, 2023-08-01T19:55:54.294 INFO:teuthology.orchestra.run.smithi008.stdout: { 2023-08-01T19:55:54.294 INFO:teuthology.orchestra.run.smithi008.stdout: "description": "osd_op(client.4668.0:188774 5.5 5:a8c6e976:::benchmark_data_smithi006_114134_object55113:head [delete] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e59)", 2023-08-01T19:55:54.294 INFO:teuthology.orchestra.run.smithi008.stdout: "initiated_at": "2023-08-01T19:55:54.265025+0000", 2023-08-01T19:55:54.294 INFO:teuthology.orchestra.run.smithi008.stdout: "age": 0.0032606950000000001, 2023-08-01T19:55:54.294 INFO:teuthology.orchestra.run.smithi008.stdout: "duration": 0.0035314349999999999, 2023-08-01T19:55:54.294 INFO:teuthology.orchestra.run.smithi008.stdout: "type_data": { 2023-08-01T19:55:54.294 INFO:teuthology.orchestra.run.smithi008.stdout: "flag_point": "waiting for sub ops", 2023-08-01T19:55:54.295 INFO:teuthology.orchestra.run.smithi008.stdout: "client_info": { 2023-08-01T19:55:54.295 INFO:teuthology.orchestra.run.smithi008.stdout: "client": "client.4668", 2023-08-01T19:55:54.295 INFO:teuthology.orchestra.run.smithi008.stdout: "client_addr": "172.21.15.6:0/1709472247", 2023-08-01T19:55:54.295 INFO:teuthology.orchestra.run.smithi008.stdout: "tid": 188774 2023-08-01T19:55:54.295 INFO:teuthology.orchestra.run.smithi008.stdout: }, 2023-08-01T19:55:54.295 INFO:teuthology.orchestra.run.smithi008.stdout: "events": [ 2023-08-01T19:55:54.295 INFO:teuthology.orchestra.run.smithi008.stdout: { 2023-08-01T19:55:54.295 INFO:teuthology.orchestra.run.smithi008.stdout: "event": "initiated", 2023-08-01T19:55:54.296 INFO:teuthology.orchestra.run.smithi008.stdout: "time": "2023-08-01T19:55:54.265025+0000", 2023-08-01T19:55:54.296 INFO:teuthology.orchestra.run.smithi008.stdout: "duration": 0 2023-08-01T19:55:54.296 INFO:teuthology.orchestra.run.smithi008.stdout: }, 2023-08-01T19:55:54.296 INFO:teuthology.orchestra.run.smithi008.stdout: { 2023-08-01T19:55:54.296 INFO:teuthology.orchestra.run.smithi008.stdout: "event": "throttled", 2023-08-01T19:55:54.296 INFO:teuthology.orchestra.run.smithi008.stdout: "time": "2023-08-01T19:55:54.265025+0000", 2023-08-01T19:55:54.296 INFO:teuthology.orchestra.run.smithi008.stdout: "duration": 0 2023-08-01T19:55:54.296 INFO:teuthology.orchestra.run.smithi008.stdout: }, 2023-08-01T19:55:54.297 INFO:teuthology.orchestra.run.smithi008.stdout: { 2023-08-01T19:55:54.297 INFO:teuthology.orchestra.run.smithi008.stdout: "event": "header_read", 2023-08-01T19:55:54.297 INFO:teuthology.orchestra.run.smithi008.stdout: "time": "2023-08-01T19:55:54.265024+0000", 2023-08-01T19:55:54.297 INFO:teuthology.orchestra.run.smithi008.stdout: "duration": 4294967295.999999 2023-08-01T19:55:54.297 INFO:teuthology.orchestra.run.smithi008.stdout: }, 2023-08-01T19:55:54.297 INFO:teuthology.orchestra.run.smithi008.stdout: { 2023-08-01T19:55:54.297 INFO:teuthology.orchestra.run.smithi008.stdout: "event": "all_read", 2023-08-01T19:55:54.298 INFO:teuthology.orchestra.run.smithi008.stdout: "time": "2023-08-01T19:55:54.265030+0000", 2023-08-01T19:55:54.298 INFO:teuthology.orchestra.run.smithi008.stdout: "duration": 5.5060000000000003e-06 2023-08-01T19:55:54.298 INFO:teuthology.orchestra.run.smithi008.stdout: }, 2023-08-01T19:55:54.298 INFO:teuthology.orchestra.run.smithi008.stdout: { 2023-08-01T19:55:54.298 INFO:teuthology.orchestra.run.smithi008.stdout: "event": "dispatched", 2023-08-01T19:55:54.298 INFO:teuthology.orchestra.run.smithi008.stdout: "time": "2023-08-01T19:55:54.265039+0000", 2023-08-01T19:55:54.298 INFO:teuthology.orchestra.run.smithi008.stdout: "duration": 9.7389999999999994e-06 2023-08-01T19:55:54.298 INFO:teuthology.orchestra.run.smithi008.stdout: }, 2023-08-01T19:55:54.299 INFO:teuthology.orchestra.run.smithi008.stdout: { 2023-08-01T19:55:54.299 INFO:teuthology.orchestra.run.smithi008.stdout: "event": "queued_for_pg", 2023-08-01T19:55:54.299 INFO:teuthology.orchestra.run.smithi008.stdout: "time": "2023-08-01T19:55:54.265045+0000", 2023-08-01T19:55:54.299 INFO:teuthology.orchestra.run.smithi008.stdout: "duration": 5.7590000000000003e-06 2023-08-01T19:55:54.299 INFO:teuthology.orchestra.run.smithi008.stdout: }, 2023-08-01T19:55:54.299 INFO:teuthology.orchestra.run.smithi008.stdout: { 2023-08-01T19:55:54.299 INFO:teuthology.orchestra.run.smithi008.stdout: "event": "reached_pg", 2023-08-01T19:55:54.299 INFO:teuthology.orchestra.run.smithi008.stdout: "time": "2023-08-01T19:55:54.265082+0000", 2023-08-01T19:55:54.300 INFO:teuthology.orchestra.run.smithi008.stdout: "duration": 3.6837e-05 2023-08-01T19:55:54.300 INFO:teuthology.orchestra.run.smithi008.stdout: }, 2023-08-01T19:55:54.300 INFO:teuthology.orchestra.run.smithi008.stdout: { 2023-08-01T19:55:54.300 INFO:teuthology.orchestra.run.smithi008.stdout: "event": "started", 2023-08-01T19:55:54.300 INFO:teuthology.orchestra.run.smithi008.stdout: "time": "2023-08-01T19:55:54.265198+0000", 2023-08-01T19:55:54.300 INFO:teuthology.orchestra.run.smithi008.stdout: "duration": 0.000116272 2023-08-01T19:55:54.300 INFO:teuthology.orchestra.run.smithi008.stdout: }, 2023-08-01T19:55:54.300 INFO:teuthology.orchestra.run.smithi008.stdout: { 2023-08-01T19:55:54.301 INFO:teuthology.orchestra.run.smithi008.stdout: "event": "waiting for subops from 1", 2023-08-01T19:55:54.301 INFO:teuthology.orchestra.run.smithi008.stdout: "time": "2023-08-01T19:55:54.265310+0000", 2023-08-01T19:55:54.301 INFO:teuthology.orchestra.run.smithi008.stdout: "duration": 0.000112211 2023-08-01T19:55:54.301 INFO:teuthology.orchestra.run.smithi008.stdout: } 2023-08-01T19:55:54.301 INFO:teuthology.orchestra.run.smithi008.stdout: ] 2023-08-01T19:55:54.301 INFO:teuthology.orchestra.run.smithi008.stdout: } 2023-08-01T19:55:54.301 INFO:teuthology.orchestra.run.smithi008.stdout: }, 2023-08-01T19:55:54.302 INFO:teuthology.orchestra.run.smithi008.stdout: { 2023-08-01T19:55:54.302 INFO:teuthology.orchestra.run.smithi008.stdout: "description": "osd_op(client.4668.0:188775 5.6 5:6423881c:::benchmark_data_smithi006_114134_object55114:head [delete] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e59)", 2023-08-01T19:55:54.302 INFO:teuthology.orchestra.run.smithi008.stdout: "initiated_at": "2023-08-01T19:55:54.266701+0000", 2023-08-01T19:55:54.302 INFO:teuthology.orchestra.run.smithi008.stdout: "age": 0.0015851859999999999, 2023-08-01T19:55:54.302 INFO:teuthology.orchestra.run.smithi008.stdout: "duration": 0.0019387429999999999, 2023-08-01T19:55:54.302 INFO:teuthology.orchestra.run.smithi008.stdout: "type_data": { 2023-08-01T19:55:54.302 INFO:teuthology.orchestra.run.smithi008.stdout: "flag_point": "waiting for sub ops", 2023-08-01T19:55:54.302 INFO:teuthology.orchestra.run.smithi008.stdout: "client_info": { 2023-08-01T19:55:54.303 INFO:teuthology.orchestra.run.smithi008.stdout: "client": "client.4668", 2023-08-01T19:55:54.303 INFO:teuthology.orchestra.run.smithi008.stdout: "client_addr": "172.21.15.6:0/1709472247", 2023-08-01T19:55:54.303 INFO:teuthology.orchestra.run.smithi008.stdout: "tid": 188775 2023-08-01T19:55:54.303 INFO:teuthology.orchestra.run.smithi008.stdout: }, 2023-08-01T19:55:54.303 INFO:teuthology.orchestra.run.smithi008.stdout: "events": [ 2023-08-01T19:55:54.303 INFO:teuthology.orchestra.run.smithi008.stdout: { 2023-08-01T19:55:54.303 INFO:teuthology.orchestra.run.smithi008.stdout: "event": "initiated", 2023-08-01T19:55:54.303 INFO:teuthology.orchestra.run.smithi008.stdout: "time": "2023-08-01T19:55:54.266701+0000", 2023-08-01T19:55:54.304 INFO:teuthology.orchestra.run.smithi008.stdout: "duration": 0 2023-08-01T19:55:54.304 INFO:teuthology.orchestra.run.smithi008.stdout: }, 2023-08-01T19:55:54.304 INFO:teuthology.orchestra.run.smithi008.stdout: { 2023-08-01T19:55:54.304 INFO:teuthology.orchestra.run.smithi008.stdout: "event": "throttled", 2023-08-01T19:55:54.304 INFO:teuthology.orchestra.run.smithi008.stdout: "time": "2023-08-01T19:55:54.266701+0000", 2023-08-01T19:55:54.304 INFO:teuthology.orchestra.run.smithi008.stdout: "duration": 0 2023-08-01T19:55:54.304 INFO:teuthology.orchestra.run.smithi008.stdout: }, 2023-08-01T19:55:54.304 INFO:teuthology.orchestra.run.smithi008.stdout: { 2023-08-01T19:55:54.305 INFO:teuthology.orchestra.run.smithi008.stdout: "event": "header_read", 2023-08-01T19:55:54.305 INFO:teuthology.orchestra.run.smithi008.stdout: "time": "2023-08-01T19:55:54.266700+0000", 2023-08-01T19:55:54.305 INFO:teuthology.orchestra.run.smithi008.stdout: "duration": 4294967295.9999995 2023-08-01T19:55:54.305 INFO:teuthology.orchestra.run.smithi008.stdout: }, 2023-08-01T19:55:54.305 INFO:teuthology.orchestra.run.smithi008.stdout: { 2023-08-01T19:55:54.305 INFO:teuthology.orchestra.run.smithi008.stdout: "event": "all_read", 2023-08-01T19:55:54.305 INFO:teuthology.orchestra.run.smithi008.stdout: "time": "2023-08-01T19:55:54.266703+0000", 2023-08-01T19:55:54.305 INFO:teuthology.orchestra.run.smithi008.stdout: "duration": 3.5130000000000001e-06 2023-08-01T19:55:54.306 INFO:teuthology.orchestra.run.smithi008.stdout: }, 2023-08-01T19:55:54.306 INFO:teuthology.orchestra.run.smithi008.stdout: { 2023-08-01T19:55:54.306 INFO:teuthology.orchestra.run.smithi008.stdout: "event": "dispatched", 2023-08-01T19:55:54.306 INFO:teuthology.orchestra.run.smithi008.stdout: "time": "2023-08-01T19:55:54.266713+0000", 2023-08-01T19:55:54.306 INFO:teuthology.orchestra.run.smithi008.stdout: "duration": 9.4380000000000001e-06 2023-08-01T19:55:54.306 INFO:teuthology.orchestra.run.smithi008.stdout: }, 2023-08-01T19:55:54.306 INFO:teuthology.orchestra.run.smithi008.stdout: { 2023-08-01T19:55:54.306 INFO:teuthology.orchestra.run.smithi008.stdout: "event": "queued_for_pg", 2023-08-01T19:55:54.307 INFO:teuthology.orchestra.run.smithi008.stdout: "time": "2023-08-01T19:55:54.266718+0000", 2023-08-01T19:55:54.307 INFO:teuthology.orchestra.run.smithi008.stdout: "duration": 4.9699999999999998e-06 2023-08-01T19:55:54.307 INFO:teuthology.orchestra.run.smithi008.stdout: }, 2023-08-01T19:55:54.307 INFO:teuthology.orchestra.run.smithi008.stdout: { 2023-08-01T19:55:54.307 INFO:teuthology.orchestra.run.smithi008.stdout: "event": "reached_pg", 2023-08-01T19:55:54.307 INFO:teuthology.orchestra.run.smithi008.stdout: "time": "2023-08-01T19:55:54.266747+0000", 2023-08-01T19:55:54.307 INFO:teuthology.orchestra.run.smithi008.stdout: "duration": 2.8721000000000002e-05 2023-08-01T19:55:54.308 INFO:teuthology.orchestra.run.smithi008.stdout: }, 2023-08-01T19:55:54.308 INFO:teuthology.orchestra.run.smithi008.stdout: { 2023-08-01T19:55:54.308 INFO:teuthology.orchestra.run.smithi008.stdout: "event": "started", 2023-08-01T19:55:54.308 INFO:teuthology.orchestra.run.smithi008.stdout: "time": "2023-08-01T19:55:54.266845+0000", 2023-08-01T19:55:54.308 INFO:teuthology.orchestra.run.smithi008.stdout: "duration": 9.8708000000000004e-05 2023-08-01T19:55:54.308 INFO:teuthology.orchestra.run.smithi008.stdout: }, 2023-08-01T19:55:54.308 INFO:teuthology.orchestra.run.smithi008.stdout: { 2023-08-01T19:55:54.308 INFO:teuthology.orchestra.run.smithi008.stdout: "event": "waiting for subops from 1", 2023-08-01T19:55:54.309 INFO:teuthology.orchestra.run.smithi008.stdout: "time": "2023-08-01T19:55:54.266908+0000", 2023-08-01T19:55:54.309 INFO:teuthology.orchestra.run.smithi008.stdout: "duration": 6.2890000000000003e-05 2023-08-01T19:55:54.309 INFO:teuthology.orchestra.run.smithi008.stdout: } 2023-08-01T19:55:54.309 INFO:teuthology.orchestra.run.smithi008.stdout: ] 2023-08-01T19:55:54.309 INFO:teuthology.orchestra.run.smithi008.stdout: } 2023-08-01T19:55:54.309 INFO:teuthology.orchestra.run.smithi008.stdout: }, 2023-08-01T19:55:54.309 INFO:teuthology.orchestra.run.smithi008.stdout: { 2023-08-01T19:55:54.309 INFO:teuthology.orchestra.run.smithi008.stdout: "description": "osd_op(client.4668.0:188779 5.6 5.fccb0516 (undecoded) ondisk+write+known_if_redirected+supports_pool_eio e59)", 2023-08-01T19:55:54.310 INFO:teuthology.orchestra.run.smithi008.stdout: "initiated_at": "2023-08-01T19:55:54.267475+0000", 2023-08-01T19:55:54.310 INFO:teuthology.orchestra.run.smithi008.stdout: "age": 0.000810733, 2023-08-01T19:55:54.310 INFO:teuthology.orchestra.run.smithi008.stdout: "duration": 0.0012418100000000001, 2023-08-01T19:55:54.310 INFO:teuthology.orchestra.run.smithi008.stdout: "type_data": { 2023-08-01T19:55:54.310 INFO:teuthology.orchestra.run.smithi008.stdout: "flag_point": "queued for pg", 2023-08-01T19:55:54.310 INFO:teuthology.orchestra.run.smithi008.stdout: "client_info": { 2023-08-01T19:55:54.310 INFO:teuthology.orchestra.run.smithi008.stdout: "client": "client.4668", 2023-08-01T19:55:54.310 INFO:teuthology.orchestra.run.smithi008.stdout: "client_addr": "172.21.15.6:0/1709472247", 2023-08-01T19:55:54.311 INFO:teuthology.orchestra.run.smithi008.stdout: "tid": 188779 2023-08-01T19:55:54.311 INFO:teuthology.orchestra.run.smithi008.stdout: }, 2023-08-01T19:55:54.311 INFO:teuthology.orchestra.run.smithi008.stdout: "events": [ 2023-08-01T19:55:54.311 INFO:teuthology.orchestra.run.smithi008.stdout: { 2023-08-01T19:55:54.311 INFO:teuthology.orchestra.run.smithi008.stdout: "event": "initiated", 2023-08-01T19:55:54.311 INFO:teuthology.orchestra.run.smithi008.stdout: "time": "2023-08-01T19:55:54.267475+0000", 2023-08-01T19:55:54.311 INFO:teuthology.orchestra.run.smithi008.stdout: "duration": 0 2023-08-01T19:55:54.311 INFO:teuthology.orchestra.run.smithi008.stdout: }, 2023-08-01T19:55:54.312 INFO:teuthology.orchestra.run.smithi008.stdout: { 2023-08-01T19:55:54.312 INFO:teuthology.orchestra.run.smithi008.stdout: "event": "throttled", 2023-08-01T19:55:54.312 INFO:teuthology.orchestra.run.smithi008.stdout: "time": "2023-08-01T19:55:54.267475+0000", 2023-08-01T19:55:54.312 INFO:teuthology.orchestra.run.smithi008.stdout: "duration": 0 2023-08-01T19:55:54.312 INFO:teuthology.orchestra.run.smithi008.stdout: }, 2023-08-01T19:55:54.312 INFO:teuthology.orchestra.run.smithi008.stdout: { 2023-08-01T19:55:54.312 INFO:teuthology.orchestra.run.smithi008.stdout: "event": "header_read", 2023-08-01T19:55:54.312 INFO:teuthology.orchestra.run.smithi008.stdout: "time": "2023-08-01T19:55:54.267474+0000", 2023-08-01T19:55:54.313 INFO:teuthology.orchestra.run.smithi008.stdout: "duration": 4294967295.999999 2023-08-01T19:55:54.313 INFO:teuthology.orchestra.run.smithi008.stdout: }, 2023-08-01T19:55:54.313 INFO:teuthology.orchestra.run.smithi008.stdout: { 2023-08-01T19:55:54.313 INFO:teuthology.orchestra.run.smithi008.stdout: "event": "all_read", 2023-08-01T19:55:54.313 INFO:teuthology.orchestra.run.smithi008.stdout: "time": "2023-08-01T19:55:54.267479+0000", 2023-08-01T19:55:54.313 INFO:teuthology.orchestra.run.smithi008.stdout: "duration": 5.2129999999999999e-06 2023-08-01T19:55:54.313 INFO:teuthology.orchestra.run.smithi008.stdout: }, 2023-08-01T19:55:54.314 INFO:teuthology.orchestra.run.smithi008.stdout: { 2023-08-01T19:55:54.314 INFO:teuthology.orchestra.run.smithi008.stdout: "event": "dispatched", 2023-08-01T19:55:54.314 INFO:teuthology.orchestra.run.smithi008.stdout: "time": "2023-08-01T19:55:54.267492+0000", 2023-08-01T19:55:54.314 INFO:teuthology.orchestra.run.smithi008.stdout: "duration": 1.2500000000000001e-05 2023-08-01T19:55:54.314 INFO:teuthology.orchestra.run.smithi008.stdout: }, 2023-08-01T19:55:54.314 INFO:teuthology.orchestra.run.smithi008.stdout: { 2023-08-01T19:55:54.314 INFO:teuthology.orchestra.run.smithi008.stdout: "event": "queued_for_pg", 2023-08-01T19:55:54.314 INFO:teuthology.orchestra.run.smithi008.stdout: "time": "2023-08-01T19:55:54.267499+0000", 2023-08-01T19:55:54.315 INFO:teuthology.orchestra.run.smithi008.stdout: "duration": 6.9530000000000002e-06 2023-08-01T19:55:54.315 INFO:teuthology.orchestra.run.smithi008.stdout: } 2023-08-01T19:55:54.315 INFO:teuthology.orchestra.run.smithi008.stdout: ] 2023-08-01T19:55:54.315 INFO:teuthology.orchestra.run.smithi008.stdout: } 2023-08-01T19:55:54.315 INFO:teuthology.orchestra.run.smithi008.stdout: }, 2023-08-01T19:55:54.315 INFO:teuthology.orchestra.run.smithi008.stdout: { 2023-08-01T19:55:54.315 INFO:teuthology.orchestra.run.smithi008.stdout: "description": "osd_repop(client.4668.0:188777 5.b e59/19 5:d887e738:::benchmark_data_smithi006_114134_object55116:head v 59'11730, mlcod=59'11728)", 2023-08-01T19:55:54.315 INFO:teuthology.orchestra.run.smithi008.stdout: "initiated_at": "2023-08-01T19:55:54.267593+0000", 2023-08-01T19:55:54.316 INFO:teuthology.orchestra.run.smithi008.stdout: "age": 0.00069266100000000001, 2023-08-01T19:55:54.316 INFO:teuthology.orchestra.run.smithi008.stdout: "duration": 0.0011869789999999999, 2023-08-01T19:55:54.316 INFO:teuthology.orchestra.run.smithi008.stdout: "type_data": { 2023-08-01T19:55:54.316 INFO:teuthology.orchestra.run.smithi008.stdout: "flag_point": "started", 2023-08-01T19:55:54.316 INFO:teuthology.orchestra.run.smithi008.stdout: "events": [ 2023-08-01T19:55:54.316 INFO:teuthology.orchestra.run.smithi008.stdout: { 2023-08-01T19:55:54.316 INFO:teuthology.orchestra.run.smithi008.stdout: "event": "initiated", 2023-08-01T19:55:54.316 INFO:teuthology.orchestra.run.smithi008.stdout: "time": "2023-08-01T19:55:54.267593+0000", 2023-08-01T19:55:54.317 INFO:teuthology.orchestra.run.smithi008.stdout: "duration": 0 2023-08-01T19:55:54.317 INFO:teuthology.orchestra.run.smithi008.stdout: }, 2023-08-01T19:55:54.317 INFO:teuthology.orchestra.run.smithi008.stdout: { 2023-08-01T19:55:54.317 INFO:teuthology.orchestra.run.smithi008.stdout: "event": "throttled", 2023-08-01T19:55:54.317 INFO:teuthology.orchestra.run.smithi008.stdout: "time": "2023-08-01T19:55:54.267593+0000", 2023-08-01T19:55:54.317 INFO:teuthology.orchestra.run.smithi008.stdout: "duration": 0 2023-08-01T19:55:54.317 INFO:teuthology.orchestra.run.smithi008.stdout: }, 2023-08-01T19:55:54.317 INFO:teuthology.orchestra.run.smithi008.stdout: { 2023-08-01T19:55:54.318 INFO:teuthology.orchestra.run.smithi008.stdout: "event": "header_read", 2023-08-01T19:55:54.318 INFO:teuthology.orchestra.run.smithi008.stdout: "time": "2023-08-01T19:55:54.267592+0000", 2023-08-01T19:55:54.318 INFO:teuthology.orchestra.run.smithi008.stdout: "duration": 4294967295.9999995 2023-08-01T19:55:54.318 INFO:teuthology.orchestra.run.smithi008.stdout: }, 2023-08-01T19:55:54.318 INFO:teuthology.orchestra.run.smithi008.stdout: { 2023-08-01T19:55:54.318 INFO:teuthology.orchestra.run.smithi008.stdout: "event": "all_read", 2023-08-01T19:55:54.318 INFO:teuthology.orchestra.run.smithi008.stdout: "time": "2023-08-01T19:55:54.267599+0000", 2023-08-01T19:55:54.318 INFO:teuthology.orchestra.run.smithi008.stdout: "duration": 6.5849999999999996e-06 2023-08-01T19:55:54.319 INFO:teuthology.orchestra.run.smithi008.stdout: }, 2023-08-01T19:55:54.319 INFO:teuthology.orchestra.run.smithi008.stdout: { 2023-08-01T19:55:54.319 INFO:teuthology.orchestra.run.smithi008.stdout: "event": "dispatched", 2023-08-01T19:55:54.319 INFO:teuthology.orchestra.run.smithi008.stdout: "time": "2023-08-01T19:55:54.267609+0000", 2023-08-01T19:55:54.319 INFO:teuthology.orchestra.run.smithi008.stdout: "duration": 9.7289999999999995e-06 2023-08-01T19:55:54.319 INFO:teuthology.orchestra.run.smithi008.stdout: }, 2023-08-01T19:55:54.319 INFO:teuthology.orchestra.run.smithi008.stdout: { 2023-08-01T19:55:54.319 INFO:teuthology.orchestra.run.smithi008.stdout: "event": "queued_for_pg", 2023-08-01T19:55:54.320 INFO:teuthology.orchestra.run.smithi008.stdout: "time": "2023-08-01T19:55:54.267613+0000", 2023-08-01T19:55:54.320 INFO:teuthology.orchestra.run.smithi008.stdout: "duration": 3.9040000000000002e-06 2023-08-01T19:55:54.320 INFO:teuthology.orchestra.run.smithi008.stdout: }, 2023-08-01T19:55:54.320 INFO:teuthology.orchestra.run.smithi008.stdout: { 2023-08-01T19:55:54.320 INFO:teuthology.orchestra.run.smithi008.stdout: "event": "reached_pg", 2023-08-01T19:55:54.320 INFO:teuthology.orchestra.run.smithi008.stdout: "time": "2023-08-01T19:55:54.267671+0000", 2023-08-01T19:55:54.320 INFO:teuthology.orchestra.run.smithi008.stdout: "duration": 5.8161000000000001e-05 2023-08-01T19:55:54.321 INFO:teuthology.orchestra.run.smithi008.stdout: }, 2023-08-01T19:55:54.321 INFO:teuthology.orchestra.run.smithi008.stdout: { 2023-08-01T19:55:54.321 INFO:teuthology.orchestra.run.smithi008.stdout: "event": "started", 2023-08-01T19:55:54.321 INFO:teuthology.orchestra.run.smithi008.stdout: "time": "2023-08-01T19:55:54.267682+0000", 2023-08-01T19:55:54.321 INFO:teuthology.orchestra.run.smithi008.stdout: "duration": 1.1358e-05 2023-08-01T19:55:54.321 INFO:teuthology.orchestra.run.smithi008.stdout: } 2023-08-01T19:55:54.321 INFO:teuthology.orchestra.run.smithi008.stdout: ] 2023-08-01T19:55:54.321 INFO:teuthology.orchestra.run.smithi008.stdout: } 2023-08-01T19:55:54.322 INFO:teuthology.orchestra.run.smithi008.stdout: }, 2023-08-01T19:55:54.322 INFO:teuthology.orchestra.run.smithi008.stdout: { 2023-08-01T19:55:54.322 INFO:teuthology.orchestra.run.smithi008.stdout: "description": "osd_repop(client.4668.0:188776 5.7 e59/19 5:eb02af67:::benchmark_data_smithi006_114134_object55115:head v 59'11788, mlcod=59'11784)", 2023-08-01T19:55:54.322 INFO:teuthology.orchestra.run.smithi008.stdout: "initiated_at": "2023-08-01T19:55:54.267640+0000", 2023-08-01T19:55:54.322 INFO:teuthology.orchestra.run.smithi008.stdout: "age": 0.000645512, 2023-08-01T19:55:54.322 INFO:teuthology.orchestra.run.smithi008.stdout: "duration": 0.001209971, 2023-08-01T19:55:54.322 INFO:teuthology.orchestra.run.smithi008.stdout: "type_data": { 2023-08-01T19:55:54.322 INFO:teuthology.orchestra.run.smithi008.stdout: "flag_point": "started", 2023-08-01T19:55:54.323 INFO:teuthology.orchestra.run.smithi008.stdout: "events": [ 2023-08-01T19:55:54.323 INFO:teuthology.orchestra.run.smithi008.stdout: { 2023-08-01T19:55:54.323 INFO:teuthology.orchestra.run.smithi008.stdout: "event": "initiated", 2023-08-01T19:55:54.323 INFO:teuthology.orchestra.run.smithi008.stdout: "time": "2023-08-01T19:55:54.267640+0000", 2023-08-01T19:55:54.323 INFO:teuthology.orchestra.run.smithi008.stdout: "duration": 0 2023-08-01T19:55:54.323 INFO:teuthology.orchestra.run.smithi008.stdout: }, 2023-08-01T19:55:54.323 INFO:teuthology.orchestra.run.smithi008.stdout: { 2023-08-01T19:55:54.323 INFO:teuthology.orchestra.run.smithi008.stdout: "event": "throttled", 2023-08-01T19:55:54.324 INFO:teuthology.orchestra.run.smithi008.stdout: "time": "2023-08-01T19:55:54.267640+0000", 2023-08-01T19:55:54.324 INFO:teuthology.orchestra.run.smithi008.stdout: "duration": 0 2023-08-01T19:55:54.324 INFO:teuthology.orchestra.run.smithi008.stdout: }, 2023-08-01T19:55:54.324 INFO:teuthology.orchestra.run.smithi008.stdout: { 2023-08-01T19:55:54.324 INFO:teuthology.orchestra.run.smithi008.stdout: "event": "header_read", 2023-08-01T19:55:54.324 INFO:teuthology.orchestra.run.smithi008.stdout: "time": "2023-08-01T19:55:54.267640+0000", 2023-08-01T19:55:54.324 INFO:teuthology.orchestra.run.smithi008.stdout: "duration": 4294967295.9999995 2023-08-01T19:55:54.325 INFO:teuthology.orchestra.run.smithi008.stdout: }, 2023-08-01T19:55:54.325 INFO:teuthology.orchestra.run.smithi008.stdout: { 2023-08-01T19:55:54.325 INFO:teuthology.orchestra.run.smithi008.stdout: "event": "all_read", 2023-08-01T19:55:54.325 INFO:teuthology.orchestra.run.smithi008.stdout: "time": "2023-08-01T19:55:54.267643+0000", 2023-08-01T19:55:54.325 INFO:teuthology.orchestra.run.smithi008.stdout: "duration": 3.3019999999999999e-06 2023-08-01T19:55:54.325 INFO:teuthology.orchestra.run.smithi008.stdout: }, 2023-08-01T19:55:54.325 INFO:teuthology.orchestra.run.smithi008.stdout: { 2023-08-01T19:55:54.325 INFO:teuthology.orchestra.run.smithi008.stdout: "event": "dispatched", 2023-08-01T19:55:54.326 INFO:teuthology.orchestra.run.smithi008.stdout: "time": "2023-08-01T19:55:54.267649+0000", 2023-08-01T19:55:54.326 INFO:teuthology.orchestra.run.smithi008.stdout: "duration": 5.8590000000000001e-06 2023-08-01T19:55:54.326 INFO:teuthology.orchestra.run.smithi008.stdout: }, 2023-08-01T19:55:54.326 INFO:teuthology.orchestra.run.smithi008.stdout: { 2023-08-01T19:55:54.326 INFO:teuthology.orchestra.run.smithi008.stdout: "event": "queued_for_pg", 2023-08-01T19:55:54.326 INFO:teuthology.orchestra.run.smithi008.stdout: "time": "2023-08-01T19:55:54.267652+0000", 2023-08-01T19:55:54.326 INFO:teuthology.orchestra.run.smithi008.stdout: "duration": 3.05e-06 2023-08-01T19:55:54.326 INFO:teuthology.orchestra.run.smithi008.stdout: }, 2023-08-01T19:55:54.327 INFO:teuthology.orchestra.run.smithi008.stdout: { 2023-08-01T19:55:54.327 INFO:teuthology.orchestra.run.smithi008.stdout: "event": "reached_pg", 2023-08-01T19:55:54.327 INFO:teuthology.orchestra.run.smithi008.stdout: "time": "2023-08-01T19:55:54.268392+0000", 2023-08-01T19:55:54.327 INFO:teuthology.orchestra.run.smithi008.stdout: "duration": 0.00074012199999999996 2023-08-01T19:55:54.327 INFO:teuthology.orchestra.run.smithi008.stdout: }, 2023-08-01T19:55:54.327 INFO:teuthology.orchestra.run.smithi008.stdout: { 2023-08-01T19:55:54.327 INFO:teuthology.orchestra.run.smithi008.stdout: "event": "started", 2023-08-01T19:55:54.327 INFO:teuthology.orchestra.run.smithi008.stdout: "time": "2023-08-01T19:55:54.268408+0000", 2023-08-01T19:55:54.328 INFO:teuthology.orchestra.run.smithi008.stdout: "duration": 1.6223e-05 2023-08-01T19:55:54.328 INFO:teuthology.orchestra.run.smithi008.stdout: } 2023-08-01T19:55:54.328 INFO:teuthology.orchestra.run.smithi008.stdout: ] 2023-08-01T19:55:54.328 INFO:teuthology.orchestra.run.smithi008.stdout: } 2023-08-01T19:55:54.328 INFO:teuthology.orchestra.run.smithi008.stdout: }, 2023-08-01T19:55:54.328 INFO:teuthology.orchestra.run.smithi008.stdout: { 2023-08-01T19:55:54.328 INFO:teuthology.orchestra.run.smithi008.stdout: "description": "osd_repop(client.4668.0:188778 5.0 e59/19)", 2023-08-01T19:55:54.328 INFO:teuthology.orchestra.run.smithi008.stdout: "initiated_at": "2023-08-01T19:55:54.268404+0000", 2023-08-01T19:55:54.329 INFO:teuthology.orchestra.run.smithi008.stdout: "age": 4294967295.9998822, 2023-08-01T19:55:54.329 INFO:teuthology.orchestra.run.smithi008.stdout: "duration": 0.00051520299999999999, 2023-08-01T19:55:54.329 INFO:teuthology.orchestra.run.smithi008.stdout: "type_data": { 2023-08-01T19:55:54.329 INFO:teuthology.orchestra.run.smithi008.stdout: "flag_point": "queued for pg", 2023-08-01T19:55:54.329 INFO:teuthology.orchestra.run.smithi008.stdout: "events": [ 2023-08-01T19:55:54.329 INFO:teuthology.orchestra.run.smithi008.stdout: { 2023-08-01T19:55:54.329 INFO:teuthology.orchestra.run.smithi008.stdout: "event": "initiated", 2023-08-01T19:55:54.330 INFO:teuthology.orchestra.run.smithi008.stdout: "time": "2023-08-01T19:55:54.268404+0000", 2023-08-01T19:55:54.330 INFO:teuthology.orchestra.run.smithi008.stdout: "duration": 0 2023-08-01T19:55:54.330 INFO:teuthology.orchestra.run.smithi008.stdout: }, 2023-08-01T19:55:54.330 INFO:teuthology.orchestra.run.smithi008.stdout: { 2023-08-01T19:55:54.330 INFO:teuthology.orchestra.run.smithi008.stdout: "event": "throttled", 2023-08-01T19:55:54.330 INFO:teuthology.orchestra.run.smithi008.stdout: "time": "2023-08-01T19:55:54.268404+0000", 2023-08-01T19:55:54.330 INFO:teuthology.orchestra.run.smithi008.stdout: "duration": 0 2023-08-01T19:55:54.330 INFO:teuthology.orchestra.run.smithi008.stdout: }, 2023-08-01T19:55:54.331 INFO:teuthology.orchestra.run.smithi008.stdout: { 2023-08-01T19:55:54.331 INFO:teuthology.orchestra.run.smithi008.stdout: "event": "header_read", 2023-08-01T19:55:54.331 INFO:teuthology.orchestra.run.smithi008.stdout: "time": "2023-08-01T19:55:54.268403+0000", 2023-08-01T19:55:54.331 INFO:teuthology.orchestra.run.smithi008.stdout: "duration": 4294967295.9999995 2023-08-01T19:55:54.331 INFO:teuthology.orchestra.run.smithi008.stdout: }, 2023-08-01T19:55:54.331 INFO:teuthology.orchestra.run.smithi008.stdout: { 2023-08-01T19:55:54.331 INFO:teuthology.orchestra.run.smithi008.stdout: "event": "all_read", 2023-08-01T19:55:54.331 INFO:teuthology.orchestra.run.smithi008.stdout: "time": "2023-08-01T19:55:54.268409+0000", 2023-08-01T19:55:54.332 INFO:teuthology.orchestra.run.smithi008.stdout: "duration": 6.3099999999999997e-06 2023-08-01T19:55:54.332 INFO:teuthology.orchestra.run.smithi008.stdout: }, 2023-08-01T19:55:54.332 INFO:teuthology.orchestra.run.smithi008.stdout: { 2023-08-01T19:55:54.332 INFO:teuthology.orchestra.run.smithi008.stdout: "event": "dispatched", 2023-08-01T19:55:54.332 INFO:teuthology.orchestra.run.smithi008.stdout: "time": "2023-08-01T19:55:54.268427+0000", 2023-08-01T19:55:54.332 INFO:teuthology.orchestra.run.smithi008.stdout: "duration": 1.8068999999999999e-05 2023-08-01T19:55:54.332 INFO:teuthology.orchestra.run.smithi008.stdout: }, 2023-08-01T19:55:54.332 INFO:teuthology.orchestra.run.smithi008.stdout: { 2023-08-01T19:55:54.333 INFO:teuthology.orchestra.run.smithi008.stdout: "event": "queued_for_pg", 2023-08-01T19:55:54.333 INFO:teuthology.orchestra.run.smithi008.stdout: "time": "2023-08-01T19:55:54.268434+0000", 2023-08-01T19:55:54.333 INFO:teuthology.orchestra.run.smithi008.stdout: "duration": 6.4509999999999997e-06 2023-08-01T19:55:54.333 INFO:teuthology.orchestra.run.smithi008.stdout: } 2023-08-01T19:55:54.333 INFO:teuthology.orchestra.run.smithi008.stdout: ] 2023-08-01T19:55:54.333 INFO:teuthology.orchestra.run.smithi008.stdout: } 2023-08-01T19:55:54.333 INFO:teuthology.orchestra.run.smithi008.stdout: }, 2023-08-01T19:55:54.333 INFO:teuthology.orchestra.run.smithi008.stdout: { 2023-08-01T19:55:54.334 INFO:teuthology.orchestra.run.smithi008.stdout: "description": "osd_repop_reply(client.4668.0:188771 5.1 e59/57)", 2023-08-01T19:55:54.334 INFO:teuthology.orchestra.run.smithi008.stdout: "initiated_at": "2023-08-01T19:55:54.268744+0000", 2023-08-01T19:55:54.334 INFO:teuthology.orchestra.run.smithi008.stdout: "age": 4294967295.9995413, 2023-08-01T19:55:54.334 INFO:teuthology.orchestra.run.smithi008.stdout: "duration": 0.000228116, 2023-08-01T19:55:54.334 INFO:teuthology.orchestra.run.smithi008.stdout: "type_data": { 2023-08-01T19:55:54.334 INFO:teuthology.orchestra.run.smithi008.stdout: "flag_point": "queued for pg", 2023-08-01T19:55:54.334 INFO:teuthology.orchestra.run.smithi008.stdout: "events": [ 2023-08-01T19:55:54.335 INFO:teuthology.orchestra.run.smithi008.stdout: { 2023-08-01T19:55:54.335 INFO:teuthology.orchestra.run.smithi008.stdout: "event": "initiated", 2023-08-01T19:55:54.335 INFO:teuthology.orchestra.run.smithi008.stdout: "time": "2023-08-01T19:55:54.268744+0000", 2023-08-01T19:55:54.335 INFO:teuthology.orchestra.run.smithi008.stdout: "duration": 0 2023-08-01T19:55:54.335 INFO:teuthology.orchestra.run.smithi008.stdout: }, 2023-08-01T19:55:54.335 INFO:teuthology.orchestra.run.smithi008.stdout: { 2023-08-01T19:55:54.335 INFO:teuthology.orchestra.run.smithi008.stdout: "event": "throttled", 2023-08-01T19:55:54.335 INFO:teuthology.orchestra.run.smithi008.stdout: "time": "2023-08-01T19:55:54.268744+0000", 2023-08-01T19:55:54.336 INFO:teuthology.orchestra.run.smithi008.stdout: "duration": 0 2023-08-01T19:55:54.336 INFO:teuthology.orchestra.run.smithi008.stdout: }, 2023-08-01T19:55:54.336 INFO:teuthology.orchestra.run.smithi008.stdout: { 2023-08-01T19:55:54.336 INFO:teuthology.orchestra.run.smithi008.stdout: "event": "header_read", 2023-08-01T19:55:54.336 INFO:teuthology.orchestra.run.smithi008.stdout: "time": "2023-08-01T19:55:54.268744+0000", 2023-08-01T19:55:54.336 INFO:teuthology.orchestra.run.smithi008.stdout: "duration": 4294967295.9999995 2023-08-01T19:55:54.336 INFO:teuthology.orchestra.run.smithi008.stdout: }, 2023-08-01T19:55:54.336 INFO:teuthology.orchestra.run.smithi008.stdout: { 2023-08-01T19:55:54.337 INFO:teuthology.orchestra.run.smithi008.stdout: "event": "all_read", 2023-08-01T19:55:54.337 INFO:teuthology.orchestra.run.smithi008.stdout: "time": "2023-08-01T19:55:54.268747+0000", 2023-08-01T19:55:54.337 INFO:teuthology.orchestra.run.smithi008.stdout: "duration": 3.6669999999999998e-06 2023-08-01T19:55:54.337 INFO:teuthology.orchestra.run.smithi008.stdout: }, 2023-08-01T19:55:54.337 INFO:teuthology.orchestra.run.smithi008.stdout: { 2023-08-01T19:55:54.337 INFO:teuthology.orchestra.run.smithi008.stdout: "event": "dispatched", 2023-08-01T19:55:54.337 INFO:teuthology.orchestra.run.smithi008.stdout: "time": "2023-08-01T19:55:54.268758+0000", 2023-08-01T19:55:54.337 INFO:teuthology.orchestra.run.smithi008.stdout: "duration": 1.0183000000000001e-05 2023-08-01T19:55:54.338 INFO:teuthology.orchestra.run.smithi008.stdout: }, 2023-08-01T19:55:54.338 INFO:teuthology.orchestra.run.smithi008.stdout: { 2023-08-01T19:55:54.338 INFO:teuthology.orchestra.run.smithi008.stdout: "event": "queued_for_pg", 2023-08-01T19:55:54.338 INFO:teuthology.orchestra.run.smithi008.stdout: "time": "2023-08-01T19:55:54.268763+0000", 2023-08-01T19:55:54.338 INFO:teuthology.orchestra.run.smithi008.stdout: "duration": 5.8080000000000001e-06 2023-08-01T19:55:54.338 INFO:teuthology.orchestra.run.smithi008.stdout: } 2023-08-01T19:55:54.338 INFO:teuthology.orchestra.run.smithi008.stdout: ] 2023-08-01T19:55:54.338 INFO:teuthology.orchestra.run.smithi008.stdout: } 2023-08-01T19:55:54.339 INFO:teuthology.orchestra.run.smithi008.stdout: }, 2023-08-01T19:55:54.339 INFO:teuthology.orchestra.run.smithi008.stdout: { 2023-08-01T19:55:54.339 INFO:teuthology.orchestra.run.smithi008.stdout: "description": "osd_op(client.4668.0:188780 5.a 5.2acd271a (undecoded) ondisk+write+known_if_redirected+supports_pool_eio e59)", 2023-08-01T19:55:54.339 INFO:teuthology.orchestra.run.smithi008.stdout: "initiated_at": "2023-08-01T19:55:54.268981+0000", 2023-08-01T19:55:54.339 INFO:teuthology.orchestra.run.smithi008.stdout: "age": 4294967295.9993048, 2023-08-01T19:55:54.339 INFO:teuthology.orchestra.run.smithi008.stdout: "duration": 5.1989e-05, 2023-08-01T19:55:54.339 INFO:teuthology.orchestra.run.smithi008.stdout: "type_data": { 2023-08-01T19:55:54.340 INFO:teuthology.orchestra.run.smithi008.stdout: "flag_point": "queued for pg", 2023-08-01T19:55:54.340 INFO:teuthology.orchestra.run.smithi008.stdout: "client_info": { 2023-08-01T19:55:54.340 INFO:teuthology.orchestra.run.smithi008.stdout: "client": "client.4668", 2023-08-01T19:55:54.340 INFO:teuthology.orchestra.run.smithi008.stdout: "client_addr": "172.21.15.6:0/1709472247", 2023-08-01T19:55:54.340 INFO:teuthology.orchestra.run.smithi008.stdout: "tid": 188780 2023-08-01T19:55:54.340 INFO:teuthology.orchestra.run.smithi008.stdout: }, 2023-08-01T19:55:54.340 INFO:teuthology.orchestra.run.smithi008.stdout: "events": [ 2023-08-01T19:55:54.340 INFO:teuthology.orchestra.run.smithi008.stdout: { 2023-08-01T19:55:54.341 INFO:teuthology.orchestra.run.smithi008.stdout: "event": "initiated", 2023-08-01T19:55:54.341 INFO:teuthology.orchestra.run.smithi008.stdout: "time": "2023-08-01T19:55:54.268981+0000", 2023-08-01T19:55:54.341 INFO:teuthology.orchestra.run.smithi008.stdout: "duration": 0 2023-08-01T19:55:54.341 INFO:teuthology.orchestra.run.smithi008.stdout: }, 2023-08-01T19:55:54.341 INFO:teuthology.orchestra.run.smithi008.stdout: { 2023-08-01T19:55:54.341 INFO:teuthology.orchestra.run.smithi008.stdout: "event": "throttled", 2023-08-01T19:55:54.341 INFO:teuthology.orchestra.run.smithi008.stdout: "time": "2023-08-01T19:55:54.268981+0000", 2023-08-01T19:55:54.341 INFO:teuthology.orchestra.run.smithi008.stdout: "duration": 0 2023-08-01T19:55:54.342 INFO:teuthology.orchestra.run.smithi008.stdout: }, 2023-08-01T19:55:54.342 INFO:teuthology.orchestra.run.smithi008.stdout: { 2023-08-01T19:55:54.342 INFO:teuthology.orchestra.run.smithi008.stdout: "event": "header_read", 2023-08-01T19:55:54.342 INFO:teuthology.orchestra.run.smithi008.stdout: "time": "2023-08-01T19:55:54.268980+0000", 2023-08-01T19:55:54.342 INFO:teuthology.orchestra.run.smithi008.stdout: "duration": 4294967295.999999 2023-08-01T19:55:54.342 INFO:teuthology.orchestra.run.smithi008.stdout: }, 2023-08-01T19:55:54.342 INFO:teuthology.orchestra.run.smithi008.stdout: { 2023-08-01T19:55:54.342 INFO:teuthology.orchestra.run.smithi008.stdout: "event": "all_read", 2023-08-01T19:55:54.343 INFO:teuthology.orchestra.run.smithi008.stdout: "time": "2023-08-01T19:55:54.268986+0000", 2023-08-01T19:55:54.343 INFO:teuthology.orchestra.run.smithi008.stdout: "duration": 5.6459999999999998e-06 2023-08-01T19:55:54.343 INFO:teuthology.orchestra.run.smithi008.stdout: }, 2023-08-01T19:55:54.343 INFO:teuthology.orchestra.run.smithi008.stdout: { 2023-08-01T19:55:54.343 INFO:teuthology.orchestra.run.smithi008.stdout: "event": "dispatched", 2023-08-01T19:55:54.343 INFO:teuthology.orchestra.run.smithi008.stdout: "time": "2023-08-01T19:55:54.268997+0000", 2023-08-01T19:55:54.343 INFO:teuthology.orchestra.run.smithi008.stdout: "duration": 1.1902999999999999e-05 2023-08-01T19:55:54.343 INFO:teuthology.orchestra.run.smithi008.stdout: }, 2023-08-01T19:55:54.344 INFO:teuthology.orchestra.run.smithi008.stdout: { 2023-08-01T19:55:54.344 INFO:teuthology.orchestra.run.smithi008.stdout: "event": "queued_for_pg", 2023-08-01T19:55:54.344 INFO:teuthology.orchestra.run.smithi008.stdout: "time": "2023-08-01T19:55:54.269003+0000", 2023-08-01T19:55:54.344 INFO:teuthology.orchestra.run.smithi008.stdout: "duration": 5.8320000000000002e-06 2023-08-01T19:55:54.344 INFO:teuthology.orchestra.run.smithi008.stdout: } 2023-08-01T19:55:54.344 INFO:teuthology.orchestra.run.smithi008.stdout: ] 2023-08-01T19:55:54.344 INFO:teuthology.orchestra.run.smithi008.stdout: } 2023-08-01T19:55:54.345 INFO:teuthology.orchestra.run.smithi008.stdout: }, 2023-08-01T19:55:54.345 INFO:teuthology.orchestra.run.smithi008.stdout: { 2023-08-01T19:55:54.345 INFO:teuthology.orchestra.run.smithi008.stdout: "description": "osd_repop(client.4668.0:188763 5.7 e59/19 5:e469e989:::benchmark_data_smithi006_114134_object55102:head v 59'11786, mlcod=59'11783)", 2023-08-01T19:55:54.345 INFO:teuthology.orchestra.run.smithi008.stdout: "initiated_at": "2023-08-01T19:55:54.262833+0000", 2023-08-01T19:55:54.345 INFO:teuthology.orchestra.run.smithi008.stdout: "age": 0.0054522839999999999, 2023-08-01T19:55:54.345 INFO:teuthology.orchestra.run.smithi008.stdout: "duration": 0.0062637150000000004, 2023-08-01T19:55:54.345 INFO:teuthology.orchestra.run.smithi008.stdout: "type_data": { 2023-08-01T19:55:54.345 INFO:teuthology.orchestra.run.smithi008.stdout: "flag_point": "started", 2023-08-01T19:55:54.346 INFO:teuthology.orchestra.run.smithi008.stdout: "events": [ 2023-08-01T19:55:54.346 INFO:teuthology.orchestra.run.smithi008.stdout: { 2023-08-01T19:55:54.346 INFO:teuthology.orchestra.run.smithi008.stdout: "event": "initiated", 2023-08-01T19:55:54.346 INFO:teuthology.orchestra.run.smithi008.stdout: "time": "2023-08-01T19:55:54.262833+0000", 2023-08-01T19:55:54.346 INFO:teuthology.orchestra.run.smithi008.stdout: "duration": 0 2023-08-01T19:55:54.346 INFO:teuthology.orchestra.run.smithi008.stdout: }, 2023-08-01T19:55:54.346 INFO:teuthology.orchestra.run.smithi008.stdout: { 2023-08-01T19:55:54.346 INFO:teuthology.orchestra.run.smithi008.stdout: "event": "throttled", 2023-08-01T19:55:54.347 INFO:teuthology.orchestra.run.smithi008.stdout: "time": "2023-08-01T19:55:54.262833+0000", 2023-08-01T19:55:54.347 INFO:teuthology.orchestra.run.smithi008.stdout: "duration": 0 2023-08-01T19:55:54.347 INFO:teuthology.orchestra.run.smithi008.stdout: }, 2023-08-01T19:55:54.347 INFO:teuthology.orchestra.run.smithi008.stdout: { 2023-08-01T19:55:54.347 INFO:teuthology.orchestra.run.smithi008.stdout: "event": "header_read", 2023-08-01T19:55:54.347 INFO:teuthology.orchestra.run.smithi008.stdout: "time": "2023-08-01T19:55:54.262833+0000", 2023-08-01T19:55:54.347 INFO:teuthology.orchestra.run.smithi008.stdout: "duration": 4294967295.9999995 2023-08-01T19:55:54.347 INFO:teuthology.orchestra.run.smithi008.stdout: }, 2023-08-01T19:55:54.348 INFO:teuthology.orchestra.run.smithi008.stdout: { 2023-08-01T19:55:54.348 INFO:teuthology.orchestra.run.smithi008.stdout: "event": "all_read", 2023-08-01T19:55:54.348 INFO:teuthology.orchestra.run.smithi008.stdout: "time": "2023-08-01T19:55:54.262839+0000", 2023-08-01T19:55:54.348 INFO:teuthology.orchestra.run.smithi008.stdout: "duration": 5.9109999999999998e-06 2023-08-01T19:55:54.348 INFO:teuthology.orchestra.run.smithi008.stdout: }, 2023-08-01T19:55:54.348 INFO:teuthology.orchestra.run.smithi008.stdout: { 2023-08-01T19:55:54.348 INFO:teuthology.orchestra.run.smithi008.stdout: "event": "dispatched", 2023-08-01T19:55:54.348 INFO:teuthology.orchestra.run.smithi008.stdout: "time": "2023-08-01T19:55:54.262847+0000", 2023-08-01T19:55:54.349 INFO:teuthology.orchestra.run.smithi008.stdout: "duration": 8.5290000000000008e-06 2023-08-01T19:55:54.349 INFO:teuthology.orchestra.run.smithi008.stdout: }, 2023-08-01T19:55:54.349 INFO:teuthology.orchestra.run.smithi008.stdout: { 2023-08-01T19:55:54.349 INFO:teuthology.orchestra.run.smithi008.stdout: "event": "queued_for_pg", 2023-08-01T19:55:54.349 INFO:teuthology.orchestra.run.smithi008.stdout: "time": "2023-08-01T19:55:54.262852+0000", 2023-08-01T19:55:54.349 INFO:teuthology.orchestra.run.smithi008.stdout: "duration": 4.9540000000000003e-06 2023-08-01T19:55:54.349 INFO:teuthology.orchestra.run.smithi008.stdout: }, 2023-08-01T19:55:54.350 INFO:teuthology.orchestra.run.smithi008.stdout: { 2023-08-01T19:55:54.350 INFO:teuthology.orchestra.run.smithi008.stdout: "event": "reached_pg", 2023-08-01T19:55:54.350 INFO:teuthology.orchestra.run.smithi008.stdout: "time": "2023-08-01T19:55:54.262887+0000", 2023-08-01T19:55:54.350 INFO:teuthology.orchestra.run.smithi008.stdout: "duration": 3.4628000000000001e-05 2023-08-01T19:55:54.350 INFO:teuthology.orchestra.run.smithi008.stdout: }, 2023-08-01T19:55:54.350 INFO:teuthology.orchestra.run.smithi008.stdout: { 2023-08-01T19:55:54.350 INFO:teuthology.orchestra.run.smithi008.stdout: "event": "started", 2023-08-01T19:55:54.350 INFO:teuthology.orchestra.run.smithi008.stdout: "time": "2023-08-01T19:55:54.262907+0000", 2023-08-01T19:55:54.351 INFO:teuthology.orchestra.run.smithi008.stdout: "duration": 2.0018999999999999e-05 2023-08-01T19:55:54.351 INFO:teuthology.orchestra.run.smithi008.stdout: } 2023-08-01T19:55:54.351 INFO:teuthology.orchestra.run.smithi008.stdout: ] 2023-08-01T19:55:54.351 INFO:teuthology.orchestra.run.smithi008.stdout: } 2023-08-01T19:55:54.351 INFO:teuthology.orchestra.run.smithi008.stdout: }, 2023-08-01T19:55:54.351 INFO:teuthology.orchestra.run.smithi008.stdout: { 2023-08-01T19:55:54.351 INFO:teuthology.orchestra.run.smithi008.stdout: "description": "osd_repop(client.4668.0:188766 5.7 e59/19 5:e0c6c2e2:::benchmark_data_smithi006_114134_object55105:head v 59'11787, mlcod=59'11783)", 2023-08-01T19:55:54.351 INFO:teuthology.orchestra.run.smithi008.stdout: "initiated_at": "2023-08-01T19:55:54.262881+0000", 2023-08-01T19:55:54.352 INFO:teuthology.orchestra.run.smithi008.stdout: "age": 0.005404687, 2023-08-01T19:55:54.352 INFO:teuthology.orchestra.run.smithi008.stdout: "duration": 0.0062835119999999998, 2023-08-01T19:55:54.352 INFO:teuthology.orchestra.run.smithi008.stdout: "type_data": { 2023-08-01T19:55:54.352 INFO:teuthology.orchestra.run.smithi008.stdout: "flag_point": "started", 2023-08-01T19:55:54.352 INFO:teuthology.orchestra.run.smithi008.stdout: "events": [ 2023-08-01T19:55:54.352 INFO:teuthology.orchestra.run.smithi008.stdout: { 2023-08-01T19:55:54.352 INFO:teuthology.orchestra.run.smithi008.stdout: "event": "initiated", 2023-08-01T19:55:54.352 INFO:teuthology.orchestra.run.smithi008.stdout: "time": "2023-08-01T19:55:54.262881+0000", 2023-08-01T19:55:54.353 INFO:teuthology.orchestra.run.smithi008.stdout: "duration": 0 2023-08-01T19:55:54.353 INFO:teuthology.orchestra.run.smithi008.stdout: }, 2023-08-01T19:55:54.353 INFO:teuthology.orchestra.run.smithi008.stdout: { 2023-08-01T19:55:54.353 INFO:teuthology.orchestra.run.smithi008.stdout: "event": "throttled", 2023-08-01T19:55:54.353 INFO:teuthology.orchestra.run.smithi008.stdout: "time": "2023-08-01T19:55:54.262881+0000", 2023-08-01T19:55:54.353 INFO:teuthology.orchestra.run.smithi008.stdout: "duration": 0 2023-08-01T19:55:54.353 INFO:teuthology.orchestra.run.smithi008.stdout: }, 2023-08-01T19:55:54.353 INFO:teuthology.orchestra.run.smithi008.stdout: { 2023-08-01T19:55:54.354 INFO:teuthology.orchestra.run.smithi008.stdout: "event": "header_read", 2023-08-01T19:55:54.354 INFO:teuthology.orchestra.run.smithi008.stdout: "time": "2023-08-01T19:55:54.262881+0000", 2023-08-01T19:55:54.354 INFO:teuthology.orchestra.run.smithi008.stdout: "duration": 4294967296 2023-08-01T19:55:54.354 INFO:teuthology.orchestra.run.smithi008.stdout: }, 2023-08-01T19:55:54.354 INFO:teuthology.orchestra.run.smithi008.stdout: { 2023-08-01T19:55:54.354 INFO:teuthology.orchestra.run.smithi008.stdout: "event": "all_read", 2023-08-01T19:55:54.354 INFO:teuthology.orchestra.run.smithi008.stdout: "time": "2023-08-01T19:55:54.262884+0000", 2023-08-01T19:55:54.354 INFO:teuthology.orchestra.run.smithi008.stdout: "duration": 3.072e-06 2023-08-01T19:55:54.355 INFO:teuthology.orchestra.run.smithi008.stdout: }, 2023-08-01T19:55:54.355 INFO:teuthology.orchestra.run.smithi008.stdout: { 2023-08-01T19:55:54.355 INFO:teuthology.orchestra.run.smithi008.stdout: "event": "dispatched", 2023-08-01T19:55:54.355 INFO:teuthology.orchestra.run.smithi008.stdout: "time": "2023-08-01T19:55:54.262889+0000", 2023-08-01T19:55:54.355 INFO:teuthology.orchestra.run.smithi008.stdout: "duration": 5.1580000000000004e-06 2023-08-01T19:55:54.355 INFO:teuthology.orchestra.run.smithi008.stdout: }, 2023-08-01T19:55:54.355 INFO:teuthology.orchestra.run.smithi008.stdout: { 2023-08-01T19:55:54.355 INFO:teuthology.orchestra.run.smithi008.stdout: "event": "queued_for_pg", 2023-08-01T19:55:54.356 INFO:teuthology.orchestra.run.smithi008.stdout: "time": "2023-08-01T19:55:54.262893+0000", 2023-08-01T19:55:54.356 INFO:teuthology.orchestra.run.smithi008.stdout: "duration": 3.8619999999999996e-06 2023-08-01T19:55:54.356 INFO:teuthology.orchestra.run.smithi008.stdout: }, 2023-08-01T19:55:54.356 INFO:teuthology.orchestra.run.smithi008.stdout: { 2023-08-01T19:55:54.356 INFO:teuthology.orchestra.run.smithi008.stdout: "event": "reached_pg", 2023-08-01T19:55:54.356 INFO:teuthology.orchestra.run.smithi008.stdout: "time": "2023-08-01T19:55:54.264267+0000", 2023-08-01T19:55:54.356 INFO:teuthology.orchestra.run.smithi008.stdout: "duration": 0.001374311 2023-08-01T19:55:54.357 INFO:teuthology.orchestra.run.smithi008.stdout: }, 2023-08-01T19:55:54.357 INFO:teuthology.orchestra.run.smithi008.stdout: { 2023-08-01T19:55:54.357 INFO:teuthology.orchestra.run.smithi008.stdout: "event": "started", 2023-08-01T19:55:54.357 INFO:teuthology.orchestra.run.smithi008.stdout: "time": "2023-08-01T19:55:54.264285+0000", 2023-08-01T19:55:54.357 INFO:teuthology.orchestra.run.smithi008.stdout: "duration": 1.7878999999999999e-05 2023-08-01T19:55:54.357 INFO:teuthology.orchestra.run.smithi008.stdout: } 2023-08-01T19:55:54.357 INFO:teuthology.orchestra.run.smithi008.stdout: ] 2023-08-01T19:55:54.357 INFO:teuthology.orchestra.run.smithi008.stdout: } 2023-08-01T19:55:54.358 INFO:teuthology.orchestra.run.smithi008.stdout: } 2023-08-01T19:55:54.358 INFO:teuthology.orchestra.run.smithi008.stdout: ], 2023-08-01T19:55:54.358 INFO:teuthology.orchestra.run.smithi008.stdout: "num_ops": 13 2023-08-01T19:55:54.358 INFO:teuthology.orchestra.run.smithi008.stdout:} 2023-08-01T19:55:54.359 DEBUG:teuthology.orchestra.run.smithi008:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 30 ceph --cluster ceph --admin-daemon /var/run/ceph/ceph-osd.0.asok dump_blocked_ops 2023-08-01T19:55:54.360 INFO:tasks.ceph.osd.2.smithi155.stderr:2023-08-01T19:55:54.357+0000 7faa5c6ac700 -1 received signal: Hangup from /usr/bin/python3 /bin/daemon-helper kill ceph-osd -f --cluster ceph -i 2 (PID: 111337) UID: 0 2023-08-01T19:55:54.459 INFO:tasks.ceph.osd.0.smithi008.stderr:2023-08-01T19:55:54.458+0000 7f16a58f4700 -1 received signal: Hangup from /usr/bin/python3 /bin/daemon-helper kill ceph-osd -f --cluster ceph -i 0 (PID: 111179) UID: 0 2023-08-01T19:55:54.554 INFO:teuthology.orchestra.run.smithi008.stdout:{ 2023-08-01T19:55:54.554 INFO:teuthology.orchestra.run.smithi008.stdout: "ops": [], 2023-08-01T19:55:54.554 INFO:teuthology.orchestra.run.smithi008.stdout: "complaint_time": 30, 2023-08-01T19:55:54.554 INFO:teuthology.orchestra.run.smithi008.stdout: "num_blocked_ops": 0 2023-08-01T19:55:54.555 INFO:teuthology.orchestra.run.smithi008.stdout:} 2023-08-01T19:55:54.559 INFO:tasks.ceph.osd.2.smithi155.stderr:2023-08-01T19:55:54.558+0000 7faa5c6ac700 -1 received signal: Hangup from /usr/bin/python3 /bin/daemon-helper kill ceph-osd -f --cluster ceph -i 2 (PID: 111337) UID: 0 2023-08-01T19:55:54.567 DEBUG:teuthology.orchestra.run.smithi008:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 30 ceph --cluster ceph --admin-daemon /var/run/ceph/ceph-osd.0.asok dump_historic_ops 2023-08-01T19:55:54.660 INFO:tasks.ceph.osd.0.smithi008.stderr:2023-08-01T19:55:54.659+0000 7f16a58f4700 -1 received signal: Hangup from /usr/bin/python3 /bin/daemon-helper kill ceph-osd -f --cluster ceph -i 0 (PID: 111179) UID: 0 2023-08-01T19:55:54.761 INFO:tasks.ceph.osd.1.smithi101.stderr:2023-08-01T19:55:54.760+0000 7fb0cb7f6700 -1 received signal: Hangup from /usr/bin/python3 /bin/daemon-helper kill ceph-osd -f --cluster ceph -i 1 (PID: 111141) UID: 0 2023-08-01T19:55:54.801 INFO:teuthology.orchestra.run.smithi008.stdout:{ 2023-08-01T19:55:54.801 INFO:teuthology.orchestra.run.smithi008.stdout: "size": 20, 2023-08-01T19:55:54.801 INFO:teuthology.orchestra.run.smithi008.stdout: "duration": 600, 2023-08-01T19:55:54.801 INFO:teuthology.orchestra.run.smithi008.stdout: "ops": [ 2023-08-01T19:55:54.802 INFO:teuthology.orchestra.run.smithi008.stdout: { 2023-08-01T19:55:54.802 INFO:teuthology.orchestra.run.smithi008.stdout: "description": "osd_op(client.4668.0:100240 5.a 5:5313c5b9:::benchmark_data_smithi006_114134_object100239:head [set-alloc-hint object_size 65536 write_size 65536,write 0~65536] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e37)", 2023-08-01T19:55:54.802 INFO:teuthology.orchestra.run.smithi008.stdout: "initiated_at": "2023-08-01T19:55:05.148399+0000", 2023-08-01T19:55:54.802 INFO:teuthology.orchestra.run.smithi008.stdout: "age": 49.649662364000001, 2023-08-01T19:55:54.802 INFO:teuthology.orchestra.run.smithi008.stdout: "duration": 0.077278904999999995, 2023-08-01T19:55:54.802 INFO:teuthology.orchestra.run.smithi008.stdout: "type_data": { 2023-08-01T19:55:54.802 INFO:teuthology.orchestra.run.smithi008.stdout: "flag_point": "commit sent; apply or cleanup", 2023-08-01T19:55:54.802 INFO:teuthology.orchestra.run.smithi008.stdout: "client_info": { 2023-08-01T19:55:54.803 INFO:teuthology.orchestra.run.smithi008.stdout: "client": "client.4668", 2023-08-01T19:55:54.803 INFO:teuthology.orchestra.run.smithi008.stdout: "client_addr": "172.21.15.6:0/1709472247", 2023-08-01T19:55:54.803 INFO:teuthology.orchestra.run.smithi008.stdout: "tid": 100240 2023-08-01T19:55:54.803 INFO:teuthology.orchestra.run.smithi008.stdout: }, 2023-08-01T19:55:54.803 INFO:teuthology.orchestra.run.smithi008.stdout: "events": [ 2023-08-01T19:55:54.803 INFO:teuthology.orchestra.run.smithi008.stdout: { 2023-08-01T19:55:54.803 INFO:teuthology.orchestra.run.smithi008.stdout: "event": "initiated", 2023-08-01T19:55:54.804 INFO:teuthology.orchestra.run.smithi008.stdout: "time": "2023-08-01T19:55:05.148399+0000", 2023-08-01T19:55:54.804 INFO:teuthology.orchestra.run.smithi008.stdout: "duration": 0 2023-08-01T19:55:54.804 INFO:teuthology.orchestra.run.smithi008.stdout: }, 2023-08-01T19:55:54.804 INFO:teuthology.orchestra.run.smithi008.stdout: { 2023-08-01T19:55:54.804 INFO:teuthology.orchestra.run.smithi008.stdout: "event": "throttled", 2023-08-01T19:55:54.804 INFO:teuthology.orchestra.run.smithi008.stdout: "time": "2023-08-01T19:55:05.148399+0000", 2023-08-01T19:55:54.804 INFO:teuthology.orchestra.run.smithi008.stdout: "duration": 0 2023-08-01T19:55:54.804 INFO:teuthology.orchestra.run.smithi008.stdout: }, 2023-08-01T19:55:54.805 INFO:teuthology.orchestra.run.smithi008.stdout: { 2023-08-01T19:55:54.805 INFO:teuthology.orchestra.run.smithi008.stdout: "event": "header_read", 2023-08-01T19:55:54.805 INFO:teuthology.orchestra.run.smithi008.stdout: "time": "2023-08-01T19:55:05.148398+0000", 2023-08-01T19:55:54.805 INFO:teuthology.orchestra.run.smithi008.stdout: "duration": 4294967295.999999 2023-08-01T19:55:54.805 INFO:teuthology.orchestra.run.smithi008.stdout: }, 2023-08-01T19:55:54.805 INFO:teuthology.orchestra.run.smithi008.stdout: { 2023-08-01T19:55:54.805 INFO:teuthology.orchestra.run.smithi008.stdout: "event": "all_read", 2023-08-01T19:55:54.805 INFO:teuthology.orchestra.run.smithi008.stdout: "time": "2023-08-01T19:55:05.148492+0000", 2023-08-01T19:55:54.806 INFO:teuthology.orchestra.run.smithi008.stdout: "duration": 9.3892000000000002e-05 2023-08-01T19:55:54.806 INFO:teuthology.orchestra.run.smithi008.stdout: }, 2023-08-01T19:55:54.806 INFO:teuthology.orchestra.run.smithi008.stdout: { 2023-08-01T19:55:54.806 INFO:teuthology.orchestra.run.smithi008.stdout: "event": "dispatched", 2023-08-01T19:55:54.806 INFO:teuthology.orchestra.run.smithi008.stdout: "time": "2023-08-01T19:55:05.148503+0000", 2023-08-01T19:55:54.806 INFO:teuthology.orchestra.run.smithi008.stdout: "duration": 1.0951000000000001e-05 2023-08-01T19:55:54.806 INFO:teuthology.orchestra.run.smithi008.stdout: }, 2023-08-01T19:55:54.807 INFO:teuthology.orchestra.run.smithi008.stdout: { 2023-08-01T19:55:54.807 INFO:teuthology.orchestra.run.smithi008.stdout: "event": "queued_for_pg", 2023-08-01T19:55:54.807 INFO:teuthology.orchestra.run.smithi008.stdout: "time": "2023-08-01T19:55:05.148508+0000", 2023-08-01T19:55:54.807 INFO:teuthology.orchestra.run.smithi008.stdout: "duration": 5.0080000000000002e-06 2023-08-01T19:55:54.807 INFO:teuthology.orchestra.run.smithi008.stdout: }, 2023-08-01T19:55:54.807 INFO:teuthology.orchestra.run.smithi008.stdout: { 2023-08-01T19:55:54.807 INFO:teuthology.orchestra.run.smithi008.stdout: "event": "reached_pg", 2023-08-01T19:55:54.807 INFO:teuthology.orchestra.run.smithi008.stdout: "time": "2023-08-01T19:55:05.148548+0000", 2023-08-01T19:55:54.808 INFO:teuthology.orchestra.run.smithi008.stdout: "duration": 4.0358999999999998e-05 2023-08-01T19:55:54.808 INFO:teuthology.orchestra.run.smithi008.stdout: }, 2023-08-01T19:55:54.808 INFO:teuthology.orchestra.run.smithi008.stdout: { 2023-08-01T19:55:54.808 INFO:teuthology.orchestra.run.smithi008.stdout: "event": "started", 2023-08-01T19:55:54.808 INFO:teuthology.orchestra.run.smithi008.stdout: "time": "2023-08-01T19:55:05.148666+0000", 2023-08-01T19:55:54.808 INFO:teuthology.orchestra.run.smithi008.stdout: "duration": 0.000117621 2023-08-01T19:55:54.808 INFO:teuthology.orchestra.run.smithi008.stdout: }, 2023-08-01T19:55:54.808 INFO:teuthology.orchestra.run.smithi008.stdout: { 2023-08-01T19:55:54.809 INFO:teuthology.orchestra.run.smithi008.stdout: "event": "waiting for subops from 2", 2023-08-01T19:55:54.809 INFO:teuthology.orchestra.run.smithi008.stdout: "time": "2023-08-01T19:55:05.148805+0000", 2023-08-01T19:55:54.809 INFO:teuthology.orchestra.run.smithi008.stdout: "duration": 0.000139176 2023-08-01T19:55:54.809 INFO:teuthology.orchestra.run.smithi008.stdout: }, 2023-08-01T19:55:54.809 INFO:teuthology.orchestra.run.smithi008.stdout: { 2023-08-01T19:55:54.809 INFO:teuthology.orchestra.run.smithi008.stdout: "event": "op_commit", 2023-08-01T19:55:54.809 INFO:teuthology.orchestra.run.smithi008.stdout: "time": "2023-08-01T19:55:05.156143+0000", 2023-08-01T19:55:54.809 INFO:teuthology.orchestra.run.smithi008.stdout: "duration": 0.007338041 2023-08-01T19:55:54.810 INFO:teuthology.orchestra.run.smithi008.stdout: }, 2023-08-01T19:55:54.810 INFO:teuthology.orchestra.run.smithi008.stdout: { 2023-08-01T19:55:54.810 INFO:teuthology.orchestra.run.smithi008.stdout: "event": "sub_op_commit_rec", 2023-08-01T19:55:54.810 INFO:teuthology.orchestra.run.smithi008.stdout: "time": "2023-08-01T19:55:05.225581+0000", 2023-08-01T19:55:54.810 INFO:teuthology.orchestra.run.smithi008.stdout: "duration": 0.069438402999999996 2023-08-01T19:55:54.810 INFO:teuthology.orchestra.run.smithi008.stdout: }, 2023-08-01T19:55:54.810 INFO:teuthology.orchestra.run.smithi008.stdout: { 2023-08-01T19:55:54.811 INFO:teuthology.orchestra.run.smithi008.stdout: "event": "commit_sent", 2023-08-01T19:55:54.811 INFO:teuthology.orchestra.run.smithi008.stdout: "time": "2023-08-01T19:55:05.225632+0000", 2023-08-01T19:55:54.811 INFO:teuthology.orchestra.run.smithi008.stdout: "duration": 5.0382e-05 2023-08-01T19:55:54.811 INFO:teuthology.orchestra.run.smithi008.stdout: }, 2023-08-01T19:55:54.811 INFO:teuthology.orchestra.run.smithi008.stdout: { 2023-08-01T19:55:54.811 INFO:teuthology.orchestra.run.smithi008.stdout: "event": "done", 2023-08-01T19:55:54.811 INFO:teuthology.orchestra.run.smithi008.stdout: "time": "2023-08-01T19:55:05.225677+0000", 2023-08-01T19:55:54.811 INFO:teuthology.orchestra.run.smithi008.stdout: "duration": 4.5893000000000003e-05 2023-08-01T19:55:54.812 INFO:teuthology.orchestra.run.smithi008.stdout: } 2023-08-01T19:55:54.812 INFO:teuthology.orchestra.run.smithi008.stdout: ] 2023-08-01T19:55:54.812 INFO:teuthology.orchestra.run.smithi008.stdout: } 2023-08-01T19:55:54.812 INFO:teuthology.orchestra.run.smithi008.stdout: }, 2023-08-01T19:55:54.812 INFO:teuthology.orchestra.run.smithi008.stdout: { 2023-08-01T19:55:54.812 INFO:teuthology.orchestra.run.smithi008.stdout: "description": "osd_op(client.4668.0:100243 5.a 5:5e8193b6:::benchmark_data_smithi006_114134_object100242:head [set-alloc-hint object_size 65536 write_size 65536,write 0~65536] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e37)", 2023-08-01T19:55:54.812 INFO:teuthology.orchestra.run.smithi008.stdout: "initiated_at": "2023-08-01T19:55:05.150737+0000", 2023-08-01T19:55:54.812 INFO:teuthology.orchestra.run.smithi008.stdout: "age": 49.647323909000001, 2023-08-01T19:55:54.813 INFO:teuthology.orchestra.run.smithi008.stdout: "duration": 0.075019885999999994, 2023-08-01T19:55:54.813 INFO:teuthology.orchestra.run.smithi008.stdout: "type_data": { 2023-08-01T19:55:54.813 INFO:teuthology.orchestra.run.smithi008.stdout: "flag_point": "commit sent; apply or cleanup", 2023-08-01T19:55:54.813 INFO:teuthology.orchestra.run.smithi008.stdout: "client_info": { 2023-08-01T19:55:54.813 INFO:teuthology.orchestra.run.smithi008.stdout: "client": "client.4668", 2023-08-01T19:55:54.813 INFO:teuthology.orchestra.run.smithi008.stdout: "client_addr": "172.21.15.6:0/1709472247", 2023-08-01T19:55:54.813 INFO:teuthology.orchestra.run.smithi008.stdout: "tid": 100243 2023-08-01T19:55:54.813 INFO:teuthology.orchestra.run.smithi008.stdout: }, 2023-08-01T19:55:54.814 INFO:teuthology.orchestra.run.smithi008.stdout: "events": [ 2023-08-01T19:55:54.814 INFO:teuthology.orchestra.run.smithi008.stdout: { 2023-08-01T19:55:54.814 INFO:teuthology.orchestra.run.smithi008.stdout: "event": "initiated", 2023-08-01T19:55:54.814 INFO:teuthology.orchestra.run.smithi008.stdout: "time": "2023-08-01T19:55:05.150737+0000", 2023-08-01T19:55:54.814 INFO:teuthology.orchestra.run.smithi008.stdout: "duration": 0 2023-08-01T19:55:54.814 INFO:teuthology.orchestra.run.smithi008.stdout: }, 2023-08-01T19:55:54.814 INFO:teuthology.orchestra.run.smithi008.stdout: { 2023-08-01T19:55:54.814 INFO:teuthology.orchestra.run.smithi008.stdout: "event": "throttled", 2023-08-01T19:55:54.815 INFO:teuthology.orchestra.run.smithi008.stdout: "time": "2023-08-01T19:55:05.150737+0000", 2023-08-01T19:55:54.815 INFO:teuthology.orchestra.run.smithi008.stdout: "duration": 0 2023-08-01T19:55:54.815 INFO:teuthology.orchestra.run.smithi008.stdout: }, 2023-08-01T19:55:54.815 INFO:teuthology.orchestra.run.smithi008.stdout: { 2023-08-01T19:55:54.815 INFO:teuthology.orchestra.run.smithi008.stdout: "event": "header_read", 2023-08-01T19:55:54.815 INFO:teuthology.orchestra.run.smithi008.stdout: "time": "2023-08-01T19:55:05.150736+0000", 2023-08-01T19:55:54.815 INFO:teuthology.orchestra.run.smithi008.stdout: "duration": 4294967295.999999 2023-08-01T19:55:54.816 INFO:teuthology.orchestra.run.smithi008.stdout: }, 2023-08-01T19:55:54.816 INFO:teuthology.orchestra.run.smithi008.stdout: { 2023-08-01T19:55:54.816 INFO:teuthology.orchestra.run.smithi008.stdout: "event": "all_read", 2023-08-01T19:55:54.816 INFO:teuthology.orchestra.run.smithi008.stdout: "time": "2023-08-01T19:55:05.150780+0000", 2023-08-01T19:55:54.816 INFO:teuthology.orchestra.run.smithi008.stdout: "duration": 4.3578999999999997e-05 2023-08-01T19:55:54.816 INFO:teuthology.orchestra.run.smithi008.stdout: }, 2023-08-01T19:55:54.816 INFO:teuthology.orchestra.run.smithi008.stdout: { 2023-08-01T19:55:54.816 INFO:teuthology.orchestra.run.smithi008.stdout: "event": "dispatched", 2023-08-01T19:55:54.817 INFO:teuthology.orchestra.run.smithi008.stdout: "time": "2023-08-01T19:55:05.150791+0000", 2023-08-01T19:55:54.817 INFO:teuthology.orchestra.run.smithi008.stdout: "duration": 1.0963e-05 2023-08-01T19:55:54.817 INFO:teuthology.orchestra.run.smithi008.stdout: }, 2023-08-01T19:55:54.817 INFO:teuthology.orchestra.run.smithi008.stdout: { 2023-08-01T19:55:54.817 INFO:teuthology.orchestra.run.smithi008.stdout: "event": "queued_for_pg", 2023-08-01T19:55:54.817 INFO:teuthology.orchestra.run.smithi008.stdout: "time": "2023-08-01T19:55:05.150797+0000", 2023-08-01T19:55:54.817 INFO:teuthology.orchestra.run.smithi008.stdout: "duration": 5.9780000000000002e-06 2023-08-01T19:55:54.817 INFO:teuthology.orchestra.run.smithi008.stdout: }, 2023-08-01T19:55:54.818 INFO:teuthology.orchestra.run.smithi008.stdout: { 2023-08-01T19:55:54.818 INFO:teuthology.orchestra.run.smithi008.stdout: "event": "reached_pg", 2023-08-01T19:55:54.818 INFO:teuthology.orchestra.run.smithi008.stdout: "time": "2023-08-01T19:55:05.150833+0000", 2023-08-01T19:55:54.818 INFO:teuthology.orchestra.run.smithi008.stdout: "duration": 3.6000000000000001e-05 2023-08-01T19:55:54.818 INFO:teuthology.orchestra.run.smithi008.stdout: }, 2023-08-01T19:55:54.818 INFO:teuthology.orchestra.run.smithi008.stdout: { 2023-08-01T19:55:54.818 INFO:teuthology.orchestra.run.smithi008.stdout: "event": "started", 2023-08-01T19:55:54.818 INFO:teuthology.orchestra.run.smithi008.stdout: "time": "2023-08-01T19:55:05.150951+0000", 2023-08-01T19:55:54.819 INFO:teuthology.orchestra.run.smithi008.stdout: "duration": 0.00011827799999999999 2023-08-01T19:55:54.819 INFO:teuthology.orchestra.run.smithi008.stdout: }, 2023-08-01T19:55:54.819 INFO:teuthology.orchestra.run.smithi008.stdout: { 2023-08-01T19:55:54.819 INFO:teuthology.orchestra.run.smithi008.stdout: "event": "waiting for subops from 2", 2023-08-01T19:55:54.819 INFO:teuthology.orchestra.run.smithi008.stdout: "time": "2023-08-01T19:55:05.151111+0000", 2023-08-01T19:55:54.819 INFO:teuthology.orchestra.run.smithi008.stdout: "duration": 0.00015961299999999999 2023-08-01T19:55:54.819 INFO:teuthology.orchestra.run.smithi008.stdout: }, 2023-08-01T19:55:54.819 INFO:teuthology.orchestra.run.smithi008.stdout: { 2023-08-01T19:55:54.820 INFO:teuthology.orchestra.run.smithi008.stdout: "event": "op_commit", 2023-08-01T19:55:54.820 INFO:teuthology.orchestra.run.smithi008.stdout: "time": "2023-08-01T19:55:05.156247+0000", 2023-08-01T19:55:54.820 INFO:teuthology.orchestra.run.smithi008.stdout: "duration": 0.005136524 2023-08-01T19:55:54.820 INFO:teuthology.orchestra.run.smithi008.stdout: }, 2023-08-01T19:55:54.820 INFO:teuthology.orchestra.run.smithi008.stdout: { 2023-08-01T19:55:54.820 INFO:teuthology.orchestra.run.smithi008.stdout: "event": "sub_op_commit_rec", 2023-08-01T19:55:54.820 INFO:teuthology.orchestra.run.smithi008.stdout: "time": "2023-08-01T19:55:05.225705+0000", 2023-08-01T19:55:54.821 INFO:teuthology.orchestra.run.smithi008.stdout: "duration": 0.069458377000000002 2023-08-01T19:55:54.821 INFO:teuthology.orchestra.run.smithi008.stdout: }, 2023-08-01T19:55:54.821 INFO:teuthology.orchestra.run.smithi008.stdout: { 2023-08-01T19:55:54.821 INFO:teuthology.orchestra.run.smithi008.stdout: "event": "commit_sent", 2023-08-01T19:55:54.821 INFO:teuthology.orchestra.run.smithi008.stdout: "time": "2023-08-01T19:55:05.225736+0000", 2023-08-01T19:55:54.821 INFO:teuthology.orchestra.run.smithi008.stdout: "duration": 3.0388000000000001e-05 2023-08-01T19:55:54.821 INFO:teuthology.orchestra.run.smithi008.stdout: }, 2023-08-01T19:55:54.821 INFO:teuthology.orchestra.run.smithi008.stdout: { 2023-08-01T19:55:54.822 INFO:teuthology.orchestra.run.smithi008.stdout: "event": "done", 2023-08-01T19:55:54.822 INFO:teuthology.orchestra.run.smithi008.stdout: "time": "2023-08-01T19:55:05.225757+0000", 2023-08-01T19:55:54.822 INFO:teuthology.orchestra.run.smithi008.stdout: "duration": 2.1090999999999998e-05 2023-08-01T19:55:54.822 INFO:teuthology.orchestra.run.smithi008.stdout: } 2023-08-01T19:55:54.822 INFO:teuthology.orchestra.run.smithi008.stdout: ] 2023-08-01T19:55:54.822 INFO:teuthology.orchestra.run.smithi008.stdout: } 2023-08-01T19:55:54.822 INFO:teuthology.orchestra.run.smithi008.stdout: }, 2023-08-01T19:55:54.822 INFO:teuthology.orchestra.run.smithi008.stdout: { 2023-08-01T19:55:54.823 INFO:teuthology.orchestra.run.smithi008.stdout: "description": "osd_op(client.4668.0:100261 5.a 5:562deedb:::benchmark_data_smithi006_114134_object100260:head [set-alloc-hint object_size 65536 write_size 65536,write 0~65536] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e37)", 2023-08-01T19:55:54.823 INFO:teuthology.orchestra.run.smithi008.stdout: "initiated_at": "2023-08-01T19:55:05.163316+0000", 2023-08-01T19:55:54.823 INFO:teuthology.orchestra.run.smithi008.stdout: "age": 49.634744492999999, 2023-08-01T19:55:54.823 INFO:teuthology.orchestra.run.smithi008.stdout: "duration": 0.063073012999999997, 2023-08-01T19:55:54.823 INFO:teuthology.orchestra.run.smithi008.stdout: "type_data": { 2023-08-01T19:55:54.823 INFO:teuthology.orchestra.run.smithi008.stdout: "flag_point": "commit sent; apply or cleanup", 2023-08-01T19:55:54.823 INFO:teuthology.orchestra.run.smithi008.stdout: "client_info": { 2023-08-01T19:55:54.823 INFO:teuthology.orchestra.run.smithi008.stdout: "client": "client.4668", 2023-08-01T19:55:54.824 INFO:teuthology.orchestra.run.smithi008.stdout: "client_addr": "172.21.15.6:0/1709472247", 2023-08-01T19:55:54.824 INFO:teuthology.orchestra.run.smithi008.stdout: "tid": 100261 2023-08-01T19:55:54.824 INFO:teuthology.orchestra.run.smithi008.stdout: }, 2023-08-01T19:55:54.824 INFO:teuthology.orchestra.run.smithi008.stdout: "events": [ 2023-08-01T19:55:54.824 INFO:teuthology.orchestra.run.smithi008.stdout: { 2023-08-01T19:55:54.824 INFO:teuthology.orchestra.run.smithi008.stdout: "event": "initiated", 2023-08-01T19:55:54.824 INFO:teuthology.orchestra.run.smithi008.stdout: "time": "2023-08-01T19:55:05.163316+0000", 2023-08-01T19:55:54.824 INFO:teuthology.orchestra.run.smithi008.stdout: "duration": 0 2023-08-01T19:55:54.825 INFO:teuthology.orchestra.run.smithi008.stdout: }, 2023-08-01T19:55:54.825 INFO:teuthology.orchestra.run.smithi008.stdout: { 2023-08-01T19:55:54.825 INFO:teuthology.orchestra.run.smithi008.stdout: "event": "throttled", 2023-08-01T19:55:54.825 INFO:teuthology.orchestra.run.smithi008.stdout: "time": "2023-08-01T19:55:05.163316+0000", 2023-08-01T19:55:54.825 INFO:teuthology.orchestra.run.smithi008.stdout: "duration": 0 2023-08-01T19:55:54.825 INFO:teuthology.orchestra.run.smithi008.stdout: }, 2023-08-01T19:55:54.825 INFO:teuthology.orchestra.run.smithi008.stdout: { 2023-08-01T19:55:54.826 INFO:teuthology.orchestra.run.smithi008.stdout: "event": "header_read", 2023-08-01T19:55:54.826 INFO:teuthology.orchestra.run.smithi008.stdout: "time": "2023-08-01T19:55:05.163316+0000", 2023-08-01T19:55:54.826 INFO:teuthology.orchestra.run.smithi008.stdout: "duration": 4294967295.999999 2023-08-01T19:55:54.826 INFO:teuthology.orchestra.run.smithi008.stdout: }, 2023-08-01T19:55:54.826 INFO:teuthology.orchestra.run.smithi008.stdout: { 2023-08-01T19:55:54.826 INFO:teuthology.orchestra.run.smithi008.stdout: "event": "all_read", 2023-08-01T19:55:54.826 INFO:teuthology.orchestra.run.smithi008.stdout: "time": "2023-08-01T19:55:05.163380+0000", 2023-08-01T19:55:54.826 INFO:teuthology.orchestra.run.smithi008.stdout: "duration": 6.4395999999999998e-05 2023-08-01T19:55:54.827 INFO:teuthology.orchestra.run.smithi008.stdout: }, 2023-08-01T19:55:54.827 INFO:teuthology.orchestra.run.smithi008.stdout: { 2023-08-01T19:55:54.827 INFO:teuthology.orchestra.run.smithi008.stdout: "event": "dispatched", 2023-08-01T19:55:54.827 INFO:teuthology.orchestra.run.smithi008.stdout: "time": "2023-08-01T19:55:05.163390+0000", 2023-08-01T19:55:54.827 INFO:teuthology.orchestra.run.smithi008.stdout: "duration": 1.0189e-05 2023-08-01T19:55:54.827 INFO:teuthology.orchestra.run.smithi008.stdout: }, 2023-08-01T19:55:54.827 INFO:teuthology.orchestra.run.smithi008.stdout: { 2023-08-01T19:55:54.827 INFO:teuthology.orchestra.run.smithi008.stdout: "event": "queued_for_pg", 2023-08-01T19:55:54.828 INFO:teuthology.orchestra.run.smithi008.stdout: "time": "2023-08-01T19:55:05.163395+0000", 2023-08-01T19:55:54.828 INFO:teuthology.orchestra.run.smithi008.stdout: "duration": 4.4059999999999998e-06 2023-08-01T19:55:54.828 INFO:teuthology.orchestra.run.smithi008.stdout: }, 2023-08-01T19:55:54.828 INFO:teuthology.orchestra.run.smithi008.stdout: { 2023-08-01T19:55:54.828 INFO:teuthology.orchestra.run.smithi008.stdout: "event": "reached_pg", 2023-08-01T19:55:54.828 INFO:teuthology.orchestra.run.smithi008.stdout: "time": "2023-08-01T19:55:05.163429+0000", 2023-08-01T19:55:54.828 INFO:teuthology.orchestra.run.smithi008.stdout: "duration": 3.4900000000000001e-05 2023-08-01T19:55:54.828 INFO:teuthology.orchestra.run.smithi008.stdout: }, 2023-08-01T19:55:54.829 INFO:teuthology.orchestra.run.smithi008.stdout: { 2023-08-01T19:55:54.829 INFO:teuthology.orchestra.run.smithi008.stdout: "event": "started", 2023-08-01T19:55:54.829 INFO:teuthology.orchestra.run.smithi008.stdout: "time": "2023-08-01T19:55:05.163512+0000", 2023-08-01T19:55:54.829 INFO:teuthology.orchestra.run.smithi008.stdout: "duration": 8.2987999999999999e-05 2023-08-01T19:55:54.829 INFO:teuthology.orchestra.run.smithi008.stdout: }, 2023-08-01T19:55:54.829 INFO:teuthology.orchestra.run.smithi008.stdout: { 2023-08-01T19:55:54.829 INFO:teuthology.orchestra.run.smithi008.stdout: "event": "waiting for subops from 2", 2023-08-01T19:55:54.830 INFO:teuthology.orchestra.run.smithi008.stdout: "time": "2023-08-01T19:55:05.163596+0000", 2023-08-01T19:55:54.830 INFO:teuthology.orchestra.run.smithi008.stdout: "duration": 8.3783999999999996e-05 2023-08-01T19:55:54.830 INFO:teuthology.orchestra.run.smithi008.stdout: }, 2023-08-01T19:55:54.830 INFO:teuthology.orchestra.run.smithi008.stdout: { 2023-08-01T19:55:54.830 INFO:teuthology.orchestra.run.smithi008.stdout: "event": "op_commit", 2023-08-01T19:55:54.830 INFO:teuthology.orchestra.run.smithi008.stdout: "time": "2023-08-01T19:55:05.167129+0000", 2023-08-01T19:55:54.830 INFO:teuthology.orchestra.run.smithi008.stdout: "duration": 0.0035328709999999999 2023-08-01T19:55:54.830 INFO:teuthology.orchestra.run.smithi008.stdout: }, 2023-08-01T19:55:54.831 INFO:teuthology.orchestra.run.smithi008.stdout: { 2023-08-01T19:55:54.831 INFO:teuthology.orchestra.run.smithi008.stdout: "event": "sub_op_commit_rec", 2023-08-01T19:55:54.831 INFO:teuthology.orchestra.run.smithi008.stdout: "time": "2023-08-01T19:55:05.226302+0000", 2023-08-01T19:55:54.831 INFO:teuthology.orchestra.run.smithi008.stdout: "duration": 0.059172711000000003 2023-08-01T19:55:54.831 INFO:teuthology.orchestra.run.smithi008.stdout: }, 2023-08-01T19:55:54.831 INFO:teuthology.orchestra.run.smithi008.stdout: { 2023-08-01T19:55:54.831 INFO:teuthology.orchestra.run.smithi008.stdout: "event": "commit_sent", 2023-08-01T19:55:54.831 INFO:teuthology.orchestra.run.smithi008.stdout: "time": "2023-08-01T19:55:05.226351+0000", 2023-08-01T19:55:54.832 INFO:teuthology.orchestra.run.smithi008.stdout: "duration": 4.969e-05 2023-08-01T19:55:54.832 INFO:teuthology.orchestra.run.smithi008.stdout: }, 2023-08-01T19:55:54.832 INFO:teuthology.orchestra.run.smithi008.stdout: { 2023-08-01T19:55:54.832 INFO:teuthology.orchestra.run.smithi008.stdout: "event": "done", 2023-08-01T19:55:54.832 INFO:teuthology.orchestra.run.smithi008.stdout: "time": "2023-08-01T19:55:05.226389+0000", 2023-08-01T19:55:54.832 INFO:teuthology.orchestra.run.smithi008.stdout: "duration": 3.7978000000000001e-05 2023-08-01T19:55:54.832 INFO:teuthology.orchestra.run.smithi008.stdout: } 2023-08-01T19:55:54.832 INFO:teuthology.orchestra.run.smithi008.stdout: ] 2023-08-01T19:55:54.833 INFO:teuthology.orchestra.run.smithi008.stdout: } 2023-08-01T19:55:54.833 INFO:teuthology.orchestra.run.smithi008.stdout: }, 2023-08-01T19:55:54.833 INFO:teuthology.orchestra.run.smithi008.stdout: { 2023-08-01T19:55:54.833 INFO:teuthology.orchestra.run.smithi008.stdout: "description": "osd_op(client.4668.0:100262 5.a 5:5c636b5d:::benchmark_data_smithi006_114134_object100261:head [set-alloc-hint object_size 65536 write_size 65536,write 0~65536] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e37)", 2023-08-01T19:55:54.833 INFO:teuthology.orchestra.run.smithi008.stdout: "initiated_at": "2023-08-01T19:55:05.165068+0000", 2023-08-01T19:55:54.833 INFO:teuthology.orchestra.run.smithi008.stdout: "age": 49.63299284, 2023-08-01T19:55:54.833 INFO:teuthology.orchestra.run.smithi008.stdout: "duration": 0.063919403, 2023-08-01T19:55:54.834 INFO:teuthology.orchestra.run.smithi008.stdout: "type_data": { 2023-08-01T19:55:54.834 INFO:teuthology.orchestra.run.smithi008.stdout: "flag_point": "commit sent; apply or cleanup", 2023-08-01T19:55:54.834 INFO:teuthology.orchestra.run.smithi008.stdout: "client_info": { 2023-08-01T19:55:54.834 INFO:teuthology.orchestra.run.smithi008.stdout: "client": "client.4668", 2023-08-01T19:55:54.834 INFO:teuthology.orchestra.run.smithi008.stdout: "client_addr": "172.21.15.6:0/1709472247", 2023-08-01T19:55:54.834 INFO:teuthology.orchestra.run.smithi008.stdout: "tid": 100262 2023-08-01T19:55:54.834 INFO:teuthology.orchestra.run.smithi008.stdout: }, 2023-08-01T19:55:54.834 INFO:teuthology.orchestra.run.smithi008.stdout: "events": [ 2023-08-01T19:55:54.835 INFO:teuthology.orchestra.run.smithi008.stdout: { 2023-08-01T19:55:54.835 INFO:teuthology.orchestra.run.smithi008.stdout: "event": "initiated", 2023-08-01T19:55:54.835 INFO:teuthology.orchestra.run.smithi008.stdout: "time": "2023-08-01T19:55:05.165068+0000", 2023-08-01T19:55:54.835 INFO:teuthology.orchestra.run.smithi008.stdout: "duration": 0 2023-08-01T19:55:54.835 INFO:teuthology.orchestra.run.smithi008.stdout: }, 2023-08-01T19:55:54.835 INFO:teuthology.orchestra.run.smithi008.stdout: { 2023-08-01T19:55:54.835 INFO:teuthology.orchestra.run.smithi008.stdout: "event": "throttled", 2023-08-01T19:55:54.835 INFO:teuthology.orchestra.run.smithi008.stdout: "time": "2023-08-01T19:55:05.165068+0000", 2023-08-01T19:55:54.836 INFO:teuthology.orchestra.run.smithi008.stdout: "duration": 0 2023-08-01T19:55:54.836 INFO:teuthology.orchestra.run.smithi008.stdout: }, 2023-08-01T19:55:54.836 INFO:teuthology.orchestra.run.smithi008.stdout: { 2023-08-01T19:55:54.836 INFO:teuthology.orchestra.run.smithi008.stdout: "event": "header_read", 2023-08-01T19:55:54.836 INFO:teuthology.orchestra.run.smithi008.stdout: "time": "2023-08-01T19:55:05.165067+0000", 2023-08-01T19:55:54.836 INFO:teuthology.orchestra.run.smithi008.stdout: "duration": 4294967295.999999 2023-08-01T19:55:54.836 INFO:teuthology.orchestra.run.smithi008.stdout: }, 2023-08-01T19:55:54.836 INFO:teuthology.orchestra.run.smithi008.stdout: { 2023-08-01T19:55:54.837 INFO:teuthology.orchestra.run.smithi008.stdout: "event": "all_read", 2023-08-01T19:55:54.837 INFO:teuthology.orchestra.run.smithi008.stdout: "time": "2023-08-01T19:55:05.165126+0000", 2023-08-01T19:55:54.837 INFO:teuthology.orchestra.run.smithi008.stdout: "duration": 5.9116000000000001e-05 2023-08-01T19:55:54.837 INFO:teuthology.orchestra.run.smithi008.stdout: }, 2023-08-01T19:55:54.837 INFO:teuthology.orchestra.run.smithi008.stdout: { 2023-08-01T19:55:54.837 INFO:teuthology.orchestra.run.smithi008.stdout: "event": "dispatched", 2023-08-01T19:55:54.837 INFO:teuthology.orchestra.run.smithi008.stdout: "time": "2023-08-01T19:55:05.165134+0000", 2023-08-01T19:55:54.837 INFO:teuthology.orchestra.run.smithi008.stdout: "duration": 7.9820000000000008e-06 2023-08-01T19:55:54.838 INFO:teuthology.orchestra.run.smithi008.stdout: }, 2023-08-01T19:55:54.838 INFO:teuthology.orchestra.run.smithi008.stdout: { 2023-08-01T19:55:54.838 INFO:teuthology.orchestra.run.smithi008.stdout: "event": "queued_for_pg", 2023-08-01T19:55:54.838 INFO:teuthology.orchestra.run.smithi008.stdout: "time": "2023-08-01T19:55:05.165139+0000", 2023-08-01T19:55:54.838 INFO:teuthology.orchestra.run.smithi008.stdout: "duration": 4.2560000000000004e-06 2023-08-01T19:55:54.838 INFO:teuthology.orchestra.run.smithi008.stdout: }, 2023-08-01T19:55:54.838 INFO:teuthology.orchestra.run.smithi008.stdout: { 2023-08-01T19:55:54.839 INFO:teuthology.orchestra.run.smithi008.stdout: "event": "reached_pg", 2023-08-01T19:55:54.839 INFO:teuthology.orchestra.run.smithi008.stdout: "time": "2023-08-01T19:55:05.165165+0000", 2023-08-01T19:55:54.839 INFO:teuthology.orchestra.run.smithi008.stdout: "duration": 2.6554e-05 2023-08-01T19:55:54.839 INFO:teuthology.orchestra.run.smithi008.stdout: }, 2023-08-01T19:55:54.839 INFO:teuthology.orchestra.run.smithi008.stdout: { 2023-08-01T19:55:54.839 INFO:teuthology.orchestra.run.smithi008.stdout: "event": "started", 2023-08-01T19:55:54.839 INFO:teuthology.orchestra.run.smithi008.stdout: "time": "2023-08-01T19:55:05.165243+0000", 2023-08-01T19:55:54.839 INFO:teuthology.orchestra.run.smithi008.stdout: "duration": 7.7877e-05 2023-08-01T19:55:54.840 INFO:teuthology.orchestra.run.smithi008.stdout: }, 2023-08-01T19:55:54.840 INFO:teuthology.orchestra.run.smithi008.stdout: { 2023-08-01T19:55:54.840 INFO:teuthology.orchestra.run.smithi008.stdout: "event": "waiting for subops from 2", 2023-08-01T19:55:54.840 INFO:teuthology.orchestra.run.smithi008.stdout: "time": "2023-08-01T19:55:05.165450+0000", 2023-08-01T19:55:54.840 INFO:teuthology.orchestra.run.smithi008.stdout: "duration": 0.00020655599999999999 2023-08-01T19:55:54.840 INFO:teuthology.orchestra.run.smithi008.stdout: }, 2023-08-01T19:55:54.840 INFO:teuthology.orchestra.run.smithi008.stdout: { 2023-08-01T19:55:54.840 INFO:teuthology.orchestra.run.smithi008.stdout: "event": "op_commit", 2023-08-01T19:55:54.841 INFO:teuthology.orchestra.run.smithi008.stdout: "time": "2023-08-01T19:55:05.168883+0000", 2023-08-01T19:55:54.841 INFO:teuthology.orchestra.run.smithi008.stdout: "duration": 0.0034333279999999998 2023-08-01T19:55:54.841 INFO:teuthology.orchestra.run.smithi008.stdout: }, 2023-08-01T19:55:54.841 INFO:teuthology.orchestra.run.smithi008.stdout: { 2023-08-01T19:55:54.841 INFO:teuthology.orchestra.run.smithi008.stdout: "event": "sub_op_commit_rec", 2023-08-01T19:55:54.841 INFO:teuthology.orchestra.run.smithi008.stdout: "time": "2023-08-01T19:55:05.228904+0000", 2023-08-01T19:55:54.841 INFO:teuthology.orchestra.run.smithi008.stdout: "duration": 0.060021370999999997 2023-08-01T19:55:54.841 INFO:teuthology.orchestra.run.smithi008.stdout: }, 2023-08-01T19:55:54.842 INFO:teuthology.orchestra.run.smithi008.stdout: { 2023-08-01T19:55:54.842 INFO:teuthology.orchestra.run.smithi008.stdout: "event": "commit_sent", 2023-08-01T19:55:54.842 INFO:teuthology.orchestra.run.smithi008.stdout: "time": "2023-08-01T19:55:05.228952+0000", 2023-08-01T19:55:54.842 INFO:teuthology.orchestra.run.smithi008.stdout: "duration": 4.8056999999999997e-05 2023-08-01T19:55:54.842 INFO:teuthology.orchestra.run.smithi008.stdout: }, 2023-08-01T19:55:54.842 INFO:teuthology.orchestra.run.smithi008.stdout: { 2023-08-01T19:55:54.842 INFO:teuthology.orchestra.run.smithi008.stdout: "event": "done", 2023-08-01T19:55:54.842 INFO:teuthology.orchestra.run.smithi008.stdout: "time": "2023-08-01T19:55:05.228987+0000", 2023-08-01T19:55:54.843 INFO:teuthology.orchestra.run.smithi008.stdout: "duration": 3.5083000000000003e-05 2023-08-01T19:55:54.843 INFO:teuthology.orchestra.run.smithi008.stdout: } 2023-08-01T19:55:54.843 INFO:teuthology.orchestra.run.smithi008.stdout: ] 2023-08-01T19:55:54.843 INFO:teuthology.orchestra.run.smithi008.stdout: } 2023-08-01T19:55:54.843 INFO:teuthology.orchestra.run.smithi008.stdout: }, 2023-08-01T19:55:54.843 INFO:teuthology.orchestra.run.smithi008.stdout: { 2023-08-01T19:55:54.843 INFO:teuthology.orchestra.run.smithi008.stdout: "description": "osd_op(client.4668.0:100929 5.3 5:c29f4adb:::benchmark_data_smithi006_114134_object100928:head [set-alloc-hint object_size 65536 write_size 65536,write 0~65536] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e37)", 2023-08-01T19:55:54.843 INFO:teuthology.orchestra.run.smithi008.stdout: "initiated_at": "2023-08-01T19:55:05.564759+0000", 2023-08-01T19:55:54.844 INFO:teuthology.orchestra.run.smithi008.stdout: "age": 49.233302201000001, 2023-08-01T19:55:54.844 INFO:teuthology.orchestra.run.smithi008.stdout: "duration": 0.062544635000000001, 2023-08-01T19:55:54.844 INFO:teuthology.orchestra.run.smithi008.stdout: "type_data": { 2023-08-01T19:55:54.844 INFO:teuthology.orchestra.run.smithi008.stdout: "flag_point": "commit sent; apply or cleanup", 2023-08-01T19:55:54.844 INFO:teuthology.orchestra.run.smithi008.stdout: "client_info": { 2023-08-01T19:55:54.844 INFO:teuthology.orchestra.run.smithi008.stdout: "client": "client.4668", 2023-08-01T19:55:54.844 INFO:teuthology.orchestra.run.smithi008.stdout: "client_addr": "172.21.15.6:0/1709472247", 2023-08-01T19:55:54.845 INFO:teuthology.orchestra.run.smithi008.stdout: "tid": 100929 2023-08-01T19:55:54.845 INFO:teuthology.orchestra.run.smithi008.stdout: }, 2023-08-01T19:55:54.845 INFO:teuthology.orchestra.run.smithi008.stdout: "events": [ 2023-08-01T19:55:54.845 INFO:teuthology.orchestra.run.smithi008.stdout: { 2023-08-01T19:55:54.845 INFO:teuthology.orchestra.run.smithi008.stdout: "event": "initiated", 2023-08-01T19:55:54.845 INFO:teuthology.orchestra.run.smithi008.stdout: "time": "2023-08-01T19:55:05.564759+0000", 2023-08-01T19:55:54.845 INFO:teuthology.orchestra.run.smithi008.stdout: "duration": 0 2023-08-01T19:55:54.845 INFO:teuthology.orchestra.run.smithi008.stdout: }, 2023-08-01T19:55:54.846 INFO:teuthology.orchestra.run.smithi008.stdout: { 2023-08-01T19:55:54.846 INFO:teuthology.orchestra.run.smithi008.stdout: "event": "throttled", 2023-08-01T19:55:54.846 INFO:teuthology.orchestra.run.smithi008.stdout: "time": "2023-08-01T19:55:05.564759+0000", 2023-08-01T19:55:54.846 INFO:teuthology.orchestra.run.smithi008.stdout: "duration": 0 2023-08-01T19:55:54.846 INFO:teuthology.orchestra.run.smithi008.stdout: }, 2023-08-01T19:55:54.846 INFO:teuthology.orchestra.run.smithi008.stdout: { 2023-08-01T19:55:54.846 INFO:teuthology.orchestra.run.smithi008.stdout: "event": "header_read", 2023-08-01T19:55:54.846 INFO:teuthology.orchestra.run.smithi008.stdout: "time": "2023-08-01T19:55:05.564758+0000", 2023-08-01T19:55:54.847 INFO:teuthology.orchestra.run.smithi008.stdout: "duration": 4294967295.999999 2023-08-01T19:55:54.847 INFO:teuthology.orchestra.run.smithi008.stdout: }, 2023-08-01T19:55:54.847 INFO:teuthology.orchestra.run.smithi008.stdout: { 2023-08-01T19:55:54.847 INFO:teuthology.orchestra.run.smithi008.stdout: "event": "all_read", 2023-08-01T19:55:54.847 INFO:teuthology.orchestra.run.smithi008.stdout: "time": "2023-08-01T19:55:05.564815+0000", 2023-08-01T19:55:54.847 INFO:teuthology.orchestra.run.smithi008.stdout: "duration": 5.7757000000000003e-05 2023-08-01T19:55:54.847 INFO:teuthology.orchestra.run.smithi008.stdout: }, 2023-08-01T19:55:54.847 INFO:teuthology.orchestra.run.smithi008.stdout: { 2023-08-01T19:55:54.848 INFO:teuthology.orchestra.run.smithi008.stdout: "event": "dispatched", 2023-08-01T19:55:54.848 INFO:teuthology.orchestra.run.smithi008.stdout: "time": "2023-08-01T19:55:05.564824+0000", 2023-08-01T19:55:54.848 INFO:teuthology.orchestra.run.smithi008.stdout: "duration": 8.6559999999999998e-06 2023-08-01T19:55:54.848 INFO:teuthology.orchestra.run.smithi008.stdout: }, 2023-08-01T19:55:54.848 INFO:teuthology.orchestra.run.smithi008.stdout: { 2023-08-01T19:55:54.848 INFO:teuthology.orchestra.run.smithi008.stdout: "event": "queued_for_pg", 2023-08-01T19:55:54.848 INFO:teuthology.orchestra.run.smithi008.stdout: "time": "2023-08-01T19:55:05.564829+0000", 2023-08-01T19:55:54.848 INFO:teuthology.orchestra.run.smithi008.stdout: "duration": 4.6160000000000004e-06 2023-08-01T19:55:54.849 INFO:teuthology.orchestra.run.smithi008.stdout: }, 2023-08-01T19:55:54.849 INFO:teuthology.orchestra.run.smithi008.stdout: { 2023-08-01T19:55:54.849 INFO:teuthology.orchestra.run.smithi008.stdout: "event": "reached_pg", 2023-08-01T19:55:54.849 INFO:teuthology.orchestra.run.smithi008.stdout: "time": "2023-08-01T19:55:05.564871+0000", 2023-08-01T19:55:54.849 INFO:teuthology.orchestra.run.smithi008.stdout: "duration": 4.2206000000000002e-05 2023-08-01T19:55:54.849 INFO:teuthology.orchestra.run.smithi008.stdout: }, 2023-08-01T19:55:54.849 INFO:teuthology.orchestra.run.smithi008.stdout: { 2023-08-01T19:55:54.850 INFO:teuthology.orchestra.run.smithi008.stdout: "event": "started", 2023-08-01T19:55:54.850 INFO:teuthology.orchestra.run.smithi008.stdout: "time": "2023-08-01T19:55:05.565011+0000", 2023-08-01T19:55:54.850 INFO:teuthology.orchestra.run.smithi008.stdout: "duration": 0.000140469 2023-08-01T19:55:54.850 INFO:teuthology.orchestra.run.smithi008.stdout: }, 2023-08-01T19:55:54.850 INFO:teuthology.orchestra.run.smithi008.stdout: { 2023-08-01T19:55:54.850 INFO:teuthology.orchestra.run.smithi008.stdout: "event": "waiting for subops from 1", 2023-08-01T19:55:54.850 INFO:teuthology.orchestra.run.smithi008.stdout: "time": "2023-08-01T19:55:05.565212+0000", 2023-08-01T19:55:54.850 INFO:teuthology.orchestra.run.smithi008.stdout: "duration": 0.00020106599999999999 2023-08-01T19:55:54.851 INFO:teuthology.orchestra.run.smithi008.stdout: }, 2023-08-01T19:55:54.851 INFO:teuthology.orchestra.run.smithi008.stdout: { 2023-08-01T19:55:54.851 INFO:teuthology.orchestra.run.smithi008.stdout: "event": "sub_op_commit_rec", 2023-08-01T19:55:54.851 INFO:teuthology.orchestra.run.smithi008.stdout: "time": "2023-08-01T19:55:05.626925+0000", 2023-08-01T19:55:54.851 INFO:teuthology.orchestra.run.smithi008.stdout: "duration": 0.061712111 2023-08-01T19:55:54.851 INFO:teuthology.orchestra.run.smithi008.stdout: }, 2023-08-01T19:55:54.851 INFO:teuthology.orchestra.run.smithi008.stdout: { 2023-08-01T19:55:54.851 INFO:teuthology.orchestra.run.smithi008.stdout: "event": "op_commit", 2023-08-01T19:55:54.852 INFO:teuthology.orchestra.run.smithi008.stdout: "time": "2023-08-01T19:55:05.627217+0000", 2023-08-01T19:55:54.852 INFO:teuthology.orchestra.run.smithi008.stdout: "duration": 0.00029265999999999998 2023-08-01T19:55:54.852 INFO:teuthology.orchestra.run.smithi008.stdout: }, 2023-08-01T19:55:54.852 INFO:teuthology.orchestra.run.smithi008.stdout: { 2023-08-01T19:55:54.852 INFO:teuthology.orchestra.run.smithi008.stdout: "event": "commit_sent", 2023-08-01T19:55:54.852 INFO:teuthology.orchestra.run.smithi008.stdout: "time": "2023-08-01T19:55:05.627264+0000", 2023-08-01T19:55:54.852 INFO:teuthology.orchestra.run.smithi008.stdout: "duration": 4.6260000000000001e-05 2023-08-01T19:55:54.852 INFO:teuthology.orchestra.run.smithi008.stdout: }, 2023-08-01T19:55:54.853 INFO:teuthology.orchestra.run.smithi008.stdout: { 2023-08-01T19:55:54.853 INFO:teuthology.orchestra.run.smithi008.stdout: "event": "done", 2023-08-01T19:55:54.853 INFO:teuthology.orchestra.run.smithi008.stdout: "time": "2023-08-01T19:55:05.627303+0000", 2023-08-01T19:55:54.853 INFO:teuthology.orchestra.run.smithi008.stdout: "duration": 3.9839999999999998e-05 2023-08-01T19:55:54.853 INFO:teuthology.orchestra.run.smithi008.stdout: } 2023-08-01T19:55:54.853 INFO:teuthology.orchestra.run.smithi008.stdout: ] 2023-08-01T19:55:54.853 INFO:teuthology.orchestra.run.smithi008.stdout: } 2023-08-01T19:55:54.853 INFO:teuthology.orchestra.run.smithi008.stdout: }, 2023-08-01T19:55:54.854 INFO:teuthology.orchestra.run.smithi008.stdout: { 2023-08-01T19:55:54.854 INFO:teuthology.orchestra.run.smithi008.stdout: "description": "osd_repop(client.4668.0:100928 5.7 e37/19 5:e61a7dfa:::benchmark_data_smithi006_114134_object100927:head v 37'6273, mlcod=37'6270)", 2023-08-01T19:55:54.854 INFO:teuthology.orchestra.run.smithi008.stdout: "initiated_at": "2023-08-01T19:55:05.565106+0000", 2023-08-01T19:55:54.854 INFO:teuthology.orchestra.run.smithi008.stdout: "age": 49.232955103000002, 2023-08-01T19:55:54.854 INFO:teuthology.orchestra.run.smithi008.stdout: "duration": 0.064091282999999999, 2023-08-01T19:55:54.854 INFO:teuthology.orchestra.run.smithi008.stdout: "type_data": { 2023-08-01T19:55:54.854 INFO:teuthology.orchestra.run.smithi008.stdout: "flag_point": "commit sent; apply or cleanup", 2023-08-01T19:55:54.854 INFO:teuthology.orchestra.run.smithi008.stdout: "events": [ 2023-08-01T19:55:54.855 INFO:teuthology.orchestra.run.smithi008.stdout: { 2023-08-01T19:55:54.855 INFO:teuthology.orchestra.run.smithi008.stdout: "event": "initiated", 2023-08-01T19:55:54.855 INFO:teuthology.orchestra.run.smithi008.stdout: "time": "2023-08-01T19:55:05.565106+0000", 2023-08-01T19:55:54.855 INFO:teuthology.orchestra.run.smithi008.stdout: "duration": 0 2023-08-01T19:55:54.855 INFO:teuthology.orchestra.run.smithi008.stdout: }, 2023-08-01T19:55:54.855 INFO:teuthology.orchestra.run.smithi008.stdout: { 2023-08-01T19:55:54.855 INFO:teuthology.orchestra.run.smithi008.stdout: "event": "throttled", 2023-08-01T19:55:54.856 INFO:teuthology.orchestra.run.smithi008.stdout: "time": "2023-08-01T19:55:05.565106+0000", 2023-08-01T19:55:54.856 INFO:teuthology.orchestra.run.smithi008.stdout: "duration": 0 2023-08-01T19:55:54.856 INFO:teuthology.orchestra.run.smithi008.stdout: }, 2023-08-01T19:55:54.856 INFO:teuthology.orchestra.run.smithi008.stdout: { 2023-08-01T19:55:54.856 INFO:teuthology.orchestra.run.smithi008.stdout: "event": "header_read", 2023-08-01T19:55:54.856 INFO:teuthology.orchestra.run.smithi008.stdout: "time": "2023-08-01T19:55:05.565105+0000", 2023-08-01T19:55:54.856 INFO:teuthology.orchestra.run.smithi008.stdout: "duration": 4294967295.9999995 2023-08-01T19:55:54.856 INFO:teuthology.orchestra.run.smithi008.stdout: }, 2023-08-01T19:55:54.857 INFO:teuthology.orchestra.run.smithi008.stdout: { 2023-08-01T19:55:54.857 INFO:teuthology.orchestra.run.smithi008.stdout: "event": "all_read", 2023-08-01T19:55:54.857 INFO:teuthology.orchestra.run.smithi008.stdout: "time": "2023-08-01T19:55:05.565173+0000", 2023-08-01T19:55:54.857 INFO:teuthology.orchestra.run.smithi008.stdout: "duration": 6.8186000000000001e-05 2023-08-01T19:55:54.857 INFO:teuthology.orchestra.run.smithi008.stdout: }, 2023-08-01T19:55:54.857 INFO:teuthology.orchestra.run.smithi008.stdout: { 2023-08-01T19:55:54.857 INFO:teuthology.orchestra.run.smithi008.stdout: "event": "dispatched", 2023-08-01T19:55:54.857 INFO:teuthology.orchestra.run.smithi008.stdout: "time": "2023-08-01T19:55:05.565182+0000", 2023-08-01T19:55:54.858 INFO:teuthology.orchestra.run.smithi008.stdout: "duration": 8.3620000000000006e-06 2023-08-01T19:55:54.858 INFO:teuthology.orchestra.run.smithi008.stdout: }, 2023-08-01T19:55:54.858 INFO:teuthology.orchestra.run.smithi008.stdout: { 2023-08-01T19:55:54.858 INFO:teuthology.orchestra.run.smithi008.stdout: "event": "queued_for_pg", 2023-08-01T19:55:54.858 INFO:teuthology.orchestra.run.smithi008.stdout: "time": "2023-08-01T19:55:05.565186+0000", 2023-08-01T19:55:54.858 INFO:teuthology.orchestra.run.smithi008.stdout: "duration": 3.7680000000000002e-06 2023-08-01T19:55:54.858 INFO:teuthology.orchestra.run.smithi008.stdout: }, 2023-08-01T19:55:54.858 INFO:teuthology.orchestra.run.smithi008.stdout: { 2023-08-01T19:55:54.859 INFO:teuthology.orchestra.run.smithi008.stdout: "event": "reached_pg", 2023-08-01T19:55:54.859 INFO:teuthology.orchestra.run.smithi008.stdout: "time": "2023-08-01T19:55:05.565212+0000", 2023-08-01T19:55:54.859 INFO:teuthology.orchestra.run.smithi008.stdout: "duration": 2.6230000000000001e-05 2023-08-01T19:55:54.859 INFO:teuthology.orchestra.run.smithi008.stdout: }, 2023-08-01T19:55:54.859 INFO:teuthology.orchestra.run.smithi008.stdout: { 2023-08-01T19:55:54.859 INFO:teuthology.orchestra.run.smithi008.stdout: "event": "started", 2023-08-01T19:55:54.859 INFO:teuthology.orchestra.run.smithi008.stdout: "time": "2023-08-01T19:55:05.565224+0000", 2023-08-01T19:55:54.859 INFO:teuthology.orchestra.run.smithi008.stdout: "duration": 1.2033e-05 2023-08-01T19:55:54.860 INFO:teuthology.orchestra.run.smithi008.stdout: }, 2023-08-01T19:55:54.860 INFO:teuthology.orchestra.run.smithi008.stdout: { 2023-08-01T19:55:54.860 INFO:teuthology.orchestra.run.smithi008.stdout: "event": "commit_sent", 2023-08-01T19:55:54.860 INFO:teuthology.orchestra.run.smithi008.stdout: "time": "2023-08-01T19:55:05.629152+0000", 2023-08-01T19:55:54.860 INFO:teuthology.orchestra.run.smithi008.stdout: "duration": 0.063928378999999994 2023-08-01T19:55:54.860 INFO:teuthology.orchestra.run.smithi008.stdout: }, 2023-08-01T19:55:54.860 INFO:teuthology.orchestra.run.smithi008.stdout: { 2023-08-01T19:55:54.861 INFO:teuthology.orchestra.run.smithi008.stdout: "event": "done", 2023-08-01T19:55:54.861 INFO:teuthology.orchestra.run.smithi008.stdout: "time": "2023-08-01T19:55:05.629197+0000", 2023-08-01T19:55:54.861 INFO:teuthology.orchestra.run.smithi008.stdout: "duration": 4.4894000000000001e-05 2023-08-01T19:55:54.861 INFO:teuthology.orchestra.run.smithi008.stdout: } 2023-08-01T19:55:54.861 INFO:teuthology.orchestra.run.smithi008.stdout: ] 2023-08-01T19:55:54.861 INFO:teuthology.orchestra.run.smithi008.stdout: } 2023-08-01T19:55:54.861 INFO:teuthology.orchestra.run.smithi008.stdout: }, 2023-08-01T19:55:54.861 INFO:teuthology.orchestra.run.smithi008.stdout: { 2023-08-01T19:55:54.862 INFO:teuthology.orchestra.run.smithi008.stdout: "description": "osd_repop(client.4668.0:100927 5.0 e37/19 5:00608ec6:::benchmark_data_smithi006_114134_object100926:head v 37'6408, mlcod=37'6403)", 2023-08-01T19:55:54.862 INFO:teuthology.orchestra.run.smithi008.stdout: "initiated_at": "2023-08-01T19:55:05.565153+0000", 2023-08-01T19:55:54.862 INFO:teuthology.orchestra.run.smithi008.stdout: "age": 49.232908365999997, 2023-08-01T19:55:54.862 INFO:teuthology.orchestra.run.smithi008.stdout: "duration": 0.062202714999999999, 2023-08-01T19:55:54.862 INFO:teuthology.orchestra.run.smithi008.stdout: "type_data": { 2023-08-01T19:55:54.862 INFO:teuthology.orchestra.run.smithi008.stdout: "flag_point": "commit sent; apply or cleanup", 2023-08-01T19:55:54.862 INFO:teuthology.orchestra.run.smithi008.stdout: "events": [ 2023-08-01T19:55:54.862 INFO:teuthology.orchestra.run.smithi008.stdout: { 2023-08-01T19:55:54.863 INFO:teuthology.orchestra.run.smithi008.stdout: "event": "initiated", 2023-08-01T19:55:54.863 INFO:teuthology.orchestra.run.smithi008.stdout: "time": "2023-08-01T19:55:05.565153+0000", 2023-08-01T19:55:54.863 INFO:teuthology.orchestra.run.smithi008.stdout: "duration": 0 2023-08-01T19:55:54.863 INFO:teuthology.orchestra.run.smithi008.stdout: }, 2023-08-01T19:55:54.863 INFO:teuthology.orchestra.run.smithi008.stdout: { 2023-08-01T19:55:54.863 INFO:teuthology.orchestra.run.smithi008.stdout: "event": "throttled", 2023-08-01T19:55:54.863 INFO:teuthology.orchestra.run.smithi008.stdout: "time": "2023-08-01T19:55:05.565153+0000", 2023-08-01T19:55:54.863 INFO:teuthology.orchestra.run.smithi008.stdout: "duration": 0 2023-08-01T19:55:54.864 INFO:teuthology.orchestra.run.smithi008.stdout: }, 2023-08-01T19:55:54.864 INFO:teuthology.orchestra.run.smithi008.stdout: { 2023-08-01T19:55:54.864 INFO:teuthology.orchestra.run.smithi008.stdout: "event": "header_read", 2023-08-01T19:55:54.864 INFO:teuthology.orchestra.run.smithi008.stdout: "time": "2023-08-01T19:55:05.565152+0000", 2023-08-01T19:55:54.864 INFO:teuthology.orchestra.run.smithi008.stdout: "duration": 4294967295.9999995 2023-08-01T19:55:54.864 INFO:teuthology.orchestra.run.smithi008.stdout: }, 2023-08-01T19:55:54.864 INFO:teuthology.orchestra.run.smithi008.stdout: { 2023-08-01T19:55:54.865 INFO:teuthology.orchestra.run.smithi008.stdout: "event": "all_read", 2023-08-01T19:55:54.865 INFO:teuthology.orchestra.run.smithi008.stdout: "time": "2023-08-01T19:55:05.565225+0000", 2023-08-01T19:55:54.865 INFO:teuthology.orchestra.run.smithi008.stdout: "duration": 7.2471000000000005e-05 2023-08-01T19:55:54.865 INFO:teuthology.orchestra.run.smithi008.stdout: }, 2023-08-01T19:55:54.865 INFO:teuthology.orchestra.run.smithi008.stdout: { 2023-08-01T19:55:54.865 INFO:teuthology.orchestra.run.smithi008.stdout: "event": "dispatched", 2023-08-01T19:55:54.865 INFO:teuthology.orchestra.run.smithi008.stdout: "time": "2023-08-01T19:55:05.565229+0000", 2023-08-01T19:55:54.865 INFO:teuthology.orchestra.run.smithi008.stdout: "duration": 4.5600000000000004e-06 2023-08-01T19:55:54.866 INFO:teuthology.orchestra.run.smithi008.stdout: }, 2023-08-01T19:55:54.866 INFO:teuthology.orchestra.run.smithi008.stdout: { 2023-08-01T19:55:54.866 INFO:teuthology.orchestra.run.smithi008.stdout: "event": "queued_for_pg", 2023-08-01T19:55:54.866 INFO:teuthology.orchestra.run.smithi008.stdout: "time": "2023-08-01T19:55:05.565232+0000", 2023-08-01T19:55:54.866 INFO:teuthology.orchestra.run.smithi008.stdout: "duration": 2.6900000000000001e-06 2023-08-01T19:55:54.866 INFO:teuthology.orchestra.run.smithi008.stdout: }, 2023-08-01T19:55:54.866 INFO:teuthology.orchestra.run.smithi008.stdout: { 2023-08-01T19:55:54.866 INFO:teuthology.orchestra.run.smithi008.stdout: "event": "reached_pg", 2023-08-01T19:55:54.867 INFO:teuthology.orchestra.run.smithi008.stdout: "time": "2023-08-01T19:55:05.565283+0000", 2023-08-01T19:55:54.867 INFO:teuthology.orchestra.run.smithi008.stdout: "duration": 5.1442e-05 2023-08-01T19:55:54.867 INFO:teuthology.orchestra.run.smithi008.stdout: }, 2023-08-01T19:55:54.867 INFO:teuthology.orchestra.run.smithi008.stdout: { 2023-08-01T19:55:54.867 INFO:teuthology.orchestra.run.smithi008.stdout: "event": "started", 2023-08-01T19:55:54.867 INFO:teuthology.orchestra.run.smithi008.stdout: "time": "2023-08-01T19:55:05.565301+0000", 2023-08-01T19:55:54.867 INFO:teuthology.orchestra.run.smithi008.stdout: "duration": 1.8029e-05 2023-08-01T19:55:54.867 INFO:teuthology.orchestra.run.smithi008.stdout: }, 2023-08-01T19:55:54.868 INFO:teuthology.orchestra.run.smithi008.stdout: { 2023-08-01T19:55:54.868 INFO:teuthology.orchestra.run.smithi008.stdout: "event": "commit_sent", 2023-08-01T19:55:54.868 INFO:teuthology.orchestra.run.smithi008.stdout: "time": "2023-08-01T19:55:05.627318+0000", 2023-08-01T19:55:54.868 INFO:teuthology.orchestra.run.smithi008.stdout: "duration": 0.062016763000000003 2023-08-01T19:55:54.868 INFO:teuthology.orchestra.run.smithi008.stdout: }, 2023-08-01T19:55:54.868 INFO:teuthology.orchestra.run.smithi008.stdout: { 2023-08-01T19:55:54.868 INFO:teuthology.orchestra.run.smithi008.stdout: "event": "done", 2023-08-01T19:55:54.868 INFO:teuthology.orchestra.run.smithi008.stdout: "time": "2023-08-01T19:55:05.627355+0000", 2023-08-01T19:55:54.869 INFO:teuthology.orchestra.run.smithi008.stdout: "duration": 3.7258999999999997e-05 2023-08-01T19:55:54.869 INFO:teuthology.orchestra.run.smithi008.stdout: } 2023-08-01T19:55:54.869 INFO:teuthology.orchestra.run.smithi008.stdout: ] 2023-08-01T19:55:54.869 INFO:teuthology.orchestra.run.smithi008.stdout: } 2023-08-01T19:55:54.869 INFO:teuthology.orchestra.run.smithi008.stdout: }, 2023-08-01T19:55:54.869 INFO:teuthology.orchestra.run.smithi008.stdout: { 2023-08-01T19:55:54.869 INFO:teuthology.orchestra.run.smithi008.stdout: "description": "osd_op(client.4668.0:100930 5.5 5:a7b64eb3:::benchmark_data_smithi006_114134_object100929:head [set-alloc-hint object_size 65536 write_size 65536,write 0~65536] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e37)", 2023-08-01T19:55:54.869 INFO:teuthology.orchestra.run.smithi008.stdout: "initiated_at": "2023-08-01T19:55:05.565766+0000", 2023-08-01T19:55:54.870 INFO:teuthology.orchestra.run.smithi008.stdout: "age": 49.232294580999998, 2023-08-01T19:55:54.870 INFO:teuthology.orchestra.run.smithi008.stdout: "duration": 0.063668735000000004, 2023-08-01T19:55:54.870 INFO:teuthology.orchestra.run.smithi008.stdout: "type_data": { 2023-08-01T19:55:54.870 INFO:teuthology.orchestra.run.smithi008.stdout: "flag_point": "commit sent; apply or cleanup", 2023-08-01T19:55:54.870 INFO:teuthology.orchestra.run.smithi008.stdout: "client_info": { 2023-08-01T19:55:54.870 INFO:teuthology.orchestra.run.smithi008.stdout: "client": "client.4668", 2023-08-01T19:55:54.870 INFO:teuthology.orchestra.run.smithi008.stdout: "client_addr": "172.21.15.6:0/1709472247", 2023-08-01T19:55:54.870 INFO:teuthology.orchestra.run.smithi008.stdout: "tid": 100930 2023-08-01T19:55:54.871 INFO:teuthology.orchestra.run.smithi008.stdout: }, 2023-08-01T19:55:54.871 INFO:teuthology.orchestra.run.smithi008.stdout: "events": [ 2023-08-01T19:55:54.871 INFO:teuthology.orchestra.run.smithi008.stdout: { 2023-08-01T19:55:54.871 INFO:teuthology.orchestra.run.smithi008.stdout: "event": "initiated", 2023-08-01T19:55:54.871 INFO:teuthology.orchestra.run.smithi008.stdout: "time": "2023-08-01T19:55:05.565766+0000", 2023-08-01T19:55:54.871 INFO:teuthology.orchestra.run.smithi008.stdout: "duration": 0 2023-08-01T19:55:54.871 INFO:teuthology.orchestra.run.smithi008.stdout: }, 2023-08-01T19:55:54.871 INFO:teuthology.orchestra.run.smithi008.stdout: { 2023-08-01T19:55:54.872 INFO:teuthology.orchestra.run.smithi008.stdout: "event": "throttled", 2023-08-01T19:55:54.872 INFO:teuthology.orchestra.run.smithi008.stdout: "time": "2023-08-01T19:55:05.565766+0000", 2023-08-01T19:55:54.872 INFO:teuthology.orchestra.run.smithi008.stdout: "duration": 0 2023-08-01T19:55:54.872 INFO:teuthology.orchestra.run.smithi008.stdout: }, 2023-08-01T19:55:54.872 INFO:teuthology.orchestra.run.smithi008.stdout: { 2023-08-01T19:55:54.872 INFO:teuthology.orchestra.run.smithi008.stdout: "event": "header_read", 2023-08-01T19:55:54.872 INFO:teuthology.orchestra.run.smithi008.stdout: "time": "2023-08-01T19:55:05.565766+0000", 2023-08-01T19:55:54.873 INFO:teuthology.orchestra.run.smithi008.stdout: "duration": 4294967295.999999 2023-08-01T19:55:54.873 INFO:teuthology.orchestra.run.smithi008.stdout: }, 2023-08-01T19:55:54.873 INFO:teuthology.orchestra.run.smithi008.stdout: { 2023-08-01T19:55:54.873 INFO:teuthology.orchestra.run.smithi008.stdout: "event": "all_read", 2023-08-01T19:55:54.873 INFO:teuthology.orchestra.run.smithi008.stdout: "time": "2023-08-01T19:55:05.565855+0000", 2023-08-01T19:55:54.873 INFO:teuthology.orchestra.run.smithi008.stdout: "duration": 8.9166999999999995e-05 2023-08-01T19:55:54.873 INFO:teuthology.orchestra.run.smithi008.stdout: }, 2023-08-01T19:55:54.873 INFO:teuthology.orchestra.run.smithi008.stdout: { 2023-08-01T19:55:54.874 INFO:teuthology.orchestra.run.smithi008.stdout: "event": "dispatched", 2023-08-01T19:55:54.874 INFO:teuthology.orchestra.run.smithi008.stdout: "time": "2023-08-01T19:55:05.565862+0000", 2023-08-01T19:55:54.874 INFO:teuthology.orchestra.run.smithi008.stdout: "duration": 7.4549999999999998e-06 2023-08-01T19:55:54.874 INFO:teuthology.orchestra.run.smithi008.stdout: }, 2023-08-01T19:55:54.874 INFO:teuthology.orchestra.run.smithi008.stdout: { 2023-08-01T19:55:54.874 INFO:teuthology.orchestra.run.smithi008.stdout: "event": "queued_for_pg", 2023-08-01T19:55:54.874 INFO:teuthology.orchestra.run.smithi008.stdout: "time": "2023-08-01T19:55:05.565866+0000", 2023-08-01T19:55:54.874 INFO:teuthology.orchestra.run.smithi008.stdout: "duration": 3.8060000000000001e-06 2023-08-01T19:55:54.875 INFO:teuthology.orchestra.run.smithi008.stdout: }, 2023-08-01T19:55:54.875 INFO:teuthology.orchestra.run.smithi008.stdout: { 2023-08-01T19:55:54.875 INFO:teuthology.orchestra.run.smithi008.stdout: "event": "reached_pg", 2023-08-01T19:55:54.875 INFO:teuthology.orchestra.run.smithi008.stdout: "time": "2023-08-01T19:55:05.565901+0000", 2023-08-01T19:55:54.875 INFO:teuthology.orchestra.run.smithi008.stdout: "duration": 3.5063e-05 2023-08-01T19:55:54.875 INFO:teuthology.orchestra.run.smithi008.stdout: }, 2023-08-01T19:55:54.875 INFO:teuthology.orchestra.run.smithi008.stdout: { 2023-08-01T19:55:54.875 INFO:teuthology.orchestra.run.smithi008.stdout: "event": "started", 2023-08-01T19:55:54.876 INFO:teuthology.orchestra.run.smithi008.stdout: "time": "2023-08-01T19:55:05.566016+0000", 2023-08-01T19:55:54.876 INFO:teuthology.orchestra.run.smithi008.stdout: "duration": 0.00011509400000000001 2023-08-01T19:55:54.876 INFO:teuthology.orchestra.run.smithi008.stdout: }, 2023-08-01T19:55:54.876 INFO:teuthology.orchestra.run.smithi008.stdout: { 2023-08-01T19:55:54.876 INFO:teuthology.orchestra.run.smithi008.stdout: "event": "waiting for subops from 1", 2023-08-01T19:55:54.876 INFO:teuthology.orchestra.run.smithi008.stdout: "time": "2023-08-01T19:55:05.566154+0000", 2023-08-01T19:55:54.876 INFO:teuthology.orchestra.run.smithi008.stdout: "duration": 0.000138052 2023-08-01T19:55:54.877 INFO:teuthology.orchestra.run.smithi008.stdout: }, 2023-08-01T19:55:54.877 INFO:teuthology.orchestra.run.smithi008.stdout: { 2023-08-01T19:55:54.877 INFO:teuthology.orchestra.run.smithi008.stdout: "event": "sub_op_commit_rec", 2023-08-01T19:55:54.877 INFO:teuthology.orchestra.run.smithi008.stdout: "time": "2023-08-01T19:55:05.629279+0000", 2023-08-01T19:55:54.877 INFO:teuthology.orchestra.run.smithi008.stdout: "duration": 0.063124531999999997 2023-08-01T19:55:54.877 INFO:teuthology.orchestra.run.smithi008.stdout: }, 2023-08-01T19:55:54.877 INFO:teuthology.orchestra.run.smithi008.stdout: { 2023-08-01T19:55:54.877 INFO:teuthology.orchestra.run.smithi008.stdout: "event": "op_commit", 2023-08-01T19:55:54.878 INFO:teuthology.orchestra.run.smithi008.stdout: "time": "2023-08-01T19:55:05.629333+0000", 2023-08-01T19:55:54.878 INFO:teuthology.orchestra.run.smithi008.stdout: "duration": 5.4694999999999997e-05 2023-08-01T19:55:54.878 INFO:teuthology.orchestra.run.smithi008.stdout: }, 2023-08-01T19:55:54.878 INFO:teuthology.orchestra.run.smithi008.stdout: { 2023-08-01T19:55:54.878 INFO:teuthology.orchestra.run.smithi008.stdout: "event": "commit_sent", 2023-08-01T19:55:54.878 INFO:teuthology.orchestra.run.smithi008.stdout: "time": "2023-08-01T19:55:05.629390+0000", 2023-08-01T19:55:54.878 INFO:teuthology.orchestra.run.smithi008.stdout: "duration": 5.6416000000000003e-05 2023-08-01T19:55:54.878 INFO:teuthology.orchestra.run.smithi008.stdout: }, 2023-08-01T19:55:54.879 INFO:teuthology.orchestra.run.smithi008.stdout: { 2023-08-01T19:55:54.879 INFO:teuthology.orchestra.run.smithi008.stdout: "event": "done", 2023-08-01T19:55:54.879 INFO:teuthology.orchestra.run.smithi008.stdout: "time": "2023-08-01T19:55:05.629435+0000", 2023-08-01T19:55:54.879 INFO:teuthology.orchestra.run.smithi008.stdout: "duration": 4.5170999999999998e-05 2023-08-01T19:55:54.879 INFO:teuthology.orchestra.run.smithi008.stdout: } 2023-08-01T19:55:54.879 INFO:teuthology.orchestra.run.smithi008.stdout: ] 2023-08-01T19:55:54.879 INFO:teuthology.orchestra.run.smithi008.stdout: } 2023-08-01T19:55:54.879 INFO:teuthology.orchestra.run.smithi008.stdout: }, 2023-08-01T19:55:54.880 INFO:teuthology.orchestra.run.smithi008.stdout: { 2023-08-01T19:55:54.880 INFO:teuthology.orchestra.run.smithi008.stdout: "description": "osd_op(client.4668.0:100933 5.5 5:af92e9f2:::benchmark_data_smithi006_114134_object100932:head [set-alloc-hint object_size 65536 write_size 65536,write 0~65536] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e37)", 2023-08-01T19:55:54.880 INFO:teuthology.orchestra.run.smithi008.stdout: "initiated_at": "2023-08-01T19:55:05.566634+0000", 2023-08-01T19:55:54.880 INFO:teuthology.orchestra.run.smithi008.stdout: "age": 49.231427038, 2023-08-01T19:55:54.880 INFO:teuthology.orchestra.run.smithi008.stdout: "duration": 0.065909364999999998, 2023-08-01T19:55:54.880 INFO:teuthology.orchestra.run.smithi008.stdout: "type_data": { 2023-08-01T19:55:54.880 INFO:teuthology.orchestra.run.smithi008.stdout: "flag_point": "commit sent; apply or cleanup", 2023-08-01T19:55:54.880 INFO:teuthology.orchestra.run.smithi008.stdout: "client_info": { 2023-08-01T19:55:54.881 INFO:teuthology.orchestra.run.smithi008.stdout: "client": "client.4668", 2023-08-01T19:55:54.881 INFO:teuthology.orchestra.run.smithi008.stdout: "client_addr": "172.21.15.6:0/1709472247", 2023-08-01T19:55:54.881 INFO:teuthology.orchestra.run.smithi008.stdout: "tid": 100933 2023-08-01T19:55:54.881 INFO:teuthology.orchestra.run.smithi008.stdout: }, 2023-08-01T19:55:54.881 INFO:teuthology.orchestra.run.smithi008.stdout: "events": [ 2023-08-01T19:55:54.881 INFO:teuthology.orchestra.run.smithi008.stdout: { 2023-08-01T19:55:54.881 INFO:teuthology.orchestra.run.smithi008.stdout: "event": "initiated", 2023-08-01T19:55:54.882 INFO:teuthology.orchestra.run.smithi008.stdout: "time": "2023-08-01T19:55:05.566634+0000", 2023-08-01T19:55:54.882 INFO:teuthology.orchestra.run.smithi008.stdout: "duration": 0 2023-08-01T19:55:54.882 INFO:teuthology.orchestra.run.smithi008.stdout: }, 2023-08-01T19:55:54.882 INFO:teuthology.orchestra.run.smithi008.stdout: { 2023-08-01T19:55:54.882 INFO:teuthology.orchestra.run.smithi008.stdout: "event": "throttled", 2023-08-01T19:55:54.882 INFO:teuthology.orchestra.run.smithi008.stdout: "time": "2023-08-01T19:55:05.566634+0000", 2023-08-01T19:55:54.882 INFO:teuthology.orchestra.run.smithi008.stdout: "duration": 0 2023-08-01T19:55:54.882 INFO:teuthology.orchestra.run.smithi008.stdout: }, 2023-08-01T19:55:54.883 INFO:teuthology.orchestra.run.smithi008.stdout: { 2023-08-01T19:55:54.883 INFO:teuthology.orchestra.run.smithi008.stdout: "event": "header_read", 2023-08-01T19:55:54.883 INFO:teuthology.orchestra.run.smithi008.stdout: "time": "2023-08-01T19:55:05.566630+0000", 2023-08-01T19:55:54.883 INFO:teuthology.orchestra.run.smithi008.stdout: "duration": 4294967295.9999962 2023-08-01T19:55:54.883 INFO:teuthology.orchestra.run.smithi008.stdout: }, 2023-08-01T19:55:54.883 INFO:teuthology.orchestra.run.smithi008.stdout: { 2023-08-01T19:55:54.883 INFO:teuthology.orchestra.run.smithi008.stdout: "event": "all_read", 2023-08-01T19:55:54.883 INFO:teuthology.orchestra.run.smithi008.stdout: "time": "2023-08-01T19:55:05.566736+0000", 2023-08-01T19:55:54.884 INFO:teuthology.orchestra.run.smithi008.stdout: "duration": 0.000105752 2023-08-01T19:55:54.884 INFO:teuthology.orchestra.run.smithi008.stdout: }, 2023-08-01T19:55:54.884 INFO:teuthology.orchestra.run.smithi008.stdout: { 2023-08-01T19:55:54.884 INFO:teuthology.orchestra.run.smithi008.stdout: "event": "dispatched", 2023-08-01T19:55:54.884 INFO:teuthology.orchestra.run.smithi008.stdout: "time": "2023-08-01T19:55:05.566742+0000", 2023-08-01T19:55:54.884 INFO:teuthology.orchestra.run.smithi008.stdout: "duration": 5.8209999999999998e-06 2023-08-01T19:55:54.884 INFO:teuthology.orchestra.run.smithi008.stdout: }, 2023-08-01T19:55:54.884 INFO:teuthology.orchestra.run.smithi008.stdout: { 2023-08-01T19:55:54.885 INFO:teuthology.orchestra.run.smithi008.stdout: "event": "queued_for_pg", 2023-08-01T19:55:54.885 INFO:teuthology.orchestra.run.smithi008.stdout: "time": "2023-08-01T19:55:05.566745+0000", 2023-08-01T19:55:54.885 INFO:teuthology.orchestra.run.smithi008.stdout: "duration": 3.337e-06 2023-08-01T19:55:54.885 INFO:teuthology.orchestra.run.smithi008.stdout: }, 2023-08-01T19:55:54.885 INFO:teuthology.orchestra.run.smithi008.stdout: { 2023-08-01T19:55:54.885 INFO:teuthology.orchestra.run.smithi008.stdout: "event": "reached_pg", 2023-08-01T19:55:54.885 INFO:teuthology.orchestra.run.smithi008.stdout: "time": "2023-08-01T19:55:05.568175+0000", 2023-08-01T19:55:54.885 INFO:teuthology.orchestra.run.smithi008.stdout: "duration": 0.001429647 2023-08-01T19:55:54.886 INFO:teuthology.orchestra.run.smithi008.stdout: }, 2023-08-01T19:55:54.886 INFO:teuthology.orchestra.run.smithi008.stdout: { 2023-08-01T19:55:54.886 INFO:teuthology.orchestra.run.smithi008.stdout: "event": "started", 2023-08-01T19:55:54.886 INFO:teuthology.orchestra.run.smithi008.stdout: "time": "2023-08-01T19:55:05.568288+0000", 2023-08-01T19:55:54.886 INFO:teuthology.orchestra.run.smithi008.stdout: "duration": 0.000113353 2023-08-01T19:55:54.886 INFO:teuthology.orchestra.run.smithi008.stdout: }, 2023-08-01T19:55:54.886 INFO:teuthology.orchestra.run.smithi008.stdout: { 2023-08-01T19:55:54.886 INFO:teuthology.orchestra.run.smithi008.stdout: "event": "waiting for subops from 1", 2023-08-01T19:55:54.887 INFO:teuthology.orchestra.run.smithi008.stdout: "time": "2023-08-01T19:55:05.568425+0000", 2023-08-01T19:55:54.887 INFO:teuthology.orchestra.run.smithi008.stdout: "duration": 0.000137346 2023-08-01T19:55:54.887 INFO:teuthology.orchestra.run.smithi008.stdout: }, 2023-08-01T19:55:54.887 INFO:teuthology.orchestra.run.smithi008.stdout: { 2023-08-01T19:55:54.887 INFO:teuthology.orchestra.run.smithi008.stdout: "event": "sub_op_commit_rec", 2023-08-01T19:55:54.887 INFO:teuthology.orchestra.run.smithi008.stdout: "time": "2023-08-01T19:55:05.629320+0000", 2023-08-01T19:55:54.887 INFO:teuthology.orchestra.run.smithi008.stdout: "duration": 0.060894491000000002 2023-08-01T19:55:54.888 INFO:teuthology.orchestra.run.smithi008.stdout: }, 2023-08-01T19:55:54.888 INFO:teuthology.orchestra.run.smithi008.stdout: { 2023-08-01T19:55:54.888 INFO:teuthology.orchestra.run.smithi008.stdout: "event": "op_commit", 2023-08-01T19:55:54.888 INFO:teuthology.orchestra.run.smithi008.stdout: "time": "2023-08-01T19:55:05.632452+0000", 2023-08-01T19:55:54.888 INFO:teuthology.orchestra.run.smithi008.stdout: "duration": 0.003131909 2023-08-01T19:55:54.888 INFO:teuthology.orchestra.run.smithi008.stdout: }, 2023-08-01T19:55:54.888 INFO:teuthology.orchestra.run.smithi008.stdout: { 2023-08-01T19:55:54.888 INFO:teuthology.orchestra.run.smithi008.stdout: "event": "commit_sent", 2023-08-01T19:55:54.889 INFO:teuthology.orchestra.run.smithi008.stdout: "time": "2023-08-01T19:55:05.632503+0000", 2023-08-01T19:55:54.889 INFO:teuthology.orchestra.run.smithi008.stdout: "duration": 5.1295000000000003e-05 2023-08-01T19:55:54.889 INFO:teuthology.orchestra.run.smithi008.stdout: }, 2023-08-01T19:55:54.889 INFO:teuthology.orchestra.run.smithi008.stdout: { 2023-08-01T19:55:54.889 INFO:teuthology.orchestra.run.smithi008.stdout: "event": "done", 2023-08-01T19:55:54.889 INFO:teuthology.orchestra.run.smithi008.stdout: "time": "2023-08-01T19:55:05.632543+0000", 2023-08-01T19:55:54.889 INFO:teuthology.orchestra.run.smithi008.stdout: "duration": 4.0234000000000001e-05 2023-08-01T19:55:54.889 INFO:teuthology.orchestra.run.smithi008.stdout: } 2023-08-01T19:55:54.890 INFO:teuthology.orchestra.run.smithi008.stdout: ] 2023-08-01T19:55:54.890 INFO:teuthology.orchestra.run.smithi008.stdout: } 2023-08-01T19:55:54.890 INFO:teuthology.orchestra.run.smithi008.stdout: }, 2023-08-01T19:55:54.890 INFO:teuthology.orchestra.run.smithi008.stdout: { 2023-08-01T19:55:54.890 INFO:teuthology.orchestra.run.smithi008.stdout: "description": "osd_repop(client.4668.0:100935 5.e e37/19 5:7895b14e:::benchmark_data_smithi006_114134_object100934:head v 37'6305, mlcod=37'6303)", 2023-08-01T19:55:54.890 INFO:teuthology.orchestra.run.smithi008.stdout: "initiated_at": "2023-08-01T19:55:05.567118+0000", 2023-08-01T19:55:54.890 INFO:teuthology.orchestra.run.smithi008.stdout: "age": 49.230942794999997, 2023-08-01T19:55:54.890 INFO:teuthology.orchestra.run.smithi008.stdout: "duration": 0.063691180999999999, 2023-08-01T19:55:54.891 INFO:teuthology.orchestra.run.smithi008.stdout: "type_data": { 2023-08-01T19:55:54.891 INFO:teuthology.orchestra.run.smithi008.stdout: "flag_point": "commit sent; apply or cleanup", 2023-08-01T19:55:54.891 INFO:teuthology.orchestra.run.smithi008.stdout: "events": [ 2023-08-01T19:55:54.891 INFO:teuthology.orchestra.run.smithi008.stdout: { 2023-08-01T19:55:54.891 INFO:teuthology.orchestra.run.smithi008.stdout: "event": "initiated", 2023-08-01T19:55:54.891 INFO:teuthology.orchestra.run.smithi008.stdout: "time": "2023-08-01T19:55:05.567118+0000", 2023-08-01T19:55:54.891 INFO:teuthology.orchestra.run.smithi008.stdout: "duration": 0 2023-08-01T19:55:54.891 INFO:teuthology.orchestra.run.smithi008.stdout: }, 2023-08-01T19:55:54.892 INFO:teuthology.orchestra.run.smithi008.stdout: { 2023-08-01T19:55:54.892 INFO:teuthology.orchestra.run.smithi008.stdout: "event": "throttled", 2023-08-01T19:55:54.892 INFO:teuthology.orchestra.run.smithi008.stdout: "time": "2023-08-01T19:55:05.567118+0000", 2023-08-01T19:55:54.892 INFO:teuthology.orchestra.run.smithi008.stdout: "duration": 0 2023-08-01T19:55:54.892 INFO:teuthology.orchestra.run.smithi008.stdout: }, 2023-08-01T19:55:54.892 INFO:teuthology.orchestra.run.smithi008.stdout: { 2023-08-01T19:55:54.892 INFO:teuthology.orchestra.run.smithi008.stdout: "event": "header_read", 2023-08-01T19:55:54.893 INFO:teuthology.orchestra.run.smithi008.stdout: "time": "2023-08-01T19:55:05.567117+0000", 2023-08-01T19:55:54.893 INFO:teuthology.orchestra.run.smithi008.stdout: "duration": 4294967295.999999 2023-08-01T19:55:54.893 INFO:teuthology.orchestra.run.smithi008.stdout: }, 2023-08-01T19:55:54.893 INFO:teuthology.orchestra.run.smithi008.stdout: { 2023-08-01T19:55:54.893 INFO:teuthology.orchestra.run.smithi008.stdout: "event": "all_read", 2023-08-01T19:55:54.893 INFO:teuthology.orchestra.run.smithi008.stdout: "time": "2023-08-01T19:55:05.567168+0000", 2023-08-01T19:55:54.893 INFO:teuthology.orchestra.run.smithi008.stdout: "duration": 5.0353999999999999e-05 2023-08-01T19:55:54.893 INFO:teuthology.orchestra.run.smithi008.stdout: }, 2023-08-01T19:55:54.894 INFO:teuthology.orchestra.run.smithi008.stdout: { 2023-08-01T19:55:54.894 INFO:teuthology.orchestra.run.smithi008.stdout: "event": "dispatched", 2023-08-01T19:55:54.894 INFO:teuthology.orchestra.run.smithi008.stdout: "time": "2023-08-01T19:55:05.567175+0000", 2023-08-01T19:55:54.894 INFO:teuthology.orchestra.run.smithi008.stdout: "duration": 7.3919999999999997e-06 2023-08-01T19:55:54.894 INFO:teuthology.orchestra.run.smithi008.stdout: }, 2023-08-01T19:55:54.894 INFO:teuthology.orchestra.run.smithi008.stdout: { 2023-08-01T19:55:54.894 INFO:teuthology.orchestra.run.smithi008.stdout: "event": "queued_for_pg", 2023-08-01T19:55:54.894 INFO:teuthology.orchestra.run.smithi008.stdout: "time": "2023-08-01T19:55:05.567180+0000", 2023-08-01T19:55:54.895 INFO:teuthology.orchestra.run.smithi008.stdout: "duration": 5.3090000000000003e-06 2023-08-01T19:55:54.895 INFO:teuthology.orchestra.run.smithi008.stdout: }, 2023-08-01T19:55:54.895 INFO:teuthology.orchestra.run.smithi008.stdout: { 2023-08-01T19:55:54.895 INFO:teuthology.orchestra.run.smithi008.stdout: "event": "reached_pg", 2023-08-01T19:55:54.895 INFO:teuthology.orchestra.run.smithi008.stdout: "time": "2023-08-01T19:55:05.567210+0000", 2023-08-01T19:55:54.895 INFO:teuthology.orchestra.run.smithi008.stdout: "duration": 3.0001999999999998e-05 2023-08-01T19:55:54.895 INFO:teuthology.orchestra.run.smithi008.stdout: }, 2023-08-01T19:55:54.895 INFO:teuthology.orchestra.run.smithi008.stdout: { 2023-08-01T19:55:54.896 INFO:teuthology.orchestra.run.smithi008.stdout: "event": "started", 2023-08-01T19:55:54.896 INFO:teuthology.orchestra.run.smithi008.stdout: "time": "2023-08-01T19:55:05.567222+0000", 2023-08-01T19:55:54.896 INFO:teuthology.orchestra.run.smithi008.stdout: "duration": 1.1499e-05 2023-08-01T19:55:54.896 INFO:teuthology.orchestra.run.smithi008.stdout: }, 2023-08-01T19:55:54.896 INFO:teuthology.orchestra.run.smithi008.stdout: { 2023-08-01T19:55:54.896 INFO:teuthology.orchestra.run.smithi008.stdout: "event": "commit_sent", 2023-08-01T19:55:54.896 INFO:teuthology.orchestra.run.smithi008.stdout: "time": "2023-08-01T19:55:05.630772+0000", 2023-08-01T19:55:54.896 INFO:teuthology.orchestra.run.smithi008.stdout: "duration": 0.063550572999999999 2023-08-01T19:55:54.897 INFO:teuthology.orchestra.run.smithi008.stdout: }, 2023-08-01T19:55:54.897 INFO:teuthology.orchestra.run.smithi008.stdout: { 2023-08-01T19:55:54.897 INFO:teuthology.orchestra.run.smithi008.stdout: "event": "done", 2023-08-01T19:55:54.897 INFO:teuthology.orchestra.run.smithi008.stdout: "time": "2023-08-01T19:55:05.630809+0000", 2023-08-01T19:55:54.897 INFO:teuthology.orchestra.run.smithi008.stdout: "duration": 3.7033000000000003e-05 2023-08-01T19:55:54.897 INFO:teuthology.orchestra.run.smithi008.stdout: } 2023-08-01T19:55:54.897 INFO:teuthology.orchestra.run.smithi008.stdout: ] 2023-08-01T19:55:54.897 INFO:teuthology.orchestra.run.smithi008.stdout: } 2023-08-01T19:55:54.898 INFO:teuthology.orchestra.run.smithi008.stdout: }, 2023-08-01T19:55:54.898 INFO:teuthology.orchestra.run.smithi008.stdout: { 2023-08-01T19:55:54.898 INFO:teuthology.orchestra.run.smithi008.stdout: "description": "osd_repop(client.4668.0:100936 5.1 e37/19 5:8f4e3576:::benchmark_data_smithi006_114134_object100935:head v 37'6263, mlcod=37'6261)", 2023-08-01T19:55:54.898 INFO:teuthology.orchestra.run.smithi008.stdout: "initiated_at": "2023-08-01T19:55:05.567617+0000", 2023-08-01T19:55:54.898 INFO:teuthology.orchestra.run.smithi008.stdout: "age": 49.230443532000002, 2023-08-01T19:55:54.898 INFO:teuthology.orchestra.run.smithi008.stdout: "duration": 0.062773918999999997, 2023-08-01T19:55:54.898 INFO:teuthology.orchestra.run.smithi008.stdout: "type_data": { 2023-08-01T19:55:54.899 INFO:teuthology.orchestra.run.smithi008.stdout: "flag_point": "commit sent; apply or cleanup", 2023-08-01T19:55:54.899 INFO:teuthology.orchestra.run.smithi008.stdout: "events": [ 2023-08-01T19:55:54.899 INFO:teuthology.orchestra.run.smithi008.stdout: { 2023-08-01T19:55:54.899 INFO:teuthology.orchestra.run.smithi008.stdout: "event": "initiated", 2023-08-01T19:55:54.899 INFO:teuthology.orchestra.run.smithi008.stdout: "time": "2023-08-01T19:55:05.567617+0000", 2023-08-01T19:55:54.899 INFO:teuthology.orchestra.run.smithi008.stdout: "duration": 0 2023-08-01T19:55:54.899 INFO:teuthology.orchestra.run.smithi008.stdout: }, 2023-08-01T19:55:54.899 INFO:teuthology.orchestra.run.smithi008.stdout: { 2023-08-01T19:55:54.900 INFO:teuthology.orchestra.run.smithi008.stdout: "event": "throttled", 2023-08-01T19:55:54.900 INFO:teuthology.orchestra.run.smithi008.stdout: "time": "2023-08-01T19:55:05.567617+0000", 2023-08-01T19:55:54.900 INFO:teuthology.orchestra.run.smithi008.stdout: "duration": 0 2023-08-01T19:55:54.900 INFO:teuthology.orchestra.run.smithi008.stdout: }, 2023-08-01T19:55:54.900 INFO:teuthology.orchestra.run.smithi008.stdout: { 2023-08-01T19:55:54.900 INFO:teuthology.orchestra.run.smithi008.stdout: "event": "header_read", 2023-08-01T19:55:54.900 INFO:teuthology.orchestra.run.smithi008.stdout: "time": "2023-08-01T19:55:05.567617+0000", 2023-08-01T19:55:54.900 INFO:teuthology.orchestra.run.smithi008.stdout: "duration": 4294967295.9999995 2023-08-01T19:55:54.901 INFO:teuthology.orchestra.run.smithi008.stdout: }, 2023-08-01T19:55:54.901 INFO:teuthology.orchestra.run.smithi008.stdout: { 2023-08-01T19:55:54.901 INFO:teuthology.orchestra.run.smithi008.stdout: "event": "all_read", 2023-08-01T19:55:54.901 INFO:teuthology.orchestra.run.smithi008.stdout: "time": "2023-08-01T19:55:05.567700+0000", 2023-08-01T19:55:54.901 INFO:teuthology.orchestra.run.smithi008.stdout: "duration": 8.3363999999999997e-05 2023-08-01T19:55:54.901 INFO:teuthology.orchestra.run.smithi008.stdout: }, 2023-08-01T19:55:54.901 INFO:teuthology.orchestra.run.smithi008.stdout: { 2023-08-01T19:55:54.901 INFO:teuthology.orchestra.run.smithi008.stdout: "event": "dispatched", 2023-08-01T19:55:54.902 INFO:teuthology.orchestra.run.smithi008.stdout: "time": "2023-08-01T19:55:05.567706+0000", 2023-08-01T19:55:54.902 INFO:teuthology.orchestra.run.smithi008.stdout: "duration": 5.9739999999999999e-06 2023-08-01T19:55:54.902 INFO:teuthology.orchestra.run.smithi008.stdout: }, 2023-08-01T19:55:54.902 INFO:teuthology.orchestra.run.smithi008.stdout: { 2023-08-01T19:55:54.902 INFO:teuthology.orchestra.run.smithi008.stdout: "event": "queued_for_pg", 2023-08-01T19:55:54.902 INFO:teuthology.orchestra.run.smithi008.stdout: "time": "2023-08-01T19:55:05.567709+0000", 2023-08-01T19:55:54.902 INFO:teuthology.orchestra.run.smithi008.stdout: "duration": 3.1420000000000002e-06 2023-08-01T19:55:54.902 INFO:teuthology.orchestra.run.smithi008.stdout: }, 2023-08-01T19:55:54.903 INFO:teuthology.orchestra.run.smithi008.stdout: { 2023-08-01T19:55:54.903 INFO:teuthology.orchestra.run.smithi008.stdout: "event": "reached_pg", 2023-08-01T19:55:54.903 INFO:teuthology.orchestra.run.smithi008.stdout: "time": "2023-08-01T19:55:05.567741+0000", 2023-08-01T19:55:54.903 INFO:teuthology.orchestra.run.smithi008.stdout: "duration": 3.1532999999999998e-05 2023-08-01T19:55:54.903 INFO:teuthology.orchestra.run.smithi008.stdout: }, 2023-08-01T19:55:54.903 INFO:teuthology.orchestra.run.smithi008.stdout: { 2023-08-01T19:55:54.903 INFO:teuthology.orchestra.run.smithi008.stdout: "event": "started", 2023-08-01T19:55:54.903 INFO:teuthology.orchestra.run.smithi008.stdout: "time": "2023-08-01T19:55:05.567752+0000", 2023-08-01T19:55:54.904 INFO:teuthology.orchestra.run.smithi008.stdout: "duration": 1.1266e-05 2023-08-01T19:55:54.904 INFO:teuthology.orchestra.run.smithi008.stdout: }, 2023-08-01T19:55:54.904 INFO:teuthology.orchestra.run.smithi008.stdout: { 2023-08-01T19:55:54.904 INFO:teuthology.orchestra.run.smithi008.stdout: "event": "commit_sent", 2023-08-01T19:55:54.904 INFO:teuthology.orchestra.run.smithi008.stdout: "time": "2023-08-01T19:55:05.630357+0000", 2023-08-01T19:55:54.904 INFO:teuthology.orchestra.run.smithi008.stdout: "duration": 0.062604554000000007 2023-08-01T19:55:54.904 INFO:teuthology.orchestra.run.smithi008.stdout: }, 2023-08-01T19:55:54.905 INFO:teuthology.orchestra.run.smithi008.stdout: { 2023-08-01T19:55:54.905 INFO:teuthology.orchestra.run.smithi008.stdout: "event": "done", 2023-08-01T19:55:54.905 INFO:teuthology.orchestra.run.smithi008.stdout: "time": "2023-08-01T19:55:05.630391+0000", 2023-08-01T19:55:54.905 INFO:teuthology.orchestra.run.smithi008.stdout: "duration": 3.4619000000000002e-05 2023-08-01T19:55:54.905 INFO:teuthology.orchestra.run.smithi008.stdout: } 2023-08-01T19:55:54.905 INFO:teuthology.orchestra.run.smithi008.stdout: ] 2023-08-01T19:55:54.905 INFO:teuthology.orchestra.run.smithi008.stdout: } 2023-08-01T19:55:54.905 INFO:teuthology.orchestra.run.smithi008.stdout: }, 2023-08-01T19:55:54.906 INFO:teuthology.orchestra.run.smithi008.stdout: { 2023-08-01T19:55:54.906 INFO:teuthology.orchestra.run.smithi008.stdout: "description": "osd_op(client.4668.0:100937 5.c 5:34445fc3:::benchmark_data_smithi006_114134_object100936:head [set-alloc-hint object_size 65536 write_size 65536,write 0~65536] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e37)", 2023-08-01T19:55:54.906 INFO:teuthology.orchestra.run.smithi008.stdout: "initiated_at": "2023-08-01T19:55:05.569198+0000", 2023-08-01T19:55:54.906 INFO:teuthology.orchestra.run.smithi008.stdout: "age": 49.228862909, 2023-08-01T19:55:54.906 INFO:teuthology.orchestra.run.smithi008.stdout: "duration": 0.063349390000000005, 2023-08-01T19:55:54.906 INFO:teuthology.orchestra.run.smithi008.stdout: "type_data": { 2023-08-01T19:55:54.906 INFO:teuthology.orchestra.run.smithi008.stdout: "flag_point": "commit sent; apply or cleanup", 2023-08-01T19:55:54.906 INFO:teuthology.orchestra.run.smithi008.stdout: "client_info": { 2023-08-01T19:55:54.907 INFO:teuthology.orchestra.run.smithi008.stdout: "client": "client.4668", 2023-08-01T19:55:54.907 INFO:teuthology.orchestra.run.smithi008.stdout: "client_addr": "172.21.15.6:0/1709472247", 2023-08-01T19:55:54.907 INFO:teuthology.orchestra.run.smithi008.stdout: "tid": 100937 2023-08-01T19:55:54.907 INFO:teuthology.orchestra.run.smithi008.stdout: }, 2023-08-01T19:55:54.907 INFO:teuthology.orchestra.run.smithi008.stdout: "events": [ 2023-08-01T19:55:54.907 INFO:teuthology.orchestra.run.smithi008.stdout: { 2023-08-01T19:55:54.907 INFO:teuthology.orchestra.run.smithi008.stdout: "event": "initiated", 2023-08-01T19:55:54.907 INFO:teuthology.orchestra.run.smithi008.stdout: "time": "2023-08-01T19:55:05.569198+0000", 2023-08-01T19:55:54.908 INFO:teuthology.orchestra.run.smithi008.stdout: "duration": 0 2023-08-01T19:55:54.908 INFO:teuthology.orchestra.run.smithi008.stdout: }, 2023-08-01T19:55:54.908 INFO:teuthology.orchestra.run.smithi008.stdout: { 2023-08-01T19:55:54.908 INFO:teuthology.orchestra.run.smithi008.stdout: "event": "throttled", 2023-08-01T19:55:54.908 INFO:teuthology.orchestra.run.smithi008.stdout: "time": "2023-08-01T19:55:05.569198+0000", 2023-08-01T19:55:54.908 INFO:teuthology.orchestra.run.smithi008.stdout: "duration": 0 2023-08-01T19:55:54.908 INFO:teuthology.orchestra.run.smithi008.stdout: }, 2023-08-01T19:55:54.908 INFO:teuthology.orchestra.run.smithi008.stdout: { 2023-08-01T19:55:54.909 INFO:teuthology.orchestra.run.smithi008.stdout: "event": "header_read", 2023-08-01T19:55:54.909 INFO:teuthology.orchestra.run.smithi008.stdout: "time": "2023-08-01T19:55:05.569197+0000", 2023-08-01T19:55:54.909 INFO:teuthology.orchestra.run.smithi008.stdout: "duration": 4294967295.999999 2023-08-01T19:55:54.909 INFO:teuthology.orchestra.run.smithi008.stdout: }, 2023-08-01T19:55:54.909 INFO:teuthology.orchestra.run.smithi008.stdout: { 2023-08-01T19:55:54.909 INFO:teuthology.orchestra.run.smithi008.stdout: "event": "all_read", 2023-08-01T19:55:54.909 INFO:teuthology.orchestra.run.smithi008.stdout: "time": "2023-08-01T19:55:05.569250+0000", 2023-08-01T19:55:54.909 INFO:teuthology.orchestra.run.smithi008.stdout: "duration": 5.3106000000000003e-05 2023-08-01T19:55:54.910 INFO:teuthology.orchestra.run.smithi008.stdout: }, 2023-08-01T19:55:54.910 INFO:teuthology.orchestra.run.smithi008.stdout: { 2023-08-01T19:55:54.910 INFO:teuthology.orchestra.run.smithi008.stdout: "event": "dispatched", 2023-08-01T19:55:54.910 INFO:teuthology.orchestra.run.smithi008.stdout: "time": "2023-08-01T19:55:05.569260+0000", 2023-08-01T19:55:54.910 INFO:teuthology.orchestra.run.smithi008.stdout: "duration": 9.533e-06 2023-08-01T19:55:54.910 INFO:teuthology.orchestra.run.smithi008.stdout: }, 2023-08-01T19:55:54.910 INFO:teuthology.orchestra.run.smithi008.stdout: { 2023-08-01T19:55:54.911 INFO:teuthology.orchestra.run.smithi008.stdout: "event": "queued_for_pg", 2023-08-01T19:55:54.911 INFO:teuthology.orchestra.run.smithi008.stdout: "time": "2023-08-01T19:55:05.569264+0000", 2023-08-01T19:55:54.911 INFO:teuthology.orchestra.run.smithi008.stdout: "duration": 4.6099999999999999e-06 2023-08-01T19:55:54.911 INFO:teuthology.orchestra.run.smithi008.stdout: }, 2023-08-01T19:55:54.911 INFO:teuthology.orchestra.run.smithi008.stdout: { 2023-08-01T19:55:54.911 INFO:teuthology.orchestra.run.smithi008.stdout: "event": "reached_pg", 2023-08-01T19:55:54.911 INFO:teuthology.orchestra.run.smithi008.stdout: "time": "2023-08-01T19:55:05.569293+0000", 2023-08-01T19:55:54.911 INFO:teuthology.orchestra.run.smithi008.stdout: "duration": 2.8181999999999999e-05 2023-08-01T19:55:54.912 INFO:teuthology.orchestra.run.smithi008.stdout: }, 2023-08-01T19:55:54.912 INFO:teuthology.orchestra.run.smithi008.stdout: { 2023-08-01T19:55:54.912 INFO:teuthology.orchestra.run.smithi008.stdout: "event": "started", 2023-08-01T19:55:54.912 INFO:teuthology.orchestra.run.smithi008.stdout: "time": "2023-08-01T19:55:05.569401+0000", 2023-08-01T19:55:54.912 INFO:teuthology.orchestra.run.smithi008.stdout: "duration": 0.000108065 2023-08-01T19:55:54.912 INFO:teuthology.orchestra.run.smithi008.stdout: }, 2023-08-01T19:55:54.912 INFO:teuthology.orchestra.run.smithi008.stdout: { 2023-08-01T19:55:54.912 INFO:teuthology.orchestra.run.smithi008.stdout: "event": "waiting for subops from 1", 2023-08-01T19:55:54.913 INFO:teuthology.orchestra.run.smithi008.stdout: "time": "2023-08-01T19:55:05.569521+0000", 2023-08-01T19:55:54.913 INFO:teuthology.orchestra.run.smithi008.stdout: "duration": 0.00012006900000000001 2023-08-01T19:55:54.913 INFO:teuthology.orchestra.run.smithi008.stdout: }, 2023-08-01T19:55:54.913 INFO:teuthology.orchestra.run.smithi008.stdout: { 2023-08-01T19:55:54.913 INFO:teuthology.orchestra.run.smithi008.stdout: "event": "sub_op_commit_rec", 2023-08-01T19:55:54.913 INFO:teuthology.orchestra.run.smithi008.stdout: "time": "2023-08-01T19:55:05.629421+0000", 2023-08-01T19:55:54.913 INFO:teuthology.orchestra.run.smithi008.stdout: "duration": 0.059900525000000003 2023-08-01T19:55:54.913 INFO:teuthology.orchestra.run.smithi008.stdout: }, 2023-08-01T19:55:54.914 INFO:teuthology.orchestra.run.smithi008.stdout: { 2023-08-01T19:55:54.914 INFO:teuthology.orchestra.run.smithi008.stdout: "event": "op_commit", 2023-08-01T19:55:54.914 INFO:teuthology.orchestra.run.smithi008.stdout: "time": "2023-08-01T19:55:05.632461+0000", 2023-08-01T19:55:54.914 INFO:teuthology.orchestra.run.smithi008.stdout: "duration": 0.0030401220000000001 2023-08-01T19:55:54.914 INFO:teuthology.orchestra.run.smithi008.stdout: }, 2023-08-01T19:55:54.914 INFO:teuthology.orchestra.run.smithi008.stdout: { 2023-08-01T19:55:54.914 INFO:teuthology.orchestra.run.smithi008.stdout: "event": "commit_sent", 2023-08-01T19:55:54.914 INFO:teuthology.orchestra.run.smithi008.stdout: "time": "2023-08-01T19:55:05.632507+0000", 2023-08-01T19:55:54.915 INFO:teuthology.orchestra.run.smithi008.stdout: "duration": 4.5361999999999997e-05 2023-08-01T19:55:54.915 INFO:teuthology.orchestra.run.smithi008.stdout: }, 2023-08-01T19:55:54.915 INFO:teuthology.orchestra.run.smithi008.stdout: { 2023-08-01T19:55:54.915 INFO:teuthology.orchestra.run.smithi008.stdout: "event": "done", 2023-08-01T19:55:54.915 INFO:teuthology.orchestra.run.smithi008.stdout: "time": "2023-08-01T19:55:05.632547+0000", 2023-08-01T19:55:54.915 INFO:teuthology.orchestra.run.smithi008.stdout: "duration": 4.0760999999999998e-05 2023-08-01T19:55:54.915 INFO:teuthology.orchestra.run.smithi008.stdout: } 2023-08-01T19:55:54.915 INFO:teuthology.orchestra.run.smithi008.stdout: ] 2023-08-01T19:55:54.916 INFO:teuthology.orchestra.run.smithi008.stdout: } 2023-08-01T19:55:54.916 INFO:teuthology.orchestra.run.smithi008.stdout: }, 2023-08-01T19:55:54.916 INFO:teuthology.orchestra.run.smithi008.stdout: { 2023-08-01T19:55:54.916 INFO:teuthology.orchestra.run.smithi008.stdout: "description": "osd_op(client.4668.0:100939 5.5 5:a75fa6e3:::benchmark_data_smithi006_114134_object100938:head [set-alloc-hint object_size 65536 write_size 65536,write 0~65536] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e37)", 2023-08-01T19:55:54.916 INFO:teuthology.orchestra.run.smithi008.stdout: "initiated_at": "2023-08-01T19:55:05.569740+0000", 2023-08-01T19:55:54.916 INFO:teuthology.orchestra.run.smithi008.stdout: "age": 49.228321366999999, 2023-08-01T19:55:54.916 INFO:teuthology.orchestra.run.smithi008.stdout: "duration": 0.067753412999999998, 2023-08-01T19:55:54.917 INFO:teuthology.orchestra.run.smithi008.stdout: "type_data": { 2023-08-01T19:55:54.917 INFO:teuthology.orchestra.run.smithi008.stdout: "flag_point": "commit sent; apply or cleanup", 2023-08-01T19:55:54.917 INFO:teuthology.orchestra.run.smithi008.stdout: "client_info": { 2023-08-01T19:55:54.917 INFO:teuthology.orchestra.run.smithi008.stdout: "client": "client.4668", 2023-08-01T19:55:54.917 INFO:teuthology.orchestra.run.smithi008.stdout: "client_addr": "172.21.15.6:0/1709472247", 2023-08-01T19:55:54.917 INFO:teuthology.orchestra.run.smithi008.stdout: "tid": 100939 2023-08-01T19:55:54.917 INFO:teuthology.orchestra.run.smithi008.stdout: }, 2023-08-01T19:55:54.917 INFO:teuthology.orchestra.run.smithi008.stdout: "events": [ 2023-08-01T19:55:54.918 INFO:teuthology.orchestra.run.smithi008.stdout: { 2023-08-01T19:55:54.918 INFO:teuthology.orchestra.run.smithi008.stdout: "event": "initiated", 2023-08-01T19:55:54.918 INFO:teuthology.orchestra.run.smithi008.stdout: "time": "2023-08-01T19:55:05.569740+0000", 2023-08-01T19:55:54.918 INFO:teuthology.orchestra.run.smithi008.stdout: "duration": 0 2023-08-01T19:55:54.918 INFO:teuthology.orchestra.run.smithi008.stdout: }, 2023-08-01T19:55:54.918 INFO:teuthology.orchestra.run.smithi008.stdout: { 2023-08-01T19:55:54.918 INFO:teuthology.orchestra.run.smithi008.stdout: "event": "throttled", 2023-08-01T19:55:54.918 INFO:teuthology.orchestra.run.smithi008.stdout: "time": "2023-08-01T19:55:05.569740+0000", 2023-08-01T19:55:54.919 INFO:teuthology.orchestra.run.smithi008.stdout: "duration": 0 2023-08-01T19:55:54.919 INFO:teuthology.orchestra.run.smithi008.stdout: }, 2023-08-01T19:55:54.919 INFO:teuthology.orchestra.run.smithi008.stdout: { 2023-08-01T19:55:54.919 INFO:teuthology.orchestra.run.smithi008.stdout: "event": "header_read", 2023-08-01T19:55:54.919 INFO:teuthology.orchestra.run.smithi008.stdout: "time": "2023-08-01T19:55:05.569739+0000", 2023-08-01T19:55:54.919 INFO:teuthology.orchestra.run.smithi008.stdout: "duration": 4294967295.9999995 2023-08-01T19:55:54.919 INFO:teuthology.orchestra.run.smithi008.stdout: }, 2023-08-01T19:55:54.919 INFO:teuthology.orchestra.run.smithi008.stdout: { 2023-08-01T19:55:54.920 INFO:teuthology.orchestra.run.smithi008.stdout: "event": "all_read", 2023-08-01T19:55:54.920 INFO:teuthology.orchestra.run.smithi008.stdout: "time": "2023-08-01T19:55:05.569839+0000", 2023-08-01T19:55:54.920 INFO:teuthology.orchestra.run.smithi008.stdout: "duration": 0.000100219 2023-08-01T19:55:54.920 INFO:teuthology.orchestra.run.smithi008.stdout: }, 2023-08-01T19:55:54.920 INFO:teuthology.orchestra.run.smithi008.stdout: { 2023-08-01T19:55:54.920 INFO:teuthology.orchestra.run.smithi008.stdout: "event": "dispatched", 2023-08-01T19:55:54.920 INFO:teuthology.orchestra.run.smithi008.stdout: "time": "2023-08-01T19:55:05.569846+0000", 2023-08-01T19:55:54.920 INFO:teuthology.orchestra.run.smithi008.stdout: "duration": 7.3150000000000003e-06 2023-08-01T19:55:54.921 INFO:teuthology.orchestra.run.smithi008.stdout: }, 2023-08-01T19:55:54.921 INFO:teuthology.orchestra.run.smithi008.stdout: { 2023-08-01T19:55:54.921 INFO:teuthology.orchestra.run.smithi008.stdout: "event": "queued_for_pg", 2023-08-01T19:55:54.921 INFO:teuthology.orchestra.run.smithi008.stdout: "time": "2023-08-01T19:55:05.569850+0000", 2023-08-01T19:55:54.921 INFO:teuthology.orchestra.run.smithi008.stdout: "duration": 3.3299999999999999e-06 2023-08-01T19:55:54.921 INFO:teuthology.orchestra.run.smithi008.stdout: }, 2023-08-01T19:55:54.921 INFO:teuthology.orchestra.run.smithi008.stdout: { 2023-08-01T19:55:54.921 INFO:teuthology.orchestra.run.smithi008.stdout: "event": "reached_pg", 2023-08-01T19:55:54.922 INFO:teuthology.orchestra.run.smithi008.stdout: "time": "2023-08-01T19:55:05.626991+0000", 2023-08-01T19:55:54.922 INFO:teuthology.orchestra.run.smithi008.stdout: "duration": 0.057141585000000002 2023-08-01T19:55:54.922 INFO:teuthology.orchestra.run.smithi008.stdout: }, 2023-08-01T19:55:54.922 INFO:teuthology.orchestra.run.smithi008.stdout: { 2023-08-01T19:55:54.922 INFO:teuthology.orchestra.run.smithi008.stdout: "event": "started", 2023-08-01T19:55:54.922 INFO:teuthology.orchestra.run.smithi008.stdout: "time": "2023-08-01T19:55:05.627111+0000", 2023-08-01T19:55:54.922 INFO:teuthology.orchestra.run.smithi008.stdout: "duration": 0.000119238 2023-08-01T19:55:54.922 INFO:teuthology.orchestra.run.smithi008.stdout: }, 2023-08-01T19:55:54.923 INFO:teuthology.orchestra.run.smithi008.stdout: { 2023-08-01T19:55:54.923 INFO:teuthology.orchestra.run.smithi008.stdout: "event": "waiting for subops from 1", 2023-08-01T19:55:54.923 INFO:teuthology.orchestra.run.smithi008.stdout: "time": "2023-08-01T19:55:05.627253+0000", 2023-08-01T19:55:54.923 INFO:teuthology.orchestra.run.smithi008.stdout: "duration": 0.000142822 2023-08-01T19:55:54.923 INFO:teuthology.orchestra.run.smithi008.stdout: }, 2023-08-01T19:55:54.923 INFO:teuthology.orchestra.run.smithi008.stdout: { 2023-08-01T19:55:54.923 INFO:teuthology.orchestra.run.smithi008.stdout: "event": "op_commit", 2023-08-01T19:55:54.924 INFO:teuthology.orchestra.run.smithi008.stdout: "time": "2023-08-01T19:55:05.632555+0000", 2023-08-01T19:55:54.924 INFO:teuthology.orchestra.run.smithi008.stdout: "duration": 0.0053012449999999996 2023-08-01T19:55:54.924 INFO:teuthology.orchestra.run.smithi008.stdout: }, 2023-08-01T19:55:54.924 INFO:teuthology.orchestra.run.smithi008.stdout: { 2023-08-01T19:55:54.924 INFO:teuthology.orchestra.run.smithi008.stdout: "event": "sub_op_commit_rec", 2023-08-01T19:55:54.924 INFO:teuthology.orchestra.run.smithi008.stdout: "time": "2023-08-01T19:55:05.637380+0000", 2023-08-01T19:55:54.924 INFO:teuthology.orchestra.run.smithi008.stdout: "duration": 0.0048257639999999997 2023-08-01T19:55:54.924 INFO:teuthology.orchestra.run.smithi008.stdout: }, 2023-08-01T19:55:54.925 INFO:teuthology.orchestra.run.smithi008.stdout: { 2023-08-01T19:55:54.925 INFO:teuthology.orchestra.run.smithi008.stdout: "event": "commit_sent", 2023-08-01T19:55:54.925 INFO:teuthology.orchestra.run.smithi008.stdout: "time": "2023-08-01T19:55:05.637454+0000", 2023-08-01T19:55:54.925 INFO:teuthology.orchestra.run.smithi008.stdout: "duration": 7.3578999999999995e-05 2023-08-01T19:55:54.925 INFO:teuthology.orchestra.run.smithi008.stdout: }, 2023-08-01T19:55:54.925 INFO:teuthology.orchestra.run.smithi008.stdout: { 2023-08-01T19:55:54.925 INFO:teuthology.orchestra.run.smithi008.stdout: "event": "done", 2023-08-01T19:55:54.925 INFO:teuthology.orchestra.run.smithi008.stdout: "time": "2023-08-01T19:55:05.637493+0000", 2023-08-01T19:55:54.926 INFO:teuthology.orchestra.run.smithi008.stdout: "duration": 3.8986999999999998e-05 2023-08-01T19:55:54.926 INFO:teuthology.orchestra.run.smithi008.stdout: } 2023-08-01T19:55:54.926 INFO:teuthology.orchestra.run.smithi008.stdout: ] 2023-08-01T19:55:54.926 INFO:teuthology.orchestra.run.smithi008.stdout: } 2023-08-01T19:55:54.926 INFO:teuthology.orchestra.run.smithi008.stdout: }, 2023-08-01T19:55:54.926 INFO:teuthology.orchestra.run.smithi008.stdout: { 2023-08-01T19:55:54.926 INFO:teuthology.orchestra.run.smithi008.stdout: "description": "osd_repop(client.4668.0:100941 5.e e37/19 5:736a6ac6:::benchmark_data_smithi006_114134_object100940:head v 37'6306, mlcod=37'6303)", 2023-08-01T19:55:54.926 INFO:teuthology.orchestra.run.smithi008.stdout: "initiated_at": "2023-08-01T19:55:05.570237+0000", 2023-08-01T19:55:54.927 INFO:teuthology.orchestra.run.smithi008.stdout: "age": 49.227824056999999, 2023-08-01T19:55:54.927 INFO:teuthology.orchestra.run.smithi008.stdout: "duration": 0.064830421999999999, 2023-08-01T19:55:54.927 INFO:teuthology.orchestra.run.smithi008.stdout: "type_data": { 2023-08-01T19:55:54.927 INFO:teuthology.orchestra.run.smithi008.stdout: "flag_point": "commit sent; apply or cleanup", 2023-08-01T19:55:54.927 INFO:teuthology.orchestra.run.smithi008.stdout: "events": [ 2023-08-01T19:55:54.927 INFO:teuthology.orchestra.run.smithi008.stdout: { 2023-08-01T19:55:54.927 INFO:teuthology.orchestra.run.smithi008.stdout: "event": "initiated", 2023-08-01T19:55:54.927 INFO:teuthology.orchestra.run.smithi008.stdout: "time": "2023-08-01T19:55:05.570237+0000", 2023-08-01T19:55:54.928 INFO:teuthology.orchestra.run.smithi008.stdout: "duration": 0 2023-08-01T19:55:54.928 INFO:teuthology.orchestra.run.smithi008.stdout: }, 2023-08-01T19:55:54.928 INFO:teuthology.orchestra.run.smithi008.stdout: { 2023-08-01T19:55:54.928 INFO:teuthology.orchestra.run.smithi008.stdout: "event": "throttled", 2023-08-01T19:55:54.928 INFO:teuthology.orchestra.run.smithi008.stdout: "time": "2023-08-01T19:55:05.570237+0000", 2023-08-01T19:55:54.928 INFO:teuthology.orchestra.run.smithi008.stdout: "duration": 0 2023-08-01T19:55:54.928 INFO:teuthology.orchestra.run.smithi008.stdout: }, 2023-08-01T19:55:54.929 INFO:teuthology.orchestra.run.smithi008.stdout: { 2023-08-01T19:55:54.929 INFO:teuthology.orchestra.run.smithi008.stdout: "event": "header_read", 2023-08-01T19:55:54.929 INFO:teuthology.orchestra.run.smithi008.stdout: "time": "2023-08-01T19:55:05.570236+0000", 2023-08-01T19:55:54.929 INFO:teuthology.orchestra.run.smithi008.stdout: "duration": 4294967295.9999995 2023-08-01T19:55:54.929 INFO:teuthology.orchestra.run.smithi008.stdout: }, 2023-08-01T19:55:54.929 INFO:teuthology.orchestra.run.smithi008.stdout: { 2023-08-01T19:55:54.929 INFO:teuthology.orchestra.run.smithi008.stdout: "event": "all_read", 2023-08-01T19:55:54.929 INFO:teuthology.orchestra.run.smithi008.stdout: "time": "2023-08-01T19:55:05.570354+0000", 2023-08-01T19:55:54.930 INFO:teuthology.orchestra.run.smithi008.stdout: "duration": 0.000118029 2023-08-01T19:55:54.930 INFO:teuthology.orchestra.run.smithi008.stdout: }, 2023-08-01T19:55:54.930 INFO:teuthology.orchestra.run.smithi008.stdout: { 2023-08-01T19:55:54.930 INFO:teuthology.orchestra.run.smithi008.stdout: "event": "dispatched", 2023-08-01T19:55:54.930 INFO:teuthology.orchestra.run.smithi008.stdout: "time": "2023-08-01T19:55:05.626649+0000", 2023-08-01T19:55:54.930 INFO:teuthology.orchestra.run.smithi008.stdout: "duration": 0.056294489000000003 2023-08-01T19:55:54.930 INFO:teuthology.orchestra.run.smithi008.stdout: }, 2023-08-01T19:55:54.930 INFO:teuthology.orchestra.run.smithi008.stdout: { 2023-08-01T19:55:54.931 INFO:teuthology.orchestra.run.smithi008.stdout: "event": "queued_for_pg", 2023-08-01T19:55:54.931 INFO:teuthology.orchestra.run.smithi008.stdout: "time": "2023-08-01T19:55:05.626676+0000", 2023-08-01T19:55:54.931 INFO:teuthology.orchestra.run.smithi008.stdout: "duration": 2.7228000000000001e-05 2023-08-01T19:55:54.931 INFO:teuthology.orchestra.run.smithi008.stdout: }, 2023-08-01T19:55:54.931 INFO:teuthology.orchestra.run.smithi008.stdout: { 2023-08-01T19:55:54.931 INFO:teuthology.orchestra.run.smithi008.stdout: "event": "reached_pg", 2023-08-01T19:55:54.931 INFO:teuthology.orchestra.run.smithi008.stdout: "time": "2023-08-01T19:55:05.626717+0000", 2023-08-01T19:55:54.931 INFO:teuthology.orchestra.run.smithi008.stdout: "duration": 4.1318e-05 2023-08-01T19:55:54.932 INFO:teuthology.orchestra.run.smithi008.stdout: }, 2023-08-01T19:55:54.932 INFO:teuthology.orchestra.run.smithi008.stdout: { 2023-08-01T19:55:54.932 INFO:teuthology.orchestra.run.smithi008.stdout: "event": "started", 2023-08-01T19:55:54.932 INFO:teuthology.orchestra.run.smithi008.stdout: "time": "2023-08-01T19:55:05.626737+0000", 2023-08-01T19:55:54.932 INFO:teuthology.orchestra.run.smithi008.stdout: "duration": 1.9415e-05 2023-08-01T19:55:54.932 INFO:teuthology.orchestra.run.smithi008.stdout: }, 2023-08-01T19:55:54.932 INFO:teuthology.orchestra.run.smithi008.stdout: { 2023-08-01T19:55:54.932 INFO:teuthology.orchestra.run.smithi008.stdout: "event": "commit_sent", 2023-08-01T19:55:54.933 INFO:teuthology.orchestra.run.smithi008.stdout: "time": "2023-08-01T19:55:05.635036+0000", 2023-08-01T19:55:54.933 INFO:teuthology.orchestra.run.smithi008.stdout: "duration": 0.0082987700000000005 2023-08-01T19:55:54.933 INFO:teuthology.orchestra.run.smithi008.stdout: }, 2023-08-01T19:55:54.933 INFO:teuthology.orchestra.run.smithi008.stdout: { 2023-08-01T19:55:54.933 INFO:teuthology.orchestra.run.smithi008.stdout: "event": "done", 2023-08-01T19:55:54.933 INFO:teuthology.orchestra.run.smithi008.stdout: "time": "2023-08-01T19:55:05.635067+0000", 2023-08-01T19:55:54.933 INFO:teuthology.orchestra.run.smithi008.stdout: "duration": 3.1786999999999999e-05 2023-08-01T19:55:54.933 INFO:teuthology.orchestra.run.smithi008.stdout: } 2023-08-01T19:55:54.934 INFO:teuthology.orchestra.run.smithi008.stdout: ] 2023-08-01T19:55:54.934 INFO:teuthology.orchestra.run.smithi008.stdout: } 2023-08-01T19:55:54.934 INFO:teuthology.orchestra.run.smithi008.stdout: }, 2023-08-01T19:55:54.934 INFO:teuthology.orchestra.run.smithi008.stdout: { 2023-08-01T19:55:54.934 INFO:teuthology.orchestra.run.smithi008.stdout: "description": "osd_op(client.4668.0:107863 5.3 5:cbdd875a:::benchmark_data_smithi006_114134_object107862:head [set-alloc-hint object_size 65536 write_size 65536,write 0~65536] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e38)", 2023-08-01T19:55:54.934 INFO:teuthology.orchestra.run.smithi008.stdout: "initiated_at": "2023-08-01T19:55:09.278851+0000", 2023-08-01T19:55:54.934 INFO:teuthology.orchestra.run.smithi008.stdout: "age": 45.519209627000002, 2023-08-01T19:55:54.935 INFO:teuthology.orchestra.run.smithi008.stdout: "duration": 0.071378853000000006, 2023-08-01T19:55:54.935 INFO:teuthology.orchestra.run.smithi008.stdout: "type_data": { 2023-08-01T19:55:54.935 INFO:teuthology.orchestra.run.smithi008.stdout: "flag_point": "commit sent; apply or cleanup", 2023-08-01T19:55:54.935 INFO:teuthology.orchestra.run.smithi008.stdout: "client_info": { 2023-08-01T19:55:54.935 INFO:teuthology.orchestra.run.smithi008.stdout: "client": "client.4668", 2023-08-01T19:55:54.935 INFO:teuthology.orchestra.run.smithi008.stdout: "client_addr": "172.21.15.6:0/1709472247", 2023-08-01T19:55:54.935 INFO:teuthology.orchestra.run.smithi008.stdout: "tid": 107863 2023-08-01T19:55:54.935 INFO:teuthology.orchestra.run.smithi008.stdout: }, 2023-08-01T19:55:54.936 INFO:teuthology.orchestra.run.smithi008.stdout: "events": [ 2023-08-01T19:55:54.936 INFO:teuthology.orchestra.run.smithi008.stdout: { 2023-08-01T19:55:54.936 INFO:teuthology.orchestra.run.smithi008.stdout: "event": "initiated", 2023-08-01T19:55:54.936 INFO:teuthology.orchestra.run.smithi008.stdout: "time": "2023-08-01T19:55:09.278851+0000", 2023-08-01T19:55:54.936 INFO:teuthology.orchestra.run.smithi008.stdout: "duration": 0 2023-08-01T19:55:54.936 INFO:teuthology.orchestra.run.smithi008.stdout: }, 2023-08-01T19:55:54.936 INFO:teuthology.orchestra.run.smithi008.stdout: { 2023-08-01T19:55:54.936 INFO:teuthology.orchestra.run.smithi008.stdout: "event": "throttled", 2023-08-01T19:55:54.937 INFO:teuthology.orchestra.run.smithi008.stdout: "time": "2023-08-01T19:55:09.278851+0000", 2023-08-01T19:55:54.937 INFO:teuthology.orchestra.run.smithi008.stdout: "duration": 0 2023-08-01T19:55:54.937 INFO:teuthology.orchestra.run.smithi008.stdout: }, 2023-08-01T19:55:54.937 INFO:teuthology.orchestra.run.smithi008.stdout: { 2023-08-01T19:55:54.937 INFO:teuthology.orchestra.run.smithi008.stdout: "event": "header_read", 2023-08-01T19:55:54.937 INFO:teuthology.orchestra.run.smithi008.stdout: "time": "2023-08-01T19:55:09.278850+0000", 2023-08-01T19:55:54.937 INFO:teuthology.orchestra.run.smithi008.stdout: "duration": 4294967295.999999 2023-08-01T19:55:54.937 INFO:teuthology.orchestra.run.smithi008.stdout: }, 2023-08-01T19:55:54.938 INFO:teuthology.orchestra.run.smithi008.stdout: { 2023-08-01T19:55:54.938 INFO:teuthology.orchestra.run.smithi008.stdout: "event": "all_read", 2023-08-01T19:55:54.938 INFO:teuthology.orchestra.run.smithi008.stdout: "time": "2023-08-01T19:55:09.278945+0000", 2023-08-01T19:55:54.938 INFO:teuthology.orchestra.run.smithi008.stdout: "duration": 9.4388000000000005e-05 2023-08-01T19:55:54.938 INFO:teuthology.orchestra.run.smithi008.stdout: }, 2023-08-01T19:55:54.938 INFO:teuthology.orchestra.run.smithi008.stdout: { 2023-08-01T19:55:54.938 INFO:teuthology.orchestra.run.smithi008.stdout: "event": "dispatched", 2023-08-01T19:55:54.938 INFO:teuthology.orchestra.run.smithi008.stdout: "time": "2023-08-01T19:55:09.278955+0000", 2023-08-01T19:55:54.939 INFO:teuthology.orchestra.run.smithi008.stdout: "duration": 1.0413e-05 2023-08-01T19:55:54.939 INFO:teuthology.orchestra.run.smithi008.stdout: }, 2023-08-01T19:55:54.939 INFO:teuthology.orchestra.run.smithi008.stdout: { 2023-08-01T19:55:54.939 INFO:teuthology.orchestra.run.smithi008.stdout: "event": "queued_for_pg", 2023-08-01T19:55:54.939 INFO:teuthology.orchestra.run.smithi008.stdout: "time": "2023-08-01T19:55:09.278962+0000", 2023-08-01T19:55:54.939 INFO:teuthology.orchestra.run.smithi008.stdout: "duration": 6.2169999999999999e-06 2023-08-01T19:55:54.939 INFO:teuthology.orchestra.run.smithi008.stdout: }, 2023-08-01T19:55:54.939 INFO:teuthology.orchestra.run.smithi008.stdout: { 2023-08-01T19:55:54.940 INFO:teuthology.orchestra.run.smithi008.stdout: "event": "reached_pg", 2023-08-01T19:55:54.940 INFO:teuthology.orchestra.run.smithi008.stdout: "time": "2023-08-01T19:55:09.280363+0000", 2023-08-01T19:55:54.940 INFO:teuthology.orchestra.run.smithi008.stdout: "duration": 0.0014014489999999999 2023-08-01T19:55:54.940 INFO:teuthology.orchestra.run.smithi008.stdout: }, 2023-08-01T19:55:54.940 INFO:teuthology.orchestra.run.smithi008.stdout: { 2023-08-01T19:55:54.940 INFO:teuthology.orchestra.run.smithi008.stdout: "event": "started", 2023-08-01T19:55:54.940 INFO:teuthology.orchestra.run.smithi008.stdout: "time": "2023-08-01T19:55:09.280488+0000", 2023-08-01T19:55:54.941 INFO:teuthology.orchestra.run.smithi008.stdout: "duration": 0.00012474099999999999 2023-08-01T19:55:54.941 INFO:teuthology.orchestra.run.smithi008.stdout: }, 2023-08-01T19:55:54.941 INFO:teuthology.orchestra.run.smithi008.stdout: { 2023-08-01T19:55:54.941 INFO:teuthology.orchestra.run.smithi008.stdout: "event": "waiting for subops from 1", 2023-08-01T19:55:54.941 INFO:teuthology.orchestra.run.smithi008.stdout: "time": "2023-08-01T19:55:09.280626+0000", 2023-08-01T19:55:54.941 INFO:teuthology.orchestra.run.smithi008.stdout: "duration": 0.000138193 2023-08-01T19:55:54.941 INFO:teuthology.orchestra.run.smithi008.stdout: }, 2023-08-01T19:55:54.941 INFO:teuthology.orchestra.run.smithi008.stdout: { 2023-08-01T19:55:54.942 INFO:teuthology.orchestra.run.smithi008.stdout: "event": "op_commit", 2023-08-01T19:55:54.942 INFO:teuthology.orchestra.run.smithi008.stdout: "time": "2023-08-01T19:55:09.285958+0000", 2023-08-01T19:55:54.942 INFO:teuthology.orchestra.run.smithi008.stdout: "duration": 0.0053317130000000001 2023-08-01T19:55:54.942 INFO:teuthology.orchestra.run.smithi008.stdout: }, 2023-08-01T19:55:54.942 INFO:teuthology.orchestra.run.smithi008.stdout: { 2023-08-01T19:55:54.942 INFO:teuthology.orchestra.run.smithi008.stdout: "event": "sub_op_commit_rec", 2023-08-01T19:55:54.942 INFO:teuthology.orchestra.run.smithi008.stdout: "time": "2023-08-01T19:55:09.350151+0000", 2023-08-01T19:55:54.942 INFO:teuthology.orchestra.run.smithi008.stdout: "duration": 0.064193202000000005 2023-08-01T19:55:54.943 INFO:teuthology.orchestra.run.smithi008.stdout: }, 2023-08-01T19:55:54.943 INFO:teuthology.orchestra.run.smithi008.stdout: { 2023-08-01T19:55:54.943 INFO:teuthology.orchestra.run.smithi008.stdout: "event": "commit_sent", 2023-08-01T19:55:54.943 INFO:teuthology.orchestra.run.smithi008.stdout: "time": "2023-08-01T19:55:09.350188+0000", 2023-08-01T19:55:54.943 INFO:teuthology.orchestra.run.smithi008.stdout: "duration": 3.7549999999999998e-05 2023-08-01T19:55:54.943 INFO:teuthology.orchestra.run.smithi008.stdout: }, 2023-08-01T19:55:54.943 INFO:teuthology.orchestra.run.smithi008.stdout: { 2023-08-01T19:55:54.943 INFO:teuthology.orchestra.run.smithi008.stdout: "event": "done", 2023-08-01T19:55:54.944 INFO:teuthology.orchestra.run.smithi008.stdout: "time": "2023-08-01T19:55:09.350230+0000", 2023-08-01T19:55:54.944 INFO:teuthology.orchestra.run.smithi008.stdout: "duration": 4.1804999999999997e-05 2023-08-01T19:55:54.944 INFO:teuthology.orchestra.run.smithi008.stdout: } 2023-08-01T19:55:54.944 INFO:teuthology.orchestra.run.smithi008.stdout: ] 2023-08-01T19:55:54.944 INFO:teuthology.orchestra.run.smithi008.stdout: } 2023-08-01T19:55:54.944 INFO:teuthology.orchestra.run.smithi008.stdout: }, 2023-08-01T19:55:54.944 INFO:teuthology.orchestra.run.smithi008.stdout: { 2023-08-01T19:55:54.944 INFO:teuthology.orchestra.run.smithi008.stdout: "description": "osd_op(client.4668.0:107865 5.3 5:c2ebb96d:::benchmark_data_smithi006_114134_object107864:head [set-alloc-hint object_size 65536 write_size 65536,write 0~65536] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e38)", 2023-08-01T19:55:54.945 INFO:teuthology.orchestra.run.smithi008.stdout: "initiated_at": "2023-08-01T19:55:09.279020+0000", 2023-08-01T19:55:54.945 INFO:teuthology.orchestra.run.smithi008.stdout: "age": 45.519040955000001, 2023-08-01T19:55:54.945 INFO:teuthology.orchestra.run.smithi008.stdout: "duration": 0.072892565000000006, 2023-08-01T19:55:54.945 INFO:teuthology.orchestra.run.smithi008.stdout: "type_data": { 2023-08-01T19:55:54.945 INFO:teuthology.orchestra.run.smithi008.stdout: "flag_point": "commit sent; apply or cleanup", 2023-08-01T19:55:54.945 INFO:teuthology.orchestra.run.smithi008.stdout: "client_info": { 2023-08-01T19:55:54.945 INFO:teuthology.orchestra.run.smithi008.stdout: "client": "client.4668", 2023-08-01T19:55:54.945 INFO:teuthology.orchestra.run.smithi008.stdout: "client_addr": "172.21.15.6:0/1709472247", 2023-08-01T19:55:54.946 INFO:teuthology.orchestra.run.smithi008.stdout: "tid": 107865 2023-08-01T19:55:54.946 INFO:teuthology.orchestra.run.smithi008.stdout: }, 2023-08-01T19:55:54.946 INFO:teuthology.orchestra.run.smithi008.stdout: "events": [ 2023-08-01T19:55:54.946 INFO:teuthology.orchestra.run.smithi008.stdout: { 2023-08-01T19:55:54.946 INFO:teuthology.orchestra.run.smithi008.stdout: "event": "initiated", 2023-08-01T19:55:54.946 INFO:teuthology.orchestra.run.smithi008.stdout: "time": "2023-08-01T19:55:09.279020+0000", 2023-08-01T19:55:54.946 INFO:teuthology.orchestra.run.smithi008.stdout: "duration": 0 2023-08-01T19:55:54.947 INFO:teuthology.orchestra.run.smithi008.stdout: }, 2023-08-01T19:55:54.947 INFO:teuthology.orchestra.run.smithi008.stdout: { 2023-08-01T19:55:54.947 INFO:teuthology.orchestra.run.smithi008.stdout: "event": "throttled", 2023-08-01T19:55:54.947 INFO:teuthology.orchestra.run.smithi008.stdout: "time": "2023-08-01T19:55:09.279020+0000", 2023-08-01T19:55:54.947 INFO:teuthology.orchestra.run.smithi008.stdout: "duration": 0 2023-08-01T19:55:54.947 INFO:teuthology.orchestra.run.smithi008.stdout: }, 2023-08-01T19:55:54.947 INFO:teuthology.orchestra.run.smithi008.stdout: { 2023-08-01T19:55:54.947 INFO:teuthology.orchestra.run.smithi008.stdout: "event": "header_read", 2023-08-01T19:55:54.948 INFO:teuthology.orchestra.run.smithi008.stdout: "time": "2023-08-01T19:55:09.279019+0000", 2023-08-01T19:55:54.948 INFO:teuthology.orchestra.run.smithi008.stdout: "duration": 4294967295.999999 2023-08-01T19:55:54.948 INFO:teuthology.orchestra.run.smithi008.stdout: }, 2023-08-01T19:55:54.948 INFO:teuthology.orchestra.run.smithi008.stdout: { 2023-08-01T19:55:54.948 INFO:teuthology.orchestra.run.smithi008.stdout: "event": "all_read", 2023-08-01T19:55:54.948 INFO:teuthology.orchestra.run.smithi008.stdout: "time": "2023-08-01T19:55:09.279087+0000", 2023-08-01T19:55:54.948 INFO:teuthology.orchestra.run.smithi008.stdout: "duration": 6.8392000000000005e-05 2023-08-01T19:55:54.948 INFO:teuthology.orchestra.run.smithi008.stdout: }, 2023-08-01T19:55:54.949 INFO:teuthology.orchestra.run.smithi008.stdout: { 2023-08-01T19:55:54.949 INFO:teuthology.orchestra.run.smithi008.stdout: "event": "dispatched", 2023-08-01T19:55:54.949 INFO:teuthology.orchestra.run.smithi008.stdout: "time": "2023-08-01T19:55:09.279095+0000", 2023-08-01T19:55:54.949 INFO:teuthology.orchestra.run.smithi008.stdout: "duration": 8.0989999999999999e-06 2023-08-01T19:55:54.949 INFO:teuthology.orchestra.run.smithi008.stdout: }, 2023-08-01T19:55:54.949 INFO:teuthology.orchestra.run.smithi008.stdout: { 2023-08-01T19:55:54.949 INFO:teuthology.orchestra.run.smithi008.stdout: "event": "queued_for_pg", 2023-08-01T19:55:54.949 INFO:teuthology.orchestra.run.smithi008.stdout: "time": "2023-08-01T19:55:09.279101+0000", 2023-08-01T19:55:54.950 INFO:teuthology.orchestra.run.smithi008.stdout: "duration": 5.0390000000000004e-06 2023-08-01T19:55:54.950 INFO:teuthology.orchestra.run.smithi008.stdout: }, 2023-08-01T19:55:54.950 INFO:teuthology.orchestra.run.smithi008.stdout: { 2023-08-01T19:55:54.950 INFO:teuthology.orchestra.run.smithi008.stdout: "event": "reached_pg", 2023-08-01T19:55:54.950 INFO:teuthology.orchestra.run.smithi008.stdout: "time": "2023-08-01T19:55:09.282574+0000", 2023-08-01T19:55:54.950 INFO:teuthology.orchestra.run.smithi008.stdout: "duration": 0.0034730619999999999 2023-08-01T19:55:54.950 INFO:teuthology.orchestra.run.smithi008.stdout: }, 2023-08-01T19:55:54.950 INFO:teuthology.orchestra.run.smithi008.stdout: { 2023-08-01T19:55:54.951 INFO:teuthology.orchestra.run.smithi008.stdout: "event": "started", 2023-08-01T19:55:54.951 INFO:teuthology.orchestra.run.smithi008.stdout: "time": "2023-08-01T19:55:09.282705+0000", 2023-08-01T19:55:54.951 INFO:teuthology.orchestra.run.smithi008.stdout: "duration": 0.00013133400000000001 2023-08-01T19:55:54.951 INFO:teuthology.orchestra.run.smithi008.stdout: }, 2023-08-01T19:55:54.951 INFO:teuthology.orchestra.run.smithi008.stdout: { 2023-08-01T19:55:54.951 INFO:teuthology.orchestra.run.smithi008.stdout: "event": "waiting for subops from 1", 2023-08-01T19:55:54.951 INFO:teuthology.orchestra.run.smithi008.stdout: "time": "2023-08-01T19:55:09.283067+0000", 2023-08-01T19:55:54.951 INFO:teuthology.orchestra.run.smithi008.stdout: "duration": 0.00036195299999999998 2023-08-01T19:55:54.952 INFO:teuthology.orchestra.run.smithi008.stdout: }, 2023-08-01T19:55:54.952 INFO:teuthology.orchestra.run.smithi008.stdout: { 2023-08-01T19:55:54.952 INFO:teuthology.orchestra.run.smithi008.stdout: "event": "op_commit", 2023-08-01T19:55:54.952 INFO:teuthology.orchestra.run.smithi008.stdout: "time": "2023-08-01T19:55:09.288196+0000", 2023-08-01T19:55:54.952 INFO:teuthology.orchestra.run.smithi008.stdout: "duration": 0.0051293780000000004 2023-08-01T19:55:54.952 INFO:teuthology.orchestra.run.smithi008.stdout: }, 2023-08-01T19:55:54.952 INFO:teuthology.orchestra.run.smithi008.stdout: { 2023-08-01T19:55:54.953 INFO:teuthology.orchestra.run.smithi008.stdout: "event": "sub_op_commit_rec", 2023-08-01T19:55:54.953 INFO:teuthology.orchestra.run.smithi008.stdout: "time": "2023-08-01T19:55:09.351832+0000", 2023-08-01T19:55:54.953 INFO:teuthology.orchestra.run.smithi008.stdout: "duration": 0.063636076 2023-08-01T19:55:54.953 INFO:teuthology.orchestra.run.smithi008.stdout: }, 2023-08-01T19:55:54.953 INFO:teuthology.orchestra.run.smithi008.stdout: { 2023-08-01T19:55:54.953 INFO:teuthology.orchestra.run.smithi008.stdout: "event": "commit_sent", 2023-08-01T19:55:54.953 INFO:teuthology.orchestra.run.smithi008.stdout: "time": "2023-08-01T19:55:09.351878+0000", 2023-08-01T19:55:54.953 INFO:teuthology.orchestra.run.smithi008.stdout: "duration": 4.5408999999999998e-05 2023-08-01T19:55:54.954 INFO:teuthology.orchestra.run.smithi008.stdout: }, 2023-08-01T19:55:54.954 INFO:teuthology.orchestra.run.smithi008.stdout: { 2023-08-01T19:55:54.954 INFO:teuthology.orchestra.run.smithi008.stdout: "event": "done", 2023-08-01T19:55:54.954 INFO:teuthology.orchestra.run.smithi008.stdout: "time": "2023-08-01T19:55:09.351913+0000", 2023-08-01T19:55:54.954 INFO:teuthology.orchestra.run.smithi008.stdout: "duration": 3.4808999999999998e-05 2023-08-01T19:55:54.954 INFO:teuthology.orchestra.run.smithi008.stdout: } 2023-08-01T19:55:54.954 INFO:teuthology.orchestra.run.smithi008.stdout: ] 2023-08-01T19:55:54.954 INFO:teuthology.orchestra.run.smithi008.stdout: } 2023-08-01T19:55:54.955 INFO:teuthology.orchestra.run.smithi008.stdout: }, 2023-08-01T19:55:54.955 INFO:teuthology.orchestra.run.smithi008.stdout: { 2023-08-01T19:55:54.955 INFO:teuthology.orchestra.run.smithi008.stdout: "description": "osd_op(client.4668.0:107869 5.c 5:31910384:::benchmark_data_smithi006_114134_object107868:head [set-alloc-hint object_size 65536 write_size 65536,write 0~65536] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e38)", 2023-08-01T19:55:54.955 INFO:teuthology.orchestra.run.smithi008.stdout: "initiated_at": "2023-08-01T19:55:09.283205+0000", 2023-08-01T19:55:54.955 INFO:teuthology.orchestra.run.smithi008.stdout: "age": 45.514855789999999, 2023-08-01T19:55:54.955 INFO:teuthology.orchestra.run.smithi008.stdout: "duration": 0.068611808999999996, 2023-08-01T19:55:54.955 INFO:teuthology.orchestra.run.smithi008.stdout: "type_data": { 2023-08-01T19:55:54.955 INFO:teuthology.orchestra.run.smithi008.stdout: "flag_point": "commit sent; apply or cleanup", 2023-08-01T19:55:54.956 INFO:teuthology.orchestra.run.smithi008.stdout: "client_info": { 2023-08-01T19:55:54.956 INFO:teuthology.orchestra.run.smithi008.stdout: "client": "client.4668", 2023-08-01T19:55:54.956 INFO:teuthology.orchestra.run.smithi008.stdout: "client_addr": "172.21.15.6:0/1709472247", 2023-08-01T19:55:54.956 INFO:teuthology.orchestra.run.smithi008.stdout: "tid": 107869 2023-08-01T19:55:54.956 INFO:teuthology.orchestra.run.smithi008.stdout: }, 2023-08-01T19:55:54.956 INFO:teuthology.orchestra.run.smithi008.stdout: "events": [ 2023-08-01T19:55:54.956 INFO:teuthology.orchestra.run.smithi008.stdout: { 2023-08-01T19:55:54.956 INFO:teuthology.orchestra.run.smithi008.stdout: "event": "initiated", 2023-08-01T19:55:54.957 INFO:teuthology.orchestra.run.smithi008.stdout: "time": "2023-08-01T19:55:09.283205+0000", 2023-08-01T19:55:54.957 INFO:teuthology.orchestra.run.smithi008.stdout: "duration": 0 2023-08-01T19:55:54.957 INFO:teuthology.orchestra.run.smithi008.stdout: }, 2023-08-01T19:55:54.957 INFO:teuthology.orchestra.run.smithi008.stdout: { 2023-08-01T19:55:54.957 INFO:teuthology.orchestra.run.smithi008.stdout: "event": "throttled", 2023-08-01T19:55:54.957 INFO:teuthology.orchestra.run.smithi008.stdout: "time": "2023-08-01T19:55:09.283205+0000", 2023-08-01T19:55:54.957 INFO:teuthology.orchestra.run.smithi008.stdout: "duration": 0 2023-08-01T19:55:54.957 INFO:teuthology.orchestra.run.smithi008.stdout: }, 2023-08-01T19:55:54.958 INFO:teuthology.orchestra.run.smithi008.stdout: { 2023-08-01T19:55:54.958 INFO:teuthology.orchestra.run.smithi008.stdout: "event": "header_read", 2023-08-01T19:55:54.958 INFO:teuthology.orchestra.run.smithi008.stdout: "time": "2023-08-01T19:55:09.283204+0000", 2023-08-01T19:55:54.958 INFO:teuthology.orchestra.run.smithi008.stdout: "duration": 4294967295.999999 2023-08-01T19:55:54.958 INFO:teuthology.orchestra.run.smithi008.stdout: }, 2023-08-01T19:55:54.958 INFO:teuthology.orchestra.run.smithi008.stdout: { 2023-08-01T19:55:54.958 INFO:teuthology.orchestra.run.smithi008.stdout: "event": "all_read", 2023-08-01T19:55:54.958 INFO:teuthology.orchestra.run.smithi008.stdout: "time": "2023-08-01T19:55:09.283300+0000", 2023-08-01T19:55:54.959 INFO:teuthology.orchestra.run.smithi008.stdout: "duration": 9.6280000000000007e-05 2023-08-01T19:55:54.959 INFO:teuthology.orchestra.run.smithi008.stdout: }, 2023-08-01T19:55:54.959 INFO:teuthology.orchestra.run.smithi008.stdout: { 2023-08-01T19:55:54.959 INFO:teuthology.orchestra.run.smithi008.stdout: "event": "dispatched", 2023-08-01T19:55:54.959 INFO:teuthology.orchestra.run.smithi008.stdout: "time": "2023-08-01T19:55:09.283314+0000", 2023-08-01T19:55:54.959 INFO:teuthology.orchestra.run.smithi008.stdout: "duration": 1.3344e-05 2023-08-01T19:55:54.959 INFO:teuthology.orchestra.run.smithi008.stdout: }, 2023-08-01T19:55:54.960 INFO:teuthology.orchestra.run.smithi008.stdout: { 2023-08-01T19:55:54.960 INFO:teuthology.orchestra.run.smithi008.stdout: "event": "queued_for_pg", 2023-08-01T19:55:54.960 INFO:teuthology.orchestra.run.smithi008.stdout: "time": "2023-08-01T19:55:09.283320+0000", 2023-08-01T19:55:54.960 INFO:teuthology.orchestra.run.smithi008.stdout: "duration": 6.0299999999999999e-06 2023-08-01T19:55:54.960 INFO:teuthology.orchestra.run.smithi008.stdout: }, 2023-08-01T19:55:54.960 INFO:teuthology.orchestra.run.smithi008.stdout: { 2023-08-01T19:55:54.960 INFO:teuthology.orchestra.run.smithi008.stdout: "event": "reached_pg", 2023-08-01T19:55:54.960 INFO:teuthology.orchestra.run.smithi008.stdout: "time": "2023-08-01T19:55:09.283365+0000", 2023-08-01T19:55:54.961 INFO:teuthology.orchestra.run.smithi008.stdout: "duration": 4.5578999999999998e-05 2023-08-01T19:55:54.961 INFO:teuthology.orchestra.run.smithi008.stdout: }, 2023-08-01T19:55:54.961 INFO:teuthology.orchestra.run.smithi008.stdout: { 2023-08-01T19:55:54.961 INFO:teuthology.orchestra.run.smithi008.stdout: "event": "started", 2023-08-01T19:55:54.961 INFO:teuthology.orchestra.run.smithi008.stdout: "time": "2023-08-01T19:55:09.283490+0000", 2023-08-01T19:55:54.961 INFO:teuthology.orchestra.run.smithi008.stdout: "duration": 0.00012473700000000001 2023-08-01T19:55:54.961 INFO:teuthology.orchestra.run.smithi008.stdout: }, 2023-08-01T19:55:54.961 INFO:teuthology.orchestra.run.smithi008.stdout: { 2023-08-01T19:55:54.962 INFO:teuthology.orchestra.run.smithi008.stdout: "event": "waiting for subops from 1", 2023-08-01T19:55:54.962 INFO:teuthology.orchestra.run.smithi008.stdout: "time": "2023-08-01T19:55:09.283637+0000", 2023-08-01T19:55:54.962 INFO:teuthology.orchestra.run.smithi008.stdout: "duration": 0.00014715600000000001 2023-08-01T19:55:54.962 INFO:teuthology.orchestra.run.smithi008.stdout: }, 2023-08-01T19:55:54.962 INFO:teuthology.orchestra.run.smithi008.stdout: { 2023-08-01T19:55:54.962 INFO:teuthology.orchestra.run.smithi008.stdout: "event": "op_commit", 2023-08-01T19:55:54.962 INFO:teuthology.orchestra.run.smithi008.stdout: "time": "2023-08-01T19:55:09.288214+0000", 2023-08-01T19:55:54.962 INFO:teuthology.orchestra.run.smithi008.stdout: "duration": 0.0045769560000000001 2023-08-01T19:55:54.963 INFO:teuthology.orchestra.run.smithi008.stdout: }, 2023-08-01T19:55:54.963 INFO:teuthology.orchestra.run.smithi008.stdout: { 2023-08-01T19:55:54.963 INFO:teuthology.orchestra.run.smithi008.stdout: "event": "sub_op_commit_rec", 2023-08-01T19:55:54.963 INFO:teuthology.orchestra.run.smithi008.stdout: "time": "2023-08-01T19:55:09.351721+0000", 2023-08-01T19:55:54.963 INFO:teuthology.orchestra.run.smithi008.stdout: "duration": 0.063507383000000001 2023-08-01T19:55:54.963 INFO:teuthology.orchestra.run.smithi008.stdout: }, 2023-08-01T19:55:54.963 INFO:teuthology.orchestra.run.smithi008.stdout: { 2023-08-01T19:55:54.963 INFO:teuthology.orchestra.run.smithi008.stdout: "event": "commit_sent", 2023-08-01T19:55:54.964 INFO:teuthology.orchestra.run.smithi008.stdout: "time": "2023-08-01T19:55:09.351777+0000", 2023-08-01T19:55:54.964 INFO:teuthology.orchestra.run.smithi008.stdout: "duration": 5.5733999999999999e-05 2023-08-01T19:55:54.964 INFO:teuthology.orchestra.run.smithi008.stdout: }, 2023-08-01T19:55:54.964 INFO:teuthology.orchestra.run.smithi008.stdout: { 2023-08-01T19:55:54.964 INFO:teuthology.orchestra.run.smithi008.stdout: "event": "done", 2023-08-01T19:55:54.964 INFO:teuthology.orchestra.run.smithi008.stdout: "time": "2023-08-01T19:55:09.351817+0000", 2023-08-01T19:55:54.964 INFO:teuthology.orchestra.run.smithi008.stdout: "duration": 3.9765000000000003e-05 2023-08-01T19:55:54.964 INFO:teuthology.orchestra.run.smithi008.stdout: } 2023-08-01T19:55:54.965 INFO:teuthology.orchestra.run.smithi008.stdout: ] 2023-08-01T19:55:54.965 INFO:teuthology.orchestra.run.smithi008.stdout: } 2023-08-01T19:55:54.965 INFO:teuthology.orchestra.run.smithi008.stdout: }, 2023-08-01T19:55:54.965 INFO:teuthology.orchestra.run.smithi008.stdout: { 2023-08-01T19:55:54.965 INFO:teuthology.orchestra.run.smithi008.stdout: "description": "osd_op(client.4668.0:107874 5.3 5:ce4c2799:::benchmark_data_smithi006_114134_object107873:head [set-alloc-hint object_size 65536 write_size 65536,write 0~65536] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e38)", 2023-08-01T19:55:54.965 INFO:teuthology.orchestra.run.smithi008.stdout: "initiated_at": "2023-08-01T19:55:09.286239+0000", 2023-08-01T19:55:54.965 INFO:teuthology.orchestra.run.smithi008.stdout: "age": 45.511822285000001, 2023-08-01T19:55:54.966 INFO:teuthology.orchestra.run.smithi008.stdout: "duration": 0.068224389999999996, 2023-08-01T19:55:54.966 INFO:teuthology.orchestra.run.smithi008.stdout: "type_data": { 2023-08-01T19:55:54.966 INFO:teuthology.orchestra.run.smithi008.stdout: "flag_point": "commit sent; apply or cleanup", 2023-08-01T19:55:54.966 INFO:teuthology.orchestra.run.smithi008.stdout: "client_info": { 2023-08-01T19:55:54.966 INFO:teuthology.orchestra.run.smithi008.stdout: "client": "client.4668", 2023-08-01T19:55:54.966 INFO:teuthology.orchestra.run.smithi008.stdout: "client_addr": "172.21.15.6:0/1709472247", 2023-08-01T19:55:54.966 INFO:teuthology.orchestra.run.smithi008.stdout: "tid": 107874 2023-08-01T19:55:54.966 INFO:teuthology.orchestra.run.smithi008.stdout: }, 2023-08-01T19:55:54.967 INFO:teuthology.orchestra.run.smithi008.stdout: "events": [ 2023-08-01T19:55:54.967 INFO:teuthology.orchestra.run.smithi008.stdout: { 2023-08-01T19:55:54.967 INFO:teuthology.orchestra.run.smithi008.stdout: "event": "initiated", 2023-08-01T19:55:54.967 INFO:teuthology.orchestra.run.smithi008.stdout: "time": "2023-08-01T19:55:09.286239+0000", 2023-08-01T19:55:54.967 INFO:teuthology.orchestra.run.smithi008.stdout: "duration": 0 2023-08-01T19:55:54.967 INFO:teuthology.orchestra.run.smithi008.stdout: }, 2023-08-01T19:55:54.967 INFO:teuthology.orchestra.run.smithi008.stdout: { 2023-08-01T19:55:54.967 INFO:teuthology.orchestra.run.smithi008.stdout: "event": "throttled", 2023-08-01T19:55:54.968 INFO:teuthology.orchestra.run.smithi008.stdout: "time": "2023-08-01T19:55:09.286239+0000", 2023-08-01T19:55:54.968 INFO:teuthology.orchestra.run.smithi008.stdout: "duration": 0 2023-08-01T19:55:54.968 INFO:teuthology.orchestra.run.smithi008.stdout: }, 2023-08-01T19:55:54.968 INFO:teuthology.orchestra.run.smithi008.stdout: { 2023-08-01T19:55:54.968 INFO:teuthology.orchestra.run.smithi008.stdout: "event": "header_read", 2023-08-01T19:55:54.968 INFO:teuthology.orchestra.run.smithi008.stdout: "time": "2023-08-01T19:55:09.286238+0000", 2023-08-01T19:55:54.968 INFO:teuthology.orchestra.run.smithi008.stdout: "duration": 4294967295.999999 2023-08-01T19:55:54.968 INFO:teuthology.orchestra.run.smithi008.stdout: }, 2023-08-01T19:55:54.969 INFO:teuthology.orchestra.run.smithi008.stdout: { 2023-08-01T19:55:54.969 INFO:teuthology.orchestra.run.smithi008.stdout: "event": "all_read", 2023-08-01T19:55:54.969 INFO:teuthology.orchestra.run.smithi008.stdout: "time": "2023-08-01T19:55:09.286310+0000", 2023-08-01T19:55:54.969 INFO:teuthology.orchestra.run.smithi008.stdout: "duration": 7.2583999999999995e-05 2023-08-01T19:55:54.969 INFO:teuthology.orchestra.run.smithi008.stdout: }, 2023-08-01T19:55:54.969 INFO:teuthology.orchestra.run.smithi008.stdout: { 2023-08-01T19:55:54.969 INFO:teuthology.orchestra.run.smithi008.stdout: "event": "dispatched", 2023-08-01T19:55:54.969 INFO:teuthology.orchestra.run.smithi008.stdout: "time": "2023-08-01T19:55:09.286323+0000", 2023-08-01T19:55:54.970 INFO:teuthology.orchestra.run.smithi008.stdout: "duration": 1.3151e-05 2023-08-01T19:55:54.970 INFO:teuthology.orchestra.run.smithi008.stdout: }, 2023-08-01T19:55:54.970 INFO:teuthology.orchestra.run.smithi008.stdout: { 2023-08-01T19:55:54.970 INFO:teuthology.orchestra.run.smithi008.stdout: "event": "queued_for_pg", 2023-08-01T19:55:54.970 INFO:teuthology.orchestra.run.smithi008.stdout: "time": "2023-08-01T19:55:09.286329+0000", 2023-08-01T19:55:54.970 INFO:teuthology.orchestra.run.smithi008.stdout: "duration": 5.8719999999999999e-06 2023-08-01T19:55:54.970 INFO:teuthology.orchestra.run.smithi008.stdout: }, 2023-08-01T19:55:54.970 INFO:teuthology.orchestra.run.smithi008.stdout: { 2023-08-01T19:55:54.971 INFO:teuthology.orchestra.run.smithi008.stdout: "event": "reached_pg", 2023-08-01T19:55:54.971 INFO:teuthology.orchestra.run.smithi008.stdout: "time": "2023-08-01T19:55:09.286392+0000", 2023-08-01T19:55:54.971 INFO:teuthology.orchestra.run.smithi008.stdout: "duration": 6.2378000000000005e-05 2023-08-01T19:55:54.971 INFO:teuthology.orchestra.run.smithi008.stdout: }, 2023-08-01T19:55:54.971 INFO:teuthology.orchestra.run.smithi008.stdout: { 2023-08-01T19:55:54.971 INFO:teuthology.orchestra.run.smithi008.stdout: "event": "started", 2023-08-01T19:55:54.971 INFO:teuthology.orchestra.run.smithi008.stdout: "time": "2023-08-01T19:55:09.286473+0000", 2023-08-01T19:55:54.971 INFO:teuthology.orchestra.run.smithi008.stdout: "duration": 8.1327000000000002e-05 2023-08-01T19:55:54.972 INFO:teuthology.orchestra.run.smithi008.stdout: }, 2023-08-01T19:55:54.972 INFO:teuthology.orchestra.run.smithi008.stdout: { 2023-08-01T19:55:54.972 INFO:teuthology.orchestra.run.smithi008.stdout: "event": "waiting for subops from 1", 2023-08-01T19:55:54.972 INFO:teuthology.orchestra.run.smithi008.stdout: "time": "2023-08-01T19:55:09.286557+0000", 2023-08-01T19:55:54.972 INFO:teuthology.orchestra.run.smithi008.stdout: "duration": 8.4140000000000004e-05 2023-08-01T19:55:54.972 INFO:teuthology.orchestra.run.smithi008.stdout: }, 2023-08-01T19:55:54.972 INFO:teuthology.orchestra.run.smithi008.stdout: { 2023-08-01T19:55:54.973 INFO:teuthology.orchestra.run.smithi008.stdout: "event": "op_commit", 2023-08-01T19:55:54.973 INFO:teuthology.orchestra.run.smithi008.stdout: "time": "2023-08-01T19:55:09.290681+0000", 2023-08-01T19:55:54.973 INFO:teuthology.orchestra.run.smithi008.stdout: "duration": 0.0041242420000000002 2023-08-01T19:55:54.973 INFO:teuthology.orchestra.run.smithi008.stdout: }, 2023-08-01T19:55:54.973 INFO:teuthology.orchestra.run.smithi008.stdout: { 2023-08-01T19:55:54.973 INFO:teuthology.orchestra.run.smithi008.stdout: "event": "sub_op_commit_rec", 2023-08-01T19:55:54.973 INFO:teuthology.orchestra.run.smithi008.stdout: "time": "2023-08-01T19:55:09.354372+0000", 2023-08-01T19:55:54.973 INFO:teuthology.orchestra.run.smithi008.stdout: "duration": 0.063690438000000002 2023-08-01T19:55:54.974 INFO:teuthology.orchestra.run.smithi008.stdout: }, 2023-08-01T19:55:54.974 INFO:teuthology.orchestra.run.smithi008.stdout: { 2023-08-01T19:55:54.974 INFO:teuthology.orchestra.run.smithi008.stdout: "event": "commit_sent", 2023-08-01T19:55:54.974 INFO:teuthology.orchestra.run.smithi008.stdout: "time": "2023-08-01T19:55:09.354421+0000", 2023-08-01T19:55:54.974 INFO:teuthology.orchestra.run.smithi008.stdout: "duration": 4.9413000000000003e-05 2023-08-01T19:55:54.974 INFO:teuthology.orchestra.run.smithi008.stdout: }, 2023-08-01T19:55:54.974 INFO:teuthology.orchestra.run.smithi008.stdout: { 2023-08-01T19:55:54.974 INFO:teuthology.orchestra.run.smithi008.stdout: "event": "done", 2023-08-01T19:55:54.975 INFO:teuthology.orchestra.run.smithi008.stdout: "time": "2023-08-01T19:55:09.354463+0000", 2023-08-01T19:55:54.975 INFO:teuthology.orchestra.run.smithi008.stdout: "duration": 4.1924e-05 2023-08-01T19:55:54.975 INFO:teuthology.orchestra.run.smithi008.stdout: } 2023-08-01T19:55:54.975 INFO:teuthology.orchestra.run.smithi008.stdout: ] 2023-08-01T19:55:54.975 INFO:teuthology.orchestra.run.smithi008.stdout: } 2023-08-01T19:55:54.975 INFO:teuthology.orchestra.run.smithi008.stdout: }, 2023-08-01T19:55:54.975 INFO:teuthology.orchestra.run.smithi008.stdout: { 2023-08-01T19:55:54.975 INFO:teuthology.orchestra.run.smithi008.stdout: "description": "osd_op(client.4668.0:107875 5.5 5:af4ec927:::benchmark_data_smithi006_114134_object107874:head [set-alloc-hint object_size 65536 write_size 65536,write 0~65536] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e38)", 2023-08-01T19:55:54.976 INFO:teuthology.orchestra.run.smithi008.stdout: "initiated_at": "2023-08-01T19:55:09.287186+0000", 2023-08-01T19:55:54.976 INFO:teuthology.orchestra.run.smithi008.stdout: "age": 45.510874498, 2023-08-01T19:55:54.976 INFO:teuthology.orchestra.run.smithi008.stdout: "duration": 0.064764719999999998, 2023-08-01T19:55:54.976 INFO:teuthology.orchestra.run.smithi008.stdout: "type_data": { 2023-08-01T19:55:54.976 INFO:teuthology.orchestra.run.smithi008.stdout: "flag_point": "commit sent; apply or cleanup", 2023-08-01T19:55:54.976 INFO:teuthology.orchestra.run.smithi008.stdout: "client_info": { 2023-08-01T19:55:54.976 INFO:teuthology.orchestra.run.smithi008.stdout: "client": "client.4668", 2023-08-01T19:55:54.977 INFO:teuthology.orchestra.run.smithi008.stdout: "client_addr": "172.21.15.6:0/1709472247", 2023-08-01T19:55:54.977 INFO:teuthology.orchestra.run.smithi008.stdout: "tid": 107875 2023-08-01T19:55:54.977 INFO:teuthology.orchestra.run.smithi008.stdout: }, 2023-08-01T19:55:54.977 INFO:teuthology.orchestra.run.smithi008.stdout: "events": [ 2023-08-01T19:55:54.977 INFO:teuthology.orchestra.run.smithi008.stdout: { 2023-08-01T19:55:54.977 INFO:teuthology.orchestra.run.smithi008.stdout: "event": "initiated", 2023-08-01T19:55:54.977 INFO:teuthology.orchestra.run.smithi008.stdout: "time": "2023-08-01T19:55:09.287186+0000", 2023-08-01T19:55:54.977 INFO:teuthology.orchestra.run.smithi008.stdout: "duration": 0 2023-08-01T19:55:54.978 INFO:teuthology.orchestra.run.smithi008.stdout: }, 2023-08-01T19:55:54.978 INFO:teuthology.orchestra.run.smithi008.stdout: { 2023-08-01T19:55:54.978 INFO:teuthology.orchestra.run.smithi008.stdout: "event": "throttled", 2023-08-01T19:55:54.978 INFO:teuthology.orchestra.run.smithi008.stdout: "time": "2023-08-01T19:55:09.287186+0000", 2023-08-01T19:55:54.978 INFO:teuthology.orchestra.run.smithi008.stdout: "duration": 0 2023-08-01T19:55:54.978 INFO:teuthology.orchestra.run.smithi008.stdout: }, 2023-08-01T19:55:54.978 INFO:teuthology.orchestra.run.smithi008.stdout: { 2023-08-01T19:55:54.978 INFO:teuthology.orchestra.run.smithi008.stdout: "event": "header_read", 2023-08-01T19:55:54.979 INFO:teuthology.orchestra.run.smithi008.stdout: "time": "2023-08-01T19:55:09.287186+0000", 2023-08-01T19:55:54.979 INFO:teuthology.orchestra.run.smithi008.stdout: "duration": 4294967295.999999 2023-08-01T19:55:54.979 INFO:teuthology.orchestra.run.smithi008.stdout: }, 2023-08-01T19:55:54.979 INFO:teuthology.orchestra.run.smithi008.stdout: { 2023-08-01T19:55:54.979 INFO:teuthology.orchestra.run.smithi008.stdout: "event": "all_read", 2023-08-01T19:55:54.979 INFO:teuthology.orchestra.run.smithi008.stdout: "time": "2023-08-01T19:55:09.287248+0000", 2023-08-01T19:55:54.979 INFO:teuthology.orchestra.run.smithi008.stdout: "duration": 6.2922000000000005e-05 2023-08-01T19:55:54.979 INFO:teuthology.orchestra.run.smithi008.stdout: }, 2023-08-01T19:55:54.980 INFO:teuthology.orchestra.run.smithi008.stdout: { 2023-08-01T19:55:54.980 INFO:teuthology.orchestra.run.smithi008.stdout: "event": "dispatched", 2023-08-01T19:55:54.980 INFO:teuthology.orchestra.run.smithi008.stdout: "time": "2023-08-01T19:55:09.287261+0000", 2023-08-01T19:55:54.980 INFO:teuthology.orchestra.run.smithi008.stdout: "duration": 1.2364000000000001e-05 2023-08-01T19:55:54.980 INFO:teuthology.orchestra.run.smithi008.stdout: }, 2023-08-01T19:55:54.980 INFO:teuthology.orchestra.run.smithi008.stdout: { 2023-08-01T19:55:54.980 INFO:teuthology.orchestra.run.smithi008.stdout: "event": "queued_for_pg", 2023-08-01T19:55:54.980 INFO:teuthology.orchestra.run.smithi008.stdout: "time": "2023-08-01T19:55:09.287267+0000", 2023-08-01T19:55:54.981 INFO:teuthology.orchestra.run.smithi008.stdout: "duration": 6.2580000000000001e-06 2023-08-01T19:55:54.981 INFO:teuthology.orchestra.run.smithi008.stdout: }, 2023-08-01T19:55:54.981 INFO:teuthology.orchestra.run.smithi008.stdout: { 2023-08-01T19:55:54.981 INFO:teuthology.orchestra.run.smithi008.stdout: "event": "reached_pg", 2023-08-01T19:55:54.981 INFO:teuthology.orchestra.run.smithi008.stdout: "time": "2023-08-01T19:55:09.287306+0000", 2023-08-01T19:55:54.981 INFO:teuthology.orchestra.run.smithi008.stdout: "duration": 3.9057999999999998e-05 2023-08-01T19:55:54.981 INFO:teuthology.orchestra.run.smithi008.stdout: }, 2023-08-01T19:55:54.981 INFO:teuthology.orchestra.run.smithi008.stdout: { 2023-08-01T19:55:54.982 INFO:teuthology.orchestra.run.smithi008.stdout: "event": "started", 2023-08-01T19:55:54.982 INFO:teuthology.orchestra.run.smithi008.stdout: "time": "2023-08-01T19:55:09.287419+0000", 2023-08-01T19:55:54.982 INFO:teuthology.orchestra.run.smithi008.stdout: "duration": 0.000112843 2023-08-01T19:55:54.982 INFO:teuthology.orchestra.run.smithi008.stdout: }, 2023-08-01T19:55:54.982 INFO:teuthology.orchestra.run.smithi008.stdout: { 2023-08-01T19:55:54.982 INFO:teuthology.orchestra.run.smithi008.stdout: "event": "waiting for subops from 1", 2023-08-01T19:55:54.982 INFO:teuthology.orchestra.run.smithi008.stdout: "time": "2023-08-01T19:55:09.287514+0000", 2023-08-01T19:55:54.982 INFO:teuthology.orchestra.run.smithi008.stdout: "duration": 9.5068000000000005e-05 2023-08-01T19:55:54.983 INFO:teuthology.orchestra.run.smithi008.stdout: }, 2023-08-01T19:55:54.983 INFO:teuthology.orchestra.run.smithi008.stdout: { 2023-08-01T19:55:54.983 INFO:teuthology.orchestra.run.smithi008.stdout: "event": "op_commit", 2023-08-01T19:55:54.983 INFO:teuthology.orchestra.run.smithi008.stdout: "time": "2023-08-01T19:55:09.293891+0000", 2023-08-01T19:55:54.983 INFO:teuthology.orchestra.run.smithi008.stdout: "duration": 0.00637712 2023-08-01T19:55:54.983 INFO:teuthology.orchestra.run.smithi008.stdout: }, 2023-08-01T19:55:54.983 INFO:teuthology.orchestra.run.smithi008.stdout: { 2023-08-01T19:55:54.983 INFO:teuthology.orchestra.run.smithi008.stdout: "event": "sub_op_commit_rec", 2023-08-01T19:55:54.984 INFO:teuthology.orchestra.run.smithi008.stdout: "time": "2023-08-01T19:55:09.351871+0000", 2023-08-01T19:55:54.984 INFO:teuthology.orchestra.run.smithi008.stdout: "duration": 0.057980054000000003 2023-08-01T19:55:54.984 INFO:teuthology.orchestra.run.smithi008.stdout: }, 2023-08-01T19:55:54.984 INFO:teuthology.orchestra.run.smithi008.stdout: { 2023-08-01T19:55:54.984 INFO:teuthology.orchestra.run.smithi008.stdout: "event": "commit_sent", 2023-08-01T19:55:54.984 INFO:teuthology.orchestra.run.smithi008.stdout: "time": "2023-08-01T19:55:09.351917+0000", 2023-08-01T19:55:54.984 INFO:teuthology.orchestra.run.smithi008.stdout: "duration": 4.5501999999999999e-05 2023-08-01T19:55:54.985 INFO:teuthology.orchestra.run.smithi008.stdout: }, 2023-08-01T19:55:54.985 INFO:teuthology.orchestra.run.smithi008.stdout: { 2023-08-01T19:55:54.985 INFO:teuthology.orchestra.run.smithi008.stdout: "event": "done", 2023-08-01T19:55:54.985 INFO:teuthology.orchestra.run.smithi008.stdout: "time": "2023-08-01T19:55:09.351951+0000", 2023-08-01T19:55:54.985 INFO:teuthology.orchestra.run.smithi008.stdout: "duration": 3.4450999999999999e-05 2023-08-01T19:55:54.985 INFO:teuthology.orchestra.run.smithi008.stdout: } 2023-08-01T19:55:54.985 INFO:teuthology.orchestra.run.smithi008.stdout: ] 2023-08-01T19:55:54.985 INFO:teuthology.orchestra.run.smithi008.stdout: } 2023-08-01T19:55:54.986 INFO:teuthology.orchestra.run.smithi008.stdout: }, 2023-08-01T19:55:54.986 INFO:teuthology.orchestra.run.smithi008.stdout: { 2023-08-01T19:55:54.986 INFO:teuthology.orchestra.run.smithi008.stdout: "description": "osd_op(client.4668.0:107880 5.5 5:a8d12d4b:::benchmark_data_smithi006_114134_object107879:head [set-alloc-hint object_size 65536 write_size 65536,write 0~65536] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e38)", 2023-08-01T19:55:54.986 INFO:teuthology.orchestra.run.smithi008.stdout: "initiated_at": "2023-08-01T19:55:09.292335+0000", 2023-08-01T19:55:54.986 INFO:teuthology.orchestra.run.smithi008.stdout: "age": 45.505725896999998, 2023-08-01T19:55:54.986 INFO:teuthology.orchestra.run.smithi008.stdout: "duration": 0.061350719999999997, 2023-08-01T19:55:54.986 INFO:teuthology.orchestra.run.smithi008.stdout: "type_data": { 2023-08-01T19:55:54.986 INFO:teuthology.orchestra.run.smithi008.stdout: "flag_point": "commit sent; apply or cleanup", 2023-08-01T19:55:54.987 INFO:teuthology.orchestra.run.smithi008.stdout: "client_info": { 2023-08-01T19:55:54.987 INFO:teuthology.orchestra.run.smithi008.stdout: "client": "client.4668", 2023-08-01T19:55:54.987 INFO:teuthology.orchestra.run.smithi008.stdout: "client_addr": "172.21.15.6:0/1709472247", 2023-08-01T19:55:54.987 INFO:teuthology.orchestra.run.smithi008.stdout: "tid": 107880 2023-08-01T19:55:54.987 INFO:teuthology.orchestra.run.smithi008.stdout: }, 2023-08-01T19:55:54.987 INFO:teuthology.orchestra.run.smithi008.stdout: "events": [ 2023-08-01T19:55:54.987 INFO:teuthology.orchestra.run.smithi008.stdout: { 2023-08-01T19:55:54.987 INFO:teuthology.orchestra.run.smithi008.stdout: "event": "initiated", 2023-08-01T19:55:54.988 INFO:teuthology.orchestra.run.smithi008.stdout: "time": "2023-08-01T19:55:09.292335+0000", 2023-08-01T19:55:54.988 INFO:teuthology.orchestra.run.smithi008.stdout: "duration": 0 2023-08-01T19:55:54.988 INFO:teuthology.orchestra.run.smithi008.stdout: }, 2023-08-01T19:55:54.988 INFO:teuthology.orchestra.run.smithi008.stdout: { 2023-08-01T19:55:54.988 INFO:teuthology.orchestra.run.smithi008.stdout: "event": "throttled", 2023-08-01T19:55:54.988 INFO:teuthology.orchestra.run.smithi008.stdout: "time": "2023-08-01T19:55:09.292335+0000", 2023-08-01T19:55:54.988 INFO:teuthology.orchestra.run.smithi008.stdout: "duration": 0 2023-08-01T19:55:54.988 INFO:teuthology.orchestra.run.smithi008.stdout: }, 2023-08-01T19:55:54.989 INFO:teuthology.orchestra.run.smithi008.stdout: { 2023-08-01T19:55:54.989 INFO:teuthology.orchestra.run.smithi008.stdout: "event": "header_read", 2023-08-01T19:55:54.989 INFO:teuthology.orchestra.run.smithi008.stdout: "time": "2023-08-01T19:55:09.292334+0000", 2023-08-01T19:55:54.989 INFO:teuthology.orchestra.run.smithi008.stdout: "duration": 4294967295.999999 2023-08-01T19:55:54.989 INFO:teuthology.orchestra.run.smithi008.stdout: }, 2023-08-01T19:55:54.989 INFO:teuthology.orchestra.run.smithi008.stdout: { 2023-08-01T19:55:54.989 INFO:teuthology.orchestra.run.smithi008.stdout: "event": "all_read", 2023-08-01T19:55:54.990 INFO:teuthology.orchestra.run.smithi008.stdout: "time": "2023-08-01T19:55:09.292449+0000", 2023-08-01T19:55:54.990 INFO:teuthology.orchestra.run.smithi008.stdout: "duration": 0.00011551400000000001 2023-08-01T19:55:54.990 INFO:teuthology.orchestra.run.smithi008.stdout: }, 2023-08-01T19:55:54.990 INFO:teuthology.orchestra.run.smithi008.stdout: { 2023-08-01T19:55:54.990 INFO:teuthology.orchestra.run.smithi008.stdout: "event": "dispatched", 2023-08-01T19:55:54.990 INFO:teuthology.orchestra.run.smithi008.stdout: "time": "2023-08-01T19:55:09.292461+0000", 2023-08-01T19:55:54.990 INFO:teuthology.orchestra.run.smithi008.stdout: "duration": 1.1287000000000001e-05 2023-08-01T19:55:54.990 INFO:teuthology.orchestra.run.smithi008.stdout: }, 2023-08-01T19:55:54.991 INFO:teuthology.orchestra.run.smithi008.stdout: { 2023-08-01T19:55:54.991 INFO:teuthology.orchestra.run.smithi008.stdout: "event": "queued_for_pg", 2023-08-01T19:55:54.991 INFO:teuthology.orchestra.run.smithi008.stdout: "time": "2023-08-01T19:55:09.292467+0000", 2023-08-01T19:55:54.991 INFO:teuthology.orchestra.run.smithi008.stdout: "duration": 6.4520000000000002e-06 2023-08-01T19:55:54.991 INFO:teuthology.orchestra.run.smithi008.stdout: }, 2023-08-01T19:55:54.991 INFO:teuthology.orchestra.run.smithi008.stdout: { 2023-08-01T19:55:54.991 INFO:teuthology.orchestra.run.smithi008.stdout: "event": "reached_pg", 2023-08-01T19:55:54.991 INFO:teuthology.orchestra.run.smithi008.stdout: "time": "2023-08-01T19:55:09.292510+0000", 2023-08-01T19:55:54.992 INFO:teuthology.orchestra.run.smithi008.stdout: "duration": 4.2502000000000001e-05 2023-08-01T19:55:54.992 INFO:teuthology.orchestra.run.smithi008.stdout: }, 2023-08-01T19:55:54.992 INFO:teuthology.orchestra.run.smithi008.stdout: { 2023-08-01T19:55:54.992 INFO:teuthology.orchestra.run.smithi008.stdout: "event": "started", 2023-08-01T19:55:54.992 INFO:teuthology.orchestra.run.smithi008.stdout: "time": "2023-08-01T19:55:09.292596+0000", 2023-08-01T19:55:54.992 INFO:teuthology.orchestra.run.smithi008.stdout: "duration": 8.6545000000000006e-05 2023-08-01T19:55:54.992 INFO:teuthology.orchestra.run.smithi008.stdout: }, 2023-08-01T19:55:54.992 INFO:teuthology.orchestra.run.smithi008.stdout: { 2023-08-01T19:55:54.993 INFO:teuthology.orchestra.run.smithi008.stdout: "event": "waiting for subops from 1", 2023-08-01T19:55:54.993 INFO:teuthology.orchestra.run.smithi008.stdout: "time": "2023-08-01T19:55:09.292697+0000", 2023-08-01T19:55:54.993 INFO:teuthology.orchestra.run.smithi008.stdout: "duration": 0.000100368 2023-08-01T19:55:54.993 INFO:teuthology.orchestra.run.smithi008.stdout: }, 2023-08-01T19:55:54.993 INFO:teuthology.orchestra.run.smithi008.stdout: { 2023-08-01T19:55:54.993 INFO:teuthology.orchestra.run.smithi008.stdout: "event": "op_commit", 2023-08-01T19:55:54.993 INFO:teuthology.orchestra.run.smithi008.stdout: "time": "2023-08-01T19:55:09.295658+0000", 2023-08-01T19:55:54.993 INFO:teuthology.orchestra.run.smithi008.stdout: "duration": 0.0029617290000000002 2023-08-01T19:55:54.994 INFO:teuthology.orchestra.run.smithi008.stdout: }, 2023-08-01T19:55:54.994 INFO:teuthology.orchestra.run.smithi008.stdout: { 2023-08-01T19:55:54.994 INFO:teuthology.orchestra.run.smithi008.stdout: "event": "sub_op_commit_rec", 2023-08-01T19:55:54.994 INFO:teuthology.orchestra.run.smithi008.stdout: "time": "2023-08-01T19:55:09.353604+0000", 2023-08-01T19:55:54.994 INFO:teuthology.orchestra.run.smithi008.stdout: "duration": 0.057945868999999997 2023-08-01T19:55:54.994 INFO:teuthology.orchestra.run.smithi008.stdout: }, 2023-08-01T19:55:54.994 INFO:teuthology.orchestra.run.smithi008.stdout: { 2023-08-01T19:55:54.994 INFO:teuthology.orchestra.run.smithi008.stdout: "event": "commit_sent", 2023-08-01T19:55:54.995 INFO:teuthology.orchestra.run.smithi008.stdout: "time": "2023-08-01T19:55:09.353650+0000", 2023-08-01T19:55:54.995 INFO:teuthology.orchestra.run.smithi008.stdout: "duration": 4.5698999999999997e-05 2023-08-01T19:55:54.995 INFO:teuthology.orchestra.run.smithi008.stdout: }, 2023-08-01T19:55:54.995 INFO:teuthology.orchestra.run.smithi008.stdout: { 2023-08-01T19:55:54.995 INFO:teuthology.orchestra.run.smithi008.stdout: "event": "done", 2023-08-01T19:55:54.995 INFO:teuthology.orchestra.run.smithi008.stdout: "time": "2023-08-01T19:55:09.353686+0000", 2023-08-01T19:55:54.995 INFO:teuthology.orchestra.run.smithi008.stdout: "duration": 3.5936999999999998e-05 2023-08-01T19:55:54.996 INFO:teuthology.orchestra.run.smithi008.stdout: } 2023-08-01T19:55:54.996 INFO:teuthology.orchestra.run.smithi008.stdout: ] 2023-08-01T19:55:54.996 INFO:teuthology.orchestra.run.smithi008.stdout: } 2023-08-01T19:55:54.996 INFO:teuthology.orchestra.run.smithi008.stdout: } 2023-08-01T19:55:54.996 INFO:teuthology.orchestra.run.smithi008.stdout: ] 2023-08-01T19:55:54.996 INFO:teuthology.orchestra.run.smithi008.stdout:} 2023-08-01T19:55:54.997 DEBUG:teuthology.orchestra.run.smithi101:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 30 ceph --cluster ceph --admin-daemon /var/run/ceph/ceph-osd.1.asok dump_ops_in_flight 2023-08-01T19:55:54.998 INFO:tasks.ceph.osd.0.smithi008.stderr:2023-08-01T19:55:54.995+0000 7f16a58f4700 -1 received signal: Hangup from /usr/bin/python3 /bin/daemon-helper kill ceph-osd -f --cluster ceph -i 0 (PID: 111179) UID: 0 2023-08-01T19:55:55.098 INFO:tasks.ceph.osd.2.smithi155.stderr:2023-08-01T19:55:55.096+0000 7faa5c6ac700 -1 received signal: Hangup from /usr/bin/python3 /bin/daemon-helper kill ceph-osd -f --cluster ceph -i 2 (PID: 111337) UID: 0 2023-08-01T19:55:55.113 INFO:tasks.thrashosds.thrasher:in_osds: [0, 1, 2] out_osds: [] dead_osds: [] live_osds: [0, 1, 2] 2023-08-01T19:55:55.113 INFO:tasks.thrashosds.thrasher:choose_action: min_in 4 min_out 0 min_live 2 min_dead 0 chance_down 1.00 2023-08-01T19:55:55.114 INFO:tasks.thrashosds.thrasher:Killing osd 1, live_osds are [0, 1, 2] 2023-08-01T19:55:55.114 INFO:tasks.ceph.ceph_manager.ceph:kill_osd on osd.1 doing powercycle of ubuntu@smithi101.front.sepia.ceph.com 2023-08-01T19:55:55.114 INFO:teuthology.orchestra.console.smithi101:Power off 2023-08-01T19:55:55.114 DEBUG:teuthology.orchestra.console.smithi101:pexpect command: ipmitool -H smithi101.ipmi.sepia.ceph.com -I lanplus -U inktank -P ApGNXcA7 power off 2023-08-01T19:55:55.135 DEBUG:teuthology.orchestra.console.smithi101:power off output: Chassis Power Control: Down/Off 2023-08-01T19:55:55.136 DEBUG:teuthology.orchestra.console.smithi101:pexpect command: ipmitool -H smithi101.ipmi.sepia.ceph.com -I lanplus -U inktank -P ApGNXcA7 power status 2023-08-01T19:55:55.147 INFO:teuthology.orchestra.run.smithi006.stderr:nodeep-scrub is unset 2023-08-01T19:55:55.159 DEBUG:teuthology.orchestra.console.smithi101:check power output: Chassis Power is on 2023-08-01T19:55:55.162 INFO:teuthology.orchestra.run.smithi101.stdout:{ 2023-08-01T19:55:55.162 INFO:teuthology.orchestra.run.smithi101.stdout: "ops": [ 2023-08-01T19:55:55.162 INFO:teuthology.orchestra.run.smithi101.stdout: { 2023-08-01T19:55:55.162 INFO:teuthology.orchestra.run.smithi101.stdout: "description": "osd_repop(client.4668.0:190569 5.6 e60/19 5:623f7b19:::benchmark_data_smithi006_114134_object56908:head v 60'11843, mlcod=59'11840)", 2023-08-01T19:55:55.163 INFO:teuthology.orchestra.run.smithi101.stdout: "initiated_at": "2023-08-01T19:55:55.156407+0000", 2023-08-01T19:55:55.163 INFO:teuthology.orchestra.run.smithi101.stdout: "age": 0.0045363770000000003, 2023-08-01T19:55:55.163 INFO:teuthology.orchestra.run.smithi101.stdout: "duration": 0.0045534870000000002, 2023-08-01T19:55:55.163 INFO:teuthology.orchestra.run.smithi101.stdout: "type_data": { 2023-08-01T19:55:55.163 INFO:teuthology.orchestra.run.smithi101.stdout: "flag_point": "started", 2023-08-01T19:55:55.163 INFO:teuthology.orchestra.run.smithi101.stdout: "events": [ 2023-08-01T19:55:55.163 INFO:teuthology.orchestra.run.smithi101.stdout: { 2023-08-01T19:55:55.164 INFO:teuthology.orchestra.run.smithi101.stdout: "event": "initiated", 2023-08-01T19:55:55.164 INFO:teuthology.orchestra.run.smithi101.stdout: "time": "2023-08-01T19:55:55.156407+0000", 2023-08-01T19:55:55.164 INFO:teuthology.orchestra.run.smithi101.stdout: "duration": 0 2023-08-01T19:55:55.164 INFO:teuthology.orchestra.run.smithi101.stdout: }, 2023-08-01T19:55:55.164 INFO:teuthology.orchestra.run.smithi101.stdout: { 2023-08-01T19:55:55.164 INFO:teuthology.orchestra.run.smithi101.stdout: "event": "throttled", 2023-08-01T19:55:55.164 INFO:teuthology.orchestra.run.smithi101.stdout: "time": "2023-08-01T19:55:55.156407+0000", 2023-08-01T19:55:55.165 INFO:teuthology.orchestra.run.smithi101.stdout: "duration": 0 2023-08-01T19:55:55.165 INFO:teuthology.orchestra.run.smithi101.stdout: }, 2023-08-01T19:55:55.165 INFO:teuthology.orchestra.run.smithi101.stdout: { 2023-08-01T19:55:55.165 INFO:teuthology.orchestra.run.smithi101.stdout: "event": "header_read", 2023-08-01T19:55:55.165 INFO:teuthology.orchestra.run.smithi101.stdout: "time": "2023-08-01T19:55:55.156406+0000", 2023-08-01T19:55:55.165 INFO:teuthology.orchestra.run.smithi101.stdout: "duration": 4294967295.9999995 2023-08-01T19:55:55.165 INFO:teuthology.orchestra.run.smithi101.stdout: }, 2023-08-01T19:55:55.165 INFO:teuthology.orchestra.run.smithi101.stdout: { 2023-08-01T19:55:55.166 INFO:teuthology.orchestra.run.smithi101.stdout: "event": "all_read", 2023-08-01T19:55:55.166 INFO:teuthology.orchestra.run.smithi101.stdout: "time": "2023-08-01T19:55:55.156411+0000", 2023-08-01T19:55:55.166 INFO:teuthology.orchestra.run.smithi101.stdout: "duration": 4.9459999999999997e-06 2023-08-01T19:55:55.166 INFO:teuthology.orchestra.run.smithi101.stdout: }, 2023-08-01T19:55:55.166 INFO:teuthology.orchestra.run.smithi101.stdout: { 2023-08-01T19:55:55.166 INFO:teuthology.orchestra.run.smithi101.stdout: "event": "dispatched", 2023-08-01T19:55:55.166 INFO:teuthology.orchestra.run.smithi101.stdout: "time": "2023-08-01T19:55:55.156421+0000", 2023-08-01T19:55:55.166 INFO:teuthology.orchestra.run.smithi101.stdout: "duration": 9.5899999999999997e-06 2023-08-01T19:55:55.167 INFO:teuthology.orchestra.run.smithi101.stdout: }, 2023-08-01T19:55:55.167 INFO:teuthology.orchestra.run.smithi101.stdout: { 2023-08-01T19:55:55.167 INFO:teuthology.orchestra.run.smithi101.stdout: "event": "queued_for_pg", 2023-08-01T19:55:55.167 INFO:teuthology.orchestra.run.smithi101.stdout: "time": "2023-08-01T19:55:55.156425+0000", 2023-08-01T19:55:55.167 INFO:teuthology.orchestra.run.smithi101.stdout: "duration": 4.4039999999999997e-06 2023-08-01T19:55:55.167 INFO:teuthology.orchestra.run.smithi101.stdout: }, 2023-08-01T19:55:55.167 INFO:teuthology.orchestra.run.smithi101.stdout: { 2023-08-01T19:55:55.168 INFO:teuthology.orchestra.run.smithi101.stdout: "event": "reached_pg", 2023-08-01T19:55:55.168 INFO:teuthology.orchestra.run.smithi101.stdout: "time": "2023-08-01T19:55:55.156461+0000", 2023-08-01T19:55:55.168 INFO:teuthology.orchestra.run.smithi101.stdout: "duration": 3.5500999999999998e-05 2023-08-01T19:55:55.168 INFO:teuthology.orchestra.run.smithi101.stdout: }, 2023-08-01T19:55:55.168 INFO:teuthology.orchestra.run.smithi101.stdout: { 2023-08-01T19:55:55.168 INFO:teuthology.orchestra.run.smithi101.stdout: "event": "started", 2023-08-01T19:55:55.168 INFO:teuthology.orchestra.run.smithi101.stdout: "time": "2023-08-01T19:55:55.156480+0000", 2023-08-01T19:55:55.169 INFO:teuthology.orchestra.run.smithi101.stdout: "duration": 1.9432999999999998e-05 2023-08-01T19:55:55.169 INFO:teuthology.orchestra.run.smithi101.stdout: } 2023-08-01T19:55:55.169 INFO:teuthology.orchestra.run.smithi101.stdout: ] 2023-08-01T19:55:55.169 INFO:teuthology.orchestra.run.smithi101.stdout: } 2023-08-01T19:55:55.169 INFO:teuthology.orchestra.run.smithi101.stdout: }, 2023-08-01T19:55:55.169 INFO:teuthology.orchestra.run.smithi101.stdout: { 2023-08-01T19:55:55.169 INFO:teuthology.orchestra.run.smithi101.stdout: "description": "osd_repop(client.4668.0:190568 5.1 e60/57 5:84fdfae8:::benchmark_data_smithi006_114134_object56907:head v 60'11815, mlcod=60'11812)", 2023-08-01T19:55:55.169 INFO:teuthology.orchestra.run.smithi101.stdout: "initiated_at": "2023-08-01T19:55:55.156488+0000", 2023-08-01T19:55:55.170 INFO:teuthology.orchestra.run.smithi101.stdout: "age": 0.0044550060000000001, 2023-08-01T19:55:55.170 INFO:teuthology.orchestra.run.smithi101.stdout: "duration": 0.0045123230000000004, 2023-08-01T19:55:55.170 INFO:teuthology.orchestra.run.smithi101.stdout: "type_data": { 2023-08-01T19:55:55.170 INFO:teuthology.orchestra.run.smithi101.stdout: "flag_point": "started", 2023-08-01T19:55:55.170 INFO:teuthology.orchestra.run.smithi101.stdout: "events": [ 2023-08-01T19:55:55.170 INFO:teuthology.orchestra.run.smithi101.stdout: { 2023-08-01T19:55:55.170 INFO:teuthology.orchestra.run.smithi101.stdout: "event": "initiated", 2023-08-01T19:55:55.171 INFO:teuthology.orchestra.run.smithi101.stdout: "time": "2023-08-01T19:55:55.156488+0000", 2023-08-01T19:55:55.171 INFO:teuthology.orchestra.run.smithi101.stdout: "duration": 0 2023-08-01T19:55:55.171 INFO:teuthology.orchestra.run.smithi101.stdout: }, 2023-08-01T19:55:55.171 INFO:teuthology.orchestra.run.smithi101.stdout: { 2023-08-01T19:55:55.171 INFO:teuthology.orchestra.run.smithi101.stdout: "event": "throttled", 2023-08-01T19:55:55.171 INFO:teuthology.orchestra.run.smithi101.stdout: "time": "2023-08-01T19:55:55.156488+0000", 2023-08-01T19:55:55.171 INFO:teuthology.orchestra.run.smithi101.stdout: "duration": 0 2023-08-01T19:55:55.171 INFO:teuthology.orchestra.run.smithi101.stdout: }, 2023-08-01T19:55:55.172 INFO:teuthology.orchestra.run.smithi101.stdout: { 2023-08-01T19:55:55.172 INFO:teuthology.orchestra.run.smithi101.stdout: "event": "header_read", 2023-08-01T19:55:55.172 INFO:teuthology.orchestra.run.smithi101.stdout: "time": "2023-08-01T19:55:55.156488+0000", 2023-08-01T19:55:55.172 INFO:teuthology.orchestra.run.smithi101.stdout: "duration": 4294967295.9999995 2023-08-01T19:55:55.172 INFO:teuthology.orchestra.run.smithi101.stdout: }, 2023-08-01T19:55:55.172 INFO:teuthology.orchestra.run.smithi101.stdout: { 2023-08-01T19:55:55.172 INFO:teuthology.orchestra.run.smithi101.stdout: "event": "all_read", 2023-08-01T19:55:55.173 INFO:teuthology.orchestra.run.smithi101.stdout: "time": "2023-08-01T19:55:55.156491+0000", 2023-08-01T19:55:55.173 INFO:teuthology.orchestra.run.smithi101.stdout: "duration": 3.3129999999999999e-06 2023-08-01T19:55:55.173 INFO:teuthology.orchestra.run.smithi101.stdout: }, 2023-08-01T19:55:55.173 INFO:teuthology.orchestra.run.smithi101.stdout: { 2023-08-01T19:55:55.173 INFO:teuthology.orchestra.run.smithi101.stdout: "event": "dispatched", 2023-08-01T19:55:55.173 INFO:teuthology.orchestra.run.smithi101.stdout: "time": "2023-08-01T19:55:55.156496+0000", 2023-08-01T19:55:55.173 INFO:teuthology.orchestra.run.smithi101.stdout: "duration": 4.6709999999999998e-06 2023-08-01T19:55:55.174 INFO:teuthology.orchestra.run.smithi101.stdout: }, 2023-08-01T19:55:55.174 INFO:teuthology.orchestra.run.smithi101.stdout: { 2023-08-01T19:55:55.174 INFO:teuthology.orchestra.run.smithi101.stdout: "event": "queued_for_pg", 2023-08-01T19:55:55.174 INFO:teuthology.orchestra.run.smithi101.stdout: "time": "2023-08-01T19:55:55.156499+0000", 2023-08-01T19:55:55.174 INFO:teuthology.orchestra.run.smithi101.stdout: "duration": 2.7829999999999999e-06 2023-08-01T19:55:55.174 INFO:teuthology.orchestra.run.smithi101.stdout: }, 2023-08-01T19:55:55.174 INFO:teuthology.orchestra.run.smithi101.stdout: { 2023-08-01T19:55:55.174 INFO:teuthology.orchestra.run.smithi101.stdout: "event": "reached_pg", 2023-08-01T19:55:55.175 INFO:teuthology.orchestra.run.smithi101.stdout: "time": "2023-08-01T19:55:55.156524+0000", 2023-08-01T19:55:55.175 INFO:teuthology.orchestra.run.smithi101.stdout: "duration": 2.5055999999999999e-05 2023-08-01T19:55:55.175 INFO:teuthology.orchestra.run.smithi101.stdout: }, 2023-08-01T19:55:55.175 INFO:teuthology.orchestra.run.smithi101.stdout: { 2023-08-01T19:55:55.175 INFO:teuthology.orchestra.run.smithi101.stdout: "event": "started", 2023-08-01T19:55:55.175 INFO:teuthology.orchestra.run.smithi101.stdout: "time": "2023-08-01T19:55:55.156535+0000", 2023-08-01T19:55:55.175 INFO:teuthology.orchestra.run.smithi101.stdout: "duration": 1.1856e-05 2023-08-01T19:55:55.175 INFO:teuthology.orchestra.run.smithi101.stdout: } 2023-08-01T19:55:55.176 INFO:teuthology.orchestra.run.smithi101.stdout: ] 2023-08-01T19:55:55.176 INFO:teuthology.orchestra.run.smithi101.stdout: } 2023-08-01T19:55:55.176 INFO:teuthology.orchestra.run.smithi101.stdout: }, 2023-08-01T19:55:55.176 INFO:teuthology.orchestra.run.smithi101.stdout: { 2023-08-01T19:55:55.176 INFO:teuthology.orchestra.run.smithi101.stdout: "description": "osd_op(client.4668.0:190572 5.2 5:417006a1:::benchmark_data_smithi006_114134_object56911:head [delete] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e60)", 2023-08-01T19:55:55.176 INFO:teuthology.orchestra.run.smithi101.stdout: "initiated_at": "2023-08-01T19:55:55.157089+0000", 2023-08-01T19:55:55.177 INFO:teuthology.orchestra.run.smithi101.stdout: "age": 0.0038536180000000001, 2023-08-01T19:55:55.177 INFO:teuthology.orchestra.run.smithi101.stdout: "duration": 0.0039593759999999997, 2023-08-01T19:55:55.177 INFO:teuthology.orchestra.run.smithi101.stdout: "type_data": { 2023-08-01T19:55:55.177 INFO:teuthology.orchestra.run.smithi101.stdout: "flag_point": "waiting for sub ops", 2023-08-01T19:55:55.177 INFO:teuthology.orchestra.run.smithi101.stdout: "client_info": { 2023-08-01T19:55:55.177 INFO:teuthology.orchestra.run.smithi101.stdout: "client": "client.4668", 2023-08-01T19:55:55.177 INFO:teuthology.orchestra.run.smithi101.stdout: "client_addr": "172.21.15.6:0/1709472247", 2023-08-01T19:55:55.177 INFO:teuthology.orchestra.run.smithi101.stdout: "tid": 190572 2023-08-01T19:55:55.178 INFO:teuthology.orchestra.run.smithi101.stdout: }, 2023-08-01T19:55:55.178 INFO:teuthology.orchestra.run.smithi101.stdout: "events": [ 2023-08-01T19:55:55.178 INFO:teuthology.orchestra.run.smithi101.stdout: { 2023-08-01T19:55:55.178 INFO:teuthology.orchestra.run.smithi101.stdout: "event": "initiated", 2023-08-01T19:55:55.178 INFO:teuthology.orchestra.run.smithi101.stdout: "time": "2023-08-01T19:55:55.157089+0000", 2023-08-01T19:55:55.178 INFO:teuthology.orchestra.run.smithi101.stdout: "duration": 0 2023-08-01T19:55:55.178 INFO:teuthology.orchestra.run.smithi101.stdout: }, 2023-08-01T19:55:55.179 INFO:teuthology.orchestra.run.smithi101.stdout: { 2023-08-01T19:55:55.179 INFO:teuthology.orchestra.run.smithi101.stdout: "event": "throttled", 2023-08-01T19:55:55.179 INFO:teuthology.orchestra.run.smithi101.stdout: "time": "2023-08-01T19:55:55.157089+0000", 2023-08-01T19:55:55.179 INFO:teuthology.orchestra.run.smithi101.stdout: "duration": 0 2023-08-01T19:55:55.179 INFO:teuthology.orchestra.run.smithi101.stdout: }, 2023-08-01T19:55:55.179 INFO:teuthology.orchestra.run.smithi101.stdout: { 2023-08-01T19:55:55.179 INFO:teuthology.orchestra.run.smithi101.stdout: "event": "header_read", 2023-08-01T19:55:55.179 INFO:teuthology.orchestra.run.smithi101.stdout: "time": "2023-08-01T19:55:55.157088+0000", 2023-08-01T19:55:55.180 INFO:teuthology.orchestra.run.smithi101.stdout: "duration": 4294967295.9999986 2023-08-01T19:55:55.180 INFO:teuthology.orchestra.run.smithi101.stdout: }, 2023-08-01T19:55:55.180 INFO:teuthology.orchestra.run.smithi101.stdout: { 2023-08-01T19:55:55.180 INFO:teuthology.orchestra.run.smithi101.stdout: "event": "all_read", 2023-08-01T19:55:55.180 INFO:teuthology.orchestra.run.smithi101.stdout: "time": "2023-08-01T19:55:55.157093+0000", 2023-08-01T19:55:55.180 INFO:teuthology.orchestra.run.smithi101.stdout: "duration": 4.977e-06 2023-08-01T19:55:55.181 INFO:teuthology.orchestra.run.smithi101.stdout: }, 2023-08-01T19:55:55.181 INFO:teuthology.orchestra.run.smithi101.stdout: { 2023-08-01T19:55:55.181 INFO:teuthology.orchestra.run.smithi101.stdout: "event": "dispatched", 2023-08-01T19:55:55.181 INFO:teuthology.orchestra.run.smithi101.stdout: "time": "2023-08-01T19:55:55.157105+0000", 2023-08-01T19:55:55.181 INFO:teuthology.orchestra.run.smithi101.stdout: "duration": 1.173e-05 2023-08-01T19:55:55.181 INFO:teuthology.orchestra.run.smithi101.stdout: }, 2023-08-01T19:55:55.181 INFO:teuthology.orchestra.run.smithi101.stdout: { 2023-08-01T19:55:55.181 INFO:teuthology.orchestra.run.smithi101.stdout: "event": "queued_for_pg", 2023-08-01T19:55:55.182 INFO:teuthology.orchestra.run.smithi101.stdout: "time": "2023-08-01T19:55:55.157111+0000", 2023-08-01T19:55:55.182 INFO:teuthology.orchestra.run.smithi101.stdout: "duration": 6.2400000000000004e-06 2023-08-01T19:55:55.182 INFO:teuthology.orchestra.run.smithi101.stdout: }, 2023-08-01T19:55:55.182 INFO:teuthology.orchestra.run.smithi101.stdout: { 2023-08-01T19:55:55.182 INFO:teuthology.orchestra.run.smithi101.stdout: "event": "reached_pg", 2023-08-01T19:55:55.182 INFO:teuthology.orchestra.run.smithi101.stdout: "time": "2023-08-01T19:55:55.157147+0000", 2023-08-01T19:55:55.182 INFO:teuthology.orchestra.run.smithi101.stdout: "duration": 3.5598e-05 2023-08-01T19:55:55.183 INFO:teuthology.orchestra.run.smithi101.stdout: }, 2023-08-01T19:55:55.183 INFO:teuthology.orchestra.run.smithi101.stdout: { 2023-08-01T19:55:55.183 INFO:teuthology.orchestra.run.smithi101.stdout: "event": "started", 2023-08-01T19:55:55.183 INFO:teuthology.orchestra.run.smithi101.stdout: "time": "2023-08-01T19:55:55.157241+0000", 2023-08-01T19:55:55.183 INFO:teuthology.orchestra.run.smithi101.stdout: "duration": 9.3789000000000006e-05 2023-08-01T19:55:55.183 INFO:teuthology.orchestra.run.smithi101.stdout: }, 2023-08-01T19:55:55.183 INFO:teuthology.orchestra.run.smithi101.stdout: { 2023-08-01T19:55:55.183 INFO:teuthology.orchestra.run.smithi101.stdout: "event": "waiting for subops from 0", 2023-08-01T19:55:55.184 INFO:teuthology.orchestra.run.smithi101.stdout: "time": "2023-08-01T19:55:55.157312+0000", 2023-08-01T19:55:55.184 INFO:teuthology.orchestra.run.smithi101.stdout: "duration": 7.1557999999999995e-05 2023-08-01T19:55:55.184 INFO:teuthology.orchestra.run.smithi101.stdout: } 2023-08-01T19:55:55.184 INFO:teuthology.orchestra.run.smithi101.stdout: ] 2023-08-01T19:55:55.184 INFO:teuthology.orchestra.run.smithi101.stdout: } 2023-08-01T19:55:55.184 INFO:teuthology.orchestra.run.smithi101.stdout: }, 2023-08-01T19:55:55.184 INFO:teuthology.orchestra.run.smithi101.stdout: { 2023-08-01T19:55:55.185 INFO:teuthology.orchestra.run.smithi101.stdout: "description": "osd_repop(client.4668.0:190573 5.1 e60/57 5:83f7ffdd:::benchmark_data_smithi006_114134_object56912:head v 60'11816, mlcod=60'11812)", 2023-08-01T19:55:55.185 INFO:teuthology.orchestra.run.smithi101.stdout: "initiated_at": "2023-08-01T19:55:55.159780+0000", 2023-08-01T19:55:55.185 INFO:teuthology.orchestra.run.smithi101.stdout: "age": 0.0011629120000000001, 2023-08-01T19:55:55.185 INFO:teuthology.orchestra.run.smithi101.stdout: "duration": 0.0013146329999999999, 2023-08-01T19:55:55.185 INFO:teuthology.orchestra.run.smithi101.stdout: "type_data": { 2023-08-01T19:55:55.185 INFO:teuthology.orchestra.run.smithi101.stdout: "flag_point": "started", 2023-08-01T19:55:55.185 INFO:teuthology.orchestra.run.smithi101.stdout: "events": [ 2023-08-01T19:55:55.186 INFO:teuthology.orchestra.run.smithi101.stdout: { 2023-08-01T19:55:55.186 INFO:teuthology.orchestra.run.smithi101.stdout: "event": "initiated", 2023-08-01T19:55:55.186 INFO:teuthology.orchestra.run.smithi101.stdout: "time": "2023-08-01T19:55:55.159780+0000", 2023-08-01T19:55:55.186 INFO:teuthology.orchestra.run.smithi101.stdout: "duration": 0 2023-08-01T19:55:55.186 INFO:teuthology.orchestra.run.smithi101.stdout: }, 2023-08-01T19:55:55.186 INFO:teuthology.orchestra.run.smithi101.stdout: { 2023-08-01T19:55:55.186 INFO:teuthology.orchestra.run.smithi101.stdout: "event": "throttled", 2023-08-01T19:55:55.187 INFO:teuthology.orchestra.run.smithi101.stdout: "time": "2023-08-01T19:55:55.159780+0000", 2023-08-01T19:55:55.187 INFO:teuthology.orchestra.run.smithi101.stdout: "duration": 0 2023-08-01T19:55:55.187 INFO:teuthology.orchestra.run.smithi101.stdout: }, 2023-08-01T19:55:55.187 INFO:teuthology.orchestra.run.smithi101.stdout: { 2023-08-01T19:55:55.187 INFO:teuthology.orchestra.run.smithi101.stdout: "event": "header_read", 2023-08-01T19:55:55.187 INFO:teuthology.orchestra.run.smithi101.stdout: "time": "2023-08-01T19:55:55.159780+0000", 2023-08-01T19:55:55.187 INFO:teuthology.orchestra.run.smithi101.stdout: "duration": 4294967295.9999995 2023-08-01T19:55:55.187 INFO:teuthology.orchestra.run.smithi101.stdout: }, 2023-08-01T19:55:55.188 INFO:teuthology.orchestra.run.smithi101.stdout: { 2023-08-01T19:55:55.188 INFO:teuthology.orchestra.run.smithi101.stdout: "event": "all_read", 2023-08-01T19:55:55.188 INFO:teuthology.orchestra.run.smithi101.stdout: "time": "2023-08-01T19:55:55.159784+0000", 2023-08-01T19:55:55.188 INFO:teuthology.orchestra.run.smithi101.stdout: "duration": 4.8420000000000004e-06 2023-08-01T19:55:55.188 INFO:teuthology.orchestra.run.smithi101.stdout: }, 2023-08-01T19:55:55.188 INFO:teuthology.orchestra.run.smithi101.stdout: { 2023-08-01T19:55:55.189 INFO:teuthology.orchestra.run.smithi101.stdout: "event": "dispatched", 2023-08-01T19:55:55.189 INFO:teuthology.orchestra.run.smithi101.stdout: "time": "2023-08-01T19:55:55.159794+0000", 2023-08-01T19:55:55.189 INFO:teuthology.orchestra.run.smithi101.stdout: "duration": 9.3470000000000005e-06 2023-08-01T19:55:55.189 INFO:teuthology.orchestra.run.smithi101.stdout: }, 2023-08-01T19:55:55.189 INFO:teuthology.orchestra.run.smithi101.stdout: { 2023-08-01T19:55:55.189 INFO:teuthology.orchestra.run.smithi101.stdout: "event": "queued_for_pg", 2023-08-01T19:55:55.189 INFO:teuthology.orchestra.run.smithi101.stdout: "time": "2023-08-01T19:55:55.159798+0000", 2023-08-01T19:55:55.190 INFO:teuthology.orchestra.run.smithi101.stdout: "duration": 3.9899999999999999e-06 2023-08-01T19:55:55.190 INFO:teuthology.orchestra.run.smithi101.stdout: }, 2023-08-01T19:55:55.190 INFO:teuthology.orchestra.run.smithi101.stdout: { 2023-08-01T19:55:55.190 INFO:teuthology.orchestra.run.smithi101.stdout: "event": "reached_pg", 2023-08-01T19:55:55.190 INFO:teuthology.orchestra.run.smithi101.stdout: "time": "2023-08-01T19:55:55.159829+0000", 2023-08-01T19:55:55.190 INFO:teuthology.orchestra.run.smithi101.stdout: "duration": 3.1183999999999998e-05 2023-08-01T19:55:55.190 INFO:teuthology.orchestra.run.smithi101.stdout: }, 2023-08-01T19:55:55.190 INFO:teuthology.orchestra.run.smithi101.stdout: { 2023-08-01T19:55:55.191 INFO:teuthology.orchestra.run.smithi101.stdout: "event": "started", 2023-08-01T19:55:55.191 INFO:teuthology.orchestra.run.smithi101.stdout: "time": "2023-08-01T19:55:55.159843+0000", 2023-08-01T19:55:55.191 INFO:teuthology.orchestra.run.smithi101.stdout: "duration": 1.4476e-05 2023-08-01T19:55:55.191 INFO:teuthology.orchestra.run.smithi101.stdout: } 2023-08-01T19:55:55.191 INFO:teuthology.orchestra.run.smithi101.stdout: ] 2023-08-01T19:55:55.191 INFO:teuthology.orchestra.run.smithi101.stdout: } 2023-08-01T19:55:55.191 INFO:teuthology.orchestra.run.smithi101.stdout: }, 2023-08-01T19:55:55.191 INFO:teuthology.orchestra.run.smithi101.stdout: { 2023-08-01T19:55:55.192 INFO:teuthology.orchestra.run.smithi101.stdout: "description": "osd_repop(client.4668.0:190575 5.6 e60/19 5:6805a308:::benchmark_data_smithi006_114134_object56914:head v 60'11844, mlcod=60'11841)", 2023-08-01T19:55:55.192 INFO:teuthology.orchestra.run.smithi101.stdout: "initiated_at": "2023-08-01T19:55:55.160695+0000", 2023-08-01T19:55:55.192 INFO:teuthology.orchestra.run.smithi101.stdout: "age": 0.000247865, 2023-08-01T19:55:55.192 INFO:teuthology.orchestra.run.smithi101.stdout: "duration": 0.00043614000000000001, 2023-08-01T19:55:55.192 INFO:teuthology.orchestra.run.smithi101.stdout: "type_data": { 2023-08-01T19:55:55.192 INFO:teuthology.orchestra.run.smithi101.stdout: "flag_point": "started", 2023-08-01T19:55:55.192 INFO:teuthology.orchestra.run.smithi101.stdout: "events": [ 2023-08-01T19:55:55.193 INFO:teuthology.orchestra.run.smithi101.stdout: { 2023-08-01T19:55:55.193 INFO:teuthology.orchestra.run.smithi101.stdout: "event": "initiated", 2023-08-01T19:55:55.193 INFO:teuthology.orchestra.run.smithi101.stdout: "time": "2023-08-01T19:55:55.160695+0000", 2023-08-01T19:55:55.193 INFO:teuthology.orchestra.run.smithi101.stdout: "duration": 0 2023-08-01T19:55:55.193 INFO:teuthology.orchestra.run.smithi101.stdout: }, 2023-08-01T19:55:55.193 INFO:teuthology.orchestra.run.smithi101.stdout: { 2023-08-01T19:55:55.193 INFO:teuthology.orchestra.run.smithi101.stdout: "event": "throttled", 2023-08-01T19:55:55.193 INFO:teuthology.orchestra.run.smithi101.stdout: "time": "2023-08-01T19:55:55.160695+0000", 2023-08-01T19:55:55.194 INFO:teuthology.orchestra.run.smithi101.stdout: "duration": 0 2023-08-01T19:55:55.194 INFO:teuthology.orchestra.run.smithi101.stdout: }, 2023-08-01T19:55:55.194 INFO:teuthology.orchestra.run.smithi101.stdout: { 2023-08-01T19:55:55.194 INFO:teuthology.orchestra.run.smithi101.stdout: "event": "header_read", 2023-08-01T19:55:55.194 INFO:teuthology.orchestra.run.smithi101.stdout: "time": "2023-08-01T19:55:55.160695+0000", 2023-08-01T19:55:55.194 INFO:teuthology.orchestra.run.smithi101.stdout: "duration": 4294967295.9999995 2023-08-01T19:55:55.194 INFO:teuthology.orchestra.run.smithi101.stdout: }, 2023-08-01T19:55:55.195 INFO:teuthology.orchestra.run.smithi101.stdout: { 2023-08-01T19:55:55.195 INFO:teuthology.orchestra.run.smithi101.stdout: "event": "all_read", 2023-08-01T19:55:55.195 INFO:teuthology.orchestra.run.smithi101.stdout: "time": "2023-08-01T19:55:55.160700+0000", 2023-08-01T19:55:55.195 INFO:teuthology.orchestra.run.smithi101.stdout: "duration": 5.7119999999999997e-06 2023-08-01T19:55:55.195 INFO:teuthology.orchestra.run.smithi101.stdout: }, 2023-08-01T19:55:55.195 INFO:teuthology.orchestra.run.smithi101.stdout: { 2023-08-01T19:55:55.195 INFO:teuthology.orchestra.run.smithi101.stdout: "event": "dispatched", 2023-08-01T19:55:55.195 INFO:teuthology.orchestra.run.smithi101.stdout: "time": "2023-08-01T19:55:55.160711+0000", 2023-08-01T19:55:55.196 INFO:teuthology.orchestra.run.smithi101.stdout: "duration": 1.1146e-05 2023-08-01T19:55:55.196 INFO:teuthology.orchestra.run.smithi101.stdout: }, 2023-08-01T19:55:55.196 INFO:teuthology.orchestra.run.smithi101.stdout: { 2023-08-01T19:55:55.196 INFO:teuthology.orchestra.run.smithi101.stdout: "event": "queued_for_pg", 2023-08-01T19:55:55.196 INFO:teuthology.orchestra.run.smithi101.stdout: "time": "2023-08-01T19:55:55.160718+0000", 2023-08-01T19:55:55.196 INFO:teuthology.orchestra.run.smithi101.stdout: "duration": 6.2820000000000002e-06 2023-08-01T19:55:55.196 INFO:teuthology.orchestra.run.smithi101.stdout: }, 2023-08-01T19:55:55.197 INFO:teuthology.orchestra.run.smithi101.stdout: { 2023-08-01T19:55:55.197 INFO:teuthology.orchestra.run.smithi101.stdout: "event": "reached_pg", 2023-08-01T19:55:55.197 INFO:teuthology.orchestra.run.smithi101.stdout: "time": "2023-08-01T19:55:55.160754+0000", 2023-08-01T19:55:55.197 INFO:teuthology.orchestra.run.smithi101.stdout: "duration": 3.5960000000000001e-05 2023-08-01T19:55:55.197 INFO:teuthology.orchestra.run.smithi101.stdout: }, 2023-08-01T19:55:55.197 INFO:teuthology.orchestra.run.smithi101.stdout: { 2023-08-01T19:55:55.197 INFO:teuthology.orchestra.run.smithi101.stdout: "event": "started", 2023-08-01T19:55:55.197 INFO:teuthology.orchestra.run.smithi101.stdout: "time": "2023-08-01T19:55:55.160773+0000", 2023-08-01T19:55:55.198 INFO:teuthology.orchestra.run.smithi101.stdout: "duration": 1.9692999999999999e-05 2023-08-01T19:55:55.198 INFO:teuthology.orchestra.run.smithi101.stdout: } 2023-08-01T19:55:55.198 INFO:teuthology.orchestra.run.smithi101.stdout: ] 2023-08-01T19:55:55.198 INFO:teuthology.orchestra.run.smithi101.stdout: } 2023-08-01T19:55:55.198 INFO:teuthology.orchestra.run.smithi101.stdout: }, 2023-08-01T19:55:55.198 INFO:teuthology.orchestra.run.smithi101.stdout: { 2023-08-01T19:55:55.198 INFO:teuthology.orchestra.run.smithi101.stdout: "description": "osd_repop(client.4668.0:190556 5.1 e60/57 5:89182278:::benchmark_data_smithi006_114134_object56895:head v 60'11814, mlcod=59'11811)", 2023-08-01T19:55:55.199 INFO:teuthology.orchestra.run.smithi101.stdout: "initiated_at": "2023-08-01T19:55:55.150820+0000", 2023-08-01T19:55:55.199 INFO:teuthology.orchestra.run.smithi101.stdout: "age": 0.01012265, 2023-08-01T19:55:55.199 INFO:teuthology.orchestra.run.smithi101.stdout: "duration": 0.010348677000000001, 2023-08-01T19:55:55.199 INFO:teuthology.orchestra.run.smithi101.stdout: "type_data": { 2023-08-01T19:55:55.199 INFO:teuthology.orchestra.run.smithi101.stdout: "flag_point": "started", 2023-08-01T19:55:55.199 INFO:teuthology.orchestra.run.smithi101.stdout: "events": [ 2023-08-01T19:55:55.199 INFO:teuthology.orchestra.run.smithi101.stdout: { 2023-08-01T19:55:55.199 INFO:teuthology.orchestra.run.smithi101.stdout: "event": "initiated", 2023-08-01T19:55:55.200 INFO:teuthology.orchestra.run.smithi101.stdout: "time": "2023-08-01T19:55:55.150820+0000", 2023-08-01T19:55:55.200 INFO:teuthology.orchestra.run.smithi101.stdout: "duration": 0 2023-08-01T19:55:55.200 INFO:teuthology.orchestra.run.smithi101.stdout: }, 2023-08-01T19:55:55.200 INFO:teuthology.orchestra.run.smithi101.stdout: { 2023-08-01T19:55:55.200 INFO:teuthology.orchestra.run.smithi101.stdout: "event": "throttled", 2023-08-01T19:55:55.200 INFO:teuthology.orchestra.run.smithi101.stdout: "time": "2023-08-01T19:55:55.150820+0000", 2023-08-01T19:55:55.200 INFO:teuthology.orchestra.run.smithi101.stdout: "duration": 0 2023-08-01T19:55:55.201 INFO:teuthology.orchestra.run.smithi101.stdout: }, 2023-08-01T19:55:55.201 INFO:teuthology.orchestra.run.smithi101.stdout: { 2023-08-01T19:55:55.201 INFO:teuthology.orchestra.run.smithi101.stdout: "event": "header_read", 2023-08-01T19:55:55.201 INFO:teuthology.orchestra.run.smithi101.stdout: "time": "2023-08-01T19:55:55.150820+0000", 2023-08-01T19:55:55.201 INFO:teuthology.orchestra.run.smithi101.stdout: "duration": 4294967295.9999995 2023-08-01T19:55:55.201 INFO:teuthology.orchestra.run.smithi101.stdout: }, 2023-08-01T19:55:55.201 INFO:teuthology.orchestra.run.smithi101.stdout: { 2023-08-01T19:55:55.201 INFO:teuthology.orchestra.run.smithi101.stdout: "event": "all_read", 2023-08-01T19:55:55.202 INFO:teuthology.orchestra.run.smithi101.stdout: "time": "2023-08-01T19:55:55.150824+0000", 2023-08-01T19:55:55.202 INFO:teuthology.orchestra.run.smithi101.stdout: "duration": 3.8310000000000003e-06 2023-08-01T19:55:55.202 INFO:teuthology.orchestra.run.smithi101.stdout: }, 2023-08-01T19:55:55.202 INFO:teuthology.orchestra.run.smithi101.stdout: { 2023-08-01T19:55:55.202 INFO:teuthology.orchestra.run.smithi101.stdout: "event": "dispatched", 2023-08-01T19:55:55.202 INFO:teuthology.orchestra.run.smithi101.stdout: "time": "2023-08-01T19:55:55.150830+0000", 2023-08-01T19:55:55.202 INFO:teuthology.orchestra.run.smithi101.stdout: "duration": 6.1600000000000003e-06 2023-08-01T19:55:55.202 INFO:teuthology.orchestra.run.smithi101.stdout: }, 2023-08-01T19:55:55.203 INFO:teuthology.orchestra.run.smithi101.stdout: { 2023-08-01T19:55:55.203 INFO:teuthology.orchestra.run.smithi101.stdout: "event": "queued_for_pg", 2023-08-01T19:55:55.203 INFO:teuthology.orchestra.run.smithi101.stdout: "time": "2023-08-01T19:55:55.150834+0000", 2023-08-01T19:55:55.203 INFO:teuthology.orchestra.run.smithi101.stdout: "duration": 3.6109999999999998e-06 2023-08-01T19:55:55.203 INFO:teuthology.orchestra.run.smithi101.stdout: }, 2023-08-01T19:55:55.203 INFO:teuthology.orchestra.run.smithi101.stdout: { 2023-08-01T19:55:55.203 INFO:teuthology.orchestra.run.smithi101.stdout: "event": "reached_pg", 2023-08-01T19:55:55.204 INFO:teuthology.orchestra.run.smithi101.stdout: "time": "2023-08-01T19:55:55.151355+0000", 2023-08-01T19:55:55.204 INFO:teuthology.orchestra.run.smithi101.stdout: "duration": 0.00052107900000000003 2023-08-01T19:55:55.204 INFO:teuthology.orchestra.run.smithi101.stdout: }, 2023-08-01T19:55:55.204 INFO:teuthology.orchestra.run.smithi101.stdout: { 2023-08-01T19:55:55.204 INFO:teuthology.orchestra.run.smithi101.stdout: "event": "started", 2023-08-01T19:55:55.204 INFO:teuthology.orchestra.run.smithi101.stdout: "time": "2023-08-01T19:55:55.151367+0000", 2023-08-01T19:55:55.204 INFO:teuthology.orchestra.run.smithi101.stdout: "duration": 1.1875999999999999e-05 2023-08-01T19:55:55.205 INFO:teuthology.orchestra.run.smithi101.stdout: } 2023-08-01T19:55:55.205 INFO:teuthology.orchestra.run.smithi101.stdout: ] 2023-08-01T19:55:55.205 INFO:teuthology.orchestra.run.smithi101.stdout: } 2023-08-01T19:55:55.205 INFO:teuthology.orchestra.run.smithi101.stdout: }, 2023-08-01T19:55:55.205 INFO:teuthology.orchestra.run.smithi101.stdout: { 2023-08-01T19:55:55.205 INFO:teuthology.orchestra.run.smithi101.stdout: "description": "osd_repop(client.4668.0:190560 5.3 e60/19 5:c0d9852f:::benchmark_data_smithi006_114134_object56899:head v 60'12056, mlcod=59'12052)", 2023-08-01T19:55:55.205 INFO:teuthology.orchestra.run.smithi101.stdout: "initiated_at": "2023-08-01T19:55:55.154783+0000", 2023-08-01T19:55:55.205 INFO:teuthology.orchestra.run.smithi101.stdout: "age": 0.0061600209999999999, 2023-08-01T19:55:55.206 INFO:teuthology.orchestra.run.smithi101.stdout: "duration": 0.0064220969999999999, 2023-08-01T19:55:55.206 INFO:teuthology.orchestra.run.smithi101.stdout: "type_data": { 2023-08-01T19:55:55.206 INFO:teuthology.orchestra.run.smithi101.stdout: "flag_point": "started", 2023-08-01T19:55:55.206 INFO:teuthology.orchestra.run.smithi101.stdout: "events": [ 2023-08-01T19:55:55.206 INFO:teuthology.orchestra.run.smithi101.stdout: { 2023-08-01T19:55:55.206 INFO:teuthology.orchestra.run.smithi101.stdout: "event": "initiated", 2023-08-01T19:55:55.206 INFO:teuthology.orchestra.run.smithi101.stdout: "time": "2023-08-01T19:55:55.154783+0000", 2023-08-01T19:55:55.207 INFO:teuthology.orchestra.run.smithi101.stdout: "duration": 0 2023-08-01T19:55:55.207 INFO:teuthology.orchestra.run.smithi101.stdout: }, 2023-08-01T19:55:55.207 INFO:teuthology.orchestra.run.smithi101.stdout: { 2023-08-01T19:55:55.207 INFO:teuthology.orchestra.run.smithi101.stdout: "event": "throttled", 2023-08-01T19:55:55.207 INFO:teuthology.orchestra.run.smithi101.stdout: "time": "2023-08-01T19:55:55.154783+0000", 2023-08-01T19:55:55.207 INFO:teuthology.orchestra.run.smithi101.stdout: "duration": 0 2023-08-01T19:55:55.207 INFO:teuthology.orchestra.run.smithi101.stdout: }, 2023-08-01T19:55:55.207 INFO:teuthology.orchestra.run.smithi101.stdout: { 2023-08-01T19:55:55.208 INFO:teuthology.orchestra.run.smithi101.stdout: "event": "header_read", 2023-08-01T19:55:55.208 INFO:teuthology.orchestra.run.smithi101.stdout: "time": "2023-08-01T19:55:55.154783+0000", 2023-08-01T19:55:55.208 INFO:teuthology.orchestra.run.smithi101.stdout: "duration": 4294967295.9999995 2023-08-01T19:55:55.208 INFO:teuthology.orchestra.run.smithi101.stdout: }, 2023-08-01T19:55:55.208 INFO:teuthology.orchestra.run.smithi101.stdout: { 2023-08-01T19:55:55.208 INFO:teuthology.orchestra.run.smithi101.stdout: "event": "all_read", 2023-08-01T19:55:55.209 INFO:teuthology.orchestra.run.smithi101.stdout: "time": "2023-08-01T19:55:55.154787+0000", 2023-08-01T19:55:55.209 INFO:teuthology.orchestra.run.smithi101.stdout: "duration": 4.2459999999999997e-06 2023-08-01T19:55:55.209 INFO:teuthology.orchestra.run.smithi101.stdout: }, 2023-08-01T19:55:55.209 INFO:teuthology.orchestra.run.smithi101.stdout: { 2023-08-01T19:55:55.209 INFO:teuthology.orchestra.run.smithi101.stdout: "event": "dispatched", 2023-08-01T19:55:55.209 INFO:teuthology.orchestra.run.smithi101.stdout: "time": "2023-08-01T19:55:55.154794+0000", 2023-08-01T19:55:55.210 INFO:teuthology.orchestra.run.smithi101.stdout: "duration": 7.2370000000000003e-06 2023-08-01T19:55:55.210 INFO:teuthology.orchestra.run.smithi101.stdout: }, 2023-08-01T19:55:55.210 INFO:teuthology.orchestra.run.smithi101.stdout: { 2023-08-01T19:55:55.210 INFO:teuthology.orchestra.run.smithi101.stdout: "event": "queued_for_pg", 2023-08-01T19:55:55.210 INFO:teuthology.orchestra.run.smithi101.stdout: "time": "2023-08-01T19:55:55.154797+0000", 2023-08-01T19:55:55.210 INFO:teuthology.orchestra.run.smithi101.stdout: "duration": 3.315e-06 2023-08-01T19:55:55.210 INFO:teuthology.orchestra.run.smithi101.stdout: }, 2023-08-01T19:55:55.211 INFO:teuthology.orchestra.run.smithi101.stdout: { 2023-08-01T19:55:55.211 INFO:teuthology.orchestra.run.smithi101.stdout: "event": "reached_pg", 2023-08-01T19:55:55.211 INFO:teuthology.orchestra.run.smithi101.stdout: "time": "2023-08-01T19:55:55.154831+0000", 2023-08-01T19:55:55.211 INFO:teuthology.orchestra.run.smithi101.stdout: "duration": 3.3756e-05 2023-08-01T19:55:55.212 INFO:teuthology.orchestra.run.smithi101.stdout: }, 2023-08-01T19:55:55.212 INFO:teuthology.orchestra.run.smithi101.stdout: { 2023-08-01T19:55:55.212 INFO:teuthology.orchestra.run.smithi101.stdout: "event": "started", 2023-08-01T19:55:55.212 INFO:teuthology.orchestra.run.smithi101.stdout: "time": "2023-08-01T19:55:55.154848+0000", 2023-08-01T19:55:55.212 INFO:teuthology.orchestra.run.smithi101.stdout: "duration": 1.7193999999999998e-05 2023-08-01T19:55:55.213 INFO:teuthology.orchestra.run.smithi101.stdout: } 2023-08-01T19:55:55.213 INFO:teuthology.orchestra.run.smithi101.stdout: ] 2023-08-01T19:55:55.213 INFO:teuthology.orchestra.run.smithi101.stdout: } 2023-08-01T19:55:55.213 INFO:teuthology.orchestra.run.smithi101.stdout: }, 2023-08-01T19:55:55.213 INFO:teuthology.orchestra.run.smithi101.stdout: { 2023-08-01T19:55:55.213 INFO:teuthology.orchestra.run.smithi101.stdout: "description": "osd_repop(client.4668.0:190566 5.f e60/40 5:ff723ab3:::benchmark_data_smithi006_114134_object56905:head v 60'11965, mlcod=60'11961)", 2023-08-01T19:55:55.213 INFO:teuthology.orchestra.run.smithi101.stdout: "initiated_at": "2023-08-01T19:55:55.154979+0000", 2023-08-01T19:55:55.213 INFO:teuthology.orchestra.run.smithi101.stdout: "age": 0.0059641640000000001, 2023-08-01T19:55:55.214 INFO:teuthology.orchestra.run.smithi101.stdout: "duration": 0.0062616750000000004, 2023-08-01T19:55:55.214 INFO:teuthology.orchestra.run.smithi101.stdout: "type_data": { 2023-08-01T19:55:55.214 INFO:teuthology.orchestra.run.smithi101.stdout: "flag_point": "started", 2023-08-01T19:55:55.214 INFO:teuthology.orchestra.run.smithi101.stdout: "events": [ 2023-08-01T19:55:55.214 INFO:teuthology.orchestra.run.smithi101.stdout: { 2023-08-01T19:55:55.214 INFO:teuthology.orchestra.run.smithi101.stdout: "event": "initiated", 2023-08-01T19:55:55.215 INFO:teuthology.orchestra.run.smithi101.stdout: "time": "2023-08-01T19:55:55.154979+0000", 2023-08-01T19:55:55.215 INFO:teuthology.orchestra.run.smithi101.stdout: "duration": 0 2023-08-01T19:55:55.215 INFO:teuthology.orchestra.run.smithi101.stdout: }, 2023-08-01T19:55:55.215 INFO:teuthology.orchestra.run.smithi101.stdout: { 2023-08-01T19:55:55.215 INFO:teuthology.orchestra.run.smithi101.stdout: "event": "throttled", 2023-08-01T19:55:55.215 INFO:teuthology.orchestra.run.smithi101.stdout: "time": "2023-08-01T19:55:55.154979+0000", 2023-08-01T19:55:55.215 INFO:teuthology.orchestra.run.smithi101.stdout: "duration": 0 2023-08-01T19:55:55.215 INFO:teuthology.orchestra.run.smithi101.stdout: }, 2023-08-01T19:55:55.216 INFO:teuthology.orchestra.run.smithi101.stdout: { 2023-08-01T19:55:55.216 INFO:teuthology.orchestra.run.smithi101.stdout: "event": "header_read", 2023-08-01T19:55:55.216 INFO:teuthology.orchestra.run.smithi101.stdout: "time": "2023-08-01T19:55:55.154979+0000", 2023-08-01T19:55:55.216 INFO:teuthology.orchestra.run.smithi101.stdout: "duration": 4294967295.9999995 2023-08-01T19:55:55.216 INFO:teuthology.orchestra.run.smithi101.stdout: }, 2023-08-01T19:55:55.216 INFO:teuthology.orchestra.run.smithi101.stdout: { 2023-08-01T19:55:55.216 INFO:teuthology.orchestra.run.smithi101.stdout: "event": "all_read", 2023-08-01T19:55:55.216 INFO:teuthology.orchestra.run.smithi101.stdout: "time": "2023-08-01T19:55:55.154982+0000", 2023-08-01T19:55:55.217 INFO:teuthology.orchestra.run.smithi101.stdout: "duration": 3.6710000000000001e-06 2023-08-01T19:55:55.217 INFO:teuthology.orchestra.run.smithi101.stdout: }, 2023-08-01T19:55:55.217 INFO:teuthology.orchestra.run.smithi101.stdout: { 2023-08-01T19:55:55.217 INFO:teuthology.orchestra.run.smithi101.stdout: "event": "dispatched", 2023-08-01T19:55:55.217 INFO:teuthology.orchestra.run.smithi101.stdout: "time": "2023-08-01T19:55:55.154988+0000", 2023-08-01T19:55:55.217 INFO:teuthology.orchestra.run.smithi101.stdout: "duration": 5.4419999999999997e-06 2023-08-01T19:55:55.217 INFO:teuthology.orchestra.run.smithi101.stdout: }, 2023-08-01T19:55:55.218 INFO:teuthology.orchestra.run.smithi101.stdout: { 2023-08-01T19:55:55.218 INFO:teuthology.orchestra.run.smithi101.stdout: "event": "queued_for_pg", 2023-08-01T19:55:55.218 INFO:teuthology.orchestra.run.smithi101.stdout: "time": "2023-08-01T19:55:55.154990+0000", 2023-08-01T19:55:55.218 INFO:teuthology.orchestra.run.smithi101.stdout: "duration": 2.7970000000000001e-06 2023-08-01T19:55:55.218 INFO:teuthology.orchestra.run.smithi101.stdout: }, 2023-08-01T19:55:55.218 INFO:teuthology.orchestra.run.smithi101.stdout: { 2023-08-01T19:55:55.218 INFO:teuthology.orchestra.run.smithi101.stdout: "event": "reached_pg", 2023-08-01T19:55:55.218 INFO:teuthology.orchestra.run.smithi101.stdout: "time": "2023-08-01T19:55:55.155026+0000", 2023-08-01T19:55:55.219 INFO:teuthology.orchestra.run.smithi101.stdout: "duration": 3.5119e-05 2023-08-01T19:55:55.219 INFO:teuthology.orchestra.run.smithi101.stdout: }, 2023-08-01T19:55:55.219 INFO:teuthology.orchestra.run.smithi101.stdout: { 2023-08-01T19:55:55.219 INFO:teuthology.orchestra.run.smithi101.stdout: "event": "started", 2023-08-01T19:55:55.219 INFO:teuthology.orchestra.run.smithi101.stdout: "time": "2023-08-01T19:55:55.155040+0000", 2023-08-01T19:55:55.219 INFO:teuthology.orchestra.run.smithi101.stdout: "duration": 1.4878999999999999e-05 2023-08-01T19:55:55.219 INFO:teuthology.orchestra.run.smithi101.stdout: } 2023-08-01T19:55:55.220 INFO:teuthology.orchestra.run.smithi101.stdout: ] 2023-08-01T19:55:55.220 INFO:teuthology.orchestra.run.smithi101.stdout: } 2023-08-01T19:55:55.220 INFO:teuthology.orchestra.run.smithi101.stdout: }, 2023-08-01T19:55:55.220 INFO:teuthology.orchestra.run.smithi101.stdout: { 2023-08-01T19:55:55.220 INFO:teuthology.orchestra.run.smithi101.stdout: "description": "osd_repop(client.4668.0:190565 5.d e60/19 5:bba9ba0c:::benchmark_data_smithi006_114134_object56904:head v 60'11613, mlcod=59'11610)", 2023-08-01T19:55:55.220 INFO:teuthology.orchestra.run.smithi101.stdout: "initiated_at": "2023-08-01T19:55:55.155387+0000", 2023-08-01T19:55:55.220 INFO:teuthology.orchestra.run.smithi101.stdout: "age": 0.0055563849999999996, 2023-08-01T19:55:55.221 INFO:teuthology.orchestra.run.smithi101.stdout: "duration": 0.0058919899999999997, 2023-08-01T19:55:55.221 INFO:teuthology.orchestra.run.smithi101.stdout: "type_data": { 2023-08-01T19:55:55.221 INFO:teuthology.orchestra.run.smithi101.stdout: "flag_point": "started", 2023-08-01T19:55:55.221 INFO:teuthology.orchestra.run.smithi101.stdout: "events": [ 2023-08-01T19:55:55.221 INFO:teuthology.orchestra.run.smithi101.stdout: { 2023-08-01T19:55:55.221 INFO:teuthology.orchestra.run.smithi101.stdout: "event": "initiated", 2023-08-01T19:55:55.222 INFO:teuthology.orchestra.run.smithi101.stdout: "time": "2023-08-01T19:55:55.155387+0000", 2023-08-01T19:55:55.222 INFO:teuthology.orchestra.run.smithi101.stdout: "duration": 0 2023-08-01T19:55:55.222 INFO:teuthology.orchestra.run.smithi101.stdout: }, 2023-08-01T19:55:55.222 INFO:teuthology.orchestra.run.smithi101.stdout: { 2023-08-01T19:55:55.222 INFO:teuthology.orchestra.run.smithi101.stdout: "event": "throttled", 2023-08-01T19:55:55.222 INFO:teuthology.orchestra.run.smithi101.stdout: "time": "2023-08-01T19:55:55.155387+0000", 2023-08-01T19:55:55.223 INFO:teuthology.orchestra.run.smithi101.stdout: "duration": 0 2023-08-01T19:55:55.223 INFO:teuthology.orchestra.run.smithi101.stdout: }, 2023-08-01T19:55:55.223 INFO:teuthology.orchestra.run.smithi101.stdout: { 2023-08-01T19:55:55.223 INFO:teuthology.orchestra.run.smithi101.stdout: "event": "header_read", 2023-08-01T19:55:55.223 INFO:teuthology.orchestra.run.smithi101.stdout: "time": "2023-08-01T19:55:55.155386+0000", 2023-08-01T19:55:55.223 INFO:teuthology.orchestra.run.smithi101.stdout: "duration": 4294967295.9999995 2023-08-01T19:55:55.224 INFO:teuthology.orchestra.run.smithi101.stdout: }, 2023-08-01T19:55:55.224 INFO:teuthology.orchestra.run.smithi101.stdout: { 2023-08-01T19:55:55.224 INFO:teuthology.orchestra.run.smithi101.stdout: "event": "all_read", 2023-08-01T19:55:55.225 INFO:teuthology.orchestra.run.smithi101.stdout: "time": "2023-08-01T19:55:55.155390+0000", 2023-08-01T19:55:55.225 INFO:teuthology.orchestra.run.smithi101.stdout: "duration": 3.3550000000000001e-06 2023-08-01T19:55:55.225 INFO:teuthology.orchestra.run.smithi101.stdout: }, 2023-08-01T19:55:55.225 INFO:teuthology.orchestra.run.smithi101.stdout: { 2023-08-01T19:55:55.226 INFO:teuthology.orchestra.run.smithi101.stdout: "event": "dispatched", 2023-08-01T19:55:55.226 INFO:teuthology.orchestra.run.smithi101.stdout: "time": "2023-08-01T19:55:55.155396+0000", 2023-08-01T19:55:55.226 INFO:teuthology.orchestra.run.smithi101.stdout: "duration": 6.4370000000000004e-06 2023-08-01T19:55:55.226 INFO:teuthology.orchestra.run.smithi101.stdout: }, 2023-08-01T19:55:55.226 INFO:teuthology.orchestra.run.smithi101.stdout: { 2023-08-01T19:55:55.226 INFO:teuthology.orchestra.run.smithi101.stdout: "event": "queued_for_pg", 2023-08-01T19:55:55.227 INFO:teuthology.orchestra.run.smithi101.stdout: "time": "2023-08-01T19:55:55.155399+0000", 2023-08-01T19:55:55.227 INFO:teuthology.orchestra.run.smithi101.stdout: "duration": 3.0599999999999999e-06 2023-08-01T19:55:55.227 INFO:teuthology.orchestra.run.smithi101.stdout: }, 2023-08-01T19:55:55.227 INFO:teuthology.orchestra.run.smithi101.stdout: { 2023-08-01T19:55:55.227 INFO:teuthology.orchestra.run.smithi101.stdout: "event": "reached_pg", 2023-08-01T19:55:55.228 INFO:teuthology.orchestra.run.smithi101.stdout: "time": "2023-08-01T19:55:55.155428+0000", 2023-08-01T19:55:55.228 INFO:teuthology.orchestra.run.smithi101.stdout: "duration": 2.8872000000000001e-05 2023-08-01T19:55:55.228 INFO:teuthology.orchestra.run.smithi101.stdout: }, 2023-08-01T19:55:55.228 INFO:teuthology.orchestra.run.smithi101.stdout: { 2023-08-01T19:55:55.228 INFO:teuthology.orchestra.run.smithi101.stdout: "event": "started", 2023-08-01T19:55:55.228 INFO:teuthology.orchestra.run.smithi101.stdout: "time": "2023-08-01T19:55:55.155444+0000", 2023-08-01T19:55:55.229 INFO:teuthology.orchestra.run.smithi101.stdout: "duration": 1.6186000000000001e-05 2023-08-01T19:55:55.229 INFO:teuthology.orchestra.run.smithi101.stdout: } 2023-08-01T19:55:55.229 INFO:teuthology.orchestra.run.smithi101.stdout: ] 2023-08-01T19:55:55.229 INFO:teuthology.orchestra.run.smithi101.stdout: } 2023-08-01T19:55:55.229 INFO:teuthology.orchestra.run.smithi101.stdout: } 2023-08-01T19:55:55.229 INFO:teuthology.orchestra.run.smithi101.stdout: ], 2023-08-01T19:55:55.229 INFO:teuthology.orchestra.run.smithi101.stdout: "num_ops": 9 2023-08-01T19:55:55.230 INFO:teuthology.orchestra.run.smithi101.stdout:} 2023-08-01T19:55:55.231 DEBUG:teuthology.orchestra.run.smithi101:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 30 ceph --cluster ceph --admin-daemon /var/run/ceph/ceph-osd.1.asok dump_blocked_ops 2023-08-01T19:55:55.232 INFO:tasks.ceph.osd.0.smithi008.stderr:2023-08-01T19:55:55.229+0000 7f16a58f4700 -1 received signal: Hangup from /usr/bin/python3 /bin/daemon-helper kill ceph-osd -f --cluster ceph -i 0 (PID: 111179) UID: 0 2023-08-01T19:55:55.332 INFO:tasks.ceph.osd.2.smithi155.stderr:2023-08-01T19:55:55.330+0000 7faa5c6ac700 -1 received signal: Hangup from /usr/bin/python3 /bin/daemon-helper kill ceph-osd -f --cluster ceph -i 2 (PID: 111337) UID: 0 2023-08-01T19:55:55.345 DEBUG:teuthology.orchestra.run.smithi006:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 120 ceph --cluster ceph -- tell 'osd.*' injectargs --osd_enable_op_tracker=false 2023-08-01T19:55:55.390 INFO:teuthology.orchestra.run.smithi101.stdout:{ 2023-08-01T19:55:55.390 INFO:teuthology.orchestra.run.smithi101.stdout: "ops": [], 2023-08-01T19:55:55.390 INFO:teuthology.orchestra.run.smithi101.stdout: "complaint_time": 30, 2023-08-01T19:55:55.390 INFO:teuthology.orchestra.run.smithi101.stdout: "num_blocked_ops": 0 2023-08-01T19:55:55.390 INFO:teuthology.orchestra.run.smithi101.stdout:} 2023-08-01T19:55:55.402 DEBUG:teuthology.orchestra.run.smithi101:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 30 ceph --cluster ceph --admin-daemon /var/run/ceph/ceph-osd.1.asok dump_historic_ops 2023-08-01T19:55:55.432 INFO:tasks.ceph.osd.0.smithi008.stderr:2023-08-01T19:55:55.430+0000 7f16a58f4700 -1 received signal: Hangup from /usr/bin/python3 /bin/daemon-helper kill ceph-osd -f --cluster ceph -i 0 (PID: 111179) UID: 0 2023-08-01T19:55:55.491 INFO:teuthology.orchestra.run.smithi006.stdout:osd.0: {} 2023-08-01T19:55:55.511 INFO:teuthology.orchestra.run.smithi006.stdout:osd.1: {} 2023-08-01T19:55:55.529 INFO:teuthology.orchestra.run.smithi006.stdout:osd.2: {} 2023-08-01T19:55:55.530 INFO:teuthology.orchestra.run.smithi006.stderr:osd.0: osd_enable_op_tracker = 'false' 2023-08-01T19:55:55.530 INFO:teuthology.orchestra.run.smithi006.stderr:osd.1: osd_enable_op_tracker = 'false' 2023-08-01T19:55:55.531 INFO:teuthology.orchestra.run.smithi006.stderr:osd.2: osd_enable_op_tracker = 'false' 2023-08-01T19:55:55.532 INFO:tasks.ceph.osd.2.smithi155.stderr:2023-08-01T19:55:55.531+0000 7faa5c6ac700 -1 received signal: Hangup from /usr/bin/python3 /bin/daemon-helper kill ceph-osd -f --cluster ceph -i 2 (PID: 111337) UID: 0 2023-08-01T19:55:55.575 INFO:teuthology.orchestra.run.smithi101.stdout:ERROR: (22) Invalid argument 2023-08-01T19:55:55.575 INFO:teuthology.orchestra.run.smithi101.stdout:op_tracker tracking is not enabled now, so no ops are tracked currently, even those get stuck. Please enable "osd_enable_op_tracker", and the tracker will start to track new ops received afterwards. 2023-08-01T19:55:55.590 DEBUG:teuthology.orchestra.run.smithi008:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 30 ceph --cluster ceph --admin-daemon /var/run/ceph/ceph-osd.0.asok dump_ops_in_flight 2023-08-01T19:55:55.639 INFO:tasks.ceph.osd.0.smithi008.stderr:2023-08-01T19:55:55.635+0000 7f16a58f4700 -1 received signal: Hangup from /usr/bin/python3 /bin/daemon-helper kill ceph-osd -f --cluster ceph -i 0 (PID: 111179) UID: 0 2023-08-01T19:55:55.736 INFO:tasks.ceph.osd.0.smithi008.stderr:2023-08-01T19:55:55.734+0000 7f16a58f4700 -1 received signal: Hangup from /usr/bin/python3 /bin/daemon-helper kill ceph-osd -f --cluster ceph -i 0 (PID: 111179) UID: 0 2023-08-01T19:55:55.767 INFO:teuthology.orchestra.run.smithi008.stdout:ERROR: (22) Invalid argument 2023-08-01T19:55:55.768 INFO:teuthology.orchestra.run.smithi008.stdout:op_tracker tracking is not enabled now, so no ops are tracked currently, even those get stuck. Please enable "osd_enable_op_tracker", and the tracker will start to track new ops received afterwards. 2023-08-01T19:55:55.783 DEBUG:teuthology.orchestra.run.smithi008:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 30 ceph --cluster ceph --admin-daemon /var/run/ceph/ceph-osd.0.asok dump_blocked_ops 2023-08-01T19:55:55.835 INFO:tasks.ceph.osd.2.smithi155.stderr:2023-08-01T19:55:55.834+0000 7faa5c6ac700 -1 received signal: Hangup from /usr/bin/python3 /bin/daemon-helper kill ceph-osd -f --cluster ceph -i 2 (PID: 111337) UID: 0 2023-08-01T19:55:55.936 INFO:tasks.ceph.osd.2.smithi155.stderr:2023-08-01T19:55:55.934+0000 7faa5c6ac700 -1 received signal: Hangup from /usr/bin/python3 /bin/daemon-helper kill ceph-osd -f --cluster ceph -i 2 (PID: 111337) UID: 0 2023-08-01T19:55:56.005 INFO:teuthology.orchestra.run.smithi008.stdout:ERROR: (22) Invalid argument 2023-08-01T19:55:56.005 INFO:teuthology.orchestra.run.smithi008.stdout:op_tracker tracking is not enabled now, so no ops are tracked currently, even those get stuck. Please enable "osd_enable_op_tracker", and the tracker will start to track new ops received afterwards. 2023-08-01T19:55:56.018 DEBUG:teuthology.orchestra.run.smithi008:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 30 ceph --cluster ceph --admin-daemon /var/run/ceph/ceph-osd.0.asok dump_historic_ops 2023-08-01T19:55:56.061 INFO:tasks.ceph.osd.0.smithi008.stderr:2023-08-01T19:55:56.060+0000 7f16a58f4700 -1 received signal: Hangup from /usr/bin/python3 /bin/daemon-helper kill ceph-osd -f --cluster ceph -i 0 (PID: 111179) UID: 0 2023-08-01T19:55:56.138 INFO:tasks.ceph.osd.2.smithi155.stderr:2023-08-01T19:55:56.136+0000 7faa5c6ac700 -1 received signal: Hangup from /usr/bin/python3 /bin/daemon-helper kill ceph-osd -f --cluster ceph -i 2 (PID: 111337) UID: 0 2023-08-01T19:55:56.202 INFO:teuthology.orchestra.run.smithi008.stdout:ERROR: (22) Invalid argument 2023-08-01T19:55:56.202 INFO:teuthology.orchestra.run.smithi008.stdout:op_tracker tracking is not enabled now, so no ops are tracked currently, even those get stuck. Please enable "osd_enable_op_tracker", and the tracker will start to track new ops received afterwards. 2023-08-01T19:55:56.214 DEBUG:teuthology.orchestra.run.smithi155:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 30 ceph --cluster ceph --admin-daemon /var/run/ceph/ceph-osd.2.asok dump_ops_in_flight 2023-08-01T19:55:56.256 INFO:tasks.ceph.osd.0.smithi008.stderr:2023-08-01T19:55:56.254+0000 7f16a58f4700 -1 received signal: Hangup from /usr/bin/python3 /bin/daemon-helper kill ceph-osd -f --cluster ceph -i 0 (PID: 111179) UID: 0 2023-08-01T19:55:56.339 INFO:tasks.ceph.osd.0.smithi008.stderr:2023-08-01T19:55:56.338+0000 7f16a58f4700 -1 received signal: Hangup from /usr/bin/python3 /bin/daemon-helper kill ceph-osd -f --cluster ceph -i 0 (PID: 111179) UID: 0 2023-08-01T19:55:56.400 INFO:teuthology.orchestra.run.smithi155.stdout:ERROR: (22) Invalid argument 2023-08-01T19:55:56.400 INFO:teuthology.orchestra.run.smithi155.stdout:op_tracker tracking is not enabled now, so no ops are tracked currently, even those get stuck. Please enable "osd_enable_op_tracker", and the tracker will start to track new ops received afterwards. 2023-08-01T19:55:56.410 DEBUG:teuthology.orchestra.run.smithi155:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 30 ceph --cluster ceph --admin-daemon /var/run/ceph/ceph-osd.2.asok dump_blocked_ops 2023-08-01T19:55:56.440 INFO:tasks.ceph.osd.0.smithi008.stderr:2023-08-01T19:55:56.439+0000 7f16a58f4700 -1 received signal: Hangup from /usr/bin/python3 /bin/daemon-helper kill ceph-osd -f --cluster ceph -i 0 (PID: 111179) UID: 0 2023-08-01T19:55:56.541 INFO:tasks.ceph.osd.0.smithi008.stderr:2023-08-01T19:55:56.539+0000 7f16a58f4700 -1 received signal: Hangup from /usr/bin/python3 /bin/daemon-helper kill ceph-osd -f --cluster ceph -i 0 (PID: 111179) UID: 0 2023-08-01T19:55:56.570 INFO:teuthology.orchestra.run.smithi155.stdout:ERROR: (22) Invalid argument 2023-08-01T19:55:56.570 INFO:teuthology.orchestra.run.smithi155.stdout:op_tracker tracking is not enabled now, so no ops are tracked currently, even those get stuck. Please enable "osd_enable_op_tracker", and the tracker will start to track new ops received afterwards. 2023-08-01T19:55:56.583 DEBUG:teuthology.orchestra.run.smithi155:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 30 ceph --cluster ceph --admin-daemon /var/run/ceph/ceph-osd.2.asok dump_historic_ops 2023-08-01T19:55:56.642 INFO:tasks.ceph.osd.2.smithi155.stderr:2023-08-01T19:55:56.640+0000 7faa5c6ac700 -1 received signal: Hangup from /usr/bin/python3 /bin/daemon-helper kill ceph-osd -f --cluster ceph -i 2 (PID: 111337) UID: 0 2023-08-01T19:55:56.738 INFO:teuthology.orchestra.run.smithi155.stdout:ERROR: (22) Invalid argument 2023-08-01T19:55:56.738 INFO:teuthology.orchestra.run.smithi155.stdout:op_tracker tracking is not enabled now, so no ops are tracked currently, even those get stuck. Please enable "osd_enable_op_tracker", and the tracker will start to track new ops received afterwards. 2023-08-01T19:55:56.742 INFO:tasks.ceph.osd.0.smithi008.stderr:2023-08-01T19:55:56.740+0000 7f16a58f4700 -1 received signal: Hangup from /usr/bin/python3 /bin/daemon-helper kill ceph-osd -f --cluster ceph -i 0 (PID: 111179) UID: 0 2023-08-01T19:55:56.751 DEBUG:teuthology.orchestra.run.smithi008:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 30 ceph --cluster ceph --admin-daemon /var/run/ceph/ceph-osd.0.asok dump_ops_in_flight 2023-08-01T19:55:56.845 INFO:tasks.ceph.osd.0.smithi008.stderr:2023-08-01T19:55:56.843+0000 7f16a58f4700 -1 received signal: Hangup from /usr/bin/python3 /bin/daemon-helper kill ceph-osd -f --cluster ceph -i 0 (PID: 111179) UID: 0 2023-08-01T19:55:56.929 INFO:teuthology.orchestra.run.smithi008.stdout:ERROR: (22) Invalid argument 2023-08-01T19:55:56.929 INFO:teuthology.orchestra.run.smithi008.stdout:op_tracker tracking is not enabled now, so no ops are tracked currently, even those get stuck. Please enable "osd_enable_op_tracker", and the tracker will start to track new ops received afterwards. 2023-08-01T19:55:56.943 DEBUG:teuthology.orchestra.run.smithi008:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 30 ceph --cluster ceph --admin-daemon /var/run/ceph/ceph-osd.0.asok dump_blocked_ops 2023-08-01T19:55:56.983 INFO:tasks.ceph.osd.0.smithi008.stderr:2023-08-01T19:55:56.982+0000 7f16a58f4700 -1 received signal: Hangup from /usr/bin/python3 /bin/daemon-helper kill ceph-osd -f --cluster ceph -i 0 (PID: 111179) UID: 0 2023-08-01T19:55:57.045 INFO:tasks.ceph.osd.2.smithi155.stderr:2023-08-01T19:55:57.043+0000 7faa5c6ac700 -1 received signal: Hangup from /usr/bin/python3 /bin/daemon-helper kill ceph-osd -f --cluster ceph -i 2 (PID: 111337) UID: 0 2023-08-01T19:55:57.146 INFO:tasks.ceph.osd.0.smithi008.stderr:2023-08-01T19:55:57.144+0000 7f16a58f4700 -1 received signal: Hangup from /usr/bin/python3 /bin/daemon-helper kill ceph-osd -f --cluster ceph -i 0 (PID: 111179) UID: 0 2023-08-01T19:55:57.150 DEBUG:teuthology.orchestra.run.smithi006:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 120 ceph --cluster ceph osd set noscrub 2023-08-01T19:55:57.172 INFO:teuthology.orchestra.run.smithi008.stdout:ERROR: (22) Invalid argument 2023-08-01T19:55:57.172 INFO:teuthology.orchestra.run.smithi008.stdout:op_tracker tracking is not enabled now, so no ops are tracked currently, even those get stuck. Please enable "osd_enable_op_tracker", and the tracker will start to track new ops received afterwards. 2023-08-01T19:55:57.188 DEBUG:teuthology.orchestra.run.smithi008:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 30 ceph --cluster ceph --admin-daemon /var/run/ceph/ceph-osd.0.asok dump_historic_ops 2023-08-01T19:55:57.246 INFO:tasks.ceph.osd.2.smithi155.stderr:2023-08-01T19:55:57.245+0000 7faa5c6ac700 -1 received signal: Hangup from /usr/bin/python3 /bin/daemon-helper kill ceph-osd -f --cluster ceph -i 2 (PID: 111337) UID: 0 2023-08-01T19:55:57.347 INFO:tasks.ceph.osd.2.smithi155.stderr:2023-08-01T19:55:57.346+0000 7faa5c6ac700 -1 received signal: Hangup from /usr/bin/python3 /bin/daemon-helper kill ceph-osd -f --cluster ceph -i 2 (PID: 111337) UID: 0 2023-08-01T19:55:57.405 INFO:teuthology.orchestra.run.smithi008.stdout:ERROR: (22) Invalid argument 2023-08-01T19:55:57.405 INFO:teuthology.orchestra.run.smithi008.stdout:op_tracker tracking is not enabled now, so no ops are tracked currently, even those get stuck. Please enable "osd_enable_op_tracker", and the tracker will start to track new ops received afterwards. 2023-08-01T19:55:57.421 DEBUG:teuthology.orchestra.run.smithi155:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 30 ceph --cluster ceph --admin-daemon /var/run/ceph/ceph-osd.2.asok dump_ops_in_flight 2023-08-01T19:55:57.448 INFO:tasks.ceph.osd.0.smithi008.stderr:2023-08-01T19:55:57.446+0000 7f16a58f4700 -1 received signal: Hangup from /usr/bin/python3 /bin/daemon-helper kill ceph-osd -f --cluster ceph -i 0 (PID: 111179) UID: 0 2023-08-01T19:55:57.542 DEBUG:teuthology.orchestra.run.smithi006:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 120 ceph --cluster ceph -- tell 'osd.*' injectargs --osd_enable_op_tracker=true 2023-08-01T19:55:57.548 INFO:tasks.ceph.osd.2.smithi155.stderr:2023-08-01T19:55:57.546+0000 7faa5c6ac700 -1 received signal: Hangup from /usr/bin/python3 /bin/daemon-helper kill ceph-osd -f --cluster ceph -i 2 (PID: 111337) UID: 0 2023-08-01T19:55:57.553 INFO:teuthology.orchestra.run.smithi006.stderr:noscrub is set 2023-08-01T19:55:57.579 INFO:teuthology.orchestra.run.smithi155.stdout:ERROR: (22) Invalid argument 2023-08-01T19:55:57.579 INFO:teuthology.orchestra.run.smithi155.stdout:op_tracker tracking is not enabled now, so no ops are tracked currently, even those get stuck. Please enable "osd_enable_op_tracker", and the tracker will start to track new ops received afterwards. 2023-08-01T19:55:57.594 DEBUG:teuthology.orchestra.run.smithi155:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 30 ceph --cluster ceph --admin-daemon /var/run/ceph/ceph-osd.2.asok dump_blocked_ops 2023-08-01T19:55:57.677 INFO:tasks.ceph.osd.2.smithi155.stderr:2023-08-01T19:55:57.676+0000 7faa5c6ac700 -1 received signal: Hangup from /usr/bin/python3 /bin/daemon-helper kill ceph-osd -f --cluster ceph -i 2 (PID: 111337) UID: 0 2023-08-01T19:55:57.692 INFO:teuthology.orchestra.run.smithi006.stdout:osd.0: {} 2023-08-01T19:55:57.711 INFO:teuthology.orchestra.run.smithi006.stdout:osd.1: {} 2023-08-01T19:55:57.731 INFO:teuthology.orchestra.run.smithi006.stdout:osd.2: {} 2023-08-01T19:55:57.732 INFO:teuthology.orchestra.run.smithi006.stderr:osd.0: osd_enable_op_tracker = 'true' 2023-08-01T19:55:57.732 INFO:teuthology.orchestra.run.smithi006.stderr:osd.1: osd_enable_op_tracker = 'true' 2023-08-01T19:55:57.732 INFO:teuthology.orchestra.run.smithi006.stderr:osd.2: osd_enable_op_tracker = 'true' 2023-08-01T19:55:57.749 INFO:tasks.ceph.osd.2.smithi155.stderr:2023-08-01T19:55:57.748+0000 7faa5c6ac700 -1 received signal: Hangup from /usr/bin/python3 /bin/daemon-helper kill ceph-osd -f --cluster ceph -i 2 (PID: 111337) UID: 0 2023-08-01T19:55:57.799 INFO:teuthology.orchestra.run.smithi155.stdout:{ 2023-08-01T19:55:57.799 INFO:teuthology.orchestra.run.smithi155.stdout: "ops": [], 2023-08-01T19:55:57.800 INFO:teuthology.orchestra.run.smithi155.stdout: "complaint_time": 30, 2023-08-01T19:55:57.800 INFO:teuthology.orchestra.run.smithi155.stdout: "num_blocked_ops": 0 2023-08-01T19:55:57.800 INFO:teuthology.orchestra.run.smithi155.stdout:} 2023-08-01T19:55:57.813 DEBUG:teuthology.orchestra.run.smithi155:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 30 ceph --cluster ceph --admin-daemon /var/run/ceph/ceph-osd.2.asok dump_historic_ops 2023-08-01T19:55:57.853 INFO:tasks.ceph.osd.2.smithi155.stderr:2023-08-01T19:55:57.852+0000 7faa5c6ac700 -1 received signal: Hangup from /usr/bin/python3 /bin/daemon-helper kill ceph-osd -f --cluster ceph -i 2 (PID: 111337) UID: 0 2023-08-01T19:55:57.951 INFO:tasks.ceph.osd.2.smithi155.stderr:2023-08-01T19:55:57.949+0000 7faa5c6ac700 -1 received signal: Hangup from /usr/bin/python3 /bin/daemon-helper kill ceph-osd -f --cluster ceph -i 2 (PID: 111337) UID: 0 2023-08-01T19:55:58.021 INFO:teuthology.orchestra.run.smithi155.stdout:{ 2023-08-01T19:55:58.021 INFO:teuthology.orchestra.run.smithi155.stdout: "size": 20, 2023-08-01T19:55:58.021 INFO:teuthology.orchestra.run.smithi155.stdout: "duration": 600, 2023-08-01T19:55:58.021 INFO:teuthology.orchestra.run.smithi155.stdout: "ops": [ 2023-08-01T19:55:58.021 INFO:teuthology.orchestra.run.smithi155.stdout: { 2023-08-01T19:55:58.021 INFO:teuthology.orchestra.run.smithi155.stdout: "description": "osd_op(client.4668.0:73454 5.8 5:15596b2f:::benchmark_data_smithi006_114134_object73453:head [set-alloc-hint object_size 65536 write_size 65536,write 0~65536] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e31)", 2023-08-01T19:55:58.022 INFO:teuthology.orchestra.run.smithi155.stdout: "initiated_at": "2023-08-01T19:54:51.460020+0000", 2023-08-01T19:55:58.022 INFO:teuthology.orchestra.run.smithi155.stdout: "age": 66.558013983999999, 2023-08-01T19:55:58.022 INFO:teuthology.orchestra.run.smithi155.stdout: "duration": 0.022889436999999999, 2023-08-01T19:55:58.022 INFO:teuthology.orchestra.run.smithi155.stdout: "type_data": { 2023-08-01T19:55:58.022 INFO:teuthology.orchestra.run.smithi155.stdout: "flag_point": "commit sent; apply or cleanup", 2023-08-01T19:55:58.022 INFO:teuthology.orchestra.run.smithi155.stdout: "client_info": { 2023-08-01T19:55:58.022 INFO:teuthology.orchestra.run.smithi155.stdout: "client": "client.4668", 2023-08-01T19:55:58.023 INFO:teuthology.orchestra.run.smithi155.stdout: "client_addr": "172.21.15.6:0/1709472247", 2023-08-01T19:55:58.023 INFO:teuthology.orchestra.run.smithi155.stdout: "tid": 73454 2023-08-01T19:55:58.023 INFO:teuthology.orchestra.run.smithi155.stdout: }, 2023-08-01T19:55:58.023 INFO:teuthology.orchestra.run.smithi155.stdout: "events": [ 2023-08-01T19:55:58.023 INFO:teuthology.orchestra.run.smithi155.stdout: { 2023-08-01T19:55:58.023 INFO:teuthology.orchestra.run.smithi155.stdout: "event": "initiated", 2023-08-01T19:55:58.023 INFO:teuthology.orchestra.run.smithi155.stdout: "time": "2023-08-01T19:54:51.460020+0000", 2023-08-01T19:55:58.024 INFO:teuthology.orchestra.run.smithi155.stdout: "duration": 0 2023-08-01T19:55:58.024 INFO:teuthology.orchestra.run.smithi155.stdout: }, 2023-08-01T19:55:58.024 INFO:teuthology.orchestra.run.smithi155.stdout: { 2023-08-01T19:55:58.024 INFO:teuthology.orchestra.run.smithi155.stdout: "event": "throttled", 2023-08-01T19:55:58.024 INFO:teuthology.orchestra.run.smithi155.stdout: "time": "2023-08-01T19:54:51.460020+0000", 2023-08-01T19:55:58.024 INFO:teuthology.orchestra.run.smithi155.stdout: "duration": 0 2023-08-01T19:55:58.024 INFO:teuthology.orchestra.run.smithi155.stdout: }, 2023-08-01T19:55:58.024 INFO:teuthology.orchestra.run.smithi155.stdout: { 2023-08-01T19:55:58.025 INFO:teuthology.orchestra.run.smithi155.stdout: "event": "header_read", 2023-08-01T19:55:58.025 INFO:teuthology.orchestra.run.smithi155.stdout: "time": "2023-08-01T19:54:51.460019+0000", 2023-08-01T19:55:58.025 INFO:teuthology.orchestra.run.smithi155.stdout: "duration": 4294967295.9999995 2023-08-01T19:55:58.025 INFO:teuthology.orchestra.run.smithi155.stdout: }, 2023-08-01T19:55:58.025 INFO:teuthology.orchestra.run.smithi155.stdout: { 2023-08-01T19:55:58.025 INFO:teuthology.orchestra.run.smithi155.stdout: "event": "all_read", 2023-08-01T19:55:58.025 INFO:teuthology.orchestra.run.smithi155.stdout: "time": "2023-08-01T19:54:51.460051+0000", 2023-08-01T19:55:58.025 INFO:teuthology.orchestra.run.smithi155.stdout: "duration": 3.1736000000000002e-05 2023-08-01T19:55:58.026 INFO:teuthology.orchestra.run.smithi155.stdout: }, 2023-08-01T19:55:58.026 INFO:teuthology.orchestra.run.smithi155.stdout: { 2023-08-01T19:55:58.026 INFO:teuthology.orchestra.run.smithi155.stdout: "event": "dispatched", 2023-08-01T19:55:58.026 INFO:teuthology.orchestra.run.smithi155.stdout: "time": "2023-08-01T19:54:51.460058+0000", 2023-08-01T19:55:58.026 INFO:teuthology.orchestra.run.smithi155.stdout: "duration": 7.3869999999999997e-06 2023-08-01T19:55:58.026 INFO:teuthology.orchestra.run.smithi155.stdout: }, 2023-08-01T19:55:58.026 INFO:teuthology.orchestra.run.smithi155.stdout: { 2023-08-01T19:55:58.027 INFO:teuthology.orchestra.run.smithi155.stdout: "event": "queued_for_pg", 2023-08-01T19:55:58.027 INFO:teuthology.orchestra.run.smithi155.stdout: "time": "2023-08-01T19:54:51.460062+0000", 2023-08-01T19:55:58.027 INFO:teuthology.orchestra.run.smithi155.stdout: "duration": 4.352e-06 2023-08-01T19:55:58.027 INFO:teuthology.orchestra.run.smithi155.stdout: }, 2023-08-01T19:55:58.027 INFO:teuthology.orchestra.run.smithi155.stdout: { 2023-08-01T19:55:58.027 INFO:teuthology.orchestra.run.smithi155.stdout: "event": "reached_pg", 2023-08-01T19:55:58.027 INFO:teuthology.orchestra.run.smithi155.stdout: "time": "2023-08-01T19:54:51.460101+0000", 2023-08-01T19:55:58.027 INFO:teuthology.orchestra.run.smithi155.stdout: "duration": 3.8705000000000003e-05 2023-08-01T19:55:58.028 INFO:teuthology.orchestra.run.smithi155.stdout: }, 2023-08-01T19:55:58.028 INFO:teuthology.orchestra.run.smithi155.stdout: { 2023-08-01T19:55:58.028 INFO:teuthology.orchestra.run.smithi155.stdout: "event": "started", 2023-08-01T19:55:58.028 INFO:teuthology.orchestra.run.smithi155.stdout: "time": "2023-08-01T19:54:51.460236+0000", 2023-08-01T19:55:58.028 INFO:teuthology.orchestra.run.smithi155.stdout: "duration": 0.00013463599999999999 2023-08-01T19:55:58.028 INFO:teuthology.orchestra.run.smithi155.stdout: }, 2023-08-01T19:55:58.028 INFO:teuthology.orchestra.run.smithi155.stdout: { 2023-08-01T19:55:58.028 INFO:teuthology.orchestra.run.smithi155.stdout: "event": "waiting for subops from 0", 2023-08-01T19:55:58.029 INFO:teuthology.orchestra.run.smithi155.stdout: "time": "2023-08-01T19:54:51.460391+0000", 2023-08-01T19:55:58.029 INFO:teuthology.orchestra.run.smithi155.stdout: "duration": 0.00015525000000000001 2023-08-01T19:55:58.029 INFO:teuthology.orchestra.run.smithi155.stdout: }, 2023-08-01T19:55:58.029 INFO:teuthology.orchestra.run.smithi155.stdout: { 2023-08-01T19:55:58.029 INFO:teuthology.orchestra.run.smithi155.stdout: "event": "sub_op_commit_rec", 2023-08-01T19:55:58.029 INFO:teuthology.orchestra.run.smithi155.stdout: "time": "2023-08-01T19:54:51.468393+0000", 2023-08-01T19:55:58.029 INFO:teuthology.orchestra.run.smithi155.stdout: "duration": 0.00800208 2023-08-01T19:55:58.030 INFO:teuthology.orchestra.run.smithi155.stdout: }, 2023-08-01T19:55:58.030 INFO:teuthology.orchestra.run.smithi155.stdout: { 2023-08-01T19:55:58.030 INFO:teuthology.orchestra.run.smithi155.stdout: "event": "op_commit", 2023-08-01T19:55:58.030 INFO:teuthology.orchestra.run.smithi155.stdout: "time": "2023-08-01T19:54:51.482815+0000", 2023-08-01T19:55:58.030 INFO:teuthology.orchestra.run.smithi155.stdout: "duration": 0.01442148 2023-08-01T19:55:58.030 INFO:teuthology.orchestra.run.smithi155.stdout: }, 2023-08-01T19:55:58.030 INFO:teuthology.orchestra.run.smithi155.stdout: { 2023-08-01T19:55:58.030 INFO:teuthology.orchestra.run.smithi155.stdout: "event": "commit_sent", 2023-08-01T19:55:58.031 INFO:teuthology.orchestra.run.smithi155.stdout: "time": "2023-08-01T19:54:51.482866+0000", 2023-08-01T19:55:58.031 INFO:teuthology.orchestra.run.smithi155.stdout: "duration": 5.1842999999999998e-05 2023-08-01T19:55:58.031 INFO:teuthology.orchestra.run.smithi155.stdout: }, 2023-08-01T19:55:58.031 INFO:teuthology.orchestra.run.smithi155.stdout: { 2023-08-01T19:55:58.031 INFO:teuthology.orchestra.run.smithi155.stdout: "event": "done", 2023-08-01T19:55:58.031 INFO:teuthology.orchestra.run.smithi155.stdout: "time": "2023-08-01T19:54:51.482909+0000", 2023-08-01T19:55:58.031 INFO:teuthology.orchestra.run.smithi155.stdout: "duration": 4.2663000000000001e-05 2023-08-01T19:55:58.031 INFO:teuthology.orchestra.run.smithi155.stdout: } 2023-08-01T19:55:58.032 INFO:teuthology.orchestra.run.smithi155.stdout: ] 2023-08-01T19:55:58.032 INFO:teuthology.orchestra.run.smithi155.stdout: } 2023-08-01T19:55:58.032 INFO:teuthology.orchestra.run.smithi155.stdout: }, 2023-08-01T19:55:58.032 INFO:teuthology.orchestra.run.smithi155.stdout: { 2023-08-01T19:55:58.032 INFO:teuthology.orchestra.run.smithi155.stdout: "description": "osd_op(client.4668.0:73455 5.b 5:de51121e:::benchmark_data_smithi006_114134_object73454:head [set-alloc-hint object_size 65536 write_size 65536,write 0~65536] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e31)", 2023-08-01T19:55:58.032 INFO:teuthology.orchestra.run.smithi155.stdout: "initiated_at": "2023-08-01T19:54:51.460078+0000", 2023-08-01T19:55:58.032 INFO:teuthology.orchestra.run.smithi155.stdout: "age": 66.557956009999998, 2023-08-01T19:55:58.032 INFO:teuthology.orchestra.run.smithi155.stdout: "duration": 0.022689121999999999, 2023-08-01T19:55:58.033 INFO:teuthology.orchestra.run.smithi155.stdout: "type_data": { 2023-08-01T19:55:58.033 INFO:teuthology.orchestra.run.smithi155.stdout: "flag_point": "commit sent; apply or cleanup", 2023-08-01T19:55:58.033 INFO:teuthology.orchestra.run.smithi155.stdout: "client_info": { 2023-08-01T19:55:58.033 INFO:teuthology.orchestra.run.smithi155.stdout: "client": "client.4668", 2023-08-01T19:55:58.033 INFO:teuthology.orchestra.run.smithi155.stdout: "client_addr": "172.21.15.6:0/1709472247", 2023-08-01T19:55:58.033 INFO:teuthology.orchestra.run.smithi155.stdout: "tid": 73455 2023-08-01T19:55:58.033 INFO:teuthology.orchestra.run.smithi155.stdout: }, 2023-08-01T19:55:58.034 INFO:teuthology.orchestra.run.smithi155.stdout: "events": [ 2023-08-01T19:55:58.034 INFO:teuthology.orchestra.run.smithi155.stdout: { 2023-08-01T19:55:58.034 INFO:teuthology.orchestra.run.smithi155.stdout: "event": "initiated", 2023-08-01T19:55:58.034 INFO:teuthology.orchestra.run.smithi155.stdout: "time": "2023-08-01T19:54:51.460078+0000", 2023-08-01T19:55:58.034 INFO:teuthology.orchestra.run.smithi155.stdout: "duration": 0 2023-08-01T19:55:58.034 INFO:teuthology.orchestra.run.smithi155.stdout: }, 2023-08-01T19:55:58.034 INFO:teuthology.orchestra.run.smithi155.stdout: { 2023-08-01T19:55:58.034 INFO:teuthology.orchestra.run.smithi155.stdout: "event": "throttled", 2023-08-01T19:55:58.035 INFO:teuthology.orchestra.run.smithi155.stdout: "time": "2023-08-01T19:54:51.460078+0000", 2023-08-01T19:55:58.035 INFO:teuthology.orchestra.run.smithi155.stdout: "duration": 0 2023-08-01T19:55:58.035 INFO:teuthology.orchestra.run.smithi155.stdout: }, 2023-08-01T19:55:58.035 INFO:teuthology.orchestra.run.smithi155.stdout: { 2023-08-01T19:55:58.035 INFO:teuthology.orchestra.run.smithi155.stdout: "event": "header_read", 2023-08-01T19:55:58.035 INFO:teuthology.orchestra.run.smithi155.stdout: "time": "2023-08-01T19:54:51.460077+0000", 2023-08-01T19:55:58.035 INFO:teuthology.orchestra.run.smithi155.stdout: "duration": 4294967295.9999995 2023-08-01T19:55:58.035 INFO:teuthology.orchestra.run.smithi155.stdout: }, 2023-08-01T19:55:58.036 INFO:teuthology.orchestra.run.smithi155.stdout: { 2023-08-01T19:55:58.036 INFO:teuthology.orchestra.run.smithi155.stdout: "event": "all_read", 2023-08-01T19:55:58.036 INFO:teuthology.orchestra.run.smithi155.stdout: "time": "2023-08-01T19:54:51.460102+0000", 2023-08-01T19:55:58.036 INFO:teuthology.orchestra.run.smithi155.stdout: "duration": 2.4933e-05 2023-08-01T19:55:58.036 INFO:teuthology.orchestra.run.smithi155.stdout: }, 2023-08-01T19:55:58.036 INFO:teuthology.orchestra.run.smithi155.stdout: { 2023-08-01T19:55:58.036 INFO:teuthology.orchestra.run.smithi155.stdout: "event": "dispatched", 2023-08-01T19:55:58.036 INFO:teuthology.orchestra.run.smithi155.stdout: "time": "2023-08-01T19:54:51.460109+0000", 2023-08-01T19:55:58.037 INFO:teuthology.orchestra.run.smithi155.stdout: "duration": 7.0720000000000002e-06 2023-08-01T19:55:58.037 INFO:teuthology.orchestra.run.smithi155.stdout: }, 2023-08-01T19:55:58.037 INFO:teuthology.orchestra.run.smithi155.stdout: { 2023-08-01T19:55:58.037 INFO:teuthology.orchestra.run.smithi155.stdout: "event": "queued_for_pg", 2023-08-01T19:55:58.037 INFO:teuthology.orchestra.run.smithi155.stdout: "time": "2023-08-01T19:54:51.460113+0000", 2023-08-01T19:55:58.037 INFO:teuthology.orchestra.run.smithi155.stdout: "duration": 4.3220000000000003e-06 2023-08-01T19:55:58.037 INFO:teuthology.orchestra.run.smithi155.stdout: }, 2023-08-01T19:55:58.037 INFO:teuthology.orchestra.run.smithi155.stdout: { 2023-08-01T19:55:58.038 INFO:teuthology.orchestra.run.smithi155.stdout: "event": "reached_pg", 2023-08-01T19:55:58.038 INFO:teuthology.orchestra.run.smithi155.stdout: "time": "2023-08-01T19:54:51.460955+0000", 2023-08-01T19:55:58.038 INFO:teuthology.orchestra.run.smithi155.stdout: "duration": 0.00084142500000000003 2023-08-01T19:55:58.038 INFO:teuthology.orchestra.run.smithi155.stdout: }, 2023-08-01T19:55:58.038 INFO:teuthology.orchestra.run.smithi155.stdout: { 2023-08-01T19:55:58.038 INFO:teuthology.orchestra.run.smithi155.stdout: "event": "started", 2023-08-01T19:55:58.038 INFO:teuthology.orchestra.run.smithi155.stdout: "time": "2023-08-01T19:54:51.461079+0000", 2023-08-01T19:55:58.038 INFO:teuthology.orchestra.run.smithi155.stdout: "duration": 0.000123826 2023-08-01T19:55:58.039 INFO:teuthology.orchestra.run.smithi155.stdout: }, 2023-08-01T19:55:58.039 INFO:teuthology.orchestra.run.smithi155.stdout: { 2023-08-01T19:55:58.039 INFO:teuthology.orchestra.run.smithi155.stdout: "event": "waiting for subops from 0", 2023-08-01T19:55:58.039 INFO:teuthology.orchestra.run.smithi155.stdout: "time": "2023-08-01T19:54:51.461233+0000", 2023-08-01T19:55:58.039 INFO:teuthology.orchestra.run.smithi155.stdout: "duration": 0.00015431900000000001 2023-08-01T19:55:58.039 INFO:teuthology.orchestra.run.smithi155.stdout: }, 2023-08-01T19:55:58.039 INFO:teuthology.orchestra.run.smithi155.stdout: { 2023-08-01T19:55:58.040 INFO:teuthology.orchestra.run.smithi155.stdout: "event": "sub_op_commit_rec", 2023-08-01T19:55:58.040 INFO:teuthology.orchestra.run.smithi155.stdout: "time": "2023-08-01T19:54:51.468509+0000", 2023-08-01T19:55:58.040 INFO:teuthology.orchestra.run.smithi155.stdout: "duration": 0.0072759859999999999 2023-08-01T19:55:58.040 INFO:teuthology.orchestra.run.smithi155.stdout: }, 2023-08-01T19:55:58.040 INFO:teuthology.orchestra.run.smithi155.stdout: { 2023-08-01T19:55:58.040 INFO:teuthology.orchestra.run.smithi155.stdout: "event": "op_commit", 2023-08-01T19:55:58.040 INFO:teuthology.orchestra.run.smithi155.stdout: "time": "2023-08-01T19:54:51.482704+0000", 2023-08-01T19:55:58.040 INFO:teuthology.orchestra.run.smithi155.stdout: "duration": 0.01419545 2023-08-01T19:55:58.041 INFO:teuthology.orchestra.run.smithi155.stdout: }, 2023-08-01T19:55:58.041 INFO:teuthology.orchestra.run.smithi155.stdout: { 2023-08-01T19:55:58.041 INFO:teuthology.orchestra.run.smithi155.stdout: "event": "commit_sent", 2023-08-01T19:55:58.041 INFO:teuthology.orchestra.run.smithi155.stdout: "time": "2023-08-01T19:54:51.482747+0000", 2023-08-01T19:55:58.041 INFO:teuthology.orchestra.run.smithi155.stdout: "duration": 4.2413999999999997e-05 2023-08-01T19:55:58.041 INFO:teuthology.orchestra.run.smithi155.stdout: }, 2023-08-01T19:55:58.041 INFO:teuthology.orchestra.run.smithi155.stdout: { 2023-08-01T19:55:58.041 INFO:teuthology.orchestra.run.smithi155.stdout: "event": "done", 2023-08-01T19:55:58.042 INFO:teuthology.orchestra.run.smithi155.stdout: "time": "2023-08-01T19:54:51.482767+0000", 2023-08-01T19:55:58.042 INFO:teuthology.orchestra.run.smithi155.stdout: "duration": 1.9908999999999999e-05 2023-08-01T19:55:58.042 INFO:teuthology.orchestra.run.smithi155.stdout: } 2023-08-01T19:55:58.042 INFO:teuthology.orchestra.run.smithi155.stdout: ] 2023-08-01T19:55:58.042 INFO:teuthology.orchestra.run.smithi155.stdout: } 2023-08-01T19:55:58.042 INFO:teuthology.orchestra.run.smithi155.stdout: }, 2023-08-01T19:55:58.042 INFO:teuthology.orchestra.run.smithi155.stdout: { 2023-08-01T19:55:58.042 INFO:teuthology.orchestra.run.smithi155.stdout: "description": "osd_op(client.4668.0:73456 5.0 5:0164baf4:::benchmark_data_smithi006_114134_object73455:head [set-alloc-hint object_size 65536 write_size 65536,write 0~65536] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e31)", 2023-08-01T19:55:58.043 INFO:teuthology.orchestra.run.smithi155.stdout: "initiated_at": "2023-08-01T19:54:51.461520+0000", 2023-08-01T19:55:58.043 INFO:teuthology.orchestra.run.smithi155.stdout: "age": 66.556514019999995, 2023-08-01T19:55:58.043 INFO:teuthology.orchestra.run.smithi155.stdout: "duration": 0.023899916, 2023-08-01T19:55:58.043 INFO:teuthology.orchestra.run.smithi155.stdout: "type_data": { 2023-08-01T19:55:58.043 INFO:teuthology.orchestra.run.smithi155.stdout: "flag_point": "commit sent; apply or cleanup", 2023-08-01T19:55:58.043 INFO:teuthology.orchestra.run.smithi155.stdout: "client_info": { 2023-08-01T19:55:58.043 INFO:teuthology.orchestra.run.smithi155.stdout: "client": "client.4668", 2023-08-01T19:55:58.043 INFO:teuthology.orchestra.run.smithi155.stdout: "client_addr": "172.21.15.6:0/1709472247", 2023-08-01T19:55:58.044 INFO:teuthology.orchestra.run.smithi155.stdout: "tid": 73456 2023-08-01T19:55:58.044 INFO:teuthology.orchestra.run.smithi155.stdout: }, 2023-08-01T19:55:58.044 INFO:teuthology.orchestra.run.smithi155.stdout: "events": [ 2023-08-01T19:55:58.044 INFO:teuthology.orchestra.run.smithi155.stdout: { 2023-08-01T19:55:58.044 INFO:teuthology.orchestra.run.smithi155.stdout: "event": "initiated", 2023-08-01T19:55:58.044 INFO:teuthology.orchestra.run.smithi155.stdout: "time": "2023-08-01T19:54:51.461520+0000", 2023-08-01T19:55:58.044 INFO:teuthology.orchestra.run.smithi155.stdout: "duration": 0 2023-08-01T19:55:58.045 INFO:teuthology.orchestra.run.smithi155.stdout: }, 2023-08-01T19:55:58.045 INFO:teuthology.orchestra.run.smithi155.stdout: { 2023-08-01T19:55:58.045 INFO:teuthology.orchestra.run.smithi155.stdout: "event": "throttled", 2023-08-01T19:55:58.045 INFO:teuthology.orchestra.run.smithi155.stdout: "time": "2023-08-01T19:54:51.461520+0000", 2023-08-01T19:55:58.045 INFO:teuthology.orchestra.run.smithi155.stdout: "duration": 0 2023-08-01T19:55:58.045 INFO:teuthology.orchestra.run.smithi155.stdout: }, 2023-08-01T19:55:58.045 INFO:teuthology.orchestra.run.smithi155.stdout: { 2023-08-01T19:55:58.045 INFO:teuthology.orchestra.run.smithi155.stdout: "event": "header_read", 2023-08-01T19:55:58.046 INFO:teuthology.orchestra.run.smithi155.stdout: "time": "2023-08-01T19:54:51.461519+0000", 2023-08-01T19:55:58.046 INFO:teuthology.orchestra.run.smithi155.stdout: "duration": 4294967295.999999 2023-08-01T19:55:58.046 INFO:teuthology.orchestra.run.smithi155.stdout: }, 2023-08-01T19:55:58.046 INFO:teuthology.orchestra.run.smithi155.stdout: { 2023-08-01T19:55:58.046 INFO:teuthology.orchestra.run.smithi155.stdout: "event": "all_read", 2023-08-01T19:55:58.046 INFO:teuthology.orchestra.run.smithi155.stdout: "time": "2023-08-01T19:54:51.461633+0000", 2023-08-01T19:55:58.046 INFO:teuthology.orchestra.run.smithi155.stdout: "duration": 0.000114015 2023-08-01T19:55:58.047 INFO:teuthology.orchestra.run.smithi155.stdout: }, 2023-08-01T19:55:58.047 INFO:teuthology.orchestra.run.smithi155.stdout: { 2023-08-01T19:55:58.047 INFO:teuthology.orchestra.run.smithi155.stdout: "event": "dispatched", 2023-08-01T19:55:58.047 INFO:teuthology.orchestra.run.smithi155.stdout: "time": "2023-08-01T19:54:51.461643+0000", 2023-08-01T19:55:58.047 INFO:teuthology.orchestra.run.smithi155.stdout: "duration": 1.0217000000000001e-05 2023-08-01T19:55:58.047 INFO:teuthology.orchestra.run.smithi155.stdout: }, 2023-08-01T19:55:58.047 INFO:teuthology.orchestra.run.smithi155.stdout: { 2023-08-01T19:55:58.047 INFO:teuthology.orchestra.run.smithi155.stdout: "event": "queued_for_pg", 2023-08-01T19:55:58.048 INFO:teuthology.orchestra.run.smithi155.stdout: "time": "2023-08-01T19:54:51.461649+0000", 2023-08-01T19:55:58.048 INFO:teuthology.orchestra.run.smithi155.stdout: "duration": 5.8850000000000004e-06 2023-08-01T19:55:58.048 INFO:teuthology.orchestra.run.smithi155.stdout: }, 2023-08-01T19:55:58.048 INFO:teuthology.orchestra.run.smithi155.stdout: { 2023-08-01T19:55:58.048 INFO:teuthology.orchestra.run.smithi155.stdout: "event": "reached_pg", 2023-08-01T19:55:58.048 INFO:teuthology.orchestra.run.smithi155.stdout: "time": "2023-08-01T19:54:51.461686+0000", 2023-08-01T19:55:58.048 INFO:teuthology.orchestra.run.smithi155.stdout: "duration": 3.7319e-05 2023-08-01T19:55:58.048 INFO:teuthology.orchestra.run.smithi155.stdout: }, 2023-08-01T19:55:58.049 INFO:teuthology.orchestra.run.smithi155.stdout: { 2023-08-01T19:55:58.049 INFO:teuthology.orchestra.run.smithi155.stdout: "event": "started", 2023-08-01T19:55:58.049 INFO:teuthology.orchestra.run.smithi155.stdout: "time": "2023-08-01T19:54:51.461802+0000", 2023-08-01T19:55:58.049 INFO:teuthology.orchestra.run.smithi155.stdout: "duration": 0.000115604 2023-08-01T19:55:58.049 INFO:teuthology.orchestra.run.smithi155.stdout: }, 2023-08-01T19:55:58.049 INFO:teuthology.orchestra.run.smithi155.stdout: { 2023-08-01T19:55:58.049 INFO:teuthology.orchestra.run.smithi155.stdout: "event": "waiting for subops from 0", 2023-08-01T19:55:58.049 INFO:teuthology.orchestra.run.smithi155.stdout: "time": "2023-08-01T19:54:51.461933+0000", 2023-08-01T19:55:58.050 INFO:teuthology.orchestra.run.smithi155.stdout: "duration": 0.000131175 2023-08-01T19:55:58.050 INFO:teuthology.orchestra.run.smithi155.stdout: }, 2023-08-01T19:55:58.050 INFO:teuthology.orchestra.run.smithi155.stdout: { 2023-08-01T19:55:58.050 INFO:teuthology.orchestra.run.smithi155.stdout: "event": "sub_op_commit_rec", 2023-08-01T19:55:58.050 INFO:teuthology.orchestra.run.smithi155.stdout: "time": "2023-08-01T19:54:51.468411+0000", 2023-08-01T19:55:58.050 INFO:teuthology.orchestra.run.smithi155.stdout: "duration": 0.0064775850000000001 2023-08-01T19:55:58.050 INFO:teuthology.orchestra.run.smithi155.stdout: }, 2023-08-01T19:55:58.050 INFO:teuthology.orchestra.run.smithi155.stdout: { 2023-08-01T19:55:58.051 INFO:teuthology.orchestra.run.smithi155.stdout: "event": "op_commit", 2023-08-01T19:55:58.051 INFO:teuthology.orchestra.run.smithi155.stdout: "time": "2023-08-01T19:54:51.485340+0000", 2023-08-01T19:55:58.051 INFO:teuthology.orchestra.run.smithi155.stdout: "duration": 0.016928907 2023-08-01T19:55:58.051 INFO:teuthology.orchestra.run.smithi155.stdout: }, 2023-08-01T19:55:58.051 INFO:teuthology.orchestra.run.smithi155.stdout: { 2023-08-01T19:55:58.051 INFO:teuthology.orchestra.run.smithi155.stdout: "event": "commit_sent", 2023-08-01T19:55:58.051 INFO:teuthology.orchestra.run.smithi155.stdout: "time": "2023-08-01T19:54:51.485385+0000", 2023-08-01T19:55:58.052 INFO:teuthology.orchestra.run.smithi155.stdout: "duration": 4.5222000000000002e-05 2023-08-01T19:55:58.052 INFO:teuthology.orchestra.run.smithi155.stdout: }, 2023-08-01T19:55:58.052 INFO:teuthology.orchestra.run.smithi155.stdout: { 2023-08-01T19:55:58.052 INFO:teuthology.orchestra.run.smithi155.stdout: "event": "done", 2023-08-01T19:55:58.052 INFO:teuthology.orchestra.run.smithi155.stdout: "time": "2023-08-01T19:54:51.485420+0000", 2023-08-01T19:55:58.052 INFO:teuthology.orchestra.run.smithi155.stdout: "duration": 3.4717e-05 2023-08-01T19:55:58.052 INFO:teuthology.orchestra.run.smithi155.stdout: } 2023-08-01T19:55:58.052 INFO:teuthology.orchestra.run.smithi155.stdout: ] 2023-08-01T19:55:58.053 INFO:teuthology.orchestra.run.smithi155.stdout: } 2023-08-01T19:55:58.053 INFO:teuthology.orchestra.run.smithi155.stdout: }, 2023-08-01T19:55:58.053 INFO:teuthology.orchestra.run.smithi155.stdout: { 2023-08-01T19:55:58.053 INFO:teuthology.orchestra.run.smithi155.stdout: "description": "osd_op(client.4668.0:100237 5.4 5:2d68bec9:::benchmark_data_smithi006_114134_object100236:head [set-alloc-hint object_size 65536 write_size 65536,write 0~65536] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e37)", 2023-08-01T19:55:58.053 INFO:teuthology.orchestra.run.smithi155.stdout: "initiated_at": "2023-08-01T19:55:05.147736+0000", 2023-08-01T19:55:58.053 INFO:teuthology.orchestra.run.smithi155.stdout: "age": 52.870297307000001, 2023-08-01T19:55:58.053 INFO:teuthology.orchestra.run.smithi155.stdout: "duration": 0.071299464000000007, 2023-08-01T19:55:58.053 INFO:teuthology.orchestra.run.smithi155.stdout: "type_data": { 2023-08-01T19:55:58.054 INFO:teuthology.orchestra.run.smithi155.stdout: "flag_point": "commit sent; apply or cleanup", 2023-08-01T19:55:58.054 INFO:teuthology.orchestra.run.smithi155.stdout: "client_info": { 2023-08-01T19:55:58.054 INFO:teuthology.orchestra.run.smithi155.stdout: "client": "client.4668", 2023-08-01T19:55:58.054 INFO:teuthology.orchestra.run.smithi155.stdout: "client_addr": "172.21.15.6:0/1709472247", 2023-08-01T19:55:58.054 INFO:teuthology.orchestra.run.smithi155.stdout: "tid": 100237 2023-08-01T19:55:58.054 INFO:teuthology.orchestra.run.smithi155.stdout: }, 2023-08-01T19:55:58.054 INFO:teuthology.orchestra.run.smithi155.stdout: "events": [ 2023-08-01T19:55:58.054 INFO:teuthology.orchestra.run.smithi155.stdout: { 2023-08-01T19:55:58.055 INFO:teuthology.orchestra.run.smithi155.stdout: "event": "initiated", 2023-08-01T19:55:58.055 INFO:teuthology.orchestra.run.smithi155.stdout: "time": "2023-08-01T19:55:05.147736+0000", 2023-08-01T19:55:58.055 INFO:teuthology.orchestra.run.smithi155.stdout: "duration": 0 2023-08-01T19:55:58.055 INFO:teuthology.orchestra.run.smithi155.stdout: }, 2023-08-01T19:55:58.055 INFO:teuthology.orchestra.run.smithi155.stdout: { 2023-08-01T19:55:58.055 INFO:teuthology.orchestra.run.smithi155.stdout: "event": "throttled", 2023-08-01T19:55:58.055 INFO:teuthology.orchestra.run.smithi155.stdout: "time": "2023-08-01T19:55:05.147736+0000", 2023-08-01T19:55:58.056 INFO:teuthology.orchestra.run.smithi155.stdout: "duration": 0 2023-08-01T19:55:58.056 INFO:teuthology.orchestra.run.smithi155.stdout: }, 2023-08-01T19:55:58.056 INFO:teuthology.orchestra.run.smithi155.stdout: { 2023-08-01T19:55:58.056 INFO:teuthology.orchestra.run.smithi155.stdout: "event": "header_read", 2023-08-01T19:55:58.056 INFO:teuthology.orchestra.run.smithi155.stdout: "time": "2023-08-01T19:55:05.147736+0000", 2023-08-01T19:55:58.056 INFO:teuthology.orchestra.run.smithi155.stdout: "duration": 4294967295.9999995 2023-08-01T19:55:58.056 INFO:teuthology.orchestra.run.smithi155.stdout: }, 2023-08-01T19:55:58.056 INFO:teuthology.orchestra.run.smithi155.stdout: { 2023-08-01T19:55:58.057 INFO:teuthology.orchestra.run.smithi155.stdout: "event": "all_read", 2023-08-01T19:55:58.057 INFO:teuthology.orchestra.run.smithi155.stdout: "time": "2023-08-01T19:55:05.147766+0000", 2023-08-01T19:55:58.057 INFO:teuthology.orchestra.run.smithi155.stdout: "duration": 3.0394000000000001e-05 2023-08-01T19:55:58.057 INFO:teuthology.orchestra.run.smithi155.stdout: }, 2023-08-01T19:55:58.057 INFO:teuthology.orchestra.run.smithi155.stdout: { 2023-08-01T19:55:58.057 INFO:teuthology.orchestra.run.smithi155.stdout: "event": "dispatched", 2023-08-01T19:55:58.057 INFO:teuthology.orchestra.run.smithi155.stdout: "time": "2023-08-01T19:55:05.147771+0000", 2023-08-01T19:55:58.057 INFO:teuthology.orchestra.run.smithi155.stdout: "duration": 4.25e-06 2023-08-01T19:55:58.058 INFO:teuthology.orchestra.run.smithi155.stdout: }, 2023-08-01T19:55:58.058 INFO:teuthology.orchestra.run.smithi155.stdout: { 2023-08-01T19:55:58.058 INFO:teuthology.orchestra.run.smithi155.stdout: "event": "queued_for_pg", 2023-08-01T19:55:58.058 INFO:teuthology.orchestra.run.smithi155.stdout: "time": "2023-08-01T19:55:05.147773+0000", 2023-08-01T19:55:58.058 INFO:teuthology.orchestra.run.smithi155.stdout: "duration": 2.4159999999999998e-06 2023-08-01T19:55:58.058 INFO:teuthology.orchestra.run.smithi155.stdout: }, 2023-08-01T19:55:58.058 INFO:teuthology.orchestra.run.smithi155.stdout: { 2023-08-01T19:55:58.058 INFO:teuthology.orchestra.run.smithi155.stdout: "event": "reached_pg", 2023-08-01T19:55:58.059 INFO:teuthology.orchestra.run.smithi155.stdout: "time": "2023-08-01T19:55:05.149903+0000", 2023-08-01T19:55:58.059 INFO:teuthology.orchestra.run.smithi155.stdout: "duration": 0.002129948 2023-08-01T19:55:58.059 INFO:teuthology.orchestra.run.smithi155.stdout: }, 2023-08-01T19:55:58.059 INFO:teuthology.orchestra.run.smithi155.stdout: { 2023-08-01T19:55:58.059 INFO:teuthology.orchestra.run.smithi155.stdout: "event": "started", 2023-08-01T19:55:58.059 INFO:teuthology.orchestra.run.smithi155.stdout: "time": "2023-08-01T19:55:05.149982+0000", 2023-08-01T19:55:58.059 INFO:teuthology.orchestra.run.smithi155.stdout: "duration": 7.8706000000000002e-05 2023-08-01T19:55:58.059 INFO:teuthology.orchestra.run.smithi155.stdout: }, 2023-08-01T19:55:58.060 INFO:teuthology.orchestra.run.smithi155.stdout: { 2023-08-01T19:55:58.060 INFO:teuthology.orchestra.run.smithi155.stdout: "event": "waiting for subops from 0", 2023-08-01T19:55:58.060 INFO:teuthology.orchestra.run.smithi155.stdout: "time": "2023-08-01T19:55:05.150066+0000", 2023-08-01T19:55:58.060 INFO:teuthology.orchestra.run.smithi155.stdout: "duration": 8.4241999999999997e-05 2023-08-01T19:55:58.060 INFO:teuthology.orchestra.run.smithi155.stdout: }, 2023-08-01T19:55:58.060 INFO:teuthology.orchestra.run.smithi155.stdout: { 2023-08-01T19:55:58.060 INFO:teuthology.orchestra.run.smithi155.stdout: "event": "op_commit", 2023-08-01T19:55:58.061 INFO:teuthology.orchestra.run.smithi155.stdout: "time": "2023-08-01T19:55:05.154994+0000", 2023-08-01T19:55:58.061 INFO:teuthology.orchestra.run.smithi155.stdout: "duration": 0.0049277050000000001 2023-08-01T19:55:58.061 INFO:teuthology.orchestra.run.smithi155.stdout: }, 2023-08-01T19:55:58.061 INFO:teuthology.orchestra.run.smithi155.stdout: { 2023-08-01T19:55:58.061 INFO:teuthology.orchestra.run.smithi155.stdout: "event": "sub_op_commit_rec", 2023-08-01T19:55:58.061 INFO:teuthology.orchestra.run.smithi155.stdout: "time": "2023-08-01T19:55:05.218933+0000", 2023-08-01T19:55:58.061 INFO:teuthology.orchestra.run.smithi155.stdout: "duration": 0.063939916999999999 2023-08-01T19:55:58.061 INFO:teuthology.orchestra.run.smithi155.stdout: }, 2023-08-01T19:55:58.062 INFO:teuthology.orchestra.run.smithi155.stdout: { 2023-08-01T19:55:58.062 INFO:teuthology.orchestra.run.smithi155.stdout: "event": "commit_sent", 2023-08-01T19:55:58.062 INFO:teuthology.orchestra.run.smithi155.stdout: "time": "2023-08-01T19:55:05.218989+0000", 2023-08-01T19:55:58.062 INFO:teuthology.orchestra.run.smithi155.stdout: "duration": 5.5772000000000001e-05 2023-08-01T19:55:58.062 INFO:teuthology.orchestra.run.smithi155.stdout: }, 2023-08-01T19:55:58.062 INFO:teuthology.orchestra.run.smithi155.stdout: { 2023-08-01T19:55:58.062 INFO:teuthology.orchestra.run.smithi155.stdout: "event": "done", 2023-08-01T19:55:58.062 INFO:teuthology.orchestra.run.smithi155.stdout: "time": "2023-08-01T19:55:05.219036+0000", 2023-08-01T19:55:58.063 INFO:teuthology.orchestra.run.smithi155.stdout: "duration": 4.6526000000000001e-05 2023-08-01T19:55:58.063 INFO:teuthology.orchestra.run.smithi155.stdout: } 2023-08-01T19:55:58.063 INFO:teuthology.orchestra.run.smithi155.stdout: ] 2023-08-01T19:55:58.063 INFO:teuthology.orchestra.run.smithi155.stdout: } 2023-08-01T19:55:58.063 INFO:teuthology.orchestra.run.smithi155.stdout: }, 2023-08-01T19:55:58.063 INFO:teuthology.orchestra.run.smithi155.stdout: { 2023-08-01T19:55:58.063 INFO:teuthology.orchestra.run.smithi155.stdout: "description": "osd_op(client.4668.0:100242 5.8 5:16a314b8:::benchmark_data_smithi006_114134_object100241:head [set-alloc-hint object_size 65536 write_size 65536,write 0~65536] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e37)", 2023-08-01T19:55:58.063 INFO:teuthology.orchestra.run.smithi155.stdout: "initiated_at": "2023-08-01T19:55:05.150616+0000", 2023-08-01T19:55:58.064 INFO:teuthology.orchestra.run.smithi155.stdout: "age": 52.867417676999999, 2023-08-01T19:55:58.064 INFO:teuthology.orchestra.run.smithi155.stdout: "duration": 0.071105065999999995, 2023-08-01T19:55:58.064 INFO:teuthology.orchestra.run.smithi155.stdout: "type_data": { 2023-08-01T19:55:58.064 INFO:teuthology.orchestra.run.smithi155.stdout: "flag_point": "commit sent; apply or cleanup", 2023-08-01T19:55:58.064 INFO:teuthology.orchestra.run.smithi155.stdout: "client_info": { 2023-08-01T19:55:58.064 INFO:teuthology.orchestra.run.smithi155.stdout: "client": "client.4668", 2023-08-01T19:55:58.064 INFO:teuthology.orchestra.run.smithi155.stdout: "client_addr": "172.21.15.6:0/1709472247", 2023-08-01T19:55:58.064 INFO:teuthology.orchestra.run.smithi155.stdout: "tid": 100242 2023-08-01T19:55:58.065 INFO:teuthology.orchestra.run.smithi155.stdout: }, 2023-08-01T19:55:58.065 INFO:teuthology.orchestra.run.smithi155.stdout: "events": [ 2023-08-01T19:55:58.065 INFO:teuthology.orchestra.run.smithi155.stdout: { 2023-08-01T19:55:58.065 INFO:teuthology.orchestra.run.smithi155.stdout: "event": "initiated", 2023-08-01T19:55:58.065 INFO:teuthology.orchestra.run.smithi155.stdout: "time": "2023-08-01T19:55:05.150616+0000", 2023-08-01T19:55:58.065 INFO:teuthology.orchestra.run.smithi155.stdout: "duration": 0 2023-08-01T19:55:58.065 INFO:teuthology.orchestra.run.smithi155.stdout: }, 2023-08-01T19:55:58.066 INFO:teuthology.orchestra.run.smithi155.stdout: { 2023-08-01T19:55:58.066 INFO:teuthology.orchestra.run.smithi155.stdout: "event": "throttled", 2023-08-01T19:55:58.066 INFO:teuthology.orchestra.run.smithi155.stdout: "time": "2023-08-01T19:55:05.150616+0000", 2023-08-01T19:55:58.066 INFO:teuthology.orchestra.run.smithi155.stdout: "duration": 0 2023-08-01T19:55:58.066 INFO:teuthology.orchestra.run.smithi155.stdout: }, 2023-08-01T19:55:58.066 INFO:teuthology.orchestra.run.smithi155.stdout: { 2023-08-01T19:55:58.066 INFO:teuthology.orchestra.run.smithi155.stdout: "event": "header_read", 2023-08-01T19:55:58.066 INFO:teuthology.orchestra.run.smithi155.stdout: "time": "2023-08-01T19:55:05.150615+0000", 2023-08-01T19:55:58.067 INFO:teuthology.orchestra.run.smithi155.stdout: "duration": 4294967295.999999 2023-08-01T19:55:58.067 INFO:teuthology.orchestra.run.smithi155.stdout: }, 2023-08-01T19:55:58.067 INFO:teuthology.orchestra.run.smithi155.stdout: { 2023-08-01T19:55:58.067 INFO:teuthology.orchestra.run.smithi155.stdout: "event": "all_read", 2023-08-01T19:55:58.067 INFO:teuthology.orchestra.run.smithi155.stdout: "time": "2023-08-01T19:55:05.150696+0000", 2023-08-01T19:55:58.067 INFO:teuthology.orchestra.run.smithi155.stdout: "duration": 8.0852000000000004e-05 2023-08-01T19:55:58.067 INFO:teuthology.orchestra.run.smithi155.stdout: }, 2023-08-01T19:55:58.067 INFO:teuthology.orchestra.run.smithi155.stdout: { 2023-08-01T19:55:58.068 INFO:teuthology.orchestra.run.smithi155.stdout: "event": "dispatched", 2023-08-01T19:55:58.068 INFO:teuthology.orchestra.run.smithi155.stdout: "time": "2023-08-01T19:55:05.150708+0000", 2023-08-01T19:55:58.068 INFO:teuthology.orchestra.run.smithi155.stdout: "duration": 1.2116999999999999e-05 2023-08-01T19:55:58.068 INFO:teuthology.orchestra.run.smithi155.stdout: }, 2023-08-01T19:55:58.068 INFO:teuthology.orchestra.run.smithi155.stdout: { 2023-08-01T19:55:58.068 INFO:teuthology.orchestra.run.smithi155.stdout: "event": "queued_for_pg", 2023-08-01T19:55:58.068 INFO:teuthology.orchestra.run.smithi155.stdout: "time": "2023-08-01T19:55:05.150713+0000", 2023-08-01T19:55:58.068 INFO:teuthology.orchestra.run.smithi155.stdout: "duration": 5.4620000000000004e-06 2023-08-01T19:55:58.069 INFO:teuthology.orchestra.run.smithi155.stdout: }, 2023-08-01T19:55:58.069 INFO:teuthology.orchestra.run.smithi155.stdout: { 2023-08-01T19:55:58.069 INFO:teuthology.orchestra.run.smithi155.stdout: "event": "reached_pg", 2023-08-01T19:55:58.069 INFO:teuthology.orchestra.run.smithi155.stdout: "time": "2023-08-01T19:55:05.150761+0000", 2023-08-01T19:55:58.069 INFO:teuthology.orchestra.run.smithi155.stdout: "duration": 4.7429000000000003e-05 2023-08-01T19:55:58.069 INFO:teuthology.orchestra.run.smithi155.stdout: }, 2023-08-01T19:55:58.069 INFO:teuthology.orchestra.run.smithi155.stdout: { 2023-08-01T19:55:58.069 INFO:teuthology.orchestra.run.smithi155.stdout: "event": "started", 2023-08-01T19:55:58.070 INFO:teuthology.orchestra.run.smithi155.stdout: "time": "2023-08-01T19:55:05.150856+0000", 2023-08-01T19:55:58.070 INFO:teuthology.orchestra.run.smithi155.stdout: "duration": 9.5356e-05 2023-08-01T19:55:58.070 INFO:teuthology.orchestra.run.smithi155.stdout: }, 2023-08-01T19:55:58.070 INFO:teuthology.orchestra.run.smithi155.stdout: { 2023-08-01T19:55:58.070 INFO:teuthology.orchestra.run.smithi155.stdout: "event": "waiting for subops from 0", 2023-08-01T19:55:58.070 INFO:teuthology.orchestra.run.smithi155.stdout: "time": "2023-08-01T19:55:05.150999+0000", 2023-08-01T19:55:58.070 INFO:teuthology.orchestra.run.smithi155.stdout: "duration": 0.00014234499999999999 2023-08-01T19:55:58.071 INFO:teuthology.orchestra.run.smithi155.stdout: }, 2023-08-01T19:55:58.071 INFO:teuthology.orchestra.run.smithi155.stdout: { 2023-08-01T19:55:58.071 INFO:teuthology.orchestra.run.smithi155.stdout: "event": "sub_op_commit_rec", 2023-08-01T19:55:58.071 INFO:teuthology.orchestra.run.smithi155.stdout: "time": "2023-08-01T19:55:05.219001+0000", 2023-08-01T19:55:58.071 INFO:teuthology.orchestra.run.smithi155.stdout: "duration": 0.068002776000000001 2023-08-01T19:55:58.071 INFO:teuthology.orchestra.run.smithi155.stdout: }, 2023-08-01T19:55:58.071 INFO:teuthology.orchestra.run.smithi155.stdout: { 2023-08-01T19:55:58.071 INFO:teuthology.orchestra.run.smithi155.stdout: "event": "op_commit", 2023-08-01T19:55:58.072 INFO:teuthology.orchestra.run.smithi155.stdout: "time": "2023-08-01T19:55:05.221635+0000", 2023-08-01T19:55:58.072 INFO:teuthology.orchestra.run.smithi155.stdout: "duration": 0.0026340579999999999 2023-08-01T19:55:58.072 INFO:teuthology.orchestra.run.smithi155.stdout: }, 2023-08-01T19:55:58.072 INFO:teuthology.orchestra.run.smithi155.stdout: { 2023-08-01T19:55:58.072 INFO:teuthology.orchestra.run.smithi155.stdout: "event": "commit_sent", 2023-08-01T19:55:58.072 INFO:teuthology.orchestra.run.smithi155.stdout: "time": "2023-08-01T19:55:05.221682+0000", 2023-08-01T19:55:58.072 INFO:teuthology.orchestra.run.smithi155.stdout: "duration": 4.7123999999999998e-05 2023-08-01T19:55:58.072 INFO:teuthology.orchestra.run.smithi155.stdout: }, 2023-08-01T19:55:58.073 INFO:teuthology.orchestra.run.smithi155.stdout: { 2023-08-01T19:55:58.073 INFO:teuthology.orchestra.run.smithi155.stdout: "event": "done", 2023-08-01T19:55:58.073 INFO:teuthology.orchestra.run.smithi155.stdout: "time": "2023-08-01T19:55:05.221721+0000", 2023-08-01T19:55:58.073 INFO:teuthology.orchestra.run.smithi155.stdout: "duration": 3.8529999999999999e-05 2023-08-01T19:55:58.073 INFO:teuthology.orchestra.run.smithi155.stdout: } 2023-08-01T19:55:58.073 INFO:teuthology.orchestra.run.smithi155.stdout: ] 2023-08-01T19:55:58.073 INFO:teuthology.orchestra.run.smithi155.stdout: } 2023-08-01T19:55:58.073 INFO:teuthology.orchestra.run.smithi155.stdout: }, 2023-08-01T19:55:58.074 INFO:teuthology.orchestra.run.smithi155.stdout: { 2023-08-01T19:55:58.074 INFO:teuthology.orchestra.run.smithi155.stdout: "description": "osd_repop(client.4668.0:100240 5.a e37/19 5:5313c5b9:::benchmark_data_smithi006_114134_object100239:head v 37'6227, mlcod=37'6225)", 2023-08-01T19:55:58.074 INFO:teuthology.orchestra.run.smithi155.stdout: "initiated_at": "2023-08-01T19:55:05.150778+0000", 2023-08-01T19:55:58.074 INFO:teuthology.orchestra.run.smithi155.stdout: "age": 52.867255475999997, 2023-08-01T19:55:58.074 INFO:teuthology.orchestra.run.smithi155.stdout: "duration": 0.073362533999999993, 2023-08-01T19:55:58.074 INFO:teuthology.orchestra.run.smithi155.stdout: "type_data": { 2023-08-01T19:55:58.074 INFO:teuthology.orchestra.run.smithi155.stdout: "flag_point": "commit sent; apply or cleanup", 2023-08-01T19:55:58.074 INFO:teuthology.orchestra.run.smithi155.stdout: "events": [ 2023-08-01T19:55:58.075 INFO:teuthology.orchestra.run.smithi155.stdout: { 2023-08-01T19:55:58.075 INFO:teuthology.orchestra.run.smithi155.stdout: "event": "initiated", 2023-08-01T19:55:58.075 INFO:teuthology.orchestra.run.smithi155.stdout: "time": "2023-08-01T19:55:05.150778+0000", 2023-08-01T19:55:58.075 INFO:teuthology.orchestra.run.smithi155.stdout: "duration": 0 2023-08-01T19:55:58.075 INFO:teuthology.orchestra.run.smithi155.stdout: }, 2023-08-01T19:55:58.075 INFO:teuthology.orchestra.run.smithi155.stdout: { 2023-08-01T19:55:58.075 INFO:teuthology.orchestra.run.smithi155.stdout: "event": "throttled", 2023-08-01T19:55:58.076 INFO:teuthology.orchestra.run.smithi155.stdout: "time": "2023-08-01T19:55:05.150778+0000", 2023-08-01T19:55:58.076 INFO:teuthology.orchestra.run.smithi155.stdout: "duration": 0 2023-08-01T19:55:58.076 INFO:teuthology.orchestra.run.smithi155.stdout: }, 2023-08-01T19:55:58.076 INFO:teuthology.orchestra.run.smithi155.stdout: { 2023-08-01T19:55:58.076 INFO:teuthology.orchestra.run.smithi155.stdout: "event": "header_read", 2023-08-01T19:55:58.076 INFO:teuthology.orchestra.run.smithi155.stdout: "time": "2023-08-01T19:55:05.150778+0000", 2023-08-01T19:55:58.076 INFO:teuthology.orchestra.run.smithi155.stdout: "duration": 4294967295.9999995 2023-08-01T19:55:58.076 INFO:teuthology.orchestra.run.smithi155.stdout: }, 2023-08-01T19:55:58.077 INFO:teuthology.orchestra.run.smithi155.stdout: { 2023-08-01T19:55:58.077 INFO:teuthology.orchestra.run.smithi155.stdout: "event": "all_read", 2023-08-01T19:55:58.077 INFO:teuthology.orchestra.run.smithi155.stdout: "time": "2023-08-01T19:55:05.150811+0000", 2023-08-01T19:55:58.077 INFO:teuthology.orchestra.run.smithi155.stdout: "duration": 3.3664000000000002e-05 2023-08-01T19:55:58.077 INFO:teuthology.orchestra.run.smithi155.stdout: }, 2023-08-01T19:55:58.077 INFO:teuthology.orchestra.run.smithi155.stdout: { 2023-08-01T19:55:58.077 INFO:teuthology.orchestra.run.smithi155.stdout: "event": "dispatched", 2023-08-01T19:55:58.077 INFO:teuthology.orchestra.run.smithi155.stdout: "time": "2023-08-01T19:55:05.150818+0000", 2023-08-01T19:55:58.078 INFO:teuthology.orchestra.run.smithi155.stdout: "duration": 6.5769999999999999e-06 2023-08-01T19:55:58.078 INFO:teuthology.orchestra.run.smithi155.stdout: }, 2023-08-01T19:55:58.078 INFO:teuthology.orchestra.run.smithi155.stdout: { 2023-08-01T19:55:58.078 INFO:teuthology.orchestra.run.smithi155.stdout: "event": "queued_for_pg", 2023-08-01T19:55:58.078 INFO:teuthology.orchestra.run.smithi155.stdout: "time": "2023-08-01T19:55:05.150822+0000", 2023-08-01T19:55:58.078 INFO:teuthology.orchestra.run.smithi155.stdout: "duration": 4.0060000000000003e-06 2023-08-01T19:55:58.078 INFO:teuthology.orchestra.run.smithi155.stdout: }, 2023-08-01T19:55:58.078 INFO:teuthology.orchestra.run.smithi155.stdout: { 2023-08-01T19:55:58.079 INFO:teuthology.orchestra.run.smithi155.stdout: "event": "reached_pg", 2023-08-01T19:55:58.079 INFO:teuthology.orchestra.run.smithi155.stdout: "time": "2023-08-01T19:55:05.150855+0000", 2023-08-01T19:55:58.079 INFO:teuthology.orchestra.run.smithi155.stdout: "duration": 3.3204999999999998e-05 2023-08-01T19:55:58.079 INFO:teuthology.orchestra.run.smithi155.stdout: }, 2023-08-01T19:55:58.079 INFO:teuthology.orchestra.run.smithi155.stdout: { 2023-08-01T19:55:58.079 INFO:teuthology.orchestra.run.smithi155.stdout: "event": "started", 2023-08-01T19:55:58.079 INFO:teuthology.orchestra.run.smithi155.stdout: "time": "2023-08-01T19:55:05.150873+0000", 2023-08-01T19:55:58.079 INFO:teuthology.orchestra.run.smithi155.stdout: "duration": 1.8139999999999999e-05 2023-08-01T19:55:58.080 INFO:teuthology.orchestra.run.smithi155.stdout: }, 2023-08-01T19:55:58.080 INFO:teuthology.orchestra.run.smithi155.stdout: { 2023-08-01T19:55:58.080 INFO:teuthology.orchestra.run.smithi155.stdout: "event": "commit_sent", 2023-08-01T19:55:58.080 INFO:teuthology.orchestra.run.smithi155.stdout: "time": "2023-08-01T19:55:05.224095+0000", 2023-08-01T19:55:58.080 INFO:teuthology.orchestra.run.smithi155.stdout: "duration": 0.073221895999999995 2023-08-01T19:55:58.080 INFO:teuthology.orchestra.run.smithi155.stdout: }, 2023-08-01T19:55:58.080 INFO:teuthology.orchestra.run.smithi155.stdout: { 2023-08-01T19:55:58.080 INFO:teuthology.orchestra.run.smithi155.stdout: "event": "done", 2023-08-01T19:55:58.081 INFO:teuthology.orchestra.run.smithi155.stdout: "time": "2023-08-01T19:55:05.224141+0000", 2023-08-01T19:55:58.081 INFO:teuthology.orchestra.run.smithi155.stdout: "duration": 4.5385e-05 2023-08-01T19:55:58.081 INFO:teuthology.orchestra.run.smithi155.stdout: } 2023-08-01T19:55:58.081 INFO:teuthology.orchestra.run.smithi155.stdout: ] 2023-08-01T19:55:58.081 INFO:teuthology.orchestra.run.smithi155.stdout: } 2023-08-01T19:55:58.081 INFO:teuthology.orchestra.run.smithi155.stdout: }, 2023-08-01T19:55:58.081 INFO:teuthology.orchestra.run.smithi155.stdout: { 2023-08-01T19:55:58.082 INFO:teuthology.orchestra.run.smithi155.stdout: "description": "osd_op(client.4668.0:100245 5.e 5:71869c66:::benchmark_data_smithi006_114134_object100244:head [set-alloc-hint object_size 65536 write_size 65536,write 0~65536] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e37)", 2023-08-01T19:55:58.082 INFO:teuthology.orchestra.run.smithi155.stdout: "initiated_at": "2023-08-01T19:55:05.150991+0000", 2023-08-01T19:55:58.082 INFO:teuthology.orchestra.run.smithi155.stdout: "age": 52.867042689000002, 2023-08-01T19:55:58.082 INFO:teuthology.orchestra.run.smithi155.stdout: "duration": 0.070734490999999997, 2023-08-01T19:55:58.082 INFO:teuthology.orchestra.run.smithi155.stdout: "type_data": { 2023-08-01T19:55:58.082 INFO:teuthology.orchestra.run.smithi155.stdout: "flag_point": "commit sent; apply or cleanup", 2023-08-01T19:55:58.082 INFO:teuthology.orchestra.run.smithi155.stdout: "client_info": { 2023-08-01T19:55:58.082 INFO:teuthology.orchestra.run.smithi155.stdout: "client": "client.4668", 2023-08-01T19:55:58.083 INFO:teuthology.orchestra.run.smithi155.stdout: "client_addr": "172.21.15.6:0/1709472247", 2023-08-01T19:55:58.083 INFO:teuthology.orchestra.run.smithi155.stdout: "tid": 100245 2023-08-01T19:55:58.083 INFO:teuthology.orchestra.run.smithi155.stdout: }, 2023-08-01T19:55:58.083 INFO:teuthology.orchestra.run.smithi155.stdout: "events": [ 2023-08-01T19:55:58.083 INFO:teuthology.orchestra.run.smithi155.stdout: { 2023-08-01T19:55:58.083 INFO:teuthology.orchestra.run.smithi155.stdout: "event": "initiated", 2023-08-01T19:55:58.083 INFO:teuthology.orchestra.run.smithi155.stdout: "time": "2023-08-01T19:55:05.150991+0000", 2023-08-01T19:55:58.083 INFO:teuthology.orchestra.run.smithi155.stdout: "duration": 0 2023-08-01T19:55:58.084 INFO:teuthology.orchestra.run.smithi155.stdout: }, 2023-08-01T19:55:58.084 INFO:teuthology.orchestra.run.smithi155.stdout: { 2023-08-01T19:55:58.084 INFO:teuthology.orchestra.run.smithi155.stdout: "event": "throttled", 2023-08-01T19:55:58.084 INFO:teuthology.orchestra.run.smithi155.stdout: "time": "2023-08-01T19:55:05.150991+0000", 2023-08-01T19:55:58.084 INFO:teuthology.orchestra.run.smithi155.stdout: "duration": 0 2023-08-01T19:55:58.084 INFO:teuthology.orchestra.run.smithi155.stdout: }, 2023-08-01T19:55:58.084 INFO:teuthology.orchestra.run.smithi155.stdout: { 2023-08-01T19:55:58.084 INFO:teuthology.orchestra.run.smithi155.stdout: "event": "header_read", 2023-08-01T19:55:58.085 INFO:teuthology.orchestra.run.smithi155.stdout: "time": "2023-08-01T19:55:05.150990+0000", 2023-08-01T19:55:58.085 INFO:teuthology.orchestra.run.smithi155.stdout: "duration": 4294967295.999999 2023-08-01T19:55:58.085 INFO:teuthology.orchestra.run.smithi155.stdout: }, 2023-08-01T19:55:58.085 INFO:teuthology.orchestra.run.smithi155.stdout: { 2023-08-01T19:55:58.085 INFO:teuthology.orchestra.run.smithi155.stdout: "event": "all_read", 2023-08-01T19:55:58.085 INFO:teuthology.orchestra.run.smithi155.stdout: "time": "2023-08-01T19:55:05.151108+0000", 2023-08-01T19:55:58.085 INFO:teuthology.orchestra.run.smithi155.stdout: "duration": 0.00011849300000000001 2023-08-01T19:55:58.085 INFO:teuthology.orchestra.run.smithi155.stdout: }, 2023-08-01T19:55:58.086 INFO:teuthology.orchestra.run.smithi155.stdout: { 2023-08-01T19:55:58.086 INFO:teuthology.orchestra.run.smithi155.stdout: "event": "dispatched", 2023-08-01T19:55:58.086 INFO:teuthology.orchestra.run.smithi155.stdout: "time": "2023-08-01T19:55:05.151117+0000", 2023-08-01T19:55:58.086 INFO:teuthology.orchestra.run.smithi155.stdout: "duration": 8.1040000000000007e-06 2023-08-01T19:55:58.086 INFO:teuthology.orchestra.run.smithi155.stdout: }, 2023-08-01T19:55:58.086 INFO:teuthology.orchestra.run.smithi155.stdout: { 2023-08-01T19:55:58.086 INFO:teuthology.orchestra.run.smithi155.stdout: "event": "queued_for_pg", 2023-08-01T19:55:58.086 INFO:teuthology.orchestra.run.smithi155.stdout: "time": "2023-08-01T19:55:05.151121+0000", 2023-08-01T19:55:58.087 INFO:teuthology.orchestra.run.smithi155.stdout: "duration": 4.2019999999999997e-06 2023-08-01T19:55:58.087 INFO:teuthology.orchestra.run.smithi155.stdout: }, 2023-08-01T19:55:58.087 INFO:teuthology.orchestra.run.smithi155.stdout: { 2023-08-01T19:55:58.087 INFO:teuthology.orchestra.run.smithi155.stdout: "event": "reached_pg", 2023-08-01T19:55:58.087 INFO:teuthology.orchestra.run.smithi155.stdout: "time": "2023-08-01T19:55:05.151162+0000", 2023-08-01T19:55:58.087 INFO:teuthology.orchestra.run.smithi155.stdout: "duration": 4.1448e-05 2023-08-01T19:55:58.087 INFO:teuthology.orchestra.run.smithi155.stdout: }, 2023-08-01T19:55:58.088 INFO:teuthology.orchestra.run.smithi155.stdout: { 2023-08-01T19:55:58.088 INFO:teuthology.orchestra.run.smithi155.stdout: "event": "started", 2023-08-01T19:55:58.088 INFO:teuthology.orchestra.run.smithi155.stdout: "time": "2023-08-01T19:55:05.151281+0000", 2023-08-01T19:55:58.088 INFO:teuthology.orchestra.run.smithi155.stdout: "duration": 0.000119141 2023-08-01T19:55:58.088 INFO:teuthology.orchestra.run.smithi155.stdout: }, 2023-08-01T19:55:58.088 INFO:teuthology.orchestra.run.smithi155.stdout: { 2023-08-01T19:55:58.088 INFO:teuthology.orchestra.run.smithi155.stdout: "event": "waiting for subops from 0", 2023-08-01T19:55:58.088 INFO:teuthology.orchestra.run.smithi155.stdout: "time": "2023-08-01T19:55:05.151443+0000", 2023-08-01T19:55:58.089 INFO:teuthology.orchestra.run.smithi155.stdout: "duration": 0.00016181600000000001 2023-08-01T19:55:58.089 INFO:teuthology.orchestra.run.smithi155.stdout: }, 2023-08-01T19:55:58.089 INFO:teuthology.orchestra.run.smithi155.stdout: { 2023-08-01T19:55:58.089 INFO:teuthology.orchestra.run.smithi155.stdout: "event": "sub_op_commit_rec", 2023-08-01T19:55:58.089 INFO:teuthology.orchestra.run.smithi155.stdout: "time": "2023-08-01T19:55:05.219101+0000", 2023-08-01T19:55:58.089 INFO:teuthology.orchestra.run.smithi155.stdout: "duration": 0.067658037000000004 2023-08-01T19:55:58.089 INFO:teuthology.orchestra.run.smithi155.stdout: }, 2023-08-01T19:55:58.089 INFO:teuthology.orchestra.run.smithi155.stdout: { 2023-08-01T19:55:58.090 INFO:teuthology.orchestra.run.smithi155.stdout: "event": "op_commit", 2023-08-01T19:55:58.090 INFO:teuthology.orchestra.run.smithi155.stdout: "time": "2023-08-01T19:55:05.221646+0000", 2023-08-01T19:55:58.090 INFO:teuthology.orchestra.run.smithi155.stdout: "duration": 0.0025450540000000002 2023-08-01T19:55:58.090 INFO:teuthology.orchestra.run.smithi155.stdout: }, 2023-08-01T19:55:58.090 INFO:teuthology.orchestra.run.smithi155.stdout: { 2023-08-01T19:55:58.090 INFO:teuthology.orchestra.run.smithi155.stdout: "event": "commit_sent", 2023-08-01T19:55:58.090 INFO:teuthology.orchestra.run.smithi155.stdout: "time": "2023-08-01T19:55:05.221689+0000", 2023-08-01T19:55:58.090 INFO:teuthology.orchestra.run.smithi155.stdout: "duration": 4.3078999999999999e-05 2023-08-01T19:55:58.091 INFO:teuthology.orchestra.run.smithi155.stdout: }, 2023-08-01T19:55:58.091 INFO:teuthology.orchestra.run.smithi155.stdout: { 2023-08-01T19:55:58.091 INFO:teuthology.orchestra.run.smithi155.stdout: "event": "done", 2023-08-01T19:55:58.091 INFO:teuthology.orchestra.run.smithi155.stdout: "time": "2023-08-01T19:55:05.221725+0000", 2023-08-01T19:55:58.091 INFO:teuthology.orchestra.run.smithi155.stdout: "duration": 3.6137999999999999e-05 2023-08-01T19:55:58.091 INFO:teuthology.orchestra.run.smithi155.stdout: } 2023-08-01T19:55:58.091 INFO:teuthology.orchestra.run.smithi155.stdout: ] 2023-08-01T19:55:58.091 INFO:teuthology.orchestra.run.smithi155.stdout: } 2023-08-01T19:55:58.092 INFO:teuthology.orchestra.run.smithi155.stdout: }, 2023-08-01T19:55:58.092 INFO:teuthology.orchestra.run.smithi155.stdout: { 2023-08-01T19:55:58.092 INFO:teuthology.orchestra.run.smithi155.stdout: "description": "osd_repop(client.4668.0:100243 5.a e37/19 5:5e8193b6:::benchmark_data_smithi006_114134_object100242:head v 37'6228, mlcod=37'6225)", 2023-08-01T19:55:58.092 INFO:teuthology.orchestra.run.smithi155.stdout: "initiated_at": "2023-08-01T19:55:05.151148+0000", 2023-08-01T19:55:58.092 INFO:teuthology.orchestra.run.smithi155.stdout: "age": 52.866885678000003, 2023-08-01T19:55:58.092 INFO:teuthology.orchestra.run.smithi155.stdout: "duration": 0.073020370000000001, 2023-08-01T19:55:58.092 INFO:teuthology.orchestra.run.smithi155.stdout: "type_data": { 2023-08-01T19:55:58.093 INFO:teuthology.orchestra.run.smithi155.stdout: "flag_point": "commit sent; apply or cleanup", 2023-08-01T19:55:58.093 INFO:teuthology.orchestra.run.smithi155.stdout: "events": [ 2023-08-01T19:55:58.093 INFO:teuthology.orchestra.run.smithi155.stdout: { 2023-08-01T19:55:58.093 INFO:teuthology.orchestra.run.smithi155.stdout: "event": "initiated", 2023-08-01T19:55:58.093 INFO:teuthology.orchestra.run.smithi155.stdout: "time": "2023-08-01T19:55:05.151148+0000", 2023-08-01T19:55:58.093 INFO:teuthology.orchestra.run.smithi155.stdout: "duration": 0 2023-08-01T19:55:58.093 INFO:teuthology.orchestra.run.smithi155.stdout: }, 2023-08-01T19:55:58.093 INFO:teuthology.orchestra.run.smithi155.stdout: { 2023-08-01T19:55:58.094 INFO:teuthology.orchestra.run.smithi155.stdout: "event": "throttled", 2023-08-01T19:55:58.094 INFO:teuthology.orchestra.run.smithi155.stdout: "time": "2023-08-01T19:55:05.151148+0000", 2023-08-01T19:55:58.094 INFO:teuthology.orchestra.run.smithi155.stdout: "duration": 0 2023-08-01T19:55:58.094 INFO:teuthology.orchestra.run.smithi155.stdout: }, 2023-08-01T19:55:58.094 INFO:teuthology.orchestra.run.smithi155.stdout: { 2023-08-01T19:55:58.094 INFO:teuthology.orchestra.run.smithi155.stdout: "event": "header_read", 2023-08-01T19:55:58.094 INFO:teuthology.orchestra.run.smithi155.stdout: "time": "2023-08-01T19:55:05.151147+0000", 2023-08-01T19:55:58.094 INFO:teuthology.orchestra.run.smithi155.stdout: "duration": 4294967295.9999995 2023-08-01T19:55:58.095 INFO:teuthology.orchestra.run.smithi155.stdout: }, 2023-08-01T19:55:58.095 INFO:teuthology.orchestra.run.smithi155.stdout: { 2023-08-01T19:55:58.095 INFO:teuthology.orchestra.run.smithi155.stdout: "event": "all_read", 2023-08-01T19:55:58.095 INFO:teuthology.orchestra.run.smithi155.stdout: "time": "2023-08-01T19:55:05.151231+0000", 2023-08-01T19:55:58.095 INFO:teuthology.orchestra.run.smithi155.stdout: "duration": 8.3135999999999998e-05 2023-08-01T19:55:58.095 INFO:teuthology.orchestra.run.smithi155.stdout: }, 2023-08-01T19:55:58.095 INFO:teuthology.orchestra.run.smithi155.stdout: { 2023-08-01T19:55:58.095 INFO:teuthology.orchestra.run.smithi155.stdout: "event": "dispatched", 2023-08-01T19:55:58.096 INFO:teuthology.orchestra.run.smithi155.stdout: "time": "2023-08-01T19:55:05.151239+0000", 2023-08-01T19:55:58.096 INFO:teuthology.orchestra.run.smithi155.stdout: "duration": 8.7469999999999994e-06 2023-08-01T19:55:58.096 INFO:teuthology.orchestra.run.smithi155.stdout: }, 2023-08-01T19:55:58.096 INFO:teuthology.orchestra.run.smithi155.stdout: { 2023-08-01T19:55:58.096 INFO:teuthology.orchestra.run.smithi155.stdout: "event": "queued_for_pg", 2023-08-01T19:55:58.096 INFO:teuthology.orchestra.run.smithi155.stdout: "time": "2023-08-01T19:55:05.151244+0000", 2023-08-01T19:55:58.096 INFO:teuthology.orchestra.run.smithi155.stdout: "duration": 4.4800000000000003e-06 2023-08-01T19:55:58.097 INFO:teuthology.orchestra.run.smithi155.stdout: }, 2023-08-01T19:55:58.097 INFO:teuthology.orchestra.run.smithi155.stdout: { 2023-08-01T19:55:58.097 INFO:teuthology.orchestra.run.smithi155.stdout: "event": "reached_pg", 2023-08-01T19:55:58.097 INFO:teuthology.orchestra.run.smithi155.stdout: "time": "2023-08-01T19:55:05.152938+0000", 2023-08-01T19:55:58.097 INFO:teuthology.orchestra.run.smithi155.stdout: "duration": 0.001693824 2023-08-01T19:55:58.097 INFO:teuthology.orchestra.run.smithi155.stdout: }, 2023-08-01T19:55:58.097 INFO:teuthology.orchestra.run.smithi155.stdout: { 2023-08-01T19:55:58.097 INFO:teuthology.orchestra.run.smithi155.stdout: "event": "started", 2023-08-01T19:55:58.098 INFO:teuthology.orchestra.run.smithi155.stdout: "time": "2023-08-01T19:55:05.152956+0000", 2023-08-01T19:55:58.098 INFO:teuthology.orchestra.run.smithi155.stdout: "duration": 1.8287e-05 2023-08-01T19:55:58.098 INFO:teuthology.orchestra.run.smithi155.stdout: }, 2023-08-01T19:55:58.098 INFO:teuthology.orchestra.run.smithi155.stdout: { 2023-08-01T19:55:58.098 INFO:teuthology.orchestra.run.smithi155.stdout: "event": "commit_sent", 2023-08-01T19:55:58.098 INFO:teuthology.orchestra.run.smithi155.stdout: "time": "2023-08-01T19:55:05.224145+0000", 2023-08-01T19:55:58.098 INFO:teuthology.orchestra.run.smithi155.stdout: "duration": 0.071189447000000003 2023-08-01T19:55:58.098 INFO:teuthology.orchestra.run.smithi155.stdout: }, 2023-08-01T19:55:58.099 INFO:teuthology.orchestra.run.smithi155.stdout: { 2023-08-01T19:55:58.099 INFO:teuthology.orchestra.run.smithi155.stdout: "event": "done", 2023-08-01T19:55:58.099 INFO:teuthology.orchestra.run.smithi155.stdout: "time": "2023-08-01T19:55:05.224168+0000", 2023-08-01T19:55:58.099 INFO:teuthology.orchestra.run.smithi155.stdout: "duration": 2.3008999999999999e-05 2023-08-01T19:55:58.099 INFO:teuthology.orchestra.run.smithi155.stdout: } 2023-08-01T19:55:58.099 INFO:teuthology.orchestra.run.smithi155.stdout: ] 2023-08-01T19:55:58.099 INFO:teuthology.orchestra.run.smithi155.stdout: } 2023-08-01T19:55:58.099 INFO:teuthology.orchestra.run.smithi155.stdout: }, 2023-08-01T19:55:58.100 INFO:teuthology.orchestra.run.smithi155.stdout: { 2023-08-01T19:55:58.100 INFO:teuthology.orchestra.run.smithi155.stdout: "description": "osd_repop(client.4668.0:100244 5.9 e37/19 5:92f56a12:::benchmark_data_smithi006_114134_object100243:head v 37'6294, mlcod=37'6292)", 2023-08-01T19:55:58.100 INFO:teuthology.orchestra.run.smithi155.stdout: "initiated_at": "2023-08-01T19:55:05.151325+0000", 2023-08-01T19:55:58.100 INFO:teuthology.orchestra.run.smithi155.stdout: "age": 52.866708332999998, 2023-08-01T19:55:58.100 INFO:teuthology.orchestra.run.smithi155.stdout: "duration": 0.071883673999999995, 2023-08-01T19:55:58.100 INFO:teuthology.orchestra.run.smithi155.stdout: "type_data": { 2023-08-01T19:55:58.100 INFO:teuthology.orchestra.run.smithi155.stdout: "flag_point": "commit sent; apply or cleanup", 2023-08-01T19:55:58.100 INFO:teuthology.orchestra.run.smithi155.stdout: "events": [ 2023-08-01T19:55:58.101 INFO:teuthology.orchestra.run.smithi155.stdout: { 2023-08-01T19:55:58.101 INFO:teuthology.orchestra.run.smithi155.stdout: "event": "initiated", 2023-08-01T19:55:58.101 INFO:teuthology.orchestra.run.smithi155.stdout: "time": "2023-08-01T19:55:05.151325+0000", 2023-08-01T19:55:58.101 INFO:teuthology.orchestra.run.smithi155.stdout: "duration": 0 2023-08-01T19:55:58.101 INFO:teuthology.orchestra.run.smithi155.stdout: }, 2023-08-01T19:55:58.101 INFO:teuthology.orchestra.run.smithi155.stdout: { 2023-08-01T19:55:58.101 INFO:teuthology.orchestra.run.smithi155.stdout: "event": "throttled", 2023-08-01T19:55:58.101 INFO:teuthology.orchestra.run.smithi155.stdout: "time": "2023-08-01T19:55:05.151325+0000", 2023-08-01T19:55:58.102 INFO:teuthology.orchestra.run.smithi155.stdout: "duration": 0 2023-08-01T19:55:58.102 INFO:teuthology.orchestra.run.smithi155.stdout: }, 2023-08-01T19:55:58.102 INFO:teuthology.orchestra.run.smithi155.stdout: { 2023-08-01T19:55:58.102 INFO:teuthology.orchestra.run.smithi155.stdout: "event": "header_read", 2023-08-01T19:55:58.102 INFO:teuthology.orchestra.run.smithi155.stdout: "time": "2023-08-01T19:55:05.151325+0000", 2023-08-01T19:55:58.102 INFO:teuthology.orchestra.run.smithi155.stdout: "duration": 4294967295.9999995 2023-08-01T19:55:58.102 INFO:teuthology.orchestra.run.smithi155.stdout: }, 2023-08-01T19:55:58.103 INFO:teuthology.orchestra.run.smithi155.stdout: { 2023-08-01T19:55:58.103 INFO:teuthology.orchestra.run.smithi155.stdout: "event": "all_read", 2023-08-01T19:55:58.103 INFO:teuthology.orchestra.run.smithi155.stdout: "time": "2023-08-01T19:55:05.151390+0000", 2023-08-01T19:55:58.103 INFO:teuthology.orchestra.run.smithi155.stdout: "duration": 6.5456999999999993e-05 2023-08-01T19:55:58.103 INFO:teuthology.orchestra.run.smithi155.stdout: }, 2023-08-01T19:55:58.103 INFO:teuthology.orchestra.run.smithi155.stdout: { 2023-08-01T19:55:58.103 INFO:teuthology.orchestra.run.smithi155.stdout: "event": "dispatched", 2023-08-01T19:55:58.103 INFO:teuthology.orchestra.run.smithi155.stdout: "time": "2023-08-01T19:55:05.151396+0000", 2023-08-01T19:55:58.104 INFO:teuthology.orchestra.run.smithi155.stdout: "duration": 5.9190000000000004e-06 2023-08-01T19:55:58.104 INFO:teuthology.orchestra.run.smithi155.stdout: }, 2023-08-01T19:55:58.104 INFO:teuthology.orchestra.run.smithi155.stdout: { 2023-08-01T19:55:58.104 INFO:teuthology.orchestra.run.smithi155.stdout: "event": "queued_for_pg", 2023-08-01T19:55:58.104 INFO:teuthology.orchestra.run.smithi155.stdout: "time": "2023-08-01T19:55:05.151400+0000", 2023-08-01T19:55:58.104 INFO:teuthology.orchestra.run.smithi155.stdout: "duration": 4.1030000000000004e-06 2023-08-01T19:55:58.104 INFO:teuthology.orchestra.run.smithi155.stdout: }, 2023-08-01T19:55:58.104 INFO:teuthology.orchestra.run.smithi155.stdout: { 2023-08-01T19:55:58.105 INFO:teuthology.orchestra.run.smithi155.stdout: "event": "reached_pg", 2023-08-01T19:55:58.105 INFO:teuthology.orchestra.run.smithi155.stdout: "time": "2023-08-01T19:55:05.151452+0000", 2023-08-01T19:55:58.105 INFO:teuthology.orchestra.run.smithi155.stdout: "duration": 5.2136999999999999e-05 2023-08-01T19:55:58.105 INFO:teuthology.orchestra.run.smithi155.stdout: }, 2023-08-01T19:55:58.105 INFO:teuthology.orchestra.run.smithi155.stdout: { 2023-08-01T19:55:58.105 INFO:teuthology.orchestra.run.smithi155.stdout: "event": "started", 2023-08-01T19:55:58.105 INFO:teuthology.orchestra.run.smithi155.stdout: "time": "2023-08-01T19:55:05.151470+0000", 2023-08-01T19:55:58.105 INFO:teuthology.orchestra.run.smithi155.stdout: "duration": 1.8e-05 2023-08-01T19:55:58.106 INFO:teuthology.orchestra.run.smithi155.stdout: }, 2023-08-01T19:55:58.106 INFO:teuthology.orchestra.run.smithi155.stdout: { 2023-08-01T19:55:58.106 INFO:teuthology.orchestra.run.smithi155.stdout: "event": "commit_sent", 2023-08-01T19:55:58.106 INFO:teuthology.orchestra.run.smithi155.stdout: "time": "2023-08-01T19:55:05.223183+0000", 2023-08-01T19:55:58.106 INFO:teuthology.orchestra.run.smithi155.stdout: "duration": 0.071712622000000004 2023-08-01T19:55:58.106 INFO:teuthology.orchestra.run.smithi155.stdout: }, 2023-08-01T19:55:58.106 INFO:teuthology.orchestra.run.smithi155.stdout: { 2023-08-01T19:55:58.106 INFO:teuthology.orchestra.run.smithi155.stdout: "event": "done", 2023-08-01T19:55:58.107 INFO:teuthology.orchestra.run.smithi155.stdout: "time": "2023-08-01T19:55:05.223209+0000", 2023-08-01T19:55:58.107 INFO:teuthology.orchestra.run.smithi155.stdout: "duration": 2.5956e-05 2023-08-01T19:55:58.107 INFO:teuthology.orchestra.run.smithi155.stdout: } 2023-08-01T19:55:58.107 INFO:teuthology.orchestra.run.smithi155.stdout: ] 2023-08-01T19:55:58.107 INFO:teuthology.orchestra.run.smithi155.stdout: } 2023-08-01T19:55:58.107 INFO:teuthology.orchestra.run.smithi155.stdout: }, 2023-08-01T19:55:58.107 INFO:teuthology.orchestra.run.smithi155.stdout: { 2023-08-01T19:55:58.107 INFO:teuthology.orchestra.run.smithi155.stdout: "description": "osd_op(client.4668.0:100249 5.b 5:d0666827:::benchmark_data_smithi006_114134_object100248:head [set-alloc-hint object_size 65536 write_size 65536,write 0~65536] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e37)", 2023-08-01T19:55:58.108 INFO:teuthology.orchestra.run.smithi155.stdout: "initiated_at": "2023-08-01T19:55:05.153614+0000", 2023-08-01T19:55:58.108 INFO:teuthology.orchestra.run.smithi155.stdout: "age": 52.864419908000002, 2023-08-01T19:55:58.108 INFO:teuthology.orchestra.run.smithi155.stdout: "duration": 0.069286118999999993, 2023-08-01T19:55:58.108 INFO:teuthology.orchestra.run.smithi155.stdout: "type_data": { 2023-08-01T19:55:58.108 INFO:teuthology.orchestra.run.smithi155.stdout: "flag_point": "commit sent; apply or cleanup", 2023-08-01T19:55:58.108 INFO:teuthology.orchestra.run.smithi155.stdout: "client_info": { 2023-08-01T19:55:58.108 INFO:teuthology.orchestra.run.smithi155.stdout: "client": "client.4668", 2023-08-01T19:55:58.109 INFO:teuthology.orchestra.run.smithi155.stdout: "client_addr": "172.21.15.6:0/1709472247", 2023-08-01T19:55:58.109 INFO:teuthology.orchestra.run.smithi155.stdout: "tid": 100249 2023-08-01T19:55:58.109 INFO:teuthology.orchestra.run.smithi155.stdout: }, 2023-08-01T19:55:58.109 INFO:teuthology.orchestra.run.smithi155.stdout: "events": [ 2023-08-01T19:55:58.109 INFO:teuthology.orchestra.run.smithi155.stdout: { 2023-08-01T19:55:58.109 INFO:teuthology.orchestra.run.smithi155.stdout: "event": "initiated", 2023-08-01T19:55:58.109 INFO:teuthology.orchestra.run.smithi155.stdout: "time": "2023-08-01T19:55:05.153614+0000", 2023-08-01T19:55:58.109 INFO:teuthology.orchestra.run.smithi155.stdout: "duration": 0 2023-08-01T19:55:58.110 INFO:teuthology.orchestra.run.smithi155.stdout: }, 2023-08-01T19:55:58.110 INFO:teuthology.orchestra.run.smithi155.stdout: { 2023-08-01T19:55:58.110 INFO:teuthology.orchestra.run.smithi155.stdout: "event": "throttled", 2023-08-01T19:55:58.110 INFO:teuthology.orchestra.run.smithi155.stdout: "time": "2023-08-01T19:55:05.153614+0000", 2023-08-01T19:55:58.110 INFO:teuthology.orchestra.run.smithi155.stdout: "duration": 0 2023-08-01T19:55:58.110 INFO:teuthology.orchestra.run.smithi155.stdout: }, 2023-08-01T19:55:58.110 INFO:teuthology.orchestra.run.smithi155.stdout: { 2023-08-01T19:55:58.110 INFO:teuthology.orchestra.run.smithi155.stdout: "event": "header_read", 2023-08-01T19:55:58.111 INFO:teuthology.orchestra.run.smithi155.stdout: "time": "2023-08-01T19:55:05.153612+0000", 2023-08-01T19:55:58.111 INFO:teuthology.orchestra.run.smithi155.stdout: "duration": 4294967295.9999986 2023-08-01T19:55:58.111 INFO:teuthology.orchestra.run.smithi155.stdout: }, 2023-08-01T19:55:58.111 INFO:teuthology.orchestra.run.smithi155.stdout: { 2023-08-01T19:55:58.111 INFO:teuthology.orchestra.run.smithi155.stdout: "event": "all_read", 2023-08-01T19:55:58.111 INFO:teuthology.orchestra.run.smithi155.stdout: "time": "2023-08-01T19:55:05.153694+0000", 2023-08-01T19:55:58.111 INFO:teuthology.orchestra.run.smithi155.stdout: "duration": 8.1618000000000004e-05 2023-08-01T19:55:58.111 INFO:teuthology.orchestra.run.smithi155.stdout: }, 2023-08-01T19:55:58.112 INFO:teuthology.orchestra.run.smithi155.stdout: { 2023-08-01T19:55:58.112 INFO:teuthology.orchestra.run.smithi155.stdout: "event": "dispatched", 2023-08-01T19:55:58.112 INFO:teuthology.orchestra.run.smithi155.stdout: "time": "2023-08-01T19:55:05.153713+0000", 2023-08-01T19:55:58.112 INFO:teuthology.orchestra.run.smithi155.stdout: "duration": 1.9069999999999999e-05 2023-08-01T19:55:58.112 INFO:teuthology.orchestra.run.smithi155.stdout: }, 2023-08-01T19:55:58.112 INFO:teuthology.orchestra.run.smithi155.stdout: { 2023-08-01T19:55:58.112 INFO:teuthology.orchestra.run.smithi155.stdout: "event": "queued_for_pg", 2023-08-01T19:55:58.113 INFO:teuthology.orchestra.run.smithi155.stdout: "time": "2023-08-01T19:55:05.153726+0000", 2023-08-01T19:55:58.113 INFO:teuthology.orchestra.run.smithi155.stdout: "duration": 1.238e-05 2023-08-01T19:55:58.113 INFO:teuthology.orchestra.run.smithi155.stdout: }, 2023-08-01T19:55:58.113 INFO:teuthology.orchestra.run.smithi155.stdout: { 2023-08-01T19:55:58.113 INFO:teuthology.orchestra.run.smithi155.stdout: "event": "reached_pg", 2023-08-01T19:55:58.113 INFO:teuthology.orchestra.run.smithi155.stdout: "time": "2023-08-01T19:55:05.153761+0000", 2023-08-01T19:55:58.113 INFO:teuthology.orchestra.run.smithi155.stdout: "duration": 3.5046999999999998e-05 2023-08-01T19:55:58.113 INFO:teuthology.orchestra.run.smithi155.stdout: }, 2023-08-01T19:55:58.114 INFO:teuthology.orchestra.run.smithi155.stdout: { 2023-08-01T19:55:58.114 INFO:teuthology.orchestra.run.smithi155.stdout: "event": "started", 2023-08-01T19:55:58.114 INFO:teuthology.orchestra.run.smithi155.stdout: "time": "2023-08-01T19:55:05.153896+0000", 2023-08-01T19:55:58.114 INFO:teuthology.orchestra.run.smithi155.stdout: "duration": 0.00013575800000000001 2023-08-01T19:55:58.114 INFO:teuthology.orchestra.run.smithi155.stdout: }, 2023-08-01T19:55:58.114 INFO:teuthology.orchestra.run.smithi155.stdout: { 2023-08-01T19:55:58.114 INFO:teuthology.orchestra.run.smithi155.stdout: "event": "waiting for subops from 0", 2023-08-01T19:55:58.114 INFO:teuthology.orchestra.run.smithi155.stdout: "time": "2023-08-01T19:55:05.154043+0000", 2023-08-01T19:55:58.115 INFO:teuthology.orchestra.run.smithi155.stdout: "duration": 0.00014650700000000001 2023-08-01T19:55:58.115 INFO:teuthology.orchestra.run.smithi155.stdout: }, 2023-08-01T19:55:58.115 INFO:teuthology.orchestra.run.smithi155.stdout: { 2023-08-01T19:55:58.115 INFO:teuthology.orchestra.run.smithi155.stdout: "event": "sub_op_commit_rec", 2023-08-01T19:55:58.115 INFO:teuthology.orchestra.run.smithi155.stdout: "time": "2023-08-01T19:55:05.221876+0000", 2023-08-01T19:55:58.115 INFO:teuthology.orchestra.run.smithi155.stdout: "duration": 0.067832796000000001 2023-08-01T19:55:58.115 INFO:teuthology.orchestra.run.smithi155.stdout: }, 2023-08-01T19:55:58.115 INFO:teuthology.orchestra.run.smithi155.stdout: { 2023-08-01T19:55:58.116 INFO:teuthology.orchestra.run.smithi155.stdout: "event": "op_commit", 2023-08-01T19:55:58.116 INFO:teuthology.orchestra.run.smithi155.stdout: "time": "2023-08-01T19:55:05.222813+0000", 2023-08-01T19:55:58.116 INFO:teuthology.orchestra.run.smithi155.stdout: "duration": 0.00093755300000000004 2023-08-01T19:55:58.116 INFO:teuthology.orchestra.run.smithi155.stdout: }, 2023-08-01T19:55:58.116 INFO:teuthology.orchestra.run.smithi155.stdout: { 2023-08-01T19:55:58.116 INFO:teuthology.orchestra.run.smithi155.stdout: "event": "commit_sent", 2023-08-01T19:55:58.116 INFO:teuthology.orchestra.run.smithi155.stdout: "time": "2023-08-01T19:55:05.222861+0000", 2023-08-01T19:55:58.116 INFO:teuthology.orchestra.run.smithi155.stdout: "duration": 4.8013999999999998e-05 2023-08-01T19:55:58.117 INFO:teuthology.orchestra.run.smithi155.stdout: }, 2023-08-01T19:55:58.117 INFO:teuthology.orchestra.run.smithi155.stdout: { 2023-08-01T19:55:58.117 INFO:teuthology.orchestra.run.smithi155.stdout: "event": "done", 2023-08-01T19:55:58.117 INFO:teuthology.orchestra.run.smithi155.stdout: "time": "2023-08-01T19:55:05.222900+0000", 2023-08-01T19:55:58.117 INFO:teuthology.orchestra.run.smithi155.stdout: "duration": 3.8634999999999999e-05 2023-08-01T19:55:58.117 INFO:teuthology.orchestra.run.smithi155.stdout: } 2023-08-01T19:55:58.117 INFO:teuthology.orchestra.run.smithi155.stdout: ] 2023-08-01T19:55:58.117 INFO:teuthology.orchestra.run.smithi155.stdout: } 2023-08-01T19:55:58.118 INFO:teuthology.orchestra.run.smithi155.stdout: }, 2023-08-01T19:55:58.118 INFO:teuthology.orchestra.run.smithi155.stdout: { 2023-08-01T19:55:58.118 INFO:teuthology.orchestra.run.smithi155.stdout: "description": "osd_op(client.4668.0:100251 5.b 5:d853df24:::benchmark_data_smithi006_114134_object100250:head [set-alloc-hint object_size 65536 write_size 65536,write 0~65536] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e37)", 2023-08-01T19:55:58.118 INFO:teuthology.orchestra.run.smithi155.stdout: "initiated_at": "2023-08-01T19:55:05.153737+0000", 2023-08-01T19:55:58.118 INFO:teuthology.orchestra.run.smithi155.stdout: "age": 52.864296893999999, 2023-08-01T19:55:58.118 INFO:teuthology.orchestra.run.smithi155.stdout: "duration": 0.071366545000000003, 2023-08-01T19:55:58.118 INFO:teuthology.orchestra.run.smithi155.stdout: "type_data": { 2023-08-01T19:55:58.119 INFO:teuthology.orchestra.run.smithi155.stdout: "flag_point": "commit sent; apply or cleanup", 2023-08-01T19:55:58.119 INFO:teuthology.orchestra.run.smithi155.stdout: "client_info": { 2023-08-01T19:55:58.119 INFO:teuthology.orchestra.run.smithi155.stdout: "client": "client.4668", 2023-08-01T19:55:58.119 INFO:teuthology.orchestra.run.smithi155.stdout: "client_addr": "172.21.15.6:0/1709472247", 2023-08-01T19:55:58.119 INFO:teuthology.orchestra.run.smithi155.stdout: "tid": 100251 2023-08-01T19:55:58.119 INFO:teuthology.orchestra.run.smithi155.stdout: }, 2023-08-01T19:55:58.119 INFO:teuthology.orchestra.run.smithi155.stdout: "events": [ 2023-08-01T19:55:58.119 INFO:teuthology.orchestra.run.smithi155.stdout: { 2023-08-01T19:55:58.120 INFO:teuthology.orchestra.run.smithi155.stdout: "event": "initiated", 2023-08-01T19:55:58.120 INFO:teuthology.orchestra.run.smithi155.stdout: "time": "2023-08-01T19:55:05.153737+0000", 2023-08-01T19:55:58.120 INFO:teuthology.orchestra.run.smithi155.stdout: "duration": 0 2023-08-01T19:55:58.120 INFO:teuthology.orchestra.run.smithi155.stdout: }, 2023-08-01T19:55:58.120 INFO:teuthology.orchestra.run.smithi155.stdout: { 2023-08-01T19:55:58.120 INFO:teuthology.orchestra.run.smithi155.stdout: "event": "throttled", 2023-08-01T19:55:58.120 INFO:teuthology.orchestra.run.smithi155.stdout: "time": "2023-08-01T19:55:05.153737+0000", 2023-08-01T19:55:58.120 INFO:teuthology.orchestra.run.smithi155.stdout: "duration": 0 2023-08-01T19:55:58.121 INFO:teuthology.orchestra.run.smithi155.stdout: }, 2023-08-01T19:55:58.121 INFO:teuthology.orchestra.run.smithi155.stdout: { 2023-08-01T19:55:58.121 INFO:teuthology.orchestra.run.smithi155.stdout: "event": "header_read", 2023-08-01T19:55:58.121 INFO:teuthology.orchestra.run.smithi155.stdout: "time": "2023-08-01T19:55:05.153736+0000", 2023-08-01T19:55:58.121 INFO:teuthology.orchestra.run.smithi155.stdout: "duration": 4294967295.9999995 2023-08-01T19:55:58.121 INFO:teuthology.orchestra.run.smithi155.stdout: }, 2023-08-01T19:55:58.121 INFO:teuthology.orchestra.run.smithi155.stdout: { 2023-08-01T19:55:58.122 INFO:teuthology.orchestra.run.smithi155.stdout: "event": "all_read", 2023-08-01T19:55:58.122 INFO:teuthology.orchestra.run.smithi155.stdout: "time": "2023-08-01T19:55:05.153784+0000", 2023-08-01T19:55:58.122 INFO:teuthology.orchestra.run.smithi155.stdout: "duration": 4.7660000000000001e-05 2023-08-01T19:55:58.122 INFO:teuthology.orchestra.run.smithi155.stdout: }, 2023-08-01T19:55:58.122 INFO:teuthology.orchestra.run.smithi155.stdout: { 2023-08-01T19:55:58.122 INFO:teuthology.orchestra.run.smithi155.stdout: "event": "dispatched", 2023-08-01T19:55:58.122 INFO:teuthology.orchestra.run.smithi155.stdout: "time": "2023-08-01T19:55:05.153793+0000", 2023-08-01T19:55:58.122 INFO:teuthology.orchestra.run.smithi155.stdout: "duration": 8.7150000000000004e-06 2023-08-01T19:55:58.123 INFO:teuthology.orchestra.run.smithi155.stdout: }, 2023-08-01T19:55:58.123 INFO:teuthology.orchestra.run.smithi155.stdout: { 2023-08-01T19:55:58.123 INFO:teuthology.orchestra.run.smithi155.stdout: "event": "queued_for_pg", 2023-08-01T19:55:58.123 INFO:teuthology.orchestra.run.smithi155.stdout: "time": "2023-08-01T19:55:05.153800+0000", 2023-08-01T19:55:58.123 INFO:teuthology.orchestra.run.smithi155.stdout: "duration": 7.2459999999999997e-06 2023-08-01T19:55:58.123 INFO:teuthology.orchestra.run.smithi155.stdout: }, 2023-08-01T19:55:58.123 INFO:teuthology.orchestra.run.smithi155.stdout: { 2023-08-01T19:55:58.123 INFO:teuthology.orchestra.run.smithi155.stdout: "event": "reached_pg", 2023-08-01T19:55:58.124 INFO:teuthology.orchestra.run.smithi155.stdout: "time": "2023-08-01T19:55:05.156241+0000", 2023-08-01T19:55:58.124 INFO:teuthology.orchestra.run.smithi155.stdout: "duration": 0.0024415359999999998 2023-08-01T19:55:58.124 INFO:teuthology.orchestra.run.smithi155.stdout: }, 2023-08-01T19:55:58.124 INFO:teuthology.orchestra.run.smithi155.stdout: { 2023-08-01T19:55:58.124 INFO:teuthology.orchestra.run.smithi155.stdout: "event": "started", 2023-08-01T19:55:58.124 INFO:teuthology.orchestra.run.smithi155.stdout: "time": "2023-08-01T19:55:05.219045+0000", 2023-08-01T19:55:58.124 INFO:teuthology.orchestra.run.smithi155.stdout: "duration": 0.062803855000000006 2023-08-01T19:55:58.124 INFO:teuthology.orchestra.run.smithi155.stdout: }, 2023-08-01T19:55:58.125 INFO:teuthology.orchestra.run.smithi155.stdout: { 2023-08-01T19:55:58.125 INFO:teuthology.orchestra.run.smithi155.stdout: "event": "waiting for subops from 0", 2023-08-01T19:55:58.125 INFO:teuthology.orchestra.run.smithi155.stdout: "time": "2023-08-01T19:55:05.219238+0000", 2023-08-01T19:55:58.125 INFO:teuthology.orchestra.run.smithi155.stdout: "duration": 0.00019241500000000001 2023-08-01T19:55:58.125 INFO:teuthology.orchestra.run.smithi155.stdout: }, 2023-08-01T19:55:58.125 INFO:teuthology.orchestra.run.smithi155.stdout: { 2023-08-01T19:55:58.125 INFO:teuthology.orchestra.run.smithi155.stdout: "event": "sub_op_commit_rec", 2023-08-01T19:55:58.125 INFO:teuthology.orchestra.run.smithi155.stdout: "time": "2023-08-01T19:55:05.223300+0000", 2023-08-01T19:55:58.126 INFO:teuthology.orchestra.run.smithi155.stdout: "duration": 0.0040626509999999996 2023-08-01T19:55:58.126 INFO:teuthology.orchestra.run.smithi155.stdout: }, 2023-08-01T19:55:58.126 INFO:teuthology.orchestra.run.smithi155.stdout: { 2023-08-01T19:55:58.126 INFO:teuthology.orchestra.run.smithi155.stdout: "event": "op_commit", 2023-08-01T19:55:58.126 INFO:teuthology.orchestra.run.smithi155.stdout: "time": "2023-08-01T19:55:05.225020+0000", 2023-08-01T19:55:58.126 INFO:teuthology.orchestra.run.smithi155.stdout: "duration": 0.0017201 2023-08-01T19:55:58.126 INFO:teuthology.orchestra.run.smithi155.stdout: }, 2023-08-01T19:55:58.127 INFO:teuthology.orchestra.run.smithi155.stdout: { 2023-08-01T19:55:58.127 INFO:teuthology.orchestra.run.smithi155.stdout: "event": "commit_sent", 2023-08-01T19:55:58.127 INFO:teuthology.orchestra.run.smithi155.stdout: "time": "2023-08-01T19:55:05.225066+0000", 2023-08-01T19:55:58.127 INFO:teuthology.orchestra.run.smithi155.stdout: "duration": 4.6143000000000002e-05 2023-08-01T19:55:58.127 INFO:teuthology.orchestra.run.smithi155.stdout: }, 2023-08-01T19:55:58.127 INFO:teuthology.orchestra.run.smithi155.stdout: { 2023-08-01T19:55:58.127 INFO:teuthology.orchestra.run.smithi155.stdout: "event": "done", 2023-08-01T19:55:58.127 INFO:teuthology.orchestra.run.smithi155.stdout: "time": "2023-08-01T19:55:05.225103+0000", 2023-08-01T19:55:58.128 INFO:teuthology.orchestra.run.smithi155.stdout: "duration": 3.6789999999999998e-05 2023-08-01T19:55:58.128 INFO:teuthology.orchestra.run.smithi155.stdout: } 2023-08-01T19:55:58.128 INFO:teuthology.orchestra.run.smithi155.stdout: ] 2023-08-01T19:55:58.128 INFO:teuthology.orchestra.run.smithi155.stdout: } 2023-08-01T19:55:58.128 INFO:teuthology.orchestra.run.smithi155.stdout: }, 2023-08-01T19:55:58.128 INFO:teuthology.orchestra.run.smithi155.stdout: { 2023-08-01T19:55:58.128 INFO:teuthology.orchestra.run.smithi155.stdout: "description": "osd_op(client.4668.0:100252 5.0 5:01f90c3c:::benchmark_data_smithi006_114134_object100251:head [set-alloc-hint object_size 65536 write_size 65536,write 0~65536] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e37)", 2023-08-01T19:55:58.128 INFO:teuthology.orchestra.run.smithi155.stdout: "initiated_at": "2023-08-01T19:55:05.154048+0000", 2023-08-01T19:55:58.129 INFO:teuthology.orchestra.run.smithi155.stdout: "age": 52.863985647, 2023-08-01T19:55:58.129 INFO:teuthology.orchestra.run.smithi155.stdout: "duration": 0.070156683999999997, 2023-08-01T19:55:58.129 INFO:teuthology.orchestra.run.smithi155.stdout: "type_data": { 2023-08-01T19:55:58.129 INFO:teuthology.orchestra.run.smithi155.stdout: "flag_point": "commit sent; apply or cleanup", 2023-08-01T19:55:58.129 INFO:teuthology.orchestra.run.smithi155.stdout: "client_info": { 2023-08-01T19:55:58.129 INFO:teuthology.orchestra.run.smithi155.stdout: "client": "client.4668", 2023-08-01T19:55:58.129 INFO:teuthology.orchestra.run.smithi155.stdout: "client_addr": "172.21.15.6:0/1709472247", 2023-08-01T19:55:58.129 INFO:teuthology.orchestra.run.smithi155.stdout: "tid": 100252 2023-08-01T19:55:58.130 INFO:teuthology.orchestra.run.smithi155.stdout: }, 2023-08-01T19:55:58.130 INFO:teuthology.orchestra.run.smithi155.stdout: "events": [ 2023-08-01T19:55:58.130 INFO:teuthology.orchestra.run.smithi155.stdout: { 2023-08-01T19:55:58.130 INFO:teuthology.orchestra.run.smithi155.stdout: "event": "initiated", 2023-08-01T19:55:58.130 INFO:teuthology.orchestra.run.smithi155.stdout: "time": "2023-08-01T19:55:05.154048+0000", 2023-08-01T19:55:58.130 INFO:teuthology.orchestra.run.smithi155.stdout: "duration": 0 2023-08-01T19:55:58.130 INFO:teuthology.orchestra.run.smithi155.stdout: }, 2023-08-01T19:55:58.130 INFO:teuthology.orchestra.run.smithi155.stdout: { 2023-08-01T19:55:58.131 INFO:teuthology.orchestra.run.smithi155.stdout: "event": "throttled", 2023-08-01T19:55:58.131 INFO:teuthology.orchestra.run.smithi155.stdout: "time": "2023-08-01T19:55:05.154048+0000", 2023-08-01T19:55:58.131 INFO:teuthology.orchestra.run.smithi155.stdout: "duration": 0 2023-08-01T19:55:58.131 INFO:teuthology.orchestra.run.smithi155.stdout: }, 2023-08-01T19:55:58.131 INFO:teuthology.orchestra.run.smithi155.stdout: { 2023-08-01T19:55:58.131 INFO:teuthology.orchestra.run.smithi155.stdout: "event": "header_read", 2023-08-01T19:55:58.131 INFO:teuthology.orchestra.run.smithi155.stdout: "time": "2023-08-01T19:55:05.154047+0000", 2023-08-01T19:55:58.131 INFO:teuthology.orchestra.run.smithi155.stdout: "duration": 4294967295.999999 2023-08-01T19:55:58.132 INFO:teuthology.orchestra.run.smithi155.stdout: }, 2023-08-01T19:55:58.132 INFO:teuthology.orchestra.run.smithi155.stdout: { 2023-08-01T19:55:58.132 INFO:teuthology.orchestra.run.smithi155.stdout: "event": "all_read", 2023-08-01T19:55:58.132 INFO:teuthology.orchestra.run.smithi155.stdout: "time": "2023-08-01T19:55:05.154115+0000", 2023-08-01T19:55:58.132 INFO:teuthology.orchestra.run.smithi155.stdout: "duration": 6.7545999999999993e-05 2023-08-01T19:55:58.132 INFO:teuthology.orchestra.run.smithi155.stdout: }, 2023-08-01T19:55:58.132 INFO:teuthology.orchestra.run.smithi155.stdout: { 2023-08-01T19:55:58.133 INFO:teuthology.orchestra.run.smithi155.stdout: "event": "dispatched", 2023-08-01T19:55:58.133 INFO:teuthology.orchestra.run.smithi155.stdout: "time": "2023-08-01T19:55:05.154125+0000", 2023-08-01T19:55:58.133 INFO:teuthology.orchestra.run.smithi155.stdout: "duration": 1.0669000000000001e-05 2023-08-01T19:55:58.133 INFO:teuthology.orchestra.run.smithi155.stdout: }, 2023-08-01T19:55:58.133 INFO:teuthology.orchestra.run.smithi155.stdout: { 2023-08-01T19:55:58.133 INFO:teuthology.orchestra.run.smithi155.stdout: "event": "queued_for_pg", 2023-08-01T19:55:58.133 INFO:teuthology.orchestra.run.smithi155.stdout: "time": "2023-08-01T19:55:05.154131+0000", 2023-08-01T19:55:58.133 INFO:teuthology.orchestra.run.smithi155.stdout: "duration": 6.0349999999999998e-06 2023-08-01T19:55:58.134 INFO:teuthology.orchestra.run.smithi155.stdout: }, 2023-08-01T19:55:58.134 INFO:teuthology.orchestra.run.smithi155.stdout: { 2023-08-01T19:55:58.134 INFO:teuthology.orchestra.run.smithi155.stdout: "event": "reached_pg", 2023-08-01T19:55:58.134 INFO:teuthology.orchestra.run.smithi155.stdout: "time": "2023-08-01T19:55:05.154174+0000", 2023-08-01T19:55:58.134 INFO:teuthology.orchestra.run.smithi155.stdout: "duration": 4.2429000000000003e-05 2023-08-01T19:55:58.134 INFO:teuthology.orchestra.run.smithi155.stdout: }, 2023-08-01T19:55:58.134 INFO:teuthology.orchestra.run.smithi155.stdout: { 2023-08-01T19:55:58.134 INFO:teuthology.orchestra.run.smithi155.stdout: "event": "started", 2023-08-01T19:55:58.135 INFO:teuthology.orchestra.run.smithi155.stdout: "time": "2023-08-01T19:55:05.154287+0000", 2023-08-01T19:55:58.135 INFO:teuthology.orchestra.run.smithi155.stdout: "duration": 0.000113138 2023-08-01T19:55:58.135 INFO:teuthology.orchestra.run.smithi155.stdout: }, 2023-08-01T19:55:58.135 INFO:teuthology.orchestra.run.smithi155.stdout: { 2023-08-01T19:55:58.135 INFO:teuthology.orchestra.run.smithi155.stdout: "event": "waiting for subops from 0", 2023-08-01T19:55:58.135 INFO:teuthology.orchestra.run.smithi155.stdout: "time": "2023-08-01T19:55:05.154420+0000", 2023-08-01T19:55:58.135 INFO:teuthology.orchestra.run.smithi155.stdout: "duration": 0.000133292 2023-08-01T19:55:58.135 INFO:teuthology.orchestra.run.smithi155.stdout: }, 2023-08-01T19:55:58.136 INFO:teuthology.orchestra.run.smithi155.stdout: { 2023-08-01T19:55:58.136 INFO:teuthology.orchestra.run.smithi155.stdout: "event": "sub_op_commit_rec", 2023-08-01T19:55:58.136 INFO:teuthology.orchestra.run.smithi155.stdout: "time": "2023-08-01T19:55:05.219034+0000", 2023-08-01T19:55:58.136 INFO:teuthology.orchestra.run.smithi155.stdout: "duration": 0.064613429999999999 2023-08-01T19:55:58.136 INFO:teuthology.orchestra.run.smithi155.stdout: }, 2023-08-01T19:55:58.136 INFO:teuthology.orchestra.run.smithi155.stdout: { 2023-08-01T19:55:58.136 INFO:teuthology.orchestra.run.smithi155.stdout: "event": "op_commit", 2023-08-01T19:55:58.136 INFO:teuthology.orchestra.run.smithi155.stdout: "time": "2023-08-01T19:55:05.224138+0000", 2023-08-01T19:55:58.137 INFO:teuthology.orchestra.run.smithi155.stdout: "duration": 0.0051041999999999997 2023-08-01T19:55:58.137 INFO:teuthology.orchestra.run.smithi155.stdout: }, 2023-08-01T19:55:58.137 INFO:teuthology.orchestra.run.smithi155.stdout: { 2023-08-01T19:55:58.137 INFO:teuthology.orchestra.run.smithi155.stdout: "event": "commit_sent", 2023-08-01T19:55:58.137 INFO:teuthology.orchestra.run.smithi155.stdout: "time": "2023-08-01T19:55:05.224171+0000", 2023-08-01T19:55:58.137 INFO:teuthology.orchestra.run.smithi155.stdout: "duration": 3.3345e-05 2023-08-01T19:55:58.137 INFO:teuthology.orchestra.run.smithi155.stdout: }, 2023-08-01T19:55:58.137 INFO:teuthology.orchestra.run.smithi155.stdout: { 2023-08-01T19:55:58.138 INFO:teuthology.orchestra.run.smithi155.stdout: "event": "done", 2023-08-01T19:55:58.138 INFO:teuthology.orchestra.run.smithi155.stdout: "time": "2023-08-01T19:55:05.224205+0000", 2023-08-01T19:55:58.138 INFO:teuthology.orchestra.run.smithi155.stdout: "duration": 3.3525999999999997e-05 2023-08-01T19:55:58.138 INFO:teuthology.orchestra.run.smithi155.stdout: } 2023-08-01T19:55:58.138 INFO:teuthology.orchestra.run.smithi155.stdout: ] 2023-08-01T19:55:58.138 INFO:teuthology.orchestra.run.smithi155.stdout: } 2023-08-01T19:55:58.138 INFO:teuthology.orchestra.run.smithi155.stdout: }, 2023-08-01T19:55:58.139 INFO:teuthology.orchestra.run.smithi155.stdout: { 2023-08-01T19:55:58.139 INFO:teuthology.orchestra.run.smithi155.stdout: "description": "osd_repop_reply(client.4668.0:100237 5.4 e37/19 ondisk, result = 0)", 2023-08-01T19:55:58.139 INFO:teuthology.orchestra.run.smithi155.stdout: "initiated_at": "2023-08-01T19:55:05.156249+0000", 2023-08-01T19:55:58.139 INFO:teuthology.orchestra.run.smithi155.stdout: "age": 52.861784702000001, 2023-08-01T19:55:58.139 INFO:teuthology.orchestra.run.smithi155.stdout: "duration": 0.062792549000000003, 2023-08-01T19:55:58.139 INFO:teuthology.orchestra.run.smithi155.stdout: "type_data": { 2023-08-01T19:55:58.139 INFO:teuthology.orchestra.run.smithi155.stdout: "flag_point": "started", 2023-08-01T19:55:58.139 INFO:teuthology.orchestra.run.smithi155.stdout: "events": [ 2023-08-01T19:55:58.140 INFO:teuthology.orchestra.run.smithi155.stdout: { 2023-08-01T19:55:58.140 INFO:teuthology.orchestra.run.smithi155.stdout: "event": "initiated", 2023-08-01T19:55:58.140 INFO:teuthology.orchestra.run.smithi155.stdout: "time": "2023-08-01T19:55:05.156249+0000", 2023-08-01T19:55:58.140 INFO:teuthology.orchestra.run.smithi155.stdout: "duration": 0 2023-08-01T19:55:58.140 INFO:teuthology.orchestra.run.smithi155.stdout: }, 2023-08-01T19:55:58.140 INFO:teuthology.orchestra.run.smithi155.stdout: { 2023-08-01T19:55:58.140 INFO:teuthology.orchestra.run.smithi155.stdout: "event": "throttled", 2023-08-01T19:55:58.140 INFO:teuthology.orchestra.run.smithi155.stdout: "time": "2023-08-01T19:55:05.156249+0000", 2023-08-01T19:55:58.141 INFO:teuthology.orchestra.run.smithi155.stdout: "duration": 0 2023-08-01T19:55:58.141 INFO:teuthology.orchestra.run.smithi155.stdout: }, 2023-08-01T19:55:58.141 INFO:teuthology.orchestra.run.smithi155.stdout: { 2023-08-01T19:55:58.141 INFO:teuthology.orchestra.run.smithi155.stdout: "event": "header_read", 2023-08-01T19:55:58.141 INFO:teuthology.orchestra.run.smithi155.stdout: "time": "2023-08-01T19:55:05.156248+0000", 2023-08-01T19:55:58.141 INFO:teuthology.orchestra.run.smithi155.stdout: "duration": 4294967295.9999995 2023-08-01T19:55:58.141 INFO:teuthology.orchestra.run.smithi155.stdout: }, 2023-08-01T19:55:58.141 INFO:teuthology.orchestra.run.smithi155.stdout: { 2023-08-01T19:55:58.142 INFO:teuthology.orchestra.run.smithi155.stdout: "event": "all_read", 2023-08-01T19:55:58.142 INFO:teuthology.orchestra.run.smithi155.stdout: "time": "2023-08-01T19:55:05.156252+0000", 2023-08-01T19:55:58.142 INFO:teuthology.orchestra.run.smithi155.stdout: "duration": 3.9999999999999998e-06 2023-08-01T19:55:58.142 INFO:teuthology.orchestra.run.smithi155.stdout: }, 2023-08-01T19:55:58.142 INFO:teuthology.orchestra.run.smithi155.stdout: { 2023-08-01T19:55:58.142 INFO:teuthology.orchestra.run.smithi155.stdout: "event": "dispatched", 2023-08-01T19:55:58.142 INFO:teuthology.orchestra.run.smithi155.stdout: "time": "2023-08-01T19:55:05.218844+0000", 2023-08-01T19:55:58.142 INFO:teuthology.orchestra.run.smithi155.stdout: "duration": 0.062591516999999999 2023-08-01T19:55:58.143 INFO:teuthology.orchestra.run.smithi155.stdout: }, 2023-08-01T19:55:58.143 INFO:teuthology.orchestra.run.smithi155.stdout: { 2023-08-01T19:55:58.143 INFO:teuthology.orchestra.run.smithi155.stdout: "event": "queued_for_pg", 2023-08-01T19:55:58.143 INFO:teuthology.orchestra.run.smithi155.stdout: "time": "2023-08-01T19:55:05.218862+0000", 2023-08-01T19:55:58.143 INFO:teuthology.orchestra.run.smithi155.stdout: "duration": 1.7666e-05 2023-08-01T19:55:58.143 INFO:teuthology.orchestra.run.smithi155.stdout: }, 2023-08-01T19:55:58.143 INFO:teuthology.orchestra.run.smithi155.stdout: { 2023-08-01T19:55:58.144 INFO:teuthology.orchestra.run.smithi155.stdout: "event": "reached_pg", 2023-08-01T19:55:58.144 INFO:teuthology.orchestra.run.smithi155.stdout: "time": "2023-08-01T19:55:05.218914+0000", 2023-08-01T19:55:58.144 INFO:teuthology.orchestra.run.smithi155.stdout: "duration": 5.2565999999999998e-05 2023-08-01T19:55:58.144 INFO:teuthology.orchestra.run.smithi155.stdout: }, 2023-08-01T19:55:58.144 INFO:teuthology.orchestra.run.smithi155.stdout: { 2023-08-01T19:55:58.144 INFO:teuthology.orchestra.run.smithi155.stdout: "event": "started", 2023-08-01T19:55:58.144 INFO:teuthology.orchestra.run.smithi155.stdout: "time": "2023-08-01T19:55:05.218925+0000", 2023-08-01T19:55:58.144 INFO:teuthology.orchestra.run.smithi155.stdout: "duration": 1.1375e-05 2023-08-01T19:55:58.145 INFO:teuthology.orchestra.run.smithi155.stdout: }, 2023-08-01T19:55:58.145 INFO:teuthology.orchestra.run.smithi155.stdout: { 2023-08-01T19:55:58.145 INFO:teuthology.orchestra.run.smithi155.stdout: "event": "done", 2023-08-01T19:55:58.145 INFO:teuthology.orchestra.run.smithi155.stdout: "time": "2023-08-01T19:55:05.219041+0000", 2023-08-01T19:55:58.145 INFO:teuthology.orchestra.run.smithi155.stdout: "duration": 0.000115977 2023-08-01T19:55:58.145 INFO:teuthology.orchestra.run.smithi155.stdout: } 2023-08-01T19:55:58.145 INFO:teuthology.orchestra.run.smithi155.stdout: ] 2023-08-01T19:55:58.145 INFO:teuthology.orchestra.run.smithi155.stdout: } 2023-08-01T19:55:58.146 INFO:teuthology.orchestra.run.smithi155.stdout: }, 2023-08-01T19:55:58.146 INFO:teuthology.orchestra.run.smithi155.stdout: { 2023-08-01T19:55:58.146 INFO:teuthology.orchestra.run.smithi155.stdout: "description": "osd_repop(client.4668.0:100253 5.f e37/19 5:f7bbce05:::benchmark_data_smithi006_114134_object100252:head v 37'6323, mlcod=37'6321)", 2023-08-01T19:55:58.146 INFO:teuthology.orchestra.run.smithi155.stdout: "initiated_at": "2023-08-01T19:55:05.156952+0000", 2023-08-01T19:55:58.146 INFO:teuthology.orchestra.run.smithi155.stdout: "age": 52.861081638999998, 2023-08-01T19:55:58.146 INFO:teuthology.orchestra.run.smithi155.stdout: "duration": 0.068018577999999996, 2023-08-01T19:55:58.146 INFO:teuthology.orchestra.run.smithi155.stdout: "type_data": { 2023-08-01T19:55:58.146 INFO:teuthology.orchestra.run.smithi155.stdout: "flag_point": "commit sent; apply or cleanup", 2023-08-01T19:55:58.147 INFO:teuthology.orchestra.run.smithi155.stdout: "events": [ 2023-08-01T19:55:58.147 INFO:teuthology.orchestra.run.smithi155.stdout: { 2023-08-01T19:55:58.147 INFO:teuthology.orchestra.run.smithi155.stdout: "event": "initiated", 2023-08-01T19:55:58.147 INFO:teuthology.orchestra.run.smithi155.stdout: "time": "2023-08-01T19:55:05.156952+0000", 2023-08-01T19:55:58.147 INFO:teuthology.orchestra.run.smithi155.stdout: "duration": 0 2023-08-01T19:55:58.147 INFO:teuthology.orchestra.run.smithi155.stdout: }, 2023-08-01T19:55:58.147 INFO:teuthology.orchestra.run.smithi155.stdout: { 2023-08-01T19:55:58.148 INFO:teuthology.orchestra.run.smithi155.stdout: "event": "throttled", 2023-08-01T19:55:58.148 INFO:teuthology.orchestra.run.smithi155.stdout: "time": "2023-08-01T19:55:05.156952+0000", 2023-08-01T19:55:58.148 INFO:teuthology.orchestra.run.smithi155.stdout: "duration": 0 2023-08-01T19:55:58.148 INFO:teuthology.orchestra.run.smithi155.stdout: }, 2023-08-01T19:55:58.148 INFO:teuthology.orchestra.run.smithi155.stdout: { 2023-08-01T19:55:58.148 INFO:teuthology.orchestra.run.smithi155.stdout: "event": "header_read", 2023-08-01T19:55:58.148 INFO:teuthology.orchestra.run.smithi155.stdout: "time": "2023-08-01T19:55:05.156951+0000", 2023-08-01T19:55:58.148 INFO:teuthology.orchestra.run.smithi155.stdout: "duration": 4294967295.999999 2023-08-01T19:55:58.149 INFO:teuthology.orchestra.run.smithi155.stdout: }, 2023-08-01T19:55:58.149 INFO:teuthology.orchestra.run.smithi155.stdout: { 2023-08-01T19:55:58.149 INFO:teuthology.orchestra.run.smithi155.stdout: "event": "all_read", 2023-08-01T19:55:58.149 INFO:teuthology.orchestra.run.smithi155.stdout: "time": "2023-08-01T19:55:05.156989+0000", 2023-08-01T19:55:58.149 INFO:teuthology.orchestra.run.smithi155.stdout: "duration": 3.8175e-05 2023-08-01T19:55:58.149 INFO:teuthology.orchestra.run.smithi155.stdout: }, 2023-08-01T19:55:58.149 INFO:teuthology.orchestra.run.smithi155.stdout: { 2023-08-01T19:55:58.149 INFO:teuthology.orchestra.run.smithi155.stdout: "event": "dispatched", 2023-08-01T19:55:58.150 INFO:teuthology.orchestra.run.smithi155.stdout: "time": "2023-08-01T19:55:05.218842+0000", 2023-08-01T19:55:58.150 INFO:teuthology.orchestra.run.smithi155.stdout: "duration": 0.061852299999999999 2023-08-01T19:55:58.150 INFO:teuthology.orchestra.run.smithi155.stdout: }, 2023-08-01T19:55:58.150 INFO:teuthology.orchestra.run.smithi155.stdout: { 2023-08-01T19:55:58.150 INFO:teuthology.orchestra.run.smithi155.stdout: "event": "queued_for_pg", 2023-08-01T19:55:58.150 INFO:teuthology.orchestra.run.smithi155.stdout: "time": "2023-08-01T19:55:05.218862+0000", 2023-08-01T19:55:58.150 INFO:teuthology.orchestra.run.smithi155.stdout: "duration": 1.9854999999999999e-05 2023-08-01T19:55:58.150 INFO:teuthology.orchestra.run.smithi155.stdout: }, 2023-08-01T19:55:58.151 INFO:teuthology.orchestra.run.smithi155.stdout: { 2023-08-01T19:55:58.151 INFO:teuthology.orchestra.run.smithi155.stdout: "event": "reached_pg", 2023-08-01T19:55:58.151 INFO:teuthology.orchestra.run.smithi155.stdout: "time": "2023-08-01T19:55:05.218918+0000", 2023-08-01T19:55:58.151 INFO:teuthology.orchestra.run.smithi155.stdout: "duration": 5.6570000000000002e-05 2023-08-01T19:55:58.151 INFO:teuthology.orchestra.run.smithi155.stdout: }, 2023-08-01T19:55:58.151 INFO:teuthology.orchestra.run.smithi155.stdout: { 2023-08-01T19:55:58.151 INFO:teuthology.orchestra.run.smithi155.stdout: "event": "started", 2023-08-01T19:55:58.151 INFO:teuthology.orchestra.run.smithi155.stdout: "time": "2023-08-01T19:55:05.218940+0000", 2023-08-01T19:55:58.152 INFO:teuthology.orchestra.run.smithi155.stdout: "duration": 2.1804e-05 2023-08-01T19:55:58.152 INFO:teuthology.orchestra.run.smithi155.stdout: }, 2023-08-01T19:55:58.152 INFO:teuthology.orchestra.run.smithi155.stdout: { 2023-08-01T19:55:58.152 INFO:teuthology.orchestra.run.smithi155.stdout: "event": "commit_sent", 2023-08-01T19:55:58.152 INFO:teuthology.orchestra.run.smithi155.stdout: "time": "2023-08-01T19:55:05.224928+0000", 2023-08-01T19:55:58.152 INFO:teuthology.orchestra.run.smithi155.stdout: "duration": 0.0059876759999999999 2023-08-01T19:55:58.152 INFO:teuthology.orchestra.run.smithi155.stdout: }, 2023-08-01T19:55:58.153 INFO:teuthology.orchestra.run.smithi155.stdout: { 2023-08-01T19:55:58.153 INFO:teuthology.orchestra.run.smithi155.stdout: "event": "done", 2023-08-01T19:55:58.153 INFO:teuthology.orchestra.run.smithi155.stdout: "time": "2023-08-01T19:55:05.224971+0000", 2023-08-01T19:55:58.153 INFO:teuthology.orchestra.run.smithi155.stdout: "duration": 4.2929999999999997e-05 2023-08-01T19:55:58.153 INFO:teuthology.orchestra.run.smithi155.stdout: } 2023-08-01T19:55:58.153 INFO:teuthology.orchestra.run.smithi155.stdout: ] 2023-08-01T19:55:58.153 INFO:teuthology.orchestra.run.smithi155.stdout: } 2023-08-01T19:55:58.153 INFO:teuthology.orchestra.run.smithi155.stdout: }, 2023-08-01T19:55:58.154 INFO:teuthology.orchestra.run.smithi155.stdout: { 2023-08-01T19:55:58.154 INFO:teuthology.orchestra.run.smithi155.stdout: "description": "osd_op(client.4668.0:100927 5.0 5:00608ec6:::benchmark_data_smithi006_114134_object100926:head [set-alloc-hint object_size 65536 write_size 65536,write 0~65536] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e37)", 2023-08-01T19:55:58.154 INFO:teuthology.orchestra.run.smithi155.stdout: "initiated_at": "2023-08-01T19:55:05.561169+0000", 2023-08-01T19:55:58.154 INFO:teuthology.orchestra.run.smithi155.stdout: "age": 52.456864736, 2023-08-01T19:55:58.154 INFO:teuthology.orchestra.run.smithi155.stdout: "duration": 0.066411687999999997, 2023-08-01T19:55:58.154 INFO:teuthology.orchestra.run.smithi155.stdout: "type_data": { 2023-08-01T19:55:58.154 INFO:teuthology.orchestra.run.smithi155.stdout: "flag_point": "commit sent; apply or cleanup", 2023-08-01T19:55:58.154 INFO:teuthology.orchestra.run.smithi155.stdout: "client_info": { 2023-08-01T19:55:58.155 INFO:teuthology.orchestra.run.smithi155.stdout: "client": "client.4668", 2023-08-01T19:55:58.155 INFO:teuthology.orchestra.run.smithi155.stdout: "client_addr": "172.21.15.6:0/1709472247", 2023-08-01T19:55:58.155 INFO:teuthology.orchestra.run.smithi155.stdout: "tid": 100927 2023-08-01T19:55:58.155 INFO:teuthology.orchestra.run.smithi155.stdout: }, 2023-08-01T19:55:58.155 INFO:teuthology.orchestra.run.smithi155.stdout: "events": [ 2023-08-01T19:55:58.155 INFO:teuthology.orchestra.run.smithi155.stdout: { 2023-08-01T19:55:58.155 INFO:teuthology.orchestra.run.smithi155.stdout: "event": "initiated", 2023-08-01T19:55:58.155 INFO:teuthology.orchestra.run.smithi155.stdout: "time": "2023-08-01T19:55:05.561169+0000", 2023-08-01T19:55:58.156 INFO:teuthology.orchestra.run.smithi155.stdout: "duration": 0 2023-08-01T19:55:58.156 INFO:teuthology.orchestra.run.smithi155.stdout: }, 2023-08-01T19:55:58.156 INFO:teuthology.orchestra.run.smithi155.stdout: { 2023-08-01T19:55:58.156 INFO:teuthology.orchestra.run.smithi155.stdout: "event": "throttled", 2023-08-01T19:55:58.156 INFO:teuthology.orchestra.run.smithi155.stdout: "time": "2023-08-01T19:55:05.561169+0000", 2023-08-01T19:55:58.156 INFO:teuthology.orchestra.run.smithi155.stdout: "duration": 0 2023-08-01T19:55:58.156 INFO:teuthology.orchestra.run.smithi155.stdout: }, 2023-08-01T19:55:58.156 INFO:teuthology.orchestra.run.smithi155.stdout: { 2023-08-01T19:55:58.157 INFO:teuthology.orchestra.run.smithi155.stdout: "event": "header_read", 2023-08-01T19:55:58.157 INFO:teuthology.orchestra.run.smithi155.stdout: "time": "2023-08-01T19:55:05.561168+0000", 2023-08-01T19:55:58.157 INFO:teuthology.orchestra.run.smithi155.stdout: "duration": 4294967295.9999995 2023-08-01T19:55:58.157 INFO:teuthology.orchestra.run.smithi155.stdout: }, 2023-08-01T19:55:58.157 INFO:teuthology.orchestra.run.smithi155.stdout: { 2023-08-01T19:55:58.157 INFO:teuthology.orchestra.run.smithi155.stdout: "event": "all_read", 2023-08-01T19:55:58.157 INFO:teuthology.orchestra.run.smithi155.stdout: "time": "2023-08-01T19:55:05.561218+0000", 2023-08-01T19:55:58.157 INFO:teuthology.orchestra.run.smithi155.stdout: "duration": 4.9379999999999998e-05 2023-08-01T19:55:58.158 INFO:teuthology.orchestra.run.smithi155.stdout: }, 2023-08-01T19:55:58.158 INFO:teuthology.orchestra.run.smithi155.stdout: { 2023-08-01T19:55:58.158 INFO:teuthology.orchestra.run.smithi155.stdout: "event": "dispatched", 2023-08-01T19:55:58.158 INFO:teuthology.orchestra.run.smithi155.stdout: "time": "2023-08-01T19:55:05.561225+0000", 2023-08-01T19:55:58.158 INFO:teuthology.orchestra.run.smithi155.stdout: "duration": 7.114e-06 2023-08-01T19:55:58.158 INFO:teuthology.orchestra.run.smithi155.stdout: }, 2023-08-01T19:55:58.158 INFO:teuthology.orchestra.run.smithi155.stdout: { 2023-08-01T19:55:58.159 INFO:teuthology.orchestra.run.smithi155.stdout: "event": "queued_for_pg", 2023-08-01T19:55:58.159 INFO:teuthology.orchestra.run.smithi155.stdout: "time": "2023-08-01T19:55:05.561229+0000", 2023-08-01T19:55:58.159 INFO:teuthology.orchestra.run.smithi155.stdout: "duration": 4.2180000000000001e-06 2023-08-01T19:55:58.159 INFO:teuthology.orchestra.run.smithi155.stdout: }, 2023-08-01T19:55:58.159 INFO:teuthology.orchestra.run.smithi155.stdout: { 2023-08-01T19:55:58.159 INFO:teuthology.orchestra.run.smithi155.stdout: "event": "reached_pg", 2023-08-01T19:55:58.159 INFO:teuthology.orchestra.run.smithi155.stdout: "time": "2023-08-01T19:55:05.564737+0000", 2023-08-01T19:55:58.159 INFO:teuthology.orchestra.run.smithi155.stdout: "duration": 0.0035081869999999999 2023-08-01T19:55:58.160 INFO:teuthology.orchestra.run.smithi155.stdout: }, 2023-08-01T19:55:58.160 INFO:teuthology.orchestra.run.smithi155.stdout: { 2023-08-01T19:55:58.160 INFO:teuthology.orchestra.run.smithi155.stdout: "event": "started", 2023-08-01T19:55:58.160 INFO:teuthology.orchestra.run.smithi155.stdout: "time": "2023-08-01T19:55:05.564859+0000", 2023-08-01T19:55:58.160 INFO:teuthology.orchestra.run.smithi155.stdout: "duration": 0.00012165800000000001 2023-08-01T19:55:58.160 INFO:teuthology.orchestra.run.smithi155.stdout: }, 2023-08-01T19:55:58.160 INFO:teuthology.orchestra.run.smithi155.stdout: { 2023-08-01T19:55:58.160 INFO:teuthology.orchestra.run.smithi155.stdout: "event": "waiting for subops from 0", 2023-08-01T19:55:58.161 INFO:teuthology.orchestra.run.smithi155.stdout: "time": "2023-08-01T19:55:05.565009+0000", 2023-08-01T19:55:58.161 INFO:teuthology.orchestra.run.smithi155.stdout: "duration": 0.00014979699999999999 2023-08-01T19:55:58.161 INFO:teuthology.orchestra.run.smithi155.stdout: }, 2023-08-01T19:55:58.161 INFO:teuthology.orchestra.run.smithi155.stdout: { 2023-08-01T19:55:58.161 INFO:teuthology.orchestra.run.smithi155.stdout: "event": "op_commit", 2023-08-01T19:55:58.161 INFO:teuthology.orchestra.run.smithi155.stdout: "time": "2023-08-01T19:55:05.568007+0000", 2023-08-01T19:55:58.161 INFO:teuthology.orchestra.run.smithi155.stdout: "duration": 0.00299796 2023-08-01T19:55:58.161 INFO:teuthology.orchestra.run.smithi155.stdout: }, 2023-08-01T19:55:58.162 INFO:teuthology.orchestra.run.smithi155.stdout: { 2023-08-01T19:55:58.162 INFO:teuthology.orchestra.run.smithi155.stdout: "event": "sub_op_commit_rec", 2023-08-01T19:55:58.162 INFO:teuthology.orchestra.run.smithi155.stdout: "time": "2023-08-01T19:55:05.627520+0000", 2023-08-01T19:55:58.162 INFO:teuthology.orchestra.run.smithi155.stdout: "duration": 0.059513636000000002 2023-08-01T19:55:58.162 INFO:teuthology.orchestra.run.smithi155.stdout: }, 2023-08-01T19:55:58.162 INFO:teuthology.orchestra.run.smithi155.stdout: { 2023-08-01T19:55:58.162 INFO:teuthology.orchestra.run.smithi155.stdout: "event": "commit_sent", 2023-08-01T19:55:58.162 INFO:teuthology.orchestra.run.smithi155.stdout: "time": "2023-08-01T19:55:05.627553+0000", 2023-08-01T19:55:58.163 INFO:teuthology.orchestra.run.smithi155.stdout: "duration": 3.2635999999999997e-05 2023-08-01T19:55:58.163 INFO:teuthology.orchestra.run.smithi155.stdout: }, 2023-08-01T19:55:58.163 INFO:teuthology.orchestra.run.smithi155.stdout: { 2023-08-01T19:55:58.163 INFO:teuthology.orchestra.run.smithi155.stdout: "event": "done", 2023-08-01T19:55:58.163 INFO:teuthology.orchestra.run.smithi155.stdout: "time": "2023-08-01T19:55:05.627581+0000", 2023-08-01T19:55:58.163 INFO:teuthology.orchestra.run.smithi155.stdout: "duration": 2.7681000000000001e-05 2023-08-01T19:55:58.163 INFO:teuthology.orchestra.run.smithi155.stdout: } 2023-08-01T19:55:58.163 INFO:teuthology.orchestra.run.smithi155.stdout: ] 2023-08-01T19:55:58.164 INFO:teuthology.orchestra.run.smithi155.stdout: } 2023-08-01T19:55:58.164 INFO:teuthology.orchestra.run.smithi155.stdout: }, 2023-08-01T19:55:58.164 INFO:teuthology.orchestra.run.smithi155.stdout: { 2023-08-01T19:55:58.164 INFO:teuthology.orchestra.run.smithi155.stdout: "description": "osd_op(client.4668.0:100935 5.e 5:7895b14e:::benchmark_data_smithi006_114134_object100934:head [set-alloc-hint object_size 65536 write_size 65536,write 0~65536] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e37)", 2023-08-01T19:55:58.164 INFO:teuthology.orchestra.run.smithi155.stdout: "initiated_at": "2023-08-01T19:55:05.566666+0000", 2023-08-01T19:55:58.164 INFO:teuthology.orchestra.run.smithi155.stdout: "age": 52.451367435999998, 2023-08-01T19:55:58.164 INFO:teuthology.orchestra.run.smithi155.stdout: "duration": 0.064309016999999996, 2023-08-01T19:55:58.165 INFO:teuthology.orchestra.run.smithi155.stdout: "type_data": { 2023-08-01T19:55:58.165 INFO:teuthology.orchestra.run.smithi155.stdout: "flag_point": "commit sent; apply or cleanup", 2023-08-01T19:55:58.165 INFO:teuthology.orchestra.run.smithi155.stdout: "client_info": { 2023-08-01T19:55:58.165 INFO:teuthology.orchestra.run.smithi155.stdout: "client": "client.4668", 2023-08-01T19:55:58.165 INFO:teuthology.orchestra.run.smithi155.stdout: "client_addr": "172.21.15.6:0/1709472247", 2023-08-01T19:55:58.165 INFO:teuthology.orchestra.run.smithi155.stdout: "tid": 100935 2023-08-01T19:55:58.165 INFO:teuthology.orchestra.run.smithi155.stdout: }, 2023-08-01T19:55:58.165 INFO:teuthology.orchestra.run.smithi155.stdout: "events": [ 2023-08-01T19:55:58.166 INFO:teuthology.orchestra.run.smithi155.stdout: { 2023-08-01T19:55:58.166 INFO:teuthology.orchestra.run.smithi155.stdout: "event": "initiated", 2023-08-01T19:55:58.166 INFO:teuthology.orchestra.run.smithi155.stdout: "time": "2023-08-01T19:55:05.566666+0000", 2023-08-01T19:55:58.166 INFO:teuthology.orchestra.run.smithi155.stdout: "duration": 0 2023-08-01T19:55:58.166 INFO:teuthology.orchestra.run.smithi155.stdout: }, 2023-08-01T19:55:58.166 INFO:teuthology.orchestra.run.smithi155.stdout: { 2023-08-01T19:55:58.166 INFO:teuthology.orchestra.run.smithi155.stdout: "event": "throttled", 2023-08-01T19:55:58.166 INFO:teuthology.orchestra.run.smithi155.stdout: "time": "2023-08-01T19:55:05.566666+0000", 2023-08-01T19:55:58.167 INFO:teuthology.orchestra.run.smithi155.stdout: "duration": 0 2023-08-01T19:55:58.167 INFO:teuthology.orchestra.run.smithi155.stdout: }, 2023-08-01T19:55:58.167 INFO:teuthology.orchestra.run.smithi155.stdout: { 2023-08-01T19:55:58.167 INFO:teuthology.orchestra.run.smithi155.stdout: "event": "header_read", 2023-08-01T19:55:58.167 INFO:teuthology.orchestra.run.smithi155.stdout: "time": "2023-08-01T19:55:05.566665+0000", 2023-08-01T19:55:58.167 INFO:teuthology.orchestra.run.smithi155.stdout: "duration": 4294967295.9999986 2023-08-01T19:55:58.167 INFO:teuthology.orchestra.run.smithi155.stdout: }, 2023-08-01T19:55:58.167 INFO:teuthology.orchestra.run.smithi155.stdout: { 2023-08-01T19:55:58.168 INFO:teuthology.orchestra.run.smithi155.stdout: "event": "all_read", 2023-08-01T19:55:58.168 INFO:teuthology.orchestra.run.smithi155.stdout: "time": "2023-08-01T19:55:05.566754+0000", 2023-08-01T19:55:58.168 INFO:teuthology.orchestra.run.smithi155.stdout: "duration": 8.9425999999999994e-05 2023-08-01T19:55:58.168 INFO:teuthology.orchestra.run.smithi155.stdout: }, 2023-08-01T19:55:58.168 INFO:teuthology.orchestra.run.smithi155.stdout: { 2023-08-01T19:55:58.168 INFO:teuthology.orchestra.run.smithi155.stdout: "event": "dispatched", 2023-08-01T19:55:58.168 INFO:teuthology.orchestra.run.smithi155.stdout: "time": "2023-08-01T19:55:05.566766+0000", 2023-08-01T19:55:58.169 INFO:teuthology.orchestra.run.smithi155.stdout: "duration": 1.2018000000000001e-05 2023-08-01T19:55:58.169 INFO:teuthology.orchestra.run.smithi155.stdout: }, 2023-08-01T19:55:58.169 INFO:teuthology.orchestra.run.smithi155.stdout: { 2023-08-01T19:55:58.169 INFO:teuthology.orchestra.run.smithi155.stdout: "event": "queued_for_pg", 2023-08-01T19:55:58.169 INFO:teuthology.orchestra.run.smithi155.stdout: "time": "2023-08-01T19:55:05.566772+0000", 2023-08-01T19:55:58.169 INFO:teuthology.orchestra.run.smithi155.stdout: "duration": 6.0190000000000003e-06 2023-08-01T19:55:58.169 INFO:teuthology.orchestra.run.smithi155.stdout: }, 2023-08-01T19:55:58.169 INFO:teuthology.orchestra.run.smithi155.stdout: { 2023-08-01T19:55:58.170 INFO:teuthology.orchestra.run.smithi155.stdout: "event": "reached_pg", 2023-08-01T19:55:58.170 INFO:teuthology.orchestra.run.smithi155.stdout: "time": "2023-08-01T19:55:05.566800+0000", 2023-08-01T19:55:58.170 INFO:teuthology.orchestra.run.smithi155.stdout: "duration": 2.7835999999999999e-05 2023-08-01T19:55:58.170 INFO:teuthology.orchestra.run.smithi155.stdout: }, 2023-08-01T19:55:58.170 INFO:teuthology.orchestra.run.smithi155.stdout: { 2023-08-01T19:55:58.170 INFO:teuthology.orchestra.run.smithi155.stdout: "event": "started", 2023-08-01T19:55:58.170 INFO:teuthology.orchestra.run.smithi155.stdout: "time": "2023-08-01T19:55:05.566879+0000", 2023-08-01T19:55:58.170 INFO:teuthology.orchestra.run.smithi155.stdout: "duration": 7.9105999999999998e-05 2023-08-01T19:55:58.171 INFO:teuthology.orchestra.run.smithi155.stdout: }, 2023-08-01T19:55:58.171 INFO:teuthology.orchestra.run.smithi155.stdout: { 2023-08-01T19:55:58.171 INFO:teuthology.orchestra.run.smithi155.stdout: "event": "waiting for subops from 0", 2023-08-01T19:55:58.171 INFO:teuthology.orchestra.run.smithi155.stdout: "time": "2023-08-01T19:55:05.566971+0000", 2023-08-01T19:55:58.171 INFO:teuthology.orchestra.run.smithi155.stdout: "duration": 9.1817999999999994e-05 2023-08-01T19:55:58.171 INFO:teuthology.orchestra.run.smithi155.stdout: }, 2023-08-01T19:55:58.171 INFO:teuthology.orchestra.run.smithi155.stdout: { 2023-08-01T19:55:58.171 INFO:teuthology.orchestra.run.smithi155.stdout: "event": "op_commit", 2023-08-01T19:55:58.172 INFO:teuthology.orchestra.run.smithi155.stdout: "time": "2023-08-01T19:55:05.571475+0000", 2023-08-01T19:55:58.172 INFO:teuthology.orchestra.run.smithi155.stdout: "duration": 0.0045039499999999996 2023-08-01T19:55:58.172 INFO:teuthology.orchestra.run.smithi155.stdout: }, 2023-08-01T19:55:58.172 INFO:teuthology.orchestra.run.smithi155.stdout: { 2023-08-01T19:55:58.172 INFO:teuthology.orchestra.run.smithi155.stdout: "event": "sub_op_commit_rec", 2023-08-01T19:55:58.172 INFO:teuthology.orchestra.run.smithi155.stdout: "time": "2023-08-01T19:55:05.630884+0000", 2023-08-01T19:55:58.172 INFO:teuthology.orchestra.run.smithi155.stdout: "duration": 0.059409181999999998 2023-08-01T19:55:58.172 INFO:teuthology.orchestra.run.smithi155.stdout: }, 2023-08-01T19:55:58.173 INFO:teuthology.orchestra.run.smithi155.stdout: { 2023-08-01T19:55:58.173 INFO:teuthology.orchestra.run.smithi155.stdout: "event": "commit_sent", 2023-08-01T19:55:58.173 INFO:teuthology.orchestra.run.smithi155.stdout: "time": "2023-08-01T19:55:05.630930+0000", 2023-08-01T19:55:58.173 INFO:teuthology.orchestra.run.smithi155.stdout: "duration": 4.5507999999999999e-05 2023-08-01T19:55:58.173 INFO:teuthology.orchestra.run.smithi155.stdout: }, 2023-08-01T19:55:58.173 INFO:teuthology.orchestra.run.smithi155.stdout: { 2023-08-01T19:55:58.173 INFO:teuthology.orchestra.run.smithi155.stdout: "event": "done", 2023-08-01T19:55:58.173 INFO:teuthology.orchestra.run.smithi155.stdout: "time": "2023-08-01T19:55:05.630975+0000", 2023-08-01T19:55:58.174 INFO:teuthology.orchestra.run.smithi155.stdout: "duration": 4.5441000000000001e-05 2023-08-01T19:55:58.174 INFO:teuthology.orchestra.run.smithi155.stdout: } 2023-08-01T19:55:58.174 INFO:teuthology.orchestra.run.smithi155.stdout: ] 2023-08-01T19:55:58.174 INFO:teuthology.orchestra.run.smithi155.stdout: } 2023-08-01T19:55:58.174 INFO:teuthology.orchestra.run.smithi155.stdout: }, 2023-08-01T19:55:58.174 INFO:teuthology.orchestra.run.smithi155.stdout: { 2023-08-01T19:55:58.174 INFO:teuthology.orchestra.run.smithi155.stdout: "description": "osd_op(client.4668.0:100941 5.e 5:736a6ac6:::benchmark_data_smithi006_114134_object100940:head [set-alloc-hint object_size 65536 write_size 65536,write 0~65536] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e37)", 2023-08-01T19:55:58.174 INFO:teuthology.orchestra.run.smithi155.stdout: "initiated_at": "2023-08-01T19:55:05.569750+0000", 2023-08-01T19:55:58.175 INFO:teuthology.orchestra.run.smithi155.stdout: "age": 52.448283543000002, 2023-08-01T19:55:58.175 INFO:teuthology.orchestra.run.smithi155.stdout: "duration": 0.065431331999999995, 2023-08-01T19:55:58.175 INFO:teuthology.orchestra.run.smithi155.stdout: "type_data": { 2023-08-01T19:55:58.175 INFO:teuthology.orchestra.run.smithi155.stdout: "flag_point": "commit sent; apply or cleanup", 2023-08-01T19:55:58.175 INFO:teuthology.orchestra.run.smithi155.stdout: "client_info": { 2023-08-01T19:55:58.175 INFO:teuthology.orchestra.run.smithi155.stdout: "client": "client.4668", 2023-08-01T19:55:58.175 INFO:teuthology.orchestra.run.smithi155.stdout: "client_addr": "172.21.15.6:0/1709472247", 2023-08-01T19:55:58.176 INFO:teuthology.orchestra.run.smithi155.stdout: "tid": 100941 2023-08-01T19:55:58.176 INFO:teuthology.orchestra.run.smithi155.stdout: }, 2023-08-01T19:55:58.176 INFO:teuthology.orchestra.run.smithi155.stdout: "events": [ 2023-08-01T19:55:58.176 INFO:teuthology.orchestra.run.smithi155.stdout: { 2023-08-01T19:55:58.176 INFO:teuthology.orchestra.run.smithi155.stdout: "event": "initiated", 2023-08-01T19:55:58.176 INFO:teuthology.orchestra.run.smithi155.stdout: "time": "2023-08-01T19:55:05.569750+0000", 2023-08-01T19:55:58.176 INFO:teuthology.orchestra.run.smithi155.stdout: "duration": 0 2023-08-01T19:55:58.176 INFO:teuthology.orchestra.run.smithi155.stdout: }, 2023-08-01T19:55:58.177 INFO:teuthology.orchestra.run.smithi155.stdout: { 2023-08-01T19:55:58.177 INFO:teuthology.orchestra.run.smithi155.stdout: "event": "throttled", 2023-08-01T19:55:58.177 INFO:teuthology.orchestra.run.smithi155.stdout: "time": "2023-08-01T19:55:05.569750+0000", 2023-08-01T19:55:58.177 INFO:teuthology.orchestra.run.smithi155.stdout: "duration": 0 2023-08-01T19:55:58.177 INFO:teuthology.orchestra.run.smithi155.stdout: }, 2023-08-01T19:55:58.177 INFO:teuthology.orchestra.run.smithi155.stdout: { 2023-08-01T19:55:58.177 INFO:teuthology.orchestra.run.smithi155.stdout: "event": "header_read", 2023-08-01T19:55:58.177 INFO:teuthology.orchestra.run.smithi155.stdout: "time": "2023-08-01T19:55:05.569749+0000", 2023-08-01T19:55:58.178 INFO:teuthology.orchestra.run.smithi155.stdout: "duration": 4294967295.999999 2023-08-01T19:55:58.178 INFO:teuthology.orchestra.run.smithi155.stdout: }, 2023-08-01T19:55:58.178 INFO:teuthology.orchestra.run.smithi155.stdout: { 2023-08-01T19:55:58.178 INFO:teuthology.orchestra.run.smithi155.stdout: "event": "all_read", 2023-08-01T19:55:58.178 INFO:teuthology.orchestra.run.smithi155.stdout: "time": "2023-08-01T19:55:05.569861+0000", 2023-08-01T19:55:58.178 INFO:teuthology.orchestra.run.smithi155.stdout: "duration": 0.000111333 2023-08-01T19:55:58.178 INFO:teuthology.orchestra.run.smithi155.stdout: }, 2023-08-01T19:55:58.178 INFO:teuthology.orchestra.run.smithi155.stdout: { 2023-08-01T19:55:58.179 INFO:teuthology.orchestra.run.smithi155.stdout: "event": "dispatched", 2023-08-01T19:55:58.179 INFO:teuthology.orchestra.run.smithi155.stdout: "time": "2023-08-01T19:55:05.569869+0000", 2023-08-01T19:55:58.179 INFO:teuthology.orchestra.run.smithi155.stdout: "duration": 8.8589999999999994e-06 2023-08-01T19:55:58.179 INFO:teuthology.orchestra.run.smithi155.stdout: }, 2023-08-01T19:55:58.179 INFO:teuthology.orchestra.run.smithi155.stdout: { 2023-08-01T19:55:58.179 INFO:teuthology.orchestra.run.smithi155.stdout: "event": "queued_for_pg", 2023-08-01T19:55:58.179 INFO:teuthology.orchestra.run.smithi155.stdout: "time": "2023-08-01T19:55:05.569874+0000", 2023-08-01T19:55:58.179 INFO:teuthology.orchestra.run.smithi155.stdout: "duration": 4.1679999999999997e-06 2023-08-01T19:55:58.180 INFO:teuthology.orchestra.run.smithi155.stdout: }, 2023-08-01T19:55:58.180 INFO:teuthology.orchestra.run.smithi155.stdout: { 2023-08-01T19:55:58.180 INFO:teuthology.orchestra.run.smithi155.stdout: "event": "reached_pg", 2023-08-01T19:55:58.180 INFO:teuthology.orchestra.run.smithi155.stdout: "time": "2023-08-01T19:55:05.569904+0000", 2023-08-01T19:55:58.180 INFO:teuthology.orchestra.run.smithi155.stdout: "duration": 3.0920999999999998e-05 2023-08-01T19:55:58.180 INFO:teuthology.orchestra.run.smithi155.stdout: }, 2023-08-01T19:55:58.180 INFO:teuthology.orchestra.run.smithi155.stdout: { 2023-08-01T19:55:58.181 INFO:teuthology.orchestra.run.smithi155.stdout: "event": "started", 2023-08-01T19:55:58.181 INFO:teuthology.orchestra.run.smithi155.stdout: "time": "2023-08-01T19:55:05.569998+0000", 2023-08-01T19:55:58.181 INFO:teuthology.orchestra.run.smithi155.stdout: "duration": 9.3086999999999998e-05 2023-08-01T19:55:58.181 INFO:teuthology.orchestra.run.smithi155.stdout: }, 2023-08-01T19:55:58.181 INFO:teuthology.orchestra.run.smithi155.stdout: { 2023-08-01T19:55:58.181 INFO:teuthology.orchestra.run.smithi155.stdout: "event": "waiting for subops from 0", 2023-08-01T19:55:58.181 INFO:teuthology.orchestra.run.smithi155.stdout: "time": "2023-08-01T19:55:05.570093+0000", 2023-08-01T19:55:58.181 INFO:teuthology.orchestra.run.smithi155.stdout: "duration": 9.5768999999999997e-05 2023-08-01T19:55:58.182 INFO:teuthology.orchestra.run.smithi155.stdout: }, 2023-08-01T19:55:58.182 INFO:teuthology.orchestra.run.smithi155.stdout: { 2023-08-01T19:55:58.182 INFO:teuthology.orchestra.run.smithi155.stdout: "event": "op_commit", 2023-08-01T19:55:58.182 INFO:teuthology.orchestra.run.smithi155.stdout: "time": "2023-08-01T19:55:05.572839+0000", 2023-08-01T19:55:58.182 INFO:teuthology.orchestra.run.smithi155.stdout: "duration": 0.0027460050000000001 2023-08-01T19:55:58.182 INFO:teuthology.orchestra.run.smithi155.stdout: }, 2023-08-01T19:55:58.182 INFO:teuthology.orchestra.run.smithi155.stdout: { 2023-08-01T19:55:58.182 INFO:teuthology.orchestra.run.smithi155.stdout: "event": "sub_op_commit_rec", 2023-08-01T19:55:58.183 INFO:teuthology.orchestra.run.smithi155.stdout: "time": "2023-08-01T19:55:05.635114+0000", 2023-08-01T19:55:58.183 INFO:teuthology.orchestra.run.smithi155.stdout: "duration": 0.062274297999999999 2023-08-01T19:55:58.183 INFO:teuthology.orchestra.run.smithi155.stdout: }, 2023-08-01T19:55:58.183 INFO:teuthology.orchestra.run.smithi155.stdout: { 2023-08-01T19:55:58.183 INFO:teuthology.orchestra.run.smithi155.stdout: "event": "commit_sent", 2023-08-01T19:55:58.183 INFO:teuthology.orchestra.run.smithi155.stdout: "time": "2023-08-01T19:55:05.635143+0000", 2023-08-01T19:55:58.183 INFO:teuthology.orchestra.run.smithi155.stdout: "duration": 2.9430000000000001e-05 2023-08-01T19:55:58.183 INFO:teuthology.orchestra.run.smithi155.stdout: }, 2023-08-01T19:55:58.184 INFO:teuthology.orchestra.run.smithi155.stdout: { 2023-08-01T19:55:58.184 INFO:teuthology.orchestra.run.smithi155.stdout: "event": "done", 2023-08-01T19:55:58.184 INFO:teuthology.orchestra.run.smithi155.stdout: "time": "2023-08-01T19:55:05.635181+0000", 2023-08-01T19:55:58.184 INFO:teuthology.orchestra.run.smithi155.stdout: "duration": 3.8352000000000001e-05 2023-08-01T19:55:58.184 INFO:teuthology.orchestra.run.smithi155.stdout: } 2023-08-01T19:55:58.184 INFO:teuthology.orchestra.run.smithi155.stdout: ] 2023-08-01T19:55:58.184 INFO:teuthology.orchestra.run.smithi155.stdout: } 2023-08-01T19:55:58.184 INFO:teuthology.orchestra.run.smithi155.stdout: }, 2023-08-01T19:55:58.185 INFO:teuthology.orchestra.run.smithi155.stdout: { 2023-08-01T19:55:58.185 INFO:teuthology.orchestra.run.smithi155.stdout: "description": "osd_op(client.4668.0:100944 5.4 5:25fae865:::benchmark_data_smithi006_114134_object100943:head [set-alloc-hint object_size 65536 write_size 65536,write 0~65536] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e37)", 2023-08-01T19:55:58.185 INFO:teuthology.orchestra.run.smithi155.stdout: "initiated_at": "2023-08-01T19:55:05.576662+0000", 2023-08-01T19:55:58.185 INFO:teuthology.orchestra.run.smithi155.stdout: "age": 52.441371846000003, 2023-08-01T19:55:58.185 INFO:teuthology.orchestra.run.smithi155.stdout: "duration": 0.056054925999999998, 2023-08-01T19:55:58.185 INFO:teuthology.orchestra.run.smithi155.stdout: "type_data": { 2023-08-01T19:55:58.185 INFO:teuthology.orchestra.run.smithi155.stdout: "flag_point": "commit sent; apply or cleanup", 2023-08-01T19:55:58.185 INFO:teuthology.orchestra.run.smithi155.stdout: "client_info": { 2023-08-01T19:55:58.186 INFO:teuthology.orchestra.run.smithi155.stdout: "client": "client.4668", 2023-08-01T19:55:58.186 INFO:teuthology.orchestra.run.smithi155.stdout: "client_addr": "172.21.15.6:0/1709472247", 2023-08-01T19:55:58.186 INFO:teuthology.orchestra.run.smithi155.stdout: "tid": 100944 2023-08-01T19:55:58.186 INFO:teuthology.orchestra.run.smithi155.stdout: }, 2023-08-01T19:55:58.186 INFO:teuthology.orchestra.run.smithi155.stdout: "events": [ 2023-08-01T19:55:58.186 INFO:teuthology.orchestra.run.smithi155.stdout: { 2023-08-01T19:55:58.186 INFO:teuthology.orchestra.run.smithi155.stdout: "event": "initiated", 2023-08-01T19:55:58.187 INFO:teuthology.orchestra.run.smithi155.stdout: "time": "2023-08-01T19:55:05.576662+0000", 2023-08-01T19:55:58.187 INFO:teuthology.orchestra.run.smithi155.stdout: "duration": 0 2023-08-01T19:55:58.187 INFO:teuthology.orchestra.run.smithi155.stdout: }, 2023-08-01T19:55:58.187 INFO:teuthology.orchestra.run.smithi155.stdout: { 2023-08-01T19:55:58.187 INFO:teuthology.orchestra.run.smithi155.stdout: "event": "throttled", 2023-08-01T19:55:58.187 INFO:teuthology.orchestra.run.smithi155.stdout: "time": "2023-08-01T19:55:05.576662+0000", 2023-08-01T19:55:58.187 INFO:teuthology.orchestra.run.smithi155.stdout: "duration": 0 2023-08-01T19:55:58.187 INFO:teuthology.orchestra.run.smithi155.stdout: }, 2023-08-01T19:55:58.188 INFO:teuthology.orchestra.run.smithi155.stdout: { 2023-08-01T19:55:58.188 INFO:teuthology.orchestra.run.smithi155.stdout: "event": "header_read", 2023-08-01T19:55:58.188 INFO:teuthology.orchestra.run.smithi155.stdout: "time": "2023-08-01T19:55:05.576661+0000", 2023-08-01T19:55:58.188 INFO:teuthology.orchestra.run.smithi155.stdout: "duration": 4294967295.999999 2023-08-01T19:55:58.188 INFO:teuthology.orchestra.run.smithi155.stdout: }, 2023-08-01T19:55:58.188 INFO:teuthology.orchestra.run.smithi155.stdout: { 2023-08-01T19:55:58.188 INFO:teuthology.orchestra.run.smithi155.stdout: "event": "all_read", 2023-08-01T19:55:58.188 INFO:teuthology.orchestra.run.smithi155.stdout: "time": "2023-08-01T19:55:05.576725+0000", 2023-08-01T19:55:58.189 INFO:teuthology.orchestra.run.smithi155.stdout: "duration": 6.4435000000000002e-05 2023-08-01T19:55:58.189 INFO:teuthology.orchestra.run.smithi155.stdout: }, 2023-08-01T19:55:58.189 INFO:teuthology.orchestra.run.smithi155.stdout: { 2023-08-01T19:55:58.189 INFO:teuthology.orchestra.run.smithi155.stdout: "event": "dispatched", 2023-08-01T19:55:58.189 INFO:teuthology.orchestra.run.smithi155.stdout: "time": "2023-08-01T19:55:05.576744+0000", 2023-08-01T19:55:58.189 INFO:teuthology.orchestra.run.smithi155.stdout: "duration": 1.8502999999999999e-05 2023-08-01T19:55:58.189 INFO:teuthology.orchestra.run.smithi155.stdout: }, 2023-08-01T19:55:58.189 INFO:teuthology.orchestra.run.smithi155.stdout: { 2023-08-01T19:55:58.190 INFO:teuthology.orchestra.run.smithi155.stdout: "event": "queued_for_pg", 2023-08-01T19:55:58.190 INFO:teuthology.orchestra.run.smithi155.stdout: "time": "2023-08-01T19:55:05.576772+0000", 2023-08-01T19:55:58.190 INFO:teuthology.orchestra.run.smithi155.stdout: "duration": 2.8354999999999999e-05 2023-08-01T19:55:58.190 INFO:teuthology.orchestra.run.smithi155.stdout: }, 2023-08-01T19:55:58.190 INFO:teuthology.orchestra.run.smithi155.stdout: { 2023-08-01T19:55:58.190 INFO:teuthology.orchestra.run.smithi155.stdout: "event": "reached_pg", 2023-08-01T19:55:58.190 INFO:teuthology.orchestra.run.smithi155.stdout: "time": "2023-08-01T19:55:05.576815+0000", 2023-08-01T19:55:58.190 INFO:teuthology.orchestra.run.smithi155.stdout: "duration": 4.3223999999999998e-05 2023-08-01T19:55:58.191 INFO:teuthology.orchestra.run.smithi155.stdout: }, 2023-08-01T19:55:58.191 INFO:teuthology.orchestra.run.smithi155.stdout: { 2023-08-01T19:55:58.191 INFO:teuthology.orchestra.run.smithi155.stdout: "event": "started", 2023-08-01T19:55:58.191 INFO:teuthology.orchestra.run.smithi155.stdout: "time": "2023-08-01T19:55:05.576961+0000", 2023-08-01T19:55:58.191 INFO:teuthology.orchestra.run.smithi155.stdout: "duration": 0.000145043 2023-08-01T19:55:58.191 INFO:teuthology.orchestra.run.smithi155.stdout: }, 2023-08-01T19:55:58.191 INFO:teuthology.orchestra.run.smithi155.stdout: { 2023-08-01T19:55:58.191 INFO:teuthology.orchestra.run.smithi155.stdout: "event": "waiting for subops from 0", 2023-08-01T19:55:58.192 INFO:teuthology.orchestra.run.smithi155.stdout: "time": "2023-08-01T19:55:05.577343+0000", 2023-08-01T19:55:58.192 INFO:teuthology.orchestra.run.smithi155.stdout: "duration": 0.00038249699999999998 2023-08-01T19:55:58.192 INFO:teuthology.orchestra.run.smithi155.stdout: }, 2023-08-01T19:55:58.192 INFO:teuthology.orchestra.run.smithi155.stdout: { 2023-08-01T19:55:58.192 INFO:teuthology.orchestra.run.smithi155.stdout: "event": "op_commit", 2023-08-01T19:55:58.192 INFO:teuthology.orchestra.run.smithi155.stdout: "time": "2023-08-01T19:55:05.582349+0000", 2023-08-01T19:55:58.192 INFO:teuthology.orchestra.run.smithi155.stdout: "duration": 0.0050062880000000002 2023-08-01T19:55:58.193 INFO:teuthology.orchestra.run.smithi155.stdout: }, 2023-08-01T19:55:58.193 INFO:teuthology.orchestra.run.smithi155.stdout: { 2023-08-01T19:55:58.193 INFO:teuthology.orchestra.run.smithi155.stdout: "event": "sub_op_commit_rec", 2023-08-01T19:55:58.193 INFO:teuthology.orchestra.run.smithi155.stdout: "time": "2023-08-01T19:55:05.632659+0000", 2023-08-01T19:55:58.193 INFO:teuthology.orchestra.run.smithi155.stdout: "duration": 0.050309185999999999 2023-08-01T19:55:58.193 INFO:teuthology.orchestra.run.smithi155.stdout: }, 2023-08-01T19:55:58.193 INFO:teuthology.orchestra.run.smithi155.stdout: { 2023-08-01T19:55:58.193 INFO:teuthology.orchestra.run.smithi155.stdout: "event": "commit_sent", 2023-08-01T19:55:58.194 INFO:teuthology.orchestra.run.smithi155.stdout: "time": "2023-08-01T19:55:05.632692+0000", 2023-08-01T19:55:58.194 INFO:teuthology.orchestra.run.smithi155.stdout: "duration": 3.3077999999999997e-05 2023-08-01T19:55:58.194 INFO:teuthology.orchestra.run.smithi155.stdout: }, 2023-08-01T19:55:58.194 INFO:teuthology.orchestra.run.smithi155.stdout: { 2023-08-01T19:55:58.194 INFO:teuthology.orchestra.run.smithi155.stdout: "event": "done", 2023-08-01T19:55:58.194 INFO:teuthology.orchestra.run.smithi155.stdout: "time": "2023-08-01T19:55:05.632717+0000", 2023-08-01T19:55:58.194 INFO:teuthology.orchestra.run.smithi155.stdout: "duration": 2.5119000000000001e-05 2023-08-01T19:55:58.194 INFO:teuthology.orchestra.run.smithi155.stdout: } 2023-08-01T19:55:58.195 INFO:teuthology.orchestra.run.smithi155.stdout: ] 2023-08-01T19:55:58.195 INFO:teuthology.orchestra.run.smithi155.stdout: } 2023-08-01T19:55:58.195 INFO:teuthology.orchestra.run.smithi155.stdout: }, 2023-08-01T19:55:58.195 INFO:teuthology.orchestra.run.smithi155.stdout: { 2023-08-01T19:55:58.195 INFO:teuthology.orchestra.run.smithi155.stdout: "description": "osd_op(client.4668.0:100945 5.e 5:73df68dd:::benchmark_data_smithi006_114134_object100944:head [set-alloc-hint object_size 65536 write_size 65536,write 0~65536] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e37)", 2023-08-01T19:55:58.195 INFO:teuthology.orchestra.run.smithi155.stdout: "initiated_at": "2023-08-01T19:55:05.576784+0000", 2023-08-01T19:55:58.195 INFO:teuthology.orchestra.run.smithi155.stdout: "age": 52.441249958, 2023-08-01T19:55:58.195 INFO:teuthology.orchestra.run.smithi155.stdout: "duration": 0.058512994999999998, 2023-08-01T19:55:58.196 INFO:teuthology.orchestra.run.smithi155.stdout: "type_data": { 2023-08-01T19:55:58.196 INFO:teuthology.orchestra.run.smithi155.stdout: "flag_point": "commit sent; apply or cleanup", 2023-08-01T19:55:58.196 INFO:teuthology.orchestra.run.smithi155.stdout: "client_info": { 2023-08-01T19:55:58.196 INFO:teuthology.orchestra.run.smithi155.stdout: "client": "client.4668", 2023-08-01T19:55:58.196 INFO:teuthology.orchestra.run.smithi155.stdout: "client_addr": "172.21.15.6:0/1709472247", 2023-08-01T19:55:58.196 INFO:teuthology.orchestra.run.smithi155.stdout: "tid": 100945 2023-08-01T19:55:58.196 INFO:teuthology.orchestra.run.smithi155.stdout: }, 2023-08-01T19:55:58.197 INFO:teuthology.orchestra.run.smithi155.stdout: "events": [ 2023-08-01T19:55:58.197 INFO:teuthology.orchestra.run.smithi155.stdout: { 2023-08-01T19:55:58.197 INFO:teuthology.orchestra.run.smithi155.stdout: "event": "initiated", 2023-08-01T19:55:58.197 INFO:teuthology.orchestra.run.smithi155.stdout: "time": "2023-08-01T19:55:05.576784+0000", 2023-08-01T19:55:58.197 INFO:teuthology.orchestra.run.smithi155.stdout: "duration": 0 2023-08-01T19:55:58.197 INFO:teuthology.orchestra.run.smithi155.stdout: }, 2023-08-01T19:55:58.197 INFO:teuthology.orchestra.run.smithi155.stdout: { 2023-08-01T19:55:58.197 INFO:teuthology.orchestra.run.smithi155.stdout: "event": "throttled", 2023-08-01T19:55:58.198 INFO:teuthology.orchestra.run.smithi155.stdout: "time": "2023-08-01T19:55:05.576784+0000", 2023-08-01T19:55:58.198 INFO:teuthology.orchestra.run.smithi155.stdout: "duration": 0 2023-08-01T19:55:58.198 INFO:teuthology.orchestra.run.smithi155.stdout: }, 2023-08-01T19:55:58.198 INFO:teuthology.orchestra.run.smithi155.stdout: { 2023-08-01T19:55:58.198 INFO:teuthology.orchestra.run.smithi155.stdout: "event": "header_read", 2023-08-01T19:55:58.198 INFO:teuthology.orchestra.run.smithi155.stdout: "time": "2023-08-01T19:55:05.576783+0000", 2023-08-01T19:55:58.198 INFO:teuthology.orchestra.run.smithi155.stdout: "duration": 4294967295.9999995 2023-08-01T19:55:58.198 INFO:teuthology.orchestra.run.smithi155.stdout: }, 2023-08-01T19:55:58.199 INFO:teuthology.orchestra.run.smithi155.stdout: { 2023-08-01T19:55:58.199 INFO:teuthology.orchestra.run.smithi155.stdout: "event": "all_read", 2023-08-01T19:55:58.199 INFO:teuthology.orchestra.run.smithi155.stdout: "time": "2023-08-01T19:55:05.576807+0000", 2023-08-01T19:55:58.199 INFO:teuthology.orchestra.run.smithi155.stdout: "duration": 2.3651000000000001e-05 2023-08-01T19:55:58.199 INFO:teuthology.orchestra.run.smithi155.stdout: }, 2023-08-01T19:55:58.199 INFO:teuthology.orchestra.run.smithi155.stdout: { 2023-08-01T19:55:58.199 INFO:teuthology.orchestra.run.smithi155.stdout: "event": "dispatched", 2023-08-01T19:55:58.199 INFO:teuthology.orchestra.run.smithi155.stdout: "time": "2023-08-01T19:55:05.576817+0000", 2023-08-01T19:55:58.200 INFO:teuthology.orchestra.run.smithi155.stdout: "duration": 9.9389999999999992e-06 2023-08-01T19:55:58.200 INFO:teuthology.orchestra.run.smithi155.stdout: }, 2023-08-01T19:55:58.200 INFO:teuthology.orchestra.run.smithi155.stdout: { 2023-08-01T19:55:58.200 INFO:teuthology.orchestra.run.smithi155.stdout: "event": "queued_for_pg", 2023-08-01T19:55:58.200 INFO:teuthology.orchestra.run.smithi155.stdout: "time": "2023-08-01T19:55:05.576820+0000", 2023-08-01T19:55:58.200 INFO:teuthology.orchestra.run.smithi155.stdout: "duration": 3.2619999999999999e-06 2023-08-01T19:55:58.200 INFO:teuthology.orchestra.run.smithi155.stdout: }, 2023-08-01T19:55:58.200 INFO:teuthology.orchestra.run.smithi155.stdout: { 2023-08-01T19:55:58.201 INFO:teuthology.orchestra.run.smithi155.stdout: "event": "reached_pg", 2023-08-01T19:55:58.201 INFO:teuthology.orchestra.run.smithi155.stdout: "time": "2023-08-01T19:55:05.576849+0000", 2023-08-01T19:55:58.201 INFO:teuthology.orchestra.run.smithi155.stdout: "duration": 2.8880000000000001e-05 2023-08-01T19:55:58.201 INFO:teuthology.orchestra.run.smithi155.stdout: }, 2023-08-01T19:55:58.201 INFO:teuthology.orchestra.run.smithi155.stdout: { 2023-08-01T19:55:58.201 INFO:teuthology.orchestra.run.smithi155.stdout: "event": "started", 2023-08-01T19:55:58.201 INFO:teuthology.orchestra.run.smithi155.stdout: "time": "2023-08-01T19:55:05.576940+0000", 2023-08-01T19:55:58.201 INFO:teuthology.orchestra.run.smithi155.stdout: "duration": 9.0570999999999997e-05 2023-08-01T19:55:58.202 INFO:teuthology.orchestra.run.smithi155.stdout: }, 2023-08-01T19:55:58.202 INFO:teuthology.orchestra.run.smithi155.stdout: { 2023-08-01T19:55:58.202 INFO:teuthology.orchestra.run.smithi155.stdout: "event": "waiting for subops from 0", 2023-08-01T19:55:58.202 INFO:teuthology.orchestra.run.smithi155.stdout: "time": "2023-08-01T19:55:05.577027+0000", 2023-08-01T19:55:58.202 INFO:teuthology.orchestra.run.smithi155.stdout: "duration": 8.7237999999999994e-05 2023-08-01T19:55:58.202 INFO:teuthology.orchestra.run.smithi155.stdout: }, 2023-08-01T19:55:58.202 INFO:teuthology.orchestra.run.smithi155.stdout: { 2023-08-01T19:55:58.202 INFO:teuthology.orchestra.run.smithi155.stdout: "event": "op_commit", 2023-08-01T19:55:58.203 INFO:teuthology.orchestra.run.smithi155.stdout: "time": "2023-08-01T19:55:05.579624+0000", 2023-08-01T19:55:58.203 INFO:teuthology.orchestra.run.smithi155.stdout: "duration": 0.0025971200000000001 2023-08-01T19:55:58.203 INFO:teuthology.orchestra.run.smithi155.stdout: }, 2023-08-01T19:55:58.203 INFO:teuthology.orchestra.run.smithi155.stdout: { 2023-08-01T19:55:58.203 INFO:teuthology.orchestra.run.smithi155.stdout: "event": "sub_op_commit_rec", 2023-08-01T19:55:58.203 INFO:teuthology.orchestra.run.smithi155.stdout: "time": "2023-08-01T19:55:05.635218+0000", 2023-08-01T19:55:58.203 INFO:teuthology.orchestra.run.smithi155.stdout: "duration": 0.055594487999999997 2023-08-01T19:55:58.204 INFO:teuthology.orchestra.run.smithi155.stdout: }, 2023-08-01T19:55:58.204 INFO:teuthology.orchestra.run.smithi155.stdout: { 2023-08-01T19:55:58.204 INFO:teuthology.orchestra.run.smithi155.stdout: "event": "commit_sent", 2023-08-01T19:55:58.204 INFO:teuthology.orchestra.run.smithi155.stdout: "time": "2023-08-01T19:55:05.635262+0000", 2023-08-01T19:55:58.204 INFO:teuthology.orchestra.run.smithi155.stdout: "duration": 4.3380999999999997e-05 2023-08-01T19:55:58.204 INFO:teuthology.orchestra.run.smithi155.stdout: }, 2023-08-01T19:55:58.204 INFO:teuthology.orchestra.run.smithi155.stdout: { 2023-08-01T19:55:58.204 INFO:teuthology.orchestra.run.smithi155.stdout: "event": "done", 2023-08-01T19:55:58.205 INFO:teuthology.orchestra.run.smithi155.stdout: "time": "2023-08-01T19:55:05.635297+0000", 2023-08-01T19:55:58.205 INFO:teuthology.orchestra.run.smithi155.stdout: "duration": 3.4842000000000003e-05 2023-08-01T19:55:58.205 INFO:teuthology.orchestra.run.smithi155.stdout: } 2023-08-01T19:55:58.205 INFO:teuthology.orchestra.run.smithi155.stdout: ] 2023-08-01T19:55:58.205 INFO:teuthology.orchestra.run.smithi155.stdout: } 2023-08-01T19:55:58.205 INFO:teuthology.orchestra.run.smithi155.stdout: }, 2023-08-01T19:55:58.205 INFO:teuthology.orchestra.run.smithi155.stdout: { 2023-08-01T19:55:58.205 INFO:teuthology.orchestra.run.smithi155.stdout: "description": "osd_op(client.4668.0:100947 5.4 5:23e8fc27:::benchmark_data_smithi006_114134_object100946:head [set-alloc-hint object_size 65536 write_size 65536,write 0~65536] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e37)", 2023-08-01T19:55:58.206 INFO:teuthology.orchestra.run.smithi155.stdout: "initiated_at": "2023-08-01T19:55:05.576840+0000", 2023-08-01T19:55:58.206 INFO:teuthology.orchestra.run.smithi155.stdout: "age": 52.441193902999998, 2023-08-01T19:55:58.206 INFO:teuthology.orchestra.run.smithi155.stdout: "duration": 0.058423127999999998, 2023-08-01T19:55:58.206 INFO:teuthology.orchestra.run.smithi155.stdout: "type_data": { 2023-08-01T19:55:58.206 INFO:teuthology.orchestra.run.smithi155.stdout: "flag_point": "commit sent; apply or cleanup", 2023-08-01T19:55:58.206 INFO:teuthology.orchestra.run.smithi155.stdout: "client_info": { 2023-08-01T19:55:58.206 INFO:teuthology.orchestra.run.smithi155.stdout: "client": "client.4668", 2023-08-01T19:55:58.206 INFO:teuthology.orchestra.run.smithi155.stdout: "client_addr": "172.21.15.6:0/1709472247", 2023-08-01T19:55:58.207 INFO:teuthology.orchestra.run.smithi155.stdout: "tid": 100947 2023-08-01T19:55:58.207 INFO:teuthology.orchestra.run.smithi155.stdout: }, 2023-08-01T19:55:58.207 INFO:teuthology.orchestra.run.smithi155.stdout: "events": [ 2023-08-01T19:55:58.207 INFO:teuthology.orchestra.run.smithi155.stdout: { 2023-08-01T19:55:58.207 INFO:teuthology.orchestra.run.smithi155.stdout: "event": "initiated", 2023-08-01T19:55:58.207 INFO:teuthology.orchestra.run.smithi155.stdout: "time": "2023-08-01T19:55:05.576840+0000", 2023-08-01T19:55:58.207 INFO:teuthology.orchestra.run.smithi155.stdout: "duration": 0 2023-08-01T19:55:58.207 INFO:teuthology.orchestra.run.smithi155.stdout: }, 2023-08-01T19:55:58.208 INFO:teuthology.orchestra.run.smithi155.stdout: { 2023-08-01T19:55:58.208 INFO:teuthology.orchestra.run.smithi155.stdout: "event": "throttled", 2023-08-01T19:55:58.208 INFO:teuthology.orchestra.run.smithi155.stdout: "time": "2023-08-01T19:55:05.576840+0000", 2023-08-01T19:55:58.208 INFO:teuthology.orchestra.run.smithi155.stdout: "duration": 0 2023-08-01T19:55:58.208 INFO:teuthology.orchestra.run.smithi155.stdout: }, 2023-08-01T19:55:58.208 INFO:teuthology.orchestra.run.smithi155.stdout: { 2023-08-01T19:55:58.208 INFO:teuthology.orchestra.run.smithi155.stdout: "event": "header_read", 2023-08-01T19:55:58.208 INFO:teuthology.orchestra.run.smithi155.stdout: "time": "2023-08-01T19:55:05.576839+0000", 2023-08-01T19:55:58.209 INFO:teuthology.orchestra.run.smithi155.stdout: "duration": 4294967295.9999995 2023-08-01T19:55:58.209 INFO:teuthology.orchestra.run.smithi155.stdout: }, 2023-08-01T19:55:58.209 INFO:teuthology.orchestra.run.smithi155.stdout: { 2023-08-01T19:55:58.209 INFO:teuthology.orchestra.run.smithi155.stdout: "event": "all_read", 2023-08-01T19:55:58.209 INFO:teuthology.orchestra.run.smithi155.stdout: "time": "2023-08-01T19:55:05.576893+0000", 2023-08-01T19:55:58.209 INFO:teuthology.orchestra.run.smithi155.stdout: "duration": 5.3893000000000001e-05 2023-08-01T19:55:58.209 INFO:teuthology.orchestra.run.smithi155.stdout: }, 2023-08-01T19:55:58.210 INFO:teuthology.orchestra.run.smithi155.stdout: { 2023-08-01T19:55:58.210 INFO:teuthology.orchestra.run.smithi155.stdout: "event": "dispatched", 2023-08-01T19:55:58.210 INFO:teuthology.orchestra.run.smithi155.stdout: "time": "2023-08-01T19:55:05.576902+0000", 2023-08-01T19:55:58.210 INFO:teuthology.orchestra.run.smithi155.stdout: "duration": 8.7520000000000002e-06 2023-08-01T19:55:58.210 INFO:teuthology.orchestra.run.smithi155.stdout: }, 2023-08-01T19:55:58.210 INFO:teuthology.orchestra.run.smithi155.stdout: { 2023-08-01T19:55:58.210 INFO:teuthology.orchestra.run.smithi155.stdout: "event": "queued_for_pg", 2023-08-01T19:55:58.210 INFO:teuthology.orchestra.run.smithi155.stdout: "time": "2023-08-01T19:55:05.576905+0000", 2023-08-01T19:55:58.211 INFO:teuthology.orchestra.run.smithi155.stdout: "duration": 3.01e-06 2023-08-01T19:55:58.211 INFO:teuthology.orchestra.run.smithi155.stdout: }, 2023-08-01T19:55:58.211 INFO:teuthology.orchestra.run.smithi155.stdout: { 2023-08-01T19:55:58.211 INFO:teuthology.orchestra.run.smithi155.stdout: "event": "reached_pg", 2023-08-01T19:55:58.211 INFO:teuthology.orchestra.run.smithi155.stdout: "time": "2023-08-01T19:55:05.579641+0000", 2023-08-01T19:55:58.211 INFO:teuthology.orchestra.run.smithi155.stdout: "duration": 0.0027366880000000001 2023-08-01T19:55:58.211 INFO:teuthology.orchestra.run.smithi155.stdout: }, 2023-08-01T19:55:58.211 INFO:teuthology.orchestra.run.smithi155.stdout: { 2023-08-01T19:55:58.212 INFO:teuthology.orchestra.run.smithi155.stdout: "event": "started", 2023-08-01T19:55:58.212 INFO:teuthology.orchestra.run.smithi155.stdout: "time": "2023-08-01T19:55:05.579734+0000", 2023-08-01T19:55:58.212 INFO:teuthology.orchestra.run.smithi155.stdout: "duration": 9.2590000000000006e-05 2023-08-01T19:55:58.212 INFO:teuthology.orchestra.run.smithi155.stdout: }, 2023-08-01T19:55:58.212 INFO:teuthology.orchestra.run.smithi155.stdout: { 2023-08-01T19:55:58.212 INFO:teuthology.orchestra.run.smithi155.stdout: "event": "waiting for subops from 0", 2023-08-01T19:55:58.212 INFO:teuthology.orchestra.run.smithi155.stdout: "time": "2023-08-01T19:55:05.579825+0000", 2023-08-01T19:55:58.212 INFO:teuthology.orchestra.run.smithi155.stdout: "duration": 9.0964999999999994e-05 2023-08-01T19:55:58.213 INFO:teuthology.orchestra.run.smithi155.stdout: }, 2023-08-01T19:55:58.213 INFO:teuthology.orchestra.run.smithi155.stdout: { 2023-08-01T19:55:58.213 INFO:teuthology.orchestra.run.smithi155.stdout: "event": "op_commit", 2023-08-01T19:55:58.213 INFO:teuthology.orchestra.run.smithi155.stdout: "time": "2023-08-01T19:55:05.585041+0000", 2023-08-01T19:55:58.213 INFO:teuthology.orchestra.run.smithi155.stdout: "duration": 0.0052159670000000002 2023-08-01T19:55:58.213 INFO:teuthology.orchestra.run.smithi155.stdout: }, 2023-08-01T19:55:58.213 INFO:teuthology.orchestra.run.smithi155.stdout: { 2023-08-01T19:55:58.213 INFO:teuthology.orchestra.run.smithi155.stdout: "event": "sub_op_commit_rec", 2023-08-01T19:55:58.214 INFO:teuthology.orchestra.run.smithi155.stdout: "time": "2023-08-01T19:55:05.635199+0000", 2023-08-01T19:55:58.214 INFO:teuthology.orchestra.run.smithi155.stdout: "duration": 0.050158023000000003 2023-08-01T19:55:58.214 INFO:teuthology.orchestra.run.smithi155.stdout: }, 2023-08-01T19:55:58.214 INFO:teuthology.orchestra.run.smithi155.stdout: { 2023-08-01T19:55:58.214 INFO:teuthology.orchestra.run.smithi155.stdout: "event": "commit_sent", 2023-08-01T19:55:58.214 INFO:teuthology.orchestra.run.smithi155.stdout: "time": "2023-08-01T19:55:05.635227+0000", 2023-08-01T19:55:58.214 INFO:teuthology.orchestra.run.smithi155.stdout: "duration": 2.7821e-05 2023-08-01T19:55:58.214 INFO:teuthology.orchestra.run.smithi155.stdout: }, 2023-08-01T19:55:58.215 INFO:teuthology.orchestra.run.smithi155.stdout: { 2023-08-01T19:55:58.215 INFO:teuthology.orchestra.run.smithi155.stdout: "event": "done", 2023-08-01T19:55:58.215 INFO:teuthology.orchestra.run.smithi155.stdout: "time": "2023-08-01T19:55:05.635263+0000", 2023-08-01T19:55:58.215 INFO:teuthology.orchestra.run.smithi155.stdout: "duration": 3.6081000000000002e-05 2023-08-01T19:55:58.215 INFO:teuthology.orchestra.run.smithi155.stdout: } 2023-08-01T19:55:58.215 INFO:teuthology.orchestra.run.smithi155.stdout: ] 2023-08-01T19:55:58.215 INFO:teuthology.orchestra.run.smithi155.stdout: } 2023-08-01T19:55:58.215 INFO:teuthology.orchestra.run.smithi155.stdout: } 2023-08-01T19:55:58.216 INFO:teuthology.orchestra.run.smithi155.stdout: ] 2023-08-01T19:55:58.216 INFO:teuthology.orchestra.run.smithi155.stdout:} 2023-08-01T19:55:58.217 INFO:tasks.ceph.osd.2.smithi155.stderr:2023-08-01T19:55:58.215+0000 7faa5c6ac700 -1 received signal: Hangup from /usr/bin/python3 /bin/daemon-helper kill ceph-osd -f --cluster ceph -i 2 (PID: 111337) UID: 0 2023-08-01T19:55:58.217 DEBUG:teuthology.orchestra.run.smithi008:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 30 ceph --cluster ceph --admin-daemon /var/run/ceph/ceph-osd.0.asok dump_ops_in_flight 2023-08-01T19:55:58.318 INFO:tasks.ceph.osd.0.smithi008.stderr:2023-08-01T19:55:58.316+0000 7f16a58f4700 -1 received signal: Hangup from /usr/bin/python3 /bin/daemon-helper kill ceph-osd -f --cluster ceph -i 0 (PID: 111179) UID: 0 2023-08-01T19:55:58.405 INFO:teuthology.orchestra.run.smithi008.stdout:{ 2023-08-01T19:55:58.405 INFO:teuthology.orchestra.run.smithi008.stdout: "ops": [ 2023-08-01T19:55:58.405 INFO:teuthology.orchestra.run.smithi008.stdout: { 2023-08-01T19:55:58.405 INFO:teuthology.orchestra.run.smithi008.stdout: "description": "osd_op(client.4668.0:197069 5.c 5:337d2116:::benchmark_data_smithi006_114134_object63408:head [delete] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e61)", 2023-08-01T19:55:58.406 INFO:teuthology.orchestra.run.smithi008.stdout: "initiated_at": "2023-08-01T19:55:58.395026+0000", 2023-08-01T19:55:58.406 INFO:teuthology.orchestra.run.smithi008.stdout: "age": 0.0084670809999999996, 2023-08-01T19:55:58.406 INFO:teuthology.orchestra.run.smithi008.stdout: "duration": 0.0084943429999999997, 2023-08-01T19:55:58.406 INFO:teuthology.orchestra.run.smithi008.stdout: "type_data": { 2023-08-01T19:55:58.406 INFO:teuthology.orchestra.run.smithi008.stdout: "flag_point": "waiting for sub ops", 2023-08-01T19:55:58.406 INFO:teuthology.orchestra.run.smithi008.stdout: "client_info": { 2023-08-01T19:55:58.406 INFO:teuthology.orchestra.run.smithi008.stdout: "client": "client.4668", 2023-08-01T19:55:58.407 INFO:teuthology.orchestra.run.smithi008.stdout: "client_addr": "172.21.15.6:0/1709472247", 2023-08-01T19:55:58.407 INFO:teuthology.orchestra.run.smithi008.stdout: "tid": 197069 2023-08-01T19:55:58.407 INFO:teuthology.orchestra.run.smithi008.stdout: }, 2023-08-01T19:55:58.407 INFO:teuthology.orchestra.run.smithi008.stdout: "events": [ 2023-08-01T19:55:58.407 INFO:teuthology.orchestra.run.smithi008.stdout: { 2023-08-01T19:55:58.407 INFO:teuthology.orchestra.run.smithi008.stdout: "event": "initiated", 2023-08-01T19:55:58.407 INFO:teuthology.orchestra.run.smithi008.stdout: "time": "2023-08-01T19:55:58.395026+0000", 2023-08-01T19:55:58.408 INFO:teuthology.orchestra.run.smithi008.stdout: "duration": 0 2023-08-01T19:55:58.408 INFO:teuthology.orchestra.run.smithi008.stdout: }, 2023-08-01T19:55:58.408 INFO:teuthology.orchestra.run.smithi008.stdout: { 2023-08-01T19:55:58.408 INFO:teuthology.orchestra.run.smithi008.stdout: "event": "throttled", 2023-08-01T19:55:58.408 INFO:teuthology.orchestra.run.smithi008.stdout: "time": "2023-08-01T19:55:58.395026+0000", 2023-08-01T19:55:58.408 INFO:teuthology.orchestra.run.smithi008.stdout: "duration": 0 2023-08-01T19:55:58.408 INFO:teuthology.orchestra.run.smithi008.stdout: }, 2023-08-01T19:55:58.408 INFO:teuthology.orchestra.run.smithi008.stdout: { 2023-08-01T19:55:58.409 INFO:teuthology.orchestra.run.smithi008.stdout: "event": "header_read", 2023-08-01T19:55:58.409 INFO:teuthology.orchestra.run.smithi008.stdout: "time": "2023-08-01T19:55:58.395025+0000", 2023-08-01T19:55:58.409 INFO:teuthology.orchestra.run.smithi008.stdout: "duration": 4294967295.9999995 2023-08-01T19:55:58.409 INFO:teuthology.orchestra.run.smithi008.stdout: }, 2023-08-01T19:55:58.409 INFO:teuthology.orchestra.run.smithi008.stdout: { 2023-08-01T19:55:58.409 INFO:teuthology.orchestra.run.smithi008.stdout: "event": "all_read", 2023-08-01T19:55:58.409 INFO:teuthology.orchestra.run.smithi008.stdout: "time": "2023-08-01T19:55:58.395029+0000", 2023-08-01T19:55:58.410 INFO:teuthology.orchestra.run.smithi008.stdout: "duration": 4.143e-06 2023-08-01T19:55:58.410 INFO:teuthology.orchestra.run.smithi008.stdout: }, 2023-08-01T19:55:58.410 INFO:teuthology.orchestra.run.smithi008.stdout: { 2023-08-01T19:55:58.410 INFO:teuthology.orchestra.run.smithi008.stdout: "event": "dispatched", 2023-08-01T19:55:58.410 INFO:teuthology.orchestra.run.smithi008.stdout: "time": "2023-08-01T19:55:58.395038+0000", 2023-08-01T19:55:58.410 INFO:teuthology.orchestra.run.smithi008.stdout: "duration": 8.6759999999999996e-06 2023-08-01T19:55:58.410 INFO:teuthology.orchestra.run.smithi008.stdout: }, 2023-08-01T19:55:58.410 INFO:teuthology.orchestra.run.smithi008.stdout: { 2023-08-01T19:55:58.411 INFO:teuthology.orchestra.run.smithi008.stdout: "event": "queued_for_pg", 2023-08-01T19:55:58.411 INFO:teuthology.orchestra.run.smithi008.stdout: "time": "2023-08-01T19:55:58.395043+0000", 2023-08-01T19:55:58.411 INFO:teuthology.orchestra.run.smithi008.stdout: "duration": 4.7929999999999997e-06 2023-08-01T19:55:58.411 INFO:teuthology.orchestra.run.smithi008.stdout: }, 2023-08-01T19:55:58.411 INFO:teuthology.orchestra.run.smithi008.stdout: { 2023-08-01T19:55:58.411 INFO:teuthology.orchestra.run.smithi008.stdout: "event": "reached_pg", 2023-08-01T19:55:58.411 INFO:teuthology.orchestra.run.smithi008.stdout: "time": "2023-08-01T19:55:58.395393+0000", 2023-08-01T19:55:58.411 INFO:teuthology.orchestra.run.smithi008.stdout: "duration": 0.00034989100000000001 2023-08-01T19:55:58.412 INFO:teuthology.orchestra.run.smithi008.stdout: }, 2023-08-01T19:55:58.412 INFO:teuthology.orchestra.run.smithi008.stdout: { 2023-08-01T19:55:58.412 INFO:teuthology.orchestra.run.smithi008.stdout: "event": "started", 2023-08-01T19:55:58.412 INFO:teuthology.orchestra.run.smithi008.stdout: "time": "2023-08-01T19:55:58.395509+0000", 2023-08-01T19:55:58.412 INFO:teuthology.orchestra.run.smithi008.stdout: "duration": 0.00011629300000000001 2023-08-01T19:55:58.412 INFO:teuthology.orchestra.run.smithi008.stdout: }, 2023-08-01T19:55:58.412 INFO:teuthology.orchestra.run.smithi008.stdout: { 2023-08-01T19:55:58.413 INFO:teuthology.orchestra.run.smithi008.stdout: "event": "waiting for subops from 1", 2023-08-01T19:55:58.413 INFO:teuthology.orchestra.run.smithi008.stdout: "time": "2023-08-01T19:55:58.395618+0000", 2023-08-01T19:55:58.413 INFO:teuthology.orchestra.run.smithi008.stdout: "duration": 0.00010896900000000001 2023-08-01T19:55:58.413 INFO:teuthology.orchestra.run.smithi008.stdout: }, 2023-08-01T19:55:58.413 INFO:teuthology.orchestra.run.smithi008.stdout: { 2023-08-01T19:55:58.413 INFO:teuthology.orchestra.run.smithi008.stdout: "event": "op_commit", 2023-08-01T19:55:58.413 INFO:teuthology.orchestra.run.smithi008.stdout: "time": "2023-08-01T19:55:58.402609+0000", 2023-08-01T19:55:58.413 INFO:teuthology.orchestra.run.smithi008.stdout: "duration": 0.0069908949999999996 2023-08-01T19:55:58.414 INFO:teuthology.orchestra.run.smithi008.stdout: } 2023-08-01T19:55:58.414 INFO:teuthology.orchestra.run.smithi008.stdout: ] 2023-08-01T19:55:58.414 INFO:teuthology.orchestra.run.smithi008.stdout: } 2023-08-01T19:55:58.414 INFO:teuthology.orchestra.run.smithi008.stdout: }, 2023-08-01T19:55:58.414 INFO:teuthology.orchestra.run.smithi008.stdout: { 2023-08-01T19:55:58.414 INFO:teuthology.orchestra.run.smithi008.stdout: "description": "osd_op(client.4668.0:197070 5.1 5:8d4f3d93:::benchmark_data_smithi006_114134_object63409:head [delete] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e61)", 2023-08-01T19:55:58.414 INFO:teuthology.orchestra.run.smithi008.stdout: "initiated_at": "2023-08-01T19:55:58.395377+0000", 2023-08-01T19:55:58.414 INFO:teuthology.orchestra.run.smithi008.stdout: "age": 0.0081157390000000003, 2023-08-01T19:55:58.415 INFO:teuthology.orchestra.run.smithi008.stdout: "duration": 0.0082351500000000001, 2023-08-01T19:55:58.415 INFO:teuthology.orchestra.run.smithi008.stdout: "type_data": { 2023-08-01T19:55:58.415 INFO:teuthology.orchestra.run.smithi008.stdout: "flag_point": "waiting for sub ops", 2023-08-01T19:55:58.415 INFO:teuthology.orchestra.run.smithi008.stdout: "client_info": { 2023-08-01T19:55:58.415 INFO:teuthology.orchestra.run.smithi008.stdout: "client": "client.4668", 2023-08-01T19:55:58.415 INFO:teuthology.orchestra.run.smithi008.stdout: "client_addr": "172.21.15.6:0/1709472247", 2023-08-01T19:55:58.415 INFO:teuthology.orchestra.run.smithi008.stdout: "tid": 197070 2023-08-01T19:55:58.416 INFO:teuthology.orchestra.run.smithi008.stdout: }, 2023-08-01T19:55:58.416 INFO:teuthology.orchestra.run.smithi008.stdout: "events": [ 2023-08-01T19:55:58.416 INFO:teuthology.orchestra.run.smithi008.stdout: { 2023-08-01T19:55:58.416 INFO:teuthology.orchestra.run.smithi008.stdout: "event": "initiated", 2023-08-01T19:55:58.416 INFO:teuthology.orchestra.run.smithi008.stdout: "time": "2023-08-01T19:55:58.395377+0000", 2023-08-01T19:55:58.416 INFO:teuthology.orchestra.run.smithi008.stdout: "duration": 0 2023-08-01T19:55:58.416 INFO:teuthology.orchestra.run.smithi008.stdout: }, 2023-08-01T19:55:58.416 INFO:teuthology.orchestra.run.smithi008.stdout: { 2023-08-01T19:55:58.417 INFO:teuthology.orchestra.run.smithi008.stdout: "event": "throttled", 2023-08-01T19:55:58.417 INFO:teuthology.orchestra.run.smithi008.stdout: "time": "2023-08-01T19:55:58.395377+0000", 2023-08-01T19:55:58.417 INFO:teuthology.orchestra.run.smithi008.stdout: "duration": 0 2023-08-01T19:55:58.417 INFO:teuthology.orchestra.run.smithi008.stdout: }, 2023-08-01T19:55:58.417 INFO:teuthology.orchestra.run.smithi008.stdout: { 2023-08-01T19:55:58.417 INFO:teuthology.orchestra.run.smithi008.stdout: "event": "header_read", 2023-08-01T19:55:58.417 INFO:teuthology.orchestra.run.smithi008.stdout: "time": "2023-08-01T19:55:58.395376+0000", 2023-08-01T19:55:58.417 INFO:teuthology.orchestra.run.smithi008.stdout: "duration": 4294967295.999999 2023-08-01T19:55:58.418 INFO:teuthology.orchestra.run.smithi008.stdout: }, 2023-08-01T19:55:58.418 INFO:teuthology.orchestra.run.smithi008.stdout: { 2023-08-01T19:55:58.418 INFO:teuthology.orchestra.run.smithi008.stdout: "event": "all_read", 2023-08-01T19:55:58.418 INFO:teuthology.orchestra.run.smithi008.stdout: "time": "2023-08-01T19:55:58.395381+0000", 2023-08-01T19:55:58.418 INFO:teuthology.orchestra.run.smithi008.stdout: "duration": 5.0989999999999998e-06 2023-08-01T19:55:58.418 INFO:teuthology.orchestra.run.smithi008.stdout: }, 2023-08-01T19:55:58.418 INFO:teuthology.orchestra.run.smithi008.stdout: { 2023-08-01T19:55:58.418 INFO:teuthology.orchestra.run.smithi008.stdout: "event": "dispatched", 2023-08-01T19:55:58.419 INFO:teuthology.orchestra.run.smithi008.stdout: "time": "2023-08-01T19:55:58.395392+0000", 2023-08-01T19:55:58.419 INFO:teuthology.orchestra.run.smithi008.stdout: "duration": 1.0721e-05 2023-08-01T19:55:58.419 INFO:teuthology.orchestra.run.smithi008.stdout: }, 2023-08-01T19:55:58.419 INFO:teuthology.orchestra.run.smithi008.stdout: { 2023-08-01T19:55:58.419 INFO:teuthology.orchestra.run.smithi008.stdout: "event": "queued_for_pg", 2023-08-01T19:55:58.419 INFO:teuthology.orchestra.run.smithi008.stdout: "time": "2023-08-01T19:55:58.395398+0000", 2023-08-01T19:55:58.419 INFO:teuthology.orchestra.run.smithi008.stdout: "duration": 6.0220000000000001e-06 2023-08-01T19:55:58.420 INFO:teuthology.orchestra.run.smithi008.stdout: }, 2023-08-01T19:55:58.420 INFO:teuthology.orchestra.run.smithi008.stdout: { 2023-08-01T19:55:58.420 INFO:teuthology.orchestra.run.smithi008.stdout: "event": "reached_pg", 2023-08-01T19:55:58.420 INFO:teuthology.orchestra.run.smithi008.stdout: "time": "2023-08-01T19:55:58.397018+0000", 2023-08-01T19:55:58.420 INFO:teuthology.orchestra.run.smithi008.stdout: "duration": 0.0016197729999999999 2023-08-01T19:55:58.420 INFO:teuthology.orchestra.run.smithi008.stdout: }, 2023-08-01T19:55:58.420 INFO:teuthology.orchestra.run.smithi008.stdout: { 2023-08-01T19:55:58.420 INFO:teuthology.orchestra.run.smithi008.stdout: "event": "started", 2023-08-01T19:55:58.421 INFO:teuthology.orchestra.run.smithi008.stdout: "time": "2023-08-01T19:55:58.397136+0000", 2023-08-01T19:55:58.421 INFO:teuthology.orchestra.run.smithi008.stdout: "duration": 0.000118443 2023-08-01T19:55:58.421 INFO:teuthology.orchestra.run.smithi008.stdout: }, 2023-08-01T19:55:58.421 INFO:teuthology.orchestra.run.smithi008.stdout: { 2023-08-01T19:55:58.421 INFO:teuthology.orchestra.run.smithi008.stdout: "event": "waiting for subops from 1", 2023-08-01T19:55:58.421 INFO:teuthology.orchestra.run.smithi008.stdout: "time": "2023-08-01T19:55:58.397241+0000", 2023-08-01T19:55:58.421 INFO:teuthology.orchestra.run.smithi008.stdout: "duration": 0.000104224 2023-08-01T19:55:58.421 INFO:teuthology.orchestra.run.smithi008.stdout: } 2023-08-01T19:55:58.422 INFO:teuthology.orchestra.run.smithi008.stdout: ] 2023-08-01T19:55:58.422 INFO:teuthology.orchestra.run.smithi008.stdout: } 2023-08-01T19:55:58.422 INFO:teuthology.orchestra.run.smithi008.stdout: }, 2023-08-01T19:55:58.422 INFO:teuthology.orchestra.run.smithi008.stdout: { 2023-08-01T19:55:58.422 INFO:teuthology.orchestra.run.smithi008.stdout: "description": "osd_op(client.4668.0:197071 5.5 5:ad1399a6:::benchmark_data_smithi006_114134_object63410:head [delete] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e61)", 2023-08-01T19:55:58.422 INFO:teuthology.orchestra.run.smithi008.stdout: "initiated_at": "2023-08-01T19:55:58.396422+0000", 2023-08-01T19:55:58.422 INFO:teuthology.orchestra.run.smithi008.stdout: "age": 0.007070738, 2023-08-01T19:55:58.422 INFO:teuthology.orchestra.run.smithi008.stdout: "duration": 0.0072745960000000004, 2023-08-01T19:55:58.423 INFO:teuthology.orchestra.run.smithi008.stdout: "type_data": { 2023-08-01T19:55:58.423 INFO:teuthology.orchestra.run.smithi008.stdout: "flag_point": "waiting for sub ops", 2023-08-01T19:55:58.423 INFO:teuthology.orchestra.run.smithi008.stdout: "client_info": { 2023-08-01T19:55:58.423 INFO:teuthology.orchestra.run.smithi008.stdout: "client": "client.4668", 2023-08-01T19:55:58.423 INFO:teuthology.orchestra.run.smithi008.stdout: "client_addr": "172.21.15.6:0/1709472247", 2023-08-01T19:55:58.423 INFO:teuthology.orchestra.run.smithi008.stdout: "tid": 197071 2023-08-01T19:55:58.423 INFO:teuthology.orchestra.run.smithi008.stdout: }, 2023-08-01T19:55:58.424 INFO:teuthology.orchestra.run.smithi008.stdout: "events": [ 2023-08-01T19:55:58.424 INFO:teuthology.orchestra.run.smithi008.stdout: { 2023-08-01T19:55:58.424 INFO:teuthology.orchestra.run.smithi008.stdout: "event": "initiated", 2023-08-01T19:55:58.424 INFO:teuthology.orchestra.run.smithi008.stdout: "time": "2023-08-01T19:55:58.396422+0000", 2023-08-01T19:55:58.424 INFO:teuthology.orchestra.run.smithi008.stdout: "duration": 0 2023-08-01T19:55:58.424 INFO:teuthology.orchestra.run.smithi008.stdout: }, 2023-08-01T19:55:58.424 INFO:teuthology.orchestra.run.smithi008.stdout: { 2023-08-01T19:55:58.424 INFO:teuthology.orchestra.run.smithi008.stdout: "event": "throttled", 2023-08-01T19:55:58.425 INFO:teuthology.orchestra.run.smithi008.stdout: "time": "2023-08-01T19:55:58.396422+0000", 2023-08-01T19:55:58.425 INFO:teuthology.orchestra.run.smithi008.stdout: "duration": 0 2023-08-01T19:55:58.425 INFO:teuthology.orchestra.run.smithi008.stdout: }, 2023-08-01T19:55:58.425 INFO:teuthology.orchestra.run.smithi008.stdout: { 2023-08-01T19:55:58.425 INFO:teuthology.orchestra.run.smithi008.stdout: "event": "header_read", 2023-08-01T19:55:58.425 INFO:teuthology.orchestra.run.smithi008.stdout: "time": "2023-08-01T19:55:58.396421+0000", 2023-08-01T19:55:58.425 INFO:teuthology.orchestra.run.smithi008.stdout: "duration": 4294967295.9999995 2023-08-01T19:55:58.425 INFO:teuthology.orchestra.run.smithi008.stdout: }, 2023-08-01T19:55:58.426 INFO:teuthology.orchestra.run.smithi008.stdout: { 2023-08-01T19:55:58.426 INFO:teuthology.orchestra.run.smithi008.stdout: "event": "all_read", 2023-08-01T19:55:58.426 INFO:teuthology.orchestra.run.smithi008.stdout: "time": "2023-08-01T19:55:58.396425+0000", 2023-08-01T19:55:58.426 INFO:teuthology.orchestra.run.smithi008.stdout: "duration": 3.968e-06 2023-08-01T19:55:58.426 INFO:teuthology.orchestra.run.smithi008.stdout: }, 2023-08-01T19:55:58.426 INFO:teuthology.orchestra.run.smithi008.stdout: { 2023-08-01T19:55:58.426 INFO:teuthology.orchestra.run.smithi008.stdout: "event": "dispatched", 2023-08-01T19:55:58.426 INFO:teuthology.orchestra.run.smithi008.stdout: "time": "2023-08-01T19:55:58.396434+0000", 2023-08-01T19:55:58.427 INFO:teuthology.orchestra.run.smithi008.stdout: "duration": 8.7129999999999994e-06 2023-08-01T19:55:58.427 INFO:teuthology.orchestra.run.smithi008.stdout: }, 2023-08-01T19:55:58.427 INFO:teuthology.orchestra.run.smithi008.stdout: { 2023-08-01T19:55:58.427 INFO:teuthology.orchestra.run.smithi008.stdout: "event": "queued_for_pg", 2023-08-01T19:55:58.427 INFO:teuthology.orchestra.run.smithi008.stdout: "time": "2023-08-01T19:55:58.396439+0000", 2023-08-01T19:55:58.427 INFO:teuthology.orchestra.run.smithi008.stdout: "duration": 4.8799999999999999e-06 2023-08-01T19:55:58.427 INFO:teuthology.orchestra.run.smithi008.stdout: }, 2023-08-01T19:55:58.427 INFO:teuthology.orchestra.run.smithi008.stdout: { 2023-08-01T19:55:58.428 INFO:teuthology.orchestra.run.smithi008.stdout: "event": "reached_pg", 2023-08-01T19:55:58.428 INFO:teuthology.orchestra.run.smithi008.stdout: "time": "2023-08-01T19:55:58.396470+0000", 2023-08-01T19:55:58.428 INFO:teuthology.orchestra.run.smithi008.stdout: "duration": 3.0954999999999998e-05 2023-08-01T19:55:58.428 INFO:teuthology.orchestra.run.smithi008.stdout: }, 2023-08-01T19:55:58.428 INFO:teuthology.orchestra.run.smithi008.stdout: { 2023-08-01T19:55:58.428 INFO:teuthology.orchestra.run.smithi008.stdout: "event": "started", 2023-08-01T19:55:58.428 INFO:teuthology.orchestra.run.smithi008.stdout: "time": "2023-08-01T19:55:58.396592+0000", 2023-08-01T19:55:58.429 INFO:teuthology.orchestra.run.smithi008.stdout: "duration": 0.000121754 2023-08-01T19:55:58.429 INFO:teuthology.orchestra.run.smithi008.stdout: }, 2023-08-01T19:55:58.429 INFO:teuthology.orchestra.run.smithi008.stdout: { 2023-08-01T19:55:58.429 INFO:teuthology.orchestra.run.smithi008.stdout: "event": "waiting for subops from 1", 2023-08-01T19:55:58.429 INFO:teuthology.orchestra.run.smithi008.stdout: "time": "2023-08-01T19:55:58.396702+0000", 2023-08-01T19:55:58.429 INFO:teuthology.orchestra.run.smithi008.stdout: "duration": 0.000110771 2023-08-01T19:55:58.429 INFO:teuthology.orchestra.run.smithi008.stdout: } 2023-08-01T19:55:58.429 INFO:teuthology.orchestra.run.smithi008.stdout: ] 2023-08-01T19:55:58.430 INFO:teuthology.orchestra.run.smithi008.stdout: } 2023-08-01T19:55:58.430 INFO:teuthology.orchestra.run.smithi008.stdout: }, 2023-08-01T19:55:58.430 INFO:teuthology.orchestra.run.smithi008.stdout: { 2023-08-01T19:55:58.430 INFO:teuthology.orchestra.run.smithi008.stdout: "description": "osd_op(client.4668.0:197072 5.c 5:370a6750:::benchmark_data_smithi006_114134_object63411:head [delete] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e61)", 2023-08-01T19:55:58.430 INFO:teuthology.orchestra.run.smithi008.stdout: "initiated_at": "2023-08-01T19:55:58.396783+0000", 2023-08-01T19:55:58.430 INFO:teuthology.orchestra.run.smithi008.stdout: "age": 0.0067100930000000003, 2023-08-01T19:55:58.430 INFO:teuthology.orchestra.run.smithi008.stdout: "duration": 0.0069865029999999998, 2023-08-01T19:55:58.430 INFO:teuthology.orchestra.run.smithi008.stdout: "type_data": { 2023-08-01T19:55:58.431 INFO:teuthology.orchestra.run.smithi008.stdout: "flag_point": "waiting for sub ops", 2023-08-01T19:55:58.431 INFO:teuthology.orchestra.run.smithi008.stdout: "client_info": { 2023-08-01T19:55:58.431 INFO:teuthology.orchestra.run.smithi008.stdout: "client": "client.4668", 2023-08-01T19:55:58.431 INFO:teuthology.orchestra.run.smithi008.stdout: "client_addr": "172.21.15.6:0/1709472247", 2023-08-01T19:55:58.431 INFO:teuthology.orchestra.run.smithi008.stdout: "tid": 197072 2023-08-01T19:55:58.431 INFO:teuthology.orchestra.run.smithi008.stdout: }, 2023-08-01T19:55:58.431 INFO:teuthology.orchestra.run.smithi008.stdout: "events": [ 2023-08-01T19:55:58.432 INFO:teuthology.orchestra.run.smithi008.stdout: { 2023-08-01T19:55:58.432 INFO:teuthology.orchestra.run.smithi008.stdout: "event": "initiated", 2023-08-01T19:55:58.432 INFO:teuthology.orchestra.run.smithi008.stdout: "time": "2023-08-01T19:55:58.396783+0000", 2023-08-01T19:55:58.432 INFO:teuthology.orchestra.run.smithi008.stdout: "duration": 0 2023-08-01T19:55:58.432 INFO:teuthology.orchestra.run.smithi008.stdout: }, 2023-08-01T19:55:58.432 INFO:teuthology.orchestra.run.smithi008.stdout: { 2023-08-01T19:55:58.432 INFO:teuthology.orchestra.run.smithi008.stdout: "event": "throttled", 2023-08-01T19:55:58.432 INFO:teuthology.orchestra.run.smithi008.stdout: "time": "2023-08-01T19:55:58.396783+0000", 2023-08-01T19:55:58.433 INFO:teuthology.orchestra.run.smithi008.stdout: "duration": 0 2023-08-01T19:55:58.433 INFO:teuthology.orchestra.run.smithi008.stdout: }, 2023-08-01T19:55:58.433 INFO:teuthology.orchestra.run.smithi008.stdout: { 2023-08-01T19:55:58.433 INFO:teuthology.orchestra.run.smithi008.stdout: "event": "header_read", 2023-08-01T19:55:58.433 INFO:teuthology.orchestra.run.smithi008.stdout: "time": "2023-08-01T19:55:58.396782+0000", 2023-08-01T19:55:58.433 INFO:teuthology.orchestra.run.smithi008.stdout: "duration": 4294967295.9999995 2023-08-01T19:55:58.433 INFO:teuthology.orchestra.run.smithi008.stdout: }, 2023-08-01T19:55:58.433 INFO:teuthology.orchestra.run.smithi008.stdout: { 2023-08-01T19:55:58.434 INFO:teuthology.orchestra.run.smithi008.stdout: "event": "all_read", 2023-08-01T19:55:58.434 INFO:teuthology.orchestra.run.smithi008.stdout: "time": "2023-08-01T19:55:58.396786+0000", 2023-08-01T19:55:58.434 INFO:teuthology.orchestra.run.smithi008.stdout: "duration": 3.636e-06 2023-08-01T19:55:58.434 INFO:teuthology.orchestra.run.smithi008.stdout: }, 2023-08-01T19:55:58.434 INFO:teuthology.orchestra.run.smithi008.stdout: { 2023-08-01T19:55:58.434 INFO:teuthology.orchestra.run.smithi008.stdout: "event": "dispatched", 2023-08-01T19:55:58.434 INFO:teuthology.orchestra.run.smithi008.stdout: "time": "2023-08-01T19:55:58.396800+0000", 2023-08-01T19:55:58.434 INFO:teuthology.orchestra.run.smithi008.stdout: "duration": 1.4263999999999999e-05 2023-08-01T19:55:58.435 INFO:teuthology.orchestra.run.smithi008.stdout: }, 2023-08-01T19:55:58.435 INFO:teuthology.orchestra.run.smithi008.stdout: { 2023-08-01T19:55:58.435 INFO:teuthology.orchestra.run.smithi008.stdout: "event": "queued_for_pg", 2023-08-01T19:55:58.435 INFO:teuthology.orchestra.run.smithi008.stdout: "time": "2023-08-01T19:55:58.396805+0000", 2023-08-01T19:55:58.435 INFO:teuthology.orchestra.run.smithi008.stdout: "duration": 5.4500000000000003e-06 2023-08-01T19:55:58.435 INFO:teuthology.orchestra.run.smithi008.stdout: }, 2023-08-01T19:55:58.435 INFO:teuthology.orchestra.run.smithi008.stdout: { 2023-08-01T19:55:58.436 INFO:teuthology.orchestra.run.smithi008.stdout: "event": "reached_pg", 2023-08-01T19:55:58.436 INFO:teuthology.orchestra.run.smithi008.stdout: "time": "2023-08-01T19:55:58.397385+0000", 2023-08-01T19:55:58.436 INFO:teuthology.orchestra.run.smithi008.stdout: "duration": 0.00057991200000000003 2023-08-01T19:55:58.436 INFO:teuthology.orchestra.run.smithi008.stdout: }, 2023-08-01T19:55:58.436 INFO:teuthology.orchestra.run.smithi008.stdout: { 2023-08-01T19:55:58.436 INFO:teuthology.orchestra.run.smithi008.stdout: "event": "started", 2023-08-01T19:55:58.436 INFO:teuthology.orchestra.run.smithi008.stdout: "time": "2023-08-01T19:55:58.397512+0000", 2023-08-01T19:55:58.436 INFO:teuthology.orchestra.run.smithi008.stdout: "duration": 0.00012706300000000001 2023-08-01T19:55:58.437 INFO:teuthology.orchestra.run.smithi008.stdout: }, 2023-08-01T19:55:58.437 INFO:teuthology.orchestra.run.smithi008.stdout: { 2023-08-01T19:55:58.437 INFO:teuthology.orchestra.run.smithi008.stdout: "event": "waiting for subops from 1", 2023-08-01T19:55:58.437 INFO:teuthology.orchestra.run.smithi008.stdout: "time": "2023-08-01T19:55:58.397634+0000", 2023-08-01T19:55:58.437 INFO:teuthology.orchestra.run.smithi008.stdout: "duration": 0.00012148500000000001 2023-08-01T19:55:58.437 INFO:teuthology.orchestra.run.smithi008.stdout: } 2023-08-01T19:55:58.437 INFO:teuthology.orchestra.run.smithi008.stdout: ] 2023-08-01T19:55:58.437 INFO:teuthology.orchestra.run.smithi008.stdout: } 2023-08-01T19:55:58.438 INFO:teuthology.orchestra.run.smithi008.stdout: }, 2023-08-01T19:55:58.438 INFO:teuthology.orchestra.run.smithi008.stdout: { 2023-08-01T19:55:58.438 INFO:teuthology.orchestra.run.smithi008.stdout: "description": "osd_op(client.4668.0:197073 5.6 5:6a71909e:::benchmark_data_smithi006_114134_object63412:head [delete] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e61)", 2023-08-01T19:55:58.438 INFO:teuthology.orchestra.run.smithi008.stdout: "initiated_at": "2023-08-01T19:55:58.397490+0000", 2023-08-01T19:55:58.438 INFO:teuthology.orchestra.run.smithi008.stdout: "age": 0.0060031570000000003, 2023-08-01T19:55:58.438 INFO:teuthology.orchestra.run.smithi008.stdout: "duration": 0.0063259170000000003, 2023-08-01T19:55:58.438 INFO:teuthology.orchestra.run.smithi008.stdout: "type_data": { 2023-08-01T19:55:58.438 INFO:teuthology.orchestra.run.smithi008.stdout: "flag_point": "waiting for sub ops", 2023-08-01T19:55:58.439 INFO:teuthology.orchestra.run.smithi008.stdout: "client_info": { 2023-08-01T19:55:58.439 INFO:teuthology.orchestra.run.smithi008.stdout: "client": "client.4668", 2023-08-01T19:55:58.439 INFO:teuthology.orchestra.run.smithi008.stdout: "client_addr": "172.21.15.6:0/1709472247", 2023-08-01T19:55:58.439 INFO:teuthology.orchestra.run.smithi008.stdout: "tid": 197073 2023-08-01T19:55:58.439 INFO:teuthology.orchestra.run.smithi008.stdout: }, 2023-08-01T19:55:58.439 INFO:teuthology.orchestra.run.smithi008.stdout: "events": [ 2023-08-01T19:55:58.439 INFO:teuthology.orchestra.run.smithi008.stdout: { 2023-08-01T19:55:58.440 INFO:teuthology.orchestra.run.smithi008.stdout: "event": "initiated", 2023-08-01T19:55:58.440 INFO:teuthology.orchestra.run.smithi008.stdout: "time": "2023-08-01T19:55:58.397490+0000", 2023-08-01T19:55:58.440 INFO:teuthology.orchestra.run.smithi008.stdout: "duration": 0 2023-08-01T19:55:58.440 INFO:teuthology.orchestra.run.smithi008.stdout: }, 2023-08-01T19:55:58.440 INFO:teuthology.orchestra.run.smithi008.stdout: { 2023-08-01T19:55:58.440 INFO:teuthology.orchestra.run.smithi008.stdout: "event": "throttled", 2023-08-01T19:55:58.440 INFO:teuthology.orchestra.run.smithi008.stdout: "time": "2023-08-01T19:55:58.397490+0000", 2023-08-01T19:55:58.440 INFO:teuthology.orchestra.run.smithi008.stdout: "duration": 0 2023-08-01T19:55:58.441 INFO:teuthology.orchestra.run.smithi008.stdout: }, 2023-08-01T19:55:58.441 INFO:teuthology.orchestra.run.smithi008.stdout: { 2023-08-01T19:55:58.441 INFO:teuthology.orchestra.run.smithi008.stdout: "event": "header_read", 2023-08-01T19:55:58.441 INFO:teuthology.orchestra.run.smithi008.stdout: "time": "2023-08-01T19:55:58.397489+0000", 2023-08-01T19:55:58.441 INFO:teuthology.orchestra.run.smithi008.stdout: "duration": 4294967295.999999 2023-08-01T19:55:58.441 INFO:teuthology.orchestra.run.smithi008.stdout: }, 2023-08-01T19:55:58.441 INFO:teuthology.orchestra.run.smithi008.stdout: { 2023-08-01T19:55:58.441 INFO:teuthology.orchestra.run.smithi008.stdout: "event": "all_read", 2023-08-01T19:55:58.442 INFO:teuthology.orchestra.run.smithi008.stdout: "time": "2023-08-01T19:55:58.397494+0000", 2023-08-01T19:55:58.442 INFO:teuthology.orchestra.run.smithi008.stdout: "duration": 4.8330000000000001e-06 2023-08-01T19:55:58.442 INFO:teuthology.orchestra.run.smithi008.stdout: }, 2023-08-01T19:55:58.442 INFO:teuthology.orchestra.run.smithi008.stdout: { 2023-08-01T19:55:58.442 INFO:teuthology.orchestra.run.smithi008.stdout: "event": "dispatched", 2023-08-01T19:55:58.442 INFO:teuthology.orchestra.run.smithi008.stdout: "time": "2023-08-01T19:55:58.397504+0000", 2023-08-01T19:55:58.442 INFO:teuthology.orchestra.run.smithi008.stdout: "duration": 1.0148e-05 2023-08-01T19:55:58.442 INFO:teuthology.orchestra.run.smithi008.stdout: }, 2023-08-01T19:55:58.443 INFO:teuthology.orchestra.run.smithi008.stdout: { 2023-08-01T19:55:58.443 INFO:teuthology.orchestra.run.smithi008.stdout: "event": "queued_for_pg", 2023-08-01T19:55:58.443 INFO:teuthology.orchestra.run.smithi008.stdout: "time": "2023-08-01T19:55:58.397509+0000", 2023-08-01T19:55:58.443 INFO:teuthology.orchestra.run.smithi008.stdout: "duration": 5.6149999999999996e-06 2023-08-01T19:55:58.443 INFO:teuthology.orchestra.run.smithi008.stdout: }, 2023-08-01T19:55:58.443 INFO:teuthology.orchestra.run.smithi008.stdout: { 2023-08-01T19:55:58.443 INFO:teuthology.orchestra.run.smithi008.stdout: "event": "reached_pg", 2023-08-01T19:55:58.443 INFO:teuthology.orchestra.run.smithi008.stdout: "time": "2023-08-01T19:55:58.397549+0000", 2023-08-01T19:55:58.444 INFO:teuthology.orchestra.run.smithi008.stdout: "duration": 3.9833999999999998e-05 2023-08-01T19:55:58.444 INFO:teuthology.orchestra.run.smithi008.stdout: }, 2023-08-01T19:55:58.444 INFO:teuthology.orchestra.run.smithi008.stdout: { 2023-08-01T19:55:58.444 INFO:teuthology.orchestra.run.smithi008.stdout: "event": "started", 2023-08-01T19:55:58.444 INFO:teuthology.orchestra.run.smithi008.stdout: "time": "2023-08-01T19:55:58.397660+0000", 2023-08-01T19:55:58.444 INFO:teuthology.orchestra.run.smithi008.stdout: "duration": 0.00011095300000000001 2023-08-01T19:55:58.444 INFO:teuthology.orchestra.run.smithi008.stdout: }, 2023-08-01T19:55:58.445 INFO:teuthology.orchestra.run.smithi008.stdout: { 2023-08-01T19:55:58.445 INFO:teuthology.orchestra.run.smithi008.stdout: "event": "waiting for subops from 1", 2023-08-01T19:55:58.445 INFO:teuthology.orchestra.run.smithi008.stdout: "time": "2023-08-01T19:55:58.397765+0000", 2023-08-01T19:55:58.445 INFO:teuthology.orchestra.run.smithi008.stdout: "duration": 0.000104545 2023-08-01T19:55:58.445 INFO:teuthology.orchestra.run.smithi008.stdout: } 2023-08-01T19:55:58.445 INFO:teuthology.orchestra.run.smithi008.stdout: ] 2023-08-01T19:55:58.445 INFO:teuthology.orchestra.run.smithi008.stdout: } 2023-08-01T19:55:58.445 INFO:teuthology.orchestra.run.smithi008.stdout: }, 2023-08-01T19:55:58.446 INFO:teuthology.orchestra.run.smithi008.stdout: { 2023-08-01T19:55:58.446 INFO:teuthology.orchestra.run.smithi008.stdout: "description": "osd_op(client.4668.0:197074 5.5 5:abee3880:::benchmark_data_smithi006_114134_object63413:head [delete] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e61)", 2023-08-01T19:55:58.446 INFO:teuthology.orchestra.run.smithi008.stdout: "initiated_at": "2023-08-01T19:55:58.398587+0000", 2023-08-01T19:55:58.446 INFO:teuthology.orchestra.run.smithi008.stdout: "age": 0.0049062649999999999, 2023-08-01T19:55:58.446 INFO:teuthology.orchestra.run.smithi008.stdout: "duration": 0.0052717370000000003, 2023-08-01T19:55:58.446 INFO:teuthology.orchestra.run.smithi008.stdout: "type_data": { 2023-08-01T19:55:58.446 INFO:teuthology.orchestra.run.smithi008.stdout: "flag_point": "waiting for sub ops", 2023-08-01T19:55:58.446 INFO:teuthology.orchestra.run.smithi008.stdout: "client_info": { 2023-08-01T19:55:58.447 INFO:teuthology.orchestra.run.smithi008.stdout: "client": "client.4668", 2023-08-01T19:55:58.447 INFO:teuthology.orchestra.run.smithi008.stdout: "client_addr": "172.21.15.6:0/1709472247", 2023-08-01T19:55:58.447 INFO:teuthology.orchestra.run.smithi008.stdout: "tid": 197074 2023-08-01T19:55:58.447 INFO:teuthology.orchestra.run.smithi008.stdout: }, 2023-08-01T19:55:58.447 INFO:teuthology.orchestra.run.smithi008.stdout: "events": [ 2023-08-01T19:55:58.447 INFO:teuthology.orchestra.run.smithi008.stdout: { 2023-08-01T19:55:58.447 INFO:teuthology.orchestra.run.smithi008.stdout: "event": "initiated", 2023-08-01T19:55:58.447 INFO:teuthology.orchestra.run.smithi008.stdout: "time": "2023-08-01T19:55:58.398587+0000", 2023-08-01T19:55:58.448 INFO:teuthology.orchestra.run.smithi008.stdout: "duration": 0 2023-08-01T19:55:58.448 INFO:teuthology.orchestra.run.smithi008.stdout: }, 2023-08-01T19:55:58.448 INFO:teuthology.orchestra.run.smithi008.stdout: { 2023-08-01T19:55:58.448 INFO:teuthology.orchestra.run.smithi008.stdout: "event": "throttled", 2023-08-01T19:55:58.448 INFO:teuthology.orchestra.run.smithi008.stdout: "time": "2023-08-01T19:55:58.398587+0000", 2023-08-01T19:55:58.448 INFO:teuthology.orchestra.run.smithi008.stdout: "duration": 0 2023-08-01T19:55:58.448 INFO:teuthology.orchestra.run.smithi008.stdout: }, 2023-08-01T19:55:58.448 INFO:teuthology.orchestra.run.smithi008.stdout: { 2023-08-01T19:55:58.449 INFO:teuthology.orchestra.run.smithi008.stdout: "event": "header_read", 2023-08-01T19:55:58.449 INFO:teuthology.orchestra.run.smithi008.stdout: "time": "2023-08-01T19:55:58.398586+0000", 2023-08-01T19:55:58.449 INFO:teuthology.orchestra.run.smithi008.stdout: "duration": 4294967295.999999 2023-08-01T19:55:58.449 INFO:teuthology.orchestra.run.smithi008.stdout: }, 2023-08-01T19:55:58.449 INFO:teuthology.orchestra.run.smithi008.stdout: { 2023-08-01T19:55:58.449 INFO:teuthology.orchestra.run.smithi008.stdout: "event": "all_read", 2023-08-01T19:55:58.449 INFO:teuthology.orchestra.run.smithi008.stdout: "time": "2023-08-01T19:55:58.398590+0000", 2023-08-01T19:55:58.450 INFO:teuthology.orchestra.run.smithi008.stdout: "duration": 4.2939999999999999e-06 2023-08-01T19:55:58.450 INFO:teuthology.orchestra.run.smithi008.stdout: }, 2023-08-01T19:55:58.450 INFO:teuthology.orchestra.run.smithi008.stdout: { 2023-08-01T19:55:58.450 INFO:teuthology.orchestra.run.smithi008.stdout: "event": "dispatched", 2023-08-01T19:55:58.450 INFO:teuthology.orchestra.run.smithi008.stdout: "time": "2023-08-01T19:55:58.398600+0000", 2023-08-01T19:55:58.450 INFO:teuthology.orchestra.run.smithi008.stdout: "duration": 9.6730000000000004e-06 2023-08-01T19:55:58.450 INFO:teuthology.orchestra.run.smithi008.stdout: }, 2023-08-01T19:55:58.450 INFO:teuthology.orchestra.run.smithi008.stdout: { 2023-08-01T19:55:58.451 INFO:teuthology.orchestra.run.smithi008.stdout: "event": "queued_for_pg", 2023-08-01T19:55:58.451 INFO:teuthology.orchestra.run.smithi008.stdout: "time": "2023-08-01T19:55:58.398604+0000", 2023-08-01T19:55:58.451 INFO:teuthology.orchestra.run.smithi008.stdout: "duration": 4.4240000000000003e-06 2023-08-01T19:55:58.451 INFO:teuthology.orchestra.run.smithi008.stdout: }, 2023-08-01T19:55:58.451 INFO:teuthology.orchestra.run.smithi008.stdout: { 2023-08-01T19:55:58.451 INFO:teuthology.orchestra.run.smithi008.stdout: "event": "reached_pg", 2023-08-01T19:55:58.451 INFO:teuthology.orchestra.run.smithi008.stdout: "time": "2023-08-01T19:55:58.398639+0000", 2023-08-01T19:55:58.451 INFO:teuthology.orchestra.run.smithi008.stdout: "duration": 3.5268000000000002e-05 2023-08-01T19:55:58.452 INFO:teuthology.orchestra.run.smithi008.stdout: }, 2023-08-01T19:55:58.452 INFO:teuthology.orchestra.run.smithi008.stdout: { 2023-08-01T19:55:58.452 INFO:teuthology.orchestra.run.smithi008.stdout: "event": "started", 2023-08-01T19:55:58.452 INFO:teuthology.orchestra.run.smithi008.stdout: "time": "2023-08-01T19:55:58.398713+0000", 2023-08-01T19:55:58.452 INFO:teuthology.orchestra.run.smithi008.stdout: "duration": 7.3137000000000001e-05 2023-08-01T19:55:58.452 INFO:teuthology.orchestra.run.smithi008.stdout: }, 2023-08-01T19:55:58.452 INFO:teuthology.orchestra.run.smithi008.stdout: { 2023-08-01T19:55:58.452 INFO:teuthology.orchestra.run.smithi008.stdout: "event": "waiting for subops from 1", 2023-08-01T19:55:58.453 INFO:teuthology.orchestra.run.smithi008.stdout: "time": "2023-08-01T19:55:58.398810+0000", 2023-08-01T19:55:58.453 INFO:teuthology.orchestra.run.smithi008.stdout: "duration": 9.7466999999999994e-05 2023-08-01T19:55:58.453 INFO:teuthology.orchestra.run.smithi008.stdout: } 2023-08-01T19:55:58.453 INFO:teuthology.orchestra.run.smithi008.stdout: ] 2023-08-01T19:55:58.453 INFO:teuthology.orchestra.run.smithi008.stdout: } 2023-08-01T19:55:58.453 INFO:teuthology.orchestra.run.smithi008.stdout: }, 2023-08-01T19:55:58.453 INFO:teuthology.orchestra.run.smithi008.stdout: { 2023-08-01T19:55:58.453 INFO:teuthology.orchestra.run.smithi008.stdout: "description": "osd_op(client.4668.0:197075 5.6 5:6be9aecf:::benchmark_data_smithi006_114134_object63414:head [delete] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e61)", 2023-08-01T19:55:58.454 INFO:teuthology.orchestra.run.smithi008.stdout: "initiated_at": "2023-08-01T19:55:58.399669+0000", 2023-08-01T19:55:58.454 INFO:teuthology.orchestra.run.smithi008.stdout: "age": 0.0038238030000000002, 2023-08-01T19:55:58.454 INFO:teuthology.orchestra.run.smithi008.stdout: "duration": 0.0042503829999999999, 2023-08-01T19:55:58.454 INFO:teuthology.orchestra.run.smithi008.stdout: "type_data": { 2023-08-01T19:55:58.454 INFO:teuthology.orchestra.run.smithi008.stdout: "flag_point": "waiting for sub ops", 2023-08-01T19:55:58.454 INFO:teuthology.orchestra.run.smithi008.stdout: "client_info": { 2023-08-01T19:55:58.454 INFO:teuthology.orchestra.run.smithi008.stdout: "client": "client.4668", 2023-08-01T19:55:58.455 INFO:teuthology.orchestra.run.smithi008.stdout: "client_addr": "172.21.15.6:0/1709472247", 2023-08-01T19:55:58.455 INFO:teuthology.orchestra.run.smithi008.stdout: "tid": 197075 2023-08-01T19:55:58.455 INFO:teuthology.orchestra.run.smithi008.stdout: }, 2023-08-01T19:55:58.455 INFO:teuthology.orchestra.run.smithi008.stdout: "events": [ 2023-08-01T19:55:58.455 INFO:teuthology.orchestra.run.smithi008.stdout: { 2023-08-01T19:55:58.455 INFO:teuthology.orchestra.run.smithi008.stdout: "event": "initiated", 2023-08-01T19:55:58.455 INFO:teuthology.orchestra.run.smithi008.stdout: "time": "2023-08-01T19:55:58.399669+0000", 2023-08-01T19:55:58.455 INFO:teuthology.orchestra.run.smithi008.stdout: "duration": 0 2023-08-01T19:55:58.456 INFO:teuthology.orchestra.run.smithi008.stdout: }, 2023-08-01T19:55:58.456 INFO:teuthology.orchestra.run.smithi008.stdout: { 2023-08-01T19:55:58.456 INFO:teuthology.orchestra.run.smithi008.stdout: "event": "throttled", 2023-08-01T19:55:58.456 INFO:teuthology.orchestra.run.smithi008.stdout: "time": "2023-08-01T19:55:58.399669+0000", 2023-08-01T19:55:58.456 INFO:teuthology.orchestra.run.smithi008.stdout: "duration": 0 2023-08-01T19:55:58.456 INFO:teuthology.orchestra.run.smithi008.stdout: }, 2023-08-01T19:55:58.456 INFO:teuthology.orchestra.run.smithi008.stdout: { 2023-08-01T19:55:58.457 INFO:teuthology.orchestra.run.smithi008.stdout: "event": "header_read", 2023-08-01T19:55:58.457 INFO:teuthology.orchestra.run.smithi008.stdout: "time": "2023-08-01T19:55:58.399668+0000", 2023-08-01T19:55:58.457 INFO:teuthology.orchestra.run.smithi008.stdout: "duration": 4294967295.999999 2023-08-01T19:55:58.457 INFO:teuthology.orchestra.run.smithi008.stdout: }, 2023-08-01T19:55:58.457 INFO:teuthology.orchestra.run.smithi008.stdout: { 2023-08-01T19:55:58.457 INFO:teuthology.orchestra.run.smithi008.stdout: "event": "all_read", 2023-08-01T19:55:58.457 INFO:teuthology.orchestra.run.smithi008.stdout: "time": "2023-08-01T19:55:58.399672+0000", 2023-08-01T19:55:58.457 INFO:teuthology.orchestra.run.smithi008.stdout: "duration": 4.2409999999999997e-06 2023-08-01T19:55:58.458 INFO:teuthology.orchestra.run.smithi008.stdout: }, 2023-08-01T19:55:58.458 INFO:teuthology.orchestra.run.smithi008.stdout: { 2023-08-01T19:55:58.458 INFO:teuthology.orchestra.run.smithi008.stdout: "event": "dispatched", 2023-08-01T19:55:58.458 INFO:teuthology.orchestra.run.smithi008.stdout: "time": "2023-08-01T19:55:58.399684+0000", 2023-08-01T19:55:58.458 INFO:teuthology.orchestra.run.smithi008.stdout: "duration": 1.1418e-05 2023-08-01T19:55:58.458 INFO:teuthology.orchestra.run.smithi008.stdout: }, 2023-08-01T19:55:58.458 INFO:teuthology.orchestra.run.smithi008.stdout: { 2023-08-01T19:55:58.458 INFO:teuthology.orchestra.run.smithi008.stdout: "event": "queued_for_pg", 2023-08-01T19:55:58.459 INFO:teuthology.orchestra.run.smithi008.stdout: "time": "2023-08-01T19:55:58.399689+0000", 2023-08-01T19:55:58.459 INFO:teuthology.orchestra.run.smithi008.stdout: "duration": 5.4229999999999996e-06 2023-08-01T19:55:58.459 INFO:teuthology.orchestra.run.smithi008.stdout: }, 2023-08-01T19:55:58.459 INFO:teuthology.orchestra.run.smithi008.stdout: { 2023-08-01T19:55:58.459 INFO:teuthology.orchestra.run.smithi008.stdout: "event": "reached_pg", 2023-08-01T19:55:58.459 INFO:teuthology.orchestra.run.smithi008.stdout: "time": "2023-08-01T19:55:58.399728+0000", 2023-08-01T19:55:58.459 INFO:teuthology.orchestra.run.smithi008.stdout: "duration": 3.9033999999999999e-05 2023-08-01T19:55:58.459 INFO:teuthology.orchestra.run.smithi008.stdout: }, 2023-08-01T19:55:58.460 INFO:teuthology.orchestra.run.smithi008.stdout: { 2023-08-01T19:55:58.460 INFO:teuthology.orchestra.run.smithi008.stdout: "event": "started", 2023-08-01T19:55:58.460 INFO:teuthology.orchestra.run.smithi008.stdout: "time": "2023-08-01T19:55:58.399806+0000", 2023-08-01T19:55:58.460 INFO:teuthology.orchestra.run.smithi008.stdout: "duration": 7.7818999999999995e-05 2023-08-01T19:55:58.460 INFO:teuthology.orchestra.run.smithi008.stdout: }, 2023-08-01T19:55:58.460 INFO:teuthology.orchestra.run.smithi008.stdout: { 2023-08-01T19:55:58.460 INFO:teuthology.orchestra.run.smithi008.stdout: "event": "waiting for subops from 1", 2023-08-01T19:55:58.460 INFO:teuthology.orchestra.run.smithi008.stdout: "time": "2023-08-01T19:55:58.399867+0000", 2023-08-01T19:55:58.461 INFO:teuthology.orchestra.run.smithi008.stdout: "duration": 6.0832999999999998e-05 2023-08-01T19:55:58.461 INFO:teuthology.orchestra.run.smithi008.stdout: } 2023-08-01T19:55:58.461 INFO:teuthology.orchestra.run.smithi008.stdout: ] 2023-08-01T19:55:58.461 INFO:teuthology.orchestra.run.smithi008.stdout: } 2023-08-01T19:55:58.461 INFO:teuthology.orchestra.run.smithi008.stdout: }, 2023-08-01T19:55:58.461 INFO:teuthology.orchestra.run.smithi008.stdout: { 2023-08-01T19:55:58.461 INFO:teuthology.orchestra.run.smithi008.stdout: "description": "osd_op(client.4668.0:197076 5.5 5:a73bd7fd:::benchmark_data_smithi006_114134_object63415:head [delete] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e61)", 2023-08-01T19:55:58.462 INFO:teuthology.orchestra.run.smithi008.stdout: "initiated_at": "2023-08-01T19:55:58.399698+0000", 2023-08-01T19:55:58.462 INFO:teuthology.orchestra.run.smithi008.stdout: "age": 0.0037946379999999999, 2023-08-01T19:55:58.462 INFO:teuthology.orchestra.run.smithi008.stdout: "duration": 0.0042951079999999997, 2023-08-01T19:55:58.462 INFO:teuthology.orchestra.run.smithi008.stdout: "type_data": { 2023-08-01T19:55:58.462 INFO:teuthology.orchestra.run.smithi008.stdout: "flag_point": "waiting for sub ops", 2023-08-01T19:55:58.462 INFO:teuthology.orchestra.run.smithi008.stdout: "client_info": { 2023-08-01T19:55:58.462 INFO:teuthology.orchestra.run.smithi008.stdout: "client": "client.4668", 2023-08-01T19:55:58.462 INFO:teuthology.orchestra.run.smithi008.stdout: "client_addr": "172.21.15.6:0/1709472247", 2023-08-01T19:55:58.463 INFO:teuthology.orchestra.run.smithi008.stdout: "tid": 197076 2023-08-01T19:55:58.463 INFO:teuthology.orchestra.run.smithi008.stdout: }, 2023-08-01T19:55:58.463 INFO:teuthology.orchestra.run.smithi008.stdout: "events": [ 2023-08-01T19:55:58.463 INFO:teuthology.orchestra.run.smithi008.stdout: { 2023-08-01T19:55:58.463 INFO:teuthology.orchestra.run.smithi008.stdout: "event": "initiated", 2023-08-01T19:55:58.463 INFO:teuthology.orchestra.run.smithi008.stdout: "time": "2023-08-01T19:55:58.399698+0000", 2023-08-01T19:55:58.463 INFO:teuthology.orchestra.run.smithi008.stdout: "duration": 0 2023-08-01T19:55:58.463 INFO:teuthology.orchestra.run.smithi008.stdout: }, 2023-08-01T19:55:58.464 INFO:teuthology.orchestra.run.smithi008.stdout: { 2023-08-01T19:55:58.464 INFO:teuthology.orchestra.run.smithi008.stdout: "event": "throttled", 2023-08-01T19:55:58.464 INFO:teuthology.orchestra.run.smithi008.stdout: "time": "2023-08-01T19:55:58.399698+0000", 2023-08-01T19:55:58.464 INFO:teuthology.orchestra.run.smithi008.stdout: "duration": 0 2023-08-01T19:55:58.464 INFO:teuthology.orchestra.run.smithi008.stdout: }, 2023-08-01T19:55:58.464 INFO:teuthology.orchestra.run.smithi008.stdout: { 2023-08-01T19:55:58.464 INFO:teuthology.orchestra.run.smithi008.stdout: "event": "header_read", 2023-08-01T19:55:58.464 INFO:teuthology.orchestra.run.smithi008.stdout: "time": "2023-08-01T19:55:58.399698+0000", 2023-08-01T19:55:58.465 INFO:teuthology.orchestra.run.smithi008.stdout: "duration": 4294967295.9999995 2023-08-01T19:55:58.465 INFO:teuthology.orchestra.run.smithi008.stdout: }, 2023-08-01T19:55:58.465 INFO:teuthology.orchestra.run.smithi008.stdout: { 2023-08-01T19:55:58.465 INFO:teuthology.orchestra.run.smithi008.stdout: "event": "all_read", 2023-08-01T19:55:58.465 INFO:teuthology.orchestra.run.smithi008.stdout: "time": "2023-08-01T19:55:58.399700+0000", 2023-08-01T19:55:58.465 INFO:teuthology.orchestra.run.smithi008.stdout: "duration": 2.3819999999999998e-06 2023-08-01T19:55:58.465 INFO:teuthology.orchestra.run.smithi008.stdout: }, 2023-08-01T19:55:58.465 INFO:teuthology.orchestra.run.smithi008.stdout: { 2023-08-01T19:55:58.466 INFO:teuthology.orchestra.run.smithi008.stdout: "event": "dispatched", 2023-08-01T19:55:58.466 INFO:teuthology.orchestra.run.smithi008.stdout: "time": "2023-08-01T19:55:58.399711+0000", 2023-08-01T19:55:58.466 INFO:teuthology.orchestra.run.smithi008.stdout: "duration": 1.1134999999999999e-05 2023-08-01T19:55:58.466 INFO:teuthology.orchestra.run.smithi008.stdout: }, 2023-08-01T19:55:58.466 INFO:teuthology.orchestra.run.smithi008.stdout: { 2023-08-01T19:55:58.466 INFO:teuthology.orchestra.run.smithi008.stdout: "event": "queued_for_pg", 2023-08-01T19:55:58.466 INFO:teuthology.orchestra.run.smithi008.stdout: "time": "2023-08-01T19:55:58.399716+0000", 2023-08-01T19:55:58.467 INFO:teuthology.orchestra.run.smithi008.stdout: "duration": 4.3919999999999996e-06 2023-08-01T19:55:58.467 INFO:teuthology.orchestra.run.smithi008.stdout: }, 2023-08-01T19:55:58.467 INFO:teuthology.orchestra.run.smithi008.stdout: { 2023-08-01T19:55:58.467 INFO:teuthology.orchestra.run.smithi008.stdout: "event": "reached_pg", 2023-08-01T19:55:58.467 INFO:teuthology.orchestra.run.smithi008.stdout: "time": "2023-08-01T19:55:58.400152+0000", 2023-08-01T19:55:58.467 INFO:teuthology.orchestra.run.smithi008.stdout: "duration": 0.000436105 2023-08-01T19:55:58.467 INFO:teuthology.orchestra.run.smithi008.stdout: }, 2023-08-01T19:55:58.467 INFO:teuthology.orchestra.run.smithi008.stdout: { 2023-08-01T19:55:58.468 INFO:teuthology.orchestra.run.smithi008.stdout: "event": "started", 2023-08-01T19:55:58.468 INFO:teuthology.orchestra.run.smithi008.stdout: "time": "2023-08-01T19:55:58.400222+0000", 2023-08-01T19:55:58.468 INFO:teuthology.orchestra.run.smithi008.stdout: "duration": 7.0699999999999997e-05 2023-08-01T19:55:58.468 INFO:teuthology.orchestra.run.smithi008.stdout: }, 2023-08-01T19:55:58.468 INFO:teuthology.orchestra.run.smithi008.stdout: { 2023-08-01T19:55:58.468 INFO:teuthology.orchestra.run.smithi008.stdout: "event": "waiting for subops from 1", 2023-08-01T19:55:58.468 INFO:teuthology.orchestra.run.smithi008.stdout: "time": "2023-08-01T19:55:58.400284+0000", 2023-08-01T19:55:58.468 INFO:teuthology.orchestra.run.smithi008.stdout: "duration": 6.1162999999999997e-05 2023-08-01T19:55:58.469 INFO:teuthology.orchestra.run.smithi008.stdout: } 2023-08-01T19:55:58.469 INFO:teuthology.orchestra.run.smithi008.stdout: ] 2023-08-01T19:55:58.469 INFO:teuthology.orchestra.run.smithi008.stdout: } 2023-08-01T19:55:58.469 INFO:teuthology.orchestra.run.smithi008.stdout: }, 2023-08-01T19:55:58.469 INFO:teuthology.orchestra.run.smithi008.stdout: { 2023-08-01T19:55:58.469 INFO:teuthology.orchestra.run.smithi008.stdout: "description": "osd_repop(client.4668.0:197077 5.2 e61/53 5:42c589f0:::benchmark_data_smithi006_114134_object63416:head v 61'12679, mlcod=61'12676)", 2023-08-01T19:55:58.469 INFO:teuthology.orchestra.run.smithi008.stdout: "initiated_at": "2023-08-01T19:55:58.400677+0000", 2023-08-01T19:55:58.469 INFO:teuthology.orchestra.run.smithi008.stdout: "age": 0.0028158480000000001, 2023-08-01T19:55:58.470 INFO:teuthology.orchestra.run.smithi008.stdout: "duration": 0.0033694329999999998, 2023-08-01T19:55:58.470 INFO:teuthology.orchestra.run.smithi008.stdout: "type_data": { 2023-08-01T19:55:58.470 INFO:teuthology.orchestra.run.smithi008.stdout: "flag_point": "started", 2023-08-01T19:55:58.470 INFO:teuthology.orchestra.run.smithi008.stdout: "events": [ 2023-08-01T19:55:58.470 INFO:teuthology.orchestra.run.smithi008.stdout: { 2023-08-01T19:55:58.470 INFO:teuthology.orchestra.run.smithi008.stdout: "event": "initiated", 2023-08-01T19:55:58.470 INFO:teuthology.orchestra.run.smithi008.stdout: "time": "2023-08-01T19:55:58.400677+0000", 2023-08-01T19:55:58.470 INFO:teuthology.orchestra.run.smithi008.stdout: "duration": 0 2023-08-01T19:55:58.471 INFO:teuthology.orchestra.run.smithi008.stdout: }, 2023-08-01T19:55:58.471 INFO:teuthology.orchestra.run.smithi008.stdout: { 2023-08-01T19:55:58.471 INFO:teuthology.orchestra.run.smithi008.stdout: "event": "throttled", 2023-08-01T19:55:58.471 INFO:teuthology.orchestra.run.smithi008.stdout: "time": "2023-08-01T19:55:58.400677+0000", 2023-08-01T19:55:58.471 INFO:teuthology.orchestra.run.smithi008.stdout: "duration": 0 2023-08-01T19:55:58.471 INFO:teuthology.orchestra.run.smithi008.stdout: }, 2023-08-01T19:55:58.471 INFO:teuthology.orchestra.run.smithi008.stdout: { 2023-08-01T19:55:58.471 INFO:teuthology.orchestra.run.smithi008.stdout: "event": "header_read", 2023-08-01T19:55:58.472 INFO:teuthology.orchestra.run.smithi008.stdout: "time": "2023-08-01T19:55:58.400676+0000", 2023-08-01T19:55:58.472 INFO:teuthology.orchestra.run.smithi008.stdout: "duration": 4294967295.9999995 2023-08-01T19:55:58.472 INFO:teuthology.orchestra.run.smithi008.stdout: }, 2023-08-01T19:55:58.472 INFO:teuthology.orchestra.run.smithi008.stdout: { 2023-08-01T19:55:58.472 INFO:teuthology.orchestra.run.smithi008.stdout: "event": "all_read", 2023-08-01T19:55:58.472 INFO:teuthology.orchestra.run.smithi008.stdout: "time": "2023-08-01T19:55:58.400682+0000", 2023-08-01T19:55:58.472 INFO:teuthology.orchestra.run.smithi008.stdout: "duration": 5.6400000000000002e-06 2023-08-01T19:55:58.473 INFO:teuthology.orchestra.run.smithi008.stdout: }, 2023-08-01T19:55:58.473 INFO:teuthology.orchestra.run.smithi008.stdout: { 2023-08-01T19:55:58.473 INFO:teuthology.orchestra.run.smithi008.stdout: "event": "dispatched", 2023-08-01T19:55:58.473 INFO:teuthology.orchestra.run.smithi008.stdout: "time": "2023-08-01T19:55:58.400694+0000", 2023-08-01T19:55:58.473 INFO:teuthology.orchestra.run.smithi008.stdout: "duration": 1.2204e-05 2023-08-01T19:55:58.473 INFO:teuthology.orchestra.run.smithi008.stdout: }, 2023-08-01T19:55:58.473 INFO:teuthology.orchestra.run.smithi008.stdout: { 2023-08-01T19:55:58.473 INFO:teuthology.orchestra.run.smithi008.stdout: "event": "queued_for_pg", 2023-08-01T19:55:58.474 INFO:teuthology.orchestra.run.smithi008.stdout: "time": "2023-08-01T19:55:58.400708+0000", 2023-08-01T19:55:58.474 INFO:teuthology.orchestra.run.smithi008.stdout: "duration": 1.3519999999999999e-05 2023-08-01T19:55:58.474 INFO:teuthology.orchestra.run.smithi008.stdout: }, 2023-08-01T19:55:58.474 INFO:teuthology.orchestra.run.smithi008.stdout: { 2023-08-01T19:55:58.474 INFO:teuthology.orchestra.run.smithi008.stdout: "event": "reached_pg", 2023-08-01T19:55:58.474 INFO:teuthology.orchestra.run.smithi008.stdout: "time": "2023-08-01T19:55:58.400743+0000", 2023-08-01T19:55:58.474 INFO:teuthology.orchestra.run.smithi008.stdout: "duration": 3.5709e-05 2023-08-01T19:55:58.474 INFO:teuthology.orchestra.run.smithi008.stdout: }, 2023-08-01T19:55:58.475 INFO:teuthology.orchestra.run.smithi008.stdout: { 2023-08-01T19:55:58.475 INFO:teuthology.orchestra.run.smithi008.stdout: "event": "started", 2023-08-01T19:55:58.475 INFO:teuthology.orchestra.run.smithi008.stdout: "time": "2023-08-01T19:55:58.400763+0000", 2023-08-01T19:55:58.475 INFO:teuthology.orchestra.run.smithi008.stdout: "duration": 1.9029e-05 2023-08-01T19:55:58.475 INFO:teuthology.orchestra.run.smithi008.stdout: } 2023-08-01T19:55:58.475 INFO:teuthology.orchestra.run.smithi008.stdout: ] 2023-08-01T19:55:58.475 INFO:teuthology.orchestra.run.smithi008.stdout: } 2023-08-01T19:55:58.475 INFO:teuthology.orchestra.run.smithi008.stdout: }, 2023-08-01T19:55:58.476 INFO:teuthology.orchestra.run.smithi008.stdout: { 2023-08-01T19:55:58.476 INFO:teuthology.orchestra.run.smithi008.stdout: "description": "osd_repop(client.4668.0:197078 5.7 e61/19 5:eab2fa11:::benchmark_data_smithi006_114134_object63417:head v 61'12317, mlcod=61'12313)", 2023-08-01T19:55:58.476 INFO:teuthology.orchestra.run.smithi008.stdout: "initiated_at": "2023-08-01T19:55:58.400734+0000", 2023-08-01T19:55:58.476 INFO:teuthology.orchestra.run.smithi008.stdout: "age": 0.0027584829999999999, 2023-08-01T19:55:58.476 INFO:teuthology.orchestra.run.smithi008.stdout: "duration": 0.0033487040000000001, 2023-08-01T19:55:58.476 INFO:teuthology.orchestra.run.smithi008.stdout: "type_data": { 2023-08-01T19:55:58.476 INFO:teuthology.orchestra.run.smithi008.stdout: "flag_point": "started", 2023-08-01T19:55:58.477 INFO:teuthology.orchestra.run.smithi008.stdout: "events": [ 2023-08-01T19:55:58.477 INFO:teuthology.orchestra.run.smithi008.stdout: { 2023-08-01T19:55:58.477 INFO:teuthology.orchestra.run.smithi008.stdout: "event": "initiated", 2023-08-01T19:55:58.477 INFO:teuthology.orchestra.run.smithi008.stdout: "time": "2023-08-01T19:55:58.400734+0000", 2023-08-01T19:55:58.477 INFO:teuthology.orchestra.run.smithi008.stdout: "duration": 0 2023-08-01T19:55:58.477 INFO:teuthology.orchestra.run.smithi008.stdout: }, 2023-08-01T19:55:58.477 INFO:teuthology.orchestra.run.smithi008.stdout: { 2023-08-01T19:55:58.477 INFO:teuthology.orchestra.run.smithi008.stdout: "event": "throttled", 2023-08-01T19:55:58.478 INFO:teuthology.orchestra.run.smithi008.stdout: "time": "2023-08-01T19:55:58.400734+0000", 2023-08-01T19:55:58.478 INFO:teuthology.orchestra.run.smithi008.stdout: "duration": 0 2023-08-01T19:55:58.478 INFO:teuthology.orchestra.run.smithi008.stdout: }, 2023-08-01T19:55:58.478 INFO:teuthology.orchestra.run.smithi008.stdout: { 2023-08-01T19:55:58.478 INFO:teuthology.orchestra.run.smithi008.stdout: "event": "header_read", 2023-08-01T19:55:58.478 INFO:teuthology.orchestra.run.smithi008.stdout: "time": "2023-08-01T19:55:58.400734+0000", 2023-08-01T19:55:58.478 INFO:teuthology.orchestra.run.smithi008.stdout: "duration": 4294967295.9999995 2023-08-01T19:55:58.478 INFO:teuthology.orchestra.run.smithi008.stdout: }, 2023-08-01T19:55:58.479 INFO:teuthology.orchestra.run.smithi008.stdout: { 2023-08-01T19:55:58.479 INFO:teuthology.orchestra.run.smithi008.stdout: "event": "all_read", 2023-08-01T19:55:58.479 INFO:teuthology.orchestra.run.smithi008.stdout: "time": "2023-08-01T19:55:58.400738+0000", 2023-08-01T19:55:58.479 INFO:teuthology.orchestra.run.smithi008.stdout: "duration": 4.206e-06 2023-08-01T19:55:58.479 INFO:teuthology.orchestra.run.smithi008.stdout: }, 2023-08-01T19:55:58.479 INFO:teuthology.orchestra.run.smithi008.stdout: { 2023-08-01T19:55:58.479 INFO:teuthology.orchestra.run.smithi008.stdout: "event": "dispatched", 2023-08-01T19:55:58.479 INFO:teuthology.orchestra.run.smithi008.stdout: "time": "2023-08-01T19:55:58.400746+0000", 2023-08-01T19:55:58.480 INFO:teuthology.orchestra.run.smithi008.stdout: "duration": 8.3450000000000006e-06 2023-08-01T19:55:58.480 INFO:teuthology.orchestra.run.smithi008.stdout: }, 2023-08-01T19:55:58.480 INFO:teuthology.orchestra.run.smithi008.stdout: { 2023-08-01T19:55:58.480 INFO:teuthology.orchestra.run.smithi008.stdout: "event": "queued_for_pg", 2023-08-01T19:55:58.480 INFO:teuthology.orchestra.run.smithi008.stdout: "time": "2023-08-01T19:55:58.400751+0000", 2023-08-01T19:55:58.480 INFO:teuthology.orchestra.run.smithi008.stdout: "duration": 4.2080000000000002e-06 2023-08-01T19:55:58.480 INFO:teuthology.orchestra.run.smithi008.stdout: }, 2023-08-01T19:55:58.481 INFO:teuthology.orchestra.run.smithi008.stdout: { 2023-08-01T19:55:58.481 INFO:teuthology.orchestra.run.smithi008.stdout: "event": "reached_pg", 2023-08-01T19:55:58.481 INFO:teuthology.orchestra.run.smithi008.stdout: "time": "2023-08-01T19:55:58.400784+0000", 2023-08-01T19:55:58.481 INFO:teuthology.orchestra.run.smithi008.stdout: "duration": 3.3090000000000003e-05 2023-08-01T19:55:58.481 INFO:teuthology.orchestra.run.smithi008.stdout: }, 2023-08-01T19:55:58.481 INFO:teuthology.orchestra.run.smithi008.stdout: { 2023-08-01T19:55:58.481 INFO:teuthology.orchestra.run.smithi008.stdout: "event": "started", 2023-08-01T19:55:58.481 INFO:teuthology.orchestra.run.smithi008.stdout: "time": "2023-08-01T19:55:58.400800+0000", 2023-08-01T19:55:58.482 INFO:teuthology.orchestra.run.smithi008.stdout: "duration": 1.6277999999999999e-05 2023-08-01T19:55:58.482 INFO:teuthology.orchestra.run.smithi008.stdout: } 2023-08-01T19:55:58.482 INFO:teuthology.orchestra.run.smithi008.stdout: ] 2023-08-01T19:55:58.482 INFO:teuthology.orchestra.run.smithi008.stdout: } 2023-08-01T19:55:58.482 INFO:teuthology.orchestra.run.smithi008.stdout: }, 2023-08-01T19:55:58.482 INFO:teuthology.orchestra.run.smithi008.stdout: { 2023-08-01T19:55:58.482 INFO:teuthology.orchestra.run.smithi008.stdout: "description": "osd_repop(client.4668.0:197080 5.b e61/19 5:d19d0b52:::benchmark_data_smithi006_114134_object63419:head v 61'12223, mlcod=61'12221)", 2023-08-01T19:55:58.482 INFO:teuthology.orchestra.run.smithi008.stdout: "initiated_at": "2023-08-01T19:55:58.401944+0000", 2023-08-01T19:55:58.483 INFO:teuthology.orchestra.run.smithi008.stdout: "age": 0.001548705, 2023-08-01T19:55:58.483 INFO:teuthology.orchestra.run.smithi008.stdout: "duration": 0.0021735629999999999, 2023-08-01T19:55:58.483 INFO:teuthology.orchestra.run.smithi008.stdout: "type_data": { 2023-08-01T19:55:58.483 INFO:teuthology.orchestra.run.smithi008.stdout: "flag_point": "started", 2023-08-01T19:55:58.483 INFO:teuthology.orchestra.run.smithi008.stdout: "events": [ 2023-08-01T19:55:58.483 INFO:teuthology.orchestra.run.smithi008.stdout: { 2023-08-01T19:55:58.483 INFO:teuthology.orchestra.run.smithi008.stdout: "event": "initiated", 2023-08-01T19:55:58.483 INFO:teuthology.orchestra.run.smithi008.stdout: "time": "2023-08-01T19:55:58.401944+0000", 2023-08-01T19:55:58.484 INFO:teuthology.orchestra.run.smithi008.stdout: "duration": 0 2023-08-01T19:55:58.484 INFO:teuthology.orchestra.run.smithi008.stdout: }, 2023-08-01T19:55:58.484 INFO:teuthology.orchestra.run.smithi008.stdout: { 2023-08-01T19:55:58.484 INFO:teuthology.orchestra.run.smithi008.stdout: "event": "throttled", 2023-08-01T19:55:58.484 INFO:teuthology.orchestra.run.smithi008.stdout: "time": "2023-08-01T19:55:58.401944+0000", 2023-08-01T19:55:58.484 INFO:teuthology.orchestra.run.smithi008.stdout: "duration": 0 2023-08-01T19:55:58.484 INFO:teuthology.orchestra.run.smithi008.stdout: }, 2023-08-01T19:55:58.484 INFO:teuthology.orchestra.run.smithi008.stdout: { 2023-08-01T19:55:58.485 INFO:teuthology.orchestra.run.smithi008.stdout: "event": "header_read", 2023-08-01T19:55:58.485 INFO:teuthology.orchestra.run.smithi008.stdout: "time": "2023-08-01T19:55:58.401944+0000", 2023-08-01T19:55:58.485 INFO:teuthology.orchestra.run.smithi008.stdout: "duration": 4294967295.9999995 2023-08-01T19:55:58.485 INFO:teuthology.orchestra.run.smithi008.stdout: }, 2023-08-01T19:55:58.485 INFO:teuthology.orchestra.run.smithi008.stdout: { 2023-08-01T19:55:58.485 INFO:teuthology.orchestra.run.smithi008.stdout: "event": "all_read", 2023-08-01T19:55:58.485 INFO:teuthology.orchestra.run.smithi008.stdout: "time": "2023-08-01T19:55:58.401948+0000", 2023-08-01T19:55:58.485 INFO:teuthology.orchestra.run.smithi008.stdout: "duration": 4.8110000000000002e-06 2023-08-01T19:55:58.486 INFO:teuthology.orchestra.run.smithi008.stdout: }, 2023-08-01T19:55:58.486 INFO:teuthology.orchestra.run.smithi008.stdout: { 2023-08-01T19:55:58.486 INFO:teuthology.orchestra.run.smithi008.stdout: "event": "dispatched", 2023-08-01T19:55:58.486 INFO:teuthology.orchestra.run.smithi008.stdout: "time": "2023-08-01T19:55:58.401957+0000", 2023-08-01T19:55:58.486 INFO:teuthology.orchestra.run.smithi008.stdout: "duration": 8.4780000000000008e-06 2023-08-01T19:55:58.486 INFO:teuthology.orchestra.run.smithi008.stdout: }, 2023-08-01T19:55:58.486 INFO:teuthology.orchestra.run.smithi008.stdout: { 2023-08-01T19:55:58.487 INFO:teuthology.orchestra.run.smithi008.stdout: "event": "queued_for_pg", 2023-08-01T19:55:58.487 INFO:teuthology.orchestra.run.smithi008.stdout: "time": "2023-08-01T19:55:58.401961+0000", 2023-08-01T19:55:58.487 INFO:teuthology.orchestra.run.smithi008.stdout: "duration": 4.0899999999999998e-06 2023-08-01T19:55:58.487 INFO:teuthology.orchestra.run.smithi008.stdout: }, 2023-08-01T19:55:58.487 INFO:teuthology.orchestra.run.smithi008.stdout: { 2023-08-01T19:55:58.487 INFO:teuthology.orchestra.run.smithi008.stdout: "event": "reached_pg", 2023-08-01T19:55:58.487 INFO:teuthology.orchestra.run.smithi008.stdout: "time": "2023-08-01T19:55:58.401996+0000", 2023-08-01T19:55:58.487 INFO:teuthology.orchestra.run.smithi008.stdout: "duration": 3.5008000000000001e-05 2023-08-01T19:55:58.488 INFO:teuthology.orchestra.run.smithi008.stdout: }, 2023-08-01T19:55:58.488 INFO:teuthology.orchestra.run.smithi008.stdout: { 2023-08-01T19:55:58.488 INFO:teuthology.orchestra.run.smithi008.stdout: "event": "started", 2023-08-01T19:55:58.488 INFO:teuthology.orchestra.run.smithi008.stdout: "time": "2023-08-01T19:55:58.402014+0000", 2023-08-01T19:55:58.488 INFO:teuthology.orchestra.run.smithi008.stdout: "duration": 1.7822e-05 2023-08-01T19:55:58.488 INFO:teuthology.orchestra.run.smithi008.stdout: } 2023-08-01T19:55:58.488 INFO:teuthology.orchestra.run.smithi008.stdout: ] 2023-08-01T19:55:58.488 INFO:teuthology.orchestra.run.smithi008.stdout: } 2023-08-01T19:55:58.489 INFO:teuthology.orchestra.run.smithi008.stdout: }, 2023-08-01T19:55:58.489 INFO:teuthology.orchestra.run.smithi008.stdout: { 2023-08-01T19:55:58.489 INFO:teuthology.orchestra.run.smithi008.stdout: "description": "osd_repop(client.4668.0:197081 5.4 e61/19 5:2c38872b:::benchmark_data_smithi006_114134_object63420:head v 61'12128, mlcod=61'12126)", 2023-08-01T19:55:58.489 INFO:teuthology.orchestra.run.smithi008.stdout: "initiated_at": "2023-08-01T19:55:58.402359+0000", 2023-08-01T19:55:58.489 INFO:teuthology.orchestra.run.smithi008.stdout: "age": 0.0011337949999999999, 2023-08-01T19:55:58.489 INFO:teuthology.orchestra.run.smithi008.stdout: "duration": 0.001792912, 2023-08-01T19:55:58.489 INFO:teuthology.orchestra.run.smithi008.stdout: "type_data": { 2023-08-01T19:55:58.489 INFO:teuthology.orchestra.run.smithi008.stdout: "flag_point": "started", 2023-08-01T19:55:58.490 INFO:teuthology.orchestra.run.smithi008.stdout: "events": [ 2023-08-01T19:55:58.490 INFO:teuthology.orchestra.run.smithi008.stdout: { 2023-08-01T19:55:58.490 INFO:teuthology.orchestra.run.smithi008.stdout: "event": "initiated", 2023-08-01T19:55:58.490 INFO:teuthology.orchestra.run.smithi008.stdout: "time": "2023-08-01T19:55:58.402359+0000", 2023-08-01T19:55:58.490 INFO:teuthology.orchestra.run.smithi008.stdout: "duration": 0 2023-08-01T19:55:58.490 INFO:teuthology.orchestra.run.smithi008.stdout: }, 2023-08-01T19:55:58.490 INFO:teuthology.orchestra.run.smithi008.stdout: { 2023-08-01T19:55:58.491 INFO:teuthology.orchestra.run.smithi008.stdout: "event": "throttled", 2023-08-01T19:55:58.491 INFO:teuthology.orchestra.run.smithi008.stdout: "time": "2023-08-01T19:55:58.402359+0000", 2023-08-01T19:55:58.491 INFO:teuthology.orchestra.run.smithi008.stdout: "duration": 0 2023-08-01T19:55:58.491 INFO:teuthology.orchestra.run.smithi008.stdout: }, 2023-08-01T19:55:58.491 INFO:teuthology.orchestra.run.smithi008.stdout: { 2023-08-01T19:55:58.491 INFO:teuthology.orchestra.run.smithi008.stdout: "event": "header_read", 2023-08-01T19:55:58.491 INFO:teuthology.orchestra.run.smithi008.stdout: "time": "2023-08-01T19:55:58.402358+0000", 2023-08-01T19:55:58.491 INFO:teuthology.orchestra.run.smithi008.stdout: "duration": 4294967295.9999995 2023-08-01T19:55:58.492 INFO:teuthology.orchestra.run.smithi008.stdout: }, 2023-08-01T19:55:58.492 INFO:teuthology.orchestra.run.smithi008.stdout: { 2023-08-01T19:55:58.492 INFO:teuthology.orchestra.run.smithi008.stdout: "event": "all_read", 2023-08-01T19:55:58.492 INFO:teuthology.orchestra.run.smithi008.stdout: "time": "2023-08-01T19:55:58.402364+0000", 2023-08-01T19:55:58.492 INFO:teuthology.orchestra.run.smithi008.stdout: "duration": 5.4870000000000002e-06 2023-08-01T19:55:58.492 INFO:teuthology.orchestra.run.smithi008.stdout: }, 2023-08-01T19:55:58.492 INFO:teuthology.orchestra.run.smithi008.stdout: { 2023-08-01T19:55:58.492 INFO:teuthology.orchestra.run.smithi008.stdout: "event": "dispatched", 2023-08-01T19:55:58.493 INFO:teuthology.orchestra.run.smithi008.stdout: "time": "2023-08-01T19:55:58.402372+0000", 2023-08-01T19:55:58.493 INFO:teuthology.orchestra.run.smithi008.stdout: "duration": 8.0050000000000004e-06 2023-08-01T19:55:58.493 INFO:teuthology.orchestra.run.smithi008.stdout: }, 2023-08-01T19:55:58.493 INFO:teuthology.orchestra.run.smithi008.stdout: { 2023-08-01T19:55:58.493 INFO:teuthology.orchestra.run.smithi008.stdout: "event": "queued_for_pg", 2023-08-01T19:55:58.493 INFO:teuthology.orchestra.run.smithi008.stdout: "time": "2023-08-01T19:55:58.402375+0000", 2023-08-01T19:55:58.493 INFO:teuthology.orchestra.run.smithi008.stdout: "duration": 3.5130000000000001e-06 2023-08-01T19:55:58.493 INFO:teuthology.orchestra.run.smithi008.stdout: }, 2023-08-01T19:55:58.494 INFO:teuthology.orchestra.run.smithi008.stdout: { 2023-08-01T19:55:58.494 INFO:teuthology.orchestra.run.smithi008.stdout: "event": "reached_pg", 2023-08-01T19:55:58.494 INFO:teuthology.orchestra.run.smithi008.stdout: "time": "2023-08-01T19:55:58.402609+0000", 2023-08-01T19:55:58.494 INFO:teuthology.orchestra.run.smithi008.stdout: "duration": 0.000233303 2023-08-01T19:55:58.494 INFO:teuthology.orchestra.run.smithi008.stdout: }, 2023-08-01T19:55:58.494 INFO:teuthology.orchestra.run.smithi008.stdout: { 2023-08-01T19:55:58.494 INFO:teuthology.orchestra.run.smithi008.stdout: "event": "started", 2023-08-01T19:55:58.494 INFO:teuthology.orchestra.run.smithi008.stdout: "time": "2023-08-01T19:55:58.402627+0000", 2023-08-01T19:55:58.495 INFO:teuthology.orchestra.run.smithi008.stdout: "duration": 1.7927e-05 2023-08-01T19:55:58.495 INFO:teuthology.orchestra.run.smithi008.stdout: } 2023-08-01T19:55:58.495 INFO:teuthology.orchestra.run.smithi008.stdout: ] 2023-08-01T19:55:58.495 INFO:teuthology.orchestra.run.smithi008.stdout: } 2023-08-01T19:55:58.495 INFO:teuthology.orchestra.run.smithi008.stdout: }, 2023-08-01T19:55:58.495 INFO:teuthology.orchestra.run.smithi008.stdout: { 2023-08-01T19:55:58.495 INFO:teuthology.orchestra.run.smithi008.stdout: "description": "osd_repop(client.4668.0:197079 5.7 e61/19 5:ecce2f19:::benchmark_data_smithi006_114134_object63418:head v 61'12318, mlcod=61'12313)", 2023-08-01T19:55:58.495 INFO:teuthology.orchestra.run.smithi008.stdout: "initiated_at": "2023-08-01T19:55:58.402751+0000", 2023-08-01T19:55:58.496 INFO:teuthology.orchestra.run.smithi008.stdout: "age": 0.00074222199999999996, 2023-08-01T19:55:58.496 INFO:teuthology.orchestra.run.smithi008.stdout: "duration": 0.001436276, 2023-08-01T19:55:58.496 INFO:teuthology.orchestra.run.smithi008.stdout: "type_data": { 2023-08-01T19:55:58.496 INFO:teuthology.orchestra.run.smithi008.stdout: "flag_point": "started", 2023-08-01T19:55:58.496 INFO:teuthology.orchestra.run.smithi008.stdout: "events": [ 2023-08-01T19:55:58.496 INFO:teuthology.orchestra.run.smithi008.stdout: { 2023-08-01T19:55:58.496 INFO:teuthology.orchestra.run.smithi008.stdout: "event": "initiated", 2023-08-01T19:55:58.497 INFO:teuthology.orchestra.run.smithi008.stdout: "time": "2023-08-01T19:55:58.402751+0000", 2023-08-01T19:55:58.497 INFO:teuthology.orchestra.run.smithi008.stdout: "duration": 0 2023-08-01T19:55:58.497 INFO:teuthology.orchestra.run.smithi008.stdout: }, 2023-08-01T19:55:58.497 INFO:teuthology.orchestra.run.smithi008.stdout: { 2023-08-01T19:55:58.497 INFO:teuthology.orchestra.run.smithi008.stdout: "event": "throttled", 2023-08-01T19:55:58.497 INFO:teuthology.orchestra.run.smithi008.stdout: "time": "2023-08-01T19:55:58.402751+0000", 2023-08-01T19:55:58.497 INFO:teuthology.orchestra.run.smithi008.stdout: "duration": 0 2023-08-01T19:55:58.497 INFO:teuthology.orchestra.run.smithi008.stdout: }, 2023-08-01T19:55:58.498 INFO:teuthology.orchestra.run.smithi008.stdout: { 2023-08-01T19:55:58.498 INFO:teuthology.orchestra.run.smithi008.stdout: "event": "header_read", 2023-08-01T19:55:58.498 INFO:teuthology.orchestra.run.smithi008.stdout: "time": "2023-08-01T19:55:58.402750+0000", 2023-08-01T19:55:58.498 INFO:teuthology.orchestra.run.smithi008.stdout: "duration": 4294967295.9999995 2023-08-01T19:55:58.498 INFO:teuthology.orchestra.run.smithi008.stdout: }, 2023-08-01T19:55:58.498 INFO:teuthology.orchestra.run.smithi008.stdout: { 2023-08-01T19:55:58.498 INFO:teuthology.orchestra.run.smithi008.stdout: "event": "all_read", 2023-08-01T19:55:58.498 INFO:teuthology.orchestra.run.smithi008.stdout: "time": "2023-08-01T19:55:58.402755+0000", 2023-08-01T19:55:58.499 INFO:teuthology.orchestra.run.smithi008.stdout: "duration": 4.6450000000000004e-06 2023-08-01T19:55:58.499 INFO:teuthology.orchestra.run.smithi008.stdout: }, 2023-08-01T19:55:58.499 INFO:teuthology.orchestra.run.smithi008.stdout: { 2023-08-01T19:55:58.499 INFO:teuthology.orchestra.run.smithi008.stdout: "event": "dispatched", 2023-08-01T19:55:58.499 INFO:teuthology.orchestra.run.smithi008.stdout: "time": "2023-08-01T19:55:58.402762+0000", 2023-08-01T19:55:58.499 INFO:teuthology.orchestra.run.smithi008.stdout: "duration": 7.5610000000000001e-06 2023-08-01T19:55:58.499 INFO:teuthology.orchestra.run.smithi008.stdout: }, 2023-08-01T19:55:58.499 INFO:teuthology.orchestra.run.smithi008.stdout: { 2023-08-01T19:55:58.500 INFO:teuthology.orchestra.run.smithi008.stdout: "event": "queued_for_pg", 2023-08-01T19:55:58.500 INFO:teuthology.orchestra.run.smithi008.stdout: "time": "2023-08-01T19:55:58.402765+0000", 2023-08-01T19:55:58.500 INFO:teuthology.orchestra.run.smithi008.stdout: "duration": 3.225e-06 2023-08-01T19:55:58.500 INFO:teuthology.orchestra.run.smithi008.stdout: }, 2023-08-01T19:55:58.500 INFO:teuthology.orchestra.run.smithi008.stdout: { 2023-08-01T19:55:58.500 INFO:teuthology.orchestra.run.smithi008.stdout: "event": "reached_pg", 2023-08-01T19:55:58.500 INFO:teuthology.orchestra.run.smithi008.stdout: "time": "2023-08-01T19:55:58.402794+0000", 2023-08-01T19:55:58.500 INFO:teuthology.orchestra.run.smithi008.stdout: "duration": 2.8909999999999999e-05 2023-08-01T19:55:58.501 INFO:teuthology.orchestra.run.smithi008.stdout: }, 2023-08-01T19:55:58.501 INFO:teuthology.orchestra.run.smithi008.stdout: { 2023-08-01T19:55:58.501 INFO:teuthology.orchestra.run.smithi008.stdout: "event": "started", 2023-08-01T19:55:58.501 INFO:teuthology.orchestra.run.smithi008.stdout: "time": "2023-08-01T19:55:58.402806+0000", 2023-08-01T19:55:58.501 INFO:teuthology.orchestra.run.smithi008.stdout: "duration": 1.1153e-05 2023-08-01T19:55:58.501 INFO:teuthology.orchestra.run.smithi008.stdout: } 2023-08-01T19:55:58.501 INFO:teuthology.orchestra.run.smithi008.stdout: ] 2023-08-01T19:55:58.501 INFO:teuthology.orchestra.run.smithi008.stdout: } 2023-08-01T19:55:58.502 INFO:teuthology.orchestra.run.smithi008.stdout: } 2023-08-01T19:55:58.502 INFO:teuthology.orchestra.run.smithi008.stdout: ], 2023-08-01T19:55:58.502 INFO:teuthology.orchestra.run.smithi008.stdout: "num_ops": 13 2023-08-01T19:55:58.502 INFO:teuthology.orchestra.run.smithi008.stdout:} 2023-08-01T19:55:58.503 INFO:tasks.ceph.osd.2.smithi155.stderr:2023-08-01T19:55:58.501+0000 7faa5c6ac700 -1 received signal: Hangup from /usr/bin/python3 /bin/daemon-helper kill ceph-osd -f --cluster ceph -i 2 (PID: 111337) UID: 0 2023-08-01T19:55:58.504 DEBUG:teuthology.orchestra.run.smithi008:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 30 ceph --cluster ceph --admin-daemon /var/run/ceph/ceph-osd.0.asok dump_blocked_ops 2023-08-01T19:55:58.603 INFO:tasks.ceph.osd.0.smithi008.stderr:2023-08-01T19:55:58.602+0000 7f16a58f4700 -1 received signal: Hangup from /usr/bin/python3 /bin/daemon-helper kill ceph-osd -f --cluster ceph -i 0 (PID: 111179) UID: 0 2023-08-01T19:55:58.683 INFO:teuthology.orchestra.run.smithi008.stdout:{ 2023-08-01T19:55:58.684 INFO:teuthology.orchestra.run.smithi008.stdout: "ops": [], 2023-08-01T19:55:58.684 INFO:teuthology.orchestra.run.smithi008.stdout: "complaint_time": 30, 2023-08-01T19:55:58.684 INFO:teuthology.orchestra.run.smithi008.stdout: "num_blocked_ops": 0 2023-08-01T19:55:58.684 INFO:teuthology.orchestra.run.smithi008.stdout:} 2023-08-01T19:55:58.693 DEBUG:teuthology.orchestra.run.smithi008:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 30 ceph --cluster ceph --admin-daemon /var/run/ceph/ceph-osd.0.asok dump_historic_ops 2023-08-01T19:55:58.705 INFO:tasks.ceph.osd.2.smithi155.stderr:2023-08-01T19:55:58.704+0000 7faa5c6ac700 -1 received signal: Hangup from /usr/bin/python3 /bin/daemon-helper kill ceph-osd -f --cluster ceph -i 2 (PID: 111337) UID: 0 2023-08-01T19:55:58.806 INFO:tasks.ceph.osd.2.smithi155.stderr:2023-08-01T19:55:58.805+0000 7faa5c6ac700 -1 received signal: Hangup from /usr/bin/python3 /bin/daemon-helper kill ceph-osd -f --cluster ceph -i 2 (PID: 111337) UID: 0 2023-08-01T19:55:58.863 INFO:teuthology.orchestra.run.smithi008.stdout:{ 2023-08-01T19:55:58.863 INFO:teuthology.orchestra.run.smithi008.stdout: "size": 20, 2023-08-01T19:55:58.864 INFO:teuthology.orchestra.run.smithi008.stdout: "duration": 600, 2023-08-01T19:55:58.864 INFO:teuthology.orchestra.run.smithi008.stdout: "ops": [ 2023-08-01T19:55:58.864 INFO:teuthology.orchestra.run.smithi008.stdout: { 2023-08-01T19:55:58.864 INFO:teuthology.orchestra.run.smithi008.stdout: "description": "osd_op(client.4668.0:100240 5.a 5:5313c5b9:::benchmark_data_smithi006_114134_object100239:head [set-alloc-hint object_size 65536 write_size 65536,write 0~65536] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e37)", 2023-08-01T19:55:58.864 INFO:teuthology.orchestra.run.smithi008.stdout: "initiated_at": "2023-08-01T19:55:05.148399+0000", 2023-08-01T19:55:58.864 INFO:teuthology.orchestra.run.smithi008.stdout: "age": 53.712688733999997, 2023-08-01T19:55:58.865 INFO:teuthology.orchestra.run.smithi008.stdout: "duration": 0.077278904999999995, 2023-08-01T19:55:58.865 INFO:teuthology.orchestra.run.smithi008.stdout: "type_data": { 2023-08-01T19:55:58.865 INFO:teuthology.orchestra.run.smithi008.stdout: "flag_point": "commit sent; apply or cleanup", 2023-08-01T19:55:58.865 INFO:teuthology.orchestra.run.smithi008.stdout: "client_info": { 2023-08-01T19:55:58.865 INFO:teuthology.orchestra.run.smithi008.stdout: "client": "client.4668", 2023-08-01T19:55:58.865 INFO:teuthology.orchestra.run.smithi008.stdout: "client_addr": "172.21.15.6:0/1709472247", 2023-08-01T19:55:58.865 INFO:teuthology.orchestra.run.smithi008.stdout: "tid": 100240 2023-08-01T19:55:58.865 INFO:teuthology.orchestra.run.smithi008.stdout: }, 2023-08-01T19:55:58.866 INFO:teuthology.orchestra.run.smithi008.stdout: "events": [ 2023-08-01T19:55:58.866 INFO:teuthology.orchestra.run.smithi008.stdout: { 2023-08-01T19:55:58.866 INFO:teuthology.orchestra.run.smithi008.stdout: "event": "initiated", 2023-08-01T19:55:58.866 INFO:teuthology.orchestra.run.smithi008.stdout: "time": "2023-08-01T19:55:05.148399+0000", 2023-08-01T19:55:58.866 INFO:teuthology.orchestra.run.smithi008.stdout: "duration": 0 2023-08-01T19:55:58.866 INFO:teuthology.orchestra.run.smithi008.stdout: }, 2023-08-01T19:55:58.866 INFO:teuthology.orchestra.run.smithi008.stdout: { 2023-08-01T19:55:58.866 INFO:teuthology.orchestra.run.smithi008.stdout: "event": "throttled", 2023-08-01T19:55:58.867 INFO:teuthology.orchestra.run.smithi008.stdout: "time": "2023-08-01T19:55:05.148399+0000", 2023-08-01T19:55:58.867 INFO:teuthology.orchestra.run.smithi008.stdout: "duration": 0 2023-08-01T19:55:58.867 INFO:teuthology.orchestra.run.smithi008.stdout: }, 2023-08-01T19:55:58.867 INFO:teuthology.orchestra.run.smithi008.stdout: { 2023-08-01T19:55:58.867 INFO:teuthology.orchestra.run.smithi008.stdout: "event": "header_read", 2023-08-01T19:55:58.867 INFO:teuthology.orchestra.run.smithi008.stdout: "time": "2023-08-01T19:55:05.148398+0000", 2023-08-01T19:55:58.867 INFO:teuthology.orchestra.run.smithi008.stdout: "duration": 4294967295.999999 2023-08-01T19:55:58.868 INFO:teuthology.orchestra.run.smithi008.stdout: }, 2023-08-01T19:55:58.868 INFO:teuthology.orchestra.run.smithi008.stdout: { 2023-08-01T19:55:58.868 INFO:teuthology.orchestra.run.smithi008.stdout: "event": "all_read", 2023-08-01T19:55:58.868 INFO:teuthology.orchestra.run.smithi008.stdout: "time": "2023-08-01T19:55:05.148492+0000", 2023-08-01T19:55:58.868 INFO:teuthology.orchestra.run.smithi008.stdout: "duration": 9.3892000000000002e-05 2023-08-01T19:55:58.868 INFO:teuthology.orchestra.run.smithi008.stdout: }, 2023-08-01T19:55:58.868 INFO:teuthology.orchestra.run.smithi008.stdout: { 2023-08-01T19:55:58.868 INFO:teuthology.orchestra.run.smithi008.stdout: "event": "dispatched", 2023-08-01T19:55:58.869 INFO:teuthology.orchestra.run.smithi008.stdout: "time": "2023-08-01T19:55:05.148503+0000", 2023-08-01T19:55:58.869 INFO:teuthology.orchestra.run.smithi008.stdout: "duration": 1.0951000000000001e-05 2023-08-01T19:55:58.869 INFO:teuthology.orchestra.run.smithi008.stdout: }, 2023-08-01T19:55:58.869 INFO:teuthology.orchestra.run.smithi008.stdout: { 2023-08-01T19:55:58.869 INFO:teuthology.orchestra.run.smithi008.stdout: "event": "queued_for_pg", 2023-08-01T19:55:58.869 INFO:teuthology.orchestra.run.smithi008.stdout: "time": "2023-08-01T19:55:05.148508+0000", 2023-08-01T19:55:58.869 INFO:teuthology.orchestra.run.smithi008.stdout: "duration": 5.0080000000000002e-06 2023-08-01T19:55:58.870 INFO:teuthology.orchestra.run.smithi008.stdout: }, 2023-08-01T19:55:58.870 INFO:teuthology.orchestra.run.smithi008.stdout: { 2023-08-01T19:55:58.870 INFO:teuthology.orchestra.run.smithi008.stdout: "event": "reached_pg", 2023-08-01T19:55:58.870 INFO:teuthology.orchestra.run.smithi008.stdout: "time": "2023-08-01T19:55:05.148548+0000", 2023-08-01T19:55:58.870 INFO:teuthology.orchestra.run.smithi008.stdout: "duration": 4.0358999999999998e-05 2023-08-01T19:55:58.870 INFO:teuthology.orchestra.run.smithi008.stdout: }, 2023-08-01T19:55:58.870 INFO:teuthology.orchestra.run.smithi008.stdout: { 2023-08-01T19:55:58.870 INFO:teuthology.orchestra.run.smithi008.stdout: "event": "started", 2023-08-01T19:55:58.871 INFO:teuthology.orchestra.run.smithi008.stdout: "time": "2023-08-01T19:55:05.148666+0000", 2023-08-01T19:55:58.871 INFO:teuthology.orchestra.run.smithi008.stdout: "duration": 0.000117621 2023-08-01T19:55:58.871 INFO:teuthology.orchestra.run.smithi008.stdout: }, 2023-08-01T19:55:58.871 INFO:teuthology.orchestra.run.smithi008.stdout: { 2023-08-01T19:55:58.871 INFO:teuthology.orchestra.run.smithi008.stdout: "event": "waiting for subops from 2", 2023-08-01T19:55:58.871 INFO:teuthology.orchestra.run.smithi008.stdout: "time": "2023-08-01T19:55:05.148805+0000", 2023-08-01T19:55:58.871 INFO:teuthology.orchestra.run.smithi008.stdout: "duration": 0.000139176 2023-08-01T19:55:58.871 INFO:teuthology.orchestra.run.smithi008.stdout: }, 2023-08-01T19:55:58.872 INFO:teuthology.orchestra.run.smithi008.stdout: { 2023-08-01T19:55:58.872 INFO:teuthology.orchestra.run.smithi008.stdout: "event": "op_commit", 2023-08-01T19:55:58.872 INFO:teuthology.orchestra.run.smithi008.stdout: "time": "2023-08-01T19:55:05.156143+0000", 2023-08-01T19:55:58.872 INFO:teuthology.orchestra.run.smithi008.stdout: "duration": 0.007338041 2023-08-01T19:55:58.872 INFO:teuthology.orchestra.run.smithi008.stdout: }, 2023-08-01T19:55:58.872 INFO:teuthology.orchestra.run.smithi008.stdout: { 2023-08-01T19:55:58.872 INFO:teuthology.orchestra.run.smithi008.stdout: "event": "sub_op_commit_rec", 2023-08-01T19:55:58.873 INFO:teuthology.orchestra.run.smithi008.stdout: "time": "2023-08-01T19:55:05.225581+0000", 2023-08-01T19:55:58.873 INFO:teuthology.orchestra.run.smithi008.stdout: "duration": 0.069438402999999996 2023-08-01T19:55:58.873 INFO:teuthology.orchestra.run.smithi008.stdout: }, 2023-08-01T19:55:58.873 INFO:teuthology.orchestra.run.smithi008.stdout: { 2023-08-01T19:55:58.873 INFO:teuthology.orchestra.run.smithi008.stdout: "event": "commit_sent", 2023-08-01T19:55:58.873 INFO:teuthology.orchestra.run.smithi008.stdout: "time": "2023-08-01T19:55:05.225632+0000", 2023-08-01T19:55:58.873 INFO:teuthology.orchestra.run.smithi008.stdout: "duration": 5.0382e-05 2023-08-01T19:55:58.873 INFO:teuthology.orchestra.run.smithi008.stdout: }, 2023-08-01T19:55:58.874 INFO:teuthology.orchestra.run.smithi008.stdout: { 2023-08-01T19:55:58.874 INFO:teuthology.orchestra.run.smithi008.stdout: "event": "done", 2023-08-01T19:55:58.874 INFO:teuthology.orchestra.run.smithi008.stdout: "time": "2023-08-01T19:55:05.225677+0000", 2023-08-01T19:55:58.874 INFO:teuthology.orchestra.run.smithi008.stdout: "duration": 4.5893000000000003e-05 2023-08-01T19:55:58.874 INFO:teuthology.orchestra.run.smithi008.stdout: } 2023-08-01T19:55:58.874 INFO:teuthology.orchestra.run.smithi008.stdout: ] 2023-08-01T19:55:58.874 INFO:teuthology.orchestra.run.smithi008.stdout: } 2023-08-01T19:55:58.874 INFO:teuthology.orchestra.run.smithi008.stdout: }, 2023-08-01T19:55:58.875 INFO:teuthology.orchestra.run.smithi008.stdout: { 2023-08-01T19:55:58.875 INFO:teuthology.orchestra.run.smithi008.stdout: "description": "osd_op(client.4668.0:100243 5.a 5:5e8193b6:::benchmark_data_smithi006_114134_object100242:head [set-alloc-hint object_size 65536 write_size 65536,write 0~65536] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e37)", 2023-08-01T19:55:58.875 INFO:teuthology.orchestra.run.smithi008.stdout: "initiated_at": "2023-08-01T19:55:05.150737+0000", 2023-08-01T19:55:58.875 INFO:teuthology.orchestra.run.smithi008.stdout: "age": 53.710350278999996, 2023-08-01T19:55:58.875 INFO:teuthology.orchestra.run.smithi008.stdout: "duration": 0.075019885999999994, 2023-08-01T19:55:58.875 INFO:teuthology.orchestra.run.smithi008.stdout: "type_data": { 2023-08-01T19:55:58.875 INFO:teuthology.orchestra.run.smithi008.stdout: "flag_point": "commit sent; apply or cleanup", 2023-08-01T19:55:58.875 INFO:teuthology.orchestra.run.smithi008.stdout: "client_info": { 2023-08-01T19:55:58.876 INFO:teuthology.orchestra.run.smithi008.stdout: "client": "client.4668", 2023-08-01T19:55:58.876 INFO:teuthology.orchestra.run.smithi008.stdout: "client_addr": "172.21.15.6:0/1709472247", 2023-08-01T19:55:58.876 INFO:teuthology.orchestra.run.smithi008.stdout: "tid": 100243 2023-08-01T19:55:58.876 INFO:teuthology.orchestra.run.smithi008.stdout: }, 2023-08-01T19:55:58.876 INFO:teuthology.orchestra.run.smithi008.stdout: "events": [ 2023-08-01T19:55:58.876 INFO:teuthology.orchestra.run.smithi008.stdout: { 2023-08-01T19:55:58.876 INFO:teuthology.orchestra.run.smithi008.stdout: "event": "initiated", 2023-08-01T19:55:58.877 INFO:teuthology.orchestra.run.smithi008.stdout: "time": "2023-08-01T19:55:05.150737+0000", 2023-08-01T19:55:58.877 INFO:teuthology.orchestra.run.smithi008.stdout: "duration": 0 2023-08-01T19:55:58.877 INFO:teuthology.orchestra.run.smithi008.stdout: }, 2023-08-01T19:55:58.877 INFO:teuthology.orchestra.run.smithi008.stdout: { 2023-08-01T19:55:58.877 INFO:teuthology.orchestra.run.smithi008.stdout: "event": "throttled", 2023-08-01T19:55:58.877 INFO:teuthology.orchestra.run.smithi008.stdout: "time": "2023-08-01T19:55:05.150737+0000", 2023-08-01T19:55:58.877 INFO:teuthology.orchestra.run.smithi008.stdout: "duration": 0 2023-08-01T19:55:58.878 INFO:teuthology.orchestra.run.smithi008.stdout: }, 2023-08-01T19:55:58.878 INFO:teuthology.orchestra.run.smithi008.stdout: { 2023-08-01T19:55:58.878 INFO:teuthology.orchestra.run.smithi008.stdout: "event": "header_read", 2023-08-01T19:55:58.878 INFO:teuthology.orchestra.run.smithi008.stdout: "time": "2023-08-01T19:55:05.150736+0000", 2023-08-01T19:55:58.878 INFO:teuthology.orchestra.run.smithi008.stdout: "duration": 4294967295.999999 2023-08-01T19:55:58.878 INFO:teuthology.orchestra.run.smithi008.stdout: }, 2023-08-01T19:55:58.878 INFO:teuthology.orchestra.run.smithi008.stdout: { 2023-08-01T19:55:58.879 INFO:teuthology.orchestra.run.smithi008.stdout: "event": "all_read", 2023-08-01T19:55:58.879 INFO:teuthology.orchestra.run.smithi008.stdout: "time": "2023-08-01T19:55:05.150780+0000", 2023-08-01T19:55:58.879 INFO:teuthology.orchestra.run.smithi008.stdout: "duration": 4.3578999999999997e-05 2023-08-01T19:55:58.879 INFO:teuthology.orchestra.run.smithi008.stdout: }, 2023-08-01T19:55:58.879 INFO:teuthology.orchestra.run.smithi008.stdout: { 2023-08-01T19:55:58.879 INFO:teuthology.orchestra.run.smithi008.stdout: "event": "dispatched", 2023-08-01T19:55:58.879 INFO:teuthology.orchestra.run.smithi008.stdout: "time": "2023-08-01T19:55:05.150791+0000", 2023-08-01T19:55:58.879 INFO:teuthology.orchestra.run.smithi008.stdout: "duration": 1.0963e-05 2023-08-01T19:55:58.880 INFO:teuthology.orchestra.run.smithi008.stdout: }, 2023-08-01T19:55:58.880 INFO:teuthology.orchestra.run.smithi008.stdout: { 2023-08-01T19:55:58.880 INFO:teuthology.orchestra.run.smithi008.stdout: "event": "queued_for_pg", 2023-08-01T19:55:58.880 INFO:teuthology.orchestra.run.smithi008.stdout: "time": "2023-08-01T19:55:05.150797+0000", 2023-08-01T19:55:58.880 INFO:teuthology.orchestra.run.smithi008.stdout: "duration": 5.9780000000000002e-06 2023-08-01T19:55:58.880 INFO:teuthology.orchestra.run.smithi008.stdout: }, 2023-08-01T19:55:58.880 INFO:teuthology.orchestra.run.smithi008.stdout: { 2023-08-01T19:55:58.880 INFO:teuthology.orchestra.run.smithi008.stdout: "event": "reached_pg", 2023-08-01T19:55:58.881 INFO:teuthology.orchestra.run.smithi008.stdout: "time": "2023-08-01T19:55:05.150833+0000", 2023-08-01T19:55:58.881 INFO:teuthology.orchestra.run.smithi008.stdout: "duration": 3.6000000000000001e-05 2023-08-01T19:55:58.881 INFO:teuthology.orchestra.run.smithi008.stdout: }, 2023-08-01T19:55:58.881 INFO:teuthology.orchestra.run.smithi008.stdout: { 2023-08-01T19:55:58.881 INFO:teuthology.orchestra.run.smithi008.stdout: "event": "started", 2023-08-01T19:55:58.881 INFO:teuthology.orchestra.run.smithi008.stdout: "time": "2023-08-01T19:55:05.150951+0000", 2023-08-01T19:55:58.881 INFO:teuthology.orchestra.run.smithi008.stdout: "duration": 0.00011827799999999999 2023-08-01T19:55:58.882 INFO:teuthology.orchestra.run.smithi008.stdout: }, 2023-08-01T19:55:58.882 INFO:teuthology.orchestra.run.smithi008.stdout: { 2023-08-01T19:55:58.882 INFO:teuthology.orchestra.run.smithi008.stdout: "event": "waiting for subops from 2", 2023-08-01T19:55:58.882 INFO:teuthology.orchestra.run.smithi008.stdout: "time": "2023-08-01T19:55:05.151111+0000", 2023-08-01T19:55:58.882 INFO:teuthology.orchestra.run.smithi008.stdout: "duration": 0.00015961299999999999 2023-08-01T19:55:58.882 INFO:teuthology.orchestra.run.smithi008.stdout: }, 2023-08-01T19:55:58.882 INFO:teuthology.orchestra.run.smithi008.stdout: { 2023-08-01T19:55:58.883 INFO:teuthology.orchestra.run.smithi008.stdout: "event": "op_commit", 2023-08-01T19:55:58.883 INFO:teuthology.orchestra.run.smithi008.stdout: "time": "2023-08-01T19:55:05.156247+0000", 2023-08-01T19:55:58.883 INFO:teuthology.orchestra.run.smithi008.stdout: "duration": 0.005136524 2023-08-01T19:55:58.883 INFO:teuthology.orchestra.run.smithi008.stdout: }, 2023-08-01T19:55:58.883 INFO:teuthology.orchestra.run.smithi008.stdout: { 2023-08-01T19:55:58.883 INFO:teuthology.orchestra.run.smithi008.stdout: "event": "sub_op_commit_rec", 2023-08-01T19:55:58.883 INFO:teuthology.orchestra.run.smithi008.stdout: "time": "2023-08-01T19:55:05.225705+0000", 2023-08-01T19:55:58.883 INFO:teuthology.orchestra.run.smithi008.stdout: "duration": 0.069458377000000002 2023-08-01T19:55:58.884 INFO:teuthology.orchestra.run.smithi008.stdout: }, 2023-08-01T19:55:58.884 INFO:teuthology.orchestra.run.smithi008.stdout: { 2023-08-01T19:55:58.884 INFO:teuthology.orchestra.run.smithi008.stdout: "event": "commit_sent", 2023-08-01T19:55:58.884 INFO:teuthology.orchestra.run.smithi008.stdout: "time": "2023-08-01T19:55:05.225736+0000", 2023-08-01T19:55:58.884 INFO:teuthology.orchestra.run.smithi008.stdout: "duration": 3.0388000000000001e-05 2023-08-01T19:55:58.884 INFO:teuthology.orchestra.run.smithi008.stdout: }, 2023-08-01T19:55:58.884 INFO:teuthology.orchestra.run.smithi008.stdout: { 2023-08-01T19:55:58.885 INFO:teuthology.orchestra.run.smithi008.stdout: "event": "done", 2023-08-01T19:55:58.885 INFO:teuthology.orchestra.run.smithi008.stdout: "time": "2023-08-01T19:55:05.225757+0000", 2023-08-01T19:55:58.885 INFO:teuthology.orchestra.run.smithi008.stdout: "duration": 2.1090999999999998e-05 2023-08-01T19:55:58.885 INFO:teuthology.orchestra.run.smithi008.stdout: } 2023-08-01T19:55:58.885 INFO:teuthology.orchestra.run.smithi008.stdout: ] 2023-08-01T19:55:58.885 INFO:teuthology.orchestra.run.smithi008.stdout: } 2023-08-01T19:55:58.885 INFO:teuthology.orchestra.run.smithi008.stdout: }, 2023-08-01T19:55:58.885 INFO:teuthology.orchestra.run.smithi008.stdout: { 2023-08-01T19:55:58.886 INFO:teuthology.orchestra.run.smithi008.stdout: "description": "osd_op(client.4668.0:100261 5.a 5:562deedb:::benchmark_data_smithi006_114134_object100260:head [set-alloc-hint object_size 65536 write_size 65536,write 0~65536] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e37)", 2023-08-01T19:55:58.886 INFO:teuthology.orchestra.run.smithi008.stdout: "initiated_at": "2023-08-01T19:55:05.163316+0000", 2023-08-01T19:55:58.886 INFO:teuthology.orchestra.run.smithi008.stdout: "age": 53.697770863000002, 2023-08-01T19:55:58.886 INFO:teuthology.orchestra.run.smithi008.stdout: "duration": 0.063073012999999997, 2023-08-01T19:55:58.886 INFO:teuthology.orchestra.run.smithi008.stdout: "type_data": { 2023-08-01T19:55:58.886 INFO:teuthology.orchestra.run.smithi008.stdout: "flag_point": "commit sent; apply or cleanup", 2023-08-01T19:55:58.886 INFO:teuthology.orchestra.run.smithi008.stdout: "client_info": { 2023-08-01T19:55:58.886 INFO:teuthology.orchestra.run.smithi008.stdout: "client": "client.4668", 2023-08-01T19:55:58.887 INFO:teuthology.orchestra.run.smithi008.stdout: "client_addr": "172.21.15.6:0/1709472247", 2023-08-01T19:55:58.887 INFO:teuthology.orchestra.run.smithi008.stdout: "tid": 100261 2023-08-01T19:55:58.887 INFO:teuthology.orchestra.run.smithi008.stdout: }, 2023-08-01T19:55:58.887 INFO:teuthology.orchestra.run.smithi008.stdout: "events": [ 2023-08-01T19:55:58.887 INFO:teuthology.orchestra.run.smithi008.stdout: { 2023-08-01T19:55:58.887 INFO:teuthology.orchestra.run.smithi008.stdout: "event": "initiated", 2023-08-01T19:55:58.888 INFO:teuthology.orchestra.run.smithi008.stdout: "time": "2023-08-01T19:55:05.163316+0000", 2023-08-01T19:55:58.888 INFO:teuthology.orchestra.run.smithi008.stdout: "duration": 0 2023-08-01T19:55:58.888 INFO:teuthology.orchestra.run.smithi008.stdout: }, 2023-08-01T19:55:58.888 INFO:teuthology.orchestra.run.smithi008.stdout: { 2023-08-01T19:55:58.888 INFO:teuthology.orchestra.run.smithi008.stdout: "event": "throttled", 2023-08-01T19:55:58.888 INFO:teuthology.orchestra.run.smithi008.stdout: "time": "2023-08-01T19:55:05.163316+0000", 2023-08-01T19:55:58.888 INFO:teuthology.orchestra.run.smithi008.stdout: "duration": 0 2023-08-01T19:55:58.888 INFO:teuthology.orchestra.run.smithi008.stdout: }, 2023-08-01T19:55:58.889 INFO:teuthology.orchestra.run.smithi008.stdout: { 2023-08-01T19:55:58.889 INFO:teuthology.orchestra.run.smithi008.stdout: "event": "header_read", 2023-08-01T19:55:58.889 INFO:teuthology.orchestra.run.smithi008.stdout: "time": "2023-08-01T19:55:05.163316+0000", 2023-08-01T19:55:58.889 INFO:teuthology.orchestra.run.smithi008.stdout: "duration": 4294967295.999999 2023-08-01T19:55:58.889 INFO:teuthology.orchestra.run.smithi008.stdout: }, 2023-08-01T19:55:58.889 INFO:teuthology.orchestra.run.smithi008.stdout: { 2023-08-01T19:55:58.889 INFO:teuthology.orchestra.run.smithi008.stdout: "event": "all_read", 2023-08-01T19:55:58.890 INFO:teuthology.orchestra.run.smithi008.stdout: "time": "2023-08-01T19:55:05.163380+0000", 2023-08-01T19:55:58.890 INFO:teuthology.orchestra.run.smithi008.stdout: "duration": 6.4395999999999998e-05 2023-08-01T19:55:58.890 INFO:teuthology.orchestra.run.smithi008.stdout: }, 2023-08-01T19:55:58.890 INFO:teuthology.orchestra.run.smithi008.stdout: { 2023-08-01T19:55:58.890 INFO:teuthology.orchestra.run.smithi008.stdout: "event": "dispatched", 2023-08-01T19:55:58.890 INFO:teuthology.orchestra.run.smithi008.stdout: "time": "2023-08-01T19:55:05.163390+0000", 2023-08-01T19:55:58.890 INFO:teuthology.orchestra.run.smithi008.stdout: "duration": 1.0189e-05 2023-08-01T19:55:58.890 INFO:teuthology.orchestra.run.smithi008.stdout: }, 2023-08-01T19:55:58.891 INFO:teuthology.orchestra.run.smithi008.stdout: { 2023-08-01T19:55:58.891 INFO:teuthology.orchestra.run.smithi008.stdout: "event": "queued_for_pg", 2023-08-01T19:55:58.891 INFO:teuthology.orchestra.run.smithi008.stdout: "time": "2023-08-01T19:55:05.163395+0000", 2023-08-01T19:55:58.891 INFO:teuthology.orchestra.run.smithi008.stdout: "duration": 4.4059999999999998e-06 2023-08-01T19:55:58.891 INFO:teuthology.orchestra.run.smithi008.stdout: }, 2023-08-01T19:55:58.891 INFO:teuthology.orchestra.run.smithi008.stdout: { 2023-08-01T19:55:58.891 INFO:teuthology.orchestra.run.smithi008.stdout: "event": "reached_pg", 2023-08-01T19:55:58.891 INFO:teuthology.orchestra.run.smithi008.stdout: "time": "2023-08-01T19:55:05.163429+0000", 2023-08-01T19:55:58.892 INFO:teuthology.orchestra.run.smithi008.stdout: "duration": 3.4900000000000001e-05 2023-08-01T19:55:58.892 INFO:teuthology.orchestra.run.smithi008.stdout: }, 2023-08-01T19:55:58.892 INFO:teuthology.orchestra.run.smithi008.stdout: { 2023-08-01T19:55:58.892 INFO:teuthology.orchestra.run.smithi008.stdout: "event": "started", 2023-08-01T19:55:58.892 INFO:teuthology.orchestra.run.smithi008.stdout: "time": "2023-08-01T19:55:05.163512+0000", 2023-08-01T19:55:58.892 INFO:teuthology.orchestra.run.smithi008.stdout: "duration": 8.2987999999999999e-05 2023-08-01T19:55:58.892 INFO:teuthology.orchestra.run.smithi008.stdout: }, 2023-08-01T19:55:58.893 INFO:teuthology.orchestra.run.smithi008.stdout: { 2023-08-01T19:55:58.893 INFO:teuthology.orchestra.run.smithi008.stdout: "event": "waiting for subops from 2", 2023-08-01T19:55:58.893 INFO:teuthology.orchestra.run.smithi008.stdout: "time": "2023-08-01T19:55:05.163596+0000", 2023-08-01T19:55:58.893 INFO:teuthology.orchestra.run.smithi008.stdout: "duration": 8.3783999999999996e-05 2023-08-01T19:55:58.893 INFO:teuthology.orchestra.run.smithi008.stdout: }, 2023-08-01T19:55:58.893 INFO:teuthology.orchestra.run.smithi008.stdout: { 2023-08-01T19:55:58.893 INFO:teuthology.orchestra.run.smithi008.stdout: "event": "op_commit", 2023-08-01T19:55:58.893 INFO:teuthology.orchestra.run.smithi008.stdout: "time": "2023-08-01T19:55:05.167129+0000", 2023-08-01T19:55:58.894 INFO:teuthology.orchestra.run.smithi008.stdout: "duration": 0.0035328709999999999 2023-08-01T19:55:58.894 INFO:teuthology.orchestra.run.smithi008.stdout: }, 2023-08-01T19:55:58.894 INFO:teuthology.orchestra.run.smithi008.stdout: { 2023-08-01T19:55:58.894 INFO:teuthology.orchestra.run.smithi008.stdout: "event": "sub_op_commit_rec", 2023-08-01T19:55:58.894 INFO:teuthology.orchestra.run.smithi008.stdout: "time": "2023-08-01T19:55:05.226302+0000", 2023-08-01T19:55:58.894 INFO:teuthology.orchestra.run.smithi008.stdout: "duration": 0.059172711000000003 2023-08-01T19:55:58.894 INFO:teuthology.orchestra.run.smithi008.stdout: }, 2023-08-01T19:55:58.894 INFO:teuthology.orchestra.run.smithi008.stdout: { 2023-08-01T19:55:58.895 INFO:teuthology.orchestra.run.smithi008.stdout: "event": "commit_sent", 2023-08-01T19:55:58.895 INFO:teuthology.orchestra.run.smithi008.stdout: "time": "2023-08-01T19:55:05.226351+0000", 2023-08-01T19:55:58.895 INFO:teuthology.orchestra.run.smithi008.stdout: "duration": 4.969e-05 2023-08-01T19:55:58.895 INFO:teuthology.orchestra.run.smithi008.stdout: }, 2023-08-01T19:55:58.895 INFO:teuthology.orchestra.run.smithi008.stdout: { 2023-08-01T19:55:58.895 INFO:teuthology.orchestra.run.smithi008.stdout: "event": "done", 2023-08-01T19:55:58.895 INFO:teuthology.orchestra.run.smithi008.stdout: "time": "2023-08-01T19:55:05.226389+0000", 2023-08-01T19:55:58.895 INFO:teuthology.orchestra.run.smithi008.stdout: "duration": 3.7978000000000001e-05 2023-08-01T19:55:58.896 INFO:teuthology.orchestra.run.smithi008.stdout: } 2023-08-01T19:55:58.896 INFO:teuthology.orchestra.run.smithi008.stdout: ] 2023-08-01T19:55:58.896 INFO:teuthology.orchestra.run.smithi008.stdout: } 2023-08-01T19:55:58.896 INFO:teuthology.orchestra.run.smithi008.stdout: }, 2023-08-01T19:55:58.896 INFO:teuthology.orchestra.run.smithi008.stdout: { 2023-08-01T19:55:58.896 INFO:teuthology.orchestra.run.smithi008.stdout: "description": "osd_op(client.4668.0:100262 5.a 5:5c636b5d:::benchmark_data_smithi006_114134_object100261:head [set-alloc-hint object_size 65536 write_size 65536,write 0~65536] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e37)", 2023-08-01T19:55:58.896 INFO:teuthology.orchestra.run.smithi008.stdout: "initiated_at": "2023-08-01T19:55:05.165068+0000", 2023-08-01T19:55:58.897 INFO:teuthology.orchestra.run.smithi008.stdout: "age": 53.696019210000003, 2023-08-01T19:55:58.897 INFO:teuthology.orchestra.run.smithi008.stdout: "duration": 0.063919403, 2023-08-01T19:55:58.897 INFO:teuthology.orchestra.run.smithi008.stdout: "type_data": { 2023-08-01T19:55:58.897 INFO:teuthology.orchestra.run.smithi008.stdout: "flag_point": "commit sent; apply or cleanup", 2023-08-01T19:55:58.897 INFO:teuthology.orchestra.run.smithi008.stdout: "client_info": { 2023-08-01T19:55:58.897 INFO:teuthology.orchestra.run.smithi008.stdout: "client": "client.4668", 2023-08-01T19:55:58.897 INFO:teuthology.orchestra.run.smithi008.stdout: "client_addr": "172.21.15.6:0/1709472247", 2023-08-01T19:55:58.897 INFO:teuthology.orchestra.run.smithi008.stdout: "tid": 100262 2023-08-01T19:55:58.898 INFO:teuthology.orchestra.run.smithi008.stdout: }, 2023-08-01T19:55:58.898 INFO:teuthology.orchestra.run.smithi008.stdout: "events": [ 2023-08-01T19:55:58.898 INFO:teuthology.orchestra.run.smithi008.stdout: { 2023-08-01T19:55:58.898 INFO:teuthology.orchestra.run.smithi008.stdout: "event": "initiated", 2023-08-01T19:55:58.898 INFO:teuthology.orchestra.run.smithi008.stdout: "time": "2023-08-01T19:55:05.165068+0000", 2023-08-01T19:55:58.898 INFO:teuthology.orchestra.run.smithi008.stdout: "duration": 0 2023-08-01T19:55:58.898 INFO:teuthology.orchestra.run.smithi008.stdout: }, 2023-08-01T19:55:58.898 INFO:teuthology.orchestra.run.smithi008.stdout: { 2023-08-01T19:55:58.899 INFO:teuthology.orchestra.run.smithi008.stdout: "event": "throttled", 2023-08-01T19:55:58.899 INFO:teuthology.orchestra.run.smithi008.stdout: "time": "2023-08-01T19:55:05.165068+0000", 2023-08-01T19:55:58.899 INFO:teuthology.orchestra.run.smithi008.stdout: "duration": 0 2023-08-01T19:55:58.899 INFO:teuthology.orchestra.run.smithi008.stdout: }, 2023-08-01T19:55:58.899 INFO:teuthology.orchestra.run.smithi008.stdout: { 2023-08-01T19:55:58.899 INFO:teuthology.orchestra.run.smithi008.stdout: "event": "header_read", 2023-08-01T19:55:58.899 INFO:teuthology.orchestra.run.smithi008.stdout: "time": "2023-08-01T19:55:05.165067+0000", 2023-08-01T19:55:58.899 INFO:teuthology.orchestra.run.smithi008.stdout: "duration": 4294967295.999999 2023-08-01T19:55:58.900 INFO:teuthology.orchestra.run.smithi008.stdout: }, 2023-08-01T19:55:58.900 INFO:teuthology.orchestra.run.smithi008.stdout: { 2023-08-01T19:55:58.900 INFO:teuthology.orchestra.run.smithi008.stdout: "event": "all_read", 2023-08-01T19:55:58.900 INFO:teuthology.orchestra.run.smithi008.stdout: "time": "2023-08-01T19:55:05.165126+0000", 2023-08-01T19:55:58.900 INFO:teuthology.orchestra.run.smithi008.stdout: "duration": 5.9116000000000001e-05 2023-08-01T19:55:58.900 INFO:teuthology.orchestra.run.smithi008.stdout: }, 2023-08-01T19:55:58.901 INFO:teuthology.orchestra.run.smithi008.stdout: { 2023-08-01T19:55:58.901 INFO:teuthology.orchestra.run.smithi008.stdout: "event": "dispatched", 2023-08-01T19:55:58.901 INFO:teuthology.orchestra.run.smithi008.stdout: "time": "2023-08-01T19:55:05.165134+0000", 2023-08-01T19:55:58.901 INFO:teuthology.orchestra.run.smithi008.stdout: "duration": 7.9820000000000008e-06 2023-08-01T19:55:58.901 INFO:teuthology.orchestra.run.smithi008.stdout: }, 2023-08-01T19:55:58.901 INFO:teuthology.orchestra.run.smithi008.stdout: { 2023-08-01T19:55:58.901 INFO:teuthology.orchestra.run.smithi008.stdout: "event": "queued_for_pg", 2023-08-01T19:55:58.901 INFO:teuthology.orchestra.run.smithi008.stdout: "time": "2023-08-01T19:55:05.165139+0000", 2023-08-01T19:55:58.902 INFO:teuthology.orchestra.run.smithi008.stdout: "duration": 4.2560000000000004e-06 2023-08-01T19:55:58.902 INFO:teuthology.orchestra.run.smithi008.stdout: }, 2023-08-01T19:55:58.902 INFO:teuthology.orchestra.run.smithi008.stdout: { 2023-08-01T19:55:58.902 INFO:teuthology.orchestra.run.smithi008.stdout: "event": "reached_pg", 2023-08-01T19:55:58.902 INFO:teuthology.orchestra.run.smithi008.stdout: "time": "2023-08-01T19:55:05.165165+0000", 2023-08-01T19:55:58.902 INFO:teuthology.orchestra.run.smithi008.stdout: "duration": 2.6554e-05 2023-08-01T19:55:58.902 INFO:teuthology.orchestra.run.smithi008.stdout: }, 2023-08-01T19:55:58.902 INFO:teuthology.orchestra.run.smithi008.stdout: { 2023-08-01T19:55:58.903 INFO:teuthology.orchestra.run.smithi008.stdout: "event": "started", 2023-08-01T19:55:58.903 INFO:teuthology.orchestra.run.smithi008.stdout: "time": "2023-08-01T19:55:05.165243+0000", 2023-08-01T19:55:58.903 INFO:teuthology.orchestra.run.smithi008.stdout: "duration": 7.7877e-05 2023-08-01T19:55:58.903 INFO:teuthology.orchestra.run.smithi008.stdout: }, 2023-08-01T19:55:58.903 INFO:teuthology.orchestra.run.smithi008.stdout: { 2023-08-01T19:55:58.903 INFO:teuthology.orchestra.run.smithi008.stdout: "event": "waiting for subops from 2", 2023-08-01T19:55:58.903 INFO:teuthology.orchestra.run.smithi008.stdout: "time": "2023-08-01T19:55:05.165450+0000", 2023-08-01T19:55:58.904 INFO:teuthology.orchestra.run.smithi008.stdout: "duration": 0.00020655599999999999 2023-08-01T19:55:58.904 INFO:teuthology.orchestra.run.smithi008.stdout: }, 2023-08-01T19:55:58.904 INFO:teuthology.orchestra.run.smithi008.stdout: { 2023-08-01T19:55:58.904 INFO:teuthology.orchestra.run.smithi008.stdout: "event": "op_commit", 2023-08-01T19:55:58.904 INFO:teuthology.orchestra.run.smithi008.stdout: "time": "2023-08-01T19:55:05.168883+0000", 2023-08-01T19:55:58.904 INFO:teuthology.orchestra.run.smithi008.stdout: "duration": 0.0034333279999999998 2023-08-01T19:55:58.905 INFO:teuthology.orchestra.run.smithi008.stdout: }, 2023-08-01T19:55:58.905 INFO:teuthology.orchestra.run.smithi008.stdout: { 2023-08-01T19:55:58.905 INFO:teuthology.orchestra.run.smithi008.stdout: "event": "sub_op_commit_rec", 2023-08-01T19:55:58.905 INFO:teuthology.orchestra.run.smithi008.stdout: "time": "2023-08-01T19:55:05.228904+0000", 2023-08-01T19:55:58.905 INFO:teuthology.orchestra.run.smithi008.stdout: "duration": 0.060021370999999997 2023-08-01T19:55:58.905 INFO:teuthology.orchestra.run.smithi008.stdout: }, 2023-08-01T19:55:58.905 INFO:teuthology.orchestra.run.smithi008.stdout: { 2023-08-01T19:55:58.906 INFO:teuthology.orchestra.run.smithi008.stdout: "event": "commit_sent", 2023-08-01T19:55:58.906 INFO:teuthology.orchestra.run.smithi008.stdout: "time": "2023-08-01T19:55:05.228952+0000", 2023-08-01T19:55:58.906 INFO:teuthology.orchestra.run.smithi008.stdout: "duration": 4.8056999999999997e-05 2023-08-01T19:55:58.906 INFO:teuthology.orchestra.run.smithi008.stdout: }, 2023-08-01T19:55:58.906 INFO:teuthology.orchestra.run.smithi008.stdout: { 2023-08-01T19:55:58.906 INFO:teuthology.orchestra.run.smithi008.stdout: "event": "done", 2023-08-01T19:55:58.906 INFO:teuthology.orchestra.run.smithi008.stdout: "time": "2023-08-01T19:55:05.228987+0000", 2023-08-01T19:55:58.906 INFO:teuthology.orchestra.run.smithi008.stdout: "duration": 3.5083000000000003e-05 2023-08-01T19:55:58.907 INFO:teuthology.orchestra.run.smithi008.stdout: } 2023-08-01T19:55:58.907 INFO:teuthology.orchestra.run.smithi008.stdout: ] 2023-08-01T19:55:58.907 INFO:teuthology.orchestra.run.smithi008.stdout: } 2023-08-01T19:55:58.907 INFO:teuthology.orchestra.run.smithi008.stdout: }, 2023-08-01T19:55:58.908 INFO:teuthology.orchestra.run.smithi008.stdout: { 2023-08-01T19:55:58.908 INFO:teuthology.orchestra.run.smithi008.stdout: "description": "osd_op(client.4668.0:100929 5.3 5:c29f4adb:::benchmark_data_smithi006_114134_object100928:head [set-alloc-hint object_size 65536 write_size 65536,write 0~65536] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e37)", 2023-08-01T19:55:58.908 INFO:teuthology.orchestra.run.smithi008.stdout: "initiated_at": "2023-08-01T19:55:05.564759+0000", 2023-08-01T19:55:58.908 INFO:teuthology.orchestra.run.smithi008.stdout: "age": 53.296328570999997, 2023-08-01T19:55:58.908 INFO:teuthology.orchestra.run.smithi008.stdout: "duration": 0.062544635000000001, 2023-08-01T19:55:58.908 INFO:teuthology.orchestra.run.smithi008.stdout: "type_data": { 2023-08-01T19:55:58.908 INFO:teuthology.orchestra.run.smithi008.stdout: "flag_point": "commit sent; apply or cleanup", 2023-08-01T19:55:58.909 INFO:teuthology.orchestra.run.smithi008.stdout: "client_info": { 2023-08-01T19:55:58.909 INFO:teuthology.orchestra.run.smithi008.stdout: "client": "client.4668", 2023-08-01T19:55:58.909 INFO:teuthology.orchestra.run.smithi008.stdout: "client_addr": "172.21.15.6:0/1709472247", 2023-08-01T19:55:58.909 INFO:teuthology.orchestra.run.smithi008.stdout: "tid": 100929 2023-08-01T19:55:58.909 INFO:teuthology.orchestra.run.smithi008.stdout: }, 2023-08-01T19:55:58.909 INFO:teuthology.orchestra.run.smithi008.stdout: "events": [ 2023-08-01T19:55:58.909 INFO:teuthology.orchestra.run.smithi008.stdout: { 2023-08-01T19:55:58.909 INFO:teuthology.orchestra.run.smithi008.stdout: "event": "initiated", 2023-08-01T19:55:58.910 INFO:teuthology.orchestra.run.smithi008.stdout: "time": "2023-08-01T19:55:05.564759+0000", 2023-08-01T19:55:58.910 INFO:teuthology.orchestra.run.smithi008.stdout: "duration": 0 2023-08-01T19:55:58.910 INFO:teuthology.orchestra.run.smithi008.stdout: }, 2023-08-01T19:55:58.910 INFO:teuthology.orchestra.run.smithi008.stdout: { 2023-08-01T19:55:58.910 INFO:teuthology.orchestra.run.smithi008.stdout: "event": "throttled", 2023-08-01T19:55:58.910 INFO:teuthology.orchestra.run.smithi008.stdout: "time": "2023-08-01T19:55:05.564759+0000", 2023-08-01T19:55:58.910 INFO:teuthology.orchestra.run.smithi008.stdout: "duration": 0 2023-08-01T19:55:58.910 INFO:teuthology.orchestra.run.smithi008.stdout: }, 2023-08-01T19:55:58.911 INFO:teuthology.orchestra.run.smithi008.stdout: { 2023-08-01T19:55:58.911 INFO:teuthology.orchestra.run.smithi008.stdout: "event": "header_read", 2023-08-01T19:55:58.911 INFO:teuthology.orchestra.run.smithi008.stdout: "time": "2023-08-01T19:55:05.564758+0000", 2023-08-01T19:55:58.911 INFO:teuthology.orchestra.run.smithi008.stdout: "duration": 4294967295.999999 2023-08-01T19:55:58.911 INFO:teuthology.orchestra.run.smithi008.stdout: }, 2023-08-01T19:55:58.911 INFO:teuthology.orchestra.run.smithi008.stdout: { 2023-08-01T19:55:58.911 INFO:teuthology.orchestra.run.smithi008.stdout: "event": "all_read", 2023-08-01T19:55:58.911 INFO:teuthology.orchestra.run.smithi008.stdout: "time": "2023-08-01T19:55:05.564815+0000", 2023-08-01T19:55:58.912 INFO:teuthology.orchestra.run.smithi008.stdout: "duration": 5.7757000000000003e-05 2023-08-01T19:55:58.912 INFO:teuthology.orchestra.run.smithi008.stdout: }, 2023-08-01T19:55:58.912 INFO:teuthology.orchestra.run.smithi008.stdout: { 2023-08-01T19:55:58.912 INFO:teuthology.orchestra.run.smithi008.stdout: "event": "dispatched", 2023-08-01T19:55:58.912 INFO:teuthology.orchestra.run.smithi008.stdout: "time": "2023-08-01T19:55:05.564824+0000", 2023-08-01T19:55:58.912 INFO:teuthology.orchestra.run.smithi008.stdout: "duration": 8.6559999999999998e-06 2023-08-01T19:55:58.912 INFO:teuthology.orchestra.run.smithi008.stdout: }, 2023-08-01T19:55:58.913 INFO:teuthology.orchestra.run.smithi008.stdout: { 2023-08-01T19:55:58.913 INFO:teuthology.orchestra.run.smithi008.stdout: "event": "queued_for_pg", 2023-08-01T19:55:58.913 INFO:teuthology.orchestra.run.smithi008.stdout: "time": "2023-08-01T19:55:05.564829+0000", 2023-08-01T19:55:58.913 INFO:teuthology.orchestra.run.smithi008.stdout: "duration": 4.6160000000000004e-06 2023-08-01T19:55:58.913 INFO:teuthology.orchestra.run.smithi008.stdout: }, 2023-08-01T19:55:58.913 INFO:teuthology.orchestra.run.smithi008.stdout: { 2023-08-01T19:55:58.913 INFO:teuthology.orchestra.run.smithi008.stdout: "event": "reached_pg", 2023-08-01T19:55:58.913 INFO:teuthology.orchestra.run.smithi008.stdout: "time": "2023-08-01T19:55:05.564871+0000", 2023-08-01T19:55:58.914 INFO:teuthology.orchestra.run.smithi008.stdout: "duration": 4.2206000000000002e-05 2023-08-01T19:55:58.914 INFO:teuthology.orchestra.run.smithi008.stdout: }, 2023-08-01T19:55:58.914 INFO:teuthology.orchestra.run.smithi008.stdout: { 2023-08-01T19:55:58.914 INFO:teuthology.orchestra.run.smithi008.stdout: "event": "started", 2023-08-01T19:55:58.914 INFO:teuthology.orchestra.run.smithi008.stdout: "time": "2023-08-01T19:55:05.565011+0000", 2023-08-01T19:55:58.914 INFO:teuthology.orchestra.run.smithi008.stdout: "duration": 0.000140469 2023-08-01T19:55:58.914 INFO:teuthology.orchestra.run.smithi008.stdout: }, 2023-08-01T19:55:58.914 INFO:teuthology.orchestra.run.smithi008.stdout: { 2023-08-01T19:55:58.915 INFO:teuthology.orchestra.run.smithi008.stdout: "event": "waiting for subops from 1", 2023-08-01T19:55:58.915 INFO:teuthology.orchestra.run.smithi008.stdout: "time": "2023-08-01T19:55:05.565212+0000", 2023-08-01T19:55:58.915 INFO:teuthology.orchestra.run.smithi008.stdout: "duration": 0.00020106599999999999 2023-08-01T19:55:58.915 INFO:teuthology.orchestra.run.smithi008.stdout: }, 2023-08-01T19:55:58.915 INFO:teuthology.orchestra.run.smithi008.stdout: { 2023-08-01T19:55:58.915 INFO:teuthology.orchestra.run.smithi008.stdout: "event": "sub_op_commit_rec", 2023-08-01T19:55:58.915 INFO:teuthology.orchestra.run.smithi008.stdout: "time": "2023-08-01T19:55:05.626925+0000", 2023-08-01T19:55:58.916 INFO:teuthology.orchestra.run.smithi008.stdout: "duration": 0.061712111 2023-08-01T19:55:58.916 INFO:teuthology.orchestra.run.smithi008.stdout: }, 2023-08-01T19:55:58.916 INFO:teuthology.orchestra.run.smithi008.stdout: { 2023-08-01T19:55:58.916 INFO:teuthology.orchestra.run.smithi008.stdout: "event": "op_commit", 2023-08-01T19:55:58.916 INFO:teuthology.orchestra.run.smithi008.stdout: "time": "2023-08-01T19:55:05.627217+0000", 2023-08-01T19:55:58.916 INFO:teuthology.orchestra.run.smithi008.stdout: "duration": 0.00029265999999999998 2023-08-01T19:55:58.916 INFO:teuthology.orchestra.run.smithi008.stdout: }, 2023-08-01T19:55:58.916 INFO:teuthology.orchestra.run.smithi008.stdout: { 2023-08-01T19:55:58.917 INFO:teuthology.orchestra.run.smithi008.stdout: "event": "commit_sent", 2023-08-01T19:55:58.917 INFO:teuthology.orchestra.run.smithi008.stdout: "time": "2023-08-01T19:55:05.627264+0000", 2023-08-01T19:55:58.917 INFO:teuthology.orchestra.run.smithi008.stdout: "duration": 4.6260000000000001e-05 2023-08-01T19:55:58.917 INFO:teuthology.orchestra.run.smithi008.stdout: }, 2023-08-01T19:55:58.917 INFO:teuthology.orchestra.run.smithi008.stdout: { 2023-08-01T19:55:58.917 INFO:teuthology.orchestra.run.smithi008.stdout: "event": "done", 2023-08-01T19:55:58.917 INFO:teuthology.orchestra.run.smithi008.stdout: "time": "2023-08-01T19:55:05.627303+0000", 2023-08-01T19:55:58.917 INFO:teuthology.orchestra.run.smithi008.stdout: "duration": 3.9839999999999998e-05 2023-08-01T19:55:58.918 INFO:teuthology.orchestra.run.smithi008.stdout: } 2023-08-01T19:55:58.918 INFO:teuthology.orchestra.run.smithi008.stdout: ] 2023-08-01T19:55:58.918 INFO:teuthology.orchestra.run.smithi008.stdout: } 2023-08-01T19:55:58.918 INFO:teuthology.orchestra.run.smithi008.stdout: }, 2023-08-01T19:55:58.918 INFO:teuthology.orchestra.run.smithi008.stdout: { 2023-08-01T19:55:58.918 INFO:teuthology.orchestra.run.smithi008.stdout: "description": "osd_repop(client.4668.0:100928 5.7 e37/19 5:e61a7dfa:::benchmark_data_smithi006_114134_object100927:head v 37'6273, mlcod=37'6270)", 2023-08-01T19:55:58.918 INFO:teuthology.orchestra.run.smithi008.stdout: "initiated_at": "2023-08-01T19:55:05.565106+0000", 2023-08-01T19:55:58.918 INFO:teuthology.orchestra.run.smithi008.stdout: "age": 53.295981472999998, 2023-08-01T19:55:58.919 INFO:teuthology.orchestra.run.smithi008.stdout: "duration": 0.064091282999999999, 2023-08-01T19:55:58.919 INFO:teuthology.orchestra.run.smithi008.stdout: "type_data": { 2023-08-01T19:55:58.919 INFO:teuthology.orchestra.run.smithi008.stdout: "flag_point": "commit sent; apply or cleanup", 2023-08-01T19:55:58.919 INFO:teuthology.orchestra.run.smithi008.stdout: "events": [ 2023-08-01T19:55:58.919 INFO:teuthology.orchestra.run.smithi008.stdout: { 2023-08-01T19:55:58.919 INFO:teuthology.orchestra.run.smithi008.stdout: "event": "initiated", 2023-08-01T19:55:58.919 INFO:teuthology.orchestra.run.smithi008.stdout: "time": "2023-08-01T19:55:05.565106+0000", 2023-08-01T19:55:58.920 INFO:teuthology.orchestra.run.smithi008.stdout: "duration": 0 2023-08-01T19:55:58.920 INFO:teuthology.orchestra.run.smithi008.stdout: }, 2023-08-01T19:55:58.920 INFO:teuthology.orchestra.run.smithi008.stdout: { 2023-08-01T19:55:58.920 INFO:teuthology.orchestra.run.smithi008.stdout: "event": "throttled", 2023-08-01T19:55:58.920 INFO:teuthology.orchestra.run.smithi008.stdout: "time": "2023-08-01T19:55:05.565106+0000", 2023-08-01T19:55:58.920 INFO:teuthology.orchestra.run.smithi008.stdout: "duration": 0 2023-08-01T19:55:58.920 INFO:teuthology.orchestra.run.smithi008.stdout: }, 2023-08-01T19:55:58.920 INFO:teuthology.orchestra.run.smithi008.stdout: { 2023-08-01T19:55:58.921 INFO:teuthology.orchestra.run.smithi008.stdout: "event": "header_read", 2023-08-01T19:55:58.921 INFO:teuthology.orchestra.run.smithi008.stdout: "time": "2023-08-01T19:55:05.565105+0000", 2023-08-01T19:55:58.921 INFO:teuthology.orchestra.run.smithi008.stdout: "duration": 4294967295.9999995 2023-08-01T19:55:58.921 INFO:teuthology.orchestra.run.smithi008.stdout: }, 2023-08-01T19:55:58.921 INFO:teuthology.orchestra.run.smithi008.stdout: { 2023-08-01T19:55:58.921 INFO:teuthology.orchestra.run.smithi008.stdout: "event": "all_read", 2023-08-01T19:55:58.921 INFO:teuthology.orchestra.run.smithi008.stdout: "time": "2023-08-01T19:55:05.565173+0000", 2023-08-01T19:55:58.921 INFO:teuthology.orchestra.run.smithi008.stdout: "duration": 6.8186000000000001e-05 2023-08-01T19:55:58.922 INFO:teuthology.orchestra.run.smithi008.stdout: }, 2023-08-01T19:55:58.922 INFO:teuthology.orchestra.run.smithi008.stdout: { 2023-08-01T19:55:58.922 INFO:teuthology.orchestra.run.smithi008.stdout: "event": "dispatched", 2023-08-01T19:55:58.922 INFO:teuthology.orchestra.run.smithi008.stdout: "time": "2023-08-01T19:55:05.565182+0000", 2023-08-01T19:55:58.922 INFO:teuthology.orchestra.run.smithi008.stdout: "duration": 8.3620000000000006e-06 2023-08-01T19:55:58.922 INFO:teuthology.orchestra.run.smithi008.stdout: }, 2023-08-01T19:55:58.922 INFO:teuthology.orchestra.run.smithi008.stdout: { 2023-08-01T19:55:58.923 INFO:teuthology.orchestra.run.smithi008.stdout: "event": "queued_for_pg", 2023-08-01T19:55:58.923 INFO:teuthology.orchestra.run.smithi008.stdout: "time": "2023-08-01T19:55:05.565186+0000", 2023-08-01T19:55:58.923 INFO:teuthology.orchestra.run.smithi008.stdout: "duration": 3.7680000000000002e-06 2023-08-01T19:55:58.923 INFO:teuthology.orchestra.run.smithi008.stdout: }, 2023-08-01T19:55:58.923 INFO:teuthology.orchestra.run.smithi008.stdout: { 2023-08-01T19:55:58.923 INFO:teuthology.orchestra.run.smithi008.stdout: "event": "reached_pg", 2023-08-01T19:55:58.923 INFO:teuthology.orchestra.run.smithi008.stdout: "time": "2023-08-01T19:55:05.565212+0000", 2023-08-01T19:55:58.923 INFO:teuthology.orchestra.run.smithi008.stdout: "duration": 2.6230000000000001e-05 2023-08-01T19:55:58.924 INFO:teuthology.orchestra.run.smithi008.stdout: }, 2023-08-01T19:55:58.924 INFO:teuthology.orchestra.run.smithi008.stdout: { 2023-08-01T19:55:58.924 INFO:teuthology.orchestra.run.smithi008.stdout: "event": "started", 2023-08-01T19:55:58.924 INFO:teuthology.orchestra.run.smithi008.stdout: "time": "2023-08-01T19:55:05.565224+0000", 2023-08-01T19:55:58.924 INFO:teuthology.orchestra.run.smithi008.stdout: "duration": 1.2033e-05 2023-08-01T19:55:58.924 INFO:teuthology.orchestra.run.smithi008.stdout: }, 2023-08-01T19:55:58.924 INFO:teuthology.orchestra.run.smithi008.stdout: { 2023-08-01T19:55:58.924 INFO:teuthology.orchestra.run.smithi008.stdout: "event": "commit_sent", 2023-08-01T19:55:58.925 INFO:teuthology.orchestra.run.smithi008.stdout: "time": "2023-08-01T19:55:05.629152+0000", 2023-08-01T19:55:58.925 INFO:teuthology.orchestra.run.smithi008.stdout: "duration": 0.063928378999999994 2023-08-01T19:55:58.925 INFO:teuthology.orchestra.run.smithi008.stdout: }, 2023-08-01T19:55:58.925 INFO:teuthology.orchestra.run.smithi008.stdout: { 2023-08-01T19:55:58.925 INFO:teuthology.orchestra.run.smithi008.stdout: "event": "done", 2023-08-01T19:55:58.925 INFO:teuthology.orchestra.run.smithi008.stdout: "time": "2023-08-01T19:55:05.629197+0000", 2023-08-01T19:55:58.925 INFO:teuthology.orchestra.run.smithi008.stdout: "duration": 4.4894000000000001e-05 2023-08-01T19:55:58.925 INFO:teuthology.orchestra.run.smithi008.stdout: } 2023-08-01T19:55:58.926 INFO:teuthology.orchestra.run.smithi008.stdout: ] 2023-08-01T19:55:58.926 INFO:teuthology.orchestra.run.smithi008.stdout: } 2023-08-01T19:55:58.926 INFO:teuthology.orchestra.run.smithi008.stdout: }, 2023-08-01T19:55:58.926 INFO:teuthology.orchestra.run.smithi008.stdout: { 2023-08-01T19:55:58.926 INFO:teuthology.orchestra.run.smithi008.stdout: "description": "osd_repop(client.4668.0:100927 5.0 e37/19 5:00608ec6:::benchmark_data_smithi006_114134_object100926:head v 37'6408, mlcod=37'6403)", 2023-08-01T19:55:58.926 INFO:teuthology.orchestra.run.smithi008.stdout: "initiated_at": "2023-08-01T19:55:05.565153+0000", 2023-08-01T19:55:58.926 INFO:teuthology.orchestra.run.smithi008.stdout: "age": 53.295934736, 2023-08-01T19:55:58.926 INFO:teuthology.orchestra.run.smithi008.stdout: "duration": 0.062202714999999999, 2023-08-01T19:55:58.927 INFO:teuthology.orchestra.run.smithi008.stdout: "type_data": { 2023-08-01T19:55:58.927 INFO:teuthology.orchestra.run.smithi008.stdout: "flag_point": "commit sent; apply or cleanup", 2023-08-01T19:55:58.927 INFO:teuthology.orchestra.run.smithi008.stdout: "events": [ 2023-08-01T19:55:58.927 INFO:teuthology.orchestra.run.smithi008.stdout: { 2023-08-01T19:55:58.927 INFO:teuthology.orchestra.run.smithi008.stdout: "event": "initiated", 2023-08-01T19:55:58.927 INFO:teuthology.orchestra.run.smithi008.stdout: "time": "2023-08-01T19:55:05.565153+0000", 2023-08-01T19:55:58.927 INFO:teuthology.orchestra.run.smithi008.stdout: "duration": 0 2023-08-01T19:55:58.928 INFO:teuthology.orchestra.run.smithi008.stdout: }, 2023-08-01T19:55:58.928 INFO:teuthology.orchestra.run.smithi008.stdout: { 2023-08-01T19:55:58.928 INFO:teuthology.orchestra.run.smithi008.stdout: "event": "throttled", 2023-08-01T19:55:58.928 INFO:teuthology.orchestra.run.smithi008.stdout: "time": "2023-08-01T19:55:05.565153+0000", 2023-08-01T19:55:58.928 INFO:teuthology.orchestra.run.smithi008.stdout: "duration": 0 2023-08-01T19:55:58.928 INFO:teuthology.orchestra.run.smithi008.stdout: }, 2023-08-01T19:55:58.928 INFO:teuthology.orchestra.run.smithi008.stdout: { 2023-08-01T19:55:58.928 INFO:teuthology.orchestra.run.smithi008.stdout: "event": "header_read", 2023-08-01T19:55:58.929 INFO:teuthology.orchestra.run.smithi008.stdout: "time": "2023-08-01T19:55:05.565152+0000", 2023-08-01T19:55:58.929 INFO:teuthology.orchestra.run.smithi008.stdout: "duration": 4294967295.9999995 2023-08-01T19:55:58.929 INFO:teuthology.orchestra.run.smithi008.stdout: }, 2023-08-01T19:55:58.929 INFO:teuthology.orchestra.run.smithi008.stdout: { 2023-08-01T19:55:58.929 INFO:teuthology.orchestra.run.smithi008.stdout: "event": "all_read", 2023-08-01T19:55:58.929 INFO:teuthology.orchestra.run.smithi008.stdout: "time": "2023-08-01T19:55:05.565225+0000", 2023-08-01T19:55:58.929 INFO:teuthology.orchestra.run.smithi008.stdout: "duration": 7.2471000000000005e-05 2023-08-01T19:55:58.929 INFO:teuthology.orchestra.run.smithi008.stdout: }, 2023-08-01T19:55:58.930 INFO:teuthology.orchestra.run.smithi008.stdout: { 2023-08-01T19:55:58.930 INFO:teuthology.orchestra.run.smithi008.stdout: "event": "dispatched", 2023-08-01T19:55:58.930 INFO:teuthology.orchestra.run.smithi008.stdout: "time": "2023-08-01T19:55:05.565229+0000", 2023-08-01T19:55:58.930 INFO:teuthology.orchestra.run.smithi008.stdout: "duration": 4.5600000000000004e-06 2023-08-01T19:55:58.930 INFO:teuthology.orchestra.run.smithi008.stdout: }, 2023-08-01T19:55:58.930 INFO:teuthology.orchestra.run.smithi008.stdout: { 2023-08-01T19:55:58.930 INFO:teuthology.orchestra.run.smithi008.stdout: "event": "queued_for_pg", 2023-08-01T19:55:58.930 INFO:teuthology.orchestra.run.smithi008.stdout: "time": "2023-08-01T19:55:05.565232+0000", 2023-08-01T19:55:58.931 INFO:teuthology.orchestra.run.smithi008.stdout: "duration": 2.6900000000000001e-06 2023-08-01T19:55:58.931 INFO:teuthology.orchestra.run.smithi008.stdout: }, 2023-08-01T19:55:58.931 INFO:teuthology.orchestra.run.smithi008.stdout: { 2023-08-01T19:55:58.931 INFO:teuthology.orchestra.run.smithi008.stdout: "event": "reached_pg", 2023-08-01T19:55:58.931 INFO:teuthology.orchestra.run.smithi008.stdout: "time": "2023-08-01T19:55:05.565283+0000", 2023-08-01T19:55:58.931 INFO:teuthology.orchestra.run.smithi008.stdout: "duration": 5.1442e-05 2023-08-01T19:55:58.931 INFO:teuthology.orchestra.run.smithi008.stdout: }, 2023-08-01T19:55:58.931 INFO:teuthology.orchestra.run.smithi008.stdout: { 2023-08-01T19:55:58.932 INFO:teuthology.orchestra.run.smithi008.stdout: "event": "started", 2023-08-01T19:55:58.932 INFO:teuthology.orchestra.run.smithi008.stdout: "time": "2023-08-01T19:55:05.565301+0000", 2023-08-01T19:55:58.932 INFO:teuthology.orchestra.run.smithi008.stdout: "duration": 1.8029e-05 2023-08-01T19:55:58.932 INFO:teuthology.orchestra.run.smithi008.stdout: }, 2023-08-01T19:55:58.932 INFO:teuthology.orchestra.run.smithi008.stdout: { 2023-08-01T19:55:58.932 INFO:teuthology.orchestra.run.smithi008.stdout: "event": "commit_sent", 2023-08-01T19:55:58.932 INFO:teuthology.orchestra.run.smithi008.stdout: "time": "2023-08-01T19:55:05.627318+0000", 2023-08-01T19:55:58.933 INFO:teuthology.orchestra.run.smithi008.stdout: "duration": 0.062016763000000003 2023-08-01T19:55:58.933 INFO:teuthology.orchestra.run.smithi008.stdout: }, 2023-08-01T19:55:58.933 INFO:teuthology.orchestra.run.smithi008.stdout: { 2023-08-01T19:55:58.933 INFO:teuthology.orchestra.run.smithi008.stdout: "event": "done", 2023-08-01T19:55:58.933 INFO:teuthology.orchestra.run.smithi008.stdout: "time": "2023-08-01T19:55:05.627355+0000", 2023-08-01T19:55:58.933 INFO:teuthology.orchestra.run.smithi008.stdout: "duration": 3.7258999999999997e-05 2023-08-01T19:55:58.933 INFO:teuthology.orchestra.run.smithi008.stdout: } 2023-08-01T19:55:58.933 INFO:teuthology.orchestra.run.smithi008.stdout: ] 2023-08-01T19:55:58.934 INFO:teuthology.orchestra.run.smithi008.stdout: } 2023-08-01T19:55:58.934 INFO:teuthology.orchestra.run.smithi008.stdout: }, 2023-08-01T19:55:58.934 INFO:teuthology.orchestra.run.smithi008.stdout: { 2023-08-01T19:55:58.934 INFO:teuthology.orchestra.run.smithi008.stdout: "description": "osd_op(client.4668.0:100930 5.5 5:a7b64eb3:::benchmark_data_smithi006_114134_object100929:head [set-alloc-hint object_size 65536 write_size 65536,write 0~65536] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e37)", 2023-08-01T19:55:58.934 INFO:teuthology.orchestra.run.smithi008.stdout: "initiated_at": "2023-08-01T19:55:05.565766+0000", 2023-08-01T19:55:58.934 INFO:teuthology.orchestra.run.smithi008.stdout: "age": 53.295320951000001, 2023-08-01T19:55:58.934 INFO:teuthology.orchestra.run.smithi008.stdout: "duration": 0.063668735000000004, 2023-08-01T19:55:58.934 INFO:teuthology.orchestra.run.smithi008.stdout: "type_data": { 2023-08-01T19:55:58.935 INFO:teuthology.orchestra.run.smithi008.stdout: "flag_point": "commit sent; apply or cleanup", 2023-08-01T19:55:58.935 INFO:teuthology.orchestra.run.smithi008.stdout: "client_info": { 2023-08-01T19:55:58.935 INFO:teuthology.orchestra.run.smithi008.stdout: "client": "client.4668", 2023-08-01T19:55:58.935 INFO:teuthology.orchestra.run.smithi008.stdout: "client_addr": "172.21.15.6:0/1709472247", 2023-08-01T19:55:58.935 INFO:teuthology.orchestra.run.smithi008.stdout: "tid": 100930 2023-08-01T19:55:58.935 INFO:teuthology.orchestra.run.smithi008.stdout: }, 2023-08-01T19:55:58.935 INFO:teuthology.orchestra.run.smithi008.stdout: "events": [ 2023-08-01T19:55:58.935 INFO:teuthology.orchestra.run.smithi008.stdout: { 2023-08-01T19:55:58.936 INFO:teuthology.orchestra.run.smithi008.stdout: "event": "initiated", 2023-08-01T19:55:58.936 INFO:teuthology.orchestra.run.smithi008.stdout: "time": "2023-08-01T19:55:05.565766+0000", 2023-08-01T19:55:58.936 INFO:teuthology.orchestra.run.smithi008.stdout: "duration": 0 2023-08-01T19:55:58.936 INFO:teuthology.orchestra.run.smithi008.stdout: }, 2023-08-01T19:55:58.936 INFO:teuthology.orchestra.run.smithi008.stdout: { 2023-08-01T19:55:58.936 INFO:teuthology.orchestra.run.smithi008.stdout: "event": "throttled", 2023-08-01T19:55:58.936 INFO:teuthology.orchestra.run.smithi008.stdout: "time": "2023-08-01T19:55:05.565766+0000", 2023-08-01T19:55:58.936 INFO:teuthology.orchestra.run.smithi008.stdout: "duration": 0 2023-08-01T19:55:58.937 INFO:teuthology.orchestra.run.smithi008.stdout: }, 2023-08-01T19:55:58.937 INFO:teuthology.orchestra.run.smithi008.stdout: { 2023-08-01T19:55:58.937 INFO:teuthology.orchestra.run.smithi008.stdout: "event": "header_read", 2023-08-01T19:55:58.937 INFO:teuthology.orchestra.run.smithi008.stdout: "time": "2023-08-01T19:55:05.565766+0000", 2023-08-01T19:55:58.937 INFO:teuthology.orchestra.run.smithi008.stdout: "duration": 4294967295.999999 2023-08-01T19:55:58.937 INFO:teuthology.orchestra.run.smithi008.stdout: }, 2023-08-01T19:55:58.937 INFO:teuthology.orchestra.run.smithi008.stdout: { 2023-08-01T19:55:58.937 INFO:teuthology.orchestra.run.smithi008.stdout: "event": "all_read", 2023-08-01T19:55:58.938 INFO:teuthology.orchestra.run.smithi008.stdout: "time": "2023-08-01T19:55:05.565855+0000", 2023-08-01T19:55:58.938 INFO:teuthology.orchestra.run.smithi008.stdout: "duration": 8.9166999999999995e-05 2023-08-01T19:55:58.938 INFO:teuthology.orchestra.run.smithi008.stdout: }, 2023-08-01T19:55:58.938 INFO:teuthology.orchestra.run.smithi008.stdout: { 2023-08-01T19:55:58.938 INFO:teuthology.orchestra.run.smithi008.stdout: "event": "dispatched", 2023-08-01T19:55:58.938 INFO:teuthology.orchestra.run.smithi008.stdout: "time": "2023-08-01T19:55:05.565862+0000", 2023-08-01T19:55:58.938 INFO:teuthology.orchestra.run.smithi008.stdout: "duration": 7.4549999999999998e-06 2023-08-01T19:55:58.939 INFO:teuthology.orchestra.run.smithi008.stdout: }, 2023-08-01T19:55:58.939 INFO:teuthology.orchestra.run.smithi008.stdout: { 2023-08-01T19:55:58.939 INFO:teuthology.orchestra.run.smithi008.stdout: "event": "queued_for_pg", 2023-08-01T19:55:58.939 INFO:teuthology.orchestra.run.smithi008.stdout: "time": "2023-08-01T19:55:05.565866+0000", 2023-08-01T19:55:58.939 INFO:teuthology.orchestra.run.smithi008.stdout: "duration": 3.8060000000000001e-06 2023-08-01T19:55:58.939 INFO:teuthology.orchestra.run.smithi008.stdout: }, 2023-08-01T19:55:58.939 INFO:teuthology.orchestra.run.smithi008.stdout: { 2023-08-01T19:55:58.939 INFO:teuthology.orchestra.run.smithi008.stdout: "event": "reached_pg", 2023-08-01T19:55:58.940 INFO:teuthology.orchestra.run.smithi008.stdout: "time": "2023-08-01T19:55:05.565901+0000", 2023-08-01T19:55:58.940 INFO:teuthology.orchestra.run.smithi008.stdout: "duration": 3.5063e-05 2023-08-01T19:55:58.940 INFO:teuthology.orchestra.run.smithi008.stdout: }, 2023-08-01T19:55:58.940 INFO:teuthology.orchestra.run.smithi008.stdout: { 2023-08-01T19:55:58.940 INFO:teuthology.orchestra.run.smithi008.stdout: "event": "started", 2023-08-01T19:55:58.940 INFO:teuthology.orchestra.run.smithi008.stdout: "time": "2023-08-01T19:55:05.566016+0000", 2023-08-01T19:55:58.940 INFO:teuthology.orchestra.run.smithi008.stdout: "duration": 0.00011509400000000001 2023-08-01T19:55:58.940 INFO:teuthology.orchestra.run.smithi008.stdout: }, 2023-08-01T19:55:58.941 INFO:teuthology.orchestra.run.smithi008.stdout: { 2023-08-01T19:55:58.941 INFO:teuthology.orchestra.run.smithi008.stdout: "event": "waiting for subops from 1", 2023-08-01T19:55:58.941 INFO:teuthology.orchestra.run.smithi008.stdout: "time": "2023-08-01T19:55:05.566154+0000", 2023-08-01T19:55:58.941 INFO:teuthology.orchestra.run.smithi008.stdout: "duration": 0.000138052 2023-08-01T19:55:58.941 INFO:teuthology.orchestra.run.smithi008.stdout: }, 2023-08-01T19:55:58.941 INFO:teuthology.orchestra.run.smithi008.stdout: { 2023-08-01T19:55:58.941 INFO:teuthology.orchestra.run.smithi008.stdout: "event": "sub_op_commit_rec", 2023-08-01T19:55:58.942 INFO:teuthology.orchestra.run.smithi008.stdout: "time": "2023-08-01T19:55:05.629279+0000", 2023-08-01T19:55:58.942 INFO:teuthology.orchestra.run.smithi008.stdout: "duration": 0.063124531999999997 2023-08-01T19:55:58.942 INFO:teuthology.orchestra.run.smithi008.stdout: }, 2023-08-01T19:55:58.942 INFO:teuthology.orchestra.run.smithi008.stdout: { 2023-08-01T19:55:58.942 INFO:teuthology.orchestra.run.smithi008.stdout: "event": "op_commit", 2023-08-01T19:55:58.942 INFO:teuthology.orchestra.run.smithi008.stdout: "time": "2023-08-01T19:55:05.629333+0000", 2023-08-01T19:55:58.942 INFO:teuthology.orchestra.run.smithi008.stdout: "duration": 5.4694999999999997e-05 2023-08-01T19:55:58.942 INFO:teuthology.orchestra.run.smithi008.stdout: }, 2023-08-01T19:55:58.943 INFO:teuthology.orchestra.run.smithi008.stdout: { 2023-08-01T19:55:58.943 INFO:teuthology.orchestra.run.smithi008.stdout: "event": "commit_sent", 2023-08-01T19:55:58.943 INFO:teuthology.orchestra.run.smithi008.stdout: "time": "2023-08-01T19:55:05.629390+0000", 2023-08-01T19:55:58.943 INFO:teuthology.orchestra.run.smithi008.stdout: "duration": 5.6416000000000003e-05 2023-08-01T19:55:58.943 INFO:teuthology.orchestra.run.smithi008.stdout: }, 2023-08-01T19:55:58.943 INFO:teuthology.orchestra.run.smithi008.stdout: { 2023-08-01T19:55:58.943 INFO:teuthology.orchestra.run.smithi008.stdout: "event": "done", 2023-08-01T19:55:58.943 INFO:teuthology.orchestra.run.smithi008.stdout: "time": "2023-08-01T19:55:05.629435+0000", 2023-08-01T19:55:58.944 INFO:teuthology.orchestra.run.smithi008.stdout: "duration": 4.5170999999999998e-05 2023-08-01T19:55:58.944 INFO:teuthology.orchestra.run.smithi008.stdout: } 2023-08-01T19:55:58.944 INFO:teuthology.orchestra.run.smithi008.stdout: ] 2023-08-01T19:55:58.944 INFO:teuthology.orchestra.run.smithi008.stdout: } 2023-08-01T19:55:58.944 INFO:teuthology.orchestra.run.smithi008.stdout: }, 2023-08-01T19:55:58.944 INFO:teuthology.orchestra.run.smithi008.stdout: { 2023-08-01T19:55:58.944 INFO:teuthology.orchestra.run.smithi008.stdout: "description": "osd_op(client.4668.0:100933 5.5 5:af92e9f2:::benchmark_data_smithi006_114134_object100932:head [set-alloc-hint object_size 65536 write_size 65536,write 0~65536] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e37)", 2023-08-01T19:55:58.944 INFO:teuthology.orchestra.run.smithi008.stdout: "initiated_at": "2023-08-01T19:55:05.566634+0000", 2023-08-01T19:55:58.945 INFO:teuthology.orchestra.run.smithi008.stdout: "age": 53.294453408000003, 2023-08-01T19:55:58.945 INFO:teuthology.orchestra.run.smithi008.stdout: "duration": 0.065909364999999998, 2023-08-01T19:55:58.945 INFO:teuthology.orchestra.run.smithi008.stdout: "type_data": { 2023-08-01T19:55:58.945 INFO:teuthology.orchestra.run.smithi008.stdout: "flag_point": "commit sent; apply or cleanup", 2023-08-01T19:55:58.945 INFO:teuthology.orchestra.run.smithi008.stdout: "client_info": { 2023-08-01T19:55:58.945 INFO:teuthology.orchestra.run.smithi008.stdout: "client": "client.4668", 2023-08-01T19:55:58.945 INFO:teuthology.orchestra.run.smithi008.stdout: "client_addr": "172.21.15.6:0/1709472247", 2023-08-01T19:55:58.945 INFO:teuthology.orchestra.run.smithi008.stdout: "tid": 100933 2023-08-01T19:55:58.946 INFO:teuthology.orchestra.run.smithi008.stdout: }, 2023-08-01T19:55:58.946 INFO:teuthology.orchestra.run.smithi008.stdout: "events": [ 2023-08-01T19:55:58.946 INFO:teuthology.orchestra.run.smithi008.stdout: { 2023-08-01T19:55:58.946 INFO:teuthology.orchestra.run.smithi008.stdout: "event": "initiated", 2023-08-01T19:55:58.946 INFO:teuthology.orchestra.run.smithi008.stdout: "time": "2023-08-01T19:55:05.566634+0000", 2023-08-01T19:55:58.946 INFO:teuthology.orchestra.run.smithi008.stdout: "duration": 0 2023-08-01T19:55:58.946 INFO:teuthology.orchestra.run.smithi008.stdout: }, 2023-08-01T19:55:58.947 INFO:teuthology.orchestra.run.smithi008.stdout: { 2023-08-01T19:55:58.947 INFO:teuthology.orchestra.run.smithi008.stdout: "event": "throttled", 2023-08-01T19:55:58.947 INFO:teuthology.orchestra.run.smithi008.stdout: "time": "2023-08-01T19:55:05.566634+0000", 2023-08-01T19:55:58.947 INFO:teuthology.orchestra.run.smithi008.stdout: "duration": 0 2023-08-01T19:55:58.947 INFO:teuthology.orchestra.run.smithi008.stdout: }, 2023-08-01T19:55:58.947 INFO:teuthology.orchestra.run.smithi008.stdout: { 2023-08-01T19:55:58.947 INFO:teuthology.orchestra.run.smithi008.stdout: "event": "header_read", 2023-08-01T19:55:58.947 INFO:teuthology.orchestra.run.smithi008.stdout: "time": "2023-08-01T19:55:05.566630+0000", 2023-08-01T19:55:58.948 INFO:teuthology.orchestra.run.smithi008.stdout: "duration": 4294967295.9999962 2023-08-01T19:55:58.948 INFO:teuthology.orchestra.run.smithi008.stdout: }, 2023-08-01T19:55:58.948 INFO:teuthology.orchestra.run.smithi008.stdout: { 2023-08-01T19:55:58.948 INFO:teuthology.orchestra.run.smithi008.stdout: "event": "all_read", 2023-08-01T19:55:58.948 INFO:teuthology.orchestra.run.smithi008.stdout: "time": "2023-08-01T19:55:05.566736+0000", 2023-08-01T19:55:58.948 INFO:teuthology.orchestra.run.smithi008.stdout: "duration": 0.000105752 2023-08-01T19:55:58.948 INFO:teuthology.orchestra.run.smithi008.stdout: }, 2023-08-01T19:55:58.948 INFO:teuthology.orchestra.run.smithi008.stdout: { 2023-08-01T19:55:58.949 INFO:teuthology.orchestra.run.smithi008.stdout: "event": "dispatched", 2023-08-01T19:55:58.949 INFO:teuthology.orchestra.run.smithi008.stdout: "time": "2023-08-01T19:55:05.566742+0000", 2023-08-01T19:55:58.949 INFO:teuthology.orchestra.run.smithi008.stdout: "duration": 5.8209999999999998e-06 2023-08-01T19:55:58.949 INFO:teuthology.orchestra.run.smithi008.stdout: }, 2023-08-01T19:55:58.949 INFO:teuthology.orchestra.run.smithi008.stdout: { 2023-08-01T19:55:58.949 INFO:teuthology.orchestra.run.smithi008.stdout: "event": "queued_for_pg", 2023-08-01T19:55:58.949 INFO:teuthology.orchestra.run.smithi008.stdout: "time": "2023-08-01T19:55:05.566745+0000", 2023-08-01T19:55:58.949 INFO:teuthology.orchestra.run.smithi008.stdout: "duration": 3.337e-06 2023-08-01T19:55:58.950 INFO:teuthology.orchestra.run.smithi008.stdout: }, 2023-08-01T19:55:58.950 INFO:teuthology.orchestra.run.smithi008.stdout: { 2023-08-01T19:55:58.950 INFO:teuthology.orchestra.run.smithi008.stdout: "event": "reached_pg", 2023-08-01T19:55:58.950 INFO:teuthology.orchestra.run.smithi008.stdout: "time": "2023-08-01T19:55:05.568175+0000", 2023-08-01T19:55:58.950 INFO:teuthology.orchestra.run.smithi008.stdout: "duration": 0.001429647 2023-08-01T19:55:58.950 INFO:teuthology.orchestra.run.smithi008.stdout: }, 2023-08-01T19:55:58.950 INFO:teuthology.orchestra.run.smithi008.stdout: { 2023-08-01T19:55:58.951 INFO:teuthology.orchestra.run.smithi008.stdout: "event": "started", 2023-08-01T19:55:58.951 INFO:teuthology.orchestra.run.smithi008.stdout: "time": "2023-08-01T19:55:05.568288+0000", 2023-08-01T19:55:58.951 INFO:teuthology.orchestra.run.smithi008.stdout: "duration": 0.000113353 2023-08-01T19:55:58.951 INFO:teuthology.orchestra.run.smithi008.stdout: }, 2023-08-01T19:55:58.951 INFO:teuthology.orchestra.run.smithi008.stdout: { 2023-08-01T19:55:58.951 INFO:teuthology.orchestra.run.smithi008.stdout: "event": "waiting for subops from 1", 2023-08-01T19:55:58.951 INFO:teuthology.orchestra.run.smithi008.stdout: "time": "2023-08-01T19:55:05.568425+0000", 2023-08-01T19:55:58.951 INFO:teuthology.orchestra.run.smithi008.stdout: "duration": 0.000137346 2023-08-01T19:55:58.952 INFO:teuthology.orchestra.run.smithi008.stdout: }, 2023-08-01T19:55:58.952 INFO:teuthology.orchestra.run.smithi008.stdout: { 2023-08-01T19:55:58.952 INFO:teuthology.orchestra.run.smithi008.stdout: "event": "sub_op_commit_rec", 2023-08-01T19:55:58.952 INFO:teuthology.orchestra.run.smithi008.stdout: "time": "2023-08-01T19:55:05.629320+0000", 2023-08-01T19:55:58.952 INFO:teuthology.orchestra.run.smithi008.stdout: "duration": 0.060894491000000002 2023-08-01T19:55:58.952 INFO:teuthology.orchestra.run.smithi008.stdout: }, 2023-08-01T19:55:58.952 INFO:teuthology.orchestra.run.smithi008.stdout: { 2023-08-01T19:55:58.952 INFO:teuthology.orchestra.run.smithi008.stdout: "event": "op_commit", 2023-08-01T19:55:58.953 INFO:teuthology.orchestra.run.smithi008.stdout: "time": "2023-08-01T19:55:05.632452+0000", 2023-08-01T19:55:58.953 INFO:teuthology.orchestra.run.smithi008.stdout: "duration": 0.003131909 2023-08-01T19:55:58.953 INFO:teuthology.orchestra.run.smithi008.stdout: }, 2023-08-01T19:55:58.953 INFO:teuthology.orchestra.run.smithi008.stdout: { 2023-08-01T19:55:58.953 INFO:teuthology.orchestra.run.smithi008.stdout: "event": "commit_sent", 2023-08-01T19:55:58.953 INFO:teuthology.orchestra.run.smithi008.stdout: "time": "2023-08-01T19:55:05.632503+0000", 2023-08-01T19:55:58.953 INFO:teuthology.orchestra.run.smithi008.stdout: "duration": 5.1295000000000003e-05 2023-08-01T19:55:58.954 INFO:teuthology.orchestra.run.smithi008.stdout: }, 2023-08-01T19:55:58.954 INFO:teuthology.orchestra.run.smithi008.stdout: { 2023-08-01T19:55:58.954 INFO:teuthology.orchestra.run.smithi008.stdout: "event": "done", 2023-08-01T19:55:58.954 INFO:teuthology.orchestra.run.smithi008.stdout: "time": "2023-08-01T19:55:05.632543+0000", 2023-08-01T19:55:58.955 INFO:teuthology.orchestra.run.smithi008.stdout: "duration": 4.0234000000000001e-05 2023-08-01T19:55:58.955 INFO:teuthology.orchestra.run.smithi008.stdout: } 2023-08-01T19:55:58.955 INFO:teuthology.orchestra.run.smithi008.stdout: ] 2023-08-01T19:55:58.955 INFO:teuthology.orchestra.run.smithi008.stdout: } 2023-08-01T19:55:58.955 INFO:teuthology.orchestra.run.smithi008.stdout: }, 2023-08-01T19:55:58.955 INFO:teuthology.orchestra.run.smithi008.stdout: { 2023-08-01T19:55:58.955 INFO:teuthology.orchestra.run.smithi008.stdout: "description": "osd_repop(client.4668.0:100935 5.e e37/19 5:7895b14e:::benchmark_data_smithi006_114134_object100934:head v 37'6305, mlcod=37'6303)", 2023-08-01T19:55:58.955 INFO:teuthology.orchestra.run.smithi008.stdout: "initiated_at": "2023-08-01T19:55:05.567118+0000", 2023-08-01T19:55:58.956 INFO:teuthology.orchestra.run.smithi008.stdout: "age": 53.293969165, 2023-08-01T19:55:58.956 INFO:teuthology.orchestra.run.smithi008.stdout: "duration": 0.063691180999999999, 2023-08-01T19:55:58.956 INFO:teuthology.orchestra.run.smithi008.stdout: "type_data": { 2023-08-01T19:55:58.956 INFO:teuthology.orchestra.run.smithi008.stdout: "flag_point": "commit sent; apply or cleanup", 2023-08-01T19:55:58.957 INFO:teuthology.orchestra.run.smithi008.stdout: "events": [ 2023-08-01T19:55:58.957 INFO:teuthology.orchestra.run.smithi008.stdout: { 2023-08-01T19:55:58.957 INFO:teuthology.orchestra.run.smithi008.stdout: "event": "initiated", 2023-08-01T19:55:58.957 INFO:teuthology.orchestra.run.smithi008.stdout: "time": "2023-08-01T19:55:05.567118+0000", 2023-08-01T19:55:58.958 INFO:teuthology.orchestra.run.smithi008.stdout: "duration": 0 2023-08-01T19:55:58.958 INFO:teuthology.orchestra.run.smithi008.stdout: }, 2023-08-01T19:55:58.958 INFO:teuthology.orchestra.run.smithi008.stdout: { 2023-08-01T19:55:58.958 INFO:teuthology.orchestra.run.smithi008.stdout: "event": "throttled", 2023-08-01T19:55:58.959 INFO:teuthology.orchestra.run.smithi008.stdout: "time": "2023-08-01T19:55:05.567118+0000", 2023-08-01T19:55:58.959 INFO:teuthology.orchestra.run.smithi008.stdout: "duration": 0 2023-08-01T19:55:58.959 INFO:teuthology.orchestra.run.smithi008.stdout: }, 2023-08-01T19:55:58.959 INFO:teuthology.orchestra.run.smithi008.stdout: { 2023-08-01T19:55:58.959 INFO:teuthology.orchestra.run.smithi008.stdout: "event": "header_read", 2023-08-01T19:55:58.959 INFO:teuthology.orchestra.run.smithi008.stdout: "time": "2023-08-01T19:55:05.567117+0000", 2023-08-01T19:55:58.960 INFO:teuthology.orchestra.run.smithi008.stdout: "duration": 4294967295.999999 2023-08-01T19:55:58.960 INFO:teuthology.orchestra.run.smithi008.stdout: }, 2023-08-01T19:55:58.960 INFO:teuthology.orchestra.run.smithi008.stdout: { 2023-08-01T19:55:58.960 INFO:teuthology.orchestra.run.smithi008.stdout: "event": "all_read", 2023-08-01T19:55:58.961 INFO:teuthology.orchestra.run.smithi008.stdout: "time": "2023-08-01T19:55:05.567168+0000", 2023-08-01T19:55:58.961 INFO:teuthology.orchestra.run.smithi008.stdout: "duration": 5.0353999999999999e-05 2023-08-01T19:55:58.961 INFO:teuthology.orchestra.run.smithi008.stdout: }, 2023-08-01T19:55:58.961 INFO:teuthology.orchestra.run.smithi008.stdout: { 2023-08-01T19:55:58.961 INFO:teuthology.orchestra.run.smithi008.stdout: "event": "dispatched", 2023-08-01T19:55:58.961 INFO:teuthology.orchestra.run.smithi008.stdout: "time": "2023-08-01T19:55:05.567175+0000", 2023-08-01T19:55:58.961 INFO:teuthology.orchestra.run.smithi008.stdout: "duration": 7.3919999999999997e-06 2023-08-01T19:55:58.962 INFO:teuthology.orchestra.run.smithi008.stdout: }, 2023-08-01T19:55:58.962 INFO:teuthology.orchestra.run.smithi008.stdout: { 2023-08-01T19:55:58.962 INFO:teuthology.orchestra.run.smithi008.stdout: "event": "queued_for_pg", 2023-08-01T19:55:58.962 INFO:teuthology.orchestra.run.smithi008.stdout: "time": "2023-08-01T19:55:05.567180+0000", 2023-08-01T19:55:58.962 INFO:teuthology.orchestra.run.smithi008.stdout: "duration": 5.3090000000000003e-06 2023-08-01T19:55:58.962 INFO:teuthology.orchestra.run.smithi008.stdout: }, 2023-08-01T19:55:58.962 INFO:teuthology.orchestra.run.smithi008.stdout: { 2023-08-01T19:55:58.963 INFO:teuthology.orchestra.run.smithi008.stdout: "event": "reached_pg", 2023-08-01T19:55:58.963 INFO:teuthology.orchestra.run.smithi008.stdout: "time": "2023-08-01T19:55:05.567210+0000", 2023-08-01T19:55:58.963 INFO:teuthology.orchestra.run.smithi008.stdout: "duration": 3.0001999999999998e-05 2023-08-01T19:55:58.963 INFO:teuthology.orchestra.run.smithi008.stdout: }, 2023-08-01T19:55:58.963 INFO:teuthology.orchestra.run.smithi008.stdout: { 2023-08-01T19:55:58.963 INFO:teuthology.orchestra.run.smithi008.stdout: "event": "started", 2023-08-01T19:55:58.963 INFO:teuthology.orchestra.run.smithi008.stdout: "time": "2023-08-01T19:55:05.567222+0000", 2023-08-01T19:55:58.963 INFO:teuthology.orchestra.run.smithi008.stdout: "duration": 1.1499e-05 2023-08-01T19:55:58.964 INFO:teuthology.orchestra.run.smithi008.stdout: }, 2023-08-01T19:55:58.964 INFO:teuthology.orchestra.run.smithi008.stdout: { 2023-08-01T19:55:58.964 INFO:teuthology.orchestra.run.smithi008.stdout: "event": "commit_sent", 2023-08-01T19:55:58.964 INFO:teuthology.orchestra.run.smithi008.stdout: "time": "2023-08-01T19:55:05.630772+0000", 2023-08-01T19:55:58.964 INFO:teuthology.orchestra.run.smithi008.stdout: "duration": 0.063550572999999999 2023-08-01T19:55:58.964 INFO:teuthology.orchestra.run.smithi008.stdout: }, 2023-08-01T19:55:58.964 INFO:teuthology.orchestra.run.smithi008.stdout: { 2023-08-01T19:55:58.964 INFO:teuthology.orchestra.run.smithi008.stdout: "event": "done", 2023-08-01T19:55:58.965 INFO:teuthology.orchestra.run.smithi008.stdout: "time": "2023-08-01T19:55:05.630809+0000", 2023-08-01T19:55:58.965 INFO:teuthology.orchestra.run.smithi008.stdout: "duration": 3.7033000000000003e-05 2023-08-01T19:55:58.965 INFO:teuthology.orchestra.run.smithi008.stdout: } 2023-08-01T19:55:58.965 INFO:teuthology.orchestra.run.smithi008.stdout: ] 2023-08-01T19:55:58.965 INFO:teuthology.orchestra.run.smithi008.stdout: } 2023-08-01T19:55:58.965 INFO:teuthology.orchestra.run.smithi008.stdout: }, 2023-08-01T19:55:58.965 INFO:teuthology.orchestra.run.smithi008.stdout: { 2023-08-01T19:55:58.965 INFO:teuthology.orchestra.run.smithi008.stdout: "description": "osd_repop(client.4668.0:100936 5.1 e37/19 5:8f4e3576:::benchmark_data_smithi006_114134_object100935:head v 37'6263, mlcod=37'6261)", 2023-08-01T19:55:58.966 INFO:teuthology.orchestra.run.smithi008.stdout: "initiated_at": "2023-08-01T19:55:05.567617+0000", 2023-08-01T19:55:58.966 INFO:teuthology.orchestra.run.smithi008.stdout: "age": 53.293469901999998, 2023-08-01T19:55:58.966 INFO:teuthology.orchestra.run.smithi008.stdout: "duration": 0.062773918999999997, 2023-08-01T19:55:58.966 INFO:teuthology.orchestra.run.smithi008.stdout: "type_data": { 2023-08-01T19:55:58.966 INFO:teuthology.orchestra.run.smithi008.stdout: "flag_point": "commit sent; apply or cleanup", 2023-08-01T19:55:58.966 INFO:teuthology.orchestra.run.smithi008.stdout: "events": [ 2023-08-01T19:55:58.966 INFO:teuthology.orchestra.run.smithi008.stdout: { 2023-08-01T19:55:58.967 INFO:teuthology.orchestra.run.smithi008.stdout: "event": "initiated", 2023-08-01T19:55:58.967 INFO:teuthology.orchestra.run.smithi008.stdout: "time": "2023-08-01T19:55:05.567617+0000", 2023-08-01T19:55:58.967 INFO:teuthology.orchestra.run.smithi008.stdout: "duration": 0 2023-08-01T19:55:58.967 INFO:teuthology.orchestra.run.smithi008.stdout: }, 2023-08-01T19:55:58.967 INFO:teuthology.orchestra.run.smithi008.stdout: { 2023-08-01T19:55:58.967 INFO:teuthology.orchestra.run.smithi008.stdout: "event": "throttled", 2023-08-01T19:55:58.967 INFO:teuthology.orchestra.run.smithi008.stdout: "time": "2023-08-01T19:55:05.567617+0000", 2023-08-01T19:55:58.967 INFO:teuthology.orchestra.run.smithi008.stdout: "duration": 0 2023-08-01T19:55:58.968 INFO:teuthology.orchestra.run.smithi008.stdout: }, 2023-08-01T19:55:58.968 INFO:teuthology.orchestra.run.smithi008.stdout: { 2023-08-01T19:55:58.968 INFO:teuthology.orchestra.run.smithi008.stdout: "event": "header_read", 2023-08-01T19:55:58.968 INFO:teuthology.orchestra.run.smithi008.stdout: "time": "2023-08-01T19:55:05.567617+0000", 2023-08-01T19:55:58.968 INFO:teuthology.orchestra.run.smithi008.stdout: "duration": 4294967295.9999995 2023-08-01T19:55:58.968 INFO:teuthology.orchestra.run.smithi008.stdout: }, 2023-08-01T19:55:58.968 INFO:teuthology.orchestra.run.smithi008.stdout: { 2023-08-01T19:55:58.969 INFO:teuthology.orchestra.run.smithi008.stdout: "event": "all_read", 2023-08-01T19:55:58.969 INFO:teuthology.orchestra.run.smithi008.stdout: "time": "2023-08-01T19:55:05.567700+0000", 2023-08-01T19:55:58.969 INFO:teuthology.orchestra.run.smithi008.stdout: "duration": 8.3363999999999997e-05 2023-08-01T19:55:58.969 INFO:teuthology.orchestra.run.smithi008.stdout: }, 2023-08-01T19:55:58.969 INFO:teuthology.orchestra.run.smithi008.stdout: { 2023-08-01T19:55:58.969 INFO:teuthology.orchestra.run.smithi008.stdout: "event": "dispatched", 2023-08-01T19:55:58.969 INFO:teuthology.orchestra.run.smithi008.stdout: "time": "2023-08-01T19:55:05.567706+0000", 2023-08-01T19:55:58.969 INFO:teuthology.orchestra.run.smithi008.stdout: "duration": 5.9739999999999999e-06 2023-08-01T19:55:58.970 INFO:teuthology.orchestra.run.smithi008.stdout: }, 2023-08-01T19:55:58.970 INFO:teuthology.orchestra.run.smithi008.stdout: { 2023-08-01T19:55:58.970 INFO:teuthology.orchestra.run.smithi008.stdout: "event": "queued_for_pg", 2023-08-01T19:55:58.970 INFO:teuthology.orchestra.run.smithi008.stdout: "time": "2023-08-01T19:55:05.567709+0000", 2023-08-01T19:55:58.970 INFO:teuthology.orchestra.run.smithi008.stdout: "duration": 3.1420000000000002e-06 2023-08-01T19:55:58.970 INFO:teuthology.orchestra.run.smithi008.stdout: }, 2023-08-01T19:55:58.970 INFO:teuthology.orchestra.run.smithi008.stdout: { 2023-08-01T19:55:58.970 INFO:teuthology.orchestra.run.smithi008.stdout: "event": "reached_pg", 2023-08-01T19:55:58.971 INFO:teuthology.orchestra.run.smithi008.stdout: "time": "2023-08-01T19:55:05.567741+0000", 2023-08-01T19:55:58.971 INFO:teuthology.orchestra.run.smithi008.stdout: "duration": 3.1532999999999998e-05 2023-08-01T19:55:58.971 INFO:teuthology.orchestra.run.smithi008.stdout: }, 2023-08-01T19:55:58.971 INFO:teuthology.orchestra.run.smithi008.stdout: { 2023-08-01T19:55:58.971 INFO:teuthology.orchestra.run.smithi008.stdout: "event": "started", 2023-08-01T19:55:58.971 INFO:teuthology.orchestra.run.smithi008.stdout: "time": "2023-08-01T19:55:05.567752+0000", 2023-08-01T19:55:58.971 INFO:teuthology.orchestra.run.smithi008.stdout: "duration": 1.1266e-05 2023-08-01T19:55:58.971 INFO:teuthology.orchestra.run.smithi008.stdout: }, 2023-08-01T19:55:58.972 INFO:teuthology.orchestra.run.smithi008.stdout: { 2023-08-01T19:55:58.972 INFO:teuthology.orchestra.run.smithi008.stdout: "event": "commit_sent", 2023-08-01T19:55:58.972 INFO:teuthology.orchestra.run.smithi008.stdout: "time": "2023-08-01T19:55:05.630357+0000", 2023-08-01T19:55:58.972 INFO:teuthology.orchestra.run.smithi008.stdout: "duration": 0.062604554000000007 2023-08-01T19:55:58.972 INFO:teuthology.orchestra.run.smithi008.stdout: }, 2023-08-01T19:55:58.972 INFO:teuthology.orchestra.run.smithi008.stdout: { 2023-08-01T19:55:58.972 INFO:teuthology.orchestra.run.smithi008.stdout: "event": "done", 2023-08-01T19:55:58.973 INFO:teuthology.orchestra.run.smithi008.stdout: "time": "2023-08-01T19:55:05.630391+0000", 2023-08-01T19:55:58.973 INFO:teuthology.orchestra.run.smithi008.stdout: "duration": 3.4619000000000002e-05 2023-08-01T19:55:58.973 INFO:teuthology.orchestra.run.smithi008.stdout: } 2023-08-01T19:55:58.973 INFO:teuthology.orchestra.run.smithi008.stdout: ] 2023-08-01T19:55:58.973 INFO:teuthology.orchestra.run.smithi008.stdout: } 2023-08-01T19:55:58.973 INFO:teuthology.orchestra.run.smithi008.stdout: }, 2023-08-01T19:55:58.973 INFO:teuthology.orchestra.run.smithi008.stdout: { 2023-08-01T19:55:58.973 INFO:teuthology.orchestra.run.smithi008.stdout: "description": "osd_op(client.4668.0:100937 5.c 5:34445fc3:::benchmark_data_smithi006_114134_object100936:head [set-alloc-hint object_size 65536 write_size 65536,write 0~65536] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e37)", 2023-08-01T19:55:58.974 INFO:teuthology.orchestra.run.smithi008.stdout: "initiated_at": "2023-08-01T19:55:05.569198+0000", 2023-08-01T19:55:58.974 INFO:teuthology.orchestra.run.smithi008.stdout: "age": 53.291889279000003, 2023-08-01T19:55:58.974 INFO:teuthology.orchestra.run.smithi008.stdout: "duration": 0.063349390000000005, 2023-08-01T19:55:58.974 INFO:teuthology.orchestra.run.smithi008.stdout: "type_data": { 2023-08-01T19:55:58.974 INFO:teuthology.orchestra.run.smithi008.stdout: "flag_point": "commit sent; apply or cleanup", 2023-08-01T19:55:58.974 INFO:teuthology.orchestra.run.smithi008.stdout: "client_info": { 2023-08-01T19:55:58.974 INFO:teuthology.orchestra.run.smithi008.stdout: "client": "client.4668", 2023-08-01T19:55:58.974 INFO:teuthology.orchestra.run.smithi008.stdout: "client_addr": "172.21.15.6:0/1709472247", 2023-08-01T19:55:58.975 INFO:teuthology.orchestra.run.smithi008.stdout: "tid": 100937 2023-08-01T19:55:58.975 INFO:teuthology.orchestra.run.smithi008.stdout: }, 2023-08-01T19:55:58.975 INFO:teuthology.orchestra.run.smithi008.stdout: "events": [ 2023-08-01T19:55:58.975 INFO:teuthology.orchestra.run.smithi008.stdout: { 2023-08-01T19:55:58.975 INFO:teuthology.orchestra.run.smithi008.stdout: "event": "initiated", 2023-08-01T19:55:58.975 INFO:teuthology.orchestra.run.smithi008.stdout: "time": "2023-08-01T19:55:05.569198+0000", 2023-08-01T19:55:58.975 INFO:teuthology.orchestra.run.smithi008.stdout: "duration": 0 2023-08-01T19:55:58.975 INFO:teuthology.orchestra.run.smithi008.stdout: }, 2023-08-01T19:55:58.976 INFO:teuthology.orchestra.run.smithi008.stdout: { 2023-08-01T19:55:58.976 INFO:teuthology.orchestra.run.smithi008.stdout: "event": "throttled", 2023-08-01T19:55:58.976 INFO:teuthology.orchestra.run.smithi008.stdout: "time": "2023-08-01T19:55:05.569198+0000", 2023-08-01T19:55:58.976 INFO:teuthology.orchestra.run.smithi008.stdout: "duration": 0 2023-08-01T19:55:58.976 INFO:teuthology.orchestra.run.smithi008.stdout: }, 2023-08-01T19:55:58.976 INFO:teuthology.orchestra.run.smithi008.stdout: { 2023-08-01T19:55:58.976 INFO:teuthology.orchestra.run.smithi008.stdout: "event": "header_read", 2023-08-01T19:55:58.977 INFO:teuthology.orchestra.run.smithi008.stdout: "time": "2023-08-01T19:55:05.569197+0000", 2023-08-01T19:55:58.977 INFO:teuthology.orchestra.run.smithi008.stdout: "duration": 4294967295.999999 2023-08-01T19:55:58.977 INFO:teuthology.orchestra.run.smithi008.stdout: }, 2023-08-01T19:55:58.977 INFO:teuthology.orchestra.run.smithi008.stdout: { 2023-08-01T19:55:58.977 INFO:teuthology.orchestra.run.smithi008.stdout: "event": "all_read", 2023-08-01T19:55:58.977 INFO:teuthology.orchestra.run.smithi008.stdout: "time": "2023-08-01T19:55:05.569250+0000", 2023-08-01T19:55:58.977 INFO:teuthology.orchestra.run.smithi008.stdout: "duration": 5.3106000000000003e-05 2023-08-01T19:55:58.977 INFO:teuthology.orchestra.run.smithi008.stdout: }, 2023-08-01T19:55:58.978 INFO:teuthology.orchestra.run.smithi008.stdout: { 2023-08-01T19:55:58.978 INFO:teuthology.orchestra.run.smithi008.stdout: "event": "dispatched", 2023-08-01T19:55:58.978 INFO:teuthology.orchestra.run.smithi008.stdout: "time": "2023-08-01T19:55:05.569260+0000", 2023-08-01T19:55:58.978 INFO:teuthology.orchestra.run.smithi008.stdout: "duration": 9.533e-06 2023-08-01T19:55:58.978 INFO:teuthology.orchestra.run.smithi008.stdout: }, 2023-08-01T19:55:58.978 INFO:teuthology.orchestra.run.smithi008.stdout: { 2023-08-01T19:55:58.978 INFO:teuthology.orchestra.run.smithi008.stdout: "event": "queued_for_pg", 2023-08-01T19:55:58.979 INFO:teuthology.orchestra.run.smithi008.stdout: "time": "2023-08-01T19:55:05.569264+0000", 2023-08-01T19:55:58.979 INFO:teuthology.orchestra.run.smithi008.stdout: "duration": 4.6099999999999999e-06 2023-08-01T19:55:58.979 INFO:teuthology.orchestra.run.smithi008.stdout: }, 2023-08-01T19:55:58.979 INFO:teuthology.orchestra.run.smithi008.stdout: { 2023-08-01T19:55:58.979 INFO:teuthology.orchestra.run.smithi008.stdout: "event": "reached_pg", 2023-08-01T19:55:58.979 INFO:teuthology.orchestra.run.smithi008.stdout: "time": "2023-08-01T19:55:05.569293+0000", 2023-08-01T19:55:58.979 INFO:teuthology.orchestra.run.smithi008.stdout: "duration": 2.8181999999999999e-05 2023-08-01T19:55:58.979 INFO:teuthology.orchestra.run.smithi008.stdout: }, 2023-08-01T19:55:58.980 INFO:teuthology.orchestra.run.smithi008.stdout: { 2023-08-01T19:55:58.980 INFO:teuthology.orchestra.run.smithi008.stdout: "event": "started", 2023-08-01T19:55:58.980 INFO:teuthology.orchestra.run.smithi008.stdout: "time": "2023-08-01T19:55:05.569401+0000", 2023-08-01T19:55:58.980 INFO:teuthology.orchestra.run.smithi008.stdout: "duration": 0.000108065 2023-08-01T19:55:58.980 INFO:teuthology.orchestra.run.smithi008.stdout: }, 2023-08-01T19:55:58.980 INFO:teuthology.orchestra.run.smithi008.stdout: { 2023-08-01T19:55:58.980 INFO:teuthology.orchestra.run.smithi008.stdout: "event": "waiting for subops from 1", 2023-08-01T19:55:58.981 INFO:teuthology.orchestra.run.smithi008.stdout: "time": "2023-08-01T19:55:05.569521+0000", 2023-08-01T19:55:58.981 INFO:teuthology.orchestra.run.smithi008.stdout: "duration": 0.00012006900000000001 2023-08-01T19:55:58.981 INFO:teuthology.orchestra.run.smithi008.stdout: }, 2023-08-01T19:55:58.981 INFO:teuthology.orchestra.run.smithi008.stdout: { 2023-08-01T19:55:58.981 INFO:teuthology.orchestra.run.smithi008.stdout: "event": "sub_op_commit_rec", 2023-08-01T19:55:58.981 INFO:teuthology.orchestra.run.smithi008.stdout: "time": "2023-08-01T19:55:05.629421+0000", 2023-08-01T19:55:58.981 INFO:teuthology.orchestra.run.smithi008.stdout: "duration": 0.059900525000000003 2023-08-01T19:55:58.981 INFO:teuthology.orchestra.run.smithi008.stdout: }, 2023-08-01T19:55:58.982 INFO:teuthology.orchestra.run.smithi008.stdout: { 2023-08-01T19:55:58.982 INFO:teuthology.orchestra.run.smithi008.stdout: "event": "op_commit", 2023-08-01T19:55:58.982 INFO:teuthology.orchestra.run.smithi008.stdout: "time": "2023-08-01T19:55:05.632461+0000", 2023-08-01T19:55:58.982 INFO:teuthology.orchestra.run.smithi008.stdout: "duration": 0.0030401220000000001 2023-08-01T19:55:58.982 INFO:teuthology.orchestra.run.smithi008.stdout: }, 2023-08-01T19:55:58.982 INFO:teuthology.orchestra.run.smithi008.stdout: { 2023-08-01T19:55:58.982 INFO:teuthology.orchestra.run.smithi008.stdout: "event": "commit_sent", 2023-08-01T19:55:58.982 INFO:teuthology.orchestra.run.smithi008.stdout: "time": "2023-08-01T19:55:05.632507+0000", 2023-08-01T19:55:58.983 INFO:teuthology.orchestra.run.smithi008.stdout: "duration": 4.5361999999999997e-05 2023-08-01T19:55:58.983 INFO:teuthology.orchestra.run.smithi008.stdout: }, 2023-08-01T19:55:58.983 INFO:teuthology.orchestra.run.smithi008.stdout: { 2023-08-01T19:55:58.983 INFO:teuthology.orchestra.run.smithi008.stdout: "event": "done", 2023-08-01T19:55:58.983 INFO:teuthology.orchestra.run.smithi008.stdout: "time": "2023-08-01T19:55:05.632547+0000", 2023-08-01T19:55:58.983 INFO:teuthology.orchestra.run.smithi008.stdout: "duration": 4.0760999999999998e-05 2023-08-01T19:55:58.983 INFO:teuthology.orchestra.run.smithi008.stdout: } 2023-08-01T19:55:58.984 INFO:teuthology.orchestra.run.smithi008.stdout: ] 2023-08-01T19:55:58.984 INFO:teuthology.orchestra.run.smithi008.stdout: } 2023-08-01T19:55:58.984 INFO:teuthology.orchestra.run.smithi008.stdout: }, 2023-08-01T19:55:58.984 INFO:teuthology.orchestra.run.smithi008.stdout: { 2023-08-01T19:55:58.984 INFO:teuthology.orchestra.run.smithi008.stdout: "description": "osd_op(client.4668.0:100939 5.5 5:a75fa6e3:::benchmark_data_smithi006_114134_object100938:head [set-alloc-hint object_size 65536 write_size 65536,write 0~65536] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e37)", 2023-08-01T19:55:58.984 INFO:teuthology.orchestra.run.smithi008.stdout: "initiated_at": "2023-08-01T19:55:05.569740+0000", 2023-08-01T19:55:58.984 INFO:teuthology.orchestra.run.smithi008.stdout: "age": 53.291347737000002, 2023-08-01T19:55:58.985 INFO:teuthology.orchestra.run.smithi008.stdout: "duration": 0.067753412999999998, 2023-08-01T19:55:58.985 INFO:teuthology.orchestra.run.smithi008.stdout: "type_data": { 2023-08-01T19:55:58.985 INFO:teuthology.orchestra.run.smithi008.stdout: "flag_point": "commit sent; apply or cleanup", 2023-08-01T19:55:58.985 INFO:teuthology.orchestra.run.smithi008.stdout: "client_info": { 2023-08-01T19:55:58.985 INFO:teuthology.orchestra.run.smithi008.stdout: "client": "client.4668", 2023-08-01T19:55:58.985 INFO:teuthology.orchestra.run.smithi008.stdout: "client_addr": "172.21.15.6:0/1709472247", 2023-08-01T19:55:58.985 INFO:teuthology.orchestra.run.smithi008.stdout: "tid": 100939 2023-08-01T19:55:58.985 INFO:teuthology.orchestra.run.smithi008.stdout: }, 2023-08-01T19:55:58.986 INFO:teuthology.orchestra.run.smithi008.stdout: "events": [ 2023-08-01T19:55:58.986 INFO:teuthology.orchestra.run.smithi008.stdout: { 2023-08-01T19:55:58.986 INFO:teuthology.orchestra.run.smithi008.stdout: "event": "initiated", 2023-08-01T19:55:58.986 INFO:teuthology.orchestra.run.smithi008.stdout: "time": "2023-08-01T19:55:05.569740+0000", 2023-08-01T19:55:58.986 INFO:teuthology.orchestra.run.smithi008.stdout: "duration": 0 2023-08-01T19:55:58.986 INFO:teuthology.orchestra.run.smithi008.stdout: }, 2023-08-01T19:55:58.986 INFO:teuthology.orchestra.run.smithi008.stdout: { 2023-08-01T19:55:58.986 INFO:teuthology.orchestra.run.smithi008.stdout: "event": "throttled", 2023-08-01T19:55:58.987 INFO:teuthology.orchestra.run.smithi008.stdout: "time": "2023-08-01T19:55:05.569740+0000", 2023-08-01T19:55:58.987 INFO:teuthology.orchestra.run.smithi008.stdout: "duration": 0 2023-08-01T19:55:58.987 INFO:teuthology.orchestra.run.smithi008.stdout: }, 2023-08-01T19:55:58.987 INFO:teuthology.orchestra.run.smithi008.stdout: { 2023-08-01T19:55:58.987 INFO:teuthology.orchestra.run.smithi008.stdout: "event": "header_read", 2023-08-01T19:55:58.987 INFO:teuthology.orchestra.run.smithi008.stdout: "time": "2023-08-01T19:55:05.569739+0000", 2023-08-01T19:55:58.987 INFO:teuthology.orchestra.run.smithi008.stdout: "duration": 4294967295.9999995 2023-08-01T19:55:58.987 INFO:teuthology.orchestra.run.smithi008.stdout: }, 2023-08-01T19:55:58.988 INFO:teuthology.orchestra.run.smithi008.stdout: { 2023-08-01T19:55:58.988 INFO:teuthology.orchestra.run.smithi008.stdout: "event": "all_read", 2023-08-01T19:55:58.988 INFO:teuthology.orchestra.run.smithi008.stdout: "time": "2023-08-01T19:55:05.569839+0000", 2023-08-01T19:55:58.988 INFO:teuthology.orchestra.run.smithi008.stdout: "duration": 0.000100219 2023-08-01T19:55:58.988 INFO:teuthology.orchestra.run.smithi008.stdout: }, 2023-08-01T19:55:58.988 INFO:teuthology.orchestra.run.smithi008.stdout: { 2023-08-01T19:55:58.989 INFO:teuthology.orchestra.run.smithi008.stdout: "event": "dispatched", 2023-08-01T19:55:58.989 INFO:teuthology.orchestra.run.smithi008.stdout: "time": "2023-08-01T19:55:05.569846+0000", 2023-08-01T19:55:58.989 INFO:teuthology.orchestra.run.smithi008.stdout: "duration": 7.3150000000000003e-06 2023-08-01T19:55:58.989 INFO:teuthology.orchestra.run.smithi008.stdout: }, 2023-08-01T19:55:58.989 INFO:teuthology.orchestra.run.smithi008.stdout: { 2023-08-01T19:55:58.989 INFO:teuthology.orchestra.run.smithi008.stdout: "event": "queued_for_pg", 2023-08-01T19:55:58.989 INFO:teuthology.orchestra.run.smithi008.stdout: "time": "2023-08-01T19:55:05.569850+0000", 2023-08-01T19:55:58.989 INFO:teuthology.orchestra.run.smithi008.stdout: "duration": 3.3299999999999999e-06 2023-08-01T19:55:58.990 INFO:teuthology.orchestra.run.smithi008.stdout: }, 2023-08-01T19:55:58.990 INFO:teuthology.orchestra.run.smithi008.stdout: { 2023-08-01T19:55:58.990 INFO:teuthology.orchestra.run.smithi008.stdout: "event": "reached_pg", 2023-08-01T19:55:58.990 INFO:teuthology.orchestra.run.smithi008.stdout: "time": "2023-08-01T19:55:05.626991+0000", 2023-08-01T19:55:58.990 INFO:teuthology.orchestra.run.smithi008.stdout: "duration": 0.057141585000000002 2023-08-01T19:55:58.990 INFO:teuthology.orchestra.run.smithi008.stdout: }, 2023-08-01T19:55:58.990 INFO:teuthology.orchestra.run.smithi008.stdout: { 2023-08-01T19:55:58.990 INFO:teuthology.orchestra.run.smithi008.stdout: "event": "started", 2023-08-01T19:55:58.991 INFO:teuthology.orchestra.run.smithi008.stdout: "time": "2023-08-01T19:55:05.627111+0000", 2023-08-01T19:55:58.991 INFO:teuthology.orchestra.run.smithi008.stdout: "duration": 0.000119238 2023-08-01T19:55:58.991 INFO:teuthology.orchestra.run.smithi008.stdout: }, 2023-08-01T19:55:58.991 INFO:teuthology.orchestra.run.smithi008.stdout: { 2023-08-01T19:55:58.991 INFO:teuthology.orchestra.run.smithi008.stdout: "event": "waiting for subops from 1", 2023-08-01T19:55:58.991 INFO:teuthology.orchestra.run.smithi008.stdout: "time": "2023-08-01T19:55:05.627253+0000", 2023-08-01T19:55:58.991 INFO:teuthology.orchestra.run.smithi008.stdout: "duration": 0.000142822 2023-08-01T19:55:58.992 INFO:teuthology.orchestra.run.smithi008.stdout: }, 2023-08-01T19:55:58.992 INFO:teuthology.orchestra.run.smithi008.stdout: { 2023-08-01T19:55:58.992 INFO:teuthology.orchestra.run.smithi008.stdout: "event": "op_commit", 2023-08-01T19:55:58.992 INFO:teuthology.orchestra.run.smithi008.stdout: "time": "2023-08-01T19:55:05.632555+0000", 2023-08-01T19:55:58.992 INFO:teuthology.orchestra.run.smithi008.stdout: "duration": 0.0053012449999999996 2023-08-01T19:55:58.992 INFO:teuthology.orchestra.run.smithi008.stdout: }, 2023-08-01T19:55:58.992 INFO:teuthology.orchestra.run.smithi008.stdout: { 2023-08-01T19:55:58.993 INFO:teuthology.orchestra.run.smithi008.stdout: "event": "sub_op_commit_rec", 2023-08-01T19:55:58.993 INFO:teuthology.orchestra.run.smithi008.stdout: "time": "2023-08-01T19:55:05.637380+0000", 2023-08-01T19:55:58.993 INFO:teuthology.orchestra.run.smithi008.stdout: "duration": 0.0048257639999999997 2023-08-01T19:55:58.993 INFO:teuthology.orchestra.run.smithi008.stdout: }, 2023-08-01T19:55:58.993 INFO:teuthology.orchestra.run.smithi008.stdout: { 2023-08-01T19:55:58.993 INFO:teuthology.orchestra.run.smithi008.stdout: "event": "commit_sent", 2023-08-01T19:55:58.993 INFO:teuthology.orchestra.run.smithi008.stdout: "time": "2023-08-01T19:55:05.637454+0000", 2023-08-01T19:55:58.993 INFO:teuthology.orchestra.run.smithi008.stdout: "duration": 7.3578999999999995e-05 2023-08-01T19:55:58.994 INFO:teuthology.orchestra.run.smithi008.stdout: }, 2023-08-01T19:55:58.994 INFO:teuthology.orchestra.run.smithi008.stdout: { 2023-08-01T19:55:58.994 INFO:teuthology.orchestra.run.smithi008.stdout: "event": "done", 2023-08-01T19:55:58.994 INFO:teuthology.orchestra.run.smithi008.stdout: "time": "2023-08-01T19:55:05.637493+0000", 2023-08-01T19:55:58.994 INFO:teuthology.orchestra.run.smithi008.stdout: "duration": 3.8986999999999998e-05 2023-08-01T19:55:58.994 INFO:teuthology.orchestra.run.smithi008.stdout: } 2023-08-01T19:55:58.994 INFO:teuthology.orchestra.run.smithi008.stdout: ] 2023-08-01T19:55:58.994 INFO:teuthology.orchestra.run.smithi008.stdout: } 2023-08-01T19:55:58.995 INFO:teuthology.orchestra.run.smithi008.stdout: }, 2023-08-01T19:55:58.995 INFO:teuthology.orchestra.run.smithi008.stdout: { 2023-08-01T19:55:58.995 INFO:teuthology.orchestra.run.smithi008.stdout: "description": "osd_repop(client.4668.0:100941 5.e e37/19 5:736a6ac6:::benchmark_data_smithi006_114134_object100940:head v 37'6306, mlcod=37'6303)", 2023-08-01T19:55:58.995 INFO:teuthology.orchestra.run.smithi008.stdout: "initiated_at": "2023-08-01T19:55:05.570237+0000", 2023-08-01T19:55:58.995 INFO:teuthology.orchestra.run.smithi008.stdout: "age": 53.290850427000002, 2023-08-01T19:55:58.995 INFO:teuthology.orchestra.run.smithi008.stdout: "duration": 0.064830421999999999, 2023-08-01T19:55:58.995 INFO:teuthology.orchestra.run.smithi008.stdout: "type_data": { 2023-08-01T19:55:58.995 INFO:teuthology.orchestra.run.smithi008.stdout: "flag_point": "commit sent; apply or cleanup", 2023-08-01T19:55:58.996 INFO:teuthology.orchestra.run.smithi008.stdout: "events": [ 2023-08-01T19:55:58.996 INFO:teuthology.orchestra.run.smithi008.stdout: { 2023-08-01T19:55:58.996 INFO:teuthology.orchestra.run.smithi008.stdout: "event": "initiated", 2023-08-01T19:55:58.996 INFO:teuthology.orchestra.run.smithi008.stdout: "time": "2023-08-01T19:55:05.570237+0000", 2023-08-01T19:55:58.996 INFO:teuthology.orchestra.run.smithi008.stdout: "duration": 0 2023-08-01T19:55:58.996 INFO:teuthology.orchestra.run.smithi008.stdout: }, 2023-08-01T19:55:58.996 INFO:teuthology.orchestra.run.smithi008.stdout: { 2023-08-01T19:55:58.997 INFO:teuthology.orchestra.run.smithi008.stdout: "event": "throttled", 2023-08-01T19:55:58.997 INFO:teuthology.orchestra.run.smithi008.stdout: "time": "2023-08-01T19:55:05.570237+0000", 2023-08-01T19:55:58.997 INFO:teuthology.orchestra.run.smithi008.stdout: "duration": 0 2023-08-01T19:55:58.997 INFO:teuthology.orchestra.run.smithi008.stdout: }, 2023-08-01T19:55:58.997 INFO:teuthology.orchestra.run.smithi008.stdout: { 2023-08-01T19:55:58.997 INFO:teuthology.orchestra.run.smithi008.stdout: "event": "header_read", 2023-08-01T19:55:58.997 INFO:teuthology.orchestra.run.smithi008.stdout: "time": "2023-08-01T19:55:05.570236+0000", 2023-08-01T19:55:58.997 INFO:teuthology.orchestra.run.smithi008.stdout: "duration": 4294967295.9999995 2023-08-01T19:55:58.998 INFO:teuthology.orchestra.run.smithi008.stdout: }, 2023-08-01T19:55:58.998 INFO:teuthology.orchestra.run.smithi008.stdout: { 2023-08-01T19:55:58.998 INFO:teuthology.orchestra.run.smithi008.stdout: "event": "all_read", 2023-08-01T19:55:58.998 INFO:teuthology.orchestra.run.smithi008.stdout: "time": "2023-08-01T19:55:05.570354+0000", 2023-08-01T19:55:58.998 INFO:teuthology.orchestra.run.smithi008.stdout: "duration": 0.000118029 2023-08-01T19:55:58.998 INFO:teuthology.orchestra.run.smithi008.stdout: }, 2023-08-01T19:55:58.998 INFO:teuthology.orchestra.run.smithi008.stdout: { 2023-08-01T19:55:58.998 INFO:teuthology.orchestra.run.smithi008.stdout: "event": "dispatched", 2023-08-01T19:55:58.999 INFO:teuthology.orchestra.run.smithi008.stdout: "time": "2023-08-01T19:55:05.626649+0000", 2023-08-01T19:55:58.999 INFO:teuthology.orchestra.run.smithi008.stdout: "duration": 0.056294489000000003 2023-08-01T19:55:58.999 INFO:teuthology.orchestra.run.smithi008.stdout: }, 2023-08-01T19:55:58.999 INFO:teuthology.orchestra.run.smithi008.stdout: { 2023-08-01T19:55:58.999 INFO:teuthology.orchestra.run.smithi008.stdout: "event": "queued_for_pg", 2023-08-01T19:55:58.999 INFO:teuthology.orchestra.run.smithi008.stdout: "time": "2023-08-01T19:55:05.626676+0000", 2023-08-01T19:55:58.999 INFO:teuthology.orchestra.run.smithi008.stdout: "duration": 2.7228000000000001e-05 2023-08-01T19:55:58.999 INFO:teuthology.orchestra.run.smithi008.stdout: }, 2023-08-01T19:55:59.000 INFO:teuthology.orchestra.run.smithi008.stdout: { 2023-08-01T19:55:59.000 INFO:teuthology.orchestra.run.smithi008.stdout: "event": "reached_pg", 2023-08-01T19:55:59.000 INFO:teuthology.orchestra.run.smithi008.stdout: "time": "2023-08-01T19:55:05.626717+0000", 2023-08-01T19:55:59.000 INFO:teuthology.orchestra.run.smithi008.stdout: "duration": 4.1318e-05 2023-08-01T19:55:59.000 INFO:teuthology.orchestra.run.smithi008.stdout: }, 2023-08-01T19:55:59.000 INFO:teuthology.orchestra.run.smithi008.stdout: { 2023-08-01T19:55:59.000 INFO:teuthology.orchestra.run.smithi008.stdout: "event": "started", 2023-08-01T19:55:59.001 INFO:teuthology.orchestra.run.smithi008.stdout: "time": "2023-08-01T19:55:05.626737+0000", 2023-08-01T19:55:59.001 INFO:teuthology.orchestra.run.smithi008.stdout: "duration": 1.9415e-05 2023-08-01T19:55:59.001 INFO:teuthology.orchestra.run.smithi008.stdout: }, 2023-08-01T19:55:59.001 INFO:teuthology.orchestra.run.smithi008.stdout: { 2023-08-01T19:55:59.001 INFO:teuthology.orchestra.run.smithi008.stdout: "event": "commit_sent", 2023-08-01T19:55:59.001 INFO:teuthology.orchestra.run.smithi008.stdout: "time": "2023-08-01T19:55:05.635036+0000", 2023-08-01T19:55:59.001 INFO:teuthology.orchestra.run.smithi008.stdout: "duration": 0.0082987700000000005 2023-08-01T19:55:59.002 INFO:teuthology.orchestra.run.smithi008.stdout: }, 2023-08-01T19:55:59.002 INFO:teuthology.orchestra.run.smithi008.stdout: { 2023-08-01T19:55:59.002 INFO:teuthology.orchestra.run.smithi008.stdout: "event": "done", 2023-08-01T19:55:59.002 INFO:teuthology.orchestra.run.smithi008.stdout: "time": "2023-08-01T19:55:05.635067+0000", 2023-08-01T19:55:59.002 INFO:teuthology.orchestra.run.smithi008.stdout: "duration": 3.1786999999999999e-05 2023-08-01T19:55:59.002 INFO:teuthology.orchestra.run.smithi008.stdout: } 2023-08-01T19:55:59.002 INFO:teuthology.orchestra.run.smithi008.stdout: ] 2023-08-01T19:55:59.003 INFO:teuthology.orchestra.run.smithi008.stdout: } 2023-08-01T19:55:59.003 INFO:teuthology.orchestra.run.smithi008.stdout: }, 2023-08-01T19:55:59.003 INFO:teuthology.orchestra.run.smithi008.stdout: { 2023-08-01T19:55:59.003 INFO:teuthology.orchestra.run.smithi008.stdout: "description": "osd_op(client.4668.0:107863 5.3 5:cbdd875a:::benchmark_data_smithi006_114134_object107862:head [set-alloc-hint object_size 65536 write_size 65536,write 0~65536] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e38)", 2023-08-01T19:55:59.004 INFO:teuthology.orchestra.run.smithi008.stdout: "initiated_at": "2023-08-01T19:55:09.278851+0000", 2023-08-01T19:55:59.004 INFO:teuthology.orchestra.run.smithi008.stdout: "age": 49.582235996999998, 2023-08-01T19:55:59.004 INFO:teuthology.orchestra.run.smithi008.stdout: "duration": 0.071378853000000006, 2023-08-01T19:55:59.004 INFO:teuthology.orchestra.run.smithi008.stdout: "type_data": { 2023-08-01T19:55:59.005 INFO:teuthology.orchestra.run.smithi008.stdout: "flag_point": "commit sent; apply or cleanup", 2023-08-01T19:55:59.005 INFO:teuthology.orchestra.run.smithi008.stdout: "client_info": { 2023-08-01T19:55:59.005 INFO:teuthology.orchestra.run.smithi008.stdout: "client": "client.4668", 2023-08-01T19:55:59.005 INFO:teuthology.orchestra.run.smithi008.stdout: "client_addr": "172.21.15.6:0/1709472247", 2023-08-01T19:55:59.006 INFO:teuthology.orchestra.run.smithi008.stdout: "tid": 107863 2023-08-01T19:55:59.006 INFO:teuthology.orchestra.run.smithi008.stdout: }, 2023-08-01T19:55:59.006 INFO:teuthology.orchestra.run.smithi008.stdout: "events": [ 2023-08-01T19:55:59.006 INFO:teuthology.orchestra.run.smithi008.stdout: { 2023-08-01T19:55:59.007 INFO:teuthology.orchestra.run.smithi008.stdout: "event": "initiated", 2023-08-01T19:55:59.007 INFO:teuthology.orchestra.run.smithi008.stdout: "time": "2023-08-01T19:55:09.278851+0000", 2023-08-01T19:55:59.007 INFO:teuthology.orchestra.run.smithi008.stdout: "duration": 0 2023-08-01T19:55:59.007 INFO:teuthology.orchestra.run.smithi008.stdout: }, 2023-08-01T19:55:59.008 INFO:teuthology.orchestra.run.smithi008.stdout: { 2023-08-01T19:55:59.008 INFO:teuthology.orchestra.run.smithi008.stdout: "event": "throttled", 2023-08-01T19:55:59.008 INFO:teuthology.orchestra.run.smithi008.stdout: "time": "2023-08-01T19:55:09.278851+0000", 2023-08-01T19:55:59.008 INFO:teuthology.orchestra.run.smithi008.stdout: "duration": 0 2023-08-01T19:55:59.009 INFO:teuthology.orchestra.run.smithi008.stdout: }, 2023-08-01T19:55:59.009 INFO:teuthology.orchestra.run.smithi008.stdout: { 2023-08-01T19:55:59.009 INFO:teuthology.orchestra.run.smithi008.stdout: "event": "header_read", 2023-08-01T19:55:59.009 INFO:teuthology.orchestra.run.smithi008.stdout: "time": "2023-08-01T19:55:09.278850+0000", 2023-08-01T19:55:59.010 INFO:teuthology.orchestra.run.smithi008.stdout: "duration": 4294967295.999999 2023-08-01T19:55:59.010 INFO:teuthology.orchestra.run.smithi008.stdout: }, 2023-08-01T19:55:59.010 INFO:teuthology.orchestra.run.smithi008.stdout: { 2023-08-01T19:55:59.010 INFO:teuthology.orchestra.run.smithi008.stdout: "event": "all_read", 2023-08-01T19:55:59.010 INFO:teuthology.orchestra.run.smithi008.stdout: "time": "2023-08-01T19:55:09.278945+0000", 2023-08-01T19:55:59.011 INFO:teuthology.orchestra.run.smithi008.stdout: "duration": 9.4388000000000005e-05 2023-08-01T19:55:59.011 INFO:teuthology.orchestra.run.smithi008.stdout: }, 2023-08-01T19:55:59.011 INFO:teuthology.orchestra.run.smithi008.stdout: { 2023-08-01T19:55:59.011 INFO:teuthology.orchestra.run.smithi008.stdout: "event": "dispatched", 2023-08-01T19:55:59.012 INFO:teuthology.orchestra.run.smithi008.stdout: "time": "2023-08-01T19:55:09.278955+0000", 2023-08-01T19:55:59.012 INFO:teuthology.orchestra.run.smithi008.stdout: "duration": 1.0413e-05 2023-08-01T19:55:59.012 INFO:teuthology.orchestra.run.smithi008.stdout: }, 2023-08-01T19:55:59.012 INFO:teuthology.orchestra.run.smithi008.stdout: { 2023-08-01T19:55:59.013 INFO:teuthology.orchestra.run.smithi008.stdout: "event": "queued_for_pg", 2023-08-01T19:55:59.013 INFO:teuthology.orchestra.run.smithi008.stdout: "time": "2023-08-01T19:55:09.278962+0000", 2023-08-01T19:55:59.013 INFO:teuthology.orchestra.run.smithi008.stdout: "duration": 6.2169999999999999e-06 2023-08-01T19:55:59.013 INFO:teuthology.orchestra.run.smithi008.stdout: }, 2023-08-01T19:55:59.014 INFO:teuthology.orchestra.run.smithi008.stdout: { 2023-08-01T19:55:59.014 INFO:teuthology.orchestra.run.smithi008.stdout: "event": "reached_pg", 2023-08-01T19:55:59.014 INFO:teuthology.orchestra.run.smithi008.stdout: "time": "2023-08-01T19:55:09.280363+0000", 2023-08-01T19:55:59.014 INFO:teuthology.orchestra.run.smithi008.stdout: "duration": 0.0014014489999999999 2023-08-01T19:55:59.014 INFO:teuthology.orchestra.run.smithi008.stdout: }, 2023-08-01T19:55:59.015 INFO:teuthology.orchestra.run.smithi008.stdout: { 2023-08-01T19:55:59.015 INFO:teuthology.orchestra.run.smithi008.stdout: "event": "started", 2023-08-01T19:55:59.015 INFO:teuthology.orchestra.run.smithi008.stdout: "time": "2023-08-01T19:55:09.280488+0000", 2023-08-01T19:55:59.015 INFO:teuthology.orchestra.run.smithi008.stdout: "duration": 0.00012474099999999999 2023-08-01T19:55:59.016 INFO:teuthology.orchestra.run.smithi008.stdout: }, 2023-08-01T19:55:59.016 INFO:teuthology.orchestra.run.smithi008.stdout: { 2023-08-01T19:55:59.016 INFO:teuthology.orchestra.run.smithi008.stdout: "event": "waiting for subops from 1", 2023-08-01T19:55:59.016 INFO:teuthology.orchestra.run.smithi008.stdout: "time": "2023-08-01T19:55:09.280626+0000", 2023-08-01T19:55:59.017 INFO:teuthology.orchestra.run.smithi008.stdout: "duration": 0.000138193 2023-08-01T19:55:59.017 INFO:teuthology.orchestra.run.smithi008.stdout: }, 2023-08-01T19:55:59.017 INFO:teuthology.orchestra.run.smithi008.stdout: { 2023-08-01T19:55:59.017 INFO:teuthology.orchestra.run.smithi008.stdout: "event": "op_commit", 2023-08-01T19:55:59.018 INFO:teuthology.orchestra.run.smithi008.stdout: "time": "2023-08-01T19:55:09.285958+0000", 2023-08-01T19:55:59.018 INFO:teuthology.orchestra.run.smithi008.stdout: "duration": 0.0053317130000000001 2023-08-01T19:55:59.018 INFO:teuthology.orchestra.run.smithi008.stdout: }, 2023-08-01T19:55:59.018 INFO:teuthology.orchestra.run.smithi008.stdout: { 2023-08-01T19:55:59.018 INFO:teuthology.orchestra.run.smithi008.stdout: "event": "sub_op_commit_rec", 2023-08-01T19:55:59.019 INFO:teuthology.orchestra.run.smithi008.stdout: "time": "2023-08-01T19:55:09.350151+0000", 2023-08-01T19:55:59.019 INFO:teuthology.orchestra.run.smithi008.stdout: "duration": 0.064193202000000005 2023-08-01T19:55:59.019 INFO:teuthology.orchestra.run.smithi008.stdout: }, 2023-08-01T19:55:59.019 INFO:teuthology.orchestra.run.smithi008.stdout: { 2023-08-01T19:55:59.020 INFO:teuthology.orchestra.run.smithi008.stdout: "event": "commit_sent", 2023-08-01T19:55:59.020 INFO:teuthology.orchestra.run.smithi008.stdout: "time": "2023-08-01T19:55:09.350188+0000", 2023-08-01T19:55:59.020 INFO:teuthology.orchestra.run.smithi008.stdout: "duration": 3.7549999999999998e-05 2023-08-01T19:55:59.020 INFO:teuthology.orchestra.run.smithi008.stdout: }, 2023-08-01T19:55:59.020 INFO:teuthology.orchestra.run.smithi008.stdout: { 2023-08-01T19:55:59.020 INFO:teuthology.orchestra.run.smithi008.stdout: "event": "done", 2023-08-01T19:55:59.020 INFO:teuthology.orchestra.run.smithi008.stdout: "time": "2023-08-01T19:55:09.350230+0000", 2023-08-01T19:55:59.021 INFO:teuthology.orchestra.run.smithi008.stdout: "duration": 4.1804999999999997e-05 2023-08-01T19:55:59.021 INFO:teuthology.orchestra.run.smithi008.stdout: } 2023-08-01T19:55:59.021 INFO:teuthology.orchestra.run.smithi008.stdout: ] 2023-08-01T19:55:59.021 INFO:teuthology.orchestra.run.smithi008.stdout: } 2023-08-01T19:55:59.021 INFO:teuthology.orchestra.run.smithi008.stdout: }, 2023-08-01T19:55:59.021 INFO:teuthology.orchestra.run.smithi008.stdout: { 2023-08-01T19:55:59.021 INFO:teuthology.orchestra.run.smithi008.stdout: "description": "osd_op(client.4668.0:107865 5.3 5:c2ebb96d:::benchmark_data_smithi006_114134_object107864:head [set-alloc-hint object_size 65536 write_size 65536,write 0~65536] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e38)", 2023-08-01T19:55:59.022 INFO:teuthology.orchestra.run.smithi008.stdout: "initiated_at": "2023-08-01T19:55:09.279020+0000", 2023-08-01T19:55:59.022 INFO:teuthology.orchestra.run.smithi008.stdout: "age": 49.582067324999997, 2023-08-01T19:55:59.022 INFO:teuthology.orchestra.run.smithi008.stdout: "duration": 0.072892565000000006, 2023-08-01T19:55:59.022 INFO:teuthology.orchestra.run.smithi008.stdout: "type_data": { 2023-08-01T19:55:59.022 INFO:teuthology.orchestra.run.smithi008.stdout: "flag_point": "commit sent; apply or cleanup", 2023-08-01T19:55:59.023 INFO:teuthology.orchestra.run.smithi008.stdout: "client_info": { 2023-08-01T19:55:59.023 INFO:teuthology.orchestra.run.smithi008.stdout: "client": "client.4668", 2023-08-01T19:55:59.023 INFO:teuthology.orchestra.run.smithi008.stdout: "client_addr": "172.21.15.6:0/1709472247", 2023-08-01T19:55:59.023 INFO:teuthology.orchestra.run.smithi008.stdout: "tid": 107865 2023-08-01T19:55:59.023 INFO:teuthology.orchestra.run.smithi008.stdout: }, 2023-08-01T19:55:59.023 INFO:teuthology.orchestra.run.smithi008.stdout: "events": [ 2023-08-01T19:55:59.023 INFO:teuthology.orchestra.run.smithi008.stdout: { 2023-08-01T19:55:59.023 INFO:teuthology.orchestra.run.smithi008.stdout: "event": "initiated", 2023-08-01T19:55:59.024 INFO:teuthology.orchestra.run.smithi008.stdout: "time": "2023-08-01T19:55:09.279020+0000", 2023-08-01T19:55:59.024 INFO:teuthology.orchestra.run.smithi008.stdout: "duration": 0 2023-08-01T19:55:59.024 INFO:teuthology.orchestra.run.smithi008.stdout: }, 2023-08-01T19:55:59.024 INFO:teuthology.orchestra.run.smithi008.stdout: { 2023-08-01T19:55:59.024 INFO:teuthology.orchestra.run.smithi008.stdout: "event": "throttled", 2023-08-01T19:55:59.024 INFO:teuthology.orchestra.run.smithi008.stdout: "time": "2023-08-01T19:55:09.279020+0000", 2023-08-01T19:55:59.024 INFO:teuthology.orchestra.run.smithi008.stdout: "duration": 0 2023-08-01T19:55:59.025 INFO:teuthology.orchestra.run.smithi008.stdout: }, 2023-08-01T19:55:59.025 INFO:teuthology.orchestra.run.smithi008.stdout: { 2023-08-01T19:55:59.025 INFO:teuthology.orchestra.run.smithi008.stdout: "event": "header_read", 2023-08-01T19:55:59.025 INFO:teuthology.orchestra.run.smithi008.stdout: "time": "2023-08-01T19:55:09.279019+0000", 2023-08-01T19:55:59.025 INFO:teuthology.orchestra.run.smithi008.stdout: "duration": 4294967295.999999 2023-08-01T19:55:59.025 INFO:teuthology.orchestra.run.smithi008.stdout: }, 2023-08-01T19:55:59.025 INFO:teuthology.orchestra.run.smithi008.stdout: { 2023-08-01T19:55:59.026 INFO:teuthology.orchestra.run.smithi008.stdout: "event": "all_read", 2023-08-01T19:55:59.026 INFO:teuthology.orchestra.run.smithi008.stdout: "time": "2023-08-01T19:55:09.279087+0000", 2023-08-01T19:55:59.026 INFO:teuthology.orchestra.run.smithi008.stdout: "duration": 6.8392000000000005e-05 2023-08-01T19:55:59.026 INFO:teuthology.orchestra.run.smithi008.stdout: }, 2023-08-01T19:55:59.026 INFO:teuthology.orchestra.run.smithi008.stdout: { 2023-08-01T19:55:59.026 INFO:teuthology.orchestra.run.smithi008.stdout: "event": "dispatched", 2023-08-01T19:55:59.026 INFO:teuthology.orchestra.run.smithi008.stdout: "time": "2023-08-01T19:55:09.279095+0000", 2023-08-01T19:55:59.026 INFO:teuthology.orchestra.run.smithi008.stdout: "duration": 8.0989999999999999e-06 2023-08-01T19:55:59.027 INFO:teuthology.orchestra.run.smithi008.stdout: }, 2023-08-01T19:55:59.027 INFO:teuthology.orchestra.run.smithi008.stdout: { 2023-08-01T19:55:59.027 INFO:teuthology.orchestra.run.smithi008.stdout: "event": "queued_for_pg", 2023-08-01T19:55:59.027 INFO:teuthology.orchestra.run.smithi008.stdout: "time": "2023-08-01T19:55:09.279101+0000", 2023-08-01T19:55:59.027 INFO:teuthology.orchestra.run.smithi008.stdout: "duration": 5.0390000000000004e-06 2023-08-01T19:55:59.027 INFO:teuthology.orchestra.run.smithi008.stdout: }, 2023-08-01T19:55:59.027 INFO:teuthology.orchestra.run.smithi008.stdout: { 2023-08-01T19:55:59.027 INFO:teuthology.orchestra.run.smithi008.stdout: "event": "reached_pg", 2023-08-01T19:55:59.028 INFO:teuthology.orchestra.run.smithi008.stdout: "time": "2023-08-01T19:55:09.282574+0000", 2023-08-01T19:55:59.028 INFO:teuthology.orchestra.run.smithi008.stdout: "duration": 0.0034730619999999999 2023-08-01T19:55:59.028 INFO:teuthology.orchestra.run.smithi008.stdout: }, 2023-08-01T19:55:59.028 INFO:teuthology.orchestra.run.smithi008.stdout: { 2023-08-01T19:55:59.028 INFO:teuthology.orchestra.run.smithi008.stdout: "event": "started", 2023-08-01T19:55:59.028 INFO:teuthology.orchestra.run.smithi008.stdout: "time": "2023-08-01T19:55:09.282705+0000", 2023-08-01T19:55:59.028 INFO:teuthology.orchestra.run.smithi008.stdout: "duration": 0.00013133400000000001 2023-08-01T19:55:59.029 INFO:teuthology.orchestra.run.smithi008.stdout: }, 2023-08-01T19:55:59.029 INFO:teuthology.orchestra.run.smithi008.stdout: { 2023-08-01T19:55:59.029 INFO:teuthology.orchestra.run.smithi008.stdout: "event": "waiting for subops from 1", 2023-08-01T19:55:59.029 INFO:teuthology.orchestra.run.smithi008.stdout: "time": "2023-08-01T19:55:09.283067+0000", 2023-08-01T19:55:59.029 INFO:teuthology.orchestra.run.smithi008.stdout: "duration": 0.00036195299999999998 2023-08-01T19:55:59.029 INFO:teuthology.orchestra.run.smithi008.stdout: }, 2023-08-01T19:55:59.029 INFO:teuthology.orchestra.run.smithi008.stdout: { 2023-08-01T19:55:59.029 INFO:teuthology.orchestra.run.smithi008.stdout: "event": "op_commit", 2023-08-01T19:55:59.030 INFO:teuthology.orchestra.run.smithi008.stdout: "time": "2023-08-01T19:55:09.288196+0000", 2023-08-01T19:55:59.030 INFO:teuthology.orchestra.run.smithi008.stdout: "duration": 0.0051293780000000004 2023-08-01T19:55:59.030 INFO:teuthology.orchestra.run.smithi008.stdout: }, 2023-08-01T19:55:59.030 INFO:teuthology.orchestra.run.smithi008.stdout: { 2023-08-01T19:55:59.030 INFO:teuthology.orchestra.run.smithi008.stdout: "event": "sub_op_commit_rec", 2023-08-01T19:55:59.030 INFO:teuthology.orchestra.run.smithi008.stdout: "time": "2023-08-01T19:55:09.351832+0000", 2023-08-01T19:55:59.030 INFO:teuthology.orchestra.run.smithi008.stdout: "duration": 0.063636076 2023-08-01T19:55:59.030 INFO:teuthology.orchestra.run.smithi008.stdout: }, 2023-08-01T19:55:59.031 INFO:teuthology.orchestra.run.smithi008.stdout: { 2023-08-01T19:55:59.031 INFO:teuthology.orchestra.run.smithi008.stdout: "event": "commit_sent", 2023-08-01T19:55:59.031 INFO:teuthology.orchestra.run.smithi008.stdout: "time": "2023-08-01T19:55:09.351878+0000", 2023-08-01T19:55:59.031 INFO:teuthology.orchestra.run.smithi008.stdout: "duration": 4.5408999999999998e-05 2023-08-01T19:55:59.031 INFO:teuthology.orchestra.run.smithi008.stdout: }, 2023-08-01T19:55:59.031 INFO:teuthology.orchestra.run.smithi008.stdout: { 2023-08-01T19:55:59.031 INFO:teuthology.orchestra.run.smithi008.stdout: "event": "done", 2023-08-01T19:55:59.031 INFO:teuthology.orchestra.run.smithi008.stdout: "time": "2023-08-01T19:55:09.351913+0000", 2023-08-01T19:55:59.032 INFO:teuthology.orchestra.run.smithi008.stdout: "duration": 3.4808999999999998e-05 2023-08-01T19:55:59.032 INFO:teuthology.orchestra.run.smithi008.stdout: } 2023-08-01T19:55:59.032 INFO:teuthology.orchestra.run.smithi008.stdout: ] 2023-08-01T19:55:59.032 INFO:teuthology.orchestra.run.smithi008.stdout: } 2023-08-01T19:55:59.032 INFO:teuthology.orchestra.run.smithi008.stdout: }, 2023-08-01T19:55:59.032 INFO:teuthology.orchestra.run.smithi008.stdout: { 2023-08-01T19:55:59.032 INFO:teuthology.orchestra.run.smithi008.stdout: "description": "osd_op(client.4668.0:107869 5.c 5:31910384:::benchmark_data_smithi006_114134_object107868:head [set-alloc-hint object_size 65536 write_size 65536,write 0~65536] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e38)", 2023-08-01T19:55:59.033 INFO:teuthology.orchestra.run.smithi008.stdout: "initiated_at": "2023-08-01T19:55:09.283205+0000", 2023-08-01T19:55:59.033 INFO:teuthology.orchestra.run.smithi008.stdout: "age": 49.577882160000001, 2023-08-01T19:55:59.033 INFO:teuthology.orchestra.run.smithi008.stdout: "duration": 0.068611808999999996, 2023-08-01T19:55:59.033 INFO:teuthology.orchestra.run.smithi008.stdout: "type_data": { 2023-08-01T19:55:59.033 INFO:teuthology.orchestra.run.smithi008.stdout: "flag_point": "commit sent; apply or cleanup", 2023-08-01T19:55:59.033 INFO:teuthology.orchestra.run.smithi008.stdout: "client_info": { 2023-08-01T19:55:59.033 INFO:teuthology.orchestra.run.smithi008.stdout: "client": "client.4668", 2023-08-01T19:55:59.034 INFO:teuthology.orchestra.run.smithi008.stdout: "client_addr": "172.21.15.6:0/1709472247", 2023-08-01T19:55:59.034 INFO:teuthology.orchestra.run.smithi008.stdout: "tid": 107869 2023-08-01T19:55:59.034 INFO:teuthology.orchestra.run.smithi008.stdout: }, 2023-08-01T19:55:59.034 INFO:teuthology.orchestra.run.smithi008.stdout: "events": [ 2023-08-01T19:55:59.034 INFO:teuthology.orchestra.run.smithi008.stdout: { 2023-08-01T19:55:59.034 INFO:teuthology.orchestra.run.smithi008.stdout: "event": "initiated", 2023-08-01T19:55:59.034 INFO:teuthology.orchestra.run.smithi008.stdout: "time": "2023-08-01T19:55:09.283205+0000", 2023-08-01T19:55:59.034 INFO:teuthology.orchestra.run.smithi008.stdout: "duration": 0 2023-08-01T19:55:59.035 INFO:teuthology.orchestra.run.smithi008.stdout: }, 2023-08-01T19:55:59.035 INFO:teuthology.orchestra.run.smithi008.stdout: { 2023-08-01T19:55:59.035 INFO:teuthology.orchestra.run.smithi008.stdout: "event": "throttled", 2023-08-01T19:55:59.035 INFO:teuthology.orchestra.run.smithi008.stdout: "time": "2023-08-01T19:55:09.283205+0000", 2023-08-01T19:55:59.035 INFO:teuthology.orchestra.run.smithi008.stdout: "duration": 0 2023-08-01T19:55:59.035 INFO:teuthology.orchestra.run.smithi008.stdout: }, 2023-08-01T19:55:59.035 INFO:teuthology.orchestra.run.smithi008.stdout: { 2023-08-01T19:55:59.035 INFO:teuthology.orchestra.run.smithi008.stdout: "event": "header_read", 2023-08-01T19:55:59.036 INFO:teuthology.orchestra.run.smithi008.stdout: "time": "2023-08-01T19:55:09.283204+0000", 2023-08-01T19:55:59.036 INFO:teuthology.orchestra.run.smithi008.stdout: "duration": 4294967295.999999 2023-08-01T19:55:59.036 INFO:teuthology.orchestra.run.smithi008.stdout: }, 2023-08-01T19:55:59.036 INFO:teuthology.orchestra.run.smithi008.stdout: { 2023-08-01T19:55:59.036 INFO:teuthology.orchestra.run.smithi008.stdout: "event": "all_read", 2023-08-01T19:55:59.036 INFO:teuthology.orchestra.run.smithi008.stdout: "time": "2023-08-01T19:55:09.283300+0000", 2023-08-01T19:55:59.036 INFO:teuthology.orchestra.run.smithi008.stdout: "duration": 9.6280000000000007e-05 2023-08-01T19:55:59.037 INFO:teuthology.orchestra.run.smithi008.stdout: }, 2023-08-01T19:55:59.037 INFO:teuthology.orchestra.run.smithi008.stdout: { 2023-08-01T19:55:59.037 INFO:teuthology.orchestra.run.smithi008.stdout: "event": "dispatched", 2023-08-01T19:55:59.037 INFO:teuthology.orchestra.run.smithi008.stdout: "time": "2023-08-01T19:55:09.283314+0000", 2023-08-01T19:55:59.037 INFO:teuthology.orchestra.run.smithi008.stdout: "duration": 1.3344e-05 2023-08-01T19:55:59.037 INFO:teuthology.orchestra.run.smithi008.stdout: }, 2023-08-01T19:55:59.037 INFO:teuthology.orchestra.run.smithi008.stdout: { 2023-08-01T19:55:59.037 INFO:teuthology.orchestra.run.smithi008.stdout: "event": "queued_for_pg", 2023-08-01T19:55:59.038 INFO:teuthology.orchestra.run.smithi008.stdout: "time": "2023-08-01T19:55:09.283320+0000", 2023-08-01T19:55:59.038 INFO:teuthology.orchestra.run.smithi008.stdout: "duration": 6.0299999999999999e-06 2023-08-01T19:55:59.038 INFO:teuthology.orchestra.run.smithi008.stdout: }, 2023-08-01T19:55:59.038 INFO:teuthology.orchestra.run.smithi008.stdout: { 2023-08-01T19:55:59.038 INFO:teuthology.orchestra.run.smithi008.stdout: "event": "reached_pg", 2023-08-01T19:55:59.038 INFO:teuthology.orchestra.run.smithi008.stdout: "time": "2023-08-01T19:55:09.283365+0000", 2023-08-01T19:55:59.038 INFO:teuthology.orchestra.run.smithi008.stdout: "duration": 4.5578999999999998e-05 2023-08-01T19:55:59.038 INFO:teuthology.orchestra.run.smithi008.stdout: }, 2023-08-01T19:55:59.039 INFO:teuthology.orchestra.run.smithi008.stdout: { 2023-08-01T19:55:59.039 INFO:teuthology.orchestra.run.smithi008.stdout: "event": "started", 2023-08-01T19:55:59.039 INFO:teuthology.orchestra.run.smithi008.stdout: "time": "2023-08-01T19:55:09.283490+0000", 2023-08-01T19:55:59.039 INFO:teuthology.orchestra.run.smithi008.stdout: "duration": 0.00012473700000000001 2023-08-01T19:55:59.039 INFO:teuthology.orchestra.run.smithi008.stdout: }, 2023-08-01T19:55:59.039 INFO:teuthology.orchestra.run.smithi008.stdout: { 2023-08-01T19:55:59.039 INFO:teuthology.orchestra.run.smithi008.stdout: "event": "waiting for subops from 1", 2023-08-01T19:55:59.039 INFO:teuthology.orchestra.run.smithi008.stdout: "time": "2023-08-01T19:55:09.283637+0000", 2023-08-01T19:55:59.040 INFO:teuthology.orchestra.run.smithi008.stdout: "duration": 0.00014715600000000001 2023-08-01T19:55:59.040 INFO:teuthology.orchestra.run.smithi008.stdout: }, 2023-08-01T19:55:59.040 INFO:teuthology.orchestra.run.smithi008.stdout: { 2023-08-01T19:55:59.040 INFO:teuthology.orchestra.run.smithi008.stdout: "event": "op_commit", 2023-08-01T19:55:59.040 INFO:teuthology.orchestra.run.smithi008.stdout: "time": "2023-08-01T19:55:09.288214+0000", 2023-08-01T19:55:59.040 INFO:teuthology.orchestra.run.smithi008.stdout: "duration": 0.0045769560000000001 2023-08-01T19:55:59.040 INFO:teuthology.orchestra.run.smithi008.stdout: }, 2023-08-01T19:55:59.041 INFO:teuthology.orchestra.run.smithi008.stdout: { 2023-08-01T19:55:59.041 INFO:teuthology.orchestra.run.smithi008.stdout: "event": "sub_op_commit_rec", 2023-08-01T19:55:59.041 INFO:teuthology.orchestra.run.smithi008.stdout: "time": "2023-08-01T19:55:09.351721+0000", 2023-08-01T19:55:59.041 INFO:teuthology.orchestra.run.smithi008.stdout: "duration": 0.063507383000000001 2023-08-01T19:55:59.041 INFO:teuthology.orchestra.run.smithi008.stdout: }, 2023-08-01T19:55:59.041 INFO:teuthology.orchestra.run.smithi008.stdout: { 2023-08-01T19:55:59.041 INFO:teuthology.orchestra.run.smithi008.stdout: "event": "commit_sent", 2023-08-01T19:55:59.041 INFO:teuthology.orchestra.run.smithi008.stdout: "time": "2023-08-01T19:55:09.351777+0000", 2023-08-01T19:55:59.042 INFO:teuthology.orchestra.run.smithi008.stdout: "duration": 5.5733999999999999e-05 2023-08-01T19:55:59.042 INFO:teuthology.orchestra.run.smithi008.stdout: }, 2023-08-01T19:55:59.042 INFO:teuthology.orchestra.run.smithi008.stdout: { 2023-08-01T19:55:59.042 INFO:teuthology.orchestra.run.smithi008.stdout: "event": "done", 2023-08-01T19:55:59.042 INFO:teuthology.orchestra.run.smithi008.stdout: "time": "2023-08-01T19:55:09.351817+0000", 2023-08-01T19:55:59.042 INFO:teuthology.orchestra.run.smithi008.stdout: "duration": 3.9765000000000003e-05 2023-08-01T19:55:59.042 INFO:teuthology.orchestra.run.smithi008.stdout: } 2023-08-01T19:55:59.042 INFO:teuthology.orchestra.run.smithi008.stdout: ] 2023-08-01T19:55:59.043 INFO:teuthology.orchestra.run.smithi008.stdout: } 2023-08-01T19:55:59.043 INFO:teuthology.orchestra.run.smithi008.stdout: }, 2023-08-01T19:55:59.043 INFO:teuthology.orchestra.run.smithi008.stdout: { 2023-08-01T19:55:59.043 INFO:teuthology.orchestra.run.smithi008.stdout: "description": "osd_op(client.4668.0:107874 5.3 5:ce4c2799:::benchmark_data_smithi006_114134_object107873:head [set-alloc-hint object_size 65536 write_size 65536,write 0~65536] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e38)", 2023-08-01T19:55:59.043 INFO:teuthology.orchestra.run.smithi008.stdout: "initiated_at": "2023-08-01T19:55:09.286239+0000", 2023-08-01T19:55:59.043 INFO:teuthology.orchestra.run.smithi008.stdout: "age": 49.574848654999997, 2023-08-01T19:55:59.043 INFO:teuthology.orchestra.run.smithi008.stdout: "duration": 0.068224389999999996, 2023-08-01T19:55:59.043 INFO:teuthology.orchestra.run.smithi008.stdout: "type_data": { 2023-08-01T19:55:59.044 INFO:teuthology.orchestra.run.smithi008.stdout: "flag_point": "commit sent; apply or cleanup", 2023-08-01T19:55:59.044 INFO:teuthology.orchestra.run.smithi008.stdout: "client_info": { 2023-08-01T19:55:59.044 INFO:teuthology.orchestra.run.smithi008.stdout: "client": "client.4668", 2023-08-01T19:55:59.044 INFO:teuthology.orchestra.run.smithi008.stdout: "client_addr": "172.21.15.6:0/1709472247", 2023-08-01T19:55:59.044 INFO:teuthology.orchestra.run.smithi008.stdout: "tid": 107874 2023-08-01T19:55:59.044 INFO:teuthology.orchestra.run.smithi008.stdout: }, 2023-08-01T19:55:59.044 INFO:teuthology.orchestra.run.smithi008.stdout: "events": [ 2023-08-01T19:55:59.045 INFO:teuthology.orchestra.run.smithi008.stdout: { 2023-08-01T19:55:59.045 INFO:teuthology.orchestra.run.smithi008.stdout: "event": "initiated", 2023-08-01T19:55:59.045 INFO:teuthology.orchestra.run.smithi008.stdout: "time": "2023-08-01T19:55:09.286239+0000", 2023-08-01T19:55:59.045 INFO:teuthology.orchestra.run.smithi008.stdout: "duration": 0 2023-08-01T19:55:59.045 INFO:teuthology.orchestra.run.smithi008.stdout: }, 2023-08-01T19:55:59.045 INFO:teuthology.orchestra.run.smithi008.stdout: { 2023-08-01T19:55:59.046 INFO:teuthology.orchestra.run.smithi008.stdout: "event": "throttled", 2023-08-01T19:55:59.046 INFO:teuthology.orchestra.run.smithi008.stdout: "time": "2023-08-01T19:55:09.286239+0000", 2023-08-01T19:55:59.046 INFO:teuthology.orchestra.run.smithi008.stdout: "duration": 0 2023-08-01T19:55:59.046 INFO:teuthology.orchestra.run.smithi008.stdout: }, 2023-08-01T19:55:59.046 INFO:teuthology.orchestra.run.smithi008.stdout: { 2023-08-01T19:55:59.046 INFO:teuthology.orchestra.run.smithi008.stdout: "event": "header_read", 2023-08-01T19:55:59.047 INFO:teuthology.orchestra.run.smithi008.stdout: "time": "2023-08-01T19:55:09.286238+0000", 2023-08-01T19:55:59.047 INFO:teuthology.orchestra.run.smithi008.stdout: "duration": 4294967295.999999 2023-08-01T19:55:59.047 INFO:teuthology.orchestra.run.smithi008.stdout: }, 2023-08-01T19:55:59.047 INFO:teuthology.orchestra.run.smithi008.stdout: { 2023-08-01T19:55:59.047 INFO:teuthology.orchestra.run.smithi008.stdout: "event": "all_read", 2023-08-01T19:55:59.047 INFO:teuthology.orchestra.run.smithi008.stdout: "time": "2023-08-01T19:55:09.286310+0000", 2023-08-01T19:55:59.048 INFO:teuthology.orchestra.run.smithi008.stdout: "duration": 7.2583999999999995e-05 2023-08-01T19:55:59.048 INFO:teuthology.orchestra.run.smithi008.stdout: }, 2023-08-01T19:55:59.048 INFO:teuthology.orchestra.run.smithi008.stdout: { 2023-08-01T19:55:59.049 INFO:teuthology.orchestra.run.smithi008.stdout: "event": "dispatched", 2023-08-01T19:55:59.049 INFO:teuthology.orchestra.run.smithi008.stdout: "time": "2023-08-01T19:55:09.286323+0000", 2023-08-01T19:55:59.049 INFO:teuthology.orchestra.run.smithi008.stdout: "duration": 1.3151e-05 2023-08-01T19:55:59.049 INFO:teuthology.orchestra.run.smithi008.stdout: }, 2023-08-01T19:55:59.050 INFO:teuthology.orchestra.run.smithi008.stdout: { 2023-08-01T19:55:59.050 INFO:teuthology.orchestra.run.smithi008.stdout: "event": "queued_for_pg", 2023-08-01T19:55:59.050 INFO:teuthology.orchestra.run.smithi008.stdout: "time": "2023-08-01T19:55:09.286329+0000", 2023-08-01T19:55:59.050 INFO:teuthology.orchestra.run.smithi008.stdout: "duration": 5.8719999999999999e-06 2023-08-01T19:55:59.050 INFO:teuthology.orchestra.run.smithi008.stdout: }, 2023-08-01T19:55:59.051 INFO:teuthology.orchestra.run.smithi008.stdout: { 2023-08-01T19:55:59.051 INFO:teuthology.orchestra.run.smithi008.stdout: "event": "reached_pg", 2023-08-01T19:55:59.051 INFO:teuthology.orchestra.run.smithi008.stdout: "time": "2023-08-01T19:55:09.286392+0000", 2023-08-01T19:55:59.051 INFO:teuthology.orchestra.run.smithi008.stdout: "duration": 6.2378000000000005e-05 2023-08-01T19:55:59.051 INFO:teuthology.orchestra.run.smithi008.stdout: }, 2023-08-01T19:55:59.052 INFO:teuthology.orchestra.run.smithi008.stdout: { 2023-08-01T19:55:59.052 INFO:teuthology.orchestra.run.smithi008.stdout: "event": "started", 2023-08-01T19:55:59.052 INFO:teuthology.orchestra.run.smithi008.stdout: "time": "2023-08-01T19:55:09.286473+0000", 2023-08-01T19:55:59.052 INFO:teuthology.orchestra.run.smithi008.stdout: "duration": 8.1327000000000002e-05 2023-08-01T19:55:59.052 INFO:teuthology.orchestra.run.smithi008.stdout: }, 2023-08-01T19:55:59.052 INFO:teuthology.orchestra.run.smithi008.stdout: { 2023-08-01T19:55:59.052 INFO:teuthology.orchestra.run.smithi008.stdout: "event": "waiting for subops from 1", 2023-08-01T19:55:59.053 INFO:teuthology.orchestra.run.smithi008.stdout: "time": "2023-08-01T19:55:09.286557+0000", 2023-08-01T19:55:59.053 INFO:teuthology.orchestra.run.smithi008.stdout: "duration": 8.4140000000000004e-05 2023-08-01T19:55:59.053 INFO:teuthology.orchestra.run.smithi008.stdout: }, 2023-08-01T19:55:59.053 INFO:teuthology.orchestra.run.smithi008.stdout: { 2023-08-01T19:55:59.053 INFO:teuthology.orchestra.run.smithi008.stdout: "event": "op_commit", 2023-08-01T19:55:59.053 INFO:teuthology.orchestra.run.smithi008.stdout: "time": "2023-08-01T19:55:09.290681+0000", 2023-08-01T19:55:59.053 INFO:teuthology.orchestra.run.smithi008.stdout: "duration": 0.0041242420000000002 2023-08-01T19:55:59.054 INFO:teuthology.orchestra.run.smithi008.stdout: }, 2023-08-01T19:55:59.054 INFO:teuthology.orchestra.run.smithi008.stdout: { 2023-08-01T19:55:59.054 INFO:teuthology.orchestra.run.smithi008.stdout: "event": "sub_op_commit_rec", 2023-08-01T19:55:59.054 INFO:teuthology.orchestra.run.smithi008.stdout: "time": "2023-08-01T19:55:09.354372+0000", 2023-08-01T19:55:59.054 INFO:teuthology.orchestra.run.smithi008.stdout: "duration": 0.063690438000000002 2023-08-01T19:55:59.054 INFO:teuthology.orchestra.run.smithi008.stdout: }, 2023-08-01T19:55:59.054 INFO:teuthology.orchestra.run.smithi008.stdout: { 2023-08-01T19:55:59.054 INFO:teuthology.orchestra.run.smithi008.stdout: "event": "commit_sent", 2023-08-01T19:55:59.055 INFO:teuthology.orchestra.run.smithi008.stdout: "time": "2023-08-01T19:55:09.354421+0000", 2023-08-01T19:55:59.055 INFO:teuthology.orchestra.run.smithi008.stdout: "duration": 4.9413000000000003e-05 2023-08-01T19:55:59.055 INFO:teuthology.orchestra.run.smithi008.stdout: }, 2023-08-01T19:55:59.055 INFO:teuthology.orchestra.run.smithi008.stdout: { 2023-08-01T19:55:59.055 INFO:teuthology.orchestra.run.smithi008.stdout: "event": "done", 2023-08-01T19:55:59.055 INFO:teuthology.orchestra.run.smithi008.stdout: "time": "2023-08-01T19:55:09.354463+0000", 2023-08-01T19:55:59.055 INFO:teuthology.orchestra.run.smithi008.stdout: "duration": 4.1924e-05 2023-08-01T19:55:59.055 INFO:teuthology.orchestra.run.smithi008.stdout: } 2023-08-01T19:55:59.056 INFO:teuthology.orchestra.run.smithi008.stdout: ] 2023-08-01T19:55:59.056 INFO:teuthology.orchestra.run.smithi008.stdout: } 2023-08-01T19:55:59.056 INFO:teuthology.orchestra.run.smithi008.stdout: }, 2023-08-01T19:55:59.056 INFO:teuthology.orchestra.run.smithi008.stdout: { 2023-08-01T19:55:59.056 INFO:teuthology.orchestra.run.smithi008.stdout: "description": "osd_op(client.4668.0:107875 5.5 5:af4ec927:::benchmark_data_smithi006_114134_object107874:head [set-alloc-hint object_size 65536 write_size 65536,write 0~65536] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e38)", 2023-08-01T19:55:59.056 INFO:teuthology.orchestra.run.smithi008.stdout: "initiated_at": "2023-08-01T19:55:09.287186+0000", 2023-08-01T19:55:59.056 INFO:teuthology.orchestra.run.smithi008.stdout: "age": 49.573900868000003, 2023-08-01T19:55:59.057 INFO:teuthology.orchestra.run.smithi008.stdout: "duration": 0.064764719999999998, 2023-08-01T19:55:59.057 INFO:teuthology.orchestra.run.smithi008.stdout: "type_data": { 2023-08-01T19:55:59.057 INFO:teuthology.orchestra.run.smithi008.stdout: "flag_point": "commit sent; apply or cleanup", 2023-08-01T19:55:59.057 INFO:teuthology.orchestra.run.smithi008.stdout: "client_info": { 2023-08-01T19:55:59.057 INFO:teuthology.orchestra.run.smithi008.stdout: "client": "client.4668", 2023-08-01T19:55:59.057 INFO:teuthology.orchestra.run.smithi008.stdout: "client_addr": "172.21.15.6:0/1709472247", 2023-08-01T19:55:59.057 INFO:teuthology.orchestra.run.smithi008.stdout: "tid": 107875 2023-08-01T19:55:59.057 INFO:teuthology.orchestra.run.smithi008.stdout: }, 2023-08-01T19:55:59.058 INFO:teuthology.orchestra.run.smithi008.stdout: "events": [ 2023-08-01T19:55:59.058 INFO:teuthology.orchestra.run.smithi008.stdout: { 2023-08-01T19:55:59.058 INFO:teuthology.orchestra.run.smithi008.stdout: "event": "initiated", 2023-08-01T19:55:59.058 INFO:teuthology.orchestra.run.smithi008.stdout: "time": "2023-08-01T19:55:09.287186+0000", 2023-08-01T19:55:59.058 INFO:teuthology.orchestra.run.smithi008.stdout: "duration": 0 2023-08-01T19:55:59.058 INFO:teuthology.orchestra.run.smithi008.stdout: }, 2023-08-01T19:55:59.058 INFO:teuthology.orchestra.run.smithi008.stdout: { 2023-08-01T19:55:59.058 INFO:teuthology.orchestra.run.smithi008.stdout: "event": "throttled", 2023-08-01T19:55:59.059 INFO:teuthology.orchestra.run.smithi008.stdout: "time": "2023-08-01T19:55:09.287186+0000", 2023-08-01T19:55:59.059 INFO:teuthology.orchestra.run.smithi008.stdout: "duration": 0 2023-08-01T19:55:59.059 INFO:teuthology.orchestra.run.smithi008.stdout: }, 2023-08-01T19:55:59.059 INFO:teuthology.orchestra.run.smithi008.stdout: { 2023-08-01T19:55:59.059 INFO:teuthology.orchestra.run.smithi008.stdout: "event": "header_read", 2023-08-01T19:55:59.059 INFO:teuthology.orchestra.run.smithi008.stdout: "time": "2023-08-01T19:55:09.287186+0000", 2023-08-01T19:55:59.059 INFO:teuthology.orchestra.run.smithi008.stdout: "duration": 4294967295.999999 2023-08-01T19:55:59.059 INFO:teuthology.orchestra.run.smithi008.stdout: }, 2023-08-01T19:55:59.060 INFO:teuthology.orchestra.run.smithi008.stdout: { 2023-08-01T19:55:59.060 INFO:teuthology.orchestra.run.smithi008.stdout: "event": "all_read", 2023-08-01T19:55:59.060 INFO:teuthology.orchestra.run.smithi008.stdout: "time": "2023-08-01T19:55:09.287248+0000", 2023-08-01T19:55:59.060 INFO:teuthology.orchestra.run.smithi008.stdout: "duration": 6.2922000000000005e-05 2023-08-01T19:55:59.060 INFO:teuthology.orchestra.run.smithi008.stdout: }, 2023-08-01T19:55:59.060 INFO:teuthology.orchestra.run.smithi008.stdout: { 2023-08-01T19:55:59.060 INFO:teuthology.orchestra.run.smithi008.stdout: "event": "dispatched", 2023-08-01T19:55:59.061 INFO:teuthology.orchestra.run.smithi008.stdout: "time": "2023-08-01T19:55:09.287261+0000", 2023-08-01T19:55:59.061 INFO:teuthology.orchestra.run.smithi008.stdout: "duration": 1.2364000000000001e-05 2023-08-01T19:55:59.061 INFO:teuthology.orchestra.run.smithi008.stdout: }, 2023-08-01T19:55:59.061 INFO:teuthology.orchestra.run.smithi008.stdout: { 2023-08-01T19:55:59.061 INFO:teuthology.orchestra.run.smithi008.stdout: "event": "queued_for_pg", 2023-08-01T19:55:59.061 INFO:teuthology.orchestra.run.smithi008.stdout: "time": "2023-08-01T19:55:09.287267+0000", 2023-08-01T19:55:59.061 INFO:teuthology.orchestra.run.smithi008.stdout: "duration": 6.2580000000000001e-06 2023-08-01T19:55:59.061 INFO:teuthology.orchestra.run.smithi008.stdout: }, 2023-08-01T19:55:59.062 INFO:teuthology.orchestra.run.smithi008.stdout: { 2023-08-01T19:55:59.062 INFO:teuthology.orchestra.run.smithi008.stdout: "event": "reached_pg", 2023-08-01T19:55:59.062 INFO:teuthology.orchestra.run.smithi008.stdout: "time": "2023-08-01T19:55:09.287306+0000", 2023-08-01T19:55:59.062 INFO:teuthology.orchestra.run.smithi008.stdout: "duration": 3.9057999999999998e-05 2023-08-01T19:55:59.062 INFO:teuthology.orchestra.run.smithi008.stdout: }, 2023-08-01T19:55:59.062 INFO:teuthology.orchestra.run.smithi008.stdout: { 2023-08-01T19:55:59.062 INFO:teuthology.orchestra.run.smithi008.stdout: "event": "started", 2023-08-01T19:55:59.062 INFO:teuthology.orchestra.run.smithi008.stdout: "time": "2023-08-01T19:55:09.287419+0000", 2023-08-01T19:55:59.063 INFO:teuthology.orchestra.run.smithi008.stdout: "duration": 0.000112843 2023-08-01T19:55:59.063 INFO:teuthology.orchestra.run.smithi008.stdout: }, 2023-08-01T19:55:59.063 INFO:teuthology.orchestra.run.smithi008.stdout: { 2023-08-01T19:55:59.063 INFO:teuthology.orchestra.run.smithi008.stdout: "event": "waiting for subops from 1", 2023-08-01T19:55:59.063 INFO:teuthology.orchestra.run.smithi008.stdout: "time": "2023-08-01T19:55:09.287514+0000", 2023-08-01T19:55:59.063 INFO:teuthology.orchestra.run.smithi008.stdout: "duration": 9.5068000000000005e-05 2023-08-01T19:55:59.063 INFO:teuthology.orchestra.run.smithi008.stdout: }, 2023-08-01T19:55:59.063 INFO:teuthology.orchestra.run.smithi008.stdout: { 2023-08-01T19:55:59.064 INFO:teuthology.orchestra.run.smithi008.stdout: "event": "op_commit", 2023-08-01T19:55:59.064 INFO:teuthology.orchestra.run.smithi008.stdout: "time": "2023-08-01T19:55:09.293891+0000", 2023-08-01T19:55:59.064 INFO:teuthology.orchestra.run.smithi008.stdout: "duration": 0.00637712 2023-08-01T19:55:59.064 INFO:teuthology.orchestra.run.smithi008.stdout: }, 2023-08-01T19:55:59.064 INFO:teuthology.orchestra.run.smithi008.stdout: { 2023-08-01T19:55:59.064 INFO:teuthology.orchestra.run.smithi008.stdout: "event": "sub_op_commit_rec", 2023-08-01T19:55:59.064 INFO:teuthology.orchestra.run.smithi008.stdout: "time": "2023-08-01T19:55:09.351871+0000", 2023-08-01T19:55:59.065 INFO:teuthology.orchestra.run.smithi008.stdout: "duration": 0.057980054000000003 2023-08-01T19:55:59.065 INFO:teuthology.orchestra.run.smithi008.stdout: }, 2023-08-01T19:55:59.065 INFO:teuthology.orchestra.run.smithi008.stdout: { 2023-08-01T19:55:59.065 INFO:teuthology.orchestra.run.smithi008.stdout: "event": "commit_sent", 2023-08-01T19:55:59.065 INFO:teuthology.orchestra.run.smithi008.stdout: "time": "2023-08-01T19:55:09.351917+0000", 2023-08-01T19:55:59.065 INFO:teuthology.orchestra.run.smithi008.stdout: "duration": 4.5501999999999999e-05 2023-08-01T19:55:59.065 INFO:teuthology.orchestra.run.smithi008.stdout: }, 2023-08-01T19:55:59.065 INFO:teuthology.orchestra.run.smithi008.stdout: { 2023-08-01T19:55:59.066 INFO:teuthology.orchestra.run.smithi008.stdout: "event": "done", 2023-08-01T19:55:59.066 INFO:teuthology.orchestra.run.smithi008.stdout: "time": "2023-08-01T19:55:09.351951+0000", 2023-08-01T19:55:59.066 INFO:teuthology.orchestra.run.smithi008.stdout: "duration": 3.4450999999999999e-05 2023-08-01T19:55:59.066 INFO:teuthology.orchestra.run.smithi008.stdout: } 2023-08-01T19:55:59.066 INFO:teuthology.orchestra.run.smithi008.stdout: ] 2023-08-01T19:55:59.066 INFO:teuthology.orchestra.run.smithi008.stdout: } 2023-08-01T19:55:59.066 INFO:teuthology.orchestra.run.smithi008.stdout: }, 2023-08-01T19:55:59.066 INFO:teuthology.orchestra.run.smithi008.stdout: { 2023-08-01T19:55:59.067 INFO:teuthology.orchestra.run.smithi008.stdout: "description": "osd_op(client.4668.0:107880 5.5 5:a8d12d4b:::benchmark_data_smithi006_114134_object107879:head [set-alloc-hint object_size 65536 write_size 65536,write 0~65536] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e38)", 2023-08-01T19:55:59.067 INFO:teuthology.orchestra.run.smithi008.stdout: "initiated_at": "2023-08-01T19:55:09.292335+0000", 2023-08-01T19:55:59.067 INFO:teuthology.orchestra.run.smithi008.stdout: "age": 49.568752267000001, 2023-08-01T19:55:59.067 INFO:teuthology.orchestra.run.smithi008.stdout: "duration": 0.061350719999999997, 2023-08-01T19:55:59.067 INFO:teuthology.orchestra.run.smithi008.stdout: "type_data": { 2023-08-01T19:55:59.067 INFO:teuthology.orchestra.run.smithi008.stdout: "flag_point": "commit sent; apply or cleanup", 2023-08-01T19:55:59.067 INFO:teuthology.orchestra.run.smithi008.stdout: "client_info": { 2023-08-01T19:55:59.067 INFO:teuthology.orchestra.run.smithi008.stdout: "client": "client.4668", 2023-08-01T19:55:59.068 INFO:teuthology.orchestra.run.smithi008.stdout: "client_addr": "172.21.15.6:0/1709472247", 2023-08-01T19:55:59.068 INFO:teuthology.orchestra.run.smithi008.stdout: "tid": 107880 2023-08-01T19:55:59.068 INFO:teuthology.orchestra.run.smithi008.stdout: }, 2023-08-01T19:55:59.068 INFO:teuthology.orchestra.run.smithi008.stdout: "events": [ 2023-08-01T19:55:59.068 INFO:teuthology.orchestra.run.smithi008.stdout: { 2023-08-01T19:55:59.068 INFO:teuthology.orchestra.run.smithi008.stdout: "event": "initiated", 2023-08-01T19:55:59.068 INFO:teuthology.orchestra.run.smithi008.stdout: "time": "2023-08-01T19:55:09.292335+0000", 2023-08-01T19:55:59.069 INFO:teuthology.orchestra.run.smithi008.stdout: "duration": 0 2023-08-01T19:55:59.069 INFO:teuthology.orchestra.run.smithi008.stdout: }, 2023-08-01T19:55:59.069 INFO:teuthology.orchestra.run.smithi008.stdout: { 2023-08-01T19:55:59.069 INFO:teuthology.orchestra.run.smithi008.stdout: "event": "throttled", 2023-08-01T19:55:59.069 INFO:teuthology.orchestra.run.smithi008.stdout: "time": "2023-08-01T19:55:09.292335+0000", 2023-08-01T19:55:59.069 INFO:teuthology.orchestra.run.smithi008.stdout: "duration": 0 2023-08-01T19:55:59.069 INFO:teuthology.orchestra.run.smithi008.stdout: }, 2023-08-01T19:55:59.069 INFO:teuthology.orchestra.run.smithi008.stdout: { 2023-08-01T19:55:59.070 INFO:teuthology.orchestra.run.smithi008.stdout: "event": "header_read", 2023-08-01T19:55:59.070 INFO:teuthology.orchestra.run.smithi008.stdout: "time": "2023-08-01T19:55:09.292334+0000", 2023-08-01T19:55:59.070 INFO:teuthology.orchestra.run.smithi008.stdout: "duration": 4294967295.999999 2023-08-01T19:55:59.070 INFO:teuthology.orchestra.run.smithi008.stdout: }, 2023-08-01T19:55:59.070 INFO:teuthology.orchestra.run.smithi008.stdout: { 2023-08-01T19:55:59.070 INFO:teuthology.orchestra.run.smithi008.stdout: "event": "all_read", 2023-08-01T19:55:59.070 INFO:teuthology.orchestra.run.smithi008.stdout: "time": "2023-08-01T19:55:09.292449+0000", 2023-08-01T19:55:59.070 INFO:teuthology.orchestra.run.smithi008.stdout: "duration": 0.00011551400000000001 2023-08-01T19:55:59.071 INFO:teuthology.orchestra.run.smithi008.stdout: }, 2023-08-01T19:55:59.071 INFO:teuthology.orchestra.run.smithi008.stdout: { 2023-08-01T19:55:59.071 INFO:teuthology.orchestra.run.smithi008.stdout: "event": "dispatched", 2023-08-01T19:55:59.071 INFO:teuthology.orchestra.run.smithi008.stdout: "time": "2023-08-01T19:55:09.292461+0000", 2023-08-01T19:55:59.071 INFO:teuthology.orchestra.run.smithi008.stdout: "duration": 1.1287000000000001e-05 2023-08-01T19:55:59.071 INFO:teuthology.orchestra.run.smithi008.stdout: }, 2023-08-01T19:55:59.071 INFO:teuthology.orchestra.run.smithi008.stdout: { 2023-08-01T19:55:59.071 INFO:teuthology.orchestra.run.smithi008.stdout: "event": "queued_for_pg", 2023-08-01T19:55:59.072 INFO:teuthology.orchestra.run.smithi008.stdout: "time": "2023-08-01T19:55:09.292467+0000", 2023-08-01T19:55:59.072 INFO:teuthology.orchestra.run.smithi008.stdout: "duration": 6.4520000000000002e-06 2023-08-01T19:55:59.072 INFO:teuthology.orchestra.run.smithi008.stdout: }, 2023-08-01T19:55:59.072 INFO:teuthology.orchestra.run.smithi008.stdout: { 2023-08-01T19:55:59.072 INFO:teuthology.orchestra.run.smithi008.stdout: "event": "reached_pg", 2023-08-01T19:55:59.072 INFO:teuthology.orchestra.run.smithi008.stdout: "time": "2023-08-01T19:55:09.292510+0000", 2023-08-01T19:55:59.072 INFO:teuthology.orchestra.run.smithi008.stdout: "duration": 4.2502000000000001e-05 2023-08-01T19:55:59.072 INFO:teuthology.orchestra.run.smithi008.stdout: }, 2023-08-01T19:55:59.073 INFO:teuthology.orchestra.run.smithi008.stdout: { 2023-08-01T19:55:59.073 INFO:teuthology.orchestra.run.smithi008.stdout: "event": "started", 2023-08-01T19:55:59.073 INFO:teuthology.orchestra.run.smithi008.stdout: "time": "2023-08-01T19:55:09.292596+0000", 2023-08-01T19:55:59.073 INFO:teuthology.orchestra.run.smithi008.stdout: "duration": 8.6545000000000006e-05 2023-08-01T19:55:59.073 INFO:teuthology.orchestra.run.smithi008.stdout: }, 2023-08-01T19:55:59.073 INFO:teuthology.orchestra.run.smithi008.stdout: { 2023-08-01T19:55:59.073 INFO:teuthology.orchestra.run.smithi008.stdout: "event": "waiting for subops from 1", 2023-08-01T19:55:59.074 INFO:teuthology.orchestra.run.smithi008.stdout: "time": "2023-08-01T19:55:09.292697+0000", 2023-08-01T19:55:59.074 INFO:teuthology.orchestra.run.smithi008.stdout: "duration": 0.000100368 2023-08-01T19:55:59.074 INFO:teuthology.orchestra.run.smithi008.stdout: }, 2023-08-01T19:55:59.074 INFO:teuthology.orchestra.run.smithi008.stdout: { 2023-08-01T19:55:59.074 INFO:teuthology.orchestra.run.smithi008.stdout: "event": "op_commit", 2023-08-01T19:55:59.074 INFO:teuthology.orchestra.run.smithi008.stdout: "time": "2023-08-01T19:55:09.295658+0000", 2023-08-01T19:55:59.074 INFO:teuthology.orchestra.run.smithi008.stdout: "duration": 0.0029617290000000002 2023-08-01T19:55:59.074 INFO:teuthology.orchestra.run.smithi008.stdout: }, 2023-08-01T19:55:59.075 INFO:teuthology.orchestra.run.smithi008.stdout: { 2023-08-01T19:55:59.075 INFO:teuthology.orchestra.run.smithi008.stdout: "event": "sub_op_commit_rec", 2023-08-01T19:55:59.075 INFO:teuthology.orchestra.run.smithi008.stdout: "time": "2023-08-01T19:55:09.353604+0000", 2023-08-01T19:55:59.075 INFO:teuthology.orchestra.run.smithi008.stdout: "duration": 0.057945868999999997 2023-08-01T19:55:59.075 INFO:teuthology.orchestra.run.smithi008.stdout: }, 2023-08-01T19:55:59.075 INFO:teuthology.orchestra.run.smithi008.stdout: { 2023-08-01T19:55:59.075 INFO:teuthology.orchestra.run.smithi008.stdout: "event": "commit_sent", 2023-08-01T19:55:59.075 INFO:teuthology.orchestra.run.smithi008.stdout: "time": "2023-08-01T19:55:09.353650+0000", 2023-08-01T19:55:59.076 INFO:teuthology.orchestra.run.smithi008.stdout: "duration": 4.5698999999999997e-05 2023-08-01T19:55:59.076 INFO:teuthology.orchestra.run.smithi008.stdout: }, 2023-08-01T19:55:59.076 INFO:teuthology.orchestra.run.smithi008.stdout: { 2023-08-01T19:55:59.076 INFO:teuthology.orchestra.run.smithi008.stdout: "event": "done", 2023-08-01T19:55:59.076 INFO:teuthology.orchestra.run.smithi008.stdout: "time": "2023-08-01T19:55:09.353686+0000", 2023-08-01T19:55:59.076 INFO:teuthology.orchestra.run.smithi008.stdout: "duration": 3.5936999999999998e-05 2023-08-01T19:55:59.076 INFO:teuthology.orchestra.run.smithi008.stdout: } 2023-08-01T19:55:59.077 INFO:teuthology.orchestra.run.smithi008.stdout: ] 2023-08-01T19:55:59.077 INFO:teuthology.orchestra.run.smithi008.stdout: } 2023-08-01T19:55:59.077 INFO:teuthology.orchestra.run.smithi008.stdout: } 2023-08-01T19:55:59.077 INFO:teuthology.orchestra.run.smithi008.stdout: ] 2023-08-01T19:55:59.077 INFO:teuthology.orchestra.run.smithi008.stdout:} 2023-08-01T19:55:59.078 DEBUG:teuthology.orchestra.run.smithi155:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 30 ceph --cluster ceph --admin-daemon /var/run/ceph/ceph-osd.2.asok dump_ops_in_flight 2023-08-01T19:55:59.079 INFO:tasks.ceph.osd.2.smithi155.stderr:2023-08-01T19:55:59.077+0000 7faa5c6ac700 -1 received signal: Hangup from /usr/bin/python3 /bin/daemon-helper kill ceph-osd -f --cluster ceph -i 2 (PID: 111337) UID: 0 2023-08-01T19:55:59.161 DEBUG:teuthology.orchestra.console.smithi101:pexpect command: ipmitool -H smithi101.ipmi.sepia.ceph.com -I lanplus -U inktank -P ApGNXcA7 power status 2023-08-01T19:55:59.180 INFO:tasks.ceph.osd.2.smithi155.stderr:2023-08-01T19:55:59.178+0000 7faa5c6ac700 -1 received signal: Hangup from /usr/bin/python3 /bin/daemon-helper kill ceph-osd -f --cluster ceph -i 2 (PID: 111337) UID: 0 2023-08-01T19:55:59.207 INFO:teuthology.orchestra.run.smithi155.stdout:{ 2023-08-01T19:55:59.208 INFO:teuthology.orchestra.run.smithi155.stdout: "ops": [ 2023-08-01T19:55:59.208 INFO:teuthology.orchestra.run.smithi155.stdout: { 2023-08-01T19:55:59.208 INFO:teuthology.orchestra.run.smithi155.stdout: "description": "osd_op(client.4668.0:197408 5.d 5.5aec5bdd (undecoded) ondisk+write+known_if_redirected+supports_pool_eio e61)", 2023-08-01T19:55:59.208 INFO:teuthology.orchestra.run.smithi155.stdout: "initiated_at": "2023-08-01T19:55:58.559714+0000", 2023-08-01T19:55:59.208 INFO:teuthology.orchestra.run.smithi155.stdout: "age": 0.64709436099999995, 2023-08-01T19:55:59.208 INFO:teuthology.orchestra.run.smithi155.stdout: "duration": 0.64711603299999998, 2023-08-01T19:55:59.209 INFO:teuthology.orchestra.run.smithi155.stdout: "type_data": { 2023-08-01T19:55:59.209 INFO:teuthology.orchestra.run.smithi155.stdout: "flag_point": "delayed", 2023-08-01T19:55:59.209 INFO:teuthology.orchestra.run.smithi155.stdout: "client_info": { 2023-08-01T19:55:59.209 INFO:teuthology.orchestra.run.smithi155.stdout: "client": "client.4668", 2023-08-01T19:55:59.209 INFO:teuthology.orchestra.run.smithi155.stdout: "client_addr": "172.21.15.6:0/1709472247", 2023-08-01T19:55:59.209 INFO:teuthology.orchestra.run.smithi155.stdout: "tid": 197408 2023-08-01T19:55:59.209 INFO:teuthology.orchestra.run.smithi155.stdout: }, 2023-08-01T19:55:59.210 INFO:teuthology.orchestra.run.smithi155.stdout: "events": [ 2023-08-01T19:55:59.210 INFO:teuthology.orchestra.run.smithi155.stdout: { 2023-08-01T19:55:59.210 INFO:teuthology.orchestra.run.smithi155.stdout: "event": "initiated", 2023-08-01T19:55:59.210 INFO:teuthology.orchestra.run.smithi155.stdout: "time": "2023-08-01T19:55:58.559714+0000", 2023-08-01T19:55:59.210 INFO:teuthology.orchestra.run.smithi155.stdout: "duration": 0 2023-08-01T19:55:59.210 INFO:teuthology.orchestra.run.smithi155.stdout: }, 2023-08-01T19:55:59.210 INFO:teuthology.orchestra.run.smithi155.stdout: { 2023-08-01T19:55:59.210 INFO:teuthology.orchestra.run.smithi155.stdout: "event": "throttled", 2023-08-01T19:55:59.211 INFO:teuthology.orchestra.run.smithi155.stdout: "time": "2023-08-01T19:55:58.559714+0000", 2023-08-01T19:55:59.211 INFO:teuthology.orchestra.run.smithi155.stdout: "duration": 0 2023-08-01T19:55:59.211 INFO:teuthology.orchestra.run.smithi155.stdout: }, 2023-08-01T19:55:59.211 INFO:teuthology.orchestra.run.smithi155.stdout: { 2023-08-01T19:55:59.211 INFO:teuthology.orchestra.run.smithi155.stdout: "event": "header_read", 2023-08-01T19:55:59.211 INFO:teuthology.orchestra.run.smithi155.stdout: "time": "2023-08-01T19:55:58.559713+0000", 2023-08-01T19:55:59.211 INFO:teuthology.orchestra.run.smithi155.stdout: "duration": 4294967295.999999 2023-08-01T19:55:59.212 INFO:teuthology.orchestra.run.smithi155.stdout: }, 2023-08-01T19:55:59.212 INFO:teuthology.orchestra.run.smithi155.stdout: { 2023-08-01T19:55:59.212 INFO:teuthology.orchestra.run.smithi155.stdout: "event": "all_read", 2023-08-01T19:55:59.212 INFO:teuthology.orchestra.run.smithi155.stdout: "time": "2023-08-01T19:55:58.559717+0000", 2023-08-01T19:55:59.212 INFO:teuthology.orchestra.run.smithi155.stdout: "duration": 4.2860000000000001e-06 2023-08-01T19:55:59.212 INFO:teuthology.orchestra.run.smithi155.stdout: }, 2023-08-01T19:55:59.212 INFO:teuthology.orchestra.run.smithi155.stdout: { 2023-08-01T19:55:59.212 INFO:teuthology.orchestra.run.smithi155.stdout: "event": "dispatched", 2023-08-01T19:55:59.213 INFO:teuthology.orchestra.run.smithi155.stdout: "time": "2023-08-01T19:55:58.559774+0000", 2023-08-01T19:55:59.213 INFO:teuthology.orchestra.run.smithi155.stdout: "duration": 5.6508999999999997e-05 2023-08-01T19:55:59.213 INFO:teuthology.orchestra.run.smithi155.stdout: }, 2023-08-01T19:55:59.213 INFO:teuthology.orchestra.run.smithi155.stdout: { 2023-08-01T19:55:59.213 INFO:teuthology.orchestra.run.smithi155.stdout: "event": "queued_for_pg", 2023-08-01T19:55:59.213 INFO:teuthology.orchestra.run.smithi155.stdout: "time": "2023-08-01T19:55:58.559781+0000", 2023-08-01T19:55:59.213 INFO:teuthology.orchestra.run.smithi155.stdout: "duration": 7.1829999999999997e-06 2023-08-01T19:55:59.214 INFO:teuthology.orchestra.run.smithi155.stdout: }, 2023-08-01T19:55:59.214 INFO:teuthology.orchestra.run.smithi155.stdout: { 2023-08-01T19:55:59.214 INFO:teuthology.orchestra.run.smithi155.stdout: "event": "reached_pg", 2023-08-01T19:55:59.214 INFO:teuthology.orchestra.run.smithi155.stdout: "time": "2023-08-01T19:55:58.571621+0000", 2023-08-01T19:55:59.214 INFO:teuthology.orchestra.run.smithi155.stdout: "duration": 0.011840603999999999 2023-08-01T19:55:59.214 INFO:teuthology.orchestra.run.smithi155.stdout: }, 2023-08-01T19:55:59.214 INFO:teuthology.orchestra.run.smithi155.stdout: { 2023-08-01T19:55:59.214 INFO:teuthology.orchestra.run.smithi155.stdout: "event": "waiting for peered", 2023-08-01T19:55:59.215 INFO:teuthology.orchestra.run.smithi155.stdout: "time": "2023-08-01T19:55:58.571630+0000", 2023-08-01T19:55:59.215 INFO:teuthology.orchestra.run.smithi155.stdout: "duration": 8.9770000000000006e-06 2023-08-01T19:55:59.215 INFO:teuthology.orchestra.run.smithi155.stdout: } 2023-08-01T19:55:59.215 INFO:teuthology.orchestra.run.smithi155.stdout: ] 2023-08-01T19:55:59.215 INFO:teuthology.orchestra.run.smithi155.stdout: } 2023-08-01T19:55:59.215 INFO:teuthology.orchestra.run.smithi155.stdout: }, 2023-08-01T19:55:59.215 INFO:teuthology.orchestra.run.smithi155.stdout: { 2023-08-01T19:55:59.215 INFO:teuthology.orchestra.run.smithi155.stdout: "description": "osd_op(client.4668.0:197416 5.d 5.b66799bd (undecoded) ondisk+write+known_if_redirected+supports_pool_eio e62)", 2023-08-01T19:55:59.216 INFO:teuthology.orchestra.run.smithi155.stdout: "initiated_at": "2023-08-01T19:55:58.577369+0000", 2023-08-01T19:55:59.216 INFO:teuthology.orchestra.run.smithi155.stdout: "age": 0.62943938399999999, 2023-08-01T19:55:59.216 INFO:teuthology.orchestra.run.smithi155.stdout: "duration": 0.62950582600000005, 2023-08-01T19:55:59.216 INFO:teuthology.orchestra.run.smithi155.stdout: "type_data": { 2023-08-01T19:55:59.216 INFO:teuthology.orchestra.run.smithi155.stdout: "flag_point": "delayed", 2023-08-01T19:55:59.216 INFO:teuthology.orchestra.run.smithi155.stdout: "client_info": { 2023-08-01T19:55:59.217 INFO:teuthology.orchestra.run.smithi155.stdout: "client": "client.4668", 2023-08-01T19:55:59.217 INFO:teuthology.orchestra.run.smithi155.stdout: "client_addr": "172.21.15.6:0/1709472247", 2023-08-01T19:55:59.217 INFO:teuthology.orchestra.run.smithi155.stdout: "tid": 197416 2023-08-01T19:55:59.217 INFO:teuthology.orchestra.run.smithi155.stdout: }, 2023-08-01T19:55:59.217 INFO:teuthology.orchestra.run.smithi155.stdout: "events": [ 2023-08-01T19:55:59.217 INFO:teuthology.orchestra.run.smithi155.stdout: { 2023-08-01T19:55:59.217 INFO:teuthology.orchestra.run.smithi155.stdout: "event": "initiated", 2023-08-01T19:55:59.218 INFO:teuthology.orchestra.run.smithi155.stdout: "time": "2023-08-01T19:55:58.577369+0000", 2023-08-01T19:55:59.218 INFO:teuthology.orchestra.run.smithi155.stdout: "duration": 0 2023-08-01T19:55:59.218 INFO:teuthology.orchestra.run.smithi155.stdout: }, 2023-08-01T19:55:59.218 INFO:teuthology.orchestra.run.smithi155.stdout: { 2023-08-01T19:55:59.218 INFO:teuthology.orchestra.run.smithi155.stdout: "event": "throttled", 2023-08-01T19:55:59.218 INFO:teuthology.orchestra.run.smithi155.stdout: "time": "2023-08-01T19:55:58.577369+0000", 2023-08-01T19:55:59.218 INFO:teuthology.orchestra.run.smithi155.stdout: "duration": 0 2023-08-01T19:55:59.219 INFO:teuthology.orchestra.run.smithi155.stdout: }, 2023-08-01T19:55:59.219 INFO:teuthology.orchestra.run.smithi155.stdout: { 2023-08-01T19:55:59.219 INFO:teuthology.orchestra.run.smithi155.stdout: "event": "header_read", 2023-08-01T19:55:59.219 INFO:teuthology.orchestra.run.smithi155.stdout: "time": "2023-08-01T19:55:58.577368+0000", 2023-08-01T19:55:59.219 INFO:teuthology.orchestra.run.smithi155.stdout: "duration": 4294967295.9999995 2023-08-01T19:55:59.219 INFO:teuthology.orchestra.run.smithi155.stdout: }, 2023-08-01T19:55:59.219 INFO:teuthology.orchestra.run.smithi155.stdout: { 2023-08-01T19:55:59.219 INFO:teuthology.orchestra.run.smithi155.stdout: "event": "all_read", 2023-08-01T19:55:59.220 INFO:teuthology.orchestra.run.smithi155.stdout: "time": "2023-08-01T19:55:58.577370+0000", 2023-08-01T19:55:59.220 INFO:teuthology.orchestra.run.smithi155.stdout: "duration": 2.1150000000000001e-06 2023-08-01T19:55:59.220 INFO:teuthology.orchestra.run.smithi155.stdout: }, 2023-08-01T19:55:59.220 INFO:teuthology.orchestra.run.smithi155.stdout: { 2023-08-01T19:55:59.220 INFO:teuthology.orchestra.run.smithi155.stdout: "event": "dispatched", 2023-08-01T19:55:59.220 INFO:teuthology.orchestra.run.smithi155.stdout: "time": "2023-08-01T19:55:58.577377+0000", 2023-08-01T19:55:59.221 INFO:teuthology.orchestra.run.smithi155.stdout: "duration": 6.6610000000000003e-06 2023-08-01T19:55:59.221 INFO:teuthology.orchestra.run.smithi155.stdout: }, 2023-08-01T19:55:59.221 INFO:teuthology.orchestra.run.smithi155.stdout: { 2023-08-01T19:55:59.221 INFO:teuthology.orchestra.run.smithi155.stdout: "event": "queued_for_pg", 2023-08-01T19:55:59.221 INFO:teuthology.orchestra.run.smithi155.stdout: "time": "2023-08-01T19:55:58.577380+0000", 2023-08-01T19:55:59.221 INFO:teuthology.orchestra.run.smithi155.stdout: "duration": 2.7360000000000001e-06 2023-08-01T19:55:59.221 INFO:teuthology.orchestra.run.smithi155.stdout: }, 2023-08-01T19:55:59.222 INFO:teuthology.orchestra.run.smithi155.stdout: { 2023-08-01T19:55:59.222 INFO:teuthology.orchestra.run.smithi155.stdout: "event": "reached_pg", 2023-08-01T19:55:59.222 INFO:teuthology.orchestra.run.smithi155.stdout: "time": "2023-08-01T19:55:58.577405+0000", 2023-08-01T19:55:59.222 INFO:teuthology.orchestra.run.smithi155.stdout: "duration": 2.4929000000000001e-05 2023-08-01T19:55:59.222 INFO:teuthology.orchestra.run.smithi155.stdout: }, 2023-08-01T19:55:59.222 INFO:teuthology.orchestra.run.smithi155.stdout: { 2023-08-01T19:55:59.222 INFO:teuthology.orchestra.run.smithi155.stdout: "event": "waiting for peered", 2023-08-01T19:55:59.222 INFO:teuthology.orchestra.run.smithi155.stdout: "time": "2023-08-01T19:55:58.577409+0000", 2023-08-01T19:55:59.223 INFO:teuthology.orchestra.run.smithi155.stdout: "duration": 4.0799999999999999e-06 2023-08-01T19:55:59.223 INFO:teuthology.orchestra.run.smithi155.stdout: } 2023-08-01T19:55:59.223 INFO:teuthology.orchestra.run.smithi155.stdout: ] 2023-08-01T19:55:59.223 INFO:teuthology.orchestra.run.smithi155.stdout: } 2023-08-01T19:55:59.223 INFO:teuthology.orchestra.run.smithi155.stdout: }, 2023-08-01T19:55:59.223 INFO:teuthology.orchestra.run.smithi155.stdout: { 2023-08-01T19:55:59.223 INFO:teuthology.orchestra.run.smithi155.stdout: "description": "osd_op(client.4668.0:197419 5.d 5.93e3be7d (undecoded) ondisk+write+known_if_redirected+supports_pool_eio e62)", 2023-08-01T19:55:59.224 INFO:teuthology.orchestra.run.smithi155.stdout: "initiated_at": "2023-08-01T19:55:58.580223+0000", 2023-08-01T19:55:59.224 INFO:teuthology.orchestra.run.smithi155.stdout: "age": 0.62658543300000002, 2023-08-01T19:55:59.224 INFO:teuthology.orchestra.run.smithi155.stdout: "duration": 0.62670514200000005, 2023-08-01T19:55:59.224 INFO:teuthology.orchestra.run.smithi155.stdout: "type_data": { 2023-08-01T19:55:59.224 INFO:teuthology.orchestra.run.smithi155.stdout: "flag_point": "delayed", 2023-08-01T19:55:59.224 INFO:teuthology.orchestra.run.smithi155.stdout: "client_info": { 2023-08-01T19:55:59.224 INFO:teuthology.orchestra.run.smithi155.stdout: "client": "client.4668", 2023-08-01T19:55:59.224 INFO:teuthology.orchestra.run.smithi155.stdout: "client_addr": "172.21.15.6:0/1709472247", 2023-08-01T19:55:59.225 INFO:teuthology.orchestra.run.smithi155.stdout: "tid": 197419 2023-08-01T19:55:59.225 INFO:teuthology.orchestra.run.smithi155.stdout: }, 2023-08-01T19:55:59.225 INFO:teuthology.orchestra.run.smithi155.stdout: "events": [ 2023-08-01T19:55:59.225 INFO:teuthology.orchestra.run.smithi155.stdout: { 2023-08-01T19:55:59.225 INFO:teuthology.orchestra.run.smithi155.stdout: "event": "initiated", 2023-08-01T19:55:59.225 INFO:teuthology.orchestra.run.smithi155.stdout: "time": "2023-08-01T19:55:58.580223+0000", 2023-08-01T19:55:59.225 INFO:teuthology.orchestra.run.smithi155.stdout: "duration": 0 2023-08-01T19:55:59.226 INFO:teuthology.orchestra.run.smithi155.stdout: }, 2023-08-01T19:55:59.226 INFO:teuthology.orchestra.run.smithi155.stdout: { 2023-08-01T19:55:59.226 INFO:teuthology.orchestra.run.smithi155.stdout: "event": "throttled", 2023-08-01T19:55:59.226 INFO:teuthology.orchestra.run.smithi155.stdout: "time": "2023-08-01T19:55:58.580223+0000", 2023-08-01T19:55:59.226 INFO:teuthology.orchestra.run.smithi155.stdout: "duration": 0 2023-08-01T19:55:59.226 INFO:teuthology.orchestra.run.smithi155.stdout: }, 2023-08-01T19:55:59.226 INFO:teuthology.orchestra.run.smithi155.stdout: { 2023-08-01T19:55:59.226 INFO:teuthology.orchestra.run.smithi155.stdout: "event": "header_read", 2023-08-01T19:55:59.227 INFO:teuthology.orchestra.run.smithi155.stdout: "time": "2023-08-01T19:55:58.580222+0000", 2023-08-01T19:55:59.227 INFO:teuthology.orchestra.run.smithi155.stdout: "duration": 4294967295.9999995 2023-08-01T19:55:59.227 INFO:teuthology.orchestra.run.smithi155.stdout: }, 2023-08-01T19:55:59.227 INFO:teuthology.orchestra.run.smithi155.stdout: { 2023-08-01T19:55:59.227 INFO:teuthology.orchestra.run.smithi155.stdout: "event": "all_read", 2023-08-01T19:55:59.227 INFO:teuthology.orchestra.run.smithi155.stdout: "time": "2023-08-01T19:55:58.580225+0000", 2023-08-01T19:55:59.227 INFO:teuthology.orchestra.run.smithi155.stdout: "duration": 3.2820000000000001e-06 2023-08-01T19:55:59.227 INFO:teuthology.orchestra.run.smithi155.stdout: }, 2023-08-01T19:55:59.228 INFO:teuthology.orchestra.run.smithi155.stdout: { 2023-08-01T19:55:59.228 INFO:teuthology.orchestra.run.smithi155.stdout: "event": "dispatched", 2023-08-01T19:55:59.228 INFO:teuthology.orchestra.run.smithi155.stdout: "time": "2023-08-01T19:55:58.580233+0000", 2023-08-01T19:55:59.228 INFO:teuthology.orchestra.run.smithi155.stdout: "duration": 7.34e-06 2023-08-01T19:55:59.228 INFO:teuthology.orchestra.run.smithi155.stdout: }, 2023-08-01T19:55:59.228 INFO:teuthology.orchestra.run.smithi155.stdout: { 2023-08-01T19:55:59.228 INFO:teuthology.orchestra.run.smithi155.stdout: "event": "queued_for_pg", 2023-08-01T19:55:59.229 INFO:teuthology.orchestra.run.smithi155.stdout: "time": "2023-08-01T19:55:58.580236+0000", 2023-08-01T19:55:59.229 INFO:teuthology.orchestra.run.smithi155.stdout: "duration": 3.473e-06 2023-08-01T19:55:59.229 INFO:teuthology.orchestra.run.smithi155.stdout: }, 2023-08-01T19:55:59.229 INFO:teuthology.orchestra.run.smithi155.stdout: { 2023-08-01T19:55:59.229 INFO:teuthology.orchestra.run.smithi155.stdout: "event": "reached_pg", 2023-08-01T19:55:59.229 INFO:teuthology.orchestra.run.smithi155.stdout: "time": "2023-08-01T19:55:58.580267+0000", 2023-08-01T19:55:59.229 INFO:teuthology.orchestra.run.smithi155.stdout: "duration": 3.0479000000000001e-05 2023-08-01T19:55:59.229 INFO:teuthology.orchestra.run.smithi155.stdout: }, 2023-08-01T19:55:59.230 INFO:teuthology.orchestra.run.smithi155.stdout: { 2023-08-01T19:55:59.230 INFO:teuthology.orchestra.run.smithi155.stdout: "event": "waiting for peered", 2023-08-01T19:55:59.230 INFO:teuthology.orchestra.run.smithi155.stdout: "time": "2023-08-01T19:55:58.580272+0000", 2023-08-01T19:55:59.230 INFO:teuthology.orchestra.run.smithi155.stdout: "duration": 5.011e-06 2023-08-01T19:55:59.230 INFO:teuthology.orchestra.run.smithi155.stdout: } 2023-08-01T19:55:59.230 INFO:teuthology.orchestra.run.smithi155.stdout: ] 2023-08-01T19:55:59.230 INFO:teuthology.orchestra.run.smithi155.stdout: } 2023-08-01T19:55:59.231 INFO:teuthology.orchestra.run.smithi155.stdout: }, 2023-08-01T19:55:59.231 INFO:teuthology.orchestra.run.smithi155.stdout: { 2023-08-01T19:55:59.231 INFO:teuthology.orchestra.run.smithi155.stdout: "description": "osd_op(client.4668.0:197420 5.9 5.a7f74549 (undecoded) ondisk+write+known_if_redirected+supports_pool_eio e62)", 2023-08-01T19:55:59.231 INFO:teuthology.orchestra.run.smithi155.stdout: "initiated_at": "2023-08-01T19:55:58.582230+0000", 2023-08-01T19:55:59.231 INFO:teuthology.orchestra.run.smithi155.stdout: "age": 0.62457812300000004, 2023-08-01T19:55:59.231 INFO:teuthology.orchestra.run.smithi155.stdout: "duration": 0.62473452299999999, 2023-08-01T19:55:59.231 INFO:teuthology.orchestra.run.smithi155.stdout: "type_data": { 2023-08-01T19:55:59.232 INFO:teuthology.orchestra.run.smithi155.stdout: "flag_point": "delayed", 2023-08-01T19:55:59.232 INFO:teuthology.orchestra.run.smithi155.stdout: "client_info": { 2023-08-01T19:55:59.232 INFO:teuthology.orchestra.run.smithi155.stdout: "client": "client.4668", 2023-08-01T19:55:59.232 INFO:teuthology.orchestra.run.smithi155.stdout: "client_addr": "172.21.15.6:0/1709472247", 2023-08-01T19:55:59.232 INFO:teuthology.orchestra.run.smithi155.stdout: "tid": 197420 2023-08-01T19:55:59.232 INFO:teuthology.orchestra.run.smithi155.stdout: }, 2023-08-01T19:55:59.232 INFO:teuthology.orchestra.run.smithi155.stdout: "events": [ 2023-08-01T19:55:59.233 INFO:teuthology.orchestra.run.smithi155.stdout: { 2023-08-01T19:55:59.233 INFO:teuthology.orchestra.run.smithi155.stdout: "event": "initiated", 2023-08-01T19:55:59.233 INFO:teuthology.orchestra.run.smithi155.stdout: "time": "2023-08-01T19:55:58.582230+0000", 2023-08-01T19:55:59.233 INFO:teuthology.orchestra.run.smithi155.stdout: "duration": 0 2023-08-01T19:55:59.233 INFO:teuthology.orchestra.run.smithi155.stdout: }, 2023-08-01T19:55:59.233 INFO:teuthology.orchestra.run.smithi155.stdout: { 2023-08-01T19:55:59.233 INFO:teuthology.orchestra.run.smithi155.stdout: "event": "throttled", 2023-08-01T19:55:59.234 INFO:teuthology.orchestra.run.smithi155.stdout: "time": "2023-08-01T19:55:58.582230+0000", 2023-08-01T19:55:59.234 INFO:teuthology.orchestra.run.smithi155.stdout: "duration": 0 2023-08-01T19:55:59.234 INFO:teuthology.orchestra.run.smithi155.stdout: }, 2023-08-01T19:55:59.234 INFO:teuthology.orchestra.run.smithi155.stdout: { 2023-08-01T19:55:59.234 INFO:teuthology.orchestra.run.smithi155.stdout: "event": "header_read", 2023-08-01T19:55:59.234 INFO:teuthology.orchestra.run.smithi155.stdout: "time": "2023-08-01T19:55:58.582229+0000", 2023-08-01T19:55:59.234 INFO:teuthology.orchestra.run.smithi155.stdout: "duration": 4294967295.9999995 2023-08-01T19:55:59.235 INFO:teuthology.orchestra.run.smithi155.stdout: }, 2023-08-01T19:55:59.235 INFO:teuthology.orchestra.run.smithi155.stdout: { 2023-08-01T19:55:59.235 INFO:teuthology.orchestra.run.smithi155.stdout: "event": "all_read", 2023-08-01T19:55:59.235 INFO:teuthology.orchestra.run.smithi155.stdout: "time": "2023-08-01T19:55:58.582233+0000", 2023-08-01T19:55:59.235 INFO:teuthology.orchestra.run.smithi155.stdout: "duration": 3.7869999999999999e-06 2023-08-01T19:55:59.235 INFO:teuthology.orchestra.run.smithi155.stdout: }, 2023-08-01T19:55:59.235 INFO:teuthology.orchestra.run.smithi155.stdout: { 2023-08-01T19:55:59.236 INFO:teuthology.orchestra.run.smithi155.stdout: "event": "dispatched", 2023-08-01T19:55:59.236 INFO:teuthology.orchestra.run.smithi155.stdout: "time": "2023-08-01T19:55:58.582241+0000", 2023-08-01T19:55:59.236 INFO:teuthology.orchestra.run.smithi155.stdout: "duration": 7.6909999999999997e-06 2023-08-01T19:55:59.236 INFO:teuthology.orchestra.run.smithi155.stdout: }, 2023-08-01T19:55:59.236 INFO:teuthology.orchestra.run.smithi155.stdout: { 2023-08-01T19:55:59.236 INFO:teuthology.orchestra.run.smithi155.stdout: "event": "queued_for_pg", 2023-08-01T19:55:59.236 INFO:teuthology.orchestra.run.smithi155.stdout: "time": "2023-08-01T19:55:58.582244+0000", 2023-08-01T19:55:59.236 INFO:teuthology.orchestra.run.smithi155.stdout: "duration": 3.6770000000000001e-06 2023-08-01T19:55:59.237 INFO:teuthology.orchestra.run.smithi155.stdout: }, 2023-08-01T19:55:59.237 INFO:teuthology.orchestra.run.smithi155.stdout: { 2023-08-01T19:55:59.237 INFO:teuthology.orchestra.run.smithi155.stdout: "event": "reached_pg", 2023-08-01T19:55:59.237 INFO:teuthology.orchestra.run.smithi155.stdout: "time": "2023-08-01T19:55:58.582274+0000", 2023-08-01T19:55:59.237 INFO:teuthology.orchestra.run.smithi155.stdout: "duration": 3.0074e-05 2023-08-01T19:55:59.237 INFO:teuthology.orchestra.run.smithi155.stdout: }, 2023-08-01T19:55:59.237 INFO:teuthology.orchestra.run.smithi155.stdout: { 2023-08-01T19:55:59.238 INFO:teuthology.orchestra.run.smithi155.stdout: "event": "waiting for peered", 2023-08-01T19:55:59.238 INFO:teuthology.orchestra.run.smithi155.stdout: "time": "2023-08-01T19:55:58.582281+0000", 2023-08-01T19:55:59.238 INFO:teuthology.orchestra.run.smithi155.stdout: "duration": 6.297e-06 2023-08-01T19:55:59.238 INFO:teuthology.orchestra.run.smithi155.stdout: } 2023-08-01T19:55:59.238 INFO:teuthology.orchestra.run.smithi155.stdout: ] 2023-08-01T19:55:59.238 INFO:teuthology.orchestra.run.smithi155.stdout: } 2023-08-01T19:55:59.238 INFO:teuthology.orchestra.run.smithi155.stdout: } 2023-08-01T19:55:59.238 INFO:teuthology.orchestra.run.smithi155.stdout: ], 2023-08-01T19:55:59.239 INFO:teuthology.orchestra.run.smithi155.stdout: "num_ops": 4 2023-08-01T19:55:59.239 INFO:teuthology.orchestra.run.smithi155.stdout:} 2023-08-01T19:55:59.240 DEBUG:teuthology.orchestra.run.smithi155:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 30 ceph --cluster ceph --admin-daemon /var/run/ceph/ceph-osd.2.asok dump_blocked_ops 2023-08-01T19:55:59.273 DEBUG:teuthology.orchestra.console.smithi101:check power output: Chassis Power is on 2023-08-01T19:55:59.280 INFO:tasks.ceph.osd.2.smithi155.stderr:2023-08-01T19:55:59.279+0000 7faa5c6ac700 -1 received signal: Hangup from /usr/bin/python3 /bin/daemon-helper kill ceph-osd -f --cluster ceph -i 2 (PID: 111337) UID: 0 2023-08-01T19:55:59.382 INFO:tasks.ceph.osd.0.smithi008.stderr:2023-08-01T19:55:59.381+0000 7f16a58f4700 -1 received signal: Hangup from /usr/bin/python3 /bin/daemon-helper kill ceph-osd -f --cluster ceph -i 0 (PID: 111179) UID: 0 2023-08-01T19:55:59.402 INFO:teuthology.orchestra.run.smithi155.stdout:{ 2023-08-01T19:55:59.403 INFO:teuthology.orchestra.run.smithi155.stdout: "ops": [], 2023-08-01T19:55:59.403 INFO:teuthology.orchestra.run.smithi155.stdout: "complaint_time": 30, 2023-08-01T19:55:59.403 INFO:teuthology.orchestra.run.smithi155.stdout: "num_blocked_ops": 0 2023-08-01T19:55:59.404 INFO:teuthology.orchestra.run.smithi155.stdout:} 2023-08-01T19:55:59.413 DEBUG:teuthology.orchestra.run.smithi155:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 30 ceph --cluster ceph --admin-daemon /var/run/ceph/ceph-osd.2.asok dump_historic_ops 2023-08-01T19:55:59.484 INFO:tasks.ceph.osd.0.smithi008.stderr:2023-08-01T19:55:59.482+0000 7f16a58f4700 -1 received signal: Hangup from /usr/bin/python3 /bin/daemon-helper kill ceph-osd -f --cluster ceph -i 0 (PID: 111179) UID: 0 2023-08-01T19:55:59.560 INFO:teuthology.orchestra.run.smithi155.stdout:{ 2023-08-01T19:55:59.560 INFO:teuthology.orchestra.run.smithi155.stdout: "size": 20, 2023-08-01T19:55:59.560 INFO:teuthology.orchestra.run.smithi155.stdout: "duration": 600, 2023-08-01T19:55:59.560 INFO:teuthology.orchestra.run.smithi155.stdout: "ops": [ 2023-08-01T19:55:59.561 INFO:teuthology.orchestra.run.smithi155.stdout: { 2023-08-01T19:55:59.561 INFO:teuthology.orchestra.run.smithi155.stdout: "description": "osd_op(client.4668.0:100237 5.4 5:2d68bec9:::benchmark_data_smithi006_114134_object100236:head [set-alloc-hint object_size 65536 write_size 65536,write 0~65536] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e37)", 2023-08-01T19:55:59.561 INFO:teuthology.orchestra.run.smithi155.stdout: "initiated_at": "2023-08-01T19:55:05.147736+0000", 2023-08-01T19:55:59.561 INFO:teuthology.orchestra.run.smithi155.stdout: "age": 54.388256775000002, 2023-08-01T19:55:59.561 INFO:teuthology.orchestra.run.smithi155.stdout: "duration": 0.071299464000000007, 2023-08-01T19:55:59.561 INFO:teuthology.orchestra.run.smithi155.stdout: "type_data": { 2023-08-01T19:55:59.561 INFO:teuthology.orchestra.run.smithi155.stdout: "flag_point": "commit sent; apply or cleanup", 2023-08-01T19:55:59.561 INFO:teuthology.orchestra.run.smithi155.stdout: "client_info": { 2023-08-01T19:55:59.562 INFO:teuthology.orchestra.run.smithi155.stdout: "client": "client.4668", 2023-08-01T19:55:59.562 INFO:teuthology.orchestra.run.smithi155.stdout: "client_addr": "172.21.15.6:0/1709472247", 2023-08-01T19:55:59.562 INFO:teuthology.orchestra.run.smithi155.stdout: "tid": 100237 2023-08-01T19:55:59.562 INFO:teuthology.orchestra.run.smithi155.stdout: }, 2023-08-01T19:55:59.562 INFO:teuthology.orchestra.run.smithi155.stdout: "events": [ 2023-08-01T19:55:59.562 INFO:teuthology.orchestra.run.smithi155.stdout: { 2023-08-01T19:55:59.562 INFO:teuthology.orchestra.run.smithi155.stdout: "event": "initiated", 2023-08-01T19:55:59.563 INFO:teuthology.orchestra.run.smithi155.stdout: "time": "2023-08-01T19:55:05.147736+0000", 2023-08-01T19:55:59.563 INFO:teuthology.orchestra.run.smithi155.stdout: "duration": 0 2023-08-01T19:55:59.563 INFO:teuthology.orchestra.run.smithi155.stdout: }, 2023-08-01T19:55:59.563 INFO:teuthology.orchestra.run.smithi155.stdout: { 2023-08-01T19:55:59.563 INFO:teuthology.orchestra.run.smithi155.stdout: "event": "throttled", 2023-08-01T19:55:59.563 INFO:teuthology.orchestra.run.smithi155.stdout: "time": "2023-08-01T19:55:05.147736+0000", 2023-08-01T19:55:59.563 INFO:teuthology.orchestra.run.smithi155.stdout: "duration": 0 2023-08-01T19:55:59.563 INFO:teuthology.orchestra.run.smithi155.stdout: }, 2023-08-01T19:55:59.564 INFO:teuthology.orchestra.run.smithi155.stdout: { 2023-08-01T19:55:59.564 INFO:teuthology.orchestra.run.smithi155.stdout: "event": "header_read", 2023-08-01T19:55:59.564 INFO:teuthology.orchestra.run.smithi155.stdout: "time": "2023-08-01T19:55:05.147736+0000", 2023-08-01T19:55:59.564 INFO:teuthology.orchestra.run.smithi155.stdout: "duration": 4294967295.9999995 2023-08-01T19:55:59.564 INFO:teuthology.orchestra.run.smithi155.stdout: }, 2023-08-01T19:55:59.564 INFO:teuthology.orchestra.run.smithi155.stdout: { 2023-08-01T19:55:59.564 INFO:teuthology.orchestra.run.smithi155.stdout: "event": "all_read", 2023-08-01T19:55:59.565 INFO:teuthology.orchestra.run.smithi155.stdout: "time": "2023-08-01T19:55:05.147766+0000", 2023-08-01T19:55:59.565 INFO:teuthology.orchestra.run.smithi155.stdout: "duration": 3.0394000000000001e-05 2023-08-01T19:55:59.565 INFO:teuthology.orchestra.run.smithi155.stdout: }, 2023-08-01T19:55:59.565 INFO:teuthology.orchestra.run.smithi155.stdout: { 2023-08-01T19:55:59.565 INFO:teuthology.orchestra.run.smithi155.stdout: "event": "dispatched", 2023-08-01T19:55:59.565 INFO:teuthology.orchestra.run.smithi155.stdout: "time": "2023-08-01T19:55:05.147771+0000", 2023-08-01T19:55:59.565 INFO:teuthology.orchestra.run.smithi155.stdout: "duration": 4.25e-06 2023-08-01T19:55:59.565 INFO:teuthology.orchestra.run.smithi155.stdout: }, 2023-08-01T19:55:59.566 INFO:teuthology.orchestra.run.smithi155.stdout: { 2023-08-01T19:55:59.566 INFO:teuthology.orchestra.run.smithi155.stdout: "event": "queued_for_pg", 2023-08-01T19:55:59.566 INFO:teuthology.orchestra.run.smithi155.stdout: "time": "2023-08-01T19:55:05.147773+0000", 2023-08-01T19:55:59.566 INFO:teuthology.orchestra.run.smithi155.stdout: "duration": 2.4159999999999998e-06 2023-08-01T19:55:59.566 INFO:teuthology.orchestra.run.smithi155.stdout: }, 2023-08-01T19:55:59.566 INFO:teuthology.orchestra.run.smithi155.stdout: { 2023-08-01T19:55:59.566 INFO:teuthology.orchestra.run.smithi155.stdout: "event": "reached_pg", 2023-08-01T19:55:59.567 INFO:teuthology.orchestra.run.smithi155.stdout: "time": "2023-08-01T19:55:05.149903+0000", 2023-08-01T19:55:59.567 INFO:teuthology.orchestra.run.smithi155.stdout: "duration": 0.002129948 2023-08-01T19:55:59.567 INFO:teuthology.orchestra.run.smithi155.stdout: }, 2023-08-01T19:55:59.567 INFO:teuthology.orchestra.run.smithi155.stdout: { 2023-08-01T19:55:59.567 INFO:teuthology.orchestra.run.smithi155.stdout: "event": "started", 2023-08-01T19:55:59.567 INFO:teuthology.orchestra.run.smithi155.stdout: "time": "2023-08-01T19:55:05.149982+0000", 2023-08-01T19:55:59.567 INFO:teuthology.orchestra.run.smithi155.stdout: "duration": 7.8706000000000002e-05 2023-08-01T19:55:59.567 INFO:teuthology.orchestra.run.smithi155.stdout: }, 2023-08-01T19:55:59.568 INFO:teuthology.orchestra.run.smithi155.stdout: { 2023-08-01T19:55:59.568 INFO:teuthology.orchestra.run.smithi155.stdout: "event": "waiting for subops from 0", 2023-08-01T19:55:59.568 INFO:teuthology.orchestra.run.smithi155.stdout: "time": "2023-08-01T19:55:05.150066+0000", 2023-08-01T19:55:59.568 INFO:teuthology.orchestra.run.smithi155.stdout: "duration": 8.4241999999999997e-05 2023-08-01T19:55:59.568 INFO:teuthology.orchestra.run.smithi155.stdout: }, 2023-08-01T19:55:59.568 INFO:teuthology.orchestra.run.smithi155.stdout: { 2023-08-01T19:55:59.568 INFO:teuthology.orchestra.run.smithi155.stdout: "event": "op_commit", 2023-08-01T19:55:59.569 INFO:teuthology.orchestra.run.smithi155.stdout: "time": "2023-08-01T19:55:05.154994+0000", 2023-08-01T19:55:59.569 INFO:teuthology.orchestra.run.smithi155.stdout: "duration": 0.0049277050000000001 2023-08-01T19:55:59.569 INFO:teuthology.orchestra.run.smithi155.stdout: }, 2023-08-01T19:55:59.569 INFO:teuthology.orchestra.run.smithi155.stdout: { 2023-08-01T19:55:59.569 INFO:teuthology.orchestra.run.smithi155.stdout: "event": "sub_op_commit_rec", 2023-08-01T19:55:59.569 INFO:teuthology.orchestra.run.smithi155.stdout: "time": "2023-08-01T19:55:05.218933+0000", 2023-08-01T19:55:59.569 INFO:teuthology.orchestra.run.smithi155.stdout: "duration": 0.063939916999999999 2023-08-01T19:55:59.570 INFO:teuthology.orchestra.run.smithi155.stdout: }, 2023-08-01T19:55:59.570 INFO:teuthology.orchestra.run.smithi155.stdout: { 2023-08-01T19:55:59.570 INFO:teuthology.orchestra.run.smithi155.stdout: "event": "commit_sent", 2023-08-01T19:55:59.570 INFO:teuthology.orchestra.run.smithi155.stdout: "time": "2023-08-01T19:55:05.218989+0000", 2023-08-01T19:55:59.570 INFO:teuthology.orchestra.run.smithi155.stdout: "duration": 5.5772000000000001e-05 2023-08-01T19:55:59.570 INFO:teuthology.orchestra.run.smithi155.stdout: }, 2023-08-01T19:55:59.570 INFO:teuthology.orchestra.run.smithi155.stdout: { 2023-08-01T19:55:59.570 INFO:teuthology.orchestra.run.smithi155.stdout: "event": "done", 2023-08-01T19:55:59.571 INFO:teuthology.orchestra.run.smithi155.stdout: "time": "2023-08-01T19:55:05.219036+0000", 2023-08-01T19:55:59.571 INFO:teuthology.orchestra.run.smithi155.stdout: "duration": 4.6526000000000001e-05 2023-08-01T19:55:59.571 INFO:teuthology.orchestra.run.smithi155.stdout: } 2023-08-01T19:55:59.571 INFO:teuthology.orchestra.run.smithi155.stdout: ] 2023-08-01T19:55:59.571 INFO:teuthology.orchestra.run.smithi155.stdout: } 2023-08-01T19:55:59.571 INFO:teuthology.orchestra.run.smithi155.stdout: }, 2023-08-01T19:55:59.571 INFO:teuthology.orchestra.run.smithi155.stdout: { 2023-08-01T19:55:59.571 INFO:teuthology.orchestra.run.smithi155.stdout: "description": "osd_op(client.4668.0:100242 5.8 5:16a314b8:::benchmark_data_smithi006_114134_object100241:head [set-alloc-hint object_size 65536 write_size 65536,write 0~65536] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e37)", 2023-08-01T19:55:59.572 INFO:teuthology.orchestra.run.smithi155.stdout: "initiated_at": "2023-08-01T19:55:05.150616+0000", 2023-08-01T19:55:59.572 INFO:teuthology.orchestra.run.smithi155.stdout: "age": 54.385377145, 2023-08-01T19:55:59.572 INFO:teuthology.orchestra.run.smithi155.stdout: "duration": 0.071105065999999995, 2023-08-01T19:55:59.572 INFO:teuthology.orchestra.run.smithi155.stdout: "type_data": { 2023-08-01T19:55:59.572 INFO:teuthology.orchestra.run.smithi155.stdout: "flag_point": "commit sent; apply or cleanup", 2023-08-01T19:55:59.572 INFO:teuthology.orchestra.run.smithi155.stdout: "client_info": { 2023-08-01T19:55:59.572 INFO:teuthology.orchestra.run.smithi155.stdout: "client": "client.4668", 2023-08-01T19:55:59.573 INFO:teuthology.orchestra.run.smithi155.stdout: "client_addr": "172.21.15.6:0/1709472247", 2023-08-01T19:55:59.573 INFO:teuthology.orchestra.run.smithi155.stdout: "tid": 100242 2023-08-01T19:55:59.573 INFO:teuthology.orchestra.run.smithi155.stdout: }, 2023-08-01T19:55:59.573 INFO:teuthology.orchestra.run.smithi155.stdout: "events": [ 2023-08-01T19:55:59.573 INFO:teuthology.orchestra.run.smithi155.stdout: { 2023-08-01T19:55:59.573 INFO:teuthology.orchestra.run.smithi155.stdout: "event": "initiated", 2023-08-01T19:55:59.573 INFO:teuthology.orchestra.run.smithi155.stdout: "time": "2023-08-01T19:55:05.150616+0000", 2023-08-01T19:55:59.573 INFO:teuthology.orchestra.run.smithi155.stdout: "duration": 0 2023-08-01T19:55:59.574 INFO:teuthology.orchestra.run.smithi155.stdout: }, 2023-08-01T19:55:59.574 INFO:teuthology.orchestra.run.smithi155.stdout: { 2023-08-01T19:55:59.574 INFO:teuthology.orchestra.run.smithi155.stdout: "event": "throttled", 2023-08-01T19:55:59.574 INFO:teuthology.orchestra.run.smithi155.stdout: "time": "2023-08-01T19:55:05.150616+0000", 2023-08-01T19:55:59.574 INFO:teuthology.orchestra.run.smithi155.stdout: "duration": 0 2023-08-01T19:55:59.574 INFO:teuthology.orchestra.run.smithi155.stdout: }, 2023-08-01T19:55:59.575 INFO:teuthology.orchestra.run.smithi155.stdout: { 2023-08-01T19:55:59.575 INFO:teuthology.orchestra.run.smithi155.stdout: "event": "header_read", 2023-08-01T19:55:59.575 INFO:teuthology.orchestra.run.smithi155.stdout: "time": "2023-08-01T19:55:05.150615+0000", 2023-08-01T19:55:59.575 INFO:teuthology.orchestra.run.smithi155.stdout: "duration": 4294967295.999999 2023-08-01T19:55:59.575 INFO:teuthology.orchestra.run.smithi155.stdout: }, 2023-08-01T19:55:59.575 INFO:teuthology.orchestra.run.smithi155.stdout: { 2023-08-01T19:55:59.575 INFO:teuthology.orchestra.run.smithi155.stdout: "event": "all_read", 2023-08-01T19:55:59.575 INFO:teuthology.orchestra.run.smithi155.stdout: "time": "2023-08-01T19:55:05.150696+0000", 2023-08-01T19:55:59.576 INFO:teuthology.orchestra.run.smithi155.stdout: "duration": 8.0852000000000004e-05 2023-08-01T19:55:59.576 INFO:teuthology.orchestra.run.smithi155.stdout: }, 2023-08-01T19:55:59.576 INFO:teuthology.orchestra.run.smithi155.stdout: { 2023-08-01T19:55:59.576 INFO:teuthology.orchestra.run.smithi155.stdout: "event": "dispatched", 2023-08-01T19:55:59.576 INFO:teuthology.orchestra.run.smithi155.stdout: "time": "2023-08-01T19:55:05.150708+0000", 2023-08-01T19:55:59.576 INFO:teuthology.orchestra.run.smithi155.stdout: "duration": 1.2116999999999999e-05 2023-08-01T19:55:59.576 INFO:teuthology.orchestra.run.smithi155.stdout: }, 2023-08-01T19:55:59.577 INFO:teuthology.orchestra.run.smithi155.stdout: { 2023-08-01T19:55:59.577 INFO:teuthology.orchestra.run.smithi155.stdout: "event": "queued_for_pg", 2023-08-01T19:55:59.577 INFO:teuthology.orchestra.run.smithi155.stdout: "time": "2023-08-01T19:55:05.150713+0000", 2023-08-01T19:55:59.577 INFO:teuthology.orchestra.run.smithi155.stdout: "duration": 5.4620000000000004e-06 2023-08-01T19:55:59.577 INFO:teuthology.orchestra.run.smithi155.stdout: }, 2023-08-01T19:55:59.577 INFO:teuthology.orchestra.run.smithi155.stdout: { 2023-08-01T19:55:59.577 INFO:teuthology.orchestra.run.smithi155.stdout: "event": "reached_pg", 2023-08-01T19:55:59.577 INFO:teuthology.orchestra.run.smithi155.stdout: "time": "2023-08-01T19:55:05.150761+0000", 2023-08-01T19:55:59.578 INFO:teuthology.orchestra.run.smithi155.stdout: "duration": 4.7429000000000003e-05 2023-08-01T19:55:59.578 INFO:teuthology.orchestra.run.smithi155.stdout: }, 2023-08-01T19:55:59.578 INFO:teuthology.orchestra.run.smithi155.stdout: { 2023-08-01T19:55:59.578 INFO:teuthology.orchestra.run.smithi155.stdout: "event": "started", 2023-08-01T19:55:59.578 INFO:teuthology.orchestra.run.smithi155.stdout: "time": "2023-08-01T19:55:05.150856+0000", 2023-08-01T19:55:59.578 INFO:teuthology.orchestra.run.smithi155.stdout: "duration": 9.5356e-05 2023-08-01T19:55:59.578 INFO:teuthology.orchestra.run.smithi155.stdout: }, 2023-08-01T19:55:59.579 INFO:teuthology.orchestra.run.smithi155.stdout: { 2023-08-01T19:55:59.579 INFO:teuthology.orchestra.run.smithi155.stdout: "event": "waiting for subops from 0", 2023-08-01T19:55:59.579 INFO:teuthology.orchestra.run.smithi155.stdout: "time": "2023-08-01T19:55:05.150999+0000", 2023-08-01T19:55:59.579 INFO:teuthology.orchestra.run.smithi155.stdout: "duration": 0.00014234499999999999 2023-08-01T19:55:59.579 INFO:teuthology.orchestra.run.smithi155.stdout: }, 2023-08-01T19:55:59.579 INFO:teuthology.orchestra.run.smithi155.stdout: { 2023-08-01T19:55:59.579 INFO:teuthology.orchestra.run.smithi155.stdout: "event": "sub_op_commit_rec", 2023-08-01T19:55:59.580 INFO:teuthology.orchestra.run.smithi155.stdout: "time": "2023-08-01T19:55:05.219001+0000", 2023-08-01T19:55:59.580 INFO:teuthology.orchestra.run.smithi155.stdout: "duration": 0.068002776000000001 2023-08-01T19:55:59.580 INFO:teuthology.orchestra.run.smithi155.stdout: }, 2023-08-01T19:55:59.580 INFO:teuthology.orchestra.run.smithi155.stdout: { 2023-08-01T19:55:59.580 INFO:teuthology.orchestra.run.smithi155.stdout: "event": "op_commit", 2023-08-01T19:55:59.580 INFO:teuthology.orchestra.run.smithi155.stdout: "time": "2023-08-01T19:55:05.221635+0000", 2023-08-01T19:55:59.580 INFO:teuthology.orchestra.run.smithi155.stdout: "duration": 0.0026340579999999999 2023-08-01T19:55:59.581 INFO:teuthology.orchestra.run.smithi155.stdout: }, 2023-08-01T19:55:59.581 INFO:teuthology.orchestra.run.smithi155.stdout: { 2023-08-01T19:55:59.581 INFO:teuthology.orchestra.run.smithi155.stdout: "event": "commit_sent", 2023-08-01T19:55:59.581 INFO:teuthology.orchestra.run.smithi155.stdout: "time": "2023-08-01T19:55:05.221682+0000", 2023-08-01T19:55:59.581 INFO:teuthology.orchestra.run.smithi155.stdout: "duration": 4.7123999999999998e-05 2023-08-01T19:55:59.581 INFO:teuthology.orchestra.run.smithi155.stdout: }, 2023-08-01T19:55:59.581 INFO:teuthology.orchestra.run.smithi155.stdout: { 2023-08-01T19:55:59.581 INFO:teuthology.orchestra.run.smithi155.stdout: "event": "done", 2023-08-01T19:55:59.582 INFO:teuthology.orchestra.run.smithi155.stdout: "time": "2023-08-01T19:55:05.221721+0000", 2023-08-01T19:55:59.582 INFO:teuthology.orchestra.run.smithi155.stdout: "duration": 3.8529999999999999e-05 2023-08-01T19:55:59.582 INFO:teuthology.orchestra.run.smithi155.stdout: } 2023-08-01T19:55:59.582 INFO:teuthology.orchestra.run.smithi155.stdout: ] 2023-08-01T19:55:59.582 INFO:teuthology.orchestra.run.smithi155.stdout: } 2023-08-01T19:55:59.582 INFO:teuthology.orchestra.run.smithi155.stdout: }, 2023-08-01T19:55:59.582 INFO:teuthology.orchestra.run.smithi155.stdout: { 2023-08-01T19:55:59.582 INFO:teuthology.orchestra.run.smithi155.stdout: "description": "osd_repop(client.4668.0:100240 5.a e37/19 5:5313c5b9:::benchmark_data_smithi006_114134_object100239:head v 37'6227, mlcod=37'6225)", 2023-08-01T19:55:59.583 INFO:teuthology.orchestra.run.smithi155.stdout: "initiated_at": "2023-08-01T19:55:05.150778+0000", 2023-08-01T19:55:59.583 INFO:teuthology.orchestra.run.smithi155.stdout: "age": 54.385214943999998, 2023-08-01T19:55:59.583 INFO:teuthology.orchestra.run.smithi155.stdout: "duration": 0.073362533999999993, 2023-08-01T19:55:59.583 INFO:teuthology.orchestra.run.smithi155.stdout: "type_data": { 2023-08-01T19:55:59.583 INFO:teuthology.orchestra.run.smithi155.stdout: "flag_point": "commit sent; apply or cleanup", 2023-08-01T19:55:59.583 INFO:teuthology.orchestra.run.smithi155.stdout: "events": [ 2023-08-01T19:55:59.583 INFO:teuthology.orchestra.run.smithi155.stdout: { 2023-08-01T19:55:59.583 INFO:teuthology.orchestra.run.smithi155.stdout: "event": "initiated", 2023-08-01T19:55:59.584 INFO:teuthology.orchestra.run.smithi155.stdout: "time": "2023-08-01T19:55:05.150778+0000", 2023-08-01T19:55:59.584 INFO:teuthology.orchestra.run.smithi155.stdout: "duration": 0 2023-08-01T19:55:59.584 INFO:teuthology.orchestra.run.smithi155.stdout: }, 2023-08-01T19:55:59.584 INFO:teuthology.orchestra.run.smithi155.stdout: { 2023-08-01T19:55:59.584 INFO:teuthology.orchestra.run.smithi155.stdout: "event": "throttled", 2023-08-01T19:55:59.584 INFO:teuthology.orchestra.run.smithi155.stdout: "time": "2023-08-01T19:55:05.150778+0000", 2023-08-01T19:55:59.585 INFO:teuthology.orchestra.run.smithi155.stdout: "duration": 0 2023-08-01T19:55:59.585 INFO:teuthology.orchestra.run.smithi155.stdout: }, 2023-08-01T19:55:59.585 INFO:teuthology.orchestra.run.smithi155.stdout: { 2023-08-01T19:55:59.585 INFO:teuthology.orchestra.run.smithi155.stdout: "event": "header_read", 2023-08-01T19:55:59.585 INFO:teuthology.orchestra.run.smithi155.stdout: "time": "2023-08-01T19:55:05.150778+0000", 2023-08-01T19:55:59.585 INFO:teuthology.orchestra.run.smithi155.stdout: "duration": 4294967295.9999995 2023-08-01T19:55:59.585 INFO:teuthology.orchestra.run.smithi155.stdout: }, 2023-08-01T19:55:59.586 INFO:teuthology.orchestra.run.smithi155.stdout: { 2023-08-01T19:55:59.586 INFO:teuthology.orchestra.run.smithi155.stdout: "event": "all_read", 2023-08-01T19:55:59.586 INFO:teuthology.orchestra.run.smithi155.stdout: "time": "2023-08-01T19:55:05.150811+0000", 2023-08-01T19:55:59.586 INFO:teuthology.orchestra.run.smithi155.stdout: "duration": 3.3664000000000002e-05 2023-08-01T19:55:59.586 INFO:teuthology.orchestra.run.smithi155.stdout: }, 2023-08-01T19:55:59.586 INFO:teuthology.orchestra.run.smithi155.stdout: { 2023-08-01T19:55:59.586 INFO:teuthology.orchestra.run.smithi155.stdout: "event": "dispatched", 2023-08-01T19:55:59.586 INFO:teuthology.orchestra.run.smithi155.stdout: "time": "2023-08-01T19:55:05.150818+0000", 2023-08-01T19:55:59.587 INFO:teuthology.orchestra.run.smithi155.stdout: "duration": 6.5769999999999999e-06 2023-08-01T19:55:59.587 INFO:teuthology.orchestra.run.smithi155.stdout: }, 2023-08-01T19:55:59.587 INFO:teuthology.orchestra.run.smithi155.stdout: { 2023-08-01T19:55:59.587 INFO:teuthology.orchestra.run.smithi155.stdout: "event": "queued_for_pg", 2023-08-01T19:55:59.587 INFO:teuthology.orchestra.run.smithi155.stdout: "time": "2023-08-01T19:55:05.150822+0000", 2023-08-01T19:55:59.587 INFO:teuthology.orchestra.run.smithi155.stdout: "duration": 4.0060000000000003e-06 2023-08-01T19:55:59.587 INFO:teuthology.orchestra.run.smithi155.stdout: }, 2023-08-01T19:55:59.587 INFO:teuthology.orchestra.run.smithi155.stdout: { 2023-08-01T19:55:59.588 INFO:teuthology.orchestra.run.smithi155.stdout: "event": "reached_pg", 2023-08-01T19:55:59.588 INFO:teuthology.orchestra.run.smithi155.stdout: "time": "2023-08-01T19:55:05.150855+0000", 2023-08-01T19:55:59.588 INFO:teuthology.orchestra.run.smithi155.stdout: "duration": 3.3204999999999998e-05 2023-08-01T19:55:59.588 INFO:teuthology.orchestra.run.smithi155.stdout: }, 2023-08-01T19:55:59.588 INFO:teuthology.orchestra.run.smithi155.stdout: { 2023-08-01T19:55:59.588 INFO:teuthology.orchestra.run.smithi155.stdout: "event": "started", 2023-08-01T19:55:59.588 INFO:teuthology.orchestra.run.smithi155.stdout: "time": "2023-08-01T19:55:05.150873+0000", 2023-08-01T19:55:59.589 INFO:teuthology.orchestra.run.smithi155.stdout: "duration": 1.8139999999999999e-05 2023-08-01T19:55:59.589 INFO:teuthology.orchestra.run.smithi155.stdout: }, 2023-08-01T19:55:59.589 INFO:teuthology.orchestra.run.smithi155.stdout: { 2023-08-01T19:55:59.589 INFO:teuthology.orchestra.run.smithi155.stdout: "event": "commit_sent", 2023-08-01T19:55:59.589 INFO:teuthology.orchestra.run.smithi155.stdout: "time": "2023-08-01T19:55:05.224095+0000", 2023-08-01T19:55:59.589 INFO:teuthology.orchestra.run.smithi155.stdout: "duration": 0.073221895999999995 2023-08-01T19:55:59.589 INFO:teuthology.orchestra.run.smithi155.stdout: }, 2023-08-01T19:55:59.589 INFO:teuthology.orchestra.run.smithi155.stdout: { 2023-08-01T19:55:59.590 INFO:teuthology.orchestra.run.smithi155.stdout: "event": "done", 2023-08-01T19:55:59.590 INFO:teuthology.orchestra.run.smithi155.stdout: "time": "2023-08-01T19:55:05.224141+0000", 2023-08-01T19:55:59.590 INFO:teuthology.orchestra.run.smithi155.stdout: "duration": 4.5385e-05 2023-08-01T19:55:59.590 INFO:teuthology.orchestra.run.smithi155.stdout: } 2023-08-01T19:55:59.590 INFO:teuthology.orchestra.run.smithi155.stdout: ] 2023-08-01T19:55:59.590 INFO:teuthology.orchestra.run.smithi155.stdout: } 2023-08-01T19:55:59.590 INFO:teuthology.orchestra.run.smithi155.stdout: }, 2023-08-01T19:55:59.591 INFO:teuthology.orchestra.run.smithi155.stdout: { 2023-08-01T19:55:59.591 INFO:teuthology.orchestra.run.smithi155.stdout: "description": "osd_op(client.4668.0:100245 5.e 5:71869c66:::benchmark_data_smithi006_114134_object100244:head [set-alloc-hint object_size 65536 write_size 65536,write 0~65536] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e37)", 2023-08-01T19:55:59.591 INFO:teuthology.orchestra.run.smithi155.stdout: "initiated_at": "2023-08-01T19:55:05.150991+0000", 2023-08-01T19:55:59.591 INFO:teuthology.orchestra.run.smithi155.stdout: "age": 54.385002157000002, 2023-08-01T19:55:59.591 INFO:teuthology.orchestra.run.smithi155.stdout: "duration": 0.070734490999999997, 2023-08-01T19:55:59.591 INFO:teuthology.orchestra.run.smithi155.stdout: "type_data": { 2023-08-01T19:55:59.591 INFO:teuthology.orchestra.run.smithi155.stdout: "flag_point": "commit sent; apply or cleanup", 2023-08-01T19:55:59.591 INFO:teuthology.orchestra.run.smithi155.stdout: "client_info": { 2023-08-01T19:55:59.592 INFO:teuthology.orchestra.run.smithi155.stdout: "client": "client.4668", 2023-08-01T19:55:59.592 INFO:teuthology.orchestra.run.smithi155.stdout: "client_addr": "172.21.15.6:0/1709472247", 2023-08-01T19:55:59.592 INFO:teuthology.orchestra.run.smithi155.stdout: "tid": 100245 2023-08-01T19:55:59.592 INFO:teuthology.orchestra.run.smithi155.stdout: }, 2023-08-01T19:55:59.592 INFO:teuthology.orchestra.run.smithi155.stdout: "events": [ 2023-08-01T19:55:59.592 INFO:teuthology.orchestra.run.smithi155.stdout: { 2023-08-01T19:55:59.592 INFO:teuthology.orchestra.run.smithi155.stdout: "event": "initiated", 2023-08-01T19:55:59.593 INFO:teuthology.orchestra.run.smithi155.stdout: "time": "2023-08-01T19:55:05.150991+0000", 2023-08-01T19:55:59.593 INFO:teuthology.orchestra.run.smithi155.stdout: "duration": 0 2023-08-01T19:55:59.593 INFO:teuthology.orchestra.run.smithi155.stdout: }, 2023-08-01T19:55:59.593 INFO:teuthology.orchestra.run.smithi155.stdout: { 2023-08-01T19:55:59.593 INFO:teuthology.orchestra.run.smithi155.stdout: "event": "throttled", 2023-08-01T19:55:59.593 INFO:teuthology.orchestra.run.smithi155.stdout: "time": "2023-08-01T19:55:05.150991+0000", 2023-08-01T19:55:59.593 INFO:teuthology.orchestra.run.smithi155.stdout: "duration": 0 2023-08-01T19:55:59.593 INFO:teuthology.orchestra.run.smithi155.stdout: }, 2023-08-01T19:55:59.594 INFO:teuthology.orchestra.run.smithi155.stdout: { 2023-08-01T19:55:59.594 INFO:teuthology.orchestra.run.smithi155.stdout: "event": "header_read", 2023-08-01T19:55:59.594 INFO:teuthology.orchestra.run.smithi155.stdout: "time": "2023-08-01T19:55:05.150990+0000", 2023-08-01T19:55:59.594 INFO:teuthology.orchestra.run.smithi155.stdout: "duration": 4294967295.999999 2023-08-01T19:55:59.594 INFO:teuthology.orchestra.run.smithi155.stdout: }, 2023-08-01T19:55:59.594 INFO:teuthology.orchestra.run.smithi155.stdout: { 2023-08-01T19:55:59.594 INFO:teuthology.orchestra.run.smithi155.stdout: "event": "all_read", 2023-08-01T19:55:59.594 INFO:teuthology.orchestra.run.smithi155.stdout: "time": "2023-08-01T19:55:05.151108+0000", 2023-08-01T19:55:59.595 INFO:teuthology.orchestra.run.smithi155.stdout: "duration": 0.00011849300000000001 2023-08-01T19:55:59.595 INFO:teuthology.orchestra.run.smithi155.stdout: }, 2023-08-01T19:55:59.595 INFO:teuthology.orchestra.run.smithi155.stdout: { 2023-08-01T19:55:59.595 INFO:teuthology.orchestra.run.smithi155.stdout: "event": "dispatched", 2023-08-01T19:55:59.595 INFO:teuthology.orchestra.run.smithi155.stdout: "time": "2023-08-01T19:55:05.151117+0000", 2023-08-01T19:55:59.595 INFO:teuthology.orchestra.run.smithi155.stdout: "duration": 8.1040000000000007e-06 2023-08-01T19:55:59.595 INFO:teuthology.orchestra.run.smithi155.stdout: }, 2023-08-01T19:55:59.595 INFO:teuthology.orchestra.run.smithi155.stdout: { 2023-08-01T19:55:59.596 INFO:teuthology.orchestra.run.smithi155.stdout: "event": "queued_for_pg", 2023-08-01T19:55:59.596 INFO:teuthology.orchestra.run.smithi155.stdout: "time": "2023-08-01T19:55:05.151121+0000", 2023-08-01T19:55:59.596 INFO:teuthology.orchestra.run.smithi155.stdout: "duration": 4.2019999999999997e-06 2023-08-01T19:55:59.596 INFO:teuthology.orchestra.run.smithi155.stdout: }, 2023-08-01T19:55:59.596 INFO:teuthology.orchestra.run.smithi155.stdout: { 2023-08-01T19:55:59.596 INFO:teuthology.orchestra.run.smithi155.stdout: "event": "reached_pg", 2023-08-01T19:55:59.596 INFO:teuthology.orchestra.run.smithi155.stdout: "time": "2023-08-01T19:55:05.151162+0000", 2023-08-01T19:55:59.597 INFO:teuthology.orchestra.run.smithi155.stdout: "duration": 4.1448e-05 2023-08-01T19:55:59.597 INFO:teuthology.orchestra.run.smithi155.stdout: }, 2023-08-01T19:55:59.597 INFO:teuthology.orchestra.run.smithi155.stdout: { 2023-08-01T19:55:59.597 INFO:teuthology.orchestra.run.smithi155.stdout: "event": "started", 2023-08-01T19:55:59.597 INFO:teuthology.orchestra.run.smithi155.stdout: "time": "2023-08-01T19:55:05.151281+0000", 2023-08-01T19:55:59.597 INFO:teuthology.orchestra.run.smithi155.stdout: "duration": 0.000119141 2023-08-01T19:55:59.597 INFO:teuthology.orchestra.run.smithi155.stdout: }, 2023-08-01T19:55:59.597 INFO:teuthology.orchestra.run.smithi155.stdout: { 2023-08-01T19:55:59.598 INFO:teuthology.orchestra.run.smithi155.stdout: "event": "waiting for subops from 0", 2023-08-01T19:55:59.598 INFO:teuthology.orchestra.run.smithi155.stdout: "time": "2023-08-01T19:55:05.151443+0000", 2023-08-01T19:55:59.598 INFO:teuthology.orchestra.run.smithi155.stdout: "duration": 0.00016181600000000001 2023-08-01T19:55:59.598 INFO:teuthology.orchestra.run.smithi155.stdout: }, 2023-08-01T19:55:59.598 INFO:teuthology.orchestra.run.smithi155.stdout: { 2023-08-01T19:55:59.598 INFO:teuthology.orchestra.run.smithi155.stdout: "event": "sub_op_commit_rec", 2023-08-01T19:55:59.599 INFO:teuthology.orchestra.run.smithi155.stdout: "time": "2023-08-01T19:55:05.219101+0000", 2023-08-01T19:55:59.599 INFO:teuthology.orchestra.run.smithi155.stdout: "duration": 0.067658037000000004 2023-08-01T19:55:59.599 INFO:teuthology.orchestra.run.smithi155.stdout: }, 2023-08-01T19:55:59.599 INFO:teuthology.orchestra.run.smithi155.stdout: { 2023-08-01T19:55:59.599 INFO:teuthology.orchestra.run.smithi155.stdout: "event": "op_commit", 2023-08-01T19:55:59.599 INFO:teuthology.orchestra.run.smithi155.stdout: "time": "2023-08-01T19:55:05.221646+0000", 2023-08-01T19:55:59.599 INFO:teuthology.orchestra.run.smithi155.stdout: "duration": 0.0025450540000000002 2023-08-01T19:55:59.599 INFO:teuthology.orchestra.run.smithi155.stdout: }, 2023-08-01T19:55:59.600 INFO:teuthology.orchestra.run.smithi155.stdout: { 2023-08-01T19:55:59.600 INFO:teuthology.orchestra.run.smithi155.stdout: "event": "commit_sent", 2023-08-01T19:55:59.600 INFO:teuthology.orchestra.run.smithi155.stdout: "time": "2023-08-01T19:55:05.221689+0000", 2023-08-01T19:55:59.600 INFO:teuthology.orchestra.run.smithi155.stdout: "duration": 4.3078999999999999e-05 2023-08-01T19:55:59.600 INFO:teuthology.orchestra.run.smithi155.stdout: }, 2023-08-01T19:55:59.600 INFO:teuthology.orchestra.run.smithi155.stdout: { 2023-08-01T19:55:59.600 INFO:teuthology.orchestra.run.smithi155.stdout: "event": "done", 2023-08-01T19:55:59.601 INFO:teuthology.orchestra.run.smithi155.stdout: "time": "2023-08-01T19:55:05.221725+0000", 2023-08-01T19:55:59.601 INFO:teuthology.orchestra.run.smithi155.stdout: "duration": 3.6137999999999999e-05 2023-08-01T19:55:59.601 INFO:teuthology.orchestra.run.smithi155.stdout: } 2023-08-01T19:55:59.601 INFO:teuthology.orchestra.run.smithi155.stdout: ] 2023-08-01T19:55:59.601 INFO:teuthology.orchestra.run.smithi155.stdout: } 2023-08-01T19:55:59.601 INFO:teuthology.orchestra.run.smithi155.stdout: }, 2023-08-01T19:55:59.601 INFO:teuthology.orchestra.run.smithi155.stdout: { 2023-08-01T19:55:59.601 INFO:teuthology.orchestra.run.smithi155.stdout: "description": "osd_repop(client.4668.0:100243 5.a e37/19 5:5e8193b6:::benchmark_data_smithi006_114134_object100242:head v 37'6228, mlcod=37'6225)", 2023-08-01T19:55:59.602 INFO:teuthology.orchestra.run.smithi155.stdout: "initiated_at": "2023-08-01T19:55:05.151148+0000", 2023-08-01T19:55:59.602 INFO:teuthology.orchestra.run.smithi155.stdout: "age": 54.384845146000004, 2023-08-01T19:55:59.602 INFO:teuthology.orchestra.run.smithi155.stdout: "duration": 0.073020370000000001, 2023-08-01T19:55:59.602 INFO:teuthology.orchestra.run.smithi155.stdout: "type_data": { 2023-08-01T19:55:59.602 INFO:teuthology.orchestra.run.smithi155.stdout: "flag_point": "commit sent; apply or cleanup", 2023-08-01T19:55:59.602 INFO:teuthology.orchestra.run.smithi155.stdout: "events": [ 2023-08-01T19:55:59.602 INFO:teuthology.orchestra.run.smithi155.stdout: { 2023-08-01T19:55:59.602 INFO:teuthology.orchestra.run.smithi155.stdout: "event": "initiated", 2023-08-01T19:55:59.603 INFO:teuthology.orchestra.run.smithi155.stdout: "time": "2023-08-01T19:55:05.151148+0000", 2023-08-01T19:55:59.603 INFO:teuthology.orchestra.run.smithi155.stdout: "duration": 0 2023-08-01T19:55:59.603 INFO:teuthology.orchestra.run.smithi155.stdout: }, 2023-08-01T19:55:59.603 INFO:teuthology.orchestra.run.smithi155.stdout: { 2023-08-01T19:55:59.603 INFO:teuthology.orchestra.run.smithi155.stdout: "event": "throttled", 2023-08-01T19:55:59.603 INFO:teuthology.orchestra.run.smithi155.stdout: "time": "2023-08-01T19:55:05.151148+0000", 2023-08-01T19:55:59.603 INFO:teuthology.orchestra.run.smithi155.stdout: "duration": 0 2023-08-01T19:55:59.603 INFO:teuthology.orchestra.run.smithi155.stdout: }, 2023-08-01T19:55:59.604 INFO:teuthology.orchestra.run.smithi155.stdout: { 2023-08-01T19:55:59.604 INFO:teuthology.orchestra.run.smithi155.stdout: "event": "header_read", 2023-08-01T19:55:59.604 INFO:teuthology.orchestra.run.smithi155.stdout: "time": "2023-08-01T19:55:05.151147+0000", 2023-08-01T19:55:59.604 INFO:teuthology.orchestra.run.smithi155.stdout: "duration": 4294967295.9999995 2023-08-01T19:55:59.604 INFO:teuthology.orchestra.run.smithi155.stdout: }, 2023-08-01T19:55:59.604 INFO:teuthology.orchestra.run.smithi155.stdout: { 2023-08-01T19:55:59.604 INFO:teuthology.orchestra.run.smithi155.stdout: "event": "all_read", 2023-08-01T19:55:59.605 INFO:teuthology.orchestra.run.smithi155.stdout: "time": "2023-08-01T19:55:05.151231+0000", 2023-08-01T19:55:59.605 INFO:teuthology.orchestra.run.smithi155.stdout: "duration": 8.3135999999999998e-05 2023-08-01T19:55:59.605 INFO:teuthology.orchestra.run.smithi155.stdout: }, 2023-08-01T19:55:59.605 INFO:teuthology.orchestra.run.smithi155.stdout: { 2023-08-01T19:55:59.605 INFO:teuthology.orchestra.run.smithi155.stdout: "event": "dispatched", 2023-08-01T19:55:59.605 INFO:teuthology.orchestra.run.smithi155.stdout: "time": "2023-08-01T19:55:05.151239+0000", 2023-08-01T19:55:59.605 INFO:teuthology.orchestra.run.smithi155.stdout: "duration": 8.7469999999999994e-06 2023-08-01T19:55:59.605 INFO:teuthology.orchestra.run.smithi155.stdout: }, 2023-08-01T19:55:59.606 INFO:teuthology.orchestra.run.smithi155.stdout: { 2023-08-01T19:55:59.606 INFO:teuthology.orchestra.run.smithi155.stdout: "event": "queued_for_pg", 2023-08-01T19:55:59.606 INFO:teuthology.orchestra.run.smithi155.stdout: "time": "2023-08-01T19:55:05.151244+0000", 2023-08-01T19:55:59.606 INFO:teuthology.orchestra.run.smithi155.stdout: "duration": 4.4800000000000003e-06 2023-08-01T19:55:59.606 INFO:teuthology.orchestra.run.smithi155.stdout: }, 2023-08-01T19:55:59.606 INFO:teuthology.orchestra.run.smithi155.stdout: { 2023-08-01T19:55:59.606 INFO:teuthology.orchestra.run.smithi155.stdout: "event": "reached_pg", 2023-08-01T19:55:59.606 INFO:teuthology.orchestra.run.smithi155.stdout: "time": "2023-08-01T19:55:05.152938+0000", 2023-08-01T19:55:59.607 INFO:teuthology.orchestra.run.smithi155.stdout: "duration": 0.001693824 2023-08-01T19:55:59.607 INFO:teuthology.orchestra.run.smithi155.stdout: }, 2023-08-01T19:55:59.607 INFO:teuthology.orchestra.run.smithi155.stdout: { 2023-08-01T19:55:59.607 INFO:teuthology.orchestra.run.smithi155.stdout: "event": "started", 2023-08-01T19:55:59.607 INFO:teuthology.orchestra.run.smithi155.stdout: "time": "2023-08-01T19:55:05.152956+0000", 2023-08-01T19:55:59.607 INFO:teuthology.orchestra.run.smithi155.stdout: "duration": 1.8287e-05 2023-08-01T19:55:59.607 INFO:teuthology.orchestra.run.smithi155.stdout: }, 2023-08-01T19:55:59.608 INFO:teuthology.orchestra.run.smithi155.stdout: { 2023-08-01T19:55:59.608 INFO:teuthology.orchestra.run.smithi155.stdout: "event": "commit_sent", 2023-08-01T19:55:59.608 INFO:teuthology.orchestra.run.smithi155.stdout: "time": "2023-08-01T19:55:05.224145+0000", 2023-08-01T19:55:59.608 INFO:teuthology.orchestra.run.smithi155.stdout: "duration": 0.071189447000000003 2023-08-01T19:55:59.608 INFO:teuthology.orchestra.run.smithi155.stdout: }, 2023-08-01T19:55:59.608 INFO:teuthology.orchestra.run.smithi155.stdout: { 2023-08-01T19:55:59.608 INFO:teuthology.orchestra.run.smithi155.stdout: "event": "done", 2023-08-01T19:55:59.609 INFO:teuthology.orchestra.run.smithi155.stdout: "time": "2023-08-01T19:55:05.224168+0000", 2023-08-01T19:55:59.609 INFO:teuthology.orchestra.run.smithi155.stdout: "duration": 2.3008999999999999e-05 2023-08-01T19:55:59.609 INFO:teuthology.orchestra.run.smithi155.stdout: } 2023-08-01T19:55:59.609 INFO:teuthology.orchestra.run.smithi155.stdout: ] 2023-08-01T19:55:59.609 INFO:teuthology.orchestra.run.smithi155.stdout: } 2023-08-01T19:55:59.609 INFO:teuthology.orchestra.run.smithi155.stdout: }, 2023-08-01T19:55:59.609 INFO:teuthology.orchestra.run.smithi155.stdout: { 2023-08-01T19:55:59.609 INFO:teuthology.orchestra.run.smithi155.stdout: "description": "osd_repop(client.4668.0:100244 5.9 e37/19 5:92f56a12:::benchmark_data_smithi006_114134_object100243:head v 37'6294, mlcod=37'6292)", 2023-08-01T19:55:59.610 INFO:teuthology.orchestra.run.smithi155.stdout: "initiated_at": "2023-08-01T19:55:05.151325+0000", 2023-08-01T19:55:59.610 INFO:teuthology.orchestra.run.smithi155.stdout: "age": 54.384667800999999, 2023-08-01T19:55:59.610 INFO:teuthology.orchestra.run.smithi155.stdout: "duration": 0.071883673999999995, 2023-08-01T19:55:59.610 INFO:teuthology.orchestra.run.smithi155.stdout: "type_data": { 2023-08-01T19:55:59.610 INFO:teuthology.orchestra.run.smithi155.stdout: "flag_point": "commit sent; apply or cleanup", 2023-08-01T19:55:59.610 INFO:teuthology.orchestra.run.smithi155.stdout: "events": [ 2023-08-01T19:55:59.610 INFO:teuthology.orchestra.run.smithi155.stdout: { 2023-08-01T19:55:59.611 INFO:teuthology.orchestra.run.smithi155.stdout: "event": "initiated", 2023-08-01T19:55:59.611 INFO:teuthology.orchestra.run.smithi155.stdout: "time": "2023-08-01T19:55:05.151325+0000", 2023-08-01T19:55:59.611 INFO:teuthology.orchestra.run.smithi155.stdout: "duration": 0 2023-08-01T19:55:59.611 INFO:teuthology.orchestra.run.smithi155.stdout: }, 2023-08-01T19:55:59.611 INFO:teuthology.orchestra.run.smithi155.stdout: { 2023-08-01T19:55:59.611 INFO:teuthology.orchestra.run.smithi155.stdout: "event": "throttled", 2023-08-01T19:55:59.611 INFO:teuthology.orchestra.run.smithi155.stdout: "time": "2023-08-01T19:55:05.151325+0000", 2023-08-01T19:55:59.611 INFO:teuthology.orchestra.run.smithi155.stdout: "duration": 0 2023-08-01T19:55:59.612 INFO:teuthology.orchestra.run.smithi155.stdout: }, 2023-08-01T19:55:59.612 INFO:teuthology.orchestra.run.smithi155.stdout: { 2023-08-01T19:55:59.612 INFO:teuthology.orchestra.run.smithi155.stdout: "event": "header_read", 2023-08-01T19:55:59.612 INFO:teuthology.orchestra.run.smithi155.stdout: "time": "2023-08-01T19:55:05.151325+0000", 2023-08-01T19:55:59.612 INFO:teuthology.orchestra.run.smithi155.stdout: "duration": 4294967295.9999995 2023-08-01T19:55:59.612 INFO:teuthology.orchestra.run.smithi155.stdout: }, 2023-08-01T19:55:59.612 INFO:teuthology.orchestra.run.smithi155.stdout: { 2023-08-01T19:55:59.612 INFO:teuthology.orchestra.run.smithi155.stdout: "event": "all_read", 2023-08-01T19:55:59.613 INFO:teuthology.orchestra.run.smithi155.stdout: "time": "2023-08-01T19:55:05.151390+0000", 2023-08-01T19:55:59.613 INFO:teuthology.orchestra.run.smithi155.stdout: "duration": 6.5456999999999993e-05 2023-08-01T19:55:59.613 INFO:teuthology.orchestra.run.smithi155.stdout: }, 2023-08-01T19:55:59.613 INFO:teuthology.orchestra.run.smithi155.stdout: { 2023-08-01T19:55:59.613 INFO:teuthology.orchestra.run.smithi155.stdout: "event": "dispatched", 2023-08-01T19:55:59.613 INFO:teuthology.orchestra.run.smithi155.stdout: "time": "2023-08-01T19:55:05.151396+0000", 2023-08-01T19:55:59.613 INFO:teuthology.orchestra.run.smithi155.stdout: "duration": 5.9190000000000004e-06 2023-08-01T19:55:59.614 INFO:teuthology.orchestra.run.smithi155.stdout: }, 2023-08-01T19:55:59.614 INFO:teuthology.orchestra.run.smithi155.stdout: { 2023-08-01T19:55:59.614 INFO:teuthology.orchestra.run.smithi155.stdout: "event": "queued_for_pg", 2023-08-01T19:55:59.614 INFO:teuthology.orchestra.run.smithi155.stdout: "time": "2023-08-01T19:55:05.151400+0000", 2023-08-01T19:55:59.614 INFO:teuthology.orchestra.run.smithi155.stdout: "duration": 4.1030000000000004e-06 2023-08-01T19:55:59.614 INFO:teuthology.orchestra.run.smithi155.stdout: }, 2023-08-01T19:55:59.614 INFO:teuthology.orchestra.run.smithi155.stdout: { 2023-08-01T19:55:59.614 INFO:teuthology.orchestra.run.smithi155.stdout: "event": "reached_pg", 2023-08-01T19:55:59.615 INFO:teuthology.orchestra.run.smithi155.stdout: "time": "2023-08-01T19:55:05.151452+0000", 2023-08-01T19:55:59.615 INFO:teuthology.orchestra.run.smithi155.stdout: "duration": 5.2136999999999999e-05 2023-08-01T19:55:59.615 INFO:teuthology.orchestra.run.smithi155.stdout: }, 2023-08-01T19:55:59.615 INFO:teuthology.orchestra.run.smithi155.stdout: { 2023-08-01T19:55:59.615 INFO:teuthology.orchestra.run.smithi155.stdout: "event": "started", 2023-08-01T19:55:59.615 INFO:teuthology.orchestra.run.smithi155.stdout: "time": "2023-08-01T19:55:05.151470+0000", 2023-08-01T19:55:59.615 INFO:teuthology.orchestra.run.smithi155.stdout: "duration": 1.8e-05 2023-08-01T19:55:59.615 INFO:teuthology.orchestra.run.smithi155.stdout: }, 2023-08-01T19:55:59.616 INFO:teuthology.orchestra.run.smithi155.stdout: { 2023-08-01T19:55:59.616 INFO:teuthology.orchestra.run.smithi155.stdout: "event": "commit_sent", 2023-08-01T19:55:59.616 INFO:teuthology.orchestra.run.smithi155.stdout: "time": "2023-08-01T19:55:05.223183+0000", 2023-08-01T19:55:59.616 INFO:teuthology.orchestra.run.smithi155.stdout: "duration": 0.071712622000000004 2023-08-01T19:55:59.616 INFO:teuthology.orchestra.run.smithi155.stdout: }, 2023-08-01T19:55:59.616 INFO:teuthology.orchestra.run.smithi155.stdout: { 2023-08-01T19:55:59.616 INFO:teuthology.orchestra.run.smithi155.stdout: "event": "done", 2023-08-01T19:55:59.617 INFO:teuthology.orchestra.run.smithi155.stdout: "time": "2023-08-01T19:55:05.223209+0000", 2023-08-01T19:55:59.617 INFO:teuthology.orchestra.run.smithi155.stdout: "duration": 2.5956e-05 2023-08-01T19:55:59.617 INFO:teuthology.orchestra.run.smithi155.stdout: } 2023-08-01T19:55:59.617 INFO:teuthology.orchestra.run.smithi155.stdout: ] 2023-08-01T19:55:59.617 INFO:teuthology.orchestra.run.smithi155.stdout: } 2023-08-01T19:55:59.617 INFO:teuthology.orchestra.run.smithi155.stdout: }, 2023-08-01T19:55:59.617 INFO:teuthology.orchestra.run.smithi155.stdout: { 2023-08-01T19:55:59.617 INFO:teuthology.orchestra.run.smithi155.stdout: "description": "osd_op(client.4668.0:100249 5.b 5:d0666827:::benchmark_data_smithi006_114134_object100248:head [set-alloc-hint object_size 65536 write_size 65536,write 0~65536] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e37)", 2023-08-01T19:55:59.618 INFO:teuthology.orchestra.run.smithi155.stdout: "initiated_at": "2023-08-01T19:55:05.153614+0000", 2023-08-01T19:55:59.618 INFO:teuthology.orchestra.run.smithi155.stdout: "age": 54.382379376000003, 2023-08-01T19:55:59.618 INFO:teuthology.orchestra.run.smithi155.stdout: "duration": 0.069286118999999993, 2023-08-01T19:55:59.618 INFO:teuthology.orchestra.run.smithi155.stdout: "type_data": { 2023-08-01T19:55:59.618 INFO:teuthology.orchestra.run.smithi155.stdout: "flag_point": "commit sent; apply or cleanup", 2023-08-01T19:55:59.618 INFO:teuthology.orchestra.run.smithi155.stdout: "client_info": { 2023-08-01T19:55:59.618 INFO:teuthology.orchestra.run.smithi155.stdout: "client": "client.4668", 2023-08-01T19:55:59.618 INFO:teuthology.orchestra.run.smithi155.stdout: "client_addr": "172.21.15.6:0/1709472247", 2023-08-01T19:55:59.619 INFO:teuthology.orchestra.run.smithi155.stdout: "tid": 100249 2023-08-01T19:55:59.619 INFO:teuthology.orchestra.run.smithi155.stdout: }, 2023-08-01T19:55:59.619 INFO:teuthology.orchestra.run.smithi155.stdout: "events": [ 2023-08-01T19:55:59.619 INFO:teuthology.orchestra.run.smithi155.stdout: { 2023-08-01T19:55:59.619 INFO:teuthology.orchestra.run.smithi155.stdout: "event": "initiated", 2023-08-01T19:55:59.619 INFO:teuthology.orchestra.run.smithi155.stdout: "time": "2023-08-01T19:55:05.153614+0000", 2023-08-01T19:55:59.619 INFO:teuthology.orchestra.run.smithi155.stdout: "duration": 0 2023-08-01T19:55:59.619 INFO:teuthology.orchestra.run.smithi155.stdout: }, 2023-08-01T19:55:59.620 INFO:teuthology.orchestra.run.smithi155.stdout: { 2023-08-01T19:55:59.620 INFO:teuthology.orchestra.run.smithi155.stdout: "event": "throttled", 2023-08-01T19:55:59.620 INFO:teuthology.orchestra.run.smithi155.stdout: "time": "2023-08-01T19:55:05.153614+0000", 2023-08-01T19:55:59.620 INFO:teuthology.orchestra.run.smithi155.stdout: "duration": 0 2023-08-01T19:55:59.620 INFO:teuthology.orchestra.run.smithi155.stdout: }, 2023-08-01T19:55:59.620 INFO:teuthology.orchestra.run.smithi155.stdout: { 2023-08-01T19:55:59.620 INFO:teuthology.orchestra.run.smithi155.stdout: "event": "header_read", 2023-08-01T19:55:59.621 INFO:teuthology.orchestra.run.smithi155.stdout: "time": "2023-08-01T19:55:05.153612+0000", 2023-08-01T19:55:59.621 INFO:teuthology.orchestra.run.smithi155.stdout: "duration": 4294967295.9999986 2023-08-01T19:55:59.621 INFO:teuthology.orchestra.run.smithi155.stdout: }, 2023-08-01T19:55:59.621 INFO:teuthology.orchestra.run.smithi155.stdout: { 2023-08-01T19:55:59.621 INFO:teuthology.orchestra.run.smithi155.stdout: "event": "all_read", 2023-08-01T19:55:59.621 INFO:teuthology.orchestra.run.smithi155.stdout: "time": "2023-08-01T19:55:05.153694+0000", 2023-08-01T19:55:59.621 INFO:teuthology.orchestra.run.smithi155.stdout: "duration": 8.1618000000000004e-05 2023-08-01T19:55:59.621 INFO:teuthology.orchestra.run.smithi155.stdout: }, 2023-08-01T19:55:59.622 INFO:teuthology.orchestra.run.smithi155.stdout: { 2023-08-01T19:55:59.622 INFO:teuthology.orchestra.run.smithi155.stdout: "event": "dispatched", 2023-08-01T19:55:59.622 INFO:teuthology.orchestra.run.smithi155.stdout: "time": "2023-08-01T19:55:05.153713+0000", 2023-08-01T19:55:59.622 INFO:teuthology.orchestra.run.smithi155.stdout: "duration": 1.9069999999999999e-05 2023-08-01T19:55:59.622 INFO:teuthology.orchestra.run.smithi155.stdout: }, 2023-08-01T19:55:59.622 INFO:teuthology.orchestra.run.smithi155.stdout: { 2023-08-01T19:55:59.622 INFO:teuthology.orchestra.run.smithi155.stdout: "event": "queued_for_pg", 2023-08-01T19:55:59.622 INFO:teuthology.orchestra.run.smithi155.stdout: "time": "2023-08-01T19:55:05.153726+0000", 2023-08-01T19:55:59.623 INFO:teuthology.orchestra.run.smithi155.stdout: "duration": 1.238e-05 2023-08-01T19:55:59.623 INFO:teuthology.orchestra.run.smithi155.stdout: }, 2023-08-01T19:55:59.623 INFO:teuthology.orchestra.run.smithi155.stdout: { 2023-08-01T19:55:59.623 INFO:teuthology.orchestra.run.smithi155.stdout: "event": "reached_pg", 2023-08-01T19:55:59.623 INFO:teuthology.orchestra.run.smithi155.stdout: "time": "2023-08-01T19:55:05.153761+0000", 2023-08-01T19:55:59.623 INFO:teuthology.orchestra.run.smithi155.stdout: "duration": 3.5046999999999998e-05 2023-08-01T19:55:59.623 INFO:teuthology.orchestra.run.smithi155.stdout: }, 2023-08-01T19:55:59.623 INFO:teuthology.orchestra.run.smithi155.stdout: { 2023-08-01T19:55:59.624 INFO:teuthology.orchestra.run.smithi155.stdout: "event": "started", 2023-08-01T19:55:59.624 INFO:teuthology.orchestra.run.smithi155.stdout: "time": "2023-08-01T19:55:05.153896+0000", 2023-08-01T19:55:59.624 INFO:teuthology.orchestra.run.smithi155.stdout: "duration": 0.00013575800000000001 2023-08-01T19:55:59.624 INFO:teuthology.orchestra.run.smithi155.stdout: }, 2023-08-01T19:55:59.624 INFO:teuthology.orchestra.run.smithi155.stdout: { 2023-08-01T19:55:59.624 INFO:teuthology.orchestra.run.smithi155.stdout: "event": "waiting for subops from 0", 2023-08-01T19:55:59.624 INFO:teuthology.orchestra.run.smithi155.stdout: "time": "2023-08-01T19:55:05.154043+0000", 2023-08-01T19:55:59.625 INFO:teuthology.orchestra.run.smithi155.stdout: "duration": 0.00014650700000000001 2023-08-01T19:55:59.625 INFO:teuthology.orchestra.run.smithi155.stdout: }, 2023-08-01T19:55:59.625 INFO:teuthology.orchestra.run.smithi155.stdout: { 2023-08-01T19:55:59.625 INFO:teuthology.orchestra.run.smithi155.stdout: "event": "sub_op_commit_rec", 2023-08-01T19:55:59.625 INFO:teuthology.orchestra.run.smithi155.stdout: "time": "2023-08-01T19:55:05.221876+0000", 2023-08-01T19:55:59.625 INFO:teuthology.orchestra.run.smithi155.stdout: "duration": 0.067832796000000001 2023-08-01T19:55:59.625 INFO:teuthology.orchestra.run.smithi155.stdout: }, 2023-08-01T19:55:59.625 INFO:teuthology.orchestra.run.smithi155.stdout: { 2023-08-01T19:55:59.626 INFO:teuthology.orchestra.run.smithi155.stdout: "event": "op_commit", 2023-08-01T19:55:59.626 INFO:teuthology.orchestra.run.smithi155.stdout: "time": "2023-08-01T19:55:05.222813+0000", 2023-08-01T19:55:59.626 INFO:teuthology.orchestra.run.smithi155.stdout: "duration": 0.00093755300000000004 2023-08-01T19:55:59.626 INFO:teuthology.orchestra.run.smithi155.stdout: }, 2023-08-01T19:55:59.626 INFO:teuthology.orchestra.run.smithi155.stdout: { 2023-08-01T19:55:59.626 INFO:teuthology.orchestra.run.smithi155.stdout: "event": "commit_sent", 2023-08-01T19:55:59.626 INFO:teuthology.orchestra.run.smithi155.stdout: "time": "2023-08-01T19:55:05.222861+0000", 2023-08-01T19:55:59.626 INFO:teuthology.orchestra.run.smithi155.stdout: "duration": 4.8013999999999998e-05 2023-08-01T19:55:59.627 INFO:teuthology.orchestra.run.smithi155.stdout: }, 2023-08-01T19:55:59.627 INFO:teuthology.orchestra.run.smithi155.stdout: { 2023-08-01T19:55:59.627 INFO:teuthology.orchestra.run.smithi155.stdout: "event": "done", 2023-08-01T19:55:59.627 INFO:teuthology.orchestra.run.smithi155.stdout: "time": "2023-08-01T19:55:05.222900+0000", 2023-08-01T19:55:59.627 INFO:teuthology.orchestra.run.smithi155.stdout: "duration": 3.8634999999999999e-05 2023-08-01T19:55:59.627 INFO:teuthology.orchestra.run.smithi155.stdout: } 2023-08-01T19:55:59.627 INFO:teuthology.orchestra.run.smithi155.stdout: ] 2023-08-01T19:55:59.627 INFO:teuthology.orchestra.run.smithi155.stdout: } 2023-08-01T19:55:59.628 INFO:teuthology.orchestra.run.smithi155.stdout: }, 2023-08-01T19:55:59.628 INFO:teuthology.orchestra.run.smithi155.stdout: { 2023-08-01T19:55:59.628 INFO:teuthology.orchestra.run.smithi155.stdout: "description": "osd_op(client.4668.0:100251 5.b 5:d853df24:::benchmark_data_smithi006_114134_object100250:head [set-alloc-hint object_size 65536 write_size 65536,write 0~65536] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e37)", 2023-08-01T19:55:59.628 INFO:teuthology.orchestra.run.smithi155.stdout: "initiated_at": "2023-08-01T19:55:05.153737+0000", 2023-08-01T19:55:59.628 INFO:teuthology.orchestra.run.smithi155.stdout: "age": 54.382256362, 2023-08-01T19:55:59.628 INFO:teuthology.orchestra.run.smithi155.stdout: "duration": 0.071366545000000003, 2023-08-01T19:55:59.628 INFO:teuthology.orchestra.run.smithi155.stdout: "type_data": { 2023-08-01T19:55:59.629 INFO:teuthology.orchestra.run.smithi155.stdout: "flag_point": "commit sent; apply or cleanup", 2023-08-01T19:55:59.629 INFO:teuthology.orchestra.run.smithi155.stdout: "client_info": { 2023-08-01T19:55:59.629 INFO:teuthology.orchestra.run.smithi155.stdout: "client": "client.4668", 2023-08-01T19:55:59.629 INFO:teuthology.orchestra.run.smithi155.stdout: "client_addr": "172.21.15.6:0/1709472247", 2023-08-01T19:55:59.629 INFO:teuthology.orchestra.run.smithi155.stdout: "tid": 100251 2023-08-01T19:55:59.629 INFO:teuthology.orchestra.run.smithi155.stdout: }, 2023-08-01T19:55:59.629 INFO:teuthology.orchestra.run.smithi155.stdout: "events": [ 2023-08-01T19:55:59.630 INFO:teuthology.orchestra.run.smithi155.stdout: { 2023-08-01T19:55:59.630 INFO:teuthology.orchestra.run.smithi155.stdout: "event": "initiated", 2023-08-01T19:55:59.630 INFO:teuthology.orchestra.run.smithi155.stdout: "time": "2023-08-01T19:55:05.153737+0000", 2023-08-01T19:55:59.630 INFO:teuthology.orchestra.run.smithi155.stdout: "duration": 0 2023-08-01T19:55:59.630 INFO:teuthology.orchestra.run.smithi155.stdout: }, 2023-08-01T19:55:59.630 INFO:teuthology.orchestra.run.smithi155.stdout: { 2023-08-01T19:55:59.630 INFO:teuthology.orchestra.run.smithi155.stdout: "event": "throttled", 2023-08-01T19:55:59.630 INFO:teuthology.orchestra.run.smithi155.stdout: "time": "2023-08-01T19:55:05.153737+0000", 2023-08-01T19:55:59.631 INFO:teuthology.orchestra.run.smithi155.stdout: "duration": 0 2023-08-01T19:55:59.631 INFO:teuthology.orchestra.run.smithi155.stdout: }, 2023-08-01T19:55:59.631 INFO:teuthology.orchestra.run.smithi155.stdout: { 2023-08-01T19:55:59.631 INFO:teuthology.orchestra.run.smithi155.stdout: "event": "header_read", 2023-08-01T19:55:59.631 INFO:teuthology.orchestra.run.smithi155.stdout: "time": "2023-08-01T19:55:05.153736+0000", 2023-08-01T19:55:59.631 INFO:teuthology.orchestra.run.smithi155.stdout: "duration": 4294967295.9999995 2023-08-01T19:55:59.631 INFO:teuthology.orchestra.run.smithi155.stdout: }, 2023-08-01T19:55:59.631 INFO:teuthology.orchestra.run.smithi155.stdout: { 2023-08-01T19:55:59.632 INFO:teuthology.orchestra.run.smithi155.stdout: "event": "all_read", 2023-08-01T19:55:59.632 INFO:teuthology.orchestra.run.smithi155.stdout: "time": "2023-08-01T19:55:05.153784+0000", 2023-08-01T19:55:59.632 INFO:teuthology.orchestra.run.smithi155.stdout: "duration": 4.7660000000000001e-05 2023-08-01T19:55:59.632 INFO:teuthology.orchestra.run.smithi155.stdout: }, 2023-08-01T19:55:59.632 INFO:teuthology.orchestra.run.smithi155.stdout: { 2023-08-01T19:55:59.632 INFO:teuthology.orchestra.run.smithi155.stdout: "event": "dispatched", 2023-08-01T19:55:59.632 INFO:teuthology.orchestra.run.smithi155.stdout: "time": "2023-08-01T19:55:05.153793+0000", 2023-08-01T19:55:59.632 INFO:teuthology.orchestra.run.smithi155.stdout: "duration": 8.7150000000000004e-06 2023-08-01T19:55:59.633 INFO:teuthology.orchestra.run.smithi155.stdout: }, 2023-08-01T19:55:59.633 INFO:teuthology.orchestra.run.smithi155.stdout: { 2023-08-01T19:55:59.633 INFO:teuthology.orchestra.run.smithi155.stdout: "event": "queued_for_pg", 2023-08-01T19:55:59.633 INFO:teuthology.orchestra.run.smithi155.stdout: "time": "2023-08-01T19:55:05.153800+0000", 2023-08-01T19:55:59.633 INFO:teuthology.orchestra.run.smithi155.stdout: "duration": 7.2459999999999997e-06 2023-08-01T19:55:59.633 INFO:teuthology.orchestra.run.smithi155.stdout: }, 2023-08-01T19:55:59.633 INFO:teuthology.orchestra.run.smithi155.stdout: { 2023-08-01T19:55:59.635 INFO:teuthology.orchestra.run.smithi155.stdout: "event": "reached_pg", 2023-08-01T19:55:59.635 INFO:teuthology.orchestra.run.smithi155.stdout: "time": "2023-08-01T19:55:05.156241+0000", 2023-08-01T19:55:59.635 INFO:teuthology.orchestra.run.smithi155.stdout: "duration": 0.0024415359999999998 2023-08-01T19:55:59.636 INFO:teuthology.orchestra.run.smithi155.stdout: }, 2023-08-01T19:55:59.636 INFO:teuthology.orchestra.run.smithi155.stdout: { 2023-08-01T19:55:59.636 INFO:teuthology.orchestra.run.smithi155.stdout: "event": "started", 2023-08-01T19:55:59.636 INFO:teuthology.orchestra.run.smithi155.stdout: "time": "2023-08-01T19:55:05.219045+0000", 2023-08-01T19:55:59.636 INFO:teuthology.orchestra.run.smithi155.stdout: "duration": 0.062803855000000006 2023-08-01T19:55:59.636 INFO:teuthology.orchestra.run.smithi155.stdout: }, 2023-08-01T19:55:59.636 INFO:teuthology.orchestra.run.smithi155.stdout: { 2023-08-01T19:55:59.636 INFO:teuthology.orchestra.run.smithi155.stdout: "event": "waiting for subops from 0", 2023-08-01T19:55:59.637 INFO:teuthology.orchestra.run.smithi155.stdout: "time": "2023-08-01T19:55:05.219238+0000", 2023-08-01T19:55:59.637 INFO:teuthology.orchestra.run.smithi155.stdout: "duration": 0.00019241500000000001 2023-08-01T19:55:59.637 INFO:teuthology.orchestra.run.smithi155.stdout: }, 2023-08-01T19:55:59.637 INFO:teuthology.orchestra.run.smithi155.stdout: { 2023-08-01T19:55:59.637 INFO:teuthology.orchestra.run.smithi155.stdout: "event": "sub_op_commit_rec", 2023-08-01T19:55:59.637 INFO:teuthology.orchestra.run.smithi155.stdout: "time": "2023-08-01T19:55:05.223300+0000", 2023-08-01T19:55:59.637 INFO:teuthology.orchestra.run.smithi155.stdout: "duration": 0.0040626509999999996 2023-08-01T19:55:59.638 INFO:teuthology.orchestra.run.smithi155.stdout: }, 2023-08-01T19:55:59.638 INFO:teuthology.orchestra.run.smithi155.stdout: { 2023-08-01T19:55:59.638 INFO:teuthology.orchestra.run.smithi155.stdout: "event": "op_commit", 2023-08-01T19:55:59.638 INFO:teuthology.orchestra.run.smithi155.stdout: "time": "2023-08-01T19:55:05.225020+0000", 2023-08-01T19:55:59.638 INFO:teuthology.orchestra.run.smithi155.stdout: "duration": 0.0017201 2023-08-01T19:55:59.638 INFO:teuthology.orchestra.run.smithi155.stdout: }, 2023-08-01T19:55:59.638 INFO:teuthology.orchestra.run.smithi155.stdout: { 2023-08-01T19:55:59.638 INFO:teuthology.orchestra.run.smithi155.stdout: "event": "commit_sent", 2023-08-01T19:55:59.639 INFO:teuthology.orchestra.run.smithi155.stdout: "time": "2023-08-01T19:55:05.225066+0000", 2023-08-01T19:55:59.639 INFO:teuthology.orchestra.run.smithi155.stdout: "duration": 4.6143000000000002e-05 2023-08-01T19:55:59.639 INFO:teuthology.orchestra.run.smithi155.stdout: }, 2023-08-01T19:55:59.639 INFO:teuthology.orchestra.run.smithi155.stdout: { 2023-08-01T19:55:59.639 INFO:teuthology.orchestra.run.smithi155.stdout: "event": "done", 2023-08-01T19:55:59.639 INFO:teuthology.orchestra.run.smithi155.stdout: "time": "2023-08-01T19:55:05.225103+0000", 2023-08-01T19:55:59.639 INFO:teuthology.orchestra.run.smithi155.stdout: "duration": 3.6789999999999998e-05 2023-08-01T19:55:59.640 INFO:teuthology.orchestra.run.smithi155.stdout: } 2023-08-01T19:55:59.640 INFO:teuthology.orchestra.run.smithi155.stdout: ] 2023-08-01T19:55:59.640 INFO:teuthology.orchestra.run.smithi155.stdout: } 2023-08-01T19:55:59.640 INFO:teuthology.orchestra.run.smithi155.stdout: }, 2023-08-01T19:55:59.640 INFO:teuthology.orchestra.run.smithi155.stdout: { 2023-08-01T19:55:59.640 INFO:teuthology.orchestra.run.smithi155.stdout: "description": "osd_op(client.4668.0:100252 5.0 5:01f90c3c:::benchmark_data_smithi006_114134_object100251:head [set-alloc-hint object_size 65536 write_size 65536,write 0~65536] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e37)", 2023-08-01T19:55:59.640 INFO:teuthology.orchestra.run.smithi155.stdout: "initiated_at": "2023-08-01T19:55:05.154048+0000", 2023-08-01T19:55:59.641 INFO:teuthology.orchestra.run.smithi155.stdout: "age": 54.381945115000001, 2023-08-01T19:55:59.641 INFO:teuthology.orchestra.run.smithi155.stdout: "duration": 0.070156683999999997, 2023-08-01T19:55:59.641 INFO:teuthology.orchestra.run.smithi155.stdout: "type_data": { 2023-08-01T19:55:59.641 INFO:teuthology.orchestra.run.smithi155.stdout: "flag_point": "commit sent; apply or cleanup", 2023-08-01T19:55:59.641 INFO:teuthology.orchestra.run.smithi155.stdout: "client_info": { 2023-08-01T19:55:59.641 INFO:teuthology.orchestra.run.smithi155.stdout: "client": "client.4668", 2023-08-01T19:55:59.641 INFO:teuthology.orchestra.run.smithi155.stdout: "client_addr": "172.21.15.6:0/1709472247", 2023-08-01T19:55:59.641 INFO:teuthology.orchestra.run.smithi155.stdout: "tid": 100252 2023-08-01T19:55:59.642 INFO:teuthology.orchestra.run.smithi155.stdout: }, 2023-08-01T19:55:59.642 INFO:teuthology.orchestra.run.smithi155.stdout: "events": [ 2023-08-01T19:55:59.642 INFO:teuthology.orchestra.run.smithi155.stdout: { 2023-08-01T19:55:59.642 INFO:teuthology.orchestra.run.smithi155.stdout: "event": "initiated", 2023-08-01T19:55:59.642 INFO:teuthology.orchestra.run.smithi155.stdout: "time": "2023-08-01T19:55:05.154048+0000", 2023-08-01T19:55:59.642 INFO:teuthology.orchestra.run.smithi155.stdout: "duration": 0 2023-08-01T19:55:59.642 INFO:teuthology.orchestra.run.smithi155.stdout: }, 2023-08-01T19:55:59.642 INFO:teuthology.orchestra.run.smithi155.stdout: { 2023-08-01T19:55:59.643 INFO:teuthology.orchestra.run.smithi155.stdout: "event": "throttled", 2023-08-01T19:55:59.643 INFO:teuthology.orchestra.run.smithi155.stdout: "time": "2023-08-01T19:55:05.154048+0000", 2023-08-01T19:55:59.643 INFO:teuthology.orchestra.run.smithi155.stdout: "duration": 0 2023-08-01T19:55:59.643 INFO:teuthology.orchestra.run.smithi155.stdout: }, 2023-08-01T19:55:59.643 INFO:teuthology.orchestra.run.smithi155.stdout: { 2023-08-01T19:55:59.643 INFO:teuthology.orchestra.run.smithi155.stdout: "event": "header_read", 2023-08-01T19:55:59.643 INFO:teuthology.orchestra.run.smithi155.stdout: "time": "2023-08-01T19:55:05.154047+0000", 2023-08-01T19:55:59.644 INFO:teuthology.orchestra.run.smithi155.stdout: "duration": 4294967295.999999 2023-08-01T19:55:59.644 INFO:teuthology.orchestra.run.smithi155.stdout: }, 2023-08-01T19:55:59.644 INFO:teuthology.orchestra.run.smithi155.stdout: { 2023-08-01T19:55:59.644 INFO:teuthology.orchestra.run.smithi155.stdout: "event": "all_read", 2023-08-01T19:55:59.644 INFO:teuthology.orchestra.run.smithi155.stdout: "time": "2023-08-01T19:55:05.154115+0000", 2023-08-01T19:55:59.644 INFO:teuthology.orchestra.run.smithi155.stdout: "duration": 6.7545999999999993e-05 2023-08-01T19:55:59.644 INFO:teuthology.orchestra.run.smithi155.stdout: }, 2023-08-01T19:55:59.644 INFO:teuthology.orchestra.run.smithi155.stdout: { 2023-08-01T19:55:59.645 INFO:teuthology.orchestra.run.smithi155.stdout: "event": "dispatched", 2023-08-01T19:55:59.645 INFO:teuthology.orchestra.run.smithi155.stdout: "time": "2023-08-01T19:55:05.154125+0000", 2023-08-01T19:55:59.645 INFO:teuthology.orchestra.run.smithi155.stdout: "duration": 1.0669000000000001e-05 2023-08-01T19:55:59.645 INFO:teuthology.orchestra.run.smithi155.stdout: }, 2023-08-01T19:55:59.645 INFO:teuthology.orchestra.run.smithi155.stdout: { 2023-08-01T19:55:59.645 INFO:teuthology.orchestra.run.smithi155.stdout: "event": "queued_for_pg", 2023-08-01T19:55:59.645 INFO:teuthology.orchestra.run.smithi155.stdout: "time": "2023-08-01T19:55:05.154131+0000", 2023-08-01T19:55:59.645 INFO:teuthology.orchestra.run.smithi155.stdout: "duration": 6.0349999999999998e-06 2023-08-01T19:55:59.646 INFO:teuthology.orchestra.run.smithi155.stdout: }, 2023-08-01T19:55:59.646 INFO:teuthology.orchestra.run.smithi155.stdout: { 2023-08-01T19:55:59.646 INFO:teuthology.orchestra.run.smithi155.stdout: "event": "reached_pg", 2023-08-01T19:55:59.646 INFO:teuthology.orchestra.run.smithi155.stdout: "time": "2023-08-01T19:55:05.154174+0000", 2023-08-01T19:55:59.646 INFO:teuthology.orchestra.run.smithi155.stdout: "duration": 4.2429000000000003e-05 2023-08-01T19:55:59.646 INFO:teuthology.orchestra.run.smithi155.stdout: }, 2023-08-01T19:55:59.646 INFO:teuthology.orchestra.run.smithi155.stdout: { 2023-08-01T19:55:59.646 INFO:teuthology.orchestra.run.smithi155.stdout: "event": "started", 2023-08-01T19:55:59.647 INFO:teuthology.orchestra.run.smithi155.stdout: "time": "2023-08-01T19:55:05.154287+0000", 2023-08-01T19:55:59.647 INFO:teuthology.orchestra.run.smithi155.stdout: "duration": 0.000113138 2023-08-01T19:55:59.647 INFO:teuthology.orchestra.run.smithi155.stdout: }, 2023-08-01T19:55:59.647 INFO:teuthology.orchestra.run.smithi155.stdout: { 2023-08-01T19:55:59.647 INFO:teuthology.orchestra.run.smithi155.stdout: "event": "waiting for subops from 0", 2023-08-01T19:55:59.647 INFO:teuthology.orchestra.run.smithi155.stdout: "time": "2023-08-01T19:55:05.154420+0000", 2023-08-01T19:55:59.647 INFO:teuthology.orchestra.run.smithi155.stdout: "duration": 0.000133292 2023-08-01T19:55:59.647 INFO:teuthology.orchestra.run.smithi155.stdout: }, 2023-08-01T19:55:59.648 INFO:teuthology.orchestra.run.smithi155.stdout: { 2023-08-01T19:55:59.648 INFO:teuthology.orchestra.run.smithi155.stdout: "event": "sub_op_commit_rec", 2023-08-01T19:55:59.648 INFO:teuthology.orchestra.run.smithi155.stdout: "time": "2023-08-01T19:55:05.219034+0000", 2023-08-01T19:55:59.648 INFO:teuthology.orchestra.run.smithi155.stdout: "duration": 0.064613429999999999 2023-08-01T19:55:59.648 INFO:teuthology.orchestra.run.smithi155.stdout: }, 2023-08-01T19:55:59.648 INFO:teuthology.orchestra.run.smithi155.stdout: { 2023-08-01T19:55:59.648 INFO:teuthology.orchestra.run.smithi155.stdout: "event": "op_commit", 2023-08-01T19:55:59.649 INFO:teuthology.orchestra.run.smithi155.stdout: "time": "2023-08-01T19:55:05.224138+0000", 2023-08-01T19:55:59.649 INFO:teuthology.orchestra.run.smithi155.stdout: "duration": 0.0051041999999999997 2023-08-01T19:55:59.649 INFO:teuthology.orchestra.run.smithi155.stdout: }, 2023-08-01T19:55:59.649 INFO:teuthology.orchestra.run.smithi155.stdout: { 2023-08-01T19:55:59.649 INFO:teuthology.orchestra.run.smithi155.stdout: "event": "commit_sent", 2023-08-01T19:55:59.649 INFO:teuthology.orchestra.run.smithi155.stdout: "time": "2023-08-01T19:55:05.224171+0000", 2023-08-01T19:55:59.649 INFO:teuthology.orchestra.run.smithi155.stdout: "duration": 3.3345e-05 2023-08-01T19:55:59.649 INFO:teuthology.orchestra.run.smithi155.stdout: }, 2023-08-01T19:55:59.650 INFO:teuthology.orchestra.run.smithi155.stdout: { 2023-08-01T19:55:59.650 INFO:teuthology.orchestra.run.smithi155.stdout: "event": "done", 2023-08-01T19:55:59.650 INFO:teuthology.orchestra.run.smithi155.stdout: "time": "2023-08-01T19:55:05.224205+0000", 2023-08-01T19:55:59.650 INFO:teuthology.orchestra.run.smithi155.stdout: "duration": 3.3525999999999997e-05 2023-08-01T19:55:59.650 INFO:teuthology.orchestra.run.smithi155.stdout: } 2023-08-01T19:55:59.650 INFO:teuthology.orchestra.run.smithi155.stdout: ] 2023-08-01T19:55:59.650 INFO:teuthology.orchestra.run.smithi155.stdout: } 2023-08-01T19:55:59.650 INFO:teuthology.orchestra.run.smithi155.stdout: }, 2023-08-01T19:55:59.651 INFO:teuthology.orchestra.run.smithi155.stdout: { 2023-08-01T19:55:59.651 INFO:teuthology.orchestra.run.smithi155.stdout: "description": "osd_repop_reply(client.4668.0:100237 5.4 e37/19 ondisk, result = 0)", 2023-08-01T19:55:59.651 INFO:teuthology.orchestra.run.smithi155.stdout: "initiated_at": "2023-08-01T19:55:05.156249+0000", 2023-08-01T19:55:59.651 INFO:teuthology.orchestra.run.smithi155.stdout: "age": 54.379744170000002, 2023-08-01T19:55:59.651 INFO:teuthology.orchestra.run.smithi155.stdout: "duration": 0.062792549000000003, 2023-08-01T19:55:59.651 INFO:teuthology.orchestra.run.smithi155.stdout: "type_data": { 2023-08-01T19:55:59.651 INFO:teuthology.orchestra.run.smithi155.stdout: "flag_point": "started", 2023-08-01T19:55:59.651 INFO:teuthology.orchestra.run.smithi155.stdout: "events": [ 2023-08-01T19:55:59.652 INFO:teuthology.orchestra.run.smithi155.stdout: { 2023-08-01T19:55:59.652 INFO:teuthology.orchestra.run.smithi155.stdout: "event": "initiated", 2023-08-01T19:55:59.652 INFO:teuthology.orchestra.run.smithi155.stdout: "time": "2023-08-01T19:55:05.156249+0000", 2023-08-01T19:55:59.652 INFO:teuthology.orchestra.run.smithi155.stdout: "duration": 0 2023-08-01T19:55:59.652 INFO:teuthology.orchestra.run.smithi155.stdout: }, 2023-08-01T19:55:59.652 INFO:teuthology.orchestra.run.smithi155.stdout: { 2023-08-01T19:55:59.652 INFO:teuthology.orchestra.run.smithi155.stdout: "event": "throttled", 2023-08-01T19:55:59.653 INFO:teuthology.orchestra.run.smithi155.stdout: "time": "2023-08-01T19:55:05.156249+0000", 2023-08-01T19:55:59.653 INFO:teuthology.orchestra.run.smithi155.stdout: "duration": 0 2023-08-01T19:55:59.653 INFO:teuthology.orchestra.run.smithi155.stdout: }, 2023-08-01T19:55:59.653 INFO:teuthology.orchestra.run.smithi155.stdout: { 2023-08-01T19:55:59.653 INFO:teuthology.orchestra.run.smithi155.stdout: "event": "header_read", 2023-08-01T19:55:59.653 INFO:teuthology.orchestra.run.smithi155.stdout: "time": "2023-08-01T19:55:05.156248+0000", 2023-08-01T19:55:59.653 INFO:teuthology.orchestra.run.smithi155.stdout: "duration": 4294967295.9999995 2023-08-01T19:55:59.653 INFO:teuthology.orchestra.run.smithi155.stdout: }, 2023-08-01T19:55:59.654 INFO:teuthology.orchestra.run.smithi155.stdout: { 2023-08-01T19:55:59.654 INFO:teuthology.orchestra.run.smithi155.stdout: "event": "all_read", 2023-08-01T19:55:59.654 INFO:teuthology.orchestra.run.smithi155.stdout: "time": "2023-08-01T19:55:05.156252+0000", 2023-08-01T19:55:59.654 INFO:teuthology.orchestra.run.smithi155.stdout: "duration": 3.9999999999999998e-06 2023-08-01T19:55:59.654 INFO:teuthology.orchestra.run.smithi155.stdout: }, 2023-08-01T19:55:59.654 INFO:teuthology.orchestra.run.smithi155.stdout: { 2023-08-01T19:55:59.654 INFO:teuthology.orchestra.run.smithi155.stdout: "event": "dispatched", 2023-08-01T19:55:59.654 INFO:teuthology.orchestra.run.smithi155.stdout: "time": "2023-08-01T19:55:05.218844+0000", 2023-08-01T19:55:59.655 INFO:teuthology.orchestra.run.smithi155.stdout: "duration": 0.062591516999999999 2023-08-01T19:55:59.655 INFO:teuthology.orchestra.run.smithi155.stdout: }, 2023-08-01T19:55:59.655 INFO:teuthology.orchestra.run.smithi155.stdout: { 2023-08-01T19:55:59.655 INFO:teuthology.orchestra.run.smithi155.stdout: "event": "queued_for_pg", 2023-08-01T19:55:59.655 INFO:teuthology.orchestra.run.smithi155.stdout: "time": "2023-08-01T19:55:05.218862+0000", 2023-08-01T19:55:59.655 INFO:teuthology.orchestra.run.smithi155.stdout: "duration": 1.7666e-05 2023-08-01T19:55:59.655 INFO:teuthology.orchestra.run.smithi155.stdout: }, 2023-08-01T19:55:59.655 INFO:teuthology.orchestra.run.smithi155.stdout: { 2023-08-01T19:55:59.656 INFO:teuthology.orchestra.run.smithi155.stdout: "event": "reached_pg", 2023-08-01T19:55:59.656 INFO:teuthology.orchestra.run.smithi155.stdout: "time": "2023-08-01T19:55:05.218914+0000", 2023-08-01T19:55:59.656 INFO:teuthology.orchestra.run.smithi155.stdout: "duration": 5.2565999999999998e-05 2023-08-01T19:55:59.656 INFO:teuthology.orchestra.run.smithi155.stdout: }, 2023-08-01T19:55:59.656 INFO:teuthology.orchestra.run.smithi155.stdout: { 2023-08-01T19:55:59.656 INFO:teuthology.orchestra.run.smithi155.stdout: "event": "started", 2023-08-01T19:55:59.656 INFO:teuthology.orchestra.run.smithi155.stdout: "time": "2023-08-01T19:55:05.218925+0000", 2023-08-01T19:55:59.657 INFO:teuthology.orchestra.run.smithi155.stdout: "duration": 1.1375e-05 2023-08-01T19:55:59.657 INFO:teuthology.orchestra.run.smithi155.stdout: }, 2023-08-01T19:55:59.657 INFO:teuthology.orchestra.run.smithi155.stdout: { 2023-08-01T19:55:59.657 INFO:teuthology.orchestra.run.smithi155.stdout: "event": "done", 2023-08-01T19:55:59.657 INFO:teuthology.orchestra.run.smithi155.stdout: "time": "2023-08-01T19:55:05.219041+0000", 2023-08-01T19:55:59.657 INFO:teuthology.orchestra.run.smithi155.stdout: "duration": 0.000115977 2023-08-01T19:55:59.657 INFO:teuthology.orchestra.run.smithi155.stdout: } 2023-08-01T19:55:59.657 INFO:teuthology.orchestra.run.smithi155.stdout: ] 2023-08-01T19:55:59.658 INFO:teuthology.orchestra.run.smithi155.stdout: } 2023-08-01T19:55:59.658 INFO:teuthology.orchestra.run.smithi155.stdout: }, 2023-08-01T19:55:59.658 INFO:teuthology.orchestra.run.smithi155.stdout: { 2023-08-01T19:55:59.658 INFO:teuthology.orchestra.run.smithi155.stdout: "description": "osd_repop(client.4668.0:100253 5.f e37/19 5:f7bbce05:::benchmark_data_smithi006_114134_object100252:head v 37'6323, mlcod=37'6321)", 2023-08-01T19:55:59.658 INFO:teuthology.orchestra.run.smithi155.stdout: "initiated_at": "2023-08-01T19:55:05.156952+0000", 2023-08-01T19:55:59.658 INFO:teuthology.orchestra.run.smithi155.stdout: "age": 54.379041106999999, 2023-08-01T19:55:59.658 INFO:teuthology.orchestra.run.smithi155.stdout: "duration": 0.068018577999999996, 2023-08-01T19:55:59.659 INFO:teuthology.orchestra.run.smithi155.stdout: "type_data": { 2023-08-01T19:55:59.659 INFO:teuthology.orchestra.run.smithi155.stdout: "flag_point": "commit sent; apply or cleanup", 2023-08-01T19:55:59.659 INFO:teuthology.orchestra.run.smithi155.stdout: "events": [ 2023-08-01T19:55:59.659 INFO:teuthology.orchestra.run.smithi155.stdout: { 2023-08-01T19:55:59.659 INFO:teuthology.orchestra.run.smithi155.stdout: "event": "initiated", 2023-08-01T19:55:59.659 INFO:teuthology.orchestra.run.smithi155.stdout: "time": "2023-08-01T19:55:05.156952+0000", 2023-08-01T19:55:59.659 INFO:teuthology.orchestra.run.smithi155.stdout: "duration": 0 2023-08-01T19:55:59.659 INFO:teuthology.orchestra.run.smithi155.stdout: }, 2023-08-01T19:55:59.660 INFO:teuthology.orchestra.run.smithi155.stdout: { 2023-08-01T19:55:59.660 INFO:teuthology.orchestra.run.smithi155.stdout: "event": "throttled", 2023-08-01T19:55:59.660 INFO:teuthology.orchestra.run.smithi155.stdout: "time": "2023-08-01T19:55:05.156952+0000", 2023-08-01T19:55:59.660 INFO:teuthology.orchestra.run.smithi155.stdout: "duration": 0 2023-08-01T19:55:59.660 INFO:teuthology.orchestra.run.smithi155.stdout: }, 2023-08-01T19:55:59.660 INFO:teuthology.orchestra.run.smithi155.stdout: { 2023-08-01T19:55:59.660 INFO:teuthology.orchestra.run.smithi155.stdout: "event": "header_read", 2023-08-01T19:55:59.660 INFO:teuthology.orchestra.run.smithi155.stdout: "time": "2023-08-01T19:55:05.156951+0000", 2023-08-01T19:55:59.661 INFO:teuthology.orchestra.run.smithi155.stdout: "duration": 4294967295.999999 2023-08-01T19:55:59.661 INFO:teuthology.orchestra.run.smithi155.stdout: }, 2023-08-01T19:55:59.661 INFO:teuthology.orchestra.run.smithi155.stdout: { 2023-08-01T19:55:59.661 INFO:teuthology.orchestra.run.smithi155.stdout: "event": "all_read", 2023-08-01T19:55:59.661 INFO:teuthology.orchestra.run.smithi155.stdout: "time": "2023-08-01T19:55:05.156989+0000", 2023-08-01T19:55:59.661 INFO:teuthology.orchestra.run.smithi155.stdout: "duration": 3.8175e-05 2023-08-01T19:55:59.661 INFO:teuthology.orchestra.run.smithi155.stdout: }, 2023-08-01T19:55:59.662 INFO:teuthology.orchestra.run.smithi155.stdout: { 2023-08-01T19:55:59.662 INFO:teuthology.orchestra.run.smithi155.stdout: "event": "dispatched", 2023-08-01T19:55:59.662 INFO:teuthology.orchestra.run.smithi155.stdout: "time": "2023-08-01T19:55:05.218842+0000", 2023-08-01T19:55:59.662 INFO:teuthology.orchestra.run.smithi155.stdout: "duration": 0.061852299999999999 2023-08-01T19:55:59.662 INFO:teuthology.orchestra.run.smithi155.stdout: }, 2023-08-01T19:55:59.662 INFO:teuthology.orchestra.run.smithi155.stdout: { 2023-08-01T19:55:59.662 INFO:teuthology.orchestra.run.smithi155.stdout: "event": "queued_for_pg", 2023-08-01T19:55:59.662 INFO:teuthology.orchestra.run.smithi155.stdout: "time": "2023-08-01T19:55:05.218862+0000", 2023-08-01T19:55:59.663 INFO:teuthology.orchestra.run.smithi155.stdout: "duration": 1.9854999999999999e-05 2023-08-01T19:55:59.663 INFO:teuthology.orchestra.run.smithi155.stdout: }, 2023-08-01T19:55:59.663 INFO:teuthology.orchestra.run.smithi155.stdout: { 2023-08-01T19:55:59.663 INFO:teuthology.orchestra.run.smithi155.stdout: "event": "reached_pg", 2023-08-01T19:55:59.663 INFO:teuthology.orchestra.run.smithi155.stdout: "time": "2023-08-01T19:55:05.218918+0000", 2023-08-01T19:55:59.663 INFO:teuthology.orchestra.run.smithi155.stdout: "duration": 5.6570000000000002e-05 2023-08-01T19:55:59.663 INFO:teuthology.orchestra.run.smithi155.stdout: }, 2023-08-01T19:55:59.664 INFO:teuthology.orchestra.run.smithi155.stdout: { 2023-08-01T19:55:59.664 INFO:teuthology.orchestra.run.smithi155.stdout: "event": "started", 2023-08-01T19:55:59.664 INFO:teuthology.orchestra.run.smithi155.stdout: "time": "2023-08-01T19:55:05.218940+0000", 2023-08-01T19:55:59.664 INFO:teuthology.orchestra.run.smithi155.stdout: "duration": 2.1804e-05 2023-08-01T19:55:59.664 INFO:teuthology.orchestra.run.smithi155.stdout: }, 2023-08-01T19:55:59.664 INFO:teuthology.orchestra.run.smithi155.stdout: { 2023-08-01T19:55:59.664 INFO:teuthology.orchestra.run.smithi155.stdout: "event": "commit_sent", 2023-08-01T19:55:59.664 INFO:teuthology.orchestra.run.smithi155.stdout: "time": "2023-08-01T19:55:05.224928+0000", 2023-08-01T19:55:59.665 INFO:teuthology.orchestra.run.smithi155.stdout: "duration": 0.0059876759999999999 2023-08-01T19:55:59.665 INFO:teuthology.orchestra.run.smithi155.stdout: }, 2023-08-01T19:55:59.665 INFO:teuthology.orchestra.run.smithi155.stdout: { 2023-08-01T19:55:59.665 INFO:teuthology.orchestra.run.smithi155.stdout: "event": "done", 2023-08-01T19:55:59.665 INFO:teuthology.orchestra.run.smithi155.stdout: "time": "2023-08-01T19:55:05.224971+0000", 2023-08-01T19:55:59.665 INFO:teuthology.orchestra.run.smithi155.stdout: "duration": 4.2929999999999997e-05 2023-08-01T19:55:59.665 INFO:teuthology.orchestra.run.smithi155.stdout: } 2023-08-01T19:55:59.666 INFO:teuthology.orchestra.run.smithi155.stdout: ] 2023-08-01T19:55:59.666 INFO:teuthology.orchestra.run.smithi155.stdout: } 2023-08-01T19:55:59.666 INFO:teuthology.orchestra.run.smithi155.stdout: }, 2023-08-01T19:55:59.666 INFO:teuthology.orchestra.run.smithi155.stdout: { 2023-08-01T19:55:59.666 INFO:teuthology.orchestra.run.smithi155.stdout: "description": "osd_op(client.4668.0:100927 5.0 5:00608ec6:::benchmark_data_smithi006_114134_object100926:head [set-alloc-hint object_size 65536 write_size 65536,write 0~65536] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e37)", 2023-08-01T19:55:59.666 INFO:teuthology.orchestra.run.smithi155.stdout: "initiated_at": "2023-08-01T19:55:05.561169+0000", 2023-08-01T19:55:59.666 INFO:teuthology.orchestra.run.smithi155.stdout: "age": 53.974824204000001, 2023-08-01T19:55:59.667 INFO:teuthology.orchestra.run.smithi155.stdout: "duration": 0.066411687999999997, 2023-08-01T19:55:59.667 INFO:teuthology.orchestra.run.smithi155.stdout: "type_data": { 2023-08-01T19:55:59.667 INFO:teuthology.orchestra.run.smithi155.stdout: "flag_point": "commit sent; apply or cleanup", 2023-08-01T19:55:59.667 INFO:teuthology.orchestra.run.smithi155.stdout: "client_info": { 2023-08-01T19:55:59.667 INFO:teuthology.orchestra.run.smithi155.stdout: "client": "client.4668", 2023-08-01T19:55:59.667 INFO:teuthology.orchestra.run.smithi155.stdout: "client_addr": "172.21.15.6:0/1709472247", 2023-08-01T19:55:59.667 INFO:teuthology.orchestra.run.smithi155.stdout: "tid": 100927 2023-08-01T19:55:59.667 INFO:teuthology.orchestra.run.smithi155.stdout: }, 2023-08-01T19:55:59.668 INFO:teuthology.orchestra.run.smithi155.stdout: "events": [ 2023-08-01T19:55:59.668 INFO:teuthology.orchestra.run.smithi155.stdout: { 2023-08-01T19:55:59.668 INFO:teuthology.orchestra.run.smithi155.stdout: "event": "initiated", 2023-08-01T19:55:59.668 INFO:teuthology.orchestra.run.smithi155.stdout: "time": "2023-08-01T19:55:05.561169+0000", 2023-08-01T19:55:59.668 INFO:teuthology.orchestra.run.smithi155.stdout: "duration": 0 2023-08-01T19:55:59.668 INFO:teuthology.orchestra.run.smithi155.stdout: }, 2023-08-01T19:55:59.668 INFO:teuthology.orchestra.run.smithi155.stdout: { 2023-08-01T19:55:59.669 INFO:teuthology.orchestra.run.smithi155.stdout: "event": "throttled", 2023-08-01T19:55:59.669 INFO:teuthology.orchestra.run.smithi155.stdout: "time": "2023-08-01T19:55:05.561169+0000", 2023-08-01T19:55:59.669 INFO:teuthology.orchestra.run.smithi155.stdout: "duration": 0 2023-08-01T19:55:59.669 INFO:teuthology.orchestra.run.smithi155.stdout: }, 2023-08-01T19:55:59.669 INFO:teuthology.orchestra.run.smithi155.stdout: { 2023-08-01T19:55:59.669 INFO:teuthology.orchestra.run.smithi155.stdout: "event": "header_read", 2023-08-01T19:55:59.669 INFO:teuthology.orchestra.run.smithi155.stdout: "time": "2023-08-01T19:55:05.561168+0000", 2023-08-01T19:55:59.670 INFO:teuthology.orchestra.run.smithi155.stdout: "duration": 4294967295.9999995 2023-08-01T19:55:59.670 INFO:teuthology.orchestra.run.smithi155.stdout: }, 2023-08-01T19:55:59.670 INFO:teuthology.orchestra.run.smithi155.stdout: { 2023-08-01T19:55:59.670 INFO:teuthology.orchestra.run.smithi155.stdout: "event": "all_read", 2023-08-01T19:55:59.670 INFO:teuthology.orchestra.run.smithi155.stdout: "time": "2023-08-01T19:55:05.561218+0000", 2023-08-01T19:55:59.670 INFO:teuthology.orchestra.run.smithi155.stdout: "duration": 4.9379999999999998e-05 2023-08-01T19:55:59.670 INFO:teuthology.orchestra.run.smithi155.stdout: }, 2023-08-01T19:55:59.670 INFO:teuthology.orchestra.run.smithi155.stdout: { 2023-08-01T19:55:59.671 INFO:teuthology.orchestra.run.smithi155.stdout: "event": "dispatched", 2023-08-01T19:55:59.671 INFO:teuthology.orchestra.run.smithi155.stdout: "time": "2023-08-01T19:55:05.561225+0000", 2023-08-01T19:55:59.671 INFO:teuthology.orchestra.run.smithi155.stdout: "duration": 7.114e-06 2023-08-01T19:55:59.671 INFO:teuthology.orchestra.run.smithi155.stdout: }, 2023-08-01T19:55:59.671 INFO:teuthology.orchestra.run.smithi155.stdout: { 2023-08-01T19:55:59.671 INFO:teuthology.orchestra.run.smithi155.stdout: "event": "queued_for_pg", 2023-08-01T19:55:59.671 INFO:teuthology.orchestra.run.smithi155.stdout: "time": "2023-08-01T19:55:05.561229+0000", 2023-08-01T19:55:59.671 INFO:teuthology.orchestra.run.smithi155.stdout: "duration": 4.2180000000000001e-06 2023-08-01T19:55:59.672 INFO:teuthology.orchestra.run.smithi155.stdout: }, 2023-08-01T19:55:59.672 INFO:teuthology.orchestra.run.smithi155.stdout: { 2023-08-01T19:55:59.672 INFO:teuthology.orchestra.run.smithi155.stdout: "event": "reached_pg", 2023-08-01T19:55:59.672 INFO:teuthology.orchestra.run.smithi155.stdout: "time": "2023-08-01T19:55:05.564737+0000", 2023-08-01T19:55:59.672 INFO:teuthology.orchestra.run.smithi155.stdout: "duration": 0.0035081869999999999 2023-08-01T19:55:59.672 INFO:teuthology.orchestra.run.smithi155.stdout: }, 2023-08-01T19:55:59.672 INFO:teuthology.orchestra.run.smithi155.stdout: { 2023-08-01T19:55:59.672 INFO:teuthology.orchestra.run.smithi155.stdout: "event": "started", 2023-08-01T19:55:59.673 INFO:teuthology.orchestra.run.smithi155.stdout: "time": "2023-08-01T19:55:05.564859+0000", 2023-08-01T19:55:59.673 INFO:teuthology.orchestra.run.smithi155.stdout: "duration": 0.00012165800000000001 2023-08-01T19:55:59.673 INFO:teuthology.orchestra.run.smithi155.stdout: }, 2023-08-01T19:55:59.673 INFO:teuthology.orchestra.run.smithi155.stdout: { 2023-08-01T19:55:59.673 INFO:teuthology.orchestra.run.smithi155.stdout: "event": "waiting for subops from 0", 2023-08-01T19:55:59.673 INFO:teuthology.orchestra.run.smithi155.stdout: "time": "2023-08-01T19:55:05.565009+0000", 2023-08-01T19:55:59.673 INFO:teuthology.orchestra.run.smithi155.stdout: "duration": 0.00014979699999999999 2023-08-01T19:55:59.674 INFO:teuthology.orchestra.run.smithi155.stdout: }, 2023-08-01T19:55:59.674 INFO:teuthology.orchestra.run.smithi155.stdout: { 2023-08-01T19:55:59.674 INFO:teuthology.orchestra.run.smithi155.stdout: "event": "op_commit", 2023-08-01T19:55:59.674 INFO:teuthology.orchestra.run.smithi155.stdout: "time": "2023-08-01T19:55:05.568007+0000", 2023-08-01T19:55:59.674 INFO:teuthology.orchestra.run.smithi155.stdout: "duration": 0.00299796 2023-08-01T19:55:59.674 INFO:teuthology.orchestra.run.smithi155.stdout: }, 2023-08-01T19:55:59.674 INFO:teuthology.orchestra.run.smithi155.stdout: { 2023-08-01T19:55:59.675 INFO:teuthology.orchestra.run.smithi155.stdout: "event": "sub_op_commit_rec", 2023-08-01T19:55:59.675 INFO:teuthology.orchestra.run.smithi155.stdout: "time": "2023-08-01T19:55:05.627520+0000", 2023-08-01T19:55:59.675 INFO:teuthology.orchestra.run.smithi155.stdout: "duration": 0.059513636000000002 2023-08-01T19:55:59.675 INFO:teuthology.orchestra.run.smithi155.stdout: }, 2023-08-01T19:55:59.675 INFO:teuthology.orchestra.run.smithi155.stdout: { 2023-08-01T19:55:59.675 INFO:teuthology.orchestra.run.smithi155.stdout: "event": "commit_sent", 2023-08-01T19:55:59.675 INFO:teuthology.orchestra.run.smithi155.stdout: "time": "2023-08-01T19:55:05.627553+0000", 2023-08-01T19:55:59.675 INFO:teuthology.orchestra.run.smithi155.stdout: "duration": 3.2635999999999997e-05 2023-08-01T19:55:59.676 INFO:teuthology.orchestra.run.smithi155.stdout: }, 2023-08-01T19:55:59.676 INFO:teuthology.orchestra.run.smithi155.stdout: { 2023-08-01T19:55:59.676 INFO:teuthology.orchestra.run.smithi155.stdout: "event": "done", 2023-08-01T19:55:59.676 INFO:teuthology.orchestra.run.smithi155.stdout: "time": "2023-08-01T19:55:05.627581+0000", 2023-08-01T19:55:59.676 INFO:teuthology.orchestra.run.smithi155.stdout: "duration": 2.7681000000000001e-05 2023-08-01T19:55:59.676 INFO:teuthology.orchestra.run.smithi155.stdout: } 2023-08-01T19:55:59.676 INFO:teuthology.orchestra.run.smithi155.stdout: ] 2023-08-01T19:55:59.676 INFO:teuthology.orchestra.run.smithi155.stdout: } 2023-08-01T19:55:59.677 INFO:teuthology.orchestra.run.smithi155.stdout: }, 2023-08-01T19:55:59.677 INFO:teuthology.orchestra.run.smithi155.stdout: { 2023-08-01T19:55:59.677 INFO:teuthology.orchestra.run.smithi155.stdout: "description": "osd_op(client.4668.0:100935 5.e 5:7895b14e:::benchmark_data_smithi006_114134_object100934:head [set-alloc-hint object_size 65536 write_size 65536,write 0~65536] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e37)", 2023-08-01T19:55:59.677 INFO:teuthology.orchestra.run.smithi155.stdout: "initiated_at": "2023-08-01T19:55:05.566666+0000", 2023-08-01T19:55:59.677 INFO:teuthology.orchestra.run.smithi155.stdout: "age": 53.969326903999999, 2023-08-01T19:55:59.677 INFO:teuthology.orchestra.run.smithi155.stdout: "duration": 0.064309016999999996, 2023-08-01T19:55:59.677 INFO:teuthology.orchestra.run.smithi155.stdout: "type_data": { 2023-08-01T19:55:59.678 INFO:teuthology.orchestra.run.smithi155.stdout: "flag_point": "commit sent; apply or cleanup", 2023-08-01T19:55:59.678 INFO:teuthology.orchestra.run.smithi155.stdout: "client_info": { 2023-08-01T19:55:59.678 INFO:teuthology.orchestra.run.smithi155.stdout: "client": "client.4668", 2023-08-01T19:55:59.678 INFO:teuthology.orchestra.run.smithi155.stdout: "client_addr": "172.21.15.6:0/1709472247", 2023-08-01T19:55:59.678 INFO:teuthology.orchestra.run.smithi155.stdout: "tid": 100935 2023-08-01T19:55:59.678 INFO:teuthology.orchestra.run.smithi155.stdout: }, 2023-08-01T19:55:59.678 INFO:teuthology.orchestra.run.smithi155.stdout: "events": [ 2023-08-01T19:55:59.678 INFO:teuthology.orchestra.run.smithi155.stdout: { 2023-08-01T19:55:59.679 INFO:teuthology.orchestra.run.smithi155.stdout: "event": "initiated", 2023-08-01T19:55:59.679 INFO:teuthology.orchestra.run.smithi155.stdout: "time": "2023-08-01T19:55:05.566666+0000", 2023-08-01T19:55:59.679 INFO:teuthology.orchestra.run.smithi155.stdout: "duration": 0 2023-08-01T19:55:59.679 INFO:teuthology.orchestra.run.smithi155.stdout: }, 2023-08-01T19:55:59.679 INFO:teuthology.orchestra.run.smithi155.stdout: { 2023-08-01T19:55:59.679 INFO:teuthology.orchestra.run.smithi155.stdout: "event": "throttled", 2023-08-01T19:55:59.679 INFO:teuthology.orchestra.run.smithi155.stdout: "time": "2023-08-01T19:55:05.566666+0000", 2023-08-01T19:55:59.679 INFO:teuthology.orchestra.run.smithi155.stdout: "duration": 0 2023-08-01T19:55:59.680 INFO:teuthology.orchestra.run.smithi155.stdout: }, 2023-08-01T19:55:59.680 INFO:teuthology.orchestra.run.smithi155.stdout: { 2023-08-01T19:55:59.680 INFO:teuthology.orchestra.run.smithi155.stdout: "event": "header_read", 2023-08-01T19:55:59.680 INFO:teuthology.orchestra.run.smithi155.stdout: "time": "2023-08-01T19:55:05.566665+0000", 2023-08-01T19:55:59.680 INFO:teuthology.orchestra.run.smithi155.stdout: "duration": 4294967295.9999986 2023-08-01T19:55:59.680 INFO:teuthology.orchestra.run.smithi155.stdout: }, 2023-08-01T19:55:59.680 INFO:teuthology.orchestra.run.smithi155.stdout: { 2023-08-01T19:55:59.681 INFO:teuthology.orchestra.run.smithi155.stdout: "event": "all_read", 2023-08-01T19:55:59.681 INFO:teuthology.orchestra.run.smithi155.stdout: "time": "2023-08-01T19:55:05.566754+0000", 2023-08-01T19:55:59.681 INFO:teuthology.orchestra.run.smithi155.stdout: "duration": 8.9425999999999994e-05 2023-08-01T19:55:59.681 INFO:teuthology.orchestra.run.smithi155.stdout: }, 2023-08-01T19:55:59.681 INFO:teuthology.orchestra.run.smithi155.stdout: { 2023-08-01T19:55:59.681 INFO:teuthology.orchestra.run.smithi155.stdout: "event": "dispatched", 2023-08-01T19:55:59.681 INFO:teuthology.orchestra.run.smithi155.stdout: "time": "2023-08-01T19:55:05.566766+0000", 2023-08-01T19:55:59.681 INFO:teuthology.orchestra.run.smithi155.stdout: "duration": 1.2018000000000001e-05 2023-08-01T19:55:59.682 INFO:teuthology.orchestra.run.smithi155.stdout: }, 2023-08-01T19:55:59.682 INFO:teuthology.orchestra.run.smithi155.stdout: { 2023-08-01T19:55:59.682 INFO:teuthology.orchestra.run.smithi155.stdout: "event": "queued_for_pg", 2023-08-01T19:55:59.682 INFO:teuthology.orchestra.run.smithi155.stdout: "time": "2023-08-01T19:55:05.566772+0000", 2023-08-01T19:55:59.682 INFO:teuthology.orchestra.run.smithi155.stdout: "duration": 6.0190000000000003e-06 2023-08-01T19:55:59.682 INFO:teuthology.orchestra.run.smithi155.stdout: }, 2023-08-01T19:55:59.682 INFO:teuthology.orchestra.run.smithi155.stdout: { 2023-08-01T19:55:59.683 INFO:teuthology.orchestra.run.smithi155.stdout: "event": "reached_pg", 2023-08-01T19:55:59.683 INFO:teuthology.orchestra.run.smithi155.stdout: "time": "2023-08-01T19:55:05.566800+0000", 2023-08-01T19:55:59.683 INFO:teuthology.orchestra.run.smithi155.stdout: "duration": 2.7835999999999999e-05 2023-08-01T19:55:59.683 INFO:teuthology.orchestra.run.smithi155.stdout: }, 2023-08-01T19:55:59.683 INFO:teuthology.orchestra.run.smithi155.stdout: { 2023-08-01T19:55:59.683 INFO:teuthology.orchestra.run.smithi155.stdout: "event": "started", 2023-08-01T19:55:59.683 INFO:teuthology.orchestra.run.smithi155.stdout: "time": "2023-08-01T19:55:05.566879+0000", 2023-08-01T19:55:59.683 INFO:teuthology.orchestra.run.smithi155.stdout: "duration": 7.9105999999999998e-05 2023-08-01T19:55:59.684 INFO:teuthology.orchestra.run.smithi155.stdout: }, 2023-08-01T19:55:59.684 INFO:teuthology.orchestra.run.smithi155.stdout: { 2023-08-01T19:55:59.684 INFO:teuthology.orchestra.run.smithi155.stdout: "event": "waiting for subops from 0", 2023-08-01T19:55:59.684 INFO:teuthology.orchestra.run.smithi155.stdout: "time": "2023-08-01T19:55:05.566971+0000", 2023-08-01T19:55:59.684 INFO:teuthology.orchestra.run.smithi155.stdout: "duration": 9.1817999999999994e-05 2023-08-01T19:55:59.684 INFO:teuthology.orchestra.run.smithi155.stdout: }, 2023-08-01T19:55:59.684 INFO:teuthology.orchestra.run.smithi155.stdout: { 2023-08-01T19:55:59.685 INFO:teuthology.orchestra.run.smithi155.stdout: "event": "op_commit", 2023-08-01T19:55:59.685 INFO:teuthology.orchestra.run.smithi155.stdout: "time": "2023-08-01T19:55:05.571475+0000", 2023-08-01T19:55:59.685 INFO:teuthology.orchestra.run.smithi155.stdout: "duration": 0.0045039499999999996 2023-08-01T19:55:59.685 INFO:teuthology.orchestra.run.smithi155.stdout: }, 2023-08-01T19:55:59.685 INFO:teuthology.orchestra.run.smithi155.stdout: { 2023-08-01T19:55:59.685 INFO:teuthology.orchestra.run.smithi155.stdout: "event": "sub_op_commit_rec", 2023-08-01T19:55:59.685 INFO:teuthology.orchestra.run.smithi155.stdout: "time": "2023-08-01T19:55:05.630884+0000", 2023-08-01T19:55:59.685 INFO:teuthology.orchestra.run.smithi155.stdout: "duration": 0.059409181999999998 2023-08-01T19:55:59.686 INFO:teuthology.orchestra.run.smithi155.stdout: }, 2023-08-01T19:55:59.686 INFO:teuthology.orchestra.run.smithi155.stdout: { 2023-08-01T19:55:59.686 INFO:teuthology.orchestra.run.smithi155.stdout: "event": "commit_sent", 2023-08-01T19:55:59.686 INFO:teuthology.orchestra.run.smithi155.stdout: "time": "2023-08-01T19:55:05.630930+0000", 2023-08-01T19:55:59.686 INFO:teuthology.orchestra.run.smithi155.stdout: "duration": 4.5507999999999999e-05 2023-08-01T19:55:59.686 INFO:teuthology.orchestra.run.smithi155.stdout: }, 2023-08-01T19:55:59.686 INFO:teuthology.orchestra.run.smithi155.stdout: { 2023-08-01T19:55:59.687 INFO:teuthology.orchestra.run.smithi155.stdout: "event": "done", 2023-08-01T19:55:59.687 INFO:teuthology.orchestra.run.smithi155.stdout: "time": "2023-08-01T19:55:05.630975+0000", 2023-08-01T19:55:59.687 INFO:teuthology.orchestra.run.smithi155.stdout: "duration": 4.5441000000000001e-05 2023-08-01T19:55:59.687 INFO:teuthology.orchestra.run.smithi155.stdout: } 2023-08-01T19:55:59.687 INFO:teuthology.orchestra.run.smithi155.stdout: ] 2023-08-01T19:55:59.687 INFO:teuthology.orchestra.run.smithi155.stdout: } 2023-08-01T19:55:59.687 INFO:teuthology.orchestra.run.smithi155.stdout: }, 2023-08-01T19:55:59.688 INFO:teuthology.orchestra.run.smithi155.stdout: { 2023-08-01T19:55:59.688 INFO:teuthology.orchestra.run.smithi155.stdout: "description": "osd_op(client.4668.0:100941 5.e 5:736a6ac6:::benchmark_data_smithi006_114134_object100940:head [set-alloc-hint object_size 65536 write_size 65536,write 0~65536] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e37)", 2023-08-01T19:55:59.688 INFO:teuthology.orchestra.run.smithi155.stdout: "initiated_at": "2023-08-01T19:55:05.569750+0000", 2023-08-01T19:55:59.688 INFO:teuthology.orchestra.run.smithi155.stdout: "age": 53.966243011000003, 2023-08-01T19:55:59.688 INFO:teuthology.orchestra.run.smithi155.stdout: "duration": 0.065431331999999995, 2023-08-01T19:55:59.688 INFO:teuthology.orchestra.run.smithi155.stdout: "type_data": { 2023-08-01T19:55:59.688 INFO:teuthology.orchestra.run.smithi155.stdout: "flag_point": "commit sent; apply or cleanup", 2023-08-01T19:55:59.688 INFO:teuthology.orchestra.run.smithi155.stdout: "client_info": { 2023-08-01T19:55:59.689 INFO:teuthology.orchestra.run.smithi155.stdout: "client": "client.4668", 2023-08-01T19:55:59.689 INFO:teuthology.orchestra.run.smithi155.stdout: "client_addr": "172.21.15.6:0/1709472247", 2023-08-01T19:55:59.689 INFO:teuthology.orchestra.run.smithi155.stdout: "tid": 100941 2023-08-01T19:55:59.689 INFO:teuthology.orchestra.run.smithi155.stdout: }, 2023-08-01T19:55:59.689 INFO:teuthology.orchestra.run.smithi155.stdout: "events": [ 2023-08-01T19:55:59.689 INFO:teuthology.orchestra.run.smithi155.stdout: { 2023-08-01T19:55:59.689 INFO:teuthology.orchestra.run.smithi155.stdout: "event": "initiated", 2023-08-01T19:55:59.689 INFO:teuthology.orchestra.run.smithi155.stdout: "time": "2023-08-01T19:55:05.569750+0000", 2023-08-01T19:55:59.690 INFO:teuthology.orchestra.run.smithi155.stdout: "duration": 0 2023-08-01T19:55:59.690 INFO:teuthology.orchestra.run.smithi155.stdout: }, 2023-08-01T19:55:59.690 INFO:teuthology.orchestra.run.smithi155.stdout: { 2023-08-01T19:55:59.690 INFO:teuthology.orchestra.run.smithi155.stdout: "event": "throttled", 2023-08-01T19:55:59.690 INFO:teuthology.orchestra.run.smithi155.stdout: "time": "2023-08-01T19:55:05.569750+0000", 2023-08-01T19:55:59.690 INFO:teuthology.orchestra.run.smithi155.stdout: "duration": 0 2023-08-01T19:55:59.690 INFO:teuthology.orchestra.run.smithi155.stdout: }, 2023-08-01T19:55:59.691 INFO:teuthology.orchestra.run.smithi155.stdout: { 2023-08-01T19:55:59.691 INFO:teuthology.orchestra.run.smithi155.stdout: "event": "header_read", 2023-08-01T19:55:59.691 INFO:teuthology.orchestra.run.smithi155.stdout: "time": "2023-08-01T19:55:05.569749+0000", 2023-08-01T19:55:59.691 INFO:teuthology.orchestra.run.smithi155.stdout: "duration": 4294967295.999999 2023-08-01T19:55:59.691 INFO:teuthology.orchestra.run.smithi155.stdout: }, 2023-08-01T19:55:59.691 INFO:teuthology.orchestra.run.smithi155.stdout: { 2023-08-01T19:55:59.691 INFO:teuthology.orchestra.run.smithi155.stdout: "event": "all_read", 2023-08-01T19:55:59.691 INFO:teuthology.orchestra.run.smithi155.stdout: "time": "2023-08-01T19:55:05.569861+0000", 2023-08-01T19:55:59.692 INFO:teuthology.orchestra.run.smithi155.stdout: "duration": 0.000111333 2023-08-01T19:55:59.692 INFO:teuthology.orchestra.run.smithi155.stdout: }, 2023-08-01T19:55:59.692 INFO:teuthology.orchestra.run.smithi155.stdout: { 2023-08-01T19:55:59.692 INFO:teuthology.orchestra.run.smithi155.stdout: "event": "dispatched", 2023-08-01T19:55:59.692 INFO:teuthology.orchestra.run.smithi155.stdout: "time": "2023-08-01T19:55:05.569869+0000", 2023-08-01T19:55:59.692 INFO:teuthology.orchestra.run.smithi155.stdout: "duration": 8.8589999999999994e-06 2023-08-01T19:55:59.692 INFO:teuthology.orchestra.run.smithi155.stdout: }, 2023-08-01T19:55:59.693 INFO:teuthology.orchestra.run.smithi155.stdout: { 2023-08-01T19:55:59.693 INFO:teuthology.orchestra.run.smithi155.stdout: "event": "queued_for_pg", 2023-08-01T19:55:59.693 INFO:teuthology.orchestra.run.smithi155.stdout: "time": "2023-08-01T19:55:05.569874+0000", 2023-08-01T19:55:59.693 INFO:teuthology.orchestra.run.smithi155.stdout: "duration": 4.1679999999999997e-06 2023-08-01T19:55:59.693 INFO:teuthology.orchestra.run.smithi155.stdout: }, 2023-08-01T19:55:59.693 INFO:teuthology.orchestra.run.smithi155.stdout: { 2023-08-01T19:55:59.693 INFO:teuthology.orchestra.run.smithi155.stdout: "event": "reached_pg", 2023-08-01T19:55:59.693 INFO:teuthology.orchestra.run.smithi155.stdout: "time": "2023-08-01T19:55:05.569904+0000", 2023-08-01T19:55:59.694 INFO:teuthology.orchestra.run.smithi155.stdout: "duration": 3.0920999999999998e-05 2023-08-01T19:55:59.694 INFO:teuthology.orchestra.run.smithi155.stdout: }, 2023-08-01T19:55:59.694 INFO:teuthology.orchestra.run.smithi155.stdout: { 2023-08-01T19:55:59.694 INFO:teuthology.orchestra.run.smithi155.stdout: "event": "started", 2023-08-01T19:55:59.694 INFO:teuthology.orchestra.run.smithi155.stdout: "time": "2023-08-01T19:55:05.569998+0000", 2023-08-01T19:55:59.694 INFO:teuthology.orchestra.run.smithi155.stdout: "duration": 9.3086999999999998e-05 2023-08-01T19:55:59.694 INFO:teuthology.orchestra.run.smithi155.stdout: }, 2023-08-01T19:55:59.694 INFO:teuthology.orchestra.run.smithi155.stdout: { 2023-08-01T19:55:59.695 INFO:teuthology.orchestra.run.smithi155.stdout: "event": "waiting for subops from 0", 2023-08-01T19:55:59.695 INFO:teuthology.orchestra.run.smithi155.stdout: "time": "2023-08-01T19:55:05.570093+0000", 2023-08-01T19:55:59.695 INFO:teuthology.orchestra.run.smithi155.stdout: "duration": 9.5768999999999997e-05 2023-08-01T19:55:59.695 INFO:teuthology.orchestra.run.smithi155.stdout: }, 2023-08-01T19:55:59.695 INFO:teuthology.orchestra.run.smithi155.stdout: { 2023-08-01T19:55:59.695 INFO:teuthology.orchestra.run.smithi155.stdout: "event": "op_commit", 2023-08-01T19:55:59.695 INFO:teuthology.orchestra.run.smithi155.stdout: "time": "2023-08-01T19:55:05.572839+0000", 2023-08-01T19:55:59.696 INFO:teuthology.orchestra.run.smithi155.stdout: "duration": 0.0027460050000000001 2023-08-01T19:55:59.696 INFO:teuthology.orchestra.run.smithi155.stdout: }, 2023-08-01T19:55:59.696 INFO:teuthology.orchestra.run.smithi155.stdout: { 2023-08-01T19:55:59.696 INFO:teuthology.orchestra.run.smithi155.stdout: "event": "sub_op_commit_rec", 2023-08-01T19:55:59.696 INFO:teuthology.orchestra.run.smithi155.stdout: "time": "2023-08-01T19:55:05.635114+0000", 2023-08-01T19:55:59.696 INFO:teuthology.orchestra.run.smithi155.stdout: "duration": 0.062274297999999999 2023-08-01T19:55:59.696 INFO:teuthology.orchestra.run.smithi155.stdout: }, 2023-08-01T19:55:59.696 INFO:teuthology.orchestra.run.smithi155.stdout: { 2023-08-01T19:55:59.697 INFO:teuthology.orchestra.run.smithi155.stdout: "event": "commit_sent", 2023-08-01T19:55:59.697 INFO:teuthology.orchestra.run.smithi155.stdout: "time": "2023-08-01T19:55:05.635143+0000", 2023-08-01T19:55:59.697 INFO:teuthology.orchestra.run.smithi155.stdout: "duration": 2.9430000000000001e-05 2023-08-01T19:55:59.697 INFO:teuthology.orchestra.run.smithi155.stdout: }, 2023-08-01T19:55:59.697 INFO:teuthology.orchestra.run.smithi155.stdout: { 2023-08-01T19:55:59.697 INFO:teuthology.orchestra.run.smithi155.stdout: "event": "done", 2023-08-01T19:55:59.697 INFO:teuthology.orchestra.run.smithi155.stdout: "time": "2023-08-01T19:55:05.635181+0000", 2023-08-01T19:55:59.697 INFO:teuthology.orchestra.run.smithi155.stdout: "duration": 3.8352000000000001e-05 2023-08-01T19:55:59.698 INFO:teuthology.orchestra.run.smithi155.stdout: } 2023-08-01T19:55:59.698 INFO:teuthology.orchestra.run.smithi155.stdout: ] 2023-08-01T19:55:59.698 INFO:teuthology.orchestra.run.smithi155.stdout: } 2023-08-01T19:55:59.698 INFO:teuthology.orchestra.run.smithi155.stdout: }, 2023-08-01T19:55:59.698 INFO:teuthology.orchestra.run.smithi155.stdout: { 2023-08-01T19:55:59.698 INFO:teuthology.orchestra.run.smithi155.stdout: "description": "osd_op(client.4668.0:100944 5.4 5:25fae865:::benchmark_data_smithi006_114134_object100943:head [set-alloc-hint object_size 65536 write_size 65536,write 0~65536] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e37)", 2023-08-01T19:55:59.698 INFO:teuthology.orchestra.run.smithi155.stdout: "initiated_at": "2023-08-01T19:55:05.576662+0000", 2023-08-01T19:55:59.699 INFO:teuthology.orchestra.run.smithi155.stdout: "age": 53.959331314000003, 2023-08-01T19:55:59.699 INFO:teuthology.orchestra.run.smithi155.stdout: "duration": 0.056054925999999998, 2023-08-01T19:55:59.699 INFO:teuthology.orchestra.run.smithi155.stdout: "type_data": { 2023-08-01T19:55:59.699 INFO:teuthology.orchestra.run.smithi155.stdout: "flag_point": "commit sent; apply or cleanup", 2023-08-01T19:55:59.699 INFO:teuthology.orchestra.run.smithi155.stdout: "client_info": { 2023-08-01T19:55:59.699 INFO:teuthology.orchestra.run.smithi155.stdout: "client": "client.4668", 2023-08-01T19:55:59.699 INFO:teuthology.orchestra.run.smithi155.stdout: "client_addr": "172.21.15.6:0/1709472247", 2023-08-01T19:55:59.699 INFO:teuthology.orchestra.run.smithi155.stdout: "tid": 100944 2023-08-01T19:55:59.700 INFO:teuthology.orchestra.run.smithi155.stdout: }, 2023-08-01T19:55:59.700 INFO:teuthology.orchestra.run.smithi155.stdout: "events": [ 2023-08-01T19:55:59.700 INFO:teuthology.orchestra.run.smithi155.stdout: { 2023-08-01T19:55:59.700 INFO:teuthology.orchestra.run.smithi155.stdout: "event": "initiated", 2023-08-01T19:55:59.700 INFO:teuthology.orchestra.run.smithi155.stdout: "time": "2023-08-01T19:55:05.576662+0000", 2023-08-01T19:55:59.700 INFO:teuthology.orchestra.run.smithi155.stdout: "duration": 0 2023-08-01T19:55:59.700 INFO:teuthology.orchestra.run.smithi155.stdout: }, 2023-08-01T19:55:59.701 INFO:teuthology.orchestra.run.smithi155.stdout: { 2023-08-01T19:55:59.701 INFO:teuthology.orchestra.run.smithi155.stdout: "event": "throttled", 2023-08-01T19:55:59.701 INFO:teuthology.orchestra.run.smithi155.stdout: "time": "2023-08-01T19:55:05.576662+0000", 2023-08-01T19:55:59.701 INFO:teuthology.orchestra.run.smithi155.stdout: "duration": 0 2023-08-01T19:55:59.701 INFO:teuthology.orchestra.run.smithi155.stdout: }, 2023-08-01T19:55:59.701 INFO:teuthology.orchestra.run.smithi155.stdout: { 2023-08-01T19:55:59.701 INFO:teuthology.orchestra.run.smithi155.stdout: "event": "header_read", 2023-08-01T19:55:59.701 INFO:teuthology.orchestra.run.smithi155.stdout: "time": "2023-08-01T19:55:05.576661+0000", 2023-08-01T19:55:59.702 INFO:teuthology.orchestra.run.smithi155.stdout: "duration": 4294967295.999999 2023-08-01T19:55:59.702 INFO:teuthology.orchestra.run.smithi155.stdout: }, 2023-08-01T19:55:59.702 INFO:teuthology.orchestra.run.smithi155.stdout: { 2023-08-01T19:55:59.702 INFO:teuthology.orchestra.run.smithi155.stdout: "event": "all_read", 2023-08-01T19:55:59.702 INFO:teuthology.orchestra.run.smithi155.stdout: "time": "2023-08-01T19:55:05.576725+0000", 2023-08-01T19:55:59.702 INFO:teuthology.orchestra.run.smithi155.stdout: "duration": 6.4435000000000002e-05 2023-08-01T19:55:59.702 INFO:teuthology.orchestra.run.smithi155.stdout: }, 2023-08-01T19:55:59.702 INFO:teuthology.orchestra.run.smithi155.stdout: { 2023-08-01T19:55:59.703 INFO:teuthology.orchestra.run.smithi155.stdout: "event": "dispatched", 2023-08-01T19:55:59.703 INFO:teuthology.orchestra.run.smithi155.stdout: "time": "2023-08-01T19:55:05.576744+0000", 2023-08-01T19:55:59.703 INFO:teuthology.orchestra.run.smithi155.stdout: "duration": 1.8502999999999999e-05 2023-08-01T19:55:59.703 INFO:teuthology.orchestra.run.smithi155.stdout: }, 2023-08-01T19:55:59.703 INFO:teuthology.orchestra.run.smithi155.stdout: { 2023-08-01T19:55:59.703 INFO:teuthology.orchestra.run.smithi155.stdout: "event": "queued_for_pg", 2023-08-01T19:55:59.703 INFO:teuthology.orchestra.run.smithi155.stdout: "time": "2023-08-01T19:55:05.576772+0000", 2023-08-01T19:55:59.703 INFO:teuthology.orchestra.run.smithi155.stdout: "duration": 2.8354999999999999e-05 2023-08-01T19:55:59.704 INFO:teuthology.orchestra.run.smithi155.stdout: }, 2023-08-01T19:55:59.704 INFO:teuthology.orchestra.run.smithi155.stdout: { 2023-08-01T19:55:59.704 INFO:teuthology.orchestra.run.smithi155.stdout: "event": "reached_pg", 2023-08-01T19:55:59.704 INFO:teuthology.orchestra.run.smithi155.stdout: "time": "2023-08-01T19:55:05.576815+0000", 2023-08-01T19:55:59.704 INFO:teuthology.orchestra.run.smithi155.stdout: "duration": 4.3223999999999998e-05 2023-08-01T19:55:59.704 INFO:teuthology.orchestra.run.smithi155.stdout: }, 2023-08-01T19:55:59.704 INFO:teuthology.orchestra.run.smithi155.stdout: { 2023-08-01T19:55:59.705 INFO:teuthology.orchestra.run.smithi155.stdout: "event": "started", 2023-08-01T19:55:59.705 INFO:teuthology.orchestra.run.smithi155.stdout: "time": "2023-08-01T19:55:05.576961+0000", 2023-08-01T19:55:59.705 INFO:teuthology.orchestra.run.smithi155.stdout: "duration": 0.000145043 2023-08-01T19:55:59.705 INFO:teuthology.orchestra.run.smithi155.stdout: }, 2023-08-01T19:55:59.705 INFO:teuthology.orchestra.run.smithi155.stdout: { 2023-08-01T19:55:59.705 INFO:teuthology.orchestra.run.smithi155.stdout: "event": "waiting for subops from 0", 2023-08-01T19:55:59.705 INFO:teuthology.orchestra.run.smithi155.stdout: "time": "2023-08-01T19:55:05.577343+0000", 2023-08-01T19:55:59.705 INFO:teuthology.orchestra.run.smithi155.stdout: "duration": 0.00038249699999999998 2023-08-01T19:55:59.706 INFO:teuthology.orchestra.run.smithi155.stdout: }, 2023-08-01T19:55:59.706 INFO:teuthology.orchestra.run.smithi155.stdout: { 2023-08-01T19:55:59.706 INFO:teuthology.orchestra.run.smithi155.stdout: "event": "op_commit", 2023-08-01T19:55:59.706 INFO:teuthology.orchestra.run.smithi155.stdout: "time": "2023-08-01T19:55:05.582349+0000", 2023-08-01T19:55:59.706 INFO:teuthology.orchestra.run.smithi155.stdout: "duration": 0.0050062880000000002 2023-08-01T19:55:59.706 INFO:teuthology.orchestra.run.smithi155.stdout: }, 2023-08-01T19:55:59.706 INFO:teuthology.orchestra.run.smithi155.stdout: { 2023-08-01T19:55:59.706 INFO:teuthology.orchestra.run.smithi155.stdout: "event": "sub_op_commit_rec", 2023-08-01T19:55:59.707 INFO:teuthology.orchestra.run.smithi155.stdout: "time": "2023-08-01T19:55:05.632659+0000", 2023-08-01T19:55:59.707 INFO:teuthology.orchestra.run.smithi155.stdout: "duration": 0.050309185999999999 2023-08-01T19:55:59.707 INFO:teuthology.orchestra.run.smithi155.stdout: }, 2023-08-01T19:55:59.707 INFO:teuthology.orchestra.run.smithi155.stdout: { 2023-08-01T19:55:59.707 INFO:teuthology.orchestra.run.smithi155.stdout: "event": "commit_sent", 2023-08-01T19:55:59.707 INFO:teuthology.orchestra.run.smithi155.stdout: "time": "2023-08-01T19:55:05.632692+0000", 2023-08-01T19:55:59.707 INFO:teuthology.orchestra.run.smithi155.stdout: "duration": 3.3077999999999997e-05 2023-08-01T19:55:59.708 INFO:teuthology.orchestra.run.smithi155.stdout: }, 2023-08-01T19:55:59.708 INFO:teuthology.orchestra.run.smithi155.stdout: { 2023-08-01T19:55:59.708 INFO:teuthology.orchestra.run.smithi155.stdout: "event": "done", 2023-08-01T19:55:59.708 INFO:teuthology.orchestra.run.smithi155.stdout: "time": "2023-08-01T19:55:05.632717+0000", 2023-08-01T19:55:59.708 INFO:teuthology.orchestra.run.smithi155.stdout: "duration": 2.5119000000000001e-05 2023-08-01T19:55:59.708 INFO:teuthology.orchestra.run.smithi155.stdout: } 2023-08-01T19:55:59.708 INFO:teuthology.orchestra.run.smithi155.stdout: ] 2023-08-01T19:55:59.708 INFO:teuthology.orchestra.run.smithi155.stdout: } 2023-08-01T19:55:59.709 INFO:teuthology.orchestra.run.smithi155.stdout: }, 2023-08-01T19:55:59.709 INFO:teuthology.orchestra.run.smithi155.stdout: { 2023-08-01T19:55:59.709 INFO:teuthology.orchestra.run.smithi155.stdout: "description": "osd_op(client.4668.0:100945 5.e 5:73df68dd:::benchmark_data_smithi006_114134_object100944:head [set-alloc-hint object_size 65536 write_size 65536,write 0~65536] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e37)", 2023-08-01T19:55:59.709 INFO:teuthology.orchestra.run.smithi155.stdout: "initiated_at": "2023-08-01T19:55:05.576784+0000", 2023-08-01T19:55:59.709 INFO:teuthology.orchestra.run.smithi155.stdout: "age": 53.959209426000001, 2023-08-01T19:55:59.709 INFO:teuthology.orchestra.run.smithi155.stdout: "duration": 0.058512994999999998, 2023-08-01T19:55:59.709 INFO:teuthology.orchestra.run.smithi155.stdout: "type_data": { 2023-08-01T19:55:59.710 INFO:teuthology.orchestra.run.smithi155.stdout: "flag_point": "commit sent; apply or cleanup", 2023-08-01T19:55:59.710 INFO:teuthology.orchestra.run.smithi155.stdout: "client_info": { 2023-08-01T19:55:59.710 INFO:teuthology.orchestra.run.smithi155.stdout: "client": "client.4668", 2023-08-01T19:55:59.710 INFO:teuthology.orchestra.run.smithi155.stdout: "client_addr": "172.21.15.6:0/1709472247", 2023-08-01T19:55:59.710 INFO:teuthology.orchestra.run.smithi155.stdout: "tid": 100945 2023-08-01T19:55:59.710 INFO:teuthology.orchestra.run.smithi155.stdout: }, 2023-08-01T19:55:59.710 INFO:teuthology.orchestra.run.smithi155.stdout: "events": [ 2023-08-01T19:55:59.710 INFO:teuthology.orchestra.run.smithi155.stdout: { 2023-08-01T19:55:59.711 INFO:teuthology.orchestra.run.smithi155.stdout: "event": "initiated", 2023-08-01T19:55:59.711 INFO:teuthology.orchestra.run.smithi155.stdout: "time": "2023-08-01T19:55:05.576784+0000", 2023-08-01T19:55:59.711 INFO:teuthology.orchestra.run.smithi155.stdout: "duration": 0 2023-08-01T19:55:59.711 INFO:teuthology.orchestra.run.smithi155.stdout: }, 2023-08-01T19:55:59.711 INFO:teuthology.orchestra.run.smithi155.stdout: { 2023-08-01T19:55:59.711 INFO:teuthology.orchestra.run.smithi155.stdout: "event": "throttled", 2023-08-01T19:55:59.711 INFO:teuthology.orchestra.run.smithi155.stdout: "time": "2023-08-01T19:55:05.576784+0000", 2023-08-01T19:55:59.711 INFO:teuthology.orchestra.run.smithi155.stdout: "duration": 0 2023-08-01T19:55:59.712 INFO:teuthology.orchestra.run.smithi155.stdout: }, 2023-08-01T19:55:59.712 INFO:teuthology.orchestra.run.smithi155.stdout: { 2023-08-01T19:55:59.712 INFO:teuthology.orchestra.run.smithi155.stdout: "event": "header_read", 2023-08-01T19:55:59.712 INFO:teuthology.orchestra.run.smithi155.stdout: "time": "2023-08-01T19:55:05.576783+0000", 2023-08-01T19:55:59.712 INFO:teuthology.orchestra.run.smithi155.stdout: "duration": 4294967295.9999995 2023-08-01T19:55:59.712 INFO:teuthology.orchestra.run.smithi155.stdout: }, 2023-08-01T19:55:59.712 INFO:teuthology.orchestra.run.smithi155.stdout: { 2023-08-01T19:55:59.713 INFO:teuthology.orchestra.run.smithi155.stdout: "event": "all_read", 2023-08-01T19:55:59.713 INFO:teuthology.orchestra.run.smithi155.stdout: "time": "2023-08-01T19:55:05.576807+0000", 2023-08-01T19:55:59.713 INFO:teuthology.orchestra.run.smithi155.stdout: "duration": 2.3651000000000001e-05 2023-08-01T19:55:59.713 INFO:teuthology.orchestra.run.smithi155.stdout: }, 2023-08-01T19:55:59.713 INFO:teuthology.orchestra.run.smithi155.stdout: { 2023-08-01T19:55:59.713 INFO:teuthology.orchestra.run.smithi155.stdout: "event": "dispatched", 2023-08-01T19:55:59.713 INFO:teuthology.orchestra.run.smithi155.stdout: "time": "2023-08-01T19:55:05.576817+0000", 2023-08-01T19:55:59.713 INFO:teuthology.orchestra.run.smithi155.stdout: "duration": 9.9389999999999992e-06 2023-08-01T19:55:59.714 INFO:teuthology.orchestra.run.smithi155.stdout: }, 2023-08-01T19:55:59.714 INFO:teuthology.orchestra.run.smithi155.stdout: { 2023-08-01T19:55:59.714 INFO:teuthology.orchestra.run.smithi155.stdout: "event": "queued_for_pg", 2023-08-01T19:55:59.714 INFO:teuthology.orchestra.run.smithi155.stdout: "time": "2023-08-01T19:55:05.576820+0000", 2023-08-01T19:55:59.714 INFO:teuthology.orchestra.run.smithi155.stdout: "duration": 3.2619999999999999e-06 2023-08-01T19:55:59.714 INFO:teuthology.orchestra.run.smithi155.stdout: }, 2023-08-01T19:55:59.714 INFO:teuthology.orchestra.run.smithi155.stdout: { 2023-08-01T19:55:59.714 INFO:teuthology.orchestra.run.smithi155.stdout: "event": "reached_pg", 2023-08-01T19:55:59.715 INFO:teuthology.orchestra.run.smithi155.stdout: "time": "2023-08-01T19:55:05.576849+0000", 2023-08-01T19:55:59.715 INFO:teuthology.orchestra.run.smithi155.stdout: "duration": 2.8880000000000001e-05 2023-08-01T19:55:59.715 INFO:teuthology.orchestra.run.smithi155.stdout: }, 2023-08-01T19:55:59.715 INFO:teuthology.orchestra.run.smithi155.stdout: { 2023-08-01T19:55:59.715 INFO:teuthology.orchestra.run.smithi155.stdout: "event": "started", 2023-08-01T19:55:59.715 INFO:teuthology.orchestra.run.smithi155.stdout: "time": "2023-08-01T19:55:05.576940+0000", 2023-08-01T19:55:59.715 INFO:teuthology.orchestra.run.smithi155.stdout: "duration": 9.0570999999999997e-05 2023-08-01T19:55:59.716 INFO:teuthology.orchestra.run.smithi155.stdout: }, 2023-08-01T19:55:59.716 INFO:teuthology.orchestra.run.smithi155.stdout: { 2023-08-01T19:55:59.716 INFO:teuthology.orchestra.run.smithi155.stdout: "event": "waiting for subops from 0", 2023-08-01T19:55:59.716 INFO:teuthology.orchestra.run.smithi155.stdout: "time": "2023-08-01T19:55:05.577027+0000", 2023-08-01T19:55:59.716 INFO:teuthology.orchestra.run.smithi155.stdout: "duration": 8.7237999999999994e-05 2023-08-01T19:55:59.716 INFO:teuthology.orchestra.run.smithi155.stdout: }, 2023-08-01T19:55:59.716 INFO:teuthology.orchestra.run.smithi155.stdout: { 2023-08-01T19:55:59.716 INFO:teuthology.orchestra.run.smithi155.stdout: "event": "op_commit", 2023-08-01T19:55:59.717 INFO:teuthology.orchestra.run.smithi155.stdout: "time": "2023-08-01T19:55:05.579624+0000", 2023-08-01T19:55:59.717 INFO:teuthology.orchestra.run.smithi155.stdout: "duration": 0.0025971200000000001 2023-08-01T19:55:59.717 INFO:teuthology.orchestra.run.smithi155.stdout: }, 2023-08-01T19:55:59.717 INFO:teuthology.orchestra.run.smithi155.stdout: { 2023-08-01T19:55:59.717 INFO:teuthology.orchestra.run.smithi155.stdout: "event": "sub_op_commit_rec", 2023-08-01T19:55:59.717 INFO:teuthology.orchestra.run.smithi155.stdout: "time": "2023-08-01T19:55:05.635218+0000", 2023-08-01T19:55:59.717 INFO:teuthology.orchestra.run.smithi155.stdout: "duration": 0.055594487999999997 2023-08-01T19:55:59.718 INFO:teuthology.orchestra.run.smithi155.stdout: }, 2023-08-01T19:55:59.718 INFO:teuthology.orchestra.run.smithi155.stdout: { 2023-08-01T19:55:59.718 INFO:teuthology.orchestra.run.smithi155.stdout: "event": "commit_sent", 2023-08-01T19:55:59.718 INFO:teuthology.orchestra.run.smithi155.stdout: "time": "2023-08-01T19:55:05.635262+0000", 2023-08-01T19:55:59.718 INFO:teuthology.orchestra.run.smithi155.stdout: "duration": 4.3380999999999997e-05 2023-08-01T19:55:59.718 INFO:teuthology.orchestra.run.smithi155.stdout: }, 2023-08-01T19:55:59.718 INFO:teuthology.orchestra.run.smithi155.stdout: { 2023-08-01T19:55:59.718 INFO:teuthology.orchestra.run.smithi155.stdout: "event": "done", 2023-08-01T19:55:59.719 INFO:teuthology.orchestra.run.smithi155.stdout: "time": "2023-08-01T19:55:05.635297+0000", 2023-08-01T19:55:59.719 INFO:teuthology.orchestra.run.smithi155.stdout: "duration": 3.4842000000000003e-05 2023-08-01T19:55:59.719 INFO:teuthology.orchestra.run.smithi155.stdout: } 2023-08-01T19:55:59.719 INFO:teuthology.orchestra.run.smithi155.stdout: ] 2023-08-01T19:55:59.719 INFO:teuthology.orchestra.run.smithi155.stdout: } 2023-08-01T19:55:59.719 INFO:teuthology.orchestra.run.smithi155.stdout: }, 2023-08-01T19:55:59.719 INFO:teuthology.orchestra.run.smithi155.stdout: { 2023-08-01T19:55:59.719 INFO:teuthology.orchestra.run.smithi155.stdout: "description": "osd_op(client.4668.0:100947 5.4 5:23e8fc27:::benchmark_data_smithi006_114134_object100946:head [set-alloc-hint object_size 65536 write_size 65536,write 0~65536] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e37)", 2023-08-01T19:55:59.720 INFO:teuthology.orchestra.run.smithi155.stdout: "initiated_at": "2023-08-01T19:55:05.576840+0000", 2023-08-01T19:55:59.720 INFO:teuthology.orchestra.run.smithi155.stdout: "age": 53.959153370999999, 2023-08-01T19:55:59.720 INFO:teuthology.orchestra.run.smithi155.stdout: "duration": 0.058423127999999998, 2023-08-01T19:55:59.720 INFO:teuthology.orchestra.run.smithi155.stdout: "type_data": { 2023-08-01T19:55:59.720 INFO:teuthology.orchestra.run.smithi155.stdout: "flag_point": "commit sent; apply or cleanup", 2023-08-01T19:55:59.720 INFO:teuthology.orchestra.run.smithi155.stdout: "client_info": { 2023-08-01T19:55:59.720 INFO:teuthology.orchestra.run.smithi155.stdout: "client": "client.4668", 2023-08-01T19:55:59.721 INFO:teuthology.orchestra.run.smithi155.stdout: "client_addr": "172.21.15.6:0/1709472247", 2023-08-01T19:55:59.721 INFO:teuthology.orchestra.run.smithi155.stdout: "tid": 100947 2023-08-01T19:55:59.721 INFO:teuthology.orchestra.run.smithi155.stdout: }, 2023-08-01T19:55:59.721 INFO:teuthology.orchestra.run.smithi155.stdout: "events": [ 2023-08-01T19:55:59.721 INFO:teuthology.orchestra.run.smithi155.stdout: { 2023-08-01T19:55:59.721 INFO:teuthology.orchestra.run.smithi155.stdout: "event": "initiated", 2023-08-01T19:55:59.721 INFO:teuthology.orchestra.run.smithi155.stdout: "time": "2023-08-01T19:55:05.576840+0000", 2023-08-01T19:55:59.721 INFO:teuthology.orchestra.run.smithi155.stdout: "duration": 0 2023-08-01T19:55:59.722 INFO:teuthology.orchestra.run.smithi155.stdout: }, 2023-08-01T19:55:59.722 INFO:teuthology.orchestra.run.smithi155.stdout: { 2023-08-01T19:55:59.722 INFO:teuthology.orchestra.run.smithi155.stdout: "event": "throttled", 2023-08-01T19:55:59.722 INFO:teuthology.orchestra.run.smithi155.stdout: "time": "2023-08-01T19:55:05.576840+0000", 2023-08-01T19:55:59.722 INFO:teuthology.orchestra.run.smithi155.stdout: "duration": 0 2023-08-01T19:55:59.722 INFO:teuthology.orchestra.run.smithi155.stdout: }, 2023-08-01T19:55:59.722 INFO:teuthology.orchestra.run.smithi155.stdout: { 2023-08-01T19:55:59.722 INFO:teuthology.orchestra.run.smithi155.stdout: "event": "header_read", 2023-08-01T19:55:59.723 INFO:teuthology.orchestra.run.smithi155.stdout: "time": "2023-08-01T19:55:05.576839+0000", 2023-08-01T19:55:59.723 INFO:teuthology.orchestra.run.smithi155.stdout: "duration": 4294967295.9999995 2023-08-01T19:55:59.723 INFO:teuthology.orchestra.run.smithi155.stdout: }, 2023-08-01T19:55:59.723 INFO:teuthology.orchestra.run.smithi155.stdout: { 2023-08-01T19:55:59.723 INFO:teuthology.orchestra.run.smithi155.stdout: "event": "all_read", 2023-08-01T19:55:59.723 INFO:teuthology.orchestra.run.smithi155.stdout: "time": "2023-08-01T19:55:05.576893+0000", 2023-08-01T19:55:59.723 INFO:teuthology.orchestra.run.smithi155.stdout: "duration": 5.3893000000000001e-05 2023-08-01T19:55:59.723 INFO:teuthology.orchestra.run.smithi155.stdout: }, 2023-08-01T19:55:59.724 INFO:teuthology.orchestra.run.smithi155.stdout: { 2023-08-01T19:55:59.724 INFO:teuthology.orchestra.run.smithi155.stdout: "event": "dispatched", 2023-08-01T19:55:59.724 INFO:teuthology.orchestra.run.smithi155.stdout: "time": "2023-08-01T19:55:05.576902+0000", 2023-08-01T19:55:59.724 INFO:teuthology.orchestra.run.smithi155.stdout: "duration": 8.7520000000000002e-06 2023-08-01T19:55:59.724 INFO:teuthology.orchestra.run.smithi155.stdout: }, 2023-08-01T19:55:59.724 INFO:teuthology.orchestra.run.smithi155.stdout: { 2023-08-01T19:55:59.724 INFO:teuthology.orchestra.run.smithi155.stdout: "event": "queued_for_pg", 2023-08-01T19:55:59.725 INFO:teuthology.orchestra.run.smithi155.stdout: "time": "2023-08-01T19:55:05.576905+0000", 2023-08-01T19:55:59.725 INFO:teuthology.orchestra.run.smithi155.stdout: "duration": 3.01e-06 2023-08-01T19:55:59.725 INFO:teuthology.orchestra.run.smithi155.stdout: }, 2023-08-01T19:55:59.725 INFO:teuthology.orchestra.run.smithi155.stdout: { 2023-08-01T19:55:59.725 INFO:teuthology.orchestra.run.smithi155.stdout: "event": "reached_pg", 2023-08-01T19:55:59.725 INFO:teuthology.orchestra.run.smithi155.stdout: "time": "2023-08-01T19:55:05.579641+0000", 2023-08-01T19:55:59.725 INFO:teuthology.orchestra.run.smithi155.stdout: "duration": 0.0027366880000000001 2023-08-01T19:55:59.725 INFO:teuthology.orchestra.run.smithi155.stdout: }, 2023-08-01T19:55:59.726 INFO:teuthology.orchestra.run.smithi155.stdout: { 2023-08-01T19:55:59.726 INFO:teuthology.orchestra.run.smithi155.stdout: "event": "started", 2023-08-01T19:55:59.726 INFO:teuthology.orchestra.run.smithi155.stdout: "time": "2023-08-01T19:55:05.579734+0000", 2023-08-01T19:55:59.726 INFO:teuthology.orchestra.run.smithi155.stdout: "duration": 9.2590000000000006e-05 2023-08-01T19:55:59.726 INFO:teuthology.orchestra.run.smithi155.stdout: }, 2023-08-01T19:55:59.726 INFO:teuthology.orchestra.run.smithi155.stdout: { 2023-08-01T19:55:59.726 INFO:teuthology.orchestra.run.smithi155.stdout: "event": "waiting for subops from 0", 2023-08-01T19:55:59.726 INFO:teuthology.orchestra.run.smithi155.stdout: "time": "2023-08-01T19:55:05.579825+0000", 2023-08-01T19:55:59.727 INFO:teuthology.orchestra.run.smithi155.stdout: "duration": 9.0964999999999994e-05 2023-08-01T19:55:59.727 INFO:teuthology.orchestra.run.smithi155.stdout: }, 2023-08-01T19:55:59.727 INFO:teuthology.orchestra.run.smithi155.stdout: { 2023-08-01T19:55:59.727 INFO:teuthology.orchestra.run.smithi155.stdout: "event": "op_commit", 2023-08-01T19:55:59.727 INFO:teuthology.orchestra.run.smithi155.stdout: "time": "2023-08-01T19:55:05.585041+0000", 2023-08-01T19:55:59.727 INFO:teuthology.orchestra.run.smithi155.stdout: "duration": 0.0052159670000000002 2023-08-01T19:55:59.727 INFO:teuthology.orchestra.run.smithi155.stdout: }, 2023-08-01T19:55:59.728 INFO:teuthology.orchestra.run.smithi155.stdout: { 2023-08-01T19:55:59.728 INFO:teuthology.orchestra.run.smithi155.stdout: "event": "sub_op_commit_rec", 2023-08-01T19:55:59.728 INFO:teuthology.orchestra.run.smithi155.stdout: "time": "2023-08-01T19:55:05.635199+0000", 2023-08-01T19:55:59.728 INFO:teuthology.orchestra.run.smithi155.stdout: "duration": 0.050158023000000003 2023-08-01T19:55:59.728 INFO:teuthology.orchestra.run.smithi155.stdout: }, 2023-08-01T19:55:59.728 INFO:teuthology.orchestra.run.smithi155.stdout: { 2023-08-01T19:55:59.728 INFO:teuthology.orchestra.run.smithi155.stdout: "event": "commit_sent", 2023-08-01T19:55:59.728 INFO:teuthology.orchestra.run.smithi155.stdout: "time": "2023-08-01T19:55:05.635227+0000", 2023-08-01T19:55:59.729 INFO:teuthology.orchestra.run.smithi155.stdout: "duration": 2.7821e-05 2023-08-01T19:55:59.729 INFO:teuthology.orchestra.run.smithi155.stdout: }, 2023-08-01T19:55:59.729 INFO:teuthology.orchestra.run.smithi155.stdout: { 2023-08-01T19:55:59.729 INFO:teuthology.orchestra.run.smithi155.stdout: "event": "done", 2023-08-01T19:55:59.729 INFO:teuthology.orchestra.run.smithi155.stdout: "time": "2023-08-01T19:55:05.635263+0000", 2023-08-01T19:55:59.729 INFO:teuthology.orchestra.run.smithi155.stdout: "duration": 3.6081000000000002e-05 2023-08-01T19:55:59.729 INFO:teuthology.orchestra.run.smithi155.stdout: } 2023-08-01T19:55:59.729 INFO:teuthology.orchestra.run.smithi155.stdout: ] 2023-08-01T19:55:59.730 INFO:teuthology.orchestra.run.smithi155.stdout: } 2023-08-01T19:55:59.730 INFO:teuthology.orchestra.run.smithi155.stdout: }, 2023-08-01T19:55:59.730 INFO:teuthology.orchestra.run.smithi155.stdout: { 2023-08-01T19:55:59.730 INFO:teuthology.orchestra.run.smithi155.stdout: "description": "osd_op(client.4668.0:196973 5.d 5:b0279e95:::benchmark_data_smithi006_114134_object63312:head [delete] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e61)", 2023-08-01T19:55:59.730 INFO:teuthology.orchestra.run.smithi155.stdout: "initiated_at": "2023-08-01T19:55:58.323767+0000", 2023-08-01T19:55:59.730 INFO:teuthology.orchestra.run.smithi155.stdout: "age": 1.2122263769999999, 2023-08-01T19:55:59.730 INFO:teuthology.orchestra.run.smithi155.stdout: "duration": 0.024003638000000001, 2023-08-01T19:55:59.731 INFO:teuthology.orchestra.run.smithi155.stdout: "type_data": { 2023-08-01T19:55:59.731 INFO:teuthology.orchestra.run.smithi155.stdout: "flag_point": "commit sent; apply or cleanup", 2023-08-01T19:55:59.731 INFO:teuthology.orchestra.run.smithi155.stdout: "client_info": { 2023-08-01T19:55:59.731 INFO:teuthology.orchestra.run.smithi155.stdout: "client": "client.4668", 2023-08-01T19:55:59.731 INFO:teuthology.orchestra.run.smithi155.stdout: "client_addr": "172.21.15.6:0/1709472247", 2023-08-01T19:55:59.731 INFO:teuthology.orchestra.run.smithi155.stdout: "tid": 196973 2023-08-01T19:55:59.731 INFO:teuthology.orchestra.run.smithi155.stdout: }, 2023-08-01T19:55:59.732 INFO:teuthology.orchestra.run.smithi155.stdout: "events": [ 2023-08-01T19:55:59.732 INFO:teuthology.orchestra.run.smithi155.stdout: { 2023-08-01T19:55:59.732 INFO:teuthology.orchestra.run.smithi155.stdout: "event": "initiated", 2023-08-01T19:55:59.732 INFO:teuthology.orchestra.run.smithi155.stdout: "time": "2023-08-01T19:55:58.323767+0000", 2023-08-01T19:55:59.732 INFO:teuthology.orchestra.run.smithi155.stdout: "duration": 0 2023-08-01T19:55:59.732 INFO:teuthology.orchestra.run.smithi155.stdout: }, 2023-08-01T19:55:59.732 INFO:teuthology.orchestra.run.smithi155.stdout: { 2023-08-01T19:55:59.732 INFO:teuthology.orchestra.run.smithi155.stdout: "event": "throttled", 2023-08-01T19:55:59.733 INFO:teuthology.orchestra.run.smithi155.stdout: "time": "2023-08-01T19:55:58.323767+0000", 2023-08-01T19:55:59.733 INFO:teuthology.orchestra.run.smithi155.stdout: "duration": 0 2023-08-01T19:55:59.733 INFO:teuthology.orchestra.run.smithi155.stdout: }, 2023-08-01T19:55:59.733 INFO:teuthology.orchestra.run.smithi155.stdout: { 2023-08-01T19:55:59.733 INFO:teuthology.orchestra.run.smithi155.stdout: "event": "header_read", 2023-08-01T19:55:59.733 INFO:teuthology.orchestra.run.smithi155.stdout: "time": "2023-08-01T19:55:58.323766+0000", 2023-08-01T19:55:59.733 INFO:teuthology.orchestra.run.smithi155.stdout: "duration": 4294967295.9999995 2023-08-01T19:55:59.733 INFO:teuthology.orchestra.run.smithi155.stdout: }, 2023-08-01T19:55:59.734 INFO:teuthology.orchestra.run.smithi155.stdout: { 2023-08-01T19:55:59.734 INFO:teuthology.orchestra.run.smithi155.stdout: "event": "all_read", 2023-08-01T19:55:59.734 INFO:teuthology.orchestra.run.smithi155.stdout: "time": "2023-08-01T19:55:58.323770+0000", 2023-08-01T19:55:59.734 INFO:teuthology.orchestra.run.smithi155.stdout: "duration": 3.7639999999999999e-06 2023-08-01T19:55:59.734 INFO:teuthology.orchestra.run.smithi155.stdout: }, 2023-08-01T19:55:59.734 INFO:teuthology.orchestra.run.smithi155.stdout: { 2023-08-01T19:55:59.734 INFO:teuthology.orchestra.run.smithi155.stdout: "event": "dispatched", 2023-08-01T19:55:59.734 INFO:teuthology.orchestra.run.smithi155.stdout: "time": "2023-08-01T19:55:58.323778+0000", 2023-08-01T19:55:59.735 INFO:teuthology.orchestra.run.smithi155.stdout: "duration": 7.9570000000000002e-06 2023-08-01T19:55:59.735 INFO:teuthology.orchestra.run.smithi155.stdout: }, 2023-08-01T19:55:59.735 INFO:teuthology.orchestra.run.smithi155.stdout: { 2023-08-01T19:55:59.735 INFO:teuthology.orchestra.run.smithi155.stdout: "event": "queued_for_pg", 2023-08-01T19:55:59.735 INFO:teuthology.orchestra.run.smithi155.stdout: "time": "2023-08-01T19:55:58.323783+0000", 2023-08-01T19:55:59.735 INFO:teuthology.orchestra.run.smithi155.stdout: "duration": 4.9250000000000003e-06 2023-08-01T19:55:59.735 INFO:teuthology.orchestra.run.smithi155.stdout: }, 2023-08-01T19:55:59.736 INFO:teuthology.orchestra.run.smithi155.stdout: { 2023-08-01T19:55:59.736 INFO:teuthology.orchestra.run.smithi155.stdout: "event": "reached_pg", 2023-08-01T19:55:59.736 INFO:teuthology.orchestra.run.smithi155.stdout: "time": "2023-08-01T19:55:58.323818+0000", 2023-08-01T19:55:59.736 INFO:teuthology.orchestra.run.smithi155.stdout: "duration": 3.4768000000000003e-05 2023-08-01T19:55:59.736 INFO:teuthology.orchestra.run.smithi155.stdout: }, 2023-08-01T19:55:59.736 INFO:teuthology.orchestra.run.smithi155.stdout: { 2023-08-01T19:55:59.736 INFO:teuthology.orchestra.run.smithi155.stdout: "event": "started", 2023-08-01T19:55:59.736 INFO:teuthology.orchestra.run.smithi155.stdout: "time": "2023-08-01T19:55:58.323896+0000", 2023-08-01T19:55:59.737 INFO:teuthology.orchestra.run.smithi155.stdout: "duration": 7.8475999999999999e-05 2023-08-01T19:55:59.737 INFO:teuthology.orchestra.run.smithi155.stdout: }, 2023-08-01T19:55:59.737 INFO:teuthology.orchestra.run.smithi155.stdout: { 2023-08-01T19:55:59.737 INFO:teuthology.orchestra.run.smithi155.stdout: "event": "waiting for subops from 1", 2023-08-01T19:55:59.737 INFO:teuthology.orchestra.run.smithi155.stdout: "time": "2023-08-01T19:55:58.323960+0000", 2023-08-01T19:55:59.737 INFO:teuthology.orchestra.run.smithi155.stdout: "duration": 6.4417000000000003e-05 2023-08-01T19:55:59.737 INFO:teuthology.orchestra.run.smithi155.stdout: }, 2023-08-01T19:55:59.737 INFO:teuthology.orchestra.run.smithi155.stdout: { 2023-08-01T19:55:59.738 INFO:teuthology.orchestra.run.smithi155.stdout: "event": "op_commit", 2023-08-01T19:55:59.738 INFO:teuthology.orchestra.run.smithi155.stdout: "time": "2023-08-01T19:55:58.328667+0000", 2023-08-01T19:55:59.738 INFO:teuthology.orchestra.run.smithi155.stdout: "duration": 0.0047067530000000002 2023-08-01T19:55:59.738 INFO:teuthology.orchestra.run.smithi155.stdout: }, 2023-08-01T19:55:59.738 INFO:teuthology.orchestra.run.smithi155.stdout: { 2023-08-01T19:55:59.738 INFO:teuthology.orchestra.run.smithi155.stdout: "event": "sub_op_commit_rec", 2023-08-01T19:55:59.738 INFO:teuthology.orchestra.run.smithi155.stdout: "time": "2023-08-01T19:55:58.347719+0000", 2023-08-01T19:55:59.739 INFO:teuthology.orchestra.run.smithi155.stdout: "duration": 0.019051351000000001 2023-08-01T19:55:59.739 INFO:teuthology.orchestra.run.smithi155.stdout: }, 2023-08-01T19:55:59.739 INFO:teuthology.orchestra.run.smithi155.stdout: { 2023-08-01T19:55:59.739 INFO:teuthology.orchestra.run.smithi155.stdout: "event": "commit_sent", 2023-08-01T19:55:59.739 INFO:teuthology.orchestra.run.smithi155.stdout: "time": "2023-08-01T19:55:58.347749+0000", 2023-08-01T19:55:59.739 INFO:teuthology.orchestra.run.smithi155.stdout: "duration": 3.0207999999999999e-05 2023-08-01T19:55:59.739 INFO:teuthology.orchestra.run.smithi155.stdout: }, 2023-08-01T19:55:59.739 INFO:teuthology.orchestra.run.smithi155.stdout: { 2023-08-01T19:55:59.740 INFO:teuthology.orchestra.run.smithi155.stdout: "event": "done", 2023-08-01T19:55:59.740 INFO:teuthology.orchestra.run.smithi155.stdout: "time": "2023-08-01T19:55:58.347770+0000", 2023-08-01T19:55:59.740 INFO:teuthology.orchestra.run.smithi155.stdout: "duration": 2.1642999999999999e-05 2023-08-01T19:55:59.740 INFO:teuthology.orchestra.run.smithi155.stdout: } 2023-08-01T19:55:59.740 INFO:teuthology.orchestra.run.smithi155.stdout: ] 2023-08-01T19:55:59.740 INFO:teuthology.orchestra.run.smithi155.stdout: } 2023-08-01T19:55:59.740 INFO:teuthology.orchestra.run.smithi155.stdout: }, 2023-08-01T19:55:59.740 INFO:teuthology.orchestra.run.smithi155.stdout: { 2023-08-01T19:55:59.741 INFO:teuthology.orchestra.run.smithi155.stdout: "description": "osd_op(client.4668.0:196976 5.f 5:fc67f1bf:::benchmark_data_smithi006_114134_object63315:head [delete] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e61)", 2023-08-01T19:55:59.741 INFO:teuthology.orchestra.run.smithi155.stdout: "initiated_at": "2023-08-01T19:55:58.327582+0000", 2023-08-01T19:55:59.741 INFO:teuthology.orchestra.run.smithi155.stdout: "age": 1.208411328, 2023-08-01T19:55:59.741 INFO:teuthology.orchestra.run.smithi155.stdout: "duration": 0.025437165000000001, 2023-08-01T19:55:59.741 INFO:teuthology.orchestra.run.smithi155.stdout: "type_data": { 2023-08-01T19:55:59.741 INFO:teuthology.orchestra.run.smithi155.stdout: "flag_point": "commit sent; apply or cleanup", 2023-08-01T19:55:59.741 INFO:teuthology.orchestra.run.smithi155.stdout: "client_info": { 2023-08-01T19:55:59.742 INFO:teuthology.orchestra.run.smithi155.stdout: "client": "client.4668", 2023-08-01T19:55:59.742 INFO:teuthology.orchestra.run.smithi155.stdout: "client_addr": "172.21.15.6:0/1709472247", 2023-08-01T19:55:59.742 INFO:teuthology.orchestra.run.smithi155.stdout: "tid": 196976 2023-08-01T19:55:59.742 INFO:teuthology.orchestra.run.smithi155.stdout: }, 2023-08-01T19:55:59.742 INFO:teuthology.orchestra.run.smithi155.stdout: "events": [ 2023-08-01T19:55:59.742 INFO:teuthology.orchestra.run.smithi155.stdout: { 2023-08-01T19:55:59.742 INFO:teuthology.orchestra.run.smithi155.stdout: "event": "initiated", 2023-08-01T19:55:59.742 INFO:teuthology.orchestra.run.smithi155.stdout: "time": "2023-08-01T19:55:58.327582+0000", 2023-08-01T19:55:59.743 INFO:teuthology.orchestra.run.smithi155.stdout: "duration": 0 2023-08-01T19:55:59.743 INFO:teuthology.orchestra.run.smithi155.stdout: }, 2023-08-01T19:55:59.743 INFO:teuthology.orchestra.run.smithi155.stdout: { 2023-08-01T19:55:59.743 INFO:teuthology.orchestra.run.smithi155.stdout: "event": "throttled", 2023-08-01T19:55:59.743 INFO:teuthology.orchestra.run.smithi155.stdout: "time": "2023-08-01T19:55:58.327582+0000", 2023-08-01T19:55:59.743 INFO:teuthology.orchestra.run.smithi155.stdout: "duration": 0 2023-08-01T19:55:59.743 INFO:teuthology.orchestra.run.smithi155.stdout: }, 2023-08-01T19:55:59.743 INFO:teuthology.orchestra.run.smithi155.stdout: { 2023-08-01T19:55:59.744 INFO:teuthology.orchestra.run.smithi155.stdout: "event": "header_read", 2023-08-01T19:55:59.744 INFO:teuthology.orchestra.run.smithi155.stdout: "time": "2023-08-01T19:55:58.327581+0000", 2023-08-01T19:55:59.744 INFO:teuthology.orchestra.run.smithi155.stdout: "duration": 4294967295.9999995 2023-08-01T19:55:59.744 INFO:teuthology.orchestra.run.smithi155.stdout: }, 2023-08-01T19:55:59.744 INFO:teuthology.orchestra.run.smithi155.stdout: { 2023-08-01T19:55:59.744 INFO:teuthology.orchestra.run.smithi155.stdout: "event": "all_read", 2023-08-01T19:55:59.744 INFO:teuthology.orchestra.run.smithi155.stdout: "time": "2023-08-01T19:55:58.327584+0000", 2023-08-01T19:55:59.745 INFO:teuthology.orchestra.run.smithi155.stdout: "duration": 2.7640000000000001e-06 2023-08-01T19:55:59.745 INFO:teuthology.orchestra.run.smithi155.stdout: }, 2023-08-01T19:55:59.745 INFO:teuthology.orchestra.run.smithi155.stdout: { 2023-08-01T19:55:59.745 INFO:teuthology.orchestra.run.smithi155.stdout: "event": "dispatched", 2023-08-01T19:55:59.745 INFO:teuthology.orchestra.run.smithi155.stdout: "time": "2023-08-01T19:55:58.327592+0000", 2023-08-01T19:55:59.745 INFO:teuthology.orchestra.run.smithi155.stdout: "duration": 7.5769999999999996e-06 2023-08-01T19:55:59.745 INFO:teuthology.orchestra.run.smithi155.stdout: }, 2023-08-01T19:55:59.745 INFO:teuthology.orchestra.run.smithi155.stdout: { 2023-08-01T19:55:59.746 INFO:teuthology.orchestra.run.smithi155.stdout: "event": "queued_for_pg", 2023-08-01T19:55:59.746 INFO:teuthology.orchestra.run.smithi155.stdout: "time": "2023-08-01T19:55:58.327595+0000", 2023-08-01T19:55:59.746 INFO:teuthology.orchestra.run.smithi155.stdout: "duration": 3.2179999999999999e-06 2023-08-01T19:55:59.746 INFO:teuthology.orchestra.run.smithi155.stdout: }, 2023-08-01T19:55:59.746 INFO:teuthology.orchestra.run.smithi155.stdout: { 2023-08-01T19:55:59.746 INFO:teuthology.orchestra.run.smithi155.stdout: "event": "reached_pg", 2023-08-01T19:55:59.746 INFO:teuthology.orchestra.run.smithi155.stdout: "time": "2023-08-01T19:55:58.327633+0000", 2023-08-01T19:55:59.746 INFO:teuthology.orchestra.run.smithi155.stdout: "duration": 3.8525999999999997e-05 2023-08-01T19:55:59.747 INFO:teuthology.orchestra.run.smithi155.stdout: }, 2023-08-01T19:55:59.747 INFO:teuthology.orchestra.run.smithi155.stdout: { 2023-08-01T19:55:59.747 INFO:teuthology.orchestra.run.smithi155.stdout: "event": "started", 2023-08-01T19:55:59.747 INFO:teuthology.orchestra.run.smithi155.stdout: "time": "2023-08-01T19:55:58.327745+0000", 2023-08-01T19:55:59.747 INFO:teuthology.orchestra.run.smithi155.stdout: "duration": 0.000111877 2023-08-01T19:55:59.747 INFO:teuthology.orchestra.run.smithi155.stdout: }, 2023-08-01T19:55:59.747 INFO:teuthology.orchestra.run.smithi155.stdout: { 2023-08-01T19:55:59.747 INFO:teuthology.orchestra.run.smithi155.stdout: "event": "waiting for subops from 1", 2023-08-01T19:55:59.748 INFO:teuthology.orchestra.run.smithi155.stdout: "time": "2023-08-01T19:55:58.327846+0000", 2023-08-01T19:55:59.748 INFO:teuthology.orchestra.run.smithi155.stdout: "duration": 0.000100989 2023-08-01T19:55:59.748 INFO:teuthology.orchestra.run.smithi155.stdout: }, 2023-08-01T19:55:59.748 INFO:teuthology.orchestra.run.smithi155.stdout: { 2023-08-01T19:55:59.748 INFO:teuthology.orchestra.run.smithi155.stdout: "event": "op_commit", 2023-08-01T19:55:59.748 INFO:teuthology.orchestra.run.smithi155.stdout: "time": "2023-08-01T19:55:58.332277+0000", 2023-08-01T19:55:59.748 INFO:teuthology.orchestra.run.smithi155.stdout: "duration": 0.0044303119999999996 2023-08-01T19:55:59.749 INFO:teuthology.orchestra.run.smithi155.stdout: }, 2023-08-01T19:55:59.749 INFO:teuthology.orchestra.run.smithi155.stdout: { 2023-08-01T19:55:59.749 INFO:teuthology.orchestra.run.smithi155.stdout: "event": "sub_op_commit_rec", 2023-08-01T19:55:59.749 INFO:teuthology.orchestra.run.smithi155.stdout: "time": "2023-08-01T19:55:58.352945+0000", 2023-08-01T19:55:59.749 INFO:teuthology.orchestra.run.smithi155.stdout: "duration": 0.020668461999999999 2023-08-01T19:55:59.749 INFO:teuthology.orchestra.run.smithi155.stdout: }, 2023-08-01T19:55:59.749 INFO:teuthology.orchestra.run.smithi155.stdout: { 2023-08-01T19:55:59.749 INFO:teuthology.orchestra.run.smithi155.stdout: "event": "commit_sent", 2023-08-01T19:55:59.750 INFO:teuthology.orchestra.run.smithi155.stdout: "time": "2023-08-01T19:55:58.352985+0000", 2023-08-01T19:55:59.750 INFO:teuthology.orchestra.run.smithi155.stdout: "duration": 3.9632000000000003e-05 2023-08-01T19:55:59.750 INFO:teuthology.orchestra.run.smithi155.stdout: }, 2023-08-01T19:55:59.750 INFO:teuthology.orchestra.run.smithi155.stdout: { 2023-08-01T19:55:59.750 INFO:teuthology.orchestra.run.smithi155.stdout: "event": "done", 2023-08-01T19:55:59.750 INFO:teuthology.orchestra.run.smithi155.stdout: "time": "2023-08-01T19:55:58.353019+0000", 2023-08-01T19:55:59.750 INFO:teuthology.orchestra.run.smithi155.stdout: "duration": 3.4295999999999998e-05 2023-08-01T19:55:59.750 INFO:teuthology.orchestra.run.smithi155.stdout: } 2023-08-01T19:55:59.751 INFO:teuthology.orchestra.run.smithi155.stdout: ] 2023-08-01T19:55:59.751 INFO:teuthology.orchestra.run.smithi155.stdout: } 2023-08-01T19:55:59.751 INFO:teuthology.orchestra.run.smithi155.stdout: }, 2023-08-01T19:55:59.751 INFO:teuthology.orchestra.run.smithi155.stdout: { 2023-08-01T19:55:59.751 INFO:teuthology.orchestra.run.smithi155.stdout: "description": "osd_op(client.4668.0:196977 5.f 5:f15b666f:::benchmark_data_smithi006_114134_object63316:head [delete] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e61)", 2023-08-01T19:55:59.751 INFO:teuthology.orchestra.run.smithi155.stdout: "initiated_at": "2023-08-01T19:55:58.327601+0000", 2023-08-01T19:55:59.751 INFO:teuthology.orchestra.run.smithi155.stdout: "age": 1.208392151, 2023-08-01T19:55:59.752 INFO:teuthology.orchestra.run.smithi155.stdout: "duration": 0.0295406, 2023-08-01T19:55:59.752 INFO:teuthology.orchestra.run.smithi155.stdout: "type_data": { 2023-08-01T19:55:59.752 INFO:teuthology.orchestra.run.smithi155.stdout: "flag_point": "commit sent; apply or cleanup", 2023-08-01T19:55:59.752 INFO:teuthology.orchestra.run.smithi155.stdout: "client_info": { 2023-08-01T19:55:59.752 INFO:teuthology.orchestra.run.smithi155.stdout: "client": "client.4668", 2023-08-01T19:55:59.752 INFO:teuthology.orchestra.run.smithi155.stdout: "client_addr": "172.21.15.6:0/1709472247", 2023-08-01T19:55:59.752 INFO:teuthology.orchestra.run.smithi155.stdout: "tid": 196977 2023-08-01T19:55:59.752 INFO:teuthology.orchestra.run.smithi155.stdout: }, 2023-08-01T19:55:59.753 INFO:teuthology.orchestra.run.smithi155.stdout: "events": [ 2023-08-01T19:55:59.753 INFO:teuthology.orchestra.run.smithi155.stdout: { 2023-08-01T19:55:59.753 INFO:teuthology.orchestra.run.smithi155.stdout: "event": "initiated", 2023-08-01T19:55:59.753 INFO:teuthology.orchestra.run.smithi155.stdout: "time": "2023-08-01T19:55:58.327601+0000", 2023-08-01T19:55:59.753 INFO:teuthology.orchestra.run.smithi155.stdout: "duration": 0 2023-08-01T19:55:59.753 INFO:teuthology.orchestra.run.smithi155.stdout: }, 2023-08-01T19:55:59.753 INFO:teuthology.orchestra.run.smithi155.stdout: { 2023-08-01T19:55:59.753 INFO:teuthology.orchestra.run.smithi155.stdout: "event": "throttled", 2023-08-01T19:55:59.754 INFO:teuthology.orchestra.run.smithi155.stdout: "time": "2023-08-01T19:55:58.327601+0000", 2023-08-01T19:55:59.754 INFO:teuthology.orchestra.run.smithi155.stdout: "duration": 0 2023-08-01T19:55:59.754 INFO:teuthology.orchestra.run.smithi155.stdout: }, 2023-08-01T19:55:59.754 INFO:teuthology.orchestra.run.smithi155.stdout: { 2023-08-01T19:55:59.754 INFO:teuthology.orchestra.run.smithi155.stdout: "event": "header_read", 2023-08-01T19:55:59.754 INFO:teuthology.orchestra.run.smithi155.stdout: "time": "2023-08-01T19:55:58.327601+0000", 2023-08-01T19:55:59.754 INFO:teuthology.orchestra.run.smithi155.stdout: "duration": 4294967295.9999995 2023-08-01T19:55:59.754 INFO:teuthology.orchestra.run.smithi155.stdout: }, 2023-08-01T19:55:59.755 INFO:teuthology.orchestra.run.smithi155.stdout: { 2023-08-01T19:55:59.755 INFO:teuthology.orchestra.run.smithi155.stdout: "event": "all_read", 2023-08-01T19:55:59.755 INFO:teuthology.orchestra.run.smithi155.stdout: "time": "2023-08-01T19:55:58.327602+0000", 2023-08-01T19:55:59.755 INFO:teuthology.orchestra.run.smithi155.stdout: "duration": 1.6020000000000001e-06 2023-08-01T19:55:59.755 INFO:teuthology.orchestra.run.smithi155.stdout: }, 2023-08-01T19:55:59.755 INFO:teuthology.orchestra.run.smithi155.stdout: { 2023-08-01T19:55:59.755 INFO:teuthology.orchestra.run.smithi155.stdout: "event": "dispatched", 2023-08-01T19:55:59.756 INFO:teuthology.orchestra.run.smithi155.stdout: "time": "2023-08-01T19:55:58.327606+0000", 2023-08-01T19:55:59.756 INFO:teuthology.orchestra.run.smithi155.stdout: "duration": 3.9720000000000003e-06 2023-08-01T19:55:59.756 INFO:teuthology.orchestra.run.smithi155.stdout: }, 2023-08-01T19:55:59.756 INFO:teuthology.orchestra.run.smithi155.stdout: { 2023-08-01T19:55:59.756 INFO:teuthology.orchestra.run.smithi155.stdout: "event": "queued_for_pg", 2023-08-01T19:55:59.756 INFO:teuthology.orchestra.run.smithi155.stdout: "time": "2023-08-01T19:55:58.327608+0000", 2023-08-01T19:55:59.756 INFO:teuthology.orchestra.run.smithi155.stdout: "duration": 2.159e-06 2023-08-01T19:55:59.757 INFO:teuthology.orchestra.run.smithi155.stdout: }, 2023-08-01T19:55:59.757 INFO:teuthology.orchestra.run.smithi155.stdout: { 2023-08-01T19:55:59.757 INFO:teuthology.orchestra.run.smithi155.stdout: "event": "reached_pg", 2023-08-01T19:55:59.757 INFO:teuthology.orchestra.run.smithi155.stdout: "time": "2023-08-01T19:55:58.329714+0000", 2023-08-01T19:55:59.757 INFO:teuthology.orchestra.run.smithi155.stdout: "duration": 0.0021059970000000001 2023-08-01T19:55:59.757 INFO:teuthology.orchestra.run.smithi155.stdout: }, 2023-08-01T19:55:59.757 INFO:teuthology.orchestra.run.smithi155.stdout: { 2023-08-01T19:55:59.757 INFO:teuthology.orchestra.run.smithi155.stdout: "event": "started", 2023-08-01T19:55:59.758 INFO:teuthology.orchestra.run.smithi155.stdout: "time": "2023-08-01T19:55:58.329793+0000", 2023-08-01T19:55:59.758 INFO:teuthology.orchestra.run.smithi155.stdout: "duration": 7.9062999999999998e-05 2023-08-01T19:55:59.758 INFO:teuthology.orchestra.run.smithi155.stdout: }, 2023-08-01T19:55:59.758 INFO:teuthology.orchestra.run.smithi155.stdout: { 2023-08-01T19:55:59.758 INFO:teuthology.orchestra.run.smithi155.stdout: "event": "waiting for subops from 1", 2023-08-01T19:55:59.758 INFO:teuthology.orchestra.run.smithi155.stdout: "time": "2023-08-01T19:55:58.329856+0000", 2023-08-01T19:55:59.758 INFO:teuthology.orchestra.run.smithi155.stdout: "duration": 6.2707999999999997e-05 2023-08-01T19:55:59.758 INFO:teuthology.orchestra.run.smithi155.stdout: }, 2023-08-01T19:55:59.759 INFO:teuthology.orchestra.run.smithi155.stdout: { 2023-08-01T19:55:59.759 INFO:teuthology.orchestra.run.smithi155.stdout: "event": "op_commit", 2023-08-01T19:55:59.759 INFO:teuthology.orchestra.run.smithi155.stdout: "time": "2023-08-01T19:55:58.333989+0000", 2023-08-01T19:55:59.759 INFO:teuthology.orchestra.run.smithi155.stdout: "duration": 0.0041324079999999997 2023-08-01T19:55:59.759 INFO:teuthology.orchestra.run.smithi155.stdout: }, 2023-08-01T19:55:59.759 INFO:teuthology.orchestra.run.smithi155.stdout: { 2023-08-01T19:55:59.759 INFO:teuthology.orchestra.run.smithi155.stdout: "event": "sub_op_commit_rec", 2023-08-01T19:55:59.759 INFO:teuthology.orchestra.run.smithi155.stdout: "time": "2023-08-01T19:55:58.357069+0000", 2023-08-01T19:55:59.760 INFO:teuthology.orchestra.run.smithi155.stdout: "duration": 0.023080570000000002 2023-08-01T19:55:59.760 INFO:teuthology.orchestra.run.smithi155.stdout: }, 2023-08-01T19:55:59.760 INFO:teuthology.orchestra.run.smithi155.stdout: { 2023-08-01T19:55:59.760 INFO:teuthology.orchestra.run.smithi155.stdout: "event": "commit_sent", 2023-08-01T19:55:59.760 INFO:teuthology.orchestra.run.smithi155.stdout: "time": "2023-08-01T19:55:58.357108+0000", 2023-08-01T19:55:59.760 INFO:teuthology.orchestra.run.smithi155.stdout: "duration": 3.8890999999999997e-05 2023-08-01T19:55:59.760 INFO:teuthology.orchestra.run.smithi155.stdout: }, 2023-08-01T19:55:59.761 INFO:teuthology.orchestra.run.smithi155.stdout: { 2023-08-01T19:55:59.761 INFO:teuthology.orchestra.run.smithi155.stdout: "event": "done", 2023-08-01T19:55:59.761 INFO:teuthology.orchestra.run.smithi155.stdout: "time": "2023-08-01T19:55:58.357142+0000", 2023-08-01T19:55:59.761 INFO:teuthology.orchestra.run.smithi155.stdout: "duration": 3.349e-05 2023-08-01T19:55:59.761 INFO:teuthology.orchestra.run.smithi155.stdout: } 2023-08-01T19:55:59.761 INFO:teuthology.orchestra.run.smithi155.stdout: ] 2023-08-01T19:55:59.761 INFO:teuthology.orchestra.run.smithi155.stdout: } 2023-08-01T19:55:59.761 INFO:teuthology.orchestra.run.smithi155.stdout: } 2023-08-01T19:55:59.762 INFO:teuthology.orchestra.run.smithi155.stdout: ] 2023-08-01T19:55:59.762 INFO:teuthology.orchestra.run.smithi155.stdout:} 2023-08-01T19:55:59.762 DEBUG:teuthology.orchestra.run.smithi008:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 30 ceph --cluster ceph --admin-daemon /var/run/ceph/ceph-osd.0.asok dump_ops_in_flight 2023-08-01T19:55:59.763 DEBUG:teuthology.orchestra.run.smithi006:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 120 ceph --cluster ceph osd set nodeep-scrub 2023-08-01T19:55:59.763 DEBUG:teuthology.orchestra.run.smithi006:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 120 ceph --cluster ceph -- tell 'osd.*' injectargs --osd_enable_op_tracker=false 2023-08-01T19:55:59.765 INFO:tasks.ceph.osd.0.smithi008.stderr:2023-08-01T19:55:59.762+0000 7f16a58f4700 -1 received signal: Hangup from /usr/bin/python3 /bin/daemon-helper kill ceph-osd -f --cluster ceph -i 0 (PID: 111179) UID: 0 2023-08-01T19:55:59.866 INFO:tasks.ceph.osd.0.smithi008.stderr:2023-08-01T19:55:59.864+0000 7f16a58f4700 -1 received signal: Hangup from /usr/bin/python3 /bin/daemon-helper kill ceph-osd -f --cluster ceph -i 0 (PID: 111179) UID: 0 2023-08-01T19:55:59.932 INFO:teuthology.orchestra.run.smithi006.stdout:osd.0: {} 2023-08-01T19:55:59.950 INFO:teuthology.orchestra.run.smithi008.stdout:ERROR: (22) Invalid argument 2023-08-01T19:55:59.950 INFO:teuthology.orchestra.run.smithi008.stdout:op_tracker tracking is not enabled now, so no ops are tracked currently, even those get stuck. Please enable "osd_enable_op_tracker", and the tracker will start to track new ops received afterwards. 2023-08-01T19:55:59.953 INFO:teuthology.orchestra.run.smithi006.stdout:osd.2: {} 2023-08-01T19:55:59.953 INFO:teuthology.orchestra.run.smithi006.stderr:osd.0: osd_enable_op_tracker = 'false' 2023-08-01T19:55:59.953 INFO:teuthology.orchestra.run.smithi006.stderr:Error ENXIO: problem getting command descriptions from osd.1 2023-08-01T19:55:59.953 INFO:teuthology.orchestra.run.smithi006.stderr:osd.2: osd_enable_op_tracker = 'false' 2023-08-01T19:55:59.955 DEBUG:teuthology.orchestra.run:got remote process result: 6 2023-08-01T19:55:59.956 INFO:tasks.thrashosds.thrasher:Failed to tell all osds, ignoring 2023-08-01T19:55:59.965 DEBUG:teuthology.orchestra.run.smithi008:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 30 ceph --cluster ceph --admin-daemon /var/run/ceph/ceph-osd.0.asok dump_blocked_ops 2023-08-01T19:55:59.965 INFO:tasks.ceph.osd.0.smithi008.stderr:2023-08-01T19:55:59.963+0000 7f16a58f4700 -1 received signal: Hangup from /usr/bin/python3 /bin/daemon-helper kill ceph-osd -f --cluster ceph -i 0 (PID: 111179) UID: 0 2023-08-01T19:56:00.066 INFO:tasks.ceph.osd.2.smithi155.stderr:2023-08-01T19:56:00.064+0000 7faa5c6ac700 -1 received signal: Hangup from /usr/bin/python3 /bin/daemon-helper kill ceph-osd -f --cluster ceph -i 2 (PID: 111337) UID: 0 2023-08-01T19:56:00.166 INFO:tasks.ceph.osd.2.smithi155.stderr:2023-08-01T19:56:00.165+0000 7faa5c6ac700 -1 received signal: Hangup from /usr/bin/python3 /bin/daemon-helper kill ceph-osd -f --cluster ceph -i 2 (PID: 111337) UID: 0 2023-08-01T19:56:00.186 INFO:teuthology.orchestra.run.smithi008.stdout:ERROR: (22) Invalid argument 2023-08-01T19:56:00.187 INFO:teuthology.orchestra.run.smithi008.stdout:op_tracker tracking is not enabled now, so no ops are tracked currently, even those get stuck. Please enable "osd_enable_op_tracker", and the tracker will start to track new ops received afterwards. 2023-08-01T19:56:00.195 DEBUG:teuthology.orchestra.run.smithi008:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 30 ceph --cluster ceph --admin-daemon /var/run/ceph/ceph-osd.0.asok dump_historic_ops 2023-08-01T19:56:00.269 INFO:tasks.ceph.osd.0.smithi008.stderr:2023-08-01T19:56:00.267+0000 7f16a58f4700 -1 received signal: Hangup from /usr/bin/python3 /bin/daemon-helper kill ceph-osd -f --cluster ceph -i 0 (PID: 111179) UID: 0 2023-08-01T19:56:00.368 INFO:tasks.ceph.osd.2.smithi155.stderr:2023-08-01T19:56:00.366+0000 7faa5c6ac700 -1 received signal: Hangup from /usr/bin/python3 /bin/daemon-helper kill ceph-osd -f --cluster ceph -i 2 (PID: 111337) UID: 0 2023-08-01T19:56:00.377 INFO:teuthology.orchestra.run.smithi008.stdout:ERROR: (22) Invalid argument 2023-08-01T19:56:00.377 INFO:teuthology.orchestra.run.smithi008.stdout:op_tracker tracking is not enabled now, so no ops are tracked currently, even those get stuck. Please enable "osd_enable_op_tracker", and the tracker will start to track new ops received afterwards. 2023-08-01T19:56:00.392 DEBUG:teuthology.orchestra.run.smithi155:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 30 ceph --cluster ceph --admin-daemon /var/run/ceph/ceph-osd.2.asok dump_ops_in_flight 2023-08-01T19:56:00.469 INFO:tasks.ceph.osd.0.smithi008.stderr:2023-08-01T19:56:00.467+0000 7f16a58f4700 -1 received signal: Hangup from /usr/bin/python3 /bin/daemon-helper kill ceph-osd -f --cluster ceph -i 0 (PID: 111179) UID: 0 2023-08-01T19:56:00.557 INFO:teuthology.orchestra.run.smithi155.stdout:ERROR: (22) Invalid argument 2023-08-01T19:56:00.557 INFO:teuthology.orchestra.run.smithi155.stdout:op_tracker tracking is not enabled now, so no ops are tracked currently, even those get stuck. Please enable "osd_enable_op_tracker", and the tracker will start to track new ops received afterwards. 2023-08-01T19:56:00.569 INFO:teuthology.orchestra.run.smithi006.stderr:nodeep-scrub is set 2023-08-01T19:56:00.571 DEBUG:teuthology.orchestra.run.smithi155:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 30 ceph --cluster ceph --admin-daemon /var/run/ceph/ceph-osd.2.asok dump_blocked_ops 2023-08-01T19:56:00.572 INFO:tasks.ceph.osd.2.smithi155.stderr:2023-08-01T19:56:00.569+0000 7faa5c6ac700 -1 received signal: Hangup from /usr/bin/python3 /bin/daemon-helper kill ceph-osd -f --cluster ceph -i 2 (PID: 111337) UID: 0 2023-08-01T19:56:00.671 INFO:tasks.ceph.osd.2.smithi155.stderr:2023-08-01T19:56:00.669+0000 7faa5c6ac700 -1 received signal: Hangup from /usr/bin/python3 /bin/daemon-helper kill ceph-osd -f --cluster ceph -i 2 (PID: 111337) UID: 0 2023-08-01T19:56:00.733 INFO:teuthology.orchestra.run.smithi155.stdout:ERROR: (22) Invalid argument 2023-08-01T19:56:00.733 INFO:teuthology.orchestra.run.smithi155.stdout:op_tracker tracking is not enabled now, so no ops are tracked currently, even those get stuck. Please enable "osd_enable_op_tracker", and the tracker will start to track new ops received afterwards. 2023-08-01T19:56:00.745 DEBUG:teuthology.orchestra.run.smithi155:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 30 ceph --cluster ceph --admin-daemon /var/run/ceph/ceph-osd.2.asok dump_historic_ops 2023-08-01T19:56:00.771 INFO:tasks.ceph.osd.0.smithi008.stderr:2023-08-01T19:56:00.770+0000 7f16a58f4700 -1 received signal: Hangup from /usr/bin/python3 /bin/daemon-helper kill ceph-osd -f --cluster ceph -i 0 (PID: 111179) UID: 0 2023-08-01T19:56:00.873 INFO:tasks.ceph.osd.0.smithi008.stderr:2023-08-01T19:56:00.871+0000 7f16a58f4700 -1 received signal: Hangup from /usr/bin/python3 /bin/daemon-helper kill ceph-osd -f --cluster ceph -i 0 (PID: 111179) UID: 0 2023-08-01T19:56:00.957 INFO:teuthology.orchestra.run.smithi155.stdout:ERROR: (22) Invalid argument 2023-08-01T19:56:00.958 INFO:teuthology.orchestra.run.smithi155.stdout:op_tracker tracking is not enabled now, so no ops are tracked currently, even those get stuck. Please enable "osd_enable_op_tracker", and the tracker will start to track new ops received afterwards. 2023-08-01T19:56:00.972 DEBUG:teuthology.orchestra.run.smithi008:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 30 ceph --cluster ceph --admin-daemon /var/run/ceph/ceph-osd.0.asok dump_ops_in_flight 2023-08-01T19:56:00.973 INFO:tasks.ceph.osd.0.smithi008.stderr:2023-08-01T19:56:00.971+0000 7f16a58f4700 -1 received signal: Hangup from /usr/bin/python3 /bin/daemon-helper kill ceph-osd -f --cluster ceph -i 0 (PID: 111179) UID: 0 2023-08-01T19:56:01.074 INFO:tasks.ceph.osd.0.smithi008.stderr:2023-08-01T19:56:01.072+0000 7f16a58f4700 -1 received signal: Hangup from /usr/bin/python3 /bin/daemon-helper kill ceph-osd -f --cluster ceph -i 0 (PID: 111179) UID: 0 2023-08-01T19:56:01.160 INFO:teuthology.orchestra.run.smithi008.stdout:ERROR: (22) Invalid argument 2023-08-01T19:56:01.160 INFO:teuthology.orchestra.run.smithi008.stdout:op_tracker tracking is not enabled now, so no ops are tracked currently, even those get stuck. Please enable "osd_enable_op_tracker", and the tracker will start to track new ops received afterwards. 2023-08-01T19:56:01.174 DEBUG:teuthology.orchestra.run.smithi008:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 30 ceph --cluster ceph --admin-daemon /var/run/ceph/ceph-osd.0.asok dump_blocked_ops 2023-08-01T19:56:01.175 INFO:tasks.ceph.osd.0.smithi008.stderr:2023-08-01T19:56:01.172+0000 7f16a58f4700 -1 received signal: Hangup from /usr/bin/python3 /bin/daemon-helper kill ceph-osd -f --cluster ceph -i 0 (PID: 111179) UID: 0 2023-08-01T19:56:01.275 INFO:tasks.ceph.osd.0.smithi008.stderr:2023-08-01T19:56:01.273+0000 7f16a58f4700 -1 received signal: Hangup from /usr/bin/python3 /bin/daemon-helper kill ceph-osd -f --cluster ceph -i 0 (PID: 111179) UID: 0 2023-08-01T19:56:01.376 INFO:tasks.ceph.osd.0.smithi008.stderr:2023-08-01T19:56:01.374+0000 7f16a58f4700 -1 received signal: Hangup from /usr/bin/python3 /bin/daemon-helper kill ceph-osd -f --cluster ceph -i 0 (PID: 111179) UID: 0 2023-08-01T19:56:01.399 INFO:teuthology.orchestra.run.smithi008.stdout:ERROR: (22) Invalid argument 2023-08-01T19:56:01.399 INFO:teuthology.orchestra.run.smithi008.stdout:op_tracker tracking is not enabled now, so no ops are tracked currently, even those get stuck. Please enable "osd_enable_op_tracker", and the tracker will start to track new ops received afterwards. 2023-08-01T19:56:01.414 DEBUG:teuthology.orchestra.run.smithi008:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 30 ceph --cluster ceph --admin-daemon /var/run/ceph/ceph-osd.0.asok dump_historic_ops 2023-08-01T19:56:01.498 INFO:tasks.ceph.osd.0.smithi008.stderr:2023-08-01T19:56:01.496+0000 7f16a58f4700 -1 received signal: Hangup from /usr/bin/python3 /bin/daemon-helper kill ceph-osd -f --cluster ceph -i 0 (PID: 111179) UID: 0 2023-08-01T19:56:01.577 INFO:tasks.ceph.osd.0.smithi008.stderr:2023-08-01T19:56:01.576+0000 7f16a58f4700 -1 received signal: Hangup from /usr/bin/python3 /bin/daemon-helper kill ceph-osd -f --cluster ceph -i 0 (PID: 111179) UID: 0 2023-08-01T19:56:01.642 INFO:teuthology.orchestra.run.smithi008.stdout:ERROR: (22) Invalid argument 2023-08-01T19:56:01.642 INFO:teuthology.orchestra.run.smithi008.stdout:op_tracker tracking is not enabled now, so no ops are tracked currently, even those get stuck. Please enable "osd_enable_op_tracker", and the tracker will start to track new ops received afterwards. 2023-08-01T19:56:01.656 DEBUG:teuthology.orchestra.run.smithi155:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 30 ceph --cluster ceph --admin-daemon /var/run/ceph/ceph-osd.2.asok dump_ops_in_flight 2023-08-01T19:56:01.700 INFO:tasks.ceph.osd.2.smithi155.stderr:2023-08-01T19:56:01.698+0000 7faa5c6ac700 -1 received signal: Hangup from /usr/bin/python3 /bin/daemon-helper kill ceph-osd -f --cluster ceph -i 2 (PID: 111337) UID: 0 2023-08-01T19:56:01.779 INFO:tasks.ceph.osd.0.smithi008.stderr:2023-08-01T19:56:01.777+0000 7f16a58f4700 -1 received signal: Hangup from /usr/bin/python3 /bin/daemon-helper kill ceph-osd -f --cluster ceph -i 0 (PID: 111179) UID: 0 2023-08-01T19:56:01.822 INFO:teuthology.orchestra.run.smithi155.stdout:ERROR: (22) Invalid argument 2023-08-01T19:56:01.822 INFO:teuthology.orchestra.run.smithi155.stdout:op_tracker tracking is not enabled now, so no ops are tracked currently, even those get stuck. Please enable "osd_enable_op_tracker", and the tracker will start to track new ops received afterwards. 2023-08-01T19:56:01.837 DEBUG:teuthology.orchestra.run.smithi155:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 30 ceph --cluster ceph --admin-daemon /var/run/ceph/ceph-osd.2.asok dump_blocked_ops 2023-08-01T19:56:01.880 INFO:tasks.ceph.osd.2.smithi155.stderr:2023-08-01T19:56:01.878+0000 7faa5c6ac700 -1 received signal: Hangup from /usr/bin/python3 /bin/daemon-helper kill ceph-osd -f --cluster ceph -i 2 (PID: 111337) UID: 0 2023-08-01T19:56:01.957 DEBUG:teuthology.orchestra.run.smithi006:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 120 ceph --cluster ceph -- tell 'osd.*' injectargs --osd_enable_op_tracker=true 2023-08-01T19:56:01.981 INFO:tasks.ceph.osd.2.smithi155.stderr:2023-08-01T19:56:01.979+0000 7faa5c6ac700 -1 received signal: Hangup from /usr/bin/python3 /bin/daemon-helper kill ceph-osd -f --cluster ceph -i 2 (PID: 111337) UID: 0 2023-08-01T19:56:02.039 INFO:teuthology.orchestra.run.smithi155.stdout:ERROR: (22) Invalid argument 2023-08-01T19:56:02.040 INFO:teuthology.orchestra.run.smithi155.stdout:op_tracker tracking is not enabled now, so no ops are tracked currently, even those get stuck. Please enable "osd_enable_op_tracker", and the tracker will start to track new ops received afterwards. 2023-08-01T19:56:02.048 DEBUG:teuthology.orchestra.run.smithi155:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 30 ceph --cluster ceph --admin-daemon /var/run/ceph/ceph-osd.2.asok dump_historic_ops 2023-08-01T19:56:02.082 INFO:tasks.ceph.osd.0.smithi008.stderr:2023-08-01T19:56:02.080+0000 7f16a58f4700 -1 received signal: Hangup from /usr/bin/python3 /bin/daemon-helper kill ceph-osd -f --cluster ceph -i 0 (PID: 111179) UID: 0 2023-08-01T19:56:02.110 INFO:teuthology.orchestra.run.smithi006.stdout:osd.0: {} 2023-08-01T19:56:02.130 INFO:teuthology.orchestra.run.smithi006.stdout:osd.2: {} 2023-08-01T19:56:02.131 INFO:teuthology.orchestra.run.smithi006.stderr:osd.0: osd_enable_op_tracker = 'true' 2023-08-01T19:56:02.131 INFO:teuthology.orchestra.run.smithi006.stderr:Error ENXIO: problem getting command descriptions from osd.1 2023-08-01T19:56:02.131 INFO:teuthology.orchestra.run.smithi006.stderr:osd.2: osd_enable_op_tracker = 'true' 2023-08-01T19:56:02.133 DEBUG:teuthology.orchestra.run:got remote process result: 6 2023-08-01T19:56:02.134 INFO:tasks.thrashosds.thrasher:Failed to tell all osds, ignoring 2023-08-01T19:56:02.183 INFO:tasks.ceph.osd.2.smithi155.stderr:2023-08-01T19:56:02.181+0000 7faa5c6ac700 -1 received signal: Hangup from /usr/bin/python3 /bin/daemon-helper kill ceph-osd -f --cluster ceph -i 2 (PID: 111337) UID: 0 2023-08-01T19:56:02.260 INFO:teuthology.orchestra.run.smithi155.stdout:{ 2023-08-01T19:56:02.260 INFO:teuthology.orchestra.run.smithi155.stdout: "size": 20, 2023-08-01T19:56:02.260 INFO:teuthology.orchestra.run.smithi155.stdout: "duration": 600, 2023-08-01T19:56:02.260 INFO:teuthology.orchestra.run.smithi155.stdout: "ops": [ 2023-08-01T19:56:02.260 INFO:teuthology.orchestra.run.smithi155.stdout: { 2023-08-01T19:56:02.261 INFO:teuthology.orchestra.run.smithi155.stdout: "description": "osd_op(client.4668.0:100237 5.4 5:2d68bec9:::benchmark_data_smithi006_114134_object100236:head [set-alloc-hint object_size 65536 write_size 65536,write 0~65536] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e37)", 2023-08-01T19:56:02.261 INFO:teuthology.orchestra.run.smithi155.stdout: "initiated_at": "2023-08-01T19:55:05.147736+0000", 2023-08-01T19:56:02.261 INFO:teuthology.orchestra.run.smithi155.stdout: "age": 57.109250142, 2023-08-01T19:56:02.261 INFO:teuthology.orchestra.run.smithi155.stdout: "duration": 0.071299464000000007, 2023-08-01T19:56:02.261 INFO:teuthology.orchestra.run.smithi155.stdout: "type_data": { 2023-08-01T19:56:02.261 INFO:teuthology.orchestra.run.smithi155.stdout: "flag_point": "commit sent; apply or cleanup", 2023-08-01T19:56:02.261 INFO:teuthology.orchestra.run.smithi155.stdout: "client_info": { 2023-08-01T19:56:02.262 INFO:teuthology.orchestra.run.smithi155.stdout: "client": "client.4668", 2023-08-01T19:56:02.262 INFO:teuthology.orchestra.run.smithi155.stdout: "client_addr": "172.21.15.6:0/1709472247", 2023-08-01T19:56:02.262 INFO:teuthology.orchestra.run.smithi155.stdout: "tid": 100237 2023-08-01T19:56:02.262 INFO:teuthology.orchestra.run.smithi155.stdout: }, 2023-08-01T19:56:02.262 INFO:teuthology.orchestra.run.smithi155.stdout: "events": [ 2023-08-01T19:56:02.262 INFO:teuthology.orchestra.run.smithi155.stdout: { 2023-08-01T19:56:02.262 INFO:teuthology.orchestra.run.smithi155.stdout: "event": "initiated", 2023-08-01T19:56:02.262 INFO:teuthology.orchestra.run.smithi155.stdout: "time": "2023-08-01T19:55:05.147736+0000", 2023-08-01T19:56:02.263 INFO:teuthology.orchestra.run.smithi155.stdout: "duration": 0 2023-08-01T19:56:02.263 INFO:teuthology.orchestra.run.smithi155.stdout: }, 2023-08-01T19:56:02.263 INFO:teuthology.orchestra.run.smithi155.stdout: { 2023-08-01T19:56:02.263 INFO:teuthology.orchestra.run.smithi155.stdout: "event": "throttled", 2023-08-01T19:56:02.263 INFO:teuthology.orchestra.run.smithi155.stdout: "time": "2023-08-01T19:55:05.147736+0000", 2023-08-01T19:56:02.263 INFO:teuthology.orchestra.run.smithi155.stdout: "duration": 0 2023-08-01T19:56:02.263 INFO:teuthology.orchestra.run.smithi155.stdout: }, 2023-08-01T19:56:02.264 INFO:teuthology.orchestra.run.smithi155.stdout: { 2023-08-01T19:56:02.264 INFO:teuthology.orchestra.run.smithi155.stdout: "event": "header_read", 2023-08-01T19:56:02.264 INFO:teuthology.orchestra.run.smithi155.stdout: "time": "2023-08-01T19:55:05.147736+0000", 2023-08-01T19:56:02.264 INFO:teuthology.orchestra.run.smithi155.stdout: "duration": 4294967295.9999995 2023-08-01T19:56:02.264 INFO:teuthology.orchestra.run.smithi155.stdout: }, 2023-08-01T19:56:02.264 INFO:teuthology.orchestra.run.smithi155.stdout: { 2023-08-01T19:56:02.264 INFO:teuthology.orchestra.run.smithi155.stdout: "event": "all_read", 2023-08-01T19:56:02.264 INFO:teuthology.orchestra.run.smithi155.stdout: "time": "2023-08-01T19:55:05.147766+0000", 2023-08-01T19:56:02.265 INFO:teuthology.orchestra.run.smithi155.stdout: "duration": 3.0394000000000001e-05 2023-08-01T19:56:02.265 INFO:teuthology.orchestra.run.smithi155.stdout: }, 2023-08-01T19:56:02.265 INFO:teuthology.orchestra.run.smithi155.stdout: { 2023-08-01T19:56:02.265 INFO:teuthology.orchestra.run.smithi155.stdout: "event": "dispatched", 2023-08-01T19:56:02.265 INFO:teuthology.orchestra.run.smithi155.stdout: "time": "2023-08-01T19:55:05.147771+0000", 2023-08-01T19:56:02.265 INFO:teuthology.orchestra.run.smithi155.stdout: "duration": 4.25e-06 2023-08-01T19:56:02.265 INFO:teuthology.orchestra.run.smithi155.stdout: }, 2023-08-01T19:56:02.265 INFO:teuthology.orchestra.run.smithi155.stdout: { 2023-08-01T19:56:02.266 INFO:teuthology.orchestra.run.smithi155.stdout: "event": "queued_for_pg", 2023-08-01T19:56:02.266 INFO:teuthology.orchestra.run.smithi155.stdout: "time": "2023-08-01T19:55:05.147773+0000", 2023-08-01T19:56:02.266 INFO:teuthology.orchestra.run.smithi155.stdout: "duration": 2.4159999999999998e-06 2023-08-01T19:56:02.266 INFO:teuthology.orchestra.run.smithi155.stdout: }, 2023-08-01T19:56:02.266 INFO:teuthology.orchestra.run.smithi155.stdout: { 2023-08-01T19:56:02.266 INFO:teuthology.orchestra.run.smithi155.stdout: "event": "reached_pg", 2023-08-01T19:56:02.266 INFO:teuthology.orchestra.run.smithi155.stdout: "time": "2023-08-01T19:55:05.149903+0000", 2023-08-01T19:56:02.266 INFO:teuthology.orchestra.run.smithi155.stdout: "duration": 0.002129948 2023-08-01T19:56:02.267 INFO:teuthology.orchestra.run.smithi155.stdout: }, 2023-08-01T19:56:02.267 INFO:teuthology.orchestra.run.smithi155.stdout: { 2023-08-01T19:56:02.267 INFO:teuthology.orchestra.run.smithi155.stdout: "event": "started", 2023-08-01T19:56:02.267 INFO:teuthology.orchestra.run.smithi155.stdout: "time": "2023-08-01T19:55:05.149982+0000", 2023-08-01T19:56:02.267 INFO:teuthology.orchestra.run.smithi155.stdout: "duration": 7.8706000000000002e-05 2023-08-01T19:56:02.267 INFO:teuthology.orchestra.run.smithi155.stdout: }, 2023-08-01T19:56:02.267 INFO:teuthology.orchestra.run.smithi155.stdout: { 2023-08-01T19:56:02.268 INFO:teuthology.orchestra.run.smithi155.stdout: "event": "waiting for subops from 0", 2023-08-01T19:56:02.268 INFO:teuthology.orchestra.run.smithi155.stdout: "time": "2023-08-01T19:55:05.150066+0000", 2023-08-01T19:56:02.268 INFO:teuthology.orchestra.run.smithi155.stdout: "duration": 8.4241999999999997e-05 2023-08-01T19:56:02.268 INFO:teuthology.orchestra.run.smithi155.stdout: }, 2023-08-01T19:56:02.268 INFO:teuthology.orchestra.run.smithi155.stdout: { 2023-08-01T19:56:02.268 INFO:teuthology.orchestra.run.smithi155.stdout: "event": "op_commit", 2023-08-01T19:56:02.268 INFO:teuthology.orchestra.run.smithi155.stdout: "time": "2023-08-01T19:55:05.154994+0000", 2023-08-01T19:56:02.268 INFO:teuthology.orchestra.run.smithi155.stdout: "duration": 0.0049277050000000001 2023-08-01T19:56:02.269 INFO:teuthology.orchestra.run.smithi155.stdout: }, 2023-08-01T19:56:02.269 INFO:teuthology.orchestra.run.smithi155.stdout: { 2023-08-01T19:56:02.269 INFO:teuthology.orchestra.run.smithi155.stdout: "event": "sub_op_commit_rec", 2023-08-01T19:56:02.269 INFO:teuthology.orchestra.run.smithi155.stdout: "time": "2023-08-01T19:55:05.218933+0000", 2023-08-01T19:56:02.269 INFO:teuthology.orchestra.run.smithi155.stdout: "duration": 0.063939916999999999 2023-08-01T19:56:02.269 INFO:teuthology.orchestra.run.smithi155.stdout: }, 2023-08-01T19:56:02.269 INFO:teuthology.orchestra.run.smithi155.stdout: { 2023-08-01T19:56:02.269 INFO:teuthology.orchestra.run.smithi155.stdout: "event": "commit_sent", 2023-08-01T19:56:02.270 INFO:teuthology.orchestra.run.smithi155.stdout: "time": "2023-08-01T19:55:05.218989+0000", 2023-08-01T19:56:02.270 INFO:teuthology.orchestra.run.smithi155.stdout: "duration": 5.5772000000000001e-05 2023-08-01T19:56:02.270 INFO:teuthology.orchestra.run.smithi155.stdout: }, 2023-08-01T19:56:02.270 INFO:teuthology.orchestra.run.smithi155.stdout: { 2023-08-01T19:56:02.270 INFO:teuthology.orchestra.run.smithi155.stdout: "event": "done", 2023-08-01T19:56:02.270 INFO:teuthology.orchestra.run.smithi155.stdout: "time": "2023-08-01T19:55:05.219036+0000", 2023-08-01T19:56:02.270 INFO:teuthology.orchestra.run.smithi155.stdout: "duration": 4.6526000000000001e-05 2023-08-01T19:56:02.270 INFO:teuthology.orchestra.run.smithi155.stdout: } 2023-08-01T19:56:02.271 INFO:teuthology.orchestra.run.smithi155.stdout: ] 2023-08-01T19:56:02.271 INFO:teuthology.orchestra.run.smithi155.stdout: } 2023-08-01T19:56:02.271 INFO:teuthology.orchestra.run.smithi155.stdout: }, 2023-08-01T19:56:02.271 INFO:teuthology.orchestra.run.smithi155.stdout: { 2023-08-01T19:56:02.271 INFO:teuthology.orchestra.run.smithi155.stdout: "description": "osd_op(client.4668.0:100242 5.8 5:16a314b8:::benchmark_data_smithi006_114134_object100241:head [set-alloc-hint object_size 65536 write_size 65536,write 0~65536] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e37)", 2023-08-01T19:56:02.271 INFO:teuthology.orchestra.run.smithi155.stdout: "initiated_at": "2023-08-01T19:55:05.150616+0000", 2023-08-01T19:56:02.271 INFO:teuthology.orchestra.run.smithi155.stdout: "age": 57.106370511999998, 2023-08-01T19:56:02.271 INFO:teuthology.orchestra.run.smithi155.stdout: "duration": 0.071105065999999995, 2023-08-01T19:56:02.272 INFO:teuthology.orchestra.run.smithi155.stdout: "type_data": { 2023-08-01T19:56:02.272 INFO:teuthology.orchestra.run.smithi155.stdout: "flag_point": "commit sent; apply or cleanup", 2023-08-01T19:56:02.272 INFO:teuthology.orchestra.run.smithi155.stdout: "client_info": { 2023-08-01T19:56:02.272 INFO:teuthology.orchestra.run.smithi155.stdout: "client": "client.4668", 2023-08-01T19:56:02.272 INFO:teuthology.orchestra.run.smithi155.stdout: "client_addr": "172.21.15.6:0/1709472247", 2023-08-01T19:56:02.272 INFO:teuthology.orchestra.run.smithi155.stdout: "tid": 100242 2023-08-01T19:56:02.272 INFO:teuthology.orchestra.run.smithi155.stdout: }, 2023-08-01T19:56:02.273 INFO:teuthology.orchestra.run.smithi155.stdout: "events": [ 2023-08-01T19:56:02.273 INFO:teuthology.orchestra.run.smithi155.stdout: { 2023-08-01T19:56:02.273 INFO:teuthology.orchestra.run.smithi155.stdout: "event": "initiated", 2023-08-01T19:56:02.273 INFO:teuthology.orchestra.run.smithi155.stdout: "time": "2023-08-01T19:55:05.150616+0000", 2023-08-01T19:56:02.273 INFO:teuthology.orchestra.run.smithi155.stdout: "duration": 0 2023-08-01T19:56:02.273 INFO:teuthology.orchestra.run.smithi155.stdout: }, 2023-08-01T19:56:02.273 INFO:teuthology.orchestra.run.smithi155.stdout: { 2023-08-01T19:56:02.273 INFO:teuthology.orchestra.run.smithi155.stdout: "event": "throttled", 2023-08-01T19:56:02.274 INFO:teuthology.orchestra.run.smithi155.stdout: "time": "2023-08-01T19:55:05.150616+0000", 2023-08-01T19:56:02.274 INFO:teuthology.orchestra.run.smithi155.stdout: "duration": 0 2023-08-01T19:56:02.274 INFO:teuthology.orchestra.run.smithi155.stdout: }, 2023-08-01T19:56:02.274 INFO:teuthology.orchestra.run.smithi155.stdout: { 2023-08-01T19:56:02.274 INFO:teuthology.orchestra.run.smithi155.stdout: "event": "header_read", 2023-08-01T19:56:02.274 INFO:teuthology.orchestra.run.smithi155.stdout: "time": "2023-08-01T19:55:05.150615+0000", 2023-08-01T19:56:02.274 INFO:teuthology.orchestra.run.smithi155.stdout: "duration": 4294967295.999999 2023-08-01T19:56:02.274 INFO:teuthology.orchestra.run.smithi155.stdout: }, 2023-08-01T19:56:02.275 INFO:teuthology.orchestra.run.smithi155.stdout: { 2023-08-01T19:56:02.275 INFO:teuthology.orchestra.run.smithi155.stdout: "event": "all_read", 2023-08-01T19:56:02.275 INFO:teuthology.orchestra.run.smithi155.stdout: "time": "2023-08-01T19:55:05.150696+0000", 2023-08-01T19:56:02.275 INFO:teuthology.orchestra.run.smithi155.stdout: "duration": 8.0852000000000004e-05 2023-08-01T19:56:02.275 INFO:teuthology.orchestra.run.smithi155.stdout: }, 2023-08-01T19:56:02.275 INFO:teuthology.orchestra.run.smithi155.stdout: { 2023-08-01T19:56:02.275 INFO:teuthology.orchestra.run.smithi155.stdout: "event": "dispatched", 2023-08-01T19:56:02.275 INFO:teuthology.orchestra.run.smithi155.stdout: "time": "2023-08-01T19:55:05.150708+0000", 2023-08-01T19:56:02.276 INFO:teuthology.orchestra.run.smithi155.stdout: "duration": 1.2116999999999999e-05 2023-08-01T19:56:02.276 INFO:teuthology.orchestra.run.smithi155.stdout: }, 2023-08-01T19:56:02.276 INFO:teuthology.orchestra.run.smithi155.stdout: { 2023-08-01T19:56:02.276 INFO:teuthology.orchestra.run.smithi155.stdout: "event": "queued_for_pg", 2023-08-01T19:56:02.276 INFO:teuthology.orchestra.run.smithi155.stdout: "time": "2023-08-01T19:55:05.150713+0000", 2023-08-01T19:56:02.276 INFO:teuthology.orchestra.run.smithi155.stdout: "duration": 5.4620000000000004e-06 2023-08-01T19:56:02.276 INFO:teuthology.orchestra.run.smithi155.stdout: }, 2023-08-01T19:56:02.276 INFO:teuthology.orchestra.run.smithi155.stdout: { 2023-08-01T19:56:02.277 INFO:teuthology.orchestra.run.smithi155.stdout: "event": "reached_pg", 2023-08-01T19:56:02.277 INFO:teuthology.orchestra.run.smithi155.stdout: "time": "2023-08-01T19:55:05.150761+0000", 2023-08-01T19:56:02.277 INFO:teuthology.orchestra.run.smithi155.stdout: "duration": 4.7429000000000003e-05 2023-08-01T19:56:02.277 INFO:teuthology.orchestra.run.smithi155.stdout: }, 2023-08-01T19:56:02.277 INFO:teuthology.orchestra.run.smithi155.stdout: { 2023-08-01T19:56:02.277 INFO:teuthology.orchestra.run.smithi155.stdout: "event": "started", 2023-08-01T19:56:02.277 INFO:teuthology.orchestra.run.smithi155.stdout: "time": "2023-08-01T19:55:05.150856+0000", 2023-08-01T19:56:02.278 INFO:teuthology.orchestra.run.smithi155.stdout: "duration": 9.5356e-05 2023-08-01T19:56:02.278 INFO:teuthology.orchestra.run.smithi155.stdout: }, 2023-08-01T19:56:02.278 INFO:teuthology.orchestra.run.smithi155.stdout: { 2023-08-01T19:56:02.278 INFO:teuthology.orchestra.run.smithi155.stdout: "event": "waiting for subops from 0", 2023-08-01T19:56:02.278 INFO:teuthology.orchestra.run.smithi155.stdout: "time": "2023-08-01T19:55:05.150999+0000", 2023-08-01T19:56:02.278 INFO:teuthology.orchestra.run.smithi155.stdout: "duration": 0.00014234499999999999 2023-08-01T19:56:02.278 INFO:teuthology.orchestra.run.smithi155.stdout: }, 2023-08-01T19:56:02.278 INFO:teuthology.orchestra.run.smithi155.stdout: { 2023-08-01T19:56:02.279 INFO:teuthology.orchestra.run.smithi155.stdout: "event": "sub_op_commit_rec", 2023-08-01T19:56:02.279 INFO:teuthology.orchestra.run.smithi155.stdout: "time": "2023-08-01T19:55:05.219001+0000", 2023-08-01T19:56:02.279 INFO:teuthology.orchestra.run.smithi155.stdout: "duration": 0.068002776000000001 2023-08-01T19:56:02.279 INFO:teuthology.orchestra.run.smithi155.stdout: }, 2023-08-01T19:56:02.279 INFO:teuthology.orchestra.run.smithi155.stdout: { 2023-08-01T19:56:02.279 INFO:teuthology.orchestra.run.smithi155.stdout: "event": "op_commit", 2023-08-01T19:56:02.279 INFO:teuthology.orchestra.run.smithi155.stdout: "time": "2023-08-01T19:55:05.221635+0000", 2023-08-01T19:56:02.279 INFO:teuthology.orchestra.run.smithi155.stdout: "duration": 0.0026340579999999999 2023-08-01T19:56:02.280 INFO:teuthology.orchestra.run.smithi155.stdout: }, 2023-08-01T19:56:02.280 INFO:teuthology.orchestra.run.smithi155.stdout: { 2023-08-01T19:56:02.280 INFO:teuthology.orchestra.run.smithi155.stdout: "event": "commit_sent", 2023-08-01T19:56:02.280 INFO:teuthology.orchestra.run.smithi155.stdout: "time": "2023-08-01T19:55:05.221682+0000", 2023-08-01T19:56:02.280 INFO:teuthology.orchestra.run.smithi155.stdout: "duration": 4.7123999999999998e-05 2023-08-01T19:56:02.280 INFO:teuthology.orchestra.run.smithi155.stdout: }, 2023-08-01T19:56:02.280 INFO:teuthology.orchestra.run.smithi155.stdout: { 2023-08-01T19:56:02.280 INFO:teuthology.orchestra.run.smithi155.stdout: "event": "done", 2023-08-01T19:56:02.281 INFO:teuthology.orchestra.run.smithi155.stdout: "time": "2023-08-01T19:55:05.221721+0000", 2023-08-01T19:56:02.281 INFO:teuthology.orchestra.run.smithi155.stdout: "duration": 3.8529999999999999e-05 2023-08-01T19:56:02.281 INFO:teuthology.orchestra.run.smithi155.stdout: } 2023-08-01T19:56:02.281 INFO:teuthology.orchestra.run.smithi155.stdout: ] 2023-08-01T19:56:02.281 INFO:teuthology.orchestra.run.smithi155.stdout: } 2023-08-01T19:56:02.281 INFO:teuthology.orchestra.run.smithi155.stdout: }, 2023-08-01T19:56:02.281 INFO:teuthology.orchestra.run.smithi155.stdout: { 2023-08-01T19:56:02.281 INFO:teuthology.orchestra.run.smithi155.stdout: "description": "osd_repop(client.4668.0:100240 5.a e37/19 5:5313c5b9:::benchmark_data_smithi006_114134_object100239:head v 37'6227, mlcod=37'6225)", 2023-08-01T19:56:02.282 INFO:teuthology.orchestra.run.smithi155.stdout: "initiated_at": "2023-08-01T19:55:05.150778+0000", 2023-08-01T19:56:02.282 INFO:teuthology.orchestra.run.smithi155.stdout: "age": 57.106208311000003, 2023-08-01T19:56:02.282 INFO:teuthology.orchestra.run.smithi155.stdout: "duration": 0.073362533999999993, 2023-08-01T19:56:02.282 INFO:teuthology.orchestra.run.smithi155.stdout: "type_data": { 2023-08-01T19:56:02.282 INFO:teuthology.orchestra.run.smithi155.stdout: "flag_point": "commit sent; apply or cleanup", 2023-08-01T19:56:02.282 INFO:teuthology.orchestra.run.smithi155.stdout: "events": [ 2023-08-01T19:56:02.282 INFO:teuthology.orchestra.run.smithi155.stdout: { 2023-08-01T19:56:02.282 INFO:teuthology.orchestra.run.smithi155.stdout: "event": "initiated", 2023-08-01T19:56:02.283 INFO:teuthology.orchestra.run.smithi155.stdout: "time": "2023-08-01T19:55:05.150778+0000", 2023-08-01T19:56:02.283 INFO:teuthology.orchestra.run.smithi155.stdout: "duration": 0 2023-08-01T19:56:02.283 INFO:teuthology.orchestra.run.smithi155.stdout: }, 2023-08-01T19:56:02.283 INFO:teuthology.orchestra.run.smithi155.stdout: { 2023-08-01T19:56:02.283 INFO:teuthology.orchestra.run.smithi155.stdout: "event": "throttled", 2023-08-01T19:56:02.283 INFO:teuthology.orchestra.run.smithi155.stdout: "time": "2023-08-01T19:55:05.150778+0000", 2023-08-01T19:56:02.283 INFO:teuthology.orchestra.run.smithi155.stdout: "duration": 0 2023-08-01T19:56:02.283 INFO:teuthology.orchestra.run.smithi155.stdout: }, 2023-08-01T19:56:02.284 INFO:teuthology.orchestra.run.smithi155.stdout: { 2023-08-01T19:56:02.284 INFO:teuthology.orchestra.run.smithi155.stdout: "event": "header_read", 2023-08-01T19:56:02.284 INFO:teuthology.orchestra.run.smithi155.stdout: "time": "2023-08-01T19:55:05.150778+0000", 2023-08-01T19:56:02.284 INFO:teuthology.orchestra.run.smithi155.stdout: "duration": 4294967295.9999995 2023-08-01T19:56:02.284 INFO:teuthology.orchestra.run.smithi155.stdout: }, 2023-08-01T19:56:02.284 INFO:teuthology.orchestra.run.smithi155.stdout: { 2023-08-01T19:56:02.284 INFO:teuthology.orchestra.run.smithi155.stdout: "event": "all_read", 2023-08-01T19:56:02.285 INFO:teuthology.orchestra.run.smithi155.stdout: "time": "2023-08-01T19:55:05.150811+0000", 2023-08-01T19:56:02.285 INFO:teuthology.orchestra.run.smithi155.stdout: "duration": 3.3664000000000002e-05 2023-08-01T19:56:02.285 INFO:teuthology.orchestra.run.smithi155.stdout: }, 2023-08-01T19:56:02.285 INFO:teuthology.orchestra.run.smithi155.stdout: { 2023-08-01T19:56:02.285 INFO:teuthology.orchestra.run.smithi155.stdout: "event": "dispatched", 2023-08-01T19:56:02.285 INFO:teuthology.orchestra.run.smithi155.stdout: "time": "2023-08-01T19:55:05.150818+0000", 2023-08-01T19:56:02.285 INFO:teuthology.orchestra.run.smithi155.stdout: "duration": 6.5769999999999999e-06 2023-08-01T19:56:02.285 INFO:teuthology.orchestra.run.smithi155.stdout: }, 2023-08-01T19:56:02.286 INFO:teuthology.orchestra.run.smithi155.stdout: { 2023-08-01T19:56:02.286 INFO:teuthology.orchestra.run.smithi155.stdout: "event": "queued_for_pg", 2023-08-01T19:56:02.286 INFO:teuthology.orchestra.run.smithi155.stdout: "time": "2023-08-01T19:55:05.150822+0000", 2023-08-01T19:56:02.286 INFO:teuthology.orchestra.run.smithi155.stdout: "duration": 4.0060000000000003e-06 2023-08-01T19:56:02.286 INFO:teuthology.orchestra.run.smithi155.stdout: }, 2023-08-01T19:56:02.286 INFO:teuthology.orchestra.run.smithi155.stdout: { 2023-08-01T19:56:02.286 INFO:teuthology.orchestra.run.smithi155.stdout: "event": "reached_pg", 2023-08-01T19:56:02.286 INFO:teuthology.orchestra.run.smithi155.stdout: "time": "2023-08-01T19:55:05.150855+0000", 2023-08-01T19:56:02.287 INFO:teuthology.orchestra.run.smithi155.stdout: "duration": 3.3204999999999998e-05 2023-08-01T19:56:02.287 INFO:teuthology.orchestra.run.smithi155.stdout: }, 2023-08-01T19:56:02.287 INFO:teuthology.orchestra.run.smithi155.stdout: { 2023-08-01T19:56:02.287 INFO:teuthology.orchestra.run.smithi155.stdout: "event": "started", 2023-08-01T19:56:02.287 INFO:teuthology.orchestra.run.smithi155.stdout: "time": "2023-08-01T19:55:05.150873+0000", 2023-08-01T19:56:02.287 INFO:teuthology.orchestra.run.smithi155.stdout: "duration": 1.8139999999999999e-05 2023-08-01T19:56:02.287 INFO:teuthology.orchestra.run.smithi155.stdout: }, 2023-08-01T19:56:02.288 INFO:teuthology.orchestra.run.smithi155.stdout: { 2023-08-01T19:56:02.288 INFO:teuthology.orchestra.run.smithi155.stdout: "event": "commit_sent", 2023-08-01T19:56:02.288 INFO:teuthology.orchestra.run.smithi155.stdout: "time": "2023-08-01T19:55:05.224095+0000", 2023-08-01T19:56:02.288 INFO:teuthology.orchestra.run.smithi155.stdout: "duration": 0.073221895999999995 2023-08-01T19:56:02.288 INFO:teuthology.orchestra.run.smithi155.stdout: }, 2023-08-01T19:56:02.288 INFO:teuthology.orchestra.run.smithi155.stdout: { 2023-08-01T19:56:02.288 INFO:teuthology.orchestra.run.smithi155.stdout: "event": "done", 2023-08-01T19:56:02.288 INFO:teuthology.orchestra.run.smithi155.stdout: "time": "2023-08-01T19:55:05.224141+0000", 2023-08-01T19:56:02.289 INFO:teuthology.orchestra.run.smithi155.stdout: "duration": 4.5385e-05 2023-08-01T19:56:02.289 INFO:teuthology.orchestra.run.smithi155.stdout: } 2023-08-01T19:56:02.289 INFO:teuthology.orchestra.run.smithi155.stdout: ] 2023-08-01T19:56:02.289 INFO:teuthology.orchestra.run.smithi155.stdout: } 2023-08-01T19:56:02.289 INFO:teuthology.orchestra.run.smithi155.stdout: }, 2023-08-01T19:56:02.289 INFO:teuthology.orchestra.run.smithi155.stdout: { 2023-08-01T19:56:02.289 INFO:teuthology.orchestra.run.smithi155.stdout: "description": "osd_op(client.4668.0:100245 5.e 5:71869c66:::benchmark_data_smithi006_114134_object100244:head [set-alloc-hint object_size 65536 write_size 65536,write 0~65536] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e37)", 2023-08-01T19:56:02.289 INFO:teuthology.orchestra.run.smithi155.stdout: "initiated_at": "2023-08-01T19:55:05.150991+0000", 2023-08-01T19:56:02.290 INFO:teuthology.orchestra.run.smithi155.stdout: "age": 57.105995524000001, 2023-08-01T19:56:02.290 INFO:teuthology.orchestra.run.smithi155.stdout: "duration": 0.070734490999999997, 2023-08-01T19:56:02.290 INFO:teuthology.orchestra.run.smithi155.stdout: "type_data": { 2023-08-01T19:56:02.290 INFO:teuthology.orchestra.run.smithi155.stdout: "flag_point": "commit sent; apply or cleanup", 2023-08-01T19:56:02.290 INFO:teuthology.orchestra.run.smithi155.stdout: "client_info": { 2023-08-01T19:56:02.290 INFO:teuthology.orchestra.run.smithi155.stdout: "client": "client.4668", 2023-08-01T19:56:02.290 INFO:teuthology.orchestra.run.smithi155.stdout: "client_addr": "172.21.15.6:0/1709472247", 2023-08-01T19:56:02.290 INFO:teuthology.orchestra.run.smithi155.stdout: "tid": 100245 2023-08-01T19:56:02.291 INFO:teuthology.orchestra.run.smithi155.stdout: }, 2023-08-01T19:56:02.291 INFO:teuthology.orchestra.run.smithi155.stdout: "events": [ 2023-08-01T19:56:02.291 INFO:teuthology.orchestra.run.smithi155.stdout: { 2023-08-01T19:56:02.291 INFO:teuthology.orchestra.run.smithi155.stdout: "event": "initiated", 2023-08-01T19:56:02.291 INFO:teuthology.orchestra.run.smithi155.stdout: "time": "2023-08-01T19:55:05.150991+0000", 2023-08-01T19:56:02.291 INFO:teuthology.orchestra.run.smithi155.stdout: "duration": 0 2023-08-01T19:56:02.291 INFO:teuthology.orchestra.run.smithi155.stdout: }, 2023-08-01T19:56:02.291 INFO:teuthology.orchestra.run.smithi155.stdout: { 2023-08-01T19:56:02.292 INFO:teuthology.orchestra.run.smithi155.stdout: "event": "throttled", 2023-08-01T19:56:02.292 INFO:teuthology.orchestra.run.smithi155.stdout: "time": "2023-08-01T19:55:05.150991+0000", 2023-08-01T19:56:02.292 INFO:teuthology.orchestra.run.smithi155.stdout: "duration": 0 2023-08-01T19:56:02.292 INFO:teuthology.orchestra.run.smithi155.stdout: }, 2023-08-01T19:56:02.292 INFO:teuthology.orchestra.run.smithi155.stdout: { 2023-08-01T19:56:02.292 INFO:teuthology.orchestra.run.smithi155.stdout: "event": "header_read", 2023-08-01T19:56:02.292 INFO:teuthology.orchestra.run.smithi155.stdout: "time": "2023-08-01T19:55:05.150990+0000", 2023-08-01T19:56:02.293 INFO:teuthology.orchestra.run.smithi155.stdout: "duration": 4294967295.999999 2023-08-01T19:56:02.293 INFO:teuthology.orchestra.run.smithi155.stdout: }, 2023-08-01T19:56:02.293 INFO:teuthology.orchestra.run.smithi155.stdout: { 2023-08-01T19:56:02.293 INFO:teuthology.orchestra.run.smithi155.stdout: "event": "all_read", 2023-08-01T19:56:02.293 INFO:teuthology.orchestra.run.smithi155.stdout: "time": "2023-08-01T19:55:05.151108+0000", 2023-08-01T19:56:02.293 INFO:teuthology.orchestra.run.smithi155.stdout: "duration": 0.00011849300000000001 2023-08-01T19:56:02.293 INFO:teuthology.orchestra.run.smithi155.stdout: }, 2023-08-01T19:56:02.293 INFO:teuthology.orchestra.run.smithi155.stdout: { 2023-08-01T19:56:02.294 INFO:teuthology.orchestra.run.smithi155.stdout: "event": "dispatched", 2023-08-01T19:56:02.294 INFO:teuthology.orchestra.run.smithi155.stdout: "time": "2023-08-01T19:55:05.151117+0000", 2023-08-01T19:56:02.294 INFO:teuthology.orchestra.run.smithi155.stdout: "duration": 8.1040000000000007e-06 2023-08-01T19:56:02.294 INFO:teuthology.orchestra.run.smithi155.stdout: }, 2023-08-01T19:56:02.294 INFO:teuthology.orchestra.run.smithi155.stdout: { 2023-08-01T19:56:02.294 INFO:teuthology.orchestra.run.smithi155.stdout: "event": "queued_for_pg", 2023-08-01T19:56:02.294 INFO:teuthology.orchestra.run.smithi155.stdout: "time": "2023-08-01T19:55:05.151121+0000", 2023-08-01T19:56:02.294 INFO:teuthology.orchestra.run.smithi155.stdout: "duration": 4.2019999999999997e-06 2023-08-01T19:56:02.295 INFO:teuthology.orchestra.run.smithi155.stdout: }, 2023-08-01T19:56:02.295 INFO:teuthology.orchestra.run.smithi155.stdout: { 2023-08-01T19:56:02.295 INFO:teuthology.orchestra.run.smithi155.stdout: "event": "reached_pg", 2023-08-01T19:56:02.295 INFO:teuthology.orchestra.run.smithi155.stdout: "time": "2023-08-01T19:55:05.151162+0000", 2023-08-01T19:56:02.295 INFO:teuthology.orchestra.run.smithi155.stdout: "duration": 4.1448e-05 2023-08-01T19:56:02.295 INFO:teuthology.orchestra.run.smithi155.stdout: }, 2023-08-01T19:56:02.295 INFO:teuthology.orchestra.run.smithi155.stdout: { 2023-08-01T19:56:02.295 INFO:teuthology.orchestra.run.smithi155.stdout: "event": "started", 2023-08-01T19:56:02.296 INFO:teuthology.orchestra.run.smithi155.stdout: "time": "2023-08-01T19:55:05.151281+0000", 2023-08-01T19:56:02.296 INFO:teuthology.orchestra.run.smithi155.stdout: "duration": 0.000119141 2023-08-01T19:56:02.296 INFO:teuthology.orchestra.run.smithi155.stdout: }, 2023-08-01T19:56:02.296 INFO:teuthology.orchestra.run.smithi155.stdout: { 2023-08-01T19:56:02.296 INFO:teuthology.orchestra.run.smithi155.stdout: "event": "waiting for subops from 0", 2023-08-01T19:56:02.296 INFO:teuthology.orchestra.run.smithi155.stdout: "time": "2023-08-01T19:55:05.151443+0000", 2023-08-01T19:56:02.296 INFO:teuthology.orchestra.run.smithi155.stdout: "duration": 0.00016181600000000001 2023-08-01T19:56:02.296 INFO:teuthology.orchestra.run.smithi155.stdout: }, 2023-08-01T19:56:02.297 INFO:teuthology.orchestra.run.smithi155.stdout: { 2023-08-01T19:56:02.297 INFO:teuthology.orchestra.run.smithi155.stdout: "event": "sub_op_commit_rec", 2023-08-01T19:56:02.297 INFO:teuthology.orchestra.run.smithi155.stdout: "time": "2023-08-01T19:55:05.219101+0000", 2023-08-01T19:56:02.297 INFO:teuthology.orchestra.run.smithi155.stdout: "duration": 0.067658037000000004 2023-08-01T19:56:02.297 INFO:teuthology.orchestra.run.smithi155.stdout: }, 2023-08-01T19:56:02.297 INFO:teuthology.orchestra.run.smithi155.stdout: { 2023-08-01T19:56:02.297 INFO:teuthology.orchestra.run.smithi155.stdout: "event": "op_commit", 2023-08-01T19:56:02.297 INFO:teuthology.orchestra.run.smithi155.stdout: "time": "2023-08-01T19:55:05.221646+0000", 2023-08-01T19:56:02.298 INFO:teuthology.orchestra.run.smithi155.stdout: "duration": 0.0025450540000000002 2023-08-01T19:56:02.298 INFO:teuthology.orchestra.run.smithi155.stdout: }, 2023-08-01T19:56:02.298 INFO:teuthology.orchestra.run.smithi155.stdout: { 2023-08-01T19:56:02.298 INFO:teuthology.orchestra.run.smithi155.stdout: "event": "commit_sent", 2023-08-01T19:56:02.298 INFO:teuthology.orchestra.run.smithi155.stdout: "time": "2023-08-01T19:55:05.221689+0000", 2023-08-01T19:56:02.298 INFO:teuthology.orchestra.run.smithi155.stdout: "duration": 4.3078999999999999e-05 2023-08-01T19:56:02.298 INFO:teuthology.orchestra.run.smithi155.stdout: }, 2023-08-01T19:56:02.299 INFO:teuthology.orchestra.run.smithi155.stdout: { 2023-08-01T19:56:02.299 INFO:teuthology.orchestra.run.smithi155.stdout: "event": "done", 2023-08-01T19:56:02.299 INFO:teuthology.orchestra.run.smithi155.stdout: "time": "2023-08-01T19:55:05.221725+0000", 2023-08-01T19:56:02.299 INFO:teuthology.orchestra.run.smithi155.stdout: "duration": 3.6137999999999999e-05 2023-08-01T19:56:02.299 INFO:teuthology.orchestra.run.smithi155.stdout: } 2023-08-01T19:56:02.299 INFO:teuthology.orchestra.run.smithi155.stdout: ] 2023-08-01T19:56:02.299 INFO:teuthology.orchestra.run.smithi155.stdout: } 2023-08-01T19:56:02.299 INFO:teuthology.orchestra.run.smithi155.stdout: }, 2023-08-01T19:56:02.300 INFO:teuthology.orchestra.run.smithi155.stdout: { 2023-08-01T19:56:02.300 INFO:teuthology.orchestra.run.smithi155.stdout: "description": "osd_repop(client.4668.0:100243 5.a e37/19 5:5e8193b6:::benchmark_data_smithi006_114134_object100242:head v 37'6228, mlcod=37'6225)", 2023-08-01T19:56:02.300 INFO:teuthology.orchestra.run.smithi155.stdout: "initiated_at": "2023-08-01T19:55:05.151148+0000", 2023-08-01T19:56:02.300 INFO:teuthology.orchestra.run.smithi155.stdout: "age": 57.105838513000002, 2023-08-01T19:56:02.300 INFO:teuthology.orchestra.run.smithi155.stdout: "duration": 0.073020370000000001, 2023-08-01T19:56:02.300 INFO:teuthology.orchestra.run.smithi155.stdout: "type_data": { 2023-08-01T19:56:02.300 INFO:teuthology.orchestra.run.smithi155.stdout: "flag_point": "commit sent; apply or cleanup", 2023-08-01T19:56:02.300 INFO:teuthology.orchestra.run.smithi155.stdout: "events": [ 2023-08-01T19:56:02.301 INFO:teuthology.orchestra.run.smithi155.stdout: { 2023-08-01T19:56:02.301 INFO:teuthology.orchestra.run.smithi155.stdout: "event": "initiated", 2023-08-01T19:56:02.301 INFO:teuthology.orchestra.run.smithi155.stdout: "time": "2023-08-01T19:55:05.151148+0000", 2023-08-01T19:56:02.301 INFO:teuthology.orchestra.run.smithi155.stdout: "duration": 0 2023-08-01T19:56:02.301 INFO:teuthology.orchestra.run.smithi155.stdout: }, 2023-08-01T19:56:02.301 INFO:teuthology.orchestra.run.smithi155.stdout: { 2023-08-01T19:56:02.301 INFO:teuthology.orchestra.run.smithi155.stdout: "event": "throttled", 2023-08-01T19:56:02.301 INFO:teuthology.orchestra.run.smithi155.stdout: "time": "2023-08-01T19:55:05.151148+0000", 2023-08-01T19:56:02.302 INFO:teuthology.orchestra.run.smithi155.stdout: "duration": 0 2023-08-01T19:56:02.302 INFO:teuthology.orchestra.run.smithi155.stdout: }, 2023-08-01T19:56:02.302 INFO:teuthology.orchestra.run.smithi155.stdout: { 2023-08-01T19:56:02.302 INFO:teuthology.orchestra.run.smithi155.stdout: "event": "header_read", 2023-08-01T19:56:02.302 INFO:teuthology.orchestra.run.smithi155.stdout: "time": "2023-08-01T19:55:05.151147+0000", 2023-08-01T19:56:02.302 INFO:teuthology.orchestra.run.smithi155.stdout: "duration": 4294967295.9999995 2023-08-01T19:56:02.302 INFO:teuthology.orchestra.run.smithi155.stdout: }, 2023-08-01T19:56:02.302 INFO:teuthology.orchestra.run.smithi155.stdout: { 2023-08-01T19:56:02.303 INFO:teuthology.orchestra.run.smithi155.stdout: "event": "all_read", 2023-08-01T19:56:02.303 INFO:teuthology.orchestra.run.smithi155.stdout: "time": "2023-08-01T19:55:05.151231+0000", 2023-08-01T19:56:02.303 INFO:teuthology.orchestra.run.smithi155.stdout: "duration": 8.3135999999999998e-05 2023-08-01T19:56:02.303 INFO:teuthology.orchestra.run.smithi155.stdout: }, 2023-08-01T19:56:02.303 INFO:teuthology.orchestra.run.smithi155.stdout: { 2023-08-01T19:56:02.303 INFO:teuthology.orchestra.run.smithi155.stdout: "event": "dispatched", 2023-08-01T19:56:02.303 INFO:teuthology.orchestra.run.smithi155.stdout: "time": "2023-08-01T19:55:05.151239+0000", 2023-08-01T19:56:02.303 INFO:teuthology.orchestra.run.smithi155.stdout: "duration": 8.7469999999999994e-06 2023-08-01T19:56:02.304 INFO:teuthology.orchestra.run.smithi155.stdout: }, 2023-08-01T19:56:02.304 INFO:teuthology.orchestra.run.smithi155.stdout: { 2023-08-01T19:56:02.304 INFO:teuthology.orchestra.run.smithi155.stdout: "event": "queued_for_pg", 2023-08-01T19:56:02.304 INFO:teuthology.orchestra.run.smithi155.stdout: "time": "2023-08-01T19:55:05.151244+0000", 2023-08-01T19:56:02.304 INFO:teuthology.orchestra.run.smithi155.stdout: "duration": 4.4800000000000003e-06 2023-08-01T19:56:02.304 INFO:teuthology.orchestra.run.smithi155.stdout: }, 2023-08-01T19:56:02.304 INFO:teuthology.orchestra.run.smithi155.stdout: { 2023-08-01T19:56:02.305 INFO:teuthology.orchestra.run.smithi155.stdout: "event": "reached_pg", 2023-08-01T19:56:02.305 INFO:teuthology.orchestra.run.smithi155.stdout: "time": "2023-08-01T19:55:05.152938+0000", 2023-08-01T19:56:02.305 INFO:teuthology.orchestra.run.smithi155.stdout: "duration": 0.001693824 2023-08-01T19:56:02.305 INFO:teuthology.orchestra.run.smithi155.stdout: }, 2023-08-01T19:56:02.305 INFO:teuthology.orchestra.run.smithi155.stdout: { 2023-08-01T19:56:02.305 INFO:teuthology.orchestra.run.smithi155.stdout: "event": "started", 2023-08-01T19:56:02.305 INFO:teuthology.orchestra.run.smithi155.stdout: "time": "2023-08-01T19:55:05.152956+0000", 2023-08-01T19:56:02.305 INFO:teuthology.orchestra.run.smithi155.stdout: "duration": 1.8287e-05 2023-08-01T19:56:02.306 INFO:teuthology.orchestra.run.smithi155.stdout: }, 2023-08-01T19:56:02.306 INFO:teuthology.orchestra.run.smithi155.stdout: { 2023-08-01T19:56:02.306 INFO:teuthology.orchestra.run.smithi155.stdout: "event": "commit_sent", 2023-08-01T19:56:02.306 INFO:teuthology.orchestra.run.smithi155.stdout: "time": "2023-08-01T19:55:05.224145+0000", 2023-08-01T19:56:02.306 INFO:teuthology.orchestra.run.smithi155.stdout: "duration": 0.071189447000000003 2023-08-01T19:56:02.306 INFO:teuthology.orchestra.run.smithi155.stdout: }, 2023-08-01T19:56:02.306 INFO:teuthology.orchestra.run.smithi155.stdout: { 2023-08-01T19:56:02.306 INFO:teuthology.orchestra.run.smithi155.stdout: "event": "done", 2023-08-01T19:56:02.307 INFO:teuthology.orchestra.run.smithi155.stdout: "time": "2023-08-01T19:55:05.224168+0000", 2023-08-01T19:56:02.307 INFO:teuthology.orchestra.run.smithi155.stdout: "duration": 2.3008999999999999e-05 2023-08-01T19:56:02.307 INFO:teuthology.orchestra.run.smithi155.stdout: } 2023-08-01T19:56:02.307 INFO:teuthology.orchestra.run.smithi155.stdout: ] 2023-08-01T19:56:02.307 INFO:teuthology.orchestra.run.smithi155.stdout: } 2023-08-01T19:56:02.307 INFO:teuthology.orchestra.run.smithi155.stdout: }, 2023-08-01T19:56:02.307 INFO:teuthology.orchestra.run.smithi155.stdout: { 2023-08-01T19:56:02.307 INFO:teuthology.orchestra.run.smithi155.stdout: "description": "osd_repop(client.4668.0:100244 5.9 e37/19 5:92f56a12:::benchmark_data_smithi006_114134_object100243:head v 37'6294, mlcod=37'6292)", 2023-08-01T19:56:02.308 INFO:teuthology.orchestra.run.smithi155.stdout: "initiated_at": "2023-08-01T19:55:05.151325+0000", 2023-08-01T19:56:02.308 INFO:teuthology.orchestra.run.smithi155.stdout: "age": 57.105661167999997, 2023-08-01T19:56:02.308 INFO:teuthology.orchestra.run.smithi155.stdout: "duration": 0.071883673999999995, 2023-08-01T19:56:02.308 INFO:teuthology.orchestra.run.smithi155.stdout: "type_data": { 2023-08-01T19:56:02.308 INFO:teuthology.orchestra.run.smithi155.stdout: "flag_point": "commit sent; apply or cleanup", 2023-08-01T19:56:02.308 INFO:teuthology.orchestra.run.smithi155.stdout: "events": [ 2023-08-01T19:56:02.308 INFO:teuthology.orchestra.run.smithi155.stdout: { 2023-08-01T19:56:02.308 INFO:teuthology.orchestra.run.smithi155.stdout: "event": "initiated", 2023-08-01T19:56:02.309 INFO:teuthology.orchestra.run.smithi155.stdout: "time": "2023-08-01T19:55:05.151325+0000", 2023-08-01T19:56:02.309 INFO:teuthology.orchestra.run.smithi155.stdout: "duration": 0 2023-08-01T19:56:02.309 INFO:teuthology.orchestra.run.smithi155.stdout: }, 2023-08-01T19:56:02.309 INFO:teuthology.orchestra.run.smithi155.stdout: { 2023-08-01T19:56:02.309 INFO:teuthology.orchestra.run.smithi155.stdout: "event": "throttled", 2023-08-01T19:56:02.309 INFO:teuthology.orchestra.run.smithi155.stdout: "time": "2023-08-01T19:55:05.151325+0000", 2023-08-01T19:56:02.309 INFO:teuthology.orchestra.run.smithi155.stdout: "duration": 0 2023-08-01T19:56:02.310 INFO:teuthology.orchestra.run.smithi155.stdout: }, 2023-08-01T19:56:02.310 INFO:teuthology.orchestra.run.smithi155.stdout: { 2023-08-01T19:56:02.310 INFO:teuthology.orchestra.run.smithi155.stdout: "event": "header_read", 2023-08-01T19:56:02.310 INFO:teuthology.orchestra.run.smithi155.stdout: "time": "2023-08-01T19:55:05.151325+0000", 2023-08-01T19:56:02.310 INFO:teuthology.orchestra.run.smithi155.stdout: "duration": 4294967295.9999995 2023-08-01T19:56:02.310 INFO:teuthology.orchestra.run.smithi155.stdout: }, 2023-08-01T19:56:02.310 INFO:teuthology.orchestra.run.smithi155.stdout: { 2023-08-01T19:56:02.310 INFO:teuthology.orchestra.run.smithi155.stdout: "event": "all_read", 2023-08-01T19:56:02.311 INFO:teuthology.orchestra.run.smithi155.stdout: "time": "2023-08-01T19:55:05.151390+0000", 2023-08-01T19:56:02.311 INFO:teuthology.orchestra.run.smithi155.stdout: "duration": 6.5456999999999993e-05 2023-08-01T19:56:02.311 INFO:teuthology.orchestra.run.smithi155.stdout: }, 2023-08-01T19:56:02.311 INFO:teuthology.orchestra.run.smithi155.stdout: { 2023-08-01T19:56:02.311 INFO:teuthology.orchestra.run.smithi155.stdout: "event": "dispatched", 2023-08-01T19:56:02.311 INFO:teuthology.orchestra.run.smithi155.stdout: "time": "2023-08-01T19:55:05.151396+0000", 2023-08-01T19:56:02.311 INFO:teuthology.orchestra.run.smithi155.stdout: "duration": 5.9190000000000004e-06 2023-08-01T19:56:02.311 INFO:teuthology.orchestra.run.smithi155.stdout: }, 2023-08-01T19:56:02.312 INFO:teuthology.orchestra.run.smithi155.stdout: { 2023-08-01T19:56:02.312 INFO:teuthology.orchestra.run.smithi155.stdout: "event": "queued_for_pg", 2023-08-01T19:56:02.312 INFO:teuthology.orchestra.run.smithi155.stdout: "time": "2023-08-01T19:55:05.151400+0000", 2023-08-01T19:56:02.312 INFO:teuthology.orchestra.run.smithi155.stdout: "duration": 4.1030000000000004e-06 2023-08-01T19:56:02.312 INFO:teuthology.orchestra.run.smithi155.stdout: }, 2023-08-01T19:56:02.312 INFO:teuthology.orchestra.run.smithi155.stdout: { 2023-08-01T19:56:02.312 INFO:teuthology.orchestra.run.smithi155.stdout: "event": "reached_pg", 2023-08-01T19:56:02.312 INFO:teuthology.orchestra.run.smithi155.stdout: "time": "2023-08-01T19:55:05.151452+0000", 2023-08-01T19:56:02.313 INFO:teuthology.orchestra.run.smithi155.stdout: "duration": 5.2136999999999999e-05 2023-08-01T19:56:02.313 INFO:teuthology.orchestra.run.smithi155.stdout: }, 2023-08-01T19:56:02.313 INFO:teuthology.orchestra.run.smithi155.stdout: { 2023-08-01T19:56:02.313 INFO:teuthology.orchestra.run.smithi155.stdout: "event": "started", 2023-08-01T19:56:02.313 INFO:teuthology.orchestra.run.smithi155.stdout: "time": "2023-08-01T19:55:05.151470+0000", 2023-08-01T19:56:02.313 INFO:teuthology.orchestra.run.smithi155.stdout: "duration": 1.8e-05 2023-08-01T19:56:02.313 INFO:teuthology.orchestra.run.smithi155.stdout: }, 2023-08-01T19:56:02.313 INFO:teuthology.orchestra.run.smithi155.stdout: { 2023-08-01T19:56:02.314 INFO:teuthology.orchestra.run.smithi155.stdout: "event": "commit_sent", 2023-08-01T19:56:02.314 INFO:teuthology.orchestra.run.smithi155.stdout: "time": "2023-08-01T19:55:05.223183+0000", 2023-08-01T19:56:02.314 INFO:teuthology.orchestra.run.smithi155.stdout: "duration": 0.071712622000000004 2023-08-01T19:56:02.314 INFO:teuthology.orchestra.run.smithi155.stdout: }, 2023-08-01T19:56:02.314 INFO:teuthology.orchestra.run.smithi155.stdout: { 2023-08-01T19:56:02.314 INFO:teuthology.orchestra.run.smithi155.stdout: "event": "done", 2023-08-01T19:56:02.314 INFO:teuthology.orchestra.run.smithi155.stdout: "time": "2023-08-01T19:55:05.223209+0000", 2023-08-01T19:56:02.314 INFO:teuthology.orchestra.run.smithi155.stdout: "duration": 2.5956e-05 2023-08-01T19:56:02.315 INFO:teuthology.orchestra.run.smithi155.stdout: } 2023-08-01T19:56:02.315 INFO:teuthology.orchestra.run.smithi155.stdout: ] 2023-08-01T19:56:02.315 INFO:teuthology.orchestra.run.smithi155.stdout: } 2023-08-01T19:56:02.315 INFO:teuthology.orchestra.run.smithi155.stdout: }, 2023-08-01T19:56:02.315 INFO:teuthology.orchestra.run.smithi155.stdout: { 2023-08-01T19:56:02.315 INFO:teuthology.orchestra.run.smithi155.stdout: "description": "osd_op(client.4668.0:100249 5.b 5:d0666827:::benchmark_data_smithi006_114134_object100248:head [set-alloc-hint object_size 65536 write_size 65536,write 0~65536] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e37)", 2023-08-01T19:56:02.315 INFO:teuthology.orchestra.run.smithi155.stdout: "initiated_at": "2023-08-01T19:55:05.153614+0000", 2023-08-01T19:56:02.315 INFO:teuthology.orchestra.run.smithi155.stdout: "age": 57.103372743000001, 2023-08-01T19:56:02.316 INFO:teuthology.orchestra.run.smithi155.stdout: "duration": 0.069286118999999993, 2023-08-01T19:56:02.316 INFO:teuthology.orchestra.run.smithi155.stdout: "type_data": { 2023-08-01T19:56:02.316 INFO:teuthology.orchestra.run.smithi155.stdout: "flag_point": "commit sent; apply or cleanup", 2023-08-01T19:56:02.316 INFO:teuthology.orchestra.run.smithi155.stdout: "client_info": { 2023-08-01T19:56:02.316 INFO:teuthology.orchestra.run.smithi155.stdout: "client": "client.4668", 2023-08-01T19:56:02.316 INFO:teuthology.orchestra.run.smithi155.stdout: "client_addr": "172.21.15.6:0/1709472247", 2023-08-01T19:56:02.316 INFO:teuthology.orchestra.run.smithi155.stdout: "tid": 100249 2023-08-01T19:56:02.317 INFO:teuthology.orchestra.run.smithi155.stdout: }, 2023-08-01T19:56:02.317 INFO:teuthology.orchestra.run.smithi155.stdout: "events": [ 2023-08-01T19:56:02.317 INFO:teuthology.orchestra.run.smithi155.stdout: { 2023-08-01T19:56:02.317 INFO:teuthology.orchestra.run.smithi155.stdout: "event": "initiated", 2023-08-01T19:56:02.317 INFO:teuthology.orchestra.run.smithi155.stdout: "time": "2023-08-01T19:55:05.153614+0000", 2023-08-01T19:56:02.317 INFO:teuthology.orchestra.run.smithi155.stdout: "duration": 0 2023-08-01T19:56:02.317 INFO:teuthology.orchestra.run.smithi155.stdout: }, 2023-08-01T19:56:02.317 INFO:teuthology.orchestra.run.smithi155.stdout: { 2023-08-01T19:56:02.318 INFO:teuthology.orchestra.run.smithi155.stdout: "event": "throttled", 2023-08-01T19:56:02.318 INFO:teuthology.orchestra.run.smithi155.stdout: "time": "2023-08-01T19:55:05.153614+0000", 2023-08-01T19:56:02.318 INFO:teuthology.orchestra.run.smithi155.stdout: "duration": 0 2023-08-01T19:56:02.318 INFO:teuthology.orchestra.run.smithi155.stdout: }, 2023-08-01T19:56:02.318 INFO:teuthology.orchestra.run.smithi155.stdout: { 2023-08-01T19:56:02.318 INFO:teuthology.orchestra.run.smithi155.stdout: "event": "header_read", 2023-08-01T19:56:02.318 INFO:teuthology.orchestra.run.smithi155.stdout: "time": "2023-08-01T19:55:05.153612+0000", 2023-08-01T19:56:02.318 INFO:teuthology.orchestra.run.smithi155.stdout: "duration": 4294967295.9999986 2023-08-01T19:56:02.319 INFO:teuthology.orchestra.run.smithi155.stdout: }, 2023-08-01T19:56:02.319 INFO:teuthology.orchestra.run.smithi155.stdout: { 2023-08-01T19:56:02.319 INFO:teuthology.orchestra.run.smithi155.stdout: "event": "all_read", 2023-08-01T19:56:02.319 INFO:teuthology.orchestra.run.smithi155.stdout: "time": "2023-08-01T19:55:05.153694+0000", 2023-08-01T19:56:02.319 INFO:teuthology.orchestra.run.smithi155.stdout: "duration": 8.1618000000000004e-05 2023-08-01T19:56:02.319 INFO:teuthology.orchestra.run.smithi155.stdout: }, 2023-08-01T19:56:02.319 INFO:teuthology.orchestra.run.smithi155.stdout: { 2023-08-01T19:56:02.319 INFO:teuthology.orchestra.run.smithi155.stdout: "event": "dispatched", 2023-08-01T19:56:02.320 INFO:teuthology.orchestra.run.smithi155.stdout: "time": "2023-08-01T19:55:05.153713+0000", 2023-08-01T19:56:02.320 INFO:teuthology.orchestra.run.smithi155.stdout: "duration": 1.9069999999999999e-05 2023-08-01T19:56:02.320 INFO:teuthology.orchestra.run.smithi155.stdout: }, 2023-08-01T19:56:02.320 INFO:teuthology.orchestra.run.smithi155.stdout: { 2023-08-01T19:56:02.320 INFO:teuthology.orchestra.run.smithi155.stdout: "event": "queued_for_pg", 2023-08-01T19:56:02.320 INFO:teuthology.orchestra.run.smithi155.stdout: "time": "2023-08-01T19:55:05.153726+0000", 2023-08-01T19:56:02.320 INFO:teuthology.orchestra.run.smithi155.stdout: "duration": 1.238e-05 2023-08-01T19:56:02.321 INFO:teuthology.orchestra.run.smithi155.stdout: }, 2023-08-01T19:56:02.321 INFO:teuthology.orchestra.run.smithi155.stdout: { 2023-08-01T19:56:02.321 INFO:teuthology.orchestra.run.smithi155.stdout: "event": "reached_pg", 2023-08-01T19:56:02.321 INFO:teuthology.orchestra.run.smithi155.stdout: "time": "2023-08-01T19:55:05.153761+0000", 2023-08-01T19:56:02.321 INFO:teuthology.orchestra.run.smithi155.stdout: "duration": 3.5046999999999998e-05 2023-08-01T19:56:02.321 INFO:teuthology.orchestra.run.smithi155.stdout: }, 2023-08-01T19:56:02.321 INFO:teuthology.orchestra.run.smithi155.stdout: { 2023-08-01T19:56:02.321 INFO:teuthology.orchestra.run.smithi155.stdout: "event": "started", 2023-08-01T19:56:02.322 INFO:teuthology.orchestra.run.smithi155.stdout: "time": "2023-08-01T19:55:05.153896+0000", 2023-08-01T19:56:02.322 INFO:teuthology.orchestra.run.smithi155.stdout: "duration": 0.00013575800000000001 2023-08-01T19:56:02.322 INFO:teuthology.orchestra.run.smithi155.stdout: }, 2023-08-01T19:56:02.322 INFO:teuthology.orchestra.run.smithi155.stdout: { 2023-08-01T19:56:02.322 INFO:teuthology.orchestra.run.smithi155.stdout: "event": "waiting for subops from 0", 2023-08-01T19:56:02.322 INFO:teuthology.orchestra.run.smithi155.stdout: "time": "2023-08-01T19:55:05.154043+0000", 2023-08-01T19:56:02.322 INFO:teuthology.orchestra.run.smithi155.stdout: "duration": 0.00014650700000000001 2023-08-01T19:56:02.322 INFO:teuthology.orchestra.run.smithi155.stdout: }, 2023-08-01T19:56:02.323 INFO:teuthology.orchestra.run.smithi155.stdout: { 2023-08-01T19:56:02.323 INFO:teuthology.orchestra.run.smithi155.stdout: "event": "sub_op_commit_rec", 2023-08-01T19:56:02.323 INFO:teuthology.orchestra.run.smithi155.stdout: "time": "2023-08-01T19:55:05.221876+0000", 2023-08-01T19:56:02.323 INFO:teuthology.orchestra.run.smithi155.stdout: "duration": 0.067832796000000001 2023-08-01T19:56:02.323 INFO:teuthology.orchestra.run.smithi155.stdout: }, 2023-08-01T19:56:02.323 INFO:teuthology.orchestra.run.smithi155.stdout: { 2023-08-01T19:56:02.323 INFO:teuthology.orchestra.run.smithi155.stdout: "event": "op_commit", 2023-08-01T19:56:02.323 INFO:teuthology.orchestra.run.smithi155.stdout: "time": "2023-08-01T19:55:05.222813+0000", 2023-08-01T19:56:02.324 INFO:teuthology.orchestra.run.smithi155.stdout: "duration": 0.00093755300000000004 2023-08-01T19:56:02.324 INFO:teuthology.orchestra.run.smithi155.stdout: }, 2023-08-01T19:56:02.324 INFO:teuthology.orchestra.run.smithi155.stdout: { 2023-08-01T19:56:02.324 INFO:teuthology.orchestra.run.smithi155.stdout: "event": "commit_sent", 2023-08-01T19:56:02.324 INFO:teuthology.orchestra.run.smithi155.stdout: "time": "2023-08-01T19:55:05.222861+0000", 2023-08-01T19:56:02.324 INFO:teuthology.orchestra.run.smithi155.stdout: "duration": 4.8013999999999998e-05 2023-08-01T19:56:02.324 INFO:teuthology.orchestra.run.smithi155.stdout: }, 2023-08-01T19:56:02.324 INFO:teuthology.orchestra.run.smithi155.stdout: { 2023-08-01T19:56:02.325 INFO:teuthology.orchestra.run.smithi155.stdout: "event": "done", 2023-08-01T19:56:02.325 INFO:teuthology.orchestra.run.smithi155.stdout: "time": "2023-08-01T19:55:05.222900+0000", 2023-08-01T19:56:02.325 INFO:teuthology.orchestra.run.smithi155.stdout: "duration": 3.8634999999999999e-05 2023-08-01T19:56:02.325 INFO:teuthology.orchestra.run.smithi155.stdout: } 2023-08-01T19:56:02.325 INFO:teuthology.orchestra.run.smithi155.stdout: ] 2023-08-01T19:56:02.325 INFO:teuthology.orchestra.run.smithi155.stdout: } 2023-08-01T19:56:02.325 INFO:teuthology.orchestra.run.smithi155.stdout: }, 2023-08-01T19:56:02.325 INFO:teuthology.orchestra.run.smithi155.stdout: { 2023-08-01T19:56:02.326 INFO:teuthology.orchestra.run.smithi155.stdout: "description": "osd_op(client.4668.0:100251 5.b 5:d853df24:::benchmark_data_smithi006_114134_object100250:head [set-alloc-hint object_size 65536 write_size 65536,write 0~65536] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e37)", 2023-08-01T19:56:02.326 INFO:teuthology.orchestra.run.smithi155.stdout: "initiated_at": "2023-08-01T19:55:05.153737+0000", 2023-08-01T19:56:02.326 INFO:teuthology.orchestra.run.smithi155.stdout: "age": 57.103249728999998, 2023-08-01T19:56:02.326 INFO:teuthology.orchestra.run.smithi155.stdout: "duration": 0.071366545000000003, 2023-08-01T19:56:02.326 INFO:teuthology.orchestra.run.smithi155.stdout: "type_data": { 2023-08-01T19:56:02.326 INFO:teuthology.orchestra.run.smithi155.stdout: "flag_point": "commit sent; apply or cleanup", 2023-08-01T19:56:02.326 INFO:teuthology.orchestra.run.smithi155.stdout: "client_info": { 2023-08-01T19:56:02.326 INFO:teuthology.orchestra.run.smithi155.stdout: "client": "client.4668", 2023-08-01T19:56:02.327 INFO:teuthology.orchestra.run.smithi155.stdout: "client_addr": "172.21.15.6:0/1709472247", 2023-08-01T19:56:02.327 INFO:teuthology.orchestra.run.smithi155.stdout: "tid": 100251 2023-08-01T19:56:02.327 INFO:teuthology.orchestra.run.smithi155.stdout: }, 2023-08-01T19:56:02.327 INFO:teuthology.orchestra.run.smithi155.stdout: "events": [ 2023-08-01T19:56:02.327 INFO:teuthology.orchestra.run.smithi155.stdout: { 2023-08-01T19:56:02.327 INFO:teuthology.orchestra.run.smithi155.stdout: "event": "initiated", 2023-08-01T19:56:02.327 INFO:teuthology.orchestra.run.smithi155.stdout: "time": "2023-08-01T19:55:05.153737+0000", 2023-08-01T19:56:02.328 INFO:teuthology.orchestra.run.smithi155.stdout: "duration": 0 2023-08-01T19:56:02.328 INFO:teuthology.orchestra.run.smithi155.stdout: }, 2023-08-01T19:56:02.328 INFO:teuthology.orchestra.run.smithi155.stdout: { 2023-08-01T19:56:02.328 INFO:teuthology.orchestra.run.smithi155.stdout: "event": "throttled", 2023-08-01T19:56:02.328 INFO:teuthology.orchestra.run.smithi155.stdout: "time": "2023-08-01T19:55:05.153737+0000", 2023-08-01T19:56:02.328 INFO:teuthology.orchestra.run.smithi155.stdout: "duration": 0 2023-08-01T19:56:02.328 INFO:teuthology.orchestra.run.smithi155.stdout: }, 2023-08-01T19:56:02.328 INFO:teuthology.orchestra.run.smithi155.stdout: { 2023-08-01T19:56:02.329 INFO:teuthology.orchestra.run.smithi155.stdout: "event": "header_read", 2023-08-01T19:56:02.329 INFO:teuthology.orchestra.run.smithi155.stdout: "time": "2023-08-01T19:55:05.153736+0000", 2023-08-01T19:56:02.329 INFO:teuthology.orchestra.run.smithi155.stdout: "duration": 4294967295.9999995 2023-08-01T19:56:02.329 INFO:teuthology.orchestra.run.smithi155.stdout: }, 2023-08-01T19:56:02.329 INFO:teuthology.orchestra.run.smithi155.stdout: { 2023-08-01T19:56:02.329 INFO:teuthology.orchestra.run.smithi155.stdout: "event": "all_read", 2023-08-01T19:56:02.329 INFO:teuthology.orchestra.run.smithi155.stdout: "time": "2023-08-01T19:55:05.153784+0000", 2023-08-01T19:56:02.329 INFO:teuthology.orchestra.run.smithi155.stdout: "duration": 4.7660000000000001e-05 2023-08-01T19:56:02.330 INFO:teuthology.orchestra.run.smithi155.stdout: }, 2023-08-01T19:56:02.330 INFO:teuthology.orchestra.run.smithi155.stdout: { 2023-08-01T19:56:02.330 INFO:teuthology.orchestra.run.smithi155.stdout: "event": "dispatched", 2023-08-01T19:56:02.330 INFO:teuthology.orchestra.run.smithi155.stdout: "time": "2023-08-01T19:55:05.153793+0000", 2023-08-01T19:56:02.330 INFO:teuthology.orchestra.run.smithi155.stdout: "duration": 8.7150000000000004e-06 2023-08-01T19:56:02.330 INFO:teuthology.orchestra.run.smithi155.stdout: }, 2023-08-01T19:56:02.330 INFO:teuthology.orchestra.run.smithi155.stdout: { 2023-08-01T19:56:02.330 INFO:teuthology.orchestra.run.smithi155.stdout: "event": "queued_for_pg", 2023-08-01T19:56:02.331 INFO:teuthology.orchestra.run.smithi155.stdout: "time": "2023-08-01T19:55:05.153800+0000", 2023-08-01T19:56:02.331 INFO:teuthology.orchestra.run.smithi155.stdout: "duration": 7.2459999999999997e-06 2023-08-01T19:56:02.331 INFO:teuthology.orchestra.run.smithi155.stdout: }, 2023-08-01T19:56:02.331 INFO:teuthology.orchestra.run.smithi155.stdout: { 2023-08-01T19:56:02.331 INFO:teuthology.orchestra.run.smithi155.stdout: "event": "reached_pg", 2023-08-01T19:56:02.331 INFO:teuthology.orchestra.run.smithi155.stdout: "time": "2023-08-01T19:55:05.156241+0000", 2023-08-01T19:56:02.331 INFO:teuthology.orchestra.run.smithi155.stdout: "duration": 0.0024415359999999998 2023-08-01T19:56:02.331 INFO:teuthology.orchestra.run.smithi155.stdout: }, 2023-08-01T19:56:02.332 INFO:teuthology.orchestra.run.smithi155.stdout: { 2023-08-01T19:56:02.332 INFO:teuthology.orchestra.run.smithi155.stdout: "event": "started", 2023-08-01T19:56:02.332 INFO:teuthology.orchestra.run.smithi155.stdout: "time": "2023-08-01T19:55:05.219045+0000", 2023-08-01T19:56:02.332 INFO:teuthology.orchestra.run.smithi155.stdout: "duration": 0.062803855000000006 2023-08-01T19:56:02.332 INFO:teuthology.orchestra.run.smithi155.stdout: }, 2023-08-01T19:56:02.332 INFO:teuthology.orchestra.run.smithi155.stdout: { 2023-08-01T19:56:02.332 INFO:teuthology.orchestra.run.smithi155.stdout: "event": "waiting for subops from 0", 2023-08-01T19:56:02.332 INFO:teuthology.orchestra.run.smithi155.stdout: "time": "2023-08-01T19:55:05.219238+0000", 2023-08-01T19:56:02.333 INFO:teuthology.orchestra.run.smithi155.stdout: "duration": 0.00019241500000000001 2023-08-01T19:56:02.333 INFO:teuthology.orchestra.run.smithi155.stdout: }, 2023-08-01T19:56:02.333 INFO:teuthology.orchestra.run.smithi155.stdout: { 2023-08-01T19:56:02.333 INFO:teuthology.orchestra.run.smithi155.stdout: "event": "sub_op_commit_rec", 2023-08-01T19:56:02.333 INFO:teuthology.orchestra.run.smithi155.stdout: "time": "2023-08-01T19:55:05.223300+0000", 2023-08-01T19:56:02.333 INFO:teuthology.orchestra.run.smithi155.stdout: "duration": 0.0040626509999999996 2023-08-01T19:56:02.333 INFO:teuthology.orchestra.run.smithi155.stdout: }, 2023-08-01T19:56:02.334 INFO:teuthology.orchestra.run.smithi155.stdout: { 2023-08-01T19:56:02.334 INFO:teuthology.orchestra.run.smithi155.stdout: "event": "op_commit", 2023-08-01T19:56:02.334 INFO:teuthology.orchestra.run.smithi155.stdout: "time": "2023-08-01T19:55:05.225020+0000", 2023-08-01T19:56:02.334 INFO:teuthology.orchestra.run.smithi155.stdout: "duration": 0.0017201 2023-08-01T19:56:02.334 INFO:teuthology.orchestra.run.smithi155.stdout: }, 2023-08-01T19:56:02.334 INFO:teuthology.orchestra.run.smithi155.stdout: { 2023-08-01T19:56:02.334 INFO:teuthology.orchestra.run.smithi155.stdout: "event": "commit_sent", 2023-08-01T19:56:02.334 INFO:teuthology.orchestra.run.smithi155.stdout: "time": "2023-08-01T19:55:05.225066+0000", 2023-08-01T19:56:02.335 INFO:teuthology.orchestra.run.smithi155.stdout: "duration": 4.6143000000000002e-05 2023-08-01T19:56:02.335 INFO:teuthology.orchestra.run.smithi155.stdout: }, 2023-08-01T19:56:02.335 INFO:teuthology.orchestra.run.smithi155.stdout: { 2023-08-01T19:56:02.335 INFO:teuthology.orchestra.run.smithi155.stdout: "event": "done", 2023-08-01T19:56:02.335 INFO:teuthology.orchestra.run.smithi155.stdout: "time": "2023-08-01T19:55:05.225103+0000", 2023-08-01T19:56:02.335 INFO:teuthology.orchestra.run.smithi155.stdout: "duration": 3.6789999999999998e-05 2023-08-01T19:56:02.335 INFO:teuthology.orchestra.run.smithi155.stdout: } 2023-08-01T19:56:02.335 INFO:teuthology.orchestra.run.smithi155.stdout: ] 2023-08-01T19:56:02.336 INFO:teuthology.orchestra.run.smithi155.stdout: } 2023-08-01T19:56:02.336 INFO:teuthology.orchestra.run.smithi155.stdout: }, 2023-08-01T19:56:02.336 INFO:teuthology.orchestra.run.smithi155.stdout: { 2023-08-01T19:56:02.336 INFO:teuthology.orchestra.run.smithi155.stdout: "description": "osd_op(client.4668.0:100252 5.0 5:01f90c3c:::benchmark_data_smithi006_114134_object100251:head [set-alloc-hint object_size 65536 write_size 65536,write 0~65536] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e37)", 2023-08-01T19:56:02.336 INFO:teuthology.orchestra.run.smithi155.stdout: "initiated_at": "2023-08-01T19:55:05.154048+0000", 2023-08-01T19:56:02.336 INFO:teuthology.orchestra.run.smithi155.stdout: "age": 57.102938481999999, 2023-08-01T19:56:02.336 INFO:teuthology.orchestra.run.smithi155.stdout: "duration": 0.070156683999999997, 2023-08-01T19:56:02.336 INFO:teuthology.orchestra.run.smithi155.stdout: "type_data": { 2023-08-01T19:56:02.337 INFO:teuthology.orchestra.run.smithi155.stdout: "flag_point": "commit sent; apply or cleanup", 2023-08-01T19:56:02.337 INFO:teuthology.orchestra.run.smithi155.stdout: "client_info": { 2023-08-01T19:56:02.337 INFO:teuthology.orchestra.run.smithi155.stdout: "client": "client.4668", 2023-08-01T19:56:02.337 INFO:teuthology.orchestra.run.smithi155.stdout: "client_addr": "172.21.15.6:0/1709472247", 2023-08-01T19:56:02.337 INFO:teuthology.orchestra.run.smithi155.stdout: "tid": 100252 2023-08-01T19:56:02.337 INFO:teuthology.orchestra.run.smithi155.stdout: }, 2023-08-01T19:56:02.337 INFO:teuthology.orchestra.run.smithi155.stdout: "events": [ 2023-08-01T19:56:02.337 INFO:teuthology.orchestra.run.smithi155.stdout: { 2023-08-01T19:56:02.338 INFO:teuthology.orchestra.run.smithi155.stdout: "event": "initiated", 2023-08-01T19:56:02.338 INFO:teuthology.orchestra.run.smithi155.stdout: "time": "2023-08-01T19:55:05.154048+0000", 2023-08-01T19:56:02.338 INFO:teuthology.orchestra.run.smithi155.stdout: "duration": 0 2023-08-01T19:56:02.338 INFO:teuthology.orchestra.run.smithi155.stdout: }, 2023-08-01T19:56:02.338 INFO:teuthology.orchestra.run.smithi155.stdout: { 2023-08-01T19:56:02.338 INFO:teuthology.orchestra.run.smithi155.stdout: "event": "throttled", 2023-08-01T19:56:02.338 INFO:teuthology.orchestra.run.smithi155.stdout: "time": "2023-08-01T19:55:05.154048+0000", 2023-08-01T19:56:02.338 INFO:teuthology.orchestra.run.smithi155.stdout: "duration": 0 2023-08-01T19:56:02.339 INFO:teuthology.orchestra.run.smithi155.stdout: }, 2023-08-01T19:56:02.339 INFO:teuthology.orchestra.run.smithi155.stdout: { 2023-08-01T19:56:02.339 INFO:teuthology.orchestra.run.smithi155.stdout: "event": "header_read", 2023-08-01T19:56:02.339 INFO:teuthology.orchestra.run.smithi155.stdout: "time": "2023-08-01T19:55:05.154047+0000", 2023-08-01T19:56:02.339 INFO:teuthology.orchestra.run.smithi155.stdout: "duration": 4294967295.999999 2023-08-01T19:56:02.339 INFO:teuthology.orchestra.run.smithi155.stdout: }, 2023-08-01T19:56:02.339 INFO:teuthology.orchestra.run.smithi155.stdout: { 2023-08-01T19:56:02.340 INFO:teuthology.orchestra.run.smithi155.stdout: "event": "all_read", 2023-08-01T19:56:02.340 INFO:teuthology.orchestra.run.smithi155.stdout: "time": "2023-08-01T19:55:05.154115+0000", 2023-08-01T19:56:02.340 INFO:teuthology.orchestra.run.smithi155.stdout: "duration": 6.7545999999999993e-05 2023-08-01T19:56:02.340 INFO:teuthology.orchestra.run.smithi155.stdout: }, 2023-08-01T19:56:02.340 INFO:teuthology.orchestra.run.smithi155.stdout: { 2023-08-01T19:56:02.340 INFO:teuthology.orchestra.run.smithi155.stdout: "event": "dispatched", 2023-08-01T19:56:02.340 INFO:teuthology.orchestra.run.smithi155.stdout: "time": "2023-08-01T19:55:05.154125+0000", 2023-08-01T19:56:02.340 INFO:teuthology.orchestra.run.smithi155.stdout: "duration": 1.0669000000000001e-05 2023-08-01T19:56:02.341 INFO:teuthology.orchestra.run.smithi155.stdout: }, 2023-08-01T19:56:02.341 INFO:teuthology.orchestra.run.smithi155.stdout: { 2023-08-01T19:56:02.341 INFO:teuthology.orchestra.run.smithi155.stdout: "event": "queued_for_pg", 2023-08-01T19:56:02.341 INFO:teuthology.orchestra.run.smithi155.stdout: "time": "2023-08-01T19:55:05.154131+0000", 2023-08-01T19:56:02.341 INFO:teuthology.orchestra.run.smithi155.stdout: "duration": 6.0349999999999998e-06 2023-08-01T19:56:02.341 INFO:teuthology.orchestra.run.smithi155.stdout: }, 2023-08-01T19:56:02.341 INFO:teuthology.orchestra.run.smithi155.stdout: { 2023-08-01T19:56:02.341 INFO:teuthology.orchestra.run.smithi155.stdout: "event": "reached_pg", 2023-08-01T19:56:02.342 INFO:teuthology.orchestra.run.smithi155.stdout: "time": "2023-08-01T19:55:05.154174+0000", 2023-08-01T19:56:02.342 INFO:teuthology.orchestra.run.smithi155.stdout: "duration": 4.2429000000000003e-05 2023-08-01T19:56:02.342 INFO:teuthology.orchestra.run.smithi155.stdout: }, 2023-08-01T19:56:02.342 INFO:teuthology.orchestra.run.smithi155.stdout: { 2023-08-01T19:56:02.342 INFO:teuthology.orchestra.run.smithi155.stdout: "event": "started", 2023-08-01T19:56:02.342 INFO:teuthology.orchestra.run.smithi155.stdout: "time": "2023-08-01T19:55:05.154287+0000", 2023-08-01T19:56:02.342 INFO:teuthology.orchestra.run.smithi155.stdout: "duration": 0.000113138 2023-08-01T19:56:02.342 INFO:teuthology.orchestra.run.smithi155.stdout: }, 2023-08-01T19:56:02.343 INFO:teuthology.orchestra.run.smithi155.stdout: { 2023-08-01T19:56:02.343 INFO:teuthology.orchestra.run.smithi155.stdout: "event": "waiting for subops from 0", 2023-08-01T19:56:02.343 INFO:teuthology.orchestra.run.smithi155.stdout: "time": "2023-08-01T19:55:05.154420+0000", 2023-08-01T19:56:02.343 INFO:teuthology.orchestra.run.smithi155.stdout: "duration": 0.000133292 2023-08-01T19:56:02.343 INFO:teuthology.orchestra.run.smithi155.stdout: }, 2023-08-01T19:56:02.343 INFO:teuthology.orchestra.run.smithi155.stdout: { 2023-08-01T19:56:02.343 INFO:teuthology.orchestra.run.smithi155.stdout: "event": "sub_op_commit_rec", 2023-08-01T19:56:02.343 INFO:teuthology.orchestra.run.smithi155.stdout: "time": "2023-08-01T19:55:05.219034+0000", 2023-08-01T19:56:02.344 INFO:teuthology.orchestra.run.smithi155.stdout: "duration": 0.064613429999999999 2023-08-01T19:56:02.344 INFO:teuthology.orchestra.run.smithi155.stdout: }, 2023-08-01T19:56:02.344 INFO:teuthology.orchestra.run.smithi155.stdout: { 2023-08-01T19:56:02.344 INFO:teuthology.orchestra.run.smithi155.stdout: "event": "op_commit", 2023-08-01T19:56:02.344 INFO:teuthology.orchestra.run.smithi155.stdout: "time": "2023-08-01T19:55:05.224138+0000", 2023-08-01T19:56:02.344 INFO:teuthology.orchestra.run.smithi155.stdout: "duration": 0.0051041999999999997 2023-08-01T19:56:02.344 INFO:teuthology.orchestra.run.smithi155.stdout: }, 2023-08-01T19:56:02.345 INFO:teuthology.orchestra.run.smithi155.stdout: { 2023-08-01T19:56:02.345 INFO:teuthology.orchestra.run.smithi155.stdout: "event": "commit_sent", 2023-08-01T19:56:02.345 INFO:teuthology.orchestra.run.smithi155.stdout: "time": "2023-08-01T19:55:05.224171+0000", 2023-08-01T19:56:02.345 INFO:teuthology.orchestra.run.smithi155.stdout: "duration": 3.3345e-05 2023-08-01T19:56:02.345 INFO:teuthology.orchestra.run.smithi155.stdout: }, 2023-08-01T19:56:02.345 INFO:teuthology.orchestra.run.smithi155.stdout: { 2023-08-01T19:56:02.345 INFO:teuthology.orchestra.run.smithi155.stdout: "event": "done", 2023-08-01T19:56:02.345 INFO:teuthology.orchestra.run.smithi155.stdout: "time": "2023-08-01T19:55:05.224205+0000", 2023-08-01T19:56:02.346 INFO:teuthology.orchestra.run.smithi155.stdout: "duration": 3.3525999999999997e-05 2023-08-01T19:56:02.346 INFO:teuthology.orchestra.run.smithi155.stdout: } 2023-08-01T19:56:02.346 INFO:teuthology.orchestra.run.smithi155.stdout: ] 2023-08-01T19:56:02.346 INFO:teuthology.orchestra.run.smithi155.stdout: } 2023-08-01T19:56:02.346 INFO:teuthology.orchestra.run.smithi155.stdout: }, 2023-08-01T19:56:02.346 INFO:teuthology.orchestra.run.smithi155.stdout: { 2023-08-01T19:56:02.346 INFO:teuthology.orchestra.run.smithi155.stdout: "description": "osd_repop_reply(client.4668.0:100237 5.4 e37/19 ondisk, result = 0)", 2023-08-01T19:56:02.346 INFO:teuthology.orchestra.run.smithi155.stdout: "initiated_at": "2023-08-01T19:55:05.156249+0000", 2023-08-01T19:56:02.347 INFO:teuthology.orchestra.run.smithi155.stdout: "age": 57.100737537000001, 2023-08-01T19:56:02.347 INFO:teuthology.orchestra.run.smithi155.stdout: "duration": 0.062792549000000003, 2023-08-01T19:56:02.347 INFO:teuthology.orchestra.run.smithi155.stdout: "type_data": { 2023-08-01T19:56:02.347 INFO:teuthology.orchestra.run.smithi155.stdout: "flag_point": "started", 2023-08-01T19:56:02.347 INFO:teuthology.orchestra.run.smithi155.stdout: "events": [ 2023-08-01T19:56:02.347 INFO:teuthology.orchestra.run.smithi155.stdout: { 2023-08-01T19:56:02.347 INFO:teuthology.orchestra.run.smithi155.stdout: "event": "initiated", 2023-08-01T19:56:02.347 INFO:teuthology.orchestra.run.smithi155.stdout: "time": "2023-08-01T19:55:05.156249+0000", 2023-08-01T19:56:02.348 INFO:teuthology.orchestra.run.smithi155.stdout: "duration": 0 2023-08-01T19:56:02.348 INFO:teuthology.orchestra.run.smithi155.stdout: }, 2023-08-01T19:56:02.348 INFO:teuthology.orchestra.run.smithi155.stdout: { 2023-08-01T19:56:02.348 INFO:teuthology.orchestra.run.smithi155.stdout: "event": "throttled", 2023-08-01T19:56:02.348 INFO:teuthology.orchestra.run.smithi155.stdout: "time": "2023-08-01T19:55:05.156249+0000", 2023-08-01T19:56:02.348 INFO:teuthology.orchestra.run.smithi155.stdout: "duration": 0 2023-08-01T19:56:02.348 INFO:teuthology.orchestra.run.smithi155.stdout: }, 2023-08-01T19:56:02.348 INFO:teuthology.orchestra.run.smithi155.stdout: { 2023-08-01T19:56:02.349 INFO:teuthology.orchestra.run.smithi155.stdout: "event": "header_read", 2023-08-01T19:56:02.349 INFO:teuthology.orchestra.run.smithi155.stdout: "time": "2023-08-01T19:55:05.156248+0000", 2023-08-01T19:56:02.349 INFO:teuthology.orchestra.run.smithi155.stdout: "duration": 4294967295.9999995 2023-08-01T19:56:02.349 INFO:teuthology.orchestra.run.smithi155.stdout: }, 2023-08-01T19:56:02.349 INFO:teuthology.orchestra.run.smithi155.stdout: { 2023-08-01T19:56:02.349 INFO:teuthology.orchestra.run.smithi155.stdout: "event": "all_read", 2023-08-01T19:56:02.349 INFO:teuthology.orchestra.run.smithi155.stdout: "time": "2023-08-01T19:55:05.156252+0000", 2023-08-01T19:56:02.349 INFO:teuthology.orchestra.run.smithi155.stdout: "duration": 3.9999999999999998e-06 2023-08-01T19:56:02.350 INFO:teuthology.orchestra.run.smithi155.stdout: }, 2023-08-01T19:56:02.350 INFO:teuthology.orchestra.run.smithi155.stdout: { 2023-08-01T19:56:02.350 INFO:teuthology.orchestra.run.smithi155.stdout: "event": "dispatched", 2023-08-01T19:56:02.350 INFO:teuthology.orchestra.run.smithi155.stdout: "time": "2023-08-01T19:55:05.218844+0000", 2023-08-01T19:56:02.350 INFO:teuthology.orchestra.run.smithi155.stdout: "duration": 0.062591516999999999 2023-08-01T19:56:02.350 INFO:teuthology.orchestra.run.smithi155.stdout: }, 2023-08-01T19:56:02.350 INFO:teuthology.orchestra.run.smithi155.stdout: { 2023-08-01T19:56:02.350 INFO:teuthology.orchestra.run.smithi155.stdout: "event": "queued_for_pg", 2023-08-01T19:56:02.351 INFO:teuthology.orchestra.run.smithi155.stdout: "time": "2023-08-01T19:55:05.218862+0000", 2023-08-01T19:56:02.351 INFO:teuthology.orchestra.run.smithi155.stdout: "duration": 1.7666e-05 2023-08-01T19:56:02.351 INFO:teuthology.orchestra.run.smithi155.stdout: }, 2023-08-01T19:56:02.351 INFO:teuthology.orchestra.run.smithi155.stdout: { 2023-08-01T19:56:02.351 INFO:teuthology.orchestra.run.smithi155.stdout: "event": "reached_pg", 2023-08-01T19:56:02.351 INFO:teuthology.orchestra.run.smithi155.stdout: "time": "2023-08-01T19:55:05.218914+0000", 2023-08-01T19:56:02.351 INFO:teuthology.orchestra.run.smithi155.stdout: "duration": 5.2565999999999998e-05 2023-08-01T19:56:02.351 INFO:teuthology.orchestra.run.smithi155.stdout: }, 2023-08-01T19:56:02.352 INFO:teuthology.orchestra.run.smithi155.stdout: { 2023-08-01T19:56:02.352 INFO:teuthology.orchestra.run.smithi155.stdout: "event": "started", 2023-08-01T19:56:02.352 INFO:teuthology.orchestra.run.smithi155.stdout: "time": "2023-08-01T19:55:05.218925+0000", 2023-08-01T19:56:02.352 INFO:teuthology.orchestra.run.smithi155.stdout: "duration": 1.1375e-05 2023-08-01T19:56:02.352 INFO:teuthology.orchestra.run.smithi155.stdout: }, 2023-08-01T19:56:02.352 INFO:teuthology.orchestra.run.smithi155.stdout: { 2023-08-01T19:56:02.352 INFO:teuthology.orchestra.run.smithi155.stdout: "event": "done", 2023-08-01T19:56:02.353 INFO:teuthology.orchestra.run.smithi155.stdout: "time": "2023-08-01T19:55:05.219041+0000", 2023-08-01T19:56:02.353 INFO:teuthology.orchestra.run.smithi155.stdout: "duration": 0.000115977 2023-08-01T19:56:02.353 INFO:teuthology.orchestra.run.smithi155.stdout: } 2023-08-01T19:56:02.353 INFO:teuthology.orchestra.run.smithi155.stdout: ] 2023-08-01T19:56:02.353 INFO:teuthology.orchestra.run.smithi155.stdout: } 2023-08-01T19:56:02.353 INFO:teuthology.orchestra.run.smithi155.stdout: }, 2023-08-01T19:56:02.353 INFO:teuthology.orchestra.run.smithi155.stdout: { 2023-08-01T19:56:02.353 INFO:teuthology.orchestra.run.smithi155.stdout: "description": "osd_repop(client.4668.0:100253 5.f e37/19 5:f7bbce05:::benchmark_data_smithi006_114134_object100252:head v 37'6323, mlcod=37'6321)", 2023-08-01T19:56:02.354 INFO:teuthology.orchestra.run.smithi155.stdout: "initiated_at": "2023-08-01T19:55:05.156952+0000", 2023-08-01T19:56:02.354 INFO:teuthology.orchestra.run.smithi155.stdout: "age": 57.100034473999997, 2023-08-01T19:56:02.354 INFO:teuthology.orchestra.run.smithi155.stdout: "duration": 0.068018577999999996, 2023-08-01T19:56:02.354 INFO:teuthology.orchestra.run.smithi155.stdout: "type_data": { 2023-08-01T19:56:02.354 INFO:teuthology.orchestra.run.smithi155.stdout: "flag_point": "commit sent; apply or cleanup", 2023-08-01T19:56:02.354 INFO:teuthology.orchestra.run.smithi155.stdout: "events": [ 2023-08-01T19:56:02.354 INFO:teuthology.orchestra.run.smithi155.stdout: { 2023-08-01T19:56:02.354 INFO:teuthology.orchestra.run.smithi155.stdout: "event": "initiated", 2023-08-01T19:56:02.355 INFO:teuthology.orchestra.run.smithi155.stdout: "time": "2023-08-01T19:55:05.156952+0000", 2023-08-01T19:56:02.355 INFO:teuthology.orchestra.run.smithi155.stdout: "duration": 0 2023-08-01T19:56:02.355 INFO:teuthology.orchestra.run.smithi155.stdout: }, 2023-08-01T19:56:02.355 INFO:teuthology.orchestra.run.smithi155.stdout: { 2023-08-01T19:56:02.355 INFO:teuthology.orchestra.run.smithi155.stdout: "event": "throttled", 2023-08-01T19:56:02.355 INFO:teuthology.orchestra.run.smithi155.stdout: "time": "2023-08-01T19:55:05.156952+0000", 2023-08-01T19:56:02.355 INFO:teuthology.orchestra.run.smithi155.stdout: "duration": 0 2023-08-01T19:56:02.355 INFO:teuthology.orchestra.run.smithi155.stdout: }, 2023-08-01T19:56:02.356 INFO:teuthology.orchestra.run.smithi155.stdout: { 2023-08-01T19:56:02.356 INFO:teuthology.orchestra.run.smithi155.stdout: "event": "header_read", 2023-08-01T19:56:02.356 INFO:teuthology.orchestra.run.smithi155.stdout: "time": "2023-08-01T19:55:05.156951+0000", 2023-08-01T19:56:02.356 INFO:teuthology.orchestra.run.smithi155.stdout: "duration": 4294967295.999999 2023-08-01T19:56:02.356 INFO:teuthology.orchestra.run.smithi155.stdout: }, 2023-08-01T19:56:02.356 INFO:teuthology.orchestra.run.smithi155.stdout: { 2023-08-01T19:56:02.356 INFO:teuthology.orchestra.run.smithi155.stdout: "event": "all_read", 2023-08-01T19:56:02.356 INFO:teuthology.orchestra.run.smithi155.stdout: "time": "2023-08-01T19:55:05.156989+0000", 2023-08-01T19:56:02.357 INFO:teuthology.orchestra.run.smithi155.stdout: "duration": 3.8175e-05 2023-08-01T19:56:02.357 INFO:teuthology.orchestra.run.smithi155.stdout: }, 2023-08-01T19:56:02.357 INFO:teuthology.orchestra.run.smithi155.stdout: { 2023-08-01T19:56:02.357 INFO:teuthology.orchestra.run.smithi155.stdout: "event": "dispatched", 2023-08-01T19:56:02.357 INFO:teuthology.orchestra.run.smithi155.stdout: "time": "2023-08-01T19:55:05.218842+0000", 2023-08-01T19:56:02.357 INFO:teuthology.orchestra.run.smithi155.stdout: "duration": 0.061852299999999999 2023-08-01T19:56:02.357 INFO:teuthology.orchestra.run.smithi155.stdout: }, 2023-08-01T19:56:02.358 INFO:teuthology.orchestra.run.smithi155.stdout: { 2023-08-01T19:56:02.358 INFO:teuthology.orchestra.run.smithi155.stdout: "event": "queued_for_pg", 2023-08-01T19:56:02.358 INFO:teuthology.orchestra.run.smithi155.stdout: "time": "2023-08-01T19:55:05.218862+0000", 2023-08-01T19:56:02.358 INFO:teuthology.orchestra.run.smithi155.stdout: "duration": 1.9854999999999999e-05 2023-08-01T19:56:02.358 INFO:teuthology.orchestra.run.smithi155.stdout: }, 2023-08-01T19:56:02.358 INFO:teuthology.orchestra.run.smithi155.stdout: { 2023-08-01T19:56:02.358 INFO:teuthology.orchestra.run.smithi155.stdout: "event": "reached_pg", 2023-08-01T19:56:02.358 INFO:teuthology.orchestra.run.smithi155.stdout: "time": "2023-08-01T19:55:05.218918+0000", 2023-08-01T19:56:02.359 INFO:teuthology.orchestra.run.smithi155.stdout: "duration": 5.6570000000000002e-05 2023-08-01T19:56:02.359 INFO:teuthology.orchestra.run.smithi155.stdout: }, 2023-08-01T19:56:02.359 INFO:teuthology.orchestra.run.smithi155.stdout: { 2023-08-01T19:56:02.359 INFO:teuthology.orchestra.run.smithi155.stdout: "event": "started", 2023-08-01T19:56:02.359 INFO:teuthology.orchestra.run.smithi155.stdout: "time": "2023-08-01T19:55:05.218940+0000", 2023-08-01T19:56:02.359 INFO:teuthology.orchestra.run.smithi155.stdout: "duration": 2.1804e-05 2023-08-01T19:56:02.359 INFO:teuthology.orchestra.run.smithi155.stdout: }, 2023-08-01T19:56:02.359 INFO:teuthology.orchestra.run.smithi155.stdout: { 2023-08-01T19:56:02.360 INFO:teuthology.orchestra.run.smithi155.stdout: "event": "commit_sent", 2023-08-01T19:56:02.360 INFO:teuthology.orchestra.run.smithi155.stdout: "time": "2023-08-01T19:55:05.224928+0000", 2023-08-01T19:56:02.360 INFO:teuthology.orchestra.run.smithi155.stdout: "duration": 0.0059876759999999999 2023-08-01T19:56:02.360 INFO:teuthology.orchestra.run.smithi155.stdout: }, 2023-08-01T19:56:02.360 INFO:teuthology.orchestra.run.smithi155.stdout: { 2023-08-01T19:56:02.360 INFO:teuthology.orchestra.run.smithi155.stdout: "event": "done", 2023-08-01T19:56:02.360 INFO:teuthology.orchestra.run.smithi155.stdout: "time": "2023-08-01T19:55:05.224971+0000", 2023-08-01T19:56:02.360 INFO:teuthology.orchestra.run.smithi155.stdout: "duration": 4.2929999999999997e-05 2023-08-01T19:56:02.361 INFO:teuthology.orchestra.run.smithi155.stdout: } 2023-08-01T19:56:02.361 INFO:teuthology.orchestra.run.smithi155.stdout: ] 2023-08-01T19:56:02.361 INFO:teuthology.orchestra.run.smithi155.stdout: } 2023-08-01T19:56:02.361 INFO:teuthology.orchestra.run.smithi155.stdout: }, 2023-08-01T19:56:02.361 INFO:teuthology.orchestra.run.smithi155.stdout: { 2023-08-01T19:56:02.361 INFO:teuthology.orchestra.run.smithi155.stdout: "description": "osd_op(client.4668.0:100927 5.0 5:00608ec6:::benchmark_data_smithi006_114134_object100926:head [set-alloc-hint object_size 65536 write_size 65536,write 0~65536] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e37)", 2023-08-01T19:56:02.361 INFO:teuthology.orchestra.run.smithi155.stdout: "initiated_at": "2023-08-01T19:55:05.561169+0000", 2023-08-01T19:56:02.361 INFO:teuthology.orchestra.run.smithi155.stdout: "age": 56.695817570999999, 2023-08-01T19:56:02.362 INFO:teuthology.orchestra.run.smithi155.stdout: "duration": 0.066411687999999997, 2023-08-01T19:56:02.362 INFO:teuthology.orchestra.run.smithi155.stdout: "type_data": { 2023-08-01T19:56:02.362 INFO:teuthology.orchestra.run.smithi155.stdout: "flag_point": "commit sent; apply or cleanup", 2023-08-01T19:56:02.362 INFO:teuthology.orchestra.run.smithi155.stdout: "client_info": { 2023-08-01T19:56:02.362 INFO:teuthology.orchestra.run.smithi155.stdout: "client": "client.4668", 2023-08-01T19:56:02.362 INFO:teuthology.orchestra.run.smithi155.stdout: "client_addr": "172.21.15.6:0/1709472247", 2023-08-01T19:56:02.362 INFO:teuthology.orchestra.run.smithi155.stdout: "tid": 100927 2023-08-01T19:56:02.363 INFO:teuthology.orchestra.run.smithi155.stdout: }, 2023-08-01T19:56:02.363 INFO:teuthology.orchestra.run.smithi155.stdout: "events": [ 2023-08-01T19:56:02.363 INFO:teuthology.orchestra.run.smithi155.stdout: { 2023-08-01T19:56:02.363 INFO:teuthology.orchestra.run.smithi155.stdout: "event": "initiated", 2023-08-01T19:56:02.363 INFO:teuthology.orchestra.run.smithi155.stdout: "time": "2023-08-01T19:55:05.561169+0000", 2023-08-01T19:56:02.363 INFO:teuthology.orchestra.run.smithi155.stdout: "duration": 0 2023-08-01T19:56:02.363 INFO:teuthology.orchestra.run.smithi155.stdout: }, 2023-08-01T19:56:02.363 INFO:teuthology.orchestra.run.smithi155.stdout: { 2023-08-01T19:56:02.364 INFO:teuthology.orchestra.run.smithi155.stdout: "event": "throttled", 2023-08-01T19:56:02.364 INFO:teuthology.orchestra.run.smithi155.stdout: "time": "2023-08-01T19:55:05.561169+0000", 2023-08-01T19:56:02.364 INFO:teuthology.orchestra.run.smithi155.stdout: "duration": 0 2023-08-01T19:56:02.364 INFO:teuthology.orchestra.run.smithi155.stdout: }, 2023-08-01T19:56:02.364 INFO:teuthology.orchestra.run.smithi155.stdout: { 2023-08-01T19:56:02.364 INFO:teuthology.orchestra.run.smithi155.stdout: "event": "header_read", 2023-08-01T19:56:02.364 INFO:teuthology.orchestra.run.smithi155.stdout: "time": "2023-08-01T19:55:05.561168+0000", 2023-08-01T19:56:02.364 INFO:teuthology.orchestra.run.smithi155.stdout: "duration": 4294967295.9999995 2023-08-01T19:56:02.365 INFO:teuthology.orchestra.run.smithi155.stdout: }, 2023-08-01T19:56:02.365 INFO:teuthology.orchestra.run.smithi155.stdout: { 2023-08-01T19:56:02.365 INFO:teuthology.orchestra.run.smithi155.stdout: "event": "all_read", 2023-08-01T19:56:02.365 INFO:teuthology.orchestra.run.smithi155.stdout: "time": "2023-08-01T19:55:05.561218+0000", 2023-08-01T19:56:02.365 INFO:teuthology.orchestra.run.smithi155.stdout: "duration": 4.9379999999999998e-05 2023-08-01T19:56:02.365 INFO:teuthology.orchestra.run.smithi155.stdout: }, 2023-08-01T19:56:02.365 INFO:teuthology.orchestra.run.smithi155.stdout: { 2023-08-01T19:56:02.365 INFO:teuthology.orchestra.run.smithi155.stdout: "event": "dispatched", 2023-08-01T19:56:02.366 INFO:teuthology.orchestra.run.smithi155.stdout: "time": "2023-08-01T19:55:05.561225+0000", 2023-08-01T19:56:02.366 INFO:teuthology.orchestra.run.smithi155.stdout: "duration": 7.114e-06 2023-08-01T19:56:02.366 INFO:teuthology.orchestra.run.smithi155.stdout: }, 2023-08-01T19:56:02.366 INFO:teuthology.orchestra.run.smithi155.stdout: { 2023-08-01T19:56:02.366 INFO:teuthology.orchestra.run.smithi155.stdout: "event": "queued_for_pg", 2023-08-01T19:56:02.366 INFO:teuthology.orchestra.run.smithi155.stdout: "time": "2023-08-01T19:55:05.561229+0000", 2023-08-01T19:56:02.366 INFO:teuthology.orchestra.run.smithi155.stdout: "duration": 4.2180000000000001e-06 2023-08-01T19:56:02.366 INFO:teuthology.orchestra.run.smithi155.stdout: }, 2023-08-01T19:56:02.367 INFO:teuthology.orchestra.run.smithi155.stdout: { 2023-08-01T19:56:02.367 INFO:teuthology.orchestra.run.smithi155.stdout: "event": "reached_pg", 2023-08-01T19:56:02.367 INFO:teuthology.orchestra.run.smithi155.stdout: "time": "2023-08-01T19:55:05.564737+0000", 2023-08-01T19:56:02.367 INFO:teuthology.orchestra.run.smithi155.stdout: "duration": 0.0035081869999999999 2023-08-01T19:56:02.367 INFO:teuthology.orchestra.run.smithi155.stdout: }, 2023-08-01T19:56:02.367 INFO:teuthology.orchestra.run.smithi155.stdout: { 2023-08-01T19:56:02.367 INFO:teuthology.orchestra.run.smithi155.stdout: "event": "started", 2023-08-01T19:56:02.367 INFO:teuthology.orchestra.run.smithi155.stdout: "time": "2023-08-01T19:55:05.564859+0000", 2023-08-01T19:56:02.368 INFO:teuthology.orchestra.run.smithi155.stdout: "duration": 0.00012165800000000001 2023-08-01T19:56:02.368 INFO:teuthology.orchestra.run.smithi155.stdout: }, 2023-08-01T19:56:02.368 INFO:teuthology.orchestra.run.smithi155.stdout: { 2023-08-01T19:56:02.368 INFO:teuthology.orchestra.run.smithi155.stdout: "event": "waiting for subops from 0", 2023-08-01T19:56:02.368 INFO:teuthology.orchestra.run.smithi155.stdout: "time": "2023-08-01T19:55:05.565009+0000", 2023-08-01T19:56:02.368 INFO:teuthology.orchestra.run.smithi155.stdout: "duration": 0.00014979699999999999 2023-08-01T19:56:02.368 INFO:teuthology.orchestra.run.smithi155.stdout: }, 2023-08-01T19:56:02.369 INFO:teuthology.orchestra.run.smithi155.stdout: { 2023-08-01T19:56:02.369 INFO:teuthology.orchestra.run.smithi155.stdout: "event": "op_commit", 2023-08-01T19:56:02.369 INFO:teuthology.orchestra.run.smithi155.stdout: "time": "2023-08-01T19:55:05.568007+0000", 2023-08-01T19:56:02.369 INFO:teuthology.orchestra.run.smithi155.stdout: "duration": 0.00299796 2023-08-01T19:56:02.369 INFO:teuthology.orchestra.run.smithi155.stdout: }, 2023-08-01T19:56:02.369 INFO:teuthology.orchestra.run.smithi155.stdout: { 2023-08-01T19:56:02.369 INFO:teuthology.orchestra.run.smithi155.stdout: "event": "sub_op_commit_rec", 2023-08-01T19:56:02.369 INFO:teuthology.orchestra.run.smithi155.stdout: "time": "2023-08-01T19:55:05.627520+0000", 2023-08-01T19:56:02.370 INFO:teuthology.orchestra.run.smithi155.stdout: "duration": 0.059513636000000002 2023-08-01T19:56:02.370 INFO:teuthology.orchestra.run.smithi155.stdout: }, 2023-08-01T19:56:02.370 INFO:teuthology.orchestra.run.smithi155.stdout: { 2023-08-01T19:56:02.370 INFO:teuthology.orchestra.run.smithi155.stdout: "event": "commit_sent", 2023-08-01T19:56:02.370 INFO:teuthology.orchestra.run.smithi155.stdout: "time": "2023-08-01T19:55:05.627553+0000", 2023-08-01T19:56:02.370 INFO:teuthology.orchestra.run.smithi155.stdout: "duration": 3.2635999999999997e-05 2023-08-01T19:56:02.370 INFO:teuthology.orchestra.run.smithi155.stdout: }, 2023-08-01T19:56:02.370 INFO:teuthology.orchestra.run.smithi155.stdout: { 2023-08-01T19:56:02.371 INFO:teuthology.orchestra.run.smithi155.stdout: "event": "done", 2023-08-01T19:56:02.371 INFO:teuthology.orchestra.run.smithi155.stdout: "time": "2023-08-01T19:55:05.627581+0000", 2023-08-01T19:56:02.371 INFO:teuthology.orchestra.run.smithi155.stdout: "duration": 2.7681000000000001e-05 2023-08-01T19:56:02.371 INFO:teuthology.orchestra.run.smithi155.stdout: } 2023-08-01T19:56:02.371 INFO:teuthology.orchestra.run.smithi155.stdout: ] 2023-08-01T19:56:02.371 INFO:teuthology.orchestra.run.smithi155.stdout: } 2023-08-01T19:56:02.371 INFO:teuthology.orchestra.run.smithi155.stdout: }, 2023-08-01T19:56:02.371 INFO:teuthology.orchestra.run.smithi155.stdout: { 2023-08-01T19:56:02.372 INFO:teuthology.orchestra.run.smithi155.stdout: "description": "osd_op(client.4668.0:100935 5.e 5:7895b14e:::benchmark_data_smithi006_114134_object100934:head [set-alloc-hint object_size 65536 write_size 65536,write 0~65536] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e37)", 2023-08-01T19:56:02.372 INFO:teuthology.orchestra.run.smithi155.stdout: "initiated_at": "2023-08-01T19:55:05.566666+0000", 2023-08-01T19:56:02.372 INFO:teuthology.orchestra.run.smithi155.stdout: "age": 56.690320270999997, 2023-08-01T19:56:02.372 INFO:teuthology.orchestra.run.smithi155.stdout: "duration": 0.064309016999999996, 2023-08-01T19:56:02.372 INFO:teuthology.orchestra.run.smithi155.stdout: "type_data": { 2023-08-01T19:56:02.372 INFO:teuthology.orchestra.run.smithi155.stdout: "flag_point": "commit sent; apply or cleanup", 2023-08-01T19:56:02.372 INFO:teuthology.orchestra.run.smithi155.stdout: "client_info": { 2023-08-01T19:56:02.372 INFO:teuthology.orchestra.run.smithi155.stdout: "client": "client.4668", 2023-08-01T19:56:02.373 INFO:teuthology.orchestra.run.smithi155.stdout: "client_addr": "172.21.15.6:0/1709472247", 2023-08-01T19:56:02.373 INFO:teuthology.orchestra.run.smithi155.stdout: "tid": 100935 2023-08-01T19:56:02.373 INFO:teuthology.orchestra.run.smithi155.stdout: }, 2023-08-01T19:56:02.373 INFO:teuthology.orchestra.run.smithi155.stdout: "events": [ 2023-08-01T19:56:02.373 INFO:teuthology.orchestra.run.smithi155.stdout: { 2023-08-01T19:56:02.373 INFO:teuthology.orchestra.run.smithi155.stdout: "event": "initiated", 2023-08-01T19:56:02.373 INFO:teuthology.orchestra.run.smithi155.stdout: "time": "2023-08-01T19:55:05.566666+0000", 2023-08-01T19:56:02.373 INFO:teuthology.orchestra.run.smithi155.stdout: "duration": 0 2023-08-01T19:56:02.374 INFO:teuthology.orchestra.run.smithi155.stdout: }, 2023-08-01T19:56:02.374 INFO:teuthology.orchestra.run.smithi155.stdout: { 2023-08-01T19:56:02.374 INFO:teuthology.orchestra.run.smithi155.stdout: "event": "throttled", 2023-08-01T19:56:02.374 INFO:teuthology.orchestra.run.smithi155.stdout: "time": "2023-08-01T19:55:05.566666+0000", 2023-08-01T19:56:02.374 INFO:teuthology.orchestra.run.smithi155.stdout: "duration": 0 2023-08-01T19:56:02.374 INFO:teuthology.orchestra.run.smithi155.stdout: }, 2023-08-01T19:56:02.374 INFO:teuthology.orchestra.run.smithi155.stdout: { 2023-08-01T19:56:02.375 INFO:teuthology.orchestra.run.smithi155.stdout: "event": "header_read", 2023-08-01T19:56:02.375 INFO:teuthology.orchestra.run.smithi155.stdout: "time": "2023-08-01T19:55:05.566665+0000", 2023-08-01T19:56:02.375 INFO:teuthology.orchestra.run.smithi155.stdout: "duration": 4294967295.9999986 2023-08-01T19:56:02.375 INFO:teuthology.orchestra.run.smithi155.stdout: }, 2023-08-01T19:56:02.375 INFO:teuthology.orchestra.run.smithi155.stdout: { 2023-08-01T19:56:02.375 INFO:teuthology.orchestra.run.smithi155.stdout: "event": "all_read", 2023-08-01T19:56:02.375 INFO:teuthology.orchestra.run.smithi155.stdout: "time": "2023-08-01T19:55:05.566754+0000", 2023-08-01T19:56:02.375 INFO:teuthology.orchestra.run.smithi155.stdout: "duration": 8.9425999999999994e-05 2023-08-01T19:56:02.376 INFO:teuthology.orchestra.run.smithi155.stdout: }, 2023-08-01T19:56:02.376 INFO:teuthology.orchestra.run.smithi155.stdout: { 2023-08-01T19:56:02.376 INFO:teuthology.orchestra.run.smithi155.stdout: "event": "dispatched", 2023-08-01T19:56:02.376 INFO:teuthology.orchestra.run.smithi155.stdout: "time": "2023-08-01T19:55:05.566766+0000", 2023-08-01T19:56:02.376 INFO:teuthology.orchestra.run.smithi155.stdout: "duration": 1.2018000000000001e-05 2023-08-01T19:56:02.376 INFO:teuthology.orchestra.run.smithi155.stdout: }, 2023-08-01T19:56:02.376 INFO:teuthology.orchestra.run.smithi155.stdout: { 2023-08-01T19:56:02.376 INFO:teuthology.orchestra.run.smithi155.stdout: "event": "queued_for_pg", 2023-08-01T19:56:02.377 INFO:teuthology.orchestra.run.smithi155.stdout: "time": "2023-08-01T19:55:05.566772+0000", 2023-08-01T19:56:02.377 INFO:teuthology.orchestra.run.smithi155.stdout: "duration": 6.0190000000000003e-06 2023-08-01T19:56:02.377 INFO:teuthology.orchestra.run.smithi155.stdout: }, 2023-08-01T19:56:02.377 INFO:teuthology.orchestra.run.smithi155.stdout: { 2023-08-01T19:56:02.377 INFO:teuthology.orchestra.run.smithi155.stdout: "event": "reached_pg", 2023-08-01T19:56:02.377 INFO:teuthology.orchestra.run.smithi155.stdout: "time": "2023-08-01T19:55:05.566800+0000", 2023-08-01T19:56:02.377 INFO:teuthology.orchestra.run.smithi155.stdout: "duration": 2.7835999999999999e-05 2023-08-01T19:56:02.377 INFO:teuthology.orchestra.run.smithi155.stdout: }, 2023-08-01T19:56:02.378 INFO:teuthology.orchestra.run.smithi155.stdout: { 2023-08-01T19:56:02.378 INFO:teuthology.orchestra.run.smithi155.stdout: "event": "started", 2023-08-01T19:56:02.378 INFO:teuthology.orchestra.run.smithi155.stdout: "time": "2023-08-01T19:55:05.566879+0000", 2023-08-01T19:56:02.378 INFO:teuthology.orchestra.run.smithi155.stdout: "duration": 7.9105999999999998e-05 2023-08-01T19:56:02.378 INFO:teuthology.orchestra.run.smithi155.stdout: }, 2023-08-01T19:56:02.378 INFO:teuthology.orchestra.run.smithi155.stdout: { 2023-08-01T19:56:02.378 INFO:teuthology.orchestra.run.smithi155.stdout: "event": "waiting for subops from 0", 2023-08-01T19:56:02.378 INFO:teuthology.orchestra.run.smithi155.stdout: "time": "2023-08-01T19:55:05.566971+0000", 2023-08-01T19:56:02.379 INFO:teuthology.orchestra.run.smithi155.stdout: "duration": 9.1817999999999994e-05 2023-08-01T19:56:02.379 INFO:teuthology.orchestra.run.smithi155.stdout: }, 2023-08-01T19:56:02.379 INFO:teuthology.orchestra.run.smithi155.stdout: { 2023-08-01T19:56:02.379 INFO:teuthology.orchestra.run.smithi155.stdout: "event": "op_commit", 2023-08-01T19:56:02.379 INFO:teuthology.orchestra.run.smithi155.stdout: "time": "2023-08-01T19:55:05.571475+0000", 2023-08-01T19:56:02.379 INFO:teuthology.orchestra.run.smithi155.stdout: "duration": 0.0045039499999999996 2023-08-01T19:56:02.379 INFO:teuthology.orchestra.run.smithi155.stdout: }, 2023-08-01T19:56:02.379 INFO:teuthology.orchestra.run.smithi155.stdout: { 2023-08-01T19:56:02.380 INFO:teuthology.orchestra.run.smithi155.stdout: "event": "sub_op_commit_rec", 2023-08-01T19:56:02.380 INFO:teuthology.orchestra.run.smithi155.stdout: "time": "2023-08-01T19:55:05.630884+0000", 2023-08-01T19:56:02.380 INFO:teuthology.orchestra.run.smithi155.stdout: "duration": 0.059409181999999998 2023-08-01T19:56:02.380 INFO:teuthology.orchestra.run.smithi155.stdout: }, 2023-08-01T19:56:02.380 INFO:teuthology.orchestra.run.smithi155.stdout: { 2023-08-01T19:56:02.380 INFO:teuthology.orchestra.run.smithi155.stdout: "event": "commit_sent", 2023-08-01T19:56:02.380 INFO:teuthology.orchestra.run.smithi155.stdout: "time": "2023-08-01T19:55:05.630930+0000", 2023-08-01T19:56:02.380 INFO:teuthology.orchestra.run.smithi155.stdout: "duration": 4.5507999999999999e-05 2023-08-01T19:56:02.381 INFO:teuthology.orchestra.run.smithi155.stdout: }, 2023-08-01T19:56:02.381 INFO:teuthology.orchestra.run.smithi155.stdout: { 2023-08-01T19:56:02.381 INFO:teuthology.orchestra.run.smithi155.stdout: "event": "done", 2023-08-01T19:56:02.381 INFO:teuthology.orchestra.run.smithi155.stdout: "time": "2023-08-01T19:55:05.630975+0000", 2023-08-01T19:56:02.381 INFO:teuthology.orchestra.run.smithi155.stdout: "duration": 4.5441000000000001e-05 2023-08-01T19:56:02.381 INFO:teuthology.orchestra.run.smithi155.stdout: } 2023-08-01T19:56:02.381 INFO:teuthology.orchestra.run.smithi155.stdout: ] 2023-08-01T19:56:02.382 INFO:teuthology.orchestra.run.smithi155.stdout: } 2023-08-01T19:56:02.382 INFO:teuthology.orchestra.run.smithi155.stdout: }, 2023-08-01T19:56:02.382 INFO:teuthology.orchestra.run.smithi155.stdout: { 2023-08-01T19:56:02.382 INFO:teuthology.orchestra.run.smithi155.stdout: "description": "osd_op(client.4668.0:100941 5.e 5:736a6ac6:::benchmark_data_smithi006_114134_object100940:head [set-alloc-hint object_size 65536 write_size 65536,write 0~65536] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e37)", 2023-08-01T19:56:02.382 INFO:teuthology.orchestra.run.smithi155.stdout: "initiated_at": "2023-08-01T19:55:05.569750+0000", 2023-08-01T19:56:02.382 INFO:teuthology.orchestra.run.smithi155.stdout: "age": 56.687236378000001, 2023-08-01T19:56:02.382 INFO:teuthology.orchestra.run.smithi155.stdout: "duration": 0.065431331999999995, 2023-08-01T19:56:02.382 INFO:teuthology.orchestra.run.smithi155.stdout: "type_data": { 2023-08-01T19:56:02.383 INFO:teuthology.orchestra.run.smithi155.stdout: "flag_point": "commit sent; apply or cleanup", 2023-08-01T19:56:02.383 INFO:teuthology.orchestra.run.smithi155.stdout: "client_info": { 2023-08-01T19:56:02.383 INFO:teuthology.orchestra.run.smithi155.stdout: "client": "client.4668", 2023-08-01T19:56:02.383 INFO:teuthology.orchestra.run.smithi155.stdout: "client_addr": "172.21.15.6:0/1709472247", 2023-08-01T19:56:02.383 INFO:teuthology.orchestra.run.smithi155.stdout: "tid": 100941 2023-08-01T19:56:02.383 INFO:teuthology.orchestra.run.smithi155.stdout: }, 2023-08-01T19:56:02.383 INFO:teuthology.orchestra.run.smithi155.stdout: "events": [ 2023-08-01T19:56:02.383 INFO:teuthology.orchestra.run.smithi155.stdout: { 2023-08-01T19:56:02.384 INFO:teuthology.orchestra.run.smithi155.stdout: "event": "initiated", 2023-08-01T19:56:02.384 INFO:teuthology.orchestra.run.smithi155.stdout: "time": "2023-08-01T19:55:05.569750+0000", 2023-08-01T19:56:02.384 INFO:teuthology.orchestra.run.smithi155.stdout: "duration": 0 2023-08-01T19:56:02.384 INFO:teuthology.orchestra.run.smithi155.stdout: }, 2023-08-01T19:56:02.384 INFO:teuthology.orchestra.run.smithi155.stdout: { 2023-08-01T19:56:02.384 INFO:teuthology.orchestra.run.smithi155.stdout: "event": "throttled", 2023-08-01T19:56:02.384 INFO:teuthology.orchestra.run.smithi155.stdout: "time": "2023-08-01T19:55:05.569750+0000", 2023-08-01T19:56:02.384 INFO:teuthology.orchestra.run.smithi155.stdout: "duration": 0 2023-08-01T19:56:02.385 INFO:teuthology.orchestra.run.smithi155.stdout: }, 2023-08-01T19:56:02.385 INFO:teuthology.orchestra.run.smithi155.stdout: { 2023-08-01T19:56:02.385 INFO:teuthology.orchestra.run.smithi155.stdout: "event": "header_read", 2023-08-01T19:56:02.385 INFO:teuthology.orchestra.run.smithi155.stdout: "time": "2023-08-01T19:55:05.569749+0000", 2023-08-01T19:56:02.385 INFO:teuthology.orchestra.run.smithi155.stdout: "duration": 4294967295.999999 2023-08-01T19:56:02.385 INFO:teuthology.orchestra.run.smithi155.stdout: }, 2023-08-01T19:56:02.385 INFO:teuthology.orchestra.run.smithi155.stdout: { 2023-08-01T19:56:02.385 INFO:teuthology.orchestra.run.smithi155.stdout: "event": "all_read", 2023-08-01T19:56:02.386 INFO:teuthology.orchestra.run.smithi155.stdout: "time": "2023-08-01T19:55:05.569861+0000", 2023-08-01T19:56:02.386 INFO:teuthology.orchestra.run.smithi155.stdout: "duration": 0.000111333 2023-08-01T19:56:02.386 INFO:teuthology.orchestra.run.smithi155.stdout: }, 2023-08-01T19:56:02.386 INFO:teuthology.orchestra.run.smithi155.stdout: { 2023-08-01T19:56:02.386 INFO:teuthology.orchestra.run.smithi155.stdout: "event": "dispatched", 2023-08-01T19:56:02.386 INFO:teuthology.orchestra.run.smithi155.stdout: "time": "2023-08-01T19:55:05.569869+0000", 2023-08-01T19:56:02.386 INFO:teuthology.orchestra.run.smithi155.stdout: "duration": 8.8589999999999994e-06 2023-08-01T19:56:02.387 INFO:teuthology.orchestra.run.smithi155.stdout: }, 2023-08-01T19:56:02.387 INFO:teuthology.orchestra.run.smithi155.stdout: { 2023-08-01T19:56:02.387 INFO:teuthology.orchestra.run.smithi155.stdout: "event": "queued_for_pg", 2023-08-01T19:56:02.387 INFO:teuthology.orchestra.run.smithi155.stdout: "time": "2023-08-01T19:55:05.569874+0000", 2023-08-01T19:56:02.387 INFO:teuthology.orchestra.run.smithi155.stdout: "duration": 4.1679999999999997e-06 2023-08-01T19:56:02.387 INFO:teuthology.orchestra.run.smithi155.stdout: }, 2023-08-01T19:56:02.387 INFO:teuthology.orchestra.run.smithi155.stdout: { 2023-08-01T19:56:02.387 INFO:teuthology.orchestra.run.smithi155.stdout: "event": "reached_pg", 2023-08-01T19:56:02.388 INFO:teuthology.orchestra.run.smithi155.stdout: "time": "2023-08-01T19:55:05.569904+0000", 2023-08-01T19:56:02.388 INFO:teuthology.orchestra.run.smithi155.stdout: "duration": 3.0920999999999998e-05 2023-08-01T19:56:02.388 INFO:teuthology.orchestra.run.smithi155.stdout: }, 2023-08-01T19:56:02.388 INFO:teuthology.orchestra.run.smithi155.stdout: { 2023-08-01T19:56:02.388 INFO:teuthology.orchestra.run.smithi155.stdout: "event": "started", 2023-08-01T19:56:02.388 INFO:teuthology.orchestra.run.smithi155.stdout: "time": "2023-08-01T19:55:05.569998+0000", 2023-08-01T19:56:02.388 INFO:teuthology.orchestra.run.smithi155.stdout: "duration": 9.3086999999999998e-05 2023-08-01T19:56:02.388 INFO:teuthology.orchestra.run.smithi155.stdout: }, 2023-08-01T19:56:02.389 INFO:teuthology.orchestra.run.smithi155.stdout: { 2023-08-01T19:56:02.389 INFO:teuthology.orchestra.run.smithi155.stdout: "event": "waiting for subops from 0", 2023-08-01T19:56:02.389 INFO:teuthology.orchestra.run.smithi155.stdout: "time": "2023-08-01T19:55:05.570093+0000", 2023-08-01T19:56:02.389 INFO:teuthology.orchestra.run.smithi155.stdout: "duration": 9.5768999999999997e-05 2023-08-01T19:56:02.389 INFO:teuthology.orchestra.run.smithi155.stdout: }, 2023-08-01T19:56:02.389 INFO:teuthology.orchestra.run.smithi155.stdout: { 2023-08-01T19:56:02.389 INFO:teuthology.orchestra.run.smithi155.stdout: "event": "op_commit", 2023-08-01T19:56:02.389 INFO:teuthology.orchestra.run.smithi155.stdout: "time": "2023-08-01T19:55:05.572839+0000", 2023-08-01T19:56:02.390 INFO:teuthology.orchestra.run.smithi155.stdout: "duration": 0.0027460050000000001 2023-08-01T19:56:02.390 INFO:teuthology.orchestra.run.smithi155.stdout: }, 2023-08-01T19:56:02.390 INFO:teuthology.orchestra.run.smithi155.stdout: { 2023-08-01T19:56:02.390 INFO:teuthology.orchestra.run.smithi155.stdout: "event": "sub_op_commit_rec", 2023-08-01T19:56:02.390 INFO:teuthology.orchestra.run.smithi155.stdout: "time": "2023-08-01T19:55:05.635114+0000", 2023-08-01T19:56:02.390 INFO:teuthology.orchestra.run.smithi155.stdout: "duration": 0.062274297999999999 2023-08-01T19:56:02.390 INFO:teuthology.orchestra.run.smithi155.stdout: }, 2023-08-01T19:56:02.390 INFO:teuthology.orchestra.run.smithi155.stdout: { 2023-08-01T19:56:02.391 INFO:teuthology.orchestra.run.smithi155.stdout: "event": "commit_sent", 2023-08-01T19:56:02.391 INFO:teuthology.orchestra.run.smithi155.stdout: "time": "2023-08-01T19:55:05.635143+0000", 2023-08-01T19:56:02.391 INFO:teuthology.orchestra.run.smithi155.stdout: "duration": 2.9430000000000001e-05 2023-08-01T19:56:02.391 INFO:teuthology.orchestra.run.smithi155.stdout: }, 2023-08-01T19:56:02.391 INFO:teuthology.orchestra.run.smithi155.stdout: { 2023-08-01T19:56:02.391 INFO:teuthology.orchestra.run.smithi155.stdout: "event": "done", 2023-08-01T19:56:02.391 INFO:teuthology.orchestra.run.smithi155.stdout: "time": "2023-08-01T19:55:05.635181+0000", 2023-08-01T19:56:02.391 INFO:teuthology.orchestra.run.smithi155.stdout: "duration": 3.8352000000000001e-05 2023-08-01T19:56:02.392 INFO:teuthology.orchestra.run.smithi155.stdout: } 2023-08-01T19:56:02.392 INFO:teuthology.orchestra.run.smithi155.stdout: ] 2023-08-01T19:56:02.392 INFO:teuthology.orchestra.run.smithi155.stdout: } 2023-08-01T19:56:02.392 INFO:teuthology.orchestra.run.smithi155.stdout: }, 2023-08-01T19:56:02.392 INFO:teuthology.orchestra.run.smithi155.stdout: { 2023-08-01T19:56:02.392 INFO:teuthology.orchestra.run.smithi155.stdout: "description": "osd_op(client.4668.0:100945 5.e 5:73df68dd:::benchmark_data_smithi006_114134_object100944:head [set-alloc-hint object_size 65536 write_size 65536,write 0~65536] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e37)", 2023-08-01T19:56:02.392 INFO:teuthology.orchestra.run.smithi155.stdout: "initiated_at": "2023-08-01T19:55:05.576784+0000", 2023-08-01T19:56:02.392 INFO:teuthology.orchestra.run.smithi155.stdout: "age": 56.680202792999999, 2023-08-01T19:56:02.393 INFO:teuthology.orchestra.run.smithi155.stdout: "duration": 0.058512994999999998, 2023-08-01T19:56:02.393 INFO:teuthology.orchestra.run.smithi155.stdout: "type_data": { 2023-08-01T19:56:02.393 INFO:teuthology.orchestra.run.smithi155.stdout: "flag_point": "commit sent; apply or cleanup", 2023-08-01T19:56:02.393 INFO:teuthology.orchestra.run.smithi155.stdout: "client_info": { 2023-08-01T19:56:02.393 INFO:teuthology.orchestra.run.smithi155.stdout: "client": "client.4668", 2023-08-01T19:56:02.393 INFO:teuthology.orchestra.run.smithi155.stdout: "client_addr": "172.21.15.6:0/1709472247", 2023-08-01T19:56:02.393 INFO:teuthology.orchestra.run.smithi155.stdout: "tid": 100945 2023-08-01T19:56:02.394 INFO:teuthology.orchestra.run.smithi155.stdout: }, 2023-08-01T19:56:02.394 INFO:teuthology.orchestra.run.smithi155.stdout: "events": [ 2023-08-01T19:56:02.394 INFO:teuthology.orchestra.run.smithi155.stdout: { 2023-08-01T19:56:02.394 INFO:teuthology.orchestra.run.smithi155.stdout: "event": "initiated", 2023-08-01T19:56:02.394 INFO:teuthology.orchestra.run.smithi155.stdout: "time": "2023-08-01T19:55:05.576784+0000", 2023-08-01T19:56:02.394 INFO:teuthology.orchestra.run.smithi155.stdout: "duration": 0 2023-08-01T19:56:02.394 INFO:teuthology.orchestra.run.smithi155.stdout: }, 2023-08-01T19:56:02.394 INFO:teuthology.orchestra.run.smithi155.stdout: { 2023-08-01T19:56:02.395 INFO:teuthology.orchestra.run.smithi155.stdout: "event": "throttled", 2023-08-01T19:56:02.395 INFO:teuthology.orchestra.run.smithi155.stdout: "time": "2023-08-01T19:55:05.576784+0000", 2023-08-01T19:56:02.395 INFO:teuthology.orchestra.run.smithi155.stdout: "duration": 0 2023-08-01T19:56:02.395 INFO:teuthology.orchestra.run.smithi155.stdout: }, 2023-08-01T19:56:02.395 INFO:teuthology.orchestra.run.smithi155.stdout: { 2023-08-01T19:56:02.395 INFO:teuthology.orchestra.run.smithi155.stdout: "event": "header_read", 2023-08-01T19:56:02.395 INFO:teuthology.orchestra.run.smithi155.stdout: "time": "2023-08-01T19:55:05.576783+0000", 2023-08-01T19:56:02.395 INFO:teuthology.orchestra.run.smithi155.stdout: "duration": 4294967295.9999995 2023-08-01T19:56:02.396 INFO:teuthology.orchestra.run.smithi155.stdout: }, 2023-08-01T19:56:02.396 INFO:teuthology.orchestra.run.smithi155.stdout: { 2023-08-01T19:56:02.396 INFO:teuthology.orchestra.run.smithi155.stdout: "event": "all_read", 2023-08-01T19:56:02.396 INFO:teuthology.orchestra.run.smithi155.stdout: "time": "2023-08-01T19:55:05.576807+0000", 2023-08-01T19:56:02.396 INFO:teuthology.orchestra.run.smithi155.stdout: "duration": 2.3651000000000001e-05 2023-08-01T19:56:02.396 INFO:teuthology.orchestra.run.smithi155.stdout: }, 2023-08-01T19:56:02.396 INFO:teuthology.orchestra.run.smithi155.stdout: { 2023-08-01T19:56:02.396 INFO:teuthology.orchestra.run.smithi155.stdout: "event": "dispatched", 2023-08-01T19:56:02.397 INFO:teuthology.orchestra.run.smithi155.stdout: "time": "2023-08-01T19:55:05.576817+0000", 2023-08-01T19:56:02.397 INFO:teuthology.orchestra.run.smithi155.stdout: "duration": 9.9389999999999992e-06 2023-08-01T19:56:02.397 INFO:teuthology.orchestra.run.smithi155.stdout: }, 2023-08-01T19:56:02.397 INFO:teuthology.orchestra.run.smithi155.stdout: { 2023-08-01T19:56:02.397 INFO:teuthology.orchestra.run.smithi155.stdout: "event": "queued_for_pg", 2023-08-01T19:56:02.397 INFO:teuthology.orchestra.run.smithi155.stdout: "time": "2023-08-01T19:55:05.576820+0000", 2023-08-01T19:56:02.397 INFO:teuthology.orchestra.run.smithi155.stdout: "duration": 3.2619999999999999e-06 2023-08-01T19:56:02.397 INFO:teuthology.orchestra.run.smithi155.stdout: }, 2023-08-01T19:56:02.398 INFO:teuthology.orchestra.run.smithi155.stdout: { 2023-08-01T19:56:02.398 INFO:teuthology.orchestra.run.smithi155.stdout: "event": "reached_pg", 2023-08-01T19:56:02.398 INFO:teuthology.orchestra.run.smithi155.stdout: "time": "2023-08-01T19:55:05.576849+0000", 2023-08-01T19:56:02.398 INFO:teuthology.orchestra.run.smithi155.stdout: "duration": 2.8880000000000001e-05 2023-08-01T19:56:02.398 INFO:teuthology.orchestra.run.smithi155.stdout: }, 2023-08-01T19:56:02.398 INFO:teuthology.orchestra.run.smithi155.stdout: { 2023-08-01T19:56:02.398 INFO:teuthology.orchestra.run.smithi155.stdout: "event": "started", 2023-08-01T19:56:02.398 INFO:teuthology.orchestra.run.smithi155.stdout: "time": "2023-08-01T19:55:05.576940+0000", 2023-08-01T19:56:02.399 INFO:teuthology.orchestra.run.smithi155.stdout: "duration": 9.0570999999999997e-05 2023-08-01T19:56:02.399 INFO:teuthology.orchestra.run.smithi155.stdout: }, 2023-08-01T19:56:02.399 INFO:teuthology.orchestra.run.smithi155.stdout: { 2023-08-01T19:56:02.399 INFO:teuthology.orchestra.run.smithi155.stdout: "event": "waiting for subops from 0", 2023-08-01T19:56:02.399 INFO:teuthology.orchestra.run.smithi155.stdout: "time": "2023-08-01T19:55:05.577027+0000", 2023-08-01T19:56:02.399 INFO:teuthology.orchestra.run.smithi155.stdout: "duration": 8.7237999999999994e-05 2023-08-01T19:56:02.399 INFO:teuthology.orchestra.run.smithi155.stdout: }, 2023-08-01T19:56:02.399 INFO:teuthology.orchestra.run.smithi155.stdout: { 2023-08-01T19:56:02.400 INFO:teuthology.orchestra.run.smithi155.stdout: "event": "op_commit", 2023-08-01T19:56:02.400 INFO:teuthology.orchestra.run.smithi155.stdout: "time": "2023-08-01T19:55:05.579624+0000", 2023-08-01T19:56:02.400 INFO:teuthology.orchestra.run.smithi155.stdout: "duration": 0.0025971200000000001 2023-08-01T19:56:02.400 INFO:teuthology.orchestra.run.smithi155.stdout: }, 2023-08-01T19:56:02.400 INFO:teuthology.orchestra.run.smithi155.stdout: { 2023-08-01T19:56:02.400 INFO:teuthology.orchestra.run.smithi155.stdout: "event": "sub_op_commit_rec", 2023-08-01T19:56:02.400 INFO:teuthology.orchestra.run.smithi155.stdout: "time": "2023-08-01T19:55:05.635218+0000", 2023-08-01T19:56:02.401 INFO:teuthology.orchestra.run.smithi155.stdout: "duration": 0.055594487999999997 2023-08-01T19:56:02.401 INFO:teuthology.orchestra.run.smithi155.stdout: }, 2023-08-01T19:56:02.401 INFO:teuthology.orchestra.run.smithi155.stdout: { 2023-08-01T19:56:02.401 INFO:teuthology.orchestra.run.smithi155.stdout: "event": "commit_sent", 2023-08-01T19:56:02.401 INFO:teuthology.orchestra.run.smithi155.stdout: "time": "2023-08-01T19:55:05.635262+0000", 2023-08-01T19:56:02.401 INFO:teuthology.orchestra.run.smithi155.stdout: "duration": 4.3380999999999997e-05 2023-08-01T19:56:02.401 INFO:teuthology.orchestra.run.smithi155.stdout: }, 2023-08-01T19:56:02.401 INFO:teuthology.orchestra.run.smithi155.stdout: { 2023-08-01T19:56:02.402 INFO:teuthology.orchestra.run.smithi155.stdout: "event": "done", 2023-08-01T19:56:02.402 INFO:teuthology.orchestra.run.smithi155.stdout: "time": "2023-08-01T19:55:05.635297+0000", 2023-08-01T19:56:02.402 INFO:teuthology.orchestra.run.smithi155.stdout: "duration": 3.4842000000000003e-05 2023-08-01T19:56:02.402 INFO:teuthology.orchestra.run.smithi155.stdout: } 2023-08-01T19:56:02.402 INFO:teuthology.orchestra.run.smithi155.stdout: ] 2023-08-01T19:56:02.402 INFO:teuthology.orchestra.run.smithi155.stdout: } 2023-08-01T19:56:02.402 INFO:teuthology.orchestra.run.smithi155.stdout: }, 2023-08-01T19:56:02.402 INFO:teuthology.orchestra.run.smithi155.stdout: { 2023-08-01T19:56:02.403 INFO:teuthology.orchestra.run.smithi155.stdout: "description": "osd_op(client.4668.0:100947 5.4 5:23e8fc27:::benchmark_data_smithi006_114134_object100946:head [set-alloc-hint object_size 65536 write_size 65536,write 0~65536] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e37)", 2023-08-01T19:56:02.403 INFO:teuthology.orchestra.run.smithi155.stdout: "initiated_at": "2023-08-01T19:55:05.576840+0000", 2023-08-01T19:56:02.403 INFO:teuthology.orchestra.run.smithi155.stdout: "age": 56.680146737999998, 2023-08-01T19:56:02.403 INFO:teuthology.orchestra.run.smithi155.stdout: "duration": 0.058423127999999998, 2023-08-01T19:56:02.403 INFO:teuthology.orchestra.run.smithi155.stdout: "type_data": { 2023-08-01T19:56:02.403 INFO:teuthology.orchestra.run.smithi155.stdout: "flag_point": "commit sent; apply or cleanup", 2023-08-01T19:56:02.403 INFO:teuthology.orchestra.run.smithi155.stdout: "client_info": { 2023-08-01T19:56:02.403 INFO:teuthology.orchestra.run.smithi155.stdout: "client": "client.4668", 2023-08-01T19:56:02.404 INFO:teuthology.orchestra.run.smithi155.stdout: "client_addr": "172.21.15.6:0/1709472247", 2023-08-01T19:56:02.404 INFO:teuthology.orchestra.run.smithi155.stdout: "tid": 100947 2023-08-01T19:56:02.404 INFO:teuthology.orchestra.run.smithi155.stdout: }, 2023-08-01T19:56:02.404 INFO:teuthology.orchestra.run.smithi155.stdout: "events": [ 2023-08-01T19:56:02.404 INFO:teuthology.orchestra.run.smithi155.stdout: { 2023-08-01T19:56:02.404 INFO:teuthology.orchestra.run.smithi155.stdout: "event": "initiated", 2023-08-01T19:56:02.404 INFO:teuthology.orchestra.run.smithi155.stdout: "time": "2023-08-01T19:55:05.576840+0000", 2023-08-01T19:56:02.404 INFO:teuthology.orchestra.run.smithi155.stdout: "duration": 0 2023-08-01T19:56:02.405 INFO:teuthology.orchestra.run.smithi155.stdout: }, 2023-08-01T19:56:02.405 INFO:teuthology.orchestra.run.smithi155.stdout: { 2023-08-01T19:56:02.405 INFO:teuthology.orchestra.run.smithi155.stdout: "event": "throttled", 2023-08-01T19:56:02.405 INFO:teuthology.orchestra.run.smithi155.stdout: "time": "2023-08-01T19:55:05.576840+0000", 2023-08-01T19:56:02.405 INFO:teuthology.orchestra.run.smithi155.stdout: "duration": 0 2023-08-01T19:56:02.405 INFO:teuthology.orchestra.run.smithi155.stdout: }, 2023-08-01T19:56:02.405 INFO:teuthology.orchestra.run.smithi155.stdout: { 2023-08-01T19:56:02.406 INFO:teuthology.orchestra.run.smithi155.stdout: "event": "header_read", 2023-08-01T19:56:02.406 INFO:teuthology.orchestra.run.smithi155.stdout: "time": "2023-08-01T19:55:05.576839+0000", 2023-08-01T19:56:02.406 INFO:teuthology.orchestra.run.smithi155.stdout: "duration": 4294967295.9999995 2023-08-01T19:56:02.406 INFO:teuthology.orchestra.run.smithi155.stdout: }, 2023-08-01T19:56:02.406 INFO:teuthology.orchestra.run.smithi155.stdout: { 2023-08-01T19:56:02.406 INFO:teuthology.orchestra.run.smithi155.stdout: "event": "all_read", 2023-08-01T19:56:02.406 INFO:teuthology.orchestra.run.smithi155.stdout: "time": "2023-08-01T19:55:05.576893+0000", 2023-08-01T19:56:02.406 INFO:teuthology.orchestra.run.smithi155.stdout: "duration": 5.3893000000000001e-05 2023-08-01T19:56:02.407 INFO:teuthology.orchestra.run.smithi155.stdout: }, 2023-08-01T19:56:02.407 INFO:teuthology.orchestra.run.smithi155.stdout: { 2023-08-01T19:56:02.407 INFO:teuthology.orchestra.run.smithi155.stdout: "event": "dispatched", 2023-08-01T19:56:02.407 INFO:teuthology.orchestra.run.smithi155.stdout: "time": "2023-08-01T19:55:05.576902+0000", 2023-08-01T19:56:02.407 INFO:teuthology.orchestra.run.smithi155.stdout: "duration": 8.7520000000000002e-06 2023-08-01T19:56:02.407 INFO:teuthology.orchestra.run.smithi155.stdout: }, 2023-08-01T19:56:02.407 INFO:teuthology.orchestra.run.smithi155.stdout: { 2023-08-01T19:56:02.407 INFO:teuthology.orchestra.run.smithi155.stdout: "event": "queued_for_pg", 2023-08-01T19:56:02.408 INFO:teuthology.orchestra.run.smithi155.stdout: "time": "2023-08-01T19:55:05.576905+0000", 2023-08-01T19:56:02.408 INFO:teuthology.orchestra.run.smithi155.stdout: "duration": 3.01e-06 2023-08-01T19:56:02.408 INFO:teuthology.orchestra.run.smithi155.stdout: }, 2023-08-01T19:56:02.408 INFO:teuthology.orchestra.run.smithi155.stdout: { 2023-08-01T19:56:02.408 INFO:teuthology.orchestra.run.smithi155.stdout: "event": "reached_pg", 2023-08-01T19:56:02.408 INFO:teuthology.orchestra.run.smithi155.stdout: "time": "2023-08-01T19:55:05.579641+0000", 2023-08-01T19:56:02.408 INFO:teuthology.orchestra.run.smithi155.stdout: "duration": 0.0027366880000000001 2023-08-01T19:56:02.408 INFO:teuthology.orchestra.run.smithi155.stdout: }, 2023-08-01T19:56:02.409 INFO:teuthology.orchestra.run.smithi155.stdout: { 2023-08-01T19:56:02.409 INFO:teuthology.orchestra.run.smithi155.stdout: "event": "started", 2023-08-01T19:56:02.409 INFO:teuthology.orchestra.run.smithi155.stdout: "time": "2023-08-01T19:55:05.579734+0000", 2023-08-01T19:56:02.409 INFO:teuthology.orchestra.run.smithi155.stdout: "duration": 9.2590000000000006e-05 2023-08-01T19:56:02.409 INFO:teuthology.orchestra.run.smithi155.stdout: }, 2023-08-01T19:56:02.409 INFO:teuthology.orchestra.run.smithi155.stdout: { 2023-08-01T19:56:02.409 INFO:teuthology.orchestra.run.smithi155.stdout: "event": "waiting for subops from 0", 2023-08-01T19:56:02.410 INFO:teuthology.orchestra.run.smithi155.stdout: "time": "2023-08-01T19:55:05.579825+0000", 2023-08-01T19:56:02.410 INFO:teuthology.orchestra.run.smithi155.stdout: "duration": 9.0964999999999994e-05 2023-08-01T19:56:02.410 INFO:teuthology.orchestra.run.smithi155.stdout: }, 2023-08-01T19:56:02.410 INFO:teuthology.orchestra.run.smithi155.stdout: { 2023-08-01T19:56:02.410 INFO:teuthology.orchestra.run.smithi155.stdout: "event": "op_commit", 2023-08-01T19:56:02.410 INFO:teuthology.orchestra.run.smithi155.stdout: "time": "2023-08-01T19:55:05.585041+0000", 2023-08-01T19:56:02.410 INFO:teuthology.orchestra.run.smithi155.stdout: "duration": 0.0052159670000000002 2023-08-01T19:56:02.410 INFO:teuthology.orchestra.run.smithi155.stdout: }, 2023-08-01T19:56:02.411 INFO:teuthology.orchestra.run.smithi155.stdout: { 2023-08-01T19:56:02.411 INFO:teuthology.orchestra.run.smithi155.stdout: "event": "sub_op_commit_rec", 2023-08-01T19:56:02.411 INFO:teuthology.orchestra.run.smithi155.stdout: "time": "2023-08-01T19:55:05.635199+0000", 2023-08-01T19:56:02.411 INFO:teuthology.orchestra.run.smithi155.stdout: "duration": 0.050158023000000003 2023-08-01T19:56:02.411 INFO:teuthology.orchestra.run.smithi155.stdout: }, 2023-08-01T19:56:02.411 INFO:teuthology.orchestra.run.smithi155.stdout: { 2023-08-01T19:56:02.411 INFO:teuthology.orchestra.run.smithi155.stdout: "event": "commit_sent", 2023-08-01T19:56:02.411 INFO:teuthology.orchestra.run.smithi155.stdout: "time": "2023-08-01T19:55:05.635227+0000", 2023-08-01T19:56:02.412 INFO:teuthology.orchestra.run.smithi155.stdout: "duration": 2.7821e-05 2023-08-01T19:56:02.412 INFO:teuthology.orchestra.run.smithi155.stdout: }, 2023-08-01T19:56:02.412 INFO:teuthology.orchestra.run.smithi155.stdout: { 2023-08-01T19:56:02.412 INFO:teuthology.orchestra.run.smithi155.stdout: "event": "done", 2023-08-01T19:56:02.412 INFO:teuthology.orchestra.run.smithi155.stdout: "time": "2023-08-01T19:55:05.635263+0000", 2023-08-01T19:56:02.412 INFO:teuthology.orchestra.run.smithi155.stdout: "duration": 3.6081000000000002e-05 2023-08-01T19:56:02.412 INFO:teuthology.orchestra.run.smithi155.stdout: } 2023-08-01T19:56:02.412 INFO:teuthology.orchestra.run.smithi155.stdout: ] 2023-08-01T19:56:02.413 INFO:teuthology.orchestra.run.smithi155.stdout: } 2023-08-01T19:56:02.413 INFO:teuthology.orchestra.run.smithi155.stdout: }, 2023-08-01T19:56:02.413 INFO:teuthology.orchestra.run.smithi155.stdout: { 2023-08-01T19:56:02.413 INFO:teuthology.orchestra.run.smithi155.stdout: "description": "osd_op(client.4668.0:197408 5.d 5:bbda375a:::benchmark_data_smithi006_114134_object63747:head [delete] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e61)", 2023-08-01T19:56:02.413 INFO:teuthology.orchestra.run.smithi155.stdout: "initiated_at": "2023-08-01T19:55:58.559714+0000", 2023-08-01T19:56:02.413 INFO:teuthology.orchestra.run.smithi155.stdout: "age": 3.6972727509999999, 2023-08-01T19:56:02.413 INFO:teuthology.orchestra.run.smithi155.stdout: "duration": 1.047043671, 2023-08-01T19:56:02.413 INFO:teuthology.orchestra.run.smithi155.stdout: "type_data": { 2023-08-01T19:56:02.414 INFO:teuthology.orchestra.run.smithi155.stdout: "flag_point": "commit sent; apply or cleanup", 2023-08-01T19:56:02.414 INFO:teuthology.orchestra.run.smithi155.stdout: "client_info": { 2023-08-01T19:56:02.414 INFO:teuthology.orchestra.run.smithi155.stdout: "client": "client.4668", 2023-08-01T19:56:02.414 INFO:teuthology.orchestra.run.smithi155.stdout: "client_addr": "172.21.15.6:0/1709472247", 2023-08-01T19:56:02.414 INFO:teuthology.orchestra.run.smithi155.stdout: "tid": 197408 2023-08-01T19:56:02.414 INFO:teuthology.orchestra.run.smithi155.stdout: }, 2023-08-01T19:56:02.414 INFO:teuthology.orchestra.run.smithi155.stdout: "events": [ 2023-08-01T19:56:02.414 INFO:teuthology.orchestra.run.smithi155.stdout: { 2023-08-01T19:56:02.415 INFO:teuthology.orchestra.run.smithi155.stdout: "event": "initiated", 2023-08-01T19:56:02.415 INFO:teuthology.orchestra.run.smithi155.stdout: "time": "2023-08-01T19:55:58.559714+0000", 2023-08-01T19:56:02.415 INFO:teuthology.orchestra.run.smithi155.stdout: "duration": 0 2023-08-01T19:56:02.415 INFO:teuthology.orchestra.run.smithi155.stdout: }, 2023-08-01T19:56:02.415 INFO:teuthology.orchestra.run.smithi155.stdout: { 2023-08-01T19:56:02.415 INFO:teuthology.orchestra.run.smithi155.stdout: "event": "throttled", 2023-08-01T19:56:02.415 INFO:teuthology.orchestra.run.smithi155.stdout: "time": "2023-08-01T19:55:58.559714+0000", 2023-08-01T19:56:02.415 INFO:teuthology.orchestra.run.smithi155.stdout: "duration": 0 2023-08-01T19:56:02.416 INFO:teuthology.orchestra.run.smithi155.stdout: }, 2023-08-01T19:56:02.416 INFO:teuthology.orchestra.run.smithi155.stdout: { 2023-08-01T19:56:02.416 INFO:teuthology.orchestra.run.smithi155.stdout: "event": "header_read", 2023-08-01T19:56:02.416 INFO:teuthology.orchestra.run.smithi155.stdout: "time": "2023-08-01T19:55:58.559713+0000", 2023-08-01T19:56:02.416 INFO:teuthology.orchestra.run.smithi155.stdout: "duration": 4294967295.999999 2023-08-01T19:56:02.416 INFO:teuthology.orchestra.run.smithi155.stdout: }, 2023-08-01T19:56:02.416 INFO:teuthology.orchestra.run.smithi155.stdout: { 2023-08-01T19:56:02.417 INFO:teuthology.orchestra.run.smithi155.stdout: "event": "all_read", 2023-08-01T19:56:02.417 INFO:teuthology.orchestra.run.smithi155.stdout: "time": "2023-08-01T19:55:58.559717+0000", 2023-08-01T19:56:02.417 INFO:teuthology.orchestra.run.smithi155.stdout: "duration": 4.2860000000000001e-06 2023-08-01T19:56:02.417 INFO:teuthology.orchestra.run.smithi155.stdout: }, 2023-08-01T19:56:02.417 INFO:teuthology.orchestra.run.smithi155.stdout: { 2023-08-01T19:56:02.417 INFO:teuthology.orchestra.run.smithi155.stdout: "event": "dispatched", 2023-08-01T19:56:02.417 INFO:teuthology.orchestra.run.smithi155.stdout: "time": "2023-08-01T19:55:58.559774+0000", 2023-08-01T19:56:02.417 INFO:teuthology.orchestra.run.smithi155.stdout: "duration": 5.6508999999999997e-05 2023-08-01T19:56:02.418 INFO:teuthology.orchestra.run.smithi155.stdout: }, 2023-08-01T19:56:02.418 INFO:teuthology.orchestra.run.smithi155.stdout: { 2023-08-01T19:56:02.418 INFO:teuthology.orchestra.run.smithi155.stdout: "event": "queued_for_pg", 2023-08-01T19:56:02.418 INFO:teuthology.orchestra.run.smithi155.stdout: "time": "2023-08-01T19:55:58.559781+0000", 2023-08-01T19:56:02.418 INFO:teuthology.orchestra.run.smithi155.stdout: "duration": 7.1829999999999997e-06 2023-08-01T19:56:02.418 INFO:teuthology.orchestra.run.smithi155.stdout: }, 2023-08-01T19:56:02.418 INFO:teuthology.orchestra.run.smithi155.stdout: { 2023-08-01T19:56:02.418 INFO:teuthology.orchestra.run.smithi155.stdout: "event": "reached_pg", 2023-08-01T19:56:02.419 INFO:teuthology.orchestra.run.smithi155.stdout: "time": "2023-08-01T19:55:58.571621+0000", 2023-08-01T19:56:02.419 INFO:teuthology.orchestra.run.smithi155.stdout: "duration": 0.011840603999999999 2023-08-01T19:56:02.419 INFO:teuthology.orchestra.run.smithi155.stdout: }, 2023-08-01T19:56:02.419 INFO:teuthology.orchestra.run.smithi155.stdout: { 2023-08-01T19:56:02.419 INFO:teuthology.orchestra.run.smithi155.stdout: "event": "waiting for peered", 2023-08-01T19:56:02.419 INFO:teuthology.orchestra.run.smithi155.stdout: "time": "2023-08-01T19:55:58.571630+0000", 2023-08-01T19:56:02.419 INFO:teuthology.orchestra.run.smithi155.stdout: "duration": 8.9770000000000006e-06 2023-08-01T19:56:02.419 INFO:teuthology.orchestra.run.smithi155.stdout: }, 2023-08-01T19:56:02.420 INFO:teuthology.orchestra.run.smithi155.stdout: { 2023-08-01T19:56:02.420 INFO:teuthology.orchestra.run.smithi155.stdout: "event": "reached_pg", 2023-08-01T19:56:02.420 INFO:teuthology.orchestra.run.smithi155.stdout: "time": "2023-08-01T19:55:59.601300+0000", 2023-08-01T19:56:02.420 INFO:teuthology.orchestra.run.smithi155.stdout: "duration": 1.0296694989999999 2023-08-01T19:56:02.420 INFO:teuthology.orchestra.run.smithi155.stdout: }, 2023-08-01T19:56:02.420 INFO:teuthology.orchestra.run.smithi155.stdout: { 2023-08-01T19:56:02.420 INFO:teuthology.orchestra.run.smithi155.stdout: "event": "started", 2023-08-01T19:56:02.420 INFO:teuthology.orchestra.run.smithi155.stdout: "time": "2023-08-01T19:55:59.601448+0000", 2023-08-01T19:56:02.421 INFO:teuthology.orchestra.run.smithi155.stdout: "duration": 0.00014828399999999999 2023-08-01T19:56:02.421 INFO:teuthology.orchestra.run.smithi155.stdout: }, 2023-08-01T19:56:02.421 INFO:teuthology.orchestra.run.smithi155.stdout: { 2023-08-01T19:56:02.421 INFO:teuthology.orchestra.run.smithi155.stdout: "event": "op_commit", 2023-08-01T19:56:02.421 INFO:teuthology.orchestra.run.smithi155.stdout: "time": "2023-08-01T19:55:59.606616+0000", 2023-08-01T19:56:02.421 INFO:teuthology.orchestra.run.smithi155.stdout: "duration": 0.0051679769999999998 2023-08-01T19:56:02.421 INFO:teuthology.orchestra.run.smithi155.stdout: }, 2023-08-01T19:56:02.421 INFO:teuthology.orchestra.run.smithi155.stdout: { 2023-08-01T19:56:02.422 INFO:teuthology.orchestra.run.smithi155.stdout: "event": "commit_sent", 2023-08-01T19:56:02.422 INFO:teuthology.orchestra.run.smithi155.stdout: "time": "2023-08-01T19:55:59.606662+0000", 2023-08-01T19:56:02.422 INFO:teuthology.orchestra.run.smithi155.stdout: "duration": 4.5843000000000001e-05 2023-08-01T19:56:02.422 INFO:teuthology.orchestra.run.smithi155.stdout: }, 2023-08-01T19:56:02.422 INFO:teuthology.orchestra.run.smithi155.stdout: { 2023-08-01T19:56:02.422 INFO:teuthology.orchestra.run.smithi155.stdout: "event": "done", 2023-08-01T19:56:02.422 INFO:teuthology.orchestra.run.smithi155.stdout: "time": "2023-08-01T19:55:59.606757+0000", 2023-08-01T19:56:02.422 INFO:teuthology.orchestra.run.smithi155.stdout: "duration": 9.5373999999999999e-05 2023-08-01T19:56:02.423 INFO:teuthology.orchestra.run.smithi155.stdout: } 2023-08-01T19:56:02.423 INFO:teuthology.orchestra.run.smithi155.stdout: ] 2023-08-01T19:56:02.423 INFO:teuthology.orchestra.run.smithi155.stdout: } 2023-08-01T19:56:02.423 INFO:teuthology.orchestra.run.smithi155.stdout: }, 2023-08-01T19:56:02.423 INFO:teuthology.orchestra.run.smithi155.stdout: { 2023-08-01T19:56:02.423 INFO:teuthology.orchestra.run.smithi155.stdout: "description": "osd_op(client.4668.0:197416 5.d 5:bd99e66d:::benchmark_data_smithi006_114134_object63755:head [delete] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e62)", 2023-08-01T19:56:02.423 INFO:teuthology.orchestra.run.smithi155.stdout: "initiated_at": "2023-08-01T19:55:58.577369+0000", 2023-08-01T19:56:02.423 INFO:teuthology.orchestra.run.smithi155.stdout: "age": 3.679617774, 2023-08-01T19:56:02.424 INFO:teuthology.orchestra.run.smithi155.stdout: "duration": 1.0300980120000001, 2023-08-01T19:56:02.424 INFO:teuthology.orchestra.run.smithi155.stdout: "type_data": { 2023-08-01T19:56:02.424 INFO:teuthology.orchestra.run.smithi155.stdout: "flag_point": "commit sent; apply or cleanup", 2023-08-01T19:56:02.424 INFO:teuthology.orchestra.run.smithi155.stdout: "client_info": { 2023-08-01T19:56:02.424 INFO:teuthology.orchestra.run.smithi155.stdout: "client": "client.4668", 2023-08-01T19:56:02.424 INFO:teuthology.orchestra.run.smithi155.stdout: "client_addr": "172.21.15.6:0/1709472247", 2023-08-01T19:56:02.424 INFO:teuthology.orchestra.run.smithi155.stdout: "tid": 197416 2023-08-01T19:56:02.425 INFO:teuthology.orchestra.run.smithi155.stdout: }, 2023-08-01T19:56:02.425 INFO:teuthology.orchestra.run.smithi155.stdout: "events": [ 2023-08-01T19:56:02.425 INFO:teuthology.orchestra.run.smithi155.stdout: { 2023-08-01T19:56:02.425 INFO:teuthology.orchestra.run.smithi155.stdout: "event": "initiated", 2023-08-01T19:56:02.425 INFO:teuthology.orchestra.run.smithi155.stdout: "time": "2023-08-01T19:55:58.577369+0000", 2023-08-01T19:56:02.425 INFO:teuthology.orchestra.run.smithi155.stdout: "duration": 0 2023-08-01T19:56:02.425 INFO:teuthology.orchestra.run.smithi155.stdout: }, 2023-08-01T19:56:02.425 INFO:teuthology.orchestra.run.smithi155.stdout: { 2023-08-01T19:56:02.426 INFO:teuthology.orchestra.run.smithi155.stdout: "event": "throttled", 2023-08-01T19:56:02.426 INFO:teuthology.orchestra.run.smithi155.stdout: "time": "2023-08-01T19:55:58.577369+0000", 2023-08-01T19:56:02.426 INFO:teuthology.orchestra.run.smithi155.stdout: "duration": 0 2023-08-01T19:56:02.426 INFO:teuthology.orchestra.run.smithi155.stdout: }, 2023-08-01T19:56:02.426 INFO:teuthology.orchestra.run.smithi155.stdout: { 2023-08-01T19:56:02.426 INFO:teuthology.orchestra.run.smithi155.stdout: "event": "header_read", 2023-08-01T19:56:02.426 INFO:teuthology.orchestra.run.smithi155.stdout: "time": "2023-08-01T19:55:58.577368+0000", 2023-08-01T19:56:02.426 INFO:teuthology.orchestra.run.smithi155.stdout: "duration": 4294967295.9999995 2023-08-01T19:56:02.427 INFO:teuthology.orchestra.run.smithi155.stdout: }, 2023-08-01T19:56:02.427 INFO:teuthology.orchestra.run.smithi155.stdout: { 2023-08-01T19:56:02.427 INFO:teuthology.orchestra.run.smithi155.stdout: "event": "all_read", 2023-08-01T19:56:02.427 INFO:teuthology.orchestra.run.smithi155.stdout: "time": "2023-08-01T19:55:58.577370+0000", 2023-08-01T19:56:02.427 INFO:teuthology.orchestra.run.smithi155.stdout: "duration": 2.1150000000000001e-06 2023-08-01T19:56:02.427 INFO:teuthology.orchestra.run.smithi155.stdout: }, 2023-08-01T19:56:02.427 INFO:teuthology.orchestra.run.smithi155.stdout: { 2023-08-01T19:56:02.427 INFO:teuthology.orchestra.run.smithi155.stdout: "event": "dispatched", 2023-08-01T19:56:02.428 INFO:teuthology.orchestra.run.smithi155.stdout: "time": "2023-08-01T19:55:58.577377+0000", 2023-08-01T19:56:02.428 INFO:teuthology.orchestra.run.smithi155.stdout: "duration": 6.6610000000000003e-06 2023-08-01T19:56:02.428 INFO:teuthology.orchestra.run.smithi155.stdout: }, 2023-08-01T19:56:02.428 INFO:teuthology.orchestra.run.smithi155.stdout: { 2023-08-01T19:56:02.428 INFO:teuthology.orchestra.run.smithi155.stdout: "event": "queued_for_pg", 2023-08-01T19:56:02.428 INFO:teuthology.orchestra.run.smithi155.stdout: "time": "2023-08-01T19:55:58.577380+0000", 2023-08-01T19:56:02.428 INFO:teuthology.orchestra.run.smithi155.stdout: "duration": 2.7360000000000001e-06 2023-08-01T19:56:02.428 INFO:teuthology.orchestra.run.smithi155.stdout: }, 2023-08-01T19:56:02.429 INFO:teuthology.orchestra.run.smithi155.stdout: { 2023-08-01T19:56:02.429 INFO:teuthology.orchestra.run.smithi155.stdout: "event": "reached_pg", 2023-08-01T19:56:02.429 INFO:teuthology.orchestra.run.smithi155.stdout: "time": "2023-08-01T19:55:58.577405+0000", 2023-08-01T19:56:02.429 INFO:teuthology.orchestra.run.smithi155.stdout: "duration": 2.4929000000000001e-05 2023-08-01T19:56:02.429 INFO:teuthology.orchestra.run.smithi155.stdout: }, 2023-08-01T19:56:02.429 INFO:teuthology.orchestra.run.smithi155.stdout: { 2023-08-01T19:56:02.429 INFO:teuthology.orchestra.run.smithi155.stdout: "event": "waiting for peered", 2023-08-01T19:56:02.429 INFO:teuthology.orchestra.run.smithi155.stdout: "time": "2023-08-01T19:55:58.577409+0000", 2023-08-01T19:56:02.430 INFO:teuthology.orchestra.run.smithi155.stdout: "duration": 4.0799999999999999e-06 2023-08-01T19:56:02.430 INFO:teuthology.orchestra.run.smithi155.stdout: }, 2023-08-01T19:56:02.430 INFO:teuthology.orchestra.run.smithi155.stdout: { 2023-08-01T19:56:02.430 INFO:teuthology.orchestra.run.smithi155.stdout: "event": "reached_pg", 2023-08-01T19:56:02.430 INFO:teuthology.orchestra.run.smithi155.stdout: "time": "2023-08-01T19:55:59.603639+0000", 2023-08-01T19:56:02.430 INFO:teuthology.orchestra.run.smithi155.stdout: "duration": 1.0262299349999999 2023-08-01T19:56:02.430 INFO:teuthology.orchestra.run.smithi155.stdout: }, 2023-08-01T19:56:02.431 INFO:teuthology.orchestra.run.smithi155.stdout: { 2023-08-01T19:56:02.431 INFO:teuthology.orchestra.run.smithi155.stdout: "event": "started", 2023-08-01T19:56:02.431 INFO:teuthology.orchestra.run.smithi155.stdout: "time": "2023-08-01T19:55:59.603772+0000", 2023-08-01T19:56:02.431 INFO:teuthology.orchestra.run.smithi155.stdout: "duration": 0.000133153 2023-08-01T19:56:02.431 INFO:teuthology.orchestra.run.smithi155.stdout: }, 2023-08-01T19:56:02.431 INFO:teuthology.orchestra.run.smithi155.stdout: { 2023-08-01T19:56:02.431 INFO:teuthology.orchestra.run.smithi155.stdout: "event": "op_commit", 2023-08-01T19:56:02.431 INFO:teuthology.orchestra.run.smithi155.stdout: "time": "2023-08-01T19:55:59.607354+0000", 2023-08-01T19:56:02.432 INFO:teuthology.orchestra.run.smithi155.stdout: "duration": 0.0035819599999999999 2023-08-01T19:56:02.432 INFO:teuthology.orchestra.run.smithi155.stdout: }, 2023-08-01T19:56:02.432 INFO:teuthology.orchestra.run.smithi155.stdout: { 2023-08-01T19:56:02.432 INFO:teuthology.orchestra.run.smithi155.stdout: "event": "commit_sent", 2023-08-01T19:56:02.432 INFO:teuthology.orchestra.run.smithi155.stdout: "time": "2023-08-01T19:55:59.607396+0000", 2023-08-01T19:56:02.432 INFO:teuthology.orchestra.run.smithi155.stdout: "duration": 4.2423999999999999e-05 2023-08-01T19:56:02.432 INFO:teuthology.orchestra.run.smithi155.stdout: }, 2023-08-01T19:56:02.432 INFO:teuthology.orchestra.run.smithi155.stdout: { 2023-08-01T19:56:02.433 INFO:teuthology.orchestra.run.smithi155.stdout: "event": "done", 2023-08-01T19:56:02.433 INFO:teuthology.orchestra.run.smithi155.stdout: "time": "2023-08-01T19:55:59.607467+0000", 2023-08-01T19:56:02.433 INFO:teuthology.orchestra.run.smithi155.stdout: "duration": 7.0360999999999999e-05 2023-08-01T19:56:02.433 INFO:teuthology.orchestra.run.smithi155.stdout: } 2023-08-01T19:56:02.433 INFO:teuthology.orchestra.run.smithi155.stdout: ] 2023-08-01T19:56:02.433 INFO:teuthology.orchestra.run.smithi155.stdout: } 2023-08-01T19:56:02.433 INFO:teuthology.orchestra.run.smithi155.stdout: }, 2023-08-01T19:56:02.433 INFO:teuthology.orchestra.run.smithi155.stdout: { 2023-08-01T19:56:02.434 INFO:teuthology.orchestra.run.smithi155.stdout: "description": "osd_op(client.4668.0:197419 5.d 5:be7dc7c9:::benchmark_data_smithi006_114134_object63758:head [delete] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e62)", 2023-08-01T19:56:02.434 INFO:teuthology.orchestra.run.smithi155.stdout: "initiated_at": "2023-08-01T19:55:58.580223+0000", 2023-08-01T19:56:02.434 INFO:teuthology.orchestra.run.smithi155.stdout: "age": 3.6767638229999999, 2023-08-01T19:56:02.434 INFO:teuthology.orchestra.run.smithi155.stdout: "duration": 1.0286139439999999, 2023-08-01T19:56:02.434 INFO:teuthology.orchestra.run.smithi155.stdout: "type_data": { 2023-08-01T19:56:02.434 INFO:teuthology.orchestra.run.smithi155.stdout: "flag_point": "commit sent; apply or cleanup", 2023-08-01T19:56:02.434 INFO:teuthology.orchestra.run.smithi155.stdout: "client_info": { 2023-08-01T19:56:02.434 INFO:teuthology.orchestra.run.smithi155.stdout: "client": "client.4668", 2023-08-01T19:56:02.435 INFO:teuthology.orchestra.run.smithi155.stdout: "client_addr": "172.21.15.6:0/1709472247", 2023-08-01T19:56:02.435 INFO:teuthology.orchestra.run.smithi155.stdout: "tid": 197419 2023-08-01T19:56:02.435 INFO:teuthology.orchestra.run.smithi155.stdout: }, 2023-08-01T19:56:02.435 INFO:teuthology.orchestra.run.smithi155.stdout: "events": [ 2023-08-01T19:56:02.435 INFO:teuthology.orchestra.run.smithi155.stdout: { 2023-08-01T19:56:02.435 INFO:teuthology.orchestra.run.smithi155.stdout: "event": "initiated", 2023-08-01T19:56:02.435 INFO:teuthology.orchestra.run.smithi155.stdout: "time": "2023-08-01T19:55:58.580223+0000", 2023-08-01T19:56:02.436 INFO:teuthology.orchestra.run.smithi155.stdout: "duration": 0 2023-08-01T19:56:02.436 INFO:teuthology.orchestra.run.smithi155.stdout: }, 2023-08-01T19:56:02.436 INFO:teuthology.orchestra.run.smithi155.stdout: { 2023-08-01T19:56:02.436 INFO:teuthology.orchestra.run.smithi155.stdout: "event": "throttled", 2023-08-01T19:56:02.436 INFO:teuthology.orchestra.run.smithi155.stdout: "time": "2023-08-01T19:55:58.580223+0000", 2023-08-01T19:56:02.436 INFO:teuthology.orchestra.run.smithi155.stdout: "duration": 0 2023-08-01T19:56:02.436 INFO:teuthology.orchestra.run.smithi155.stdout: }, 2023-08-01T19:56:02.436 INFO:teuthology.orchestra.run.smithi155.stdout: { 2023-08-01T19:56:02.437 INFO:teuthology.orchestra.run.smithi155.stdout: "event": "header_read", 2023-08-01T19:56:02.437 INFO:teuthology.orchestra.run.smithi155.stdout: "time": "2023-08-01T19:55:58.580222+0000", 2023-08-01T19:56:02.437 INFO:teuthology.orchestra.run.smithi155.stdout: "duration": 4294967295.9999995 2023-08-01T19:56:02.437 INFO:teuthology.orchestra.run.smithi155.stdout: }, 2023-08-01T19:56:02.437 INFO:teuthology.orchestra.run.smithi155.stdout: { 2023-08-01T19:56:02.437 INFO:teuthology.orchestra.run.smithi155.stdout: "event": "all_read", 2023-08-01T19:56:02.437 INFO:teuthology.orchestra.run.smithi155.stdout: "time": "2023-08-01T19:55:58.580225+0000", 2023-08-01T19:56:02.437 INFO:teuthology.orchestra.run.smithi155.stdout: "duration": 3.2820000000000001e-06 2023-08-01T19:56:02.438 INFO:teuthology.orchestra.run.smithi155.stdout: }, 2023-08-01T19:56:02.438 INFO:teuthology.orchestra.run.smithi155.stdout: { 2023-08-01T19:56:02.438 INFO:teuthology.orchestra.run.smithi155.stdout: "event": "dispatched", 2023-08-01T19:56:02.438 INFO:teuthology.orchestra.run.smithi155.stdout: "time": "2023-08-01T19:55:58.580233+0000", 2023-08-01T19:56:02.438 INFO:teuthology.orchestra.run.smithi155.stdout: "duration": 7.34e-06 2023-08-01T19:56:02.438 INFO:teuthology.orchestra.run.smithi155.stdout: }, 2023-08-01T19:56:02.438 INFO:teuthology.orchestra.run.smithi155.stdout: { 2023-08-01T19:56:02.438 INFO:teuthology.orchestra.run.smithi155.stdout: "event": "queued_for_pg", 2023-08-01T19:56:02.439 INFO:teuthology.orchestra.run.smithi155.stdout: "time": "2023-08-01T19:55:58.580236+0000", 2023-08-01T19:56:02.439 INFO:teuthology.orchestra.run.smithi155.stdout: "duration": 3.473e-06 2023-08-01T19:56:02.439 INFO:teuthology.orchestra.run.smithi155.stdout: }, 2023-08-01T19:56:02.439 INFO:teuthology.orchestra.run.smithi155.stdout: { 2023-08-01T19:56:02.439 INFO:teuthology.orchestra.run.smithi155.stdout: "event": "reached_pg", 2023-08-01T19:56:02.439 INFO:teuthology.orchestra.run.smithi155.stdout: "time": "2023-08-01T19:55:58.580267+0000", 2023-08-01T19:56:02.439 INFO:teuthology.orchestra.run.smithi155.stdout: "duration": 3.0479000000000001e-05 2023-08-01T19:56:02.439 INFO:teuthology.orchestra.run.smithi155.stdout: }, 2023-08-01T19:56:02.440 INFO:teuthology.orchestra.run.smithi155.stdout: { 2023-08-01T19:56:02.440 INFO:teuthology.orchestra.run.smithi155.stdout: "event": "waiting for peered", 2023-08-01T19:56:02.440 INFO:teuthology.orchestra.run.smithi155.stdout: "time": "2023-08-01T19:55:58.580272+0000", 2023-08-01T19:56:02.440 INFO:teuthology.orchestra.run.smithi155.stdout: "duration": 5.011e-06 2023-08-01T19:56:02.440 INFO:teuthology.orchestra.run.smithi155.stdout: }, 2023-08-01T19:56:02.440 INFO:teuthology.orchestra.run.smithi155.stdout: { 2023-08-01T19:56:02.440 INFO:teuthology.orchestra.run.smithi155.stdout: "event": "reached_pg", 2023-08-01T19:56:02.441 INFO:teuthology.orchestra.run.smithi155.stdout: "time": "2023-08-01T19:55:59.604970+0000", 2023-08-01T19:56:02.441 INFO:teuthology.orchestra.run.smithi155.stdout: "duration": 1.0246984189999999 2023-08-01T19:56:02.441 INFO:teuthology.orchestra.run.smithi155.stdout: }, 2023-08-01T19:56:02.441 INFO:teuthology.orchestra.run.smithi155.stdout: { 2023-08-01T19:56:02.441 INFO:teuthology.orchestra.run.smithi155.stdout: "event": "started", 2023-08-01T19:56:02.441 INFO:teuthology.orchestra.run.smithi155.stdout: "time": "2023-08-01T19:55:59.605085+0000", 2023-08-01T19:56:02.441 INFO:teuthology.orchestra.run.smithi155.stdout: "duration": 0.00011531000000000001 2023-08-01T19:56:02.441 INFO:teuthology.orchestra.run.smithi155.stdout: }, 2023-08-01T19:56:02.442 INFO:teuthology.orchestra.run.smithi155.stdout: { 2023-08-01T19:56:02.442 INFO:teuthology.orchestra.run.smithi155.stdout: "event": "op_commit", 2023-08-01T19:56:02.442 INFO:teuthology.orchestra.run.smithi155.stdout: "time": "2023-08-01T19:55:59.608733+0000", 2023-08-01T19:56:02.442 INFO:teuthology.orchestra.run.smithi155.stdout: "duration": 0.0036478090000000001 2023-08-01T19:56:02.442 INFO:teuthology.orchestra.run.smithi155.stdout: }, 2023-08-01T19:56:02.442 INFO:teuthology.orchestra.run.smithi155.stdout: { 2023-08-01T19:56:02.442 INFO:teuthology.orchestra.run.smithi155.stdout: "event": "commit_sent", 2023-08-01T19:56:02.442 INFO:teuthology.orchestra.run.smithi155.stdout: "time": "2023-08-01T19:55:59.608771+0000", 2023-08-01T19:56:02.443 INFO:teuthology.orchestra.run.smithi155.stdout: "duration": 3.8033e-05 2023-08-01T19:56:02.443 INFO:teuthology.orchestra.run.smithi155.stdout: }, 2023-08-01T19:56:02.443 INFO:teuthology.orchestra.run.smithi155.stdout: { 2023-08-01T19:56:02.443 INFO:teuthology.orchestra.run.smithi155.stdout: "event": "done", 2023-08-01T19:56:02.443 INFO:teuthology.orchestra.run.smithi155.stdout: "time": "2023-08-01T19:55:59.608837+0000", 2023-08-01T19:56:02.443 INFO:teuthology.orchestra.run.smithi155.stdout: "duration": 6.5364000000000006e-05 2023-08-01T19:56:02.443 INFO:teuthology.orchestra.run.smithi155.stdout: } 2023-08-01T19:56:02.443 INFO:teuthology.orchestra.run.smithi155.stdout: ] 2023-08-01T19:56:02.444 INFO:teuthology.orchestra.run.smithi155.stdout: } 2023-08-01T19:56:02.444 INFO:teuthology.orchestra.run.smithi155.stdout: }, 2023-08-01T19:56:02.444 INFO:teuthology.orchestra.run.smithi155.stdout: { 2023-08-01T19:56:02.444 INFO:teuthology.orchestra.run.smithi155.stdout: "description": "osd_op(client.4668.0:197420 5.9 5:92a2efe5:::benchmark_data_smithi006_114134_object63759:head [delete] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e62)", 2023-08-01T19:56:02.444 INFO:teuthology.orchestra.run.smithi155.stdout: "initiated_at": "2023-08-01T19:55:58.582230+0000", 2023-08-01T19:56:02.444 INFO:teuthology.orchestra.run.smithi155.stdout: "age": 3.6747565130000002, 2023-08-01T19:56:02.444 INFO:teuthology.orchestra.run.smithi155.stdout: "duration": 1.0095353739999999, 2023-08-01T19:56:02.444 INFO:teuthology.orchestra.run.smithi155.stdout: "type_data": { 2023-08-01T19:56:02.445 INFO:teuthology.orchestra.run.smithi155.stdout: "flag_point": "commit sent; apply or cleanup", 2023-08-01T19:56:02.445 INFO:teuthology.orchestra.run.smithi155.stdout: "client_info": { 2023-08-01T19:56:02.445 INFO:teuthology.orchestra.run.smithi155.stdout: "client": "client.4668", 2023-08-01T19:56:02.445 INFO:teuthology.orchestra.run.smithi155.stdout: "client_addr": "172.21.15.6:0/1709472247", 2023-08-01T19:56:02.445 INFO:teuthology.orchestra.run.smithi155.stdout: "tid": 197420 2023-08-01T19:56:02.445 INFO:teuthology.orchestra.run.smithi155.stdout: }, 2023-08-01T19:56:02.445 INFO:teuthology.orchestra.run.smithi155.stdout: "events": [ 2023-08-01T19:56:02.445 INFO:teuthology.orchestra.run.smithi155.stdout: { 2023-08-01T19:56:02.446 INFO:teuthology.orchestra.run.smithi155.stdout: "event": "initiated", 2023-08-01T19:56:02.446 INFO:teuthology.orchestra.run.smithi155.stdout: "time": "2023-08-01T19:55:58.582230+0000", 2023-08-01T19:56:02.446 INFO:teuthology.orchestra.run.smithi155.stdout: "duration": 0 2023-08-01T19:56:02.446 INFO:teuthology.orchestra.run.smithi155.stdout: }, 2023-08-01T19:56:02.446 INFO:teuthology.orchestra.run.smithi155.stdout: { 2023-08-01T19:56:02.446 INFO:teuthology.orchestra.run.smithi155.stdout: "event": "throttled", 2023-08-01T19:56:02.446 INFO:teuthology.orchestra.run.smithi155.stdout: "time": "2023-08-01T19:55:58.582230+0000", 2023-08-01T19:56:02.446 INFO:teuthology.orchestra.run.smithi155.stdout: "duration": 0 2023-08-01T19:56:02.447 INFO:teuthology.orchestra.run.smithi155.stdout: }, 2023-08-01T19:56:02.447 INFO:teuthology.orchestra.run.smithi155.stdout: { 2023-08-01T19:56:02.447 INFO:teuthology.orchestra.run.smithi155.stdout: "event": "header_read", 2023-08-01T19:56:02.447 INFO:teuthology.orchestra.run.smithi155.stdout: "time": "2023-08-01T19:55:58.582229+0000", 2023-08-01T19:56:02.447 INFO:teuthology.orchestra.run.smithi155.stdout: "duration": 4294967295.9999995 2023-08-01T19:56:02.447 INFO:teuthology.orchestra.run.smithi155.stdout: }, 2023-08-01T19:56:02.447 INFO:teuthology.orchestra.run.smithi155.stdout: { 2023-08-01T19:56:02.447 INFO:teuthology.orchestra.run.smithi155.stdout: "event": "all_read", 2023-08-01T19:56:02.448 INFO:teuthology.orchestra.run.smithi155.stdout: "time": "2023-08-01T19:55:58.582233+0000", 2023-08-01T19:56:02.448 INFO:teuthology.orchestra.run.smithi155.stdout: "duration": 3.7869999999999999e-06 2023-08-01T19:56:02.448 INFO:teuthology.orchestra.run.smithi155.stdout: }, 2023-08-01T19:56:02.448 INFO:teuthology.orchestra.run.smithi155.stdout: { 2023-08-01T19:56:02.448 INFO:teuthology.orchestra.run.smithi155.stdout: "event": "dispatched", 2023-08-01T19:56:02.448 INFO:teuthology.orchestra.run.smithi155.stdout: "time": "2023-08-01T19:55:58.582241+0000", 2023-08-01T19:56:02.448 INFO:teuthology.orchestra.run.smithi155.stdout: "duration": 7.6909999999999997e-06 2023-08-01T19:56:02.449 INFO:teuthology.orchestra.run.smithi155.stdout: }, 2023-08-01T19:56:02.449 INFO:teuthology.orchestra.run.smithi155.stdout: { 2023-08-01T19:56:02.449 INFO:teuthology.orchestra.run.smithi155.stdout: "event": "queued_for_pg", 2023-08-01T19:56:02.449 INFO:teuthology.orchestra.run.smithi155.stdout: "time": "2023-08-01T19:55:58.582244+0000", 2023-08-01T19:56:02.449 INFO:teuthology.orchestra.run.smithi155.stdout: "duration": 3.6770000000000001e-06 2023-08-01T19:56:02.449 INFO:teuthology.orchestra.run.smithi155.stdout: }, 2023-08-01T19:56:02.449 INFO:teuthology.orchestra.run.smithi155.stdout: { 2023-08-01T19:56:02.449 INFO:teuthology.orchestra.run.smithi155.stdout: "event": "reached_pg", 2023-08-01T19:56:02.450 INFO:teuthology.orchestra.run.smithi155.stdout: "time": "2023-08-01T19:55:58.582274+0000", 2023-08-01T19:56:02.450 INFO:teuthology.orchestra.run.smithi155.stdout: "duration": 3.0074e-05 2023-08-01T19:56:02.450 INFO:teuthology.orchestra.run.smithi155.stdout: }, 2023-08-01T19:56:02.450 INFO:teuthology.orchestra.run.smithi155.stdout: { 2023-08-01T19:56:02.450 INFO:teuthology.orchestra.run.smithi155.stdout: "event": "waiting for peered", 2023-08-01T19:56:02.450 INFO:teuthology.orchestra.run.smithi155.stdout: "time": "2023-08-01T19:55:58.582281+0000", 2023-08-01T19:56:02.450 INFO:teuthology.orchestra.run.smithi155.stdout: "duration": 6.297e-06 2023-08-01T19:56:02.450 INFO:teuthology.orchestra.run.smithi155.stdout: }, 2023-08-01T19:56:02.451 INFO:teuthology.orchestra.run.smithi155.stdout: { 2023-08-01T19:56:02.451 INFO:teuthology.orchestra.run.smithi155.stdout: "event": "reached_pg", 2023-08-01T19:56:02.451 INFO:teuthology.orchestra.run.smithi155.stdout: "time": "2023-08-01T19:55:59.586809+0000", 2023-08-01T19:56:02.451 INFO:teuthology.orchestra.run.smithi155.stdout: "duration": 1.0045281720000001 2023-08-01T19:56:02.451 INFO:teuthology.orchestra.run.smithi155.stdout: }, 2023-08-01T19:56:02.451 INFO:teuthology.orchestra.run.smithi155.stdout: { 2023-08-01T19:56:02.451 INFO:teuthology.orchestra.run.smithi155.stdout: "event": "started", 2023-08-01T19:56:02.451 INFO:teuthology.orchestra.run.smithi155.stdout: "time": "2023-08-01T19:55:59.586910+0000", 2023-08-01T19:56:02.452 INFO:teuthology.orchestra.run.smithi155.stdout: "duration": 0.000100898 2023-08-01T19:56:02.452 INFO:teuthology.orchestra.run.smithi155.stdout: }, 2023-08-01T19:56:02.452 INFO:teuthology.orchestra.run.smithi155.stdout: { 2023-08-01T19:56:02.452 INFO:teuthology.orchestra.run.smithi155.stdout: "event": "op_commit", 2023-08-01T19:56:02.452 INFO:teuthology.orchestra.run.smithi155.stdout: "time": "2023-08-01T19:55:59.591679+0000", 2023-08-01T19:56:02.452 INFO:teuthology.orchestra.run.smithi155.stdout: "duration": 0.004769471 2023-08-01T19:56:02.452 INFO:teuthology.orchestra.run.smithi155.stdout: }, 2023-08-01T19:56:02.452 INFO:teuthology.orchestra.run.smithi155.stdout: { 2023-08-01T19:56:02.453 INFO:teuthology.orchestra.run.smithi155.stdout: "event": "commit_sent", 2023-08-01T19:56:02.453 INFO:teuthology.orchestra.run.smithi155.stdout: "time": "2023-08-01T19:55:59.591721+0000", 2023-08-01T19:56:02.453 INFO:teuthology.orchestra.run.smithi155.stdout: "duration": 4.1953000000000003e-05 2023-08-01T19:56:02.453 INFO:teuthology.orchestra.run.smithi155.stdout: }, 2023-08-01T19:56:02.453 INFO:teuthology.orchestra.run.smithi155.stdout: { 2023-08-01T19:56:02.453 INFO:teuthology.orchestra.run.smithi155.stdout: "event": "done", 2023-08-01T19:56:02.453 INFO:teuthology.orchestra.run.smithi155.stdout: "time": "2023-08-01T19:55:59.591765+0000", 2023-08-01T19:56:02.453 INFO:teuthology.orchestra.run.smithi155.stdout: "duration": 4.4030999999999999e-05 2023-08-01T19:56:02.454 INFO:teuthology.orchestra.run.smithi155.stdout: } 2023-08-01T19:56:02.454 INFO:teuthology.orchestra.run.smithi155.stdout: ] 2023-08-01T19:56:02.454 INFO:teuthology.orchestra.run.smithi155.stdout: } 2023-08-01T19:56:02.454 INFO:teuthology.orchestra.run.smithi155.stdout: } 2023-08-01T19:56:02.454 INFO:teuthology.orchestra.run.smithi155.stdout: ] 2023-08-01T19:56:02.454 INFO:teuthology.orchestra.run.smithi155.stdout:} 2023-08-01T19:56:02.455 DEBUG:teuthology.orchestra.run.smithi008:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 30 ceph --cluster ceph --admin-daemon /var/run/ceph/ceph-osd.0.asok dump_ops_in_flight 2023-08-01T19:56:02.456 INFO:tasks.ceph.osd.0.smithi008.stderr:2023-08-01T19:56:02.453+0000 7f16a58f4700 -1 received signal: Hangup from /usr/bin/python3 /bin/daemon-helper kill ceph-osd -f --cluster ceph -i 0 (PID: 111179) UID: 0 2023-08-01T19:56:02.557 INFO:tasks.ceph.osd.0.smithi008.stderr:2023-08-01T19:56:02.555+0000 7f16a58f4700 -1 received signal: Hangup from /usr/bin/python3 /bin/daemon-helper kill ceph-osd -f --cluster ceph -i 0 (PID: 111179) UID: 0 2023-08-01T19:56:02.581 DEBUG:teuthology.orchestra.run.smithi006:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 120 ceph --cluster ceph osd unset noscrub 2023-08-01T19:56:02.658 INFO:tasks.ceph.osd.0.smithi008.stderr:2023-08-01T19:56:02.656+0000 7f16a58f4700 -1 received signal: Hangup from /usr/bin/python3 /bin/daemon-helper kill ceph-osd -f --cluster ceph -i 0 (PID: 111179) UID: 0 2023-08-01T19:56:02.659 INFO:teuthology.orchestra.run.smithi008.stdout:{ 2023-08-01T19:56:02.660 INFO:teuthology.orchestra.run.smithi008.stdout: "ops": [ 2023-08-01T19:56:02.660 INFO:teuthology.orchestra.run.smithi008.stdout: { 2023-08-01T19:56:02.660 INFO:teuthology.orchestra.run.smithi008.stdout: "description": "osd_op(client.4668.0:203707 5.2 5:42f9dae5:::benchmark_data_smithi006_114134_object70046:head [delete] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e64)", 2023-08-01T19:56:02.660 INFO:teuthology.orchestra.run.smithi008.stdout: "initiated_at": "2023-08-01T19:56:02.656418+0000", 2023-08-01T19:56:02.660 INFO:teuthology.orchestra.run.smithi008.stdout: "age": 0.0014735079999999999, 2023-08-01T19:56:02.660 INFO:teuthology.orchestra.run.smithi008.stdout: "duration": 0.0015012420000000001, 2023-08-01T19:56:02.661 INFO:teuthology.orchestra.run.smithi008.stdout: "type_data": { 2023-08-01T19:56:02.661 INFO:teuthology.orchestra.run.smithi008.stdout: "flag_point": "started", 2023-08-01T19:56:02.661 INFO:teuthology.orchestra.run.smithi008.stdout: "client_info": { 2023-08-01T19:56:02.661 INFO:teuthology.orchestra.run.smithi008.stdout: "client": "client.4668", 2023-08-01T19:56:02.661 INFO:teuthology.orchestra.run.smithi008.stdout: "client_addr": "172.21.15.6:0/1709472247", 2023-08-01T19:56:02.661 INFO:teuthology.orchestra.run.smithi008.stdout: "tid": 203707 2023-08-01T19:56:02.661 INFO:teuthology.orchestra.run.smithi008.stdout: }, 2023-08-01T19:56:02.661 INFO:teuthology.orchestra.run.smithi008.stdout: "events": [ 2023-08-01T19:56:02.662 INFO:teuthology.orchestra.run.smithi008.stdout: { 2023-08-01T19:56:02.662 INFO:teuthology.orchestra.run.smithi008.stdout: "event": "initiated", 2023-08-01T19:56:02.662 INFO:teuthology.orchestra.run.smithi008.stdout: "time": "2023-08-01T19:56:02.656418+0000", 2023-08-01T19:56:02.662 INFO:teuthology.orchestra.run.smithi008.stdout: "duration": 0 2023-08-01T19:56:02.662 INFO:teuthology.orchestra.run.smithi008.stdout: }, 2023-08-01T19:56:02.663 INFO:teuthology.orchestra.run.smithi008.stdout: { 2023-08-01T19:56:02.663 INFO:teuthology.orchestra.run.smithi008.stdout: "event": "throttled", 2023-08-01T19:56:02.663 INFO:teuthology.orchestra.run.smithi008.stdout: "time": "2023-08-01T19:56:02.656418+0000", 2023-08-01T19:56:02.663 INFO:teuthology.orchestra.run.smithi008.stdout: "duration": 0 2023-08-01T19:56:02.663 INFO:teuthology.orchestra.run.smithi008.stdout: }, 2023-08-01T19:56:02.664 INFO:teuthology.orchestra.run.smithi008.stdout: { 2023-08-01T19:56:02.664 INFO:teuthology.orchestra.run.smithi008.stdout: "event": "header_read", 2023-08-01T19:56:02.664 INFO:teuthology.orchestra.run.smithi008.stdout: "time": "2023-08-01T19:56:02.656418+0000", 2023-08-01T19:56:02.664 INFO:teuthology.orchestra.run.smithi008.stdout: "duration": 4294967295.9999995 2023-08-01T19:56:02.664 INFO:teuthology.orchestra.run.smithi008.stdout: }, 2023-08-01T19:56:02.664 INFO:teuthology.orchestra.run.smithi008.stdout: { 2023-08-01T19:56:02.664 INFO:teuthology.orchestra.run.smithi008.stdout: "event": "all_read", 2023-08-01T19:56:02.665 INFO:teuthology.orchestra.run.smithi008.stdout: "time": "2023-08-01T19:56:02.656420+0000", 2023-08-01T19:56:02.665 INFO:teuthology.orchestra.run.smithi008.stdout: "duration": 2.447e-06 2023-08-01T19:56:02.665 INFO:teuthology.orchestra.run.smithi008.stdout: }, 2023-08-01T19:56:02.665 INFO:teuthology.orchestra.run.smithi008.stdout: { 2023-08-01T19:56:02.665 INFO:teuthology.orchestra.run.smithi008.stdout: "event": "dispatched", 2023-08-01T19:56:02.665 INFO:teuthology.orchestra.run.smithi008.stdout: "time": "2023-08-01T19:56:02.656428+0000", 2023-08-01T19:56:02.665 INFO:teuthology.orchestra.run.smithi008.stdout: "duration": 7.7700000000000001e-06 2023-08-01T19:56:02.665 INFO:teuthology.orchestra.run.smithi008.stdout: }, 2023-08-01T19:56:02.666 INFO:teuthology.orchestra.run.smithi008.stdout: { 2023-08-01T19:56:02.666 INFO:teuthology.orchestra.run.smithi008.stdout: "event": "queued_for_pg", 2023-08-01T19:56:02.666 INFO:teuthology.orchestra.run.smithi008.stdout: "time": "2023-08-01T19:56:02.656434+0000", 2023-08-01T19:56:02.666 INFO:teuthology.orchestra.run.smithi008.stdout: "duration": 5.3319999999999999e-06 2023-08-01T19:56:02.666 INFO:teuthology.orchestra.run.smithi008.stdout: }, 2023-08-01T19:56:02.666 INFO:teuthology.orchestra.run.smithi008.stdout: { 2023-08-01T19:56:02.666 INFO:teuthology.orchestra.run.smithi008.stdout: "event": "reached_pg", 2023-08-01T19:56:02.667 INFO:teuthology.orchestra.run.smithi008.stdout: "time": "2023-08-01T19:56:02.656583+0000", 2023-08-01T19:56:02.667 INFO:teuthology.orchestra.run.smithi008.stdout: "duration": 0.00014984199999999999 2023-08-01T19:56:02.667 INFO:teuthology.orchestra.run.smithi008.stdout: }, 2023-08-01T19:56:02.667 INFO:teuthology.orchestra.run.smithi008.stdout: { 2023-08-01T19:56:02.667 INFO:teuthology.orchestra.run.smithi008.stdout: "event": "started", 2023-08-01T19:56:02.667 INFO:teuthology.orchestra.run.smithi008.stdout: "time": "2023-08-01T19:56:02.656708+0000", 2023-08-01T19:56:02.667 INFO:teuthology.orchestra.run.smithi008.stdout: "duration": 0.00012426399999999999 2023-08-01T19:56:02.667 INFO:teuthology.orchestra.run.smithi008.stdout: } 2023-08-01T19:56:02.668 INFO:teuthology.orchestra.run.smithi008.stdout: ] 2023-08-01T19:56:02.668 INFO:teuthology.orchestra.run.smithi008.stdout: } 2023-08-01T19:56:02.668 INFO:teuthology.orchestra.run.smithi008.stdout: }, 2023-08-01T19:56:02.668 INFO:teuthology.orchestra.run.smithi008.stdout: { 2023-08-01T19:56:02.668 INFO:teuthology.orchestra.run.smithi008.stdout: "description": "osd_op(client.4668.0:203709 5.c 5:34b4a784:::benchmark_data_smithi006_114134_object70048:head [delete] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e64)", 2023-08-01T19:56:02.668 INFO:teuthology.orchestra.run.smithi008.stdout: "initiated_at": "2023-08-01T19:56:02.656449+0000", 2023-08-01T19:56:02.668 INFO:teuthology.orchestra.run.smithi008.stdout: "age": 0.001442462, 2023-08-01T19:56:02.668 INFO:teuthology.orchestra.run.smithi008.stdout: "duration": 0.001548542, 2023-08-01T19:56:02.669 INFO:teuthology.orchestra.run.smithi008.stdout: "type_data": { 2023-08-01T19:56:02.669 INFO:teuthology.orchestra.run.smithi008.stdout: "flag_point": "started", 2023-08-01T19:56:02.669 INFO:teuthology.orchestra.run.smithi008.stdout: "client_info": { 2023-08-01T19:56:02.669 INFO:teuthology.orchestra.run.smithi008.stdout: "client": "client.4668", 2023-08-01T19:56:02.669 INFO:teuthology.orchestra.run.smithi008.stdout: "client_addr": "172.21.15.6:0/1709472247", 2023-08-01T19:56:02.669 INFO:teuthology.orchestra.run.smithi008.stdout: "tid": 203709 2023-08-01T19:56:02.669 INFO:teuthology.orchestra.run.smithi008.stdout: }, 2023-08-01T19:56:02.669 INFO:teuthology.orchestra.run.smithi008.stdout: "events": [ 2023-08-01T19:56:02.670 INFO:teuthology.orchestra.run.smithi008.stdout: { 2023-08-01T19:56:02.670 INFO:teuthology.orchestra.run.smithi008.stdout: "event": "initiated", 2023-08-01T19:56:02.670 INFO:teuthology.orchestra.run.smithi008.stdout: "time": "2023-08-01T19:56:02.656449+0000", 2023-08-01T19:56:02.670 INFO:teuthology.orchestra.run.smithi008.stdout: "duration": 0 2023-08-01T19:56:02.670 INFO:teuthology.orchestra.run.smithi008.stdout: }, 2023-08-01T19:56:02.670 INFO:teuthology.orchestra.run.smithi008.stdout: { 2023-08-01T19:56:02.670 INFO:teuthology.orchestra.run.smithi008.stdout: "event": "throttled", 2023-08-01T19:56:02.671 INFO:teuthology.orchestra.run.smithi008.stdout: "time": "2023-08-01T19:56:02.656449+0000", 2023-08-01T19:56:02.671 INFO:teuthology.orchestra.run.smithi008.stdout: "duration": 0 2023-08-01T19:56:02.671 INFO:teuthology.orchestra.run.smithi008.stdout: }, 2023-08-01T19:56:02.671 INFO:teuthology.orchestra.run.smithi008.stdout: { 2023-08-01T19:56:02.671 INFO:teuthology.orchestra.run.smithi008.stdout: "event": "header_read", 2023-08-01T19:56:02.671 INFO:teuthology.orchestra.run.smithi008.stdout: "time": "2023-08-01T19:56:02.656449+0000", 2023-08-01T19:56:02.671 INFO:teuthology.orchestra.run.smithi008.stdout: "duration": 4294967295.9999995 2023-08-01T19:56:02.671 INFO:teuthology.orchestra.run.smithi008.stdout: }, 2023-08-01T19:56:02.672 INFO:teuthology.orchestra.run.smithi008.stdout: { 2023-08-01T19:56:02.672 INFO:teuthology.orchestra.run.smithi008.stdout: "event": "all_read", 2023-08-01T19:56:02.672 INFO:teuthology.orchestra.run.smithi008.stdout: "time": "2023-08-01T19:56:02.656452+0000", 2023-08-01T19:56:02.672 INFO:teuthology.orchestra.run.smithi008.stdout: "duration": 2.7520000000000001e-06 2023-08-01T19:56:02.672 INFO:teuthology.orchestra.run.smithi008.stdout: }, 2023-08-01T19:56:02.672 INFO:teuthology.orchestra.run.smithi008.stdout: { 2023-08-01T19:56:02.672 INFO:teuthology.orchestra.run.smithi008.stdout: "event": "dispatched", 2023-08-01T19:56:02.672 INFO:teuthology.orchestra.run.smithi008.stdout: "time": "2023-08-01T19:56:02.656459+0000", 2023-08-01T19:56:02.673 INFO:teuthology.orchestra.run.smithi008.stdout: "duration": 7.6839999999999996e-06 2023-08-01T19:56:02.673 INFO:teuthology.orchestra.run.smithi008.stdout: }, 2023-08-01T19:56:02.673 INFO:teuthology.orchestra.run.smithi008.stdout: { 2023-08-01T19:56:02.673 INFO:teuthology.orchestra.run.smithi008.stdout: "event": "queued_for_pg", 2023-08-01T19:56:02.673 INFO:teuthology.orchestra.run.smithi008.stdout: "time": "2023-08-01T19:56:02.656464+0000", 2023-08-01T19:56:02.673 INFO:teuthology.orchestra.run.smithi008.stdout: "duration": 4.6890000000000003e-06 2023-08-01T19:56:02.673 INFO:teuthology.orchestra.run.smithi008.stdout: }, 2023-08-01T19:56:02.673 INFO:teuthology.orchestra.run.smithi008.stdout: { 2023-08-01T19:56:02.674 INFO:teuthology.orchestra.run.smithi008.stdout: "event": "reached_pg", 2023-08-01T19:56:02.674 INFO:teuthology.orchestra.run.smithi008.stdout: "time": "2023-08-01T19:56:02.656503+0000", 2023-08-01T19:56:02.674 INFO:teuthology.orchestra.run.smithi008.stdout: "duration": 3.9094999999999998e-05 2023-08-01T19:56:02.674 INFO:teuthology.orchestra.run.smithi008.stdout: }, 2023-08-01T19:56:02.674 INFO:teuthology.orchestra.run.smithi008.stdout: { 2023-08-01T19:56:02.674 INFO:teuthology.orchestra.run.smithi008.stdout: "event": "started", 2023-08-01T19:56:02.674 INFO:teuthology.orchestra.run.smithi008.stdout: "time": "2023-08-01T19:56:02.656637+0000", 2023-08-01T19:56:02.675 INFO:teuthology.orchestra.run.smithi008.stdout: "duration": 0.00013414300000000001 2023-08-01T19:56:02.675 INFO:teuthology.orchestra.run.smithi008.stdout: } 2023-08-01T19:56:02.675 INFO:teuthology.orchestra.run.smithi008.stdout: ] 2023-08-01T19:56:02.675 INFO:teuthology.orchestra.run.smithi008.stdout: } 2023-08-01T19:56:02.675 INFO:teuthology.orchestra.run.smithi008.stdout: }, 2023-08-01T19:56:02.675 INFO:teuthology.orchestra.run.smithi008.stdout: { 2023-08-01T19:56:02.675 INFO:teuthology.orchestra.run.smithi008.stdout: "description": "osd_repop(client.4668.0:203708 5.0 e64/19)", 2023-08-01T19:56:02.676 INFO:teuthology.orchestra.run.smithi008.stdout: "initiated_at": "2023-08-01T19:56:02.656683+0000", 2023-08-01T19:56:02.676 INFO:teuthology.orchestra.run.smithi008.stdout: "age": 0.00120882, 2023-08-01T19:56:02.676 INFO:teuthology.orchestra.run.smithi008.stdout: "duration": 0.001382012, 2023-08-01T19:56:02.676 INFO:teuthology.orchestra.run.smithi008.stdout: "type_data": { 2023-08-01T19:56:02.676 INFO:teuthology.orchestra.run.smithi008.stdout: "flag_point": "queued for pg", 2023-08-01T19:56:02.676 INFO:teuthology.orchestra.run.smithi008.stdout: "events": [ 2023-08-01T19:56:02.676 INFO:teuthology.orchestra.run.smithi008.stdout: { 2023-08-01T19:56:02.676 INFO:teuthology.orchestra.run.smithi008.stdout: "event": "initiated", 2023-08-01T19:56:02.677 INFO:teuthology.orchestra.run.smithi008.stdout: "time": "2023-08-01T19:56:02.656683+0000", 2023-08-01T19:56:02.677 INFO:teuthology.orchestra.run.smithi008.stdout: "duration": 0 2023-08-01T19:56:02.677 INFO:teuthology.orchestra.run.smithi008.stdout: }, 2023-08-01T19:56:02.677 INFO:teuthology.orchestra.run.smithi008.stdout: { 2023-08-01T19:56:02.677 INFO:teuthology.orchestra.run.smithi008.stdout: "event": "throttled", 2023-08-01T19:56:02.677 INFO:teuthology.orchestra.run.smithi008.stdout: "time": "2023-08-01T19:56:02.656683+0000", 2023-08-01T19:56:02.677 INFO:teuthology.orchestra.run.smithi008.stdout: "duration": 0 2023-08-01T19:56:02.677 INFO:teuthology.orchestra.run.smithi008.stdout: }, 2023-08-01T19:56:02.678 INFO:teuthology.orchestra.run.smithi008.stdout: { 2023-08-01T19:56:02.678 INFO:teuthology.orchestra.run.smithi008.stdout: "event": "header_read", 2023-08-01T19:56:02.678 INFO:teuthology.orchestra.run.smithi008.stdout: "time": "2023-08-01T19:56:02.656683+0000", 2023-08-01T19:56:02.678 INFO:teuthology.orchestra.run.smithi008.stdout: "duration": 4294967295.9999995 2023-08-01T19:56:02.678 INFO:teuthology.orchestra.run.smithi008.stdout: }, 2023-08-01T19:56:02.678 INFO:teuthology.orchestra.run.smithi008.stdout: { 2023-08-01T19:56:02.678 INFO:teuthology.orchestra.run.smithi008.stdout: "event": "all_read", 2023-08-01T19:56:02.678 INFO:teuthology.orchestra.run.smithi008.stdout: "time": "2023-08-01T19:56:02.656688+0000", 2023-08-01T19:56:02.679 INFO:teuthology.orchestra.run.smithi008.stdout: "duration": 5.4299999999999997e-06 2023-08-01T19:56:02.679 INFO:teuthology.orchestra.run.smithi008.stdout: }, 2023-08-01T19:56:02.679 INFO:teuthology.orchestra.run.smithi008.stdout: { 2023-08-01T19:56:02.679 INFO:teuthology.orchestra.run.smithi008.stdout: "event": "dispatched", 2023-08-01T19:56:02.679 INFO:teuthology.orchestra.run.smithi008.stdout: "time": "2023-08-01T19:56:02.656697+0000", 2023-08-01T19:56:02.679 INFO:teuthology.orchestra.run.smithi008.stdout: "duration": 9.0909999999999999e-06 2023-08-01T19:56:02.679 INFO:teuthology.orchestra.run.smithi008.stdout: }, 2023-08-01T19:56:02.679 INFO:teuthology.orchestra.run.smithi008.stdout: { 2023-08-01T19:56:02.680 INFO:teuthology.orchestra.run.smithi008.stdout: "event": "queued_for_pg", 2023-08-01T19:56:02.680 INFO:teuthology.orchestra.run.smithi008.stdout: "time": "2023-08-01T19:56:02.656702+0000", 2023-08-01T19:56:02.680 INFO:teuthology.orchestra.run.smithi008.stdout: "duration": 5.0130000000000001e-06 2023-08-01T19:56:02.680 INFO:teuthology.orchestra.run.smithi008.stdout: } 2023-08-01T19:56:02.680 INFO:teuthology.orchestra.run.smithi008.stdout: ] 2023-08-01T19:56:02.680 INFO:teuthology.orchestra.run.smithi008.stdout: } 2023-08-01T19:56:02.680 INFO:teuthology.orchestra.run.smithi008.stdout: }, 2023-08-01T19:56:02.681 INFO:teuthology.orchestra.run.smithi008.stdout: { 2023-08-01T19:56:02.681 INFO:teuthology.orchestra.run.smithi008.stdout: "description": "osd_repop(client.4668.0:203710 5.4 e64/19 5:24c2b11e:::benchmark_data_smithi006_114134_object70049:head v 64'12552, mlcod=64'12550)", 2023-08-01T19:56:02.681 INFO:teuthology.orchestra.run.smithi008.stdout: "initiated_at": "2023-08-01T19:56:02.656901+0000", 2023-08-01T19:56:02.681 INFO:teuthology.orchestra.run.smithi008.stdout: "age": 0.00099134799999999997, 2023-08-01T19:56:02.681 INFO:teuthology.orchestra.run.smithi008.stdout: "duration": 0.0012155919999999999, 2023-08-01T19:56:02.681 INFO:teuthology.orchestra.run.smithi008.stdout: "type_data": { 2023-08-01T19:56:02.681 INFO:teuthology.orchestra.run.smithi008.stdout: "flag_point": "started", 2023-08-01T19:56:02.681 INFO:teuthology.orchestra.run.smithi008.stdout: "events": [ 2023-08-01T19:56:02.682 INFO:teuthology.orchestra.run.smithi008.stdout: { 2023-08-01T19:56:02.682 INFO:teuthology.orchestra.run.smithi008.stdout: "event": "initiated", 2023-08-01T19:56:02.682 INFO:teuthology.orchestra.run.smithi008.stdout: "time": "2023-08-01T19:56:02.656901+0000", 2023-08-01T19:56:02.682 INFO:teuthology.orchestra.run.smithi008.stdout: "duration": 0 2023-08-01T19:56:02.682 INFO:teuthology.orchestra.run.smithi008.stdout: }, 2023-08-01T19:56:02.682 INFO:teuthology.orchestra.run.smithi008.stdout: { 2023-08-01T19:56:02.682 INFO:teuthology.orchestra.run.smithi008.stdout: "event": "throttled", 2023-08-01T19:56:02.682 INFO:teuthology.orchestra.run.smithi008.stdout: "time": "2023-08-01T19:56:02.656901+0000", 2023-08-01T19:56:02.683 INFO:teuthology.orchestra.run.smithi008.stdout: "duration": 0 2023-08-01T19:56:02.683 INFO:teuthology.orchestra.run.smithi008.stdout: }, 2023-08-01T19:56:02.683 INFO:teuthology.orchestra.run.smithi008.stdout: { 2023-08-01T19:56:02.683 INFO:teuthology.orchestra.run.smithi008.stdout: "event": "header_read", 2023-08-01T19:56:02.683 INFO:teuthology.orchestra.run.smithi008.stdout: "time": "2023-08-01T19:56:02.656900+0000", 2023-08-01T19:56:02.683 INFO:teuthology.orchestra.run.smithi008.stdout: "duration": 4294967295.9999995 2023-08-01T19:56:02.683 INFO:teuthology.orchestra.run.smithi008.stdout: }, 2023-08-01T19:56:02.683 INFO:teuthology.orchestra.run.smithi008.stdout: { 2023-08-01T19:56:02.684 INFO:teuthology.orchestra.run.smithi008.stdout: "event": "all_read", 2023-08-01T19:56:02.684 INFO:teuthology.orchestra.run.smithi008.stdout: "time": "2023-08-01T19:56:02.656905+0000", 2023-08-01T19:56:02.684 INFO:teuthology.orchestra.run.smithi008.stdout: "duration": 4.656e-06 2023-08-01T19:56:02.684 INFO:teuthology.orchestra.run.smithi008.stdout: }, 2023-08-01T19:56:02.684 INFO:teuthology.orchestra.run.smithi008.stdout: { 2023-08-01T19:56:02.684 INFO:teuthology.orchestra.run.smithi008.stdout: "event": "dispatched", 2023-08-01T19:56:02.684 INFO:teuthology.orchestra.run.smithi008.stdout: "time": "2023-08-01T19:56:02.656912+0000", 2023-08-01T19:56:02.684 INFO:teuthology.orchestra.run.smithi008.stdout: "duration": 7.6709999999999999e-06 2023-08-01T19:56:02.685 INFO:teuthology.orchestra.run.smithi008.stdout: }, 2023-08-01T19:56:02.685 INFO:teuthology.orchestra.run.smithi008.stdout: { 2023-08-01T19:56:02.685 INFO:teuthology.orchestra.run.smithi008.stdout: "event": "queued_for_pg", 2023-08-01T19:56:02.685 INFO:teuthology.orchestra.run.smithi008.stdout: "time": "2023-08-01T19:56:02.656916+0000", 2023-08-01T19:56:02.685 INFO:teuthology.orchestra.run.smithi008.stdout: "duration": 4.0300000000000004e-06 2023-08-01T19:56:02.685 INFO:teuthology.orchestra.run.smithi008.stdout: }, 2023-08-01T19:56:02.685 INFO:teuthology.orchestra.run.smithi008.stdout: { 2023-08-01T19:56:02.685 INFO:teuthology.orchestra.run.smithi008.stdout: "event": "reached_pg", 2023-08-01T19:56:02.686 INFO:teuthology.orchestra.run.smithi008.stdout: "time": "2023-08-01T19:56:02.656956+0000", 2023-08-01T19:56:02.686 INFO:teuthology.orchestra.run.smithi008.stdout: "duration": 3.9279999999999997e-05 2023-08-01T19:56:02.686 INFO:teuthology.orchestra.run.smithi008.stdout: }, 2023-08-01T19:56:02.686 INFO:teuthology.orchestra.run.smithi008.stdout: { 2023-08-01T19:56:02.686 INFO:teuthology.orchestra.run.smithi008.stdout: "event": "started", 2023-08-01T19:56:02.686 INFO:teuthology.orchestra.run.smithi008.stdout: "time": "2023-08-01T19:56:02.656972+0000", 2023-08-01T19:56:02.686 INFO:teuthology.orchestra.run.smithi008.stdout: "duration": 1.6373999999999999e-05 2023-08-01T19:56:02.687 INFO:teuthology.orchestra.run.smithi008.stdout: } 2023-08-01T19:56:02.687 INFO:teuthology.orchestra.run.smithi008.stdout: ] 2023-08-01T19:56:02.687 INFO:teuthology.orchestra.run.smithi008.stdout: } 2023-08-01T19:56:02.687 INFO:teuthology.orchestra.run.smithi008.stdout: }, 2023-08-01T19:56:02.687 INFO:teuthology.orchestra.run.smithi008.stdout: { 2023-08-01T19:56:02.687 INFO:teuthology.orchestra.run.smithi008.stdout: "description": "osd_repop(client.4668.0:203687 5.0 e64/19 5:0cdbce94:::benchmark_data_smithi006_114134_object70026:head v 64'12924, mlcod=64'12922)", 2023-08-01T19:56:02.687 INFO:teuthology.orchestra.run.smithi008.stdout: "initiated_at": "2023-08-01T19:56:02.646149+0000", 2023-08-01T19:56:02.687 INFO:teuthology.orchestra.run.smithi008.stdout: "age": 0.011742509999999999, 2023-08-01T19:56:02.688 INFO:teuthology.orchestra.run.smithi008.stdout: "duration": 0.012043020999999999, 2023-08-01T19:56:02.688 INFO:teuthology.orchestra.run.smithi008.stdout: "type_data": { 2023-08-01T19:56:02.688 INFO:teuthology.orchestra.run.smithi008.stdout: "flag_point": "started", 2023-08-01T19:56:02.688 INFO:teuthology.orchestra.run.smithi008.stdout: "events": [ 2023-08-01T19:56:02.688 INFO:teuthology.orchestra.run.smithi008.stdout: { 2023-08-01T19:56:02.688 INFO:teuthology.orchestra.run.smithi008.stdout: "event": "initiated", 2023-08-01T19:56:02.688 INFO:teuthology.orchestra.run.smithi008.stdout: "time": "2023-08-01T19:56:02.646149+0000", 2023-08-01T19:56:02.688 INFO:teuthology.orchestra.run.smithi008.stdout: "duration": 0 2023-08-01T19:56:02.689 INFO:teuthology.orchestra.run.smithi008.stdout: }, 2023-08-01T19:56:02.689 INFO:teuthology.orchestra.run.smithi008.stdout: { 2023-08-01T19:56:02.689 INFO:teuthology.orchestra.run.smithi008.stdout: "event": "throttled", 2023-08-01T19:56:02.689 INFO:teuthology.orchestra.run.smithi008.stdout: "time": "2023-08-01T19:56:02.646149+0000", 2023-08-01T19:56:02.689 INFO:teuthology.orchestra.run.smithi008.stdout: "duration": 0 2023-08-01T19:56:02.689 INFO:teuthology.orchestra.run.smithi008.stdout: }, 2023-08-01T19:56:02.689 INFO:teuthology.orchestra.run.smithi008.stdout: { 2023-08-01T19:56:02.689 INFO:teuthology.orchestra.run.smithi008.stdout: "event": "header_read", 2023-08-01T19:56:02.690 INFO:teuthology.orchestra.run.smithi008.stdout: "time": "2023-08-01T19:56:02.646149+0000", 2023-08-01T19:56:02.690 INFO:teuthology.orchestra.run.smithi008.stdout: "duration": 4294967295.999999 2023-08-01T19:56:02.690 INFO:teuthology.orchestra.run.smithi008.stdout: }, 2023-08-01T19:56:02.690 INFO:teuthology.orchestra.run.smithi008.stdout: { 2023-08-01T19:56:02.690 INFO:teuthology.orchestra.run.smithi008.stdout: "event": "all_read", 2023-08-01T19:56:02.690 INFO:teuthology.orchestra.run.smithi008.stdout: "time": "2023-08-01T19:56:02.646155+0000", 2023-08-01T19:56:02.690 INFO:teuthology.orchestra.run.smithi008.stdout: "duration": 6.015e-06 2023-08-01T19:56:02.691 INFO:teuthology.orchestra.run.smithi008.stdout: }, 2023-08-01T19:56:02.691 INFO:teuthology.orchestra.run.smithi008.stdout: { 2023-08-01T19:56:02.691 INFO:teuthology.orchestra.run.smithi008.stdout: "event": "dispatched", 2023-08-01T19:56:02.691 INFO:teuthology.orchestra.run.smithi008.stdout: "time": "2023-08-01T19:56:02.646165+0000", 2023-08-01T19:56:02.691 INFO:teuthology.orchestra.run.smithi008.stdout: "duration": 1.0396e-05 2023-08-01T19:56:02.691 INFO:teuthology.orchestra.run.smithi008.stdout: }, 2023-08-01T19:56:02.691 INFO:teuthology.orchestra.run.smithi008.stdout: { 2023-08-01T19:56:02.691 INFO:teuthology.orchestra.run.smithi008.stdout: "event": "queued_for_pg", 2023-08-01T19:56:02.692 INFO:teuthology.orchestra.run.smithi008.stdout: "time": "2023-08-01T19:56:02.646171+0000", 2023-08-01T19:56:02.692 INFO:teuthology.orchestra.run.smithi008.stdout: "duration": 6.0240000000000003e-06 2023-08-01T19:56:02.692 INFO:teuthology.orchestra.run.smithi008.stdout: }, 2023-08-01T19:56:02.692 INFO:teuthology.orchestra.run.smithi008.stdout: { 2023-08-01T19:56:02.692 INFO:teuthology.orchestra.run.smithi008.stdout: "event": "reached_pg", 2023-08-01T19:56:02.692 INFO:teuthology.orchestra.run.smithi008.stdout: "time": "2023-08-01T19:56:02.647005+0000", 2023-08-01T19:56:02.692 INFO:teuthology.orchestra.run.smithi008.stdout: "duration": 0.00083339299999999998 2023-08-01T19:56:02.692 INFO:teuthology.orchestra.run.smithi008.stdout: }, 2023-08-01T19:56:02.693 INFO:teuthology.orchestra.run.smithi008.stdout: { 2023-08-01T19:56:02.693 INFO:teuthology.orchestra.run.smithi008.stdout: "event": "started", 2023-08-01T19:56:02.693 INFO:teuthology.orchestra.run.smithi008.stdout: "time": "2023-08-01T19:56:02.647022+0000", 2023-08-01T19:56:02.693 INFO:teuthology.orchestra.run.smithi008.stdout: "duration": 1.7884999999999999e-05 2023-08-01T19:56:02.693 INFO:teuthology.orchestra.run.smithi008.stdout: } 2023-08-01T19:56:02.693 INFO:teuthology.orchestra.run.smithi008.stdout: ] 2023-08-01T19:56:02.693 INFO:teuthology.orchestra.run.smithi008.stdout: } 2023-08-01T19:56:02.693 INFO:teuthology.orchestra.run.smithi008.stdout: }, 2023-08-01T19:56:02.694 INFO:teuthology.orchestra.run.smithi008.stdout: { 2023-08-01T19:56:02.694 INFO:teuthology.orchestra.run.smithi008.stdout: "description": "osd_repop(client.4668.0:203696 5.0 e64/19 5:051952fc:::benchmark_data_smithi006_114134_object70035:head v 64'12925, mlcod=64'12922)", 2023-08-01T19:56:02.694 INFO:teuthology.orchestra.run.smithi008.stdout: "initiated_at": "2023-08-01T19:56:02.650370+0000", 2023-08-01T19:56:02.694 INFO:teuthology.orchestra.run.smithi008.stdout: "age": 0.0075220579999999999, 2023-08-01T19:56:02.694 INFO:teuthology.orchestra.run.smithi008.stdout: "duration": 0.0078848410000000001, 2023-08-01T19:56:02.694 INFO:teuthology.orchestra.run.smithi008.stdout: "type_data": { 2023-08-01T19:56:02.694 INFO:teuthology.orchestra.run.smithi008.stdout: "flag_point": "started", 2023-08-01T19:56:02.695 INFO:teuthology.orchestra.run.smithi008.stdout: "events": [ 2023-08-01T19:56:02.695 INFO:teuthology.orchestra.run.smithi008.stdout: { 2023-08-01T19:56:02.695 INFO:teuthology.orchestra.run.smithi008.stdout: "event": "initiated", 2023-08-01T19:56:02.695 INFO:teuthology.orchestra.run.smithi008.stdout: "time": "2023-08-01T19:56:02.650370+0000", 2023-08-01T19:56:02.695 INFO:teuthology.orchestra.run.smithi008.stdout: "duration": 0 2023-08-01T19:56:02.695 INFO:teuthology.orchestra.run.smithi008.stdout: }, 2023-08-01T19:56:02.695 INFO:teuthology.orchestra.run.smithi008.stdout: { 2023-08-01T19:56:02.695 INFO:teuthology.orchestra.run.smithi008.stdout: "event": "throttled", 2023-08-01T19:56:02.696 INFO:teuthology.orchestra.run.smithi008.stdout: "time": "2023-08-01T19:56:02.650370+0000", 2023-08-01T19:56:02.696 INFO:teuthology.orchestra.run.smithi008.stdout: "duration": 0 2023-08-01T19:56:02.696 INFO:teuthology.orchestra.run.smithi008.stdout: }, 2023-08-01T19:56:02.696 INFO:teuthology.orchestra.run.smithi008.stdout: { 2023-08-01T19:56:02.696 INFO:teuthology.orchestra.run.smithi008.stdout: "event": "header_read", 2023-08-01T19:56:02.696 INFO:teuthology.orchestra.run.smithi008.stdout: "time": "2023-08-01T19:56:02.650369+0000", 2023-08-01T19:56:02.696 INFO:teuthology.orchestra.run.smithi008.stdout: "duration": 4294967295.9999995 2023-08-01T19:56:02.696 INFO:teuthology.orchestra.run.smithi008.stdout: }, 2023-08-01T19:56:02.697 INFO:teuthology.orchestra.run.smithi008.stdout: { 2023-08-01T19:56:02.697 INFO:teuthology.orchestra.run.smithi008.stdout: "event": "all_read", 2023-08-01T19:56:02.697 INFO:teuthology.orchestra.run.smithi008.stdout: "time": "2023-08-01T19:56:02.650375+0000", 2023-08-01T19:56:02.697 INFO:teuthology.orchestra.run.smithi008.stdout: "duration": 6.0129999999999999e-06 2023-08-01T19:56:02.697 INFO:teuthology.orchestra.run.smithi008.stdout: }, 2023-08-01T19:56:02.697 INFO:teuthology.orchestra.run.smithi008.stdout: { 2023-08-01T19:56:02.697 INFO:teuthology.orchestra.run.smithi008.stdout: "event": "dispatched", 2023-08-01T19:56:02.697 INFO:teuthology.orchestra.run.smithi008.stdout: "time": "2023-08-01T19:56:02.650387+0000", 2023-08-01T19:56:02.698 INFO:teuthology.orchestra.run.smithi008.stdout: "duration": 1.1685000000000001e-05 2023-08-01T19:56:02.698 INFO:teuthology.orchestra.run.smithi008.stdout: }, 2023-08-01T19:56:02.698 INFO:teuthology.orchestra.run.smithi008.stdout: { 2023-08-01T19:56:02.698 INFO:teuthology.orchestra.run.smithi008.stdout: "event": "queued_for_pg", 2023-08-01T19:56:02.698 INFO:teuthology.orchestra.run.smithi008.stdout: "time": "2023-08-01T19:56:02.650392+0000", 2023-08-01T19:56:02.698 INFO:teuthology.orchestra.run.smithi008.stdout: "duration": 5.3349999999999997e-06 2023-08-01T19:56:02.698 INFO:teuthology.orchestra.run.smithi008.stdout: }, 2023-08-01T19:56:02.698 INFO:teuthology.orchestra.run.smithi008.stdout: { 2023-08-01T19:56:02.699 INFO:teuthology.orchestra.run.smithi008.stdout: "event": "reached_pg", 2023-08-01T19:56:02.699 INFO:teuthology.orchestra.run.smithi008.stdout: "time": "2023-08-01T19:56:02.650428+0000", 2023-08-01T19:56:02.699 INFO:teuthology.orchestra.run.smithi008.stdout: "duration": 3.6022999999999997e-05 2023-08-01T19:56:02.699 INFO:teuthology.orchestra.run.smithi008.stdout: }, 2023-08-01T19:56:02.699 INFO:teuthology.orchestra.run.smithi008.stdout: { 2023-08-01T19:56:02.699 INFO:teuthology.orchestra.run.smithi008.stdout: "event": "started", 2023-08-01T19:56:02.699 INFO:teuthology.orchestra.run.smithi008.stdout: "time": "2023-08-01T19:56:02.650447+0000", 2023-08-01T19:56:02.699 INFO:teuthology.orchestra.run.smithi008.stdout: "duration": 1.8411e-05 2023-08-01T19:56:02.700 INFO:teuthology.orchestra.run.smithi008.stdout: } 2023-08-01T19:56:02.700 INFO:teuthology.orchestra.run.smithi008.stdout: ] 2023-08-01T19:56:02.700 INFO:teuthology.orchestra.run.smithi008.stdout: } 2023-08-01T19:56:02.700 INFO:teuthology.orchestra.run.smithi008.stdout: }, 2023-08-01T19:56:02.700 INFO:teuthology.orchestra.run.smithi008.stdout: { 2023-08-01T19:56:02.700 INFO:teuthology.orchestra.run.smithi008.stdout: "description": "osd_repop(client.4668.0:203697 5.8 e64/19 5:12414f6a:::benchmark_data_smithi006_114134_object70036:head v 64'12757, mlcod=64'12755)", 2023-08-01T19:56:02.700 INFO:teuthology.orchestra.run.smithi008.stdout: "initiated_at": "2023-08-01T19:56:02.651001+0000", 2023-08-01T19:56:02.701 INFO:teuthology.orchestra.run.smithi008.stdout: "age": 0.0068908950000000002, 2023-08-01T19:56:02.701 INFO:teuthology.orchestra.run.smithi008.stdout: "duration": 0.007316609, 2023-08-01T19:56:02.701 INFO:teuthology.orchestra.run.smithi008.stdout: "type_data": { 2023-08-01T19:56:02.701 INFO:teuthology.orchestra.run.smithi008.stdout: "flag_point": "started", 2023-08-01T19:56:02.701 INFO:teuthology.orchestra.run.smithi008.stdout: "events": [ 2023-08-01T19:56:02.701 INFO:teuthology.orchestra.run.smithi008.stdout: { 2023-08-01T19:56:02.701 INFO:teuthology.orchestra.run.smithi008.stdout: "event": "initiated", 2023-08-01T19:56:02.701 INFO:teuthology.orchestra.run.smithi008.stdout: "time": "2023-08-01T19:56:02.651001+0000", 2023-08-01T19:56:02.702 INFO:teuthology.orchestra.run.smithi008.stdout: "duration": 0 2023-08-01T19:56:02.702 INFO:teuthology.orchestra.run.smithi008.stdout: }, 2023-08-01T19:56:02.702 INFO:teuthology.orchestra.run.smithi008.stdout: { 2023-08-01T19:56:02.702 INFO:teuthology.orchestra.run.smithi008.stdout: "event": "throttled", 2023-08-01T19:56:02.702 INFO:teuthology.orchestra.run.smithi008.stdout: "time": "2023-08-01T19:56:02.651001+0000", 2023-08-01T19:56:02.702 INFO:teuthology.orchestra.run.smithi008.stdout: "duration": 0 2023-08-01T19:56:02.702 INFO:teuthology.orchestra.run.smithi008.stdout: }, 2023-08-01T19:56:02.702 INFO:teuthology.orchestra.run.smithi008.stdout: { 2023-08-01T19:56:02.703 INFO:teuthology.orchestra.run.smithi008.stdout: "event": "header_read", 2023-08-01T19:56:02.703 INFO:teuthology.orchestra.run.smithi008.stdout: "time": "2023-08-01T19:56:02.651001+0000", 2023-08-01T19:56:02.703 INFO:teuthology.orchestra.run.smithi008.stdout: "duration": 4294967295.9999995 2023-08-01T19:56:02.703 INFO:teuthology.orchestra.run.smithi008.stdout: }, 2023-08-01T19:56:02.703 INFO:teuthology.orchestra.run.smithi008.stdout: { 2023-08-01T19:56:02.703 INFO:teuthology.orchestra.run.smithi008.stdout: "event": "all_read", 2023-08-01T19:56:02.703 INFO:teuthology.orchestra.run.smithi008.stdout: "time": "2023-08-01T19:56:02.651006+0000", 2023-08-01T19:56:02.703 INFO:teuthology.orchestra.run.smithi008.stdout: "duration": 4.9899999999999997e-06 2023-08-01T19:56:02.704 INFO:teuthology.orchestra.run.smithi008.stdout: }, 2023-08-01T19:56:02.704 INFO:teuthology.orchestra.run.smithi008.stdout: { 2023-08-01T19:56:02.704 INFO:teuthology.orchestra.run.smithi008.stdout: "event": "dispatched", 2023-08-01T19:56:02.704 INFO:teuthology.orchestra.run.smithi008.stdout: "time": "2023-08-01T19:56:02.651015+0000", 2023-08-01T19:56:02.704 INFO:teuthology.orchestra.run.smithi008.stdout: "duration": 9.8800000000000003e-06 2023-08-01T19:56:02.704 INFO:teuthology.orchestra.run.smithi008.stdout: }, 2023-08-01T19:56:02.704 INFO:teuthology.orchestra.run.smithi008.stdout: { 2023-08-01T19:56:02.705 INFO:teuthology.orchestra.run.smithi008.stdout: "event": "queued_for_pg", 2023-08-01T19:56:02.705 INFO:teuthology.orchestra.run.smithi008.stdout: "time": "2023-08-01T19:56:02.651020+0000", 2023-08-01T19:56:02.705 INFO:teuthology.orchestra.run.smithi008.stdout: "duration": 4.4070000000000003e-06 2023-08-01T19:56:02.705 INFO:teuthology.orchestra.run.smithi008.stdout: }, 2023-08-01T19:56:02.705 INFO:teuthology.orchestra.run.smithi008.stdout: { 2023-08-01T19:56:02.705 INFO:teuthology.orchestra.run.smithi008.stdout: "event": "reached_pg", 2023-08-01T19:56:02.705 INFO:teuthology.orchestra.run.smithi008.stdout: "time": "2023-08-01T19:56:02.651053+0000", 2023-08-01T19:56:02.705 INFO:teuthology.orchestra.run.smithi008.stdout: "duration": 3.2758e-05 2023-08-01T19:56:02.706 INFO:teuthology.orchestra.run.smithi008.stdout: }, 2023-08-01T19:56:02.706 INFO:teuthology.orchestra.run.smithi008.stdout: { 2023-08-01T19:56:02.706 INFO:teuthology.orchestra.run.smithi008.stdout: "event": "started", 2023-08-01T19:56:02.706 INFO:teuthology.orchestra.run.smithi008.stdout: "time": "2023-08-01T19:56:02.651071+0000", 2023-08-01T19:56:02.706 INFO:teuthology.orchestra.run.smithi008.stdout: "duration": 1.8365000000000001e-05 2023-08-01T19:56:02.706 INFO:teuthology.orchestra.run.smithi008.stdout: } 2023-08-01T19:56:02.706 INFO:teuthology.orchestra.run.smithi008.stdout: ] 2023-08-01T19:56:02.706 INFO:teuthology.orchestra.run.smithi008.stdout: } 2023-08-01T19:56:02.707 INFO:teuthology.orchestra.run.smithi008.stdout: }, 2023-08-01T19:56:02.707 INFO:teuthology.orchestra.run.smithi008.stdout: { 2023-08-01T19:56:02.707 INFO:teuthology.orchestra.run.smithi008.stdout: "description": "osd_op(client.4668.0:203701 5.c 5:3ce88bcc:::benchmark_data_smithi006_114134_object70040:head [delete] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e64)", 2023-08-01T19:56:02.707 INFO:teuthology.orchestra.run.smithi008.stdout: "initiated_at": "2023-08-01T19:56:02.652676+0000", 2023-08-01T19:56:02.707 INFO:teuthology.orchestra.run.smithi008.stdout: "age": 0.0052160940000000001, 2023-08-01T19:56:02.707 INFO:teuthology.orchestra.run.smithi008.stdout: "duration": 0.0057234729999999998, 2023-08-01T19:56:02.707 INFO:teuthology.orchestra.run.smithi008.stdout: "type_data": { 2023-08-01T19:56:02.708 INFO:teuthology.orchestra.run.smithi008.stdout: "flag_point": "started", 2023-08-01T19:56:02.708 INFO:teuthology.orchestra.run.smithi008.stdout: "client_info": { 2023-08-01T19:56:02.708 INFO:teuthology.orchestra.run.smithi008.stdout: "client": "client.4668", 2023-08-01T19:56:02.708 INFO:teuthology.orchestra.run.smithi008.stdout: "client_addr": "172.21.15.6:0/1709472247", 2023-08-01T19:56:02.709 INFO:teuthology.orchestra.run.smithi008.stdout: "tid": 203701 2023-08-01T19:56:02.709 INFO:teuthology.orchestra.run.smithi008.stdout: }, 2023-08-01T19:56:02.709 INFO:teuthology.orchestra.run.smithi008.stdout: "events": [ 2023-08-01T19:56:02.709 INFO:teuthology.orchestra.run.smithi008.stdout: { 2023-08-01T19:56:02.709 INFO:teuthology.orchestra.run.smithi008.stdout: "event": "initiated", 2023-08-01T19:56:02.709 INFO:teuthology.orchestra.run.smithi008.stdout: "time": "2023-08-01T19:56:02.652676+0000", 2023-08-01T19:56:02.709 INFO:teuthology.orchestra.run.smithi008.stdout: "duration": 0 2023-08-01T19:56:02.710 INFO:teuthology.orchestra.run.smithi008.stdout: }, 2023-08-01T19:56:02.710 INFO:teuthology.orchestra.run.smithi008.stdout: { 2023-08-01T19:56:02.710 INFO:teuthology.orchestra.run.smithi008.stdout: "event": "throttled", 2023-08-01T19:56:02.710 INFO:teuthology.orchestra.run.smithi008.stdout: "time": "2023-08-01T19:56:02.652676+0000", 2023-08-01T19:56:02.710 INFO:teuthology.orchestra.run.smithi008.stdout: "duration": 0 2023-08-01T19:56:02.710 INFO:teuthology.orchestra.run.smithi008.stdout: }, 2023-08-01T19:56:02.710 INFO:teuthology.orchestra.run.smithi008.stdout: { 2023-08-01T19:56:02.710 INFO:teuthology.orchestra.run.smithi008.stdout: "event": "header_read", 2023-08-01T19:56:02.711 INFO:teuthology.orchestra.run.smithi008.stdout: "time": "2023-08-01T19:56:02.652675+0000", 2023-08-01T19:56:02.711 INFO:teuthology.orchestra.run.smithi008.stdout: "duration": 4294967295.999999 2023-08-01T19:56:02.711 INFO:teuthology.orchestra.run.smithi008.stdout: }, 2023-08-01T19:56:02.711 INFO:teuthology.orchestra.run.smithi008.stdout: { 2023-08-01T19:56:02.711 INFO:teuthology.orchestra.run.smithi008.stdout: "event": "all_read", 2023-08-01T19:56:02.711 INFO:teuthology.orchestra.run.smithi008.stdout: "time": "2023-08-01T19:56:02.652679+0000", 2023-08-01T19:56:02.711 INFO:teuthology.orchestra.run.smithi008.stdout: "duration": 4.0459999999999999e-06 2023-08-01T19:56:02.712 INFO:teuthology.orchestra.run.smithi008.stdout: }, 2023-08-01T19:56:02.712 INFO:teuthology.orchestra.run.smithi008.stdout: { 2023-08-01T19:56:02.712 INFO:teuthology.orchestra.run.smithi008.stdout: "event": "dispatched", 2023-08-01T19:56:02.712 INFO:teuthology.orchestra.run.smithi008.stdout: "time": "2023-08-01T19:56:02.652686+0000", 2023-08-01T19:56:02.712 INFO:teuthology.orchestra.run.smithi008.stdout: "duration": 7.0779999999999998e-06 2023-08-01T19:56:02.712 INFO:teuthology.orchestra.run.smithi008.stdout: }, 2023-08-01T19:56:02.712 INFO:teuthology.orchestra.run.smithi008.stdout: { 2023-08-01T19:56:02.712 INFO:teuthology.orchestra.run.smithi008.stdout: "event": "queued_for_pg", 2023-08-01T19:56:02.713 INFO:teuthology.orchestra.run.smithi008.stdout: "time": "2023-08-01T19:56:02.652691+0000", 2023-08-01T19:56:02.713 INFO:teuthology.orchestra.run.smithi008.stdout: "duration": 4.6519999999999997e-06 2023-08-01T19:56:02.713 INFO:teuthology.orchestra.run.smithi008.stdout: }, 2023-08-01T19:56:02.713 INFO:teuthology.orchestra.run.smithi008.stdout: { 2023-08-01T19:56:02.713 INFO:teuthology.orchestra.run.smithi008.stdout: "event": "reached_pg", 2023-08-01T19:56:02.713 INFO:teuthology.orchestra.run.smithi008.stdout: "time": "2023-08-01T19:56:02.652731+0000", 2023-08-01T19:56:02.713 INFO:teuthology.orchestra.run.smithi008.stdout: "duration": 4.0256999999999998e-05 2023-08-01T19:56:02.713 INFO:teuthology.orchestra.run.smithi008.stdout: }, 2023-08-01T19:56:02.714 INFO:teuthology.orchestra.run.smithi008.stdout: { 2023-08-01T19:56:02.714 INFO:teuthology.orchestra.run.smithi008.stdout: "event": "started", 2023-08-01T19:56:02.714 INFO:teuthology.orchestra.run.smithi008.stdout: "time": "2023-08-01T19:56:02.652869+0000", 2023-08-01T19:56:02.714 INFO:teuthology.orchestra.run.smithi008.stdout: "duration": 0.00013803099999999999 2023-08-01T19:56:02.714 INFO:teuthology.orchestra.run.smithi008.stdout: } 2023-08-01T19:56:02.714 INFO:teuthology.orchestra.run.smithi008.stdout: ] 2023-08-01T19:56:02.714 INFO:teuthology.orchestra.run.smithi008.stdout: } 2023-08-01T19:56:02.715 INFO:teuthology.orchestra.run.smithi008.stdout: }, 2023-08-01T19:56:02.715 INFO:teuthology.orchestra.run.smithi008.stdout: { 2023-08-01T19:56:02.715 INFO:teuthology.orchestra.run.smithi008.stdout: "description": "osd_op(client.4668.0:203702 5.1 5:8245b7b3:::benchmark_data_smithi006_114134_object70041:head [delete] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e64)", 2023-08-01T19:56:02.715 INFO:teuthology.orchestra.run.smithi008.stdout: "initiated_at": "2023-08-01T19:56:02.652698+0000", 2023-08-01T19:56:02.715 INFO:teuthology.orchestra.run.smithi008.stdout: "age": 0.0051938080000000003, 2023-08-01T19:56:02.715 INFO:teuthology.orchestra.run.smithi008.stdout: "duration": 0.0057750889999999997, 2023-08-01T19:56:02.715 INFO:teuthology.orchestra.run.smithi008.stdout: "type_data": { 2023-08-01T19:56:02.715 INFO:teuthology.orchestra.run.smithi008.stdout: "flag_point": "started", 2023-08-01T19:56:02.716 INFO:teuthology.orchestra.run.smithi008.stdout: "client_info": { 2023-08-01T19:56:02.716 INFO:teuthology.orchestra.run.smithi008.stdout: "client": "client.4668", 2023-08-01T19:56:02.716 INFO:teuthology.orchestra.run.smithi008.stdout: "client_addr": "172.21.15.6:0/1709472247", 2023-08-01T19:56:02.716 INFO:teuthology.orchestra.run.smithi008.stdout: "tid": 203702 2023-08-01T19:56:02.716 INFO:teuthology.orchestra.run.smithi008.stdout: }, 2023-08-01T19:56:02.716 INFO:teuthology.orchestra.run.smithi008.stdout: "events": [ 2023-08-01T19:56:02.716 INFO:teuthology.orchestra.run.smithi008.stdout: { 2023-08-01T19:56:02.716 INFO:teuthology.orchestra.run.smithi008.stdout: "event": "initiated", 2023-08-01T19:56:02.717 INFO:teuthology.orchestra.run.smithi008.stdout: "time": "2023-08-01T19:56:02.652698+0000", 2023-08-01T19:56:02.717 INFO:teuthology.orchestra.run.smithi008.stdout: "duration": 0 2023-08-01T19:56:02.717 INFO:teuthology.orchestra.run.smithi008.stdout: }, 2023-08-01T19:56:02.717 INFO:teuthology.orchestra.run.smithi008.stdout: { 2023-08-01T19:56:02.717 INFO:teuthology.orchestra.run.smithi008.stdout: "event": "throttled", 2023-08-01T19:56:02.717 INFO:teuthology.orchestra.run.smithi008.stdout: "time": "2023-08-01T19:56:02.652698+0000", 2023-08-01T19:56:02.717 INFO:teuthology.orchestra.run.smithi008.stdout: "duration": 0 2023-08-01T19:56:02.717 INFO:teuthology.orchestra.run.smithi008.stdout: }, 2023-08-01T19:56:02.718 INFO:teuthology.orchestra.run.smithi008.stdout: { 2023-08-01T19:56:02.718 INFO:teuthology.orchestra.run.smithi008.stdout: "event": "header_read", 2023-08-01T19:56:02.718 INFO:teuthology.orchestra.run.smithi008.stdout: "time": "2023-08-01T19:56:02.652698+0000", 2023-08-01T19:56:02.718 INFO:teuthology.orchestra.run.smithi008.stdout: "duration": 4294967295.9999995 2023-08-01T19:56:02.718 INFO:teuthology.orchestra.run.smithi008.stdout: }, 2023-08-01T19:56:02.718 INFO:teuthology.orchestra.run.smithi008.stdout: { 2023-08-01T19:56:02.718 INFO:teuthology.orchestra.run.smithi008.stdout: "event": "all_read", 2023-08-01T19:56:02.718 INFO:teuthology.orchestra.run.smithi008.stdout: "time": "2023-08-01T19:56:02.652700+0000", 2023-08-01T19:56:02.719 INFO:teuthology.orchestra.run.smithi008.stdout: "duration": 1.826e-06 2023-08-01T19:56:02.719 INFO:teuthology.orchestra.run.smithi008.stdout: }, 2023-08-01T19:56:02.719 INFO:teuthology.orchestra.run.smithi008.stdout: { 2023-08-01T19:56:02.719 INFO:teuthology.orchestra.run.smithi008.stdout: "event": "dispatched", 2023-08-01T19:56:02.719 INFO:teuthology.orchestra.run.smithi008.stdout: "time": "2023-08-01T19:56:02.652708+0000", 2023-08-01T19:56:02.719 INFO:teuthology.orchestra.run.smithi008.stdout: "duration": 8.5590000000000006e-06 2023-08-01T19:56:02.719 INFO:teuthology.orchestra.run.smithi008.stdout: }, 2023-08-01T19:56:02.720 INFO:teuthology.orchestra.run.smithi008.stdout: { 2023-08-01T19:56:02.720 INFO:teuthology.orchestra.run.smithi008.stdout: "event": "queued_for_pg", 2023-08-01T19:56:02.720 INFO:teuthology.orchestra.run.smithi008.stdout: "time": "2023-08-01T19:56:02.652711+0000", 2023-08-01T19:56:02.720 INFO:teuthology.orchestra.run.smithi008.stdout: "duration": 3.0910000000000001e-06 2023-08-01T19:56:02.720 INFO:teuthology.orchestra.run.smithi008.stdout: }, 2023-08-01T19:56:02.720 INFO:teuthology.orchestra.run.smithi008.stdout: { 2023-08-01T19:56:02.720 INFO:teuthology.orchestra.run.smithi008.stdout: "event": "reached_pg", 2023-08-01T19:56:02.720 INFO:teuthology.orchestra.run.smithi008.stdout: "time": "2023-08-01T19:56:02.653404+0000", 2023-08-01T19:56:02.721 INFO:teuthology.orchestra.run.smithi008.stdout: "duration": 0.00069287600000000004 2023-08-01T19:56:02.721 INFO:teuthology.orchestra.run.smithi008.stdout: }, 2023-08-01T19:56:02.721 INFO:teuthology.orchestra.run.smithi008.stdout: { 2023-08-01T19:56:02.721 INFO:teuthology.orchestra.run.smithi008.stdout: "event": "started", 2023-08-01T19:56:02.721 INFO:teuthology.orchestra.run.smithi008.stdout: "time": "2023-08-01T19:56:02.653485+0000", 2023-08-01T19:56:02.721 INFO:teuthology.orchestra.run.smithi008.stdout: "duration": 8.1087999999999993e-05 2023-08-01T19:56:02.721 INFO:teuthology.orchestra.run.smithi008.stdout: } 2023-08-01T19:56:02.721 INFO:teuthology.orchestra.run.smithi008.stdout: ] 2023-08-01T19:56:02.722 INFO:teuthology.orchestra.run.smithi008.stdout: } 2023-08-01T19:56:02.722 INFO:teuthology.orchestra.run.smithi008.stdout: }, 2023-08-01T19:56:02.722 INFO:teuthology.orchestra.run.smithi008.stdout: { 2023-08-01T19:56:02.722 INFO:teuthology.orchestra.run.smithi008.stdout: "description": "osd_repop(client.4668.0:203698 5.0 e64/19 5:0245ca97:::benchmark_data_smithi006_114134_object70037:head v 64'12926, mlcod=64'12922)", 2023-08-01T19:56:02.722 INFO:teuthology.orchestra.run.smithi008.stdout: "initiated_at": "2023-08-01T19:56:02.652951+0000", 2023-08-01T19:56:02.722 INFO:teuthology.orchestra.run.smithi008.stdout: "age": 0.0049407089999999997, 2023-08-01T19:56:02.722 INFO:teuthology.orchestra.run.smithi008.stdout: "duration": 0.0055917989999999997, 2023-08-01T19:56:02.722 INFO:teuthology.orchestra.run.smithi008.stdout: "type_data": { 2023-08-01T19:56:02.723 INFO:teuthology.orchestra.run.smithi008.stdout: "flag_point": "started", 2023-08-01T19:56:02.723 INFO:teuthology.orchestra.run.smithi008.stdout: "events": [ 2023-08-01T19:56:02.723 INFO:teuthology.orchestra.run.smithi008.stdout: { 2023-08-01T19:56:02.723 INFO:teuthology.orchestra.run.smithi008.stdout: "event": "initiated", 2023-08-01T19:56:02.723 INFO:teuthology.orchestra.run.smithi008.stdout: "time": "2023-08-01T19:56:02.652951+0000", 2023-08-01T19:56:02.724 INFO:teuthology.orchestra.run.smithi008.stdout: "duration": 0 2023-08-01T19:56:02.724 INFO:teuthology.orchestra.run.smithi008.stdout: }, 2023-08-01T19:56:02.724 INFO:teuthology.orchestra.run.smithi008.stdout: { 2023-08-01T19:56:02.724 INFO:teuthology.orchestra.run.smithi008.stdout: "event": "throttled", 2023-08-01T19:56:02.725 INFO:teuthology.orchestra.run.smithi008.stdout: "time": "2023-08-01T19:56:02.652951+0000", 2023-08-01T19:56:02.725 INFO:teuthology.orchestra.run.smithi008.stdout: "duration": 0 2023-08-01T19:56:02.725 INFO:teuthology.orchestra.run.smithi008.stdout: }, 2023-08-01T19:56:02.725 INFO:teuthology.orchestra.run.smithi008.stdout: { 2023-08-01T19:56:02.726 INFO:teuthology.orchestra.run.smithi008.stdout: "event": "header_read", 2023-08-01T19:56:02.726 INFO:teuthology.orchestra.run.smithi008.stdout: "time": "2023-08-01T19:56:02.652951+0000", 2023-08-01T19:56:02.726 INFO:teuthology.orchestra.run.smithi008.stdout: "duration": 4294967295.9999995 2023-08-01T19:56:02.726 INFO:teuthology.orchestra.run.smithi008.stdout: }, 2023-08-01T19:56:02.726 INFO:teuthology.orchestra.run.smithi008.stdout: { 2023-08-01T19:56:02.726 INFO:teuthology.orchestra.run.smithi008.stdout: "event": "all_read", 2023-08-01T19:56:02.726 INFO:teuthology.orchestra.run.smithi008.stdout: "time": "2023-08-01T19:56:02.652955+0000", 2023-08-01T19:56:02.727 INFO:teuthology.orchestra.run.smithi008.stdout: "duration": 4.4129999999999999e-06 2023-08-01T19:56:02.727 INFO:teuthology.orchestra.run.smithi008.stdout: }, 2023-08-01T19:56:02.727 INFO:teuthology.orchestra.run.smithi008.stdout: { 2023-08-01T19:56:02.727 INFO:teuthology.orchestra.run.smithi008.stdout: "event": "dispatched", 2023-08-01T19:56:02.727 INFO:teuthology.orchestra.run.smithi008.stdout: "time": "2023-08-01T19:56:02.652962+0000", 2023-08-01T19:56:02.728 INFO:teuthology.orchestra.run.smithi008.stdout: "duration": 6.6549999999999998e-06 2023-08-01T19:56:02.728 INFO:teuthology.orchestra.run.smithi008.stdout: }, 2023-08-01T19:56:02.728 INFO:teuthology.orchestra.run.smithi008.stdout: { 2023-08-01T19:56:02.728 INFO:teuthology.orchestra.run.smithi008.stdout: "event": "queued_for_pg", 2023-08-01T19:56:02.728 INFO:teuthology.orchestra.run.smithi008.stdout: "time": "2023-08-01T19:56:02.652965+0000", 2023-08-01T19:56:02.728 INFO:teuthology.orchestra.run.smithi008.stdout: "duration": 3.3790000000000002e-06 2023-08-01T19:56:02.728 INFO:teuthology.orchestra.run.smithi008.stdout: }, 2023-08-01T19:56:02.729 INFO:teuthology.orchestra.run.smithi008.stdout: { 2023-08-01T19:56:02.729 INFO:teuthology.orchestra.run.smithi008.stdout: "event": "reached_pg", 2023-08-01T19:56:02.729 INFO:teuthology.orchestra.run.smithi008.stdout: "time": "2023-08-01T19:56:02.653003+0000", 2023-08-01T19:56:02.729 INFO:teuthology.orchestra.run.smithi008.stdout: "duration": 3.7481999999999998e-05 2023-08-01T19:56:02.729 INFO:teuthology.orchestra.run.smithi008.stdout: }, 2023-08-01T19:56:02.729 INFO:teuthology.orchestra.run.smithi008.stdout: { 2023-08-01T19:56:02.729 INFO:teuthology.orchestra.run.smithi008.stdout: "event": "started", 2023-08-01T19:56:02.729 INFO:teuthology.orchestra.run.smithi008.stdout: "time": "2023-08-01T19:56:02.653022+0000", 2023-08-01T19:56:02.730 INFO:teuthology.orchestra.run.smithi008.stdout: "duration": 1.9449e-05 2023-08-01T19:56:02.730 INFO:teuthology.orchestra.run.smithi008.stdout: } 2023-08-01T19:56:02.730 INFO:teuthology.orchestra.run.smithi008.stdout: ] 2023-08-01T19:56:02.730 INFO:teuthology.orchestra.run.smithi008.stdout: } 2023-08-01T19:56:02.730 INFO:teuthology.orchestra.run.smithi008.stdout: }, 2023-08-01T19:56:02.730 INFO:teuthology.orchestra.run.smithi008.stdout: { 2023-08-01T19:56:02.730 INFO:teuthology.orchestra.run.smithi008.stdout: "description": "osd_op(client.4668.0:203703 5.1 5:80af353b:::benchmark_data_smithi006_114134_object70042:head [delete] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e64)", 2023-08-01T19:56:02.730 INFO:teuthology.orchestra.run.smithi008.stdout: "initiated_at": "2023-08-01T19:56:02.653382+0000", 2023-08-01T19:56:02.731 INFO:teuthology.orchestra.run.smithi008.stdout: "age": 0.0045100440000000004, 2023-08-01T19:56:02.731 INFO:teuthology.orchestra.run.smithi008.stdout: "duration": 0.0052249490000000004, 2023-08-01T19:56:02.731 INFO:teuthology.orchestra.run.smithi008.stdout: "type_data": { 2023-08-01T19:56:02.731 INFO:teuthology.orchestra.run.smithi008.stdout: "flag_point": "started", 2023-08-01T19:56:02.731 INFO:teuthology.orchestra.run.smithi008.stdout: "client_info": { 2023-08-01T19:56:02.732 INFO:teuthology.orchestra.run.smithi008.stdout: "client": "client.4668", 2023-08-01T19:56:02.732 INFO:teuthology.orchestra.run.smithi008.stdout: "client_addr": "172.21.15.6:0/1709472247", 2023-08-01T19:56:02.732 INFO:teuthology.orchestra.run.smithi008.stdout: "tid": 203703 2023-08-01T19:56:02.732 INFO:teuthology.orchestra.run.smithi008.stdout: }, 2023-08-01T19:56:02.733 INFO:teuthology.orchestra.run.smithi008.stdout: "events": [ 2023-08-01T19:56:02.733 INFO:teuthology.orchestra.run.smithi008.stdout: { 2023-08-01T19:56:02.733 INFO:teuthology.orchestra.run.smithi008.stdout: "event": "initiated", 2023-08-01T19:56:02.733 INFO:teuthology.orchestra.run.smithi008.stdout: "time": "2023-08-01T19:56:02.653382+0000", 2023-08-01T19:56:02.733 INFO:teuthology.orchestra.run.smithi008.stdout: "duration": 0 2023-08-01T19:56:02.733 INFO:teuthology.orchestra.run.smithi008.stdout: }, 2023-08-01T19:56:02.733 INFO:teuthology.orchestra.run.smithi008.stdout: { 2023-08-01T19:56:02.734 INFO:teuthology.orchestra.run.smithi008.stdout: "event": "throttled", 2023-08-01T19:56:02.734 INFO:teuthology.orchestra.run.smithi008.stdout: "time": "2023-08-01T19:56:02.653382+0000", 2023-08-01T19:56:02.734 INFO:teuthology.orchestra.run.smithi008.stdout: "duration": 0 2023-08-01T19:56:02.734 INFO:teuthology.orchestra.run.smithi008.stdout: }, 2023-08-01T19:56:02.734 INFO:teuthology.orchestra.run.smithi008.stdout: { 2023-08-01T19:56:02.734 INFO:teuthology.orchestra.run.smithi008.stdout: "event": "header_read", 2023-08-01T19:56:02.734 INFO:teuthology.orchestra.run.smithi008.stdout: "time": "2023-08-01T19:56:02.653381+0000", 2023-08-01T19:56:02.734 INFO:teuthology.orchestra.run.smithi008.stdout: "duration": 4294967295.9999995 2023-08-01T19:56:02.735 INFO:teuthology.orchestra.run.smithi008.stdout: }, 2023-08-01T19:56:02.735 INFO:teuthology.orchestra.run.smithi008.stdout: { 2023-08-01T19:56:02.735 INFO:teuthology.orchestra.run.smithi008.stdout: "event": "all_read", 2023-08-01T19:56:02.735 INFO:teuthology.orchestra.run.smithi008.stdout: "time": "2023-08-01T19:56:02.653385+0000", 2023-08-01T19:56:02.735 INFO:teuthology.orchestra.run.smithi008.stdout: "duration": 4.0160000000000002e-06 2023-08-01T19:56:02.735 INFO:teuthology.orchestra.run.smithi008.stdout: }, 2023-08-01T19:56:02.735 INFO:teuthology.orchestra.run.smithi008.stdout: { 2023-08-01T19:56:02.735 INFO:teuthology.orchestra.run.smithi008.stdout: "event": "dispatched", 2023-08-01T19:56:02.736 INFO:teuthology.orchestra.run.smithi008.stdout: "time": "2023-08-01T19:56:02.653394+0000", 2023-08-01T19:56:02.736 INFO:teuthology.orchestra.run.smithi008.stdout: "duration": 8.8359999999999998e-06 2023-08-01T19:56:02.736 INFO:teuthology.orchestra.run.smithi008.stdout: }, 2023-08-01T19:56:02.736 INFO:teuthology.orchestra.run.smithi008.stdout: { 2023-08-01T19:56:02.736 INFO:teuthology.orchestra.run.smithi008.stdout: "event": "queued_for_pg", 2023-08-01T19:56:02.736 INFO:teuthology.orchestra.run.smithi008.stdout: "time": "2023-08-01T19:56:02.653399+0000", 2023-08-01T19:56:02.736 INFO:teuthology.orchestra.run.smithi008.stdout: "duration": 5.3669999999999996e-06 2023-08-01T19:56:02.737 INFO:teuthology.orchestra.run.smithi008.stdout: }, 2023-08-01T19:56:02.737 INFO:teuthology.orchestra.run.smithi008.stdout: { 2023-08-01T19:56:02.737 INFO:teuthology.orchestra.run.smithi008.stdout: "event": "reached_pg", 2023-08-01T19:56:02.737 INFO:teuthology.orchestra.run.smithi008.stdout: "time": "2023-08-01T19:56:02.654935+0000", 2023-08-01T19:56:02.737 INFO:teuthology.orchestra.run.smithi008.stdout: "duration": 0.0015352160000000001 2023-08-01T19:56:02.737 INFO:teuthology.orchestra.run.smithi008.stdout: }, 2023-08-01T19:56:02.737 INFO:teuthology.orchestra.run.smithi008.stdout: { 2023-08-01T19:56:02.737 INFO:teuthology.orchestra.run.smithi008.stdout: "event": "started", 2023-08-01T19:56:02.738 INFO:teuthology.orchestra.run.smithi008.stdout: "time": "2023-08-01T19:56:02.655014+0000", 2023-08-01T19:56:02.738 INFO:teuthology.orchestra.run.smithi008.stdout: "duration": 7.9358999999999997e-05 2023-08-01T19:56:02.738 INFO:teuthology.orchestra.run.smithi008.stdout: } 2023-08-01T19:56:02.738 INFO:teuthology.orchestra.run.smithi008.stdout: ] 2023-08-01T19:56:02.738 INFO:teuthology.orchestra.run.smithi008.stdout: } 2023-08-01T19:56:02.738 INFO:teuthology.orchestra.run.smithi008.stdout: }, 2023-08-01T19:56:02.738 INFO:teuthology.orchestra.run.smithi008.stdout: { 2023-08-01T19:56:02.738 INFO:teuthology.orchestra.run.smithi008.stdout: "description": "osd_repop(client.4668.0:203700 5.8 e64/19 5:19672bdc:::benchmark_data_smithi006_114134_object70039:head v 64'12758, mlcod=64'12755)", 2023-08-01T19:56:02.739 INFO:teuthology.orchestra.run.smithi008.stdout: "initiated_at": "2023-08-01T19:56:02.654368+0000", 2023-08-01T19:56:02.739 INFO:teuthology.orchestra.run.smithi008.stdout: "age": 0.0035234870000000001, 2023-08-01T19:56:02.739 INFO:teuthology.orchestra.run.smithi008.stdout: "duration": 0.0043112799999999998, 2023-08-01T19:56:02.739 INFO:teuthology.orchestra.run.smithi008.stdout: "type_data": { 2023-08-01T19:56:02.739 INFO:teuthology.orchestra.run.smithi008.stdout: "flag_point": "started", 2023-08-01T19:56:02.739 INFO:teuthology.orchestra.run.smithi008.stdout: "events": [ 2023-08-01T19:56:02.739 INFO:teuthology.orchestra.run.smithi008.stdout: { 2023-08-01T19:56:02.739 INFO:teuthology.orchestra.run.smithi008.stdout: "event": "initiated", 2023-08-01T19:56:02.740 INFO:teuthology.orchestra.run.smithi008.stdout: "time": "2023-08-01T19:56:02.654368+0000", 2023-08-01T19:56:02.740 INFO:teuthology.orchestra.run.smithi008.stdout: "duration": 0 2023-08-01T19:56:02.740 INFO:teuthology.orchestra.run.smithi008.stdout: }, 2023-08-01T19:56:02.740 INFO:teuthology.orchestra.run.smithi008.stdout: { 2023-08-01T19:56:02.740 INFO:teuthology.orchestra.run.smithi008.stdout: "event": "throttled", 2023-08-01T19:56:02.740 INFO:teuthology.orchestra.run.smithi008.stdout: "time": "2023-08-01T19:56:02.654368+0000", 2023-08-01T19:56:02.740 INFO:teuthology.orchestra.run.smithi008.stdout: "duration": 0 2023-08-01T19:56:02.741 INFO:teuthology.orchestra.run.smithi008.stdout: }, 2023-08-01T19:56:02.741 INFO:teuthology.orchestra.run.smithi008.stdout: { 2023-08-01T19:56:02.741 INFO:teuthology.orchestra.run.smithi008.stdout: "event": "header_read", 2023-08-01T19:56:02.741 INFO:teuthology.orchestra.run.smithi008.stdout: "time": "2023-08-01T19:56:02.654368+0000", 2023-08-01T19:56:02.741 INFO:teuthology.orchestra.run.smithi008.stdout: "duration": 4294967295.9999995 2023-08-01T19:56:02.741 INFO:teuthology.orchestra.run.smithi008.stdout: }, 2023-08-01T19:56:02.741 INFO:teuthology.orchestra.run.smithi008.stdout: { 2023-08-01T19:56:02.741 INFO:teuthology.orchestra.run.smithi008.stdout: "event": "all_read", 2023-08-01T19:56:02.742 INFO:teuthology.orchestra.run.smithi008.stdout: "time": "2023-08-01T19:56:02.654379+0000", 2023-08-01T19:56:02.742 INFO:teuthology.orchestra.run.smithi008.stdout: "duration": 1.1443e-05 2023-08-01T19:56:02.742 INFO:teuthology.orchestra.run.smithi008.stdout: }, 2023-08-01T19:56:02.742 INFO:teuthology.orchestra.run.smithi008.stdout: { 2023-08-01T19:56:02.742 INFO:teuthology.orchestra.run.smithi008.stdout: "event": "dispatched", 2023-08-01T19:56:02.742 INFO:teuthology.orchestra.run.smithi008.stdout: "time": "2023-08-01T19:56:02.654390+0000", 2023-08-01T19:56:02.742 INFO:teuthology.orchestra.run.smithi008.stdout: "duration": 1.0509999999999999e-05 2023-08-01T19:56:02.742 INFO:teuthology.orchestra.run.smithi008.stdout: }, 2023-08-01T19:56:02.743 INFO:teuthology.orchestra.run.smithi008.stdout: { 2023-08-01T19:56:02.743 INFO:teuthology.orchestra.run.smithi008.stdout: "event": "queued_for_pg", 2023-08-01T19:56:02.743 INFO:teuthology.orchestra.run.smithi008.stdout: "time": "2023-08-01T19:56:02.654395+0000", 2023-08-01T19:56:02.743 INFO:teuthology.orchestra.run.smithi008.stdout: "duration": 5.0930000000000002e-06 2023-08-01T19:56:02.743 INFO:teuthology.orchestra.run.smithi008.stdout: }, 2023-08-01T19:56:02.743 INFO:teuthology.orchestra.run.smithi008.stdout: { 2023-08-01T19:56:02.743 INFO:teuthology.orchestra.run.smithi008.stdout: "event": "reached_pg", 2023-08-01T19:56:02.743 INFO:teuthology.orchestra.run.smithi008.stdout: "time": "2023-08-01T19:56:02.654432+0000", 2023-08-01T19:56:02.744 INFO:teuthology.orchestra.run.smithi008.stdout: "duration": 3.7457999999999999e-05 2023-08-01T19:56:02.744 INFO:teuthology.orchestra.run.smithi008.stdout: }, 2023-08-01T19:56:02.744 INFO:teuthology.orchestra.run.smithi008.stdout: { 2023-08-01T19:56:02.744 INFO:teuthology.orchestra.run.smithi008.stdout: "event": "started", 2023-08-01T19:56:02.744 INFO:teuthology.orchestra.run.smithi008.stdout: "time": "2023-08-01T19:56:02.654452+0000", 2023-08-01T19:56:02.744 INFO:teuthology.orchestra.run.smithi008.stdout: "duration": 1.9202999999999999e-05 2023-08-01T19:56:02.744 INFO:teuthology.orchestra.run.smithi008.stdout: } 2023-08-01T19:56:02.744 INFO:teuthology.orchestra.run.smithi008.stdout: ] 2023-08-01T19:56:02.745 INFO:teuthology.orchestra.run.smithi008.stdout: } 2023-08-01T19:56:02.745 INFO:teuthology.orchestra.run.smithi008.stdout: }, 2023-08-01T19:56:02.745 INFO:teuthology.orchestra.run.smithi008.stdout: { 2023-08-01T19:56:02.745 INFO:teuthology.orchestra.run.smithi008.stdout: "description": "osd_repop(client.4668.0:203699 5.0 e64/19 5:0800ad50:::benchmark_data_smithi006_114134_object70038:head v 64'12927, mlcod=64'12922)", 2023-08-01T19:56:02.745 INFO:teuthology.orchestra.run.smithi008.stdout: "initiated_at": "2023-08-01T19:56:02.654402+0000", 2023-08-01T19:56:02.745 INFO:teuthology.orchestra.run.smithi008.stdout: "age": 0.0034899459999999998, 2023-08-01T19:56:02.745 INFO:teuthology.orchestra.run.smithi008.stdout: "duration": 0.0043502330000000002, 2023-08-01T19:56:02.746 INFO:teuthology.orchestra.run.smithi008.stdout: "type_data": { 2023-08-01T19:56:02.746 INFO:teuthology.orchestra.run.smithi008.stdout: "flag_point": "started", 2023-08-01T19:56:02.746 INFO:teuthology.orchestra.run.smithi008.stdout: "events": [ 2023-08-01T19:56:02.746 INFO:teuthology.orchestra.run.smithi008.stdout: { 2023-08-01T19:56:02.746 INFO:teuthology.orchestra.run.smithi008.stdout: "event": "initiated", 2023-08-01T19:56:02.746 INFO:teuthology.orchestra.run.smithi008.stdout: "time": "2023-08-01T19:56:02.654402+0000", 2023-08-01T19:56:02.746 INFO:teuthology.orchestra.run.smithi008.stdout: "duration": 0 2023-08-01T19:56:02.746 INFO:teuthology.orchestra.run.smithi008.stdout: }, 2023-08-01T19:56:02.747 INFO:teuthology.orchestra.run.smithi008.stdout: { 2023-08-01T19:56:02.747 INFO:teuthology.orchestra.run.smithi008.stdout: "event": "throttled", 2023-08-01T19:56:02.747 INFO:teuthology.orchestra.run.smithi008.stdout: "time": "2023-08-01T19:56:02.654402+0000", 2023-08-01T19:56:02.747 INFO:teuthology.orchestra.run.smithi008.stdout: "duration": 0 2023-08-01T19:56:02.747 INFO:teuthology.orchestra.run.smithi008.stdout: }, 2023-08-01T19:56:02.747 INFO:teuthology.orchestra.run.smithi008.stdout: { 2023-08-01T19:56:02.747 INFO:teuthology.orchestra.run.smithi008.stdout: "event": "header_read", 2023-08-01T19:56:02.747 INFO:teuthology.orchestra.run.smithi008.stdout: "time": "2023-08-01T19:56:02.654402+0000", 2023-08-01T19:56:02.748 INFO:teuthology.orchestra.run.smithi008.stdout: "duration": 4294967296 2023-08-01T19:56:02.748 INFO:teuthology.orchestra.run.smithi008.stdout: }, 2023-08-01T19:56:02.748 INFO:teuthology.orchestra.run.smithi008.stdout: { 2023-08-01T19:56:02.748 INFO:teuthology.orchestra.run.smithi008.stdout: "event": "all_read", 2023-08-01T19:56:02.748 INFO:teuthology.orchestra.run.smithi008.stdout: "time": "2023-08-01T19:56:02.654405+0000", 2023-08-01T19:56:02.748 INFO:teuthology.orchestra.run.smithi008.stdout: "duration": 3.3699999999999999e-06 2023-08-01T19:56:02.748 INFO:teuthology.orchestra.run.smithi008.stdout: }, 2023-08-01T19:56:02.748 INFO:teuthology.orchestra.run.smithi008.stdout: { 2023-08-01T19:56:02.749 INFO:teuthology.orchestra.run.smithi008.stdout: "event": "dispatched", 2023-08-01T19:56:02.749 INFO:teuthology.orchestra.run.smithi008.stdout: "time": "2023-08-01T19:56:02.654417+0000", 2023-08-01T19:56:02.749 INFO:teuthology.orchestra.run.smithi008.stdout: "duration": 1.2334000000000001e-05 2023-08-01T19:56:02.749 INFO:teuthology.orchestra.run.smithi008.stdout: }, 2023-08-01T19:56:02.749 INFO:teuthology.orchestra.run.smithi008.stdout: { 2023-08-01T19:56:02.749 INFO:teuthology.orchestra.run.smithi008.stdout: "event": "queued_for_pg", 2023-08-01T19:56:02.749 INFO:teuthology.orchestra.run.smithi008.stdout: "time": "2023-08-01T19:56:02.654421+0000", 2023-08-01T19:56:02.750 INFO:teuthology.orchestra.run.smithi008.stdout: "duration": 3.6660000000000001e-06 2023-08-01T19:56:02.750 INFO:teuthology.orchestra.run.smithi008.stdout: }, 2023-08-01T19:56:02.750 INFO:teuthology.orchestra.run.smithi008.stdout: { 2023-08-01T19:56:02.750 INFO:teuthology.orchestra.run.smithi008.stdout: "event": "reached_pg", 2023-08-01T19:56:02.750 INFO:teuthology.orchestra.run.smithi008.stdout: "time": "2023-08-01T19:56:02.654895+0000", 2023-08-01T19:56:02.750 INFO:teuthology.orchestra.run.smithi008.stdout: "duration": 0.00047421699999999998 2023-08-01T19:56:02.750 INFO:teuthology.orchestra.run.smithi008.stdout: }, 2023-08-01T19:56:02.750 INFO:teuthology.orchestra.run.smithi008.stdout: { 2023-08-01T19:56:02.751 INFO:teuthology.orchestra.run.smithi008.stdout: "event": "started", 2023-08-01T19:56:02.751 INFO:teuthology.orchestra.run.smithi008.stdout: "time": "2023-08-01T19:56:02.654916+0000", 2023-08-01T19:56:02.751 INFO:teuthology.orchestra.run.smithi008.stdout: "duration": 2.0330999999999999e-05 2023-08-01T19:56:02.751 INFO:teuthology.orchestra.run.smithi008.stdout: } 2023-08-01T19:56:02.751 INFO:teuthology.orchestra.run.smithi008.stdout: ] 2023-08-01T19:56:02.751 INFO:teuthology.orchestra.run.smithi008.stdout: } 2023-08-01T19:56:02.751 INFO:teuthology.orchestra.run.smithi008.stdout: }, 2023-08-01T19:56:02.751 INFO:teuthology.orchestra.run.smithi008.stdout: { 2023-08-01T19:56:02.752 INFO:teuthology.orchestra.run.smithi008.stdout: "description": "osd_repop(client.4668.0:203704 5.0 e64/19 5:02d17676:::benchmark_data_smithi006_114134_object70043:head v 64'12928, mlcod=64'12922)", 2023-08-01T19:56:02.752 INFO:teuthology.orchestra.run.smithi008.stdout: "initiated_at": "2023-08-01T19:56:02.655541+0000", 2023-08-01T19:56:02.752 INFO:teuthology.orchestra.run.smithi008.stdout: "age": 0.0023513119999999999, 2023-08-01T19:56:02.752 INFO:teuthology.orchestra.run.smithi008.stdout: "duration": 0.0032563800000000001, 2023-08-01T19:56:02.752 INFO:teuthology.orchestra.run.smithi008.stdout: "type_data": { 2023-08-01T19:56:02.752 INFO:teuthology.orchestra.run.smithi008.stdout: "flag_point": "started", 2023-08-01T19:56:02.752 INFO:teuthology.orchestra.run.smithi008.stdout: "events": [ 2023-08-01T19:56:02.752 INFO:teuthology.orchestra.run.smithi008.stdout: { 2023-08-01T19:56:02.753 INFO:teuthology.orchestra.run.smithi008.stdout: "event": "initiated", 2023-08-01T19:56:02.753 INFO:teuthology.orchestra.run.smithi008.stdout: "time": "2023-08-01T19:56:02.655541+0000", 2023-08-01T19:56:02.753 INFO:teuthology.orchestra.run.smithi008.stdout: "duration": 0 2023-08-01T19:56:02.753 INFO:teuthology.orchestra.run.smithi008.stdout: }, 2023-08-01T19:56:02.753 INFO:teuthology.orchestra.run.smithi008.stdout: { 2023-08-01T19:56:02.753 INFO:teuthology.orchestra.run.smithi008.stdout: "event": "throttled", 2023-08-01T19:56:02.753 INFO:teuthology.orchestra.run.smithi008.stdout: "time": "2023-08-01T19:56:02.655541+0000", 2023-08-01T19:56:02.753 INFO:teuthology.orchestra.run.smithi008.stdout: "duration": 0 2023-08-01T19:56:02.754 INFO:teuthology.orchestra.run.smithi008.stdout: }, 2023-08-01T19:56:02.754 INFO:teuthology.orchestra.run.smithi008.stdout: { 2023-08-01T19:56:02.754 INFO:teuthology.orchestra.run.smithi008.stdout: "event": "header_read", 2023-08-01T19:56:02.754 INFO:teuthology.orchestra.run.smithi008.stdout: "time": "2023-08-01T19:56:02.655540+0000", 2023-08-01T19:56:02.754 INFO:teuthology.orchestra.run.smithi008.stdout: "duration": 4294967295.9999995 2023-08-01T19:56:02.754 INFO:teuthology.orchestra.run.smithi008.stdout: }, 2023-08-01T19:56:02.754 INFO:teuthology.orchestra.run.smithi008.stdout: { 2023-08-01T19:56:02.754 INFO:teuthology.orchestra.run.smithi008.stdout: "event": "all_read", 2023-08-01T19:56:02.755 INFO:teuthology.orchestra.run.smithi008.stdout: "time": "2023-08-01T19:56:02.655545+0000", 2023-08-01T19:56:02.755 INFO:teuthology.orchestra.run.smithi008.stdout: "duration": 4.7859999999999996e-06 2023-08-01T19:56:02.755 INFO:teuthology.orchestra.run.smithi008.stdout: }, 2023-08-01T19:56:02.755 INFO:teuthology.orchestra.run.smithi008.stdout: { 2023-08-01T19:56:02.755 INFO:teuthology.orchestra.run.smithi008.stdout: "event": "dispatched", 2023-08-01T19:56:02.755 INFO:teuthology.orchestra.run.smithi008.stdout: "time": "2023-08-01T19:56:02.655553+0000", 2023-08-01T19:56:02.755 INFO:teuthology.orchestra.run.smithi008.stdout: "duration": 8.2740000000000007e-06 2023-08-01T19:56:02.755 INFO:teuthology.orchestra.run.smithi008.stdout: }, 2023-08-01T19:56:02.756 INFO:teuthology.orchestra.run.smithi008.stdout: { 2023-08-01T19:56:02.756 INFO:teuthology.orchestra.run.smithi008.stdout: "event": "queued_for_pg", 2023-08-01T19:56:02.756 INFO:teuthology.orchestra.run.smithi008.stdout: "time": "2023-08-01T19:56:02.655558+0000", 2023-08-01T19:56:02.756 INFO:teuthology.orchestra.run.smithi008.stdout: "duration": 4.6959999999999996e-06 2023-08-01T19:56:02.756 INFO:teuthology.orchestra.run.smithi008.stdout: }, 2023-08-01T19:56:02.756 INFO:teuthology.orchestra.run.smithi008.stdout: { 2023-08-01T19:56:02.756 INFO:teuthology.orchestra.run.smithi008.stdout: "event": "reached_pg", 2023-08-01T19:56:02.757 INFO:teuthology.orchestra.run.smithi008.stdout: "time": "2023-08-01T19:56:02.656564+0000", 2023-08-01T19:56:02.757 INFO:teuthology.orchestra.run.smithi008.stdout: "duration": 0.0010057670000000001 2023-08-01T19:56:02.757 INFO:teuthology.orchestra.run.smithi008.stdout: }, 2023-08-01T19:56:02.757 INFO:teuthology.orchestra.run.smithi008.stdout: { 2023-08-01T19:56:02.757 INFO:teuthology.orchestra.run.smithi008.stdout: "event": "started", 2023-08-01T19:56:02.757 INFO:teuthology.orchestra.run.smithi008.stdout: "time": "2023-08-01T19:56:02.656584+0000", 2023-08-01T19:56:02.757 INFO:teuthology.orchestra.run.smithi008.stdout: "duration": 2.0477999999999999e-05 2023-08-01T19:56:02.757 INFO:teuthology.orchestra.run.smithi008.stdout: } 2023-08-01T19:56:02.758 INFO:teuthology.orchestra.run.smithi008.stdout: ] 2023-08-01T19:56:02.758 INFO:teuthology.orchestra.run.smithi008.stdout: } 2023-08-01T19:56:02.758 INFO:teuthology.orchestra.run.smithi008.stdout: }, 2023-08-01T19:56:02.758 INFO:teuthology.orchestra.run.smithi008.stdout: { 2023-08-01T19:56:02.758 INFO:teuthology.orchestra.run.smithi008.stdout: "description": "osd_op(client.4668.0:203706 5.7 5:e22c5c79:::benchmark_data_smithi006_114134_object70045:head [delete] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e64)", 2023-08-01T19:56:02.758 INFO:teuthology.orchestra.run.smithi008.stdout: "initiated_at": "2023-08-01T19:56:02.656383+0000", 2023-08-01T19:56:02.758 INFO:teuthology.orchestra.run.smithi008.stdout: "age": 0.0015088689999999999, 2023-08-01T19:56:02.759 INFO:teuthology.orchestra.run.smithi008.stdout: "duration": 0.0024502249999999999, 2023-08-01T19:56:02.759 INFO:teuthology.orchestra.run.smithi008.stdout: "type_data": { 2023-08-01T19:56:02.759 INFO:teuthology.orchestra.run.smithi008.stdout: "flag_point": "started", 2023-08-01T19:56:02.759 INFO:teuthology.orchestra.run.smithi008.stdout: "client_info": { 2023-08-01T19:56:02.759 INFO:teuthology.orchestra.run.smithi008.stdout: "client": "client.4668", 2023-08-01T19:56:02.759 INFO:teuthology.orchestra.run.smithi008.stdout: "client_addr": "172.21.15.6:0/1709472247", 2023-08-01T19:56:02.759 INFO:teuthology.orchestra.run.smithi008.stdout: "tid": 203706 2023-08-01T19:56:02.759 INFO:teuthology.orchestra.run.smithi008.stdout: }, 2023-08-01T19:56:02.760 INFO:teuthology.orchestra.run.smithi008.stdout: "events": [ 2023-08-01T19:56:02.760 INFO:teuthology.orchestra.run.smithi008.stdout: { 2023-08-01T19:56:02.760 INFO:teuthology.orchestra.run.smithi008.stdout: "event": "initiated", 2023-08-01T19:56:02.760 INFO:teuthology.orchestra.run.smithi008.stdout: "time": "2023-08-01T19:56:02.656383+0000", 2023-08-01T19:56:02.760 INFO:teuthology.orchestra.run.smithi008.stdout: "duration": 0 2023-08-01T19:56:02.760 INFO:teuthology.orchestra.run.smithi008.stdout: }, 2023-08-01T19:56:02.760 INFO:teuthology.orchestra.run.smithi008.stdout: { 2023-08-01T19:56:02.761 INFO:teuthology.orchestra.run.smithi008.stdout: "event": "throttled", 2023-08-01T19:56:02.761 INFO:teuthology.orchestra.run.smithi008.stdout: "time": "2023-08-01T19:56:02.656383+0000", 2023-08-01T19:56:02.761 INFO:teuthology.orchestra.run.smithi008.stdout: "duration": 0 2023-08-01T19:56:02.761 INFO:teuthology.orchestra.run.smithi008.stdout: }, 2023-08-01T19:56:02.761 INFO:teuthology.orchestra.run.smithi008.stdout: { 2023-08-01T19:56:02.761 INFO:teuthology.orchestra.run.smithi008.stdout: "event": "header_read", 2023-08-01T19:56:02.761 INFO:teuthology.orchestra.run.smithi008.stdout: "time": "2023-08-01T19:56:02.656382+0000", 2023-08-01T19:56:02.761 INFO:teuthology.orchestra.run.smithi008.stdout: "duration": 4294967295.999999 2023-08-01T19:56:02.762 INFO:teuthology.orchestra.run.smithi008.stdout: }, 2023-08-01T19:56:02.762 INFO:teuthology.orchestra.run.smithi008.stdout: { 2023-08-01T19:56:02.762 INFO:teuthology.orchestra.run.smithi008.stdout: "event": "all_read", 2023-08-01T19:56:02.762 INFO:teuthology.orchestra.run.smithi008.stdout: "time": "2023-08-01T19:56:02.656387+0000", 2023-08-01T19:56:02.762 INFO:teuthology.orchestra.run.smithi008.stdout: "duration": 5.3260000000000003e-06 2023-08-01T19:56:02.762 INFO:teuthology.orchestra.run.smithi008.stdout: }, 2023-08-01T19:56:02.762 INFO:teuthology.orchestra.run.smithi008.stdout: { 2023-08-01T19:56:02.762 INFO:teuthology.orchestra.run.smithi008.stdout: "event": "dispatched", 2023-08-01T19:56:02.763 INFO:teuthology.orchestra.run.smithi008.stdout: "time": "2023-08-01T19:56:02.656401+0000", 2023-08-01T19:56:02.763 INFO:teuthology.orchestra.run.smithi008.stdout: "duration": 1.3249e-05 2023-08-01T19:56:02.763 INFO:teuthology.orchestra.run.smithi008.stdout: }, 2023-08-01T19:56:02.763 INFO:teuthology.orchestra.run.smithi008.stdout: { 2023-08-01T19:56:02.763 INFO:teuthology.orchestra.run.smithi008.stdout: "event": "queued_for_pg", 2023-08-01T19:56:02.763 INFO:teuthology.orchestra.run.smithi008.stdout: "time": "2023-08-01T19:56:02.656407+0000", 2023-08-01T19:56:02.764 INFO:teuthology.orchestra.run.smithi008.stdout: "duration": 6.4320000000000004e-06 2023-08-01T19:56:02.764 INFO:teuthology.orchestra.run.smithi008.stdout: }, 2023-08-01T19:56:02.764 INFO:teuthology.orchestra.run.smithi008.stdout: { 2023-08-01T19:56:02.764 INFO:teuthology.orchestra.run.smithi008.stdout: "event": "reached_pg", 2023-08-01T19:56:02.764 INFO:teuthology.orchestra.run.smithi008.stdout: "time": "2023-08-01T19:56:02.656447+0000", 2023-08-01T19:56:02.764 INFO:teuthology.orchestra.run.smithi008.stdout: "duration": 3.9369999999999997e-05 2023-08-01T19:56:02.764 INFO:teuthology.orchestra.run.smithi008.stdout: }, 2023-08-01T19:56:02.765 INFO:teuthology.orchestra.run.smithi008.stdout: { 2023-08-01T19:56:02.765 INFO:teuthology.orchestra.run.smithi008.stdout: "event": "started", 2023-08-01T19:56:02.765 INFO:teuthology.orchestra.run.smithi008.stdout: "time": "2023-08-01T19:56:02.656532+0000", 2023-08-01T19:56:02.765 INFO:teuthology.orchestra.run.smithi008.stdout: "duration": 8.5921000000000006e-05 2023-08-01T19:56:02.765 INFO:teuthology.orchestra.run.smithi008.stdout: } 2023-08-01T19:56:02.765 INFO:teuthology.orchestra.run.smithi008.stdout: ] 2023-08-01T19:56:02.765 INFO:teuthology.orchestra.run.smithi008.stdout: } 2023-08-01T19:56:02.765 INFO:teuthology.orchestra.run.smithi008.stdout: } 2023-08-01T19:56:02.766 INFO:teuthology.orchestra.run.smithi008.stdout: ], 2023-08-01T19:56:02.766 INFO:teuthology.orchestra.run.smithi008.stdout: "num_ops": 15 2023-08-01T19:56:02.766 INFO:teuthology.orchestra.run.smithi008.stdout:} 2023-08-01T19:56:02.767 DEBUG:teuthology.orchestra.run.smithi008:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 30 ceph --cluster ceph --admin-daemon /var/run/ceph/ceph-osd.0.asok dump_blocked_ops 2023-08-01T19:56:02.768 INFO:tasks.ceph.osd.0.smithi008.stderr:2023-08-01T19:56:02.765+0000 7f16a58f4700 -1 received signal: Hangup from /usr/bin/python3 /bin/daemon-helper kill ceph-osd -f --cluster ceph -i 0 (PID: 111179) UID: 0 2023-08-01T19:56:02.868 INFO:tasks.ceph.osd.2.smithi155.stderr:2023-08-01T19:56:02.866+0000 7faa5c6ac700 -1 received signal: Hangup from /usr/bin/python3 /bin/daemon-helper kill ceph-osd -f --cluster ceph -i 2 (PID: 111337) UID: 0 2023-08-01T19:56:02.968 INFO:tasks.ceph.osd.0.smithi008.stderr:2023-08-01T19:56:02.966+0000 7f16a58f4700 -1 received signal: Hangup from /usr/bin/python3 /bin/daemon-helper kill ceph-osd -f --cluster ceph -i 0 (PID: 111179) UID: 0 2023-08-01T19:56:02.993 INFO:teuthology.orchestra.run.smithi008.stdout:{ 2023-08-01T19:56:02.994 INFO:teuthology.orchestra.run.smithi008.stdout: "ops": [], 2023-08-01T19:56:02.994 INFO:teuthology.orchestra.run.smithi008.stdout: "complaint_time": 30, 2023-08-01T19:56:02.994 INFO:teuthology.orchestra.run.smithi008.stdout: "num_blocked_ops": 0 2023-08-01T19:56:02.994 INFO:teuthology.orchestra.run.smithi008.stdout:} 2023-08-01T19:56:03.008 DEBUG:teuthology.orchestra.run.smithi008:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 30 ceph --cluster ceph --admin-daemon /var/run/ceph/ceph-osd.0.asok dump_historic_ops 2023-08-01T19:56:03.068 INFO:tasks.ceph.osd.2.smithi155.stderr:2023-08-01T19:56:03.067+0000 7faa5c6ac700 -1 received signal: Hangup from /usr/bin/python3 /bin/daemon-helper kill ceph-osd -f --cluster ceph -i 2 (PID: 111337) UID: 0 2023-08-01T19:56:03.172 INFO:tasks.ceph.osd.0.smithi008.stderr:2023-08-01T19:56:03.168+0000 7f16a58f4700 -1 received signal: Hangup from /usr/bin/python3 /bin/daemon-helper kill ceph-osd -f --cluster ceph -i 0 (PID: 111179) UID: 0 2023-08-01T19:56:03.239 INFO:teuthology.orchestra.run.smithi008.stdout:{ 2023-08-01T19:56:03.239 INFO:teuthology.orchestra.run.smithi008.stdout: "size": 20, 2023-08-01T19:56:03.240 INFO:teuthology.orchestra.run.smithi008.stdout: "duration": 600, 2023-08-01T19:56:03.240 INFO:teuthology.orchestra.run.smithi008.stdout: "ops": [ 2023-08-01T19:56:03.240 INFO:teuthology.orchestra.run.smithi008.stdout: { 2023-08-01T19:56:03.240 INFO:teuthology.orchestra.run.smithi008.stdout: "description": "osd_op(client.4668.0:100240 5.a 5:5313c5b9:::benchmark_data_smithi006_114134_object100239:head [set-alloc-hint object_size 65536 write_size 65536,write 0~65536] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e37)", 2023-08-01T19:56:03.240 INFO:teuthology.orchestra.run.smithi008.stdout: "initiated_at": "2023-08-01T19:55:05.148399+0000", 2023-08-01T19:56:03.240 INFO:teuthology.orchestra.run.smithi008.stdout: "age": 58.087159888000002, 2023-08-01T19:56:03.241 INFO:teuthology.orchestra.run.smithi008.stdout: "duration": 0.077278904999999995, 2023-08-01T19:56:03.241 INFO:teuthology.orchestra.run.smithi008.stdout: "type_data": { 2023-08-01T19:56:03.241 INFO:teuthology.orchestra.run.smithi008.stdout: "flag_point": "commit sent; apply or cleanup", 2023-08-01T19:56:03.241 INFO:teuthology.orchestra.run.smithi008.stdout: "client_info": { 2023-08-01T19:56:03.241 INFO:teuthology.orchestra.run.smithi008.stdout: "client": "client.4668", 2023-08-01T19:56:03.241 INFO:teuthology.orchestra.run.smithi008.stdout: "client_addr": "172.21.15.6:0/1709472247", 2023-08-01T19:56:03.242 INFO:teuthology.orchestra.run.smithi008.stdout: "tid": 100240 2023-08-01T19:56:03.242 INFO:teuthology.orchestra.run.smithi008.stdout: }, 2023-08-01T19:56:03.242 INFO:teuthology.orchestra.run.smithi008.stdout: "events": [ 2023-08-01T19:56:03.242 INFO:teuthology.orchestra.run.smithi008.stdout: { 2023-08-01T19:56:03.242 INFO:teuthology.orchestra.run.smithi008.stdout: "event": "initiated", 2023-08-01T19:56:03.242 INFO:teuthology.orchestra.run.smithi008.stdout: "time": "2023-08-01T19:55:05.148399+0000", 2023-08-01T19:56:03.243 INFO:teuthology.orchestra.run.smithi008.stdout: "duration": 0 2023-08-01T19:56:03.243 INFO:teuthology.orchestra.run.smithi008.stdout: }, 2023-08-01T19:56:03.243 INFO:teuthology.orchestra.run.smithi008.stdout: { 2023-08-01T19:56:03.243 INFO:teuthology.orchestra.run.smithi008.stdout: "event": "throttled", 2023-08-01T19:56:03.243 INFO:teuthology.orchestra.run.smithi008.stdout: "time": "2023-08-01T19:55:05.148399+0000", 2023-08-01T19:56:03.243 INFO:teuthology.orchestra.run.smithi008.stdout: "duration": 0 2023-08-01T19:56:03.243 INFO:teuthology.orchestra.run.smithi008.stdout: }, 2023-08-01T19:56:03.243 INFO:teuthology.orchestra.run.smithi008.stdout: { 2023-08-01T19:56:03.244 INFO:teuthology.orchestra.run.smithi008.stdout: "event": "header_read", 2023-08-01T19:56:03.244 INFO:teuthology.orchestra.run.smithi008.stdout: "time": "2023-08-01T19:55:05.148398+0000", 2023-08-01T19:56:03.244 INFO:teuthology.orchestra.run.smithi008.stdout: "duration": 4294967295.999999 2023-08-01T19:56:03.244 INFO:teuthology.orchestra.run.smithi008.stdout: }, 2023-08-01T19:56:03.244 INFO:teuthology.orchestra.run.smithi008.stdout: { 2023-08-01T19:56:03.244 INFO:teuthology.orchestra.run.smithi008.stdout: "event": "all_read", 2023-08-01T19:56:03.244 INFO:teuthology.orchestra.run.smithi008.stdout: "time": "2023-08-01T19:55:05.148492+0000", 2023-08-01T19:56:03.245 INFO:teuthology.orchestra.run.smithi008.stdout: "duration": 9.3892000000000002e-05 2023-08-01T19:56:03.245 INFO:teuthology.orchestra.run.smithi008.stdout: }, 2023-08-01T19:56:03.245 INFO:teuthology.orchestra.run.smithi008.stdout: { 2023-08-01T19:56:03.245 INFO:teuthology.orchestra.run.smithi008.stdout: "event": "dispatched", 2023-08-01T19:56:03.245 INFO:teuthology.orchestra.run.smithi008.stdout: "time": "2023-08-01T19:55:05.148503+0000", 2023-08-01T19:56:03.245 INFO:teuthology.orchestra.run.smithi008.stdout: "duration": 1.0951000000000001e-05 2023-08-01T19:56:03.245 INFO:teuthology.orchestra.run.smithi008.stdout: }, 2023-08-01T19:56:03.245 INFO:teuthology.orchestra.run.smithi008.stdout: { 2023-08-01T19:56:03.246 INFO:teuthology.orchestra.run.smithi008.stdout: "event": "queued_for_pg", 2023-08-01T19:56:03.246 INFO:teuthology.orchestra.run.smithi008.stdout: "time": "2023-08-01T19:55:05.148508+0000", 2023-08-01T19:56:03.246 INFO:teuthology.orchestra.run.smithi008.stdout: "duration": 5.0080000000000002e-06 2023-08-01T19:56:03.246 INFO:teuthology.orchestra.run.smithi008.stdout: }, 2023-08-01T19:56:03.247 INFO:teuthology.orchestra.run.smithi008.stdout: { 2023-08-01T19:56:03.247 INFO:teuthology.orchestra.run.smithi008.stdout: "event": "reached_pg", 2023-08-01T19:56:03.247 INFO:teuthology.orchestra.run.smithi008.stdout: "time": "2023-08-01T19:55:05.148548+0000", 2023-08-01T19:56:03.248 INFO:teuthology.orchestra.run.smithi008.stdout: "duration": 4.0358999999999998e-05 2023-08-01T19:56:03.248 INFO:teuthology.orchestra.run.smithi008.stdout: }, 2023-08-01T19:56:03.248 INFO:teuthology.orchestra.run.smithi008.stdout: { 2023-08-01T19:56:03.249 INFO:teuthology.orchestra.run.smithi008.stdout: "event": "started", 2023-08-01T19:56:03.249 INFO:teuthology.orchestra.run.smithi008.stdout: "time": "2023-08-01T19:55:05.148666+0000", 2023-08-01T19:56:03.249 INFO:teuthology.orchestra.run.smithi008.stdout: "duration": 0.000117621 2023-08-01T19:56:03.249 INFO:teuthology.orchestra.run.smithi008.stdout: }, 2023-08-01T19:56:03.250 INFO:teuthology.orchestra.run.smithi008.stdout: { 2023-08-01T19:56:03.250 INFO:teuthology.orchestra.run.smithi008.stdout: "event": "waiting for subops from 2", 2023-08-01T19:56:03.250 INFO:teuthology.orchestra.run.smithi008.stdout: "time": "2023-08-01T19:55:05.148805+0000", 2023-08-01T19:56:03.250 INFO:teuthology.orchestra.run.smithi008.stdout: "duration": 0.000139176 2023-08-01T19:56:03.251 INFO:teuthology.orchestra.run.smithi008.stdout: }, 2023-08-01T19:56:03.251 INFO:teuthology.orchestra.run.smithi008.stdout: { 2023-08-01T19:56:03.251 INFO:teuthology.orchestra.run.smithi008.stdout: "event": "op_commit", 2023-08-01T19:56:03.251 INFO:teuthology.orchestra.run.smithi008.stdout: "time": "2023-08-01T19:55:05.156143+0000", 2023-08-01T19:56:03.251 INFO:teuthology.orchestra.run.smithi008.stdout: "duration": 0.007338041 2023-08-01T19:56:03.251 INFO:teuthology.orchestra.run.smithi008.stdout: }, 2023-08-01T19:56:03.251 INFO:teuthology.orchestra.run.smithi008.stdout: { 2023-08-01T19:56:03.252 INFO:teuthology.orchestra.run.smithi008.stdout: "event": "sub_op_commit_rec", 2023-08-01T19:56:03.252 INFO:teuthology.orchestra.run.smithi008.stdout: "time": "2023-08-01T19:55:05.225581+0000", 2023-08-01T19:56:03.252 INFO:teuthology.orchestra.run.smithi008.stdout: "duration": 0.069438402999999996 2023-08-01T19:56:03.252 INFO:teuthology.orchestra.run.smithi008.stdout: }, 2023-08-01T19:56:03.253 INFO:teuthology.orchestra.run.smithi008.stdout: { 2023-08-01T19:56:03.253 INFO:teuthology.orchestra.run.smithi008.stdout: "event": "commit_sent", 2023-08-01T19:56:03.253 INFO:teuthology.orchestra.run.smithi008.stdout: "time": "2023-08-01T19:55:05.225632+0000", 2023-08-01T19:56:03.253 INFO:teuthology.orchestra.run.smithi008.stdout: "duration": 5.0382e-05 2023-08-01T19:56:03.253 INFO:teuthology.orchestra.run.smithi008.stdout: }, 2023-08-01T19:56:03.253 INFO:teuthology.orchestra.run.smithi008.stdout: { 2023-08-01T19:56:03.253 INFO:teuthology.orchestra.run.smithi008.stdout: "event": "done", 2023-08-01T19:56:03.253 INFO:teuthology.orchestra.run.smithi008.stdout: "time": "2023-08-01T19:55:05.225677+0000", 2023-08-01T19:56:03.254 INFO:teuthology.orchestra.run.smithi008.stdout: "duration": 4.5893000000000003e-05 2023-08-01T19:56:03.254 INFO:teuthology.orchestra.run.smithi008.stdout: } 2023-08-01T19:56:03.254 INFO:teuthology.orchestra.run.smithi008.stdout: ] 2023-08-01T19:56:03.254 INFO:teuthology.orchestra.run.smithi008.stdout: } 2023-08-01T19:56:03.254 INFO:teuthology.orchestra.run.smithi008.stdout: }, 2023-08-01T19:56:03.254 INFO:teuthology.orchestra.run.smithi008.stdout: { 2023-08-01T19:56:03.254 INFO:teuthology.orchestra.run.smithi008.stdout: "description": "osd_op(client.4668.0:100243 5.a 5:5e8193b6:::benchmark_data_smithi006_114134_object100242:head [set-alloc-hint object_size 65536 write_size 65536,write 0~65536] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e37)", 2023-08-01T19:56:03.255 INFO:teuthology.orchestra.run.smithi008.stdout: "initiated_at": "2023-08-01T19:55:05.150737+0000", 2023-08-01T19:56:03.255 INFO:teuthology.orchestra.run.smithi008.stdout: "age": 58.084821433000002, 2023-08-01T19:56:03.255 INFO:teuthology.orchestra.run.smithi008.stdout: "duration": 0.075019885999999994, 2023-08-01T19:56:03.255 INFO:teuthology.orchestra.run.smithi008.stdout: "type_data": { 2023-08-01T19:56:03.255 INFO:teuthology.orchestra.run.smithi008.stdout: "flag_point": "commit sent; apply or cleanup", 2023-08-01T19:56:03.255 INFO:teuthology.orchestra.run.smithi008.stdout: "client_info": { 2023-08-01T19:56:03.256 INFO:teuthology.orchestra.run.smithi008.stdout: "client": "client.4668", 2023-08-01T19:56:03.256 INFO:teuthology.orchestra.run.smithi008.stdout: "client_addr": "172.21.15.6:0/1709472247", 2023-08-01T19:56:03.256 INFO:teuthology.orchestra.run.smithi008.stdout: "tid": 100243 2023-08-01T19:56:03.256 INFO:teuthology.orchestra.run.smithi008.stdout: }, 2023-08-01T19:56:03.256 INFO:teuthology.orchestra.run.smithi008.stdout: "events": [ 2023-08-01T19:56:03.257 INFO:teuthology.orchestra.run.smithi008.stdout: { 2023-08-01T19:56:03.257 INFO:teuthology.orchestra.run.smithi008.stdout: "event": "initiated", 2023-08-01T19:56:03.257 INFO:teuthology.orchestra.run.smithi008.stdout: "time": "2023-08-01T19:55:05.150737+0000", 2023-08-01T19:56:03.257 INFO:teuthology.orchestra.run.smithi008.stdout: "duration": 0 2023-08-01T19:56:03.257 INFO:teuthology.orchestra.run.smithi008.stdout: }, 2023-08-01T19:56:03.258 INFO:teuthology.orchestra.run.smithi008.stdout: { 2023-08-01T19:56:03.258 INFO:teuthology.orchestra.run.smithi008.stdout: "event": "throttled", 2023-08-01T19:56:03.258 INFO:teuthology.orchestra.run.smithi008.stdout: "time": "2023-08-01T19:55:05.150737+0000", 2023-08-01T19:56:03.258 INFO:teuthology.orchestra.run.smithi008.stdout: "duration": 0 2023-08-01T19:56:03.259 INFO:teuthology.orchestra.run.smithi008.stdout: }, 2023-08-01T19:56:03.259 INFO:teuthology.orchestra.run.smithi008.stdout: { 2023-08-01T19:56:03.259 INFO:teuthology.orchestra.run.smithi008.stdout: "event": "header_read", 2023-08-01T19:56:03.259 INFO:teuthology.orchestra.run.smithi008.stdout: "time": "2023-08-01T19:55:05.150736+0000", 2023-08-01T19:56:03.260 INFO:teuthology.orchestra.run.smithi008.stdout: "duration": 4294967295.999999 2023-08-01T19:56:03.260 INFO:teuthology.orchestra.run.smithi008.stdout: }, 2023-08-01T19:56:03.260 INFO:teuthology.orchestra.run.smithi008.stdout: { 2023-08-01T19:56:03.260 INFO:teuthology.orchestra.run.smithi008.stdout: "event": "all_read", 2023-08-01T19:56:03.261 INFO:teuthology.orchestra.run.smithi008.stdout: "time": "2023-08-01T19:55:05.150780+0000", 2023-08-01T19:56:03.261 INFO:teuthology.orchestra.run.smithi008.stdout: "duration": 4.3578999999999997e-05 2023-08-01T19:56:03.261 INFO:teuthology.orchestra.run.smithi008.stdout: }, 2023-08-01T19:56:03.261 INFO:teuthology.orchestra.run.smithi008.stdout: { 2023-08-01T19:56:03.262 INFO:teuthology.orchestra.run.smithi008.stdout: "event": "dispatched", 2023-08-01T19:56:03.262 INFO:teuthology.orchestra.run.smithi008.stdout: "time": "2023-08-01T19:55:05.150791+0000", 2023-08-01T19:56:03.262 INFO:teuthology.orchestra.run.smithi008.stdout: "duration": 1.0963e-05 2023-08-01T19:56:03.262 INFO:teuthology.orchestra.run.smithi008.stdout: }, 2023-08-01T19:56:03.262 INFO:teuthology.orchestra.run.smithi008.stdout: { 2023-08-01T19:56:03.262 INFO:teuthology.orchestra.run.smithi008.stdout: "event": "queued_for_pg", 2023-08-01T19:56:03.263 INFO:teuthology.orchestra.run.smithi008.stdout: "time": "2023-08-01T19:55:05.150797+0000", 2023-08-01T19:56:03.263 INFO:teuthology.orchestra.run.smithi008.stdout: "duration": 5.9780000000000002e-06 2023-08-01T19:56:03.263 INFO:teuthology.orchestra.run.smithi008.stdout: }, 2023-08-01T19:56:03.263 INFO:teuthology.orchestra.run.smithi008.stdout: { 2023-08-01T19:56:03.263 INFO:teuthology.orchestra.run.smithi008.stdout: "event": "reached_pg", 2023-08-01T19:56:03.263 INFO:teuthology.orchestra.run.smithi008.stdout: "time": "2023-08-01T19:55:05.150833+0000", 2023-08-01T19:56:03.264 INFO:teuthology.orchestra.run.smithi008.stdout: "duration": 3.6000000000000001e-05 2023-08-01T19:56:03.264 INFO:teuthology.orchestra.run.smithi008.stdout: }, 2023-08-01T19:56:03.264 INFO:teuthology.orchestra.run.smithi008.stdout: { 2023-08-01T19:56:03.264 INFO:teuthology.orchestra.run.smithi008.stdout: "event": "started", 2023-08-01T19:56:03.264 INFO:teuthology.orchestra.run.smithi008.stdout: "time": "2023-08-01T19:55:05.150951+0000", 2023-08-01T19:56:03.264 INFO:teuthology.orchestra.run.smithi008.stdout: "duration": 0.00011827799999999999 2023-08-01T19:56:03.265 INFO:teuthology.orchestra.run.smithi008.stdout: }, 2023-08-01T19:56:03.265 INFO:teuthology.orchestra.run.smithi008.stdout: { 2023-08-01T19:56:03.265 INFO:teuthology.orchestra.run.smithi008.stdout: "event": "waiting for subops from 2", 2023-08-01T19:56:03.265 INFO:teuthology.orchestra.run.smithi008.stdout: "time": "2023-08-01T19:55:05.151111+0000", 2023-08-01T19:56:03.265 INFO:teuthology.orchestra.run.smithi008.stdout: "duration": 0.00015961299999999999 2023-08-01T19:56:03.265 INFO:teuthology.orchestra.run.smithi008.stdout: }, 2023-08-01T19:56:03.265 INFO:teuthology.orchestra.run.smithi008.stdout: { 2023-08-01T19:56:03.266 INFO:teuthology.orchestra.run.smithi008.stdout: "event": "op_commit", 2023-08-01T19:56:03.266 INFO:teuthology.orchestra.run.smithi008.stdout: "time": "2023-08-01T19:55:05.156247+0000", 2023-08-01T19:56:03.266 INFO:teuthology.orchestra.run.smithi008.stdout: "duration": 0.005136524 2023-08-01T19:56:03.266 INFO:teuthology.orchestra.run.smithi008.stdout: }, 2023-08-01T19:56:03.267 INFO:teuthology.orchestra.run.smithi008.stdout: { 2023-08-01T19:56:03.267 INFO:teuthology.orchestra.run.smithi008.stdout: "event": "sub_op_commit_rec", 2023-08-01T19:56:03.267 INFO:teuthology.orchestra.run.smithi008.stdout: "time": "2023-08-01T19:55:05.225705+0000", 2023-08-01T19:56:03.267 INFO:teuthology.orchestra.run.smithi008.stdout: "duration": 0.069458377000000002 2023-08-01T19:56:03.268 INFO:teuthology.orchestra.run.smithi008.stdout: }, 2023-08-01T19:56:03.268 INFO:teuthology.orchestra.run.smithi008.stdout: { 2023-08-01T19:56:03.268 INFO:teuthology.orchestra.run.smithi008.stdout: "event": "commit_sent", 2023-08-01T19:56:03.268 INFO:teuthology.orchestra.run.smithi008.stdout: "time": "2023-08-01T19:55:05.225736+0000", 2023-08-01T19:56:03.269 INFO:teuthology.orchestra.run.smithi008.stdout: "duration": 3.0388000000000001e-05 2023-08-01T19:56:03.269 INFO:teuthology.orchestra.run.smithi008.stdout: }, 2023-08-01T19:56:03.269 INFO:teuthology.orchestra.run.smithi008.stdout: { 2023-08-01T19:56:03.270 INFO:teuthology.orchestra.run.smithi008.stdout: "event": "done", 2023-08-01T19:56:03.270 INFO:teuthology.orchestra.run.smithi008.stdout: "time": "2023-08-01T19:55:05.225757+0000", 2023-08-01T19:56:03.270 INFO:teuthology.orchestra.run.smithi008.stdout: "duration": 2.1090999999999998e-05 2023-08-01T19:56:03.270 INFO:teuthology.orchestra.run.smithi008.stdout: } 2023-08-01T19:56:03.271 INFO:teuthology.orchestra.run.smithi008.stdout: ] 2023-08-01T19:56:03.271 INFO:teuthology.orchestra.run.smithi008.stdout: } 2023-08-01T19:56:03.271 INFO:teuthology.orchestra.run.smithi008.stdout: }, 2023-08-01T19:56:03.271 INFO:teuthology.orchestra.run.smithi008.stdout: { 2023-08-01T19:56:03.272 INFO:teuthology.orchestra.run.smithi008.stdout: "description": "osd_op(client.4668.0:100933 5.5 5:af92e9f2:::benchmark_data_smithi006_114134_object100932:head [set-alloc-hint object_size 65536 write_size 65536,write 0~65536] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e37)", 2023-08-01T19:56:03.272 INFO:teuthology.orchestra.run.smithi008.stdout: "initiated_at": "2023-08-01T19:55:05.566634+0000", 2023-08-01T19:56:03.272 INFO:teuthology.orchestra.run.smithi008.stdout: "age": 57.668924562000001, 2023-08-01T19:56:03.272 INFO:teuthology.orchestra.run.smithi008.stdout: "duration": 0.065909364999999998, 2023-08-01T19:56:03.273 INFO:teuthology.orchestra.run.smithi008.stdout: "type_data": { 2023-08-01T19:56:03.273 INFO:teuthology.orchestra.run.smithi008.stdout: "flag_point": "commit sent; apply or cleanup", 2023-08-01T19:56:03.273 INFO:teuthology.orchestra.run.smithi008.stdout: "client_info": { 2023-08-01T19:56:03.273 INFO:teuthology.orchestra.run.smithi008.stdout: "client": "client.4668", 2023-08-01T19:56:03.274 INFO:teuthology.orchestra.run.smithi008.stdout: "client_addr": "172.21.15.6:0/1709472247", 2023-08-01T19:56:03.274 INFO:teuthology.orchestra.run.smithi008.stdout: "tid": 100933 2023-08-01T19:56:03.274 INFO:teuthology.orchestra.run.smithi008.stdout: }, 2023-08-01T19:56:03.274 INFO:teuthology.orchestra.run.smithi008.stdout: "events": [ 2023-08-01T19:56:03.275 INFO:teuthology.orchestra.run.smithi008.stdout: { 2023-08-01T19:56:03.275 INFO:teuthology.orchestra.run.smithi008.stdout: "event": "initiated", 2023-08-01T19:56:03.275 INFO:teuthology.orchestra.run.smithi008.stdout: "time": "2023-08-01T19:55:05.566634+0000", 2023-08-01T19:56:03.275 INFO:teuthology.orchestra.run.smithi008.stdout: "duration": 0 2023-08-01T19:56:03.276 INFO:teuthology.orchestra.run.smithi008.stdout: }, 2023-08-01T19:56:03.276 INFO:teuthology.orchestra.run.smithi008.stdout: { 2023-08-01T19:56:03.276 INFO:teuthology.orchestra.run.smithi008.stdout: "event": "throttled", 2023-08-01T19:56:03.276 INFO:teuthology.orchestra.run.smithi008.stdout: "time": "2023-08-01T19:55:05.566634+0000", 2023-08-01T19:56:03.276 INFO:teuthology.orchestra.run.smithi008.stdout: "duration": 0 2023-08-01T19:56:03.276 INFO:teuthology.orchestra.run.smithi008.stdout: }, 2023-08-01T19:56:03.277 INFO:teuthology.orchestra.run.smithi008.stdout: { 2023-08-01T19:56:03.277 INFO:teuthology.orchestra.run.smithi008.stdout: "event": "header_read", 2023-08-01T19:56:03.277 INFO:teuthology.orchestra.run.smithi008.stdout: "time": "2023-08-01T19:55:05.566630+0000", 2023-08-01T19:56:03.277 INFO:teuthology.orchestra.run.smithi008.stdout: "duration": 4294967295.9999962 2023-08-01T19:56:03.277 INFO:teuthology.orchestra.run.smithi008.stdout: }, 2023-08-01T19:56:03.277 INFO:teuthology.orchestra.run.smithi008.stdout: { 2023-08-01T19:56:03.277 INFO:teuthology.orchestra.run.smithi008.stdout: "event": "all_read", 2023-08-01T19:56:03.278 INFO:teuthology.orchestra.run.smithi008.stdout: "time": "2023-08-01T19:55:05.566736+0000", 2023-08-01T19:56:03.278 INFO:teuthology.orchestra.run.smithi008.stdout: "duration": 0.000105752 2023-08-01T19:56:03.278 INFO:teuthology.orchestra.run.smithi008.stdout: }, 2023-08-01T19:56:03.278 INFO:teuthology.orchestra.run.smithi008.stdout: { 2023-08-01T19:56:03.278 INFO:teuthology.orchestra.run.smithi008.stdout: "event": "dispatched", 2023-08-01T19:56:03.279 INFO:teuthology.orchestra.run.smithi008.stdout: "time": "2023-08-01T19:55:05.566742+0000", 2023-08-01T19:56:03.279 INFO:teuthology.orchestra.run.smithi008.stdout: "duration": 5.8209999999999998e-06 2023-08-01T19:56:03.279 INFO:teuthology.orchestra.run.smithi008.stdout: }, 2023-08-01T19:56:03.279 INFO:teuthology.orchestra.run.smithi008.stdout: { 2023-08-01T19:56:03.279 INFO:teuthology.orchestra.run.smithi008.stdout: "event": "queued_for_pg", 2023-08-01T19:56:03.279 INFO:teuthology.orchestra.run.smithi008.stdout: "time": "2023-08-01T19:55:05.566745+0000", 2023-08-01T19:56:03.280 INFO:teuthology.orchestra.run.smithi008.stdout: "duration": 3.337e-06 2023-08-01T19:56:03.280 INFO:teuthology.orchestra.run.smithi008.stdout: }, 2023-08-01T19:56:03.280 INFO:teuthology.orchestra.run.smithi008.stdout: { 2023-08-01T19:56:03.281 INFO:teuthology.orchestra.run.smithi008.stdout: "event": "reached_pg", 2023-08-01T19:56:03.281 INFO:teuthology.orchestra.run.smithi008.stdout: "time": "2023-08-01T19:55:05.568175+0000", 2023-08-01T19:56:03.281 INFO:teuthology.orchestra.run.smithi008.stdout: "duration": 0.001429647 2023-08-01T19:56:03.281 INFO:teuthology.orchestra.run.smithi008.stdout: }, 2023-08-01T19:56:03.282 INFO:teuthology.orchestra.run.smithi008.stdout: { 2023-08-01T19:56:03.282 INFO:teuthology.orchestra.run.smithi008.stdout: "event": "started", 2023-08-01T19:56:03.282 INFO:teuthology.orchestra.run.smithi008.stdout: "time": "2023-08-01T19:55:05.568288+0000", 2023-08-01T19:56:03.282 INFO:teuthology.orchestra.run.smithi008.stdout: "duration": 0.000113353 2023-08-01T19:56:03.283 INFO:teuthology.orchestra.run.smithi008.stdout: }, 2023-08-01T19:56:03.283 INFO:teuthology.orchestra.run.smithi008.stdout: { 2023-08-01T19:56:03.283 INFO:teuthology.orchestra.run.smithi008.stdout: "event": "waiting for subops from 1", 2023-08-01T19:56:03.283 INFO:teuthology.orchestra.run.smithi008.stdout: "time": "2023-08-01T19:55:05.568425+0000", 2023-08-01T19:56:03.284 INFO:teuthology.orchestra.run.smithi008.stdout: "duration": 0.000137346 2023-08-01T19:56:03.284 INFO:teuthology.orchestra.run.smithi008.stdout: }, 2023-08-01T19:56:03.284 INFO:teuthology.orchestra.run.smithi008.stdout: { 2023-08-01T19:56:03.285 INFO:teuthology.orchestra.run.smithi008.stdout: "event": "sub_op_commit_rec", 2023-08-01T19:56:03.285 INFO:teuthology.orchestra.run.smithi008.stdout: "time": "2023-08-01T19:55:05.629320+0000", 2023-08-01T19:56:03.285 INFO:teuthology.orchestra.run.smithi008.stdout: "duration": 0.060894491000000002 2023-08-01T19:56:03.285 INFO:teuthology.orchestra.run.smithi008.stdout: }, 2023-08-01T19:56:03.286 INFO:teuthology.orchestra.run.smithi008.stdout: { 2023-08-01T19:56:03.286 INFO:teuthology.orchestra.run.smithi008.stdout: "event": "op_commit", 2023-08-01T19:56:03.286 INFO:teuthology.orchestra.run.smithi008.stdout: "time": "2023-08-01T19:55:05.632452+0000", 2023-08-01T19:56:03.286 INFO:teuthology.orchestra.run.smithi008.stdout: "duration": 0.003131909 2023-08-01T19:56:03.287 INFO:teuthology.orchestra.run.smithi008.stdout: }, 2023-08-01T19:56:03.287 INFO:teuthology.orchestra.run.smithi008.stdout: { 2023-08-01T19:56:03.287 INFO:teuthology.orchestra.run.smithi008.stdout: "event": "commit_sent", 2023-08-01T19:56:03.287 INFO:teuthology.orchestra.run.smithi008.stdout: "time": "2023-08-01T19:55:05.632503+0000", 2023-08-01T19:56:03.288 INFO:teuthology.orchestra.run.smithi008.stdout: "duration": 5.1295000000000003e-05 2023-08-01T19:56:03.288 INFO:teuthology.orchestra.run.smithi008.stdout: }, 2023-08-01T19:56:03.288 INFO:teuthology.orchestra.run.smithi008.stdout: { 2023-08-01T19:56:03.288 INFO:teuthology.orchestra.run.smithi008.stdout: "event": "done", 2023-08-01T19:56:03.289 INFO:teuthology.orchestra.run.smithi008.stdout: "time": "2023-08-01T19:55:05.632543+0000", 2023-08-01T19:56:03.289 INFO:teuthology.orchestra.run.smithi008.stdout: "duration": 4.0234000000000001e-05 2023-08-01T19:56:03.289 INFO:teuthology.orchestra.run.smithi008.stdout: } 2023-08-01T19:56:03.289 INFO:teuthology.orchestra.run.smithi008.stdout: ] 2023-08-01T19:56:03.290 INFO:teuthology.orchestra.run.smithi008.stdout: } 2023-08-01T19:56:03.290 INFO:teuthology.orchestra.run.smithi008.stdout: }, 2023-08-01T19:56:03.290 INFO:teuthology.orchestra.run.smithi008.stdout: { 2023-08-01T19:56:03.290 INFO:teuthology.orchestra.run.smithi008.stdout: "description": "osd_op(client.4668.0:100939 5.5 5:a75fa6e3:::benchmark_data_smithi006_114134_object100938:head [set-alloc-hint object_size 65536 write_size 65536,write 0~65536] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e37)", 2023-08-01T19:56:03.291 INFO:teuthology.orchestra.run.smithi008.stdout: "initiated_at": "2023-08-01T19:55:05.569740+0000", 2023-08-01T19:56:03.291 INFO:teuthology.orchestra.run.smithi008.stdout: "age": 57.665818891000001, 2023-08-01T19:56:03.291 INFO:teuthology.orchestra.run.smithi008.stdout: "duration": 0.067753412999999998, 2023-08-01T19:56:03.291 INFO:teuthology.orchestra.run.smithi008.stdout: "type_data": { 2023-08-01T19:56:03.292 INFO:teuthology.orchestra.run.smithi008.stdout: "flag_point": "commit sent; apply or cleanup", 2023-08-01T19:56:03.292 INFO:teuthology.orchestra.run.smithi008.stdout: "client_info": { 2023-08-01T19:56:03.292 INFO:teuthology.orchestra.run.smithi008.stdout: "client": "client.4668", 2023-08-01T19:56:03.292 INFO:teuthology.orchestra.run.smithi008.stdout: "client_addr": "172.21.15.6:0/1709472247", 2023-08-01T19:56:03.293 INFO:teuthology.orchestra.run.smithi008.stdout: "tid": 100939 2023-08-01T19:56:03.293 INFO:teuthology.orchestra.run.smithi008.stdout: }, 2023-08-01T19:56:03.293 INFO:teuthology.orchestra.run.smithi008.stdout: "events": [ 2023-08-01T19:56:03.293 INFO:teuthology.orchestra.run.smithi008.stdout: { 2023-08-01T19:56:03.294 INFO:teuthology.orchestra.run.smithi008.stdout: "event": "initiated", 2023-08-01T19:56:03.294 INFO:teuthology.orchestra.run.smithi008.stdout: "time": "2023-08-01T19:55:05.569740+0000", 2023-08-01T19:56:03.294 INFO:teuthology.orchestra.run.smithi008.stdout: "duration": 0 2023-08-01T19:56:03.295 INFO:teuthology.orchestra.run.smithi008.stdout: }, 2023-08-01T19:56:03.295 INFO:teuthology.orchestra.run.smithi008.stdout: { 2023-08-01T19:56:03.295 INFO:teuthology.orchestra.run.smithi008.stdout: "event": "throttled", 2023-08-01T19:56:03.295 INFO:teuthology.orchestra.run.smithi008.stdout: "time": "2023-08-01T19:55:05.569740+0000", 2023-08-01T19:56:03.295 INFO:teuthology.orchestra.run.smithi008.stdout: "duration": 0 2023-08-01T19:56:03.296 INFO:teuthology.orchestra.run.smithi008.stdout: }, 2023-08-01T19:56:03.296 INFO:teuthology.orchestra.run.smithi008.stdout: { 2023-08-01T19:56:03.296 INFO:teuthology.orchestra.run.smithi008.stdout: "event": "header_read", 2023-08-01T19:56:03.297 INFO:teuthology.orchestra.run.smithi008.stdout: "time": "2023-08-01T19:55:05.569739+0000", 2023-08-01T19:56:03.297 INFO:teuthology.orchestra.run.smithi008.stdout: "duration": 4294967295.9999995 2023-08-01T19:56:03.297 INFO:teuthology.orchestra.run.smithi008.stdout: }, 2023-08-01T19:56:03.297 INFO:teuthology.orchestra.run.smithi008.stdout: { 2023-08-01T19:56:03.298 INFO:teuthology.orchestra.run.smithi008.stdout: "event": "all_read", 2023-08-01T19:56:03.298 INFO:teuthology.orchestra.run.smithi008.stdout: "time": "2023-08-01T19:55:05.569839+0000", 2023-08-01T19:56:03.298 INFO:teuthology.orchestra.run.smithi008.stdout: "duration": 0.000100219 2023-08-01T19:56:03.298 INFO:teuthology.orchestra.run.smithi008.stdout: }, 2023-08-01T19:56:03.299 INFO:teuthology.orchestra.run.smithi008.stdout: { 2023-08-01T19:56:03.299 INFO:teuthology.orchestra.run.smithi008.stdout: "event": "dispatched", 2023-08-01T19:56:03.299 INFO:teuthology.orchestra.run.smithi008.stdout: "time": "2023-08-01T19:55:05.569846+0000", 2023-08-01T19:56:03.299 INFO:teuthology.orchestra.run.smithi008.stdout: "duration": 7.3150000000000003e-06 2023-08-01T19:56:03.300 INFO:teuthology.orchestra.run.smithi008.stdout: }, 2023-08-01T19:56:03.300 INFO:teuthology.orchestra.run.smithi008.stdout: { 2023-08-01T19:56:03.300 INFO:teuthology.orchestra.run.smithi008.stdout: "event": "queued_for_pg", 2023-08-01T19:56:03.300 INFO:teuthology.orchestra.run.smithi008.stdout: "time": "2023-08-01T19:55:05.569850+0000", 2023-08-01T19:56:03.301 INFO:teuthology.orchestra.run.smithi008.stdout: "duration": 3.3299999999999999e-06 2023-08-01T19:56:03.301 INFO:teuthology.orchestra.run.smithi008.stdout: }, 2023-08-01T19:56:03.301 INFO:teuthology.orchestra.run.smithi008.stdout: { 2023-08-01T19:56:03.301 INFO:teuthology.orchestra.run.smithi008.stdout: "event": "reached_pg", 2023-08-01T19:56:03.302 INFO:teuthology.orchestra.run.smithi008.stdout: "time": "2023-08-01T19:55:05.626991+0000", 2023-08-01T19:56:03.302 INFO:teuthology.orchestra.run.smithi008.stdout: "duration": 0.057141585000000002 2023-08-01T19:56:03.302 INFO:teuthology.orchestra.run.smithi008.stdout: }, 2023-08-01T19:56:03.302 INFO:teuthology.orchestra.run.smithi008.stdout: { 2023-08-01T19:56:03.303 INFO:teuthology.orchestra.run.smithi008.stdout: "event": "started", 2023-08-01T19:56:03.303 INFO:teuthology.orchestra.run.smithi008.stdout: "time": "2023-08-01T19:55:05.627111+0000", 2023-08-01T19:56:03.303 INFO:teuthology.orchestra.run.smithi008.stdout: "duration": 0.000119238 2023-08-01T19:56:03.303 INFO:teuthology.orchestra.run.smithi008.stdout: }, 2023-08-01T19:56:03.304 INFO:teuthology.orchestra.run.smithi008.stdout: { 2023-08-01T19:56:03.304 INFO:teuthology.orchestra.run.smithi008.stdout: "event": "waiting for subops from 1", 2023-08-01T19:56:03.304 INFO:teuthology.orchestra.run.smithi008.stdout: "time": "2023-08-01T19:55:05.627253+0000", 2023-08-01T19:56:03.304 INFO:teuthology.orchestra.run.smithi008.stdout: "duration": 0.000142822 2023-08-01T19:56:03.304 INFO:teuthology.orchestra.run.smithi008.stdout: }, 2023-08-01T19:56:03.304 INFO:teuthology.orchestra.run.smithi008.stdout: { 2023-08-01T19:56:03.304 INFO:teuthology.orchestra.run.smithi008.stdout: "event": "op_commit", 2023-08-01T19:56:03.305 INFO:teuthology.orchestra.run.smithi008.stdout: "time": "2023-08-01T19:55:05.632555+0000", 2023-08-01T19:56:03.305 INFO:teuthology.orchestra.run.smithi008.stdout: "duration": 0.0053012449999999996 2023-08-01T19:56:03.305 INFO:teuthology.orchestra.run.smithi008.stdout: }, 2023-08-01T19:56:03.305 INFO:teuthology.orchestra.run.smithi008.stdout: { 2023-08-01T19:56:03.305 INFO:teuthology.orchestra.run.smithi008.stdout: "event": "sub_op_commit_rec", 2023-08-01T19:56:03.305 INFO:teuthology.orchestra.run.smithi008.stdout: "time": "2023-08-01T19:55:05.637380+0000", 2023-08-01T19:56:03.305 INFO:teuthology.orchestra.run.smithi008.stdout: "duration": 0.0048257639999999997 2023-08-01T19:56:03.305 INFO:teuthology.orchestra.run.smithi008.stdout: }, 2023-08-01T19:56:03.306 INFO:teuthology.orchestra.run.smithi008.stdout: { 2023-08-01T19:56:03.306 INFO:teuthology.orchestra.run.smithi008.stdout: "event": "commit_sent", 2023-08-01T19:56:03.306 INFO:teuthology.orchestra.run.smithi008.stdout: "time": "2023-08-01T19:55:05.637454+0000", 2023-08-01T19:56:03.306 INFO:teuthology.orchestra.run.smithi008.stdout: "duration": 7.3578999999999995e-05 2023-08-01T19:56:03.306 INFO:teuthology.orchestra.run.smithi008.stdout: }, 2023-08-01T19:56:03.306 INFO:teuthology.orchestra.run.smithi008.stdout: { 2023-08-01T19:56:03.306 INFO:teuthology.orchestra.run.smithi008.stdout: "event": "done", 2023-08-01T19:56:03.307 INFO:teuthology.orchestra.run.smithi008.stdout: "time": "2023-08-01T19:55:05.637493+0000", 2023-08-01T19:56:03.307 INFO:teuthology.orchestra.run.smithi008.stdout: "duration": 3.8986999999999998e-05 2023-08-01T19:56:03.307 INFO:teuthology.orchestra.run.smithi008.stdout: } 2023-08-01T19:56:03.307 INFO:teuthology.orchestra.run.smithi008.stdout: ] 2023-08-01T19:56:03.307 INFO:teuthology.orchestra.run.smithi008.stdout: } 2023-08-01T19:56:03.307 INFO:teuthology.orchestra.run.smithi008.stdout: }, 2023-08-01T19:56:03.307 INFO:teuthology.orchestra.run.smithi008.stdout: { 2023-08-01T19:56:03.307 INFO:teuthology.orchestra.run.smithi008.stdout: "description": "osd_op(client.4668.0:107863 5.3 5:cbdd875a:::benchmark_data_smithi006_114134_object107862:head [set-alloc-hint object_size 65536 write_size 65536,write 0~65536] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e38)", 2023-08-01T19:56:03.308 INFO:teuthology.orchestra.run.smithi008.stdout: "initiated_at": "2023-08-01T19:55:09.278851+0000", 2023-08-01T19:56:03.308 INFO:teuthology.orchestra.run.smithi008.stdout: "age": 53.956707151000003, 2023-08-01T19:56:03.308 INFO:teuthology.orchestra.run.smithi008.stdout: "duration": 0.071378853000000006, 2023-08-01T19:56:03.308 INFO:teuthology.orchestra.run.smithi008.stdout: "type_data": { 2023-08-01T19:56:03.308 INFO:teuthology.orchestra.run.smithi008.stdout: "flag_point": "commit sent; apply or cleanup", 2023-08-01T19:56:03.308 INFO:teuthology.orchestra.run.smithi008.stdout: "client_info": { 2023-08-01T19:56:03.308 INFO:teuthology.orchestra.run.smithi008.stdout: "client": "client.4668", 2023-08-01T19:56:03.309 INFO:teuthology.orchestra.run.smithi008.stdout: "client_addr": "172.21.15.6:0/1709472247", 2023-08-01T19:56:03.309 INFO:teuthology.orchestra.run.smithi008.stdout: "tid": 107863 2023-08-01T19:56:03.309 INFO:teuthology.orchestra.run.smithi008.stdout: }, 2023-08-01T19:56:03.309 INFO:teuthology.orchestra.run.smithi008.stdout: "events": [ 2023-08-01T19:56:03.309 INFO:teuthology.orchestra.run.smithi008.stdout: { 2023-08-01T19:56:03.309 INFO:teuthology.orchestra.run.smithi008.stdout: "event": "initiated", 2023-08-01T19:56:03.310 INFO:teuthology.orchestra.run.smithi008.stdout: "time": "2023-08-01T19:55:09.278851+0000", 2023-08-01T19:56:03.310 INFO:teuthology.orchestra.run.smithi008.stdout: "duration": 0 2023-08-01T19:56:03.310 INFO:teuthology.orchestra.run.smithi008.stdout: }, 2023-08-01T19:56:03.310 INFO:teuthology.orchestra.run.smithi008.stdout: { 2023-08-01T19:56:03.310 INFO:teuthology.orchestra.run.smithi008.stdout: "event": "throttled", 2023-08-01T19:56:03.310 INFO:teuthology.orchestra.run.smithi008.stdout: "time": "2023-08-01T19:55:09.278851+0000", 2023-08-01T19:56:03.311 INFO:teuthology.orchestra.run.smithi008.stdout: "duration": 0 2023-08-01T19:56:03.311 INFO:teuthology.orchestra.run.smithi008.stdout: }, 2023-08-01T19:56:03.311 INFO:teuthology.orchestra.run.smithi008.stdout: { 2023-08-01T19:56:03.311 INFO:teuthology.orchestra.run.smithi008.stdout: "event": "header_read", 2023-08-01T19:56:03.311 INFO:teuthology.orchestra.run.smithi008.stdout: "time": "2023-08-01T19:55:09.278850+0000", 2023-08-01T19:56:03.311 INFO:teuthology.orchestra.run.smithi008.stdout: "duration": 4294967295.999999 2023-08-01T19:56:03.311 INFO:teuthology.orchestra.run.smithi008.stdout: }, 2023-08-01T19:56:03.311 INFO:teuthology.orchestra.run.smithi008.stdout: { 2023-08-01T19:56:03.312 INFO:teuthology.orchestra.run.smithi008.stdout: "event": "all_read", 2023-08-01T19:56:03.312 INFO:teuthology.orchestra.run.smithi008.stdout: "time": "2023-08-01T19:55:09.278945+0000", 2023-08-01T19:56:03.312 INFO:teuthology.orchestra.run.smithi008.stdout: "duration": 9.4388000000000005e-05 2023-08-01T19:56:03.312 INFO:teuthology.orchestra.run.smithi008.stdout: }, 2023-08-01T19:56:03.312 INFO:teuthology.orchestra.run.smithi008.stdout: { 2023-08-01T19:56:03.312 INFO:teuthology.orchestra.run.smithi008.stdout: "event": "dispatched", 2023-08-01T19:56:03.312 INFO:teuthology.orchestra.run.smithi008.stdout: "time": "2023-08-01T19:55:09.278955+0000", 2023-08-01T19:56:03.313 INFO:teuthology.orchestra.run.smithi008.stdout: "duration": 1.0413e-05 2023-08-01T19:56:03.313 INFO:teuthology.orchestra.run.smithi008.stdout: }, 2023-08-01T19:56:03.313 INFO:teuthology.orchestra.run.smithi008.stdout: { 2023-08-01T19:56:03.313 INFO:teuthology.orchestra.run.smithi008.stdout: "event": "queued_for_pg", 2023-08-01T19:56:03.313 INFO:teuthology.orchestra.run.smithi008.stdout: "time": "2023-08-01T19:55:09.278962+0000", 2023-08-01T19:56:03.313 INFO:teuthology.orchestra.run.smithi008.stdout: "duration": 6.2169999999999999e-06 2023-08-01T19:56:03.313 INFO:teuthology.orchestra.run.smithi008.stdout: }, 2023-08-01T19:56:03.313 INFO:teuthology.orchestra.run.smithi008.stdout: { 2023-08-01T19:56:03.314 INFO:teuthology.orchestra.run.smithi008.stdout: "event": "reached_pg", 2023-08-01T19:56:03.314 INFO:teuthology.orchestra.run.smithi008.stdout: "time": "2023-08-01T19:55:09.280363+0000", 2023-08-01T19:56:03.314 INFO:teuthology.orchestra.run.smithi008.stdout: "duration": 0.0014014489999999999 2023-08-01T19:56:03.314 INFO:teuthology.orchestra.run.smithi008.stdout: }, 2023-08-01T19:56:03.315 INFO:teuthology.orchestra.run.smithi008.stdout: { 2023-08-01T19:56:03.315 INFO:teuthology.orchestra.run.smithi008.stdout: "event": "started", 2023-08-01T19:56:03.315 INFO:teuthology.orchestra.run.smithi008.stdout: "time": "2023-08-01T19:55:09.280488+0000", 2023-08-01T19:56:03.315 INFO:teuthology.orchestra.run.smithi008.stdout: "duration": 0.00012474099999999999 2023-08-01T19:56:03.316 INFO:teuthology.orchestra.run.smithi008.stdout: }, 2023-08-01T19:56:03.316 INFO:teuthology.orchestra.run.smithi008.stdout: { 2023-08-01T19:56:03.316 INFO:teuthology.orchestra.run.smithi008.stdout: "event": "waiting for subops from 1", 2023-08-01T19:56:03.316 INFO:teuthology.orchestra.run.smithi008.stdout: "time": "2023-08-01T19:55:09.280626+0000", 2023-08-01T19:56:03.317 INFO:teuthology.orchestra.run.smithi008.stdout: "duration": 0.000138193 2023-08-01T19:56:03.317 INFO:teuthology.orchestra.run.smithi008.stdout: }, 2023-08-01T19:56:03.317 INFO:teuthology.orchestra.run.smithi008.stdout: { 2023-08-01T19:56:03.317 INFO:teuthology.orchestra.run.smithi008.stdout: "event": "op_commit", 2023-08-01T19:56:03.318 INFO:teuthology.orchestra.run.smithi008.stdout: "time": "2023-08-01T19:55:09.285958+0000", 2023-08-01T19:56:03.318 INFO:teuthology.orchestra.run.smithi008.stdout: "duration": 0.0053317130000000001 2023-08-01T19:56:03.318 INFO:teuthology.orchestra.run.smithi008.stdout: }, 2023-08-01T19:56:03.318 INFO:teuthology.orchestra.run.smithi008.stdout: { 2023-08-01T19:56:03.319 INFO:teuthology.orchestra.run.smithi008.stdout: "event": "sub_op_commit_rec", 2023-08-01T19:56:03.319 INFO:teuthology.orchestra.run.smithi008.stdout: "time": "2023-08-01T19:55:09.350151+0000", 2023-08-01T19:56:03.319 INFO:teuthology.orchestra.run.smithi008.stdout: "duration": 0.064193202000000005 2023-08-01T19:56:03.319 INFO:teuthology.orchestra.run.smithi008.stdout: }, 2023-08-01T19:56:03.320 INFO:teuthology.orchestra.run.smithi008.stdout: { 2023-08-01T19:56:03.320 INFO:teuthology.orchestra.run.smithi008.stdout: "event": "commit_sent", 2023-08-01T19:56:03.320 INFO:teuthology.orchestra.run.smithi008.stdout: "time": "2023-08-01T19:55:09.350188+0000", 2023-08-01T19:56:03.320 INFO:teuthology.orchestra.run.smithi008.stdout: "duration": 3.7549999999999998e-05 2023-08-01T19:56:03.320 INFO:teuthology.orchestra.run.smithi008.stdout: }, 2023-08-01T19:56:03.320 INFO:teuthology.orchestra.run.smithi008.stdout: { 2023-08-01T19:56:03.320 INFO:teuthology.orchestra.run.smithi008.stdout: "event": "done", 2023-08-01T19:56:03.321 INFO:teuthology.orchestra.run.smithi008.stdout: "time": "2023-08-01T19:55:09.350230+0000", 2023-08-01T19:56:03.321 INFO:teuthology.orchestra.run.smithi008.stdout: "duration": 4.1804999999999997e-05 2023-08-01T19:56:03.321 INFO:teuthology.orchestra.run.smithi008.stdout: } 2023-08-01T19:56:03.321 INFO:teuthology.orchestra.run.smithi008.stdout: ] 2023-08-01T19:56:03.321 INFO:teuthology.orchestra.run.smithi008.stdout: } 2023-08-01T19:56:03.321 INFO:teuthology.orchestra.run.smithi008.stdout: }, 2023-08-01T19:56:03.321 INFO:teuthology.orchestra.run.smithi008.stdout: { 2023-08-01T19:56:03.322 INFO:teuthology.orchestra.run.smithi008.stdout: "description": "osd_op(client.4668.0:107865 5.3 5:c2ebb96d:::benchmark_data_smithi006_114134_object107864:head [set-alloc-hint object_size 65536 write_size 65536,write 0~65536] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e38)", 2023-08-01T19:56:03.322 INFO:teuthology.orchestra.run.smithi008.stdout: "initiated_at": "2023-08-01T19:55:09.279020+0000", 2023-08-01T19:56:03.322 INFO:teuthology.orchestra.run.smithi008.stdout: "age": 53.956538479000002, 2023-08-01T19:56:03.322 INFO:teuthology.orchestra.run.smithi008.stdout: "duration": 0.072892565000000006, 2023-08-01T19:56:03.322 INFO:teuthology.orchestra.run.smithi008.stdout: "type_data": { 2023-08-01T19:56:03.322 INFO:teuthology.orchestra.run.smithi008.stdout: "flag_point": "commit sent; apply or cleanup", 2023-08-01T19:56:03.322 INFO:teuthology.orchestra.run.smithi008.stdout: "client_info": { 2023-08-01T19:56:03.322 INFO:teuthology.orchestra.run.smithi008.stdout: "client": "client.4668", 2023-08-01T19:56:03.323 INFO:teuthology.orchestra.run.smithi008.stdout: "client_addr": "172.21.15.6:0/1709472247", 2023-08-01T19:56:03.323 INFO:teuthology.orchestra.run.smithi008.stdout: "tid": 107865 2023-08-01T19:56:03.323 INFO:teuthology.orchestra.run.smithi008.stdout: }, 2023-08-01T19:56:03.323 INFO:teuthology.orchestra.run.smithi008.stdout: "events": [ 2023-08-01T19:56:03.323 INFO:teuthology.orchestra.run.smithi008.stdout: { 2023-08-01T19:56:03.323 INFO:teuthology.orchestra.run.smithi008.stdout: "event": "initiated", 2023-08-01T19:56:03.323 INFO:teuthology.orchestra.run.smithi008.stdout: "time": "2023-08-01T19:55:09.279020+0000", 2023-08-01T19:56:03.324 INFO:teuthology.orchestra.run.smithi008.stdout: "duration": 0 2023-08-01T19:56:03.324 INFO:teuthology.orchestra.run.smithi008.stdout: }, 2023-08-01T19:56:03.324 INFO:teuthology.orchestra.run.smithi008.stdout: { 2023-08-01T19:56:03.324 INFO:teuthology.orchestra.run.smithi008.stdout: "event": "throttled", 2023-08-01T19:56:03.324 INFO:teuthology.orchestra.run.smithi008.stdout: "time": "2023-08-01T19:55:09.279020+0000", 2023-08-01T19:56:03.324 INFO:teuthology.orchestra.run.smithi008.stdout: "duration": 0 2023-08-01T19:56:03.324 INFO:teuthology.orchestra.run.smithi008.stdout: }, 2023-08-01T19:56:03.324 INFO:teuthology.orchestra.run.smithi008.stdout: { 2023-08-01T19:56:03.325 INFO:teuthology.orchestra.run.smithi008.stdout: "event": "header_read", 2023-08-01T19:56:03.325 INFO:teuthology.orchestra.run.smithi008.stdout: "time": "2023-08-01T19:55:09.279019+0000", 2023-08-01T19:56:03.325 INFO:teuthology.orchestra.run.smithi008.stdout: "duration": 4294967295.999999 2023-08-01T19:56:03.325 INFO:teuthology.orchestra.run.smithi008.stdout: }, 2023-08-01T19:56:03.326 INFO:teuthology.orchestra.run.smithi008.stdout: { 2023-08-01T19:56:03.326 INFO:teuthology.orchestra.run.smithi008.stdout: "event": "all_read", 2023-08-01T19:56:03.326 INFO:teuthology.orchestra.run.smithi008.stdout: "time": "2023-08-01T19:55:09.279087+0000", 2023-08-01T19:56:03.326 INFO:teuthology.orchestra.run.smithi008.stdout: "duration": 6.8392000000000005e-05 2023-08-01T19:56:03.326 INFO:teuthology.orchestra.run.smithi008.stdout: }, 2023-08-01T19:56:03.327 INFO:teuthology.orchestra.run.smithi008.stdout: { 2023-08-01T19:56:03.327 INFO:teuthology.orchestra.run.smithi008.stdout: "event": "dispatched", 2023-08-01T19:56:03.327 INFO:teuthology.orchestra.run.smithi008.stdout: "time": "2023-08-01T19:55:09.279095+0000", 2023-08-01T19:56:03.327 INFO:teuthology.orchestra.run.smithi008.stdout: "duration": 8.0989999999999999e-06 2023-08-01T19:56:03.327 INFO:teuthology.orchestra.run.smithi008.stdout: }, 2023-08-01T19:56:03.327 INFO:teuthology.orchestra.run.smithi008.stdout: { 2023-08-01T19:56:03.327 INFO:teuthology.orchestra.run.smithi008.stdout: "event": "queued_for_pg", 2023-08-01T19:56:03.328 INFO:teuthology.orchestra.run.smithi008.stdout: "time": "2023-08-01T19:55:09.279101+0000", 2023-08-01T19:56:03.328 INFO:teuthology.orchestra.run.smithi008.stdout: "duration": 5.0390000000000004e-06 2023-08-01T19:56:03.328 INFO:teuthology.orchestra.run.smithi008.stdout: }, 2023-08-01T19:56:03.328 INFO:teuthology.orchestra.run.smithi008.stdout: { 2023-08-01T19:56:03.328 INFO:teuthology.orchestra.run.smithi008.stdout: "event": "reached_pg", 2023-08-01T19:56:03.328 INFO:teuthology.orchestra.run.smithi008.stdout: "time": "2023-08-01T19:55:09.282574+0000", 2023-08-01T19:56:03.329 INFO:teuthology.orchestra.run.smithi008.stdout: "duration": 0.0034730619999999999 2023-08-01T19:56:03.329 INFO:teuthology.orchestra.run.smithi008.stdout: }, 2023-08-01T19:56:03.329 INFO:teuthology.orchestra.run.smithi008.stdout: { 2023-08-01T19:56:03.329 INFO:teuthology.orchestra.run.smithi008.stdout: "event": "started", 2023-08-01T19:56:03.329 INFO:teuthology.orchestra.run.smithi008.stdout: "time": "2023-08-01T19:55:09.282705+0000", 2023-08-01T19:56:03.329 INFO:teuthology.orchestra.run.smithi008.stdout: "duration": 0.00013133400000000001 2023-08-01T19:56:03.329 INFO:teuthology.orchestra.run.smithi008.stdout: }, 2023-08-01T19:56:03.329 INFO:teuthology.orchestra.run.smithi008.stdout: { 2023-08-01T19:56:03.330 INFO:teuthology.orchestra.run.smithi008.stdout: "event": "waiting for subops from 1", 2023-08-01T19:56:03.330 INFO:teuthology.orchestra.run.smithi008.stdout: "time": "2023-08-01T19:55:09.283067+0000", 2023-08-01T19:56:03.330 INFO:teuthology.orchestra.run.smithi008.stdout: "duration": 0.00036195299999999998 2023-08-01T19:56:03.330 INFO:teuthology.orchestra.run.smithi008.stdout: }, 2023-08-01T19:56:03.330 INFO:teuthology.orchestra.run.smithi008.stdout: { 2023-08-01T19:56:03.330 INFO:teuthology.orchestra.run.smithi008.stdout: "event": "op_commit", 2023-08-01T19:56:03.330 INFO:teuthology.orchestra.run.smithi008.stdout: "time": "2023-08-01T19:55:09.288196+0000", 2023-08-01T19:56:03.331 INFO:teuthology.orchestra.run.smithi008.stdout: "duration": 0.0051293780000000004 2023-08-01T19:56:03.331 INFO:teuthology.orchestra.run.smithi008.stdout: }, 2023-08-01T19:56:03.331 INFO:teuthology.orchestra.run.smithi008.stdout: { 2023-08-01T19:56:03.331 INFO:teuthology.orchestra.run.smithi008.stdout: "event": "sub_op_commit_rec", 2023-08-01T19:56:03.331 INFO:teuthology.orchestra.run.smithi008.stdout: "time": "2023-08-01T19:55:09.351832+0000", 2023-08-01T19:56:03.332 INFO:teuthology.orchestra.run.smithi008.stdout: "duration": 0.063636076 2023-08-01T19:56:03.332 INFO:teuthology.orchestra.run.smithi008.stdout: }, 2023-08-01T19:56:03.332 INFO:teuthology.orchestra.run.smithi008.stdout: { 2023-08-01T19:56:03.332 INFO:teuthology.orchestra.run.smithi008.stdout: "event": "commit_sent", 2023-08-01T19:56:03.332 INFO:teuthology.orchestra.run.smithi008.stdout: "time": "2023-08-01T19:55:09.351878+0000", 2023-08-01T19:56:03.332 INFO:teuthology.orchestra.run.smithi008.stdout: "duration": 4.5408999999999998e-05 2023-08-01T19:56:03.332 INFO:teuthology.orchestra.run.smithi008.stdout: }, 2023-08-01T19:56:03.333 INFO:teuthology.orchestra.run.smithi008.stdout: { 2023-08-01T19:56:03.333 INFO:teuthology.orchestra.run.smithi008.stdout: "event": "done", 2023-08-01T19:56:03.333 INFO:teuthology.orchestra.run.smithi008.stdout: "time": "2023-08-01T19:55:09.351913+0000", 2023-08-01T19:56:03.333 INFO:teuthology.orchestra.run.smithi008.stdout: "duration": 3.4808999999999998e-05 2023-08-01T19:56:03.333 INFO:teuthology.orchestra.run.smithi008.stdout: } 2023-08-01T19:56:03.333 INFO:teuthology.orchestra.run.smithi008.stdout: ] 2023-08-01T19:56:03.333 INFO:teuthology.orchestra.run.smithi008.stdout: } 2023-08-01T19:56:03.333 INFO:teuthology.orchestra.run.smithi008.stdout: }, 2023-08-01T19:56:03.334 INFO:teuthology.orchestra.run.smithi008.stdout: { 2023-08-01T19:56:03.334 INFO:teuthology.orchestra.run.smithi008.stdout: "description": "osd_op(client.4668.0:107869 5.c 5:31910384:::benchmark_data_smithi006_114134_object107868:head [set-alloc-hint object_size 65536 write_size 65536,write 0~65536] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e38)", 2023-08-01T19:56:03.334 INFO:teuthology.orchestra.run.smithi008.stdout: "initiated_at": "2023-08-01T19:55:09.283205+0000", 2023-08-01T19:56:03.334 INFO:teuthology.orchestra.run.smithi008.stdout: "age": 53.952353314, 2023-08-01T19:56:03.334 INFO:teuthology.orchestra.run.smithi008.stdout: "duration": 0.068611808999999996, 2023-08-01T19:56:03.334 INFO:teuthology.orchestra.run.smithi008.stdout: "type_data": { 2023-08-01T19:56:03.334 INFO:teuthology.orchestra.run.smithi008.stdout: "flag_point": "commit sent; apply or cleanup", 2023-08-01T19:56:03.335 INFO:teuthology.orchestra.run.smithi008.stdout: "client_info": { 2023-08-01T19:56:03.335 INFO:teuthology.orchestra.run.smithi008.stdout: "client": "client.4668", 2023-08-01T19:56:03.335 INFO:teuthology.orchestra.run.smithi008.stdout: "client_addr": "172.21.15.6:0/1709472247", 2023-08-01T19:56:03.335 INFO:teuthology.orchestra.run.smithi008.stdout: "tid": 107869 2023-08-01T19:56:03.335 INFO:teuthology.orchestra.run.smithi008.stdout: }, 2023-08-01T19:56:03.335 INFO:teuthology.orchestra.run.smithi008.stdout: "events": [ 2023-08-01T19:56:03.335 INFO:teuthology.orchestra.run.smithi008.stdout: { 2023-08-01T19:56:03.335 INFO:teuthology.orchestra.run.smithi008.stdout: "event": "initiated", 2023-08-01T19:56:03.336 INFO:teuthology.orchestra.run.smithi008.stdout: "time": "2023-08-01T19:55:09.283205+0000", 2023-08-01T19:56:03.336 INFO:teuthology.orchestra.run.smithi008.stdout: "duration": 0 2023-08-01T19:56:03.336 INFO:teuthology.orchestra.run.smithi008.stdout: }, 2023-08-01T19:56:03.336 INFO:teuthology.orchestra.run.smithi008.stdout: { 2023-08-01T19:56:03.336 INFO:teuthology.orchestra.run.smithi008.stdout: "event": "throttled", 2023-08-01T19:56:03.336 INFO:teuthology.orchestra.run.smithi008.stdout: "time": "2023-08-01T19:55:09.283205+0000", 2023-08-01T19:56:03.336 INFO:teuthology.orchestra.run.smithi008.stdout: "duration": 0 2023-08-01T19:56:03.337 INFO:teuthology.orchestra.run.smithi008.stdout: }, 2023-08-01T19:56:03.337 INFO:teuthology.orchestra.run.smithi008.stdout: { 2023-08-01T19:56:03.337 INFO:teuthology.orchestra.run.smithi008.stdout: "event": "header_read", 2023-08-01T19:56:03.337 INFO:teuthology.orchestra.run.smithi008.stdout: "time": "2023-08-01T19:55:09.283204+0000", 2023-08-01T19:56:03.338 INFO:teuthology.orchestra.run.smithi008.stdout: "duration": 4294967295.999999 2023-08-01T19:56:03.338 INFO:teuthology.orchestra.run.smithi008.stdout: }, 2023-08-01T19:56:03.338 INFO:teuthology.orchestra.run.smithi008.stdout: { 2023-08-01T19:56:03.338 INFO:teuthology.orchestra.run.smithi008.stdout: "event": "all_read", 2023-08-01T19:56:03.338 INFO:teuthology.orchestra.run.smithi008.stdout: "time": "2023-08-01T19:55:09.283300+0000", 2023-08-01T19:56:03.338 INFO:teuthology.orchestra.run.smithi008.stdout: "duration": 9.6280000000000007e-05 2023-08-01T19:56:03.339 INFO:teuthology.orchestra.run.smithi008.stdout: }, 2023-08-01T19:56:03.339 INFO:teuthology.orchestra.run.smithi008.stdout: { 2023-08-01T19:56:03.339 INFO:teuthology.orchestra.run.smithi008.stdout: "event": "dispatched", 2023-08-01T19:56:03.339 INFO:teuthology.orchestra.run.smithi008.stdout: "time": "2023-08-01T19:55:09.283314+0000", 2023-08-01T19:56:03.339 INFO:teuthology.orchestra.run.smithi008.stdout: "duration": 1.3344e-05 2023-08-01T19:56:03.339 INFO:teuthology.orchestra.run.smithi008.stdout: }, 2023-08-01T19:56:03.339 INFO:teuthology.orchestra.run.smithi008.stdout: { 2023-08-01T19:56:03.340 INFO:teuthology.orchestra.run.smithi008.stdout: "event": "queued_for_pg", 2023-08-01T19:56:03.340 INFO:teuthology.orchestra.run.smithi008.stdout: "time": "2023-08-01T19:55:09.283320+0000", 2023-08-01T19:56:03.340 INFO:teuthology.orchestra.run.smithi008.stdout: "duration": 6.0299999999999999e-06 2023-08-01T19:56:03.340 INFO:teuthology.orchestra.run.smithi008.stdout: }, 2023-08-01T19:56:03.340 INFO:teuthology.orchestra.run.smithi008.stdout: { 2023-08-01T19:56:03.340 INFO:teuthology.orchestra.run.smithi008.stdout: "event": "reached_pg", 2023-08-01T19:56:03.340 INFO:teuthology.orchestra.run.smithi008.stdout: "time": "2023-08-01T19:55:09.283365+0000", 2023-08-01T19:56:03.341 INFO:teuthology.orchestra.run.smithi008.stdout: "duration": 4.5578999999999998e-05 2023-08-01T19:56:03.341 INFO:teuthology.orchestra.run.smithi008.stdout: }, 2023-08-01T19:56:03.341 INFO:teuthology.orchestra.run.smithi008.stdout: { 2023-08-01T19:56:03.341 INFO:teuthology.orchestra.run.smithi008.stdout: "event": "started", 2023-08-01T19:56:03.341 INFO:teuthology.orchestra.run.smithi008.stdout: "time": "2023-08-01T19:55:09.283490+0000", 2023-08-01T19:56:03.341 INFO:teuthology.orchestra.run.smithi008.stdout: "duration": 0.00012473700000000001 2023-08-01T19:56:03.341 INFO:teuthology.orchestra.run.smithi008.stdout: }, 2023-08-01T19:56:03.341 INFO:teuthology.orchestra.run.smithi008.stdout: { 2023-08-01T19:56:03.342 INFO:teuthology.orchestra.run.smithi008.stdout: "event": "waiting for subops from 1", 2023-08-01T19:56:03.342 INFO:teuthology.orchestra.run.smithi008.stdout: "time": "2023-08-01T19:55:09.283637+0000", 2023-08-01T19:56:03.342 INFO:teuthology.orchestra.run.smithi008.stdout: "duration": 0.00014715600000000001 2023-08-01T19:56:03.342 INFO:teuthology.orchestra.run.smithi008.stdout: }, 2023-08-01T19:56:03.342 INFO:teuthology.orchestra.run.smithi008.stdout: { 2023-08-01T19:56:03.342 INFO:teuthology.orchestra.run.smithi008.stdout: "event": "op_commit", 2023-08-01T19:56:03.342 INFO:teuthology.orchestra.run.smithi008.stdout: "time": "2023-08-01T19:55:09.288214+0000", 2023-08-01T19:56:03.342 INFO:teuthology.orchestra.run.smithi008.stdout: "duration": 0.0045769560000000001 2023-08-01T19:56:03.343 INFO:teuthology.orchestra.run.smithi008.stdout: }, 2023-08-01T19:56:03.343 INFO:teuthology.orchestra.run.smithi008.stdout: { 2023-08-01T19:56:03.343 INFO:teuthology.orchestra.run.smithi008.stdout: "event": "sub_op_commit_rec", 2023-08-01T19:56:03.343 INFO:teuthology.orchestra.run.smithi008.stdout: "time": "2023-08-01T19:55:09.351721+0000", 2023-08-01T19:56:03.343 INFO:teuthology.orchestra.run.smithi008.stdout: "duration": 0.063507383000000001 2023-08-01T19:56:03.344 INFO:teuthology.orchestra.run.smithi008.stdout: }, 2023-08-01T19:56:03.344 INFO:teuthology.orchestra.run.smithi008.stdout: { 2023-08-01T19:56:03.344 INFO:teuthology.orchestra.run.smithi008.stdout: "event": "commit_sent", 2023-08-01T19:56:03.344 INFO:teuthology.orchestra.run.smithi008.stdout: "time": "2023-08-01T19:55:09.351777+0000", 2023-08-01T19:56:03.344 INFO:teuthology.orchestra.run.smithi008.stdout: "duration": 5.5733999999999999e-05 2023-08-01T19:56:03.344 INFO:teuthology.orchestra.run.smithi008.stdout: }, 2023-08-01T19:56:03.344 INFO:teuthology.orchestra.run.smithi008.stdout: { 2023-08-01T19:56:03.345 INFO:teuthology.orchestra.run.smithi008.stdout: "event": "done", 2023-08-01T19:56:03.345 INFO:teuthology.orchestra.run.smithi008.stdout: "time": "2023-08-01T19:55:09.351817+0000", 2023-08-01T19:56:03.345 INFO:teuthology.orchestra.run.smithi008.stdout: "duration": 3.9765000000000003e-05 2023-08-01T19:56:03.345 INFO:teuthology.orchestra.run.smithi008.stdout: } 2023-08-01T19:56:03.345 INFO:teuthology.orchestra.run.smithi008.stdout: ] 2023-08-01T19:56:03.345 INFO:teuthology.orchestra.run.smithi008.stdout: } 2023-08-01T19:56:03.345 INFO:teuthology.orchestra.run.smithi008.stdout: }, 2023-08-01T19:56:03.345 INFO:teuthology.orchestra.run.smithi008.stdout: { 2023-08-01T19:56:03.346 INFO:teuthology.orchestra.run.smithi008.stdout: "description": "osd_op(client.4668.0:107874 5.3 5:ce4c2799:::benchmark_data_smithi006_114134_object107873:head [set-alloc-hint object_size 65536 write_size 65536,write 0~65536] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e38)", 2023-08-01T19:56:03.346 INFO:teuthology.orchestra.run.smithi008.stdout: "initiated_at": "2023-08-01T19:55:09.286239+0000", 2023-08-01T19:56:03.346 INFO:teuthology.orchestra.run.smithi008.stdout: "age": 53.949319809000002, 2023-08-01T19:56:03.346 INFO:teuthology.orchestra.run.smithi008.stdout: "duration": 0.068224389999999996, 2023-08-01T19:56:03.346 INFO:teuthology.orchestra.run.smithi008.stdout: "type_data": { 2023-08-01T19:56:03.346 INFO:teuthology.orchestra.run.smithi008.stdout: "flag_point": "commit sent; apply or cleanup", 2023-08-01T19:56:03.346 INFO:teuthology.orchestra.run.smithi008.stdout: "client_info": { 2023-08-01T19:56:03.347 INFO:teuthology.orchestra.run.smithi008.stdout: "client": "client.4668", 2023-08-01T19:56:03.347 INFO:teuthology.orchestra.run.smithi008.stdout: "client_addr": "172.21.15.6:0/1709472247", 2023-08-01T19:56:03.347 INFO:teuthology.orchestra.run.smithi008.stdout: "tid": 107874 2023-08-01T19:56:03.347 INFO:teuthology.orchestra.run.smithi008.stdout: }, 2023-08-01T19:56:03.347 INFO:teuthology.orchestra.run.smithi008.stdout: "events": [ 2023-08-01T19:56:03.347 INFO:teuthology.orchestra.run.smithi008.stdout: { 2023-08-01T19:56:03.347 INFO:teuthology.orchestra.run.smithi008.stdout: "event": "initiated", 2023-08-01T19:56:03.347 INFO:teuthology.orchestra.run.smithi008.stdout: "time": "2023-08-01T19:55:09.286239+0000", 2023-08-01T19:56:03.348 INFO:teuthology.orchestra.run.smithi008.stdout: "duration": 0 2023-08-01T19:56:03.348 INFO:teuthology.orchestra.run.smithi008.stdout: }, 2023-08-01T19:56:03.348 INFO:teuthology.orchestra.run.smithi008.stdout: { 2023-08-01T19:56:03.348 INFO:teuthology.orchestra.run.smithi008.stdout: "event": "throttled", 2023-08-01T19:56:03.348 INFO:teuthology.orchestra.run.smithi008.stdout: "time": "2023-08-01T19:55:09.286239+0000", 2023-08-01T19:56:03.348 INFO:teuthology.orchestra.run.smithi008.stdout: "duration": 0 2023-08-01T19:56:03.348 INFO:teuthology.orchestra.run.smithi008.stdout: }, 2023-08-01T19:56:03.349 INFO:teuthology.orchestra.run.smithi008.stdout: { 2023-08-01T19:56:03.349 INFO:teuthology.orchestra.run.smithi008.stdout: "event": "header_read", 2023-08-01T19:56:03.349 INFO:teuthology.orchestra.run.smithi008.stdout: "time": "2023-08-01T19:55:09.286238+0000", 2023-08-01T19:56:03.349 INFO:teuthology.orchestra.run.smithi008.stdout: "duration": 4294967295.999999 2023-08-01T19:56:03.350 INFO:teuthology.orchestra.run.smithi008.stdout: }, 2023-08-01T19:56:03.350 INFO:teuthology.orchestra.run.smithi008.stdout: { 2023-08-01T19:56:03.350 INFO:teuthology.orchestra.run.smithi008.stdout: "event": "all_read", 2023-08-01T19:56:03.350 INFO:teuthology.orchestra.run.smithi008.stdout: "time": "2023-08-01T19:55:09.286310+0000", 2023-08-01T19:56:03.350 INFO:teuthology.orchestra.run.smithi008.stdout: "duration": 7.2583999999999995e-05 2023-08-01T19:56:03.350 INFO:teuthology.orchestra.run.smithi008.stdout: }, 2023-08-01T19:56:03.351 INFO:teuthology.orchestra.run.smithi008.stdout: { 2023-08-01T19:56:03.351 INFO:teuthology.orchestra.run.smithi008.stdout: "event": "dispatched", 2023-08-01T19:56:03.351 INFO:teuthology.orchestra.run.smithi008.stdout: "time": "2023-08-01T19:55:09.286323+0000", 2023-08-01T19:56:03.351 INFO:teuthology.orchestra.run.smithi008.stdout: "duration": 1.3151e-05 2023-08-01T19:56:03.351 INFO:teuthology.orchestra.run.smithi008.stdout: }, 2023-08-01T19:56:03.351 INFO:teuthology.orchestra.run.smithi008.stdout: { 2023-08-01T19:56:03.351 INFO:teuthology.orchestra.run.smithi008.stdout: "event": "queued_for_pg", 2023-08-01T19:56:03.351 INFO:teuthology.orchestra.run.smithi008.stdout: "time": "2023-08-01T19:55:09.286329+0000", 2023-08-01T19:56:03.352 INFO:teuthology.orchestra.run.smithi008.stdout: "duration": 5.8719999999999999e-06 2023-08-01T19:56:03.352 INFO:teuthology.orchestra.run.smithi008.stdout: }, 2023-08-01T19:56:03.352 INFO:teuthology.orchestra.run.smithi008.stdout: { 2023-08-01T19:56:03.352 INFO:teuthology.orchestra.run.smithi008.stdout: "event": "reached_pg", 2023-08-01T19:56:03.352 INFO:teuthology.orchestra.run.smithi008.stdout: "time": "2023-08-01T19:55:09.286392+0000", 2023-08-01T19:56:03.352 INFO:teuthology.orchestra.run.smithi008.stdout: "duration": 6.2378000000000005e-05 2023-08-01T19:56:03.352 INFO:teuthology.orchestra.run.smithi008.stdout: }, 2023-08-01T19:56:03.353 INFO:teuthology.orchestra.run.smithi008.stdout: { 2023-08-01T19:56:03.353 INFO:teuthology.orchestra.run.smithi008.stdout: "event": "started", 2023-08-01T19:56:03.353 INFO:teuthology.orchestra.run.smithi008.stdout: "time": "2023-08-01T19:55:09.286473+0000", 2023-08-01T19:56:03.353 INFO:teuthology.orchestra.run.smithi008.stdout: "duration": 8.1327000000000002e-05 2023-08-01T19:56:03.353 INFO:teuthology.orchestra.run.smithi008.stdout: }, 2023-08-01T19:56:03.353 INFO:teuthology.orchestra.run.smithi008.stdout: { 2023-08-01T19:56:03.353 INFO:teuthology.orchestra.run.smithi008.stdout: "event": "waiting for subops from 1", 2023-08-01T19:56:03.353 INFO:teuthology.orchestra.run.smithi008.stdout: "time": "2023-08-01T19:55:09.286557+0000", 2023-08-01T19:56:03.354 INFO:teuthology.orchestra.run.smithi008.stdout: "duration": 8.4140000000000004e-05 2023-08-01T19:56:03.354 INFO:teuthology.orchestra.run.smithi008.stdout: }, 2023-08-01T19:56:03.354 INFO:teuthology.orchestra.run.smithi008.stdout: { 2023-08-01T19:56:03.354 INFO:teuthology.orchestra.run.smithi008.stdout: "event": "op_commit", 2023-08-01T19:56:03.354 INFO:teuthology.orchestra.run.smithi008.stdout: "time": "2023-08-01T19:55:09.290681+0000", 2023-08-01T19:56:03.354 INFO:teuthology.orchestra.run.smithi008.stdout: "duration": 0.0041242420000000002 2023-08-01T19:56:03.354 INFO:teuthology.orchestra.run.smithi008.stdout: }, 2023-08-01T19:56:03.354 INFO:teuthology.orchestra.run.smithi008.stdout: { 2023-08-01T19:56:03.355 INFO:teuthology.orchestra.run.smithi008.stdout: "event": "sub_op_commit_rec", 2023-08-01T19:56:03.355 INFO:teuthology.orchestra.run.smithi008.stdout: "time": "2023-08-01T19:55:09.354372+0000", 2023-08-01T19:56:03.355 INFO:teuthology.orchestra.run.smithi008.stdout: "duration": 0.063690438000000002 2023-08-01T19:56:03.355 INFO:teuthology.orchestra.run.smithi008.stdout: }, 2023-08-01T19:56:03.355 INFO:teuthology.orchestra.run.smithi008.stdout: { 2023-08-01T19:56:03.355 INFO:teuthology.orchestra.run.smithi008.stdout: "event": "commit_sent", 2023-08-01T19:56:03.355 INFO:teuthology.orchestra.run.smithi008.stdout: "time": "2023-08-01T19:55:09.354421+0000", 2023-08-01T19:56:03.356 INFO:teuthology.orchestra.run.smithi008.stdout: "duration": 4.9413000000000003e-05 2023-08-01T19:56:03.356 INFO:teuthology.orchestra.run.smithi008.stdout: }, 2023-08-01T19:56:03.356 INFO:teuthology.orchestra.run.smithi008.stdout: { 2023-08-01T19:56:03.356 INFO:teuthology.orchestra.run.smithi008.stdout: "event": "done", 2023-08-01T19:56:03.356 INFO:teuthology.orchestra.run.smithi008.stdout: "time": "2023-08-01T19:55:09.354463+0000", 2023-08-01T19:56:03.357 INFO:teuthology.orchestra.run.smithi008.stdout: "duration": 4.1924e-05 2023-08-01T19:56:03.357 INFO:teuthology.orchestra.run.smithi008.stdout: } 2023-08-01T19:56:03.357 INFO:teuthology.orchestra.run.smithi008.stdout: ] 2023-08-01T19:56:03.357 INFO:teuthology.orchestra.run.smithi008.stdout: } 2023-08-01T19:56:03.357 INFO:teuthology.orchestra.run.smithi008.stdout: }, 2023-08-01T19:56:03.357 INFO:teuthology.orchestra.run.smithi008.stdout: { 2023-08-01T19:56:03.357 INFO:teuthology.orchestra.run.smithi008.stdout: "description": "osd_op(client.4668.0:197398 5.1 5:809d7164:::benchmark_data_smithi006_114134_object63737:head [delete] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e61)", 2023-08-01T19:56:03.357 INFO:teuthology.orchestra.run.smithi008.stdout: "initiated_at": "2023-08-01T19:55:58.554713+0000", 2023-08-01T19:56:03.358 INFO:teuthology.orchestra.run.smithi008.stdout: "age": 4.6808451209999999, 2023-08-01T19:56:03.358 INFO:teuthology.orchestra.run.smithi008.stdout: "duration": 1.0661326660000001, 2023-08-01T19:56:03.358 INFO:teuthology.orchestra.run.smithi008.stdout: "type_data": { 2023-08-01T19:56:03.358 INFO:teuthology.orchestra.run.smithi008.stdout: "flag_point": "reached pg", 2023-08-01T19:56:03.358 INFO:teuthology.orchestra.run.smithi008.stdout: "client_info": { 2023-08-01T19:56:03.358 INFO:teuthology.orchestra.run.smithi008.stdout: "client": "client.4668", 2023-08-01T19:56:03.358 INFO:teuthology.orchestra.run.smithi008.stdout: "client_addr": "172.21.15.6:0/1709472247", 2023-08-01T19:56:03.359 INFO:teuthology.orchestra.run.smithi008.stdout: "tid": 197398 2023-08-01T19:56:03.359 INFO:teuthology.orchestra.run.smithi008.stdout: }, 2023-08-01T19:56:03.359 INFO:teuthology.orchestra.run.smithi008.stdout: "events": [ 2023-08-01T19:56:03.359 INFO:teuthology.orchestra.run.smithi008.stdout: { 2023-08-01T19:56:03.359 INFO:teuthology.orchestra.run.smithi008.stdout: "event": "initiated", 2023-08-01T19:56:03.359 INFO:teuthology.orchestra.run.smithi008.stdout: "time": "2023-08-01T19:55:58.554713+0000", 2023-08-01T19:56:03.359 INFO:teuthology.orchestra.run.smithi008.stdout: "duration": 0 2023-08-01T19:56:03.359 INFO:teuthology.orchestra.run.smithi008.stdout: }, 2023-08-01T19:56:03.360 INFO:teuthology.orchestra.run.smithi008.stdout: { 2023-08-01T19:56:03.360 INFO:teuthology.orchestra.run.smithi008.stdout: "event": "throttled", 2023-08-01T19:56:03.360 INFO:teuthology.orchestra.run.smithi008.stdout: "time": "2023-08-01T19:55:58.554713+0000", 2023-08-01T19:56:03.360 INFO:teuthology.orchestra.run.smithi008.stdout: "duration": 0 2023-08-01T19:56:03.360 INFO:teuthology.orchestra.run.smithi008.stdout: }, 2023-08-01T19:56:03.360 INFO:teuthology.orchestra.run.smithi008.stdout: { 2023-08-01T19:56:03.361 INFO:teuthology.orchestra.run.smithi008.stdout: "event": "header_read", 2023-08-01T19:56:03.361 INFO:teuthology.orchestra.run.smithi008.stdout: "time": "2023-08-01T19:55:58.554713+0000", 2023-08-01T19:56:03.361 INFO:teuthology.orchestra.run.smithi008.stdout: "duration": 4294967295.999999 2023-08-01T19:56:03.361 INFO:teuthology.orchestra.run.smithi008.stdout: }, 2023-08-01T19:56:03.362 INFO:teuthology.orchestra.run.smithi008.stdout: { 2023-08-01T19:56:03.362 INFO:teuthology.orchestra.run.smithi008.stdout: "event": "all_read", 2023-08-01T19:56:03.362 INFO:teuthology.orchestra.run.smithi008.stdout: "time": "2023-08-01T19:55:58.554717+0000", 2023-08-01T19:56:03.362 INFO:teuthology.orchestra.run.smithi008.stdout: "duration": 4.7389999999999999e-06 2023-08-01T19:56:03.363 INFO:teuthology.orchestra.run.smithi008.stdout: }, 2023-08-01T19:56:03.363 INFO:teuthology.orchestra.run.smithi008.stdout: { 2023-08-01T19:56:03.363 INFO:teuthology.orchestra.run.smithi008.stdout: "event": "dispatched", 2023-08-01T19:56:03.363 INFO:teuthology.orchestra.run.smithi008.stdout: "time": "2023-08-01T19:55:58.554725+0000", 2023-08-01T19:56:03.364 INFO:teuthology.orchestra.run.smithi008.stdout: "duration": 7.9820000000000008e-06 2023-08-01T19:56:03.364 INFO:teuthology.orchestra.run.smithi008.stdout: }, 2023-08-01T19:56:03.364 INFO:teuthology.orchestra.run.smithi008.stdout: { 2023-08-01T19:56:03.365 INFO:teuthology.orchestra.run.smithi008.stdout: "event": "queued_for_pg", 2023-08-01T19:56:03.365 INFO:teuthology.orchestra.run.smithi008.stdout: "time": "2023-08-01T19:55:58.554730+0000", 2023-08-01T19:56:03.365 INFO:teuthology.orchestra.run.smithi008.stdout: "duration": 4.318e-06 2023-08-01T19:56:03.365 INFO:teuthology.orchestra.run.smithi008.stdout: }, 2023-08-01T19:56:03.366 INFO:teuthology.orchestra.run.smithi008.stdout: { 2023-08-01T19:56:03.366 INFO:teuthology.orchestra.run.smithi008.stdout: "event": "reached_pg", 2023-08-01T19:56:03.366 INFO:teuthology.orchestra.run.smithi008.stdout: "time": "2023-08-01T19:55:58.554767+0000", 2023-08-01T19:56:03.366 INFO:teuthology.orchestra.run.smithi008.stdout: "duration": 3.7778000000000003e-05 2023-08-01T19:56:03.367 INFO:teuthology.orchestra.run.smithi008.stdout: }, 2023-08-01T19:56:03.367 INFO:teuthology.orchestra.run.smithi008.stdout: { 2023-08-01T19:56:03.367 INFO:teuthology.orchestra.run.smithi008.stdout: "event": "started", 2023-08-01T19:56:03.367 INFO:teuthology.orchestra.run.smithi008.stdout: "time": "2023-08-01T19:55:58.554874+0000", 2023-08-01T19:56:03.367 INFO:teuthology.orchestra.run.smithi008.stdout: "duration": 0.000106613 2023-08-01T19:56:03.367 INFO:teuthology.orchestra.run.smithi008.stdout: }, 2023-08-01T19:56:03.367 INFO:teuthology.orchestra.run.smithi008.stdout: { 2023-08-01T19:56:03.368 INFO:teuthology.orchestra.run.smithi008.stdout: "event": "waiting for subops from 1", 2023-08-01T19:56:03.368 INFO:teuthology.orchestra.run.smithi008.stdout: "time": "2023-08-01T19:55:58.554941+0000", 2023-08-01T19:56:03.368 INFO:teuthology.orchestra.run.smithi008.stdout: "duration": 6.6569000000000006e-05 2023-08-01T19:56:03.368 INFO:teuthology.orchestra.run.smithi008.stdout: }, 2023-08-01T19:56:03.368 INFO:teuthology.orchestra.run.smithi008.stdout: { 2023-08-01T19:56:03.369 INFO:teuthology.orchestra.run.smithi008.stdout: "event": "reached_pg", 2023-08-01T19:56:03.369 INFO:teuthology.orchestra.run.smithi008.stdout: "time": "2023-08-01T19:55:58.569436+0000", 2023-08-01T19:56:03.369 INFO:teuthology.orchestra.run.smithi008.stdout: "duration": 0.014495413 2023-08-01T19:56:03.369 INFO:teuthology.orchestra.run.smithi008.stdout: }, 2023-08-01T19:56:03.369 INFO:teuthology.orchestra.run.smithi008.stdout: { 2023-08-01T19:56:03.369 INFO:teuthology.orchestra.run.smithi008.stdout: "event": "waiting for peered", 2023-08-01T19:56:03.370 INFO:teuthology.orchestra.run.smithi008.stdout: "time": "2023-08-01T19:55:58.569441+0000", 2023-08-01T19:56:03.370 INFO:teuthology.orchestra.run.smithi008.stdout: "duration": 5.1109999999999999e-06 2023-08-01T19:56:03.370 INFO:teuthology.orchestra.run.smithi008.stdout: }, 2023-08-01T19:56:03.370 INFO:teuthology.orchestra.run.smithi008.stdout: { 2023-08-01T19:56:03.370 INFO:teuthology.orchestra.run.smithi008.stdout: "event": "reached_pg", 2023-08-01T19:56:03.370 INFO:teuthology.orchestra.run.smithi008.stdout: "time": "2023-08-01T19:55:59.620748+0000", 2023-08-01T19:56:03.370 INFO:teuthology.orchestra.run.smithi008.stdout: "duration": 1.0513071810000001 2023-08-01T19:56:03.370 INFO:teuthology.orchestra.run.smithi008.stdout: }, 2023-08-01T19:56:03.371 INFO:teuthology.orchestra.run.smithi008.stdout: { 2023-08-01T19:56:03.371 INFO:teuthology.orchestra.run.smithi008.stdout: "event": "done", 2023-08-01T19:56:03.371 INFO:teuthology.orchestra.run.smithi008.stdout: "time": "2023-08-01T19:55:59.620846+0000", 2023-08-01T19:56:03.371 INFO:teuthology.orchestra.run.smithi008.stdout: "duration": 9.7739999999999996e-05 2023-08-01T19:56:03.371 INFO:teuthology.orchestra.run.smithi008.stdout: } 2023-08-01T19:56:03.371 INFO:teuthology.orchestra.run.smithi008.stdout: ] 2023-08-01T19:56:03.371 INFO:teuthology.orchestra.run.smithi008.stdout: } 2023-08-01T19:56:03.372 INFO:teuthology.orchestra.run.smithi008.stdout: }, 2023-08-01T19:56:03.372 INFO:teuthology.orchestra.run.smithi008.stdout: { 2023-08-01T19:56:03.372 INFO:teuthology.orchestra.run.smithi008.stdout: "description": "osd_op(client.4668.0:197400 5.c 5:30dad7f9:::benchmark_data_smithi006_114134_object63739:head [delete] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e61)", 2023-08-01T19:56:03.372 INFO:teuthology.orchestra.run.smithi008.stdout: "initiated_at": "2023-08-01T19:55:58.556576+0000", 2023-08-01T19:56:03.372 INFO:teuthology.orchestra.run.smithi008.stdout: "age": 4.6789822719999998, 2023-08-01T19:56:03.372 INFO:teuthology.orchestra.run.smithi008.stdout: "duration": 1.062559968, 2023-08-01T19:56:03.372 INFO:teuthology.orchestra.run.smithi008.stdout: "type_data": { 2023-08-01T19:56:03.373 INFO:teuthology.orchestra.run.smithi008.stdout: "flag_point": "reached pg", 2023-08-01T19:56:03.373 INFO:teuthology.orchestra.run.smithi008.stdout: "client_info": { 2023-08-01T19:56:03.373 INFO:teuthology.orchestra.run.smithi008.stdout: "client": "client.4668", 2023-08-01T19:56:03.373 INFO:teuthology.orchestra.run.smithi008.stdout: "client_addr": "172.21.15.6:0/1709472247", 2023-08-01T19:56:03.374 INFO:teuthology.orchestra.run.smithi008.stdout: "tid": 197400 2023-08-01T19:56:03.374 INFO:teuthology.orchestra.run.smithi008.stdout: }, 2023-08-01T19:56:03.374 INFO:teuthology.orchestra.run.smithi008.stdout: "events": [ 2023-08-01T19:56:03.374 INFO:teuthology.orchestra.run.smithi008.stdout: { 2023-08-01T19:56:03.375 INFO:teuthology.orchestra.run.smithi008.stdout: "event": "initiated", 2023-08-01T19:56:03.375 INFO:teuthology.orchestra.run.smithi008.stdout: "time": "2023-08-01T19:55:58.556576+0000", 2023-08-01T19:56:03.375 INFO:teuthology.orchestra.run.smithi008.stdout: "duration": 0 2023-08-01T19:56:03.376 INFO:teuthology.orchestra.run.smithi008.stdout: }, 2023-08-01T19:56:03.376 INFO:teuthology.orchestra.run.smithi008.stdout: { 2023-08-01T19:56:03.376 INFO:teuthology.orchestra.run.smithi008.stdout: "event": "throttled", 2023-08-01T19:56:03.376 INFO:teuthology.orchestra.run.smithi008.stdout: "time": "2023-08-01T19:55:58.556576+0000", 2023-08-01T19:56:03.377 INFO:teuthology.orchestra.run.smithi008.stdout: "duration": 0 2023-08-01T19:56:03.377 INFO:teuthology.orchestra.run.smithi008.stdout: }, 2023-08-01T19:56:03.377 INFO:teuthology.orchestra.run.smithi008.stdout: { 2023-08-01T19:56:03.377 INFO:teuthology.orchestra.run.smithi008.stdout: "event": "header_read", 2023-08-01T19:56:03.378 INFO:teuthology.orchestra.run.smithi008.stdout: "time": "2023-08-01T19:55:58.556575+0000", 2023-08-01T19:56:03.378 INFO:teuthology.orchestra.run.smithi008.stdout: "duration": 4294967295.999999 2023-08-01T19:56:03.378 INFO:teuthology.orchestra.run.smithi008.stdout: }, 2023-08-01T19:56:03.378 INFO:teuthology.orchestra.run.smithi008.stdout: { 2023-08-01T19:56:03.379 INFO:teuthology.orchestra.run.smithi008.stdout: "event": "all_read", 2023-08-01T19:56:03.379 INFO:teuthology.orchestra.run.smithi008.stdout: "time": "2023-08-01T19:55:58.556580+0000", 2023-08-01T19:56:03.379 INFO:teuthology.orchestra.run.smithi008.stdout: "duration": 4.2860000000000001e-06 2023-08-01T19:56:03.379 INFO:teuthology.orchestra.run.smithi008.stdout: }, 2023-08-01T19:56:03.380 INFO:teuthology.orchestra.run.smithi008.stdout: { 2023-08-01T19:56:03.380 INFO:teuthology.orchestra.run.smithi008.stdout: "event": "dispatched", 2023-08-01T19:56:03.380 INFO:teuthology.orchestra.run.smithi008.stdout: "time": "2023-08-01T19:55:58.556589+0000", 2023-08-01T19:56:03.380 INFO:teuthology.orchestra.run.smithi008.stdout: "duration": 9.6500000000000008e-06 2023-08-01T19:56:03.381 INFO:teuthology.orchestra.run.smithi008.stdout: }, 2023-08-01T19:56:03.381 INFO:teuthology.orchestra.run.smithi008.stdout: { 2023-08-01T19:56:03.381 INFO:teuthology.orchestra.run.smithi008.stdout: "event": "queued_for_pg", 2023-08-01T19:56:03.381 INFO:teuthology.orchestra.run.smithi008.stdout: "time": "2023-08-01T19:55:58.556596+0000", 2023-08-01T19:56:03.382 INFO:teuthology.orchestra.run.smithi008.stdout: "duration": 6.1430000000000003e-06 2023-08-01T19:56:03.382 INFO:teuthology.orchestra.run.smithi008.stdout: }, 2023-08-01T19:56:03.382 INFO:teuthology.orchestra.run.smithi008.stdout: { 2023-08-01T19:56:03.382 INFO:teuthology.orchestra.run.smithi008.stdout: "event": "reached_pg", 2023-08-01T19:56:03.383 INFO:teuthology.orchestra.run.smithi008.stdout: "time": "2023-08-01T19:55:58.556634+0000", 2023-08-01T19:56:03.383 INFO:teuthology.orchestra.run.smithi008.stdout: "duration": 3.8080000000000001e-05 2023-08-01T19:56:03.383 INFO:teuthology.orchestra.run.smithi008.stdout: }, 2023-08-01T19:56:03.384 INFO:teuthology.orchestra.run.smithi008.stdout: { 2023-08-01T19:56:03.384 INFO:teuthology.orchestra.run.smithi008.stdout: "event": "started", 2023-08-01T19:56:03.384 INFO:teuthology.orchestra.run.smithi008.stdout: "time": "2023-08-01T19:55:58.556754+0000", 2023-08-01T19:56:03.384 INFO:teuthology.orchestra.run.smithi008.stdout: "duration": 0.000120444 2023-08-01T19:56:03.385 INFO:teuthology.orchestra.run.smithi008.stdout: }, 2023-08-01T19:56:03.385 INFO:teuthology.orchestra.run.smithi008.stdout: { 2023-08-01T19:56:03.385 INFO:teuthology.orchestra.run.smithi008.stdout: "event": "waiting for subops from 1", 2023-08-01T19:56:03.386 INFO:teuthology.orchestra.run.smithi008.stdout: "time": "2023-08-01T19:55:58.556875+0000", 2023-08-01T19:56:03.386 INFO:teuthology.orchestra.run.smithi008.stdout: "duration": 0.00012100900000000001 2023-08-01T19:56:03.386 INFO:teuthology.orchestra.run.smithi008.stdout: }, 2023-08-01T19:56:03.386 INFO:teuthology.orchestra.run.smithi008.stdout: { 2023-08-01T19:56:03.386 INFO:teuthology.orchestra.run.smithi008.stdout: "event": "reached_pg", 2023-08-01T19:56:03.387 INFO:teuthology.orchestra.run.smithi008.stdout: "time": "2023-08-01T19:55:58.567406+0000", 2023-08-01T19:56:03.387 INFO:teuthology.orchestra.run.smithi008.stdout: "duration": 0.010531351 2023-08-01T19:56:03.387 INFO:teuthology.orchestra.run.smithi008.stdout: }, 2023-08-01T19:56:03.387 INFO:teuthology.orchestra.run.smithi008.stdout: { 2023-08-01T19:56:03.387 INFO:teuthology.orchestra.run.smithi008.stdout: "event": "waiting for peered", 2023-08-01T19:56:03.387 INFO:teuthology.orchestra.run.smithi008.stdout: "time": "2023-08-01T19:55:58.567414+0000", 2023-08-01T19:56:03.387 INFO:teuthology.orchestra.run.smithi008.stdout: "duration": 7.9189999999999999e-06 2023-08-01T19:56:03.387 INFO:teuthology.orchestra.run.smithi008.stdout: }, 2023-08-01T19:56:03.388 INFO:teuthology.orchestra.run.smithi008.stdout: { 2023-08-01T19:56:03.388 INFO:teuthology.orchestra.run.smithi008.stdout: "event": "reached_pg", 2023-08-01T19:56:03.388 INFO:teuthology.orchestra.run.smithi008.stdout: "time": "2023-08-01T19:55:59.619054+0000", 2023-08-01T19:56:03.388 INFO:teuthology.orchestra.run.smithi008.stdout: "duration": 1.0516396269999999 2023-08-01T19:56:03.388 INFO:teuthology.orchestra.run.smithi008.stdout: }, 2023-08-01T19:56:03.388 INFO:teuthology.orchestra.run.smithi008.stdout: { 2023-08-01T19:56:03.388 INFO:teuthology.orchestra.run.smithi008.stdout: "event": "done", 2023-08-01T19:56:03.389 INFO:teuthology.orchestra.run.smithi008.stdout: "time": "2023-08-01T19:55:59.619136+0000", 2023-08-01T19:56:03.389 INFO:teuthology.orchestra.run.smithi008.stdout: "duration": 8.2208999999999998e-05 2023-08-01T19:56:03.389 INFO:teuthology.orchestra.run.smithi008.stdout: } 2023-08-01T19:56:03.389 INFO:teuthology.orchestra.run.smithi008.stdout: ] 2023-08-01T19:56:03.389 INFO:teuthology.orchestra.run.smithi008.stdout: } 2023-08-01T19:56:03.389 INFO:teuthology.orchestra.run.smithi008.stdout: }, 2023-08-01T19:56:03.389 INFO:teuthology.orchestra.run.smithi008.stdout: { 2023-08-01T19:56:03.390 INFO:teuthology.orchestra.run.smithi008.stdout: "description": "osd_op(client.4668.0:197401 5.1 5:88b38567:::benchmark_data_smithi006_114134_object63740:head [delete] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e61)", 2023-08-01T19:56:03.390 INFO:teuthology.orchestra.run.smithi008.stdout: "initiated_at": "2023-08-01T19:55:58.556607+0000", 2023-08-01T19:56:03.390 INFO:teuthology.orchestra.run.smithi008.stdout: "age": 4.6789518479999996, 2023-08-01T19:56:03.390 INFO:teuthology.orchestra.run.smithi008.stdout: "duration": 1.0643254870000001, 2023-08-01T19:56:03.390 INFO:teuthology.orchestra.run.smithi008.stdout: "type_data": { 2023-08-01T19:56:03.390 INFO:teuthology.orchestra.run.smithi008.stdout: "flag_point": "reached pg", 2023-08-01T19:56:03.390 INFO:teuthology.orchestra.run.smithi008.stdout: "client_info": { 2023-08-01T19:56:03.390 INFO:teuthology.orchestra.run.smithi008.stdout: "client": "client.4668", 2023-08-01T19:56:03.391 INFO:teuthology.orchestra.run.smithi008.stdout: "client_addr": "172.21.15.6:0/1709472247", 2023-08-01T19:56:03.391 INFO:teuthology.orchestra.run.smithi008.stdout: "tid": 197401 2023-08-01T19:56:03.391 INFO:teuthology.orchestra.run.smithi008.stdout: }, 2023-08-01T19:56:03.391 INFO:teuthology.orchestra.run.smithi008.stdout: "events": [ 2023-08-01T19:56:03.391 INFO:teuthology.orchestra.run.smithi008.stdout: { 2023-08-01T19:56:03.391 INFO:teuthology.orchestra.run.smithi008.stdout: "event": "initiated", 2023-08-01T19:56:03.391 INFO:teuthology.orchestra.run.smithi008.stdout: "time": "2023-08-01T19:55:58.556607+0000", 2023-08-01T19:56:03.392 INFO:teuthology.orchestra.run.smithi008.stdout: "duration": 0 2023-08-01T19:56:03.392 INFO:teuthology.orchestra.run.smithi008.stdout: }, 2023-08-01T19:56:03.392 INFO:teuthology.orchestra.run.smithi008.stdout: { 2023-08-01T19:56:03.392 INFO:teuthology.orchestra.run.smithi008.stdout: "event": "throttled", 2023-08-01T19:56:03.392 INFO:teuthology.orchestra.run.smithi008.stdout: "time": "2023-08-01T19:55:58.556607+0000", 2023-08-01T19:56:03.393 INFO:teuthology.orchestra.run.smithi008.stdout: "duration": 0 2023-08-01T19:56:03.393 INFO:teuthology.orchestra.run.smithi008.stdout: }, 2023-08-01T19:56:03.393 INFO:teuthology.orchestra.run.smithi008.stdout: { 2023-08-01T19:56:03.393 INFO:teuthology.orchestra.run.smithi008.stdout: "event": "header_read", 2023-08-01T19:56:03.393 INFO:teuthology.orchestra.run.smithi008.stdout: "time": "2023-08-01T19:55:58.556606+0000", 2023-08-01T19:56:03.393 INFO:teuthology.orchestra.run.smithi008.stdout: "duration": 4294967295.9999995 2023-08-01T19:56:03.393 INFO:teuthology.orchestra.run.smithi008.stdout: }, 2023-08-01T19:56:03.394 INFO:teuthology.orchestra.run.smithi008.stdout: { 2023-08-01T19:56:03.394 INFO:teuthology.orchestra.run.smithi008.stdout: "event": "all_read", 2023-08-01T19:56:03.394 INFO:teuthology.orchestra.run.smithi008.stdout: "time": "2023-08-01T19:55:58.556609+0000", 2023-08-01T19:56:03.394 INFO:teuthology.orchestra.run.smithi008.stdout: "duration": 3.1750000000000001e-06 2023-08-01T19:56:03.394 INFO:teuthology.orchestra.run.smithi008.stdout: }, 2023-08-01T19:56:03.394 INFO:teuthology.orchestra.run.smithi008.stdout: { 2023-08-01T19:56:03.394 INFO:teuthology.orchestra.run.smithi008.stdout: "event": "dispatched", 2023-08-01T19:56:03.395 INFO:teuthology.orchestra.run.smithi008.stdout: "time": "2023-08-01T19:55:58.556617+0000", 2023-08-01T19:56:03.395 INFO:teuthology.orchestra.run.smithi008.stdout: "duration": 7.2760000000000003e-06 2023-08-01T19:56:03.395 INFO:teuthology.orchestra.run.smithi008.stdout: }, 2023-08-01T19:56:03.395 INFO:teuthology.orchestra.run.smithi008.stdout: { 2023-08-01T19:56:03.395 INFO:teuthology.orchestra.run.smithi008.stdout: "event": "queued_for_pg", 2023-08-01T19:56:03.395 INFO:teuthology.orchestra.run.smithi008.stdout: "time": "2023-08-01T19:55:58.556621+0000", 2023-08-01T19:56:03.395 INFO:teuthology.orchestra.run.smithi008.stdout: "duration": 4.8219999999999997e-06 2023-08-01T19:56:03.395 INFO:teuthology.orchestra.run.smithi008.stdout: }, 2023-08-01T19:56:03.396 INFO:teuthology.orchestra.run.smithi008.stdout: { 2023-08-01T19:56:03.396 INFO:teuthology.orchestra.run.smithi008.stdout: "event": "reached_pg", 2023-08-01T19:56:03.396 INFO:teuthology.orchestra.run.smithi008.stdout: "time": "2023-08-01T19:55:58.556651+0000", 2023-08-01T19:56:03.396 INFO:teuthology.orchestra.run.smithi008.stdout: "duration": 2.9921999999999999e-05 2023-08-01T19:56:03.396 INFO:teuthology.orchestra.run.smithi008.stdout: }, 2023-08-01T19:56:03.396 INFO:teuthology.orchestra.run.smithi008.stdout: { 2023-08-01T19:56:03.396 INFO:teuthology.orchestra.run.smithi008.stdout: "event": "started", 2023-08-01T19:56:03.397 INFO:teuthology.orchestra.run.smithi008.stdout: "time": "2023-08-01T19:55:58.556755+0000", 2023-08-01T19:56:03.397 INFO:teuthology.orchestra.run.smithi008.stdout: "duration": 0.000103309 2023-08-01T19:56:03.397 INFO:teuthology.orchestra.run.smithi008.stdout: }, 2023-08-01T19:56:03.397 INFO:teuthology.orchestra.run.smithi008.stdout: { 2023-08-01T19:56:03.397 INFO:teuthology.orchestra.run.smithi008.stdout: "event": "waiting for subops from 1", 2023-08-01T19:56:03.397 INFO:teuthology.orchestra.run.smithi008.stdout: "time": "2023-08-01T19:55:58.556875+0000", 2023-08-01T19:56:03.397 INFO:teuthology.orchestra.run.smithi008.stdout: "duration": 0.000120424 2023-08-01T19:56:03.398 INFO:teuthology.orchestra.run.smithi008.stdout: }, 2023-08-01T19:56:03.398 INFO:teuthology.orchestra.run.smithi008.stdout: { 2023-08-01T19:56:03.398 INFO:teuthology.orchestra.run.smithi008.stdout: "event": "reached_pg", 2023-08-01T19:56:03.398 INFO:teuthology.orchestra.run.smithi008.stdout: "time": "2023-08-01T19:55:58.569459+0000", 2023-08-01T19:56:03.399 INFO:teuthology.orchestra.run.smithi008.stdout: "duration": 0.012583776 2023-08-01T19:56:03.399 INFO:teuthology.orchestra.run.smithi008.stdout: }, 2023-08-01T19:56:03.399 INFO:teuthology.orchestra.run.smithi008.stdout: { 2023-08-01T19:56:03.399 INFO:teuthology.orchestra.run.smithi008.stdout: "event": "waiting for peered", 2023-08-01T19:56:03.399 INFO:teuthology.orchestra.run.smithi008.stdout: "time": "2023-08-01T19:55:58.569462+0000", 2023-08-01T19:56:03.399 INFO:teuthology.orchestra.run.smithi008.stdout: "duration": 2.74e-06 2023-08-01T19:56:03.399 INFO:teuthology.orchestra.run.smithi008.stdout: }, 2023-08-01T19:56:03.400 INFO:teuthology.orchestra.run.smithi008.stdout: { 2023-08-01T19:56:03.400 INFO:teuthology.orchestra.run.smithi008.stdout: "event": "reached_pg", 2023-08-01T19:56:03.400 INFO:teuthology.orchestra.run.smithi008.stdout: "time": "2023-08-01T19:55:59.620880+0000", 2023-08-01T19:56:03.400 INFO:teuthology.orchestra.run.smithi008.stdout: "duration": 1.0514181279999999 2023-08-01T19:56:03.400 INFO:teuthology.orchestra.run.smithi008.stdout: }, 2023-08-01T19:56:03.400 INFO:teuthology.orchestra.run.smithi008.stdout: { 2023-08-01T19:56:03.400 INFO:teuthology.orchestra.run.smithi008.stdout: "event": "done", 2023-08-01T19:56:03.401 INFO:teuthology.orchestra.run.smithi008.stdout: "time": "2023-08-01T19:55:59.620932+0000", 2023-08-01T19:56:03.401 INFO:teuthology.orchestra.run.smithi008.stdout: "duration": 5.2404000000000002e-05 2023-08-01T19:56:03.401 INFO:teuthology.orchestra.run.smithi008.stdout: } 2023-08-01T19:56:03.401 INFO:teuthology.orchestra.run.smithi008.stdout: ] 2023-08-01T19:56:03.401 INFO:teuthology.orchestra.run.smithi008.stdout: } 2023-08-01T19:56:03.401 INFO:teuthology.orchestra.run.smithi008.stdout: }, 2023-08-01T19:56:03.401 INFO:teuthology.orchestra.run.smithi008.stdout: { 2023-08-01T19:56:03.401 INFO:teuthology.orchestra.run.smithi008.stdout: "description": "osd_op(client.4668.0:197402 5.c 5:3f057b78:::benchmark_data_smithi006_114134_object63741:head [delete] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e61)", 2023-08-01T19:56:03.402 INFO:teuthology.orchestra.run.smithi008.stdout: "initiated_at": "2023-08-01T19:55:58.556632+0000", 2023-08-01T19:56:03.402 INFO:teuthology.orchestra.run.smithi008.stdout: "age": 4.6789264780000002, 2023-08-01T19:56:03.402 INFO:teuthology.orchestra.run.smithi008.stdout: "duration": 1.0625773970000001, 2023-08-01T19:56:03.402 INFO:teuthology.orchestra.run.smithi008.stdout: "type_data": { 2023-08-01T19:56:03.402 INFO:teuthology.orchestra.run.smithi008.stdout: "flag_point": "reached pg", 2023-08-01T19:56:03.402 INFO:teuthology.orchestra.run.smithi008.stdout: "client_info": { 2023-08-01T19:56:03.403 INFO:teuthology.orchestra.run.smithi008.stdout: "client": "client.4668", 2023-08-01T19:56:03.403 INFO:teuthology.orchestra.run.smithi008.stdout: "client_addr": "172.21.15.6:0/1709472247", 2023-08-01T19:56:03.403 INFO:teuthology.orchestra.run.smithi008.stdout: "tid": 197402 2023-08-01T19:56:03.403 INFO:teuthology.orchestra.run.smithi008.stdout: }, 2023-08-01T19:56:03.403 INFO:teuthology.orchestra.run.smithi008.stdout: "events": [ 2023-08-01T19:56:03.404 INFO:teuthology.orchestra.run.smithi008.stdout: { 2023-08-01T19:56:03.404 INFO:teuthology.orchestra.run.smithi008.stdout: "event": "initiated", 2023-08-01T19:56:03.404 INFO:teuthology.orchestra.run.smithi008.stdout: "time": "2023-08-01T19:55:58.556632+0000", 2023-08-01T19:56:03.404 INFO:teuthology.orchestra.run.smithi008.stdout: "duration": 0 2023-08-01T19:56:03.404 INFO:teuthology.orchestra.run.smithi008.stdout: }, 2023-08-01T19:56:03.404 INFO:teuthology.orchestra.run.smithi008.stdout: { 2023-08-01T19:56:03.404 INFO:teuthology.orchestra.run.smithi008.stdout: "event": "throttled", 2023-08-01T19:56:03.405 INFO:teuthology.orchestra.run.smithi008.stdout: "time": "2023-08-01T19:55:58.556632+0000", 2023-08-01T19:56:03.405 INFO:teuthology.orchestra.run.smithi008.stdout: "duration": 0 2023-08-01T19:56:03.405 INFO:teuthology.orchestra.run.smithi008.stdout: }, 2023-08-01T19:56:03.405 INFO:teuthology.orchestra.run.smithi008.stdout: { 2023-08-01T19:56:03.406 INFO:teuthology.orchestra.run.smithi008.stdout: "event": "header_read", 2023-08-01T19:56:03.406 INFO:teuthology.orchestra.run.smithi008.stdout: "time": "2023-08-01T19:55:58.556632+0000", 2023-08-01T19:56:03.406 INFO:teuthology.orchestra.run.smithi008.stdout: "duration": 4294967295.9999995 2023-08-01T19:56:03.406 INFO:teuthology.orchestra.run.smithi008.stdout: }, 2023-08-01T19:56:03.406 INFO:teuthology.orchestra.run.smithi008.stdout: { 2023-08-01T19:56:03.406 INFO:teuthology.orchestra.run.smithi008.stdout: "event": "all_read", 2023-08-01T19:56:03.406 INFO:teuthology.orchestra.run.smithi008.stdout: "time": "2023-08-01T19:55:58.556634+0000", 2023-08-01T19:56:03.406 INFO:teuthology.orchestra.run.smithi008.stdout: "duration": 2.8940000000000002e-06 2023-08-01T19:56:03.407 INFO:teuthology.orchestra.run.smithi008.stdout: }, 2023-08-01T19:56:03.407 INFO:teuthology.orchestra.run.smithi008.stdout: { 2023-08-01T19:56:03.407 INFO:teuthology.orchestra.run.smithi008.stdout: "event": "dispatched", 2023-08-01T19:56:03.407 INFO:teuthology.orchestra.run.smithi008.stdout: "time": "2023-08-01T19:55:58.556641+0000", 2023-08-01T19:56:03.407 INFO:teuthology.orchestra.run.smithi008.stdout: "duration": 6.8449999999999997e-06 2023-08-01T19:56:03.407 INFO:teuthology.orchestra.run.smithi008.stdout: }, 2023-08-01T19:56:03.407 INFO:teuthology.orchestra.run.smithi008.stdout: { 2023-08-01T19:56:03.408 INFO:teuthology.orchestra.run.smithi008.stdout: "event": "queued_for_pg", 2023-08-01T19:56:03.408 INFO:teuthology.orchestra.run.smithi008.stdout: "time": "2023-08-01T19:55:58.556646+0000", 2023-08-01T19:56:03.408 INFO:teuthology.orchestra.run.smithi008.stdout: "duration": 5.2070000000000003e-06 2023-08-01T19:56:03.408 INFO:teuthology.orchestra.run.smithi008.stdout: }, 2023-08-01T19:56:03.408 INFO:teuthology.orchestra.run.smithi008.stdout: { 2023-08-01T19:56:03.408 INFO:teuthology.orchestra.run.smithi008.stdout: "event": "reached_pg", 2023-08-01T19:56:03.408 INFO:teuthology.orchestra.run.smithi008.stdout: "time": "2023-08-01T19:55:58.558870+0000", 2023-08-01T19:56:03.408 INFO:teuthology.orchestra.run.smithi008.stdout: "duration": 0.0022237730000000001 2023-08-01T19:56:03.409 INFO:teuthology.orchestra.run.smithi008.stdout: }, 2023-08-01T19:56:03.409 INFO:teuthology.orchestra.run.smithi008.stdout: { 2023-08-01T19:56:03.409 INFO:teuthology.orchestra.run.smithi008.stdout: "event": "started", 2023-08-01T19:56:03.409 INFO:teuthology.orchestra.run.smithi008.stdout: "time": "2023-08-01T19:55:58.559013+0000", 2023-08-01T19:56:03.409 INFO:teuthology.orchestra.run.smithi008.stdout: "duration": 0.00014289899999999999 2023-08-01T19:56:03.409 INFO:teuthology.orchestra.run.smithi008.stdout: }, 2023-08-01T19:56:03.409 INFO:teuthology.orchestra.run.smithi008.stdout: { 2023-08-01T19:56:03.409 INFO:teuthology.orchestra.run.smithi008.stdout: "event": "waiting for subops from 1", 2023-08-01T19:56:03.410 INFO:teuthology.orchestra.run.smithi008.stdout: "time": "2023-08-01T19:55:58.559137+0000", 2023-08-01T19:56:03.410 INFO:teuthology.orchestra.run.smithi008.stdout: "duration": 0.00012428499999999999 2023-08-01T19:56:03.410 INFO:teuthology.orchestra.run.smithi008.stdout: }, 2023-08-01T19:56:03.410 INFO:teuthology.orchestra.run.smithi008.stdout: { 2023-08-01T19:56:03.411 INFO:teuthology.orchestra.run.smithi008.stdout: "event": "reached_pg", 2023-08-01T19:56:03.411 INFO:teuthology.orchestra.run.smithi008.stdout: "time": "2023-08-01T19:55:58.567438+0000", 2023-08-01T19:56:03.411 INFO:teuthology.orchestra.run.smithi008.stdout: "duration": 0.0083003190000000004 2023-08-01T19:56:03.411 INFO:teuthology.orchestra.run.smithi008.stdout: }, 2023-08-01T19:56:03.412 INFO:teuthology.orchestra.run.smithi008.stdout: { 2023-08-01T19:56:03.412 INFO:teuthology.orchestra.run.smithi008.stdout: "event": "waiting for peered", 2023-08-01T19:56:03.412 INFO:teuthology.orchestra.run.smithi008.stdout: "time": "2023-08-01T19:55:58.567443+0000", 2023-08-01T19:56:03.412 INFO:teuthology.orchestra.run.smithi008.stdout: "duration": 5.1739999999999999e-06 2023-08-01T19:56:03.413 INFO:teuthology.orchestra.run.smithi008.stdout: }, 2023-08-01T19:56:03.413 INFO:teuthology.orchestra.run.smithi008.stdout: { 2023-08-01T19:56:03.413 INFO:teuthology.orchestra.run.smithi008.stdout: "event": "reached_pg", 2023-08-01T19:56:03.413 INFO:teuthology.orchestra.run.smithi008.stdout: "time": "2023-08-01T19:55:59.619164+0000", 2023-08-01T19:56:03.414 INFO:teuthology.orchestra.run.smithi008.stdout: "duration": 1.0517206750000001 2023-08-01T19:56:03.414 INFO:teuthology.orchestra.run.smithi008.stdout: }, 2023-08-01T19:56:03.414 INFO:teuthology.orchestra.run.smithi008.stdout: { 2023-08-01T19:56:03.414 INFO:teuthology.orchestra.run.smithi008.stdout: "event": "done", 2023-08-01T19:56:03.415 INFO:teuthology.orchestra.run.smithi008.stdout: "time": "2023-08-01T19:55:59.619209+0000", 2023-08-01T19:56:03.415 INFO:teuthology.orchestra.run.smithi008.stdout: "duration": 4.5800000000000002e-05 2023-08-01T19:56:03.415 INFO:teuthology.orchestra.run.smithi008.stdout: } 2023-08-01T19:56:03.415 INFO:teuthology.orchestra.run.smithi008.stdout: ] 2023-08-01T19:56:03.416 INFO:teuthology.orchestra.run.smithi008.stdout: } 2023-08-01T19:56:03.416 INFO:teuthology.orchestra.run.smithi008.stdout: }, 2023-08-01T19:56:03.416 INFO:teuthology.orchestra.run.smithi008.stdout: { 2023-08-01T19:56:03.416 INFO:teuthology.orchestra.run.smithi008.stdout: "description": "osd_op(client.4668.0:197404 5.5 5:a3c9c1bd:::benchmark_data_smithi006_114134_object63743:head [delete] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e61)", 2023-08-01T19:56:03.417 INFO:teuthology.orchestra.run.smithi008.stdout: "initiated_at": "2023-08-01T19:55:58.556653+0000", 2023-08-01T19:56:03.417 INFO:teuthology.orchestra.run.smithi008.stdout: "age": 4.6789055240000001, 2023-08-01T19:56:03.417 INFO:teuthology.orchestra.run.smithi008.stdout: "duration": 1.061865576, 2023-08-01T19:56:03.418 INFO:teuthology.orchestra.run.smithi008.stdout: "type_data": { 2023-08-01T19:56:03.418 INFO:teuthology.orchestra.run.smithi008.stdout: "flag_point": "reached pg", 2023-08-01T19:56:03.418 INFO:teuthology.orchestra.run.smithi008.stdout: "client_info": { 2023-08-01T19:56:03.418 INFO:teuthology.orchestra.run.smithi008.stdout: "client": "client.4668", 2023-08-01T19:56:03.419 INFO:teuthology.orchestra.run.smithi008.stdout: "client_addr": "172.21.15.6:0/1709472247", 2023-08-01T19:56:03.419 INFO:teuthology.orchestra.run.smithi008.stdout: "tid": 197404 2023-08-01T19:56:03.419 INFO:teuthology.orchestra.run.smithi008.stdout: }, 2023-08-01T19:56:03.419 INFO:teuthology.orchestra.run.smithi008.stdout: "events": [ 2023-08-01T19:56:03.420 INFO:teuthology.orchestra.run.smithi008.stdout: { 2023-08-01T19:56:03.420 INFO:teuthology.orchestra.run.smithi008.stdout: "event": "initiated", 2023-08-01T19:56:03.420 INFO:teuthology.orchestra.run.smithi008.stdout: "time": "2023-08-01T19:55:58.556653+0000", 2023-08-01T19:56:03.420 INFO:teuthology.orchestra.run.smithi008.stdout: "duration": 0 2023-08-01T19:56:03.421 INFO:teuthology.orchestra.run.smithi008.stdout: }, 2023-08-01T19:56:03.421 INFO:teuthology.orchestra.run.smithi008.stdout: { 2023-08-01T19:56:03.421 INFO:teuthology.orchestra.run.smithi008.stdout: "event": "throttled", 2023-08-01T19:56:03.421 INFO:teuthology.orchestra.run.smithi008.stdout: "time": "2023-08-01T19:55:58.556653+0000", 2023-08-01T19:56:03.422 INFO:teuthology.orchestra.run.smithi008.stdout: "duration": 0 2023-08-01T19:56:03.422 INFO:teuthology.orchestra.run.smithi008.stdout: }, 2023-08-01T19:56:03.422 INFO:teuthology.orchestra.run.smithi008.stdout: { 2023-08-01T19:56:03.423 INFO:teuthology.orchestra.run.smithi008.stdout: "event": "header_read", 2023-08-01T19:56:03.423 INFO:teuthology.orchestra.run.smithi008.stdout: "time": "2023-08-01T19:55:58.556653+0000", 2023-08-01T19:56:03.423 INFO:teuthology.orchestra.run.smithi008.stdout: "duration": 4294967295.9999995 2023-08-01T19:56:03.423 INFO:teuthology.orchestra.run.smithi008.stdout: }, 2023-08-01T19:56:03.423 INFO:teuthology.orchestra.run.smithi008.stdout: { 2023-08-01T19:56:03.424 INFO:teuthology.orchestra.run.smithi008.stdout: "event": "all_read", 2023-08-01T19:56:03.424 INFO:teuthology.orchestra.run.smithi008.stdout: "time": "2023-08-01T19:55:58.556655+0000", 2023-08-01T19:56:03.424 INFO:teuthology.orchestra.run.smithi008.stdout: "duration": 2.435e-06 2023-08-01T19:56:03.424 INFO:teuthology.orchestra.run.smithi008.stdout: }, 2023-08-01T19:56:03.424 INFO:teuthology.orchestra.run.smithi008.stdout: { 2023-08-01T19:56:03.424 INFO:teuthology.orchestra.run.smithi008.stdout: "event": "dispatched", 2023-08-01T19:56:03.424 INFO:teuthology.orchestra.run.smithi008.stdout: "time": "2023-08-01T19:55:58.556661+0000", 2023-08-01T19:56:03.424 INFO:teuthology.orchestra.run.smithi008.stdout: "duration": 6.0599999999999996e-06 2023-08-01T19:56:03.425 INFO:teuthology.orchestra.run.smithi008.stdout: }, 2023-08-01T19:56:03.425 INFO:teuthology.orchestra.run.smithi008.stdout: { 2023-08-01T19:56:03.425 INFO:teuthology.orchestra.run.smithi008.stdout: "event": "queued_for_pg", 2023-08-01T19:56:03.425 INFO:teuthology.orchestra.run.smithi008.stdout: "time": "2023-08-01T19:55:58.556666+0000", 2023-08-01T19:56:03.425 INFO:teuthology.orchestra.run.smithi008.stdout: "duration": 4.9620000000000001e-06 2023-08-01T19:56:03.425 INFO:teuthology.orchestra.run.smithi008.stdout: }, 2023-08-01T19:56:03.425 INFO:teuthology.orchestra.run.smithi008.stdout: { 2023-08-01T19:56:03.426 INFO:teuthology.orchestra.run.smithi008.stdout: "event": "reached_pg", 2023-08-01T19:56:03.426 INFO:teuthology.orchestra.run.smithi008.stdout: "time": "2023-08-01T19:55:58.556698+0000", 2023-08-01T19:56:03.426 INFO:teuthology.orchestra.run.smithi008.stdout: "duration": 3.2302999999999999e-05 2023-08-01T19:56:03.426 INFO:teuthology.orchestra.run.smithi008.stdout: }, 2023-08-01T19:56:03.426 INFO:teuthology.orchestra.run.smithi008.stdout: { 2023-08-01T19:56:03.426 INFO:teuthology.orchestra.run.smithi008.stdout: "event": "started", 2023-08-01T19:56:03.426 INFO:teuthology.orchestra.run.smithi008.stdout: "time": "2023-08-01T19:55:58.556773+0000", 2023-08-01T19:56:03.426 INFO:teuthology.orchestra.run.smithi008.stdout: "duration": 7.4431999999999995e-05 2023-08-01T19:56:03.427 INFO:teuthology.orchestra.run.smithi008.stdout: }, 2023-08-01T19:56:03.427 INFO:teuthology.orchestra.run.smithi008.stdout: { 2023-08-01T19:56:03.427 INFO:teuthology.orchestra.run.smithi008.stdout: "event": "waiting for subops from 1", 2023-08-01T19:56:03.427 INFO:teuthology.orchestra.run.smithi008.stdout: "time": "2023-08-01T19:55:58.556837+0000", 2023-08-01T19:56:03.427 INFO:teuthology.orchestra.run.smithi008.stdout: "duration": 6.4522000000000003e-05 2023-08-01T19:56:03.427 INFO:teuthology.orchestra.run.smithi008.stdout: }, 2023-08-01T19:56:03.427 INFO:teuthology.orchestra.run.smithi008.stdout: { 2023-08-01T19:56:03.427 INFO:teuthology.orchestra.run.smithi008.stdout: "event": "reached_pg", 2023-08-01T19:56:03.428 INFO:teuthology.orchestra.run.smithi008.stdout: "time": "2023-08-01T19:55:58.563930+0000", 2023-08-01T19:56:03.428 INFO:teuthology.orchestra.run.smithi008.stdout: "duration": 0.0070929030000000002 2023-08-01T19:56:03.428 INFO:teuthology.orchestra.run.smithi008.stdout: }, 2023-08-01T19:56:03.428 INFO:teuthology.orchestra.run.smithi008.stdout: { 2023-08-01T19:56:03.428 INFO:teuthology.orchestra.run.smithi008.stdout: "event": "waiting for peered", 2023-08-01T19:56:03.428 INFO:teuthology.orchestra.run.smithi008.stdout: "time": "2023-08-01T19:55:58.563939+0000", 2023-08-01T19:56:03.428 INFO:teuthology.orchestra.run.smithi008.stdout: "duration": 8.6079999999999996e-06 2023-08-01T19:56:03.428 INFO:teuthology.orchestra.run.smithi008.stdout: }, 2023-08-01T19:56:03.429 INFO:teuthology.orchestra.run.smithi008.stdout: { 2023-08-01T19:56:03.429 INFO:teuthology.orchestra.run.smithi008.stdout: "event": "reached_pg", 2023-08-01T19:56:03.429 INFO:teuthology.orchestra.run.smithi008.stdout: "time": "2023-08-01T19:55:59.618422+0000", 2023-08-01T19:56:03.429 INFO:teuthology.orchestra.run.smithi008.stdout: "duration": 1.054483295 2023-08-01T19:56:03.429 INFO:teuthology.orchestra.run.smithi008.stdout: }, 2023-08-01T19:56:03.429 INFO:teuthology.orchestra.run.smithi008.stdout: { 2023-08-01T19:56:03.429 INFO:teuthology.orchestra.run.smithi008.stdout: "event": "done", 2023-08-01T19:56:03.430 INFO:teuthology.orchestra.run.smithi008.stdout: "time": "2023-08-01T19:55:59.618519+0000", 2023-08-01T19:56:03.430 INFO:teuthology.orchestra.run.smithi008.stdout: "duration": 9.6471000000000005e-05 2023-08-01T19:56:03.430 INFO:teuthology.orchestra.run.smithi008.stdout: } 2023-08-01T19:56:03.430 INFO:teuthology.orchestra.run.smithi008.stdout: ] 2023-08-01T19:56:03.430 INFO:teuthology.orchestra.run.smithi008.stdout: } 2023-08-01T19:56:03.430 INFO:teuthology.orchestra.run.smithi008.stdout: }, 2023-08-01T19:56:03.430 INFO:teuthology.orchestra.run.smithi008.stdout: { 2023-08-01T19:56:03.430 INFO:teuthology.orchestra.run.smithi008.stdout: "description": "osd_op(client.4668.0:197407 5.1 5:85528fae:::benchmark_data_smithi006_114134_object63746:head [delete] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e61)", 2023-08-01T19:56:03.431 INFO:teuthology.orchestra.run.smithi008.stdout: "initiated_at": "2023-08-01T19:55:58.559216+0000", 2023-08-01T19:56:03.431 INFO:teuthology.orchestra.run.smithi008.stdout: "age": 4.6763428759999996, 2023-08-01T19:56:03.431 INFO:teuthology.orchestra.run.smithi008.stdout: "duration": 1.061802277, 2023-08-01T19:56:03.431 INFO:teuthology.orchestra.run.smithi008.stdout: "type_data": { 2023-08-01T19:56:03.431 INFO:teuthology.orchestra.run.smithi008.stdout: "flag_point": "reached pg", 2023-08-01T19:56:03.431 INFO:teuthology.orchestra.run.smithi008.stdout: "client_info": { 2023-08-01T19:56:03.431 INFO:teuthology.orchestra.run.smithi008.stdout: "client": "client.4668", 2023-08-01T19:56:03.431 INFO:teuthology.orchestra.run.smithi008.stdout: "client_addr": "172.21.15.6:0/1709472247", 2023-08-01T19:56:03.432 INFO:teuthology.orchestra.run.smithi008.stdout: "tid": 197407 2023-08-01T19:56:03.432 INFO:teuthology.orchestra.run.smithi008.stdout: }, 2023-08-01T19:56:03.432 INFO:teuthology.orchestra.run.smithi008.stdout: "events": [ 2023-08-01T19:56:03.432 INFO:teuthology.orchestra.run.smithi008.stdout: { 2023-08-01T19:56:03.432 INFO:teuthology.orchestra.run.smithi008.stdout: "event": "initiated", 2023-08-01T19:56:03.432 INFO:teuthology.orchestra.run.smithi008.stdout: "time": "2023-08-01T19:55:58.559216+0000", 2023-08-01T19:56:03.432 INFO:teuthology.orchestra.run.smithi008.stdout: "duration": 0 2023-08-01T19:56:03.432 INFO:teuthology.orchestra.run.smithi008.stdout: }, 2023-08-01T19:56:03.433 INFO:teuthology.orchestra.run.smithi008.stdout: { 2023-08-01T19:56:03.433 INFO:teuthology.orchestra.run.smithi008.stdout: "event": "throttled", 2023-08-01T19:56:03.433 INFO:teuthology.orchestra.run.smithi008.stdout: "time": "2023-08-01T19:55:58.559216+0000", 2023-08-01T19:56:03.433 INFO:teuthology.orchestra.run.smithi008.stdout: "duration": 0 2023-08-01T19:56:03.433 INFO:teuthology.orchestra.run.smithi008.stdout: }, 2023-08-01T19:56:03.433 INFO:teuthology.orchestra.run.smithi008.stdout: { 2023-08-01T19:56:03.433 INFO:teuthology.orchestra.run.smithi008.stdout: "event": "header_read", 2023-08-01T19:56:03.434 INFO:teuthology.orchestra.run.smithi008.stdout: "time": "2023-08-01T19:55:58.559215+0000", 2023-08-01T19:56:03.434 INFO:teuthology.orchestra.run.smithi008.stdout: "duration": 4294967295.999999 2023-08-01T19:56:03.434 INFO:teuthology.orchestra.run.smithi008.stdout: }, 2023-08-01T19:56:03.434 INFO:teuthology.orchestra.run.smithi008.stdout: { 2023-08-01T19:56:03.434 INFO:teuthology.orchestra.run.smithi008.stdout: "event": "all_read", 2023-08-01T19:56:03.434 INFO:teuthology.orchestra.run.smithi008.stdout: "time": "2023-08-01T19:55:58.559220+0000", 2023-08-01T19:56:03.434 INFO:teuthology.orchestra.run.smithi008.stdout: "duration": 5.3879999999999999e-06 2023-08-01T19:56:03.434 INFO:teuthology.orchestra.run.smithi008.stdout: }, 2023-08-01T19:56:03.435 INFO:teuthology.orchestra.run.smithi008.stdout: { 2023-08-01T19:56:03.435 INFO:teuthology.orchestra.run.smithi008.stdout: "event": "dispatched", 2023-08-01T19:56:03.435 INFO:teuthology.orchestra.run.smithi008.stdout: "time": "2023-08-01T19:55:58.559230+0000", 2023-08-01T19:56:03.435 INFO:teuthology.orchestra.run.smithi008.stdout: "duration": 9.6590000000000002e-06 2023-08-01T19:56:03.435 INFO:teuthology.orchestra.run.smithi008.stdout: }, 2023-08-01T19:56:03.435 INFO:teuthology.orchestra.run.smithi008.stdout: { 2023-08-01T19:56:03.435 INFO:teuthology.orchestra.run.smithi008.stdout: "event": "queued_for_pg", 2023-08-01T19:56:03.435 INFO:teuthology.orchestra.run.smithi008.stdout: "time": "2023-08-01T19:55:58.559235+0000", 2023-08-01T19:56:03.436 INFO:teuthology.orchestra.run.smithi008.stdout: "duration": 5.575e-06 2023-08-01T19:56:03.436 INFO:teuthology.orchestra.run.smithi008.stdout: }, 2023-08-01T19:56:03.436 INFO:teuthology.orchestra.run.smithi008.stdout: { 2023-08-01T19:56:03.436 INFO:teuthology.orchestra.run.smithi008.stdout: "event": "reached_pg", 2023-08-01T19:56:03.436 INFO:teuthology.orchestra.run.smithi008.stdout: "time": "2023-08-01T19:55:58.559279+0000", 2023-08-01T19:56:03.436 INFO:teuthology.orchestra.run.smithi008.stdout: "duration": 4.3273999999999999e-05 2023-08-01T19:56:03.436 INFO:teuthology.orchestra.run.smithi008.stdout: }, 2023-08-01T19:56:03.436 INFO:teuthology.orchestra.run.smithi008.stdout: { 2023-08-01T19:56:03.437 INFO:teuthology.orchestra.run.smithi008.stdout: "event": "started", 2023-08-01T19:56:03.437 INFO:teuthology.orchestra.run.smithi008.stdout: "time": "2023-08-01T19:55:58.559403+0000", 2023-08-01T19:56:03.437 INFO:teuthology.orchestra.run.smithi008.stdout: "duration": 0.000124781 2023-08-01T19:56:03.437 INFO:teuthology.orchestra.run.smithi008.stdout: }, 2023-08-01T19:56:03.437 INFO:teuthology.orchestra.run.smithi008.stdout: { 2023-08-01T19:56:03.437 INFO:teuthology.orchestra.run.smithi008.stdout: "event": "waiting for subops from 1", 2023-08-01T19:56:03.437 INFO:teuthology.orchestra.run.smithi008.stdout: "time": "2023-08-01T19:55:58.559561+0000", 2023-08-01T19:56:03.437 INFO:teuthology.orchestra.run.smithi008.stdout: "duration": 0.000157773 2023-08-01T19:56:03.438 INFO:teuthology.orchestra.run.smithi008.stdout: }, 2023-08-01T19:56:03.438 INFO:teuthology.orchestra.run.smithi008.stdout: { 2023-08-01T19:56:03.438 INFO:teuthology.orchestra.run.smithi008.stdout: "event": "reached_pg", 2023-08-01T19:56:03.438 INFO:teuthology.orchestra.run.smithi008.stdout: "time": "2023-08-01T19:55:58.569498+0000", 2023-08-01T19:56:03.438 INFO:teuthology.orchestra.run.smithi008.stdout: "duration": 0.0099367069999999995 2023-08-01T19:56:03.438 INFO:teuthology.orchestra.run.smithi008.stdout: }, 2023-08-01T19:56:03.438 INFO:teuthology.orchestra.run.smithi008.stdout: { 2023-08-01T19:56:03.438 INFO:teuthology.orchestra.run.smithi008.stdout: "event": "waiting for peered", 2023-08-01T19:56:03.439 INFO:teuthology.orchestra.run.smithi008.stdout: "time": "2023-08-01T19:55:58.569756+0000", 2023-08-01T19:56:03.439 INFO:teuthology.orchestra.run.smithi008.stdout: "duration": 0.00025830800000000001 2023-08-01T19:56:03.439 INFO:teuthology.orchestra.run.smithi008.stdout: }, 2023-08-01T19:56:03.439 INFO:teuthology.orchestra.run.smithi008.stdout: { 2023-08-01T19:56:03.439 INFO:teuthology.orchestra.run.smithi008.stdout: "event": "reached_pg", 2023-08-01T19:56:03.439 INFO:teuthology.orchestra.run.smithi008.stdout: "time": "2023-08-01T19:55:59.620962+0000", 2023-08-01T19:56:03.439 INFO:teuthology.orchestra.run.smithi008.stdout: "duration": 1.0512062129999999 2023-08-01T19:56:03.440 INFO:teuthology.orchestra.run.smithi008.stdout: }, 2023-08-01T19:56:03.440 INFO:teuthology.orchestra.run.smithi008.stdout: { 2023-08-01T19:56:03.440 INFO:teuthology.orchestra.run.smithi008.stdout: "event": "done", 2023-08-01T19:56:03.440 INFO:teuthology.orchestra.run.smithi008.stdout: "time": "2023-08-01T19:55:59.621018+0000", 2023-08-01T19:56:03.440 INFO:teuthology.orchestra.run.smithi008.stdout: "duration": 5.5498999999999998e-05 2023-08-01T19:56:03.440 INFO:teuthology.orchestra.run.smithi008.stdout: } 2023-08-01T19:56:03.440 INFO:teuthology.orchestra.run.smithi008.stdout: ] 2023-08-01T19:56:03.440 INFO:teuthology.orchestra.run.smithi008.stdout: } 2023-08-01T19:56:03.441 INFO:teuthology.orchestra.run.smithi008.stdout: }, 2023-08-01T19:56:03.441 INFO:teuthology.orchestra.run.smithi008.stdout: { 2023-08-01T19:56:03.441 INFO:teuthology.orchestra.run.smithi008.stdout: "description": "osd_op(client.4668.0:197396 5.2 5:43f8487b:::benchmark_data_smithi006_114134_object63735:head [delete] snapc 0=[] RETRY=1 ondisk+retry+write+known_if_redirected+supports_pool_eio e62)", 2023-08-01T19:56:03.441 INFO:teuthology.orchestra.run.smithi008.stdout: "initiated_at": "2023-08-01T19:55:58.564585+0000", 2023-08-01T19:56:03.441 INFO:teuthology.orchestra.run.smithi008.stdout: "age": 4.6709739020000001, 2023-08-01T19:56:03.441 INFO:teuthology.orchestra.run.smithi008.stdout: "duration": 1.0535085049999999, 2023-08-01T19:56:03.441 INFO:teuthology.orchestra.run.smithi008.stdout: "type_data": { 2023-08-01T19:56:03.442 INFO:teuthology.orchestra.run.smithi008.stdout: "flag_point": "reached pg", 2023-08-01T19:56:03.442 INFO:teuthology.orchestra.run.smithi008.stdout: "client_info": { 2023-08-01T19:56:03.442 INFO:teuthology.orchestra.run.smithi008.stdout: "client": "client.4668", 2023-08-01T19:56:03.442 INFO:teuthology.orchestra.run.smithi008.stdout: "client_addr": "172.21.15.6:0/1709472247", 2023-08-01T19:56:03.442 INFO:teuthology.orchestra.run.smithi008.stdout: "tid": 197396 2023-08-01T19:56:03.442 INFO:teuthology.orchestra.run.smithi008.stdout: }, 2023-08-01T19:56:03.442 INFO:teuthology.orchestra.run.smithi008.stdout: "events": [ 2023-08-01T19:56:03.442 INFO:teuthology.orchestra.run.smithi008.stdout: { 2023-08-01T19:56:03.443 INFO:teuthology.orchestra.run.smithi008.stdout: "event": "initiated", 2023-08-01T19:56:03.443 INFO:teuthology.orchestra.run.smithi008.stdout: "time": "2023-08-01T19:55:58.564585+0000", 2023-08-01T19:56:03.443 INFO:teuthology.orchestra.run.smithi008.stdout: "duration": 0 2023-08-01T19:56:03.443 INFO:teuthology.orchestra.run.smithi008.stdout: }, 2023-08-01T19:56:03.443 INFO:teuthology.orchestra.run.smithi008.stdout: { 2023-08-01T19:56:03.443 INFO:teuthology.orchestra.run.smithi008.stdout: "event": "throttled", 2023-08-01T19:56:03.443 INFO:teuthology.orchestra.run.smithi008.stdout: "time": "2023-08-01T19:55:58.564585+0000", 2023-08-01T19:56:03.443 INFO:teuthology.orchestra.run.smithi008.stdout: "duration": 0 2023-08-01T19:56:03.444 INFO:teuthology.orchestra.run.smithi008.stdout: }, 2023-08-01T19:56:03.444 INFO:teuthology.orchestra.run.smithi008.stdout: { 2023-08-01T19:56:03.444 INFO:teuthology.orchestra.run.smithi008.stdout: "event": "header_read", 2023-08-01T19:56:03.444 INFO:teuthology.orchestra.run.smithi008.stdout: "time": "2023-08-01T19:55:58.564583+0000", 2023-08-01T19:56:03.444 INFO:teuthology.orchestra.run.smithi008.stdout: "duration": 4294967295.9999981 2023-08-01T19:56:03.444 INFO:teuthology.orchestra.run.smithi008.stdout: }, 2023-08-01T19:56:03.444 INFO:teuthology.orchestra.run.smithi008.stdout: { 2023-08-01T19:56:03.445 INFO:teuthology.orchestra.run.smithi008.stdout: "event": "all_read", 2023-08-01T19:56:03.445 INFO:teuthology.orchestra.run.smithi008.stdout: "time": "2023-08-01T19:55:58.564591+0000", 2023-08-01T19:56:03.445 INFO:teuthology.orchestra.run.smithi008.stdout: "duration": 8.2169999999999994e-06 2023-08-01T19:56:03.445 INFO:teuthology.orchestra.run.smithi008.stdout: }, 2023-08-01T19:56:03.445 INFO:teuthology.orchestra.run.smithi008.stdout: { 2023-08-01T19:56:03.445 INFO:teuthology.orchestra.run.smithi008.stdout: "event": "dispatched", 2023-08-01T19:56:03.445 INFO:teuthology.orchestra.run.smithi008.stdout: "time": "2023-08-01T19:55:58.564603+0000", 2023-08-01T19:56:03.445 INFO:teuthology.orchestra.run.smithi008.stdout: "duration": 1.186e-05 2023-08-01T19:56:03.446 INFO:teuthology.orchestra.run.smithi008.stdout: }, 2023-08-01T19:56:03.446 INFO:teuthology.orchestra.run.smithi008.stdout: { 2023-08-01T19:56:03.446 INFO:teuthology.orchestra.run.smithi008.stdout: "event": "queued_for_pg", 2023-08-01T19:56:03.446 INFO:teuthology.orchestra.run.smithi008.stdout: "time": "2023-08-01T19:55:58.564609+0000", 2023-08-01T19:56:03.446 INFO:teuthology.orchestra.run.smithi008.stdout: "duration": 6.4130000000000003e-06 2023-08-01T19:56:03.446 INFO:teuthology.orchestra.run.smithi008.stdout: }, 2023-08-01T19:56:03.446 INFO:teuthology.orchestra.run.smithi008.stdout: { 2023-08-01T19:56:03.446 INFO:teuthology.orchestra.run.smithi008.stdout: "event": "reached_pg", 2023-08-01T19:56:03.447 INFO:teuthology.orchestra.run.smithi008.stdout: "time": "2023-08-01T19:55:58.573439+0000", 2023-08-01T19:56:03.447 INFO:teuthology.orchestra.run.smithi008.stdout: "duration": 0.0088303310000000003 2023-08-01T19:56:03.447 INFO:teuthology.orchestra.run.smithi008.stdout: }, 2023-08-01T19:56:03.447 INFO:teuthology.orchestra.run.smithi008.stdout: { 2023-08-01T19:56:03.447 INFO:teuthology.orchestra.run.smithi008.stdout: "event": "waiting for peered", 2023-08-01T19:56:03.447 INFO:teuthology.orchestra.run.smithi008.stdout: "time": "2023-08-01T19:55:58.573448+0000", 2023-08-01T19:56:03.447 INFO:teuthology.orchestra.run.smithi008.stdout: "duration": 8.2910000000000007e-06 2023-08-01T19:56:03.447 INFO:teuthology.orchestra.run.smithi008.stdout: }, 2023-08-01T19:56:03.448 INFO:teuthology.orchestra.run.smithi008.stdout: { 2023-08-01T19:56:03.448 INFO:teuthology.orchestra.run.smithi008.stdout: "event": "reached_pg", 2023-08-01T19:56:03.448 INFO:teuthology.orchestra.run.smithi008.stdout: "time": "2023-08-01T19:55:59.617892+0000", 2023-08-01T19:56:03.448 INFO:teuthology.orchestra.run.smithi008.stdout: "duration": 1.0444446380000001 2023-08-01T19:56:03.448 INFO:teuthology.orchestra.run.smithi008.stdout: }, 2023-08-01T19:56:03.448 INFO:teuthology.orchestra.run.smithi008.stdout: { 2023-08-01T19:56:03.448 INFO:teuthology.orchestra.run.smithi008.stdout: "event": "done", 2023-08-01T19:56:03.448 INFO:teuthology.orchestra.run.smithi008.stdout: "time": "2023-08-01T19:55:59.618093+0000", 2023-08-01T19:56:03.449 INFO:teuthology.orchestra.run.smithi008.stdout: "duration": 0.00020066300000000001 2023-08-01T19:56:03.449 INFO:teuthology.orchestra.run.smithi008.stdout: } 2023-08-01T19:56:03.449 INFO:teuthology.orchestra.run.smithi008.stdout: ] 2023-08-01T19:56:03.449 INFO:teuthology.orchestra.run.smithi008.stdout: } 2023-08-01T19:56:03.449 INFO:teuthology.orchestra.run.smithi008.stdout: }, 2023-08-01T19:56:03.449 INFO:teuthology.orchestra.run.smithi008.stdout: { 2023-08-01T19:56:03.449 INFO:teuthology.orchestra.run.smithi008.stdout: "description": "osd_op(client.4668.0:197411 5.7 5:ebefbc20:::benchmark_data_smithi006_114134_object63750:head [delete] snapc 0=[] RETRY=1 ondisk+retry+write+known_if_redirected+supports_pool_eio e62)", 2023-08-01T19:56:03.449 INFO:teuthology.orchestra.run.smithi008.stdout: "initiated_at": "2023-08-01T19:55:58.564619+0000", 2023-08-01T19:56:03.450 INFO:teuthology.orchestra.run.smithi008.stdout: "age": 4.6709392269999999, 2023-08-01T19:56:03.450 INFO:teuthology.orchestra.run.smithi008.stdout: "duration": 1.0686062569999999, 2023-08-01T19:56:03.450 INFO:teuthology.orchestra.run.smithi008.stdout: "type_data": { 2023-08-01T19:56:03.450 INFO:teuthology.orchestra.run.smithi008.stdout: "flag_point": "commit sent; apply or cleanup", 2023-08-01T19:56:03.450 INFO:teuthology.orchestra.run.smithi008.stdout: "client_info": { 2023-08-01T19:56:03.450 INFO:teuthology.orchestra.run.smithi008.stdout: "client": "client.4668", 2023-08-01T19:56:03.450 INFO:teuthology.orchestra.run.smithi008.stdout: "client_addr": "172.21.15.6:0/1709472247", 2023-08-01T19:56:03.451 INFO:teuthology.orchestra.run.smithi008.stdout: "tid": 197411 2023-08-01T19:56:03.451 INFO:teuthology.orchestra.run.smithi008.stdout: }, 2023-08-01T19:56:03.451 INFO:teuthology.orchestra.run.smithi008.stdout: "events": [ 2023-08-01T19:56:03.451 INFO:teuthology.orchestra.run.smithi008.stdout: { 2023-08-01T19:56:03.451 INFO:teuthology.orchestra.run.smithi008.stdout: "event": "initiated", 2023-08-01T19:56:03.451 INFO:teuthology.orchestra.run.smithi008.stdout: "time": "2023-08-01T19:55:58.564619+0000", 2023-08-01T19:56:03.451 INFO:teuthology.orchestra.run.smithi008.stdout: "duration": 0 2023-08-01T19:56:03.451 INFO:teuthology.orchestra.run.smithi008.stdout: }, 2023-08-01T19:56:03.452 INFO:teuthology.orchestra.run.smithi008.stdout: { 2023-08-01T19:56:03.452 INFO:teuthology.orchestra.run.smithi008.stdout: "event": "throttled", 2023-08-01T19:56:03.452 INFO:teuthology.orchestra.run.smithi008.stdout: "time": "2023-08-01T19:55:58.564619+0000", 2023-08-01T19:56:03.452 INFO:teuthology.orchestra.run.smithi008.stdout: "duration": 0 2023-08-01T19:56:03.452 INFO:teuthology.orchestra.run.smithi008.stdout: }, 2023-08-01T19:56:03.452 INFO:teuthology.orchestra.run.smithi008.stdout: { 2023-08-01T19:56:03.452 INFO:teuthology.orchestra.run.smithi008.stdout: "event": "header_read", 2023-08-01T19:56:03.452 INFO:teuthology.orchestra.run.smithi008.stdout: "time": "2023-08-01T19:55:58.564619+0000", 2023-08-01T19:56:03.453 INFO:teuthology.orchestra.run.smithi008.stdout: "duration": 4294967295.9999995 2023-08-01T19:56:03.453 INFO:teuthology.orchestra.run.smithi008.stdout: }, 2023-08-01T19:56:03.453 INFO:teuthology.orchestra.run.smithi008.stdout: { 2023-08-01T19:56:03.453 INFO:teuthology.orchestra.run.smithi008.stdout: "event": "all_read", 2023-08-01T19:56:03.453 INFO:teuthology.orchestra.run.smithi008.stdout: "time": "2023-08-01T19:55:58.564621+0000", 2023-08-01T19:56:03.453 INFO:teuthology.orchestra.run.smithi008.stdout: "duration": 2.6139999999999999e-06 2023-08-01T19:56:03.453 INFO:teuthology.orchestra.run.smithi008.stdout: }, 2023-08-01T19:56:03.453 INFO:teuthology.orchestra.run.smithi008.stdout: { 2023-08-01T19:56:03.454 INFO:teuthology.orchestra.run.smithi008.stdout: "event": "dispatched", 2023-08-01T19:56:03.454 INFO:teuthology.orchestra.run.smithi008.stdout: "time": "2023-08-01T19:55:58.564627+0000", 2023-08-01T19:56:03.454 INFO:teuthology.orchestra.run.smithi008.stdout: "duration": 5.1150000000000002e-06 2023-08-01T19:56:03.454 INFO:teuthology.orchestra.run.smithi008.stdout: }, 2023-08-01T19:56:03.454 INFO:teuthology.orchestra.run.smithi008.stdout: { 2023-08-01T19:56:03.454 INFO:teuthology.orchestra.run.smithi008.stdout: "event": "queued_for_pg", 2023-08-01T19:56:03.454 INFO:teuthology.orchestra.run.smithi008.stdout: "time": "2023-08-01T19:55:58.564631+0000", 2023-08-01T19:56:03.454 INFO:teuthology.orchestra.run.smithi008.stdout: "duration": 4.702e-06 2023-08-01T19:56:03.455 INFO:teuthology.orchestra.run.smithi008.stdout: }, 2023-08-01T19:56:03.455 INFO:teuthology.orchestra.run.smithi008.stdout: { 2023-08-01T19:56:03.455 INFO:teuthology.orchestra.run.smithi008.stdout: "event": "reached_pg", 2023-08-01T19:56:03.455 INFO:teuthology.orchestra.run.smithi008.stdout: "time": "2023-08-01T19:55:58.565520+0000", 2023-08-01T19:56:03.455 INFO:teuthology.orchestra.run.smithi008.stdout: "duration": 0.00088893399999999997 2023-08-01T19:56:03.455 INFO:teuthology.orchestra.run.smithi008.stdout: }, 2023-08-01T19:56:03.455 INFO:teuthology.orchestra.run.smithi008.stdout: { 2023-08-01T19:56:03.455 INFO:teuthology.orchestra.run.smithi008.stdout: "event": "waiting for peered", 2023-08-01T19:56:03.456 INFO:teuthology.orchestra.run.smithi008.stdout: "time": "2023-08-01T19:55:58.565528+0000", 2023-08-01T19:56:03.456 INFO:teuthology.orchestra.run.smithi008.stdout: "duration": 7.5410000000000003e-06 2023-08-01T19:56:03.456 INFO:teuthology.orchestra.run.smithi008.stdout: }, 2023-08-01T19:56:03.456 INFO:teuthology.orchestra.run.smithi008.stdout: { 2023-08-01T19:56:03.456 INFO:teuthology.orchestra.run.smithi008.stdout: "event": "reached_pg", 2023-08-01T19:56:03.456 INFO:teuthology.orchestra.run.smithi008.stdout: "time": "2023-08-01T19:55:59.622374+0000", 2023-08-01T19:56:03.456 INFO:teuthology.orchestra.run.smithi008.stdout: "duration": 1.05684588 2023-08-01T19:56:03.457 INFO:teuthology.orchestra.run.smithi008.stdout: }, 2023-08-01T19:56:03.457 INFO:teuthology.orchestra.run.smithi008.stdout: { 2023-08-01T19:56:03.457 INFO:teuthology.orchestra.run.smithi008.stdout: "event": "started", 2023-08-01T19:56:03.457 INFO:teuthology.orchestra.run.smithi008.stdout: "time": "2023-08-01T19:55:59.624156+0000", 2023-08-01T19:56:03.457 INFO:teuthology.orchestra.run.smithi008.stdout: "duration": 0.0017826129999999999 2023-08-01T19:56:03.457 INFO:teuthology.orchestra.run.smithi008.stdout: }, 2023-08-01T19:56:03.457 INFO:teuthology.orchestra.run.smithi008.stdout: { 2023-08-01T19:56:03.457 INFO:teuthology.orchestra.run.smithi008.stdout: "event": "op_commit", 2023-08-01T19:56:03.458 INFO:teuthology.orchestra.run.smithi008.stdout: "time": "2023-08-01T19:55:59.633131+0000", 2023-08-01T19:56:03.458 INFO:teuthology.orchestra.run.smithi008.stdout: "duration": 0.0089745740000000008 2023-08-01T19:56:03.458 INFO:teuthology.orchestra.run.smithi008.stdout: }, 2023-08-01T19:56:03.458 INFO:teuthology.orchestra.run.smithi008.stdout: { 2023-08-01T19:56:03.458 INFO:teuthology.orchestra.run.smithi008.stdout: "event": "commit_sent", 2023-08-01T19:56:03.458 INFO:teuthology.orchestra.run.smithi008.stdout: "time": "2023-08-01T19:55:59.633173+0000", 2023-08-01T19:56:03.458 INFO:teuthology.orchestra.run.smithi008.stdout: "duration": 4.2645000000000003e-05 2023-08-01T19:56:03.458 INFO:teuthology.orchestra.run.smithi008.stdout: }, 2023-08-01T19:56:03.459 INFO:teuthology.orchestra.run.smithi008.stdout: { 2023-08-01T19:56:03.459 INFO:teuthology.orchestra.run.smithi008.stdout: "event": "done", 2023-08-01T19:56:03.459 INFO:teuthology.orchestra.run.smithi008.stdout: "time": "2023-08-01T19:55:59.633225+0000", 2023-08-01T19:56:03.459 INFO:teuthology.orchestra.run.smithi008.stdout: "duration": 5.2003999999999999e-05 2023-08-01T19:56:03.459 INFO:teuthology.orchestra.run.smithi008.stdout: } 2023-08-01T19:56:03.459 INFO:teuthology.orchestra.run.smithi008.stdout: ] 2023-08-01T19:56:03.459 INFO:teuthology.orchestra.run.smithi008.stdout: } 2023-08-01T19:56:03.459 INFO:teuthology.orchestra.run.smithi008.stdout: }, 2023-08-01T19:56:03.460 INFO:teuthology.orchestra.run.smithi008.stdout: { 2023-08-01T19:56:03.460 INFO:teuthology.orchestra.run.smithi008.stdout: "description": "osd_op(client.4668.0:197413 5.5 5:a6ff9d8a:::benchmark_data_smithi006_114134_object63752:head [delete] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e62)", 2023-08-01T19:56:03.460 INFO:teuthology.orchestra.run.smithi008.stdout: "initiated_at": "2023-08-01T19:55:58.573778+0000", 2023-08-01T19:56:03.460 INFO:teuthology.orchestra.run.smithi008.stdout: "age": 4.6617802609999996, 2023-08-01T19:56:03.460 INFO:teuthology.orchestra.run.smithi008.stdout: "duration": 1.054781371, 2023-08-01T19:56:03.460 INFO:teuthology.orchestra.run.smithi008.stdout: "type_data": { 2023-08-01T19:56:03.460 INFO:teuthology.orchestra.run.smithi008.stdout: "flag_point": "commit sent; apply or cleanup", 2023-08-01T19:56:03.461 INFO:teuthology.orchestra.run.smithi008.stdout: "client_info": { 2023-08-01T19:56:03.461 INFO:teuthology.orchestra.run.smithi008.stdout: "client": "client.4668", 2023-08-01T19:56:03.461 INFO:teuthology.orchestra.run.smithi008.stdout: "client_addr": "172.21.15.6:0/1709472247", 2023-08-01T19:56:03.461 INFO:teuthology.orchestra.run.smithi008.stdout: "tid": 197413 2023-08-01T19:56:03.461 INFO:teuthology.orchestra.run.smithi008.stdout: }, 2023-08-01T19:56:03.461 INFO:teuthology.orchestra.run.smithi008.stdout: "events": [ 2023-08-01T19:56:03.461 INFO:teuthology.orchestra.run.smithi008.stdout: { 2023-08-01T19:56:03.461 INFO:teuthology.orchestra.run.smithi008.stdout: "event": "initiated", 2023-08-01T19:56:03.462 INFO:teuthology.orchestra.run.smithi008.stdout: "time": "2023-08-01T19:55:58.573778+0000", 2023-08-01T19:56:03.462 INFO:teuthology.orchestra.run.smithi008.stdout: "duration": 0 2023-08-01T19:56:03.462 INFO:teuthology.orchestra.run.smithi008.stdout: }, 2023-08-01T19:56:03.462 INFO:teuthology.orchestra.run.smithi008.stdout: { 2023-08-01T19:56:03.462 INFO:teuthology.orchestra.run.smithi008.stdout: "event": "throttled", 2023-08-01T19:56:03.462 INFO:teuthology.orchestra.run.smithi008.stdout: "time": "2023-08-01T19:55:58.573778+0000", 2023-08-01T19:56:03.462 INFO:teuthology.orchestra.run.smithi008.stdout: "duration": 0 2023-08-01T19:56:03.462 INFO:teuthology.orchestra.run.smithi008.stdout: }, 2023-08-01T19:56:03.463 INFO:teuthology.orchestra.run.smithi008.stdout: { 2023-08-01T19:56:03.463 INFO:teuthology.orchestra.run.smithi008.stdout: "event": "header_read", 2023-08-01T19:56:03.463 INFO:teuthology.orchestra.run.smithi008.stdout: "time": "2023-08-01T19:55:58.573776+0000", 2023-08-01T19:56:03.463 INFO:teuthology.orchestra.run.smithi008.stdout: "duration": 4294967295.9999981 2023-08-01T19:56:03.463 INFO:teuthology.orchestra.run.smithi008.stdout: }, 2023-08-01T19:56:03.463 INFO:teuthology.orchestra.run.smithi008.stdout: { 2023-08-01T19:56:03.463 INFO:teuthology.orchestra.run.smithi008.stdout: "event": "all_read", 2023-08-01T19:56:03.463 INFO:teuthology.orchestra.run.smithi008.stdout: "time": "2023-08-01T19:55:58.573784+0000", 2023-08-01T19:56:03.464 INFO:teuthology.orchestra.run.smithi008.stdout: "duration": 8.2490000000000001e-06 2023-08-01T19:56:03.464 INFO:teuthology.orchestra.run.smithi008.stdout: }, 2023-08-01T19:56:03.464 INFO:teuthology.orchestra.run.smithi008.stdout: { 2023-08-01T19:56:03.464 INFO:teuthology.orchestra.run.smithi008.stdout: "event": "dispatched", 2023-08-01T19:56:03.464 INFO:teuthology.orchestra.run.smithi008.stdout: "time": "2023-08-01T19:55:58.574230+0000", 2023-08-01T19:56:03.464 INFO:teuthology.orchestra.run.smithi008.stdout: "duration": 0.00044558400000000001 2023-08-01T19:56:03.464 INFO:teuthology.orchestra.run.smithi008.stdout: }, 2023-08-01T19:56:03.465 INFO:teuthology.orchestra.run.smithi008.stdout: { 2023-08-01T19:56:03.465 INFO:teuthology.orchestra.run.smithi008.stdout: "event": "queued_for_pg", 2023-08-01T19:56:03.465 INFO:teuthology.orchestra.run.smithi008.stdout: "time": "2023-08-01T19:55:58.574240+0000", 2023-08-01T19:56:03.465 INFO:teuthology.orchestra.run.smithi008.stdout: "duration": 9.7699999999999996e-06 2023-08-01T19:56:03.465 INFO:teuthology.orchestra.run.smithi008.stdout: }, 2023-08-01T19:56:03.465 INFO:teuthology.orchestra.run.smithi008.stdout: { 2023-08-01T19:56:03.465 INFO:teuthology.orchestra.run.smithi008.stdout: "event": "reached_pg", 2023-08-01T19:56:03.465 INFO:teuthology.orchestra.run.smithi008.stdout: "time": "2023-08-01T19:55:58.574292+0000", 2023-08-01T19:56:03.466 INFO:teuthology.orchestra.run.smithi008.stdout: "duration": 5.2101000000000001e-05 2023-08-01T19:56:03.466 INFO:teuthology.orchestra.run.smithi008.stdout: }, 2023-08-01T19:56:03.466 INFO:teuthology.orchestra.run.smithi008.stdout: { 2023-08-01T19:56:03.466 INFO:teuthology.orchestra.run.smithi008.stdout: "event": "waiting for peered", 2023-08-01T19:56:03.466 INFO:teuthology.orchestra.run.smithi008.stdout: "time": "2023-08-01T19:55:58.574299+0000", 2023-08-01T19:56:03.466 INFO:teuthology.orchestra.run.smithi008.stdout: "duration": 7.3420000000000002e-06 2023-08-01T19:56:03.466 INFO:teuthology.orchestra.run.smithi008.stdout: }, 2023-08-01T19:56:03.466 INFO:teuthology.orchestra.run.smithi008.stdout: { 2023-08-01T19:56:03.467 INFO:teuthology.orchestra.run.smithi008.stdout: "event": "reached_pg", 2023-08-01T19:56:03.467 INFO:teuthology.orchestra.run.smithi008.stdout: "time": "2023-08-01T19:55:59.618545+0000", 2023-08-01T19:56:03.467 INFO:teuthology.orchestra.run.smithi008.stdout: "duration": 1.044245922 2023-08-01T19:56:03.467 INFO:teuthology.orchestra.run.smithi008.stdout: }, 2023-08-01T19:56:03.467 INFO:teuthology.orchestra.run.smithi008.stdout: { 2023-08-01T19:56:03.467 INFO:teuthology.orchestra.run.smithi008.stdout: "event": "started", 2023-08-01T19:56:03.467 INFO:teuthology.orchestra.run.smithi008.stdout: "time": "2023-08-01T19:55:59.618855+0000", 2023-08-01T19:56:03.467 INFO:teuthology.orchestra.run.smithi008.stdout: "duration": 0.00030964099999999999 2023-08-01T19:56:03.468 INFO:teuthology.orchestra.run.smithi008.stdout: }, 2023-08-01T19:56:03.468 INFO:teuthology.orchestra.run.smithi008.stdout: { 2023-08-01T19:56:03.468 INFO:teuthology.orchestra.run.smithi008.stdout: "event": "op_commit", 2023-08-01T19:56:03.468 INFO:teuthology.orchestra.run.smithi008.stdout: "time": "2023-08-01T19:55:59.628438+0000", 2023-08-01T19:56:03.468 INFO:teuthology.orchestra.run.smithi008.stdout: "duration": 0.0095832939999999991 2023-08-01T19:56:03.468 INFO:teuthology.orchestra.run.smithi008.stdout: }, 2023-08-01T19:56:03.468 INFO:teuthology.orchestra.run.smithi008.stdout: { 2023-08-01T19:56:03.469 INFO:teuthology.orchestra.run.smithi008.stdout: "event": "commit_sent", 2023-08-01T19:56:03.469 INFO:teuthology.orchestra.run.smithi008.stdout: "time": "2023-08-01T19:55:59.628479+0000", 2023-08-01T19:56:03.469 INFO:teuthology.orchestra.run.smithi008.stdout: "duration": 4.1350000000000002e-05 2023-08-01T19:56:03.469 INFO:teuthology.orchestra.run.smithi008.stdout: }, 2023-08-01T19:56:03.469 INFO:teuthology.orchestra.run.smithi008.stdout: { 2023-08-01T19:56:03.469 INFO:teuthology.orchestra.run.smithi008.stdout: "event": "done", 2023-08-01T19:56:03.469 INFO:teuthology.orchestra.run.smithi008.stdout: "time": "2023-08-01T19:55:59.628560+0000", 2023-08-01T19:56:03.469 INFO:teuthology.orchestra.run.smithi008.stdout: "duration": 8.0080999999999994e-05 2023-08-01T19:56:03.470 INFO:teuthology.orchestra.run.smithi008.stdout: } 2023-08-01T19:56:03.470 INFO:teuthology.orchestra.run.smithi008.stdout: ] 2023-08-01T19:56:03.470 INFO:teuthology.orchestra.run.smithi008.stdout: } 2023-08-01T19:56:03.470 INFO:teuthology.orchestra.run.smithi008.stdout: }, 2023-08-01T19:56:03.470 INFO:teuthology.orchestra.run.smithi008.stdout: { 2023-08-01T19:56:03.470 INFO:teuthology.orchestra.run.smithi008.stdout: "description": "osd_op(client.4668.0:197415 5.c 5:3e539c01:::benchmark_data_smithi006_114134_object63754:head [delete] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e62)", 2023-08-01T19:56:03.470 INFO:teuthology.orchestra.run.smithi008.stdout: "initiated_at": "2023-08-01T19:55:58.577434+0000", 2023-08-01T19:56:03.470 INFO:teuthology.orchestra.run.smithi008.stdout: "age": 4.6581245039999999, 2023-08-01T19:56:03.471 INFO:teuthology.orchestra.run.smithi008.stdout: "duration": 1.0520807059999999, 2023-08-01T19:56:03.471 INFO:teuthology.orchestra.run.smithi008.stdout: "type_data": { 2023-08-01T19:56:03.471 INFO:teuthology.orchestra.run.smithi008.stdout: "flag_point": "commit sent; apply or cleanup", 2023-08-01T19:56:03.471 INFO:teuthology.orchestra.run.smithi008.stdout: "client_info": { 2023-08-01T19:56:03.471 INFO:teuthology.orchestra.run.smithi008.stdout: "client": "client.4668", 2023-08-01T19:56:03.471 INFO:teuthology.orchestra.run.smithi008.stdout: "client_addr": "172.21.15.6:0/1709472247", 2023-08-01T19:56:03.471 INFO:teuthology.orchestra.run.smithi008.stdout: "tid": 197415 2023-08-01T19:56:03.471 INFO:teuthology.orchestra.run.smithi008.stdout: }, 2023-08-01T19:56:03.472 INFO:teuthology.orchestra.run.smithi008.stdout: "events": [ 2023-08-01T19:56:03.472 INFO:teuthology.orchestra.run.smithi008.stdout: { 2023-08-01T19:56:03.472 INFO:teuthology.orchestra.run.smithi008.stdout: "event": "initiated", 2023-08-01T19:56:03.472 INFO:teuthology.orchestra.run.smithi008.stdout: "time": "2023-08-01T19:55:58.577434+0000", 2023-08-01T19:56:03.472 INFO:teuthology.orchestra.run.smithi008.stdout: "duration": 0 2023-08-01T19:56:03.472 INFO:teuthology.orchestra.run.smithi008.stdout: }, 2023-08-01T19:56:03.472 INFO:teuthology.orchestra.run.smithi008.stdout: { 2023-08-01T19:56:03.473 INFO:teuthology.orchestra.run.smithi008.stdout: "event": "throttled", 2023-08-01T19:56:03.473 INFO:teuthology.orchestra.run.smithi008.stdout: "time": "2023-08-01T19:55:58.577434+0000", 2023-08-01T19:56:03.473 INFO:teuthology.orchestra.run.smithi008.stdout: "duration": 0 2023-08-01T19:56:03.473 INFO:teuthology.orchestra.run.smithi008.stdout: }, 2023-08-01T19:56:03.473 INFO:teuthology.orchestra.run.smithi008.stdout: { 2023-08-01T19:56:03.473 INFO:teuthology.orchestra.run.smithi008.stdout: "event": "header_read", 2023-08-01T19:56:03.473 INFO:teuthology.orchestra.run.smithi008.stdout: "time": "2023-08-01T19:55:58.577432+0000", 2023-08-01T19:56:03.473 INFO:teuthology.orchestra.run.smithi008.stdout: "duration": 4294967295.9999986 2023-08-01T19:56:03.474 INFO:teuthology.orchestra.run.smithi008.stdout: }, 2023-08-01T19:56:03.474 INFO:teuthology.orchestra.run.smithi008.stdout: { 2023-08-01T19:56:03.474 INFO:teuthology.orchestra.run.smithi008.stdout: "event": "all_read", 2023-08-01T19:56:03.474 INFO:teuthology.orchestra.run.smithi008.stdout: "time": "2023-08-01T19:55:58.577440+0000", 2023-08-01T19:56:03.474 INFO:teuthology.orchestra.run.smithi008.stdout: "duration": 7.5480000000000004e-06 2023-08-01T19:56:03.474 INFO:teuthology.orchestra.run.smithi008.stdout: }, 2023-08-01T19:56:03.474 INFO:teuthology.orchestra.run.smithi008.stdout: { 2023-08-01T19:56:03.474 INFO:teuthology.orchestra.run.smithi008.stdout: "event": "dispatched", 2023-08-01T19:56:03.475 INFO:teuthology.orchestra.run.smithi008.stdout: "time": "2023-08-01T19:55:58.577454+0000", 2023-08-01T19:56:03.475 INFO:teuthology.orchestra.run.smithi008.stdout: "duration": 1.4216000000000001e-05 2023-08-01T19:56:03.475 INFO:teuthology.orchestra.run.smithi008.stdout: }, 2023-08-01T19:56:03.475 INFO:teuthology.orchestra.run.smithi008.stdout: { 2023-08-01T19:56:03.475 INFO:teuthology.orchestra.run.smithi008.stdout: "event": "queued_for_pg", 2023-08-01T19:56:03.475 INFO:teuthology.orchestra.run.smithi008.stdout: "time": "2023-08-01T19:55:58.577463+0000", 2023-08-01T19:56:03.475 INFO:teuthology.orchestra.run.smithi008.stdout: "duration": 8.2900000000000002e-06 2023-08-01T19:56:03.475 INFO:teuthology.orchestra.run.smithi008.stdout: }, 2023-08-01T19:56:03.476 INFO:teuthology.orchestra.run.smithi008.stdout: { 2023-08-01T19:56:03.476 INFO:teuthology.orchestra.run.smithi008.stdout: "event": "reached_pg", 2023-08-01T19:56:03.476 INFO:teuthology.orchestra.run.smithi008.stdout: "time": "2023-08-01T19:55:58.577498+0000", 2023-08-01T19:56:03.476 INFO:teuthology.orchestra.run.smithi008.stdout: "duration": 3.5302000000000002e-05 2023-08-01T19:56:03.476 INFO:teuthology.orchestra.run.smithi008.stdout: }, 2023-08-01T19:56:03.476 INFO:teuthology.orchestra.run.smithi008.stdout: { 2023-08-01T19:56:03.476 INFO:teuthology.orchestra.run.smithi008.stdout: "event": "waiting for peered", 2023-08-01T19:56:03.477 INFO:teuthology.orchestra.run.smithi008.stdout: "time": "2023-08-01T19:55:58.577503+0000", 2023-08-01T19:56:03.477 INFO:teuthology.orchestra.run.smithi008.stdout: "duration": 4.8409999999999999e-06 2023-08-01T19:56:03.477 INFO:teuthology.orchestra.run.smithi008.stdout: }, 2023-08-01T19:56:03.477 INFO:teuthology.orchestra.run.smithi008.stdout: { 2023-08-01T19:56:03.477 INFO:teuthology.orchestra.run.smithi008.stdout: "event": "reached_pg", 2023-08-01T19:56:03.477 INFO:teuthology.orchestra.run.smithi008.stdout: "time": "2023-08-01T19:55:59.619229+0000", 2023-08-01T19:56:03.477 INFO:teuthology.orchestra.run.smithi008.stdout: "duration": 1.041726119 2023-08-01T19:56:03.477 INFO:teuthology.orchestra.run.smithi008.stdout: }, 2023-08-01T19:56:03.478 INFO:teuthology.orchestra.run.smithi008.stdout: { 2023-08-01T19:56:03.478 INFO:teuthology.orchestra.run.smithi008.stdout: "event": "started", 2023-08-01T19:56:03.478 INFO:teuthology.orchestra.run.smithi008.stdout: "time": "2023-08-01T19:55:59.619326+0000", 2023-08-01T19:56:03.478 INFO:teuthology.orchestra.run.smithi008.stdout: "duration": 9.7044000000000001e-05 2023-08-01T19:56:03.478 INFO:teuthology.orchestra.run.smithi008.stdout: }, 2023-08-01T19:56:03.478 INFO:teuthology.orchestra.run.smithi008.stdout: { 2023-08-01T19:56:03.478 INFO:teuthology.orchestra.run.smithi008.stdout: "event": "op_commit", 2023-08-01T19:56:03.478 INFO:teuthology.orchestra.run.smithi008.stdout: "time": "2023-08-01T19:55:59.629399+0000", 2023-08-01T19:56:03.479 INFO:teuthology.orchestra.run.smithi008.stdout: "duration": 0.010073014 2023-08-01T19:56:03.479 INFO:teuthology.orchestra.run.smithi008.stdout: }, 2023-08-01T19:56:03.479 INFO:teuthology.orchestra.run.smithi008.stdout: { 2023-08-01T19:56:03.479 INFO:teuthology.orchestra.run.smithi008.stdout: "event": "commit_sent", 2023-08-01T19:56:03.479 INFO:teuthology.orchestra.run.smithi008.stdout: "time": "2023-08-01T19:55:59.629443+0000", 2023-08-01T19:56:03.479 INFO:teuthology.orchestra.run.smithi008.stdout: "duration": 4.3739999999999998e-05 2023-08-01T19:56:03.479 INFO:teuthology.orchestra.run.smithi008.stdout: }, 2023-08-01T19:56:03.479 INFO:teuthology.orchestra.run.smithi008.stdout: { 2023-08-01T19:56:03.480 INFO:teuthology.orchestra.run.smithi008.stdout: "event": "done", 2023-08-01T19:56:03.480 INFO:teuthology.orchestra.run.smithi008.stdout: "time": "2023-08-01T19:55:59.629515+0000", 2023-08-01T19:56:03.480 INFO:teuthology.orchestra.run.smithi008.stdout: "duration": 7.2089999999999996e-05 2023-08-01T19:56:03.480 INFO:teuthology.orchestra.run.smithi008.stdout: } 2023-08-01T19:56:03.480 INFO:teuthology.orchestra.run.smithi008.stdout: ] 2023-08-01T19:56:03.480 INFO:teuthology.orchestra.run.smithi008.stdout: } 2023-08-01T19:56:03.480 INFO:teuthology.orchestra.run.smithi008.stdout: }, 2023-08-01T19:56:03.481 INFO:teuthology.orchestra.run.smithi008.stdout: { 2023-08-01T19:56:03.481 INFO:teuthology.orchestra.run.smithi008.stdout: "description": "osd_op(client.4668.0:197417 5.7 5:eb36cb7d:::benchmark_data_smithi006_114134_object63756:head [delete] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e62)", 2023-08-01T19:56:03.481 INFO:teuthology.orchestra.run.smithi008.stdout: "initiated_at": "2023-08-01T19:55:58.578162+0000", 2023-08-01T19:56:03.481 INFO:teuthology.orchestra.run.smithi008.stdout: "age": 4.6573962069999997, 2023-08-01T19:56:03.481 INFO:teuthology.orchestra.run.smithi008.stdout: "duration": 1.0582469299999999, 2023-08-01T19:56:03.481 INFO:teuthology.orchestra.run.smithi008.stdout: "type_data": { 2023-08-01T19:56:03.481 INFO:teuthology.orchestra.run.smithi008.stdout: "flag_point": "commit sent; apply or cleanup", 2023-08-01T19:56:03.481 INFO:teuthology.orchestra.run.smithi008.stdout: "client_info": { 2023-08-01T19:56:03.482 INFO:teuthology.orchestra.run.smithi008.stdout: "client": "client.4668", 2023-08-01T19:56:03.482 INFO:teuthology.orchestra.run.smithi008.stdout: "client_addr": "172.21.15.6:0/1709472247", 2023-08-01T19:56:03.482 INFO:teuthology.orchestra.run.smithi008.stdout: "tid": 197417 2023-08-01T19:56:03.482 INFO:teuthology.orchestra.run.smithi008.stdout: }, 2023-08-01T19:56:03.482 INFO:teuthology.orchestra.run.smithi008.stdout: "events": [ 2023-08-01T19:56:03.482 INFO:teuthology.orchestra.run.smithi008.stdout: { 2023-08-01T19:56:03.482 INFO:teuthology.orchestra.run.smithi008.stdout: "event": "initiated", 2023-08-01T19:56:03.482 INFO:teuthology.orchestra.run.smithi008.stdout: "time": "2023-08-01T19:55:58.578162+0000", 2023-08-01T19:56:03.483 INFO:teuthology.orchestra.run.smithi008.stdout: "duration": 0 2023-08-01T19:56:03.483 INFO:teuthology.orchestra.run.smithi008.stdout: }, 2023-08-01T19:56:03.483 INFO:teuthology.orchestra.run.smithi008.stdout: { 2023-08-01T19:56:03.483 INFO:teuthology.orchestra.run.smithi008.stdout: "event": "throttled", 2023-08-01T19:56:03.483 INFO:teuthology.orchestra.run.smithi008.stdout: "time": "2023-08-01T19:55:58.578162+0000", 2023-08-01T19:56:03.483 INFO:teuthology.orchestra.run.smithi008.stdout: "duration": 0 2023-08-01T19:56:03.483 INFO:teuthology.orchestra.run.smithi008.stdout: }, 2023-08-01T19:56:03.483 INFO:teuthology.orchestra.run.smithi008.stdout: { 2023-08-01T19:56:03.484 INFO:teuthology.orchestra.run.smithi008.stdout: "event": "header_read", 2023-08-01T19:56:03.484 INFO:teuthology.orchestra.run.smithi008.stdout: "time": "2023-08-01T19:55:58.578161+0000", 2023-08-01T19:56:03.484 INFO:teuthology.orchestra.run.smithi008.stdout: "duration": 4294967295.999999 2023-08-01T19:56:03.484 INFO:teuthology.orchestra.run.smithi008.stdout: }, 2023-08-01T19:56:03.484 INFO:teuthology.orchestra.run.smithi008.stdout: { 2023-08-01T19:56:03.484 INFO:teuthology.orchestra.run.smithi008.stdout: "event": "all_read", 2023-08-01T19:56:03.484 INFO:teuthology.orchestra.run.smithi008.stdout: "time": "2023-08-01T19:55:58.578166+0000", 2023-08-01T19:56:03.485 INFO:teuthology.orchestra.run.smithi008.stdout: "duration": 4.6589999999999998e-06 2023-08-01T19:56:03.485 INFO:teuthology.orchestra.run.smithi008.stdout: }, 2023-08-01T19:56:03.485 INFO:teuthology.orchestra.run.smithi008.stdout: { 2023-08-01T19:56:03.485 INFO:teuthology.orchestra.run.smithi008.stdout: "event": "dispatched", 2023-08-01T19:56:03.485 INFO:teuthology.orchestra.run.smithi008.stdout: "time": "2023-08-01T19:55:58.578177+0000", 2023-08-01T19:56:03.485 INFO:teuthology.orchestra.run.smithi008.stdout: "duration": 1.0512e-05 2023-08-01T19:56:03.485 INFO:teuthology.orchestra.run.smithi008.stdout: }, 2023-08-01T19:56:03.485 INFO:teuthology.orchestra.run.smithi008.stdout: { 2023-08-01T19:56:03.486 INFO:teuthology.orchestra.run.smithi008.stdout: "event": "queued_for_pg", 2023-08-01T19:56:03.486 INFO:teuthology.orchestra.run.smithi008.stdout: "time": "2023-08-01T19:55:58.578182+0000", 2023-08-01T19:56:03.486 INFO:teuthology.orchestra.run.smithi008.stdout: "duration": 5.6540000000000004e-06 2023-08-01T19:56:03.486 INFO:teuthology.orchestra.run.smithi008.stdout: }, 2023-08-01T19:56:03.486 INFO:teuthology.orchestra.run.smithi008.stdout: { 2023-08-01T19:56:03.486 INFO:teuthology.orchestra.run.smithi008.stdout: "event": "reached_pg", 2023-08-01T19:56:03.486 INFO:teuthology.orchestra.run.smithi008.stdout: "time": "2023-08-01T19:55:58.578221+0000", 2023-08-01T19:56:03.486 INFO:teuthology.orchestra.run.smithi008.stdout: "duration": 3.8764999999999999e-05 2023-08-01T19:56:03.487 INFO:teuthology.orchestra.run.smithi008.stdout: }, 2023-08-01T19:56:03.487 INFO:teuthology.orchestra.run.smithi008.stdout: { 2023-08-01T19:56:03.487 INFO:teuthology.orchestra.run.smithi008.stdout: "event": "waiting for peered", 2023-08-01T19:56:03.487 INFO:teuthology.orchestra.run.smithi008.stdout: "time": "2023-08-01T19:55:58.578226+0000", 2023-08-01T19:56:03.487 INFO:teuthology.orchestra.run.smithi008.stdout: "duration": 4.6319999999999999e-06 2023-08-01T19:56:03.487 INFO:teuthology.orchestra.run.smithi008.stdout: }, 2023-08-01T19:56:03.487 INFO:teuthology.orchestra.run.smithi008.stdout: { 2023-08-01T19:56:03.487 INFO:teuthology.orchestra.run.smithi008.stdout: "event": "reached_pg", 2023-08-01T19:56:03.488 INFO:teuthology.orchestra.run.smithi008.stdout: "time": "2023-08-01T19:55:59.628027+0000", 2023-08-01T19:56:03.488 INFO:teuthology.orchestra.run.smithi008.stdout: "duration": 1.049801261 2023-08-01T19:56:03.488 INFO:teuthology.orchestra.run.smithi008.stdout: }, 2023-08-01T19:56:03.488 INFO:teuthology.orchestra.run.smithi008.stdout: { 2023-08-01T19:56:03.488 INFO:teuthology.orchestra.run.smithi008.stdout: "event": "started", 2023-08-01T19:56:03.488 INFO:teuthology.orchestra.run.smithi008.stdout: "time": "2023-08-01T19:55:59.628156+0000", 2023-08-01T19:56:03.488 INFO:teuthology.orchestra.run.smithi008.stdout: "duration": 0.00012906899999999999 2023-08-01T19:56:03.488 INFO:teuthology.orchestra.run.smithi008.stdout: }, 2023-08-01T19:56:03.489 INFO:teuthology.orchestra.run.smithi008.stdout: { 2023-08-01T19:56:03.489 INFO:teuthology.orchestra.run.smithi008.stdout: "event": "op_commit", 2023-08-01T19:56:03.489 INFO:teuthology.orchestra.run.smithi008.stdout: "time": "2023-08-01T19:55:59.636292+0000", 2023-08-01T19:56:03.489 INFO:teuthology.orchestra.run.smithi008.stdout: "duration": 0.0081362859999999995 2023-08-01T19:56:03.489 INFO:teuthology.orchestra.run.smithi008.stdout: }, 2023-08-01T19:56:03.489 INFO:teuthology.orchestra.run.smithi008.stdout: { 2023-08-01T19:56:03.489 INFO:teuthology.orchestra.run.smithi008.stdout: "event": "commit_sent", 2023-08-01T19:56:03.490 INFO:teuthology.orchestra.run.smithi008.stdout: "time": "2023-08-01T19:55:59.636343+0000", 2023-08-01T19:56:03.490 INFO:teuthology.orchestra.run.smithi008.stdout: "duration": 5.0603000000000003e-05 2023-08-01T19:56:03.490 INFO:teuthology.orchestra.run.smithi008.stdout: }, 2023-08-01T19:56:03.490 INFO:teuthology.orchestra.run.smithi008.stdout: { 2023-08-01T19:56:03.490 INFO:teuthology.orchestra.run.smithi008.stdout: "event": "done", 2023-08-01T19:56:03.490 INFO:teuthology.orchestra.run.smithi008.stdout: "time": "2023-08-01T19:55:59.636409+0000", 2023-08-01T19:56:03.490 INFO:teuthology.orchestra.run.smithi008.stdout: "duration": 6.6353999999999995e-05 2023-08-01T19:56:03.490 INFO:teuthology.orchestra.run.smithi008.stdout: } 2023-08-01T19:56:03.491 INFO:teuthology.orchestra.run.smithi008.stdout: ] 2023-08-01T19:56:03.491 INFO:teuthology.orchestra.run.smithi008.stdout: } 2023-08-01T19:56:03.491 INFO:teuthology.orchestra.run.smithi008.stdout: }, 2023-08-01T19:56:03.491 INFO:teuthology.orchestra.run.smithi008.stdout: { 2023-08-01T19:56:03.491 INFO:teuthology.orchestra.run.smithi008.stdout: "description": "osd_op(client.4668.0:197418 5.2 5:4ba84ab7:::benchmark_data_smithi006_114134_object63757:head [delete] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e62)", 2023-08-01T19:56:03.491 INFO:teuthology.orchestra.run.smithi008.stdout: "initiated_at": "2023-08-01T19:55:58.580297+0000", 2023-08-01T19:56:03.491 INFO:teuthology.orchestra.run.smithi008.stdout: "age": 4.6552618539999999, 2023-08-01T19:56:03.491 INFO:teuthology.orchestra.run.smithi008.stdout: "duration": 1.0529485839999999, 2023-08-01T19:56:03.492 INFO:teuthology.orchestra.run.smithi008.stdout: "type_data": { 2023-08-01T19:56:03.492 INFO:teuthology.orchestra.run.smithi008.stdout: "flag_point": "commit sent; apply or cleanup", 2023-08-01T19:56:03.492 INFO:teuthology.orchestra.run.smithi008.stdout: "client_info": { 2023-08-01T19:56:03.492 INFO:teuthology.orchestra.run.smithi008.stdout: "client": "client.4668", 2023-08-01T19:56:03.492 INFO:teuthology.orchestra.run.smithi008.stdout: "client_addr": "172.21.15.6:0/1709472247", 2023-08-01T19:56:03.492 INFO:teuthology.orchestra.run.smithi008.stdout: "tid": 197418 2023-08-01T19:56:03.492 INFO:teuthology.orchestra.run.smithi008.stdout: }, 2023-08-01T19:56:03.493 INFO:teuthology.orchestra.run.smithi008.stdout: "events": [ 2023-08-01T19:56:03.493 INFO:teuthology.orchestra.run.smithi008.stdout: { 2023-08-01T19:56:03.493 INFO:teuthology.orchestra.run.smithi008.stdout: "event": "initiated", 2023-08-01T19:56:03.493 INFO:teuthology.orchestra.run.smithi008.stdout: "time": "2023-08-01T19:55:58.580297+0000", 2023-08-01T19:56:03.493 INFO:teuthology.orchestra.run.smithi008.stdout: "duration": 0 2023-08-01T19:56:03.493 INFO:teuthology.orchestra.run.smithi008.stdout: }, 2023-08-01T19:56:03.493 INFO:teuthology.orchestra.run.smithi008.stdout: { 2023-08-01T19:56:03.493 INFO:teuthology.orchestra.run.smithi008.stdout: "event": "throttled", 2023-08-01T19:56:03.494 INFO:teuthology.orchestra.run.smithi008.stdout: "time": "2023-08-01T19:55:58.580297+0000", 2023-08-01T19:56:03.494 INFO:teuthology.orchestra.run.smithi008.stdout: "duration": 0 2023-08-01T19:56:03.494 INFO:teuthology.orchestra.run.smithi008.stdout: }, 2023-08-01T19:56:03.494 INFO:teuthology.orchestra.run.smithi008.stdout: { 2023-08-01T19:56:03.494 INFO:teuthology.orchestra.run.smithi008.stdout: "event": "header_read", 2023-08-01T19:56:03.494 INFO:teuthology.orchestra.run.smithi008.stdout: "time": "2023-08-01T19:55:58.580296+0000", 2023-08-01T19:56:03.494 INFO:teuthology.orchestra.run.smithi008.stdout: "duration": 4294967295.999999 2023-08-01T19:56:03.494 INFO:teuthology.orchestra.run.smithi008.stdout: }, 2023-08-01T19:56:03.495 INFO:teuthology.orchestra.run.smithi008.stdout: { 2023-08-01T19:56:03.495 INFO:teuthology.orchestra.run.smithi008.stdout: "event": "all_read", 2023-08-01T19:56:03.495 INFO:teuthology.orchestra.run.smithi008.stdout: "time": "2023-08-01T19:55:58.580302+0000", 2023-08-01T19:56:03.495 INFO:teuthology.orchestra.run.smithi008.stdout: "duration": 6.032e-06 2023-08-01T19:56:03.495 INFO:teuthology.orchestra.run.smithi008.stdout: }, 2023-08-01T19:56:03.495 INFO:teuthology.orchestra.run.smithi008.stdout: { 2023-08-01T19:56:03.495 INFO:teuthology.orchestra.run.smithi008.stdout: "event": "dispatched", 2023-08-01T19:56:03.495 INFO:teuthology.orchestra.run.smithi008.stdout: "time": "2023-08-01T19:55:58.580315+0000", 2023-08-01T19:56:03.496 INFO:teuthology.orchestra.run.smithi008.stdout: "duration": 1.327e-05 2023-08-01T19:56:03.496 INFO:teuthology.orchestra.run.smithi008.stdout: }, 2023-08-01T19:56:03.496 INFO:teuthology.orchestra.run.smithi008.stdout: { 2023-08-01T19:56:03.496 INFO:teuthology.orchestra.run.smithi008.stdout: "event": "queued_for_pg", 2023-08-01T19:56:03.496 INFO:teuthology.orchestra.run.smithi008.stdout: "time": "2023-08-01T19:55:58.580321+0000", 2023-08-01T19:56:03.496 INFO:teuthology.orchestra.run.smithi008.stdout: "duration": 6.3980000000000004e-06 2023-08-01T19:56:03.496 INFO:teuthology.orchestra.run.smithi008.stdout: }, 2023-08-01T19:56:03.496 INFO:teuthology.orchestra.run.smithi008.stdout: { 2023-08-01T19:56:03.497 INFO:teuthology.orchestra.run.smithi008.stdout: "event": "reached_pg", 2023-08-01T19:56:03.497 INFO:teuthology.orchestra.run.smithi008.stdout: "time": "2023-08-01T19:55:58.580372+0000", 2023-08-01T19:56:03.497 INFO:teuthology.orchestra.run.smithi008.stdout: "duration": 5.0219000000000001e-05 2023-08-01T19:56:03.497 INFO:teuthology.orchestra.run.smithi008.stdout: }, 2023-08-01T19:56:03.497 INFO:teuthology.orchestra.run.smithi008.stdout: { 2023-08-01T19:56:03.497 INFO:teuthology.orchestra.run.smithi008.stdout: "event": "waiting for peered", 2023-08-01T19:56:03.497 INFO:teuthology.orchestra.run.smithi008.stdout: "time": "2023-08-01T19:55:58.580378+0000", 2023-08-01T19:56:03.497 INFO:teuthology.orchestra.run.smithi008.stdout: "duration": 6.6529999999999997e-06 2023-08-01T19:56:03.498 INFO:teuthology.orchestra.run.smithi008.stdout: }, 2023-08-01T19:56:03.498 INFO:teuthology.orchestra.run.smithi008.stdout: { 2023-08-01T19:56:03.498 INFO:teuthology.orchestra.run.smithi008.stdout: "event": "reached_pg", 2023-08-01T19:56:03.498 INFO:teuthology.orchestra.run.smithi008.stdout: "time": "2023-08-01T19:55:59.618188+0000", 2023-08-01T19:56:03.498 INFO:teuthology.orchestra.run.smithi008.stdout: "duration": 1.037810267 2023-08-01T19:56:03.498 INFO:teuthology.orchestra.run.smithi008.stdout: }, 2023-08-01T19:56:03.498 INFO:teuthology.orchestra.run.smithi008.stdout: { 2023-08-01T19:56:03.498 INFO:teuthology.orchestra.run.smithi008.stdout: "event": "started", 2023-08-01T19:56:03.499 INFO:teuthology.orchestra.run.smithi008.stdout: "time": "2023-08-01T19:55:59.618308+0000", 2023-08-01T19:56:03.499 INFO:teuthology.orchestra.run.smithi008.stdout: "duration": 0.00011959 2023-08-01T19:56:03.499 INFO:teuthology.orchestra.run.smithi008.stdout: }, 2023-08-01T19:56:03.499 INFO:teuthology.orchestra.run.smithi008.stdout: { 2023-08-01T19:56:03.499 INFO:teuthology.orchestra.run.smithi008.stdout: "event": "op_commit", 2023-08-01T19:56:03.499 INFO:teuthology.orchestra.run.smithi008.stdout: "time": "2023-08-01T19:55:59.633122+0000", 2023-08-01T19:56:03.499 INFO:teuthology.orchestra.run.smithi008.stdout: "duration": 0.014814280000000001 2023-08-01T19:56:03.500 INFO:teuthology.orchestra.run.smithi008.stdout: }, 2023-08-01T19:56:03.500 INFO:teuthology.orchestra.run.smithi008.stdout: { 2023-08-01T19:56:03.500 INFO:teuthology.orchestra.run.smithi008.stdout: "event": "commit_sent", 2023-08-01T19:56:03.500 INFO:teuthology.orchestra.run.smithi008.stdout: "time": "2023-08-01T19:55:59.633167+0000", 2023-08-01T19:56:03.500 INFO:teuthology.orchestra.run.smithi008.stdout: "duration": 4.4651999999999999e-05 2023-08-01T19:56:03.500 INFO:teuthology.orchestra.run.smithi008.stdout: }, 2023-08-01T19:56:03.500 INFO:teuthology.orchestra.run.smithi008.stdout: { 2023-08-01T19:56:03.500 INFO:teuthology.orchestra.run.smithi008.stdout: "event": "done", 2023-08-01T19:56:03.501 INFO:teuthology.orchestra.run.smithi008.stdout: "time": "2023-08-01T19:55:59.633245+0000", 2023-08-01T19:56:03.501 INFO:teuthology.orchestra.run.smithi008.stdout: "duration": 7.8215999999999998e-05 2023-08-01T19:56:03.501 INFO:teuthology.orchestra.run.smithi008.stdout: } 2023-08-01T19:56:03.501 INFO:teuthology.orchestra.run.smithi008.stdout: ] 2023-08-01T19:56:03.501 INFO:teuthology.orchestra.run.smithi008.stdout: } 2023-08-01T19:56:03.501 INFO:teuthology.orchestra.run.smithi008.stdout: } 2023-08-01T19:56:03.501 INFO:teuthology.orchestra.run.smithi008.stdout: ] 2023-08-01T19:56:03.501 INFO:teuthology.orchestra.run.smithi008.stdout:} 2023-08-01T19:56:03.502 DEBUG:teuthology.orchestra.console.smithi101:pexpect command: ipmitool -H smithi101.ipmi.sepia.ceph.com -I lanplus -U inktank -P ApGNXcA7 power status 2023-08-01T19:56:03.514 DEBUG:teuthology.orchestra.run.smithi155:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 30 ceph --cluster ceph --admin-daemon /var/run/ceph/ceph-osd.2.asok dump_ops_in_flight 2023-08-01T19:56:03.514 INFO:tasks.ceph.osd.0.smithi008.stderr:2023-08-01T19:56:03.501+0000 7f16a58f4700 -1 received signal: Hangup from /usr/bin/python3 /bin/daemon-helper kill ceph-osd -f --cluster ceph -i 0 (PID: 111179) UID: 0 2023-08-01T19:56:03.584 INFO:teuthology.orchestra.run.smithi006.stderr:noscrub is unset 2023-08-01T19:56:03.603 INFO:tasks.ceph.osd.0.smithi008.stderr:2023-08-01T19:56:03.601+0000 7f16a58f4700 -1 received signal: Hangup from /usr/bin/python3 /bin/daemon-helper kill ceph-osd -f --cluster ceph -i 0 (PID: 111179) UID: 0 2023-08-01T19:56:03.614 DEBUG:teuthology.orchestra.console.smithi101:check power output: Chassis Power is off 2023-08-01T19:56:03.685 INFO:teuthology.orchestra.run.smithi155.stdout:{ 2023-08-01T19:56:03.685 INFO:teuthology.orchestra.run.smithi155.stdout: "ops": [ 2023-08-01T19:56:03.685 INFO:teuthology.orchestra.run.smithi155.stdout: { 2023-08-01T19:56:03.685 INFO:teuthology.orchestra.run.smithi155.stdout: "description": "osd_op(client.4668.0:205855 5.0 5:0644a2c9:::benchmark_data_smithi006_114134_object72194:head [delete] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e65)", 2023-08-01T19:56:03.685 INFO:teuthology.orchestra.run.smithi155.stdout: "initiated_at": "2023-08-01T19:56:03.674942+0000", 2023-08-01T19:56:03.685 INFO:teuthology.orchestra.run.smithi155.stdout: "age": 0.0083918229999999996, 2023-08-01T19:56:03.686 INFO:teuthology.orchestra.run.smithi155.stdout: "duration": 0.0084116620000000003, 2023-08-01T19:56:03.686 INFO:teuthology.orchestra.run.smithi155.stdout: "type_data": { 2023-08-01T19:56:03.686 INFO:teuthology.orchestra.run.smithi155.stdout: "flag_point": "waiting for sub ops", 2023-08-01T19:56:03.686 INFO:teuthology.orchestra.run.smithi155.stdout: "client_info": { 2023-08-01T19:56:03.686 INFO:teuthology.orchestra.run.smithi155.stdout: "client": "client.4668", 2023-08-01T19:56:03.686 INFO:teuthology.orchestra.run.smithi155.stdout: "client_addr": "172.21.15.6:0/1709472247", 2023-08-01T19:56:03.686 INFO:teuthology.orchestra.run.smithi155.stdout: "tid": 205855 2023-08-01T19:56:03.687 INFO:teuthology.orchestra.run.smithi155.stdout: }, 2023-08-01T19:56:03.687 INFO:teuthology.orchestra.run.smithi155.stdout: "events": [ 2023-08-01T19:56:03.687 INFO:teuthology.orchestra.run.smithi155.stdout: { 2023-08-01T19:56:03.687 INFO:teuthology.orchestra.run.smithi155.stdout: "event": "initiated", 2023-08-01T19:56:03.687 INFO:teuthology.orchestra.run.smithi155.stdout: "time": "2023-08-01T19:56:03.674942+0000", 2023-08-01T19:56:03.687 INFO:teuthology.orchestra.run.smithi155.stdout: "duration": 0 2023-08-01T19:56:03.687 INFO:teuthology.orchestra.run.smithi155.stdout: }, 2023-08-01T19:56:03.688 INFO:teuthology.orchestra.run.smithi155.stdout: { 2023-08-01T19:56:03.688 INFO:teuthology.orchestra.run.smithi155.stdout: "event": "throttled", 2023-08-01T19:56:03.688 INFO:teuthology.orchestra.run.smithi155.stdout: "time": "2023-08-01T19:56:03.674942+0000", 2023-08-01T19:56:03.688 INFO:teuthology.orchestra.run.smithi155.stdout: "duration": 0 2023-08-01T19:56:03.688 INFO:teuthology.orchestra.run.smithi155.stdout: }, 2023-08-01T19:56:03.688 INFO:teuthology.orchestra.run.smithi155.stdout: { 2023-08-01T19:56:03.688 INFO:teuthology.orchestra.run.smithi155.stdout: "event": "header_read", 2023-08-01T19:56:03.688 INFO:teuthology.orchestra.run.smithi155.stdout: "time": "2023-08-01T19:56:03.674941+0000", 2023-08-01T19:56:03.689 INFO:teuthology.orchestra.run.smithi155.stdout: "duration": 4294967295.999999 2023-08-01T19:56:03.689 INFO:teuthology.orchestra.run.smithi155.stdout: }, 2023-08-01T19:56:03.689 INFO:teuthology.orchestra.run.smithi155.stdout: { 2023-08-01T19:56:03.689 INFO:teuthology.orchestra.run.smithi155.stdout: "event": "all_read", 2023-08-01T19:56:03.689 INFO:teuthology.orchestra.run.smithi155.stdout: "time": "2023-08-01T19:56:03.674945+0000", 2023-08-01T19:56:03.689 INFO:teuthology.orchestra.run.smithi155.stdout: "duration": 4.0990000000000001e-06 2023-08-01T19:56:03.689 INFO:teuthology.orchestra.run.smithi155.stdout: }, 2023-08-01T19:56:03.689 INFO:teuthology.orchestra.run.smithi155.stdout: { 2023-08-01T19:56:03.690 INFO:teuthology.orchestra.run.smithi155.stdout: "event": "dispatched", 2023-08-01T19:56:03.690 INFO:teuthology.orchestra.run.smithi155.stdout: "time": "2023-08-01T19:56:03.674955+0000", 2023-08-01T19:56:03.690 INFO:teuthology.orchestra.run.smithi155.stdout: "duration": 9.4469999999999995e-06 2023-08-01T19:56:03.690 INFO:teuthology.orchestra.run.smithi155.stdout: }, 2023-08-01T19:56:03.690 INFO:teuthology.orchestra.run.smithi155.stdout: { 2023-08-01T19:56:03.690 INFO:teuthology.orchestra.run.smithi155.stdout: "event": "queued_for_pg", 2023-08-01T19:56:03.690 INFO:teuthology.orchestra.run.smithi155.stdout: "time": "2023-08-01T19:56:03.674959+0000", 2023-08-01T19:56:03.691 INFO:teuthology.orchestra.run.smithi155.stdout: "duration": 4.4530000000000004e-06 2023-08-01T19:56:03.691 INFO:teuthology.orchestra.run.smithi155.stdout: }, 2023-08-01T19:56:03.691 INFO:teuthology.orchestra.run.smithi155.stdout: { 2023-08-01T19:56:03.691 INFO:teuthology.orchestra.run.smithi155.stdout: "event": "reached_pg", 2023-08-01T19:56:03.691 INFO:teuthology.orchestra.run.smithi155.stdout: "time": "2023-08-01T19:56:03.674985+0000", 2023-08-01T19:56:03.691 INFO:teuthology.orchestra.run.smithi155.stdout: "duration": 2.5897999999999998e-05 2023-08-01T19:56:03.691 INFO:teuthology.orchestra.run.smithi155.stdout: }, 2023-08-01T19:56:03.691 INFO:teuthology.orchestra.run.smithi155.stdout: { 2023-08-01T19:56:03.692 INFO:teuthology.orchestra.run.smithi155.stdout: "event": "started", 2023-08-01T19:56:03.692 INFO:teuthology.orchestra.run.smithi155.stdout: "time": "2023-08-01T19:56:03.675074+0000", 2023-08-01T19:56:03.692 INFO:teuthology.orchestra.run.smithi155.stdout: "duration": 8.8811000000000001e-05 2023-08-01T19:56:03.692 INFO:teuthology.orchestra.run.smithi155.stdout: }, 2023-08-01T19:56:03.692 INFO:teuthology.orchestra.run.smithi155.stdout: { 2023-08-01T19:56:03.692 INFO:teuthology.orchestra.run.smithi155.stdout: "event": "waiting for subops from 0", 2023-08-01T19:56:03.692 INFO:teuthology.orchestra.run.smithi155.stdout: "time": "2023-08-01T19:56:03.675138+0000", 2023-08-01T19:56:03.692 INFO:teuthology.orchestra.run.smithi155.stdout: "duration": 6.4377999999999999e-05 2023-08-01T19:56:03.693 INFO:teuthology.orchestra.run.smithi155.stdout: }, 2023-08-01T19:56:03.693 INFO:teuthology.orchestra.run.smithi155.stdout: { 2023-08-01T19:56:03.693 INFO:teuthology.orchestra.run.smithi155.stdout: "event": "op_commit", 2023-08-01T19:56:03.693 INFO:teuthology.orchestra.run.smithi155.stdout: "time": "2023-08-01T19:56:03.681121+0000", 2023-08-01T19:56:03.693 INFO:teuthology.orchestra.run.smithi155.stdout: "duration": 0.0059824159999999999 2023-08-01T19:56:03.693 INFO:teuthology.orchestra.run.smithi155.stdout: } 2023-08-01T19:56:03.693 INFO:teuthology.orchestra.run.smithi155.stdout: ] 2023-08-01T19:56:03.694 INFO:teuthology.orchestra.run.smithi155.stdout: } 2023-08-01T19:56:03.694 INFO:teuthology.orchestra.run.smithi155.stdout: }, 2023-08-01T19:56:03.694 INFO:teuthology.orchestra.run.smithi155.stdout: { 2023-08-01T19:56:03.694 INFO:teuthology.orchestra.run.smithi155.stdout: "description": "osd_op(client.4668.0:205861 5.4 5:2800eac7:::benchmark_data_smithi006_114134_object72200:head [delete] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e65)", 2023-08-01T19:56:03.694 INFO:teuthology.orchestra.run.smithi155.stdout: "initiated_at": "2023-08-01T19:56:03.677448+0000", 2023-08-01T19:56:03.694 INFO:teuthology.orchestra.run.smithi155.stdout: "age": 0.0058858410000000002, 2023-08-01T19:56:03.694 INFO:teuthology.orchestra.run.smithi155.stdout: "duration": 0.0059604009999999997, 2023-08-01T19:56:03.694 INFO:teuthology.orchestra.run.smithi155.stdout: "type_data": { 2023-08-01T19:56:03.695 INFO:teuthology.orchestra.run.smithi155.stdout: "flag_point": "waiting for sub ops", 2023-08-01T19:56:03.695 INFO:teuthology.orchestra.run.smithi155.stdout: "client_info": { 2023-08-01T19:56:03.695 INFO:teuthology.orchestra.run.smithi155.stdout: "client": "client.4668", 2023-08-01T19:56:03.695 INFO:teuthology.orchestra.run.smithi155.stdout: "client_addr": "172.21.15.6:0/1709472247", 2023-08-01T19:56:03.695 INFO:teuthology.orchestra.run.smithi155.stdout: "tid": 205861 2023-08-01T19:56:03.695 INFO:teuthology.orchestra.run.smithi155.stdout: }, 2023-08-01T19:56:03.695 INFO:teuthology.orchestra.run.smithi155.stdout: "events": [ 2023-08-01T19:56:03.695 INFO:teuthology.orchestra.run.smithi155.stdout: { 2023-08-01T19:56:03.696 INFO:teuthology.orchestra.run.smithi155.stdout: "event": "initiated", 2023-08-01T19:56:03.696 INFO:teuthology.orchestra.run.smithi155.stdout: "time": "2023-08-01T19:56:03.677448+0000", 2023-08-01T19:56:03.696 INFO:teuthology.orchestra.run.smithi155.stdout: "duration": 0 2023-08-01T19:56:03.696 INFO:teuthology.orchestra.run.smithi155.stdout: }, 2023-08-01T19:56:03.696 INFO:teuthology.orchestra.run.smithi155.stdout: { 2023-08-01T19:56:03.696 INFO:teuthology.orchestra.run.smithi155.stdout: "event": "throttled", 2023-08-01T19:56:03.696 INFO:teuthology.orchestra.run.smithi155.stdout: "time": "2023-08-01T19:56:03.677448+0000", 2023-08-01T19:56:03.697 INFO:teuthology.orchestra.run.smithi155.stdout: "duration": 0 2023-08-01T19:56:03.697 INFO:teuthology.orchestra.run.smithi155.stdout: }, 2023-08-01T19:56:03.697 INFO:teuthology.orchestra.run.smithi155.stdout: { 2023-08-01T19:56:03.697 INFO:teuthology.orchestra.run.smithi155.stdout: "event": "header_read", 2023-08-01T19:56:03.697 INFO:teuthology.orchestra.run.smithi155.stdout: "time": "2023-08-01T19:56:03.677447+0000", 2023-08-01T19:56:03.697 INFO:teuthology.orchestra.run.smithi155.stdout: "duration": 4294967295.999999 2023-08-01T19:56:03.697 INFO:teuthology.orchestra.run.smithi155.stdout: }, 2023-08-01T19:56:03.697 INFO:teuthology.orchestra.run.smithi155.stdout: { 2023-08-01T19:56:03.698 INFO:teuthology.orchestra.run.smithi155.stdout: "event": "all_read", 2023-08-01T19:56:03.698 INFO:teuthology.orchestra.run.smithi155.stdout: "time": "2023-08-01T19:56:03.677452+0000", 2023-08-01T19:56:03.698 INFO:teuthology.orchestra.run.smithi155.stdout: "duration": 4.5859999999999998e-06 2023-08-01T19:56:03.698 INFO:teuthology.orchestra.run.smithi155.stdout: }, 2023-08-01T19:56:03.698 INFO:teuthology.orchestra.run.smithi155.stdout: { 2023-08-01T19:56:03.698 INFO:teuthology.orchestra.run.smithi155.stdout: "event": "dispatched", 2023-08-01T19:56:03.698 INFO:teuthology.orchestra.run.smithi155.stdout: "time": "2023-08-01T19:56:03.677460+0000", 2023-08-01T19:56:03.698 INFO:teuthology.orchestra.run.smithi155.stdout: "duration": 7.9729999999999997e-06 2023-08-01T19:56:03.699 INFO:teuthology.orchestra.run.smithi155.stdout: }, 2023-08-01T19:56:03.699 INFO:teuthology.orchestra.run.smithi155.stdout: { 2023-08-01T19:56:03.699 INFO:teuthology.orchestra.run.smithi155.stdout: "event": "queued_for_pg", 2023-08-01T19:56:03.699 INFO:teuthology.orchestra.run.smithi155.stdout: "time": "2023-08-01T19:56:03.677464+0000", 2023-08-01T19:56:03.699 INFO:teuthology.orchestra.run.smithi155.stdout: "duration": 4.0990000000000001e-06 2023-08-01T19:56:03.699 INFO:teuthology.orchestra.run.smithi155.stdout: }, 2023-08-01T19:56:03.699 INFO:teuthology.orchestra.run.smithi155.stdout: { 2023-08-01T19:56:03.699 INFO:teuthology.orchestra.run.smithi155.stdout: "event": "reached_pg", 2023-08-01T19:56:03.700 INFO:teuthology.orchestra.run.smithi155.stdout: "time": "2023-08-01T19:56:03.677496+0000", 2023-08-01T19:56:03.700 INFO:teuthology.orchestra.run.smithi155.stdout: "duration": 3.2041e-05 2023-08-01T19:56:03.700 INFO:teuthology.orchestra.run.smithi155.stdout: }, 2023-08-01T19:56:03.700 INFO:teuthology.orchestra.run.smithi155.stdout: { 2023-08-01T19:56:03.700 INFO:teuthology.orchestra.run.smithi155.stdout: "event": "started", 2023-08-01T19:56:03.700 INFO:teuthology.orchestra.run.smithi155.stdout: "time": "2023-08-01T19:56:03.677573+0000", 2023-08-01T19:56:03.700 INFO:teuthology.orchestra.run.smithi155.stdout: "duration": 7.7532000000000002e-05 2023-08-01T19:56:03.701 INFO:teuthology.orchestra.run.smithi155.stdout: }, 2023-08-01T19:56:03.701 INFO:teuthology.orchestra.run.smithi155.stdout: { 2023-08-01T19:56:03.701 INFO:teuthology.orchestra.run.smithi155.stdout: "event": "waiting for subops from 0", 2023-08-01T19:56:03.701 INFO:teuthology.orchestra.run.smithi155.stdout: "time": "2023-08-01T19:56:03.677636+0000", 2023-08-01T19:56:03.701 INFO:teuthology.orchestra.run.smithi155.stdout: "duration": 6.2407000000000001e-05 2023-08-01T19:56:03.701 INFO:teuthology.orchestra.run.smithi155.stdout: }, 2023-08-01T19:56:03.701 INFO:teuthology.orchestra.run.smithi155.stdout: { 2023-08-01T19:56:03.701 INFO:teuthology.orchestra.run.smithi155.stdout: "event": "op_commit", 2023-08-01T19:56:03.702 INFO:teuthology.orchestra.run.smithi155.stdout: "time": "2023-08-01T19:56:03.681032+0000", 2023-08-01T19:56:03.702 INFO:teuthology.orchestra.run.smithi155.stdout: "duration": 0.0033959630000000001 2023-08-01T19:56:03.702 INFO:teuthology.orchestra.run.smithi155.stdout: } 2023-08-01T19:56:03.702 INFO:teuthology.orchestra.run.smithi155.stdout: ] 2023-08-01T19:56:03.702 INFO:teuthology.orchestra.run.smithi155.stdout: } 2023-08-01T19:56:03.702 INFO:teuthology.orchestra.run.smithi155.stdout: }, 2023-08-01T19:56:03.702 INFO:teuthology.orchestra.run.smithi155.stdout: { 2023-08-01T19:56:03.702 INFO:teuthology.orchestra.run.smithi155.stdout: "description": "osd_op(client.4668.0:205866 5.0 5:0482aff4:::benchmark_data_smithi006_114134_object72205:head [delete] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e65)", 2023-08-01T19:56:03.703 INFO:teuthology.orchestra.run.smithi155.stdout: "initiated_at": "2023-08-01T19:56:03.679507+0000", 2023-08-01T19:56:03.703 INFO:teuthology.orchestra.run.smithi155.stdout: "age": 0.0038264449999999999, 2023-08-01T19:56:03.703 INFO:teuthology.orchestra.run.smithi155.stdout: "duration": 0.003948806, 2023-08-01T19:56:03.703 INFO:teuthology.orchestra.run.smithi155.stdout: "type_data": { 2023-08-01T19:56:03.703 INFO:teuthology.orchestra.run.smithi155.stdout: "flag_point": "waiting for sub ops", 2023-08-01T19:56:03.703 INFO:teuthology.orchestra.run.smithi155.stdout: "client_info": { 2023-08-01T19:56:03.703 INFO:teuthology.orchestra.run.smithi155.stdout: "client": "client.4668", 2023-08-01T19:56:03.703 INFO:teuthology.orchestra.run.smithi155.stdout: "client_addr": "172.21.15.6:0/1709472247", 2023-08-01T19:56:03.704 INFO:teuthology.orchestra.run.smithi155.stdout: "tid": 205866 2023-08-01T19:56:03.704 INFO:teuthology.orchestra.run.smithi155.stdout: }, 2023-08-01T19:56:03.704 INFO:teuthology.orchestra.run.smithi155.stdout: "events": [ 2023-08-01T19:56:03.704 INFO:teuthology.orchestra.run.smithi155.stdout: { 2023-08-01T19:56:03.704 INFO:teuthology.orchestra.run.smithi155.stdout: "event": "initiated", 2023-08-01T19:56:03.704 INFO:teuthology.orchestra.run.smithi155.stdout: "time": "2023-08-01T19:56:03.679507+0000", 2023-08-01T19:56:03.704 INFO:teuthology.orchestra.run.smithi155.stdout: "duration": 0 2023-08-01T19:56:03.705 INFO:teuthology.orchestra.run.smithi155.stdout: }, 2023-08-01T19:56:03.705 INFO:teuthology.orchestra.run.smithi155.stdout: { 2023-08-01T19:56:03.705 INFO:teuthology.orchestra.run.smithi155.stdout: "event": "throttled", 2023-08-01T19:56:03.705 INFO:teuthology.orchestra.run.smithi155.stdout: "time": "2023-08-01T19:56:03.679507+0000", 2023-08-01T19:56:03.705 INFO:teuthology.orchestra.run.smithi155.stdout: "duration": 0 2023-08-01T19:56:03.705 INFO:teuthology.orchestra.run.smithi155.stdout: }, 2023-08-01T19:56:03.705 INFO:teuthology.orchestra.run.smithi155.stdout: { 2023-08-01T19:56:03.705 INFO:teuthology.orchestra.run.smithi155.stdout: "event": "header_read", 2023-08-01T19:56:03.706 INFO:teuthology.orchestra.run.smithi155.stdout: "time": "2023-08-01T19:56:03.679506+0000", 2023-08-01T19:56:03.706 INFO:teuthology.orchestra.run.smithi155.stdout: "duration": 4294967295.999999 2023-08-01T19:56:03.706 INFO:teuthology.orchestra.run.smithi155.stdout: }, 2023-08-01T19:56:03.706 INFO:teuthology.orchestra.run.smithi155.stdout: { 2023-08-01T19:56:03.706 INFO:teuthology.orchestra.run.smithi155.stdout: "event": "all_read", 2023-08-01T19:56:03.706 INFO:teuthology.orchestra.run.smithi155.stdout: "time": "2023-08-01T19:56:03.679511+0000", 2023-08-01T19:56:03.706 INFO:teuthology.orchestra.run.smithi155.stdout: "duration": 4.4479999999999996e-06 2023-08-01T19:56:03.706 INFO:teuthology.orchestra.run.smithi155.stdout: }, 2023-08-01T19:56:03.707 INFO:teuthology.orchestra.run.smithi155.stdout: { 2023-08-01T19:56:03.707 INFO:teuthology.orchestra.run.smithi155.stdout: "event": "dispatched", 2023-08-01T19:56:03.707 INFO:teuthology.orchestra.run.smithi155.stdout: "time": "2023-08-01T19:56:03.679522+0000", 2023-08-01T19:56:03.707 INFO:teuthology.orchestra.run.smithi155.stdout: "duration": 1.0749e-05 2023-08-01T19:56:03.707 INFO:teuthology.orchestra.run.smithi155.stdout: }, 2023-08-01T19:56:03.707 INFO:teuthology.orchestra.run.smithi155.stdout: { 2023-08-01T19:56:03.707 INFO:teuthology.orchestra.run.smithi155.stdout: "event": "queued_for_pg", 2023-08-01T19:56:03.708 INFO:teuthology.orchestra.run.smithi155.stdout: "time": "2023-08-01T19:56:03.679527+0000", 2023-08-01T19:56:03.708 INFO:teuthology.orchestra.run.smithi155.stdout: "duration": 5.7590000000000003e-06 2023-08-01T19:56:03.708 INFO:teuthology.orchestra.run.smithi155.stdout: }, 2023-08-01T19:56:03.708 INFO:teuthology.orchestra.run.smithi155.stdout: { 2023-08-01T19:56:03.708 INFO:teuthology.orchestra.run.smithi155.stdout: "event": "reached_pg", 2023-08-01T19:56:03.708 INFO:teuthology.orchestra.run.smithi155.stdout: "time": "2023-08-01T19:56:03.679552+0000", 2023-08-01T19:56:03.708 INFO:teuthology.orchestra.run.smithi155.stdout: "duration": 2.4476000000000001e-05 2023-08-01T19:56:03.708 INFO:teuthology.orchestra.run.smithi155.stdout: }, 2023-08-01T19:56:03.709 INFO:teuthology.orchestra.run.smithi155.stdout: { 2023-08-01T19:56:03.709 INFO:teuthology.orchestra.run.smithi155.stdout: "event": "started", 2023-08-01T19:56:03.709 INFO:teuthology.orchestra.run.smithi155.stdout: "time": "2023-08-01T19:56:03.679621+0000", 2023-08-01T19:56:03.709 INFO:teuthology.orchestra.run.smithi155.stdout: "duration": 6.8706000000000003e-05 2023-08-01T19:56:03.709 INFO:teuthology.orchestra.run.smithi155.stdout: }, 2023-08-01T19:56:03.709 INFO:teuthology.orchestra.run.smithi155.stdout: { 2023-08-01T19:56:03.709 INFO:teuthology.orchestra.run.smithi155.stdout: "event": "waiting for subops from 0", 2023-08-01T19:56:03.710 INFO:teuthology.orchestra.run.smithi155.stdout: "time": "2023-08-01T19:56:03.679680+0000", 2023-08-01T19:56:03.710 INFO:teuthology.orchestra.run.smithi155.stdout: "duration": 5.9336000000000002e-05 2023-08-01T19:56:03.710 INFO:teuthology.orchestra.run.smithi155.stdout: } 2023-08-01T19:56:03.710 INFO:teuthology.orchestra.run.smithi155.stdout: ] 2023-08-01T19:56:03.710 INFO:teuthology.orchestra.run.smithi155.stdout: } 2023-08-01T19:56:03.710 INFO:teuthology.orchestra.run.smithi155.stdout: }, 2023-08-01T19:56:03.710 INFO:teuthology.orchestra.run.smithi155.stdout: { 2023-08-01T19:56:03.710 INFO:teuthology.orchestra.run.smithi155.stdout: "description": "osd_op(client.4668.0:205868 5.d 5:b2aa45f4:::benchmark_data_smithi006_114134_object72207:head [delete] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e65)", 2023-08-01T19:56:03.711 INFO:teuthology.orchestra.run.smithi155.stdout: "initiated_at": "2023-08-01T19:56:03.680334+0000", 2023-08-01T19:56:03.711 INFO:teuthology.orchestra.run.smithi155.stdout: "age": 0.0029992500000000002, 2023-08-01T19:56:03.711 INFO:teuthology.orchestra.run.smithi155.stdout: "duration": 0.003165902, 2023-08-01T19:56:03.711 INFO:teuthology.orchestra.run.smithi155.stdout: "type_data": { 2023-08-01T19:56:03.711 INFO:teuthology.orchestra.run.smithi155.stdout: "flag_point": "started", 2023-08-01T19:56:03.711 INFO:teuthology.orchestra.run.smithi155.stdout: "client_info": { 2023-08-01T19:56:03.711 INFO:teuthology.orchestra.run.smithi155.stdout: "client": "client.4668", 2023-08-01T19:56:03.711 INFO:teuthology.orchestra.run.smithi155.stdout: "client_addr": "172.21.15.6:0/1709472247", 2023-08-01T19:56:03.712 INFO:teuthology.orchestra.run.smithi155.stdout: "tid": 205868 2023-08-01T19:56:03.712 INFO:teuthology.orchestra.run.smithi155.stdout: }, 2023-08-01T19:56:03.712 INFO:teuthology.orchestra.run.smithi155.stdout: "events": [ 2023-08-01T19:56:03.712 INFO:teuthology.orchestra.run.smithi155.stdout: { 2023-08-01T19:56:03.712 INFO:teuthology.orchestra.run.smithi155.stdout: "event": "initiated", 2023-08-01T19:56:03.712 INFO:teuthology.orchestra.run.smithi155.stdout: "time": "2023-08-01T19:56:03.680334+0000", 2023-08-01T19:56:03.712 INFO:teuthology.orchestra.run.smithi155.stdout: "duration": 0 2023-08-01T19:56:03.713 INFO:teuthology.orchestra.run.smithi155.stdout: }, 2023-08-01T19:56:03.713 INFO:teuthology.orchestra.run.smithi155.stdout: { 2023-08-01T19:56:03.713 INFO:teuthology.orchestra.run.smithi155.stdout: "event": "throttled", 2023-08-01T19:56:03.713 INFO:teuthology.orchestra.run.smithi155.stdout: "time": "2023-08-01T19:56:03.680334+0000", 2023-08-01T19:56:03.713 INFO:teuthology.orchestra.run.smithi155.stdout: "duration": 0 2023-08-01T19:56:03.713 INFO:teuthology.orchestra.run.smithi155.stdout: }, 2023-08-01T19:56:03.713 INFO:teuthology.orchestra.run.smithi155.stdout: { 2023-08-01T19:56:03.713 INFO:teuthology.orchestra.run.smithi155.stdout: "event": "header_read", 2023-08-01T19:56:03.714 INFO:teuthology.orchestra.run.smithi155.stdout: "time": "2023-08-01T19:56:03.680334+0000", 2023-08-01T19:56:03.714 INFO:teuthology.orchestra.run.smithi155.stdout: "duration": 4294967295.9999995 2023-08-01T19:56:03.714 INFO:teuthology.orchestra.run.smithi155.stdout: }, 2023-08-01T19:56:03.714 INFO:teuthology.orchestra.run.smithi155.stdout: { 2023-08-01T19:56:03.714 INFO:teuthology.orchestra.run.smithi155.stdout: "event": "all_read", 2023-08-01T19:56:03.714 INFO:teuthology.orchestra.run.smithi155.stdout: "time": "2023-08-01T19:56:03.680337+0000", 2023-08-01T19:56:03.714 INFO:teuthology.orchestra.run.smithi155.stdout: "duration": 3.7579999999999998e-06 2023-08-01T19:56:03.714 INFO:teuthology.orchestra.run.smithi155.stdout: }, 2023-08-01T19:56:03.715 INFO:teuthology.orchestra.run.smithi155.stdout: { 2023-08-01T19:56:03.715 INFO:teuthology.orchestra.run.smithi155.stdout: "event": "dispatched", 2023-08-01T19:56:03.715 INFO:teuthology.orchestra.run.smithi155.stdout: "time": "2023-08-01T19:56:03.680345+0000", 2023-08-01T19:56:03.715 INFO:teuthology.orchestra.run.smithi155.stdout: "duration": 7.7940000000000003e-06 2023-08-01T19:56:03.715 INFO:teuthology.orchestra.run.smithi155.stdout: }, 2023-08-01T19:56:03.715 INFO:teuthology.orchestra.run.smithi155.stdout: { 2023-08-01T19:56:03.715 INFO:teuthology.orchestra.run.smithi155.stdout: "event": "queued_for_pg", 2023-08-01T19:56:03.716 INFO:teuthology.orchestra.run.smithi155.stdout: "time": "2023-08-01T19:56:03.680349+0000", 2023-08-01T19:56:03.716 INFO:teuthology.orchestra.run.smithi155.stdout: "duration": 3.591e-06 2023-08-01T19:56:03.716 INFO:teuthology.orchestra.run.smithi155.stdout: }, 2023-08-01T19:56:03.716 INFO:teuthology.orchestra.run.smithi155.stdout: { 2023-08-01T19:56:03.716 INFO:teuthology.orchestra.run.smithi155.stdout: "event": "reached_pg", 2023-08-01T19:56:03.716 INFO:teuthology.orchestra.run.smithi155.stdout: "time": "2023-08-01T19:56:03.680377+0000", 2023-08-01T19:56:03.716 INFO:teuthology.orchestra.run.smithi155.stdout: "duration": 2.811e-05 2023-08-01T19:56:03.716 INFO:teuthology.orchestra.run.smithi155.stdout: }, 2023-08-01T19:56:03.717 INFO:teuthology.orchestra.run.smithi155.stdout: { 2023-08-01T19:56:03.717 INFO:teuthology.orchestra.run.smithi155.stdout: "event": "started", 2023-08-01T19:56:03.717 INFO:teuthology.orchestra.run.smithi155.stdout: "time": "2023-08-01T19:56:03.680452+0000", 2023-08-01T19:56:03.717 INFO:teuthology.orchestra.run.smithi155.stdout: "duration": 7.4937000000000004e-05 2023-08-01T19:56:03.717 INFO:teuthology.orchestra.run.smithi155.stdout: } 2023-08-01T19:56:03.717 INFO:teuthology.orchestra.run.smithi155.stdout: ] 2023-08-01T19:56:03.717 INFO:teuthology.orchestra.run.smithi155.stdout: } 2023-08-01T19:56:03.717 INFO:teuthology.orchestra.run.smithi155.stdout: }, 2023-08-01T19:56:03.718 INFO:teuthology.orchestra.run.smithi155.stdout: { 2023-08-01T19:56:03.718 INFO:teuthology.orchestra.run.smithi155.stdout: "description": "osd_op(client.4668.0:205869 5.0 5:048130bf:::benchmark_data_smithi006_114134_object72208:head [delete] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e65)", 2023-08-01T19:56:03.718 INFO:teuthology.orchestra.run.smithi155.stdout: "initiated_at": "2023-08-01T19:56:03.681233+0000", 2023-08-01T19:56:03.718 INFO:teuthology.orchestra.run.smithi155.stdout: "age": 0.0021001290000000001, 2023-08-01T19:56:03.718 INFO:teuthology.orchestra.run.smithi155.stdout: "duration": 0.0023057970000000001, 2023-08-01T19:56:03.718 INFO:teuthology.orchestra.run.smithi155.stdout: "type_data": { 2023-08-01T19:56:03.718 INFO:teuthology.orchestra.run.smithi155.stdout: "flag_point": "waiting for sub ops", 2023-08-01T19:56:03.719 INFO:teuthology.orchestra.run.smithi155.stdout: "client_info": { 2023-08-01T19:56:03.719 INFO:teuthology.orchestra.run.smithi155.stdout: "client": "client.4668", 2023-08-01T19:56:03.719 INFO:teuthology.orchestra.run.smithi155.stdout: "client_addr": "172.21.15.6:0/1709472247", 2023-08-01T19:56:03.719 INFO:teuthology.orchestra.run.smithi155.stdout: "tid": 205869 2023-08-01T19:56:03.719 INFO:teuthology.orchestra.run.smithi155.stdout: }, 2023-08-01T19:56:03.719 INFO:teuthology.orchestra.run.smithi155.stdout: "events": [ 2023-08-01T19:56:03.719 INFO:teuthology.orchestra.run.smithi155.stdout: { 2023-08-01T19:56:03.719 INFO:teuthology.orchestra.run.smithi155.stdout: "event": "initiated", 2023-08-01T19:56:03.720 INFO:teuthology.orchestra.run.smithi155.stdout: "time": "2023-08-01T19:56:03.681233+0000", 2023-08-01T19:56:03.720 INFO:teuthology.orchestra.run.smithi155.stdout: "duration": 0 2023-08-01T19:56:03.720 INFO:teuthology.orchestra.run.smithi155.stdout: }, 2023-08-01T19:56:03.720 INFO:teuthology.orchestra.run.smithi155.stdout: { 2023-08-01T19:56:03.720 INFO:teuthology.orchestra.run.smithi155.stdout: "event": "throttled", 2023-08-01T19:56:03.720 INFO:teuthology.orchestra.run.smithi155.stdout: "time": "2023-08-01T19:56:03.681233+0000", 2023-08-01T19:56:03.720 INFO:teuthology.orchestra.run.smithi155.stdout: "duration": 0 2023-08-01T19:56:03.720 INFO:teuthology.orchestra.run.smithi155.stdout: }, 2023-08-01T19:56:03.721 INFO:teuthology.orchestra.run.smithi155.stdout: { 2023-08-01T19:56:03.721 INFO:teuthology.orchestra.run.smithi155.stdout: "event": "header_read", 2023-08-01T19:56:03.721 INFO:teuthology.orchestra.run.smithi155.stdout: "time": "2023-08-01T19:56:03.681233+0000", 2023-08-01T19:56:03.721 INFO:teuthology.orchestra.run.smithi155.stdout: "duration": 4294967295.999999 2023-08-01T19:56:03.721 INFO:teuthology.orchestra.run.smithi155.stdout: }, 2023-08-01T19:56:03.721 INFO:teuthology.orchestra.run.smithi155.stdout: { 2023-08-01T19:56:03.721 INFO:teuthology.orchestra.run.smithi155.stdout: "event": "all_read", 2023-08-01T19:56:03.721 INFO:teuthology.orchestra.run.smithi155.stdout: "time": "2023-08-01T19:56:03.681238+0000", 2023-08-01T19:56:03.722 INFO:teuthology.orchestra.run.smithi155.stdout: "duration": 4.8010000000000003e-06 2023-08-01T19:56:03.722 INFO:teuthology.orchestra.run.smithi155.stdout: }, 2023-08-01T19:56:03.722 INFO:teuthology.orchestra.run.smithi155.stdout: { 2023-08-01T19:56:03.722 INFO:teuthology.orchestra.run.smithi155.stdout: "event": "dispatched", 2023-08-01T19:56:03.722 INFO:teuthology.orchestra.run.smithi155.stdout: "time": "2023-08-01T19:56:03.681249+0000", 2023-08-01T19:56:03.722 INFO:teuthology.orchestra.run.smithi155.stdout: "duration": 1.168e-05 2023-08-01T19:56:03.722 INFO:teuthology.orchestra.run.smithi155.stdout: }, 2023-08-01T19:56:03.723 INFO:teuthology.orchestra.run.smithi155.stdout: { 2023-08-01T19:56:03.723 INFO:teuthology.orchestra.run.smithi155.stdout: "event": "queued_for_pg", 2023-08-01T19:56:03.723 INFO:teuthology.orchestra.run.smithi155.stdout: "time": "2023-08-01T19:56:03.681255+0000", 2023-08-01T19:56:03.723 INFO:teuthology.orchestra.run.smithi155.stdout: "duration": 5.6149999999999996e-06 2023-08-01T19:56:03.723 INFO:teuthology.orchestra.run.smithi155.stdout: }, 2023-08-01T19:56:03.723 INFO:teuthology.orchestra.run.smithi155.stdout: { 2023-08-01T19:56:03.723 INFO:teuthology.orchestra.run.smithi155.stdout: "event": "reached_pg", 2023-08-01T19:56:03.723 INFO:teuthology.orchestra.run.smithi155.stdout: "time": "2023-08-01T19:56:03.681285+0000", 2023-08-01T19:56:03.724 INFO:teuthology.orchestra.run.smithi155.stdout: "duration": 3.0583999999999997e-05 2023-08-01T19:56:03.724 INFO:teuthology.orchestra.run.smithi155.stdout: }, 2023-08-01T19:56:03.724 INFO:teuthology.orchestra.run.smithi155.stdout: { 2023-08-01T19:56:03.724 INFO:teuthology.orchestra.run.smithi155.stdout: "event": "started", 2023-08-01T19:56:03.724 INFO:teuthology.orchestra.run.smithi155.stdout: "time": "2023-08-01T19:56:03.681361+0000", 2023-08-01T19:56:03.724 INFO:teuthology.orchestra.run.smithi155.stdout: "duration": 7.6032999999999995e-05 2023-08-01T19:56:03.724 INFO:teuthology.orchestra.run.smithi155.stdout: }, 2023-08-01T19:56:03.724 INFO:teuthology.orchestra.run.smithi155.stdout: { 2023-08-01T19:56:03.725 INFO:teuthology.orchestra.run.smithi155.stdout: "event": "waiting for subops from 0", 2023-08-01T19:56:03.725 INFO:teuthology.orchestra.run.smithi155.stdout: "time": "2023-08-01T19:56:03.681422+0000", 2023-08-01T19:56:03.725 INFO:teuthology.orchestra.run.smithi155.stdout: "duration": 6.0103999999999999e-05 2023-08-01T19:56:03.725 INFO:teuthology.orchestra.run.smithi155.stdout: } 2023-08-01T19:56:03.725 INFO:teuthology.orchestra.run.smithi155.stdout: ] 2023-08-01T19:56:03.725 INFO:teuthology.orchestra.run.smithi155.stdout: } 2023-08-01T19:56:03.725 INFO:teuthology.orchestra.run.smithi155.stdout: }, 2023-08-01T19:56:03.725 INFO:teuthology.orchestra.run.smithi155.stdout: { 2023-08-01T19:56:03.726 INFO:teuthology.orchestra.run.smithi155.stdout: "description": "osd_op(client.4668.0:205871 5.b 5:d6d0d8c8:::benchmark_data_smithi006_114134_object72210:head [delete] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e65)", 2023-08-01T19:56:03.726 INFO:teuthology.orchestra.run.smithi155.stdout: "initiated_at": "2023-08-01T19:56:03.682093+0000", 2023-08-01T19:56:03.726 INFO:teuthology.orchestra.run.smithi155.stdout: "age": 0.001240307, 2023-08-01T19:56:03.726 INFO:teuthology.orchestra.run.smithi155.stdout: "duration": 0.001488395, 2023-08-01T19:56:03.726 INFO:teuthology.orchestra.run.smithi155.stdout: "type_data": { 2023-08-01T19:56:03.726 INFO:teuthology.orchestra.run.smithi155.stdout: "flag_point": "waiting for sub ops", 2023-08-01T19:56:03.726 INFO:teuthology.orchestra.run.smithi155.stdout: "client_info": { 2023-08-01T19:56:03.726 INFO:teuthology.orchestra.run.smithi155.stdout: "client": "client.4668", 2023-08-01T19:56:03.727 INFO:teuthology.orchestra.run.smithi155.stdout: "client_addr": "172.21.15.6:0/1709472247", 2023-08-01T19:56:03.727 INFO:teuthology.orchestra.run.smithi155.stdout: "tid": 205871 2023-08-01T19:56:03.727 INFO:teuthology.orchestra.run.smithi155.stdout: }, 2023-08-01T19:56:03.727 INFO:teuthology.orchestra.run.smithi155.stdout: "events": [ 2023-08-01T19:56:03.727 INFO:teuthology.orchestra.run.smithi155.stdout: { 2023-08-01T19:56:03.727 INFO:teuthology.orchestra.run.smithi155.stdout: "event": "initiated", 2023-08-01T19:56:03.727 INFO:teuthology.orchestra.run.smithi155.stdout: "time": "2023-08-01T19:56:03.682093+0000", 2023-08-01T19:56:03.728 INFO:teuthology.orchestra.run.smithi155.stdout: "duration": 0 2023-08-01T19:56:03.728 INFO:teuthology.orchestra.run.smithi155.stdout: }, 2023-08-01T19:56:03.728 INFO:teuthology.orchestra.run.smithi155.stdout: { 2023-08-01T19:56:03.728 INFO:teuthology.orchestra.run.smithi155.stdout: "event": "throttled", 2023-08-01T19:56:03.728 INFO:teuthology.orchestra.run.smithi155.stdout: "time": "2023-08-01T19:56:03.682093+0000", 2023-08-01T19:56:03.728 INFO:teuthology.orchestra.run.smithi155.stdout: "duration": 0 2023-08-01T19:56:03.728 INFO:teuthology.orchestra.run.smithi155.stdout: }, 2023-08-01T19:56:03.728 INFO:teuthology.orchestra.run.smithi155.stdout: { 2023-08-01T19:56:03.729 INFO:teuthology.orchestra.run.smithi155.stdout: "event": "header_read", 2023-08-01T19:56:03.729 INFO:teuthology.orchestra.run.smithi155.stdout: "time": "2023-08-01T19:56:03.682093+0000", 2023-08-01T19:56:03.729 INFO:teuthology.orchestra.run.smithi155.stdout: "duration": 4294967295.9999995 2023-08-01T19:56:03.729 INFO:teuthology.orchestra.run.smithi155.stdout: }, 2023-08-01T19:56:03.729 INFO:teuthology.orchestra.run.smithi155.stdout: { 2023-08-01T19:56:03.729 INFO:teuthology.orchestra.run.smithi155.stdout: "event": "all_read", 2023-08-01T19:56:03.729 INFO:teuthology.orchestra.run.smithi155.stdout: "time": "2023-08-01T19:56:03.682097+0000", 2023-08-01T19:56:03.729 INFO:teuthology.orchestra.run.smithi155.stdout: "duration": 4.1239999999999998e-06 2023-08-01T19:56:03.730 INFO:teuthology.orchestra.run.smithi155.stdout: }, 2023-08-01T19:56:03.730 INFO:teuthology.orchestra.run.smithi155.stdout: { 2023-08-01T19:56:03.730 INFO:teuthology.orchestra.run.smithi155.stdout: "event": "dispatched", 2023-08-01T19:56:03.730 INFO:teuthology.orchestra.run.smithi155.stdout: "time": "2023-08-01T19:56:03.682108+0000", 2023-08-01T19:56:03.730 INFO:teuthology.orchestra.run.smithi155.stdout: "duration": 1.0915e-05 2023-08-01T19:56:03.730 INFO:teuthology.orchestra.run.smithi155.stdout: }, 2023-08-01T19:56:03.730 INFO:teuthology.orchestra.run.smithi155.stdout: { 2023-08-01T19:56:03.730 INFO:teuthology.orchestra.run.smithi155.stdout: "event": "queued_for_pg", 2023-08-01T19:56:03.731 INFO:teuthology.orchestra.run.smithi155.stdout: "time": "2023-08-01T19:56:03.682112+0000", 2023-08-01T19:56:03.731 INFO:teuthology.orchestra.run.smithi155.stdout: "duration": 3.8240000000000001e-06 2023-08-01T19:56:03.731 INFO:teuthology.orchestra.run.smithi155.stdout: }, 2023-08-01T19:56:03.731 INFO:teuthology.orchestra.run.smithi155.stdout: { 2023-08-01T19:56:03.731 INFO:teuthology.orchestra.run.smithi155.stdout: "event": "reached_pg", 2023-08-01T19:56:03.731 INFO:teuthology.orchestra.run.smithi155.stdout: "time": "2023-08-01T19:56:03.682149+0000", 2023-08-01T19:56:03.731 INFO:teuthology.orchestra.run.smithi155.stdout: "duration": 3.7829e-05 2023-08-01T19:56:03.732 INFO:teuthology.orchestra.run.smithi155.stdout: }, 2023-08-01T19:56:03.732 INFO:teuthology.orchestra.run.smithi155.stdout: { 2023-08-01T19:56:03.732 INFO:teuthology.orchestra.run.smithi155.stdout: "event": "started", 2023-08-01T19:56:03.732 INFO:teuthology.orchestra.run.smithi155.stdout: "time": "2023-08-01T19:56:03.682275+0000", 2023-08-01T19:56:03.732 INFO:teuthology.orchestra.run.smithi155.stdout: "duration": 0.00012561699999999999 2023-08-01T19:56:03.732 INFO:teuthology.orchestra.run.smithi155.stdout: }, 2023-08-01T19:56:03.732 INFO:teuthology.orchestra.run.smithi155.stdout: { 2023-08-01T19:56:03.732 INFO:teuthology.orchestra.run.smithi155.stdout: "event": "waiting for subops from 0", 2023-08-01T19:56:03.733 INFO:teuthology.orchestra.run.smithi155.stdout: "time": "2023-08-01T19:56:03.682391+0000", 2023-08-01T19:56:03.733 INFO:teuthology.orchestra.run.smithi155.stdout: "duration": 0.000115858 2023-08-01T19:56:03.733 INFO:teuthology.orchestra.run.smithi155.stdout: } 2023-08-01T19:56:03.733 INFO:teuthology.orchestra.run.smithi155.stdout: ] 2023-08-01T19:56:03.733 INFO:teuthology.orchestra.run.smithi155.stdout: } 2023-08-01T19:56:03.733 INFO:teuthology.orchestra.run.smithi155.stdout: }, 2023-08-01T19:56:03.733 INFO:teuthology.orchestra.run.smithi155.stdout: { 2023-08-01T19:56:03.733 INFO:teuthology.orchestra.run.smithi155.stdout: "description": "osd_op(client.4668.0:205872 5.0 5:09cb9357:::benchmark_data_smithi006_114134_object72211:head [delete] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e65)", 2023-08-01T19:56:03.734 INFO:teuthology.orchestra.run.smithi155.stdout: "initiated_at": "2023-08-01T19:56:03.682119+0000", 2023-08-01T19:56:03.734 INFO:teuthology.orchestra.run.smithi155.stdout: "age": 0.0012145560000000001, 2023-08-01T19:56:03.734 INFO:teuthology.orchestra.run.smithi155.stdout: "duration": 0.0015053149999999999, 2023-08-01T19:56:03.734 INFO:teuthology.orchestra.run.smithi155.stdout: "type_data": { 2023-08-01T19:56:03.734 INFO:teuthology.orchestra.run.smithi155.stdout: "flag_point": "waiting for sub ops", 2023-08-01T19:56:03.734 INFO:teuthology.orchestra.run.smithi155.stdout: "client_info": { 2023-08-01T19:56:03.734 INFO:teuthology.orchestra.run.smithi155.stdout: "client": "client.4668", 2023-08-01T19:56:03.735 INFO:teuthology.orchestra.run.smithi155.stdout: "client_addr": "172.21.15.6:0/1709472247", 2023-08-01T19:56:03.735 INFO:teuthology.orchestra.run.smithi155.stdout: "tid": 205872 2023-08-01T19:56:03.735 INFO:teuthology.orchestra.run.smithi155.stdout: }, 2023-08-01T19:56:03.735 INFO:teuthology.orchestra.run.smithi155.stdout: "events": [ 2023-08-01T19:56:03.735 INFO:teuthology.orchestra.run.smithi155.stdout: { 2023-08-01T19:56:03.735 INFO:teuthology.orchestra.run.smithi155.stdout: "event": "initiated", 2023-08-01T19:56:03.735 INFO:teuthology.orchestra.run.smithi155.stdout: "time": "2023-08-01T19:56:03.682119+0000", 2023-08-01T19:56:03.735 INFO:teuthology.orchestra.run.smithi155.stdout: "duration": 0 2023-08-01T19:56:03.736 INFO:teuthology.orchestra.run.smithi155.stdout: }, 2023-08-01T19:56:03.736 INFO:teuthology.orchestra.run.smithi155.stdout: { 2023-08-01T19:56:03.736 INFO:teuthology.orchestra.run.smithi155.stdout: "event": "throttled", 2023-08-01T19:56:03.736 INFO:teuthology.orchestra.run.smithi155.stdout: "time": "2023-08-01T19:56:03.682119+0000", 2023-08-01T19:56:03.736 INFO:teuthology.orchestra.run.smithi155.stdout: "duration": 0 2023-08-01T19:56:03.736 INFO:teuthology.orchestra.run.smithi155.stdout: }, 2023-08-01T19:56:03.736 INFO:teuthology.orchestra.run.smithi155.stdout: { 2023-08-01T19:56:03.736 INFO:teuthology.orchestra.run.smithi155.stdout: "event": "header_read", 2023-08-01T19:56:03.737 INFO:teuthology.orchestra.run.smithi155.stdout: "time": "2023-08-01T19:56:03.682119+0000", 2023-08-01T19:56:03.737 INFO:teuthology.orchestra.run.smithi155.stdout: "duration": 4294967295.9999995 2023-08-01T19:56:03.737 INFO:teuthology.orchestra.run.smithi155.stdout: }, 2023-08-01T19:56:03.737 INFO:teuthology.orchestra.run.smithi155.stdout: { 2023-08-01T19:56:03.737 INFO:teuthology.orchestra.run.smithi155.stdout: "event": "all_read", 2023-08-01T19:56:03.737 INFO:teuthology.orchestra.run.smithi155.stdout: "time": "2023-08-01T19:56:03.682121+0000", 2023-08-01T19:56:03.737 INFO:teuthology.orchestra.run.smithi155.stdout: "duration": 1.9690000000000001e-06 2023-08-01T19:56:03.737 INFO:teuthology.orchestra.run.smithi155.stdout: }, 2023-08-01T19:56:03.738 INFO:teuthology.orchestra.run.smithi155.stdout: { 2023-08-01T19:56:03.738 INFO:teuthology.orchestra.run.smithi155.stdout: "event": "dispatched", 2023-08-01T19:56:03.738 INFO:teuthology.orchestra.run.smithi155.stdout: "time": "2023-08-01T19:56:03.682124+0000", 2023-08-01T19:56:03.738 INFO:teuthology.orchestra.run.smithi155.stdout: "duration": 3.7689999999999998e-06 2023-08-01T19:56:03.738 INFO:teuthology.orchestra.run.smithi155.stdout: }, 2023-08-01T19:56:03.738 INFO:teuthology.orchestra.run.smithi155.stdout: { 2023-08-01T19:56:03.738 INFO:teuthology.orchestra.run.smithi155.stdout: "event": "queued_for_pg", 2023-08-01T19:56:03.739 INFO:teuthology.orchestra.run.smithi155.stdout: "time": "2023-08-01T19:56:03.682127+0000", 2023-08-01T19:56:03.739 INFO:teuthology.orchestra.run.smithi155.stdout: "duration": 2.1900000000000002e-06 2023-08-01T19:56:03.739 INFO:teuthology.orchestra.run.smithi155.stdout: }, 2023-08-01T19:56:03.739 INFO:teuthology.orchestra.run.smithi155.stdout: { 2023-08-01T19:56:03.739 INFO:teuthology.orchestra.run.smithi155.stdout: "event": "reached_pg", 2023-08-01T19:56:03.739 INFO:teuthology.orchestra.run.smithi155.stdout: "time": "2023-08-01T19:56:03.682527+0000", 2023-08-01T19:56:03.739 INFO:teuthology.orchestra.run.smithi155.stdout: "duration": 0.00040061600000000001 2023-08-01T19:56:03.739 INFO:teuthology.orchestra.run.smithi155.stdout: }, 2023-08-01T19:56:03.740 INFO:teuthology.orchestra.run.smithi155.stdout: { 2023-08-01T19:56:03.740 INFO:teuthology.orchestra.run.smithi155.stdout: "event": "started", 2023-08-01T19:56:03.740 INFO:teuthology.orchestra.run.smithi155.stdout: "time": "2023-08-01T19:56:03.682631+0000", 2023-08-01T19:56:03.740 INFO:teuthology.orchestra.run.smithi155.stdout: "duration": 0.000103899 2023-08-01T19:56:03.740 INFO:teuthology.orchestra.run.smithi155.stdout: }, 2023-08-01T19:56:03.740 INFO:teuthology.orchestra.run.smithi155.stdout: { 2023-08-01T19:56:03.740 INFO:teuthology.orchestra.run.smithi155.stdout: "event": "waiting for subops from 0", 2023-08-01T19:56:03.740 INFO:teuthology.orchestra.run.smithi155.stdout: "time": "2023-08-01T19:56:03.682738+0000", 2023-08-01T19:56:03.741 INFO:teuthology.orchestra.run.smithi155.stdout: "duration": 0.000106777 2023-08-01T19:56:03.741 INFO:teuthology.orchestra.run.smithi155.stdout: } 2023-08-01T19:56:03.741 INFO:teuthology.orchestra.run.smithi155.stdout: ] 2023-08-01T19:56:03.741 INFO:teuthology.orchestra.run.smithi155.stdout: } 2023-08-01T19:56:03.742 INFO:teuthology.orchestra.run.smithi155.stdout: }, 2023-08-01T19:56:03.742 INFO:teuthology.orchestra.run.smithi155.stdout: { 2023-08-01T19:56:03.742 INFO:teuthology.orchestra.run.smithi155.stdout: "description": "osd_op(client.4668.0:205873 5.8 5:1fa5551e:::benchmark_data_smithi006_114134_object72212:head [delete] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e65)", 2023-08-01T19:56:03.742 INFO:teuthology.orchestra.run.smithi155.stdout: "initiated_at": "2023-08-01T19:56:03.682130+0000", 2023-08-01T19:56:03.742 INFO:teuthology.orchestra.run.smithi155.stdout: "age": 0.001203254, 2023-08-01T19:56:03.742 INFO:teuthology.orchestra.run.smithi155.stdout: "duration": 0.001538298, 2023-08-01T19:56:03.742 INFO:teuthology.orchestra.run.smithi155.stdout: "type_data": { 2023-08-01T19:56:03.742 INFO:teuthology.orchestra.run.smithi155.stdout: "flag_point": "waiting for sub ops", 2023-08-01T19:56:03.743 INFO:teuthology.orchestra.run.smithi155.stdout: "client_info": { 2023-08-01T19:56:03.743 INFO:teuthology.orchestra.run.smithi155.stdout: "client": "client.4668", 2023-08-01T19:56:03.743 INFO:teuthology.orchestra.run.smithi155.stdout: "client_addr": "172.21.15.6:0/1709472247", 2023-08-01T19:56:03.743 INFO:teuthology.orchestra.run.smithi155.stdout: "tid": 205873 2023-08-01T19:56:03.743 INFO:teuthology.orchestra.run.smithi155.stdout: }, 2023-08-01T19:56:03.743 INFO:teuthology.orchestra.run.smithi155.stdout: "events": [ 2023-08-01T19:56:03.743 INFO:teuthology.orchestra.run.smithi155.stdout: { 2023-08-01T19:56:03.744 INFO:teuthology.orchestra.run.smithi155.stdout: "event": "initiated", 2023-08-01T19:56:03.744 INFO:teuthology.orchestra.run.smithi155.stdout: "time": "2023-08-01T19:56:03.682130+0000", 2023-08-01T19:56:03.744 INFO:teuthology.orchestra.run.smithi155.stdout: "duration": 0 2023-08-01T19:56:03.744 INFO:teuthology.orchestra.run.smithi155.stdout: }, 2023-08-01T19:56:03.744 INFO:teuthology.orchestra.run.smithi155.stdout: { 2023-08-01T19:56:03.744 INFO:teuthology.orchestra.run.smithi155.stdout: "event": "throttled", 2023-08-01T19:56:03.744 INFO:teuthology.orchestra.run.smithi155.stdout: "time": "2023-08-01T19:56:03.682130+0000", 2023-08-01T19:56:03.744 INFO:teuthology.orchestra.run.smithi155.stdout: "duration": 0 2023-08-01T19:56:03.745 INFO:teuthology.orchestra.run.smithi155.stdout: }, 2023-08-01T19:56:03.745 INFO:teuthology.orchestra.run.smithi155.stdout: { 2023-08-01T19:56:03.745 INFO:teuthology.orchestra.run.smithi155.stdout: "event": "header_read", 2023-08-01T19:56:03.745 INFO:teuthology.orchestra.run.smithi155.stdout: "time": "2023-08-01T19:56:03.682130+0000", 2023-08-01T19:56:03.745 INFO:teuthology.orchestra.run.smithi155.stdout: "duration": 4294967296 2023-08-01T19:56:03.745 INFO:teuthology.orchestra.run.smithi155.stdout: }, 2023-08-01T19:56:03.745 INFO:teuthology.orchestra.run.smithi155.stdout: { 2023-08-01T19:56:03.745 INFO:teuthology.orchestra.run.smithi155.stdout: "event": "all_read", 2023-08-01T19:56:03.746 INFO:teuthology.orchestra.run.smithi155.stdout: "time": "2023-08-01T19:56:03.682132+0000", 2023-08-01T19:56:03.746 INFO:teuthology.orchestra.run.smithi155.stdout: "duration": 1.4649999999999999e-06 2023-08-01T19:56:03.746 INFO:teuthology.orchestra.run.smithi155.stdout: }, 2023-08-01T19:56:03.746 INFO:teuthology.orchestra.run.smithi155.stdout: { 2023-08-01T19:56:03.746 INFO:teuthology.orchestra.run.smithi155.stdout: "event": "dispatched", 2023-08-01T19:56:03.746 INFO:teuthology.orchestra.run.smithi155.stdout: "time": "2023-08-01T19:56:03.682137+0000", 2023-08-01T19:56:03.746 INFO:teuthology.orchestra.run.smithi155.stdout: "duration": 5.0679999999999996e-06 2023-08-01T19:56:03.747 INFO:teuthology.orchestra.run.smithi155.stdout: }, 2023-08-01T19:56:03.747 INFO:teuthology.orchestra.run.smithi155.stdout: { 2023-08-01T19:56:03.747 INFO:teuthology.orchestra.run.smithi155.stdout: "event": "queued_for_pg", 2023-08-01T19:56:03.747 INFO:teuthology.orchestra.run.smithi155.stdout: "time": "2023-08-01T19:56:03.682140+0000", 2023-08-01T19:56:03.747 INFO:teuthology.orchestra.run.smithi155.stdout: "duration": 3.591e-06 2023-08-01T19:56:03.747 INFO:teuthology.orchestra.run.smithi155.stdout: }, 2023-08-01T19:56:03.747 INFO:teuthology.orchestra.run.smithi155.stdout: { 2023-08-01T19:56:03.747 INFO:teuthology.orchestra.run.smithi155.stdout: "event": "reached_pg", 2023-08-01T19:56:03.748 INFO:teuthology.orchestra.run.smithi155.stdout: "time": "2023-08-01T19:56:03.682519+0000", 2023-08-01T19:56:03.748 INFO:teuthology.orchestra.run.smithi155.stdout: "duration": 0.00037882299999999997 2023-08-01T19:56:03.748 INFO:teuthology.orchestra.run.smithi155.stdout: }, 2023-08-01T19:56:03.748 INFO:teuthology.orchestra.run.smithi155.stdout: { 2023-08-01T19:56:03.748 INFO:teuthology.orchestra.run.smithi155.stdout: "event": "started", 2023-08-01T19:56:03.748 INFO:teuthology.orchestra.run.smithi155.stdout: "time": "2023-08-01T19:56:03.682631+0000", 2023-08-01T19:56:03.748 INFO:teuthology.orchestra.run.smithi155.stdout: "duration": 0.000111833 2023-08-01T19:56:03.749 INFO:teuthology.orchestra.run.smithi155.stdout: }, 2023-08-01T19:56:03.749 INFO:teuthology.orchestra.run.smithi155.stdout: { 2023-08-01T19:56:03.749 INFO:teuthology.orchestra.run.smithi155.stdout: "event": "waiting for subops from 0", 2023-08-01T19:56:03.749 INFO:teuthology.orchestra.run.smithi155.stdout: "time": "2023-08-01T19:56:03.682738+0000", 2023-08-01T19:56:03.749 INFO:teuthology.orchestra.run.smithi155.stdout: "duration": 0.000107018 2023-08-01T19:56:03.749 INFO:teuthology.orchestra.run.smithi155.stdout: } 2023-08-01T19:56:03.749 INFO:teuthology.orchestra.run.smithi155.stdout: ] 2023-08-01T19:56:03.749 INFO:teuthology.orchestra.run.smithi155.stdout: } 2023-08-01T19:56:03.750 INFO:teuthology.orchestra.run.smithi155.stdout: }, 2023-08-01T19:56:03.750 INFO:teuthology.orchestra.run.smithi155.stdout: { 2023-08-01T19:56:03.750 INFO:teuthology.orchestra.run.smithi155.stdout: "description": "osd_op(client.4668.0:205874 5.0 5.77d0eb0 (undecoded) ondisk+write+known_if_redirected+supports_pool_eio e65)", 2023-08-01T19:56:03.750 INFO:teuthology.orchestra.run.smithi155.stdout: "initiated_at": "2023-08-01T19:56:03.682144+0000", 2023-08-01T19:56:03.750 INFO:teuthology.orchestra.run.smithi155.stdout: "age": 0.001189364, 2023-08-01T19:56:03.750 INFO:teuthology.orchestra.run.smithi155.stdout: "duration": 0.0015654289999999999, 2023-08-01T19:56:03.750 INFO:teuthology.orchestra.run.smithi155.stdout: "type_data": { 2023-08-01T19:56:03.750 INFO:teuthology.orchestra.run.smithi155.stdout: "flag_point": "queued for pg", 2023-08-01T19:56:03.751 INFO:teuthology.orchestra.run.smithi155.stdout: "client_info": { 2023-08-01T19:56:03.751 INFO:teuthology.orchestra.run.smithi155.stdout: "client": "client.4668", 2023-08-01T19:56:03.751 INFO:teuthology.orchestra.run.smithi155.stdout: "client_addr": "172.21.15.6:0/1709472247", 2023-08-01T19:56:03.751 INFO:teuthology.orchestra.run.smithi155.stdout: "tid": 205874 2023-08-01T19:56:03.751 INFO:teuthology.orchestra.run.smithi155.stdout: }, 2023-08-01T19:56:03.751 INFO:teuthology.orchestra.run.smithi155.stdout: "events": [ 2023-08-01T19:56:03.751 INFO:teuthology.orchestra.run.smithi155.stdout: { 2023-08-01T19:56:03.751 INFO:teuthology.orchestra.run.smithi155.stdout: "event": "initiated", 2023-08-01T19:56:03.752 INFO:teuthology.orchestra.run.smithi155.stdout: "time": "2023-08-01T19:56:03.682144+0000", 2023-08-01T19:56:03.752 INFO:teuthology.orchestra.run.smithi155.stdout: "duration": 0 2023-08-01T19:56:03.752 INFO:teuthology.orchestra.run.smithi155.stdout: }, 2023-08-01T19:56:03.752 INFO:teuthology.orchestra.run.smithi155.stdout: { 2023-08-01T19:56:03.752 INFO:teuthology.orchestra.run.smithi155.stdout: "event": "throttled", 2023-08-01T19:56:03.752 INFO:teuthology.orchestra.run.smithi155.stdout: "time": "2023-08-01T19:56:03.682144+0000", 2023-08-01T19:56:03.752 INFO:teuthology.orchestra.run.smithi155.stdout: "duration": 0 2023-08-01T19:56:03.753 INFO:teuthology.orchestra.run.smithi155.stdout: }, 2023-08-01T19:56:03.754 INFO:teuthology.orchestra.run.smithi155.stdout: { 2023-08-01T19:56:03.754 INFO:teuthology.orchestra.run.smithi155.stdout: "event": "header_read", 2023-08-01T19:56:03.754 INFO:teuthology.orchestra.run.smithi155.stdout: "time": "2023-08-01T19:56:03.682144+0000", 2023-08-01T19:56:03.754 INFO:teuthology.orchestra.run.smithi155.stdout: "duration": 4294967295.9999995 2023-08-01T19:56:03.754 INFO:teuthology.orchestra.run.smithi155.stdout: }, 2023-08-01T19:56:03.755 INFO:teuthology.orchestra.run.smithi155.stdout: { 2023-08-01T19:56:03.755 INFO:teuthology.orchestra.run.smithi155.stdout: "event": "all_read", 2023-08-01T19:56:03.755 INFO:teuthology.orchestra.run.smithi155.stdout: "time": "2023-08-01T19:56:03.682146+0000", 2023-08-01T19:56:03.755 INFO:teuthology.orchestra.run.smithi155.stdout: "duration": 2.4169999999999999e-06 2023-08-01T19:56:03.755 INFO:teuthology.orchestra.run.smithi155.stdout: }, 2023-08-01T19:56:03.755 INFO:teuthology.orchestra.run.smithi155.stdout: { 2023-08-01T19:56:03.755 INFO:teuthology.orchestra.run.smithi155.stdout: "event": "dispatched", 2023-08-01T19:56:03.756 INFO:teuthology.orchestra.run.smithi155.stdout: "time": "2023-08-01T19:56:03.682150+0000", 2023-08-01T19:56:03.756 INFO:teuthology.orchestra.run.smithi155.stdout: "duration": 3.715e-06 2023-08-01T19:56:03.756 INFO:teuthology.orchestra.run.smithi155.stdout: }, 2023-08-01T19:56:03.756 INFO:teuthology.orchestra.run.smithi155.stdout: { 2023-08-01T19:56:03.756 INFO:teuthology.orchestra.run.smithi155.stdout: "event": "queued_for_pg", 2023-08-01T19:56:03.756 INFO:teuthology.orchestra.run.smithi155.stdout: "time": "2023-08-01T19:56:03.682152+0000", 2023-08-01T19:56:03.757 INFO:teuthology.orchestra.run.smithi155.stdout: "duration": 2.2050000000000001e-06 2023-08-01T19:56:03.757 INFO:teuthology.orchestra.run.smithi155.stdout: } 2023-08-01T19:56:03.757 INFO:teuthology.orchestra.run.smithi155.stdout: ] 2023-08-01T19:56:03.757 INFO:teuthology.orchestra.run.smithi155.stdout: } 2023-08-01T19:56:03.757 INFO:teuthology.orchestra.run.smithi155.stdout: } 2023-08-01T19:56:03.757 INFO:teuthology.orchestra.run.smithi155.stdout: ], 2023-08-01T19:56:03.757 INFO:teuthology.orchestra.run.smithi155.stdout: "num_ops": 9 2023-08-01T19:56:03.757 INFO:teuthology.orchestra.run.smithi155.stdout:} 2023-08-01T19:56:03.758 INFO:teuthology.orchestra.console.smithi101:Power off completed 2023-08-01T19:56:03.759 DEBUG:teuthology.orchestra.run.smithi155:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 30 ceph --cluster ceph --admin-daemon /var/run/ceph/ceph-osd.2.asok dump_blocked_ops 2023-08-01T19:56:03.760 INFO:tasks.ceph.osd.2.smithi155.stderr:2023-08-01T19:56:03.757+0000 7faa5c6ac700 -1 received signal: Hangup from /usr/bin/python3 /bin/daemon-helper kill ceph-osd -f --cluster ceph -i 2 (PID: 111337) UID: 0 2023-08-01T19:56:03.860 INFO:tasks.daemonwatchdog.daemon_watchdog:daemon ceph.osd.1 is failed for ~0s 2023-08-01T19:56:03.860 INFO:tasks.ceph.osd.0.smithi008.stderr:2023-08-01T19:56:03.858+0000 7f16a58f4700 -1 received signal: Hangup from /usr/bin/python3 /bin/daemon-helper kill ceph-osd -f --cluster ceph -i 0 (PID: 111179) UID: 0 2023-08-01T19:56:03.962 INFO:tasks.ceph.osd.0.smithi008.stderr:2023-08-01T19:56:03.959+0000 7f16a58f4700 -1 received signal: Hangup from /usr/bin/python3 /bin/daemon-helper kill ceph-osd -f --cluster ceph -i 0 (PID: 111179) UID: 0 2023-08-01T19:56:03.966 INFO:teuthology.orchestra.run.smithi155.stdout:{ 2023-08-01T19:56:03.966 INFO:teuthology.orchestra.run.smithi155.stdout: "ops": [], 2023-08-01T19:56:03.966 INFO:teuthology.orchestra.run.smithi155.stdout: "complaint_time": 30, 2023-08-01T19:56:03.966 INFO:teuthology.orchestra.run.smithi155.stdout: "num_blocked_ops": 0 2023-08-01T19:56:03.967 INFO:teuthology.orchestra.run.smithi155.stdout:} 2023-08-01T19:56:03.980 DEBUG:teuthology.orchestra.run.smithi155:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 30 ceph --cluster ceph --admin-daemon /var/run/ceph/ceph-osd.2.asok dump_historic_ops 2023-08-01T19:56:04.061 INFO:tasks.ceph.osd.2.smithi155.stderr:2023-08-01T19:56:04.059+0000 7faa5c6ac700 -1 received signal: Hangup from /usr/bin/python3 /bin/daemon-helper kill ceph-osd -f --cluster ceph -i 2 (PID: 111337) UID: 0 2023-08-01T19:56:04.135 DEBUG:teuthology.orchestra.run.smithi006:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 120 ceph --cluster ceph -- tell 'osd.*' injectargs --osd_enable_op_tracker=false 2023-08-01T19:56:04.149 INFO:teuthology.orchestra.run.smithi155.stdout:{ 2023-08-01T19:56:04.149 INFO:teuthology.orchestra.run.smithi155.stdout: "size": 20, 2023-08-01T19:56:04.149 INFO:teuthology.orchestra.run.smithi155.stdout: "duration": 600, 2023-08-01T19:56:04.150 INFO:teuthology.orchestra.run.smithi155.stdout: "ops": [ 2023-08-01T19:56:04.150 INFO:teuthology.orchestra.run.smithi155.stdout: { 2023-08-01T19:56:04.150 INFO:teuthology.orchestra.run.smithi155.stdout: "description": "osd_op(client.4668.0:100237 5.4 5:2d68bec9:::benchmark_data_smithi006_114134_object100236:head [set-alloc-hint object_size 65536 write_size 65536,write 0~65536] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e37)", 2023-08-01T19:56:04.150 INFO:teuthology.orchestra.run.smithi155.stdout: "initiated_at": "2023-08-01T19:55:05.147736+0000", 2023-08-01T19:56:04.150 INFO:teuthology.orchestra.run.smithi155.stdout: "age": 58.999019842000003, 2023-08-01T19:56:04.150 INFO:teuthology.orchestra.run.smithi155.stdout: "duration": 0.071299464000000007, 2023-08-01T19:56:04.150 INFO:teuthology.orchestra.run.smithi155.stdout: "type_data": { 2023-08-01T19:56:04.151 INFO:teuthology.orchestra.run.smithi155.stdout: "flag_point": "commit sent; apply or cleanup", 2023-08-01T19:56:04.151 INFO:teuthology.orchestra.run.smithi155.stdout: "client_info": { 2023-08-01T19:56:04.151 INFO:teuthology.orchestra.run.smithi155.stdout: "client": "client.4668", 2023-08-01T19:56:04.151 INFO:teuthology.orchestra.run.smithi155.stdout: "client_addr": "172.21.15.6:0/1709472247", 2023-08-01T19:56:04.151 INFO:teuthology.orchestra.run.smithi155.stdout: "tid": 100237 2023-08-01T19:56:04.151 INFO:teuthology.orchestra.run.smithi155.stdout: }, 2023-08-01T19:56:04.151 INFO:teuthology.orchestra.run.smithi155.stdout: "events": [ 2023-08-01T19:56:04.151 INFO:teuthology.orchestra.run.smithi155.stdout: { 2023-08-01T19:56:04.152 INFO:teuthology.orchestra.run.smithi155.stdout: "event": "initiated", 2023-08-01T19:56:04.152 INFO:teuthology.orchestra.run.smithi155.stdout: "time": "2023-08-01T19:55:05.147736+0000", 2023-08-01T19:56:04.152 INFO:teuthology.orchestra.run.smithi155.stdout: "duration": 0 2023-08-01T19:56:04.152 INFO:teuthology.orchestra.run.smithi155.stdout: }, 2023-08-01T19:56:04.152 INFO:teuthology.orchestra.run.smithi155.stdout: { 2023-08-01T19:56:04.152 INFO:teuthology.orchestra.run.smithi155.stdout: "event": "throttled", 2023-08-01T19:56:04.153 INFO:teuthology.orchestra.run.smithi155.stdout: "time": "2023-08-01T19:55:05.147736+0000", 2023-08-01T19:56:04.153 INFO:teuthology.orchestra.run.smithi155.stdout: "duration": 0 2023-08-01T19:56:04.153 INFO:teuthology.orchestra.run.smithi155.stdout: }, 2023-08-01T19:56:04.153 INFO:teuthology.orchestra.run.smithi155.stdout: { 2023-08-01T19:56:04.153 INFO:teuthology.orchestra.run.smithi155.stdout: "event": "header_read", 2023-08-01T19:56:04.153 INFO:teuthology.orchestra.run.smithi155.stdout: "time": "2023-08-01T19:55:05.147736+0000", 2023-08-01T19:56:04.153 INFO:teuthology.orchestra.run.smithi155.stdout: "duration": 4294967295.9999995 2023-08-01T19:56:04.154 INFO:teuthology.orchestra.run.smithi155.stdout: }, 2023-08-01T19:56:04.154 INFO:teuthology.orchestra.run.smithi155.stdout: { 2023-08-01T19:56:04.154 INFO:teuthology.orchestra.run.smithi155.stdout: "event": "all_read", 2023-08-01T19:56:04.154 INFO:teuthology.orchestra.run.smithi155.stdout: "time": "2023-08-01T19:55:05.147766+0000", 2023-08-01T19:56:04.154 INFO:teuthology.orchestra.run.smithi155.stdout: "duration": 3.0394000000000001e-05 2023-08-01T19:56:04.154 INFO:teuthology.orchestra.run.smithi155.stdout: }, 2023-08-01T19:56:04.154 INFO:teuthology.orchestra.run.smithi155.stdout: { 2023-08-01T19:56:04.154 INFO:teuthology.orchestra.run.smithi155.stdout: "event": "dispatched", 2023-08-01T19:56:04.155 INFO:teuthology.orchestra.run.smithi155.stdout: "time": "2023-08-01T19:55:05.147771+0000", 2023-08-01T19:56:04.155 INFO:teuthology.orchestra.run.smithi155.stdout: "duration": 4.25e-06 2023-08-01T19:56:04.155 INFO:teuthology.orchestra.run.smithi155.stdout: }, 2023-08-01T19:56:04.155 INFO:teuthology.orchestra.run.smithi155.stdout: { 2023-08-01T19:56:04.155 INFO:teuthology.orchestra.run.smithi155.stdout: "event": "queued_for_pg", 2023-08-01T19:56:04.155 INFO:teuthology.orchestra.run.smithi155.stdout: "time": "2023-08-01T19:55:05.147773+0000", 2023-08-01T19:56:04.155 INFO:teuthology.orchestra.run.smithi155.stdout: "duration": 2.4159999999999998e-06 2023-08-01T19:56:04.155 INFO:teuthology.orchestra.run.smithi155.stdout: }, 2023-08-01T19:56:04.156 INFO:teuthology.orchestra.run.smithi155.stdout: { 2023-08-01T19:56:04.156 INFO:teuthology.orchestra.run.smithi155.stdout: "event": "reached_pg", 2023-08-01T19:56:04.156 INFO:teuthology.orchestra.run.smithi155.stdout: "time": "2023-08-01T19:55:05.149903+0000", 2023-08-01T19:56:04.156 INFO:teuthology.orchestra.run.smithi155.stdout: "duration": 0.002129948 2023-08-01T19:56:04.156 INFO:teuthology.orchestra.run.smithi155.stdout: }, 2023-08-01T19:56:04.156 INFO:teuthology.orchestra.run.smithi155.stdout: { 2023-08-01T19:56:04.156 INFO:teuthology.orchestra.run.smithi155.stdout: "event": "started", 2023-08-01T19:56:04.157 INFO:teuthology.orchestra.run.smithi155.stdout: "time": "2023-08-01T19:55:05.149982+0000", 2023-08-01T19:56:04.157 INFO:teuthology.orchestra.run.smithi155.stdout: "duration": 7.8706000000000002e-05 2023-08-01T19:56:04.157 INFO:teuthology.orchestra.run.smithi155.stdout: }, 2023-08-01T19:56:04.157 INFO:teuthology.orchestra.run.smithi155.stdout: { 2023-08-01T19:56:04.157 INFO:teuthology.orchestra.run.smithi155.stdout: "event": "waiting for subops from 0", 2023-08-01T19:56:04.157 INFO:teuthology.orchestra.run.smithi155.stdout: "time": "2023-08-01T19:55:05.150066+0000", 2023-08-01T19:56:04.157 INFO:teuthology.orchestra.run.smithi155.stdout: "duration": 8.4241999999999997e-05 2023-08-01T19:56:04.158 INFO:teuthology.orchestra.run.smithi155.stdout: }, 2023-08-01T19:56:04.158 INFO:teuthology.orchestra.run.smithi155.stdout: { 2023-08-01T19:56:04.158 INFO:teuthology.orchestra.run.smithi155.stdout: "event": "op_commit", 2023-08-01T19:56:04.158 INFO:teuthology.orchestra.run.smithi155.stdout: "time": "2023-08-01T19:55:05.154994+0000", 2023-08-01T19:56:04.158 INFO:teuthology.orchestra.run.smithi155.stdout: "duration": 0.0049277050000000001 2023-08-01T19:56:04.158 INFO:teuthology.orchestra.run.smithi155.stdout: }, 2023-08-01T19:56:04.158 INFO:teuthology.orchestra.run.smithi155.stdout: { 2023-08-01T19:56:04.158 INFO:teuthology.orchestra.run.smithi155.stdout: "event": "sub_op_commit_rec", 2023-08-01T19:56:04.159 INFO:teuthology.orchestra.run.smithi155.stdout: "time": "2023-08-01T19:55:05.218933+0000", 2023-08-01T19:56:04.159 INFO:teuthology.orchestra.run.smithi155.stdout: "duration": 0.063939916999999999 2023-08-01T19:56:04.159 INFO:teuthology.orchestra.run.smithi155.stdout: }, 2023-08-01T19:56:04.159 INFO:teuthology.orchestra.run.smithi155.stdout: { 2023-08-01T19:56:04.159 INFO:teuthology.orchestra.run.smithi155.stdout: "event": "commit_sent", 2023-08-01T19:56:04.159 INFO:teuthology.orchestra.run.smithi155.stdout: "time": "2023-08-01T19:55:05.218989+0000", 2023-08-01T19:56:04.159 INFO:teuthology.orchestra.run.smithi155.stdout: "duration": 5.5772000000000001e-05 2023-08-01T19:56:04.160 INFO:teuthology.orchestra.run.smithi155.stdout: }, 2023-08-01T19:56:04.160 INFO:teuthology.orchestra.run.smithi155.stdout: { 2023-08-01T19:56:04.160 INFO:teuthology.orchestra.run.smithi155.stdout: "event": "done", 2023-08-01T19:56:04.160 INFO:teuthology.orchestra.run.smithi155.stdout: "time": "2023-08-01T19:55:05.219036+0000", 2023-08-01T19:56:04.160 INFO:teuthology.orchestra.run.smithi155.stdout: "duration": 4.6526000000000001e-05 2023-08-01T19:56:04.160 INFO:teuthology.orchestra.run.smithi155.stdout: } 2023-08-01T19:56:04.160 INFO:teuthology.orchestra.run.smithi155.stdout: ] 2023-08-01T19:56:04.160 INFO:teuthology.orchestra.run.smithi155.stdout: } 2023-08-01T19:56:04.161 INFO:teuthology.orchestra.run.smithi155.stdout: }, 2023-08-01T19:56:04.161 INFO:teuthology.orchestra.run.smithi155.stdout: { 2023-08-01T19:56:04.161 INFO:teuthology.orchestra.run.smithi155.stdout: "description": "osd_op(client.4668.0:100242 5.8 5:16a314b8:::benchmark_data_smithi006_114134_object100241:head [set-alloc-hint object_size 65536 write_size 65536,write 0~65536] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e37)", 2023-08-01T19:56:04.161 INFO:teuthology.orchestra.run.smithi155.stdout: "initiated_at": "2023-08-01T19:55:05.150616+0000", 2023-08-01T19:56:04.161 INFO:teuthology.orchestra.run.smithi155.stdout: "age": 58.996140212, 2023-08-01T19:56:04.161 INFO:teuthology.orchestra.run.smithi155.stdout: "duration": 0.071105065999999995, 2023-08-01T19:56:04.161 INFO:teuthology.orchestra.run.smithi155.stdout: "type_data": { 2023-08-01T19:56:04.162 INFO:teuthology.orchestra.run.smithi155.stdout: "flag_point": "commit sent; apply or cleanup", 2023-08-01T19:56:04.162 INFO:teuthology.orchestra.run.smithi155.stdout: "client_info": { 2023-08-01T19:56:04.162 INFO:teuthology.orchestra.run.smithi155.stdout: "client": "client.4668", 2023-08-01T19:56:04.162 INFO:teuthology.orchestra.run.smithi155.stdout: "client_addr": "172.21.15.6:0/1709472247", 2023-08-01T19:56:04.162 INFO:teuthology.orchestra.run.smithi155.stdout: "tid": 100242 2023-08-01T19:56:04.162 INFO:teuthology.orchestra.run.smithi155.stdout: }, 2023-08-01T19:56:04.162 INFO:teuthology.orchestra.run.smithi155.stdout: "events": [ 2023-08-01T19:56:04.162 INFO:teuthology.orchestra.run.smithi155.stdout: { 2023-08-01T19:56:04.163 INFO:teuthology.orchestra.run.smithi155.stdout: "event": "initiated", 2023-08-01T19:56:04.163 INFO:teuthology.orchestra.run.smithi155.stdout: "time": "2023-08-01T19:55:05.150616+0000", 2023-08-01T19:56:04.163 INFO:teuthology.orchestra.run.smithi155.stdout: "duration": 0 2023-08-01T19:56:04.163 INFO:teuthology.orchestra.run.smithi155.stdout: }, 2023-08-01T19:56:04.163 INFO:teuthology.orchestra.run.smithi155.stdout: { 2023-08-01T19:56:04.163 INFO:teuthology.orchestra.run.smithi155.stdout: "event": "throttled", 2023-08-01T19:56:04.163 INFO:teuthology.orchestra.run.smithi155.stdout: "time": "2023-08-01T19:55:05.150616+0000", 2023-08-01T19:56:04.164 INFO:teuthology.orchestra.run.smithi155.stdout: "duration": 0 2023-08-01T19:56:04.164 INFO:teuthology.orchestra.run.smithi155.stdout: }, 2023-08-01T19:56:04.164 INFO:teuthology.orchestra.run.smithi155.stdout: { 2023-08-01T19:56:04.164 INFO:teuthology.orchestra.run.smithi155.stdout: "event": "header_read", 2023-08-01T19:56:04.164 INFO:teuthology.orchestra.run.smithi155.stdout: "time": "2023-08-01T19:55:05.150615+0000", 2023-08-01T19:56:04.164 INFO:teuthology.orchestra.run.smithi155.stdout: "duration": 4294967295.999999 2023-08-01T19:56:04.164 INFO:teuthology.orchestra.run.smithi155.stdout: }, 2023-08-01T19:56:04.164 INFO:teuthology.orchestra.run.smithi155.stdout: { 2023-08-01T19:56:04.165 INFO:teuthology.orchestra.run.smithi155.stdout: "event": "all_read", 2023-08-01T19:56:04.165 INFO:teuthology.orchestra.run.smithi155.stdout: "time": "2023-08-01T19:55:05.150696+0000", 2023-08-01T19:56:04.165 INFO:teuthology.orchestra.run.smithi155.stdout: "duration": 8.0852000000000004e-05 2023-08-01T19:56:04.165 INFO:teuthology.orchestra.run.smithi155.stdout: }, 2023-08-01T19:56:04.165 INFO:teuthology.orchestra.run.smithi155.stdout: { 2023-08-01T19:56:04.165 INFO:teuthology.orchestra.run.smithi155.stdout: "event": "dispatched", 2023-08-01T19:56:04.165 INFO:teuthology.orchestra.run.smithi155.stdout: "time": "2023-08-01T19:55:05.150708+0000", 2023-08-01T19:56:04.165 INFO:teuthology.orchestra.run.smithi155.stdout: "duration": 1.2116999999999999e-05 2023-08-01T19:56:04.166 INFO:teuthology.orchestra.run.smithi155.stdout: }, 2023-08-01T19:56:04.166 INFO:teuthology.orchestra.run.smithi155.stdout: { 2023-08-01T19:56:04.166 INFO:teuthology.orchestra.run.smithi155.stdout: "event": "queued_for_pg", 2023-08-01T19:56:04.166 INFO:teuthology.orchestra.run.smithi155.stdout: "time": "2023-08-01T19:55:05.150713+0000", 2023-08-01T19:56:04.166 INFO:teuthology.orchestra.run.smithi155.stdout: "duration": 5.4620000000000004e-06 2023-08-01T19:56:04.166 INFO:teuthology.orchestra.run.smithi155.stdout: }, 2023-08-01T19:56:04.166 INFO:teuthology.orchestra.run.smithi155.stdout: { 2023-08-01T19:56:04.167 INFO:teuthology.orchestra.run.smithi155.stdout: "event": "reached_pg", 2023-08-01T19:56:04.167 INFO:teuthology.orchestra.run.smithi155.stdout: "time": "2023-08-01T19:55:05.150761+0000", 2023-08-01T19:56:04.167 INFO:teuthology.orchestra.run.smithi155.stdout: "duration": 4.7429000000000003e-05 2023-08-01T19:56:04.167 INFO:teuthology.orchestra.run.smithi155.stdout: }, 2023-08-01T19:56:04.167 INFO:teuthology.orchestra.run.smithi155.stdout: { 2023-08-01T19:56:04.167 INFO:teuthology.orchestra.run.smithi155.stdout: "event": "started", 2023-08-01T19:56:04.167 INFO:teuthology.orchestra.run.smithi155.stdout: "time": "2023-08-01T19:55:05.150856+0000", 2023-08-01T19:56:04.167 INFO:teuthology.orchestra.run.smithi155.stdout: "duration": 9.5356e-05 2023-08-01T19:56:04.168 INFO:teuthology.orchestra.run.smithi155.stdout: }, 2023-08-01T19:56:04.168 INFO:teuthology.orchestra.run.smithi155.stdout: { 2023-08-01T19:56:04.168 INFO:teuthology.orchestra.run.smithi155.stdout: "event": "waiting for subops from 0", 2023-08-01T19:56:04.168 INFO:teuthology.orchestra.run.smithi155.stdout: "time": "2023-08-01T19:55:05.150999+0000", 2023-08-01T19:56:04.168 INFO:teuthology.orchestra.run.smithi155.stdout: "duration": 0.00014234499999999999 2023-08-01T19:56:04.168 INFO:teuthology.orchestra.run.smithi155.stdout: }, 2023-08-01T19:56:04.168 INFO:teuthology.orchestra.run.smithi155.stdout: { 2023-08-01T19:56:04.168 INFO:teuthology.orchestra.run.smithi155.stdout: "event": "sub_op_commit_rec", 2023-08-01T19:56:04.169 INFO:teuthology.orchestra.run.smithi155.stdout: "time": "2023-08-01T19:55:05.219001+0000", 2023-08-01T19:56:04.169 INFO:teuthology.orchestra.run.smithi155.stdout: "duration": 0.068002776000000001 2023-08-01T19:56:04.169 INFO:teuthology.orchestra.run.smithi155.stdout: }, 2023-08-01T19:56:04.169 INFO:teuthology.orchestra.run.smithi155.stdout: { 2023-08-01T19:56:04.169 INFO:teuthology.orchestra.run.smithi155.stdout: "event": "op_commit", 2023-08-01T19:56:04.169 INFO:teuthology.orchestra.run.smithi155.stdout: "time": "2023-08-01T19:55:05.221635+0000", 2023-08-01T19:56:04.169 INFO:teuthology.orchestra.run.smithi155.stdout: "duration": 0.0026340579999999999 2023-08-01T19:56:04.170 INFO:teuthology.orchestra.run.smithi155.stdout: }, 2023-08-01T19:56:04.170 INFO:teuthology.orchestra.run.smithi155.stdout: { 2023-08-01T19:56:04.170 INFO:teuthology.orchestra.run.smithi155.stdout: "event": "commit_sent", 2023-08-01T19:56:04.170 INFO:teuthology.orchestra.run.smithi155.stdout: "time": "2023-08-01T19:55:05.221682+0000", 2023-08-01T19:56:04.170 INFO:teuthology.orchestra.run.smithi155.stdout: "duration": 4.7123999999999998e-05 2023-08-01T19:56:04.170 INFO:teuthology.orchestra.run.smithi155.stdout: }, 2023-08-01T19:56:04.170 INFO:teuthology.orchestra.run.smithi155.stdout: { 2023-08-01T19:56:04.170 INFO:teuthology.orchestra.run.smithi155.stdout: "event": "done", 2023-08-01T19:56:04.171 INFO:teuthology.orchestra.run.smithi155.stdout: "time": "2023-08-01T19:55:05.221721+0000", 2023-08-01T19:56:04.171 INFO:teuthology.orchestra.run.smithi155.stdout: "duration": 3.8529999999999999e-05 2023-08-01T19:56:04.171 INFO:teuthology.orchestra.run.smithi155.stdout: } 2023-08-01T19:56:04.171 INFO:teuthology.orchestra.run.smithi155.stdout: ] 2023-08-01T19:56:04.171 INFO:teuthology.orchestra.run.smithi155.stdout: } 2023-08-01T19:56:04.171 INFO:teuthology.orchestra.run.smithi155.stdout: }, 2023-08-01T19:56:04.171 INFO:teuthology.orchestra.run.smithi155.stdout: { 2023-08-01T19:56:04.171 INFO:teuthology.orchestra.run.smithi155.stdout: "description": "osd_repop(client.4668.0:100240 5.a e37/19 5:5313c5b9:::benchmark_data_smithi006_114134_object100239:head v 37'6227, mlcod=37'6225)", 2023-08-01T19:56:04.172 INFO:teuthology.orchestra.run.smithi155.stdout: "initiated_at": "2023-08-01T19:55:05.150778+0000", 2023-08-01T19:56:04.172 INFO:teuthology.orchestra.run.smithi155.stdout: "age": 58.995978010999998, 2023-08-01T19:56:04.172 INFO:teuthology.orchestra.run.smithi155.stdout: "duration": 0.073362533999999993, 2023-08-01T19:56:04.172 INFO:teuthology.orchestra.run.smithi155.stdout: "type_data": { 2023-08-01T19:56:04.172 INFO:teuthology.orchestra.run.smithi155.stdout: "flag_point": "commit sent; apply or cleanup", 2023-08-01T19:56:04.172 INFO:teuthology.orchestra.run.smithi155.stdout: "events": [ 2023-08-01T19:56:04.172 INFO:teuthology.orchestra.run.smithi155.stdout: { 2023-08-01T19:56:04.173 INFO:teuthology.orchestra.run.smithi155.stdout: "event": "initiated", 2023-08-01T19:56:04.173 INFO:teuthology.orchestra.run.smithi155.stdout: "time": "2023-08-01T19:55:05.150778+0000", 2023-08-01T19:56:04.173 INFO:teuthology.orchestra.run.smithi155.stdout: "duration": 0 2023-08-01T19:56:04.173 INFO:teuthology.orchestra.run.smithi155.stdout: }, 2023-08-01T19:56:04.173 INFO:teuthology.orchestra.run.smithi155.stdout: { 2023-08-01T19:56:04.173 INFO:teuthology.orchestra.run.smithi155.stdout: "event": "throttled", 2023-08-01T19:56:04.173 INFO:teuthology.orchestra.run.smithi155.stdout: "time": "2023-08-01T19:55:05.150778+0000", 2023-08-01T19:56:04.173 INFO:teuthology.orchestra.run.smithi155.stdout: "duration": 0 2023-08-01T19:56:04.174 INFO:teuthology.orchestra.run.smithi155.stdout: }, 2023-08-01T19:56:04.174 INFO:teuthology.orchestra.run.smithi155.stdout: { 2023-08-01T19:56:04.174 INFO:teuthology.orchestra.run.smithi155.stdout: "event": "header_read", 2023-08-01T19:56:04.174 INFO:teuthology.orchestra.run.smithi155.stdout: "time": "2023-08-01T19:55:05.150778+0000", 2023-08-01T19:56:04.174 INFO:teuthology.orchestra.run.smithi155.stdout: "duration": 4294967295.9999995 2023-08-01T19:56:04.174 INFO:teuthology.orchestra.run.smithi155.stdout: }, 2023-08-01T19:56:04.174 INFO:teuthology.orchestra.run.smithi155.stdout: { 2023-08-01T19:56:04.174 INFO:teuthology.orchestra.run.smithi155.stdout: "event": "all_read", 2023-08-01T19:56:04.175 INFO:teuthology.orchestra.run.smithi155.stdout: "time": "2023-08-01T19:55:05.150811+0000", 2023-08-01T19:56:04.175 INFO:teuthology.orchestra.run.smithi155.stdout: "duration": 3.3664000000000002e-05 2023-08-01T19:56:04.175 INFO:teuthology.orchestra.run.smithi155.stdout: }, 2023-08-01T19:56:04.175 INFO:teuthology.orchestra.run.smithi155.stdout: { 2023-08-01T19:56:04.175 INFO:teuthology.orchestra.run.smithi155.stdout: "event": "dispatched", 2023-08-01T19:56:04.176 INFO:teuthology.orchestra.run.smithi155.stdout: "time": "2023-08-01T19:55:05.150818+0000", 2023-08-01T19:56:04.176 INFO:teuthology.orchestra.run.smithi155.stdout: "duration": 6.5769999999999999e-06 2023-08-01T19:56:04.176 INFO:teuthology.orchestra.run.smithi155.stdout: }, 2023-08-01T19:56:04.176 INFO:teuthology.orchestra.run.smithi155.stdout: { 2023-08-01T19:56:04.176 INFO:teuthology.orchestra.run.smithi155.stdout: "event": "queued_for_pg", 2023-08-01T19:56:04.176 INFO:teuthology.orchestra.run.smithi155.stdout: "time": "2023-08-01T19:55:05.150822+0000", 2023-08-01T19:56:04.177 INFO:teuthology.orchestra.run.smithi155.stdout: "duration": 4.0060000000000003e-06 2023-08-01T19:56:04.177 INFO:teuthology.orchestra.run.smithi155.stdout: }, 2023-08-01T19:56:04.177 INFO:teuthology.orchestra.run.smithi155.stdout: { 2023-08-01T19:56:04.177 INFO:teuthology.orchestra.run.smithi155.stdout: "event": "reached_pg", 2023-08-01T19:56:04.177 INFO:teuthology.orchestra.run.smithi155.stdout: "time": "2023-08-01T19:55:05.150855+0000", 2023-08-01T19:56:04.177 INFO:teuthology.orchestra.run.smithi155.stdout: "duration": 3.3204999999999998e-05 2023-08-01T19:56:04.177 INFO:teuthology.orchestra.run.smithi155.stdout: }, 2023-08-01T19:56:04.178 INFO:teuthology.orchestra.run.smithi155.stdout: { 2023-08-01T19:56:04.178 INFO:teuthology.orchestra.run.smithi155.stdout: "event": "started", 2023-08-01T19:56:04.178 INFO:teuthology.orchestra.run.smithi155.stdout: "time": "2023-08-01T19:55:05.150873+0000", 2023-08-01T19:56:04.178 INFO:teuthology.orchestra.run.smithi155.stdout: "duration": 1.8139999999999999e-05 2023-08-01T19:56:04.178 INFO:teuthology.orchestra.run.smithi155.stdout: }, 2023-08-01T19:56:04.178 INFO:teuthology.orchestra.run.smithi155.stdout: { 2023-08-01T19:56:04.178 INFO:teuthology.orchestra.run.smithi155.stdout: "event": "commit_sent", 2023-08-01T19:56:04.178 INFO:teuthology.orchestra.run.smithi155.stdout: "time": "2023-08-01T19:55:05.224095+0000", 2023-08-01T19:56:04.179 INFO:teuthology.orchestra.run.smithi155.stdout: "duration": 0.073221895999999995 2023-08-01T19:56:04.179 INFO:teuthology.orchestra.run.smithi155.stdout: }, 2023-08-01T19:56:04.179 INFO:teuthology.orchestra.run.smithi155.stdout: { 2023-08-01T19:56:04.179 INFO:teuthology.orchestra.run.smithi155.stdout: "event": "done", 2023-08-01T19:56:04.179 INFO:teuthology.orchestra.run.smithi155.stdout: "time": "2023-08-01T19:55:05.224141+0000", 2023-08-01T19:56:04.179 INFO:teuthology.orchestra.run.smithi155.stdout: "duration": 4.5385e-05 2023-08-01T19:56:04.179 INFO:teuthology.orchestra.run.smithi155.stdout: } 2023-08-01T19:56:04.179 INFO:teuthology.orchestra.run.smithi155.stdout: ] 2023-08-01T19:56:04.180 INFO:teuthology.orchestra.run.smithi155.stdout: } 2023-08-01T19:56:04.180 INFO:teuthology.orchestra.run.smithi155.stdout: }, 2023-08-01T19:56:04.180 INFO:teuthology.orchestra.run.smithi155.stdout: { 2023-08-01T19:56:04.180 INFO:teuthology.orchestra.run.smithi155.stdout: "description": "osd_op(client.4668.0:100245 5.e 5:71869c66:::benchmark_data_smithi006_114134_object100244:head [set-alloc-hint object_size 65536 write_size 65536,write 0~65536] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e37)", 2023-08-01T19:56:04.180 INFO:teuthology.orchestra.run.smithi155.stdout: "initiated_at": "2023-08-01T19:55:05.150991+0000", 2023-08-01T19:56:04.180 INFO:teuthology.orchestra.run.smithi155.stdout: "age": 58.995765224000003, 2023-08-01T19:56:04.180 INFO:teuthology.orchestra.run.smithi155.stdout: "duration": 0.070734490999999997, 2023-08-01T19:56:04.181 INFO:teuthology.orchestra.run.smithi155.stdout: "type_data": { 2023-08-01T19:56:04.181 INFO:teuthology.orchestra.run.smithi155.stdout: "flag_point": "commit sent; apply or cleanup", 2023-08-01T19:56:04.181 INFO:teuthology.orchestra.run.smithi155.stdout: "client_info": { 2023-08-01T19:56:04.181 INFO:teuthology.orchestra.run.smithi155.stdout: "client": "client.4668", 2023-08-01T19:56:04.181 INFO:teuthology.orchestra.run.smithi155.stdout: "client_addr": "172.21.15.6:0/1709472247", 2023-08-01T19:56:04.181 INFO:teuthology.orchestra.run.smithi155.stdout: "tid": 100245 2023-08-01T19:56:04.181 INFO:teuthology.orchestra.run.smithi155.stdout: }, 2023-08-01T19:56:04.181 INFO:teuthology.orchestra.run.smithi155.stdout: "events": [ 2023-08-01T19:56:04.182 INFO:teuthology.orchestra.run.smithi155.stdout: { 2023-08-01T19:56:04.182 INFO:teuthology.orchestra.run.smithi155.stdout: "event": "initiated", 2023-08-01T19:56:04.182 INFO:teuthology.orchestra.run.smithi155.stdout: "time": "2023-08-01T19:55:05.150991+0000", 2023-08-01T19:56:04.182 INFO:teuthology.orchestra.run.smithi155.stdout: "duration": 0 2023-08-01T19:56:04.182 INFO:teuthology.orchestra.run.smithi155.stdout: }, 2023-08-01T19:56:04.182 INFO:teuthology.orchestra.run.smithi155.stdout: { 2023-08-01T19:56:04.182 INFO:teuthology.orchestra.run.smithi155.stdout: "event": "throttled", 2023-08-01T19:56:04.183 INFO:teuthology.orchestra.run.smithi155.stdout: "time": "2023-08-01T19:55:05.150991+0000", 2023-08-01T19:56:04.183 INFO:teuthology.orchestra.run.smithi155.stdout: "duration": 0 2023-08-01T19:56:04.183 INFO:teuthology.orchestra.run.smithi155.stdout: }, 2023-08-01T19:56:04.183 INFO:teuthology.orchestra.run.smithi155.stdout: { 2023-08-01T19:56:04.183 INFO:teuthology.orchestra.run.smithi155.stdout: "event": "header_read", 2023-08-01T19:56:04.183 INFO:teuthology.orchestra.run.smithi155.stdout: "time": "2023-08-01T19:55:05.150990+0000", 2023-08-01T19:56:04.183 INFO:teuthology.orchestra.run.smithi155.stdout: "duration": 4294967295.999999 2023-08-01T19:56:04.184 INFO:teuthology.orchestra.run.smithi155.stdout: }, 2023-08-01T19:56:04.184 INFO:teuthology.orchestra.run.smithi155.stdout: { 2023-08-01T19:56:04.184 INFO:teuthology.orchestra.run.smithi155.stdout: "event": "all_read", 2023-08-01T19:56:04.184 INFO:teuthology.orchestra.run.smithi155.stdout: "time": "2023-08-01T19:55:05.151108+0000", 2023-08-01T19:56:04.184 INFO:teuthology.orchestra.run.smithi155.stdout: "duration": 0.00011849300000000001 2023-08-01T19:56:04.184 INFO:teuthology.orchestra.run.smithi155.stdout: }, 2023-08-01T19:56:04.184 INFO:teuthology.orchestra.run.smithi155.stdout: { 2023-08-01T19:56:04.184 INFO:teuthology.orchestra.run.smithi155.stdout: "event": "dispatched", 2023-08-01T19:56:04.185 INFO:teuthology.orchestra.run.smithi155.stdout: "time": "2023-08-01T19:55:05.151117+0000", 2023-08-01T19:56:04.185 INFO:teuthology.orchestra.run.smithi155.stdout: "duration": 8.1040000000000007e-06 2023-08-01T19:56:04.185 INFO:teuthology.orchestra.run.smithi155.stdout: }, 2023-08-01T19:56:04.185 INFO:teuthology.orchestra.run.smithi155.stdout: { 2023-08-01T19:56:04.185 INFO:teuthology.orchestra.run.smithi155.stdout: "event": "queued_for_pg", 2023-08-01T19:56:04.185 INFO:teuthology.orchestra.run.smithi155.stdout: "time": "2023-08-01T19:55:05.151121+0000", 2023-08-01T19:56:04.185 INFO:teuthology.orchestra.run.smithi155.stdout: "duration": 4.2019999999999997e-06 2023-08-01T19:56:04.186 INFO:teuthology.orchestra.run.smithi155.stdout: }, 2023-08-01T19:56:04.186 INFO:teuthology.orchestra.run.smithi155.stdout: { 2023-08-01T19:56:04.186 INFO:teuthology.orchestra.run.smithi155.stdout: "event": "reached_pg", 2023-08-01T19:56:04.186 INFO:teuthology.orchestra.run.smithi155.stdout: "time": "2023-08-01T19:55:05.151162+0000", 2023-08-01T19:56:04.186 INFO:teuthology.orchestra.run.smithi155.stdout: "duration": 4.1448e-05 2023-08-01T19:56:04.186 INFO:teuthology.orchestra.run.smithi155.stdout: }, 2023-08-01T19:56:04.186 INFO:teuthology.orchestra.run.smithi155.stdout: { 2023-08-01T19:56:04.187 INFO:teuthology.orchestra.run.smithi155.stdout: "event": "started", 2023-08-01T19:56:04.187 INFO:teuthology.orchestra.run.smithi155.stdout: "time": "2023-08-01T19:55:05.151281+0000", 2023-08-01T19:56:04.187 INFO:teuthology.orchestra.run.smithi155.stdout: "duration": 0.000119141 2023-08-01T19:56:04.187 INFO:teuthology.orchestra.run.smithi155.stdout: }, 2023-08-01T19:56:04.187 INFO:teuthology.orchestra.run.smithi155.stdout: { 2023-08-01T19:56:04.187 INFO:teuthology.orchestra.run.smithi155.stdout: "event": "waiting for subops from 0", 2023-08-01T19:56:04.187 INFO:teuthology.orchestra.run.smithi155.stdout: "time": "2023-08-01T19:55:05.151443+0000", 2023-08-01T19:56:04.187 INFO:teuthology.orchestra.run.smithi155.stdout: "duration": 0.00016181600000000001 2023-08-01T19:56:04.188 INFO:teuthology.orchestra.run.smithi155.stdout: }, 2023-08-01T19:56:04.188 INFO:teuthology.orchestra.run.smithi155.stdout: { 2023-08-01T19:56:04.188 INFO:teuthology.orchestra.run.smithi155.stdout: "event": "sub_op_commit_rec", 2023-08-01T19:56:04.188 INFO:teuthology.orchestra.run.smithi155.stdout: "time": "2023-08-01T19:55:05.219101+0000", 2023-08-01T19:56:04.188 INFO:teuthology.orchestra.run.smithi155.stdout: "duration": 0.067658037000000004 2023-08-01T19:56:04.188 INFO:teuthology.orchestra.run.smithi155.stdout: }, 2023-08-01T19:56:04.188 INFO:teuthology.orchestra.run.smithi155.stdout: { 2023-08-01T19:56:04.189 INFO:teuthology.orchestra.run.smithi155.stdout: "event": "op_commit", 2023-08-01T19:56:04.189 INFO:teuthology.orchestra.run.smithi155.stdout: "time": "2023-08-01T19:55:05.221646+0000", 2023-08-01T19:56:04.189 INFO:teuthology.orchestra.run.smithi155.stdout: "duration": 0.0025450540000000002 2023-08-01T19:56:04.189 INFO:teuthology.orchestra.run.smithi155.stdout: }, 2023-08-01T19:56:04.189 INFO:teuthology.orchestra.run.smithi155.stdout: { 2023-08-01T19:56:04.189 INFO:teuthology.orchestra.run.smithi155.stdout: "event": "commit_sent", 2023-08-01T19:56:04.189 INFO:teuthology.orchestra.run.smithi155.stdout: "time": "2023-08-01T19:55:05.221689+0000", 2023-08-01T19:56:04.189 INFO:teuthology.orchestra.run.smithi155.stdout: "duration": 4.3078999999999999e-05 2023-08-01T19:56:04.190 INFO:teuthology.orchestra.run.smithi155.stdout: }, 2023-08-01T19:56:04.190 INFO:teuthology.orchestra.run.smithi155.stdout: { 2023-08-01T19:56:04.190 INFO:teuthology.orchestra.run.smithi155.stdout: "event": "done", 2023-08-01T19:56:04.190 INFO:teuthology.orchestra.run.smithi155.stdout: "time": "2023-08-01T19:55:05.221725+0000", 2023-08-01T19:56:04.190 INFO:teuthology.orchestra.run.smithi155.stdout: "duration": 3.6137999999999999e-05 2023-08-01T19:56:04.190 INFO:teuthology.orchestra.run.smithi155.stdout: } 2023-08-01T19:56:04.190 INFO:teuthology.orchestra.run.smithi155.stdout: ] 2023-08-01T19:56:04.191 INFO:teuthology.orchestra.run.smithi155.stdout: } 2023-08-01T19:56:04.191 INFO:teuthology.orchestra.run.smithi155.stdout: }, 2023-08-01T19:56:04.191 INFO:teuthology.orchestra.run.smithi155.stdout: { 2023-08-01T19:56:04.191 INFO:teuthology.orchestra.run.smithi155.stdout: "description": "osd_repop(client.4668.0:100243 5.a e37/19 5:5e8193b6:::benchmark_data_smithi006_114134_object100242:head v 37'6228, mlcod=37'6225)", 2023-08-01T19:56:04.191 INFO:teuthology.orchestra.run.smithi155.stdout: "initiated_at": "2023-08-01T19:55:05.151148+0000", 2023-08-01T19:56:04.191 INFO:teuthology.orchestra.run.smithi155.stdout: "age": 58.995608212999997, 2023-08-01T19:56:04.191 INFO:teuthology.orchestra.run.smithi155.stdout: "duration": 0.073020370000000001, 2023-08-01T19:56:04.192 INFO:teuthology.orchestra.run.smithi155.stdout: "type_data": { 2023-08-01T19:56:04.192 INFO:teuthology.orchestra.run.smithi155.stdout: "flag_point": "commit sent; apply or cleanup", 2023-08-01T19:56:04.192 INFO:teuthology.orchestra.run.smithi155.stdout: "events": [ 2023-08-01T19:56:04.192 INFO:teuthology.orchestra.run.smithi155.stdout: { 2023-08-01T19:56:04.192 INFO:teuthology.orchestra.run.smithi155.stdout: "event": "initiated", 2023-08-01T19:56:04.192 INFO:teuthology.orchestra.run.smithi155.stdout: "time": "2023-08-01T19:55:05.151148+0000", 2023-08-01T19:56:04.192 INFO:teuthology.orchestra.run.smithi155.stdout: "duration": 0 2023-08-01T19:56:04.192 INFO:teuthology.orchestra.run.smithi155.stdout: }, 2023-08-01T19:56:04.193 INFO:teuthology.orchestra.run.smithi155.stdout: { 2023-08-01T19:56:04.193 INFO:teuthology.orchestra.run.smithi155.stdout: "event": "throttled", 2023-08-01T19:56:04.193 INFO:teuthology.orchestra.run.smithi155.stdout: "time": "2023-08-01T19:55:05.151148+0000", 2023-08-01T19:56:04.193 INFO:teuthology.orchestra.run.smithi155.stdout: "duration": 0 2023-08-01T19:56:04.193 INFO:teuthology.orchestra.run.smithi155.stdout: }, 2023-08-01T19:56:04.193 INFO:teuthology.orchestra.run.smithi155.stdout: { 2023-08-01T19:56:04.193 INFO:teuthology.orchestra.run.smithi155.stdout: "event": "header_read", 2023-08-01T19:56:04.194 INFO:teuthology.orchestra.run.smithi155.stdout: "time": "2023-08-01T19:55:05.151147+0000", 2023-08-01T19:56:04.194 INFO:teuthology.orchestra.run.smithi155.stdout: "duration": 4294967295.9999995 2023-08-01T19:56:04.194 INFO:teuthology.orchestra.run.smithi155.stdout: }, 2023-08-01T19:56:04.194 INFO:teuthology.orchestra.run.smithi155.stdout: { 2023-08-01T19:56:04.194 INFO:teuthology.orchestra.run.smithi155.stdout: "event": "all_read", 2023-08-01T19:56:04.194 INFO:teuthology.orchestra.run.smithi155.stdout: "time": "2023-08-01T19:55:05.151231+0000", 2023-08-01T19:56:04.194 INFO:teuthology.orchestra.run.smithi155.stdout: "duration": 8.3135999999999998e-05 2023-08-01T19:56:04.195 INFO:teuthology.orchestra.run.smithi155.stdout: }, 2023-08-01T19:56:04.195 INFO:teuthology.orchestra.run.smithi155.stdout: { 2023-08-01T19:56:04.195 INFO:teuthology.orchestra.run.smithi155.stdout: "event": "dispatched", 2023-08-01T19:56:04.195 INFO:teuthology.orchestra.run.smithi155.stdout: "time": "2023-08-01T19:55:05.151239+0000", 2023-08-01T19:56:04.195 INFO:teuthology.orchestra.run.smithi155.stdout: "duration": 8.7469999999999994e-06 2023-08-01T19:56:04.195 INFO:teuthology.orchestra.run.smithi155.stdout: }, 2023-08-01T19:56:04.195 INFO:teuthology.orchestra.run.smithi155.stdout: { 2023-08-01T19:56:04.195 INFO:teuthology.orchestra.run.smithi155.stdout: "event": "queued_for_pg", 2023-08-01T19:56:04.196 INFO:teuthology.orchestra.run.smithi155.stdout: "time": "2023-08-01T19:55:05.151244+0000", 2023-08-01T19:56:04.196 INFO:teuthology.orchestra.run.smithi155.stdout: "duration": 4.4800000000000003e-06 2023-08-01T19:56:04.196 INFO:teuthology.orchestra.run.smithi155.stdout: }, 2023-08-01T19:56:04.196 INFO:teuthology.orchestra.run.smithi155.stdout: { 2023-08-01T19:56:04.196 INFO:teuthology.orchestra.run.smithi155.stdout: "event": "reached_pg", 2023-08-01T19:56:04.196 INFO:teuthology.orchestra.run.smithi155.stdout: "time": "2023-08-01T19:55:05.152938+0000", 2023-08-01T19:56:04.197 INFO:teuthology.orchestra.run.smithi155.stdout: "duration": 0.001693824 2023-08-01T19:56:04.197 INFO:teuthology.orchestra.run.smithi155.stdout: }, 2023-08-01T19:56:04.197 INFO:teuthology.orchestra.run.smithi155.stdout: { 2023-08-01T19:56:04.197 INFO:teuthology.orchestra.run.smithi155.stdout: "event": "started", 2023-08-01T19:56:04.197 INFO:teuthology.orchestra.run.smithi155.stdout: "time": "2023-08-01T19:55:05.152956+0000", 2023-08-01T19:56:04.197 INFO:teuthology.orchestra.run.smithi155.stdout: "duration": 1.8287e-05 2023-08-01T19:56:04.198 INFO:teuthology.orchestra.run.smithi155.stdout: }, 2023-08-01T19:56:04.198 INFO:teuthology.orchestra.run.smithi155.stdout: { 2023-08-01T19:56:04.198 INFO:teuthology.orchestra.run.smithi155.stdout: "event": "commit_sent", 2023-08-01T19:56:04.198 INFO:teuthology.orchestra.run.smithi155.stdout: "time": "2023-08-01T19:55:05.224145+0000", 2023-08-01T19:56:04.198 INFO:teuthology.orchestra.run.smithi155.stdout: "duration": 0.071189447000000003 2023-08-01T19:56:04.198 INFO:teuthology.orchestra.run.smithi155.stdout: }, 2023-08-01T19:56:04.198 INFO:teuthology.orchestra.run.smithi155.stdout: { 2023-08-01T19:56:04.199 INFO:teuthology.orchestra.run.smithi155.stdout: "event": "done", 2023-08-01T19:56:04.199 INFO:teuthology.orchestra.run.smithi155.stdout: "time": "2023-08-01T19:55:05.224168+0000", 2023-08-01T19:56:04.199 INFO:teuthology.orchestra.run.smithi155.stdout: "duration": 2.3008999999999999e-05 2023-08-01T19:56:04.199 INFO:teuthology.orchestra.run.smithi155.stdout: } 2023-08-01T19:56:04.199 INFO:teuthology.orchestra.run.smithi155.stdout: ] 2023-08-01T19:56:04.199 INFO:teuthology.orchestra.run.smithi155.stdout: } 2023-08-01T19:56:04.200 INFO:teuthology.orchestra.run.smithi155.stdout: }, 2023-08-01T19:56:04.200 INFO:teuthology.orchestra.run.smithi155.stdout: { 2023-08-01T19:56:04.200 INFO:teuthology.orchestra.run.smithi155.stdout: "description": "osd_repop(client.4668.0:100244 5.9 e37/19 5:92f56a12:::benchmark_data_smithi006_114134_object100243:head v 37'6294, mlcod=37'6292)", 2023-08-01T19:56:04.200 INFO:teuthology.orchestra.run.smithi155.stdout: "initiated_at": "2023-08-01T19:55:05.151325+0000", 2023-08-01T19:56:04.200 INFO:teuthology.orchestra.run.smithi155.stdout: "age": 58.995430868, 2023-08-01T19:56:04.200 INFO:teuthology.orchestra.run.smithi155.stdout: "duration": 0.071883673999999995, 2023-08-01T19:56:04.200 INFO:teuthology.orchestra.run.smithi155.stdout: "type_data": { 2023-08-01T19:56:04.201 INFO:teuthology.orchestra.run.smithi155.stdout: "flag_point": "commit sent; apply or cleanup", 2023-08-01T19:56:04.201 INFO:teuthology.orchestra.run.smithi155.stdout: "events": [ 2023-08-01T19:56:04.201 INFO:teuthology.orchestra.run.smithi155.stdout: { 2023-08-01T19:56:04.201 INFO:teuthology.orchestra.run.smithi155.stdout: "event": "initiated", 2023-08-01T19:56:04.201 INFO:teuthology.orchestra.run.smithi155.stdout: "time": "2023-08-01T19:55:05.151325+0000", 2023-08-01T19:56:04.201 INFO:teuthology.orchestra.run.smithi155.stdout: "duration": 0 2023-08-01T19:56:04.201 INFO:teuthology.orchestra.run.smithi155.stdout: }, 2023-08-01T19:56:04.202 INFO:teuthology.orchestra.run.smithi155.stdout: { 2023-08-01T19:56:04.202 INFO:teuthology.orchestra.run.smithi155.stdout: "event": "throttled", 2023-08-01T19:56:04.202 INFO:teuthology.orchestra.run.smithi155.stdout: "time": "2023-08-01T19:55:05.151325+0000", 2023-08-01T19:56:04.202 INFO:teuthology.orchestra.run.smithi155.stdout: "duration": 0 2023-08-01T19:56:04.202 INFO:teuthology.orchestra.run.smithi155.stdout: }, 2023-08-01T19:56:04.202 INFO:teuthology.orchestra.run.smithi155.stdout: { 2023-08-01T19:56:04.202 INFO:teuthology.orchestra.run.smithi155.stdout: "event": "header_read", 2023-08-01T19:56:04.202 INFO:teuthology.orchestra.run.smithi155.stdout: "time": "2023-08-01T19:55:05.151325+0000", 2023-08-01T19:56:04.203 INFO:teuthology.orchestra.run.smithi155.stdout: "duration": 4294967295.9999995 2023-08-01T19:56:04.203 INFO:teuthology.orchestra.run.smithi155.stdout: }, 2023-08-01T19:56:04.203 INFO:teuthology.orchestra.run.smithi155.stdout: { 2023-08-01T19:56:04.203 INFO:teuthology.orchestra.run.smithi155.stdout: "event": "all_read", 2023-08-01T19:56:04.203 INFO:teuthology.orchestra.run.smithi155.stdout: "time": "2023-08-01T19:55:05.151390+0000", 2023-08-01T19:56:04.203 INFO:teuthology.orchestra.run.smithi155.stdout: "duration": 6.5456999999999993e-05 2023-08-01T19:56:04.204 INFO:teuthology.orchestra.run.smithi155.stdout: }, 2023-08-01T19:56:04.204 INFO:teuthology.orchestra.run.smithi155.stdout: { 2023-08-01T19:56:04.204 INFO:teuthology.orchestra.run.smithi155.stdout: "event": "dispatched", 2023-08-01T19:56:04.204 INFO:teuthology.orchestra.run.smithi155.stdout: "time": "2023-08-01T19:55:05.151396+0000", 2023-08-01T19:56:04.204 INFO:teuthology.orchestra.run.smithi155.stdout: "duration": 5.9190000000000004e-06 2023-08-01T19:56:04.204 INFO:teuthology.orchestra.run.smithi155.stdout: }, 2023-08-01T19:56:04.204 INFO:teuthology.orchestra.run.smithi155.stdout: { 2023-08-01T19:56:04.204 INFO:teuthology.orchestra.run.smithi155.stdout: "event": "queued_for_pg", 2023-08-01T19:56:04.205 INFO:teuthology.orchestra.run.smithi155.stdout: "time": "2023-08-01T19:55:05.151400+0000", 2023-08-01T19:56:04.205 INFO:teuthology.orchestra.run.smithi155.stdout: "duration": 4.1030000000000004e-06 2023-08-01T19:56:04.205 INFO:teuthology.orchestra.run.smithi155.stdout: }, 2023-08-01T19:56:04.205 INFO:teuthology.orchestra.run.smithi155.stdout: { 2023-08-01T19:56:04.205 INFO:teuthology.orchestra.run.smithi155.stdout: "event": "reached_pg", 2023-08-01T19:56:04.205 INFO:teuthology.orchestra.run.smithi155.stdout: "time": "2023-08-01T19:55:05.151452+0000", 2023-08-01T19:56:04.206 INFO:teuthology.orchestra.run.smithi155.stdout: "duration": 5.2136999999999999e-05 2023-08-01T19:56:04.206 INFO:teuthology.orchestra.run.smithi155.stdout: }, 2023-08-01T19:56:04.206 INFO:teuthology.orchestra.run.smithi155.stdout: { 2023-08-01T19:56:04.206 INFO:teuthology.orchestra.run.smithi155.stdout: "event": "started", 2023-08-01T19:56:04.206 INFO:teuthology.orchestra.run.smithi155.stdout: "time": "2023-08-01T19:55:05.151470+0000", 2023-08-01T19:56:04.206 INFO:teuthology.orchestra.run.smithi155.stdout: "duration": 1.8e-05 2023-08-01T19:56:04.207 INFO:teuthology.orchestra.run.smithi155.stdout: }, 2023-08-01T19:56:04.207 INFO:teuthology.orchestra.run.smithi155.stdout: { 2023-08-01T19:56:04.207 INFO:teuthology.orchestra.run.smithi155.stdout: "event": "commit_sent", 2023-08-01T19:56:04.207 INFO:teuthology.orchestra.run.smithi155.stdout: "time": "2023-08-01T19:55:05.223183+0000", 2023-08-01T19:56:04.207 INFO:teuthology.orchestra.run.smithi155.stdout: "duration": 0.071712622000000004 2023-08-01T19:56:04.207 INFO:teuthology.orchestra.run.smithi155.stdout: }, 2023-08-01T19:56:04.208 INFO:teuthology.orchestra.run.smithi155.stdout: { 2023-08-01T19:56:04.208 INFO:teuthology.orchestra.run.smithi155.stdout: "event": "done", 2023-08-01T19:56:04.208 INFO:teuthology.orchestra.run.smithi155.stdout: "time": "2023-08-01T19:55:05.223209+0000", 2023-08-01T19:56:04.209 INFO:teuthology.orchestra.run.smithi155.stdout: "duration": 2.5956e-05 2023-08-01T19:56:04.209 INFO:teuthology.orchestra.run.smithi155.stdout: } 2023-08-01T19:56:04.209 INFO:teuthology.orchestra.run.smithi155.stdout: ] 2023-08-01T19:56:04.209 INFO:teuthology.orchestra.run.smithi155.stdout: } 2023-08-01T19:56:04.210 INFO:teuthology.orchestra.run.smithi155.stdout: }, 2023-08-01T19:56:04.210 INFO:teuthology.orchestra.run.smithi155.stdout: { 2023-08-01T19:56:04.210 INFO:teuthology.orchestra.run.smithi155.stdout: "description": "osd_op(client.4668.0:100249 5.b 5:d0666827:::benchmark_data_smithi006_114134_object100248:head [set-alloc-hint object_size 65536 write_size 65536,write 0~65536] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e37)", 2023-08-01T19:56:04.210 INFO:teuthology.orchestra.run.smithi155.stdout: "initiated_at": "2023-08-01T19:55:05.153614+0000", 2023-08-01T19:56:04.210 INFO:teuthology.orchestra.run.smithi155.stdout: "age": 58.993142442999996, 2023-08-01T19:56:04.211 INFO:teuthology.orchestra.run.smithi155.stdout: "duration": 0.069286118999999993, 2023-08-01T19:56:04.211 INFO:teuthology.orchestra.run.smithi155.stdout: "type_data": { 2023-08-01T19:56:04.211 INFO:teuthology.orchestra.run.smithi155.stdout: "flag_point": "commit sent; apply or cleanup", 2023-08-01T19:56:04.211 INFO:teuthology.orchestra.run.smithi155.stdout: "client_info": { 2023-08-01T19:56:04.212 INFO:teuthology.orchestra.run.smithi155.stdout: "client": "client.4668", 2023-08-01T19:56:04.212 INFO:teuthology.orchestra.run.smithi155.stdout: "client_addr": "172.21.15.6:0/1709472247", 2023-08-01T19:56:04.212 INFO:teuthology.orchestra.run.smithi155.stdout: "tid": 100249 2023-08-01T19:56:04.212 INFO:teuthology.orchestra.run.smithi155.stdout: }, 2023-08-01T19:56:04.212 INFO:teuthology.orchestra.run.smithi155.stdout: "events": [ 2023-08-01T19:56:04.212 INFO:teuthology.orchestra.run.smithi155.stdout: { 2023-08-01T19:56:04.212 INFO:teuthology.orchestra.run.smithi155.stdout: "event": "initiated", 2023-08-01T19:56:04.213 INFO:teuthology.orchestra.run.smithi155.stdout: "time": "2023-08-01T19:55:05.153614+0000", 2023-08-01T19:56:04.213 INFO:teuthology.orchestra.run.smithi155.stdout: "duration": 0 2023-08-01T19:56:04.213 INFO:teuthology.orchestra.run.smithi155.stdout: }, 2023-08-01T19:56:04.213 INFO:teuthology.orchestra.run.smithi155.stdout: { 2023-08-01T19:56:04.213 INFO:teuthology.orchestra.run.smithi155.stdout: "event": "throttled", 2023-08-01T19:56:04.213 INFO:teuthology.orchestra.run.smithi155.stdout: "time": "2023-08-01T19:55:05.153614+0000", 2023-08-01T19:56:04.214 INFO:teuthology.orchestra.run.smithi155.stdout: "duration": 0 2023-08-01T19:56:04.214 INFO:teuthology.orchestra.run.smithi155.stdout: }, 2023-08-01T19:56:04.214 INFO:teuthology.orchestra.run.smithi155.stdout: { 2023-08-01T19:56:04.214 INFO:teuthology.orchestra.run.smithi155.stdout: "event": "header_read", 2023-08-01T19:56:04.214 INFO:teuthology.orchestra.run.smithi155.stdout: "time": "2023-08-01T19:55:05.153612+0000", 2023-08-01T19:56:04.214 INFO:teuthology.orchestra.run.smithi155.stdout: "duration": 4294967295.9999986 2023-08-01T19:56:04.214 INFO:teuthology.orchestra.run.smithi155.stdout: }, 2023-08-01T19:56:04.215 INFO:teuthology.orchestra.run.smithi155.stdout: { 2023-08-01T19:56:04.215 INFO:teuthology.orchestra.run.smithi155.stdout: "event": "all_read", 2023-08-01T19:56:04.215 INFO:teuthology.orchestra.run.smithi155.stdout: "time": "2023-08-01T19:55:05.153694+0000", 2023-08-01T19:56:04.215 INFO:teuthology.orchestra.run.smithi155.stdout: "duration": 8.1618000000000004e-05 2023-08-01T19:56:04.215 INFO:teuthology.orchestra.run.smithi155.stdout: }, 2023-08-01T19:56:04.215 INFO:teuthology.orchestra.run.smithi155.stdout: { 2023-08-01T19:56:04.215 INFO:teuthology.orchestra.run.smithi155.stdout: "event": "dispatched", 2023-08-01T19:56:04.215 INFO:teuthology.orchestra.run.smithi155.stdout: "time": "2023-08-01T19:55:05.153713+0000", 2023-08-01T19:56:04.216 INFO:teuthology.orchestra.run.smithi155.stdout: "duration": 1.9069999999999999e-05 2023-08-01T19:56:04.216 INFO:teuthology.orchestra.run.smithi155.stdout: }, 2023-08-01T19:56:04.216 INFO:teuthology.orchestra.run.smithi155.stdout: { 2023-08-01T19:56:04.216 INFO:teuthology.orchestra.run.smithi155.stdout: "event": "queued_for_pg", 2023-08-01T19:56:04.216 INFO:teuthology.orchestra.run.smithi155.stdout: "time": "2023-08-01T19:55:05.153726+0000", 2023-08-01T19:56:04.216 INFO:teuthology.orchestra.run.smithi155.stdout: "duration": 1.238e-05 2023-08-01T19:56:04.216 INFO:teuthology.orchestra.run.smithi155.stdout: }, 2023-08-01T19:56:04.217 INFO:teuthology.orchestra.run.smithi155.stdout: { 2023-08-01T19:56:04.217 INFO:teuthology.orchestra.run.smithi155.stdout: "event": "reached_pg", 2023-08-01T19:56:04.217 INFO:teuthology.orchestra.run.smithi155.stdout: "time": "2023-08-01T19:55:05.153761+0000", 2023-08-01T19:56:04.217 INFO:teuthology.orchestra.run.smithi155.stdout: "duration": 3.5046999999999998e-05 2023-08-01T19:56:04.217 INFO:teuthology.orchestra.run.smithi155.stdout: }, 2023-08-01T19:56:04.217 INFO:teuthology.orchestra.run.smithi155.stdout: { 2023-08-01T19:56:04.217 INFO:teuthology.orchestra.run.smithi155.stdout: "event": "started", 2023-08-01T19:56:04.217 INFO:teuthology.orchestra.run.smithi155.stdout: "time": "2023-08-01T19:55:05.153896+0000", 2023-08-01T19:56:04.218 INFO:teuthology.orchestra.run.smithi155.stdout: "duration": 0.00013575800000000001 2023-08-01T19:56:04.218 INFO:teuthology.orchestra.run.smithi155.stdout: }, 2023-08-01T19:56:04.218 INFO:teuthology.orchestra.run.smithi155.stdout: { 2023-08-01T19:56:04.218 INFO:teuthology.orchestra.run.smithi155.stdout: "event": "waiting for subops from 0", 2023-08-01T19:56:04.218 INFO:teuthology.orchestra.run.smithi155.stdout: "time": "2023-08-01T19:55:05.154043+0000", 2023-08-01T19:56:04.218 INFO:teuthology.orchestra.run.smithi155.stdout: "duration": 0.00014650700000000001 2023-08-01T19:56:04.218 INFO:teuthology.orchestra.run.smithi155.stdout: }, 2023-08-01T19:56:04.219 INFO:teuthology.orchestra.run.smithi155.stdout: { 2023-08-01T19:56:04.219 INFO:teuthology.orchestra.run.smithi155.stdout: "event": "sub_op_commit_rec", 2023-08-01T19:56:04.219 INFO:teuthology.orchestra.run.smithi155.stdout: "time": "2023-08-01T19:55:05.221876+0000", 2023-08-01T19:56:04.219 INFO:teuthology.orchestra.run.smithi155.stdout: "duration": 0.067832796000000001 2023-08-01T19:56:04.219 INFO:teuthology.orchestra.run.smithi155.stdout: }, 2023-08-01T19:56:04.219 INFO:teuthology.orchestra.run.smithi155.stdout: { 2023-08-01T19:56:04.219 INFO:teuthology.orchestra.run.smithi155.stdout: "event": "op_commit", 2023-08-01T19:56:04.219 INFO:teuthology.orchestra.run.smithi155.stdout: "time": "2023-08-01T19:55:05.222813+0000", 2023-08-01T19:56:04.220 INFO:teuthology.orchestra.run.smithi155.stdout: "duration": 0.00093755300000000004 2023-08-01T19:56:04.220 INFO:teuthology.orchestra.run.smithi155.stdout: }, 2023-08-01T19:56:04.220 INFO:teuthology.orchestra.run.smithi155.stdout: { 2023-08-01T19:56:04.220 INFO:teuthology.orchestra.run.smithi155.stdout: "event": "commit_sent", 2023-08-01T19:56:04.220 INFO:teuthology.orchestra.run.smithi155.stdout: "time": "2023-08-01T19:55:05.222861+0000", 2023-08-01T19:56:04.220 INFO:teuthology.orchestra.run.smithi155.stdout: "duration": 4.8013999999999998e-05 2023-08-01T19:56:04.220 INFO:teuthology.orchestra.run.smithi155.stdout: }, 2023-08-01T19:56:04.221 INFO:teuthology.orchestra.run.smithi155.stdout: { 2023-08-01T19:56:04.221 INFO:teuthology.orchestra.run.smithi155.stdout: "event": "done", 2023-08-01T19:56:04.221 INFO:teuthology.orchestra.run.smithi155.stdout: "time": "2023-08-01T19:55:05.222900+0000", 2023-08-01T19:56:04.221 INFO:teuthology.orchestra.run.smithi155.stdout: "duration": 3.8634999999999999e-05 2023-08-01T19:56:04.221 INFO:teuthology.orchestra.run.smithi155.stdout: } 2023-08-01T19:56:04.221 INFO:teuthology.orchestra.run.smithi155.stdout: ] 2023-08-01T19:56:04.221 INFO:teuthology.orchestra.run.smithi155.stdout: } 2023-08-01T19:56:04.222 INFO:teuthology.orchestra.run.smithi155.stdout: }, 2023-08-01T19:56:04.222 INFO:teuthology.orchestra.run.smithi155.stdout: { 2023-08-01T19:56:04.222 INFO:teuthology.orchestra.run.smithi155.stdout: "description": "osd_op(client.4668.0:100251 5.b 5:d853df24:::benchmark_data_smithi006_114134_object100250:head [set-alloc-hint object_size 65536 write_size 65536,write 0~65536] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e37)", 2023-08-01T19:56:04.222 INFO:teuthology.orchestra.run.smithi155.stdout: "initiated_at": "2023-08-01T19:55:05.153737+0000", 2023-08-01T19:56:04.222 INFO:teuthology.orchestra.run.smithi155.stdout: "age": 58.993019429, 2023-08-01T19:56:04.222 INFO:teuthology.orchestra.run.smithi155.stdout: "duration": 0.071366545000000003, 2023-08-01T19:56:04.222 INFO:teuthology.orchestra.run.smithi155.stdout: "type_data": { 2023-08-01T19:56:04.223 INFO:teuthology.orchestra.run.smithi155.stdout: "flag_point": "commit sent; apply or cleanup", 2023-08-01T19:56:04.223 INFO:teuthology.orchestra.run.smithi155.stdout: "client_info": { 2023-08-01T19:56:04.223 INFO:teuthology.orchestra.run.smithi155.stdout: "client": "client.4668", 2023-08-01T19:56:04.223 INFO:teuthology.orchestra.run.smithi155.stdout: "client_addr": "172.21.15.6:0/1709472247", 2023-08-01T19:56:04.223 INFO:teuthology.orchestra.run.smithi155.stdout: "tid": 100251 2023-08-01T19:56:04.223 INFO:teuthology.orchestra.run.smithi155.stdout: }, 2023-08-01T19:56:04.223 INFO:teuthology.orchestra.run.smithi155.stdout: "events": [ 2023-08-01T19:56:04.223 INFO:teuthology.orchestra.run.smithi155.stdout: { 2023-08-01T19:56:04.224 INFO:teuthology.orchestra.run.smithi155.stdout: "event": "initiated", 2023-08-01T19:56:04.224 INFO:teuthology.orchestra.run.smithi155.stdout: "time": "2023-08-01T19:55:05.153737+0000", 2023-08-01T19:56:04.224 INFO:teuthology.orchestra.run.smithi155.stdout: "duration": 0 2023-08-01T19:56:04.224 INFO:teuthology.orchestra.run.smithi155.stdout: }, 2023-08-01T19:56:04.224 INFO:teuthology.orchestra.run.smithi155.stdout: { 2023-08-01T19:56:04.224 INFO:teuthology.orchestra.run.smithi155.stdout: "event": "throttled", 2023-08-01T19:56:04.224 INFO:teuthology.orchestra.run.smithi155.stdout: "time": "2023-08-01T19:55:05.153737+0000", 2023-08-01T19:56:04.225 INFO:teuthology.orchestra.run.smithi155.stdout: "duration": 0 2023-08-01T19:56:04.225 INFO:teuthology.orchestra.run.smithi155.stdout: }, 2023-08-01T19:56:04.225 INFO:teuthology.orchestra.run.smithi155.stdout: { 2023-08-01T19:56:04.225 INFO:teuthology.orchestra.run.smithi155.stdout: "event": "header_read", 2023-08-01T19:56:04.225 INFO:teuthology.orchestra.run.smithi155.stdout: "time": "2023-08-01T19:55:05.153736+0000", 2023-08-01T19:56:04.225 INFO:teuthology.orchestra.run.smithi155.stdout: "duration": 4294967295.9999995 2023-08-01T19:56:04.225 INFO:teuthology.orchestra.run.smithi155.stdout: }, 2023-08-01T19:56:04.225 INFO:teuthology.orchestra.run.smithi155.stdout: { 2023-08-01T19:56:04.226 INFO:teuthology.orchestra.run.smithi155.stdout: "event": "all_read", 2023-08-01T19:56:04.226 INFO:teuthology.orchestra.run.smithi155.stdout: "time": "2023-08-01T19:55:05.153784+0000", 2023-08-01T19:56:04.226 INFO:teuthology.orchestra.run.smithi155.stdout: "duration": 4.7660000000000001e-05 2023-08-01T19:56:04.226 INFO:teuthology.orchestra.run.smithi155.stdout: }, 2023-08-01T19:56:04.226 INFO:teuthology.orchestra.run.smithi155.stdout: { 2023-08-01T19:56:04.226 INFO:teuthology.orchestra.run.smithi155.stdout: "event": "dispatched", 2023-08-01T19:56:04.226 INFO:teuthology.orchestra.run.smithi155.stdout: "time": "2023-08-01T19:55:05.153793+0000", 2023-08-01T19:56:04.226 INFO:teuthology.orchestra.run.smithi155.stdout: "duration": 8.7150000000000004e-06 2023-08-01T19:56:04.227 INFO:teuthology.orchestra.run.smithi155.stdout: }, 2023-08-01T19:56:04.227 INFO:teuthology.orchestra.run.smithi155.stdout: { 2023-08-01T19:56:04.227 INFO:teuthology.orchestra.run.smithi155.stdout: "event": "queued_for_pg", 2023-08-01T19:56:04.227 INFO:teuthology.orchestra.run.smithi155.stdout: "time": "2023-08-01T19:55:05.153800+0000", 2023-08-01T19:56:04.227 INFO:teuthology.orchestra.run.smithi155.stdout: "duration": 7.2459999999999997e-06 2023-08-01T19:56:04.227 INFO:teuthology.orchestra.run.smithi155.stdout: }, 2023-08-01T19:56:04.227 INFO:teuthology.orchestra.run.smithi155.stdout: { 2023-08-01T19:56:04.228 INFO:teuthology.orchestra.run.smithi155.stdout: "event": "reached_pg", 2023-08-01T19:56:04.228 INFO:teuthology.orchestra.run.smithi155.stdout: "time": "2023-08-01T19:55:05.156241+0000", 2023-08-01T19:56:04.228 INFO:teuthology.orchestra.run.smithi155.stdout: "duration": 0.0024415359999999998 2023-08-01T19:56:04.228 INFO:teuthology.orchestra.run.smithi155.stdout: }, 2023-08-01T19:56:04.228 INFO:teuthology.orchestra.run.smithi155.stdout: { 2023-08-01T19:56:04.228 INFO:teuthology.orchestra.run.smithi155.stdout: "event": "started", 2023-08-01T19:56:04.228 INFO:teuthology.orchestra.run.smithi155.stdout: "time": "2023-08-01T19:55:05.219045+0000", 2023-08-01T19:56:04.228 INFO:teuthology.orchestra.run.smithi155.stdout: "duration": 0.062803855000000006 2023-08-01T19:56:04.229 INFO:teuthology.orchestra.run.smithi155.stdout: }, 2023-08-01T19:56:04.229 INFO:teuthology.orchestra.run.smithi155.stdout: { 2023-08-01T19:56:04.229 INFO:teuthology.orchestra.run.smithi155.stdout: "event": "waiting for subops from 0", 2023-08-01T19:56:04.229 INFO:teuthology.orchestra.run.smithi155.stdout: "time": "2023-08-01T19:55:05.219238+0000", 2023-08-01T19:56:04.229 INFO:teuthology.orchestra.run.smithi155.stdout: "duration": 0.00019241500000000001 2023-08-01T19:56:04.229 INFO:teuthology.orchestra.run.smithi155.stdout: }, 2023-08-01T19:56:04.229 INFO:teuthology.orchestra.run.smithi155.stdout: { 2023-08-01T19:56:04.230 INFO:teuthology.orchestra.run.smithi155.stdout: "event": "sub_op_commit_rec", 2023-08-01T19:56:04.230 INFO:teuthology.orchestra.run.smithi155.stdout: "time": "2023-08-01T19:55:05.223300+0000", 2023-08-01T19:56:04.230 INFO:teuthology.orchestra.run.smithi155.stdout: "duration": 0.0040626509999999996 2023-08-01T19:56:04.230 INFO:teuthology.orchestra.run.smithi155.stdout: }, 2023-08-01T19:56:04.230 INFO:teuthology.orchestra.run.smithi155.stdout: { 2023-08-01T19:56:04.230 INFO:teuthology.orchestra.run.smithi155.stdout: "event": "op_commit", 2023-08-01T19:56:04.230 INFO:teuthology.orchestra.run.smithi155.stdout: "time": "2023-08-01T19:55:05.225020+0000", 2023-08-01T19:56:04.230 INFO:teuthology.orchestra.run.smithi155.stdout: "duration": 0.0017201 2023-08-01T19:56:04.231 INFO:teuthology.orchestra.run.smithi155.stdout: }, 2023-08-01T19:56:04.231 INFO:teuthology.orchestra.run.smithi155.stdout: { 2023-08-01T19:56:04.231 INFO:teuthology.orchestra.run.smithi155.stdout: "event": "commit_sent", 2023-08-01T19:56:04.231 INFO:teuthology.orchestra.run.smithi155.stdout: "time": "2023-08-01T19:55:05.225066+0000", 2023-08-01T19:56:04.231 INFO:teuthology.orchestra.run.smithi155.stdout: "duration": 4.6143000000000002e-05 2023-08-01T19:56:04.231 INFO:teuthology.orchestra.run.smithi155.stdout: }, 2023-08-01T19:56:04.231 INFO:teuthology.orchestra.run.smithi155.stdout: { 2023-08-01T19:56:04.232 INFO:teuthology.orchestra.run.smithi155.stdout: "event": "done", 2023-08-01T19:56:04.232 INFO:teuthology.orchestra.run.smithi155.stdout: "time": "2023-08-01T19:55:05.225103+0000", 2023-08-01T19:56:04.232 INFO:teuthology.orchestra.run.smithi155.stdout: "duration": 3.6789999999999998e-05 2023-08-01T19:56:04.232 INFO:teuthology.orchestra.run.smithi155.stdout: } 2023-08-01T19:56:04.232 INFO:teuthology.orchestra.run.smithi155.stdout: ] 2023-08-01T19:56:04.232 INFO:teuthology.orchestra.run.smithi155.stdout: } 2023-08-01T19:56:04.232 INFO:teuthology.orchestra.run.smithi155.stdout: }, 2023-08-01T19:56:04.233 INFO:teuthology.orchestra.run.smithi155.stdout: { 2023-08-01T19:56:04.233 INFO:teuthology.orchestra.run.smithi155.stdout: "description": "osd_op(client.4668.0:100252 5.0 5:01f90c3c:::benchmark_data_smithi006_114134_object100251:head [set-alloc-hint object_size 65536 write_size 65536,write 0~65536] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e37)", 2023-08-01T19:56:04.233 INFO:teuthology.orchestra.run.smithi155.stdout: "initiated_at": "2023-08-01T19:55:05.154048+0000", 2023-08-01T19:56:04.233 INFO:teuthology.orchestra.run.smithi155.stdout: "age": 58.992708182000001, 2023-08-01T19:56:04.233 INFO:teuthology.orchestra.run.smithi155.stdout: "duration": 0.070156683999999997, 2023-08-01T19:56:04.233 INFO:teuthology.orchestra.run.smithi155.stdout: "type_data": { 2023-08-01T19:56:04.233 INFO:teuthology.orchestra.run.smithi155.stdout: "flag_point": "commit sent; apply or cleanup", 2023-08-01T19:56:04.233 INFO:teuthology.orchestra.run.smithi155.stdout: "client_info": { 2023-08-01T19:56:04.234 INFO:teuthology.orchestra.run.smithi155.stdout: "client": "client.4668", 2023-08-01T19:56:04.234 INFO:teuthology.orchestra.run.smithi155.stdout: "client_addr": "172.21.15.6:0/1709472247", 2023-08-01T19:56:04.234 INFO:teuthology.orchestra.run.smithi155.stdout: "tid": 100252 2023-08-01T19:56:04.234 INFO:teuthology.orchestra.run.smithi155.stdout: }, 2023-08-01T19:56:04.234 INFO:teuthology.orchestra.run.smithi155.stdout: "events": [ 2023-08-01T19:56:04.234 INFO:teuthology.orchestra.run.smithi155.stdout: { 2023-08-01T19:56:04.234 INFO:teuthology.orchestra.run.smithi155.stdout: "event": "initiated", 2023-08-01T19:56:04.235 INFO:teuthology.orchestra.run.smithi155.stdout: "time": "2023-08-01T19:55:05.154048+0000", 2023-08-01T19:56:04.235 INFO:teuthology.orchestra.run.smithi155.stdout: "duration": 0 2023-08-01T19:56:04.235 INFO:teuthology.orchestra.run.smithi155.stdout: }, 2023-08-01T19:56:04.235 INFO:teuthology.orchestra.run.smithi155.stdout: { 2023-08-01T19:56:04.235 INFO:teuthology.orchestra.run.smithi155.stdout: "event": "throttled", 2023-08-01T19:56:04.235 INFO:teuthology.orchestra.run.smithi155.stdout: "time": "2023-08-01T19:55:05.154048+0000", 2023-08-01T19:56:04.235 INFO:teuthology.orchestra.run.smithi155.stdout: "duration": 0 2023-08-01T19:56:04.235 INFO:teuthology.orchestra.run.smithi155.stdout: }, 2023-08-01T19:56:04.236 INFO:teuthology.orchestra.run.smithi155.stdout: { 2023-08-01T19:56:04.236 INFO:teuthology.orchestra.run.smithi155.stdout: "event": "header_read", 2023-08-01T19:56:04.236 INFO:teuthology.orchestra.run.smithi155.stdout: "time": "2023-08-01T19:55:05.154047+0000", 2023-08-01T19:56:04.236 INFO:teuthology.orchestra.run.smithi155.stdout: "duration": 4294967295.999999 2023-08-01T19:56:04.236 INFO:teuthology.orchestra.run.smithi155.stdout: }, 2023-08-01T19:56:04.236 INFO:teuthology.orchestra.run.smithi155.stdout: { 2023-08-01T19:56:04.236 INFO:teuthology.orchestra.run.smithi155.stdout: "event": "all_read", 2023-08-01T19:56:04.237 INFO:teuthology.orchestra.run.smithi155.stdout: "time": "2023-08-01T19:55:05.154115+0000", 2023-08-01T19:56:04.237 INFO:teuthology.orchestra.run.smithi155.stdout: "duration": 6.7545999999999993e-05 2023-08-01T19:56:04.237 INFO:teuthology.orchestra.run.smithi155.stdout: }, 2023-08-01T19:56:04.237 INFO:teuthology.orchestra.run.smithi155.stdout: { 2023-08-01T19:56:04.237 INFO:teuthology.orchestra.run.smithi155.stdout: "event": "dispatched", 2023-08-01T19:56:04.237 INFO:teuthology.orchestra.run.smithi155.stdout: "time": "2023-08-01T19:55:05.154125+0000", 2023-08-01T19:56:04.237 INFO:teuthology.orchestra.run.smithi155.stdout: "duration": 1.0669000000000001e-05 2023-08-01T19:56:04.237 INFO:teuthology.orchestra.run.smithi155.stdout: }, 2023-08-01T19:56:04.238 INFO:teuthology.orchestra.run.smithi155.stdout: { 2023-08-01T19:56:04.238 INFO:teuthology.orchestra.run.smithi155.stdout: "event": "queued_for_pg", 2023-08-01T19:56:04.238 INFO:teuthology.orchestra.run.smithi155.stdout: "time": "2023-08-01T19:55:05.154131+0000", 2023-08-01T19:56:04.238 INFO:teuthology.orchestra.run.smithi155.stdout: "duration": 6.0349999999999998e-06 2023-08-01T19:56:04.238 INFO:teuthology.orchestra.run.smithi155.stdout: }, 2023-08-01T19:56:04.238 INFO:teuthology.orchestra.run.smithi155.stdout: { 2023-08-01T19:56:04.238 INFO:teuthology.orchestra.run.smithi155.stdout: "event": "reached_pg", 2023-08-01T19:56:04.238 INFO:teuthology.orchestra.run.smithi155.stdout: "time": "2023-08-01T19:55:05.154174+0000", 2023-08-01T19:56:04.239 INFO:teuthology.orchestra.run.smithi155.stdout: "duration": 4.2429000000000003e-05 2023-08-01T19:56:04.239 INFO:teuthology.orchestra.run.smithi155.stdout: }, 2023-08-01T19:56:04.239 INFO:teuthology.orchestra.run.smithi155.stdout: { 2023-08-01T19:56:04.239 INFO:teuthology.orchestra.run.smithi155.stdout: "event": "started", 2023-08-01T19:56:04.239 INFO:teuthology.orchestra.run.smithi155.stdout: "time": "2023-08-01T19:55:05.154287+0000", 2023-08-01T19:56:04.239 INFO:teuthology.orchestra.run.smithi155.stdout: "duration": 0.000113138 2023-08-01T19:56:04.239 INFO:teuthology.orchestra.run.smithi155.stdout: }, 2023-08-01T19:56:04.240 INFO:teuthology.orchestra.run.smithi155.stdout: { 2023-08-01T19:56:04.240 INFO:teuthology.orchestra.run.smithi155.stdout: "event": "waiting for subops from 0", 2023-08-01T19:56:04.240 INFO:teuthology.orchestra.run.smithi155.stdout: "time": "2023-08-01T19:55:05.154420+0000", 2023-08-01T19:56:04.240 INFO:teuthology.orchestra.run.smithi155.stdout: "duration": 0.000133292 2023-08-01T19:56:04.240 INFO:teuthology.orchestra.run.smithi155.stdout: }, 2023-08-01T19:56:04.240 INFO:teuthology.orchestra.run.smithi155.stdout: { 2023-08-01T19:56:04.240 INFO:teuthology.orchestra.run.smithi155.stdout: "event": "sub_op_commit_rec", 2023-08-01T19:56:04.241 INFO:teuthology.orchestra.run.smithi155.stdout: "time": "2023-08-01T19:55:05.219034+0000", 2023-08-01T19:56:04.241 INFO:teuthology.orchestra.run.smithi155.stdout: "duration": 0.064613429999999999 2023-08-01T19:56:04.241 INFO:teuthology.orchestra.run.smithi155.stdout: }, 2023-08-01T19:56:04.241 INFO:teuthology.orchestra.run.smithi155.stdout: { 2023-08-01T19:56:04.241 INFO:teuthology.orchestra.run.smithi155.stdout: "event": "op_commit", 2023-08-01T19:56:04.241 INFO:teuthology.orchestra.run.smithi155.stdout: "time": "2023-08-01T19:55:05.224138+0000", 2023-08-01T19:56:04.241 INFO:teuthology.orchestra.run.smithi155.stdout: "duration": 0.0051041999999999997 2023-08-01T19:56:04.242 INFO:teuthology.orchestra.run.smithi155.stdout: }, 2023-08-01T19:56:04.242 INFO:teuthology.orchestra.run.smithi155.stdout: { 2023-08-01T19:56:04.242 INFO:teuthology.orchestra.run.smithi155.stdout: "event": "commit_sent", 2023-08-01T19:56:04.242 INFO:teuthology.orchestra.run.smithi155.stdout: "time": "2023-08-01T19:55:05.224171+0000", 2023-08-01T19:56:04.242 INFO:teuthology.orchestra.run.smithi155.stdout: "duration": 3.3345e-05 2023-08-01T19:56:04.242 INFO:teuthology.orchestra.run.smithi155.stdout: }, 2023-08-01T19:56:04.242 INFO:teuthology.orchestra.run.smithi155.stdout: { 2023-08-01T19:56:04.243 INFO:teuthology.orchestra.run.smithi155.stdout: "event": "done", 2023-08-01T19:56:04.243 INFO:teuthology.orchestra.run.smithi155.stdout: "time": "2023-08-01T19:55:05.224205+0000", 2023-08-01T19:56:04.243 INFO:teuthology.orchestra.run.smithi155.stdout: "duration": 3.3525999999999997e-05 2023-08-01T19:56:04.243 INFO:teuthology.orchestra.run.smithi155.stdout: } 2023-08-01T19:56:04.243 INFO:teuthology.orchestra.run.smithi155.stdout: ] 2023-08-01T19:56:04.243 INFO:teuthology.orchestra.run.smithi155.stdout: } 2023-08-01T19:56:04.243 INFO:teuthology.orchestra.run.smithi155.stdout: }, 2023-08-01T19:56:04.243 INFO:teuthology.orchestra.run.smithi155.stdout: { 2023-08-01T19:56:04.244 INFO:teuthology.orchestra.run.smithi155.stdout: "description": "osd_repop_reply(client.4668.0:100237 5.4 e37/19 ondisk, result = 0)", 2023-08-01T19:56:04.244 INFO:teuthology.orchestra.run.smithi155.stdout: "initiated_at": "2023-08-01T19:55:05.156249+0000", 2023-08-01T19:56:04.244 INFO:teuthology.orchestra.run.smithi155.stdout: "age": 58.990507237000003, 2023-08-01T19:56:04.244 INFO:teuthology.orchestra.run.smithi155.stdout: "duration": 0.062792549000000003, 2023-08-01T19:56:04.245 INFO:teuthology.orchestra.run.smithi155.stdout: "type_data": { 2023-08-01T19:56:04.245 INFO:teuthology.orchestra.run.smithi155.stdout: "flag_point": "started", 2023-08-01T19:56:04.245 INFO:teuthology.orchestra.run.smithi155.stdout: "events": [ 2023-08-01T19:56:04.245 INFO:teuthology.orchestra.run.smithi155.stdout: { 2023-08-01T19:56:04.245 INFO:teuthology.orchestra.run.smithi155.stdout: "event": "initiated", 2023-08-01T19:56:04.245 INFO:teuthology.orchestra.run.smithi155.stdout: "time": "2023-08-01T19:55:05.156249+0000", 2023-08-01T19:56:04.245 INFO:teuthology.orchestra.run.smithi155.stdout: "duration": 0 2023-08-01T19:56:04.245 INFO:teuthology.orchestra.run.smithi155.stdout: }, 2023-08-01T19:56:04.246 INFO:teuthology.orchestra.run.smithi155.stdout: { 2023-08-01T19:56:04.246 INFO:teuthology.orchestra.run.smithi155.stdout: "event": "throttled", 2023-08-01T19:56:04.246 INFO:teuthology.orchestra.run.smithi155.stdout: "time": "2023-08-01T19:55:05.156249+0000", 2023-08-01T19:56:04.246 INFO:teuthology.orchestra.run.smithi155.stdout: "duration": 0 2023-08-01T19:56:04.246 INFO:teuthology.orchestra.run.smithi155.stdout: }, 2023-08-01T19:56:04.246 INFO:teuthology.orchestra.run.smithi155.stdout: { 2023-08-01T19:56:04.246 INFO:teuthology.orchestra.run.smithi155.stdout: "event": "header_read", 2023-08-01T19:56:04.247 INFO:teuthology.orchestra.run.smithi155.stdout: "time": "2023-08-01T19:55:05.156248+0000", 2023-08-01T19:56:04.247 INFO:teuthology.orchestra.run.smithi155.stdout: "duration": 4294967295.9999995 2023-08-01T19:56:04.247 INFO:teuthology.orchestra.run.smithi155.stdout: }, 2023-08-01T19:56:04.247 INFO:teuthology.orchestra.run.smithi155.stdout: { 2023-08-01T19:56:04.247 INFO:teuthology.orchestra.run.smithi155.stdout: "event": "all_read", 2023-08-01T19:56:04.247 INFO:teuthology.orchestra.run.smithi155.stdout: "time": "2023-08-01T19:55:05.156252+0000", 2023-08-01T19:56:04.247 INFO:teuthology.orchestra.run.smithi155.stdout: "duration": 3.9999999999999998e-06 2023-08-01T19:56:04.248 INFO:teuthology.orchestra.run.smithi155.stdout: }, 2023-08-01T19:56:04.248 INFO:teuthology.orchestra.run.smithi155.stdout: { 2023-08-01T19:56:04.248 INFO:teuthology.orchestra.run.smithi155.stdout: "event": "dispatched", 2023-08-01T19:56:04.248 INFO:teuthology.orchestra.run.smithi155.stdout: "time": "2023-08-01T19:55:05.218844+0000", 2023-08-01T19:56:04.248 INFO:teuthology.orchestra.run.smithi155.stdout: "duration": 0.062591516999999999 2023-08-01T19:56:04.248 INFO:teuthology.orchestra.run.smithi155.stdout: }, 2023-08-01T19:56:04.249 INFO:teuthology.orchestra.run.smithi155.stdout: { 2023-08-01T19:56:04.249 INFO:teuthology.orchestra.run.smithi155.stdout: "event": "queued_for_pg", 2023-08-01T19:56:04.249 INFO:teuthology.orchestra.run.smithi155.stdout: "time": "2023-08-01T19:55:05.218862+0000", 2023-08-01T19:56:04.249 INFO:teuthology.orchestra.run.smithi155.stdout: "duration": 1.7666e-05 2023-08-01T19:56:04.249 INFO:teuthology.orchestra.run.smithi155.stdout: }, 2023-08-01T19:56:04.249 INFO:teuthology.orchestra.run.smithi155.stdout: { 2023-08-01T19:56:04.249 INFO:teuthology.orchestra.run.smithi155.stdout: "event": "reached_pg", 2023-08-01T19:56:04.249 INFO:teuthology.orchestra.run.smithi155.stdout: "time": "2023-08-01T19:55:05.218914+0000", 2023-08-01T19:56:04.250 INFO:teuthology.orchestra.run.smithi155.stdout: "duration": 5.2565999999999998e-05 2023-08-01T19:56:04.250 INFO:teuthology.orchestra.run.smithi155.stdout: }, 2023-08-01T19:56:04.250 INFO:teuthology.orchestra.run.smithi155.stdout: { 2023-08-01T19:56:04.250 INFO:teuthology.orchestra.run.smithi155.stdout: "event": "started", 2023-08-01T19:56:04.250 INFO:teuthology.orchestra.run.smithi155.stdout: "time": "2023-08-01T19:55:05.218925+0000", 2023-08-01T19:56:04.250 INFO:teuthology.orchestra.run.smithi155.stdout: "duration": 1.1375e-05 2023-08-01T19:56:04.250 INFO:teuthology.orchestra.run.smithi155.stdout: }, 2023-08-01T19:56:04.251 INFO:teuthology.orchestra.run.smithi155.stdout: { 2023-08-01T19:56:04.251 INFO:teuthology.orchestra.run.smithi155.stdout: "event": "done", 2023-08-01T19:56:04.251 INFO:teuthology.orchestra.run.smithi155.stdout: "time": "2023-08-01T19:55:05.219041+0000", 2023-08-01T19:56:04.251 INFO:teuthology.orchestra.run.smithi155.stdout: "duration": 0.000115977 2023-08-01T19:56:04.251 INFO:teuthology.orchestra.run.smithi155.stdout: } 2023-08-01T19:56:04.251 INFO:teuthology.orchestra.run.smithi155.stdout: ] 2023-08-01T19:56:04.251 INFO:teuthology.orchestra.run.smithi155.stdout: } 2023-08-01T19:56:04.251 INFO:teuthology.orchestra.run.smithi155.stdout: }, 2023-08-01T19:56:04.252 INFO:teuthology.orchestra.run.smithi155.stdout: { 2023-08-01T19:56:04.252 INFO:teuthology.orchestra.run.smithi155.stdout: "description": "osd_repop(client.4668.0:100253 5.f e37/19 5:f7bbce05:::benchmark_data_smithi006_114134_object100252:head v 37'6323, mlcod=37'6321)", 2023-08-01T19:56:04.252 INFO:teuthology.orchestra.run.smithi155.stdout: "initiated_at": "2023-08-01T19:55:05.156952+0000", 2023-08-01T19:56:04.252 INFO:teuthology.orchestra.run.smithi155.stdout: "age": 58.989804174, 2023-08-01T19:56:04.252 INFO:teuthology.orchestra.run.smithi155.stdout: "duration": 0.068018577999999996, 2023-08-01T19:56:04.252 INFO:teuthology.orchestra.run.smithi155.stdout: "type_data": { 2023-08-01T19:56:04.252 INFO:teuthology.orchestra.run.smithi155.stdout: "flag_point": "commit sent; apply or cleanup", 2023-08-01T19:56:04.253 INFO:teuthology.orchestra.run.smithi155.stdout: "events": [ 2023-08-01T19:56:04.253 INFO:teuthology.orchestra.run.smithi155.stdout: { 2023-08-01T19:56:04.253 INFO:teuthology.orchestra.run.smithi155.stdout: "event": "initiated", 2023-08-01T19:56:04.253 INFO:teuthology.orchestra.run.smithi155.stdout: "time": "2023-08-01T19:55:05.156952+0000", 2023-08-01T19:56:04.253 INFO:teuthology.orchestra.run.smithi155.stdout: "duration": 0 2023-08-01T19:56:04.253 INFO:teuthology.orchestra.run.smithi155.stdout: }, 2023-08-01T19:56:04.253 INFO:teuthology.orchestra.run.smithi155.stdout: { 2023-08-01T19:56:04.254 INFO:teuthology.orchestra.run.smithi155.stdout: "event": "throttled", 2023-08-01T19:56:04.254 INFO:teuthology.orchestra.run.smithi155.stdout: "time": "2023-08-01T19:55:05.156952+0000", 2023-08-01T19:56:04.254 INFO:teuthology.orchestra.run.smithi155.stdout: "duration": 0 2023-08-01T19:56:04.254 INFO:teuthology.orchestra.run.smithi155.stdout: }, 2023-08-01T19:56:04.254 INFO:teuthology.orchestra.run.smithi155.stdout: { 2023-08-01T19:56:04.254 INFO:teuthology.orchestra.run.smithi155.stdout: "event": "header_read", 2023-08-01T19:56:04.254 INFO:teuthology.orchestra.run.smithi155.stdout: "time": "2023-08-01T19:55:05.156951+0000", 2023-08-01T19:56:04.254 INFO:teuthology.orchestra.run.smithi155.stdout: "duration": 4294967295.999999 2023-08-01T19:56:04.255 INFO:teuthology.orchestra.run.smithi155.stdout: }, 2023-08-01T19:56:04.255 INFO:teuthology.orchestra.run.smithi155.stdout: { 2023-08-01T19:56:04.255 INFO:teuthology.orchestra.run.smithi155.stdout: "event": "all_read", 2023-08-01T19:56:04.255 INFO:teuthology.orchestra.run.smithi155.stdout: "time": "2023-08-01T19:55:05.156989+0000", 2023-08-01T19:56:04.255 INFO:teuthology.orchestra.run.smithi155.stdout: "duration": 3.8175e-05 2023-08-01T19:56:04.255 INFO:teuthology.orchestra.run.smithi155.stdout: }, 2023-08-01T19:56:04.255 INFO:teuthology.orchestra.run.smithi155.stdout: { 2023-08-01T19:56:04.255 INFO:teuthology.orchestra.run.smithi155.stdout: "event": "dispatched", 2023-08-01T19:56:04.256 INFO:teuthology.orchestra.run.smithi155.stdout: "time": "2023-08-01T19:55:05.218842+0000", 2023-08-01T19:56:04.256 INFO:teuthology.orchestra.run.smithi155.stdout: "duration": 0.061852299999999999 2023-08-01T19:56:04.256 INFO:teuthology.orchestra.run.smithi155.stdout: }, 2023-08-01T19:56:04.256 INFO:teuthology.orchestra.run.smithi155.stdout: { 2023-08-01T19:56:04.256 INFO:teuthology.orchestra.run.smithi155.stdout: "event": "queued_for_pg", 2023-08-01T19:56:04.256 INFO:teuthology.orchestra.run.smithi155.stdout: "time": "2023-08-01T19:55:05.218862+0000", 2023-08-01T19:56:04.257 INFO:teuthology.orchestra.run.smithi155.stdout: "duration": 1.9854999999999999e-05 2023-08-01T19:56:04.257 INFO:teuthology.orchestra.run.smithi155.stdout: }, 2023-08-01T19:56:04.257 INFO:teuthology.orchestra.run.smithi155.stdout: { 2023-08-01T19:56:04.257 INFO:teuthology.orchestra.run.smithi155.stdout: "event": "reached_pg", 2023-08-01T19:56:04.257 INFO:teuthology.orchestra.run.smithi155.stdout: "time": "2023-08-01T19:55:05.218918+0000", 2023-08-01T19:56:04.257 INFO:teuthology.orchestra.run.smithi155.stdout: "duration": 5.6570000000000002e-05 2023-08-01T19:56:04.257 INFO:teuthology.orchestra.run.smithi155.stdout: }, 2023-08-01T19:56:04.257 INFO:teuthology.orchestra.run.smithi155.stdout: { 2023-08-01T19:56:04.258 INFO:teuthology.orchestra.run.smithi155.stdout: "event": "started", 2023-08-01T19:56:04.258 INFO:teuthology.orchestra.run.smithi155.stdout: "time": "2023-08-01T19:55:05.218940+0000", 2023-08-01T19:56:04.258 INFO:teuthology.orchestra.run.smithi155.stdout: "duration": 2.1804e-05 2023-08-01T19:56:04.258 INFO:teuthology.orchestra.run.smithi155.stdout: }, 2023-08-01T19:56:04.258 INFO:teuthology.orchestra.run.smithi155.stdout: { 2023-08-01T19:56:04.258 INFO:teuthology.orchestra.run.smithi155.stdout: "event": "commit_sent", 2023-08-01T19:56:04.258 INFO:teuthology.orchestra.run.smithi155.stdout: "time": "2023-08-01T19:55:05.224928+0000", 2023-08-01T19:56:04.259 INFO:teuthology.orchestra.run.smithi155.stdout: "duration": 0.0059876759999999999 2023-08-01T19:56:04.259 INFO:teuthology.orchestra.run.smithi155.stdout: }, 2023-08-01T19:56:04.259 INFO:teuthology.orchestra.run.smithi155.stdout: { 2023-08-01T19:56:04.259 INFO:teuthology.orchestra.run.smithi155.stdout: "event": "done", 2023-08-01T19:56:04.259 INFO:teuthology.orchestra.run.smithi155.stdout: "time": "2023-08-01T19:55:05.224971+0000", 2023-08-01T19:56:04.259 INFO:teuthology.orchestra.run.smithi155.stdout: "duration": 4.2929999999999997e-05 2023-08-01T19:56:04.259 INFO:teuthology.orchestra.run.smithi155.stdout: } 2023-08-01T19:56:04.259 INFO:teuthology.orchestra.run.smithi155.stdout: ] 2023-08-01T19:56:04.260 INFO:teuthology.orchestra.run.smithi155.stdout: } 2023-08-01T19:56:04.260 INFO:teuthology.orchestra.run.smithi155.stdout: }, 2023-08-01T19:56:04.260 INFO:teuthology.orchestra.run.smithi155.stdout: { 2023-08-01T19:56:04.260 INFO:teuthology.orchestra.run.smithi155.stdout: "description": "osd_op(client.4668.0:100927 5.0 5:00608ec6:::benchmark_data_smithi006_114134_object100926:head [set-alloc-hint object_size 65536 write_size 65536,write 0~65536] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e37)", 2023-08-01T19:56:04.260 INFO:teuthology.orchestra.run.smithi155.stdout: "initiated_at": "2023-08-01T19:55:05.561169+0000", 2023-08-01T19:56:04.260 INFO:teuthology.orchestra.run.smithi155.stdout: "age": 58.585587271000001, 2023-08-01T19:56:04.260 INFO:teuthology.orchestra.run.smithi155.stdout: "duration": 0.066411687999999997, 2023-08-01T19:56:04.260 INFO:teuthology.orchestra.run.smithi155.stdout: "type_data": { 2023-08-01T19:56:04.261 INFO:teuthology.orchestra.run.smithi155.stdout: "flag_point": "commit sent; apply or cleanup", 2023-08-01T19:56:04.261 INFO:teuthology.orchestra.run.smithi155.stdout: "client_info": { 2023-08-01T19:56:04.261 INFO:teuthology.orchestra.run.smithi155.stdout: "client": "client.4668", 2023-08-01T19:56:04.261 INFO:teuthology.orchestra.run.smithi155.stdout: "client_addr": "172.21.15.6:0/1709472247", 2023-08-01T19:56:04.261 INFO:teuthology.orchestra.run.smithi155.stdout: "tid": 100927 2023-08-01T19:56:04.261 INFO:teuthology.orchestra.run.smithi155.stdout: }, 2023-08-01T19:56:04.261 INFO:teuthology.orchestra.run.smithi155.stdout: "events": [ 2023-08-01T19:56:04.262 INFO:teuthology.orchestra.run.smithi155.stdout: { 2023-08-01T19:56:04.262 INFO:teuthology.orchestra.run.smithi155.stdout: "event": "initiated", 2023-08-01T19:56:04.262 INFO:teuthology.orchestra.run.smithi155.stdout: "time": "2023-08-01T19:55:05.561169+0000", 2023-08-01T19:56:04.262 INFO:teuthology.orchestra.run.smithi155.stdout: "duration": 0 2023-08-01T19:56:04.262 INFO:teuthology.orchestra.run.smithi155.stdout: }, 2023-08-01T19:56:04.262 INFO:teuthology.orchestra.run.smithi155.stdout: { 2023-08-01T19:56:04.262 INFO:teuthology.orchestra.run.smithi155.stdout: "event": "throttled", 2023-08-01T19:56:04.263 INFO:teuthology.orchestra.run.smithi155.stdout: "time": "2023-08-01T19:55:05.561169+0000", 2023-08-01T19:56:04.263 INFO:teuthology.orchestra.run.smithi155.stdout: "duration": 0 2023-08-01T19:56:04.263 INFO:teuthology.orchestra.run.smithi155.stdout: }, 2023-08-01T19:56:04.263 INFO:teuthology.orchestra.run.smithi155.stdout: { 2023-08-01T19:56:04.263 INFO:teuthology.orchestra.run.smithi155.stdout: "event": "header_read", 2023-08-01T19:56:04.263 INFO:teuthology.orchestra.run.smithi155.stdout: "time": "2023-08-01T19:55:05.561168+0000", 2023-08-01T19:56:04.263 INFO:teuthology.orchestra.run.smithi155.stdout: "duration": 4294967295.9999995 2023-08-01T19:56:04.263 INFO:teuthology.orchestra.run.smithi155.stdout: }, 2023-08-01T19:56:04.264 INFO:teuthology.orchestra.run.smithi155.stdout: { 2023-08-01T19:56:04.264 INFO:teuthology.orchestra.run.smithi155.stdout: "event": "all_read", 2023-08-01T19:56:04.264 INFO:teuthology.orchestra.run.smithi155.stdout: "time": "2023-08-01T19:55:05.561218+0000", 2023-08-01T19:56:04.264 INFO:teuthology.orchestra.run.smithi155.stdout: "duration": 4.9379999999999998e-05 2023-08-01T19:56:04.264 INFO:teuthology.orchestra.run.smithi155.stdout: }, 2023-08-01T19:56:04.264 INFO:teuthology.orchestra.run.smithi155.stdout: { 2023-08-01T19:56:04.264 INFO:teuthology.orchestra.run.smithi155.stdout: "event": "dispatched", 2023-08-01T19:56:04.264 INFO:teuthology.orchestra.run.smithi155.stdout: "time": "2023-08-01T19:55:05.561225+0000", 2023-08-01T19:56:04.265 INFO:teuthology.orchestra.run.smithi155.stdout: "duration": 7.114e-06 2023-08-01T19:56:04.265 INFO:teuthology.orchestra.run.smithi155.stdout: }, 2023-08-01T19:56:04.265 INFO:teuthology.orchestra.run.smithi155.stdout: { 2023-08-01T19:56:04.265 INFO:teuthology.orchestra.run.smithi155.stdout: "event": "queued_for_pg", 2023-08-01T19:56:04.265 INFO:teuthology.orchestra.run.smithi155.stdout: "time": "2023-08-01T19:55:05.561229+0000", 2023-08-01T19:56:04.265 INFO:teuthology.orchestra.run.smithi155.stdout: "duration": 4.2180000000000001e-06 2023-08-01T19:56:04.265 INFO:teuthology.orchestra.run.smithi155.stdout: }, 2023-08-01T19:56:04.266 INFO:teuthology.orchestra.run.smithi155.stdout: { 2023-08-01T19:56:04.266 INFO:teuthology.orchestra.run.smithi155.stdout: "event": "reached_pg", 2023-08-01T19:56:04.266 INFO:teuthology.orchestra.run.smithi155.stdout: "time": "2023-08-01T19:55:05.564737+0000", 2023-08-01T19:56:04.266 INFO:teuthology.orchestra.run.smithi155.stdout: "duration": 0.0035081869999999999 2023-08-01T19:56:04.266 INFO:teuthology.orchestra.run.smithi155.stdout: }, 2023-08-01T19:56:04.266 INFO:teuthology.orchestra.run.smithi155.stdout: { 2023-08-01T19:56:04.266 INFO:teuthology.orchestra.run.smithi155.stdout: "event": "started", 2023-08-01T19:56:04.267 INFO:teuthology.orchestra.run.smithi155.stdout: "time": "2023-08-01T19:55:05.564859+0000", 2023-08-01T19:56:04.267 INFO:teuthology.orchestra.run.smithi155.stdout: "duration": 0.00012165800000000001 2023-08-01T19:56:04.267 INFO:teuthology.orchestra.run.smithi155.stdout: }, 2023-08-01T19:56:04.267 INFO:teuthology.orchestra.run.smithi155.stdout: { 2023-08-01T19:56:04.267 INFO:teuthology.orchestra.run.smithi155.stdout: "event": "waiting for subops from 0", 2023-08-01T19:56:04.267 INFO:teuthology.orchestra.run.smithi155.stdout: "time": "2023-08-01T19:55:05.565009+0000", 2023-08-01T19:56:04.267 INFO:teuthology.orchestra.run.smithi155.stdout: "duration": 0.00014979699999999999 2023-08-01T19:56:04.267 INFO:teuthology.orchestra.run.smithi155.stdout: }, 2023-08-01T19:56:04.268 INFO:teuthology.orchestra.run.smithi155.stdout: { 2023-08-01T19:56:04.268 INFO:teuthology.orchestra.run.smithi155.stdout: "event": "op_commit", 2023-08-01T19:56:04.268 INFO:teuthology.orchestra.run.smithi155.stdout: "time": "2023-08-01T19:55:05.568007+0000", 2023-08-01T19:56:04.268 INFO:teuthology.orchestra.run.smithi155.stdout: "duration": 0.00299796 2023-08-01T19:56:04.268 INFO:teuthology.orchestra.run.smithi155.stdout: }, 2023-08-01T19:56:04.268 INFO:teuthology.orchestra.run.smithi155.stdout: { 2023-08-01T19:56:04.268 INFO:teuthology.orchestra.run.smithi155.stdout: "event": "sub_op_commit_rec", 2023-08-01T19:56:04.269 INFO:teuthology.orchestra.run.smithi155.stdout: "time": "2023-08-01T19:55:05.627520+0000", 2023-08-01T19:56:04.269 INFO:teuthology.orchestra.run.smithi155.stdout: "duration": 0.059513636000000002 2023-08-01T19:56:04.269 INFO:teuthology.orchestra.run.smithi155.stdout: }, 2023-08-01T19:56:04.269 INFO:teuthology.orchestra.run.smithi155.stdout: { 2023-08-01T19:56:04.269 INFO:teuthology.orchestra.run.smithi155.stdout: "event": "commit_sent", 2023-08-01T19:56:04.269 INFO:teuthology.orchestra.run.smithi155.stdout: "time": "2023-08-01T19:55:05.627553+0000", 2023-08-01T19:56:04.269 INFO:teuthology.orchestra.run.smithi155.stdout: "duration": 3.2635999999999997e-05 2023-08-01T19:56:04.269 INFO:teuthology.orchestra.run.smithi155.stdout: }, 2023-08-01T19:56:04.270 INFO:teuthology.orchestra.run.smithi155.stdout: { 2023-08-01T19:56:04.270 INFO:teuthology.orchestra.run.smithi155.stdout: "event": "done", 2023-08-01T19:56:04.270 INFO:teuthology.orchestra.run.smithi155.stdout: "time": "2023-08-01T19:55:05.627581+0000", 2023-08-01T19:56:04.270 INFO:teuthology.orchestra.run.smithi155.stdout: "duration": 2.7681000000000001e-05 2023-08-01T19:56:04.270 INFO:teuthology.orchestra.run.smithi155.stdout: } 2023-08-01T19:56:04.270 INFO:teuthology.orchestra.run.smithi155.stdout: ] 2023-08-01T19:56:04.270 INFO:teuthology.orchestra.run.smithi155.stdout: } 2023-08-01T19:56:04.271 INFO:teuthology.orchestra.run.smithi155.stdout: }, 2023-08-01T19:56:04.271 INFO:teuthology.orchestra.run.smithi155.stdout: { 2023-08-01T19:56:04.271 INFO:teuthology.orchestra.run.smithi155.stdout: "description": "osd_op(client.4668.0:100935 5.e 5:7895b14e:::benchmark_data_smithi006_114134_object100934:head [set-alloc-hint object_size 65536 write_size 65536,write 0~65536] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e37)", 2023-08-01T19:56:04.271 INFO:teuthology.orchestra.run.smithi155.stdout: "initiated_at": "2023-08-01T19:55:05.566666+0000", 2023-08-01T19:56:04.271 INFO:teuthology.orchestra.run.smithi155.stdout: "age": 58.580089971, 2023-08-01T19:56:04.271 INFO:teuthology.orchestra.run.smithi155.stdout: "duration": 0.064309016999999996, 2023-08-01T19:56:04.271 INFO:teuthology.orchestra.run.smithi155.stdout: "type_data": { 2023-08-01T19:56:04.271 INFO:teuthology.orchestra.run.smithi155.stdout: "flag_point": "commit sent; apply or cleanup", 2023-08-01T19:56:04.272 INFO:teuthology.orchestra.run.smithi155.stdout: "client_info": { 2023-08-01T19:56:04.272 INFO:teuthology.orchestra.run.smithi155.stdout: "client": "client.4668", 2023-08-01T19:56:04.272 INFO:teuthology.orchestra.run.smithi155.stdout: "client_addr": "172.21.15.6:0/1709472247", 2023-08-01T19:56:04.272 INFO:teuthology.orchestra.run.smithi155.stdout: "tid": 100935 2023-08-01T19:56:04.272 INFO:teuthology.orchestra.run.smithi155.stdout: }, 2023-08-01T19:56:04.272 INFO:teuthology.orchestra.run.smithi155.stdout: "events": [ 2023-08-01T19:56:04.272 INFO:teuthology.orchestra.run.smithi155.stdout: { 2023-08-01T19:56:04.273 INFO:teuthology.orchestra.run.smithi155.stdout: "event": "initiated", 2023-08-01T19:56:04.273 INFO:teuthology.orchestra.run.smithi155.stdout: "time": "2023-08-01T19:55:05.566666+0000", 2023-08-01T19:56:04.273 INFO:teuthology.orchestra.run.smithi155.stdout: "duration": 0 2023-08-01T19:56:04.273 INFO:teuthology.orchestra.run.smithi155.stdout: }, 2023-08-01T19:56:04.273 INFO:teuthology.orchestra.run.smithi155.stdout: { 2023-08-01T19:56:04.273 INFO:teuthology.orchestra.run.smithi155.stdout: "event": "throttled", 2023-08-01T19:56:04.273 INFO:teuthology.orchestra.run.smithi155.stdout: "time": "2023-08-01T19:55:05.566666+0000", 2023-08-01T19:56:04.274 INFO:teuthology.orchestra.run.smithi155.stdout: "duration": 0 2023-08-01T19:56:04.274 INFO:teuthology.orchestra.run.smithi155.stdout: }, 2023-08-01T19:56:04.274 INFO:teuthology.orchestra.run.smithi155.stdout: { 2023-08-01T19:56:04.274 INFO:teuthology.orchestra.run.smithi155.stdout: "event": "header_read", 2023-08-01T19:56:04.274 INFO:teuthology.orchestra.run.smithi155.stdout: "time": "2023-08-01T19:55:05.566665+0000", 2023-08-01T19:56:04.274 INFO:teuthology.orchestra.run.smithi155.stdout: "duration": 4294967295.9999986 2023-08-01T19:56:04.274 INFO:teuthology.orchestra.run.smithi155.stdout: }, 2023-08-01T19:56:04.274 INFO:teuthology.orchestra.run.smithi155.stdout: { 2023-08-01T19:56:04.275 INFO:teuthology.orchestra.run.smithi155.stdout: "event": "all_read", 2023-08-01T19:56:04.275 INFO:teuthology.orchestra.run.smithi155.stdout: "time": "2023-08-01T19:55:05.566754+0000", 2023-08-01T19:56:04.275 INFO:teuthology.orchestra.run.smithi155.stdout: "duration": 8.9425999999999994e-05 2023-08-01T19:56:04.275 INFO:teuthology.orchestra.run.smithi155.stdout: }, 2023-08-01T19:56:04.275 INFO:teuthology.orchestra.run.smithi155.stdout: { 2023-08-01T19:56:04.275 INFO:teuthology.orchestra.run.smithi155.stdout: "event": "dispatched", 2023-08-01T19:56:04.275 INFO:teuthology.orchestra.run.smithi155.stdout: "time": "2023-08-01T19:55:05.566766+0000", 2023-08-01T19:56:04.275 INFO:teuthology.orchestra.run.smithi155.stdout: "duration": 1.2018000000000001e-05 2023-08-01T19:56:04.276 INFO:teuthology.orchestra.run.smithi155.stdout: }, 2023-08-01T19:56:04.276 INFO:teuthology.orchestra.run.smithi155.stdout: { 2023-08-01T19:56:04.276 INFO:teuthology.orchestra.run.smithi155.stdout: "event": "queued_for_pg", 2023-08-01T19:56:04.276 INFO:teuthology.orchestra.run.smithi155.stdout: "time": "2023-08-01T19:55:05.566772+0000", 2023-08-01T19:56:04.276 INFO:teuthology.orchestra.run.smithi155.stdout: "duration": 6.0190000000000003e-06 2023-08-01T19:56:04.276 INFO:teuthology.orchestra.run.smithi155.stdout: }, 2023-08-01T19:56:04.276 INFO:teuthology.orchestra.run.smithi155.stdout: { 2023-08-01T19:56:04.277 INFO:teuthology.orchestra.run.smithi155.stdout: "event": "reached_pg", 2023-08-01T19:56:04.277 INFO:teuthology.orchestra.run.smithi155.stdout: "time": "2023-08-01T19:55:05.566800+0000", 2023-08-01T19:56:04.277 INFO:teuthology.orchestra.run.smithi155.stdout: "duration": 2.7835999999999999e-05 2023-08-01T19:56:04.277 INFO:teuthology.orchestra.run.smithi155.stdout: }, 2023-08-01T19:56:04.277 INFO:teuthology.orchestra.run.smithi155.stdout: { 2023-08-01T19:56:04.278 INFO:teuthology.orchestra.run.smithi155.stdout: "event": "started", 2023-08-01T19:56:04.278 INFO:teuthology.orchestra.run.smithi155.stdout: "time": "2023-08-01T19:55:05.566879+0000", 2023-08-01T19:56:04.278 INFO:teuthology.orchestra.run.smithi155.stdout: "duration": 7.9105999999999998e-05 2023-08-01T19:56:04.278 INFO:teuthology.orchestra.run.smithi155.stdout: }, 2023-08-01T19:56:04.278 INFO:teuthology.orchestra.run.smithi155.stdout: { 2023-08-01T19:56:04.278 INFO:teuthology.orchestra.run.smithi155.stdout: "event": "waiting for subops from 0", 2023-08-01T19:56:04.278 INFO:teuthology.orchestra.run.smithi155.stdout: "time": "2023-08-01T19:55:05.566971+0000", 2023-08-01T19:56:04.279 INFO:teuthology.orchestra.run.smithi155.stdout: "duration": 9.1817999999999994e-05 2023-08-01T19:56:04.279 INFO:teuthology.orchestra.run.smithi155.stdout: }, 2023-08-01T19:56:04.279 INFO:teuthology.orchestra.run.smithi155.stdout: { 2023-08-01T19:56:04.279 INFO:teuthology.orchestra.run.smithi155.stdout: "event": "op_commit", 2023-08-01T19:56:04.279 INFO:teuthology.orchestra.run.smithi155.stdout: "time": "2023-08-01T19:55:05.571475+0000", 2023-08-01T19:56:04.279 INFO:teuthology.orchestra.run.smithi155.stdout: "duration": 0.0045039499999999996 2023-08-01T19:56:04.279 INFO:teuthology.orchestra.run.smithi155.stdout: }, 2023-08-01T19:56:04.279 INFO:teuthology.orchestra.run.smithi155.stdout: { 2023-08-01T19:56:04.280 INFO:teuthology.orchestra.run.smithi155.stdout: "event": "sub_op_commit_rec", 2023-08-01T19:56:04.280 INFO:teuthology.orchestra.run.smithi155.stdout: "time": "2023-08-01T19:55:05.630884+0000", 2023-08-01T19:56:04.280 INFO:teuthology.orchestra.run.smithi155.stdout: "duration": 0.059409181999999998 2023-08-01T19:56:04.280 INFO:teuthology.orchestra.run.smithi155.stdout: }, 2023-08-01T19:56:04.280 INFO:teuthology.orchestra.run.smithi155.stdout: { 2023-08-01T19:56:04.280 INFO:teuthology.orchestra.run.smithi155.stdout: "event": "commit_sent", 2023-08-01T19:56:04.280 INFO:teuthology.orchestra.run.smithi155.stdout: "time": "2023-08-01T19:55:05.630930+0000", 2023-08-01T19:56:04.281 INFO:teuthology.orchestra.run.smithi155.stdout: "duration": 4.5507999999999999e-05 2023-08-01T19:56:04.281 INFO:teuthology.orchestra.run.smithi155.stdout: }, 2023-08-01T19:56:04.281 INFO:teuthology.orchestra.run.smithi155.stdout: { 2023-08-01T19:56:04.281 INFO:teuthology.orchestra.run.smithi155.stdout: "event": "done", 2023-08-01T19:56:04.281 INFO:teuthology.orchestra.run.smithi155.stdout: "time": "2023-08-01T19:55:05.630975+0000", 2023-08-01T19:56:04.281 INFO:teuthology.orchestra.run.smithi155.stdout: "duration": 4.5441000000000001e-05 2023-08-01T19:56:04.281 INFO:teuthology.orchestra.run.smithi155.stdout: } 2023-08-01T19:56:04.282 INFO:teuthology.orchestra.run.smithi155.stdout: ] 2023-08-01T19:56:04.282 INFO:teuthology.orchestra.run.smithi155.stdout: } 2023-08-01T19:56:04.282 INFO:teuthology.orchestra.run.smithi155.stdout: }, 2023-08-01T19:56:04.282 INFO:teuthology.orchestra.run.smithi155.stdout: { 2023-08-01T19:56:04.282 INFO:teuthology.orchestra.run.smithi155.stdout: "description": "osd_op(client.4668.0:100941 5.e 5:736a6ac6:::benchmark_data_smithi006_114134_object100940:head [set-alloc-hint object_size 65536 write_size 65536,write 0~65536] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e37)", 2023-08-01T19:56:04.282 INFO:teuthology.orchestra.run.smithi155.stdout: "initiated_at": "2023-08-01T19:55:05.569750+0000", 2023-08-01T19:56:04.282 INFO:teuthology.orchestra.run.smithi155.stdout: "age": 58.577006077999997, 2023-08-01T19:56:04.283 INFO:teuthology.orchestra.run.smithi155.stdout: "duration": 0.065431331999999995, 2023-08-01T19:56:04.283 INFO:teuthology.orchestra.run.smithi155.stdout: "type_data": { 2023-08-01T19:56:04.283 INFO:teuthology.orchestra.run.smithi155.stdout: "flag_point": "commit sent; apply or cleanup", 2023-08-01T19:56:04.283 INFO:teuthology.orchestra.run.smithi155.stdout: "client_info": { 2023-08-01T19:56:04.283 INFO:teuthology.orchestra.run.smithi155.stdout: "client": "client.4668", 2023-08-01T19:56:04.283 INFO:teuthology.orchestra.run.smithi155.stdout: "client_addr": "172.21.15.6:0/1709472247", 2023-08-01T19:56:04.283 INFO:teuthology.orchestra.run.smithi155.stdout: "tid": 100941 2023-08-01T19:56:04.284 INFO:teuthology.orchestra.run.smithi155.stdout: }, 2023-08-01T19:56:04.284 INFO:teuthology.orchestra.run.smithi155.stdout: "events": [ 2023-08-01T19:56:04.284 INFO:teuthology.orchestra.run.smithi155.stdout: { 2023-08-01T19:56:04.284 INFO:teuthology.orchestra.run.smithi155.stdout: "event": "initiated", 2023-08-01T19:56:04.284 INFO:teuthology.orchestra.run.smithi155.stdout: "time": "2023-08-01T19:55:05.569750+0000", 2023-08-01T19:56:04.284 INFO:teuthology.orchestra.run.smithi155.stdout: "duration": 0 2023-08-01T19:56:04.284 INFO:teuthology.orchestra.run.smithi155.stdout: }, 2023-08-01T19:56:04.284 INFO:teuthology.orchestra.run.smithi155.stdout: { 2023-08-01T19:56:04.285 INFO:teuthology.orchestra.run.smithi155.stdout: "event": "throttled", 2023-08-01T19:56:04.285 INFO:teuthology.orchestra.run.smithi155.stdout: "time": "2023-08-01T19:55:05.569750+0000", 2023-08-01T19:56:04.285 INFO:teuthology.orchestra.run.smithi155.stdout: "duration": 0 2023-08-01T19:56:04.285 INFO:teuthology.orchestra.run.smithi155.stdout: }, 2023-08-01T19:56:04.285 INFO:teuthology.orchestra.run.smithi155.stdout: { 2023-08-01T19:56:04.285 INFO:teuthology.orchestra.run.smithi155.stdout: "event": "header_read", 2023-08-01T19:56:04.285 INFO:teuthology.orchestra.run.smithi155.stdout: "time": "2023-08-01T19:55:05.569749+0000", 2023-08-01T19:56:04.285 INFO:teuthology.orchestra.run.smithi155.stdout: "duration": 4294967295.999999 2023-08-01T19:56:04.286 INFO:teuthology.orchestra.run.smithi155.stdout: }, 2023-08-01T19:56:04.286 INFO:teuthology.orchestra.run.smithi155.stdout: { 2023-08-01T19:56:04.286 INFO:teuthology.orchestra.run.smithi155.stdout: "event": "all_read", 2023-08-01T19:56:04.286 INFO:teuthology.orchestra.run.smithi155.stdout: "time": "2023-08-01T19:55:05.569861+0000", 2023-08-01T19:56:04.286 INFO:teuthology.orchestra.run.smithi155.stdout: "duration": 0.000111333 2023-08-01T19:56:04.286 INFO:teuthology.orchestra.run.smithi155.stdout: }, 2023-08-01T19:56:04.286 INFO:teuthology.orchestra.run.smithi155.stdout: { 2023-08-01T19:56:04.287 INFO:teuthology.orchestra.run.smithi155.stdout: "event": "dispatched", 2023-08-01T19:56:04.287 INFO:teuthology.orchestra.run.smithi155.stdout: "time": "2023-08-01T19:55:05.569869+0000", 2023-08-01T19:56:04.287 INFO:teuthology.orchestra.run.smithi155.stdout: "duration": 8.8589999999999994e-06 2023-08-01T19:56:04.287 INFO:teuthology.orchestra.run.smithi155.stdout: }, 2023-08-01T19:56:04.287 INFO:teuthology.orchestra.run.smithi155.stdout: { 2023-08-01T19:56:04.287 INFO:teuthology.orchestra.run.smithi155.stdout: "event": "queued_for_pg", 2023-08-01T19:56:04.287 INFO:teuthology.orchestra.run.smithi155.stdout: "time": "2023-08-01T19:55:05.569874+0000", 2023-08-01T19:56:04.287 INFO:teuthology.orchestra.run.smithi155.stdout: "duration": 4.1679999999999997e-06 2023-08-01T19:56:04.288 INFO:teuthology.orchestra.run.smithi155.stdout: }, 2023-08-01T19:56:04.288 INFO:teuthology.orchestra.run.smithi155.stdout: { 2023-08-01T19:56:04.288 INFO:teuthology.orchestra.run.smithi155.stdout: "event": "reached_pg", 2023-08-01T19:56:04.288 INFO:teuthology.orchestra.run.smithi155.stdout: "time": "2023-08-01T19:55:05.569904+0000", 2023-08-01T19:56:04.288 INFO:teuthology.orchestra.run.smithi155.stdout: "duration": 3.0920999999999998e-05 2023-08-01T19:56:04.288 INFO:teuthology.orchestra.run.smithi155.stdout: }, 2023-08-01T19:56:04.288 INFO:teuthology.orchestra.run.smithi155.stdout: { 2023-08-01T19:56:04.288 INFO:teuthology.orchestra.run.smithi155.stdout: "event": "started", 2023-08-01T19:56:04.289 INFO:teuthology.orchestra.run.smithi155.stdout: "time": "2023-08-01T19:55:05.569998+0000", 2023-08-01T19:56:04.289 INFO:teuthology.orchestra.run.smithi155.stdout: "duration": 9.3086999999999998e-05 2023-08-01T19:56:04.289 INFO:teuthology.orchestra.run.smithi155.stdout: }, 2023-08-01T19:56:04.289 INFO:teuthology.orchestra.run.smithi155.stdout: { 2023-08-01T19:56:04.289 INFO:teuthology.orchestra.run.smithi155.stdout: "event": "waiting for subops from 0", 2023-08-01T19:56:04.289 INFO:teuthology.orchestra.run.smithi155.stdout: "time": "2023-08-01T19:55:05.570093+0000", 2023-08-01T19:56:04.289 INFO:teuthology.orchestra.run.smithi155.stdout: "duration": 9.5768999999999997e-05 2023-08-01T19:56:04.289 INFO:teuthology.orchestra.run.smithi155.stdout: }, 2023-08-01T19:56:04.290 INFO:teuthology.orchestra.run.smithi155.stdout: { 2023-08-01T19:56:04.290 INFO:teuthology.orchestra.run.smithi155.stdout: "event": "op_commit", 2023-08-01T19:56:04.290 INFO:teuthology.orchestra.run.smithi155.stdout: "time": "2023-08-01T19:55:05.572839+0000", 2023-08-01T19:56:04.290 INFO:teuthology.orchestra.run.smithi155.stdout: "duration": 0.0027460050000000001 2023-08-01T19:56:04.290 INFO:teuthology.orchestra.run.smithi155.stdout: }, 2023-08-01T19:56:04.290 INFO:teuthology.orchestra.run.smithi155.stdout: { 2023-08-01T19:56:04.290 INFO:teuthology.orchestra.run.smithi155.stdout: "event": "sub_op_commit_rec", 2023-08-01T19:56:04.290 INFO:teuthology.orchestra.run.smithi155.stdout: "time": "2023-08-01T19:55:05.635114+0000", 2023-08-01T19:56:04.291 INFO:teuthology.orchestra.run.smithi155.stdout: "duration": 0.062274297999999999 2023-08-01T19:56:04.291 INFO:teuthology.orchestra.run.smithi155.stdout: }, 2023-08-01T19:56:04.291 INFO:teuthology.orchestra.run.smithi155.stdout: { 2023-08-01T19:56:04.291 INFO:teuthology.orchestra.run.smithi155.stdout: "event": "commit_sent", 2023-08-01T19:56:04.291 INFO:teuthology.orchestra.run.smithi155.stdout: "time": "2023-08-01T19:55:05.635143+0000", 2023-08-01T19:56:04.291 INFO:teuthology.orchestra.run.smithi155.stdout: "duration": 2.9430000000000001e-05 2023-08-01T19:56:04.291 INFO:teuthology.orchestra.run.smithi155.stdout: }, 2023-08-01T19:56:04.292 INFO:teuthology.orchestra.run.smithi155.stdout: { 2023-08-01T19:56:04.292 INFO:teuthology.orchestra.run.smithi155.stdout: "event": "done", 2023-08-01T19:56:04.292 INFO:teuthology.orchestra.run.smithi155.stdout: "time": "2023-08-01T19:55:05.635181+0000", 2023-08-01T19:56:04.292 INFO:teuthology.orchestra.run.smithi155.stdout: "duration": 3.8352000000000001e-05 2023-08-01T19:56:04.292 INFO:teuthology.orchestra.run.smithi155.stdout: } 2023-08-01T19:56:04.292 INFO:teuthology.orchestra.run.smithi155.stdout: ] 2023-08-01T19:56:04.292 INFO:teuthology.orchestra.run.smithi155.stdout: } 2023-08-01T19:56:04.292 INFO:teuthology.orchestra.run.smithi155.stdout: }, 2023-08-01T19:56:04.293 INFO:teuthology.orchestra.run.smithi155.stdout: { 2023-08-01T19:56:04.293 INFO:teuthology.orchestra.run.smithi155.stdout: "description": "osd_op(client.4668.0:100945 5.e 5:73df68dd:::benchmark_data_smithi006_114134_object100944:head [set-alloc-hint object_size 65536 write_size 65536,write 0~65536] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e37)", 2023-08-01T19:56:04.293 INFO:teuthology.orchestra.run.smithi155.stdout: "initiated_at": "2023-08-01T19:55:05.576784+0000", 2023-08-01T19:56:04.293 INFO:teuthology.orchestra.run.smithi155.stdout: "age": 58.569972493000002, 2023-08-01T19:56:04.293 INFO:teuthology.orchestra.run.smithi155.stdout: "duration": 0.058512994999999998, 2023-08-01T19:56:04.293 INFO:teuthology.orchestra.run.smithi155.stdout: "type_data": { 2023-08-01T19:56:04.294 INFO:teuthology.orchestra.run.smithi155.stdout: "flag_point": "commit sent; apply or cleanup", 2023-08-01T19:56:04.294 INFO:teuthology.orchestra.run.smithi155.stdout: "client_info": { 2023-08-01T19:56:04.294 INFO:teuthology.orchestra.run.smithi155.stdout: "client": "client.4668", 2023-08-01T19:56:04.294 INFO:teuthology.orchestra.run.smithi155.stdout: "client_addr": "172.21.15.6:0/1709472247", 2023-08-01T19:56:04.294 INFO:teuthology.orchestra.run.smithi155.stdout: "tid": 100945 2023-08-01T19:56:04.294 INFO:teuthology.orchestra.run.smithi155.stdout: }, 2023-08-01T19:56:04.294 INFO:teuthology.orchestra.run.smithi155.stdout: "events": [ 2023-08-01T19:56:04.294 INFO:teuthology.orchestra.run.smithi155.stdout: { 2023-08-01T19:56:04.295 INFO:teuthology.orchestra.run.smithi155.stdout: "event": "initiated", 2023-08-01T19:56:04.295 INFO:teuthology.orchestra.run.smithi155.stdout: "time": "2023-08-01T19:55:05.576784+0000", 2023-08-01T19:56:04.295 INFO:teuthology.orchestra.run.smithi155.stdout: "duration": 0 2023-08-01T19:56:04.295 INFO:teuthology.orchestra.run.smithi155.stdout: }, 2023-08-01T19:56:04.295 INFO:teuthology.orchestra.run.smithi155.stdout: { 2023-08-01T19:56:04.295 INFO:teuthology.orchestra.run.smithi155.stdout: "event": "throttled", 2023-08-01T19:56:04.295 INFO:teuthology.orchestra.run.smithi155.stdout: "time": "2023-08-01T19:55:05.576784+0000", 2023-08-01T19:56:04.295 INFO:teuthology.orchestra.run.smithi155.stdout: "duration": 0 2023-08-01T19:56:04.296 INFO:teuthology.orchestra.run.smithi155.stdout: }, 2023-08-01T19:56:04.296 INFO:teuthology.orchestra.run.smithi155.stdout: { 2023-08-01T19:56:04.296 INFO:teuthology.orchestra.run.smithi155.stdout: "event": "header_read", 2023-08-01T19:56:04.296 INFO:teuthology.orchestra.run.smithi155.stdout: "time": "2023-08-01T19:55:05.576783+0000", 2023-08-01T19:56:04.296 INFO:teuthology.orchestra.run.smithi155.stdout: "duration": 4294967295.9999995 2023-08-01T19:56:04.296 INFO:teuthology.orchestra.run.smithi155.stdout: }, 2023-08-01T19:56:04.296 INFO:teuthology.orchestra.run.smithi155.stdout: { 2023-08-01T19:56:04.296 INFO:teuthology.orchestra.run.smithi155.stdout: "event": "all_read", 2023-08-01T19:56:04.297 INFO:teuthology.orchestra.run.smithi155.stdout: "time": "2023-08-01T19:55:05.576807+0000", 2023-08-01T19:56:04.297 INFO:teuthology.orchestra.run.smithi155.stdout: "duration": 2.3651000000000001e-05 2023-08-01T19:56:04.297 INFO:teuthology.orchestra.run.smithi155.stdout: }, 2023-08-01T19:56:04.297 INFO:teuthology.orchestra.run.smithi155.stdout: { 2023-08-01T19:56:04.297 INFO:teuthology.orchestra.run.smithi155.stdout: "event": "dispatched", 2023-08-01T19:56:04.297 INFO:teuthology.orchestra.run.smithi155.stdout: "time": "2023-08-01T19:55:05.576817+0000", 2023-08-01T19:56:04.297 INFO:teuthology.orchestra.run.smithi155.stdout: "duration": 9.9389999999999992e-06 2023-08-01T19:56:04.298 INFO:teuthology.orchestra.run.smithi155.stdout: }, 2023-08-01T19:56:04.298 INFO:teuthology.orchestra.run.smithi155.stdout: { 2023-08-01T19:56:04.298 INFO:teuthology.orchestra.run.smithi155.stdout: "event": "queued_for_pg", 2023-08-01T19:56:04.298 INFO:teuthology.orchestra.run.smithi155.stdout: "time": "2023-08-01T19:55:05.576820+0000", 2023-08-01T19:56:04.298 INFO:teuthology.orchestra.run.smithi155.stdout: "duration": 3.2619999999999999e-06 2023-08-01T19:56:04.298 INFO:teuthology.orchestra.run.smithi155.stdout: }, 2023-08-01T19:56:04.298 INFO:teuthology.orchestra.run.smithi155.stdout: { 2023-08-01T19:56:04.298 INFO:teuthology.orchestra.run.smithi155.stdout: "event": "reached_pg", 2023-08-01T19:56:04.299 INFO:teuthology.orchestra.run.smithi155.stdout: "time": "2023-08-01T19:55:05.576849+0000", 2023-08-01T19:56:04.299 INFO:teuthology.orchestra.run.smithi155.stdout: "duration": 2.8880000000000001e-05 2023-08-01T19:56:04.299 INFO:teuthology.orchestra.run.smithi155.stdout: }, 2023-08-01T19:56:04.299 INFO:teuthology.orchestra.run.smithi155.stdout: { 2023-08-01T19:56:04.299 INFO:teuthology.orchestra.run.smithi155.stdout: "event": "started", 2023-08-01T19:56:04.299 INFO:teuthology.orchestra.run.smithi155.stdout: "time": "2023-08-01T19:55:05.576940+0000", 2023-08-01T19:56:04.299 INFO:teuthology.orchestra.run.smithi155.stdout: "duration": 9.0570999999999997e-05 2023-08-01T19:56:04.299 INFO:teuthology.orchestra.run.smithi155.stdout: }, 2023-08-01T19:56:04.300 INFO:teuthology.orchestra.run.smithi155.stdout: { 2023-08-01T19:56:04.300 INFO:teuthology.orchestra.run.smithi155.stdout: "event": "waiting for subops from 0", 2023-08-01T19:56:04.300 INFO:teuthology.orchestra.run.smithi155.stdout: "time": "2023-08-01T19:55:05.577027+0000", 2023-08-01T19:56:04.300 INFO:teuthology.orchestra.run.smithi155.stdout: "duration": 8.7237999999999994e-05 2023-08-01T19:56:04.300 INFO:teuthology.orchestra.run.smithi155.stdout: }, 2023-08-01T19:56:04.300 INFO:teuthology.orchestra.run.smithi155.stdout: { 2023-08-01T19:56:04.300 INFO:teuthology.orchestra.run.smithi155.stdout: "event": "op_commit", 2023-08-01T19:56:04.300 INFO:teuthology.orchestra.run.smithi155.stdout: "time": "2023-08-01T19:55:05.579624+0000", 2023-08-01T19:56:04.301 INFO:teuthology.orchestra.run.smithi155.stdout: "duration": 0.0025971200000000001 2023-08-01T19:56:04.301 INFO:teuthology.orchestra.run.smithi155.stdout: }, 2023-08-01T19:56:04.301 INFO:teuthology.orchestra.run.smithi155.stdout: { 2023-08-01T19:56:04.301 INFO:teuthology.orchestra.run.smithi155.stdout: "event": "sub_op_commit_rec", 2023-08-01T19:56:04.301 INFO:teuthology.orchestra.run.smithi155.stdout: "time": "2023-08-01T19:55:05.635218+0000", 2023-08-01T19:56:04.301 INFO:teuthology.orchestra.run.smithi155.stdout: "duration": 0.055594487999999997 2023-08-01T19:56:04.301 INFO:teuthology.orchestra.run.smithi155.stdout: }, 2023-08-01T19:56:04.302 INFO:teuthology.orchestra.run.smithi155.stdout: { 2023-08-01T19:56:04.302 INFO:teuthology.orchestra.run.smithi155.stdout: "event": "commit_sent", 2023-08-01T19:56:04.302 INFO:teuthology.orchestra.run.smithi155.stdout: "time": "2023-08-01T19:55:05.635262+0000", 2023-08-01T19:56:04.302 INFO:teuthology.orchestra.run.smithi155.stdout: "duration": 4.3380999999999997e-05 2023-08-01T19:56:04.302 INFO:teuthology.orchestra.run.smithi155.stdout: }, 2023-08-01T19:56:04.302 INFO:teuthology.orchestra.run.smithi155.stdout: { 2023-08-01T19:56:04.302 INFO:teuthology.orchestra.run.smithi155.stdout: "event": "done", 2023-08-01T19:56:04.302 INFO:teuthology.orchestra.run.smithi155.stdout: "time": "2023-08-01T19:55:05.635297+0000", 2023-08-01T19:56:04.303 INFO:teuthology.orchestra.run.smithi155.stdout: "duration": 3.4842000000000003e-05 2023-08-01T19:56:04.303 INFO:teuthology.orchestra.run.smithi155.stdout: } 2023-08-01T19:56:04.303 INFO:teuthology.orchestra.run.smithi155.stdout: ] 2023-08-01T19:56:04.303 INFO:teuthology.orchestra.run.smithi155.stdout: } 2023-08-01T19:56:04.303 INFO:teuthology.orchestra.run.smithi155.stdout: }, 2023-08-01T19:56:04.303 INFO:teuthology.orchestra.run.smithi155.stdout: { 2023-08-01T19:56:04.303 INFO:teuthology.orchestra.run.smithi155.stdout: "description": "osd_op(client.4668.0:100947 5.4 5:23e8fc27:::benchmark_data_smithi006_114134_object100946:head [set-alloc-hint object_size 65536 write_size 65536,write 0~65536] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e37)", 2023-08-01T19:56:04.304 INFO:teuthology.orchestra.run.smithi155.stdout: "initiated_at": "2023-08-01T19:55:05.576840+0000", 2023-08-01T19:56:04.304 INFO:teuthology.orchestra.run.smithi155.stdout: "age": 58.569916438, 2023-08-01T19:56:04.304 INFO:teuthology.orchestra.run.smithi155.stdout: "duration": 0.058423127999999998, 2023-08-01T19:56:04.304 INFO:teuthology.orchestra.run.smithi155.stdout: "type_data": { 2023-08-01T19:56:04.304 INFO:teuthology.orchestra.run.smithi155.stdout: "flag_point": "commit sent; apply or cleanup", 2023-08-01T19:56:04.304 INFO:teuthology.orchestra.run.smithi155.stdout: "client_info": { 2023-08-01T19:56:04.304 INFO:teuthology.orchestra.run.smithi155.stdout: "client": "client.4668", 2023-08-01T19:56:04.305 INFO:teuthology.orchestra.run.smithi155.stdout: "client_addr": "172.21.15.6:0/1709472247", 2023-08-01T19:56:04.305 INFO:teuthology.orchestra.run.smithi155.stdout: "tid": 100947 2023-08-01T19:56:04.305 INFO:teuthology.orchestra.run.smithi155.stdout: }, 2023-08-01T19:56:04.305 INFO:teuthology.orchestra.run.smithi155.stdout: "events": [ 2023-08-01T19:56:04.305 INFO:teuthology.orchestra.run.smithi155.stdout: { 2023-08-01T19:56:04.305 INFO:teuthology.orchestra.run.smithi155.stdout: "event": "initiated", 2023-08-01T19:56:04.305 INFO:teuthology.orchestra.run.smithi155.stdout: "time": "2023-08-01T19:55:05.576840+0000", 2023-08-01T19:56:04.305 INFO:teuthology.orchestra.run.smithi155.stdout: "duration": 0 2023-08-01T19:56:04.306 INFO:teuthology.orchestra.run.smithi155.stdout: }, 2023-08-01T19:56:04.306 INFO:teuthology.orchestra.run.smithi155.stdout: { 2023-08-01T19:56:04.306 INFO:teuthology.orchestra.run.smithi155.stdout: "event": "throttled", 2023-08-01T19:56:04.306 INFO:teuthology.orchestra.run.smithi155.stdout: "time": "2023-08-01T19:55:05.576840+0000", 2023-08-01T19:56:04.306 INFO:teuthology.orchestra.run.smithi155.stdout: "duration": 0 2023-08-01T19:56:04.306 INFO:teuthology.orchestra.run.smithi155.stdout: }, 2023-08-01T19:56:04.306 INFO:teuthology.orchestra.run.smithi155.stdout: { 2023-08-01T19:56:04.307 INFO:teuthology.orchestra.run.smithi155.stdout: "event": "header_read", 2023-08-01T19:56:04.307 INFO:teuthology.orchestra.run.smithi155.stdout: "time": "2023-08-01T19:55:05.576839+0000", 2023-08-01T19:56:04.307 INFO:teuthology.orchestra.run.smithi155.stdout: "duration": 4294967295.9999995 2023-08-01T19:56:04.307 INFO:teuthology.orchestra.run.smithi155.stdout: }, 2023-08-01T19:56:04.307 INFO:teuthology.orchestra.run.smithi155.stdout: { 2023-08-01T19:56:04.307 INFO:teuthology.orchestra.run.smithi155.stdout: "event": "all_read", 2023-08-01T19:56:04.307 INFO:teuthology.orchestra.run.smithi155.stdout: "time": "2023-08-01T19:55:05.576893+0000", 2023-08-01T19:56:04.307 INFO:teuthology.orchestra.run.smithi155.stdout: "duration": 5.3893000000000001e-05 2023-08-01T19:56:04.308 INFO:teuthology.orchestra.run.smithi155.stdout: }, 2023-08-01T19:56:04.308 INFO:teuthology.orchestra.run.smithi155.stdout: { 2023-08-01T19:56:04.308 INFO:teuthology.orchestra.run.smithi155.stdout: "event": "dispatched", 2023-08-01T19:56:04.308 INFO:teuthology.orchestra.run.smithi155.stdout: "time": "2023-08-01T19:55:05.576902+0000", 2023-08-01T19:56:04.308 INFO:teuthology.orchestra.run.smithi155.stdout: "duration": 8.7520000000000002e-06 2023-08-01T19:56:04.308 INFO:teuthology.orchestra.run.smithi155.stdout: }, 2023-08-01T19:56:04.308 INFO:teuthology.orchestra.run.smithi155.stdout: { 2023-08-01T19:56:04.308 INFO:teuthology.orchestra.run.smithi155.stdout: "event": "queued_for_pg", 2023-08-01T19:56:04.309 INFO:teuthology.orchestra.run.smithi155.stdout: "time": "2023-08-01T19:55:05.576905+0000", 2023-08-01T19:56:04.309 INFO:teuthology.orchestra.run.smithi155.stdout: "duration": 3.01e-06 2023-08-01T19:56:04.309 INFO:teuthology.orchestra.run.smithi155.stdout: }, 2023-08-01T19:56:04.309 INFO:teuthology.orchestra.run.smithi155.stdout: { 2023-08-01T19:56:04.309 INFO:teuthology.orchestra.run.smithi155.stdout: "event": "reached_pg", 2023-08-01T19:56:04.309 INFO:teuthology.orchestra.run.smithi155.stdout: "time": "2023-08-01T19:55:05.579641+0000", 2023-08-01T19:56:04.309 INFO:teuthology.orchestra.run.smithi155.stdout: "duration": 0.0027366880000000001 2023-08-01T19:56:04.310 INFO:teuthology.orchestra.run.smithi155.stdout: }, 2023-08-01T19:56:04.310 INFO:teuthology.orchestra.run.smithi155.stdout: { 2023-08-01T19:56:04.310 INFO:teuthology.orchestra.run.smithi155.stdout: "event": "started", 2023-08-01T19:56:04.310 INFO:teuthology.orchestra.run.smithi155.stdout: "time": "2023-08-01T19:55:05.579734+0000", 2023-08-01T19:56:04.310 INFO:teuthology.orchestra.run.smithi155.stdout: "duration": 9.2590000000000006e-05 2023-08-01T19:56:04.310 INFO:teuthology.orchestra.run.smithi155.stdout: }, 2023-08-01T19:56:04.310 INFO:teuthology.orchestra.run.smithi155.stdout: { 2023-08-01T19:56:04.311 INFO:teuthology.orchestra.run.smithi155.stdout: "event": "waiting for subops from 0", 2023-08-01T19:56:04.311 INFO:teuthology.orchestra.run.smithi155.stdout: "time": "2023-08-01T19:55:05.579825+0000", 2023-08-01T19:56:04.311 INFO:teuthology.orchestra.run.smithi155.stdout: "duration": 9.0964999999999994e-05 2023-08-01T19:56:04.311 INFO:teuthology.orchestra.run.smithi155.stdout: }, 2023-08-01T19:56:04.311 INFO:teuthology.orchestra.run.smithi155.stdout: { 2023-08-01T19:56:04.311 INFO:teuthology.orchestra.run.smithi155.stdout: "event": "op_commit", 2023-08-01T19:56:04.311 INFO:teuthology.orchestra.run.smithi155.stdout: "time": "2023-08-01T19:55:05.585041+0000", 2023-08-01T19:56:04.311 INFO:teuthology.orchestra.run.smithi155.stdout: "duration": 0.0052159670000000002 2023-08-01T19:56:04.312 INFO:teuthology.orchestra.run.smithi155.stdout: }, 2023-08-01T19:56:04.312 INFO:teuthology.orchestra.run.smithi155.stdout: { 2023-08-01T19:56:04.312 INFO:teuthology.orchestra.run.smithi155.stdout: "event": "sub_op_commit_rec", 2023-08-01T19:56:04.312 INFO:teuthology.orchestra.run.smithi155.stdout: "time": "2023-08-01T19:55:05.635199+0000", 2023-08-01T19:56:04.312 INFO:teuthology.orchestra.run.smithi155.stdout: "duration": 0.050158023000000003 2023-08-01T19:56:04.312 INFO:teuthology.orchestra.run.smithi155.stdout: }, 2023-08-01T19:56:04.313 INFO:teuthology.orchestra.run.smithi155.stdout: { 2023-08-01T19:56:04.313 INFO:teuthology.orchestra.run.smithi155.stdout: "event": "commit_sent", 2023-08-01T19:56:04.313 INFO:teuthology.orchestra.run.smithi155.stdout: "time": "2023-08-01T19:55:05.635227+0000", 2023-08-01T19:56:04.313 INFO:teuthology.orchestra.run.smithi155.stdout: "duration": 2.7821e-05 2023-08-01T19:56:04.313 INFO:teuthology.orchestra.run.smithi155.stdout: }, 2023-08-01T19:56:04.313 INFO:teuthology.orchestra.run.smithi155.stdout: { 2023-08-01T19:56:04.314 INFO:teuthology.orchestra.run.smithi155.stdout: "event": "done", 2023-08-01T19:56:04.314 INFO:teuthology.orchestra.run.smithi155.stdout: "time": "2023-08-01T19:55:05.635263+0000", 2023-08-01T19:56:04.314 INFO:teuthology.orchestra.run.smithi155.stdout: "duration": 3.6081000000000002e-05 2023-08-01T19:56:04.314 INFO:teuthology.orchestra.run.smithi155.stdout: } 2023-08-01T19:56:04.314 INFO:teuthology.orchestra.run.smithi155.stdout: ] 2023-08-01T19:56:04.314 INFO:teuthology.orchestra.run.smithi155.stdout: } 2023-08-01T19:56:04.314 INFO:teuthology.orchestra.run.smithi155.stdout: }, 2023-08-01T19:56:04.315 INFO:teuthology.orchestra.run.smithi155.stdout: { 2023-08-01T19:56:04.315 INFO:teuthology.orchestra.run.smithi155.stdout: "description": "osd_op(client.4668.0:197408 5.d 5:bbda375a:::benchmark_data_smithi006_114134_object63747:head [delete] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e61)", 2023-08-01T19:56:04.315 INFO:teuthology.orchestra.run.smithi155.stdout: "initiated_at": "2023-08-01T19:55:58.559714+0000", 2023-08-01T19:56:04.315 INFO:teuthology.orchestra.run.smithi155.stdout: "age": 5.5870424510000003, 2023-08-01T19:56:04.315 INFO:teuthology.orchestra.run.smithi155.stdout: "duration": 1.047043671, 2023-08-01T19:56:04.315 INFO:teuthology.orchestra.run.smithi155.stdout: "type_data": { 2023-08-01T19:56:04.315 INFO:teuthology.orchestra.run.smithi155.stdout: "flag_point": "commit sent; apply or cleanup", 2023-08-01T19:56:04.316 INFO:teuthology.orchestra.run.smithi155.stdout: "client_info": { 2023-08-01T19:56:04.316 INFO:teuthology.orchestra.run.smithi155.stdout: "client": "client.4668", 2023-08-01T19:56:04.316 INFO:teuthology.orchestra.run.smithi155.stdout: "client_addr": "172.21.15.6:0/1709472247", 2023-08-01T19:56:04.316 INFO:teuthology.orchestra.run.smithi155.stdout: "tid": 197408 2023-08-01T19:56:04.316 INFO:teuthology.orchestra.run.smithi155.stdout: }, 2023-08-01T19:56:04.316 INFO:teuthology.orchestra.run.smithi155.stdout: "events": [ 2023-08-01T19:56:04.316 INFO:teuthology.orchestra.run.smithi155.stdout: { 2023-08-01T19:56:04.316 INFO:teuthology.orchestra.run.smithi155.stdout: "event": "initiated", 2023-08-01T19:56:04.317 INFO:teuthology.orchestra.run.smithi155.stdout: "time": "2023-08-01T19:55:58.559714+0000", 2023-08-01T19:56:04.317 INFO:teuthology.orchestra.run.smithi155.stdout: "duration": 0 2023-08-01T19:56:04.317 INFO:teuthology.orchestra.run.smithi155.stdout: }, 2023-08-01T19:56:04.317 INFO:teuthology.orchestra.run.smithi155.stdout: { 2023-08-01T19:56:04.317 INFO:teuthology.orchestra.run.smithi155.stdout: "event": "throttled", 2023-08-01T19:56:04.317 INFO:teuthology.orchestra.run.smithi155.stdout: "time": "2023-08-01T19:55:58.559714+0000", 2023-08-01T19:56:04.317 INFO:teuthology.orchestra.run.smithi155.stdout: "duration": 0 2023-08-01T19:56:04.317 INFO:teuthology.orchestra.run.smithi155.stdout: }, 2023-08-01T19:56:04.318 INFO:teuthology.orchestra.run.smithi155.stdout: { 2023-08-01T19:56:04.318 INFO:teuthology.orchestra.run.smithi155.stdout: "event": "header_read", 2023-08-01T19:56:04.318 INFO:teuthology.orchestra.run.smithi155.stdout: "time": "2023-08-01T19:55:58.559713+0000", 2023-08-01T19:56:04.318 INFO:teuthology.orchestra.run.smithi155.stdout: "duration": 4294967295.999999 2023-08-01T19:56:04.318 INFO:teuthology.orchestra.run.smithi155.stdout: }, 2023-08-01T19:56:04.318 INFO:teuthology.orchestra.run.smithi155.stdout: { 2023-08-01T19:56:04.318 INFO:teuthology.orchestra.run.smithi155.stdout: "event": "all_read", 2023-08-01T19:56:04.319 INFO:teuthology.orchestra.run.smithi155.stdout: "time": "2023-08-01T19:55:58.559717+0000", 2023-08-01T19:56:04.319 INFO:teuthology.orchestra.run.smithi155.stdout: "duration": 4.2860000000000001e-06 2023-08-01T19:56:04.319 INFO:teuthology.orchestra.run.smithi155.stdout: }, 2023-08-01T19:56:04.319 INFO:teuthology.orchestra.run.smithi155.stdout: { 2023-08-01T19:56:04.320 INFO:teuthology.orchestra.run.smithi155.stdout: "event": "dispatched", 2023-08-01T19:56:04.320 INFO:teuthology.orchestra.run.smithi155.stdout: "time": "2023-08-01T19:55:58.559774+0000", 2023-08-01T19:56:04.320 INFO:teuthology.orchestra.run.smithi155.stdout: "duration": 5.6508999999999997e-05 2023-08-01T19:56:04.320 INFO:teuthology.orchestra.run.smithi155.stdout: }, 2023-08-01T19:56:04.320 INFO:teuthology.orchestra.run.smithi155.stdout: { 2023-08-01T19:56:04.320 INFO:teuthology.orchestra.run.smithi155.stdout: "event": "queued_for_pg", 2023-08-01T19:56:04.320 INFO:teuthology.orchestra.run.smithi155.stdout: "time": "2023-08-01T19:55:58.559781+0000", 2023-08-01T19:56:04.321 INFO:teuthology.orchestra.run.smithi155.stdout: "duration": 7.1829999999999997e-06 2023-08-01T19:56:04.321 INFO:teuthology.orchestra.run.smithi155.stdout: }, 2023-08-01T19:56:04.321 INFO:teuthology.orchestra.run.smithi155.stdout: { 2023-08-01T19:56:04.321 INFO:teuthology.orchestra.run.smithi155.stdout: "event": "reached_pg", 2023-08-01T19:56:04.321 INFO:teuthology.orchestra.run.smithi155.stdout: "time": "2023-08-01T19:55:58.571621+0000", 2023-08-01T19:56:04.322 INFO:teuthology.orchestra.run.smithi155.stdout: "duration": 0.011840603999999999 2023-08-01T19:56:04.322 INFO:teuthology.orchestra.run.smithi155.stdout: }, 2023-08-01T19:56:04.322 INFO:teuthology.orchestra.run.smithi155.stdout: { 2023-08-01T19:56:04.322 INFO:teuthology.orchestra.run.smithi155.stdout: "event": "waiting for peered", 2023-08-01T19:56:04.323 INFO:teuthology.orchestra.run.smithi155.stdout: "time": "2023-08-01T19:55:58.571630+0000", 2023-08-01T19:56:04.323 INFO:teuthology.orchestra.run.smithi155.stdout: "duration": 8.9770000000000006e-06 2023-08-01T19:56:04.323 INFO:teuthology.orchestra.run.smithi155.stdout: }, 2023-08-01T19:56:04.324 INFO:teuthology.orchestra.run.smithi155.stdout: { 2023-08-01T19:56:04.324 INFO:teuthology.orchestra.run.smithi155.stdout: "event": "reached_pg", 2023-08-01T19:56:04.324 INFO:teuthology.orchestra.run.smithi155.stdout: "time": "2023-08-01T19:55:59.601300+0000", 2023-08-01T19:56:04.324 INFO:teuthology.orchestra.run.smithi155.stdout: "duration": 1.0296694989999999 2023-08-01T19:56:04.324 INFO:teuthology.orchestra.run.smithi155.stdout: }, 2023-08-01T19:56:04.324 INFO:teuthology.orchestra.run.smithi155.stdout: { 2023-08-01T19:56:04.324 INFO:teuthology.orchestra.run.smithi155.stdout: "event": "started", 2023-08-01T19:56:04.325 INFO:teuthology.orchestra.run.smithi155.stdout: "time": "2023-08-01T19:55:59.601448+0000", 2023-08-01T19:56:04.325 INFO:teuthology.orchestra.run.smithi155.stdout: "duration": 0.00014828399999999999 2023-08-01T19:56:04.325 INFO:teuthology.orchestra.run.smithi155.stdout: }, 2023-08-01T19:56:04.325 INFO:teuthology.orchestra.run.smithi155.stdout: { 2023-08-01T19:56:04.326 INFO:teuthology.orchestra.run.smithi155.stdout: "event": "op_commit", 2023-08-01T19:56:04.326 INFO:teuthology.orchestra.run.smithi155.stdout: "time": "2023-08-01T19:55:59.606616+0000", 2023-08-01T19:56:04.326 INFO:teuthology.orchestra.run.smithi155.stdout: "duration": 0.0051679769999999998 2023-08-01T19:56:04.326 INFO:teuthology.orchestra.run.smithi155.stdout: }, 2023-08-01T19:56:04.326 INFO:teuthology.orchestra.run.smithi155.stdout: { 2023-08-01T19:56:04.326 INFO:teuthology.orchestra.run.smithi155.stdout: "event": "commit_sent", 2023-08-01T19:56:04.326 INFO:teuthology.orchestra.run.smithi155.stdout: "time": "2023-08-01T19:55:59.606662+0000", 2023-08-01T19:56:04.327 INFO:teuthology.orchestra.run.smithi155.stdout: "duration": 4.5843000000000001e-05 2023-08-01T19:56:04.327 INFO:teuthology.orchestra.run.smithi155.stdout: }, 2023-08-01T19:56:04.327 INFO:teuthology.orchestra.run.smithi155.stdout: { 2023-08-01T19:56:04.327 INFO:teuthology.orchestra.run.smithi155.stdout: "event": "done", 2023-08-01T19:56:04.327 INFO:teuthology.orchestra.run.smithi155.stdout: "time": "2023-08-01T19:55:59.606757+0000", 2023-08-01T19:56:04.327 INFO:teuthology.orchestra.run.smithi155.stdout: "duration": 9.5373999999999999e-05 2023-08-01T19:56:04.327 INFO:teuthology.orchestra.run.smithi155.stdout: } 2023-08-01T19:56:04.327 INFO:teuthology.orchestra.run.smithi155.stdout: ] 2023-08-01T19:56:04.328 INFO:teuthology.orchestra.run.smithi155.stdout: } 2023-08-01T19:56:04.328 INFO:teuthology.orchestra.run.smithi155.stdout: }, 2023-08-01T19:56:04.328 INFO:teuthology.orchestra.run.smithi155.stdout: { 2023-08-01T19:56:04.328 INFO:teuthology.orchestra.run.smithi155.stdout: "description": "osd_op(client.4668.0:197416 5.d 5:bd99e66d:::benchmark_data_smithi006_114134_object63755:head [delete] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e62)", 2023-08-01T19:56:04.328 INFO:teuthology.orchestra.run.smithi155.stdout: "initiated_at": "2023-08-01T19:55:58.577369+0000", 2023-08-01T19:56:04.328 INFO:teuthology.orchestra.run.smithi155.stdout: "age": 5.569387474, 2023-08-01T19:56:04.328 INFO:teuthology.orchestra.run.smithi155.stdout: "duration": 1.0300980120000001, 2023-08-01T19:56:04.329 INFO:teuthology.orchestra.run.smithi155.stdout: "type_data": { 2023-08-01T19:56:04.329 INFO:teuthology.orchestra.run.smithi155.stdout: "flag_point": "commit sent; apply or cleanup", 2023-08-01T19:56:04.329 INFO:teuthology.orchestra.run.smithi155.stdout: "client_info": { 2023-08-01T19:56:04.329 INFO:teuthology.orchestra.run.smithi155.stdout: "client": "client.4668", 2023-08-01T19:56:04.329 INFO:teuthology.orchestra.run.smithi155.stdout: "client_addr": "172.21.15.6:0/1709472247", 2023-08-01T19:56:04.329 INFO:teuthology.orchestra.run.smithi155.stdout: "tid": 197416 2023-08-01T19:56:04.329 INFO:teuthology.orchestra.run.smithi155.stdout: }, 2023-08-01T19:56:04.329 INFO:teuthology.orchestra.run.smithi155.stdout: "events": [ 2023-08-01T19:56:04.330 INFO:teuthology.orchestra.run.smithi155.stdout: { 2023-08-01T19:56:04.330 INFO:teuthology.orchestra.run.smithi155.stdout: "event": "initiated", 2023-08-01T19:56:04.330 INFO:teuthology.orchestra.run.smithi155.stdout: "time": "2023-08-01T19:55:58.577369+0000", 2023-08-01T19:56:04.330 INFO:teuthology.orchestra.run.smithi155.stdout: "duration": 0 2023-08-01T19:56:04.330 INFO:teuthology.orchestra.run.smithi155.stdout: }, 2023-08-01T19:56:04.330 INFO:teuthology.orchestra.run.smithi155.stdout: { 2023-08-01T19:56:04.330 INFO:teuthology.orchestra.run.smithi155.stdout: "event": "throttled", 2023-08-01T19:56:04.330 INFO:teuthology.orchestra.run.smithi155.stdout: "time": "2023-08-01T19:55:58.577369+0000", 2023-08-01T19:56:04.331 INFO:teuthology.orchestra.run.smithi155.stdout: "duration": 0 2023-08-01T19:56:04.331 INFO:teuthology.orchestra.run.smithi155.stdout: }, 2023-08-01T19:56:04.331 INFO:teuthology.orchestra.run.smithi155.stdout: { 2023-08-01T19:56:04.331 INFO:teuthology.orchestra.run.smithi155.stdout: "event": "header_read", 2023-08-01T19:56:04.331 INFO:teuthology.orchestra.run.smithi155.stdout: "time": "2023-08-01T19:55:58.577368+0000", 2023-08-01T19:56:04.331 INFO:teuthology.orchestra.run.smithi155.stdout: "duration": 4294967295.9999995 2023-08-01T19:56:04.331 INFO:teuthology.orchestra.run.smithi155.stdout: }, 2023-08-01T19:56:04.332 INFO:teuthology.orchestra.run.smithi155.stdout: { 2023-08-01T19:56:04.332 INFO:teuthology.orchestra.run.smithi155.stdout: "event": "all_read", 2023-08-01T19:56:04.332 INFO:teuthology.orchestra.run.smithi155.stdout: "time": "2023-08-01T19:55:58.577370+0000", 2023-08-01T19:56:04.332 INFO:teuthology.orchestra.run.smithi155.stdout: "duration": 2.1150000000000001e-06 2023-08-01T19:56:04.332 INFO:teuthology.orchestra.run.smithi155.stdout: }, 2023-08-01T19:56:04.332 INFO:teuthology.orchestra.run.smithi155.stdout: { 2023-08-01T19:56:04.332 INFO:teuthology.orchestra.run.smithi155.stdout: "event": "dispatched", 2023-08-01T19:56:04.332 INFO:teuthology.orchestra.run.smithi155.stdout: "time": "2023-08-01T19:55:58.577377+0000", 2023-08-01T19:56:04.333 INFO:teuthology.orchestra.run.smithi155.stdout: "duration": 6.6610000000000003e-06 2023-08-01T19:56:04.333 INFO:teuthology.orchestra.run.smithi155.stdout: }, 2023-08-01T19:56:04.333 INFO:teuthology.orchestra.run.smithi155.stdout: { 2023-08-01T19:56:04.333 INFO:teuthology.orchestra.run.smithi155.stdout: "event": "queued_for_pg", 2023-08-01T19:56:04.333 INFO:teuthology.orchestra.run.smithi155.stdout: "time": "2023-08-01T19:55:58.577380+0000", 2023-08-01T19:56:04.333 INFO:teuthology.orchestra.run.smithi155.stdout: "duration": 2.7360000000000001e-06 2023-08-01T19:56:04.333 INFO:teuthology.orchestra.run.smithi155.stdout: }, 2023-08-01T19:56:04.334 INFO:teuthology.orchestra.run.smithi155.stdout: { 2023-08-01T19:56:04.334 INFO:teuthology.orchestra.run.smithi155.stdout: "event": "reached_pg", 2023-08-01T19:56:04.334 INFO:teuthology.orchestra.run.smithi155.stdout: "time": "2023-08-01T19:55:58.577405+0000", 2023-08-01T19:56:04.334 INFO:teuthology.orchestra.run.smithi155.stdout: "duration": 2.4929000000000001e-05 2023-08-01T19:56:04.334 INFO:teuthology.orchestra.run.smithi155.stdout: }, 2023-08-01T19:56:04.334 INFO:teuthology.orchestra.run.smithi155.stdout: { 2023-08-01T19:56:04.334 INFO:teuthology.orchestra.run.smithi155.stdout: "event": "waiting for peered", 2023-08-01T19:56:04.334 INFO:teuthology.orchestra.run.smithi155.stdout: "time": "2023-08-01T19:55:58.577409+0000", 2023-08-01T19:56:04.335 INFO:teuthology.orchestra.run.smithi155.stdout: "duration": 4.0799999999999999e-06 2023-08-01T19:56:04.335 INFO:teuthology.orchestra.run.smithi155.stdout: }, 2023-08-01T19:56:04.335 INFO:teuthology.orchestra.run.smithi155.stdout: { 2023-08-01T19:56:04.335 INFO:teuthology.orchestra.run.smithi155.stdout: "event": "reached_pg", 2023-08-01T19:56:04.335 INFO:teuthology.orchestra.run.smithi155.stdout: "time": "2023-08-01T19:55:59.603639+0000", 2023-08-01T19:56:04.335 INFO:teuthology.orchestra.run.smithi155.stdout: "duration": 1.0262299349999999 2023-08-01T19:56:04.335 INFO:teuthology.orchestra.run.smithi155.stdout: }, 2023-08-01T19:56:04.336 INFO:teuthology.orchestra.run.smithi155.stdout: { 2023-08-01T19:56:04.336 INFO:teuthology.orchestra.run.smithi155.stdout: "event": "started", 2023-08-01T19:56:04.336 INFO:teuthology.orchestra.run.smithi155.stdout: "time": "2023-08-01T19:55:59.603772+0000", 2023-08-01T19:56:04.336 INFO:teuthology.orchestra.run.smithi155.stdout: "duration": 0.000133153 2023-08-01T19:56:04.336 INFO:teuthology.orchestra.run.smithi155.stdout: }, 2023-08-01T19:56:04.336 INFO:teuthology.orchestra.run.smithi155.stdout: { 2023-08-01T19:56:04.336 INFO:teuthology.orchestra.run.smithi155.stdout: "event": "op_commit", 2023-08-01T19:56:04.336 INFO:teuthology.orchestra.run.smithi155.stdout: "time": "2023-08-01T19:55:59.607354+0000", 2023-08-01T19:56:04.337 INFO:teuthology.orchestra.run.smithi155.stdout: "duration": 0.0035819599999999999 2023-08-01T19:56:04.337 INFO:teuthology.orchestra.run.smithi155.stdout: }, 2023-08-01T19:56:04.337 INFO:teuthology.orchestra.run.smithi155.stdout: { 2023-08-01T19:56:04.337 INFO:teuthology.orchestra.run.smithi155.stdout: "event": "commit_sent", 2023-08-01T19:56:04.337 INFO:teuthology.orchestra.run.smithi155.stdout: "time": "2023-08-01T19:55:59.607396+0000", 2023-08-01T19:56:04.337 INFO:teuthology.orchestra.run.smithi155.stdout: "duration": 4.2423999999999999e-05 2023-08-01T19:56:04.337 INFO:teuthology.orchestra.run.smithi155.stdout: }, 2023-08-01T19:56:04.338 INFO:teuthology.orchestra.run.smithi155.stdout: { 2023-08-01T19:56:04.338 INFO:teuthology.orchestra.run.smithi155.stdout: "event": "done", 2023-08-01T19:56:04.338 INFO:teuthology.orchestra.run.smithi155.stdout: "time": "2023-08-01T19:55:59.607467+0000", 2023-08-01T19:56:04.338 INFO:teuthology.orchestra.run.smithi155.stdout: "duration": 7.0360999999999999e-05 2023-08-01T19:56:04.338 INFO:teuthology.orchestra.run.smithi155.stdout: } 2023-08-01T19:56:04.338 INFO:teuthology.orchestra.run.smithi155.stdout: ] 2023-08-01T19:56:04.338 INFO:teuthology.orchestra.run.smithi155.stdout: } 2023-08-01T19:56:04.338 INFO:teuthology.orchestra.run.smithi155.stdout: }, 2023-08-01T19:56:04.339 INFO:teuthology.orchestra.run.smithi155.stdout: { 2023-08-01T19:56:04.339 INFO:teuthology.orchestra.run.smithi155.stdout: "description": "osd_op(client.4668.0:197419 5.d 5:be7dc7c9:::benchmark_data_smithi006_114134_object63758:head [delete] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e62)", 2023-08-01T19:56:04.339 INFO:teuthology.orchestra.run.smithi155.stdout: "initiated_at": "2023-08-01T19:55:58.580223+0000", 2023-08-01T19:56:04.339 INFO:teuthology.orchestra.run.smithi155.stdout: "age": 5.5665335230000004, 2023-08-01T19:56:04.339 INFO:teuthology.orchestra.run.smithi155.stdout: "duration": 1.0286139439999999, 2023-08-01T19:56:04.339 INFO:teuthology.orchestra.run.smithi155.stdout: "type_data": { 2023-08-01T19:56:04.339 INFO:teuthology.orchestra.run.smithi155.stdout: "flag_point": "commit sent; apply or cleanup", 2023-08-01T19:56:04.340 INFO:teuthology.orchestra.run.smithi155.stdout: "client_info": { 2023-08-01T19:56:04.340 INFO:teuthology.orchestra.run.smithi155.stdout: "client": "client.4668", 2023-08-01T19:56:04.340 INFO:teuthology.orchestra.run.smithi155.stdout: "client_addr": "172.21.15.6:0/1709472247", 2023-08-01T19:56:04.340 INFO:teuthology.orchestra.run.smithi155.stdout: "tid": 197419 2023-08-01T19:56:04.340 INFO:teuthology.orchestra.run.smithi155.stdout: }, 2023-08-01T19:56:04.340 INFO:teuthology.orchestra.run.smithi155.stdout: "events": [ 2023-08-01T19:56:04.340 INFO:teuthology.orchestra.run.smithi155.stdout: { 2023-08-01T19:56:04.340 INFO:teuthology.orchestra.run.smithi155.stdout: "event": "initiated", 2023-08-01T19:56:04.341 INFO:teuthology.orchestra.run.smithi155.stdout: "time": "2023-08-01T19:55:58.580223+0000", 2023-08-01T19:56:04.341 INFO:teuthology.orchestra.run.smithi155.stdout: "duration": 0 2023-08-01T19:56:04.341 INFO:teuthology.orchestra.run.smithi155.stdout: }, 2023-08-01T19:56:04.341 INFO:teuthology.orchestra.run.smithi155.stdout: { 2023-08-01T19:56:04.341 INFO:teuthology.orchestra.run.smithi155.stdout: "event": "throttled", 2023-08-01T19:56:04.341 INFO:teuthology.orchestra.run.smithi155.stdout: "time": "2023-08-01T19:55:58.580223+0000", 2023-08-01T19:56:04.341 INFO:teuthology.orchestra.run.smithi155.stdout: "duration": 0 2023-08-01T19:56:04.342 INFO:teuthology.orchestra.run.smithi155.stdout: }, 2023-08-01T19:56:04.342 INFO:teuthology.orchestra.run.smithi155.stdout: { 2023-08-01T19:56:04.342 INFO:teuthology.orchestra.run.smithi155.stdout: "event": "header_read", 2023-08-01T19:56:04.342 INFO:teuthology.orchestra.run.smithi155.stdout: "time": "2023-08-01T19:55:58.580222+0000", 2023-08-01T19:56:04.342 INFO:teuthology.orchestra.run.smithi155.stdout: "duration": 4294967295.9999995 2023-08-01T19:56:04.342 INFO:teuthology.orchestra.run.smithi155.stdout: }, 2023-08-01T19:56:04.342 INFO:teuthology.orchestra.run.smithi155.stdout: { 2023-08-01T19:56:04.343 INFO:teuthology.orchestra.run.smithi155.stdout: "event": "all_read", 2023-08-01T19:56:04.343 INFO:teuthology.orchestra.run.smithi155.stdout: "time": "2023-08-01T19:55:58.580225+0000", 2023-08-01T19:56:04.343 INFO:teuthology.orchestra.run.smithi155.stdout: "duration": 3.2820000000000001e-06 2023-08-01T19:56:04.343 INFO:teuthology.orchestra.run.smithi155.stdout: }, 2023-08-01T19:56:04.343 INFO:teuthology.orchestra.run.smithi155.stdout: { 2023-08-01T19:56:04.343 INFO:teuthology.orchestra.run.smithi155.stdout: "event": "dispatched", 2023-08-01T19:56:04.343 INFO:teuthology.orchestra.run.smithi155.stdout: "time": "2023-08-01T19:55:58.580233+0000", 2023-08-01T19:56:04.343 INFO:teuthology.orchestra.run.smithi155.stdout: "duration": 7.34e-06 2023-08-01T19:56:04.344 INFO:teuthology.orchestra.run.smithi155.stdout: }, 2023-08-01T19:56:04.344 INFO:teuthology.orchestra.run.smithi155.stdout: { 2023-08-01T19:56:04.344 INFO:teuthology.orchestra.run.smithi155.stdout: "event": "queued_for_pg", 2023-08-01T19:56:04.344 INFO:teuthology.orchestra.run.smithi155.stdout: "time": "2023-08-01T19:55:58.580236+0000", 2023-08-01T19:56:04.344 INFO:teuthology.orchestra.run.smithi155.stdout: "duration": 3.473e-06 2023-08-01T19:56:04.344 INFO:teuthology.orchestra.run.smithi155.stdout: }, 2023-08-01T19:56:04.344 INFO:teuthology.orchestra.run.smithi155.stdout: { 2023-08-01T19:56:04.345 INFO:teuthology.orchestra.run.smithi155.stdout: "event": "reached_pg", 2023-08-01T19:56:04.345 INFO:teuthology.orchestra.run.smithi155.stdout: "time": "2023-08-01T19:55:58.580267+0000", 2023-08-01T19:56:04.345 INFO:teuthology.orchestra.run.smithi155.stdout: "duration": 3.0479000000000001e-05 2023-08-01T19:56:04.345 INFO:teuthology.orchestra.run.smithi155.stdout: }, 2023-08-01T19:56:04.345 INFO:teuthology.orchestra.run.smithi155.stdout: { 2023-08-01T19:56:04.345 INFO:teuthology.orchestra.run.smithi155.stdout: "event": "waiting for peered", 2023-08-01T19:56:04.345 INFO:teuthology.orchestra.run.smithi155.stdout: "time": "2023-08-01T19:55:58.580272+0000", 2023-08-01T19:56:04.346 INFO:teuthology.orchestra.run.smithi155.stdout: "duration": 5.011e-06 2023-08-01T19:56:04.346 INFO:teuthology.orchestra.run.smithi155.stdout: }, 2023-08-01T19:56:04.346 INFO:teuthology.orchestra.run.smithi155.stdout: { 2023-08-01T19:56:04.346 INFO:teuthology.orchestra.run.smithi155.stdout: "event": "reached_pg", 2023-08-01T19:56:04.346 INFO:teuthology.orchestra.run.smithi155.stdout: "time": "2023-08-01T19:55:59.604970+0000", 2023-08-01T19:56:04.346 INFO:teuthology.orchestra.run.smithi155.stdout: "duration": 1.0246984189999999 2023-08-01T19:56:04.346 INFO:teuthology.orchestra.run.smithi155.stdout: }, 2023-08-01T19:56:04.346 INFO:teuthology.orchestra.run.smithi155.stdout: { 2023-08-01T19:56:04.347 INFO:teuthology.orchestra.run.smithi155.stdout: "event": "started", 2023-08-01T19:56:04.347 INFO:teuthology.orchestra.run.smithi155.stdout: "time": "2023-08-01T19:55:59.605085+0000", 2023-08-01T19:56:04.347 INFO:teuthology.orchestra.run.smithi155.stdout: "duration": 0.00011531000000000001 2023-08-01T19:56:04.347 INFO:teuthology.orchestra.run.smithi155.stdout: }, 2023-08-01T19:56:04.347 INFO:teuthology.orchestra.run.smithi155.stdout: { 2023-08-01T19:56:04.347 INFO:teuthology.orchestra.run.smithi155.stdout: "event": "op_commit", 2023-08-01T19:56:04.347 INFO:teuthology.orchestra.run.smithi155.stdout: "time": "2023-08-01T19:55:59.608733+0000", 2023-08-01T19:56:04.348 INFO:teuthology.orchestra.run.smithi155.stdout: "duration": 0.0036478090000000001 2023-08-01T19:56:04.348 INFO:teuthology.orchestra.run.smithi155.stdout: }, 2023-08-01T19:56:04.348 INFO:teuthology.orchestra.run.smithi155.stdout: { 2023-08-01T19:56:04.348 INFO:teuthology.orchestra.run.smithi155.stdout: "event": "commit_sent", 2023-08-01T19:56:04.348 INFO:teuthology.orchestra.run.smithi155.stdout: "time": "2023-08-01T19:55:59.608771+0000", 2023-08-01T19:56:04.348 INFO:teuthology.orchestra.run.smithi155.stdout: "duration": 3.8033e-05 2023-08-01T19:56:04.348 INFO:teuthology.orchestra.run.smithi155.stdout: }, 2023-08-01T19:56:04.349 INFO:teuthology.orchestra.run.smithi155.stdout: { 2023-08-01T19:56:04.349 INFO:teuthology.orchestra.run.smithi155.stdout: "event": "done", 2023-08-01T19:56:04.349 INFO:teuthology.orchestra.run.smithi155.stdout: "time": "2023-08-01T19:55:59.608837+0000", 2023-08-01T19:56:04.349 INFO:teuthology.orchestra.run.smithi155.stdout: "duration": 6.5364000000000006e-05 2023-08-01T19:56:04.349 INFO:teuthology.orchestra.run.smithi155.stdout: } 2023-08-01T19:56:04.349 INFO:teuthology.orchestra.run.smithi155.stdout: ] 2023-08-01T19:56:04.349 INFO:teuthology.orchestra.run.smithi155.stdout: } 2023-08-01T19:56:04.350 INFO:teuthology.orchestra.run.smithi155.stdout: }, 2023-08-01T19:56:04.350 INFO:teuthology.orchestra.run.smithi155.stdout: { 2023-08-01T19:56:04.350 INFO:teuthology.orchestra.run.smithi155.stdout: "description": "osd_op(client.4668.0:197420 5.9 5:92a2efe5:::benchmark_data_smithi006_114134_object63759:head [delete] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e62)", 2023-08-01T19:56:04.350 INFO:teuthology.orchestra.run.smithi155.stdout: "initiated_at": "2023-08-01T19:55:58.582230+0000", 2023-08-01T19:56:04.350 INFO:teuthology.orchestra.run.smithi155.stdout: "age": 5.5645262129999997, 2023-08-01T19:56:04.350 INFO:teuthology.orchestra.run.smithi155.stdout: "duration": 1.0095353739999999, 2023-08-01T19:56:04.350 INFO:teuthology.orchestra.run.smithi155.stdout: "type_data": { 2023-08-01T19:56:04.351 INFO:teuthology.orchestra.run.smithi155.stdout: "flag_point": "commit sent; apply or cleanup", 2023-08-01T19:56:04.351 INFO:teuthology.orchestra.run.smithi155.stdout: "client_info": { 2023-08-01T19:56:04.351 INFO:teuthology.orchestra.run.smithi155.stdout: "client": "client.4668", 2023-08-01T19:56:04.351 INFO:teuthology.orchestra.run.smithi155.stdout: "client_addr": "172.21.15.6:0/1709472247", 2023-08-01T19:56:04.351 INFO:teuthology.orchestra.run.smithi155.stdout: "tid": 197420 2023-08-01T19:56:04.351 INFO:teuthology.orchestra.run.smithi155.stdout: }, 2023-08-01T19:56:04.351 INFO:teuthology.orchestra.run.smithi155.stdout: "events": [ 2023-08-01T19:56:04.351 INFO:teuthology.orchestra.run.smithi155.stdout: { 2023-08-01T19:56:04.352 INFO:teuthology.orchestra.run.smithi155.stdout: "event": "initiated", 2023-08-01T19:56:04.352 INFO:teuthology.orchestra.run.smithi155.stdout: "time": "2023-08-01T19:55:58.582230+0000", 2023-08-01T19:56:04.352 INFO:teuthology.orchestra.run.smithi155.stdout: "duration": 0 2023-08-01T19:56:04.352 INFO:teuthology.orchestra.run.smithi155.stdout: }, 2023-08-01T19:56:04.352 INFO:teuthology.orchestra.run.smithi155.stdout: { 2023-08-01T19:56:04.352 INFO:teuthology.orchestra.run.smithi155.stdout: "event": "throttled", 2023-08-01T19:56:04.352 INFO:teuthology.orchestra.run.smithi155.stdout: "time": "2023-08-01T19:55:58.582230+0000", 2023-08-01T19:56:04.352 INFO:teuthology.orchestra.run.smithi155.stdout: "duration": 0 2023-08-01T19:56:04.353 INFO:teuthology.orchestra.run.smithi155.stdout: }, 2023-08-01T19:56:04.353 INFO:teuthology.orchestra.run.smithi155.stdout: { 2023-08-01T19:56:04.353 INFO:teuthology.orchestra.run.smithi155.stdout: "event": "header_read", 2023-08-01T19:56:04.353 INFO:teuthology.orchestra.run.smithi155.stdout: "time": "2023-08-01T19:55:58.582229+0000", 2023-08-01T19:56:04.353 INFO:teuthology.orchestra.run.smithi155.stdout: "duration": 4294967295.9999995 2023-08-01T19:56:04.353 INFO:teuthology.orchestra.run.smithi155.stdout: }, 2023-08-01T19:56:04.354 INFO:teuthology.orchestra.run.smithi155.stdout: { 2023-08-01T19:56:04.354 INFO:teuthology.orchestra.run.smithi155.stdout: "event": "all_read", 2023-08-01T19:56:04.354 INFO:teuthology.orchestra.run.smithi155.stdout: "time": "2023-08-01T19:55:58.582233+0000", 2023-08-01T19:56:04.354 INFO:teuthology.orchestra.run.smithi155.stdout: "duration": 3.7869999999999999e-06 2023-08-01T19:56:04.354 INFO:teuthology.orchestra.run.smithi155.stdout: }, 2023-08-01T19:56:04.354 INFO:teuthology.orchestra.run.smithi155.stdout: { 2023-08-01T19:56:04.354 INFO:teuthology.orchestra.run.smithi155.stdout: "event": "dispatched", 2023-08-01T19:56:04.355 INFO:teuthology.orchestra.run.smithi155.stdout: "time": "2023-08-01T19:55:58.582241+0000", 2023-08-01T19:56:04.355 INFO:teuthology.orchestra.run.smithi155.stdout: "duration": 7.6909999999999997e-06 2023-08-01T19:56:04.355 INFO:teuthology.orchestra.run.smithi155.stdout: }, 2023-08-01T19:56:04.355 INFO:teuthology.orchestra.run.smithi155.stdout: { 2023-08-01T19:56:04.355 INFO:teuthology.orchestra.run.smithi155.stdout: "event": "queued_for_pg", 2023-08-01T19:56:04.355 INFO:teuthology.orchestra.run.smithi155.stdout: "time": "2023-08-01T19:55:58.582244+0000", 2023-08-01T19:56:04.355 INFO:teuthology.orchestra.run.smithi155.stdout: "duration": 3.6770000000000001e-06 2023-08-01T19:56:04.356 INFO:teuthology.orchestra.run.smithi155.stdout: }, 2023-08-01T19:56:04.356 INFO:teuthology.orchestra.run.smithi155.stdout: { 2023-08-01T19:56:04.356 INFO:teuthology.orchestra.run.smithi155.stdout: "event": "reached_pg", 2023-08-01T19:56:04.356 INFO:teuthology.orchestra.run.smithi155.stdout: "time": "2023-08-01T19:55:58.582274+0000", 2023-08-01T19:56:04.356 INFO:teuthology.orchestra.run.smithi155.stdout: "duration": 3.0074e-05 2023-08-01T19:56:04.356 INFO:teuthology.orchestra.run.smithi155.stdout: }, 2023-08-01T19:56:04.356 INFO:teuthology.orchestra.run.smithi155.stdout: { 2023-08-01T19:56:04.356 INFO:teuthology.orchestra.run.smithi155.stdout: "event": "waiting for peered", 2023-08-01T19:56:04.357 INFO:teuthology.orchestra.run.smithi155.stdout: "time": "2023-08-01T19:55:58.582281+0000", 2023-08-01T19:56:04.357 INFO:teuthology.orchestra.run.smithi155.stdout: "duration": 6.297e-06 2023-08-01T19:56:04.357 INFO:teuthology.orchestra.run.smithi155.stdout: }, 2023-08-01T19:56:04.357 INFO:teuthology.orchestra.run.smithi155.stdout: { 2023-08-01T19:56:04.357 INFO:teuthology.orchestra.run.smithi155.stdout: "event": "reached_pg", 2023-08-01T19:56:04.357 INFO:teuthology.orchestra.run.smithi155.stdout: "time": "2023-08-01T19:55:59.586809+0000", 2023-08-01T19:56:04.357 INFO:teuthology.orchestra.run.smithi155.stdout: "duration": 1.0045281720000001 2023-08-01T19:56:04.357 INFO:teuthology.orchestra.run.smithi155.stdout: }, 2023-08-01T19:56:04.358 INFO:teuthology.orchestra.run.smithi155.stdout: { 2023-08-01T19:56:04.358 INFO:teuthology.orchestra.run.smithi155.stdout: "event": "started", 2023-08-01T19:56:04.358 INFO:teuthology.orchestra.run.smithi155.stdout: "time": "2023-08-01T19:55:59.586910+0000", 2023-08-01T19:56:04.358 INFO:teuthology.orchestra.run.smithi155.stdout: "duration": 0.000100898 2023-08-01T19:56:04.358 INFO:teuthology.orchestra.run.smithi155.stdout: }, 2023-08-01T19:56:04.358 INFO:teuthology.orchestra.run.smithi155.stdout: { 2023-08-01T19:56:04.358 INFO:teuthology.orchestra.run.smithi155.stdout: "event": "op_commit", 2023-08-01T19:56:04.359 INFO:teuthology.orchestra.run.smithi155.stdout: "time": "2023-08-01T19:55:59.591679+0000", 2023-08-01T19:56:04.359 INFO:teuthology.orchestra.run.smithi155.stdout: "duration": 0.004769471 2023-08-01T19:56:04.359 INFO:teuthology.orchestra.run.smithi155.stdout: }, 2023-08-01T19:56:04.359 INFO:teuthology.orchestra.run.smithi155.stdout: { 2023-08-01T19:56:04.359 INFO:teuthology.orchestra.run.smithi155.stdout: "event": "commit_sent", 2023-08-01T19:56:04.359 INFO:teuthology.orchestra.run.smithi155.stdout: "time": "2023-08-01T19:55:59.591721+0000", 2023-08-01T19:56:04.359 INFO:teuthology.orchestra.run.smithi155.stdout: "duration": 4.1953000000000003e-05 2023-08-01T19:56:04.359 INFO:teuthology.orchestra.run.smithi155.stdout: }, 2023-08-01T19:56:04.360 INFO:teuthology.orchestra.run.smithi155.stdout: { 2023-08-01T19:56:04.360 INFO:teuthology.orchestra.run.smithi155.stdout: "event": "done", 2023-08-01T19:56:04.360 INFO:teuthology.orchestra.run.smithi155.stdout: "time": "2023-08-01T19:55:59.591765+0000", 2023-08-01T19:56:04.360 INFO:teuthology.orchestra.run.smithi155.stdout: "duration": 4.4030999999999999e-05 2023-08-01T19:56:04.360 INFO:teuthology.orchestra.run.smithi155.stdout: } 2023-08-01T19:56:04.360 INFO:teuthology.orchestra.run.smithi155.stdout: ] 2023-08-01T19:56:04.360 INFO:teuthology.orchestra.run.smithi155.stdout: } 2023-08-01T19:56:04.360 INFO:teuthology.orchestra.run.smithi155.stdout: } 2023-08-01T19:56:04.361 INFO:teuthology.orchestra.run.smithi155.stdout: ] 2023-08-01T19:56:04.361 INFO:teuthology.orchestra.run.smithi155.stdout:} 2023-08-01T19:56:04.362 INFO:teuthology.orchestra.run.smithi006.stdout:osd.0: {} 2023-08-01T19:56:04.362 INFO:teuthology.orchestra.run.smithi006.stdout:osd.2: {} 2023-08-01T19:56:04.363 INFO:tasks.ceph.osd.2.smithi155.stderr:2023-08-01T19:56:04.360+0000 7faa5c6ac700 -1 received signal: Hangup from /usr/bin/python3 /bin/daemon-helper kill ceph-osd -f --cluster ceph -i 2 (PID: 111337) UID: 0 2023-08-01T19:56:04.363 DEBUG:teuthology.orchestra.run:got remote process result: 6 2023-08-01T19:56:04.363 DEBUG:teuthology.orchestra.run.smithi008:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 30 ceph --cluster ceph --admin-daemon /var/run/ceph/ceph-osd.0.asok dump_ops_in_flight 2023-08-01T19:56:04.364 INFO:teuthology.orchestra.run.smithi006.stderr:osd.0: osd_enable_op_tracker = 'false' 2023-08-01T19:56:04.364 INFO:teuthology.orchestra.run.smithi006.stderr:Error ENXIO: problem getting command descriptions from osd.1 2023-08-01T19:56:04.364 INFO:teuthology.orchestra.run.smithi006.stderr:osd.2: osd_enable_op_tracker = 'false' 2023-08-01T19:56:04.365 INFO:tasks.thrashosds.thrasher:Failed to tell all osds, ignoring 2023-08-01T19:56:04.465 INFO:tasks.ceph.osd.0.smithi008.stderr:2023-08-01T19:56:04.463+0000 7f16a58f4700 -1 received signal: Hangup from /usr/bin/python3 /bin/daemon-helper kill ceph-osd -f --cluster ceph -i 0 (PID: 111179) UID: 0 2023-08-01T19:56:04.546 INFO:teuthology.orchestra.run.smithi008.stdout:ERROR: (22) Invalid argument 2023-08-01T19:56:04.547 INFO:teuthology.orchestra.run.smithi008.stdout:op_tracker tracking is not enabled now, so no ops are tracked currently, even those get stuck. Please enable "osd_enable_op_tracker", and the tracker will start to track new ops received afterwards. 2023-08-01T19:56:04.560 DEBUG:teuthology.orchestra.run.smithi008:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 30 ceph --cluster ceph --admin-daemon /var/run/ceph/ceph-osd.0.asok dump_blocked_ops 2023-08-01T19:56:04.602 INFO:tasks.ceph.osd.0.smithi008.stderr:2023-08-01T19:56:04.600+0000 7f16a58f4700 -1 received signal: Hangup from /usr/bin/python3 /bin/daemon-helper kill ceph-osd -f --cluster ceph -i 0 (PID: 111179) UID: 0 2023-08-01T19:56:04.665 INFO:tasks.ceph.osd.0.smithi008.stderr:2023-08-01T19:56:04.664+0000 7f16a58f4700 -1 received signal: Hangup from /usr/bin/python3 /bin/daemon-helper kill ceph-osd -f --cluster ceph -i 0 (PID: 111179) UID: 0 2023-08-01T19:56:04.766 INFO:tasks.ceph.osd.0.smithi008.stderr:2023-08-01T19:56:04.764+0000 7f16a58f4700 -1 received signal: Hangup from /usr/bin/python3 /bin/daemon-helper kill ceph-osd -f --cluster ceph -i 0 (PID: 111179) UID: 0 2023-08-01T19:56:04.794 INFO:teuthology.orchestra.run.smithi008.stdout:ERROR: (22) Invalid argument 2023-08-01T19:56:04.794 INFO:teuthology.orchestra.run.smithi008.stdout:op_tracker tracking is not enabled now, so no ops are tracked currently, even those get stuck. Please enable "osd_enable_op_tracker", and the tracker will start to track new ops received afterwards. 2023-08-01T19:56:04.810 DEBUG:teuthology.orchestra.run.smithi008:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 30 ceph --cluster ceph --admin-daemon /var/run/ceph/ceph-osd.0.asok dump_historic_ops 2023-08-01T19:56:04.866 INFO:tasks.ceph.osd.2.smithi155.stderr:2023-08-01T19:56:04.865+0000 7faa5c6ac700 -1 received signal: Hangup from /usr/bin/python3 /bin/daemon-helper kill ceph-osd -f --cluster ceph -i 2 (PID: 111337) UID: 0 2023-08-01T19:56:04.967 INFO:tasks.ceph.osd.0.smithi008.stderr:2023-08-01T19:56:04.965+0000 7f16a58f4700 -1 received signal: Hangup from /usr/bin/python3 /bin/daemon-helper kill ceph-osd -f --cluster ceph -i 0 (PID: 111179) UID: 0 2023-08-01T19:56:05.038 INFO:teuthology.orchestra.run.smithi008.stdout:ERROR: (22) Invalid argument 2023-08-01T19:56:05.038 INFO:teuthology.orchestra.run.smithi008.stdout:op_tracker tracking is not enabled now, so no ops are tracked currently, even those get stuck. Please enable "osd_enable_op_tracker", and the tracker will start to track new ops received afterwards. 2023-08-01T19:56:05.054 DEBUG:teuthology.orchestra.run.smithi155:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 30 ceph --cluster ceph --admin-daemon /var/run/ceph/ceph-osd.2.asok dump_ops_in_flight 2023-08-01T19:56:05.097 INFO:tasks.ceph.osd.2.smithi155.stderr:2023-08-01T19:56:05.096+0000 7faa5c6ac700 -1 received signal: Hangup from /usr/bin/python3 /bin/daemon-helper kill ceph-osd -f --cluster ceph -i 2 (PID: 111337) UID: 0 2023-08-01T19:56:05.169 INFO:tasks.ceph.osd.2.smithi155.stderr:2023-08-01T19:56:05.167+0000 7faa5c6ac700 -1 received signal: Hangup from /usr/bin/python3 /bin/daemon-helper kill ceph-osd -f --cluster ceph -i 2 (PID: 111337) UID: 0 2023-08-01T19:56:05.233 INFO:teuthology.orchestra.run.smithi155.stdout:ERROR: (22) Invalid argument 2023-08-01T19:56:05.233 INFO:teuthology.orchestra.run.smithi155.stdout:op_tracker tracking is not enabled now, so no ops are tracked currently, even those get stuck. Please enable "osd_enable_op_tracker", and the tracker will start to track new ops received afterwards. 2023-08-01T19:56:05.247 DEBUG:teuthology.orchestra.run.smithi155:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 30 ceph --cluster ceph --admin-daemon /var/run/ceph/ceph-osd.2.asok dump_blocked_ops 2023-08-01T19:56:05.270 INFO:tasks.ceph.osd.0.smithi008.stderr:2023-08-01T19:56:05.268+0000 7f16a58f4700 -1 received signal: Hangup from /usr/bin/python3 /bin/daemon-helper kill ceph-osd -f --cluster ceph -i 0 (PID: 111179) UID: 0 2023-08-01T19:56:05.370 INFO:tasks.ceph.osd.0.smithi008.stderr:2023-08-01T19:56:05.369+0000 7f16a58f4700 -1 received signal: Hangup from /usr/bin/python3 /bin/daemon-helper kill ceph-osd -f --cluster ceph -i 0 (PID: 111179) UID: 0 2023-08-01T19:56:05.448 INFO:teuthology.orchestra.run.smithi155.stdout:ERROR: (22) Invalid argument 2023-08-01T19:56:05.449 INFO:teuthology.orchestra.run.smithi155.stdout:op_tracker tracking is not enabled now, so no ops are tracked currently, even those get stuck. Please enable "osd_enable_op_tracker", and the tracker will start to track new ops received afterwards. 2023-08-01T19:56:05.464 DEBUG:teuthology.orchestra.run.smithi155:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 30 ceph --cluster ceph --admin-daemon /var/run/ceph/ceph-osd.2.asok dump_historic_ops 2023-08-01T19:56:05.471 INFO:tasks.ceph.osd.0.smithi008.stderr:2023-08-01T19:56:05.469+0000 7f16a58f4700 -1 received signal: Hangup from /usr/bin/python3 /bin/daemon-helper kill ceph-osd -f --cluster ceph -i 0 (PID: 111179) UID: 0 2023-08-01T19:56:05.572 INFO:tasks.ceph.osd.0.smithi008.stderr:2023-08-01T19:56:05.570+0000 7f16a58f4700 -1 received signal: Hangup from /usr/bin/python3 /bin/daemon-helper kill ceph-osd -f --cluster ceph -i 0 (PID: 111179) UID: 0 2023-08-01T19:56:05.596 DEBUG:teuthology.orchestra.run.smithi006:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 120 ceph --cluster ceph osd unset nodeep-scrub 2023-08-01T19:56:05.627 INFO:teuthology.orchestra.run.smithi155.stdout:ERROR: (22) Invalid argument 2023-08-01T19:56:05.627 INFO:teuthology.orchestra.run.smithi155.stdout:op_tracker tracking is not enabled now, so no ops are tracked currently, even those get stuck. Please enable "osd_enable_op_tracker", and the tracker will start to track new ops received afterwards. 2023-08-01T19:56:05.642 DEBUG:teuthology.orchestra.run.smithi008:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 30 ceph --cluster ceph --admin-daemon /var/run/ceph/ceph-osd.0.asok dump_ops_in_flight 2023-08-01T19:56:05.673 INFO:tasks.ceph.osd.2.smithi155.stderr:2023-08-01T19:56:05.671+0000 7faa5c6ac700 -1 received signal: Hangup from /usr/bin/python3 /bin/daemon-helper kill ceph-osd -f --cluster ceph -i 2 (PID: 111337) UID: 0 2023-08-01T19:56:05.773 INFO:tasks.ceph.osd.2.smithi155.stderr:2023-08-01T19:56:05.772+0000 7faa5c6ac700 -1 received signal: Hangup from /usr/bin/python3 /bin/daemon-helper kill ceph-osd -f --cluster ceph -i 2 (PID: 111337) UID: 0 2023-08-01T19:56:05.830 INFO:teuthology.orchestra.run.smithi008.stdout:ERROR: (22) Invalid argument 2023-08-01T19:56:05.831 INFO:teuthology.orchestra.run.smithi008.stdout:op_tracker tracking is not enabled now, so no ops are tracked currently, even those get stuck. Please enable "osd_enable_op_tracker", and the tracker will start to track new ops received afterwards. 2023-08-01T19:56:05.845 DEBUG:teuthology.orchestra.run.smithi008:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 30 ceph --cluster ceph --admin-daemon /var/run/ceph/ceph-osd.0.asok dump_blocked_ops 2023-08-01T19:56:05.890 INFO:tasks.ceph.osd.0.smithi008.stderr:2023-08-01T19:56:05.889+0000 7f16a58f4700 -1 received signal: Hangup from /usr/bin/python3 /bin/daemon-helper kill ceph-osd -f --cluster ceph -i 0 (PID: 111179) UID: 0 2023-08-01T19:56:05.975 INFO:tasks.ceph.osd.0.smithi008.stderr:2023-08-01T19:56:05.973+0000 7f16a58f4700 -1 received signal: Hangup from /usr/bin/python3 /bin/daemon-helper kill ceph-osd -f --cluster ceph -i 0 (PID: 111179) UID: 0 2023-08-01T19:56:06.004 INFO:teuthology.orchestra.run.smithi006.stderr:nodeep-scrub is unset 2023-08-01T19:56:06.022 INFO:teuthology.orchestra.run.smithi008.stdout:ERROR: (22) Invalid argument 2023-08-01T19:56:06.022 INFO:teuthology.orchestra.run.smithi008.stdout:op_tracker tracking is not enabled now, so no ops are tracked currently, even those get stuck. Please enable "osd_enable_op_tracker", and the tracker will start to track new ops received afterwards. 2023-08-01T19:56:06.038 DEBUG:teuthology.orchestra.run.smithi008:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 30 ceph --cluster ceph --admin-daemon /var/run/ceph/ceph-osd.0.asok dump_historic_ops 2023-08-01T19:56:06.076 INFO:tasks.ceph.osd.2.smithi155.stderr:2023-08-01T19:56:06.074+0000 7faa5c6ac700 -1 received signal: Hangup from /usr/bin/python3 /bin/daemon-helper kill ceph-osd -f --cluster ceph -i 2 (PID: 111337) UID: 0 2023-08-01T19:56:06.177 INFO:tasks.ceph.osd.0.smithi008.stderr:2023-08-01T19:56:06.175+0000 7f16a58f4700 -1 received signal: Hangup from /usr/bin/python3 /bin/daemon-helper kill ceph-osd -f --cluster ceph -i 0 (PID: 111179) UID: 0 2023-08-01T19:56:06.259 INFO:teuthology.orchestra.run.smithi008.stdout:ERROR: (22) Invalid argument 2023-08-01T19:56:06.259 INFO:teuthology.orchestra.run.smithi008.stdout:op_tracker tracking is not enabled now, so no ops are tracked currently, even those get stuck. Please enable "osd_enable_op_tracker", and the tracker will start to track new ops received afterwards. 2023-08-01T19:56:06.274 DEBUG:teuthology.orchestra.run.smithi155:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 30 ceph --cluster ceph --admin-daemon /var/run/ceph/ceph-osd.2.asok dump_ops_in_flight 2023-08-01T19:56:06.319 INFO:tasks.ceph.osd.2.smithi155.stderr:2023-08-01T19:56:06.318+0000 7faa5c6ac700 -1 received signal: Hangup from /usr/bin/python3 /bin/daemon-helper kill ceph-osd -f --cluster ceph -i 2 (PID: 111337) UID: 0 2023-08-01T19:56:06.366 DEBUG:teuthology.orchestra.run.smithi006:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 120 ceph --cluster ceph -- tell 'osd.*' injectargs --osd_enable_op_tracker=true 2023-08-01T19:56:06.379 INFO:tasks.ceph.osd.0.smithi008.stderr:2023-08-01T19:56:06.377+0000 7f16a58f4700 -1 received signal: Hangup from /usr/bin/python3 /bin/daemon-helper kill ceph-osd -f --cluster ceph -i 0 (PID: 111179) UID: 0 2023-08-01T19:56:06.441 INFO:teuthology.orchestra.run.smithi155.stdout:ERROR: (22) Invalid argument 2023-08-01T19:56:06.442 INFO:teuthology.orchestra.run.smithi155.stdout:op_tracker tracking is not enabled now, so no ops are tracked currently, even those get stuck. Please enable "osd_enable_op_tracker", and the tracker will start to track new ops received afterwards. 2023-08-01T19:56:06.454 DEBUG:teuthology.orchestra.run.smithi155:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 30 ceph --cluster ceph --admin-daemon /var/run/ceph/ceph-osd.2.asok dump_blocked_ops 2023-08-01T19:56:06.495 INFO:tasks.ceph.osd.2.smithi155.stderr:2023-08-01T19:56:06.494+0000 7faa5c6ac700 -1 received signal: Hangup from /usr/bin/python3 /bin/daemon-helper kill ceph-osd -f --cluster ceph -i 2 (PID: 111337) UID: 0 2023-08-01T19:56:06.513 INFO:teuthology.orchestra.run.smithi006.stdout:osd.0: {} 2023-08-01T19:56:06.536 INFO:teuthology.orchestra.run.smithi006.stdout:osd.2: {} 2023-08-01T19:56:06.536 INFO:teuthology.orchestra.run.smithi006.stderr:osd.0: osd_enable_op_tracker = 'true' 2023-08-01T19:56:06.536 INFO:teuthology.orchestra.run.smithi006.stderr:Error ENXIO: problem getting command descriptions from osd.1 2023-08-01T19:56:06.536 INFO:teuthology.orchestra.run.smithi006.stderr:osd.2: osd_enable_op_tracker = 'true' 2023-08-01T19:56:06.538 DEBUG:teuthology.orchestra.run:got remote process result: 6 2023-08-01T19:56:06.539 INFO:tasks.thrashosds.thrasher:Failed to tell all osds, ignoring 2023-08-01T19:56:06.580 INFO:tasks.ceph.osd.2.smithi155.stderr:2023-08-01T19:56:06.578+0000 7faa5c6ac700 -1 received signal: Hangup from /usr/bin/python3 /bin/daemon-helper kill ceph-osd -f --cluster ceph -i 2 (PID: 111337) UID: 0 2023-08-01T19:56:06.658 INFO:teuthology.orchestra.run.smithi155.stdout:{ 2023-08-01T19:56:06.658 INFO:teuthology.orchestra.run.smithi155.stdout: "ops": [], 2023-08-01T19:56:06.658 INFO:teuthology.orchestra.run.smithi155.stdout: "complaint_time": 30, 2023-08-01T19:56:06.658 INFO:teuthology.orchestra.run.smithi155.stdout: "num_blocked_ops": 0 2023-08-01T19:56:06.658 INFO:teuthology.orchestra.run.smithi155.stdout:} 2023-08-01T19:56:06.673 DEBUG:teuthology.orchestra.run.smithi155:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 30 ceph --cluster ceph --admin-daemon /var/run/ceph/ceph-osd.2.asok dump_historic_ops 2023-08-01T19:56:06.681 INFO:tasks.ceph.osd.0.smithi008.stderr:2023-08-01T19:56:06.679+0000 7f16a58f4700 -1 received signal: Hangup from /usr/bin/python3 /bin/daemon-helper kill ceph-osd -f --cluster ceph -i 0 (PID: 111179) UID: 0 2023-08-01T19:56:06.782 INFO:tasks.ceph.osd.0.smithi008.stderr:2023-08-01T19:56:06.780+0000 7f16a58f4700 -1 received signal: Hangup from /usr/bin/python3 /bin/daemon-helper kill ceph-osd -f --cluster ceph -i 0 (PID: 111179) UID: 0 2023-08-01T19:56:06.877 INFO:teuthology.orchestra.run.smithi155.stdout:{ 2023-08-01T19:56:06.877 INFO:teuthology.orchestra.run.smithi155.stdout: "size": 20, 2023-08-01T19:56:06.877 INFO:teuthology.orchestra.run.smithi155.stdout: "duration": 600, 2023-08-01T19:56:06.877 INFO:teuthology.orchestra.run.smithi155.stdout: "ops": [ 2023-08-01T19:56:06.877 INFO:teuthology.orchestra.run.smithi155.stdout: { 2023-08-01T19:56:06.878 INFO:teuthology.orchestra.run.smithi155.stdout: "description": "osd_op(client.4668.0:100237 5.4 5:2d68bec9:::benchmark_data_smithi006_114134_object100236:head [set-alloc-hint object_size 65536 write_size 65536,write 0~65536] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e37)", 2023-08-01T19:56:06.878 INFO:teuthology.orchestra.run.smithi155.stdout: "initiated_at": "2023-08-01T19:55:05.147736+0000", 2023-08-01T19:56:06.878 INFO:teuthology.orchestra.run.smithi155.stdout: "age": 61.726683848999997, 2023-08-01T19:56:06.878 INFO:teuthology.orchestra.run.smithi155.stdout: "duration": 0.071299464000000007, 2023-08-01T19:56:06.878 INFO:teuthology.orchestra.run.smithi155.stdout: "type_data": { 2023-08-01T19:56:06.878 INFO:teuthology.orchestra.run.smithi155.stdout: "flag_point": "commit sent; apply or cleanup", 2023-08-01T19:56:06.878 INFO:teuthology.orchestra.run.smithi155.stdout: "client_info": { 2023-08-01T19:56:06.879 INFO:teuthology.orchestra.run.smithi155.stdout: "client": "client.4668", 2023-08-01T19:56:06.879 INFO:teuthology.orchestra.run.smithi155.stdout: "client_addr": "172.21.15.6:0/1709472247", 2023-08-01T19:56:06.879 INFO:teuthology.orchestra.run.smithi155.stdout: "tid": 100237 2023-08-01T19:56:06.879 INFO:teuthology.orchestra.run.smithi155.stdout: }, 2023-08-01T19:56:06.879 INFO:teuthology.orchestra.run.smithi155.stdout: "events": [ 2023-08-01T19:56:06.879 INFO:teuthology.orchestra.run.smithi155.stdout: { 2023-08-01T19:56:06.879 INFO:teuthology.orchestra.run.smithi155.stdout: "event": "initiated", 2023-08-01T19:56:06.879 INFO:teuthology.orchestra.run.smithi155.stdout: "time": "2023-08-01T19:55:05.147736+0000", 2023-08-01T19:56:06.880 INFO:teuthology.orchestra.run.smithi155.stdout: "duration": 0 2023-08-01T19:56:06.880 INFO:teuthology.orchestra.run.smithi155.stdout: }, 2023-08-01T19:56:06.880 INFO:teuthology.orchestra.run.smithi155.stdout: { 2023-08-01T19:56:06.880 INFO:teuthology.orchestra.run.smithi155.stdout: "event": "throttled", 2023-08-01T19:56:06.880 INFO:teuthology.orchestra.run.smithi155.stdout: "time": "2023-08-01T19:55:05.147736+0000", 2023-08-01T19:56:06.880 INFO:teuthology.orchestra.run.smithi155.stdout: "duration": 0 2023-08-01T19:56:06.880 INFO:teuthology.orchestra.run.smithi155.stdout: }, 2023-08-01T19:56:06.881 INFO:teuthology.orchestra.run.smithi155.stdout: { 2023-08-01T19:56:06.881 INFO:teuthology.orchestra.run.smithi155.stdout: "event": "header_read", 2023-08-01T19:56:06.881 INFO:teuthology.orchestra.run.smithi155.stdout: "time": "2023-08-01T19:55:05.147736+0000", 2023-08-01T19:56:06.881 INFO:teuthology.orchestra.run.smithi155.stdout: "duration": 4294967295.9999995 2023-08-01T19:56:06.881 INFO:teuthology.orchestra.run.smithi155.stdout: }, 2023-08-01T19:56:06.881 INFO:teuthology.orchestra.run.smithi155.stdout: { 2023-08-01T19:56:06.881 INFO:teuthology.orchestra.run.smithi155.stdout: "event": "all_read", 2023-08-01T19:56:06.881 INFO:teuthology.orchestra.run.smithi155.stdout: "time": "2023-08-01T19:55:05.147766+0000", 2023-08-01T19:56:06.882 INFO:teuthology.orchestra.run.smithi155.stdout: "duration": 3.0394000000000001e-05 2023-08-01T19:56:06.882 INFO:teuthology.orchestra.run.smithi155.stdout: }, 2023-08-01T19:56:06.882 INFO:teuthology.orchestra.run.smithi155.stdout: { 2023-08-01T19:56:06.882 INFO:teuthology.orchestra.run.smithi155.stdout: "event": "dispatched", 2023-08-01T19:56:06.882 INFO:teuthology.orchestra.run.smithi155.stdout: "time": "2023-08-01T19:55:05.147771+0000", 2023-08-01T19:56:06.882 INFO:teuthology.orchestra.run.smithi155.stdout: "duration": 4.25e-06 2023-08-01T19:56:06.882 INFO:teuthology.orchestra.run.smithi155.stdout: }, 2023-08-01T19:56:06.882 INFO:teuthology.orchestra.run.smithi155.stdout: { 2023-08-01T19:56:06.883 INFO:teuthology.orchestra.run.smithi155.stdout: "event": "queued_for_pg", 2023-08-01T19:56:06.883 INFO:teuthology.orchestra.run.smithi155.stdout: "time": "2023-08-01T19:55:05.147773+0000", 2023-08-01T19:56:06.883 INFO:teuthology.orchestra.run.smithi155.stdout: "duration": 2.4159999999999998e-06 2023-08-01T19:56:06.883 INFO:teuthology.orchestra.run.smithi155.stdout: }, 2023-08-01T19:56:06.883 INFO:teuthology.orchestra.run.smithi155.stdout: { 2023-08-01T19:56:06.883 INFO:teuthology.orchestra.run.smithi155.stdout: "event": "reached_pg", 2023-08-01T19:56:06.883 INFO:teuthology.orchestra.run.smithi155.stdout: "time": "2023-08-01T19:55:05.149903+0000", 2023-08-01T19:56:06.884 INFO:teuthology.orchestra.run.smithi155.stdout: "duration": 0.002129948 2023-08-01T19:56:06.884 INFO:teuthology.orchestra.run.smithi155.stdout: }, 2023-08-01T19:56:06.884 INFO:teuthology.orchestra.run.smithi155.stdout: { 2023-08-01T19:56:06.884 INFO:teuthology.orchestra.run.smithi155.stdout: "event": "started", 2023-08-01T19:56:06.884 INFO:teuthology.orchestra.run.smithi155.stdout: "time": "2023-08-01T19:55:05.149982+0000", 2023-08-01T19:56:06.884 INFO:teuthology.orchestra.run.smithi155.stdout: "duration": 7.8706000000000002e-05 2023-08-01T19:56:06.884 INFO:teuthology.orchestra.run.smithi155.stdout: }, 2023-08-01T19:56:06.884 INFO:teuthology.orchestra.run.smithi155.stdout: { 2023-08-01T19:56:06.885 INFO:teuthology.orchestra.run.smithi155.stdout: "event": "waiting for subops from 0", 2023-08-01T19:56:06.885 INFO:teuthology.orchestra.run.smithi155.stdout: "time": "2023-08-01T19:55:05.150066+0000", 2023-08-01T19:56:06.885 INFO:teuthology.orchestra.run.smithi155.stdout: "duration": 8.4241999999999997e-05 2023-08-01T19:56:06.885 INFO:teuthology.orchestra.run.smithi155.stdout: }, 2023-08-01T19:56:06.885 INFO:teuthology.orchestra.run.smithi155.stdout: { 2023-08-01T19:56:06.885 INFO:teuthology.orchestra.run.smithi155.stdout: "event": "op_commit", 2023-08-01T19:56:06.885 INFO:teuthology.orchestra.run.smithi155.stdout: "time": "2023-08-01T19:55:05.154994+0000", 2023-08-01T19:56:06.885 INFO:teuthology.orchestra.run.smithi155.stdout: "duration": 0.0049277050000000001 2023-08-01T19:56:06.886 INFO:teuthology.orchestra.run.smithi155.stdout: }, 2023-08-01T19:56:06.886 INFO:teuthology.orchestra.run.smithi155.stdout: { 2023-08-01T19:56:06.886 INFO:teuthology.orchestra.run.smithi155.stdout: "event": "sub_op_commit_rec", 2023-08-01T19:56:06.886 INFO:teuthology.orchestra.run.smithi155.stdout: "time": "2023-08-01T19:55:05.218933+0000", 2023-08-01T19:56:06.886 INFO:teuthology.orchestra.run.smithi155.stdout: "duration": 0.063939916999999999 2023-08-01T19:56:06.886 INFO:teuthology.orchestra.run.smithi155.stdout: }, 2023-08-01T19:56:06.886 INFO:teuthology.orchestra.run.smithi155.stdout: { 2023-08-01T19:56:06.886 INFO:teuthology.orchestra.run.smithi155.stdout: "event": "commit_sent", 2023-08-01T19:56:06.887 INFO:teuthology.orchestra.run.smithi155.stdout: "time": "2023-08-01T19:55:05.218989+0000", 2023-08-01T19:56:06.887 INFO:teuthology.orchestra.run.smithi155.stdout: "duration": 5.5772000000000001e-05 2023-08-01T19:56:06.887 INFO:teuthology.orchestra.run.smithi155.stdout: }, 2023-08-01T19:56:06.887 INFO:teuthology.orchestra.run.smithi155.stdout: { 2023-08-01T19:56:06.887 INFO:teuthology.orchestra.run.smithi155.stdout: "event": "done", 2023-08-01T19:56:06.887 INFO:teuthology.orchestra.run.smithi155.stdout: "time": "2023-08-01T19:55:05.219036+0000", 2023-08-01T19:56:06.887 INFO:teuthology.orchestra.run.smithi155.stdout: "duration": 4.6526000000000001e-05 2023-08-01T19:56:06.888 INFO:teuthology.orchestra.run.smithi155.stdout: } 2023-08-01T19:56:06.888 INFO:teuthology.orchestra.run.smithi155.stdout: ] 2023-08-01T19:56:06.888 INFO:teuthology.orchestra.run.smithi155.stdout: } 2023-08-01T19:56:06.888 INFO:teuthology.orchestra.run.smithi155.stdout: }, 2023-08-01T19:56:06.888 INFO:teuthology.orchestra.run.smithi155.stdout: { 2023-08-01T19:56:06.888 INFO:teuthology.orchestra.run.smithi155.stdout: "description": "osd_op(client.4668.0:100242 5.8 5:16a314b8:::benchmark_data_smithi006_114134_object100241:head [set-alloc-hint object_size 65536 write_size 65536,write 0~65536] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e37)", 2023-08-01T19:56:06.888 INFO:teuthology.orchestra.run.smithi155.stdout: "initiated_at": "2023-08-01T19:55:05.150616+0000", 2023-08-01T19:56:06.888 INFO:teuthology.orchestra.run.smithi155.stdout: "age": 61.723804219000002, 2023-08-01T19:56:06.889 INFO:teuthology.orchestra.run.smithi155.stdout: "duration": 0.071105065999999995, 2023-08-01T19:56:06.889 INFO:teuthology.orchestra.run.smithi155.stdout: "type_data": { 2023-08-01T19:56:06.889 INFO:teuthology.orchestra.run.smithi155.stdout: "flag_point": "commit sent; apply or cleanup", 2023-08-01T19:56:06.889 INFO:teuthology.orchestra.run.smithi155.stdout: "client_info": { 2023-08-01T19:56:06.889 INFO:teuthology.orchestra.run.smithi155.stdout: "client": "client.4668", 2023-08-01T19:56:06.889 INFO:teuthology.orchestra.run.smithi155.stdout: "client_addr": "172.21.15.6:0/1709472247", 2023-08-01T19:56:06.889 INFO:teuthology.orchestra.run.smithi155.stdout: "tid": 100242 2023-08-01T19:56:06.889 INFO:teuthology.orchestra.run.smithi155.stdout: }, 2023-08-01T19:56:06.890 INFO:teuthology.orchestra.run.smithi155.stdout: "events": [ 2023-08-01T19:56:06.890 INFO:teuthology.orchestra.run.smithi155.stdout: { 2023-08-01T19:56:06.890 INFO:teuthology.orchestra.run.smithi155.stdout: "event": "initiated", 2023-08-01T19:56:06.890 INFO:teuthology.orchestra.run.smithi155.stdout: "time": "2023-08-01T19:55:05.150616+0000", 2023-08-01T19:56:06.890 INFO:teuthology.orchestra.run.smithi155.stdout: "duration": 0 2023-08-01T19:56:06.890 INFO:teuthology.orchestra.run.smithi155.stdout: }, 2023-08-01T19:56:06.890 INFO:teuthology.orchestra.run.smithi155.stdout: { 2023-08-01T19:56:06.890 INFO:teuthology.orchestra.run.smithi155.stdout: "event": "throttled", 2023-08-01T19:56:06.891 INFO:teuthology.orchestra.run.smithi155.stdout: "time": "2023-08-01T19:55:05.150616+0000", 2023-08-01T19:56:06.891 INFO:teuthology.orchestra.run.smithi155.stdout: "duration": 0 2023-08-01T19:56:06.891 INFO:teuthology.orchestra.run.smithi155.stdout: }, 2023-08-01T19:56:06.891 INFO:teuthology.orchestra.run.smithi155.stdout: { 2023-08-01T19:56:06.891 INFO:teuthology.orchestra.run.smithi155.stdout: "event": "header_read", 2023-08-01T19:56:06.891 INFO:teuthology.orchestra.run.smithi155.stdout: "time": "2023-08-01T19:55:05.150615+0000", 2023-08-01T19:56:06.891 INFO:teuthology.orchestra.run.smithi155.stdout: "duration": 4294967295.999999 2023-08-01T19:56:06.891 INFO:teuthology.orchestra.run.smithi155.stdout: }, 2023-08-01T19:56:06.892 INFO:teuthology.orchestra.run.smithi155.stdout: { 2023-08-01T19:56:06.892 INFO:teuthology.orchestra.run.smithi155.stdout: "event": "all_read", 2023-08-01T19:56:06.892 INFO:teuthology.orchestra.run.smithi155.stdout: "time": "2023-08-01T19:55:05.150696+0000", 2023-08-01T19:56:06.892 INFO:teuthology.orchestra.run.smithi155.stdout: "duration": 8.0852000000000004e-05 2023-08-01T19:56:06.892 INFO:teuthology.orchestra.run.smithi155.stdout: }, 2023-08-01T19:56:06.892 INFO:teuthology.orchestra.run.smithi155.stdout: { 2023-08-01T19:56:06.892 INFO:teuthology.orchestra.run.smithi155.stdout: "event": "dispatched", 2023-08-01T19:56:06.892 INFO:teuthology.orchestra.run.smithi155.stdout: "time": "2023-08-01T19:55:05.150708+0000", 2023-08-01T19:56:06.893 INFO:teuthology.orchestra.run.smithi155.stdout: "duration": 1.2116999999999999e-05 2023-08-01T19:56:06.893 INFO:teuthology.orchestra.run.smithi155.stdout: }, 2023-08-01T19:56:06.893 INFO:teuthology.orchestra.run.smithi155.stdout: { 2023-08-01T19:56:06.893 INFO:teuthology.orchestra.run.smithi155.stdout: "event": "queued_for_pg", 2023-08-01T19:56:06.893 INFO:teuthology.orchestra.run.smithi155.stdout: "time": "2023-08-01T19:55:05.150713+0000", 2023-08-01T19:56:06.893 INFO:teuthology.orchestra.run.smithi155.stdout: "duration": 5.4620000000000004e-06 2023-08-01T19:56:06.893 INFO:teuthology.orchestra.run.smithi155.stdout: }, 2023-08-01T19:56:06.894 INFO:teuthology.orchestra.run.smithi155.stdout: { 2023-08-01T19:56:06.894 INFO:teuthology.orchestra.run.smithi155.stdout: "event": "reached_pg", 2023-08-01T19:56:06.894 INFO:teuthology.orchestra.run.smithi155.stdout: "time": "2023-08-01T19:55:05.150761+0000", 2023-08-01T19:56:06.894 INFO:teuthology.orchestra.run.smithi155.stdout: "duration": 4.7429000000000003e-05 2023-08-01T19:56:06.894 INFO:teuthology.orchestra.run.smithi155.stdout: }, 2023-08-01T19:56:06.894 INFO:teuthology.orchestra.run.smithi155.stdout: { 2023-08-01T19:56:06.894 INFO:teuthology.orchestra.run.smithi155.stdout: "event": "started", 2023-08-01T19:56:06.894 INFO:teuthology.orchestra.run.smithi155.stdout: "time": "2023-08-01T19:55:05.150856+0000", 2023-08-01T19:56:06.895 INFO:teuthology.orchestra.run.smithi155.stdout: "duration": 9.5356e-05 2023-08-01T19:56:06.895 INFO:teuthology.orchestra.run.smithi155.stdout: }, 2023-08-01T19:56:06.895 INFO:teuthology.orchestra.run.smithi155.stdout: { 2023-08-01T19:56:06.895 INFO:teuthology.orchestra.run.smithi155.stdout: "event": "waiting for subops from 0", 2023-08-01T19:56:06.895 INFO:teuthology.orchestra.run.smithi155.stdout: "time": "2023-08-01T19:55:05.150999+0000", 2023-08-01T19:56:06.895 INFO:teuthology.orchestra.run.smithi155.stdout: "duration": 0.00014234499999999999 2023-08-01T19:56:06.895 INFO:teuthology.orchestra.run.smithi155.stdout: }, 2023-08-01T19:56:06.895 INFO:teuthology.orchestra.run.smithi155.stdout: { 2023-08-01T19:56:06.896 INFO:teuthology.orchestra.run.smithi155.stdout: "event": "sub_op_commit_rec", 2023-08-01T19:56:06.896 INFO:teuthology.orchestra.run.smithi155.stdout: "time": "2023-08-01T19:55:05.219001+0000", 2023-08-01T19:56:06.896 INFO:teuthology.orchestra.run.smithi155.stdout: "duration": 0.068002776000000001 2023-08-01T19:56:06.896 INFO:teuthology.orchestra.run.smithi155.stdout: }, 2023-08-01T19:56:06.896 INFO:teuthology.orchestra.run.smithi155.stdout: { 2023-08-01T19:56:06.896 INFO:teuthology.orchestra.run.smithi155.stdout: "event": "op_commit", 2023-08-01T19:56:06.896 INFO:teuthology.orchestra.run.smithi155.stdout: "time": "2023-08-01T19:55:05.221635+0000", 2023-08-01T19:56:06.896 INFO:teuthology.orchestra.run.smithi155.stdout: "duration": 0.0026340579999999999 2023-08-01T19:56:06.897 INFO:teuthology.orchestra.run.smithi155.stdout: }, 2023-08-01T19:56:06.897 INFO:teuthology.orchestra.run.smithi155.stdout: { 2023-08-01T19:56:06.897 INFO:teuthology.orchestra.run.smithi155.stdout: "event": "commit_sent", 2023-08-01T19:56:06.897 INFO:teuthology.orchestra.run.smithi155.stdout: "time": "2023-08-01T19:55:05.221682+0000", 2023-08-01T19:56:06.897 INFO:teuthology.orchestra.run.smithi155.stdout: "duration": 4.7123999999999998e-05 2023-08-01T19:56:06.897 INFO:teuthology.orchestra.run.smithi155.stdout: }, 2023-08-01T19:56:06.897 INFO:teuthology.orchestra.run.smithi155.stdout: { 2023-08-01T19:56:06.897 INFO:teuthology.orchestra.run.smithi155.stdout: "event": "done", 2023-08-01T19:56:06.898 INFO:teuthology.orchestra.run.smithi155.stdout: "time": "2023-08-01T19:55:05.221721+0000", 2023-08-01T19:56:06.898 INFO:teuthology.orchestra.run.smithi155.stdout: "duration": 3.8529999999999999e-05 2023-08-01T19:56:06.898 INFO:teuthology.orchestra.run.smithi155.stdout: } 2023-08-01T19:56:06.898 INFO:teuthology.orchestra.run.smithi155.stdout: ] 2023-08-01T19:56:06.898 INFO:teuthology.orchestra.run.smithi155.stdout: } 2023-08-01T19:56:06.898 INFO:teuthology.orchestra.run.smithi155.stdout: }, 2023-08-01T19:56:06.898 INFO:teuthology.orchestra.run.smithi155.stdout: { 2023-08-01T19:56:06.899 INFO:teuthology.orchestra.run.smithi155.stdout: "description": "osd_repop(client.4668.0:100240 5.a e37/19 5:5313c5b9:::benchmark_data_smithi006_114134_object100239:head v 37'6227, mlcod=37'6225)", 2023-08-01T19:56:06.899 INFO:teuthology.orchestra.run.smithi155.stdout: "initiated_at": "2023-08-01T19:55:05.150778+0000", 2023-08-01T19:56:06.899 INFO:teuthology.orchestra.run.smithi155.stdout: "age": 61.723642018, 2023-08-01T19:56:06.899 INFO:teuthology.orchestra.run.smithi155.stdout: "duration": 0.073362533999999993, 2023-08-01T19:56:06.899 INFO:teuthology.orchestra.run.smithi155.stdout: "type_data": { 2023-08-01T19:56:06.899 INFO:teuthology.orchestra.run.smithi155.stdout: "flag_point": "commit sent; apply or cleanup", 2023-08-01T19:56:06.899 INFO:teuthology.orchestra.run.smithi155.stdout: "events": [ 2023-08-01T19:56:06.899 INFO:teuthology.orchestra.run.smithi155.stdout: { 2023-08-01T19:56:06.900 INFO:teuthology.orchestra.run.smithi155.stdout: "event": "initiated", 2023-08-01T19:56:06.900 INFO:teuthology.orchestra.run.smithi155.stdout: "time": "2023-08-01T19:55:05.150778+0000", 2023-08-01T19:56:06.900 INFO:teuthology.orchestra.run.smithi155.stdout: "duration": 0 2023-08-01T19:56:06.900 INFO:teuthology.orchestra.run.smithi155.stdout: }, 2023-08-01T19:56:06.900 INFO:teuthology.orchestra.run.smithi155.stdout: { 2023-08-01T19:56:06.900 INFO:teuthology.orchestra.run.smithi155.stdout: "event": "throttled", 2023-08-01T19:56:06.900 INFO:teuthology.orchestra.run.smithi155.stdout: "time": "2023-08-01T19:55:05.150778+0000", 2023-08-01T19:56:06.900 INFO:teuthology.orchestra.run.smithi155.stdout: "duration": 0 2023-08-01T19:56:06.901 INFO:teuthology.orchestra.run.smithi155.stdout: }, 2023-08-01T19:56:06.901 INFO:teuthology.orchestra.run.smithi155.stdout: { 2023-08-01T19:56:06.901 INFO:teuthology.orchestra.run.smithi155.stdout: "event": "header_read", 2023-08-01T19:56:06.901 INFO:teuthology.orchestra.run.smithi155.stdout: "time": "2023-08-01T19:55:05.150778+0000", 2023-08-01T19:56:06.901 INFO:teuthology.orchestra.run.smithi155.stdout: "duration": 4294967295.9999995 2023-08-01T19:56:06.901 INFO:teuthology.orchestra.run.smithi155.stdout: }, 2023-08-01T19:56:06.901 INFO:teuthology.orchestra.run.smithi155.stdout: { 2023-08-01T19:56:06.902 INFO:teuthology.orchestra.run.smithi155.stdout: "event": "all_read", 2023-08-01T19:56:06.902 INFO:teuthology.orchestra.run.smithi155.stdout: "time": "2023-08-01T19:55:05.150811+0000", 2023-08-01T19:56:06.902 INFO:teuthology.orchestra.run.smithi155.stdout: "duration": 3.3664000000000002e-05 2023-08-01T19:56:06.902 INFO:teuthology.orchestra.run.smithi155.stdout: }, 2023-08-01T19:56:06.902 INFO:teuthology.orchestra.run.smithi155.stdout: { 2023-08-01T19:56:06.902 INFO:teuthology.orchestra.run.smithi155.stdout: "event": "dispatched", 2023-08-01T19:56:06.902 INFO:teuthology.orchestra.run.smithi155.stdout: "time": "2023-08-01T19:55:05.150818+0000", 2023-08-01T19:56:06.902 INFO:teuthology.orchestra.run.smithi155.stdout: "duration": 6.5769999999999999e-06 2023-08-01T19:56:06.903 INFO:teuthology.orchestra.run.smithi155.stdout: }, 2023-08-01T19:56:06.903 INFO:teuthology.orchestra.run.smithi155.stdout: { 2023-08-01T19:56:06.903 INFO:teuthology.orchestra.run.smithi155.stdout: "event": "queued_for_pg", 2023-08-01T19:56:06.903 INFO:teuthology.orchestra.run.smithi155.stdout: "time": "2023-08-01T19:55:05.150822+0000", 2023-08-01T19:56:06.903 INFO:teuthology.orchestra.run.smithi155.stdout: "duration": 4.0060000000000003e-06 2023-08-01T19:56:06.903 INFO:teuthology.orchestra.run.smithi155.stdout: }, 2023-08-01T19:56:06.903 INFO:teuthology.orchestra.run.smithi155.stdout: { 2023-08-01T19:56:06.903 INFO:teuthology.orchestra.run.smithi155.stdout: "event": "reached_pg", 2023-08-01T19:56:06.904 INFO:teuthology.orchestra.run.smithi155.stdout: "time": "2023-08-01T19:55:05.150855+0000", 2023-08-01T19:56:06.904 INFO:teuthology.orchestra.run.smithi155.stdout: "duration": 3.3204999999999998e-05 2023-08-01T19:56:06.904 INFO:teuthology.orchestra.run.smithi155.stdout: }, 2023-08-01T19:56:06.904 INFO:teuthology.orchestra.run.smithi155.stdout: { 2023-08-01T19:56:06.904 INFO:teuthology.orchestra.run.smithi155.stdout: "event": "started", 2023-08-01T19:56:06.904 INFO:teuthology.orchestra.run.smithi155.stdout: "time": "2023-08-01T19:55:05.150873+0000", 2023-08-01T19:56:06.904 INFO:teuthology.orchestra.run.smithi155.stdout: "duration": 1.8139999999999999e-05 2023-08-01T19:56:06.904 INFO:teuthology.orchestra.run.smithi155.stdout: }, 2023-08-01T19:56:06.905 INFO:teuthology.orchestra.run.smithi155.stdout: { 2023-08-01T19:56:06.905 INFO:teuthology.orchestra.run.smithi155.stdout: "event": "commit_sent", 2023-08-01T19:56:06.905 INFO:teuthology.orchestra.run.smithi155.stdout: "time": "2023-08-01T19:55:05.224095+0000", 2023-08-01T19:56:06.905 INFO:teuthology.orchestra.run.smithi155.stdout: "duration": 0.073221895999999995 2023-08-01T19:56:06.905 INFO:teuthology.orchestra.run.smithi155.stdout: }, 2023-08-01T19:56:06.905 INFO:teuthology.orchestra.run.smithi155.stdout: { 2023-08-01T19:56:06.905 INFO:teuthology.orchestra.run.smithi155.stdout: "event": "done", 2023-08-01T19:56:06.905 INFO:teuthology.orchestra.run.smithi155.stdout: "time": "2023-08-01T19:55:05.224141+0000", 2023-08-01T19:56:06.906 INFO:teuthology.orchestra.run.smithi155.stdout: "duration": 4.5385e-05 2023-08-01T19:56:06.906 INFO:teuthology.orchestra.run.smithi155.stdout: } 2023-08-01T19:56:06.906 INFO:teuthology.orchestra.run.smithi155.stdout: ] 2023-08-01T19:56:06.906 INFO:teuthology.orchestra.run.smithi155.stdout: } 2023-08-01T19:56:06.906 INFO:teuthology.orchestra.run.smithi155.stdout: }, 2023-08-01T19:56:06.906 INFO:teuthology.orchestra.run.smithi155.stdout: { 2023-08-01T19:56:06.906 INFO:teuthology.orchestra.run.smithi155.stdout: "description": "osd_op(client.4668.0:100245 5.e 5:71869c66:::benchmark_data_smithi006_114134_object100244:head [set-alloc-hint object_size 65536 write_size 65536,write 0~65536] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e37)", 2023-08-01T19:56:06.906 INFO:teuthology.orchestra.run.smithi155.stdout: "initiated_at": "2023-08-01T19:55:05.150991+0000", 2023-08-01T19:56:06.907 INFO:teuthology.orchestra.run.smithi155.stdout: "age": 61.723429230999997, 2023-08-01T19:56:06.907 INFO:teuthology.orchestra.run.smithi155.stdout: "duration": 0.070734490999999997, 2023-08-01T19:56:06.907 INFO:teuthology.orchestra.run.smithi155.stdout: "type_data": { 2023-08-01T19:56:06.907 INFO:teuthology.orchestra.run.smithi155.stdout: "flag_point": "commit sent; apply or cleanup", 2023-08-01T19:56:06.907 INFO:teuthology.orchestra.run.smithi155.stdout: "client_info": { 2023-08-01T19:56:06.907 INFO:teuthology.orchestra.run.smithi155.stdout: "client": "client.4668", 2023-08-01T19:56:06.907 INFO:teuthology.orchestra.run.smithi155.stdout: "client_addr": "172.21.15.6:0/1709472247", 2023-08-01T19:56:06.908 INFO:teuthology.orchestra.run.smithi155.stdout: "tid": 100245 2023-08-01T19:56:06.908 INFO:teuthology.orchestra.run.smithi155.stdout: }, 2023-08-01T19:56:06.908 INFO:teuthology.orchestra.run.smithi155.stdout: "events": [ 2023-08-01T19:56:06.908 INFO:teuthology.orchestra.run.smithi155.stdout: { 2023-08-01T19:56:06.908 INFO:teuthology.orchestra.run.smithi155.stdout: "event": "initiated", 2023-08-01T19:56:06.908 INFO:teuthology.orchestra.run.smithi155.stdout: "time": "2023-08-01T19:55:05.150991+0000", 2023-08-01T19:56:06.908 INFO:teuthology.orchestra.run.smithi155.stdout: "duration": 0 2023-08-01T19:56:06.908 INFO:teuthology.orchestra.run.smithi155.stdout: }, 2023-08-01T19:56:06.909 INFO:teuthology.orchestra.run.smithi155.stdout: { 2023-08-01T19:56:06.909 INFO:teuthology.orchestra.run.smithi155.stdout: "event": "throttled", 2023-08-01T19:56:06.909 INFO:teuthology.orchestra.run.smithi155.stdout: "time": "2023-08-01T19:55:05.150991+0000", 2023-08-01T19:56:06.909 INFO:teuthology.orchestra.run.smithi155.stdout: "duration": 0 2023-08-01T19:56:06.909 INFO:teuthology.orchestra.run.smithi155.stdout: }, 2023-08-01T19:56:06.909 INFO:teuthology.orchestra.run.smithi155.stdout: { 2023-08-01T19:56:06.909 INFO:teuthology.orchestra.run.smithi155.stdout: "event": "header_read", 2023-08-01T19:56:06.909 INFO:teuthology.orchestra.run.smithi155.stdout: "time": "2023-08-01T19:55:05.150990+0000", 2023-08-01T19:56:06.910 INFO:teuthology.orchestra.run.smithi155.stdout: "duration": 4294967295.999999 2023-08-01T19:56:06.910 INFO:teuthology.orchestra.run.smithi155.stdout: }, 2023-08-01T19:56:06.910 INFO:teuthology.orchestra.run.smithi155.stdout: { 2023-08-01T19:56:06.910 INFO:teuthology.orchestra.run.smithi155.stdout: "event": "all_read", 2023-08-01T19:56:06.910 INFO:teuthology.orchestra.run.smithi155.stdout: "time": "2023-08-01T19:55:05.151108+0000", 2023-08-01T19:56:06.910 INFO:teuthology.orchestra.run.smithi155.stdout: "duration": 0.00011849300000000001 2023-08-01T19:56:06.910 INFO:teuthology.orchestra.run.smithi155.stdout: }, 2023-08-01T19:56:06.910 INFO:teuthology.orchestra.run.smithi155.stdout: { 2023-08-01T19:56:06.911 INFO:teuthology.orchestra.run.smithi155.stdout: "event": "dispatched", 2023-08-01T19:56:06.911 INFO:teuthology.orchestra.run.smithi155.stdout: "time": "2023-08-01T19:55:05.151117+0000", 2023-08-01T19:56:06.911 INFO:teuthology.orchestra.run.smithi155.stdout: "duration": 8.1040000000000007e-06 2023-08-01T19:56:06.911 INFO:teuthology.orchestra.run.smithi155.stdout: }, 2023-08-01T19:56:06.911 INFO:teuthology.orchestra.run.smithi155.stdout: { 2023-08-01T19:56:06.911 INFO:teuthology.orchestra.run.smithi155.stdout: "event": "queued_for_pg", 2023-08-01T19:56:06.911 INFO:teuthology.orchestra.run.smithi155.stdout: "time": "2023-08-01T19:55:05.151121+0000", 2023-08-01T19:56:06.911 INFO:teuthology.orchestra.run.smithi155.stdout: "duration": 4.2019999999999997e-06 2023-08-01T19:56:06.912 INFO:teuthology.orchestra.run.smithi155.stdout: }, 2023-08-01T19:56:06.912 INFO:teuthology.orchestra.run.smithi155.stdout: { 2023-08-01T19:56:06.912 INFO:teuthology.orchestra.run.smithi155.stdout: "event": "reached_pg", 2023-08-01T19:56:06.912 INFO:teuthology.orchestra.run.smithi155.stdout: "time": "2023-08-01T19:55:05.151162+0000", 2023-08-01T19:56:06.912 INFO:teuthology.orchestra.run.smithi155.stdout: "duration": 4.1448e-05 2023-08-01T19:56:06.912 INFO:teuthology.orchestra.run.smithi155.stdout: }, 2023-08-01T19:56:06.912 INFO:teuthology.orchestra.run.smithi155.stdout: { 2023-08-01T19:56:06.913 INFO:teuthology.orchestra.run.smithi155.stdout: "event": "started", 2023-08-01T19:56:06.913 INFO:teuthology.orchestra.run.smithi155.stdout: "time": "2023-08-01T19:55:05.151281+0000", 2023-08-01T19:56:06.913 INFO:teuthology.orchestra.run.smithi155.stdout: "duration": 0.000119141 2023-08-01T19:56:06.913 INFO:teuthology.orchestra.run.smithi155.stdout: }, 2023-08-01T19:56:06.913 INFO:teuthology.orchestra.run.smithi155.stdout: { 2023-08-01T19:56:06.913 INFO:teuthology.orchestra.run.smithi155.stdout: "event": "waiting for subops from 0", 2023-08-01T19:56:06.913 INFO:teuthology.orchestra.run.smithi155.stdout: "time": "2023-08-01T19:55:05.151443+0000", 2023-08-01T19:56:06.913 INFO:teuthology.orchestra.run.smithi155.stdout: "duration": 0.00016181600000000001 2023-08-01T19:56:06.914 INFO:teuthology.orchestra.run.smithi155.stdout: }, 2023-08-01T19:56:06.914 INFO:teuthology.orchestra.run.smithi155.stdout: { 2023-08-01T19:56:06.914 INFO:teuthology.orchestra.run.smithi155.stdout: "event": "sub_op_commit_rec", 2023-08-01T19:56:06.914 INFO:teuthology.orchestra.run.smithi155.stdout: "time": "2023-08-01T19:55:05.219101+0000", 2023-08-01T19:56:06.914 INFO:teuthology.orchestra.run.smithi155.stdout: "duration": 0.067658037000000004 2023-08-01T19:56:06.914 INFO:teuthology.orchestra.run.smithi155.stdout: }, 2023-08-01T19:56:06.914 INFO:teuthology.orchestra.run.smithi155.stdout: { 2023-08-01T19:56:06.914 INFO:teuthology.orchestra.run.smithi155.stdout: "event": "op_commit", 2023-08-01T19:56:06.915 INFO:teuthology.orchestra.run.smithi155.stdout: "time": "2023-08-01T19:55:05.221646+0000", 2023-08-01T19:56:06.915 INFO:teuthology.orchestra.run.smithi155.stdout: "duration": 0.0025450540000000002 2023-08-01T19:56:06.915 INFO:teuthology.orchestra.run.smithi155.stdout: }, 2023-08-01T19:56:06.915 INFO:teuthology.orchestra.run.smithi155.stdout: { 2023-08-01T19:56:06.915 INFO:teuthology.orchestra.run.smithi155.stdout: "event": "commit_sent", 2023-08-01T19:56:06.915 INFO:teuthology.orchestra.run.smithi155.stdout: "time": "2023-08-01T19:55:05.221689+0000", 2023-08-01T19:56:06.915 INFO:teuthology.orchestra.run.smithi155.stdout: "duration": 4.3078999999999999e-05 2023-08-01T19:56:06.915 INFO:teuthology.orchestra.run.smithi155.stdout: }, 2023-08-01T19:56:06.916 INFO:teuthology.orchestra.run.smithi155.stdout: { 2023-08-01T19:56:06.916 INFO:teuthology.orchestra.run.smithi155.stdout: "event": "done", 2023-08-01T19:56:06.916 INFO:teuthology.orchestra.run.smithi155.stdout: "time": "2023-08-01T19:55:05.221725+0000", 2023-08-01T19:56:06.916 INFO:teuthology.orchestra.run.smithi155.stdout: "duration": 3.6137999999999999e-05 2023-08-01T19:56:06.916 INFO:teuthology.orchestra.run.smithi155.stdout: } 2023-08-01T19:56:06.916 INFO:teuthology.orchestra.run.smithi155.stdout: ] 2023-08-01T19:56:06.916 INFO:teuthology.orchestra.run.smithi155.stdout: } 2023-08-01T19:56:06.917 INFO:teuthology.orchestra.run.smithi155.stdout: }, 2023-08-01T19:56:06.917 INFO:teuthology.orchestra.run.smithi155.stdout: { 2023-08-01T19:56:06.917 INFO:teuthology.orchestra.run.smithi155.stdout: "description": "osd_repop(client.4668.0:100243 5.a e37/19 5:5e8193b6:::benchmark_data_smithi006_114134_object100242:head v 37'6228, mlcod=37'6225)", 2023-08-01T19:56:06.917 INFO:teuthology.orchestra.run.smithi155.stdout: "initiated_at": "2023-08-01T19:55:05.151148+0000", 2023-08-01T19:56:06.917 INFO:teuthology.orchestra.run.smithi155.stdout: "age": 61.723272219999998, 2023-08-01T19:56:06.917 INFO:teuthology.orchestra.run.smithi155.stdout: "duration": 0.073020370000000001, 2023-08-01T19:56:06.917 INFO:teuthology.orchestra.run.smithi155.stdout: "type_data": { 2023-08-01T19:56:06.917 INFO:teuthology.orchestra.run.smithi155.stdout: "flag_point": "commit sent; apply or cleanup", 2023-08-01T19:56:06.918 INFO:teuthology.orchestra.run.smithi155.stdout: "events": [ 2023-08-01T19:56:06.918 INFO:teuthology.orchestra.run.smithi155.stdout: { 2023-08-01T19:56:06.918 INFO:teuthology.orchestra.run.smithi155.stdout: "event": "initiated", 2023-08-01T19:56:06.918 INFO:teuthology.orchestra.run.smithi155.stdout: "time": "2023-08-01T19:55:05.151148+0000", 2023-08-01T19:56:06.918 INFO:teuthology.orchestra.run.smithi155.stdout: "duration": 0 2023-08-01T19:56:06.918 INFO:teuthology.orchestra.run.smithi155.stdout: }, 2023-08-01T19:56:06.918 INFO:teuthology.orchestra.run.smithi155.stdout: { 2023-08-01T19:56:06.918 INFO:teuthology.orchestra.run.smithi155.stdout: "event": "throttled", 2023-08-01T19:56:06.919 INFO:teuthology.orchestra.run.smithi155.stdout: "time": "2023-08-01T19:55:05.151148+0000", 2023-08-01T19:56:06.919 INFO:teuthology.orchestra.run.smithi155.stdout: "duration": 0 2023-08-01T19:56:06.919 INFO:teuthology.orchestra.run.smithi155.stdout: }, 2023-08-01T19:56:06.919 INFO:teuthology.orchestra.run.smithi155.stdout: { 2023-08-01T19:56:06.919 INFO:teuthology.orchestra.run.smithi155.stdout: "event": "header_read", 2023-08-01T19:56:06.919 INFO:teuthology.orchestra.run.smithi155.stdout: "time": "2023-08-01T19:55:05.151147+0000", 2023-08-01T19:56:06.919 INFO:teuthology.orchestra.run.smithi155.stdout: "duration": 4294967295.9999995 2023-08-01T19:56:06.919 INFO:teuthology.orchestra.run.smithi155.stdout: }, 2023-08-01T19:56:06.920 INFO:teuthology.orchestra.run.smithi155.stdout: { 2023-08-01T19:56:06.920 INFO:teuthology.orchestra.run.smithi155.stdout: "event": "all_read", 2023-08-01T19:56:06.920 INFO:teuthology.orchestra.run.smithi155.stdout: "time": "2023-08-01T19:55:05.151231+0000", 2023-08-01T19:56:06.920 INFO:teuthology.orchestra.run.smithi155.stdout: "duration": 8.3135999999999998e-05 2023-08-01T19:56:06.920 INFO:teuthology.orchestra.run.smithi155.stdout: }, 2023-08-01T19:56:06.920 INFO:teuthology.orchestra.run.smithi155.stdout: { 2023-08-01T19:56:06.920 INFO:teuthology.orchestra.run.smithi155.stdout: "event": "dispatched", 2023-08-01T19:56:06.920 INFO:teuthology.orchestra.run.smithi155.stdout: "time": "2023-08-01T19:55:05.151239+0000", 2023-08-01T19:56:06.921 INFO:teuthology.orchestra.run.smithi155.stdout: "duration": 8.7469999999999994e-06 2023-08-01T19:56:06.921 INFO:teuthology.orchestra.run.smithi155.stdout: }, 2023-08-01T19:56:06.921 INFO:teuthology.orchestra.run.smithi155.stdout: { 2023-08-01T19:56:06.921 INFO:teuthology.orchestra.run.smithi155.stdout: "event": "queued_for_pg", 2023-08-01T19:56:06.921 INFO:teuthology.orchestra.run.smithi155.stdout: "time": "2023-08-01T19:55:05.151244+0000", 2023-08-01T19:56:06.921 INFO:teuthology.orchestra.run.smithi155.stdout: "duration": 4.4800000000000003e-06 2023-08-01T19:56:06.921 INFO:teuthology.orchestra.run.smithi155.stdout: }, 2023-08-01T19:56:06.922 INFO:teuthology.orchestra.run.smithi155.stdout: { 2023-08-01T19:56:06.922 INFO:teuthology.orchestra.run.smithi155.stdout: "event": "reached_pg", 2023-08-01T19:56:06.922 INFO:teuthology.orchestra.run.smithi155.stdout: "time": "2023-08-01T19:55:05.152938+0000", 2023-08-01T19:56:06.922 INFO:teuthology.orchestra.run.smithi155.stdout: "duration": 0.001693824 2023-08-01T19:56:06.922 INFO:teuthology.orchestra.run.smithi155.stdout: }, 2023-08-01T19:56:06.922 INFO:teuthology.orchestra.run.smithi155.stdout: { 2023-08-01T19:56:06.922 INFO:teuthology.orchestra.run.smithi155.stdout: "event": "started", 2023-08-01T19:56:06.922 INFO:teuthology.orchestra.run.smithi155.stdout: "time": "2023-08-01T19:55:05.152956+0000", 2023-08-01T19:56:06.923 INFO:teuthology.orchestra.run.smithi155.stdout: "duration": 1.8287e-05 2023-08-01T19:56:06.923 INFO:teuthology.orchestra.run.smithi155.stdout: }, 2023-08-01T19:56:06.923 INFO:teuthology.orchestra.run.smithi155.stdout: { 2023-08-01T19:56:06.923 INFO:teuthology.orchestra.run.smithi155.stdout: "event": "commit_sent", 2023-08-01T19:56:06.923 INFO:teuthology.orchestra.run.smithi155.stdout: "time": "2023-08-01T19:55:05.224145+0000", 2023-08-01T19:56:06.923 INFO:teuthology.orchestra.run.smithi155.stdout: "duration": 0.071189447000000003 2023-08-01T19:56:06.923 INFO:teuthology.orchestra.run.smithi155.stdout: }, 2023-08-01T19:56:06.923 INFO:teuthology.orchestra.run.smithi155.stdout: { 2023-08-01T19:56:06.924 INFO:teuthology.orchestra.run.smithi155.stdout: "event": "done", 2023-08-01T19:56:06.924 INFO:teuthology.orchestra.run.smithi155.stdout: "time": "2023-08-01T19:55:05.224168+0000", 2023-08-01T19:56:06.924 INFO:teuthology.orchestra.run.smithi155.stdout: "duration": 2.3008999999999999e-05 2023-08-01T19:56:06.924 INFO:teuthology.orchestra.run.smithi155.stdout: } 2023-08-01T19:56:06.924 INFO:teuthology.orchestra.run.smithi155.stdout: ] 2023-08-01T19:56:06.924 INFO:teuthology.orchestra.run.smithi155.stdout: } 2023-08-01T19:56:06.924 INFO:teuthology.orchestra.run.smithi155.stdout: }, 2023-08-01T19:56:06.924 INFO:teuthology.orchestra.run.smithi155.stdout: { 2023-08-01T19:56:06.925 INFO:teuthology.orchestra.run.smithi155.stdout: "description": "osd_repop(client.4668.0:100244 5.9 e37/19 5:92f56a12:::benchmark_data_smithi006_114134_object100243:head v 37'6294, mlcod=37'6292)", 2023-08-01T19:56:06.925 INFO:teuthology.orchestra.run.smithi155.stdout: "initiated_at": "2023-08-01T19:55:05.151325+0000", 2023-08-01T19:56:06.925 INFO:teuthology.orchestra.run.smithi155.stdout: "age": 61.723094875000001, 2023-08-01T19:56:06.925 INFO:teuthology.orchestra.run.smithi155.stdout: "duration": 0.071883673999999995, 2023-08-01T19:56:06.925 INFO:teuthology.orchestra.run.smithi155.stdout: "type_data": { 2023-08-01T19:56:06.925 INFO:teuthology.orchestra.run.smithi155.stdout: "flag_point": "commit sent; apply or cleanup", 2023-08-01T19:56:06.925 INFO:teuthology.orchestra.run.smithi155.stdout: "events": [ 2023-08-01T19:56:06.925 INFO:teuthology.orchestra.run.smithi155.stdout: { 2023-08-01T19:56:06.926 INFO:teuthology.orchestra.run.smithi155.stdout: "event": "initiated", 2023-08-01T19:56:06.926 INFO:teuthology.orchestra.run.smithi155.stdout: "time": "2023-08-01T19:55:05.151325+0000", 2023-08-01T19:56:06.926 INFO:teuthology.orchestra.run.smithi155.stdout: "duration": 0 2023-08-01T19:56:06.926 INFO:teuthology.orchestra.run.smithi155.stdout: }, 2023-08-01T19:56:06.926 INFO:teuthology.orchestra.run.smithi155.stdout: { 2023-08-01T19:56:06.926 INFO:teuthology.orchestra.run.smithi155.stdout: "event": "throttled", 2023-08-01T19:56:06.926 INFO:teuthology.orchestra.run.smithi155.stdout: "time": "2023-08-01T19:55:05.151325+0000", 2023-08-01T19:56:06.926 INFO:teuthology.orchestra.run.smithi155.stdout: "duration": 0 2023-08-01T19:56:06.927 INFO:teuthology.orchestra.run.smithi155.stdout: }, 2023-08-01T19:56:06.927 INFO:teuthology.orchestra.run.smithi155.stdout: { 2023-08-01T19:56:06.927 INFO:teuthology.orchestra.run.smithi155.stdout: "event": "header_read", 2023-08-01T19:56:06.927 INFO:teuthology.orchestra.run.smithi155.stdout: "time": "2023-08-01T19:55:05.151325+0000", 2023-08-01T19:56:06.927 INFO:teuthology.orchestra.run.smithi155.stdout: "duration": 4294967295.9999995 2023-08-01T19:56:06.927 INFO:teuthology.orchestra.run.smithi155.stdout: }, 2023-08-01T19:56:06.927 INFO:teuthology.orchestra.run.smithi155.stdout: { 2023-08-01T19:56:06.928 INFO:teuthology.orchestra.run.smithi155.stdout: "event": "all_read", 2023-08-01T19:56:06.928 INFO:teuthology.orchestra.run.smithi155.stdout: "time": "2023-08-01T19:55:05.151390+0000", 2023-08-01T19:56:06.928 INFO:teuthology.orchestra.run.smithi155.stdout: "duration": 6.5456999999999993e-05 2023-08-01T19:56:06.928 INFO:teuthology.orchestra.run.smithi155.stdout: }, 2023-08-01T19:56:06.928 INFO:teuthology.orchestra.run.smithi155.stdout: { 2023-08-01T19:56:06.928 INFO:teuthology.orchestra.run.smithi155.stdout: "event": "dispatched", 2023-08-01T19:56:06.928 INFO:teuthology.orchestra.run.smithi155.stdout: "time": "2023-08-01T19:55:05.151396+0000", 2023-08-01T19:56:06.928 INFO:teuthology.orchestra.run.smithi155.stdout: "duration": 5.9190000000000004e-06 2023-08-01T19:56:06.929 INFO:teuthology.orchestra.run.smithi155.stdout: }, 2023-08-01T19:56:06.929 INFO:teuthology.orchestra.run.smithi155.stdout: { 2023-08-01T19:56:06.929 INFO:teuthology.orchestra.run.smithi155.stdout: "event": "queued_for_pg", 2023-08-01T19:56:06.929 INFO:teuthology.orchestra.run.smithi155.stdout: "time": "2023-08-01T19:55:05.151400+0000", 2023-08-01T19:56:06.929 INFO:teuthology.orchestra.run.smithi155.stdout: "duration": 4.1030000000000004e-06 2023-08-01T19:56:06.929 INFO:teuthology.orchestra.run.smithi155.stdout: }, 2023-08-01T19:56:06.929 INFO:teuthology.orchestra.run.smithi155.stdout: { 2023-08-01T19:56:06.929 INFO:teuthology.orchestra.run.smithi155.stdout: "event": "reached_pg", 2023-08-01T19:56:06.930 INFO:teuthology.orchestra.run.smithi155.stdout: "time": "2023-08-01T19:55:05.151452+0000", 2023-08-01T19:56:06.930 INFO:teuthology.orchestra.run.smithi155.stdout: "duration": 5.2136999999999999e-05 2023-08-01T19:56:06.930 INFO:teuthology.orchestra.run.smithi155.stdout: }, 2023-08-01T19:56:06.930 INFO:teuthology.orchestra.run.smithi155.stdout: { 2023-08-01T19:56:06.930 INFO:teuthology.orchestra.run.smithi155.stdout: "event": "started", 2023-08-01T19:56:06.930 INFO:teuthology.orchestra.run.smithi155.stdout: "time": "2023-08-01T19:55:05.151470+0000", 2023-08-01T19:56:06.930 INFO:teuthology.orchestra.run.smithi155.stdout: "duration": 1.8e-05 2023-08-01T19:56:06.930 INFO:teuthology.orchestra.run.smithi155.stdout: }, 2023-08-01T19:56:06.931 INFO:teuthology.orchestra.run.smithi155.stdout: { 2023-08-01T19:56:06.931 INFO:teuthology.orchestra.run.smithi155.stdout: "event": "commit_sent", 2023-08-01T19:56:06.931 INFO:teuthology.orchestra.run.smithi155.stdout: "time": "2023-08-01T19:55:05.223183+0000", 2023-08-01T19:56:06.931 INFO:teuthology.orchestra.run.smithi155.stdout: "duration": 0.071712622000000004 2023-08-01T19:56:06.931 INFO:teuthology.orchestra.run.smithi155.stdout: }, 2023-08-01T19:56:06.931 INFO:teuthology.orchestra.run.smithi155.stdout: { 2023-08-01T19:56:06.931 INFO:teuthology.orchestra.run.smithi155.stdout: "event": "done", 2023-08-01T19:56:06.931 INFO:teuthology.orchestra.run.smithi155.stdout: "time": "2023-08-01T19:55:05.223209+0000", 2023-08-01T19:56:06.932 INFO:teuthology.orchestra.run.smithi155.stdout: "duration": 2.5956e-05 2023-08-01T19:56:06.932 INFO:teuthology.orchestra.run.smithi155.stdout: } 2023-08-01T19:56:06.932 INFO:teuthology.orchestra.run.smithi155.stdout: ] 2023-08-01T19:56:06.932 INFO:teuthology.orchestra.run.smithi155.stdout: } 2023-08-01T19:56:06.932 INFO:teuthology.orchestra.run.smithi155.stdout: }, 2023-08-01T19:56:06.932 INFO:teuthology.orchestra.run.smithi155.stdout: { 2023-08-01T19:56:06.932 INFO:teuthology.orchestra.run.smithi155.stdout: "description": "osd_op(client.4668.0:100249 5.b 5:d0666827:::benchmark_data_smithi006_114134_object100248:head [set-alloc-hint object_size 65536 write_size 65536,write 0~65536] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e37)", 2023-08-01T19:56:06.933 INFO:teuthology.orchestra.run.smithi155.stdout: "initiated_at": "2023-08-01T19:55:05.153614+0000", 2023-08-01T19:56:06.933 INFO:teuthology.orchestra.run.smithi155.stdout: "age": 61.720806449999998, 2023-08-01T19:56:06.933 INFO:teuthology.orchestra.run.smithi155.stdout: "duration": 0.069286118999999993, 2023-08-01T19:56:06.933 INFO:teuthology.orchestra.run.smithi155.stdout: "type_data": { 2023-08-01T19:56:06.933 INFO:teuthology.orchestra.run.smithi155.stdout: "flag_point": "commit sent; apply or cleanup", 2023-08-01T19:56:06.933 INFO:teuthology.orchestra.run.smithi155.stdout: "client_info": { 2023-08-01T19:56:06.933 INFO:teuthology.orchestra.run.smithi155.stdout: "client": "client.4668", 2023-08-01T19:56:06.933 INFO:teuthology.orchestra.run.smithi155.stdout: "client_addr": "172.21.15.6:0/1709472247", 2023-08-01T19:56:06.934 INFO:teuthology.orchestra.run.smithi155.stdout: "tid": 100249 2023-08-01T19:56:06.934 INFO:teuthology.orchestra.run.smithi155.stdout: }, 2023-08-01T19:56:06.934 INFO:teuthology.orchestra.run.smithi155.stdout: "events": [ 2023-08-01T19:56:06.934 INFO:teuthology.orchestra.run.smithi155.stdout: { 2023-08-01T19:56:06.934 INFO:teuthology.orchestra.run.smithi155.stdout: "event": "initiated", 2023-08-01T19:56:06.934 INFO:teuthology.orchestra.run.smithi155.stdout: "time": "2023-08-01T19:55:05.153614+0000", 2023-08-01T19:56:06.934 INFO:teuthology.orchestra.run.smithi155.stdout: "duration": 0 2023-08-01T19:56:06.934 INFO:teuthology.orchestra.run.smithi155.stdout: }, 2023-08-01T19:56:06.935 INFO:teuthology.orchestra.run.smithi155.stdout: { 2023-08-01T19:56:06.935 INFO:teuthology.orchestra.run.smithi155.stdout: "event": "throttled", 2023-08-01T19:56:06.935 INFO:teuthology.orchestra.run.smithi155.stdout: "time": "2023-08-01T19:55:05.153614+0000", 2023-08-01T19:56:06.935 INFO:teuthology.orchestra.run.smithi155.stdout: "duration": 0 2023-08-01T19:56:06.935 INFO:teuthology.orchestra.run.smithi155.stdout: }, 2023-08-01T19:56:06.935 INFO:teuthology.orchestra.run.smithi155.stdout: { 2023-08-01T19:56:06.935 INFO:teuthology.orchestra.run.smithi155.stdout: "event": "header_read", 2023-08-01T19:56:06.935 INFO:teuthology.orchestra.run.smithi155.stdout: "time": "2023-08-01T19:55:05.153612+0000", 2023-08-01T19:56:06.936 INFO:teuthology.orchestra.run.smithi155.stdout: "duration": 4294967295.9999986 2023-08-01T19:56:06.936 INFO:teuthology.orchestra.run.smithi155.stdout: }, 2023-08-01T19:56:06.936 INFO:teuthology.orchestra.run.smithi155.stdout: { 2023-08-01T19:56:06.936 INFO:teuthology.orchestra.run.smithi155.stdout: "event": "all_read", 2023-08-01T19:56:06.936 INFO:teuthology.orchestra.run.smithi155.stdout: "time": "2023-08-01T19:55:05.153694+0000", 2023-08-01T19:56:06.936 INFO:teuthology.orchestra.run.smithi155.stdout: "duration": 8.1618000000000004e-05 2023-08-01T19:56:06.936 INFO:teuthology.orchestra.run.smithi155.stdout: }, 2023-08-01T19:56:06.936 INFO:teuthology.orchestra.run.smithi155.stdout: { 2023-08-01T19:56:06.937 INFO:teuthology.orchestra.run.smithi155.stdout: "event": "dispatched", 2023-08-01T19:56:06.937 INFO:teuthology.orchestra.run.smithi155.stdout: "time": "2023-08-01T19:55:05.153713+0000", 2023-08-01T19:56:06.937 INFO:teuthology.orchestra.run.smithi155.stdout: "duration": 1.9069999999999999e-05 2023-08-01T19:56:06.937 INFO:teuthology.orchestra.run.smithi155.stdout: }, 2023-08-01T19:56:06.937 INFO:teuthology.orchestra.run.smithi155.stdout: { 2023-08-01T19:56:06.937 INFO:teuthology.orchestra.run.smithi155.stdout: "event": "queued_for_pg", 2023-08-01T19:56:06.937 INFO:teuthology.orchestra.run.smithi155.stdout: "time": "2023-08-01T19:55:05.153726+0000", 2023-08-01T19:56:06.937 INFO:teuthology.orchestra.run.smithi155.stdout: "duration": 1.238e-05 2023-08-01T19:56:06.938 INFO:teuthology.orchestra.run.smithi155.stdout: }, 2023-08-01T19:56:06.938 INFO:teuthology.orchestra.run.smithi155.stdout: { 2023-08-01T19:56:06.938 INFO:teuthology.orchestra.run.smithi155.stdout: "event": "reached_pg", 2023-08-01T19:56:06.938 INFO:teuthology.orchestra.run.smithi155.stdout: "time": "2023-08-01T19:55:05.153761+0000", 2023-08-01T19:56:06.938 INFO:teuthology.orchestra.run.smithi155.stdout: "duration": 3.5046999999999998e-05 2023-08-01T19:56:06.938 INFO:teuthology.orchestra.run.smithi155.stdout: }, 2023-08-01T19:56:06.938 INFO:teuthology.orchestra.run.smithi155.stdout: { 2023-08-01T19:56:06.938 INFO:teuthology.orchestra.run.smithi155.stdout: "event": "started", 2023-08-01T19:56:06.939 INFO:teuthology.orchestra.run.smithi155.stdout: "time": "2023-08-01T19:55:05.153896+0000", 2023-08-01T19:56:06.939 INFO:teuthology.orchestra.run.smithi155.stdout: "duration": 0.00013575800000000001 2023-08-01T19:56:06.939 INFO:teuthology.orchestra.run.smithi155.stdout: }, 2023-08-01T19:56:06.939 INFO:teuthology.orchestra.run.smithi155.stdout: { 2023-08-01T19:56:06.939 INFO:teuthology.orchestra.run.smithi155.stdout: "event": "waiting for subops from 0", 2023-08-01T19:56:06.939 INFO:teuthology.orchestra.run.smithi155.stdout: "time": "2023-08-01T19:55:05.154043+0000", 2023-08-01T19:56:06.939 INFO:teuthology.orchestra.run.smithi155.stdout: "duration": 0.00014650700000000001 2023-08-01T19:56:06.940 INFO:teuthology.orchestra.run.smithi155.stdout: }, 2023-08-01T19:56:06.940 INFO:teuthology.orchestra.run.smithi155.stdout: { 2023-08-01T19:56:06.940 INFO:teuthology.orchestra.run.smithi155.stdout: "event": "sub_op_commit_rec", 2023-08-01T19:56:06.940 INFO:teuthology.orchestra.run.smithi155.stdout: "time": "2023-08-01T19:55:05.221876+0000", 2023-08-01T19:56:06.940 INFO:teuthology.orchestra.run.smithi155.stdout: "duration": 0.067832796000000001 2023-08-01T19:56:06.940 INFO:teuthology.orchestra.run.smithi155.stdout: }, 2023-08-01T19:56:06.940 INFO:teuthology.orchestra.run.smithi155.stdout: { 2023-08-01T19:56:06.940 INFO:teuthology.orchestra.run.smithi155.stdout: "event": "op_commit", 2023-08-01T19:56:06.941 INFO:teuthology.orchestra.run.smithi155.stdout: "time": "2023-08-01T19:55:05.222813+0000", 2023-08-01T19:56:06.941 INFO:teuthology.orchestra.run.smithi155.stdout: "duration": 0.00093755300000000004 2023-08-01T19:56:06.941 INFO:teuthology.orchestra.run.smithi155.stdout: }, 2023-08-01T19:56:06.941 INFO:teuthology.orchestra.run.smithi155.stdout: { 2023-08-01T19:56:06.941 INFO:teuthology.orchestra.run.smithi155.stdout: "event": "commit_sent", 2023-08-01T19:56:06.941 INFO:teuthology.orchestra.run.smithi155.stdout: "time": "2023-08-01T19:55:05.222861+0000", 2023-08-01T19:56:06.941 INFO:teuthology.orchestra.run.smithi155.stdout: "duration": 4.8013999999999998e-05 2023-08-01T19:56:06.941 INFO:teuthology.orchestra.run.smithi155.stdout: }, 2023-08-01T19:56:06.942 INFO:teuthology.orchestra.run.smithi155.stdout: { 2023-08-01T19:56:06.942 INFO:teuthology.orchestra.run.smithi155.stdout: "event": "done", 2023-08-01T19:56:06.942 INFO:teuthology.orchestra.run.smithi155.stdout: "time": "2023-08-01T19:55:05.222900+0000", 2023-08-01T19:56:06.942 INFO:teuthology.orchestra.run.smithi155.stdout: "duration": 3.8634999999999999e-05 2023-08-01T19:56:06.942 INFO:teuthology.orchestra.run.smithi155.stdout: } 2023-08-01T19:56:06.942 INFO:teuthology.orchestra.run.smithi155.stdout: ] 2023-08-01T19:56:06.942 INFO:teuthology.orchestra.run.smithi155.stdout: } 2023-08-01T19:56:06.942 INFO:teuthology.orchestra.run.smithi155.stdout: }, 2023-08-01T19:56:06.943 INFO:teuthology.orchestra.run.smithi155.stdout: { 2023-08-01T19:56:06.943 INFO:teuthology.orchestra.run.smithi155.stdout: "description": "osd_op(client.4668.0:100251 5.b 5:d853df24:::benchmark_data_smithi006_114134_object100250:head [set-alloc-hint object_size 65536 write_size 65536,write 0~65536] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e37)", 2023-08-01T19:56:06.943 INFO:teuthology.orchestra.run.smithi155.stdout: "initiated_at": "2023-08-01T19:55:05.153737+0000", 2023-08-01T19:56:06.943 INFO:teuthology.orchestra.run.smithi155.stdout: "age": 61.720683436000002, 2023-08-01T19:56:06.943 INFO:teuthology.orchestra.run.smithi155.stdout: "duration": 0.071366545000000003, 2023-08-01T19:56:06.943 INFO:teuthology.orchestra.run.smithi155.stdout: "type_data": { 2023-08-01T19:56:06.943 INFO:teuthology.orchestra.run.smithi155.stdout: "flag_point": "commit sent; apply or cleanup", 2023-08-01T19:56:06.943 INFO:teuthology.orchestra.run.smithi155.stdout: "client_info": { 2023-08-01T19:56:06.944 INFO:teuthology.orchestra.run.smithi155.stdout: "client": "client.4668", 2023-08-01T19:56:06.944 INFO:teuthology.orchestra.run.smithi155.stdout: "client_addr": "172.21.15.6:0/1709472247", 2023-08-01T19:56:06.944 INFO:teuthology.orchestra.run.smithi155.stdout: "tid": 100251 2023-08-01T19:56:06.944 INFO:teuthology.orchestra.run.smithi155.stdout: }, 2023-08-01T19:56:06.944 INFO:teuthology.orchestra.run.smithi155.stdout: "events": [ 2023-08-01T19:56:06.944 INFO:teuthology.orchestra.run.smithi155.stdout: { 2023-08-01T19:56:06.944 INFO:teuthology.orchestra.run.smithi155.stdout: "event": "initiated", 2023-08-01T19:56:06.945 INFO:teuthology.orchestra.run.smithi155.stdout: "time": "2023-08-01T19:55:05.153737+0000", 2023-08-01T19:56:06.945 INFO:teuthology.orchestra.run.smithi155.stdout: "duration": 0 2023-08-01T19:56:06.945 INFO:teuthology.orchestra.run.smithi155.stdout: }, 2023-08-01T19:56:06.945 INFO:teuthology.orchestra.run.smithi155.stdout: { 2023-08-01T19:56:06.945 INFO:teuthology.orchestra.run.smithi155.stdout: "event": "throttled", 2023-08-01T19:56:06.945 INFO:teuthology.orchestra.run.smithi155.stdout: "time": "2023-08-01T19:55:05.153737+0000", 2023-08-01T19:56:06.945 INFO:teuthology.orchestra.run.smithi155.stdout: "duration": 0 2023-08-01T19:56:06.945 INFO:teuthology.orchestra.run.smithi155.stdout: }, 2023-08-01T19:56:06.946 INFO:teuthology.orchestra.run.smithi155.stdout: { 2023-08-01T19:56:06.946 INFO:teuthology.orchestra.run.smithi155.stdout: "event": "header_read", 2023-08-01T19:56:06.946 INFO:teuthology.orchestra.run.smithi155.stdout: "time": "2023-08-01T19:55:05.153736+0000", 2023-08-01T19:56:06.946 INFO:teuthology.orchestra.run.smithi155.stdout: "duration": 4294967295.9999995 2023-08-01T19:56:06.946 INFO:teuthology.orchestra.run.smithi155.stdout: }, 2023-08-01T19:56:06.946 INFO:teuthology.orchestra.run.smithi155.stdout: { 2023-08-01T19:56:06.946 INFO:teuthology.orchestra.run.smithi155.stdout: "event": "all_read", 2023-08-01T19:56:06.946 INFO:teuthology.orchestra.run.smithi155.stdout: "time": "2023-08-01T19:55:05.153784+0000", 2023-08-01T19:56:06.947 INFO:teuthology.orchestra.run.smithi155.stdout: "duration": 4.7660000000000001e-05 2023-08-01T19:56:06.947 INFO:teuthology.orchestra.run.smithi155.stdout: }, 2023-08-01T19:56:06.947 INFO:teuthology.orchestra.run.smithi155.stdout: { 2023-08-01T19:56:06.947 INFO:teuthology.orchestra.run.smithi155.stdout: "event": "dispatched", 2023-08-01T19:56:06.947 INFO:teuthology.orchestra.run.smithi155.stdout: "time": "2023-08-01T19:55:05.153793+0000", 2023-08-01T19:56:06.947 INFO:teuthology.orchestra.run.smithi155.stdout: "duration": 8.7150000000000004e-06 2023-08-01T19:56:06.947 INFO:teuthology.orchestra.run.smithi155.stdout: }, 2023-08-01T19:56:06.947 INFO:teuthology.orchestra.run.smithi155.stdout: { 2023-08-01T19:56:06.948 INFO:teuthology.orchestra.run.smithi155.stdout: "event": "queued_for_pg", 2023-08-01T19:56:06.948 INFO:teuthology.orchestra.run.smithi155.stdout: "time": "2023-08-01T19:55:05.153800+0000", 2023-08-01T19:56:06.948 INFO:teuthology.orchestra.run.smithi155.stdout: "duration": 7.2459999999999997e-06 2023-08-01T19:56:06.948 INFO:teuthology.orchestra.run.smithi155.stdout: }, 2023-08-01T19:56:06.948 INFO:teuthology.orchestra.run.smithi155.stdout: { 2023-08-01T19:56:06.948 INFO:teuthology.orchestra.run.smithi155.stdout: "event": "reached_pg", 2023-08-01T19:56:06.948 INFO:teuthology.orchestra.run.smithi155.stdout: "time": "2023-08-01T19:55:05.156241+0000", 2023-08-01T19:56:06.948 INFO:teuthology.orchestra.run.smithi155.stdout: "duration": 0.0024415359999999998 2023-08-01T19:56:06.949 INFO:teuthology.orchestra.run.smithi155.stdout: }, 2023-08-01T19:56:06.949 INFO:teuthology.orchestra.run.smithi155.stdout: { 2023-08-01T19:56:06.949 INFO:teuthology.orchestra.run.smithi155.stdout: "event": "started", 2023-08-01T19:56:06.949 INFO:teuthology.orchestra.run.smithi155.stdout: "time": "2023-08-01T19:55:05.219045+0000", 2023-08-01T19:56:06.949 INFO:teuthology.orchestra.run.smithi155.stdout: "duration": 0.062803855000000006 2023-08-01T19:56:06.949 INFO:teuthology.orchestra.run.smithi155.stdout: }, 2023-08-01T19:56:06.949 INFO:teuthology.orchestra.run.smithi155.stdout: { 2023-08-01T19:56:06.949 INFO:teuthology.orchestra.run.smithi155.stdout: "event": "waiting for subops from 0", 2023-08-01T19:56:06.950 INFO:teuthology.orchestra.run.smithi155.stdout: "time": "2023-08-01T19:55:05.219238+0000", 2023-08-01T19:56:06.950 INFO:teuthology.orchestra.run.smithi155.stdout: "duration": 0.00019241500000000001 2023-08-01T19:56:06.950 INFO:teuthology.orchestra.run.smithi155.stdout: }, 2023-08-01T19:56:06.950 INFO:teuthology.orchestra.run.smithi155.stdout: { 2023-08-01T19:56:06.950 INFO:teuthology.orchestra.run.smithi155.stdout: "event": "sub_op_commit_rec", 2023-08-01T19:56:06.950 INFO:teuthology.orchestra.run.smithi155.stdout: "time": "2023-08-01T19:55:05.223300+0000", 2023-08-01T19:56:06.950 INFO:teuthology.orchestra.run.smithi155.stdout: "duration": 0.0040626509999999996 2023-08-01T19:56:06.951 INFO:teuthology.orchestra.run.smithi155.stdout: }, 2023-08-01T19:56:06.951 INFO:teuthology.orchestra.run.smithi155.stdout: { 2023-08-01T19:56:06.951 INFO:teuthology.orchestra.run.smithi155.stdout: "event": "op_commit", 2023-08-01T19:56:06.951 INFO:teuthology.orchestra.run.smithi155.stdout: "time": "2023-08-01T19:55:05.225020+0000", 2023-08-01T19:56:06.951 INFO:teuthology.orchestra.run.smithi155.stdout: "duration": 0.0017201 2023-08-01T19:56:06.951 INFO:teuthology.orchestra.run.smithi155.stdout: }, 2023-08-01T19:56:06.951 INFO:teuthology.orchestra.run.smithi155.stdout: { 2023-08-01T19:56:06.951 INFO:teuthology.orchestra.run.smithi155.stdout: "event": "commit_sent", 2023-08-01T19:56:06.952 INFO:teuthology.orchestra.run.smithi155.stdout: "time": "2023-08-01T19:55:05.225066+0000", 2023-08-01T19:56:06.952 INFO:teuthology.orchestra.run.smithi155.stdout: "duration": 4.6143000000000002e-05 2023-08-01T19:56:06.952 INFO:teuthology.orchestra.run.smithi155.stdout: }, 2023-08-01T19:56:06.952 INFO:teuthology.orchestra.run.smithi155.stdout: { 2023-08-01T19:56:06.952 INFO:teuthology.orchestra.run.smithi155.stdout: "event": "done", 2023-08-01T19:56:06.952 INFO:teuthology.orchestra.run.smithi155.stdout: "time": "2023-08-01T19:55:05.225103+0000", 2023-08-01T19:56:06.952 INFO:teuthology.orchestra.run.smithi155.stdout: "duration": 3.6789999999999998e-05 2023-08-01T19:56:06.952 INFO:teuthology.orchestra.run.smithi155.stdout: } 2023-08-01T19:56:06.953 INFO:teuthology.orchestra.run.smithi155.stdout: ] 2023-08-01T19:56:06.953 INFO:teuthology.orchestra.run.smithi155.stdout: } 2023-08-01T19:56:06.953 INFO:teuthology.orchestra.run.smithi155.stdout: }, 2023-08-01T19:56:06.953 INFO:teuthology.orchestra.run.smithi155.stdout: { 2023-08-01T19:56:06.953 INFO:teuthology.orchestra.run.smithi155.stdout: "description": "osd_op(client.4668.0:100252 5.0 5:01f90c3c:::benchmark_data_smithi006_114134_object100251:head [set-alloc-hint object_size 65536 write_size 65536,write 0~65536] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e37)", 2023-08-01T19:56:06.953 INFO:teuthology.orchestra.run.smithi155.stdout: "initiated_at": "2023-08-01T19:55:05.154048+0000", 2023-08-01T19:56:06.953 INFO:teuthology.orchestra.run.smithi155.stdout: "age": 61.720372189000003, 2023-08-01T19:56:06.953 INFO:teuthology.orchestra.run.smithi155.stdout: "duration": 0.070156683999999997, 2023-08-01T19:56:06.954 INFO:teuthology.orchestra.run.smithi155.stdout: "type_data": { 2023-08-01T19:56:06.954 INFO:teuthology.orchestra.run.smithi155.stdout: "flag_point": "commit sent; apply or cleanup", 2023-08-01T19:56:06.954 INFO:teuthology.orchestra.run.smithi155.stdout: "client_info": { 2023-08-01T19:56:06.954 INFO:teuthology.orchestra.run.smithi155.stdout: "client": "client.4668", 2023-08-01T19:56:06.954 INFO:teuthology.orchestra.run.smithi155.stdout: "client_addr": "172.21.15.6:0/1709472247", 2023-08-01T19:56:06.954 INFO:teuthology.orchestra.run.smithi155.stdout: "tid": 100252 2023-08-01T19:56:06.954 INFO:teuthology.orchestra.run.smithi155.stdout: }, 2023-08-01T19:56:06.955 INFO:teuthology.orchestra.run.smithi155.stdout: "events": [ 2023-08-01T19:56:06.955 INFO:teuthology.orchestra.run.smithi155.stdout: { 2023-08-01T19:56:06.955 INFO:teuthology.orchestra.run.smithi155.stdout: "event": "initiated", 2023-08-01T19:56:06.955 INFO:teuthology.orchestra.run.smithi155.stdout: "time": "2023-08-01T19:55:05.154048+0000", 2023-08-01T19:56:06.955 INFO:teuthology.orchestra.run.smithi155.stdout: "duration": 0 2023-08-01T19:56:06.955 INFO:teuthology.orchestra.run.smithi155.stdout: }, 2023-08-01T19:56:06.955 INFO:teuthology.orchestra.run.smithi155.stdout: { 2023-08-01T19:56:06.955 INFO:teuthology.orchestra.run.smithi155.stdout: "event": "throttled", 2023-08-01T19:56:06.956 INFO:teuthology.orchestra.run.smithi155.stdout: "time": "2023-08-01T19:55:05.154048+0000", 2023-08-01T19:56:06.956 INFO:teuthology.orchestra.run.smithi155.stdout: "duration": 0 2023-08-01T19:56:06.956 INFO:teuthology.orchestra.run.smithi155.stdout: }, 2023-08-01T19:56:06.956 INFO:teuthology.orchestra.run.smithi155.stdout: { 2023-08-01T19:56:06.956 INFO:teuthology.orchestra.run.smithi155.stdout: "event": "header_read", 2023-08-01T19:56:06.956 INFO:teuthology.orchestra.run.smithi155.stdout: "time": "2023-08-01T19:55:05.154047+0000", 2023-08-01T19:56:06.956 INFO:teuthology.orchestra.run.smithi155.stdout: "duration": 4294967295.999999 2023-08-01T19:56:06.956 INFO:teuthology.orchestra.run.smithi155.stdout: }, 2023-08-01T19:56:06.957 INFO:teuthology.orchestra.run.smithi155.stdout: { 2023-08-01T19:56:06.957 INFO:teuthology.orchestra.run.smithi155.stdout: "event": "all_read", 2023-08-01T19:56:06.957 INFO:teuthology.orchestra.run.smithi155.stdout: "time": "2023-08-01T19:55:05.154115+0000", 2023-08-01T19:56:06.957 INFO:teuthology.orchestra.run.smithi155.stdout: "duration": 6.7545999999999993e-05 2023-08-01T19:56:06.957 INFO:teuthology.orchestra.run.smithi155.stdout: }, 2023-08-01T19:56:06.957 INFO:teuthology.orchestra.run.smithi155.stdout: { 2023-08-01T19:56:06.957 INFO:teuthology.orchestra.run.smithi155.stdout: "event": "dispatched", 2023-08-01T19:56:06.957 INFO:teuthology.orchestra.run.smithi155.stdout: "time": "2023-08-01T19:55:05.154125+0000", 2023-08-01T19:56:06.958 INFO:teuthology.orchestra.run.smithi155.stdout: "duration": 1.0669000000000001e-05 2023-08-01T19:56:06.958 INFO:teuthology.orchestra.run.smithi155.stdout: }, 2023-08-01T19:56:06.958 INFO:teuthology.orchestra.run.smithi155.stdout: { 2023-08-01T19:56:06.958 INFO:teuthology.orchestra.run.smithi155.stdout: "event": "queued_for_pg", 2023-08-01T19:56:06.958 INFO:teuthology.orchestra.run.smithi155.stdout: "time": "2023-08-01T19:55:05.154131+0000", 2023-08-01T19:56:06.958 INFO:teuthology.orchestra.run.smithi155.stdout: "duration": 6.0349999999999998e-06 2023-08-01T19:56:06.958 INFO:teuthology.orchestra.run.smithi155.stdout: }, 2023-08-01T19:56:06.958 INFO:teuthology.orchestra.run.smithi155.stdout: { 2023-08-01T19:56:06.959 INFO:teuthology.orchestra.run.smithi155.stdout: "event": "reached_pg", 2023-08-01T19:56:06.959 INFO:teuthology.orchestra.run.smithi155.stdout: "time": "2023-08-01T19:55:05.154174+0000", 2023-08-01T19:56:06.959 INFO:teuthology.orchestra.run.smithi155.stdout: "duration": 4.2429000000000003e-05 2023-08-01T19:56:06.959 INFO:teuthology.orchestra.run.smithi155.stdout: }, 2023-08-01T19:56:06.959 INFO:teuthology.orchestra.run.smithi155.stdout: { 2023-08-01T19:56:06.959 INFO:teuthology.orchestra.run.smithi155.stdout: "event": "started", 2023-08-01T19:56:06.959 INFO:teuthology.orchestra.run.smithi155.stdout: "time": "2023-08-01T19:55:05.154287+0000", 2023-08-01T19:56:06.959 INFO:teuthology.orchestra.run.smithi155.stdout: "duration": 0.000113138 2023-08-01T19:56:06.960 INFO:teuthology.orchestra.run.smithi155.stdout: }, 2023-08-01T19:56:06.960 INFO:teuthology.orchestra.run.smithi155.stdout: { 2023-08-01T19:56:06.960 INFO:teuthology.orchestra.run.smithi155.stdout: "event": "waiting for subops from 0", 2023-08-01T19:56:06.960 INFO:teuthology.orchestra.run.smithi155.stdout: "time": "2023-08-01T19:55:05.154420+0000", 2023-08-01T19:56:06.960 INFO:teuthology.orchestra.run.smithi155.stdout: "duration": 0.000133292 2023-08-01T19:56:06.960 INFO:teuthology.orchestra.run.smithi155.stdout: }, 2023-08-01T19:56:06.960 INFO:teuthology.orchestra.run.smithi155.stdout: { 2023-08-01T19:56:06.960 INFO:teuthology.orchestra.run.smithi155.stdout: "event": "sub_op_commit_rec", 2023-08-01T19:56:06.961 INFO:teuthology.orchestra.run.smithi155.stdout: "time": "2023-08-01T19:55:05.219034+0000", 2023-08-01T19:56:06.961 INFO:teuthology.orchestra.run.smithi155.stdout: "duration": 0.064613429999999999 2023-08-01T19:56:06.961 INFO:teuthology.orchestra.run.smithi155.stdout: }, 2023-08-01T19:56:06.961 INFO:teuthology.orchestra.run.smithi155.stdout: { 2023-08-01T19:56:06.961 INFO:teuthology.orchestra.run.smithi155.stdout: "event": "op_commit", 2023-08-01T19:56:06.961 INFO:teuthology.orchestra.run.smithi155.stdout: "time": "2023-08-01T19:55:05.224138+0000", 2023-08-01T19:56:06.961 INFO:teuthology.orchestra.run.smithi155.stdout: "duration": 0.0051041999999999997 2023-08-01T19:56:06.962 INFO:teuthology.orchestra.run.smithi155.stdout: }, 2023-08-01T19:56:06.962 INFO:teuthology.orchestra.run.smithi155.stdout: { 2023-08-01T19:56:06.962 INFO:teuthology.orchestra.run.smithi155.stdout: "event": "commit_sent", 2023-08-01T19:56:06.962 INFO:teuthology.orchestra.run.smithi155.stdout: "time": "2023-08-01T19:55:05.224171+0000", 2023-08-01T19:56:06.962 INFO:teuthology.orchestra.run.smithi155.stdout: "duration": 3.3345e-05 2023-08-01T19:56:06.962 INFO:teuthology.orchestra.run.smithi155.stdout: }, 2023-08-01T19:56:06.962 INFO:teuthology.orchestra.run.smithi155.stdout: { 2023-08-01T19:56:06.962 INFO:teuthology.orchestra.run.smithi155.stdout: "event": "done", 2023-08-01T19:56:06.963 INFO:teuthology.orchestra.run.smithi155.stdout: "time": "2023-08-01T19:55:05.224205+0000", 2023-08-01T19:56:06.963 INFO:teuthology.orchestra.run.smithi155.stdout: "duration": 3.3525999999999997e-05 2023-08-01T19:56:06.963 INFO:teuthology.orchestra.run.smithi155.stdout: } 2023-08-01T19:56:06.963 INFO:teuthology.orchestra.run.smithi155.stdout: ] 2023-08-01T19:56:06.963 INFO:teuthology.orchestra.run.smithi155.stdout: } 2023-08-01T19:56:06.963 INFO:teuthology.orchestra.run.smithi155.stdout: }, 2023-08-01T19:56:06.963 INFO:teuthology.orchestra.run.smithi155.stdout: { 2023-08-01T19:56:06.963 INFO:teuthology.orchestra.run.smithi155.stdout: "description": "osd_repop_reply(client.4668.0:100237 5.4 e37/19 ondisk, result = 0)", 2023-08-01T19:56:06.964 INFO:teuthology.orchestra.run.smithi155.stdout: "initiated_at": "2023-08-01T19:55:05.156249+0000", 2023-08-01T19:56:06.964 INFO:teuthology.orchestra.run.smithi155.stdout: "age": 61.718171243999997, 2023-08-01T19:56:06.964 INFO:teuthology.orchestra.run.smithi155.stdout: "duration": 0.062792549000000003, 2023-08-01T19:56:06.964 INFO:teuthology.orchestra.run.smithi155.stdout: "type_data": { 2023-08-01T19:56:06.964 INFO:teuthology.orchestra.run.smithi155.stdout: "flag_point": "started", 2023-08-01T19:56:06.964 INFO:teuthology.orchestra.run.smithi155.stdout: "events": [ 2023-08-01T19:56:06.964 INFO:teuthology.orchestra.run.smithi155.stdout: { 2023-08-01T19:56:06.964 INFO:teuthology.orchestra.run.smithi155.stdout: "event": "initiated", 2023-08-01T19:56:06.965 INFO:teuthology.orchestra.run.smithi155.stdout: "time": "2023-08-01T19:55:05.156249+0000", 2023-08-01T19:56:06.965 INFO:teuthology.orchestra.run.smithi155.stdout: "duration": 0 2023-08-01T19:56:06.965 INFO:teuthology.orchestra.run.smithi155.stdout: }, 2023-08-01T19:56:06.965 INFO:teuthology.orchestra.run.smithi155.stdout: { 2023-08-01T19:56:06.965 INFO:teuthology.orchestra.run.smithi155.stdout: "event": "throttled", 2023-08-01T19:56:06.965 INFO:teuthology.orchestra.run.smithi155.stdout: "time": "2023-08-01T19:55:05.156249+0000", 2023-08-01T19:56:06.965 INFO:teuthology.orchestra.run.smithi155.stdout: "duration": 0 2023-08-01T19:56:06.966 INFO:teuthology.orchestra.run.smithi155.stdout: }, 2023-08-01T19:56:06.966 INFO:teuthology.orchestra.run.smithi155.stdout: { 2023-08-01T19:56:06.966 INFO:teuthology.orchestra.run.smithi155.stdout: "event": "header_read", 2023-08-01T19:56:06.966 INFO:teuthology.orchestra.run.smithi155.stdout: "time": "2023-08-01T19:55:05.156248+0000", 2023-08-01T19:56:06.966 INFO:teuthology.orchestra.run.smithi155.stdout: "duration": 4294967295.9999995 2023-08-01T19:56:06.966 INFO:teuthology.orchestra.run.smithi155.stdout: }, 2023-08-01T19:56:06.966 INFO:teuthology.orchestra.run.smithi155.stdout: { 2023-08-01T19:56:06.966 INFO:teuthology.orchestra.run.smithi155.stdout: "event": "all_read", 2023-08-01T19:56:06.967 INFO:teuthology.orchestra.run.smithi155.stdout: "time": "2023-08-01T19:55:05.156252+0000", 2023-08-01T19:56:06.967 INFO:teuthology.orchestra.run.smithi155.stdout: "duration": 3.9999999999999998e-06 2023-08-01T19:56:06.967 INFO:teuthology.orchestra.run.smithi155.stdout: }, 2023-08-01T19:56:06.967 INFO:teuthology.orchestra.run.smithi155.stdout: { 2023-08-01T19:56:06.967 INFO:teuthology.orchestra.run.smithi155.stdout: "event": "dispatched", 2023-08-01T19:56:06.967 INFO:teuthology.orchestra.run.smithi155.stdout: "time": "2023-08-01T19:55:05.218844+0000", 2023-08-01T19:56:06.967 INFO:teuthology.orchestra.run.smithi155.stdout: "duration": 0.062591516999999999 2023-08-01T19:56:06.967 INFO:teuthology.orchestra.run.smithi155.stdout: }, 2023-08-01T19:56:06.968 INFO:teuthology.orchestra.run.smithi155.stdout: { 2023-08-01T19:56:06.968 INFO:teuthology.orchestra.run.smithi155.stdout: "event": "queued_for_pg", 2023-08-01T19:56:06.968 INFO:teuthology.orchestra.run.smithi155.stdout: "time": "2023-08-01T19:55:05.218862+0000", 2023-08-01T19:56:06.968 INFO:teuthology.orchestra.run.smithi155.stdout: "duration": 1.7666e-05 2023-08-01T19:56:06.968 INFO:teuthology.orchestra.run.smithi155.stdout: }, 2023-08-01T19:56:06.968 INFO:teuthology.orchestra.run.smithi155.stdout: { 2023-08-01T19:56:06.968 INFO:teuthology.orchestra.run.smithi155.stdout: "event": "reached_pg", 2023-08-01T19:56:06.968 INFO:teuthology.orchestra.run.smithi155.stdout: "time": "2023-08-01T19:55:05.218914+0000", 2023-08-01T19:56:06.969 INFO:teuthology.orchestra.run.smithi155.stdout: "duration": 5.2565999999999998e-05 2023-08-01T19:56:06.969 INFO:teuthology.orchestra.run.smithi155.stdout: }, 2023-08-01T19:56:06.969 INFO:teuthology.orchestra.run.smithi155.stdout: { 2023-08-01T19:56:06.969 INFO:teuthology.orchestra.run.smithi155.stdout: "event": "started", 2023-08-01T19:56:06.969 INFO:teuthology.orchestra.run.smithi155.stdout: "time": "2023-08-01T19:55:05.218925+0000", 2023-08-01T19:56:06.969 INFO:teuthology.orchestra.run.smithi155.stdout: "duration": 1.1375e-05 2023-08-01T19:56:06.969 INFO:teuthology.orchestra.run.smithi155.stdout: }, 2023-08-01T19:56:06.969 INFO:teuthology.orchestra.run.smithi155.stdout: { 2023-08-01T19:56:06.970 INFO:teuthology.orchestra.run.smithi155.stdout: "event": "done", 2023-08-01T19:56:06.970 INFO:teuthology.orchestra.run.smithi155.stdout: "time": "2023-08-01T19:55:05.219041+0000", 2023-08-01T19:56:06.970 INFO:teuthology.orchestra.run.smithi155.stdout: "duration": 0.000115977 2023-08-01T19:56:06.970 INFO:teuthology.orchestra.run.smithi155.stdout: } 2023-08-01T19:56:06.970 INFO:teuthology.orchestra.run.smithi155.stdout: ] 2023-08-01T19:56:06.970 INFO:teuthology.orchestra.run.smithi155.stdout: } 2023-08-01T19:56:06.970 INFO:teuthology.orchestra.run.smithi155.stdout: }, 2023-08-01T19:56:06.970 INFO:teuthology.orchestra.run.smithi155.stdout: { 2023-08-01T19:56:06.971 INFO:teuthology.orchestra.run.smithi155.stdout: "description": "osd_repop(client.4668.0:100253 5.f e37/19 5:f7bbce05:::benchmark_data_smithi006_114134_object100252:head v 37'6323, mlcod=37'6321)", 2023-08-01T19:56:06.971 INFO:teuthology.orchestra.run.smithi155.stdout: "initiated_at": "2023-08-01T19:55:05.156952+0000", 2023-08-01T19:56:06.971 INFO:teuthology.orchestra.run.smithi155.stdout: "age": 61.717468181000001, 2023-08-01T19:56:06.971 INFO:teuthology.orchestra.run.smithi155.stdout: "duration": 0.068018577999999996, 2023-08-01T19:56:06.971 INFO:teuthology.orchestra.run.smithi155.stdout: "type_data": { 2023-08-01T19:56:06.971 INFO:teuthology.orchestra.run.smithi155.stdout: "flag_point": "commit sent; apply or cleanup", 2023-08-01T19:56:06.971 INFO:teuthology.orchestra.run.smithi155.stdout: "events": [ 2023-08-01T19:56:06.971 INFO:teuthology.orchestra.run.smithi155.stdout: { 2023-08-01T19:56:06.972 INFO:teuthology.orchestra.run.smithi155.stdout: "event": "initiated", 2023-08-01T19:56:06.972 INFO:teuthology.orchestra.run.smithi155.stdout: "time": "2023-08-01T19:55:05.156952+0000", 2023-08-01T19:56:06.972 INFO:teuthology.orchestra.run.smithi155.stdout: "duration": 0 2023-08-01T19:56:06.972 INFO:teuthology.orchestra.run.smithi155.stdout: }, 2023-08-01T19:56:06.972 INFO:teuthology.orchestra.run.smithi155.stdout: { 2023-08-01T19:56:06.972 INFO:teuthology.orchestra.run.smithi155.stdout: "event": "throttled", 2023-08-01T19:56:06.972 INFO:teuthology.orchestra.run.smithi155.stdout: "time": "2023-08-01T19:55:05.156952+0000", 2023-08-01T19:56:06.973 INFO:teuthology.orchestra.run.smithi155.stdout: "duration": 0 2023-08-01T19:56:06.973 INFO:teuthology.orchestra.run.smithi155.stdout: }, 2023-08-01T19:56:06.973 INFO:teuthology.orchestra.run.smithi155.stdout: { 2023-08-01T19:56:06.973 INFO:teuthology.orchestra.run.smithi155.stdout: "event": "header_read", 2023-08-01T19:56:06.973 INFO:teuthology.orchestra.run.smithi155.stdout: "time": "2023-08-01T19:55:05.156951+0000", 2023-08-01T19:56:06.973 INFO:teuthology.orchestra.run.smithi155.stdout: "duration": 4294967295.999999 2023-08-01T19:56:06.973 INFO:teuthology.orchestra.run.smithi155.stdout: }, 2023-08-01T19:56:06.973 INFO:teuthology.orchestra.run.smithi155.stdout: { 2023-08-01T19:56:06.974 INFO:teuthology.orchestra.run.smithi155.stdout: "event": "all_read", 2023-08-01T19:56:06.974 INFO:teuthology.orchestra.run.smithi155.stdout: "time": "2023-08-01T19:55:05.156989+0000", 2023-08-01T19:56:06.974 INFO:teuthology.orchestra.run.smithi155.stdout: "duration": 3.8175e-05 2023-08-01T19:56:06.974 INFO:teuthology.orchestra.run.smithi155.stdout: }, 2023-08-01T19:56:06.974 INFO:teuthology.orchestra.run.smithi155.stdout: { 2023-08-01T19:56:06.974 INFO:teuthology.orchestra.run.smithi155.stdout: "event": "dispatched", 2023-08-01T19:56:06.974 INFO:teuthology.orchestra.run.smithi155.stdout: "time": "2023-08-01T19:55:05.218842+0000", 2023-08-01T19:56:06.974 INFO:teuthology.orchestra.run.smithi155.stdout: "duration": 0.061852299999999999 2023-08-01T19:56:06.975 INFO:teuthology.orchestra.run.smithi155.stdout: }, 2023-08-01T19:56:06.975 INFO:teuthology.orchestra.run.smithi155.stdout: { 2023-08-01T19:56:06.975 INFO:teuthology.orchestra.run.smithi155.stdout: "event": "queued_for_pg", 2023-08-01T19:56:06.975 INFO:teuthology.orchestra.run.smithi155.stdout: "time": "2023-08-01T19:55:05.218862+0000", 2023-08-01T19:56:06.975 INFO:teuthology.orchestra.run.smithi155.stdout: "duration": 1.9854999999999999e-05 2023-08-01T19:56:06.975 INFO:teuthology.orchestra.run.smithi155.stdout: }, 2023-08-01T19:56:06.975 INFO:teuthology.orchestra.run.smithi155.stdout: { 2023-08-01T19:56:06.975 INFO:teuthology.orchestra.run.smithi155.stdout: "event": "reached_pg", 2023-08-01T19:56:06.976 INFO:teuthology.orchestra.run.smithi155.stdout: "time": "2023-08-01T19:55:05.218918+0000", 2023-08-01T19:56:06.976 INFO:teuthology.orchestra.run.smithi155.stdout: "duration": 5.6570000000000002e-05 2023-08-01T19:56:06.976 INFO:teuthology.orchestra.run.smithi155.stdout: }, 2023-08-01T19:56:06.976 INFO:teuthology.orchestra.run.smithi155.stdout: { 2023-08-01T19:56:06.976 INFO:teuthology.orchestra.run.smithi155.stdout: "event": "started", 2023-08-01T19:56:06.976 INFO:teuthology.orchestra.run.smithi155.stdout: "time": "2023-08-01T19:55:05.218940+0000", 2023-08-01T19:56:06.976 INFO:teuthology.orchestra.run.smithi155.stdout: "duration": 2.1804e-05 2023-08-01T19:56:06.977 INFO:teuthology.orchestra.run.smithi155.stdout: }, 2023-08-01T19:56:06.977 INFO:teuthology.orchestra.run.smithi155.stdout: { 2023-08-01T19:56:06.977 INFO:teuthology.orchestra.run.smithi155.stdout: "event": "commit_sent", 2023-08-01T19:56:06.977 INFO:teuthology.orchestra.run.smithi155.stdout: "time": "2023-08-01T19:55:05.224928+0000", 2023-08-01T19:56:06.977 INFO:teuthology.orchestra.run.smithi155.stdout: "duration": 0.0059876759999999999 2023-08-01T19:56:06.977 INFO:teuthology.orchestra.run.smithi155.stdout: }, 2023-08-01T19:56:06.977 INFO:teuthology.orchestra.run.smithi155.stdout: { 2023-08-01T19:56:06.977 INFO:teuthology.orchestra.run.smithi155.stdout: "event": "done", 2023-08-01T19:56:06.978 INFO:teuthology.orchestra.run.smithi155.stdout: "time": "2023-08-01T19:55:05.224971+0000", 2023-08-01T19:56:06.978 INFO:teuthology.orchestra.run.smithi155.stdout: "duration": 4.2929999999999997e-05 2023-08-01T19:56:06.978 INFO:teuthology.orchestra.run.smithi155.stdout: } 2023-08-01T19:56:06.978 INFO:teuthology.orchestra.run.smithi155.stdout: ] 2023-08-01T19:56:06.978 INFO:teuthology.orchestra.run.smithi155.stdout: } 2023-08-01T19:56:06.978 INFO:teuthology.orchestra.run.smithi155.stdout: }, 2023-08-01T19:56:06.978 INFO:teuthology.orchestra.run.smithi155.stdout: { 2023-08-01T19:56:06.978 INFO:teuthology.orchestra.run.smithi155.stdout: "description": "osd_op(client.4668.0:100927 5.0 5:00608ec6:::benchmark_data_smithi006_114134_object100926:head [set-alloc-hint object_size 65536 write_size 65536,write 0~65536] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e37)", 2023-08-01T19:56:06.979 INFO:teuthology.orchestra.run.smithi155.stdout: "initiated_at": "2023-08-01T19:55:05.561169+0000", 2023-08-01T19:56:06.979 INFO:teuthology.orchestra.run.smithi155.stdout: "age": 61.313251278000003, 2023-08-01T19:56:06.979 INFO:teuthology.orchestra.run.smithi155.stdout: "duration": 0.066411687999999997, 2023-08-01T19:56:06.979 INFO:teuthology.orchestra.run.smithi155.stdout: "type_data": { 2023-08-01T19:56:06.979 INFO:teuthology.orchestra.run.smithi155.stdout: "flag_point": "commit sent; apply or cleanup", 2023-08-01T19:56:06.979 INFO:teuthology.orchestra.run.smithi155.stdout: "client_info": { 2023-08-01T19:56:06.979 INFO:teuthology.orchestra.run.smithi155.stdout: "client": "client.4668", 2023-08-01T19:56:06.979 INFO:teuthology.orchestra.run.smithi155.stdout: "client_addr": "172.21.15.6:0/1709472247", 2023-08-01T19:56:06.980 INFO:teuthology.orchestra.run.smithi155.stdout: "tid": 100927 2023-08-01T19:56:06.980 INFO:teuthology.orchestra.run.smithi155.stdout: }, 2023-08-01T19:56:06.980 INFO:teuthology.orchestra.run.smithi155.stdout: "events": [ 2023-08-01T19:56:06.980 INFO:teuthology.orchestra.run.smithi155.stdout: { 2023-08-01T19:56:06.980 INFO:teuthology.orchestra.run.smithi155.stdout: "event": "initiated", 2023-08-01T19:56:06.980 INFO:teuthology.orchestra.run.smithi155.stdout: "time": "2023-08-01T19:55:05.561169+0000", 2023-08-01T19:56:06.980 INFO:teuthology.orchestra.run.smithi155.stdout: "duration": 0 2023-08-01T19:56:06.980 INFO:teuthology.orchestra.run.smithi155.stdout: }, 2023-08-01T19:56:06.981 INFO:teuthology.orchestra.run.smithi155.stdout: { 2023-08-01T19:56:06.981 INFO:teuthology.orchestra.run.smithi155.stdout: "event": "throttled", 2023-08-01T19:56:06.981 INFO:teuthology.orchestra.run.smithi155.stdout: "time": "2023-08-01T19:55:05.561169+0000", 2023-08-01T19:56:06.981 INFO:teuthology.orchestra.run.smithi155.stdout: "duration": 0 2023-08-01T19:56:06.981 INFO:teuthology.orchestra.run.smithi155.stdout: }, 2023-08-01T19:56:06.981 INFO:teuthology.orchestra.run.smithi155.stdout: { 2023-08-01T19:56:06.981 INFO:teuthology.orchestra.run.smithi155.stdout: "event": "header_read", 2023-08-01T19:56:06.982 INFO:teuthology.orchestra.run.smithi155.stdout: "time": "2023-08-01T19:55:05.561168+0000", 2023-08-01T19:56:06.982 INFO:teuthology.orchestra.run.smithi155.stdout: "duration": 4294967295.9999995 2023-08-01T19:56:06.982 INFO:teuthology.orchestra.run.smithi155.stdout: }, 2023-08-01T19:56:06.982 INFO:teuthology.orchestra.run.smithi155.stdout: { 2023-08-01T19:56:06.982 INFO:teuthology.orchestra.run.smithi155.stdout: "event": "all_read", 2023-08-01T19:56:06.982 INFO:teuthology.orchestra.run.smithi155.stdout: "time": "2023-08-01T19:55:05.561218+0000", 2023-08-01T19:56:06.982 INFO:teuthology.orchestra.run.smithi155.stdout: "duration": 4.9379999999999998e-05 2023-08-01T19:56:06.982 INFO:teuthology.orchestra.run.smithi155.stdout: }, 2023-08-01T19:56:06.983 INFO:teuthology.orchestra.run.smithi155.stdout: { 2023-08-01T19:56:06.983 INFO:teuthology.orchestra.run.smithi155.stdout: "event": "dispatched", 2023-08-01T19:56:06.983 INFO:teuthology.orchestra.run.smithi155.stdout: "time": "2023-08-01T19:55:05.561225+0000", 2023-08-01T19:56:06.983 INFO:teuthology.orchestra.run.smithi155.stdout: "duration": 7.114e-06 2023-08-01T19:56:06.983 INFO:teuthology.orchestra.run.smithi155.stdout: }, 2023-08-01T19:56:06.983 INFO:teuthology.orchestra.run.smithi155.stdout: { 2023-08-01T19:56:06.983 INFO:teuthology.orchestra.run.smithi155.stdout: "event": "queued_for_pg", 2023-08-01T19:56:06.983 INFO:teuthology.orchestra.run.smithi155.stdout: "time": "2023-08-01T19:55:05.561229+0000", 2023-08-01T19:56:06.984 INFO:teuthology.orchestra.run.smithi155.stdout: "duration": 4.2180000000000001e-06 2023-08-01T19:56:06.984 INFO:teuthology.orchestra.run.smithi155.stdout: }, 2023-08-01T19:56:06.984 INFO:teuthology.orchestra.run.smithi155.stdout: { 2023-08-01T19:56:06.984 INFO:teuthology.orchestra.run.smithi155.stdout: "event": "reached_pg", 2023-08-01T19:56:06.984 INFO:teuthology.orchestra.run.smithi155.stdout: "time": "2023-08-01T19:55:05.564737+0000", 2023-08-01T19:56:06.984 INFO:teuthology.orchestra.run.smithi155.stdout: "duration": 0.0035081869999999999 2023-08-01T19:56:06.984 INFO:teuthology.orchestra.run.smithi155.stdout: }, 2023-08-01T19:56:06.984 INFO:teuthology.orchestra.run.smithi155.stdout: { 2023-08-01T19:56:06.985 INFO:teuthology.orchestra.run.smithi155.stdout: "event": "started", 2023-08-01T19:56:06.985 INFO:teuthology.orchestra.run.smithi155.stdout: "time": "2023-08-01T19:55:05.564859+0000", 2023-08-01T19:56:06.985 INFO:teuthology.orchestra.run.smithi155.stdout: "duration": 0.00012165800000000001 2023-08-01T19:56:06.985 INFO:teuthology.orchestra.run.smithi155.stdout: }, 2023-08-01T19:56:06.985 INFO:teuthology.orchestra.run.smithi155.stdout: { 2023-08-01T19:56:06.985 INFO:teuthology.orchestra.run.smithi155.stdout: "event": "waiting for subops from 0", 2023-08-01T19:56:06.985 INFO:teuthology.orchestra.run.smithi155.stdout: "time": "2023-08-01T19:55:05.565009+0000", 2023-08-01T19:56:06.985 INFO:teuthology.orchestra.run.smithi155.stdout: "duration": 0.00014979699999999999 2023-08-01T19:56:06.986 INFO:teuthology.orchestra.run.smithi155.stdout: }, 2023-08-01T19:56:06.986 INFO:teuthology.orchestra.run.smithi155.stdout: { 2023-08-01T19:56:06.986 INFO:teuthology.orchestra.run.smithi155.stdout: "event": "op_commit", 2023-08-01T19:56:06.986 INFO:teuthology.orchestra.run.smithi155.stdout: "time": "2023-08-01T19:55:05.568007+0000", 2023-08-01T19:56:06.986 INFO:teuthology.orchestra.run.smithi155.stdout: "duration": 0.00299796 2023-08-01T19:56:06.986 INFO:teuthology.orchestra.run.smithi155.stdout: }, 2023-08-01T19:56:06.986 INFO:teuthology.orchestra.run.smithi155.stdout: { 2023-08-01T19:56:06.986 INFO:teuthology.orchestra.run.smithi155.stdout: "event": "sub_op_commit_rec", 2023-08-01T19:56:06.987 INFO:teuthology.orchestra.run.smithi155.stdout: "time": "2023-08-01T19:55:05.627520+0000", 2023-08-01T19:56:06.987 INFO:teuthology.orchestra.run.smithi155.stdout: "duration": 0.059513636000000002 2023-08-01T19:56:06.987 INFO:teuthology.orchestra.run.smithi155.stdout: }, 2023-08-01T19:56:06.987 INFO:teuthology.orchestra.run.smithi155.stdout: { 2023-08-01T19:56:06.987 INFO:teuthology.orchestra.run.smithi155.stdout: "event": "commit_sent", 2023-08-01T19:56:06.987 INFO:teuthology.orchestra.run.smithi155.stdout: "time": "2023-08-01T19:55:05.627553+0000", 2023-08-01T19:56:06.987 INFO:teuthology.orchestra.run.smithi155.stdout: "duration": 3.2635999999999997e-05 2023-08-01T19:56:06.987 INFO:teuthology.orchestra.run.smithi155.stdout: }, 2023-08-01T19:56:06.988 INFO:teuthology.orchestra.run.smithi155.stdout: { 2023-08-01T19:56:06.988 INFO:teuthology.orchestra.run.smithi155.stdout: "event": "done", 2023-08-01T19:56:06.988 INFO:teuthology.orchestra.run.smithi155.stdout: "time": "2023-08-01T19:55:05.627581+0000", 2023-08-01T19:56:06.988 INFO:teuthology.orchestra.run.smithi155.stdout: "duration": 2.7681000000000001e-05 2023-08-01T19:56:06.988 INFO:teuthology.orchestra.run.smithi155.stdout: } 2023-08-01T19:56:06.988 INFO:teuthology.orchestra.run.smithi155.stdout: ] 2023-08-01T19:56:06.988 INFO:teuthology.orchestra.run.smithi155.stdout: } 2023-08-01T19:56:06.989 INFO:teuthology.orchestra.run.smithi155.stdout: }, 2023-08-01T19:56:06.989 INFO:teuthology.orchestra.run.smithi155.stdout: { 2023-08-01T19:56:06.989 INFO:teuthology.orchestra.run.smithi155.stdout: "description": "osd_op(client.4668.0:100935 5.e 5:7895b14e:::benchmark_data_smithi006_114134_object100934:head [set-alloc-hint object_size 65536 write_size 65536,write 0~65536] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e37)", 2023-08-01T19:56:06.989 INFO:teuthology.orchestra.run.smithi155.stdout: "initiated_at": "2023-08-01T19:55:05.566666+0000", 2023-08-01T19:56:06.989 INFO:teuthology.orchestra.run.smithi155.stdout: "age": 61.307753978000001, 2023-08-01T19:56:06.989 INFO:teuthology.orchestra.run.smithi155.stdout: "duration": 0.064309016999999996, 2023-08-01T19:56:06.989 INFO:teuthology.orchestra.run.smithi155.stdout: "type_data": { 2023-08-01T19:56:06.989 INFO:teuthology.orchestra.run.smithi155.stdout: "flag_point": "commit sent; apply or cleanup", 2023-08-01T19:56:06.990 INFO:teuthology.orchestra.run.smithi155.stdout: "client_info": { 2023-08-01T19:56:06.990 INFO:teuthology.orchestra.run.smithi155.stdout: "client": "client.4668", 2023-08-01T19:56:06.990 INFO:teuthology.orchestra.run.smithi155.stdout: "client_addr": "172.21.15.6:0/1709472247", 2023-08-01T19:56:06.990 INFO:teuthology.orchestra.run.smithi155.stdout: "tid": 100935 2023-08-01T19:56:06.990 INFO:teuthology.orchestra.run.smithi155.stdout: }, 2023-08-01T19:56:06.990 INFO:teuthology.orchestra.run.smithi155.stdout: "events": [ 2023-08-01T19:56:06.990 INFO:teuthology.orchestra.run.smithi155.stdout: { 2023-08-01T19:56:06.990 INFO:teuthology.orchestra.run.smithi155.stdout: "event": "initiated", 2023-08-01T19:56:06.991 INFO:teuthology.orchestra.run.smithi155.stdout: "time": "2023-08-01T19:55:05.566666+0000", 2023-08-01T19:56:06.991 INFO:teuthology.orchestra.run.smithi155.stdout: "duration": 0 2023-08-01T19:56:06.991 INFO:teuthology.orchestra.run.smithi155.stdout: }, 2023-08-01T19:56:06.991 INFO:teuthology.orchestra.run.smithi155.stdout: { 2023-08-01T19:56:06.991 INFO:teuthology.orchestra.run.smithi155.stdout: "event": "throttled", 2023-08-01T19:56:06.991 INFO:teuthology.orchestra.run.smithi155.stdout: "time": "2023-08-01T19:55:05.566666+0000", 2023-08-01T19:56:06.991 INFO:teuthology.orchestra.run.smithi155.stdout: "duration": 0 2023-08-01T19:56:06.991 INFO:teuthology.orchestra.run.smithi155.stdout: }, 2023-08-01T19:56:06.992 INFO:teuthology.orchestra.run.smithi155.stdout: { 2023-08-01T19:56:06.992 INFO:teuthology.orchestra.run.smithi155.stdout: "event": "header_read", 2023-08-01T19:56:06.992 INFO:teuthology.orchestra.run.smithi155.stdout: "time": "2023-08-01T19:55:05.566665+0000", 2023-08-01T19:56:06.992 INFO:teuthology.orchestra.run.smithi155.stdout: "duration": 4294967295.9999986 2023-08-01T19:56:06.992 INFO:teuthology.orchestra.run.smithi155.stdout: }, 2023-08-01T19:56:06.992 INFO:teuthology.orchestra.run.smithi155.stdout: { 2023-08-01T19:56:06.992 INFO:teuthology.orchestra.run.smithi155.stdout: "event": "all_read", 2023-08-01T19:56:06.992 INFO:teuthology.orchestra.run.smithi155.stdout: "time": "2023-08-01T19:55:05.566754+0000", 2023-08-01T19:56:06.993 INFO:teuthology.orchestra.run.smithi155.stdout: "duration": 8.9425999999999994e-05 2023-08-01T19:56:06.993 INFO:teuthology.orchestra.run.smithi155.stdout: }, 2023-08-01T19:56:06.993 INFO:teuthology.orchestra.run.smithi155.stdout: { 2023-08-01T19:56:06.993 INFO:teuthology.orchestra.run.smithi155.stdout: "event": "dispatched", 2023-08-01T19:56:06.993 INFO:teuthology.orchestra.run.smithi155.stdout: "time": "2023-08-01T19:55:05.566766+0000", 2023-08-01T19:56:06.993 INFO:teuthology.orchestra.run.smithi155.stdout: "duration": 1.2018000000000001e-05 2023-08-01T19:56:06.993 INFO:teuthology.orchestra.run.smithi155.stdout: }, 2023-08-01T19:56:06.993 INFO:teuthology.orchestra.run.smithi155.stdout: { 2023-08-01T19:56:06.994 INFO:teuthology.orchestra.run.smithi155.stdout: "event": "queued_for_pg", 2023-08-01T19:56:06.994 INFO:teuthology.orchestra.run.smithi155.stdout: "time": "2023-08-01T19:55:05.566772+0000", 2023-08-01T19:56:06.994 INFO:teuthology.orchestra.run.smithi155.stdout: "duration": 6.0190000000000003e-06 2023-08-01T19:56:06.994 INFO:teuthology.orchestra.run.smithi155.stdout: }, 2023-08-01T19:56:06.994 INFO:teuthology.orchestra.run.smithi155.stdout: { 2023-08-01T19:56:06.994 INFO:teuthology.orchestra.run.smithi155.stdout: "event": "reached_pg", 2023-08-01T19:56:06.994 INFO:teuthology.orchestra.run.smithi155.stdout: "time": "2023-08-01T19:55:05.566800+0000", 2023-08-01T19:56:06.995 INFO:teuthology.orchestra.run.smithi155.stdout: "duration": 2.7835999999999999e-05 2023-08-01T19:56:06.995 INFO:teuthology.orchestra.run.smithi155.stdout: }, 2023-08-01T19:56:06.995 INFO:teuthology.orchestra.run.smithi155.stdout: { 2023-08-01T19:56:06.995 INFO:teuthology.orchestra.run.smithi155.stdout: "event": "started", 2023-08-01T19:56:06.995 INFO:teuthology.orchestra.run.smithi155.stdout: "time": "2023-08-01T19:55:05.566879+0000", 2023-08-01T19:56:06.995 INFO:teuthology.orchestra.run.smithi155.stdout: "duration": 7.9105999999999998e-05 2023-08-01T19:56:06.995 INFO:teuthology.orchestra.run.smithi155.stdout: }, 2023-08-01T19:56:06.995 INFO:teuthology.orchestra.run.smithi155.stdout: { 2023-08-01T19:56:06.996 INFO:teuthology.orchestra.run.smithi155.stdout: "event": "waiting for subops from 0", 2023-08-01T19:56:06.996 INFO:teuthology.orchestra.run.smithi155.stdout: "time": "2023-08-01T19:55:05.566971+0000", 2023-08-01T19:56:06.996 INFO:teuthology.orchestra.run.smithi155.stdout: "duration": 9.1817999999999994e-05 2023-08-01T19:56:06.996 INFO:teuthology.orchestra.run.smithi155.stdout: }, 2023-08-01T19:56:06.996 INFO:teuthology.orchestra.run.smithi155.stdout: { 2023-08-01T19:56:06.996 INFO:teuthology.orchestra.run.smithi155.stdout: "event": "op_commit", 2023-08-01T19:56:06.996 INFO:teuthology.orchestra.run.smithi155.stdout: "time": "2023-08-01T19:55:05.571475+0000", 2023-08-01T19:56:06.996 INFO:teuthology.orchestra.run.smithi155.stdout: "duration": 0.0045039499999999996 2023-08-01T19:56:06.997 INFO:teuthology.orchestra.run.smithi155.stdout: }, 2023-08-01T19:56:06.997 INFO:teuthology.orchestra.run.smithi155.stdout: { 2023-08-01T19:56:06.997 INFO:teuthology.orchestra.run.smithi155.stdout: "event": "sub_op_commit_rec", 2023-08-01T19:56:06.997 INFO:teuthology.orchestra.run.smithi155.stdout: "time": "2023-08-01T19:55:05.630884+0000", 2023-08-01T19:56:06.997 INFO:teuthology.orchestra.run.smithi155.stdout: "duration": 0.059409181999999998 2023-08-01T19:56:06.997 INFO:teuthology.orchestra.run.smithi155.stdout: }, 2023-08-01T19:56:06.997 INFO:teuthology.orchestra.run.smithi155.stdout: { 2023-08-01T19:56:06.997 INFO:teuthology.orchestra.run.smithi155.stdout: "event": "commit_sent", 2023-08-01T19:56:06.998 INFO:teuthology.orchestra.run.smithi155.stdout: "time": "2023-08-01T19:55:05.630930+0000", 2023-08-01T19:56:06.998 INFO:teuthology.orchestra.run.smithi155.stdout: "duration": 4.5507999999999999e-05 2023-08-01T19:56:06.998 INFO:teuthology.orchestra.run.smithi155.stdout: }, 2023-08-01T19:56:06.998 INFO:teuthology.orchestra.run.smithi155.stdout: { 2023-08-01T19:56:06.998 INFO:teuthology.orchestra.run.smithi155.stdout: "event": "done", 2023-08-01T19:56:06.998 INFO:teuthology.orchestra.run.smithi155.stdout: "time": "2023-08-01T19:55:05.630975+0000", 2023-08-01T19:56:06.998 INFO:teuthology.orchestra.run.smithi155.stdout: "duration": 4.5441000000000001e-05 2023-08-01T19:56:06.999 INFO:teuthology.orchestra.run.smithi155.stdout: } 2023-08-01T19:56:06.999 INFO:teuthology.orchestra.run.smithi155.stdout: ] 2023-08-01T19:56:06.999 INFO:teuthology.orchestra.run.smithi155.stdout: } 2023-08-01T19:56:06.999 INFO:teuthology.orchestra.run.smithi155.stdout: }, 2023-08-01T19:56:06.999 INFO:teuthology.orchestra.run.smithi155.stdout: { 2023-08-01T19:56:06.999 INFO:teuthology.orchestra.run.smithi155.stdout: "description": "osd_op(client.4668.0:100941 5.e 5:736a6ac6:::benchmark_data_smithi006_114134_object100940:head [set-alloc-hint object_size 65536 write_size 65536,write 0~65536] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e37)", 2023-08-01T19:56:06.999 INFO:teuthology.orchestra.run.smithi155.stdout: "initiated_at": "2023-08-01T19:55:05.569750+0000", 2023-08-01T19:56:06.999 INFO:teuthology.orchestra.run.smithi155.stdout: "age": 61.304670084999998, 2023-08-01T19:56:07.000 INFO:teuthology.orchestra.run.smithi155.stdout: "duration": 0.065431331999999995, 2023-08-01T19:56:07.000 INFO:teuthology.orchestra.run.smithi155.stdout: "type_data": { 2023-08-01T19:56:07.000 INFO:teuthology.orchestra.run.smithi155.stdout: "flag_point": "commit sent; apply or cleanup", 2023-08-01T19:56:07.000 INFO:teuthology.orchestra.run.smithi155.stdout: "client_info": { 2023-08-01T19:56:07.000 INFO:teuthology.orchestra.run.smithi155.stdout: "client": "client.4668", 2023-08-01T19:56:07.000 INFO:teuthology.orchestra.run.smithi155.stdout: "client_addr": "172.21.15.6:0/1709472247", 2023-08-01T19:56:07.000 INFO:teuthology.orchestra.run.smithi155.stdout: "tid": 100941 2023-08-01T19:56:07.000 INFO:teuthology.orchestra.run.smithi155.stdout: }, 2023-08-01T19:56:07.001 INFO:teuthology.orchestra.run.smithi155.stdout: "events": [ 2023-08-01T19:56:07.001 INFO:teuthology.orchestra.run.smithi155.stdout: { 2023-08-01T19:56:07.001 INFO:teuthology.orchestra.run.smithi155.stdout: "event": "initiated", 2023-08-01T19:56:07.001 INFO:teuthology.orchestra.run.smithi155.stdout: "time": "2023-08-01T19:55:05.569750+0000", 2023-08-01T19:56:07.001 INFO:teuthology.orchestra.run.smithi155.stdout: "duration": 0 2023-08-01T19:56:07.001 INFO:teuthology.orchestra.run.smithi155.stdout: }, 2023-08-01T19:56:07.001 INFO:teuthology.orchestra.run.smithi155.stdout: { 2023-08-01T19:56:07.001 INFO:teuthology.orchestra.run.smithi155.stdout: "event": "throttled", 2023-08-01T19:56:07.002 INFO:teuthology.orchestra.run.smithi155.stdout: "time": "2023-08-01T19:55:05.569750+0000", 2023-08-01T19:56:07.002 INFO:teuthology.orchestra.run.smithi155.stdout: "duration": 0 2023-08-01T19:56:07.002 INFO:teuthology.orchestra.run.smithi155.stdout: }, 2023-08-01T19:56:07.002 INFO:teuthology.orchestra.run.smithi155.stdout: { 2023-08-01T19:56:07.002 INFO:teuthology.orchestra.run.smithi155.stdout: "event": "header_read", 2023-08-01T19:56:07.002 INFO:teuthology.orchestra.run.smithi155.stdout: "time": "2023-08-01T19:55:05.569749+0000", 2023-08-01T19:56:07.002 INFO:teuthology.orchestra.run.smithi155.stdout: "duration": 4294967295.999999 2023-08-01T19:56:07.003 INFO:teuthology.orchestra.run.smithi155.stdout: }, 2023-08-01T19:56:07.003 INFO:teuthology.orchestra.run.smithi155.stdout: { 2023-08-01T19:56:07.003 INFO:teuthology.orchestra.run.smithi155.stdout: "event": "all_read", 2023-08-01T19:56:07.003 INFO:teuthology.orchestra.run.smithi155.stdout: "time": "2023-08-01T19:55:05.569861+0000", 2023-08-01T19:56:07.003 INFO:teuthology.orchestra.run.smithi155.stdout: "duration": 0.000111333 2023-08-01T19:56:07.003 INFO:teuthology.orchestra.run.smithi155.stdout: }, 2023-08-01T19:56:07.003 INFO:teuthology.orchestra.run.smithi155.stdout: { 2023-08-01T19:56:07.003 INFO:teuthology.orchestra.run.smithi155.stdout: "event": "dispatched", 2023-08-01T19:56:07.004 INFO:teuthology.orchestra.run.smithi155.stdout: "time": "2023-08-01T19:55:05.569869+0000", 2023-08-01T19:56:07.004 INFO:teuthology.orchestra.run.smithi155.stdout: "duration": 8.8589999999999994e-06 2023-08-01T19:56:07.004 INFO:teuthology.orchestra.run.smithi155.stdout: }, 2023-08-01T19:56:07.004 INFO:teuthology.orchestra.run.smithi155.stdout: { 2023-08-01T19:56:07.004 INFO:teuthology.orchestra.run.smithi155.stdout: "event": "queued_for_pg", 2023-08-01T19:56:07.004 INFO:teuthology.orchestra.run.smithi155.stdout: "time": "2023-08-01T19:55:05.569874+0000", 2023-08-01T19:56:07.004 INFO:teuthology.orchestra.run.smithi155.stdout: "duration": 4.1679999999999997e-06 2023-08-01T19:56:07.004 INFO:teuthology.orchestra.run.smithi155.stdout: }, 2023-08-01T19:56:07.005 INFO:teuthology.orchestra.run.smithi155.stdout: { 2023-08-01T19:56:07.005 INFO:teuthology.orchestra.run.smithi155.stdout: "event": "reached_pg", 2023-08-01T19:56:07.005 INFO:teuthology.orchestra.run.smithi155.stdout: "time": "2023-08-01T19:55:05.569904+0000", 2023-08-01T19:56:07.005 INFO:teuthology.orchestra.run.smithi155.stdout: "duration": 3.0920999999999998e-05 2023-08-01T19:56:07.005 INFO:teuthology.orchestra.run.smithi155.stdout: }, 2023-08-01T19:56:07.005 INFO:teuthology.orchestra.run.smithi155.stdout: { 2023-08-01T19:56:07.005 INFO:teuthology.orchestra.run.smithi155.stdout: "event": "started", 2023-08-01T19:56:07.005 INFO:teuthology.orchestra.run.smithi155.stdout: "time": "2023-08-01T19:55:05.569998+0000", 2023-08-01T19:56:07.006 INFO:teuthology.orchestra.run.smithi155.stdout: "duration": 9.3086999999999998e-05 2023-08-01T19:56:07.006 INFO:teuthology.orchestra.run.smithi155.stdout: }, 2023-08-01T19:56:07.006 INFO:teuthology.orchestra.run.smithi155.stdout: { 2023-08-01T19:56:07.006 INFO:teuthology.orchestra.run.smithi155.stdout: "event": "waiting for subops from 0", 2023-08-01T19:56:07.006 INFO:teuthology.orchestra.run.smithi155.stdout: "time": "2023-08-01T19:55:05.570093+0000", 2023-08-01T19:56:07.006 INFO:teuthology.orchestra.run.smithi155.stdout: "duration": 9.5768999999999997e-05 2023-08-01T19:56:07.006 INFO:teuthology.orchestra.run.smithi155.stdout: }, 2023-08-01T19:56:07.007 INFO:teuthology.orchestra.run.smithi155.stdout: { 2023-08-01T19:56:07.007 INFO:teuthology.orchestra.run.smithi155.stdout: "event": "op_commit", 2023-08-01T19:56:07.007 INFO:teuthology.orchestra.run.smithi155.stdout: "time": "2023-08-01T19:55:05.572839+0000", 2023-08-01T19:56:07.007 INFO:teuthology.orchestra.run.smithi155.stdout: "duration": 0.0027460050000000001 2023-08-01T19:56:07.007 INFO:teuthology.orchestra.run.smithi155.stdout: }, 2023-08-01T19:56:07.007 INFO:teuthology.orchestra.run.smithi155.stdout: { 2023-08-01T19:56:07.007 INFO:teuthology.orchestra.run.smithi155.stdout: "event": "sub_op_commit_rec", 2023-08-01T19:56:07.007 INFO:teuthology.orchestra.run.smithi155.stdout: "time": "2023-08-01T19:55:05.635114+0000", 2023-08-01T19:56:07.008 INFO:teuthology.orchestra.run.smithi155.stdout: "duration": 0.062274297999999999 2023-08-01T19:56:07.008 INFO:teuthology.orchestra.run.smithi155.stdout: }, 2023-08-01T19:56:07.008 INFO:teuthology.orchestra.run.smithi155.stdout: { 2023-08-01T19:56:07.008 INFO:teuthology.orchestra.run.smithi155.stdout: "event": "commit_sent", 2023-08-01T19:56:07.008 INFO:teuthology.orchestra.run.smithi155.stdout: "time": "2023-08-01T19:55:05.635143+0000", 2023-08-01T19:56:07.008 INFO:teuthology.orchestra.run.smithi155.stdout: "duration": 2.9430000000000001e-05 2023-08-01T19:56:07.008 INFO:teuthology.orchestra.run.smithi155.stdout: }, 2023-08-01T19:56:07.008 INFO:teuthology.orchestra.run.smithi155.stdout: { 2023-08-01T19:56:07.009 INFO:teuthology.orchestra.run.smithi155.stdout: "event": "done", 2023-08-01T19:56:07.009 INFO:teuthology.orchestra.run.smithi155.stdout: "time": "2023-08-01T19:55:05.635181+0000", 2023-08-01T19:56:07.009 INFO:teuthology.orchestra.run.smithi155.stdout: "duration": 3.8352000000000001e-05 2023-08-01T19:56:07.009 INFO:teuthology.orchestra.run.smithi155.stdout: } 2023-08-01T19:56:07.009 INFO:teuthology.orchestra.run.smithi155.stdout: ] 2023-08-01T19:56:07.009 INFO:teuthology.orchestra.run.smithi155.stdout: } 2023-08-01T19:56:07.009 INFO:teuthology.orchestra.run.smithi155.stdout: }, 2023-08-01T19:56:07.009 INFO:teuthology.orchestra.run.smithi155.stdout: { 2023-08-01T19:56:07.010 INFO:teuthology.orchestra.run.smithi155.stdout: "description": "osd_op(client.4668.0:100945 5.e 5:73df68dd:::benchmark_data_smithi006_114134_object100944:head [set-alloc-hint object_size 65536 write_size 65536,write 0~65536] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e37)", 2023-08-01T19:56:07.010 INFO:teuthology.orchestra.run.smithi155.stdout: "initiated_at": "2023-08-01T19:55:05.576784+0000", 2023-08-01T19:56:07.010 INFO:teuthology.orchestra.run.smithi155.stdout: "age": 61.297636500000003, 2023-08-01T19:56:07.010 INFO:teuthology.orchestra.run.smithi155.stdout: "duration": 0.058512994999999998, 2023-08-01T19:56:07.010 INFO:teuthology.orchestra.run.smithi155.stdout: "type_data": { 2023-08-01T19:56:07.010 INFO:teuthology.orchestra.run.smithi155.stdout: "flag_point": "commit sent; apply or cleanup", 2023-08-01T19:56:07.010 INFO:teuthology.orchestra.run.smithi155.stdout: "client_info": { 2023-08-01T19:56:07.011 INFO:teuthology.orchestra.run.smithi155.stdout: "client": "client.4668", 2023-08-01T19:56:07.011 INFO:teuthology.orchestra.run.smithi155.stdout: "client_addr": "172.21.15.6:0/1709472247", 2023-08-01T19:56:07.011 INFO:teuthology.orchestra.run.smithi155.stdout: "tid": 100945 2023-08-01T19:56:07.011 INFO:teuthology.orchestra.run.smithi155.stdout: }, 2023-08-01T19:56:07.011 INFO:teuthology.orchestra.run.smithi155.stdout: "events": [ 2023-08-01T19:56:07.011 INFO:teuthology.orchestra.run.smithi155.stdout: { 2023-08-01T19:56:07.011 INFO:teuthology.orchestra.run.smithi155.stdout: "event": "initiated", 2023-08-01T19:56:07.011 INFO:teuthology.orchestra.run.smithi155.stdout: "time": "2023-08-01T19:55:05.576784+0000", 2023-08-01T19:56:07.012 INFO:teuthology.orchestra.run.smithi155.stdout: "duration": 0 2023-08-01T19:56:07.012 INFO:teuthology.orchestra.run.smithi155.stdout: }, 2023-08-01T19:56:07.012 INFO:teuthology.orchestra.run.smithi155.stdout: { 2023-08-01T19:56:07.012 INFO:teuthology.orchestra.run.smithi155.stdout: "event": "throttled", 2023-08-01T19:56:07.012 INFO:teuthology.orchestra.run.smithi155.stdout: "time": "2023-08-01T19:55:05.576784+0000", 2023-08-01T19:56:07.012 INFO:teuthology.orchestra.run.smithi155.stdout: "duration": 0 2023-08-01T19:56:07.012 INFO:teuthology.orchestra.run.smithi155.stdout: }, 2023-08-01T19:56:07.012 INFO:teuthology.orchestra.run.smithi155.stdout: { 2023-08-01T19:56:07.013 INFO:teuthology.orchestra.run.smithi155.stdout: "event": "header_read", 2023-08-01T19:56:07.013 INFO:teuthology.orchestra.run.smithi155.stdout: "time": "2023-08-01T19:55:05.576783+0000", 2023-08-01T19:56:07.013 INFO:teuthology.orchestra.run.smithi155.stdout: "duration": 4294967295.9999995 2023-08-01T19:56:07.013 INFO:teuthology.orchestra.run.smithi155.stdout: }, 2023-08-01T19:56:07.013 INFO:teuthology.orchestra.run.smithi155.stdout: { 2023-08-01T19:56:07.013 INFO:teuthology.orchestra.run.smithi155.stdout: "event": "all_read", 2023-08-01T19:56:07.013 INFO:teuthology.orchestra.run.smithi155.stdout: "time": "2023-08-01T19:55:05.576807+0000", 2023-08-01T19:56:07.013 INFO:teuthology.orchestra.run.smithi155.stdout: "duration": 2.3651000000000001e-05 2023-08-01T19:56:07.014 INFO:teuthology.orchestra.run.smithi155.stdout: }, 2023-08-01T19:56:07.014 INFO:teuthology.orchestra.run.smithi155.stdout: { 2023-08-01T19:56:07.014 INFO:teuthology.orchestra.run.smithi155.stdout: "event": "dispatched", 2023-08-01T19:56:07.014 INFO:teuthology.orchestra.run.smithi155.stdout: "time": "2023-08-01T19:55:05.576817+0000", 2023-08-01T19:56:07.014 INFO:teuthology.orchestra.run.smithi155.stdout: "duration": 9.9389999999999992e-06 2023-08-01T19:56:07.014 INFO:teuthology.orchestra.run.smithi155.stdout: }, 2023-08-01T19:56:07.014 INFO:teuthology.orchestra.run.smithi155.stdout: { 2023-08-01T19:56:07.014 INFO:teuthology.orchestra.run.smithi155.stdout: "event": "queued_for_pg", 2023-08-01T19:56:07.015 INFO:teuthology.orchestra.run.smithi155.stdout: "time": "2023-08-01T19:55:05.576820+0000", 2023-08-01T19:56:07.015 INFO:teuthology.orchestra.run.smithi155.stdout: "duration": 3.2619999999999999e-06 2023-08-01T19:56:07.015 INFO:teuthology.orchestra.run.smithi155.stdout: }, 2023-08-01T19:56:07.015 INFO:teuthology.orchestra.run.smithi155.stdout: { 2023-08-01T19:56:07.015 INFO:teuthology.orchestra.run.smithi155.stdout: "event": "reached_pg", 2023-08-01T19:56:07.015 INFO:teuthology.orchestra.run.smithi155.stdout: "time": "2023-08-01T19:55:05.576849+0000", 2023-08-01T19:56:07.015 INFO:teuthology.orchestra.run.smithi155.stdout: "duration": 2.8880000000000001e-05 2023-08-01T19:56:07.015 INFO:teuthology.orchestra.run.smithi155.stdout: }, 2023-08-01T19:56:07.016 INFO:teuthology.orchestra.run.smithi155.stdout: { 2023-08-01T19:56:07.016 INFO:teuthology.orchestra.run.smithi155.stdout: "event": "started", 2023-08-01T19:56:07.016 INFO:teuthology.orchestra.run.smithi155.stdout: "time": "2023-08-01T19:55:05.576940+0000", 2023-08-01T19:56:07.016 INFO:teuthology.orchestra.run.smithi155.stdout: "duration": 9.0570999999999997e-05 2023-08-01T19:56:07.016 INFO:teuthology.orchestra.run.smithi155.stdout: }, 2023-08-01T19:56:07.016 INFO:teuthology.orchestra.run.smithi155.stdout: { 2023-08-01T19:56:07.016 INFO:teuthology.orchestra.run.smithi155.stdout: "event": "waiting for subops from 0", 2023-08-01T19:56:07.017 INFO:teuthology.orchestra.run.smithi155.stdout: "time": "2023-08-01T19:55:05.577027+0000", 2023-08-01T19:56:07.017 INFO:teuthology.orchestra.run.smithi155.stdout: "duration": 8.7237999999999994e-05 2023-08-01T19:56:07.017 INFO:teuthology.orchestra.run.smithi155.stdout: }, 2023-08-01T19:56:07.017 INFO:teuthology.orchestra.run.smithi155.stdout: { 2023-08-01T19:56:07.017 INFO:teuthology.orchestra.run.smithi155.stdout: "event": "op_commit", 2023-08-01T19:56:07.017 INFO:teuthology.orchestra.run.smithi155.stdout: "time": "2023-08-01T19:55:05.579624+0000", 2023-08-01T19:56:07.017 INFO:teuthology.orchestra.run.smithi155.stdout: "duration": 0.0025971200000000001 2023-08-01T19:56:07.017 INFO:teuthology.orchestra.run.smithi155.stdout: }, 2023-08-01T19:56:07.018 INFO:teuthology.orchestra.run.smithi155.stdout: { 2023-08-01T19:56:07.018 INFO:teuthology.orchestra.run.smithi155.stdout: "event": "sub_op_commit_rec", 2023-08-01T19:56:07.018 INFO:teuthology.orchestra.run.smithi155.stdout: "time": "2023-08-01T19:55:05.635218+0000", 2023-08-01T19:56:07.018 INFO:teuthology.orchestra.run.smithi155.stdout: "duration": 0.055594487999999997 2023-08-01T19:56:07.018 INFO:teuthology.orchestra.run.smithi155.stdout: }, 2023-08-01T19:56:07.018 INFO:teuthology.orchestra.run.smithi155.stdout: { 2023-08-01T19:56:07.018 INFO:teuthology.orchestra.run.smithi155.stdout: "event": "commit_sent", 2023-08-01T19:56:07.018 INFO:teuthology.orchestra.run.smithi155.stdout: "time": "2023-08-01T19:55:05.635262+0000", 2023-08-01T19:56:07.019 INFO:teuthology.orchestra.run.smithi155.stdout: "duration": 4.3380999999999997e-05 2023-08-01T19:56:07.019 INFO:teuthology.orchestra.run.smithi155.stdout: }, 2023-08-01T19:56:07.019 INFO:teuthology.orchestra.run.smithi155.stdout: { 2023-08-01T19:56:07.019 INFO:teuthology.orchestra.run.smithi155.stdout: "event": "done", 2023-08-01T19:56:07.019 INFO:teuthology.orchestra.run.smithi155.stdout: "time": "2023-08-01T19:55:05.635297+0000", 2023-08-01T19:56:07.019 INFO:teuthology.orchestra.run.smithi155.stdout: "duration": 3.4842000000000003e-05 2023-08-01T19:56:07.019 INFO:teuthology.orchestra.run.smithi155.stdout: } 2023-08-01T19:56:07.019 INFO:teuthology.orchestra.run.smithi155.stdout: ] 2023-08-01T19:56:07.020 INFO:teuthology.orchestra.run.smithi155.stdout: } 2023-08-01T19:56:07.020 INFO:teuthology.orchestra.run.smithi155.stdout: }, 2023-08-01T19:56:07.020 INFO:teuthology.orchestra.run.smithi155.stdout: { 2023-08-01T19:56:07.020 INFO:teuthology.orchestra.run.smithi155.stdout: "description": "osd_op(client.4668.0:100947 5.4 5:23e8fc27:::benchmark_data_smithi006_114134_object100946:head [set-alloc-hint object_size 65536 write_size 65536,write 0~65536] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e37)", 2023-08-01T19:56:07.020 INFO:teuthology.orchestra.run.smithi155.stdout: "initiated_at": "2023-08-01T19:55:05.576840+0000", 2023-08-01T19:56:07.020 INFO:teuthology.orchestra.run.smithi155.stdout: "age": 61.297580445000001, 2023-08-01T19:56:07.020 INFO:teuthology.orchestra.run.smithi155.stdout: "duration": 0.058423127999999998, 2023-08-01T19:56:07.020 INFO:teuthology.orchestra.run.smithi155.stdout: "type_data": { 2023-08-01T19:56:07.021 INFO:teuthology.orchestra.run.smithi155.stdout: "flag_point": "commit sent; apply or cleanup", 2023-08-01T19:56:07.021 INFO:teuthology.orchestra.run.smithi155.stdout: "client_info": { 2023-08-01T19:56:07.021 INFO:teuthology.orchestra.run.smithi155.stdout: "client": "client.4668", 2023-08-01T19:56:07.021 INFO:teuthology.orchestra.run.smithi155.stdout: "client_addr": "172.21.15.6:0/1709472247", 2023-08-01T19:56:07.021 INFO:teuthology.orchestra.run.smithi155.stdout: "tid": 100947 2023-08-01T19:56:07.021 INFO:teuthology.orchestra.run.smithi155.stdout: }, 2023-08-01T19:56:07.021 INFO:teuthology.orchestra.run.smithi155.stdout: "events": [ 2023-08-01T19:56:07.021 INFO:teuthology.orchestra.run.smithi155.stdout: { 2023-08-01T19:56:07.022 INFO:teuthology.orchestra.run.smithi155.stdout: "event": "initiated", 2023-08-01T19:56:07.022 INFO:teuthology.orchestra.run.smithi155.stdout: "time": "2023-08-01T19:55:05.576840+0000", 2023-08-01T19:56:07.022 INFO:teuthology.orchestra.run.smithi155.stdout: "duration": 0 2023-08-01T19:56:07.022 INFO:teuthology.orchestra.run.smithi155.stdout: }, 2023-08-01T19:56:07.022 INFO:teuthology.orchestra.run.smithi155.stdout: { 2023-08-01T19:56:07.022 INFO:teuthology.orchestra.run.smithi155.stdout: "event": "throttled", 2023-08-01T19:56:07.022 INFO:teuthology.orchestra.run.smithi155.stdout: "time": "2023-08-01T19:55:05.576840+0000", 2023-08-01T19:56:07.022 INFO:teuthology.orchestra.run.smithi155.stdout: "duration": 0 2023-08-01T19:56:07.023 INFO:teuthology.orchestra.run.smithi155.stdout: }, 2023-08-01T19:56:07.023 INFO:teuthology.orchestra.run.smithi155.stdout: { 2023-08-01T19:56:07.023 INFO:teuthology.orchestra.run.smithi155.stdout: "event": "header_read", 2023-08-01T19:56:07.023 INFO:teuthology.orchestra.run.smithi155.stdout: "time": "2023-08-01T19:55:05.576839+0000", 2023-08-01T19:56:07.023 INFO:teuthology.orchestra.run.smithi155.stdout: "duration": 4294967295.9999995 2023-08-01T19:56:07.023 INFO:teuthology.orchestra.run.smithi155.stdout: }, 2023-08-01T19:56:07.023 INFO:teuthology.orchestra.run.smithi155.stdout: { 2023-08-01T19:56:07.024 INFO:teuthology.orchestra.run.smithi155.stdout: "event": "all_read", 2023-08-01T19:56:07.024 INFO:teuthology.orchestra.run.smithi155.stdout: "time": "2023-08-01T19:55:05.576893+0000", 2023-08-01T19:56:07.024 INFO:teuthology.orchestra.run.smithi155.stdout: "duration": 5.3893000000000001e-05 2023-08-01T19:56:07.024 INFO:teuthology.orchestra.run.smithi155.stdout: }, 2023-08-01T19:56:07.024 INFO:teuthology.orchestra.run.smithi155.stdout: { 2023-08-01T19:56:07.024 INFO:teuthology.orchestra.run.smithi155.stdout: "event": "dispatched", 2023-08-01T19:56:07.024 INFO:teuthology.orchestra.run.smithi155.stdout: "time": "2023-08-01T19:55:05.576902+0000", 2023-08-01T19:56:07.024 INFO:teuthology.orchestra.run.smithi155.stdout: "duration": 8.7520000000000002e-06 2023-08-01T19:56:07.025 INFO:teuthology.orchestra.run.smithi155.stdout: }, 2023-08-01T19:56:07.025 INFO:teuthology.orchestra.run.smithi155.stdout: { 2023-08-01T19:56:07.025 INFO:teuthology.orchestra.run.smithi155.stdout: "event": "queued_for_pg", 2023-08-01T19:56:07.025 INFO:teuthology.orchestra.run.smithi155.stdout: "time": "2023-08-01T19:55:05.576905+0000", 2023-08-01T19:56:07.025 INFO:teuthology.orchestra.run.smithi155.stdout: "duration": 3.01e-06 2023-08-01T19:56:07.025 INFO:teuthology.orchestra.run.smithi155.stdout: }, 2023-08-01T19:56:07.025 INFO:teuthology.orchestra.run.smithi155.stdout: { 2023-08-01T19:56:07.025 INFO:teuthology.orchestra.run.smithi155.stdout: "event": "reached_pg", 2023-08-01T19:56:07.026 INFO:teuthology.orchestra.run.smithi155.stdout: "time": "2023-08-01T19:55:05.579641+0000", 2023-08-01T19:56:07.026 INFO:teuthology.orchestra.run.smithi155.stdout: "duration": 0.0027366880000000001 2023-08-01T19:56:07.026 INFO:teuthology.orchestra.run.smithi155.stdout: }, 2023-08-01T19:56:07.026 INFO:teuthology.orchestra.run.smithi155.stdout: { 2023-08-01T19:56:07.026 INFO:teuthology.orchestra.run.smithi155.stdout: "event": "started", 2023-08-01T19:56:07.026 INFO:teuthology.orchestra.run.smithi155.stdout: "time": "2023-08-01T19:55:05.579734+0000", 2023-08-01T19:56:07.026 INFO:teuthology.orchestra.run.smithi155.stdout: "duration": 9.2590000000000006e-05 2023-08-01T19:56:07.026 INFO:teuthology.orchestra.run.smithi155.stdout: }, 2023-08-01T19:56:07.027 INFO:teuthology.orchestra.run.smithi155.stdout: { 2023-08-01T19:56:07.027 INFO:teuthology.orchestra.run.smithi155.stdout: "event": "waiting for subops from 0", 2023-08-01T19:56:07.027 INFO:teuthology.orchestra.run.smithi155.stdout: "time": "2023-08-01T19:55:05.579825+0000", 2023-08-01T19:56:07.027 INFO:teuthology.orchestra.run.smithi155.stdout: "duration": 9.0964999999999994e-05 2023-08-01T19:56:07.027 INFO:teuthology.orchestra.run.smithi155.stdout: }, 2023-08-01T19:56:07.027 INFO:teuthology.orchestra.run.smithi155.stdout: { 2023-08-01T19:56:07.027 INFO:teuthology.orchestra.run.smithi155.stdout: "event": "op_commit", 2023-08-01T19:56:07.027 INFO:teuthology.orchestra.run.smithi155.stdout: "time": "2023-08-01T19:55:05.585041+0000", 2023-08-01T19:56:07.028 INFO:teuthology.orchestra.run.smithi155.stdout: "duration": 0.0052159670000000002 2023-08-01T19:56:07.028 INFO:teuthology.orchestra.run.smithi155.stdout: }, 2023-08-01T19:56:07.028 INFO:teuthology.orchestra.run.smithi155.stdout: { 2023-08-01T19:56:07.028 INFO:teuthology.orchestra.run.smithi155.stdout: "event": "sub_op_commit_rec", 2023-08-01T19:56:07.028 INFO:teuthology.orchestra.run.smithi155.stdout: "time": "2023-08-01T19:55:05.635199+0000", 2023-08-01T19:56:07.028 INFO:teuthology.orchestra.run.smithi155.stdout: "duration": 0.050158023000000003 2023-08-01T19:56:07.028 INFO:teuthology.orchestra.run.smithi155.stdout: }, 2023-08-01T19:56:07.029 INFO:teuthology.orchestra.run.smithi155.stdout: { 2023-08-01T19:56:07.029 INFO:teuthology.orchestra.run.smithi155.stdout: "event": "commit_sent", 2023-08-01T19:56:07.029 INFO:teuthology.orchestra.run.smithi155.stdout: "time": "2023-08-01T19:55:05.635227+0000", 2023-08-01T19:56:07.029 INFO:teuthology.orchestra.run.smithi155.stdout: "duration": 2.7821e-05 2023-08-01T19:56:07.029 INFO:teuthology.orchestra.run.smithi155.stdout: }, 2023-08-01T19:56:07.029 INFO:teuthology.orchestra.run.smithi155.stdout: { 2023-08-01T19:56:07.029 INFO:teuthology.orchestra.run.smithi155.stdout: "event": "done", 2023-08-01T19:56:07.029 INFO:teuthology.orchestra.run.smithi155.stdout: "time": "2023-08-01T19:55:05.635263+0000", 2023-08-01T19:56:07.030 INFO:teuthology.orchestra.run.smithi155.stdout: "duration": 3.6081000000000002e-05 2023-08-01T19:56:07.030 INFO:teuthology.orchestra.run.smithi155.stdout: } 2023-08-01T19:56:07.030 INFO:teuthology.orchestra.run.smithi155.stdout: ] 2023-08-01T19:56:07.030 INFO:teuthology.orchestra.run.smithi155.stdout: } 2023-08-01T19:56:07.030 INFO:teuthology.orchestra.run.smithi155.stdout: }, 2023-08-01T19:56:07.030 INFO:teuthology.orchestra.run.smithi155.stdout: { 2023-08-01T19:56:07.030 INFO:teuthology.orchestra.run.smithi155.stdout: "description": "osd_op(client.4668.0:197408 5.d 5:bbda375a:::benchmark_data_smithi006_114134_object63747:head [delete] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e61)", 2023-08-01T19:56:07.030 INFO:teuthology.orchestra.run.smithi155.stdout: "initiated_at": "2023-08-01T19:55:58.559714+0000", 2023-08-01T19:56:07.031 INFO:teuthology.orchestra.run.smithi155.stdout: "age": 8.3147064579999999, 2023-08-01T19:56:07.031 INFO:teuthology.orchestra.run.smithi155.stdout: "duration": 1.047043671, 2023-08-01T19:56:07.031 INFO:teuthology.orchestra.run.smithi155.stdout: "type_data": { 2023-08-01T19:56:07.031 INFO:teuthology.orchestra.run.smithi155.stdout: "flag_point": "commit sent; apply or cleanup", 2023-08-01T19:56:07.031 INFO:teuthology.orchestra.run.smithi155.stdout: "client_info": { 2023-08-01T19:56:07.031 INFO:teuthology.orchestra.run.smithi155.stdout: "client": "client.4668", 2023-08-01T19:56:07.031 INFO:teuthology.orchestra.run.smithi155.stdout: "client_addr": "172.21.15.6:0/1709472247", 2023-08-01T19:56:07.031 INFO:teuthology.orchestra.run.smithi155.stdout: "tid": 197408 2023-08-01T19:56:07.032 INFO:teuthology.orchestra.run.smithi155.stdout: }, 2023-08-01T19:56:07.032 INFO:teuthology.orchestra.run.smithi155.stdout: "events": [ 2023-08-01T19:56:07.032 INFO:teuthology.orchestra.run.smithi155.stdout: { 2023-08-01T19:56:07.032 INFO:teuthology.orchestra.run.smithi155.stdout: "event": "initiated", 2023-08-01T19:56:07.032 INFO:teuthology.orchestra.run.smithi155.stdout: "time": "2023-08-01T19:55:58.559714+0000", 2023-08-01T19:56:07.032 INFO:teuthology.orchestra.run.smithi155.stdout: "duration": 0 2023-08-01T19:56:07.032 INFO:teuthology.orchestra.run.smithi155.stdout: }, 2023-08-01T19:56:07.032 INFO:teuthology.orchestra.run.smithi155.stdout: { 2023-08-01T19:56:07.033 INFO:teuthology.orchestra.run.smithi155.stdout: "event": "throttled", 2023-08-01T19:56:07.033 INFO:teuthology.orchestra.run.smithi155.stdout: "time": "2023-08-01T19:55:58.559714+0000", 2023-08-01T19:56:07.033 INFO:teuthology.orchestra.run.smithi155.stdout: "duration": 0 2023-08-01T19:56:07.033 INFO:teuthology.orchestra.run.smithi155.stdout: }, 2023-08-01T19:56:07.033 INFO:teuthology.orchestra.run.smithi155.stdout: { 2023-08-01T19:56:07.033 INFO:teuthology.orchestra.run.smithi155.stdout: "event": "header_read", 2023-08-01T19:56:07.033 INFO:teuthology.orchestra.run.smithi155.stdout: "time": "2023-08-01T19:55:58.559713+0000", 2023-08-01T19:56:07.033 INFO:teuthology.orchestra.run.smithi155.stdout: "duration": 4294967295.999999 2023-08-01T19:56:07.034 INFO:teuthology.orchestra.run.smithi155.stdout: }, 2023-08-01T19:56:07.034 INFO:teuthology.orchestra.run.smithi155.stdout: { 2023-08-01T19:56:07.034 INFO:teuthology.orchestra.run.smithi155.stdout: "event": "all_read", 2023-08-01T19:56:07.034 INFO:teuthology.orchestra.run.smithi155.stdout: "time": "2023-08-01T19:55:58.559717+0000", 2023-08-01T19:56:07.034 INFO:teuthology.orchestra.run.smithi155.stdout: "duration": 4.2860000000000001e-06 2023-08-01T19:56:07.034 INFO:teuthology.orchestra.run.smithi155.stdout: }, 2023-08-01T19:56:07.034 INFO:teuthology.orchestra.run.smithi155.stdout: { 2023-08-01T19:56:07.035 INFO:teuthology.orchestra.run.smithi155.stdout: "event": "dispatched", 2023-08-01T19:56:07.035 INFO:teuthology.orchestra.run.smithi155.stdout: "time": "2023-08-01T19:55:58.559774+0000", 2023-08-01T19:56:07.035 INFO:teuthology.orchestra.run.smithi155.stdout: "duration": 5.6508999999999997e-05 2023-08-01T19:56:07.035 INFO:teuthology.orchestra.run.smithi155.stdout: }, 2023-08-01T19:56:07.035 INFO:teuthology.orchestra.run.smithi155.stdout: { 2023-08-01T19:56:07.035 INFO:teuthology.orchestra.run.smithi155.stdout: "event": "queued_for_pg", 2023-08-01T19:56:07.035 INFO:teuthology.orchestra.run.smithi155.stdout: "time": "2023-08-01T19:55:58.559781+0000", 2023-08-01T19:56:07.035 INFO:teuthology.orchestra.run.smithi155.stdout: "duration": 7.1829999999999997e-06 2023-08-01T19:56:07.036 INFO:teuthology.orchestra.run.smithi155.stdout: }, 2023-08-01T19:56:07.036 INFO:teuthology.orchestra.run.smithi155.stdout: { 2023-08-01T19:56:07.036 INFO:teuthology.orchestra.run.smithi155.stdout: "event": "reached_pg", 2023-08-01T19:56:07.036 INFO:teuthology.orchestra.run.smithi155.stdout: "time": "2023-08-01T19:55:58.571621+0000", 2023-08-01T19:56:07.036 INFO:teuthology.orchestra.run.smithi155.stdout: "duration": 0.011840603999999999 2023-08-01T19:56:07.036 INFO:teuthology.orchestra.run.smithi155.stdout: }, 2023-08-01T19:56:07.036 INFO:teuthology.orchestra.run.smithi155.stdout: { 2023-08-01T19:56:07.036 INFO:teuthology.orchestra.run.smithi155.stdout: "event": "waiting for peered", 2023-08-01T19:56:07.037 INFO:teuthology.orchestra.run.smithi155.stdout: "time": "2023-08-01T19:55:58.571630+0000", 2023-08-01T19:56:07.037 INFO:teuthology.orchestra.run.smithi155.stdout: "duration": 8.9770000000000006e-06 2023-08-01T19:56:07.037 INFO:teuthology.orchestra.run.smithi155.stdout: }, 2023-08-01T19:56:07.037 INFO:teuthology.orchestra.run.smithi155.stdout: { 2023-08-01T19:56:07.037 INFO:teuthology.orchestra.run.smithi155.stdout: "event": "reached_pg", 2023-08-01T19:56:07.037 INFO:teuthology.orchestra.run.smithi155.stdout: "time": "2023-08-01T19:55:59.601300+0000", 2023-08-01T19:56:07.037 INFO:teuthology.orchestra.run.smithi155.stdout: "duration": 1.0296694989999999 2023-08-01T19:56:07.037 INFO:teuthology.orchestra.run.smithi155.stdout: }, 2023-08-01T19:56:07.038 INFO:teuthology.orchestra.run.smithi155.stdout: { 2023-08-01T19:56:07.038 INFO:teuthology.orchestra.run.smithi155.stdout: "event": "started", 2023-08-01T19:56:07.038 INFO:teuthology.orchestra.run.smithi155.stdout: "time": "2023-08-01T19:55:59.601448+0000", 2023-08-01T19:56:07.038 INFO:teuthology.orchestra.run.smithi155.stdout: "duration": 0.00014828399999999999 2023-08-01T19:56:07.038 INFO:teuthology.orchestra.run.smithi155.stdout: }, 2023-08-01T19:56:07.038 INFO:teuthology.orchestra.run.smithi155.stdout: { 2023-08-01T19:56:07.038 INFO:teuthology.orchestra.run.smithi155.stdout: "event": "op_commit", 2023-08-01T19:56:07.038 INFO:teuthology.orchestra.run.smithi155.stdout: "time": "2023-08-01T19:55:59.606616+0000", 2023-08-01T19:56:07.039 INFO:teuthology.orchestra.run.smithi155.stdout: "duration": 0.0051679769999999998 2023-08-01T19:56:07.039 INFO:teuthology.orchestra.run.smithi155.stdout: }, 2023-08-01T19:56:07.039 INFO:teuthology.orchestra.run.smithi155.stdout: { 2023-08-01T19:56:07.039 INFO:teuthology.orchestra.run.smithi155.stdout: "event": "commit_sent", 2023-08-01T19:56:07.039 INFO:teuthology.orchestra.run.smithi155.stdout: "time": "2023-08-01T19:55:59.606662+0000", 2023-08-01T19:56:07.039 INFO:teuthology.orchestra.run.smithi155.stdout: "duration": 4.5843000000000001e-05 2023-08-01T19:56:07.039 INFO:teuthology.orchestra.run.smithi155.stdout: }, 2023-08-01T19:56:07.039 INFO:teuthology.orchestra.run.smithi155.stdout: { 2023-08-01T19:56:07.040 INFO:teuthology.orchestra.run.smithi155.stdout: "event": "done", 2023-08-01T19:56:07.040 INFO:teuthology.orchestra.run.smithi155.stdout: "time": "2023-08-01T19:55:59.606757+0000", 2023-08-01T19:56:07.040 INFO:teuthology.orchestra.run.smithi155.stdout: "duration": 9.5373999999999999e-05 2023-08-01T19:56:07.040 INFO:teuthology.orchestra.run.smithi155.stdout: } 2023-08-01T19:56:07.040 INFO:teuthology.orchestra.run.smithi155.stdout: ] 2023-08-01T19:56:07.040 INFO:teuthology.orchestra.run.smithi155.stdout: } 2023-08-01T19:56:07.040 INFO:teuthology.orchestra.run.smithi155.stdout: }, 2023-08-01T19:56:07.040 INFO:teuthology.orchestra.run.smithi155.stdout: { 2023-08-01T19:56:07.041 INFO:teuthology.orchestra.run.smithi155.stdout: "description": "osd_op(client.4668.0:197416 5.d 5:bd99e66d:::benchmark_data_smithi006_114134_object63755:head [delete] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e62)", 2023-08-01T19:56:07.041 INFO:teuthology.orchestra.run.smithi155.stdout: "initiated_at": "2023-08-01T19:55:58.577369+0000", 2023-08-01T19:56:07.041 INFO:teuthology.orchestra.run.smithi155.stdout: "age": 8.2970514810000005, 2023-08-01T19:56:07.041 INFO:teuthology.orchestra.run.smithi155.stdout: "duration": 1.0300980120000001, 2023-08-01T19:56:07.041 INFO:teuthology.orchestra.run.smithi155.stdout: "type_data": { 2023-08-01T19:56:07.041 INFO:teuthology.orchestra.run.smithi155.stdout: "flag_point": "commit sent; apply or cleanup", 2023-08-01T19:56:07.041 INFO:teuthology.orchestra.run.smithi155.stdout: "client_info": { 2023-08-01T19:56:07.042 INFO:teuthology.orchestra.run.smithi155.stdout: "client": "client.4668", 2023-08-01T19:56:07.042 INFO:teuthology.orchestra.run.smithi155.stdout: "client_addr": "172.21.15.6:0/1709472247", 2023-08-01T19:56:07.042 INFO:teuthology.orchestra.run.smithi155.stdout: "tid": 197416 2023-08-01T19:56:07.042 INFO:teuthology.orchestra.run.smithi155.stdout: }, 2023-08-01T19:56:07.042 INFO:teuthology.orchestra.run.smithi155.stdout: "events": [ 2023-08-01T19:56:07.042 INFO:teuthology.orchestra.run.smithi155.stdout: { 2023-08-01T19:56:07.042 INFO:teuthology.orchestra.run.smithi155.stdout: "event": "initiated", 2023-08-01T19:56:07.042 INFO:teuthology.orchestra.run.smithi155.stdout: "time": "2023-08-01T19:55:58.577369+0000", 2023-08-01T19:56:07.043 INFO:teuthology.orchestra.run.smithi155.stdout: "duration": 0 2023-08-01T19:56:07.043 INFO:teuthology.orchestra.run.smithi155.stdout: }, 2023-08-01T19:56:07.043 INFO:teuthology.orchestra.run.smithi155.stdout: { 2023-08-01T19:56:07.043 INFO:teuthology.orchestra.run.smithi155.stdout: "event": "throttled", 2023-08-01T19:56:07.043 INFO:teuthology.orchestra.run.smithi155.stdout: "time": "2023-08-01T19:55:58.577369+0000", 2023-08-01T19:56:07.043 INFO:teuthology.orchestra.run.smithi155.stdout: "duration": 0 2023-08-01T19:56:07.043 INFO:teuthology.orchestra.run.smithi155.stdout: }, 2023-08-01T19:56:07.043 INFO:teuthology.orchestra.run.smithi155.stdout: { 2023-08-01T19:56:07.044 INFO:teuthology.orchestra.run.smithi155.stdout: "event": "header_read", 2023-08-01T19:56:07.044 INFO:teuthology.orchestra.run.smithi155.stdout: "time": "2023-08-01T19:55:58.577368+0000", 2023-08-01T19:56:07.044 INFO:teuthology.orchestra.run.smithi155.stdout: "duration": 4294967295.9999995 2023-08-01T19:56:07.044 INFO:teuthology.orchestra.run.smithi155.stdout: }, 2023-08-01T19:56:07.044 INFO:teuthology.orchestra.run.smithi155.stdout: { 2023-08-01T19:56:07.044 INFO:teuthology.orchestra.run.smithi155.stdout: "event": "all_read", 2023-08-01T19:56:07.044 INFO:teuthology.orchestra.run.smithi155.stdout: "time": "2023-08-01T19:55:58.577370+0000", 2023-08-01T19:56:07.044 INFO:teuthology.orchestra.run.smithi155.stdout: "duration": 2.1150000000000001e-06 2023-08-01T19:56:07.045 INFO:teuthology.orchestra.run.smithi155.stdout: }, 2023-08-01T19:56:07.045 INFO:teuthology.orchestra.run.smithi155.stdout: { 2023-08-01T19:56:07.045 INFO:teuthology.orchestra.run.smithi155.stdout: "event": "dispatched", 2023-08-01T19:56:07.045 INFO:teuthology.orchestra.run.smithi155.stdout: "time": "2023-08-01T19:55:58.577377+0000", 2023-08-01T19:56:07.045 INFO:teuthology.orchestra.run.smithi155.stdout: "duration": 6.6610000000000003e-06 2023-08-01T19:56:07.045 INFO:teuthology.orchestra.run.smithi155.stdout: }, 2023-08-01T19:56:07.045 INFO:teuthology.orchestra.run.smithi155.stdout: { 2023-08-01T19:56:07.045 INFO:teuthology.orchestra.run.smithi155.stdout: "event": "queued_for_pg", 2023-08-01T19:56:07.046 INFO:teuthology.orchestra.run.smithi155.stdout: "time": "2023-08-01T19:55:58.577380+0000", 2023-08-01T19:56:07.046 INFO:teuthology.orchestra.run.smithi155.stdout: "duration": 2.7360000000000001e-06 2023-08-01T19:56:07.046 INFO:teuthology.orchestra.run.smithi155.stdout: }, 2023-08-01T19:56:07.046 INFO:teuthology.orchestra.run.smithi155.stdout: { 2023-08-01T19:56:07.046 INFO:teuthology.orchestra.run.smithi155.stdout: "event": "reached_pg", 2023-08-01T19:56:07.046 INFO:teuthology.orchestra.run.smithi155.stdout: "time": "2023-08-01T19:55:58.577405+0000", 2023-08-01T19:56:07.046 INFO:teuthology.orchestra.run.smithi155.stdout: "duration": 2.4929000000000001e-05 2023-08-01T19:56:07.046 INFO:teuthology.orchestra.run.smithi155.stdout: }, 2023-08-01T19:56:07.047 INFO:teuthology.orchestra.run.smithi155.stdout: { 2023-08-01T19:56:07.047 INFO:teuthology.orchestra.run.smithi155.stdout: "event": "waiting for peered", 2023-08-01T19:56:07.047 INFO:teuthology.orchestra.run.smithi155.stdout: "time": "2023-08-01T19:55:58.577409+0000", 2023-08-01T19:56:07.047 INFO:teuthology.orchestra.run.smithi155.stdout: "duration": 4.0799999999999999e-06 2023-08-01T19:56:07.047 INFO:teuthology.orchestra.run.smithi155.stdout: }, 2023-08-01T19:56:07.047 INFO:teuthology.orchestra.run.smithi155.stdout: { 2023-08-01T19:56:07.047 INFO:teuthology.orchestra.run.smithi155.stdout: "event": "reached_pg", 2023-08-01T19:56:07.048 INFO:teuthology.orchestra.run.smithi155.stdout: "time": "2023-08-01T19:55:59.603639+0000", 2023-08-01T19:56:07.048 INFO:teuthology.orchestra.run.smithi155.stdout: "duration": 1.0262299349999999 2023-08-01T19:56:07.048 INFO:teuthology.orchestra.run.smithi155.stdout: }, 2023-08-01T19:56:07.048 INFO:teuthology.orchestra.run.smithi155.stdout: { 2023-08-01T19:56:07.048 INFO:teuthology.orchestra.run.smithi155.stdout: "event": "started", 2023-08-01T19:56:07.048 INFO:teuthology.orchestra.run.smithi155.stdout: "time": "2023-08-01T19:55:59.603772+0000", 2023-08-01T19:56:07.048 INFO:teuthology.orchestra.run.smithi155.stdout: "duration": 0.000133153 2023-08-01T19:56:07.048 INFO:teuthology.orchestra.run.smithi155.stdout: }, 2023-08-01T19:56:07.049 INFO:teuthology.orchestra.run.smithi155.stdout: { 2023-08-01T19:56:07.049 INFO:teuthology.orchestra.run.smithi155.stdout: "event": "op_commit", 2023-08-01T19:56:07.049 INFO:teuthology.orchestra.run.smithi155.stdout: "time": "2023-08-01T19:55:59.607354+0000", 2023-08-01T19:56:07.049 INFO:teuthology.orchestra.run.smithi155.stdout: "duration": 0.0035819599999999999 2023-08-01T19:56:07.049 INFO:teuthology.orchestra.run.smithi155.stdout: }, 2023-08-01T19:56:07.049 INFO:teuthology.orchestra.run.smithi155.stdout: { 2023-08-01T19:56:07.049 INFO:teuthology.orchestra.run.smithi155.stdout: "event": "commit_sent", 2023-08-01T19:56:07.049 INFO:teuthology.orchestra.run.smithi155.stdout: "time": "2023-08-01T19:55:59.607396+0000", 2023-08-01T19:56:07.050 INFO:teuthology.orchestra.run.smithi155.stdout: "duration": 4.2423999999999999e-05 2023-08-01T19:56:07.050 INFO:teuthology.orchestra.run.smithi155.stdout: }, 2023-08-01T19:56:07.050 INFO:teuthology.orchestra.run.smithi155.stdout: { 2023-08-01T19:56:07.050 INFO:teuthology.orchestra.run.smithi155.stdout: "event": "done", 2023-08-01T19:56:07.050 INFO:teuthology.orchestra.run.smithi155.stdout: "time": "2023-08-01T19:55:59.607467+0000", 2023-08-01T19:56:07.050 INFO:teuthology.orchestra.run.smithi155.stdout: "duration": 7.0360999999999999e-05 2023-08-01T19:56:07.050 INFO:teuthology.orchestra.run.smithi155.stdout: } 2023-08-01T19:56:07.050 INFO:teuthology.orchestra.run.smithi155.stdout: ] 2023-08-01T19:56:07.051 INFO:teuthology.orchestra.run.smithi155.stdout: } 2023-08-01T19:56:07.051 INFO:teuthology.orchestra.run.smithi155.stdout: }, 2023-08-01T19:56:07.051 INFO:teuthology.orchestra.run.smithi155.stdout: { 2023-08-01T19:56:07.051 INFO:teuthology.orchestra.run.smithi155.stdout: "description": "osd_op(client.4668.0:197419 5.d 5:be7dc7c9:::benchmark_data_smithi006_114134_object63758:head [delete] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e62)", 2023-08-01T19:56:07.051 INFO:teuthology.orchestra.run.smithi155.stdout: "initiated_at": "2023-08-01T19:55:58.580223+0000", 2023-08-01T19:56:07.051 INFO:teuthology.orchestra.run.smithi155.stdout: "age": 8.2941975299999999, 2023-08-01T19:56:07.051 INFO:teuthology.orchestra.run.smithi155.stdout: "duration": 1.0286139439999999, 2023-08-01T19:56:07.051 INFO:teuthology.orchestra.run.smithi155.stdout: "type_data": { 2023-08-01T19:56:07.052 INFO:teuthology.orchestra.run.smithi155.stdout: "flag_point": "commit sent; apply or cleanup", 2023-08-01T19:56:07.052 INFO:teuthology.orchestra.run.smithi155.stdout: "client_info": { 2023-08-01T19:56:07.052 INFO:teuthology.orchestra.run.smithi155.stdout: "client": "client.4668", 2023-08-01T19:56:07.052 INFO:teuthology.orchestra.run.smithi155.stdout: "client_addr": "172.21.15.6:0/1709472247", 2023-08-01T19:56:07.052 INFO:teuthology.orchestra.run.smithi155.stdout: "tid": 197419 2023-08-01T19:56:07.052 INFO:teuthology.orchestra.run.smithi155.stdout: }, 2023-08-01T19:56:07.052 INFO:teuthology.orchestra.run.smithi155.stdout: "events": [ 2023-08-01T19:56:07.053 INFO:teuthology.orchestra.run.smithi155.stdout: { 2023-08-01T19:56:07.053 INFO:teuthology.orchestra.run.smithi155.stdout: "event": "initiated", 2023-08-01T19:56:07.053 INFO:teuthology.orchestra.run.smithi155.stdout: "time": "2023-08-01T19:55:58.580223+0000", 2023-08-01T19:56:07.053 INFO:teuthology.orchestra.run.smithi155.stdout: "duration": 0 2023-08-01T19:56:07.053 INFO:teuthology.orchestra.run.smithi155.stdout: }, 2023-08-01T19:56:07.053 INFO:teuthology.orchestra.run.smithi155.stdout: { 2023-08-01T19:56:07.053 INFO:teuthology.orchestra.run.smithi155.stdout: "event": "throttled", 2023-08-01T19:56:07.053 INFO:teuthology.orchestra.run.smithi155.stdout: "time": "2023-08-01T19:55:58.580223+0000", 2023-08-01T19:56:07.054 INFO:teuthology.orchestra.run.smithi155.stdout: "duration": 0 2023-08-01T19:56:07.054 INFO:teuthology.orchestra.run.smithi155.stdout: }, 2023-08-01T19:56:07.054 INFO:teuthology.orchestra.run.smithi155.stdout: { 2023-08-01T19:56:07.054 INFO:teuthology.orchestra.run.smithi155.stdout: "event": "header_read", 2023-08-01T19:56:07.054 INFO:teuthology.orchestra.run.smithi155.stdout: "time": "2023-08-01T19:55:58.580222+0000", 2023-08-01T19:56:07.054 INFO:teuthology.orchestra.run.smithi155.stdout: "duration": 4294967295.9999995 2023-08-01T19:56:07.054 INFO:teuthology.orchestra.run.smithi155.stdout: }, 2023-08-01T19:56:07.054 INFO:teuthology.orchestra.run.smithi155.stdout: { 2023-08-01T19:56:07.055 INFO:teuthology.orchestra.run.smithi155.stdout: "event": "all_read", 2023-08-01T19:56:07.055 INFO:teuthology.orchestra.run.smithi155.stdout: "time": "2023-08-01T19:55:58.580225+0000", 2023-08-01T19:56:07.055 INFO:teuthology.orchestra.run.smithi155.stdout: "duration": 3.2820000000000001e-06 2023-08-01T19:56:07.055 INFO:teuthology.orchestra.run.smithi155.stdout: }, 2023-08-01T19:56:07.055 INFO:teuthology.orchestra.run.smithi155.stdout: { 2023-08-01T19:56:07.055 INFO:teuthology.orchestra.run.smithi155.stdout: "event": "dispatched", 2023-08-01T19:56:07.055 INFO:teuthology.orchestra.run.smithi155.stdout: "time": "2023-08-01T19:55:58.580233+0000", 2023-08-01T19:56:07.055 INFO:teuthology.orchestra.run.smithi155.stdout: "duration": 7.34e-06 2023-08-01T19:56:07.056 INFO:teuthology.orchestra.run.smithi155.stdout: }, 2023-08-01T19:56:07.056 INFO:teuthology.orchestra.run.smithi155.stdout: { 2023-08-01T19:56:07.056 INFO:teuthology.orchestra.run.smithi155.stdout: "event": "queued_for_pg", 2023-08-01T19:56:07.056 INFO:teuthology.orchestra.run.smithi155.stdout: "time": "2023-08-01T19:55:58.580236+0000", 2023-08-01T19:56:07.056 INFO:teuthology.orchestra.run.smithi155.stdout: "duration": 3.473e-06 2023-08-01T19:56:07.056 INFO:teuthology.orchestra.run.smithi155.stdout: }, 2023-08-01T19:56:07.056 INFO:teuthology.orchestra.run.smithi155.stdout: { 2023-08-01T19:56:07.057 INFO:teuthology.orchestra.run.smithi155.stdout: "event": "reached_pg", 2023-08-01T19:56:07.057 INFO:teuthology.orchestra.run.smithi155.stdout: "time": "2023-08-01T19:55:58.580267+0000", 2023-08-01T19:56:07.057 INFO:teuthology.orchestra.run.smithi155.stdout: "duration": 3.0479000000000001e-05 2023-08-01T19:56:07.057 INFO:teuthology.orchestra.run.smithi155.stdout: }, 2023-08-01T19:56:07.057 INFO:teuthology.orchestra.run.smithi155.stdout: { 2023-08-01T19:56:07.057 INFO:teuthology.orchestra.run.smithi155.stdout: "event": "waiting for peered", 2023-08-01T19:56:07.057 INFO:teuthology.orchestra.run.smithi155.stdout: "time": "2023-08-01T19:55:58.580272+0000", 2023-08-01T19:56:07.057 INFO:teuthology.orchestra.run.smithi155.stdout: "duration": 5.011e-06 2023-08-01T19:56:07.058 INFO:teuthology.orchestra.run.smithi155.stdout: }, 2023-08-01T19:56:07.058 INFO:teuthology.orchestra.run.smithi155.stdout: { 2023-08-01T19:56:07.058 INFO:teuthology.orchestra.run.smithi155.stdout: "event": "reached_pg", 2023-08-01T19:56:07.058 INFO:teuthology.orchestra.run.smithi155.stdout: "time": "2023-08-01T19:55:59.604970+0000", 2023-08-01T19:56:07.058 INFO:teuthology.orchestra.run.smithi155.stdout: "duration": 1.0246984189999999 2023-08-01T19:56:07.058 INFO:teuthology.orchestra.run.smithi155.stdout: }, 2023-08-01T19:56:07.058 INFO:teuthology.orchestra.run.smithi155.stdout: { 2023-08-01T19:56:07.058 INFO:teuthology.orchestra.run.smithi155.stdout: "event": "started", 2023-08-01T19:56:07.059 INFO:teuthology.orchestra.run.smithi155.stdout: "time": "2023-08-01T19:55:59.605085+0000", 2023-08-01T19:56:07.059 INFO:teuthology.orchestra.run.smithi155.stdout: "duration": 0.00011531000000000001 2023-08-01T19:56:07.059 INFO:teuthology.orchestra.run.smithi155.stdout: }, 2023-08-01T19:56:07.059 INFO:teuthology.orchestra.run.smithi155.stdout: { 2023-08-01T19:56:07.059 INFO:teuthology.orchestra.run.smithi155.stdout: "event": "op_commit", 2023-08-01T19:56:07.059 INFO:teuthology.orchestra.run.smithi155.stdout: "time": "2023-08-01T19:55:59.608733+0000", 2023-08-01T19:56:07.059 INFO:teuthology.orchestra.run.smithi155.stdout: "duration": 0.0036478090000000001 2023-08-01T19:56:07.059 INFO:teuthology.orchestra.run.smithi155.stdout: }, 2023-08-01T19:56:07.060 INFO:teuthology.orchestra.run.smithi155.stdout: { 2023-08-01T19:56:07.060 INFO:teuthology.orchestra.run.smithi155.stdout: "event": "commit_sent", 2023-08-01T19:56:07.060 INFO:teuthology.orchestra.run.smithi155.stdout: "time": "2023-08-01T19:55:59.608771+0000", 2023-08-01T19:56:07.060 INFO:teuthology.orchestra.run.smithi155.stdout: "duration": 3.8033e-05 2023-08-01T19:56:07.060 INFO:teuthology.orchestra.run.smithi155.stdout: }, 2023-08-01T19:56:07.060 INFO:teuthology.orchestra.run.smithi155.stdout: { 2023-08-01T19:56:07.060 INFO:teuthology.orchestra.run.smithi155.stdout: "event": "done", 2023-08-01T19:56:07.060 INFO:teuthology.orchestra.run.smithi155.stdout: "time": "2023-08-01T19:55:59.608837+0000", 2023-08-01T19:56:07.061 INFO:teuthology.orchestra.run.smithi155.stdout: "duration": 6.5364000000000006e-05 2023-08-01T19:56:07.061 INFO:teuthology.orchestra.run.smithi155.stdout: } 2023-08-01T19:56:07.061 INFO:teuthology.orchestra.run.smithi155.stdout: ] 2023-08-01T19:56:07.061 INFO:teuthology.orchestra.run.smithi155.stdout: } 2023-08-01T19:56:07.061 INFO:teuthology.orchestra.run.smithi155.stdout: }, 2023-08-01T19:56:07.061 INFO:teuthology.orchestra.run.smithi155.stdout: { 2023-08-01T19:56:07.061 INFO:teuthology.orchestra.run.smithi155.stdout: "description": "osd_op(client.4668.0:197420 5.9 5:92a2efe5:::benchmark_data_smithi006_114134_object63759:head [delete] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e62)", 2023-08-01T19:56:07.062 INFO:teuthology.orchestra.run.smithi155.stdout: "initiated_at": "2023-08-01T19:55:58.582230+0000", 2023-08-01T19:56:07.062 INFO:teuthology.orchestra.run.smithi155.stdout: "age": 8.2921902200000002, 2023-08-01T19:56:07.062 INFO:teuthology.orchestra.run.smithi155.stdout: "duration": 1.0095353739999999, 2023-08-01T19:56:07.062 INFO:teuthology.orchestra.run.smithi155.stdout: "type_data": { 2023-08-01T19:56:07.062 INFO:teuthology.orchestra.run.smithi155.stdout: "flag_point": "commit sent; apply or cleanup", 2023-08-01T19:56:07.062 INFO:teuthology.orchestra.run.smithi155.stdout: "client_info": { 2023-08-01T19:56:07.062 INFO:teuthology.orchestra.run.smithi155.stdout: "client": "client.4668", 2023-08-01T19:56:07.062 INFO:teuthology.orchestra.run.smithi155.stdout: "client_addr": "172.21.15.6:0/1709472247", 2023-08-01T19:56:07.063 INFO:teuthology.orchestra.run.smithi155.stdout: "tid": 197420 2023-08-01T19:56:07.063 INFO:teuthology.orchestra.run.smithi155.stdout: }, 2023-08-01T19:56:07.063 INFO:teuthology.orchestra.run.smithi155.stdout: "events": [ 2023-08-01T19:56:07.063 INFO:teuthology.orchestra.run.smithi155.stdout: { 2023-08-01T19:56:07.063 INFO:teuthology.orchestra.run.smithi155.stdout: "event": "initiated", 2023-08-01T19:56:07.063 INFO:teuthology.orchestra.run.smithi155.stdout: "time": "2023-08-01T19:55:58.582230+0000", 2023-08-01T19:56:07.063 INFO:teuthology.orchestra.run.smithi155.stdout: "duration": 0 2023-08-01T19:56:07.063 INFO:teuthology.orchestra.run.smithi155.stdout: }, 2023-08-01T19:56:07.064 INFO:teuthology.orchestra.run.smithi155.stdout: { 2023-08-01T19:56:07.064 INFO:teuthology.orchestra.run.smithi155.stdout: "event": "throttled", 2023-08-01T19:56:07.064 INFO:teuthology.orchestra.run.smithi155.stdout: "time": "2023-08-01T19:55:58.582230+0000", 2023-08-01T19:56:07.064 INFO:teuthology.orchestra.run.smithi155.stdout: "duration": 0 2023-08-01T19:56:07.064 INFO:teuthology.orchestra.run.smithi155.stdout: }, 2023-08-01T19:56:07.064 INFO:teuthology.orchestra.run.smithi155.stdout: { 2023-08-01T19:56:07.064 INFO:teuthology.orchestra.run.smithi155.stdout: "event": "header_read", 2023-08-01T19:56:07.064 INFO:teuthology.orchestra.run.smithi155.stdout: "time": "2023-08-01T19:55:58.582229+0000", 2023-08-01T19:56:07.065 INFO:teuthology.orchestra.run.smithi155.stdout: "duration": 4294967295.9999995 2023-08-01T19:56:07.065 INFO:teuthology.orchestra.run.smithi155.stdout: }, 2023-08-01T19:56:07.065 INFO:teuthology.orchestra.run.smithi155.stdout: { 2023-08-01T19:56:07.065 INFO:teuthology.orchestra.run.smithi155.stdout: "event": "all_read", 2023-08-01T19:56:07.065 INFO:teuthology.orchestra.run.smithi155.stdout: "time": "2023-08-01T19:55:58.582233+0000", 2023-08-01T19:56:07.065 INFO:teuthology.orchestra.run.smithi155.stdout: "duration": 3.7869999999999999e-06 2023-08-01T19:56:07.065 INFO:teuthology.orchestra.run.smithi155.stdout: }, 2023-08-01T19:56:07.065 INFO:teuthology.orchestra.run.smithi155.stdout: { 2023-08-01T19:56:07.066 INFO:teuthology.orchestra.run.smithi155.stdout: "event": "dispatched", 2023-08-01T19:56:07.066 INFO:teuthology.orchestra.run.smithi155.stdout: "time": "2023-08-01T19:55:58.582241+0000", 2023-08-01T19:56:07.066 INFO:teuthology.orchestra.run.smithi155.stdout: "duration": 7.6909999999999997e-06 2023-08-01T19:56:07.066 INFO:teuthology.orchestra.run.smithi155.stdout: }, 2023-08-01T19:56:07.066 INFO:teuthology.orchestra.run.smithi155.stdout: { 2023-08-01T19:56:07.066 INFO:teuthology.orchestra.run.smithi155.stdout: "event": "queued_for_pg", 2023-08-01T19:56:07.066 INFO:teuthology.orchestra.run.smithi155.stdout: "time": "2023-08-01T19:55:58.582244+0000", 2023-08-01T19:56:07.066 INFO:teuthology.orchestra.run.smithi155.stdout: "duration": 3.6770000000000001e-06 2023-08-01T19:56:07.067 INFO:teuthology.orchestra.run.smithi155.stdout: }, 2023-08-01T19:56:07.067 INFO:teuthology.orchestra.run.smithi155.stdout: { 2023-08-01T19:56:07.067 INFO:teuthology.orchestra.run.smithi155.stdout: "event": "reached_pg", 2023-08-01T19:56:07.067 INFO:teuthology.orchestra.run.smithi155.stdout: "time": "2023-08-01T19:55:58.582274+0000", 2023-08-01T19:56:07.067 INFO:teuthology.orchestra.run.smithi155.stdout: "duration": 3.0074e-05 2023-08-01T19:56:07.067 INFO:teuthology.orchestra.run.smithi155.stdout: }, 2023-08-01T19:56:07.067 INFO:teuthology.orchestra.run.smithi155.stdout: { 2023-08-01T19:56:07.068 INFO:teuthology.orchestra.run.smithi155.stdout: "event": "waiting for peered", 2023-08-01T19:56:07.068 INFO:teuthology.orchestra.run.smithi155.stdout: "time": "2023-08-01T19:55:58.582281+0000", 2023-08-01T19:56:07.068 INFO:teuthology.orchestra.run.smithi155.stdout: "duration": 6.297e-06 2023-08-01T19:56:07.068 INFO:teuthology.orchestra.run.smithi155.stdout: }, 2023-08-01T19:56:07.068 INFO:teuthology.orchestra.run.smithi155.stdout: { 2023-08-01T19:56:07.068 INFO:teuthology.orchestra.run.smithi155.stdout: "event": "reached_pg", 2023-08-01T19:56:07.068 INFO:teuthology.orchestra.run.smithi155.stdout: "time": "2023-08-01T19:55:59.586809+0000", 2023-08-01T19:56:07.068 INFO:teuthology.orchestra.run.smithi155.stdout: "duration": 1.0045281720000001 2023-08-01T19:56:07.069 INFO:teuthology.orchestra.run.smithi155.stdout: }, 2023-08-01T19:56:07.069 INFO:teuthology.orchestra.run.smithi155.stdout: { 2023-08-01T19:56:07.069 INFO:teuthology.orchestra.run.smithi155.stdout: "event": "started", 2023-08-01T19:56:07.069 INFO:teuthology.orchestra.run.smithi155.stdout: "time": "2023-08-01T19:55:59.586910+0000", 2023-08-01T19:56:07.069 INFO:teuthology.orchestra.run.smithi155.stdout: "duration": 0.000100898 2023-08-01T19:56:07.069 INFO:teuthology.orchestra.run.smithi155.stdout: }, 2023-08-01T19:56:07.069 INFO:teuthology.orchestra.run.smithi155.stdout: { 2023-08-01T19:56:07.069 INFO:teuthology.orchestra.run.smithi155.stdout: "event": "op_commit", 2023-08-01T19:56:07.070 INFO:teuthology.orchestra.run.smithi155.stdout: "time": "2023-08-01T19:55:59.591679+0000", 2023-08-01T19:56:07.070 INFO:teuthology.orchestra.run.smithi155.stdout: "duration": 0.004769471 2023-08-01T19:56:07.070 INFO:teuthology.orchestra.run.smithi155.stdout: }, 2023-08-01T19:56:07.070 INFO:teuthology.orchestra.run.smithi155.stdout: { 2023-08-01T19:56:07.070 INFO:teuthology.orchestra.run.smithi155.stdout: "event": "commit_sent", 2023-08-01T19:56:07.070 INFO:teuthology.orchestra.run.smithi155.stdout: "time": "2023-08-01T19:55:59.591721+0000", 2023-08-01T19:56:07.070 INFO:teuthology.orchestra.run.smithi155.stdout: "duration": 4.1953000000000003e-05 2023-08-01T19:56:07.070 INFO:teuthology.orchestra.run.smithi155.stdout: }, 2023-08-01T19:56:07.071 INFO:teuthology.orchestra.run.smithi155.stdout: { 2023-08-01T19:56:07.071 INFO:teuthology.orchestra.run.smithi155.stdout: "event": "done", 2023-08-01T19:56:07.071 INFO:teuthology.orchestra.run.smithi155.stdout: "time": "2023-08-01T19:55:59.591765+0000", 2023-08-01T19:56:07.071 INFO:teuthology.orchestra.run.smithi155.stdout: "duration": 4.4030999999999999e-05 2023-08-01T19:56:07.071 INFO:teuthology.orchestra.run.smithi155.stdout: } 2023-08-01T19:56:07.071 INFO:teuthology.orchestra.run.smithi155.stdout: ] 2023-08-01T19:56:07.071 INFO:teuthology.orchestra.run.smithi155.stdout: } 2023-08-01T19:56:07.071 INFO:teuthology.orchestra.run.smithi155.stdout: } 2023-08-01T19:56:07.072 INFO:teuthology.orchestra.run.smithi155.stdout: ] 2023-08-01T19:56:07.072 INFO:teuthology.orchestra.run.smithi155.stdout:} 2023-08-01T19:56:07.073 DEBUG:teuthology.orchestra.run.smithi008:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 30 ceph --cluster ceph --admin-daemon /var/run/ceph/ceph-osd.0.asok dump_ops_in_flight 2023-08-01T19:56:07.074 INFO:tasks.ceph.osd.0.smithi008.stderr:2023-08-01T19:56:07.071+0000 7f16a58f4700 -1 received signal: Hangup from /usr/bin/python3 /bin/daemon-helper kill ceph-osd -f --cluster ceph -i 0 (PID: 111179) UID: 0 2023-08-01T19:56:07.174 INFO:tasks.ceph.osd.0.smithi008.stderr:2023-08-01T19:56:07.172+0000 7f16a58f4700 -1 received signal: Hangup from /usr/bin/python3 /bin/daemon-helper kill ceph-osd -f --cluster ceph -i 0 (PID: 111179) UID: 0 2023-08-01T19:56:07.259 INFO:teuthology.orchestra.run.smithi008.stdout:{ 2023-08-01T19:56:07.259 INFO:teuthology.orchestra.run.smithi008.stdout: "ops": [ 2023-08-01T19:56:07.260 INFO:teuthology.orchestra.run.smithi008.stdout: { 2023-08-01T19:56:07.260 INFO:teuthology.orchestra.run.smithi008.stdout: "description": "osd_repop(client.4668.0:213250 5.b e66/19)", 2023-08-01T19:56:07.260 INFO:teuthology.orchestra.run.smithi008.stdout: "initiated_at": "2023-08-01T19:56:07.257439+0000", 2023-08-01T19:56:07.260 INFO:teuthology.orchestra.run.smithi008.stdout: "age": 4.0890000000000003e-05, 2023-08-01T19:56:07.260 INFO:teuthology.orchestra.run.smithi008.stdout: "duration": 6.9604000000000006e-05, 2023-08-01T19:56:07.260 INFO:teuthology.orchestra.run.smithi008.stdout: "type_data": { 2023-08-01T19:56:07.260 INFO:teuthology.orchestra.run.smithi008.stdout: "flag_point": "started", 2023-08-01T19:56:07.261 INFO:teuthology.orchestra.run.smithi008.stdout: "events": [ 2023-08-01T19:56:07.261 INFO:teuthology.orchestra.run.smithi008.stdout: { 2023-08-01T19:56:07.261 INFO:teuthology.orchestra.run.smithi008.stdout: "event": "initiated", 2023-08-01T19:56:07.261 INFO:teuthology.orchestra.run.smithi008.stdout: "time": "2023-08-01T19:56:07.257439+0000", 2023-08-01T19:56:07.261 INFO:teuthology.orchestra.run.smithi008.stdout: "duration": 0 2023-08-01T19:56:07.261 INFO:teuthology.orchestra.run.smithi008.stdout: }, 2023-08-01T19:56:07.261 INFO:teuthology.orchestra.run.smithi008.stdout: { 2023-08-01T19:56:07.262 INFO:teuthology.orchestra.run.smithi008.stdout: "event": "throttled", 2023-08-01T19:56:07.262 INFO:teuthology.orchestra.run.smithi008.stdout: "time": "2023-08-01T19:56:07.257439+0000", 2023-08-01T19:56:07.262 INFO:teuthology.orchestra.run.smithi008.stdout: "duration": 0 2023-08-01T19:56:07.262 INFO:teuthology.orchestra.run.smithi008.stdout: }, 2023-08-01T19:56:07.262 INFO:teuthology.orchestra.run.smithi008.stdout: { 2023-08-01T19:56:07.262 INFO:teuthology.orchestra.run.smithi008.stdout: "event": "header_read", 2023-08-01T19:56:07.262 INFO:teuthology.orchestra.run.smithi008.stdout: "time": "2023-08-01T19:56:07.257439+0000", 2023-08-01T19:56:07.262 INFO:teuthology.orchestra.run.smithi008.stdout: "duration": 4294967295.9999995 2023-08-01T19:56:07.263 INFO:teuthology.orchestra.run.smithi008.stdout: }, 2023-08-01T19:56:07.263 INFO:teuthology.orchestra.run.smithi008.stdout: { 2023-08-01T19:56:07.263 INFO:teuthology.orchestra.run.smithi008.stdout: "event": "all_read", 2023-08-01T19:56:07.263 INFO:teuthology.orchestra.run.smithi008.stdout: "time": "2023-08-01T19:56:07.257444+0000", 2023-08-01T19:56:07.263 INFO:teuthology.orchestra.run.smithi008.stdout: "duration": 5.7119999999999997e-06 2023-08-01T19:56:07.263 INFO:teuthology.orchestra.run.smithi008.stdout: }, 2023-08-01T19:56:07.263 INFO:teuthology.orchestra.run.smithi008.stdout: { 2023-08-01T19:56:07.263 INFO:teuthology.orchestra.run.smithi008.stdout: "event": "dispatched", 2023-08-01T19:56:07.264 INFO:teuthology.orchestra.run.smithi008.stdout: "time": "2023-08-01T19:56:07.257452+0000", 2023-08-01T19:56:07.264 INFO:teuthology.orchestra.run.smithi008.stdout: "duration": 8.1759999999999993e-06 2023-08-01T19:56:07.264 INFO:teuthology.orchestra.run.smithi008.stdout: }, 2023-08-01T19:56:07.264 INFO:teuthology.orchestra.run.smithi008.stdout: { 2023-08-01T19:56:07.264 INFO:teuthology.orchestra.run.smithi008.stdout: "event": "queued_for_pg", 2023-08-01T19:56:07.264 INFO:teuthology.orchestra.run.smithi008.stdout: "time": "2023-08-01T19:56:07.257458+0000", 2023-08-01T19:56:07.264 INFO:teuthology.orchestra.run.smithi008.stdout: "duration": 5.7300000000000002e-06 2023-08-01T19:56:07.265 INFO:teuthology.orchestra.run.smithi008.stdout: }, 2023-08-01T19:56:07.265 INFO:teuthology.orchestra.run.smithi008.stdout: { 2023-08-01T19:56:07.265 INFO:teuthology.orchestra.run.smithi008.stdout: "event": "reached_pg", 2023-08-01T19:56:07.265 INFO:teuthology.orchestra.run.smithi008.stdout: "time": "2023-08-01T19:56:07.257490+0000", 2023-08-01T19:56:07.265 INFO:teuthology.orchestra.run.smithi008.stdout: "duration": 3.2002000000000003e-05 2023-08-01T19:56:07.265 INFO:teuthology.orchestra.run.smithi008.stdout: }, 2023-08-01T19:56:07.265 INFO:teuthology.orchestra.run.smithi008.stdout: { 2023-08-01T19:56:07.265 INFO:teuthology.orchestra.run.smithi008.stdout: "event": "started", 2023-08-01T19:56:07.266 INFO:teuthology.orchestra.run.smithi008.stdout: "time": "2023-08-01T19:56:07.257504+0000", 2023-08-01T19:56:07.266 INFO:teuthology.orchestra.run.smithi008.stdout: "duration": 1.4265e-05 2023-08-01T19:56:07.266 INFO:teuthology.orchestra.run.smithi008.stdout: } 2023-08-01T19:56:07.266 INFO:teuthology.orchestra.run.smithi008.stdout: ] 2023-08-01T19:56:07.266 INFO:teuthology.orchestra.run.smithi008.stdout: } 2023-08-01T19:56:07.266 INFO:teuthology.orchestra.run.smithi008.stdout: }, 2023-08-01T19:56:07.266 INFO:teuthology.orchestra.run.smithi008.stdout: { 2023-08-01T19:56:07.266 INFO:teuthology.orchestra.run.smithi008.stdout: "description": "osd_op(client.4668.0:213256 5.6 5:60bdfd42:::benchmark_data_smithi006_114134_object79595:head [delete] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e66)", 2023-08-01T19:56:07.267 INFO:teuthology.orchestra.run.smithi008.stdout: "initiated_at": "2023-08-01T19:56:07.257455+0000", 2023-08-01T19:56:07.267 INFO:teuthology.orchestra.run.smithi008.stdout: "age": 2.5086e-05, 2023-08-01T19:56:07.267 INFO:teuthology.orchestra.run.smithi008.stdout: "duration": 0.00014063500000000001, 2023-08-01T19:56:07.267 INFO:teuthology.orchestra.run.smithi008.stdout: "type_data": { 2023-08-01T19:56:07.267 INFO:teuthology.orchestra.run.smithi008.stdout: "flag_point": "reached pg", 2023-08-01T19:56:07.267 INFO:teuthology.orchestra.run.smithi008.stdout: "client_info": { 2023-08-01T19:56:07.267 INFO:teuthology.orchestra.run.smithi008.stdout: "client": "client.4668", 2023-08-01T19:56:07.268 INFO:teuthology.orchestra.run.smithi008.stdout: "client_addr": "172.21.15.6:0/1709472247", 2023-08-01T19:56:07.268 INFO:teuthology.orchestra.run.smithi008.stdout: "tid": 213256 2023-08-01T19:56:07.268 INFO:teuthology.orchestra.run.smithi008.stdout: }, 2023-08-01T19:56:07.268 INFO:teuthology.orchestra.run.smithi008.stdout: "events": [ 2023-08-01T19:56:07.268 INFO:teuthology.orchestra.run.smithi008.stdout: { 2023-08-01T19:56:07.268 INFO:teuthology.orchestra.run.smithi008.stdout: "event": "initiated", 2023-08-01T19:56:07.268 INFO:teuthology.orchestra.run.smithi008.stdout: "time": "2023-08-01T19:56:07.257455+0000", 2023-08-01T19:56:07.268 INFO:teuthology.orchestra.run.smithi008.stdout: "duration": 0 2023-08-01T19:56:07.269 INFO:teuthology.orchestra.run.smithi008.stdout: }, 2023-08-01T19:56:07.269 INFO:teuthology.orchestra.run.smithi008.stdout: { 2023-08-01T19:56:07.269 INFO:teuthology.orchestra.run.smithi008.stdout: "event": "throttled", 2023-08-01T19:56:07.269 INFO:teuthology.orchestra.run.smithi008.stdout: "time": "2023-08-01T19:56:07.257455+0000", 2023-08-01T19:56:07.269 INFO:teuthology.orchestra.run.smithi008.stdout: "duration": 0 2023-08-01T19:56:07.269 INFO:teuthology.orchestra.run.smithi008.stdout: }, 2023-08-01T19:56:07.269 INFO:teuthology.orchestra.run.smithi008.stdout: { 2023-08-01T19:56:07.269 INFO:teuthology.orchestra.run.smithi008.stdout: "event": "header_read", 2023-08-01T19:56:07.270 INFO:teuthology.orchestra.run.smithi008.stdout: "time": "2023-08-01T19:56:07.257455+0000", 2023-08-01T19:56:07.270 INFO:teuthology.orchestra.run.smithi008.stdout: "duration": 4294967295.9999995 2023-08-01T19:56:07.270 INFO:teuthology.orchestra.run.smithi008.stdout: }, 2023-08-01T19:56:07.270 INFO:teuthology.orchestra.run.smithi008.stdout: { 2023-08-01T19:56:07.270 INFO:teuthology.orchestra.run.smithi008.stdout: "event": "all_read", 2023-08-01T19:56:07.270 INFO:teuthology.orchestra.run.smithi008.stdout: "time": "2023-08-01T19:56:07.257457+0000", 2023-08-01T19:56:07.270 INFO:teuthology.orchestra.run.smithi008.stdout: "duration": 2.3700000000000002e-06 2023-08-01T19:56:07.270 INFO:teuthology.orchestra.run.smithi008.stdout: }, 2023-08-01T19:56:07.271 INFO:teuthology.orchestra.run.smithi008.stdout: { 2023-08-01T19:56:07.271 INFO:teuthology.orchestra.run.smithi008.stdout: "event": "dispatched", 2023-08-01T19:56:07.271 INFO:teuthology.orchestra.run.smithi008.stdout: "time": "2023-08-01T19:56:07.257463+0000", 2023-08-01T19:56:07.271 INFO:teuthology.orchestra.run.smithi008.stdout: "duration": 6.2230000000000004e-06 2023-08-01T19:56:07.271 INFO:teuthology.orchestra.run.smithi008.stdout: }, 2023-08-01T19:56:07.271 INFO:teuthology.orchestra.run.smithi008.stdout: { 2023-08-01T19:56:07.271 INFO:teuthology.orchestra.run.smithi008.stdout: "event": "queued_for_pg", 2023-08-01T19:56:07.272 INFO:teuthology.orchestra.run.smithi008.stdout: "time": "2023-08-01T19:56:07.257467+0000", 2023-08-01T19:56:07.272 INFO:teuthology.orchestra.run.smithi008.stdout: "duration": 3.8909999999999997e-06 2023-08-01T19:56:07.272 INFO:teuthology.orchestra.run.smithi008.stdout: }, 2023-08-01T19:56:07.272 INFO:teuthology.orchestra.run.smithi008.stdout: { 2023-08-01T19:56:07.272 INFO:teuthology.orchestra.run.smithi008.stdout: "event": "reached_pg", 2023-08-01T19:56:07.272 INFO:teuthology.orchestra.run.smithi008.stdout: "time": "2023-08-01T19:56:07.257514+0000", 2023-08-01T19:56:07.272 INFO:teuthology.orchestra.run.smithi008.stdout: "duration": 4.6514000000000002e-05 2023-08-01T19:56:07.272 INFO:teuthology.orchestra.run.smithi008.stdout: } 2023-08-01T19:56:07.273 INFO:teuthology.orchestra.run.smithi008.stdout: ] 2023-08-01T19:56:07.273 INFO:teuthology.orchestra.run.smithi008.stdout: } 2023-08-01T19:56:07.273 INFO:teuthology.orchestra.run.smithi008.stdout: }, 2023-08-01T19:56:07.273 INFO:teuthology.orchestra.run.smithi008.stdout: { 2023-08-01T19:56:07.273 INFO:teuthology.orchestra.run.smithi008.stdout: "description": "osd_op(client.4668.0:213257 5.2 5.631bac82 (undecoded) ondisk+write+known_if_redirected+supports_pool_eio e66)", 2023-08-01T19:56:07.273 INFO:teuthology.orchestra.run.smithi008.stdout: "initiated_at": "2023-08-01T19:56:07.257476+0000", 2023-08-01T19:56:07.273 INFO:teuthology.orchestra.run.smithi008.stdout: "age": 4.6e-06, 2023-08-01T19:56:07.273 INFO:teuthology.orchestra.run.smithi008.stdout: "duration": 0.00019155800000000001, 2023-08-01T19:56:07.274 INFO:teuthology.orchestra.run.smithi008.stdout: "type_data": { 2023-08-01T19:56:07.274 INFO:teuthology.orchestra.run.smithi008.stdout: "flag_point": "no flag points reached", 2023-08-01T19:56:07.274 INFO:teuthology.orchestra.run.smithi008.stdout: "client_info": { 2023-08-01T19:56:07.274 INFO:teuthology.orchestra.run.smithi008.stdout: "client": "client.4668", 2023-08-01T19:56:07.274 INFO:teuthology.orchestra.run.smithi008.stdout: "client_addr": "172.21.15.6:0/1709472247", 2023-08-01T19:56:07.274 INFO:teuthology.orchestra.run.smithi008.stdout: "tid": 213257 2023-08-01T19:56:07.274 INFO:teuthology.orchestra.run.smithi008.stdout: }, 2023-08-01T19:56:07.275 INFO:teuthology.orchestra.run.smithi008.stdout: "events": [ 2023-08-01T19:56:07.275 INFO:teuthology.orchestra.run.smithi008.stdout: { 2023-08-01T19:56:07.275 INFO:teuthology.orchestra.run.smithi008.stdout: "event": "initiated", 2023-08-01T19:56:07.275 INFO:teuthology.orchestra.run.smithi008.stdout: "time": "2023-08-01T19:56:07.257476+0000", 2023-08-01T19:56:07.275 INFO:teuthology.orchestra.run.smithi008.stdout: "duration": 0 2023-08-01T19:56:07.275 INFO:teuthology.orchestra.run.smithi008.stdout: }, 2023-08-01T19:56:07.275 INFO:teuthology.orchestra.run.smithi008.stdout: { 2023-08-01T19:56:07.275 INFO:teuthology.orchestra.run.smithi008.stdout: "event": "throttled", 2023-08-01T19:56:07.276 INFO:teuthology.orchestra.run.smithi008.stdout: "time": "2023-08-01T19:56:07.257476+0000", 2023-08-01T19:56:07.276 INFO:teuthology.orchestra.run.smithi008.stdout: "duration": 0 2023-08-01T19:56:07.276 INFO:teuthology.orchestra.run.smithi008.stdout: }, 2023-08-01T19:56:07.276 INFO:teuthology.orchestra.run.smithi008.stdout: { 2023-08-01T19:56:07.276 INFO:teuthology.orchestra.run.smithi008.stdout: "event": "header_read", 2023-08-01T19:56:07.276 INFO:teuthology.orchestra.run.smithi008.stdout: "time": "2023-08-01T19:56:07.257475+0000", 2023-08-01T19:56:07.276 INFO:teuthology.orchestra.run.smithi008.stdout: "duration": 4294967295.9999995 2023-08-01T19:56:07.276 INFO:teuthology.orchestra.run.smithi008.stdout: }, 2023-08-01T19:56:07.277 INFO:teuthology.orchestra.run.smithi008.stdout: { 2023-08-01T19:56:07.277 INFO:teuthology.orchestra.run.smithi008.stdout: "event": "all_read", 2023-08-01T19:56:07.277 INFO:teuthology.orchestra.run.smithi008.stdout: "time": "2023-08-01T19:56:07.257477+0000", 2023-08-01T19:56:07.277 INFO:teuthology.orchestra.run.smithi008.stdout: "duration": 2.2749999999999998e-06 2023-08-01T19:56:07.277 INFO:teuthology.orchestra.run.smithi008.stdout: }, 2023-08-01T19:56:07.277 INFO:teuthology.orchestra.run.smithi008.stdout: { 2023-08-01T19:56:07.277 INFO:teuthology.orchestra.run.smithi008.stdout: "event": "dispatched", 2023-08-01T19:56:07.277 INFO:teuthology.orchestra.run.smithi008.stdout: "time": "2023-08-01T19:56:07.257484+0000", 2023-08-01T19:56:07.278 INFO:teuthology.orchestra.run.smithi008.stdout: "duration": 6.117e-06 2023-08-01T19:56:07.278 INFO:teuthology.orchestra.run.smithi008.stdout: } 2023-08-01T19:56:07.278 INFO:teuthology.orchestra.run.smithi008.stdout: ] 2023-08-01T19:56:07.278 INFO:teuthology.orchestra.run.smithi008.stdout: } 2023-08-01T19:56:07.278 INFO:teuthology.orchestra.run.smithi008.stdout: }, 2023-08-01T19:56:07.278 INFO:teuthology.orchestra.run.smithi008.stdout: { 2023-08-01T19:56:07.278 INFO:teuthology.orchestra.run.smithi008.stdout: "description": "osd_repop(client.4668.0:213252 5.8 e66/19)", 2023-08-01T19:56:07.278 INFO:teuthology.orchestra.run.smithi008.stdout: "initiated_at": "2023-08-01T19:56:07.257621+0000", 2023-08-01T19:56:07.279 INFO:teuthology.orchestra.run.smithi008.stdout: "age": 4294967295.9998589, 2023-08-01T19:56:07.279 INFO:teuthology.orchestra.run.smithi008.stdout: "duration": 7.7961999999999997e-05, 2023-08-01T19:56:07.279 INFO:teuthology.orchestra.run.smithi008.stdout: "type_data": { 2023-08-01T19:56:07.279 INFO:teuthology.orchestra.run.smithi008.stdout: "flag_point": "no flag points reached", 2023-08-01T19:56:07.279 INFO:teuthology.orchestra.run.smithi008.stdout: "events": [ 2023-08-01T19:56:07.279 INFO:teuthology.orchestra.run.smithi008.stdout: { 2023-08-01T19:56:07.279 INFO:teuthology.orchestra.run.smithi008.stdout: "event": "initiated", 2023-08-01T19:56:07.280 INFO:teuthology.orchestra.run.smithi008.stdout: "time": "2023-08-01T19:56:07.257621+0000", 2023-08-01T19:56:07.280 INFO:teuthology.orchestra.run.smithi008.stdout: "duration": 0 2023-08-01T19:56:07.280 INFO:teuthology.orchestra.run.smithi008.stdout: }, 2023-08-01T19:56:07.280 INFO:teuthology.orchestra.run.smithi008.stdout: { 2023-08-01T19:56:07.280 INFO:teuthology.orchestra.run.smithi008.stdout: "event": "throttled", 2023-08-01T19:56:07.280 INFO:teuthology.orchestra.run.smithi008.stdout: "time": "2023-08-01T19:56:07.257621+0000", 2023-08-01T19:56:07.280 INFO:teuthology.orchestra.run.smithi008.stdout: "duration": 0 2023-08-01T19:56:07.280 INFO:teuthology.orchestra.run.smithi008.stdout: }, 2023-08-01T19:56:07.281 INFO:teuthology.orchestra.run.smithi008.stdout: { 2023-08-01T19:56:07.281 INFO:teuthology.orchestra.run.smithi008.stdout: "event": "header_read", 2023-08-01T19:56:07.281 INFO:teuthology.orchestra.run.smithi008.stdout: "time": "2023-08-01T19:56:07.257621+0000", 2023-08-01T19:56:07.281 INFO:teuthology.orchestra.run.smithi008.stdout: "duration": 4294967295.9999995 2023-08-01T19:56:07.281 INFO:teuthology.orchestra.run.smithi008.stdout: }, 2023-08-01T19:56:07.281 INFO:teuthology.orchestra.run.smithi008.stdout: { 2023-08-01T19:56:07.281 INFO:teuthology.orchestra.run.smithi008.stdout: "event": "all_read", 2023-08-01T19:56:07.281 INFO:teuthology.orchestra.run.smithi008.stdout: "time": "2023-08-01T19:56:07.257626+0000", 2023-08-01T19:56:07.282 INFO:teuthology.orchestra.run.smithi008.stdout: "duration": 5.4779999999999999e-06 2023-08-01T19:56:07.282 INFO:teuthology.orchestra.run.smithi008.stdout: }, 2023-08-01T19:56:07.282 INFO:teuthology.orchestra.run.smithi008.stdout: { 2023-08-01T19:56:07.282 INFO:teuthology.orchestra.run.smithi008.stdout: "event": "dispatched", 2023-08-01T19:56:07.282 INFO:teuthology.orchestra.run.smithi008.stdout: "time": "2023-08-01T19:56:07.257635+0000", 2023-08-01T19:56:07.282 INFO:teuthology.orchestra.run.smithi008.stdout: "duration": 8.9730000000000003e-06 2023-08-01T19:56:07.282 INFO:teuthology.orchestra.run.smithi008.stdout: } 2023-08-01T19:56:07.282 INFO:teuthology.orchestra.run.smithi008.stdout: ] 2023-08-01T19:56:07.283 INFO:teuthology.orchestra.run.smithi008.stdout: } 2023-08-01T19:56:07.283 INFO:teuthology.orchestra.run.smithi008.stdout: }, 2023-08-01T19:56:07.283 INFO:teuthology.orchestra.run.smithi008.stdout: { 2023-08-01T19:56:07.283 INFO:teuthology.orchestra.run.smithi008.stdout: "description": "osd_repop(client.4668.0:213241 5.4 e66/19 5:2fb8aea0:::benchmark_data_smithi006_114134_object79580:head v 66'13175, mlcod=66'13173)", 2023-08-01T19:56:07.283 INFO:teuthology.orchestra.run.smithi008.stdout: "initiated_at": "2023-08-01T19:56:07.251887+0000", 2023-08-01T19:56:07.283 INFO:teuthology.orchestra.run.smithi008.stdout: "age": 0.0055927850000000003, 2023-08-01T19:56:07.283 INFO:teuthology.orchestra.run.smithi008.stdout: "duration": 0.0058768529999999996, 2023-08-01T19:56:07.283 INFO:teuthology.orchestra.run.smithi008.stdout: "type_data": { 2023-08-01T19:56:07.284 INFO:teuthology.orchestra.run.smithi008.stdout: "flag_point": "started", 2023-08-01T19:56:07.284 INFO:teuthology.orchestra.run.smithi008.stdout: "events": [ 2023-08-01T19:56:07.284 INFO:teuthology.orchestra.run.smithi008.stdout: { 2023-08-01T19:56:07.284 INFO:teuthology.orchestra.run.smithi008.stdout: "event": "initiated", 2023-08-01T19:56:07.284 INFO:teuthology.orchestra.run.smithi008.stdout: "time": "2023-08-01T19:56:07.251887+0000", 2023-08-01T19:56:07.284 INFO:teuthology.orchestra.run.smithi008.stdout: "duration": 0 2023-08-01T19:56:07.284 INFO:teuthology.orchestra.run.smithi008.stdout: }, 2023-08-01T19:56:07.285 INFO:teuthology.orchestra.run.smithi008.stdout: { 2023-08-01T19:56:07.285 INFO:teuthology.orchestra.run.smithi008.stdout: "event": "throttled", 2023-08-01T19:56:07.285 INFO:teuthology.orchestra.run.smithi008.stdout: "time": "2023-08-01T19:56:07.251887+0000", 2023-08-01T19:56:07.285 INFO:teuthology.orchestra.run.smithi008.stdout: "duration": 0 2023-08-01T19:56:07.285 INFO:teuthology.orchestra.run.smithi008.stdout: }, 2023-08-01T19:56:07.285 INFO:teuthology.orchestra.run.smithi008.stdout: { 2023-08-01T19:56:07.285 INFO:teuthology.orchestra.run.smithi008.stdout: "event": "header_read", 2023-08-01T19:56:07.285 INFO:teuthology.orchestra.run.smithi008.stdout: "time": "2023-08-01T19:56:07.251887+0000", 2023-08-01T19:56:07.286 INFO:teuthology.orchestra.run.smithi008.stdout: "duration": 4294967295.9999995 2023-08-01T19:56:07.286 INFO:teuthology.orchestra.run.smithi008.stdout: }, 2023-08-01T19:56:07.286 INFO:teuthology.orchestra.run.smithi008.stdout: { 2023-08-01T19:56:07.286 INFO:teuthology.orchestra.run.smithi008.stdout: "event": "all_read", 2023-08-01T19:56:07.286 INFO:teuthology.orchestra.run.smithi008.stdout: "time": "2023-08-01T19:56:07.251892+0000", 2023-08-01T19:56:07.286 INFO:teuthology.orchestra.run.smithi008.stdout: "duration": 5.4260000000000002e-06 2023-08-01T19:56:07.286 INFO:teuthology.orchestra.run.smithi008.stdout: }, 2023-08-01T19:56:07.286 INFO:teuthology.orchestra.run.smithi008.stdout: { 2023-08-01T19:56:07.287 INFO:teuthology.orchestra.run.smithi008.stdout: "event": "dispatched", 2023-08-01T19:56:07.287 INFO:teuthology.orchestra.run.smithi008.stdout: "time": "2023-08-01T19:56:07.251900+0000", 2023-08-01T19:56:07.287 INFO:teuthology.orchestra.run.smithi008.stdout: "duration": 7.7919999999999993e-06 2023-08-01T19:56:07.287 INFO:teuthology.orchestra.run.smithi008.stdout: }, 2023-08-01T19:56:07.287 INFO:teuthology.orchestra.run.smithi008.stdout: { 2023-08-01T19:56:07.287 INFO:teuthology.orchestra.run.smithi008.stdout: "event": "queued_for_pg", 2023-08-01T19:56:07.287 INFO:teuthology.orchestra.run.smithi008.stdout: "time": "2023-08-01T19:56:07.251905+0000", 2023-08-01T19:56:07.287 INFO:teuthology.orchestra.run.smithi008.stdout: "duration": 4.7879999999999997e-06 2023-08-01T19:56:07.288 INFO:teuthology.orchestra.run.smithi008.stdout: }, 2023-08-01T19:56:07.288 INFO:teuthology.orchestra.run.smithi008.stdout: { 2023-08-01T19:56:07.288 INFO:teuthology.orchestra.run.smithi008.stdout: "event": "reached_pg", 2023-08-01T19:56:07.288 INFO:teuthology.orchestra.run.smithi008.stdout: "time": "2023-08-01T19:56:07.251946+0000", 2023-08-01T19:56:07.288 INFO:teuthology.orchestra.run.smithi008.stdout: "duration": 4.1634000000000002e-05 2023-08-01T19:56:07.288 INFO:teuthology.orchestra.run.smithi008.stdout: }, 2023-08-01T19:56:07.288 INFO:teuthology.orchestra.run.smithi008.stdout: { 2023-08-01T19:56:07.289 INFO:teuthology.orchestra.run.smithi008.stdout: "event": "started", 2023-08-01T19:56:07.289 INFO:teuthology.orchestra.run.smithi008.stdout: "time": "2023-08-01T19:56:07.251965+0000", 2023-08-01T19:56:07.289 INFO:teuthology.orchestra.run.smithi008.stdout: "duration": 1.9035999999999999e-05 2023-08-01T19:56:07.289 INFO:teuthology.orchestra.run.smithi008.stdout: } 2023-08-01T19:56:07.289 INFO:teuthology.orchestra.run.smithi008.stdout: ] 2023-08-01T19:56:07.289 INFO:teuthology.orchestra.run.smithi008.stdout: } 2023-08-01T19:56:07.289 INFO:teuthology.orchestra.run.smithi008.stdout: }, 2023-08-01T19:56:07.289 INFO:teuthology.orchestra.run.smithi008.stdout: { 2023-08-01T19:56:07.290 INFO:teuthology.orchestra.run.smithi008.stdout: "description": "osd_op(client.4668.0:213244 5.c 5:337242c5:::benchmark_data_smithi006_114134_object79583:head [delete] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e66)", 2023-08-01T19:56:07.290 INFO:teuthology.orchestra.run.smithi008.stdout: "initiated_at": "2023-08-01T19:56:07.253640+0000", 2023-08-01T19:56:07.290 INFO:teuthology.orchestra.run.smithi008.stdout: "age": 0.0038396649999999999, 2023-08-01T19:56:07.290 INFO:teuthology.orchestra.run.smithi008.stdout: "duration": 0.0042192549999999999, 2023-08-01T19:56:07.290 INFO:teuthology.orchestra.run.smithi008.stdout: "type_data": { 2023-08-01T19:56:07.290 INFO:teuthology.orchestra.run.smithi008.stdout: "flag_point": "started", 2023-08-01T19:56:07.290 INFO:teuthology.orchestra.run.smithi008.stdout: "client_info": { 2023-08-01T19:56:07.290 INFO:teuthology.orchestra.run.smithi008.stdout: "client": "client.4668", 2023-08-01T19:56:07.291 INFO:teuthology.orchestra.run.smithi008.stdout: "client_addr": "172.21.15.6:0/1709472247", 2023-08-01T19:56:07.291 INFO:teuthology.orchestra.run.smithi008.stdout: "tid": 213244 2023-08-01T19:56:07.291 INFO:teuthology.orchestra.run.smithi008.stdout: }, 2023-08-01T19:56:07.291 INFO:teuthology.orchestra.run.smithi008.stdout: "events": [ 2023-08-01T19:56:07.291 INFO:teuthology.orchestra.run.smithi008.stdout: { 2023-08-01T19:56:07.291 INFO:teuthology.orchestra.run.smithi008.stdout: "event": "initiated", 2023-08-01T19:56:07.291 INFO:teuthology.orchestra.run.smithi008.stdout: "time": "2023-08-01T19:56:07.253640+0000", 2023-08-01T19:56:07.291 INFO:teuthology.orchestra.run.smithi008.stdout: "duration": 0 2023-08-01T19:56:07.292 INFO:teuthology.orchestra.run.smithi008.stdout: }, 2023-08-01T19:56:07.292 INFO:teuthology.orchestra.run.smithi008.stdout: { 2023-08-01T19:56:07.292 INFO:teuthology.orchestra.run.smithi008.stdout: "event": "throttled", 2023-08-01T19:56:07.292 INFO:teuthology.orchestra.run.smithi008.stdout: "time": "2023-08-01T19:56:07.253640+0000", 2023-08-01T19:56:07.292 INFO:teuthology.orchestra.run.smithi008.stdout: "duration": 0 2023-08-01T19:56:07.292 INFO:teuthology.orchestra.run.smithi008.stdout: }, 2023-08-01T19:56:07.292 INFO:teuthology.orchestra.run.smithi008.stdout: { 2023-08-01T19:56:07.292 INFO:teuthology.orchestra.run.smithi008.stdout: "event": "header_read", 2023-08-01T19:56:07.293 INFO:teuthology.orchestra.run.smithi008.stdout: "time": "2023-08-01T19:56:07.253640+0000", 2023-08-01T19:56:07.293 INFO:teuthology.orchestra.run.smithi008.stdout: "duration": 4294967295.9999995 2023-08-01T19:56:07.293 INFO:teuthology.orchestra.run.smithi008.stdout: }, 2023-08-01T19:56:07.293 INFO:teuthology.orchestra.run.smithi008.stdout: { 2023-08-01T19:56:07.293 INFO:teuthology.orchestra.run.smithi008.stdout: "event": "all_read", 2023-08-01T19:56:07.293 INFO:teuthology.orchestra.run.smithi008.stdout: "time": "2023-08-01T19:56:07.253644+0000", 2023-08-01T19:56:07.293 INFO:teuthology.orchestra.run.smithi008.stdout: "duration": 4.1479999999999999e-06 2023-08-01T19:56:07.294 INFO:teuthology.orchestra.run.smithi008.stdout: }, 2023-08-01T19:56:07.294 INFO:teuthology.orchestra.run.smithi008.stdout: { 2023-08-01T19:56:07.294 INFO:teuthology.orchestra.run.smithi008.stdout: "event": "dispatched", 2023-08-01T19:56:07.294 INFO:teuthology.orchestra.run.smithi008.stdout: "time": "2023-08-01T19:56:07.253652+0000", 2023-08-01T19:56:07.294 INFO:teuthology.orchestra.run.smithi008.stdout: "duration": 8.0220000000000004e-06 2023-08-01T19:56:07.294 INFO:teuthology.orchestra.run.smithi008.stdout: }, 2023-08-01T19:56:07.294 INFO:teuthology.orchestra.run.smithi008.stdout: { 2023-08-01T19:56:07.294 INFO:teuthology.orchestra.run.smithi008.stdout: "event": "queued_for_pg", 2023-08-01T19:56:07.295 INFO:teuthology.orchestra.run.smithi008.stdout: "time": "2023-08-01T19:56:07.253656+0000", 2023-08-01T19:56:07.295 INFO:teuthology.orchestra.run.smithi008.stdout: "duration": 3.9670000000000003e-06 2023-08-01T19:56:07.295 INFO:teuthology.orchestra.run.smithi008.stdout: }, 2023-08-01T19:56:07.295 INFO:teuthology.orchestra.run.smithi008.stdout: { 2023-08-01T19:56:07.295 INFO:teuthology.orchestra.run.smithi008.stdout: "event": "reached_pg", 2023-08-01T19:56:07.295 INFO:teuthology.orchestra.run.smithi008.stdout: "time": "2023-08-01T19:56:07.253686+0000", 2023-08-01T19:56:07.295 INFO:teuthology.orchestra.run.smithi008.stdout: "duration": 2.9865999999999998e-05 2023-08-01T19:56:07.295 INFO:teuthology.orchestra.run.smithi008.stdout: }, 2023-08-01T19:56:07.296 INFO:teuthology.orchestra.run.smithi008.stdout: { 2023-08-01T19:56:07.296 INFO:teuthology.orchestra.run.smithi008.stdout: "event": "started", 2023-08-01T19:56:07.296 INFO:teuthology.orchestra.run.smithi008.stdout: "time": "2023-08-01T19:56:07.253758+0000", 2023-08-01T19:56:07.296 INFO:teuthology.orchestra.run.smithi008.stdout: "duration": 7.2556000000000001e-05 2023-08-01T19:56:07.296 INFO:teuthology.orchestra.run.smithi008.stdout: } 2023-08-01T19:56:07.296 INFO:teuthology.orchestra.run.smithi008.stdout: ] 2023-08-01T19:56:07.296 INFO:teuthology.orchestra.run.smithi008.stdout: } 2023-08-01T19:56:07.296 INFO:teuthology.orchestra.run.smithi008.stdout: }, 2023-08-01T19:56:07.297 INFO:teuthology.orchestra.run.smithi008.stdout: { 2023-08-01T19:56:07.297 INFO:teuthology.orchestra.run.smithi008.stdout: "description": "osd_op(client.4668.0:213245 5.2 5:45ea38dd:::benchmark_data_smithi006_114134_object79584:head [delete] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e66)", 2023-08-01T19:56:07.297 INFO:teuthology.orchestra.run.smithi008.stdout: "initiated_at": "2023-08-01T19:56:07.254250+0000", 2023-08-01T19:56:07.297 INFO:teuthology.orchestra.run.smithi008.stdout: "age": 0.0032303599999999998, 2023-08-01T19:56:07.297 INFO:teuthology.orchestra.run.smithi008.stdout: "duration": 0.0036970290000000001, 2023-08-01T19:56:07.297 INFO:teuthology.orchestra.run.smithi008.stdout: "type_data": { 2023-08-01T19:56:07.297 INFO:teuthology.orchestra.run.smithi008.stdout: "flag_point": "started", 2023-08-01T19:56:07.297 INFO:teuthology.orchestra.run.smithi008.stdout: "client_info": { 2023-08-01T19:56:07.298 INFO:teuthology.orchestra.run.smithi008.stdout: "client": "client.4668", 2023-08-01T19:56:07.298 INFO:teuthology.orchestra.run.smithi008.stdout: "client_addr": "172.21.15.6:0/1709472247", 2023-08-01T19:56:07.298 INFO:teuthology.orchestra.run.smithi008.stdout: "tid": 213245 2023-08-01T19:56:07.298 INFO:teuthology.orchestra.run.smithi008.stdout: }, 2023-08-01T19:56:07.298 INFO:teuthology.orchestra.run.smithi008.stdout: "events": [ 2023-08-01T19:56:07.298 INFO:teuthology.orchestra.run.smithi008.stdout: { 2023-08-01T19:56:07.298 INFO:teuthology.orchestra.run.smithi008.stdout: "event": "initiated", 2023-08-01T19:56:07.298 INFO:teuthology.orchestra.run.smithi008.stdout: "time": "2023-08-01T19:56:07.254250+0000", 2023-08-01T19:56:07.299 INFO:teuthology.orchestra.run.smithi008.stdout: "duration": 0 2023-08-01T19:56:07.299 INFO:teuthology.orchestra.run.smithi008.stdout: }, 2023-08-01T19:56:07.299 INFO:teuthology.orchestra.run.smithi008.stdout: { 2023-08-01T19:56:07.299 INFO:teuthology.orchestra.run.smithi008.stdout: "event": "throttled", 2023-08-01T19:56:07.299 INFO:teuthology.orchestra.run.smithi008.stdout: "time": "2023-08-01T19:56:07.254250+0000", 2023-08-01T19:56:07.299 INFO:teuthology.orchestra.run.smithi008.stdout: "duration": 0 2023-08-01T19:56:07.299 INFO:teuthology.orchestra.run.smithi008.stdout: }, 2023-08-01T19:56:07.300 INFO:teuthology.orchestra.run.smithi008.stdout: { 2023-08-01T19:56:07.300 INFO:teuthology.orchestra.run.smithi008.stdout: "event": "header_read", 2023-08-01T19:56:07.300 INFO:teuthology.orchestra.run.smithi008.stdout: "time": "2023-08-01T19:56:07.254249+0000", 2023-08-01T19:56:07.300 INFO:teuthology.orchestra.run.smithi008.stdout: "duration": 4294967295.999999 2023-08-01T19:56:07.300 INFO:teuthology.orchestra.run.smithi008.stdout: }, 2023-08-01T19:56:07.300 INFO:teuthology.orchestra.run.smithi008.stdout: { 2023-08-01T19:56:07.300 INFO:teuthology.orchestra.run.smithi008.stdout: "event": "all_read", 2023-08-01T19:56:07.300 INFO:teuthology.orchestra.run.smithi008.stdout: "time": "2023-08-01T19:56:07.254254+0000", 2023-08-01T19:56:07.301 INFO:teuthology.orchestra.run.smithi008.stdout: "duration": 5.1930000000000001e-06 2023-08-01T19:56:07.301 INFO:teuthology.orchestra.run.smithi008.stdout: }, 2023-08-01T19:56:07.301 INFO:teuthology.orchestra.run.smithi008.stdout: { 2023-08-01T19:56:07.301 INFO:teuthology.orchestra.run.smithi008.stdout: "event": "dispatched", 2023-08-01T19:56:07.301 INFO:teuthology.orchestra.run.smithi008.stdout: "time": "2023-08-01T19:56:07.254266+0000", 2023-08-01T19:56:07.301 INFO:teuthology.orchestra.run.smithi008.stdout: "duration": 1.1693e-05 2023-08-01T19:56:07.301 INFO:teuthology.orchestra.run.smithi008.stdout: }, 2023-08-01T19:56:07.301 INFO:teuthology.orchestra.run.smithi008.stdout: { 2023-08-01T19:56:07.302 INFO:teuthology.orchestra.run.smithi008.stdout: "event": "queued_for_pg", 2023-08-01T19:56:07.302 INFO:teuthology.orchestra.run.smithi008.stdout: "time": "2023-08-01T19:56:07.254272+0000", 2023-08-01T19:56:07.302 INFO:teuthology.orchestra.run.smithi008.stdout: "duration": 5.8209999999999998e-06 2023-08-01T19:56:07.302 INFO:teuthology.orchestra.run.smithi008.stdout: }, 2023-08-01T19:56:07.302 INFO:teuthology.orchestra.run.smithi008.stdout: { 2023-08-01T19:56:07.302 INFO:teuthology.orchestra.run.smithi008.stdout: "event": "reached_pg", 2023-08-01T19:56:07.302 INFO:teuthology.orchestra.run.smithi008.stdout: "time": "2023-08-01T19:56:07.254306+0000", 2023-08-01T19:56:07.302 INFO:teuthology.orchestra.run.smithi008.stdout: "duration": 3.4069000000000002e-05 2023-08-01T19:56:07.303 INFO:teuthology.orchestra.run.smithi008.stdout: }, 2023-08-01T19:56:07.303 INFO:teuthology.orchestra.run.smithi008.stdout: { 2023-08-01T19:56:07.303 INFO:teuthology.orchestra.run.smithi008.stdout: "event": "started", 2023-08-01T19:56:07.303 INFO:teuthology.orchestra.run.smithi008.stdout: "time": "2023-08-01T19:56:07.254397+0000", 2023-08-01T19:56:07.303 INFO:teuthology.orchestra.run.smithi008.stdout: "duration": 9.0923999999999999e-05 2023-08-01T19:56:07.303 INFO:teuthology.orchestra.run.smithi008.stdout: } 2023-08-01T19:56:07.303 INFO:teuthology.orchestra.run.smithi008.stdout: ] 2023-08-01T19:56:07.303 INFO:teuthology.orchestra.run.smithi008.stdout: } 2023-08-01T19:56:07.304 INFO:teuthology.orchestra.run.smithi008.stdout: }, 2023-08-01T19:56:07.304 INFO:teuthology.orchestra.run.smithi008.stdout: { 2023-08-01T19:56:07.304 INFO:teuthology.orchestra.run.smithi008.stdout: "description": "osd_op(client.4668.0:213247 5.1 5:8038a3b3:::benchmark_data_smithi006_114134_object79586:head [delete] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e66)", 2023-08-01T19:56:07.304 INFO:teuthology.orchestra.run.smithi008.stdout: "initiated_at": "2023-08-01T19:56:07.254280+0000", 2023-08-01T19:56:07.304 INFO:teuthology.orchestra.run.smithi008.stdout: "age": 0.003199735, 2023-08-01T19:56:07.304 INFO:teuthology.orchestra.run.smithi008.stdout: "duration": 0.0037445740000000001, 2023-08-01T19:56:07.304 INFO:teuthology.orchestra.run.smithi008.stdout: "type_data": { 2023-08-01T19:56:07.305 INFO:teuthology.orchestra.run.smithi008.stdout: "flag_point": "started", 2023-08-01T19:56:07.305 INFO:teuthology.orchestra.run.smithi008.stdout: "client_info": { 2023-08-01T19:56:07.305 INFO:teuthology.orchestra.run.smithi008.stdout: "client": "client.4668", 2023-08-01T19:56:07.305 INFO:teuthology.orchestra.run.smithi008.stdout: "client_addr": "172.21.15.6:0/1709472247", 2023-08-01T19:56:07.305 INFO:teuthology.orchestra.run.smithi008.stdout: "tid": 213247 2023-08-01T19:56:07.305 INFO:teuthology.orchestra.run.smithi008.stdout: }, 2023-08-01T19:56:07.305 INFO:teuthology.orchestra.run.smithi008.stdout: "events": [ 2023-08-01T19:56:07.305 INFO:teuthology.orchestra.run.smithi008.stdout: { 2023-08-01T19:56:07.306 INFO:teuthology.orchestra.run.smithi008.stdout: "event": "initiated", 2023-08-01T19:56:07.306 INFO:teuthology.orchestra.run.smithi008.stdout: "time": "2023-08-01T19:56:07.254280+0000", 2023-08-01T19:56:07.306 INFO:teuthology.orchestra.run.smithi008.stdout: "duration": 0 2023-08-01T19:56:07.306 INFO:teuthology.orchestra.run.smithi008.stdout: }, 2023-08-01T19:56:07.306 INFO:teuthology.orchestra.run.smithi008.stdout: { 2023-08-01T19:56:07.306 INFO:teuthology.orchestra.run.smithi008.stdout: "event": "throttled", 2023-08-01T19:56:07.306 INFO:teuthology.orchestra.run.smithi008.stdout: "time": "2023-08-01T19:56:07.254280+0000", 2023-08-01T19:56:07.306 INFO:teuthology.orchestra.run.smithi008.stdout: "duration": 0 2023-08-01T19:56:07.307 INFO:teuthology.orchestra.run.smithi008.stdout: }, 2023-08-01T19:56:07.307 INFO:teuthology.orchestra.run.smithi008.stdout: { 2023-08-01T19:56:07.307 INFO:teuthology.orchestra.run.smithi008.stdout: "event": "header_read", 2023-08-01T19:56:07.307 INFO:teuthology.orchestra.run.smithi008.stdout: "time": "2023-08-01T19:56:07.254280+0000", 2023-08-01T19:56:07.307 INFO:teuthology.orchestra.run.smithi008.stdout: "duration": 4294967295.9999995 2023-08-01T19:56:07.307 INFO:teuthology.orchestra.run.smithi008.stdout: }, 2023-08-01T19:56:07.307 INFO:teuthology.orchestra.run.smithi008.stdout: { 2023-08-01T19:56:07.307 INFO:teuthology.orchestra.run.smithi008.stdout: "event": "all_read", 2023-08-01T19:56:07.308 INFO:teuthology.orchestra.run.smithi008.stdout: "time": "2023-08-01T19:56:07.254283+0000", 2023-08-01T19:56:07.308 INFO:teuthology.orchestra.run.smithi008.stdout: "duration": 2.5600000000000001e-06 2023-08-01T19:56:07.308 INFO:teuthology.orchestra.run.smithi008.stdout: }, 2023-08-01T19:56:07.308 INFO:teuthology.orchestra.run.smithi008.stdout: { 2023-08-01T19:56:07.308 INFO:teuthology.orchestra.run.smithi008.stdout: "event": "dispatched", 2023-08-01T19:56:07.308 INFO:teuthology.orchestra.run.smithi008.stdout: "time": "2023-08-01T19:56:07.254288+0000", 2023-08-01T19:56:07.308 INFO:teuthology.orchestra.run.smithi008.stdout: "duration": 5.8409999999999996e-06 2023-08-01T19:56:07.308 INFO:teuthology.orchestra.run.smithi008.stdout: }, 2023-08-01T19:56:07.309 INFO:teuthology.orchestra.run.smithi008.stdout: { 2023-08-01T19:56:07.309 INFO:teuthology.orchestra.run.smithi008.stdout: "event": "queued_for_pg", 2023-08-01T19:56:07.309 INFO:teuthology.orchestra.run.smithi008.stdout: "time": "2023-08-01T19:56:07.254304+0000", 2023-08-01T19:56:07.309 INFO:teuthology.orchestra.run.smithi008.stdout: "duration": 1.6053999999999999e-05 2023-08-01T19:56:07.309 INFO:teuthology.orchestra.run.smithi008.stdout: }, 2023-08-01T19:56:07.309 INFO:teuthology.orchestra.run.smithi008.stdout: { 2023-08-01T19:56:07.309 INFO:teuthology.orchestra.run.smithi008.stdout: "event": "reached_pg", 2023-08-01T19:56:07.309 INFO:teuthology.orchestra.run.smithi008.stdout: "time": "2023-08-01T19:56:07.254353+0000", 2023-08-01T19:56:07.310 INFO:teuthology.orchestra.run.smithi008.stdout: "duration": 4.8702999999999998e-05 2023-08-01T19:56:07.310 INFO:teuthology.orchestra.run.smithi008.stdout: }, 2023-08-01T19:56:07.310 INFO:teuthology.orchestra.run.smithi008.stdout: { 2023-08-01T19:56:07.310 INFO:teuthology.orchestra.run.smithi008.stdout: "event": "started", 2023-08-01T19:56:07.310 INFO:teuthology.orchestra.run.smithi008.stdout: "time": "2023-08-01T19:56:07.254480+0000", 2023-08-01T19:56:07.310 INFO:teuthology.orchestra.run.smithi008.stdout: "duration": 0.00012696300000000001 2023-08-01T19:56:07.310 INFO:teuthology.orchestra.run.smithi008.stdout: } 2023-08-01T19:56:07.311 INFO:teuthology.orchestra.run.smithi008.stdout: ] 2023-08-01T19:56:07.311 INFO:teuthology.orchestra.run.smithi008.stdout: } 2023-08-01T19:56:07.311 INFO:teuthology.orchestra.run.smithi008.stdout: }, 2023-08-01T19:56:07.311 INFO:teuthology.orchestra.run.smithi008.stdout: { 2023-08-01T19:56:07.311 INFO:teuthology.orchestra.run.smithi008.stdout: "description": "osd_op(client.4668.0:213249 5.2 5:4086f44a:::benchmark_data_smithi006_114134_object79588:head [delete] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e66)", 2023-08-01T19:56:07.311 INFO:teuthology.orchestra.run.smithi008.stdout: "initiated_at": "2023-08-01T19:56:07.254321+0000", 2023-08-01T19:56:07.311 INFO:teuthology.orchestra.run.smithi008.stdout: "age": 0.0031591549999999999, 2023-08-01T19:56:07.311 INFO:teuthology.orchestra.run.smithi008.stdout: "duration": 0.0037790390000000001, 2023-08-01T19:56:07.312 INFO:teuthology.orchestra.run.smithi008.stdout: "type_data": { 2023-08-01T19:56:07.312 INFO:teuthology.orchestra.run.smithi008.stdout: "flag_point": "started", 2023-08-01T19:56:07.312 INFO:teuthology.orchestra.run.smithi008.stdout: "client_info": { 2023-08-01T19:56:07.312 INFO:teuthology.orchestra.run.smithi008.stdout: "client": "client.4668", 2023-08-01T19:56:07.312 INFO:teuthology.orchestra.run.smithi008.stdout: "client_addr": "172.21.15.6:0/1709472247", 2023-08-01T19:56:07.312 INFO:teuthology.orchestra.run.smithi008.stdout: "tid": 213249 2023-08-01T19:56:07.312 INFO:teuthology.orchestra.run.smithi008.stdout: }, 2023-08-01T19:56:07.313 INFO:teuthology.orchestra.run.smithi008.stdout: "events": [ 2023-08-01T19:56:07.313 INFO:teuthology.orchestra.run.smithi008.stdout: { 2023-08-01T19:56:07.313 INFO:teuthology.orchestra.run.smithi008.stdout: "event": "initiated", 2023-08-01T19:56:07.313 INFO:teuthology.orchestra.run.smithi008.stdout: "time": "2023-08-01T19:56:07.254321+0000", 2023-08-01T19:56:07.313 INFO:teuthology.orchestra.run.smithi008.stdout: "duration": 0 2023-08-01T19:56:07.313 INFO:teuthology.orchestra.run.smithi008.stdout: }, 2023-08-01T19:56:07.313 INFO:teuthology.orchestra.run.smithi008.stdout: { 2023-08-01T19:56:07.313 INFO:teuthology.orchestra.run.smithi008.stdout: "event": "throttled", 2023-08-01T19:56:07.314 INFO:teuthology.orchestra.run.smithi008.stdout: "time": "2023-08-01T19:56:07.254321+0000", 2023-08-01T19:56:07.314 INFO:teuthology.orchestra.run.smithi008.stdout: "duration": 0 2023-08-01T19:56:07.314 INFO:teuthology.orchestra.run.smithi008.stdout: }, 2023-08-01T19:56:07.314 INFO:teuthology.orchestra.run.smithi008.stdout: { 2023-08-01T19:56:07.314 INFO:teuthology.orchestra.run.smithi008.stdout: "event": "header_read", 2023-08-01T19:56:07.314 INFO:teuthology.orchestra.run.smithi008.stdout: "time": "2023-08-01T19:56:07.254320+0000", 2023-08-01T19:56:07.314 INFO:teuthology.orchestra.run.smithi008.stdout: "duration": 4294967295.9999995 2023-08-01T19:56:07.314 INFO:teuthology.orchestra.run.smithi008.stdout: }, 2023-08-01T19:56:07.315 INFO:teuthology.orchestra.run.smithi008.stdout: { 2023-08-01T19:56:07.315 INFO:teuthology.orchestra.run.smithi008.stdout: "event": "all_read", 2023-08-01T19:56:07.315 INFO:teuthology.orchestra.run.smithi008.stdout: "time": "2023-08-01T19:56:07.254324+0000", 2023-08-01T19:56:07.315 INFO:teuthology.orchestra.run.smithi008.stdout: "duration": 3.0979999999999998e-06 2023-08-01T19:56:07.315 INFO:teuthology.orchestra.run.smithi008.stdout: }, 2023-08-01T19:56:07.315 INFO:teuthology.orchestra.run.smithi008.stdout: { 2023-08-01T19:56:07.315 INFO:teuthology.orchestra.run.smithi008.stdout: "event": "dispatched", 2023-08-01T19:56:07.315 INFO:teuthology.orchestra.run.smithi008.stdout: "time": "2023-08-01T19:56:07.254330+0000", 2023-08-01T19:56:07.316 INFO:teuthology.orchestra.run.smithi008.stdout: "duration": 6.8349999999999998e-06 2023-08-01T19:56:07.316 INFO:teuthology.orchestra.run.smithi008.stdout: }, 2023-08-01T19:56:07.316 INFO:teuthology.orchestra.run.smithi008.stdout: { 2023-08-01T19:56:07.316 INFO:teuthology.orchestra.run.smithi008.stdout: "event": "queued_for_pg", 2023-08-01T19:56:07.316 INFO:teuthology.orchestra.run.smithi008.stdout: "time": "2023-08-01T19:56:07.254335+0000", 2023-08-01T19:56:07.316 INFO:teuthology.orchestra.run.smithi008.stdout: "duration": 4.1819999999999999e-06 2023-08-01T19:56:07.316 INFO:teuthology.orchestra.run.smithi008.stdout: }, 2023-08-01T19:56:07.317 INFO:teuthology.orchestra.run.smithi008.stdout: { 2023-08-01T19:56:07.317 INFO:teuthology.orchestra.run.smithi008.stdout: "event": "reached_pg", 2023-08-01T19:56:07.317 INFO:teuthology.orchestra.run.smithi008.stdout: "time": "2023-08-01T19:56:07.255678+0000", 2023-08-01T19:56:07.317 INFO:teuthology.orchestra.run.smithi008.stdout: "duration": 0.001343122 2023-08-01T19:56:07.317 INFO:teuthology.orchestra.run.smithi008.stdout: }, 2023-08-01T19:56:07.317 INFO:teuthology.orchestra.run.smithi008.stdout: { 2023-08-01T19:56:07.317 INFO:teuthology.orchestra.run.smithi008.stdout: "event": "started", 2023-08-01T19:56:07.317 INFO:teuthology.orchestra.run.smithi008.stdout: "time": "2023-08-01T19:56:07.255753+0000", 2023-08-01T19:56:07.318 INFO:teuthology.orchestra.run.smithi008.stdout: "duration": 7.5446999999999998e-05 2023-08-01T19:56:07.318 INFO:teuthology.orchestra.run.smithi008.stdout: } 2023-08-01T19:56:07.318 INFO:teuthology.orchestra.run.smithi008.stdout: ] 2023-08-01T19:56:07.318 INFO:teuthology.orchestra.run.smithi008.stdout: } 2023-08-01T19:56:07.318 INFO:teuthology.orchestra.run.smithi008.stdout: }, 2023-08-01T19:56:07.318 INFO:teuthology.orchestra.run.smithi008.stdout: { 2023-08-01T19:56:07.318 INFO:teuthology.orchestra.run.smithi008.stdout: "description": "osd_repop(client.4668.0:213246 5.e e66/19 5:759c6423:::benchmark_data_smithi006_114134_object79585:head v 66'13358, mlcod=66'13356)", 2023-08-01T19:56:07.318 INFO:teuthology.orchestra.run.smithi008.stdout: "initiated_at": "2023-08-01T19:56:07.254637+0000", 2023-08-01T19:56:07.319 INFO:teuthology.orchestra.run.smithi008.stdout: "age": 0.0028426720000000001, 2023-08-01T19:56:07.319 INFO:teuthology.orchestra.run.smithi008.stdout: "duration": 0.003534265, 2023-08-01T19:56:07.319 INFO:teuthology.orchestra.run.smithi008.stdout: "type_data": { 2023-08-01T19:56:07.319 INFO:teuthology.orchestra.run.smithi008.stdout: "flag_point": "started", 2023-08-01T19:56:07.319 INFO:teuthology.orchestra.run.smithi008.stdout: "events": [ 2023-08-01T19:56:07.319 INFO:teuthology.orchestra.run.smithi008.stdout: { 2023-08-01T19:56:07.319 INFO:teuthology.orchestra.run.smithi008.stdout: "event": "initiated", 2023-08-01T19:56:07.319 INFO:teuthology.orchestra.run.smithi008.stdout: "time": "2023-08-01T19:56:07.254637+0000", 2023-08-01T19:56:07.320 INFO:teuthology.orchestra.run.smithi008.stdout: "duration": 0 2023-08-01T19:56:07.320 INFO:teuthology.orchestra.run.smithi008.stdout: }, 2023-08-01T19:56:07.320 INFO:teuthology.orchestra.run.smithi008.stdout: { 2023-08-01T19:56:07.320 INFO:teuthology.orchestra.run.smithi008.stdout: "event": "throttled", 2023-08-01T19:56:07.320 INFO:teuthology.orchestra.run.smithi008.stdout: "time": "2023-08-01T19:56:07.254637+0000", 2023-08-01T19:56:07.320 INFO:teuthology.orchestra.run.smithi008.stdout: "duration": 0 2023-08-01T19:56:07.320 INFO:teuthology.orchestra.run.smithi008.stdout: }, 2023-08-01T19:56:07.320 INFO:teuthology.orchestra.run.smithi008.stdout: { 2023-08-01T19:56:07.321 INFO:teuthology.orchestra.run.smithi008.stdout: "event": "header_read", 2023-08-01T19:56:07.321 INFO:teuthology.orchestra.run.smithi008.stdout: "time": "2023-08-01T19:56:07.254637+0000", 2023-08-01T19:56:07.321 INFO:teuthology.orchestra.run.smithi008.stdout: "duration": 4294967295.9999995 2023-08-01T19:56:07.321 INFO:teuthology.orchestra.run.smithi008.stdout: }, 2023-08-01T19:56:07.321 INFO:teuthology.orchestra.run.smithi008.stdout: { 2023-08-01T19:56:07.321 INFO:teuthology.orchestra.run.smithi008.stdout: "event": "all_read", 2023-08-01T19:56:07.321 INFO:teuthology.orchestra.run.smithi008.stdout: "time": "2023-08-01T19:56:07.254643+0000", 2023-08-01T19:56:07.321 INFO:teuthology.orchestra.run.smithi008.stdout: "duration": 6.2500000000000003e-06 2023-08-01T19:56:07.322 INFO:teuthology.orchestra.run.smithi008.stdout: }, 2023-08-01T19:56:07.322 INFO:teuthology.orchestra.run.smithi008.stdout: { 2023-08-01T19:56:07.322 INFO:teuthology.orchestra.run.smithi008.stdout: "event": "dispatched", 2023-08-01T19:56:07.322 INFO:teuthology.orchestra.run.smithi008.stdout: "time": "2023-08-01T19:56:07.254653+0000", 2023-08-01T19:56:07.322 INFO:teuthology.orchestra.run.smithi008.stdout: "duration": 9.7510000000000003e-06 2023-08-01T19:56:07.322 INFO:teuthology.orchestra.run.smithi008.stdout: }, 2023-08-01T19:56:07.322 INFO:teuthology.orchestra.run.smithi008.stdout: { 2023-08-01T19:56:07.323 INFO:teuthology.orchestra.run.smithi008.stdout: "event": "queued_for_pg", 2023-08-01T19:56:07.323 INFO:teuthology.orchestra.run.smithi008.stdout: "time": "2023-08-01T19:56:07.254658+0000", 2023-08-01T19:56:07.323 INFO:teuthology.orchestra.run.smithi008.stdout: "duration": 5.2859999999999999e-06 2023-08-01T19:56:07.323 INFO:teuthology.orchestra.run.smithi008.stdout: }, 2023-08-01T19:56:07.323 INFO:teuthology.orchestra.run.smithi008.stdout: { 2023-08-01T19:56:07.323 INFO:teuthology.orchestra.run.smithi008.stdout: "event": "reached_pg", 2023-08-01T19:56:07.323 INFO:teuthology.orchestra.run.smithi008.stdout: "time": "2023-08-01T19:56:07.254694+0000", 2023-08-01T19:56:07.323 INFO:teuthology.orchestra.run.smithi008.stdout: "duration": 3.6006000000000001e-05 2023-08-01T19:56:07.324 INFO:teuthology.orchestra.run.smithi008.stdout: }, 2023-08-01T19:56:07.324 INFO:teuthology.orchestra.run.smithi008.stdout: { 2023-08-01T19:56:07.324 INFO:teuthology.orchestra.run.smithi008.stdout: "event": "started", 2023-08-01T19:56:07.324 INFO:teuthology.orchestra.run.smithi008.stdout: "time": "2023-08-01T19:56:07.254712+0000", 2023-08-01T19:56:07.324 INFO:teuthology.orchestra.run.smithi008.stdout: "duration": 1.8012999999999998e-05 2023-08-01T19:56:07.324 INFO:teuthology.orchestra.run.smithi008.stdout: } 2023-08-01T19:56:07.324 INFO:teuthology.orchestra.run.smithi008.stdout: ] 2023-08-01T19:56:07.324 INFO:teuthology.orchestra.run.smithi008.stdout: } 2023-08-01T19:56:07.325 INFO:teuthology.orchestra.run.smithi008.stdout: }, 2023-08-01T19:56:07.325 INFO:teuthology.orchestra.run.smithi008.stdout: { 2023-08-01T19:56:07.325 INFO:teuthology.orchestra.run.smithi008.stdout: "description": "osd_op(client.4668.0:213253 5.1 5:8f3d18a4:::benchmark_data_smithi006_114134_object79592:head [delete] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e66)", 2023-08-01T19:56:07.325 INFO:teuthology.orchestra.run.smithi008.stdout: "initiated_at": "2023-08-01T19:56:07.257332+0000", 2023-08-01T19:56:07.325 INFO:teuthology.orchestra.run.smithi008.stdout: "age": 0.000147763, 2023-08-01T19:56:07.325 INFO:teuthology.orchestra.run.smithi008.stdout: "duration": 0.00090506600000000005, 2023-08-01T19:56:07.325 INFO:teuthology.orchestra.run.smithi008.stdout: "type_data": { 2023-08-01T19:56:07.325 INFO:teuthology.orchestra.run.smithi008.stdout: "flag_point": "started", 2023-08-01T19:56:07.326 INFO:teuthology.orchestra.run.smithi008.stdout: "client_info": { 2023-08-01T19:56:07.326 INFO:teuthology.orchestra.run.smithi008.stdout: "client": "client.4668", 2023-08-01T19:56:07.326 INFO:teuthology.orchestra.run.smithi008.stdout: "client_addr": "172.21.15.6:0/1709472247", 2023-08-01T19:56:07.326 INFO:teuthology.orchestra.run.smithi008.stdout: "tid": 213253 2023-08-01T19:56:07.326 INFO:teuthology.orchestra.run.smithi008.stdout: }, 2023-08-01T19:56:07.326 INFO:teuthology.orchestra.run.smithi008.stdout: "events": [ 2023-08-01T19:56:07.326 INFO:teuthology.orchestra.run.smithi008.stdout: { 2023-08-01T19:56:07.326 INFO:teuthology.orchestra.run.smithi008.stdout: "event": "initiated", 2023-08-01T19:56:07.327 INFO:teuthology.orchestra.run.smithi008.stdout: "time": "2023-08-01T19:56:07.257332+0000", 2023-08-01T19:56:07.327 INFO:teuthology.orchestra.run.smithi008.stdout: "duration": 0 2023-08-01T19:56:07.327 INFO:teuthology.orchestra.run.smithi008.stdout: }, 2023-08-01T19:56:07.327 INFO:teuthology.orchestra.run.smithi008.stdout: { 2023-08-01T19:56:07.327 INFO:teuthology.orchestra.run.smithi008.stdout: "event": "throttled", 2023-08-01T19:56:07.327 INFO:teuthology.orchestra.run.smithi008.stdout: "time": "2023-08-01T19:56:07.257332+0000", 2023-08-01T19:56:07.327 INFO:teuthology.orchestra.run.smithi008.stdout: "duration": 0 2023-08-01T19:56:07.327 INFO:teuthology.orchestra.run.smithi008.stdout: }, 2023-08-01T19:56:07.328 INFO:teuthology.orchestra.run.smithi008.stdout: { 2023-08-01T19:56:07.328 INFO:teuthology.orchestra.run.smithi008.stdout: "event": "header_read", 2023-08-01T19:56:07.328 INFO:teuthology.orchestra.run.smithi008.stdout: "time": "2023-08-01T19:56:07.257332+0000", 2023-08-01T19:56:07.328 INFO:teuthology.orchestra.run.smithi008.stdout: "duration": 4294967295.999999 2023-08-01T19:56:07.328 INFO:teuthology.orchestra.run.smithi008.stdout: }, 2023-08-01T19:56:07.328 INFO:teuthology.orchestra.run.smithi008.stdout: { 2023-08-01T19:56:07.328 INFO:teuthology.orchestra.run.smithi008.stdout: "event": "all_read", 2023-08-01T19:56:07.329 INFO:teuthology.orchestra.run.smithi008.stdout: "time": "2023-08-01T19:56:07.257337+0000", 2023-08-01T19:56:07.329 INFO:teuthology.orchestra.run.smithi008.stdout: "duration": 5.789e-06 2023-08-01T19:56:07.329 INFO:teuthology.orchestra.run.smithi008.stdout: }, 2023-08-01T19:56:07.329 INFO:teuthology.orchestra.run.smithi008.stdout: { 2023-08-01T19:56:07.329 INFO:teuthology.orchestra.run.smithi008.stdout: "event": "dispatched", 2023-08-01T19:56:07.329 INFO:teuthology.orchestra.run.smithi008.stdout: "time": "2023-08-01T19:56:07.257353+0000", 2023-08-01T19:56:07.329 INFO:teuthology.orchestra.run.smithi008.stdout: "duration": 1.6107e-05 2023-08-01T19:56:07.329 INFO:teuthology.orchestra.run.smithi008.stdout: }, 2023-08-01T19:56:07.330 INFO:teuthology.orchestra.run.smithi008.stdout: { 2023-08-01T19:56:07.330 INFO:teuthology.orchestra.run.smithi008.stdout: "event": "queued_for_pg", 2023-08-01T19:56:07.330 INFO:teuthology.orchestra.run.smithi008.stdout: "time": "2023-08-01T19:56:07.257360+0000", 2023-08-01T19:56:07.330 INFO:teuthology.orchestra.run.smithi008.stdout: "duration": 6.1120000000000001e-06 2023-08-01T19:56:07.330 INFO:teuthology.orchestra.run.smithi008.stdout: }, 2023-08-01T19:56:07.330 INFO:teuthology.orchestra.run.smithi008.stdout: { 2023-08-01T19:56:07.330 INFO:teuthology.orchestra.run.smithi008.stdout: "event": "reached_pg", 2023-08-01T19:56:07.330 INFO:teuthology.orchestra.run.smithi008.stdout: "time": "2023-08-01T19:56:07.257400+0000", 2023-08-01T19:56:07.331 INFO:teuthology.orchestra.run.smithi008.stdout: "duration": 4.0451000000000003e-05 2023-08-01T19:56:07.331 INFO:teuthology.orchestra.run.smithi008.stdout: }, 2023-08-01T19:56:07.331 INFO:teuthology.orchestra.run.smithi008.stdout: { 2023-08-01T19:56:07.331 INFO:teuthology.orchestra.run.smithi008.stdout: "event": "started", 2023-08-01T19:56:07.331 INFO:teuthology.orchestra.run.smithi008.stdout: "time": "2023-08-01T19:56:07.257526+0000", 2023-08-01T19:56:07.331 INFO:teuthology.orchestra.run.smithi008.stdout: "duration": 0.000126169 2023-08-01T19:56:07.331 INFO:teuthology.orchestra.run.smithi008.stdout: } 2023-08-01T19:56:07.331 INFO:teuthology.orchestra.run.smithi008.stdout: ] 2023-08-01T19:56:07.332 INFO:teuthology.orchestra.run.smithi008.stdout: } 2023-08-01T19:56:07.332 INFO:teuthology.orchestra.run.smithi008.stdout: }, 2023-08-01T19:56:07.332 INFO:teuthology.orchestra.run.smithi008.stdout: { 2023-08-01T19:56:07.332 INFO:teuthology.orchestra.run.smithi008.stdout: "description": "osd_op(client.4668.0:213255 5.2 5:4f5618cb:::benchmark_data_smithi006_114134_object79594:head [delete] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e66)", 2023-08-01T19:56:07.332 INFO:teuthology.orchestra.run.smithi008.stdout: "initiated_at": "2023-08-01T19:56:07.257432+0000", 2023-08-01T19:56:07.332 INFO:teuthology.orchestra.run.smithi008.stdout: "age": 4.8229999999999997e-05, 2023-08-01T19:56:07.332 INFO:teuthology.orchestra.run.smithi008.stdout: "duration": 0.00088109699999999996, 2023-08-01T19:56:07.332 INFO:teuthology.orchestra.run.smithi008.stdout: "type_data": { 2023-08-01T19:56:07.333 INFO:teuthology.orchestra.run.smithi008.stdout: "flag_point": "started", 2023-08-01T19:56:07.333 INFO:teuthology.orchestra.run.smithi008.stdout: "client_info": { 2023-08-01T19:56:07.333 INFO:teuthology.orchestra.run.smithi008.stdout: "client": "client.4668", 2023-08-01T19:56:07.333 INFO:teuthology.orchestra.run.smithi008.stdout: "client_addr": "172.21.15.6:0/1709472247", 2023-08-01T19:56:07.333 INFO:teuthology.orchestra.run.smithi008.stdout: "tid": 213255 2023-08-01T19:56:07.333 INFO:teuthology.orchestra.run.smithi008.stdout: }, 2023-08-01T19:56:07.333 INFO:teuthology.orchestra.run.smithi008.stdout: "events": [ 2023-08-01T19:56:07.334 INFO:teuthology.orchestra.run.smithi008.stdout: { 2023-08-01T19:56:07.334 INFO:teuthology.orchestra.run.smithi008.stdout: "event": "initiated", 2023-08-01T19:56:07.334 INFO:teuthology.orchestra.run.smithi008.stdout: "time": "2023-08-01T19:56:07.257432+0000", 2023-08-01T19:56:07.334 INFO:teuthology.orchestra.run.smithi008.stdout: "duration": 0 2023-08-01T19:56:07.334 INFO:teuthology.orchestra.run.smithi008.stdout: }, 2023-08-01T19:56:07.334 INFO:teuthology.orchestra.run.smithi008.stdout: { 2023-08-01T19:56:07.334 INFO:teuthology.orchestra.run.smithi008.stdout: "event": "throttled", 2023-08-01T19:56:07.334 INFO:teuthology.orchestra.run.smithi008.stdout: "time": "2023-08-01T19:56:07.257432+0000", 2023-08-01T19:56:07.335 INFO:teuthology.orchestra.run.smithi008.stdout: "duration": 0 2023-08-01T19:56:07.335 INFO:teuthology.orchestra.run.smithi008.stdout: }, 2023-08-01T19:56:07.335 INFO:teuthology.orchestra.run.smithi008.stdout: { 2023-08-01T19:56:07.335 INFO:teuthology.orchestra.run.smithi008.stdout: "event": "header_read", 2023-08-01T19:56:07.335 INFO:teuthology.orchestra.run.smithi008.stdout: "time": "2023-08-01T19:56:07.257431+0000", 2023-08-01T19:56:07.335 INFO:teuthology.orchestra.run.smithi008.stdout: "duration": 4294967295.9999995 2023-08-01T19:56:07.335 INFO:teuthology.orchestra.run.smithi008.stdout: }, 2023-08-01T19:56:07.335 INFO:teuthology.orchestra.run.smithi008.stdout: { 2023-08-01T19:56:07.336 INFO:teuthology.orchestra.run.smithi008.stdout: "event": "all_read", 2023-08-01T19:56:07.336 INFO:teuthology.orchestra.run.smithi008.stdout: "time": "2023-08-01T19:56:07.257435+0000", 2023-08-01T19:56:07.336 INFO:teuthology.orchestra.run.smithi008.stdout: "duration": 3.5669999999999999e-06 2023-08-01T19:56:07.336 INFO:teuthology.orchestra.run.smithi008.stdout: }, 2023-08-01T19:56:07.336 INFO:teuthology.orchestra.run.smithi008.stdout: { 2023-08-01T19:56:07.336 INFO:teuthology.orchestra.run.smithi008.stdout: "event": "dispatched", 2023-08-01T19:56:07.336 INFO:teuthology.orchestra.run.smithi008.stdout: "time": "2023-08-01T19:56:07.257442+0000", 2023-08-01T19:56:07.336 INFO:teuthology.orchestra.run.smithi008.stdout: "duration": 7.4229999999999999e-06 2023-08-01T19:56:07.337 INFO:teuthology.orchestra.run.smithi008.stdout: }, 2023-08-01T19:56:07.337 INFO:teuthology.orchestra.run.smithi008.stdout: { 2023-08-01T19:56:07.337 INFO:teuthology.orchestra.run.smithi008.stdout: "event": "queued_for_pg", 2023-08-01T19:56:07.337 INFO:teuthology.orchestra.run.smithi008.stdout: "time": "2023-08-01T19:56:07.257447+0000", 2023-08-01T19:56:07.337 INFO:teuthology.orchestra.run.smithi008.stdout: "duration": 4.5379999999999996e-06 2023-08-01T19:56:07.337 INFO:teuthology.orchestra.run.smithi008.stdout: }, 2023-08-01T19:56:07.337 INFO:teuthology.orchestra.run.smithi008.stdout: { 2023-08-01T19:56:07.338 INFO:teuthology.orchestra.run.smithi008.stdout: "event": "reached_pg", 2023-08-01T19:56:07.338 INFO:teuthology.orchestra.run.smithi008.stdout: "time": "2023-08-01T19:56:07.257491+0000", 2023-08-01T19:56:07.338 INFO:teuthology.orchestra.run.smithi008.stdout: "duration": 4.4147999999999998e-05 2023-08-01T19:56:07.338 INFO:teuthology.orchestra.run.smithi008.stdout: }, 2023-08-01T19:56:07.338 INFO:teuthology.orchestra.run.smithi008.stdout: { 2023-08-01T19:56:07.338 INFO:teuthology.orchestra.run.smithi008.stdout: "event": "started", 2023-08-01T19:56:07.338 INFO:teuthology.orchestra.run.smithi008.stdout: "time": "2023-08-01T19:56:07.257620+0000", 2023-08-01T19:56:07.338 INFO:teuthology.orchestra.run.smithi008.stdout: "duration": 0.00012864199999999999 2023-08-01T19:56:07.339 INFO:teuthology.orchestra.run.smithi008.stdout: } 2023-08-01T19:56:07.339 INFO:teuthology.orchestra.run.smithi008.stdout: ] 2023-08-01T19:56:07.339 INFO:teuthology.orchestra.run.smithi008.stdout: } 2023-08-01T19:56:07.339 INFO:teuthology.orchestra.run.smithi008.stdout: } 2023-08-01T19:56:07.339 INFO:teuthology.orchestra.run.smithi008.stdout: ], 2023-08-01T19:56:07.339 INFO:teuthology.orchestra.run.smithi008.stdout: "num_ops": 12 2023-08-01T19:56:07.339 INFO:teuthology.orchestra.run.smithi008.stdout:} 2023-08-01T19:56:07.341 DEBUG:teuthology.orchestra.run.smithi008:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 30 ceph --cluster ceph --admin-daemon /var/run/ceph/ceph-osd.0.asok dump_blocked_ops 2023-08-01T19:56:07.341 INFO:tasks.ceph.osd.0.smithi008.stderr:2023-08-01T19:56:07.338+0000 7f16a58f4700 -1 received signal: Hangup from /usr/bin/python3 /bin/daemon-helper kill ceph-osd -f --cluster ceph -i 0 (PID: 111179) UID: 0 2023-08-01T19:56:07.441 INFO:tasks.ceph.osd.0.smithi008.stderr:2023-08-01T19:56:07.439+0000 7f16a58f4700 -1 received signal: Hangup from /usr/bin/python3 /bin/daemon-helper kill ceph-osd -f --cluster ceph -i 0 (PID: 111179) UID: 0 2023-08-01T19:56:07.542 INFO:tasks.ceph.osd.2.smithi155.stderr:2023-08-01T19:56:07.540+0000 7faa5c6ac700 -1 received signal: Hangup from /usr/bin/python3 /bin/daemon-helper kill ceph-osd -f --cluster ceph -i 2 (PID: 111337) UID: 0 2023-08-01T19:56:07.566 INFO:teuthology.orchestra.run.smithi008.stdout:{ 2023-08-01T19:56:07.567 INFO:teuthology.orchestra.run.smithi008.stdout: "ops": [], 2023-08-01T19:56:07.567 INFO:teuthology.orchestra.run.smithi008.stdout: "complaint_time": 30, 2023-08-01T19:56:07.567 INFO:teuthology.orchestra.run.smithi008.stdout: "num_blocked_ops": 0 2023-08-01T19:56:07.567 INFO:teuthology.orchestra.run.smithi008.stdout:} 2023-08-01T19:56:07.578 DEBUG:teuthology.orchestra.run.smithi008:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 30 ceph --cluster ceph --admin-daemon /var/run/ceph/ceph-osd.0.asok dump_historic_ops 2023-08-01T19:56:07.643 INFO:tasks.ceph.osd.2.smithi155.stderr:2023-08-01T19:56:07.641+0000 7faa5c6ac700 -1 received signal: Hangup from /usr/bin/python3 /bin/daemon-helper kill ceph-osd -f --cluster ceph -i 2 (PID: 111337) UID: 0 2023-08-01T19:56:07.743 INFO:tasks.ceph.osd.2.smithi155.stderr:2023-08-01T19:56:07.741+0000 7faa5c6ac700 -1 received signal: Hangup from /usr/bin/python3 /bin/daemon-helper kill ceph-osd -f --cluster ceph -i 2 (PID: 111337) UID: 0 2023-08-01T19:56:07.810 INFO:teuthology.orchestra.run.smithi008.stdout:{ 2023-08-01T19:56:07.811 INFO:teuthology.orchestra.run.smithi008.stdout: "size": 20, 2023-08-01T19:56:07.811 INFO:teuthology.orchestra.run.smithi008.stdout: "duration": 600, 2023-08-01T19:56:07.811 INFO:teuthology.orchestra.run.smithi008.stdout: "ops": [ 2023-08-01T19:56:07.811 INFO:teuthology.orchestra.run.smithi008.stdout: { 2023-08-01T19:56:07.811 INFO:teuthology.orchestra.run.smithi008.stdout: "description": "osd_op(client.4668.0:100240 5.a 5:5313c5b9:::benchmark_data_smithi006_114134_object100239:head [set-alloc-hint object_size 65536 write_size 65536,write 0~65536] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e37)", 2023-08-01T19:56:07.811 INFO:teuthology.orchestra.run.smithi008.stdout: "initiated_at": "2023-08-01T19:55:05.148399+0000", 2023-08-01T19:56:07.811 INFO:teuthology.orchestra.run.smithi008.stdout: "age": 62.658345576000002, 2023-08-01T19:56:07.812 INFO:teuthology.orchestra.run.smithi008.stdout: "duration": 0.077278904999999995, 2023-08-01T19:56:07.812 INFO:teuthology.orchestra.run.smithi008.stdout: "type_data": { 2023-08-01T19:56:07.812 INFO:teuthology.orchestra.run.smithi008.stdout: "flag_point": "commit sent; apply or cleanup", 2023-08-01T19:56:07.812 INFO:teuthology.orchestra.run.smithi008.stdout: "client_info": { 2023-08-01T19:56:07.812 INFO:teuthology.orchestra.run.smithi008.stdout: "client": "client.4668", 2023-08-01T19:56:07.812 INFO:teuthology.orchestra.run.smithi008.stdout: "client_addr": "172.21.15.6:0/1709472247", 2023-08-01T19:56:07.812 INFO:teuthology.orchestra.run.smithi008.stdout: "tid": 100240 2023-08-01T19:56:07.812 INFO:teuthology.orchestra.run.smithi008.stdout: }, 2023-08-01T19:56:07.813 INFO:teuthology.orchestra.run.smithi008.stdout: "events": [ 2023-08-01T19:56:07.813 INFO:teuthology.orchestra.run.smithi008.stdout: { 2023-08-01T19:56:07.813 INFO:teuthology.orchestra.run.smithi008.stdout: "event": "initiated", 2023-08-01T19:56:07.813 INFO:teuthology.orchestra.run.smithi008.stdout: "time": "2023-08-01T19:55:05.148399+0000", 2023-08-01T19:56:07.813 INFO:teuthology.orchestra.run.smithi008.stdout: "duration": 0 2023-08-01T19:56:07.813 INFO:teuthology.orchestra.run.smithi008.stdout: }, 2023-08-01T19:56:07.813 INFO:teuthology.orchestra.run.smithi008.stdout: { 2023-08-01T19:56:07.813 INFO:teuthology.orchestra.run.smithi008.stdout: "event": "throttled", 2023-08-01T19:56:07.814 INFO:teuthology.orchestra.run.smithi008.stdout: "time": "2023-08-01T19:55:05.148399+0000", 2023-08-01T19:56:07.814 INFO:teuthology.orchestra.run.smithi008.stdout: "duration": 0 2023-08-01T19:56:07.814 INFO:teuthology.orchestra.run.smithi008.stdout: }, 2023-08-01T19:56:07.814 INFO:teuthology.orchestra.run.smithi008.stdout: { 2023-08-01T19:56:07.814 INFO:teuthology.orchestra.run.smithi008.stdout: "event": "header_read", 2023-08-01T19:56:07.814 INFO:teuthology.orchestra.run.smithi008.stdout: "time": "2023-08-01T19:55:05.148398+0000", 2023-08-01T19:56:07.815 INFO:teuthology.orchestra.run.smithi008.stdout: "duration": 4294967295.999999 2023-08-01T19:56:07.815 INFO:teuthology.orchestra.run.smithi008.stdout: }, 2023-08-01T19:56:07.815 INFO:teuthology.orchestra.run.smithi008.stdout: { 2023-08-01T19:56:07.815 INFO:teuthology.orchestra.run.smithi008.stdout: "event": "all_read", 2023-08-01T19:56:07.815 INFO:teuthology.orchestra.run.smithi008.stdout: "time": "2023-08-01T19:55:05.148492+0000", 2023-08-01T19:56:07.815 INFO:teuthology.orchestra.run.smithi008.stdout: "duration": 9.3892000000000002e-05 2023-08-01T19:56:07.815 INFO:teuthology.orchestra.run.smithi008.stdout: }, 2023-08-01T19:56:07.816 INFO:teuthology.orchestra.run.smithi008.stdout: { 2023-08-01T19:56:07.816 INFO:teuthology.orchestra.run.smithi008.stdout: "event": "dispatched", 2023-08-01T19:56:07.816 INFO:teuthology.orchestra.run.smithi008.stdout: "time": "2023-08-01T19:55:05.148503+0000", 2023-08-01T19:56:07.816 INFO:teuthology.orchestra.run.smithi008.stdout: "duration": 1.0951000000000001e-05 2023-08-01T19:56:07.816 INFO:teuthology.orchestra.run.smithi008.stdout: }, 2023-08-01T19:56:07.816 INFO:teuthology.orchestra.run.smithi008.stdout: { 2023-08-01T19:56:07.816 INFO:teuthology.orchestra.run.smithi008.stdout: "event": "queued_for_pg", 2023-08-01T19:56:07.816 INFO:teuthology.orchestra.run.smithi008.stdout: "time": "2023-08-01T19:55:05.148508+0000", 2023-08-01T19:56:07.817 INFO:teuthology.orchestra.run.smithi008.stdout: "duration": 5.0080000000000002e-06 2023-08-01T19:56:07.817 INFO:teuthology.orchestra.run.smithi008.stdout: }, 2023-08-01T19:56:07.817 INFO:teuthology.orchestra.run.smithi008.stdout: { 2023-08-01T19:56:07.817 INFO:teuthology.orchestra.run.smithi008.stdout: "event": "reached_pg", 2023-08-01T19:56:07.817 INFO:teuthology.orchestra.run.smithi008.stdout: "time": "2023-08-01T19:55:05.148548+0000", 2023-08-01T19:56:07.817 INFO:teuthology.orchestra.run.smithi008.stdout: "duration": 4.0358999999999998e-05 2023-08-01T19:56:07.817 INFO:teuthology.orchestra.run.smithi008.stdout: }, 2023-08-01T19:56:07.817 INFO:teuthology.orchestra.run.smithi008.stdout: { 2023-08-01T19:56:07.818 INFO:teuthology.orchestra.run.smithi008.stdout: "event": "started", 2023-08-01T19:56:07.818 INFO:teuthology.orchestra.run.smithi008.stdout: "time": "2023-08-01T19:55:05.148666+0000", 2023-08-01T19:56:07.818 INFO:teuthology.orchestra.run.smithi008.stdout: "duration": 0.000117621 2023-08-01T19:56:07.818 INFO:teuthology.orchestra.run.smithi008.stdout: }, 2023-08-01T19:56:07.818 INFO:teuthology.orchestra.run.smithi008.stdout: { 2023-08-01T19:56:07.818 INFO:teuthology.orchestra.run.smithi008.stdout: "event": "waiting for subops from 2", 2023-08-01T19:56:07.818 INFO:teuthology.orchestra.run.smithi008.stdout: "time": "2023-08-01T19:55:05.148805+0000", 2023-08-01T19:56:07.819 INFO:teuthology.orchestra.run.smithi008.stdout: "duration": 0.000139176 2023-08-01T19:56:07.819 INFO:teuthology.orchestra.run.smithi008.stdout: }, 2023-08-01T19:56:07.819 INFO:teuthology.orchestra.run.smithi008.stdout: { 2023-08-01T19:56:07.819 INFO:teuthology.orchestra.run.smithi008.stdout: "event": "op_commit", 2023-08-01T19:56:07.819 INFO:teuthology.orchestra.run.smithi008.stdout: "time": "2023-08-01T19:55:05.156143+0000", 2023-08-01T19:56:07.819 INFO:teuthology.orchestra.run.smithi008.stdout: "duration": 0.007338041 2023-08-01T19:56:07.819 INFO:teuthology.orchestra.run.smithi008.stdout: }, 2023-08-01T19:56:07.819 INFO:teuthology.orchestra.run.smithi008.stdout: { 2023-08-01T19:56:07.820 INFO:teuthology.orchestra.run.smithi008.stdout: "event": "sub_op_commit_rec", 2023-08-01T19:56:07.820 INFO:teuthology.orchestra.run.smithi008.stdout: "time": "2023-08-01T19:55:05.225581+0000", 2023-08-01T19:56:07.820 INFO:teuthology.orchestra.run.smithi008.stdout: "duration": 0.069438402999999996 2023-08-01T19:56:07.820 INFO:teuthology.orchestra.run.smithi008.stdout: }, 2023-08-01T19:56:07.820 INFO:teuthology.orchestra.run.smithi008.stdout: { 2023-08-01T19:56:07.820 INFO:teuthology.orchestra.run.smithi008.stdout: "event": "commit_sent", 2023-08-01T19:56:07.820 INFO:teuthology.orchestra.run.smithi008.stdout: "time": "2023-08-01T19:55:05.225632+0000", 2023-08-01T19:56:07.820 INFO:teuthology.orchestra.run.smithi008.stdout: "duration": 5.0382e-05 2023-08-01T19:56:07.821 INFO:teuthology.orchestra.run.smithi008.stdout: }, 2023-08-01T19:56:07.821 INFO:teuthology.orchestra.run.smithi008.stdout: { 2023-08-01T19:56:07.821 INFO:teuthology.orchestra.run.smithi008.stdout: "event": "done", 2023-08-01T19:56:07.821 INFO:teuthology.orchestra.run.smithi008.stdout: "time": "2023-08-01T19:55:05.225677+0000", 2023-08-01T19:56:07.821 INFO:teuthology.orchestra.run.smithi008.stdout: "duration": 4.5893000000000003e-05 2023-08-01T19:56:07.821 INFO:teuthology.orchestra.run.smithi008.stdout: } 2023-08-01T19:56:07.821 INFO:teuthology.orchestra.run.smithi008.stdout: ] 2023-08-01T19:56:07.821 INFO:teuthology.orchestra.run.smithi008.stdout: } 2023-08-01T19:56:07.822 INFO:teuthology.orchestra.run.smithi008.stdout: }, 2023-08-01T19:56:07.822 INFO:teuthology.orchestra.run.smithi008.stdout: { 2023-08-01T19:56:07.822 INFO:teuthology.orchestra.run.smithi008.stdout: "description": "osd_op(client.4668.0:100243 5.a 5:5e8193b6:::benchmark_data_smithi006_114134_object100242:head [set-alloc-hint object_size 65536 write_size 65536,write 0~65536] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e37)", 2023-08-01T19:56:07.822 INFO:teuthology.orchestra.run.smithi008.stdout: "initiated_at": "2023-08-01T19:55:05.150737+0000", 2023-08-01T19:56:07.822 INFO:teuthology.orchestra.run.smithi008.stdout: "age": 62.656007121000002, 2023-08-01T19:56:07.822 INFO:teuthology.orchestra.run.smithi008.stdout: "duration": 0.075019885999999994, 2023-08-01T19:56:07.822 INFO:teuthology.orchestra.run.smithi008.stdout: "type_data": { 2023-08-01T19:56:07.823 INFO:teuthology.orchestra.run.smithi008.stdout: "flag_point": "commit sent; apply or cleanup", 2023-08-01T19:56:07.823 INFO:teuthology.orchestra.run.smithi008.stdout: "client_info": { 2023-08-01T19:56:07.823 INFO:teuthology.orchestra.run.smithi008.stdout: "client": "client.4668", 2023-08-01T19:56:07.823 INFO:teuthology.orchestra.run.smithi008.stdout: "client_addr": "172.21.15.6:0/1709472247", 2023-08-01T19:56:07.823 INFO:teuthology.orchestra.run.smithi008.stdout: "tid": 100243 2023-08-01T19:56:07.823 INFO:teuthology.orchestra.run.smithi008.stdout: }, 2023-08-01T19:56:07.823 INFO:teuthology.orchestra.run.smithi008.stdout: "events": [ 2023-08-01T19:56:07.823 INFO:teuthology.orchestra.run.smithi008.stdout: { 2023-08-01T19:56:07.824 INFO:teuthology.orchestra.run.smithi008.stdout: "event": "initiated", 2023-08-01T19:56:07.824 INFO:teuthology.orchestra.run.smithi008.stdout: "time": "2023-08-01T19:55:05.150737+0000", 2023-08-01T19:56:07.824 INFO:teuthology.orchestra.run.smithi008.stdout: "duration": 0 2023-08-01T19:56:07.824 INFO:teuthology.orchestra.run.smithi008.stdout: }, 2023-08-01T19:56:07.824 INFO:teuthology.orchestra.run.smithi008.stdout: { 2023-08-01T19:56:07.824 INFO:teuthology.orchestra.run.smithi008.stdout: "event": "throttled", 2023-08-01T19:56:07.824 INFO:teuthology.orchestra.run.smithi008.stdout: "time": "2023-08-01T19:55:05.150737+0000", 2023-08-01T19:56:07.824 INFO:teuthology.orchestra.run.smithi008.stdout: "duration": 0 2023-08-01T19:56:07.825 INFO:teuthology.orchestra.run.smithi008.stdout: }, 2023-08-01T19:56:07.825 INFO:teuthology.orchestra.run.smithi008.stdout: { 2023-08-01T19:56:07.825 INFO:teuthology.orchestra.run.smithi008.stdout: "event": "header_read", 2023-08-01T19:56:07.825 INFO:teuthology.orchestra.run.smithi008.stdout: "time": "2023-08-01T19:55:05.150736+0000", 2023-08-01T19:56:07.825 INFO:teuthology.orchestra.run.smithi008.stdout: "duration": 4294967295.999999 2023-08-01T19:56:07.825 INFO:teuthology.orchestra.run.smithi008.stdout: }, 2023-08-01T19:56:07.825 INFO:teuthology.orchestra.run.smithi008.stdout: { 2023-08-01T19:56:07.826 INFO:teuthology.orchestra.run.smithi008.stdout: "event": "all_read", 2023-08-01T19:56:07.826 INFO:teuthology.orchestra.run.smithi008.stdout: "time": "2023-08-01T19:55:05.150780+0000", 2023-08-01T19:56:07.826 INFO:teuthology.orchestra.run.smithi008.stdout: "duration": 4.3578999999999997e-05 2023-08-01T19:56:07.826 INFO:teuthology.orchestra.run.smithi008.stdout: }, 2023-08-01T19:56:07.826 INFO:teuthology.orchestra.run.smithi008.stdout: { 2023-08-01T19:56:07.826 INFO:teuthology.orchestra.run.smithi008.stdout: "event": "dispatched", 2023-08-01T19:56:07.826 INFO:teuthology.orchestra.run.smithi008.stdout: "time": "2023-08-01T19:55:05.150791+0000", 2023-08-01T19:56:07.826 INFO:teuthology.orchestra.run.smithi008.stdout: "duration": 1.0963e-05 2023-08-01T19:56:07.827 INFO:teuthology.orchestra.run.smithi008.stdout: }, 2023-08-01T19:56:07.827 INFO:teuthology.orchestra.run.smithi008.stdout: { 2023-08-01T19:56:07.827 INFO:teuthology.orchestra.run.smithi008.stdout: "event": "queued_for_pg", 2023-08-01T19:56:07.827 INFO:teuthology.orchestra.run.smithi008.stdout: "time": "2023-08-01T19:55:05.150797+0000", 2023-08-01T19:56:07.827 INFO:teuthology.orchestra.run.smithi008.stdout: "duration": 5.9780000000000002e-06 2023-08-01T19:56:07.827 INFO:teuthology.orchestra.run.smithi008.stdout: }, 2023-08-01T19:56:07.827 INFO:teuthology.orchestra.run.smithi008.stdout: { 2023-08-01T19:56:07.827 INFO:teuthology.orchestra.run.smithi008.stdout: "event": "reached_pg", 2023-08-01T19:56:07.828 INFO:teuthology.orchestra.run.smithi008.stdout: "time": "2023-08-01T19:55:05.150833+0000", 2023-08-01T19:56:07.828 INFO:teuthology.orchestra.run.smithi008.stdout: "duration": 3.6000000000000001e-05 2023-08-01T19:56:07.828 INFO:teuthology.orchestra.run.smithi008.stdout: }, 2023-08-01T19:56:07.828 INFO:teuthology.orchestra.run.smithi008.stdout: { 2023-08-01T19:56:07.828 INFO:teuthology.orchestra.run.smithi008.stdout: "event": "started", 2023-08-01T19:56:07.828 INFO:teuthology.orchestra.run.smithi008.stdout: "time": "2023-08-01T19:55:05.150951+0000", 2023-08-01T19:56:07.828 INFO:teuthology.orchestra.run.smithi008.stdout: "duration": 0.00011827799999999999 2023-08-01T19:56:07.828 INFO:teuthology.orchestra.run.smithi008.stdout: }, 2023-08-01T19:56:07.829 INFO:teuthology.orchestra.run.smithi008.stdout: { 2023-08-01T19:56:07.829 INFO:teuthology.orchestra.run.smithi008.stdout: "event": "waiting for subops from 2", 2023-08-01T19:56:07.829 INFO:teuthology.orchestra.run.smithi008.stdout: "time": "2023-08-01T19:55:05.151111+0000", 2023-08-01T19:56:07.829 INFO:teuthology.orchestra.run.smithi008.stdout: "duration": 0.00015961299999999999 2023-08-01T19:56:07.829 INFO:teuthology.orchestra.run.smithi008.stdout: }, 2023-08-01T19:56:07.829 INFO:teuthology.orchestra.run.smithi008.stdout: { 2023-08-01T19:56:07.829 INFO:teuthology.orchestra.run.smithi008.stdout: "event": "op_commit", 2023-08-01T19:56:07.829 INFO:teuthology.orchestra.run.smithi008.stdout: "time": "2023-08-01T19:55:05.156247+0000", 2023-08-01T19:56:07.830 INFO:teuthology.orchestra.run.smithi008.stdout: "duration": 0.005136524 2023-08-01T19:56:07.830 INFO:teuthology.orchestra.run.smithi008.stdout: }, 2023-08-01T19:56:07.830 INFO:teuthology.orchestra.run.smithi008.stdout: { 2023-08-01T19:56:07.830 INFO:teuthology.orchestra.run.smithi008.stdout: "event": "sub_op_commit_rec", 2023-08-01T19:56:07.830 INFO:teuthology.orchestra.run.smithi008.stdout: "time": "2023-08-01T19:55:05.225705+0000", 2023-08-01T19:56:07.830 INFO:teuthology.orchestra.run.smithi008.stdout: "duration": 0.069458377000000002 2023-08-01T19:56:07.830 INFO:teuthology.orchestra.run.smithi008.stdout: }, 2023-08-01T19:56:07.830 INFO:teuthology.orchestra.run.smithi008.stdout: { 2023-08-01T19:56:07.831 INFO:teuthology.orchestra.run.smithi008.stdout: "event": "commit_sent", 2023-08-01T19:56:07.831 INFO:teuthology.orchestra.run.smithi008.stdout: "time": "2023-08-01T19:55:05.225736+0000", 2023-08-01T19:56:07.831 INFO:teuthology.orchestra.run.smithi008.stdout: "duration": 3.0388000000000001e-05 2023-08-01T19:56:07.831 INFO:teuthology.orchestra.run.smithi008.stdout: }, 2023-08-01T19:56:07.831 INFO:teuthology.orchestra.run.smithi008.stdout: { 2023-08-01T19:56:07.831 INFO:teuthology.orchestra.run.smithi008.stdout: "event": "done", 2023-08-01T19:56:07.831 INFO:teuthology.orchestra.run.smithi008.stdout: "time": "2023-08-01T19:55:05.225757+0000", 2023-08-01T19:56:07.831 INFO:teuthology.orchestra.run.smithi008.stdout: "duration": 2.1090999999999998e-05 2023-08-01T19:56:07.832 INFO:teuthology.orchestra.run.smithi008.stdout: } 2023-08-01T19:56:07.832 INFO:teuthology.orchestra.run.smithi008.stdout: ] 2023-08-01T19:56:07.832 INFO:teuthology.orchestra.run.smithi008.stdout: } 2023-08-01T19:56:07.832 INFO:teuthology.orchestra.run.smithi008.stdout: }, 2023-08-01T19:56:07.832 INFO:teuthology.orchestra.run.smithi008.stdout: { 2023-08-01T19:56:07.832 INFO:teuthology.orchestra.run.smithi008.stdout: "description": "osd_op(client.4668.0:100933 5.5 5:af92e9f2:::benchmark_data_smithi006_114134_object100932:head [set-alloc-hint object_size 65536 write_size 65536,write 0~65536] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e37)", 2023-08-01T19:56:07.832 INFO:teuthology.orchestra.run.smithi008.stdout: "initiated_at": "2023-08-01T19:55:05.566634+0000", 2023-08-01T19:56:07.833 INFO:teuthology.orchestra.run.smithi008.stdout: "age": 62.240110250000001, 2023-08-01T19:56:07.833 INFO:teuthology.orchestra.run.smithi008.stdout: "duration": 0.065909364999999998, 2023-08-01T19:56:07.833 INFO:teuthology.orchestra.run.smithi008.stdout: "type_data": { 2023-08-01T19:56:07.833 INFO:teuthology.orchestra.run.smithi008.stdout: "flag_point": "commit sent; apply or cleanup", 2023-08-01T19:56:07.833 INFO:teuthology.orchestra.run.smithi008.stdout: "client_info": { 2023-08-01T19:56:07.833 INFO:teuthology.orchestra.run.smithi008.stdout: "client": "client.4668", 2023-08-01T19:56:07.833 INFO:teuthology.orchestra.run.smithi008.stdout: "client_addr": "172.21.15.6:0/1709472247", 2023-08-01T19:56:07.833 INFO:teuthology.orchestra.run.smithi008.stdout: "tid": 100933 2023-08-01T19:56:07.834 INFO:teuthology.orchestra.run.smithi008.stdout: }, 2023-08-01T19:56:07.834 INFO:teuthology.orchestra.run.smithi008.stdout: "events": [ 2023-08-01T19:56:07.834 INFO:teuthology.orchestra.run.smithi008.stdout: { 2023-08-01T19:56:07.834 INFO:teuthology.orchestra.run.smithi008.stdout: "event": "initiated", 2023-08-01T19:56:07.834 INFO:teuthology.orchestra.run.smithi008.stdout: "time": "2023-08-01T19:55:05.566634+0000", 2023-08-01T19:56:07.834 INFO:teuthology.orchestra.run.smithi008.stdout: "duration": 0 2023-08-01T19:56:07.834 INFO:teuthology.orchestra.run.smithi008.stdout: }, 2023-08-01T19:56:07.834 INFO:teuthology.orchestra.run.smithi008.stdout: { 2023-08-01T19:56:07.835 INFO:teuthology.orchestra.run.smithi008.stdout: "event": "throttled", 2023-08-01T19:56:07.835 INFO:teuthology.orchestra.run.smithi008.stdout: "time": "2023-08-01T19:55:05.566634+0000", 2023-08-01T19:56:07.835 INFO:teuthology.orchestra.run.smithi008.stdout: "duration": 0 2023-08-01T19:56:07.835 INFO:teuthology.orchestra.run.smithi008.stdout: }, 2023-08-01T19:56:07.835 INFO:teuthology.orchestra.run.smithi008.stdout: { 2023-08-01T19:56:07.835 INFO:teuthology.orchestra.run.smithi008.stdout: "event": "header_read", 2023-08-01T19:56:07.835 INFO:teuthology.orchestra.run.smithi008.stdout: "time": "2023-08-01T19:55:05.566630+0000", 2023-08-01T19:56:07.836 INFO:teuthology.orchestra.run.smithi008.stdout: "duration": 4294967295.9999962 2023-08-01T19:56:07.836 INFO:teuthology.orchestra.run.smithi008.stdout: }, 2023-08-01T19:56:07.836 INFO:teuthology.orchestra.run.smithi008.stdout: { 2023-08-01T19:56:07.836 INFO:teuthology.orchestra.run.smithi008.stdout: "event": "all_read", 2023-08-01T19:56:07.836 INFO:teuthology.orchestra.run.smithi008.stdout: "time": "2023-08-01T19:55:05.566736+0000", 2023-08-01T19:56:07.836 INFO:teuthology.orchestra.run.smithi008.stdout: "duration": 0.000105752 2023-08-01T19:56:07.836 INFO:teuthology.orchestra.run.smithi008.stdout: }, 2023-08-01T19:56:07.836 INFO:teuthology.orchestra.run.smithi008.stdout: { 2023-08-01T19:56:07.837 INFO:teuthology.orchestra.run.smithi008.stdout: "event": "dispatched", 2023-08-01T19:56:07.837 INFO:teuthology.orchestra.run.smithi008.stdout: "time": "2023-08-01T19:55:05.566742+0000", 2023-08-01T19:56:07.837 INFO:teuthology.orchestra.run.smithi008.stdout: "duration": 5.8209999999999998e-06 2023-08-01T19:56:07.837 INFO:teuthology.orchestra.run.smithi008.stdout: }, 2023-08-01T19:56:07.837 INFO:teuthology.orchestra.run.smithi008.stdout: { 2023-08-01T19:56:07.837 INFO:teuthology.orchestra.run.smithi008.stdout: "event": "queued_for_pg", 2023-08-01T19:56:07.837 INFO:teuthology.orchestra.run.smithi008.stdout: "time": "2023-08-01T19:55:05.566745+0000", 2023-08-01T19:56:07.837 INFO:teuthology.orchestra.run.smithi008.stdout: "duration": 3.337e-06 2023-08-01T19:56:07.838 INFO:teuthology.orchestra.run.smithi008.stdout: }, 2023-08-01T19:56:07.838 INFO:teuthology.orchestra.run.smithi008.stdout: { 2023-08-01T19:56:07.838 INFO:teuthology.orchestra.run.smithi008.stdout: "event": "reached_pg", 2023-08-01T19:56:07.838 INFO:teuthology.orchestra.run.smithi008.stdout: "time": "2023-08-01T19:55:05.568175+0000", 2023-08-01T19:56:07.838 INFO:teuthology.orchestra.run.smithi008.stdout: "duration": 0.001429647 2023-08-01T19:56:07.838 INFO:teuthology.orchestra.run.smithi008.stdout: }, 2023-08-01T19:56:07.838 INFO:teuthology.orchestra.run.smithi008.stdout: { 2023-08-01T19:56:07.838 INFO:teuthology.orchestra.run.smithi008.stdout: "event": "started", 2023-08-01T19:56:07.839 INFO:teuthology.orchestra.run.smithi008.stdout: "time": "2023-08-01T19:55:05.568288+0000", 2023-08-01T19:56:07.839 INFO:teuthology.orchestra.run.smithi008.stdout: "duration": 0.000113353 2023-08-01T19:56:07.839 INFO:teuthology.orchestra.run.smithi008.stdout: }, 2023-08-01T19:56:07.839 INFO:teuthology.orchestra.run.smithi008.stdout: { 2023-08-01T19:56:07.839 INFO:teuthology.orchestra.run.smithi008.stdout: "event": "waiting for subops from 1", 2023-08-01T19:56:07.839 INFO:teuthology.orchestra.run.smithi008.stdout: "time": "2023-08-01T19:55:05.568425+0000", 2023-08-01T19:56:07.839 INFO:teuthology.orchestra.run.smithi008.stdout: "duration": 0.000137346 2023-08-01T19:56:07.840 INFO:teuthology.orchestra.run.smithi008.stdout: }, 2023-08-01T19:56:07.840 INFO:teuthology.orchestra.run.smithi008.stdout: { 2023-08-01T19:56:07.840 INFO:teuthology.orchestra.run.smithi008.stdout: "event": "sub_op_commit_rec", 2023-08-01T19:56:07.840 INFO:teuthology.orchestra.run.smithi008.stdout: "time": "2023-08-01T19:55:05.629320+0000", 2023-08-01T19:56:07.840 INFO:teuthology.orchestra.run.smithi008.stdout: "duration": 0.060894491000000002 2023-08-01T19:56:07.840 INFO:teuthology.orchestra.run.smithi008.stdout: }, 2023-08-01T19:56:07.840 INFO:teuthology.orchestra.run.smithi008.stdout: { 2023-08-01T19:56:07.840 INFO:teuthology.orchestra.run.smithi008.stdout: "event": "op_commit", 2023-08-01T19:56:07.841 INFO:teuthology.orchestra.run.smithi008.stdout: "time": "2023-08-01T19:55:05.632452+0000", 2023-08-01T19:56:07.841 INFO:teuthology.orchestra.run.smithi008.stdout: "duration": 0.003131909 2023-08-01T19:56:07.841 INFO:teuthology.orchestra.run.smithi008.stdout: }, 2023-08-01T19:56:07.841 INFO:teuthology.orchestra.run.smithi008.stdout: { 2023-08-01T19:56:07.841 INFO:teuthology.orchestra.run.smithi008.stdout: "event": "commit_sent", 2023-08-01T19:56:07.841 INFO:teuthology.orchestra.run.smithi008.stdout: "time": "2023-08-01T19:55:05.632503+0000", 2023-08-01T19:56:07.841 INFO:teuthology.orchestra.run.smithi008.stdout: "duration": 5.1295000000000003e-05 2023-08-01T19:56:07.841 INFO:teuthology.orchestra.run.smithi008.stdout: }, 2023-08-01T19:56:07.842 INFO:teuthology.orchestra.run.smithi008.stdout: { 2023-08-01T19:56:07.842 INFO:teuthology.orchestra.run.smithi008.stdout: "event": "done", 2023-08-01T19:56:07.842 INFO:teuthology.orchestra.run.smithi008.stdout: "time": "2023-08-01T19:55:05.632543+0000", 2023-08-01T19:56:07.842 INFO:teuthology.orchestra.run.smithi008.stdout: "duration": 4.0234000000000001e-05 2023-08-01T19:56:07.842 INFO:teuthology.orchestra.run.smithi008.stdout: } 2023-08-01T19:56:07.842 INFO:teuthology.orchestra.run.smithi008.stdout: ] 2023-08-01T19:56:07.842 INFO:teuthology.orchestra.run.smithi008.stdout: } 2023-08-01T19:56:07.842 INFO:teuthology.orchestra.run.smithi008.stdout: }, 2023-08-01T19:56:07.843 INFO:teuthology.orchestra.run.smithi008.stdout: { 2023-08-01T19:56:07.843 INFO:teuthology.orchestra.run.smithi008.stdout: "description": "osd_op(client.4668.0:100939 5.5 5:a75fa6e3:::benchmark_data_smithi006_114134_object100938:head [set-alloc-hint object_size 65536 write_size 65536,write 0~65536] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e37)", 2023-08-01T19:56:07.843 INFO:teuthology.orchestra.run.smithi008.stdout: "initiated_at": "2023-08-01T19:55:05.569740+0000", 2023-08-01T19:56:07.843 INFO:teuthology.orchestra.run.smithi008.stdout: "age": 62.237004579000001, 2023-08-01T19:56:07.843 INFO:teuthology.orchestra.run.smithi008.stdout: "duration": 0.067753412999999998, 2023-08-01T19:56:07.843 INFO:teuthology.orchestra.run.smithi008.stdout: "type_data": { 2023-08-01T19:56:07.843 INFO:teuthology.orchestra.run.smithi008.stdout: "flag_point": "commit sent; apply or cleanup", 2023-08-01T19:56:07.844 INFO:teuthology.orchestra.run.smithi008.stdout: "client_info": { 2023-08-01T19:56:07.844 INFO:teuthology.orchestra.run.smithi008.stdout: "client": "client.4668", 2023-08-01T19:56:07.844 INFO:teuthology.orchestra.run.smithi008.stdout: "client_addr": "172.21.15.6:0/1709472247", 2023-08-01T19:56:07.844 INFO:teuthology.orchestra.run.smithi008.stdout: "tid": 100939 2023-08-01T19:56:07.844 INFO:teuthology.orchestra.run.smithi008.stdout: }, 2023-08-01T19:56:07.844 INFO:teuthology.orchestra.run.smithi008.stdout: "events": [ 2023-08-01T19:56:07.844 INFO:teuthology.orchestra.run.smithi008.stdout: { 2023-08-01T19:56:07.844 INFO:teuthology.orchestra.run.smithi008.stdout: "event": "initiated", 2023-08-01T19:56:07.845 INFO:teuthology.orchestra.run.smithi008.stdout: "time": "2023-08-01T19:55:05.569740+0000", 2023-08-01T19:56:07.845 INFO:teuthology.orchestra.run.smithi008.stdout: "duration": 0 2023-08-01T19:56:07.845 INFO:teuthology.orchestra.run.smithi008.stdout: }, 2023-08-01T19:56:07.845 INFO:teuthology.orchestra.run.smithi008.stdout: { 2023-08-01T19:56:07.845 INFO:teuthology.orchestra.run.smithi008.stdout: "event": "throttled", 2023-08-01T19:56:07.845 INFO:teuthology.orchestra.run.smithi008.stdout: "time": "2023-08-01T19:55:05.569740+0000", 2023-08-01T19:56:07.845 INFO:teuthology.orchestra.run.smithi008.stdout: "duration": 0 2023-08-01T19:56:07.845 INFO:teuthology.orchestra.run.smithi008.stdout: }, 2023-08-01T19:56:07.846 INFO:teuthology.orchestra.run.smithi008.stdout: { 2023-08-01T19:56:07.846 INFO:teuthology.orchestra.run.smithi008.stdout: "event": "header_read", 2023-08-01T19:56:07.846 INFO:teuthology.orchestra.run.smithi008.stdout: "time": "2023-08-01T19:55:05.569739+0000", 2023-08-01T19:56:07.846 INFO:teuthology.orchestra.run.smithi008.stdout: "duration": 4294967295.9999995 2023-08-01T19:56:07.846 INFO:teuthology.orchestra.run.smithi008.stdout: }, 2023-08-01T19:56:07.846 INFO:teuthology.orchestra.run.smithi008.stdout: { 2023-08-01T19:56:07.846 INFO:teuthology.orchestra.run.smithi008.stdout: "event": "all_read", 2023-08-01T19:56:07.846 INFO:teuthology.orchestra.run.smithi008.stdout: "time": "2023-08-01T19:55:05.569839+0000", 2023-08-01T19:56:07.847 INFO:teuthology.orchestra.run.smithi008.stdout: "duration": 0.000100219 2023-08-01T19:56:07.847 INFO:teuthology.orchestra.run.smithi008.stdout: }, 2023-08-01T19:56:07.847 INFO:teuthology.orchestra.run.smithi008.stdout: { 2023-08-01T19:56:07.847 INFO:teuthology.orchestra.run.smithi008.stdout: "event": "dispatched", 2023-08-01T19:56:07.847 INFO:teuthology.orchestra.run.smithi008.stdout: "time": "2023-08-01T19:55:05.569846+0000", 2023-08-01T19:56:07.847 INFO:teuthology.orchestra.run.smithi008.stdout: "duration": 7.3150000000000003e-06 2023-08-01T19:56:07.847 INFO:teuthology.orchestra.run.smithi008.stdout: }, 2023-08-01T19:56:07.847 INFO:teuthology.orchestra.run.smithi008.stdout: { 2023-08-01T19:56:07.848 INFO:teuthology.orchestra.run.smithi008.stdout: "event": "queued_for_pg", 2023-08-01T19:56:07.848 INFO:teuthology.orchestra.run.smithi008.stdout: "time": "2023-08-01T19:55:05.569850+0000", 2023-08-01T19:56:07.848 INFO:teuthology.orchestra.run.smithi008.stdout: "duration": 3.3299999999999999e-06 2023-08-01T19:56:07.848 INFO:teuthology.orchestra.run.smithi008.stdout: }, 2023-08-01T19:56:07.848 INFO:teuthology.orchestra.run.smithi008.stdout: { 2023-08-01T19:56:07.848 INFO:teuthology.orchestra.run.smithi008.stdout: "event": "reached_pg", 2023-08-01T19:56:07.848 INFO:teuthology.orchestra.run.smithi008.stdout: "time": "2023-08-01T19:55:05.626991+0000", 2023-08-01T19:56:07.849 INFO:teuthology.orchestra.run.smithi008.stdout: "duration": 0.057141585000000002 2023-08-01T19:56:07.849 INFO:teuthology.orchestra.run.smithi008.stdout: }, 2023-08-01T19:56:07.849 INFO:teuthology.orchestra.run.smithi008.stdout: { 2023-08-01T19:56:07.849 INFO:teuthology.orchestra.run.smithi008.stdout: "event": "started", 2023-08-01T19:56:07.849 INFO:teuthology.orchestra.run.smithi008.stdout: "time": "2023-08-01T19:55:05.627111+0000", 2023-08-01T19:56:07.849 INFO:teuthology.orchestra.run.smithi008.stdout: "duration": 0.000119238 2023-08-01T19:56:07.849 INFO:teuthology.orchestra.run.smithi008.stdout: }, 2023-08-01T19:56:07.849 INFO:teuthology.orchestra.run.smithi008.stdout: { 2023-08-01T19:56:07.850 INFO:teuthology.orchestra.run.smithi008.stdout: "event": "waiting for subops from 1", 2023-08-01T19:56:07.850 INFO:teuthology.orchestra.run.smithi008.stdout: "time": "2023-08-01T19:55:05.627253+0000", 2023-08-01T19:56:07.850 INFO:teuthology.orchestra.run.smithi008.stdout: "duration": 0.000142822 2023-08-01T19:56:07.850 INFO:teuthology.orchestra.run.smithi008.stdout: }, 2023-08-01T19:56:07.850 INFO:teuthology.orchestra.run.smithi008.stdout: { 2023-08-01T19:56:07.850 INFO:teuthology.orchestra.run.smithi008.stdout: "event": "op_commit", 2023-08-01T19:56:07.850 INFO:teuthology.orchestra.run.smithi008.stdout: "time": "2023-08-01T19:55:05.632555+0000", 2023-08-01T19:56:07.850 INFO:teuthology.orchestra.run.smithi008.stdout: "duration": 0.0053012449999999996 2023-08-01T19:56:07.851 INFO:teuthology.orchestra.run.smithi008.stdout: }, 2023-08-01T19:56:07.851 INFO:teuthology.orchestra.run.smithi008.stdout: { 2023-08-01T19:56:07.851 INFO:teuthology.orchestra.run.smithi008.stdout: "event": "sub_op_commit_rec", 2023-08-01T19:56:07.851 INFO:teuthology.orchestra.run.smithi008.stdout: "time": "2023-08-01T19:55:05.637380+0000", 2023-08-01T19:56:07.851 INFO:teuthology.orchestra.run.smithi008.stdout: "duration": 0.0048257639999999997 2023-08-01T19:56:07.851 INFO:teuthology.orchestra.run.smithi008.stdout: }, 2023-08-01T19:56:07.851 INFO:teuthology.orchestra.run.smithi008.stdout: { 2023-08-01T19:56:07.851 INFO:teuthology.orchestra.run.smithi008.stdout: "event": "commit_sent", 2023-08-01T19:56:07.852 INFO:teuthology.orchestra.run.smithi008.stdout: "time": "2023-08-01T19:55:05.637454+0000", 2023-08-01T19:56:07.852 INFO:teuthology.orchestra.run.smithi008.stdout: "duration": 7.3578999999999995e-05 2023-08-01T19:56:07.852 INFO:teuthology.orchestra.run.smithi008.stdout: }, 2023-08-01T19:56:07.852 INFO:teuthology.orchestra.run.smithi008.stdout: { 2023-08-01T19:56:07.852 INFO:teuthology.orchestra.run.smithi008.stdout: "event": "done", 2023-08-01T19:56:07.852 INFO:teuthology.orchestra.run.smithi008.stdout: "time": "2023-08-01T19:55:05.637493+0000", 2023-08-01T19:56:07.852 INFO:teuthology.orchestra.run.smithi008.stdout: "duration": 3.8986999999999998e-05 2023-08-01T19:56:07.852 INFO:teuthology.orchestra.run.smithi008.stdout: } 2023-08-01T19:56:07.853 INFO:teuthology.orchestra.run.smithi008.stdout: ] 2023-08-01T19:56:07.853 INFO:teuthology.orchestra.run.smithi008.stdout: } 2023-08-01T19:56:07.853 INFO:teuthology.orchestra.run.smithi008.stdout: }, 2023-08-01T19:56:07.853 INFO:teuthology.orchestra.run.smithi008.stdout: { 2023-08-01T19:56:07.853 INFO:teuthology.orchestra.run.smithi008.stdout: "description": "osd_op(client.4668.0:107863 5.3 5:cbdd875a:::benchmark_data_smithi006_114134_object107862:head [set-alloc-hint object_size 65536 write_size 65536,write 0~65536] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e38)", 2023-08-01T19:56:07.853 INFO:teuthology.orchestra.run.smithi008.stdout: "initiated_at": "2023-08-01T19:55:09.278851+0000", 2023-08-01T19:56:07.853 INFO:teuthology.orchestra.run.smithi008.stdout: "age": 58.527892839000003, 2023-08-01T19:56:07.854 INFO:teuthology.orchestra.run.smithi008.stdout: "duration": 0.071378853000000006, 2023-08-01T19:56:07.854 INFO:teuthology.orchestra.run.smithi008.stdout: "type_data": { 2023-08-01T19:56:07.854 INFO:teuthology.orchestra.run.smithi008.stdout: "flag_point": "commit sent; apply or cleanup", 2023-08-01T19:56:07.854 INFO:teuthology.orchestra.run.smithi008.stdout: "client_info": { 2023-08-01T19:56:07.854 INFO:teuthology.orchestra.run.smithi008.stdout: "client": "client.4668", 2023-08-01T19:56:07.854 INFO:teuthology.orchestra.run.smithi008.stdout: "client_addr": "172.21.15.6:0/1709472247", 2023-08-01T19:56:07.854 INFO:teuthology.orchestra.run.smithi008.stdout: "tid": 107863 2023-08-01T19:56:07.854 INFO:teuthology.orchestra.run.smithi008.stdout: }, 2023-08-01T19:56:07.855 INFO:teuthology.orchestra.run.smithi008.stdout: "events": [ 2023-08-01T19:56:07.855 INFO:teuthology.orchestra.run.smithi008.stdout: { 2023-08-01T19:56:07.855 INFO:teuthology.orchestra.run.smithi008.stdout: "event": "initiated", 2023-08-01T19:56:07.855 INFO:teuthology.orchestra.run.smithi008.stdout: "time": "2023-08-01T19:55:09.278851+0000", 2023-08-01T19:56:07.855 INFO:teuthology.orchestra.run.smithi008.stdout: "duration": 0 2023-08-01T19:56:07.855 INFO:teuthology.orchestra.run.smithi008.stdout: }, 2023-08-01T19:56:07.855 INFO:teuthology.orchestra.run.smithi008.stdout: { 2023-08-01T19:56:07.855 INFO:teuthology.orchestra.run.smithi008.stdout: "event": "throttled", 2023-08-01T19:56:07.856 INFO:teuthology.orchestra.run.smithi008.stdout: "time": "2023-08-01T19:55:09.278851+0000", 2023-08-01T19:56:07.856 INFO:teuthology.orchestra.run.smithi008.stdout: "duration": 0 2023-08-01T19:56:07.856 INFO:teuthology.orchestra.run.smithi008.stdout: }, 2023-08-01T19:56:07.856 INFO:teuthology.orchestra.run.smithi008.stdout: { 2023-08-01T19:56:07.856 INFO:teuthology.orchestra.run.smithi008.stdout: "event": "header_read", 2023-08-01T19:56:07.856 INFO:teuthology.orchestra.run.smithi008.stdout: "time": "2023-08-01T19:55:09.278850+0000", 2023-08-01T19:56:07.856 INFO:teuthology.orchestra.run.smithi008.stdout: "duration": 4294967295.999999 2023-08-01T19:56:07.856 INFO:teuthology.orchestra.run.smithi008.stdout: }, 2023-08-01T19:56:07.857 INFO:teuthology.orchestra.run.smithi008.stdout: { 2023-08-01T19:56:07.857 INFO:teuthology.orchestra.run.smithi008.stdout: "event": "all_read", 2023-08-01T19:56:07.857 INFO:teuthology.orchestra.run.smithi008.stdout: "time": "2023-08-01T19:55:09.278945+0000", 2023-08-01T19:56:07.857 INFO:teuthology.orchestra.run.smithi008.stdout: "duration": 9.4388000000000005e-05 2023-08-01T19:56:07.857 INFO:teuthology.orchestra.run.smithi008.stdout: }, 2023-08-01T19:56:07.857 INFO:teuthology.orchestra.run.smithi008.stdout: { 2023-08-01T19:56:07.857 INFO:teuthology.orchestra.run.smithi008.stdout: "event": "dispatched", 2023-08-01T19:56:07.857 INFO:teuthology.orchestra.run.smithi008.stdout: "time": "2023-08-01T19:55:09.278955+0000", 2023-08-01T19:56:07.858 INFO:teuthology.orchestra.run.smithi008.stdout: "duration": 1.0413e-05 2023-08-01T19:56:07.858 INFO:teuthology.orchestra.run.smithi008.stdout: }, 2023-08-01T19:56:07.858 INFO:teuthology.orchestra.run.smithi008.stdout: { 2023-08-01T19:56:07.858 INFO:teuthology.orchestra.run.smithi008.stdout: "event": "queued_for_pg", 2023-08-01T19:56:07.858 INFO:teuthology.orchestra.run.smithi008.stdout: "time": "2023-08-01T19:55:09.278962+0000", 2023-08-01T19:56:07.858 INFO:teuthology.orchestra.run.smithi008.stdout: "duration": 6.2169999999999999e-06 2023-08-01T19:56:07.858 INFO:teuthology.orchestra.run.smithi008.stdout: }, 2023-08-01T19:56:07.858 INFO:teuthology.orchestra.run.smithi008.stdout: { 2023-08-01T19:56:07.859 INFO:teuthology.orchestra.run.smithi008.stdout: "event": "reached_pg", 2023-08-01T19:56:07.859 INFO:teuthology.orchestra.run.smithi008.stdout: "time": "2023-08-01T19:55:09.280363+0000", 2023-08-01T19:56:07.859 INFO:teuthology.orchestra.run.smithi008.stdout: "duration": 0.0014014489999999999 2023-08-01T19:56:07.859 INFO:teuthology.orchestra.run.smithi008.stdout: }, 2023-08-01T19:56:07.859 INFO:teuthology.orchestra.run.smithi008.stdout: { 2023-08-01T19:56:07.859 INFO:teuthology.orchestra.run.smithi008.stdout: "event": "started", 2023-08-01T19:56:07.859 INFO:teuthology.orchestra.run.smithi008.stdout: "time": "2023-08-01T19:55:09.280488+0000", 2023-08-01T19:56:07.859 INFO:teuthology.orchestra.run.smithi008.stdout: "duration": 0.00012474099999999999 2023-08-01T19:56:07.860 INFO:teuthology.orchestra.run.smithi008.stdout: }, 2023-08-01T19:56:07.860 INFO:teuthology.orchestra.run.smithi008.stdout: { 2023-08-01T19:56:07.860 INFO:teuthology.orchestra.run.smithi008.stdout: "event": "waiting for subops from 1", 2023-08-01T19:56:07.860 INFO:teuthology.orchestra.run.smithi008.stdout: "time": "2023-08-01T19:55:09.280626+0000", 2023-08-01T19:56:07.860 INFO:teuthology.orchestra.run.smithi008.stdout: "duration": 0.000138193 2023-08-01T19:56:07.860 INFO:teuthology.orchestra.run.smithi008.stdout: }, 2023-08-01T19:56:07.860 INFO:teuthology.orchestra.run.smithi008.stdout: { 2023-08-01T19:56:07.861 INFO:teuthology.orchestra.run.smithi008.stdout: "event": "op_commit", 2023-08-01T19:56:07.861 INFO:teuthology.orchestra.run.smithi008.stdout: "time": "2023-08-01T19:55:09.285958+0000", 2023-08-01T19:56:07.861 INFO:teuthology.orchestra.run.smithi008.stdout: "duration": 0.0053317130000000001 2023-08-01T19:56:07.861 INFO:teuthology.orchestra.run.smithi008.stdout: }, 2023-08-01T19:56:07.861 INFO:teuthology.orchestra.run.smithi008.stdout: { 2023-08-01T19:56:07.861 INFO:teuthology.orchestra.run.smithi008.stdout: "event": "sub_op_commit_rec", 2023-08-01T19:56:07.861 INFO:teuthology.orchestra.run.smithi008.stdout: "time": "2023-08-01T19:55:09.350151+0000", 2023-08-01T19:56:07.861 INFO:teuthology.orchestra.run.smithi008.stdout: "duration": 0.064193202000000005 2023-08-01T19:56:07.862 INFO:teuthology.orchestra.run.smithi008.stdout: }, 2023-08-01T19:56:07.862 INFO:teuthology.orchestra.run.smithi008.stdout: { 2023-08-01T19:56:07.862 INFO:teuthology.orchestra.run.smithi008.stdout: "event": "commit_sent", 2023-08-01T19:56:07.862 INFO:teuthology.orchestra.run.smithi008.stdout: "time": "2023-08-01T19:55:09.350188+0000", 2023-08-01T19:56:07.862 INFO:teuthology.orchestra.run.smithi008.stdout: "duration": 3.7549999999999998e-05 2023-08-01T19:56:07.862 INFO:teuthology.orchestra.run.smithi008.stdout: }, 2023-08-01T19:56:07.862 INFO:teuthology.orchestra.run.smithi008.stdout: { 2023-08-01T19:56:07.862 INFO:teuthology.orchestra.run.smithi008.stdout: "event": "done", 2023-08-01T19:56:07.863 INFO:teuthology.orchestra.run.smithi008.stdout: "time": "2023-08-01T19:55:09.350230+0000", 2023-08-01T19:56:07.863 INFO:teuthology.orchestra.run.smithi008.stdout: "duration": 4.1804999999999997e-05 2023-08-01T19:56:07.863 INFO:teuthology.orchestra.run.smithi008.stdout: } 2023-08-01T19:56:07.863 INFO:teuthology.orchestra.run.smithi008.stdout: ] 2023-08-01T19:56:07.863 INFO:teuthology.orchestra.run.smithi008.stdout: } 2023-08-01T19:56:07.863 INFO:teuthology.orchestra.run.smithi008.stdout: }, 2023-08-01T19:56:07.863 INFO:teuthology.orchestra.run.smithi008.stdout: { 2023-08-01T19:56:07.864 INFO:teuthology.orchestra.run.smithi008.stdout: "description": "osd_op(client.4668.0:107865 5.3 5:c2ebb96d:::benchmark_data_smithi006_114134_object107864:head [set-alloc-hint object_size 65536 write_size 65536,write 0~65536] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e38)", 2023-08-01T19:56:07.864 INFO:teuthology.orchestra.run.smithi008.stdout: "initiated_at": "2023-08-01T19:55:09.279020+0000", 2023-08-01T19:56:07.864 INFO:teuthology.orchestra.run.smithi008.stdout: "age": 58.527724167000002, 2023-08-01T19:56:07.864 INFO:teuthology.orchestra.run.smithi008.stdout: "duration": 0.072892565000000006, 2023-08-01T19:56:07.864 INFO:teuthology.orchestra.run.smithi008.stdout: "type_data": { 2023-08-01T19:56:07.864 INFO:teuthology.orchestra.run.smithi008.stdout: "flag_point": "commit sent; apply or cleanup", 2023-08-01T19:56:07.864 INFO:teuthology.orchestra.run.smithi008.stdout: "client_info": { 2023-08-01T19:56:07.864 INFO:teuthology.orchestra.run.smithi008.stdout: "client": "client.4668", 2023-08-01T19:56:07.865 INFO:teuthology.orchestra.run.smithi008.stdout: "client_addr": "172.21.15.6:0/1709472247", 2023-08-01T19:56:07.865 INFO:teuthology.orchestra.run.smithi008.stdout: "tid": 107865 2023-08-01T19:56:07.865 INFO:teuthology.orchestra.run.smithi008.stdout: }, 2023-08-01T19:56:07.865 INFO:teuthology.orchestra.run.smithi008.stdout: "events": [ 2023-08-01T19:56:07.865 INFO:teuthology.orchestra.run.smithi008.stdout: { 2023-08-01T19:56:07.865 INFO:teuthology.orchestra.run.smithi008.stdout: "event": "initiated", 2023-08-01T19:56:07.865 INFO:teuthology.orchestra.run.smithi008.stdout: "time": "2023-08-01T19:55:09.279020+0000", 2023-08-01T19:56:07.865 INFO:teuthology.orchestra.run.smithi008.stdout: "duration": 0 2023-08-01T19:56:07.866 INFO:teuthology.orchestra.run.smithi008.stdout: }, 2023-08-01T19:56:07.866 INFO:teuthology.orchestra.run.smithi008.stdout: { 2023-08-01T19:56:07.866 INFO:teuthology.orchestra.run.smithi008.stdout: "event": "throttled", 2023-08-01T19:56:07.866 INFO:teuthology.orchestra.run.smithi008.stdout: "time": "2023-08-01T19:55:09.279020+0000", 2023-08-01T19:56:07.866 INFO:teuthology.orchestra.run.smithi008.stdout: "duration": 0 2023-08-01T19:56:07.866 INFO:teuthology.orchestra.run.smithi008.stdout: }, 2023-08-01T19:56:07.866 INFO:teuthology.orchestra.run.smithi008.stdout: { 2023-08-01T19:56:07.866 INFO:teuthology.orchestra.run.smithi008.stdout: "event": "header_read", 2023-08-01T19:56:07.867 INFO:teuthology.orchestra.run.smithi008.stdout: "time": "2023-08-01T19:55:09.279019+0000", 2023-08-01T19:56:07.867 INFO:teuthology.orchestra.run.smithi008.stdout: "duration": 4294967295.999999 2023-08-01T19:56:07.867 INFO:teuthology.orchestra.run.smithi008.stdout: }, 2023-08-01T19:56:07.867 INFO:teuthology.orchestra.run.smithi008.stdout: { 2023-08-01T19:56:07.867 INFO:teuthology.orchestra.run.smithi008.stdout: "event": "all_read", 2023-08-01T19:56:07.867 INFO:teuthology.orchestra.run.smithi008.stdout: "time": "2023-08-01T19:55:09.279087+0000", 2023-08-01T19:56:07.867 INFO:teuthology.orchestra.run.smithi008.stdout: "duration": 6.8392000000000005e-05 2023-08-01T19:56:07.867 INFO:teuthology.orchestra.run.smithi008.stdout: }, 2023-08-01T19:56:07.868 INFO:teuthology.orchestra.run.smithi008.stdout: { 2023-08-01T19:56:07.868 INFO:teuthology.orchestra.run.smithi008.stdout: "event": "dispatched", 2023-08-01T19:56:07.868 INFO:teuthology.orchestra.run.smithi008.stdout: "time": "2023-08-01T19:55:09.279095+0000", 2023-08-01T19:56:07.868 INFO:teuthology.orchestra.run.smithi008.stdout: "duration": 8.0989999999999999e-06 2023-08-01T19:56:07.868 INFO:teuthology.orchestra.run.smithi008.stdout: }, 2023-08-01T19:56:07.868 INFO:teuthology.orchestra.run.smithi008.stdout: { 2023-08-01T19:56:07.868 INFO:teuthology.orchestra.run.smithi008.stdout: "event": "queued_for_pg", 2023-08-01T19:56:07.869 INFO:teuthology.orchestra.run.smithi008.stdout: "time": "2023-08-01T19:55:09.279101+0000", 2023-08-01T19:56:07.869 INFO:teuthology.orchestra.run.smithi008.stdout: "duration": 5.0390000000000004e-06 2023-08-01T19:56:07.869 INFO:teuthology.orchestra.run.smithi008.stdout: }, 2023-08-01T19:56:07.869 INFO:teuthology.orchestra.run.smithi008.stdout: { 2023-08-01T19:56:07.869 INFO:teuthology.orchestra.run.smithi008.stdout: "event": "reached_pg", 2023-08-01T19:56:07.869 INFO:teuthology.orchestra.run.smithi008.stdout: "time": "2023-08-01T19:55:09.282574+0000", 2023-08-01T19:56:07.869 INFO:teuthology.orchestra.run.smithi008.stdout: "duration": 0.0034730619999999999 2023-08-01T19:56:07.869 INFO:teuthology.orchestra.run.smithi008.stdout: }, 2023-08-01T19:56:07.870 INFO:teuthology.orchestra.run.smithi008.stdout: { 2023-08-01T19:56:07.870 INFO:teuthology.orchestra.run.smithi008.stdout: "event": "started", 2023-08-01T19:56:07.870 INFO:teuthology.orchestra.run.smithi008.stdout: "time": "2023-08-01T19:55:09.282705+0000", 2023-08-01T19:56:07.870 INFO:teuthology.orchestra.run.smithi008.stdout: "duration": 0.00013133400000000001 2023-08-01T19:56:07.870 INFO:teuthology.orchestra.run.smithi008.stdout: }, 2023-08-01T19:56:07.870 INFO:teuthology.orchestra.run.smithi008.stdout: { 2023-08-01T19:56:07.870 INFO:teuthology.orchestra.run.smithi008.stdout: "event": "waiting for subops from 1", 2023-08-01T19:56:07.870 INFO:teuthology.orchestra.run.smithi008.stdout: "time": "2023-08-01T19:55:09.283067+0000", 2023-08-01T19:56:07.871 INFO:teuthology.orchestra.run.smithi008.stdout: "duration": 0.00036195299999999998 2023-08-01T19:56:07.871 INFO:teuthology.orchestra.run.smithi008.stdout: }, 2023-08-01T19:56:07.871 INFO:teuthology.orchestra.run.smithi008.stdout: { 2023-08-01T19:56:07.871 INFO:teuthology.orchestra.run.smithi008.stdout: "event": "op_commit", 2023-08-01T19:56:07.871 INFO:teuthology.orchestra.run.smithi008.stdout: "time": "2023-08-01T19:55:09.288196+0000", 2023-08-01T19:56:07.871 INFO:teuthology.orchestra.run.smithi008.stdout: "duration": 0.0051293780000000004 2023-08-01T19:56:07.871 INFO:teuthology.orchestra.run.smithi008.stdout: }, 2023-08-01T19:56:07.871 INFO:teuthology.orchestra.run.smithi008.stdout: { 2023-08-01T19:56:07.872 INFO:teuthology.orchestra.run.smithi008.stdout: "event": "sub_op_commit_rec", 2023-08-01T19:56:07.872 INFO:teuthology.orchestra.run.smithi008.stdout: "time": "2023-08-01T19:55:09.351832+0000", 2023-08-01T19:56:07.872 INFO:teuthology.orchestra.run.smithi008.stdout: "duration": 0.063636076 2023-08-01T19:56:07.872 INFO:teuthology.orchestra.run.smithi008.stdout: }, 2023-08-01T19:56:07.872 INFO:teuthology.orchestra.run.smithi008.stdout: { 2023-08-01T19:56:07.872 INFO:teuthology.orchestra.run.smithi008.stdout: "event": "commit_sent", 2023-08-01T19:56:07.872 INFO:teuthology.orchestra.run.smithi008.stdout: "time": "2023-08-01T19:55:09.351878+0000", 2023-08-01T19:56:07.872 INFO:teuthology.orchestra.run.smithi008.stdout: "duration": 4.5408999999999998e-05 2023-08-01T19:56:07.873 INFO:teuthology.orchestra.run.smithi008.stdout: }, 2023-08-01T19:56:07.873 INFO:teuthology.orchestra.run.smithi008.stdout: { 2023-08-01T19:56:07.873 INFO:teuthology.orchestra.run.smithi008.stdout: "event": "done", 2023-08-01T19:56:07.873 INFO:teuthology.orchestra.run.smithi008.stdout: "time": "2023-08-01T19:55:09.351913+0000", 2023-08-01T19:56:07.873 INFO:teuthology.orchestra.run.smithi008.stdout: "duration": 3.4808999999999998e-05 2023-08-01T19:56:07.873 INFO:teuthology.orchestra.run.smithi008.stdout: } 2023-08-01T19:56:07.873 INFO:teuthology.orchestra.run.smithi008.stdout: ] 2023-08-01T19:56:07.873 INFO:teuthology.orchestra.run.smithi008.stdout: } 2023-08-01T19:56:07.874 INFO:teuthology.orchestra.run.smithi008.stdout: }, 2023-08-01T19:56:07.874 INFO:teuthology.orchestra.run.smithi008.stdout: { 2023-08-01T19:56:07.874 INFO:teuthology.orchestra.run.smithi008.stdout: "description": "osd_op(client.4668.0:107869 5.c 5:31910384:::benchmark_data_smithi006_114134_object107868:head [set-alloc-hint object_size 65536 write_size 65536,write 0~65536] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e38)", 2023-08-01T19:56:07.874 INFO:teuthology.orchestra.run.smithi008.stdout: "initiated_at": "2023-08-01T19:55:09.283205+0000", 2023-08-01T19:56:07.874 INFO:teuthology.orchestra.run.smithi008.stdout: "age": 58.523539002, 2023-08-01T19:56:07.874 INFO:teuthology.orchestra.run.smithi008.stdout: "duration": 0.068611808999999996, 2023-08-01T19:56:07.874 INFO:teuthology.orchestra.run.smithi008.stdout: "type_data": { 2023-08-01T19:56:07.874 INFO:teuthology.orchestra.run.smithi008.stdout: "flag_point": "commit sent; apply or cleanup", 2023-08-01T19:56:07.875 INFO:teuthology.orchestra.run.smithi008.stdout: "client_info": { 2023-08-01T19:56:07.875 INFO:teuthology.orchestra.run.smithi008.stdout: "client": "client.4668", 2023-08-01T19:56:07.875 INFO:teuthology.orchestra.run.smithi008.stdout: "client_addr": "172.21.15.6:0/1709472247", 2023-08-01T19:56:07.875 INFO:teuthology.orchestra.run.smithi008.stdout: "tid": 107869 2023-08-01T19:56:07.875 INFO:teuthology.orchestra.run.smithi008.stdout: }, 2023-08-01T19:56:07.875 INFO:teuthology.orchestra.run.smithi008.stdout: "events": [ 2023-08-01T19:56:07.875 INFO:teuthology.orchestra.run.smithi008.stdout: { 2023-08-01T19:56:07.875 INFO:teuthology.orchestra.run.smithi008.stdout: "event": "initiated", 2023-08-01T19:56:07.876 INFO:teuthology.orchestra.run.smithi008.stdout: "time": "2023-08-01T19:55:09.283205+0000", 2023-08-01T19:56:07.876 INFO:teuthology.orchestra.run.smithi008.stdout: "duration": 0 2023-08-01T19:56:07.876 INFO:teuthology.orchestra.run.smithi008.stdout: }, 2023-08-01T19:56:07.876 INFO:teuthology.orchestra.run.smithi008.stdout: { 2023-08-01T19:56:07.876 INFO:teuthology.orchestra.run.smithi008.stdout: "event": "throttled", 2023-08-01T19:56:07.876 INFO:teuthology.orchestra.run.smithi008.stdout: "time": "2023-08-01T19:55:09.283205+0000", 2023-08-01T19:56:07.876 INFO:teuthology.orchestra.run.smithi008.stdout: "duration": 0 2023-08-01T19:56:07.877 INFO:teuthology.orchestra.run.smithi008.stdout: }, 2023-08-01T19:56:07.877 INFO:teuthology.orchestra.run.smithi008.stdout: { 2023-08-01T19:56:07.877 INFO:teuthology.orchestra.run.smithi008.stdout: "event": "header_read", 2023-08-01T19:56:07.877 INFO:teuthology.orchestra.run.smithi008.stdout: "time": "2023-08-01T19:55:09.283204+0000", 2023-08-01T19:56:07.877 INFO:teuthology.orchestra.run.smithi008.stdout: "duration": 4294967295.999999 2023-08-01T19:56:07.877 INFO:teuthology.orchestra.run.smithi008.stdout: }, 2023-08-01T19:56:07.877 INFO:teuthology.orchestra.run.smithi008.stdout: { 2023-08-01T19:56:07.877 INFO:teuthology.orchestra.run.smithi008.stdout: "event": "all_read", 2023-08-01T19:56:07.878 INFO:teuthology.orchestra.run.smithi008.stdout: "time": "2023-08-01T19:55:09.283300+0000", 2023-08-01T19:56:07.878 INFO:teuthology.orchestra.run.smithi008.stdout: "duration": 9.6280000000000007e-05 2023-08-01T19:56:07.878 INFO:teuthology.orchestra.run.smithi008.stdout: }, 2023-08-01T19:56:07.878 INFO:teuthology.orchestra.run.smithi008.stdout: { 2023-08-01T19:56:07.878 INFO:teuthology.orchestra.run.smithi008.stdout: "event": "dispatched", 2023-08-01T19:56:07.878 INFO:teuthology.orchestra.run.smithi008.stdout: "time": "2023-08-01T19:55:09.283314+0000", 2023-08-01T19:56:07.878 INFO:teuthology.orchestra.run.smithi008.stdout: "duration": 1.3344e-05 2023-08-01T19:56:07.878 INFO:teuthology.orchestra.run.smithi008.stdout: }, 2023-08-01T19:56:07.879 INFO:teuthology.orchestra.run.smithi008.stdout: { 2023-08-01T19:56:07.879 INFO:teuthology.orchestra.run.smithi008.stdout: "event": "queued_for_pg", 2023-08-01T19:56:07.879 INFO:teuthology.orchestra.run.smithi008.stdout: "time": "2023-08-01T19:55:09.283320+0000", 2023-08-01T19:56:07.879 INFO:teuthology.orchestra.run.smithi008.stdout: "duration": 6.0299999999999999e-06 2023-08-01T19:56:07.879 INFO:teuthology.orchestra.run.smithi008.stdout: }, 2023-08-01T19:56:07.879 INFO:teuthology.orchestra.run.smithi008.stdout: { 2023-08-01T19:56:07.879 INFO:teuthology.orchestra.run.smithi008.stdout: "event": "reached_pg", 2023-08-01T19:56:07.879 INFO:teuthology.orchestra.run.smithi008.stdout: "time": "2023-08-01T19:55:09.283365+0000", 2023-08-01T19:56:07.880 INFO:teuthology.orchestra.run.smithi008.stdout: "duration": 4.5578999999999998e-05 2023-08-01T19:56:07.880 INFO:teuthology.orchestra.run.smithi008.stdout: }, 2023-08-01T19:56:07.880 INFO:teuthology.orchestra.run.smithi008.stdout: { 2023-08-01T19:56:07.880 INFO:teuthology.orchestra.run.smithi008.stdout: "event": "started", 2023-08-01T19:56:07.880 INFO:teuthology.orchestra.run.smithi008.stdout: "time": "2023-08-01T19:55:09.283490+0000", 2023-08-01T19:56:07.880 INFO:teuthology.orchestra.run.smithi008.stdout: "duration": 0.00012473700000000001 2023-08-01T19:56:07.880 INFO:teuthology.orchestra.run.smithi008.stdout: }, 2023-08-01T19:56:07.880 INFO:teuthology.orchestra.run.smithi008.stdout: { 2023-08-01T19:56:07.881 INFO:teuthology.orchestra.run.smithi008.stdout: "event": "waiting for subops from 1", 2023-08-01T19:56:07.881 INFO:teuthology.orchestra.run.smithi008.stdout: "time": "2023-08-01T19:55:09.283637+0000", 2023-08-01T19:56:07.881 INFO:teuthology.orchestra.run.smithi008.stdout: "duration": 0.00014715600000000001 2023-08-01T19:56:07.881 INFO:teuthology.orchestra.run.smithi008.stdout: }, 2023-08-01T19:56:07.881 INFO:teuthology.orchestra.run.smithi008.stdout: { 2023-08-01T19:56:07.881 INFO:teuthology.orchestra.run.smithi008.stdout: "event": "op_commit", 2023-08-01T19:56:07.881 INFO:teuthology.orchestra.run.smithi008.stdout: "time": "2023-08-01T19:55:09.288214+0000", 2023-08-01T19:56:07.881 INFO:teuthology.orchestra.run.smithi008.stdout: "duration": 0.0045769560000000001 2023-08-01T19:56:07.882 INFO:teuthology.orchestra.run.smithi008.stdout: }, 2023-08-01T19:56:07.882 INFO:teuthology.orchestra.run.smithi008.stdout: { 2023-08-01T19:56:07.882 INFO:teuthology.orchestra.run.smithi008.stdout: "event": "sub_op_commit_rec", 2023-08-01T19:56:07.882 INFO:teuthology.orchestra.run.smithi008.stdout: "time": "2023-08-01T19:55:09.351721+0000", 2023-08-01T19:56:07.882 INFO:teuthology.orchestra.run.smithi008.stdout: "duration": 0.063507383000000001 2023-08-01T19:56:07.882 INFO:teuthology.orchestra.run.smithi008.stdout: }, 2023-08-01T19:56:07.882 INFO:teuthology.orchestra.run.smithi008.stdout: { 2023-08-01T19:56:07.883 INFO:teuthology.orchestra.run.smithi008.stdout: "event": "commit_sent", 2023-08-01T19:56:07.883 INFO:teuthology.orchestra.run.smithi008.stdout: "time": "2023-08-01T19:55:09.351777+0000", 2023-08-01T19:56:07.883 INFO:teuthology.orchestra.run.smithi008.stdout: "duration": 5.5733999999999999e-05 2023-08-01T19:56:07.883 INFO:teuthology.orchestra.run.smithi008.stdout: }, 2023-08-01T19:56:07.883 INFO:teuthology.orchestra.run.smithi008.stdout: { 2023-08-01T19:56:07.883 INFO:teuthology.orchestra.run.smithi008.stdout: "event": "done", 2023-08-01T19:56:07.883 INFO:teuthology.orchestra.run.smithi008.stdout: "time": "2023-08-01T19:55:09.351817+0000", 2023-08-01T19:56:07.883 INFO:teuthology.orchestra.run.smithi008.stdout: "duration": 3.9765000000000003e-05 2023-08-01T19:56:07.884 INFO:teuthology.orchestra.run.smithi008.stdout: } 2023-08-01T19:56:07.884 INFO:teuthology.orchestra.run.smithi008.stdout: ] 2023-08-01T19:56:07.884 INFO:teuthology.orchestra.run.smithi008.stdout: } 2023-08-01T19:56:07.884 INFO:teuthology.orchestra.run.smithi008.stdout: }, 2023-08-01T19:56:07.884 INFO:teuthology.orchestra.run.smithi008.stdout: { 2023-08-01T19:56:07.884 INFO:teuthology.orchestra.run.smithi008.stdout: "description": "osd_op(client.4668.0:107874 5.3 5:ce4c2799:::benchmark_data_smithi006_114134_object107873:head [set-alloc-hint object_size 65536 write_size 65536,write 0~65536] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e38)", 2023-08-01T19:56:07.884 INFO:teuthology.orchestra.run.smithi008.stdout: "initiated_at": "2023-08-01T19:55:09.286239+0000", 2023-08-01T19:56:07.884 INFO:teuthology.orchestra.run.smithi008.stdout: "age": 58.520505497000002, 2023-08-01T19:56:07.885 INFO:teuthology.orchestra.run.smithi008.stdout: "duration": 0.068224389999999996, 2023-08-01T19:56:07.885 INFO:teuthology.orchestra.run.smithi008.stdout: "type_data": { 2023-08-01T19:56:07.885 INFO:teuthology.orchestra.run.smithi008.stdout: "flag_point": "commit sent; apply or cleanup", 2023-08-01T19:56:07.885 INFO:teuthology.orchestra.run.smithi008.stdout: "client_info": { 2023-08-01T19:56:07.885 INFO:teuthology.orchestra.run.smithi008.stdout: "client": "client.4668", 2023-08-01T19:56:07.885 INFO:teuthology.orchestra.run.smithi008.stdout: "client_addr": "172.21.15.6:0/1709472247", 2023-08-01T19:56:07.885 INFO:teuthology.orchestra.run.smithi008.stdout: "tid": 107874 2023-08-01T19:56:07.886 INFO:teuthology.orchestra.run.smithi008.stdout: }, 2023-08-01T19:56:07.886 INFO:teuthology.orchestra.run.smithi008.stdout: "events": [ 2023-08-01T19:56:07.886 INFO:teuthology.orchestra.run.smithi008.stdout: { 2023-08-01T19:56:07.886 INFO:teuthology.orchestra.run.smithi008.stdout: "event": "initiated", 2023-08-01T19:56:07.886 INFO:teuthology.orchestra.run.smithi008.stdout: "time": "2023-08-01T19:55:09.286239+0000", 2023-08-01T19:56:07.886 INFO:teuthology.orchestra.run.smithi008.stdout: "duration": 0 2023-08-01T19:56:07.886 INFO:teuthology.orchestra.run.smithi008.stdout: }, 2023-08-01T19:56:07.886 INFO:teuthology.orchestra.run.smithi008.stdout: { 2023-08-01T19:56:07.887 INFO:teuthology.orchestra.run.smithi008.stdout: "event": "throttled", 2023-08-01T19:56:07.887 INFO:teuthology.orchestra.run.smithi008.stdout: "time": "2023-08-01T19:55:09.286239+0000", 2023-08-01T19:56:07.887 INFO:teuthology.orchestra.run.smithi008.stdout: "duration": 0 2023-08-01T19:56:07.887 INFO:teuthology.orchestra.run.smithi008.stdout: }, 2023-08-01T19:56:07.887 INFO:teuthology.orchestra.run.smithi008.stdout: { 2023-08-01T19:56:07.887 INFO:teuthology.orchestra.run.smithi008.stdout: "event": "header_read", 2023-08-01T19:56:07.887 INFO:teuthology.orchestra.run.smithi008.stdout: "time": "2023-08-01T19:55:09.286238+0000", 2023-08-01T19:56:07.887 INFO:teuthology.orchestra.run.smithi008.stdout: "duration": 4294967295.999999 2023-08-01T19:56:07.888 INFO:teuthology.orchestra.run.smithi008.stdout: }, 2023-08-01T19:56:07.888 INFO:teuthology.orchestra.run.smithi008.stdout: { 2023-08-01T19:56:07.888 INFO:teuthology.orchestra.run.smithi008.stdout: "event": "all_read", 2023-08-01T19:56:07.888 INFO:teuthology.orchestra.run.smithi008.stdout: "time": "2023-08-01T19:55:09.286310+0000", 2023-08-01T19:56:07.888 INFO:teuthology.orchestra.run.smithi008.stdout: "duration": 7.2583999999999995e-05 2023-08-01T19:56:07.888 INFO:teuthology.orchestra.run.smithi008.stdout: }, 2023-08-01T19:56:07.888 INFO:teuthology.orchestra.run.smithi008.stdout: { 2023-08-01T19:56:07.888 INFO:teuthology.orchestra.run.smithi008.stdout: "event": "dispatched", 2023-08-01T19:56:07.889 INFO:teuthology.orchestra.run.smithi008.stdout: "time": "2023-08-01T19:55:09.286323+0000", 2023-08-01T19:56:07.889 INFO:teuthology.orchestra.run.smithi008.stdout: "duration": 1.3151e-05 2023-08-01T19:56:07.889 INFO:teuthology.orchestra.run.smithi008.stdout: }, 2023-08-01T19:56:07.889 INFO:teuthology.orchestra.run.smithi008.stdout: { 2023-08-01T19:56:07.889 INFO:teuthology.orchestra.run.smithi008.stdout: "event": "queued_for_pg", 2023-08-01T19:56:07.889 INFO:teuthology.orchestra.run.smithi008.stdout: "time": "2023-08-01T19:55:09.286329+0000", 2023-08-01T19:56:07.889 INFO:teuthology.orchestra.run.smithi008.stdout: "duration": 5.8719999999999999e-06 2023-08-01T19:56:07.889 INFO:teuthology.orchestra.run.smithi008.stdout: }, 2023-08-01T19:56:07.890 INFO:teuthology.orchestra.run.smithi008.stdout: { 2023-08-01T19:56:07.890 INFO:teuthology.orchestra.run.smithi008.stdout: "event": "reached_pg", 2023-08-01T19:56:07.890 INFO:teuthology.orchestra.run.smithi008.stdout: "time": "2023-08-01T19:55:09.286392+0000", 2023-08-01T19:56:07.890 INFO:teuthology.orchestra.run.smithi008.stdout: "duration": 6.2378000000000005e-05 2023-08-01T19:56:07.890 INFO:teuthology.orchestra.run.smithi008.stdout: }, 2023-08-01T19:56:07.890 INFO:teuthology.orchestra.run.smithi008.stdout: { 2023-08-01T19:56:07.890 INFO:teuthology.orchestra.run.smithi008.stdout: "event": "started", 2023-08-01T19:56:07.890 INFO:teuthology.orchestra.run.smithi008.stdout: "time": "2023-08-01T19:55:09.286473+0000", 2023-08-01T19:56:07.891 INFO:teuthology.orchestra.run.smithi008.stdout: "duration": 8.1327000000000002e-05 2023-08-01T19:56:07.891 INFO:teuthology.orchestra.run.smithi008.stdout: }, 2023-08-01T19:56:07.891 INFO:teuthology.orchestra.run.smithi008.stdout: { 2023-08-01T19:56:07.891 INFO:teuthology.orchestra.run.smithi008.stdout: "event": "waiting for subops from 1", 2023-08-01T19:56:07.891 INFO:teuthology.orchestra.run.smithi008.stdout: "time": "2023-08-01T19:55:09.286557+0000", 2023-08-01T19:56:07.891 INFO:teuthology.orchestra.run.smithi008.stdout: "duration": 8.4140000000000004e-05 2023-08-01T19:56:07.891 INFO:teuthology.orchestra.run.smithi008.stdout: }, 2023-08-01T19:56:07.892 INFO:teuthology.orchestra.run.smithi008.stdout: { 2023-08-01T19:56:07.892 INFO:teuthology.orchestra.run.smithi008.stdout: "event": "op_commit", 2023-08-01T19:56:07.892 INFO:teuthology.orchestra.run.smithi008.stdout: "time": "2023-08-01T19:55:09.290681+0000", 2023-08-01T19:56:07.892 INFO:teuthology.orchestra.run.smithi008.stdout: "duration": 0.0041242420000000002 2023-08-01T19:56:07.892 INFO:teuthology.orchestra.run.smithi008.stdout: }, 2023-08-01T19:56:07.892 INFO:teuthology.orchestra.run.smithi008.stdout: { 2023-08-01T19:56:07.892 INFO:teuthology.orchestra.run.smithi008.stdout: "event": "sub_op_commit_rec", 2023-08-01T19:56:07.892 INFO:teuthology.orchestra.run.smithi008.stdout: "time": "2023-08-01T19:55:09.354372+0000", 2023-08-01T19:56:07.893 INFO:teuthology.orchestra.run.smithi008.stdout: "duration": 0.063690438000000002 2023-08-01T19:56:07.893 INFO:teuthology.orchestra.run.smithi008.stdout: }, 2023-08-01T19:56:07.893 INFO:teuthology.orchestra.run.smithi008.stdout: { 2023-08-01T19:56:07.893 INFO:teuthology.orchestra.run.smithi008.stdout: "event": "commit_sent", 2023-08-01T19:56:07.893 INFO:teuthology.orchestra.run.smithi008.stdout: "time": "2023-08-01T19:55:09.354421+0000", 2023-08-01T19:56:07.893 INFO:teuthology.orchestra.run.smithi008.stdout: "duration": 4.9413000000000003e-05 2023-08-01T19:56:07.893 INFO:teuthology.orchestra.run.smithi008.stdout: }, 2023-08-01T19:56:07.893 INFO:teuthology.orchestra.run.smithi008.stdout: { 2023-08-01T19:56:07.894 INFO:teuthology.orchestra.run.smithi008.stdout: "event": "done", 2023-08-01T19:56:07.894 INFO:teuthology.orchestra.run.smithi008.stdout: "time": "2023-08-01T19:55:09.354463+0000", 2023-08-01T19:56:07.894 INFO:teuthology.orchestra.run.smithi008.stdout: "duration": 4.1924e-05 2023-08-01T19:56:07.894 INFO:teuthology.orchestra.run.smithi008.stdout: } 2023-08-01T19:56:07.894 INFO:teuthology.orchestra.run.smithi008.stdout: ] 2023-08-01T19:56:07.894 INFO:teuthology.orchestra.run.smithi008.stdout: } 2023-08-01T19:56:07.894 INFO:teuthology.orchestra.run.smithi008.stdout: }, 2023-08-01T19:56:07.894 INFO:teuthology.orchestra.run.smithi008.stdout: { 2023-08-01T19:56:07.895 INFO:teuthology.orchestra.run.smithi008.stdout: "description": "osd_op(client.4668.0:197398 5.1 5:809d7164:::benchmark_data_smithi006_114134_object63737:head [delete] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e61)", 2023-08-01T19:56:07.895 INFO:teuthology.orchestra.run.smithi008.stdout: "initiated_at": "2023-08-01T19:55:58.554713+0000", 2023-08-01T19:56:07.895 INFO:teuthology.orchestra.run.smithi008.stdout: "age": 9.2520308090000007, 2023-08-01T19:56:07.895 INFO:teuthology.orchestra.run.smithi008.stdout: "duration": 1.0661326660000001, 2023-08-01T19:56:07.895 INFO:teuthology.orchestra.run.smithi008.stdout: "type_data": { 2023-08-01T19:56:07.895 INFO:teuthology.orchestra.run.smithi008.stdout: "flag_point": "reached pg", 2023-08-01T19:56:07.895 INFO:teuthology.orchestra.run.smithi008.stdout: "client_info": { 2023-08-01T19:56:07.895 INFO:teuthology.orchestra.run.smithi008.stdout: "client": "client.4668", 2023-08-01T19:56:07.896 INFO:teuthology.orchestra.run.smithi008.stdout: "client_addr": "172.21.15.6:0/1709472247", 2023-08-01T19:56:07.896 INFO:teuthology.orchestra.run.smithi008.stdout: "tid": 197398 2023-08-01T19:56:07.896 INFO:teuthology.orchestra.run.smithi008.stdout: }, 2023-08-01T19:56:07.896 INFO:teuthology.orchestra.run.smithi008.stdout: "events": [ 2023-08-01T19:56:07.896 INFO:teuthology.orchestra.run.smithi008.stdout: { 2023-08-01T19:56:07.896 INFO:teuthology.orchestra.run.smithi008.stdout: "event": "initiated", 2023-08-01T19:56:07.896 INFO:teuthology.orchestra.run.smithi008.stdout: "time": "2023-08-01T19:55:58.554713+0000", 2023-08-01T19:56:07.897 INFO:teuthology.orchestra.run.smithi008.stdout: "duration": 0 2023-08-01T19:56:07.897 INFO:teuthology.orchestra.run.smithi008.stdout: }, 2023-08-01T19:56:07.897 INFO:teuthology.orchestra.run.smithi008.stdout: { 2023-08-01T19:56:07.897 INFO:teuthology.orchestra.run.smithi008.stdout: "event": "throttled", 2023-08-01T19:56:07.897 INFO:teuthology.orchestra.run.smithi008.stdout: "time": "2023-08-01T19:55:58.554713+0000", 2023-08-01T19:56:07.897 INFO:teuthology.orchestra.run.smithi008.stdout: "duration": 0 2023-08-01T19:56:07.897 INFO:teuthology.orchestra.run.smithi008.stdout: }, 2023-08-01T19:56:07.897 INFO:teuthology.orchestra.run.smithi008.stdout: { 2023-08-01T19:56:07.898 INFO:teuthology.orchestra.run.smithi008.stdout: "event": "header_read", 2023-08-01T19:56:07.898 INFO:teuthology.orchestra.run.smithi008.stdout: "time": "2023-08-01T19:55:58.554713+0000", 2023-08-01T19:56:07.898 INFO:teuthology.orchestra.run.smithi008.stdout: "duration": 4294967295.999999 2023-08-01T19:56:07.898 INFO:teuthology.orchestra.run.smithi008.stdout: }, 2023-08-01T19:56:07.898 INFO:teuthology.orchestra.run.smithi008.stdout: { 2023-08-01T19:56:07.898 INFO:teuthology.orchestra.run.smithi008.stdout: "event": "all_read", 2023-08-01T19:56:07.898 INFO:teuthology.orchestra.run.smithi008.stdout: "time": "2023-08-01T19:55:58.554717+0000", 2023-08-01T19:56:07.898 INFO:teuthology.orchestra.run.smithi008.stdout: "duration": 4.7389999999999999e-06 2023-08-01T19:56:07.899 INFO:teuthology.orchestra.run.smithi008.stdout: }, 2023-08-01T19:56:07.899 INFO:teuthology.orchestra.run.smithi008.stdout: { 2023-08-01T19:56:07.899 INFO:teuthology.orchestra.run.smithi008.stdout: "event": "dispatched", 2023-08-01T19:56:07.899 INFO:teuthology.orchestra.run.smithi008.stdout: "time": "2023-08-01T19:55:58.554725+0000", 2023-08-01T19:56:07.899 INFO:teuthology.orchestra.run.smithi008.stdout: "duration": 7.9820000000000008e-06 2023-08-01T19:56:07.899 INFO:teuthology.orchestra.run.smithi008.stdout: }, 2023-08-01T19:56:07.899 INFO:teuthology.orchestra.run.smithi008.stdout: { 2023-08-01T19:56:07.899 INFO:teuthology.orchestra.run.smithi008.stdout: "event": "queued_for_pg", 2023-08-01T19:56:07.900 INFO:teuthology.orchestra.run.smithi008.stdout: "time": "2023-08-01T19:55:58.554730+0000", 2023-08-01T19:56:07.900 INFO:teuthology.orchestra.run.smithi008.stdout: "duration": 4.318e-06 2023-08-01T19:56:07.900 INFO:teuthology.orchestra.run.smithi008.stdout: }, 2023-08-01T19:56:07.900 INFO:teuthology.orchestra.run.smithi008.stdout: { 2023-08-01T19:56:07.900 INFO:teuthology.orchestra.run.smithi008.stdout: "event": "reached_pg", 2023-08-01T19:56:07.900 INFO:teuthology.orchestra.run.smithi008.stdout: "time": "2023-08-01T19:55:58.554767+0000", 2023-08-01T19:56:07.900 INFO:teuthology.orchestra.run.smithi008.stdout: "duration": 3.7778000000000003e-05 2023-08-01T19:56:07.900 INFO:teuthology.orchestra.run.smithi008.stdout: }, 2023-08-01T19:56:07.901 INFO:teuthology.orchestra.run.smithi008.stdout: { 2023-08-01T19:56:07.901 INFO:teuthology.orchestra.run.smithi008.stdout: "event": "started", 2023-08-01T19:56:07.901 INFO:teuthology.orchestra.run.smithi008.stdout: "time": "2023-08-01T19:55:58.554874+0000", 2023-08-01T19:56:07.901 INFO:teuthology.orchestra.run.smithi008.stdout: "duration": 0.000106613 2023-08-01T19:56:07.901 INFO:teuthology.orchestra.run.smithi008.stdout: }, 2023-08-01T19:56:07.901 INFO:teuthology.orchestra.run.smithi008.stdout: { 2023-08-01T19:56:07.901 INFO:teuthology.orchestra.run.smithi008.stdout: "event": "waiting for subops from 1", 2023-08-01T19:56:07.902 INFO:teuthology.orchestra.run.smithi008.stdout: "time": "2023-08-01T19:55:58.554941+0000", 2023-08-01T19:56:07.902 INFO:teuthology.orchestra.run.smithi008.stdout: "duration": 6.6569000000000006e-05 2023-08-01T19:56:07.902 INFO:teuthology.orchestra.run.smithi008.stdout: }, 2023-08-01T19:56:07.902 INFO:teuthology.orchestra.run.smithi008.stdout: { 2023-08-01T19:56:07.902 INFO:teuthology.orchestra.run.smithi008.stdout: "event": "reached_pg", 2023-08-01T19:56:07.902 INFO:teuthology.orchestra.run.smithi008.stdout: "time": "2023-08-01T19:55:58.569436+0000", 2023-08-01T19:56:07.902 INFO:teuthology.orchestra.run.smithi008.stdout: "duration": 0.014495413 2023-08-01T19:56:07.902 INFO:teuthology.orchestra.run.smithi008.stdout: }, 2023-08-01T19:56:07.903 INFO:teuthology.orchestra.run.smithi008.stdout: { 2023-08-01T19:56:07.903 INFO:teuthology.orchestra.run.smithi008.stdout: "event": "waiting for peered", 2023-08-01T19:56:07.903 INFO:teuthology.orchestra.run.smithi008.stdout: "time": "2023-08-01T19:55:58.569441+0000", 2023-08-01T19:56:07.903 INFO:teuthology.orchestra.run.smithi008.stdout: "duration": 5.1109999999999999e-06 2023-08-01T19:56:07.903 INFO:teuthology.orchestra.run.smithi008.stdout: }, 2023-08-01T19:56:07.903 INFO:teuthology.orchestra.run.smithi008.stdout: { 2023-08-01T19:56:07.903 INFO:teuthology.orchestra.run.smithi008.stdout: "event": "reached_pg", 2023-08-01T19:56:07.903 INFO:teuthology.orchestra.run.smithi008.stdout: "time": "2023-08-01T19:55:59.620748+0000", 2023-08-01T19:56:07.904 INFO:teuthology.orchestra.run.smithi008.stdout: "duration": 1.0513071810000001 2023-08-01T19:56:07.904 INFO:teuthology.orchestra.run.smithi008.stdout: }, 2023-08-01T19:56:07.904 INFO:teuthology.orchestra.run.smithi008.stdout: { 2023-08-01T19:56:07.904 INFO:teuthology.orchestra.run.smithi008.stdout: "event": "done", 2023-08-01T19:56:07.904 INFO:teuthology.orchestra.run.smithi008.stdout: "time": "2023-08-01T19:55:59.620846+0000", 2023-08-01T19:56:07.904 INFO:teuthology.orchestra.run.smithi008.stdout: "duration": 9.7739999999999996e-05 2023-08-01T19:56:07.904 INFO:teuthology.orchestra.run.smithi008.stdout: } 2023-08-01T19:56:07.904 INFO:teuthology.orchestra.run.smithi008.stdout: ] 2023-08-01T19:56:07.905 INFO:teuthology.orchestra.run.smithi008.stdout: } 2023-08-01T19:56:07.905 INFO:teuthology.orchestra.run.smithi008.stdout: }, 2023-08-01T19:56:07.905 INFO:teuthology.orchestra.run.smithi008.stdout: { 2023-08-01T19:56:07.905 INFO:teuthology.orchestra.run.smithi008.stdout: "description": "osd_op(client.4668.0:197400 5.c 5:30dad7f9:::benchmark_data_smithi006_114134_object63739:head [delete] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e61)", 2023-08-01T19:56:07.905 INFO:teuthology.orchestra.run.smithi008.stdout: "initiated_at": "2023-08-01T19:55:58.556576+0000", 2023-08-01T19:56:07.905 INFO:teuthology.orchestra.run.smithi008.stdout: "age": 9.2501679600000006, 2023-08-01T19:56:07.905 INFO:teuthology.orchestra.run.smithi008.stdout: "duration": 1.062559968, 2023-08-01T19:56:07.906 INFO:teuthology.orchestra.run.smithi008.stdout: "type_data": { 2023-08-01T19:56:07.906 INFO:teuthology.orchestra.run.smithi008.stdout: "flag_point": "reached pg", 2023-08-01T19:56:07.906 INFO:teuthology.orchestra.run.smithi008.stdout: "client_info": { 2023-08-01T19:56:07.906 INFO:teuthology.orchestra.run.smithi008.stdout: "client": "client.4668", 2023-08-01T19:56:07.906 INFO:teuthology.orchestra.run.smithi008.stdout: "client_addr": "172.21.15.6:0/1709472247", 2023-08-01T19:56:07.906 INFO:teuthology.orchestra.run.smithi008.stdout: "tid": 197400 2023-08-01T19:56:07.906 INFO:teuthology.orchestra.run.smithi008.stdout: }, 2023-08-01T19:56:07.906 INFO:teuthology.orchestra.run.smithi008.stdout: "events": [ 2023-08-01T19:56:07.907 INFO:teuthology.orchestra.run.smithi008.stdout: { 2023-08-01T19:56:07.907 INFO:teuthology.orchestra.run.smithi008.stdout: "event": "initiated", 2023-08-01T19:56:07.907 INFO:teuthology.orchestra.run.smithi008.stdout: "time": "2023-08-01T19:55:58.556576+0000", 2023-08-01T19:56:07.907 INFO:teuthology.orchestra.run.smithi008.stdout: "duration": 0 2023-08-01T19:56:07.907 INFO:teuthology.orchestra.run.smithi008.stdout: }, 2023-08-01T19:56:07.907 INFO:teuthology.orchestra.run.smithi008.stdout: { 2023-08-01T19:56:07.907 INFO:teuthology.orchestra.run.smithi008.stdout: "event": "throttled", 2023-08-01T19:56:07.907 INFO:teuthology.orchestra.run.smithi008.stdout: "time": "2023-08-01T19:55:58.556576+0000", 2023-08-01T19:56:07.908 INFO:teuthology.orchestra.run.smithi008.stdout: "duration": 0 2023-08-01T19:56:07.908 INFO:teuthology.orchestra.run.smithi008.stdout: }, 2023-08-01T19:56:07.908 INFO:teuthology.orchestra.run.smithi008.stdout: { 2023-08-01T19:56:07.908 INFO:teuthology.orchestra.run.smithi008.stdout: "event": "header_read", 2023-08-01T19:56:07.908 INFO:teuthology.orchestra.run.smithi008.stdout: "time": "2023-08-01T19:55:58.556575+0000", 2023-08-01T19:56:07.908 INFO:teuthology.orchestra.run.smithi008.stdout: "duration": 4294967295.999999 2023-08-01T19:56:07.908 INFO:teuthology.orchestra.run.smithi008.stdout: }, 2023-08-01T19:56:07.909 INFO:teuthology.orchestra.run.smithi008.stdout: { 2023-08-01T19:56:07.909 INFO:teuthology.orchestra.run.smithi008.stdout: "event": "all_read", 2023-08-01T19:56:07.909 INFO:teuthology.orchestra.run.smithi008.stdout: "time": "2023-08-01T19:55:58.556580+0000", 2023-08-01T19:56:07.909 INFO:teuthology.orchestra.run.smithi008.stdout: "duration": 4.2860000000000001e-06 2023-08-01T19:56:07.909 INFO:teuthology.orchestra.run.smithi008.stdout: }, 2023-08-01T19:56:07.909 INFO:teuthology.orchestra.run.smithi008.stdout: { 2023-08-01T19:56:07.909 INFO:teuthology.orchestra.run.smithi008.stdout: "event": "dispatched", 2023-08-01T19:56:07.909 INFO:teuthology.orchestra.run.smithi008.stdout: "time": "2023-08-01T19:55:58.556589+0000", 2023-08-01T19:56:07.910 INFO:teuthology.orchestra.run.smithi008.stdout: "duration": 9.6500000000000008e-06 2023-08-01T19:56:07.910 INFO:teuthology.orchestra.run.smithi008.stdout: }, 2023-08-01T19:56:07.910 INFO:teuthology.orchestra.run.smithi008.stdout: { 2023-08-01T19:56:07.910 INFO:teuthology.orchestra.run.smithi008.stdout: "event": "queued_for_pg", 2023-08-01T19:56:07.910 INFO:teuthology.orchestra.run.smithi008.stdout: "time": "2023-08-01T19:55:58.556596+0000", 2023-08-01T19:56:07.910 INFO:teuthology.orchestra.run.smithi008.stdout: "duration": 6.1430000000000003e-06 2023-08-01T19:56:07.910 INFO:teuthology.orchestra.run.smithi008.stdout: }, 2023-08-01T19:56:07.910 INFO:teuthology.orchestra.run.smithi008.stdout: { 2023-08-01T19:56:07.911 INFO:teuthology.orchestra.run.smithi008.stdout: "event": "reached_pg", 2023-08-01T19:56:07.911 INFO:teuthology.orchestra.run.smithi008.stdout: "time": "2023-08-01T19:55:58.556634+0000", 2023-08-01T19:56:07.911 INFO:teuthology.orchestra.run.smithi008.stdout: "duration": 3.8080000000000001e-05 2023-08-01T19:56:07.911 INFO:teuthology.orchestra.run.smithi008.stdout: }, 2023-08-01T19:56:07.911 INFO:teuthology.orchestra.run.smithi008.stdout: { 2023-08-01T19:56:07.911 INFO:teuthology.orchestra.run.smithi008.stdout: "event": "started", 2023-08-01T19:56:07.911 INFO:teuthology.orchestra.run.smithi008.stdout: "time": "2023-08-01T19:55:58.556754+0000", 2023-08-01T19:56:07.911 INFO:teuthology.orchestra.run.smithi008.stdout: "duration": 0.000120444 2023-08-01T19:56:07.912 INFO:teuthology.orchestra.run.smithi008.stdout: }, 2023-08-01T19:56:07.912 INFO:teuthology.orchestra.run.smithi008.stdout: { 2023-08-01T19:56:07.912 INFO:teuthology.orchestra.run.smithi008.stdout: "event": "waiting for subops from 1", 2023-08-01T19:56:07.912 INFO:teuthology.orchestra.run.smithi008.stdout: "time": "2023-08-01T19:55:58.556875+0000", 2023-08-01T19:56:07.912 INFO:teuthology.orchestra.run.smithi008.stdout: "duration": 0.00012100900000000001 2023-08-01T19:56:07.912 INFO:teuthology.orchestra.run.smithi008.stdout: }, 2023-08-01T19:56:07.912 INFO:teuthology.orchestra.run.smithi008.stdout: { 2023-08-01T19:56:07.912 INFO:teuthology.orchestra.run.smithi008.stdout: "event": "reached_pg", 2023-08-01T19:56:07.913 INFO:teuthology.orchestra.run.smithi008.stdout: "time": "2023-08-01T19:55:58.567406+0000", 2023-08-01T19:56:07.913 INFO:teuthology.orchestra.run.smithi008.stdout: "duration": 0.010531351 2023-08-01T19:56:07.913 INFO:teuthology.orchestra.run.smithi008.stdout: }, 2023-08-01T19:56:07.913 INFO:teuthology.orchestra.run.smithi008.stdout: { 2023-08-01T19:56:07.913 INFO:teuthology.orchestra.run.smithi008.stdout: "event": "waiting for peered", 2023-08-01T19:56:07.913 INFO:teuthology.orchestra.run.smithi008.stdout: "time": "2023-08-01T19:55:58.567414+0000", 2023-08-01T19:56:07.913 INFO:teuthology.orchestra.run.smithi008.stdout: "duration": 7.9189999999999999e-06 2023-08-01T19:56:07.914 INFO:teuthology.orchestra.run.smithi008.stdout: }, 2023-08-01T19:56:07.914 INFO:teuthology.orchestra.run.smithi008.stdout: { 2023-08-01T19:56:07.914 INFO:teuthology.orchestra.run.smithi008.stdout: "event": "reached_pg", 2023-08-01T19:56:07.914 INFO:teuthology.orchestra.run.smithi008.stdout: "time": "2023-08-01T19:55:59.619054+0000", 2023-08-01T19:56:07.914 INFO:teuthology.orchestra.run.smithi008.stdout: "duration": 1.0516396269999999 2023-08-01T19:56:07.914 INFO:teuthology.orchestra.run.smithi008.stdout: }, 2023-08-01T19:56:07.914 INFO:teuthology.orchestra.run.smithi008.stdout: { 2023-08-01T19:56:07.914 INFO:teuthology.orchestra.run.smithi008.stdout: "event": "done", 2023-08-01T19:56:07.915 INFO:teuthology.orchestra.run.smithi008.stdout: "time": "2023-08-01T19:55:59.619136+0000", 2023-08-01T19:56:07.915 INFO:teuthology.orchestra.run.smithi008.stdout: "duration": 8.2208999999999998e-05 2023-08-01T19:56:07.915 INFO:teuthology.orchestra.run.smithi008.stdout: } 2023-08-01T19:56:07.915 INFO:teuthology.orchestra.run.smithi008.stdout: ] 2023-08-01T19:56:07.915 INFO:teuthology.orchestra.run.smithi008.stdout: } 2023-08-01T19:56:07.915 INFO:teuthology.orchestra.run.smithi008.stdout: }, 2023-08-01T19:56:07.915 INFO:teuthology.orchestra.run.smithi008.stdout: { 2023-08-01T19:56:07.915 INFO:teuthology.orchestra.run.smithi008.stdout: "description": "osd_op(client.4668.0:197401 5.1 5:88b38567:::benchmark_data_smithi006_114134_object63740:head [delete] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e61)", 2023-08-01T19:56:07.916 INFO:teuthology.orchestra.run.smithi008.stdout: "initiated_at": "2023-08-01T19:55:58.556607+0000", 2023-08-01T19:56:07.916 INFO:teuthology.orchestra.run.smithi008.stdout: "age": 9.2501375360000004, 2023-08-01T19:56:07.916 INFO:teuthology.orchestra.run.smithi008.stdout: "duration": 1.0643254870000001, 2023-08-01T19:56:07.916 INFO:teuthology.orchestra.run.smithi008.stdout: "type_data": { 2023-08-01T19:56:07.916 INFO:teuthology.orchestra.run.smithi008.stdout: "flag_point": "reached pg", 2023-08-01T19:56:07.916 INFO:teuthology.orchestra.run.smithi008.stdout: "client_info": { 2023-08-01T19:56:07.916 INFO:teuthology.orchestra.run.smithi008.stdout: "client": "client.4668", 2023-08-01T19:56:07.917 INFO:teuthology.orchestra.run.smithi008.stdout: "client_addr": "172.21.15.6:0/1709472247", 2023-08-01T19:56:07.917 INFO:teuthology.orchestra.run.smithi008.stdout: "tid": 197401 2023-08-01T19:56:07.917 INFO:teuthology.orchestra.run.smithi008.stdout: }, 2023-08-01T19:56:07.917 INFO:teuthology.orchestra.run.smithi008.stdout: "events": [ 2023-08-01T19:56:07.917 INFO:teuthology.orchestra.run.smithi008.stdout: { 2023-08-01T19:56:07.917 INFO:teuthology.orchestra.run.smithi008.stdout: "event": "initiated", 2023-08-01T19:56:07.917 INFO:teuthology.orchestra.run.smithi008.stdout: "time": "2023-08-01T19:55:58.556607+0000", 2023-08-01T19:56:07.917 INFO:teuthology.orchestra.run.smithi008.stdout: "duration": 0 2023-08-01T19:56:07.918 INFO:teuthology.orchestra.run.smithi008.stdout: }, 2023-08-01T19:56:07.918 INFO:teuthology.orchestra.run.smithi008.stdout: { 2023-08-01T19:56:07.918 INFO:teuthology.orchestra.run.smithi008.stdout: "event": "throttled", 2023-08-01T19:56:07.918 INFO:teuthology.orchestra.run.smithi008.stdout: "time": "2023-08-01T19:55:58.556607+0000", 2023-08-01T19:56:07.918 INFO:teuthology.orchestra.run.smithi008.stdout: "duration": 0 2023-08-01T19:56:07.918 INFO:teuthology.orchestra.run.smithi008.stdout: }, 2023-08-01T19:56:07.918 INFO:teuthology.orchestra.run.smithi008.stdout: { 2023-08-01T19:56:07.918 INFO:teuthology.orchestra.run.smithi008.stdout: "event": "header_read", 2023-08-01T19:56:07.919 INFO:teuthology.orchestra.run.smithi008.stdout: "time": "2023-08-01T19:55:58.556606+0000", 2023-08-01T19:56:07.919 INFO:teuthology.orchestra.run.smithi008.stdout: "duration": 4294967295.9999995 2023-08-01T19:56:07.919 INFO:teuthology.orchestra.run.smithi008.stdout: }, 2023-08-01T19:56:07.919 INFO:teuthology.orchestra.run.smithi008.stdout: { 2023-08-01T19:56:07.919 INFO:teuthology.orchestra.run.smithi008.stdout: "event": "all_read", 2023-08-01T19:56:07.919 INFO:teuthology.orchestra.run.smithi008.stdout: "time": "2023-08-01T19:55:58.556609+0000", 2023-08-01T19:56:07.919 INFO:teuthology.orchestra.run.smithi008.stdout: "duration": 3.1750000000000001e-06 2023-08-01T19:56:07.919 INFO:teuthology.orchestra.run.smithi008.stdout: }, 2023-08-01T19:56:07.920 INFO:teuthology.orchestra.run.smithi008.stdout: { 2023-08-01T19:56:07.920 INFO:teuthology.orchestra.run.smithi008.stdout: "event": "dispatched", 2023-08-01T19:56:07.920 INFO:teuthology.orchestra.run.smithi008.stdout: "time": "2023-08-01T19:55:58.556617+0000", 2023-08-01T19:56:07.920 INFO:teuthology.orchestra.run.smithi008.stdout: "duration": 7.2760000000000003e-06 2023-08-01T19:56:07.920 INFO:teuthology.orchestra.run.smithi008.stdout: }, 2023-08-01T19:56:07.920 INFO:teuthology.orchestra.run.smithi008.stdout: { 2023-08-01T19:56:07.920 INFO:teuthology.orchestra.run.smithi008.stdout: "event": "queued_for_pg", 2023-08-01T19:56:07.920 INFO:teuthology.orchestra.run.smithi008.stdout: "time": "2023-08-01T19:55:58.556621+0000", 2023-08-01T19:56:07.921 INFO:teuthology.orchestra.run.smithi008.stdout: "duration": 4.8219999999999997e-06 2023-08-01T19:56:07.921 INFO:teuthology.orchestra.run.smithi008.stdout: }, 2023-08-01T19:56:07.921 INFO:teuthology.orchestra.run.smithi008.stdout: { 2023-08-01T19:56:07.921 INFO:teuthology.orchestra.run.smithi008.stdout: "event": "reached_pg", 2023-08-01T19:56:07.921 INFO:teuthology.orchestra.run.smithi008.stdout: "time": "2023-08-01T19:55:58.556651+0000", 2023-08-01T19:56:07.921 INFO:teuthology.orchestra.run.smithi008.stdout: "duration": 2.9921999999999999e-05 2023-08-01T19:56:07.921 INFO:teuthology.orchestra.run.smithi008.stdout: }, 2023-08-01T19:56:07.922 INFO:teuthology.orchestra.run.smithi008.stdout: { 2023-08-01T19:56:07.922 INFO:teuthology.orchestra.run.smithi008.stdout: "event": "started", 2023-08-01T19:56:07.922 INFO:teuthology.orchestra.run.smithi008.stdout: "time": "2023-08-01T19:55:58.556755+0000", 2023-08-01T19:56:07.922 INFO:teuthology.orchestra.run.smithi008.stdout: "duration": 0.000103309 2023-08-01T19:56:07.922 INFO:teuthology.orchestra.run.smithi008.stdout: }, 2023-08-01T19:56:07.922 INFO:teuthology.orchestra.run.smithi008.stdout: { 2023-08-01T19:56:07.922 INFO:teuthology.orchestra.run.smithi008.stdout: "event": "waiting for subops from 1", 2023-08-01T19:56:07.922 INFO:teuthology.orchestra.run.smithi008.stdout: "time": "2023-08-01T19:55:58.556875+0000", 2023-08-01T19:56:07.923 INFO:teuthology.orchestra.run.smithi008.stdout: "duration": 0.000120424 2023-08-01T19:56:07.923 INFO:teuthology.orchestra.run.smithi008.stdout: }, 2023-08-01T19:56:07.923 INFO:teuthology.orchestra.run.smithi008.stdout: { 2023-08-01T19:56:07.923 INFO:teuthology.orchestra.run.smithi008.stdout: "event": "reached_pg", 2023-08-01T19:56:07.923 INFO:teuthology.orchestra.run.smithi008.stdout: "time": "2023-08-01T19:55:58.569459+0000", 2023-08-01T19:56:07.923 INFO:teuthology.orchestra.run.smithi008.stdout: "duration": 0.012583776 2023-08-01T19:56:07.923 INFO:teuthology.orchestra.run.smithi008.stdout: }, 2023-08-01T19:56:07.923 INFO:teuthology.orchestra.run.smithi008.stdout: { 2023-08-01T19:56:07.924 INFO:teuthology.orchestra.run.smithi008.stdout: "event": "waiting for peered", 2023-08-01T19:56:07.924 INFO:teuthology.orchestra.run.smithi008.stdout: "time": "2023-08-01T19:55:58.569462+0000", 2023-08-01T19:56:07.924 INFO:teuthology.orchestra.run.smithi008.stdout: "duration": 2.74e-06 2023-08-01T19:56:07.924 INFO:teuthology.orchestra.run.smithi008.stdout: }, 2023-08-01T19:56:07.924 INFO:teuthology.orchestra.run.smithi008.stdout: { 2023-08-01T19:56:07.924 INFO:teuthology.orchestra.run.smithi008.stdout: "event": "reached_pg", 2023-08-01T19:56:07.924 INFO:teuthology.orchestra.run.smithi008.stdout: "time": "2023-08-01T19:55:59.620880+0000", 2023-08-01T19:56:07.924 INFO:teuthology.orchestra.run.smithi008.stdout: "duration": 1.0514181279999999 2023-08-01T19:56:07.925 INFO:teuthology.orchestra.run.smithi008.stdout: }, 2023-08-01T19:56:07.925 INFO:teuthology.orchestra.run.smithi008.stdout: { 2023-08-01T19:56:07.925 INFO:teuthology.orchestra.run.smithi008.stdout: "event": "done", 2023-08-01T19:56:07.925 INFO:teuthology.orchestra.run.smithi008.stdout: "time": "2023-08-01T19:55:59.620932+0000", 2023-08-01T19:56:07.925 INFO:teuthology.orchestra.run.smithi008.stdout: "duration": 5.2404000000000002e-05 2023-08-01T19:56:07.925 INFO:teuthology.orchestra.run.smithi008.stdout: } 2023-08-01T19:56:07.925 INFO:teuthology.orchestra.run.smithi008.stdout: ] 2023-08-01T19:56:07.925 INFO:teuthology.orchestra.run.smithi008.stdout: } 2023-08-01T19:56:07.926 INFO:teuthology.orchestra.run.smithi008.stdout: }, 2023-08-01T19:56:07.926 INFO:teuthology.orchestra.run.smithi008.stdout: { 2023-08-01T19:56:07.926 INFO:teuthology.orchestra.run.smithi008.stdout: "description": "osd_op(client.4668.0:197402 5.c 5:3f057b78:::benchmark_data_smithi006_114134_object63741:head [delete] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e61)", 2023-08-01T19:56:07.926 INFO:teuthology.orchestra.run.smithi008.stdout: "initiated_at": "2023-08-01T19:55:58.556632+0000", 2023-08-01T19:56:07.926 INFO:teuthology.orchestra.run.smithi008.stdout: "age": 9.2501121659999992, 2023-08-01T19:56:07.926 INFO:teuthology.orchestra.run.smithi008.stdout: "duration": 1.0625773970000001, 2023-08-01T19:56:07.926 INFO:teuthology.orchestra.run.smithi008.stdout: "type_data": { 2023-08-01T19:56:07.926 INFO:teuthology.orchestra.run.smithi008.stdout: "flag_point": "reached pg", 2023-08-01T19:56:07.927 INFO:teuthology.orchestra.run.smithi008.stdout: "client_info": { 2023-08-01T19:56:07.927 INFO:teuthology.orchestra.run.smithi008.stdout: "client": "client.4668", 2023-08-01T19:56:07.927 INFO:teuthology.orchestra.run.smithi008.stdout: "client_addr": "172.21.15.6:0/1709472247", 2023-08-01T19:56:07.927 INFO:teuthology.orchestra.run.smithi008.stdout: "tid": 197402 2023-08-01T19:56:07.927 INFO:teuthology.orchestra.run.smithi008.stdout: }, 2023-08-01T19:56:07.927 INFO:teuthology.orchestra.run.smithi008.stdout: "events": [ 2023-08-01T19:56:07.927 INFO:teuthology.orchestra.run.smithi008.stdout: { 2023-08-01T19:56:07.927 INFO:teuthology.orchestra.run.smithi008.stdout: "event": "initiated", 2023-08-01T19:56:07.928 INFO:teuthology.orchestra.run.smithi008.stdout: "time": "2023-08-01T19:55:58.556632+0000", 2023-08-01T19:56:07.928 INFO:teuthology.orchestra.run.smithi008.stdout: "duration": 0 2023-08-01T19:56:07.928 INFO:teuthology.orchestra.run.smithi008.stdout: }, 2023-08-01T19:56:07.928 INFO:teuthology.orchestra.run.smithi008.stdout: { 2023-08-01T19:56:07.928 INFO:teuthology.orchestra.run.smithi008.stdout: "event": "throttled", 2023-08-01T19:56:07.928 INFO:teuthology.orchestra.run.smithi008.stdout: "time": "2023-08-01T19:55:58.556632+0000", 2023-08-01T19:56:07.928 INFO:teuthology.orchestra.run.smithi008.stdout: "duration": 0 2023-08-01T19:56:07.929 INFO:teuthology.orchestra.run.smithi008.stdout: }, 2023-08-01T19:56:07.929 INFO:teuthology.orchestra.run.smithi008.stdout: { 2023-08-01T19:56:07.929 INFO:teuthology.orchestra.run.smithi008.stdout: "event": "header_read", 2023-08-01T19:56:07.929 INFO:teuthology.orchestra.run.smithi008.stdout: "time": "2023-08-01T19:55:58.556632+0000", 2023-08-01T19:56:07.929 INFO:teuthology.orchestra.run.smithi008.stdout: "duration": 4294967295.9999995 2023-08-01T19:56:07.929 INFO:teuthology.orchestra.run.smithi008.stdout: }, 2023-08-01T19:56:07.929 INFO:teuthology.orchestra.run.smithi008.stdout: { 2023-08-01T19:56:07.929 INFO:teuthology.orchestra.run.smithi008.stdout: "event": "all_read", 2023-08-01T19:56:07.930 INFO:teuthology.orchestra.run.smithi008.stdout: "time": "2023-08-01T19:55:58.556634+0000", 2023-08-01T19:56:07.930 INFO:teuthology.orchestra.run.smithi008.stdout: "duration": 2.8940000000000002e-06 2023-08-01T19:56:07.930 INFO:teuthology.orchestra.run.smithi008.stdout: }, 2023-08-01T19:56:07.930 INFO:teuthology.orchestra.run.smithi008.stdout: { 2023-08-01T19:56:07.930 INFO:teuthology.orchestra.run.smithi008.stdout: "event": "dispatched", 2023-08-01T19:56:07.930 INFO:teuthology.orchestra.run.smithi008.stdout: "time": "2023-08-01T19:55:58.556641+0000", 2023-08-01T19:56:07.930 INFO:teuthology.orchestra.run.smithi008.stdout: "duration": 6.8449999999999997e-06 2023-08-01T19:56:07.930 INFO:teuthology.orchestra.run.smithi008.stdout: }, 2023-08-01T19:56:07.931 INFO:teuthology.orchestra.run.smithi008.stdout: { 2023-08-01T19:56:07.931 INFO:teuthology.orchestra.run.smithi008.stdout: "event": "queued_for_pg", 2023-08-01T19:56:07.931 INFO:teuthology.orchestra.run.smithi008.stdout: "time": "2023-08-01T19:55:58.556646+0000", 2023-08-01T19:56:07.931 INFO:teuthology.orchestra.run.smithi008.stdout: "duration": 5.2070000000000003e-06 2023-08-01T19:56:07.931 INFO:teuthology.orchestra.run.smithi008.stdout: }, 2023-08-01T19:56:07.931 INFO:teuthology.orchestra.run.smithi008.stdout: { 2023-08-01T19:56:07.931 INFO:teuthology.orchestra.run.smithi008.stdout: "event": "reached_pg", 2023-08-01T19:56:07.931 INFO:teuthology.orchestra.run.smithi008.stdout: "time": "2023-08-01T19:55:58.558870+0000", 2023-08-01T19:56:07.932 INFO:teuthology.orchestra.run.smithi008.stdout: "duration": 0.0022237730000000001 2023-08-01T19:56:07.932 INFO:teuthology.orchestra.run.smithi008.stdout: }, 2023-08-01T19:56:07.932 INFO:teuthology.orchestra.run.smithi008.stdout: { 2023-08-01T19:56:07.932 INFO:teuthology.orchestra.run.smithi008.stdout: "event": "started", 2023-08-01T19:56:07.932 INFO:teuthology.orchestra.run.smithi008.stdout: "time": "2023-08-01T19:55:58.559013+0000", 2023-08-01T19:56:07.932 INFO:teuthology.orchestra.run.smithi008.stdout: "duration": 0.00014289899999999999 2023-08-01T19:56:07.932 INFO:teuthology.orchestra.run.smithi008.stdout: }, 2023-08-01T19:56:07.933 INFO:teuthology.orchestra.run.smithi008.stdout: { 2023-08-01T19:56:07.933 INFO:teuthology.orchestra.run.smithi008.stdout: "event": "waiting for subops from 1", 2023-08-01T19:56:07.933 INFO:teuthology.orchestra.run.smithi008.stdout: "time": "2023-08-01T19:55:58.559137+0000", 2023-08-01T19:56:07.933 INFO:teuthology.orchestra.run.smithi008.stdout: "duration": 0.00012428499999999999 2023-08-01T19:56:07.933 INFO:teuthology.orchestra.run.smithi008.stdout: }, 2023-08-01T19:56:07.933 INFO:teuthology.orchestra.run.smithi008.stdout: { 2023-08-01T19:56:07.933 INFO:teuthology.orchestra.run.smithi008.stdout: "event": "reached_pg", 2023-08-01T19:56:07.933 INFO:teuthology.orchestra.run.smithi008.stdout: "time": "2023-08-01T19:55:58.567438+0000", 2023-08-01T19:56:07.934 INFO:teuthology.orchestra.run.smithi008.stdout: "duration": 0.0083003190000000004 2023-08-01T19:56:07.934 INFO:teuthology.orchestra.run.smithi008.stdout: }, 2023-08-01T19:56:07.934 INFO:teuthology.orchestra.run.smithi008.stdout: { 2023-08-01T19:56:07.934 INFO:teuthology.orchestra.run.smithi008.stdout: "event": "waiting for peered", 2023-08-01T19:56:07.934 INFO:teuthology.orchestra.run.smithi008.stdout: "time": "2023-08-01T19:55:58.567443+0000", 2023-08-01T19:56:07.934 INFO:teuthology.orchestra.run.smithi008.stdout: "duration": 5.1739999999999999e-06 2023-08-01T19:56:07.934 INFO:teuthology.orchestra.run.smithi008.stdout: }, 2023-08-01T19:56:07.934 INFO:teuthology.orchestra.run.smithi008.stdout: { 2023-08-01T19:56:07.935 INFO:teuthology.orchestra.run.smithi008.stdout: "event": "reached_pg", 2023-08-01T19:56:07.935 INFO:teuthology.orchestra.run.smithi008.stdout: "time": "2023-08-01T19:55:59.619164+0000", 2023-08-01T19:56:07.935 INFO:teuthology.orchestra.run.smithi008.stdout: "duration": 1.0517206750000001 2023-08-01T19:56:07.935 INFO:teuthology.orchestra.run.smithi008.stdout: }, 2023-08-01T19:56:07.935 INFO:teuthology.orchestra.run.smithi008.stdout: { 2023-08-01T19:56:07.935 INFO:teuthology.orchestra.run.smithi008.stdout: "event": "done", 2023-08-01T19:56:07.935 INFO:teuthology.orchestra.run.smithi008.stdout: "time": "2023-08-01T19:55:59.619209+0000", 2023-08-01T19:56:07.935 INFO:teuthology.orchestra.run.smithi008.stdout: "duration": 4.5800000000000002e-05 2023-08-01T19:56:07.936 INFO:teuthology.orchestra.run.smithi008.stdout: } 2023-08-01T19:56:07.936 INFO:teuthology.orchestra.run.smithi008.stdout: ] 2023-08-01T19:56:07.936 INFO:teuthology.orchestra.run.smithi008.stdout: } 2023-08-01T19:56:07.936 INFO:teuthology.orchestra.run.smithi008.stdout: }, 2023-08-01T19:56:07.936 INFO:teuthology.orchestra.run.smithi008.stdout: { 2023-08-01T19:56:07.936 INFO:teuthology.orchestra.run.smithi008.stdout: "description": "osd_op(client.4668.0:197404 5.5 5:a3c9c1bd:::benchmark_data_smithi006_114134_object63743:head [delete] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e61)", 2023-08-01T19:56:07.936 INFO:teuthology.orchestra.run.smithi008.stdout: "initiated_at": "2023-08-01T19:55:58.556653+0000", 2023-08-01T19:56:07.937 INFO:teuthology.orchestra.run.smithi008.stdout: "age": 9.2500912119999992, 2023-08-01T19:56:07.937 INFO:teuthology.orchestra.run.smithi008.stdout: "duration": 1.061865576, 2023-08-01T19:56:07.937 INFO:teuthology.orchestra.run.smithi008.stdout: "type_data": { 2023-08-01T19:56:07.937 INFO:teuthology.orchestra.run.smithi008.stdout: "flag_point": "reached pg", 2023-08-01T19:56:07.937 INFO:teuthology.orchestra.run.smithi008.stdout: "client_info": { 2023-08-01T19:56:07.937 INFO:teuthology.orchestra.run.smithi008.stdout: "client": "client.4668", 2023-08-01T19:56:07.937 INFO:teuthology.orchestra.run.smithi008.stdout: "client_addr": "172.21.15.6:0/1709472247", 2023-08-01T19:56:07.937 INFO:teuthology.orchestra.run.smithi008.stdout: "tid": 197404 2023-08-01T19:56:07.938 INFO:teuthology.orchestra.run.smithi008.stdout: }, 2023-08-01T19:56:07.938 INFO:teuthology.orchestra.run.smithi008.stdout: "events": [ 2023-08-01T19:56:07.938 INFO:teuthology.orchestra.run.smithi008.stdout: { 2023-08-01T19:56:07.938 INFO:teuthology.orchestra.run.smithi008.stdout: "event": "initiated", 2023-08-01T19:56:07.938 INFO:teuthology.orchestra.run.smithi008.stdout: "time": "2023-08-01T19:55:58.556653+0000", 2023-08-01T19:56:07.938 INFO:teuthology.orchestra.run.smithi008.stdout: "duration": 0 2023-08-01T19:56:07.938 INFO:teuthology.orchestra.run.smithi008.stdout: }, 2023-08-01T19:56:07.938 INFO:teuthology.orchestra.run.smithi008.stdout: { 2023-08-01T19:56:07.939 INFO:teuthology.orchestra.run.smithi008.stdout: "event": "throttled", 2023-08-01T19:56:07.939 INFO:teuthology.orchestra.run.smithi008.stdout: "time": "2023-08-01T19:55:58.556653+0000", 2023-08-01T19:56:07.939 INFO:teuthology.orchestra.run.smithi008.stdout: "duration": 0 2023-08-01T19:56:07.939 INFO:teuthology.orchestra.run.smithi008.stdout: }, 2023-08-01T19:56:07.939 INFO:teuthology.orchestra.run.smithi008.stdout: { 2023-08-01T19:56:07.939 INFO:teuthology.orchestra.run.smithi008.stdout: "event": "header_read", 2023-08-01T19:56:07.939 INFO:teuthology.orchestra.run.smithi008.stdout: "time": "2023-08-01T19:55:58.556653+0000", 2023-08-01T19:56:07.939 INFO:teuthology.orchestra.run.smithi008.stdout: "duration": 4294967295.9999995 2023-08-01T19:56:07.940 INFO:teuthology.orchestra.run.smithi008.stdout: }, 2023-08-01T19:56:07.940 INFO:teuthology.orchestra.run.smithi008.stdout: { 2023-08-01T19:56:07.940 INFO:teuthology.orchestra.run.smithi008.stdout: "event": "all_read", 2023-08-01T19:56:07.940 INFO:teuthology.orchestra.run.smithi008.stdout: "time": "2023-08-01T19:55:58.556655+0000", 2023-08-01T19:56:07.940 INFO:teuthology.orchestra.run.smithi008.stdout: "duration": 2.435e-06 2023-08-01T19:56:07.940 INFO:teuthology.orchestra.run.smithi008.stdout: }, 2023-08-01T19:56:07.940 INFO:teuthology.orchestra.run.smithi008.stdout: { 2023-08-01T19:56:07.940 INFO:teuthology.orchestra.run.smithi008.stdout: "event": "dispatched", 2023-08-01T19:56:07.941 INFO:teuthology.orchestra.run.smithi008.stdout: "time": "2023-08-01T19:55:58.556661+0000", 2023-08-01T19:56:07.941 INFO:teuthology.orchestra.run.smithi008.stdout: "duration": 6.0599999999999996e-06 2023-08-01T19:56:07.941 INFO:teuthology.orchestra.run.smithi008.stdout: }, 2023-08-01T19:56:07.941 INFO:teuthology.orchestra.run.smithi008.stdout: { 2023-08-01T19:56:07.941 INFO:teuthology.orchestra.run.smithi008.stdout: "event": "queued_for_pg", 2023-08-01T19:56:07.941 INFO:teuthology.orchestra.run.smithi008.stdout: "time": "2023-08-01T19:55:58.556666+0000", 2023-08-01T19:56:07.941 INFO:teuthology.orchestra.run.smithi008.stdout: "duration": 4.9620000000000001e-06 2023-08-01T19:56:07.942 INFO:teuthology.orchestra.run.smithi008.stdout: }, 2023-08-01T19:56:07.942 INFO:teuthology.orchestra.run.smithi008.stdout: { 2023-08-01T19:56:07.942 INFO:teuthology.orchestra.run.smithi008.stdout: "event": "reached_pg", 2023-08-01T19:56:07.942 INFO:teuthology.orchestra.run.smithi008.stdout: "time": "2023-08-01T19:55:58.556698+0000", 2023-08-01T19:56:07.942 INFO:teuthology.orchestra.run.smithi008.stdout: "duration": 3.2302999999999999e-05 2023-08-01T19:56:07.942 INFO:teuthology.orchestra.run.smithi008.stdout: }, 2023-08-01T19:56:07.942 INFO:teuthology.orchestra.run.smithi008.stdout: { 2023-08-01T19:56:07.942 INFO:teuthology.orchestra.run.smithi008.stdout: "event": "started", 2023-08-01T19:56:07.943 INFO:teuthology.orchestra.run.smithi008.stdout: "time": "2023-08-01T19:55:58.556773+0000", 2023-08-01T19:56:07.943 INFO:teuthology.orchestra.run.smithi008.stdout: "duration": 7.4431999999999995e-05 2023-08-01T19:56:07.943 INFO:teuthology.orchestra.run.smithi008.stdout: }, 2023-08-01T19:56:07.943 INFO:teuthology.orchestra.run.smithi008.stdout: { 2023-08-01T19:56:07.943 INFO:teuthology.orchestra.run.smithi008.stdout: "event": "waiting for subops from 1", 2023-08-01T19:56:07.943 INFO:teuthology.orchestra.run.smithi008.stdout: "time": "2023-08-01T19:55:58.556837+0000", 2023-08-01T19:56:07.943 INFO:teuthology.orchestra.run.smithi008.stdout: "duration": 6.4522000000000003e-05 2023-08-01T19:56:07.943 INFO:teuthology.orchestra.run.smithi008.stdout: }, 2023-08-01T19:56:07.944 INFO:teuthology.orchestra.run.smithi008.stdout: { 2023-08-01T19:56:07.944 INFO:teuthology.orchestra.run.smithi008.stdout: "event": "reached_pg", 2023-08-01T19:56:07.944 INFO:teuthology.orchestra.run.smithi008.stdout: "time": "2023-08-01T19:55:58.563930+0000", 2023-08-01T19:56:07.944 INFO:teuthology.orchestra.run.smithi008.stdout: "duration": 0.0070929030000000002 2023-08-01T19:56:07.944 INFO:teuthology.orchestra.run.smithi008.stdout: }, 2023-08-01T19:56:07.944 INFO:teuthology.orchestra.run.smithi008.stdout: { 2023-08-01T19:56:07.944 INFO:teuthology.orchestra.run.smithi008.stdout: "event": "waiting for peered", 2023-08-01T19:56:07.945 INFO:teuthology.orchestra.run.smithi008.stdout: "time": "2023-08-01T19:55:58.563939+0000", 2023-08-01T19:56:07.945 INFO:teuthology.orchestra.run.smithi008.stdout: "duration": 8.6079999999999996e-06 2023-08-01T19:56:07.945 INFO:teuthology.orchestra.run.smithi008.stdout: }, 2023-08-01T19:56:07.945 INFO:teuthology.orchestra.run.smithi008.stdout: { 2023-08-01T19:56:07.945 INFO:teuthology.orchestra.run.smithi008.stdout: "event": "reached_pg", 2023-08-01T19:56:07.945 INFO:teuthology.orchestra.run.smithi008.stdout: "time": "2023-08-01T19:55:59.618422+0000", 2023-08-01T19:56:07.945 INFO:teuthology.orchestra.run.smithi008.stdout: "duration": 1.054483295 2023-08-01T19:56:07.945 INFO:teuthology.orchestra.run.smithi008.stdout: }, 2023-08-01T19:56:07.946 INFO:teuthology.orchestra.run.smithi008.stdout: { 2023-08-01T19:56:07.946 INFO:teuthology.orchestra.run.smithi008.stdout: "event": "done", 2023-08-01T19:56:07.946 INFO:teuthology.orchestra.run.smithi008.stdout: "time": "2023-08-01T19:55:59.618519+0000", 2023-08-01T19:56:07.946 INFO:teuthology.orchestra.run.smithi008.stdout: "duration": 9.6471000000000005e-05 2023-08-01T19:56:07.946 INFO:teuthology.orchestra.run.smithi008.stdout: } 2023-08-01T19:56:07.946 INFO:teuthology.orchestra.run.smithi008.stdout: ] 2023-08-01T19:56:07.946 INFO:teuthology.orchestra.run.smithi008.stdout: } 2023-08-01T19:56:07.946 INFO:teuthology.orchestra.run.smithi008.stdout: }, 2023-08-01T19:56:07.947 INFO:teuthology.orchestra.run.smithi008.stdout: { 2023-08-01T19:56:07.947 INFO:teuthology.orchestra.run.smithi008.stdout: "description": "osd_op(client.4668.0:197407 5.1 5:85528fae:::benchmark_data_smithi006_114134_object63746:head [delete] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e61)", 2023-08-01T19:56:07.947 INFO:teuthology.orchestra.run.smithi008.stdout: "initiated_at": "2023-08-01T19:55:58.559216+0000", 2023-08-01T19:56:07.947 INFO:teuthology.orchestra.run.smithi008.stdout: "age": 9.2475285639999996, 2023-08-01T19:56:07.947 INFO:teuthology.orchestra.run.smithi008.stdout: "duration": 1.061802277, 2023-08-01T19:56:07.947 INFO:teuthology.orchestra.run.smithi008.stdout: "type_data": { 2023-08-01T19:56:07.947 INFO:teuthology.orchestra.run.smithi008.stdout: "flag_point": "reached pg", 2023-08-01T19:56:07.947 INFO:teuthology.orchestra.run.smithi008.stdout: "client_info": { 2023-08-01T19:56:07.948 INFO:teuthology.orchestra.run.smithi008.stdout: "client": "client.4668", 2023-08-01T19:56:07.948 INFO:teuthology.orchestra.run.smithi008.stdout: "client_addr": "172.21.15.6:0/1709472247", 2023-08-01T19:56:07.948 INFO:teuthology.orchestra.run.smithi008.stdout: "tid": 197407 2023-08-01T19:56:07.948 INFO:teuthology.orchestra.run.smithi008.stdout: }, 2023-08-01T19:56:07.948 INFO:teuthology.orchestra.run.smithi008.stdout: "events": [ 2023-08-01T19:56:07.948 INFO:teuthology.orchestra.run.smithi008.stdout: { 2023-08-01T19:56:07.948 INFO:teuthology.orchestra.run.smithi008.stdout: "event": "initiated", 2023-08-01T19:56:07.949 INFO:teuthology.orchestra.run.smithi008.stdout: "time": "2023-08-01T19:55:58.559216+0000", 2023-08-01T19:56:07.949 INFO:teuthology.orchestra.run.smithi008.stdout: "duration": 0 2023-08-01T19:56:07.949 INFO:teuthology.orchestra.run.smithi008.stdout: }, 2023-08-01T19:56:07.949 INFO:teuthology.orchestra.run.smithi008.stdout: { 2023-08-01T19:56:07.949 INFO:teuthology.orchestra.run.smithi008.stdout: "event": "throttled", 2023-08-01T19:56:07.949 INFO:teuthology.orchestra.run.smithi008.stdout: "time": "2023-08-01T19:55:58.559216+0000", 2023-08-01T19:56:07.949 INFO:teuthology.orchestra.run.smithi008.stdout: "duration": 0 2023-08-01T19:56:07.949 INFO:teuthology.orchestra.run.smithi008.stdout: }, 2023-08-01T19:56:07.950 INFO:teuthology.orchestra.run.smithi008.stdout: { 2023-08-01T19:56:07.950 INFO:teuthology.orchestra.run.smithi008.stdout: "event": "header_read", 2023-08-01T19:56:07.950 INFO:teuthology.orchestra.run.smithi008.stdout: "time": "2023-08-01T19:55:58.559215+0000", 2023-08-01T19:56:07.950 INFO:teuthology.orchestra.run.smithi008.stdout: "duration": 4294967295.999999 2023-08-01T19:56:07.950 INFO:teuthology.orchestra.run.smithi008.stdout: }, 2023-08-01T19:56:07.950 INFO:teuthology.orchestra.run.smithi008.stdout: { 2023-08-01T19:56:07.950 INFO:teuthology.orchestra.run.smithi008.stdout: "event": "all_read", 2023-08-01T19:56:07.950 INFO:teuthology.orchestra.run.smithi008.stdout: "time": "2023-08-01T19:55:58.559220+0000", 2023-08-01T19:56:07.951 INFO:teuthology.orchestra.run.smithi008.stdout: "duration": 5.3879999999999999e-06 2023-08-01T19:56:07.951 INFO:teuthology.orchestra.run.smithi008.stdout: }, 2023-08-01T19:56:07.951 INFO:teuthology.orchestra.run.smithi008.stdout: { 2023-08-01T19:56:07.951 INFO:teuthology.orchestra.run.smithi008.stdout: "event": "dispatched", 2023-08-01T19:56:07.951 INFO:teuthology.orchestra.run.smithi008.stdout: "time": "2023-08-01T19:55:58.559230+0000", 2023-08-01T19:56:07.951 INFO:teuthology.orchestra.run.smithi008.stdout: "duration": 9.6590000000000002e-06 2023-08-01T19:56:07.951 INFO:teuthology.orchestra.run.smithi008.stdout: }, 2023-08-01T19:56:07.951 INFO:teuthology.orchestra.run.smithi008.stdout: { 2023-08-01T19:56:07.952 INFO:teuthology.orchestra.run.smithi008.stdout: "event": "queued_for_pg", 2023-08-01T19:56:07.952 INFO:teuthology.orchestra.run.smithi008.stdout: "time": "2023-08-01T19:55:58.559235+0000", 2023-08-01T19:56:07.952 INFO:teuthology.orchestra.run.smithi008.stdout: "duration": 5.575e-06 2023-08-01T19:56:07.952 INFO:teuthology.orchestra.run.smithi008.stdout: }, 2023-08-01T19:56:07.952 INFO:teuthology.orchestra.run.smithi008.stdout: { 2023-08-01T19:56:07.952 INFO:teuthology.orchestra.run.smithi008.stdout: "event": "reached_pg", 2023-08-01T19:56:07.952 INFO:teuthology.orchestra.run.smithi008.stdout: "time": "2023-08-01T19:55:58.559279+0000", 2023-08-01T19:56:07.953 INFO:teuthology.orchestra.run.smithi008.stdout: "duration": 4.3273999999999999e-05 2023-08-01T19:56:07.953 INFO:teuthology.orchestra.run.smithi008.stdout: }, 2023-08-01T19:56:07.953 INFO:teuthology.orchestra.run.smithi008.stdout: { 2023-08-01T19:56:07.953 INFO:teuthology.orchestra.run.smithi008.stdout: "event": "started", 2023-08-01T19:56:07.953 INFO:teuthology.orchestra.run.smithi008.stdout: "time": "2023-08-01T19:55:58.559403+0000", 2023-08-01T19:56:07.953 INFO:teuthology.orchestra.run.smithi008.stdout: "duration": 0.000124781 2023-08-01T19:56:07.953 INFO:teuthology.orchestra.run.smithi008.stdout: }, 2023-08-01T19:56:07.953 INFO:teuthology.orchestra.run.smithi008.stdout: { 2023-08-01T19:56:07.954 INFO:teuthology.orchestra.run.smithi008.stdout: "event": "waiting for subops from 1", 2023-08-01T19:56:07.954 INFO:teuthology.orchestra.run.smithi008.stdout: "time": "2023-08-01T19:55:58.559561+0000", 2023-08-01T19:56:07.954 INFO:teuthology.orchestra.run.smithi008.stdout: "duration": 0.000157773 2023-08-01T19:56:07.954 INFO:teuthology.orchestra.run.smithi008.stdout: }, 2023-08-01T19:56:07.954 INFO:teuthology.orchestra.run.smithi008.stdout: { 2023-08-01T19:56:07.954 INFO:teuthology.orchestra.run.smithi008.stdout: "event": "reached_pg", 2023-08-01T19:56:07.954 INFO:teuthology.orchestra.run.smithi008.stdout: "time": "2023-08-01T19:55:58.569498+0000", 2023-08-01T19:56:07.954 INFO:teuthology.orchestra.run.smithi008.stdout: "duration": 0.0099367069999999995 2023-08-01T19:56:07.955 INFO:teuthology.orchestra.run.smithi008.stdout: }, 2023-08-01T19:56:07.955 INFO:teuthology.orchestra.run.smithi008.stdout: { 2023-08-01T19:56:07.955 INFO:teuthology.orchestra.run.smithi008.stdout: "event": "waiting for peered", 2023-08-01T19:56:07.955 INFO:teuthology.orchestra.run.smithi008.stdout: "time": "2023-08-01T19:55:58.569756+0000", 2023-08-01T19:56:07.955 INFO:teuthology.orchestra.run.smithi008.stdout: "duration": 0.00025830800000000001 2023-08-01T19:56:07.955 INFO:teuthology.orchestra.run.smithi008.stdout: }, 2023-08-01T19:56:07.955 INFO:teuthology.orchestra.run.smithi008.stdout: { 2023-08-01T19:56:07.955 INFO:teuthology.orchestra.run.smithi008.stdout: "event": "reached_pg", 2023-08-01T19:56:07.956 INFO:teuthology.orchestra.run.smithi008.stdout: "time": "2023-08-01T19:55:59.620962+0000", 2023-08-01T19:56:07.956 INFO:teuthology.orchestra.run.smithi008.stdout: "duration": 1.0512062129999999 2023-08-01T19:56:07.956 INFO:teuthology.orchestra.run.smithi008.stdout: }, 2023-08-01T19:56:07.956 INFO:teuthology.orchestra.run.smithi008.stdout: { 2023-08-01T19:56:07.956 INFO:teuthology.orchestra.run.smithi008.stdout: "event": "done", 2023-08-01T19:56:07.956 INFO:teuthology.orchestra.run.smithi008.stdout: "time": "2023-08-01T19:55:59.621018+0000", 2023-08-01T19:56:07.956 INFO:teuthology.orchestra.run.smithi008.stdout: "duration": 5.5498999999999998e-05 2023-08-01T19:56:07.956 INFO:teuthology.orchestra.run.smithi008.stdout: } 2023-08-01T19:56:07.957 INFO:teuthology.orchestra.run.smithi008.stdout: ] 2023-08-01T19:56:07.957 INFO:teuthology.orchestra.run.smithi008.stdout: } 2023-08-01T19:56:07.957 INFO:teuthology.orchestra.run.smithi008.stdout: }, 2023-08-01T19:56:07.957 INFO:teuthology.orchestra.run.smithi008.stdout: { 2023-08-01T19:56:07.957 INFO:teuthology.orchestra.run.smithi008.stdout: "description": "osd_op(client.4668.0:197396 5.2 5:43f8487b:::benchmark_data_smithi006_114134_object63735:head [delete] snapc 0=[] RETRY=1 ondisk+retry+write+known_if_redirected+supports_pool_eio e62)", 2023-08-01T19:56:07.957 INFO:teuthology.orchestra.run.smithi008.stdout: "initiated_at": "2023-08-01T19:55:58.564585+0000", 2023-08-01T19:56:07.957 INFO:teuthology.orchestra.run.smithi008.stdout: "age": 9.24215959, 2023-08-01T19:56:07.957 INFO:teuthology.orchestra.run.smithi008.stdout: "duration": 1.0535085049999999, 2023-08-01T19:56:07.958 INFO:teuthology.orchestra.run.smithi008.stdout: "type_data": { 2023-08-01T19:56:07.958 INFO:teuthology.orchestra.run.smithi008.stdout: "flag_point": "reached pg", 2023-08-01T19:56:07.958 INFO:teuthology.orchestra.run.smithi008.stdout: "client_info": { 2023-08-01T19:56:07.958 INFO:teuthology.orchestra.run.smithi008.stdout: "client": "client.4668", 2023-08-01T19:56:07.958 INFO:teuthology.orchestra.run.smithi008.stdout: "client_addr": "172.21.15.6:0/1709472247", 2023-08-01T19:56:07.958 INFO:teuthology.orchestra.run.smithi008.stdout: "tid": 197396 2023-08-01T19:56:07.958 INFO:teuthology.orchestra.run.smithi008.stdout: }, 2023-08-01T19:56:07.959 INFO:teuthology.orchestra.run.smithi008.stdout: "events": [ 2023-08-01T19:56:07.959 INFO:teuthology.orchestra.run.smithi008.stdout: { 2023-08-01T19:56:07.959 INFO:teuthology.orchestra.run.smithi008.stdout: "event": "initiated", 2023-08-01T19:56:07.959 INFO:teuthology.orchestra.run.smithi008.stdout: "time": "2023-08-01T19:55:58.564585+0000", 2023-08-01T19:56:07.959 INFO:teuthology.orchestra.run.smithi008.stdout: "duration": 0 2023-08-01T19:56:07.959 INFO:teuthology.orchestra.run.smithi008.stdout: }, 2023-08-01T19:56:07.959 INFO:teuthology.orchestra.run.smithi008.stdout: { 2023-08-01T19:56:07.959 INFO:teuthology.orchestra.run.smithi008.stdout: "event": "throttled", 2023-08-01T19:56:07.960 INFO:teuthology.orchestra.run.smithi008.stdout: "time": "2023-08-01T19:55:58.564585+0000", 2023-08-01T19:56:07.960 INFO:teuthology.orchestra.run.smithi008.stdout: "duration": 0 2023-08-01T19:56:07.960 INFO:teuthology.orchestra.run.smithi008.stdout: }, 2023-08-01T19:56:07.960 INFO:teuthology.orchestra.run.smithi008.stdout: { 2023-08-01T19:56:07.960 INFO:teuthology.orchestra.run.smithi008.stdout: "event": "header_read", 2023-08-01T19:56:07.960 INFO:teuthology.orchestra.run.smithi008.stdout: "time": "2023-08-01T19:55:58.564583+0000", 2023-08-01T19:56:07.960 INFO:teuthology.orchestra.run.smithi008.stdout: "duration": 4294967295.9999981 2023-08-01T19:56:07.960 INFO:teuthology.orchestra.run.smithi008.stdout: }, 2023-08-01T19:56:07.961 INFO:teuthology.orchestra.run.smithi008.stdout: { 2023-08-01T19:56:07.961 INFO:teuthology.orchestra.run.smithi008.stdout: "event": "all_read", 2023-08-01T19:56:07.961 INFO:teuthology.orchestra.run.smithi008.stdout: "time": "2023-08-01T19:55:58.564591+0000", 2023-08-01T19:56:07.961 INFO:teuthology.orchestra.run.smithi008.stdout: "duration": 8.2169999999999994e-06 2023-08-01T19:56:07.961 INFO:teuthology.orchestra.run.smithi008.stdout: }, 2023-08-01T19:56:07.961 INFO:teuthology.orchestra.run.smithi008.stdout: { 2023-08-01T19:56:07.961 INFO:teuthology.orchestra.run.smithi008.stdout: "event": "dispatched", 2023-08-01T19:56:07.961 INFO:teuthology.orchestra.run.smithi008.stdout: "time": "2023-08-01T19:55:58.564603+0000", 2023-08-01T19:56:07.962 INFO:teuthology.orchestra.run.smithi008.stdout: "duration": 1.186e-05 2023-08-01T19:56:07.962 INFO:teuthology.orchestra.run.smithi008.stdout: }, 2023-08-01T19:56:07.962 INFO:teuthology.orchestra.run.smithi008.stdout: { 2023-08-01T19:56:07.962 INFO:teuthology.orchestra.run.smithi008.stdout: "event": "queued_for_pg", 2023-08-01T19:56:07.962 INFO:teuthology.orchestra.run.smithi008.stdout: "time": "2023-08-01T19:55:58.564609+0000", 2023-08-01T19:56:07.962 INFO:teuthology.orchestra.run.smithi008.stdout: "duration": 6.4130000000000003e-06 2023-08-01T19:56:07.962 INFO:teuthology.orchestra.run.smithi008.stdout: }, 2023-08-01T19:56:07.962 INFO:teuthology.orchestra.run.smithi008.stdout: { 2023-08-01T19:56:07.963 INFO:teuthology.orchestra.run.smithi008.stdout: "event": "reached_pg", 2023-08-01T19:56:07.963 INFO:teuthology.orchestra.run.smithi008.stdout: "time": "2023-08-01T19:55:58.573439+0000", 2023-08-01T19:56:07.963 INFO:teuthology.orchestra.run.smithi008.stdout: "duration": 0.0088303310000000003 2023-08-01T19:56:07.963 INFO:teuthology.orchestra.run.smithi008.stdout: }, 2023-08-01T19:56:07.963 INFO:teuthology.orchestra.run.smithi008.stdout: { 2023-08-01T19:56:07.963 INFO:teuthology.orchestra.run.smithi008.stdout: "event": "waiting for peered", 2023-08-01T19:56:07.963 INFO:teuthology.orchestra.run.smithi008.stdout: "time": "2023-08-01T19:55:58.573448+0000", 2023-08-01T19:56:07.963 INFO:teuthology.orchestra.run.smithi008.stdout: "duration": 8.2910000000000007e-06 2023-08-01T19:56:07.964 INFO:teuthology.orchestra.run.smithi008.stdout: }, 2023-08-01T19:56:07.964 INFO:teuthology.orchestra.run.smithi008.stdout: { 2023-08-01T19:56:07.964 INFO:teuthology.orchestra.run.smithi008.stdout: "event": "reached_pg", 2023-08-01T19:56:07.964 INFO:teuthology.orchestra.run.smithi008.stdout: "time": "2023-08-01T19:55:59.617892+0000", 2023-08-01T19:56:07.964 INFO:teuthology.orchestra.run.smithi008.stdout: "duration": 1.0444446380000001 2023-08-01T19:56:07.964 INFO:teuthology.orchestra.run.smithi008.stdout: }, 2023-08-01T19:56:07.964 INFO:teuthology.orchestra.run.smithi008.stdout: { 2023-08-01T19:56:07.965 INFO:teuthology.orchestra.run.smithi008.stdout: "event": "done", 2023-08-01T19:56:07.965 INFO:teuthology.orchestra.run.smithi008.stdout: "time": "2023-08-01T19:55:59.618093+0000", 2023-08-01T19:56:07.965 INFO:teuthology.orchestra.run.smithi008.stdout: "duration": 0.00020066300000000001 2023-08-01T19:56:07.965 INFO:teuthology.orchestra.run.smithi008.stdout: } 2023-08-01T19:56:07.965 INFO:teuthology.orchestra.run.smithi008.stdout: ] 2023-08-01T19:56:07.965 INFO:teuthology.orchestra.run.smithi008.stdout: } 2023-08-01T19:56:07.965 INFO:teuthology.orchestra.run.smithi008.stdout: }, 2023-08-01T19:56:07.965 INFO:teuthology.orchestra.run.smithi008.stdout: { 2023-08-01T19:56:07.966 INFO:teuthology.orchestra.run.smithi008.stdout: "description": "osd_op(client.4668.0:197411 5.7 5:ebefbc20:::benchmark_data_smithi006_114134_object63750:head [delete] snapc 0=[] RETRY=1 ondisk+retry+write+known_if_redirected+supports_pool_eio e62)", 2023-08-01T19:56:07.966 INFO:teuthology.orchestra.run.smithi008.stdout: "initiated_at": "2023-08-01T19:55:58.564619+0000", 2023-08-01T19:56:07.966 INFO:teuthology.orchestra.run.smithi008.stdout: "age": 9.2421249149999998, 2023-08-01T19:56:07.966 INFO:teuthology.orchestra.run.smithi008.stdout: "duration": 1.0686062569999999, 2023-08-01T19:56:07.966 INFO:teuthology.orchestra.run.smithi008.stdout: "type_data": { 2023-08-01T19:56:07.966 INFO:teuthology.orchestra.run.smithi008.stdout: "flag_point": "commit sent; apply or cleanup", 2023-08-01T19:56:07.966 INFO:teuthology.orchestra.run.smithi008.stdout: "client_info": { 2023-08-01T19:56:07.966 INFO:teuthology.orchestra.run.smithi008.stdout: "client": "client.4668", 2023-08-01T19:56:07.967 INFO:teuthology.orchestra.run.smithi008.stdout: "client_addr": "172.21.15.6:0/1709472247", 2023-08-01T19:56:07.967 INFO:teuthology.orchestra.run.smithi008.stdout: "tid": 197411 2023-08-01T19:56:07.967 INFO:teuthology.orchestra.run.smithi008.stdout: }, 2023-08-01T19:56:07.967 INFO:teuthology.orchestra.run.smithi008.stdout: "events": [ 2023-08-01T19:56:07.967 INFO:teuthology.orchestra.run.smithi008.stdout: { 2023-08-01T19:56:07.967 INFO:teuthology.orchestra.run.smithi008.stdout: "event": "initiated", 2023-08-01T19:56:07.967 INFO:teuthology.orchestra.run.smithi008.stdout: "time": "2023-08-01T19:55:58.564619+0000", 2023-08-01T19:56:07.967 INFO:teuthology.orchestra.run.smithi008.stdout: "duration": 0 2023-08-01T19:56:07.968 INFO:teuthology.orchestra.run.smithi008.stdout: }, 2023-08-01T19:56:07.968 INFO:teuthology.orchestra.run.smithi008.stdout: { 2023-08-01T19:56:07.968 INFO:teuthology.orchestra.run.smithi008.stdout: "event": "throttled", 2023-08-01T19:56:07.968 INFO:teuthology.orchestra.run.smithi008.stdout: "time": "2023-08-01T19:55:58.564619+0000", 2023-08-01T19:56:07.968 INFO:teuthology.orchestra.run.smithi008.stdout: "duration": 0 2023-08-01T19:56:07.968 INFO:teuthology.orchestra.run.smithi008.stdout: }, 2023-08-01T19:56:07.968 INFO:teuthology.orchestra.run.smithi008.stdout: { 2023-08-01T19:56:07.969 INFO:teuthology.orchestra.run.smithi008.stdout: "event": "header_read", 2023-08-01T19:56:07.969 INFO:teuthology.orchestra.run.smithi008.stdout: "time": "2023-08-01T19:55:58.564619+0000", 2023-08-01T19:56:07.969 INFO:teuthology.orchestra.run.smithi008.stdout: "duration": 4294967295.9999995 2023-08-01T19:56:07.969 INFO:teuthology.orchestra.run.smithi008.stdout: }, 2023-08-01T19:56:07.969 INFO:teuthology.orchestra.run.smithi008.stdout: { 2023-08-01T19:56:07.969 INFO:teuthology.orchestra.run.smithi008.stdout: "event": "all_read", 2023-08-01T19:56:07.969 INFO:teuthology.orchestra.run.smithi008.stdout: "time": "2023-08-01T19:55:58.564621+0000", 2023-08-01T19:56:07.969 INFO:teuthology.orchestra.run.smithi008.stdout: "duration": 2.6139999999999999e-06 2023-08-01T19:56:07.970 INFO:teuthology.orchestra.run.smithi008.stdout: }, 2023-08-01T19:56:07.970 INFO:teuthology.orchestra.run.smithi008.stdout: { 2023-08-01T19:56:07.970 INFO:teuthology.orchestra.run.smithi008.stdout: "event": "dispatched", 2023-08-01T19:56:07.970 INFO:teuthology.orchestra.run.smithi008.stdout: "time": "2023-08-01T19:55:58.564627+0000", 2023-08-01T19:56:07.970 INFO:teuthology.orchestra.run.smithi008.stdout: "duration": 5.1150000000000002e-06 2023-08-01T19:56:07.970 INFO:teuthology.orchestra.run.smithi008.stdout: }, 2023-08-01T19:56:07.970 INFO:teuthology.orchestra.run.smithi008.stdout: { 2023-08-01T19:56:07.970 INFO:teuthology.orchestra.run.smithi008.stdout: "event": "queued_for_pg", 2023-08-01T19:56:07.971 INFO:teuthology.orchestra.run.smithi008.stdout: "time": "2023-08-01T19:55:58.564631+0000", 2023-08-01T19:56:07.971 INFO:teuthology.orchestra.run.smithi008.stdout: "duration": 4.702e-06 2023-08-01T19:56:07.971 INFO:teuthology.orchestra.run.smithi008.stdout: }, 2023-08-01T19:56:07.971 INFO:teuthology.orchestra.run.smithi008.stdout: { 2023-08-01T19:56:07.971 INFO:teuthology.orchestra.run.smithi008.stdout: "event": "reached_pg", 2023-08-01T19:56:07.971 INFO:teuthology.orchestra.run.smithi008.stdout: "time": "2023-08-01T19:55:58.565520+0000", 2023-08-01T19:56:07.971 INFO:teuthology.orchestra.run.smithi008.stdout: "duration": 0.00088893399999999997 2023-08-01T19:56:07.971 INFO:teuthology.orchestra.run.smithi008.stdout: }, 2023-08-01T19:56:07.972 INFO:teuthology.orchestra.run.smithi008.stdout: { 2023-08-01T19:56:07.972 INFO:teuthology.orchestra.run.smithi008.stdout: "event": "waiting for peered", 2023-08-01T19:56:07.972 INFO:teuthology.orchestra.run.smithi008.stdout: "time": "2023-08-01T19:55:58.565528+0000", 2023-08-01T19:56:07.972 INFO:teuthology.orchestra.run.smithi008.stdout: "duration": 7.5410000000000003e-06 2023-08-01T19:56:07.972 INFO:teuthology.orchestra.run.smithi008.stdout: }, 2023-08-01T19:56:07.972 INFO:teuthology.orchestra.run.smithi008.stdout: { 2023-08-01T19:56:07.972 INFO:teuthology.orchestra.run.smithi008.stdout: "event": "reached_pg", 2023-08-01T19:56:07.972 INFO:teuthology.orchestra.run.smithi008.stdout: "time": "2023-08-01T19:55:59.622374+0000", 2023-08-01T19:56:07.973 INFO:teuthology.orchestra.run.smithi008.stdout: "duration": 1.05684588 2023-08-01T19:56:07.973 INFO:teuthology.orchestra.run.smithi008.stdout: }, 2023-08-01T19:56:07.973 INFO:teuthology.orchestra.run.smithi008.stdout: { 2023-08-01T19:56:07.973 INFO:teuthology.orchestra.run.smithi008.stdout: "event": "started", 2023-08-01T19:56:07.973 INFO:teuthology.orchestra.run.smithi008.stdout: "time": "2023-08-01T19:55:59.624156+0000", 2023-08-01T19:56:07.973 INFO:teuthology.orchestra.run.smithi008.stdout: "duration": 0.0017826129999999999 2023-08-01T19:56:07.973 INFO:teuthology.orchestra.run.smithi008.stdout: }, 2023-08-01T19:56:07.973 INFO:teuthology.orchestra.run.smithi008.stdout: { 2023-08-01T19:56:07.974 INFO:teuthology.orchestra.run.smithi008.stdout: "event": "op_commit", 2023-08-01T19:56:07.974 INFO:teuthology.orchestra.run.smithi008.stdout: "time": "2023-08-01T19:55:59.633131+0000", 2023-08-01T19:56:07.974 INFO:teuthology.orchestra.run.smithi008.stdout: "duration": 0.0089745740000000008 2023-08-01T19:56:07.974 INFO:teuthology.orchestra.run.smithi008.stdout: }, 2023-08-01T19:56:07.974 INFO:teuthology.orchestra.run.smithi008.stdout: { 2023-08-01T19:56:07.974 INFO:teuthology.orchestra.run.smithi008.stdout: "event": "commit_sent", 2023-08-01T19:56:07.974 INFO:teuthology.orchestra.run.smithi008.stdout: "time": "2023-08-01T19:55:59.633173+0000", 2023-08-01T19:56:07.974 INFO:teuthology.orchestra.run.smithi008.stdout: "duration": 4.2645000000000003e-05 2023-08-01T19:56:07.975 INFO:teuthology.orchestra.run.smithi008.stdout: }, 2023-08-01T19:56:07.975 INFO:teuthology.orchestra.run.smithi008.stdout: { 2023-08-01T19:56:07.975 INFO:teuthology.orchestra.run.smithi008.stdout: "event": "done", 2023-08-01T19:56:07.975 INFO:teuthology.orchestra.run.smithi008.stdout: "time": "2023-08-01T19:55:59.633225+0000", 2023-08-01T19:56:07.975 INFO:teuthology.orchestra.run.smithi008.stdout: "duration": 5.2003999999999999e-05 2023-08-01T19:56:07.975 INFO:teuthology.orchestra.run.smithi008.stdout: } 2023-08-01T19:56:07.975 INFO:teuthology.orchestra.run.smithi008.stdout: ] 2023-08-01T19:56:07.976 INFO:teuthology.orchestra.run.smithi008.stdout: } 2023-08-01T19:56:07.976 INFO:teuthology.orchestra.run.smithi008.stdout: }, 2023-08-01T19:56:07.976 INFO:teuthology.orchestra.run.smithi008.stdout: { 2023-08-01T19:56:07.976 INFO:teuthology.orchestra.run.smithi008.stdout: "description": "osd_op(client.4668.0:197413 5.5 5:a6ff9d8a:::benchmark_data_smithi006_114134_object63752:head [delete] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e62)", 2023-08-01T19:56:07.976 INFO:teuthology.orchestra.run.smithi008.stdout: "initiated_at": "2023-08-01T19:55:58.573778+0000", 2023-08-01T19:56:07.976 INFO:teuthology.orchestra.run.smithi008.stdout: "age": 9.2329659490000004, 2023-08-01T19:56:07.976 INFO:teuthology.orchestra.run.smithi008.stdout: "duration": 1.054781371, 2023-08-01T19:56:07.976 INFO:teuthology.orchestra.run.smithi008.stdout: "type_data": { 2023-08-01T19:56:07.977 INFO:teuthology.orchestra.run.smithi008.stdout: "flag_point": "commit sent; apply or cleanup", 2023-08-01T19:56:07.977 INFO:teuthology.orchestra.run.smithi008.stdout: "client_info": { 2023-08-01T19:56:07.977 INFO:teuthology.orchestra.run.smithi008.stdout: "client": "client.4668", 2023-08-01T19:56:07.977 INFO:teuthology.orchestra.run.smithi008.stdout: "client_addr": "172.21.15.6:0/1709472247", 2023-08-01T19:56:07.977 INFO:teuthology.orchestra.run.smithi008.stdout: "tid": 197413 2023-08-01T19:56:07.977 INFO:teuthology.orchestra.run.smithi008.stdout: }, 2023-08-01T19:56:07.977 INFO:teuthology.orchestra.run.smithi008.stdout: "events": [ 2023-08-01T19:56:07.977 INFO:teuthology.orchestra.run.smithi008.stdout: { 2023-08-01T19:56:07.978 INFO:teuthology.orchestra.run.smithi008.stdout: "event": "initiated", 2023-08-01T19:56:07.978 INFO:teuthology.orchestra.run.smithi008.stdout: "time": "2023-08-01T19:55:58.573778+0000", 2023-08-01T19:56:07.978 INFO:teuthology.orchestra.run.smithi008.stdout: "duration": 0 2023-08-01T19:56:07.978 INFO:teuthology.orchestra.run.smithi008.stdout: }, 2023-08-01T19:56:07.978 INFO:teuthology.orchestra.run.smithi008.stdout: { 2023-08-01T19:56:07.978 INFO:teuthology.orchestra.run.smithi008.stdout: "event": "throttled", 2023-08-01T19:56:07.978 INFO:teuthology.orchestra.run.smithi008.stdout: "time": "2023-08-01T19:55:58.573778+0000", 2023-08-01T19:56:07.978 INFO:teuthology.orchestra.run.smithi008.stdout: "duration": 0 2023-08-01T19:56:07.979 INFO:teuthology.orchestra.run.smithi008.stdout: }, 2023-08-01T19:56:07.979 INFO:teuthology.orchestra.run.smithi008.stdout: { 2023-08-01T19:56:07.979 INFO:teuthology.orchestra.run.smithi008.stdout: "event": "header_read", 2023-08-01T19:56:07.979 INFO:teuthology.orchestra.run.smithi008.stdout: "time": "2023-08-01T19:55:58.573776+0000", 2023-08-01T19:56:07.979 INFO:teuthology.orchestra.run.smithi008.stdout: "duration": 4294967295.9999981 2023-08-01T19:56:07.979 INFO:teuthology.orchestra.run.smithi008.stdout: }, 2023-08-01T19:56:07.979 INFO:teuthology.orchestra.run.smithi008.stdout: { 2023-08-01T19:56:07.979 INFO:teuthology.orchestra.run.smithi008.stdout: "event": "all_read", 2023-08-01T19:56:07.980 INFO:teuthology.orchestra.run.smithi008.stdout: "time": "2023-08-01T19:55:58.573784+0000", 2023-08-01T19:56:07.980 INFO:teuthology.orchestra.run.smithi008.stdout: "duration": 8.2490000000000001e-06 2023-08-01T19:56:07.980 INFO:teuthology.orchestra.run.smithi008.stdout: }, 2023-08-01T19:56:07.980 INFO:teuthology.orchestra.run.smithi008.stdout: { 2023-08-01T19:56:07.980 INFO:teuthology.orchestra.run.smithi008.stdout: "event": "dispatched", 2023-08-01T19:56:07.980 INFO:teuthology.orchestra.run.smithi008.stdout: "time": "2023-08-01T19:55:58.574230+0000", 2023-08-01T19:56:07.980 INFO:teuthology.orchestra.run.smithi008.stdout: "duration": 0.00044558400000000001 2023-08-01T19:56:07.981 INFO:teuthology.orchestra.run.smithi008.stdout: }, 2023-08-01T19:56:07.981 INFO:teuthology.orchestra.run.smithi008.stdout: { 2023-08-01T19:56:07.981 INFO:teuthology.orchestra.run.smithi008.stdout: "event": "queued_for_pg", 2023-08-01T19:56:07.981 INFO:teuthology.orchestra.run.smithi008.stdout: "time": "2023-08-01T19:55:58.574240+0000", 2023-08-01T19:56:07.981 INFO:teuthology.orchestra.run.smithi008.stdout: "duration": 9.7699999999999996e-06 2023-08-01T19:56:07.981 INFO:teuthology.orchestra.run.smithi008.stdout: }, 2023-08-01T19:56:07.981 INFO:teuthology.orchestra.run.smithi008.stdout: { 2023-08-01T19:56:07.981 INFO:teuthology.orchestra.run.smithi008.stdout: "event": "reached_pg", 2023-08-01T19:56:07.982 INFO:teuthology.orchestra.run.smithi008.stdout: "time": "2023-08-01T19:55:58.574292+0000", 2023-08-01T19:56:07.982 INFO:teuthology.orchestra.run.smithi008.stdout: "duration": 5.2101000000000001e-05 2023-08-01T19:56:07.982 INFO:teuthology.orchestra.run.smithi008.stdout: }, 2023-08-01T19:56:07.982 INFO:teuthology.orchestra.run.smithi008.stdout: { 2023-08-01T19:56:07.982 INFO:teuthology.orchestra.run.smithi008.stdout: "event": "waiting for peered", 2023-08-01T19:56:07.982 INFO:teuthology.orchestra.run.smithi008.stdout: "time": "2023-08-01T19:55:58.574299+0000", 2023-08-01T19:56:07.982 INFO:teuthology.orchestra.run.smithi008.stdout: "duration": 7.3420000000000002e-06 2023-08-01T19:56:07.982 INFO:teuthology.orchestra.run.smithi008.stdout: }, 2023-08-01T19:56:07.983 INFO:teuthology.orchestra.run.smithi008.stdout: { 2023-08-01T19:56:07.983 INFO:teuthology.orchestra.run.smithi008.stdout: "event": "reached_pg", 2023-08-01T19:56:07.983 INFO:teuthology.orchestra.run.smithi008.stdout: "time": "2023-08-01T19:55:59.618545+0000", 2023-08-01T19:56:07.983 INFO:teuthology.orchestra.run.smithi008.stdout: "duration": 1.044245922 2023-08-01T19:56:07.983 INFO:teuthology.orchestra.run.smithi008.stdout: }, 2023-08-01T19:56:07.983 INFO:teuthology.orchestra.run.smithi008.stdout: { 2023-08-01T19:56:07.983 INFO:teuthology.orchestra.run.smithi008.stdout: "event": "started", 2023-08-01T19:56:07.983 INFO:teuthology.orchestra.run.smithi008.stdout: "time": "2023-08-01T19:55:59.618855+0000", 2023-08-01T19:56:07.984 INFO:teuthology.orchestra.run.smithi008.stdout: "duration": 0.00030964099999999999 2023-08-01T19:56:07.984 INFO:teuthology.orchestra.run.smithi008.stdout: }, 2023-08-01T19:56:07.984 INFO:teuthology.orchestra.run.smithi008.stdout: { 2023-08-01T19:56:07.984 INFO:teuthology.orchestra.run.smithi008.stdout: "event": "op_commit", 2023-08-01T19:56:07.984 INFO:teuthology.orchestra.run.smithi008.stdout: "time": "2023-08-01T19:55:59.628438+0000", 2023-08-01T19:56:07.984 INFO:teuthology.orchestra.run.smithi008.stdout: "duration": 0.0095832939999999991 2023-08-01T19:56:07.984 INFO:teuthology.orchestra.run.smithi008.stdout: }, 2023-08-01T19:56:07.984 INFO:teuthology.orchestra.run.smithi008.stdout: { 2023-08-01T19:56:07.985 INFO:teuthology.orchestra.run.smithi008.stdout: "event": "commit_sent", 2023-08-01T19:56:07.985 INFO:teuthology.orchestra.run.smithi008.stdout: "time": "2023-08-01T19:55:59.628479+0000", 2023-08-01T19:56:07.985 INFO:teuthology.orchestra.run.smithi008.stdout: "duration": 4.1350000000000002e-05 2023-08-01T19:56:07.985 INFO:teuthology.orchestra.run.smithi008.stdout: }, 2023-08-01T19:56:07.985 INFO:teuthology.orchestra.run.smithi008.stdout: { 2023-08-01T19:56:07.985 INFO:teuthology.orchestra.run.smithi008.stdout: "event": "done", 2023-08-01T19:56:07.985 INFO:teuthology.orchestra.run.smithi008.stdout: "time": "2023-08-01T19:55:59.628560+0000", 2023-08-01T19:56:07.986 INFO:teuthology.orchestra.run.smithi008.stdout: "duration": 8.0080999999999994e-05 2023-08-01T19:56:07.986 INFO:teuthology.orchestra.run.smithi008.stdout: } 2023-08-01T19:56:07.986 INFO:teuthology.orchestra.run.smithi008.stdout: ] 2023-08-01T19:56:07.986 INFO:teuthology.orchestra.run.smithi008.stdout: } 2023-08-01T19:56:07.986 INFO:teuthology.orchestra.run.smithi008.stdout: }, 2023-08-01T19:56:07.986 INFO:teuthology.orchestra.run.smithi008.stdout: { 2023-08-01T19:56:07.986 INFO:teuthology.orchestra.run.smithi008.stdout: "description": "osd_op(client.4668.0:197415 5.c 5:3e539c01:::benchmark_data_smithi006_114134_object63754:head [delete] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e62)", 2023-08-01T19:56:07.986 INFO:teuthology.orchestra.run.smithi008.stdout: "initiated_at": "2023-08-01T19:55:58.577434+0000", 2023-08-01T19:56:07.987 INFO:teuthology.orchestra.run.smithi008.stdout: "age": 9.2293101919999998, 2023-08-01T19:56:07.987 INFO:teuthology.orchestra.run.smithi008.stdout: "duration": 1.0520807059999999, 2023-08-01T19:56:07.987 INFO:teuthology.orchestra.run.smithi008.stdout: "type_data": { 2023-08-01T19:56:07.987 INFO:teuthology.orchestra.run.smithi008.stdout: "flag_point": "commit sent; apply or cleanup", 2023-08-01T19:56:07.987 INFO:teuthology.orchestra.run.smithi008.stdout: "client_info": { 2023-08-01T19:56:07.987 INFO:teuthology.orchestra.run.smithi008.stdout: "client": "client.4668", 2023-08-01T19:56:07.987 INFO:teuthology.orchestra.run.smithi008.stdout: "client_addr": "172.21.15.6:0/1709472247", 2023-08-01T19:56:07.987 INFO:teuthology.orchestra.run.smithi008.stdout: "tid": 197415 2023-08-01T19:56:07.988 INFO:teuthology.orchestra.run.smithi008.stdout: }, 2023-08-01T19:56:07.988 INFO:teuthology.orchestra.run.smithi008.stdout: "events": [ 2023-08-01T19:56:07.988 INFO:teuthology.orchestra.run.smithi008.stdout: { 2023-08-01T19:56:07.988 INFO:teuthology.orchestra.run.smithi008.stdout: "event": "initiated", 2023-08-01T19:56:07.988 INFO:teuthology.orchestra.run.smithi008.stdout: "time": "2023-08-01T19:55:58.577434+0000", 2023-08-01T19:56:07.988 INFO:teuthology.orchestra.run.smithi008.stdout: "duration": 0 2023-08-01T19:56:07.988 INFO:teuthology.orchestra.run.smithi008.stdout: }, 2023-08-01T19:56:07.988 INFO:teuthology.orchestra.run.smithi008.stdout: { 2023-08-01T19:56:07.989 INFO:teuthology.orchestra.run.smithi008.stdout: "event": "throttled", 2023-08-01T19:56:07.989 INFO:teuthology.orchestra.run.smithi008.stdout: "time": "2023-08-01T19:55:58.577434+0000", 2023-08-01T19:56:07.989 INFO:teuthology.orchestra.run.smithi008.stdout: "duration": 0 2023-08-01T19:56:07.989 INFO:teuthology.orchestra.run.smithi008.stdout: }, 2023-08-01T19:56:07.989 INFO:teuthology.orchestra.run.smithi008.stdout: { 2023-08-01T19:56:07.989 INFO:teuthology.orchestra.run.smithi008.stdout: "event": "header_read", 2023-08-01T19:56:07.989 INFO:teuthology.orchestra.run.smithi008.stdout: "time": "2023-08-01T19:55:58.577432+0000", 2023-08-01T19:56:07.989 INFO:teuthology.orchestra.run.smithi008.stdout: "duration": 4294967295.9999986 2023-08-01T19:56:07.990 INFO:teuthology.orchestra.run.smithi008.stdout: }, 2023-08-01T19:56:07.990 INFO:teuthology.orchestra.run.smithi008.stdout: { 2023-08-01T19:56:07.990 INFO:teuthology.orchestra.run.smithi008.stdout: "event": "all_read", 2023-08-01T19:56:07.990 INFO:teuthology.orchestra.run.smithi008.stdout: "time": "2023-08-01T19:55:58.577440+0000", 2023-08-01T19:56:07.990 INFO:teuthology.orchestra.run.smithi008.stdout: "duration": 7.5480000000000004e-06 2023-08-01T19:56:07.990 INFO:teuthology.orchestra.run.smithi008.stdout: }, 2023-08-01T19:56:07.990 INFO:teuthology.orchestra.run.smithi008.stdout: { 2023-08-01T19:56:07.991 INFO:teuthology.orchestra.run.smithi008.stdout: "event": "dispatched", 2023-08-01T19:56:07.991 INFO:teuthology.orchestra.run.smithi008.stdout: "time": "2023-08-01T19:55:58.577454+0000", 2023-08-01T19:56:07.991 INFO:teuthology.orchestra.run.smithi008.stdout: "duration": 1.4216000000000001e-05 2023-08-01T19:56:07.991 INFO:teuthology.orchestra.run.smithi008.stdout: }, 2023-08-01T19:56:07.991 INFO:teuthology.orchestra.run.smithi008.stdout: { 2023-08-01T19:56:07.991 INFO:teuthology.orchestra.run.smithi008.stdout: "event": "queued_for_pg", 2023-08-01T19:56:07.991 INFO:teuthology.orchestra.run.smithi008.stdout: "time": "2023-08-01T19:55:58.577463+0000", 2023-08-01T19:56:07.991 INFO:teuthology.orchestra.run.smithi008.stdout: "duration": 8.2900000000000002e-06 2023-08-01T19:56:07.992 INFO:teuthology.orchestra.run.smithi008.stdout: }, 2023-08-01T19:56:07.992 INFO:teuthology.orchestra.run.smithi008.stdout: { 2023-08-01T19:56:07.992 INFO:teuthology.orchestra.run.smithi008.stdout: "event": "reached_pg", 2023-08-01T19:56:07.992 INFO:teuthology.orchestra.run.smithi008.stdout: "time": "2023-08-01T19:55:58.577498+0000", 2023-08-01T19:56:07.992 INFO:teuthology.orchestra.run.smithi008.stdout: "duration": 3.5302000000000002e-05 2023-08-01T19:56:07.992 INFO:teuthology.orchestra.run.smithi008.stdout: }, 2023-08-01T19:56:07.992 INFO:teuthology.orchestra.run.smithi008.stdout: { 2023-08-01T19:56:07.992 INFO:teuthology.orchestra.run.smithi008.stdout: "event": "waiting for peered", 2023-08-01T19:56:07.993 INFO:teuthology.orchestra.run.smithi008.stdout: "time": "2023-08-01T19:55:58.577503+0000", 2023-08-01T19:56:07.993 INFO:teuthology.orchestra.run.smithi008.stdout: "duration": 4.8409999999999999e-06 2023-08-01T19:56:07.993 INFO:teuthology.orchestra.run.smithi008.stdout: }, 2023-08-01T19:56:07.993 INFO:teuthology.orchestra.run.smithi008.stdout: { 2023-08-01T19:56:07.993 INFO:teuthology.orchestra.run.smithi008.stdout: "event": "reached_pg", 2023-08-01T19:56:07.993 INFO:teuthology.orchestra.run.smithi008.stdout: "time": "2023-08-01T19:55:59.619229+0000", 2023-08-01T19:56:07.993 INFO:teuthology.orchestra.run.smithi008.stdout: "duration": 1.041726119 2023-08-01T19:56:07.993 INFO:teuthology.orchestra.run.smithi008.stdout: }, 2023-08-01T19:56:07.994 INFO:teuthology.orchestra.run.smithi008.stdout: { 2023-08-01T19:56:07.994 INFO:teuthology.orchestra.run.smithi008.stdout: "event": "started", 2023-08-01T19:56:07.994 INFO:teuthology.orchestra.run.smithi008.stdout: "time": "2023-08-01T19:55:59.619326+0000", 2023-08-01T19:56:07.994 INFO:teuthology.orchestra.run.smithi008.stdout: "duration": 9.7044000000000001e-05 2023-08-01T19:56:07.994 INFO:teuthology.orchestra.run.smithi008.stdout: }, 2023-08-01T19:56:07.994 INFO:teuthology.orchestra.run.smithi008.stdout: { 2023-08-01T19:56:07.994 INFO:teuthology.orchestra.run.smithi008.stdout: "event": "op_commit", 2023-08-01T19:56:07.994 INFO:teuthology.orchestra.run.smithi008.stdout: "time": "2023-08-01T19:55:59.629399+0000", 2023-08-01T19:56:07.995 INFO:teuthology.orchestra.run.smithi008.stdout: "duration": 0.010073014 2023-08-01T19:56:07.995 INFO:teuthology.orchestra.run.smithi008.stdout: }, 2023-08-01T19:56:07.995 INFO:teuthology.orchestra.run.smithi008.stdout: { 2023-08-01T19:56:07.995 INFO:teuthology.orchestra.run.smithi008.stdout: "event": "commit_sent", 2023-08-01T19:56:07.995 INFO:teuthology.orchestra.run.smithi008.stdout: "time": "2023-08-01T19:55:59.629443+0000", 2023-08-01T19:56:07.995 INFO:teuthology.orchestra.run.smithi008.stdout: "duration": 4.3739999999999998e-05 2023-08-01T19:56:07.995 INFO:teuthology.orchestra.run.smithi008.stdout: }, 2023-08-01T19:56:07.996 INFO:teuthology.orchestra.run.smithi008.stdout: { 2023-08-01T19:56:07.996 INFO:teuthology.orchestra.run.smithi008.stdout: "event": "done", 2023-08-01T19:56:07.996 INFO:teuthology.orchestra.run.smithi008.stdout: "time": "2023-08-01T19:55:59.629515+0000", 2023-08-01T19:56:07.996 INFO:teuthology.orchestra.run.smithi008.stdout: "duration": 7.2089999999999996e-05 2023-08-01T19:56:07.996 INFO:teuthology.orchestra.run.smithi008.stdout: } 2023-08-01T19:56:07.996 INFO:teuthology.orchestra.run.smithi008.stdout: ] 2023-08-01T19:56:07.996 INFO:teuthology.orchestra.run.smithi008.stdout: } 2023-08-01T19:56:07.996 INFO:teuthology.orchestra.run.smithi008.stdout: }, 2023-08-01T19:56:07.997 INFO:teuthology.orchestra.run.smithi008.stdout: { 2023-08-01T19:56:07.997 INFO:teuthology.orchestra.run.smithi008.stdout: "description": "osd_op(client.4668.0:197417 5.7 5:eb36cb7d:::benchmark_data_smithi006_114134_object63756:head [delete] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e62)", 2023-08-01T19:56:07.997 INFO:teuthology.orchestra.run.smithi008.stdout: "initiated_at": "2023-08-01T19:55:58.578162+0000", 2023-08-01T19:56:07.997 INFO:teuthology.orchestra.run.smithi008.stdout: "age": 9.2285818949999996, 2023-08-01T19:56:07.997 INFO:teuthology.orchestra.run.smithi008.stdout: "duration": 1.0582469299999999, 2023-08-01T19:56:07.997 INFO:teuthology.orchestra.run.smithi008.stdout: "type_data": { 2023-08-01T19:56:07.997 INFO:teuthology.orchestra.run.smithi008.stdout: "flag_point": "commit sent; apply or cleanup", 2023-08-01T19:56:07.997 INFO:teuthology.orchestra.run.smithi008.stdout: "client_info": { 2023-08-01T19:56:07.998 INFO:teuthology.orchestra.run.smithi008.stdout: "client": "client.4668", 2023-08-01T19:56:07.998 INFO:teuthology.orchestra.run.smithi008.stdout: "client_addr": "172.21.15.6:0/1709472247", 2023-08-01T19:56:07.998 INFO:teuthology.orchestra.run.smithi008.stdout: "tid": 197417 2023-08-01T19:56:07.998 INFO:teuthology.orchestra.run.smithi008.stdout: }, 2023-08-01T19:56:07.998 INFO:teuthology.orchestra.run.smithi008.stdout: "events": [ 2023-08-01T19:56:07.998 INFO:teuthology.orchestra.run.smithi008.stdout: { 2023-08-01T19:56:07.998 INFO:teuthology.orchestra.run.smithi008.stdout: "event": "initiated", 2023-08-01T19:56:07.998 INFO:teuthology.orchestra.run.smithi008.stdout: "time": "2023-08-01T19:55:58.578162+0000", 2023-08-01T19:56:07.999 INFO:teuthology.orchestra.run.smithi008.stdout: "duration": 0 2023-08-01T19:56:07.999 INFO:teuthology.orchestra.run.smithi008.stdout: }, 2023-08-01T19:56:07.999 INFO:teuthology.orchestra.run.smithi008.stdout: { 2023-08-01T19:56:07.999 INFO:teuthology.orchestra.run.smithi008.stdout: "event": "throttled", 2023-08-01T19:56:07.999 INFO:teuthology.orchestra.run.smithi008.stdout: "time": "2023-08-01T19:55:58.578162+0000", 2023-08-01T19:56:07.999 INFO:teuthology.orchestra.run.smithi008.stdout: "duration": 0 2023-08-01T19:56:07.999 INFO:teuthology.orchestra.run.smithi008.stdout: }, 2023-08-01T19:56:07.999 INFO:teuthology.orchestra.run.smithi008.stdout: { 2023-08-01T19:56:08.000 INFO:teuthology.orchestra.run.smithi008.stdout: "event": "header_read", 2023-08-01T19:56:08.000 INFO:teuthology.orchestra.run.smithi008.stdout: "time": "2023-08-01T19:55:58.578161+0000", 2023-08-01T19:56:08.000 INFO:teuthology.orchestra.run.smithi008.stdout: "duration": 4294967295.999999 2023-08-01T19:56:08.000 INFO:teuthology.orchestra.run.smithi008.stdout: }, 2023-08-01T19:56:08.000 INFO:teuthology.orchestra.run.smithi008.stdout: { 2023-08-01T19:56:08.000 INFO:teuthology.orchestra.run.smithi008.stdout: "event": "all_read", 2023-08-01T19:56:08.000 INFO:teuthology.orchestra.run.smithi008.stdout: "time": "2023-08-01T19:55:58.578166+0000", 2023-08-01T19:56:08.001 INFO:teuthology.orchestra.run.smithi008.stdout: "duration": 4.6589999999999998e-06 2023-08-01T19:56:08.001 INFO:teuthology.orchestra.run.smithi008.stdout: }, 2023-08-01T19:56:08.001 INFO:teuthology.orchestra.run.smithi008.stdout: { 2023-08-01T19:56:08.001 INFO:teuthology.orchestra.run.smithi008.stdout: "event": "dispatched", 2023-08-01T19:56:08.001 INFO:teuthology.orchestra.run.smithi008.stdout: "time": "2023-08-01T19:55:58.578177+0000", 2023-08-01T19:56:08.001 INFO:teuthology.orchestra.run.smithi008.stdout: "duration": 1.0512e-05 2023-08-01T19:56:08.001 INFO:teuthology.orchestra.run.smithi008.stdout: }, 2023-08-01T19:56:08.001 INFO:teuthology.orchestra.run.smithi008.stdout: { 2023-08-01T19:56:08.002 INFO:teuthology.orchestra.run.smithi008.stdout: "event": "queued_for_pg", 2023-08-01T19:56:08.002 INFO:teuthology.orchestra.run.smithi008.stdout: "time": "2023-08-01T19:55:58.578182+0000", 2023-08-01T19:56:08.002 INFO:teuthology.orchestra.run.smithi008.stdout: "duration": 5.6540000000000004e-06 2023-08-01T19:56:08.002 INFO:teuthology.orchestra.run.smithi008.stdout: }, 2023-08-01T19:56:08.002 INFO:teuthology.orchestra.run.smithi008.stdout: { 2023-08-01T19:56:08.002 INFO:teuthology.orchestra.run.smithi008.stdout: "event": "reached_pg", 2023-08-01T19:56:08.002 INFO:teuthology.orchestra.run.smithi008.stdout: "time": "2023-08-01T19:55:58.578221+0000", 2023-08-01T19:56:08.002 INFO:teuthology.orchestra.run.smithi008.stdout: "duration": 3.8764999999999999e-05 2023-08-01T19:56:08.003 INFO:teuthology.orchestra.run.smithi008.stdout: }, 2023-08-01T19:56:08.003 INFO:teuthology.orchestra.run.smithi008.stdout: { 2023-08-01T19:56:08.003 INFO:teuthology.orchestra.run.smithi008.stdout: "event": "waiting for peered", 2023-08-01T19:56:08.003 INFO:teuthology.orchestra.run.smithi008.stdout: "time": "2023-08-01T19:55:58.578226+0000", 2023-08-01T19:56:08.003 INFO:teuthology.orchestra.run.smithi008.stdout: "duration": 4.6319999999999999e-06 2023-08-01T19:56:08.003 INFO:teuthology.orchestra.run.smithi008.stdout: }, 2023-08-01T19:56:08.003 INFO:teuthology.orchestra.run.smithi008.stdout: { 2023-08-01T19:56:08.003 INFO:teuthology.orchestra.run.smithi008.stdout: "event": "reached_pg", 2023-08-01T19:56:08.004 INFO:teuthology.orchestra.run.smithi008.stdout: "time": "2023-08-01T19:55:59.628027+0000", 2023-08-01T19:56:08.004 INFO:teuthology.orchestra.run.smithi008.stdout: "duration": 1.049801261 2023-08-01T19:56:08.004 INFO:teuthology.orchestra.run.smithi008.stdout: }, 2023-08-01T19:56:08.004 INFO:teuthology.orchestra.run.smithi008.stdout: { 2023-08-01T19:56:08.004 INFO:teuthology.orchestra.run.smithi008.stdout: "event": "started", 2023-08-01T19:56:08.004 INFO:teuthology.orchestra.run.smithi008.stdout: "time": "2023-08-01T19:55:59.628156+0000", 2023-08-01T19:56:08.004 INFO:teuthology.orchestra.run.smithi008.stdout: "duration": 0.00012906899999999999 2023-08-01T19:56:08.004 INFO:teuthology.orchestra.run.smithi008.stdout: }, 2023-08-01T19:56:08.005 INFO:teuthology.orchestra.run.smithi008.stdout: { 2023-08-01T19:56:08.005 INFO:teuthology.orchestra.run.smithi008.stdout: "event": "op_commit", 2023-08-01T19:56:08.005 INFO:teuthology.orchestra.run.smithi008.stdout: "time": "2023-08-01T19:55:59.636292+0000", 2023-08-01T19:56:08.005 INFO:teuthology.orchestra.run.smithi008.stdout: "duration": 0.0081362859999999995 2023-08-01T19:56:08.005 INFO:teuthology.orchestra.run.smithi008.stdout: }, 2023-08-01T19:56:08.005 INFO:teuthology.orchestra.run.smithi008.stdout: { 2023-08-01T19:56:08.005 INFO:teuthology.orchestra.run.smithi008.stdout: "event": "commit_sent", 2023-08-01T19:56:08.005 INFO:teuthology.orchestra.run.smithi008.stdout: "time": "2023-08-01T19:55:59.636343+0000", 2023-08-01T19:56:08.006 INFO:teuthology.orchestra.run.smithi008.stdout: "duration": 5.0603000000000003e-05 2023-08-01T19:56:08.006 INFO:teuthology.orchestra.run.smithi008.stdout: }, 2023-08-01T19:56:08.006 INFO:teuthology.orchestra.run.smithi008.stdout: { 2023-08-01T19:56:08.006 INFO:teuthology.orchestra.run.smithi008.stdout: "event": "done", 2023-08-01T19:56:08.006 INFO:teuthology.orchestra.run.smithi008.stdout: "time": "2023-08-01T19:55:59.636409+0000", 2023-08-01T19:56:08.006 INFO:teuthology.orchestra.run.smithi008.stdout: "duration": 6.6353999999999995e-05 2023-08-01T19:56:08.006 INFO:teuthology.orchestra.run.smithi008.stdout: } 2023-08-01T19:56:08.007 INFO:teuthology.orchestra.run.smithi008.stdout: ] 2023-08-01T19:56:08.007 INFO:teuthology.orchestra.run.smithi008.stdout: } 2023-08-01T19:56:08.007 INFO:teuthology.orchestra.run.smithi008.stdout: }, 2023-08-01T19:56:08.007 INFO:teuthology.orchestra.run.smithi008.stdout: { 2023-08-01T19:56:08.007 INFO:teuthology.orchestra.run.smithi008.stdout: "description": "osd_op(client.4668.0:197418 5.2 5:4ba84ab7:::benchmark_data_smithi006_114134_object63757:head [delete] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e62)", 2023-08-01T19:56:08.007 INFO:teuthology.orchestra.run.smithi008.stdout: "initiated_at": "2023-08-01T19:55:58.580297+0000", 2023-08-01T19:56:08.007 INFO:teuthology.orchestra.run.smithi008.stdout: "age": 9.2264475420000007, 2023-08-01T19:56:08.007 INFO:teuthology.orchestra.run.smithi008.stdout: "duration": 1.0529485839999999, 2023-08-01T19:56:08.008 INFO:teuthology.orchestra.run.smithi008.stdout: "type_data": { 2023-08-01T19:56:08.008 INFO:teuthology.orchestra.run.smithi008.stdout: "flag_point": "commit sent; apply or cleanup", 2023-08-01T19:56:08.008 INFO:teuthology.orchestra.run.smithi008.stdout: "client_info": { 2023-08-01T19:56:08.008 INFO:teuthology.orchestra.run.smithi008.stdout: "client": "client.4668", 2023-08-01T19:56:08.008 INFO:teuthology.orchestra.run.smithi008.stdout: "client_addr": "172.21.15.6:0/1709472247", 2023-08-01T19:56:08.008 INFO:teuthology.orchestra.run.smithi008.stdout: "tid": 197418 2023-08-01T19:56:08.008 INFO:teuthology.orchestra.run.smithi008.stdout: }, 2023-08-01T19:56:08.008 INFO:teuthology.orchestra.run.smithi008.stdout: "events": [ 2023-08-01T19:56:08.009 INFO:teuthology.orchestra.run.smithi008.stdout: { 2023-08-01T19:56:08.009 INFO:teuthology.orchestra.run.smithi008.stdout: "event": "initiated", 2023-08-01T19:56:08.009 INFO:teuthology.orchestra.run.smithi008.stdout: "time": "2023-08-01T19:55:58.580297+0000", 2023-08-01T19:56:08.009 INFO:teuthology.orchestra.run.smithi008.stdout: "duration": 0 2023-08-01T19:56:08.009 INFO:teuthology.orchestra.run.smithi008.stdout: }, 2023-08-01T19:56:08.009 INFO:teuthology.orchestra.run.smithi008.stdout: { 2023-08-01T19:56:08.009 INFO:teuthology.orchestra.run.smithi008.stdout: "event": "throttled", 2023-08-01T19:56:08.009 INFO:teuthology.orchestra.run.smithi008.stdout: "time": "2023-08-01T19:55:58.580297+0000", 2023-08-01T19:56:08.010 INFO:teuthology.orchestra.run.smithi008.stdout: "duration": 0 2023-08-01T19:56:08.010 INFO:teuthology.orchestra.run.smithi008.stdout: }, 2023-08-01T19:56:08.010 INFO:teuthology.orchestra.run.smithi008.stdout: { 2023-08-01T19:56:08.010 INFO:teuthology.orchestra.run.smithi008.stdout: "event": "header_read", 2023-08-01T19:56:08.010 INFO:teuthology.orchestra.run.smithi008.stdout: "time": "2023-08-01T19:55:58.580296+0000", 2023-08-01T19:56:08.010 INFO:teuthology.orchestra.run.smithi008.stdout: "duration": 4294967295.999999 2023-08-01T19:56:08.010 INFO:teuthology.orchestra.run.smithi008.stdout: }, 2023-08-01T19:56:08.010 INFO:teuthology.orchestra.run.smithi008.stdout: { 2023-08-01T19:56:08.011 INFO:teuthology.orchestra.run.smithi008.stdout: "event": "all_read", 2023-08-01T19:56:08.011 INFO:teuthology.orchestra.run.smithi008.stdout: "time": "2023-08-01T19:55:58.580302+0000", 2023-08-01T19:56:08.011 INFO:teuthology.orchestra.run.smithi008.stdout: "duration": 6.032e-06 2023-08-01T19:56:08.011 INFO:teuthology.orchestra.run.smithi008.stdout: }, 2023-08-01T19:56:08.011 INFO:teuthology.orchestra.run.smithi008.stdout: { 2023-08-01T19:56:08.011 INFO:teuthology.orchestra.run.smithi008.stdout: "event": "dispatched", 2023-08-01T19:56:08.011 INFO:teuthology.orchestra.run.smithi008.stdout: "time": "2023-08-01T19:55:58.580315+0000", 2023-08-01T19:56:08.012 INFO:teuthology.orchestra.run.smithi008.stdout: "duration": 1.327e-05 2023-08-01T19:56:08.012 INFO:teuthology.orchestra.run.smithi008.stdout: }, 2023-08-01T19:56:08.012 INFO:teuthology.orchestra.run.smithi008.stdout: { 2023-08-01T19:56:08.012 INFO:teuthology.orchestra.run.smithi008.stdout: "event": "queued_for_pg", 2023-08-01T19:56:08.012 INFO:teuthology.orchestra.run.smithi008.stdout: "time": "2023-08-01T19:55:58.580321+0000", 2023-08-01T19:56:08.012 INFO:teuthology.orchestra.run.smithi008.stdout: "duration": 6.3980000000000004e-06 2023-08-01T19:56:08.012 INFO:teuthology.orchestra.run.smithi008.stdout: }, 2023-08-01T19:56:08.012 INFO:teuthology.orchestra.run.smithi008.stdout: { 2023-08-01T19:56:08.013 INFO:teuthology.orchestra.run.smithi008.stdout: "event": "reached_pg", 2023-08-01T19:56:08.013 INFO:teuthology.orchestra.run.smithi008.stdout: "time": "2023-08-01T19:55:58.580372+0000", 2023-08-01T19:56:08.013 INFO:teuthology.orchestra.run.smithi008.stdout: "duration": 5.0219000000000001e-05 2023-08-01T19:56:08.013 INFO:teuthology.orchestra.run.smithi008.stdout: }, 2023-08-01T19:56:08.013 INFO:teuthology.orchestra.run.smithi008.stdout: { 2023-08-01T19:56:08.013 INFO:teuthology.orchestra.run.smithi008.stdout: "event": "waiting for peered", 2023-08-01T19:56:08.013 INFO:teuthology.orchestra.run.smithi008.stdout: "time": "2023-08-01T19:55:58.580378+0000", 2023-08-01T19:56:08.013 INFO:teuthology.orchestra.run.smithi008.stdout: "duration": 6.6529999999999997e-06 2023-08-01T19:56:08.014 INFO:teuthology.orchestra.run.smithi008.stdout: }, 2023-08-01T19:56:08.014 INFO:teuthology.orchestra.run.smithi008.stdout: { 2023-08-01T19:56:08.014 INFO:teuthology.orchestra.run.smithi008.stdout: "event": "reached_pg", 2023-08-01T19:56:08.014 INFO:teuthology.orchestra.run.smithi008.stdout: "time": "2023-08-01T19:55:59.618188+0000", 2023-08-01T19:56:08.014 INFO:teuthology.orchestra.run.smithi008.stdout: "duration": 1.037810267 2023-08-01T19:56:08.014 INFO:teuthology.orchestra.run.smithi008.stdout: }, 2023-08-01T19:56:08.014 INFO:teuthology.orchestra.run.smithi008.stdout: { 2023-08-01T19:56:08.014 INFO:teuthology.orchestra.run.smithi008.stdout: "event": "started", 2023-08-01T19:56:08.015 INFO:teuthology.orchestra.run.smithi008.stdout: "time": "2023-08-01T19:55:59.618308+0000", 2023-08-01T19:56:08.015 INFO:teuthology.orchestra.run.smithi008.stdout: "duration": 0.00011959 2023-08-01T19:56:08.015 INFO:teuthology.orchestra.run.smithi008.stdout: }, 2023-08-01T19:56:08.015 INFO:teuthology.orchestra.run.smithi008.stdout: { 2023-08-01T19:56:08.015 INFO:teuthology.orchestra.run.smithi008.stdout: "event": "op_commit", 2023-08-01T19:56:08.015 INFO:teuthology.orchestra.run.smithi008.stdout: "time": "2023-08-01T19:55:59.633122+0000", 2023-08-01T19:56:08.015 INFO:teuthology.orchestra.run.smithi008.stdout: "duration": 0.014814280000000001 2023-08-01T19:56:08.015 INFO:teuthology.orchestra.run.smithi008.stdout: }, 2023-08-01T19:56:08.016 INFO:teuthology.orchestra.run.smithi008.stdout: { 2023-08-01T19:56:08.016 INFO:teuthology.orchestra.run.smithi008.stdout: "event": "commit_sent", 2023-08-01T19:56:08.016 INFO:teuthology.orchestra.run.smithi008.stdout: "time": "2023-08-01T19:55:59.633167+0000", 2023-08-01T19:56:08.016 INFO:teuthology.orchestra.run.smithi008.stdout: "duration": 4.4651999999999999e-05 2023-08-01T19:56:08.016 INFO:teuthology.orchestra.run.smithi008.stdout: }, 2023-08-01T19:56:08.016 INFO:teuthology.orchestra.run.smithi008.stdout: { 2023-08-01T19:56:08.016 INFO:teuthology.orchestra.run.smithi008.stdout: "event": "done", 2023-08-01T19:56:08.016 INFO:teuthology.orchestra.run.smithi008.stdout: "time": "2023-08-01T19:55:59.633245+0000", 2023-08-01T19:56:08.017 INFO:teuthology.orchestra.run.smithi008.stdout: "duration": 7.8215999999999998e-05 2023-08-01T19:56:08.017 INFO:teuthology.orchestra.run.smithi008.stdout: } 2023-08-01T19:56:08.017 INFO:teuthology.orchestra.run.smithi008.stdout: ] 2023-08-01T19:56:08.017 INFO:teuthology.orchestra.run.smithi008.stdout: } 2023-08-01T19:56:08.017 INFO:teuthology.orchestra.run.smithi008.stdout: } 2023-08-01T19:56:08.017 INFO:teuthology.orchestra.run.smithi008.stdout: ] 2023-08-01T19:56:08.017 INFO:teuthology.orchestra.run.smithi008.stdout:} 2023-08-01T19:56:08.018 DEBUG:teuthology.orchestra.run.smithi006:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 120 ceph --cluster ceph osd set noscrub 2023-08-01T19:56:08.019 INFO:tasks.ceph.osd.2.smithi155.stderr:2023-08-01T19:56:08.017+0000 7faa5c6ac700 -1 received signal: Hangup from /usr/bin/python3 /bin/daemon-helper kill ceph-osd -f --cluster ceph -i 2 (PID: 111337) UID: 0 2023-08-01T19:56:08.019 DEBUG:teuthology.orchestra.run.smithi155:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 30 ceph --cluster ceph --admin-daemon /var/run/ceph/ceph-osd.2.asok dump_ops_in_flight 2023-08-01T19:56:08.120 INFO:tasks.ceph.osd.0.smithi008.stderr:2023-08-01T19:56:08.118+0000 7f16a58f4700 -1 received signal: Hangup from /usr/bin/python3 /bin/daemon-helper kill ceph-osd -f --cluster ceph -i 0 (PID: 111179) UID: 0 2023-08-01T19:56:08.188 INFO:teuthology.orchestra.run.smithi155.stdout:{ 2023-08-01T19:56:08.188 INFO:teuthology.orchestra.run.smithi155.stdout: "ops": [ 2023-08-01T19:56:08.189 INFO:teuthology.orchestra.run.smithi155.stdout: { 2023-08-01T19:56:08.189 INFO:teuthology.orchestra.run.smithi155.stdout: "description": "osd_op(client.4668.0:215157 5.0 5:0f577ace:::benchmark_data_smithi006_114134_object81496:head [delete] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e66)", 2023-08-01T19:56:08.189 INFO:teuthology.orchestra.run.smithi155.stdout: "initiated_at": "2023-08-01T19:56:08.175952+0000", 2023-08-01T19:56:08.189 INFO:teuthology.orchestra.run.smithi155.stdout: "age": 0.010867438, 2023-08-01T19:56:08.189 INFO:teuthology.orchestra.run.smithi155.stdout: "duration": 0.010886084000000001, 2023-08-01T19:56:08.189 INFO:teuthology.orchestra.run.smithi155.stdout: "type_data": { 2023-08-01T19:56:08.190 INFO:teuthology.orchestra.run.smithi155.stdout: "flag_point": "waiting for sub ops", 2023-08-01T19:56:08.190 INFO:teuthology.orchestra.run.smithi155.stdout: "client_info": { 2023-08-01T19:56:08.190 INFO:teuthology.orchestra.run.smithi155.stdout: "client": "client.4668", 2023-08-01T19:56:08.190 INFO:teuthology.orchestra.run.smithi155.stdout: "client_addr": "172.21.15.6:0/1709472247", 2023-08-01T19:56:08.190 INFO:teuthology.orchestra.run.smithi155.stdout: "tid": 215157 2023-08-01T19:56:08.190 INFO:teuthology.orchestra.run.smithi155.stdout: }, 2023-08-01T19:56:08.190 INFO:teuthology.orchestra.run.smithi155.stdout: "events": [ 2023-08-01T19:56:08.191 INFO:teuthology.orchestra.run.smithi155.stdout: { 2023-08-01T19:56:08.191 INFO:teuthology.orchestra.run.smithi155.stdout: "event": "initiated", 2023-08-01T19:56:08.191 INFO:teuthology.orchestra.run.smithi155.stdout: "time": "2023-08-01T19:56:08.175952+0000", 2023-08-01T19:56:08.191 INFO:teuthology.orchestra.run.smithi155.stdout: "duration": 0 2023-08-01T19:56:08.191 INFO:teuthology.orchestra.run.smithi155.stdout: }, 2023-08-01T19:56:08.191 INFO:teuthology.orchestra.run.smithi155.stdout: { 2023-08-01T19:56:08.191 INFO:teuthology.orchestra.run.smithi155.stdout: "event": "throttled", 2023-08-01T19:56:08.192 INFO:teuthology.orchestra.run.smithi155.stdout: "time": "2023-08-01T19:56:08.175952+0000", 2023-08-01T19:56:08.192 INFO:teuthology.orchestra.run.smithi155.stdout: "duration": 0 2023-08-01T19:56:08.192 INFO:teuthology.orchestra.run.smithi155.stdout: }, 2023-08-01T19:56:08.192 INFO:teuthology.orchestra.run.smithi155.stdout: { 2023-08-01T19:56:08.192 INFO:teuthology.orchestra.run.smithi155.stdout: "event": "header_read", 2023-08-01T19:56:08.192 INFO:teuthology.orchestra.run.smithi155.stdout: "time": "2023-08-01T19:56:08.175951+0000", 2023-08-01T19:56:08.192 INFO:teuthology.orchestra.run.smithi155.stdout: "duration": 4294967295.9999995 2023-08-01T19:56:08.193 INFO:teuthology.orchestra.run.smithi155.stdout: }, 2023-08-01T19:56:08.193 INFO:teuthology.orchestra.run.smithi155.stdout: { 2023-08-01T19:56:08.193 INFO:teuthology.orchestra.run.smithi155.stdout: "event": "all_read", 2023-08-01T19:56:08.193 INFO:teuthology.orchestra.run.smithi155.stdout: "time": "2023-08-01T19:56:08.175954+0000", 2023-08-01T19:56:08.193 INFO:teuthology.orchestra.run.smithi155.stdout: "duration": 2.6869999999999999e-06 2023-08-01T19:56:08.193 INFO:teuthology.orchestra.run.smithi155.stdout: }, 2023-08-01T19:56:08.193 INFO:teuthology.orchestra.run.smithi155.stdout: { 2023-08-01T19:56:08.194 INFO:teuthology.orchestra.run.smithi155.stdout: "event": "dispatched", 2023-08-01T19:56:08.194 INFO:teuthology.orchestra.run.smithi155.stdout: "time": "2023-08-01T19:56:08.175960+0000", 2023-08-01T19:56:08.194 INFO:teuthology.orchestra.run.smithi155.stdout: "duration": 6.2920000000000001e-06 2023-08-01T19:56:08.194 INFO:teuthology.orchestra.run.smithi155.stdout: }, 2023-08-01T19:56:08.194 INFO:teuthology.orchestra.run.smithi155.stdout: { 2023-08-01T19:56:08.194 INFO:teuthology.orchestra.run.smithi155.stdout: "event": "queued_for_pg", 2023-08-01T19:56:08.194 INFO:teuthology.orchestra.run.smithi155.stdout: "time": "2023-08-01T19:56:08.175964+0000", 2023-08-01T19:56:08.194 INFO:teuthology.orchestra.run.smithi155.stdout: "duration": 3.9570000000000004e-06 2023-08-01T19:56:08.195 INFO:teuthology.orchestra.run.smithi155.stdout: }, 2023-08-01T19:56:08.195 INFO:teuthology.orchestra.run.smithi155.stdout: { 2023-08-01T19:56:08.195 INFO:teuthology.orchestra.run.smithi155.stdout: "event": "reached_pg", 2023-08-01T19:56:08.195 INFO:teuthology.orchestra.run.smithi155.stdout: "time": "2023-08-01T19:56:08.178253+0000", 2023-08-01T19:56:08.195 INFO:teuthology.orchestra.run.smithi155.stdout: "duration": 0.0022889630000000002 2023-08-01T19:56:08.195 INFO:teuthology.orchestra.run.smithi155.stdout: }, 2023-08-01T19:56:08.195 INFO:teuthology.orchestra.run.smithi155.stdout: { 2023-08-01T19:56:08.196 INFO:teuthology.orchestra.run.smithi155.stdout: "event": "started", 2023-08-01T19:56:08.196 INFO:teuthology.orchestra.run.smithi155.stdout: "time": "2023-08-01T19:56:08.178364+0000", 2023-08-01T19:56:08.196 INFO:teuthology.orchestra.run.smithi155.stdout: "duration": 0.000110475 2023-08-01T19:56:08.196 INFO:teuthology.orchestra.run.smithi155.stdout: }, 2023-08-01T19:56:08.196 INFO:teuthology.orchestra.run.smithi155.stdout: { 2023-08-01T19:56:08.196 INFO:teuthology.orchestra.run.smithi155.stdout: "event": "waiting for subops from 0", 2023-08-01T19:56:08.196 INFO:teuthology.orchestra.run.smithi155.stdout: "time": "2023-08-01T19:56:08.178481+0000", 2023-08-01T19:56:08.197 INFO:teuthology.orchestra.run.smithi155.stdout: "duration": 0.000117756 2023-08-01T19:56:08.197 INFO:teuthology.orchestra.run.smithi155.stdout: }, 2023-08-01T19:56:08.197 INFO:teuthology.orchestra.run.smithi155.stdout: { 2023-08-01T19:56:08.197 INFO:teuthology.orchestra.run.smithi155.stdout: "event": "op_commit", 2023-08-01T19:56:08.197 INFO:teuthology.orchestra.run.smithi155.stdout: "time": "2023-08-01T19:56:08.183007+0000", 2023-08-01T19:56:08.197 INFO:teuthology.orchestra.run.smithi155.stdout: "duration": 0.004525271 2023-08-01T19:56:08.197 INFO:teuthology.orchestra.run.smithi155.stdout: } 2023-08-01T19:56:08.198 INFO:teuthology.orchestra.run.smithi155.stdout: ] 2023-08-01T19:56:08.198 INFO:teuthology.orchestra.run.smithi155.stdout: } 2023-08-01T19:56:08.198 INFO:teuthology.orchestra.run.smithi155.stdout: }, 2023-08-01T19:56:08.198 INFO:teuthology.orchestra.run.smithi155.stdout: { 2023-08-01T19:56:08.198 INFO:teuthology.orchestra.run.smithi155.stdout: "description": "osd_op(client.4668.0:215161 5.8 5:18108c77:::benchmark_data_smithi006_114134_object81500:head [delete] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e66)", 2023-08-01T19:56:08.198 INFO:teuthology.orchestra.run.smithi155.stdout: "initiated_at": "2023-08-01T19:56:08.177882+0000", 2023-08-01T19:56:08.198 INFO:teuthology.orchestra.run.smithi155.stdout: "age": 0.0089376200000000003, 2023-08-01T19:56:08.199 INFO:teuthology.orchestra.run.smithi155.stdout: "duration": 0.0090125559999999997, 2023-08-01T19:56:08.199 INFO:teuthology.orchestra.run.smithi155.stdout: "type_data": { 2023-08-01T19:56:08.199 INFO:teuthology.orchestra.run.smithi155.stdout: "flag_point": "waiting for sub ops", 2023-08-01T19:56:08.199 INFO:teuthology.orchestra.run.smithi155.stdout: "client_info": { 2023-08-01T19:56:08.199 INFO:teuthology.orchestra.run.smithi155.stdout: "client": "client.4668", 2023-08-01T19:56:08.199 INFO:teuthology.orchestra.run.smithi155.stdout: "client_addr": "172.21.15.6:0/1709472247", 2023-08-01T19:56:08.199 INFO:teuthology.orchestra.run.smithi155.stdout: "tid": 215161 2023-08-01T19:56:08.200 INFO:teuthology.orchestra.run.smithi155.stdout: }, 2023-08-01T19:56:08.200 INFO:teuthology.orchestra.run.smithi155.stdout: "events": [ 2023-08-01T19:56:08.200 INFO:teuthology.orchestra.run.smithi155.stdout: { 2023-08-01T19:56:08.200 INFO:teuthology.orchestra.run.smithi155.stdout: "event": "initiated", 2023-08-01T19:56:08.200 INFO:teuthology.orchestra.run.smithi155.stdout: "time": "2023-08-01T19:56:08.177882+0000", 2023-08-01T19:56:08.200 INFO:teuthology.orchestra.run.smithi155.stdout: "duration": 0 2023-08-01T19:56:08.200 INFO:teuthology.orchestra.run.smithi155.stdout: }, 2023-08-01T19:56:08.201 INFO:teuthology.orchestra.run.smithi155.stdout: { 2023-08-01T19:56:08.201 INFO:teuthology.orchestra.run.smithi155.stdout: "event": "throttled", 2023-08-01T19:56:08.201 INFO:teuthology.orchestra.run.smithi155.stdout: "time": "2023-08-01T19:56:08.177882+0000", 2023-08-01T19:56:08.201 INFO:teuthology.orchestra.run.smithi155.stdout: "duration": 0 2023-08-01T19:56:08.201 INFO:teuthology.orchestra.run.smithi155.stdout: }, 2023-08-01T19:56:08.201 INFO:teuthology.orchestra.run.smithi155.stdout: { 2023-08-01T19:56:08.201 INFO:teuthology.orchestra.run.smithi155.stdout: "event": "header_read", 2023-08-01T19:56:08.202 INFO:teuthology.orchestra.run.smithi155.stdout: "time": "2023-08-01T19:56:08.177881+0000", 2023-08-01T19:56:08.202 INFO:teuthology.orchestra.run.smithi155.stdout: "duration": 4294967295.9999995 2023-08-01T19:56:08.202 INFO:teuthology.orchestra.run.smithi155.stdout: }, 2023-08-01T19:56:08.202 INFO:teuthology.orchestra.run.smithi155.stdout: { 2023-08-01T19:56:08.202 INFO:teuthology.orchestra.run.smithi155.stdout: "event": "all_read", 2023-08-01T19:56:08.202 INFO:teuthology.orchestra.run.smithi155.stdout: "time": "2023-08-01T19:56:08.177885+0000", 2023-08-01T19:56:08.202 INFO:teuthology.orchestra.run.smithi155.stdout: "duration": 4.0389999999999998e-06 2023-08-01T19:56:08.202 INFO:teuthology.orchestra.run.smithi155.stdout: }, 2023-08-01T19:56:08.203 INFO:teuthology.orchestra.run.smithi155.stdout: { 2023-08-01T19:56:08.203 INFO:teuthology.orchestra.run.smithi155.stdout: "event": "dispatched", 2023-08-01T19:56:08.203 INFO:teuthology.orchestra.run.smithi155.stdout: "time": "2023-08-01T19:56:08.177892+0000", 2023-08-01T19:56:08.203 INFO:teuthology.orchestra.run.smithi155.stdout: "duration": 7.2320000000000004e-06 2023-08-01T19:56:08.203 INFO:teuthology.orchestra.run.smithi155.stdout: }, 2023-08-01T19:56:08.203 INFO:teuthology.orchestra.run.smithi155.stdout: { 2023-08-01T19:56:08.203 INFO:teuthology.orchestra.run.smithi155.stdout: "event": "queued_for_pg", 2023-08-01T19:56:08.204 INFO:teuthology.orchestra.run.smithi155.stdout: "time": "2023-08-01T19:56:08.177896+0000", 2023-08-01T19:56:08.204 INFO:teuthology.orchestra.run.smithi155.stdout: "duration": 3.5729999999999999e-06 2023-08-01T19:56:08.204 INFO:teuthology.orchestra.run.smithi155.stdout: }, 2023-08-01T19:56:08.204 INFO:teuthology.orchestra.run.smithi155.stdout: { 2023-08-01T19:56:08.204 INFO:teuthology.orchestra.run.smithi155.stdout: "event": "reached_pg", 2023-08-01T19:56:08.204 INFO:teuthology.orchestra.run.smithi155.stdout: "time": "2023-08-01T19:56:08.178361+0000", 2023-08-01T19:56:08.204 INFO:teuthology.orchestra.run.smithi155.stdout: "duration": 0.00046509699999999998 2023-08-01T19:56:08.205 INFO:teuthology.orchestra.run.smithi155.stdout: }, 2023-08-01T19:56:08.205 INFO:teuthology.orchestra.run.smithi155.stdout: { 2023-08-01T19:56:08.205 INFO:teuthology.orchestra.run.smithi155.stdout: "event": "started", 2023-08-01T19:56:08.205 INFO:teuthology.orchestra.run.smithi155.stdout: "time": "2023-08-01T19:56:08.178466+0000", 2023-08-01T19:56:08.205 INFO:teuthology.orchestra.run.smithi155.stdout: "duration": 0.000105386 2023-08-01T19:56:08.205 INFO:teuthology.orchestra.run.smithi155.stdout: }, 2023-08-01T19:56:08.205 INFO:teuthology.orchestra.run.smithi155.stdout: { 2023-08-01T19:56:08.206 INFO:teuthology.orchestra.run.smithi155.stdout: "event": "waiting for subops from 0", 2023-08-01T19:56:08.206 INFO:teuthology.orchestra.run.smithi155.stdout: "time": "2023-08-01T19:56:08.178570+0000", 2023-08-01T19:56:08.206 INFO:teuthology.orchestra.run.smithi155.stdout: "duration": 0.00010384500000000001 2023-08-01T19:56:08.206 INFO:teuthology.orchestra.run.smithi155.stdout: }, 2023-08-01T19:56:08.206 INFO:teuthology.orchestra.run.smithi155.stdout: { 2023-08-01T19:56:08.206 INFO:teuthology.orchestra.run.smithi155.stdout: "event": "op_commit", 2023-08-01T19:56:08.206 INFO:teuthology.orchestra.run.smithi155.stdout: "time": "2023-08-01T19:56:08.185156+0000", 2023-08-01T19:56:08.207 INFO:teuthology.orchestra.run.smithi155.stdout: "duration": 0.0065854349999999997 2023-08-01T19:56:08.207 INFO:teuthology.orchestra.run.smithi155.stdout: } 2023-08-01T19:56:08.207 INFO:teuthology.orchestra.run.smithi155.stdout: ] 2023-08-01T19:56:08.207 INFO:teuthology.orchestra.run.smithi155.stdout: } 2023-08-01T19:56:08.207 INFO:teuthology.orchestra.run.smithi155.stdout: }, 2023-08-01T19:56:08.207 INFO:teuthology.orchestra.run.smithi155.stdout: { 2023-08-01T19:56:08.207 INFO:teuthology.orchestra.run.smithi155.stdout: "description": "osd_op(client.4668.0:215163 5.0 5:0f73c83d:::benchmark_data_smithi006_114134_object81502:head [delete] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e66)", 2023-08-01T19:56:08.208 INFO:teuthology.orchestra.run.smithi155.stdout: "initiated_at": "2023-08-01T19:56:08.178442+0000", 2023-08-01T19:56:08.208 INFO:teuthology.orchestra.run.smithi155.stdout: "age": 0.0083773089999999995, 2023-08-01T19:56:08.208 INFO:teuthology.orchestra.run.smithi155.stdout: "duration": 0.0085022039999999993, 2023-08-01T19:56:08.208 INFO:teuthology.orchestra.run.smithi155.stdout: "type_data": { 2023-08-01T19:56:08.208 INFO:teuthology.orchestra.run.smithi155.stdout: "flag_point": "waiting for sub ops", 2023-08-01T19:56:08.208 INFO:teuthology.orchestra.run.smithi155.stdout: "client_info": { 2023-08-01T19:56:08.208 INFO:teuthology.orchestra.run.smithi155.stdout: "client": "client.4668", 2023-08-01T19:56:08.208 INFO:teuthology.orchestra.run.smithi155.stdout: "client_addr": "172.21.15.6:0/1709472247", 2023-08-01T19:56:08.209 INFO:teuthology.orchestra.run.smithi155.stdout: "tid": 215163 2023-08-01T19:56:08.209 INFO:teuthology.orchestra.run.smithi155.stdout: }, 2023-08-01T19:56:08.209 INFO:teuthology.orchestra.run.smithi155.stdout: "events": [ 2023-08-01T19:56:08.209 INFO:teuthology.orchestra.run.smithi155.stdout: { 2023-08-01T19:56:08.209 INFO:teuthology.orchestra.run.smithi155.stdout: "event": "initiated", 2023-08-01T19:56:08.209 INFO:teuthology.orchestra.run.smithi155.stdout: "time": "2023-08-01T19:56:08.178442+0000", 2023-08-01T19:56:08.209 INFO:teuthology.orchestra.run.smithi155.stdout: "duration": 0 2023-08-01T19:56:08.210 INFO:teuthology.orchestra.run.smithi155.stdout: }, 2023-08-01T19:56:08.210 INFO:teuthology.orchestra.run.smithi155.stdout: { 2023-08-01T19:56:08.210 INFO:teuthology.orchestra.run.smithi155.stdout: "event": "throttled", 2023-08-01T19:56:08.210 INFO:teuthology.orchestra.run.smithi155.stdout: "time": "2023-08-01T19:56:08.178442+0000", 2023-08-01T19:56:08.210 INFO:teuthology.orchestra.run.smithi155.stdout: "duration": 0 2023-08-01T19:56:08.210 INFO:teuthology.orchestra.run.smithi155.stdout: }, 2023-08-01T19:56:08.210 INFO:teuthology.orchestra.run.smithi155.stdout: { 2023-08-01T19:56:08.211 INFO:teuthology.orchestra.run.smithi155.stdout: "event": "header_read", 2023-08-01T19:56:08.211 INFO:teuthology.orchestra.run.smithi155.stdout: "time": "2023-08-01T19:56:08.178442+0000", 2023-08-01T19:56:08.211 INFO:teuthology.orchestra.run.smithi155.stdout: "duration": 4294967295.9999995 2023-08-01T19:56:08.211 INFO:teuthology.orchestra.run.smithi155.stdout: }, 2023-08-01T19:56:08.211 INFO:teuthology.orchestra.run.smithi155.stdout: { 2023-08-01T19:56:08.211 INFO:teuthology.orchestra.run.smithi155.stdout: "event": "all_read", 2023-08-01T19:56:08.211 INFO:teuthology.orchestra.run.smithi155.stdout: "time": "2023-08-01T19:56:08.178444+0000", 2023-08-01T19:56:08.212 INFO:teuthology.orchestra.run.smithi155.stdout: "duration": 2.5500000000000001e-06 2023-08-01T19:56:08.212 INFO:teuthology.orchestra.run.smithi155.stdout: }, 2023-08-01T19:56:08.212 INFO:teuthology.orchestra.run.smithi155.stdout: { 2023-08-01T19:56:08.212 INFO:teuthology.orchestra.run.smithi155.stdout: "event": "dispatched", 2023-08-01T19:56:08.212 INFO:teuthology.orchestra.run.smithi155.stdout: "time": "2023-08-01T19:56:08.178449+0000", 2023-08-01T19:56:08.212 INFO:teuthology.orchestra.run.smithi155.stdout: "duration": 5.2100000000000001e-06 2023-08-01T19:56:08.212 INFO:teuthology.orchestra.run.smithi155.stdout: }, 2023-08-01T19:56:08.213 INFO:teuthology.orchestra.run.smithi155.stdout: { 2023-08-01T19:56:08.213 INFO:teuthology.orchestra.run.smithi155.stdout: "event": "queued_for_pg", 2023-08-01T19:56:08.213 INFO:teuthology.orchestra.run.smithi155.stdout: "time": "2023-08-01T19:56:08.178452+0000", 2023-08-01T19:56:08.213 INFO:teuthology.orchestra.run.smithi155.stdout: "duration": 2.9189999999999999e-06 2023-08-01T19:56:08.213 INFO:teuthology.orchestra.run.smithi155.stdout: }, 2023-08-01T19:56:08.213 INFO:teuthology.orchestra.run.smithi155.stdout: { 2023-08-01T19:56:08.213 INFO:teuthology.orchestra.run.smithi155.stdout: "event": "reached_pg", 2023-08-01T19:56:08.214 INFO:teuthology.orchestra.run.smithi155.stdout: "time": "2023-08-01T19:56:08.179967+0000", 2023-08-01T19:56:08.214 INFO:teuthology.orchestra.run.smithi155.stdout: "duration": 0.001515127 2023-08-01T19:56:08.214 INFO:teuthology.orchestra.run.smithi155.stdout: }, 2023-08-01T19:56:08.214 INFO:teuthology.orchestra.run.smithi155.stdout: { 2023-08-01T19:56:08.214 INFO:teuthology.orchestra.run.smithi155.stdout: "event": "started", 2023-08-01T19:56:08.214 INFO:teuthology.orchestra.run.smithi155.stdout: "time": "2023-08-01T19:56:08.180075+0000", 2023-08-01T19:56:08.214 INFO:teuthology.orchestra.run.smithi155.stdout: "duration": 0.000107274 2023-08-01T19:56:08.214 INFO:teuthology.orchestra.run.smithi155.stdout: }, 2023-08-01T19:56:08.215 INFO:teuthology.orchestra.run.smithi155.stdout: { 2023-08-01T19:56:08.215 INFO:teuthology.orchestra.run.smithi155.stdout: "event": "waiting for subops from 0", 2023-08-01T19:56:08.215 INFO:teuthology.orchestra.run.smithi155.stdout: "time": "2023-08-01T19:56:08.180173+0000", 2023-08-01T19:56:08.215 INFO:teuthology.orchestra.run.smithi155.stdout: "duration": 9.8394999999999996e-05 2023-08-01T19:56:08.215 INFO:teuthology.orchestra.run.smithi155.stdout: }, 2023-08-01T19:56:08.215 INFO:teuthology.orchestra.run.smithi155.stdout: { 2023-08-01T19:56:08.215 INFO:teuthology.orchestra.run.smithi155.stdout: "event": "op_commit", 2023-08-01T19:56:08.216 INFO:teuthology.orchestra.run.smithi155.stdout: "time": "2023-08-01T19:56:08.186353+0000", 2023-08-01T19:56:08.216 INFO:teuthology.orchestra.run.smithi155.stdout: "duration": 0.0061799159999999997 2023-08-01T19:56:08.216 INFO:teuthology.orchestra.run.smithi155.stdout: } 2023-08-01T19:56:08.216 INFO:teuthology.orchestra.run.smithi155.stdout: ] 2023-08-01T19:56:08.216 INFO:teuthology.orchestra.run.smithi155.stdout: } 2023-08-01T19:56:08.216 INFO:teuthology.orchestra.run.smithi155.stdout: }, 2023-08-01T19:56:08.216 INFO:teuthology.orchestra.run.smithi155.stdout: { 2023-08-01T19:56:08.217 INFO:teuthology.orchestra.run.smithi155.stdout: "description": "osd_op(client.4668.0:215164 5.0 5:02e996e7:::benchmark_data_smithi006_114134_object81503:head [delete] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e66)", 2023-08-01T19:56:08.217 INFO:teuthology.orchestra.run.smithi155.stdout: "initiated_at": "2023-08-01T19:56:08.180333+0000", 2023-08-01T19:56:08.217 INFO:teuthology.orchestra.run.smithi155.stdout: "age": 0.00648593, 2023-08-01T19:56:08.217 INFO:teuthology.orchestra.run.smithi155.stdout: "duration": 0.006660282, 2023-08-01T19:56:08.217 INFO:teuthology.orchestra.run.smithi155.stdout: "type_data": { 2023-08-01T19:56:08.217 INFO:teuthology.orchestra.run.smithi155.stdout: "flag_point": "waiting for sub ops", 2023-08-01T19:56:08.217 INFO:teuthology.orchestra.run.smithi155.stdout: "client_info": { 2023-08-01T19:56:08.218 INFO:teuthology.orchestra.run.smithi155.stdout: "client": "client.4668", 2023-08-01T19:56:08.218 INFO:teuthology.orchestra.run.smithi155.stdout: "client_addr": "172.21.15.6:0/1709472247", 2023-08-01T19:56:08.218 INFO:teuthology.orchestra.run.smithi155.stdout: "tid": 215164 2023-08-01T19:56:08.218 INFO:teuthology.orchestra.run.smithi155.stdout: }, 2023-08-01T19:56:08.218 INFO:teuthology.orchestra.run.smithi155.stdout: "events": [ 2023-08-01T19:56:08.218 INFO:teuthology.orchestra.run.smithi155.stdout: { 2023-08-01T19:56:08.218 INFO:teuthology.orchestra.run.smithi155.stdout: "event": "initiated", 2023-08-01T19:56:08.219 INFO:teuthology.orchestra.run.smithi155.stdout: "time": "2023-08-01T19:56:08.180333+0000", 2023-08-01T19:56:08.219 INFO:teuthology.orchestra.run.smithi155.stdout: "duration": 0 2023-08-01T19:56:08.219 INFO:teuthology.orchestra.run.smithi155.stdout: }, 2023-08-01T19:56:08.219 INFO:teuthology.orchestra.run.smithi155.stdout: { 2023-08-01T19:56:08.219 INFO:teuthology.orchestra.run.smithi155.stdout: "event": "throttled", 2023-08-01T19:56:08.219 INFO:teuthology.orchestra.run.smithi155.stdout: "time": "2023-08-01T19:56:08.180333+0000", 2023-08-01T19:56:08.219 INFO:teuthology.orchestra.run.smithi155.stdout: "duration": 0 2023-08-01T19:56:08.220 INFO:teuthology.orchestra.run.smithi155.stdout: }, 2023-08-01T19:56:08.220 INFO:teuthology.orchestra.run.smithi155.stdout: { 2023-08-01T19:56:08.220 INFO:teuthology.orchestra.run.smithi155.stdout: "event": "header_read", 2023-08-01T19:56:08.220 INFO:teuthology.orchestra.run.smithi155.stdout: "time": "2023-08-01T19:56:08.180333+0000", 2023-08-01T19:56:08.220 INFO:teuthology.orchestra.run.smithi155.stdout: "duration": 4294967295.999999 2023-08-01T19:56:08.220 INFO:teuthology.orchestra.run.smithi155.stdout: }, 2023-08-01T19:56:08.220 INFO:teuthology.orchestra.run.smithi155.stdout: { 2023-08-01T19:56:08.221 INFO:teuthology.orchestra.run.smithi155.stdout: "event": "all_read", 2023-08-01T19:56:08.221 INFO:teuthology.orchestra.run.smithi155.stdout: "time": "2023-08-01T19:56:08.180337+0000", 2023-08-01T19:56:08.221 INFO:teuthology.orchestra.run.smithi155.stdout: "duration": 4.3290000000000004e-06 2023-08-01T19:56:08.221 INFO:teuthology.orchestra.run.smithi155.stdout: }, 2023-08-01T19:56:08.221 INFO:teuthology.orchestra.run.smithi155.stdout: { 2023-08-01T19:56:08.221 INFO:teuthology.orchestra.run.smithi155.stdout: "event": "dispatched", 2023-08-01T19:56:08.221 INFO:teuthology.orchestra.run.smithi155.stdout: "time": "2023-08-01T19:56:08.180346+0000", 2023-08-01T19:56:08.222 INFO:teuthology.orchestra.run.smithi155.stdout: "duration": 9.4550000000000001e-06 2023-08-01T19:56:08.222 INFO:teuthology.orchestra.run.smithi155.stdout: }, 2023-08-01T19:56:08.222 INFO:teuthology.orchestra.run.smithi155.stdout: { 2023-08-01T19:56:08.222 INFO:teuthology.orchestra.run.smithi155.stdout: "event": "queued_for_pg", 2023-08-01T19:56:08.222 INFO:teuthology.orchestra.run.smithi155.stdout: "time": "2023-08-01T19:56:08.180352+0000", 2023-08-01T19:56:08.222 INFO:teuthology.orchestra.run.smithi155.stdout: "duration": 5.1889999999999998e-06 2023-08-01T19:56:08.222 INFO:teuthology.orchestra.run.smithi155.stdout: }, 2023-08-01T19:56:08.223 INFO:teuthology.orchestra.run.smithi155.stdout: { 2023-08-01T19:56:08.223 INFO:teuthology.orchestra.run.smithi155.stdout: "event": "reached_pg", 2023-08-01T19:56:08.223 INFO:teuthology.orchestra.run.smithi155.stdout: "time": "2023-08-01T19:56:08.181198+0000", 2023-08-01T19:56:08.223 INFO:teuthology.orchestra.run.smithi155.stdout: "duration": 0.00084624500000000003 2023-08-01T19:56:08.223 INFO:teuthology.orchestra.run.smithi155.stdout: }, 2023-08-01T19:56:08.223 INFO:teuthology.orchestra.run.smithi155.stdout: { 2023-08-01T19:56:08.223 INFO:teuthology.orchestra.run.smithi155.stdout: "event": "started", 2023-08-01T19:56:08.223 INFO:teuthology.orchestra.run.smithi155.stdout: "time": "2023-08-01T19:56:08.181309+0000", 2023-08-01T19:56:08.224 INFO:teuthology.orchestra.run.smithi155.stdout: "duration": 0.000111051 2023-08-01T19:56:08.224 INFO:teuthology.orchestra.run.smithi155.stdout: }, 2023-08-01T19:56:08.224 INFO:teuthology.orchestra.run.smithi155.stdout: { 2023-08-01T19:56:08.224 INFO:teuthology.orchestra.run.smithi155.stdout: "event": "waiting for subops from 0", 2023-08-01T19:56:08.224 INFO:teuthology.orchestra.run.smithi155.stdout: "time": "2023-08-01T19:56:08.181414+0000", 2023-08-01T19:56:08.224 INFO:teuthology.orchestra.run.smithi155.stdout: "duration": 0.00010536599999999999 2023-08-01T19:56:08.224 INFO:teuthology.orchestra.run.smithi155.stdout: }, 2023-08-01T19:56:08.225 INFO:teuthology.orchestra.run.smithi155.stdout: { 2023-08-01T19:56:08.225 INFO:teuthology.orchestra.run.smithi155.stdout: "event": "op_commit", 2023-08-01T19:56:08.225 INFO:teuthology.orchestra.run.smithi155.stdout: "time": "2023-08-01T19:56:08.186357+0000", 2023-08-01T19:56:08.225 INFO:teuthology.orchestra.run.smithi155.stdout: "duration": 0.0049427589999999997 2023-08-01T19:56:08.225 INFO:teuthology.orchestra.run.smithi155.stdout: } 2023-08-01T19:56:08.225 INFO:teuthology.orchestra.run.smithi155.stdout: ] 2023-08-01T19:56:08.225 INFO:teuthology.orchestra.run.smithi155.stdout: } 2023-08-01T19:56:08.226 INFO:teuthology.orchestra.run.smithi155.stdout: }, 2023-08-01T19:56:08.226 INFO:teuthology.orchestra.run.smithi155.stdout: { 2023-08-01T19:56:08.226 INFO:teuthology.orchestra.run.smithi155.stdout: "description": "osd_op(client.4668.0:215173 5.8 5:1bd79c4b:::benchmark_data_smithi006_114134_object81512:head [delete] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e66)", 2023-08-01T19:56:08.226 INFO:teuthology.orchestra.run.smithi155.stdout: "initiated_at": "2023-08-01T19:56:08.183522+0000", 2023-08-01T19:56:08.226 INFO:teuthology.orchestra.run.smithi155.stdout: "age": 0.003297459, 2023-08-01T19:56:08.226 INFO:teuthology.orchestra.run.smithi155.stdout: "duration": 0.0035197869999999999, 2023-08-01T19:56:08.226 INFO:teuthology.orchestra.run.smithi155.stdout: "type_data": { 2023-08-01T19:56:08.227 INFO:teuthology.orchestra.run.smithi155.stdout: "flag_point": "waiting for sub ops", 2023-08-01T19:56:08.227 INFO:teuthology.orchestra.run.smithi155.stdout: "client_info": { 2023-08-01T19:56:08.227 INFO:teuthology.orchestra.run.smithi155.stdout: "client": "client.4668", 2023-08-01T19:56:08.227 INFO:teuthology.orchestra.run.smithi155.stdout: "client_addr": "172.21.15.6:0/1709472247", 2023-08-01T19:56:08.227 INFO:teuthology.orchestra.run.smithi155.stdout: "tid": 215173 2023-08-01T19:56:08.227 INFO:teuthology.orchestra.run.smithi155.stdout: }, 2023-08-01T19:56:08.227 INFO:teuthology.orchestra.run.smithi155.stdout: "events": [ 2023-08-01T19:56:08.228 INFO:teuthology.orchestra.run.smithi155.stdout: { 2023-08-01T19:56:08.228 INFO:teuthology.orchestra.run.smithi155.stdout: "event": "initiated", 2023-08-01T19:56:08.228 INFO:teuthology.orchestra.run.smithi155.stdout: "time": "2023-08-01T19:56:08.183522+0000", 2023-08-01T19:56:08.228 INFO:teuthology.orchestra.run.smithi155.stdout: "duration": 0 2023-08-01T19:56:08.228 INFO:teuthology.orchestra.run.smithi155.stdout: }, 2023-08-01T19:56:08.228 INFO:teuthology.orchestra.run.smithi155.stdout: { 2023-08-01T19:56:08.228 INFO:teuthology.orchestra.run.smithi155.stdout: "event": "throttled", 2023-08-01T19:56:08.229 INFO:teuthology.orchestra.run.smithi155.stdout: "time": "2023-08-01T19:56:08.183522+0000", 2023-08-01T19:56:08.229 INFO:teuthology.orchestra.run.smithi155.stdout: "duration": 0 2023-08-01T19:56:08.229 INFO:teuthology.orchestra.run.smithi155.stdout: }, 2023-08-01T19:56:08.229 INFO:teuthology.orchestra.run.smithi155.stdout: { 2023-08-01T19:56:08.229 INFO:teuthology.orchestra.run.smithi155.stdout: "event": "header_read", 2023-08-01T19:56:08.229 INFO:teuthology.orchestra.run.smithi155.stdout: "time": "2023-08-01T19:56:08.183521+0000", 2023-08-01T19:56:08.229 INFO:teuthology.orchestra.run.smithi155.stdout: "duration": 4294967295.999999 2023-08-01T19:56:08.230 INFO:teuthology.orchestra.run.smithi155.stdout: }, 2023-08-01T19:56:08.230 INFO:teuthology.orchestra.run.smithi155.stdout: { 2023-08-01T19:56:08.230 INFO:teuthology.orchestra.run.smithi155.stdout: "event": "all_read", 2023-08-01T19:56:08.230 INFO:teuthology.orchestra.run.smithi155.stdout: "time": "2023-08-01T19:56:08.183526+0000", 2023-08-01T19:56:08.230 INFO:teuthology.orchestra.run.smithi155.stdout: "duration": 4.8550000000000001e-06 2023-08-01T19:56:08.230 INFO:teuthology.orchestra.run.smithi155.stdout: }, 2023-08-01T19:56:08.230 INFO:teuthology.orchestra.run.smithi155.stdout: { 2023-08-01T19:56:08.231 INFO:teuthology.orchestra.run.smithi155.stdout: "event": "dispatched", 2023-08-01T19:56:08.231 INFO:teuthology.orchestra.run.smithi155.stdout: "time": "2023-08-01T19:56:08.183537+0000", 2023-08-01T19:56:08.231 INFO:teuthology.orchestra.run.smithi155.stdout: "duration": 1.1014e-05 2023-08-01T19:56:08.231 INFO:teuthology.orchestra.run.smithi155.stdout: }, 2023-08-01T19:56:08.231 INFO:teuthology.orchestra.run.smithi155.stdout: { 2023-08-01T19:56:08.231 INFO:teuthology.orchestra.run.smithi155.stdout: "event": "queued_for_pg", 2023-08-01T19:56:08.231 INFO:teuthology.orchestra.run.smithi155.stdout: "time": "2023-08-01T19:56:08.183542+0000", 2023-08-01T19:56:08.232 INFO:teuthology.orchestra.run.smithi155.stdout: "duration": 5.113e-06 2023-08-01T19:56:08.232 INFO:teuthology.orchestra.run.smithi155.stdout: }, 2023-08-01T19:56:08.232 INFO:teuthology.orchestra.run.smithi155.stdout: { 2023-08-01T19:56:08.232 INFO:teuthology.orchestra.run.smithi155.stdout: "event": "reached_pg", 2023-08-01T19:56:08.232 INFO:teuthology.orchestra.run.smithi155.stdout: "time": "2023-08-01T19:56:08.183572+0000", 2023-08-01T19:56:08.232 INFO:teuthology.orchestra.run.smithi155.stdout: "duration": 3.0159999999999999e-05 2023-08-01T19:56:08.232 INFO:teuthology.orchestra.run.smithi155.stdout: }, 2023-08-01T19:56:08.233 INFO:teuthology.orchestra.run.smithi155.stdout: { 2023-08-01T19:56:08.233 INFO:teuthology.orchestra.run.smithi155.stdout: "event": "started", 2023-08-01T19:56:08.233 INFO:teuthology.orchestra.run.smithi155.stdout: "time": "2023-08-01T19:56:08.183643+0000", 2023-08-01T19:56:08.233 INFO:teuthology.orchestra.run.smithi155.stdout: "duration": 7.1075000000000006e-05 2023-08-01T19:56:08.233 INFO:teuthology.orchestra.run.smithi155.stdout: }, 2023-08-01T19:56:08.233 INFO:teuthology.orchestra.run.smithi155.stdout: { 2023-08-01T19:56:08.233 INFO:teuthology.orchestra.run.smithi155.stdout: "event": "waiting for subops from 0", 2023-08-01T19:56:08.233 INFO:teuthology.orchestra.run.smithi155.stdout: "time": "2023-08-01T19:56:08.183704+0000", 2023-08-01T19:56:08.234 INFO:teuthology.orchestra.run.smithi155.stdout: "duration": 6.0362000000000002e-05 2023-08-01T19:56:08.234 INFO:teuthology.orchestra.run.smithi155.stdout: }, 2023-08-01T19:56:08.234 INFO:teuthology.orchestra.run.smithi155.stdout: { 2023-08-01T19:56:08.234 INFO:teuthology.orchestra.run.smithi155.stdout: "event": "op_commit", 2023-08-01T19:56:08.234 INFO:teuthology.orchestra.run.smithi155.stdout: "time": "2023-08-01T19:56:08.186502+0000", 2023-08-01T19:56:08.234 INFO:teuthology.orchestra.run.smithi155.stdout: "duration": 0.0027979900000000002 2023-08-01T19:56:08.234 INFO:teuthology.orchestra.run.smithi155.stdout: } 2023-08-01T19:56:08.235 INFO:teuthology.orchestra.run.smithi155.stdout: ] 2023-08-01T19:56:08.235 INFO:teuthology.orchestra.run.smithi155.stdout: } 2023-08-01T19:56:08.235 INFO:teuthology.orchestra.run.smithi155.stdout: }, 2023-08-01T19:56:08.235 INFO:teuthology.orchestra.run.smithi155.stdout: { 2023-08-01T19:56:08.235 INFO:teuthology.orchestra.run.smithi155.stdout: "description": "osd_op(client.4668.0:215174 5.0 5:06c63c3c:::benchmark_data_smithi006_114134_object81513:head [delete] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e66)", 2023-08-01T19:56:08.235 INFO:teuthology.orchestra.run.smithi155.stdout: "initiated_at": "2023-08-01T19:56:08.184488+0000", 2023-08-01T19:56:08.235 INFO:teuthology.orchestra.run.smithi155.stdout: "age": 0.0023313909999999999, 2023-08-01T19:56:08.236 INFO:teuthology.orchestra.run.smithi155.stdout: "duration": 0.0026136710000000001, 2023-08-01T19:56:08.236 INFO:teuthology.orchestra.run.smithi155.stdout: "type_data": { 2023-08-01T19:56:08.236 INFO:teuthology.orchestra.run.smithi155.stdout: "flag_point": "waiting for sub ops", 2023-08-01T19:56:08.236 INFO:teuthology.orchestra.run.smithi155.stdout: "client_info": { 2023-08-01T19:56:08.236 INFO:teuthology.orchestra.run.smithi155.stdout: "client": "client.4668", 2023-08-01T19:56:08.236 INFO:teuthology.orchestra.run.smithi155.stdout: "client_addr": "172.21.15.6:0/1709472247", 2023-08-01T19:56:08.236 INFO:teuthology.orchestra.run.smithi155.stdout: "tid": 215174 2023-08-01T19:56:08.237 INFO:teuthology.orchestra.run.smithi155.stdout: }, 2023-08-01T19:56:08.237 INFO:teuthology.orchestra.run.smithi155.stdout: "events": [ 2023-08-01T19:56:08.237 INFO:teuthology.orchestra.run.smithi155.stdout: { 2023-08-01T19:56:08.237 INFO:teuthology.orchestra.run.smithi155.stdout: "event": "initiated", 2023-08-01T19:56:08.237 INFO:teuthology.orchestra.run.smithi155.stdout: "time": "2023-08-01T19:56:08.184488+0000", 2023-08-01T19:56:08.237 INFO:teuthology.orchestra.run.smithi155.stdout: "duration": 0 2023-08-01T19:56:08.237 INFO:teuthology.orchestra.run.smithi155.stdout: }, 2023-08-01T19:56:08.238 INFO:teuthology.orchestra.run.smithi155.stdout: { 2023-08-01T19:56:08.238 INFO:teuthology.orchestra.run.smithi155.stdout: "event": "throttled", 2023-08-01T19:56:08.238 INFO:teuthology.orchestra.run.smithi155.stdout: "time": "2023-08-01T19:56:08.184488+0000", 2023-08-01T19:56:08.238 INFO:teuthology.orchestra.run.smithi155.stdout: "duration": 0 2023-08-01T19:56:08.238 INFO:teuthology.orchestra.run.smithi155.stdout: }, 2023-08-01T19:56:08.238 INFO:teuthology.orchestra.run.smithi155.stdout: { 2023-08-01T19:56:08.238 INFO:teuthology.orchestra.run.smithi155.stdout: "event": "header_read", 2023-08-01T19:56:08.239 INFO:teuthology.orchestra.run.smithi155.stdout: "time": "2023-08-01T19:56:08.184487+0000", 2023-08-01T19:56:08.239 INFO:teuthology.orchestra.run.smithi155.stdout: "duration": 4294967295.9999995 2023-08-01T19:56:08.239 INFO:teuthology.orchestra.run.smithi155.stdout: }, 2023-08-01T19:56:08.239 INFO:teuthology.orchestra.run.smithi155.stdout: { 2023-08-01T19:56:08.239 INFO:teuthology.orchestra.run.smithi155.stdout: "event": "all_read", 2023-08-01T19:56:08.239 INFO:teuthology.orchestra.run.smithi155.stdout: "time": "2023-08-01T19:56:08.184492+0000", 2023-08-01T19:56:08.239 INFO:teuthology.orchestra.run.smithi155.stdout: "duration": 4.6349999999999997e-06 2023-08-01T19:56:08.240 INFO:teuthology.orchestra.run.smithi155.stdout: }, 2023-08-01T19:56:08.240 INFO:teuthology.orchestra.run.smithi155.stdout: { 2023-08-01T19:56:08.240 INFO:teuthology.orchestra.run.smithi155.stdout: "event": "dispatched", 2023-08-01T19:56:08.240 INFO:teuthology.orchestra.run.smithi155.stdout: "time": "2023-08-01T19:56:08.184501+0000", 2023-08-01T19:56:08.240 INFO:teuthology.orchestra.run.smithi155.stdout: "duration": 8.7760000000000003e-06 2023-08-01T19:56:08.240 INFO:teuthology.orchestra.run.smithi155.stdout: }, 2023-08-01T19:56:08.240 INFO:teuthology.orchestra.run.smithi155.stdout: { 2023-08-01T19:56:08.241 INFO:teuthology.orchestra.run.smithi155.stdout: "event": "queued_for_pg", 2023-08-01T19:56:08.241 INFO:teuthology.orchestra.run.smithi155.stdout: "time": "2023-08-01T19:56:08.184506+0000", 2023-08-01T19:56:08.241 INFO:teuthology.orchestra.run.smithi155.stdout: "duration": 5.6579999999999999e-06 2023-08-01T19:56:08.241 INFO:teuthology.orchestra.run.smithi155.stdout: }, 2023-08-01T19:56:08.241 INFO:teuthology.orchestra.run.smithi155.stdout: { 2023-08-01T19:56:08.241 INFO:teuthology.orchestra.run.smithi155.stdout: "event": "reached_pg", 2023-08-01T19:56:08.241 INFO:teuthology.orchestra.run.smithi155.stdout: "time": "2023-08-01T19:56:08.185165+0000", 2023-08-01T19:56:08.241 INFO:teuthology.orchestra.run.smithi155.stdout: "duration": 0.00065827300000000002 2023-08-01T19:56:08.242 INFO:teuthology.orchestra.run.smithi155.stdout: }, 2023-08-01T19:56:08.242 INFO:teuthology.orchestra.run.smithi155.stdout: { 2023-08-01T19:56:08.242 INFO:teuthology.orchestra.run.smithi155.stdout: "event": "started", 2023-08-01T19:56:08.242 INFO:teuthology.orchestra.run.smithi155.stdout: "time": "2023-08-01T19:56:08.185239+0000", 2023-08-01T19:56:08.242 INFO:teuthology.orchestra.run.smithi155.stdout: "duration": 7.4082e-05 2023-08-01T19:56:08.242 INFO:teuthology.orchestra.run.smithi155.stdout: }, 2023-08-01T19:56:08.242 INFO:teuthology.orchestra.run.smithi155.stdout: { 2023-08-01T19:56:08.243 INFO:teuthology.orchestra.run.smithi155.stdout: "event": "waiting for subops from 0", 2023-08-01T19:56:08.243 INFO:teuthology.orchestra.run.smithi155.stdout: "time": "2023-08-01T19:56:08.185298+0000", 2023-08-01T19:56:08.243 INFO:teuthology.orchestra.run.smithi155.stdout: "duration": 5.9369e-05 2023-08-01T19:56:08.243 INFO:teuthology.orchestra.run.smithi155.stdout: } 2023-08-01T19:56:08.243 INFO:teuthology.orchestra.run.smithi155.stdout: ] 2023-08-01T19:56:08.243 INFO:teuthology.orchestra.run.smithi155.stdout: } 2023-08-01T19:56:08.243 INFO:teuthology.orchestra.run.smithi155.stdout: }, 2023-08-01T19:56:08.244 INFO:teuthology.orchestra.run.smithi155.stdout: { 2023-08-01T19:56:08.244 INFO:teuthology.orchestra.run.smithi155.stdout: "description": "osd_op(client.4668.0:215177 5.d 5:b19b184a:::benchmark_data_smithi006_114134_object81516:head [delete] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e66)", 2023-08-01T19:56:08.244 INFO:teuthology.orchestra.run.smithi155.stdout: "initiated_at": "2023-08-01T19:56:08.185452+0000", 2023-08-01T19:56:08.244 INFO:teuthology.orchestra.run.smithi155.stdout: "age": 0.001367673, 2023-08-01T19:56:08.244 INFO:teuthology.orchestra.run.smithi155.stdout: "duration": 0.001749425, 2023-08-01T19:56:08.244 INFO:teuthology.orchestra.run.smithi155.stdout: "type_data": { 2023-08-01T19:56:08.244 INFO:teuthology.orchestra.run.smithi155.stdout: "flag_point": "started", 2023-08-01T19:56:08.245 INFO:teuthology.orchestra.run.smithi155.stdout: "client_info": { 2023-08-01T19:56:08.245 INFO:teuthology.orchestra.run.smithi155.stdout: "client": "client.4668", 2023-08-01T19:56:08.245 INFO:teuthology.orchestra.run.smithi155.stdout: "client_addr": "172.21.15.6:0/1709472247", 2023-08-01T19:56:08.245 INFO:teuthology.orchestra.run.smithi155.stdout: "tid": 215177 2023-08-01T19:56:08.245 INFO:teuthology.orchestra.run.smithi155.stdout: }, 2023-08-01T19:56:08.245 INFO:teuthology.orchestra.run.smithi155.stdout: "events": [ 2023-08-01T19:56:08.245 INFO:teuthology.orchestra.run.smithi155.stdout: { 2023-08-01T19:56:08.246 INFO:teuthology.orchestra.run.smithi155.stdout: "event": "initiated", 2023-08-01T19:56:08.246 INFO:teuthology.orchestra.run.smithi155.stdout: "time": "2023-08-01T19:56:08.185452+0000", 2023-08-01T19:56:08.246 INFO:teuthology.orchestra.run.smithi155.stdout: "duration": 0 2023-08-01T19:56:08.246 INFO:teuthology.orchestra.run.smithi155.stdout: }, 2023-08-01T19:56:08.246 INFO:teuthology.orchestra.run.smithi155.stdout: { 2023-08-01T19:56:08.246 INFO:teuthology.orchestra.run.smithi155.stdout: "event": "throttled", 2023-08-01T19:56:08.246 INFO:teuthology.orchestra.run.smithi155.stdout: "time": "2023-08-01T19:56:08.185452+0000", 2023-08-01T19:56:08.247 INFO:teuthology.orchestra.run.smithi155.stdout: "duration": 0 2023-08-01T19:56:08.247 INFO:teuthology.orchestra.run.smithi155.stdout: }, 2023-08-01T19:56:08.247 INFO:teuthology.orchestra.run.smithi155.stdout: { 2023-08-01T19:56:08.247 INFO:teuthology.orchestra.run.smithi155.stdout: "event": "header_read", 2023-08-01T19:56:08.247 INFO:teuthology.orchestra.run.smithi155.stdout: "time": "2023-08-01T19:56:08.185451+0000", 2023-08-01T19:56:08.247 INFO:teuthology.orchestra.run.smithi155.stdout: "duration": 4294967295.9999995 2023-08-01T19:56:08.247 INFO:teuthology.orchestra.run.smithi155.stdout: }, 2023-08-01T19:56:08.248 INFO:teuthology.orchestra.run.smithi155.stdout: { 2023-08-01T19:56:08.248 INFO:teuthology.orchestra.run.smithi155.stdout: "event": "all_read", 2023-08-01T19:56:08.248 INFO:teuthology.orchestra.run.smithi155.stdout: "time": "2023-08-01T19:56:08.185454+0000", 2023-08-01T19:56:08.248 INFO:teuthology.orchestra.run.smithi155.stdout: "duration": 3.1709999999999998e-06 2023-08-01T19:56:08.248 INFO:teuthology.orchestra.run.smithi155.stdout: }, 2023-08-01T19:56:08.248 INFO:teuthology.orchestra.run.smithi155.stdout: { 2023-08-01T19:56:08.248 INFO:teuthology.orchestra.run.smithi155.stdout: "event": "dispatched", 2023-08-01T19:56:08.248 INFO:teuthology.orchestra.run.smithi155.stdout: "time": "2023-08-01T19:56:08.185461+0000", 2023-08-01T19:56:08.249 INFO:teuthology.orchestra.run.smithi155.stdout: "duration": 7.1450000000000002e-06 2023-08-01T19:56:08.249 INFO:teuthology.orchestra.run.smithi155.stdout: }, 2023-08-01T19:56:08.249 INFO:teuthology.orchestra.run.smithi155.stdout: { 2023-08-01T19:56:08.249 INFO:teuthology.orchestra.run.smithi155.stdout: "event": "queued_for_pg", 2023-08-01T19:56:08.249 INFO:teuthology.orchestra.run.smithi155.stdout: "time": "2023-08-01T19:56:08.185465+0000", 2023-08-01T19:56:08.249 INFO:teuthology.orchestra.run.smithi155.stdout: "duration": 3.2160000000000002e-06 2023-08-01T19:56:08.249 INFO:teuthology.orchestra.run.smithi155.stdout: }, 2023-08-01T19:56:08.250 INFO:teuthology.orchestra.run.smithi155.stdout: { 2023-08-01T19:56:08.250 INFO:teuthology.orchestra.run.smithi155.stdout: "event": "reached_pg", 2023-08-01T19:56:08.250 INFO:teuthology.orchestra.run.smithi155.stdout: "time": "2023-08-01T19:56:08.185490+0000", 2023-08-01T19:56:08.250 INFO:teuthology.orchestra.run.smithi155.stdout: "duration": 2.5425000000000001e-05 2023-08-01T19:56:08.250 INFO:teuthology.orchestra.run.smithi155.stdout: }, 2023-08-01T19:56:08.250 INFO:teuthology.orchestra.run.smithi155.stdout: { 2023-08-01T19:56:08.250 INFO:teuthology.orchestra.run.smithi155.stdout: "event": "started", 2023-08-01T19:56:08.251 INFO:teuthology.orchestra.run.smithi155.stdout: "time": "2023-08-01T19:56:08.185575+0000", 2023-08-01T19:56:08.251 INFO:teuthology.orchestra.run.smithi155.stdout: "duration": 8.4784999999999995e-05 2023-08-01T19:56:08.251 INFO:teuthology.orchestra.run.smithi155.stdout: } 2023-08-01T19:56:08.251 INFO:teuthology.orchestra.run.smithi155.stdout: ] 2023-08-01T19:56:08.251 INFO:teuthology.orchestra.run.smithi155.stdout: } 2023-08-01T19:56:08.251 INFO:teuthology.orchestra.run.smithi155.stdout: }, 2023-08-01T19:56:08.251 INFO:teuthology.orchestra.run.smithi155.stdout: { 2023-08-01T19:56:08.252 INFO:teuthology.orchestra.run.smithi155.stdout: "description": "osd_repop_reply(client.4668.0:215157 5.0 e66/19 ondisk, result = 0)", 2023-08-01T19:56:08.252 INFO:teuthology.orchestra.run.smithi155.stdout: "initiated_at": "2023-08-01T19:56:08.187093+0000", 2023-08-01T19:56:08.252 INFO:teuthology.orchestra.run.smithi155.stdout: "age": 4294967295.9997263, 2023-08-01T19:56:08.252 INFO:teuthology.orchestra.run.smithi155.stdout: "duration": 0.00016660500000000001, 2023-08-01T19:56:08.252 INFO:teuthology.orchestra.run.smithi155.stdout: "type_data": { 2023-08-01T19:56:08.252 INFO:teuthology.orchestra.run.smithi155.stdout: "flag_point": "started", 2023-08-01T19:56:08.252 INFO:teuthology.orchestra.run.smithi155.stdout: "events": [ 2023-08-01T19:56:08.253 INFO:teuthology.orchestra.run.smithi155.stdout: { 2023-08-01T19:56:08.253 INFO:teuthology.orchestra.run.smithi155.stdout: "event": "initiated", 2023-08-01T19:56:08.253 INFO:teuthology.orchestra.run.smithi155.stdout: "time": "2023-08-01T19:56:08.187093+0000", 2023-08-01T19:56:08.253 INFO:teuthology.orchestra.run.smithi155.stdout: "duration": 0 2023-08-01T19:56:08.253 INFO:teuthology.orchestra.run.smithi155.stdout: }, 2023-08-01T19:56:08.253 INFO:teuthology.orchestra.run.smithi155.stdout: { 2023-08-01T19:56:08.253 INFO:teuthology.orchestra.run.smithi155.stdout: "event": "throttled", 2023-08-01T19:56:08.254 INFO:teuthology.orchestra.run.smithi155.stdout: "time": "2023-08-01T19:56:08.187093+0000", 2023-08-01T19:56:08.254 INFO:teuthology.orchestra.run.smithi155.stdout: "duration": 0 2023-08-01T19:56:08.254 INFO:teuthology.orchestra.run.smithi155.stdout: }, 2023-08-01T19:56:08.254 INFO:teuthology.orchestra.run.smithi155.stdout: { 2023-08-01T19:56:08.254 INFO:teuthology.orchestra.run.smithi155.stdout: "event": "header_read", 2023-08-01T19:56:08.254 INFO:teuthology.orchestra.run.smithi155.stdout: "time": "2023-08-01T19:56:08.187093+0000", 2023-08-01T19:56:08.254 INFO:teuthology.orchestra.run.smithi155.stdout: "duration": 4294967295.9999995 2023-08-01T19:56:08.254 INFO:teuthology.orchestra.run.smithi155.stdout: }, 2023-08-01T19:56:08.255 INFO:teuthology.orchestra.run.smithi155.stdout: { 2023-08-01T19:56:08.255 INFO:teuthology.orchestra.run.smithi155.stdout: "event": "all_read", 2023-08-01T19:56:08.255 INFO:teuthology.orchestra.run.smithi155.stdout: "time": "2023-08-01T19:56:08.187100+0000", 2023-08-01T19:56:08.255 INFO:teuthology.orchestra.run.smithi155.stdout: "duration": 7.8779999999999998e-06 2023-08-01T19:56:08.255 INFO:teuthology.orchestra.run.smithi155.stdout: }, 2023-08-01T19:56:08.255 INFO:teuthology.orchestra.run.smithi155.stdout: { 2023-08-01T19:56:08.255 INFO:teuthology.orchestra.run.smithi155.stdout: "event": "dispatched", 2023-08-01T19:56:08.256 INFO:teuthology.orchestra.run.smithi155.stdout: "time": "2023-08-01T19:56:08.187111+0000", 2023-08-01T19:56:08.256 INFO:teuthology.orchestra.run.smithi155.stdout: "duration": 1.049e-05 2023-08-01T19:56:08.256 INFO:teuthology.orchestra.run.smithi155.stdout: }, 2023-08-01T19:56:08.256 INFO:teuthology.orchestra.run.smithi155.stdout: { 2023-08-01T19:56:08.256 INFO:teuthology.orchestra.run.smithi155.stdout: "event": "queued_for_pg", 2023-08-01T19:56:08.256 INFO:teuthology.orchestra.run.smithi155.stdout: "time": "2023-08-01T19:56:08.187118+0000", 2023-08-01T19:56:08.256 INFO:teuthology.orchestra.run.smithi155.stdout: "duration": 6.6209999999999998e-06 2023-08-01T19:56:08.257 INFO:teuthology.orchestra.run.smithi155.stdout: }, 2023-08-01T19:56:08.257 INFO:teuthology.orchestra.run.smithi155.stdout: { 2023-08-01T19:56:08.257 INFO:teuthology.orchestra.run.smithi155.stdout: "event": "reached_pg", 2023-08-01T19:56:08.257 INFO:teuthology.orchestra.run.smithi155.stdout: "time": "2023-08-01T19:56:08.187148+0000", 2023-08-01T19:56:08.257 INFO:teuthology.orchestra.run.smithi155.stdout: "duration": 3.0227e-05 2023-08-01T19:56:08.257 INFO:teuthology.orchestra.run.smithi155.stdout: }, 2023-08-01T19:56:08.257 INFO:teuthology.orchestra.run.smithi155.stdout: { 2023-08-01T19:56:08.258 INFO:teuthology.orchestra.run.smithi155.stdout: "event": "started", 2023-08-01T19:56:08.258 INFO:teuthology.orchestra.run.smithi155.stdout: "time": "2023-08-01T19:56:08.187159+0000", 2023-08-01T19:56:08.258 INFO:teuthology.orchestra.run.smithi155.stdout: "duration": 1.1239e-05 2023-08-01T19:56:08.258 INFO:teuthology.orchestra.run.smithi155.stdout: }, 2023-08-01T19:56:08.258 INFO:teuthology.orchestra.run.smithi155.stdout: { 2023-08-01T19:56:08.258 INFO:teuthology.orchestra.run.smithi155.stdout: "event": "done", 2023-08-01T19:56:08.258 INFO:teuthology.orchestra.run.smithi155.stdout: "time": "2023-08-01T19:56:08.187260+0000", 2023-08-01T19:56:08.259 INFO:teuthology.orchestra.run.smithi155.stdout: "duration": 0.000100781 2023-08-01T19:56:08.259 INFO:teuthology.orchestra.run.smithi155.stdout: } 2023-08-01T19:56:08.259 INFO:teuthology.orchestra.run.smithi155.stdout: ] 2023-08-01T19:56:08.259 INFO:teuthology.orchestra.run.smithi155.stdout: } 2023-08-01T19:56:08.259 INFO:teuthology.orchestra.run.smithi155.stdout: }, 2023-08-01T19:56:08.259 INFO:teuthology.orchestra.run.smithi155.stdout: { 2023-08-01T19:56:08.259 INFO:teuthology.orchestra.run.smithi155.stdout: "description": "osd_repop_reply(client.4668.0:215163 5.0 e66/19 ondisk, result = 0)", 2023-08-01T19:56:08.259 INFO:teuthology.orchestra.run.smithi155.stdout: "initiated_at": "2023-08-01T19:56:08.187167+0000", 2023-08-01T19:56:08.260 INFO:teuthology.orchestra.run.smithi155.stdout: "age": 4294967295.9996519, 2023-08-01T19:56:08.260 INFO:teuthology.orchestra.run.smithi155.stdout: "duration": 0.000134282, 2023-08-01T19:56:08.260 INFO:teuthology.orchestra.run.smithi155.stdout: "type_data": { 2023-08-01T19:56:08.260 INFO:teuthology.orchestra.run.smithi155.stdout: "flag_point": "started", 2023-08-01T19:56:08.260 INFO:teuthology.orchestra.run.smithi155.stdout: "events": [ 2023-08-01T19:56:08.260 INFO:teuthology.orchestra.run.smithi155.stdout: { 2023-08-01T19:56:08.260 INFO:teuthology.orchestra.run.smithi155.stdout: "event": "initiated", 2023-08-01T19:56:08.261 INFO:teuthology.orchestra.run.smithi155.stdout: "time": "2023-08-01T19:56:08.187167+0000", 2023-08-01T19:56:08.261 INFO:teuthology.orchestra.run.smithi155.stdout: "duration": 0 2023-08-01T19:56:08.261 INFO:teuthology.orchestra.run.smithi155.stdout: }, 2023-08-01T19:56:08.261 INFO:teuthology.orchestra.run.smithi155.stdout: { 2023-08-01T19:56:08.261 INFO:teuthology.orchestra.run.smithi155.stdout: "event": "throttled", 2023-08-01T19:56:08.261 INFO:teuthology.orchestra.run.smithi155.stdout: "time": "2023-08-01T19:56:08.187167+0000", 2023-08-01T19:56:08.261 INFO:teuthology.orchestra.run.smithi155.stdout: "duration": 0 2023-08-01T19:56:08.262 INFO:teuthology.orchestra.run.smithi155.stdout: }, 2023-08-01T19:56:08.262 INFO:teuthology.orchestra.run.smithi155.stdout: { 2023-08-01T19:56:08.262 INFO:teuthology.orchestra.run.smithi155.stdout: "event": "header_read", 2023-08-01T19:56:08.262 INFO:teuthology.orchestra.run.smithi155.stdout: "time": "2023-08-01T19:56:08.187167+0000", 2023-08-01T19:56:08.262 INFO:teuthology.orchestra.run.smithi155.stdout: "duration": 4294967295.9999995 2023-08-01T19:56:08.262 INFO:teuthology.orchestra.run.smithi155.stdout: }, 2023-08-01T19:56:08.262 INFO:teuthology.orchestra.run.smithi155.stdout: { 2023-08-01T19:56:08.263 INFO:teuthology.orchestra.run.smithi155.stdout: "event": "all_read", 2023-08-01T19:56:08.263 INFO:teuthology.orchestra.run.smithi155.stdout: "time": "2023-08-01T19:56:08.187170+0000", 2023-08-01T19:56:08.263 INFO:teuthology.orchestra.run.smithi155.stdout: "duration": 3.0960000000000001e-06 2023-08-01T19:56:08.263 INFO:teuthology.orchestra.run.smithi155.stdout: }, 2023-08-01T19:56:08.263 INFO:teuthology.orchestra.run.smithi155.stdout: { 2023-08-01T19:56:08.263 INFO:teuthology.orchestra.run.smithi155.stdout: "event": "dispatched", 2023-08-01T19:56:08.263 INFO:teuthology.orchestra.run.smithi155.stdout: "time": "2023-08-01T19:56:08.187181+0000", 2023-08-01T19:56:08.264 INFO:teuthology.orchestra.run.smithi155.stdout: "duration": 1.0513000000000001e-05 2023-08-01T19:56:08.264 INFO:teuthology.orchestra.run.smithi155.stdout: }, 2023-08-01T19:56:08.264 INFO:teuthology.orchestra.run.smithi155.stdout: { 2023-08-01T19:56:08.264 INFO:teuthology.orchestra.run.smithi155.stdout: "event": "queued_for_pg", 2023-08-01T19:56:08.264 INFO:teuthology.orchestra.run.smithi155.stdout: "time": "2023-08-01T19:56:08.187186+0000", 2023-08-01T19:56:08.264 INFO:teuthology.orchestra.run.smithi155.stdout: "duration": 5.5500000000000002e-06 2023-08-01T19:56:08.264 INFO:teuthology.orchestra.run.smithi155.stdout: }, 2023-08-01T19:56:08.265 INFO:teuthology.orchestra.run.smithi155.stdout: { 2023-08-01T19:56:08.265 INFO:teuthology.orchestra.run.smithi155.stdout: "event": "reached_pg", 2023-08-01T19:56:08.265 INFO:teuthology.orchestra.run.smithi155.stdout: "time": "2023-08-01T19:56:08.187272+0000", 2023-08-01T19:56:08.265 INFO:teuthology.orchestra.run.smithi155.stdout: "duration": 8.5989000000000006e-05 2023-08-01T19:56:08.265 INFO:teuthology.orchestra.run.smithi155.stdout: }, 2023-08-01T19:56:08.265 INFO:teuthology.orchestra.run.smithi155.stdout: { 2023-08-01T19:56:08.265 INFO:teuthology.orchestra.run.smithi155.stdout: "event": "started", 2023-08-01T19:56:08.265 INFO:teuthology.orchestra.run.smithi155.stdout: "time": "2023-08-01T19:56:08.187275+0000", 2023-08-01T19:56:08.266 INFO:teuthology.orchestra.run.smithi155.stdout: "duration": 3.1990000000000002e-06 2023-08-01T19:56:08.266 INFO:teuthology.orchestra.run.smithi155.stdout: } 2023-08-01T19:56:08.266 INFO:teuthology.orchestra.run.smithi155.stdout: ] 2023-08-01T19:56:08.266 INFO:teuthology.orchestra.run.smithi155.stdout: } 2023-08-01T19:56:08.266 INFO:teuthology.orchestra.run.smithi155.stdout: } 2023-08-01T19:56:08.266 INFO:teuthology.orchestra.run.smithi155.stdout: ], 2023-08-01T19:56:08.266 INFO:teuthology.orchestra.run.smithi155.stdout: "num_ops": 9 2023-08-01T19:56:08.267 INFO:teuthology.orchestra.run.smithi155.stdout:} 2023-08-01T19:56:08.268 DEBUG:teuthology.orchestra.run.smithi155:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 30 ceph --cluster ceph --admin-daemon /var/run/ceph/ceph-osd.2.asok dump_blocked_ops 2023-08-01T19:56:08.269 INFO:tasks.ceph.osd.0.smithi008.stderr:2023-08-01T19:56:08.266+0000 7f16a58f4700 -1 received signal: Hangup from /usr/bin/python3 /bin/daemon-helper kill ceph-osd -f --cluster ceph -i 0 (PID: 111179) UID: 0 2023-08-01T19:56:08.368 INFO:tasks.ceph.osd.0.smithi008.stderr:2023-08-01T19:56:08.366+0000 7f16a58f4700 -1 received signal: Hangup from /usr/bin/python3 /bin/daemon-helper kill ceph-osd -f --cluster ceph -i 0 (PID: 111179) UID: 0 2023-08-01T19:56:08.436 INFO:teuthology.orchestra.run.smithi155.stdout:{ 2023-08-01T19:56:08.436 INFO:teuthology.orchestra.run.smithi155.stdout: "ops": [], 2023-08-01T19:56:08.436 INFO:teuthology.orchestra.run.smithi155.stdout: "complaint_time": 30, 2023-08-01T19:56:08.437 INFO:teuthology.orchestra.run.smithi155.stdout: "num_blocked_ops": 0 2023-08-01T19:56:08.437 INFO:teuthology.orchestra.run.smithi155.stdout:} 2023-08-01T19:56:08.450 DEBUG:teuthology.orchestra.run.smithi155:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 30 ceph --cluster ceph --admin-daemon /var/run/ceph/ceph-osd.2.asok dump_historic_ops 2023-08-01T19:56:08.493 INFO:tasks.ceph.osd.2.smithi155.stderr:2023-08-01T19:56:08.492+0000 7faa5c6ac700 -1 received signal: Hangup from /usr/bin/python3 /bin/daemon-helper kill ceph-osd -f --cluster ceph -i 2 (PID: 111337) UID: 0 2023-08-01T19:56:08.540 DEBUG:teuthology.orchestra.run.smithi006:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 120 ceph --cluster ceph -- tell 'osd.*' injectargs --osd_enable_op_tracker=false 2023-08-01T19:56:08.570 INFO:tasks.ceph.osd.0.smithi008.stderr:2023-08-01T19:56:08.569+0000 7f16a58f4700 -1 received signal: Hangup from /usr/bin/python3 /bin/daemon-helper kill ceph-osd -f --cluster ceph -i 0 (PID: 111179) UID: 0 2023-08-01T19:56:08.638 INFO:teuthology.orchestra.run.smithi155.stdout:{ 2023-08-01T19:56:08.639 INFO:teuthology.orchestra.run.smithi155.stdout: "size": 20, 2023-08-01T19:56:08.639 INFO:teuthology.orchestra.run.smithi155.stdout: "duration": 600, 2023-08-01T19:56:08.639 INFO:teuthology.orchestra.run.smithi155.stdout: "ops": [ 2023-08-01T19:56:08.639 INFO:teuthology.orchestra.run.smithi155.stdout: { 2023-08-01T19:56:08.639 INFO:teuthology.orchestra.run.smithi155.stdout: "description": "osd_op(client.4668.0:100237 5.4 5:2d68bec9:::benchmark_data_smithi006_114134_object100236:head [set-alloc-hint object_size 65536 write_size 65536,write 0~65536] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e37)", 2023-08-01T19:56:08.639 INFO:teuthology.orchestra.run.smithi155.stdout: "initiated_at": "2023-08-01T19:55:05.147736+0000", 2023-08-01T19:56:08.640 INFO:teuthology.orchestra.run.smithi155.stdout: "age": 63.488041258000003, 2023-08-01T19:56:08.640 INFO:teuthology.orchestra.run.smithi155.stdout: "duration": 0.071299464000000007, 2023-08-01T19:56:08.640 INFO:teuthology.orchestra.run.smithi155.stdout: "type_data": { 2023-08-01T19:56:08.640 INFO:teuthology.orchestra.run.smithi155.stdout: "flag_point": "commit sent; apply or cleanup", 2023-08-01T19:56:08.640 INFO:teuthology.orchestra.run.smithi155.stdout: "client_info": { 2023-08-01T19:56:08.640 INFO:teuthology.orchestra.run.smithi155.stdout: "client": "client.4668", 2023-08-01T19:56:08.640 INFO:teuthology.orchestra.run.smithi155.stdout: "client_addr": "172.21.15.6:0/1709472247", 2023-08-01T19:56:08.640 INFO:teuthology.orchestra.run.smithi155.stdout: "tid": 100237 2023-08-01T19:56:08.641 INFO:teuthology.orchestra.run.smithi155.stdout: }, 2023-08-01T19:56:08.641 INFO:teuthology.orchestra.run.smithi155.stdout: "events": [ 2023-08-01T19:56:08.641 INFO:teuthology.orchestra.run.smithi155.stdout: { 2023-08-01T19:56:08.641 INFO:teuthology.orchestra.run.smithi155.stdout: "event": "initiated", 2023-08-01T19:56:08.641 INFO:teuthology.orchestra.run.smithi155.stdout: "time": "2023-08-01T19:55:05.147736+0000", 2023-08-01T19:56:08.641 INFO:teuthology.orchestra.run.smithi155.stdout: "duration": 0 2023-08-01T19:56:08.641 INFO:teuthology.orchestra.run.smithi155.stdout: }, 2023-08-01T19:56:08.642 INFO:teuthology.orchestra.run.smithi155.stdout: { 2023-08-01T19:56:08.642 INFO:teuthology.orchestra.run.smithi155.stdout: "event": "throttled", 2023-08-01T19:56:08.642 INFO:teuthology.orchestra.run.smithi155.stdout: "time": "2023-08-01T19:55:05.147736+0000", 2023-08-01T19:56:08.642 INFO:teuthology.orchestra.run.smithi155.stdout: "duration": 0 2023-08-01T19:56:08.642 INFO:teuthology.orchestra.run.smithi155.stdout: }, 2023-08-01T19:56:08.642 INFO:teuthology.orchestra.run.smithi155.stdout: { 2023-08-01T19:56:08.642 INFO:teuthology.orchestra.run.smithi155.stdout: "event": "header_read", 2023-08-01T19:56:08.642 INFO:teuthology.orchestra.run.smithi155.stdout: "time": "2023-08-01T19:55:05.147736+0000", 2023-08-01T19:56:08.643 INFO:teuthology.orchestra.run.smithi155.stdout: "duration": 4294967295.9999995 2023-08-01T19:56:08.643 INFO:teuthology.orchestra.run.smithi155.stdout: }, 2023-08-01T19:56:08.643 INFO:teuthology.orchestra.run.smithi155.stdout: { 2023-08-01T19:56:08.643 INFO:teuthology.orchestra.run.smithi155.stdout: "event": "all_read", 2023-08-01T19:56:08.643 INFO:teuthology.orchestra.run.smithi155.stdout: "time": "2023-08-01T19:55:05.147766+0000", 2023-08-01T19:56:08.643 INFO:teuthology.orchestra.run.smithi155.stdout: "duration": 3.0394000000000001e-05 2023-08-01T19:56:08.643 INFO:teuthology.orchestra.run.smithi155.stdout: }, 2023-08-01T19:56:08.644 INFO:teuthology.orchestra.run.smithi155.stdout: { 2023-08-01T19:56:08.644 INFO:teuthology.orchestra.run.smithi155.stdout: "event": "dispatched", 2023-08-01T19:56:08.644 INFO:teuthology.orchestra.run.smithi155.stdout: "time": "2023-08-01T19:55:05.147771+0000", 2023-08-01T19:56:08.644 INFO:teuthology.orchestra.run.smithi155.stdout: "duration": 4.25e-06 2023-08-01T19:56:08.644 INFO:teuthology.orchestra.run.smithi155.stdout: }, 2023-08-01T19:56:08.644 INFO:teuthology.orchestra.run.smithi155.stdout: { 2023-08-01T19:56:08.644 INFO:teuthology.orchestra.run.smithi155.stdout: "event": "queued_for_pg", 2023-08-01T19:56:08.644 INFO:teuthology.orchestra.run.smithi155.stdout: "time": "2023-08-01T19:55:05.147773+0000", 2023-08-01T19:56:08.645 INFO:teuthology.orchestra.run.smithi155.stdout: "duration": 2.4159999999999998e-06 2023-08-01T19:56:08.645 INFO:teuthology.orchestra.run.smithi155.stdout: }, 2023-08-01T19:56:08.645 INFO:teuthology.orchestra.run.smithi155.stdout: { 2023-08-01T19:56:08.645 INFO:teuthology.orchestra.run.smithi155.stdout: "event": "reached_pg", 2023-08-01T19:56:08.645 INFO:teuthology.orchestra.run.smithi155.stdout: "time": "2023-08-01T19:55:05.149903+0000", 2023-08-01T19:56:08.645 INFO:teuthology.orchestra.run.smithi155.stdout: "duration": 0.002129948 2023-08-01T19:56:08.645 INFO:teuthology.orchestra.run.smithi155.stdout: }, 2023-08-01T19:56:08.646 INFO:teuthology.orchestra.run.smithi155.stdout: { 2023-08-01T19:56:08.646 INFO:teuthology.orchestra.run.smithi155.stdout: "event": "started", 2023-08-01T19:56:08.646 INFO:teuthology.orchestra.run.smithi155.stdout: "time": "2023-08-01T19:55:05.149982+0000", 2023-08-01T19:56:08.646 INFO:teuthology.orchestra.run.smithi155.stdout: "duration": 7.8706000000000002e-05 2023-08-01T19:56:08.646 INFO:teuthology.orchestra.run.smithi155.stdout: }, 2023-08-01T19:56:08.646 INFO:teuthology.orchestra.run.smithi155.stdout: { 2023-08-01T19:56:08.646 INFO:teuthology.orchestra.run.smithi155.stdout: "event": "waiting for subops from 0", 2023-08-01T19:56:08.646 INFO:teuthology.orchestra.run.smithi155.stdout: "time": "2023-08-01T19:55:05.150066+0000", 2023-08-01T19:56:08.647 INFO:teuthology.orchestra.run.smithi155.stdout: "duration": 8.4241999999999997e-05 2023-08-01T19:56:08.647 INFO:teuthology.orchestra.run.smithi155.stdout: }, 2023-08-01T19:56:08.647 INFO:teuthology.orchestra.run.smithi155.stdout: { 2023-08-01T19:56:08.647 INFO:teuthology.orchestra.run.smithi155.stdout: "event": "op_commit", 2023-08-01T19:56:08.647 INFO:teuthology.orchestra.run.smithi155.stdout: "time": "2023-08-01T19:55:05.154994+0000", 2023-08-01T19:56:08.647 INFO:teuthology.orchestra.run.smithi155.stdout: "duration": 0.0049277050000000001 2023-08-01T19:56:08.647 INFO:teuthology.orchestra.run.smithi155.stdout: }, 2023-08-01T19:56:08.647 INFO:teuthology.orchestra.run.smithi155.stdout: { 2023-08-01T19:56:08.648 INFO:teuthology.orchestra.run.smithi155.stdout: "event": "sub_op_commit_rec", 2023-08-01T19:56:08.648 INFO:teuthology.orchestra.run.smithi155.stdout: "time": "2023-08-01T19:55:05.218933+0000", 2023-08-01T19:56:08.648 INFO:teuthology.orchestra.run.smithi155.stdout: "duration": 0.063939916999999999 2023-08-01T19:56:08.648 INFO:teuthology.orchestra.run.smithi155.stdout: }, 2023-08-01T19:56:08.648 INFO:teuthology.orchestra.run.smithi155.stdout: { 2023-08-01T19:56:08.648 INFO:teuthology.orchestra.run.smithi155.stdout: "event": "commit_sent", 2023-08-01T19:56:08.648 INFO:teuthology.orchestra.run.smithi155.stdout: "time": "2023-08-01T19:55:05.218989+0000", 2023-08-01T19:56:08.648 INFO:teuthology.orchestra.run.smithi155.stdout: "duration": 5.5772000000000001e-05 2023-08-01T19:56:08.649 INFO:teuthology.orchestra.run.smithi155.stdout: }, 2023-08-01T19:56:08.649 INFO:teuthology.orchestra.run.smithi155.stdout: { 2023-08-01T19:56:08.649 INFO:teuthology.orchestra.run.smithi155.stdout: "event": "done", 2023-08-01T19:56:08.649 INFO:teuthology.orchestra.run.smithi155.stdout: "time": "2023-08-01T19:55:05.219036+0000", 2023-08-01T19:56:08.649 INFO:teuthology.orchestra.run.smithi155.stdout: "duration": 4.6526000000000001e-05 2023-08-01T19:56:08.649 INFO:teuthology.orchestra.run.smithi155.stdout: } 2023-08-01T19:56:08.649 INFO:teuthology.orchestra.run.smithi155.stdout: ] 2023-08-01T19:56:08.650 INFO:teuthology.orchestra.run.smithi155.stdout: } 2023-08-01T19:56:08.650 INFO:teuthology.orchestra.run.smithi155.stdout: }, 2023-08-01T19:56:08.650 INFO:teuthology.orchestra.run.smithi155.stdout: { 2023-08-01T19:56:08.650 INFO:teuthology.orchestra.run.smithi155.stdout: "description": "osd_op(client.4668.0:100242 5.8 5:16a314b8:::benchmark_data_smithi006_114134_object100241:head [set-alloc-hint object_size 65536 write_size 65536,write 0~65536] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e37)", 2023-08-01T19:56:08.650 INFO:teuthology.orchestra.run.smithi155.stdout: "initiated_at": "2023-08-01T19:55:05.150616+0000", 2023-08-01T19:56:08.650 INFO:teuthology.orchestra.run.smithi155.stdout: "age": 63.485161628, 2023-08-01T19:56:08.650 INFO:teuthology.orchestra.run.smithi155.stdout: "duration": 0.071105065999999995, 2023-08-01T19:56:08.650 INFO:teuthology.orchestra.run.smithi155.stdout: "type_data": { 2023-08-01T19:56:08.651 INFO:teuthology.orchestra.run.smithi155.stdout: "flag_point": "commit sent; apply or cleanup", 2023-08-01T19:56:08.651 INFO:teuthology.orchestra.run.smithi155.stdout: "client_info": { 2023-08-01T19:56:08.651 INFO:teuthology.orchestra.run.smithi155.stdout: "client": "client.4668", 2023-08-01T19:56:08.651 INFO:teuthology.orchestra.run.smithi155.stdout: "client_addr": "172.21.15.6:0/1709472247", 2023-08-01T19:56:08.651 INFO:teuthology.orchestra.run.smithi155.stdout: "tid": 100242 2023-08-01T19:56:08.651 INFO:teuthology.orchestra.run.smithi155.stdout: }, 2023-08-01T19:56:08.651 INFO:teuthology.orchestra.run.smithi155.stdout: "events": [ 2023-08-01T19:56:08.651 INFO:teuthology.orchestra.run.smithi155.stdout: { 2023-08-01T19:56:08.652 INFO:teuthology.orchestra.run.smithi155.stdout: "event": "initiated", 2023-08-01T19:56:08.652 INFO:teuthology.orchestra.run.smithi155.stdout: "time": "2023-08-01T19:55:05.150616+0000", 2023-08-01T19:56:08.652 INFO:teuthology.orchestra.run.smithi155.stdout: "duration": 0 2023-08-01T19:56:08.652 INFO:teuthology.orchestra.run.smithi155.stdout: }, 2023-08-01T19:56:08.652 INFO:teuthology.orchestra.run.smithi155.stdout: { 2023-08-01T19:56:08.652 INFO:teuthology.orchestra.run.smithi155.stdout: "event": "throttled", 2023-08-01T19:56:08.652 INFO:teuthology.orchestra.run.smithi155.stdout: "time": "2023-08-01T19:55:05.150616+0000", 2023-08-01T19:56:08.652 INFO:teuthology.orchestra.run.smithi155.stdout: "duration": 0 2023-08-01T19:56:08.653 INFO:teuthology.orchestra.run.smithi155.stdout: }, 2023-08-01T19:56:08.653 INFO:teuthology.orchestra.run.smithi155.stdout: { 2023-08-01T19:56:08.653 INFO:teuthology.orchestra.run.smithi155.stdout: "event": "header_read", 2023-08-01T19:56:08.653 INFO:teuthology.orchestra.run.smithi155.stdout: "time": "2023-08-01T19:55:05.150615+0000", 2023-08-01T19:56:08.653 INFO:teuthology.orchestra.run.smithi155.stdout: "duration": 4294967295.999999 2023-08-01T19:56:08.653 INFO:teuthology.orchestra.run.smithi155.stdout: }, 2023-08-01T19:56:08.653 INFO:teuthology.orchestra.run.smithi155.stdout: { 2023-08-01T19:56:08.653 INFO:teuthology.orchestra.run.smithi155.stdout: "event": "all_read", 2023-08-01T19:56:08.654 INFO:teuthology.orchestra.run.smithi155.stdout: "time": "2023-08-01T19:55:05.150696+0000", 2023-08-01T19:56:08.654 INFO:teuthology.orchestra.run.smithi155.stdout: "duration": 8.0852000000000004e-05 2023-08-01T19:56:08.654 INFO:teuthology.orchestra.run.smithi155.stdout: }, 2023-08-01T19:56:08.654 INFO:teuthology.orchestra.run.smithi155.stdout: { 2023-08-01T19:56:08.654 INFO:teuthology.orchestra.run.smithi155.stdout: "event": "dispatched", 2023-08-01T19:56:08.654 INFO:teuthology.orchestra.run.smithi155.stdout: "time": "2023-08-01T19:55:05.150708+0000", 2023-08-01T19:56:08.654 INFO:teuthology.orchestra.run.smithi155.stdout: "duration": 1.2116999999999999e-05 2023-08-01T19:56:08.655 INFO:teuthology.orchestra.run.smithi155.stdout: }, 2023-08-01T19:56:08.655 INFO:teuthology.orchestra.run.smithi155.stdout: { 2023-08-01T19:56:08.655 INFO:teuthology.orchestra.run.smithi155.stdout: "event": "queued_for_pg", 2023-08-01T19:56:08.655 INFO:teuthology.orchestra.run.smithi155.stdout: "time": "2023-08-01T19:55:05.150713+0000", 2023-08-01T19:56:08.655 INFO:teuthology.orchestra.run.smithi155.stdout: "duration": 5.4620000000000004e-06 2023-08-01T19:56:08.655 INFO:teuthology.orchestra.run.smithi155.stdout: }, 2023-08-01T19:56:08.655 INFO:teuthology.orchestra.run.smithi155.stdout: { 2023-08-01T19:56:08.655 INFO:teuthology.orchestra.run.smithi155.stdout: "event": "reached_pg", 2023-08-01T19:56:08.656 INFO:teuthology.orchestra.run.smithi155.stdout: "time": "2023-08-01T19:55:05.150761+0000", 2023-08-01T19:56:08.656 INFO:teuthology.orchestra.run.smithi155.stdout: "duration": 4.7429000000000003e-05 2023-08-01T19:56:08.656 INFO:teuthology.orchestra.run.smithi155.stdout: }, 2023-08-01T19:56:08.656 INFO:teuthology.orchestra.run.smithi155.stdout: { 2023-08-01T19:56:08.656 INFO:teuthology.orchestra.run.smithi155.stdout: "event": "started", 2023-08-01T19:56:08.656 INFO:teuthology.orchestra.run.smithi155.stdout: "time": "2023-08-01T19:55:05.150856+0000", 2023-08-01T19:56:08.656 INFO:teuthology.orchestra.run.smithi155.stdout: "duration": 9.5356e-05 2023-08-01T19:56:08.656 INFO:teuthology.orchestra.run.smithi155.stdout: }, 2023-08-01T19:56:08.657 INFO:teuthology.orchestra.run.smithi155.stdout: { 2023-08-01T19:56:08.657 INFO:teuthology.orchestra.run.smithi155.stdout: "event": "waiting for subops from 0", 2023-08-01T19:56:08.657 INFO:teuthology.orchestra.run.smithi155.stdout: "time": "2023-08-01T19:55:05.150999+0000", 2023-08-01T19:56:08.657 INFO:teuthology.orchestra.run.smithi155.stdout: "duration": 0.00014234499999999999 2023-08-01T19:56:08.657 INFO:teuthology.orchestra.run.smithi155.stdout: }, 2023-08-01T19:56:08.657 INFO:teuthology.orchestra.run.smithi155.stdout: { 2023-08-01T19:56:08.657 INFO:teuthology.orchestra.run.smithi155.stdout: "event": "sub_op_commit_rec", 2023-08-01T19:56:08.657 INFO:teuthology.orchestra.run.smithi155.stdout: "time": "2023-08-01T19:55:05.219001+0000", 2023-08-01T19:56:08.658 INFO:teuthology.orchestra.run.smithi155.stdout: "duration": 0.068002776000000001 2023-08-01T19:56:08.658 INFO:teuthology.orchestra.run.smithi155.stdout: }, 2023-08-01T19:56:08.658 INFO:teuthology.orchestra.run.smithi155.stdout: { 2023-08-01T19:56:08.658 INFO:teuthology.orchestra.run.smithi155.stdout: "event": "op_commit", 2023-08-01T19:56:08.658 INFO:teuthology.orchestra.run.smithi155.stdout: "time": "2023-08-01T19:55:05.221635+0000", 2023-08-01T19:56:08.658 INFO:teuthology.orchestra.run.smithi155.stdout: "duration": 0.0026340579999999999 2023-08-01T19:56:08.658 INFO:teuthology.orchestra.run.smithi155.stdout: }, 2023-08-01T19:56:08.658 INFO:teuthology.orchestra.run.smithi155.stdout: { 2023-08-01T19:56:08.659 INFO:teuthology.orchestra.run.smithi155.stdout: "event": "commit_sent", 2023-08-01T19:56:08.659 INFO:teuthology.orchestra.run.smithi155.stdout: "time": "2023-08-01T19:55:05.221682+0000", 2023-08-01T19:56:08.659 INFO:teuthology.orchestra.run.smithi155.stdout: "duration": 4.7123999999999998e-05 2023-08-01T19:56:08.659 INFO:teuthology.orchestra.run.smithi155.stdout: }, 2023-08-01T19:56:08.659 INFO:teuthology.orchestra.run.smithi155.stdout: { 2023-08-01T19:56:08.659 INFO:teuthology.orchestra.run.smithi155.stdout: "event": "done", 2023-08-01T19:56:08.659 INFO:teuthology.orchestra.run.smithi155.stdout: "time": "2023-08-01T19:55:05.221721+0000", 2023-08-01T19:56:08.660 INFO:teuthology.orchestra.run.smithi155.stdout: "duration": 3.8529999999999999e-05 2023-08-01T19:56:08.660 INFO:teuthology.orchestra.run.smithi155.stdout: } 2023-08-01T19:56:08.660 INFO:teuthology.orchestra.run.smithi155.stdout: ] 2023-08-01T19:56:08.660 INFO:teuthology.orchestra.run.smithi155.stdout: } 2023-08-01T19:56:08.660 INFO:teuthology.orchestra.run.smithi155.stdout: }, 2023-08-01T19:56:08.660 INFO:teuthology.orchestra.run.smithi155.stdout: { 2023-08-01T19:56:08.660 INFO:teuthology.orchestra.run.smithi155.stdout: "description": "osd_repop(client.4668.0:100240 5.a e37/19 5:5313c5b9:::benchmark_data_smithi006_114134_object100239:head v 37'6227, mlcod=37'6225)", 2023-08-01T19:56:08.660 INFO:teuthology.orchestra.run.smithi155.stdout: "initiated_at": "2023-08-01T19:55:05.150778+0000", 2023-08-01T19:56:08.661 INFO:teuthology.orchestra.run.smithi155.stdout: "age": 63.484999426999998, 2023-08-01T19:56:08.661 INFO:teuthology.orchestra.run.smithi155.stdout: "duration": 0.073362533999999993, 2023-08-01T19:56:08.661 INFO:teuthology.orchestra.run.smithi155.stdout: "type_data": { 2023-08-01T19:56:08.661 INFO:teuthology.orchestra.run.smithi155.stdout: "flag_point": "commit sent; apply or cleanup", 2023-08-01T19:56:08.661 INFO:teuthology.orchestra.run.smithi155.stdout: "events": [ 2023-08-01T19:56:08.661 INFO:teuthology.orchestra.run.smithi155.stdout: { 2023-08-01T19:56:08.661 INFO:teuthology.orchestra.run.smithi155.stdout: "event": "initiated", 2023-08-01T19:56:08.661 INFO:teuthology.orchestra.run.smithi155.stdout: "time": "2023-08-01T19:55:05.150778+0000", 2023-08-01T19:56:08.662 INFO:teuthology.orchestra.run.smithi155.stdout: "duration": 0 2023-08-01T19:56:08.662 INFO:teuthology.orchestra.run.smithi155.stdout: }, 2023-08-01T19:56:08.662 INFO:teuthology.orchestra.run.smithi155.stdout: { 2023-08-01T19:56:08.662 INFO:teuthology.orchestra.run.smithi155.stdout: "event": "throttled", 2023-08-01T19:56:08.662 INFO:teuthology.orchestra.run.smithi155.stdout: "time": "2023-08-01T19:55:05.150778+0000", 2023-08-01T19:56:08.662 INFO:teuthology.orchestra.run.smithi155.stdout: "duration": 0 2023-08-01T19:56:08.662 INFO:teuthology.orchestra.run.smithi155.stdout: }, 2023-08-01T19:56:08.662 INFO:teuthology.orchestra.run.smithi155.stdout: { 2023-08-01T19:56:08.663 INFO:teuthology.orchestra.run.smithi155.stdout: "event": "header_read", 2023-08-01T19:56:08.663 INFO:teuthology.orchestra.run.smithi155.stdout: "time": "2023-08-01T19:55:05.150778+0000", 2023-08-01T19:56:08.663 INFO:teuthology.orchestra.run.smithi155.stdout: "duration": 4294967295.9999995 2023-08-01T19:56:08.663 INFO:teuthology.orchestra.run.smithi155.stdout: }, 2023-08-01T19:56:08.663 INFO:teuthology.orchestra.run.smithi155.stdout: { 2023-08-01T19:56:08.663 INFO:teuthology.orchestra.run.smithi155.stdout: "event": "all_read", 2023-08-01T19:56:08.663 INFO:teuthology.orchestra.run.smithi155.stdout: "time": "2023-08-01T19:55:05.150811+0000", 2023-08-01T19:56:08.664 INFO:teuthology.orchestra.run.smithi155.stdout: "duration": 3.3664000000000002e-05 2023-08-01T19:56:08.664 INFO:teuthology.orchestra.run.smithi155.stdout: }, 2023-08-01T19:56:08.664 INFO:teuthology.orchestra.run.smithi155.stdout: { 2023-08-01T19:56:08.664 INFO:teuthology.orchestra.run.smithi155.stdout: "event": "dispatched", 2023-08-01T19:56:08.664 INFO:teuthology.orchestra.run.smithi155.stdout: "time": "2023-08-01T19:55:05.150818+0000", 2023-08-01T19:56:08.664 INFO:teuthology.orchestra.run.smithi155.stdout: "duration": 6.5769999999999999e-06 2023-08-01T19:56:08.664 INFO:teuthology.orchestra.run.smithi155.stdout: }, 2023-08-01T19:56:08.664 INFO:teuthology.orchestra.run.smithi155.stdout: { 2023-08-01T19:56:08.665 INFO:teuthology.orchestra.run.smithi155.stdout: "event": "queued_for_pg", 2023-08-01T19:56:08.665 INFO:teuthology.orchestra.run.smithi155.stdout: "time": "2023-08-01T19:55:05.150822+0000", 2023-08-01T19:56:08.665 INFO:teuthology.orchestra.run.smithi155.stdout: "duration": 4.0060000000000003e-06 2023-08-01T19:56:08.665 INFO:teuthology.orchestra.run.smithi155.stdout: }, 2023-08-01T19:56:08.665 INFO:teuthology.orchestra.run.smithi155.stdout: { 2023-08-01T19:56:08.665 INFO:teuthology.orchestra.run.smithi155.stdout: "event": "reached_pg", 2023-08-01T19:56:08.665 INFO:teuthology.orchestra.run.smithi155.stdout: "time": "2023-08-01T19:55:05.150855+0000", 2023-08-01T19:56:08.665 INFO:teuthology.orchestra.run.smithi155.stdout: "duration": 3.3204999999999998e-05 2023-08-01T19:56:08.666 INFO:teuthology.orchestra.run.smithi155.stdout: }, 2023-08-01T19:56:08.666 INFO:teuthology.orchestra.run.smithi155.stdout: { 2023-08-01T19:56:08.666 INFO:teuthology.orchestra.run.smithi155.stdout: "event": "started", 2023-08-01T19:56:08.666 INFO:teuthology.orchestra.run.smithi155.stdout: "time": "2023-08-01T19:55:05.150873+0000", 2023-08-01T19:56:08.666 INFO:teuthology.orchestra.run.smithi155.stdout: "duration": 1.8139999999999999e-05 2023-08-01T19:56:08.666 INFO:teuthology.orchestra.run.smithi155.stdout: }, 2023-08-01T19:56:08.666 INFO:teuthology.orchestra.run.smithi155.stdout: { 2023-08-01T19:56:08.666 INFO:teuthology.orchestra.run.smithi155.stdout: "event": "commit_sent", 2023-08-01T19:56:08.667 INFO:teuthology.orchestra.run.smithi155.stdout: "time": "2023-08-01T19:55:05.224095+0000", 2023-08-01T19:56:08.667 INFO:teuthology.orchestra.run.smithi155.stdout: "duration": 0.073221895999999995 2023-08-01T19:56:08.667 INFO:teuthology.orchestra.run.smithi155.stdout: }, 2023-08-01T19:56:08.667 INFO:teuthology.orchestra.run.smithi155.stdout: { 2023-08-01T19:56:08.667 INFO:teuthology.orchestra.run.smithi155.stdout: "event": "done", 2023-08-01T19:56:08.667 INFO:teuthology.orchestra.run.smithi155.stdout: "time": "2023-08-01T19:55:05.224141+0000", 2023-08-01T19:56:08.667 INFO:teuthology.orchestra.run.smithi155.stdout: "duration": 4.5385e-05 2023-08-01T19:56:08.668 INFO:teuthology.orchestra.run.smithi155.stdout: } 2023-08-01T19:56:08.668 INFO:teuthology.orchestra.run.smithi155.stdout: ] 2023-08-01T19:56:08.668 INFO:teuthology.orchestra.run.smithi155.stdout: } 2023-08-01T19:56:08.668 INFO:teuthology.orchestra.run.smithi155.stdout: }, 2023-08-01T19:56:08.668 INFO:teuthology.orchestra.run.smithi155.stdout: { 2023-08-01T19:56:08.668 INFO:teuthology.orchestra.run.smithi155.stdout: "description": "osd_op(client.4668.0:100245 5.e 5:71869c66:::benchmark_data_smithi006_114134_object100244:head [set-alloc-hint object_size 65536 write_size 65536,write 0~65536] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e37)", 2023-08-01T19:56:08.668 INFO:teuthology.orchestra.run.smithi155.stdout: "initiated_at": "2023-08-01T19:55:05.150991+0000", 2023-08-01T19:56:08.668 INFO:teuthology.orchestra.run.smithi155.stdout: "age": 63.484786640000003, 2023-08-01T19:56:08.669 INFO:teuthology.orchestra.run.smithi155.stdout: "duration": 0.070734490999999997, 2023-08-01T19:56:08.669 INFO:teuthology.orchestra.run.smithi155.stdout: "type_data": { 2023-08-01T19:56:08.669 INFO:teuthology.orchestra.run.smithi155.stdout: "flag_point": "commit sent; apply or cleanup", 2023-08-01T19:56:08.669 INFO:teuthology.orchestra.run.smithi155.stdout: "client_info": { 2023-08-01T19:56:08.669 INFO:teuthology.orchestra.run.smithi155.stdout: "client": "client.4668", 2023-08-01T19:56:08.669 INFO:teuthology.orchestra.run.smithi155.stdout: "client_addr": "172.21.15.6:0/1709472247", 2023-08-01T19:56:08.669 INFO:teuthology.orchestra.run.smithi155.stdout: "tid": 100245 2023-08-01T19:56:08.669 INFO:teuthology.orchestra.run.smithi155.stdout: }, 2023-08-01T19:56:08.670 INFO:teuthology.orchestra.run.smithi155.stdout: "events": [ 2023-08-01T19:56:08.670 INFO:teuthology.orchestra.run.smithi155.stdout: { 2023-08-01T19:56:08.670 INFO:teuthology.orchestra.run.smithi155.stdout: "event": "initiated", 2023-08-01T19:56:08.670 INFO:teuthology.orchestra.run.smithi155.stdout: "time": "2023-08-01T19:55:05.150991+0000", 2023-08-01T19:56:08.670 INFO:teuthology.orchestra.run.smithi155.stdout: "duration": 0 2023-08-01T19:56:08.670 INFO:teuthology.orchestra.run.smithi155.stdout: }, 2023-08-01T19:56:08.670 INFO:teuthology.orchestra.run.smithi155.stdout: { 2023-08-01T19:56:08.670 INFO:teuthology.orchestra.run.smithi155.stdout: "event": "throttled", 2023-08-01T19:56:08.671 INFO:teuthology.orchestra.run.smithi155.stdout: "time": "2023-08-01T19:55:05.150991+0000", 2023-08-01T19:56:08.671 INFO:teuthology.orchestra.run.smithi155.stdout: "duration": 0 2023-08-01T19:56:08.671 INFO:teuthology.orchestra.run.smithi155.stdout: }, 2023-08-01T19:56:08.671 INFO:teuthology.orchestra.run.smithi155.stdout: { 2023-08-01T19:56:08.671 INFO:teuthology.orchestra.run.smithi155.stdout: "event": "header_read", 2023-08-01T19:56:08.671 INFO:teuthology.orchestra.run.smithi155.stdout: "time": "2023-08-01T19:55:05.150990+0000", 2023-08-01T19:56:08.671 INFO:teuthology.orchestra.run.smithi155.stdout: "duration": 4294967295.999999 2023-08-01T19:56:08.672 INFO:teuthology.orchestra.run.smithi155.stdout: }, 2023-08-01T19:56:08.672 INFO:teuthology.orchestra.run.smithi155.stdout: { 2023-08-01T19:56:08.672 INFO:teuthology.orchestra.run.smithi155.stdout: "event": "all_read", 2023-08-01T19:56:08.672 INFO:teuthology.orchestra.run.smithi155.stdout: "time": "2023-08-01T19:55:05.151108+0000", 2023-08-01T19:56:08.672 INFO:teuthology.orchestra.run.smithi155.stdout: "duration": 0.00011849300000000001 2023-08-01T19:56:08.672 INFO:teuthology.orchestra.run.smithi155.stdout: }, 2023-08-01T19:56:08.672 INFO:teuthology.orchestra.run.smithi155.stdout: { 2023-08-01T19:56:08.672 INFO:teuthology.orchestra.run.smithi155.stdout: "event": "dispatched", 2023-08-01T19:56:08.673 INFO:teuthology.orchestra.run.smithi155.stdout: "time": "2023-08-01T19:55:05.151117+0000", 2023-08-01T19:56:08.673 INFO:teuthology.orchestra.run.smithi155.stdout: "duration": 8.1040000000000007e-06 2023-08-01T19:56:08.673 INFO:teuthology.orchestra.run.smithi155.stdout: }, 2023-08-01T19:56:08.673 INFO:teuthology.orchestra.run.smithi155.stdout: { 2023-08-01T19:56:08.673 INFO:teuthology.orchestra.run.smithi155.stdout: "event": "queued_for_pg", 2023-08-01T19:56:08.673 INFO:teuthology.orchestra.run.smithi155.stdout: "time": "2023-08-01T19:55:05.151121+0000", 2023-08-01T19:56:08.673 INFO:teuthology.orchestra.run.smithi155.stdout: "duration": 4.2019999999999997e-06 2023-08-01T19:56:08.673 INFO:teuthology.orchestra.run.smithi155.stdout: }, 2023-08-01T19:56:08.674 INFO:teuthology.orchestra.run.smithi155.stdout: { 2023-08-01T19:56:08.674 INFO:teuthology.orchestra.run.smithi155.stdout: "event": "reached_pg", 2023-08-01T19:56:08.674 INFO:teuthology.orchestra.run.smithi155.stdout: "time": "2023-08-01T19:55:05.151162+0000", 2023-08-01T19:56:08.674 INFO:teuthology.orchestra.run.smithi155.stdout: "duration": 4.1448e-05 2023-08-01T19:56:08.674 INFO:teuthology.orchestra.run.smithi155.stdout: }, 2023-08-01T19:56:08.674 INFO:teuthology.orchestra.run.smithi155.stdout: { 2023-08-01T19:56:08.674 INFO:teuthology.orchestra.run.smithi155.stdout: "event": "started", 2023-08-01T19:56:08.674 INFO:teuthology.orchestra.run.smithi155.stdout: "time": "2023-08-01T19:55:05.151281+0000", 2023-08-01T19:56:08.675 INFO:teuthology.orchestra.run.smithi155.stdout: "duration": 0.000119141 2023-08-01T19:56:08.675 INFO:teuthology.orchestra.run.smithi155.stdout: }, 2023-08-01T19:56:08.675 INFO:teuthology.orchestra.run.smithi155.stdout: { 2023-08-01T19:56:08.675 INFO:teuthology.orchestra.run.smithi155.stdout: "event": "waiting for subops from 0", 2023-08-01T19:56:08.675 INFO:teuthology.orchestra.run.smithi155.stdout: "time": "2023-08-01T19:55:05.151443+0000", 2023-08-01T19:56:08.675 INFO:teuthology.orchestra.run.smithi155.stdout: "duration": 0.00016181600000000001 2023-08-01T19:56:08.675 INFO:teuthology.orchestra.run.smithi155.stdout: }, 2023-08-01T19:56:08.675 INFO:teuthology.orchestra.run.smithi155.stdout: { 2023-08-01T19:56:08.676 INFO:teuthology.orchestra.run.smithi155.stdout: "event": "sub_op_commit_rec", 2023-08-01T19:56:08.676 INFO:teuthology.orchestra.run.smithi155.stdout: "time": "2023-08-01T19:55:05.219101+0000", 2023-08-01T19:56:08.676 INFO:teuthology.orchestra.run.smithi155.stdout: "duration": 0.067658037000000004 2023-08-01T19:56:08.676 INFO:teuthology.orchestra.run.smithi155.stdout: }, 2023-08-01T19:56:08.676 INFO:teuthology.orchestra.run.smithi155.stdout: { 2023-08-01T19:56:08.676 INFO:teuthology.orchestra.run.smithi155.stdout: "event": "op_commit", 2023-08-01T19:56:08.676 INFO:teuthology.orchestra.run.smithi155.stdout: "time": "2023-08-01T19:55:05.221646+0000", 2023-08-01T19:56:08.677 INFO:teuthology.orchestra.run.smithi155.stdout: "duration": 0.0025450540000000002 2023-08-01T19:56:08.677 INFO:teuthology.orchestra.run.smithi155.stdout: }, 2023-08-01T19:56:08.677 INFO:teuthology.orchestra.run.smithi155.stdout: { 2023-08-01T19:56:08.677 INFO:teuthology.orchestra.run.smithi155.stdout: "event": "commit_sent", 2023-08-01T19:56:08.677 INFO:teuthology.orchestra.run.smithi155.stdout: "time": "2023-08-01T19:55:05.221689+0000", 2023-08-01T19:56:08.677 INFO:teuthology.orchestra.run.smithi155.stdout: "duration": 4.3078999999999999e-05 2023-08-01T19:56:08.677 INFO:teuthology.orchestra.run.smithi155.stdout: }, 2023-08-01T19:56:08.677 INFO:teuthology.orchestra.run.smithi155.stdout: { 2023-08-01T19:56:08.678 INFO:teuthology.orchestra.run.smithi155.stdout: "event": "done", 2023-08-01T19:56:08.678 INFO:teuthology.orchestra.run.smithi155.stdout: "time": "2023-08-01T19:55:05.221725+0000", 2023-08-01T19:56:08.678 INFO:teuthology.orchestra.run.smithi155.stdout: "duration": 3.6137999999999999e-05 2023-08-01T19:56:08.678 INFO:teuthology.orchestra.run.smithi155.stdout: } 2023-08-01T19:56:08.678 INFO:teuthology.orchestra.run.smithi155.stdout: ] 2023-08-01T19:56:08.678 INFO:teuthology.orchestra.run.smithi155.stdout: } 2023-08-01T19:56:08.678 INFO:teuthology.orchestra.run.smithi155.stdout: }, 2023-08-01T19:56:08.678 INFO:teuthology.orchestra.run.smithi155.stdout: { 2023-08-01T19:56:08.679 INFO:teuthology.orchestra.run.smithi155.stdout: "description": "osd_repop(client.4668.0:100243 5.a e37/19 5:5e8193b6:::benchmark_data_smithi006_114134_object100242:head v 37'6228, mlcod=37'6225)", 2023-08-01T19:56:08.679 INFO:teuthology.orchestra.run.smithi155.stdout: "initiated_at": "2023-08-01T19:55:05.151148+0000", 2023-08-01T19:56:08.679 INFO:teuthology.orchestra.run.smithi155.stdout: "age": 63.484629628999997, 2023-08-01T19:56:08.679 INFO:teuthology.orchestra.run.smithi155.stdout: "duration": 0.073020370000000001, 2023-08-01T19:56:08.679 INFO:teuthology.orchestra.run.smithi155.stdout: "type_data": { 2023-08-01T19:56:08.679 INFO:teuthology.orchestra.run.smithi155.stdout: "flag_point": "commit sent; apply or cleanup", 2023-08-01T19:56:08.679 INFO:teuthology.orchestra.run.smithi155.stdout: "events": [ 2023-08-01T19:56:08.679 INFO:teuthology.orchestra.run.smithi155.stdout: { 2023-08-01T19:56:08.680 INFO:teuthology.orchestra.run.smithi155.stdout: "event": "initiated", 2023-08-01T19:56:08.680 INFO:teuthology.orchestra.run.smithi155.stdout: "time": "2023-08-01T19:55:05.151148+0000", 2023-08-01T19:56:08.680 INFO:teuthology.orchestra.run.smithi155.stdout: "duration": 0 2023-08-01T19:56:08.680 INFO:teuthology.orchestra.run.smithi155.stdout: }, 2023-08-01T19:56:08.680 INFO:teuthology.orchestra.run.smithi155.stdout: { 2023-08-01T19:56:08.680 INFO:teuthology.orchestra.run.smithi155.stdout: "event": "throttled", 2023-08-01T19:56:08.680 INFO:teuthology.orchestra.run.smithi155.stdout: "time": "2023-08-01T19:55:05.151148+0000", 2023-08-01T19:56:08.680 INFO:teuthology.orchestra.run.smithi155.stdout: "duration": 0 2023-08-01T19:56:08.681 INFO:teuthology.orchestra.run.smithi155.stdout: }, 2023-08-01T19:56:08.681 INFO:teuthology.orchestra.run.smithi155.stdout: { 2023-08-01T19:56:08.681 INFO:teuthology.orchestra.run.smithi155.stdout: "event": "header_read", 2023-08-01T19:56:08.681 INFO:teuthology.orchestra.run.smithi155.stdout: "time": "2023-08-01T19:55:05.151147+0000", 2023-08-01T19:56:08.681 INFO:teuthology.orchestra.run.smithi155.stdout: "duration": 4294967295.9999995 2023-08-01T19:56:08.681 INFO:teuthology.orchestra.run.smithi155.stdout: }, 2023-08-01T19:56:08.681 INFO:teuthology.orchestra.run.smithi155.stdout: { 2023-08-01T19:56:08.681 INFO:teuthology.orchestra.run.smithi155.stdout: "event": "all_read", 2023-08-01T19:56:08.682 INFO:teuthology.orchestra.run.smithi155.stdout: "time": "2023-08-01T19:55:05.151231+0000", 2023-08-01T19:56:08.682 INFO:teuthology.orchestra.run.smithi155.stdout: "duration": 8.3135999999999998e-05 2023-08-01T19:56:08.682 INFO:teuthology.orchestra.run.smithi155.stdout: }, 2023-08-01T19:56:08.682 INFO:teuthology.orchestra.run.smithi155.stdout: { 2023-08-01T19:56:08.682 INFO:teuthology.orchestra.run.smithi155.stdout: "event": "dispatched", 2023-08-01T19:56:08.682 INFO:teuthology.orchestra.run.smithi155.stdout: "time": "2023-08-01T19:55:05.151239+0000", 2023-08-01T19:56:08.682 INFO:teuthology.orchestra.run.smithi155.stdout: "duration": 8.7469999999999994e-06 2023-08-01T19:56:08.682 INFO:teuthology.orchestra.run.smithi155.stdout: }, 2023-08-01T19:56:08.683 INFO:teuthology.orchestra.run.smithi155.stdout: { 2023-08-01T19:56:08.683 INFO:teuthology.orchestra.run.smithi155.stdout: "event": "queued_for_pg", 2023-08-01T19:56:08.683 INFO:teuthology.orchestra.run.smithi155.stdout: "time": "2023-08-01T19:55:05.151244+0000", 2023-08-01T19:56:08.683 INFO:teuthology.orchestra.run.smithi155.stdout: "duration": 4.4800000000000003e-06 2023-08-01T19:56:08.683 INFO:teuthology.orchestra.run.smithi155.stdout: }, 2023-08-01T19:56:08.683 INFO:teuthology.orchestra.run.smithi155.stdout: { 2023-08-01T19:56:08.683 INFO:teuthology.orchestra.run.smithi155.stdout: "event": "reached_pg", 2023-08-01T19:56:08.684 INFO:teuthology.orchestra.run.smithi155.stdout: "time": "2023-08-01T19:55:05.152938+0000", 2023-08-01T19:56:08.684 INFO:teuthology.orchestra.run.smithi155.stdout: "duration": 0.001693824 2023-08-01T19:56:08.684 INFO:teuthology.orchestra.run.smithi155.stdout: }, 2023-08-01T19:56:08.684 INFO:teuthology.orchestra.run.smithi155.stdout: { 2023-08-01T19:56:08.684 INFO:teuthology.orchestra.run.smithi155.stdout: "event": "started", 2023-08-01T19:56:08.684 INFO:teuthology.orchestra.run.smithi155.stdout: "time": "2023-08-01T19:55:05.152956+0000", 2023-08-01T19:56:08.684 INFO:teuthology.orchestra.run.smithi155.stdout: "duration": 1.8287e-05 2023-08-01T19:56:08.684 INFO:teuthology.orchestra.run.smithi155.stdout: }, 2023-08-01T19:56:08.685 INFO:teuthology.orchestra.run.smithi155.stdout: { 2023-08-01T19:56:08.685 INFO:teuthology.orchestra.run.smithi155.stdout: "event": "commit_sent", 2023-08-01T19:56:08.685 INFO:teuthology.orchestra.run.smithi155.stdout: "time": "2023-08-01T19:55:05.224145+0000", 2023-08-01T19:56:08.685 INFO:teuthology.orchestra.run.smithi155.stdout: "duration": 0.071189447000000003 2023-08-01T19:56:08.685 INFO:teuthology.orchestra.run.smithi155.stdout: }, 2023-08-01T19:56:08.685 INFO:teuthology.orchestra.run.smithi155.stdout: { 2023-08-01T19:56:08.685 INFO:teuthology.orchestra.run.smithi155.stdout: "event": "done", 2023-08-01T19:56:08.685 INFO:teuthology.orchestra.run.smithi155.stdout: "time": "2023-08-01T19:55:05.224168+0000", 2023-08-01T19:56:08.686 INFO:teuthology.orchestra.run.smithi155.stdout: "duration": 2.3008999999999999e-05 2023-08-01T19:56:08.686 INFO:teuthology.orchestra.run.smithi155.stdout: } 2023-08-01T19:56:08.686 INFO:teuthology.orchestra.run.smithi155.stdout: ] 2023-08-01T19:56:08.686 INFO:teuthology.orchestra.run.smithi155.stdout: } 2023-08-01T19:56:08.686 INFO:teuthology.orchestra.run.smithi155.stdout: }, 2023-08-01T19:56:08.686 INFO:teuthology.orchestra.run.smithi155.stdout: { 2023-08-01T19:56:08.686 INFO:teuthology.orchestra.run.smithi155.stdout: "description": "osd_repop(client.4668.0:100244 5.9 e37/19 5:92f56a12:::benchmark_data_smithi006_114134_object100243:head v 37'6294, mlcod=37'6292)", 2023-08-01T19:56:08.686 INFO:teuthology.orchestra.run.smithi155.stdout: "initiated_at": "2023-08-01T19:55:05.151325+0000", 2023-08-01T19:56:08.687 INFO:teuthology.orchestra.run.smithi155.stdout: "age": 63.484452284, 2023-08-01T19:56:08.687 INFO:teuthology.orchestra.run.smithi155.stdout: "duration": 0.071883673999999995, 2023-08-01T19:56:08.687 INFO:teuthology.orchestra.run.smithi155.stdout: "type_data": { 2023-08-01T19:56:08.687 INFO:teuthology.orchestra.run.smithi155.stdout: "flag_point": "commit sent; apply or cleanup", 2023-08-01T19:56:08.687 INFO:teuthology.orchestra.run.smithi155.stdout: "events": [ 2023-08-01T19:56:08.687 INFO:teuthology.orchestra.run.smithi155.stdout: { 2023-08-01T19:56:08.687 INFO:teuthology.orchestra.run.smithi155.stdout: "event": "initiated", 2023-08-01T19:56:08.688 INFO:teuthology.orchestra.run.smithi155.stdout: "time": "2023-08-01T19:55:05.151325+0000", 2023-08-01T19:56:08.688 INFO:teuthology.orchestra.run.smithi155.stdout: "duration": 0 2023-08-01T19:56:08.688 INFO:teuthology.orchestra.run.smithi155.stdout: }, 2023-08-01T19:56:08.688 INFO:teuthology.orchestra.run.smithi155.stdout: { 2023-08-01T19:56:08.688 INFO:teuthology.orchestra.run.smithi155.stdout: "event": "throttled", 2023-08-01T19:56:08.688 INFO:teuthology.orchestra.run.smithi155.stdout: "time": "2023-08-01T19:55:05.151325+0000", 2023-08-01T19:56:08.688 INFO:teuthology.orchestra.run.smithi155.stdout: "duration": 0 2023-08-01T19:56:08.688 INFO:teuthology.orchestra.run.smithi155.stdout: }, 2023-08-01T19:56:08.689 INFO:teuthology.orchestra.run.smithi155.stdout: { 2023-08-01T19:56:08.689 INFO:teuthology.orchestra.run.smithi155.stdout: "event": "header_read", 2023-08-01T19:56:08.689 INFO:teuthology.orchestra.run.smithi155.stdout: "time": "2023-08-01T19:55:05.151325+0000", 2023-08-01T19:56:08.689 INFO:teuthology.orchestra.run.smithi155.stdout: "duration": 4294967295.9999995 2023-08-01T19:56:08.689 INFO:teuthology.orchestra.run.smithi155.stdout: }, 2023-08-01T19:56:08.689 INFO:teuthology.orchestra.run.smithi155.stdout: { 2023-08-01T19:56:08.689 INFO:teuthology.orchestra.run.smithi155.stdout: "event": "all_read", 2023-08-01T19:56:08.689 INFO:teuthology.orchestra.run.smithi155.stdout: "time": "2023-08-01T19:55:05.151390+0000", 2023-08-01T19:56:08.690 INFO:teuthology.orchestra.run.smithi155.stdout: "duration": 6.5456999999999993e-05 2023-08-01T19:56:08.690 INFO:teuthology.orchestra.run.smithi155.stdout: }, 2023-08-01T19:56:08.690 INFO:teuthology.orchestra.run.smithi155.stdout: { 2023-08-01T19:56:08.690 INFO:teuthology.orchestra.run.smithi155.stdout: "event": "dispatched", 2023-08-01T19:56:08.690 INFO:teuthology.orchestra.run.smithi155.stdout: "time": "2023-08-01T19:55:05.151396+0000", 2023-08-01T19:56:08.690 INFO:teuthology.orchestra.run.smithi155.stdout: "duration": 5.9190000000000004e-06 2023-08-01T19:56:08.690 INFO:teuthology.orchestra.run.smithi155.stdout: }, 2023-08-01T19:56:08.691 INFO:teuthology.orchestra.run.smithi155.stdout: { 2023-08-01T19:56:08.691 INFO:teuthology.orchestra.run.smithi155.stdout: "event": "queued_for_pg", 2023-08-01T19:56:08.691 INFO:teuthology.orchestra.run.smithi155.stdout: "time": "2023-08-01T19:55:05.151400+0000", 2023-08-01T19:56:08.691 INFO:teuthology.orchestra.run.smithi155.stdout: "duration": 4.1030000000000004e-06 2023-08-01T19:56:08.691 INFO:teuthology.orchestra.run.smithi155.stdout: }, 2023-08-01T19:56:08.691 INFO:teuthology.orchestra.run.smithi155.stdout: { 2023-08-01T19:56:08.691 INFO:teuthology.orchestra.run.smithi155.stdout: "event": "reached_pg", 2023-08-01T19:56:08.691 INFO:teuthology.orchestra.run.smithi155.stdout: "time": "2023-08-01T19:55:05.151452+0000", 2023-08-01T19:56:08.692 INFO:teuthology.orchestra.run.smithi155.stdout: "duration": 5.2136999999999999e-05 2023-08-01T19:56:08.692 INFO:teuthology.orchestra.run.smithi155.stdout: }, 2023-08-01T19:56:08.692 INFO:teuthology.orchestra.run.smithi155.stdout: { 2023-08-01T19:56:08.692 INFO:teuthology.orchestra.run.smithi155.stdout: "event": "started", 2023-08-01T19:56:08.692 INFO:teuthology.orchestra.run.smithi155.stdout: "time": "2023-08-01T19:55:05.151470+0000", 2023-08-01T19:56:08.692 INFO:teuthology.orchestra.run.smithi155.stdout: "duration": 1.8e-05 2023-08-01T19:56:08.692 INFO:teuthology.orchestra.run.smithi155.stdout: }, 2023-08-01T19:56:08.692 INFO:teuthology.orchestra.run.smithi155.stdout: { 2023-08-01T19:56:08.693 INFO:teuthology.orchestra.run.smithi155.stdout: "event": "commit_sent", 2023-08-01T19:56:08.693 INFO:teuthology.orchestra.run.smithi155.stdout: "time": "2023-08-01T19:55:05.223183+0000", 2023-08-01T19:56:08.693 INFO:teuthology.orchestra.run.smithi155.stdout: "duration": 0.071712622000000004 2023-08-01T19:56:08.693 INFO:teuthology.orchestra.run.smithi155.stdout: }, 2023-08-01T19:56:08.693 INFO:teuthology.orchestra.run.smithi155.stdout: { 2023-08-01T19:56:08.693 INFO:teuthology.orchestra.run.smithi155.stdout: "event": "done", 2023-08-01T19:56:08.693 INFO:teuthology.orchestra.run.smithi155.stdout: "time": "2023-08-01T19:55:05.223209+0000", 2023-08-01T19:56:08.693 INFO:teuthology.orchestra.run.smithi155.stdout: "duration": 2.5956e-05 2023-08-01T19:56:08.694 INFO:teuthology.orchestra.run.smithi155.stdout: } 2023-08-01T19:56:08.694 INFO:teuthology.orchestra.run.smithi155.stdout: ] 2023-08-01T19:56:08.694 INFO:teuthology.orchestra.run.smithi155.stdout: } 2023-08-01T19:56:08.694 INFO:teuthology.orchestra.run.smithi155.stdout: }, 2023-08-01T19:56:08.694 INFO:teuthology.orchestra.run.smithi155.stdout: { 2023-08-01T19:56:08.694 INFO:teuthology.orchestra.run.smithi155.stdout: "description": "osd_op(client.4668.0:100249 5.b 5:d0666827:::benchmark_data_smithi006_114134_object100248:head [set-alloc-hint object_size 65536 write_size 65536,write 0~65536] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e37)", 2023-08-01T19:56:08.694 INFO:teuthology.orchestra.run.smithi155.stdout: "initiated_at": "2023-08-01T19:55:05.153614+0000", 2023-08-01T19:56:08.695 INFO:teuthology.orchestra.run.smithi155.stdout: "age": 63.482163859000003, 2023-08-01T19:56:08.695 INFO:teuthology.orchestra.run.smithi155.stdout: "duration": 0.069286118999999993, 2023-08-01T19:56:08.695 INFO:teuthology.orchestra.run.smithi155.stdout: "type_data": { 2023-08-01T19:56:08.695 INFO:teuthology.orchestra.run.smithi155.stdout: "flag_point": "commit sent; apply or cleanup", 2023-08-01T19:56:08.695 INFO:teuthology.orchestra.run.smithi155.stdout: "client_info": { 2023-08-01T19:56:08.695 INFO:teuthology.orchestra.run.smithi155.stdout: "client": "client.4668", 2023-08-01T19:56:08.695 INFO:teuthology.orchestra.run.smithi155.stdout: "client_addr": "172.21.15.6:0/1709472247", 2023-08-01T19:56:08.695 INFO:teuthology.orchestra.run.smithi155.stdout: "tid": 100249 2023-08-01T19:56:08.696 INFO:teuthology.orchestra.run.smithi155.stdout: }, 2023-08-01T19:56:08.696 INFO:teuthology.orchestra.run.smithi155.stdout: "events": [ 2023-08-01T19:56:08.696 INFO:teuthology.orchestra.run.smithi155.stdout: { 2023-08-01T19:56:08.696 INFO:teuthology.orchestra.run.smithi155.stdout: "event": "initiated", 2023-08-01T19:56:08.696 INFO:teuthology.orchestra.run.smithi155.stdout: "time": "2023-08-01T19:55:05.153614+0000", 2023-08-01T19:56:08.696 INFO:teuthology.orchestra.run.smithi155.stdout: "duration": 0 2023-08-01T19:56:08.696 INFO:teuthology.orchestra.run.smithi155.stdout: }, 2023-08-01T19:56:08.696 INFO:teuthology.orchestra.run.smithi155.stdout: { 2023-08-01T19:56:08.697 INFO:teuthology.orchestra.run.smithi155.stdout: "event": "throttled", 2023-08-01T19:56:08.697 INFO:teuthology.orchestra.run.smithi155.stdout: "time": "2023-08-01T19:55:05.153614+0000", 2023-08-01T19:56:08.697 INFO:teuthology.orchestra.run.smithi155.stdout: "duration": 0 2023-08-01T19:56:08.697 INFO:teuthology.orchestra.run.smithi155.stdout: }, 2023-08-01T19:56:08.697 INFO:teuthology.orchestra.run.smithi155.stdout: { 2023-08-01T19:56:08.697 INFO:teuthology.orchestra.run.smithi155.stdout: "event": "header_read", 2023-08-01T19:56:08.697 INFO:teuthology.orchestra.run.smithi155.stdout: "time": "2023-08-01T19:55:05.153612+0000", 2023-08-01T19:56:08.697 INFO:teuthology.orchestra.run.smithi155.stdout: "duration": 4294967295.9999986 2023-08-01T19:56:08.698 INFO:teuthology.orchestra.run.smithi155.stdout: }, 2023-08-01T19:56:08.698 INFO:teuthology.orchestra.run.smithi155.stdout: { 2023-08-01T19:56:08.698 INFO:teuthology.orchestra.run.smithi155.stdout: "event": "all_read", 2023-08-01T19:56:08.698 INFO:teuthology.orchestra.run.smithi155.stdout: "time": "2023-08-01T19:55:05.153694+0000", 2023-08-01T19:56:08.698 INFO:teuthology.orchestra.run.smithi155.stdout: "duration": 8.1618000000000004e-05 2023-08-01T19:56:08.698 INFO:teuthology.orchestra.run.smithi155.stdout: }, 2023-08-01T19:56:08.698 INFO:teuthology.orchestra.run.smithi155.stdout: { 2023-08-01T19:56:08.698 INFO:teuthology.orchestra.run.smithi155.stdout: "event": "dispatched", 2023-08-01T19:56:08.699 INFO:teuthology.orchestra.run.smithi155.stdout: "time": "2023-08-01T19:55:05.153713+0000", 2023-08-01T19:56:08.699 INFO:teuthology.orchestra.run.smithi155.stdout: "duration": 1.9069999999999999e-05 2023-08-01T19:56:08.699 INFO:teuthology.orchestra.run.smithi155.stdout: }, 2023-08-01T19:56:08.699 INFO:teuthology.orchestra.run.smithi155.stdout: { 2023-08-01T19:56:08.699 INFO:teuthology.orchestra.run.smithi155.stdout: "event": "queued_for_pg", 2023-08-01T19:56:08.699 INFO:teuthology.orchestra.run.smithi155.stdout: "time": "2023-08-01T19:55:05.153726+0000", 2023-08-01T19:56:08.699 INFO:teuthology.orchestra.run.smithi155.stdout: "duration": 1.238e-05 2023-08-01T19:56:08.700 INFO:teuthology.orchestra.run.smithi155.stdout: }, 2023-08-01T19:56:08.700 INFO:teuthology.orchestra.run.smithi155.stdout: { 2023-08-01T19:56:08.700 INFO:teuthology.orchestra.run.smithi155.stdout: "event": "reached_pg", 2023-08-01T19:56:08.700 INFO:teuthology.orchestra.run.smithi155.stdout: "time": "2023-08-01T19:55:05.153761+0000", 2023-08-01T19:56:08.700 INFO:teuthology.orchestra.run.smithi155.stdout: "duration": 3.5046999999999998e-05 2023-08-01T19:56:08.700 INFO:teuthology.orchestra.run.smithi155.stdout: }, 2023-08-01T19:56:08.700 INFO:teuthology.orchestra.run.smithi155.stdout: { 2023-08-01T19:56:08.700 INFO:teuthology.orchestra.run.smithi155.stdout: "event": "started", 2023-08-01T19:56:08.701 INFO:teuthology.orchestra.run.smithi155.stdout: "time": "2023-08-01T19:55:05.153896+0000", 2023-08-01T19:56:08.701 INFO:teuthology.orchestra.run.smithi155.stdout: "duration": 0.00013575800000000001 2023-08-01T19:56:08.701 INFO:teuthology.orchestra.run.smithi155.stdout: }, 2023-08-01T19:56:08.701 INFO:teuthology.orchestra.run.smithi155.stdout: { 2023-08-01T19:56:08.701 INFO:teuthology.orchestra.run.smithi155.stdout: "event": "waiting for subops from 0", 2023-08-01T19:56:08.701 INFO:teuthology.orchestra.run.smithi155.stdout: "time": "2023-08-01T19:55:05.154043+0000", 2023-08-01T19:56:08.701 INFO:teuthology.orchestra.run.smithi155.stdout: "duration": 0.00014650700000000001 2023-08-01T19:56:08.701 INFO:teuthology.orchestra.run.smithi155.stdout: }, 2023-08-01T19:56:08.702 INFO:teuthology.orchestra.run.smithi155.stdout: { 2023-08-01T19:56:08.702 INFO:teuthology.orchestra.run.smithi155.stdout: "event": "sub_op_commit_rec", 2023-08-01T19:56:08.702 INFO:teuthology.orchestra.run.smithi155.stdout: "time": "2023-08-01T19:55:05.221876+0000", 2023-08-01T19:56:08.702 INFO:teuthology.orchestra.run.smithi155.stdout: "duration": 0.067832796000000001 2023-08-01T19:56:08.702 INFO:teuthology.orchestra.run.smithi155.stdout: }, 2023-08-01T19:56:08.702 INFO:teuthology.orchestra.run.smithi155.stdout: { 2023-08-01T19:56:08.702 INFO:teuthology.orchestra.run.smithi155.stdout: "event": "op_commit", 2023-08-01T19:56:08.702 INFO:teuthology.orchestra.run.smithi155.stdout: "time": "2023-08-01T19:55:05.222813+0000", 2023-08-01T19:56:08.703 INFO:teuthology.orchestra.run.smithi155.stdout: "duration": 0.00093755300000000004 2023-08-01T19:56:08.703 INFO:teuthology.orchestra.run.smithi155.stdout: }, 2023-08-01T19:56:08.703 INFO:teuthology.orchestra.run.smithi155.stdout: { 2023-08-01T19:56:08.703 INFO:teuthology.orchestra.run.smithi155.stdout: "event": "commit_sent", 2023-08-01T19:56:08.703 INFO:teuthology.orchestra.run.smithi155.stdout: "time": "2023-08-01T19:55:05.222861+0000", 2023-08-01T19:56:08.703 INFO:teuthology.orchestra.run.smithi155.stdout: "duration": 4.8013999999999998e-05 2023-08-01T19:56:08.703 INFO:teuthology.orchestra.run.smithi155.stdout: }, 2023-08-01T19:56:08.703 INFO:teuthology.orchestra.run.smithi155.stdout: { 2023-08-01T19:56:08.704 INFO:teuthology.orchestra.run.smithi155.stdout: "event": "done", 2023-08-01T19:56:08.704 INFO:teuthology.orchestra.run.smithi155.stdout: "time": "2023-08-01T19:55:05.222900+0000", 2023-08-01T19:56:08.704 INFO:teuthology.orchestra.run.smithi155.stdout: "duration": 3.8634999999999999e-05 2023-08-01T19:56:08.704 INFO:teuthology.orchestra.run.smithi155.stdout: } 2023-08-01T19:56:08.704 INFO:teuthology.orchestra.run.smithi155.stdout: ] 2023-08-01T19:56:08.704 INFO:teuthology.orchestra.run.smithi155.stdout: } 2023-08-01T19:56:08.704 INFO:teuthology.orchestra.run.smithi155.stdout: }, 2023-08-01T19:56:08.705 INFO:teuthology.orchestra.run.smithi155.stdout: { 2023-08-01T19:56:08.705 INFO:teuthology.orchestra.run.smithi155.stdout: "description": "osd_op(client.4668.0:100251 5.b 5:d853df24:::benchmark_data_smithi006_114134_object100250:head [set-alloc-hint object_size 65536 write_size 65536,write 0~65536] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e37)", 2023-08-01T19:56:08.705 INFO:teuthology.orchestra.run.smithi155.stdout: "initiated_at": "2023-08-01T19:55:05.153737+0000", 2023-08-01T19:56:08.705 INFO:teuthology.orchestra.run.smithi155.stdout: "age": 63.482040845, 2023-08-01T19:56:08.705 INFO:teuthology.orchestra.run.smithi155.stdout: "duration": 0.071366545000000003, 2023-08-01T19:56:08.705 INFO:teuthology.orchestra.run.smithi155.stdout: "type_data": { 2023-08-01T19:56:08.705 INFO:teuthology.orchestra.run.smithi155.stdout: "flag_point": "commit sent; apply or cleanup", 2023-08-01T19:56:08.705 INFO:teuthology.orchestra.run.smithi155.stdout: "client_info": { 2023-08-01T19:56:08.706 INFO:teuthology.orchestra.run.smithi155.stdout: "client": "client.4668", 2023-08-01T19:56:08.706 INFO:teuthology.orchestra.run.smithi155.stdout: "client_addr": "172.21.15.6:0/1709472247", 2023-08-01T19:56:08.706 INFO:teuthology.orchestra.run.smithi155.stdout: "tid": 100251 2023-08-01T19:56:08.706 INFO:teuthology.orchestra.run.smithi155.stdout: }, 2023-08-01T19:56:08.706 INFO:teuthology.orchestra.run.smithi155.stdout: "events": [ 2023-08-01T19:56:08.706 INFO:teuthology.orchestra.run.smithi155.stdout: { 2023-08-01T19:56:08.706 INFO:teuthology.orchestra.run.smithi155.stdout: "event": "initiated", 2023-08-01T19:56:08.706 INFO:teuthology.orchestra.run.smithi155.stdout: "time": "2023-08-01T19:55:05.153737+0000", 2023-08-01T19:56:08.707 INFO:teuthology.orchestra.run.smithi155.stdout: "duration": 0 2023-08-01T19:56:08.707 INFO:teuthology.orchestra.run.smithi155.stdout: }, 2023-08-01T19:56:08.707 INFO:teuthology.orchestra.run.smithi155.stdout: { 2023-08-01T19:56:08.707 INFO:teuthology.orchestra.run.smithi155.stdout: "event": "throttled", 2023-08-01T19:56:08.707 INFO:teuthology.orchestra.run.smithi155.stdout: "time": "2023-08-01T19:55:05.153737+0000", 2023-08-01T19:56:08.707 INFO:teuthology.orchestra.run.smithi155.stdout: "duration": 0 2023-08-01T19:56:08.707 INFO:teuthology.orchestra.run.smithi155.stdout: }, 2023-08-01T19:56:08.707 INFO:teuthology.orchestra.run.smithi155.stdout: { 2023-08-01T19:56:08.708 INFO:teuthology.orchestra.run.smithi155.stdout: "event": "header_read", 2023-08-01T19:56:08.708 INFO:teuthology.orchestra.run.smithi155.stdout: "time": "2023-08-01T19:55:05.153736+0000", 2023-08-01T19:56:08.708 INFO:teuthology.orchestra.run.smithi155.stdout: "duration": 4294967295.9999995 2023-08-01T19:56:08.708 INFO:teuthology.orchestra.run.smithi155.stdout: }, 2023-08-01T19:56:08.708 INFO:teuthology.orchestra.run.smithi155.stdout: { 2023-08-01T19:56:08.708 INFO:teuthology.orchestra.run.smithi155.stdout: "event": "all_read", 2023-08-01T19:56:08.708 INFO:teuthology.orchestra.run.smithi155.stdout: "time": "2023-08-01T19:55:05.153784+0000", 2023-08-01T19:56:08.709 INFO:teuthology.orchestra.run.smithi155.stdout: "duration": 4.7660000000000001e-05 2023-08-01T19:56:08.709 INFO:teuthology.orchestra.run.smithi155.stdout: }, 2023-08-01T19:56:08.709 INFO:teuthology.orchestra.run.smithi155.stdout: { 2023-08-01T19:56:08.709 INFO:teuthology.orchestra.run.smithi155.stdout: "event": "dispatched", 2023-08-01T19:56:08.709 INFO:teuthology.orchestra.run.smithi155.stdout: "time": "2023-08-01T19:55:05.153793+0000", 2023-08-01T19:56:08.709 INFO:teuthology.orchestra.run.smithi155.stdout: "duration": 8.7150000000000004e-06 2023-08-01T19:56:08.709 INFO:teuthology.orchestra.run.smithi155.stdout: }, 2023-08-01T19:56:08.709 INFO:teuthology.orchestra.run.smithi155.stdout: { 2023-08-01T19:56:08.710 INFO:teuthology.orchestra.run.smithi155.stdout: "event": "queued_for_pg", 2023-08-01T19:56:08.710 INFO:teuthology.orchestra.run.smithi155.stdout: "time": "2023-08-01T19:55:05.153800+0000", 2023-08-01T19:56:08.710 INFO:teuthology.orchestra.run.smithi155.stdout: "duration": 7.2459999999999997e-06 2023-08-01T19:56:08.710 INFO:teuthology.orchestra.run.smithi155.stdout: }, 2023-08-01T19:56:08.710 INFO:teuthology.orchestra.run.smithi155.stdout: { 2023-08-01T19:56:08.710 INFO:teuthology.orchestra.run.smithi155.stdout: "event": "reached_pg", 2023-08-01T19:56:08.710 INFO:teuthology.orchestra.run.smithi155.stdout: "time": "2023-08-01T19:55:05.156241+0000", 2023-08-01T19:56:08.710 INFO:teuthology.orchestra.run.smithi155.stdout: "duration": 0.0024415359999999998 2023-08-01T19:56:08.711 INFO:teuthology.orchestra.run.smithi155.stdout: }, 2023-08-01T19:56:08.711 INFO:teuthology.orchestra.run.smithi155.stdout: { 2023-08-01T19:56:08.711 INFO:teuthology.orchestra.run.smithi155.stdout: "event": "started", 2023-08-01T19:56:08.711 INFO:teuthology.orchestra.run.smithi155.stdout: "time": "2023-08-01T19:55:05.219045+0000", 2023-08-01T19:56:08.711 INFO:teuthology.orchestra.run.smithi155.stdout: "duration": 0.062803855000000006 2023-08-01T19:56:08.711 INFO:teuthology.orchestra.run.smithi155.stdout: }, 2023-08-01T19:56:08.711 INFO:teuthology.orchestra.run.smithi155.stdout: { 2023-08-01T19:56:08.711 INFO:teuthology.orchestra.run.smithi155.stdout: "event": "waiting for subops from 0", 2023-08-01T19:56:08.712 INFO:teuthology.orchestra.run.smithi155.stdout: "time": "2023-08-01T19:55:05.219238+0000", 2023-08-01T19:56:08.712 INFO:teuthology.orchestra.run.smithi155.stdout: "duration": 0.00019241500000000001 2023-08-01T19:56:08.712 INFO:teuthology.orchestra.run.smithi155.stdout: }, 2023-08-01T19:56:08.712 INFO:teuthology.orchestra.run.smithi155.stdout: { 2023-08-01T19:56:08.712 INFO:teuthology.orchestra.run.smithi155.stdout: "event": "sub_op_commit_rec", 2023-08-01T19:56:08.712 INFO:teuthology.orchestra.run.smithi155.stdout: "time": "2023-08-01T19:55:05.223300+0000", 2023-08-01T19:56:08.712 INFO:teuthology.orchestra.run.smithi155.stdout: "duration": 0.0040626509999999996 2023-08-01T19:56:08.712 INFO:teuthology.orchestra.run.smithi155.stdout: }, 2023-08-01T19:56:08.713 INFO:teuthology.orchestra.run.smithi155.stdout: { 2023-08-01T19:56:08.713 INFO:teuthology.orchestra.run.smithi155.stdout: "event": "op_commit", 2023-08-01T19:56:08.713 INFO:teuthology.orchestra.run.smithi155.stdout: "time": "2023-08-01T19:55:05.225020+0000", 2023-08-01T19:56:08.713 INFO:teuthology.orchestra.run.smithi155.stdout: "duration": 0.0017201 2023-08-01T19:56:08.713 INFO:teuthology.orchestra.run.smithi155.stdout: }, 2023-08-01T19:56:08.713 INFO:teuthology.orchestra.run.smithi155.stdout: { 2023-08-01T19:56:08.713 INFO:teuthology.orchestra.run.smithi155.stdout: "event": "commit_sent", 2023-08-01T19:56:08.714 INFO:teuthology.orchestra.run.smithi155.stdout: "time": "2023-08-01T19:55:05.225066+0000", 2023-08-01T19:56:08.714 INFO:teuthology.orchestra.run.smithi155.stdout: "duration": 4.6143000000000002e-05 2023-08-01T19:56:08.714 INFO:teuthology.orchestra.run.smithi155.stdout: }, 2023-08-01T19:56:08.714 INFO:teuthology.orchestra.run.smithi155.stdout: { 2023-08-01T19:56:08.714 INFO:teuthology.orchestra.run.smithi155.stdout: "event": "done", 2023-08-01T19:56:08.714 INFO:teuthology.orchestra.run.smithi155.stdout: "time": "2023-08-01T19:55:05.225103+0000", 2023-08-01T19:56:08.714 INFO:teuthology.orchestra.run.smithi155.stdout: "duration": 3.6789999999999998e-05 2023-08-01T19:56:08.714 INFO:teuthology.orchestra.run.smithi155.stdout: } 2023-08-01T19:56:08.715 INFO:teuthology.orchestra.run.smithi155.stdout: ] 2023-08-01T19:56:08.715 INFO:teuthology.orchestra.run.smithi155.stdout: } 2023-08-01T19:56:08.715 INFO:teuthology.orchestra.run.smithi155.stdout: }, 2023-08-01T19:56:08.715 INFO:teuthology.orchestra.run.smithi155.stdout: { 2023-08-01T19:56:08.715 INFO:teuthology.orchestra.run.smithi155.stdout: "description": "osd_op(client.4668.0:100252 5.0 5:01f90c3c:::benchmark_data_smithi006_114134_object100251:head [set-alloc-hint object_size 65536 write_size 65536,write 0~65536] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e37)", 2023-08-01T19:56:08.715 INFO:teuthology.orchestra.run.smithi155.stdout: "initiated_at": "2023-08-01T19:55:05.154048+0000", 2023-08-01T19:56:08.715 INFO:teuthology.orchestra.run.smithi155.stdout: "age": 63.481729598000001, 2023-08-01T19:56:08.715 INFO:teuthology.orchestra.run.smithi155.stdout: "duration": 0.070156683999999997, 2023-08-01T19:56:08.716 INFO:teuthology.orchestra.run.smithi155.stdout: "type_data": { 2023-08-01T19:56:08.716 INFO:teuthology.orchestra.run.smithi155.stdout: "flag_point": "commit sent; apply or cleanup", 2023-08-01T19:56:08.716 INFO:teuthology.orchestra.run.smithi155.stdout: "client_info": { 2023-08-01T19:56:08.716 INFO:teuthology.orchestra.run.smithi155.stdout: "client": "client.4668", 2023-08-01T19:56:08.716 INFO:teuthology.orchestra.run.smithi155.stdout: "client_addr": "172.21.15.6:0/1709472247", 2023-08-01T19:56:08.716 INFO:teuthology.orchestra.run.smithi155.stdout: "tid": 100252 2023-08-01T19:56:08.716 INFO:teuthology.orchestra.run.smithi155.stdout: }, 2023-08-01T19:56:08.716 INFO:teuthology.orchestra.run.smithi155.stdout: "events": [ 2023-08-01T19:56:08.717 INFO:teuthology.orchestra.run.smithi155.stdout: { 2023-08-01T19:56:08.717 INFO:teuthology.orchestra.run.smithi155.stdout: "event": "initiated", 2023-08-01T19:56:08.717 INFO:teuthology.orchestra.run.smithi155.stdout: "time": "2023-08-01T19:55:05.154048+0000", 2023-08-01T19:56:08.717 INFO:teuthology.orchestra.run.smithi155.stdout: "duration": 0 2023-08-01T19:56:08.717 INFO:teuthology.orchestra.run.smithi155.stdout: }, 2023-08-01T19:56:08.717 INFO:teuthology.orchestra.run.smithi155.stdout: { 2023-08-01T19:56:08.717 INFO:teuthology.orchestra.run.smithi155.stdout: "event": "throttled", 2023-08-01T19:56:08.717 INFO:teuthology.orchestra.run.smithi155.stdout: "time": "2023-08-01T19:55:05.154048+0000", 2023-08-01T19:56:08.718 INFO:teuthology.orchestra.run.smithi155.stdout: "duration": 0 2023-08-01T19:56:08.718 INFO:teuthology.orchestra.run.smithi155.stdout: }, 2023-08-01T19:56:08.718 INFO:teuthology.orchestra.run.smithi155.stdout: { 2023-08-01T19:56:08.718 INFO:teuthology.orchestra.run.smithi155.stdout: "event": "header_read", 2023-08-01T19:56:08.718 INFO:teuthology.orchestra.run.smithi155.stdout: "time": "2023-08-01T19:55:05.154047+0000", 2023-08-01T19:56:08.718 INFO:teuthology.orchestra.run.smithi155.stdout: "duration": 4294967295.999999 2023-08-01T19:56:08.718 INFO:teuthology.orchestra.run.smithi155.stdout: }, 2023-08-01T19:56:08.718 INFO:teuthology.orchestra.run.smithi155.stdout: { 2023-08-01T19:56:08.719 INFO:teuthology.orchestra.run.smithi155.stdout: "event": "all_read", 2023-08-01T19:56:08.719 INFO:teuthology.orchestra.run.smithi155.stdout: "time": "2023-08-01T19:55:05.154115+0000", 2023-08-01T19:56:08.719 INFO:teuthology.orchestra.run.smithi155.stdout: "duration": 6.7545999999999993e-05 2023-08-01T19:56:08.719 INFO:teuthology.orchestra.run.smithi155.stdout: }, 2023-08-01T19:56:08.719 INFO:teuthology.orchestra.run.smithi155.stdout: { 2023-08-01T19:56:08.719 INFO:teuthology.orchestra.run.smithi155.stdout: "event": "dispatched", 2023-08-01T19:56:08.719 INFO:teuthology.orchestra.run.smithi155.stdout: "time": "2023-08-01T19:55:05.154125+0000", 2023-08-01T19:56:08.720 INFO:teuthology.orchestra.run.smithi155.stdout: "duration": 1.0669000000000001e-05 2023-08-01T19:56:08.720 INFO:teuthology.orchestra.run.smithi155.stdout: }, 2023-08-01T19:56:08.720 INFO:teuthology.orchestra.run.smithi155.stdout: { 2023-08-01T19:56:08.720 INFO:teuthology.orchestra.run.smithi155.stdout: "event": "queued_for_pg", 2023-08-01T19:56:08.720 INFO:teuthology.orchestra.run.smithi155.stdout: "time": "2023-08-01T19:55:05.154131+0000", 2023-08-01T19:56:08.720 INFO:teuthology.orchestra.run.smithi155.stdout: "duration": 6.0349999999999998e-06 2023-08-01T19:56:08.720 INFO:teuthology.orchestra.run.smithi155.stdout: }, 2023-08-01T19:56:08.720 INFO:teuthology.orchestra.run.smithi155.stdout: { 2023-08-01T19:56:08.721 INFO:teuthology.orchestra.run.smithi155.stdout: "event": "reached_pg", 2023-08-01T19:56:08.721 INFO:teuthology.orchestra.run.smithi155.stdout: "time": "2023-08-01T19:55:05.154174+0000", 2023-08-01T19:56:08.721 INFO:teuthology.orchestra.run.smithi155.stdout: "duration": 4.2429000000000003e-05 2023-08-01T19:56:08.721 INFO:teuthology.orchestra.run.smithi155.stdout: }, 2023-08-01T19:56:08.721 INFO:teuthology.orchestra.run.smithi155.stdout: { 2023-08-01T19:56:08.721 INFO:teuthology.orchestra.run.smithi155.stdout: "event": "started", 2023-08-01T19:56:08.721 INFO:teuthology.orchestra.run.smithi155.stdout: "time": "2023-08-01T19:55:05.154287+0000", 2023-08-01T19:56:08.721 INFO:teuthology.orchestra.run.smithi155.stdout: "duration": 0.000113138 2023-08-01T19:56:08.722 INFO:teuthology.orchestra.run.smithi155.stdout: }, 2023-08-01T19:56:08.722 INFO:teuthology.orchestra.run.smithi155.stdout: { 2023-08-01T19:56:08.722 INFO:teuthology.orchestra.run.smithi155.stdout: "event": "waiting for subops from 0", 2023-08-01T19:56:08.722 INFO:teuthology.orchestra.run.smithi155.stdout: "time": "2023-08-01T19:55:05.154420+0000", 2023-08-01T19:56:08.722 INFO:teuthology.orchestra.run.smithi155.stdout: "duration": 0.000133292 2023-08-01T19:56:08.722 INFO:teuthology.orchestra.run.smithi155.stdout: }, 2023-08-01T19:56:08.722 INFO:teuthology.orchestra.run.smithi155.stdout: { 2023-08-01T19:56:08.722 INFO:teuthology.orchestra.run.smithi155.stdout: "event": "sub_op_commit_rec", 2023-08-01T19:56:08.723 INFO:teuthology.orchestra.run.smithi155.stdout: "time": "2023-08-01T19:55:05.219034+0000", 2023-08-01T19:56:08.723 INFO:teuthology.orchestra.run.smithi155.stdout: "duration": 0.064613429999999999 2023-08-01T19:56:08.723 INFO:teuthology.orchestra.run.smithi155.stdout: }, 2023-08-01T19:56:08.723 INFO:teuthology.orchestra.run.smithi155.stdout: { 2023-08-01T19:56:08.723 INFO:teuthology.orchestra.run.smithi155.stdout: "event": "op_commit", 2023-08-01T19:56:08.723 INFO:teuthology.orchestra.run.smithi155.stdout: "time": "2023-08-01T19:55:05.224138+0000", 2023-08-01T19:56:08.723 INFO:teuthology.orchestra.run.smithi155.stdout: "duration": 0.0051041999999999997 2023-08-01T19:56:08.723 INFO:teuthology.orchestra.run.smithi155.stdout: }, 2023-08-01T19:56:08.724 INFO:teuthology.orchestra.run.smithi155.stdout: { 2023-08-01T19:56:08.724 INFO:teuthology.orchestra.run.smithi155.stdout: "event": "commit_sent", 2023-08-01T19:56:08.724 INFO:teuthology.orchestra.run.smithi155.stdout: "time": "2023-08-01T19:55:05.224171+0000", 2023-08-01T19:56:08.724 INFO:teuthology.orchestra.run.smithi155.stdout: "duration": 3.3345e-05 2023-08-01T19:56:08.724 INFO:teuthology.orchestra.run.smithi155.stdout: }, 2023-08-01T19:56:08.724 INFO:teuthology.orchestra.run.smithi155.stdout: { 2023-08-01T19:56:08.724 INFO:teuthology.orchestra.run.smithi155.stdout: "event": "done", 2023-08-01T19:56:08.724 INFO:teuthology.orchestra.run.smithi155.stdout: "time": "2023-08-01T19:55:05.224205+0000", 2023-08-01T19:56:08.725 INFO:teuthology.orchestra.run.smithi155.stdout: "duration": 3.3525999999999997e-05 2023-08-01T19:56:08.725 INFO:teuthology.orchestra.run.smithi155.stdout: } 2023-08-01T19:56:08.725 INFO:teuthology.orchestra.run.smithi155.stdout: ] 2023-08-01T19:56:08.725 INFO:teuthology.orchestra.run.smithi155.stdout: } 2023-08-01T19:56:08.725 INFO:teuthology.orchestra.run.smithi155.stdout: }, 2023-08-01T19:56:08.725 INFO:teuthology.orchestra.run.smithi155.stdout: { 2023-08-01T19:56:08.725 INFO:teuthology.orchestra.run.smithi155.stdout: "description": "osd_repop_reply(client.4668.0:100237 5.4 e37/19 ondisk, result = 0)", 2023-08-01T19:56:08.726 INFO:teuthology.orchestra.run.smithi155.stdout: "initiated_at": "2023-08-01T19:55:05.156249+0000", 2023-08-01T19:56:08.726 INFO:teuthology.orchestra.run.smithi155.stdout: "age": 63.479528653000003, 2023-08-01T19:56:08.726 INFO:teuthology.orchestra.run.smithi155.stdout: "duration": 0.062792549000000003, 2023-08-01T19:56:08.726 INFO:teuthology.orchestra.run.smithi155.stdout: "type_data": { 2023-08-01T19:56:08.726 INFO:teuthology.orchestra.run.smithi155.stdout: "flag_point": "started", 2023-08-01T19:56:08.726 INFO:teuthology.orchestra.run.smithi155.stdout: "events": [ 2023-08-01T19:56:08.726 INFO:teuthology.orchestra.run.smithi155.stdout: { 2023-08-01T19:56:08.726 INFO:teuthology.orchestra.run.smithi155.stdout: "event": "initiated", 2023-08-01T19:56:08.727 INFO:teuthology.orchestra.run.smithi155.stdout: "time": "2023-08-01T19:55:05.156249+0000", 2023-08-01T19:56:08.727 INFO:teuthology.orchestra.run.smithi155.stdout: "duration": 0 2023-08-01T19:56:08.727 INFO:teuthology.orchestra.run.smithi155.stdout: }, 2023-08-01T19:56:08.727 INFO:teuthology.orchestra.run.smithi155.stdout: { 2023-08-01T19:56:08.727 INFO:teuthology.orchestra.run.smithi155.stdout: "event": "throttled", 2023-08-01T19:56:08.727 INFO:teuthology.orchestra.run.smithi155.stdout: "time": "2023-08-01T19:55:05.156249+0000", 2023-08-01T19:56:08.727 INFO:teuthology.orchestra.run.smithi155.stdout: "duration": 0 2023-08-01T19:56:08.727 INFO:teuthology.orchestra.run.smithi155.stdout: }, 2023-08-01T19:56:08.728 INFO:teuthology.orchestra.run.smithi155.stdout: { 2023-08-01T19:56:08.728 INFO:teuthology.orchestra.run.smithi155.stdout: "event": "header_read", 2023-08-01T19:56:08.728 INFO:teuthology.orchestra.run.smithi155.stdout: "time": "2023-08-01T19:55:05.156248+0000", 2023-08-01T19:56:08.728 INFO:teuthology.orchestra.run.smithi155.stdout: "duration": 4294967295.9999995 2023-08-01T19:56:08.728 INFO:teuthology.orchestra.run.smithi155.stdout: }, 2023-08-01T19:56:08.728 INFO:teuthology.orchestra.run.smithi155.stdout: { 2023-08-01T19:56:08.728 INFO:teuthology.orchestra.run.smithi155.stdout: "event": "all_read", 2023-08-01T19:56:08.728 INFO:teuthology.orchestra.run.smithi155.stdout: "time": "2023-08-01T19:55:05.156252+0000", 2023-08-01T19:56:08.729 INFO:teuthology.orchestra.run.smithi155.stdout: "duration": 3.9999999999999998e-06 2023-08-01T19:56:08.729 INFO:teuthology.orchestra.run.smithi155.stdout: }, 2023-08-01T19:56:08.729 INFO:teuthology.orchestra.run.smithi155.stdout: { 2023-08-01T19:56:08.729 INFO:teuthology.orchestra.run.smithi155.stdout: "event": "dispatched", 2023-08-01T19:56:08.729 INFO:teuthology.orchestra.run.smithi155.stdout: "time": "2023-08-01T19:55:05.218844+0000", 2023-08-01T19:56:08.729 INFO:teuthology.orchestra.run.smithi155.stdout: "duration": 0.062591516999999999 2023-08-01T19:56:08.729 INFO:teuthology.orchestra.run.smithi155.stdout: }, 2023-08-01T19:56:08.729 INFO:teuthology.orchestra.run.smithi155.stdout: { 2023-08-01T19:56:08.730 INFO:teuthology.orchestra.run.smithi155.stdout: "event": "queued_for_pg", 2023-08-01T19:56:08.730 INFO:teuthology.orchestra.run.smithi155.stdout: "time": "2023-08-01T19:55:05.218862+0000", 2023-08-01T19:56:08.730 INFO:teuthology.orchestra.run.smithi155.stdout: "duration": 1.7666e-05 2023-08-01T19:56:08.730 INFO:teuthology.orchestra.run.smithi155.stdout: }, 2023-08-01T19:56:08.730 INFO:teuthology.orchestra.run.smithi155.stdout: { 2023-08-01T19:56:08.730 INFO:teuthology.orchestra.run.smithi155.stdout: "event": "reached_pg", 2023-08-01T19:56:08.730 INFO:teuthology.orchestra.run.smithi155.stdout: "time": "2023-08-01T19:55:05.218914+0000", 2023-08-01T19:56:08.730 INFO:teuthology.orchestra.run.smithi155.stdout: "duration": 5.2565999999999998e-05 2023-08-01T19:56:08.731 INFO:teuthology.orchestra.run.smithi155.stdout: }, 2023-08-01T19:56:08.731 INFO:teuthology.orchestra.run.smithi155.stdout: { 2023-08-01T19:56:08.731 INFO:teuthology.orchestra.run.smithi155.stdout: "event": "started", 2023-08-01T19:56:08.731 INFO:teuthology.orchestra.run.smithi155.stdout: "time": "2023-08-01T19:55:05.218925+0000", 2023-08-01T19:56:08.731 INFO:teuthology.orchestra.run.smithi155.stdout: "duration": 1.1375e-05 2023-08-01T19:56:08.731 INFO:teuthology.orchestra.run.smithi155.stdout: }, 2023-08-01T19:56:08.731 INFO:teuthology.orchestra.run.smithi155.stdout: { 2023-08-01T19:56:08.731 INFO:teuthology.orchestra.run.smithi155.stdout: "event": "done", 2023-08-01T19:56:08.732 INFO:teuthology.orchestra.run.smithi155.stdout: "time": "2023-08-01T19:55:05.219041+0000", 2023-08-01T19:56:08.732 INFO:teuthology.orchestra.run.smithi155.stdout: "duration": 0.000115977 2023-08-01T19:56:08.732 INFO:teuthology.orchestra.run.smithi155.stdout: } 2023-08-01T19:56:08.732 INFO:teuthology.orchestra.run.smithi155.stdout: ] 2023-08-01T19:56:08.732 INFO:teuthology.orchestra.run.smithi155.stdout: } 2023-08-01T19:56:08.732 INFO:teuthology.orchestra.run.smithi155.stdout: }, 2023-08-01T19:56:08.732 INFO:teuthology.orchestra.run.smithi155.stdout: { 2023-08-01T19:56:08.733 INFO:teuthology.orchestra.run.smithi155.stdout: "description": "osd_repop(client.4668.0:100253 5.f e37/19 5:f7bbce05:::benchmark_data_smithi006_114134_object100252:head v 37'6323, mlcod=37'6321)", 2023-08-01T19:56:08.733 INFO:teuthology.orchestra.run.smithi155.stdout: "initiated_at": "2023-08-01T19:55:05.156952+0000", 2023-08-01T19:56:08.733 INFO:teuthology.orchestra.run.smithi155.stdout: "age": 63.47882559, 2023-08-01T19:56:08.733 INFO:teuthology.orchestra.run.smithi155.stdout: "duration": 0.068018577999999996, 2023-08-01T19:56:08.733 INFO:teuthology.orchestra.run.smithi155.stdout: "type_data": { 2023-08-01T19:56:08.733 INFO:teuthology.orchestra.run.smithi155.stdout: "flag_point": "commit sent; apply or cleanup", 2023-08-01T19:56:08.733 INFO:teuthology.orchestra.run.smithi155.stdout: "events": [ 2023-08-01T19:56:08.733 INFO:teuthology.orchestra.run.smithi155.stdout: { 2023-08-01T19:56:08.734 INFO:teuthology.orchestra.run.smithi155.stdout: "event": "initiated", 2023-08-01T19:56:08.734 INFO:teuthology.orchestra.run.smithi155.stdout: "time": "2023-08-01T19:55:05.156952+0000", 2023-08-01T19:56:08.734 INFO:teuthology.orchestra.run.smithi155.stdout: "duration": 0 2023-08-01T19:56:08.734 INFO:teuthology.orchestra.run.smithi155.stdout: }, 2023-08-01T19:56:08.734 INFO:teuthology.orchestra.run.smithi155.stdout: { 2023-08-01T19:56:08.734 INFO:teuthology.orchestra.run.smithi155.stdout: "event": "throttled", 2023-08-01T19:56:08.734 INFO:teuthology.orchestra.run.smithi155.stdout: "time": "2023-08-01T19:55:05.156952+0000", 2023-08-01T19:56:08.734 INFO:teuthology.orchestra.run.smithi155.stdout: "duration": 0 2023-08-01T19:56:08.735 INFO:teuthology.orchestra.run.smithi155.stdout: }, 2023-08-01T19:56:08.735 INFO:teuthology.orchestra.run.smithi155.stdout: { 2023-08-01T19:56:08.735 INFO:teuthology.orchestra.run.smithi155.stdout: "event": "header_read", 2023-08-01T19:56:08.735 INFO:teuthology.orchestra.run.smithi155.stdout: "time": "2023-08-01T19:55:05.156951+0000", 2023-08-01T19:56:08.735 INFO:teuthology.orchestra.run.smithi155.stdout: "duration": 4294967295.999999 2023-08-01T19:56:08.735 INFO:teuthology.orchestra.run.smithi155.stdout: }, 2023-08-01T19:56:08.735 INFO:teuthology.orchestra.run.smithi155.stdout: { 2023-08-01T19:56:08.735 INFO:teuthology.orchestra.run.smithi155.stdout: "event": "all_read", 2023-08-01T19:56:08.736 INFO:teuthology.orchestra.run.smithi155.stdout: "time": "2023-08-01T19:55:05.156989+0000", 2023-08-01T19:56:08.736 INFO:teuthology.orchestra.run.smithi155.stdout: "duration": 3.8175e-05 2023-08-01T19:56:08.736 INFO:teuthology.orchestra.run.smithi155.stdout: }, 2023-08-01T19:56:08.736 INFO:teuthology.orchestra.run.smithi155.stdout: { 2023-08-01T19:56:08.736 INFO:teuthology.orchestra.run.smithi155.stdout: "event": "dispatched", 2023-08-01T19:56:08.736 INFO:teuthology.orchestra.run.smithi155.stdout: "time": "2023-08-01T19:55:05.218842+0000", 2023-08-01T19:56:08.736 INFO:teuthology.orchestra.run.smithi155.stdout: "duration": 0.061852299999999999 2023-08-01T19:56:08.736 INFO:teuthology.orchestra.run.smithi155.stdout: }, 2023-08-01T19:56:08.737 INFO:teuthology.orchestra.run.smithi155.stdout: { 2023-08-01T19:56:08.737 INFO:teuthology.orchestra.run.smithi155.stdout: "event": "queued_for_pg", 2023-08-01T19:56:08.737 INFO:teuthology.orchestra.run.smithi155.stdout: "time": "2023-08-01T19:55:05.218862+0000", 2023-08-01T19:56:08.737 INFO:teuthology.orchestra.run.smithi155.stdout: "duration": 1.9854999999999999e-05 2023-08-01T19:56:08.737 INFO:teuthology.orchestra.run.smithi155.stdout: }, 2023-08-01T19:56:08.737 INFO:teuthology.orchestra.run.smithi155.stdout: { 2023-08-01T19:56:08.737 INFO:teuthology.orchestra.run.smithi155.stdout: "event": "reached_pg", 2023-08-01T19:56:08.738 INFO:teuthology.orchestra.run.smithi155.stdout: "time": "2023-08-01T19:55:05.218918+0000", 2023-08-01T19:56:08.738 INFO:teuthology.orchestra.run.smithi155.stdout: "duration": 5.6570000000000002e-05 2023-08-01T19:56:08.738 INFO:teuthology.orchestra.run.smithi155.stdout: }, 2023-08-01T19:56:08.738 INFO:teuthology.orchestra.run.smithi155.stdout: { 2023-08-01T19:56:08.738 INFO:teuthology.orchestra.run.smithi155.stdout: "event": "started", 2023-08-01T19:56:08.738 INFO:teuthology.orchestra.run.smithi155.stdout: "time": "2023-08-01T19:55:05.218940+0000", 2023-08-01T19:56:08.738 INFO:teuthology.orchestra.run.smithi155.stdout: "duration": 2.1804e-05 2023-08-01T19:56:08.738 INFO:teuthology.orchestra.run.smithi155.stdout: }, 2023-08-01T19:56:08.739 INFO:teuthology.orchestra.run.smithi155.stdout: { 2023-08-01T19:56:08.739 INFO:teuthology.orchestra.run.smithi155.stdout: "event": "commit_sent", 2023-08-01T19:56:08.739 INFO:teuthology.orchestra.run.smithi155.stdout: "time": "2023-08-01T19:55:05.224928+0000", 2023-08-01T19:56:08.739 INFO:teuthology.orchestra.run.smithi155.stdout: "duration": 0.0059876759999999999 2023-08-01T19:56:08.739 INFO:teuthology.orchestra.run.smithi155.stdout: }, 2023-08-01T19:56:08.739 INFO:teuthology.orchestra.run.smithi155.stdout: { 2023-08-01T19:56:08.739 INFO:teuthology.orchestra.run.smithi155.stdout: "event": "done", 2023-08-01T19:56:08.739 INFO:teuthology.orchestra.run.smithi155.stdout: "time": "2023-08-01T19:55:05.224971+0000", 2023-08-01T19:56:08.740 INFO:teuthology.orchestra.run.smithi155.stdout: "duration": 4.2929999999999997e-05 2023-08-01T19:56:08.740 INFO:teuthology.orchestra.run.smithi155.stdout: } 2023-08-01T19:56:08.740 INFO:teuthology.orchestra.run.smithi155.stdout: ] 2023-08-01T19:56:08.740 INFO:teuthology.orchestra.run.smithi155.stdout: } 2023-08-01T19:56:08.740 INFO:teuthology.orchestra.run.smithi155.stdout: }, 2023-08-01T19:56:08.740 INFO:teuthology.orchestra.run.smithi155.stdout: { 2023-08-01T19:56:08.740 INFO:teuthology.orchestra.run.smithi155.stdout: "description": "osd_op(client.4668.0:100927 5.0 5:00608ec6:::benchmark_data_smithi006_114134_object100926:head [set-alloc-hint object_size 65536 write_size 65536,write 0~65536] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e37)", 2023-08-01T19:56:08.740 INFO:teuthology.orchestra.run.smithi155.stdout: "initiated_at": "2023-08-01T19:55:05.561169+0000", 2023-08-01T19:56:08.741 INFO:teuthology.orchestra.run.smithi155.stdout: "age": 63.074608687000001, 2023-08-01T19:56:08.741 INFO:teuthology.orchestra.run.smithi155.stdout: "duration": 0.066411687999999997, 2023-08-01T19:56:08.741 INFO:teuthology.orchestra.run.smithi155.stdout: "type_data": { 2023-08-01T19:56:08.741 INFO:teuthology.orchestra.run.smithi155.stdout: "flag_point": "commit sent; apply or cleanup", 2023-08-01T19:56:08.741 INFO:teuthology.orchestra.run.smithi155.stdout: "client_info": { 2023-08-01T19:56:08.741 INFO:teuthology.orchestra.run.smithi155.stdout: "client": "client.4668", 2023-08-01T19:56:08.741 INFO:teuthology.orchestra.run.smithi155.stdout: "client_addr": "172.21.15.6:0/1709472247", 2023-08-01T19:56:08.741 INFO:teuthology.orchestra.run.smithi155.stdout: "tid": 100927 2023-08-01T19:56:08.742 INFO:teuthology.orchestra.run.smithi155.stdout: }, 2023-08-01T19:56:08.742 INFO:teuthology.orchestra.run.smithi155.stdout: "events": [ 2023-08-01T19:56:08.742 INFO:teuthology.orchestra.run.smithi155.stdout: { 2023-08-01T19:56:08.742 INFO:teuthology.orchestra.run.smithi155.stdout: "event": "initiated", 2023-08-01T19:56:08.742 INFO:teuthology.orchestra.run.smithi155.stdout: "time": "2023-08-01T19:55:05.561169+0000", 2023-08-01T19:56:08.742 INFO:teuthology.orchestra.run.smithi155.stdout: "duration": 0 2023-08-01T19:56:08.742 INFO:teuthology.orchestra.run.smithi155.stdout: }, 2023-08-01T19:56:08.742 INFO:teuthology.orchestra.run.smithi155.stdout: { 2023-08-01T19:56:08.743 INFO:teuthology.orchestra.run.smithi155.stdout: "event": "throttled", 2023-08-01T19:56:08.743 INFO:teuthology.orchestra.run.smithi155.stdout: "time": "2023-08-01T19:55:05.561169+0000", 2023-08-01T19:56:08.743 INFO:teuthology.orchestra.run.smithi155.stdout: "duration": 0 2023-08-01T19:56:08.743 INFO:teuthology.orchestra.run.smithi155.stdout: }, 2023-08-01T19:56:08.743 INFO:teuthology.orchestra.run.smithi155.stdout: { 2023-08-01T19:56:08.743 INFO:teuthology.orchestra.run.smithi155.stdout: "event": "header_read", 2023-08-01T19:56:08.743 INFO:teuthology.orchestra.run.smithi155.stdout: "time": "2023-08-01T19:55:05.561168+0000", 2023-08-01T19:56:08.744 INFO:teuthology.orchestra.run.smithi155.stdout: "duration": 4294967295.9999995 2023-08-01T19:56:08.744 INFO:teuthology.orchestra.run.smithi155.stdout: }, 2023-08-01T19:56:08.744 INFO:teuthology.orchestra.run.smithi155.stdout: { 2023-08-01T19:56:08.744 INFO:teuthology.orchestra.run.smithi155.stdout: "event": "all_read", 2023-08-01T19:56:08.744 INFO:teuthology.orchestra.run.smithi155.stdout: "time": "2023-08-01T19:55:05.561218+0000", 2023-08-01T19:56:08.744 INFO:teuthology.orchestra.run.smithi155.stdout: "duration": 4.9379999999999998e-05 2023-08-01T19:56:08.744 INFO:teuthology.orchestra.run.smithi155.stdout: }, 2023-08-01T19:56:08.744 INFO:teuthology.orchestra.run.smithi155.stdout: { 2023-08-01T19:56:08.745 INFO:teuthology.orchestra.run.smithi155.stdout: "event": "dispatched", 2023-08-01T19:56:08.745 INFO:teuthology.orchestra.run.smithi155.stdout: "time": "2023-08-01T19:55:05.561225+0000", 2023-08-01T19:56:08.745 INFO:teuthology.orchestra.run.smithi155.stdout: "duration": 7.114e-06 2023-08-01T19:56:08.745 INFO:teuthology.orchestra.run.smithi155.stdout: }, 2023-08-01T19:56:08.745 INFO:teuthology.orchestra.run.smithi155.stdout: { 2023-08-01T19:56:08.745 INFO:teuthology.orchestra.run.smithi155.stdout: "event": "queued_for_pg", 2023-08-01T19:56:08.745 INFO:teuthology.orchestra.run.smithi155.stdout: "time": "2023-08-01T19:55:05.561229+0000", 2023-08-01T19:56:08.745 INFO:teuthology.orchestra.run.smithi155.stdout: "duration": 4.2180000000000001e-06 2023-08-01T19:56:08.746 INFO:teuthology.orchestra.run.smithi155.stdout: }, 2023-08-01T19:56:08.746 INFO:teuthology.orchestra.run.smithi155.stdout: { 2023-08-01T19:56:08.746 INFO:teuthology.orchestra.run.smithi155.stdout: "event": "reached_pg", 2023-08-01T19:56:08.746 INFO:teuthology.orchestra.run.smithi155.stdout: "time": "2023-08-01T19:55:05.564737+0000", 2023-08-01T19:56:08.746 INFO:teuthology.orchestra.run.smithi155.stdout: "duration": 0.0035081869999999999 2023-08-01T19:56:08.746 INFO:teuthology.orchestra.run.smithi155.stdout: }, 2023-08-01T19:56:08.746 INFO:teuthology.orchestra.run.smithi155.stdout: { 2023-08-01T19:56:08.746 INFO:teuthology.orchestra.run.smithi155.stdout: "event": "started", 2023-08-01T19:56:08.747 INFO:teuthology.orchestra.run.smithi155.stdout: "time": "2023-08-01T19:55:05.564859+0000", 2023-08-01T19:56:08.747 INFO:teuthology.orchestra.run.smithi155.stdout: "duration": 0.00012165800000000001 2023-08-01T19:56:08.747 INFO:teuthology.orchestra.run.smithi155.stdout: }, 2023-08-01T19:56:08.747 INFO:teuthology.orchestra.run.smithi155.stdout: { 2023-08-01T19:56:08.747 INFO:teuthology.orchestra.run.smithi155.stdout: "event": "waiting for subops from 0", 2023-08-01T19:56:08.747 INFO:teuthology.orchestra.run.smithi155.stdout: "time": "2023-08-01T19:55:05.565009+0000", 2023-08-01T19:56:08.747 INFO:teuthology.orchestra.run.smithi155.stdout: "duration": 0.00014979699999999999 2023-08-01T19:56:08.747 INFO:teuthology.orchestra.run.smithi155.stdout: }, 2023-08-01T19:56:08.748 INFO:teuthology.orchestra.run.smithi155.stdout: { 2023-08-01T19:56:08.748 INFO:teuthology.orchestra.run.smithi155.stdout: "event": "op_commit", 2023-08-01T19:56:08.748 INFO:teuthology.orchestra.run.smithi155.stdout: "time": "2023-08-01T19:55:05.568007+0000", 2023-08-01T19:56:08.748 INFO:teuthology.orchestra.run.smithi155.stdout: "duration": 0.00299796 2023-08-01T19:56:08.748 INFO:teuthology.orchestra.run.smithi155.stdout: }, 2023-08-01T19:56:08.748 INFO:teuthology.orchestra.run.smithi155.stdout: { 2023-08-01T19:56:08.748 INFO:teuthology.orchestra.run.smithi155.stdout: "event": "sub_op_commit_rec", 2023-08-01T19:56:08.748 INFO:teuthology.orchestra.run.smithi155.stdout: "time": "2023-08-01T19:55:05.627520+0000", 2023-08-01T19:56:08.749 INFO:teuthology.orchestra.run.smithi155.stdout: "duration": 0.059513636000000002 2023-08-01T19:56:08.749 INFO:teuthology.orchestra.run.smithi155.stdout: }, 2023-08-01T19:56:08.749 INFO:teuthology.orchestra.run.smithi155.stdout: { 2023-08-01T19:56:08.749 INFO:teuthology.orchestra.run.smithi155.stdout: "event": "commit_sent", 2023-08-01T19:56:08.749 INFO:teuthology.orchestra.run.smithi155.stdout: "time": "2023-08-01T19:55:05.627553+0000", 2023-08-01T19:56:08.749 INFO:teuthology.orchestra.run.smithi155.stdout: "duration": 3.2635999999999997e-05 2023-08-01T19:56:08.749 INFO:teuthology.orchestra.run.smithi155.stdout: }, 2023-08-01T19:56:08.750 INFO:teuthology.orchestra.run.smithi155.stdout: { 2023-08-01T19:56:08.750 INFO:teuthology.orchestra.run.smithi155.stdout: "event": "done", 2023-08-01T19:56:08.750 INFO:teuthology.orchestra.run.smithi155.stdout: "time": "2023-08-01T19:55:05.627581+0000", 2023-08-01T19:56:08.750 INFO:teuthology.orchestra.run.smithi155.stdout: "duration": 2.7681000000000001e-05 2023-08-01T19:56:08.750 INFO:teuthology.orchestra.run.smithi155.stdout: } 2023-08-01T19:56:08.750 INFO:teuthology.orchestra.run.smithi155.stdout: ] 2023-08-01T19:56:08.750 INFO:teuthology.orchestra.run.smithi155.stdout: } 2023-08-01T19:56:08.750 INFO:teuthology.orchestra.run.smithi155.stdout: }, 2023-08-01T19:56:08.751 INFO:teuthology.orchestra.run.smithi155.stdout: { 2023-08-01T19:56:08.751 INFO:teuthology.orchestra.run.smithi155.stdout: "description": "osd_op(client.4668.0:100935 5.e 5:7895b14e:::benchmark_data_smithi006_114134_object100934:head [set-alloc-hint object_size 65536 write_size 65536,write 0~65536] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e37)", 2023-08-01T19:56:08.751 INFO:teuthology.orchestra.run.smithi155.stdout: "initiated_at": "2023-08-01T19:55:05.566666+0000", 2023-08-01T19:56:08.751 INFO:teuthology.orchestra.run.smithi155.stdout: "age": 63.069111387, 2023-08-01T19:56:08.751 INFO:teuthology.orchestra.run.smithi155.stdout: "duration": 0.064309016999999996, 2023-08-01T19:56:08.751 INFO:teuthology.orchestra.run.smithi155.stdout: "type_data": { 2023-08-01T19:56:08.751 INFO:teuthology.orchestra.run.smithi155.stdout: "flag_point": "commit sent; apply or cleanup", 2023-08-01T19:56:08.751 INFO:teuthology.orchestra.run.smithi155.stdout: "client_info": { 2023-08-01T19:56:08.752 INFO:teuthology.orchestra.run.smithi155.stdout: "client": "client.4668", 2023-08-01T19:56:08.752 INFO:teuthology.orchestra.run.smithi155.stdout: "client_addr": "172.21.15.6:0/1709472247", 2023-08-01T19:56:08.752 INFO:teuthology.orchestra.run.smithi155.stdout: "tid": 100935 2023-08-01T19:56:08.752 INFO:teuthology.orchestra.run.smithi155.stdout: }, 2023-08-01T19:56:08.752 INFO:teuthology.orchestra.run.smithi155.stdout: "events": [ 2023-08-01T19:56:08.752 INFO:teuthology.orchestra.run.smithi155.stdout: { 2023-08-01T19:56:08.752 INFO:teuthology.orchestra.run.smithi155.stdout: "event": "initiated", 2023-08-01T19:56:08.752 INFO:teuthology.orchestra.run.smithi155.stdout: "time": "2023-08-01T19:55:05.566666+0000", 2023-08-01T19:56:08.753 INFO:teuthology.orchestra.run.smithi155.stdout: "duration": 0 2023-08-01T19:56:08.753 INFO:teuthology.orchestra.run.smithi155.stdout: }, 2023-08-01T19:56:08.753 INFO:teuthology.orchestra.run.smithi155.stdout: { 2023-08-01T19:56:08.753 INFO:teuthology.orchestra.run.smithi155.stdout: "event": "throttled", 2023-08-01T19:56:08.753 INFO:teuthology.orchestra.run.smithi155.stdout: "time": "2023-08-01T19:55:05.566666+0000", 2023-08-01T19:56:08.753 INFO:teuthology.orchestra.run.smithi155.stdout: "duration": 0 2023-08-01T19:56:08.753 INFO:teuthology.orchestra.run.smithi155.stdout: }, 2023-08-01T19:56:08.753 INFO:teuthology.orchestra.run.smithi155.stdout: { 2023-08-01T19:56:08.754 INFO:teuthology.orchestra.run.smithi155.stdout: "event": "header_read", 2023-08-01T19:56:08.754 INFO:teuthology.orchestra.run.smithi155.stdout: "time": "2023-08-01T19:55:05.566665+0000", 2023-08-01T19:56:08.754 INFO:teuthology.orchestra.run.smithi155.stdout: "duration": 4294967295.9999986 2023-08-01T19:56:08.754 INFO:teuthology.orchestra.run.smithi155.stdout: }, 2023-08-01T19:56:08.754 INFO:teuthology.orchestra.run.smithi155.stdout: { 2023-08-01T19:56:08.754 INFO:teuthology.orchestra.run.smithi155.stdout: "event": "all_read", 2023-08-01T19:56:08.754 INFO:teuthology.orchestra.run.smithi155.stdout: "time": "2023-08-01T19:55:05.566754+0000", 2023-08-01T19:56:08.754 INFO:teuthology.orchestra.run.smithi155.stdout: "duration": 8.9425999999999994e-05 2023-08-01T19:56:08.755 INFO:teuthology.orchestra.run.smithi155.stdout: }, 2023-08-01T19:56:08.755 INFO:teuthology.orchestra.run.smithi155.stdout: { 2023-08-01T19:56:08.755 INFO:teuthology.orchestra.run.smithi155.stdout: "event": "dispatched", 2023-08-01T19:56:08.755 INFO:teuthology.orchestra.run.smithi155.stdout: "time": "2023-08-01T19:55:05.566766+0000", 2023-08-01T19:56:08.755 INFO:teuthology.orchestra.run.smithi155.stdout: "duration": 1.2018000000000001e-05 2023-08-01T19:56:08.755 INFO:teuthology.orchestra.run.smithi155.stdout: }, 2023-08-01T19:56:08.755 INFO:teuthology.orchestra.run.smithi155.stdout: { 2023-08-01T19:56:08.755 INFO:teuthology.orchestra.run.smithi155.stdout: "event": "queued_for_pg", 2023-08-01T19:56:08.756 INFO:teuthology.orchestra.run.smithi155.stdout: "time": "2023-08-01T19:55:05.566772+0000", 2023-08-01T19:56:08.756 INFO:teuthology.orchestra.run.smithi155.stdout: "duration": 6.0190000000000003e-06 2023-08-01T19:56:08.756 INFO:teuthology.orchestra.run.smithi155.stdout: }, 2023-08-01T19:56:08.756 INFO:teuthology.orchestra.run.smithi155.stdout: { 2023-08-01T19:56:08.756 INFO:teuthology.orchestra.run.smithi155.stdout: "event": "reached_pg", 2023-08-01T19:56:08.756 INFO:teuthology.orchestra.run.smithi155.stdout: "time": "2023-08-01T19:55:05.566800+0000", 2023-08-01T19:56:08.756 INFO:teuthology.orchestra.run.smithi155.stdout: "duration": 2.7835999999999999e-05 2023-08-01T19:56:08.757 INFO:teuthology.orchestra.run.smithi155.stdout: }, 2023-08-01T19:56:08.757 INFO:teuthology.orchestra.run.smithi155.stdout: { 2023-08-01T19:56:08.757 INFO:teuthology.orchestra.run.smithi155.stdout: "event": "started", 2023-08-01T19:56:08.757 INFO:teuthology.orchestra.run.smithi155.stdout: "time": "2023-08-01T19:55:05.566879+0000", 2023-08-01T19:56:08.757 INFO:teuthology.orchestra.run.smithi155.stdout: "duration": 7.9105999999999998e-05 2023-08-01T19:56:08.757 INFO:teuthology.orchestra.run.smithi155.stdout: }, 2023-08-01T19:56:08.757 INFO:teuthology.orchestra.run.smithi155.stdout: { 2023-08-01T19:56:08.757 INFO:teuthology.orchestra.run.smithi155.stdout: "event": "waiting for subops from 0", 2023-08-01T19:56:08.758 INFO:teuthology.orchestra.run.smithi155.stdout: "time": "2023-08-01T19:55:05.566971+0000", 2023-08-01T19:56:08.758 INFO:teuthology.orchestra.run.smithi155.stdout: "duration": 9.1817999999999994e-05 2023-08-01T19:56:08.758 INFO:teuthology.orchestra.run.smithi155.stdout: }, 2023-08-01T19:56:08.758 INFO:teuthology.orchestra.run.smithi155.stdout: { 2023-08-01T19:56:08.758 INFO:teuthology.orchestra.run.smithi155.stdout: "event": "op_commit", 2023-08-01T19:56:08.758 INFO:teuthology.orchestra.run.smithi155.stdout: "time": "2023-08-01T19:55:05.571475+0000", 2023-08-01T19:56:08.758 INFO:teuthology.orchestra.run.smithi155.stdout: "duration": 0.0045039499999999996 2023-08-01T19:56:08.758 INFO:teuthology.orchestra.run.smithi155.stdout: }, 2023-08-01T19:56:08.759 INFO:teuthology.orchestra.run.smithi155.stdout: { 2023-08-01T19:56:08.759 INFO:teuthology.orchestra.run.smithi155.stdout: "event": "sub_op_commit_rec", 2023-08-01T19:56:08.759 INFO:teuthology.orchestra.run.smithi155.stdout: "time": "2023-08-01T19:55:05.630884+0000", 2023-08-01T19:56:08.759 INFO:teuthology.orchestra.run.smithi155.stdout: "duration": 0.059409181999999998 2023-08-01T19:56:08.759 INFO:teuthology.orchestra.run.smithi155.stdout: }, 2023-08-01T19:56:08.759 INFO:teuthology.orchestra.run.smithi155.stdout: { 2023-08-01T19:56:08.759 INFO:teuthology.orchestra.run.smithi155.stdout: "event": "commit_sent", 2023-08-01T19:56:08.759 INFO:teuthology.orchestra.run.smithi155.stdout: "time": "2023-08-01T19:55:05.630930+0000", 2023-08-01T19:56:08.760 INFO:teuthology.orchestra.run.smithi155.stdout: "duration": 4.5507999999999999e-05 2023-08-01T19:56:08.760 INFO:teuthology.orchestra.run.smithi155.stdout: }, 2023-08-01T19:56:08.760 INFO:teuthology.orchestra.run.smithi155.stdout: { 2023-08-01T19:56:08.760 INFO:teuthology.orchestra.run.smithi155.stdout: "event": "done", 2023-08-01T19:56:08.760 INFO:teuthology.orchestra.run.smithi155.stdout: "time": "2023-08-01T19:55:05.630975+0000", 2023-08-01T19:56:08.760 INFO:teuthology.orchestra.run.smithi155.stdout: "duration": 4.5441000000000001e-05 2023-08-01T19:56:08.760 INFO:teuthology.orchestra.run.smithi155.stdout: } 2023-08-01T19:56:08.760 INFO:teuthology.orchestra.run.smithi155.stdout: ] 2023-08-01T19:56:08.761 INFO:teuthology.orchestra.run.smithi155.stdout: } 2023-08-01T19:56:08.761 INFO:teuthology.orchestra.run.smithi155.stdout: }, 2023-08-01T19:56:08.761 INFO:teuthology.orchestra.run.smithi155.stdout: { 2023-08-01T19:56:08.761 INFO:teuthology.orchestra.run.smithi155.stdout: "description": "osd_op(client.4668.0:100941 5.e 5:736a6ac6:::benchmark_data_smithi006_114134_object100940:head [set-alloc-hint object_size 65536 write_size 65536,write 0~65536] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e37)", 2023-08-01T19:56:08.761 INFO:teuthology.orchestra.run.smithi155.stdout: "initiated_at": "2023-08-01T19:55:05.569750+0000", 2023-08-01T19:56:08.761 INFO:teuthology.orchestra.run.smithi155.stdout: "age": 63.066027493999997, 2023-08-01T19:56:08.761 INFO:teuthology.orchestra.run.smithi155.stdout: "duration": 0.065431331999999995, 2023-08-01T19:56:08.762 INFO:teuthology.orchestra.run.smithi155.stdout: "type_data": { 2023-08-01T19:56:08.762 INFO:teuthology.orchestra.run.smithi155.stdout: "flag_point": "commit sent; apply or cleanup", 2023-08-01T19:56:08.762 INFO:teuthology.orchestra.run.smithi155.stdout: "client_info": { 2023-08-01T19:56:08.762 INFO:teuthology.orchestra.run.smithi155.stdout: "client": "client.4668", 2023-08-01T19:56:08.762 INFO:teuthology.orchestra.run.smithi155.stdout: "client_addr": "172.21.15.6:0/1709472247", 2023-08-01T19:56:08.762 INFO:teuthology.orchestra.run.smithi155.stdout: "tid": 100941 2023-08-01T19:56:08.762 INFO:teuthology.orchestra.run.smithi155.stdout: }, 2023-08-01T19:56:08.762 INFO:teuthology.orchestra.run.smithi155.stdout: "events": [ 2023-08-01T19:56:08.763 INFO:teuthology.orchestra.run.smithi155.stdout: { 2023-08-01T19:56:08.763 INFO:teuthology.orchestra.run.smithi155.stdout: "event": "initiated", 2023-08-01T19:56:08.763 INFO:teuthology.orchestra.run.smithi155.stdout: "time": "2023-08-01T19:55:05.569750+0000", 2023-08-01T19:56:08.763 INFO:teuthology.orchestra.run.smithi155.stdout: "duration": 0 2023-08-01T19:56:08.763 INFO:teuthology.orchestra.run.smithi155.stdout: }, 2023-08-01T19:56:08.763 INFO:teuthology.orchestra.run.smithi155.stdout: { 2023-08-01T19:56:08.763 INFO:teuthology.orchestra.run.smithi155.stdout: "event": "throttled", 2023-08-01T19:56:08.763 INFO:teuthology.orchestra.run.smithi155.stdout: "time": "2023-08-01T19:55:05.569750+0000", 2023-08-01T19:56:08.764 INFO:teuthology.orchestra.run.smithi155.stdout: "duration": 0 2023-08-01T19:56:08.764 INFO:teuthology.orchestra.run.smithi155.stdout: }, 2023-08-01T19:56:08.764 INFO:teuthology.orchestra.run.smithi155.stdout: { 2023-08-01T19:56:08.764 INFO:teuthology.orchestra.run.smithi155.stdout: "event": "header_read", 2023-08-01T19:56:08.764 INFO:teuthology.orchestra.run.smithi155.stdout: "time": "2023-08-01T19:55:05.569749+0000", 2023-08-01T19:56:08.764 INFO:teuthology.orchestra.run.smithi155.stdout: "duration": 4294967295.999999 2023-08-01T19:56:08.764 INFO:teuthology.orchestra.run.smithi155.stdout: }, 2023-08-01T19:56:08.764 INFO:teuthology.orchestra.run.smithi155.stdout: { 2023-08-01T19:56:08.765 INFO:teuthology.orchestra.run.smithi155.stdout: "event": "all_read", 2023-08-01T19:56:08.765 INFO:teuthology.orchestra.run.smithi155.stdout: "time": "2023-08-01T19:55:05.569861+0000", 2023-08-01T19:56:08.765 INFO:teuthology.orchestra.run.smithi155.stdout: "duration": 0.000111333 2023-08-01T19:56:08.765 INFO:teuthology.orchestra.run.smithi155.stdout: }, 2023-08-01T19:56:08.765 INFO:teuthology.orchestra.run.smithi155.stdout: { 2023-08-01T19:56:08.765 INFO:teuthology.orchestra.run.smithi155.stdout: "event": "dispatched", 2023-08-01T19:56:08.765 INFO:teuthology.orchestra.run.smithi155.stdout: "time": "2023-08-01T19:55:05.569869+0000", 2023-08-01T19:56:08.765 INFO:teuthology.orchestra.run.smithi155.stdout: "duration": 8.8589999999999994e-06 2023-08-01T19:56:08.766 INFO:teuthology.orchestra.run.smithi155.stdout: }, 2023-08-01T19:56:08.766 INFO:teuthology.orchestra.run.smithi155.stdout: { 2023-08-01T19:56:08.766 INFO:teuthology.orchestra.run.smithi155.stdout: "event": "queued_for_pg", 2023-08-01T19:56:08.766 INFO:teuthology.orchestra.run.smithi155.stdout: "time": "2023-08-01T19:55:05.569874+0000", 2023-08-01T19:56:08.766 INFO:teuthology.orchestra.run.smithi155.stdout: "duration": 4.1679999999999997e-06 2023-08-01T19:56:08.766 INFO:teuthology.orchestra.run.smithi155.stdout: }, 2023-08-01T19:56:08.766 INFO:teuthology.orchestra.run.smithi155.stdout: { 2023-08-01T19:56:08.767 INFO:teuthology.orchestra.run.smithi155.stdout: "event": "reached_pg", 2023-08-01T19:56:08.767 INFO:teuthology.orchestra.run.smithi155.stdout: "time": "2023-08-01T19:55:05.569904+0000", 2023-08-01T19:56:08.767 INFO:teuthology.orchestra.run.smithi155.stdout: "duration": 3.0920999999999998e-05 2023-08-01T19:56:08.767 INFO:teuthology.orchestra.run.smithi155.stdout: }, 2023-08-01T19:56:08.767 INFO:teuthology.orchestra.run.smithi155.stdout: { 2023-08-01T19:56:08.767 INFO:teuthology.orchestra.run.smithi155.stdout: "event": "started", 2023-08-01T19:56:08.767 INFO:teuthology.orchestra.run.smithi155.stdout: "time": "2023-08-01T19:55:05.569998+0000", 2023-08-01T19:56:08.767 INFO:teuthology.orchestra.run.smithi155.stdout: "duration": 9.3086999999999998e-05 2023-08-01T19:56:08.768 INFO:teuthology.orchestra.run.smithi155.stdout: }, 2023-08-01T19:56:08.768 INFO:teuthology.orchestra.run.smithi155.stdout: { 2023-08-01T19:56:08.768 INFO:teuthology.orchestra.run.smithi155.stdout: "event": "waiting for subops from 0", 2023-08-01T19:56:08.768 INFO:teuthology.orchestra.run.smithi155.stdout: "time": "2023-08-01T19:55:05.570093+0000", 2023-08-01T19:56:08.768 INFO:teuthology.orchestra.run.smithi155.stdout: "duration": 9.5768999999999997e-05 2023-08-01T19:56:08.768 INFO:teuthology.orchestra.run.smithi155.stdout: }, 2023-08-01T19:56:08.768 INFO:teuthology.orchestra.run.smithi155.stdout: { 2023-08-01T19:56:08.768 INFO:teuthology.orchestra.run.smithi155.stdout: "event": "op_commit", 2023-08-01T19:56:08.769 INFO:teuthology.orchestra.run.smithi155.stdout: "time": "2023-08-01T19:55:05.572839+0000", 2023-08-01T19:56:08.769 INFO:teuthology.orchestra.run.smithi155.stdout: "duration": 0.0027460050000000001 2023-08-01T19:56:08.769 INFO:teuthology.orchestra.run.smithi155.stdout: }, 2023-08-01T19:56:08.769 INFO:teuthology.orchestra.run.smithi155.stdout: { 2023-08-01T19:56:08.769 INFO:teuthology.orchestra.run.smithi155.stdout: "event": "sub_op_commit_rec", 2023-08-01T19:56:08.769 INFO:teuthology.orchestra.run.smithi155.stdout: "time": "2023-08-01T19:55:05.635114+0000", 2023-08-01T19:56:08.769 INFO:teuthology.orchestra.run.smithi155.stdout: "duration": 0.062274297999999999 2023-08-01T19:56:08.769 INFO:teuthology.orchestra.run.smithi155.stdout: }, 2023-08-01T19:56:08.770 INFO:teuthology.orchestra.run.smithi155.stdout: { 2023-08-01T19:56:08.770 INFO:teuthology.orchestra.run.smithi155.stdout: "event": "commit_sent", 2023-08-01T19:56:08.770 INFO:teuthology.orchestra.run.smithi155.stdout: "time": "2023-08-01T19:55:05.635143+0000", 2023-08-01T19:56:08.770 INFO:teuthology.orchestra.run.smithi155.stdout: "duration": 2.9430000000000001e-05 2023-08-01T19:56:08.770 INFO:teuthology.orchestra.run.smithi155.stdout: }, 2023-08-01T19:56:08.770 INFO:teuthology.orchestra.run.smithi155.stdout: { 2023-08-01T19:56:08.770 INFO:teuthology.orchestra.run.smithi155.stdout: "event": "done", 2023-08-01T19:56:08.770 INFO:teuthology.orchestra.run.smithi155.stdout: "time": "2023-08-01T19:55:05.635181+0000", 2023-08-01T19:56:08.771 INFO:teuthology.orchestra.run.smithi155.stdout: "duration": 3.8352000000000001e-05 2023-08-01T19:56:08.771 INFO:teuthology.orchestra.run.smithi155.stdout: } 2023-08-01T19:56:08.771 INFO:teuthology.orchestra.run.smithi155.stdout: ] 2023-08-01T19:56:08.771 INFO:teuthology.orchestra.run.smithi155.stdout: } 2023-08-01T19:56:08.771 INFO:teuthology.orchestra.run.smithi155.stdout: }, 2023-08-01T19:56:08.771 INFO:teuthology.orchestra.run.smithi155.stdout: { 2023-08-01T19:56:08.771 INFO:teuthology.orchestra.run.smithi155.stdout: "description": "osd_op(client.4668.0:100945 5.e 5:73df68dd:::benchmark_data_smithi006_114134_object100944:head [set-alloc-hint object_size 65536 write_size 65536,write 0~65536] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e37)", 2023-08-01T19:56:08.771 INFO:teuthology.orchestra.run.smithi155.stdout: "initiated_at": "2023-08-01T19:55:05.576784+0000", 2023-08-01T19:56:08.772 INFO:teuthology.orchestra.run.smithi155.stdout: "age": 63.058993909000002, 2023-08-01T19:56:08.772 INFO:teuthology.orchestra.run.smithi155.stdout: "duration": 0.058512994999999998, 2023-08-01T19:56:08.772 INFO:teuthology.orchestra.run.smithi155.stdout: "type_data": { 2023-08-01T19:56:08.772 INFO:teuthology.orchestra.run.smithi155.stdout: "flag_point": "commit sent; apply or cleanup", 2023-08-01T19:56:08.772 INFO:teuthology.orchestra.run.smithi155.stdout: "client_info": { 2023-08-01T19:56:08.772 INFO:teuthology.orchestra.run.smithi155.stdout: "client": "client.4668", 2023-08-01T19:56:08.772 INFO:teuthology.orchestra.run.smithi155.stdout: "client_addr": "172.21.15.6:0/1709472247", 2023-08-01T19:56:08.773 INFO:teuthology.orchestra.run.smithi155.stdout: "tid": 100945 2023-08-01T19:56:08.773 INFO:teuthology.orchestra.run.smithi155.stdout: }, 2023-08-01T19:56:08.773 INFO:teuthology.orchestra.run.smithi155.stdout: "events": [ 2023-08-01T19:56:08.773 INFO:teuthology.orchestra.run.smithi155.stdout: { 2023-08-01T19:56:08.773 INFO:teuthology.orchestra.run.smithi155.stdout: "event": "initiated", 2023-08-01T19:56:08.773 INFO:teuthology.orchestra.run.smithi155.stdout: "time": "2023-08-01T19:55:05.576784+0000", 2023-08-01T19:56:08.773 INFO:teuthology.orchestra.run.smithi155.stdout: "duration": 0 2023-08-01T19:56:08.773 INFO:teuthology.orchestra.run.smithi155.stdout: }, 2023-08-01T19:56:08.774 INFO:teuthology.orchestra.run.smithi155.stdout: { 2023-08-01T19:56:08.774 INFO:teuthology.orchestra.run.smithi155.stdout: "event": "throttled", 2023-08-01T19:56:08.774 INFO:teuthology.orchestra.run.smithi155.stdout: "time": "2023-08-01T19:55:05.576784+0000", 2023-08-01T19:56:08.774 INFO:teuthology.orchestra.run.smithi155.stdout: "duration": 0 2023-08-01T19:56:08.774 INFO:teuthology.orchestra.run.smithi155.stdout: }, 2023-08-01T19:56:08.774 INFO:teuthology.orchestra.run.smithi155.stdout: { 2023-08-01T19:56:08.774 INFO:teuthology.orchestra.run.smithi155.stdout: "event": "header_read", 2023-08-01T19:56:08.774 INFO:teuthology.orchestra.run.smithi155.stdout: "time": "2023-08-01T19:55:05.576783+0000", 2023-08-01T19:56:08.775 INFO:teuthology.orchestra.run.smithi155.stdout: "duration": 4294967295.9999995 2023-08-01T19:56:08.775 INFO:teuthology.orchestra.run.smithi155.stdout: }, 2023-08-01T19:56:08.775 INFO:teuthology.orchestra.run.smithi155.stdout: { 2023-08-01T19:56:08.775 INFO:teuthology.orchestra.run.smithi155.stdout: "event": "all_read", 2023-08-01T19:56:08.775 INFO:teuthology.orchestra.run.smithi155.stdout: "time": "2023-08-01T19:55:05.576807+0000", 2023-08-01T19:56:08.775 INFO:teuthology.orchestra.run.smithi155.stdout: "duration": 2.3651000000000001e-05 2023-08-01T19:56:08.775 INFO:teuthology.orchestra.run.smithi155.stdout: }, 2023-08-01T19:56:08.775 INFO:teuthology.orchestra.run.smithi155.stdout: { 2023-08-01T19:56:08.776 INFO:teuthology.orchestra.run.smithi155.stdout: "event": "dispatched", 2023-08-01T19:56:08.776 INFO:teuthology.orchestra.run.smithi155.stdout: "time": "2023-08-01T19:55:05.576817+0000", 2023-08-01T19:56:08.776 INFO:teuthology.orchestra.run.smithi155.stdout: "duration": 9.9389999999999992e-06 2023-08-01T19:56:08.776 INFO:teuthology.orchestra.run.smithi155.stdout: }, 2023-08-01T19:56:08.776 INFO:teuthology.orchestra.run.smithi155.stdout: { 2023-08-01T19:56:08.776 INFO:teuthology.orchestra.run.smithi155.stdout: "event": "queued_for_pg", 2023-08-01T19:56:08.776 INFO:teuthology.orchestra.run.smithi155.stdout: "time": "2023-08-01T19:55:05.576820+0000", 2023-08-01T19:56:08.777 INFO:teuthology.orchestra.run.smithi155.stdout: "duration": 3.2619999999999999e-06 2023-08-01T19:56:08.777 INFO:teuthology.orchestra.run.smithi155.stdout: }, 2023-08-01T19:56:08.777 INFO:teuthology.orchestra.run.smithi155.stdout: { 2023-08-01T19:56:08.777 INFO:teuthology.orchestra.run.smithi155.stdout: "event": "reached_pg", 2023-08-01T19:56:08.777 INFO:teuthology.orchestra.run.smithi155.stdout: "time": "2023-08-01T19:55:05.576849+0000", 2023-08-01T19:56:08.777 INFO:teuthology.orchestra.run.smithi155.stdout: "duration": 2.8880000000000001e-05 2023-08-01T19:56:08.777 INFO:teuthology.orchestra.run.smithi155.stdout: }, 2023-08-01T19:56:08.777 INFO:teuthology.orchestra.run.smithi155.stdout: { 2023-08-01T19:56:08.778 INFO:teuthology.orchestra.run.smithi155.stdout: "event": "started", 2023-08-01T19:56:08.778 INFO:teuthology.orchestra.run.smithi155.stdout: "time": "2023-08-01T19:55:05.576940+0000", 2023-08-01T19:56:08.778 INFO:teuthology.orchestra.run.smithi155.stdout: "duration": 9.0570999999999997e-05 2023-08-01T19:56:08.778 INFO:teuthology.orchestra.run.smithi155.stdout: }, 2023-08-01T19:56:08.778 INFO:teuthology.orchestra.run.smithi155.stdout: { 2023-08-01T19:56:08.778 INFO:teuthology.orchestra.run.smithi155.stdout: "event": "waiting for subops from 0", 2023-08-01T19:56:08.778 INFO:teuthology.orchestra.run.smithi155.stdout: "time": "2023-08-01T19:55:05.577027+0000", 2023-08-01T19:56:08.778 INFO:teuthology.orchestra.run.smithi155.stdout: "duration": 8.7237999999999994e-05 2023-08-01T19:56:08.779 INFO:teuthology.orchestra.run.smithi155.stdout: }, 2023-08-01T19:56:08.779 INFO:teuthology.orchestra.run.smithi155.stdout: { 2023-08-01T19:56:08.779 INFO:teuthology.orchestra.run.smithi155.stdout: "event": "op_commit", 2023-08-01T19:56:08.779 INFO:teuthology.orchestra.run.smithi155.stdout: "time": "2023-08-01T19:55:05.579624+0000", 2023-08-01T19:56:08.779 INFO:teuthology.orchestra.run.smithi155.stdout: "duration": 0.0025971200000000001 2023-08-01T19:56:08.779 INFO:teuthology.orchestra.run.smithi155.stdout: }, 2023-08-01T19:56:08.779 INFO:teuthology.orchestra.run.smithi155.stdout: { 2023-08-01T19:56:08.779 INFO:teuthology.orchestra.run.smithi155.stdout: "event": "sub_op_commit_rec", 2023-08-01T19:56:08.780 INFO:teuthology.orchestra.run.smithi155.stdout: "time": "2023-08-01T19:55:05.635218+0000", 2023-08-01T19:56:08.780 INFO:teuthology.orchestra.run.smithi155.stdout: "duration": 0.055594487999999997 2023-08-01T19:56:08.780 INFO:teuthology.orchestra.run.smithi155.stdout: }, 2023-08-01T19:56:08.780 INFO:teuthology.orchestra.run.smithi155.stdout: { 2023-08-01T19:56:08.780 INFO:teuthology.orchestra.run.smithi155.stdout: "event": "commit_sent", 2023-08-01T19:56:08.780 INFO:teuthology.orchestra.run.smithi155.stdout: "time": "2023-08-01T19:55:05.635262+0000", 2023-08-01T19:56:08.780 INFO:teuthology.orchestra.run.smithi155.stdout: "duration": 4.3380999999999997e-05 2023-08-01T19:56:08.780 INFO:teuthology.orchestra.run.smithi155.stdout: }, 2023-08-01T19:56:08.781 INFO:teuthology.orchestra.run.smithi155.stdout: { 2023-08-01T19:56:08.781 INFO:teuthology.orchestra.run.smithi155.stdout: "event": "done", 2023-08-01T19:56:08.781 INFO:teuthology.orchestra.run.smithi155.stdout: "time": "2023-08-01T19:55:05.635297+0000", 2023-08-01T19:56:08.781 INFO:teuthology.orchestra.run.smithi155.stdout: "duration": 3.4842000000000003e-05 2023-08-01T19:56:08.781 INFO:teuthology.orchestra.run.smithi155.stdout: } 2023-08-01T19:56:08.781 INFO:teuthology.orchestra.run.smithi155.stdout: ] 2023-08-01T19:56:08.781 INFO:teuthology.orchestra.run.smithi155.stdout: } 2023-08-01T19:56:08.781 INFO:teuthology.orchestra.run.smithi155.stdout: }, 2023-08-01T19:56:08.782 INFO:teuthology.orchestra.run.smithi155.stdout: { 2023-08-01T19:56:08.782 INFO:teuthology.orchestra.run.smithi155.stdout: "description": "osd_op(client.4668.0:100947 5.4 5:23e8fc27:::benchmark_data_smithi006_114134_object100946:head [set-alloc-hint object_size 65536 write_size 65536,write 0~65536] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e37)", 2023-08-01T19:56:08.782 INFO:teuthology.orchestra.run.smithi155.stdout: "initiated_at": "2023-08-01T19:55:05.576840+0000", 2023-08-01T19:56:08.782 INFO:teuthology.orchestra.run.smithi155.stdout: "age": 63.058937854, 2023-08-01T19:56:08.782 INFO:teuthology.orchestra.run.smithi155.stdout: "duration": 0.058423127999999998, 2023-08-01T19:56:08.782 INFO:teuthology.orchestra.run.smithi155.stdout: "type_data": { 2023-08-01T19:56:08.782 INFO:teuthology.orchestra.run.smithi155.stdout: "flag_point": "commit sent; apply or cleanup", 2023-08-01T19:56:08.782 INFO:teuthology.orchestra.run.smithi155.stdout: "client_info": { 2023-08-01T19:56:08.783 INFO:teuthology.orchestra.run.smithi155.stdout: "client": "client.4668", 2023-08-01T19:56:08.783 INFO:teuthology.orchestra.run.smithi155.stdout: "client_addr": "172.21.15.6:0/1709472247", 2023-08-01T19:56:08.783 INFO:teuthology.orchestra.run.smithi155.stdout: "tid": 100947 2023-08-01T19:56:08.783 INFO:teuthology.orchestra.run.smithi155.stdout: }, 2023-08-01T19:56:08.783 INFO:teuthology.orchestra.run.smithi155.stdout: "events": [ 2023-08-01T19:56:08.783 INFO:teuthology.orchestra.run.smithi155.stdout: { 2023-08-01T19:56:08.783 INFO:teuthology.orchestra.run.smithi155.stdout: "event": "initiated", 2023-08-01T19:56:08.784 INFO:teuthology.orchestra.run.smithi155.stdout: "time": "2023-08-01T19:55:05.576840+0000", 2023-08-01T19:56:08.784 INFO:teuthology.orchestra.run.smithi155.stdout: "duration": 0 2023-08-01T19:56:08.784 INFO:teuthology.orchestra.run.smithi155.stdout: }, 2023-08-01T19:56:08.784 INFO:teuthology.orchestra.run.smithi155.stdout: { 2023-08-01T19:56:08.784 INFO:teuthology.orchestra.run.smithi155.stdout: "event": "throttled", 2023-08-01T19:56:08.784 INFO:teuthology.orchestra.run.smithi155.stdout: "time": "2023-08-01T19:55:05.576840+0000", 2023-08-01T19:56:08.784 INFO:teuthology.orchestra.run.smithi155.stdout: "duration": 0 2023-08-01T19:56:08.784 INFO:teuthology.orchestra.run.smithi155.stdout: }, 2023-08-01T19:56:08.785 INFO:teuthology.orchestra.run.smithi155.stdout: { 2023-08-01T19:56:08.785 INFO:teuthology.orchestra.run.smithi155.stdout: "event": "header_read", 2023-08-01T19:56:08.785 INFO:teuthology.orchestra.run.smithi155.stdout: "time": "2023-08-01T19:55:05.576839+0000", 2023-08-01T19:56:08.785 INFO:teuthology.orchestra.run.smithi155.stdout: "duration": 4294967295.9999995 2023-08-01T19:56:08.785 INFO:teuthology.orchestra.run.smithi155.stdout: }, 2023-08-01T19:56:08.785 INFO:teuthology.orchestra.run.smithi155.stdout: { 2023-08-01T19:56:08.785 INFO:teuthology.orchestra.run.smithi155.stdout: "event": "all_read", 2023-08-01T19:56:08.785 INFO:teuthology.orchestra.run.smithi155.stdout: "time": "2023-08-01T19:55:05.576893+0000", 2023-08-01T19:56:08.786 INFO:teuthology.orchestra.run.smithi155.stdout: "duration": 5.3893000000000001e-05 2023-08-01T19:56:08.786 INFO:teuthology.orchestra.run.smithi155.stdout: }, 2023-08-01T19:56:08.786 INFO:teuthology.orchestra.run.smithi155.stdout: { 2023-08-01T19:56:08.786 INFO:teuthology.orchestra.run.smithi155.stdout: "event": "dispatched", 2023-08-01T19:56:08.786 INFO:teuthology.orchestra.run.smithi155.stdout: "time": "2023-08-01T19:55:05.576902+0000", 2023-08-01T19:56:08.786 INFO:teuthology.orchestra.run.smithi155.stdout: "duration": 8.7520000000000002e-06 2023-08-01T19:56:08.786 INFO:teuthology.orchestra.run.smithi155.stdout: }, 2023-08-01T19:56:08.786 INFO:teuthology.orchestra.run.smithi155.stdout: { 2023-08-01T19:56:08.787 INFO:teuthology.orchestra.run.smithi155.stdout: "event": "queued_for_pg", 2023-08-01T19:56:08.787 INFO:teuthology.orchestra.run.smithi155.stdout: "time": "2023-08-01T19:55:05.576905+0000", 2023-08-01T19:56:08.787 INFO:teuthology.orchestra.run.smithi155.stdout: "duration": 3.01e-06 2023-08-01T19:56:08.787 INFO:teuthology.orchestra.run.smithi155.stdout: }, 2023-08-01T19:56:08.787 INFO:teuthology.orchestra.run.smithi155.stdout: { 2023-08-01T19:56:08.787 INFO:teuthology.orchestra.run.smithi155.stdout: "event": "reached_pg", 2023-08-01T19:56:08.787 INFO:teuthology.orchestra.run.smithi155.stdout: "time": "2023-08-01T19:55:05.579641+0000", 2023-08-01T19:56:08.787 INFO:teuthology.orchestra.run.smithi155.stdout: "duration": 0.0027366880000000001 2023-08-01T19:56:08.788 INFO:teuthology.orchestra.run.smithi155.stdout: }, 2023-08-01T19:56:08.788 INFO:teuthology.orchestra.run.smithi155.stdout: { 2023-08-01T19:56:08.788 INFO:teuthology.orchestra.run.smithi155.stdout: "event": "started", 2023-08-01T19:56:08.788 INFO:teuthology.orchestra.run.smithi155.stdout: "time": "2023-08-01T19:55:05.579734+0000", 2023-08-01T19:56:08.788 INFO:teuthology.orchestra.run.smithi155.stdout: "duration": 9.2590000000000006e-05 2023-08-01T19:56:08.788 INFO:teuthology.orchestra.run.smithi155.stdout: }, 2023-08-01T19:56:08.788 INFO:teuthology.orchestra.run.smithi155.stdout: { 2023-08-01T19:56:08.789 INFO:teuthology.orchestra.run.smithi155.stdout: "event": "waiting for subops from 0", 2023-08-01T19:56:08.789 INFO:teuthology.orchestra.run.smithi155.stdout: "time": "2023-08-01T19:55:05.579825+0000", 2023-08-01T19:56:08.789 INFO:teuthology.orchestra.run.smithi155.stdout: "duration": 9.0964999999999994e-05 2023-08-01T19:56:08.789 INFO:teuthology.orchestra.run.smithi155.stdout: }, 2023-08-01T19:56:08.789 INFO:teuthology.orchestra.run.smithi155.stdout: { 2023-08-01T19:56:08.789 INFO:teuthology.orchestra.run.smithi155.stdout: "event": "op_commit", 2023-08-01T19:56:08.789 INFO:teuthology.orchestra.run.smithi155.stdout: "time": "2023-08-01T19:55:05.585041+0000", 2023-08-01T19:56:08.789 INFO:teuthology.orchestra.run.smithi155.stdout: "duration": 0.0052159670000000002 2023-08-01T19:56:08.790 INFO:teuthology.orchestra.run.smithi155.stdout: }, 2023-08-01T19:56:08.790 INFO:teuthology.orchestra.run.smithi155.stdout: { 2023-08-01T19:56:08.790 INFO:teuthology.orchestra.run.smithi155.stdout: "event": "sub_op_commit_rec", 2023-08-01T19:56:08.790 INFO:teuthology.orchestra.run.smithi155.stdout: "time": "2023-08-01T19:55:05.635199+0000", 2023-08-01T19:56:08.790 INFO:teuthology.orchestra.run.smithi155.stdout: "duration": 0.050158023000000003 2023-08-01T19:56:08.790 INFO:teuthology.orchestra.run.smithi155.stdout: }, 2023-08-01T19:56:08.790 INFO:teuthology.orchestra.run.smithi155.stdout: { 2023-08-01T19:56:08.790 INFO:teuthology.orchestra.run.smithi155.stdout: "event": "commit_sent", 2023-08-01T19:56:08.791 INFO:teuthology.orchestra.run.smithi155.stdout: "time": "2023-08-01T19:55:05.635227+0000", 2023-08-01T19:56:08.791 INFO:teuthology.orchestra.run.smithi155.stdout: "duration": 2.7821e-05 2023-08-01T19:56:08.791 INFO:teuthology.orchestra.run.smithi155.stdout: }, 2023-08-01T19:56:08.791 INFO:teuthology.orchestra.run.smithi155.stdout: { 2023-08-01T19:56:08.791 INFO:teuthology.orchestra.run.smithi155.stdout: "event": "done", 2023-08-01T19:56:08.791 INFO:teuthology.orchestra.run.smithi155.stdout: "time": "2023-08-01T19:55:05.635263+0000", 2023-08-01T19:56:08.791 INFO:teuthology.orchestra.run.smithi155.stdout: "duration": 3.6081000000000002e-05 2023-08-01T19:56:08.791 INFO:teuthology.orchestra.run.smithi155.stdout: } 2023-08-01T19:56:08.792 INFO:teuthology.orchestra.run.smithi155.stdout: ] 2023-08-01T19:56:08.792 INFO:teuthology.orchestra.run.smithi155.stdout: } 2023-08-01T19:56:08.792 INFO:teuthology.orchestra.run.smithi155.stdout: }, 2023-08-01T19:56:08.792 INFO:teuthology.orchestra.run.smithi155.stdout: { 2023-08-01T19:56:08.792 INFO:teuthology.orchestra.run.smithi155.stdout: "description": "osd_op(client.4668.0:197408 5.d 5:bbda375a:::benchmark_data_smithi006_114134_object63747:head [delete] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e61)", 2023-08-01T19:56:08.792 INFO:teuthology.orchestra.run.smithi155.stdout: "initiated_at": "2023-08-01T19:55:58.559714+0000", 2023-08-01T19:56:08.792 INFO:teuthology.orchestra.run.smithi155.stdout: "age": 10.076063867, 2023-08-01T19:56:08.793 INFO:teuthology.orchestra.run.smithi155.stdout: "duration": 1.047043671, 2023-08-01T19:56:08.793 INFO:teuthology.orchestra.run.smithi155.stdout: "type_data": { 2023-08-01T19:56:08.793 INFO:teuthology.orchestra.run.smithi155.stdout: "flag_point": "commit sent; apply or cleanup", 2023-08-01T19:56:08.793 INFO:teuthology.orchestra.run.smithi155.stdout: "client_info": { 2023-08-01T19:56:08.793 INFO:teuthology.orchestra.run.smithi155.stdout: "client": "client.4668", 2023-08-01T19:56:08.793 INFO:teuthology.orchestra.run.smithi155.stdout: "client_addr": "172.21.15.6:0/1709472247", 2023-08-01T19:56:08.793 INFO:teuthology.orchestra.run.smithi155.stdout: "tid": 197408 2023-08-01T19:56:08.793 INFO:teuthology.orchestra.run.smithi155.stdout: }, 2023-08-01T19:56:08.794 INFO:teuthology.orchestra.run.smithi155.stdout: "events": [ 2023-08-01T19:56:08.794 INFO:teuthology.orchestra.run.smithi155.stdout: { 2023-08-01T19:56:08.794 INFO:teuthology.orchestra.run.smithi155.stdout: "event": "initiated", 2023-08-01T19:56:08.794 INFO:teuthology.orchestra.run.smithi155.stdout: "time": "2023-08-01T19:55:58.559714+0000", 2023-08-01T19:56:08.794 INFO:teuthology.orchestra.run.smithi155.stdout: "duration": 0 2023-08-01T19:56:08.794 INFO:teuthology.orchestra.run.smithi155.stdout: }, 2023-08-01T19:56:08.794 INFO:teuthology.orchestra.run.smithi155.stdout: { 2023-08-01T19:56:08.794 INFO:teuthology.orchestra.run.smithi155.stdout: "event": "throttled", 2023-08-01T19:56:08.795 INFO:teuthology.orchestra.run.smithi155.stdout: "time": "2023-08-01T19:55:58.559714+0000", 2023-08-01T19:56:08.795 INFO:teuthology.orchestra.run.smithi155.stdout: "duration": 0 2023-08-01T19:56:08.795 INFO:teuthology.orchestra.run.smithi155.stdout: }, 2023-08-01T19:56:08.795 INFO:teuthology.orchestra.run.smithi155.stdout: { 2023-08-01T19:56:08.795 INFO:teuthology.orchestra.run.smithi155.stdout: "event": "header_read", 2023-08-01T19:56:08.795 INFO:teuthology.orchestra.run.smithi155.stdout: "time": "2023-08-01T19:55:58.559713+0000", 2023-08-01T19:56:08.795 INFO:teuthology.orchestra.run.smithi155.stdout: "duration": 4294967295.999999 2023-08-01T19:56:08.795 INFO:teuthology.orchestra.run.smithi155.stdout: }, 2023-08-01T19:56:08.796 INFO:teuthology.orchestra.run.smithi155.stdout: { 2023-08-01T19:56:08.796 INFO:teuthology.orchestra.run.smithi155.stdout: "event": "all_read", 2023-08-01T19:56:08.796 INFO:teuthology.orchestra.run.smithi155.stdout: "time": "2023-08-01T19:55:58.559717+0000", 2023-08-01T19:56:08.796 INFO:teuthology.orchestra.run.smithi155.stdout: "duration": 4.2860000000000001e-06 2023-08-01T19:56:08.796 INFO:teuthology.orchestra.run.smithi155.stdout: }, 2023-08-01T19:56:08.796 INFO:teuthology.orchestra.run.smithi155.stdout: { 2023-08-01T19:56:08.796 INFO:teuthology.orchestra.run.smithi155.stdout: "event": "dispatched", 2023-08-01T19:56:08.796 INFO:teuthology.orchestra.run.smithi155.stdout: "time": "2023-08-01T19:55:58.559774+0000", 2023-08-01T19:56:08.797 INFO:teuthology.orchestra.run.smithi155.stdout: "duration": 5.6508999999999997e-05 2023-08-01T19:56:08.797 INFO:teuthology.orchestra.run.smithi155.stdout: }, 2023-08-01T19:56:08.797 INFO:teuthology.orchestra.run.smithi155.stdout: { 2023-08-01T19:56:08.797 INFO:teuthology.orchestra.run.smithi155.stdout: "event": "queued_for_pg", 2023-08-01T19:56:08.797 INFO:teuthology.orchestra.run.smithi155.stdout: "time": "2023-08-01T19:55:58.559781+0000", 2023-08-01T19:56:08.797 INFO:teuthology.orchestra.run.smithi155.stdout: "duration": 7.1829999999999997e-06 2023-08-01T19:56:08.797 INFO:teuthology.orchestra.run.smithi155.stdout: }, 2023-08-01T19:56:08.797 INFO:teuthology.orchestra.run.smithi155.stdout: { 2023-08-01T19:56:08.798 INFO:teuthology.orchestra.run.smithi155.stdout: "event": "reached_pg", 2023-08-01T19:56:08.798 INFO:teuthology.orchestra.run.smithi155.stdout: "time": "2023-08-01T19:55:58.571621+0000", 2023-08-01T19:56:08.798 INFO:teuthology.orchestra.run.smithi155.stdout: "duration": 0.011840603999999999 2023-08-01T19:56:08.798 INFO:teuthology.orchestra.run.smithi155.stdout: }, 2023-08-01T19:56:08.798 INFO:teuthology.orchestra.run.smithi155.stdout: { 2023-08-01T19:56:08.798 INFO:teuthology.orchestra.run.smithi155.stdout: "event": "waiting for peered", 2023-08-01T19:56:08.798 INFO:teuthology.orchestra.run.smithi155.stdout: "time": "2023-08-01T19:55:58.571630+0000", 2023-08-01T19:56:08.799 INFO:teuthology.orchestra.run.smithi155.stdout: "duration": 8.9770000000000006e-06 2023-08-01T19:56:08.799 INFO:teuthology.orchestra.run.smithi155.stdout: }, 2023-08-01T19:56:08.799 INFO:teuthology.orchestra.run.smithi155.stdout: { 2023-08-01T19:56:08.799 INFO:teuthology.orchestra.run.smithi155.stdout: "event": "reached_pg", 2023-08-01T19:56:08.799 INFO:teuthology.orchestra.run.smithi155.stdout: "time": "2023-08-01T19:55:59.601300+0000", 2023-08-01T19:56:08.799 INFO:teuthology.orchestra.run.smithi155.stdout: "duration": 1.0296694989999999 2023-08-01T19:56:08.799 INFO:teuthology.orchestra.run.smithi155.stdout: }, 2023-08-01T19:56:08.799 INFO:teuthology.orchestra.run.smithi155.stdout: { 2023-08-01T19:56:08.800 INFO:teuthology.orchestra.run.smithi155.stdout: "event": "started", 2023-08-01T19:56:08.800 INFO:teuthology.orchestra.run.smithi155.stdout: "time": "2023-08-01T19:55:59.601448+0000", 2023-08-01T19:56:08.800 INFO:teuthology.orchestra.run.smithi155.stdout: "duration": 0.00014828399999999999 2023-08-01T19:56:08.800 INFO:teuthology.orchestra.run.smithi155.stdout: }, 2023-08-01T19:56:08.800 INFO:teuthology.orchestra.run.smithi155.stdout: { 2023-08-01T19:56:08.800 INFO:teuthology.orchestra.run.smithi155.stdout: "event": "op_commit", 2023-08-01T19:56:08.800 INFO:teuthology.orchestra.run.smithi155.stdout: "time": "2023-08-01T19:55:59.606616+0000", 2023-08-01T19:56:08.800 INFO:teuthology.orchestra.run.smithi155.stdout: "duration": 0.0051679769999999998 2023-08-01T19:56:08.801 INFO:teuthology.orchestra.run.smithi155.stdout: }, 2023-08-01T19:56:08.801 INFO:teuthology.orchestra.run.smithi155.stdout: { 2023-08-01T19:56:08.801 INFO:teuthology.orchestra.run.smithi155.stdout: "event": "commit_sent", 2023-08-01T19:56:08.801 INFO:teuthology.orchestra.run.smithi155.stdout: "time": "2023-08-01T19:55:59.606662+0000", 2023-08-01T19:56:08.801 INFO:teuthology.orchestra.run.smithi155.stdout: "duration": 4.5843000000000001e-05 2023-08-01T19:56:08.801 INFO:teuthology.orchestra.run.smithi155.stdout: }, 2023-08-01T19:56:08.801 INFO:teuthology.orchestra.run.smithi155.stdout: { 2023-08-01T19:56:08.801 INFO:teuthology.orchestra.run.smithi155.stdout: "event": "done", 2023-08-01T19:56:08.802 INFO:teuthology.orchestra.run.smithi155.stdout: "time": "2023-08-01T19:55:59.606757+0000", 2023-08-01T19:56:08.802 INFO:teuthology.orchestra.run.smithi155.stdout: "duration": 9.5373999999999999e-05 2023-08-01T19:56:08.802 INFO:teuthology.orchestra.run.smithi155.stdout: } 2023-08-01T19:56:08.802 INFO:teuthology.orchestra.run.smithi155.stdout: ] 2023-08-01T19:56:08.802 INFO:teuthology.orchestra.run.smithi155.stdout: } 2023-08-01T19:56:08.802 INFO:teuthology.orchestra.run.smithi155.stdout: }, 2023-08-01T19:56:08.802 INFO:teuthology.orchestra.run.smithi155.stdout: { 2023-08-01T19:56:08.802 INFO:teuthology.orchestra.run.smithi155.stdout: "description": "osd_op(client.4668.0:197416 5.d 5:bd99e66d:::benchmark_data_smithi006_114134_object63755:head [delete] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e62)", 2023-08-01T19:56:08.803 INFO:teuthology.orchestra.run.smithi155.stdout: "initiated_at": "2023-08-01T19:55:58.577369+0000", 2023-08-01T19:56:08.803 INFO:teuthology.orchestra.run.smithi155.stdout: "age": 10.058408890000001, 2023-08-01T19:56:08.803 INFO:teuthology.orchestra.run.smithi155.stdout: "duration": 1.0300980120000001, 2023-08-01T19:56:08.803 INFO:teuthology.orchestra.run.smithi155.stdout: "type_data": { 2023-08-01T19:56:08.803 INFO:teuthology.orchestra.run.smithi155.stdout: "flag_point": "commit sent; apply or cleanup", 2023-08-01T19:56:08.803 INFO:teuthology.orchestra.run.smithi155.stdout: "client_info": { 2023-08-01T19:56:08.803 INFO:teuthology.orchestra.run.smithi155.stdout: "client": "client.4668", 2023-08-01T19:56:08.803 INFO:teuthology.orchestra.run.smithi155.stdout: "client_addr": "172.21.15.6:0/1709472247", 2023-08-01T19:56:08.804 INFO:teuthology.orchestra.run.smithi155.stdout: "tid": 197416 2023-08-01T19:56:08.804 INFO:teuthology.orchestra.run.smithi155.stdout: }, 2023-08-01T19:56:08.804 INFO:teuthology.orchestra.run.smithi155.stdout: "events": [ 2023-08-01T19:56:08.804 INFO:teuthology.orchestra.run.smithi155.stdout: { 2023-08-01T19:56:08.804 INFO:teuthology.orchestra.run.smithi155.stdout: "event": "initiated", 2023-08-01T19:56:08.804 INFO:teuthology.orchestra.run.smithi155.stdout: "time": "2023-08-01T19:55:58.577369+0000", 2023-08-01T19:56:08.804 INFO:teuthology.orchestra.run.smithi155.stdout: "duration": 0 2023-08-01T19:56:08.805 INFO:teuthology.orchestra.run.smithi155.stdout: }, 2023-08-01T19:56:08.805 INFO:teuthology.orchestra.run.smithi155.stdout: { 2023-08-01T19:56:08.805 INFO:teuthology.orchestra.run.smithi155.stdout: "event": "throttled", 2023-08-01T19:56:08.805 INFO:teuthology.orchestra.run.smithi155.stdout: "time": "2023-08-01T19:55:58.577369+0000", 2023-08-01T19:56:08.805 INFO:teuthology.orchestra.run.smithi155.stdout: "duration": 0 2023-08-01T19:56:08.805 INFO:teuthology.orchestra.run.smithi155.stdout: }, 2023-08-01T19:56:08.805 INFO:teuthology.orchestra.run.smithi155.stdout: { 2023-08-01T19:56:08.805 INFO:teuthology.orchestra.run.smithi155.stdout: "event": "header_read", 2023-08-01T19:56:08.806 INFO:teuthology.orchestra.run.smithi155.stdout: "time": "2023-08-01T19:55:58.577368+0000", 2023-08-01T19:56:08.806 INFO:teuthology.orchestra.run.smithi155.stdout: "duration": 4294967295.9999995 2023-08-01T19:56:08.806 INFO:teuthology.orchestra.run.smithi155.stdout: }, 2023-08-01T19:56:08.806 INFO:teuthology.orchestra.run.smithi155.stdout: { 2023-08-01T19:56:08.806 INFO:teuthology.orchestra.run.smithi155.stdout: "event": "all_read", 2023-08-01T19:56:08.806 INFO:teuthology.orchestra.run.smithi155.stdout: "time": "2023-08-01T19:55:58.577370+0000", 2023-08-01T19:56:08.806 INFO:teuthology.orchestra.run.smithi155.stdout: "duration": 2.1150000000000001e-06 2023-08-01T19:56:08.806 INFO:teuthology.orchestra.run.smithi155.stdout: }, 2023-08-01T19:56:08.807 INFO:teuthology.orchestra.run.smithi155.stdout: { 2023-08-01T19:56:08.807 INFO:teuthology.orchestra.run.smithi155.stdout: "event": "dispatched", 2023-08-01T19:56:08.807 INFO:teuthology.orchestra.run.smithi155.stdout: "time": "2023-08-01T19:55:58.577377+0000", 2023-08-01T19:56:08.807 INFO:teuthology.orchestra.run.smithi155.stdout: "duration": 6.6610000000000003e-06 2023-08-01T19:56:08.807 INFO:teuthology.orchestra.run.smithi155.stdout: }, 2023-08-01T19:56:08.807 INFO:teuthology.orchestra.run.smithi155.stdout: { 2023-08-01T19:56:08.807 INFO:teuthology.orchestra.run.smithi155.stdout: "event": "queued_for_pg", 2023-08-01T19:56:08.807 INFO:teuthology.orchestra.run.smithi155.stdout: "time": "2023-08-01T19:55:58.577380+0000", 2023-08-01T19:56:08.808 INFO:teuthology.orchestra.run.smithi155.stdout: "duration": 2.7360000000000001e-06 2023-08-01T19:56:08.808 INFO:teuthology.orchestra.run.smithi155.stdout: }, 2023-08-01T19:56:08.808 INFO:teuthology.orchestra.run.smithi155.stdout: { 2023-08-01T19:56:08.808 INFO:teuthology.orchestra.run.smithi155.stdout: "event": "reached_pg", 2023-08-01T19:56:08.808 INFO:teuthology.orchestra.run.smithi155.stdout: "time": "2023-08-01T19:55:58.577405+0000", 2023-08-01T19:56:08.808 INFO:teuthology.orchestra.run.smithi155.stdout: "duration": 2.4929000000000001e-05 2023-08-01T19:56:08.808 INFO:teuthology.orchestra.run.smithi155.stdout: }, 2023-08-01T19:56:08.808 INFO:teuthology.orchestra.run.smithi155.stdout: { 2023-08-01T19:56:08.809 INFO:teuthology.orchestra.run.smithi155.stdout: "event": "waiting for peered", 2023-08-01T19:56:08.809 INFO:teuthology.orchestra.run.smithi155.stdout: "time": "2023-08-01T19:55:58.577409+0000", 2023-08-01T19:56:08.809 INFO:teuthology.orchestra.run.smithi155.stdout: "duration": 4.0799999999999999e-06 2023-08-01T19:56:08.809 INFO:teuthology.orchestra.run.smithi155.stdout: }, 2023-08-01T19:56:08.809 INFO:teuthology.orchestra.run.smithi155.stdout: { 2023-08-01T19:56:08.809 INFO:teuthology.orchestra.run.smithi155.stdout: "event": "reached_pg", 2023-08-01T19:56:08.809 INFO:teuthology.orchestra.run.smithi155.stdout: "time": "2023-08-01T19:55:59.603639+0000", 2023-08-01T19:56:08.809 INFO:teuthology.orchestra.run.smithi155.stdout: "duration": 1.0262299349999999 2023-08-01T19:56:08.810 INFO:teuthology.orchestra.run.smithi155.stdout: }, 2023-08-01T19:56:08.810 INFO:teuthology.orchestra.run.smithi155.stdout: { 2023-08-01T19:56:08.810 INFO:teuthology.orchestra.run.smithi155.stdout: "event": "started", 2023-08-01T19:56:08.810 INFO:teuthology.orchestra.run.smithi155.stdout: "time": "2023-08-01T19:55:59.603772+0000", 2023-08-01T19:56:08.810 INFO:teuthology.orchestra.run.smithi155.stdout: "duration": 0.000133153 2023-08-01T19:56:08.810 INFO:teuthology.orchestra.run.smithi155.stdout: }, 2023-08-01T19:56:08.810 INFO:teuthology.orchestra.run.smithi155.stdout: { 2023-08-01T19:56:08.811 INFO:teuthology.orchestra.run.smithi155.stdout: "event": "op_commit", 2023-08-01T19:56:08.811 INFO:teuthology.orchestra.run.smithi155.stdout: "time": "2023-08-01T19:55:59.607354+0000", 2023-08-01T19:56:08.811 INFO:teuthology.orchestra.run.smithi155.stdout: "duration": 0.0035819599999999999 2023-08-01T19:56:08.811 INFO:teuthology.orchestra.run.smithi155.stdout: }, 2023-08-01T19:56:08.811 INFO:teuthology.orchestra.run.smithi155.stdout: { 2023-08-01T19:56:08.811 INFO:teuthology.orchestra.run.smithi155.stdout: "event": "commit_sent", 2023-08-01T19:56:08.811 INFO:teuthology.orchestra.run.smithi155.stdout: "time": "2023-08-01T19:55:59.607396+0000", 2023-08-01T19:56:08.811 INFO:teuthology.orchestra.run.smithi155.stdout: "duration": 4.2423999999999999e-05 2023-08-01T19:56:08.812 INFO:teuthology.orchestra.run.smithi155.stdout: }, 2023-08-01T19:56:08.812 INFO:teuthology.orchestra.run.smithi155.stdout: { 2023-08-01T19:56:08.812 INFO:teuthology.orchestra.run.smithi155.stdout: "event": "done", 2023-08-01T19:56:08.812 INFO:teuthology.orchestra.run.smithi155.stdout: "time": "2023-08-01T19:55:59.607467+0000", 2023-08-01T19:56:08.812 INFO:teuthology.orchestra.run.smithi155.stdout: "duration": 7.0360999999999999e-05 2023-08-01T19:56:08.812 INFO:teuthology.orchestra.run.smithi155.stdout: } 2023-08-01T19:56:08.812 INFO:teuthology.orchestra.run.smithi155.stdout: ] 2023-08-01T19:56:08.812 INFO:teuthology.orchestra.run.smithi155.stdout: } 2023-08-01T19:56:08.813 INFO:teuthology.orchestra.run.smithi155.stdout: }, 2023-08-01T19:56:08.813 INFO:teuthology.orchestra.run.smithi155.stdout: { 2023-08-01T19:56:08.813 INFO:teuthology.orchestra.run.smithi155.stdout: "description": "osd_op(client.4668.0:197419 5.d 5:be7dc7c9:::benchmark_data_smithi006_114134_object63758:head [delete] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e62)", 2023-08-01T19:56:08.813 INFO:teuthology.orchestra.run.smithi155.stdout: "initiated_at": "2023-08-01T19:55:58.580223+0000", 2023-08-01T19:56:08.813 INFO:teuthology.orchestra.run.smithi155.stdout: "age": 10.055554939, 2023-08-01T19:56:08.813 INFO:teuthology.orchestra.run.smithi155.stdout: "duration": 1.0286139439999999, 2023-08-01T19:56:08.813 INFO:teuthology.orchestra.run.smithi155.stdout: "type_data": { 2023-08-01T19:56:08.813 INFO:teuthology.orchestra.run.smithi155.stdout: "flag_point": "commit sent; apply or cleanup", 2023-08-01T19:56:08.814 INFO:teuthology.orchestra.run.smithi155.stdout: "client_info": { 2023-08-01T19:56:08.814 INFO:teuthology.orchestra.run.smithi155.stdout: "client": "client.4668", 2023-08-01T19:56:08.814 INFO:teuthology.orchestra.run.smithi155.stdout: "client_addr": "172.21.15.6:0/1709472247", 2023-08-01T19:56:08.814 INFO:teuthology.orchestra.run.smithi155.stdout: "tid": 197419 2023-08-01T19:56:08.814 INFO:teuthology.orchestra.run.smithi155.stdout: }, 2023-08-01T19:56:08.814 INFO:teuthology.orchestra.run.smithi155.stdout: "events": [ 2023-08-01T19:56:08.814 INFO:teuthology.orchestra.run.smithi155.stdout: { 2023-08-01T19:56:08.814 INFO:teuthology.orchestra.run.smithi155.stdout: "event": "initiated", 2023-08-01T19:56:08.815 INFO:teuthology.orchestra.run.smithi155.stdout: "time": "2023-08-01T19:55:58.580223+0000", 2023-08-01T19:56:08.815 INFO:teuthology.orchestra.run.smithi155.stdout: "duration": 0 2023-08-01T19:56:08.815 INFO:teuthology.orchestra.run.smithi155.stdout: }, 2023-08-01T19:56:08.815 INFO:teuthology.orchestra.run.smithi155.stdout: { 2023-08-01T19:56:08.815 INFO:teuthology.orchestra.run.smithi155.stdout: "event": "throttled", 2023-08-01T19:56:08.815 INFO:teuthology.orchestra.run.smithi155.stdout: "time": "2023-08-01T19:55:58.580223+0000", 2023-08-01T19:56:08.815 INFO:teuthology.orchestra.run.smithi155.stdout: "duration": 0 2023-08-01T19:56:08.815 INFO:teuthology.orchestra.run.smithi155.stdout: }, 2023-08-01T19:56:08.816 INFO:teuthology.orchestra.run.smithi155.stdout: { 2023-08-01T19:56:08.816 INFO:teuthology.orchestra.run.smithi155.stdout: "event": "header_read", 2023-08-01T19:56:08.816 INFO:teuthology.orchestra.run.smithi155.stdout: "time": "2023-08-01T19:55:58.580222+0000", 2023-08-01T19:56:08.816 INFO:teuthology.orchestra.run.smithi155.stdout: "duration": 4294967295.9999995 2023-08-01T19:56:08.816 INFO:teuthology.orchestra.run.smithi155.stdout: }, 2023-08-01T19:56:08.816 INFO:teuthology.orchestra.run.smithi155.stdout: { 2023-08-01T19:56:08.816 INFO:teuthology.orchestra.run.smithi155.stdout: "event": "all_read", 2023-08-01T19:56:08.817 INFO:teuthology.orchestra.run.smithi155.stdout: "time": "2023-08-01T19:55:58.580225+0000", 2023-08-01T19:56:08.817 INFO:teuthology.orchestra.run.smithi155.stdout: "duration": 3.2820000000000001e-06 2023-08-01T19:56:08.817 INFO:teuthology.orchestra.run.smithi155.stdout: }, 2023-08-01T19:56:08.817 INFO:teuthology.orchestra.run.smithi155.stdout: { 2023-08-01T19:56:08.817 INFO:teuthology.orchestra.run.smithi155.stdout: "event": "dispatched", 2023-08-01T19:56:08.817 INFO:teuthology.orchestra.run.smithi155.stdout: "time": "2023-08-01T19:55:58.580233+0000", 2023-08-01T19:56:08.817 INFO:teuthology.orchestra.run.smithi155.stdout: "duration": 7.34e-06 2023-08-01T19:56:08.817 INFO:teuthology.orchestra.run.smithi155.stdout: }, 2023-08-01T19:56:08.818 INFO:teuthology.orchestra.run.smithi155.stdout: { 2023-08-01T19:56:08.818 INFO:teuthology.orchestra.run.smithi155.stdout: "event": "queued_for_pg", 2023-08-01T19:56:08.818 INFO:teuthology.orchestra.run.smithi155.stdout: "time": "2023-08-01T19:55:58.580236+0000", 2023-08-01T19:56:08.818 INFO:teuthology.orchestra.run.smithi155.stdout: "duration": 3.473e-06 2023-08-01T19:56:08.818 INFO:teuthology.orchestra.run.smithi155.stdout: }, 2023-08-01T19:56:08.818 INFO:teuthology.orchestra.run.smithi155.stdout: { 2023-08-01T19:56:08.818 INFO:teuthology.orchestra.run.smithi155.stdout: "event": "reached_pg", 2023-08-01T19:56:08.818 INFO:teuthology.orchestra.run.smithi155.stdout: "time": "2023-08-01T19:55:58.580267+0000", 2023-08-01T19:56:08.819 INFO:teuthology.orchestra.run.smithi155.stdout: "duration": 3.0479000000000001e-05 2023-08-01T19:56:08.819 INFO:teuthology.orchestra.run.smithi155.stdout: }, 2023-08-01T19:56:08.819 INFO:teuthology.orchestra.run.smithi155.stdout: { 2023-08-01T19:56:08.819 INFO:teuthology.orchestra.run.smithi155.stdout: "event": "waiting for peered", 2023-08-01T19:56:08.819 INFO:teuthology.orchestra.run.smithi155.stdout: "time": "2023-08-01T19:55:58.580272+0000", 2023-08-01T19:56:08.819 INFO:teuthology.orchestra.run.smithi155.stdout: "duration": 5.011e-06 2023-08-01T19:56:08.819 INFO:teuthology.orchestra.run.smithi155.stdout: }, 2023-08-01T19:56:08.819 INFO:teuthology.orchestra.run.smithi155.stdout: { 2023-08-01T19:56:08.820 INFO:teuthology.orchestra.run.smithi155.stdout: "event": "reached_pg", 2023-08-01T19:56:08.820 INFO:teuthology.orchestra.run.smithi155.stdout: "time": "2023-08-01T19:55:59.604970+0000", 2023-08-01T19:56:08.820 INFO:teuthology.orchestra.run.smithi155.stdout: "duration": 1.0246984189999999 2023-08-01T19:56:08.820 INFO:teuthology.orchestra.run.smithi155.stdout: }, 2023-08-01T19:56:08.820 INFO:teuthology.orchestra.run.smithi155.stdout: { 2023-08-01T19:56:08.820 INFO:teuthology.orchestra.run.smithi155.stdout: "event": "started", 2023-08-01T19:56:08.820 INFO:teuthology.orchestra.run.smithi155.stdout: "time": "2023-08-01T19:55:59.605085+0000", 2023-08-01T19:56:08.821 INFO:teuthology.orchestra.run.smithi155.stdout: "duration": 0.00011531000000000001 2023-08-01T19:56:08.821 INFO:teuthology.orchestra.run.smithi155.stdout: }, 2023-08-01T19:56:08.821 INFO:teuthology.orchestra.run.smithi155.stdout: { 2023-08-01T19:56:08.821 INFO:teuthology.orchestra.run.smithi155.stdout: "event": "op_commit", 2023-08-01T19:56:08.821 INFO:teuthology.orchestra.run.smithi155.stdout: "time": "2023-08-01T19:55:59.608733+0000", 2023-08-01T19:56:08.821 INFO:teuthology.orchestra.run.smithi155.stdout: "duration": 0.0036478090000000001 2023-08-01T19:56:08.821 INFO:teuthology.orchestra.run.smithi155.stdout: }, 2023-08-01T19:56:08.821 INFO:teuthology.orchestra.run.smithi155.stdout: { 2023-08-01T19:56:08.822 INFO:teuthology.orchestra.run.smithi155.stdout: "event": "commit_sent", 2023-08-01T19:56:08.822 INFO:teuthology.orchestra.run.smithi155.stdout: "time": "2023-08-01T19:55:59.608771+0000", 2023-08-01T19:56:08.822 INFO:teuthology.orchestra.run.smithi155.stdout: "duration": 3.8033e-05 2023-08-01T19:56:08.822 INFO:teuthology.orchestra.run.smithi155.stdout: }, 2023-08-01T19:56:08.822 INFO:teuthology.orchestra.run.smithi155.stdout: { 2023-08-01T19:56:08.822 INFO:teuthology.orchestra.run.smithi155.stdout: "event": "done", 2023-08-01T19:56:08.822 INFO:teuthology.orchestra.run.smithi155.stdout: "time": "2023-08-01T19:55:59.608837+0000", 2023-08-01T19:56:08.822 INFO:teuthology.orchestra.run.smithi155.stdout: "duration": 6.5364000000000006e-05 2023-08-01T19:56:08.823 INFO:teuthology.orchestra.run.smithi155.stdout: } 2023-08-01T19:56:08.823 INFO:teuthology.orchestra.run.smithi155.stdout: ] 2023-08-01T19:56:08.823 INFO:teuthology.orchestra.run.smithi155.stdout: } 2023-08-01T19:56:08.823 INFO:teuthology.orchestra.run.smithi155.stdout: }, 2023-08-01T19:56:08.823 INFO:teuthology.orchestra.run.smithi155.stdout: { 2023-08-01T19:56:08.823 INFO:teuthology.orchestra.run.smithi155.stdout: "description": "osd_op(client.4668.0:197420 5.9 5:92a2efe5:::benchmark_data_smithi006_114134_object63759:head [delete] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e62)", 2023-08-01T19:56:08.823 INFO:teuthology.orchestra.run.smithi155.stdout: "initiated_at": "2023-08-01T19:55:58.582230+0000", 2023-08-01T19:56:08.823 INFO:teuthology.orchestra.run.smithi155.stdout: "age": 10.053547629000001, 2023-08-01T19:56:08.824 INFO:teuthology.orchestra.run.smithi155.stdout: "duration": 1.0095353739999999, 2023-08-01T19:56:08.824 INFO:teuthology.orchestra.run.smithi155.stdout: "type_data": { 2023-08-01T19:56:08.824 INFO:teuthology.orchestra.run.smithi155.stdout: "flag_point": "commit sent; apply or cleanup", 2023-08-01T19:56:08.824 INFO:teuthology.orchestra.run.smithi155.stdout: "client_info": { 2023-08-01T19:56:08.824 INFO:teuthology.orchestra.run.smithi155.stdout: "client": "client.4668", 2023-08-01T19:56:08.824 INFO:teuthology.orchestra.run.smithi155.stdout: "client_addr": "172.21.15.6:0/1709472247", 2023-08-01T19:56:08.824 INFO:teuthology.orchestra.run.smithi155.stdout: "tid": 197420 2023-08-01T19:56:08.824 INFO:teuthology.orchestra.run.smithi155.stdout: }, 2023-08-01T19:56:08.825 INFO:teuthology.orchestra.run.smithi155.stdout: "events": [ 2023-08-01T19:56:08.825 INFO:teuthology.orchestra.run.smithi155.stdout: { 2023-08-01T19:56:08.825 INFO:teuthology.orchestra.run.smithi155.stdout: "event": "initiated", 2023-08-01T19:56:08.825 INFO:teuthology.orchestra.run.smithi155.stdout: "time": "2023-08-01T19:55:58.582230+0000", 2023-08-01T19:56:08.825 INFO:teuthology.orchestra.run.smithi155.stdout: "duration": 0 2023-08-01T19:56:08.825 INFO:teuthology.orchestra.run.smithi155.stdout: }, 2023-08-01T19:56:08.825 INFO:teuthology.orchestra.run.smithi155.stdout: { 2023-08-01T19:56:08.825 INFO:teuthology.orchestra.run.smithi155.stdout: "event": "throttled", 2023-08-01T19:56:08.826 INFO:teuthology.orchestra.run.smithi155.stdout: "time": "2023-08-01T19:55:58.582230+0000", 2023-08-01T19:56:08.826 INFO:teuthology.orchestra.run.smithi155.stdout: "duration": 0 2023-08-01T19:56:08.826 INFO:teuthology.orchestra.run.smithi155.stdout: }, 2023-08-01T19:56:08.826 INFO:teuthology.orchestra.run.smithi155.stdout: { 2023-08-01T19:56:08.826 INFO:teuthology.orchestra.run.smithi155.stdout: "event": "header_read", 2023-08-01T19:56:08.826 INFO:teuthology.orchestra.run.smithi155.stdout: "time": "2023-08-01T19:55:58.582229+0000", 2023-08-01T19:56:08.826 INFO:teuthology.orchestra.run.smithi155.stdout: "duration": 4294967295.9999995 2023-08-01T19:56:08.827 INFO:teuthology.orchestra.run.smithi155.stdout: }, 2023-08-01T19:56:08.827 INFO:teuthology.orchestra.run.smithi155.stdout: { 2023-08-01T19:56:08.827 INFO:teuthology.orchestra.run.smithi155.stdout: "event": "all_read", 2023-08-01T19:56:08.827 INFO:teuthology.orchestra.run.smithi155.stdout: "time": "2023-08-01T19:55:58.582233+0000", 2023-08-01T19:56:08.827 INFO:teuthology.orchestra.run.smithi155.stdout: "duration": 3.7869999999999999e-06 2023-08-01T19:56:08.827 INFO:teuthology.orchestra.run.smithi155.stdout: }, 2023-08-01T19:56:08.827 INFO:teuthology.orchestra.run.smithi155.stdout: { 2023-08-01T19:56:08.827 INFO:teuthology.orchestra.run.smithi155.stdout: "event": "dispatched", 2023-08-01T19:56:08.828 INFO:teuthology.orchestra.run.smithi155.stdout: "time": "2023-08-01T19:55:58.582241+0000", 2023-08-01T19:56:08.828 INFO:teuthology.orchestra.run.smithi155.stdout: "duration": 7.6909999999999997e-06 2023-08-01T19:56:08.828 INFO:teuthology.orchestra.run.smithi155.stdout: }, 2023-08-01T19:56:08.828 INFO:teuthology.orchestra.run.smithi155.stdout: { 2023-08-01T19:56:08.828 INFO:teuthology.orchestra.run.smithi155.stdout: "event": "queued_for_pg", 2023-08-01T19:56:08.828 INFO:teuthology.orchestra.run.smithi155.stdout: "time": "2023-08-01T19:55:58.582244+0000", 2023-08-01T19:56:08.828 INFO:teuthology.orchestra.run.smithi155.stdout: "duration": 3.6770000000000001e-06 2023-08-01T19:56:08.828 INFO:teuthology.orchestra.run.smithi155.stdout: }, 2023-08-01T19:56:08.829 INFO:teuthology.orchestra.run.smithi155.stdout: { 2023-08-01T19:56:08.829 INFO:teuthology.orchestra.run.smithi155.stdout: "event": "reached_pg", 2023-08-01T19:56:08.829 INFO:teuthology.orchestra.run.smithi155.stdout: "time": "2023-08-01T19:55:58.582274+0000", 2023-08-01T19:56:08.829 INFO:teuthology.orchestra.run.smithi155.stdout: "duration": 3.0074e-05 2023-08-01T19:56:08.829 INFO:teuthology.orchestra.run.smithi155.stdout: }, 2023-08-01T19:56:08.829 INFO:teuthology.orchestra.run.smithi155.stdout: { 2023-08-01T19:56:08.829 INFO:teuthology.orchestra.run.smithi155.stdout: "event": "waiting for peered", 2023-08-01T19:56:08.829 INFO:teuthology.orchestra.run.smithi155.stdout: "time": "2023-08-01T19:55:58.582281+0000", 2023-08-01T19:56:08.830 INFO:teuthology.orchestra.run.smithi155.stdout: "duration": 6.297e-06 2023-08-01T19:56:08.830 INFO:teuthology.orchestra.run.smithi155.stdout: }, 2023-08-01T19:56:08.830 INFO:teuthology.orchestra.run.smithi155.stdout: { 2023-08-01T19:56:08.830 INFO:teuthology.orchestra.run.smithi155.stdout: "event": "reached_pg", 2023-08-01T19:56:08.830 INFO:teuthology.orchestra.run.smithi155.stdout: "time": "2023-08-01T19:55:59.586809+0000", 2023-08-01T19:56:08.830 INFO:teuthology.orchestra.run.smithi155.stdout: "duration": 1.0045281720000001 2023-08-01T19:56:08.830 INFO:teuthology.orchestra.run.smithi155.stdout: }, 2023-08-01T19:56:08.830 INFO:teuthology.orchestra.run.smithi155.stdout: { 2023-08-01T19:56:08.831 INFO:teuthology.orchestra.run.smithi155.stdout: "event": "started", 2023-08-01T19:56:08.831 INFO:teuthology.orchestra.run.smithi155.stdout: "time": "2023-08-01T19:55:59.586910+0000", 2023-08-01T19:56:08.831 INFO:teuthology.orchestra.run.smithi155.stdout: "duration": 0.000100898 2023-08-01T19:56:08.831 INFO:teuthology.orchestra.run.smithi155.stdout: }, 2023-08-01T19:56:08.831 INFO:teuthology.orchestra.run.smithi155.stdout: { 2023-08-01T19:56:08.831 INFO:teuthology.orchestra.run.smithi155.stdout: "event": "op_commit", 2023-08-01T19:56:08.831 INFO:teuthology.orchestra.run.smithi155.stdout: "time": "2023-08-01T19:55:59.591679+0000", 2023-08-01T19:56:08.831 INFO:teuthology.orchestra.run.smithi155.stdout: "duration": 0.004769471 2023-08-01T19:56:08.832 INFO:teuthology.orchestra.run.smithi155.stdout: }, 2023-08-01T19:56:08.832 INFO:teuthology.orchestra.run.smithi155.stdout: { 2023-08-01T19:56:08.832 INFO:teuthology.orchestra.run.smithi155.stdout: "event": "commit_sent", 2023-08-01T19:56:08.832 INFO:teuthology.orchestra.run.smithi155.stdout: "time": "2023-08-01T19:55:59.591721+0000", 2023-08-01T19:56:08.832 INFO:teuthology.orchestra.run.smithi155.stdout: "duration": 4.1953000000000003e-05 2023-08-01T19:56:08.832 INFO:teuthology.orchestra.run.smithi155.stdout: }, 2023-08-01T19:56:08.832 INFO:teuthology.orchestra.run.smithi155.stdout: { 2023-08-01T19:56:08.833 INFO:teuthology.orchestra.run.smithi155.stdout: "event": "done", 2023-08-01T19:56:08.833 INFO:teuthology.orchestra.run.smithi155.stdout: "time": "2023-08-01T19:55:59.591765+0000", 2023-08-01T19:56:08.833 INFO:teuthology.orchestra.run.smithi155.stdout: "duration": 4.4030999999999999e-05 2023-08-01T19:56:08.833 INFO:teuthology.orchestra.run.smithi155.stdout: } 2023-08-01T19:56:08.833 INFO:teuthology.orchestra.run.smithi155.stdout: ] 2023-08-01T19:56:08.833 INFO:teuthology.orchestra.run.smithi155.stdout: } 2023-08-01T19:56:08.833 INFO:teuthology.orchestra.run.smithi155.stdout: } 2023-08-01T19:56:08.833 INFO:teuthology.orchestra.run.smithi155.stdout: ] 2023-08-01T19:56:08.834 INFO:teuthology.orchestra.run.smithi155.stdout:} 2023-08-01T19:56:08.835 INFO:teuthology.orchestra.run.smithi006.stdout:osd.0: {} 2023-08-01T19:56:08.835 INFO:teuthology.orchestra.run.smithi006.stdout:osd.2: {} 2023-08-01T19:56:08.835 DEBUG:teuthology.orchestra.run:got remote process result: 6 2023-08-01T19:56:08.836 INFO:tasks.ceph.osd.2.smithi155.stderr:2023-08-01T19:56:08.833+0000 7faa5c6ac700 -1 received signal: Hangup from /usr/bin/python3 /bin/daemon-helper kill ceph-osd -f --cluster ceph -i 2 (PID: 111337) UID: 0 2023-08-01T19:56:08.836 DEBUG:teuthology.orchestra.run.smithi008:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 30 ceph --cluster ceph --admin-daemon /var/run/ceph/ceph-osd.0.asok dump_ops_in_flight 2023-08-01T19:56:08.837 INFO:teuthology.orchestra.run.smithi006.stderr:osd.0: osd_enable_op_tracker = 'false' 2023-08-01T19:56:08.837 INFO:teuthology.orchestra.run.smithi006.stderr:Error ENXIO: problem getting command descriptions from osd.1 2023-08-01T19:56:08.837 INFO:teuthology.orchestra.run.smithi006.stderr:osd.2: osd_enable_op_tracker = 'false' 2023-08-01T19:56:08.837 INFO:tasks.thrashosds.thrasher:Failed to tell all osds, ignoring 2023-08-01T19:56:08.860 INFO:tasks.thrashosds.thrasher:in_osds: [0, 1, 2] out_osds: [] dead_osds: [1] live_osds: [0, 2] 2023-08-01T19:56:08.861 INFO:tasks.thrashosds.thrasher:choose_action: min_in 4 min_out 0 min_live 2 min_dead 0 chance_down 1.00 2023-08-01T19:56:08.861 INFO:tasks.thrashosds.thrasher:thrash_pg_upmap 2023-08-01T19:56:08.861 DEBUG:teuthology.orchestra.run.smithi006:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 120 ceph --cluster ceph osd dump -f json-pretty 2023-08-01T19:56:08.935 INFO:tasks.ceph.osd.2.smithi155.stderr:2023-08-01T19:56:08.933+0000 7faa5c6ac700 -1 received signal: Hangup from /usr/bin/python3 /bin/daemon-helper kill ceph-osd -f --cluster ceph -i 2 (PID: 111337) UID: 0 2023-08-01T19:56:09.024 INFO:teuthology.orchestra.run.smithi008.stdout:ERROR: (22) Invalid argument 2023-08-01T19:56:09.024 INFO:teuthology.orchestra.run.smithi008.stdout:op_tracker tracking is not enabled now, so no ops are tracked currently, even those get stuck. Please enable "osd_enable_op_tracker", and the tracker will start to track new ops received afterwards. 2023-08-01T19:56:09.037 INFO:tasks.ceph.osd.0.smithi008.stderr:2023-08-01T19:56:09.036+0000 7f16a58f4700 -1 received signal: Hangup from /usr/bin/python3 /bin/daemon-helper kill ceph-osd -f --cluster ceph -i 0 (PID: 111179) UID: 0 2023-08-01T19:56:09.039 DEBUG:teuthology.orchestra.run.smithi008:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 30 ceph --cluster ceph --admin-daemon /var/run/ceph/ceph-osd.0.asok dump_blocked_ops 2023-08-01T19:56:09.073 INFO:teuthology.orchestra.run.smithi006.stderr:noscrub is set 2023-08-01T19:56:09.136 INFO:tasks.ceph.osd.2.smithi155.stderr:2023-08-01T19:56:09.134+0000 7faa5c6ac700 -1 received signal: Hangup from /usr/bin/python3 /bin/daemon-helper kill ceph-osd -f --cluster ceph -i 2 (PID: 111337) UID: 0 2023-08-01T19:56:09.197 INFO:teuthology.orchestra.run.smithi006.stdout: 2023-08-01T19:56:09.197 INFO:teuthology.orchestra.run.smithi006.stdout:{ 2023-08-01T19:56:09.197 INFO:teuthology.orchestra.run.smithi006.stdout: "epoch": 67, 2023-08-01T19:56:09.197 INFO:teuthology.orchestra.run.smithi006.stdout: "fsid": "a0e420cc-4df1-42a5-8bd4-a98c309a9349", 2023-08-01T19:56:09.198 INFO:teuthology.orchestra.run.smithi006.stdout: "created": "2023-08-01T19:53:41.279588+0000", 2023-08-01T19:56:09.198 INFO:teuthology.orchestra.run.smithi006.stdout: "modified": "2023-08-01T19:56:09.056815+0000", 2023-08-01T19:56:09.198 INFO:teuthology.orchestra.run.smithi006.stdout: "last_up_change": "2023-08-01T19:55:58.549095+0000", 2023-08-01T19:56:09.198 INFO:teuthology.orchestra.run.smithi006.stdout: "last_in_change": "2023-08-01T19:53:42.974751+0000", 2023-08-01T19:56:09.198 INFO:teuthology.orchestra.run.smithi006.stdout: "flags": "noscrub,sortbitwise,recovery_deletes,purged_snapdirs,pglog_hardlimit", 2023-08-01T19:56:09.198 INFO:teuthology.orchestra.run.smithi006.stdout: "flags_num": 5801984, 2023-08-01T19:56:09.198 INFO:teuthology.orchestra.run.smithi006.stdout: "flags_set": [ 2023-08-01T19:56:09.199 INFO:teuthology.orchestra.run.smithi006.stdout: "noscrub", 2023-08-01T19:56:09.199 INFO:teuthology.orchestra.run.smithi006.stdout: "pglog_hardlimit", 2023-08-01T19:56:09.199 INFO:teuthology.orchestra.run.smithi006.stdout: "purged_snapdirs", 2023-08-01T19:56:09.199 INFO:teuthology.orchestra.run.smithi006.stdout: "recovery_deletes", 2023-08-01T19:56:09.199 INFO:teuthology.orchestra.run.smithi006.stdout: "sortbitwise" 2023-08-01T19:56:09.199 INFO:teuthology.orchestra.run.smithi006.stdout: ], 2023-08-01T19:56:09.199 INFO:teuthology.orchestra.run.smithi006.stdout: "crush_version": 5, 2023-08-01T19:56:09.199 INFO:teuthology.orchestra.run.smithi006.stdout: "full_ratio": 0.94999998807907104, 2023-08-01T19:56:09.200 INFO:teuthology.orchestra.run.smithi006.stdout: "backfillfull_ratio": 0.89999997615814209, 2023-08-01T19:56:09.200 INFO:teuthology.orchestra.run.smithi006.stdout: "nearfull_ratio": 0.85000002384185791, 2023-08-01T19:56:09.200 INFO:teuthology.orchestra.run.smithi006.stdout: "cluster_snapshot": "", 2023-08-01T19:56:09.200 INFO:teuthology.orchestra.run.smithi006.stdout: "pool_max": 5, 2023-08-01T19:56:09.200 INFO:teuthology.orchestra.run.smithi006.stdout: "max_osd": 3, 2023-08-01T19:56:09.200 INFO:teuthology.orchestra.run.smithi006.stdout: "require_min_compat_client": "luminous", 2023-08-01T19:56:09.200 INFO:teuthology.orchestra.run.smithi006.stdout: "min_compat_client": "jewel", 2023-08-01T19:56:09.201 INFO:teuthology.orchestra.run.smithi006.stdout: "require_osd_release": "quincy", 2023-08-01T19:56:09.201 INFO:teuthology.orchestra.run.smithi006.stdout: "pools": [ 2023-08-01T19:56:09.201 INFO:teuthology.orchestra.run.smithi006.stdout: { 2023-08-01T19:56:09.201 INFO:teuthology.orchestra.run.smithi006.stdout: "pool": 1, 2023-08-01T19:56:09.201 INFO:teuthology.orchestra.run.smithi006.stdout: "pool_name": ".mgr", 2023-08-01T19:56:09.201 INFO:teuthology.orchestra.run.smithi006.stdout: "create_time": "2023-08-01T19:53:49.961944+0000", 2023-08-01T19:56:09.201 INFO:teuthology.orchestra.run.smithi006.stdout: "flags": 1, 2023-08-01T19:56:09.201 INFO:teuthology.orchestra.run.smithi006.stdout: "flags_names": "hashpspool", 2023-08-01T19:56:09.202 INFO:teuthology.orchestra.run.smithi006.stdout: "type": 1, 2023-08-01T19:56:09.202 INFO:teuthology.orchestra.run.smithi006.stdout: "size": 2, 2023-08-01T19:56:09.202 INFO:teuthology.orchestra.run.smithi006.stdout: "min_size": 1, 2023-08-01T19:56:09.202 INFO:teuthology.orchestra.run.smithi006.stdout: "crush_rule": 0, 2023-08-01T19:56:09.202 INFO:teuthology.orchestra.run.smithi006.stdout: "peering_crush_bucket_count": 0, 2023-08-01T19:56:09.202 INFO:teuthology.orchestra.run.smithi006.stdout: "peering_crush_bucket_target": 0, 2023-08-01T19:56:09.202 INFO:teuthology.orchestra.run.smithi006.stdout: "peering_crush_bucket_barrier": 0, 2023-08-01T19:56:09.202 INFO:teuthology.orchestra.run.smithi006.stdout: "peering_crush_bucket_mandatory_member": 2147483647, 2023-08-01T19:56:09.203 INFO:teuthology.orchestra.run.smithi006.stdout: "object_hash": 2, 2023-08-01T19:56:09.203 INFO:teuthology.orchestra.run.smithi006.stdout: "pg_autoscale_mode": "off", 2023-08-01T19:56:09.203 INFO:teuthology.orchestra.run.smithi006.stdout: "pg_num": 1, 2023-08-01T19:56:09.203 INFO:teuthology.orchestra.run.smithi006.stdout: "pg_placement_num": 1, 2023-08-01T19:56:09.203 INFO:teuthology.orchestra.run.smithi006.stdout: "pg_placement_num_target": 1, 2023-08-01T19:56:09.203 INFO:teuthology.orchestra.run.smithi006.stdout: "pg_num_target": 1, 2023-08-01T19:56:09.203 INFO:teuthology.orchestra.run.smithi006.stdout: "pg_num_pending": 1, 2023-08-01T19:56:09.203 INFO:teuthology.orchestra.run.smithi006.stdout: "last_pg_merge_meta": { 2023-08-01T19:56:09.204 INFO:teuthology.orchestra.run.smithi006.stdout: "source_pgid": "0.0", 2023-08-01T19:56:09.204 INFO:teuthology.orchestra.run.smithi006.stdout: "ready_epoch": 0, 2023-08-01T19:56:09.204 INFO:teuthology.orchestra.run.smithi006.stdout: "last_epoch_started": 0, 2023-08-01T19:56:09.204 INFO:teuthology.orchestra.run.smithi006.stdout: "last_epoch_clean": 0, 2023-08-01T19:56:09.204 INFO:teuthology.orchestra.run.smithi006.stdout: "source_version": "0'0", 2023-08-01T19:56:09.204 INFO:teuthology.orchestra.run.smithi006.stdout: "target_version": "0'0" 2023-08-01T19:56:09.204 INFO:teuthology.orchestra.run.smithi006.stdout: }, 2023-08-01T19:56:09.204 INFO:teuthology.orchestra.run.smithi006.stdout: "last_change": "11", 2023-08-01T19:56:09.205 INFO:teuthology.orchestra.run.smithi006.stdout: "last_force_op_resend": "0", 2023-08-01T19:56:09.205 INFO:teuthology.orchestra.run.smithi006.stdout: "last_force_op_resend_prenautilus": "0", 2023-08-01T19:56:09.205 INFO:teuthology.orchestra.run.smithi006.stdout: "last_force_op_resend_preluminous": "0", 2023-08-01T19:56:09.205 INFO:teuthology.orchestra.run.smithi006.stdout: "auid": 0, 2023-08-01T19:56:09.205 INFO:teuthology.orchestra.run.smithi006.stdout: "snap_mode": "selfmanaged", 2023-08-01T19:56:09.205 INFO:teuthology.orchestra.run.smithi006.stdout: "snap_seq": 0, 2023-08-01T19:56:09.205 INFO:teuthology.orchestra.run.smithi006.stdout: "snap_epoch": 0, 2023-08-01T19:56:09.206 INFO:teuthology.orchestra.run.smithi006.stdout: "pool_snaps": [], 2023-08-01T19:56:09.206 INFO:teuthology.orchestra.run.smithi006.stdout: "removed_snaps": "[]", 2023-08-01T19:56:09.206 INFO:teuthology.orchestra.run.smithi006.stdout: "quota_max_bytes": 0, 2023-08-01T19:56:09.206 INFO:teuthology.orchestra.run.smithi006.stdout: "quota_max_objects": 0, 2023-08-01T19:56:09.206 INFO:teuthology.orchestra.run.smithi006.stdout: "tiers": [], 2023-08-01T19:56:09.206 INFO:teuthology.orchestra.run.smithi006.stdout: "tier_of": -1, 2023-08-01T19:56:09.206 INFO:teuthology.orchestra.run.smithi006.stdout: "read_tier": -1, 2023-08-01T19:56:09.206 INFO:teuthology.orchestra.run.smithi006.stdout: "write_tier": -1, 2023-08-01T19:56:09.207 INFO:teuthology.orchestra.run.smithi006.stdout: "cache_mode": "none", 2023-08-01T19:56:09.207 INFO:teuthology.orchestra.run.smithi006.stdout: "target_max_bytes": 0, 2023-08-01T19:56:09.207 INFO:teuthology.orchestra.run.smithi006.stdout: "target_max_objects": 0, 2023-08-01T19:56:09.207 INFO:teuthology.orchestra.run.smithi006.stdout: "cache_target_dirty_ratio_micro": 400000, 2023-08-01T19:56:09.207 INFO:teuthology.orchestra.run.smithi006.stdout: "cache_target_dirty_high_ratio_micro": 600000, 2023-08-01T19:56:09.207 INFO:teuthology.orchestra.run.smithi006.stdout: "cache_target_full_ratio_micro": 800000, 2023-08-01T19:56:09.207 INFO:teuthology.orchestra.run.smithi006.stdout: "cache_min_flush_age": 0, 2023-08-01T19:56:09.207 INFO:teuthology.orchestra.run.smithi006.stdout: "cache_min_evict_age": 0, 2023-08-01T19:56:09.208 INFO:teuthology.orchestra.run.smithi006.stdout: "erasure_code_profile": "", 2023-08-01T19:56:09.208 INFO:teuthology.orchestra.run.smithi006.stdout: "hit_set_params": { 2023-08-01T19:56:09.208 INFO:teuthology.orchestra.run.smithi006.stdout: "type": "none" 2023-08-01T19:56:09.208 INFO:teuthology.orchestra.run.smithi006.stdout: }, 2023-08-01T19:56:09.208 INFO:teuthology.orchestra.run.smithi006.stdout: "hit_set_period": 0, 2023-08-01T19:56:09.208 INFO:teuthology.orchestra.run.smithi006.stdout: "hit_set_count": 0, 2023-08-01T19:56:09.208 INFO:teuthology.orchestra.run.smithi006.stdout: "use_gmt_hitset": true, 2023-08-01T19:56:09.208 INFO:teuthology.orchestra.run.smithi006.stdout: "min_read_recency_for_promote": 0, 2023-08-01T19:56:09.209 INFO:teuthology.orchestra.run.smithi006.stdout: "min_write_recency_for_promote": 0, 2023-08-01T19:56:09.209 INFO:teuthology.orchestra.run.smithi006.stdout: "hit_set_grade_decay_rate": 0, 2023-08-01T19:56:09.209 INFO:teuthology.orchestra.run.smithi006.stdout: "hit_set_search_last_n": 0, 2023-08-01T19:56:09.209 INFO:teuthology.orchestra.run.smithi006.stdout: "grade_table": [], 2023-08-01T19:56:09.209 INFO:teuthology.orchestra.run.smithi006.stdout: "stripe_width": 0, 2023-08-01T19:56:09.209 INFO:teuthology.orchestra.run.smithi006.stdout: "expected_num_objects": 0, 2023-08-01T19:56:09.209 INFO:teuthology.orchestra.run.smithi006.stdout: "fast_read": false, 2023-08-01T19:56:09.209 INFO:teuthology.orchestra.run.smithi006.stdout: "options": { 2023-08-01T19:56:09.210 INFO:teuthology.orchestra.run.smithi006.stdout: "pg_num_max": 32, 2023-08-01T19:56:09.210 INFO:teuthology.orchestra.run.smithi006.stdout: "pg_num_min": 1 2023-08-01T19:56:09.210 INFO:teuthology.orchestra.run.smithi006.stdout: }, 2023-08-01T19:56:09.210 INFO:teuthology.orchestra.run.smithi006.stdout: "application_metadata": { 2023-08-01T19:56:09.210 INFO:teuthology.orchestra.run.smithi006.stdout: "mgr": {} 2023-08-01T19:56:09.210 INFO:teuthology.orchestra.run.smithi006.stdout: } 2023-08-01T19:56:09.210 INFO:teuthology.orchestra.run.smithi006.stdout: }, 2023-08-01T19:56:09.210 INFO:teuthology.orchestra.run.smithi006.stdout: { 2023-08-01T19:56:09.211 INFO:teuthology.orchestra.run.smithi006.stdout: "pool": 2, 2023-08-01T19:56:09.211 INFO:teuthology.orchestra.run.smithi006.stdout: "pool_name": "rbd", 2023-08-01T19:56:09.211 INFO:teuthology.orchestra.run.smithi006.stdout: "create_time": "2023-08-01T19:53:57.404091+0000", 2023-08-01T19:56:09.211 INFO:teuthology.orchestra.run.smithi006.stdout: "flags": 1, 2023-08-01T19:56:09.211 INFO:teuthology.orchestra.run.smithi006.stdout: "flags_names": "hashpspool", 2023-08-01T19:56:09.211 INFO:teuthology.orchestra.run.smithi006.stdout: "type": 1, 2023-08-01T19:56:09.211 INFO:teuthology.orchestra.run.smithi006.stdout: "size": 2, 2023-08-01T19:56:09.211 INFO:teuthology.orchestra.run.smithi006.stdout: "min_size": 1, 2023-08-01T19:56:09.212 INFO:teuthology.orchestra.run.smithi006.stdout: "crush_rule": 0, 2023-08-01T19:56:09.212 INFO:teuthology.orchestra.run.smithi006.stdout: "peering_crush_bucket_count": 0, 2023-08-01T19:56:09.212 INFO:teuthology.orchestra.run.smithi006.stdout: "peering_crush_bucket_target": 0, 2023-08-01T19:56:09.212 INFO:teuthology.orchestra.run.smithi006.stdout: "peering_crush_bucket_barrier": 0, 2023-08-01T19:56:09.212 INFO:teuthology.orchestra.run.smithi006.stdout: "peering_crush_bucket_mandatory_member": 2147483647, 2023-08-01T19:56:09.212 INFO:teuthology.orchestra.run.smithi006.stdout: "object_hash": 2, 2023-08-01T19:56:09.212 INFO:teuthology.orchestra.run.smithi006.stdout: "pg_autoscale_mode": "off", 2023-08-01T19:56:09.213 INFO:teuthology.orchestra.run.smithi006.stdout: "pg_num": 8, 2023-08-01T19:56:09.213 INFO:teuthology.orchestra.run.smithi006.stdout: "pg_placement_num": 8, 2023-08-01T19:56:09.213 INFO:teuthology.orchestra.run.smithi006.stdout: "pg_placement_num_target": 8, 2023-08-01T19:56:09.213 INFO:teuthology.orchestra.run.smithi006.stdout: "pg_num_target": 8, 2023-08-01T19:56:09.213 INFO:teuthology.orchestra.run.smithi006.stdout: "pg_num_pending": 8, 2023-08-01T19:56:09.213 INFO:teuthology.orchestra.run.smithi006.stdout: "last_pg_merge_meta": { 2023-08-01T19:56:09.213 INFO:teuthology.orchestra.run.smithi006.stdout: "source_pgid": "0.0", 2023-08-01T19:56:09.213 INFO:teuthology.orchestra.run.smithi006.stdout: "ready_epoch": 0, 2023-08-01T19:56:09.214 INFO:teuthology.orchestra.run.smithi006.stdout: "last_epoch_started": 0, 2023-08-01T19:56:09.214 INFO:teuthology.orchestra.run.smithi006.stdout: "last_epoch_clean": 0, 2023-08-01T19:56:09.214 INFO:teuthology.orchestra.run.smithi006.stdout: "source_version": "0'0", 2023-08-01T19:56:09.214 INFO:teuthology.orchestra.run.smithi006.stdout: "target_version": "0'0" 2023-08-01T19:56:09.214 INFO:teuthology.orchestra.run.smithi006.stdout: }, 2023-08-01T19:56:09.214 INFO:teuthology.orchestra.run.smithi006.stdout: "last_change": "14", 2023-08-01T19:56:09.214 INFO:teuthology.orchestra.run.smithi006.stdout: "last_force_op_resend": "0", 2023-08-01T19:56:09.214 INFO:teuthology.orchestra.run.smithi006.stdout: "last_force_op_resend_prenautilus": "0", 2023-08-01T19:56:09.215 INFO:teuthology.orchestra.run.smithi006.stdout: "last_force_op_resend_preluminous": "0", 2023-08-01T19:56:09.215 INFO:teuthology.orchestra.run.smithi006.stdout: "auid": 0, 2023-08-01T19:56:09.215 INFO:teuthology.orchestra.run.smithi006.stdout: "snap_mode": "selfmanaged", 2023-08-01T19:56:09.215 INFO:teuthology.orchestra.run.smithi006.stdout: "snap_seq": 0, 2023-08-01T19:56:09.215 INFO:teuthology.orchestra.run.smithi006.stdout: "snap_epoch": 0, 2023-08-01T19:56:09.215 INFO:teuthology.orchestra.run.smithi006.stdout: "pool_snaps": [], 2023-08-01T19:56:09.215 INFO:teuthology.orchestra.run.smithi006.stdout: "removed_snaps": "[]", 2023-08-01T19:56:09.215 INFO:teuthology.orchestra.run.smithi006.stdout: "quota_max_bytes": 0, 2023-08-01T19:56:09.216 INFO:teuthology.orchestra.run.smithi006.stdout: "quota_max_objects": 0, 2023-08-01T19:56:09.216 INFO:teuthology.orchestra.run.smithi006.stdout: "tiers": [], 2023-08-01T19:56:09.216 INFO:teuthology.orchestra.run.smithi006.stdout: "tier_of": -1, 2023-08-01T19:56:09.216 INFO:teuthology.orchestra.run.smithi006.stdout: "read_tier": -1, 2023-08-01T19:56:09.216 INFO:teuthology.orchestra.run.smithi006.stdout: "write_tier": -1, 2023-08-01T19:56:09.216 INFO:teuthology.orchestra.run.smithi006.stdout: "cache_mode": "none", 2023-08-01T19:56:09.216 INFO:teuthology.orchestra.run.smithi006.stdout: "target_max_bytes": 0, 2023-08-01T19:56:09.216 INFO:teuthology.orchestra.run.smithi006.stdout: "target_max_objects": 0, 2023-08-01T19:56:09.217 INFO:teuthology.orchestra.run.smithi006.stdout: "cache_target_dirty_ratio_micro": 400000, 2023-08-01T19:56:09.217 INFO:teuthology.orchestra.run.smithi006.stdout: "cache_target_dirty_high_ratio_micro": 600000, 2023-08-01T19:56:09.217 INFO:teuthology.orchestra.run.smithi006.stdout: "cache_target_full_ratio_micro": 800000, 2023-08-01T19:56:09.217 INFO:teuthology.orchestra.run.smithi006.stdout: "cache_min_flush_age": 0, 2023-08-01T19:56:09.217 INFO:teuthology.orchestra.run.smithi006.stdout: "cache_min_evict_age": 0, 2023-08-01T19:56:09.217 INFO:teuthology.orchestra.run.smithi006.stdout: "erasure_code_profile": "", 2023-08-01T19:56:09.217 INFO:teuthology.orchestra.run.smithi006.stdout: "hit_set_params": { 2023-08-01T19:56:09.217 INFO:teuthology.orchestra.run.smithi006.stdout: "type": "none" 2023-08-01T19:56:09.218 INFO:teuthology.orchestra.run.smithi006.stdout: }, 2023-08-01T19:56:09.218 INFO:teuthology.orchestra.run.smithi006.stdout: "hit_set_period": 0, 2023-08-01T19:56:09.218 INFO:teuthology.orchestra.run.smithi006.stdout: "hit_set_count": 0, 2023-08-01T19:56:09.218 INFO:teuthology.orchestra.run.smithi006.stdout: "use_gmt_hitset": true, 2023-08-01T19:56:09.218 INFO:teuthology.orchestra.run.smithi006.stdout: "min_read_recency_for_promote": 0, 2023-08-01T19:56:09.218 INFO:teuthology.orchestra.run.smithi006.stdout: "min_write_recency_for_promote": 0, 2023-08-01T19:56:09.218 INFO:teuthology.orchestra.run.smithi006.stdout: "hit_set_grade_decay_rate": 0, 2023-08-01T19:56:09.218 INFO:teuthology.orchestra.run.smithi006.stdout: "hit_set_search_last_n": 0, 2023-08-01T19:56:09.219 INFO:teuthology.orchestra.run.smithi006.stdout: "grade_table": [], 2023-08-01T19:56:09.219 INFO:teuthology.orchestra.run.smithi006.stdout: "stripe_width": 0, 2023-08-01T19:56:09.219 INFO:teuthology.orchestra.run.smithi006.stdout: "expected_num_objects": 0, 2023-08-01T19:56:09.219 INFO:teuthology.orchestra.run.smithi006.stdout: "fast_read": false, 2023-08-01T19:56:09.219 INFO:teuthology.orchestra.run.smithi006.stdout: "options": {}, 2023-08-01T19:56:09.219 INFO:teuthology.orchestra.run.smithi006.stdout: "application_metadata": { 2023-08-01T19:56:09.219 INFO:teuthology.orchestra.run.smithi006.stdout: "rbd": {} 2023-08-01T19:56:09.219 INFO:teuthology.orchestra.run.smithi006.stdout: } 2023-08-01T19:56:09.220 INFO:teuthology.orchestra.run.smithi006.stdout: }, 2023-08-01T19:56:09.220 INFO:teuthology.orchestra.run.smithi006.stdout: { 2023-08-01T19:56:09.220 INFO:teuthology.orchestra.run.smithi006.stdout: "pool": 3, 2023-08-01T19:56:09.220 INFO:teuthology.orchestra.run.smithi006.stdout: "pool_name": "cephfs_metadata", 2023-08-01T19:56:09.220 INFO:teuthology.orchestra.run.smithi006.stdout: "create_time": "2023-08-01T19:54:02.111247+0000", 2023-08-01T19:56:09.220 INFO:teuthology.orchestra.run.smithi006.stdout: "flags": 1, 2023-08-01T19:56:09.220 INFO:teuthology.orchestra.run.smithi006.stdout: "flags_names": "hashpspool", 2023-08-01T19:56:09.221 INFO:teuthology.orchestra.run.smithi006.stdout: "type": 1, 2023-08-01T19:56:09.221 INFO:teuthology.orchestra.run.smithi006.stdout: "size": 2, 2023-08-01T19:56:09.221 INFO:teuthology.orchestra.run.smithi006.stdout: "min_size": 1, 2023-08-01T19:56:09.221 INFO:teuthology.orchestra.run.smithi006.stdout: "crush_rule": 0, 2023-08-01T19:56:09.221 INFO:teuthology.orchestra.run.smithi006.stdout: "peering_crush_bucket_count": 0, 2023-08-01T19:56:09.221 INFO:teuthology.orchestra.run.smithi006.stdout: "peering_crush_bucket_target": 0, 2023-08-01T19:56:09.221 INFO:teuthology.orchestra.run.smithi006.stdout: "peering_crush_bucket_barrier": 0, 2023-08-01T19:56:09.221 INFO:teuthology.orchestra.run.smithi006.stdout: "peering_crush_bucket_mandatory_member": 2147483647, 2023-08-01T19:56:09.222 INFO:teuthology.orchestra.run.smithi006.stdout: "object_hash": 2, 2023-08-01T19:56:09.222 INFO:teuthology.orchestra.run.smithi006.stdout: "pg_autoscale_mode": "off", 2023-08-01T19:56:09.222 INFO:teuthology.orchestra.run.smithi006.stdout: "pg_num": 32, 2023-08-01T19:56:09.222 INFO:teuthology.orchestra.run.smithi006.stdout: "pg_placement_num": 32, 2023-08-01T19:56:09.222 INFO:teuthology.orchestra.run.smithi006.stdout: "pg_placement_num_target": 32, 2023-08-01T19:56:09.222 INFO:teuthology.orchestra.run.smithi006.stdout: "pg_num_target": 32, 2023-08-01T19:56:09.222 INFO:teuthology.orchestra.run.smithi006.stdout: "pg_num_pending": 32, 2023-08-01T19:56:09.222 INFO:teuthology.orchestra.run.smithi006.stdout: "last_pg_merge_meta": { 2023-08-01T19:56:09.223 INFO:teuthology.orchestra.run.smithi006.stdout: "source_pgid": "0.0", 2023-08-01T19:56:09.223 INFO:teuthology.orchestra.run.smithi006.stdout: "ready_epoch": 0, 2023-08-01T19:56:09.223 INFO:teuthology.orchestra.run.smithi006.stdout: "last_epoch_started": 0, 2023-08-01T19:56:09.223 INFO:teuthology.orchestra.run.smithi006.stdout: "last_epoch_clean": 0, 2023-08-01T19:56:09.223 INFO:teuthology.orchestra.run.smithi006.stdout: "source_version": "0'0", 2023-08-01T19:56:09.223 INFO:teuthology.orchestra.run.smithi006.stdout: "target_version": "0'0" 2023-08-01T19:56:09.223 INFO:teuthology.orchestra.run.smithi006.stdout: }, 2023-08-01T19:56:09.223 INFO:teuthology.orchestra.run.smithi006.stdout: "last_change": "17", 2023-08-01T19:56:09.224 INFO:teuthology.orchestra.run.smithi006.stdout: "last_force_op_resend": "0", 2023-08-01T19:56:09.224 INFO:teuthology.orchestra.run.smithi006.stdout: "last_force_op_resend_prenautilus": "0", 2023-08-01T19:56:09.224 INFO:teuthology.orchestra.run.smithi006.stdout: "last_force_op_resend_preluminous": "0", 2023-08-01T19:56:09.224 INFO:teuthology.orchestra.run.smithi006.stdout: "auid": 0, 2023-08-01T19:56:09.224 INFO:teuthology.orchestra.run.smithi006.stdout: "snap_mode": "selfmanaged", 2023-08-01T19:56:09.224 INFO:teuthology.orchestra.run.smithi006.stdout: "snap_seq": 0, 2023-08-01T19:56:09.224 INFO:teuthology.orchestra.run.smithi006.stdout: "snap_epoch": 0, 2023-08-01T19:56:09.225 INFO:teuthology.orchestra.run.smithi006.stdout: "pool_snaps": [], 2023-08-01T19:56:09.225 INFO:teuthology.orchestra.run.smithi006.stdout: "removed_snaps": "[]", 2023-08-01T19:56:09.225 INFO:teuthology.orchestra.run.smithi006.stdout: "quota_max_bytes": 0, 2023-08-01T19:56:09.225 INFO:teuthology.orchestra.run.smithi006.stdout: "quota_max_objects": 0, 2023-08-01T19:56:09.225 INFO:teuthology.orchestra.run.smithi006.stdout: "tiers": [], 2023-08-01T19:56:09.225 INFO:teuthology.orchestra.run.smithi006.stdout: "tier_of": -1, 2023-08-01T19:56:09.225 INFO:teuthology.orchestra.run.smithi006.stdout: "read_tier": -1, 2023-08-01T19:56:09.225 INFO:teuthology.orchestra.run.smithi006.stdout: "write_tier": -1, 2023-08-01T19:56:09.226 INFO:teuthology.orchestra.run.smithi006.stdout: "cache_mode": "none", 2023-08-01T19:56:09.226 INFO:teuthology.orchestra.run.smithi006.stdout: "target_max_bytes": 0, 2023-08-01T19:56:09.226 INFO:teuthology.orchestra.run.smithi006.stdout: "target_max_objects": 0, 2023-08-01T19:56:09.226 INFO:teuthology.orchestra.run.smithi006.stdout: "cache_target_dirty_ratio_micro": 400000, 2023-08-01T19:56:09.226 INFO:teuthology.orchestra.run.smithi006.stdout: "cache_target_dirty_high_ratio_micro": 600000, 2023-08-01T19:56:09.226 INFO:teuthology.orchestra.run.smithi006.stdout: "cache_target_full_ratio_micro": 800000, 2023-08-01T19:56:09.226 INFO:teuthology.orchestra.run.smithi006.stdout: "cache_min_flush_age": 0, 2023-08-01T19:56:09.226 INFO:teuthology.orchestra.run.smithi006.stdout: "cache_min_evict_age": 0, 2023-08-01T19:56:09.227 INFO:teuthology.orchestra.run.smithi006.stdout: "erasure_code_profile": "", 2023-08-01T19:56:09.227 INFO:teuthology.orchestra.run.smithi006.stdout: "hit_set_params": { 2023-08-01T19:56:09.227 INFO:teuthology.orchestra.run.smithi006.stdout: "type": "none" 2023-08-01T19:56:09.227 INFO:teuthology.orchestra.run.smithi006.stdout: }, 2023-08-01T19:56:09.227 INFO:teuthology.orchestra.run.smithi006.stdout: "hit_set_period": 0, 2023-08-01T19:56:09.227 INFO:teuthology.orchestra.run.smithi006.stdout: "hit_set_count": 0, 2023-08-01T19:56:09.227 INFO:teuthology.orchestra.run.smithi006.stdout: "use_gmt_hitset": true, 2023-08-01T19:56:09.227 INFO:teuthology.orchestra.run.smithi006.stdout: "min_read_recency_for_promote": 0, 2023-08-01T19:56:09.228 INFO:teuthology.orchestra.run.smithi006.stdout: "min_write_recency_for_promote": 0, 2023-08-01T19:56:09.228 INFO:teuthology.orchestra.run.smithi006.stdout: "hit_set_grade_decay_rate": 0, 2023-08-01T19:56:09.228 INFO:teuthology.orchestra.run.smithi006.stdout: "hit_set_search_last_n": 0, 2023-08-01T19:56:09.228 INFO:teuthology.orchestra.run.smithi006.stdout: "grade_table": [], 2023-08-01T19:56:09.228 INFO:teuthology.orchestra.run.smithi006.stdout: "stripe_width": 0, 2023-08-01T19:56:09.228 INFO:teuthology.orchestra.run.smithi006.stdout: "expected_num_objects": 0, 2023-08-01T19:56:09.228 INFO:teuthology.orchestra.run.smithi006.stdout: "fast_read": false, 2023-08-01T19:56:09.229 INFO:teuthology.orchestra.run.smithi006.stdout: "options": { 2023-08-01T19:56:09.229 INFO:teuthology.orchestra.run.smithi006.stdout: "pg_autoscale_bias": 4, 2023-08-01T19:56:09.229 INFO:teuthology.orchestra.run.smithi006.stdout: "pg_num_min": 16, 2023-08-01T19:56:09.229 INFO:teuthology.orchestra.run.smithi006.stdout: "recovery_priority": 5 2023-08-01T19:56:09.229 INFO:teuthology.orchestra.run.smithi006.stdout: }, 2023-08-01T19:56:09.229 INFO:teuthology.orchestra.run.smithi006.stdout: "application_metadata": { 2023-08-01T19:56:09.229 INFO:teuthology.orchestra.run.smithi006.stdout: "cephfs": { 2023-08-01T19:56:09.229 INFO:teuthology.orchestra.run.smithi006.stdout: "metadata": "cephfs" 2023-08-01T19:56:09.230 INFO:teuthology.orchestra.run.smithi006.stdout: } 2023-08-01T19:56:09.230 INFO:teuthology.orchestra.run.smithi006.stdout: } 2023-08-01T19:56:09.230 INFO:teuthology.orchestra.run.smithi006.stdout: }, 2023-08-01T19:56:09.230 INFO:teuthology.orchestra.run.smithi006.stdout: { 2023-08-01T19:56:09.230 INFO:teuthology.orchestra.run.smithi006.stdout: "pool": 4, 2023-08-01T19:56:09.230 INFO:teuthology.orchestra.run.smithi006.stdout: "pool_name": "cephfs_data", 2023-08-01T19:56:09.230 INFO:teuthology.orchestra.run.smithi006.stdout: "create_time": "2023-08-01T19:54:03.430277+0000", 2023-08-01T19:56:09.230 INFO:teuthology.orchestra.run.smithi006.stdout: "flags": 1, 2023-08-01T19:56:09.231 INFO:teuthology.orchestra.run.smithi006.stdout: "flags_names": "hashpspool", 2023-08-01T19:56:09.231 INFO:teuthology.orchestra.run.smithi006.stdout: "type": 1, 2023-08-01T19:56:09.231 INFO:teuthology.orchestra.run.smithi006.stdout: "size": 2, 2023-08-01T19:56:09.231 INFO:teuthology.orchestra.run.smithi006.stdout: "min_size": 1, 2023-08-01T19:56:09.231 INFO:teuthology.orchestra.run.smithi006.stdout: "crush_rule": 0, 2023-08-01T19:56:09.231 INFO:teuthology.orchestra.run.smithi006.stdout: "peering_crush_bucket_count": 0, 2023-08-01T19:56:09.231 INFO:teuthology.orchestra.run.smithi006.stdout: "peering_crush_bucket_target": 0, 2023-08-01T19:56:09.231 INFO:teuthology.orchestra.run.smithi006.stdout: "peering_crush_bucket_barrier": 0, 2023-08-01T19:56:09.232 INFO:teuthology.orchestra.run.smithi006.stdout: "peering_crush_bucket_mandatory_member": 2147483647, 2023-08-01T19:56:09.232 INFO:teuthology.orchestra.run.smithi006.stdout: "object_hash": 2, 2023-08-01T19:56:09.232 INFO:teuthology.orchestra.run.smithi006.stdout: "pg_autoscale_mode": "off", 2023-08-01T19:56:09.232 INFO:teuthology.orchestra.run.smithi006.stdout: "pg_num": 64, 2023-08-01T19:56:09.232 INFO:teuthology.orchestra.run.smithi006.stdout: "pg_placement_num": 64, 2023-08-01T19:56:09.232 INFO:teuthology.orchestra.run.smithi006.stdout: "pg_placement_num_target": 64, 2023-08-01T19:56:09.232 INFO:teuthology.orchestra.run.smithi006.stdout: "pg_num_target": 64, 2023-08-01T19:56:09.232 INFO:teuthology.orchestra.run.smithi006.stdout: "pg_num_pending": 64, 2023-08-01T19:56:09.233 INFO:teuthology.orchestra.run.smithi006.stdout: "last_pg_merge_meta": { 2023-08-01T19:56:09.233 INFO:teuthology.orchestra.run.smithi006.stdout: "source_pgid": "0.0", 2023-08-01T19:56:09.233 INFO:teuthology.orchestra.run.smithi006.stdout: "ready_epoch": 0, 2023-08-01T19:56:09.233 INFO:teuthology.orchestra.run.smithi006.stdout: "last_epoch_started": 0, 2023-08-01T19:56:09.233 INFO:teuthology.orchestra.run.smithi006.stdout: "last_epoch_clean": 0, 2023-08-01T19:56:09.233 INFO:teuthology.orchestra.run.smithi006.stdout: "source_version": "0'0", 2023-08-01T19:56:09.233 INFO:teuthology.orchestra.run.smithi006.stdout: "target_version": "0'0" 2023-08-01T19:56:09.234 INFO:teuthology.orchestra.run.smithi006.stdout: }, 2023-08-01T19:56:09.234 INFO:teuthology.orchestra.run.smithi006.stdout: "last_change": "18", 2023-08-01T19:56:09.234 INFO:teuthology.orchestra.run.smithi006.stdout: "last_force_op_resend": "0", 2023-08-01T19:56:09.234 INFO:teuthology.orchestra.run.smithi006.stdout: "last_force_op_resend_prenautilus": "0", 2023-08-01T19:56:09.234 INFO:teuthology.orchestra.run.smithi006.stdout: "last_force_op_resend_preluminous": "0", 2023-08-01T19:56:09.234 INFO:teuthology.orchestra.run.smithi006.stdout: "auid": 0, 2023-08-01T19:56:09.234 INFO:teuthology.orchestra.run.smithi006.stdout: "snap_mode": "selfmanaged", 2023-08-01T19:56:09.234 INFO:teuthology.orchestra.run.smithi006.stdout: "snap_seq": 0, 2023-08-01T19:56:09.235 INFO:teuthology.orchestra.run.smithi006.stdout: "snap_epoch": 0, 2023-08-01T19:56:09.235 INFO:teuthology.orchestra.run.smithi006.stdout: "pool_snaps": [], 2023-08-01T19:56:09.235 INFO:teuthology.orchestra.run.smithi006.stdout: "removed_snaps": "[]", 2023-08-01T19:56:09.235 INFO:teuthology.orchestra.run.smithi006.stdout: "quota_max_bytes": 0, 2023-08-01T19:56:09.235 INFO:teuthology.orchestra.run.smithi006.stdout: "quota_max_objects": 0, 2023-08-01T19:56:09.235 INFO:teuthology.orchestra.run.smithi006.stdout: "tiers": [], 2023-08-01T19:56:09.235 INFO:teuthology.orchestra.run.smithi006.stdout: "tier_of": -1, 2023-08-01T19:56:09.235 INFO:teuthology.orchestra.run.smithi006.stdout: "read_tier": -1, 2023-08-01T19:56:09.236 INFO:teuthology.orchestra.run.smithi006.stdout: "write_tier": -1, 2023-08-01T19:56:09.236 INFO:teuthology.orchestra.run.smithi006.stdout: "cache_mode": "none", 2023-08-01T19:56:09.236 INFO:teuthology.orchestra.run.smithi006.stdout: "target_max_bytes": 0, 2023-08-01T19:56:09.236 INFO:teuthology.orchestra.run.smithi006.stdout: "target_max_objects": 0, 2023-08-01T19:56:09.236 INFO:teuthology.orchestra.run.smithi006.stdout: "cache_target_dirty_ratio_micro": 400000, 2023-08-01T19:56:09.236 INFO:teuthology.orchestra.run.smithi006.stdout: "cache_target_dirty_high_ratio_micro": 600000, 2023-08-01T19:56:09.236 INFO:teuthology.orchestra.run.smithi006.stdout: "cache_target_full_ratio_micro": 800000, 2023-08-01T19:56:09.236 INFO:teuthology.orchestra.run.smithi006.stdout: "cache_min_flush_age": 0, 2023-08-01T19:56:09.237 INFO:teuthology.orchestra.run.smithi006.stdout: "cache_min_evict_age": 0, 2023-08-01T19:56:09.237 INFO:teuthology.orchestra.run.smithi006.stdout: "erasure_code_profile": "", 2023-08-01T19:56:09.237 INFO:teuthology.orchestra.run.smithi006.stdout: "hit_set_params": { 2023-08-01T19:56:09.237 INFO:teuthology.orchestra.run.smithi006.stdout: "type": "none" 2023-08-01T19:56:09.237 INFO:teuthology.orchestra.run.smithi006.stdout: }, 2023-08-01T19:56:09.237 INFO:teuthology.orchestra.run.smithi006.stdout: "hit_set_period": 0, 2023-08-01T19:56:09.237 INFO:teuthology.orchestra.run.smithi006.stdout: "hit_set_count": 0, 2023-08-01T19:56:09.237 INFO:teuthology.orchestra.run.smithi006.stdout: "use_gmt_hitset": true, 2023-08-01T19:56:09.238 INFO:teuthology.orchestra.run.smithi006.stdout: "min_read_recency_for_promote": 0, 2023-08-01T19:56:09.238 INFO:teuthology.orchestra.run.smithi006.stdout: "min_write_recency_for_promote": 0, 2023-08-01T19:56:09.238 INFO:teuthology.orchestra.run.smithi006.stdout: "hit_set_grade_decay_rate": 0, 2023-08-01T19:56:09.238 INFO:teuthology.orchestra.run.smithi006.stdout: "hit_set_search_last_n": 0, 2023-08-01T19:56:09.238 INFO:teuthology.orchestra.run.smithi006.stdout: "grade_table": [], 2023-08-01T19:56:09.238 INFO:teuthology.orchestra.run.smithi006.stdout: "stripe_width": 0, 2023-08-01T19:56:09.238 INFO:teuthology.orchestra.run.smithi006.stdout: "expected_num_objects": 0, 2023-08-01T19:56:09.239 INFO:teuthology.orchestra.run.smithi006.stdout: "fast_read": false, 2023-08-01T19:56:09.239 INFO:teuthology.orchestra.run.smithi006.stdout: "options": { 2023-08-01T19:56:09.239 INFO:teuthology.orchestra.run.smithi006.stdout: "pg_num_min": 64, 2023-08-01T19:56:09.239 INFO:teuthology.orchestra.run.smithi006.stdout: "target_size_ratio": 0.89999997615814209 2023-08-01T19:56:09.239 INFO:teuthology.orchestra.run.smithi006.stdout: }, 2023-08-01T19:56:09.239 INFO:teuthology.orchestra.run.smithi006.stdout: "application_metadata": { 2023-08-01T19:56:09.239 INFO:teuthology.orchestra.run.smithi006.stdout: "cephfs": { 2023-08-01T19:56:09.239 INFO:teuthology.orchestra.run.smithi006.stdout: "data": "cephfs" 2023-08-01T19:56:09.240 INFO:teuthology.orchestra.run.smithi006.stdout: } 2023-08-01T19:56:09.240 INFO:teuthology.orchestra.run.smithi006.stdout: } 2023-08-01T19:56:09.240 INFO:teuthology.orchestra.run.smithi006.stdout: }, 2023-08-01T19:56:09.240 INFO:teuthology.orchestra.run.smithi006.stdout: { 2023-08-01T19:56:09.240 INFO:teuthology.orchestra.run.smithi006.stdout: "pool": 5, 2023-08-01T19:56:09.240 INFO:teuthology.orchestra.run.smithi006.stdout: "pool_name": "unique_pool_0", 2023-08-01T19:56:09.240 INFO:teuthology.orchestra.run.smithi006.stdout: "create_time": "2023-08-01T19:54:21.165668+0000", 2023-08-01T19:56:09.240 INFO:teuthology.orchestra.run.smithi006.stdout: "flags": 1, 2023-08-01T19:56:09.241 INFO:teuthology.orchestra.run.smithi006.stdout: "flags_names": "hashpspool", 2023-08-01T19:56:09.241 INFO:teuthology.orchestra.run.smithi006.stdout: "type": 1, 2023-08-01T19:56:09.241 INFO:teuthology.orchestra.run.smithi006.stdout: "size": 2, 2023-08-01T19:56:09.241 INFO:teuthology.orchestra.run.smithi006.stdout: "min_size": 1, 2023-08-01T19:56:09.241 INFO:teuthology.orchestra.run.smithi006.stdout: "crush_rule": 0, 2023-08-01T19:56:09.241 INFO:teuthology.orchestra.run.smithi006.stdout: "peering_crush_bucket_count": 0, 2023-08-01T19:56:09.241 INFO:teuthology.orchestra.run.smithi006.stdout: "peering_crush_bucket_target": 0, 2023-08-01T19:56:09.241 INFO:teuthology.orchestra.run.smithi006.stdout: "peering_crush_bucket_barrier": 0, 2023-08-01T19:56:09.242 INFO:teuthology.orchestra.run.smithi006.stdout: "peering_crush_bucket_mandatory_member": 2147483647, 2023-08-01T19:56:09.242 INFO:teuthology.orchestra.run.smithi006.stdout: "object_hash": 2, 2023-08-01T19:56:09.242 INFO:teuthology.orchestra.run.smithi006.stdout: "pg_autoscale_mode": "off", 2023-08-01T19:56:09.242 INFO:teuthology.orchestra.run.smithi006.stdout: "pg_num": 16, 2023-08-01T19:56:09.242 INFO:teuthology.orchestra.run.smithi006.stdout: "pg_placement_num": 16, 2023-08-01T19:56:09.242 INFO:teuthology.orchestra.run.smithi006.stdout: "pg_placement_num_target": 16, 2023-08-01T19:56:09.242 INFO:teuthology.orchestra.run.smithi006.stdout: "pg_num_target": 16, 2023-08-01T19:56:09.242 INFO:teuthology.orchestra.run.smithi006.stdout: "pg_num_pending": 16, 2023-08-01T19:56:09.243 INFO:teuthology.orchestra.run.smithi006.stdout: "last_pg_merge_meta": { 2023-08-01T19:56:09.243 INFO:teuthology.orchestra.run.smithi006.stdout: "source_pgid": "0.0", 2023-08-01T19:56:09.243 INFO:teuthology.orchestra.run.smithi006.stdout: "ready_epoch": 0, 2023-08-01T19:56:09.243 INFO:teuthology.orchestra.run.smithi006.stdout: "last_epoch_started": 0, 2023-08-01T19:56:09.243 INFO:teuthology.orchestra.run.smithi006.stdout: "last_epoch_clean": 0, 2023-08-01T19:56:09.243 INFO:teuthology.orchestra.run.smithi006.stdout: "source_version": "0'0", 2023-08-01T19:56:09.243 INFO:teuthology.orchestra.run.smithi006.stdout: "target_version": "0'0" 2023-08-01T19:56:09.243 INFO:teuthology.orchestra.run.smithi006.stdout: }, 2023-08-01T19:56:09.244 INFO:teuthology.orchestra.run.smithi006.stdout: "last_change": "21", 2023-08-01T19:56:09.244 INFO:teuthology.orchestra.run.smithi006.stdout: "last_force_op_resend": "0", 2023-08-01T19:56:09.244 INFO:teuthology.orchestra.run.smithi006.stdout: "last_force_op_resend_prenautilus": "0", 2023-08-01T19:56:09.244 INFO:teuthology.orchestra.run.smithi006.stdout: "last_force_op_resend_preluminous": "0", 2023-08-01T19:56:09.244 INFO:teuthology.orchestra.run.smithi006.stdout: "auid": 0, 2023-08-01T19:56:09.244 INFO:teuthology.orchestra.run.smithi006.stdout: "snap_mode": "selfmanaged", 2023-08-01T19:56:09.244 INFO:teuthology.orchestra.run.smithi006.stdout: "snap_seq": 0, 2023-08-01T19:56:09.245 INFO:teuthology.orchestra.run.smithi006.stdout: "snap_epoch": 0, 2023-08-01T19:56:09.245 INFO:teuthology.orchestra.run.smithi006.stdout: "pool_snaps": [], 2023-08-01T19:56:09.245 INFO:teuthology.orchestra.run.smithi006.stdout: "removed_snaps": "[]", 2023-08-01T19:56:09.245 INFO:teuthology.orchestra.run.smithi006.stdout: "quota_max_bytes": 0, 2023-08-01T19:56:09.245 INFO:teuthology.orchestra.run.smithi006.stdout: "quota_max_objects": 0, 2023-08-01T19:56:09.245 INFO:teuthology.orchestra.run.smithi006.stdout: "tiers": [], 2023-08-01T19:56:09.245 INFO:teuthology.orchestra.run.smithi006.stdout: "tier_of": -1, 2023-08-01T19:56:09.245 INFO:teuthology.orchestra.run.smithi006.stdout: "read_tier": -1, 2023-08-01T19:56:09.246 INFO:teuthology.orchestra.run.smithi006.stdout: "write_tier": -1, 2023-08-01T19:56:09.246 INFO:teuthology.orchestra.run.smithi006.stdout: "cache_mode": "none", 2023-08-01T19:56:09.246 INFO:teuthology.orchestra.run.smithi006.stdout: "target_max_bytes": 0, 2023-08-01T19:56:09.246 INFO:teuthology.orchestra.run.smithi006.stdout: "target_max_objects": 0, 2023-08-01T19:56:09.246 INFO:teuthology.orchestra.run.smithi006.stdout: "cache_target_dirty_ratio_micro": 400000, 2023-08-01T19:56:09.246 INFO:teuthology.orchestra.run.smithi006.stdout: "cache_target_dirty_high_ratio_micro": 600000, 2023-08-01T19:56:09.246 INFO:teuthology.orchestra.run.smithi006.stdout: "cache_target_full_ratio_micro": 800000, 2023-08-01T19:56:09.246 INFO:teuthology.orchestra.run.smithi006.stdout: "cache_min_flush_age": 0, 2023-08-01T19:56:09.247 INFO:teuthology.orchestra.run.smithi006.stdout: "cache_min_evict_age": 0, 2023-08-01T19:56:09.247 INFO:teuthology.orchestra.run.smithi006.stdout: "erasure_code_profile": "", 2023-08-01T19:56:09.247 INFO:teuthology.orchestra.run.smithi006.stdout: "hit_set_params": { 2023-08-01T19:56:09.247 INFO:teuthology.orchestra.run.smithi006.stdout: "type": "none" 2023-08-01T19:56:09.247 INFO:teuthology.orchestra.run.smithi006.stdout: }, 2023-08-01T19:56:09.247 INFO:teuthology.orchestra.run.smithi006.stdout: "hit_set_period": 0, 2023-08-01T19:56:09.247 INFO:teuthology.orchestra.run.smithi006.stdout: "hit_set_count": 0, 2023-08-01T19:56:09.247 INFO:teuthology.orchestra.run.smithi006.stdout: "use_gmt_hitset": true, 2023-08-01T19:56:09.248 INFO:teuthology.orchestra.run.smithi006.stdout: "min_read_recency_for_promote": 0, 2023-08-01T19:56:09.248 INFO:teuthology.orchestra.run.smithi006.stdout: "min_write_recency_for_promote": 0, 2023-08-01T19:56:09.248 INFO:teuthology.orchestra.run.smithi006.stdout: "hit_set_grade_decay_rate": 0, 2023-08-01T19:56:09.248 INFO:teuthology.orchestra.run.smithi006.stdout: "hit_set_search_last_n": 0, 2023-08-01T19:56:09.248 INFO:teuthology.orchestra.run.smithi006.stdout: "grade_table": [], 2023-08-01T19:56:09.248 INFO:teuthology.orchestra.run.smithi006.stdout: "stripe_width": 0, 2023-08-01T19:56:09.248 INFO:teuthology.orchestra.run.smithi006.stdout: "expected_num_objects": 0, 2023-08-01T19:56:09.248 INFO:teuthology.orchestra.run.smithi006.stdout: "fast_read": false, 2023-08-01T19:56:09.249 INFO:teuthology.orchestra.run.smithi006.stdout: "options": {}, 2023-08-01T19:56:09.249 INFO:teuthology.orchestra.run.smithi006.stdout: "application_metadata": { 2023-08-01T19:56:09.249 INFO:teuthology.orchestra.run.smithi006.stdout: "rados": {} 2023-08-01T19:56:09.249 INFO:teuthology.orchestra.run.smithi006.stdout: } 2023-08-01T19:56:09.249 INFO:teuthology.orchestra.run.smithi006.stdout: } 2023-08-01T19:56:09.249 INFO:teuthology.orchestra.run.smithi006.stdout: ], 2023-08-01T19:56:09.249 INFO:teuthology.orchestra.run.smithi006.stdout: "osds": [ 2023-08-01T19:56:09.249 INFO:teuthology.orchestra.run.smithi006.stdout: { 2023-08-01T19:56:09.250 INFO:teuthology.orchestra.run.smithi006.stdout: "osd": 0, 2023-08-01T19:56:09.250 INFO:teuthology.orchestra.run.smithi006.stdout: "uuid": "5dd675c7-2777-48f2-8009-ff0e0d4c7086", 2023-08-01T19:56:09.250 INFO:teuthology.orchestra.run.smithi006.stdout: "up": 1, 2023-08-01T19:56:09.250 INFO:teuthology.orchestra.run.smithi006.stdout: "in": 1, 2023-08-01T19:56:09.250 INFO:teuthology.orchestra.run.smithi006.stdout: "weight": 1, 2023-08-01T19:56:09.250 INFO:teuthology.orchestra.run.smithi006.stdout: "primary_affinity": 0.822052001953125, 2023-08-01T19:56:09.250 INFO:teuthology.orchestra.run.smithi006.stdout: "last_clean_begin": 0, 2023-08-01T19:56:09.251 INFO:teuthology.orchestra.run.smithi006.stdout: "last_clean_end": 0, 2023-08-01T19:56:09.251 INFO:teuthology.orchestra.run.smithi006.stdout: "up_from": 8, 2023-08-01T19:56:09.251 INFO:teuthology.orchestra.run.smithi006.stdout: "up_thru": 62, 2023-08-01T19:56:09.251 INFO:teuthology.orchestra.run.smithi006.stdout: "down_at": 0, 2023-08-01T19:56:09.251 INFO:teuthology.orchestra.run.smithi006.stdout: "lost_at": 0, 2023-08-01T19:56:09.251 INFO:teuthology.orchestra.run.smithi006.stdout: "public_addrs": { 2023-08-01T19:56:09.251 INFO:teuthology.orchestra.run.smithi006.stdout: "addrvec": [ 2023-08-01T19:56:09.251 INFO:teuthology.orchestra.run.smithi006.stdout: { 2023-08-01T19:56:09.252 INFO:teuthology.orchestra.run.smithi006.stdout: "type": "v2", 2023-08-01T19:56:09.252 INFO:teuthology.orchestra.run.smithi006.stdout: "addr": "172.21.15.8:6800", 2023-08-01T19:56:09.252 INFO:teuthology.orchestra.run.smithi006.stdout: "nonce": 111181 2023-08-01T19:56:09.252 INFO:teuthology.orchestra.run.smithi006.stdout: }, 2023-08-01T19:56:09.252 INFO:teuthology.orchestra.run.smithi006.stdout: { 2023-08-01T19:56:09.252 INFO:teuthology.orchestra.run.smithi006.stdout: "type": "v1", 2023-08-01T19:56:09.252 INFO:teuthology.orchestra.run.smithi006.stdout: "addr": "172.21.15.8:6801", 2023-08-01T19:56:09.252 INFO:teuthology.orchestra.run.smithi006.stdout: "nonce": 111181 2023-08-01T19:56:09.253 INFO:teuthology.orchestra.run.smithi006.stdout: } 2023-08-01T19:56:09.253 INFO:teuthology.orchestra.run.smithi006.stdout: ] 2023-08-01T19:56:09.253 INFO:teuthology.orchestra.run.smithi006.stdout: }, 2023-08-01T19:56:09.253 INFO:teuthology.orchestra.run.smithi006.stdout: "cluster_addrs": { 2023-08-01T19:56:09.253 INFO:teuthology.orchestra.run.smithi006.stdout: "addrvec": [ 2023-08-01T19:56:09.253 INFO:teuthology.orchestra.run.smithi006.stdout: { 2023-08-01T19:56:09.253 INFO:teuthology.orchestra.run.smithi006.stdout: "type": "v2", 2023-08-01T19:56:09.253 INFO:teuthology.orchestra.run.smithi006.stdout: "addr": "172.21.15.8:6802", 2023-08-01T19:56:09.254 INFO:teuthology.orchestra.run.smithi006.stdout: "nonce": 111181 2023-08-01T19:56:09.254 INFO:teuthology.orchestra.run.smithi006.stdout: }, 2023-08-01T19:56:09.254 INFO:teuthology.orchestra.run.smithi006.stdout: { 2023-08-01T19:56:09.254 INFO:teuthology.orchestra.run.smithi006.stdout: "type": "v1", 2023-08-01T19:56:09.254 INFO:teuthology.orchestra.run.smithi006.stdout: "addr": "172.21.15.8:6803", 2023-08-01T19:56:09.254 INFO:teuthology.orchestra.run.smithi006.stdout: "nonce": 111181 2023-08-01T19:56:09.254 INFO:teuthology.orchestra.run.smithi006.stdout: } 2023-08-01T19:56:09.254 INFO:teuthology.orchestra.run.smithi006.stdout: ] 2023-08-01T19:56:09.255 INFO:teuthology.orchestra.run.smithi006.stdout: }, 2023-08-01T19:56:09.255 INFO:teuthology.orchestra.run.smithi006.stdout: "heartbeat_back_addrs": { 2023-08-01T19:56:09.255 INFO:teuthology.orchestra.run.smithi006.stdout: "addrvec": [ 2023-08-01T19:56:09.255 INFO:teuthology.orchestra.run.smithi006.stdout: { 2023-08-01T19:56:09.255 INFO:teuthology.orchestra.run.smithi006.stdout: "type": "v2", 2023-08-01T19:56:09.255 INFO:teuthology.orchestra.run.smithi006.stdout: "addr": "172.21.15.8:6806", 2023-08-01T19:56:09.255 INFO:teuthology.orchestra.run.smithi006.stdout: "nonce": 111181 2023-08-01T19:56:09.255 INFO:teuthology.orchestra.run.smithi006.stdout: }, 2023-08-01T19:56:09.256 INFO:teuthology.orchestra.run.smithi006.stdout: { 2023-08-01T19:56:09.256 INFO:teuthology.orchestra.run.smithi006.stdout: "type": "v1", 2023-08-01T19:56:09.256 INFO:teuthology.orchestra.run.smithi006.stdout: "addr": "172.21.15.8:6807", 2023-08-01T19:56:09.256 INFO:teuthology.orchestra.run.smithi006.stdout: "nonce": 111181 2023-08-01T19:56:09.256 INFO:teuthology.orchestra.run.smithi006.stdout: } 2023-08-01T19:56:09.256 INFO:teuthology.orchestra.run.smithi006.stdout: ] 2023-08-01T19:56:09.256 INFO:teuthology.orchestra.run.smithi006.stdout: }, 2023-08-01T19:56:09.257 INFO:teuthology.orchestra.run.smithi006.stdout: "heartbeat_front_addrs": { 2023-08-01T19:56:09.257 INFO:teuthology.orchestra.run.smithi006.stdout: "addrvec": [ 2023-08-01T19:56:09.257 INFO:teuthology.orchestra.run.smithi006.stdout: { 2023-08-01T19:56:09.257 INFO:teuthology.orchestra.run.smithi006.stdout: "type": "v2", 2023-08-01T19:56:09.257 INFO:teuthology.orchestra.run.smithi006.stdout: "addr": "172.21.15.8:6804", 2023-08-01T19:56:09.257 INFO:teuthology.orchestra.run.smithi006.stdout: "nonce": 111181 2023-08-01T19:56:09.257 INFO:teuthology.orchestra.run.smithi006.stdout: }, 2023-08-01T19:56:09.257 INFO:teuthology.orchestra.run.smithi006.stdout: { 2023-08-01T19:56:09.258 INFO:teuthology.orchestra.run.smithi006.stdout: "type": "v1", 2023-08-01T19:56:09.258 INFO:teuthology.orchestra.run.smithi006.stdout: "addr": "172.21.15.8:6805", 2023-08-01T19:56:09.258 INFO:teuthology.orchestra.run.smithi006.stdout: "nonce": 111181 2023-08-01T19:56:09.258 INFO:teuthology.orchestra.run.smithi006.stdout: } 2023-08-01T19:56:09.258 INFO:teuthology.orchestra.run.smithi006.stdout: ] 2023-08-01T19:56:09.258 INFO:teuthology.orchestra.run.smithi006.stdout: }, 2023-08-01T19:56:09.258 INFO:teuthology.orchestra.run.smithi006.stdout: "public_addr": "172.21.15.8:6801/111181", 2023-08-01T19:56:09.258 INFO:teuthology.orchestra.run.smithi006.stdout: "cluster_addr": "172.21.15.8:6803/111181", 2023-08-01T19:56:09.259 INFO:teuthology.orchestra.run.smithi006.stdout: "heartbeat_back_addr": "172.21.15.8:6807/111181", 2023-08-01T19:56:09.259 INFO:teuthology.orchestra.run.smithi006.stdout: "heartbeat_front_addr": "172.21.15.8:6805/111181", 2023-08-01T19:56:09.259 INFO:teuthology.orchestra.run.smithi006.stdout: "state": [ 2023-08-01T19:56:09.259 INFO:teuthology.orchestra.run.smithi006.stdout: "exists", 2023-08-01T19:56:09.259 INFO:teuthology.orchestra.run.smithi006.stdout: "up" 2023-08-01T19:56:09.259 INFO:teuthology.orchestra.run.smithi006.stdout: ] 2023-08-01T19:56:09.259 INFO:teuthology.orchestra.run.smithi006.stdout: }, 2023-08-01T19:56:09.259 INFO:teuthology.orchestra.run.smithi006.stdout: { 2023-08-01T19:56:09.260 INFO:teuthology.orchestra.run.smithi006.stdout: "osd": 1, 2023-08-01T19:56:09.260 INFO:teuthology.orchestra.run.smithi006.stdout: "uuid": "7fc612c4-33ba-4a33-bca8-1f42ee8ed548", 2023-08-01T19:56:09.260 INFO:teuthology.orchestra.run.smithi006.stdout: "up": 0, 2023-08-01T19:56:09.260 INFO:teuthology.orchestra.run.smithi006.stdout: "in": 1, 2023-08-01T19:56:09.260 INFO:teuthology.orchestra.run.smithi006.stdout: "weight": 1, 2023-08-01T19:56:09.260 INFO:teuthology.orchestra.run.smithi006.stdout: "primary_affinity": 0.3376312255859375, 2023-08-01T19:56:09.260 INFO:teuthology.orchestra.run.smithi006.stdout: "last_clean_begin": 0, 2023-08-01T19:56:09.260 INFO:teuthology.orchestra.run.smithi006.stdout: "last_clean_end": 0, 2023-08-01T19:56:09.261 INFO:teuthology.orchestra.run.smithi006.stdout: "up_from": 8, 2023-08-01T19:56:09.261 INFO:teuthology.orchestra.run.smithi006.stdout: "up_thru": 53, 2023-08-01T19:56:09.261 INFO:teuthology.orchestra.run.smithi006.stdout: "down_at": 62, 2023-08-01T19:56:09.261 INFO:teuthology.orchestra.run.smithi006.stdout: "lost_at": 0, 2023-08-01T19:56:09.261 INFO:teuthology.orchestra.run.smithi006.stdout: "public_addrs": { 2023-08-01T19:56:09.261 INFO:teuthology.orchestra.run.smithi006.stdout: "addrvec": [ 2023-08-01T19:56:09.261 INFO:teuthology.orchestra.run.smithi006.stdout: { 2023-08-01T19:56:09.262 INFO:teuthology.orchestra.run.smithi006.stdout: "type": "v2", 2023-08-01T19:56:09.262 INFO:teuthology.orchestra.run.smithi006.stdout: "addr": "172.21.15.101:6800", 2023-08-01T19:56:09.262 INFO:teuthology.orchestra.run.smithi006.stdout: "nonce": 111143 2023-08-01T19:56:09.262 INFO:teuthology.orchestra.run.smithi006.stdout: }, 2023-08-01T19:56:09.262 INFO:teuthology.orchestra.run.smithi006.stdout: { 2023-08-01T19:56:09.262 INFO:teuthology.orchestra.run.smithi006.stdout: "type": "v1", 2023-08-01T19:56:09.262 INFO:teuthology.orchestra.run.smithi006.stdout: "addr": "172.21.15.101:6801", 2023-08-01T19:56:09.262 INFO:teuthology.orchestra.run.smithi006.stdout: "nonce": 111143 2023-08-01T19:56:09.263 INFO:teuthology.orchestra.run.smithi006.stdout: } 2023-08-01T19:56:09.263 INFO:teuthology.orchestra.run.smithi006.stdout: ] 2023-08-01T19:56:09.263 INFO:teuthology.orchestra.run.smithi006.stdout: }, 2023-08-01T19:56:09.263 INFO:teuthology.orchestra.run.smithi006.stdout: "cluster_addrs": { 2023-08-01T19:56:09.263 INFO:teuthology.orchestra.run.smithi006.stdout: "addrvec": [ 2023-08-01T19:56:09.263 INFO:teuthology.orchestra.run.smithi006.stdout: { 2023-08-01T19:56:09.263 INFO:teuthology.orchestra.run.smithi006.stdout: "type": "v2", 2023-08-01T19:56:09.263 INFO:teuthology.orchestra.run.smithi006.stdout: "addr": "172.21.15.101:6802", 2023-08-01T19:56:09.264 INFO:teuthology.orchestra.run.smithi006.stdout: "nonce": 111143 2023-08-01T19:56:09.264 INFO:teuthology.orchestra.run.smithi006.stdout: }, 2023-08-01T19:56:09.264 INFO:teuthology.orchestra.run.smithi006.stdout: { 2023-08-01T19:56:09.264 INFO:teuthology.orchestra.run.smithi006.stdout: "type": "v1", 2023-08-01T19:56:09.264 INFO:teuthology.orchestra.run.smithi006.stdout: "addr": "172.21.15.101:6803", 2023-08-01T19:56:09.264 INFO:teuthology.orchestra.run.smithi006.stdout: "nonce": 111143 2023-08-01T19:56:09.264 INFO:teuthology.orchestra.run.smithi006.stdout: } 2023-08-01T19:56:09.264 INFO:teuthology.orchestra.run.smithi006.stdout: ] 2023-08-01T19:56:09.265 INFO:teuthology.orchestra.run.smithi006.stdout: }, 2023-08-01T19:56:09.265 INFO:teuthology.orchestra.run.smithi006.stdout: "heartbeat_back_addrs": { 2023-08-01T19:56:09.265 INFO:teuthology.orchestra.run.smithi006.stdout: "addrvec": [ 2023-08-01T19:56:09.265 INFO:teuthology.orchestra.run.smithi006.stdout: { 2023-08-01T19:56:09.265 INFO:teuthology.orchestra.run.smithi006.stdout: "type": "v2", 2023-08-01T19:56:09.265 INFO:teuthology.orchestra.run.smithi006.stdout: "addr": "172.21.15.101:6806", 2023-08-01T19:56:09.265 INFO:teuthology.orchestra.run.smithi006.stdout: "nonce": 111143 2023-08-01T19:56:09.265 INFO:teuthology.orchestra.run.smithi006.stdout: }, 2023-08-01T19:56:09.266 INFO:teuthology.orchestra.run.smithi006.stdout: { 2023-08-01T19:56:09.266 INFO:teuthology.orchestra.run.smithi006.stdout: "type": "v1", 2023-08-01T19:56:09.266 INFO:teuthology.orchestra.run.smithi006.stdout: "addr": "172.21.15.101:6807", 2023-08-01T19:56:09.266 INFO:teuthology.orchestra.run.smithi006.stdout: "nonce": 111143 2023-08-01T19:56:09.266 INFO:teuthology.orchestra.run.smithi006.stdout: } 2023-08-01T19:56:09.266 INFO:teuthology.orchestra.run.smithi006.stdout: ] 2023-08-01T19:56:09.266 INFO:teuthology.orchestra.run.smithi006.stdout: }, 2023-08-01T19:56:09.266 INFO:teuthology.orchestra.run.smithi006.stdout: "heartbeat_front_addrs": { 2023-08-01T19:56:09.267 INFO:teuthology.orchestra.run.smithi006.stdout: "addrvec": [ 2023-08-01T19:56:09.267 INFO:teuthology.orchestra.run.smithi006.stdout: { 2023-08-01T19:56:09.267 INFO:teuthology.orchestra.run.smithi006.stdout: "type": "v2", 2023-08-01T19:56:09.267 INFO:teuthology.orchestra.run.smithi006.stdout: "addr": "172.21.15.101:6804", 2023-08-01T19:56:09.267 INFO:teuthology.orchestra.run.smithi006.stdout: "nonce": 111143 2023-08-01T19:56:09.267 INFO:teuthology.orchestra.run.smithi006.stdout: }, 2023-08-01T19:56:09.267 INFO:teuthology.orchestra.run.smithi006.stdout: { 2023-08-01T19:56:09.267 INFO:teuthology.orchestra.run.smithi006.stdout: "type": "v1", 2023-08-01T19:56:09.268 INFO:teuthology.orchestra.run.smithi006.stdout: "addr": "172.21.15.101:6805", 2023-08-01T19:56:09.268 INFO:teuthology.orchestra.run.smithi006.stdout: "nonce": 111143 2023-08-01T19:56:09.268 INFO:teuthology.orchestra.run.smithi006.stdout: } 2023-08-01T19:56:09.268 INFO:teuthology.orchestra.run.smithi006.stdout: ] 2023-08-01T19:56:09.268 INFO:teuthology.orchestra.run.smithi006.stdout: }, 2023-08-01T19:56:09.268 INFO:teuthology.orchestra.run.smithi006.stdout: "public_addr": "172.21.15.101:6801/111143", 2023-08-01T19:56:09.268 INFO:teuthology.orchestra.run.smithi006.stdout: "cluster_addr": "172.21.15.101:6803/111143", 2023-08-01T19:56:09.268 INFO:teuthology.orchestra.run.smithi006.stdout: "heartbeat_back_addr": "172.21.15.101:6807/111143", 2023-08-01T19:56:09.269 INFO:teuthology.orchestra.run.smithi006.stdout: "heartbeat_front_addr": "172.21.15.101:6805/111143", 2023-08-01T19:56:09.269 INFO:teuthology.orchestra.run.smithi006.stdout: "state": [ 2023-08-01T19:56:09.269 INFO:teuthology.orchestra.run.smithi006.stdout: "exists" 2023-08-01T19:56:09.269 INFO:teuthology.orchestra.run.smithi006.stdout: ] 2023-08-01T19:56:09.269 INFO:teuthology.orchestra.run.smithi006.stdout: }, 2023-08-01T19:56:09.269 INFO:teuthology.orchestra.run.smithi006.stdout: { 2023-08-01T19:56:09.269 INFO:teuthology.orchestra.run.smithi006.stdout: "osd": 2, 2023-08-01T19:56:09.270 INFO:teuthology.orchestra.run.smithi006.stdout: "uuid": "f85cadbc-4230-4772-8f39-62ed52e220b1", 2023-08-01T19:56:09.270 INFO:teuthology.orchestra.run.smithi006.stdout: "up": 1, 2023-08-01T19:56:09.270 INFO:teuthology.orchestra.run.smithi006.stdout: "in": 1, 2023-08-01T19:56:09.270 INFO:teuthology.orchestra.run.smithi006.stdout: "weight": 1, 2023-08-01T19:56:09.270 INFO:teuthology.orchestra.run.smithi006.stdout: "primary_affinity": 1, 2023-08-01T19:56:09.270 INFO:teuthology.orchestra.run.smithi006.stdout: "last_clean_begin": 0, 2023-08-01T19:56:09.270 INFO:teuthology.orchestra.run.smithi006.stdout: "last_clean_end": 0, 2023-08-01T19:56:09.270 INFO:teuthology.orchestra.run.smithi006.stdout: "up_from": 9, 2023-08-01T19:56:09.271 INFO:teuthology.orchestra.run.smithi006.stdout: "up_thru": 62, 2023-08-01T19:56:09.271 INFO:teuthology.orchestra.run.smithi006.stdout: "down_at": 0, 2023-08-01T19:56:09.271 INFO:teuthology.orchestra.run.smithi006.stdout: "lost_at": 0, 2023-08-01T19:56:09.271 INFO:teuthology.orchestra.run.smithi006.stdout: "public_addrs": { 2023-08-01T19:56:09.271 INFO:teuthology.orchestra.run.smithi006.stdout: "addrvec": [ 2023-08-01T19:56:09.271 INFO:teuthology.orchestra.run.smithi006.stdout: { 2023-08-01T19:56:09.271 INFO:teuthology.orchestra.run.smithi006.stdout: "type": "v2", 2023-08-01T19:56:09.271 INFO:teuthology.orchestra.run.smithi006.stdout: "addr": "172.21.15.155:6800", 2023-08-01T19:56:09.272 INFO:teuthology.orchestra.run.smithi006.stdout: "nonce": 111339 2023-08-01T19:56:09.272 INFO:teuthology.orchestra.run.smithi006.stdout: }, 2023-08-01T19:56:09.272 INFO:teuthology.orchestra.run.smithi006.stdout: { 2023-08-01T19:56:09.272 INFO:teuthology.orchestra.run.smithi006.stdout: "type": "v1", 2023-08-01T19:56:09.272 INFO:teuthology.orchestra.run.smithi006.stdout: "addr": "172.21.15.155:6801", 2023-08-01T19:56:09.272 INFO:teuthology.orchestra.run.smithi006.stdout: "nonce": 111339 2023-08-01T19:56:09.272 INFO:teuthology.orchestra.run.smithi006.stdout: } 2023-08-01T19:56:09.272 INFO:teuthology.orchestra.run.smithi006.stdout: ] 2023-08-01T19:56:09.273 INFO:teuthology.orchestra.run.smithi006.stdout: }, 2023-08-01T19:56:09.273 INFO:teuthology.orchestra.run.smithi006.stdout: "cluster_addrs": { 2023-08-01T19:56:09.273 INFO:teuthology.orchestra.run.smithi006.stdout: "addrvec": [ 2023-08-01T19:56:09.273 INFO:teuthology.orchestra.run.smithi006.stdout: { 2023-08-01T19:56:09.273 INFO:teuthology.orchestra.run.smithi006.stdout: "type": "v2", 2023-08-01T19:56:09.273 INFO:teuthology.orchestra.run.smithi006.stdout: "addr": "172.21.15.155:6802", 2023-08-01T19:56:09.273 INFO:teuthology.orchestra.run.smithi006.stdout: "nonce": 111339 2023-08-01T19:56:09.273 INFO:teuthology.orchestra.run.smithi006.stdout: }, 2023-08-01T19:56:09.274 INFO:teuthology.orchestra.run.smithi006.stdout: { 2023-08-01T19:56:09.274 INFO:teuthology.orchestra.run.smithi006.stdout: "type": "v1", 2023-08-01T19:56:09.274 INFO:teuthology.orchestra.run.smithi006.stdout: "addr": "172.21.15.155:6803", 2023-08-01T19:56:09.274 INFO:teuthology.orchestra.run.smithi006.stdout: "nonce": 111339 2023-08-01T19:56:09.274 INFO:teuthology.orchestra.run.smithi006.stdout: } 2023-08-01T19:56:09.274 INFO:teuthology.orchestra.run.smithi006.stdout: ] 2023-08-01T19:56:09.274 INFO:teuthology.orchestra.run.smithi006.stdout: }, 2023-08-01T19:56:09.275 INFO:teuthology.orchestra.run.smithi006.stdout: "heartbeat_back_addrs": { 2023-08-01T19:56:09.275 INFO:teuthology.orchestra.run.smithi006.stdout: "addrvec": [ 2023-08-01T19:56:09.275 INFO:teuthology.orchestra.run.smithi006.stdout: { 2023-08-01T19:56:09.275 INFO:teuthology.orchestra.run.smithi006.stdout: "type": "v2", 2023-08-01T19:56:09.275 INFO:teuthology.orchestra.run.smithi006.stdout: "addr": "172.21.15.155:6806", 2023-08-01T19:56:09.275 INFO:teuthology.orchestra.run.smithi006.stdout: "nonce": 111339 2023-08-01T19:56:09.275 INFO:teuthology.orchestra.run.smithi006.stdout: }, 2023-08-01T19:56:09.275 INFO:teuthology.orchestra.run.smithi006.stdout: { 2023-08-01T19:56:09.276 INFO:teuthology.orchestra.run.smithi006.stdout: "type": "v1", 2023-08-01T19:56:09.276 INFO:teuthology.orchestra.run.smithi006.stdout: "addr": "172.21.15.155:6807", 2023-08-01T19:56:09.276 INFO:teuthology.orchestra.run.smithi006.stdout: "nonce": 111339 2023-08-01T19:56:09.276 INFO:teuthology.orchestra.run.smithi006.stdout: } 2023-08-01T19:56:09.276 INFO:teuthology.orchestra.run.smithi006.stdout: ] 2023-08-01T19:56:09.276 INFO:teuthology.orchestra.run.smithi006.stdout: }, 2023-08-01T19:56:09.276 INFO:teuthology.orchestra.run.smithi006.stdout: "heartbeat_front_addrs": { 2023-08-01T19:56:09.276 INFO:teuthology.orchestra.run.smithi006.stdout: "addrvec": [ 2023-08-01T19:56:09.277 INFO:teuthology.orchestra.run.smithi006.stdout: { 2023-08-01T19:56:09.277 INFO:teuthology.orchestra.run.smithi006.stdout: "type": "v2", 2023-08-01T19:56:09.277 INFO:teuthology.orchestra.run.smithi006.stdout: "addr": "172.21.15.155:6804", 2023-08-01T19:56:09.277 INFO:teuthology.orchestra.run.smithi006.stdout: "nonce": 111339 2023-08-01T19:56:09.277 INFO:teuthology.orchestra.run.smithi006.stdout: }, 2023-08-01T19:56:09.277 INFO:teuthology.orchestra.run.smithi006.stdout: { 2023-08-01T19:56:09.277 INFO:teuthology.orchestra.run.smithi006.stdout: "type": "v1", 2023-08-01T19:56:09.277 INFO:teuthology.orchestra.run.smithi006.stdout: "addr": "172.21.15.155:6805", 2023-08-01T19:56:09.278 INFO:teuthology.orchestra.run.smithi006.stdout: "nonce": 111339 2023-08-01T19:56:09.278 INFO:teuthology.orchestra.run.smithi006.stdout: } 2023-08-01T19:56:09.278 INFO:teuthology.orchestra.run.smithi006.stdout: ] 2023-08-01T19:56:09.278 INFO:teuthology.orchestra.run.smithi006.stdout: }, 2023-08-01T19:56:09.278 INFO:teuthology.orchestra.run.smithi006.stdout: "public_addr": "172.21.15.155:6801/111339", 2023-08-01T19:56:09.278 INFO:teuthology.orchestra.run.smithi006.stdout: "cluster_addr": "172.21.15.155:6803/111339", 2023-08-01T19:56:09.278 INFO:teuthology.orchestra.run.smithi006.stdout: "heartbeat_back_addr": "172.21.15.155:6807/111339", 2023-08-01T19:56:09.278 INFO:teuthology.orchestra.run.smithi006.stdout: "heartbeat_front_addr": "172.21.15.155:6805/111339", 2023-08-01T19:56:09.279 INFO:teuthology.orchestra.run.smithi006.stdout: "state": [ 2023-08-01T19:56:09.279 INFO:teuthology.orchestra.run.smithi006.stdout: "exists", 2023-08-01T19:56:09.279 INFO:teuthology.orchestra.run.smithi006.stdout: "up" 2023-08-01T19:56:09.279 INFO:teuthology.orchestra.run.smithi006.stdout: ] 2023-08-01T19:56:09.279 INFO:teuthology.orchestra.run.smithi006.stdout: } 2023-08-01T19:56:09.279 INFO:teuthology.orchestra.run.smithi006.stdout: ], 2023-08-01T19:56:09.279 INFO:teuthology.orchestra.run.smithi006.stdout: "osd_xinfo": [ 2023-08-01T19:56:09.279 INFO:teuthology.orchestra.run.smithi006.stdout: { 2023-08-01T19:56:09.280 INFO:teuthology.orchestra.run.smithi006.stdout: "osd": 0, 2023-08-01T19:56:09.280 INFO:teuthology.orchestra.run.smithi006.stdout: "down_stamp": "0.000000", 2023-08-01T19:56:09.280 INFO:teuthology.orchestra.run.smithi006.stdout: "laggy_probability": 0, 2023-08-01T19:56:09.280 INFO:teuthology.orchestra.run.smithi006.stdout: "laggy_interval": 0, 2023-08-01T19:56:09.280 INFO:teuthology.orchestra.run.smithi006.stdout: "features": 4540138320759226367, 2023-08-01T19:56:09.280 INFO:teuthology.orchestra.run.smithi006.stdout: "old_weight": 0, 2023-08-01T19:56:09.280 INFO:teuthology.orchestra.run.smithi006.stdout: "last_purged_snaps_scrub": "2023-08-01T19:53:48.018154+0000", 2023-08-01T19:56:09.280 INFO:teuthology.orchestra.run.smithi006.stdout: "dead_epoch": 0 2023-08-01T19:56:09.281 INFO:teuthology.orchestra.run.smithi006.stdout: }, 2023-08-01T19:56:09.281 INFO:teuthology.orchestra.run.smithi006.stdout: { 2023-08-01T19:56:09.281 INFO:teuthology.orchestra.run.smithi006.stdout: "osd": 1, 2023-08-01T19:56:09.281 INFO:teuthology.orchestra.run.smithi006.stdout: "down_stamp": "0.000000", 2023-08-01T19:56:09.281 INFO:teuthology.orchestra.run.smithi006.stdout: "laggy_probability": 0, 2023-08-01T19:56:09.281 INFO:teuthology.orchestra.run.smithi006.stdout: "laggy_interval": 0, 2023-08-01T19:56:09.281 INFO:teuthology.orchestra.run.smithi006.stdout: "features": 4540138320759226367, 2023-08-01T19:56:09.282 INFO:teuthology.orchestra.run.smithi006.stdout: "old_weight": 0, 2023-08-01T19:56:09.282 INFO:teuthology.orchestra.run.smithi006.stdout: "last_purged_snaps_scrub": "2023-08-01T19:53:48.000488+0000", 2023-08-01T19:56:09.282 INFO:teuthology.orchestra.run.smithi006.stdout: "dead_epoch": 61 2023-08-01T19:56:09.282 INFO:teuthology.orchestra.run.smithi006.stdout: }, 2023-08-01T19:56:09.282 INFO:teuthology.orchestra.run.smithi006.stdout: { 2023-08-01T19:56:09.282 INFO:teuthology.orchestra.run.smithi006.stdout: "osd": 2, 2023-08-01T19:56:09.282 INFO:teuthology.orchestra.run.smithi006.stdout: "down_stamp": "0.000000", 2023-08-01T19:56:09.282 INFO:teuthology.orchestra.run.smithi006.stdout: "laggy_probability": 0, 2023-08-01T19:56:09.283 INFO:teuthology.orchestra.run.smithi006.stdout: "laggy_interval": 0, 2023-08-01T19:56:09.283 INFO:teuthology.orchestra.run.smithi006.stdout: "features": 4540138320759226367, 2023-08-01T19:56:09.283 INFO:teuthology.orchestra.run.smithi006.stdout: "old_weight": 0, 2023-08-01T19:56:09.283 INFO:teuthology.orchestra.run.smithi006.stdout: "last_purged_snaps_scrub": "2023-08-01T19:53:48.072529+0000", 2023-08-01T19:56:09.283 INFO:teuthology.orchestra.run.smithi006.stdout: "dead_epoch": 0 2023-08-01T19:56:09.283 INFO:teuthology.orchestra.run.smithi006.stdout: } 2023-08-01T19:56:09.283 INFO:teuthology.orchestra.run.smithi006.stdout: ], 2023-08-01T19:56:09.283 INFO:teuthology.orchestra.run.smithi006.stdout: "pg_upmap": [], 2023-08-01T19:56:09.284 INFO:teuthology.orchestra.run.smithi006.stdout: "pg_upmap_items": [], 2023-08-01T19:56:09.284 INFO:teuthology.orchestra.run.smithi006.stdout: "pg_temp": [], 2023-08-01T19:56:09.284 INFO:teuthology.orchestra.run.smithi006.stdout: "primary_temp": [], 2023-08-01T19:56:09.284 INFO:teuthology.orchestra.run.smithi006.stdout: "blocklist": {}, 2023-08-01T19:56:09.284 INFO:teuthology.orchestra.run.smithi006.stdout: "range_blocklist": {}, 2023-08-01T19:56:09.284 INFO:teuthology.orchestra.run.smithi006.stdout: "erasure_code_profiles": { 2023-08-01T19:56:09.284 INFO:teuthology.orchestra.run.smithi006.stdout: "default": { 2023-08-01T19:56:09.284 INFO:teuthology.orchestra.run.smithi006.stdout: "crush-failure-domain": "osd", 2023-08-01T19:56:09.285 INFO:teuthology.orchestra.run.smithi006.stdout: "k": "2", 2023-08-01T19:56:09.285 INFO:teuthology.orchestra.run.smithi006.stdout: "m": "1", 2023-08-01T19:56:09.285 INFO:teuthology.orchestra.run.smithi006.stdout: "plugin": "jerasure", 2023-08-01T19:56:09.285 INFO:teuthology.orchestra.run.smithi006.stdout: "technique": "reed_sol_van" 2023-08-01T19:56:09.285 INFO:teuthology.orchestra.run.smithi006.stdout: } 2023-08-01T19:56:09.285 INFO:teuthology.orchestra.run.smithi006.stdout: }, 2023-08-01T19:56:09.285 INFO:teuthology.orchestra.run.smithi006.stdout: "removed_snaps_queue": [], 2023-08-01T19:56:09.285 INFO:teuthology.orchestra.run.smithi006.stdout: "new_removed_snaps": [], 2023-08-01T19:56:09.286 INFO:teuthology.orchestra.run.smithi006.stdout: "new_purged_snaps": [], 2023-08-01T19:56:09.286 INFO:teuthology.orchestra.run.smithi006.stdout: "crush_node_flags": {}, 2023-08-01T19:56:09.286 INFO:teuthology.orchestra.run.smithi006.stdout: "device_class_flags": {}, 2023-08-01T19:56:09.286 INFO:teuthology.orchestra.run.smithi006.stdout: "stretch_mode": { 2023-08-01T19:56:09.286 INFO:teuthology.orchestra.run.smithi006.stdout: "stretch_mode_enabled": false, 2023-08-01T19:56:09.286 INFO:teuthology.orchestra.run.smithi006.stdout: "stretch_bucket_count": 0, 2023-08-01T19:56:09.286 INFO:teuthology.orchestra.run.smithi006.stdout: "degraded_stretch_mode": 0, 2023-08-01T19:56:09.286 INFO:teuthology.orchestra.run.smithi006.stdout: "recovering_stretch_mode": 0, 2023-08-01T19:56:09.287 INFO:teuthology.orchestra.run.smithi006.stdout: "stretch_mode_bucket": 0 2023-08-01T19:56:09.287 INFO:teuthology.orchestra.run.smithi006.stdout: } 2023-08-01T19:56:09.287 INFO:teuthology.orchestra.run.smithi006.stdout:} 2023-08-01T19:56:09.288 INFO:teuthology.orchestra.run.smithi008.stdout:ERROR: (22) Invalid argument 2023-08-01T19:56:09.289 INFO:teuthology.orchestra.run.smithi008.stdout:op_tracker tracking is not enabled now, so no ops are tracked currently, even those get stuck. Please enable "osd_enable_op_tracker", and the tracker will start to track new ops received afterwards. 2023-08-01T19:56:09.289 INFO:tasks.thrashosds.thrasher:j is {'epoch': 67, 'fsid': 'a0e420cc-4df1-42a5-8bd4-a98c309a9349', 'created': '2023-08-01T19:53:41.279588+0000', 'modified': '2023-08-01T19:56:09.056815+0000', 'last_up_change': '2023-08-01T19:55:58.549095+0000', 'last_in_change': '2023-08-01T19:53:42.974751+0000', 'flags': 'noscrub,sortbitwise,recovery_deletes,purged_snapdirs,pglog_hardlimit', 'flags_num': 5801984, 'flags_set': ['noscrub', 'pglog_hardlimit', 'purged_snapdirs', 'recovery_deletes', 'sortbitwise'], 'crush_version': 5, 'full_ratio': 0.949999988079071, 'backfillfull_ratio': 0.8999999761581421, 'nearfull_ratio': 0.8500000238418579, 'cluster_snapshot': '', 'pool_max': 5, 'max_osd': 3, 'require_min_compat_client': 'luminous', 'min_compat_client': 'jewel', 'require_osd_release': 'quincy', 'pools': [{'pool': 1, 'pool_name': '.mgr', 'create_time': '2023-08-01T19:53:49.961944+0000', 'flags': 1, 'flags_names': 'hashpspool', 'type': 1, 'size': 2, 'min_size': 1, 'crush_rule': 0, 'peering_crush_bucket_count': 0, 'peering_crush_bucket_target': 0, 'peering_crush_bucket_barrier': 0, 'peering_crush_bucket_mandatory_member': 2147483647, 'object_hash': 2, 'pg_autoscale_mode': 'off', 'pg_num': 1, 'pg_placement_num': 1, 'pg_placement_num_target': 1, 'pg_num_target': 1, 'pg_num_pending': 1, 'last_pg_merge_meta': {'source_pgid': '0.0', 'ready_epoch': 0, 'last_epoch_started': 0, 'last_epoch_clean': 0, 'source_version': "0'0", 'target_version': "0'0"}, 'last_change': '11', 'last_force_op_resend': '0', 'last_force_op_resend_prenautilus': '0', 'last_force_op_resend_preluminous': '0', 'auid': 0, 'snap_mode': 'selfmanaged', 'snap_seq': 0, 'snap_epoch': 0, 'pool_snaps': [], 'removed_snaps': '[]', 'quota_max_bytes': 0, 'quota_max_objects': 0, 'tiers': [], 'tier_of': -1, 'read_tier': -1, 'write_tier': -1, 'cache_mode': 'none', 'target_max_bytes': 0, 'target_max_objects': 0, 'cache_target_dirty_ratio_micro': 400000, 'cache_target_dirty_high_ratio_micro': 600000, 'cache_target_full_ratio_micro': 800000, 'cache_min_flush_age': 0, 'cache_min_evict_age': 0, 'erasure_code_profile': '', 'hit_set_params': {'type': 'none'}, 'hit_set_period': 0, 'hit_set_count': 0, 'use_gmt_hitset': True, 'min_read_recency_for_promote': 0, 'min_write_recency_for_promote': 0, 'hit_set_grade_decay_rate': 0, 'hit_set_search_last_n': 0, 'grade_table': [], 'stripe_width': 0, 'expected_num_objects': 0, 'fast_read': False, 'options': {'pg_num_max': 32, 'pg_num_min': 1}, 'application_metadata': {'mgr': {}}}, {'pool': 2, 'pool_name': 'rbd', 'create_time': '2023-08-01T19:53:57.404091+0000', 'flags': 1, 'flags_names': 'hashpspool', 'type': 1, 'size': 2, 'min_size': 1, 'crush_rule': 0, 'peering_crush_bucket_count': 0, 'peering_crush_bucket_target': 0, 'peering_crush_bucket_barrier': 0, 'peering_crush_bucket_mandatory_member': 2147483647, 'object_hash': 2, 'pg_autoscale_mode': 'off', 'pg_num': 8, 'pg_placement_num': 8, 'pg_placement_num_target': 8, 'pg_num_target': 8, 'pg_num_pending': 8, 'last_pg_merge_meta': {'source_pgid': '0.0', 'ready_epoch': 0, 'last_epoch_started': 0, 'last_epoch_clean': 0, 'source_version': "0'0", 'target_version': "0'0"}, 'last_change': '14', 'last_force_op_resend': '0', 'last_force_op_resend_prenautilus': '0', 'last_force_op_resend_preluminous': '0', 'auid': 0, 'snap_mode': 'selfmanaged', 'snap_seq': 0, 'snap_epoch': 0, 'pool_snaps': [], 'removed_snaps': '[]', 'quota_max_bytes': 0, 'quota_max_objects': 0, 'tiers': [], 'tier_of': -1, 'read_tier': -1, 'write_tier': -1, 'cache_mode': 'none', 'target_max_bytes': 0, 'target_max_objects': 0, 'cache_target_dirty_ratio_micro': 400000, 'cache_target_dirty_high_ratio_micro': 600000, 'cache_target_full_ratio_micro': 800000, 'cache_min_flush_age': 0, 'cache_min_evict_age': 0, 'erasure_code_profile': '', 'hit_set_params': {'type': 'none'}, 'hit_set_period': 0, 'hit_set_count': 0, 'use_gmt_hitset': True, 'min_read_recency_for_promote': 0, 'min_write_recency_for_promote': 0, 'hit_set_grade_decay_rate': 0, 'hit_set_search_last_n': 0, 'grade_table': [], 'stripe_width': 0, 'expected_num_objects': 0, 'fast_read': False, 'options': {}, 'application_metadata': {'rbd': {}}}, {'pool': 3, 'pool_name': 'cephfs_metadata', 'create_time': '2023-08-01T19:54:02.111247+0000', 'flags': 1, 'flags_names': 'hashpspool', 'type': 1, 'size': 2, 'min_size': 1, 'crush_rule': 0, 'peering_crush_bucket_count': 0, 'peering_crush_bucket_target': 0, 'peering_crush_bucket_barrier': 0, 'peering_crush_bucket_mandatory_member': 2147483647, 'object_hash': 2, 'pg_autoscale_mode': 'off', 'pg_num': 32, 'pg_placement_num': 32, 'pg_placement_num_target': 32, 'pg_num_target': 32, 'pg_num_pending': 32, 'last_pg_merge_meta': {'source_pgid': '0.0', 'ready_epoch': 0, 'last_epoch_started': 0, 'last_epoch_clean': 0, 'source_version': "0'0", 'target_version': "0'0"}, 'last_change': '17', 'last_force_op_resend': '0', 'last_force_op_resend_prenautilus': '0', 'last_force_op_resend_preluminous': '0', 'auid': 0, 'snap_mode': 'selfmanaged', 'snap_seq': 0, 'snap_epoch': 0, 'pool_snaps': [], 'removed_snaps': '[]', 'quota_max_bytes': 0, 'quota_max_objects': 0, 'tiers': [], 'tier_of': -1, 'read_tier': -1, 'write_tier': -1, 'cache_mode': 'none', 'target_max_bytes': 0, 'target_max_objects': 0, 'cache_target_dirty_ratio_micro': 400000, 'cache_target_dirty_high_ratio_micro': 600000, 'cache_target_full_ratio_micro': 800000, 'cache_min_flush_age': 0, 'cache_min_evict_age': 0, 'erasure_code_profile': '', 'hit_set_params': {'type': 'none'}, 'hit_set_period': 0, 'hit_set_count': 0, 'use_gmt_hitset': True, 'min_read_recency_for_promote': 0, 'min_write_recency_for_promote': 0, 'hit_set_grade_decay_rate': 0, 'hit_set_search_last_n': 0, 'grade_table': [], 'stripe_width': 0, 'expected_num_objects': 0, 'fast_read': False, 'options': {'pg_autoscale_bias': 4, 'pg_num_min': 16, 'recovery_priority': 5}, 'application_metadata': {'cephfs': {'metadata': 'cephfs'}}}, {'pool': 4, 'pool_name': 'cephfs_data', 'create_time': '2023-08-01T19:54:03.430277+0000', 'flags': 1, 'flags_names': 'hashpspool', 'type': 1, 'size': 2, 'min_size': 1, 'crush_rule': 0, 'peering_crush_bucket_count': 0, 'peering_crush_bucket_target': 0, 'peering_crush_bucket_barrier': 0, 'peering_crush_bucket_mandatory_member': 2147483647, 'object_hash': 2, 'pg_autoscale_mode': 'off', 'pg_num': 64, 'pg_placement_num': 64, 'pg_placement_num_target': 64, 'pg_num_target': 64, 'pg_num_pending': 64, 'last_pg_merge_meta': {'source_pgid': '0.0', 'ready_epoch': 0, 'last_epoch_started': 0, 'last_epoch_clean': 0, 'source_version': "0'0", 'target_version': "0'0"}, 'last_change': '18', 'last_force_op_resend': '0', 'last_force_op_resend_prenautilus': '0', 'last_force_op_resend_preluminous': '0', 'auid': 0, 'snap_mode': 'selfmanaged', 'snap_seq': 0, 'snap_epoch': 0, 'pool_snaps': [], 'removed_snaps': '[]', 'quota_max_bytes': 0, 'quota_max_objects': 0, 'tiers': [], 'tier_of': -1, 'read_tier': -1, 'write_tier': -1, 'cache_mode': 'none', 'target_max_bytes': 0, 'target_max_objects': 0, 'cache_target_dirty_ratio_micro': 400000, 'cache_target_dirty_high_ratio_micro': 600000, 'cache_target_full_ratio_micro': 800000, 'cache_min_flush_age': 0, 'cache_min_evict_age': 0, 'erasure_code_profile': '', 'hit_set_params': {'type': 'none'}, 'hit_set_period': 0, 'hit_set_count': 0, 'use_gmt_hitset': True, 'min_read_recency_for_promote': 0, 'min_write_recency_for_promote': 0, 'hit_set_grade_decay_rate': 0, 'hit_set_search_last_n': 0, 'grade_table': [], 'stripe_width': 0, 'expected_num_objects': 0, 'fast_read': False, 'options': {'pg_num_min': 64, 'target_size_ratio': 0.8999999761581421}, 'application_metadata': {'cephfs': {'data': 'cephfs'}}}, {'pool': 5, 'pool_name': 'unique_pool_0', 'create_time': '2023-08-01T19:54:21.165668+0000', 'flags': 1, 'flags_names': 'hashpspool', 'type': 1, 'size': 2, 'min_size': 1, 'crush_rule': 0, 'peering_crush_bucket_count': 0, 'peering_crush_bucket_target': 0, 'peering_crush_bucket_barrier': 0, 'peering_crush_bucket_mandatory_member': 2147483647, 'object_hash': 2, 'pg_autoscale_mode': 'off', 'pg_num': 16, 'pg_placement_num': 16, 'pg_placement_num_target': 16, 'pg_num_target': 16, 'pg_num_pending': 16, 'last_pg_merge_meta': {'source_pgid': '0.0', 'ready_epoch': 0, 'last_epoch_started': 0, 'last_epoch_clean': 0, 'source_version': "0'0", 'target_version': "0'0"}, 'last_change': '21', 'last_force_op_resend': '0', 'last_force_op_resend_prenautilus': '0', 'last_force_op_resend_preluminous': '0', 'auid': 0, 'snap_mode': 'selfmanaged', 'snap_seq': 0, 'snap_epoch': 0, 'pool_snaps': [], 'removed_snaps': '[]', 'quota_max_bytes': 0, 'quota_max_objects': 0, 'tiers': [], 'tier_of': -1, 'read_tier': -1, 'write_tier': -1, 'cache_mode': 'none', 'target_max_bytes': 0, 'target_max_objects': 0, 'cache_target_dirty_ratio_micro': 400000, 'cache_target_dirty_high_ratio_micro': 600000, 'cache_target_full_ratio_micro': 800000, 'cache_min_flush_age': 0, 'cache_min_evict_age': 0, 'erasure_code_profile': '', 'hit_set_params': {'type': 'none'}, 'hit_set_period': 0, 'hit_set_count': 0, 'use_gmt_hitset': True, 'min_read_recency_for_promote': 0, 'min_write_recency_for_promote': 0, 'hit_set_grade_decay_rate': 0, 'hit_set_search_last_n': 0, 'grade_table': [], 'stripe_width': 0, 'expected_num_objects': 0, 'fast_read': False, 'options': {}, 'application_metadata': {'rados': {}}}], 'osds': [{'osd': 0, 'uuid': '5dd675c7-2777-48f2-8009-ff0e0d4c7086', 'up': 1, 'in': 1, 'weight': 1, 'primary_affinity': 0.822052001953125, 'last_clean_begin': 0, 'last_clean_end': 0, 'up_from': 8, 'up_thru': 62, 'down_at': 0, 'lost_at': 0, 'public_addrs': {'addrvec': [{'type': 'v2', 'addr': '172.21.15.8:6800', 'nonce': 111181}, {'type': 'v1', 'addr': '172.21.15.8:6801', 'nonce': 111181}]}, 'cluster_addrs': {'addrvec': [{'type': 'v2', 'addr': '172.21.15.8:6802', 'nonce': 111181}, {'type': 'v1', 'addr': '172.21.15.8:6803', 'nonce': 111181}]}, 'heartbeat_back_addrs': {'addrvec': [{'type': 'v2', 'addr': '172.21.15.8:6806', 'nonce': 111181}, {'type': 'v1', 'addr': '172.21.15.8:6807', 'nonce': 111181}]}, 'heartbeat_front_addrs': {'addrvec': [{'type': 'v2', 'addr': '172.21.15.8:6804', 'nonce': 111181}, {'type': 'v1', 'addr': '172.21.15.8:6805', 'nonce': 111181}]}, 'public_addr': '172.21.15.8:6801/111181', 'cluster_addr': '172.21.15.8:6803/111181', 'heartbeat_back_addr': '172.21.15.8:6807/111181', 'heartbeat_front_addr': '172.21.15.8:6805/111181', 'state': ['exists', 'up']}, {'osd': 1, 'uuid': '7fc612c4-33ba-4a33-bca8-1f42ee8ed548', 'up': 0, 'in': 1, 'weight': 1, 'primary_affinity': 0.3376312255859375, 'last_clean_begin': 0, 'last_clean_end': 0, 'up_from': 8, 'up_thru': 53, 'down_at': 62, 'lost_at': 0, 'public_addrs': {'addrvec': [{'type': 'v2', 'addr': '172.21.15.101:6800', 'nonce': 111143}, {'type': 'v1', 'addr': '172.21.15.101:6801', 'nonce': 111143}]}, 'cluster_addrs': {'addrvec': [{'type': 'v2', 'addr': '172.21.15.101:6802', 'nonce': 111143}, {'type': 'v1', 'addr': '172.21.15.101:6803', 'nonce': 111143}]}, 'heartbeat_back_addrs': {'addrvec': [{'type': 'v2', 'addr': '172.21.15.101:6806', 'nonce': 111143}, {'type': 'v1', 'addr': '172.21.15.101:6807', 'nonce': 111143}]}, 'heartbeat_front_addrs': {'addrvec': [{'type': 'v2', 'addr': '172.21.15.101:6804', 'nonce': 111143}, {'type': 'v1', 'addr': '172.21.15.101:6805', 'nonce': 111143}]}, 'public_addr': '172.21.15.101:6801/111143', 'cluster_addr': '172.21.15.101:6803/111143', 'heartbeat_back_addr': '172.21.15.101:6807/111143', 'heartbeat_front_addr': '172.21.15.101:6805/111143', 'state': ['exists']}, {'osd': 2, 'uuid': 'f85cadbc-4230-4772-8f39-62ed52e220b1', 'up': 1, 'in': 1, 'weight': 1, 'primary_affinity': 1, 'last_clean_begin': 0, 'last_clean_end': 0, 'up_from': 9, 'up_thru': 62, 'down_at': 0, 'lost_at': 0, 'public_addrs': {'addrvec': [{'type': 'v2', 'addr': '172.21.15.155:6800', 'nonce': 111339}, {'type': 'v1', 'addr': '172.21.15.155:6801', 'nonce': 111339}]}, 'cluster_addrs': {'addrvec': [{'type': 'v2', 'addr': '172.21.15.155:6802', 'nonce': 111339}, {'type': 'v1', 'addr': '172.21.15.155:6803', 'nonce': 111339}]}, 'heartbeat_back_addrs': {'addrvec': [{'type': 'v2', 'addr': '172.21.15.155:6806', 'nonce': 111339}, {'type': 'v1', 'addr': '172.21.15.155:6807', 'nonce': 111339}]}, 'heartbeat_front_addrs': {'addrvec': [{'type': 'v2', 'addr': '172.21.15.155:6804', 'nonce': 111339}, {'type': 'v1', 'addr': '172.21.15.155:6805', 'nonce': 111339}]}, 'public_addr': '172.21.15.155:6801/111339', 'cluster_addr': '172.21.15.155:6803/111339', 'heartbeat_back_addr': '172.21.15.155:6807/111339', 'heartbeat_front_addr': '172.21.15.155:6805/111339', 'state': ['exists', 'up']}], 'osd_xinfo': [{'osd': 0, 'down_stamp': '0.000000', 'laggy_probability': 0, 'laggy_interval': 0, 'features': 4540138320759226367, 'old_weight': 0, 'last_purged_snaps_scrub': '2023-08-01T19:53:48.018154+0000', 'dead_epoch': 0}, {'osd': 1, 'down_stamp': '0.000000', 'laggy_probability': 0, 'laggy_interval': 0, 'features': 4540138320759226367, 'old_weight': 0, 'last_purged_snaps_scrub': '2023-08-01T19:53:48.000488+0000', 'dead_epoch': 61}, {'osd': 2, 'down_stamp': '0.000000', 'laggy_probability': 0, 'laggy_interval': 0, 'features': 4540138320759226367, 'old_weight': 0, 'last_purged_snaps_scrub': '2023-08-01T19:53:48.072529+0000', 'dead_epoch': 0}], 'pg_upmap': [], 'pg_upmap_items': [], 'pg_temp': [], 'primary_temp': [], 'blocklist': {}, 'range_blocklist': {}, 'erasure_code_profiles': {'default': {'crush-failure-domain': 'osd', 'k': '2', 'm': '1', 'plugin': 'jerasure', 'technique': 'reed_sol_van'}}, 'removed_snaps_queue': [], 'new_removed_snaps': [], 'new_purged_snaps': [], 'crush_node_flags': {}, 'device_class_flags': {}, 'stretch_mode': {'stretch_mode_enabled': False, 'stretch_bucket_count': 0, 'degraded_stretch_mode': 0, 'recovering_stretch_mode': 0, 'stretch_mode_bucket': 0}} 2023-08-01T19:56:09.290 INFO:tasks.thrashosds.thrasher:No pg_upmap entries; doing nothing 2023-08-01T19:56:09.290 DEBUG:teuthology.orchestra.run.smithi008:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 30 ceph --cluster ceph --admin-daemon /var/run/ceph/ceph-osd.0.asok dump_historic_ops 2023-08-01T19:56:09.291 INFO:tasks.ceph.osd.2.smithi155.stderr:2023-08-01T19:56:09.286+0000 7faa5c6ac700 -1 received signal: Hangup from /usr/bin/python3 /bin/daemon-helper kill ceph-osd -f --cluster ceph -i 2 (PID: 111337) UID: 0 2023-08-01T19:56:09.388 INFO:tasks.ceph.osd.2.smithi155.stderr:2023-08-01T19:56:09.387+0000 7faa5c6ac700 -1 received signal: Hangup from /usr/bin/python3 /bin/daemon-helper kill ceph-osd -f --cluster ceph -i 2 (PID: 111337) UID: 0 2023-08-01T19:56:09.477 INFO:teuthology.orchestra.run.smithi008.stdout:ERROR: (22) Invalid argument 2023-08-01T19:56:09.478 INFO:teuthology.orchestra.run.smithi008.stdout:op_tracker tracking is not enabled now, so no ops are tracked currently, even those get stuck. Please enable "osd_enable_op_tracker", and the tracker will start to track new ops received afterwards. 2023-08-01T19:56:09.489 DEBUG:teuthology.orchestra.run.smithi155:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 30 ceph --cluster ceph --admin-daemon /var/run/ceph/ceph-osd.2.asok dump_ops_in_flight 2023-08-01T19:56:09.491 INFO:tasks.ceph.osd.2.smithi155.stderr:2023-08-01T19:56:09.489+0000 7faa5c6ac700 -1 received signal: Hangup from /usr/bin/python3 /bin/daemon-helper kill ceph-osd -f --cluster ceph -i 2 (PID: 111337) UID: 0 2023-08-01T19:56:09.591 INFO:tasks.ceph.osd.2.smithi155.stderr:2023-08-01T19:56:09.590+0000 7faa5c6ac700 -1 received signal: Hangup from /usr/bin/python3 /bin/daemon-helper kill ceph-osd -f --cluster ceph -i 2 (PID: 111337) UID: 0 2023-08-01T19:56:09.661 INFO:teuthology.orchestra.run.smithi155.stdout:ERROR: (22) Invalid argument 2023-08-01T19:56:09.661 INFO:teuthology.orchestra.run.smithi155.stdout:op_tracker tracking is not enabled now, so no ops are tracked currently, even those get stuck. Please enable "osd_enable_op_tracker", and the tracker will start to track new ops received afterwards. 2023-08-01T19:56:09.673 DEBUG:teuthology.orchestra.run.smithi155:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 30 ceph --cluster ceph --admin-daemon /var/run/ceph/ceph-osd.2.asok dump_blocked_ops 2023-08-01T19:56:09.691 INFO:tasks.daemonwatchdog.daemon_watchdog:daemon ceph.osd.1 is failed for ~6s 2023-08-01T19:56:09.692 INFO:tasks.ceph.osd.0.smithi008.stderr:2023-08-01T19:56:09.690+0000 7f16a58f4700 -1 received signal: Hangup from /usr/bin/python3 /bin/daemon-helper kill ceph-osd -f --cluster ceph -i 0 (PID: 111179) UID: 0 2023-08-01T19:56:09.793 INFO:tasks.ceph.osd.2.smithi155.stderr:2023-08-01T19:56:09.792+0000 7faa5c6ac700 -1 received signal: Hangup from /usr/bin/python3 /bin/daemon-helper kill ceph-osd -f --cluster ceph -i 2 (PID: 111337) UID: 0 2023-08-01T19:56:09.876 INFO:teuthology.orchestra.run.smithi155.stdout:ERROR: (22) Invalid argument 2023-08-01T19:56:09.876 INFO:teuthology.orchestra.run.smithi155.stdout:op_tracker tracking is not enabled now, so no ops are tracked currently, even those get stuck. Please enable "osd_enable_op_tracker", and the tracker will start to track new ops received afterwards. 2023-08-01T19:56:09.887 DEBUG:teuthology.orchestra.run.smithi155:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 30 ceph --cluster ceph --admin-daemon /var/run/ceph/ceph-osd.2.asok dump_historic_ops 2023-08-01T19:56:09.928 INFO:tasks.ceph.osd.2.smithi155.stderr:2023-08-01T19:56:09.928+0000 7faa5c6ac700 -1 received signal: Hangup from /usr/bin/python3 /bin/daemon-helper kill ceph-osd -f --cluster ceph -i 2 (PID: 111337) UID: 0 2023-08-01T19:56:09.994 INFO:tasks.ceph.osd.2.smithi155.stderr:2023-08-01T19:56:09.994+0000 7faa5c6ac700 -1 received signal: Hangup from /usr/bin/python3 /bin/daemon-helper kill ceph-osd -f --cluster ceph -i 2 (PID: 111337) UID: 0 2023-08-01T19:56:10.089 INFO:teuthology.orchestra.run.smithi155.stdout:ERROR: (22) Invalid argument 2023-08-01T19:56:10.089 INFO:teuthology.orchestra.run.smithi155.stdout:op_tracker tracking is not enabled now, so no ops are tracked currently, even those get stuck. Please enable "osd_enable_op_tracker", and the tracker will start to track new ops received afterwards. 2023-08-01T19:56:10.095 INFO:tasks.ceph.osd.2.smithi155.stderr:2023-08-01T19:56:10.094+0000 7faa5c6ac700 -1 received signal: Hangup from /usr/bin/python3 /bin/daemon-helper kill ceph-osd -f --cluster ceph -i 2 (PID: 111337) UID: 0 2023-08-01T19:56:10.101 DEBUG:teuthology.orchestra.run.smithi008:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 30 ceph --cluster ceph --admin-daemon /var/run/ceph/ceph-osd.0.asok dump_ops_in_flight 2023-08-01T19:56:10.195 INFO:tasks.ceph.osd.2.smithi155.stderr:2023-08-01T19:56:10.195+0000 7faa5c6ac700 -1 received signal: Hangup from /usr/bin/python3 /bin/daemon-helper kill ceph-osd -f --cluster ceph -i 2 (PID: 111337) UID: 0 2023-08-01T19:56:10.297 INFO:teuthology.orchestra.run.smithi008.stdout:ERROR: (22) Invalid argument 2023-08-01T19:56:10.297 INFO:teuthology.orchestra.run.smithi008.stdout:op_tracker tracking is not enabled now, so no ops are tracked currently, even those get stuck. Please enable "osd_enable_op_tracker", and the tracker will start to track new ops received afterwards. 2023-08-01T19:56:10.297 INFO:tasks.ceph.osd.0.smithi008.stderr:2023-08-01T19:56:10.295+0000 7f16a58f4700 -1 received signal: Hangup from /usr/bin/python3 /bin/daemon-helper kill ceph-osd -f --cluster ceph -i 0 (PID: 111179) UID: 0 2023-08-01T19:56:10.312 DEBUG:teuthology.orchestra.run.smithi008:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 30 ceph --cluster ceph --admin-daemon /var/run/ceph/ceph-osd.0.asok dump_blocked_ops 2023-08-01T19:56:10.397 INFO:tasks.ceph.osd.2.smithi155.stderr:2023-08-01T19:56:10.397+0000 7faa5c6ac700 -1 received signal: Hangup from /usr/bin/python3 /bin/daemon-helper kill ceph-osd -f --cluster ceph -i 2 (PID: 111337) UID: 0 2023-08-01T19:56:10.499 INFO:tasks.ceph.osd.0.smithi008.stderr:2023-08-01T19:56:10.497+0000 7f16a58f4700 -1 received signal: Hangup from /usr/bin/python3 /bin/daemon-helper kill ceph-osd -f --cluster ceph -i 0 (PID: 111179) UID: 0 2023-08-01T19:56:10.544 INFO:teuthology.orchestra.run.smithi008.stdout:ERROR: (22) Invalid argument 2023-08-01T19:56:10.545 INFO:teuthology.orchestra.run.smithi008.stdout:op_tracker tracking is not enabled now, so no ops are tracked currently, even those get stuck. Please enable "osd_enable_op_tracker", and the tracker will start to track new ops received afterwards. 2023-08-01T19:56:10.551 DEBUG:teuthology.orchestra.run.smithi008:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 30 ceph --cluster ceph --admin-daemon /var/run/ceph/ceph-osd.0.asok dump_historic_ops 2023-08-01T19:56:10.600 INFO:tasks.ceph.osd.2.smithi155.stderr:2023-08-01T19:56:10.599+0000 7faa5c6ac700 -1 received signal: Hangup from /usr/bin/python3 /bin/daemon-helper kill ceph-osd -f --cluster ceph -i 2 (PID: 111337) UID: 0 2023-08-01T19:56:10.704 INFO:tasks.ceph.osd.0.smithi008.stderr:2023-08-01T19:56:10.700+0000 7f16a58f4700 -1 received signal: Hangup from /usr/bin/python3 /bin/daemon-helper kill ceph-osd -f --cluster ceph -i 0 (PID: 111179) UID: 0 2023-08-01T19:56:10.777 INFO:teuthology.orchestra.run.smithi008.stdout:ERROR: (22) Invalid argument 2023-08-01T19:56:10.777 INFO:teuthology.orchestra.run.smithi008.stdout:op_tracker tracking is not enabled now, so no ops are tracked currently, even those get stuck. Please enable "osd_enable_op_tracker", and the tracker will start to track new ops received afterwards. 2023-08-01T19:56:10.791 DEBUG:teuthology.orchestra.run.smithi155:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 30 ceph --cluster ceph --admin-daemon /var/run/ceph/ceph-osd.2.asok dump_ops_in_flight 2023-08-01T19:56:10.835 INFO:tasks.ceph.osd.2.smithi155.stderr:2023-08-01T19:56:10.835+0000 7faa5c6ac700 -1 received signal: Hangup from /usr/bin/python3 /bin/daemon-helper kill ceph-osd -f --cluster ceph -i 2 (PID: 111337) UID: 0 2023-08-01T19:56:10.838 DEBUG:teuthology.orchestra.run.smithi006:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 120 ceph --cluster ceph -- tell 'osd.*' injectargs --osd_enable_op_tracker=true 2023-08-01T19:56:10.903 INFO:tasks.ceph.osd.2.smithi155.stderr:2023-08-01T19:56:10.902+0000 7faa5c6ac700 -1 received signal: Hangup from /usr/bin/python3 /bin/daemon-helper kill ceph-osd -f --cluster ceph -i 2 (PID: 111337) UID: 0 2023-08-01T19:56:10.965 INFO:teuthology.orchestra.run.smithi155.stdout:ERROR: (22) Invalid argument 2023-08-01T19:56:10.966 INFO:teuthology.orchestra.run.smithi155.stdout:op_tracker tracking is not enabled now, so no ops are tracked currently, even those get stuck. Please enable "osd_enable_op_tracker", and the tracker will start to track new ops received afterwards. 2023-08-01T19:56:10.978 DEBUG:teuthology.orchestra.run.smithi155:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 30 ceph --cluster ceph --admin-daemon /var/run/ceph/ceph-osd.2.asok dump_blocked_ops 2023-08-01T19:56:10.987 INFO:teuthology.orchestra.run.smithi006.stdout:osd.0: {} 2023-08-01T19:56:11.007 INFO:teuthology.orchestra.run.smithi006.stdout:osd.2: {} 2023-08-01T19:56:11.008 INFO:teuthology.orchestra.run.smithi006.stderr:osd.0: osd_enable_op_tracker = 'true' 2023-08-01T19:56:11.008 INFO:teuthology.orchestra.run.smithi006.stderr:Error ENXIO: problem getting command descriptions from osd.1 2023-08-01T19:56:11.008 INFO:teuthology.orchestra.run.smithi006.stderr:osd.2: osd_enable_op_tracker = 'true' 2023-08-01T19:56:11.010 DEBUG:teuthology.orchestra.run:got remote process result: 6 2023-08-01T19:56:11.010 INFO:tasks.thrashosds.thrasher:Failed to tell all osds, ignoring 2023-08-01T19:56:11.019 INFO:tasks.ceph.osd.2.smithi155.stderr:2023-08-01T19:56:11.019+0000 7faa5c6ac700 -1 received signal: Hangup from /usr/bin/python3 /bin/daemon-helper kill ceph-osd -f --cluster ceph -i 2 (PID: 111337) UID: 0 2023-08-01T19:56:11.085 DEBUG:teuthology.orchestra.run.smithi006:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 120 ceph --cluster ceph osd set nodeep-scrub 2023-08-01T19:56:11.105 INFO:tasks.ceph.osd.0.smithi008.stderr:2023-08-01T19:56:11.104+0000 7f16a58f4700 -1 received signal: Hangup from /usr/bin/python3 /bin/daemon-helper kill ceph-osd -f --cluster ceph -i 0 (PID: 111179) UID: 0 2023-08-01T19:56:11.185 INFO:teuthology.orchestra.run.smithi155.stdout:{ 2023-08-01T19:56:11.185 INFO:teuthology.orchestra.run.smithi155.stdout: "ops": [], 2023-08-01T19:56:11.185 INFO:teuthology.orchestra.run.smithi155.stdout: "complaint_time": 30, 2023-08-01T19:56:11.185 INFO:teuthology.orchestra.run.smithi155.stdout: "num_blocked_ops": 0 2023-08-01T19:56:11.186 INFO:teuthology.orchestra.run.smithi155.stdout:} 2023-08-01T19:56:11.198 DEBUG:teuthology.orchestra.run.smithi155:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 30 ceph --cluster ceph --admin-daemon /var/run/ceph/ceph-osd.2.asok dump_historic_ops 2023-08-01T19:56:11.206 INFO:tasks.ceph.osd.0.smithi008.stderr:2023-08-01T19:56:11.204+0000 7f16a58f4700 -1 received signal: Hangup from /usr/bin/python3 /bin/daemon-helper kill ceph-osd -f --cluster ceph -i 0 (PID: 111179) UID: 0 2023-08-01T19:56:11.306 INFO:tasks.ceph.osd.0.smithi008.stderr:2023-08-01T19:56:11.305+0000 7f16a58f4700 -1 received signal: Hangup from /usr/bin/python3 /bin/daemon-helper kill ceph-osd -f --cluster ceph -i 0 (PID: 111179) UID: 0 2023-08-01T19:56:11.365 INFO:teuthology.orchestra.run.smithi155.stdout:{ 2023-08-01T19:56:11.365 INFO:teuthology.orchestra.run.smithi155.stdout: "size": 20, 2023-08-01T19:56:11.366 INFO:teuthology.orchestra.run.smithi155.stdout: "duration": 600, 2023-08-01T19:56:11.366 INFO:teuthology.orchestra.run.smithi155.stdout: "ops": [ 2023-08-01T19:56:11.366 INFO:teuthology.orchestra.run.smithi155.stdout: { 2023-08-01T19:56:11.366 INFO:teuthology.orchestra.run.smithi155.stdout: "description": "osd_op(client.4668.0:100237 5.4 5:2d68bec9:::benchmark_data_smithi006_114134_object100236:head [set-alloc-hint object_size 65536 write_size 65536,write 0~65536] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e37)", 2023-08-01T19:56:11.366 INFO:teuthology.orchestra.run.smithi155.stdout: "initiated_at": "2023-08-01T19:55:05.147736+0000", 2023-08-01T19:56:11.366 INFO:teuthology.orchestra.run.smithi155.stdout: "age": 66.214334070000007, 2023-08-01T19:56:11.366 INFO:teuthology.orchestra.run.smithi155.stdout: "duration": 0.071299464000000007, 2023-08-01T19:56:11.367 INFO:teuthology.orchestra.run.smithi155.stdout: "type_data": { 2023-08-01T19:56:11.367 INFO:teuthology.orchestra.run.smithi155.stdout: "flag_point": "commit sent; apply or cleanup", 2023-08-01T19:56:11.367 INFO:teuthology.orchestra.run.smithi155.stdout: "client_info": { 2023-08-01T19:56:11.367 INFO:teuthology.orchestra.run.smithi155.stdout: "client": "client.4668", 2023-08-01T19:56:11.367 INFO:teuthology.orchestra.run.smithi155.stdout: "client_addr": "172.21.15.6:0/1709472247", 2023-08-01T19:56:11.367 INFO:teuthology.orchestra.run.smithi155.stdout: "tid": 100237 2023-08-01T19:56:11.367 INFO:teuthology.orchestra.run.smithi155.stdout: }, 2023-08-01T19:56:11.368 INFO:teuthology.orchestra.run.smithi155.stdout: "events": [ 2023-08-01T19:56:11.368 INFO:teuthology.orchestra.run.smithi155.stdout: { 2023-08-01T19:56:11.368 INFO:teuthology.orchestra.run.smithi155.stdout: "event": "initiated", 2023-08-01T19:56:11.368 INFO:teuthology.orchestra.run.smithi155.stdout: "time": "2023-08-01T19:55:05.147736+0000", 2023-08-01T19:56:11.368 INFO:teuthology.orchestra.run.smithi155.stdout: "duration": 0 2023-08-01T19:56:11.368 INFO:teuthology.orchestra.run.smithi155.stdout: }, 2023-08-01T19:56:11.368 INFO:teuthology.orchestra.run.smithi155.stdout: { 2023-08-01T19:56:11.368 INFO:teuthology.orchestra.run.smithi155.stdout: "event": "throttled", 2023-08-01T19:56:11.369 INFO:teuthology.orchestra.run.smithi155.stdout: "time": "2023-08-01T19:55:05.147736+0000", 2023-08-01T19:56:11.369 INFO:teuthology.orchestra.run.smithi155.stdout: "duration": 0 2023-08-01T19:56:11.369 INFO:teuthology.orchestra.run.smithi155.stdout: }, 2023-08-01T19:56:11.369 INFO:teuthology.orchestra.run.smithi155.stdout: { 2023-08-01T19:56:11.369 INFO:teuthology.orchestra.run.smithi155.stdout: "event": "header_read", 2023-08-01T19:56:11.369 INFO:teuthology.orchestra.run.smithi155.stdout: "time": "2023-08-01T19:55:05.147736+0000", 2023-08-01T19:56:11.369 INFO:teuthology.orchestra.run.smithi155.stdout: "duration": 4294967295.9999995 2023-08-01T19:56:11.369 INFO:teuthology.orchestra.run.smithi155.stdout: }, 2023-08-01T19:56:11.370 INFO:teuthology.orchestra.run.smithi155.stdout: { 2023-08-01T19:56:11.370 INFO:teuthology.orchestra.run.smithi155.stdout: "event": "all_read", 2023-08-01T19:56:11.370 INFO:teuthology.orchestra.run.smithi155.stdout: "time": "2023-08-01T19:55:05.147766+0000", 2023-08-01T19:56:11.370 INFO:teuthology.orchestra.run.smithi155.stdout: "duration": 3.0394000000000001e-05 2023-08-01T19:56:11.370 INFO:teuthology.orchestra.run.smithi155.stdout: }, 2023-08-01T19:56:11.370 INFO:teuthology.orchestra.run.smithi155.stdout: { 2023-08-01T19:56:11.370 INFO:teuthology.orchestra.run.smithi155.stdout: "event": "dispatched", 2023-08-01T19:56:11.371 INFO:teuthology.orchestra.run.smithi155.stdout: "time": "2023-08-01T19:55:05.147771+0000", 2023-08-01T19:56:11.371 INFO:teuthology.orchestra.run.smithi155.stdout: "duration": 4.25e-06 2023-08-01T19:56:11.371 INFO:teuthology.orchestra.run.smithi155.stdout: }, 2023-08-01T19:56:11.371 INFO:teuthology.orchestra.run.smithi155.stdout: { 2023-08-01T19:56:11.371 INFO:teuthology.orchestra.run.smithi155.stdout: "event": "queued_for_pg", 2023-08-01T19:56:11.371 INFO:teuthology.orchestra.run.smithi155.stdout: "time": "2023-08-01T19:55:05.147773+0000", 2023-08-01T19:56:11.371 INFO:teuthology.orchestra.run.smithi155.stdout: "duration": 2.4159999999999998e-06 2023-08-01T19:56:11.371 INFO:teuthology.orchestra.run.smithi155.stdout: }, 2023-08-01T19:56:11.372 INFO:teuthology.orchestra.run.smithi155.stdout: { 2023-08-01T19:56:11.372 INFO:teuthology.orchestra.run.smithi155.stdout: "event": "reached_pg", 2023-08-01T19:56:11.372 INFO:teuthology.orchestra.run.smithi155.stdout: "time": "2023-08-01T19:55:05.149903+0000", 2023-08-01T19:56:11.372 INFO:teuthology.orchestra.run.smithi155.stdout: "duration": 0.002129948 2023-08-01T19:56:11.372 INFO:teuthology.orchestra.run.smithi155.stdout: }, 2023-08-01T19:56:11.372 INFO:teuthology.orchestra.run.smithi155.stdout: { 2023-08-01T19:56:11.372 INFO:teuthology.orchestra.run.smithi155.stdout: "event": "started", 2023-08-01T19:56:11.372 INFO:teuthology.orchestra.run.smithi155.stdout: "time": "2023-08-01T19:55:05.149982+0000", 2023-08-01T19:56:11.373 INFO:teuthology.orchestra.run.smithi155.stdout: "duration": 7.8706000000000002e-05 2023-08-01T19:56:11.373 INFO:teuthology.orchestra.run.smithi155.stdout: }, 2023-08-01T19:56:11.373 INFO:teuthology.orchestra.run.smithi155.stdout: { 2023-08-01T19:56:11.373 INFO:teuthology.orchestra.run.smithi155.stdout: "event": "waiting for subops from 0", 2023-08-01T19:56:11.373 INFO:teuthology.orchestra.run.smithi155.stdout: "time": "2023-08-01T19:55:05.150066+0000", 2023-08-01T19:56:11.373 INFO:teuthology.orchestra.run.smithi155.stdout: "duration": 8.4241999999999997e-05 2023-08-01T19:56:11.373 INFO:teuthology.orchestra.run.smithi155.stdout: }, 2023-08-01T19:56:11.374 INFO:teuthology.orchestra.run.smithi155.stdout: { 2023-08-01T19:56:11.374 INFO:teuthology.orchestra.run.smithi155.stdout: "event": "op_commit", 2023-08-01T19:56:11.374 INFO:teuthology.orchestra.run.smithi155.stdout: "time": "2023-08-01T19:55:05.154994+0000", 2023-08-01T19:56:11.374 INFO:teuthology.orchestra.run.smithi155.stdout: "duration": 0.0049277050000000001 2023-08-01T19:56:11.374 INFO:teuthology.orchestra.run.smithi155.stdout: }, 2023-08-01T19:56:11.374 INFO:teuthology.orchestra.run.smithi155.stdout: { 2023-08-01T19:56:11.374 INFO:teuthology.orchestra.run.smithi155.stdout: "event": "sub_op_commit_rec", 2023-08-01T19:56:11.374 INFO:teuthology.orchestra.run.smithi155.stdout: "time": "2023-08-01T19:55:05.218933+0000", 2023-08-01T19:56:11.375 INFO:teuthology.orchestra.run.smithi155.stdout: "duration": 0.063939916999999999 2023-08-01T19:56:11.375 INFO:teuthology.orchestra.run.smithi155.stdout: }, 2023-08-01T19:56:11.375 INFO:teuthology.orchestra.run.smithi155.stdout: { 2023-08-01T19:56:11.375 INFO:teuthology.orchestra.run.smithi155.stdout: "event": "commit_sent", 2023-08-01T19:56:11.375 INFO:teuthology.orchestra.run.smithi155.stdout: "time": "2023-08-01T19:55:05.218989+0000", 2023-08-01T19:56:11.375 INFO:teuthology.orchestra.run.smithi155.stdout: "duration": 5.5772000000000001e-05 2023-08-01T19:56:11.375 INFO:teuthology.orchestra.run.smithi155.stdout: }, 2023-08-01T19:56:11.375 INFO:teuthology.orchestra.run.smithi155.stdout: { 2023-08-01T19:56:11.376 INFO:teuthology.orchestra.run.smithi155.stdout: "event": "done", 2023-08-01T19:56:11.376 INFO:teuthology.orchestra.run.smithi155.stdout: "time": "2023-08-01T19:55:05.219036+0000", 2023-08-01T19:56:11.376 INFO:teuthology.orchestra.run.smithi155.stdout: "duration": 4.6526000000000001e-05 2023-08-01T19:56:11.376 INFO:teuthology.orchestra.run.smithi155.stdout: } 2023-08-01T19:56:11.376 INFO:teuthology.orchestra.run.smithi155.stdout: ] 2023-08-01T19:56:11.376 INFO:teuthology.orchestra.run.smithi155.stdout: } 2023-08-01T19:56:11.376 INFO:teuthology.orchestra.run.smithi155.stdout: }, 2023-08-01T19:56:11.377 INFO:teuthology.orchestra.run.smithi155.stdout: { 2023-08-01T19:56:11.377 INFO:teuthology.orchestra.run.smithi155.stdout: "description": "osd_op(client.4668.0:100242 5.8 5:16a314b8:::benchmark_data_smithi006_114134_object100241:head [set-alloc-hint object_size 65536 write_size 65536,write 0~65536] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e37)", 2023-08-01T19:56:11.377 INFO:teuthology.orchestra.run.smithi155.stdout: "initiated_at": "2023-08-01T19:55:05.150616+0000", 2023-08-01T19:56:11.377 INFO:teuthology.orchestra.run.smithi155.stdout: "age": 66.211454439999997, 2023-08-01T19:56:11.377 INFO:teuthology.orchestra.run.smithi155.stdout: "duration": 0.071105065999999995, 2023-08-01T19:56:11.377 INFO:teuthology.orchestra.run.smithi155.stdout: "type_data": { 2023-08-01T19:56:11.377 INFO:teuthology.orchestra.run.smithi155.stdout: "flag_point": "commit sent; apply or cleanup", 2023-08-01T19:56:11.377 INFO:teuthology.orchestra.run.smithi155.stdout: "client_info": { 2023-08-01T19:56:11.378 INFO:teuthology.orchestra.run.smithi155.stdout: "client": "client.4668", 2023-08-01T19:56:11.378 INFO:teuthology.orchestra.run.smithi155.stdout: "client_addr": "172.21.15.6:0/1709472247", 2023-08-01T19:56:11.378 INFO:teuthology.orchestra.run.smithi155.stdout: "tid": 100242 2023-08-01T19:56:11.378 INFO:teuthology.orchestra.run.smithi155.stdout: }, 2023-08-01T19:56:11.378 INFO:teuthology.orchestra.run.smithi155.stdout: "events": [ 2023-08-01T19:56:11.378 INFO:teuthology.orchestra.run.smithi155.stdout: { 2023-08-01T19:56:11.378 INFO:teuthology.orchestra.run.smithi155.stdout: "event": "initiated", 2023-08-01T19:56:11.378 INFO:teuthology.orchestra.run.smithi155.stdout: "time": "2023-08-01T19:55:05.150616+0000", 2023-08-01T19:56:11.379 INFO:teuthology.orchestra.run.smithi155.stdout: "duration": 0 2023-08-01T19:56:11.379 INFO:teuthology.orchestra.run.smithi155.stdout: }, 2023-08-01T19:56:11.379 INFO:teuthology.orchestra.run.smithi155.stdout: { 2023-08-01T19:56:11.379 INFO:teuthology.orchestra.run.smithi155.stdout: "event": "throttled", 2023-08-01T19:56:11.379 INFO:teuthology.orchestra.run.smithi155.stdout: "time": "2023-08-01T19:55:05.150616+0000", 2023-08-01T19:56:11.379 INFO:teuthology.orchestra.run.smithi155.stdout: "duration": 0 2023-08-01T19:56:11.379 INFO:teuthology.orchestra.run.smithi155.stdout: }, 2023-08-01T19:56:11.379 INFO:teuthology.orchestra.run.smithi155.stdout: { 2023-08-01T19:56:11.380 INFO:teuthology.orchestra.run.smithi155.stdout: "event": "header_read", 2023-08-01T19:56:11.380 INFO:teuthology.orchestra.run.smithi155.stdout: "time": "2023-08-01T19:55:05.150615+0000", 2023-08-01T19:56:11.380 INFO:teuthology.orchestra.run.smithi155.stdout: "duration": 4294967295.999999 2023-08-01T19:56:11.380 INFO:teuthology.orchestra.run.smithi155.stdout: }, 2023-08-01T19:56:11.380 INFO:teuthology.orchestra.run.smithi155.stdout: { 2023-08-01T19:56:11.380 INFO:teuthology.orchestra.run.smithi155.stdout: "event": "all_read", 2023-08-01T19:56:11.380 INFO:teuthology.orchestra.run.smithi155.stdout: "time": "2023-08-01T19:55:05.150696+0000", 2023-08-01T19:56:11.381 INFO:teuthology.orchestra.run.smithi155.stdout: "duration": 8.0852000000000004e-05 2023-08-01T19:56:11.381 INFO:teuthology.orchestra.run.smithi155.stdout: }, 2023-08-01T19:56:11.381 INFO:teuthology.orchestra.run.smithi155.stdout: { 2023-08-01T19:56:11.381 INFO:teuthology.orchestra.run.smithi155.stdout: "event": "dispatched", 2023-08-01T19:56:11.381 INFO:teuthology.orchestra.run.smithi155.stdout: "time": "2023-08-01T19:55:05.150708+0000", 2023-08-01T19:56:11.381 INFO:teuthology.orchestra.run.smithi155.stdout: "duration": 1.2116999999999999e-05 2023-08-01T19:56:11.381 INFO:teuthology.orchestra.run.smithi155.stdout: }, 2023-08-01T19:56:11.381 INFO:teuthology.orchestra.run.smithi155.stdout: { 2023-08-01T19:56:11.382 INFO:teuthology.orchestra.run.smithi155.stdout: "event": "queued_for_pg", 2023-08-01T19:56:11.382 INFO:teuthology.orchestra.run.smithi155.stdout: "time": "2023-08-01T19:55:05.150713+0000", 2023-08-01T19:56:11.382 INFO:teuthology.orchestra.run.smithi155.stdout: "duration": 5.4620000000000004e-06 2023-08-01T19:56:11.382 INFO:teuthology.orchestra.run.smithi155.stdout: }, 2023-08-01T19:56:11.382 INFO:teuthology.orchestra.run.smithi155.stdout: { 2023-08-01T19:56:11.382 INFO:teuthology.orchestra.run.smithi155.stdout: "event": "reached_pg", 2023-08-01T19:56:11.382 INFO:teuthology.orchestra.run.smithi155.stdout: "time": "2023-08-01T19:55:05.150761+0000", 2023-08-01T19:56:11.382 INFO:teuthology.orchestra.run.smithi155.stdout: "duration": 4.7429000000000003e-05 2023-08-01T19:56:11.383 INFO:teuthology.orchestra.run.smithi155.stdout: }, 2023-08-01T19:56:11.383 INFO:teuthology.orchestra.run.smithi155.stdout: { 2023-08-01T19:56:11.383 INFO:teuthology.orchestra.run.smithi155.stdout: "event": "started", 2023-08-01T19:56:11.383 INFO:teuthology.orchestra.run.smithi155.stdout: "time": "2023-08-01T19:55:05.150856+0000", 2023-08-01T19:56:11.383 INFO:teuthology.orchestra.run.smithi155.stdout: "duration": 9.5356e-05 2023-08-01T19:56:11.383 INFO:teuthology.orchestra.run.smithi155.stdout: }, 2023-08-01T19:56:11.383 INFO:teuthology.orchestra.run.smithi155.stdout: { 2023-08-01T19:56:11.383 INFO:teuthology.orchestra.run.smithi155.stdout: "event": "waiting for subops from 0", 2023-08-01T19:56:11.384 INFO:teuthology.orchestra.run.smithi155.stdout: "time": "2023-08-01T19:55:05.150999+0000", 2023-08-01T19:56:11.384 INFO:teuthology.orchestra.run.smithi155.stdout: "duration": 0.00014234499999999999 2023-08-01T19:56:11.384 INFO:teuthology.orchestra.run.smithi155.stdout: }, 2023-08-01T19:56:11.384 INFO:teuthology.orchestra.run.smithi155.stdout: { 2023-08-01T19:56:11.384 INFO:teuthology.orchestra.run.smithi155.stdout: "event": "sub_op_commit_rec", 2023-08-01T19:56:11.384 INFO:teuthology.orchestra.run.smithi155.stdout: "time": "2023-08-01T19:55:05.219001+0000", 2023-08-01T19:56:11.384 INFO:teuthology.orchestra.run.smithi155.stdout: "duration": 0.068002776000000001 2023-08-01T19:56:11.384 INFO:teuthology.orchestra.run.smithi155.stdout: }, 2023-08-01T19:56:11.385 INFO:teuthology.orchestra.run.smithi155.stdout: { 2023-08-01T19:56:11.385 INFO:teuthology.orchestra.run.smithi155.stdout: "event": "op_commit", 2023-08-01T19:56:11.385 INFO:teuthology.orchestra.run.smithi155.stdout: "time": "2023-08-01T19:55:05.221635+0000", 2023-08-01T19:56:11.385 INFO:teuthology.orchestra.run.smithi155.stdout: "duration": 0.0026340579999999999 2023-08-01T19:56:11.385 INFO:teuthology.orchestra.run.smithi155.stdout: }, 2023-08-01T19:56:11.385 INFO:teuthology.orchestra.run.smithi155.stdout: { 2023-08-01T19:56:11.385 INFO:teuthology.orchestra.run.smithi155.stdout: "event": "commit_sent", 2023-08-01T19:56:11.386 INFO:teuthology.orchestra.run.smithi155.stdout: "time": "2023-08-01T19:55:05.221682+0000", 2023-08-01T19:56:11.386 INFO:teuthology.orchestra.run.smithi155.stdout: "duration": 4.7123999999999998e-05 2023-08-01T19:56:11.386 INFO:teuthology.orchestra.run.smithi155.stdout: }, 2023-08-01T19:56:11.386 INFO:teuthology.orchestra.run.smithi155.stdout: { 2023-08-01T19:56:11.386 INFO:teuthology.orchestra.run.smithi155.stdout: "event": "done", 2023-08-01T19:56:11.386 INFO:teuthology.orchestra.run.smithi155.stdout: "time": "2023-08-01T19:55:05.221721+0000", 2023-08-01T19:56:11.386 INFO:teuthology.orchestra.run.smithi155.stdout: "duration": 3.8529999999999999e-05 2023-08-01T19:56:11.386 INFO:teuthology.orchestra.run.smithi155.stdout: } 2023-08-01T19:56:11.387 INFO:teuthology.orchestra.run.smithi155.stdout: ] 2023-08-01T19:56:11.387 INFO:teuthology.orchestra.run.smithi155.stdout: } 2023-08-01T19:56:11.387 INFO:teuthology.orchestra.run.smithi155.stdout: }, 2023-08-01T19:56:11.387 INFO:teuthology.orchestra.run.smithi155.stdout: { 2023-08-01T19:56:11.387 INFO:teuthology.orchestra.run.smithi155.stdout: "description": "osd_repop(client.4668.0:100240 5.a e37/19 5:5313c5b9:::benchmark_data_smithi006_114134_object100239:head v 37'6227, mlcod=37'6225)", 2023-08-01T19:56:11.387 INFO:teuthology.orchestra.run.smithi155.stdout: "initiated_at": "2023-08-01T19:55:05.150778+0000", 2023-08-01T19:56:11.387 INFO:teuthology.orchestra.run.smithi155.stdout: "age": 66.211292239000002, 2023-08-01T19:56:11.387 INFO:teuthology.orchestra.run.smithi155.stdout: "duration": 0.073362533999999993, 2023-08-01T19:56:11.388 INFO:teuthology.orchestra.run.smithi155.stdout: "type_data": { 2023-08-01T19:56:11.388 INFO:teuthology.orchestra.run.smithi155.stdout: "flag_point": "commit sent; apply or cleanup", 2023-08-01T19:56:11.388 INFO:teuthology.orchestra.run.smithi155.stdout: "events": [ 2023-08-01T19:56:11.388 INFO:teuthology.orchestra.run.smithi155.stdout: { 2023-08-01T19:56:11.388 INFO:teuthology.orchestra.run.smithi155.stdout: "event": "initiated", 2023-08-01T19:56:11.388 INFO:teuthology.orchestra.run.smithi155.stdout: "time": "2023-08-01T19:55:05.150778+0000", 2023-08-01T19:56:11.388 INFO:teuthology.orchestra.run.smithi155.stdout: "duration": 0 2023-08-01T19:56:11.388 INFO:teuthology.orchestra.run.smithi155.stdout: }, 2023-08-01T19:56:11.389 INFO:teuthology.orchestra.run.smithi155.stdout: { 2023-08-01T19:56:11.389 INFO:teuthology.orchestra.run.smithi155.stdout: "event": "throttled", 2023-08-01T19:56:11.389 INFO:teuthology.orchestra.run.smithi155.stdout: "time": "2023-08-01T19:55:05.150778+0000", 2023-08-01T19:56:11.389 INFO:teuthology.orchestra.run.smithi155.stdout: "duration": 0 2023-08-01T19:56:11.389 INFO:teuthology.orchestra.run.smithi155.stdout: }, 2023-08-01T19:56:11.389 INFO:teuthology.orchestra.run.smithi155.stdout: { 2023-08-01T19:56:11.389 INFO:teuthology.orchestra.run.smithi155.stdout: "event": "header_read", 2023-08-01T19:56:11.389 INFO:teuthology.orchestra.run.smithi155.stdout: "time": "2023-08-01T19:55:05.150778+0000", 2023-08-01T19:56:11.390 INFO:teuthology.orchestra.run.smithi155.stdout: "duration": 4294967295.9999995 2023-08-01T19:56:11.390 INFO:teuthology.orchestra.run.smithi155.stdout: }, 2023-08-01T19:56:11.390 INFO:teuthology.orchestra.run.smithi155.stdout: { 2023-08-01T19:56:11.390 INFO:teuthology.orchestra.run.smithi155.stdout: "event": "all_read", 2023-08-01T19:56:11.390 INFO:teuthology.orchestra.run.smithi155.stdout: "time": "2023-08-01T19:55:05.150811+0000", 2023-08-01T19:56:11.390 INFO:teuthology.orchestra.run.smithi155.stdout: "duration": 3.3664000000000002e-05 2023-08-01T19:56:11.390 INFO:teuthology.orchestra.run.smithi155.stdout: }, 2023-08-01T19:56:11.391 INFO:teuthology.orchestra.run.smithi155.stdout: { 2023-08-01T19:56:11.391 INFO:teuthology.orchestra.run.smithi155.stdout: "event": "dispatched", 2023-08-01T19:56:11.391 INFO:teuthology.orchestra.run.smithi155.stdout: "time": "2023-08-01T19:55:05.150818+0000", 2023-08-01T19:56:11.391 INFO:teuthology.orchestra.run.smithi155.stdout: "duration": 6.5769999999999999e-06 2023-08-01T19:56:11.391 INFO:teuthology.orchestra.run.smithi155.stdout: }, 2023-08-01T19:56:11.391 INFO:teuthology.orchestra.run.smithi155.stdout: { 2023-08-01T19:56:11.391 INFO:teuthology.orchestra.run.smithi155.stdout: "event": "queued_for_pg", 2023-08-01T19:56:11.391 INFO:teuthology.orchestra.run.smithi155.stdout: "time": "2023-08-01T19:55:05.150822+0000", 2023-08-01T19:56:11.392 INFO:teuthology.orchestra.run.smithi155.stdout: "duration": 4.0060000000000003e-06 2023-08-01T19:56:11.392 INFO:teuthology.orchestra.run.smithi155.stdout: }, 2023-08-01T19:56:11.392 INFO:teuthology.orchestra.run.smithi155.stdout: { 2023-08-01T19:56:11.392 INFO:teuthology.orchestra.run.smithi155.stdout: "event": "reached_pg", 2023-08-01T19:56:11.392 INFO:teuthology.orchestra.run.smithi155.stdout: "time": "2023-08-01T19:55:05.150855+0000", 2023-08-01T19:56:11.392 INFO:teuthology.orchestra.run.smithi155.stdout: "duration": 3.3204999999999998e-05 2023-08-01T19:56:11.392 INFO:teuthology.orchestra.run.smithi155.stdout: }, 2023-08-01T19:56:11.392 INFO:teuthology.orchestra.run.smithi155.stdout: { 2023-08-01T19:56:11.393 INFO:teuthology.orchestra.run.smithi155.stdout: "event": "started", 2023-08-01T19:56:11.393 INFO:teuthology.orchestra.run.smithi155.stdout: "time": "2023-08-01T19:55:05.150873+0000", 2023-08-01T19:56:11.393 INFO:teuthology.orchestra.run.smithi155.stdout: "duration": 1.8139999999999999e-05 2023-08-01T19:56:11.393 INFO:teuthology.orchestra.run.smithi155.stdout: }, 2023-08-01T19:56:11.393 INFO:teuthology.orchestra.run.smithi155.stdout: { 2023-08-01T19:56:11.393 INFO:teuthology.orchestra.run.smithi155.stdout: "event": "commit_sent", 2023-08-01T19:56:11.393 INFO:teuthology.orchestra.run.smithi155.stdout: "time": "2023-08-01T19:55:05.224095+0000", 2023-08-01T19:56:11.394 INFO:teuthology.orchestra.run.smithi155.stdout: "duration": 0.073221895999999995 2023-08-01T19:56:11.394 INFO:teuthology.orchestra.run.smithi155.stdout: }, 2023-08-01T19:56:11.394 INFO:teuthology.orchestra.run.smithi155.stdout: { 2023-08-01T19:56:11.394 INFO:teuthology.orchestra.run.smithi155.stdout: "event": "done", 2023-08-01T19:56:11.394 INFO:teuthology.orchestra.run.smithi155.stdout: "time": "2023-08-01T19:55:05.224141+0000", 2023-08-01T19:56:11.394 INFO:teuthology.orchestra.run.smithi155.stdout: "duration": 4.5385e-05 2023-08-01T19:56:11.394 INFO:teuthology.orchestra.run.smithi155.stdout: } 2023-08-01T19:56:11.394 INFO:teuthology.orchestra.run.smithi155.stdout: ] 2023-08-01T19:56:11.395 INFO:teuthology.orchestra.run.smithi155.stdout: } 2023-08-01T19:56:11.395 INFO:teuthology.orchestra.run.smithi155.stdout: }, 2023-08-01T19:56:11.395 INFO:teuthology.orchestra.run.smithi155.stdout: { 2023-08-01T19:56:11.395 INFO:teuthology.orchestra.run.smithi155.stdout: "description": "osd_op(client.4668.0:100245 5.e 5:71869c66:::benchmark_data_smithi006_114134_object100244:head [set-alloc-hint object_size 65536 write_size 65536,write 0~65536] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e37)", 2023-08-01T19:56:11.395 INFO:teuthology.orchestra.run.smithi155.stdout: "initiated_at": "2023-08-01T19:55:05.150991+0000", 2023-08-01T19:56:11.395 INFO:teuthology.orchestra.run.smithi155.stdout: "age": 66.211079452000007, 2023-08-01T19:56:11.395 INFO:teuthology.orchestra.run.smithi155.stdout: "duration": 0.070734490999999997, 2023-08-01T19:56:11.395 INFO:teuthology.orchestra.run.smithi155.stdout: "type_data": { 2023-08-01T19:56:11.396 INFO:teuthology.orchestra.run.smithi155.stdout: "flag_point": "commit sent; apply or cleanup", 2023-08-01T19:56:11.396 INFO:teuthology.orchestra.run.smithi155.stdout: "client_info": { 2023-08-01T19:56:11.396 INFO:teuthology.orchestra.run.smithi155.stdout: "client": "client.4668", 2023-08-01T19:56:11.396 INFO:teuthology.orchestra.run.smithi155.stdout: "client_addr": "172.21.15.6:0/1709472247", 2023-08-01T19:56:11.396 INFO:teuthology.orchestra.run.smithi155.stdout: "tid": 100245 2023-08-01T19:56:11.396 INFO:teuthology.orchestra.run.smithi155.stdout: }, 2023-08-01T19:56:11.396 INFO:teuthology.orchestra.run.smithi155.stdout: "events": [ 2023-08-01T19:56:11.396 INFO:teuthology.orchestra.run.smithi155.stdout: { 2023-08-01T19:56:11.397 INFO:teuthology.orchestra.run.smithi155.stdout: "event": "initiated", 2023-08-01T19:56:11.397 INFO:teuthology.orchestra.run.smithi155.stdout: "time": "2023-08-01T19:55:05.150991+0000", 2023-08-01T19:56:11.397 INFO:teuthology.orchestra.run.smithi155.stdout: "duration": 0 2023-08-01T19:56:11.397 INFO:teuthology.orchestra.run.smithi155.stdout: }, 2023-08-01T19:56:11.397 INFO:teuthology.orchestra.run.smithi155.stdout: { 2023-08-01T19:56:11.397 INFO:teuthology.orchestra.run.smithi155.stdout: "event": "throttled", 2023-08-01T19:56:11.397 INFO:teuthology.orchestra.run.smithi155.stdout: "time": "2023-08-01T19:55:05.150991+0000", 2023-08-01T19:56:11.398 INFO:teuthology.orchestra.run.smithi155.stdout: "duration": 0 2023-08-01T19:56:11.398 INFO:teuthology.orchestra.run.smithi155.stdout: }, 2023-08-01T19:56:11.398 INFO:teuthology.orchestra.run.smithi155.stdout: { 2023-08-01T19:56:11.398 INFO:teuthology.orchestra.run.smithi155.stdout: "event": "header_read", 2023-08-01T19:56:11.398 INFO:teuthology.orchestra.run.smithi155.stdout: "time": "2023-08-01T19:55:05.150990+0000", 2023-08-01T19:56:11.398 INFO:teuthology.orchestra.run.smithi155.stdout: "duration": 4294967295.999999 2023-08-01T19:56:11.398 INFO:teuthology.orchestra.run.smithi155.stdout: }, 2023-08-01T19:56:11.398 INFO:teuthology.orchestra.run.smithi155.stdout: { 2023-08-01T19:56:11.399 INFO:teuthology.orchestra.run.smithi155.stdout: "event": "all_read", 2023-08-01T19:56:11.399 INFO:teuthology.orchestra.run.smithi155.stdout: "time": "2023-08-01T19:55:05.151108+0000", 2023-08-01T19:56:11.399 INFO:teuthology.orchestra.run.smithi155.stdout: "duration": 0.00011849300000000001 2023-08-01T19:56:11.399 INFO:teuthology.orchestra.run.smithi155.stdout: }, 2023-08-01T19:56:11.399 INFO:teuthology.orchestra.run.smithi155.stdout: { 2023-08-01T19:56:11.399 INFO:teuthology.orchestra.run.smithi155.stdout: "event": "dispatched", 2023-08-01T19:56:11.399 INFO:teuthology.orchestra.run.smithi155.stdout: "time": "2023-08-01T19:55:05.151117+0000", 2023-08-01T19:56:11.399 INFO:teuthology.orchestra.run.smithi155.stdout: "duration": 8.1040000000000007e-06 2023-08-01T19:56:11.400 INFO:teuthology.orchestra.run.smithi155.stdout: }, 2023-08-01T19:56:11.400 INFO:teuthology.orchestra.run.smithi155.stdout: { 2023-08-01T19:56:11.400 INFO:teuthology.orchestra.run.smithi155.stdout: "event": "queued_for_pg", 2023-08-01T19:56:11.400 INFO:teuthology.orchestra.run.smithi155.stdout: "time": "2023-08-01T19:55:05.151121+0000", 2023-08-01T19:56:11.400 INFO:teuthology.orchestra.run.smithi155.stdout: "duration": 4.2019999999999997e-06 2023-08-01T19:56:11.400 INFO:teuthology.orchestra.run.smithi155.stdout: }, 2023-08-01T19:56:11.400 INFO:teuthology.orchestra.run.smithi155.stdout: { 2023-08-01T19:56:11.400 INFO:teuthology.orchestra.run.smithi155.stdout: "event": "reached_pg", 2023-08-01T19:56:11.401 INFO:teuthology.orchestra.run.smithi155.stdout: "time": "2023-08-01T19:55:05.151162+0000", 2023-08-01T19:56:11.401 INFO:teuthology.orchestra.run.smithi155.stdout: "duration": 4.1448e-05 2023-08-01T19:56:11.401 INFO:teuthology.orchestra.run.smithi155.stdout: }, 2023-08-01T19:56:11.401 INFO:teuthology.orchestra.run.smithi155.stdout: { 2023-08-01T19:56:11.401 INFO:teuthology.orchestra.run.smithi155.stdout: "event": "started", 2023-08-01T19:56:11.401 INFO:teuthology.orchestra.run.smithi155.stdout: "time": "2023-08-01T19:55:05.151281+0000", 2023-08-01T19:56:11.401 INFO:teuthology.orchestra.run.smithi155.stdout: "duration": 0.000119141 2023-08-01T19:56:11.402 INFO:teuthology.orchestra.run.smithi155.stdout: }, 2023-08-01T19:56:11.402 INFO:teuthology.orchestra.run.smithi155.stdout: { 2023-08-01T19:56:11.402 INFO:teuthology.orchestra.run.smithi155.stdout: "event": "waiting for subops from 0", 2023-08-01T19:56:11.402 INFO:teuthology.orchestra.run.smithi155.stdout: "time": "2023-08-01T19:55:05.151443+0000", 2023-08-01T19:56:11.402 INFO:teuthology.orchestra.run.smithi155.stdout: "duration": 0.00016181600000000001 2023-08-01T19:56:11.402 INFO:teuthology.orchestra.run.smithi155.stdout: }, 2023-08-01T19:56:11.402 INFO:teuthology.orchestra.run.smithi155.stdout: { 2023-08-01T19:56:11.402 INFO:teuthology.orchestra.run.smithi155.stdout: "event": "sub_op_commit_rec", 2023-08-01T19:56:11.403 INFO:teuthology.orchestra.run.smithi155.stdout: "time": "2023-08-01T19:55:05.219101+0000", 2023-08-01T19:56:11.403 INFO:teuthology.orchestra.run.smithi155.stdout: "duration": 0.067658037000000004 2023-08-01T19:56:11.403 INFO:teuthology.orchestra.run.smithi155.stdout: }, 2023-08-01T19:56:11.403 INFO:teuthology.orchestra.run.smithi155.stdout: { 2023-08-01T19:56:11.403 INFO:teuthology.orchestra.run.smithi155.stdout: "event": "op_commit", 2023-08-01T19:56:11.403 INFO:teuthology.orchestra.run.smithi155.stdout: "time": "2023-08-01T19:55:05.221646+0000", 2023-08-01T19:56:11.403 INFO:teuthology.orchestra.run.smithi155.stdout: "duration": 0.0025450540000000002 2023-08-01T19:56:11.403 INFO:teuthology.orchestra.run.smithi155.stdout: }, 2023-08-01T19:56:11.404 INFO:teuthology.orchestra.run.smithi155.stdout: { 2023-08-01T19:56:11.404 INFO:teuthology.orchestra.run.smithi155.stdout: "event": "commit_sent", 2023-08-01T19:56:11.404 INFO:teuthology.orchestra.run.smithi155.stdout: "time": "2023-08-01T19:55:05.221689+0000", 2023-08-01T19:56:11.404 INFO:teuthology.orchestra.run.smithi155.stdout: "duration": 4.3078999999999999e-05 2023-08-01T19:56:11.404 INFO:teuthology.orchestra.run.smithi155.stdout: }, 2023-08-01T19:56:11.404 INFO:teuthology.orchestra.run.smithi155.stdout: { 2023-08-01T19:56:11.404 INFO:teuthology.orchestra.run.smithi155.stdout: "event": "done", 2023-08-01T19:56:11.404 INFO:teuthology.orchestra.run.smithi155.stdout: "time": "2023-08-01T19:55:05.221725+0000", 2023-08-01T19:56:11.405 INFO:teuthology.orchestra.run.smithi155.stdout: "duration": 3.6137999999999999e-05 2023-08-01T19:56:11.405 INFO:teuthology.orchestra.run.smithi155.stdout: } 2023-08-01T19:56:11.405 INFO:teuthology.orchestra.run.smithi155.stdout: ] 2023-08-01T19:56:11.405 INFO:teuthology.orchestra.run.smithi155.stdout: } 2023-08-01T19:56:11.405 INFO:teuthology.orchestra.run.smithi155.stdout: }, 2023-08-01T19:56:11.405 INFO:teuthology.orchestra.run.smithi155.stdout: { 2023-08-01T19:56:11.405 INFO:teuthology.orchestra.run.smithi155.stdout: "description": "osd_repop(client.4668.0:100243 5.a e37/19 5:5e8193b6:::benchmark_data_smithi006_114134_object100242:head v 37'6228, mlcod=37'6225)", 2023-08-01T19:56:11.405 INFO:teuthology.orchestra.run.smithi155.stdout: "initiated_at": "2023-08-01T19:55:05.151148+0000", 2023-08-01T19:56:11.406 INFO:teuthology.orchestra.run.smithi155.stdout: "age": 66.210922440999994, 2023-08-01T19:56:11.406 INFO:teuthology.orchestra.run.smithi155.stdout: "duration": 0.073020370000000001, 2023-08-01T19:56:11.406 INFO:teuthology.orchestra.run.smithi155.stdout: "type_data": { 2023-08-01T19:56:11.406 INFO:teuthology.orchestra.run.smithi155.stdout: "flag_point": "commit sent; apply or cleanup", 2023-08-01T19:56:11.406 INFO:teuthology.orchestra.run.smithi155.stdout: "events": [ 2023-08-01T19:56:11.406 INFO:teuthology.orchestra.run.smithi155.stdout: { 2023-08-01T19:56:11.406 INFO:teuthology.orchestra.run.smithi155.stdout: "event": "initiated", 2023-08-01T19:56:11.407 INFO:teuthology.orchestra.run.smithi155.stdout: "time": "2023-08-01T19:55:05.151148+0000", 2023-08-01T19:56:11.407 INFO:teuthology.orchestra.run.smithi155.stdout: "duration": 0 2023-08-01T19:56:11.407 INFO:teuthology.orchestra.run.smithi155.stdout: }, 2023-08-01T19:56:11.407 INFO:teuthology.orchestra.run.smithi155.stdout: { 2023-08-01T19:56:11.407 INFO:teuthology.orchestra.run.smithi155.stdout: "event": "throttled", 2023-08-01T19:56:11.407 INFO:teuthology.orchestra.run.smithi155.stdout: "time": "2023-08-01T19:55:05.151148+0000", 2023-08-01T19:56:11.407 INFO:teuthology.orchestra.run.smithi155.stdout: "duration": 0 2023-08-01T19:56:11.407 INFO:teuthology.orchestra.run.smithi155.stdout: }, 2023-08-01T19:56:11.408 INFO:teuthology.orchestra.run.smithi155.stdout: { 2023-08-01T19:56:11.408 INFO:teuthology.orchestra.run.smithi155.stdout: "event": "header_read", 2023-08-01T19:56:11.408 INFO:teuthology.orchestra.run.smithi155.stdout: "time": "2023-08-01T19:55:05.151147+0000", 2023-08-01T19:56:11.408 INFO:teuthology.orchestra.run.smithi155.stdout: "duration": 4294967295.9999995 2023-08-01T19:56:11.408 INFO:teuthology.orchestra.run.smithi155.stdout: }, 2023-08-01T19:56:11.408 INFO:teuthology.orchestra.run.smithi155.stdout: { 2023-08-01T19:56:11.408 INFO:teuthology.orchestra.run.smithi155.stdout: "event": "all_read", 2023-08-01T19:56:11.408 INFO:teuthology.orchestra.run.smithi155.stdout: "time": "2023-08-01T19:55:05.151231+0000", 2023-08-01T19:56:11.409 INFO:teuthology.orchestra.run.smithi155.stdout: "duration": 8.3135999999999998e-05 2023-08-01T19:56:11.409 INFO:teuthology.orchestra.run.smithi155.stdout: }, 2023-08-01T19:56:11.409 INFO:teuthology.orchestra.run.smithi155.stdout: { 2023-08-01T19:56:11.409 INFO:teuthology.orchestra.run.smithi155.stdout: "event": "dispatched", 2023-08-01T19:56:11.409 INFO:teuthology.orchestra.run.smithi155.stdout: "time": "2023-08-01T19:55:05.151239+0000", 2023-08-01T19:56:11.409 INFO:teuthology.orchestra.run.smithi155.stdout: "duration": 8.7469999999999994e-06 2023-08-01T19:56:11.409 INFO:teuthology.orchestra.run.smithi155.stdout: }, 2023-08-01T19:56:11.409 INFO:teuthology.orchestra.run.smithi155.stdout: { 2023-08-01T19:56:11.410 INFO:teuthology.orchestra.run.smithi155.stdout: "event": "queued_for_pg", 2023-08-01T19:56:11.410 INFO:teuthology.orchestra.run.smithi155.stdout: "time": "2023-08-01T19:55:05.151244+0000", 2023-08-01T19:56:11.410 INFO:teuthology.orchestra.run.smithi155.stdout: "duration": 4.4800000000000003e-06 2023-08-01T19:56:11.410 INFO:teuthology.orchestra.run.smithi155.stdout: }, 2023-08-01T19:56:11.410 INFO:teuthology.orchestra.run.smithi155.stdout: { 2023-08-01T19:56:11.410 INFO:teuthology.orchestra.run.smithi155.stdout: "event": "reached_pg", 2023-08-01T19:56:11.410 INFO:teuthology.orchestra.run.smithi155.stdout: "time": "2023-08-01T19:55:05.152938+0000", 2023-08-01T19:56:11.410 INFO:teuthology.orchestra.run.smithi155.stdout: "duration": 0.001693824 2023-08-01T19:56:11.411 INFO:teuthology.orchestra.run.smithi155.stdout: }, 2023-08-01T19:56:11.411 INFO:teuthology.orchestra.run.smithi155.stdout: { 2023-08-01T19:56:11.411 INFO:teuthology.orchestra.run.smithi155.stdout: "event": "started", 2023-08-01T19:56:11.411 INFO:teuthology.orchestra.run.smithi155.stdout: "time": "2023-08-01T19:55:05.152956+0000", 2023-08-01T19:56:11.411 INFO:teuthology.orchestra.run.smithi155.stdout: "duration": 1.8287e-05 2023-08-01T19:56:11.411 INFO:teuthology.orchestra.run.smithi155.stdout: }, 2023-08-01T19:56:11.411 INFO:teuthology.orchestra.run.smithi155.stdout: { 2023-08-01T19:56:11.412 INFO:teuthology.orchestra.run.smithi155.stdout: "event": "commit_sent", 2023-08-01T19:56:11.412 INFO:teuthology.orchestra.run.smithi155.stdout: "time": "2023-08-01T19:55:05.224145+0000", 2023-08-01T19:56:11.412 INFO:teuthology.orchestra.run.smithi155.stdout: "duration": 0.071189447000000003 2023-08-01T19:56:11.412 INFO:teuthology.orchestra.run.smithi155.stdout: }, 2023-08-01T19:56:11.412 INFO:teuthology.orchestra.run.smithi155.stdout: { 2023-08-01T19:56:11.412 INFO:teuthology.orchestra.run.smithi155.stdout: "event": "done", 2023-08-01T19:56:11.412 INFO:teuthology.orchestra.run.smithi155.stdout: "time": "2023-08-01T19:55:05.224168+0000", 2023-08-01T19:56:11.412 INFO:teuthology.orchestra.run.smithi155.stdout: "duration": 2.3008999999999999e-05 2023-08-01T19:56:11.413 INFO:teuthology.orchestra.run.smithi155.stdout: } 2023-08-01T19:56:11.413 INFO:teuthology.orchestra.run.smithi155.stdout: ] 2023-08-01T19:56:11.413 INFO:teuthology.orchestra.run.smithi155.stdout: } 2023-08-01T19:56:11.413 INFO:teuthology.orchestra.run.smithi155.stdout: }, 2023-08-01T19:56:11.413 INFO:teuthology.orchestra.run.smithi155.stdout: { 2023-08-01T19:56:11.413 INFO:teuthology.orchestra.run.smithi155.stdout: "description": "osd_repop(client.4668.0:100244 5.9 e37/19 5:92f56a12:::benchmark_data_smithi006_114134_object100243:head v 37'6294, mlcod=37'6292)", 2023-08-01T19:56:11.413 INFO:teuthology.orchestra.run.smithi155.stdout: "initiated_at": "2023-08-01T19:55:05.151325+0000", 2023-08-01T19:56:11.413 INFO:teuthology.orchestra.run.smithi155.stdout: "age": 66.210745095999997, 2023-08-01T19:56:11.414 INFO:teuthology.orchestra.run.smithi155.stdout: "duration": 0.071883673999999995, 2023-08-01T19:56:11.414 INFO:teuthology.orchestra.run.smithi155.stdout: "type_data": { 2023-08-01T19:56:11.414 INFO:teuthology.orchestra.run.smithi155.stdout: "flag_point": "commit sent; apply or cleanup", 2023-08-01T19:56:11.414 INFO:teuthology.orchestra.run.smithi155.stdout: "events": [ 2023-08-01T19:56:11.414 INFO:teuthology.orchestra.run.smithi155.stdout: { 2023-08-01T19:56:11.414 INFO:teuthology.orchestra.run.smithi155.stdout: "event": "initiated", 2023-08-01T19:56:11.414 INFO:teuthology.orchestra.run.smithi155.stdout: "time": "2023-08-01T19:55:05.151325+0000", 2023-08-01T19:56:11.414 INFO:teuthology.orchestra.run.smithi155.stdout: "duration": 0 2023-08-01T19:56:11.415 INFO:teuthology.orchestra.run.smithi155.stdout: }, 2023-08-01T19:56:11.415 INFO:teuthology.orchestra.run.smithi155.stdout: { 2023-08-01T19:56:11.415 INFO:teuthology.orchestra.run.smithi155.stdout: "event": "throttled", 2023-08-01T19:56:11.415 INFO:teuthology.orchestra.run.smithi155.stdout: "time": "2023-08-01T19:55:05.151325+0000", 2023-08-01T19:56:11.415 INFO:teuthology.orchestra.run.smithi155.stdout: "duration": 0 2023-08-01T19:56:11.415 INFO:teuthology.orchestra.run.smithi155.stdout: }, 2023-08-01T19:56:11.415 INFO:teuthology.orchestra.run.smithi155.stdout: { 2023-08-01T19:56:11.416 INFO:teuthology.orchestra.run.smithi155.stdout: "event": "header_read", 2023-08-01T19:56:11.416 INFO:teuthology.orchestra.run.smithi155.stdout: "time": "2023-08-01T19:55:05.151325+0000", 2023-08-01T19:56:11.416 INFO:teuthology.orchestra.run.smithi155.stdout: "duration": 4294967295.9999995 2023-08-01T19:56:11.416 INFO:teuthology.orchestra.run.smithi155.stdout: }, 2023-08-01T19:56:11.416 INFO:teuthology.orchestra.run.smithi155.stdout: { 2023-08-01T19:56:11.416 INFO:teuthology.orchestra.run.smithi155.stdout: "event": "all_read", 2023-08-01T19:56:11.416 INFO:teuthology.orchestra.run.smithi155.stdout: "time": "2023-08-01T19:55:05.151390+0000", 2023-08-01T19:56:11.416 INFO:teuthology.orchestra.run.smithi155.stdout: "duration": 6.5456999999999993e-05 2023-08-01T19:56:11.417 INFO:teuthology.orchestra.run.smithi155.stdout: }, 2023-08-01T19:56:11.417 INFO:teuthology.orchestra.run.smithi155.stdout: { 2023-08-01T19:56:11.417 INFO:teuthology.orchestra.run.smithi155.stdout: "event": "dispatched", 2023-08-01T19:56:11.417 INFO:teuthology.orchestra.run.smithi155.stdout: "time": "2023-08-01T19:55:05.151396+0000", 2023-08-01T19:56:11.417 INFO:teuthology.orchestra.run.smithi155.stdout: "duration": 5.9190000000000004e-06 2023-08-01T19:56:11.417 INFO:teuthology.orchestra.run.smithi155.stdout: }, 2023-08-01T19:56:11.417 INFO:teuthology.orchestra.run.smithi155.stdout: { 2023-08-01T19:56:11.417 INFO:teuthology.orchestra.run.smithi155.stdout: "event": "queued_for_pg", 2023-08-01T19:56:11.418 INFO:teuthology.orchestra.run.smithi155.stdout: "time": "2023-08-01T19:55:05.151400+0000", 2023-08-01T19:56:11.418 INFO:teuthology.orchestra.run.smithi155.stdout: "duration": 4.1030000000000004e-06 2023-08-01T19:56:11.418 INFO:teuthology.orchestra.run.smithi155.stdout: }, 2023-08-01T19:56:11.418 INFO:teuthology.orchestra.run.smithi155.stdout: { 2023-08-01T19:56:11.418 INFO:teuthology.orchestra.run.smithi155.stdout: "event": "reached_pg", 2023-08-01T19:56:11.418 INFO:teuthology.orchestra.run.smithi155.stdout: "time": "2023-08-01T19:55:05.151452+0000", 2023-08-01T19:56:11.418 INFO:teuthology.orchestra.run.smithi155.stdout: "duration": 5.2136999999999999e-05 2023-08-01T19:56:11.419 INFO:teuthology.orchestra.run.smithi155.stdout: }, 2023-08-01T19:56:11.419 INFO:teuthology.orchestra.run.smithi155.stdout: { 2023-08-01T19:56:11.419 INFO:teuthology.orchestra.run.smithi155.stdout: "event": "started", 2023-08-01T19:56:11.419 INFO:teuthology.orchestra.run.smithi155.stdout: "time": "2023-08-01T19:55:05.151470+0000", 2023-08-01T19:56:11.419 INFO:teuthology.orchestra.run.smithi155.stdout: "duration": 1.8e-05 2023-08-01T19:56:11.419 INFO:teuthology.orchestra.run.smithi155.stdout: }, 2023-08-01T19:56:11.419 INFO:teuthology.orchestra.run.smithi155.stdout: { 2023-08-01T19:56:11.419 INFO:teuthology.orchestra.run.smithi155.stdout: "event": "commit_sent", 2023-08-01T19:56:11.420 INFO:teuthology.orchestra.run.smithi155.stdout: "time": "2023-08-01T19:55:05.223183+0000", 2023-08-01T19:56:11.420 INFO:teuthology.orchestra.run.smithi155.stdout: "duration": 0.071712622000000004 2023-08-01T19:56:11.420 INFO:teuthology.orchestra.run.smithi155.stdout: }, 2023-08-01T19:56:11.420 INFO:teuthology.orchestra.run.smithi155.stdout: { 2023-08-01T19:56:11.420 INFO:teuthology.orchestra.run.smithi155.stdout: "event": "done", 2023-08-01T19:56:11.420 INFO:teuthology.orchestra.run.smithi155.stdout: "time": "2023-08-01T19:55:05.223209+0000", 2023-08-01T19:56:11.420 INFO:teuthology.orchestra.run.smithi155.stdout: "duration": 2.5956e-05 2023-08-01T19:56:11.420 INFO:teuthology.orchestra.run.smithi155.stdout: } 2023-08-01T19:56:11.421 INFO:teuthology.orchestra.run.smithi155.stdout: ] 2023-08-01T19:56:11.421 INFO:teuthology.orchestra.run.smithi155.stdout: } 2023-08-01T19:56:11.421 INFO:teuthology.orchestra.run.smithi155.stdout: }, 2023-08-01T19:56:11.421 INFO:teuthology.orchestra.run.smithi155.stdout: { 2023-08-01T19:56:11.421 INFO:teuthology.orchestra.run.smithi155.stdout: "description": "osd_op(client.4668.0:100249 5.b 5:d0666827:::benchmark_data_smithi006_114134_object100248:head [set-alloc-hint object_size 65536 write_size 65536,write 0~65536] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e37)", 2023-08-01T19:56:11.421 INFO:teuthology.orchestra.run.smithi155.stdout: "initiated_at": "2023-08-01T19:55:05.153614+0000", 2023-08-01T19:56:11.421 INFO:teuthology.orchestra.run.smithi155.stdout: "age": 66.208456670999993, 2023-08-01T19:56:11.421 INFO:teuthology.orchestra.run.smithi155.stdout: "duration": 0.069286118999999993, 2023-08-01T19:56:11.422 INFO:teuthology.orchestra.run.smithi155.stdout: "type_data": { 2023-08-01T19:56:11.422 INFO:teuthology.orchestra.run.smithi155.stdout: "flag_point": "commit sent; apply or cleanup", 2023-08-01T19:56:11.422 INFO:teuthology.orchestra.run.smithi155.stdout: "client_info": { 2023-08-01T19:56:11.422 INFO:teuthology.orchestra.run.smithi155.stdout: "client": "client.4668", 2023-08-01T19:56:11.422 INFO:teuthology.orchestra.run.smithi155.stdout: "client_addr": "172.21.15.6:0/1709472247", 2023-08-01T19:56:11.422 INFO:teuthology.orchestra.run.smithi155.stdout: "tid": 100249 2023-08-01T19:56:11.422 INFO:teuthology.orchestra.run.smithi155.stdout: }, 2023-08-01T19:56:11.423 INFO:teuthology.orchestra.run.smithi155.stdout: "events": [ 2023-08-01T19:56:11.423 INFO:teuthology.orchestra.run.smithi155.stdout: { 2023-08-01T19:56:11.423 INFO:teuthology.orchestra.run.smithi155.stdout: "event": "initiated", 2023-08-01T19:56:11.423 INFO:teuthology.orchestra.run.smithi155.stdout: "time": "2023-08-01T19:55:05.153614+0000", 2023-08-01T19:56:11.423 INFO:teuthology.orchestra.run.smithi155.stdout: "duration": 0 2023-08-01T19:56:11.423 INFO:teuthology.orchestra.run.smithi155.stdout: }, 2023-08-01T19:56:11.423 INFO:teuthology.orchestra.run.smithi155.stdout: { 2023-08-01T19:56:11.423 INFO:teuthology.orchestra.run.smithi155.stdout: "event": "throttled", 2023-08-01T19:56:11.424 INFO:teuthology.orchestra.run.smithi155.stdout: "time": "2023-08-01T19:55:05.153614+0000", 2023-08-01T19:56:11.424 INFO:teuthology.orchestra.run.smithi155.stdout: "duration": 0 2023-08-01T19:56:11.424 INFO:teuthology.orchestra.run.smithi155.stdout: }, 2023-08-01T19:56:11.424 INFO:teuthology.orchestra.run.smithi155.stdout: { 2023-08-01T19:56:11.424 INFO:teuthology.orchestra.run.smithi155.stdout: "event": "header_read", 2023-08-01T19:56:11.424 INFO:teuthology.orchestra.run.smithi155.stdout: "time": "2023-08-01T19:55:05.153612+0000", 2023-08-01T19:56:11.424 INFO:teuthology.orchestra.run.smithi155.stdout: "duration": 4294967295.9999986 2023-08-01T19:56:11.425 INFO:teuthology.orchestra.run.smithi155.stdout: }, 2023-08-01T19:56:11.425 INFO:teuthology.orchestra.run.smithi155.stdout: { 2023-08-01T19:56:11.425 INFO:teuthology.orchestra.run.smithi155.stdout: "event": "all_read", 2023-08-01T19:56:11.425 INFO:teuthology.orchestra.run.smithi155.stdout: "time": "2023-08-01T19:55:05.153694+0000", 2023-08-01T19:56:11.425 INFO:teuthology.orchestra.run.smithi155.stdout: "duration": 8.1618000000000004e-05 2023-08-01T19:56:11.425 INFO:teuthology.orchestra.run.smithi155.stdout: }, 2023-08-01T19:56:11.425 INFO:teuthology.orchestra.run.smithi155.stdout: { 2023-08-01T19:56:11.425 INFO:teuthology.orchestra.run.smithi155.stdout: "event": "dispatched", 2023-08-01T19:56:11.426 INFO:teuthology.orchestra.run.smithi155.stdout: "time": "2023-08-01T19:55:05.153713+0000", 2023-08-01T19:56:11.426 INFO:teuthology.orchestra.run.smithi155.stdout: "duration": 1.9069999999999999e-05 2023-08-01T19:56:11.426 INFO:teuthology.orchestra.run.smithi155.stdout: }, 2023-08-01T19:56:11.426 INFO:teuthology.orchestra.run.smithi155.stdout: { 2023-08-01T19:56:11.426 INFO:teuthology.orchestra.run.smithi155.stdout: "event": "queued_for_pg", 2023-08-01T19:56:11.426 INFO:teuthology.orchestra.run.smithi155.stdout: "time": "2023-08-01T19:55:05.153726+0000", 2023-08-01T19:56:11.426 INFO:teuthology.orchestra.run.smithi155.stdout: "duration": 1.238e-05 2023-08-01T19:56:11.427 INFO:teuthology.orchestra.run.smithi155.stdout: }, 2023-08-01T19:56:11.427 INFO:teuthology.orchestra.run.smithi155.stdout: { 2023-08-01T19:56:11.427 INFO:teuthology.orchestra.run.smithi155.stdout: "event": "reached_pg", 2023-08-01T19:56:11.427 INFO:teuthology.orchestra.run.smithi155.stdout: "time": "2023-08-01T19:55:05.153761+0000", 2023-08-01T19:56:11.427 INFO:teuthology.orchestra.run.smithi155.stdout: "duration": 3.5046999999999998e-05 2023-08-01T19:56:11.427 INFO:teuthology.orchestra.run.smithi155.stdout: }, 2023-08-01T19:56:11.427 INFO:teuthology.orchestra.run.smithi155.stdout: { 2023-08-01T19:56:11.427 INFO:teuthology.orchestra.run.smithi155.stdout: "event": "started", 2023-08-01T19:56:11.428 INFO:teuthology.orchestra.run.smithi155.stdout: "time": "2023-08-01T19:55:05.153896+0000", 2023-08-01T19:56:11.428 INFO:teuthology.orchestra.run.smithi155.stdout: "duration": 0.00013575800000000001 2023-08-01T19:56:11.428 INFO:teuthology.orchestra.run.smithi155.stdout: }, 2023-08-01T19:56:11.428 INFO:teuthology.orchestra.run.smithi155.stdout: { 2023-08-01T19:56:11.428 INFO:teuthology.orchestra.run.smithi155.stdout: "event": "waiting for subops from 0", 2023-08-01T19:56:11.428 INFO:teuthology.orchestra.run.smithi155.stdout: "time": "2023-08-01T19:55:05.154043+0000", 2023-08-01T19:56:11.428 INFO:teuthology.orchestra.run.smithi155.stdout: "duration": 0.00014650700000000001 2023-08-01T19:56:11.428 INFO:teuthology.orchestra.run.smithi155.stdout: }, 2023-08-01T19:56:11.429 INFO:teuthology.orchestra.run.smithi155.stdout: { 2023-08-01T19:56:11.429 INFO:teuthology.orchestra.run.smithi155.stdout: "event": "sub_op_commit_rec", 2023-08-01T19:56:11.429 INFO:teuthology.orchestra.run.smithi155.stdout: "time": "2023-08-01T19:55:05.221876+0000", 2023-08-01T19:56:11.429 INFO:teuthology.orchestra.run.smithi155.stdout: "duration": 0.067832796000000001 2023-08-01T19:56:11.429 INFO:teuthology.orchestra.run.smithi155.stdout: }, 2023-08-01T19:56:11.429 INFO:teuthology.orchestra.run.smithi155.stdout: { 2023-08-01T19:56:11.429 INFO:teuthology.orchestra.run.smithi155.stdout: "event": "op_commit", 2023-08-01T19:56:11.429 INFO:teuthology.orchestra.run.smithi155.stdout: "time": "2023-08-01T19:55:05.222813+0000", 2023-08-01T19:56:11.430 INFO:teuthology.orchestra.run.smithi155.stdout: "duration": 0.00093755300000000004 2023-08-01T19:56:11.430 INFO:teuthology.orchestra.run.smithi155.stdout: }, 2023-08-01T19:56:11.430 INFO:teuthology.orchestra.run.smithi155.stdout: { 2023-08-01T19:56:11.430 INFO:teuthology.orchestra.run.smithi155.stdout: "event": "commit_sent", 2023-08-01T19:56:11.430 INFO:teuthology.orchestra.run.smithi155.stdout: "time": "2023-08-01T19:55:05.222861+0000", 2023-08-01T19:56:11.430 INFO:teuthology.orchestra.run.smithi155.stdout: "duration": 4.8013999999999998e-05 2023-08-01T19:56:11.430 INFO:teuthology.orchestra.run.smithi155.stdout: }, 2023-08-01T19:56:11.431 INFO:teuthology.orchestra.run.smithi155.stdout: { 2023-08-01T19:56:11.431 INFO:teuthology.orchestra.run.smithi155.stdout: "event": "done", 2023-08-01T19:56:11.431 INFO:teuthology.orchestra.run.smithi155.stdout: "time": "2023-08-01T19:55:05.222900+0000", 2023-08-01T19:56:11.431 INFO:teuthology.orchestra.run.smithi155.stdout: "duration": 3.8634999999999999e-05 2023-08-01T19:56:11.431 INFO:teuthology.orchestra.run.smithi155.stdout: } 2023-08-01T19:56:11.431 INFO:teuthology.orchestra.run.smithi155.stdout: ] 2023-08-01T19:56:11.431 INFO:teuthology.orchestra.run.smithi155.stdout: } 2023-08-01T19:56:11.431 INFO:teuthology.orchestra.run.smithi155.stdout: }, 2023-08-01T19:56:11.432 INFO:teuthology.orchestra.run.smithi155.stdout: { 2023-08-01T19:56:11.432 INFO:teuthology.orchestra.run.smithi155.stdout: "description": "osd_op(client.4668.0:100251 5.b 5:d853df24:::benchmark_data_smithi006_114134_object100250:head [set-alloc-hint object_size 65536 write_size 65536,write 0~65536] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e37)", 2023-08-01T19:56:11.432 INFO:teuthology.orchestra.run.smithi155.stdout: "initiated_at": "2023-08-01T19:55:05.153737+0000", 2023-08-01T19:56:11.432 INFO:teuthology.orchestra.run.smithi155.stdout: "age": 66.208333656999997, 2023-08-01T19:56:11.432 INFO:teuthology.orchestra.run.smithi155.stdout: "duration": 0.071366545000000003, 2023-08-01T19:56:11.432 INFO:teuthology.orchestra.run.smithi155.stdout: "type_data": { 2023-08-01T19:56:11.432 INFO:teuthology.orchestra.run.smithi155.stdout: "flag_point": "commit sent; apply or cleanup", 2023-08-01T19:56:11.432 INFO:teuthology.orchestra.run.smithi155.stdout: "client_info": { 2023-08-01T19:56:11.433 INFO:teuthology.orchestra.run.smithi155.stdout: "client": "client.4668", 2023-08-01T19:56:11.433 INFO:teuthology.orchestra.run.smithi155.stdout: "client_addr": "172.21.15.6:0/1709472247", 2023-08-01T19:56:11.433 INFO:teuthology.orchestra.run.smithi155.stdout: "tid": 100251 2023-08-01T19:56:11.433 INFO:teuthology.orchestra.run.smithi155.stdout: }, 2023-08-01T19:56:11.433 INFO:teuthology.orchestra.run.smithi155.stdout: "events": [ 2023-08-01T19:56:11.433 INFO:teuthology.orchestra.run.smithi155.stdout: { 2023-08-01T19:56:11.433 INFO:teuthology.orchestra.run.smithi155.stdout: "event": "initiated", 2023-08-01T19:56:11.434 INFO:teuthology.orchestra.run.smithi155.stdout: "time": "2023-08-01T19:55:05.153737+0000", 2023-08-01T19:56:11.434 INFO:teuthology.orchestra.run.smithi155.stdout: "duration": 0 2023-08-01T19:56:11.434 INFO:teuthology.orchestra.run.smithi155.stdout: }, 2023-08-01T19:56:11.434 INFO:teuthology.orchestra.run.smithi155.stdout: { 2023-08-01T19:56:11.434 INFO:teuthology.orchestra.run.smithi155.stdout: "event": "throttled", 2023-08-01T19:56:11.434 INFO:teuthology.orchestra.run.smithi155.stdout: "time": "2023-08-01T19:55:05.153737+0000", 2023-08-01T19:56:11.434 INFO:teuthology.orchestra.run.smithi155.stdout: "duration": 0 2023-08-01T19:56:11.434 INFO:teuthology.orchestra.run.smithi155.stdout: }, 2023-08-01T19:56:11.435 INFO:teuthology.orchestra.run.smithi155.stdout: { 2023-08-01T19:56:11.435 INFO:teuthology.orchestra.run.smithi155.stdout: "event": "header_read", 2023-08-01T19:56:11.435 INFO:teuthology.orchestra.run.smithi155.stdout: "time": "2023-08-01T19:55:05.153736+0000", 2023-08-01T19:56:11.435 INFO:teuthology.orchestra.run.smithi155.stdout: "duration": 4294967295.9999995 2023-08-01T19:56:11.435 INFO:teuthology.orchestra.run.smithi155.stdout: }, 2023-08-01T19:56:11.435 INFO:teuthology.orchestra.run.smithi155.stdout: { 2023-08-01T19:56:11.435 INFO:teuthology.orchestra.run.smithi155.stdout: "event": "all_read", 2023-08-01T19:56:11.435 INFO:teuthology.orchestra.run.smithi155.stdout: "time": "2023-08-01T19:55:05.153784+0000", 2023-08-01T19:56:11.436 INFO:teuthology.orchestra.run.smithi155.stdout: "duration": 4.7660000000000001e-05 2023-08-01T19:56:11.436 INFO:teuthology.orchestra.run.smithi155.stdout: }, 2023-08-01T19:56:11.436 INFO:teuthology.orchestra.run.smithi155.stdout: { 2023-08-01T19:56:11.436 INFO:teuthology.orchestra.run.smithi155.stdout: "event": "dispatched", 2023-08-01T19:56:11.436 INFO:teuthology.orchestra.run.smithi155.stdout: "time": "2023-08-01T19:55:05.153793+0000", 2023-08-01T19:56:11.436 INFO:teuthology.orchestra.run.smithi155.stdout: "duration": 8.7150000000000004e-06 2023-08-01T19:56:11.436 INFO:teuthology.orchestra.run.smithi155.stdout: }, 2023-08-01T19:56:11.436 INFO:teuthology.orchestra.run.smithi155.stdout: { 2023-08-01T19:56:11.437 INFO:teuthology.orchestra.run.smithi155.stdout: "event": "queued_for_pg", 2023-08-01T19:56:11.437 INFO:teuthology.orchestra.run.smithi155.stdout: "time": "2023-08-01T19:55:05.153800+0000", 2023-08-01T19:56:11.437 INFO:teuthology.orchestra.run.smithi155.stdout: "duration": 7.2459999999999997e-06 2023-08-01T19:56:11.437 INFO:teuthology.orchestra.run.smithi155.stdout: }, 2023-08-01T19:56:11.437 INFO:teuthology.orchestra.run.smithi155.stdout: { 2023-08-01T19:56:11.437 INFO:teuthology.orchestra.run.smithi155.stdout: "event": "reached_pg", 2023-08-01T19:56:11.437 INFO:teuthology.orchestra.run.smithi155.stdout: "time": "2023-08-01T19:55:05.156241+0000", 2023-08-01T19:56:11.438 INFO:teuthology.orchestra.run.smithi155.stdout: "duration": 0.0024415359999999998 2023-08-01T19:56:11.438 INFO:teuthology.orchestra.run.smithi155.stdout: }, 2023-08-01T19:56:11.438 INFO:teuthology.orchestra.run.smithi155.stdout: { 2023-08-01T19:56:11.438 INFO:teuthology.orchestra.run.smithi155.stdout: "event": "started", 2023-08-01T19:56:11.438 INFO:teuthology.orchestra.run.smithi155.stdout: "time": "2023-08-01T19:55:05.219045+0000", 2023-08-01T19:56:11.438 INFO:teuthology.orchestra.run.smithi155.stdout: "duration": 0.062803855000000006 2023-08-01T19:56:11.438 INFO:teuthology.orchestra.run.smithi155.stdout: }, 2023-08-01T19:56:11.438 INFO:teuthology.orchestra.run.smithi155.stdout: { 2023-08-01T19:56:11.439 INFO:teuthology.orchestra.run.smithi155.stdout: "event": "waiting for subops from 0", 2023-08-01T19:56:11.439 INFO:teuthology.orchestra.run.smithi155.stdout: "time": "2023-08-01T19:55:05.219238+0000", 2023-08-01T19:56:11.439 INFO:teuthology.orchestra.run.smithi155.stdout: "duration": 0.00019241500000000001 2023-08-01T19:56:11.439 INFO:teuthology.orchestra.run.smithi155.stdout: }, 2023-08-01T19:56:11.439 INFO:teuthology.orchestra.run.smithi155.stdout: { 2023-08-01T19:56:11.439 INFO:teuthology.orchestra.run.smithi155.stdout: "event": "sub_op_commit_rec", 2023-08-01T19:56:11.439 INFO:teuthology.orchestra.run.smithi155.stdout: "time": "2023-08-01T19:55:05.223300+0000", 2023-08-01T19:56:11.439 INFO:teuthology.orchestra.run.smithi155.stdout: "duration": 0.0040626509999999996 2023-08-01T19:56:11.440 INFO:teuthology.orchestra.run.smithi155.stdout: }, 2023-08-01T19:56:11.440 INFO:teuthology.orchestra.run.smithi155.stdout: { 2023-08-01T19:56:11.440 INFO:teuthology.orchestra.run.smithi155.stdout: "event": "op_commit", 2023-08-01T19:56:11.440 INFO:teuthology.orchestra.run.smithi155.stdout: "time": "2023-08-01T19:55:05.225020+0000", 2023-08-01T19:56:11.440 INFO:teuthology.orchestra.run.smithi155.stdout: "duration": 0.0017201 2023-08-01T19:56:11.440 INFO:teuthology.orchestra.run.smithi155.stdout: }, 2023-08-01T19:56:11.440 INFO:teuthology.orchestra.run.smithi155.stdout: { 2023-08-01T19:56:11.441 INFO:teuthology.orchestra.run.smithi155.stdout: "event": "commit_sent", 2023-08-01T19:56:11.441 INFO:teuthology.orchestra.run.smithi155.stdout: "time": "2023-08-01T19:55:05.225066+0000", 2023-08-01T19:56:11.441 INFO:teuthology.orchestra.run.smithi155.stdout: "duration": 4.6143000000000002e-05 2023-08-01T19:56:11.441 INFO:teuthology.orchestra.run.smithi155.stdout: }, 2023-08-01T19:56:11.441 INFO:teuthology.orchestra.run.smithi155.stdout: { 2023-08-01T19:56:11.441 INFO:teuthology.orchestra.run.smithi155.stdout: "event": "done", 2023-08-01T19:56:11.441 INFO:teuthology.orchestra.run.smithi155.stdout: "time": "2023-08-01T19:55:05.225103+0000", 2023-08-01T19:56:11.441 INFO:teuthology.orchestra.run.smithi155.stdout: "duration": 3.6789999999999998e-05 2023-08-01T19:56:11.442 INFO:teuthology.orchestra.run.smithi155.stdout: } 2023-08-01T19:56:11.442 INFO:teuthology.orchestra.run.smithi155.stdout: ] 2023-08-01T19:56:11.442 INFO:teuthology.orchestra.run.smithi155.stdout: } 2023-08-01T19:56:11.442 INFO:teuthology.orchestra.run.smithi155.stdout: }, 2023-08-01T19:56:11.442 INFO:teuthology.orchestra.run.smithi155.stdout: { 2023-08-01T19:56:11.442 INFO:teuthology.orchestra.run.smithi155.stdout: "description": "osd_op(client.4668.0:100252 5.0 5:01f90c3c:::benchmark_data_smithi006_114134_object100251:head [set-alloc-hint object_size 65536 write_size 65536,write 0~65536] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e37)", 2023-08-01T19:56:11.442 INFO:teuthology.orchestra.run.smithi155.stdout: "initiated_at": "2023-08-01T19:55:05.154048+0000", 2023-08-01T19:56:11.443 INFO:teuthology.orchestra.run.smithi155.stdout: "age": 66.208022409999998, 2023-08-01T19:56:11.443 INFO:teuthology.orchestra.run.smithi155.stdout: "duration": 0.070156683999999997, 2023-08-01T19:56:11.443 INFO:teuthology.orchestra.run.smithi155.stdout: "type_data": { 2023-08-01T19:56:11.443 INFO:teuthology.orchestra.run.smithi155.stdout: "flag_point": "commit sent; apply or cleanup", 2023-08-01T19:56:11.443 INFO:teuthology.orchestra.run.smithi155.stdout: "client_info": { 2023-08-01T19:56:11.443 INFO:teuthology.orchestra.run.smithi155.stdout: "client": "client.4668", 2023-08-01T19:56:11.443 INFO:teuthology.orchestra.run.smithi155.stdout: "client_addr": "172.21.15.6:0/1709472247", 2023-08-01T19:56:11.443 INFO:teuthology.orchestra.run.smithi155.stdout: "tid": 100252 2023-08-01T19:56:11.444 INFO:teuthology.orchestra.run.smithi155.stdout: }, 2023-08-01T19:56:11.444 INFO:teuthology.orchestra.run.smithi155.stdout: "events": [ 2023-08-01T19:56:11.444 INFO:teuthology.orchestra.run.smithi155.stdout: { 2023-08-01T19:56:11.444 INFO:teuthology.orchestra.run.smithi155.stdout: "event": "initiated", 2023-08-01T19:56:11.444 INFO:teuthology.orchestra.run.smithi155.stdout: "time": "2023-08-01T19:55:05.154048+0000", 2023-08-01T19:56:11.444 INFO:teuthology.orchestra.run.smithi155.stdout: "duration": 0 2023-08-01T19:56:11.444 INFO:teuthology.orchestra.run.smithi155.stdout: }, 2023-08-01T19:56:11.445 INFO:teuthology.orchestra.run.smithi155.stdout: { 2023-08-01T19:56:11.445 INFO:teuthology.orchestra.run.smithi155.stdout: "event": "throttled", 2023-08-01T19:56:11.445 INFO:teuthology.orchestra.run.smithi155.stdout: "time": "2023-08-01T19:55:05.154048+0000", 2023-08-01T19:56:11.445 INFO:teuthology.orchestra.run.smithi155.stdout: "duration": 0 2023-08-01T19:56:11.445 INFO:teuthology.orchestra.run.smithi155.stdout: }, 2023-08-01T19:56:11.445 INFO:teuthology.orchestra.run.smithi155.stdout: { 2023-08-01T19:56:11.445 INFO:teuthology.orchestra.run.smithi155.stdout: "event": "header_read", 2023-08-01T19:56:11.445 INFO:teuthology.orchestra.run.smithi155.stdout: "time": "2023-08-01T19:55:05.154047+0000", 2023-08-01T19:56:11.446 INFO:teuthology.orchestra.run.smithi155.stdout: "duration": 4294967295.999999 2023-08-01T19:56:11.446 INFO:teuthology.orchestra.run.smithi155.stdout: }, 2023-08-01T19:56:11.446 INFO:teuthology.orchestra.run.smithi155.stdout: { 2023-08-01T19:56:11.446 INFO:teuthology.orchestra.run.smithi155.stdout: "event": "all_read", 2023-08-01T19:56:11.446 INFO:teuthology.orchestra.run.smithi155.stdout: "time": "2023-08-01T19:55:05.154115+0000", 2023-08-01T19:56:11.446 INFO:teuthology.orchestra.run.smithi155.stdout: "duration": 6.7545999999999993e-05 2023-08-01T19:56:11.446 INFO:teuthology.orchestra.run.smithi155.stdout: }, 2023-08-01T19:56:11.446 INFO:teuthology.orchestra.run.smithi155.stdout: { 2023-08-01T19:56:11.447 INFO:teuthology.orchestra.run.smithi155.stdout: "event": "dispatched", 2023-08-01T19:56:11.447 INFO:teuthology.orchestra.run.smithi155.stdout: "time": "2023-08-01T19:55:05.154125+0000", 2023-08-01T19:56:11.447 INFO:teuthology.orchestra.run.smithi155.stdout: "duration": 1.0669000000000001e-05 2023-08-01T19:56:11.447 INFO:teuthology.orchestra.run.smithi155.stdout: }, 2023-08-01T19:56:11.447 INFO:teuthology.orchestra.run.smithi155.stdout: { 2023-08-01T19:56:11.447 INFO:teuthology.orchestra.run.smithi155.stdout: "event": "queued_for_pg", 2023-08-01T19:56:11.447 INFO:teuthology.orchestra.run.smithi155.stdout: "time": "2023-08-01T19:55:05.154131+0000", 2023-08-01T19:56:11.447 INFO:teuthology.orchestra.run.smithi155.stdout: "duration": 6.0349999999999998e-06 2023-08-01T19:56:11.448 INFO:teuthology.orchestra.run.smithi155.stdout: }, 2023-08-01T19:56:11.448 INFO:teuthology.orchestra.run.smithi155.stdout: { 2023-08-01T19:56:11.448 INFO:teuthology.orchestra.run.smithi155.stdout: "event": "reached_pg", 2023-08-01T19:56:11.448 INFO:teuthology.orchestra.run.smithi155.stdout: "time": "2023-08-01T19:55:05.154174+0000", 2023-08-01T19:56:11.448 INFO:teuthology.orchestra.run.smithi155.stdout: "duration": 4.2429000000000003e-05 2023-08-01T19:56:11.448 INFO:teuthology.orchestra.run.smithi155.stdout: }, 2023-08-01T19:56:11.448 INFO:teuthology.orchestra.run.smithi155.stdout: { 2023-08-01T19:56:11.449 INFO:teuthology.orchestra.run.smithi155.stdout: "event": "started", 2023-08-01T19:56:11.449 INFO:teuthology.orchestra.run.smithi155.stdout: "time": "2023-08-01T19:55:05.154287+0000", 2023-08-01T19:56:11.449 INFO:teuthology.orchestra.run.smithi155.stdout: "duration": 0.000113138 2023-08-01T19:56:11.449 INFO:teuthology.orchestra.run.smithi155.stdout: }, 2023-08-01T19:56:11.449 INFO:teuthology.orchestra.run.smithi155.stdout: { 2023-08-01T19:56:11.449 INFO:teuthology.orchestra.run.smithi155.stdout: "event": "waiting for subops from 0", 2023-08-01T19:56:11.449 INFO:teuthology.orchestra.run.smithi155.stdout: "time": "2023-08-01T19:55:05.154420+0000", 2023-08-01T19:56:11.449 INFO:teuthology.orchestra.run.smithi155.stdout: "duration": 0.000133292 2023-08-01T19:56:11.450 INFO:teuthology.orchestra.run.smithi155.stdout: }, 2023-08-01T19:56:11.450 INFO:teuthology.orchestra.run.smithi155.stdout: { 2023-08-01T19:56:11.450 INFO:teuthology.orchestra.run.smithi155.stdout: "event": "sub_op_commit_rec", 2023-08-01T19:56:11.450 INFO:teuthology.orchestra.run.smithi155.stdout: "time": "2023-08-01T19:55:05.219034+0000", 2023-08-01T19:56:11.450 INFO:teuthology.orchestra.run.smithi155.stdout: "duration": 0.064613429999999999 2023-08-01T19:56:11.450 INFO:teuthology.orchestra.run.smithi155.stdout: }, 2023-08-01T19:56:11.450 INFO:teuthology.orchestra.run.smithi155.stdout: { 2023-08-01T19:56:11.450 INFO:teuthology.orchestra.run.smithi155.stdout: "event": "op_commit", 2023-08-01T19:56:11.451 INFO:teuthology.orchestra.run.smithi155.stdout: "time": "2023-08-01T19:55:05.224138+0000", 2023-08-01T19:56:11.451 INFO:teuthology.orchestra.run.smithi155.stdout: "duration": 0.0051041999999999997 2023-08-01T19:56:11.451 INFO:teuthology.orchestra.run.smithi155.stdout: }, 2023-08-01T19:56:11.451 INFO:teuthology.orchestra.run.smithi155.stdout: { 2023-08-01T19:56:11.451 INFO:teuthology.orchestra.run.smithi155.stdout: "event": "commit_sent", 2023-08-01T19:56:11.451 INFO:teuthology.orchestra.run.smithi155.stdout: "time": "2023-08-01T19:55:05.224171+0000", 2023-08-01T19:56:11.451 INFO:teuthology.orchestra.run.smithi155.stdout: "duration": 3.3345e-05 2023-08-01T19:56:11.452 INFO:teuthology.orchestra.run.smithi155.stdout: }, 2023-08-01T19:56:11.452 INFO:teuthology.orchestra.run.smithi155.stdout: { 2023-08-01T19:56:11.452 INFO:teuthology.orchestra.run.smithi155.stdout: "event": "done", 2023-08-01T19:56:11.452 INFO:teuthology.orchestra.run.smithi155.stdout: "time": "2023-08-01T19:55:05.224205+0000", 2023-08-01T19:56:11.452 INFO:teuthology.orchestra.run.smithi155.stdout: "duration": 3.3525999999999997e-05 2023-08-01T19:56:11.452 INFO:teuthology.orchestra.run.smithi155.stdout: } 2023-08-01T19:56:11.452 INFO:teuthology.orchestra.run.smithi155.stdout: ] 2023-08-01T19:56:11.452 INFO:teuthology.orchestra.run.smithi155.stdout: } 2023-08-01T19:56:11.453 INFO:teuthology.orchestra.run.smithi155.stdout: }, 2023-08-01T19:56:11.453 INFO:teuthology.orchestra.run.smithi155.stdout: { 2023-08-01T19:56:11.453 INFO:teuthology.orchestra.run.smithi155.stdout: "description": "osd_repop_reply(client.4668.0:100237 5.4 e37/19 ondisk, result = 0)", 2023-08-01T19:56:11.453 INFO:teuthology.orchestra.run.smithi155.stdout: "initiated_at": "2023-08-01T19:55:05.156249+0000", 2023-08-01T19:56:11.453 INFO:teuthology.orchestra.run.smithi155.stdout: "age": 66.205821465, 2023-08-01T19:56:11.453 INFO:teuthology.orchestra.run.smithi155.stdout: "duration": 0.062792549000000003, 2023-08-01T19:56:11.453 INFO:teuthology.orchestra.run.smithi155.stdout: "type_data": { 2023-08-01T19:56:11.453 INFO:teuthology.orchestra.run.smithi155.stdout: "flag_point": "started", 2023-08-01T19:56:11.454 INFO:teuthology.orchestra.run.smithi155.stdout: "events": [ 2023-08-01T19:56:11.454 INFO:teuthology.orchestra.run.smithi155.stdout: { 2023-08-01T19:56:11.454 INFO:teuthology.orchestra.run.smithi155.stdout: "event": "initiated", 2023-08-01T19:56:11.454 INFO:teuthology.orchestra.run.smithi155.stdout: "time": "2023-08-01T19:55:05.156249+0000", 2023-08-01T19:56:11.454 INFO:teuthology.orchestra.run.smithi155.stdout: "duration": 0 2023-08-01T19:56:11.454 INFO:teuthology.orchestra.run.smithi155.stdout: }, 2023-08-01T19:56:11.454 INFO:teuthology.orchestra.run.smithi155.stdout: { 2023-08-01T19:56:11.455 INFO:teuthology.orchestra.run.smithi155.stdout: "event": "throttled", 2023-08-01T19:56:11.455 INFO:teuthology.orchestra.run.smithi155.stdout: "time": "2023-08-01T19:55:05.156249+0000", 2023-08-01T19:56:11.455 INFO:teuthology.orchestra.run.smithi155.stdout: "duration": 0 2023-08-01T19:56:11.455 INFO:teuthology.orchestra.run.smithi155.stdout: }, 2023-08-01T19:56:11.455 INFO:teuthology.orchestra.run.smithi155.stdout: { 2023-08-01T19:56:11.455 INFO:teuthology.orchestra.run.smithi155.stdout: "event": "header_read", 2023-08-01T19:56:11.455 INFO:teuthology.orchestra.run.smithi155.stdout: "time": "2023-08-01T19:55:05.156248+0000", 2023-08-01T19:56:11.455 INFO:teuthology.orchestra.run.smithi155.stdout: "duration": 4294967295.9999995 2023-08-01T19:56:11.456 INFO:teuthology.orchestra.run.smithi155.stdout: }, 2023-08-01T19:56:11.456 INFO:teuthology.orchestra.run.smithi155.stdout: { 2023-08-01T19:56:11.456 INFO:teuthology.orchestra.run.smithi155.stdout: "event": "all_read", 2023-08-01T19:56:11.456 INFO:teuthology.orchestra.run.smithi155.stdout: "time": "2023-08-01T19:55:05.156252+0000", 2023-08-01T19:56:11.456 INFO:teuthology.orchestra.run.smithi155.stdout: "duration": 3.9999999999999998e-06 2023-08-01T19:56:11.456 INFO:teuthology.orchestra.run.smithi155.stdout: }, 2023-08-01T19:56:11.456 INFO:teuthology.orchestra.run.smithi155.stdout: { 2023-08-01T19:56:11.457 INFO:teuthology.orchestra.run.smithi155.stdout: "event": "dispatched", 2023-08-01T19:56:11.457 INFO:teuthology.orchestra.run.smithi155.stdout: "time": "2023-08-01T19:55:05.218844+0000", 2023-08-01T19:56:11.457 INFO:teuthology.orchestra.run.smithi155.stdout: "duration": 0.062591516999999999 2023-08-01T19:56:11.457 INFO:teuthology.orchestra.run.smithi155.stdout: }, 2023-08-01T19:56:11.457 INFO:teuthology.orchestra.run.smithi155.stdout: { 2023-08-01T19:56:11.457 INFO:teuthology.orchestra.run.smithi155.stdout: "event": "queued_for_pg", 2023-08-01T19:56:11.457 INFO:teuthology.orchestra.run.smithi155.stdout: "time": "2023-08-01T19:55:05.218862+0000", 2023-08-01T19:56:11.457 INFO:teuthology.orchestra.run.smithi155.stdout: "duration": 1.7666e-05 2023-08-01T19:56:11.458 INFO:teuthology.orchestra.run.smithi155.stdout: }, 2023-08-01T19:56:11.458 INFO:teuthology.orchestra.run.smithi155.stdout: { 2023-08-01T19:56:11.458 INFO:teuthology.orchestra.run.smithi155.stdout: "event": "reached_pg", 2023-08-01T19:56:11.458 INFO:teuthology.orchestra.run.smithi155.stdout: "time": "2023-08-01T19:55:05.218914+0000", 2023-08-01T19:56:11.458 INFO:teuthology.orchestra.run.smithi155.stdout: "duration": 5.2565999999999998e-05 2023-08-01T19:56:11.458 INFO:teuthology.orchestra.run.smithi155.stdout: }, 2023-08-01T19:56:11.458 INFO:teuthology.orchestra.run.smithi155.stdout: { 2023-08-01T19:56:11.459 INFO:teuthology.orchestra.run.smithi155.stdout: "event": "started", 2023-08-01T19:56:11.459 INFO:teuthology.orchestra.run.smithi155.stdout: "time": "2023-08-01T19:55:05.218925+0000", 2023-08-01T19:56:11.459 INFO:teuthology.orchestra.run.smithi155.stdout: "duration": 1.1375e-05 2023-08-01T19:56:11.459 INFO:teuthology.orchestra.run.smithi155.stdout: }, 2023-08-01T19:56:11.459 INFO:teuthology.orchestra.run.smithi155.stdout: { 2023-08-01T19:56:11.459 INFO:teuthology.orchestra.run.smithi155.stdout: "event": "done", 2023-08-01T19:56:11.459 INFO:teuthology.orchestra.run.smithi155.stdout: "time": "2023-08-01T19:55:05.219041+0000", 2023-08-01T19:56:11.459 INFO:teuthology.orchestra.run.smithi155.stdout: "duration": 0.000115977 2023-08-01T19:56:11.460 INFO:teuthology.orchestra.run.smithi155.stdout: } 2023-08-01T19:56:11.460 INFO:teuthology.orchestra.run.smithi155.stdout: ] 2023-08-01T19:56:11.460 INFO:teuthology.orchestra.run.smithi155.stdout: } 2023-08-01T19:56:11.460 INFO:teuthology.orchestra.run.smithi155.stdout: }, 2023-08-01T19:56:11.460 INFO:teuthology.orchestra.run.smithi155.stdout: { 2023-08-01T19:56:11.460 INFO:teuthology.orchestra.run.smithi155.stdout: "description": "osd_repop(client.4668.0:100253 5.f e37/19 5:f7bbce05:::benchmark_data_smithi006_114134_object100252:head v 37'6323, mlcod=37'6321)", 2023-08-01T19:56:11.460 INFO:teuthology.orchestra.run.smithi155.stdout: "initiated_at": "2023-08-01T19:55:05.156952+0000", 2023-08-01T19:56:11.460 INFO:teuthology.orchestra.run.smithi155.stdout: "age": 66.205118401999997, 2023-08-01T19:56:11.461 INFO:teuthology.orchestra.run.smithi155.stdout: "duration": 0.068018577999999996, 2023-08-01T19:56:11.461 INFO:teuthology.orchestra.run.smithi155.stdout: "type_data": { 2023-08-01T19:56:11.461 INFO:teuthology.orchestra.run.smithi155.stdout: "flag_point": "commit sent; apply or cleanup", 2023-08-01T19:56:11.461 INFO:teuthology.orchestra.run.smithi155.stdout: "events": [ 2023-08-01T19:56:11.461 INFO:teuthology.orchestra.run.smithi155.stdout: { 2023-08-01T19:56:11.461 INFO:teuthology.orchestra.run.smithi155.stdout: "event": "initiated", 2023-08-01T19:56:11.461 INFO:teuthology.orchestra.run.smithi155.stdout: "time": "2023-08-01T19:55:05.156952+0000", 2023-08-01T19:56:11.461 INFO:teuthology.orchestra.run.smithi155.stdout: "duration": 0 2023-08-01T19:56:11.462 INFO:teuthology.orchestra.run.smithi155.stdout: }, 2023-08-01T19:56:11.462 INFO:teuthology.orchestra.run.smithi155.stdout: { 2023-08-01T19:56:11.462 INFO:teuthology.orchestra.run.smithi155.stdout: "event": "throttled", 2023-08-01T19:56:11.462 INFO:teuthology.orchestra.run.smithi155.stdout: "time": "2023-08-01T19:55:05.156952+0000", 2023-08-01T19:56:11.462 INFO:teuthology.orchestra.run.smithi155.stdout: "duration": 0 2023-08-01T19:56:11.462 INFO:teuthology.orchestra.run.smithi155.stdout: }, 2023-08-01T19:56:11.462 INFO:teuthology.orchestra.run.smithi155.stdout: { 2023-08-01T19:56:11.462 INFO:teuthology.orchestra.run.smithi155.stdout: "event": "header_read", 2023-08-01T19:56:11.463 INFO:teuthology.orchestra.run.smithi155.stdout: "time": "2023-08-01T19:55:05.156951+0000", 2023-08-01T19:56:11.463 INFO:teuthology.orchestra.run.smithi155.stdout: "duration": 4294967295.999999 2023-08-01T19:56:11.463 INFO:teuthology.orchestra.run.smithi155.stdout: }, 2023-08-01T19:56:11.463 INFO:teuthology.orchestra.run.smithi155.stdout: { 2023-08-01T19:56:11.463 INFO:teuthology.orchestra.run.smithi155.stdout: "event": "all_read", 2023-08-01T19:56:11.463 INFO:teuthology.orchestra.run.smithi155.stdout: "time": "2023-08-01T19:55:05.156989+0000", 2023-08-01T19:56:11.463 INFO:teuthology.orchestra.run.smithi155.stdout: "duration": 3.8175e-05 2023-08-01T19:56:11.464 INFO:teuthology.orchestra.run.smithi155.stdout: }, 2023-08-01T19:56:11.464 INFO:teuthology.orchestra.run.smithi155.stdout: { 2023-08-01T19:56:11.464 INFO:teuthology.orchestra.run.smithi155.stdout: "event": "dispatched", 2023-08-01T19:56:11.464 INFO:teuthology.orchestra.run.smithi155.stdout: "time": "2023-08-01T19:55:05.218842+0000", 2023-08-01T19:56:11.464 INFO:teuthology.orchestra.run.smithi155.stdout: "duration": 0.061852299999999999 2023-08-01T19:56:11.464 INFO:teuthology.orchestra.run.smithi155.stdout: }, 2023-08-01T19:56:11.464 INFO:teuthology.orchestra.run.smithi155.stdout: { 2023-08-01T19:56:11.464 INFO:teuthology.orchestra.run.smithi155.stdout: "event": "queued_for_pg", 2023-08-01T19:56:11.465 INFO:teuthology.orchestra.run.smithi155.stdout: "time": "2023-08-01T19:55:05.218862+0000", 2023-08-01T19:56:11.465 INFO:teuthology.orchestra.run.smithi155.stdout: "duration": 1.9854999999999999e-05 2023-08-01T19:56:11.465 INFO:teuthology.orchestra.run.smithi155.stdout: }, 2023-08-01T19:56:11.465 INFO:teuthology.orchestra.run.smithi155.stdout: { 2023-08-01T19:56:11.465 INFO:teuthology.orchestra.run.smithi155.stdout: "event": "reached_pg", 2023-08-01T19:56:11.465 INFO:teuthology.orchestra.run.smithi155.stdout: "time": "2023-08-01T19:55:05.218918+0000", 2023-08-01T19:56:11.465 INFO:teuthology.orchestra.run.smithi155.stdout: "duration": 5.6570000000000002e-05 2023-08-01T19:56:11.465 INFO:teuthology.orchestra.run.smithi155.stdout: }, 2023-08-01T19:56:11.466 INFO:teuthology.orchestra.run.smithi155.stdout: { 2023-08-01T19:56:11.466 INFO:teuthology.orchestra.run.smithi155.stdout: "event": "started", 2023-08-01T19:56:11.466 INFO:teuthology.orchestra.run.smithi155.stdout: "time": "2023-08-01T19:55:05.218940+0000", 2023-08-01T19:56:11.466 INFO:teuthology.orchestra.run.smithi155.stdout: "duration": 2.1804e-05 2023-08-01T19:56:11.466 INFO:teuthology.orchestra.run.smithi155.stdout: }, 2023-08-01T19:56:11.466 INFO:teuthology.orchestra.run.smithi155.stdout: { 2023-08-01T19:56:11.466 INFO:teuthology.orchestra.run.smithi155.stdout: "event": "commit_sent", 2023-08-01T19:56:11.467 INFO:teuthology.orchestra.run.smithi155.stdout: "time": "2023-08-01T19:55:05.224928+0000", 2023-08-01T19:56:11.467 INFO:teuthology.orchestra.run.smithi155.stdout: "duration": 0.0059876759999999999 2023-08-01T19:56:11.467 INFO:teuthology.orchestra.run.smithi155.stdout: }, 2023-08-01T19:56:11.467 INFO:teuthology.orchestra.run.smithi155.stdout: { 2023-08-01T19:56:11.467 INFO:teuthology.orchestra.run.smithi155.stdout: "event": "done", 2023-08-01T19:56:11.467 INFO:teuthology.orchestra.run.smithi155.stdout: "time": "2023-08-01T19:55:05.224971+0000", 2023-08-01T19:56:11.467 INFO:teuthology.orchestra.run.smithi155.stdout: "duration": 4.2929999999999997e-05 2023-08-01T19:56:11.467 INFO:teuthology.orchestra.run.smithi155.stdout: } 2023-08-01T19:56:11.468 INFO:teuthology.orchestra.run.smithi155.stdout: ] 2023-08-01T19:56:11.468 INFO:teuthology.orchestra.run.smithi155.stdout: } 2023-08-01T19:56:11.468 INFO:teuthology.orchestra.run.smithi155.stdout: }, 2023-08-01T19:56:11.468 INFO:teuthology.orchestra.run.smithi155.stdout: { 2023-08-01T19:56:11.468 INFO:teuthology.orchestra.run.smithi155.stdout: "description": "osd_op(client.4668.0:100927 5.0 5:00608ec6:::benchmark_data_smithi006_114134_object100926:head [set-alloc-hint object_size 65536 write_size 65536,write 0~65536] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e37)", 2023-08-01T19:56:11.468 INFO:teuthology.orchestra.run.smithi155.stdout: "initiated_at": "2023-08-01T19:55:05.561169+0000", 2023-08-01T19:56:11.468 INFO:teuthology.orchestra.run.smithi155.stdout: "age": 65.800901499000005, 2023-08-01T19:56:11.469 INFO:teuthology.orchestra.run.smithi155.stdout: "duration": 0.066411687999999997, 2023-08-01T19:56:11.469 INFO:teuthology.orchestra.run.smithi155.stdout: "type_data": { 2023-08-01T19:56:11.469 INFO:teuthology.orchestra.run.smithi155.stdout: "flag_point": "commit sent; apply or cleanup", 2023-08-01T19:56:11.469 INFO:teuthology.orchestra.run.smithi155.stdout: "client_info": { 2023-08-01T19:56:11.469 INFO:teuthology.orchestra.run.smithi155.stdout: "client": "client.4668", 2023-08-01T19:56:11.469 INFO:teuthology.orchestra.run.smithi155.stdout: "client_addr": "172.21.15.6:0/1709472247", 2023-08-01T19:56:11.469 INFO:teuthology.orchestra.run.smithi155.stdout: "tid": 100927 2023-08-01T19:56:11.469 INFO:teuthology.orchestra.run.smithi155.stdout: }, 2023-08-01T19:56:11.470 INFO:teuthology.orchestra.run.smithi155.stdout: "events": [ 2023-08-01T19:56:11.470 INFO:teuthology.orchestra.run.smithi155.stdout: { 2023-08-01T19:56:11.470 INFO:teuthology.orchestra.run.smithi155.stdout: "event": "initiated", 2023-08-01T19:56:11.470 INFO:teuthology.orchestra.run.smithi155.stdout: "time": "2023-08-01T19:55:05.561169+0000", 2023-08-01T19:56:11.470 INFO:teuthology.orchestra.run.smithi155.stdout: "duration": 0 2023-08-01T19:56:11.470 INFO:teuthology.orchestra.run.smithi155.stdout: }, 2023-08-01T19:56:11.470 INFO:teuthology.orchestra.run.smithi155.stdout: { 2023-08-01T19:56:11.470 INFO:teuthology.orchestra.run.smithi155.stdout: "event": "throttled", 2023-08-01T19:56:11.471 INFO:teuthology.orchestra.run.smithi155.stdout: "time": "2023-08-01T19:55:05.561169+0000", 2023-08-01T19:56:11.471 INFO:teuthology.orchestra.run.smithi155.stdout: "duration": 0 2023-08-01T19:56:11.471 INFO:teuthology.orchestra.run.smithi155.stdout: }, 2023-08-01T19:56:11.471 INFO:teuthology.orchestra.run.smithi155.stdout: { 2023-08-01T19:56:11.471 INFO:teuthology.orchestra.run.smithi155.stdout: "event": "header_read", 2023-08-01T19:56:11.471 INFO:teuthology.orchestra.run.smithi155.stdout: "time": "2023-08-01T19:55:05.561168+0000", 2023-08-01T19:56:11.471 INFO:teuthology.orchestra.run.smithi155.stdout: "duration": 4294967295.9999995 2023-08-01T19:56:11.472 INFO:teuthology.orchestra.run.smithi155.stdout: }, 2023-08-01T19:56:11.472 INFO:teuthology.orchestra.run.smithi155.stdout: { 2023-08-01T19:56:11.472 INFO:teuthology.orchestra.run.smithi155.stdout: "event": "all_read", 2023-08-01T19:56:11.472 INFO:teuthology.orchestra.run.smithi155.stdout: "time": "2023-08-01T19:55:05.561218+0000", 2023-08-01T19:56:11.472 INFO:teuthology.orchestra.run.smithi155.stdout: "duration": 4.9379999999999998e-05 2023-08-01T19:56:11.472 INFO:teuthology.orchestra.run.smithi155.stdout: }, 2023-08-01T19:56:11.472 INFO:teuthology.orchestra.run.smithi155.stdout: { 2023-08-01T19:56:11.472 INFO:teuthology.orchestra.run.smithi155.stdout: "event": "dispatched", 2023-08-01T19:56:11.473 INFO:teuthology.orchestra.run.smithi155.stdout: "time": "2023-08-01T19:55:05.561225+0000", 2023-08-01T19:56:11.473 INFO:teuthology.orchestra.run.smithi155.stdout: "duration": 7.114e-06 2023-08-01T19:56:11.473 INFO:teuthology.orchestra.run.smithi155.stdout: }, 2023-08-01T19:56:11.473 INFO:teuthology.orchestra.run.smithi155.stdout: { 2023-08-01T19:56:11.473 INFO:teuthology.orchestra.run.smithi155.stdout: "event": "queued_for_pg", 2023-08-01T19:56:11.473 INFO:teuthology.orchestra.run.smithi155.stdout: "time": "2023-08-01T19:55:05.561229+0000", 2023-08-01T19:56:11.473 INFO:teuthology.orchestra.run.smithi155.stdout: "duration": 4.2180000000000001e-06 2023-08-01T19:56:11.473 INFO:teuthology.orchestra.run.smithi155.stdout: }, 2023-08-01T19:56:11.474 INFO:teuthology.orchestra.run.smithi155.stdout: { 2023-08-01T19:56:11.474 INFO:teuthology.orchestra.run.smithi155.stdout: "event": "reached_pg", 2023-08-01T19:56:11.474 INFO:teuthology.orchestra.run.smithi155.stdout: "time": "2023-08-01T19:55:05.564737+0000", 2023-08-01T19:56:11.474 INFO:teuthology.orchestra.run.smithi155.stdout: "duration": 0.0035081869999999999 2023-08-01T19:56:11.474 INFO:teuthology.orchestra.run.smithi155.stdout: }, 2023-08-01T19:56:11.475 INFO:teuthology.orchestra.run.smithi155.stdout: { 2023-08-01T19:56:11.475 INFO:teuthology.orchestra.run.smithi155.stdout: "event": "started", 2023-08-01T19:56:11.475 INFO:teuthology.orchestra.run.smithi155.stdout: "time": "2023-08-01T19:55:05.564859+0000", 2023-08-01T19:56:11.475 INFO:teuthology.orchestra.run.smithi155.stdout: "duration": 0.00012165800000000001 2023-08-01T19:56:11.475 INFO:teuthology.orchestra.run.smithi155.stdout: }, 2023-08-01T19:56:11.475 INFO:teuthology.orchestra.run.smithi155.stdout: { 2023-08-01T19:56:11.475 INFO:teuthology.orchestra.run.smithi155.stdout: "event": "waiting for subops from 0", 2023-08-01T19:56:11.476 INFO:teuthology.orchestra.run.smithi155.stdout: "time": "2023-08-01T19:55:05.565009+0000", 2023-08-01T19:56:11.476 INFO:teuthology.orchestra.run.smithi155.stdout: "duration": 0.00014979699999999999 2023-08-01T19:56:11.476 INFO:teuthology.orchestra.run.smithi155.stdout: }, 2023-08-01T19:56:11.476 INFO:teuthology.orchestra.run.smithi155.stdout: { 2023-08-01T19:56:11.476 INFO:teuthology.orchestra.run.smithi155.stdout: "event": "op_commit", 2023-08-01T19:56:11.476 INFO:teuthology.orchestra.run.smithi155.stdout: "time": "2023-08-01T19:55:05.568007+0000", 2023-08-01T19:56:11.477 INFO:teuthology.orchestra.run.smithi155.stdout: "duration": 0.00299796 2023-08-01T19:56:11.477 INFO:teuthology.orchestra.run.smithi155.stdout: }, 2023-08-01T19:56:11.477 INFO:teuthology.orchestra.run.smithi155.stdout: { 2023-08-01T19:56:11.477 INFO:teuthology.orchestra.run.smithi155.stdout: "event": "sub_op_commit_rec", 2023-08-01T19:56:11.477 INFO:teuthology.orchestra.run.smithi155.stdout: "time": "2023-08-01T19:55:05.627520+0000", 2023-08-01T19:56:11.477 INFO:teuthology.orchestra.run.smithi155.stdout: "duration": 0.059513636000000002 2023-08-01T19:56:11.477 INFO:teuthology.orchestra.run.smithi155.stdout: }, 2023-08-01T19:56:11.478 INFO:teuthology.orchestra.run.smithi155.stdout: { 2023-08-01T19:56:11.478 INFO:teuthology.orchestra.run.smithi155.stdout: "event": "commit_sent", 2023-08-01T19:56:11.478 INFO:teuthology.orchestra.run.smithi155.stdout: "time": "2023-08-01T19:55:05.627553+0000", 2023-08-01T19:56:11.478 INFO:teuthology.orchestra.run.smithi155.stdout: "duration": 3.2635999999999997e-05 2023-08-01T19:56:11.478 INFO:teuthology.orchestra.run.smithi155.stdout: }, 2023-08-01T19:56:11.478 INFO:teuthology.orchestra.run.smithi155.stdout: { 2023-08-01T19:56:11.478 INFO:teuthology.orchestra.run.smithi155.stdout: "event": "done", 2023-08-01T19:56:11.479 INFO:teuthology.orchestra.run.smithi155.stdout: "time": "2023-08-01T19:55:05.627581+0000", 2023-08-01T19:56:11.479 INFO:teuthology.orchestra.run.smithi155.stdout: "duration": 2.7681000000000001e-05 2023-08-01T19:56:11.479 INFO:teuthology.orchestra.run.smithi155.stdout: } 2023-08-01T19:56:11.479 INFO:teuthology.orchestra.run.smithi155.stdout: ] 2023-08-01T19:56:11.479 INFO:teuthology.orchestra.run.smithi155.stdout: } 2023-08-01T19:56:11.479 INFO:teuthology.orchestra.run.smithi155.stdout: }, 2023-08-01T19:56:11.479 INFO:teuthology.orchestra.run.smithi155.stdout: { 2023-08-01T19:56:11.480 INFO:teuthology.orchestra.run.smithi155.stdout: "description": "osd_op(client.4668.0:100935 5.e 5:7895b14e:::benchmark_data_smithi006_114134_object100934:head [set-alloc-hint object_size 65536 write_size 65536,write 0~65536] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e37)", 2023-08-01T19:56:11.480 INFO:teuthology.orchestra.run.smithi155.stdout: "initiated_at": "2023-08-01T19:55:05.566666+0000", 2023-08-01T19:56:11.480 INFO:teuthology.orchestra.run.smithi155.stdout: "age": 65.795404199000004, 2023-08-01T19:56:11.480 INFO:teuthology.orchestra.run.smithi155.stdout: "duration": 0.064309016999999996, 2023-08-01T19:56:11.480 INFO:teuthology.orchestra.run.smithi155.stdout: "type_data": { 2023-08-01T19:56:11.481 INFO:teuthology.orchestra.run.smithi155.stdout: "flag_point": "commit sent; apply or cleanup", 2023-08-01T19:56:11.481 INFO:teuthology.orchestra.run.smithi155.stdout: "client_info": { 2023-08-01T19:56:11.481 INFO:teuthology.orchestra.run.smithi155.stdout: "client": "client.4668", 2023-08-01T19:56:11.481 INFO:teuthology.orchestra.run.smithi155.stdout: "client_addr": "172.21.15.6:0/1709472247", 2023-08-01T19:56:11.481 INFO:teuthology.orchestra.run.smithi155.stdout: "tid": 100935 2023-08-01T19:56:11.481 INFO:teuthology.orchestra.run.smithi155.stdout: }, 2023-08-01T19:56:11.481 INFO:teuthology.orchestra.run.smithi155.stdout: "events": [ 2023-08-01T19:56:11.481 INFO:teuthology.orchestra.run.smithi155.stdout: { 2023-08-01T19:56:11.482 INFO:teuthology.orchestra.run.smithi155.stdout: "event": "initiated", 2023-08-01T19:56:11.482 INFO:teuthology.orchestra.run.smithi155.stdout: "time": "2023-08-01T19:55:05.566666+0000", 2023-08-01T19:56:11.482 INFO:teuthology.orchestra.run.smithi155.stdout: "duration": 0 2023-08-01T19:56:11.482 INFO:teuthology.orchestra.run.smithi155.stdout: }, 2023-08-01T19:56:11.482 INFO:teuthology.orchestra.run.smithi155.stdout: { 2023-08-01T19:56:11.482 INFO:teuthology.orchestra.run.smithi155.stdout: "event": "throttled", 2023-08-01T19:56:11.482 INFO:teuthology.orchestra.run.smithi155.stdout: "time": "2023-08-01T19:55:05.566666+0000", 2023-08-01T19:56:11.483 INFO:teuthology.orchestra.run.smithi155.stdout: "duration": 0 2023-08-01T19:56:11.483 INFO:teuthology.orchestra.run.smithi155.stdout: }, 2023-08-01T19:56:11.483 INFO:teuthology.orchestra.run.smithi155.stdout: { 2023-08-01T19:56:11.483 INFO:teuthology.orchestra.run.smithi155.stdout: "event": "header_read", 2023-08-01T19:56:11.483 INFO:teuthology.orchestra.run.smithi155.stdout: "time": "2023-08-01T19:55:05.566665+0000", 2023-08-01T19:56:11.483 INFO:teuthology.orchestra.run.smithi155.stdout: "duration": 4294967295.9999986 2023-08-01T19:56:11.483 INFO:teuthology.orchestra.run.smithi155.stdout: }, 2023-08-01T19:56:11.484 INFO:teuthology.orchestra.run.smithi155.stdout: { 2023-08-01T19:56:11.484 INFO:teuthology.orchestra.run.smithi155.stdout: "event": "all_read", 2023-08-01T19:56:11.484 INFO:teuthology.orchestra.run.smithi155.stdout: "time": "2023-08-01T19:55:05.566754+0000", 2023-08-01T19:56:11.484 INFO:teuthology.orchestra.run.smithi155.stdout: "duration": 8.9425999999999994e-05 2023-08-01T19:56:11.484 INFO:teuthology.orchestra.run.smithi155.stdout: }, 2023-08-01T19:56:11.484 INFO:teuthology.orchestra.run.smithi155.stdout: { 2023-08-01T19:56:11.484 INFO:teuthology.orchestra.run.smithi155.stdout: "event": "dispatched", 2023-08-01T19:56:11.485 INFO:teuthology.orchestra.run.smithi155.stdout: "time": "2023-08-01T19:55:05.566766+0000", 2023-08-01T19:56:11.485 INFO:teuthology.orchestra.run.smithi155.stdout: "duration": 1.2018000000000001e-05 2023-08-01T19:56:11.485 INFO:teuthology.orchestra.run.smithi155.stdout: }, 2023-08-01T19:56:11.485 INFO:teuthology.orchestra.run.smithi155.stdout: { 2023-08-01T19:56:11.485 INFO:teuthology.orchestra.run.smithi155.stdout: "event": "queued_for_pg", 2023-08-01T19:56:11.485 INFO:teuthology.orchestra.run.smithi155.stdout: "time": "2023-08-01T19:55:05.566772+0000", 2023-08-01T19:56:11.485 INFO:teuthology.orchestra.run.smithi155.stdout: "duration": 6.0190000000000003e-06 2023-08-01T19:56:11.486 INFO:teuthology.orchestra.run.smithi155.stdout: }, 2023-08-01T19:56:11.486 INFO:teuthology.orchestra.run.smithi155.stdout: { 2023-08-01T19:56:11.486 INFO:teuthology.orchestra.run.smithi155.stdout: "event": "reached_pg", 2023-08-01T19:56:11.486 INFO:teuthology.orchestra.run.smithi155.stdout: "time": "2023-08-01T19:55:05.566800+0000", 2023-08-01T19:56:11.486 INFO:teuthology.orchestra.run.smithi155.stdout: "duration": 2.7835999999999999e-05 2023-08-01T19:56:11.486 INFO:teuthology.orchestra.run.smithi155.stdout: }, 2023-08-01T19:56:11.486 INFO:teuthology.orchestra.run.smithi155.stdout: { 2023-08-01T19:56:11.486 INFO:teuthology.orchestra.run.smithi155.stdout: "event": "started", 2023-08-01T19:56:11.487 INFO:teuthology.orchestra.run.smithi155.stdout: "time": "2023-08-01T19:55:05.566879+0000", 2023-08-01T19:56:11.487 INFO:teuthology.orchestra.run.smithi155.stdout: "duration": 7.9105999999999998e-05 2023-08-01T19:56:11.487 INFO:teuthology.orchestra.run.smithi155.stdout: }, 2023-08-01T19:56:11.487 INFO:teuthology.orchestra.run.smithi155.stdout: { 2023-08-01T19:56:11.487 INFO:teuthology.orchestra.run.smithi155.stdout: "event": "waiting for subops from 0", 2023-08-01T19:56:11.487 INFO:teuthology.orchestra.run.smithi155.stdout: "time": "2023-08-01T19:55:05.566971+0000", 2023-08-01T19:56:11.487 INFO:teuthology.orchestra.run.smithi155.stdout: "duration": 9.1817999999999994e-05 2023-08-01T19:56:11.488 INFO:teuthology.orchestra.run.smithi155.stdout: }, 2023-08-01T19:56:11.488 INFO:teuthology.orchestra.run.smithi155.stdout: { 2023-08-01T19:56:11.488 INFO:teuthology.orchestra.run.smithi155.stdout: "event": "op_commit", 2023-08-01T19:56:11.488 INFO:teuthology.orchestra.run.smithi155.stdout: "time": "2023-08-01T19:55:05.571475+0000", 2023-08-01T19:56:11.488 INFO:teuthology.orchestra.run.smithi155.stdout: "duration": 0.0045039499999999996 2023-08-01T19:56:11.488 INFO:teuthology.orchestra.run.smithi155.stdout: }, 2023-08-01T19:56:11.488 INFO:teuthology.orchestra.run.smithi155.stdout: { 2023-08-01T19:56:11.488 INFO:teuthology.orchestra.run.smithi155.stdout: "event": "sub_op_commit_rec", 2023-08-01T19:56:11.489 INFO:teuthology.orchestra.run.smithi155.stdout: "time": "2023-08-01T19:55:05.630884+0000", 2023-08-01T19:56:11.489 INFO:teuthology.orchestra.run.smithi155.stdout: "duration": 0.059409181999999998 2023-08-01T19:56:11.489 INFO:teuthology.orchestra.run.smithi155.stdout: }, 2023-08-01T19:56:11.489 INFO:teuthology.orchestra.run.smithi155.stdout: { 2023-08-01T19:56:11.489 INFO:teuthology.orchestra.run.smithi155.stdout: "event": "commit_sent", 2023-08-01T19:56:11.489 INFO:teuthology.orchestra.run.smithi155.stdout: "time": "2023-08-01T19:55:05.630930+0000", 2023-08-01T19:56:11.490 INFO:teuthology.orchestra.run.smithi155.stdout: "duration": 4.5507999999999999e-05 2023-08-01T19:56:11.490 INFO:teuthology.orchestra.run.smithi155.stdout: }, 2023-08-01T19:56:11.490 INFO:teuthology.orchestra.run.smithi155.stdout: { 2023-08-01T19:56:11.490 INFO:teuthology.orchestra.run.smithi155.stdout: "event": "done", 2023-08-01T19:56:11.490 INFO:teuthology.orchestra.run.smithi155.stdout: "time": "2023-08-01T19:55:05.630975+0000", 2023-08-01T19:56:11.490 INFO:teuthology.orchestra.run.smithi155.stdout: "duration": 4.5441000000000001e-05 2023-08-01T19:56:11.490 INFO:teuthology.orchestra.run.smithi155.stdout: } 2023-08-01T19:56:11.491 INFO:teuthology.orchestra.run.smithi155.stdout: ] 2023-08-01T19:56:11.491 INFO:teuthology.orchestra.run.smithi155.stdout: } 2023-08-01T19:56:11.491 INFO:teuthology.orchestra.run.smithi155.stdout: }, 2023-08-01T19:56:11.491 INFO:teuthology.orchestra.run.smithi155.stdout: { 2023-08-01T19:56:11.491 INFO:teuthology.orchestra.run.smithi155.stdout: "description": "osd_op(client.4668.0:100941 5.e 5:736a6ac6:::benchmark_data_smithi006_114134_object100940:head [set-alloc-hint object_size 65536 write_size 65536,write 0~65536] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e37)", 2023-08-01T19:56:11.491 INFO:teuthology.orchestra.run.smithi155.stdout: "initiated_at": "2023-08-01T19:55:05.569750+0000", 2023-08-01T19:56:11.491 INFO:teuthology.orchestra.run.smithi155.stdout: "age": 65.792320305999993, 2023-08-01T19:56:11.491 INFO:teuthology.orchestra.run.smithi155.stdout: "duration": 0.065431331999999995, 2023-08-01T19:56:11.492 INFO:teuthology.orchestra.run.smithi155.stdout: "type_data": { 2023-08-01T19:56:11.492 INFO:teuthology.orchestra.run.smithi155.stdout: "flag_point": "commit sent; apply or cleanup", 2023-08-01T19:56:11.492 INFO:teuthology.orchestra.run.smithi155.stdout: "client_info": { 2023-08-01T19:56:11.492 INFO:teuthology.orchestra.run.smithi155.stdout: "client": "client.4668", 2023-08-01T19:56:11.492 INFO:teuthology.orchestra.run.smithi155.stdout: "client_addr": "172.21.15.6:0/1709472247", 2023-08-01T19:56:11.492 INFO:teuthology.orchestra.run.smithi155.stdout: "tid": 100941 2023-08-01T19:56:11.493 INFO:teuthology.orchestra.run.smithi155.stdout: }, 2023-08-01T19:56:11.493 INFO:teuthology.orchestra.run.smithi155.stdout: "events": [ 2023-08-01T19:56:11.493 INFO:teuthology.orchestra.run.smithi155.stdout: { 2023-08-01T19:56:11.493 INFO:teuthology.orchestra.run.smithi155.stdout: "event": "initiated", 2023-08-01T19:56:11.493 INFO:teuthology.orchestra.run.smithi155.stdout: "time": "2023-08-01T19:55:05.569750+0000", 2023-08-01T19:56:11.493 INFO:teuthology.orchestra.run.smithi155.stdout: "duration": 0 2023-08-01T19:56:11.493 INFO:teuthology.orchestra.run.smithi155.stdout: }, 2023-08-01T19:56:11.493 INFO:teuthology.orchestra.run.smithi155.stdout: { 2023-08-01T19:56:11.494 INFO:teuthology.orchestra.run.smithi155.stdout: "event": "throttled", 2023-08-01T19:56:11.494 INFO:teuthology.orchestra.run.smithi155.stdout: "time": "2023-08-01T19:55:05.569750+0000", 2023-08-01T19:56:11.494 INFO:teuthology.orchestra.run.smithi155.stdout: "duration": 0 2023-08-01T19:56:11.494 INFO:teuthology.orchestra.run.smithi155.stdout: }, 2023-08-01T19:56:11.494 INFO:teuthology.orchestra.run.smithi155.stdout: { 2023-08-01T19:56:11.494 INFO:teuthology.orchestra.run.smithi155.stdout: "event": "header_read", 2023-08-01T19:56:11.494 INFO:teuthology.orchestra.run.smithi155.stdout: "time": "2023-08-01T19:55:05.569749+0000", 2023-08-01T19:56:11.495 INFO:teuthology.orchestra.run.smithi155.stdout: "duration": 4294967295.999999 2023-08-01T19:56:11.495 INFO:teuthology.orchestra.run.smithi155.stdout: }, 2023-08-01T19:56:11.495 INFO:teuthology.orchestra.run.smithi155.stdout: { 2023-08-01T19:56:11.495 INFO:teuthology.orchestra.run.smithi155.stdout: "event": "all_read", 2023-08-01T19:56:11.495 INFO:teuthology.orchestra.run.smithi155.stdout: "time": "2023-08-01T19:55:05.569861+0000", 2023-08-01T19:56:11.495 INFO:teuthology.orchestra.run.smithi155.stdout: "duration": 0.000111333 2023-08-01T19:56:11.495 INFO:teuthology.orchestra.run.smithi155.stdout: }, 2023-08-01T19:56:11.496 INFO:teuthology.orchestra.run.smithi155.stdout: { 2023-08-01T19:56:11.496 INFO:teuthology.orchestra.run.smithi155.stdout: "event": "dispatched", 2023-08-01T19:56:11.496 INFO:teuthology.orchestra.run.smithi155.stdout: "time": "2023-08-01T19:55:05.569869+0000", 2023-08-01T19:56:11.496 INFO:teuthology.orchestra.run.smithi155.stdout: "duration": 8.8589999999999994e-06 2023-08-01T19:56:11.496 INFO:teuthology.orchestra.run.smithi155.stdout: }, 2023-08-01T19:56:11.496 INFO:teuthology.orchestra.run.smithi155.stdout: { 2023-08-01T19:56:11.496 INFO:teuthology.orchestra.run.smithi155.stdout: "event": "queued_for_pg", 2023-08-01T19:56:11.497 INFO:teuthology.orchestra.run.smithi155.stdout: "time": "2023-08-01T19:55:05.569874+0000", 2023-08-01T19:56:11.497 INFO:teuthology.orchestra.run.smithi155.stdout: "duration": 4.1679999999999997e-06 2023-08-01T19:56:11.497 INFO:teuthology.orchestra.run.smithi155.stdout: }, 2023-08-01T19:56:11.497 INFO:teuthology.orchestra.run.smithi155.stdout: { 2023-08-01T19:56:11.497 INFO:teuthology.orchestra.run.smithi155.stdout: "event": "reached_pg", 2023-08-01T19:56:11.497 INFO:teuthology.orchestra.run.smithi155.stdout: "time": "2023-08-01T19:55:05.569904+0000", 2023-08-01T19:56:11.497 INFO:teuthology.orchestra.run.smithi155.stdout: "duration": 3.0920999999999998e-05 2023-08-01T19:56:11.497 INFO:teuthology.orchestra.run.smithi155.stdout: }, 2023-08-01T19:56:11.498 INFO:teuthology.orchestra.run.smithi155.stdout: { 2023-08-01T19:56:11.498 INFO:teuthology.orchestra.run.smithi155.stdout: "event": "started", 2023-08-01T19:56:11.498 INFO:teuthology.orchestra.run.smithi155.stdout: "time": "2023-08-01T19:55:05.569998+0000", 2023-08-01T19:56:11.498 INFO:teuthology.orchestra.run.smithi155.stdout: "duration": 9.3086999999999998e-05 2023-08-01T19:56:11.498 INFO:teuthology.orchestra.run.smithi155.stdout: }, 2023-08-01T19:56:11.498 INFO:teuthology.orchestra.run.smithi155.stdout: { 2023-08-01T19:56:11.498 INFO:teuthology.orchestra.run.smithi155.stdout: "event": "waiting for subops from 0", 2023-08-01T19:56:11.498 INFO:teuthology.orchestra.run.smithi155.stdout: "time": "2023-08-01T19:55:05.570093+0000", 2023-08-01T19:56:11.499 INFO:teuthology.orchestra.run.smithi155.stdout: "duration": 9.5768999999999997e-05 2023-08-01T19:56:11.499 INFO:teuthology.orchestra.run.smithi155.stdout: }, 2023-08-01T19:56:11.499 INFO:teuthology.orchestra.run.smithi155.stdout: { 2023-08-01T19:56:11.499 INFO:teuthology.orchestra.run.smithi155.stdout: "event": "op_commit", 2023-08-01T19:56:11.499 INFO:teuthology.orchestra.run.smithi155.stdout: "time": "2023-08-01T19:55:05.572839+0000", 2023-08-01T19:56:11.499 INFO:teuthology.orchestra.run.smithi155.stdout: "duration": 0.0027460050000000001 2023-08-01T19:56:11.499 INFO:teuthology.orchestra.run.smithi155.stdout: }, 2023-08-01T19:56:11.500 INFO:teuthology.orchestra.run.smithi155.stdout: { 2023-08-01T19:56:11.500 INFO:teuthology.orchestra.run.smithi155.stdout: "event": "sub_op_commit_rec", 2023-08-01T19:56:11.500 INFO:teuthology.orchestra.run.smithi155.stdout: "time": "2023-08-01T19:55:05.635114+0000", 2023-08-01T19:56:11.500 INFO:teuthology.orchestra.run.smithi155.stdout: "duration": 0.062274297999999999 2023-08-01T19:56:11.500 INFO:teuthology.orchestra.run.smithi155.stdout: }, 2023-08-01T19:56:11.500 INFO:teuthology.orchestra.run.smithi155.stdout: { 2023-08-01T19:56:11.500 INFO:teuthology.orchestra.run.smithi155.stdout: "event": "commit_sent", 2023-08-01T19:56:11.501 INFO:teuthology.orchestra.run.smithi155.stdout: "time": "2023-08-01T19:55:05.635143+0000", 2023-08-01T19:56:11.501 INFO:teuthology.orchestra.run.smithi155.stdout: "duration": 2.9430000000000001e-05 2023-08-01T19:56:11.501 INFO:teuthology.orchestra.run.smithi155.stdout: }, 2023-08-01T19:56:11.501 INFO:teuthology.orchestra.run.smithi155.stdout: { 2023-08-01T19:56:11.501 INFO:teuthology.orchestra.run.smithi155.stdout: "event": "done", 2023-08-01T19:56:11.501 INFO:teuthology.orchestra.run.smithi155.stdout: "time": "2023-08-01T19:55:05.635181+0000", 2023-08-01T19:56:11.501 INFO:teuthology.orchestra.run.smithi155.stdout: "duration": 3.8352000000000001e-05 2023-08-01T19:56:11.502 INFO:teuthology.orchestra.run.smithi155.stdout: } 2023-08-01T19:56:11.502 INFO:teuthology.orchestra.run.smithi155.stdout: ] 2023-08-01T19:56:11.502 INFO:teuthology.orchestra.run.smithi155.stdout: } 2023-08-01T19:56:11.502 INFO:teuthology.orchestra.run.smithi155.stdout: }, 2023-08-01T19:56:11.502 INFO:teuthology.orchestra.run.smithi155.stdout: { 2023-08-01T19:56:11.502 INFO:teuthology.orchestra.run.smithi155.stdout: "description": "osd_op(client.4668.0:100945 5.e 5:73df68dd:::benchmark_data_smithi006_114134_object100944:head [set-alloc-hint object_size 65536 write_size 65536,write 0~65536] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e37)", 2023-08-01T19:56:11.502 INFO:teuthology.orchestra.run.smithi155.stdout: "initiated_at": "2023-08-01T19:55:05.576784+0000", 2023-08-01T19:56:11.502 INFO:teuthology.orchestra.run.smithi155.stdout: "age": 65.785286721000006, 2023-08-01T19:56:11.503 INFO:teuthology.orchestra.run.smithi155.stdout: "duration": 0.058512994999999998, 2023-08-01T19:56:11.503 INFO:teuthology.orchestra.run.smithi155.stdout: "type_data": { 2023-08-01T19:56:11.503 INFO:teuthology.orchestra.run.smithi155.stdout: "flag_point": "commit sent; apply or cleanup", 2023-08-01T19:56:11.503 INFO:teuthology.orchestra.run.smithi155.stdout: "client_info": { 2023-08-01T19:56:11.503 INFO:teuthology.orchestra.run.smithi155.stdout: "client": "client.4668", 2023-08-01T19:56:11.503 INFO:teuthology.orchestra.run.smithi155.stdout: "client_addr": "172.21.15.6:0/1709472247", 2023-08-01T19:56:11.503 INFO:teuthology.orchestra.run.smithi155.stdout: "tid": 100945 2023-08-01T19:56:11.503 INFO:teuthology.orchestra.run.smithi155.stdout: }, 2023-08-01T19:56:11.504 INFO:teuthology.orchestra.run.smithi155.stdout: "events": [ 2023-08-01T19:56:11.504 INFO:teuthology.orchestra.run.smithi155.stdout: { 2023-08-01T19:56:11.504 INFO:teuthology.orchestra.run.smithi155.stdout: "event": "initiated", 2023-08-01T19:56:11.504 INFO:teuthology.orchestra.run.smithi155.stdout: "time": "2023-08-01T19:55:05.576784+0000", 2023-08-01T19:56:11.504 INFO:teuthology.orchestra.run.smithi155.stdout: "duration": 0 2023-08-01T19:56:11.504 INFO:teuthology.orchestra.run.smithi155.stdout: }, 2023-08-01T19:56:11.505 INFO:teuthology.orchestra.run.smithi155.stdout: { 2023-08-01T19:56:11.505 INFO:teuthology.orchestra.run.smithi155.stdout: "event": "throttled", 2023-08-01T19:56:11.505 INFO:teuthology.orchestra.run.smithi155.stdout: "time": "2023-08-01T19:55:05.576784+0000", 2023-08-01T19:56:11.505 INFO:teuthology.orchestra.run.smithi155.stdout: "duration": 0 2023-08-01T19:56:11.505 INFO:teuthology.orchestra.run.smithi155.stdout: }, 2023-08-01T19:56:11.505 INFO:teuthology.orchestra.run.smithi155.stdout: { 2023-08-01T19:56:11.505 INFO:teuthology.orchestra.run.smithi155.stdout: "event": "header_read", 2023-08-01T19:56:11.506 INFO:teuthology.orchestra.run.smithi155.stdout: "time": "2023-08-01T19:55:05.576783+0000", 2023-08-01T19:56:11.506 INFO:teuthology.orchestra.run.smithi155.stdout: "duration": 4294967295.9999995 2023-08-01T19:56:11.506 INFO:teuthology.orchestra.run.smithi155.stdout: }, 2023-08-01T19:56:11.506 INFO:teuthology.orchestra.run.smithi155.stdout: { 2023-08-01T19:56:11.506 INFO:teuthology.orchestra.run.smithi155.stdout: "event": "all_read", 2023-08-01T19:56:11.506 INFO:teuthology.orchestra.run.smithi155.stdout: "time": "2023-08-01T19:55:05.576807+0000", 2023-08-01T19:56:11.506 INFO:teuthology.orchestra.run.smithi155.stdout: "duration": 2.3651000000000001e-05 2023-08-01T19:56:11.507 INFO:teuthology.orchestra.run.smithi155.stdout: }, 2023-08-01T19:56:11.507 INFO:teuthology.orchestra.run.smithi155.stdout: { 2023-08-01T19:56:11.507 INFO:teuthology.orchestra.run.smithi155.stdout: "event": "dispatched", 2023-08-01T19:56:11.507 INFO:teuthology.orchestra.run.smithi155.stdout: "time": "2023-08-01T19:55:05.576817+0000", 2023-08-01T19:56:11.507 INFO:teuthology.orchestra.run.smithi155.stdout: "duration": 9.9389999999999992e-06 2023-08-01T19:56:11.507 INFO:teuthology.orchestra.run.smithi155.stdout: }, 2023-08-01T19:56:11.507 INFO:teuthology.orchestra.run.smithi155.stdout: { 2023-08-01T19:56:11.507 INFO:teuthology.orchestra.run.smithi155.stdout: "event": "queued_for_pg", 2023-08-01T19:56:11.508 INFO:teuthology.orchestra.run.smithi155.stdout: "time": "2023-08-01T19:55:05.576820+0000", 2023-08-01T19:56:11.508 INFO:teuthology.orchestra.run.smithi155.stdout: "duration": 3.2619999999999999e-06 2023-08-01T19:56:11.508 INFO:teuthology.orchestra.run.smithi155.stdout: }, 2023-08-01T19:56:11.508 INFO:teuthology.orchestra.run.smithi155.stdout: { 2023-08-01T19:56:11.508 INFO:teuthology.orchestra.run.smithi155.stdout: "event": "reached_pg", 2023-08-01T19:56:11.508 INFO:teuthology.orchestra.run.smithi155.stdout: "time": "2023-08-01T19:55:05.576849+0000", 2023-08-01T19:56:11.508 INFO:teuthology.orchestra.run.smithi155.stdout: "duration": 2.8880000000000001e-05 2023-08-01T19:56:11.509 INFO:teuthology.orchestra.run.smithi155.stdout: }, 2023-08-01T19:56:11.509 INFO:teuthology.orchestra.run.smithi155.stdout: { 2023-08-01T19:56:11.509 INFO:teuthology.orchestra.run.smithi155.stdout: "event": "started", 2023-08-01T19:56:11.509 INFO:teuthology.orchestra.run.smithi155.stdout: "time": "2023-08-01T19:55:05.576940+0000", 2023-08-01T19:56:11.509 INFO:teuthology.orchestra.run.smithi155.stdout: "duration": 9.0570999999999997e-05 2023-08-01T19:56:11.509 INFO:teuthology.orchestra.run.smithi155.stdout: }, 2023-08-01T19:56:11.509 INFO:teuthology.orchestra.run.smithi155.stdout: { 2023-08-01T19:56:11.510 INFO:teuthology.orchestra.run.smithi155.stdout: "event": "waiting for subops from 0", 2023-08-01T19:56:11.510 INFO:teuthology.orchestra.run.smithi155.stdout: "time": "2023-08-01T19:55:05.577027+0000", 2023-08-01T19:56:11.510 INFO:teuthology.orchestra.run.smithi155.stdout: "duration": 8.7237999999999994e-05 2023-08-01T19:56:11.510 INFO:teuthology.orchestra.run.smithi155.stdout: }, 2023-08-01T19:56:11.510 INFO:teuthology.orchestra.run.smithi155.stdout: { 2023-08-01T19:56:11.510 INFO:teuthology.orchestra.run.smithi155.stdout: "event": "op_commit", 2023-08-01T19:56:11.511 INFO:teuthology.orchestra.run.smithi155.stdout: "time": "2023-08-01T19:55:05.579624+0000", 2023-08-01T19:56:11.511 INFO:teuthology.orchestra.run.smithi155.stdout: "duration": 0.0025971200000000001 2023-08-01T19:56:11.511 INFO:teuthology.orchestra.run.smithi155.stdout: }, 2023-08-01T19:56:11.511 INFO:teuthology.orchestra.run.smithi155.stdout: { 2023-08-01T19:56:11.511 INFO:teuthology.orchestra.run.smithi155.stdout: "event": "sub_op_commit_rec", 2023-08-01T19:56:11.511 INFO:teuthology.orchestra.run.smithi155.stdout: "time": "2023-08-01T19:55:05.635218+0000", 2023-08-01T19:56:11.511 INFO:teuthology.orchestra.run.smithi155.stdout: "duration": 0.055594487999999997 2023-08-01T19:56:11.511 INFO:teuthology.orchestra.run.smithi155.stdout: }, 2023-08-01T19:56:11.512 INFO:teuthology.orchestra.run.smithi155.stdout: { 2023-08-01T19:56:11.512 INFO:teuthology.orchestra.run.smithi155.stdout: "event": "commit_sent", 2023-08-01T19:56:11.512 INFO:teuthology.orchestra.run.smithi155.stdout: "time": "2023-08-01T19:55:05.635262+0000", 2023-08-01T19:56:11.512 INFO:teuthology.orchestra.run.smithi155.stdout: "duration": 4.3380999999999997e-05 2023-08-01T19:56:11.512 INFO:teuthology.orchestra.run.smithi155.stdout: }, 2023-08-01T19:56:11.512 INFO:teuthology.orchestra.run.smithi155.stdout: { 2023-08-01T19:56:11.512 INFO:teuthology.orchestra.run.smithi155.stdout: "event": "done", 2023-08-01T19:56:11.512 INFO:teuthology.orchestra.run.smithi155.stdout: "time": "2023-08-01T19:55:05.635297+0000", 2023-08-01T19:56:11.513 INFO:teuthology.orchestra.run.smithi155.stdout: "duration": 3.4842000000000003e-05 2023-08-01T19:56:11.513 INFO:teuthology.orchestra.run.smithi155.stdout: } 2023-08-01T19:56:11.513 INFO:teuthology.orchestra.run.smithi155.stdout: ] 2023-08-01T19:56:11.513 INFO:teuthology.orchestra.run.smithi155.stdout: } 2023-08-01T19:56:11.513 INFO:teuthology.orchestra.run.smithi155.stdout: }, 2023-08-01T19:56:11.513 INFO:teuthology.orchestra.run.smithi155.stdout: { 2023-08-01T19:56:11.513 INFO:teuthology.orchestra.run.smithi155.stdout: "description": "osd_op(client.4668.0:100947 5.4 5:23e8fc27:::benchmark_data_smithi006_114134_object100946:head [set-alloc-hint object_size 65536 write_size 65536,write 0~65536] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e37)", 2023-08-01T19:56:11.514 INFO:teuthology.orchestra.run.smithi155.stdout: "initiated_at": "2023-08-01T19:55:05.576840+0000", 2023-08-01T19:56:11.514 INFO:teuthology.orchestra.run.smithi155.stdout: "age": 65.785230666000004, 2023-08-01T19:56:11.514 INFO:teuthology.orchestra.run.smithi155.stdout: "duration": 0.058423127999999998, 2023-08-01T19:56:11.514 INFO:teuthology.orchestra.run.smithi155.stdout: "type_data": { 2023-08-01T19:56:11.514 INFO:teuthology.orchestra.run.smithi155.stdout: "flag_point": "commit sent; apply or cleanup", 2023-08-01T19:56:11.514 INFO:teuthology.orchestra.run.smithi155.stdout: "client_info": { 2023-08-01T19:56:11.514 INFO:teuthology.orchestra.run.smithi155.stdout: "client": "client.4668", 2023-08-01T19:56:11.514 INFO:teuthology.orchestra.run.smithi155.stdout: "client_addr": "172.21.15.6:0/1709472247", 2023-08-01T19:56:11.515 INFO:teuthology.orchestra.run.smithi155.stdout: "tid": 100947 2023-08-01T19:56:11.515 INFO:teuthology.orchestra.run.smithi155.stdout: }, 2023-08-01T19:56:11.515 INFO:teuthology.orchestra.run.smithi155.stdout: "events": [ 2023-08-01T19:56:11.515 INFO:teuthology.orchestra.run.smithi155.stdout: { 2023-08-01T19:56:11.515 INFO:teuthology.orchestra.run.smithi155.stdout: "event": "initiated", 2023-08-01T19:56:11.515 INFO:teuthology.orchestra.run.smithi155.stdout: "time": "2023-08-01T19:55:05.576840+0000", 2023-08-01T19:56:11.515 INFO:teuthology.orchestra.run.smithi155.stdout: "duration": 0 2023-08-01T19:56:11.515 INFO:teuthology.orchestra.run.smithi155.stdout: }, 2023-08-01T19:56:11.516 INFO:teuthology.orchestra.run.smithi155.stdout: { 2023-08-01T19:56:11.516 INFO:teuthology.orchestra.run.smithi155.stdout: "event": "throttled", 2023-08-01T19:56:11.516 INFO:teuthology.orchestra.run.smithi155.stdout: "time": "2023-08-01T19:55:05.576840+0000", 2023-08-01T19:56:11.516 INFO:teuthology.orchestra.run.smithi155.stdout: "duration": 0 2023-08-01T19:56:11.516 INFO:teuthology.orchestra.run.smithi155.stdout: }, 2023-08-01T19:56:11.516 INFO:teuthology.orchestra.run.smithi155.stdout: { 2023-08-01T19:56:11.516 INFO:teuthology.orchestra.run.smithi155.stdout: "event": "header_read", 2023-08-01T19:56:11.517 INFO:teuthology.orchestra.run.smithi155.stdout: "time": "2023-08-01T19:55:05.576839+0000", 2023-08-01T19:56:11.517 INFO:teuthology.orchestra.run.smithi155.stdout: "duration": 4294967295.9999995 2023-08-01T19:56:11.517 INFO:teuthology.orchestra.run.smithi155.stdout: }, 2023-08-01T19:56:11.517 INFO:teuthology.orchestra.run.smithi155.stdout: { 2023-08-01T19:56:11.517 INFO:teuthology.orchestra.run.smithi155.stdout: "event": "all_read", 2023-08-01T19:56:11.517 INFO:teuthology.orchestra.run.smithi155.stdout: "time": "2023-08-01T19:55:05.576893+0000", 2023-08-01T19:56:11.517 INFO:teuthology.orchestra.run.smithi155.stdout: "duration": 5.3893000000000001e-05 2023-08-01T19:56:11.517 INFO:teuthology.orchestra.run.smithi155.stdout: }, 2023-08-01T19:56:11.518 INFO:teuthology.orchestra.run.smithi155.stdout: { 2023-08-01T19:56:11.518 INFO:teuthology.orchestra.run.smithi155.stdout: "event": "dispatched", 2023-08-01T19:56:11.518 INFO:teuthology.orchestra.run.smithi155.stdout: "time": "2023-08-01T19:55:05.576902+0000", 2023-08-01T19:56:11.518 INFO:teuthology.orchestra.run.smithi155.stdout: "duration": 8.7520000000000002e-06 2023-08-01T19:56:11.518 INFO:teuthology.orchestra.run.smithi155.stdout: }, 2023-08-01T19:56:11.518 INFO:teuthology.orchestra.run.smithi155.stdout: { 2023-08-01T19:56:11.518 INFO:teuthology.orchestra.run.smithi155.stdout: "event": "queued_for_pg", 2023-08-01T19:56:11.519 INFO:teuthology.orchestra.run.smithi155.stdout: "time": "2023-08-01T19:55:05.576905+0000", 2023-08-01T19:56:11.519 INFO:teuthology.orchestra.run.smithi155.stdout: "duration": 3.01e-06 2023-08-01T19:56:11.519 INFO:teuthology.orchestra.run.smithi155.stdout: }, 2023-08-01T19:56:11.519 INFO:teuthology.orchestra.run.smithi155.stdout: { 2023-08-01T19:56:11.519 INFO:teuthology.orchestra.run.smithi155.stdout: "event": "reached_pg", 2023-08-01T19:56:11.519 INFO:teuthology.orchestra.run.smithi155.stdout: "time": "2023-08-01T19:55:05.579641+0000", 2023-08-01T19:56:11.519 INFO:teuthology.orchestra.run.smithi155.stdout: "duration": 0.0027366880000000001 2023-08-01T19:56:11.519 INFO:teuthology.orchestra.run.smithi155.stdout: }, 2023-08-01T19:56:11.520 INFO:teuthology.orchestra.run.smithi155.stdout: { 2023-08-01T19:56:11.520 INFO:teuthology.orchestra.run.smithi155.stdout: "event": "started", 2023-08-01T19:56:11.520 INFO:teuthology.orchestra.run.smithi155.stdout: "time": "2023-08-01T19:55:05.579734+0000", 2023-08-01T19:56:11.520 INFO:teuthology.orchestra.run.smithi155.stdout: "duration": 9.2590000000000006e-05 2023-08-01T19:56:11.520 INFO:teuthology.orchestra.run.smithi155.stdout: }, 2023-08-01T19:56:11.520 INFO:teuthology.orchestra.run.smithi155.stdout: { 2023-08-01T19:56:11.520 INFO:teuthology.orchestra.run.smithi155.stdout: "event": "waiting for subops from 0", 2023-08-01T19:56:11.520 INFO:teuthology.orchestra.run.smithi155.stdout: "time": "2023-08-01T19:55:05.579825+0000", 2023-08-01T19:56:11.521 INFO:teuthology.orchestra.run.smithi155.stdout: "duration": 9.0964999999999994e-05 2023-08-01T19:56:11.521 INFO:teuthology.orchestra.run.smithi155.stdout: }, 2023-08-01T19:56:11.521 INFO:teuthology.orchestra.run.smithi155.stdout: { 2023-08-01T19:56:11.521 INFO:teuthology.orchestra.run.smithi155.stdout: "event": "op_commit", 2023-08-01T19:56:11.521 INFO:teuthology.orchestra.run.smithi155.stdout: "time": "2023-08-01T19:55:05.585041+0000", 2023-08-01T19:56:11.521 INFO:teuthology.orchestra.run.smithi155.stdout: "duration": 0.0052159670000000002 2023-08-01T19:56:11.521 INFO:teuthology.orchestra.run.smithi155.stdout: }, 2023-08-01T19:56:11.521 INFO:teuthology.orchestra.run.smithi155.stdout: { 2023-08-01T19:56:11.522 INFO:teuthology.orchestra.run.smithi155.stdout: "event": "sub_op_commit_rec", 2023-08-01T19:56:11.522 INFO:teuthology.orchestra.run.smithi155.stdout: "time": "2023-08-01T19:55:05.635199+0000", 2023-08-01T19:56:11.522 INFO:teuthology.orchestra.run.smithi155.stdout: "duration": 0.050158023000000003 2023-08-01T19:56:11.522 INFO:teuthology.orchestra.run.smithi155.stdout: }, 2023-08-01T19:56:11.522 INFO:teuthology.orchestra.run.smithi155.stdout: { 2023-08-01T19:56:11.522 INFO:teuthology.orchestra.run.smithi155.stdout: "event": "commit_sent", 2023-08-01T19:56:11.522 INFO:teuthology.orchestra.run.smithi155.stdout: "time": "2023-08-01T19:55:05.635227+0000", 2023-08-01T19:56:11.523 INFO:teuthology.orchestra.run.smithi155.stdout: "duration": 2.7821e-05 2023-08-01T19:56:11.523 INFO:teuthology.orchestra.run.smithi155.stdout: }, 2023-08-01T19:56:11.523 INFO:teuthology.orchestra.run.smithi155.stdout: { 2023-08-01T19:56:11.523 INFO:teuthology.orchestra.run.smithi155.stdout: "event": "done", 2023-08-01T19:56:11.523 INFO:teuthology.orchestra.run.smithi155.stdout: "time": "2023-08-01T19:55:05.635263+0000", 2023-08-01T19:56:11.523 INFO:teuthology.orchestra.run.smithi155.stdout: "duration": 3.6081000000000002e-05 2023-08-01T19:56:11.523 INFO:teuthology.orchestra.run.smithi155.stdout: } 2023-08-01T19:56:11.523 INFO:teuthology.orchestra.run.smithi155.stdout: ] 2023-08-01T19:56:11.524 INFO:teuthology.orchestra.run.smithi155.stdout: } 2023-08-01T19:56:11.524 INFO:teuthology.orchestra.run.smithi155.stdout: }, 2023-08-01T19:56:11.524 INFO:teuthology.orchestra.run.smithi155.stdout: { 2023-08-01T19:56:11.524 INFO:teuthology.orchestra.run.smithi155.stdout: "description": "osd_op(client.4668.0:197408 5.d 5:bbda375a:::benchmark_data_smithi006_114134_object63747:head [delete] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e61)", 2023-08-01T19:56:11.524 INFO:teuthology.orchestra.run.smithi155.stdout: "initiated_at": "2023-08-01T19:55:58.559714+0000", 2023-08-01T19:56:11.524 INFO:teuthology.orchestra.run.smithi155.stdout: "age": 12.802356679000001, 2023-08-01T19:56:11.524 INFO:teuthology.orchestra.run.smithi155.stdout: "duration": 1.047043671, 2023-08-01T19:56:11.525 INFO:teuthology.orchestra.run.smithi155.stdout: "type_data": { 2023-08-01T19:56:11.525 INFO:teuthology.orchestra.run.smithi155.stdout: "flag_point": "commit sent; apply or cleanup", 2023-08-01T19:56:11.525 INFO:teuthology.orchestra.run.smithi155.stdout: "client_info": { 2023-08-01T19:56:11.525 INFO:teuthology.orchestra.run.smithi155.stdout: "client": "client.4668", 2023-08-01T19:56:11.525 INFO:teuthology.orchestra.run.smithi155.stdout: "client_addr": "172.21.15.6:0/1709472247", 2023-08-01T19:56:11.525 INFO:teuthology.orchestra.run.smithi155.stdout: "tid": 197408 2023-08-01T19:56:11.525 INFO:teuthology.orchestra.run.smithi155.stdout: }, 2023-08-01T19:56:11.526 INFO:teuthology.orchestra.run.smithi155.stdout: "events": [ 2023-08-01T19:56:11.526 INFO:teuthology.orchestra.run.smithi155.stdout: { 2023-08-01T19:56:11.526 INFO:teuthology.orchestra.run.smithi155.stdout: "event": "initiated", 2023-08-01T19:56:11.526 INFO:teuthology.orchestra.run.smithi155.stdout: "time": "2023-08-01T19:55:58.559714+0000", 2023-08-01T19:56:11.526 INFO:teuthology.orchestra.run.smithi155.stdout: "duration": 0 2023-08-01T19:56:11.526 INFO:teuthology.orchestra.run.smithi155.stdout: }, 2023-08-01T19:56:11.526 INFO:teuthology.orchestra.run.smithi155.stdout: { 2023-08-01T19:56:11.526 INFO:teuthology.orchestra.run.smithi155.stdout: "event": "throttled", 2023-08-01T19:56:11.527 INFO:teuthology.orchestra.run.smithi155.stdout: "time": "2023-08-01T19:55:58.559714+0000", 2023-08-01T19:56:11.527 INFO:teuthology.orchestra.run.smithi155.stdout: "duration": 0 2023-08-01T19:56:11.527 INFO:teuthology.orchestra.run.smithi155.stdout: }, 2023-08-01T19:56:11.527 INFO:teuthology.orchestra.run.smithi155.stdout: { 2023-08-01T19:56:11.527 INFO:teuthology.orchestra.run.smithi155.stdout: "event": "header_read", 2023-08-01T19:56:11.527 INFO:teuthology.orchestra.run.smithi155.stdout: "time": "2023-08-01T19:55:58.559713+0000", 2023-08-01T19:56:11.527 INFO:teuthology.orchestra.run.smithi155.stdout: "duration": 4294967295.999999 2023-08-01T19:56:11.527 INFO:teuthology.orchestra.run.smithi155.stdout: }, 2023-08-01T19:56:11.528 INFO:teuthology.orchestra.run.smithi155.stdout: { 2023-08-01T19:56:11.528 INFO:teuthology.orchestra.run.smithi155.stdout: "event": "all_read", 2023-08-01T19:56:11.528 INFO:teuthology.orchestra.run.smithi155.stdout: "time": "2023-08-01T19:55:58.559717+0000", 2023-08-01T19:56:11.528 INFO:teuthology.orchestra.run.smithi155.stdout: "duration": 4.2860000000000001e-06 2023-08-01T19:56:11.528 INFO:teuthology.orchestra.run.smithi155.stdout: }, 2023-08-01T19:56:11.528 INFO:teuthology.orchestra.run.smithi155.stdout: { 2023-08-01T19:56:11.528 INFO:teuthology.orchestra.run.smithi155.stdout: "event": "dispatched", 2023-08-01T19:56:11.529 INFO:teuthology.orchestra.run.smithi155.stdout: "time": "2023-08-01T19:55:58.559774+0000", 2023-08-01T19:56:11.529 INFO:teuthology.orchestra.run.smithi155.stdout: "duration": 5.6508999999999997e-05 2023-08-01T19:56:11.529 INFO:teuthology.orchestra.run.smithi155.stdout: }, 2023-08-01T19:56:11.529 INFO:teuthology.orchestra.run.smithi155.stdout: { 2023-08-01T19:56:11.529 INFO:teuthology.orchestra.run.smithi155.stdout: "event": "queued_for_pg", 2023-08-01T19:56:11.529 INFO:teuthology.orchestra.run.smithi155.stdout: "time": "2023-08-01T19:55:58.559781+0000", 2023-08-01T19:56:11.529 INFO:teuthology.orchestra.run.smithi155.stdout: "duration": 7.1829999999999997e-06 2023-08-01T19:56:11.529 INFO:teuthology.orchestra.run.smithi155.stdout: }, 2023-08-01T19:56:11.530 INFO:teuthology.orchestra.run.smithi155.stdout: { 2023-08-01T19:56:11.530 INFO:teuthology.orchestra.run.smithi155.stdout: "event": "reached_pg", 2023-08-01T19:56:11.530 INFO:teuthology.orchestra.run.smithi155.stdout: "time": "2023-08-01T19:55:58.571621+0000", 2023-08-01T19:56:11.530 INFO:teuthology.orchestra.run.smithi155.stdout: "duration": 0.011840603999999999 2023-08-01T19:56:11.530 INFO:teuthology.orchestra.run.smithi155.stdout: }, 2023-08-01T19:56:11.530 INFO:teuthology.orchestra.run.smithi155.stdout: { 2023-08-01T19:56:11.530 INFO:teuthology.orchestra.run.smithi155.stdout: "event": "waiting for peered", 2023-08-01T19:56:11.530 INFO:teuthology.orchestra.run.smithi155.stdout: "time": "2023-08-01T19:55:58.571630+0000", 2023-08-01T19:56:11.531 INFO:teuthology.orchestra.run.smithi155.stdout: "duration": 8.9770000000000006e-06 2023-08-01T19:56:11.531 INFO:teuthology.orchestra.run.smithi155.stdout: }, 2023-08-01T19:56:11.531 INFO:teuthology.orchestra.run.smithi155.stdout: { 2023-08-01T19:56:11.531 INFO:teuthology.orchestra.run.smithi155.stdout: "event": "reached_pg", 2023-08-01T19:56:11.531 INFO:teuthology.orchestra.run.smithi155.stdout: "time": "2023-08-01T19:55:59.601300+0000", 2023-08-01T19:56:11.531 INFO:teuthology.orchestra.run.smithi155.stdout: "duration": 1.0296694989999999 2023-08-01T19:56:11.531 INFO:teuthology.orchestra.run.smithi155.stdout: }, 2023-08-01T19:56:11.531 INFO:teuthology.orchestra.run.smithi155.stdout: { 2023-08-01T19:56:11.532 INFO:teuthology.orchestra.run.smithi155.stdout: "event": "started", 2023-08-01T19:56:11.532 INFO:teuthology.orchestra.run.smithi155.stdout: "time": "2023-08-01T19:55:59.601448+0000", 2023-08-01T19:56:11.532 INFO:teuthology.orchestra.run.smithi155.stdout: "duration": 0.00014828399999999999 2023-08-01T19:56:11.532 INFO:teuthology.orchestra.run.smithi155.stdout: }, 2023-08-01T19:56:11.532 INFO:teuthology.orchestra.run.smithi155.stdout: { 2023-08-01T19:56:11.532 INFO:teuthology.orchestra.run.smithi155.stdout: "event": "op_commit", 2023-08-01T19:56:11.532 INFO:teuthology.orchestra.run.smithi155.stdout: "time": "2023-08-01T19:55:59.606616+0000", 2023-08-01T19:56:11.533 INFO:teuthology.orchestra.run.smithi155.stdout: "duration": 0.0051679769999999998 2023-08-01T19:56:11.533 INFO:teuthology.orchestra.run.smithi155.stdout: }, 2023-08-01T19:56:11.533 INFO:teuthology.orchestra.run.smithi155.stdout: { 2023-08-01T19:56:11.533 INFO:teuthology.orchestra.run.smithi155.stdout: "event": "commit_sent", 2023-08-01T19:56:11.533 INFO:teuthology.orchestra.run.smithi155.stdout: "time": "2023-08-01T19:55:59.606662+0000", 2023-08-01T19:56:11.533 INFO:teuthology.orchestra.run.smithi155.stdout: "duration": 4.5843000000000001e-05 2023-08-01T19:56:11.533 INFO:teuthology.orchestra.run.smithi155.stdout: }, 2023-08-01T19:56:11.533 INFO:teuthology.orchestra.run.smithi155.stdout: { 2023-08-01T19:56:11.534 INFO:teuthology.orchestra.run.smithi155.stdout: "event": "done", 2023-08-01T19:56:11.534 INFO:teuthology.orchestra.run.smithi155.stdout: "time": "2023-08-01T19:55:59.606757+0000", 2023-08-01T19:56:11.534 INFO:teuthology.orchestra.run.smithi155.stdout: "duration": 9.5373999999999999e-05 2023-08-01T19:56:11.534 INFO:teuthology.orchestra.run.smithi155.stdout: } 2023-08-01T19:56:11.534 INFO:teuthology.orchestra.run.smithi155.stdout: ] 2023-08-01T19:56:11.534 INFO:teuthology.orchestra.run.smithi155.stdout: } 2023-08-01T19:56:11.534 INFO:teuthology.orchestra.run.smithi155.stdout: }, 2023-08-01T19:56:11.534 INFO:teuthology.orchestra.run.smithi155.stdout: { 2023-08-01T19:56:11.535 INFO:teuthology.orchestra.run.smithi155.stdout: "description": "osd_op(client.4668.0:197416 5.d 5:bd99e66d:::benchmark_data_smithi006_114134_object63755:head [delete] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e62)", 2023-08-01T19:56:11.535 INFO:teuthology.orchestra.run.smithi155.stdout: "initiated_at": "2023-08-01T19:55:58.577369+0000", 2023-08-01T19:56:11.535 INFO:teuthology.orchestra.run.smithi155.stdout: "age": 12.784701702, 2023-08-01T19:56:11.535 INFO:teuthology.orchestra.run.smithi155.stdout: "duration": 1.0300980120000001, 2023-08-01T19:56:11.535 INFO:teuthology.orchestra.run.smithi155.stdout: "type_data": { 2023-08-01T19:56:11.535 INFO:teuthology.orchestra.run.smithi155.stdout: "flag_point": "commit sent; apply or cleanup", 2023-08-01T19:56:11.535 INFO:teuthology.orchestra.run.smithi155.stdout: "client_info": { 2023-08-01T19:56:11.536 INFO:teuthology.orchestra.run.smithi155.stdout: "client": "client.4668", 2023-08-01T19:56:11.536 INFO:teuthology.orchestra.run.smithi155.stdout: "client_addr": "172.21.15.6:0/1709472247", 2023-08-01T19:56:11.536 INFO:teuthology.orchestra.run.smithi155.stdout: "tid": 197416 2023-08-01T19:56:11.536 INFO:teuthology.orchestra.run.smithi155.stdout: }, 2023-08-01T19:56:11.536 INFO:teuthology.orchestra.run.smithi155.stdout: "events": [ 2023-08-01T19:56:11.536 INFO:teuthology.orchestra.run.smithi155.stdout: { 2023-08-01T19:56:11.536 INFO:teuthology.orchestra.run.smithi155.stdout: "event": "initiated", 2023-08-01T19:56:11.537 INFO:teuthology.orchestra.run.smithi155.stdout: "time": "2023-08-01T19:55:58.577369+0000", 2023-08-01T19:56:11.537 INFO:teuthology.orchestra.run.smithi155.stdout: "duration": 0 2023-08-01T19:56:11.537 INFO:teuthology.orchestra.run.smithi155.stdout: }, 2023-08-01T19:56:11.537 INFO:teuthology.orchestra.run.smithi155.stdout: { 2023-08-01T19:56:11.537 INFO:teuthology.orchestra.run.smithi155.stdout: "event": "throttled", 2023-08-01T19:56:11.537 INFO:teuthology.orchestra.run.smithi155.stdout: "time": "2023-08-01T19:55:58.577369+0000", 2023-08-01T19:56:11.537 INFO:teuthology.orchestra.run.smithi155.stdout: "duration": 0 2023-08-01T19:56:11.538 INFO:teuthology.orchestra.run.smithi155.stdout: }, 2023-08-01T19:56:11.538 INFO:teuthology.orchestra.run.smithi155.stdout: { 2023-08-01T19:56:11.538 INFO:teuthology.orchestra.run.smithi155.stdout: "event": "header_read", 2023-08-01T19:56:11.538 INFO:teuthology.orchestra.run.smithi155.stdout: "time": "2023-08-01T19:55:58.577368+0000", 2023-08-01T19:56:11.538 INFO:teuthology.orchestra.run.smithi155.stdout: "duration": 4294967295.9999995 2023-08-01T19:56:11.538 INFO:teuthology.orchestra.run.smithi155.stdout: }, 2023-08-01T19:56:11.538 INFO:teuthology.orchestra.run.smithi155.stdout: { 2023-08-01T19:56:11.538 INFO:teuthology.orchestra.run.smithi155.stdout: "event": "all_read", 2023-08-01T19:56:11.539 INFO:teuthology.orchestra.run.smithi155.stdout: "time": "2023-08-01T19:55:58.577370+0000", 2023-08-01T19:56:11.539 INFO:teuthology.orchestra.run.smithi155.stdout: "duration": 2.1150000000000001e-06 2023-08-01T19:56:11.539 INFO:teuthology.orchestra.run.smithi155.stdout: }, 2023-08-01T19:56:11.539 INFO:teuthology.orchestra.run.smithi155.stdout: { 2023-08-01T19:56:11.539 INFO:teuthology.orchestra.run.smithi155.stdout: "event": "dispatched", 2023-08-01T19:56:11.539 INFO:teuthology.orchestra.run.smithi155.stdout: "time": "2023-08-01T19:55:58.577377+0000", 2023-08-01T19:56:11.539 INFO:teuthology.orchestra.run.smithi155.stdout: "duration": 6.6610000000000003e-06 2023-08-01T19:56:11.539 INFO:teuthology.orchestra.run.smithi155.stdout: }, 2023-08-01T19:56:11.540 INFO:teuthology.orchestra.run.smithi155.stdout: { 2023-08-01T19:56:11.540 INFO:teuthology.orchestra.run.smithi155.stdout: "event": "queued_for_pg", 2023-08-01T19:56:11.540 INFO:teuthology.orchestra.run.smithi155.stdout: "time": "2023-08-01T19:55:58.577380+0000", 2023-08-01T19:56:11.540 INFO:teuthology.orchestra.run.smithi155.stdout: "duration": 2.7360000000000001e-06 2023-08-01T19:56:11.540 INFO:teuthology.orchestra.run.smithi155.stdout: }, 2023-08-01T19:56:11.540 INFO:teuthology.orchestra.run.smithi155.stdout: { 2023-08-01T19:56:11.540 INFO:teuthology.orchestra.run.smithi155.stdout: "event": "reached_pg", 2023-08-01T19:56:11.540 INFO:teuthology.orchestra.run.smithi155.stdout: "time": "2023-08-01T19:55:58.577405+0000", 2023-08-01T19:56:11.541 INFO:teuthology.orchestra.run.smithi155.stdout: "duration": 2.4929000000000001e-05 2023-08-01T19:56:11.541 INFO:teuthology.orchestra.run.smithi155.stdout: }, 2023-08-01T19:56:11.541 INFO:teuthology.orchestra.run.smithi155.stdout: { 2023-08-01T19:56:11.541 INFO:teuthology.orchestra.run.smithi155.stdout: "event": "waiting for peered", 2023-08-01T19:56:11.541 INFO:teuthology.orchestra.run.smithi155.stdout: "time": "2023-08-01T19:55:58.577409+0000", 2023-08-01T19:56:11.541 INFO:teuthology.orchestra.run.smithi155.stdout: "duration": 4.0799999999999999e-06 2023-08-01T19:56:11.541 INFO:teuthology.orchestra.run.smithi155.stdout: }, 2023-08-01T19:56:11.542 INFO:teuthology.orchestra.run.smithi155.stdout: { 2023-08-01T19:56:11.542 INFO:teuthology.orchestra.run.smithi155.stdout: "event": "reached_pg", 2023-08-01T19:56:11.542 INFO:teuthology.orchestra.run.smithi155.stdout: "time": "2023-08-01T19:55:59.603639+0000", 2023-08-01T19:56:11.542 INFO:teuthology.orchestra.run.smithi155.stdout: "duration": 1.0262299349999999 2023-08-01T19:56:11.542 INFO:teuthology.orchestra.run.smithi155.stdout: }, 2023-08-01T19:56:11.542 INFO:teuthology.orchestra.run.smithi155.stdout: { 2023-08-01T19:56:11.542 INFO:teuthology.orchestra.run.smithi155.stdout: "event": "started", 2023-08-01T19:56:11.542 INFO:teuthology.orchestra.run.smithi155.stdout: "time": "2023-08-01T19:55:59.603772+0000", 2023-08-01T19:56:11.543 INFO:teuthology.orchestra.run.smithi155.stdout: "duration": 0.000133153 2023-08-01T19:56:11.543 INFO:teuthology.orchestra.run.smithi155.stdout: }, 2023-08-01T19:56:11.543 INFO:teuthology.orchestra.run.smithi155.stdout: { 2023-08-01T19:56:11.543 INFO:teuthology.orchestra.run.smithi155.stdout: "event": "op_commit", 2023-08-01T19:56:11.543 INFO:teuthology.orchestra.run.smithi155.stdout: "time": "2023-08-01T19:55:59.607354+0000", 2023-08-01T19:56:11.543 INFO:teuthology.orchestra.run.smithi155.stdout: "duration": 0.0035819599999999999 2023-08-01T19:56:11.543 INFO:teuthology.orchestra.run.smithi155.stdout: }, 2023-08-01T19:56:11.543 INFO:teuthology.orchestra.run.smithi155.stdout: { 2023-08-01T19:56:11.544 INFO:teuthology.orchestra.run.smithi155.stdout: "event": "commit_sent", 2023-08-01T19:56:11.544 INFO:teuthology.orchestra.run.smithi155.stdout: "time": "2023-08-01T19:55:59.607396+0000", 2023-08-01T19:56:11.544 INFO:teuthology.orchestra.run.smithi155.stdout: "duration": 4.2423999999999999e-05 2023-08-01T19:56:11.544 INFO:teuthology.orchestra.run.smithi155.stdout: }, 2023-08-01T19:56:11.544 INFO:teuthology.orchestra.run.smithi155.stdout: { 2023-08-01T19:56:11.544 INFO:teuthology.orchestra.run.smithi155.stdout: "event": "done", 2023-08-01T19:56:11.544 INFO:teuthology.orchestra.run.smithi155.stdout: "time": "2023-08-01T19:55:59.607467+0000", 2023-08-01T19:56:11.545 INFO:teuthology.orchestra.run.smithi155.stdout: "duration": 7.0360999999999999e-05 2023-08-01T19:56:11.545 INFO:teuthology.orchestra.run.smithi155.stdout: } 2023-08-01T19:56:11.545 INFO:teuthology.orchestra.run.smithi155.stdout: ] 2023-08-01T19:56:11.545 INFO:teuthology.orchestra.run.smithi155.stdout: } 2023-08-01T19:56:11.545 INFO:teuthology.orchestra.run.smithi155.stdout: }, 2023-08-01T19:56:11.545 INFO:teuthology.orchestra.run.smithi155.stdout: { 2023-08-01T19:56:11.545 INFO:teuthology.orchestra.run.smithi155.stdout: "description": "osd_op(client.4668.0:197419 5.d 5:be7dc7c9:::benchmark_data_smithi006_114134_object63758:head [delete] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e62)", 2023-08-01T19:56:11.545 INFO:teuthology.orchestra.run.smithi155.stdout: "initiated_at": "2023-08-01T19:55:58.580223+0000", 2023-08-01T19:56:11.546 INFO:teuthology.orchestra.run.smithi155.stdout: "age": 12.781847751000001, 2023-08-01T19:56:11.546 INFO:teuthology.orchestra.run.smithi155.stdout: "duration": 1.0286139439999999, 2023-08-01T19:56:11.546 INFO:teuthology.orchestra.run.smithi155.stdout: "type_data": { 2023-08-01T19:56:11.546 INFO:teuthology.orchestra.run.smithi155.stdout: "flag_point": "commit sent; apply or cleanup", 2023-08-01T19:56:11.546 INFO:teuthology.orchestra.run.smithi155.stdout: "client_info": { 2023-08-01T19:56:11.546 INFO:teuthology.orchestra.run.smithi155.stdout: "client": "client.4668", 2023-08-01T19:56:11.546 INFO:teuthology.orchestra.run.smithi155.stdout: "client_addr": "172.21.15.6:0/1709472247", 2023-08-01T19:56:11.547 INFO:teuthology.orchestra.run.smithi155.stdout: "tid": 197419 2023-08-01T19:56:11.547 INFO:teuthology.orchestra.run.smithi155.stdout: }, 2023-08-01T19:56:11.547 INFO:teuthology.orchestra.run.smithi155.stdout: "events": [ 2023-08-01T19:56:11.547 INFO:teuthology.orchestra.run.smithi155.stdout: { 2023-08-01T19:56:11.547 INFO:teuthology.orchestra.run.smithi155.stdout: "event": "initiated", 2023-08-01T19:56:11.547 INFO:teuthology.orchestra.run.smithi155.stdout: "time": "2023-08-01T19:55:58.580223+0000", 2023-08-01T19:56:11.547 INFO:teuthology.orchestra.run.smithi155.stdout: "duration": 0 2023-08-01T19:56:11.547 INFO:teuthology.orchestra.run.smithi155.stdout: }, 2023-08-01T19:56:11.548 INFO:teuthology.orchestra.run.smithi155.stdout: { 2023-08-01T19:56:11.548 INFO:teuthology.orchestra.run.smithi155.stdout: "event": "throttled", 2023-08-01T19:56:11.548 INFO:teuthology.orchestra.run.smithi155.stdout: "time": "2023-08-01T19:55:58.580223+0000", 2023-08-01T19:56:11.548 INFO:teuthology.orchestra.run.smithi155.stdout: "duration": 0 2023-08-01T19:56:11.548 INFO:teuthology.orchestra.run.smithi155.stdout: }, 2023-08-01T19:56:11.548 INFO:teuthology.orchestra.run.smithi155.stdout: { 2023-08-01T19:56:11.548 INFO:teuthology.orchestra.run.smithi155.stdout: "event": "header_read", 2023-08-01T19:56:11.548 INFO:teuthology.orchestra.run.smithi155.stdout: "time": "2023-08-01T19:55:58.580222+0000", 2023-08-01T19:56:11.549 INFO:teuthology.orchestra.run.smithi155.stdout: "duration": 4294967295.9999995 2023-08-01T19:56:11.549 INFO:teuthology.orchestra.run.smithi155.stdout: }, 2023-08-01T19:56:11.549 INFO:teuthology.orchestra.run.smithi155.stdout: { 2023-08-01T19:56:11.549 INFO:teuthology.orchestra.run.smithi155.stdout: "event": "all_read", 2023-08-01T19:56:11.549 INFO:teuthology.orchestra.run.smithi155.stdout: "time": "2023-08-01T19:55:58.580225+0000", 2023-08-01T19:56:11.549 INFO:teuthology.orchestra.run.smithi155.stdout: "duration": 3.2820000000000001e-06 2023-08-01T19:56:11.549 INFO:teuthology.orchestra.run.smithi155.stdout: }, 2023-08-01T19:56:11.550 INFO:teuthology.orchestra.run.smithi155.stdout: { 2023-08-01T19:56:11.550 INFO:teuthology.orchestra.run.smithi155.stdout: "event": "dispatched", 2023-08-01T19:56:11.550 INFO:teuthology.orchestra.run.smithi155.stdout: "time": "2023-08-01T19:55:58.580233+0000", 2023-08-01T19:56:11.550 INFO:teuthology.orchestra.run.smithi155.stdout: "duration": 7.34e-06 2023-08-01T19:56:11.550 INFO:teuthology.orchestra.run.smithi155.stdout: }, 2023-08-01T19:56:11.550 INFO:teuthology.orchestra.run.smithi155.stdout: { 2023-08-01T19:56:11.550 INFO:teuthology.orchestra.run.smithi155.stdout: "event": "queued_for_pg", 2023-08-01T19:56:11.550 INFO:teuthology.orchestra.run.smithi155.stdout: "time": "2023-08-01T19:55:58.580236+0000", 2023-08-01T19:56:11.551 INFO:teuthology.orchestra.run.smithi155.stdout: "duration": 3.473e-06 2023-08-01T19:56:11.551 INFO:teuthology.orchestra.run.smithi155.stdout: }, 2023-08-01T19:56:11.551 INFO:teuthology.orchestra.run.smithi155.stdout: { 2023-08-01T19:56:11.551 INFO:teuthology.orchestra.run.smithi155.stdout: "event": "reached_pg", 2023-08-01T19:56:11.551 INFO:teuthology.orchestra.run.smithi155.stdout: "time": "2023-08-01T19:55:58.580267+0000", 2023-08-01T19:56:11.551 INFO:teuthology.orchestra.run.smithi155.stdout: "duration": 3.0479000000000001e-05 2023-08-01T19:56:11.551 INFO:teuthology.orchestra.run.smithi155.stdout: }, 2023-08-01T19:56:11.551 INFO:teuthology.orchestra.run.smithi155.stdout: { 2023-08-01T19:56:11.552 INFO:teuthology.orchestra.run.smithi155.stdout: "event": "waiting for peered", 2023-08-01T19:56:11.552 INFO:teuthology.orchestra.run.smithi155.stdout: "time": "2023-08-01T19:55:58.580272+0000", 2023-08-01T19:56:11.552 INFO:teuthology.orchestra.run.smithi155.stdout: "duration": 5.011e-06 2023-08-01T19:56:11.552 INFO:teuthology.orchestra.run.smithi155.stdout: }, 2023-08-01T19:56:11.552 INFO:teuthology.orchestra.run.smithi155.stdout: { 2023-08-01T19:56:11.552 INFO:teuthology.orchestra.run.smithi155.stdout: "event": "reached_pg", 2023-08-01T19:56:11.552 INFO:teuthology.orchestra.run.smithi155.stdout: "time": "2023-08-01T19:55:59.604970+0000", 2023-08-01T19:56:11.553 INFO:teuthology.orchestra.run.smithi155.stdout: "duration": 1.0246984189999999 2023-08-01T19:56:11.553 INFO:teuthology.orchestra.run.smithi155.stdout: }, 2023-08-01T19:56:11.553 INFO:teuthology.orchestra.run.smithi155.stdout: { 2023-08-01T19:56:11.553 INFO:teuthology.orchestra.run.smithi155.stdout: "event": "started", 2023-08-01T19:56:11.553 INFO:teuthology.orchestra.run.smithi155.stdout: "time": "2023-08-01T19:55:59.605085+0000", 2023-08-01T19:56:11.553 INFO:teuthology.orchestra.run.smithi155.stdout: "duration": 0.00011531000000000001 2023-08-01T19:56:11.553 INFO:teuthology.orchestra.run.smithi155.stdout: }, 2023-08-01T19:56:11.553 INFO:teuthology.orchestra.run.smithi155.stdout: { 2023-08-01T19:56:11.554 INFO:teuthology.orchestra.run.smithi155.stdout: "event": "op_commit", 2023-08-01T19:56:11.554 INFO:teuthology.orchestra.run.smithi155.stdout: "time": "2023-08-01T19:55:59.608733+0000", 2023-08-01T19:56:11.554 INFO:teuthology.orchestra.run.smithi155.stdout: "duration": 0.0036478090000000001 2023-08-01T19:56:11.554 INFO:teuthology.orchestra.run.smithi155.stdout: }, 2023-08-01T19:56:11.554 INFO:teuthology.orchestra.run.smithi155.stdout: { 2023-08-01T19:56:11.554 INFO:teuthology.orchestra.run.smithi155.stdout: "event": "commit_sent", 2023-08-01T19:56:11.554 INFO:teuthology.orchestra.run.smithi155.stdout: "time": "2023-08-01T19:55:59.608771+0000", 2023-08-01T19:56:11.554 INFO:teuthology.orchestra.run.smithi155.stdout: "duration": 3.8033e-05 2023-08-01T19:56:11.555 INFO:teuthology.orchestra.run.smithi155.stdout: }, 2023-08-01T19:56:11.555 INFO:teuthology.orchestra.run.smithi155.stdout: { 2023-08-01T19:56:11.555 INFO:teuthology.orchestra.run.smithi155.stdout: "event": "done", 2023-08-01T19:56:11.555 INFO:teuthology.orchestra.run.smithi155.stdout: "time": "2023-08-01T19:55:59.608837+0000", 2023-08-01T19:56:11.555 INFO:teuthology.orchestra.run.smithi155.stdout: "duration": 6.5364000000000006e-05 2023-08-01T19:56:11.555 INFO:teuthology.orchestra.run.smithi155.stdout: } 2023-08-01T19:56:11.555 INFO:teuthology.orchestra.run.smithi155.stdout: ] 2023-08-01T19:56:11.555 INFO:teuthology.orchestra.run.smithi155.stdout: } 2023-08-01T19:56:11.556 INFO:teuthology.orchestra.run.smithi155.stdout: }, 2023-08-01T19:56:11.556 INFO:teuthology.orchestra.run.smithi155.stdout: { 2023-08-01T19:56:11.556 INFO:teuthology.orchestra.run.smithi155.stdout: "description": "osd_op(client.4668.0:197420 5.9 5:92a2efe5:::benchmark_data_smithi006_114134_object63759:head [delete] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e62)", 2023-08-01T19:56:11.556 INFO:teuthology.orchestra.run.smithi155.stdout: "initiated_at": "2023-08-01T19:55:58.582230+0000", 2023-08-01T19:56:11.556 INFO:teuthology.orchestra.run.smithi155.stdout: "age": 12.779840440999999, 2023-08-01T19:56:11.556 INFO:teuthology.orchestra.run.smithi155.stdout: "duration": 1.0095353739999999, 2023-08-01T19:56:11.556 INFO:teuthology.orchestra.run.smithi155.stdout: "type_data": { 2023-08-01T19:56:11.557 INFO:teuthology.orchestra.run.smithi155.stdout: "flag_point": "commit sent; apply or cleanup", 2023-08-01T19:56:11.557 INFO:teuthology.orchestra.run.smithi155.stdout: "client_info": { 2023-08-01T19:56:11.557 INFO:teuthology.orchestra.run.smithi155.stdout: "client": "client.4668", 2023-08-01T19:56:11.557 INFO:teuthology.orchestra.run.smithi155.stdout: "client_addr": "172.21.15.6:0/1709472247", 2023-08-01T19:56:11.557 INFO:teuthology.orchestra.run.smithi155.stdout: "tid": 197420 2023-08-01T19:56:11.557 INFO:teuthology.orchestra.run.smithi155.stdout: }, 2023-08-01T19:56:11.557 INFO:teuthology.orchestra.run.smithi155.stdout: "events": [ 2023-08-01T19:56:11.557 INFO:teuthology.orchestra.run.smithi155.stdout: { 2023-08-01T19:56:11.558 INFO:teuthology.orchestra.run.smithi155.stdout: "event": "initiated", 2023-08-01T19:56:11.558 INFO:teuthology.orchestra.run.smithi155.stdout: "time": "2023-08-01T19:55:58.582230+0000", 2023-08-01T19:56:11.558 INFO:teuthology.orchestra.run.smithi155.stdout: "duration": 0 2023-08-01T19:56:11.558 INFO:teuthology.orchestra.run.smithi155.stdout: }, 2023-08-01T19:56:11.558 INFO:teuthology.orchestra.run.smithi155.stdout: { 2023-08-01T19:56:11.558 INFO:teuthology.orchestra.run.smithi155.stdout: "event": "throttled", 2023-08-01T19:56:11.558 INFO:teuthology.orchestra.run.smithi155.stdout: "time": "2023-08-01T19:55:58.582230+0000", 2023-08-01T19:56:11.559 INFO:teuthology.orchestra.run.smithi155.stdout: "duration": 0 2023-08-01T19:56:11.559 INFO:teuthology.orchestra.run.smithi155.stdout: }, 2023-08-01T19:56:11.559 INFO:teuthology.orchestra.run.smithi155.stdout: { 2023-08-01T19:56:11.559 INFO:teuthology.orchestra.run.smithi155.stdout: "event": "header_read", 2023-08-01T19:56:11.559 INFO:teuthology.orchestra.run.smithi155.stdout: "time": "2023-08-01T19:55:58.582229+0000", 2023-08-01T19:56:11.559 INFO:teuthology.orchestra.run.smithi155.stdout: "duration": 4294967295.9999995 2023-08-01T19:56:11.559 INFO:teuthology.orchestra.run.smithi155.stdout: }, 2023-08-01T19:56:11.559 INFO:teuthology.orchestra.run.smithi155.stdout: { 2023-08-01T19:56:11.560 INFO:teuthology.orchestra.run.smithi155.stdout: "event": "all_read", 2023-08-01T19:56:11.560 INFO:teuthology.orchestra.run.smithi155.stdout: "time": "2023-08-01T19:55:58.582233+0000", 2023-08-01T19:56:11.560 INFO:teuthology.orchestra.run.smithi155.stdout: "duration": 3.7869999999999999e-06 2023-08-01T19:56:11.560 INFO:teuthology.orchestra.run.smithi155.stdout: }, 2023-08-01T19:56:11.560 INFO:teuthology.orchestra.run.smithi155.stdout: { 2023-08-01T19:56:11.560 INFO:teuthology.orchestra.run.smithi155.stdout: "event": "dispatched", 2023-08-01T19:56:11.560 INFO:teuthology.orchestra.run.smithi155.stdout: "time": "2023-08-01T19:55:58.582241+0000", 2023-08-01T19:56:11.561 INFO:teuthology.orchestra.run.smithi155.stdout: "duration": 7.6909999999999997e-06 2023-08-01T19:56:11.561 INFO:teuthology.orchestra.run.smithi155.stdout: }, 2023-08-01T19:56:11.561 INFO:teuthology.orchestra.run.smithi155.stdout: { 2023-08-01T19:56:11.561 INFO:teuthology.orchestra.run.smithi155.stdout: "event": "queued_for_pg", 2023-08-01T19:56:11.561 INFO:teuthology.orchestra.run.smithi155.stdout: "time": "2023-08-01T19:55:58.582244+0000", 2023-08-01T19:56:11.561 INFO:teuthology.orchestra.run.smithi155.stdout: "duration": 3.6770000000000001e-06 2023-08-01T19:56:11.561 INFO:teuthology.orchestra.run.smithi155.stdout: }, 2023-08-01T19:56:11.561 INFO:teuthology.orchestra.run.smithi155.stdout: { 2023-08-01T19:56:11.562 INFO:teuthology.orchestra.run.smithi155.stdout: "event": "reached_pg", 2023-08-01T19:56:11.562 INFO:teuthology.orchestra.run.smithi155.stdout: "time": "2023-08-01T19:55:58.582274+0000", 2023-08-01T19:56:11.562 INFO:teuthology.orchestra.run.smithi155.stdout: "duration": 3.0074e-05 2023-08-01T19:56:11.562 INFO:teuthology.orchestra.run.smithi155.stdout: }, 2023-08-01T19:56:11.562 INFO:teuthology.orchestra.run.smithi155.stdout: { 2023-08-01T19:56:11.562 INFO:teuthology.orchestra.run.smithi155.stdout: "event": "waiting for peered", 2023-08-01T19:56:11.562 INFO:teuthology.orchestra.run.smithi155.stdout: "time": "2023-08-01T19:55:58.582281+0000", 2023-08-01T19:56:11.563 INFO:teuthology.orchestra.run.smithi155.stdout: "duration": 6.297e-06 2023-08-01T19:56:11.563 INFO:teuthology.orchestra.run.smithi155.stdout: }, 2023-08-01T19:56:11.563 INFO:teuthology.orchestra.run.smithi155.stdout: { 2023-08-01T19:56:11.563 INFO:teuthology.orchestra.run.smithi155.stdout: "event": "reached_pg", 2023-08-01T19:56:11.563 INFO:teuthology.orchestra.run.smithi155.stdout: "time": "2023-08-01T19:55:59.586809+0000", 2023-08-01T19:56:11.563 INFO:teuthology.orchestra.run.smithi155.stdout: "duration": 1.0045281720000001 2023-08-01T19:56:11.563 INFO:teuthology.orchestra.run.smithi155.stdout: }, 2023-08-01T19:56:11.564 INFO:teuthology.orchestra.run.smithi155.stdout: { 2023-08-01T19:56:11.564 INFO:teuthology.orchestra.run.smithi155.stdout: "event": "started", 2023-08-01T19:56:11.564 INFO:teuthology.orchestra.run.smithi155.stdout: "time": "2023-08-01T19:55:59.586910+0000", 2023-08-01T19:56:11.564 INFO:teuthology.orchestra.run.smithi155.stdout: "duration": 0.000100898 2023-08-01T19:56:11.564 INFO:teuthology.orchestra.run.smithi155.stdout: }, 2023-08-01T19:56:11.564 INFO:teuthology.orchestra.run.smithi155.stdout: { 2023-08-01T19:56:11.564 INFO:teuthology.orchestra.run.smithi155.stdout: "event": "op_commit", 2023-08-01T19:56:11.565 INFO:teuthology.orchestra.run.smithi155.stdout: "time": "2023-08-01T19:55:59.591679+0000", 2023-08-01T19:56:11.565 INFO:teuthology.orchestra.run.smithi155.stdout: "duration": 0.004769471 2023-08-01T19:56:11.565 INFO:teuthology.orchestra.run.smithi155.stdout: }, 2023-08-01T19:56:11.565 INFO:teuthology.orchestra.run.smithi155.stdout: { 2023-08-01T19:56:11.565 INFO:teuthology.orchestra.run.smithi155.stdout: "event": "commit_sent", 2023-08-01T19:56:11.565 INFO:teuthology.orchestra.run.smithi155.stdout: "time": "2023-08-01T19:55:59.591721+0000", 2023-08-01T19:56:11.565 INFO:teuthology.orchestra.run.smithi155.stdout: "duration": 4.1953000000000003e-05 2023-08-01T19:56:11.565 INFO:teuthology.orchestra.run.smithi155.stdout: }, 2023-08-01T19:56:11.566 INFO:teuthology.orchestra.run.smithi155.stdout: { 2023-08-01T19:56:11.566 INFO:teuthology.orchestra.run.smithi155.stdout: "event": "done", 2023-08-01T19:56:11.566 INFO:teuthology.orchestra.run.smithi155.stdout: "time": "2023-08-01T19:55:59.591765+0000", 2023-08-01T19:56:11.566 INFO:teuthology.orchestra.run.smithi155.stdout: "duration": 4.4030999999999999e-05 2023-08-01T19:56:11.566 INFO:teuthology.orchestra.run.smithi155.stdout: } 2023-08-01T19:56:11.566 INFO:teuthology.orchestra.run.smithi155.stdout: ] 2023-08-01T19:56:11.566 INFO:teuthology.orchestra.run.smithi155.stdout: } 2023-08-01T19:56:11.567 INFO:teuthology.orchestra.run.smithi155.stdout: } 2023-08-01T19:56:11.567 INFO:teuthology.orchestra.run.smithi155.stdout: ] 2023-08-01T19:56:11.567 INFO:teuthology.orchestra.run.smithi155.stdout:} 2023-08-01T19:56:11.568 INFO:tasks.ceph.osd.2.smithi155.stderr:2023-08-01T19:56:11.567+0000 7faa5c6ac700 -1 received signal: Hangup from /usr/bin/python3 /bin/daemon-helper kill ceph-osd -f --cluster ceph -i 2 (PID: 111337) UID: 0 2023-08-01T19:56:11.569 DEBUG:teuthology.orchestra.run.smithi008:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 30 ceph --cluster ceph --admin-daemon /var/run/ceph/ceph-osd.0.asok dump_ops_in_flight 2023-08-01T19:56:11.669 INFO:tasks.ceph.osd.2.smithi155.stderr:2023-08-01T19:56:11.668+0000 7faa5c6ac700 -1 received signal: Hangup from /usr/bin/python3 /bin/daemon-helper kill ceph-osd -f --cluster ceph -i 2 (PID: 111337) UID: 0 2023-08-01T19:56:11.769 INFO:teuthology.orchestra.run.smithi008.stdout:{ 2023-08-01T19:56:11.769 INFO:teuthology.orchestra.run.smithi008.stdout: "ops": [ 2023-08-01T19:56:11.770 INFO:teuthology.orchestra.run.smithi008.stdout: { 2023-08-01T19:56:11.770 INFO:teuthology.orchestra.run.smithi008.stdout: "description": "osd_op(client.4668.0:222503 5.6 5:6a554b75:::benchmark_data_smithi006_114134_object88842:head [delete] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e67)", 2023-08-01T19:56:11.770 INFO:teuthology.orchestra.run.smithi008.stdout: "initiated_at": "2023-08-01T19:56:11.754182+0000", 2023-08-01T19:56:11.770 INFO:teuthology.orchestra.run.smithi008.stdout: "age": 0.0077957900000000004, 2023-08-01T19:56:11.770 INFO:teuthology.orchestra.run.smithi008.stdout: "duration": 0.0078277750000000004, 2023-08-01T19:56:11.770 INFO:teuthology.orchestra.run.smithi008.stdout: "type_data": { 2023-08-01T19:56:11.770 INFO:teuthology.orchestra.run.smithi008.stdout: "flag_point": "started", 2023-08-01T19:56:11.771 INFO:teuthology.orchestra.run.smithi008.stdout: "client_info": { 2023-08-01T19:56:11.771 INFO:teuthology.orchestra.run.smithi008.stdout: "client": "client.4668", 2023-08-01T19:56:11.771 INFO:teuthology.orchestra.run.smithi008.stdout: "client_addr": "172.21.15.6:0/1709472247", 2023-08-01T19:56:11.771 INFO:teuthology.orchestra.run.smithi008.stdout: "tid": 222503 2023-08-01T19:56:11.771 INFO:teuthology.orchestra.run.smithi008.stdout: }, 2023-08-01T19:56:11.771 INFO:teuthology.orchestra.run.smithi008.stdout: "events": [ 2023-08-01T19:56:11.771 INFO:teuthology.orchestra.run.smithi008.stdout: { 2023-08-01T19:56:11.771 INFO:teuthology.orchestra.run.smithi008.stdout: "event": "initiated", 2023-08-01T19:56:11.772 INFO:teuthology.orchestra.run.smithi008.stdout: "time": "2023-08-01T19:56:11.754182+0000", 2023-08-01T19:56:11.772 INFO:teuthology.orchestra.run.smithi008.stdout: "duration": 0 2023-08-01T19:56:11.772 INFO:teuthology.orchestra.run.smithi008.stdout: }, 2023-08-01T19:56:11.772 INFO:teuthology.orchestra.run.smithi008.stdout: { 2023-08-01T19:56:11.772 INFO:teuthology.orchestra.run.smithi008.stdout: "event": "throttled", 2023-08-01T19:56:11.773 INFO:teuthology.orchestra.run.smithi008.stdout: "time": "2023-08-01T19:56:11.754182+0000", 2023-08-01T19:56:11.773 INFO:teuthology.orchestra.run.smithi008.stdout: "duration": 0 2023-08-01T19:56:11.773 INFO:teuthology.orchestra.run.smithi008.stdout: }, 2023-08-01T19:56:11.773 INFO:teuthology.orchestra.run.smithi008.stdout: { 2023-08-01T19:56:11.773 INFO:teuthology.orchestra.run.smithi008.stdout: "event": "header_read", 2023-08-01T19:56:11.773 INFO:teuthology.orchestra.run.smithi008.stdout: "time": "2023-08-01T19:56:11.754181+0000", 2023-08-01T19:56:11.773 INFO:teuthology.orchestra.run.smithi008.stdout: "duration": 4294967295.999999 2023-08-01T19:56:11.774 INFO:teuthology.orchestra.run.smithi008.stdout: }, 2023-08-01T19:56:11.774 INFO:teuthology.orchestra.run.smithi008.stdout: { 2023-08-01T19:56:11.774 INFO:teuthology.orchestra.run.smithi008.stdout: "event": "all_read", 2023-08-01T19:56:11.774 INFO:teuthology.orchestra.run.smithi008.stdout: "time": "2023-08-01T19:56:11.754186+0000", 2023-08-01T19:56:11.774 INFO:teuthology.orchestra.run.smithi008.stdout: "duration": 5.1399999999999999e-06 2023-08-01T19:56:11.774 INFO:teuthology.orchestra.run.smithi008.stdout: }, 2023-08-01T19:56:11.774 INFO:teuthology.orchestra.run.smithi008.stdout: { 2023-08-01T19:56:11.774 INFO:teuthology.orchestra.run.smithi008.stdout: "event": "dispatched", 2023-08-01T19:56:11.775 INFO:teuthology.orchestra.run.smithi008.stdout: "time": "2023-08-01T19:56:11.754192+0000", 2023-08-01T19:56:11.775 INFO:teuthology.orchestra.run.smithi008.stdout: "duration": 6.3690000000000003e-06 2023-08-01T19:56:11.775 INFO:teuthology.orchestra.run.smithi008.stdout: }, 2023-08-01T19:56:11.775 INFO:teuthology.orchestra.run.smithi008.stdout: { 2023-08-01T19:56:11.775 INFO:teuthology.orchestra.run.smithi008.stdout: "event": "queued_for_pg", 2023-08-01T19:56:11.776 INFO:teuthology.orchestra.run.smithi008.stdout: "time": "2023-08-01T19:56:11.754196+0000", 2023-08-01T19:56:11.776 INFO:teuthology.orchestra.run.smithi008.stdout: "duration": 4.1540000000000004e-06 2023-08-01T19:56:11.776 INFO:teuthology.orchestra.run.smithi008.stdout: }, 2023-08-01T19:56:11.776 INFO:teuthology.orchestra.run.smithi008.stdout: { 2023-08-01T19:56:11.776 INFO:teuthology.orchestra.run.smithi008.stdout: "event": "reached_pg", 2023-08-01T19:56:11.776 INFO:teuthology.orchestra.run.smithi008.stdout: "time": "2023-08-01T19:56:11.754229+0000", 2023-08-01T19:56:11.776 INFO:teuthology.orchestra.run.smithi008.stdout: "duration": 3.2904000000000002e-05 2023-08-01T19:56:11.777 INFO:teuthology.orchestra.run.smithi008.stdout: }, 2023-08-01T19:56:11.777 INFO:teuthology.orchestra.run.smithi008.stdout: { 2023-08-01T19:56:11.777 INFO:teuthology.orchestra.run.smithi008.stdout: "event": "started", 2023-08-01T19:56:11.777 INFO:teuthology.orchestra.run.smithi008.stdout: "time": "2023-08-01T19:56:11.754329+0000", 2023-08-01T19:56:11.777 INFO:teuthology.orchestra.run.smithi008.stdout: "duration": 9.9871999999999995e-05 2023-08-01T19:56:11.777 INFO:teuthology.orchestra.run.smithi008.stdout: } 2023-08-01T19:56:11.777 INFO:teuthology.orchestra.run.smithi008.stdout: ] 2023-08-01T19:56:11.778 INFO:teuthology.orchestra.run.smithi008.stdout: } 2023-08-01T19:56:11.778 INFO:teuthology.orchestra.run.smithi008.stdout: }, 2023-08-01T19:56:11.778 INFO:teuthology.orchestra.run.smithi008.stdout: { 2023-08-01T19:56:11.778 INFO:teuthology.orchestra.run.smithi008.stdout: "description": "osd_op(client.4668.0:222504 5.7 5:e3f58663:::benchmark_data_smithi006_114134_object88843:head [delete] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e67)", 2023-08-01T19:56:11.778 INFO:teuthology.orchestra.run.smithi008.stdout: "initiated_at": "2023-08-01T19:56:11.754309+0000", 2023-08-01T19:56:11.778 INFO:teuthology.orchestra.run.smithi008.stdout: "age": 0.0076687320000000002, 2023-08-01T19:56:11.778 INFO:teuthology.orchestra.run.smithi008.stdout: "duration": 0.0077635969999999997, 2023-08-01T19:56:11.779 INFO:teuthology.orchestra.run.smithi008.stdout: "type_data": { 2023-08-01T19:56:11.779 INFO:teuthology.orchestra.run.smithi008.stdout: "flag_point": "started", 2023-08-01T19:56:11.779 INFO:teuthology.orchestra.run.smithi008.stdout: "client_info": { 2023-08-01T19:56:11.779 INFO:teuthology.orchestra.run.smithi008.stdout: "client": "client.4668", 2023-08-01T19:56:11.779 INFO:teuthology.orchestra.run.smithi008.stdout: "client_addr": "172.21.15.6:0/1709472247", 2023-08-01T19:56:11.779 INFO:teuthology.orchestra.run.smithi008.stdout: "tid": 222504 2023-08-01T19:56:11.779 INFO:teuthology.orchestra.run.smithi008.stdout: }, 2023-08-01T19:56:11.779 INFO:teuthology.orchestra.run.smithi008.stdout: "events": [ 2023-08-01T19:56:11.780 INFO:teuthology.orchestra.run.smithi008.stdout: { 2023-08-01T19:56:11.780 INFO:teuthology.orchestra.run.smithi008.stdout: "event": "initiated", 2023-08-01T19:56:11.780 INFO:teuthology.orchestra.run.smithi008.stdout: "time": "2023-08-01T19:56:11.754309+0000", 2023-08-01T19:56:11.780 INFO:teuthology.orchestra.run.smithi008.stdout: "duration": 0 2023-08-01T19:56:11.780 INFO:teuthology.orchestra.run.smithi008.stdout: }, 2023-08-01T19:56:11.780 INFO:teuthology.orchestra.run.smithi008.stdout: { 2023-08-01T19:56:11.781 INFO:teuthology.orchestra.run.smithi008.stdout: "event": "throttled", 2023-08-01T19:56:11.781 INFO:teuthology.orchestra.run.smithi008.stdout: "time": "2023-08-01T19:56:11.754309+0000", 2023-08-01T19:56:11.781 INFO:teuthology.orchestra.run.smithi008.stdout: "duration": 0 2023-08-01T19:56:11.781 INFO:teuthology.orchestra.run.smithi008.stdout: }, 2023-08-01T19:56:11.781 INFO:teuthology.orchestra.run.smithi008.stdout: { 2023-08-01T19:56:11.781 INFO:teuthology.orchestra.run.smithi008.stdout: "event": "header_read", 2023-08-01T19:56:11.781 INFO:teuthology.orchestra.run.smithi008.stdout: "time": "2023-08-01T19:56:11.754308+0000", 2023-08-01T19:56:11.781 INFO:teuthology.orchestra.run.smithi008.stdout: "duration": 4294967295.999999 2023-08-01T19:56:11.782 INFO:teuthology.orchestra.run.smithi008.stdout: }, 2023-08-01T19:56:11.782 INFO:teuthology.orchestra.run.smithi008.stdout: { 2023-08-01T19:56:11.782 INFO:teuthology.orchestra.run.smithi008.stdout: "event": "all_read", 2023-08-01T19:56:11.782 INFO:teuthology.orchestra.run.smithi008.stdout: "time": "2023-08-01T19:56:11.754312+0000", 2023-08-01T19:56:11.782 INFO:teuthology.orchestra.run.smithi008.stdout: "duration": 4.4730000000000002e-06 2023-08-01T19:56:11.782 INFO:teuthology.orchestra.run.smithi008.stdout: }, 2023-08-01T19:56:11.782 INFO:teuthology.orchestra.run.smithi008.stdout: { 2023-08-01T19:56:11.783 INFO:teuthology.orchestra.run.smithi008.stdout: "event": "dispatched", 2023-08-01T19:56:11.783 INFO:teuthology.orchestra.run.smithi008.stdout: "time": "2023-08-01T19:56:11.754323+0000", 2023-08-01T19:56:11.783 INFO:teuthology.orchestra.run.smithi008.stdout: "duration": 1.0389e-05 2023-08-01T19:56:11.783 INFO:teuthology.orchestra.run.smithi008.stdout: }, 2023-08-01T19:56:11.783 INFO:teuthology.orchestra.run.smithi008.stdout: { 2023-08-01T19:56:11.783 INFO:teuthology.orchestra.run.smithi008.stdout: "event": "queued_for_pg", 2023-08-01T19:56:11.784 INFO:teuthology.orchestra.run.smithi008.stdout: "time": "2023-08-01T19:56:11.754328+0000", 2023-08-01T19:56:11.784 INFO:teuthology.orchestra.run.smithi008.stdout: "duration": 5.4820000000000002e-06 2023-08-01T19:56:11.784 INFO:teuthology.orchestra.run.smithi008.stdout: }, 2023-08-01T19:56:11.784 INFO:teuthology.orchestra.run.smithi008.stdout: { 2023-08-01T19:56:11.784 INFO:teuthology.orchestra.run.smithi008.stdout: "event": "reached_pg", 2023-08-01T19:56:11.784 INFO:teuthology.orchestra.run.smithi008.stdout: "time": "2023-08-01T19:56:11.754369+0000", 2023-08-01T19:56:11.784 INFO:teuthology.orchestra.run.smithi008.stdout: "duration": 4.0549000000000001e-05 2023-08-01T19:56:11.785 INFO:teuthology.orchestra.run.smithi008.stdout: }, 2023-08-01T19:56:11.785 INFO:teuthology.orchestra.run.smithi008.stdout: { 2023-08-01T19:56:11.785 INFO:teuthology.orchestra.run.smithi008.stdout: "event": "started", 2023-08-01T19:56:11.785 INFO:teuthology.orchestra.run.smithi008.stdout: "time": "2023-08-01T19:56:11.754456+0000", 2023-08-01T19:56:11.785 INFO:teuthology.orchestra.run.smithi008.stdout: "duration": 8.7869999999999997e-05 2023-08-01T19:56:11.785 INFO:teuthology.orchestra.run.smithi008.stdout: } 2023-08-01T19:56:11.785 INFO:teuthology.orchestra.run.smithi008.stdout: ] 2023-08-01T19:56:11.786 INFO:teuthology.orchestra.run.smithi008.stdout: } 2023-08-01T19:56:11.786 INFO:teuthology.orchestra.run.smithi008.stdout: }, 2023-08-01T19:56:11.786 INFO:teuthology.orchestra.run.smithi008.stdout: { 2023-08-01T19:56:11.786 INFO:teuthology.orchestra.run.smithi008.stdout: "description": "osd_op(client.4668.0:222506 5.3 5:c5beda33:::benchmark_data_smithi006_114134_object88845:head [delete] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e67)", 2023-08-01T19:56:11.786 INFO:teuthology.orchestra.run.smithi008.stdout: "initiated_at": "2023-08-01T19:56:11.754393+0000", 2023-08-01T19:56:11.786 INFO:teuthology.orchestra.run.smithi008.stdout: "age": 0.0075840550000000001, 2023-08-01T19:56:11.786 INFO:teuthology.orchestra.run.smithi008.stdout: "duration": 0.0077217190000000002, 2023-08-01T19:56:11.787 INFO:teuthology.orchestra.run.smithi008.stdout: "type_data": { 2023-08-01T19:56:11.787 INFO:teuthology.orchestra.run.smithi008.stdout: "flag_point": "started", 2023-08-01T19:56:11.787 INFO:teuthology.orchestra.run.smithi008.stdout: "client_info": { 2023-08-01T19:56:11.787 INFO:teuthology.orchestra.run.smithi008.stdout: "client": "client.4668", 2023-08-01T19:56:11.787 INFO:teuthology.orchestra.run.smithi008.stdout: "client_addr": "172.21.15.6:0/1709472247", 2023-08-01T19:56:11.787 INFO:teuthology.orchestra.run.smithi008.stdout: "tid": 222506 2023-08-01T19:56:11.787 INFO:teuthology.orchestra.run.smithi008.stdout: }, 2023-08-01T19:56:11.787 INFO:teuthology.orchestra.run.smithi008.stdout: "events": [ 2023-08-01T19:56:11.788 INFO:teuthology.orchestra.run.smithi008.stdout: { 2023-08-01T19:56:11.788 INFO:teuthology.orchestra.run.smithi008.stdout: "event": "initiated", 2023-08-01T19:56:11.788 INFO:teuthology.orchestra.run.smithi008.stdout: "time": "2023-08-01T19:56:11.754393+0000", 2023-08-01T19:56:11.788 INFO:teuthology.orchestra.run.smithi008.stdout: "duration": 0 2023-08-01T19:56:11.788 INFO:teuthology.orchestra.run.smithi008.stdout: }, 2023-08-01T19:56:11.788 INFO:teuthology.orchestra.run.smithi008.stdout: { 2023-08-01T19:56:11.788 INFO:teuthology.orchestra.run.smithi008.stdout: "event": "throttled", 2023-08-01T19:56:11.788 INFO:teuthology.orchestra.run.smithi008.stdout: "time": "2023-08-01T19:56:11.754393+0000", 2023-08-01T19:56:11.789 INFO:teuthology.orchestra.run.smithi008.stdout: "duration": 0 2023-08-01T19:56:11.789 INFO:teuthology.orchestra.run.smithi008.stdout: }, 2023-08-01T19:56:11.789 INFO:teuthology.orchestra.run.smithi008.stdout: { 2023-08-01T19:56:11.789 INFO:teuthology.orchestra.run.smithi008.stdout: "event": "header_read", 2023-08-01T19:56:11.789 INFO:teuthology.orchestra.run.smithi008.stdout: "time": "2023-08-01T19:56:11.754392+0000", 2023-08-01T19:56:11.789 INFO:teuthology.orchestra.run.smithi008.stdout: "duration": 4294967295.999999 2023-08-01T19:56:11.789 INFO:teuthology.orchestra.run.smithi008.stdout: }, 2023-08-01T19:56:11.789 INFO:teuthology.orchestra.run.smithi008.stdout: { 2023-08-01T19:56:11.790 INFO:teuthology.orchestra.run.smithi008.stdout: "event": "all_read", 2023-08-01T19:56:11.790 INFO:teuthology.orchestra.run.smithi008.stdout: "time": "2023-08-01T19:56:11.754397+0000", 2023-08-01T19:56:11.790 INFO:teuthology.orchestra.run.smithi008.stdout: "duration": 4.4789999999999998e-06 2023-08-01T19:56:11.790 INFO:teuthology.orchestra.run.smithi008.stdout: }, 2023-08-01T19:56:11.790 INFO:teuthology.orchestra.run.smithi008.stdout: { 2023-08-01T19:56:11.790 INFO:teuthology.orchestra.run.smithi008.stdout: "event": "dispatched", 2023-08-01T19:56:11.790 INFO:teuthology.orchestra.run.smithi008.stdout: "time": "2023-08-01T19:56:11.754406+0000", 2023-08-01T19:56:11.791 INFO:teuthology.orchestra.run.smithi008.stdout: "duration": 9.38e-06 2023-08-01T19:56:11.791 INFO:teuthology.orchestra.run.smithi008.stdout: }, 2023-08-01T19:56:11.791 INFO:teuthology.orchestra.run.smithi008.stdout: { 2023-08-01T19:56:11.791 INFO:teuthology.orchestra.run.smithi008.stdout: "event": "queued_for_pg", 2023-08-01T19:56:11.791 INFO:teuthology.orchestra.run.smithi008.stdout: "time": "2023-08-01T19:56:11.754411+0000", 2023-08-01T19:56:11.791 INFO:teuthology.orchestra.run.smithi008.stdout: "duration": 5.1329999999999998e-06 2023-08-01T19:56:11.791 INFO:teuthology.orchestra.run.smithi008.stdout: }, 2023-08-01T19:56:11.791 INFO:teuthology.orchestra.run.smithi008.stdout: { 2023-08-01T19:56:11.792 INFO:teuthology.orchestra.run.smithi008.stdout: "event": "reached_pg", 2023-08-01T19:56:11.792 INFO:teuthology.orchestra.run.smithi008.stdout: "time": "2023-08-01T19:56:11.754451+0000", 2023-08-01T19:56:11.792 INFO:teuthology.orchestra.run.smithi008.stdout: "duration": 3.9462000000000003e-05 2023-08-01T19:56:11.792 INFO:teuthology.orchestra.run.smithi008.stdout: }, 2023-08-01T19:56:11.792 INFO:teuthology.orchestra.run.smithi008.stdout: { 2023-08-01T19:56:11.792 INFO:teuthology.orchestra.run.smithi008.stdout: "event": "started", 2023-08-01T19:56:11.792 INFO:teuthology.orchestra.run.smithi008.stdout: "time": "2023-08-01T19:56:11.754569+0000", 2023-08-01T19:56:11.792 INFO:teuthology.orchestra.run.smithi008.stdout: "duration": 0.00011831400000000001 2023-08-01T19:56:11.793 INFO:teuthology.orchestra.run.smithi008.stdout: } 2023-08-01T19:56:11.793 INFO:teuthology.orchestra.run.smithi008.stdout: ] 2023-08-01T19:56:11.793 INFO:teuthology.orchestra.run.smithi008.stdout: } 2023-08-01T19:56:11.793 INFO:teuthology.orchestra.run.smithi008.stdout: }, 2023-08-01T19:56:11.793 INFO:teuthology.orchestra.run.smithi008.stdout: { 2023-08-01T19:56:11.793 INFO:teuthology.orchestra.run.smithi008.stdout: "description": "osd_op(client.4668.0:222509 5.6 5:67bc1f47:::benchmark_data_smithi006_114134_object88848:head [delete] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e67)", 2023-08-01T19:56:11.793 INFO:teuthology.orchestra.run.smithi008.stdout: "initiated_at": "2023-08-01T19:56:11.754544+0000", 2023-08-01T19:56:11.794 INFO:teuthology.orchestra.run.smithi008.stdout: "age": 0.0074334429999999996, 2023-08-01T19:56:11.794 INFO:teuthology.orchestra.run.smithi008.stdout: "duration": 0.0076172159999999996, 2023-08-01T19:56:11.794 INFO:teuthology.orchestra.run.smithi008.stdout: "type_data": { 2023-08-01T19:56:11.794 INFO:teuthology.orchestra.run.smithi008.stdout: "flag_point": "started", 2023-08-01T19:56:11.794 INFO:teuthology.orchestra.run.smithi008.stdout: "client_info": { 2023-08-01T19:56:11.794 INFO:teuthology.orchestra.run.smithi008.stdout: "client": "client.4668", 2023-08-01T19:56:11.794 INFO:teuthology.orchestra.run.smithi008.stdout: "client_addr": "172.21.15.6:0/1709472247", 2023-08-01T19:56:11.794 INFO:teuthology.orchestra.run.smithi008.stdout: "tid": 222509 2023-08-01T19:56:11.795 INFO:teuthology.orchestra.run.smithi008.stdout: }, 2023-08-01T19:56:11.795 INFO:teuthology.orchestra.run.smithi008.stdout: "events": [ 2023-08-01T19:56:11.795 INFO:teuthology.orchestra.run.smithi008.stdout: { 2023-08-01T19:56:11.795 INFO:teuthology.orchestra.run.smithi008.stdout: "event": "initiated", 2023-08-01T19:56:11.795 INFO:teuthology.orchestra.run.smithi008.stdout: "time": "2023-08-01T19:56:11.754544+0000", 2023-08-01T19:56:11.795 INFO:teuthology.orchestra.run.smithi008.stdout: "duration": 0 2023-08-01T19:56:11.795 INFO:teuthology.orchestra.run.smithi008.stdout: }, 2023-08-01T19:56:11.795 INFO:teuthology.orchestra.run.smithi008.stdout: { 2023-08-01T19:56:11.796 INFO:teuthology.orchestra.run.smithi008.stdout: "event": "throttled", 2023-08-01T19:56:11.796 INFO:teuthology.orchestra.run.smithi008.stdout: "time": "2023-08-01T19:56:11.754544+0000", 2023-08-01T19:56:11.796 INFO:teuthology.orchestra.run.smithi008.stdout: "duration": 0 2023-08-01T19:56:11.796 INFO:teuthology.orchestra.run.smithi008.stdout: }, 2023-08-01T19:56:11.796 INFO:teuthology.orchestra.run.smithi008.stdout: { 2023-08-01T19:56:11.796 INFO:teuthology.orchestra.run.smithi008.stdout: "event": "header_read", 2023-08-01T19:56:11.796 INFO:teuthology.orchestra.run.smithi008.stdout: "time": "2023-08-01T19:56:11.754543+0000", 2023-08-01T19:56:11.797 INFO:teuthology.orchestra.run.smithi008.stdout: "duration": 4294967295.9999995 2023-08-01T19:56:11.797 INFO:teuthology.orchestra.run.smithi008.stdout: }, 2023-08-01T19:56:11.797 INFO:teuthology.orchestra.run.smithi008.stdout: { 2023-08-01T19:56:11.797 INFO:teuthology.orchestra.run.smithi008.stdout: "event": "all_read", 2023-08-01T19:56:11.797 INFO:teuthology.orchestra.run.smithi008.stdout: "time": "2023-08-01T19:56:11.754547+0000", 2023-08-01T19:56:11.797 INFO:teuthology.orchestra.run.smithi008.stdout: "duration": 3.9709999999999998e-06 2023-08-01T19:56:11.797 INFO:teuthology.orchestra.run.smithi008.stdout: }, 2023-08-01T19:56:11.797 INFO:teuthology.orchestra.run.smithi008.stdout: { 2023-08-01T19:56:11.798 INFO:teuthology.orchestra.run.smithi008.stdout: "event": "dispatched", 2023-08-01T19:56:11.798 INFO:teuthology.orchestra.run.smithi008.stdout: "time": "2023-08-01T19:56:11.754555+0000", 2023-08-01T19:56:11.798 INFO:teuthology.orchestra.run.smithi008.stdout: "duration": 8.2120000000000003e-06 2023-08-01T19:56:11.798 INFO:teuthology.orchestra.run.smithi008.stdout: }, 2023-08-01T19:56:11.798 INFO:teuthology.orchestra.run.smithi008.stdout: { 2023-08-01T19:56:11.798 INFO:teuthology.orchestra.run.smithi008.stdout: "event": "queued_for_pg", 2023-08-01T19:56:11.799 INFO:teuthology.orchestra.run.smithi008.stdout: "time": "2023-08-01T19:56:11.754560+0000", 2023-08-01T19:56:11.799 INFO:teuthology.orchestra.run.smithi008.stdout: "duration": 5.079e-06 2023-08-01T19:56:11.799 INFO:teuthology.orchestra.run.smithi008.stdout: }, 2023-08-01T19:56:11.799 INFO:teuthology.orchestra.run.smithi008.stdout: { 2023-08-01T19:56:11.799 INFO:teuthology.orchestra.run.smithi008.stdout: "event": "reached_pg", 2023-08-01T19:56:11.799 INFO:teuthology.orchestra.run.smithi008.stdout: "time": "2023-08-01T19:56:11.756380+0000", 2023-08-01T19:56:11.799 INFO:teuthology.orchestra.run.smithi008.stdout: "duration": 0.001819668 2023-08-01T19:56:11.799 INFO:teuthology.orchestra.run.smithi008.stdout: }, 2023-08-01T19:56:11.800 INFO:teuthology.orchestra.run.smithi008.stdout: { 2023-08-01T19:56:11.800 INFO:teuthology.orchestra.run.smithi008.stdout: "event": "started", 2023-08-01T19:56:11.800 INFO:teuthology.orchestra.run.smithi008.stdout: "time": "2023-08-01T19:56:11.756499+0000", 2023-08-01T19:56:11.800 INFO:teuthology.orchestra.run.smithi008.stdout: "duration": 0.00011896 2023-08-01T19:56:11.800 INFO:teuthology.orchestra.run.smithi008.stdout: } 2023-08-01T19:56:11.800 INFO:teuthology.orchestra.run.smithi008.stdout: ] 2023-08-01T19:56:11.800 INFO:teuthology.orchestra.run.smithi008.stdout: } 2023-08-01T19:56:11.800 INFO:teuthology.orchestra.run.smithi008.stdout: }, 2023-08-01T19:56:11.801 INFO:teuthology.orchestra.run.smithi008.stdout: { 2023-08-01T19:56:11.801 INFO:teuthology.orchestra.run.smithi008.stdout: "description": "osd_repop(client.4668.0:222505 5.4 e67/19 5:20874fe2:::benchmark_data_smithi006_114134_object88844:head v 67'13756, mlcod=67'13753)", 2023-08-01T19:56:11.801 INFO:teuthology.orchestra.run.smithi008.stdout: "initiated_at": "2023-08-01T19:56:11.754733+0000", 2023-08-01T19:56:11.801 INFO:teuthology.orchestra.run.smithi008.stdout: "age": 0.007244215, 2023-08-01T19:56:11.801 INFO:teuthology.orchestra.run.smithi008.stdout: "duration": 0.0074730209999999998, 2023-08-01T19:56:11.801 INFO:teuthology.orchestra.run.smithi008.stdout: "type_data": { 2023-08-01T19:56:11.802 INFO:teuthology.orchestra.run.smithi008.stdout: "flag_point": "started", 2023-08-01T19:56:11.802 INFO:teuthology.orchestra.run.smithi008.stdout: "events": [ 2023-08-01T19:56:11.802 INFO:teuthology.orchestra.run.smithi008.stdout: { 2023-08-01T19:56:11.802 INFO:teuthology.orchestra.run.smithi008.stdout: "event": "initiated", 2023-08-01T19:56:11.802 INFO:teuthology.orchestra.run.smithi008.stdout: "time": "2023-08-01T19:56:11.754733+0000", 2023-08-01T19:56:11.802 INFO:teuthology.orchestra.run.smithi008.stdout: "duration": 0 2023-08-01T19:56:11.802 INFO:teuthology.orchestra.run.smithi008.stdout: }, 2023-08-01T19:56:11.802 INFO:teuthology.orchestra.run.smithi008.stdout: { 2023-08-01T19:56:11.803 INFO:teuthology.orchestra.run.smithi008.stdout: "event": "throttled", 2023-08-01T19:56:11.803 INFO:teuthology.orchestra.run.smithi008.stdout: "time": "2023-08-01T19:56:11.754733+0000", 2023-08-01T19:56:11.803 INFO:teuthology.orchestra.run.smithi008.stdout: "duration": 0 2023-08-01T19:56:11.803 INFO:teuthology.orchestra.run.smithi008.stdout: }, 2023-08-01T19:56:11.803 INFO:teuthology.orchestra.run.smithi008.stdout: { 2023-08-01T19:56:11.803 INFO:teuthology.orchestra.run.smithi008.stdout: "event": "header_read", 2023-08-01T19:56:11.803 INFO:teuthology.orchestra.run.smithi008.stdout: "time": "2023-08-01T19:56:11.754733+0000", 2023-08-01T19:56:11.804 INFO:teuthology.orchestra.run.smithi008.stdout: "duration": 4294967295.9999995 2023-08-01T19:56:11.804 INFO:teuthology.orchestra.run.smithi008.stdout: }, 2023-08-01T19:56:11.804 INFO:teuthology.orchestra.run.smithi008.stdout: { 2023-08-01T19:56:11.804 INFO:teuthology.orchestra.run.smithi008.stdout: "event": "all_read", 2023-08-01T19:56:11.804 INFO:teuthology.orchestra.run.smithi008.stdout: "time": "2023-08-01T19:56:11.754739+0000", 2023-08-01T19:56:11.804 INFO:teuthology.orchestra.run.smithi008.stdout: "duration": 6.1650000000000003e-06 2023-08-01T19:56:11.805 INFO:teuthology.orchestra.run.smithi008.stdout: }, 2023-08-01T19:56:11.805 INFO:teuthology.orchestra.run.smithi008.stdout: { 2023-08-01T19:56:11.805 INFO:teuthology.orchestra.run.smithi008.stdout: "event": "dispatched", 2023-08-01T19:56:11.805 INFO:teuthology.orchestra.run.smithi008.stdout: "time": "2023-08-01T19:56:11.754748+0000", 2023-08-01T19:56:11.805 INFO:teuthology.orchestra.run.smithi008.stdout: "duration": 9.4949999999999997e-06 2023-08-01T19:56:11.805 INFO:teuthology.orchestra.run.smithi008.stdout: }, 2023-08-01T19:56:11.805 INFO:teuthology.orchestra.run.smithi008.stdout: { 2023-08-01T19:56:11.806 INFO:teuthology.orchestra.run.smithi008.stdout: "event": "queued_for_pg", 2023-08-01T19:56:11.806 INFO:teuthology.orchestra.run.smithi008.stdout: "time": "2023-08-01T19:56:11.754753+0000", 2023-08-01T19:56:11.806 INFO:teuthology.orchestra.run.smithi008.stdout: "duration": 5.169e-06 2023-08-01T19:56:11.806 INFO:teuthology.orchestra.run.smithi008.stdout: }, 2023-08-01T19:56:11.806 INFO:teuthology.orchestra.run.smithi008.stdout: { 2023-08-01T19:56:11.806 INFO:teuthology.orchestra.run.smithi008.stdout: "event": "reached_pg", 2023-08-01T19:56:11.806 INFO:teuthology.orchestra.run.smithi008.stdout: "time": "2023-08-01T19:56:11.754785+0000", 2023-08-01T19:56:11.806 INFO:teuthology.orchestra.run.smithi008.stdout: "duration": 3.1359999999999998e-05 2023-08-01T19:56:11.807 INFO:teuthology.orchestra.run.smithi008.stdout: }, 2023-08-01T19:56:11.807 INFO:teuthology.orchestra.run.smithi008.stdout: { 2023-08-01T19:56:11.807 INFO:teuthology.orchestra.run.smithi008.stdout: "event": "started", 2023-08-01T19:56:11.807 INFO:teuthology.orchestra.run.smithi008.stdout: "time": "2023-08-01T19:56:11.754802+0000", 2023-08-01T19:56:11.807 INFO:teuthology.orchestra.run.smithi008.stdout: "duration": 1.6656000000000001e-05 2023-08-01T19:56:11.807 INFO:teuthology.orchestra.run.smithi008.stdout: } 2023-08-01T19:56:11.807 INFO:teuthology.orchestra.run.smithi008.stdout: ] 2023-08-01T19:56:11.808 INFO:teuthology.orchestra.run.smithi008.stdout: } 2023-08-01T19:56:11.808 INFO:teuthology.orchestra.run.smithi008.stdout: }, 2023-08-01T19:56:11.808 INFO:teuthology.orchestra.run.smithi008.stdout: { 2023-08-01T19:56:11.808 INFO:teuthology.orchestra.run.smithi008.stdout: "description": "osd_repop(client.4668.0:222507 5.8 e67/19 5:1dfe1033:::benchmark_data_smithi006_114134_object88846:head v 67'13962, mlcod=67'13959)", 2023-08-01T19:56:11.808 INFO:teuthology.orchestra.run.smithi008.stdout: "initiated_at": "2023-08-01T19:56:11.754769+0000", 2023-08-01T19:56:11.808 INFO:teuthology.orchestra.run.smithi008.stdout: "age": 0.0072086010000000002, 2023-08-01T19:56:11.808 INFO:teuthology.orchestra.run.smithi008.stdout: "duration": 0.0074839980000000004, 2023-08-01T19:56:11.809 INFO:teuthology.orchestra.run.smithi008.stdout: "type_data": { 2023-08-01T19:56:11.809 INFO:teuthology.orchestra.run.smithi008.stdout: "flag_point": "started", 2023-08-01T19:56:11.809 INFO:teuthology.orchestra.run.smithi008.stdout: "events": [ 2023-08-01T19:56:11.809 INFO:teuthology.orchestra.run.smithi008.stdout: { 2023-08-01T19:56:11.809 INFO:teuthology.orchestra.run.smithi008.stdout: "event": "initiated", 2023-08-01T19:56:11.809 INFO:teuthology.orchestra.run.smithi008.stdout: "time": "2023-08-01T19:56:11.754769+0000", 2023-08-01T19:56:11.809 INFO:teuthology.orchestra.run.smithi008.stdout: "duration": 0 2023-08-01T19:56:11.809 INFO:teuthology.orchestra.run.smithi008.stdout: }, 2023-08-01T19:56:11.810 INFO:teuthology.orchestra.run.smithi008.stdout: { 2023-08-01T19:56:11.810 INFO:teuthology.orchestra.run.smithi008.stdout: "event": "throttled", 2023-08-01T19:56:11.810 INFO:teuthology.orchestra.run.smithi008.stdout: "time": "2023-08-01T19:56:11.754769+0000", 2023-08-01T19:56:11.810 INFO:teuthology.orchestra.run.smithi008.stdout: "duration": 0 2023-08-01T19:56:11.810 INFO:teuthology.orchestra.run.smithi008.stdout: }, 2023-08-01T19:56:11.810 INFO:teuthology.orchestra.run.smithi008.stdout: { 2023-08-01T19:56:11.810 INFO:teuthology.orchestra.run.smithi008.stdout: "event": "header_read", 2023-08-01T19:56:11.810 INFO:teuthology.orchestra.run.smithi008.stdout: "time": "2023-08-01T19:56:11.754768+0000", 2023-08-01T19:56:11.811 INFO:teuthology.orchestra.run.smithi008.stdout: "duration": 4294967295.9999995 2023-08-01T19:56:11.811 INFO:teuthology.orchestra.run.smithi008.stdout: }, 2023-08-01T19:56:11.811 INFO:teuthology.orchestra.run.smithi008.stdout: { 2023-08-01T19:56:11.811 INFO:teuthology.orchestra.run.smithi008.stdout: "event": "all_read", 2023-08-01T19:56:11.811 INFO:teuthology.orchestra.run.smithi008.stdout: "time": "2023-08-01T19:56:11.754773+0000", 2023-08-01T19:56:11.811 INFO:teuthology.orchestra.run.smithi008.stdout: "duration": 4.2610000000000004e-06 2023-08-01T19:56:11.811 INFO:teuthology.orchestra.run.smithi008.stdout: }, 2023-08-01T19:56:11.811 INFO:teuthology.orchestra.run.smithi008.stdout: { 2023-08-01T19:56:11.812 INFO:teuthology.orchestra.run.smithi008.stdout: "event": "dispatched", 2023-08-01T19:56:11.812 INFO:teuthology.orchestra.run.smithi008.stdout: "time": "2023-08-01T19:56:11.754779+0000", 2023-08-01T19:56:11.812 INFO:teuthology.orchestra.run.smithi008.stdout: "duration": 6.8050000000000001e-06 2023-08-01T19:56:11.812 INFO:teuthology.orchestra.run.smithi008.stdout: }, 2023-08-01T19:56:11.812 INFO:teuthology.orchestra.run.smithi008.stdout: { 2023-08-01T19:56:11.812 INFO:teuthology.orchestra.run.smithi008.stdout: "event": "queued_for_pg", 2023-08-01T19:56:11.812 INFO:teuthology.orchestra.run.smithi008.stdout: "time": "2023-08-01T19:56:11.754783+0000", 2023-08-01T19:56:11.813 INFO:teuthology.orchestra.run.smithi008.stdout: "duration": 3.9480000000000001e-06 2023-08-01T19:56:11.813 INFO:teuthology.orchestra.run.smithi008.stdout: }, 2023-08-01T19:56:11.813 INFO:teuthology.orchestra.run.smithi008.stdout: { 2023-08-01T19:56:11.813 INFO:teuthology.orchestra.run.smithi008.stdout: "event": "reached_pg", 2023-08-01T19:56:11.813 INFO:teuthology.orchestra.run.smithi008.stdout: "time": "2023-08-01T19:56:11.754836+0000", 2023-08-01T19:56:11.813 INFO:teuthology.orchestra.run.smithi008.stdout: "duration": 5.2633000000000002e-05 2023-08-01T19:56:11.813 INFO:teuthology.orchestra.run.smithi008.stdout: }, 2023-08-01T19:56:11.813 INFO:teuthology.orchestra.run.smithi008.stdout: { 2023-08-01T19:56:11.814 INFO:teuthology.orchestra.run.smithi008.stdout: "event": "started", 2023-08-01T19:56:11.814 INFO:teuthology.orchestra.run.smithi008.stdout: "time": "2023-08-01T19:56:11.754857+0000", 2023-08-01T19:56:11.814 INFO:teuthology.orchestra.run.smithi008.stdout: "duration": 2.1029000000000001e-05 2023-08-01T19:56:11.814 INFO:teuthology.orchestra.run.smithi008.stdout: } 2023-08-01T19:56:11.814 INFO:teuthology.orchestra.run.smithi008.stdout: ] 2023-08-01T19:56:11.814 INFO:teuthology.orchestra.run.smithi008.stdout: } 2023-08-01T19:56:11.814 INFO:teuthology.orchestra.run.smithi008.stdout: }, 2023-08-01T19:56:11.814 INFO:teuthology.orchestra.run.smithi008.stdout: { 2023-08-01T19:56:11.815 INFO:teuthology.orchestra.run.smithi008.stdout: "description": "osd_op(client.4668.0:222510 5.c 5:35331ea4:::benchmark_data_smithi006_114134_object88849:head [delete] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e67)", 2023-08-01T19:56:11.815 INFO:teuthology.orchestra.run.smithi008.stdout: "initiated_at": "2023-08-01T19:56:11.756281+0000", 2023-08-01T19:56:11.815 INFO:teuthology.orchestra.run.smithi008.stdout: "age": 0.0056958570000000004, 2023-08-01T19:56:11.815 INFO:teuthology.orchestra.run.smithi008.stdout: "duration": 0.006044967, 2023-08-01T19:56:11.815 INFO:teuthology.orchestra.run.smithi008.stdout: "type_data": { 2023-08-01T19:56:11.815 INFO:teuthology.orchestra.run.smithi008.stdout: "flag_point": "started", 2023-08-01T19:56:11.815 INFO:teuthology.orchestra.run.smithi008.stdout: "client_info": { 2023-08-01T19:56:11.816 INFO:teuthology.orchestra.run.smithi008.stdout: "client": "client.4668", 2023-08-01T19:56:11.816 INFO:teuthology.orchestra.run.smithi008.stdout: "client_addr": "172.21.15.6:0/1709472247", 2023-08-01T19:56:11.816 INFO:teuthology.orchestra.run.smithi008.stdout: "tid": 222510 2023-08-01T19:56:11.816 INFO:teuthology.orchestra.run.smithi008.stdout: }, 2023-08-01T19:56:11.816 INFO:teuthology.orchestra.run.smithi008.stdout: "events": [ 2023-08-01T19:56:11.816 INFO:teuthology.orchestra.run.smithi008.stdout: { 2023-08-01T19:56:11.816 INFO:teuthology.orchestra.run.smithi008.stdout: "event": "initiated", 2023-08-01T19:56:11.816 INFO:teuthology.orchestra.run.smithi008.stdout: "time": "2023-08-01T19:56:11.756281+0000", 2023-08-01T19:56:11.817 INFO:teuthology.orchestra.run.smithi008.stdout: "duration": 0 2023-08-01T19:56:11.817 INFO:teuthology.orchestra.run.smithi008.stdout: }, 2023-08-01T19:56:11.817 INFO:teuthology.orchestra.run.smithi008.stdout: { 2023-08-01T19:56:11.817 INFO:teuthology.orchestra.run.smithi008.stdout: "event": "throttled", 2023-08-01T19:56:11.817 INFO:teuthology.orchestra.run.smithi008.stdout: "time": "2023-08-01T19:56:11.756281+0000", 2023-08-01T19:56:11.817 INFO:teuthology.orchestra.run.smithi008.stdout: "duration": 0 2023-08-01T19:56:11.817 INFO:teuthology.orchestra.run.smithi008.stdout: }, 2023-08-01T19:56:11.818 INFO:teuthology.orchestra.run.smithi008.stdout: { 2023-08-01T19:56:11.818 INFO:teuthology.orchestra.run.smithi008.stdout: "event": "header_read", 2023-08-01T19:56:11.818 INFO:teuthology.orchestra.run.smithi008.stdout: "time": "2023-08-01T19:56:11.756281+0000", 2023-08-01T19:56:11.818 INFO:teuthology.orchestra.run.smithi008.stdout: "duration": 4294967295.999999 2023-08-01T19:56:11.818 INFO:teuthology.orchestra.run.smithi008.stdout: }, 2023-08-01T19:56:11.818 INFO:teuthology.orchestra.run.smithi008.stdout: { 2023-08-01T19:56:11.818 INFO:teuthology.orchestra.run.smithi008.stdout: "event": "all_read", 2023-08-01T19:56:11.818 INFO:teuthology.orchestra.run.smithi008.stdout: "time": "2023-08-01T19:56:11.756286+0000", 2023-08-01T19:56:11.819 INFO:teuthology.orchestra.run.smithi008.stdout: "duration": 4.9799999999999998e-06 2023-08-01T19:56:11.819 INFO:teuthology.orchestra.run.smithi008.stdout: }, 2023-08-01T19:56:11.819 INFO:teuthology.orchestra.run.smithi008.stdout: { 2023-08-01T19:56:11.819 INFO:teuthology.orchestra.run.smithi008.stdout: "event": "dispatched", 2023-08-01T19:56:11.819 INFO:teuthology.orchestra.run.smithi008.stdout: "time": "2023-08-01T19:56:11.756296+0000", 2023-08-01T19:56:11.819 INFO:teuthology.orchestra.run.smithi008.stdout: "duration": 1.0560000000000001e-05 2023-08-01T19:56:11.819 INFO:teuthology.orchestra.run.smithi008.stdout: }, 2023-08-01T19:56:11.819 INFO:teuthology.orchestra.run.smithi008.stdout: { 2023-08-01T19:56:11.820 INFO:teuthology.orchestra.run.smithi008.stdout: "event": "queued_for_pg", 2023-08-01T19:56:11.820 INFO:teuthology.orchestra.run.smithi008.stdout: "time": "2023-08-01T19:56:11.756302+0000", 2023-08-01T19:56:11.820 INFO:teuthology.orchestra.run.smithi008.stdout: "duration": 5.7780000000000004e-06 2023-08-01T19:56:11.820 INFO:teuthology.orchestra.run.smithi008.stdout: }, 2023-08-01T19:56:11.820 INFO:teuthology.orchestra.run.smithi008.stdout: { 2023-08-01T19:56:11.820 INFO:teuthology.orchestra.run.smithi008.stdout: "event": "reached_pg", 2023-08-01T19:56:11.820 INFO:teuthology.orchestra.run.smithi008.stdout: "time": "2023-08-01T19:56:11.756343+0000", 2023-08-01T19:56:11.821 INFO:teuthology.orchestra.run.smithi008.stdout: "duration": 4.1149000000000002e-05 2023-08-01T19:56:11.821 INFO:teuthology.orchestra.run.smithi008.stdout: }, 2023-08-01T19:56:11.821 INFO:teuthology.orchestra.run.smithi008.stdout: { 2023-08-01T19:56:11.821 INFO:teuthology.orchestra.run.smithi008.stdout: "event": "started", 2023-08-01T19:56:11.821 INFO:teuthology.orchestra.run.smithi008.stdout: "time": "2023-08-01T19:56:11.756788+0000", 2023-08-01T19:56:11.821 INFO:teuthology.orchestra.run.smithi008.stdout: "duration": 0.00044479900000000001 2023-08-01T19:56:11.821 INFO:teuthology.orchestra.run.smithi008.stdout: } 2023-08-01T19:56:11.821 INFO:teuthology.orchestra.run.smithi008.stdout: ] 2023-08-01T19:56:11.822 INFO:teuthology.orchestra.run.smithi008.stdout: } 2023-08-01T19:56:11.822 INFO:teuthology.orchestra.run.smithi008.stdout: }, 2023-08-01T19:56:11.822 INFO:teuthology.orchestra.run.smithi008.stdout: { 2023-08-01T19:56:11.822 INFO:teuthology.orchestra.run.smithi008.stdout: "description": "osd_repop(client.4668.0:222512 5.e e67/19 5:70aa087e:::benchmark_data_smithi006_114134_object88851:head v 67'13936, mlcod=67'13934)", 2023-08-01T19:56:11.822 INFO:teuthology.orchestra.run.smithi008.stdout: "initiated_at": "2023-08-01T19:56:11.756636+0000", 2023-08-01T19:56:11.822 INFO:teuthology.orchestra.run.smithi008.stdout: "age": 0.0053416870000000003, 2023-08-01T19:56:11.822 INFO:teuthology.orchestra.run.smithi008.stdout: "duration": 0.0057856890000000001, 2023-08-01T19:56:11.823 INFO:teuthology.orchestra.run.smithi008.stdout: "type_data": { 2023-08-01T19:56:11.823 INFO:teuthology.orchestra.run.smithi008.stdout: "flag_point": "started", 2023-08-01T19:56:11.823 INFO:teuthology.orchestra.run.smithi008.stdout: "events": [ 2023-08-01T19:56:11.823 INFO:teuthology.orchestra.run.smithi008.stdout: { 2023-08-01T19:56:11.823 INFO:teuthology.orchestra.run.smithi008.stdout: "event": "initiated", 2023-08-01T19:56:11.823 INFO:teuthology.orchestra.run.smithi008.stdout: "time": "2023-08-01T19:56:11.756636+0000", 2023-08-01T19:56:11.823 INFO:teuthology.orchestra.run.smithi008.stdout: "duration": 0 2023-08-01T19:56:11.824 INFO:teuthology.orchestra.run.smithi008.stdout: }, 2023-08-01T19:56:11.824 INFO:teuthology.orchestra.run.smithi008.stdout: { 2023-08-01T19:56:11.824 INFO:teuthology.orchestra.run.smithi008.stdout: "event": "throttled", 2023-08-01T19:56:11.824 INFO:teuthology.orchestra.run.smithi008.stdout: "time": "2023-08-01T19:56:11.756636+0000", 2023-08-01T19:56:11.824 INFO:teuthology.orchestra.run.smithi008.stdout: "duration": 0 2023-08-01T19:56:11.824 INFO:teuthology.orchestra.run.smithi008.stdout: }, 2023-08-01T19:56:11.824 INFO:teuthology.orchestra.run.smithi008.stdout: { 2023-08-01T19:56:11.824 INFO:teuthology.orchestra.run.smithi008.stdout: "event": "header_read", 2023-08-01T19:56:11.825 INFO:teuthology.orchestra.run.smithi008.stdout: "time": "2023-08-01T19:56:11.756635+0000", 2023-08-01T19:56:11.825 INFO:teuthology.orchestra.run.smithi008.stdout: "duration": 4294967295.999999 2023-08-01T19:56:11.825 INFO:teuthology.orchestra.run.smithi008.stdout: }, 2023-08-01T19:56:11.825 INFO:teuthology.orchestra.run.smithi008.stdout: { 2023-08-01T19:56:11.825 INFO:teuthology.orchestra.run.smithi008.stdout: "event": "all_read", 2023-08-01T19:56:11.825 INFO:teuthology.orchestra.run.smithi008.stdout: "time": "2023-08-01T19:56:11.756641+0000", 2023-08-01T19:56:11.825 INFO:teuthology.orchestra.run.smithi008.stdout: "duration": 6.2249999999999997e-06 2023-08-01T19:56:11.826 INFO:teuthology.orchestra.run.smithi008.stdout: }, 2023-08-01T19:56:11.826 INFO:teuthology.orchestra.run.smithi008.stdout: { 2023-08-01T19:56:11.826 INFO:teuthology.orchestra.run.smithi008.stdout: "event": "dispatched", 2023-08-01T19:56:11.826 INFO:teuthology.orchestra.run.smithi008.stdout: "time": "2023-08-01T19:56:11.756650+0000", 2023-08-01T19:56:11.826 INFO:teuthology.orchestra.run.smithi008.stdout: "duration": 8.6470000000000004e-06 2023-08-01T19:56:11.826 INFO:teuthology.orchestra.run.smithi008.stdout: }, 2023-08-01T19:56:11.826 INFO:teuthology.orchestra.run.smithi008.stdout: { 2023-08-01T19:56:11.826 INFO:teuthology.orchestra.run.smithi008.stdout: "event": "queued_for_pg", 2023-08-01T19:56:11.827 INFO:teuthology.orchestra.run.smithi008.stdout: "time": "2023-08-01T19:56:11.756655+0000", 2023-08-01T19:56:11.827 INFO:teuthology.orchestra.run.smithi008.stdout: "duration": 4.8899999999999998e-06 2023-08-01T19:56:11.827 INFO:teuthology.orchestra.run.smithi008.stdout: }, 2023-08-01T19:56:11.827 INFO:teuthology.orchestra.run.smithi008.stdout: { 2023-08-01T19:56:11.827 INFO:teuthology.orchestra.run.smithi008.stdout: "event": "reached_pg", 2023-08-01T19:56:11.827 INFO:teuthology.orchestra.run.smithi008.stdout: "time": "2023-08-01T19:56:11.756683+0000", 2023-08-01T19:56:11.827 INFO:teuthology.orchestra.run.smithi008.stdout: "duration": 2.8469000000000001e-05 2023-08-01T19:56:11.827 INFO:teuthology.orchestra.run.smithi008.stdout: }, 2023-08-01T19:56:11.828 INFO:teuthology.orchestra.run.smithi008.stdout: { 2023-08-01T19:56:11.828 INFO:teuthology.orchestra.run.smithi008.stdout: "event": "started", 2023-08-01T19:56:11.828 INFO:teuthology.orchestra.run.smithi008.stdout: "time": "2023-08-01T19:56:11.756695+0000", 2023-08-01T19:56:11.828 INFO:teuthology.orchestra.run.smithi008.stdout: "duration": 1.223e-05 2023-08-01T19:56:11.828 INFO:teuthology.orchestra.run.smithi008.stdout: } 2023-08-01T19:56:11.828 INFO:teuthology.orchestra.run.smithi008.stdout: ] 2023-08-01T19:56:11.828 INFO:teuthology.orchestra.run.smithi008.stdout: } 2023-08-01T19:56:11.829 INFO:teuthology.orchestra.run.smithi008.stdout: }, 2023-08-01T19:56:11.829 INFO:teuthology.orchestra.run.smithi008.stdout: { 2023-08-01T19:56:11.829 INFO:teuthology.orchestra.run.smithi008.stdout: "description": "osd_op(client.4668.0:222513 5.3 5:c6d370d2:::benchmark_data_smithi006_114134_object88852:head [delete] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e67)", 2023-08-01T19:56:11.829 INFO:teuthology.orchestra.run.smithi008.stdout: "initiated_at": "2023-08-01T19:56:11.757645+0000", 2023-08-01T19:56:11.829 INFO:teuthology.orchestra.run.smithi008.stdout: "age": 0.0043324110000000004, 2023-08-01T19:56:11.829 INFO:teuthology.orchestra.run.smithi008.stdout: "duration": 0.0048350829999999996, 2023-08-01T19:56:11.829 INFO:teuthology.orchestra.run.smithi008.stdout: "type_data": { 2023-08-01T19:56:11.829 INFO:teuthology.orchestra.run.smithi008.stdout: "flag_point": "started", 2023-08-01T19:56:11.830 INFO:teuthology.orchestra.run.smithi008.stdout: "client_info": { 2023-08-01T19:56:11.830 INFO:teuthology.orchestra.run.smithi008.stdout: "client": "client.4668", 2023-08-01T19:56:11.830 INFO:teuthology.orchestra.run.smithi008.stdout: "client_addr": "172.21.15.6:0/1709472247", 2023-08-01T19:56:11.830 INFO:teuthology.orchestra.run.smithi008.stdout: "tid": 222513 2023-08-01T19:56:11.830 INFO:teuthology.orchestra.run.smithi008.stdout: }, 2023-08-01T19:56:11.830 INFO:teuthology.orchestra.run.smithi008.stdout: "events": [ 2023-08-01T19:56:11.830 INFO:teuthology.orchestra.run.smithi008.stdout: { 2023-08-01T19:56:11.830 INFO:teuthology.orchestra.run.smithi008.stdout: "event": "initiated", 2023-08-01T19:56:11.831 INFO:teuthology.orchestra.run.smithi008.stdout: "time": "2023-08-01T19:56:11.757645+0000", 2023-08-01T19:56:11.831 INFO:teuthology.orchestra.run.smithi008.stdout: "duration": 0 2023-08-01T19:56:11.831 INFO:teuthology.orchestra.run.smithi008.stdout: }, 2023-08-01T19:56:11.831 INFO:teuthology.orchestra.run.smithi008.stdout: { 2023-08-01T19:56:11.831 INFO:teuthology.orchestra.run.smithi008.stdout: "event": "throttled", 2023-08-01T19:56:11.831 INFO:teuthology.orchestra.run.smithi008.stdout: "time": "2023-08-01T19:56:11.757645+0000", 2023-08-01T19:56:11.831 INFO:teuthology.orchestra.run.smithi008.stdout: "duration": 0 2023-08-01T19:56:11.832 INFO:teuthology.orchestra.run.smithi008.stdout: }, 2023-08-01T19:56:11.832 INFO:teuthology.orchestra.run.smithi008.stdout: { 2023-08-01T19:56:11.832 INFO:teuthology.orchestra.run.smithi008.stdout: "event": "header_read", 2023-08-01T19:56:11.832 INFO:teuthology.orchestra.run.smithi008.stdout: "time": "2023-08-01T19:56:11.757644+0000", 2023-08-01T19:56:11.832 INFO:teuthology.orchestra.run.smithi008.stdout: "duration": 4294967295.999999 2023-08-01T19:56:11.832 INFO:teuthology.orchestra.run.smithi008.stdout: }, 2023-08-01T19:56:11.832 INFO:teuthology.orchestra.run.smithi008.stdout: { 2023-08-01T19:56:11.832 INFO:teuthology.orchestra.run.smithi008.stdout: "event": "all_read", 2023-08-01T19:56:11.833 INFO:teuthology.orchestra.run.smithi008.stdout: "time": "2023-08-01T19:56:11.757649+0000", 2023-08-01T19:56:11.833 INFO:teuthology.orchestra.run.smithi008.stdout: "duration": 5.0300000000000001e-06 2023-08-01T19:56:11.833 INFO:teuthology.orchestra.run.smithi008.stdout: }, 2023-08-01T19:56:11.833 INFO:teuthology.orchestra.run.smithi008.stdout: { 2023-08-01T19:56:11.833 INFO:teuthology.orchestra.run.smithi008.stdout: "event": "dispatched", 2023-08-01T19:56:11.833 INFO:teuthology.orchestra.run.smithi008.stdout: "time": "2023-08-01T19:56:11.757662+0000", 2023-08-01T19:56:11.833 INFO:teuthology.orchestra.run.smithi008.stdout: "duration": 1.3205e-05 2023-08-01T19:56:11.833 INFO:teuthology.orchestra.run.smithi008.stdout: }, 2023-08-01T19:56:11.834 INFO:teuthology.orchestra.run.smithi008.stdout: { 2023-08-01T19:56:11.834 INFO:teuthology.orchestra.run.smithi008.stdout: "event": "queued_for_pg", 2023-08-01T19:56:11.834 INFO:teuthology.orchestra.run.smithi008.stdout: "time": "2023-08-01T19:56:11.757669+0000", 2023-08-01T19:56:11.834 INFO:teuthology.orchestra.run.smithi008.stdout: "duration": 6.3940000000000001e-06 2023-08-01T19:56:11.834 INFO:teuthology.orchestra.run.smithi008.stdout: }, 2023-08-01T19:56:11.834 INFO:teuthology.orchestra.run.smithi008.stdout: { 2023-08-01T19:56:11.834 INFO:teuthology.orchestra.run.smithi008.stdout: "event": "reached_pg", 2023-08-01T19:56:11.834 INFO:teuthology.orchestra.run.smithi008.stdout: "time": "2023-08-01T19:56:11.757706+0000", 2023-08-01T19:56:11.835 INFO:teuthology.orchestra.run.smithi008.stdout: "duration": 3.7765999999999997e-05 2023-08-01T19:56:11.835 INFO:teuthology.orchestra.run.smithi008.stdout: }, 2023-08-01T19:56:11.835 INFO:teuthology.orchestra.run.smithi008.stdout: { 2023-08-01T19:56:11.835 INFO:teuthology.orchestra.run.smithi008.stdout: "event": "started", 2023-08-01T19:56:11.835 INFO:teuthology.orchestra.run.smithi008.stdout: "time": "2023-08-01T19:56:11.757830+0000", 2023-08-01T19:56:11.835 INFO:teuthology.orchestra.run.smithi008.stdout: "duration": 0.00012341300000000001 2023-08-01T19:56:11.835 INFO:teuthology.orchestra.run.smithi008.stdout: } 2023-08-01T19:56:11.836 INFO:teuthology.orchestra.run.smithi008.stdout: ] 2023-08-01T19:56:11.836 INFO:teuthology.orchestra.run.smithi008.stdout: } 2023-08-01T19:56:11.836 INFO:teuthology.orchestra.run.smithi008.stdout: }, 2023-08-01T19:56:11.836 INFO:teuthology.orchestra.run.smithi008.stdout: { 2023-08-01T19:56:11.836 INFO:teuthology.orchestra.run.smithi008.stdout: "description": "osd_op(client.4668.0:222514 5.5 5:a56d7b17:::benchmark_data_smithi006_114134_object88853:head [delete] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e67)", 2023-08-01T19:56:11.836 INFO:teuthology.orchestra.run.smithi008.stdout: "initiated_at": "2023-08-01T19:56:11.758762+0000", 2023-08-01T19:56:11.836 INFO:teuthology.orchestra.run.smithi008.stdout: "age": 0.0032151250000000001, 2023-08-01T19:56:11.837 INFO:teuthology.orchestra.run.smithi008.stdout: "duration": 0.0038163569999999998, 2023-08-01T19:56:11.837 INFO:teuthology.orchestra.run.smithi008.stdout: "type_data": { 2023-08-01T19:56:11.837 INFO:teuthology.orchestra.run.smithi008.stdout: "flag_point": "started", 2023-08-01T19:56:11.837 INFO:teuthology.orchestra.run.smithi008.stdout: "client_info": { 2023-08-01T19:56:11.837 INFO:teuthology.orchestra.run.smithi008.stdout: "client": "client.4668", 2023-08-01T19:56:11.837 INFO:teuthology.orchestra.run.smithi008.stdout: "client_addr": "172.21.15.6:0/1709472247", 2023-08-01T19:56:11.837 INFO:teuthology.orchestra.run.smithi008.stdout: "tid": 222514 2023-08-01T19:56:11.837 INFO:teuthology.orchestra.run.smithi008.stdout: }, 2023-08-01T19:56:11.838 INFO:teuthology.orchestra.run.smithi008.stdout: "events": [ 2023-08-01T19:56:11.838 INFO:teuthology.orchestra.run.smithi008.stdout: { 2023-08-01T19:56:11.838 INFO:teuthology.orchestra.run.smithi008.stdout: "event": "initiated", 2023-08-01T19:56:11.838 INFO:teuthology.orchestra.run.smithi008.stdout: "time": "2023-08-01T19:56:11.758762+0000", 2023-08-01T19:56:11.838 INFO:teuthology.orchestra.run.smithi008.stdout: "duration": 0 2023-08-01T19:56:11.838 INFO:teuthology.orchestra.run.smithi008.stdout: }, 2023-08-01T19:56:11.838 INFO:teuthology.orchestra.run.smithi008.stdout: { 2023-08-01T19:56:11.839 INFO:teuthology.orchestra.run.smithi008.stdout: "event": "throttled", 2023-08-01T19:56:11.839 INFO:teuthology.orchestra.run.smithi008.stdout: "time": "2023-08-01T19:56:11.758762+0000", 2023-08-01T19:56:11.839 INFO:teuthology.orchestra.run.smithi008.stdout: "duration": 0 2023-08-01T19:56:11.839 INFO:teuthology.orchestra.run.smithi008.stdout: }, 2023-08-01T19:56:11.839 INFO:teuthology.orchestra.run.smithi008.stdout: { 2023-08-01T19:56:11.839 INFO:teuthology.orchestra.run.smithi008.stdout: "event": "header_read", 2023-08-01T19:56:11.839 INFO:teuthology.orchestra.run.smithi008.stdout: "time": "2023-08-01T19:56:11.758761+0000", 2023-08-01T19:56:11.839 INFO:teuthology.orchestra.run.smithi008.stdout: "duration": 4294967295.999999 2023-08-01T19:56:11.840 INFO:teuthology.orchestra.run.smithi008.stdout: }, 2023-08-01T19:56:11.840 INFO:teuthology.orchestra.run.smithi008.stdout: { 2023-08-01T19:56:11.840 INFO:teuthology.orchestra.run.smithi008.stdout: "event": "all_read", 2023-08-01T19:56:11.840 INFO:teuthology.orchestra.run.smithi008.stdout: "time": "2023-08-01T19:56:11.758766+0000", 2023-08-01T19:56:11.840 INFO:teuthology.orchestra.run.smithi008.stdout: "duration": 4.5569999999999997e-06 2023-08-01T19:56:11.840 INFO:teuthology.orchestra.run.smithi008.stdout: }, 2023-08-01T19:56:11.840 INFO:teuthology.orchestra.run.smithi008.stdout: { 2023-08-01T19:56:11.841 INFO:teuthology.orchestra.run.smithi008.stdout: "event": "dispatched", 2023-08-01T19:56:11.841 INFO:teuthology.orchestra.run.smithi008.stdout: "time": "2023-08-01T19:56:11.758776+0000", 2023-08-01T19:56:11.841 INFO:teuthology.orchestra.run.smithi008.stdout: "duration": 9.9699999999999994e-06 2023-08-01T19:56:11.841 INFO:teuthology.orchestra.run.smithi008.stdout: }, 2023-08-01T19:56:11.841 INFO:teuthology.orchestra.run.smithi008.stdout: { 2023-08-01T19:56:11.841 INFO:teuthology.orchestra.run.smithi008.stdout: "event": "queued_for_pg", 2023-08-01T19:56:11.841 INFO:teuthology.orchestra.run.smithi008.stdout: "time": "2023-08-01T19:56:11.758782+0000", 2023-08-01T19:56:11.842 INFO:teuthology.orchestra.run.smithi008.stdout: "duration": 6.511e-06 2023-08-01T19:56:11.842 INFO:teuthology.orchestra.run.smithi008.stdout: }, 2023-08-01T19:56:11.842 INFO:teuthology.orchestra.run.smithi008.stdout: { 2023-08-01T19:56:11.842 INFO:teuthology.orchestra.run.smithi008.stdout: "event": "reached_pg", 2023-08-01T19:56:11.842 INFO:teuthology.orchestra.run.smithi008.stdout: "time": "2023-08-01T19:56:11.758813+0000", 2023-08-01T19:56:11.842 INFO:teuthology.orchestra.run.smithi008.stdout: "duration": 3.0762999999999997e-05 2023-08-01T19:56:11.842 INFO:teuthology.orchestra.run.smithi008.stdout: }, 2023-08-01T19:56:11.842 INFO:teuthology.orchestra.run.smithi008.stdout: { 2023-08-01T19:56:11.843 INFO:teuthology.orchestra.run.smithi008.stdout: "event": "started", 2023-08-01T19:56:11.843 INFO:teuthology.orchestra.run.smithi008.stdout: "time": "2023-08-01T19:56:11.758947+0000", 2023-08-01T19:56:11.843 INFO:teuthology.orchestra.run.smithi008.stdout: "duration": 0.00013371800000000001 2023-08-01T19:56:11.843 INFO:teuthology.orchestra.run.smithi008.stdout: } 2023-08-01T19:56:11.843 INFO:teuthology.orchestra.run.smithi008.stdout: ] 2023-08-01T19:56:11.843 INFO:teuthology.orchestra.run.smithi008.stdout: } 2023-08-01T19:56:11.843 INFO:teuthology.orchestra.run.smithi008.stdout: }, 2023-08-01T19:56:11.844 INFO:teuthology.orchestra.run.smithi008.stdout: { 2023-08-01T19:56:11.844 INFO:teuthology.orchestra.run.smithi008.stdout: "description": "osd_op(client.4668.0:222515 5.1 5:8481c6d5:::benchmark_data_smithi006_114134_object88854:head [delete] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e67)", 2023-08-01T19:56:11.844 INFO:teuthology.orchestra.run.smithi008.stdout: "initiated_at": "2023-08-01T19:56:11.758794+0000", 2023-08-01T19:56:11.844 INFO:teuthology.orchestra.run.smithi008.stdout: "age": 0.003183707, 2023-08-01T19:56:11.844 INFO:teuthology.orchestra.run.smithi008.stdout: "duration": 0.003836725, 2023-08-01T19:56:11.844 INFO:teuthology.orchestra.run.smithi008.stdout: "type_data": { 2023-08-01T19:56:11.844 INFO:teuthology.orchestra.run.smithi008.stdout: "flag_point": "started", 2023-08-01T19:56:11.845 INFO:teuthology.orchestra.run.smithi008.stdout: "client_info": { 2023-08-01T19:56:11.845 INFO:teuthology.orchestra.run.smithi008.stdout: "client": "client.4668", 2023-08-01T19:56:11.845 INFO:teuthology.orchestra.run.smithi008.stdout: "client_addr": "172.21.15.6:0/1709472247", 2023-08-01T19:56:11.845 INFO:teuthology.orchestra.run.smithi008.stdout: "tid": 222515 2023-08-01T19:56:11.845 INFO:teuthology.orchestra.run.smithi008.stdout: }, 2023-08-01T19:56:11.845 INFO:teuthology.orchestra.run.smithi008.stdout: "events": [ 2023-08-01T19:56:11.845 INFO:teuthology.orchestra.run.smithi008.stdout: { 2023-08-01T19:56:11.845 INFO:teuthology.orchestra.run.smithi008.stdout: "event": "initiated", 2023-08-01T19:56:11.846 INFO:teuthology.orchestra.run.smithi008.stdout: "time": "2023-08-01T19:56:11.758794+0000", 2023-08-01T19:56:11.846 INFO:teuthology.orchestra.run.smithi008.stdout: "duration": 0 2023-08-01T19:56:11.846 INFO:teuthology.orchestra.run.smithi008.stdout: }, 2023-08-01T19:56:11.846 INFO:teuthology.orchestra.run.smithi008.stdout: { 2023-08-01T19:56:11.847 INFO:teuthology.orchestra.run.smithi008.stdout: "event": "throttled", 2023-08-01T19:56:11.847 INFO:teuthology.orchestra.run.smithi008.stdout: "time": "2023-08-01T19:56:11.758794+0000", 2023-08-01T19:56:11.847 INFO:teuthology.orchestra.run.smithi008.stdout: "duration": 0 2023-08-01T19:56:11.847 INFO:teuthology.orchestra.run.smithi008.stdout: }, 2023-08-01T19:56:11.847 INFO:teuthology.orchestra.run.smithi008.stdout: { 2023-08-01T19:56:11.847 INFO:teuthology.orchestra.run.smithi008.stdout: "event": "header_read", 2023-08-01T19:56:11.847 INFO:teuthology.orchestra.run.smithi008.stdout: "time": "2023-08-01T19:56:11.758793+0000", 2023-08-01T19:56:11.848 INFO:teuthology.orchestra.run.smithi008.stdout: "duration": 4294967295.9999995 2023-08-01T19:56:11.848 INFO:teuthology.orchestra.run.smithi008.stdout: }, 2023-08-01T19:56:11.848 INFO:teuthology.orchestra.run.smithi008.stdout: { 2023-08-01T19:56:11.848 INFO:teuthology.orchestra.run.smithi008.stdout: "event": "all_read", 2023-08-01T19:56:11.848 INFO:teuthology.orchestra.run.smithi008.stdout: "time": "2023-08-01T19:56:11.758796+0000", 2023-08-01T19:56:11.848 INFO:teuthology.orchestra.run.smithi008.stdout: "duration": 3.208e-06 2023-08-01T19:56:11.848 INFO:teuthology.orchestra.run.smithi008.stdout: }, 2023-08-01T19:56:11.848 INFO:teuthology.orchestra.run.smithi008.stdout: { 2023-08-01T19:56:11.849 INFO:teuthology.orchestra.run.smithi008.stdout: "event": "dispatched", 2023-08-01T19:56:11.849 INFO:teuthology.orchestra.run.smithi008.stdout: "time": "2023-08-01T19:56:11.758804+0000", 2023-08-01T19:56:11.849 INFO:teuthology.orchestra.run.smithi008.stdout: "duration": 7.3250000000000002e-06 2023-08-01T19:56:11.849 INFO:teuthology.orchestra.run.smithi008.stdout: }, 2023-08-01T19:56:11.849 INFO:teuthology.orchestra.run.smithi008.stdout: { 2023-08-01T19:56:11.849 INFO:teuthology.orchestra.run.smithi008.stdout: "event": "queued_for_pg", 2023-08-01T19:56:11.849 INFO:teuthology.orchestra.run.smithi008.stdout: "time": "2023-08-01T19:56:11.758809+0000", 2023-08-01T19:56:11.850 INFO:teuthology.orchestra.run.smithi008.stdout: "duration": 5.2900000000000002e-06 2023-08-01T19:56:11.850 INFO:teuthology.orchestra.run.smithi008.stdout: }, 2023-08-01T19:56:11.850 INFO:teuthology.orchestra.run.smithi008.stdout: { 2023-08-01T19:56:11.850 INFO:teuthology.orchestra.run.smithi008.stdout: "event": "reached_pg", 2023-08-01T19:56:11.850 INFO:teuthology.orchestra.run.smithi008.stdout: "time": "2023-08-01T19:56:11.758852+0000", 2023-08-01T19:56:11.850 INFO:teuthology.orchestra.run.smithi008.stdout: "duration": 4.3207000000000002e-05 2023-08-01T19:56:11.850 INFO:teuthology.orchestra.run.smithi008.stdout: }, 2023-08-01T19:56:11.850 INFO:teuthology.orchestra.run.smithi008.stdout: { 2023-08-01T19:56:11.851 INFO:teuthology.orchestra.run.smithi008.stdout: "event": "started", 2023-08-01T19:56:11.851 INFO:teuthology.orchestra.run.smithi008.stdout: "time": "2023-08-01T19:56:11.758975+0000", 2023-08-01T19:56:11.851 INFO:teuthology.orchestra.run.smithi008.stdout: "duration": 0.00012290599999999999 2023-08-01T19:56:11.851 INFO:teuthology.orchestra.run.smithi008.stdout: } 2023-08-01T19:56:11.851 INFO:teuthology.orchestra.run.smithi008.stdout: ] 2023-08-01T19:56:11.851 INFO:teuthology.orchestra.run.smithi008.stdout: } 2023-08-01T19:56:11.851 INFO:teuthology.orchestra.run.smithi008.stdout: }, 2023-08-01T19:56:11.851 INFO:teuthology.orchestra.run.smithi008.stdout: { 2023-08-01T19:56:11.852 INFO:teuthology.orchestra.run.smithi008.stdout: "description": "osd_op(client.4668.0:222517 5.c 5:349ed0a0:::benchmark_data_smithi006_114134_object88856:head [delete] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e67)", 2023-08-01T19:56:11.852 INFO:teuthology.orchestra.run.smithi008.stdout: "initiated_at": "2023-08-01T19:56:11.758818+0000", 2023-08-01T19:56:11.852 INFO:teuthology.orchestra.run.smithi008.stdout: "age": 0.003158826, 2023-08-01T19:56:11.852 INFO:teuthology.orchestra.run.smithi008.stdout: "duration": 0.003869103, 2023-08-01T19:56:11.852 INFO:teuthology.orchestra.run.smithi008.stdout: "type_data": { 2023-08-01T19:56:11.852 INFO:teuthology.orchestra.run.smithi008.stdout: "flag_point": "started", 2023-08-01T19:56:11.852 INFO:teuthology.orchestra.run.smithi008.stdout: "client_info": { 2023-08-01T19:56:11.853 INFO:teuthology.orchestra.run.smithi008.stdout: "client": "client.4668", 2023-08-01T19:56:11.853 INFO:teuthology.orchestra.run.smithi008.stdout: "client_addr": "172.21.15.6:0/1709472247", 2023-08-01T19:56:11.853 INFO:teuthology.orchestra.run.smithi008.stdout: "tid": 222517 2023-08-01T19:56:11.853 INFO:teuthology.orchestra.run.smithi008.stdout: }, 2023-08-01T19:56:11.853 INFO:teuthology.orchestra.run.smithi008.stdout: "events": [ 2023-08-01T19:56:11.853 INFO:teuthology.orchestra.run.smithi008.stdout: { 2023-08-01T19:56:11.853 INFO:teuthology.orchestra.run.smithi008.stdout: "event": "initiated", 2023-08-01T19:56:11.853 INFO:teuthology.orchestra.run.smithi008.stdout: "time": "2023-08-01T19:56:11.758818+0000", 2023-08-01T19:56:11.854 INFO:teuthology.orchestra.run.smithi008.stdout: "duration": 0 2023-08-01T19:56:11.854 INFO:teuthology.orchestra.run.smithi008.stdout: }, 2023-08-01T19:56:11.854 INFO:teuthology.orchestra.run.smithi008.stdout: { 2023-08-01T19:56:11.854 INFO:teuthology.orchestra.run.smithi008.stdout: "event": "throttled", 2023-08-01T19:56:11.854 INFO:teuthology.orchestra.run.smithi008.stdout: "time": "2023-08-01T19:56:11.758818+0000", 2023-08-01T19:56:11.854 INFO:teuthology.orchestra.run.smithi008.stdout: "duration": 0 2023-08-01T19:56:11.854 INFO:teuthology.orchestra.run.smithi008.stdout: }, 2023-08-01T19:56:11.854 INFO:teuthology.orchestra.run.smithi008.stdout: { 2023-08-01T19:56:11.855 INFO:teuthology.orchestra.run.smithi008.stdout: "event": "header_read", 2023-08-01T19:56:11.855 INFO:teuthology.orchestra.run.smithi008.stdout: "time": "2023-08-01T19:56:11.758818+0000", 2023-08-01T19:56:11.855 INFO:teuthology.orchestra.run.smithi008.stdout: "duration": 4294967295.9999995 2023-08-01T19:56:11.855 INFO:teuthology.orchestra.run.smithi008.stdout: }, 2023-08-01T19:56:11.855 INFO:teuthology.orchestra.run.smithi008.stdout: { 2023-08-01T19:56:11.855 INFO:teuthology.orchestra.run.smithi008.stdout: "event": "all_read", 2023-08-01T19:56:11.855 INFO:teuthology.orchestra.run.smithi008.stdout: "time": "2023-08-01T19:56:11.758821+0000", 2023-08-01T19:56:11.855 INFO:teuthology.orchestra.run.smithi008.stdout: "duration": 2.8270000000000002e-06 2023-08-01T19:56:11.856 INFO:teuthology.orchestra.run.smithi008.stdout: }, 2023-08-01T19:56:11.856 INFO:teuthology.orchestra.run.smithi008.stdout: { 2023-08-01T19:56:11.856 INFO:teuthology.orchestra.run.smithi008.stdout: "event": "dispatched", 2023-08-01T19:56:11.856 INFO:teuthology.orchestra.run.smithi008.stdout: "time": "2023-08-01T19:56:11.758828+0000", 2023-08-01T19:56:11.856 INFO:teuthology.orchestra.run.smithi008.stdout: "duration": 6.7000000000000002e-06 2023-08-01T19:56:11.856 INFO:teuthology.orchestra.run.smithi008.stdout: }, 2023-08-01T19:56:11.856 INFO:teuthology.orchestra.run.smithi008.stdout: { 2023-08-01T19:56:11.857 INFO:teuthology.orchestra.run.smithi008.stdout: "event": "queued_for_pg", 2023-08-01T19:56:11.857 INFO:teuthology.orchestra.run.smithi008.stdout: "time": "2023-08-01T19:56:11.758831+0000", 2023-08-01T19:56:11.857 INFO:teuthology.orchestra.run.smithi008.stdout: "duration": 3.8789999999999996e-06 2023-08-01T19:56:11.857 INFO:teuthology.orchestra.run.smithi008.stdout: }, 2023-08-01T19:56:11.857 INFO:teuthology.orchestra.run.smithi008.stdout: { 2023-08-01T19:56:11.857 INFO:teuthology.orchestra.run.smithi008.stdout: "event": "reached_pg", 2023-08-01T19:56:11.857 INFO:teuthology.orchestra.run.smithi008.stdout: "time": "2023-08-01T19:56:11.758864+0000", 2023-08-01T19:56:11.858 INFO:teuthology.orchestra.run.smithi008.stdout: "duration": 3.2199000000000001e-05 2023-08-01T19:56:11.858 INFO:teuthology.orchestra.run.smithi008.stdout: }, 2023-08-01T19:56:11.858 INFO:teuthology.orchestra.run.smithi008.stdout: { 2023-08-01T19:56:11.858 INFO:teuthology.orchestra.run.smithi008.stdout: "event": "started", 2023-08-01T19:56:11.858 INFO:teuthology.orchestra.run.smithi008.stdout: "time": "2023-08-01T19:56:11.759413+0000", 2023-08-01T19:56:11.858 INFO:teuthology.orchestra.run.smithi008.stdout: "duration": 0.00054940299999999996 2023-08-01T19:56:11.858 INFO:teuthology.orchestra.run.smithi008.stdout: } 2023-08-01T19:56:11.858 INFO:teuthology.orchestra.run.smithi008.stdout: ] 2023-08-01T19:56:11.859 INFO:teuthology.orchestra.run.smithi008.stdout: } 2023-08-01T19:56:11.859 INFO:teuthology.orchestra.run.smithi008.stdout: }, 2023-08-01T19:56:11.859 INFO:teuthology.orchestra.run.smithi008.stdout: { 2023-08-01T19:56:11.859 INFO:teuthology.orchestra.run.smithi008.stdout: "description": "osd_op(client.4668.0:222520 5.c 5:344259b2:::benchmark_data_smithi006_114134_object88859:head [delete] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e67)", 2023-08-01T19:56:11.859 INFO:teuthology.orchestra.run.smithi008.stdout: "initiated_at": "2023-08-01T19:56:11.761010+0000", 2023-08-01T19:56:11.859 INFO:teuthology.orchestra.run.smithi008.stdout: "age": 0.00096696499999999997, 2023-08-01T19:56:11.859 INFO:teuthology.orchestra.run.smithi008.stdout: "duration": 0.0017382249999999999, 2023-08-01T19:56:11.860 INFO:teuthology.orchestra.run.smithi008.stdout: "type_data": { 2023-08-01T19:56:11.860 INFO:teuthology.orchestra.run.smithi008.stdout: "flag_point": "started", 2023-08-01T19:56:11.860 INFO:teuthology.orchestra.run.smithi008.stdout: "client_info": { 2023-08-01T19:56:11.860 INFO:teuthology.orchestra.run.smithi008.stdout: "client": "client.4668", 2023-08-01T19:56:11.860 INFO:teuthology.orchestra.run.smithi008.stdout: "client_addr": "172.21.15.6:0/1709472247", 2023-08-01T19:56:11.860 INFO:teuthology.orchestra.run.smithi008.stdout: "tid": 222520 2023-08-01T19:56:11.860 INFO:teuthology.orchestra.run.smithi008.stdout: }, 2023-08-01T19:56:11.860 INFO:teuthology.orchestra.run.smithi008.stdout: "events": [ 2023-08-01T19:56:11.861 INFO:teuthology.orchestra.run.smithi008.stdout: { 2023-08-01T19:56:11.861 INFO:teuthology.orchestra.run.smithi008.stdout: "event": "initiated", 2023-08-01T19:56:11.861 INFO:teuthology.orchestra.run.smithi008.stdout: "time": "2023-08-01T19:56:11.761010+0000", 2023-08-01T19:56:11.861 INFO:teuthology.orchestra.run.smithi008.stdout: "duration": 0 2023-08-01T19:56:11.861 INFO:teuthology.orchestra.run.smithi008.stdout: }, 2023-08-01T19:56:11.861 INFO:teuthology.orchestra.run.smithi008.stdout: { 2023-08-01T19:56:11.861 INFO:teuthology.orchestra.run.smithi008.stdout: "event": "throttled", 2023-08-01T19:56:11.862 INFO:teuthology.orchestra.run.smithi008.stdout: "time": "2023-08-01T19:56:11.761010+0000", 2023-08-01T19:56:11.862 INFO:teuthology.orchestra.run.smithi008.stdout: "duration": 0 2023-08-01T19:56:11.862 INFO:teuthology.orchestra.run.smithi008.stdout: }, 2023-08-01T19:56:11.862 INFO:teuthology.orchestra.run.smithi008.stdout: { 2023-08-01T19:56:11.862 INFO:teuthology.orchestra.run.smithi008.stdout: "event": "header_read", 2023-08-01T19:56:11.862 INFO:teuthology.orchestra.run.smithi008.stdout: "time": "2023-08-01T19:56:11.761009+0000", 2023-08-01T19:56:11.862 INFO:teuthology.orchestra.run.smithi008.stdout: "duration": 4294967295.999999 2023-08-01T19:56:11.862 INFO:teuthology.orchestra.run.smithi008.stdout: }, 2023-08-01T19:56:11.863 INFO:teuthology.orchestra.run.smithi008.stdout: { 2023-08-01T19:56:11.863 INFO:teuthology.orchestra.run.smithi008.stdout: "event": "all_read", 2023-08-01T19:56:11.863 INFO:teuthology.orchestra.run.smithi008.stdout: "time": "2023-08-01T19:56:11.761014+0000", 2023-08-01T19:56:11.863 INFO:teuthology.orchestra.run.smithi008.stdout: "duration": 4.5070000000000002e-06 2023-08-01T19:56:11.863 INFO:teuthology.orchestra.run.smithi008.stdout: }, 2023-08-01T19:56:11.863 INFO:teuthology.orchestra.run.smithi008.stdout: { 2023-08-01T19:56:11.863 INFO:teuthology.orchestra.run.smithi008.stdout: "event": "dispatched", 2023-08-01T19:56:11.863 INFO:teuthology.orchestra.run.smithi008.stdout: "time": "2023-08-01T19:56:11.761032+0000", 2023-08-01T19:56:11.864 INFO:teuthology.orchestra.run.smithi008.stdout: "duration": 1.8400999999999999e-05 2023-08-01T19:56:11.864 INFO:teuthology.orchestra.run.smithi008.stdout: }, 2023-08-01T19:56:11.864 INFO:teuthology.orchestra.run.smithi008.stdout: { 2023-08-01T19:56:11.864 INFO:teuthology.orchestra.run.smithi008.stdout: "event": "queued_for_pg", 2023-08-01T19:56:11.864 INFO:teuthology.orchestra.run.smithi008.stdout: "time": "2023-08-01T19:56:11.761039+0000", 2023-08-01T19:56:11.864 INFO:teuthology.orchestra.run.smithi008.stdout: "duration": 6.3709999999999996e-06 2023-08-01T19:56:11.864 INFO:teuthology.orchestra.run.smithi008.stdout: }, 2023-08-01T19:56:11.865 INFO:teuthology.orchestra.run.smithi008.stdout: { 2023-08-01T19:56:11.865 INFO:teuthology.orchestra.run.smithi008.stdout: "event": "reached_pg", 2023-08-01T19:56:11.865 INFO:teuthology.orchestra.run.smithi008.stdout: "time": "2023-08-01T19:56:11.761066+0000", 2023-08-01T19:56:11.865 INFO:teuthology.orchestra.run.smithi008.stdout: "duration": 2.6903999999999999e-05 2023-08-01T19:56:11.865 INFO:teuthology.orchestra.run.smithi008.stdout: }, 2023-08-01T19:56:11.865 INFO:teuthology.orchestra.run.smithi008.stdout: { 2023-08-01T19:56:11.865 INFO:teuthology.orchestra.run.smithi008.stdout: "event": "started", 2023-08-01T19:56:11.865 INFO:teuthology.orchestra.run.smithi008.stdout: "time": "2023-08-01T19:56:11.761142+0000", 2023-08-01T19:56:11.866 INFO:teuthology.orchestra.run.smithi008.stdout: "duration": 7.6023e-05 2023-08-01T19:56:11.866 INFO:teuthology.orchestra.run.smithi008.stdout: } 2023-08-01T19:56:11.866 INFO:teuthology.orchestra.run.smithi008.stdout: ] 2023-08-01T19:56:11.866 INFO:teuthology.orchestra.run.smithi008.stdout: } 2023-08-01T19:56:11.866 INFO:teuthology.orchestra.run.smithi008.stdout: } 2023-08-01T19:56:11.866 INFO:teuthology.orchestra.run.smithi008.stdout: ], 2023-08-01T19:56:11.866 INFO:teuthology.orchestra.run.smithi008.stdout: "num_ops": 13 2023-08-01T19:56:11.866 INFO:teuthology.orchestra.run.smithi008.stdout:} 2023-08-01T19:56:11.868 INFO:tasks.ceph.osd.2.smithi155.stderr:2023-08-01T19:56:11.867+0000 7faa5c6ac700 -1 received signal: Hangup from /usr/bin/python3 /bin/daemon-helper kill ceph-osd -f --cluster ceph -i 2 (PID: 111337) UID: 0 2023-08-01T19:56:11.868 DEBUG:teuthology.orchestra.run.smithi008:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 30 ceph --cluster ceph --admin-daemon /var/run/ceph/ceph-osd.0.asok dump_blocked_ops 2023-08-01T19:56:11.969 INFO:tasks.ceph.osd.0.smithi008.stderr:2023-08-01T19:56:11.967+0000 7f16a58f4700 -1 received signal: Hangup from /usr/bin/python3 /bin/daemon-helper kill ceph-osd -f --cluster ceph -i 0 (PID: 111179) UID: 0 2023-08-01T19:56:12.069 INFO:tasks.ceph.osd.2.smithi155.stderr:2023-08-01T19:56:12.068+0000 7faa5c6ac700 -1 received signal: Hangup from /usr/bin/python3 /bin/daemon-helper kill ceph-osd -f --cluster ceph -i 2 (PID: 111337) UID: 0 2023-08-01T19:56:12.073 INFO:teuthology.orchestra.run.smithi008.stdout:{ 2023-08-01T19:56:12.074 INFO:teuthology.orchestra.run.smithi008.stdout: "ops": [], 2023-08-01T19:56:12.074 INFO:teuthology.orchestra.run.smithi008.stdout: "complaint_time": 30, 2023-08-01T19:56:12.074 INFO:teuthology.orchestra.run.smithi008.stdout: "num_blocked_ops": 0 2023-08-01T19:56:12.074 INFO:teuthology.orchestra.run.smithi008.stdout:} 2023-08-01T19:56:12.085 INFO:teuthology.orchestra.run.smithi006.stderr:nodeep-scrub is set 2023-08-01T19:56:12.089 DEBUG:teuthology.orchestra.run.smithi008:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 30 ceph --cluster ceph --admin-daemon /var/run/ceph/ceph-osd.0.asok dump_historic_ops 2023-08-01T19:56:12.172 INFO:tasks.ceph.osd.0.smithi008.stderr:2023-08-01T19:56:12.171+0000 7f16a58f4700 -1 received signal: Hangup from /usr/bin/python3 /bin/daemon-helper kill ceph-osd -f --cluster ceph -i 0 (PID: 111179) UID: 0 2023-08-01T19:56:12.271 INFO:tasks.ceph.osd.2.smithi155.stderr:2023-08-01T19:56:12.270+0000 7faa5c6ac700 -1 received signal: Hangup from /usr/bin/python3 /bin/daemon-helper kill ceph-osd -f --cluster ceph -i 2 (PID: 111337) UID: 0 2023-08-01T19:56:12.320 INFO:teuthology.orchestra.run.smithi008.stdout:{ 2023-08-01T19:56:12.321 INFO:teuthology.orchestra.run.smithi008.stdout: "size": 20, 2023-08-01T19:56:12.321 INFO:teuthology.orchestra.run.smithi008.stdout: "duration": 600, 2023-08-01T19:56:12.321 INFO:teuthology.orchestra.run.smithi008.stdout: "ops": [ 2023-08-01T19:56:12.321 INFO:teuthology.orchestra.run.smithi008.stdout: { 2023-08-01T19:56:12.321 INFO:teuthology.orchestra.run.smithi008.stdout: "description": "osd_op(client.4668.0:100240 5.a 5:5313c5b9:::benchmark_data_smithi006_114134_object100239:head [set-alloc-hint object_size 65536 write_size 65536,write 0~65536] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e37)", 2023-08-01T19:56:12.321 INFO:teuthology.orchestra.run.smithi008.stdout: "initiated_at": "2023-08-01T19:55:05.148399+0000", 2023-08-01T19:56:12.322 INFO:teuthology.orchestra.run.smithi008.stdout: "age": 67.169461795999993, 2023-08-01T19:56:12.322 INFO:teuthology.orchestra.run.smithi008.stdout: "duration": 0.077278904999999995, 2023-08-01T19:56:12.322 INFO:teuthology.orchestra.run.smithi008.stdout: "type_data": { 2023-08-01T19:56:12.322 INFO:teuthology.orchestra.run.smithi008.stdout: "flag_point": "commit sent; apply or cleanup", 2023-08-01T19:56:12.322 INFO:teuthology.orchestra.run.smithi008.stdout: "client_info": { 2023-08-01T19:56:12.322 INFO:teuthology.orchestra.run.smithi008.stdout: "client": "client.4668", 2023-08-01T19:56:12.322 INFO:teuthology.orchestra.run.smithi008.stdout: "client_addr": "172.21.15.6:0/1709472247", 2023-08-01T19:56:12.323 INFO:teuthology.orchestra.run.smithi008.stdout: "tid": 100240 2023-08-01T19:56:12.323 INFO:teuthology.orchestra.run.smithi008.stdout: }, 2023-08-01T19:56:12.323 INFO:teuthology.orchestra.run.smithi008.stdout: "events": [ 2023-08-01T19:56:12.323 INFO:teuthology.orchestra.run.smithi008.stdout: { 2023-08-01T19:56:12.323 INFO:teuthology.orchestra.run.smithi008.stdout: "event": "initiated", 2023-08-01T19:56:12.323 INFO:teuthology.orchestra.run.smithi008.stdout: "time": "2023-08-01T19:55:05.148399+0000", 2023-08-01T19:56:12.323 INFO:teuthology.orchestra.run.smithi008.stdout: "duration": 0 2023-08-01T19:56:12.323 INFO:teuthology.orchestra.run.smithi008.stdout: }, 2023-08-01T19:56:12.324 INFO:teuthology.orchestra.run.smithi008.stdout: { 2023-08-01T19:56:12.324 INFO:teuthology.orchestra.run.smithi008.stdout: "event": "throttled", 2023-08-01T19:56:12.324 INFO:teuthology.orchestra.run.smithi008.stdout: "time": "2023-08-01T19:55:05.148399+0000", 2023-08-01T19:56:12.324 INFO:teuthology.orchestra.run.smithi008.stdout: "duration": 0 2023-08-01T19:56:12.324 INFO:teuthology.orchestra.run.smithi008.stdout: }, 2023-08-01T19:56:12.324 INFO:teuthology.orchestra.run.smithi008.stdout: { 2023-08-01T19:56:12.324 INFO:teuthology.orchestra.run.smithi008.stdout: "event": "header_read", 2023-08-01T19:56:12.325 INFO:teuthology.orchestra.run.smithi008.stdout: "time": "2023-08-01T19:55:05.148398+0000", 2023-08-01T19:56:12.325 INFO:teuthology.orchestra.run.smithi008.stdout: "duration": 4294967295.999999 2023-08-01T19:56:12.325 INFO:teuthology.orchestra.run.smithi008.stdout: }, 2023-08-01T19:56:12.325 INFO:teuthology.orchestra.run.smithi008.stdout: { 2023-08-01T19:56:12.325 INFO:teuthology.orchestra.run.smithi008.stdout: "event": "all_read", 2023-08-01T19:56:12.325 INFO:teuthology.orchestra.run.smithi008.stdout: "time": "2023-08-01T19:55:05.148492+0000", 2023-08-01T19:56:12.325 INFO:teuthology.orchestra.run.smithi008.stdout: "duration": 9.3892000000000002e-05 2023-08-01T19:56:12.325 INFO:teuthology.orchestra.run.smithi008.stdout: }, 2023-08-01T19:56:12.326 INFO:teuthology.orchestra.run.smithi008.stdout: { 2023-08-01T19:56:12.326 INFO:teuthology.orchestra.run.smithi008.stdout: "event": "dispatched", 2023-08-01T19:56:12.326 INFO:teuthology.orchestra.run.smithi008.stdout: "time": "2023-08-01T19:55:05.148503+0000", 2023-08-01T19:56:12.326 INFO:teuthology.orchestra.run.smithi008.stdout: "duration": 1.0951000000000001e-05 2023-08-01T19:56:12.326 INFO:teuthology.orchestra.run.smithi008.stdout: }, 2023-08-01T19:56:12.326 INFO:teuthology.orchestra.run.smithi008.stdout: { 2023-08-01T19:56:12.326 INFO:teuthology.orchestra.run.smithi008.stdout: "event": "queued_for_pg", 2023-08-01T19:56:12.327 INFO:teuthology.orchestra.run.smithi008.stdout: "time": "2023-08-01T19:55:05.148508+0000", 2023-08-01T19:56:12.327 INFO:teuthology.orchestra.run.smithi008.stdout: "duration": 5.0080000000000002e-06 2023-08-01T19:56:12.327 INFO:teuthology.orchestra.run.smithi008.stdout: }, 2023-08-01T19:56:12.327 INFO:teuthology.orchestra.run.smithi008.stdout: { 2023-08-01T19:56:12.327 INFO:teuthology.orchestra.run.smithi008.stdout: "event": "reached_pg", 2023-08-01T19:56:12.327 INFO:teuthology.orchestra.run.smithi008.stdout: "time": "2023-08-01T19:55:05.148548+0000", 2023-08-01T19:56:12.327 INFO:teuthology.orchestra.run.smithi008.stdout: "duration": 4.0358999999999998e-05 2023-08-01T19:56:12.328 INFO:teuthology.orchestra.run.smithi008.stdout: }, 2023-08-01T19:56:12.328 INFO:teuthology.orchestra.run.smithi008.stdout: { 2023-08-01T19:56:12.328 INFO:teuthology.orchestra.run.smithi008.stdout: "event": "started", 2023-08-01T19:56:12.328 INFO:teuthology.orchestra.run.smithi008.stdout: "time": "2023-08-01T19:55:05.148666+0000", 2023-08-01T19:56:12.328 INFO:teuthology.orchestra.run.smithi008.stdout: "duration": 0.000117621 2023-08-01T19:56:12.328 INFO:teuthology.orchestra.run.smithi008.stdout: }, 2023-08-01T19:56:12.328 INFO:teuthology.orchestra.run.smithi008.stdout: { 2023-08-01T19:56:12.328 INFO:teuthology.orchestra.run.smithi008.stdout: "event": "waiting for subops from 2", 2023-08-01T19:56:12.329 INFO:teuthology.orchestra.run.smithi008.stdout: "time": "2023-08-01T19:55:05.148805+0000", 2023-08-01T19:56:12.329 INFO:teuthology.orchestra.run.smithi008.stdout: "duration": 0.000139176 2023-08-01T19:56:12.329 INFO:teuthology.orchestra.run.smithi008.stdout: }, 2023-08-01T19:56:12.329 INFO:teuthology.orchestra.run.smithi008.stdout: { 2023-08-01T19:56:12.329 INFO:teuthology.orchestra.run.smithi008.stdout: "event": "op_commit", 2023-08-01T19:56:12.329 INFO:teuthology.orchestra.run.smithi008.stdout: "time": "2023-08-01T19:55:05.156143+0000", 2023-08-01T19:56:12.329 INFO:teuthology.orchestra.run.smithi008.stdout: "duration": 0.007338041 2023-08-01T19:56:12.329 INFO:teuthology.orchestra.run.smithi008.stdout: }, 2023-08-01T19:56:12.330 INFO:teuthology.orchestra.run.smithi008.stdout: { 2023-08-01T19:56:12.330 INFO:teuthology.orchestra.run.smithi008.stdout: "event": "sub_op_commit_rec", 2023-08-01T19:56:12.330 INFO:teuthology.orchestra.run.smithi008.stdout: "time": "2023-08-01T19:55:05.225581+0000", 2023-08-01T19:56:12.330 INFO:teuthology.orchestra.run.smithi008.stdout: "duration": 0.069438402999999996 2023-08-01T19:56:12.330 INFO:teuthology.orchestra.run.smithi008.stdout: }, 2023-08-01T19:56:12.330 INFO:teuthology.orchestra.run.smithi008.stdout: { 2023-08-01T19:56:12.330 INFO:teuthology.orchestra.run.smithi008.stdout: "event": "commit_sent", 2023-08-01T19:56:12.331 INFO:teuthology.orchestra.run.smithi008.stdout: "time": "2023-08-01T19:55:05.225632+0000", 2023-08-01T19:56:12.331 INFO:teuthology.orchestra.run.smithi008.stdout: "duration": 5.0382e-05 2023-08-01T19:56:12.331 INFO:teuthology.orchestra.run.smithi008.stdout: }, 2023-08-01T19:56:12.331 INFO:teuthology.orchestra.run.smithi008.stdout: { 2023-08-01T19:56:12.331 INFO:teuthology.orchestra.run.smithi008.stdout: "event": "done", 2023-08-01T19:56:12.331 INFO:teuthology.orchestra.run.smithi008.stdout: "time": "2023-08-01T19:55:05.225677+0000", 2023-08-01T19:56:12.331 INFO:teuthology.orchestra.run.smithi008.stdout: "duration": 4.5893000000000003e-05 2023-08-01T19:56:12.331 INFO:teuthology.orchestra.run.smithi008.stdout: } 2023-08-01T19:56:12.332 INFO:teuthology.orchestra.run.smithi008.stdout: ] 2023-08-01T19:56:12.332 INFO:teuthology.orchestra.run.smithi008.stdout: } 2023-08-01T19:56:12.332 INFO:teuthology.orchestra.run.smithi008.stdout: }, 2023-08-01T19:56:12.332 INFO:teuthology.orchestra.run.smithi008.stdout: { 2023-08-01T19:56:12.332 INFO:teuthology.orchestra.run.smithi008.stdout: "description": "osd_op(client.4668.0:100243 5.a 5:5e8193b6:::benchmark_data_smithi006_114134_object100242:head [set-alloc-hint object_size 65536 write_size 65536,write 0~65536] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e37)", 2023-08-01T19:56:12.332 INFO:teuthology.orchestra.run.smithi008.stdout: "initiated_at": "2023-08-01T19:55:05.150737+0000", 2023-08-01T19:56:12.332 INFO:teuthology.orchestra.run.smithi008.stdout: "age": 67.167123341000007, 2023-08-01T19:56:12.333 INFO:teuthology.orchestra.run.smithi008.stdout: "duration": 0.075019885999999994, 2023-08-01T19:56:12.333 INFO:teuthology.orchestra.run.smithi008.stdout: "type_data": { 2023-08-01T19:56:12.333 INFO:teuthology.orchestra.run.smithi008.stdout: "flag_point": "commit sent; apply or cleanup", 2023-08-01T19:56:12.333 INFO:teuthology.orchestra.run.smithi008.stdout: "client_info": { 2023-08-01T19:56:12.333 INFO:teuthology.orchestra.run.smithi008.stdout: "client": "client.4668", 2023-08-01T19:56:12.333 INFO:teuthology.orchestra.run.smithi008.stdout: "client_addr": "172.21.15.6:0/1709472247", 2023-08-01T19:56:12.333 INFO:teuthology.orchestra.run.smithi008.stdout: "tid": 100243 2023-08-01T19:56:12.333 INFO:teuthology.orchestra.run.smithi008.stdout: }, 2023-08-01T19:56:12.334 INFO:teuthology.orchestra.run.smithi008.stdout: "events": [ 2023-08-01T19:56:12.334 INFO:teuthology.orchestra.run.smithi008.stdout: { 2023-08-01T19:56:12.334 INFO:teuthology.orchestra.run.smithi008.stdout: "event": "initiated", 2023-08-01T19:56:12.334 INFO:teuthology.orchestra.run.smithi008.stdout: "time": "2023-08-01T19:55:05.150737+0000", 2023-08-01T19:56:12.334 INFO:teuthology.orchestra.run.smithi008.stdout: "duration": 0 2023-08-01T19:56:12.334 INFO:teuthology.orchestra.run.smithi008.stdout: }, 2023-08-01T19:56:12.334 INFO:teuthology.orchestra.run.smithi008.stdout: { 2023-08-01T19:56:12.334 INFO:teuthology.orchestra.run.smithi008.stdout: "event": "throttled", 2023-08-01T19:56:12.335 INFO:teuthology.orchestra.run.smithi008.stdout: "time": "2023-08-01T19:55:05.150737+0000", 2023-08-01T19:56:12.335 INFO:teuthology.orchestra.run.smithi008.stdout: "duration": 0 2023-08-01T19:56:12.335 INFO:teuthology.orchestra.run.smithi008.stdout: }, 2023-08-01T19:56:12.335 INFO:teuthology.orchestra.run.smithi008.stdout: { 2023-08-01T19:56:12.335 INFO:teuthology.orchestra.run.smithi008.stdout: "event": "header_read", 2023-08-01T19:56:12.335 INFO:teuthology.orchestra.run.smithi008.stdout: "time": "2023-08-01T19:55:05.150736+0000", 2023-08-01T19:56:12.335 INFO:teuthology.orchestra.run.smithi008.stdout: "duration": 4294967295.999999 2023-08-01T19:56:12.336 INFO:teuthology.orchestra.run.smithi008.stdout: }, 2023-08-01T19:56:12.336 INFO:teuthology.orchestra.run.smithi008.stdout: { 2023-08-01T19:56:12.336 INFO:teuthology.orchestra.run.smithi008.stdout: "event": "all_read", 2023-08-01T19:56:12.336 INFO:teuthology.orchestra.run.smithi008.stdout: "time": "2023-08-01T19:55:05.150780+0000", 2023-08-01T19:56:12.336 INFO:teuthology.orchestra.run.smithi008.stdout: "duration": 4.3578999999999997e-05 2023-08-01T19:56:12.336 INFO:teuthology.orchestra.run.smithi008.stdout: }, 2023-08-01T19:56:12.336 INFO:teuthology.orchestra.run.smithi008.stdout: { 2023-08-01T19:56:12.336 INFO:teuthology.orchestra.run.smithi008.stdout: "event": "dispatched", 2023-08-01T19:56:12.337 INFO:teuthology.orchestra.run.smithi008.stdout: "time": "2023-08-01T19:55:05.150791+0000", 2023-08-01T19:56:12.337 INFO:teuthology.orchestra.run.smithi008.stdout: "duration": 1.0963e-05 2023-08-01T19:56:12.337 INFO:teuthology.orchestra.run.smithi008.stdout: }, 2023-08-01T19:56:12.337 INFO:teuthology.orchestra.run.smithi008.stdout: { 2023-08-01T19:56:12.337 INFO:teuthology.orchestra.run.smithi008.stdout: "event": "queued_for_pg", 2023-08-01T19:56:12.337 INFO:teuthology.orchestra.run.smithi008.stdout: "time": "2023-08-01T19:55:05.150797+0000", 2023-08-01T19:56:12.337 INFO:teuthology.orchestra.run.smithi008.stdout: "duration": 5.9780000000000002e-06 2023-08-01T19:56:12.337 INFO:teuthology.orchestra.run.smithi008.stdout: }, 2023-08-01T19:56:12.338 INFO:teuthology.orchestra.run.smithi008.stdout: { 2023-08-01T19:56:12.338 INFO:teuthology.orchestra.run.smithi008.stdout: "event": "reached_pg", 2023-08-01T19:56:12.338 INFO:teuthology.orchestra.run.smithi008.stdout: "time": "2023-08-01T19:55:05.150833+0000", 2023-08-01T19:56:12.338 INFO:teuthology.orchestra.run.smithi008.stdout: "duration": 3.6000000000000001e-05 2023-08-01T19:56:12.338 INFO:teuthology.orchestra.run.smithi008.stdout: }, 2023-08-01T19:56:12.338 INFO:teuthology.orchestra.run.smithi008.stdout: { 2023-08-01T19:56:12.338 INFO:teuthology.orchestra.run.smithi008.stdout: "event": "started", 2023-08-01T19:56:12.339 INFO:teuthology.orchestra.run.smithi008.stdout: "time": "2023-08-01T19:55:05.150951+0000", 2023-08-01T19:56:12.339 INFO:teuthology.orchestra.run.smithi008.stdout: "duration": 0.00011827799999999999 2023-08-01T19:56:12.339 INFO:teuthology.orchestra.run.smithi008.stdout: }, 2023-08-01T19:56:12.339 INFO:teuthology.orchestra.run.smithi008.stdout: { 2023-08-01T19:56:12.339 INFO:teuthology.orchestra.run.smithi008.stdout: "event": "waiting for subops from 2", 2023-08-01T19:56:12.339 INFO:teuthology.orchestra.run.smithi008.stdout: "time": "2023-08-01T19:55:05.151111+0000", 2023-08-01T19:56:12.339 INFO:teuthology.orchestra.run.smithi008.stdout: "duration": 0.00015961299999999999 2023-08-01T19:56:12.339 INFO:teuthology.orchestra.run.smithi008.stdout: }, 2023-08-01T19:56:12.340 INFO:teuthology.orchestra.run.smithi008.stdout: { 2023-08-01T19:56:12.340 INFO:teuthology.orchestra.run.smithi008.stdout: "event": "op_commit", 2023-08-01T19:56:12.340 INFO:teuthology.orchestra.run.smithi008.stdout: "time": "2023-08-01T19:55:05.156247+0000", 2023-08-01T19:56:12.340 INFO:teuthology.orchestra.run.smithi008.stdout: "duration": 0.005136524 2023-08-01T19:56:12.340 INFO:teuthology.orchestra.run.smithi008.stdout: }, 2023-08-01T19:56:12.340 INFO:teuthology.orchestra.run.smithi008.stdout: { 2023-08-01T19:56:12.340 INFO:teuthology.orchestra.run.smithi008.stdout: "event": "sub_op_commit_rec", 2023-08-01T19:56:12.340 INFO:teuthology.orchestra.run.smithi008.stdout: "time": "2023-08-01T19:55:05.225705+0000", 2023-08-01T19:56:12.341 INFO:teuthology.orchestra.run.smithi008.stdout: "duration": 0.069458377000000002 2023-08-01T19:56:12.341 INFO:teuthology.orchestra.run.smithi008.stdout: }, 2023-08-01T19:56:12.341 INFO:teuthology.orchestra.run.smithi008.stdout: { 2023-08-01T19:56:12.341 INFO:teuthology.orchestra.run.smithi008.stdout: "event": "commit_sent", 2023-08-01T19:56:12.341 INFO:teuthology.orchestra.run.smithi008.stdout: "time": "2023-08-01T19:55:05.225736+0000", 2023-08-01T19:56:12.341 INFO:teuthology.orchestra.run.smithi008.stdout: "duration": 3.0388000000000001e-05 2023-08-01T19:56:12.341 INFO:teuthology.orchestra.run.smithi008.stdout: }, 2023-08-01T19:56:12.342 INFO:teuthology.orchestra.run.smithi008.stdout: { 2023-08-01T19:56:12.342 INFO:teuthology.orchestra.run.smithi008.stdout: "event": "done", 2023-08-01T19:56:12.342 INFO:teuthology.orchestra.run.smithi008.stdout: "time": "2023-08-01T19:55:05.225757+0000", 2023-08-01T19:56:12.342 INFO:teuthology.orchestra.run.smithi008.stdout: "duration": 2.1090999999999998e-05 2023-08-01T19:56:12.342 INFO:teuthology.orchestra.run.smithi008.stdout: } 2023-08-01T19:56:12.342 INFO:teuthology.orchestra.run.smithi008.stdout: ] 2023-08-01T19:56:12.342 INFO:teuthology.orchestra.run.smithi008.stdout: } 2023-08-01T19:56:12.342 INFO:teuthology.orchestra.run.smithi008.stdout: }, 2023-08-01T19:56:12.343 INFO:teuthology.orchestra.run.smithi008.stdout: { 2023-08-01T19:56:12.343 INFO:teuthology.orchestra.run.smithi008.stdout: "description": "osd_op(client.4668.0:100933 5.5 5:af92e9f2:::benchmark_data_smithi006_114134_object100932:head [set-alloc-hint object_size 65536 write_size 65536,write 0~65536] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e37)", 2023-08-01T19:56:12.343 INFO:teuthology.orchestra.run.smithi008.stdout: "initiated_at": "2023-08-01T19:55:05.566634+0000", 2023-08-01T19:56:12.343 INFO:teuthology.orchestra.run.smithi008.stdout: "age": 66.751226470000006, 2023-08-01T19:56:12.343 INFO:teuthology.orchestra.run.smithi008.stdout: "duration": 0.065909364999999998, 2023-08-01T19:56:12.343 INFO:teuthology.orchestra.run.smithi008.stdout: "type_data": { 2023-08-01T19:56:12.343 INFO:teuthology.orchestra.run.smithi008.stdout: "flag_point": "commit sent; apply or cleanup", 2023-08-01T19:56:12.344 INFO:teuthology.orchestra.run.smithi008.stdout: "client_info": { 2023-08-01T19:56:12.344 INFO:teuthology.orchestra.run.smithi008.stdout: "client": "client.4668", 2023-08-01T19:56:12.344 INFO:teuthology.orchestra.run.smithi008.stdout: "client_addr": "172.21.15.6:0/1709472247", 2023-08-01T19:56:12.344 INFO:teuthology.orchestra.run.smithi008.stdout: "tid": 100933 2023-08-01T19:56:12.344 INFO:teuthology.orchestra.run.smithi008.stdout: }, 2023-08-01T19:56:12.344 INFO:teuthology.orchestra.run.smithi008.stdout: "events": [ 2023-08-01T19:56:12.344 INFO:teuthology.orchestra.run.smithi008.stdout: { 2023-08-01T19:56:12.345 INFO:teuthology.orchestra.run.smithi008.stdout: "event": "initiated", 2023-08-01T19:56:12.345 INFO:teuthology.orchestra.run.smithi008.stdout: "time": "2023-08-01T19:55:05.566634+0000", 2023-08-01T19:56:12.345 INFO:teuthology.orchestra.run.smithi008.stdout: "duration": 0 2023-08-01T19:56:12.345 INFO:teuthology.orchestra.run.smithi008.stdout: }, 2023-08-01T19:56:12.345 INFO:teuthology.orchestra.run.smithi008.stdout: { 2023-08-01T19:56:12.345 INFO:teuthology.orchestra.run.smithi008.stdout: "event": "throttled", 2023-08-01T19:56:12.345 INFO:teuthology.orchestra.run.smithi008.stdout: "time": "2023-08-01T19:55:05.566634+0000", 2023-08-01T19:56:12.345 INFO:teuthology.orchestra.run.smithi008.stdout: "duration": 0 2023-08-01T19:56:12.346 INFO:teuthology.orchestra.run.smithi008.stdout: }, 2023-08-01T19:56:12.346 INFO:teuthology.orchestra.run.smithi008.stdout: { 2023-08-01T19:56:12.346 INFO:teuthology.orchestra.run.smithi008.stdout: "event": "header_read", 2023-08-01T19:56:12.346 INFO:teuthology.orchestra.run.smithi008.stdout: "time": "2023-08-01T19:55:05.566630+0000", 2023-08-01T19:56:12.346 INFO:teuthology.orchestra.run.smithi008.stdout: "duration": 4294967295.9999962 2023-08-01T19:56:12.346 INFO:teuthology.orchestra.run.smithi008.stdout: }, 2023-08-01T19:56:12.346 INFO:teuthology.orchestra.run.smithi008.stdout: { 2023-08-01T19:56:12.346 INFO:teuthology.orchestra.run.smithi008.stdout: "event": "all_read", 2023-08-01T19:56:12.347 INFO:teuthology.orchestra.run.smithi008.stdout: "time": "2023-08-01T19:55:05.566736+0000", 2023-08-01T19:56:12.347 INFO:teuthology.orchestra.run.smithi008.stdout: "duration": 0.000105752 2023-08-01T19:56:12.347 INFO:teuthology.orchestra.run.smithi008.stdout: }, 2023-08-01T19:56:12.347 INFO:teuthology.orchestra.run.smithi008.stdout: { 2023-08-01T19:56:12.347 INFO:teuthology.orchestra.run.smithi008.stdout: "event": "dispatched", 2023-08-01T19:56:12.347 INFO:teuthology.orchestra.run.smithi008.stdout: "time": "2023-08-01T19:55:05.566742+0000", 2023-08-01T19:56:12.347 INFO:teuthology.orchestra.run.smithi008.stdout: "duration": 5.8209999999999998e-06 2023-08-01T19:56:12.348 INFO:teuthology.orchestra.run.smithi008.stdout: }, 2023-08-01T19:56:12.348 INFO:teuthology.orchestra.run.smithi008.stdout: { 2023-08-01T19:56:12.348 INFO:teuthology.orchestra.run.smithi008.stdout: "event": "queued_for_pg", 2023-08-01T19:56:12.348 INFO:teuthology.orchestra.run.smithi008.stdout: "time": "2023-08-01T19:55:05.566745+0000", 2023-08-01T19:56:12.348 INFO:teuthology.orchestra.run.smithi008.stdout: "duration": 3.337e-06 2023-08-01T19:56:12.348 INFO:teuthology.orchestra.run.smithi008.stdout: }, 2023-08-01T19:56:12.348 INFO:teuthology.orchestra.run.smithi008.stdout: { 2023-08-01T19:56:12.348 INFO:teuthology.orchestra.run.smithi008.stdout: "event": "reached_pg", 2023-08-01T19:56:12.349 INFO:teuthology.orchestra.run.smithi008.stdout: "time": "2023-08-01T19:55:05.568175+0000", 2023-08-01T19:56:12.349 INFO:teuthology.orchestra.run.smithi008.stdout: "duration": 0.001429647 2023-08-01T19:56:12.349 INFO:teuthology.orchestra.run.smithi008.stdout: }, 2023-08-01T19:56:12.349 INFO:teuthology.orchestra.run.smithi008.stdout: { 2023-08-01T19:56:12.349 INFO:teuthology.orchestra.run.smithi008.stdout: "event": "started", 2023-08-01T19:56:12.349 INFO:teuthology.orchestra.run.smithi008.stdout: "time": "2023-08-01T19:55:05.568288+0000", 2023-08-01T19:56:12.349 INFO:teuthology.orchestra.run.smithi008.stdout: "duration": 0.000113353 2023-08-01T19:56:12.349 INFO:teuthology.orchestra.run.smithi008.stdout: }, 2023-08-01T19:56:12.350 INFO:teuthology.orchestra.run.smithi008.stdout: { 2023-08-01T19:56:12.350 INFO:teuthology.orchestra.run.smithi008.stdout: "event": "waiting for subops from 1", 2023-08-01T19:56:12.350 INFO:teuthology.orchestra.run.smithi008.stdout: "time": "2023-08-01T19:55:05.568425+0000", 2023-08-01T19:56:12.350 INFO:teuthology.orchestra.run.smithi008.stdout: "duration": 0.000137346 2023-08-01T19:56:12.350 INFO:teuthology.orchestra.run.smithi008.stdout: }, 2023-08-01T19:56:12.350 INFO:teuthology.orchestra.run.smithi008.stdout: { 2023-08-01T19:56:12.350 INFO:teuthology.orchestra.run.smithi008.stdout: "event": "sub_op_commit_rec", 2023-08-01T19:56:12.351 INFO:teuthology.orchestra.run.smithi008.stdout: "time": "2023-08-01T19:55:05.629320+0000", 2023-08-01T19:56:12.351 INFO:teuthology.orchestra.run.smithi008.stdout: "duration": 0.060894491000000002 2023-08-01T19:56:12.351 INFO:teuthology.orchestra.run.smithi008.stdout: }, 2023-08-01T19:56:12.351 INFO:teuthology.orchestra.run.smithi008.stdout: { 2023-08-01T19:56:12.351 INFO:teuthology.orchestra.run.smithi008.stdout: "event": "op_commit", 2023-08-01T19:56:12.351 INFO:teuthology.orchestra.run.smithi008.stdout: "time": "2023-08-01T19:55:05.632452+0000", 2023-08-01T19:56:12.351 INFO:teuthology.orchestra.run.smithi008.stdout: "duration": 0.003131909 2023-08-01T19:56:12.351 INFO:teuthology.orchestra.run.smithi008.stdout: }, 2023-08-01T19:56:12.352 INFO:teuthology.orchestra.run.smithi008.stdout: { 2023-08-01T19:56:12.352 INFO:teuthology.orchestra.run.smithi008.stdout: "event": "commit_sent", 2023-08-01T19:56:12.352 INFO:teuthology.orchestra.run.smithi008.stdout: "time": "2023-08-01T19:55:05.632503+0000", 2023-08-01T19:56:12.352 INFO:teuthology.orchestra.run.smithi008.stdout: "duration": 5.1295000000000003e-05 2023-08-01T19:56:12.352 INFO:teuthology.orchestra.run.smithi008.stdout: }, 2023-08-01T19:56:12.352 INFO:teuthology.orchestra.run.smithi008.stdout: { 2023-08-01T19:56:12.352 INFO:teuthology.orchestra.run.smithi008.stdout: "event": "done", 2023-08-01T19:56:12.352 INFO:teuthology.orchestra.run.smithi008.stdout: "time": "2023-08-01T19:55:05.632543+0000", 2023-08-01T19:56:12.353 INFO:teuthology.orchestra.run.smithi008.stdout: "duration": 4.0234000000000001e-05 2023-08-01T19:56:12.353 INFO:teuthology.orchestra.run.smithi008.stdout: } 2023-08-01T19:56:12.353 INFO:teuthology.orchestra.run.smithi008.stdout: ] 2023-08-01T19:56:12.353 INFO:teuthology.orchestra.run.smithi008.stdout: } 2023-08-01T19:56:12.353 INFO:teuthology.orchestra.run.smithi008.stdout: }, 2023-08-01T19:56:12.353 INFO:teuthology.orchestra.run.smithi008.stdout: { 2023-08-01T19:56:12.353 INFO:teuthology.orchestra.run.smithi008.stdout: "description": "osd_op(client.4668.0:100939 5.5 5:a75fa6e3:::benchmark_data_smithi006_114134_object100938:head [set-alloc-hint object_size 65536 write_size 65536,write 0~65536] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e37)", 2023-08-01T19:56:12.353 INFO:teuthology.orchestra.run.smithi008.stdout: "initiated_at": "2023-08-01T19:55:05.569740+0000", 2023-08-01T19:56:12.354 INFO:teuthology.orchestra.run.smithi008.stdout: "age": 66.748120799000006, 2023-08-01T19:56:12.354 INFO:teuthology.orchestra.run.smithi008.stdout: "duration": 0.067753412999999998, 2023-08-01T19:56:12.354 INFO:teuthology.orchestra.run.smithi008.stdout: "type_data": { 2023-08-01T19:56:12.354 INFO:teuthology.orchestra.run.smithi008.stdout: "flag_point": "commit sent; apply or cleanup", 2023-08-01T19:56:12.354 INFO:teuthology.orchestra.run.smithi008.stdout: "client_info": { 2023-08-01T19:56:12.354 INFO:teuthology.orchestra.run.smithi008.stdout: "client": "client.4668", 2023-08-01T19:56:12.354 INFO:teuthology.orchestra.run.smithi008.stdout: "client_addr": "172.21.15.6:0/1709472247", 2023-08-01T19:56:12.355 INFO:teuthology.orchestra.run.smithi008.stdout: "tid": 100939 2023-08-01T19:56:12.355 INFO:teuthology.orchestra.run.smithi008.stdout: }, 2023-08-01T19:56:12.355 INFO:teuthology.orchestra.run.smithi008.stdout: "events": [ 2023-08-01T19:56:12.355 INFO:teuthology.orchestra.run.smithi008.stdout: { 2023-08-01T19:56:12.355 INFO:teuthology.orchestra.run.smithi008.stdout: "event": "initiated", 2023-08-01T19:56:12.355 INFO:teuthology.orchestra.run.smithi008.stdout: "time": "2023-08-01T19:55:05.569740+0000", 2023-08-01T19:56:12.355 INFO:teuthology.orchestra.run.smithi008.stdout: "duration": 0 2023-08-01T19:56:12.355 INFO:teuthology.orchestra.run.smithi008.stdout: }, 2023-08-01T19:56:12.356 INFO:teuthology.orchestra.run.smithi008.stdout: { 2023-08-01T19:56:12.356 INFO:teuthology.orchestra.run.smithi008.stdout: "event": "throttled", 2023-08-01T19:56:12.356 INFO:teuthology.orchestra.run.smithi008.stdout: "time": "2023-08-01T19:55:05.569740+0000", 2023-08-01T19:56:12.356 INFO:teuthology.orchestra.run.smithi008.stdout: "duration": 0 2023-08-01T19:56:12.356 INFO:teuthology.orchestra.run.smithi008.stdout: }, 2023-08-01T19:56:12.356 INFO:teuthology.orchestra.run.smithi008.stdout: { 2023-08-01T19:56:12.356 INFO:teuthology.orchestra.run.smithi008.stdout: "event": "header_read", 2023-08-01T19:56:12.356 INFO:teuthology.orchestra.run.smithi008.stdout: "time": "2023-08-01T19:55:05.569739+0000", 2023-08-01T19:56:12.357 INFO:teuthology.orchestra.run.smithi008.stdout: "duration": 4294967295.9999995 2023-08-01T19:56:12.357 INFO:teuthology.orchestra.run.smithi008.stdout: }, 2023-08-01T19:56:12.357 INFO:teuthology.orchestra.run.smithi008.stdout: { 2023-08-01T19:56:12.357 INFO:teuthology.orchestra.run.smithi008.stdout: "event": "all_read", 2023-08-01T19:56:12.357 INFO:teuthology.orchestra.run.smithi008.stdout: "time": "2023-08-01T19:55:05.569839+0000", 2023-08-01T19:56:12.357 INFO:teuthology.orchestra.run.smithi008.stdout: "duration": 0.000100219 2023-08-01T19:56:12.357 INFO:teuthology.orchestra.run.smithi008.stdout: }, 2023-08-01T19:56:12.357 INFO:teuthology.orchestra.run.smithi008.stdout: { 2023-08-01T19:56:12.358 INFO:teuthology.orchestra.run.smithi008.stdout: "event": "dispatched", 2023-08-01T19:56:12.358 INFO:teuthology.orchestra.run.smithi008.stdout: "time": "2023-08-01T19:55:05.569846+0000", 2023-08-01T19:56:12.358 INFO:teuthology.orchestra.run.smithi008.stdout: "duration": 7.3150000000000003e-06 2023-08-01T19:56:12.358 INFO:teuthology.orchestra.run.smithi008.stdout: }, 2023-08-01T19:56:12.358 INFO:teuthology.orchestra.run.smithi008.stdout: { 2023-08-01T19:56:12.358 INFO:teuthology.orchestra.run.smithi008.stdout: "event": "queued_for_pg", 2023-08-01T19:56:12.358 INFO:teuthology.orchestra.run.smithi008.stdout: "time": "2023-08-01T19:55:05.569850+0000", 2023-08-01T19:56:12.359 INFO:teuthology.orchestra.run.smithi008.stdout: "duration": 3.3299999999999999e-06 2023-08-01T19:56:12.359 INFO:teuthology.orchestra.run.smithi008.stdout: }, 2023-08-01T19:56:12.359 INFO:teuthology.orchestra.run.smithi008.stdout: { 2023-08-01T19:56:12.359 INFO:teuthology.orchestra.run.smithi008.stdout: "event": "reached_pg", 2023-08-01T19:56:12.359 INFO:teuthology.orchestra.run.smithi008.stdout: "time": "2023-08-01T19:55:05.626991+0000", 2023-08-01T19:56:12.359 INFO:teuthology.orchestra.run.smithi008.stdout: "duration": 0.057141585000000002 2023-08-01T19:56:12.359 INFO:teuthology.orchestra.run.smithi008.stdout: }, 2023-08-01T19:56:12.359 INFO:teuthology.orchestra.run.smithi008.stdout: { 2023-08-01T19:56:12.360 INFO:teuthology.orchestra.run.smithi008.stdout: "event": "started", 2023-08-01T19:56:12.360 INFO:teuthology.orchestra.run.smithi008.stdout: "time": "2023-08-01T19:55:05.627111+0000", 2023-08-01T19:56:12.360 INFO:teuthology.orchestra.run.smithi008.stdout: "duration": 0.000119238 2023-08-01T19:56:12.360 INFO:teuthology.orchestra.run.smithi008.stdout: }, 2023-08-01T19:56:12.360 INFO:teuthology.orchestra.run.smithi008.stdout: { 2023-08-01T19:56:12.360 INFO:teuthology.orchestra.run.smithi008.stdout: "event": "waiting for subops from 1", 2023-08-01T19:56:12.360 INFO:teuthology.orchestra.run.smithi008.stdout: "time": "2023-08-01T19:55:05.627253+0000", 2023-08-01T19:56:12.360 INFO:teuthology.orchestra.run.smithi008.stdout: "duration": 0.000142822 2023-08-01T19:56:12.361 INFO:teuthology.orchestra.run.smithi008.stdout: }, 2023-08-01T19:56:12.361 INFO:teuthology.orchestra.run.smithi008.stdout: { 2023-08-01T19:56:12.361 INFO:teuthology.orchestra.run.smithi008.stdout: "event": "op_commit", 2023-08-01T19:56:12.361 INFO:teuthology.orchestra.run.smithi008.stdout: "time": "2023-08-01T19:55:05.632555+0000", 2023-08-01T19:56:12.361 INFO:teuthology.orchestra.run.smithi008.stdout: "duration": 0.0053012449999999996 2023-08-01T19:56:12.361 INFO:teuthology.orchestra.run.smithi008.stdout: }, 2023-08-01T19:56:12.361 INFO:teuthology.orchestra.run.smithi008.stdout: { 2023-08-01T19:56:12.361 INFO:teuthology.orchestra.run.smithi008.stdout: "event": "sub_op_commit_rec", 2023-08-01T19:56:12.362 INFO:teuthology.orchestra.run.smithi008.stdout: "time": "2023-08-01T19:55:05.637380+0000", 2023-08-01T19:56:12.362 INFO:teuthology.orchestra.run.smithi008.stdout: "duration": 0.0048257639999999997 2023-08-01T19:56:12.362 INFO:teuthology.orchestra.run.smithi008.stdout: }, 2023-08-01T19:56:12.362 INFO:teuthology.orchestra.run.smithi008.stdout: { 2023-08-01T19:56:12.362 INFO:teuthology.orchestra.run.smithi008.stdout: "event": "commit_sent", 2023-08-01T19:56:12.362 INFO:teuthology.orchestra.run.smithi008.stdout: "time": "2023-08-01T19:55:05.637454+0000", 2023-08-01T19:56:12.362 INFO:teuthology.orchestra.run.smithi008.stdout: "duration": 7.3578999999999995e-05 2023-08-01T19:56:12.362 INFO:teuthology.orchestra.run.smithi008.stdout: }, 2023-08-01T19:56:12.363 INFO:teuthology.orchestra.run.smithi008.stdout: { 2023-08-01T19:56:12.363 INFO:teuthology.orchestra.run.smithi008.stdout: "event": "done", 2023-08-01T19:56:12.363 INFO:teuthology.orchestra.run.smithi008.stdout: "time": "2023-08-01T19:55:05.637493+0000", 2023-08-01T19:56:12.363 INFO:teuthology.orchestra.run.smithi008.stdout: "duration": 3.8986999999999998e-05 2023-08-01T19:56:12.363 INFO:teuthology.orchestra.run.smithi008.stdout: } 2023-08-01T19:56:12.363 INFO:teuthology.orchestra.run.smithi008.stdout: ] 2023-08-01T19:56:12.363 INFO:teuthology.orchestra.run.smithi008.stdout: } 2023-08-01T19:56:12.364 INFO:teuthology.orchestra.run.smithi008.stdout: }, 2023-08-01T19:56:12.364 INFO:teuthology.orchestra.run.smithi008.stdout: { 2023-08-01T19:56:12.364 INFO:teuthology.orchestra.run.smithi008.stdout: "description": "osd_op(client.4668.0:107863 5.3 5:cbdd875a:::benchmark_data_smithi006_114134_object107862:head [set-alloc-hint object_size 65536 write_size 65536,write 0~65536] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e38)", 2023-08-01T19:56:12.364 INFO:teuthology.orchestra.run.smithi008.stdout: "initiated_at": "2023-08-01T19:55:09.278851+0000", 2023-08-01T19:56:12.364 INFO:teuthology.orchestra.run.smithi008.stdout: "age": 63.039009059000001, 2023-08-01T19:56:12.364 INFO:teuthology.orchestra.run.smithi008.stdout: "duration": 0.071378853000000006, 2023-08-01T19:56:12.364 INFO:teuthology.orchestra.run.smithi008.stdout: "type_data": { 2023-08-01T19:56:12.364 INFO:teuthology.orchestra.run.smithi008.stdout: "flag_point": "commit sent; apply or cleanup", 2023-08-01T19:56:12.365 INFO:teuthology.orchestra.run.smithi008.stdout: "client_info": { 2023-08-01T19:56:12.365 INFO:teuthology.orchestra.run.smithi008.stdout: "client": "client.4668", 2023-08-01T19:56:12.365 INFO:teuthology.orchestra.run.smithi008.stdout: "client_addr": "172.21.15.6:0/1709472247", 2023-08-01T19:56:12.365 INFO:teuthology.orchestra.run.smithi008.stdout: "tid": 107863 2023-08-01T19:56:12.365 INFO:teuthology.orchestra.run.smithi008.stdout: }, 2023-08-01T19:56:12.365 INFO:teuthology.orchestra.run.smithi008.stdout: "events": [ 2023-08-01T19:56:12.365 INFO:teuthology.orchestra.run.smithi008.stdout: { 2023-08-01T19:56:12.365 INFO:teuthology.orchestra.run.smithi008.stdout: "event": "initiated", 2023-08-01T19:56:12.366 INFO:teuthology.orchestra.run.smithi008.stdout: "time": "2023-08-01T19:55:09.278851+0000", 2023-08-01T19:56:12.366 INFO:teuthology.orchestra.run.smithi008.stdout: "duration": 0 2023-08-01T19:56:12.366 INFO:teuthology.orchestra.run.smithi008.stdout: }, 2023-08-01T19:56:12.366 INFO:teuthology.orchestra.run.smithi008.stdout: { 2023-08-01T19:56:12.366 INFO:teuthology.orchestra.run.smithi008.stdout: "event": "throttled", 2023-08-01T19:56:12.366 INFO:teuthology.orchestra.run.smithi008.stdout: "time": "2023-08-01T19:55:09.278851+0000", 2023-08-01T19:56:12.366 INFO:teuthology.orchestra.run.smithi008.stdout: "duration": 0 2023-08-01T19:56:12.366 INFO:teuthology.orchestra.run.smithi008.stdout: }, 2023-08-01T19:56:12.367 INFO:teuthology.orchestra.run.smithi008.stdout: { 2023-08-01T19:56:12.367 INFO:teuthology.orchestra.run.smithi008.stdout: "event": "header_read", 2023-08-01T19:56:12.367 INFO:teuthology.orchestra.run.smithi008.stdout: "time": "2023-08-01T19:55:09.278850+0000", 2023-08-01T19:56:12.367 INFO:teuthology.orchestra.run.smithi008.stdout: "duration": 4294967295.999999 2023-08-01T19:56:12.367 INFO:teuthology.orchestra.run.smithi008.stdout: }, 2023-08-01T19:56:12.367 INFO:teuthology.orchestra.run.smithi008.stdout: { 2023-08-01T19:56:12.367 INFO:teuthology.orchestra.run.smithi008.stdout: "event": "all_read", 2023-08-01T19:56:12.367 INFO:teuthology.orchestra.run.smithi008.stdout: "time": "2023-08-01T19:55:09.278945+0000", 2023-08-01T19:56:12.368 INFO:teuthology.orchestra.run.smithi008.stdout: "duration": 9.4388000000000005e-05 2023-08-01T19:56:12.368 INFO:teuthology.orchestra.run.smithi008.stdout: }, 2023-08-01T19:56:12.368 INFO:teuthology.orchestra.run.smithi008.stdout: { 2023-08-01T19:56:12.368 INFO:teuthology.orchestra.run.smithi008.stdout: "event": "dispatched", 2023-08-01T19:56:12.368 INFO:teuthology.orchestra.run.smithi008.stdout: "time": "2023-08-01T19:55:09.278955+0000", 2023-08-01T19:56:12.368 INFO:teuthology.orchestra.run.smithi008.stdout: "duration": 1.0413e-05 2023-08-01T19:56:12.368 INFO:teuthology.orchestra.run.smithi008.stdout: }, 2023-08-01T19:56:12.369 INFO:teuthology.orchestra.run.smithi008.stdout: { 2023-08-01T19:56:12.369 INFO:teuthology.orchestra.run.smithi008.stdout: "event": "queued_for_pg", 2023-08-01T19:56:12.369 INFO:teuthology.orchestra.run.smithi008.stdout: "time": "2023-08-01T19:55:09.278962+0000", 2023-08-01T19:56:12.369 INFO:teuthology.orchestra.run.smithi008.stdout: "duration": 6.2169999999999999e-06 2023-08-01T19:56:12.369 INFO:teuthology.orchestra.run.smithi008.stdout: }, 2023-08-01T19:56:12.369 INFO:teuthology.orchestra.run.smithi008.stdout: { 2023-08-01T19:56:12.369 INFO:teuthology.orchestra.run.smithi008.stdout: "event": "reached_pg", 2023-08-01T19:56:12.369 INFO:teuthology.orchestra.run.smithi008.stdout: "time": "2023-08-01T19:55:09.280363+0000", 2023-08-01T19:56:12.370 INFO:teuthology.orchestra.run.smithi008.stdout: "duration": 0.0014014489999999999 2023-08-01T19:56:12.370 INFO:teuthology.orchestra.run.smithi008.stdout: }, 2023-08-01T19:56:12.370 INFO:teuthology.orchestra.run.smithi008.stdout: { 2023-08-01T19:56:12.370 INFO:teuthology.orchestra.run.smithi008.stdout: "event": "started", 2023-08-01T19:56:12.370 INFO:teuthology.orchestra.run.smithi008.stdout: "time": "2023-08-01T19:55:09.280488+0000", 2023-08-01T19:56:12.370 INFO:teuthology.orchestra.run.smithi008.stdout: "duration": 0.00012474099999999999 2023-08-01T19:56:12.370 INFO:teuthology.orchestra.run.smithi008.stdout: }, 2023-08-01T19:56:12.371 INFO:teuthology.orchestra.run.smithi008.stdout: { 2023-08-01T19:56:12.371 INFO:teuthology.orchestra.run.smithi008.stdout: "event": "waiting for subops from 1", 2023-08-01T19:56:12.371 INFO:teuthology.orchestra.run.smithi008.stdout: "time": "2023-08-01T19:55:09.280626+0000", 2023-08-01T19:56:12.371 INFO:teuthology.orchestra.run.smithi008.stdout: "duration": 0.000138193 2023-08-01T19:56:12.371 INFO:teuthology.orchestra.run.smithi008.stdout: }, 2023-08-01T19:56:12.371 INFO:teuthology.orchestra.run.smithi008.stdout: { 2023-08-01T19:56:12.371 INFO:teuthology.orchestra.run.smithi008.stdout: "event": "op_commit", 2023-08-01T19:56:12.371 INFO:teuthology.orchestra.run.smithi008.stdout: "time": "2023-08-01T19:55:09.285958+0000", 2023-08-01T19:56:12.372 INFO:teuthology.orchestra.run.smithi008.stdout: "duration": 0.0053317130000000001 2023-08-01T19:56:12.372 INFO:teuthology.orchestra.run.smithi008.stdout: }, 2023-08-01T19:56:12.372 INFO:teuthology.orchestra.run.smithi008.stdout: { 2023-08-01T19:56:12.372 INFO:teuthology.orchestra.run.smithi008.stdout: "event": "sub_op_commit_rec", 2023-08-01T19:56:12.372 INFO:teuthology.orchestra.run.smithi008.stdout: "time": "2023-08-01T19:55:09.350151+0000", 2023-08-01T19:56:12.372 INFO:teuthology.orchestra.run.smithi008.stdout: "duration": 0.064193202000000005 2023-08-01T19:56:12.372 INFO:teuthology.orchestra.run.smithi008.stdout: }, 2023-08-01T19:56:12.372 INFO:teuthology.orchestra.run.smithi008.stdout: { 2023-08-01T19:56:12.373 INFO:teuthology.orchestra.run.smithi008.stdout: "event": "commit_sent", 2023-08-01T19:56:12.373 INFO:teuthology.orchestra.run.smithi008.stdout: "time": "2023-08-01T19:55:09.350188+0000", 2023-08-01T19:56:12.373 INFO:teuthology.orchestra.run.smithi008.stdout: "duration": 3.7549999999999998e-05 2023-08-01T19:56:12.373 INFO:teuthology.orchestra.run.smithi008.stdout: }, 2023-08-01T19:56:12.373 INFO:teuthology.orchestra.run.smithi008.stdout: { 2023-08-01T19:56:12.373 INFO:teuthology.orchestra.run.smithi008.stdout: "event": "done", 2023-08-01T19:56:12.373 INFO:teuthology.orchestra.run.smithi008.stdout: "time": "2023-08-01T19:55:09.350230+0000", 2023-08-01T19:56:12.374 INFO:teuthology.orchestra.run.smithi008.stdout: "duration": 4.1804999999999997e-05 2023-08-01T19:56:12.374 INFO:teuthology.orchestra.run.smithi008.stdout: } 2023-08-01T19:56:12.374 INFO:teuthology.orchestra.run.smithi008.stdout: ] 2023-08-01T19:56:12.374 INFO:teuthology.orchestra.run.smithi008.stdout: } 2023-08-01T19:56:12.374 INFO:teuthology.orchestra.run.smithi008.stdout: }, 2023-08-01T19:56:12.374 INFO:teuthology.orchestra.run.smithi008.stdout: { 2023-08-01T19:56:12.374 INFO:teuthology.orchestra.run.smithi008.stdout: "description": "osd_op(client.4668.0:107865 5.3 5:c2ebb96d:::benchmark_data_smithi006_114134_object107864:head [set-alloc-hint object_size 65536 write_size 65536,write 0~65536] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e38)", 2023-08-01T19:56:12.374 INFO:teuthology.orchestra.run.smithi008.stdout: "initiated_at": "2023-08-01T19:55:09.279020+0000", 2023-08-01T19:56:12.375 INFO:teuthology.orchestra.run.smithi008.stdout: "age": 63.038840387, 2023-08-01T19:56:12.375 INFO:teuthology.orchestra.run.smithi008.stdout: "duration": 0.072892565000000006, 2023-08-01T19:56:12.375 INFO:teuthology.orchestra.run.smithi008.stdout: "type_data": { 2023-08-01T19:56:12.375 INFO:teuthology.orchestra.run.smithi008.stdout: "flag_point": "commit sent; apply or cleanup", 2023-08-01T19:56:12.375 INFO:teuthology.orchestra.run.smithi008.stdout: "client_info": { 2023-08-01T19:56:12.375 INFO:teuthology.orchestra.run.smithi008.stdout: "client": "client.4668", 2023-08-01T19:56:12.375 INFO:teuthology.orchestra.run.smithi008.stdout: "client_addr": "172.21.15.6:0/1709472247", 2023-08-01T19:56:12.376 INFO:teuthology.orchestra.run.smithi008.stdout: "tid": 107865 2023-08-01T19:56:12.376 INFO:teuthology.orchestra.run.smithi008.stdout: }, 2023-08-01T19:56:12.376 INFO:teuthology.orchestra.run.smithi008.stdout: "events": [ 2023-08-01T19:56:12.376 INFO:teuthology.orchestra.run.smithi008.stdout: { 2023-08-01T19:56:12.376 INFO:teuthology.orchestra.run.smithi008.stdout: "event": "initiated", 2023-08-01T19:56:12.376 INFO:teuthology.orchestra.run.smithi008.stdout: "time": "2023-08-01T19:55:09.279020+0000", 2023-08-01T19:56:12.376 INFO:teuthology.orchestra.run.smithi008.stdout: "duration": 0 2023-08-01T19:56:12.376 INFO:teuthology.orchestra.run.smithi008.stdout: }, 2023-08-01T19:56:12.377 INFO:teuthology.orchestra.run.smithi008.stdout: { 2023-08-01T19:56:12.377 INFO:teuthology.orchestra.run.smithi008.stdout: "event": "throttled", 2023-08-01T19:56:12.377 INFO:teuthology.orchestra.run.smithi008.stdout: "time": "2023-08-01T19:55:09.279020+0000", 2023-08-01T19:56:12.377 INFO:teuthology.orchestra.run.smithi008.stdout: "duration": 0 2023-08-01T19:56:12.377 INFO:teuthology.orchestra.run.smithi008.stdout: }, 2023-08-01T19:56:12.377 INFO:teuthology.orchestra.run.smithi008.stdout: { 2023-08-01T19:56:12.377 INFO:teuthology.orchestra.run.smithi008.stdout: "event": "header_read", 2023-08-01T19:56:12.378 INFO:teuthology.orchestra.run.smithi008.stdout: "time": "2023-08-01T19:55:09.279019+0000", 2023-08-01T19:56:12.378 INFO:teuthology.orchestra.run.smithi008.stdout: "duration": 4294967295.999999 2023-08-01T19:56:12.378 INFO:teuthology.orchestra.run.smithi008.stdout: }, 2023-08-01T19:56:12.378 INFO:teuthology.orchestra.run.smithi008.stdout: { 2023-08-01T19:56:12.378 INFO:teuthology.orchestra.run.smithi008.stdout: "event": "all_read", 2023-08-01T19:56:12.378 INFO:teuthology.orchestra.run.smithi008.stdout: "time": "2023-08-01T19:55:09.279087+0000", 2023-08-01T19:56:12.378 INFO:teuthology.orchestra.run.smithi008.stdout: "duration": 6.8392000000000005e-05 2023-08-01T19:56:12.378 INFO:teuthology.orchestra.run.smithi008.stdout: }, 2023-08-01T19:56:12.379 INFO:teuthology.orchestra.run.smithi008.stdout: { 2023-08-01T19:56:12.379 INFO:teuthology.orchestra.run.smithi008.stdout: "event": "dispatched", 2023-08-01T19:56:12.379 INFO:teuthology.orchestra.run.smithi008.stdout: "time": "2023-08-01T19:55:09.279095+0000", 2023-08-01T19:56:12.379 INFO:teuthology.orchestra.run.smithi008.stdout: "duration": 8.0989999999999999e-06 2023-08-01T19:56:12.379 INFO:teuthology.orchestra.run.smithi008.stdout: }, 2023-08-01T19:56:12.379 INFO:teuthology.orchestra.run.smithi008.stdout: { 2023-08-01T19:56:12.379 INFO:teuthology.orchestra.run.smithi008.stdout: "event": "queued_for_pg", 2023-08-01T19:56:12.379 INFO:teuthology.orchestra.run.smithi008.stdout: "time": "2023-08-01T19:55:09.279101+0000", 2023-08-01T19:56:12.380 INFO:teuthology.orchestra.run.smithi008.stdout: "duration": 5.0390000000000004e-06 2023-08-01T19:56:12.380 INFO:teuthology.orchestra.run.smithi008.stdout: }, 2023-08-01T19:56:12.380 INFO:teuthology.orchestra.run.smithi008.stdout: { 2023-08-01T19:56:12.380 INFO:teuthology.orchestra.run.smithi008.stdout: "event": "reached_pg", 2023-08-01T19:56:12.380 INFO:teuthology.orchestra.run.smithi008.stdout: "time": "2023-08-01T19:55:09.282574+0000", 2023-08-01T19:56:12.380 INFO:teuthology.orchestra.run.smithi008.stdout: "duration": 0.0034730619999999999 2023-08-01T19:56:12.380 INFO:teuthology.orchestra.run.smithi008.stdout: }, 2023-08-01T19:56:12.380 INFO:teuthology.orchestra.run.smithi008.stdout: { 2023-08-01T19:56:12.381 INFO:teuthology.orchestra.run.smithi008.stdout: "event": "started", 2023-08-01T19:56:12.381 INFO:teuthology.orchestra.run.smithi008.stdout: "time": "2023-08-01T19:55:09.282705+0000", 2023-08-01T19:56:12.381 INFO:teuthology.orchestra.run.smithi008.stdout: "duration": 0.00013133400000000001 2023-08-01T19:56:12.381 INFO:teuthology.orchestra.run.smithi008.stdout: }, 2023-08-01T19:56:12.381 INFO:teuthology.orchestra.run.smithi008.stdout: { 2023-08-01T19:56:12.381 INFO:teuthology.orchestra.run.smithi008.stdout: "event": "waiting for subops from 1", 2023-08-01T19:56:12.381 INFO:teuthology.orchestra.run.smithi008.stdout: "time": "2023-08-01T19:55:09.283067+0000", 2023-08-01T19:56:12.382 INFO:teuthology.orchestra.run.smithi008.stdout: "duration": 0.00036195299999999998 2023-08-01T19:56:12.382 INFO:teuthology.orchestra.run.smithi008.stdout: }, 2023-08-01T19:56:12.382 INFO:teuthology.orchestra.run.smithi008.stdout: { 2023-08-01T19:56:12.382 INFO:teuthology.orchestra.run.smithi008.stdout: "event": "op_commit", 2023-08-01T19:56:12.382 INFO:teuthology.orchestra.run.smithi008.stdout: "time": "2023-08-01T19:55:09.288196+0000", 2023-08-01T19:56:12.382 INFO:teuthology.orchestra.run.smithi008.stdout: "duration": 0.0051293780000000004 2023-08-01T19:56:12.382 INFO:teuthology.orchestra.run.smithi008.stdout: }, 2023-08-01T19:56:12.382 INFO:teuthology.orchestra.run.smithi008.stdout: { 2023-08-01T19:56:12.383 INFO:teuthology.orchestra.run.smithi008.stdout: "event": "sub_op_commit_rec", 2023-08-01T19:56:12.383 INFO:teuthology.orchestra.run.smithi008.stdout: "time": "2023-08-01T19:55:09.351832+0000", 2023-08-01T19:56:12.383 INFO:teuthology.orchestra.run.smithi008.stdout: "duration": 0.063636076 2023-08-01T19:56:12.383 INFO:teuthology.orchestra.run.smithi008.stdout: }, 2023-08-01T19:56:12.383 INFO:teuthology.orchestra.run.smithi008.stdout: { 2023-08-01T19:56:12.383 INFO:teuthology.orchestra.run.smithi008.stdout: "event": "commit_sent", 2023-08-01T19:56:12.383 INFO:teuthology.orchestra.run.smithi008.stdout: "time": "2023-08-01T19:55:09.351878+0000", 2023-08-01T19:56:12.383 INFO:teuthology.orchestra.run.smithi008.stdout: "duration": 4.5408999999999998e-05 2023-08-01T19:56:12.384 INFO:teuthology.orchestra.run.smithi008.stdout: }, 2023-08-01T19:56:12.384 INFO:teuthology.orchestra.run.smithi008.stdout: { 2023-08-01T19:56:12.384 INFO:teuthology.orchestra.run.smithi008.stdout: "event": "done", 2023-08-01T19:56:12.384 INFO:teuthology.orchestra.run.smithi008.stdout: "time": "2023-08-01T19:55:09.351913+0000", 2023-08-01T19:56:12.384 INFO:teuthology.orchestra.run.smithi008.stdout: "duration": 3.4808999999999998e-05 2023-08-01T19:56:12.384 INFO:teuthology.orchestra.run.smithi008.stdout: } 2023-08-01T19:56:12.384 INFO:teuthology.orchestra.run.smithi008.stdout: ] 2023-08-01T19:56:12.384 INFO:teuthology.orchestra.run.smithi008.stdout: } 2023-08-01T19:56:12.385 INFO:teuthology.orchestra.run.smithi008.stdout: }, 2023-08-01T19:56:12.385 INFO:teuthology.orchestra.run.smithi008.stdout: { 2023-08-01T19:56:12.385 INFO:teuthology.orchestra.run.smithi008.stdout: "description": "osd_op(client.4668.0:107869 5.c 5:31910384:::benchmark_data_smithi006_114134_object107868:head [set-alloc-hint object_size 65536 write_size 65536,write 0~65536] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e38)", 2023-08-01T19:56:12.385 INFO:teuthology.orchestra.run.smithi008.stdout: "initiated_at": "2023-08-01T19:55:09.283205+0000", 2023-08-01T19:56:12.385 INFO:teuthology.orchestra.run.smithi008.stdout: "age": 63.034655221999998, 2023-08-01T19:56:12.385 INFO:teuthology.orchestra.run.smithi008.stdout: "duration": 0.068611808999999996, 2023-08-01T19:56:12.385 INFO:teuthology.orchestra.run.smithi008.stdout: "type_data": { 2023-08-01T19:56:12.386 INFO:teuthology.orchestra.run.smithi008.stdout: "flag_point": "commit sent; apply or cleanup", 2023-08-01T19:56:12.386 INFO:teuthology.orchestra.run.smithi008.stdout: "client_info": { 2023-08-01T19:56:12.386 INFO:teuthology.orchestra.run.smithi008.stdout: "client": "client.4668", 2023-08-01T19:56:12.386 INFO:teuthology.orchestra.run.smithi008.stdout: "client_addr": "172.21.15.6:0/1709472247", 2023-08-01T19:56:12.386 INFO:teuthology.orchestra.run.smithi008.stdout: "tid": 107869 2023-08-01T19:56:12.386 INFO:teuthology.orchestra.run.smithi008.stdout: }, 2023-08-01T19:56:12.386 INFO:teuthology.orchestra.run.smithi008.stdout: "events": [ 2023-08-01T19:56:12.386 INFO:teuthology.orchestra.run.smithi008.stdout: { 2023-08-01T19:56:12.387 INFO:teuthology.orchestra.run.smithi008.stdout: "event": "initiated", 2023-08-01T19:56:12.387 INFO:teuthology.orchestra.run.smithi008.stdout: "time": "2023-08-01T19:55:09.283205+0000", 2023-08-01T19:56:12.387 INFO:teuthology.orchestra.run.smithi008.stdout: "duration": 0 2023-08-01T19:56:12.387 INFO:teuthology.orchestra.run.smithi008.stdout: }, 2023-08-01T19:56:12.387 INFO:teuthology.orchestra.run.smithi008.stdout: { 2023-08-01T19:56:12.387 INFO:teuthology.orchestra.run.smithi008.stdout: "event": "throttled", 2023-08-01T19:56:12.387 INFO:teuthology.orchestra.run.smithi008.stdout: "time": "2023-08-01T19:55:09.283205+0000", 2023-08-01T19:56:12.387 INFO:teuthology.orchestra.run.smithi008.stdout: "duration": 0 2023-08-01T19:56:12.388 INFO:teuthology.orchestra.run.smithi008.stdout: }, 2023-08-01T19:56:12.388 INFO:teuthology.orchestra.run.smithi008.stdout: { 2023-08-01T19:56:12.388 INFO:teuthology.orchestra.run.smithi008.stdout: "event": "header_read", 2023-08-01T19:56:12.388 INFO:teuthology.orchestra.run.smithi008.stdout: "time": "2023-08-01T19:55:09.283204+0000", 2023-08-01T19:56:12.388 INFO:teuthology.orchestra.run.smithi008.stdout: "duration": 4294967295.999999 2023-08-01T19:56:12.388 INFO:teuthology.orchestra.run.smithi008.stdout: }, 2023-08-01T19:56:12.388 INFO:teuthology.orchestra.run.smithi008.stdout: { 2023-08-01T19:56:12.389 INFO:teuthology.orchestra.run.smithi008.stdout: "event": "all_read", 2023-08-01T19:56:12.389 INFO:teuthology.orchestra.run.smithi008.stdout: "time": "2023-08-01T19:55:09.283300+0000", 2023-08-01T19:56:12.389 INFO:teuthology.orchestra.run.smithi008.stdout: "duration": 9.6280000000000007e-05 2023-08-01T19:56:12.389 INFO:teuthology.orchestra.run.smithi008.stdout: }, 2023-08-01T19:56:12.389 INFO:teuthology.orchestra.run.smithi008.stdout: { 2023-08-01T19:56:12.389 INFO:teuthology.orchestra.run.smithi008.stdout: "event": "dispatched", 2023-08-01T19:56:12.389 INFO:teuthology.orchestra.run.smithi008.stdout: "time": "2023-08-01T19:55:09.283314+0000", 2023-08-01T19:56:12.389 INFO:teuthology.orchestra.run.smithi008.stdout: "duration": 1.3344e-05 2023-08-01T19:56:12.390 INFO:teuthology.orchestra.run.smithi008.stdout: }, 2023-08-01T19:56:12.390 INFO:teuthology.orchestra.run.smithi008.stdout: { 2023-08-01T19:56:12.390 INFO:teuthology.orchestra.run.smithi008.stdout: "event": "queued_for_pg", 2023-08-01T19:56:12.390 INFO:teuthology.orchestra.run.smithi008.stdout: "time": "2023-08-01T19:55:09.283320+0000", 2023-08-01T19:56:12.390 INFO:teuthology.orchestra.run.smithi008.stdout: "duration": 6.0299999999999999e-06 2023-08-01T19:56:12.390 INFO:teuthology.orchestra.run.smithi008.stdout: }, 2023-08-01T19:56:12.390 INFO:teuthology.orchestra.run.smithi008.stdout: { 2023-08-01T19:56:12.390 INFO:teuthology.orchestra.run.smithi008.stdout: "event": "reached_pg", 2023-08-01T19:56:12.391 INFO:teuthology.orchestra.run.smithi008.stdout: "time": "2023-08-01T19:55:09.283365+0000", 2023-08-01T19:56:12.391 INFO:teuthology.orchestra.run.smithi008.stdout: "duration": 4.5578999999999998e-05 2023-08-01T19:56:12.391 INFO:teuthology.orchestra.run.smithi008.stdout: }, 2023-08-01T19:56:12.391 INFO:teuthology.orchestra.run.smithi008.stdout: { 2023-08-01T19:56:12.391 INFO:teuthology.orchestra.run.smithi008.stdout: "event": "started", 2023-08-01T19:56:12.391 INFO:teuthology.orchestra.run.smithi008.stdout: "time": "2023-08-01T19:55:09.283490+0000", 2023-08-01T19:56:12.391 INFO:teuthology.orchestra.run.smithi008.stdout: "duration": 0.00012473700000000001 2023-08-01T19:56:12.391 INFO:teuthology.orchestra.run.smithi008.stdout: }, 2023-08-01T19:56:12.392 INFO:teuthology.orchestra.run.smithi008.stdout: { 2023-08-01T19:56:12.392 INFO:teuthology.orchestra.run.smithi008.stdout: "event": "waiting for subops from 1", 2023-08-01T19:56:12.392 INFO:teuthology.orchestra.run.smithi008.stdout: "time": "2023-08-01T19:55:09.283637+0000", 2023-08-01T19:56:12.392 INFO:teuthology.orchestra.run.smithi008.stdout: "duration": 0.00014715600000000001 2023-08-01T19:56:12.392 INFO:teuthology.orchestra.run.smithi008.stdout: }, 2023-08-01T19:56:12.392 INFO:teuthology.orchestra.run.smithi008.stdout: { 2023-08-01T19:56:12.392 INFO:teuthology.orchestra.run.smithi008.stdout: "event": "op_commit", 2023-08-01T19:56:12.392 INFO:teuthology.orchestra.run.smithi008.stdout: "time": "2023-08-01T19:55:09.288214+0000", 2023-08-01T19:56:12.393 INFO:teuthology.orchestra.run.smithi008.stdout: "duration": 0.0045769560000000001 2023-08-01T19:56:12.393 INFO:teuthology.orchestra.run.smithi008.stdout: }, 2023-08-01T19:56:12.393 INFO:teuthology.orchestra.run.smithi008.stdout: { 2023-08-01T19:56:12.393 INFO:teuthology.orchestra.run.smithi008.stdout: "event": "sub_op_commit_rec", 2023-08-01T19:56:12.393 INFO:teuthology.orchestra.run.smithi008.stdout: "time": "2023-08-01T19:55:09.351721+0000", 2023-08-01T19:56:12.393 INFO:teuthology.orchestra.run.smithi008.stdout: "duration": 0.063507383000000001 2023-08-01T19:56:12.393 INFO:teuthology.orchestra.run.smithi008.stdout: }, 2023-08-01T19:56:12.394 INFO:teuthology.orchestra.run.smithi008.stdout: { 2023-08-01T19:56:12.394 INFO:teuthology.orchestra.run.smithi008.stdout: "event": "commit_sent", 2023-08-01T19:56:12.394 INFO:teuthology.orchestra.run.smithi008.stdout: "time": "2023-08-01T19:55:09.351777+0000", 2023-08-01T19:56:12.394 INFO:teuthology.orchestra.run.smithi008.stdout: "duration": 5.5733999999999999e-05 2023-08-01T19:56:12.394 INFO:teuthology.orchestra.run.smithi008.stdout: }, 2023-08-01T19:56:12.394 INFO:teuthology.orchestra.run.smithi008.stdout: { 2023-08-01T19:56:12.394 INFO:teuthology.orchestra.run.smithi008.stdout: "event": "done", 2023-08-01T19:56:12.394 INFO:teuthology.orchestra.run.smithi008.stdout: "time": "2023-08-01T19:55:09.351817+0000", 2023-08-01T19:56:12.395 INFO:teuthology.orchestra.run.smithi008.stdout: "duration": 3.9765000000000003e-05 2023-08-01T19:56:12.395 INFO:teuthology.orchestra.run.smithi008.stdout: } 2023-08-01T19:56:12.395 INFO:teuthology.orchestra.run.smithi008.stdout: ] 2023-08-01T19:56:12.395 INFO:teuthology.orchestra.run.smithi008.stdout: } 2023-08-01T19:56:12.395 INFO:teuthology.orchestra.run.smithi008.stdout: }, 2023-08-01T19:56:12.395 INFO:teuthology.orchestra.run.smithi008.stdout: { 2023-08-01T19:56:12.395 INFO:teuthology.orchestra.run.smithi008.stdout: "description": "osd_op(client.4668.0:107874 5.3 5:ce4c2799:::benchmark_data_smithi006_114134_object107873:head [set-alloc-hint object_size 65536 write_size 65536,write 0~65536] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e38)", 2023-08-01T19:56:12.395 INFO:teuthology.orchestra.run.smithi008.stdout: "initiated_at": "2023-08-01T19:55:09.286239+0000", 2023-08-01T19:56:12.396 INFO:teuthology.orchestra.run.smithi008.stdout: "age": 63.031621717, 2023-08-01T19:56:12.396 INFO:teuthology.orchestra.run.smithi008.stdout: "duration": 0.068224389999999996, 2023-08-01T19:56:12.396 INFO:teuthology.orchestra.run.smithi008.stdout: "type_data": { 2023-08-01T19:56:12.396 INFO:teuthology.orchestra.run.smithi008.stdout: "flag_point": "commit sent; apply or cleanup", 2023-08-01T19:56:12.396 INFO:teuthology.orchestra.run.smithi008.stdout: "client_info": { 2023-08-01T19:56:12.396 INFO:teuthology.orchestra.run.smithi008.stdout: "client": "client.4668", 2023-08-01T19:56:12.396 INFO:teuthology.orchestra.run.smithi008.stdout: "client_addr": "172.21.15.6:0/1709472247", 2023-08-01T19:56:12.397 INFO:teuthology.orchestra.run.smithi008.stdout: "tid": 107874 2023-08-01T19:56:12.397 INFO:teuthology.orchestra.run.smithi008.stdout: }, 2023-08-01T19:56:12.397 INFO:teuthology.orchestra.run.smithi008.stdout: "events": [ 2023-08-01T19:56:12.397 INFO:teuthology.orchestra.run.smithi008.stdout: { 2023-08-01T19:56:12.397 INFO:teuthology.orchestra.run.smithi008.stdout: "event": "initiated", 2023-08-01T19:56:12.397 INFO:teuthology.orchestra.run.smithi008.stdout: "time": "2023-08-01T19:55:09.286239+0000", 2023-08-01T19:56:12.397 INFO:teuthology.orchestra.run.smithi008.stdout: "duration": 0 2023-08-01T19:56:12.397 INFO:teuthology.orchestra.run.smithi008.stdout: }, 2023-08-01T19:56:12.398 INFO:teuthology.orchestra.run.smithi008.stdout: { 2023-08-01T19:56:12.398 INFO:teuthology.orchestra.run.smithi008.stdout: "event": "throttled", 2023-08-01T19:56:12.398 INFO:teuthology.orchestra.run.smithi008.stdout: "time": "2023-08-01T19:55:09.286239+0000", 2023-08-01T19:56:12.398 INFO:teuthology.orchestra.run.smithi008.stdout: "duration": 0 2023-08-01T19:56:12.398 INFO:teuthology.orchestra.run.smithi008.stdout: }, 2023-08-01T19:56:12.398 INFO:teuthology.orchestra.run.smithi008.stdout: { 2023-08-01T19:56:12.398 INFO:teuthology.orchestra.run.smithi008.stdout: "event": "header_read", 2023-08-01T19:56:12.398 INFO:teuthology.orchestra.run.smithi008.stdout: "time": "2023-08-01T19:55:09.286238+0000", 2023-08-01T19:56:12.399 INFO:teuthology.orchestra.run.smithi008.stdout: "duration": 4294967295.999999 2023-08-01T19:56:12.399 INFO:teuthology.orchestra.run.smithi008.stdout: }, 2023-08-01T19:56:12.399 INFO:teuthology.orchestra.run.smithi008.stdout: { 2023-08-01T19:56:12.399 INFO:teuthology.orchestra.run.smithi008.stdout: "event": "all_read", 2023-08-01T19:56:12.399 INFO:teuthology.orchestra.run.smithi008.stdout: "time": "2023-08-01T19:55:09.286310+0000", 2023-08-01T19:56:12.399 INFO:teuthology.orchestra.run.smithi008.stdout: "duration": 7.2583999999999995e-05 2023-08-01T19:56:12.399 INFO:teuthology.orchestra.run.smithi008.stdout: }, 2023-08-01T19:56:12.400 INFO:teuthology.orchestra.run.smithi008.stdout: { 2023-08-01T19:56:12.400 INFO:teuthology.orchestra.run.smithi008.stdout: "event": "dispatched", 2023-08-01T19:56:12.400 INFO:teuthology.orchestra.run.smithi008.stdout: "time": "2023-08-01T19:55:09.286323+0000", 2023-08-01T19:56:12.400 INFO:teuthology.orchestra.run.smithi008.stdout: "duration": 1.3151e-05 2023-08-01T19:56:12.400 INFO:teuthology.orchestra.run.smithi008.stdout: }, 2023-08-01T19:56:12.400 INFO:teuthology.orchestra.run.smithi008.stdout: { 2023-08-01T19:56:12.400 INFO:teuthology.orchestra.run.smithi008.stdout: "event": "queued_for_pg", 2023-08-01T19:56:12.400 INFO:teuthology.orchestra.run.smithi008.stdout: "time": "2023-08-01T19:55:09.286329+0000", 2023-08-01T19:56:12.401 INFO:teuthology.orchestra.run.smithi008.stdout: "duration": 5.8719999999999999e-06 2023-08-01T19:56:12.401 INFO:teuthology.orchestra.run.smithi008.stdout: }, 2023-08-01T19:56:12.401 INFO:teuthology.orchestra.run.smithi008.stdout: { 2023-08-01T19:56:12.401 INFO:teuthology.orchestra.run.smithi008.stdout: "event": "reached_pg", 2023-08-01T19:56:12.401 INFO:teuthology.orchestra.run.smithi008.stdout: "time": "2023-08-01T19:55:09.286392+0000", 2023-08-01T19:56:12.401 INFO:teuthology.orchestra.run.smithi008.stdout: "duration": 6.2378000000000005e-05 2023-08-01T19:56:12.401 INFO:teuthology.orchestra.run.smithi008.stdout: }, 2023-08-01T19:56:12.402 INFO:teuthology.orchestra.run.smithi008.stdout: { 2023-08-01T19:56:12.402 INFO:teuthology.orchestra.run.smithi008.stdout: "event": "started", 2023-08-01T19:56:12.402 INFO:teuthology.orchestra.run.smithi008.stdout: "time": "2023-08-01T19:55:09.286473+0000", 2023-08-01T19:56:12.402 INFO:teuthology.orchestra.run.smithi008.stdout: "duration": 8.1327000000000002e-05 2023-08-01T19:56:12.402 INFO:teuthology.orchestra.run.smithi008.stdout: }, 2023-08-01T19:56:12.402 INFO:teuthology.orchestra.run.smithi008.stdout: { 2023-08-01T19:56:12.402 INFO:teuthology.orchestra.run.smithi008.stdout: "event": "waiting for subops from 1", 2023-08-01T19:56:12.403 INFO:teuthology.orchestra.run.smithi008.stdout: "time": "2023-08-01T19:55:09.286557+0000", 2023-08-01T19:56:12.403 INFO:teuthology.orchestra.run.smithi008.stdout: "duration": 8.4140000000000004e-05 2023-08-01T19:56:12.403 INFO:teuthology.orchestra.run.smithi008.stdout: }, 2023-08-01T19:56:12.403 INFO:teuthology.orchestra.run.smithi008.stdout: { 2023-08-01T19:56:12.403 INFO:teuthology.orchestra.run.smithi008.stdout: "event": "op_commit", 2023-08-01T19:56:12.403 INFO:teuthology.orchestra.run.smithi008.stdout: "time": "2023-08-01T19:55:09.290681+0000", 2023-08-01T19:56:12.403 INFO:teuthology.orchestra.run.smithi008.stdout: "duration": 0.0041242420000000002 2023-08-01T19:56:12.403 INFO:teuthology.orchestra.run.smithi008.stdout: }, 2023-08-01T19:56:12.404 INFO:teuthology.orchestra.run.smithi008.stdout: { 2023-08-01T19:56:12.404 INFO:teuthology.orchestra.run.smithi008.stdout: "event": "sub_op_commit_rec", 2023-08-01T19:56:12.404 INFO:teuthology.orchestra.run.smithi008.stdout: "time": "2023-08-01T19:55:09.354372+0000", 2023-08-01T19:56:12.404 INFO:teuthology.orchestra.run.smithi008.stdout: "duration": 0.063690438000000002 2023-08-01T19:56:12.404 INFO:teuthology.orchestra.run.smithi008.stdout: }, 2023-08-01T19:56:12.404 INFO:teuthology.orchestra.run.smithi008.stdout: { 2023-08-01T19:56:12.404 INFO:teuthology.orchestra.run.smithi008.stdout: "event": "commit_sent", 2023-08-01T19:56:12.404 INFO:teuthology.orchestra.run.smithi008.stdout: "time": "2023-08-01T19:55:09.354421+0000", 2023-08-01T19:56:12.405 INFO:teuthology.orchestra.run.smithi008.stdout: "duration": 4.9413000000000003e-05 2023-08-01T19:56:12.405 INFO:teuthology.orchestra.run.smithi008.stdout: }, 2023-08-01T19:56:12.405 INFO:teuthology.orchestra.run.smithi008.stdout: { 2023-08-01T19:56:12.405 INFO:teuthology.orchestra.run.smithi008.stdout: "event": "done", 2023-08-01T19:56:12.405 INFO:teuthology.orchestra.run.smithi008.stdout: "time": "2023-08-01T19:55:09.354463+0000", 2023-08-01T19:56:12.405 INFO:teuthology.orchestra.run.smithi008.stdout: "duration": 4.1924e-05 2023-08-01T19:56:12.405 INFO:teuthology.orchestra.run.smithi008.stdout: } 2023-08-01T19:56:12.405 INFO:teuthology.orchestra.run.smithi008.stdout: ] 2023-08-01T19:56:12.406 INFO:teuthology.orchestra.run.smithi008.stdout: } 2023-08-01T19:56:12.406 INFO:teuthology.orchestra.run.smithi008.stdout: }, 2023-08-01T19:56:12.406 INFO:teuthology.orchestra.run.smithi008.stdout: { 2023-08-01T19:56:12.406 INFO:teuthology.orchestra.run.smithi008.stdout: "description": "osd_op(client.4668.0:197398 5.1 5:809d7164:::benchmark_data_smithi006_114134_object63737:head [delete] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e61)", 2023-08-01T19:56:12.406 INFO:teuthology.orchestra.run.smithi008.stdout: "initiated_at": "2023-08-01T19:55:58.554713+0000", 2023-08-01T19:56:12.406 INFO:teuthology.orchestra.run.smithi008.stdout: "age": 13.763147029000001, 2023-08-01T19:56:12.406 INFO:teuthology.orchestra.run.smithi008.stdout: "duration": 1.0661326660000001, 2023-08-01T19:56:12.407 INFO:teuthology.orchestra.run.smithi008.stdout: "type_data": { 2023-08-01T19:56:12.407 INFO:teuthology.orchestra.run.smithi008.stdout: "flag_point": "reached pg", 2023-08-01T19:56:12.407 INFO:teuthology.orchestra.run.smithi008.stdout: "client_info": { 2023-08-01T19:56:12.407 INFO:teuthology.orchestra.run.smithi008.stdout: "client": "client.4668", 2023-08-01T19:56:12.407 INFO:teuthology.orchestra.run.smithi008.stdout: "client_addr": "172.21.15.6:0/1709472247", 2023-08-01T19:56:12.407 INFO:teuthology.orchestra.run.smithi008.stdout: "tid": 197398 2023-08-01T19:56:12.407 INFO:teuthology.orchestra.run.smithi008.stdout: }, 2023-08-01T19:56:12.407 INFO:teuthology.orchestra.run.smithi008.stdout: "events": [ 2023-08-01T19:56:12.408 INFO:teuthology.orchestra.run.smithi008.stdout: { 2023-08-01T19:56:12.408 INFO:teuthology.orchestra.run.smithi008.stdout: "event": "initiated", 2023-08-01T19:56:12.408 INFO:teuthology.orchestra.run.smithi008.stdout: "time": "2023-08-01T19:55:58.554713+0000", 2023-08-01T19:56:12.408 INFO:teuthology.orchestra.run.smithi008.stdout: "duration": 0 2023-08-01T19:56:12.408 INFO:teuthology.orchestra.run.smithi008.stdout: }, 2023-08-01T19:56:12.408 INFO:teuthology.orchestra.run.smithi008.stdout: { 2023-08-01T19:56:12.408 INFO:teuthology.orchestra.run.smithi008.stdout: "event": "throttled", 2023-08-01T19:56:12.409 INFO:teuthology.orchestra.run.smithi008.stdout: "time": "2023-08-01T19:55:58.554713+0000", 2023-08-01T19:56:12.409 INFO:teuthology.orchestra.run.smithi008.stdout: "duration": 0 2023-08-01T19:56:12.409 INFO:teuthology.orchestra.run.smithi008.stdout: }, 2023-08-01T19:56:12.409 INFO:teuthology.orchestra.run.smithi008.stdout: { 2023-08-01T19:56:12.409 INFO:teuthology.orchestra.run.smithi008.stdout: "event": "header_read", 2023-08-01T19:56:12.409 INFO:teuthology.orchestra.run.smithi008.stdout: "time": "2023-08-01T19:55:58.554713+0000", 2023-08-01T19:56:12.409 INFO:teuthology.orchestra.run.smithi008.stdout: "duration": 4294967295.999999 2023-08-01T19:56:12.410 INFO:teuthology.orchestra.run.smithi008.stdout: }, 2023-08-01T19:56:12.410 INFO:teuthology.orchestra.run.smithi008.stdout: { 2023-08-01T19:56:12.410 INFO:teuthology.orchestra.run.smithi008.stdout: "event": "all_read", 2023-08-01T19:56:12.410 INFO:teuthology.orchestra.run.smithi008.stdout: "time": "2023-08-01T19:55:58.554717+0000", 2023-08-01T19:56:12.410 INFO:teuthology.orchestra.run.smithi008.stdout: "duration": 4.7389999999999999e-06 2023-08-01T19:56:12.410 INFO:teuthology.orchestra.run.smithi008.stdout: }, 2023-08-01T19:56:12.410 INFO:teuthology.orchestra.run.smithi008.stdout: { 2023-08-01T19:56:12.410 INFO:teuthology.orchestra.run.smithi008.stdout: "event": "dispatched", 2023-08-01T19:56:12.411 INFO:teuthology.orchestra.run.smithi008.stdout: "time": "2023-08-01T19:55:58.554725+0000", 2023-08-01T19:56:12.411 INFO:teuthology.orchestra.run.smithi008.stdout: "duration": 7.9820000000000008e-06 2023-08-01T19:56:12.411 INFO:teuthology.orchestra.run.smithi008.stdout: }, 2023-08-01T19:56:12.411 INFO:teuthology.orchestra.run.smithi008.stdout: { 2023-08-01T19:56:12.411 INFO:teuthology.orchestra.run.smithi008.stdout: "event": "queued_for_pg", 2023-08-01T19:56:12.411 INFO:teuthology.orchestra.run.smithi008.stdout: "time": "2023-08-01T19:55:58.554730+0000", 2023-08-01T19:56:12.411 INFO:teuthology.orchestra.run.smithi008.stdout: "duration": 4.318e-06 2023-08-01T19:56:12.411 INFO:teuthology.orchestra.run.smithi008.stdout: }, 2023-08-01T19:56:12.412 INFO:teuthology.orchestra.run.smithi008.stdout: { 2023-08-01T19:56:12.412 INFO:teuthology.orchestra.run.smithi008.stdout: "event": "reached_pg", 2023-08-01T19:56:12.412 INFO:teuthology.orchestra.run.smithi008.stdout: "time": "2023-08-01T19:55:58.554767+0000", 2023-08-01T19:56:12.412 INFO:teuthology.orchestra.run.smithi008.stdout: "duration": 3.7778000000000003e-05 2023-08-01T19:56:12.412 INFO:teuthology.orchestra.run.smithi008.stdout: }, 2023-08-01T19:56:12.412 INFO:teuthology.orchestra.run.smithi008.stdout: { 2023-08-01T19:56:12.412 INFO:teuthology.orchestra.run.smithi008.stdout: "event": "started", 2023-08-01T19:56:12.413 INFO:teuthology.orchestra.run.smithi008.stdout: "time": "2023-08-01T19:55:58.554874+0000", 2023-08-01T19:56:12.413 INFO:teuthology.orchestra.run.smithi008.stdout: "duration": 0.000106613 2023-08-01T19:56:12.413 INFO:teuthology.orchestra.run.smithi008.stdout: }, 2023-08-01T19:56:12.413 INFO:teuthology.orchestra.run.smithi008.stdout: { 2023-08-01T19:56:12.413 INFO:teuthology.orchestra.run.smithi008.stdout: "event": "waiting for subops from 1", 2023-08-01T19:56:12.413 INFO:teuthology.orchestra.run.smithi008.stdout: "time": "2023-08-01T19:55:58.554941+0000", 2023-08-01T19:56:12.413 INFO:teuthology.orchestra.run.smithi008.stdout: "duration": 6.6569000000000006e-05 2023-08-01T19:56:12.413 INFO:teuthology.orchestra.run.smithi008.stdout: }, 2023-08-01T19:56:12.414 INFO:teuthology.orchestra.run.smithi008.stdout: { 2023-08-01T19:56:12.414 INFO:teuthology.orchestra.run.smithi008.stdout: "event": "reached_pg", 2023-08-01T19:56:12.414 INFO:teuthology.orchestra.run.smithi008.stdout: "time": "2023-08-01T19:55:58.569436+0000", 2023-08-01T19:56:12.414 INFO:teuthology.orchestra.run.smithi008.stdout: "duration": 0.014495413 2023-08-01T19:56:12.414 INFO:teuthology.orchestra.run.smithi008.stdout: }, 2023-08-01T19:56:12.414 INFO:teuthology.orchestra.run.smithi008.stdout: { 2023-08-01T19:56:12.414 INFO:teuthology.orchestra.run.smithi008.stdout: "event": "waiting for peered", 2023-08-01T19:56:12.414 INFO:teuthology.orchestra.run.smithi008.stdout: "time": "2023-08-01T19:55:58.569441+0000", 2023-08-01T19:56:12.415 INFO:teuthology.orchestra.run.smithi008.stdout: "duration": 5.1109999999999999e-06 2023-08-01T19:56:12.415 INFO:teuthology.orchestra.run.smithi008.stdout: }, 2023-08-01T19:56:12.415 INFO:teuthology.orchestra.run.smithi008.stdout: { 2023-08-01T19:56:12.415 INFO:teuthology.orchestra.run.smithi008.stdout: "event": "reached_pg", 2023-08-01T19:56:12.415 INFO:teuthology.orchestra.run.smithi008.stdout: "time": "2023-08-01T19:55:59.620748+0000", 2023-08-01T19:56:12.415 INFO:teuthology.orchestra.run.smithi008.stdout: "duration": 1.0513071810000001 2023-08-01T19:56:12.415 INFO:teuthology.orchestra.run.smithi008.stdout: }, 2023-08-01T19:56:12.415 INFO:teuthology.orchestra.run.smithi008.stdout: { 2023-08-01T19:56:12.416 INFO:teuthology.orchestra.run.smithi008.stdout: "event": "done", 2023-08-01T19:56:12.416 INFO:teuthology.orchestra.run.smithi008.stdout: "time": "2023-08-01T19:55:59.620846+0000", 2023-08-01T19:56:12.416 INFO:teuthology.orchestra.run.smithi008.stdout: "duration": 9.7739999999999996e-05 2023-08-01T19:56:12.416 INFO:teuthology.orchestra.run.smithi008.stdout: } 2023-08-01T19:56:12.416 INFO:teuthology.orchestra.run.smithi008.stdout: ] 2023-08-01T19:56:12.416 INFO:teuthology.orchestra.run.smithi008.stdout: } 2023-08-01T19:56:12.416 INFO:teuthology.orchestra.run.smithi008.stdout: }, 2023-08-01T19:56:12.417 INFO:teuthology.orchestra.run.smithi008.stdout: { 2023-08-01T19:56:12.417 INFO:teuthology.orchestra.run.smithi008.stdout: "description": "osd_op(client.4668.0:197400 5.c 5:30dad7f9:::benchmark_data_smithi006_114134_object63739:head [delete] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e61)", 2023-08-01T19:56:12.417 INFO:teuthology.orchestra.run.smithi008.stdout: "initiated_at": "2023-08-01T19:55:58.556576+0000", 2023-08-01T19:56:12.417 INFO:teuthology.orchestra.run.smithi008.stdout: "age": 13.761284180000001, 2023-08-01T19:56:12.417 INFO:teuthology.orchestra.run.smithi008.stdout: "duration": 1.062559968, 2023-08-01T19:56:12.417 INFO:teuthology.orchestra.run.smithi008.stdout: "type_data": { 2023-08-01T19:56:12.417 INFO:teuthology.orchestra.run.smithi008.stdout: "flag_point": "reached pg", 2023-08-01T19:56:12.417 INFO:teuthology.orchestra.run.smithi008.stdout: "client_info": { 2023-08-01T19:56:12.418 INFO:teuthology.orchestra.run.smithi008.stdout: "client": "client.4668", 2023-08-01T19:56:12.418 INFO:teuthology.orchestra.run.smithi008.stdout: "client_addr": "172.21.15.6:0/1709472247", 2023-08-01T19:56:12.418 INFO:teuthology.orchestra.run.smithi008.stdout: "tid": 197400 2023-08-01T19:56:12.418 INFO:teuthology.orchestra.run.smithi008.stdout: }, 2023-08-01T19:56:12.418 INFO:teuthology.orchestra.run.smithi008.stdout: "events": [ 2023-08-01T19:56:12.418 INFO:teuthology.orchestra.run.smithi008.stdout: { 2023-08-01T19:56:12.418 INFO:teuthology.orchestra.run.smithi008.stdout: "event": "initiated", 2023-08-01T19:56:12.418 INFO:teuthology.orchestra.run.smithi008.stdout: "time": "2023-08-01T19:55:58.556576+0000", 2023-08-01T19:56:12.419 INFO:teuthology.orchestra.run.smithi008.stdout: "duration": 0 2023-08-01T19:56:12.419 INFO:teuthology.orchestra.run.smithi008.stdout: }, 2023-08-01T19:56:12.419 INFO:teuthology.orchestra.run.smithi008.stdout: { 2023-08-01T19:56:12.419 INFO:teuthology.orchestra.run.smithi008.stdout: "event": "throttled", 2023-08-01T19:56:12.419 INFO:teuthology.orchestra.run.smithi008.stdout: "time": "2023-08-01T19:55:58.556576+0000", 2023-08-01T19:56:12.419 INFO:teuthology.orchestra.run.smithi008.stdout: "duration": 0 2023-08-01T19:56:12.419 INFO:teuthology.orchestra.run.smithi008.stdout: }, 2023-08-01T19:56:12.420 INFO:teuthology.orchestra.run.smithi008.stdout: { 2023-08-01T19:56:12.420 INFO:teuthology.orchestra.run.smithi008.stdout: "event": "header_read", 2023-08-01T19:56:12.420 INFO:teuthology.orchestra.run.smithi008.stdout: "time": "2023-08-01T19:55:58.556575+0000", 2023-08-01T19:56:12.420 INFO:teuthology.orchestra.run.smithi008.stdout: "duration": 4294967295.999999 2023-08-01T19:56:12.420 INFO:teuthology.orchestra.run.smithi008.stdout: }, 2023-08-01T19:56:12.420 INFO:teuthology.orchestra.run.smithi008.stdout: { 2023-08-01T19:56:12.420 INFO:teuthology.orchestra.run.smithi008.stdout: "event": "all_read", 2023-08-01T19:56:12.421 INFO:teuthology.orchestra.run.smithi008.stdout: "time": "2023-08-01T19:55:58.556580+0000", 2023-08-01T19:56:12.421 INFO:teuthology.orchestra.run.smithi008.stdout: "duration": 4.2860000000000001e-06 2023-08-01T19:56:12.421 INFO:teuthology.orchestra.run.smithi008.stdout: }, 2023-08-01T19:56:12.421 INFO:teuthology.orchestra.run.smithi008.stdout: { 2023-08-01T19:56:12.421 INFO:teuthology.orchestra.run.smithi008.stdout: "event": "dispatched", 2023-08-01T19:56:12.421 INFO:teuthology.orchestra.run.smithi008.stdout: "time": "2023-08-01T19:55:58.556589+0000", 2023-08-01T19:56:12.421 INFO:teuthology.orchestra.run.smithi008.stdout: "duration": 9.6500000000000008e-06 2023-08-01T19:56:12.421 INFO:teuthology.orchestra.run.smithi008.stdout: }, 2023-08-01T19:56:12.422 INFO:teuthology.orchestra.run.smithi008.stdout: { 2023-08-01T19:56:12.422 INFO:teuthology.orchestra.run.smithi008.stdout: "event": "queued_for_pg", 2023-08-01T19:56:12.422 INFO:teuthology.orchestra.run.smithi008.stdout: "time": "2023-08-01T19:55:58.556596+0000", 2023-08-01T19:56:12.422 INFO:teuthology.orchestra.run.smithi008.stdout: "duration": 6.1430000000000003e-06 2023-08-01T19:56:12.422 INFO:teuthology.orchestra.run.smithi008.stdout: }, 2023-08-01T19:56:12.422 INFO:teuthology.orchestra.run.smithi008.stdout: { 2023-08-01T19:56:12.422 INFO:teuthology.orchestra.run.smithi008.stdout: "event": "reached_pg", 2023-08-01T19:56:12.423 INFO:teuthology.orchestra.run.smithi008.stdout: "time": "2023-08-01T19:55:58.556634+0000", 2023-08-01T19:56:12.423 INFO:teuthology.orchestra.run.smithi008.stdout: "duration": 3.8080000000000001e-05 2023-08-01T19:56:12.423 INFO:teuthology.orchestra.run.smithi008.stdout: }, 2023-08-01T19:56:12.423 INFO:teuthology.orchestra.run.smithi008.stdout: { 2023-08-01T19:56:12.423 INFO:teuthology.orchestra.run.smithi008.stdout: "event": "started", 2023-08-01T19:56:12.423 INFO:teuthology.orchestra.run.smithi008.stdout: "time": "2023-08-01T19:55:58.556754+0000", 2023-08-01T19:56:12.423 INFO:teuthology.orchestra.run.smithi008.stdout: "duration": 0.000120444 2023-08-01T19:56:12.423 INFO:teuthology.orchestra.run.smithi008.stdout: }, 2023-08-01T19:56:12.424 INFO:teuthology.orchestra.run.smithi008.stdout: { 2023-08-01T19:56:12.424 INFO:teuthology.orchestra.run.smithi008.stdout: "event": "waiting for subops from 1", 2023-08-01T19:56:12.424 INFO:teuthology.orchestra.run.smithi008.stdout: "time": "2023-08-01T19:55:58.556875+0000", 2023-08-01T19:56:12.424 INFO:teuthology.orchestra.run.smithi008.stdout: "duration": 0.00012100900000000001 2023-08-01T19:56:12.424 INFO:teuthology.orchestra.run.smithi008.stdout: }, 2023-08-01T19:56:12.424 INFO:teuthology.orchestra.run.smithi008.stdout: { 2023-08-01T19:56:12.424 INFO:teuthology.orchestra.run.smithi008.stdout: "event": "reached_pg", 2023-08-01T19:56:12.424 INFO:teuthology.orchestra.run.smithi008.stdout: "time": "2023-08-01T19:55:58.567406+0000", 2023-08-01T19:56:12.425 INFO:teuthology.orchestra.run.smithi008.stdout: "duration": 0.010531351 2023-08-01T19:56:12.425 INFO:teuthology.orchestra.run.smithi008.stdout: }, 2023-08-01T19:56:12.425 INFO:teuthology.orchestra.run.smithi008.stdout: { 2023-08-01T19:56:12.425 INFO:teuthology.orchestra.run.smithi008.stdout: "event": "waiting for peered", 2023-08-01T19:56:12.425 INFO:teuthology.orchestra.run.smithi008.stdout: "time": "2023-08-01T19:55:58.567414+0000", 2023-08-01T19:56:12.425 INFO:teuthology.orchestra.run.smithi008.stdout: "duration": 7.9189999999999999e-06 2023-08-01T19:56:12.425 INFO:teuthology.orchestra.run.smithi008.stdout: }, 2023-08-01T19:56:12.426 INFO:teuthology.orchestra.run.smithi008.stdout: { 2023-08-01T19:56:12.426 INFO:teuthology.orchestra.run.smithi008.stdout: "event": "reached_pg", 2023-08-01T19:56:12.426 INFO:teuthology.orchestra.run.smithi008.stdout: "time": "2023-08-01T19:55:59.619054+0000", 2023-08-01T19:56:12.426 INFO:teuthology.orchestra.run.smithi008.stdout: "duration": 1.0516396269999999 2023-08-01T19:56:12.426 INFO:teuthology.orchestra.run.smithi008.stdout: }, 2023-08-01T19:56:12.426 INFO:teuthology.orchestra.run.smithi008.stdout: { 2023-08-01T19:56:12.426 INFO:teuthology.orchestra.run.smithi008.stdout: "event": "done", 2023-08-01T19:56:12.426 INFO:teuthology.orchestra.run.smithi008.stdout: "time": "2023-08-01T19:55:59.619136+0000", 2023-08-01T19:56:12.427 INFO:teuthology.orchestra.run.smithi008.stdout: "duration": 8.2208999999999998e-05 2023-08-01T19:56:12.427 INFO:teuthology.orchestra.run.smithi008.stdout: } 2023-08-01T19:56:12.427 INFO:teuthology.orchestra.run.smithi008.stdout: ] 2023-08-01T19:56:12.427 INFO:teuthology.orchestra.run.smithi008.stdout: } 2023-08-01T19:56:12.427 INFO:teuthology.orchestra.run.smithi008.stdout: }, 2023-08-01T19:56:12.427 INFO:teuthology.orchestra.run.smithi008.stdout: { 2023-08-01T19:56:12.427 INFO:teuthology.orchestra.run.smithi008.stdout: "description": "osd_op(client.4668.0:197401 5.1 5:88b38567:::benchmark_data_smithi006_114134_object63740:head [delete] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e61)", 2023-08-01T19:56:12.427 INFO:teuthology.orchestra.run.smithi008.stdout: "initiated_at": "2023-08-01T19:55:58.556607+0000", 2023-08-01T19:56:12.428 INFO:teuthology.orchestra.run.smithi008.stdout: "age": 13.761253756, 2023-08-01T19:56:12.428 INFO:teuthology.orchestra.run.smithi008.stdout: "duration": 1.0643254870000001, 2023-08-01T19:56:12.428 INFO:teuthology.orchestra.run.smithi008.stdout: "type_data": { 2023-08-01T19:56:12.428 INFO:teuthology.orchestra.run.smithi008.stdout: "flag_point": "reached pg", 2023-08-01T19:56:12.428 INFO:teuthology.orchestra.run.smithi008.stdout: "client_info": { 2023-08-01T19:56:12.428 INFO:teuthology.orchestra.run.smithi008.stdout: "client": "client.4668", 2023-08-01T19:56:12.428 INFO:teuthology.orchestra.run.smithi008.stdout: "client_addr": "172.21.15.6:0/1709472247", 2023-08-01T19:56:12.429 INFO:teuthology.orchestra.run.smithi008.stdout: "tid": 197401 2023-08-01T19:56:12.429 INFO:teuthology.orchestra.run.smithi008.stdout: }, 2023-08-01T19:56:12.429 INFO:teuthology.orchestra.run.smithi008.stdout: "events": [ 2023-08-01T19:56:12.429 INFO:teuthology.orchestra.run.smithi008.stdout: { 2023-08-01T19:56:12.429 INFO:teuthology.orchestra.run.smithi008.stdout: "event": "initiated", 2023-08-01T19:56:12.429 INFO:teuthology.orchestra.run.smithi008.stdout: "time": "2023-08-01T19:55:58.556607+0000", 2023-08-01T19:56:12.429 INFO:teuthology.orchestra.run.smithi008.stdout: "duration": 0 2023-08-01T19:56:12.429 INFO:teuthology.orchestra.run.smithi008.stdout: }, 2023-08-01T19:56:12.430 INFO:teuthology.orchestra.run.smithi008.stdout: { 2023-08-01T19:56:12.430 INFO:teuthology.orchestra.run.smithi008.stdout: "event": "throttled", 2023-08-01T19:56:12.430 INFO:teuthology.orchestra.run.smithi008.stdout: "time": "2023-08-01T19:55:58.556607+0000", 2023-08-01T19:56:12.430 INFO:teuthology.orchestra.run.smithi008.stdout: "duration": 0 2023-08-01T19:56:12.430 INFO:teuthology.orchestra.run.smithi008.stdout: }, 2023-08-01T19:56:12.430 INFO:teuthology.orchestra.run.smithi008.stdout: { 2023-08-01T19:56:12.430 INFO:teuthology.orchestra.run.smithi008.stdout: "event": "header_read", 2023-08-01T19:56:12.430 INFO:teuthology.orchestra.run.smithi008.stdout: "time": "2023-08-01T19:55:58.556606+0000", 2023-08-01T19:56:12.431 INFO:teuthology.orchestra.run.smithi008.stdout: "duration": 4294967295.9999995 2023-08-01T19:56:12.431 INFO:teuthology.orchestra.run.smithi008.stdout: }, 2023-08-01T19:56:12.431 INFO:teuthology.orchestra.run.smithi008.stdout: { 2023-08-01T19:56:12.431 INFO:teuthology.orchestra.run.smithi008.stdout: "event": "all_read", 2023-08-01T19:56:12.431 INFO:teuthology.orchestra.run.smithi008.stdout: "time": "2023-08-01T19:55:58.556609+0000", 2023-08-01T19:56:12.431 INFO:teuthology.orchestra.run.smithi008.stdout: "duration": 3.1750000000000001e-06 2023-08-01T19:56:12.431 INFO:teuthology.orchestra.run.smithi008.stdout: }, 2023-08-01T19:56:12.431 INFO:teuthology.orchestra.run.smithi008.stdout: { 2023-08-01T19:56:12.432 INFO:teuthology.orchestra.run.smithi008.stdout: "event": "dispatched", 2023-08-01T19:56:12.432 INFO:teuthology.orchestra.run.smithi008.stdout: "time": "2023-08-01T19:55:58.556617+0000", 2023-08-01T19:56:12.432 INFO:teuthology.orchestra.run.smithi008.stdout: "duration": 7.2760000000000003e-06 2023-08-01T19:56:12.432 INFO:teuthology.orchestra.run.smithi008.stdout: }, 2023-08-01T19:56:12.432 INFO:teuthology.orchestra.run.smithi008.stdout: { 2023-08-01T19:56:12.432 INFO:teuthology.orchestra.run.smithi008.stdout: "event": "queued_for_pg", 2023-08-01T19:56:12.432 INFO:teuthology.orchestra.run.smithi008.stdout: "time": "2023-08-01T19:55:58.556621+0000", 2023-08-01T19:56:12.433 INFO:teuthology.orchestra.run.smithi008.stdout: "duration": 4.8219999999999997e-06 2023-08-01T19:56:12.433 INFO:teuthology.orchestra.run.smithi008.stdout: }, 2023-08-01T19:56:12.433 INFO:teuthology.orchestra.run.smithi008.stdout: { 2023-08-01T19:56:12.433 INFO:teuthology.orchestra.run.smithi008.stdout: "event": "reached_pg", 2023-08-01T19:56:12.433 INFO:teuthology.orchestra.run.smithi008.stdout: "time": "2023-08-01T19:55:58.556651+0000", 2023-08-01T19:56:12.433 INFO:teuthology.orchestra.run.smithi008.stdout: "duration": 2.9921999999999999e-05 2023-08-01T19:56:12.433 INFO:teuthology.orchestra.run.smithi008.stdout: }, 2023-08-01T19:56:12.433 INFO:teuthology.orchestra.run.smithi008.stdout: { 2023-08-01T19:56:12.434 INFO:teuthology.orchestra.run.smithi008.stdout: "event": "started", 2023-08-01T19:56:12.434 INFO:teuthology.orchestra.run.smithi008.stdout: "time": "2023-08-01T19:55:58.556755+0000", 2023-08-01T19:56:12.434 INFO:teuthology.orchestra.run.smithi008.stdout: "duration": 0.000103309 2023-08-01T19:56:12.434 INFO:teuthology.orchestra.run.smithi008.stdout: }, 2023-08-01T19:56:12.434 INFO:teuthology.orchestra.run.smithi008.stdout: { 2023-08-01T19:56:12.434 INFO:teuthology.orchestra.run.smithi008.stdout: "event": "waiting for subops from 1", 2023-08-01T19:56:12.434 INFO:teuthology.orchestra.run.smithi008.stdout: "time": "2023-08-01T19:55:58.556875+0000", 2023-08-01T19:56:12.434 INFO:teuthology.orchestra.run.smithi008.stdout: "duration": 0.000120424 2023-08-01T19:56:12.435 INFO:teuthology.orchestra.run.smithi008.stdout: }, 2023-08-01T19:56:12.435 INFO:teuthology.orchestra.run.smithi008.stdout: { 2023-08-01T19:56:12.435 INFO:teuthology.orchestra.run.smithi008.stdout: "event": "reached_pg", 2023-08-01T19:56:12.435 INFO:teuthology.orchestra.run.smithi008.stdout: "time": "2023-08-01T19:55:58.569459+0000", 2023-08-01T19:56:12.435 INFO:teuthology.orchestra.run.smithi008.stdout: "duration": 0.012583776 2023-08-01T19:56:12.435 INFO:teuthology.orchestra.run.smithi008.stdout: }, 2023-08-01T19:56:12.435 INFO:teuthology.orchestra.run.smithi008.stdout: { 2023-08-01T19:56:12.435 INFO:teuthology.orchestra.run.smithi008.stdout: "event": "waiting for peered", 2023-08-01T19:56:12.436 INFO:teuthology.orchestra.run.smithi008.stdout: "time": "2023-08-01T19:55:58.569462+0000", 2023-08-01T19:56:12.436 INFO:teuthology.orchestra.run.smithi008.stdout: "duration": 2.74e-06 2023-08-01T19:56:12.436 INFO:teuthology.orchestra.run.smithi008.stdout: }, 2023-08-01T19:56:12.436 INFO:teuthology.orchestra.run.smithi008.stdout: { 2023-08-01T19:56:12.436 INFO:teuthology.orchestra.run.smithi008.stdout: "event": "reached_pg", 2023-08-01T19:56:12.436 INFO:teuthology.orchestra.run.smithi008.stdout: "time": "2023-08-01T19:55:59.620880+0000", 2023-08-01T19:56:12.436 INFO:teuthology.orchestra.run.smithi008.stdout: "duration": 1.0514181279999999 2023-08-01T19:56:12.437 INFO:teuthology.orchestra.run.smithi008.stdout: }, 2023-08-01T19:56:12.437 INFO:teuthology.orchestra.run.smithi008.stdout: { 2023-08-01T19:56:12.437 INFO:teuthology.orchestra.run.smithi008.stdout: "event": "done", 2023-08-01T19:56:12.437 INFO:teuthology.orchestra.run.smithi008.stdout: "time": "2023-08-01T19:55:59.620932+0000", 2023-08-01T19:56:12.437 INFO:teuthology.orchestra.run.smithi008.stdout: "duration": 5.2404000000000002e-05 2023-08-01T19:56:12.437 INFO:teuthology.orchestra.run.smithi008.stdout: } 2023-08-01T19:56:12.437 INFO:teuthology.orchestra.run.smithi008.stdout: ] 2023-08-01T19:56:12.437 INFO:teuthology.orchestra.run.smithi008.stdout: } 2023-08-01T19:56:12.438 INFO:teuthology.orchestra.run.smithi008.stdout: }, 2023-08-01T19:56:12.438 INFO:teuthology.orchestra.run.smithi008.stdout: { 2023-08-01T19:56:12.438 INFO:teuthology.orchestra.run.smithi008.stdout: "description": "osd_op(client.4668.0:197402 5.c 5:3f057b78:::benchmark_data_smithi006_114134_object63741:head [delete] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e61)", 2023-08-01T19:56:12.438 INFO:teuthology.orchestra.run.smithi008.stdout: "initiated_at": "2023-08-01T19:55:58.556632+0000", 2023-08-01T19:56:12.438 INFO:teuthology.orchestra.run.smithi008.stdout: "age": 13.761228385999999, 2023-08-01T19:56:12.438 INFO:teuthology.orchestra.run.smithi008.stdout: "duration": 1.0625773970000001, 2023-08-01T19:56:12.438 INFO:teuthology.orchestra.run.smithi008.stdout: "type_data": { 2023-08-01T19:56:12.438 INFO:teuthology.orchestra.run.smithi008.stdout: "flag_point": "reached pg", 2023-08-01T19:56:12.439 INFO:teuthology.orchestra.run.smithi008.stdout: "client_info": { 2023-08-01T19:56:12.439 INFO:teuthology.orchestra.run.smithi008.stdout: "client": "client.4668", 2023-08-01T19:56:12.439 INFO:teuthology.orchestra.run.smithi008.stdout: "client_addr": "172.21.15.6:0/1709472247", 2023-08-01T19:56:12.439 INFO:teuthology.orchestra.run.smithi008.stdout: "tid": 197402 2023-08-01T19:56:12.439 INFO:teuthology.orchestra.run.smithi008.stdout: }, 2023-08-01T19:56:12.439 INFO:teuthology.orchestra.run.smithi008.stdout: "events": [ 2023-08-01T19:56:12.439 INFO:teuthology.orchestra.run.smithi008.stdout: { 2023-08-01T19:56:12.440 INFO:teuthology.orchestra.run.smithi008.stdout: "event": "initiated", 2023-08-01T19:56:12.440 INFO:teuthology.orchestra.run.smithi008.stdout: "time": "2023-08-01T19:55:58.556632+0000", 2023-08-01T19:56:12.440 INFO:teuthology.orchestra.run.smithi008.stdout: "duration": 0 2023-08-01T19:56:12.440 INFO:teuthology.orchestra.run.smithi008.stdout: }, 2023-08-01T19:56:12.440 INFO:teuthology.orchestra.run.smithi008.stdout: { 2023-08-01T19:56:12.440 INFO:teuthology.orchestra.run.smithi008.stdout: "event": "throttled", 2023-08-01T19:56:12.440 INFO:teuthology.orchestra.run.smithi008.stdout: "time": "2023-08-01T19:55:58.556632+0000", 2023-08-01T19:56:12.440 INFO:teuthology.orchestra.run.smithi008.stdout: "duration": 0 2023-08-01T19:56:12.441 INFO:teuthology.orchestra.run.smithi008.stdout: }, 2023-08-01T19:56:12.441 INFO:teuthology.orchestra.run.smithi008.stdout: { 2023-08-01T19:56:12.441 INFO:teuthology.orchestra.run.smithi008.stdout: "event": "header_read", 2023-08-01T19:56:12.441 INFO:teuthology.orchestra.run.smithi008.stdout: "time": "2023-08-01T19:55:58.556632+0000", 2023-08-01T19:56:12.441 INFO:teuthology.orchestra.run.smithi008.stdout: "duration": 4294967295.9999995 2023-08-01T19:56:12.441 INFO:teuthology.orchestra.run.smithi008.stdout: }, 2023-08-01T19:56:12.441 INFO:teuthology.orchestra.run.smithi008.stdout: { 2023-08-01T19:56:12.442 INFO:teuthology.orchestra.run.smithi008.stdout: "event": "all_read", 2023-08-01T19:56:12.442 INFO:teuthology.orchestra.run.smithi008.stdout: "time": "2023-08-01T19:55:58.556634+0000", 2023-08-01T19:56:12.442 INFO:teuthology.orchestra.run.smithi008.stdout: "duration": 2.8940000000000002e-06 2023-08-01T19:56:12.442 INFO:teuthology.orchestra.run.smithi008.stdout: }, 2023-08-01T19:56:12.442 INFO:teuthology.orchestra.run.smithi008.stdout: { 2023-08-01T19:56:12.442 INFO:teuthology.orchestra.run.smithi008.stdout: "event": "dispatched", 2023-08-01T19:56:12.442 INFO:teuthology.orchestra.run.smithi008.stdout: "time": "2023-08-01T19:55:58.556641+0000", 2023-08-01T19:56:12.442 INFO:teuthology.orchestra.run.smithi008.stdout: "duration": 6.8449999999999997e-06 2023-08-01T19:56:12.443 INFO:teuthology.orchestra.run.smithi008.stdout: }, 2023-08-01T19:56:12.443 INFO:teuthology.orchestra.run.smithi008.stdout: { 2023-08-01T19:56:12.443 INFO:teuthology.orchestra.run.smithi008.stdout: "event": "queued_for_pg", 2023-08-01T19:56:12.443 INFO:teuthology.orchestra.run.smithi008.stdout: "time": "2023-08-01T19:55:58.556646+0000", 2023-08-01T19:56:12.443 INFO:teuthology.orchestra.run.smithi008.stdout: "duration": 5.2070000000000003e-06 2023-08-01T19:56:12.443 INFO:teuthology.orchestra.run.smithi008.stdout: }, 2023-08-01T19:56:12.443 INFO:teuthology.orchestra.run.smithi008.stdout: { 2023-08-01T19:56:12.443 INFO:teuthology.orchestra.run.smithi008.stdout: "event": "reached_pg", 2023-08-01T19:56:12.444 INFO:teuthology.orchestra.run.smithi008.stdout: "time": "2023-08-01T19:55:58.558870+0000", 2023-08-01T19:56:12.444 INFO:teuthology.orchestra.run.smithi008.stdout: "duration": 0.0022237730000000001 2023-08-01T19:56:12.444 INFO:teuthology.orchestra.run.smithi008.stdout: }, 2023-08-01T19:56:12.444 INFO:teuthology.orchestra.run.smithi008.stdout: { 2023-08-01T19:56:12.444 INFO:teuthology.orchestra.run.smithi008.stdout: "event": "started", 2023-08-01T19:56:12.444 INFO:teuthology.orchestra.run.smithi008.stdout: "time": "2023-08-01T19:55:58.559013+0000", 2023-08-01T19:56:12.444 INFO:teuthology.orchestra.run.smithi008.stdout: "duration": 0.00014289899999999999 2023-08-01T19:56:12.445 INFO:teuthology.orchestra.run.smithi008.stdout: }, 2023-08-01T19:56:12.445 INFO:teuthology.orchestra.run.smithi008.stdout: { 2023-08-01T19:56:12.445 INFO:teuthology.orchestra.run.smithi008.stdout: "event": "waiting for subops from 1", 2023-08-01T19:56:12.445 INFO:teuthology.orchestra.run.smithi008.stdout: "time": "2023-08-01T19:55:58.559137+0000", 2023-08-01T19:56:12.445 INFO:teuthology.orchestra.run.smithi008.stdout: "duration": 0.00012428499999999999 2023-08-01T19:56:12.445 INFO:teuthology.orchestra.run.smithi008.stdout: }, 2023-08-01T19:56:12.445 INFO:teuthology.orchestra.run.smithi008.stdout: { 2023-08-01T19:56:12.445 INFO:teuthology.orchestra.run.smithi008.stdout: "event": "reached_pg", 2023-08-01T19:56:12.446 INFO:teuthology.orchestra.run.smithi008.stdout: "time": "2023-08-01T19:55:58.567438+0000", 2023-08-01T19:56:12.446 INFO:teuthology.orchestra.run.smithi008.stdout: "duration": 0.0083003190000000004 2023-08-01T19:56:12.446 INFO:teuthology.orchestra.run.smithi008.stdout: }, 2023-08-01T19:56:12.446 INFO:teuthology.orchestra.run.smithi008.stdout: { 2023-08-01T19:56:12.446 INFO:teuthology.orchestra.run.smithi008.stdout: "event": "waiting for peered", 2023-08-01T19:56:12.446 INFO:teuthology.orchestra.run.smithi008.stdout: "time": "2023-08-01T19:55:58.567443+0000", 2023-08-01T19:56:12.446 INFO:teuthology.orchestra.run.smithi008.stdout: "duration": 5.1739999999999999e-06 2023-08-01T19:56:12.446 INFO:teuthology.orchestra.run.smithi008.stdout: }, 2023-08-01T19:56:12.447 INFO:teuthology.orchestra.run.smithi008.stdout: { 2023-08-01T19:56:12.447 INFO:teuthology.orchestra.run.smithi008.stdout: "event": "reached_pg", 2023-08-01T19:56:12.447 INFO:teuthology.orchestra.run.smithi008.stdout: "time": "2023-08-01T19:55:59.619164+0000", 2023-08-01T19:56:12.447 INFO:teuthology.orchestra.run.smithi008.stdout: "duration": 1.0517206750000001 2023-08-01T19:56:12.447 INFO:teuthology.orchestra.run.smithi008.stdout: }, 2023-08-01T19:56:12.447 INFO:teuthology.orchestra.run.smithi008.stdout: { 2023-08-01T19:56:12.447 INFO:teuthology.orchestra.run.smithi008.stdout: "event": "done", 2023-08-01T19:56:12.447 INFO:teuthology.orchestra.run.smithi008.stdout: "time": "2023-08-01T19:55:59.619209+0000", 2023-08-01T19:56:12.448 INFO:teuthology.orchestra.run.smithi008.stdout: "duration": 4.5800000000000002e-05 2023-08-01T19:56:12.448 INFO:teuthology.orchestra.run.smithi008.stdout: } 2023-08-01T19:56:12.448 INFO:teuthology.orchestra.run.smithi008.stdout: ] 2023-08-01T19:56:12.448 INFO:teuthology.orchestra.run.smithi008.stdout: } 2023-08-01T19:56:12.448 INFO:teuthology.orchestra.run.smithi008.stdout: }, 2023-08-01T19:56:12.448 INFO:teuthology.orchestra.run.smithi008.stdout: { 2023-08-01T19:56:12.448 INFO:teuthology.orchestra.run.smithi008.stdout: "description": "osd_op(client.4668.0:197404 5.5 5:a3c9c1bd:::benchmark_data_smithi006_114134_object63743:head [delete] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e61)", 2023-08-01T19:56:12.449 INFO:teuthology.orchestra.run.smithi008.stdout: "initiated_at": "2023-08-01T19:55:58.556653+0000", 2023-08-01T19:56:12.449 INFO:teuthology.orchestra.run.smithi008.stdout: "age": 13.761207431999999, 2023-08-01T19:56:12.449 INFO:teuthology.orchestra.run.smithi008.stdout: "duration": 1.061865576, 2023-08-01T19:56:12.449 INFO:teuthology.orchestra.run.smithi008.stdout: "type_data": { 2023-08-01T19:56:12.449 INFO:teuthology.orchestra.run.smithi008.stdout: "flag_point": "reached pg", 2023-08-01T19:56:12.449 INFO:teuthology.orchestra.run.smithi008.stdout: "client_info": { 2023-08-01T19:56:12.449 INFO:teuthology.orchestra.run.smithi008.stdout: "client": "client.4668", 2023-08-01T19:56:12.449 INFO:teuthology.orchestra.run.smithi008.stdout: "client_addr": "172.21.15.6:0/1709472247", 2023-08-01T19:56:12.450 INFO:teuthology.orchestra.run.smithi008.stdout: "tid": 197404 2023-08-01T19:56:12.450 INFO:teuthology.orchestra.run.smithi008.stdout: }, 2023-08-01T19:56:12.450 INFO:teuthology.orchestra.run.smithi008.stdout: "events": [ 2023-08-01T19:56:12.450 INFO:teuthology.orchestra.run.smithi008.stdout: { 2023-08-01T19:56:12.450 INFO:teuthology.orchestra.run.smithi008.stdout: "event": "initiated", 2023-08-01T19:56:12.450 INFO:teuthology.orchestra.run.smithi008.stdout: "time": "2023-08-01T19:55:58.556653+0000", 2023-08-01T19:56:12.450 INFO:teuthology.orchestra.run.smithi008.stdout: "duration": 0 2023-08-01T19:56:12.450 INFO:teuthology.orchestra.run.smithi008.stdout: }, 2023-08-01T19:56:12.451 INFO:teuthology.orchestra.run.smithi008.stdout: { 2023-08-01T19:56:12.451 INFO:teuthology.orchestra.run.smithi008.stdout: "event": "throttled", 2023-08-01T19:56:12.451 INFO:teuthology.orchestra.run.smithi008.stdout: "time": "2023-08-01T19:55:58.556653+0000", 2023-08-01T19:56:12.451 INFO:teuthology.orchestra.run.smithi008.stdout: "duration": 0 2023-08-01T19:56:12.451 INFO:teuthology.orchestra.run.smithi008.stdout: }, 2023-08-01T19:56:12.451 INFO:teuthology.orchestra.run.smithi008.stdout: { 2023-08-01T19:56:12.451 INFO:teuthology.orchestra.run.smithi008.stdout: "event": "header_read", 2023-08-01T19:56:12.451 INFO:teuthology.orchestra.run.smithi008.stdout: "time": "2023-08-01T19:55:58.556653+0000", 2023-08-01T19:56:12.452 INFO:teuthology.orchestra.run.smithi008.stdout: "duration": 4294967295.9999995 2023-08-01T19:56:12.452 INFO:teuthology.orchestra.run.smithi008.stdout: }, 2023-08-01T19:56:12.452 INFO:teuthology.orchestra.run.smithi008.stdout: { 2023-08-01T19:56:12.452 INFO:teuthology.orchestra.run.smithi008.stdout: "event": "all_read", 2023-08-01T19:56:12.452 INFO:teuthology.orchestra.run.smithi008.stdout: "time": "2023-08-01T19:55:58.556655+0000", 2023-08-01T19:56:12.452 INFO:teuthology.orchestra.run.smithi008.stdout: "duration": 2.435e-06 2023-08-01T19:56:12.452 INFO:teuthology.orchestra.run.smithi008.stdout: }, 2023-08-01T19:56:12.453 INFO:teuthology.orchestra.run.smithi008.stdout: { 2023-08-01T19:56:12.453 INFO:teuthology.orchestra.run.smithi008.stdout: "event": "dispatched", 2023-08-01T19:56:12.453 INFO:teuthology.orchestra.run.smithi008.stdout: "time": "2023-08-01T19:55:58.556661+0000", 2023-08-01T19:56:12.453 INFO:teuthology.orchestra.run.smithi008.stdout: "duration": 6.0599999999999996e-06 2023-08-01T19:56:12.453 INFO:teuthology.orchestra.run.smithi008.stdout: }, 2023-08-01T19:56:12.453 INFO:teuthology.orchestra.run.smithi008.stdout: { 2023-08-01T19:56:12.453 INFO:teuthology.orchestra.run.smithi008.stdout: "event": "queued_for_pg", 2023-08-01T19:56:12.453 INFO:teuthology.orchestra.run.smithi008.stdout: "time": "2023-08-01T19:55:58.556666+0000", 2023-08-01T19:56:12.454 INFO:teuthology.orchestra.run.smithi008.stdout: "duration": 4.9620000000000001e-06 2023-08-01T19:56:12.454 INFO:teuthology.orchestra.run.smithi008.stdout: }, 2023-08-01T19:56:12.454 INFO:teuthology.orchestra.run.smithi008.stdout: { 2023-08-01T19:56:12.454 INFO:teuthology.orchestra.run.smithi008.stdout: "event": "reached_pg", 2023-08-01T19:56:12.454 INFO:teuthology.orchestra.run.smithi008.stdout: "time": "2023-08-01T19:55:58.556698+0000", 2023-08-01T19:56:12.454 INFO:teuthology.orchestra.run.smithi008.stdout: "duration": 3.2302999999999999e-05 2023-08-01T19:56:12.454 INFO:teuthology.orchestra.run.smithi008.stdout: }, 2023-08-01T19:56:12.454 INFO:teuthology.orchestra.run.smithi008.stdout: { 2023-08-01T19:56:12.455 INFO:teuthology.orchestra.run.smithi008.stdout: "event": "started", 2023-08-01T19:56:12.455 INFO:teuthology.orchestra.run.smithi008.stdout: "time": "2023-08-01T19:55:58.556773+0000", 2023-08-01T19:56:12.455 INFO:teuthology.orchestra.run.smithi008.stdout: "duration": 7.4431999999999995e-05 2023-08-01T19:56:12.455 INFO:teuthology.orchestra.run.smithi008.stdout: }, 2023-08-01T19:56:12.455 INFO:teuthology.orchestra.run.smithi008.stdout: { 2023-08-01T19:56:12.455 INFO:teuthology.orchestra.run.smithi008.stdout: "event": "waiting for subops from 1", 2023-08-01T19:56:12.455 INFO:teuthology.orchestra.run.smithi008.stdout: "time": "2023-08-01T19:55:58.556837+0000", 2023-08-01T19:56:12.455 INFO:teuthology.orchestra.run.smithi008.stdout: "duration": 6.4522000000000003e-05 2023-08-01T19:56:12.456 INFO:teuthology.orchestra.run.smithi008.stdout: }, 2023-08-01T19:56:12.456 INFO:teuthology.orchestra.run.smithi008.stdout: { 2023-08-01T19:56:12.456 INFO:teuthology.orchestra.run.smithi008.stdout: "event": "reached_pg", 2023-08-01T19:56:12.456 INFO:teuthology.orchestra.run.smithi008.stdout: "time": "2023-08-01T19:55:58.563930+0000", 2023-08-01T19:56:12.456 INFO:teuthology.orchestra.run.smithi008.stdout: "duration": 0.0070929030000000002 2023-08-01T19:56:12.456 INFO:teuthology.orchestra.run.smithi008.stdout: }, 2023-08-01T19:56:12.456 INFO:teuthology.orchestra.run.smithi008.stdout: { 2023-08-01T19:56:12.456 INFO:teuthology.orchestra.run.smithi008.stdout: "event": "waiting for peered", 2023-08-01T19:56:12.457 INFO:teuthology.orchestra.run.smithi008.stdout: "time": "2023-08-01T19:55:58.563939+0000", 2023-08-01T19:56:12.457 INFO:teuthology.orchestra.run.smithi008.stdout: "duration": 8.6079999999999996e-06 2023-08-01T19:56:12.457 INFO:teuthology.orchestra.run.smithi008.stdout: }, 2023-08-01T19:56:12.457 INFO:teuthology.orchestra.run.smithi008.stdout: { 2023-08-01T19:56:12.457 INFO:teuthology.orchestra.run.smithi008.stdout: "event": "reached_pg", 2023-08-01T19:56:12.457 INFO:teuthology.orchestra.run.smithi008.stdout: "time": "2023-08-01T19:55:59.618422+0000", 2023-08-01T19:56:12.457 INFO:teuthology.orchestra.run.smithi008.stdout: "duration": 1.054483295 2023-08-01T19:56:12.458 INFO:teuthology.orchestra.run.smithi008.stdout: }, 2023-08-01T19:56:12.458 INFO:teuthology.orchestra.run.smithi008.stdout: { 2023-08-01T19:56:12.458 INFO:teuthology.orchestra.run.smithi008.stdout: "event": "done", 2023-08-01T19:56:12.458 INFO:teuthology.orchestra.run.smithi008.stdout: "time": "2023-08-01T19:55:59.618519+0000", 2023-08-01T19:56:12.458 INFO:teuthology.orchestra.run.smithi008.stdout: "duration": 9.6471000000000005e-05 2023-08-01T19:56:12.458 INFO:teuthology.orchestra.run.smithi008.stdout: } 2023-08-01T19:56:12.458 INFO:teuthology.orchestra.run.smithi008.stdout: ] 2023-08-01T19:56:12.458 INFO:teuthology.orchestra.run.smithi008.stdout: } 2023-08-01T19:56:12.459 INFO:teuthology.orchestra.run.smithi008.stdout: }, 2023-08-01T19:56:12.459 INFO:teuthology.orchestra.run.smithi008.stdout: { 2023-08-01T19:56:12.459 INFO:teuthology.orchestra.run.smithi008.stdout: "description": "osd_op(client.4668.0:197407 5.1 5:85528fae:::benchmark_data_smithi006_114134_object63746:head [delete] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e61)", 2023-08-01T19:56:12.459 INFO:teuthology.orchestra.run.smithi008.stdout: "initiated_at": "2023-08-01T19:55:58.559216+0000", 2023-08-01T19:56:12.459 INFO:teuthology.orchestra.run.smithi008.stdout: "age": 13.758644783999999, 2023-08-01T19:56:12.459 INFO:teuthology.orchestra.run.smithi008.stdout: "duration": 1.061802277, 2023-08-01T19:56:12.459 INFO:teuthology.orchestra.run.smithi008.stdout: "type_data": { 2023-08-01T19:56:12.459 INFO:teuthology.orchestra.run.smithi008.stdout: "flag_point": "reached pg", 2023-08-01T19:56:12.460 INFO:teuthology.orchestra.run.smithi008.stdout: "client_info": { 2023-08-01T19:56:12.460 INFO:teuthology.orchestra.run.smithi008.stdout: "client": "client.4668", 2023-08-01T19:56:12.460 INFO:teuthology.orchestra.run.smithi008.stdout: "client_addr": "172.21.15.6:0/1709472247", 2023-08-01T19:56:12.460 INFO:teuthology.orchestra.run.smithi008.stdout: "tid": 197407 2023-08-01T19:56:12.460 INFO:teuthology.orchestra.run.smithi008.stdout: }, 2023-08-01T19:56:12.460 INFO:teuthology.orchestra.run.smithi008.stdout: "events": [ 2023-08-01T19:56:12.460 INFO:teuthology.orchestra.run.smithi008.stdout: { 2023-08-01T19:56:12.460 INFO:teuthology.orchestra.run.smithi008.stdout: "event": "initiated", 2023-08-01T19:56:12.461 INFO:teuthology.orchestra.run.smithi008.stdout: "time": "2023-08-01T19:55:58.559216+0000", 2023-08-01T19:56:12.461 INFO:teuthology.orchestra.run.smithi008.stdout: "duration": 0 2023-08-01T19:56:12.461 INFO:teuthology.orchestra.run.smithi008.stdout: }, 2023-08-01T19:56:12.461 INFO:teuthology.orchestra.run.smithi008.stdout: { 2023-08-01T19:56:12.461 INFO:teuthology.orchestra.run.smithi008.stdout: "event": "throttled", 2023-08-01T19:56:12.461 INFO:teuthology.orchestra.run.smithi008.stdout: "time": "2023-08-01T19:55:58.559216+0000", 2023-08-01T19:56:12.461 INFO:teuthology.orchestra.run.smithi008.stdout: "duration": 0 2023-08-01T19:56:12.461 INFO:teuthology.orchestra.run.smithi008.stdout: }, 2023-08-01T19:56:12.462 INFO:teuthology.orchestra.run.smithi008.stdout: { 2023-08-01T19:56:12.462 INFO:teuthology.orchestra.run.smithi008.stdout: "event": "header_read", 2023-08-01T19:56:12.462 INFO:teuthology.orchestra.run.smithi008.stdout: "time": "2023-08-01T19:55:58.559215+0000", 2023-08-01T19:56:12.462 INFO:teuthology.orchestra.run.smithi008.stdout: "duration": 4294967295.999999 2023-08-01T19:56:12.462 INFO:teuthology.orchestra.run.smithi008.stdout: }, 2023-08-01T19:56:12.462 INFO:teuthology.orchestra.run.smithi008.stdout: { 2023-08-01T19:56:12.462 INFO:teuthology.orchestra.run.smithi008.stdout: "event": "all_read", 2023-08-01T19:56:12.463 INFO:teuthology.orchestra.run.smithi008.stdout: "time": "2023-08-01T19:55:58.559220+0000", 2023-08-01T19:56:12.463 INFO:teuthology.orchestra.run.smithi008.stdout: "duration": 5.3879999999999999e-06 2023-08-01T19:56:12.463 INFO:teuthology.orchestra.run.smithi008.stdout: }, 2023-08-01T19:56:12.463 INFO:teuthology.orchestra.run.smithi008.stdout: { 2023-08-01T19:56:12.463 INFO:teuthology.orchestra.run.smithi008.stdout: "event": "dispatched", 2023-08-01T19:56:12.463 INFO:teuthology.orchestra.run.smithi008.stdout: "time": "2023-08-01T19:55:58.559230+0000", 2023-08-01T19:56:12.463 INFO:teuthology.orchestra.run.smithi008.stdout: "duration": 9.6590000000000002e-06 2023-08-01T19:56:12.463 INFO:teuthology.orchestra.run.smithi008.stdout: }, 2023-08-01T19:56:12.464 INFO:teuthology.orchestra.run.smithi008.stdout: { 2023-08-01T19:56:12.464 INFO:teuthology.orchestra.run.smithi008.stdout: "event": "queued_for_pg", 2023-08-01T19:56:12.464 INFO:teuthology.orchestra.run.smithi008.stdout: "time": "2023-08-01T19:55:58.559235+0000", 2023-08-01T19:56:12.464 INFO:teuthology.orchestra.run.smithi008.stdout: "duration": 5.575e-06 2023-08-01T19:56:12.464 INFO:teuthology.orchestra.run.smithi008.stdout: }, 2023-08-01T19:56:12.464 INFO:teuthology.orchestra.run.smithi008.stdout: { 2023-08-01T19:56:12.464 INFO:teuthology.orchestra.run.smithi008.stdout: "event": "reached_pg", 2023-08-01T19:56:12.465 INFO:teuthology.orchestra.run.smithi008.stdout: "time": "2023-08-01T19:55:58.559279+0000", 2023-08-01T19:56:12.465 INFO:teuthology.orchestra.run.smithi008.stdout: "duration": 4.3273999999999999e-05 2023-08-01T19:56:12.465 INFO:teuthology.orchestra.run.smithi008.stdout: }, 2023-08-01T19:56:12.465 INFO:teuthology.orchestra.run.smithi008.stdout: { 2023-08-01T19:56:12.465 INFO:teuthology.orchestra.run.smithi008.stdout: "event": "started", 2023-08-01T19:56:12.465 INFO:teuthology.orchestra.run.smithi008.stdout: "time": "2023-08-01T19:55:58.559403+0000", 2023-08-01T19:56:12.465 INFO:teuthology.orchestra.run.smithi008.stdout: "duration": 0.000124781 2023-08-01T19:56:12.465 INFO:teuthology.orchestra.run.smithi008.stdout: }, 2023-08-01T19:56:12.466 INFO:teuthology.orchestra.run.smithi008.stdout: { 2023-08-01T19:56:12.466 INFO:teuthology.orchestra.run.smithi008.stdout: "event": "waiting for subops from 1", 2023-08-01T19:56:12.466 INFO:teuthology.orchestra.run.smithi008.stdout: "time": "2023-08-01T19:55:58.559561+0000", 2023-08-01T19:56:12.466 INFO:teuthology.orchestra.run.smithi008.stdout: "duration": 0.000157773 2023-08-01T19:56:12.466 INFO:teuthology.orchestra.run.smithi008.stdout: }, 2023-08-01T19:56:12.466 INFO:teuthology.orchestra.run.smithi008.stdout: { 2023-08-01T19:56:12.466 INFO:teuthology.orchestra.run.smithi008.stdout: "event": "reached_pg", 2023-08-01T19:56:12.467 INFO:teuthology.orchestra.run.smithi008.stdout: "time": "2023-08-01T19:55:58.569498+0000", 2023-08-01T19:56:12.467 INFO:teuthology.orchestra.run.smithi008.stdout: "duration": 0.0099367069999999995 2023-08-01T19:56:12.467 INFO:teuthology.orchestra.run.smithi008.stdout: }, 2023-08-01T19:56:12.467 INFO:teuthology.orchestra.run.smithi008.stdout: { 2023-08-01T19:56:12.467 INFO:teuthology.orchestra.run.smithi008.stdout: "event": "waiting for peered", 2023-08-01T19:56:12.467 INFO:teuthology.orchestra.run.smithi008.stdout: "time": "2023-08-01T19:55:58.569756+0000", 2023-08-01T19:56:12.467 INFO:teuthology.orchestra.run.smithi008.stdout: "duration": 0.00025830800000000001 2023-08-01T19:56:12.467 INFO:teuthology.orchestra.run.smithi008.stdout: }, 2023-08-01T19:56:12.468 INFO:teuthology.orchestra.run.smithi008.stdout: { 2023-08-01T19:56:12.468 INFO:teuthology.orchestra.run.smithi008.stdout: "event": "reached_pg", 2023-08-01T19:56:12.468 INFO:teuthology.orchestra.run.smithi008.stdout: "time": "2023-08-01T19:55:59.620962+0000", 2023-08-01T19:56:12.468 INFO:teuthology.orchestra.run.smithi008.stdout: "duration": 1.0512062129999999 2023-08-01T19:56:12.468 INFO:teuthology.orchestra.run.smithi008.stdout: }, 2023-08-01T19:56:12.468 INFO:teuthology.orchestra.run.smithi008.stdout: { 2023-08-01T19:56:12.468 INFO:teuthology.orchestra.run.smithi008.stdout: "event": "done", 2023-08-01T19:56:12.468 INFO:teuthology.orchestra.run.smithi008.stdout: "time": "2023-08-01T19:55:59.621018+0000", 2023-08-01T19:56:12.469 INFO:teuthology.orchestra.run.smithi008.stdout: "duration": 5.5498999999999998e-05 2023-08-01T19:56:12.469 INFO:teuthology.orchestra.run.smithi008.stdout: } 2023-08-01T19:56:12.469 INFO:teuthology.orchestra.run.smithi008.stdout: ] 2023-08-01T19:56:12.469 INFO:teuthology.orchestra.run.smithi008.stdout: } 2023-08-01T19:56:12.469 INFO:teuthology.orchestra.run.smithi008.stdout: }, 2023-08-01T19:56:12.469 INFO:teuthology.orchestra.run.smithi008.stdout: { 2023-08-01T19:56:12.469 INFO:teuthology.orchestra.run.smithi008.stdout: "description": "osd_op(client.4668.0:197396 5.2 5:43f8487b:::benchmark_data_smithi006_114134_object63735:head [delete] snapc 0=[] RETRY=1 ondisk+retry+write+known_if_redirected+supports_pool_eio e62)", 2023-08-01T19:56:12.469 INFO:teuthology.orchestra.run.smithi008.stdout: "initiated_at": "2023-08-01T19:55:58.564585+0000", 2023-08-01T19:56:12.470 INFO:teuthology.orchestra.run.smithi008.stdout: "age": 13.75327581, 2023-08-01T19:56:12.470 INFO:teuthology.orchestra.run.smithi008.stdout: "duration": 1.0535085049999999, 2023-08-01T19:56:12.470 INFO:teuthology.orchestra.run.smithi008.stdout: "type_data": { 2023-08-01T19:56:12.470 INFO:teuthology.orchestra.run.smithi008.stdout: "flag_point": "reached pg", 2023-08-01T19:56:12.470 INFO:teuthology.orchestra.run.smithi008.stdout: "client_info": { 2023-08-01T19:56:12.470 INFO:teuthology.orchestra.run.smithi008.stdout: "client": "client.4668", 2023-08-01T19:56:12.470 INFO:teuthology.orchestra.run.smithi008.stdout: "client_addr": "172.21.15.6:0/1709472247", 2023-08-01T19:56:12.471 INFO:teuthology.orchestra.run.smithi008.stdout: "tid": 197396 2023-08-01T19:56:12.471 INFO:teuthology.orchestra.run.smithi008.stdout: }, 2023-08-01T19:56:12.471 INFO:teuthology.orchestra.run.smithi008.stdout: "events": [ 2023-08-01T19:56:12.471 INFO:teuthology.orchestra.run.smithi008.stdout: { 2023-08-01T19:56:12.471 INFO:teuthology.orchestra.run.smithi008.stdout: "event": "initiated", 2023-08-01T19:56:12.471 INFO:teuthology.orchestra.run.smithi008.stdout: "time": "2023-08-01T19:55:58.564585+0000", 2023-08-01T19:56:12.471 INFO:teuthology.orchestra.run.smithi008.stdout: "duration": 0 2023-08-01T19:56:12.471 INFO:teuthology.orchestra.run.smithi008.stdout: }, 2023-08-01T19:56:12.472 INFO:teuthology.orchestra.run.smithi008.stdout: { 2023-08-01T19:56:12.472 INFO:teuthology.orchestra.run.smithi008.stdout: "event": "throttled", 2023-08-01T19:56:12.472 INFO:teuthology.orchestra.run.smithi008.stdout: "time": "2023-08-01T19:55:58.564585+0000", 2023-08-01T19:56:12.472 INFO:teuthology.orchestra.run.smithi008.stdout: "duration": 0 2023-08-01T19:56:12.472 INFO:teuthology.orchestra.run.smithi008.stdout: }, 2023-08-01T19:56:12.472 INFO:teuthology.orchestra.run.smithi008.stdout: { 2023-08-01T19:56:12.472 INFO:teuthology.orchestra.run.smithi008.stdout: "event": "header_read", 2023-08-01T19:56:12.473 INFO:teuthology.orchestra.run.smithi008.stdout: "time": "2023-08-01T19:55:58.564583+0000", 2023-08-01T19:56:12.473 INFO:teuthology.orchestra.run.smithi008.stdout: "duration": 4294967295.9999981 2023-08-01T19:56:12.473 INFO:teuthology.orchestra.run.smithi008.stdout: }, 2023-08-01T19:56:12.473 INFO:teuthology.orchestra.run.smithi008.stdout: { 2023-08-01T19:56:12.473 INFO:teuthology.orchestra.run.smithi008.stdout: "event": "all_read", 2023-08-01T19:56:12.473 INFO:teuthology.orchestra.run.smithi008.stdout: "time": "2023-08-01T19:55:58.564591+0000", 2023-08-01T19:56:12.473 INFO:teuthology.orchestra.run.smithi008.stdout: "duration": 8.2169999999999994e-06 2023-08-01T19:56:12.473 INFO:teuthology.orchestra.run.smithi008.stdout: }, 2023-08-01T19:56:12.474 INFO:teuthology.orchestra.run.smithi008.stdout: { 2023-08-01T19:56:12.474 INFO:teuthology.orchestra.run.smithi008.stdout: "event": "dispatched", 2023-08-01T19:56:12.474 INFO:teuthology.orchestra.run.smithi008.stdout: "time": "2023-08-01T19:55:58.564603+0000", 2023-08-01T19:56:12.474 INFO:teuthology.orchestra.run.smithi008.stdout: "duration": 1.186e-05 2023-08-01T19:56:12.474 INFO:teuthology.orchestra.run.smithi008.stdout: }, 2023-08-01T19:56:12.474 INFO:teuthology.orchestra.run.smithi008.stdout: { 2023-08-01T19:56:12.474 INFO:teuthology.orchestra.run.smithi008.stdout: "event": "queued_for_pg", 2023-08-01T19:56:12.474 INFO:teuthology.orchestra.run.smithi008.stdout: "time": "2023-08-01T19:55:58.564609+0000", 2023-08-01T19:56:12.475 INFO:teuthology.orchestra.run.smithi008.stdout: "duration": 6.4130000000000003e-06 2023-08-01T19:56:12.475 INFO:teuthology.orchestra.run.smithi008.stdout: }, 2023-08-01T19:56:12.475 INFO:teuthology.orchestra.run.smithi008.stdout: { 2023-08-01T19:56:12.475 INFO:teuthology.orchestra.run.smithi008.stdout: "event": "reached_pg", 2023-08-01T19:56:12.475 INFO:teuthology.orchestra.run.smithi008.stdout: "time": "2023-08-01T19:55:58.573439+0000", 2023-08-01T19:56:12.475 INFO:teuthology.orchestra.run.smithi008.stdout: "duration": 0.0088303310000000003 2023-08-01T19:56:12.475 INFO:teuthology.orchestra.run.smithi008.stdout: }, 2023-08-01T19:56:12.476 INFO:teuthology.orchestra.run.smithi008.stdout: { 2023-08-01T19:56:12.476 INFO:teuthology.orchestra.run.smithi008.stdout: "event": "waiting for peered", 2023-08-01T19:56:12.476 INFO:teuthology.orchestra.run.smithi008.stdout: "time": "2023-08-01T19:55:58.573448+0000", 2023-08-01T19:56:12.476 INFO:teuthology.orchestra.run.smithi008.stdout: "duration": 8.2910000000000007e-06 2023-08-01T19:56:12.476 INFO:teuthology.orchestra.run.smithi008.stdout: }, 2023-08-01T19:56:12.476 INFO:teuthology.orchestra.run.smithi008.stdout: { 2023-08-01T19:56:12.476 INFO:teuthology.orchestra.run.smithi008.stdout: "event": "reached_pg", 2023-08-01T19:56:12.476 INFO:teuthology.orchestra.run.smithi008.stdout: "time": "2023-08-01T19:55:59.617892+0000", 2023-08-01T19:56:12.477 INFO:teuthology.orchestra.run.smithi008.stdout: "duration": 1.0444446380000001 2023-08-01T19:56:12.477 INFO:teuthology.orchestra.run.smithi008.stdout: }, 2023-08-01T19:56:12.477 INFO:teuthology.orchestra.run.smithi008.stdout: { 2023-08-01T19:56:12.477 INFO:teuthology.orchestra.run.smithi008.stdout: "event": "done", 2023-08-01T19:56:12.477 INFO:teuthology.orchestra.run.smithi008.stdout: "time": "2023-08-01T19:55:59.618093+0000", 2023-08-01T19:56:12.477 INFO:teuthology.orchestra.run.smithi008.stdout: "duration": 0.00020066300000000001 2023-08-01T19:56:12.477 INFO:teuthology.orchestra.run.smithi008.stdout: } 2023-08-01T19:56:12.477 INFO:teuthology.orchestra.run.smithi008.stdout: ] 2023-08-01T19:56:12.478 INFO:teuthology.orchestra.run.smithi008.stdout: } 2023-08-01T19:56:12.478 INFO:teuthology.orchestra.run.smithi008.stdout: }, 2023-08-01T19:56:12.478 INFO:teuthology.orchestra.run.smithi008.stdout: { 2023-08-01T19:56:12.478 INFO:teuthology.orchestra.run.smithi008.stdout: "description": "osd_op(client.4668.0:197411 5.7 5:ebefbc20:::benchmark_data_smithi006_114134_object63750:head [delete] snapc 0=[] RETRY=1 ondisk+retry+write+known_if_redirected+supports_pool_eio e62)", 2023-08-01T19:56:12.478 INFO:teuthology.orchestra.run.smithi008.stdout: "initiated_at": "2023-08-01T19:55:58.564619+0000", 2023-08-01T19:56:12.478 INFO:teuthology.orchestra.run.smithi008.stdout: "age": 13.753241135, 2023-08-01T19:56:12.478 INFO:teuthology.orchestra.run.smithi008.stdout: "duration": 1.0686062569999999, 2023-08-01T19:56:12.479 INFO:teuthology.orchestra.run.smithi008.stdout: "type_data": { 2023-08-01T19:56:12.479 INFO:teuthology.orchestra.run.smithi008.stdout: "flag_point": "commit sent; apply or cleanup", 2023-08-01T19:56:12.479 INFO:teuthology.orchestra.run.smithi008.stdout: "client_info": { 2023-08-01T19:56:12.479 INFO:teuthology.orchestra.run.smithi008.stdout: "client": "client.4668", 2023-08-01T19:56:12.479 INFO:teuthology.orchestra.run.smithi008.stdout: "client_addr": "172.21.15.6:0/1709472247", 2023-08-01T19:56:12.479 INFO:teuthology.orchestra.run.smithi008.stdout: "tid": 197411 2023-08-01T19:56:12.479 INFO:teuthology.orchestra.run.smithi008.stdout: }, 2023-08-01T19:56:12.479 INFO:teuthology.orchestra.run.smithi008.stdout: "events": [ 2023-08-01T19:56:12.480 INFO:teuthology.orchestra.run.smithi008.stdout: { 2023-08-01T19:56:12.480 INFO:teuthology.orchestra.run.smithi008.stdout: "event": "initiated", 2023-08-01T19:56:12.480 INFO:teuthology.orchestra.run.smithi008.stdout: "time": "2023-08-01T19:55:58.564619+0000", 2023-08-01T19:56:12.480 INFO:teuthology.orchestra.run.smithi008.stdout: "duration": 0 2023-08-01T19:56:12.480 INFO:teuthology.orchestra.run.smithi008.stdout: }, 2023-08-01T19:56:12.480 INFO:teuthology.orchestra.run.smithi008.stdout: { 2023-08-01T19:56:12.480 INFO:teuthology.orchestra.run.smithi008.stdout: "event": "throttled", 2023-08-01T19:56:12.480 INFO:teuthology.orchestra.run.smithi008.stdout: "time": "2023-08-01T19:55:58.564619+0000", 2023-08-01T19:56:12.481 INFO:teuthology.orchestra.run.smithi008.stdout: "duration": 0 2023-08-01T19:56:12.481 INFO:teuthology.orchestra.run.smithi008.stdout: }, 2023-08-01T19:56:12.481 INFO:teuthology.orchestra.run.smithi008.stdout: { 2023-08-01T19:56:12.481 INFO:teuthology.orchestra.run.smithi008.stdout: "event": "header_read", 2023-08-01T19:56:12.481 INFO:teuthology.orchestra.run.smithi008.stdout: "time": "2023-08-01T19:55:58.564619+0000", 2023-08-01T19:56:12.481 INFO:teuthology.orchestra.run.smithi008.stdout: "duration": 4294967295.9999995 2023-08-01T19:56:12.481 INFO:teuthology.orchestra.run.smithi008.stdout: }, 2023-08-01T19:56:12.482 INFO:teuthology.orchestra.run.smithi008.stdout: { 2023-08-01T19:56:12.482 INFO:teuthology.orchestra.run.smithi008.stdout: "event": "all_read", 2023-08-01T19:56:12.482 INFO:teuthology.orchestra.run.smithi008.stdout: "time": "2023-08-01T19:55:58.564621+0000", 2023-08-01T19:56:12.482 INFO:teuthology.orchestra.run.smithi008.stdout: "duration": 2.6139999999999999e-06 2023-08-01T19:56:12.482 INFO:teuthology.orchestra.run.smithi008.stdout: }, 2023-08-01T19:56:12.482 INFO:teuthology.orchestra.run.smithi008.stdout: { 2023-08-01T19:56:12.482 INFO:teuthology.orchestra.run.smithi008.stdout: "event": "dispatched", 2023-08-01T19:56:12.482 INFO:teuthology.orchestra.run.smithi008.stdout: "time": "2023-08-01T19:55:58.564627+0000", 2023-08-01T19:56:12.483 INFO:teuthology.orchestra.run.smithi008.stdout: "duration": 5.1150000000000002e-06 2023-08-01T19:56:12.483 INFO:teuthology.orchestra.run.smithi008.stdout: }, 2023-08-01T19:56:12.483 INFO:teuthology.orchestra.run.smithi008.stdout: { 2023-08-01T19:56:12.483 INFO:teuthology.orchestra.run.smithi008.stdout: "event": "queued_for_pg", 2023-08-01T19:56:12.483 INFO:teuthology.orchestra.run.smithi008.stdout: "time": "2023-08-01T19:55:58.564631+0000", 2023-08-01T19:56:12.483 INFO:teuthology.orchestra.run.smithi008.stdout: "duration": 4.702e-06 2023-08-01T19:56:12.483 INFO:teuthology.orchestra.run.smithi008.stdout: }, 2023-08-01T19:56:12.483 INFO:teuthology.orchestra.run.smithi008.stdout: { 2023-08-01T19:56:12.484 INFO:teuthology.orchestra.run.smithi008.stdout: "event": "reached_pg", 2023-08-01T19:56:12.484 INFO:teuthology.orchestra.run.smithi008.stdout: "time": "2023-08-01T19:55:58.565520+0000", 2023-08-01T19:56:12.484 INFO:teuthology.orchestra.run.smithi008.stdout: "duration": 0.00088893399999999997 2023-08-01T19:56:12.484 INFO:teuthology.orchestra.run.smithi008.stdout: }, 2023-08-01T19:56:12.484 INFO:teuthology.orchestra.run.smithi008.stdout: { 2023-08-01T19:56:12.484 INFO:teuthology.orchestra.run.smithi008.stdout: "event": "waiting for peered", 2023-08-01T19:56:12.484 INFO:teuthology.orchestra.run.smithi008.stdout: "time": "2023-08-01T19:55:58.565528+0000", 2023-08-01T19:56:12.484 INFO:teuthology.orchestra.run.smithi008.stdout: "duration": 7.5410000000000003e-06 2023-08-01T19:56:12.485 INFO:teuthology.orchestra.run.smithi008.stdout: }, 2023-08-01T19:56:12.485 INFO:teuthology.orchestra.run.smithi008.stdout: { 2023-08-01T19:56:12.485 INFO:teuthology.orchestra.run.smithi008.stdout: "event": "reached_pg", 2023-08-01T19:56:12.485 INFO:teuthology.orchestra.run.smithi008.stdout: "time": "2023-08-01T19:55:59.622374+0000", 2023-08-01T19:56:12.485 INFO:teuthology.orchestra.run.smithi008.stdout: "duration": 1.05684588 2023-08-01T19:56:12.485 INFO:teuthology.orchestra.run.smithi008.stdout: }, 2023-08-01T19:56:12.485 INFO:teuthology.orchestra.run.smithi008.stdout: { 2023-08-01T19:56:12.486 INFO:teuthology.orchestra.run.smithi008.stdout: "event": "started", 2023-08-01T19:56:12.486 INFO:teuthology.orchestra.run.smithi008.stdout: "time": "2023-08-01T19:55:59.624156+0000", 2023-08-01T19:56:12.486 INFO:teuthology.orchestra.run.smithi008.stdout: "duration": 0.0017826129999999999 2023-08-01T19:56:12.486 INFO:teuthology.orchestra.run.smithi008.stdout: }, 2023-08-01T19:56:12.486 INFO:teuthology.orchestra.run.smithi008.stdout: { 2023-08-01T19:56:12.486 INFO:teuthology.orchestra.run.smithi008.stdout: "event": "op_commit", 2023-08-01T19:56:12.486 INFO:teuthology.orchestra.run.smithi008.stdout: "time": "2023-08-01T19:55:59.633131+0000", 2023-08-01T19:56:12.486 INFO:teuthology.orchestra.run.smithi008.stdout: "duration": 0.0089745740000000008 2023-08-01T19:56:12.487 INFO:teuthology.orchestra.run.smithi008.stdout: }, 2023-08-01T19:56:12.487 INFO:teuthology.orchestra.run.smithi008.stdout: { 2023-08-01T19:56:12.487 INFO:teuthology.orchestra.run.smithi008.stdout: "event": "commit_sent", 2023-08-01T19:56:12.487 INFO:teuthology.orchestra.run.smithi008.stdout: "time": "2023-08-01T19:55:59.633173+0000", 2023-08-01T19:56:12.487 INFO:teuthology.orchestra.run.smithi008.stdout: "duration": 4.2645000000000003e-05 2023-08-01T19:56:12.487 INFO:teuthology.orchestra.run.smithi008.stdout: }, 2023-08-01T19:56:12.487 INFO:teuthology.orchestra.run.smithi008.stdout: { 2023-08-01T19:56:12.487 INFO:teuthology.orchestra.run.smithi008.stdout: "event": "done", 2023-08-01T19:56:12.488 INFO:teuthology.orchestra.run.smithi008.stdout: "time": "2023-08-01T19:55:59.633225+0000", 2023-08-01T19:56:12.488 INFO:teuthology.orchestra.run.smithi008.stdout: "duration": 5.2003999999999999e-05 2023-08-01T19:56:12.488 INFO:teuthology.orchestra.run.smithi008.stdout: } 2023-08-01T19:56:12.488 INFO:teuthology.orchestra.run.smithi008.stdout: ] 2023-08-01T19:56:12.488 INFO:teuthology.orchestra.run.smithi008.stdout: } 2023-08-01T19:56:12.488 INFO:teuthology.orchestra.run.smithi008.stdout: }, 2023-08-01T19:56:12.488 INFO:teuthology.orchestra.run.smithi008.stdout: { 2023-08-01T19:56:12.489 INFO:teuthology.orchestra.run.smithi008.stdout: "description": "osd_op(client.4668.0:197413 5.5 5:a6ff9d8a:::benchmark_data_smithi006_114134_object63752:head [delete] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e62)", 2023-08-01T19:56:12.489 INFO:teuthology.orchestra.run.smithi008.stdout: "initiated_at": "2023-08-01T19:55:58.573778+0000", 2023-08-01T19:56:12.489 INFO:teuthology.orchestra.run.smithi008.stdout: "age": 13.744082169, 2023-08-01T19:56:12.489 INFO:teuthology.orchestra.run.smithi008.stdout: "duration": 1.054781371, 2023-08-01T19:56:12.489 INFO:teuthology.orchestra.run.smithi008.stdout: "type_data": { 2023-08-01T19:56:12.489 INFO:teuthology.orchestra.run.smithi008.stdout: "flag_point": "commit sent; apply or cleanup", 2023-08-01T19:56:12.489 INFO:teuthology.orchestra.run.smithi008.stdout: "client_info": { 2023-08-01T19:56:12.489 INFO:teuthology.orchestra.run.smithi008.stdout: "client": "client.4668", 2023-08-01T19:56:12.490 INFO:teuthology.orchestra.run.smithi008.stdout: "client_addr": "172.21.15.6:0/1709472247", 2023-08-01T19:56:12.490 INFO:teuthology.orchestra.run.smithi008.stdout: "tid": 197413 2023-08-01T19:56:12.490 INFO:teuthology.orchestra.run.smithi008.stdout: }, 2023-08-01T19:56:12.490 INFO:teuthology.orchestra.run.smithi008.stdout: "events": [ 2023-08-01T19:56:12.490 INFO:teuthology.orchestra.run.smithi008.stdout: { 2023-08-01T19:56:12.490 INFO:teuthology.orchestra.run.smithi008.stdout: "event": "initiated", 2023-08-01T19:56:12.490 INFO:teuthology.orchestra.run.smithi008.stdout: "time": "2023-08-01T19:55:58.573778+0000", 2023-08-01T19:56:12.490 INFO:teuthology.orchestra.run.smithi008.stdout: "duration": 0 2023-08-01T19:56:12.491 INFO:teuthology.orchestra.run.smithi008.stdout: }, 2023-08-01T19:56:12.491 INFO:teuthology.orchestra.run.smithi008.stdout: { 2023-08-01T19:56:12.491 INFO:teuthology.orchestra.run.smithi008.stdout: "event": "throttled", 2023-08-01T19:56:12.491 INFO:teuthology.orchestra.run.smithi008.stdout: "time": "2023-08-01T19:55:58.573778+0000", 2023-08-01T19:56:12.491 INFO:teuthology.orchestra.run.smithi008.stdout: "duration": 0 2023-08-01T19:56:12.491 INFO:teuthology.orchestra.run.smithi008.stdout: }, 2023-08-01T19:56:12.491 INFO:teuthology.orchestra.run.smithi008.stdout: { 2023-08-01T19:56:12.491 INFO:teuthology.orchestra.run.smithi008.stdout: "event": "header_read", 2023-08-01T19:56:12.492 INFO:teuthology.orchestra.run.smithi008.stdout: "time": "2023-08-01T19:55:58.573776+0000", 2023-08-01T19:56:12.492 INFO:teuthology.orchestra.run.smithi008.stdout: "duration": 4294967295.9999981 2023-08-01T19:56:12.492 INFO:teuthology.orchestra.run.smithi008.stdout: }, 2023-08-01T19:56:12.492 INFO:teuthology.orchestra.run.smithi008.stdout: { 2023-08-01T19:56:12.492 INFO:teuthology.orchestra.run.smithi008.stdout: "event": "all_read", 2023-08-01T19:56:12.492 INFO:teuthology.orchestra.run.smithi008.stdout: "time": "2023-08-01T19:55:58.573784+0000", 2023-08-01T19:56:12.492 INFO:teuthology.orchestra.run.smithi008.stdout: "duration": 8.2490000000000001e-06 2023-08-01T19:56:12.492 INFO:teuthology.orchestra.run.smithi008.stdout: }, 2023-08-01T19:56:12.493 INFO:teuthology.orchestra.run.smithi008.stdout: { 2023-08-01T19:56:12.493 INFO:teuthology.orchestra.run.smithi008.stdout: "event": "dispatched", 2023-08-01T19:56:12.493 INFO:teuthology.orchestra.run.smithi008.stdout: "time": "2023-08-01T19:55:58.574230+0000", 2023-08-01T19:56:12.493 INFO:teuthology.orchestra.run.smithi008.stdout: "duration": 0.00044558400000000001 2023-08-01T19:56:12.493 INFO:teuthology.orchestra.run.smithi008.stdout: }, 2023-08-01T19:56:12.493 INFO:teuthology.orchestra.run.smithi008.stdout: { 2023-08-01T19:56:12.493 INFO:teuthology.orchestra.run.smithi008.stdout: "event": "queued_for_pg", 2023-08-01T19:56:12.494 INFO:teuthology.orchestra.run.smithi008.stdout: "time": "2023-08-01T19:55:58.574240+0000", 2023-08-01T19:56:12.494 INFO:teuthology.orchestra.run.smithi008.stdout: "duration": 9.7699999999999996e-06 2023-08-01T19:56:12.494 INFO:teuthology.orchestra.run.smithi008.stdout: }, 2023-08-01T19:56:12.494 INFO:teuthology.orchestra.run.smithi008.stdout: { 2023-08-01T19:56:12.494 INFO:teuthology.orchestra.run.smithi008.stdout: "event": "reached_pg", 2023-08-01T19:56:12.494 INFO:teuthology.orchestra.run.smithi008.stdout: "time": "2023-08-01T19:55:58.574292+0000", 2023-08-01T19:56:12.494 INFO:teuthology.orchestra.run.smithi008.stdout: "duration": 5.2101000000000001e-05 2023-08-01T19:56:12.494 INFO:teuthology.orchestra.run.smithi008.stdout: }, 2023-08-01T19:56:12.495 INFO:teuthology.orchestra.run.smithi008.stdout: { 2023-08-01T19:56:12.495 INFO:teuthology.orchestra.run.smithi008.stdout: "event": "waiting for peered", 2023-08-01T19:56:12.495 INFO:teuthology.orchestra.run.smithi008.stdout: "time": "2023-08-01T19:55:58.574299+0000", 2023-08-01T19:56:12.495 INFO:teuthology.orchestra.run.smithi008.stdout: "duration": 7.3420000000000002e-06 2023-08-01T19:56:12.495 INFO:teuthology.orchestra.run.smithi008.stdout: }, 2023-08-01T19:56:12.495 INFO:teuthology.orchestra.run.smithi008.stdout: { 2023-08-01T19:56:12.495 INFO:teuthology.orchestra.run.smithi008.stdout: "event": "reached_pg", 2023-08-01T19:56:12.495 INFO:teuthology.orchestra.run.smithi008.stdout: "time": "2023-08-01T19:55:59.618545+0000", 2023-08-01T19:56:12.496 INFO:teuthology.orchestra.run.smithi008.stdout: "duration": 1.044245922 2023-08-01T19:56:12.496 INFO:teuthology.orchestra.run.smithi008.stdout: }, 2023-08-01T19:56:12.496 INFO:teuthology.orchestra.run.smithi008.stdout: { 2023-08-01T19:56:12.496 INFO:teuthology.orchestra.run.smithi008.stdout: "event": "started", 2023-08-01T19:56:12.496 INFO:teuthology.orchestra.run.smithi008.stdout: "time": "2023-08-01T19:55:59.618855+0000", 2023-08-01T19:56:12.496 INFO:teuthology.orchestra.run.smithi008.stdout: "duration": 0.00030964099999999999 2023-08-01T19:56:12.496 INFO:teuthology.orchestra.run.smithi008.stdout: }, 2023-08-01T19:56:12.497 INFO:teuthology.orchestra.run.smithi008.stdout: { 2023-08-01T19:56:12.497 INFO:teuthology.orchestra.run.smithi008.stdout: "event": "op_commit", 2023-08-01T19:56:12.497 INFO:teuthology.orchestra.run.smithi008.stdout: "time": "2023-08-01T19:55:59.628438+0000", 2023-08-01T19:56:12.497 INFO:teuthology.orchestra.run.smithi008.stdout: "duration": 0.0095832939999999991 2023-08-01T19:56:12.497 INFO:teuthology.orchestra.run.smithi008.stdout: }, 2023-08-01T19:56:12.497 INFO:teuthology.orchestra.run.smithi008.stdout: { 2023-08-01T19:56:12.497 INFO:teuthology.orchestra.run.smithi008.stdout: "event": "commit_sent", 2023-08-01T19:56:12.497 INFO:teuthology.orchestra.run.smithi008.stdout: "time": "2023-08-01T19:55:59.628479+0000", 2023-08-01T19:56:12.498 INFO:teuthology.orchestra.run.smithi008.stdout: "duration": 4.1350000000000002e-05 2023-08-01T19:56:12.498 INFO:teuthology.orchestra.run.smithi008.stdout: }, 2023-08-01T19:56:12.498 INFO:teuthology.orchestra.run.smithi008.stdout: { 2023-08-01T19:56:12.498 INFO:teuthology.orchestra.run.smithi008.stdout: "event": "done", 2023-08-01T19:56:12.498 INFO:teuthology.orchestra.run.smithi008.stdout: "time": "2023-08-01T19:55:59.628560+0000", 2023-08-01T19:56:12.498 INFO:teuthology.orchestra.run.smithi008.stdout: "duration": 8.0080999999999994e-05 2023-08-01T19:56:12.498 INFO:teuthology.orchestra.run.smithi008.stdout: } 2023-08-01T19:56:12.498 INFO:teuthology.orchestra.run.smithi008.stdout: ] 2023-08-01T19:56:12.499 INFO:teuthology.orchestra.run.smithi008.stdout: } 2023-08-01T19:56:12.499 INFO:teuthology.orchestra.run.smithi008.stdout: }, 2023-08-01T19:56:12.499 INFO:teuthology.orchestra.run.smithi008.stdout: { 2023-08-01T19:56:12.499 INFO:teuthology.orchestra.run.smithi008.stdout: "description": "osd_op(client.4668.0:197415 5.c 5:3e539c01:::benchmark_data_smithi006_114134_object63754:head [delete] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e62)", 2023-08-01T19:56:12.499 INFO:teuthology.orchestra.run.smithi008.stdout: "initiated_at": "2023-08-01T19:55:58.577434+0000", 2023-08-01T19:56:12.499 INFO:teuthology.orchestra.run.smithi008.stdout: "age": 13.740426412, 2023-08-01T19:56:12.499 INFO:teuthology.orchestra.run.smithi008.stdout: "duration": 1.0520807059999999, 2023-08-01T19:56:12.499 INFO:teuthology.orchestra.run.smithi008.stdout: "type_data": { 2023-08-01T19:56:12.500 INFO:teuthology.orchestra.run.smithi008.stdout: "flag_point": "commit sent; apply or cleanup", 2023-08-01T19:56:12.500 INFO:teuthology.orchestra.run.smithi008.stdout: "client_info": { 2023-08-01T19:56:12.500 INFO:teuthology.orchestra.run.smithi008.stdout: "client": "client.4668", 2023-08-01T19:56:12.500 INFO:teuthology.orchestra.run.smithi008.stdout: "client_addr": "172.21.15.6:0/1709472247", 2023-08-01T19:56:12.500 INFO:teuthology.orchestra.run.smithi008.stdout: "tid": 197415 2023-08-01T19:56:12.500 INFO:teuthology.orchestra.run.smithi008.stdout: }, 2023-08-01T19:56:12.500 INFO:teuthology.orchestra.run.smithi008.stdout: "events": [ 2023-08-01T19:56:12.500 INFO:teuthology.orchestra.run.smithi008.stdout: { 2023-08-01T19:56:12.501 INFO:teuthology.orchestra.run.smithi008.stdout: "event": "initiated", 2023-08-01T19:56:12.501 INFO:teuthology.orchestra.run.smithi008.stdout: "time": "2023-08-01T19:55:58.577434+0000", 2023-08-01T19:56:12.501 INFO:teuthology.orchestra.run.smithi008.stdout: "duration": 0 2023-08-01T19:56:12.501 INFO:teuthology.orchestra.run.smithi008.stdout: }, 2023-08-01T19:56:12.501 INFO:teuthology.orchestra.run.smithi008.stdout: { 2023-08-01T19:56:12.501 INFO:teuthology.orchestra.run.smithi008.stdout: "event": "throttled", 2023-08-01T19:56:12.501 INFO:teuthology.orchestra.run.smithi008.stdout: "time": "2023-08-01T19:55:58.577434+0000", 2023-08-01T19:56:12.502 INFO:teuthology.orchestra.run.smithi008.stdout: "duration": 0 2023-08-01T19:56:12.502 INFO:teuthology.orchestra.run.smithi008.stdout: }, 2023-08-01T19:56:12.502 INFO:teuthology.orchestra.run.smithi008.stdout: { 2023-08-01T19:56:12.502 INFO:teuthology.orchestra.run.smithi008.stdout: "event": "header_read", 2023-08-01T19:56:12.502 INFO:teuthology.orchestra.run.smithi008.stdout: "time": "2023-08-01T19:55:58.577432+0000", 2023-08-01T19:56:12.502 INFO:teuthology.orchestra.run.smithi008.stdout: "duration": 4294967295.9999986 2023-08-01T19:56:12.502 INFO:teuthology.orchestra.run.smithi008.stdout: }, 2023-08-01T19:56:12.502 INFO:teuthology.orchestra.run.smithi008.stdout: { 2023-08-01T19:56:12.503 INFO:teuthology.orchestra.run.smithi008.stdout: "event": "all_read", 2023-08-01T19:56:12.503 INFO:teuthology.orchestra.run.smithi008.stdout: "time": "2023-08-01T19:55:58.577440+0000", 2023-08-01T19:56:12.503 INFO:teuthology.orchestra.run.smithi008.stdout: "duration": 7.5480000000000004e-06 2023-08-01T19:56:12.503 INFO:teuthology.orchestra.run.smithi008.stdout: }, 2023-08-01T19:56:12.503 INFO:teuthology.orchestra.run.smithi008.stdout: { 2023-08-01T19:56:12.503 INFO:teuthology.orchestra.run.smithi008.stdout: "event": "dispatched", 2023-08-01T19:56:12.503 INFO:teuthology.orchestra.run.smithi008.stdout: "time": "2023-08-01T19:55:58.577454+0000", 2023-08-01T19:56:12.504 INFO:teuthology.orchestra.run.smithi008.stdout: "duration": 1.4216000000000001e-05 2023-08-01T19:56:12.504 INFO:teuthology.orchestra.run.smithi008.stdout: }, 2023-08-01T19:56:12.504 INFO:teuthology.orchestra.run.smithi008.stdout: { 2023-08-01T19:56:12.504 INFO:teuthology.orchestra.run.smithi008.stdout: "event": "queued_for_pg", 2023-08-01T19:56:12.504 INFO:teuthology.orchestra.run.smithi008.stdout: "time": "2023-08-01T19:55:58.577463+0000", 2023-08-01T19:56:12.504 INFO:teuthology.orchestra.run.smithi008.stdout: "duration": 8.2900000000000002e-06 2023-08-01T19:56:12.504 INFO:teuthology.orchestra.run.smithi008.stdout: }, 2023-08-01T19:56:12.505 INFO:teuthology.orchestra.run.smithi008.stdout: { 2023-08-01T19:56:12.505 INFO:teuthology.orchestra.run.smithi008.stdout: "event": "reached_pg", 2023-08-01T19:56:12.505 INFO:teuthology.orchestra.run.smithi008.stdout: "time": "2023-08-01T19:55:58.577498+0000", 2023-08-01T19:56:12.505 INFO:teuthology.orchestra.run.smithi008.stdout: "duration": 3.5302000000000002e-05 2023-08-01T19:56:12.505 INFO:teuthology.orchestra.run.smithi008.stdout: }, 2023-08-01T19:56:12.505 INFO:teuthology.orchestra.run.smithi008.stdout: { 2023-08-01T19:56:12.505 INFO:teuthology.orchestra.run.smithi008.stdout: "event": "waiting for peered", 2023-08-01T19:56:12.505 INFO:teuthology.orchestra.run.smithi008.stdout: "time": "2023-08-01T19:55:58.577503+0000", 2023-08-01T19:56:12.506 INFO:teuthology.orchestra.run.smithi008.stdout: "duration": 4.8409999999999999e-06 2023-08-01T19:56:12.506 INFO:teuthology.orchestra.run.smithi008.stdout: }, 2023-08-01T19:56:12.506 INFO:teuthology.orchestra.run.smithi008.stdout: { 2023-08-01T19:56:12.506 INFO:teuthology.orchestra.run.smithi008.stdout: "event": "reached_pg", 2023-08-01T19:56:12.506 INFO:teuthology.orchestra.run.smithi008.stdout: "time": "2023-08-01T19:55:59.619229+0000", 2023-08-01T19:56:12.506 INFO:teuthology.orchestra.run.smithi008.stdout: "duration": 1.041726119 2023-08-01T19:56:12.506 INFO:teuthology.orchestra.run.smithi008.stdout: }, 2023-08-01T19:56:12.506 INFO:teuthology.orchestra.run.smithi008.stdout: { 2023-08-01T19:56:12.507 INFO:teuthology.orchestra.run.smithi008.stdout: "event": "started", 2023-08-01T19:56:12.507 INFO:teuthology.orchestra.run.smithi008.stdout: "time": "2023-08-01T19:55:59.619326+0000", 2023-08-01T19:56:12.507 INFO:teuthology.orchestra.run.smithi008.stdout: "duration": 9.7044000000000001e-05 2023-08-01T19:56:12.507 INFO:teuthology.orchestra.run.smithi008.stdout: }, 2023-08-01T19:56:12.507 INFO:teuthology.orchestra.run.smithi008.stdout: { 2023-08-01T19:56:12.507 INFO:teuthology.orchestra.run.smithi008.stdout: "event": "op_commit", 2023-08-01T19:56:12.507 INFO:teuthology.orchestra.run.smithi008.stdout: "time": "2023-08-01T19:55:59.629399+0000", 2023-08-01T19:56:12.508 INFO:teuthology.orchestra.run.smithi008.stdout: "duration": 0.010073014 2023-08-01T19:56:12.508 INFO:teuthology.orchestra.run.smithi008.stdout: }, 2023-08-01T19:56:12.508 INFO:teuthology.orchestra.run.smithi008.stdout: { 2023-08-01T19:56:12.508 INFO:teuthology.orchestra.run.smithi008.stdout: "event": "commit_sent", 2023-08-01T19:56:12.508 INFO:teuthology.orchestra.run.smithi008.stdout: "time": "2023-08-01T19:55:59.629443+0000", 2023-08-01T19:56:12.508 INFO:teuthology.orchestra.run.smithi008.stdout: "duration": 4.3739999999999998e-05 2023-08-01T19:56:12.508 INFO:teuthology.orchestra.run.smithi008.stdout: }, 2023-08-01T19:56:12.508 INFO:teuthology.orchestra.run.smithi008.stdout: { 2023-08-01T19:56:12.509 INFO:teuthology.orchestra.run.smithi008.stdout: "event": "done", 2023-08-01T19:56:12.509 INFO:teuthology.orchestra.run.smithi008.stdout: "time": "2023-08-01T19:55:59.629515+0000", 2023-08-01T19:56:12.509 INFO:teuthology.orchestra.run.smithi008.stdout: "duration": 7.2089999999999996e-05 2023-08-01T19:56:12.509 INFO:teuthology.orchestra.run.smithi008.stdout: } 2023-08-01T19:56:12.509 INFO:teuthology.orchestra.run.smithi008.stdout: ] 2023-08-01T19:56:12.509 INFO:teuthology.orchestra.run.smithi008.stdout: } 2023-08-01T19:56:12.509 INFO:teuthology.orchestra.run.smithi008.stdout: }, 2023-08-01T19:56:12.509 INFO:teuthology.orchestra.run.smithi008.stdout: { 2023-08-01T19:56:12.510 INFO:teuthology.orchestra.run.smithi008.stdout: "description": "osd_op(client.4668.0:197417 5.7 5:eb36cb7d:::benchmark_data_smithi006_114134_object63756:head [delete] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e62)", 2023-08-01T19:56:12.510 INFO:teuthology.orchestra.run.smithi008.stdout: "initiated_at": "2023-08-01T19:55:58.578162+0000", 2023-08-01T19:56:12.510 INFO:teuthology.orchestra.run.smithi008.stdout: "age": 13.739698114999999, 2023-08-01T19:56:12.510 INFO:teuthology.orchestra.run.smithi008.stdout: "duration": 1.0582469299999999, 2023-08-01T19:56:12.510 INFO:teuthology.orchestra.run.smithi008.stdout: "type_data": { 2023-08-01T19:56:12.510 INFO:teuthology.orchestra.run.smithi008.stdout: "flag_point": "commit sent; apply or cleanup", 2023-08-01T19:56:12.510 INFO:teuthology.orchestra.run.smithi008.stdout: "client_info": { 2023-08-01T19:56:12.511 INFO:teuthology.orchestra.run.smithi008.stdout: "client": "client.4668", 2023-08-01T19:56:12.511 INFO:teuthology.orchestra.run.smithi008.stdout: "client_addr": "172.21.15.6:0/1709472247", 2023-08-01T19:56:12.511 INFO:teuthology.orchestra.run.smithi008.stdout: "tid": 197417 2023-08-01T19:56:12.511 INFO:teuthology.orchestra.run.smithi008.stdout: }, 2023-08-01T19:56:12.511 INFO:teuthology.orchestra.run.smithi008.stdout: "events": [ 2023-08-01T19:56:12.511 INFO:teuthology.orchestra.run.smithi008.stdout: { 2023-08-01T19:56:12.511 INFO:teuthology.orchestra.run.smithi008.stdout: "event": "initiated", 2023-08-01T19:56:12.511 INFO:teuthology.orchestra.run.smithi008.stdout: "time": "2023-08-01T19:55:58.578162+0000", 2023-08-01T19:56:12.512 INFO:teuthology.orchestra.run.smithi008.stdout: "duration": 0 2023-08-01T19:56:12.512 INFO:teuthology.orchestra.run.smithi008.stdout: }, 2023-08-01T19:56:12.512 INFO:teuthology.orchestra.run.smithi008.stdout: { 2023-08-01T19:56:12.512 INFO:teuthology.orchestra.run.smithi008.stdout: "event": "throttled", 2023-08-01T19:56:12.512 INFO:teuthology.orchestra.run.smithi008.stdout: "time": "2023-08-01T19:55:58.578162+0000", 2023-08-01T19:56:12.512 INFO:teuthology.orchestra.run.smithi008.stdout: "duration": 0 2023-08-01T19:56:12.512 INFO:teuthology.orchestra.run.smithi008.stdout: }, 2023-08-01T19:56:12.512 INFO:teuthology.orchestra.run.smithi008.stdout: { 2023-08-01T19:56:12.513 INFO:teuthology.orchestra.run.smithi008.stdout: "event": "header_read", 2023-08-01T19:56:12.513 INFO:teuthology.orchestra.run.smithi008.stdout: "time": "2023-08-01T19:55:58.578161+0000", 2023-08-01T19:56:12.513 INFO:teuthology.orchestra.run.smithi008.stdout: "duration": 4294967295.999999 2023-08-01T19:56:12.513 INFO:teuthology.orchestra.run.smithi008.stdout: }, 2023-08-01T19:56:12.513 INFO:teuthology.orchestra.run.smithi008.stdout: { 2023-08-01T19:56:12.513 INFO:teuthology.orchestra.run.smithi008.stdout: "event": "all_read", 2023-08-01T19:56:12.513 INFO:teuthology.orchestra.run.smithi008.stdout: "time": "2023-08-01T19:55:58.578166+0000", 2023-08-01T19:56:12.514 INFO:teuthology.orchestra.run.smithi008.stdout: "duration": 4.6589999999999998e-06 2023-08-01T19:56:12.514 INFO:teuthology.orchestra.run.smithi008.stdout: }, 2023-08-01T19:56:12.514 INFO:teuthology.orchestra.run.smithi008.stdout: { 2023-08-01T19:56:12.514 INFO:teuthology.orchestra.run.smithi008.stdout: "event": "dispatched", 2023-08-01T19:56:12.514 INFO:teuthology.orchestra.run.smithi008.stdout: "time": "2023-08-01T19:55:58.578177+0000", 2023-08-01T19:56:12.514 INFO:teuthology.orchestra.run.smithi008.stdout: "duration": 1.0512e-05 2023-08-01T19:56:12.514 INFO:teuthology.orchestra.run.smithi008.stdout: }, 2023-08-01T19:56:12.514 INFO:teuthology.orchestra.run.smithi008.stdout: { 2023-08-01T19:56:12.515 INFO:teuthology.orchestra.run.smithi008.stdout: "event": "queued_for_pg", 2023-08-01T19:56:12.515 INFO:teuthology.orchestra.run.smithi008.stdout: "time": "2023-08-01T19:55:58.578182+0000", 2023-08-01T19:56:12.515 INFO:teuthology.orchestra.run.smithi008.stdout: "duration": 5.6540000000000004e-06 2023-08-01T19:56:12.515 INFO:teuthology.orchestra.run.smithi008.stdout: }, 2023-08-01T19:56:12.515 INFO:teuthology.orchestra.run.smithi008.stdout: { 2023-08-01T19:56:12.515 INFO:teuthology.orchestra.run.smithi008.stdout: "event": "reached_pg", 2023-08-01T19:56:12.515 INFO:teuthology.orchestra.run.smithi008.stdout: "time": "2023-08-01T19:55:58.578221+0000", 2023-08-01T19:56:12.516 INFO:teuthology.orchestra.run.smithi008.stdout: "duration": 3.8764999999999999e-05 2023-08-01T19:56:12.516 INFO:teuthology.orchestra.run.smithi008.stdout: }, 2023-08-01T19:56:12.516 INFO:teuthology.orchestra.run.smithi008.stdout: { 2023-08-01T19:56:12.516 INFO:teuthology.orchestra.run.smithi008.stdout: "event": "waiting for peered", 2023-08-01T19:56:12.516 INFO:teuthology.orchestra.run.smithi008.stdout: "time": "2023-08-01T19:55:58.578226+0000", 2023-08-01T19:56:12.516 INFO:teuthology.orchestra.run.smithi008.stdout: "duration": 4.6319999999999999e-06 2023-08-01T19:56:12.516 INFO:teuthology.orchestra.run.smithi008.stdout: }, 2023-08-01T19:56:12.517 INFO:teuthology.orchestra.run.smithi008.stdout: { 2023-08-01T19:56:12.517 INFO:teuthology.orchestra.run.smithi008.stdout: "event": "reached_pg", 2023-08-01T19:56:12.517 INFO:teuthology.orchestra.run.smithi008.stdout: "time": "2023-08-01T19:55:59.628027+0000", 2023-08-01T19:56:12.517 INFO:teuthology.orchestra.run.smithi008.stdout: "duration": 1.049801261 2023-08-01T19:56:12.517 INFO:teuthology.orchestra.run.smithi008.stdout: }, 2023-08-01T19:56:12.517 INFO:teuthology.orchestra.run.smithi008.stdout: { 2023-08-01T19:56:12.517 INFO:teuthology.orchestra.run.smithi008.stdout: "event": "started", 2023-08-01T19:56:12.518 INFO:teuthology.orchestra.run.smithi008.stdout: "time": "2023-08-01T19:55:59.628156+0000", 2023-08-01T19:56:12.518 INFO:teuthology.orchestra.run.smithi008.stdout: "duration": 0.00012906899999999999 2023-08-01T19:56:12.518 INFO:teuthology.orchestra.run.smithi008.stdout: }, 2023-08-01T19:56:12.518 INFO:teuthology.orchestra.run.smithi008.stdout: { 2023-08-01T19:56:12.518 INFO:teuthology.orchestra.run.smithi008.stdout: "event": "op_commit", 2023-08-01T19:56:12.518 INFO:teuthology.orchestra.run.smithi008.stdout: "time": "2023-08-01T19:55:59.636292+0000", 2023-08-01T19:56:12.518 INFO:teuthology.orchestra.run.smithi008.stdout: "duration": 0.0081362859999999995 2023-08-01T19:56:12.518 INFO:teuthology.orchestra.run.smithi008.stdout: }, 2023-08-01T19:56:12.519 INFO:teuthology.orchestra.run.smithi008.stdout: { 2023-08-01T19:56:12.519 INFO:teuthology.orchestra.run.smithi008.stdout: "event": "commit_sent", 2023-08-01T19:56:12.519 INFO:teuthology.orchestra.run.smithi008.stdout: "time": "2023-08-01T19:55:59.636343+0000", 2023-08-01T19:56:12.519 INFO:teuthology.orchestra.run.smithi008.stdout: "duration": 5.0603000000000003e-05 2023-08-01T19:56:12.519 INFO:teuthology.orchestra.run.smithi008.stdout: }, 2023-08-01T19:56:12.519 INFO:teuthology.orchestra.run.smithi008.stdout: { 2023-08-01T19:56:12.519 INFO:teuthology.orchestra.run.smithi008.stdout: "event": "done", 2023-08-01T19:56:12.520 INFO:teuthology.orchestra.run.smithi008.stdout: "time": "2023-08-01T19:55:59.636409+0000", 2023-08-01T19:56:12.520 INFO:teuthology.orchestra.run.smithi008.stdout: "duration": 6.6353999999999995e-05 2023-08-01T19:56:12.520 INFO:teuthology.orchestra.run.smithi008.stdout: } 2023-08-01T19:56:12.520 INFO:teuthology.orchestra.run.smithi008.stdout: ] 2023-08-01T19:56:12.520 INFO:teuthology.orchestra.run.smithi008.stdout: } 2023-08-01T19:56:12.520 INFO:teuthology.orchestra.run.smithi008.stdout: }, 2023-08-01T19:56:12.520 INFO:teuthology.orchestra.run.smithi008.stdout: { 2023-08-01T19:56:12.520 INFO:teuthology.orchestra.run.smithi008.stdout: "description": "osd_op(client.4668.0:197418 5.2 5:4ba84ab7:::benchmark_data_smithi006_114134_object63757:head [delete] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e62)", 2023-08-01T19:56:12.521 INFO:teuthology.orchestra.run.smithi008.stdout: "initiated_at": "2023-08-01T19:55:58.580297+0000", 2023-08-01T19:56:12.521 INFO:teuthology.orchestra.run.smithi008.stdout: "age": 13.737563762000001, 2023-08-01T19:56:12.521 INFO:teuthology.orchestra.run.smithi008.stdout: "duration": 1.0529485839999999, 2023-08-01T19:56:12.521 INFO:teuthology.orchestra.run.smithi008.stdout: "type_data": { 2023-08-01T19:56:12.521 INFO:teuthology.orchestra.run.smithi008.stdout: "flag_point": "commit sent; apply or cleanup", 2023-08-01T19:56:12.521 INFO:teuthology.orchestra.run.smithi008.stdout: "client_info": { 2023-08-01T19:56:12.521 INFO:teuthology.orchestra.run.smithi008.stdout: "client": "client.4668", 2023-08-01T19:56:12.521 INFO:teuthology.orchestra.run.smithi008.stdout: "client_addr": "172.21.15.6:0/1709472247", 2023-08-01T19:56:12.522 INFO:teuthology.orchestra.run.smithi008.stdout: "tid": 197418 2023-08-01T19:56:12.522 INFO:teuthology.orchestra.run.smithi008.stdout: }, 2023-08-01T19:56:12.522 INFO:teuthology.orchestra.run.smithi008.stdout: "events": [ 2023-08-01T19:56:12.522 INFO:teuthology.orchestra.run.smithi008.stdout: { 2023-08-01T19:56:12.522 INFO:teuthology.orchestra.run.smithi008.stdout: "event": "initiated", 2023-08-01T19:56:12.522 INFO:teuthology.orchestra.run.smithi008.stdout: "time": "2023-08-01T19:55:58.580297+0000", 2023-08-01T19:56:12.522 INFO:teuthology.orchestra.run.smithi008.stdout: "duration": 0 2023-08-01T19:56:12.522 INFO:teuthology.orchestra.run.smithi008.stdout: }, 2023-08-01T19:56:12.523 INFO:teuthology.orchestra.run.smithi008.stdout: { 2023-08-01T19:56:12.523 INFO:teuthology.orchestra.run.smithi008.stdout: "event": "throttled", 2023-08-01T19:56:12.523 INFO:teuthology.orchestra.run.smithi008.stdout: "time": "2023-08-01T19:55:58.580297+0000", 2023-08-01T19:56:12.523 INFO:teuthology.orchestra.run.smithi008.stdout: "duration": 0 2023-08-01T19:56:12.523 INFO:teuthology.orchestra.run.smithi008.stdout: }, 2023-08-01T19:56:12.523 INFO:teuthology.orchestra.run.smithi008.stdout: { 2023-08-01T19:56:12.523 INFO:teuthology.orchestra.run.smithi008.stdout: "event": "header_read", 2023-08-01T19:56:12.523 INFO:teuthology.orchestra.run.smithi008.stdout: "time": "2023-08-01T19:55:58.580296+0000", 2023-08-01T19:56:12.524 INFO:teuthology.orchestra.run.smithi008.stdout: "duration": 4294967295.999999 2023-08-01T19:56:12.524 INFO:teuthology.orchestra.run.smithi008.stdout: }, 2023-08-01T19:56:12.524 INFO:teuthology.orchestra.run.smithi008.stdout: { 2023-08-01T19:56:12.524 INFO:teuthology.orchestra.run.smithi008.stdout: "event": "all_read", 2023-08-01T19:56:12.524 INFO:teuthology.orchestra.run.smithi008.stdout: "time": "2023-08-01T19:55:58.580302+0000", 2023-08-01T19:56:12.524 INFO:teuthology.orchestra.run.smithi008.stdout: "duration": 6.032e-06 2023-08-01T19:56:12.524 INFO:teuthology.orchestra.run.smithi008.stdout: }, 2023-08-01T19:56:12.525 INFO:teuthology.orchestra.run.smithi008.stdout: { 2023-08-01T19:56:12.525 INFO:teuthology.orchestra.run.smithi008.stdout: "event": "dispatched", 2023-08-01T19:56:12.525 INFO:teuthology.orchestra.run.smithi008.stdout: "time": "2023-08-01T19:55:58.580315+0000", 2023-08-01T19:56:12.525 INFO:teuthology.orchestra.run.smithi008.stdout: "duration": 1.327e-05 2023-08-01T19:56:12.525 INFO:teuthology.orchestra.run.smithi008.stdout: }, 2023-08-01T19:56:12.525 INFO:teuthology.orchestra.run.smithi008.stdout: { 2023-08-01T19:56:12.525 INFO:teuthology.orchestra.run.smithi008.stdout: "event": "queued_for_pg", 2023-08-01T19:56:12.525 INFO:teuthology.orchestra.run.smithi008.stdout: "time": "2023-08-01T19:55:58.580321+0000", 2023-08-01T19:56:12.526 INFO:teuthology.orchestra.run.smithi008.stdout: "duration": 6.3980000000000004e-06 2023-08-01T19:56:12.526 INFO:teuthology.orchestra.run.smithi008.stdout: }, 2023-08-01T19:56:12.526 INFO:teuthology.orchestra.run.smithi008.stdout: { 2023-08-01T19:56:12.526 INFO:teuthology.orchestra.run.smithi008.stdout: "event": "reached_pg", 2023-08-01T19:56:12.526 INFO:teuthology.orchestra.run.smithi008.stdout: "time": "2023-08-01T19:55:58.580372+0000", 2023-08-01T19:56:12.526 INFO:teuthology.orchestra.run.smithi008.stdout: "duration": 5.0219000000000001e-05 2023-08-01T19:56:12.526 INFO:teuthology.orchestra.run.smithi008.stdout: }, 2023-08-01T19:56:12.526 INFO:teuthology.orchestra.run.smithi008.stdout: { 2023-08-01T19:56:12.527 INFO:teuthology.orchestra.run.smithi008.stdout: "event": "waiting for peered", 2023-08-01T19:56:12.527 INFO:teuthology.orchestra.run.smithi008.stdout: "time": "2023-08-01T19:55:58.580378+0000", 2023-08-01T19:56:12.527 INFO:teuthology.orchestra.run.smithi008.stdout: "duration": 6.6529999999999997e-06 2023-08-01T19:56:12.527 INFO:teuthology.orchestra.run.smithi008.stdout: }, 2023-08-01T19:56:12.527 INFO:teuthology.orchestra.run.smithi008.stdout: { 2023-08-01T19:56:12.527 INFO:teuthology.orchestra.run.smithi008.stdout: "event": "reached_pg", 2023-08-01T19:56:12.527 INFO:teuthology.orchestra.run.smithi008.stdout: "time": "2023-08-01T19:55:59.618188+0000", 2023-08-01T19:56:12.527 INFO:teuthology.orchestra.run.smithi008.stdout: "duration": 1.037810267 2023-08-01T19:56:12.528 INFO:teuthology.orchestra.run.smithi008.stdout: }, 2023-08-01T19:56:12.528 INFO:teuthology.orchestra.run.smithi008.stdout: { 2023-08-01T19:56:12.528 INFO:teuthology.orchestra.run.smithi008.stdout: "event": "started", 2023-08-01T19:56:12.528 INFO:teuthology.orchestra.run.smithi008.stdout: "time": "2023-08-01T19:55:59.618308+0000", 2023-08-01T19:56:12.528 INFO:teuthology.orchestra.run.smithi008.stdout: "duration": 0.00011959 2023-08-01T19:56:12.528 INFO:teuthology.orchestra.run.smithi008.stdout: }, 2023-08-01T19:56:12.528 INFO:teuthology.orchestra.run.smithi008.stdout: { 2023-08-01T19:56:12.529 INFO:teuthology.orchestra.run.smithi008.stdout: "event": "op_commit", 2023-08-01T19:56:12.529 INFO:teuthology.orchestra.run.smithi008.stdout: "time": "2023-08-01T19:55:59.633122+0000", 2023-08-01T19:56:12.529 INFO:teuthology.orchestra.run.smithi008.stdout: "duration": 0.014814280000000001 2023-08-01T19:56:12.529 INFO:teuthology.orchestra.run.smithi008.stdout: }, 2023-08-01T19:56:12.529 INFO:teuthology.orchestra.run.smithi008.stdout: { 2023-08-01T19:56:12.529 INFO:teuthology.orchestra.run.smithi008.stdout: "event": "commit_sent", 2023-08-01T19:56:12.529 INFO:teuthology.orchestra.run.smithi008.stdout: "time": "2023-08-01T19:55:59.633167+0000", 2023-08-01T19:56:12.529 INFO:teuthology.orchestra.run.smithi008.stdout: "duration": 4.4651999999999999e-05 2023-08-01T19:56:12.530 INFO:teuthology.orchestra.run.smithi008.stdout: }, 2023-08-01T19:56:12.530 INFO:teuthology.orchestra.run.smithi008.stdout: { 2023-08-01T19:56:12.530 INFO:teuthology.orchestra.run.smithi008.stdout: "event": "done", 2023-08-01T19:56:12.530 INFO:teuthology.orchestra.run.smithi008.stdout: "time": "2023-08-01T19:55:59.633245+0000", 2023-08-01T19:56:12.530 INFO:teuthology.orchestra.run.smithi008.stdout: "duration": 7.8215999999999998e-05 2023-08-01T19:56:12.530 INFO:teuthology.orchestra.run.smithi008.stdout: } 2023-08-01T19:56:12.530 INFO:teuthology.orchestra.run.smithi008.stdout: ] 2023-08-01T19:56:12.531 INFO:teuthology.orchestra.run.smithi008.stdout: } 2023-08-01T19:56:12.531 INFO:teuthology.orchestra.run.smithi008.stdout: } 2023-08-01T19:56:12.531 INFO:teuthology.orchestra.run.smithi008.stdout: ] 2023-08-01T19:56:12.531 INFO:teuthology.orchestra.run.smithi008.stdout:} 2023-08-01T19:56:12.532 DEBUG:teuthology.orchestra.run.smithi155:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 30 ceph --cluster ceph --admin-daemon /var/run/ceph/ceph-osd.2.asok dump_ops_in_flight 2023-08-01T19:56:12.533 INFO:tasks.ceph.osd.2.smithi155.stderr:2023-08-01T19:56:12.531+0000 7faa5c6ac700 -1 received signal: Hangup from /usr/bin/python3 /bin/daemon-helper kill ceph-osd -f --cluster ceph -i 2 (PID: 111337) UID: 0 2023-08-01T19:56:12.633 INFO:tasks.ceph.osd.0.smithi008.stderr:2023-08-01T19:56:12.631+0000 7f16a58f4700 -1 received signal: Hangup from /usr/bin/python3 /bin/daemon-helper kill ceph-osd -f --cluster ceph -i 0 (PID: 111179) UID: 0 2023-08-01T19:56:12.704 INFO:teuthology.orchestra.run.smithi155.stdout:{ 2023-08-01T19:56:12.704 INFO:teuthology.orchestra.run.smithi155.stdout: "ops": [ 2023-08-01T19:56:12.704 INFO:teuthology.orchestra.run.smithi155.stdout: { 2023-08-01T19:56:12.704 INFO:teuthology.orchestra.run.smithi155.stdout: "description": "osd_op(client.4668.0:224460 5.b 5:da745f44:::benchmark_data_smithi006_114134_object90799:head [delete] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e68)", 2023-08-01T19:56:12.705 INFO:teuthology.orchestra.run.smithi155.stdout: "initiated_at": "2023-08-01T19:56:12.700266+0000", 2023-08-01T19:56:12.705 INFO:teuthology.orchestra.run.smithi155.stdout: "age": 0.001636867, 2023-08-01T19:56:12.705 INFO:teuthology.orchestra.run.smithi155.stdout: "duration": 0.0016616510000000001, 2023-08-01T19:56:12.705 INFO:teuthology.orchestra.run.smithi155.stdout: "type_data": { 2023-08-01T19:56:12.705 INFO:teuthology.orchestra.run.smithi155.stdout: "flag_point": "waiting for sub ops", 2023-08-01T19:56:12.705 INFO:teuthology.orchestra.run.smithi155.stdout: "client_info": { 2023-08-01T19:56:12.705 INFO:teuthology.orchestra.run.smithi155.stdout: "client": "client.4668", 2023-08-01T19:56:12.706 INFO:teuthology.orchestra.run.smithi155.stdout: "client_addr": "172.21.15.6:0/1709472247", 2023-08-01T19:56:12.706 INFO:teuthology.orchestra.run.smithi155.stdout: "tid": 224460 2023-08-01T19:56:12.706 INFO:teuthology.orchestra.run.smithi155.stdout: }, 2023-08-01T19:56:12.706 INFO:teuthology.orchestra.run.smithi155.stdout: "events": [ 2023-08-01T19:56:12.706 INFO:teuthology.orchestra.run.smithi155.stdout: { 2023-08-01T19:56:12.706 INFO:teuthology.orchestra.run.smithi155.stdout: "event": "initiated", 2023-08-01T19:56:12.706 INFO:teuthology.orchestra.run.smithi155.stdout: "time": "2023-08-01T19:56:12.700266+0000", 2023-08-01T19:56:12.707 INFO:teuthology.orchestra.run.smithi155.stdout: "duration": 0 2023-08-01T19:56:12.707 INFO:teuthology.orchestra.run.smithi155.stdout: }, 2023-08-01T19:56:12.707 INFO:teuthology.orchestra.run.smithi155.stdout: { 2023-08-01T19:56:12.707 INFO:teuthology.orchestra.run.smithi155.stdout: "event": "throttled", 2023-08-01T19:56:12.707 INFO:teuthology.orchestra.run.smithi155.stdout: "time": "2023-08-01T19:56:12.700266+0000", 2023-08-01T19:56:12.707 INFO:teuthology.orchestra.run.smithi155.stdout: "duration": 0 2023-08-01T19:56:12.707 INFO:teuthology.orchestra.run.smithi155.stdout: }, 2023-08-01T19:56:12.707 INFO:teuthology.orchestra.run.smithi155.stdout: { 2023-08-01T19:56:12.708 INFO:teuthology.orchestra.run.smithi155.stdout: "event": "header_read", 2023-08-01T19:56:12.708 INFO:teuthology.orchestra.run.smithi155.stdout: "time": "2023-08-01T19:56:12.700266+0000", 2023-08-01T19:56:12.708 INFO:teuthology.orchestra.run.smithi155.stdout: "duration": 4294967295.9999995 2023-08-01T19:56:12.708 INFO:teuthology.orchestra.run.smithi155.stdout: }, 2023-08-01T19:56:12.708 INFO:teuthology.orchestra.run.smithi155.stdout: { 2023-08-01T19:56:12.709 INFO:teuthology.orchestra.run.smithi155.stdout: "event": "all_read", 2023-08-01T19:56:12.709 INFO:teuthology.orchestra.run.smithi155.stdout: "time": "2023-08-01T19:56:12.700269+0000", 2023-08-01T19:56:12.709 INFO:teuthology.orchestra.run.smithi155.stdout: "duration": 3.9049999999999999e-06 2023-08-01T19:56:12.709 INFO:teuthology.orchestra.run.smithi155.stdout: }, 2023-08-01T19:56:12.709 INFO:teuthology.orchestra.run.smithi155.stdout: { 2023-08-01T19:56:12.709 INFO:teuthology.orchestra.run.smithi155.stdout: "event": "dispatched", 2023-08-01T19:56:12.709 INFO:teuthology.orchestra.run.smithi155.stdout: "time": "2023-08-01T19:56:12.700276+0000", 2023-08-01T19:56:12.709 INFO:teuthology.orchestra.run.smithi155.stdout: "duration": 6.365e-06 2023-08-01T19:56:12.710 INFO:teuthology.orchestra.run.smithi155.stdout: }, 2023-08-01T19:56:12.710 INFO:teuthology.orchestra.run.smithi155.stdout: { 2023-08-01T19:56:12.710 INFO:teuthology.orchestra.run.smithi155.stdout: "event": "queued_for_pg", 2023-08-01T19:56:12.710 INFO:teuthology.orchestra.run.smithi155.stdout: "time": "2023-08-01T19:56:12.700279+0000", 2023-08-01T19:56:12.710 INFO:teuthology.orchestra.run.smithi155.stdout: "duration": 3.2490000000000001e-06 2023-08-01T19:56:12.710 INFO:teuthology.orchestra.run.smithi155.stdout: }, 2023-08-01T19:56:12.710 INFO:teuthology.orchestra.run.smithi155.stdout: { 2023-08-01T19:56:12.710 INFO:teuthology.orchestra.run.smithi155.stdout: "event": "reached_pg", 2023-08-01T19:56:12.711 INFO:teuthology.orchestra.run.smithi155.stdout: "time": "2023-08-01T19:56:12.700309+0000", 2023-08-01T19:56:12.711 INFO:teuthology.orchestra.run.smithi155.stdout: "duration": 3.0188e-05 2023-08-01T19:56:12.711 INFO:teuthology.orchestra.run.smithi155.stdout: }, 2023-08-01T19:56:12.711 INFO:teuthology.orchestra.run.smithi155.stdout: { 2023-08-01T19:56:12.711 INFO:teuthology.orchestra.run.smithi155.stdout: "event": "started", 2023-08-01T19:56:12.711 INFO:teuthology.orchestra.run.smithi155.stdout: "time": "2023-08-01T19:56:12.700381+0000", 2023-08-01T19:56:12.711 INFO:teuthology.orchestra.run.smithi155.stdout: "duration": 7.1571999999999998e-05 2023-08-01T19:56:12.712 INFO:teuthology.orchestra.run.smithi155.stdout: }, 2023-08-01T19:56:12.712 INFO:teuthology.orchestra.run.smithi155.stdout: { 2023-08-01T19:56:12.712 INFO:teuthology.orchestra.run.smithi155.stdout: "event": "waiting for subops from 0", 2023-08-01T19:56:12.712 INFO:teuthology.orchestra.run.smithi155.stdout: "time": "2023-08-01T19:56:12.700448+0000", 2023-08-01T19:56:12.712 INFO:teuthology.orchestra.run.smithi155.stdout: "duration": 6.7222000000000001e-05 2023-08-01T19:56:12.712 INFO:teuthology.orchestra.run.smithi155.stdout: } 2023-08-01T19:56:12.712 INFO:teuthology.orchestra.run.smithi155.stdout: ] 2023-08-01T19:56:12.713 INFO:teuthology.orchestra.run.smithi155.stdout: } 2023-08-01T19:56:12.713 INFO:teuthology.orchestra.run.smithi155.stdout: }, 2023-08-01T19:56:12.713 INFO:teuthology.orchestra.run.smithi155.stdout: { 2023-08-01T19:56:12.713 INFO:teuthology.orchestra.run.smithi155.stdout: "description": "osd_op(client.4668.0:224462 5.9 5:922fcc03:::benchmark_data_smithi006_114134_object90801:head [delete] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e68)", 2023-08-01T19:56:12.713 INFO:teuthology.orchestra.run.smithi155.stdout: "initiated_at": "2023-08-01T19:56:12.700884+0000", 2023-08-01T19:56:12.713 INFO:teuthology.orchestra.run.smithi155.stdout: "age": 0.0010189859999999999, 2023-08-01T19:56:12.713 INFO:teuthology.orchestra.run.smithi155.stdout: "duration": 0.00112407, 2023-08-01T19:56:12.714 INFO:teuthology.orchestra.run.smithi155.stdout: "type_data": { 2023-08-01T19:56:12.714 INFO:teuthology.orchestra.run.smithi155.stdout: "flag_point": "started", 2023-08-01T19:56:12.714 INFO:teuthology.orchestra.run.smithi155.stdout: "client_info": { 2023-08-01T19:56:12.714 INFO:teuthology.orchestra.run.smithi155.stdout: "client": "client.4668", 2023-08-01T19:56:12.714 INFO:teuthology.orchestra.run.smithi155.stdout: "client_addr": "172.21.15.6:0/1709472247", 2023-08-01T19:56:12.714 INFO:teuthology.orchestra.run.smithi155.stdout: "tid": 224462 2023-08-01T19:56:12.714 INFO:teuthology.orchestra.run.smithi155.stdout: }, 2023-08-01T19:56:12.715 INFO:teuthology.orchestra.run.smithi155.stdout: "events": [ 2023-08-01T19:56:12.715 INFO:teuthology.orchestra.run.smithi155.stdout: { 2023-08-01T19:56:12.715 INFO:teuthology.orchestra.run.smithi155.stdout: "event": "initiated", 2023-08-01T19:56:12.715 INFO:teuthology.orchestra.run.smithi155.stdout: "time": "2023-08-01T19:56:12.700884+0000", 2023-08-01T19:56:12.715 INFO:teuthology.orchestra.run.smithi155.stdout: "duration": 0 2023-08-01T19:56:12.715 INFO:teuthology.orchestra.run.smithi155.stdout: }, 2023-08-01T19:56:12.715 INFO:teuthology.orchestra.run.smithi155.stdout: { 2023-08-01T19:56:12.715 INFO:teuthology.orchestra.run.smithi155.stdout: "event": "throttled", 2023-08-01T19:56:12.716 INFO:teuthology.orchestra.run.smithi155.stdout: "time": "2023-08-01T19:56:12.700884+0000", 2023-08-01T19:56:12.716 INFO:teuthology.orchestra.run.smithi155.stdout: "duration": 0 2023-08-01T19:56:12.716 INFO:teuthology.orchestra.run.smithi155.stdout: }, 2023-08-01T19:56:12.716 INFO:teuthology.orchestra.run.smithi155.stdout: { 2023-08-01T19:56:12.716 INFO:teuthology.orchestra.run.smithi155.stdout: "event": "header_read", 2023-08-01T19:56:12.716 INFO:teuthology.orchestra.run.smithi155.stdout: "time": "2023-08-01T19:56:12.700883+0000", 2023-08-01T19:56:12.717 INFO:teuthology.orchestra.run.smithi155.stdout: "duration": 4294967295.999999 2023-08-01T19:56:12.717 INFO:teuthology.orchestra.run.smithi155.stdout: }, 2023-08-01T19:56:12.717 INFO:teuthology.orchestra.run.smithi155.stdout: { 2023-08-01T19:56:12.717 INFO:teuthology.orchestra.run.smithi155.stdout: "event": "all_read", 2023-08-01T19:56:12.717 INFO:teuthology.orchestra.run.smithi155.stdout: "time": "2023-08-01T19:56:12.700888+0000", 2023-08-01T19:56:12.717 INFO:teuthology.orchestra.run.smithi155.stdout: "duration": 5.2349999999999999e-06 2023-08-01T19:56:12.717 INFO:teuthology.orchestra.run.smithi155.stdout: }, 2023-08-01T19:56:12.718 INFO:teuthology.orchestra.run.smithi155.stdout: { 2023-08-01T19:56:12.718 INFO:teuthology.orchestra.run.smithi155.stdout: "event": "dispatched", 2023-08-01T19:56:12.718 INFO:teuthology.orchestra.run.smithi155.stdout: "time": "2023-08-01T19:56:12.700897+0000", 2023-08-01T19:56:12.718 INFO:teuthology.orchestra.run.smithi155.stdout: "duration": 9.0229999999999998e-06 2023-08-01T19:56:12.718 INFO:teuthology.orchestra.run.smithi155.stdout: }, 2023-08-01T19:56:12.718 INFO:teuthology.orchestra.run.smithi155.stdout: { 2023-08-01T19:56:12.718 INFO:teuthology.orchestra.run.smithi155.stdout: "event": "queued_for_pg", 2023-08-01T19:56:12.718 INFO:teuthology.orchestra.run.smithi155.stdout: "time": "2023-08-01T19:56:12.700908+0000", 2023-08-01T19:56:12.719 INFO:teuthology.orchestra.run.smithi155.stdout: "duration": 1.1088e-05 2023-08-01T19:56:12.719 INFO:teuthology.orchestra.run.smithi155.stdout: }, 2023-08-01T19:56:12.719 INFO:teuthology.orchestra.run.smithi155.stdout: { 2023-08-01T19:56:12.719 INFO:teuthology.orchestra.run.smithi155.stdout: "event": "reached_pg", 2023-08-01T19:56:12.719 INFO:teuthology.orchestra.run.smithi155.stdout: "time": "2023-08-01T19:56:12.700952+0000", 2023-08-01T19:56:12.719 INFO:teuthology.orchestra.run.smithi155.stdout: "duration": 4.3503e-05 2023-08-01T19:56:12.719 INFO:teuthology.orchestra.run.smithi155.stdout: }, 2023-08-01T19:56:12.720 INFO:teuthology.orchestra.run.smithi155.stdout: { 2023-08-01T19:56:12.720 INFO:teuthology.orchestra.run.smithi155.stdout: "event": "started", 2023-08-01T19:56:12.720 INFO:teuthology.orchestra.run.smithi155.stdout: "time": "2023-08-01T19:56:12.701094+0000", 2023-08-01T19:56:12.720 INFO:teuthology.orchestra.run.smithi155.stdout: "duration": 0.00014198699999999999 2023-08-01T19:56:12.720 INFO:teuthology.orchestra.run.smithi155.stdout: } 2023-08-01T19:56:12.720 INFO:teuthology.orchestra.run.smithi155.stdout: ] 2023-08-01T19:56:12.720 INFO:teuthology.orchestra.run.smithi155.stdout: } 2023-08-01T19:56:12.721 INFO:teuthology.orchestra.run.smithi155.stdout: }, 2023-08-01T19:56:12.721 INFO:teuthology.orchestra.run.smithi155.stdout: { 2023-08-01T19:56:12.721 INFO:teuthology.orchestra.run.smithi155.stdout: "description": "osd_repop_reply(client.4668.0:224445 5.e e68/19)", 2023-08-01T19:56:12.721 INFO:teuthology.orchestra.run.smithi155.stdout: "initiated_at": "2023-08-01T19:56:12.700883+0000", 2023-08-01T19:56:12.721 INFO:teuthology.orchestra.run.smithi155.stdout: "age": 0.0010199320000000001, 2023-08-01T19:56:12.721 INFO:teuthology.orchestra.run.smithi155.stdout: "duration": 0.001187158, 2023-08-01T19:56:12.721 INFO:teuthology.orchestra.run.smithi155.stdout: "type_data": { 2023-08-01T19:56:12.721 INFO:teuthology.orchestra.run.smithi155.stdout: "flag_point": "queued for pg", 2023-08-01T19:56:12.722 INFO:teuthology.orchestra.run.smithi155.stdout: "events": [ 2023-08-01T19:56:12.722 INFO:teuthology.orchestra.run.smithi155.stdout: { 2023-08-01T19:56:12.722 INFO:teuthology.orchestra.run.smithi155.stdout: "event": "initiated", 2023-08-01T19:56:12.722 INFO:teuthology.orchestra.run.smithi155.stdout: "time": "2023-08-01T19:56:12.700883+0000", 2023-08-01T19:56:12.722 INFO:teuthology.orchestra.run.smithi155.stdout: "duration": 0 2023-08-01T19:56:12.722 INFO:teuthology.orchestra.run.smithi155.stdout: }, 2023-08-01T19:56:12.722 INFO:teuthology.orchestra.run.smithi155.stdout: { 2023-08-01T19:56:12.723 INFO:teuthology.orchestra.run.smithi155.stdout: "event": "throttled", 2023-08-01T19:56:12.723 INFO:teuthology.orchestra.run.smithi155.stdout: "time": "2023-08-01T19:56:12.700883+0000", 2023-08-01T19:56:12.723 INFO:teuthology.orchestra.run.smithi155.stdout: "duration": 0 2023-08-01T19:56:12.723 INFO:teuthology.orchestra.run.smithi155.stdout: }, 2023-08-01T19:56:12.723 INFO:teuthology.orchestra.run.smithi155.stdout: { 2023-08-01T19:56:12.723 INFO:teuthology.orchestra.run.smithi155.stdout: "event": "header_read", 2023-08-01T19:56:12.723 INFO:teuthology.orchestra.run.smithi155.stdout: "time": "2023-08-01T19:56:12.700882+0000", 2023-08-01T19:56:12.723 INFO:teuthology.orchestra.run.smithi155.stdout: "duration": 4294967295.9999995 2023-08-01T19:56:12.724 INFO:teuthology.orchestra.run.smithi155.stdout: }, 2023-08-01T19:56:12.724 INFO:teuthology.orchestra.run.smithi155.stdout: { 2023-08-01T19:56:12.724 INFO:teuthology.orchestra.run.smithi155.stdout: "event": "all_read", 2023-08-01T19:56:12.724 INFO:teuthology.orchestra.run.smithi155.stdout: "time": "2023-08-01T19:56:12.700888+0000", 2023-08-01T19:56:12.724 INFO:teuthology.orchestra.run.smithi155.stdout: "duration": 5.2220000000000001e-06 2023-08-01T19:56:12.724 INFO:teuthology.orchestra.run.smithi155.stdout: }, 2023-08-01T19:56:12.724 INFO:teuthology.orchestra.run.smithi155.stdout: { 2023-08-01T19:56:12.725 INFO:teuthology.orchestra.run.smithi155.stdout: "event": "dispatched", 2023-08-01T19:56:12.725 INFO:teuthology.orchestra.run.smithi155.stdout: "time": "2023-08-01T19:56:12.700898+0000", 2023-08-01T19:56:12.725 INFO:teuthology.orchestra.run.smithi155.stdout: "duration": 9.8709999999999992e-06 2023-08-01T19:56:12.725 INFO:teuthology.orchestra.run.smithi155.stdout: }, 2023-08-01T19:56:12.725 INFO:teuthology.orchestra.run.smithi155.stdout: { 2023-08-01T19:56:12.725 INFO:teuthology.orchestra.run.smithi155.stdout: "event": "queued_for_pg", 2023-08-01T19:56:12.725 INFO:teuthology.orchestra.run.smithi155.stdout: "time": "2023-08-01T19:56:12.700904+0000", 2023-08-01T19:56:12.726 INFO:teuthology.orchestra.run.smithi155.stdout: "duration": 6.2530000000000001e-06 2023-08-01T19:56:12.726 INFO:teuthology.orchestra.run.smithi155.stdout: } 2023-08-01T19:56:12.726 INFO:teuthology.orchestra.run.smithi155.stdout: ] 2023-08-01T19:56:12.726 INFO:teuthology.orchestra.run.smithi155.stdout: } 2023-08-01T19:56:12.726 INFO:teuthology.orchestra.run.smithi155.stdout: }, 2023-08-01T19:56:12.726 INFO:teuthology.orchestra.run.smithi155.stdout: { 2023-08-01T19:56:12.726 INFO:teuthology.orchestra.run.smithi155.stdout: "description": "osd_op(client.4668.0:224463 5.e 5.625a987e (undecoded) ondisk+write+known_if_redirected+supports_pool_eio e68)", 2023-08-01T19:56:12.727 INFO:teuthology.orchestra.run.smithi155.stdout: "initiated_at": "2023-08-01T19:56:12.700921+0000", 2023-08-01T19:56:12.727 INFO:teuthology.orchestra.run.smithi155.stdout: "age": 0.00098161400000000001, 2023-08-01T19:56:12.727 INFO:teuthology.orchestra.run.smithi155.stdout: "duration": 0.0011946179999999999, 2023-08-01T19:56:12.727 INFO:teuthology.orchestra.run.smithi155.stdout: "type_data": { 2023-08-01T19:56:12.727 INFO:teuthology.orchestra.run.smithi155.stdout: "flag_point": "queued for pg", 2023-08-01T19:56:12.727 INFO:teuthology.orchestra.run.smithi155.stdout: "client_info": { 2023-08-01T19:56:12.727 INFO:teuthology.orchestra.run.smithi155.stdout: "client": "client.4668", 2023-08-01T19:56:12.727 INFO:teuthology.orchestra.run.smithi155.stdout: "client_addr": "172.21.15.6:0/1709472247", 2023-08-01T19:56:12.728 INFO:teuthology.orchestra.run.smithi155.stdout: "tid": 224463 2023-08-01T19:56:12.728 INFO:teuthology.orchestra.run.smithi155.stdout: }, 2023-08-01T19:56:12.728 INFO:teuthology.orchestra.run.smithi155.stdout: "events": [ 2023-08-01T19:56:12.728 INFO:teuthology.orchestra.run.smithi155.stdout: { 2023-08-01T19:56:12.728 INFO:teuthology.orchestra.run.smithi155.stdout: "event": "initiated", 2023-08-01T19:56:12.728 INFO:teuthology.orchestra.run.smithi155.stdout: "time": "2023-08-01T19:56:12.700921+0000", 2023-08-01T19:56:12.729 INFO:teuthology.orchestra.run.smithi155.stdout: "duration": 0 2023-08-01T19:56:12.729 INFO:teuthology.orchestra.run.smithi155.stdout: }, 2023-08-01T19:56:12.729 INFO:teuthology.orchestra.run.smithi155.stdout: { 2023-08-01T19:56:12.729 INFO:teuthology.orchestra.run.smithi155.stdout: "event": "throttled", 2023-08-01T19:56:12.729 INFO:teuthology.orchestra.run.smithi155.stdout: "time": "2023-08-01T19:56:12.700921+0000", 2023-08-01T19:56:12.729 INFO:teuthology.orchestra.run.smithi155.stdout: "duration": 0 2023-08-01T19:56:12.729 INFO:teuthology.orchestra.run.smithi155.stdout: }, 2023-08-01T19:56:12.729 INFO:teuthology.orchestra.run.smithi155.stdout: { 2023-08-01T19:56:12.730 INFO:teuthology.orchestra.run.smithi155.stdout: "event": "header_read", 2023-08-01T19:56:12.730 INFO:teuthology.orchestra.run.smithi155.stdout: "time": "2023-08-01T19:56:12.700921+0000", 2023-08-01T19:56:12.730 INFO:teuthology.orchestra.run.smithi155.stdout: "duration": 4294967295.9999995 2023-08-01T19:56:12.730 INFO:teuthology.orchestra.run.smithi155.stdout: }, 2023-08-01T19:56:12.730 INFO:teuthology.orchestra.run.smithi155.stdout: { 2023-08-01T19:56:12.730 INFO:teuthology.orchestra.run.smithi155.stdout: "event": "all_read", 2023-08-01T19:56:12.730 INFO:teuthology.orchestra.run.smithi155.stdout: "time": "2023-08-01T19:56:12.700924+0000", 2023-08-01T19:56:12.730 INFO:teuthology.orchestra.run.smithi155.stdout: "duration": 3.6239999999999999e-06 2023-08-01T19:56:12.731 INFO:teuthology.orchestra.run.smithi155.stdout: }, 2023-08-01T19:56:12.731 INFO:teuthology.orchestra.run.smithi155.stdout: { 2023-08-01T19:56:12.731 INFO:teuthology.orchestra.run.smithi155.stdout: "event": "dispatched", 2023-08-01T19:56:12.731 INFO:teuthology.orchestra.run.smithi155.stdout: "time": "2023-08-01T19:56:12.700931+0000", 2023-08-01T19:56:12.731 INFO:teuthology.orchestra.run.smithi155.stdout: "duration": 6.8070000000000002e-06 2023-08-01T19:56:12.731 INFO:teuthology.orchestra.run.smithi155.stdout: }, 2023-08-01T19:56:12.731 INFO:teuthology.orchestra.run.smithi155.stdout: { 2023-08-01T19:56:12.732 INFO:teuthology.orchestra.run.smithi155.stdout: "event": "queued_for_pg", 2023-08-01T19:56:12.732 INFO:teuthology.orchestra.run.smithi155.stdout: "time": "2023-08-01T19:56:12.700935+0000", 2023-08-01T19:56:12.732 INFO:teuthology.orchestra.run.smithi155.stdout: "duration": 4.2100000000000003e-06 2023-08-01T19:56:12.732 INFO:teuthology.orchestra.run.smithi155.stdout: } 2023-08-01T19:56:12.732 INFO:teuthology.orchestra.run.smithi155.stdout: ] 2023-08-01T19:56:12.732 INFO:teuthology.orchestra.run.smithi155.stdout: } 2023-08-01T19:56:12.732 INFO:teuthology.orchestra.run.smithi155.stdout: }, 2023-08-01T19:56:12.733 INFO:teuthology.orchestra.run.smithi155.stdout: { 2023-08-01T19:56:12.733 INFO:teuthology.orchestra.run.smithi155.stdout: "description": "osd_repop(client.4668.0:224461 5.a e68/19 5:5e4ea326:::benchmark_data_smithi006_114134_object90800:head v 68'13939, mlcod=68'13936)", 2023-08-01T19:56:12.733 INFO:teuthology.orchestra.run.smithi155.stdout: "initiated_at": "2023-08-01T19:56:12.701558+0000", 2023-08-01T19:56:12.733 INFO:teuthology.orchestra.run.smithi155.stdout: "age": 0.000344481, 2023-08-01T19:56:12.733 INFO:teuthology.orchestra.run.smithi155.stdout: "duration": 0.00061236199999999998, 2023-08-01T19:56:12.733 INFO:teuthology.orchestra.run.smithi155.stdout: "type_data": { 2023-08-01T19:56:12.733 INFO:teuthology.orchestra.run.smithi155.stdout: "flag_point": "started", 2023-08-01T19:56:12.734 INFO:teuthology.orchestra.run.smithi155.stdout: "events": [ 2023-08-01T19:56:12.734 INFO:teuthology.orchestra.run.smithi155.stdout: { 2023-08-01T19:56:12.734 INFO:teuthology.orchestra.run.smithi155.stdout: "event": "initiated", 2023-08-01T19:56:12.734 INFO:teuthology.orchestra.run.smithi155.stdout: "time": "2023-08-01T19:56:12.701558+0000", 2023-08-01T19:56:12.734 INFO:teuthology.orchestra.run.smithi155.stdout: "duration": 0 2023-08-01T19:56:12.734 INFO:teuthology.orchestra.run.smithi155.stdout: }, 2023-08-01T19:56:12.734 INFO:teuthology.orchestra.run.smithi155.stdout: { 2023-08-01T19:56:12.734 INFO:teuthology.orchestra.run.smithi155.stdout: "event": "throttled", 2023-08-01T19:56:12.735 INFO:teuthology.orchestra.run.smithi155.stdout: "time": "2023-08-01T19:56:12.701558+0000", 2023-08-01T19:56:12.735 INFO:teuthology.orchestra.run.smithi155.stdout: "duration": 0 2023-08-01T19:56:12.735 INFO:teuthology.orchestra.run.smithi155.stdout: }, 2023-08-01T19:56:12.735 INFO:teuthology.orchestra.run.smithi155.stdout: { 2023-08-01T19:56:12.735 INFO:teuthology.orchestra.run.smithi155.stdout: "event": "header_read", 2023-08-01T19:56:12.735 INFO:teuthology.orchestra.run.smithi155.stdout: "time": "2023-08-01T19:56:12.701558+0000", 2023-08-01T19:56:12.735 INFO:teuthology.orchestra.run.smithi155.stdout: "duration": 4294967295.9999995 2023-08-01T19:56:12.735 INFO:teuthology.orchestra.run.smithi155.stdout: }, 2023-08-01T19:56:12.736 INFO:teuthology.orchestra.run.smithi155.stdout: { 2023-08-01T19:56:12.736 INFO:teuthology.orchestra.run.smithi155.stdout: "event": "all_read", 2023-08-01T19:56:12.736 INFO:teuthology.orchestra.run.smithi155.stdout: "time": "2023-08-01T19:56:12.701567+0000", 2023-08-01T19:56:12.736 INFO:teuthology.orchestra.run.smithi155.stdout: "duration": 9.2939999999999994e-06 2023-08-01T19:56:12.736 INFO:teuthology.orchestra.run.smithi155.stdout: }, 2023-08-01T19:56:12.736 INFO:teuthology.orchestra.run.smithi155.stdout: { 2023-08-01T19:56:12.736 INFO:teuthology.orchestra.run.smithi155.stdout: "event": "dispatched", 2023-08-01T19:56:12.737 INFO:teuthology.orchestra.run.smithi155.stdout: "time": "2023-08-01T19:56:12.701578+0000", 2023-08-01T19:56:12.737 INFO:teuthology.orchestra.run.smithi155.stdout: "duration": 1.0349999999999999e-05 2023-08-01T19:56:12.737 INFO:teuthology.orchestra.run.smithi155.stdout: }, 2023-08-01T19:56:12.737 INFO:teuthology.orchestra.run.smithi155.stdout: { 2023-08-01T19:56:12.737 INFO:teuthology.orchestra.run.smithi155.stdout: "event": "queued_for_pg", 2023-08-01T19:56:12.737 INFO:teuthology.orchestra.run.smithi155.stdout: "time": "2023-08-01T19:56:12.701583+0000", 2023-08-01T19:56:12.737 INFO:teuthology.orchestra.run.smithi155.stdout: "duration": 4.989e-06 2023-08-01T19:56:12.737 INFO:teuthology.orchestra.run.smithi155.stdout: }, 2023-08-01T19:56:12.738 INFO:teuthology.orchestra.run.smithi155.stdout: { 2023-08-01T19:56:12.738 INFO:teuthology.orchestra.run.smithi155.stdout: "event": "reached_pg", 2023-08-01T19:56:12.738 INFO:teuthology.orchestra.run.smithi155.stdout: "time": "2023-08-01T19:56:12.701613+0000", 2023-08-01T19:56:12.738 INFO:teuthology.orchestra.run.smithi155.stdout: "duration": 3.0022000000000002e-05 2023-08-01T19:56:12.738 INFO:teuthology.orchestra.run.smithi155.stdout: }, 2023-08-01T19:56:12.738 INFO:teuthology.orchestra.run.smithi155.stdout: { 2023-08-01T19:56:12.738 INFO:teuthology.orchestra.run.smithi155.stdout: "event": "started", 2023-08-01T19:56:12.738 INFO:teuthology.orchestra.run.smithi155.stdout: "time": "2023-08-01T19:56:12.701626+0000", 2023-08-01T19:56:12.739 INFO:teuthology.orchestra.run.smithi155.stdout: "duration": 1.3823e-05 2023-08-01T19:56:12.739 INFO:teuthology.orchestra.run.smithi155.stdout: } 2023-08-01T19:56:12.739 INFO:teuthology.orchestra.run.smithi155.stdout: ] 2023-08-01T19:56:12.739 INFO:teuthology.orchestra.run.smithi155.stdout: } 2023-08-01T19:56:12.739 INFO:teuthology.orchestra.run.smithi155.stdout: }, 2023-08-01T19:56:12.739 INFO:teuthology.orchestra.run.smithi155.stdout: { 2023-08-01T19:56:12.739 INFO:teuthology.orchestra.run.smithi155.stdout: "description": "osd_op(client.4668.0:224445 5.e 5:7e33eefb:::benchmark_data_smithi006_114134_object90784:head [delete] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e68)", 2023-08-01T19:56:12.739 INFO:teuthology.orchestra.run.smithi155.stdout: "initiated_at": "2023-08-01T19:56:12.693093+0000", 2023-08-01T19:56:12.740 INFO:teuthology.orchestra.run.smithi155.stdout: "age": 0.0088096589999999992, 2023-08-01T19:56:12.740 INFO:teuthology.orchestra.run.smithi155.stdout: "duration": 0.0091452010000000004, 2023-08-01T19:56:12.740 INFO:teuthology.orchestra.run.smithi155.stdout: "type_data": { 2023-08-01T19:56:12.740 INFO:teuthology.orchestra.run.smithi155.stdout: "flag_point": "waiting for sub ops", 2023-08-01T19:56:12.740 INFO:teuthology.orchestra.run.smithi155.stdout: "client_info": { 2023-08-01T19:56:12.740 INFO:teuthology.orchestra.run.smithi155.stdout: "client": "client.4668", 2023-08-01T19:56:12.740 INFO:teuthology.orchestra.run.smithi155.stdout: "client_addr": "172.21.15.6:0/1709472247", 2023-08-01T19:56:12.741 INFO:teuthology.orchestra.run.smithi155.stdout: "tid": 224445 2023-08-01T19:56:12.741 INFO:teuthology.orchestra.run.smithi155.stdout: }, 2023-08-01T19:56:12.741 INFO:teuthology.orchestra.run.smithi155.stdout: "events": [ 2023-08-01T19:56:12.741 INFO:teuthology.orchestra.run.smithi155.stdout: { 2023-08-01T19:56:12.741 INFO:teuthology.orchestra.run.smithi155.stdout: "event": "initiated", 2023-08-01T19:56:12.741 INFO:teuthology.orchestra.run.smithi155.stdout: "time": "2023-08-01T19:56:12.693093+0000", 2023-08-01T19:56:12.741 INFO:teuthology.orchestra.run.smithi155.stdout: "duration": 0 2023-08-01T19:56:12.741 INFO:teuthology.orchestra.run.smithi155.stdout: }, 2023-08-01T19:56:12.742 INFO:teuthology.orchestra.run.smithi155.stdout: { 2023-08-01T19:56:12.742 INFO:teuthology.orchestra.run.smithi155.stdout: "event": "throttled", 2023-08-01T19:56:12.742 INFO:teuthology.orchestra.run.smithi155.stdout: "time": "2023-08-01T19:56:12.693093+0000", 2023-08-01T19:56:12.742 INFO:teuthology.orchestra.run.smithi155.stdout: "duration": 0 2023-08-01T19:56:12.742 INFO:teuthology.orchestra.run.smithi155.stdout: }, 2023-08-01T19:56:12.742 INFO:teuthology.orchestra.run.smithi155.stdout: { 2023-08-01T19:56:12.742 INFO:teuthology.orchestra.run.smithi155.stdout: "event": "header_read", 2023-08-01T19:56:12.742 INFO:teuthology.orchestra.run.smithi155.stdout: "time": "2023-08-01T19:56:12.693093+0000", 2023-08-01T19:56:12.743 INFO:teuthology.orchestra.run.smithi155.stdout: "duration": 4294967295.9999995 2023-08-01T19:56:12.743 INFO:teuthology.orchestra.run.smithi155.stdout: }, 2023-08-01T19:56:12.743 INFO:teuthology.orchestra.run.smithi155.stdout: { 2023-08-01T19:56:12.743 INFO:teuthology.orchestra.run.smithi155.stdout: "event": "all_read", 2023-08-01T19:56:12.743 INFO:teuthology.orchestra.run.smithi155.stdout: "time": "2023-08-01T19:56:12.693096+0000", 2023-08-01T19:56:12.743 INFO:teuthology.orchestra.run.smithi155.stdout: "duration": 3.2279999999999998e-06 2023-08-01T19:56:12.743 INFO:teuthology.orchestra.run.smithi155.stdout: }, 2023-08-01T19:56:12.744 INFO:teuthology.orchestra.run.smithi155.stdout: { 2023-08-01T19:56:12.744 INFO:teuthology.orchestra.run.smithi155.stdout: "event": "dispatched", 2023-08-01T19:56:12.744 INFO:teuthology.orchestra.run.smithi155.stdout: "time": "2023-08-01T19:56:12.693107+0000", 2023-08-01T19:56:12.744 INFO:teuthology.orchestra.run.smithi155.stdout: "duration": 1.1260000000000001e-05 2023-08-01T19:56:12.744 INFO:teuthology.orchestra.run.smithi155.stdout: }, 2023-08-01T19:56:12.744 INFO:teuthology.orchestra.run.smithi155.stdout: { 2023-08-01T19:56:12.744 INFO:teuthology.orchestra.run.smithi155.stdout: "event": "queued_for_pg", 2023-08-01T19:56:12.744 INFO:teuthology.orchestra.run.smithi155.stdout: "time": "2023-08-01T19:56:12.693112+0000", 2023-08-01T19:56:12.745 INFO:teuthology.orchestra.run.smithi155.stdout: "duration": 5.0649999999999998e-06 2023-08-01T19:56:12.745 INFO:teuthology.orchestra.run.smithi155.stdout: }, 2023-08-01T19:56:12.745 INFO:teuthology.orchestra.run.smithi155.stdout: { 2023-08-01T19:56:12.745 INFO:teuthology.orchestra.run.smithi155.stdout: "event": "reached_pg", 2023-08-01T19:56:12.745 INFO:teuthology.orchestra.run.smithi155.stdout: "time": "2023-08-01T19:56:12.693152+0000", 2023-08-01T19:56:12.745 INFO:teuthology.orchestra.run.smithi155.stdout: "duration": 4.0116e-05 2023-08-01T19:56:12.745 INFO:teuthology.orchestra.run.smithi155.stdout: }, 2023-08-01T19:56:12.746 INFO:teuthology.orchestra.run.smithi155.stdout: { 2023-08-01T19:56:12.746 INFO:teuthology.orchestra.run.smithi155.stdout: "event": "started", 2023-08-01T19:56:12.746 INFO:teuthology.orchestra.run.smithi155.stdout: "time": "2023-08-01T19:56:12.693271+0000", 2023-08-01T19:56:12.746 INFO:teuthology.orchestra.run.smithi155.stdout: "duration": 0.00011873499999999999 2023-08-01T19:56:12.746 INFO:teuthology.orchestra.run.smithi155.stdout: }, 2023-08-01T19:56:12.746 INFO:teuthology.orchestra.run.smithi155.stdout: { 2023-08-01T19:56:12.746 INFO:teuthology.orchestra.run.smithi155.stdout: "event": "waiting for subops from 0", 2023-08-01T19:56:12.746 INFO:teuthology.orchestra.run.smithi155.stdout: "time": "2023-08-01T19:56:12.693372+0000", 2023-08-01T19:56:12.747 INFO:teuthology.orchestra.run.smithi155.stdout: "duration": 0.000100814 2023-08-01T19:56:12.747 INFO:teuthology.orchestra.run.smithi155.stdout: } 2023-08-01T19:56:12.747 INFO:teuthology.orchestra.run.smithi155.stdout: ] 2023-08-01T19:56:12.747 INFO:teuthology.orchestra.run.smithi155.stdout: } 2023-08-01T19:56:12.747 INFO:teuthology.orchestra.run.smithi155.stdout: }, 2023-08-01T19:56:12.747 INFO:teuthology.orchestra.run.smithi155.stdout: { 2023-08-01T19:56:12.747 INFO:teuthology.orchestra.run.smithi155.stdout: "description": "osd_repop(client.4668.0:224449 5.a e68/19 5:5ad90991:::benchmark_data_smithi006_114134_object90788:head v 68'13938, mlcod=68'13935)", 2023-08-01T19:56:12.748 INFO:teuthology.orchestra.run.smithi155.stdout: "initiated_at": "2023-08-01T19:56:12.695804+0000", 2023-08-01T19:56:12.748 INFO:teuthology.orchestra.run.smithi155.stdout: "age": 0.0060985420000000002, 2023-08-01T19:56:12.748 INFO:teuthology.orchestra.run.smithi155.stdout: "duration": 0.0065060919999999998, 2023-08-01T19:56:12.748 INFO:teuthology.orchestra.run.smithi155.stdout: "type_data": { 2023-08-01T19:56:12.748 INFO:teuthology.orchestra.run.smithi155.stdout: "flag_point": "started", 2023-08-01T19:56:12.748 INFO:teuthology.orchestra.run.smithi155.stdout: "events": [ 2023-08-01T19:56:12.748 INFO:teuthology.orchestra.run.smithi155.stdout: { 2023-08-01T19:56:12.748 INFO:teuthology.orchestra.run.smithi155.stdout: "event": "initiated", 2023-08-01T19:56:12.749 INFO:teuthology.orchestra.run.smithi155.stdout: "time": "2023-08-01T19:56:12.695804+0000", 2023-08-01T19:56:12.749 INFO:teuthology.orchestra.run.smithi155.stdout: "duration": 0 2023-08-01T19:56:12.749 INFO:teuthology.orchestra.run.smithi155.stdout: }, 2023-08-01T19:56:12.749 INFO:teuthology.orchestra.run.smithi155.stdout: { 2023-08-01T19:56:12.749 INFO:teuthology.orchestra.run.smithi155.stdout: "event": "throttled", 2023-08-01T19:56:12.749 INFO:teuthology.orchestra.run.smithi155.stdout: "time": "2023-08-01T19:56:12.695804+0000", 2023-08-01T19:56:12.749 INFO:teuthology.orchestra.run.smithi155.stdout: "duration": 0 2023-08-01T19:56:12.749 INFO:teuthology.orchestra.run.smithi155.stdout: }, 2023-08-01T19:56:12.750 INFO:teuthology.orchestra.run.smithi155.stdout: { 2023-08-01T19:56:12.750 INFO:teuthology.orchestra.run.smithi155.stdout: "event": "header_read", 2023-08-01T19:56:12.750 INFO:teuthology.orchestra.run.smithi155.stdout: "time": "2023-08-01T19:56:12.695804+0000", 2023-08-01T19:56:12.750 INFO:teuthology.orchestra.run.smithi155.stdout: "duration": 4294967295.9999995 2023-08-01T19:56:12.750 INFO:teuthology.orchestra.run.smithi155.stdout: }, 2023-08-01T19:56:12.750 INFO:teuthology.orchestra.run.smithi155.stdout: { 2023-08-01T19:56:12.750 INFO:teuthology.orchestra.run.smithi155.stdout: "event": "all_read", 2023-08-01T19:56:12.751 INFO:teuthology.orchestra.run.smithi155.stdout: "time": "2023-08-01T19:56:12.695809+0000", 2023-08-01T19:56:12.751 INFO:teuthology.orchestra.run.smithi155.stdout: "duration": 5.0849999999999996e-06 2023-08-01T19:56:12.751 INFO:teuthology.orchestra.run.smithi155.stdout: }, 2023-08-01T19:56:12.751 INFO:teuthology.orchestra.run.smithi155.stdout: { 2023-08-01T19:56:12.751 INFO:teuthology.orchestra.run.smithi155.stdout: "event": "dispatched", 2023-08-01T19:56:12.751 INFO:teuthology.orchestra.run.smithi155.stdout: "time": "2023-08-01T19:56:12.695818+0000", 2023-08-01T19:56:12.751 INFO:teuthology.orchestra.run.smithi155.stdout: "duration": 9.1549999999999996e-06 2023-08-01T19:56:12.751 INFO:teuthology.orchestra.run.smithi155.stdout: }, 2023-08-01T19:56:12.752 INFO:teuthology.orchestra.run.smithi155.stdout: { 2023-08-01T19:56:12.752 INFO:teuthology.orchestra.run.smithi155.stdout: "event": "queued_for_pg", 2023-08-01T19:56:12.752 INFO:teuthology.orchestra.run.smithi155.stdout: "time": "2023-08-01T19:56:12.695823+0000", 2023-08-01T19:56:12.752 INFO:teuthology.orchestra.run.smithi155.stdout: "duration": 4.3250000000000001e-06 2023-08-01T19:56:12.752 INFO:teuthology.orchestra.run.smithi155.stdout: }, 2023-08-01T19:56:12.752 INFO:teuthology.orchestra.run.smithi155.stdout: { 2023-08-01T19:56:12.752 INFO:teuthology.orchestra.run.smithi155.stdout: "event": "reached_pg", 2023-08-01T19:56:12.752 INFO:teuthology.orchestra.run.smithi155.stdout: "time": "2023-08-01T19:56:12.696331+0000", 2023-08-01T19:56:12.753 INFO:teuthology.orchestra.run.smithi155.stdout: "duration": 0.00050805900000000005 2023-08-01T19:56:12.753 INFO:teuthology.orchestra.run.smithi155.stdout: }, 2023-08-01T19:56:12.753 INFO:teuthology.orchestra.run.smithi155.stdout: { 2023-08-01T19:56:12.753 INFO:teuthology.orchestra.run.smithi155.stdout: "event": "started", 2023-08-01T19:56:12.753 INFO:teuthology.orchestra.run.smithi155.stdout: "time": "2023-08-01T19:56:12.696343+0000", 2023-08-01T19:56:12.753 INFO:teuthology.orchestra.run.smithi155.stdout: "duration": 1.2585999999999999e-05 2023-08-01T19:56:12.753 INFO:teuthology.orchestra.run.smithi155.stdout: } 2023-08-01T19:56:12.753 INFO:teuthology.orchestra.run.smithi155.stdout: ] 2023-08-01T19:56:12.754 INFO:teuthology.orchestra.run.smithi155.stdout: } 2023-08-01T19:56:12.754 INFO:teuthology.orchestra.run.smithi155.stdout: }, 2023-08-01T19:56:12.754 INFO:teuthology.orchestra.run.smithi155.stdout: { 2023-08-01T19:56:12.754 INFO:teuthology.orchestra.run.smithi155.stdout: "description": "osd_op(client.4668.0:224451 5.e 5:7c1b16b7:::benchmark_data_smithi006_114134_object90790:head [delete] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e68)", 2023-08-01T19:56:12.754 INFO:teuthology.orchestra.run.smithi155.stdout: "initiated_at": "2023-08-01T19:56:12.696270+0000", 2023-08-01T19:56:12.754 INFO:teuthology.orchestra.run.smithi155.stdout: "age": 0.0056328200000000002, 2023-08-01T19:56:12.754 INFO:teuthology.orchestra.run.smithi155.stdout: "duration": 0.0060998800000000002, 2023-08-01T19:56:12.755 INFO:teuthology.orchestra.run.smithi155.stdout: "type_data": { 2023-08-01T19:56:12.755 INFO:teuthology.orchestra.run.smithi155.stdout: "flag_point": "waiting for sub ops", 2023-08-01T19:56:12.755 INFO:teuthology.orchestra.run.smithi155.stdout: "client_info": { 2023-08-01T19:56:12.755 INFO:teuthology.orchestra.run.smithi155.stdout: "client": "client.4668", 2023-08-01T19:56:12.755 INFO:teuthology.orchestra.run.smithi155.stdout: "client_addr": "172.21.15.6:0/1709472247", 2023-08-01T19:56:12.755 INFO:teuthology.orchestra.run.smithi155.stdout: "tid": 224451 2023-08-01T19:56:12.755 INFO:teuthology.orchestra.run.smithi155.stdout: }, 2023-08-01T19:56:12.755 INFO:teuthology.orchestra.run.smithi155.stdout: "events": [ 2023-08-01T19:56:12.756 INFO:teuthology.orchestra.run.smithi155.stdout: { 2023-08-01T19:56:12.756 INFO:teuthology.orchestra.run.smithi155.stdout: "event": "initiated", 2023-08-01T19:56:12.756 INFO:teuthology.orchestra.run.smithi155.stdout: "time": "2023-08-01T19:56:12.696270+0000", 2023-08-01T19:56:12.756 INFO:teuthology.orchestra.run.smithi155.stdout: "duration": 0 2023-08-01T19:56:12.756 INFO:teuthology.orchestra.run.smithi155.stdout: }, 2023-08-01T19:56:12.756 INFO:teuthology.orchestra.run.smithi155.stdout: { 2023-08-01T19:56:12.756 INFO:teuthology.orchestra.run.smithi155.stdout: "event": "throttled", 2023-08-01T19:56:12.756 INFO:teuthology.orchestra.run.smithi155.stdout: "time": "2023-08-01T19:56:12.696270+0000", 2023-08-01T19:56:12.757 INFO:teuthology.orchestra.run.smithi155.stdout: "duration": 0 2023-08-01T19:56:12.757 INFO:teuthology.orchestra.run.smithi155.stdout: }, 2023-08-01T19:56:12.757 INFO:teuthology.orchestra.run.smithi155.stdout: { 2023-08-01T19:56:12.757 INFO:teuthology.orchestra.run.smithi155.stdout: "event": "header_read", 2023-08-01T19:56:12.757 INFO:teuthology.orchestra.run.smithi155.stdout: "time": "2023-08-01T19:56:12.696269+0000", 2023-08-01T19:56:12.757 INFO:teuthology.orchestra.run.smithi155.stdout: "duration": 4294967295.999999 2023-08-01T19:56:12.757 INFO:teuthology.orchestra.run.smithi155.stdout: }, 2023-08-01T19:56:12.758 INFO:teuthology.orchestra.run.smithi155.stdout: { 2023-08-01T19:56:12.758 INFO:teuthology.orchestra.run.smithi155.stdout: "event": "all_read", 2023-08-01T19:56:12.758 INFO:teuthology.orchestra.run.smithi155.stdout: "time": "2023-08-01T19:56:12.696274+0000", 2023-08-01T19:56:12.758 INFO:teuthology.orchestra.run.smithi155.stdout: "duration": 4.651e-06 2023-08-01T19:56:12.758 INFO:teuthology.orchestra.run.smithi155.stdout: }, 2023-08-01T19:56:12.758 INFO:teuthology.orchestra.run.smithi155.stdout: { 2023-08-01T19:56:12.758 INFO:teuthology.orchestra.run.smithi155.stdout: "event": "dispatched", 2023-08-01T19:56:12.759 INFO:teuthology.orchestra.run.smithi155.stdout: "time": "2023-08-01T19:56:12.696285+0000", 2023-08-01T19:56:12.759 INFO:teuthology.orchestra.run.smithi155.stdout: "duration": 1.1343e-05 2023-08-01T19:56:12.759 INFO:teuthology.orchestra.run.smithi155.stdout: }, 2023-08-01T19:56:12.759 INFO:teuthology.orchestra.run.smithi155.stdout: { 2023-08-01T19:56:12.759 INFO:teuthology.orchestra.run.smithi155.stdout: "event": "queued_for_pg", 2023-08-01T19:56:12.759 INFO:teuthology.orchestra.run.smithi155.stdout: "time": "2023-08-01T19:56:12.696290+0000", 2023-08-01T19:56:12.759 INFO:teuthology.orchestra.run.smithi155.stdout: "duration": 4.5959999999999997e-06 2023-08-01T19:56:12.759 INFO:teuthology.orchestra.run.smithi155.stdout: }, 2023-08-01T19:56:12.760 INFO:teuthology.orchestra.run.smithi155.stdout: { 2023-08-01T19:56:12.760 INFO:teuthology.orchestra.run.smithi155.stdout: "event": "reached_pg", 2023-08-01T19:56:12.760 INFO:teuthology.orchestra.run.smithi155.stdout: "time": "2023-08-01T19:56:12.696330+0000", 2023-08-01T19:56:12.760 INFO:teuthology.orchestra.run.smithi155.stdout: "duration": 3.9833000000000003e-05 2023-08-01T19:56:12.760 INFO:teuthology.orchestra.run.smithi155.stdout: }, 2023-08-01T19:56:12.760 INFO:teuthology.orchestra.run.smithi155.stdout: { 2023-08-01T19:56:12.760 INFO:teuthology.orchestra.run.smithi155.stdout: "event": "started", 2023-08-01T19:56:12.761 INFO:teuthology.orchestra.run.smithi155.stdout: "time": "2023-08-01T19:56:12.696461+0000", 2023-08-01T19:56:12.761 INFO:teuthology.orchestra.run.smithi155.stdout: "duration": 0.00013126500000000001 2023-08-01T19:56:12.761 INFO:teuthology.orchestra.run.smithi155.stdout: }, 2023-08-01T19:56:12.761 INFO:teuthology.orchestra.run.smithi155.stdout: { 2023-08-01T19:56:12.761 INFO:teuthology.orchestra.run.smithi155.stdout: "event": "waiting for subops from 0", 2023-08-01T19:56:12.761 INFO:teuthology.orchestra.run.smithi155.stdout: "time": "2023-08-01T19:56:12.696589+0000", 2023-08-01T19:56:12.761 INFO:teuthology.orchestra.run.smithi155.stdout: "duration": 0.00012838500000000001 2023-08-01T19:56:12.761 INFO:teuthology.orchestra.run.smithi155.stdout: } 2023-08-01T19:56:12.762 INFO:teuthology.orchestra.run.smithi155.stdout: ] 2023-08-01T19:56:12.762 INFO:teuthology.orchestra.run.smithi155.stdout: } 2023-08-01T19:56:12.762 INFO:teuthology.orchestra.run.smithi155.stdout: }, 2023-08-01T19:56:12.762 INFO:teuthology.orchestra.run.smithi155.stdout: { 2023-08-01T19:56:12.762 INFO:teuthology.orchestra.run.smithi155.stdout: "description": "osd_op(client.4668.0:224452 5.e 5:7e3eb4ff:::benchmark_data_smithi006_114134_object90791:head [delete] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e68)", 2023-08-01T19:56:12.762 INFO:teuthology.orchestra.run.smithi155.stdout: "initiated_at": "2023-08-01T19:56:12.697264+0000", 2023-08-01T19:56:12.762 INFO:teuthology.orchestra.run.smithi155.stdout: "age": 0.0046386960000000003, 2023-08-01T19:56:12.763 INFO:teuthology.orchestra.run.smithi155.stdout: "duration": 0.0051794859999999996, 2023-08-01T19:56:12.763 INFO:teuthology.orchestra.run.smithi155.stdout: "type_data": { 2023-08-01T19:56:12.763 INFO:teuthology.orchestra.run.smithi155.stdout: "flag_point": "waiting for sub ops", 2023-08-01T19:56:12.763 INFO:teuthology.orchestra.run.smithi155.stdout: "client_info": { 2023-08-01T19:56:12.763 INFO:teuthology.orchestra.run.smithi155.stdout: "client": "client.4668", 2023-08-01T19:56:12.763 INFO:teuthology.orchestra.run.smithi155.stdout: "client_addr": "172.21.15.6:0/1709472247", 2023-08-01T19:56:12.763 INFO:teuthology.orchestra.run.smithi155.stdout: "tid": 224452 2023-08-01T19:56:12.763 INFO:teuthology.orchestra.run.smithi155.stdout: }, 2023-08-01T19:56:12.764 INFO:teuthology.orchestra.run.smithi155.stdout: "events": [ 2023-08-01T19:56:12.764 INFO:teuthology.orchestra.run.smithi155.stdout: { 2023-08-01T19:56:12.764 INFO:teuthology.orchestra.run.smithi155.stdout: "event": "initiated", 2023-08-01T19:56:12.764 INFO:teuthology.orchestra.run.smithi155.stdout: "time": "2023-08-01T19:56:12.697264+0000", 2023-08-01T19:56:12.764 INFO:teuthology.orchestra.run.smithi155.stdout: "duration": 0 2023-08-01T19:56:12.764 INFO:teuthology.orchestra.run.smithi155.stdout: }, 2023-08-01T19:56:12.765 INFO:teuthology.orchestra.run.smithi155.stdout: { 2023-08-01T19:56:12.765 INFO:teuthology.orchestra.run.smithi155.stdout: "event": "throttled", 2023-08-01T19:56:12.765 INFO:teuthology.orchestra.run.smithi155.stdout: "time": "2023-08-01T19:56:12.697264+0000", 2023-08-01T19:56:12.765 INFO:teuthology.orchestra.run.smithi155.stdout: "duration": 0 2023-08-01T19:56:12.765 INFO:teuthology.orchestra.run.smithi155.stdout: }, 2023-08-01T19:56:12.765 INFO:teuthology.orchestra.run.smithi155.stdout: { 2023-08-01T19:56:12.765 INFO:teuthology.orchestra.run.smithi155.stdout: "event": "header_read", 2023-08-01T19:56:12.765 INFO:teuthology.orchestra.run.smithi155.stdout: "time": "2023-08-01T19:56:12.697264+0000", 2023-08-01T19:56:12.766 INFO:teuthology.orchestra.run.smithi155.stdout: "duration": 4294967295.9999995 2023-08-01T19:56:12.766 INFO:teuthology.orchestra.run.smithi155.stdout: }, 2023-08-01T19:56:12.766 INFO:teuthology.orchestra.run.smithi155.stdout: { 2023-08-01T19:56:12.766 INFO:teuthology.orchestra.run.smithi155.stdout: "event": "all_read", 2023-08-01T19:56:12.766 INFO:teuthology.orchestra.run.smithi155.stdout: "time": "2023-08-01T19:56:12.697268+0000", 2023-08-01T19:56:12.766 INFO:teuthology.orchestra.run.smithi155.stdout: "duration": 4.2679999999999996e-06 2023-08-01T19:56:12.766 INFO:teuthology.orchestra.run.smithi155.stdout: }, 2023-08-01T19:56:12.767 INFO:teuthology.orchestra.run.smithi155.stdout: { 2023-08-01T19:56:12.767 INFO:teuthology.orchestra.run.smithi155.stdout: "event": "dispatched", 2023-08-01T19:56:12.767 INFO:teuthology.orchestra.run.smithi155.stdout: "time": "2023-08-01T19:56:12.697277+0000", 2023-08-01T19:56:12.767 INFO:teuthology.orchestra.run.smithi155.stdout: "duration": 9.1800000000000002e-06 2023-08-01T19:56:12.767 INFO:teuthology.orchestra.run.smithi155.stdout: }, 2023-08-01T19:56:12.767 INFO:teuthology.orchestra.run.smithi155.stdout: { 2023-08-01T19:56:12.767 INFO:teuthology.orchestra.run.smithi155.stdout: "event": "queued_for_pg", 2023-08-01T19:56:12.767 INFO:teuthology.orchestra.run.smithi155.stdout: "time": "2023-08-01T19:56:12.697283+0000", 2023-08-01T19:56:12.768 INFO:teuthology.orchestra.run.smithi155.stdout: "duration": 5.8669999999999999e-06 2023-08-01T19:56:12.768 INFO:teuthology.orchestra.run.smithi155.stdout: }, 2023-08-01T19:56:12.768 INFO:teuthology.orchestra.run.smithi155.stdout: { 2023-08-01T19:56:12.768 INFO:teuthology.orchestra.run.smithi155.stdout: "event": "reached_pg", 2023-08-01T19:56:12.768 INFO:teuthology.orchestra.run.smithi155.stdout: "time": "2023-08-01T19:56:12.698570+0000", 2023-08-01T19:56:12.768 INFO:teuthology.orchestra.run.smithi155.stdout: "duration": 0.0012868179999999999 2023-08-01T19:56:12.768 INFO:teuthology.orchestra.run.smithi155.stdout: }, 2023-08-01T19:56:12.769 INFO:teuthology.orchestra.run.smithi155.stdout: { 2023-08-01T19:56:12.769 INFO:teuthology.orchestra.run.smithi155.stdout: "event": "started", 2023-08-01T19:56:12.769 INFO:teuthology.orchestra.run.smithi155.stdout: "time": "2023-08-01T19:56:12.698678+0000", 2023-08-01T19:56:12.769 INFO:teuthology.orchestra.run.smithi155.stdout: "duration": 0.000107865 2023-08-01T19:56:12.769 INFO:teuthology.orchestra.run.smithi155.stdout: }, 2023-08-01T19:56:12.769 INFO:teuthology.orchestra.run.smithi155.stdout: { 2023-08-01T19:56:12.769 INFO:teuthology.orchestra.run.smithi155.stdout: "event": "waiting for subops from 0", 2023-08-01T19:56:12.770 INFO:teuthology.orchestra.run.smithi155.stdout: "time": "2023-08-01T19:56:12.698780+0000", 2023-08-01T19:56:12.770 INFO:teuthology.orchestra.run.smithi155.stdout: "duration": 0.000102357 2023-08-01T19:56:12.770 INFO:teuthology.orchestra.run.smithi155.stdout: } 2023-08-01T19:56:12.770 INFO:teuthology.orchestra.run.smithi155.stdout: ] 2023-08-01T19:56:12.770 INFO:teuthology.orchestra.run.smithi155.stdout: } 2023-08-01T19:56:12.770 INFO:teuthology.orchestra.run.smithi155.stdout: }, 2023-08-01T19:56:12.770 INFO:teuthology.orchestra.run.smithi155.stdout: { 2023-08-01T19:56:12.771 INFO:teuthology.orchestra.run.smithi155.stdout: "description": "osd_op(client.4668.0:224454 5.f 5:f1402ccc:::benchmark_data_smithi006_114134_object90793:head [delete] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e68)", 2023-08-01T19:56:12.771 INFO:teuthology.orchestra.run.smithi155.stdout: "initiated_at": "2023-08-01T19:56:12.697856+0000", 2023-08-01T19:56:12.771 INFO:teuthology.orchestra.run.smithi155.stdout: "age": 0.0040466920000000002, 2023-08-01T19:56:12.771 INFO:teuthology.orchestra.run.smithi155.stdout: "duration": 0.0046577060000000002, 2023-08-01T19:56:12.771 INFO:teuthology.orchestra.run.smithi155.stdout: "type_data": { 2023-08-01T19:56:12.771 INFO:teuthology.orchestra.run.smithi155.stdout: "flag_point": "started", 2023-08-01T19:56:12.771 INFO:teuthology.orchestra.run.smithi155.stdout: "client_info": { 2023-08-01T19:56:12.771 INFO:teuthology.orchestra.run.smithi155.stdout: "client": "client.4668", 2023-08-01T19:56:12.772 INFO:teuthology.orchestra.run.smithi155.stdout: "client_addr": "172.21.15.6:0/1709472247", 2023-08-01T19:56:12.772 INFO:teuthology.orchestra.run.smithi155.stdout: "tid": 224454 2023-08-01T19:56:12.772 INFO:teuthology.orchestra.run.smithi155.stdout: }, 2023-08-01T19:56:12.772 INFO:teuthology.orchestra.run.smithi155.stdout: "events": [ 2023-08-01T19:56:12.772 INFO:teuthology.orchestra.run.smithi155.stdout: { 2023-08-01T19:56:12.772 INFO:teuthology.orchestra.run.smithi155.stdout: "event": "initiated", 2023-08-01T19:56:12.772 INFO:teuthology.orchestra.run.smithi155.stdout: "time": "2023-08-01T19:56:12.697856+0000", 2023-08-01T19:56:12.773 INFO:teuthology.orchestra.run.smithi155.stdout: "duration": 0 2023-08-01T19:56:12.773 INFO:teuthology.orchestra.run.smithi155.stdout: }, 2023-08-01T19:56:12.773 INFO:teuthology.orchestra.run.smithi155.stdout: { 2023-08-01T19:56:12.773 INFO:teuthology.orchestra.run.smithi155.stdout: "event": "throttled", 2023-08-01T19:56:12.773 INFO:teuthology.orchestra.run.smithi155.stdout: "time": "2023-08-01T19:56:12.697856+0000", 2023-08-01T19:56:12.773 INFO:teuthology.orchestra.run.smithi155.stdout: "duration": 0 2023-08-01T19:56:12.773 INFO:teuthology.orchestra.run.smithi155.stdout: }, 2023-08-01T19:56:12.774 INFO:teuthology.orchestra.run.smithi155.stdout: { 2023-08-01T19:56:12.774 INFO:teuthology.orchestra.run.smithi155.stdout: "event": "header_read", 2023-08-01T19:56:12.774 INFO:teuthology.orchestra.run.smithi155.stdout: "time": "2023-08-01T19:56:12.697856+0000", 2023-08-01T19:56:12.774 INFO:teuthology.orchestra.run.smithi155.stdout: "duration": 4294967295.999999 2023-08-01T19:56:12.774 INFO:teuthology.orchestra.run.smithi155.stdout: }, 2023-08-01T19:56:12.774 INFO:teuthology.orchestra.run.smithi155.stdout: { 2023-08-01T19:56:12.774 INFO:teuthology.orchestra.run.smithi155.stdout: "event": "all_read", 2023-08-01T19:56:12.774 INFO:teuthology.orchestra.run.smithi155.stdout: "time": "2023-08-01T19:56:12.697860+0000", 2023-08-01T19:56:12.775 INFO:teuthology.orchestra.run.smithi155.stdout: "duration": 4.1520000000000002e-06 2023-08-01T19:56:12.775 INFO:teuthology.orchestra.run.smithi155.stdout: }, 2023-08-01T19:56:12.775 INFO:teuthology.orchestra.run.smithi155.stdout: { 2023-08-01T19:56:12.775 INFO:teuthology.orchestra.run.smithi155.stdout: "event": "dispatched", 2023-08-01T19:56:12.775 INFO:teuthology.orchestra.run.smithi155.stdout: "time": "2023-08-01T19:56:12.697870+0000", 2023-08-01T19:56:12.775 INFO:teuthology.orchestra.run.smithi155.stdout: "duration": 1.0688e-05 2023-08-01T19:56:12.775 INFO:teuthology.orchestra.run.smithi155.stdout: }, 2023-08-01T19:56:12.776 INFO:teuthology.orchestra.run.smithi155.stdout: { 2023-08-01T19:56:12.776 INFO:teuthology.orchestra.run.smithi155.stdout: "event": "queued_for_pg", 2023-08-01T19:56:12.776 INFO:teuthology.orchestra.run.smithi155.stdout: "time": "2023-08-01T19:56:12.697875+0000", 2023-08-01T19:56:12.776 INFO:teuthology.orchestra.run.smithi155.stdout: "duration": 5.1200000000000001e-06 2023-08-01T19:56:12.776 INFO:teuthology.orchestra.run.smithi155.stdout: }, 2023-08-01T19:56:12.776 INFO:teuthology.orchestra.run.smithi155.stdout: { 2023-08-01T19:56:12.776 INFO:teuthology.orchestra.run.smithi155.stdout: "event": "reached_pg", 2023-08-01T19:56:12.777 INFO:teuthology.orchestra.run.smithi155.stdout: "time": "2023-08-01T19:56:12.697914+0000", 2023-08-01T19:56:12.777 INFO:teuthology.orchestra.run.smithi155.stdout: "duration": 3.8309000000000002e-05 2023-08-01T19:56:12.777 INFO:teuthology.orchestra.run.smithi155.stdout: }, 2023-08-01T19:56:12.777 INFO:teuthology.orchestra.run.smithi155.stdout: { 2023-08-01T19:56:12.777 INFO:teuthology.orchestra.run.smithi155.stdout: "event": "started", 2023-08-01T19:56:12.777 INFO:teuthology.orchestra.run.smithi155.stdout: "time": "2023-08-01T19:56:12.698033+0000", 2023-08-01T19:56:12.777 INFO:teuthology.orchestra.run.smithi155.stdout: "duration": 0.000119407 2023-08-01T19:56:12.777 INFO:teuthology.orchestra.run.smithi155.stdout: } 2023-08-01T19:56:12.778 INFO:teuthology.orchestra.run.smithi155.stdout: ] 2023-08-01T19:56:12.778 INFO:teuthology.orchestra.run.smithi155.stdout: } 2023-08-01T19:56:12.778 INFO:teuthology.orchestra.run.smithi155.stdout: }, 2023-08-01T19:56:12.778 INFO:teuthology.orchestra.run.smithi155.stdout: { 2023-08-01T19:56:12.778 INFO:teuthology.orchestra.run.smithi155.stdout: "description": "osd_op(client.4668.0:224455 5.d 5:b479439d:::benchmark_data_smithi006_114134_object90794:head [delete] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e68)", 2023-08-01T19:56:12.778 INFO:teuthology.orchestra.run.smithi155.stdout: "initiated_at": "2023-08-01T19:56:12.697906+0000", 2023-08-01T19:56:12.778 INFO:teuthology.orchestra.run.smithi155.stdout: "age": 0.0039971520000000003, 2023-08-01T19:56:12.779 INFO:teuthology.orchestra.run.smithi155.stdout: "duration": 0.0046721970000000003, 2023-08-01T19:56:12.779 INFO:teuthology.orchestra.run.smithi155.stdout: "type_data": { 2023-08-01T19:56:12.779 INFO:teuthology.orchestra.run.smithi155.stdout: "flag_point": "started", 2023-08-01T19:56:12.779 INFO:teuthology.orchestra.run.smithi155.stdout: "client_info": { 2023-08-01T19:56:12.779 INFO:teuthology.orchestra.run.smithi155.stdout: "client": "client.4668", 2023-08-01T19:56:12.779 INFO:teuthology.orchestra.run.smithi155.stdout: "client_addr": "172.21.15.6:0/1709472247", 2023-08-01T19:56:12.779 INFO:teuthology.orchestra.run.smithi155.stdout: "tid": 224455 2023-08-01T19:56:12.779 INFO:teuthology.orchestra.run.smithi155.stdout: }, 2023-08-01T19:56:12.780 INFO:teuthology.orchestra.run.smithi155.stdout: "events": [ 2023-08-01T19:56:12.780 INFO:teuthology.orchestra.run.smithi155.stdout: { 2023-08-01T19:56:12.780 INFO:teuthology.orchestra.run.smithi155.stdout: "event": "initiated", 2023-08-01T19:56:12.780 INFO:teuthology.orchestra.run.smithi155.stdout: "time": "2023-08-01T19:56:12.697906+0000", 2023-08-01T19:56:12.780 INFO:teuthology.orchestra.run.smithi155.stdout: "duration": 0 2023-08-01T19:56:12.780 INFO:teuthology.orchestra.run.smithi155.stdout: }, 2023-08-01T19:56:12.780 INFO:teuthology.orchestra.run.smithi155.stdout: { 2023-08-01T19:56:12.780 INFO:teuthology.orchestra.run.smithi155.stdout: "event": "throttled", 2023-08-01T19:56:12.781 INFO:teuthology.orchestra.run.smithi155.stdout: "time": "2023-08-01T19:56:12.697906+0000", 2023-08-01T19:56:12.781 INFO:teuthology.orchestra.run.smithi155.stdout: "duration": 0 2023-08-01T19:56:12.781 INFO:teuthology.orchestra.run.smithi155.stdout: }, 2023-08-01T19:56:12.781 INFO:teuthology.orchestra.run.smithi155.stdout: { 2023-08-01T19:56:12.781 INFO:teuthology.orchestra.run.smithi155.stdout: "event": "header_read", 2023-08-01T19:56:12.781 INFO:teuthology.orchestra.run.smithi155.stdout: "time": "2023-08-01T19:56:12.697905+0000", 2023-08-01T19:56:12.781 INFO:teuthology.orchestra.run.smithi155.stdout: "duration": 4294967295.9999995 2023-08-01T19:56:12.782 INFO:teuthology.orchestra.run.smithi155.stdout: }, 2023-08-01T19:56:12.782 INFO:teuthology.orchestra.run.smithi155.stdout: { 2023-08-01T19:56:12.782 INFO:teuthology.orchestra.run.smithi155.stdout: "event": "all_read", 2023-08-01T19:56:12.782 INFO:teuthology.orchestra.run.smithi155.stdout: "time": "2023-08-01T19:56:12.697909+0000", 2023-08-01T19:56:12.782 INFO:teuthology.orchestra.run.smithi155.stdout: "duration": 3.3179999999999998e-06 2023-08-01T19:56:12.782 INFO:teuthology.orchestra.run.smithi155.stdout: }, 2023-08-01T19:56:12.782 INFO:teuthology.orchestra.run.smithi155.stdout: { 2023-08-01T19:56:12.782 INFO:teuthology.orchestra.run.smithi155.stdout: "event": "dispatched", 2023-08-01T19:56:12.783 INFO:teuthology.orchestra.run.smithi155.stdout: "time": "2023-08-01T19:56:12.697916+0000", 2023-08-01T19:56:12.783 INFO:teuthology.orchestra.run.smithi155.stdout: "duration": 7.1740000000000003e-06 2023-08-01T19:56:12.783 INFO:teuthology.orchestra.run.smithi155.stdout: }, 2023-08-01T19:56:12.783 INFO:teuthology.orchestra.run.smithi155.stdout: { 2023-08-01T19:56:12.783 INFO:teuthology.orchestra.run.smithi155.stdout: "event": "queued_for_pg", 2023-08-01T19:56:12.783 INFO:teuthology.orchestra.run.smithi155.stdout: "time": "2023-08-01T19:56:12.697920+0000", 2023-08-01T19:56:12.783 INFO:teuthology.orchestra.run.smithi155.stdout: "duration": 4.2139999999999998e-06 2023-08-01T19:56:12.783 INFO:teuthology.orchestra.run.smithi155.stdout: }, 2023-08-01T19:56:12.784 INFO:teuthology.orchestra.run.smithi155.stdout: { 2023-08-01T19:56:12.784 INFO:teuthology.orchestra.run.smithi155.stdout: "event": "reached_pg", 2023-08-01T19:56:12.784 INFO:teuthology.orchestra.run.smithi155.stdout: "time": "2023-08-01T19:56:12.697957+0000", 2023-08-01T19:56:12.784 INFO:teuthology.orchestra.run.smithi155.stdout: "duration": 3.7293999999999999e-05 2023-08-01T19:56:12.784 INFO:teuthology.orchestra.run.smithi155.stdout: }, 2023-08-01T19:56:12.784 INFO:teuthology.orchestra.run.smithi155.stdout: { 2023-08-01T19:56:12.784 INFO:teuthology.orchestra.run.smithi155.stdout: "event": "started", 2023-08-01T19:56:12.785 INFO:teuthology.orchestra.run.smithi155.stdout: "time": "2023-08-01T19:56:12.698084+0000", 2023-08-01T19:56:12.785 INFO:teuthology.orchestra.run.smithi155.stdout: "duration": 0.000126873 2023-08-01T19:56:12.785 INFO:teuthology.orchestra.run.smithi155.stdout: } 2023-08-01T19:56:12.785 INFO:teuthology.orchestra.run.smithi155.stdout: ] 2023-08-01T19:56:12.785 INFO:teuthology.orchestra.run.smithi155.stdout: } 2023-08-01T19:56:12.785 INFO:teuthology.orchestra.run.smithi155.stdout: }, 2023-08-01T19:56:12.785 INFO:teuthology.orchestra.run.smithi155.stdout: { 2023-08-01T19:56:12.785 INFO:teuthology.orchestra.run.smithi155.stdout: "description": "osd_op(client.4668.0:224457 5.e 5:7d1afd77:::benchmark_data_smithi006_114134_object90796:head [delete] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e68)", 2023-08-01T19:56:12.786 INFO:teuthology.orchestra.run.smithi155.stdout: "initiated_at": "2023-08-01T19:56:12.698354+0000", 2023-08-01T19:56:12.786 INFO:teuthology.orchestra.run.smithi155.stdout: "age": 0.0035491559999999999, 2023-08-01T19:56:12.786 INFO:teuthology.orchestra.run.smithi155.stdout: "duration": 0.0042884059999999998, 2023-08-01T19:56:12.786 INFO:teuthology.orchestra.run.smithi155.stdout: "type_data": { 2023-08-01T19:56:12.786 INFO:teuthology.orchestra.run.smithi155.stdout: "flag_point": "waiting for sub ops", 2023-08-01T19:56:12.786 INFO:teuthology.orchestra.run.smithi155.stdout: "client_info": { 2023-08-01T19:56:12.786 INFO:teuthology.orchestra.run.smithi155.stdout: "client": "client.4668", 2023-08-01T19:56:12.786 INFO:teuthology.orchestra.run.smithi155.stdout: "client_addr": "172.21.15.6:0/1709472247", 2023-08-01T19:56:12.787 INFO:teuthology.orchestra.run.smithi155.stdout: "tid": 224457 2023-08-01T19:56:12.787 INFO:teuthology.orchestra.run.smithi155.stdout: }, 2023-08-01T19:56:12.787 INFO:teuthology.orchestra.run.smithi155.stdout: "events": [ 2023-08-01T19:56:12.787 INFO:teuthology.orchestra.run.smithi155.stdout: { 2023-08-01T19:56:12.787 INFO:teuthology.orchestra.run.smithi155.stdout: "event": "initiated", 2023-08-01T19:56:12.787 INFO:teuthology.orchestra.run.smithi155.stdout: "time": "2023-08-01T19:56:12.698354+0000", 2023-08-01T19:56:12.787 INFO:teuthology.orchestra.run.smithi155.stdout: "duration": 0 2023-08-01T19:56:12.787 INFO:teuthology.orchestra.run.smithi155.stdout: }, 2023-08-01T19:56:12.788 INFO:teuthology.orchestra.run.smithi155.stdout: { 2023-08-01T19:56:12.788 INFO:teuthology.orchestra.run.smithi155.stdout: "event": "throttled", 2023-08-01T19:56:12.788 INFO:teuthology.orchestra.run.smithi155.stdout: "time": "2023-08-01T19:56:12.698354+0000", 2023-08-01T19:56:12.788 INFO:teuthology.orchestra.run.smithi155.stdout: "duration": 0 2023-08-01T19:56:12.788 INFO:teuthology.orchestra.run.smithi155.stdout: }, 2023-08-01T19:56:12.788 INFO:teuthology.orchestra.run.smithi155.stdout: { 2023-08-01T19:56:12.788 INFO:teuthology.orchestra.run.smithi155.stdout: "event": "header_read", 2023-08-01T19:56:12.789 INFO:teuthology.orchestra.run.smithi155.stdout: "time": "2023-08-01T19:56:12.698353+0000", 2023-08-01T19:56:12.789 INFO:teuthology.orchestra.run.smithi155.stdout: "duration": 4294967295.9999995 2023-08-01T19:56:12.789 INFO:teuthology.orchestra.run.smithi155.stdout: }, 2023-08-01T19:56:12.789 INFO:teuthology.orchestra.run.smithi155.stdout: { 2023-08-01T19:56:12.789 INFO:teuthology.orchestra.run.smithi155.stdout: "event": "all_read", 2023-08-01T19:56:12.789 INFO:teuthology.orchestra.run.smithi155.stdout: "time": "2023-08-01T19:56:12.698357+0000", 2023-08-01T19:56:12.789 INFO:teuthology.orchestra.run.smithi155.stdout: "duration": 4.189e-06 2023-08-01T19:56:12.789 INFO:teuthology.orchestra.run.smithi155.stdout: }, 2023-08-01T19:56:12.790 INFO:teuthology.orchestra.run.smithi155.stdout: { 2023-08-01T19:56:12.790 INFO:teuthology.orchestra.run.smithi155.stdout: "event": "dispatched", 2023-08-01T19:56:12.790 INFO:teuthology.orchestra.run.smithi155.stdout: "time": "2023-08-01T19:56:12.698366+0000", 2023-08-01T19:56:12.790 INFO:teuthology.orchestra.run.smithi155.stdout: "duration": 8.8610000000000004e-06 2023-08-01T19:56:12.790 INFO:teuthology.orchestra.run.smithi155.stdout: }, 2023-08-01T19:56:12.790 INFO:teuthology.orchestra.run.smithi155.stdout: { 2023-08-01T19:56:12.790 INFO:teuthology.orchestra.run.smithi155.stdout: "event": "queued_for_pg", 2023-08-01T19:56:12.791 INFO:teuthology.orchestra.run.smithi155.stdout: "time": "2023-08-01T19:56:12.698371+0000", 2023-08-01T19:56:12.791 INFO:teuthology.orchestra.run.smithi155.stdout: "duration": 4.9969999999999998e-06 2023-08-01T19:56:12.791 INFO:teuthology.orchestra.run.smithi155.stdout: }, 2023-08-01T19:56:12.791 INFO:teuthology.orchestra.run.smithi155.stdout: { 2023-08-01T19:56:12.791 INFO:teuthology.orchestra.run.smithi155.stdout: "event": "reached_pg", 2023-08-01T19:56:12.791 INFO:teuthology.orchestra.run.smithi155.stdout: "time": "2023-08-01T19:56:12.700603+0000", 2023-08-01T19:56:12.791 INFO:teuthology.orchestra.run.smithi155.stdout: "duration": 0.0022315830000000001 2023-08-01T19:56:12.791 INFO:teuthology.orchestra.run.smithi155.stdout: }, 2023-08-01T19:56:12.792 INFO:teuthology.orchestra.run.smithi155.stdout: { 2023-08-01T19:56:12.792 INFO:teuthology.orchestra.run.smithi155.stdout: "event": "started", 2023-08-01T19:56:12.792 INFO:teuthology.orchestra.run.smithi155.stdout: "time": "2023-08-01T19:56:12.700726+0000", 2023-08-01T19:56:12.792 INFO:teuthology.orchestra.run.smithi155.stdout: "duration": 0.000123223 2023-08-01T19:56:12.792 INFO:teuthology.orchestra.run.smithi155.stdout: }, 2023-08-01T19:56:12.792 INFO:teuthology.orchestra.run.smithi155.stdout: { 2023-08-01T19:56:12.792 INFO:teuthology.orchestra.run.smithi155.stdout: "event": "waiting for subops from 0", 2023-08-01T19:56:12.792 INFO:teuthology.orchestra.run.smithi155.stdout: "time": "2023-08-01T19:56:12.700840+0000", 2023-08-01T19:56:12.793 INFO:teuthology.orchestra.run.smithi155.stdout: "duration": 0.000113959 2023-08-01T19:56:12.793 INFO:teuthology.orchestra.run.smithi155.stdout: } 2023-08-01T19:56:12.793 INFO:teuthology.orchestra.run.smithi155.stdout: ] 2023-08-01T19:56:12.793 INFO:teuthology.orchestra.run.smithi155.stdout: } 2023-08-01T19:56:12.793 INFO:teuthology.orchestra.run.smithi155.stdout: }, 2023-08-01T19:56:12.793 INFO:teuthology.orchestra.run.smithi155.stdout: { 2023-08-01T19:56:12.793 INFO:teuthology.orchestra.run.smithi155.stdout: "description": "osd_op(client.4668.0:224458 5.8 5:1422cef7:::benchmark_data_smithi006_114134_object90797:head [delete] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e68)", 2023-08-01T19:56:12.793 INFO:teuthology.orchestra.run.smithi155.stdout: "initiated_at": "2023-08-01T19:56:12.698502+0000", 2023-08-01T19:56:12.794 INFO:teuthology.orchestra.run.smithi155.stdout: "age": 0.0034006050000000001, 2023-08-01T19:56:12.794 INFO:teuthology.orchestra.run.smithi155.stdout: "duration": 0.0042100280000000002, 2023-08-01T19:56:12.794 INFO:teuthology.orchestra.run.smithi155.stdout: "type_data": { 2023-08-01T19:56:12.794 INFO:teuthology.orchestra.run.smithi155.stdout: "flag_point": "waiting for sub ops", 2023-08-01T19:56:12.794 INFO:teuthology.orchestra.run.smithi155.stdout: "client_info": { 2023-08-01T19:56:12.794 INFO:teuthology.orchestra.run.smithi155.stdout: "client": "client.4668", 2023-08-01T19:56:12.794 INFO:teuthology.orchestra.run.smithi155.stdout: "client_addr": "172.21.15.6:0/1709472247", 2023-08-01T19:56:12.795 INFO:teuthology.orchestra.run.smithi155.stdout: "tid": 224458 2023-08-01T19:56:12.795 INFO:teuthology.orchestra.run.smithi155.stdout: }, 2023-08-01T19:56:12.795 INFO:teuthology.orchestra.run.smithi155.stdout: "events": [ 2023-08-01T19:56:12.795 INFO:teuthology.orchestra.run.smithi155.stdout: { 2023-08-01T19:56:12.795 INFO:teuthology.orchestra.run.smithi155.stdout: "event": "initiated", 2023-08-01T19:56:12.795 INFO:teuthology.orchestra.run.smithi155.stdout: "time": "2023-08-01T19:56:12.698502+0000", 2023-08-01T19:56:12.795 INFO:teuthology.orchestra.run.smithi155.stdout: "duration": 0 2023-08-01T19:56:12.795 INFO:teuthology.orchestra.run.smithi155.stdout: }, 2023-08-01T19:56:12.796 INFO:teuthology.orchestra.run.smithi155.stdout: { 2023-08-01T19:56:12.796 INFO:teuthology.orchestra.run.smithi155.stdout: "event": "throttled", 2023-08-01T19:56:12.796 INFO:teuthology.orchestra.run.smithi155.stdout: "time": "2023-08-01T19:56:12.698502+0000", 2023-08-01T19:56:12.796 INFO:teuthology.orchestra.run.smithi155.stdout: "duration": 0 2023-08-01T19:56:12.796 INFO:teuthology.orchestra.run.smithi155.stdout: }, 2023-08-01T19:56:12.796 INFO:teuthology.orchestra.run.smithi155.stdout: { 2023-08-01T19:56:12.796 INFO:teuthology.orchestra.run.smithi155.stdout: "event": "header_read", 2023-08-01T19:56:12.796 INFO:teuthology.orchestra.run.smithi155.stdout: "time": "2023-08-01T19:56:12.698502+0000", 2023-08-01T19:56:12.797 INFO:teuthology.orchestra.run.smithi155.stdout: "duration": 4294967295.9999995 2023-08-01T19:56:12.797 INFO:teuthology.orchestra.run.smithi155.stdout: }, 2023-08-01T19:56:12.797 INFO:teuthology.orchestra.run.smithi155.stdout: { 2023-08-01T19:56:12.797 INFO:teuthology.orchestra.run.smithi155.stdout: "event": "all_read", 2023-08-01T19:56:12.797 INFO:teuthology.orchestra.run.smithi155.stdout: "time": "2023-08-01T19:56:12.698506+0000", 2023-08-01T19:56:12.797 INFO:teuthology.orchestra.run.smithi155.stdout: "duration": 4.0219999999999998e-06 2023-08-01T19:56:12.797 INFO:teuthology.orchestra.run.smithi155.stdout: }, 2023-08-01T19:56:12.797 INFO:teuthology.orchestra.run.smithi155.stdout: { 2023-08-01T19:56:12.798 INFO:teuthology.orchestra.run.smithi155.stdout: "event": "dispatched", 2023-08-01T19:56:12.798 INFO:teuthology.orchestra.run.smithi155.stdout: "time": "2023-08-01T19:56:12.698514+0000", 2023-08-01T19:56:12.798 INFO:teuthology.orchestra.run.smithi155.stdout: "duration": 8.5099999999999998e-06 2023-08-01T19:56:12.798 INFO:teuthology.orchestra.run.smithi155.stdout: }, 2023-08-01T19:56:12.798 INFO:teuthology.orchestra.run.smithi155.stdout: { 2023-08-01T19:56:12.798 INFO:teuthology.orchestra.run.smithi155.stdout: "event": "queued_for_pg", 2023-08-01T19:56:12.798 INFO:teuthology.orchestra.run.smithi155.stdout: "time": "2023-08-01T19:56:12.698519+0000", 2023-08-01T19:56:12.799 INFO:teuthology.orchestra.run.smithi155.stdout: "duration": 4.7230000000000004e-06 2023-08-01T19:56:12.799 INFO:teuthology.orchestra.run.smithi155.stdout: }, 2023-08-01T19:56:12.799 INFO:teuthology.orchestra.run.smithi155.stdout: { 2023-08-01T19:56:12.799 INFO:teuthology.orchestra.run.smithi155.stdout: "event": "reached_pg", 2023-08-01T19:56:12.799 INFO:teuthology.orchestra.run.smithi155.stdout: "time": "2023-08-01T19:56:12.698552+0000", 2023-08-01T19:56:12.799 INFO:teuthology.orchestra.run.smithi155.stdout: "duration": 3.3105999999999998e-05 2023-08-01T19:56:12.799 INFO:teuthology.orchestra.run.smithi155.stdout: }, 2023-08-01T19:56:12.799 INFO:teuthology.orchestra.run.smithi155.stdout: { 2023-08-01T19:56:12.800 INFO:teuthology.orchestra.run.smithi155.stdout: "event": "started", 2023-08-01T19:56:12.800 INFO:teuthology.orchestra.run.smithi155.stdout: "time": "2023-08-01T19:56:12.698664+0000", 2023-08-01T19:56:12.800 INFO:teuthology.orchestra.run.smithi155.stdout: "duration": 0.00011157100000000001 2023-08-01T19:56:12.800 INFO:teuthology.orchestra.run.smithi155.stdout: }, 2023-08-01T19:56:12.800 INFO:teuthology.orchestra.run.smithi155.stdout: { 2023-08-01T19:56:12.800 INFO:teuthology.orchestra.run.smithi155.stdout: "event": "waiting for subops from 0", 2023-08-01T19:56:12.800 INFO:teuthology.orchestra.run.smithi155.stdout: "time": "2023-08-01T19:56:12.698765+0000", 2023-08-01T19:56:12.800 INFO:teuthology.orchestra.run.smithi155.stdout: "duration": 0.000101675 2023-08-01T19:56:12.801 INFO:teuthology.orchestra.run.smithi155.stdout: } 2023-08-01T19:56:12.801 INFO:teuthology.orchestra.run.smithi155.stdout: ] 2023-08-01T19:56:12.801 INFO:teuthology.orchestra.run.smithi155.stdout: } 2023-08-01T19:56:12.801 INFO:teuthology.orchestra.run.smithi155.stdout: }, 2023-08-01T19:56:12.801 INFO:teuthology.orchestra.run.smithi155.stdout: { 2023-08-01T19:56:12.801 INFO:teuthology.orchestra.run.smithi155.stdout: "description": "osd_op(client.4668.0:224459 5.8 5:1cfcaa2f:::benchmark_data_smithi006_114134_object90798:head [delete] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e68)", 2023-08-01T19:56:12.801 INFO:teuthology.orchestra.run.smithi155.stdout: "initiated_at": "2023-08-01T19:56:12.699962+0000", 2023-08-01T19:56:12.802 INFO:teuthology.orchestra.run.smithi155.stdout: "age": 0.0019412450000000001, 2023-08-01T19:56:12.802 INFO:teuthology.orchestra.run.smithi155.stdout: "duration": 0.0028251930000000001, 2023-08-01T19:56:12.802 INFO:teuthology.orchestra.run.smithi155.stdout: "type_data": { 2023-08-01T19:56:12.802 INFO:teuthology.orchestra.run.smithi155.stdout: "flag_point": "waiting for sub ops", 2023-08-01T19:56:12.802 INFO:teuthology.orchestra.run.smithi155.stdout: "client_info": { 2023-08-01T19:56:12.802 INFO:teuthology.orchestra.run.smithi155.stdout: "client": "client.4668", 2023-08-01T19:56:12.802 INFO:teuthology.orchestra.run.smithi155.stdout: "client_addr": "172.21.15.6:0/1709472247", 2023-08-01T19:56:12.802 INFO:teuthology.orchestra.run.smithi155.stdout: "tid": 224459 2023-08-01T19:56:12.803 INFO:teuthology.orchestra.run.smithi155.stdout: }, 2023-08-01T19:56:12.803 INFO:teuthology.orchestra.run.smithi155.stdout: "events": [ 2023-08-01T19:56:12.803 INFO:teuthology.orchestra.run.smithi155.stdout: { 2023-08-01T19:56:12.803 INFO:teuthology.orchestra.run.smithi155.stdout: "event": "initiated", 2023-08-01T19:56:12.803 INFO:teuthology.orchestra.run.smithi155.stdout: "time": "2023-08-01T19:56:12.699962+0000", 2023-08-01T19:56:12.803 INFO:teuthology.orchestra.run.smithi155.stdout: "duration": 0 2023-08-01T19:56:12.803 INFO:teuthology.orchestra.run.smithi155.stdout: }, 2023-08-01T19:56:12.803 INFO:teuthology.orchestra.run.smithi155.stdout: { 2023-08-01T19:56:12.804 INFO:teuthology.orchestra.run.smithi155.stdout: "event": "throttled", 2023-08-01T19:56:12.804 INFO:teuthology.orchestra.run.smithi155.stdout: "time": "2023-08-01T19:56:12.699962+0000", 2023-08-01T19:56:12.804 INFO:teuthology.orchestra.run.smithi155.stdout: "duration": 0 2023-08-01T19:56:12.804 INFO:teuthology.orchestra.run.smithi155.stdout: }, 2023-08-01T19:56:12.804 INFO:teuthology.orchestra.run.smithi155.stdout: { 2023-08-01T19:56:12.804 INFO:teuthology.orchestra.run.smithi155.stdout: "event": "header_read", 2023-08-01T19:56:12.804 INFO:teuthology.orchestra.run.smithi155.stdout: "time": "2023-08-01T19:56:12.699961+0000", 2023-08-01T19:56:12.804 INFO:teuthology.orchestra.run.smithi155.stdout: "duration": 4294967295.9999995 2023-08-01T19:56:12.805 INFO:teuthology.orchestra.run.smithi155.stdout: }, 2023-08-01T19:56:12.805 INFO:teuthology.orchestra.run.smithi155.stdout: { 2023-08-01T19:56:12.805 INFO:teuthology.orchestra.run.smithi155.stdout: "event": "all_read", 2023-08-01T19:56:12.805 INFO:teuthology.orchestra.run.smithi155.stdout: "time": "2023-08-01T19:56:12.699965+0000", 2023-08-01T19:56:12.805 INFO:teuthology.orchestra.run.smithi155.stdout: "duration": 3.9299999999999996e-06 2023-08-01T19:56:12.805 INFO:teuthology.orchestra.run.smithi155.stdout: }, 2023-08-01T19:56:12.805 INFO:teuthology.orchestra.run.smithi155.stdout: { 2023-08-01T19:56:12.806 INFO:teuthology.orchestra.run.smithi155.stdout: "event": "dispatched", 2023-08-01T19:56:12.806 INFO:teuthology.orchestra.run.smithi155.stdout: "time": "2023-08-01T19:56:12.699972+0000", 2023-08-01T19:56:12.806 INFO:teuthology.orchestra.run.smithi155.stdout: "duration": 7.114e-06 2023-08-01T19:56:12.806 INFO:teuthology.orchestra.run.smithi155.stdout: }, 2023-08-01T19:56:12.806 INFO:teuthology.orchestra.run.smithi155.stdout: { 2023-08-01T19:56:12.806 INFO:teuthology.orchestra.run.smithi155.stdout: "event": "queued_for_pg", 2023-08-01T19:56:12.806 INFO:teuthology.orchestra.run.smithi155.stdout: "time": "2023-08-01T19:56:12.699977+0000", 2023-08-01T19:56:12.806 INFO:teuthology.orchestra.run.smithi155.stdout: "duration": 4.4689999999999999e-06 2023-08-01T19:56:12.807 INFO:teuthology.orchestra.run.smithi155.stdout: }, 2023-08-01T19:56:12.807 INFO:teuthology.orchestra.run.smithi155.stdout: { 2023-08-01T19:56:12.807 INFO:teuthology.orchestra.run.smithi155.stdout: "event": "reached_pg", 2023-08-01T19:56:12.807 INFO:teuthology.orchestra.run.smithi155.stdout: "time": "2023-08-01T19:56:12.700809+0000", 2023-08-01T19:56:12.807 INFO:teuthology.orchestra.run.smithi155.stdout: "duration": 0.00083273199999999998 2023-08-01T19:56:12.807 INFO:teuthology.orchestra.run.smithi155.stdout: }, 2023-08-01T19:56:12.807 INFO:teuthology.orchestra.run.smithi155.stdout: { 2023-08-01T19:56:12.807 INFO:teuthology.orchestra.run.smithi155.stdout: "event": "started", 2023-08-01T19:56:12.808 INFO:teuthology.orchestra.run.smithi155.stdout: "time": "2023-08-01T19:56:12.700924+0000", 2023-08-01T19:56:12.808 INFO:teuthology.orchestra.run.smithi155.stdout: "duration": 0.000114227 2023-08-01T19:56:12.808 INFO:teuthology.orchestra.run.smithi155.stdout: }, 2023-08-01T19:56:12.808 INFO:teuthology.orchestra.run.smithi155.stdout: { 2023-08-01T19:56:12.808 INFO:teuthology.orchestra.run.smithi155.stdout: "event": "waiting for subops from 0", 2023-08-01T19:56:12.808 INFO:teuthology.orchestra.run.smithi155.stdout: "time": "2023-08-01T19:56:12.701033+0000", 2023-08-01T19:56:12.808 INFO:teuthology.orchestra.run.smithi155.stdout: "duration": 0.000109158 2023-08-01T19:56:12.809 INFO:teuthology.orchestra.run.smithi155.stdout: } 2023-08-01T19:56:12.809 INFO:teuthology.orchestra.run.smithi155.stdout: ] 2023-08-01T19:56:12.809 INFO:teuthology.orchestra.run.smithi155.stdout: } 2023-08-01T19:56:12.809 INFO:teuthology.orchestra.run.smithi155.stdout: } 2023-08-01T19:56:12.809 INFO:teuthology.orchestra.run.smithi155.stdout: ], 2023-08-01T19:56:12.809 INFO:teuthology.orchestra.run.smithi155.stdout: "num_ops": 14 2023-08-01T19:56:12.809 INFO:teuthology.orchestra.run.smithi155.stdout:} 2023-08-01T19:56:12.811 DEBUG:teuthology.orchestra.run.smithi155:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 30 ceph --cluster ceph --admin-daemon /var/run/ceph/ceph-osd.2.asok dump_blocked_ops 2023-08-01T19:56:12.811 INFO:tasks.ceph.osd.2.smithi155.stderr:2023-08-01T19:56:12.810+0000 7faa5c6ac700 -1 received signal: Hangup from /usr/bin/python3 /bin/daemon-helper kill ceph-osd -f --cluster ceph -i 2 (PID: 111337) UID: 0 2023-08-01T19:56:12.912 INFO:tasks.ceph.osd.2.smithi155.stderr:2023-08-01T19:56:12.911+0000 7faa5c6ac700 -1 received signal: Hangup from /usr/bin/python3 /bin/daemon-helper kill ceph-osd -f --cluster ceph -i 2 (PID: 111337) UID: 0 2023-08-01T19:56:13.008 INFO:teuthology.orchestra.run.smithi155.stdout:{ 2023-08-01T19:56:13.008 INFO:teuthology.orchestra.run.smithi155.stdout: "ops": [], 2023-08-01T19:56:13.008 INFO:teuthology.orchestra.run.smithi155.stdout: "complaint_time": 30, 2023-08-01T19:56:13.008 INFO:teuthology.orchestra.run.smithi155.stdout: "num_blocked_ops": 0 2023-08-01T19:56:13.009 INFO:teuthology.orchestra.run.smithi155.stdout:} 2023-08-01T19:56:13.012 DEBUG:teuthology.orchestra.run.smithi006:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 120 ceph --cluster ceph -- tell 'osd.*' injectargs --osd_enable_op_tracker=false 2023-08-01T19:56:13.013 INFO:tasks.ceph.osd.2.smithi155.stderr:2023-08-01T19:56:13.013+0000 7faa5c6ac700 -1 received signal: Hangup from /usr/bin/python3 /bin/daemon-helper kill ceph-osd -f --cluster ceph -i 2 (PID: 111337) UID: 0 2023-08-01T19:56:13.021 DEBUG:teuthology.orchestra.run.smithi155:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 30 ceph --cluster ceph --admin-daemon /var/run/ceph/ceph-osd.2.asok dump_historic_ops 2023-08-01T19:56:13.114 INFO:tasks.ceph.osd.0.smithi008.stderr:2023-08-01T19:56:13.112+0000 7f16a58f4700 -1 received signal: Hangup from /usr/bin/python3 /bin/daemon-helper kill ceph-osd -f --cluster ceph -i 0 (PID: 111179) UID: 0 2023-08-01T19:56:13.160 INFO:teuthology.orchestra.run.smithi006.stdout:osd.0: {} 2023-08-01T19:56:13.179 INFO:teuthology.orchestra.run.smithi006.stdout:osd.2: {} 2023-08-01T19:56:13.180 INFO:teuthology.orchestra.run.smithi006.stderr:osd.0: osd_enable_op_tracker = 'false' 2023-08-01T19:56:13.180 INFO:teuthology.orchestra.run.smithi006.stderr:Error ENXIO: problem getting command descriptions from osd.1 2023-08-01T19:56:13.180 INFO:teuthology.orchestra.run.smithi006.stderr:osd.2: osd_enable_op_tracker = 'false' 2023-08-01T19:56:13.182 DEBUG:teuthology.orchestra.run:got remote process result: 6 2023-08-01T19:56:13.183 INFO:tasks.thrashosds.thrasher:Failed to tell all osds, ignoring 2023-08-01T19:56:13.214 INFO:tasks.ceph.osd.0.smithi008.stderr:2023-08-01T19:56:13.212+0000 7f16a58f4700 -1 received signal: Hangup from /usr/bin/python3 /bin/daemon-helper kill ceph-osd -f --cluster ceph -i 0 (PID: 111179) UID: 0 2023-08-01T19:56:13.237 INFO:teuthology.orchestra.run.smithi155.stdout:ERROR: (22) Invalid argument 2023-08-01T19:56:13.238 INFO:teuthology.orchestra.run.smithi155.stdout:op_tracker tracking is not enabled now, so no ops are tracked currently, even those get stuck. Please enable "osd_enable_op_tracker", and the tracker will start to track new ops received afterwards. 2023-08-01T19:56:13.253 DEBUG:teuthology.orchestra.run.smithi008:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 30 ceph --cluster ceph --admin-daemon /var/run/ceph/ceph-osd.0.asok dump_ops_in_flight 2023-08-01T19:56:13.315 INFO:tasks.ceph.osd.0.smithi008.stderr:2023-08-01T19:56:13.313+0000 7f16a58f4700 -1 received signal: Hangup from /usr/bin/python3 /bin/daemon-helper kill ceph-osd -f --cluster ceph -i 0 (PID: 111179) UID: 0 2023-08-01T19:56:13.415 INFO:tasks.ceph.osd.0.smithi008.stderr:2023-08-01T19:56:13.413+0000 7f16a58f4700 -1 received signal: Hangup from /usr/bin/python3 /bin/daemon-helper kill ceph-osd -f --cluster ceph -i 0 (PID: 111179) UID: 0 2023-08-01T19:56:13.443 INFO:teuthology.orchestra.run.smithi008.stdout:ERROR: (22) Invalid argument 2023-08-01T19:56:13.443 INFO:teuthology.orchestra.run.smithi008.stdout:op_tracker tracking is not enabled now, so no ops are tracked currently, even those get stuck. Please enable "osd_enable_op_tracker", and the tracker will start to track new ops received afterwards. 2023-08-01T19:56:13.457 DEBUG:teuthology.orchestra.run.smithi008:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 30 ceph --cluster ceph --admin-daemon /var/run/ceph/ceph-osd.0.asok dump_blocked_ops 2023-08-01T19:56:13.515 INFO:tasks.ceph.osd.2.smithi155.stderr:2023-08-01T19:56:13.515+0000 7faa5c6ac700 -1 received signal: Hangup from /usr/bin/python3 /bin/daemon-helper kill ceph-osd -f --cluster ceph -i 2 (PID: 111337) UID: 0 2023-08-01T19:56:13.616 INFO:tasks.ceph.osd.2.smithi155.stderr:2023-08-01T19:56:13.615+0000 7faa5c6ac700 -1 received signal: Hangup from /usr/bin/python3 /bin/daemon-helper kill ceph-osd -f --cluster ceph -i 2 (PID: 111337) UID: 0 2023-08-01T19:56:13.675 INFO:teuthology.orchestra.run.smithi008.stdout:ERROR: (22) Invalid argument 2023-08-01T19:56:13.675 INFO:teuthology.orchestra.run.smithi008.stdout:op_tracker tracking is not enabled now, so no ops are tracked currently, even those get stuck. Please enable "osd_enable_op_tracker", and the tracker will start to track new ops received afterwards. 2023-08-01T19:56:13.690 DEBUG:teuthology.orchestra.run.smithi008:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 30 ceph --cluster ceph --admin-daemon /var/run/ceph/ceph-osd.0.asok dump_historic_ops 2023-08-01T19:56:13.734 INFO:tasks.ceph.osd.0.smithi008.stderr:2023-08-01T19:56:13.732+0000 7f16a58f4700 -1 received signal: Hangup from /usr/bin/python3 /bin/daemon-helper kill ceph-osd -f --cluster ceph -i 0 (PID: 111179) UID: 0 2023-08-01T19:56:13.818 INFO:tasks.ceph.osd.2.smithi155.stderr:2023-08-01T19:56:13.817+0000 7faa5c6ac700 -1 received signal: Hangup from /usr/bin/python3 /bin/daemon-helper kill ceph-osd -f --cluster ceph -i 2 (PID: 111337) UID: 0 2023-08-01T19:56:13.895 INFO:teuthology.orchestra.run.smithi008.stdout:ERROR: (22) Invalid argument 2023-08-01T19:56:13.896 INFO:teuthology.orchestra.run.smithi008.stdout:op_tracker tracking is not enabled now, so no ops are tracked currently, even those get stuck. Please enable "osd_enable_op_tracker", and the tracker will start to track new ops received afterwards. 2023-08-01T19:56:13.912 DEBUG:teuthology.orchestra.run.smithi155:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 30 ceph --cluster ceph --admin-daemon /var/run/ceph/ceph-osd.2.asok dump_ops_in_flight 2023-08-01T19:56:13.953 INFO:tasks.ceph.osd.0.smithi008.stderr:2023-08-01T19:56:13.951+0000 7f16a58f4700 -1 received signal: Hangup from /usr/bin/python3 /bin/daemon-helper kill ceph-osd -f --cluster ceph -i 0 (PID: 111179) UID: 0 2023-08-01T19:56:14.019 INFO:tasks.ceph.osd.2.smithi155.stderr:2023-08-01T19:56:14.018+0000 7faa5c6ac700 -1 received signal: Hangup from /usr/bin/python3 /bin/daemon-helper kill ceph-osd -f --cluster ceph -i 2 (PID: 111337) UID: 0 2023-08-01T19:56:14.088 INFO:teuthology.orchestra.run.smithi155.stdout:ERROR: (22) Invalid argument 2023-08-01T19:56:14.089 INFO:teuthology.orchestra.run.smithi155.stdout:op_tracker tracking is not enabled now, so no ops are tracked currently, even those get stuck. Please enable "osd_enable_op_tracker", and the tracker will start to track new ops received afterwards. 2023-08-01T19:56:14.096 DEBUG:teuthology.orchestra.run.smithi006:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 120 ceph --cluster ceph osd unset noscrub 2023-08-01T19:56:14.103 DEBUG:teuthology.orchestra.run.smithi155:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 30 ceph --cluster ceph --admin-daemon /var/run/ceph/ceph-osd.2.asok dump_blocked_ops 2023-08-01T19:56:14.119 INFO:tasks.ceph.osd.0.smithi008.stderr:2023-08-01T19:56:14.118+0000 7f16a58f4700 -1 received signal: Hangup from /usr/bin/python3 /bin/daemon-helper kill ceph-osd -f --cluster ceph -i 0 (PID: 111179) UID: 0 2023-08-01T19:56:14.222 INFO:tasks.ceph.osd.2.smithi155.stderr:2023-08-01T19:56:14.221+0000 7faa5c6ac700 -1 received signal: Hangup from /usr/bin/python3 /bin/daemon-helper kill ceph-osd -f --cluster ceph -i 2 (PID: 111337) UID: 0 2023-08-01T19:56:14.290 INFO:tasks.thrashosds.thrasher:in_osds: [0, 1, 2] out_osds: [] dead_osds: [1] live_osds: [0, 2] 2023-08-01T19:56:14.291 INFO:tasks.thrashosds.thrasher:choose_action: min_in 4 min_out 0 min_live 2 min_dead 0 chance_down 1.00 2023-08-01T19:56:14.291 INFO:tasks.thrashosds.thrasher:thrash_pg_upmap_items 2023-08-01T19:56:14.291 DEBUG:teuthology.orchestra.run.smithi006:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 120 ceph --cluster ceph osd dump -f json-pretty 2023-08-01T19:56:14.310 INFO:teuthology.orchestra.run.smithi155.stdout:ERROR: (22) Invalid argument 2023-08-01T19:56:14.310 INFO:teuthology.orchestra.run.smithi155.stdout:op_tracker tracking is not enabled now, so no ops are tracked currently, even those get stuck. Please enable "osd_enable_op_tracker", and the tracker will start to track new ops received afterwards. 2023-08-01T19:56:14.321 INFO:tasks.ceph.osd.0.smithi008.stderr:2023-08-01T19:56:14.320+0000 7f16a58f4700 -1 received signal: Hangup from /usr/bin/python3 /bin/daemon-helper kill ceph-osd -f --cluster ceph -i 0 (PID: 111179) UID: 0 2023-08-01T19:56:14.324 DEBUG:teuthology.orchestra.run.smithi155:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 30 ceph --cluster ceph --admin-daemon /var/run/ceph/ceph-osd.2.asok dump_historic_ops 2023-08-01T19:56:14.423 INFO:tasks.ceph.osd.0.smithi008.stderr:2023-08-01T19:56:14.421+0000 7f16a58f4700 -1 received signal: Hangup from /usr/bin/python3 /bin/daemon-helper kill ceph-osd -f --cluster ceph -i 0 (PID: 111179) UID: 0 2023-08-01T19:56:14.523 INFO:tasks.ceph.osd.0.smithi008.stderr:2023-08-01T19:56:14.521+0000 7f16a58f4700 -1 received signal: Hangup from /usr/bin/python3 /bin/daemon-helper kill ceph-osd -f --cluster ceph -i 0 (PID: 111179) UID: 0 2023-08-01T19:56:14.529 INFO:teuthology.orchestra.run.smithi155.stdout:ERROR: (22) Invalid argument 2023-08-01T19:56:14.530 INFO:teuthology.orchestra.run.smithi155.stdout:op_tracker tracking is not enabled now, so no ops are tracked currently, even those get stuck. Please enable "osd_enable_op_tracker", and the tracker will start to track new ops received afterwards. 2023-08-01T19:56:14.546 DEBUG:teuthology.orchestra.run.smithi008:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 30 ceph --cluster ceph --admin-daemon /var/run/ceph/ceph-osd.0.asok dump_ops_in_flight 2023-08-01T19:56:14.625 INFO:teuthology.orchestra.run.smithi006.stdout: 2023-08-01T19:56:14.625 INFO:teuthology.orchestra.run.smithi006.stdout:{ 2023-08-01T19:56:14.625 INFO:teuthology.orchestra.run.smithi006.stdout: "epoch": 68, 2023-08-01T19:56:14.625 INFO:teuthology.orchestra.run.smithi006.stdout: "fsid": "a0e420cc-4df1-42a5-8bd4-a98c309a9349", 2023-08-01T19:56:14.625 INFO:teuthology.orchestra.run.smithi006.stdout: "created": "2023-08-01T19:53:41.279588+0000", 2023-08-01T19:56:14.625 INFO:teuthology.orchestra.run.smithi006.stdout: "modified": "2023-08-01T19:56:12.070814+0000", 2023-08-01T19:56:14.626 INFO:teuthology.orchestra.run.smithi006.stdout: "last_up_change": "2023-08-01T19:55:58.549095+0000", 2023-08-01T19:56:14.626 INFO:teuthology.orchestra.run.smithi006.stdout: "last_in_change": "2023-08-01T19:53:42.974751+0000", 2023-08-01T19:56:14.626 INFO:teuthology.orchestra.run.smithi006.stdout: "flags": "noscrub,nodeep-scrub,sortbitwise,recovery_deletes,purged_snapdirs,pglog_hardlimit", 2023-08-01T19:56:14.626 INFO:teuthology.orchestra.run.smithi006.stdout: "flags_num": 5806080, 2023-08-01T19:56:14.626 INFO:teuthology.orchestra.run.smithi006.stdout: "flags_set": [ 2023-08-01T19:56:14.626 INFO:teuthology.orchestra.run.smithi006.stdout: "nodeep-scrub", 2023-08-01T19:56:14.626 INFO:teuthology.orchestra.run.smithi006.stdout: "noscrub", 2023-08-01T19:56:14.627 INFO:teuthology.orchestra.run.smithi006.stdout: "pglog_hardlimit", 2023-08-01T19:56:14.627 INFO:teuthology.orchestra.run.smithi006.stdout: "purged_snapdirs", 2023-08-01T19:56:14.627 INFO:teuthology.orchestra.run.smithi006.stdout: "recovery_deletes", 2023-08-01T19:56:14.627 INFO:teuthology.orchestra.run.smithi006.stdout: "sortbitwise" 2023-08-01T19:56:14.627 INFO:teuthology.orchestra.run.smithi006.stdout: ], 2023-08-01T19:56:14.627 INFO:teuthology.orchestra.run.smithi006.stdout: "crush_version": 5, 2023-08-01T19:56:14.627 INFO:teuthology.orchestra.run.smithi006.stdout: "full_ratio": 0.94999998807907104, 2023-08-01T19:56:14.628 INFO:teuthology.orchestra.run.smithi006.stdout: "backfillfull_ratio": 0.89999997615814209, 2023-08-01T19:56:14.628 INFO:teuthology.orchestra.run.smithi006.stdout: "nearfull_ratio": 0.85000002384185791, 2023-08-01T19:56:14.628 INFO:teuthology.orchestra.run.smithi006.stdout: "cluster_snapshot": "", 2023-08-01T19:56:14.628 INFO:teuthology.orchestra.run.smithi006.stdout: "pool_max": 5, 2023-08-01T19:56:14.628 INFO:teuthology.orchestra.run.smithi006.stdout: "max_osd": 3, 2023-08-01T19:56:14.628 INFO:teuthology.orchestra.run.smithi006.stdout: "require_min_compat_client": "luminous", 2023-08-01T19:56:14.628 INFO:teuthology.orchestra.run.smithi006.stdout: "min_compat_client": "jewel", 2023-08-01T19:56:14.629 INFO:teuthology.orchestra.run.smithi006.stdout: "require_osd_release": "quincy", 2023-08-01T19:56:14.629 INFO:teuthology.orchestra.run.smithi006.stdout: "pools": [ 2023-08-01T19:56:14.629 INFO:teuthology.orchestra.run.smithi006.stdout: { 2023-08-01T19:56:14.629 INFO:teuthology.orchestra.run.smithi006.stdout: "pool": 1, 2023-08-01T19:56:14.629 INFO:teuthology.orchestra.run.smithi006.stdout: "pool_name": ".mgr", 2023-08-01T19:56:14.629 INFO:teuthology.orchestra.run.smithi006.stdout: "create_time": "2023-08-01T19:53:49.961944+0000", 2023-08-01T19:56:14.629 INFO:teuthology.orchestra.run.smithi006.stdout: "flags": 1, 2023-08-01T19:56:14.629 INFO:teuthology.orchestra.run.smithi006.stdout: "flags_names": "hashpspool", 2023-08-01T19:56:14.630 INFO:teuthology.orchestra.run.smithi006.stdout: "type": 1, 2023-08-01T19:56:14.630 INFO:teuthology.orchestra.run.smithi006.stdout: "size": 2, 2023-08-01T19:56:14.630 INFO:teuthology.orchestra.run.smithi006.stdout: "min_size": 1, 2023-08-01T19:56:14.630 INFO:teuthology.orchestra.run.smithi006.stdout: "crush_rule": 0, 2023-08-01T19:56:14.630 INFO:teuthology.orchestra.run.smithi006.stdout: "peering_crush_bucket_count": 0, 2023-08-01T19:56:14.630 INFO:teuthology.orchestra.run.smithi006.stdout: "peering_crush_bucket_target": 0, 2023-08-01T19:56:14.630 INFO:teuthology.orchestra.run.smithi006.stdout: "peering_crush_bucket_barrier": 0, 2023-08-01T19:56:14.630 INFO:teuthology.orchestra.run.smithi006.stdout: "peering_crush_bucket_mandatory_member": 2147483647, 2023-08-01T19:56:14.631 INFO:teuthology.orchestra.run.smithi006.stdout: "object_hash": 2, 2023-08-01T19:56:14.631 INFO:teuthology.orchestra.run.smithi006.stdout: "pg_autoscale_mode": "off", 2023-08-01T19:56:14.631 INFO:teuthology.orchestra.run.smithi006.stdout: "pg_num": 1, 2023-08-01T19:56:14.631 INFO:teuthology.orchestra.run.smithi006.stdout: "pg_placement_num": 1, 2023-08-01T19:56:14.631 INFO:teuthology.orchestra.run.smithi006.stdout: "pg_placement_num_target": 1, 2023-08-01T19:56:14.631 INFO:teuthology.orchestra.run.smithi006.stdout: "pg_num_target": 1, 2023-08-01T19:56:14.631 INFO:teuthology.orchestra.run.smithi006.stdout: "pg_num_pending": 1, 2023-08-01T19:56:14.631 INFO:teuthology.orchestra.run.smithi006.stdout: "last_pg_merge_meta": { 2023-08-01T19:56:14.632 INFO:teuthology.orchestra.run.smithi006.stdout: "source_pgid": "0.0", 2023-08-01T19:56:14.632 INFO:teuthology.orchestra.run.smithi006.stdout: "ready_epoch": 0, 2023-08-01T19:56:14.632 INFO:teuthology.orchestra.run.smithi006.stdout: "last_epoch_started": 0, 2023-08-01T19:56:14.632 INFO:teuthology.orchestra.run.smithi006.stdout: "last_epoch_clean": 0, 2023-08-01T19:56:14.632 INFO:teuthology.orchestra.run.smithi006.stdout: "source_version": "0'0", 2023-08-01T19:56:14.632 INFO:teuthology.orchestra.run.smithi006.stdout: "target_version": "0'0" 2023-08-01T19:56:14.632 INFO:teuthology.orchestra.run.smithi006.stdout: }, 2023-08-01T19:56:14.633 INFO:teuthology.orchestra.run.smithi006.stdout: "last_change": "11", 2023-08-01T19:56:14.633 INFO:teuthology.orchestra.run.smithi006.stdout: "last_force_op_resend": "0", 2023-08-01T19:56:14.633 INFO:teuthology.orchestra.run.smithi006.stdout: "last_force_op_resend_prenautilus": "0", 2023-08-01T19:56:14.633 INFO:teuthology.orchestra.run.smithi006.stdout: "last_force_op_resend_preluminous": "0", 2023-08-01T19:56:14.633 INFO:teuthology.orchestra.run.smithi006.stdout: "auid": 0, 2023-08-01T19:56:14.633 INFO:teuthology.orchestra.run.smithi006.stdout: "snap_mode": "selfmanaged", 2023-08-01T19:56:14.633 INFO:teuthology.orchestra.run.smithi006.stdout: "snap_seq": 0, 2023-08-01T19:56:14.633 INFO:teuthology.orchestra.run.smithi006.stdout: "snap_epoch": 0, 2023-08-01T19:56:14.634 INFO:teuthology.orchestra.run.smithi006.stdout: "pool_snaps": [], 2023-08-01T19:56:14.634 INFO:teuthology.orchestra.run.smithi006.stdout: "removed_snaps": "[]", 2023-08-01T19:56:14.634 INFO:teuthology.orchestra.run.smithi006.stdout: "quota_max_bytes": 0, 2023-08-01T19:56:14.634 INFO:teuthology.orchestra.run.smithi006.stdout: "quota_max_objects": 0, 2023-08-01T19:56:14.634 INFO:teuthology.orchestra.run.smithi006.stdout: "tiers": [], 2023-08-01T19:56:14.634 INFO:teuthology.orchestra.run.smithi006.stdout: "tier_of": -1, 2023-08-01T19:56:14.634 INFO:teuthology.orchestra.run.smithi006.stdout: "read_tier": -1, 2023-08-01T19:56:14.634 INFO:teuthology.orchestra.run.smithi006.stdout: "write_tier": -1, 2023-08-01T19:56:14.635 INFO:teuthology.orchestra.run.smithi006.stdout: "cache_mode": "none", 2023-08-01T19:56:14.635 INFO:teuthology.orchestra.run.smithi006.stdout: "target_max_bytes": 0, 2023-08-01T19:56:14.635 INFO:teuthology.orchestra.run.smithi006.stdout: "target_max_objects": 0, 2023-08-01T19:56:14.635 INFO:teuthology.orchestra.run.smithi006.stdout: "cache_target_dirty_ratio_micro": 400000, 2023-08-01T19:56:14.635 INFO:teuthology.orchestra.run.smithi006.stdout: "cache_target_dirty_high_ratio_micro": 600000, 2023-08-01T19:56:14.635 INFO:teuthology.orchestra.run.smithi006.stdout: "cache_target_full_ratio_micro": 800000, 2023-08-01T19:56:14.635 INFO:teuthology.orchestra.run.smithi006.stdout: "cache_min_flush_age": 0, 2023-08-01T19:56:14.635 INFO:teuthology.orchestra.run.smithi006.stdout: "cache_min_evict_age": 0, 2023-08-01T19:56:14.636 INFO:teuthology.orchestra.run.smithi006.stdout: "erasure_code_profile": "", 2023-08-01T19:56:14.636 INFO:teuthology.orchestra.run.smithi006.stdout: "hit_set_params": { 2023-08-01T19:56:14.636 INFO:teuthology.orchestra.run.smithi006.stdout: "type": "none" 2023-08-01T19:56:14.636 INFO:teuthology.orchestra.run.smithi006.stdout: }, 2023-08-01T19:56:14.636 INFO:teuthology.orchestra.run.smithi006.stdout: "hit_set_period": 0, 2023-08-01T19:56:14.636 INFO:teuthology.orchestra.run.smithi006.stdout: "hit_set_count": 0, 2023-08-01T19:56:14.636 INFO:teuthology.orchestra.run.smithi006.stdout: "use_gmt_hitset": true, 2023-08-01T19:56:14.636 INFO:teuthology.orchestra.run.smithi006.stdout: "min_read_recency_for_promote": 0, 2023-08-01T19:56:14.637 INFO:teuthology.orchestra.run.smithi006.stdout: "min_write_recency_for_promote": 0, 2023-08-01T19:56:14.637 INFO:teuthology.orchestra.run.smithi006.stdout: "hit_set_grade_decay_rate": 0, 2023-08-01T19:56:14.637 INFO:teuthology.orchestra.run.smithi006.stdout: "hit_set_search_last_n": 0, 2023-08-01T19:56:14.637 INFO:teuthology.orchestra.run.smithi006.stdout: "grade_table": [], 2023-08-01T19:56:14.637 INFO:teuthology.orchestra.run.smithi006.stdout: "stripe_width": 0, 2023-08-01T19:56:14.637 INFO:teuthology.orchestra.run.smithi006.stdout: "expected_num_objects": 0, 2023-08-01T19:56:14.637 INFO:teuthology.orchestra.run.smithi006.stdout: "fast_read": false, 2023-08-01T19:56:14.637 INFO:teuthology.orchestra.run.smithi006.stdout: "options": { 2023-08-01T19:56:14.638 INFO:teuthology.orchestra.run.smithi006.stdout: "pg_num_max": 32, 2023-08-01T19:56:14.638 INFO:teuthology.orchestra.run.smithi006.stdout: "pg_num_min": 1 2023-08-01T19:56:14.638 INFO:teuthology.orchestra.run.smithi006.stdout: }, 2023-08-01T19:56:14.638 INFO:teuthology.orchestra.run.smithi006.stdout: "application_metadata": { 2023-08-01T19:56:14.638 INFO:teuthology.orchestra.run.smithi006.stdout: "mgr": {} 2023-08-01T19:56:14.638 INFO:teuthology.orchestra.run.smithi006.stdout: } 2023-08-01T19:56:14.638 INFO:teuthology.orchestra.run.smithi006.stdout: }, 2023-08-01T19:56:14.639 INFO:teuthology.orchestra.run.smithi006.stdout: { 2023-08-01T19:56:14.639 INFO:teuthology.orchestra.run.smithi006.stdout: "pool": 2, 2023-08-01T19:56:14.639 INFO:teuthology.orchestra.run.smithi006.stdout: "pool_name": "rbd", 2023-08-01T19:56:14.639 INFO:teuthology.orchestra.run.smithi006.stdout: "create_time": "2023-08-01T19:53:57.404091+0000", 2023-08-01T19:56:14.639 INFO:teuthology.orchestra.run.smithi006.stdout: "flags": 1, 2023-08-01T19:56:14.639 INFO:teuthology.orchestra.run.smithi006.stdout: "flags_names": "hashpspool", 2023-08-01T19:56:14.639 INFO:teuthology.orchestra.run.smithi006.stdout: "type": 1, 2023-08-01T19:56:14.639 INFO:teuthology.orchestra.run.smithi006.stdout: "size": 2, 2023-08-01T19:56:14.640 INFO:teuthology.orchestra.run.smithi006.stdout: "min_size": 1, 2023-08-01T19:56:14.640 INFO:teuthology.orchestra.run.smithi006.stdout: "crush_rule": 0, 2023-08-01T19:56:14.640 INFO:teuthology.orchestra.run.smithi006.stdout: "peering_crush_bucket_count": 0, 2023-08-01T19:56:14.640 INFO:teuthology.orchestra.run.smithi006.stdout: "peering_crush_bucket_target": 0, 2023-08-01T19:56:14.640 INFO:teuthology.orchestra.run.smithi006.stdout: "peering_crush_bucket_barrier": 0, 2023-08-01T19:56:14.640 INFO:teuthology.orchestra.run.smithi006.stdout: "peering_crush_bucket_mandatory_member": 2147483647, 2023-08-01T19:56:14.640 INFO:teuthology.orchestra.run.smithi006.stdout: "object_hash": 2, 2023-08-01T19:56:14.640 INFO:teuthology.orchestra.run.smithi006.stdout: "pg_autoscale_mode": "off", 2023-08-01T19:56:14.641 INFO:teuthology.orchestra.run.smithi006.stdout: "pg_num": 8, 2023-08-01T19:56:14.641 INFO:teuthology.orchestra.run.smithi006.stdout: "pg_placement_num": 8, 2023-08-01T19:56:14.641 INFO:teuthology.orchestra.run.smithi006.stdout: "pg_placement_num_target": 8, 2023-08-01T19:56:14.641 INFO:teuthology.orchestra.run.smithi006.stdout: "pg_num_target": 8, 2023-08-01T19:56:14.641 INFO:teuthology.orchestra.run.smithi006.stdout: "pg_num_pending": 8, 2023-08-01T19:56:14.641 INFO:teuthology.orchestra.run.smithi006.stdout: "last_pg_merge_meta": { 2023-08-01T19:56:14.641 INFO:teuthology.orchestra.run.smithi006.stdout: "source_pgid": "0.0", 2023-08-01T19:56:14.641 INFO:teuthology.orchestra.run.smithi006.stdout: "ready_epoch": 0, 2023-08-01T19:56:14.642 INFO:teuthology.orchestra.run.smithi006.stdout: "last_epoch_started": 0, 2023-08-01T19:56:14.642 INFO:teuthology.orchestra.run.smithi006.stdout: "last_epoch_clean": 0, 2023-08-01T19:56:14.642 INFO:teuthology.orchestra.run.smithi006.stdout: "source_version": "0'0", 2023-08-01T19:56:14.642 INFO:teuthology.orchestra.run.smithi006.stdout: "target_version": "0'0" 2023-08-01T19:56:14.642 INFO:teuthology.orchestra.run.smithi006.stdout: }, 2023-08-01T19:56:14.642 INFO:teuthology.orchestra.run.smithi006.stdout: "last_change": "14", 2023-08-01T19:56:14.642 INFO:teuthology.orchestra.run.smithi006.stdout: "last_force_op_resend": "0", 2023-08-01T19:56:14.643 INFO:teuthology.orchestra.run.smithi006.stdout: "last_force_op_resend_prenautilus": "0", 2023-08-01T19:56:14.643 INFO:teuthology.orchestra.run.smithi006.stdout: "last_force_op_resend_preluminous": "0", 2023-08-01T19:56:14.643 INFO:teuthology.orchestra.run.smithi006.stdout: "auid": 0, 2023-08-01T19:56:14.643 INFO:teuthology.orchestra.run.smithi006.stdout: "snap_mode": "selfmanaged", 2023-08-01T19:56:14.643 INFO:teuthology.orchestra.run.smithi006.stdout: "snap_seq": 0, 2023-08-01T19:56:14.643 INFO:teuthology.orchestra.run.smithi006.stdout: "snap_epoch": 0, 2023-08-01T19:56:14.643 INFO:teuthology.orchestra.run.smithi006.stdout: "pool_snaps": [], 2023-08-01T19:56:14.643 INFO:teuthology.orchestra.run.smithi006.stdout: "removed_snaps": "[]", 2023-08-01T19:56:14.644 INFO:teuthology.orchestra.run.smithi006.stdout: "quota_max_bytes": 0, 2023-08-01T19:56:14.644 INFO:teuthology.orchestra.run.smithi006.stdout: "quota_max_objects": 0, 2023-08-01T19:56:14.644 INFO:teuthology.orchestra.run.smithi006.stdout: "tiers": [], 2023-08-01T19:56:14.644 INFO:teuthology.orchestra.run.smithi006.stdout: "tier_of": -1, 2023-08-01T19:56:14.644 INFO:teuthology.orchestra.run.smithi006.stdout: "read_tier": -1, 2023-08-01T19:56:14.644 INFO:teuthology.orchestra.run.smithi006.stdout: "write_tier": -1, 2023-08-01T19:56:14.644 INFO:teuthology.orchestra.run.smithi006.stdout: "cache_mode": "none", 2023-08-01T19:56:14.644 INFO:teuthology.orchestra.run.smithi006.stdout: "target_max_bytes": 0, 2023-08-01T19:56:14.645 INFO:teuthology.orchestra.run.smithi006.stdout: "target_max_objects": 0, 2023-08-01T19:56:14.645 INFO:teuthology.orchestra.run.smithi006.stdout: "cache_target_dirty_ratio_micro": 400000, 2023-08-01T19:56:14.645 INFO:teuthology.orchestra.run.smithi006.stdout: "cache_target_dirty_high_ratio_micro": 600000, 2023-08-01T19:56:14.645 INFO:teuthology.orchestra.run.smithi006.stdout: "cache_target_full_ratio_micro": 800000, 2023-08-01T19:56:14.645 INFO:teuthology.orchestra.run.smithi006.stdout: "cache_min_flush_age": 0, 2023-08-01T19:56:14.645 INFO:teuthology.orchestra.run.smithi006.stdout: "cache_min_evict_age": 0, 2023-08-01T19:56:14.645 INFO:teuthology.orchestra.run.smithi006.stdout: "erasure_code_profile": "", 2023-08-01T19:56:14.645 INFO:teuthology.orchestra.run.smithi006.stdout: "hit_set_params": { 2023-08-01T19:56:14.646 INFO:teuthology.orchestra.run.smithi006.stdout: "type": "none" 2023-08-01T19:56:14.646 INFO:teuthology.orchestra.run.smithi006.stdout: }, 2023-08-01T19:56:14.646 INFO:teuthology.orchestra.run.smithi006.stdout: "hit_set_period": 0, 2023-08-01T19:56:14.646 INFO:teuthology.orchestra.run.smithi006.stdout: "hit_set_count": 0, 2023-08-01T19:56:14.646 INFO:teuthology.orchestra.run.smithi006.stdout: "use_gmt_hitset": true, 2023-08-01T19:56:14.646 INFO:teuthology.orchestra.run.smithi006.stdout: "min_read_recency_for_promote": 0, 2023-08-01T19:56:14.646 INFO:teuthology.orchestra.run.smithi006.stdout: "min_write_recency_for_promote": 0, 2023-08-01T19:56:14.647 INFO:teuthology.orchestra.run.smithi006.stdout: "hit_set_grade_decay_rate": 0, 2023-08-01T19:56:14.647 INFO:teuthology.orchestra.run.smithi006.stdout: "hit_set_search_last_n": 0, 2023-08-01T19:56:14.647 INFO:teuthology.orchestra.run.smithi006.stdout: "grade_table": [], 2023-08-01T19:56:14.647 INFO:teuthology.orchestra.run.smithi006.stdout: "stripe_width": 0, 2023-08-01T19:56:14.647 INFO:teuthology.orchestra.run.smithi006.stdout: "expected_num_objects": 0, 2023-08-01T19:56:14.647 INFO:teuthology.orchestra.run.smithi006.stdout: "fast_read": false, 2023-08-01T19:56:14.647 INFO:teuthology.orchestra.run.smithi006.stdout: "options": {}, 2023-08-01T19:56:14.647 INFO:teuthology.orchestra.run.smithi006.stdout: "application_metadata": { 2023-08-01T19:56:14.648 INFO:teuthology.orchestra.run.smithi006.stdout: "rbd": {} 2023-08-01T19:56:14.648 INFO:teuthology.orchestra.run.smithi006.stdout: } 2023-08-01T19:56:14.648 INFO:teuthology.orchestra.run.smithi006.stdout: }, 2023-08-01T19:56:14.648 INFO:teuthology.orchestra.run.smithi006.stdout: { 2023-08-01T19:56:14.648 INFO:teuthology.orchestra.run.smithi006.stdout: "pool": 3, 2023-08-01T19:56:14.648 INFO:teuthology.orchestra.run.smithi006.stdout: "pool_name": "cephfs_metadata", 2023-08-01T19:56:14.648 INFO:teuthology.orchestra.run.smithi006.stdout: "create_time": "2023-08-01T19:54:02.111247+0000", 2023-08-01T19:56:14.648 INFO:teuthology.orchestra.run.smithi006.stdout: "flags": 1, 2023-08-01T19:56:14.649 INFO:teuthology.orchestra.run.smithi006.stdout: "flags_names": "hashpspool", 2023-08-01T19:56:14.649 INFO:teuthology.orchestra.run.smithi006.stdout: "type": 1, 2023-08-01T19:56:14.649 INFO:teuthology.orchestra.run.smithi006.stdout: "size": 2, 2023-08-01T19:56:14.649 INFO:teuthology.orchestra.run.smithi006.stdout: "min_size": 1, 2023-08-01T19:56:14.649 INFO:teuthology.orchestra.run.smithi006.stdout: "crush_rule": 0, 2023-08-01T19:56:14.649 INFO:teuthology.orchestra.run.smithi006.stdout: "peering_crush_bucket_count": 0, 2023-08-01T19:56:14.649 INFO:teuthology.orchestra.run.smithi006.stdout: "peering_crush_bucket_target": 0, 2023-08-01T19:56:14.649 INFO:teuthology.orchestra.run.smithi006.stdout: "peering_crush_bucket_barrier": 0, 2023-08-01T19:56:14.650 INFO:teuthology.orchestra.run.smithi006.stdout: "peering_crush_bucket_mandatory_member": 2147483647, 2023-08-01T19:56:14.650 INFO:teuthology.orchestra.run.smithi006.stdout: "object_hash": 2, 2023-08-01T19:56:14.650 INFO:teuthology.orchestra.run.smithi006.stdout: "pg_autoscale_mode": "off", 2023-08-01T19:56:14.650 INFO:teuthology.orchestra.run.smithi006.stdout: "pg_num": 32, 2023-08-01T19:56:14.650 INFO:teuthology.orchestra.run.smithi006.stdout: "pg_placement_num": 32, 2023-08-01T19:56:14.650 INFO:teuthology.orchestra.run.smithi006.stdout: "pg_placement_num_target": 32, 2023-08-01T19:56:14.650 INFO:teuthology.orchestra.run.smithi006.stdout: "pg_num_target": 32, 2023-08-01T19:56:14.650 INFO:teuthology.orchestra.run.smithi006.stdout: "pg_num_pending": 32, 2023-08-01T19:56:14.651 INFO:teuthology.orchestra.run.smithi006.stdout: "last_pg_merge_meta": { 2023-08-01T19:56:14.651 INFO:teuthology.orchestra.run.smithi006.stdout: "source_pgid": "0.0", 2023-08-01T19:56:14.651 INFO:teuthology.orchestra.run.smithi006.stdout: "ready_epoch": 0, 2023-08-01T19:56:14.651 INFO:teuthology.orchestra.run.smithi006.stdout: "last_epoch_started": 0, 2023-08-01T19:56:14.651 INFO:teuthology.orchestra.run.smithi006.stdout: "last_epoch_clean": 0, 2023-08-01T19:56:14.651 INFO:teuthology.orchestra.run.smithi006.stdout: "source_version": "0'0", 2023-08-01T19:56:14.651 INFO:teuthology.orchestra.run.smithi006.stdout: "target_version": "0'0" 2023-08-01T19:56:14.652 INFO:teuthology.orchestra.run.smithi006.stdout: }, 2023-08-01T19:56:14.652 INFO:teuthology.orchestra.run.smithi006.stdout: "last_change": "17", 2023-08-01T19:56:14.652 INFO:teuthology.orchestra.run.smithi006.stdout: "last_force_op_resend": "0", 2023-08-01T19:56:14.652 INFO:teuthology.orchestra.run.smithi006.stdout: "last_force_op_resend_prenautilus": "0", 2023-08-01T19:56:14.652 INFO:teuthology.orchestra.run.smithi006.stdout: "last_force_op_resend_preluminous": "0", 2023-08-01T19:56:14.652 INFO:teuthology.orchestra.run.smithi006.stdout: "auid": 0, 2023-08-01T19:56:14.652 INFO:teuthology.orchestra.run.smithi006.stdout: "snap_mode": "selfmanaged", 2023-08-01T19:56:14.652 INFO:teuthology.orchestra.run.smithi006.stdout: "snap_seq": 0, 2023-08-01T19:56:14.653 INFO:teuthology.orchestra.run.smithi006.stdout: "snap_epoch": 0, 2023-08-01T19:56:14.653 INFO:teuthology.orchestra.run.smithi006.stdout: "pool_snaps": [], 2023-08-01T19:56:14.653 INFO:teuthology.orchestra.run.smithi006.stdout: "removed_snaps": "[]", 2023-08-01T19:56:14.653 INFO:teuthology.orchestra.run.smithi006.stdout: "quota_max_bytes": 0, 2023-08-01T19:56:14.653 INFO:teuthology.orchestra.run.smithi006.stdout: "quota_max_objects": 0, 2023-08-01T19:56:14.653 INFO:teuthology.orchestra.run.smithi006.stdout: "tiers": [], 2023-08-01T19:56:14.653 INFO:teuthology.orchestra.run.smithi006.stdout: "tier_of": -1, 2023-08-01T19:56:14.653 INFO:teuthology.orchestra.run.smithi006.stdout: "read_tier": -1, 2023-08-01T19:56:14.654 INFO:teuthology.orchestra.run.smithi006.stdout: "write_tier": -1, 2023-08-01T19:56:14.654 INFO:teuthology.orchestra.run.smithi006.stdout: "cache_mode": "none", 2023-08-01T19:56:14.654 INFO:teuthology.orchestra.run.smithi006.stdout: "target_max_bytes": 0, 2023-08-01T19:56:14.654 INFO:teuthology.orchestra.run.smithi006.stdout: "target_max_objects": 0, 2023-08-01T19:56:14.654 INFO:teuthology.orchestra.run.smithi006.stdout: "cache_target_dirty_ratio_micro": 400000, 2023-08-01T19:56:14.654 INFO:teuthology.orchestra.run.smithi006.stdout: "cache_target_dirty_high_ratio_micro": 600000, 2023-08-01T19:56:14.654 INFO:teuthology.orchestra.run.smithi006.stdout: "cache_target_full_ratio_micro": 800000, 2023-08-01T19:56:14.654 INFO:teuthology.orchestra.run.smithi006.stdout: "cache_min_flush_age": 0, 2023-08-01T19:56:14.655 INFO:teuthology.orchestra.run.smithi006.stdout: "cache_min_evict_age": 0, 2023-08-01T19:56:14.655 INFO:teuthology.orchestra.run.smithi006.stdout: "erasure_code_profile": "", 2023-08-01T19:56:14.655 INFO:teuthology.orchestra.run.smithi006.stdout: "hit_set_params": { 2023-08-01T19:56:14.655 INFO:teuthology.orchestra.run.smithi006.stdout: "type": "none" 2023-08-01T19:56:14.655 INFO:teuthology.orchestra.run.smithi006.stdout: }, 2023-08-01T19:56:14.655 INFO:teuthology.orchestra.run.smithi006.stdout: "hit_set_period": 0, 2023-08-01T19:56:14.655 INFO:teuthology.orchestra.run.smithi006.stdout: "hit_set_count": 0, 2023-08-01T19:56:14.656 INFO:teuthology.orchestra.run.smithi006.stdout: "use_gmt_hitset": true, 2023-08-01T19:56:14.656 INFO:teuthology.orchestra.run.smithi006.stdout: "min_read_recency_for_promote": 0, 2023-08-01T19:56:14.656 INFO:teuthology.orchestra.run.smithi006.stdout: "min_write_recency_for_promote": 0, 2023-08-01T19:56:14.656 INFO:teuthology.orchestra.run.smithi006.stdout: "hit_set_grade_decay_rate": 0, 2023-08-01T19:56:14.656 INFO:teuthology.orchestra.run.smithi006.stdout: "hit_set_search_last_n": 0, 2023-08-01T19:56:14.656 INFO:teuthology.orchestra.run.smithi006.stdout: "grade_table": [], 2023-08-01T19:56:14.656 INFO:teuthology.orchestra.run.smithi006.stdout: "stripe_width": 0, 2023-08-01T19:56:14.656 INFO:teuthology.orchestra.run.smithi006.stdout: "expected_num_objects": 0, 2023-08-01T19:56:14.657 INFO:teuthology.orchestra.run.smithi006.stdout: "fast_read": false, 2023-08-01T19:56:14.657 INFO:teuthology.orchestra.run.smithi006.stdout: "options": { 2023-08-01T19:56:14.657 INFO:teuthology.orchestra.run.smithi006.stdout: "pg_autoscale_bias": 4, 2023-08-01T19:56:14.657 INFO:teuthology.orchestra.run.smithi006.stdout: "pg_num_min": 16, 2023-08-01T19:56:14.657 INFO:teuthology.orchestra.run.smithi006.stdout: "recovery_priority": 5 2023-08-01T19:56:14.657 INFO:teuthology.orchestra.run.smithi006.stdout: }, 2023-08-01T19:56:14.657 INFO:teuthology.orchestra.run.smithi006.stdout: "application_metadata": { 2023-08-01T19:56:14.657 INFO:teuthology.orchestra.run.smithi006.stdout: "cephfs": { 2023-08-01T19:56:14.658 INFO:teuthology.orchestra.run.smithi006.stdout: "metadata": "cephfs" 2023-08-01T19:56:14.658 INFO:teuthology.orchestra.run.smithi006.stdout: } 2023-08-01T19:56:14.658 INFO:teuthology.orchestra.run.smithi006.stdout: } 2023-08-01T19:56:14.658 INFO:teuthology.orchestra.run.smithi006.stdout: }, 2023-08-01T19:56:14.658 INFO:teuthology.orchestra.run.smithi006.stdout: { 2023-08-01T19:56:14.658 INFO:teuthology.orchestra.run.smithi006.stdout: "pool": 4, 2023-08-01T19:56:14.658 INFO:teuthology.orchestra.run.smithi006.stdout: "pool_name": "cephfs_data", 2023-08-01T19:56:14.658 INFO:teuthology.orchestra.run.smithi006.stdout: "create_time": "2023-08-01T19:54:03.430277+0000", 2023-08-01T19:56:14.659 INFO:teuthology.orchestra.run.smithi006.stdout: "flags": 1, 2023-08-01T19:56:14.659 INFO:teuthology.orchestra.run.smithi006.stdout: "flags_names": "hashpspool", 2023-08-01T19:56:14.659 INFO:teuthology.orchestra.run.smithi006.stdout: "type": 1, 2023-08-01T19:56:14.659 INFO:teuthology.orchestra.run.smithi006.stdout: "size": 2, 2023-08-01T19:56:14.659 INFO:teuthology.orchestra.run.smithi006.stdout: "min_size": 1, 2023-08-01T19:56:14.659 INFO:teuthology.orchestra.run.smithi006.stdout: "crush_rule": 0, 2023-08-01T19:56:14.659 INFO:teuthology.orchestra.run.smithi006.stdout: "peering_crush_bucket_count": 0, 2023-08-01T19:56:14.659 INFO:teuthology.orchestra.run.smithi006.stdout: "peering_crush_bucket_target": 0, 2023-08-01T19:56:14.660 INFO:teuthology.orchestra.run.smithi006.stdout: "peering_crush_bucket_barrier": 0, 2023-08-01T19:56:14.660 INFO:teuthology.orchestra.run.smithi006.stdout: "peering_crush_bucket_mandatory_member": 2147483647, 2023-08-01T19:56:14.660 INFO:teuthology.orchestra.run.smithi006.stdout: "object_hash": 2, 2023-08-01T19:56:14.660 INFO:teuthology.orchestra.run.smithi006.stdout: "pg_autoscale_mode": "off", 2023-08-01T19:56:14.660 INFO:teuthology.orchestra.run.smithi006.stdout: "pg_num": 64, 2023-08-01T19:56:14.660 INFO:teuthology.orchestra.run.smithi006.stdout: "pg_placement_num": 64, 2023-08-01T19:56:14.660 INFO:teuthology.orchestra.run.smithi006.stdout: "pg_placement_num_target": 64, 2023-08-01T19:56:14.661 INFO:teuthology.orchestra.run.smithi006.stdout: "pg_num_target": 64, 2023-08-01T19:56:14.661 INFO:teuthology.orchestra.run.smithi006.stdout: "pg_num_pending": 64, 2023-08-01T19:56:14.661 INFO:teuthology.orchestra.run.smithi006.stdout: "last_pg_merge_meta": { 2023-08-01T19:56:14.661 INFO:teuthology.orchestra.run.smithi006.stdout: "source_pgid": "0.0", 2023-08-01T19:56:14.661 INFO:teuthology.orchestra.run.smithi006.stdout: "ready_epoch": 0, 2023-08-01T19:56:14.661 INFO:teuthology.orchestra.run.smithi006.stdout: "last_epoch_started": 0, 2023-08-01T19:56:14.661 INFO:teuthology.orchestra.run.smithi006.stdout: "last_epoch_clean": 0, 2023-08-01T19:56:14.661 INFO:teuthology.orchestra.run.smithi006.stdout: "source_version": "0'0", 2023-08-01T19:56:14.662 INFO:teuthology.orchestra.run.smithi006.stdout: "target_version": "0'0" 2023-08-01T19:56:14.662 INFO:teuthology.orchestra.run.smithi006.stdout: }, 2023-08-01T19:56:14.662 INFO:teuthology.orchestra.run.smithi006.stdout: "last_change": "18", 2023-08-01T19:56:14.662 INFO:teuthology.orchestra.run.smithi006.stdout: "last_force_op_resend": "0", 2023-08-01T19:56:14.662 INFO:teuthology.orchestra.run.smithi006.stdout: "last_force_op_resend_prenautilus": "0", 2023-08-01T19:56:14.662 INFO:teuthology.orchestra.run.smithi006.stdout: "last_force_op_resend_preluminous": "0", 2023-08-01T19:56:14.662 INFO:teuthology.orchestra.run.smithi006.stdout: "auid": 0, 2023-08-01T19:56:14.662 INFO:teuthology.orchestra.run.smithi006.stdout: "snap_mode": "selfmanaged", 2023-08-01T19:56:14.663 INFO:teuthology.orchestra.run.smithi006.stdout: "snap_seq": 0, 2023-08-01T19:56:14.663 INFO:teuthology.orchestra.run.smithi006.stdout: "snap_epoch": 0, 2023-08-01T19:56:14.663 INFO:teuthology.orchestra.run.smithi006.stdout: "pool_snaps": [], 2023-08-01T19:56:14.663 INFO:teuthology.orchestra.run.smithi006.stdout: "removed_snaps": "[]", 2023-08-01T19:56:14.663 INFO:teuthology.orchestra.run.smithi006.stdout: "quota_max_bytes": 0, 2023-08-01T19:56:14.663 INFO:teuthology.orchestra.run.smithi006.stdout: "quota_max_objects": 0, 2023-08-01T19:56:14.663 INFO:teuthology.orchestra.run.smithi006.stdout: "tiers": [], 2023-08-01T19:56:14.663 INFO:teuthology.orchestra.run.smithi006.stdout: "tier_of": -1, 2023-08-01T19:56:14.664 INFO:teuthology.orchestra.run.smithi006.stdout: "read_tier": -1, 2023-08-01T19:56:14.664 INFO:teuthology.orchestra.run.smithi006.stdout: "write_tier": -1, 2023-08-01T19:56:14.664 INFO:teuthology.orchestra.run.smithi006.stdout: "cache_mode": "none", 2023-08-01T19:56:14.664 INFO:teuthology.orchestra.run.smithi006.stdout: "target_max_bytes": 0, 2023-08-01T19:56:14.664 INFO:teuthology.orchestra.run.smithi006.stdout: "target_max_objects": 0, 2023-08-01T19:56:14.664 INFO:teuthology.orchestra.run.smithi006.stdout: "cache_target_dirty_ratio_micro": 400000, 2023-08-01T19:56:14.664 INFO:teuthology.orchestra.run.smithi006.stdout: "cache_target_dirty_high_ratio_micro": 600000, 2023-08-01T19:56:14.665 INFO:teuthology.orchestra.run.smithi006.stdout: "cache_target_full_ratio_micro": 800000, 2023-08-01T19:56:14.665 INFO:teuthology.orchestra.run.smithi006.stdout: "cache_min_flush_age": 0, 2023-08-01T19:56:14.665 INFO:teuthology.orchestra.run.smithi006.stdout: "cache_min_evict_age": 0, 2023-08-01T19:56:14.665 INFO:teuthology.orchestra.run.smithi006.stdout: "erasure_code_profile": "", 2023-08-01T19:56:14.665 INFO:teuthology.orchestra.run.smithi006.stdout: "hit_set_params": { 2023-08-01T19:56:14.665 INFO:teuthology.orchestra.run.smithi006.stdout: "type": "none" 2023-08-01T19:56:14.665 INFO:teuthology.orchestra.run.smithi006.stdout: }, 2023-08-01T19:56:14.665 INFO:teuthology.orchestra.run.smithi006.stdout: "hit_set_period": 0, 2023-08-01T19:56:14.666 INFO:teuthology.orchestra.run.smithi006.stdout: "hit_set_count": 0, 2023-08-01T19:56:14.666 INFO:teuthology.orchestra.run.smithi006.stdout: "use_gmt_hitset": true, 2023-08-01T19:56:14.666 INFO:teuthology.orchestra.run.smithi006.stdout: "min_read_recency_for_promote": 0, 2023-08-01T19:56:14.666 INFO:teuthology.orchestra.run.smithi006.stdout: "min_write_recency_for_promote": 0, 2023-08-01T19:56:14.666 INFO:teuthology.orchestra.run.smithi006.stdout: "hit_set_grade_decay_rate": 0, 2023-08-01T19:56:14.666 INFO:teuthology.orchestra.run.smithi006.stdout: "hit_set_search_last_n": 0, 2023-08-01T19:56:14.666 INFO:teuthology.orchestra.run.smithi006.stdout: "grade_table": [], 2023-08-01T19:56:14.666 INFO:teuthology.orchestra.run.smithi006.stdout: "stripe_width": 0, 2023-08-01T19:56:14.667 INFO:teuthology.orchestra.run.smithi006.stdout: "expected_num_objects": 0, 2023-08-01T19:56:14.667 INFO:teuthology.orchestra.run.smithi006.stdout: "fast_read": false, 2023-08-01T19:56:14.667 INFO:teuthology.orchestra.run.smithi006.stdout: "options": { 2023-08-01T19:56:14.667 INFO:teuthology.orchestra.run.smithi006.stdout: "pg_num_min": 64, 2023-08-01T19:56:14.667 INFO:teuthology.orchestra.run.smithi006.stdout: "target_size_ratio": 0.89999997615814209 2023-08-01T19:56:14.667 INFO:teuthology.orchestra.run.smithi006.stdout: }, 2023-08-01T19:56:14.667 INFO:teuthology.orchestra.run.smithi006.stdout: "application_metadata": { 2023-08-01T19:56:14.668 INFO:teuthology.orchestra.run.smithi006.stdout: "cephfs": { 2023-08-01T19:56:14.668 INFO:teuthology.orchestra.run.smithi006.stdout: "data": "cephfs" 2023-08-01T19:56:14.668 INFO:teuthology.orchestra.run.smithi006.stdout: } 2023-08-01T19:56:14.668 INFO:teuthology.orchestra.run.smithi006.stdout: } 2023-08-01T19:56:14.668 INFO:teuthology.orchestra.run.smithi006.stdout: }, 2023-08-01T19:56:14.668 INFO:teuthology.orchestra.run.smithi006.stdout: { 2023-08-01T19:56:14.668 INFO:teuthology.orchestra.run.smithi006.stdout: "pool": 5, 2023-08-01T19:56:14.669 INFO:teuthology.orchestra.run.smithi006.stdout: "pool_name": "unique_pool_0", 2023-08-01T19:56:14.669 INFO:teuthology.orchestra.run.smithi006.stdout: "create_time": "2023-08-01T19:54:21.165668+0000", 2023-08-01T19:56:14.669 INFO:teuthology.orchestra.run.smithi006.stdout: "flags": 1, 2023-08-01T19:56:14.669 INFO:teuthology.orchestra.run.smithi006.stdout: "flags_names": "hashpspool", 2023-08-01T19:56:14.669 INFO:teuthology.orchestra.run.smithi006.stdout: "type": 1, 2023-08-01T19:56:14.669 INFO:teuthology.orchestra.run.smithi006.stdout: "size": 2, 2023-08-01T19:56:14.669 INFO:teuthology.orchestra.run.smithi006.stdout: "min_size": 1, 2023-08-01T19:56:14.670 INFO:teuthology.orchestra.run.smithi006.stdout: "crush_rule": 0, 2023-08-01T19:56:14.670 INFO:teuthology.orchestra.run.smithi006.stdout: "peering_crush_bucket_count": 0, 2023-08-01T19:56:14.670 INFO:teuthology.orchestra.run.smithi006.stdout: "peering_crush_bucket_target": 0, 2023-08-01T19:56:14.670 INFO:teuthology.orchestra.run.smithi006.stdout: "peering_crush_bucket_barrier": 0, 2023-08-01T19:56:14.670 INFO:teuthology.orchestra.run.smithi006.stdout: "peering_crush_bucket_mandatory_member": 2147483647, 2023-08-01T19:56:14.670 INFO:teuthology.orchestra.run.smithi006.stdout: "object_hash": 2, 2023-08-01T19:56:14.670 INFO:teuthology.orchestra.run.smithi006.stdout: "pg_autoscale_mode": "off", 2023-08-01T19:56:14.670 INFO:teuthology.orchestra.run.smithi006.stdout: "pg_num": 16, 2023-08-01T19:56:14.671 INFO:teuthology.orchestra.run.smithi006.stdout: "pg_placement_num": 16, 2023-08-01T19:56:14.671 INFO:teuthology.orchestra.run.smithi006.stdout: "pg_placement_num_target": 16, 2023-08-01T19:56:14.671 INFO:teuthology.orchestra.run.smithi006.stdout: "pg_num_target": 16, 2023-08-01T19:56:14.671 INFO:teuthology.orchestra.run.smithi006.stdout: "pg_num_pending": 16, 2023-08-01T19:56:14.671 INFO:teuthology.orchestra.run.smithi006.stdout: "last_pg_merge_meta": { 2023-08-01T19:56:14.671 INFO:teuthology.orchestra.run.smithi006.stdout: "source_pgid": "0.0", 2023-08-01T19:56:14.671 INFO:teuthology.orchestra.run.smithi006.stdout: "ready_epoch": 0, 2023-08-01T19:56:14.672 INFO:teuthology.orchestra.run.smithi006.stdout: "last_epoch_started": 0, 2023-08-01T19:56:14.672 INFO:teuthology.orchestra.run.smithi006.stdout: "last_epoch_clean": 0, 2023-08-01T19:56:14.672 INFO:teuthology.orchestra.run.smithi006.stdout: "source_version": "0'0", 2023-08-01T19:56:14.672 INFO:teuthology.orchestra.run.smithi006.stdout: "target_version": "0'0" 2023-08-01T19:56:14.672 INFO:teuthology.orchestra.run.smithi006.stdout: }, 2023-08-01T19:56:14.672 INFO:teuthology.orchestra.run.smithi006.stdout: "last_change": "21", 2023-08-01T19:56:14.672 INFO:teuthology.orchestra.run.smithi006.stdout: "last_force_op_resend": "0", 2023-08-01T19:56:14.672 INFO:teuthology.orchestra.run.smithi006.stdout: "last_force_op_resend_prenautilus": "0", 2023-08-01T19:56:14.673 INFO:teuthology.orchestra.run.smithi006.stdout: "last_force_op_resend_preluminous": "0", 2023-08-01T19:56:14.673 INFO:teuthology.orchestra.run.smithi006.stdout: "auid": 0, 2023-08-01T19:56:14.673 INFO:teuthology.orchestra.run.smithi006.stdout: "snap_mode": "selfmanaged", 2023-08-01T19:56:14.673 INFO:teuthology.orchestra.run.smithi006.stdout: "snap_seq": 0, 2023-08-01T19:56:14.673 INFO:teuthology.orchestra.run.smithi006.stdout: "snap_epoch": 0, 2023-08-01T19:56:14.673 INFO:teuthology.orchestra.run.smithi006.stdout: "pool_snaps": [], 2023-08-01T19:56:14.673 INFO:teuthology.orchestra.run.smithi006.stdout: "removed_snaps": "[]", 2023-08-01T19:56:14.673 INFO:teuthology.orchestra.run.smithi006.stdout: "quota_max_bytes": 0, 2023-08-01T19:56:14.674 INFO:teuthology.orchestra.run.smithi006.stdout: "quota_max_objects": 0, 2023-08-01T19:56:14.674 INFO:teuthology.orchestra.run.smithi006.stdout: "tiers": [], 2023-08-01T19:56:14.674 INFO:teuthology.orchestra.run.smithi006.stdout: "tier_of": -1, 2023-08-01T19:56:14.674 INFO:teuthology.orchestra.run.smithi006.stdout: "read_tier": -1, 2023-08-01T19:56:14.674 INFO:teuthology.orchestra.run.smithi006.stdout: "write_tier": -1, 2023-08-01T19:56:14.674 INFO:teuthology.orchestra.run.smithi006.stdout: "cache_mode": "none", 2023-08-01T19:56:14.674 INFO:teuthology.orchestra.run.smithi006.stdout: "target_max_bytes": 0, 2023-08-01T19:56:14.674 INFO:teuthology.orchestra.run.smithi006.stdout: "target_max_objects": 0, 2023-08-01T19:56:14.675 INFO:teuthology.orchestra.run.smithi006.stdout: "cache_target_dirty_ratio_micro": 400000, 2023-08-01T19:56:14.675 INFO:teuthology.orchestra.run.smithi006.stdout: "cache_target_dirty_high_ratio_micro": 600000, 2023-08-01T19:56:14.675 INFO:teuthology.orchestra.run.smithi006.stdout: "cache_target_full_ratio_micro": 800000, 2023-08-01T19:56:14.675 INFO:teuthology.orchestra.run.smithi006.stdout: "cache_min_flush_age": 0, 2023-08-01T19:56:14.675 INFO:teuthology.orchestra.run.smithi006.stdout: "cache_min_evict_age": 0, 2023-08-01T19:56:14.675 INFO:teuthology.orchestra.run.smithi006.stdout: "erasure_code_profile": "", 2023-08-01T19:56:14.675 INFO:teuthology.orchestra.run.smithi006.stdout: "hit_set_params": { 2023-08-01T19:56:14.676 INFO:teuthology.orchestra.run.smithi006.stdout: "type": "none" 2023-08-01T19:56:14.676 INFO:teuthology.orchestra.run.smithi006.stdout: }, 2023-08-01T19:56:14.676 INFO:teuthology.orchestra.run.smithi006.stdout: "hit_set_period": 0, 2023-08-01T19:56:14.676 INFO:teuthology.orchestra.run.smithi006.stdout: "hit_set_count": 0, 2023-08-01T19:56:14.676 INFO:teuthology.orchestra.run.smithi006.stdout: "use_gmt_hitset": true, 2023-08-01T19:56:14.676 INFO:teuthology.orchestra.run.smithi006.stdout: "min_read_recency_for_promote": 0, 2023-08-01T19:56:14.676 INFO:teuthology.orchestra.run.smithi006.stdout: "min_write_recency_for_promote": 0, 2023-08-01T19:56:14.676 INFO:teuthology.orchestra.run.smithi006.stdout: "hit_set_grade_decay_rate": 0, 2023-08-01T19:56:14.677 INFO:teuthology.orchestra.run.smithi006.stdout: "hit_set_search_last_n": 0, 2023-08-01T19:56:14.677 INFO:teuthology.orchestra.run.smithi006.stdout: "grade_table": [], 2023-08-01T19:56:14.677 INFO:teuthology.orchestra.run.smithi006.stdout: "stripe_width": 0, 2023-08-01T19:56:14.677 INFO:teuthology.orchestra.run.smithi006.stdout: "expected_num_objects": 0, 2023-08-01T19:56:14.677 INFO:teuthology.orchestra.run.smithi006.stdout: "fast_read": false, 2023-08-01T19:56:14.677 INFO:teuthology.orchestra.run.smithi006.stdout: "options": {}, 2023-08-01T19:56:14.677 INFO:teuthology.orchestra.run.smithi006.stdout: "application_metadata": { 2023-08-01T19:56:14.677 INFO:teuthology.orchestra.run.smithi006.stdout: "rados": {} 2023-08-01T19:56:14.678 INFO:teuthology.orchestra.run.smithi006.stdout: } 2023-08-01T19:56:14.678 INFO:teuthology.orchestra.run.smithi006.stdout: } 2023-08-01T19:56:14.678 INFO:teuthology.orchestra.run.smithi006.stdout: ], 2023-08-01T19:56:14.678 INFO:teuthology.orchestra.run.smithi006.stdout: "osds": [ 2023-08-01T19:56:14.678 INFO:teuthology.orchestra.run.smithi006.stdout: { 2023-08-01T19:56:14.678 INFO:teuthology.orchestra.run.smithi006.stdout: "osd": 0, 2023-08-01T19:56:14.678 INFO:teuthology.orchestra.run.smithi006.stdout: "uuid": "5dd675c7-2777-48f2-8009-ff0e0d4c7086", 2023-08-01T19:56:14.678 INFO:teuthology.orchestra.run.smithi006.stdout: "up": 1, 2023-08-01T19:56:14.679 INFO:teuthology.orchestra.run.smithi006.stdout: "in": 1, 2023-08-01T19:56:14.679 INFO:teuthology.orchestra.run.smithi006.stdout: "weight": 1, 2023-08-01T19:56:14.679 INFO:teuthology.orchestra.run.smithi006.stdout: "primary_affinity": 0.822052001953125, 2023-08-01T19:56:14.679 INFO:teuthology.orchestra.run.smithi006.stdout: "last_clean_begin": 0, 2023-08-01T19:56:14.679 INFO:teuthology.orchestra.run.smithi006.stdout: "last_clean_end": 0, 2023-08-01T19:56:14.679 INFO:teuthology.orchestra.run.smithi006.stdout: "up_from": 8, 2023-08-01T19:56:14.679 INFO:teuthology.orchestra.run.smithi006.stdout: "up_thru": 62, 2023-08-01T19:56:14.679 INFO:teuthology.orchestra.run.smithi006.stdout: "down_at": 0, 2023-08-01T19:56:14.680 INFO:teuthology.orchestra.run.smithi006.stdout: "lost_at": 0, 2023-08-01T19:56:14.680 INFO:teuthology.orchestra.run.smithi006.stdout: "public_addrs": { 2023-08-01T19:56:14.680 INFO:teuthology.orchestra.run.smithi006.stdout: "addrvec": [ 2023-08-01T19:56:14.680 INFO:teuthology.orchestra.run.smithi006.stdout: { 2023-08-01T19:56:14.680 INFO:teuthology.orchestra.run.smithi006.stdout: "type": "v2", 2023-08-01T19:56:14.680 INFO:teuthology.orchestra.run.smithi006.stdout: "addr": "172.21.15.8:6800", 2023-08-01T19:56:14.680 INFO:teuthology.orchestra.run.smithi006.stdout: "nonce": 111181 2023-08-01T19:56:14.681 INFO:teuthology.orchestra.run.smithi006.stdout: }, 2023-08-01T19:56:14.681 INFO:teuthology.orchestra.run.smithi006.stdout: { 2023-08-01T19:56:14.681 INFO:teuthology.orchestra.run.smithi006.stdout: "type": "v1", 2023-08-01T19:56:14.681 INFO:teuthology.orchestra.run.smithi006.stdout: "addr": "172.21.15.8:6801", 2023-08-01T19:56:14.681 INFO:teuthology.orchestra.run.smithi006.stdout: "nonce": 111181 2023-08-01T19:56:14.681 INFO:teuthology.orchestra.run.smithi006.stdout: } 2023-08-01T19:56:14.681 INFO:teuthology.orchestra.run.smithi006.stdout: ] 2023-08-01T19:56:14.681 INFO:teuthology.orchestra.run.smithi006.stdout: }, 2023-08-01T19:56:14.682 INFO:teuthology.orchestra.run.smithi006.stdout: "cluster_addrs": { 2023-08-01T19:56:14.682 INFO:teuthology.orchestra.run.smithi006.stdout: "addrvec": [ 2023-08-01T19:56:14.682 INFO:teuthology.orchestra.run.smithi006.stdout: { 2023-08-01T19:56:14.682 INFO:teuthology.orchestra.run.smithi006.stdout: "type": "v2", 2023-08-01T19:56:14.682 INFO:teuthology.orchestra.run.smithi006.stdout: "addr": "172.21.15.8:6802", 2023-08-01T19:56:14.682 INFO:teuthology.orchestra.run.smithi006.stdout: "nonce": 111181 2023-08-01T19:56:14.682 INFO:teuthology.orchestra.run.smithi006.stdout: }, 2023-08-01T19:56:14.682 INFO:teuthology.orchestra.run.smithi006.stdout: { 2023-08-01T19:56:14.683 INFO:teuthology.orchestra.run.smithi006.stdout: "type": "v1", 2023-08-01T19:56:14.683 INFO:teuthology.orchestra.run.smithi006.stdout: "addr": "172.21.15.8:6803", 2023-08-01T19:56:14.683 INFO:teuthology.orchestra.run.smithi006.stdout: "nonce": 111181 2023-08-01T19:56:14.683 INFO:teuthology.orchestra.run.smithi006.stdout: } 2023-08-01T19:56:14.683 INFO:teuthology.orchestra.run.smithi006.stdout: ] 2023-08-01T19:56:14.683 INFO:teuthology.orchestra.run.smithi006.stdout: }, 2023-08-01T19:56:14.683 INFO:teuthology.orchestra.run.smithi006.stdout: "heartbeat_back_addrs": { 2023-08-01T19:56:14.683 INFO:teuthology.orchestra.run.smithi006.stdout: "addrvec": [ 2023-08-01T19:56:14.684 INFO:teuthology.orchestra.run.smithi006.stdout: { 2023-08-01T19:56:14.684 INFO:teuthology.orchestra.run.smithi006.stdout: "type": "v2", 2023-08-01T19:56:14.684 INFO:teuthology.orchestra.run.smithi006.stdout: "addr": "172.21.15.8:6806", 2023-08-01T19:56:14.684 INFO:teuthology.orchestra.run.smithi006.stdout: "nonce": 111181 2023-08-01T19:56:14.684 INFO:teuthology.orchestra.run.smithi006.stdout: }, 2023-08-01T19:56:14.684 INFO:teuthology.orchestra.run.smithi006.stdout: { 2023-08-01T19:56:14.684 INFO:teuthology.orchestra.run.smithi006.stdout: "type": "v1", 2023-08-01T19:56:14.685 INFO:teuthology.orchestra.run.smithi006.stdout: "addr": "172.21.15.8:6807", 2023-08-01T19:56:14.685 INFO:teuthology.orchestra.run.smithi006.stdout: "nonce": 111181 2023-08-01T19:56:14.685 INFO:teuthology.orchestra.run.smithi006.stdout: } 2023-08-01T19:56:14.685 INFO:teuthology.orchestra.run.smithi006.stdout: ] 2023-08-01T19:56:14.685 INFO:teuthology.orchestra.run.smithi006.stdout: }, 2023-08-01T19:56:14.685 INFO:teuthology.orchestra.run.smithi006.stdout: "heartbeat_front_addrs": { 2023-08-01T19:56:14.685 INFO:teuthology.orchestra.run.smithi006.stdout: "addrvec": [ 2023-08-01T19:56:14.685 INFO:teuthology.orchestra.run.smithi006.stdout: { 2023-08-01T19:56:14.686 INFO:teuthology.orchestra.run.smithi006.stdout: "type": "v2", 2023-08-01T19:56:14.686 INFO:teuthology.orchestra.run.smithi006.stdout: "addr": "172.21.15.8:6804", 2023-08-01T19:56:14.686 INFO:teuthology.orchestra.run.smithi006.stdout: "nonce": 111181 2023-08-01T19:56:14.686 INFO:teuthology.orchestra.run.smithi006.stdout: }, 2023-08-01T19:56:14.686 INFO:teuthology.orchestra.run.smithi006.stdout: { 2023-08-01T19:56:14.686 INFO:teuthology.orchestra.run.smithi006.stdout: "type": "v1", 2023-08-01T19:56:14.686 INFO:teuthology.orchestra.run.smithi006.stdout: "addr": "172.21.15.8:6805", 2023-08-01T19:56:14.686 INFO:teuthology.orchestra.run.smithi006.stdout: "nonce": 111181 2023-08-01T19:56:14.687 INFO:teuthology.orchestra.run.smithi006.stdout: } 2023-08-01T19:56:14.687 INFO:teuthology.orchestra.run.smithi006.stdout: ] 2023-08-01T19:56:14.687 INFO:teuthology.orchestra.run.smithi006.stdout: }, 2023-08-01T19:56:14.687 INFO:teuthology.orchestra.run.smithi006.stdout: "public_addr": "172.21.15.8:6801/111181", 2023-08-01T19:56:14.687 INFO:teuthology.orchestra.run.smithi006.stdout: "cluster_addr": "172.21.15.8:6803/111181", 2023-08-01T19:56:14.687 INFO:teuthology.orchestra.run.smithi006.stdout: "heartbeat_back_addr": "172.21.15.8:6807/111181", 2023-08-01T19:56:14.687 INFO:teuthology.orchestra.run.smithi006.stdout: "heartbeat_front_addr": "172.21.15.8:6805/111181", 2023-08-01T19:56:14.687 INFO:teuthology.orchestra.run.smithi006.stdout: "state": [ 2023-08-01T19:56:14.688 INFO:teuthology.orchestra.run.smithi006.stdout: "exists", 2023-08-01T19:56:14.688 INFO:teuthology.orchestra.run.smithi006.stdout: "up" 2023-08-01T19:56:14.688 INFO:teuthology.orchestra.run.smithi006.stdout: ] 2023-08-01T19:56:14.688 INFO:teuthology.orchestra.run.smithi006.stdout: }, 2023-08-01T19:56:14.688 INFO:teuthology.orchestra.run.smithi006.stdout: { 2023-08-01T19:56:14.688 INFO:teuthology.orchestra.run.smithi006.stdout: "osd": 1, 2023-08-01T19:56:14.688 INFO:teuthology.orchestra.run.smithi006.stdout: "uuid": "7fc612c4-33ba-4a33-bca8-1f42ee8ed548", 2023-08-01T19:56:14.689 INFO:teuthology.orchestra.run.smithi006.stdout: "up": 0, 2023-08-01T19:56:14.689 INFO:teuthology.orchestra.run.smithi006.stdout: "in": 1, 2023-08-01T19:56:14.689 INFO:teuthology.orchestra.run.smithi006.stdout: "weight": 1, 2023-08-01T19:56:14.689 INFO:teuthology.orchestra.run.smithi006.stdout: "primary_affinity": 0.3376312255859375, 2023-08-01T19:56:14.689 INFO:teuthology.orchestra.run.smithi006.stdout: "last_clean_begin": 0, 2023-08-01T19:56:14.689 INFO:teuthology.orchestra.run.smithi006.stdout: "last_clean_end": 0, 2023-08-01T19:56:14.689 INFO:teuthology.orchestra.run.smithi006.stdout: "up_from": 8, 2023-08-01T19:56:14.689 INFO:teuthology.orchestra.run.smithi006.stdout: "up_thru": 53, 2023-08-01T19:56:14.690 INFO:teuthology.orchestra.run.smithi006.stdout: "down_at": 62, 2023-08-01T19:56:14.690 INFO:teuthology.orchestra.run.smithi006.stdout: "lost_at": 0, 2023-08-01T19:56:14.690 INFO:teuthology.orchestra.run.smithi006.stdout: "public_addrs": { 2023-08-01T19:56:14.690 INFO:teuthology.orchestra.run.smithi006.stdout: "addrvec": [ 2023-08-01T19:56:14.690 INFO:teuthology.orchestra.run.smithi006.stdout: { 2023-08-01T19:56:14.690 INFO:teuthology.orchestra.run.smithi006.stdout: "type": "v2", 2023-08-01T19:56:14.690 INFO:teuthology.orchestra.run.smithi006.stdout: "addr": "172.21.15.101:6800", 2023-08-01T19:56:14.690 INFO:teuthology.orchestra.run.smithi006.stdout: "nonce": 111143 2023-08-01T19:56:14.691 INFO:teuthology.orchestra.run.smithi006.stdout: }, 2023-08-01T19:56:14.691 INFO:teuthology.orchestra.run.smithi006.stdout: { 2023-08-01T19:56:14.691 INFO:teuthology.orchestra.run.smithi006.stdout: "type": "v1", 2023-08-01T19:56:14.691 INFO:teuthology.orchestra.run.smithi006.stdout: "addr": "172.21.15.101:6801", 2023-08-01T19:56:14.691 INFO:teuthology.orchestra.run.smithi006.stdout: "nonce": 111143 2023-08-01T19:56:14.691 INFO:teuthology.orchestra.run.smithi006.stdout: } 2023-08-01T19:56:14.691 INFO:teuthology.orchestra.run.smithi006.stdout: ] 2023-08-01T19:56:14.691 INFO:teuthology.orchestra.run.smithi006.stdout: }, 2023-08-01T19:56:14.692 INFO:teuthology.orchestra.run.smithi006.stdout: "cluster_addrs": { 2023-08-01T19:56:14.692 INFO:teuthology.orchestra.run.smithi006.stdout: "addrvec": [ 2023-08-01T19:56:14.692 INFO:teuthology.orchestra.run.smithi006.stdout: { 2023-08-01T19:56:14.692 INFO:teuthology.orchestra.run.smithi006.stdout: "type": "v2", 2023-08-01T19:56:14.692 INFO:teuthology.orchestra.run.smithi006.stdout: "addr": "172.21.15.101:6802", 2023-08-01T19:56:14.692 INFO:teuthology.orchestra.run.smithi006.stdout: "nonce": 111143 2023-08-01T19:56:14.692 INFO:teuthology.orchestra.run.smithi006.stdout: }, 2023-08-01T19:56:14.692 INFO:teuthology.orchestra.run.smithi006.stdout: { 2023-08-01T19:56:14.693 INFO:teuthology.orchestra.run.smithi006.stdout: "type": "v1", 2023-08-01T19:56:14.693 INFO:teuthology.orchestra.run.smithi006.stdout: "addr": "172.21.15.101:6803", 2023-08-01T19:56:14.693 INFO:teuthology.orchestra.run.smithi006.stdout: "nonce": 111143 2023-08-01T19:56:14.693 INFO:teuthology.orchestra.run.smithi006.stdout: } 2023-08-01T19:56:14.693 INFO:teuthology.orchestra.run.smithi006.stdout: ] 2023-08-01T19:56:14.693 INFO:teuthology.orchestra.run.smithi006.stdout: }, 2023-08-01T19:56:14.693 INFO:teuthology.orchestra.run.smithi006.stdout: "heartbeat_back_addrs": { 2023-08-01T19:56:14.694 INFO:teuthology.orchestra.run.smithi006.stdout: "addrvec": [ 2023-08-01T19:56:14.694 INFO:teuthology.orchestra.run.smithi006.stdout: { 2023-08-01T19:56:14.694 INFO:teuthology.orchestra.run.smithi006.stdout: "type": "v2", 2023-08-01T19:56:14.694 INFO:teuthology.orchestra.run.smithi006.stdout: "addr": "172.21.15.101:6806", 2023-08-01T19:56:14.694 INFO:teuthology.orchestra.run.smithi006.stdout: "nonce": 111143 2023-08-01T19:56:14.694 INFO:teuthology.orchestra.run.smithi006.stdout: }, 2023-08-01T19:56:14.694 INFO:teuthology.orchestra.run.smithi006.stdout: { 2023-08-01T19:56:14.694 INFO:teuthology.orchestra.run.smithi006.stdout: "type": "v1", 2023-08-01T19:56:14.695 INFO:teuthology.orchestra.run.smithi006.stdout: "addr": "172.21.15.101:6807", 2023-08-01T19:56:14.695 INFO:teuthology.orchestra.run.smithi006.stdout: "nonce": 111143 2023-08-01T19:56:14.695 INFO:teuthology.orchestra.run.smithi006.stdout: } 2023-08-01T19:56:14.695 INFO:teuthology.orchestra.run.smithi006.stdout: ] 2023-08-01T19:56:14.695 INFO:teuthology.orchestra.run.smithi006.stdout: }, 2023-08-01T19:56:14.695 INFO:teuthology.orchestra.run.smithi006.stdout: "heartbeat_front_addrs": { 2023-08-01T19:56:14.695 INFO:teuthology.orchestra.run.smithi006.stdout: "addrvec": [ 2023-08-01T19:56:14.695 INFO:teuthology.orchestra.run.smithi006.stdout: { 2023-08-01T19:56:14.696 INFO:teuthology.orchestra.run.smithi006.stdout: "type": "v2", 2023-08-01T19:56:14.696 INFO:teuthology.orchestra.run.smithi006.stdout: "addr": "172.21.15.101:6804", 2023-08-01T19:56:14.696 INFO:teuthology.orchestra.run.smithi006.stdout: "nonce": 111143 2023-08-01T19:56:14.696 INFO:teuthology.orchestra.run.smithi006.stdout: }, 2023-08-01T19:56:14.696 INFO:teuthology.orchestra.run.smithi006.stdout: { 2023-08-01T19:56:14.696 INFO:teuthology.orchestra.run.smithi006.stdout: "type": "v1", 2023-08-01T19:56:14.696 INFO:teuthology.orchestra.run.smithi006.stdout: "addr": "172.21.15.101:6805", 2023-08-01T19:56:14.696 INFO:teuthology.orchestra.run.smithi006.stdout: "nonce": 111143 2023-08-01T19:56:14.697 INFO:teuthology.orchestra.run.smithi006.stdout: } 2023-08-01T19:56:14.697 INFO:teuthology.orchestra.run.smithi006.stdout: ] 2023-08-01T19:56:14.697 INFO:teuthology.orchestra.run.smithi006.stdout: }, 2023-08-01T19:56:14.697 INFO:teuthology.orchestra.run.smithi006.stdout: "public_addr": "172.21.15.101:6801/111143", 2023-08-01T19:56:14.697 INFO:teuthology.orchestra.run.smithi006.stdout: "cluster_addr": "172.21.15.101:6803/111143", 2023-08-01T19:56:14.697 INFO:teuthology.orchestra.run.smithi006.stdout: "heartbeat_back_addr": "172.21.15.101:6807/111143", 2023-08-01T19:56:14.697 INFO:teuthology.orchestra.run.smithi006.stdout: "heartbeat_front_addr": "172.21.15.101:6805/111143", 2023-08-01T19:56:14.697 INFO:teuthology.orchestra.run.smithi006.stdout: "state": [ 2023-08-01T19:56:14.698 INFO:teuthology.orchestra.run.smithi006.stdout: "exists" 2023-08-01T19:56:14.698 INFO:teuthology.orchestra.run.smithi006.stdout: ] 2023-08-01T19:56:14.698 INFO:teuthology.orchestra.run.smithi006.stdout: }, 2023-08-01T19:56:14.698 INFO:teuthology.orchestra.run.smithi006.stdout: { 2023-08-01T19:56:14.698 INFO:teuthology.orchestra.run.smithi006.stdout: "osd": 2, 2023-08-01T19:56:14.698 INFO:teuthology.orchestra.run.smithi006.stdout: "uuid": "f85cadbc-4230-4772-8f39-62ed52e220b1", 2023-08-01T19:56:14.698 INFO:teuthology.orchestra.run.smithi006.stdout: "up": 1, 2023-08-01T19:56:14.698 INFO:teuthology.orchestra.run.smithi006.stdout: "in": 1, 2023-08-01T19:56:14.699 INFO:teuthology.orchestra.run.smithi006.stdout: "weight": 1, 2023-08-01T19:56:14.699 INFO:teuthology.orchestra.run.smithi006.stdout: "primary_affinity": 1, 2023-08-01T19:56:14.699 INFO:teuthology.orchestra.run.smithi006.stdout: "last_clean_begin": 0, 2023-08-01T19:56:14.699 INFO:teuthology.orchestra.run.smithi006.stdout: "last_clean_end": 0, 2023-08-01T19:56:14.699 INFO:teuthology.orchestra.run.smithi006.stdout: "up_from": 9, 2023-08-01T19:56:14.699 INFO:teuthology.orchestra.run.smithi006.stdout: "up_thru": 62, 2023-08-01T19:56:14.699 INFO:teuthology.orchestra.run.smithi006.stdout: "down_at": 0, 2023-08-01T19:56:14.699 INFO:teuthology.orchestra.run.smithi006.stdout: "lost_at": 0, 2023-08-01T19:56:14.700 INFO:teuthology.orchestra.run.smithi006.stdout: "public_addrs": { 2023-08-01T19:56:14.700 INFO:teuthology.orchestra.run.smithi006.stdout: "addrvec": [ 2023-08-01T19:56:14.700 INFO:teuthology.orchestra.run.smithi006.stdout: { 2023-08-01T19:56:14.700 INFO:teuthology.orchestra.run.smithi006.stdout: "type": "v2", 2023-08-01T19:56:14.700 INFO:teuthology.orchestra.run.smithi006.stdout: "addr": "172.21.15.155:6800", 2023-08-01T19:56:14.700 INFO:teuthology.orchestra.run.smithi006.stdout: "nonce": 111339 2023-08-01T19:56:14.700 INFO:teuthology.orchestra.run.smithi006.stdout: }, 2023-08-01T19:56:14.701 INFO:teuthology.orchestra.run.smithi006.stdout: { 2023-08-01T19:56:14.701 INFO:teuthology.orchestra.run.smithi006.stdout: "type": "v1", 2023-08-01T19:56:14.701 INFO:teuthology.orchestra.run.smithi006.stdout: "addr": "172.21.15.155:6801", 2023-08-01T19:56:14.701 INFO:teuthology.orchestra.run.smithi006.stdout: "nonce": 111339 2023-08-01T19:56:14.701 INFO:teuthology.orchestra.run.smithi006.stdout: } 2023-08-01T19:56:14.701 INFO:teuthology.orchestra.run.smithi006.stdout: ] 2023-08-01T19:56:14.701 INFO:teuthology.orchestra.run.smithi006.stdout: }, 2023-08-01T19:56:14.701 INFO:teuthology.orchestra.run.smithi006.stdout: "cluster_addrs": { 2023-08-01T19:56:14.702 INFO:teuthology.orchestra.run.smithi006.stdout: "addrvec": [ 2023-08-01T19:56:14.702 INFO:teuthology.orchestra.run.smithi006.stdout: { 2023-08-01T19:56:14.702 INFO:teuthology.orchestra.run.smithi006.stdout: "type": "v2", 2023-08-01T19:56:14.702 INFO:teuthology.orchestra.run.smithi006.stdout: "addr": "172.21.15.155:6802", 2023-08-01T19:56:14.702 INFO:teuthology.orchestra.run.smithi006.stdout: "nonce": 111339 2023-08-01T19:56:14.702 INFO:teuthology.orchestra.run.smithi006.stdout: }, 2023-08-01T19:56:14.702 INFO:teuthology.orchestra.run.smithi006.stdout: { 2023-08-01T19:56:14.702 INFO:teuthology.orchestra.run.smithi006.stdout: "type": "v1", 2023-08-01T19:56:14.703 INFO:teuthology.orchestra.run.smithi006.stdout: "addr": "172.21.15.155:6803", 2023-08-01T19:56:14.703 INFO:teuthology.orchestra.run.smithi006.stdout: "nonce": 111339 2023-08-01T19:56:14.703 INFO:teuthology.orchestra.run.smithi006.stdout: } 2023-08-01T19:56:14.703 INFO:teuthology.orchestra.run.smithi006.stdout: ] 2023-08-01T19:56:14.703 INFO:teuthology.orchestra.run.smithi006.stdout: }, 2023-08-01T19:56:14.703 INFO:teuthology.orchestra.run.smithi006.stdout: "heartbeat_back_addrs": { 2023-08-01T19:56:14.703 INFO:teuthology.orchestra.run.smithi006.stdout: "addrvec": [ 2023-08-01T19:56:14.703 INFO:teuthology.orchestra.run.smithi006.stdout: { 2023-08-01T19:56:14.704 INFO:teuthology.orchestra.run.smithi006.stdout: "type": "v2", 2023-08-01T19:56:14.704 INFO:teuthology.orchestra.run.smithi006.stdout: "addr": "172.21.15.155:6806", 2023-08-01T19:56:14.704 INFO:teuthology.orchestra.run.smithi006.stdout: "nonce": 111339 2023-08-01T19:56:14.704 INFO:teuthology.orchestra.run.smithi006.stdout: }, 2023-08-01T19:56:14.704 INFO:teuthology.orchestra.run.smithi006.stdout: { 2023-08-01T19:56:14.704 INFO:teuthology.orchestra.run.smithi006.stdout: "type": "v1", 2023-08-01T19:56:14.704 INFO:teuthology.orchestra.run.smithi006.stdout: "addr": "172.21.15.155:6807", 2023-08-01T19:56:14.704 INFO:teuthology.orchestra.run.smithi006.stdout: "nonce": 111339 2023-08-01T19:56:14.705 INFO:teuthology.orchestra.run.smithi006.stdout: } 2023-08-01T19:56:14.705 INFO:teuthology.orchestra.run.smithi006.stdout: ] 2023-08-01T19:56:14.705 INFO:teuthology.orchestra.run.smithi006.stdout: }, 2023-08-01T19:56:14.705 INFO:teuthology.orchestra.run.smithi006.stdout: "heartbeat_front_addrs": { 2023-08-01T19:56:14.705 INFO:teuthology.orchestra.run.smithi006.stdout: "addrvec": [ 2023-08-01T19:56:14.705 INFO:teuthology.orchestra.run.smithi006.stdout: { 2023-08-01T19:56:14.705 INFO:teuthology.orchestra.run.smithi006.stdout: "type": "v2", 2023-08-01T19:56:14.705 INFO:teuthology.orchestra.run.smithi006.stdout: "addr": "172.21.15.155:6804", 2023-08-01T19:56:14.706 INFO:teuthology.orchestra.run.smithi006.stdout: "nonce": 111339 2023-08-01T19:56:14.706 INFO:teuthology.orchestra.run.smithi006.stdout: }, 2023-08-01T19:56:14.706 INFO:teuthology.orchestra.run.smithi006.stdout: { 2023-08-01T19:56:14.706 INFO:teuthology.orchestra.run.smithi006.stdout: "type": "v1", 2023-08-01T19:56:14.706 INFO:teuthology.orchestra.run.smithi006.stdout: "addr": "172.21.15.155:6805", 2023-08-01T19:56:14.706 INFO:teuthology.orchestra.run.smithi006.stdout: "nonce": 111339 2023-08-01T19:56:14.706 INFO:teuthology.orchestra.run.smithi006.stdout: } 2023-08-01T19:56:14.707 INFO:teuthology.orchestra.run.smithi006.stdout: ] 2023-08-01T19:56:14.707 INFO:teuthology.orchestra.run.smithi006.stdout: }, 2023-08-01T19:56:14.707 INFO:teuthology.orchestra.run.smithi006.stdout: "public_addr": "172.21.15.155:6801/111339", 2023-08-01T19:56:14.707 INFO:teuthology.orchestra.run.smithi006.stdout: "cluster_addr": "172.21.15.155:6803/111339", 2023-08-01T19:56:14.707 INFO:teuthology.orchestra.run.smithi006.stdout: "heartbeat_back_addr": "172.21.15.155:6807/111339", 2023-08-01T19:56:14.707 INFO:teuthology.orchestra.run.smithi006.stdout: "heartbeat_front_addr": "172.21.15.155:6805/111339", 2023-08-01T19:56:14.707 INFO:teuthology.orchestra.run.smithi006.stdout: "state": [ 2023-08-01T19:56:14.707 INFO:teuthology.orchestra.run.smithi006.stdout: "exists", 2023-08-01T19:56:14.708 INFO:teuthology.orchestra.run.smithi006.stdout: "up" 2023-08-01T19:56:14.708 INFO:teuthology.orchestra.run.smithi006.stdout: ] 2023-08-01T19:56:14.708 INFO:teuthology.orchestra.run.smithi006.stdout: } 2023-08-01T19:56:14.708 INFO:teuthology.orchestra.run.smithi006.stdout: ], 2023-08-01T19:56:14.708 INFO:teuthology.orchestra.run.smithi006.stdout: "osd_xinfo": [ 2023-08-01T19:56:14.708 INFO:teuthology.orchestra.run.smithi006.stdout: { 2023-08-01T19:56:14.708 INFO:teuthology.orchestra.run.smithi006.stdout: "osd": 0, 2023-08-01T19:56:14.708 INFO:teuthology.orchestra.run.smithi006.stdout: "down_stamp": "0.000000", 2023-08-01T19:56:14.709 INFO:teuthology.orchestra.run.smithi006.stdout: "laggy_probability": 0, 2023-08-01T19:56:14.709 INFO:teuthology.orchestra.run.smithi006.stdout: "laggy_interval": 0, 2023-08-01T19:56:14.709 INFO:teuthology.orchestra.run.smithi006.stdout: "features": 4540138320759226367, 2023-08-01T19:56:14.709 INFO:teuthology.orchestra.run.smithi006.stdout: "old_weight": 0, 2023-08-01T19:56:14.709 INFO:teuthology.orchestra.run.smithi006.stdout: "last_purged_snaps_scrub": "2023-08-01T19:53:48.018154+0000", 2023-08-01T19:56:14.709 INFO:teuthology.orchestra.run.smithi006.stdout: "dead_epoch": 0 2023-08-01T19:56:14.709 INFO:teuthology.orchestra.run.smithi006.stdout: }, 2023-08-01T19:56:14.709 INFO:teuthology.orchestra.run.smithi006.stdout: { 2023-08-01T19:56:14.710 INFO:teuthology.orchestra.run.smithi006.stdout: "osd": 1, 2023-08-01T19:56:14.710 INFO:teuthology.orchestra.run.smithi006.stdout: "down_stamp": "0.000000", 2023-08-01T19:56:14.710 INFO:teuthology.orchestra.run.smithi006.stdout: "laggy_probability": 0, 2023-08-01T19:56:14.710 INFO:teuthology.orchestra.run.smithi006.stdout: "laggy_interval": 0, 2023-08-01T19:56:14.710 INFO:teuthology.orchestra.run.smithi006.stdout: "features": 4540138320759226367, 2023-08-01T19:56:14.710 INFO:teuthology.orchestra.run.smithi006.stdout: "old_weight": 0, 2023-08-01T19:56:14.710 INFO:teuthology.orchestra.run.smithi006.stdout: "last_purged_snaps_scrub": "2023-08-01T19:53:48.000488+0000", 2023-08-01T19:56:14.710 INFO:teuthology.orchestra.run.smithi006.stdout: "dead_epoch": 61 2023-08-01T19:56:14.711 INFO:teuthology.orchestra.run.smithi006.stdout: }, 2023-08-01T19:56:14.711 INFO:teuthology.orchestra.run.smithi006.stdout: { 2023-08-01T19:56:14.711 INFO:teuthology.orchestra.run.smithi006.stdout: "osd": 2, 2023-08-01T19:56:14.711 INFO:teuthology.orchestra.run.smithi006.stdout: "down_stamp": "0.000000", 2023-08-01T19:56:14.711 INFO:teuthology.orchestra.run.smithi006.stdout: "laggy_probability": 0, 2023-08-01T19:56:14.711 INFO:teuthology.orchestra.run.smithi006.stdout: "laggy_interval": 0, 2023-08-01T19:56:14.711 INFO:teuthology.orchestra.run.smithi006.stdout: "features": 4540138320759226367, 2023-08-01T19:56:14.711 INFO:teuthology.orchestra.run.smithi006.stdout: "old_weight": 0, 2023-08-01T19:56:14.712 INFO:teuthology.orchestra.run.smithi006.stdout: "last_purged_snaps_scrub": "2023-08-01T19:53:48.072529+0000", 2023-08-01T19:56:14.712 INFO:teuthology.orchestra.run.smithi006.stdout: "dead_epoch": 0 2023-08-01T19:56:14.712 INFO:teuthology.orchestra.run.smithi006.stdout: } 2023-08-01T19:56:14.712 INFO:teuthology.orchestra.run.smithi006.stdout: ], 2023-08-01T19:56:14.712 INFO:teuthology.orchestra.run.smithi006.stdout: "pg_upmap": [], 2023-08-01T19:56:14.712 INFO:teuthology.orchestra.run.smithi006.stdout: "pg_upmap_items": [], 2023-08-01T19:56:14.712 INFO:teuthology.orchestra.run.smithi006.stdout: "pg_temp": [], 2023-08-01T19:56:14.712 INFO:teuthology.orchestra.run.smithi006.stdout: "primary_temp": [], 2023-08-01T19:56:14.713 INFO:teuthology.orchestra.run.smithi006.stdout: "blocklist": {}, 2023-08-01T19:56:14.713 INFO:teuthology.orchestra.run.smithi006.stdout: "range_blocklist": {}, 2023-08-01T19:56:14.713 INFO:teuthology.orchestra.run.smithi006.stdout: "erasure_code_profiles": { 2023-08-01T19:56:14.713 INFO:teuthology.orchestra.run.smithi006.stdout: "default": { 2023-08-01T19:56:14.713 INFO:teuthology.orchestra.run.smithi006.stdout: "crush-failure-domain": "osd", 2023-08-01T19:56:14.713 INFO:teuthology.orchestra.run.smithi006.stdout: "k": "2", 2023-08-01T19:56:14.713 INFO:teuthology.orchestra.run.smithi006.stdout: "m": "1", 2023-08-01T19:56:14.713 INFO:teuthology.orchestra.run.smithi006.stdout: "plugin": "jerasure", 2023-08-01T19:56:14.714 INFO:teuthology.orchestra.run.smithi006.stdout: "technique": "reed_sol_van" 2023-08-01T19:56:14.714 INFO:teuthology.orchestra.run.smithi006.stdout: } 2023-08-01T19:56:14.714 INFO:teuthology.orchestra.run.smithi006.stdout: }, 2023-08-01T19:56:14.714 INFO:teuthology.orchestra.run.smithi006.stdout: "removed_snaps_queue": [], 2023-08-01T19:56:14.714 INFO:teuthology.orchestra.run.smithi006.stdout: "new_removed_snaps": [], 2023-08-01T19:56:14.714 INFO:teuthology.orchestra.run.smithi006.stdout: "new_purged_snaps": [], 2023-08-01T19:56:14.714 INFO:teuthology.orchestra.run.smithi006.stdout: "crush_node_flags": {}, 2023-08-01T19:56:14.714 INFO:teuthology.orchestra.run.smithi006.stdout: "device_class_flags": {}, 2023-08-01T19:56:14.715 INFO:teuthology.orchestra.run.smithi006.stdout: "stretch_mode": { 2023-08-01T19:56:14.715 INFO:teuthology.orchestra.run.smithi006.stdout: "stretch_mode_enabled": false, 2023-08-01T19:56:14.715 INFO:teuthology.orchestra.run.smithi006.stdout: "stretch_bucket_count": 0, 2023-08-01T19:56:14.715 INFO:teuthology.orchestra.run.smithi006.stdout: "degraded_stretch_mode": 0, 2023-08-01T19:56:14.715 INFO:teuthology.orchestra.run.smithi006.stdout: "recovering_stretch_mode": 0, 2023-08-01T19:56:14.715 INFO:teuthology.orchestra.run.smithi006.stdout: "stretch_mode_bucket": 0 2023-08-01T19:56:14.715 INFO:teuthology.orchestra.run.smithi006.stdout: } 2023-08-01T19:56:14.716 INFO:teuthology.orchestra.run.smithi006.stdout:} 2023-08-01T19:56:14.716 INFO:tasks.ceph.osd.0.smithi008.stderr:2023-08-01T19:56:14.623+0000 7f16a58f4700 -1 received signal: Hangup from /usr/bin/python3 /bin/daemon-helper kill ceph-osd -f --cluster ceph -i 0 (PID: 111179) UID: 0 2023-08-01T19:56:14.717 INFO:tasks.thrashosds.thrasher:j is {'epoch': 68, 'fsid': 'a0e420cc-4df1-42a5-8bd4-a98c309a9349', 'created': '2023-08-01T19:53:41.279588+0000', 'modified': '2023-08-01T19:56:12.070814+0000', 'last_up_change': '2023-08-01T19:55:58.549095+0000', 'last_in_change': '2023-08-01T19:53:42.974751+0000', 'flags': 'noscrub,nodeep-scrub,sortbitwise,recovery_deletes,purged_snapdirs,pglog_hardlimit', 'flags_num': 5806080, 'flags_set': ['nodeep-scrub', 'noscrub', 'pglog_hardlimit', 'purged_snapdirs', 'recovery_deletes', 'sortbitwise'], 'crush_version': 5, 'full_ratio': 0.949999988079071, 'backfillfull_ratio': 0.8999999761581421, 'nearfull_ratio': 0.8500000238418579, 'cluster_snapshot': '', 'pool_max': 5, 'max_osd': 3, 'require_min_compat_client': 'luminous', 'min_compat_client': 'jewel', 'require_osd_release': 'quincy', 'pools': [{'pool': 1, 'pool_name': '.mgr', 'create_time': '2023-08-01T19:53:49.961944+0000', 'flags': 1, 'flags_names': 'hashpspool', 'type': 1, 'size': 2, 'min_size': 1, 'crush_rule': 0, 'peering_crush_bucket_count': 0, 'peering_crush_bucket_target': 0, 'peering_crush_bucket_barrier': 0, 'peering_crush_bucket_mandatory_member': 2147483647, 'object_hash': 2, 'pg_autoscale_mode': 'off', 'pg_num': 1, 'pg_placement_num': 1, 'pg_placement_num_target': 1, 'pg_num_target': 1, 'pg_num_pending': 1, 'last_pg_merge_meta': {'source_pgid': '0.0', 'ready_epoch': 0, 'last_epoch_started': 0, 'last_epoch_clean': 0, 'source_version': "0'0", 'target_version': "0'0"}, 'last_change': '11', 'last_force_op_resend': '0', 'last_force_op_resend_prenautilus': '0', 'last_force_op_resend_preluminous': '0', 'auid': 0, 'snap_mode': 'selfmanaged', 'snap_seq': 0, 'snap_epoch': 0, 'pool_snaps': [], 'removed_snaps': '[]', 'quota_max_bytes': 0, 'quota_max_objects': 0, 'tiers': [], 'tier_of': -1, 'read_tier': -1, 'write_tier': -1, 'cache_mode': 'none', 'target_max_bytes': 0, 'target_max_objects': 0, 'cache_target_dirty_ratio_micro': 400000, 'cache_target_dirty_high_ratio_micro': 600000, 'cache_target_full_ratio_micro': 800000, 'cache_min_flush_age': 0, 'cache_min_evict_age': 0, 'erasure_code_profile': '', 'hit_set_params': {'type': 'none'}, 'hit_set_period': 0, 'hit_set_count': 0, 'use_gmt_hitset': True, 'min_read_recency_for_promote': 0, 'min_write_recency_for_promote': 0, 'hit_set_grade_decay_rate': 0, 'hit_set_search_last_n': 0, 'grade_table': [], 'stripe_width': 0, 'expected_num_objects': 0, 'fast_read': False, 'options': {'pg_num_max': 32, 'pg_num_min': 1}, 'application_metadata': {'mgr': {}}}, {'pool': 2, 'pool_name': 'rbd', 'create_time': '2023-08-01T19:53:57.404091+0000', 'flags': 1, 'flags_names': 'hashpspool', 'type': 1, 'size': 2, 'min_size': 1, 'crush_rule': 0, 'peering_crush_bucket_count': 0, 'peering_crush_bucket_target': 0, 'peering_crush_bucket_barrier': 0, 'peering_crush_bucket_mandatory_member': 2147483647, 'object_hash': 2, 'pg_autoscale_mode': 'off', 'pg_num': 8, 'pg_placement_num': 8, 'pg_placement_num_target': 8, 'pg_num_target': 8, 'pg_num_pending': 8, 'last_pg_merge_meta': {'source_pgid': '0.0', 'ready_epoch': 0, 'last_epoch_started': 0, 'last_epoch_clean': 0, 'source_version': "0'0", 'target_version': "0'0"}, 'last_change': '14', 'last_force_op_resend': '0', 'last_force_op_resend_prenautilus': '0', 'last_force_op_resend_preluminous': '0', 'auid': 0, 'snap_mode': 'selfmanaged', 'snap_seq': 0, 'snap_epoch': 0, 'pool_snaps': [], 'removed_snaps': '[]', 'quota_max_bytes': 0, 'quota_max_objects': 0, 'tiers': [], 'tier_of': -1, 'read_tier': -1, 'write_tier': -1, 'cache_mode': 'none', 'target_max_bytes': 0, 'target_max_objects': 0, 'cache_target_dirty_ratio_micro': 400000, 'cache_target_dirty_high_ratio_micro': 600000, 'cache_target_full_ratio_micro': 800000, 'cache_min_flush_age': 0, 'cache_min_evict_age': 0, 'erasure_code_profile': '', 'hit_set_params': {'type': 'none'}, 'hit_set_period': 0, 'hit_set_count': 0, 'use_gmt_hitset': True, 'min_read_recency_for_promote': 0, 'min_write_recency_for_promote': 0, 'hit_set_grade_decay_rate': 0, 'hit_set_search_last_n': 0, 'grade_table': [], 'stripe_width': 0, 'expected_num_objects': 0, 'fast_read': False, 'options': {}, 'application_metadata': {'rbd': {}}}, {'pool': 3, 'pool_name': 'cephfs_metadata', 'create_time': '2023-08-01T19:54:02.111247+0000', 'flags': 1, 'flags_names': 'hashpspool', 'type': 1, 'size': 2, 'min_size': 1, 'crush_rule': 0, 'peering_crush_bucket_count': 0, 'peering_crush_bucket_target': 0, 'peering_crush_bucket_barrier': 0, 'peering_crush_bucket_mandatory_member': 2147483647, 'object_hash': 2, 'pg_autoscale_mode': 'off', 'pg_num': 32, 'pg_placement_num': 32, 'pg_placement_num_target': 32, 'pg_num_target': 32, 'pg_num_pending': 32, 'last_pg_merge_meta': {'source_pgid': '0.0', 'ready_epoch': 0, 'last_epoch_started': 0, 'last_epoch_clean': 0, 'source_version': "0'0", 'target_version': "0'0"}, 'last_change': '17', 'last_force_op_resend': '0', 'last_force_op_resend_prenautilus': '0', 'last_force_op_resend_preluminous': '0', 'auid': 0, 'snap_mode': 'selfmanaged', 'snap_seq': 0, 'snap_epoch': 0, 'pool_snaps': [], 'removed_snaps': '[]', 'quota_max_bytes': 0, 'quota_max_objects': 0, 'tiers': [], 'tier_of': -1, 'read_tier': -1, 'write_tier': -1, 'cache_mode': 'none', 'target_max_bytes': 0, 'target_max_objects': 0, 'cache_target_dirty_ratio_micro': 400000, 'cache_target_dirty_high_ratio_micro': 600000, 'cache_target_full_ratio_micro': 800000, 'cache_min_flush_age': 0, 'cache_min_evict_age': 0, 'erasure_code_profile': '', 'hit_set_params': {'type': 'none'}, 'hit_set_period': 0, 'hit_set_count': 0, 'use_gmt_hitset': True, 'min_read_recency_for_promote': 0, 'min_write_recency_for_promote': 0, 'hit_set_grade_decay_rate': 0, 'hit_set_search_last_n': 0, 'grade_table': [], 'stripe_width': 0, 'expected_num_objects': 0, 'fast_read': False, 'options': {'pg_autoscale_bias': 4, 'pg_num_min': 16, 'recovery_priority': 5}, 'application_metadata': {'cephfs': {'metadata': 'cephfs'}}}, {'pool': 4, 'pool_name': 'cephfs_data', 'create_time': '2023-08-01T19:54:03.430277+0000', 'flags': 1, 'flags_names': 'hashpspool', 'type': 1, 'size': 2, 'min_size': 1, 'crush_rule': 0, 'peering_crush_bucket_count': 0, 'peering_crush_bucket_target': 0, 'peering_crush_bucket_barrier': 0, 'peering_crush_bucket_mandatory_member': 2147483647, 'object_hash': 2, 'pg_autoscale_mode': 'off', 'pg_num': 64, 'pg_placement_num': 64, 'pg_placement_num_target': 64, 'pg_num_target': 64, 'pg_num_pending': 64, 'last_pg_merge_meta': {'source_pgid': '0.0', 'ready_epoch': 0, 'last_epoch_started': 0, 'last_epoch_clean': 0, 'source_version': "0'0", 'target_version': "0'0"}, 'last_change': '18', 'last_force_op_resend': '0', 'last_force_op_resend_prenautilus': '0', 'last_force_op_resend_preluminous': '0', 'auid': 0, 'snap_mode': 'selfmanaged', 'snap_seq': 0, 'snap_epoch': 0, 'pool_snaps': [], 'removed_snaps': '[]', 'quota_max_bytes': 0, 'quota_max_objects': 0, 'tiers': [], 'tier_of': -1, 'read_tier': -1, 'write_tier': -1, 'cache_mode': 'none', 'target_max_bytes': 0, 'target_max_objects': 0, 'cache_target_dirty_ratio_micro': 400000, 'cache_target_dirty_high_ratio_micro': 600000, 'cache_target_full_ratio_micro': 800000, 'cache_min_flush_age': 0, 'cache_min_evict_age': 0, 'erasure_code_profile': '', 'hit_set_params': {'type': 'none'}, 'hit_set_period': 0, 'hit_set_count': 0, 'use_gmt_hitset': True, 'min_read_recency_for_promote': 0, 'min_write_recency_for_promote': 0, 'hit_set_grade_decay_rate': 0, 'hit_set_search_last_n': 0, 'grade_table': [], 'stripe_width': 0, 'expected_num_objects': 0, 'fast_read': False, 'options': {'pg_num_min': 64, 'target_size_ratio': 0.8999999761581421}, 'application_metadata': {'cephfs': {'data': 'cephfs'}}}, {'pool': 5, 'pool_name': 'unique_pool_0', 'create_time': '2023-08-01T19:54:21.165668+0000', 'flags': 1, 'flags_names': 'hashpspool', 'type': 1, 'size': 2, 'min_size': 1, 'crush_rule': 0, 'peering_crush_bucket_count': 0, 'peering_crush_bucket_target': 0, 'peering_crush_bucket_barrier': 0, 'peering_crush_bucket_mandatory_member': 2147483647, 'object_hash': 2, 'pg_autoscale_mode': 'off', 'pg_num': 16, 'pg_placement_num': 16, 'pg_placement_num_target': 16, 'pg_num_target': 16, 'pg_num_pending': 16, 'last_pg_merge_meta': {'source_pgid': '0.0', 'ready_epoch': 0, 'last_epoch_started': 0, 'last_epoch_clean': 0, 'source_version': "0'0", 'target_version': "0'0"}, 'last_change': '21', 'last_force_op_resend': '0', 'last_force_op_resend_prenautilus': '0', 'last_force_op_resend_preluminous': '0', 'auid': 0, 'snap_mode': 'selfmanaged', 'snap_seq': 0, 'snap_epoch': 0, 'pool_snaps': [], 'removed_snaps': '[]', 'quota_max_bytes': 0, 'quota_max_objects': 0, 'tiers': [], 'tier_of': -1, 'read_tier': -1, 'write_tier': -1, 'cache_mode': 'none', 'target_max_bytes': 0, 'target_max_objects': 0, 'cache_target_dirty_ratio_micro': 400000, 'cache_target_dirty_high_ratio_micro': 600000, 'cache_target_full_ratio_micro': 800000, 'cache_min_flush_age': 0, 'cache_min_evict_age': 0, 'erasure_code_profile': '', 'hit_set_params': {'type': 'none'}, 'hit_set_period': 0, 'hit_set_count': 0, 'use_gmt_hitset': True, 'min_read_recency_for_promote': 0, 'min_write_recency_for_promote': 0, 'hit_set_grade_decay_rate': 0, 'hit_set_search_last_n': 0, 'grade_table': [], 'stripe_width': 0, 'expected_num_objects': 0, 'fast_read': False, 'options': {}, 'application_metadata': {'rados': {}}}], 'osds': [{'osd': 0, 'uuid': '5dd675c7-2777-48f2-8009-ff0e0d4c7086', 'up': 1, 'in': 1, 'weight': 1, 'primary_affinity': 0.822052001953125, 'last_clean_begin': 0, 'last_clean_end': 0, 'up_from': 8, 'up_thru': 62, 'down_at': 0, 'lost_at': 0, 'public_addrs': {'addrvec': [{'type': 'v2', 'addr': '172.21.15.8:6800', 'nonce': 111181}, {'type': 'v1', 'addr': '172.21.15.8:6801', 'nonce': 111181}]}, 'cluster_addrs': {'addrvec': [{'type': 'v2', 'addr': '172.21.15.8:6802', 'nonce': 111181}, {'type': 'v1', 'addr': '172.21.15.8:6803', 'nonce': 111181}]}, 'heartbeat_back_addrs': {'addrvec': [{'type': 'v2', 'addr': '172.21.15.8:6806', 'nonce': 111181}, {'type': 'v1', 'addr': '172.21.15.8:6807', 'nonce': 111181}]}, 'heartbeat_front_addrs': {'addrvec': [{'type': 'v2', 'addr': '172.21.15.8:6804', 'nonce': 111181}, {'type': 'v1', 'addr': '172.21.15.8:6805', 'nonce': 111181}]}, 'public_addr': '172.21.15.8:6801/111181', 'cluster_addr': '172.21.15.8:6803/111181', 'heartbeat_back_addr': '172.21.15.8:6807/111181', 'heartbeat_front_addr': '172.21.15.8:6805/111181', 'state': ['exists', 'up']}, {'osd': 1, 'uuid': '7fc612c4-33ba-4a33-bca8-1f42ee8ed548', 'up': 0, 'in': 1, 'weight': 1, 'primary_affinity': 0.3376312255859375, 'last_clean_begin': 0, 'last_clean_end': 0, 'up_from': 8, 'up_thru': 53, 'down_at': 62, 'lost_at': 0, 'public_addrs': {'addrvec': [{'type': 'v2', 'addr': '172.21.15.101:6800', 'nonce': 111143}, {'type': 'v1', 'addr': '172.21.15.101:6801', 'nonce': 111143}]}, 'cluster_addrs': {'addrvec': [{'type': 'v2', 'addr': '172.21.15.101:6802', 'nonce': 111143}, {'type': 'v1', 'addr': '172.21.15.101:6803', 'nonce': 111143}]}, 'heartbeat_back_addrs': {'addrvec': [{'type': 'v2', 'addr': '172.21.15.101:6806', 'nonce': 111143}, {'type': 'v1', 'addr': '172.21.15.101:6807', 'nonce': 111143}]}, 'heartbeat_front_addrs': {'addrvec': [{'type': 'v2', 'addr': '172.21.15.101:6804', 'nonce': 111143}, {'type': 'v1', 'addr': '172.21.15.101:6805', 'nonce': 111143}]}, 'public_addr': '172.21.15.101:6801/111143', 'cluster_addr': '172.21.15.101:6803/111143', 'heartbeat_back_addr': '172.21.15.101:6807/111143', 'heartbeat_front_addr': '172.21.15.101:6805/111143', 'state': ['exists']}, {'osd': 2, 'uuid': 'f85cadbc-4230-4772-8f39-62ed52e220b1', 'up': 1, 'in': 1, 'weight': 1, 'primary_affinity': 1, 'last_clean_begin': 0, 'last_clean_end': 0, 'up_from': 9, 'up_thru': 62, 'down_at': 0, 'lost_at': 0, 'public_addrs': {'addrvec': [{'type': 'v2', 'addr': '172.21.15.155:6800', 'nonce': 111339}, {'type': 'v1', 'addr': '172.21.15.155:6801', 'nonce': 111339}]}, 'cluster_addrs': {'addrvec': [{'type': 'v2', 'addr': '172.21.15.155:6802', 'nonce': 111339}, {'type': 'v1', 'addr': '172.21.15.155:6803', 'nonce': 111339}]}, 'heartbeat_back_addrs': {'addrvec': [{'type': 'v2', 'addr': '172.21.15.155:6806', 'nonce': 111339}, {'type': 'v1', 'addr': '172.21.15.155:6807', 'nonce': 111339}]}, 'heartbeat_front_addrs': {'addrvec': [{'type': 'v2', 'addr': '172.21.15.155:6804', 'nonce': 111339}, {'type': 'v1', 'addr': '172.21.15.155:6805', 'nonce': 111339}]}, 'public_addr': '172.21.15.155:6801/111339', 'cluster_addr': '172.21.15.155:6803/111339', 'heartbeat_back_addr': '172.21.15.155:6807/111339', 'heartbeat_front_addr': '172.21.15.155:6805/111339', 'state': ['exists', 'up']}], 'osd_xinfo': [{'osd': 0, 'down_stamp': '0.000000', 'laggy_probability': 0, 'laggy_interval': 0, 'features': 4540138320759226367, 'old_weight': 0, 'last_purged_snaps_scrub': '2023-08-01T19:53:48.018154+0000', 'dead_epoch': 0}, {'osd': 1, 'down_stamp': '0.000000', 'laggy_probability': 0, 'laggy_interval': 0, 'features': 4540138320759226367, 'old_weight': 0, 'last_purged_snaps_scrub': '2023-08-01T19:53:48.000488+0000', 'dead_epoch': 61}, {'osd': 2, 'down_stamp': '0.000000', 'laggy_probability': 0, 'laggy_interval': 0, 'features': 4540138320759226367, 'old_weight': 0, 'last_purged_snaps_scrub': '2023-08-01T19:53:48.072529+0000', 'dead_epoch': 0}], 'pg_upmap': [], 'pg_upmap_items': [], 'pg_temp': [], 'primary_temp': [], 'blocklist': {}, 'range_blocklist': {}, 'erasure_code_profiles': {'default': {'crush-failure-domain': 'osd', 'k': '2', 'm': '1', 'plugin': 'jerasure', 'technique': 'reed_sol_van'}}, 'removed_snaps_queue': [], 'new_removed_snaps': [], 'new_purged_snaps': [], 'crush_node_flags': {}, 'device_class_flags': {}, 'stretch_mode': {'stretch_mode_enabled': False, 'stretch_bucket_count': 0, 'degraded_stretch_mode': 0, 'recovering_stretch_mode': 0, 'stretch_mode_bucket': 0}} 2023-08-01T19:56:14.718 DEBUG:teuthology.orchestra.run.smithi006:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 120 ceph --cluster ceph pg dump --format=json 2023-08-01T19:56:14.725 INFO:tasks.ceph.osd.0.smithi008.stderr:2023-08-01T19:56:14.723+0000 7f16a58f4700 -1 received signal: Hangup from /usr/bin/python3 /bin/daemon-helper kill ceph-osd -f --cluster ceph -i 0 (PID: 111179) UID: 0 2023-08-01T19:56:14.736 INFO:teuthology.orchestra.run.smithi008.stdout:ERROR: (22) Invalid argument 2023-08-01T19:56:14.736 INFO:teuthology.orchestra.run.smithi008.stdout:op_tracker tracking is not enabled now, so no ops are tracked currently, even those get stuck. Please enable "osd_enable_op_tracker", and the tracker will start to track new ops received afterwards. 2023-08-01T19:56:14.750 DEBUG:teuthology.orchestra.run.smithi008:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 30 ceph --cluster ceph --admin-daemon /var/run/ceph/ceph-osd.0.asok dump_blocked_ops 2023-08-01T19:56:14.826 INFO:tasks.ceph.osd.2.smithi155.stderr:2023-08-01T19:56:14.825+0000 7faa5c6ac700 -1 received signal: Hangup from /usr/bin/python3 /bin/daemon-helper kill ceph-osd -f --cluster ceph -i 2 (PID: 111337) UID: 0 2023-08-01T19:56:14.926 INFO:tasks.ceph.osd.2.smithi155.stderr:2023-08-01T19:56:14.926+0000 7faa5c6ac700 -1 received signal: Hangup from /usr/bin/python3 /bin/daemon-helper kill ceph-osd -f --cluster ceph -i 2 (PID: 111337) UID: 0 2023-08-01T19:56:14.978 INFO:teuthology.orchestra.run.smithi008.stdout:ERROR: (22) Invalid argument 2023-08-01T19:56:14.978 INFO:teuthology.orchestra.run.smithi008.stdout:op_tracker tracking is not enabled now, so no ops are tracked currently, even those get stuck. Please enable "osd_enable_op_tracker", and the tracker will start to track new ops received afterwards. 2023-08-01T19:56:14.994 DEBUG:teuthology.orchestra.run.smithi008:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 30 ceph --cluster ceph --admin-daemon /var/run/ceph/ceph-osd.0.asok dump_historic_ops 2023-08-01T19:56:15.037 INFO:tasks.ceph.osd.0.smithi008.stderr:2023-08-01T19:56:15.036+0000 7f16a58f4700 -1 received signal: Hangup from /usr/bin/python3 /bin/daemon-helper kill ceph-osd -f --cluster ceph -i 0 (PID: 111179) UID: 0 2023-08-01T19:56:15.058 INFO:teuthology.orchestra.run.smithi006.stdout: 2023-08-01T19:56:15.060 INFO:teuthology.orchestra.run.smithi006.stderr:dumped all 2023-08-01T19:56:15.069 INFO:teuthology.orchestra.run.smithi006.stdout:{"pg_ready":true,"pg_map":{"version":137,"stamp":"2023-08-01T19:56:13.931537+0000","last_osdmap_epoch":0,"last_pg_scan":0,"pg_stats_sum":{"stat_sum":{"num_bytes":3101887290,"num_objects":47347,"num_object_clones":0,"num_object_copies":94694,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":29889,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":47347,"num_whiteouts":0,"num_read":137,"num_read_kb":119,"num_write":220243,"num_write_kb":8557586,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":1,"num_bytes_recovered":65536,"num_keys_recovered":0,"num_objects_omap":14,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"store_stats":{"total":0,"available":0,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},"log_size":60697,"ondisk_log_size":60697,"up":161,"acting":161,"num_store_stats":0},"osd_stats_sum":{"up_from":0,"seq":0,"num_pgs":242,"num_osds":3,"num_per_pool_osds":3,"num_per_pool_omap_osds":3,"kb":283115520,"kb_used":891736,"kb_used_data":466552,"kb_used_omap":0,"kb_used_meta":425088,"kb_avail":282223784,"statfs":{"total":289910292480,"available":288997154816,"internally_reserved":0,"allocated":477749248,"data_stored":7608166977,"data_compressed":36531128,"data_compressed_allocated":475459584,"data_compressed_original":7607320576,"omap_allocated":0,"internal_metadata":435290112},"hb_peers":[],"snap_trim_queue_len":0,"num_snap_trimming":0,"num_shards_repaired":0,"op_queue_age_hist":{"histogram":[],"upper_bound":1},"perf_stat":{"commit_latency_ms":10,"apply_latency_ms":10,"commit_latency_ns":10000000,"apply_latency_ns":10000000},"alerts":[],"network_ping_times":[]},"pg_stats_delta":{"stat_sum":{"num_bytes":-1012400128,"num_objects":-15448,"num_object_clones":0,"num_object_copies":-30896,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":-8237,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":-15448,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":15448,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"store_stats":{"total":0,"available":0,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},"log_size":0,"ondisk_log_size":0,"up":0,"acting":0,"num_store_stats":0,"stamp_delta":"7.932461"},"pg_stats":[{"pgid":"4.3f","version":"0'0","reported_seq":58,"reported_epoch":66,"state":"active+clean","last_fresh":"2023-08-01T19:56:06.005507+0000","last_change":"2023-08-01T19:54:04.473430+0000","last_active":"2023-08-01T19:56:06.005507+0000","last_peered":"2023-08-01T19:56:06.005507+0000","last_clean":"2023-08-01T19:56:06.005507+0000","last_became_active":"2023-08-01T19:54:04.472887+0000","last_became_peered":"2023-08-01T19:54:04.472887+0000","last_unstale":"2023-08-01T19:56:06.005507+0000","last_undegraded":"2023-08-01T19:56:06.005507+0000","last_fullsized":"2023-08-01T19:56:06.005507+0000","mapping_epoch":16,"log_start":"0'0","ondisk_log_start":"0'0","created":16,"last_epoch_clean":17,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-08-01T19:54:04.040663+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-08-01T19:54:04.040663+0000","last_clean_scrub_stamp":"2023-08-01T19:54:04.040663+0000","objects_scrubbed":0,"log_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-08-03T06:38:54.196605+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[2,0],"acting":[2,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":2,"acting_primary":2,"purged_snaps":[]},{"pgid":"4.3e","version":"0'0","reported_seq":58,"reported_epoch":66,"state":"active+clean","last_fresh":"2023-08-01T19:56:06.004477+0000","last_change":"2023-08-01T19:54:04.470501+0000","last_active":"2023-08-01T19:56:06.004477+0000","last_peered":"2023-08-01T19:56:06.004477+0000","last_clean":"2023-08-01T19:56:06.004477+0000","last_became_active":"2023-08-01T19:54:04.469692+0000","last_became_peered":"2023-08-01T19:54:04.469692+0000","last_unstale":"2023-08-01T19:56:06.004477+0000","last_undegraded":"2023-08-01T19:56:06.004477+0000","last_fullsized":"2023-08-01T19:56:06.004477+0000","mapping_epoch":16,"log_start":"0'0","ondisk_log_start":"0'0","created":16,"last_epoch_clean":17,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-08-01T19:54:04.040663+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-08-01T19:54:04.040663+0000","last_clean_scrub_stamp":"2023-08-01T19:54:04.040663+0000","objects_scrubbed":0,"log_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-08-03T02:19:35.201107+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[2,0],"acting":[2,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":2,"acting_primary":2,"purged_snaps":[]},{"pgid":"4.3d","version":"0'0","reported_seq":13,"reported_epoch":66,"state":"active+undersized","last_fresh":"2023-08-01T19:56:06.004670+0000","last_change":"2023-08-01T19:55:59.565033+0000","last_active":"2023-08-01T19:56:06.004670+0000","last_peered":"2023-08-01T19:56:06.004670+0000","last_clean":"2023-08-01T19:54:04.040663+0000","last_became_active":"2023-08-01T19:55:59.565033+0000","last_became_peered":"2023-08-01T19:55:59.565033+0000","last_unstale":"2023-08-01T19:56:06.004670+0000","last_undegraded":"2023-08-01T19:56:06.004670+0000","last_fullsized":"2023-08-01T19:55:59.559202+0000","mapping_epoch":62,"log_start":"0'0","ondisk_log_start":"0'0","created":16,"last_epoch_clean":17,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-08-01T19:54:04.040663+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-08-01T19:54:04.040663+0000","last_clean_scrub_stamp":"2023-08-01T19:54:04.040663+0000","objects_scrubbed":0,"log_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-08-03T07:33:38.112389+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[2],"acting":[2],"avail_no_missing":["2"],"object_location_counts":[],"blocked_by":[],"up_primary":2,"acting_primary":2,"purged_snaps":[]},{"pgid":"4.3c","version":"0'0","reported_seq":60,"reported_epoch":66,"state":"active+undersized","last_fresh":"2023-08-01T19:56:06.008197+0000","last_change":"2023-08-01T19:55:59.622880+0000","last_active":"2023-08-01T19:56:06.008197+0000","last_peered":"2023-08-01T19:56:06.008197+0000","last_clean":"2023-08-01T19:55:57.553487+0000","last_became_active":"2023-08-01T19:55:59.622880+0000","last_became_peered":"2023-08-01T19:55:59.622880+0000","last_unstale":"2023-08-01T19:56:06.008197+0000","last_undegraded":"2023-08-01T19:56:06.008197+0000","last_fullsized":"2023-08-01T19:55:59.560756+0000","mapping_epoch":62,"log_start":"0'0","ondisk_log_start":"0'0","created":16,"last_epoch_clean":58,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-08-01T19:54:04.040663+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-08-01T19:54:04.040663+0000","last_clean_scrub_stamp":"2023-08-01T19:54:04.040663+0000","objects_scrubbed":0,"log_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-08-03T04:14:00.330198+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[0],"acting":[0],"avail_no_missing":["0"],"object_location_counts":[],"blocked_by":[],"up_primary":0,"acting_primary":0,"purged_snaps":[]},{"pgid":"4.3b","version":"0'0","reported_seq":58,"reported_epoch":66,"state":"active+clean","last_fresh":"2023-08-01T19:56:06.004112+0000","last_change":"2023-08-01T19:54:04.467197+0000","last_active":"2023-08-01T19:56:06.004112+0000","last_peered":"2023-08-01T19:56:06.004112+0000","last_clean":"2023-08-01T19:56:06.004112+0000","last_became_active":"2023-08-01T19:54:04.466526+0000","last_became_peered":"2023-08-01T19:54:04.466526+0000","last_unstale":"2023-08-01T19:56:06.004112+0000","last_undegraded":"2023-08-01T19:56:06.004112+0000","last_fullsized":"2023-08-01T19:56:06.004112+0000","mapping_epoch":16,"log_start":"0'0","ondisk_log_start":"0'0","created":16,"last_epoch_clean":17,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-08-01T19:54:04.040663+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-08-01T19:54:04.040663+0000","last_clean_scrub_stamp":"2023-08-01T19:54:04.040663+0000","objects_scrubbed":0,"log_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-08-03T06:54:18.982174+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[2,0],"acting":[2,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":2,"acting_primary":2,"purged_snaps":[]},{"pgid":"4.3a","version":"0'0","reported_seq":60,"reported_epoch":66,"state":"active+undersized","last_fresh":"2023-08-01T19:56:06.009116+0000","last_change":"2023-08-01T19:55:59.627206+0000","last_active":"2023-08-01T19:56:06.009116+0000","last_peered":"2023-08-01T19:56:06.009116+0000","last_clean":"2023-08-01T19:55:57.553069+0000","last_became_active":"2023-08-01T19:55:59.627206+0000","last_became_peered":"2023-08-01T19:55:59.627206+0000","last_unstale":"2023-08-01T19:56:06.009116+0000","last_undegraded":"2023-08-01T19:56:06.009116+0000","last_fullsized":"2023-08-01T19:55:59.560091+0000","mapping_epoch":62,"log_start":"0'0","ondisk_log_start":"0'0","created":16,"last_epoch_clean":58,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-08-01T19:54:04.040663+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-08-01T19:54:04.040663+0000","last_clean_scrub_stamp":"2023-08-01T19:54:04.040663+0000","objects_scrubbed":0,"log_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-08-03T03:48:56.726947+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[0],"acting":[0],"avail_no_missing":["0"],"object_location_counts":[],"blocked_by":[],"up_primary":0,"acting_primary":0,"purged_snaps":[]},{"pgid":"4.39","version":"0'0","reported_seq":60,"reported_epoch":66,"state":"active+undersized","last_fresh":"2023-08-01T19:56:06.007471+0000","last_change":"2023-08-01T19:55:59.568353+0000","last_active":"2023-08-01T19:56:06.007471+0000","last_peered":"2023-08-01T19:56:06.007471+0000","last_clean":"2023-08-01T19:55:57.552768+0000","last_became_active":"2023-08-01T19:55:59.568353+0000","last_became_peered":"2023-08-01T19:55:59.568353+0000","last_unstale":"2023-08-01T19:56:06.007471+0000","last_undegraded":"2023-08-01T19:56:06.007471+0000","last_fullsized":"2023-08-01T19:55:59.559299+0000","mapping_epoch":62,"log_start":"0'0","ondisk_log_start":"0'0","created":16,"last_epoch_clean":58,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-08-01T19:54:04.040663+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-08-01T19:54:04.040663+0000","last_clean_scrub_stamp":"2023-08-01T19:54:04.040663+0000","objects_scrubbed":0,"log_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-08-03T05:54:02.428766+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[0],"acting":[0],"avail_no_missing":["0"],"object_location_counts":[],"blocked_by":[],"up_primary":0,"acting_primary":0,"purged_snaps":[]},{"pgid":"4.38","version":"0'0","reported_seq":13,"reported_epoch":66,"state":"active+undersized","last_fresh":"2023-08-01T19:56:06.009910+0000","last_change":"2023-08-01T19:55:59.563741+0000","last_active":"2023-08-01T19:56:06.009910+0000","last_peered":"2023-08-01T19:56:06.009910+0000","last_clean":"2023-08-01T19:54:04.040663+0000","last_became_active":"2023-08-01T19:55:59.563741+0000","last_became_peered":"2023-08-01T19:55:59.563741+0000","last_unstale":"2023-08-01T19:56:06.009910+0000","last_undegraded":"2023-08-01T19:56:06.009910+0000","last_fullsized":"2023-08-01T19:55:59.559266+0000","mapping_epoch":62,"log_start":"0'0","ondisk_log_start":"0'0","created":16,"last_epoch_clean":17,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-08-01T19:54:04.040663+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-08-01T19:54:04.040663+0000","last_clean_scrub_stamp":"2023-08-01T19:54:04.040663+0000","objects_scrubbed":0,"log_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-08-03T02:14:14.019948+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[0],"acting":[0],"avail_no_missing":["0"],"object_location_counts":[],"blocked_by":[],"up_primary":0,"acting_primary":0,"purged_snaps":[]},{"pgid":"4.37","version":"0'0","reported_seq":63,"reported_epoch":66,"state":"active+clean","last_fresh":"2023-08-01T19:56:06.008536+0000","last_change":"2023-08-01T19:55:51.123242+0000","last_active":"2023-08-01T19:56:06.008536+0000","last_peered":"2023-08-01T19:56:06.008536+0000","last_clean":"2023-08-01T19:56:06.008536+0000","last_became_active":"2023-08-01T19:55:51.122924+0000","last_became_peered":"2023-08-01T19:55:51.122924+0000","last_unstale":"2023-08-01T19:56:06.008536+0000","last_undegraded":"2023-08-01T19:56:06.008536+0000","last_fullsized":"2023-08-01T19:56:06.008536+0000","mapping_epoch":57,"log_start":"0'0","ondisk_log_start":"0'0","created":16,"last_epoch_clean":58,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-08-01T19:54:04.040663+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-08-01T19:54:04.040663+0000","last_clean_scrub_stamp":"2023-08-01T19:54:04.040663+0000","objects_scrubbed":0,"log_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-08-03T01:30:44.142773+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[0,2],"acting":[0,2],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":0,"acting_primary":0,"purged_snaps":[]},{"pgid":"4.36","version":"0'0","reported_seq":58,"reported_epoch":66,"state":"active+clean","last_fresh":"2023-08-01T19:56:06.005340+0000","last_change":"2023-08-01T19:54:04.473523+0000","last_active":"2023-08-01T19:56:06.005340+0000","last_peered":"2023-08-01T19:56:06.005340+0000","last_clean":"2023-08-01T19:56:06.005340+0000","last_became_active":"2023-08-01T19:54:04.473084+0000","last_became_peered":"2023-08-01T19:54:04.473084+0000","last_unstale":"2023-08-01T19:56:06.005340+0000","last_undegraded":"2023-08-01T19:56:06.005340+0000","last_fullsized":"2023-08-01T19:56:06.005340+0000","mapping_epoch":16,"log_start":"0'0","ondisk_log_start":"0'0","created":16,"last_epoch_clean":17,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-08-01T19:54:04.040663+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-08-01T19:54:04.040663+0000","last_clean_scrub_stamp":"2023-08-01T19:54:04.040663+0000","objects_scrubbed":0,"log_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-08-03T04:28:59.042443+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[2,0],"acting":[2,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":2,"acting_primary":2,"purged_snaps":[]},{"pgid":"4.35","version":"0'0","reported_seq":60,"reported_epoch":66,"state":"active+undersized","last_fresh":"2023-08-01T19:56:06.009361+0000","last_change":"2023-08-01T19:55:59.623364+0000","last_active":"2023-08-01T19:56:06.009361+0000","last_peered":"2023-08-01T19:56:06.009361+0000","last_clean":"2023-08-01T19:55:57.553369+0000","last_became_active":"2023-08-01T19:55:59.623364+0000","last_became_peered":"2023-08-01T19:55:59.623364+0000","last_unstale":"2023-08-01T19:56:06.009361+0000","last_undegraded":"2023-08-01T19:56:06.009361+0000","last_fullsized":"2023-08-01T19:55:59.560271+0000","mapping_epoch":62,"log_start":"0'0","ondisk_log_start":"0'0","created":16,"last_epoch_clean":58,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-08-01T19:54:04.040663+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-08-01T19:54:04.040663+0000","last_clean_scrub_stamp":"2023-08-01T19:54:04.040663+0000","objects_scrubbed":0,"log_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-08-02T21:30:44.125279+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[0],"acting":[0],"avail_no_missing":["0"],"object_location_counts":[],"blocked_by":[],"up_primary":0,"acting_primary":0,"purged_snaps":[]},{"pgid":"4.34","version":"0'0","reported_seq":64,"reported_epoch":66,"state":"active+undersized","last_fresh":"2023-08-01T19:56:06.004530+0000","last_change":"2023-08-01T19:55:59.563484+0000","last_active":"2023-08-01T19:56:06.004530+0000","last_peered":"2023-08-01T19:56:06.004530+0000","last_clean":"2023-08-01T19:55:57.555020+0000","last_became_active":"2023-08-01T19:55:59.563484+0000","last_became_peered":"2023-08-01T19:55:59.563484+0000","last_unstale":"2023-08-01T19:56:06.004530+0000","last_undegraded":"2023-08-01T19:56:06.004530+0000","last_fullsized":"2023-08-01T19:55:59.558287+0000","mapping_epoch":62,"log_start":"0'0","ondisk_log_start":"0'0","created":16,"last_epoch_clean":17,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-08-01T19:54:04.040663+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-08-01T19:54:04.040663+0000","last_clean_scrub_stamp":"2023-08-01T19:54:04.040663+0000","objects_scrubbed":0,"log_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-08-02T20:26:09.600084+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[2],"acting":[2],"avail_no_missing":["2"],"object_location_counts":[],"blocked_by":[],"up_primary":2,"acting_primary":2,"purged_snaps":[]},{"pgid":"4.33","version":"0'0","reported_seq":58,"reported_epoch":66,"state":"active+clean","last_fresh":"2023-08-01T19:56:06.004355+0000","last_change":"2023-08-01T19:54:04.466770+0000","last_active":"2023-08-01T19:56:06.004355+0000","last_peered":"2023-08-01T19:56:06.004355+0000","last_clean":"2023-08-01T19:56:06.004355+0000","last_became_active":"2023-08-01T19:54:04.466460+0000","last_became_peered":"2023-08-01T19:54:04.466460+0000","last_unstale":"2023-08-01T19:56:06.004355+0000","last_undegraded":"2023-08-01T19:56:06.004355+0000","last_fullsized":"2023-08-01T19:56:06.004355+0000","mapping_epoch":16,"log_start":"0'0","ondisk_log_start":"0'0","created":16,"last_epoch_clean":17,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-08-01T19:54:04.040663+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-08-01T19:54:04.040663+0000","last_clean_scrub_stamp":"2023-08-01T19:54:04.040663+0000","objects_scrubbed":0,"log_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-08-03T06:04:11.595951+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[2,0],"acting":[2,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":2,"acting_primary":2,"purged_snaps":[]},{"pgid":"4.32","version":"0'0","reported_seq":44,"reported_epoch":66,"state":"active+undersized","last_fresh":"2023-08-01T19:56:06.003644+0000","last_change":"2023-08-01T19:55:59.562763+0000","last_active":"2023-08-01T19:56:06.003644+0000","last_peered":"2023-08-01T19:56:06.003644+0000","last_clean":"2023-08-01T19:55:57.554454+0000","last_became_active":"2023-08-01T19:55:59.562763+0000","last_became_peered":"2023-08-01T19:55:59.562763+0000","last_unstale":"2023-08-01T19:56:06.003644+0000","last_undegraded":"2023-08-01T19:56:06.003644+0000","last_fullsized":"2023-08-01T19:55:59.558087+0000","mapping_epoch":62,"log_start":"0'0","ondisk_log_start":"0'0","created":16,"last_epoch_clean":41,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-08-01T19:54:04.040663+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-08-01T19:54:04.040663+0000","last_clean_scrub_stamp":"2023-08-01T19:54:04.040663+0000","objects_scrubbed":0,"log_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-08-03T04:27:06.422052+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[2],"acting":[2],"avail_no_missing":["2"],"object_location_counts":[],"blocked_by":[],"up_primary":2,"acting_primary":2,"purged_snaps":[]},{"pgid":"4.31","version":"0'0","reported_seq":13,"reported_epoch":66,"state":"active+undersized","last_fresh":"2023-08-01T19:56:06.003554+0000","last_change":"2023-08-01T19:55:59.562771+0000","last_active":"2023-08-01T19:56:06.003554+0000","last_peered":"2023-08-01T19:56:06.003554+0000","last_clean":"2023-08-01T19:54:04.040663+0000","last_became_active":"2023-08-01T19:55:59.562771+0000","last_became_peered":"2023-08-01T19:55:59.562771+0000","last_unstale":"2023-08-01T19:56:06.003554+0000","last_undegraded":"2023-08-01T19:56:06.003554+0000","last_fullsized":"2023-08-01T19:55:59.557968+0000","mapping_epoch":62,"log_start":"0'0","ondisk_log_start":"0'0","created":16,"last_epoch_clean":17,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-08-01T19:54:04.040663+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-08-01T19:54:04.040663+0000","last_clean_scrub_stamp":"2023-08-01T19:54:04.040663+0000","objects_scrubbed":0,"log_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-08-02T22:24:27.948993+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[2],"acting":[2],"avail_no_missing":["2"],"object_location_counts":[],"blocked_by":[],"up_primary":2,"acting_primary":2,"purged_snaps":[]},{"pgid":"4.30","version":"0'0","reported_seq":60,"reported_epoch":66,"state":"active+undersized","last_fresh":"2023-08-01T19:56:06.009972+0000","last_change":"2023-08-01T19:55:59.563898+0000","last_active":"2023-08-01T19:56:06.009972+0000","last_peered":"2023-08-01T19:56:06.009972+0000","last_clean":"2023-08-01T19:55:57.552777+0000","last_became_active":"2023-08-01T19:55:59.563898+0000","last_became_peered":"2023-08-01T19:55:59.563898+0000","last_unstale":"2023-08-01T19:56:06.009972+0000","last_undegraded":"2023-08-01T19:56:06.009972+0000","last_fullsized":"2023-08-01T19:55:59.559299+0000","mapping_epoch":62,"log_start":"0'0","ondisk_log_start":"0'0","created":16,"last_epoch_clean":58,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-08-01T19:54:04.040663+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-08-01T19:54:04.040663+0000","last_clean_scrub_stamp":"2023-08-01T19:54:04.040663+0000","objects_scrubbed":0,"log_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-08-02T23:06:37.361708+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[0],"acting":[0],"avail_no_missing":["0"],"object_location_counts":[],"blocked_by":[],"up_primary":0,"acting_primary":0,"purged_snaps":[]},{"pgid":"4.2f","version":"0'0","reported_seq":63,"reported_epoch":66,"state":"active+clean","last_fresh":"2023-08-01T19:56:06.008611+0000","last_change":"2023-08-01T19:55:51.123562+0000","last_active":"2023-08-01T19:56:06.008611+0000","last_peered":"2023-08-01T19:56:06.008611+0000","last_clean":"2023-08-01T19:56:06.008611+0000","last_became_active":"2023-08-01T19:55:51.123267+0000","last_became_peered":"2023-08-01T19:55:51.123267+0000","last_unstale":"2023-08-01T19:56:06.008611+0000","last_undegraded":"2023-08-01T19:56:06.008611+0000","last_fullsized":"2023-08-01T19:56:06.008611+0000","mapping_epoch":57,"log_start":"0'0","ondisk_log_start":"0'0","created":16,"last_epoch_clean":58,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-08-01T19:54:04.040663+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-08-01T19:54:04.040663+0000","last_clean_scrub_stamp":"2023-08-01T19:54:04.040663+0000","objects_scrubbed":0,"log_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-08-03T05:38:22.137828+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[0,2],"acting":[0,2],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":0,"acting_primary":0,"purged_snaps":[]},{"pgid":"4.2e","version":"0'0","reported_seq":58,"reported_epoch":66,"state":"active+clean","last_fresh":"2023-08-01T19:56:06.005389+0000","last_change":"2023-08-01T19:54:04.474058+0000","last_active":"2023-08-01T19:56:06.005389+0000","last_peered":"2023-08-01T19:56:06.005389+0000","last_clean":"2023-08-01T19:56:06.005389+0000","last_became_active":"2023-08-01T19:54:04.473355+0000","last_became_peered":"2023-08-01T19:54:04.473355+0000","last_unstale":"2023-08-01T19:56:06.005389+0000","last_undegraded":"2023-08-01T19:56:06.005389+0000","last_fullsized":"2023-08-01T19:56:06.005389+0000","mapping_epoch":16,"log_start":"0'0","ondisk_log_start":"0'0","created":16,"last_epoch_clean":17,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-08-01T19:54:04.040663+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-08-01T19:54:04.040663+0000","last_clean_scrub_stamp":"2023-08-01T19:54:04.040663+0000","objects_scrubbed":0,"log_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-08-03T04:55:54.197252+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[2,0],"acting":[2,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":2,"acting_primary":2,"purged_snaps":[]},{"pgid":"4.2d","version":"0'0","reported_seq":63,"reported_epoch":66,"state":"active+clean","last_fresh":"2023-08-01T19:56:06.009588+0000","last_change":"2023-08-01T19:55:51.123843+0000","last_active":"2023-08-01T19:56:06.009588+0000","last_peered":"2023-08-01T19:56:06.009588+0000","last_clean":"2023-08-01T19:56:06.009588+0000","last_became_active":"2023-08-01T19:55:51.123399+0000","last_became_peered":"2023-08-01T19:55:51.123399+0000","last_unstale":"2023-08-01T19:56:06.009588+0000","last_undegraded":"2023-08-01T19:56:06.009588+0000","last_fullsized":"2023-08-01T19:56:06.009588+0000","mapping_epoch":57,"log_start":"0'0","ondisk_log_start":"0'0","created":16,"last_epoch_clean":58,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-08-01T19:54:04.040663+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-08-01T19:54:04.040663+0000","last_clean_scrub_stamp":"2023-08-01T19:54:04.040663+0000","objects_scrubbed":0,"log_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-08-02T23:37:40.627502+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[0,2],"acting":[0,2],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":0,"acting_primary":0,"purged_snaps":[]},{"pgid":"4.2c","version":"0'0","reported_seq":44,"reported_epoch":66,"state":"active+undersized","last_fresh":"2023-08-01T19:56:06.008548+0000","last_change":"2023-08-01T19:55:59.621764+0000","last_active":"2023-08-01T19:56:06.008548+0000","last_peered":"2023-08-01T19:56:06.008548+0000","last_clean":"2023-08-01T19:55:57.553773+0000","last_became_active":"2023-08-01T19:55:59.621764+0000","last_became_peered":"2023-08-01T19:55:59.621764+0000","last_unstale":"2023-08-01T19:56:06.008548+0000","last_undegraded":"2023-08-01T19:56:06.008548+0000","last_fullsized":"2023-08-01T19:55:59.562626+0000","mapping_epoch":62,"log_start":"0'0","ondisk_log_start":"0'0","created":16,"last_epoch_clean":41,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-08-01T19:54:04.040663+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-08-01T19:54:04.040663+0000","last_clean_scrub_stamp":"2023-08-01T19:54:04.040663+0000","objects_scrubbed":0,"log_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-08-02T21:21:30.469018+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[0],"acting":[0],"avail_no_missing":["0"],"object_location_counts":[],"blocked_by":[],"up_primary":0,"acting_primary":0,"purged_snaps":[]},{"pgid":"4.2b","version":"0'0","reported_seq":13,"reported_epoch":66,"state":"active+undersized","last_fresh":"2023-08-01T19:56:06.009052+0000","last_change":"2023-08-01T19:55:59.622392+0000","last_active":"2023-08-01T19:56:06.009052+0000","last_peered":"2023-08-01T19:56:06.009052+0000","last_clean":"2023-08-01T19:54:04.040663+0000","last_became_active":"2023-08-01T19:55:59.622392+0000","last_became_peered":"2023-08-01T19:55:59.622392+0000","last_unstale":"2023-08-01T19:56:06.009052+0000","last_undegraded":"2023-08-01T19:56:06.009052+0000","last_fullsized":"2023-08-01T19:55:59.559936+0000","mapping_epoch":62,"log_start":"0'0","ondisk_log_start":"0'0","created":16,"last_epoch_clean":17,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-08-01T19:54:04.040663+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-08-01T19:54:04.040663+0000","last_clean_scrub_stamp":"2023-08-01T19:54:04.040663+0000","objects_scrubbed":0,"log_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-08-03T00:03:17.841374+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[0],"acting":[0],"avail_no_missing":["0"],"object_location_counts":[],"blocked_by":[],"up_primary":0,"acting_primary":0,"purged_snaps":[]},{"pgid":"4.2a","version":"0'0","reported_seq":64,"reported_epoch":66,"state":"active+undersized","last_fresh":"2023-08-01T19:56:06.003919+0000","last_change":"2023-08-01T19:55:59.563837+0000","last_active":"2023-08-01T19:56:06.003919+0000","last_peered":"2023-08-01T19:56:06.003919+0000","last_clean":"2023-08-01T19:55:57.554635+0000","last_became_active":"2023-08-01T19:55:59.563837+0000","last_became_peered":"2023-08-01T19:55:59.563837+0000","last_unstale":"2023-08-01T19:56:06.003919+0000","last_undegraded":"2023-08-01T19:56:06.003919+0000","last_fullsized":"2023-08-01T19:55:59.558803+0000","mapping_epoch":62,"log_start":"0'0","ondisk_log_start":"0'0","created":16,"last_epoch_clean":17,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-08-01T19:54:04.040663+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-08-01T19:54:04.040663+0000","last_clean_scrub_stamp":"2023-08-01T19:54:04.040663+0000","objects_scrubbed":0,"log_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-08-03T05:35:47.424405+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[2],"acting":[2],"avail_no_missing":["2"],"object_location_counts":[],"blocked_by":[],"up_primary":2,"acting_primary":2,"purged_snaps":[]},{"pgid":"4.29","version":"0'0","reported_seq":64,"reported_epoch":66,"state":"active+undersized","last_fresh":"2023-08-01T19:56:06.007965+0000","last_change":"2023-08-01T19:55:59.569073+0000","last_active":"2023-08-01T19:56:06.007965+0000","last_peered":"2023-08-01T19:56:06.007965+0000","last_clean":"2023-08-01T19:55:57.553225+0000","last_became_active":"2023-08-01T19:55:59.569073+0000","last_became_peered":"2023-08-01T19:55:59.569073+0000","last_unstale":"2023-08-01T19:56:06.007965+0000","last_undegraded":"2023-08-01T19:56:06.007965+0000","last_fullsized":"2023-08-01T19:55:59.560958+0000","mapping_epoch":62,"log_start":"0'0","ondisk_log_start":"0'0","created":16,"last_epoch_clean":17,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-08-01T19:54:04.040663+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-08-01T19:54:04.040663+0000","last_clean_scrub_stamp":"2023-08-01T19:54:04.040663+0000","objects_scrubbed":0,"log_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-08-03T04:19:55.042416+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[0],"acting":[0],"avail_no_missing":["0"],"object_location_counts":[],"blocked_by":[],"up_primary":0,"acting_primary":0,"purged_snaps":[]},{"pgid":"4.28","version":"0'0","reported_seq":58,"reported_epoch":66,"state":"active+clean","last_fresh":"2023-08-01T19:56:06.003949+0000","last_change":"2023-08-01T19:54:04.468160+0000","last_active":"2023-08-01T19:56:06.003949+0000","last_peered":"2023-08-01T19:56:06.003949+0000","last_clean":"2023-08-01T19:56:06.003949+0000","last_became_active":"2023-08-01T19:54:04.467625+0000","last_became_peered":"2023-08-01T19:54:04.467625+0000","last_unstale":"2023-08-01T19:56:06.003949+0000","last_undegraded":"2023-08-01T19:56:06.003949+0000","last_fullsized":"2023-08-01T19:56:06.003949+0000","mapping_epoch":16,"log_start":"0'0","ondisk_log_start":"0'0","created":16,"last_epoch_clean":17,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-08-01T19:54:04.040663+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-08-01T19:54:04.040663+0000","last_clean_scrub_stamp":"2023-08-01T19:54:04.040663+0000","objects_scrubbed":0,"log_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-08-02T21:27:52.506153+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[2,0],"acting":[2,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":2,"acting_primary":2,"purged_snaps":[]},{"pgid":"4.27","version":"0'0","reported_seq":64,"reported_epoch":66,"state":"active+undersized","last_fresh":"2023-08-01T19:56:06.005626+0000","last_change":"2023-08-01T19:55:59.564664+0000","last_active":"2023-08-01T19:56:06.005626+0000","last_peered":"2023-08-01T19:56:06.005626+0000","last_clean":"2023-08-01T19:55:57.557314+0000","last_became_active":"2023-08-01T19:55:59.564664+0000","last_became_peered":"2023-08-01T19:55:59.564664+0000","last_unstale":"2023-08-01T19:56:06.005626+0000","last_undegraded":"2023-08-01T19:56:06.005626+0000","last_fullsized":"2023-08-01T19:55:59.560510+0000","mapping_epoch":62,"log_start":"0'0","ondisk_log_start":"0'0","created":16,"last_epoch_clean":17,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-08-01T19:54:04.040663+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-08-01T19:54:04.040663+0000","last_clean_scrub_stamp":"2023-08-01T19:54:04.040663+0000","objects_scrubbed":0,"log_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-08-03T07:15:04.594590+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[2],"acting":[2],"avail_no_missing":["2"],"object_location_counts":[],"blocked_by":[],"up_primary":2,"acting_primary":2,"purged_snaps":[]},{"pgid":"4.26","version":"0'0","reported_seq":64,"reported_epoch":66,"state":"active+undersized","last_fresh":"2023-08-01T19:56:06.010021+0000","last_change":"2023-08-01T19:55:59.620603+0000","last_active":"2023-08-01T19:56:06.010021+0000","last_peered":"2023-08-01T19:56:06.010021+0000","last_clean":"2023-08-01T19:55:57.553963+0000","last_became_active":"2023-08-01T19:55:59.620603+0000","last_became_peered":"2023-08-01T19:55:59.620603+0000","last_unstale":"2023-08-01T19:56:06.010021+0000","last_undegraded":"2023-08-01T19:56:06.010021+0000","last_fullsized":"2023-08-01T19:55:59.561411+0000","mapping_epoch":62,"log_start":"0'0","ondisk_log_start":"0'0","created":16,"last_epoch_clean":17,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-08-01T19:54:04.040663+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-08-01T19:54:04.040663+0000","last_clean_scrub_stamp":"2023-08-01T19:54:04.040663+0000","objects_scrubbed":0,"log_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-08-02T20:33:29.963457+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[0],"acting":[0],"avail_no_missing":["0"],"object_location_counts":[],"blocked_by":[],"up_primary":0,"acting_primary":0,"purged_snaps":[]},{"pgid":"4.25","version":"0'0","reported_seq":13,"reported_epoch":66,"state":"active+undersized","last_fresh":"2023-08-01T19:56:06.004185+0000","last_change":"2023-08-01T19:55:59.562778+0000","last_active":"2023-08-01T19:56:06.004185+0000","last_peered":"2023-08-01T19:56:06.004185+0000","last_clean":"2023-08-01T19:54:04.040663+0000","last_became_active":"2023-08-01T19:55:59.562778+0000","last_became_peered":"2023-08-01T19:55:59.562778+0000","last_unstale":"2023-08-01T19:56:06.004185+0000","last_undegraded":"2023-08-01T19:56:06.004185+0000","last_fullsized":"2023-08-01T19:55:59.558539+0000","mapping_epoch":62,"log_start":"0'0","ondisk_log_start":"0'0","created":16,"last_epoch_clean":17,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-08-01T19:54:04.040663+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-08-01T19:54:04.040663+0000","last_clean_scrub_stamp":"2023-08-01T19:54:04.040663+0000","objects_scrubbed":0,"log_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-08-03T06:01:26.400910+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[2],"acting":[2],"avail_no_missing":["2"],"object_location_counts":[],"blocked_by":[],"up_primary":2,"acting_primary":2,"purged_snaps":[]},{"pgid":"3.1a","version":"17'1","reported_seq":60,"reported_epoch":66,"state":"active+clean","last_fresh":"2023-08-01T19:56:06.003809+0000","last_change":"2023-08-01T19:54:04.063936+0000","last_active":"2023-08-01T19:56:06.003809+0000","last_peered":"2023-08-01T19:56:06.003809+0000","last_clean":"2023-08-01T19:56:06.003809+0000","last_became_active":"2023-08-01T19:54:04.063674+0000","last_became_peered":"2023-08-01T19:54:04.063674+0000","last_unstale":"2023-08-01T19:56:06.003809+0000","last_undegraded":"2023-08-01T19:56:06.003809+0000","last_fullsized":"2023-08-01T19:56:06.003809+0000","mapping_epoch":15,"log_start":"0'0","ondisk_log_start":"0'0","created":15,"last_epoch_clean":16,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-08-01T19:54:03.032665+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-08-01T19:54:03.032665+0000","last_clean_scrub_stamp":"2023-08-01T19:54:03.032665+0000","objects_scrubbed":0,"log_size":1,"ondisk_log_size":1,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-08-03T00:06:00.058200+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[2,0],"acting":[2,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":2,"acting_primary":2,"purged_snaps":[]},{"pgid":"4.1d","version":"0'0","reported_seq":64,"reported_epoch":66,"state":"active+undersized","last_fresh":"2023-08-01T19:56:06.005806+0000","last_change":"2023-08-01T19:55:59.566011+0000","last_active":"2023-08-01T19:56:06.005806+0000","last_peered":"2023-08-01T19:56:06.005806+0000","last_clean":"2023-08-01T19:55:57.556805+0000","last_became_active":"2023-08-01T19:55:59.566011+0000","last_became_peered":"2023-08-01T19:55:59.566011+0000","last_unstale":"2023-08-01T19:56:06.005806+0000","last_undegraded":"2023-08-01T19:56:06.005806+0000","last_fullsized":"2023-08-01T19:55:59.560510+0000","mapping_epoch":62,"log_start":"0'0","ondisk_log_start":"0'0","created":16,"last_epoch_clean":17,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-08-01T19:54:04.040663+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-08-01T19:54:04.040663+0000","last_clean_scrub_stamp":"2023-08-01T19:54:04.040663+0000","objects_scrubbed":0,"log_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-08-03T02:26:01.721421+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[2],"acting":[2],"avail_no_missing":["2"],"object_location_counts":[],"blocked_by":[],"up_primary":2,"acting_primary":2,"purged_snaps":[]},{"pgid":"3.19","version":"0'0","reported_seq":65,"reported_epoch":66,"state":"active+undersized","last_fresh":"2023-08-01T19:56:06.008075+0000","last_change":"2023-08-01T19:55:59.569495+0000","last_active":"2023-08-01T19:56:06.008075+0000","last_peered":"2023-08-01T19:56:06.008075+0000","last_clean":"2023-08-01T19:55:57.553589+0000","last_became_active":"2023-08-01T19:55:59.569495+0000","last_became_peered":"2023-08-01T19:55:59.569495+0000","last_unstale":"2023-08-01T19:56:06.008075+0000","last_undegraded":"2023-08-01T19:56:06.008075+0000","last_fullsized":"2023-08-01T19:55:59.560993+0000","mapping_epoch":62,"log_start":"0'0","ondisk_log_start":"0'0","created":15,"last_epoch_clean":16,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-08-01T19:54:03.032665+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-08-01T19:54:03.032665+0000","last_clean_scrub_stamp":"2023-08-01T19:54:03.032665+0000","objects_scrubbed":0,"log_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-08-02T20:32:58.320703+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[0],"acting":[0],"avail_no_missing":["0"],"object_location_counts":[],"blocked_by":[],"up_primary":0,"acting_primary":0,"purged_snaps":[]},{"pgid":"4.1e","version":"0'0","reported_seq":69,"reported_epoch":66,"state":"active+undersized","last_fresh":"2023-08-01T19:56:06.010612+0000","last_change":"2023-08-01T19:55:59.620909+0000","last_active":"2023-08-01T19:56:06.010612+0000","last_peered":"2023-08-01T19:56:06.010612+0000","last_clean":"2023-08-01T19:55:57.554047+0000","last_became_active":"2023-08-01T19:55:59.620909+0000","last_became_peered":"2023-08-01T19:55:59.620909+0000","last_unstale":"2023-08-01T19:56:06.010612+0000","last_undegraded":"2023-08-01T19:56:06.010612+0000","last_fullsized":"2023-08-01T19:55:59.562762+0000","mapping_epoch":62,"log_start":"0'0","ondisk_log_start":"0'0","created":16,"last_epoch_clean":58,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-08-01T19:54:04.040663+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-08-01T19:54:04.040663+0000","last_clean_scrub_stamp":"2023-08-01T19:54:04.040663+0000","objects_scrubbed":0,"log_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-08-03T03:20:48.063404+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[0],"acting":[0],"avail_no_missing":["0"],"object_location_counts":[],"blocked_by":[],"up_primary":0,"acting_primary":0,"purged_snaps":[]},{"pgid":"3.18","version":"0'0","reported_seq":59,"reported_epoch":66,"state":"active+clean","last_fresh":"2023-08-01T19:56:06.010481+0000","last_change":"2023-08-01T19:54:04.064289+0000","last_active":"2023-08-01T19:56:06.010481+0000","last_peered":"2023-08-01T19:56:06.010481+0000","last_clean":"2023-08-01T19:56:06.010481+0000","last_became_active":"2023-08-01T19:54:04.063971+0000","last_became_peered":"2023-08-01T19:54:04.063971+0000","last_unstale":"2023-08-01T19:56:06.010481+0000","last_undegraded":"2023-08-01T19:56:06.010481+0000","last_fullsized":"2023-08-01T19:56:06.010481+0000","mapping_epoch":15,"log_start":"0'0","ondisk_log_start":"0'0","created":15,"last_epoch_clean":16,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-08-01T19:54:03.032665+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-08-01T19:54:03.032665+0000","last_clean_scrub_stamp":"2023-08-01T19:54:03.032665+0000","objects_scrubbed":0,"log_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-08-03T04:09:30.496098+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[0,2],"acting":[0,2],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":0,"acting_primary":0,"purged_snaps":[]},{"pgid":"4.1f","version":"0'0","reported_seq":64,"reported_epoch":66,"state":"active+undersized","last_fresh":"2023-08-01T19:56:06.005399+0000","last_change":"2023-08-01T19:55:59.564450+0000","last_active":"2023-08-01T19:56:06.005399+0000","last_peered":"2023-08-01T19:56:06.005399+0000","last_clean":"2023-08-01T19:55:57.557267+0000","last_became_active":"2023-08-01T19:55:59.564450+0000","last_became_peered":"2023-08-01T19:55:59.564450+0000","last_unstale":"2023-08-01T19:56:06.005399+0000","last_undegraded":"2023-08-01T19:56:06.005399+0000","last_fullsized":"2023-08-01T19:55:59.560321+0000","mapping_epoch":62,"log_start":"0'0","ondisk_log_start":"0'0","created":16,"last_epoch_clean":17,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-08-01T19:54:04.040663+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-08-01T19:54:04.040663+0000","last_clean_scrub_stamp":"2023-08-01T19:54:04.040663+0000","objects_scrubbed":0,"log_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-08-02T20:28:37.335131+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[2],"acting":[2],"avail_no_missing":["2"],"object_location_counts":[],"blocked_by":[],"up_primary":2,"acting_primary":2,"purged_snaps":[]},{"pgid":"3.17","version":"0'0","reported_seq":65,"reported_epoch":66,"state":"active+undersized","last_fresh":"2023-08-01T19:56:06.008998+0000","last_change":"2023-08-01T19:55:59.569727+0000","last_active":"2023-08-01T19:56:06.008998+0000","last_peered":"2023-08-01T19:56:06.008998+0000","last_clean":"2023-08-01T19:55:57.553819+0000","last_became_active":"2023-08-01T19:55:59.569727+0000","last_became_peered":"2023-08-01T19:55:59.569727+0000","last_unstale":"2023-08-01T19:56:06.008998+0000","last_undegraded":"2023-08-01T19:56:06.008998+0000","last_fullsized":"2023-08-01T19:55:59.560983+0000","mapping_epoch":62,"log_start":"0'0","ondisk_log_start":"0'0","created":15,"last_epoch_clean":16,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-08-01T19:54:03.032665+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-08-01T19:54:03.032665+0000","last_clean_scrub_stamp":"2023-08-01T19:54:03.032665+0000","objects_scrubbed":0,"log_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-08-03T04:17:07.264774+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[0],"acting":[0],"avail_no_missing":["0"],"object_location_counts":[],"blocked_by":[],"up_primary":0,"acting_primary":0,"purged_snaps":[]},{"pgid":"4.10","version":"0'0","reported_seq":25,"reported_epoch":66,"state":"active+clean","last_fresh":"2023-08-01T19:56:06.003635+0000","last_change":"2023-08-01T19:55:45.081281+0000","last_active":"2023-08-01T19:56:06.003635+0000","last_peered":"2023-08-01T19:56:06.003635+0000","last_clean":"2023-08-01T19:56:06.003635+0000","last_became_active":"2023-08-01T19:55:45.081013+0000","last_became_peered":"2023-08-01T19:55:45.081013+0000","last_unstale":"2023-08-01T19:56:06.003635+0000","last_undegraded":"2023-08-01T19:56:06.003635+0000","last_fullsized":"2023-08-01T19:56:06.003635+0000","mapping_epoch":53,"log_start":"0'0","ondisk_log_start":"0'0","created":16,"last_epoch_clean":54,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-08-01T19:54:04.040663+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-08-01T19:54:04.040663+0000","last_clean_scrub_stamp":"2023-08-01T19:54:04.040663+0000","objects_scrubbed":0,"log_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-08-03T01:32:50.141325+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[2,0],"acting":[2,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":2,"acting_primary":2,"purged_snaps":[]},{"pgid":"3.16","version":"0'0","reported_seq":47,"reported_epoch":66,"state":"active+undersized","last_fresh":"2023-08-01T19:56:06.011039+0000","last_change":"2023-08-01T19:55:59.621333+0000","last_active":"2023-08-01T19:56:06.011039+0000","last_peered":"2023-08-01T19:56:06.011039+0000","last_clean":"2023-08-01T19:54:03.032665+0000","last_became_active":"2023-08-01T19:55:59.621333+0000","last_became_peered":"2023-08-01T19:55:59.621333+0000","last_unstale":"2023-08-01T19:56:06.011039+0000","last_undegraded":"2023-08-01T19:56:06.011039+0000","last_fullsized":"2023-08-01T19:55:59.563162+0000","mapping_epoch":62,"log_start":"0'0","ondisk_log_start":"0'0","created":15,"last_epoch_clean":54,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-08-01T19:54:03.032665+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-08-01T19:54:03.032665+0000","last_clean_scrub_stamp":"2023-08-01T19:54:03.032665+0000","objects_scrubbed":0,"log_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-08-02T22:39:56.925490+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[0],"acting":[0],"avail_no_missing":["0"],"object_location_counts":[],"blocked_by":[],"up_primary":0,"acting_primary":0,"purged_snaps":[]},{"pgid":"4.11","version":"0'0","reported_seq":69,"reported_epoch":66,"state":"active+undersized","last_fresh":"2023-08-01T19:56:06.008301+0000","last_change":"2023-08-01T19:55:59.570071+0000","last_active":"2023-08-01T19:56:06.008301+0000","last_peered":"2023-08-01T19:56:06.008301+0000","last_clean":"2023-08-01T19:55:57.553485+0000","last_became_active":"2023-08-01T19:55:59.570071+0000","last_became_peered":"2023-08-01T19:55:59.570071+0000","last_unstale":"2023-08-01T19:56:06.008301+0000","last_undegraded":"2023-08-01T19:56:06.008301+0000","last_fullsized":"2023-08-01T19:55:59.561294+0000","mapping_epoch":62,"log_start":"0'0","ondisk_log_start":"0'0","created":16,"last_epoch_clean":58,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-08-01T19:54:04.040663+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-08-01T19:54:04.040663+0000","last_clean_scrub_stamp":"2023-08-01T19:54:04.040663+0000","objects_scrubbed":0,"log_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-08-02T20:44:22.989487+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[0],"acting":[0],"avail_no_missing":["0"],"object_location_counts":[],"blocked_by":[],"up_primary":0,"acting_primary":0,"purged_snaps":[]},{"pgid":"3.15","version":"17'3","reported_seq":68,"reported_epoch":66,"state":"active+undersized+degraded","last_fresh":"2023-08-01T19:56:06.005556+0000","last_change":"2023-08-01T19:55:59.565537+0000","last_active":"2023-08-01T19:56:06.005556+0000","last_peered":"2023-08-01T19:56:06.005556+0000","last_clean":"2023-08-01T19:55:57.555623+0000","last_became_active":"2023-08-01T19:55:59.565537+0000","last_became_peered":"2023-08-01T19:55:59.565537+0000","last_unstale":"2023-08-01T19:56:06.005556+0000","last_undegraded":"2023-08-01T19:55:59.560083+0000","last_fullsized":"2023-08-01T19:55:59.560013+0000","mapping_epoch":62,"log_start":"0'0","ondisk_log_start":"0'0","created":15,"last_epoch_clean":16,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-08-01T19:54:03.032665+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-08-01T19:54:03.032665+0000","last_clean_scrub_stamp":"2023-08-01T19:54:03.032665+0000","objects_scrubbed":0,"log_size":3,"ondisk_log_size":3,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-08-03T07:39:49.811684+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":90,"num_objects":2,"num_object_clones":0,"num_object_copies":4,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":2,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":2,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":4,"num_write_kb":1,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":1,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[2],"acting":[2],"avail_no_missing":["2"],"object_location_counts":[{"shards":"2","objects":2}],"blocked_by":[],"up_primary":2,"acting_primary":2,"purged_snaps":[]},{"pgid":"4.12","version":"0'0","reported_seq":63,"reported_epoch":66,"state":"active+clean","last_fresh":"2023-08-01T19:56:06.008808+0000","last_change":"2023-08-01T19:55:51.123529+0000","last_active":"2023-08-01T19:56:06.008808+0000","last_peered":"2023-08-01T19:56:06.008808+0000","last_clean":"2023-08-01T19:56:06.008808+0000","last_became_active":"2023-08-01T19:55:51.122619+0000","last_became_peered":"2023-08-01T19:55:51.122619+0000","last_unstale":"2023-08-01T19:56:06.008808+0000","last_undegraded":"2023-08-01T19:56:06.008808+0000","last_fullsized":"2023-08-01T19:56:06.008808+0000","mapping_epoch":57,"log_start":"0'0","ondisk_log_start":"0'0","created":16,"last_epoch_clean":58,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-08-01T19:54:04.040663+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-08-01T19:54:04.040663+0000","last_clean_scrub_stamp":"2023-08-01T19:54:04.040663+0000","objects_scrubbed":0,"log_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-08-03T01:49:14.141078+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[0,2],"acting":[0,2],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":0,"acting_primary":0,"purged_snaps":[]},{"pgid":"3.14","version":"17'6","reported_seq":57,"reported_epoch":66,"state":"active+undersized+degraded","last_fresh":"2023-08-01T19:56:06.004338+0000","last_change":"2023-08-01T19:55:59.562882+0000","last_active":"2023-08-01T19:56:06.004338+0000","last_peered":"2023-08-01T19:56:06.004338+0000","last_clean":"2023-08-01T19:55:57.555234+0000","last_became_active":"2023-08-01T19:55:59.562882+0000","last_became_peered":"2023-08-01T19:55:59.562882+0000","last_unstale":"2023-08-01T19:56:06.004338+0000","last_undegraded":"2023-08-01T19:55:59.558676+0000","last_fullsized":"2023-08-01T19:55:59.558588+0000","mapping_epoch":62,"log_start":"0'0","ondisk_log_start":"0'0","created":15,"last_epoch_clean":41,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-08-01T19:54:03.032665+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-08-01T19:54:03.032665+0000","last_clean_scrub_stamp":"2023-08-01T19:54:03.032665+0000","objects_scrubbed":0,"log_size":6,"ondisk_log_size":6,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-08-03T07:47:09.146014+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":1536,"num_objects":4,"num_object_clones":0,"num_object_copies":8,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":4,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":4,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":6,"num_write_kb":3,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":1,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[2],"acting":[2],"avail_no_missing":["2"],"object_location_counts":[{"shards":"2","objects":4}],"blocked_by":[],"up_primary":2,"acting_primary":2,"purged_snaps":[]},{"pgid":"4.13","version":"0'0","reported_seq":44,"reported_epoch":66,"state":"active+undersized","last_fresh":"2023-08-01T19:56:06.005217+0000","last_change":"2023-08-01T19:55:59.563501+0000","last_active":"2023-08-01T19:56:06.005217+0000","last_peered":"2023-08-01T19:56:06.005217+0000","last_clean":"2023-08-01T19:55:57.555297+0000","last_became_active":"2023-08-01T19:55:59.563501+0000","last_became_peered":"2023-08-01T19:55:59.563501+0000","last_unstale":"2023-08-01T19:56:06.005217+0000","last_undegraded":"2023-08-01T19:56:06.005217+0000","last_fullsized":"2023-08-01T19:55:59.558963+0000","mapping_epoch":62,"log_start":"0'0","ondisk_log_start":"0'0","created":16,"last_epoch_clean":41,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-08-01T19:54:04.040663+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-08-01T19:54:04.040663+0000","last_clean_scrub_stamp":"2023-08-01T19:54:04.040663+0000","objects_scrubbed":0,"log_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-08-03T04:39:45.686110+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[2],"acting":[2],"avail_no_missing":["2"],"object_location_counts":[],"blocked_by":[],"up_primary":2,"acting_primary":2,"purged_snaps":[]},{"pgid":"3.13","version":"17'2","reported_seq":21,"reported_epoch":66,"state":"active+undersized+degraded","last_fresh":"2023-08-01T19:56:06.009664+0000","last_change":"2023-08-01T19:55:59.623467+0000","last_active":"2023-08-01T19:56:06.009664+0000","last_peered":"2023-08-01T19:56:06.009664+0000","last_clean":"2023-08-01T19:54:04.468135+0000","last_became_active":"2023-08-01T19:55:59.623467+0000","last_became_peered":"2023-08-01T19:55:59.623467+0000","last_unstale":"2023-08-01T19:56:06.009664+0000","last_undegraded":"2023-08-01T19:55:59.562671+0000","last_fullsized":"2023-08-01T19:55:59.561494+0000","mapping_epoch":62,"log_start":"0'0","ondisk_log_start":"0'0","created":15,"last_epoch_clean":16,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-08-01T19:54:03.032665+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-08-01T19:54:03.032665+0000","last_clean_scrub_stamp":"2023-08-01T19:54:03.032665+0000","objects_scrubbed":0,"log_size":2,"ondisk_log_size":2,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-08-03T01:34:44.996992+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":34,"num_objects":2,"num_object_clones":0,"num_object_copies":4,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":2,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":2,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":3,"num_write_kb":6,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":1,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[0],"acting":[0],"avail_no_missing":["0"],"object_location_counts":[{"shards":"0","objects":2}],"blocked_by":[],"up_primary":0,"acting_primary":0,"purged_snaps":[]},{"pgid":"4.14","version":"0'0","reported_seq":58,"reported_epoch":66,"state":"active+clean","last_fresh":"2023-08-01T19:56:06.004238+0000","last_change":"2023-08-01T19:54:04.464446+0000","last_active":"2023-08-01T19:56:06.004238+0000","last_peered":"2023-08-01T19:56:06.004238+0000","last_clean":"2023-08-01T19:56:06.004238+0000","last_became_active":"2023-08-01T19:54:04.464021+0000","last_became_peered":"2023-08-01T19:54:04.464021+0000","last_unstale":"2023-08-01T19:56:06.004238+0000","last_undegraded":"2023-08-01T19:56:06.004238+0000","last_fullsized":"2023-08-01T19:56:06.004238+0000","mapping_epoch":16,"log_start":"0'0","ondisk_log_start":"0'0","created":16,"last_epoch_clean":17,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-08-01T19:54:04.040663+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-08-01T19:54:04.040663+0000","last_clean_scrub_stamp":"2023-08-01T19:54:04.040663+0000","objects_scrubbed":0,"log_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-08-02T20:26:51.080849+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[2,0],"acting":[2,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":2,"acting_primary":2,"purged_snaps":[]},{"pgid":"3.12","version":"0'0","reported_seq":65,"reported_epoch":66,"state":"active+undersized","last_fresh":"2023-08-01T19:56:06.009559+0000","last_change":"2023-08-01T19:55:59.627500+0000","last_active":"2023-08-01T19:56:06.009559+0000","last_peered":"2023-08-01T19:56:06.009559+0000","last_clean":"2023-08-01T19:55:57.553607+0000","last_became_active":"2023-08-01T19:55:59.627500+0000","last_became_peered":"2023-08-01T19:55:59.627500+0000","last_unstale":"2023-08-01T19:56:06.009559+0000","last_undegraded":"2023-08-01T19:56:06.009559+0000","last_fullsized":"2023-08-01T19:55:59.562884+0000","mapping_epoch":62,"log_start":"0'0","ondisk_log_start":"0'0","created":15,"last_epoch_clean":16,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-08-01T19:54:03.032665+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-08-01T19:54:03.032665+0000","last_clean_scrub_stamp":"2023-08-01T19:54:03.032665+0000","objects_scrubbed":0,"log_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-08-03T01:58:11.712155+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[0],"acting":[0],"avail_no_missing":["0"],"object_location_counts":[],"blocked_by":[],"up_primary":0,"acting_primary":0,"purged_snaps":[]},{"pgid":"4.15","version":"0'0","reported_seq":58,"reported_epoch":66,"state":"active+clean","last_fresh":"2023-08-01T19:56:06.005678+0000","last_change":"2023-08-01T19:54:04.468791+0000","last_active":"2023-08-01T19:56:06.005678+0000","last_peered":"2023-08-01T19:56:06.005678+0000","last_clean":"2023-08-01T19:56:06.005678+0000","last_became_active":"2023-08-01T19:54:04.468214+0000","last_became_peered":"2023-08-01T19:54:04.468214+0000","last_unstale":"2023-08-01T19:56:06.005678+0000","last_undegraded":"2023-08-01T19:56:06.005678+0000","last_fullsized":"2023-08-01T19:56:06.005678+0000","mapping_epoch":16,"log_start":"0'0","ondisk_log_start":"0'0","created":16,"last_epoch_clean":17,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-08-01T19:54:04.040663+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-08-01T19:54:04.040663+0000","last_clean_scrub_stamp":"2023-08-01T19:54:04.040663+0000","objects_scrubbed":0,"log_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-08-03T04:10:44.729287+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[2,0],"acting":[2,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":2,"acting_primary":2,"purged_snaps":[]},{"pgid":"3.11","version":"0'0","reported_seq":65,"reported_epoch":66,"state":"active+undersized","last_fresh":"2023-08-01T19:56:06.003759+0000","last_change":"2023-08-01T19:55:59.563150+0000","last_active":"2023-08-01T19:56:06.003759+0000","last_peered":"2023-08-01T19:56:06.003759+0000","last_clean":"2023-08-01T19:55:57.555772+0000","last_became_active":"2023-08-01T19:55:59.563150+0000","last_became_peered":"2023-08-01T19:55:59.563150+0000","last_unstale":"2023-08-01T19:56:06.003759+0000","last_undegraded":"2023-08-01T19:56:06.003759+0000","last_fullsized":"2023-08-01T19:55:59.558419+0000","mapping_epoch":62,"log_start":"0'0","ondisk_log_start":"0'0","created":15,"last_epoch_clean":16,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-08-01T19:54:03.032665+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-08-01T19:54:03.032665+0000","last_clean_scrub_stamp":"2023-08-01T19:54:03.032665+0000","objects_scrubbed":0,"log_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-08-03T04:17:37.189798+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[2],"acting":[2],"avail_no_missing":["2"],"object_location_counts":[],"blocked_by":[],"up_primary":2,"acting_primary":2,"purged_snaps":[]},{"pgid":"4.16","version":"0'0","reported_seq":64,"reported_epoch":66,"state":"active+undersized","last_fresh":"2023-08-01T19:56:06.010741+0000","last_change":"2023-08-01T19:55:59.621136+0000","last_active":"2023-08-01T19:56:06.010741+0000","last_peered":"2023-08-01T19:56:06.010741+0000","last_clean":"2023-08-01T19:55:57.554095+0000","last_became_active":"2023-08-01T19:55:59.621136+0000","last_became_peered":"2023-08-01T19:55:59.621136+0000","last_unstale":"2023-08-01T19:56:06.010741+0000","last_undegraded":"2023-08-01T19:56:06.010741+0000","last_fullsized":"2023-08-01T19:55:59.562811+0000","mapping_epoch":62,"log_start":"0'0","ondisk_log_start":"0'0","created":16,"last_epoch_clean":17,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-08-01T19:54:04.040663+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-08-01T19:54:04.040663+0000","last_clean_scrub_stamp":"2023-08-01T19:54:04.040663+0000","objects_scrubbed":0,"log_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-08-02T20:34:36.025944+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[0],"acting":[0],"avail_no_missing":["0"],"object_location_counts":[],"blocked_by":[],"up_primary":0,"acting_primary":0,"purged_snaps":[]},{"pgid":"3.10","version":"17'8","reported_seq":52,"reported_epoch":66,"state":"active+undersized+degraded","last_fresh":"2023-08-01T19:56:06.003809+0000","last_change":"2023-08-01T19:55:59.563318+0000","last_active":"2023-08-01T19:56:06.003809+0000","last_peered":"2023-08-01T19:56:06.003809+0000","last_clean":"2023-08-01T19:55:57.554659+0000","last_became_active":"2023-08-01T19:55:59.563318+0000","last_became_peered":"2023-08-01T19:55:59.563318+0000","last_unstale":"2023-08-01T19:56:06.003809+0000","last_undegraded":"2023-08-01T19:55:59.558832+0000","last_fullsized":"2023-08-01T19:55:59.558760+0000","mapping_epoch":62,"log_start":"0'0","ondisk_log_start":"0'0","created":15,"last_epoch_clean":41,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-08-01T19:54:03.032665+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-08-01T19:54:03.032665+0000","last_clean_scrub_stamp":"2023-08-01T19:54:03.032665+0000","objects_scrubbed":0,"log_size":8,"ondisk_log_size":8,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-08-02T20:11:48.120491+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":4,"num_object_clones":0,"num_object_copies":8,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":4,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":4,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":12,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":4,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[2],"acting":[2],"avail_no_missing":["2"],"object_location_counts":[{"shards":"2","objects":4}],"blocked_by":[],"up_primary":2,"acting_primary":2,"purged_snaps":[]},{"pgid":"4.17","version":"0'0","reported_seq":64,"reported_epoch":66,"state":"active+undersized","last_fresh":"2023-08-01T19:56:06.009409+0000","last_change":"2023-08-01T19:55:59.571364+0000","last_active":"2023-08-01T19:56:06.009409+0000","last_peered":"2023-08-01T19:56:06.009409+0000","last_clean":"2023-08-01T19:55:57.553959+0000","last_became_active":"2023-08-01T19:55:59.571364+0000","last_became_peered":"2023-08-01T19:55:59.571364+0000","last_unstale":"2023-08-01T19:56:06.009409+0000","last_undegraded":"2023-08-01T19:56:06.009409+0000","last_fullsized":"2023-08-01T19:55:59.561680+0000","mapping_epoch":62,"log_start":"0'0","ondisk_log_start":"0'0","created":16,"last_epoch_clean":17,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-08-01T19:54:04.040663+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-08-01T19:54:04.040663+0000","last_clean_scrub_stamp":"2023-08-01T19:54:04.040663+0000","objects_scrubbed":0,"log_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-08-03T04:39:53.203892+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[0],"acting":[0],"avail_no_missing":["0"],"object_location_counts":[],"blocked_by":[],"up_primary":0,"acting_primary":0,"purged_snaps":[]},{"pgid":"5.9","version":"67'13873","reported_seq":13941,"reported_epoch":67,"state":"active+undersized+degraded","last_fresh":"2023-08-01T19:56:11.081539+0000","last_change":"2023-08-01T19:55:59.563393+0000","last_active":"2023-08-01T19:56:11.081539+0000","last_peered":"2023-08-01T19:56:11.081539+0000","last_clean":"2023-08-01T19:55:58.554516+0000","last_became_active":"2023-08-01T19:55:59.563393+0000","last_became_peered":"2023-08-01T19:55:59.563393+0000","last_unstale":"2023-08-01T19:56:11.081539+0000","last_undegraded":"2023-08-01T19:55:59.559406+0000","last_fullsized":"2023-08-01T19:55:59.559323+0000","mapping_epoch":62,"log_start":"49'9900","ondisk_log_start":"49'9900","created":19,"last_epoch_clean":41,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-08-01T19:54:22.116710+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-08-01T19:54:22.116710+0000","last_clean_scrub_stamp":"2023-08-01T19:54:22.116710+0000","objects_scrubbed":0,"log_size":3973,"ondisk_log_size":3973,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-08-03T00:26:30.570859+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":191037440,"num_objects":2915,"num_object_clones":0,"num_object_copies":5830,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":2915,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":2915,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":13873,"num_write_kb":537216,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[2],"acting":[2],"avail_no_missing":["2"],"object_location_counts":[{"shards":"2","objects":2915}],"blocked_by":[],"up_primary":2,"acting_primary":2,"purged_snaps":[]},{"pgid":"3.f","version":"17'1","reported_seq":21,"reported_epoch":66,"state":"active+undersized+degraded","last_fresh":"2023-08-01T19:56:06.004677+0000","last_change":"2023-08-01T19:55:59.563731+0000","last_active":"2023-08-01T19:56:06.004677+0000","last_peered":"2023-08-01T19:56:06.004677+0000","last_clean":"2023-08-01T19:54:04.469403+0000","last_became_active":"2023-08-01T19:55:59.563731+0000","last_became_peered":"2023-08-01T19:55:59.563731+0000","last_unstale":"2023-08-01T19:56:06.004677+0000","last_undegraded":"2023-08-01T19:55:59.560115+0000","last_fullsized":"2023-08-01T19:55:59.560030+0000","mapping_epoch":62,"log_start":"0'0","ondisk_log_start":"0'0","created":15,"last_epoch_clean":16,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-08-01T19:54:03.032665+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-08-01T19:54:03.032665+0000","last_clean_scrub_stamp":"2023-08-01T19:54:03.032665+0000","objects_scrubbed":0,"log_size":1,"ondisk_log_size":1,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-08-03T01:57:15.720908+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":22,"num_objects":1,"num_object_clones":0,"num_object_copies":2,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":1,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":1,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":1,"num_write_kb":1,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[2],"acting":[2],"avail_no_missing":["2"],"object_location_counts":[{"shards":"2","objects":1}],"blocked_by":[],"up_primary":2,"acting_primary":2,"purged_snaps":[]},{"pgid":"4.8","version":"0'0","reported_seq":64,"reported_epoch":66,"state":"active+undersized","last_fresh":"2023-08-01T19:56:06.003513+0000","last_change":"2023-08-01T19:55:59.562949+0000","last_active":"2023-08-01T19:56:06.003513+0000","last_peered":"2023-08-01T19:56:06.003513+0000","last_clean":"2023-08-01T19:55:57.554422+0000","last_became_active":"2023-08-01T19:55:59.562949+0000","last_became_peered":"2023-08-01T19:55:59.562949+0000","last_unstale":"2023-08-01T19:56:06.003513+0000","last_undegraded":"2023-08-01T19:56:06.003513+0000","last_fullsized":"2023-08-01T19:55:59.557986+0000","mapping_epoch":62,"log_start":"0'0","ondisk_log_start":"0'0","created":16,"last_epoch_clean":17,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-08-01T19:54:04.040663+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-08-01T19:54:04.040663+0000","last_clean_scrub_stamp":"2023-08-01T19:54:04.040663+0000","objects_scrubbed":0,"log_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-08-03T05:35:01.917792+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[2],"acting":[2],"avail_no_missing":["2"],"object_location_counts":[],"blocked_by":[],"up_primary":2,"acting_primary":2,"purged_snaps":[]},{"pgid":"5.8","version":"67'13855","reported_seq":13910,"reported_epoch":67,"state":"active+clean","last_fresh":"2023-08-01T19:56:11.093124+0000","last_change":"2023-08-01T19:54:23.139383+0000","last_active":"2023-08-01T19:56:11.093124+0000","last_peered":"2023-08-01T19:56:11.093124+0000","last_clean":"2023-08-01T19:56:11.093124+0000","last_became_active":"2023-08-01T19:54:23.139198+0000","last_became_peered":"2023-08-01T19:54:23.139198+0000","last_unstale":"2023-08-01T19:56:11.093124+0000","last_undegraded":"2023-08-01T19:56:11.093124+0000","last_fullsized":"2023-08-01T19:56:11.093124+0000","mapping_epoch":19,"log_start":"50'9900","ondisk_log_start":"50'9900","created":19,"last_epoch_clean":20,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-08-01T19:54:22.116710+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-08-01T19:54:22.116710+0000","last_clean_scrub_stamp":"2023-08-01T19:54:22.116710+0000","objects_scrubbed":0,"log_size":3955,"ondisk_log_size":3955,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-08-03T05:20:31.724064+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":193527808,"num_objects":2953,"num_object_clones":0,"num_object_copies":5906,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":2953,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":13855,"num_write_kb":537856,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[2,0],"acting":[2,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":2,"acting_primary":2,"purged_snaps":[]},{"pgid":"3.e","version":"17'2","reported_seq":67,"reported_epoch":66,"state":"active+undersized+degraded","last_fresh":"2023-08-01T19:56:06.004630+0000","last_change":"2023-08-01T19:55:59.564064+0000","last_active":"2023-08-01T19:56:06.004630+0000","last_peered":"2023-08-01T19:56:06.004630+0000","last_clean":"2023-08-01T19:55:57.555251+0000","last_became_active":"2023-08-01T19:55:59.564064+0000","last_became_peered":"2023-08-01T19:55:59.564064+0000","last_unstale":"2023-08-01T19:56:06.004630+0000","last_undegraded":"2023-08-01T19:55:59.560133+0000","last_fullsized":"2023-08-01T19:55:59.560059+0000","mapping_epoch":62,"log_start":"0'0","ondisk_log_start":"0'0","created":15,"last_epoch_clean":16,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-08-01T19:54:03.032665+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-08-01T19:54:03.032665+0000","last_clean_scrub_stamp":"2023-08-01T19:54:03.032665+0000","objects_scrubbed":0,"log_size":2,"ondisk_log_size":2,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-08-02T20:14:07.978554+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":1,"num_object_clones":0,"num_object_copies":2,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":1,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":1,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":3,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":1,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[2],"acting":[2],"avail_no_missing":["2"],"object_location_counts":[{"shards":"2","objects":1}],"blocked_by":[],"up_primary":2,"acting_primary":2,"purged_snaps":[]},{"pgid":"4.9","version":"0'0","reported_seq":58,"reported_epoch":66,"state":"active+clean","last_fresh":"2023-08-01T19:56:06.003875+0000","last_change":"2023-08-01T19:54:04.468007+0000","last_active":"2023-08-01T19:56:06.003875+0000","last_peered":"2023-08-01T19:56:06.003875+0000","last_clean":"2023-08-01T19:56:06.003875+0000","last_became_active":"2023-08-01T19:54:04.467509+0000","last_became_peered":"2023-08-01T19:54:04.467509+0000","last_unstale":"2023-08-01T19:56:06.003875+0000","last_undegraded":"2023-08-01T19:56:06.003875+0000","last_fullsized":"2023-08-01T19:56:06.003875+0000","mapping_epoch":16,"log_start":"0'0","ondisk_log_start":"0'0","created":16,"last_epoch_clean":17,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-08-01T19:54:04.040663+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-08-01T19:54:04.040663+0000","last_clean_scrub_stamp":"2023-08-01T19:54:04.040663+0000","objects_scrubbed":0,"log_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-08-03T06:04:50.963711+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[2,0],"acting":[2,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":2,"acting_primary":2,"purged_snaps":[]},{"pgid":"5.b","version":"67'13702","reported_seq":13757,"reported_epoch":67,"state":"active+clean","last_fresh":"2023-08-01T19:56:11.087291+0000","last_change":"2023-08-01T19:54:23.138143+0000","last_active":"2023-08-01T19:56:11.087291+0000","last_peered":"2023-08-01T19:56:11.087291+0000","last_clean":"2023-08-01T19:56:11.087291+0000","last_became_active":"2023-08-01T19:54:23.137922+0000","last_became_peered":"2023-08-01T19:54:23.137922+0000","last_unstale":"2023-08-01T19:56:11.087291+0000","last_undegraded":"2023-08-01T19:56:11.087291+0000","last_fullsized":"2023-08-01T19:56:11.087291+0000","mapping_epoch":19,"log_start":"49'9700","ondisk_log_start":"49'9700","created":19,"last_epoch_clean":20,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-08-01T19:54:22.116710+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-08-01T19:54:22.116710+0000","last_clean_scrub_stamp":"2023-08-01T19:54:22.116710+0000","objects_scrubbed":0,"log_size":4002,"ondisk_log_size":4002,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-08-02T23:27:13.080055+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":190316544,"num_objects":2904,"num_object_clones":0,"num_object_copies":5808,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":2904,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":13702,"num_write_kb":531392,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[2,0],"acting":[2,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":2,"acting_primary":2,"purged_snaps":[]},{"pgid":"3.d","version":"17'1","reported_seq":21,"reported_epoch":66,"state":"active+undersized+degraded","last_fresh":"2023-08-01T19:56:06.005434+0000","last_change":"2023-08-01T19:55:59.565536+0000","last_active":"2023-08-01T19:56:06.005434+0000","last_peered":"2023-08-01T19:56:06.005434+0000","last_clean":"2023-08-01T19:54:04.468649+0000","last_became_active":"2023-08-01T19:55:59.565536+0000","last_became_peered":"2023-08-01T19:55:59.565536+0000","last_unstale":"2023-08-01T19:56:06.005434+0000","last_undegraded":"2023-08-01T19:55:59.559959+0000","last_fullsized":"2023-08-01T19:55:59.559536+0000","mapping_epoch":62,"log_start":"0'0","ondisk_log_start":"0'0","created":15,"last_epoch_clean":16,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-08-01T19:54:03.032665+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-08-01T19:54:03.032665+0000","last_clean_scrub_stamp":"2023-08-01T19:54:03.032665+0000","objects_scrubbed":0,"log_size":1,"ondisk_log_size":1,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-08-03T06:18:54.331259+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":70,"num_objects":1,"num_object_clones":0,"num_object_copies":2,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":1,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":1,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":1,"num_write_kb":1,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[2],"acting":[2],"avail_no_missing":["2"],"object_location_counts":[{"shards":"2","objects":1}],"blocked_by":[],"up_primary":2,"acting_primary":2,"purged_snaps":[]},{"pgid":"4.a","version":"0'0","reported_seq":13,"reported_epoch":66,"state":"active+undersized","last_fresh":"2023-08-01T19:56:06.008509+0000","last_change":"2023-08-01T19:55:59.627323+0000","last_active":"2023-08-01T19:56:06.008509+0000","last_peered":"2023-08-01T19:56:06.008509+0000","last_clean":"2023-08-01T19:54:04.040663+0000","last_became_active":"2023-08-01T19:55:59.627323+0000","last_became_peered":"2023-08-01T19:55:59.627323+0000","last_unstale":"2023-08-01T19:56:06.008509+0000","last_undegraded":"2023-08-01T19:56:06.008509+0000","last_fullsized":"2023-08-01T19:55:59.560725+0000","mapping_epoch":62,"log_start":"0'0","ondisk_log_start":"0'0","created":16,"last_epoch_clean":17,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-08-01T19:54:04.040663+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-08-01T19:54:04.040663+0000","last_clean_scrub_stamp":"2023-08-01T19:54:04.040663+0000","objects_scrubbed":0,"log_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-08-02T22:47:41.570583+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[0],"acting":[0],"avail_no_missing":["0"],"object_location_counts":[],"blocked_by":[],"up_primary":0,"acting_primary":0,"purged_snaps":[]},{"pgid":"5.a","version":"67'13586","reported_seq":13639,"reported_epoch":67,"state":"active+clean","last_fresh":"2023-08-01T19:56:09.985654+0000","last_change":"2023-08-01T19:54:23.138147+0000","last_active":"2023-08-01T19:56:09.985654+0000","last_peered":"2023-08-01T19:56:09.985654+0000","last_clean":"2023-08-01T19:56:09.985654+0000","last_became_active":"2023-08-01T19:54:23.137827+0000","last_became_peered":"2023-08-01T19:54:23.137827+0000","last_unstale":"2023-08-01T19:56:09.985654+0000","last_undegraded":"2023-08-01T19:56:09.985654+0000","last_fullsized":"2023-08-01T19:56:09.985654+0000","mapping_epoch":19,"log_start":"50'10000","ondisk_log_start":"50'10000","created":19,"last_epoch_clean":20,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-08-01T19:54:22.116710+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-08-01T19:54:22.116710+0000","last_clean_scrub_stamp":"2023-08-01T19:54:22.116710+0000","objects_scrubbed":0,"log_size":3586,"ondisk_log_size":3586,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-08-03T05:22:32.106433+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":195690496,"num_objects":2986,"num_object_clones":0,"num_object_copies":5972,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":2986,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":13586,"num_write_kb":530304,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[0,2],"acting":[0,2],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":0,"acting_primary":0,"purged_snaps":[]},{"pgid":"3.c","version":"0'0","reported_seq":13,"reported_epoch":66,"state":"active+undersized","last_fresh":"2023-08-01T19:56:06.008770+0000","last_change":"2023-08-01T19:55:59.621960+0000","last_active":"2023-08-01T19:56:06.008770+0000","last_peered":"2023-08-01T19:56:06.008770+0000","last_clean":"2023-08-01T19:54:03.032665+0000","last_became_active":"2023-08-01T19:55:59.621960+0000","last_became_peered":"2023-08-01T19:55:59.621960+0000","last_unstale":"2023-08-01T19:56:06.008770+0000","last_undegraded":"2023-08-01T19:56:06.008770+0000","last_fullsized":"2023-08-01T19:55:59.562895+0000","mapping_epoch":62,"log_start":"0'0","ondisk_log_start":"0'0","created":15,"last_epoch_clean":16,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-08-01T19:54:03.032665+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-08-01T19:54:03.032665+0000","last_clean_scrub_stamp":"2023-08-01T19:54:03.032665+0000","objects_scrubbed":0,"log_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-08-02T20:52:18.900428+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[0],"acting":[0],"avail_no_missing":["0"],"object_location_counts":[],"blocked_by":[],"up_primary":0,"acting_primary":0,"purged_snaps":[]},{"pgid":"4.b","version":"0'0","reported_seq":64,"reported_epoch":66,"state":"active+undersized","last_fresh":"2023-08-01T19:56:06.009455+0000","last_change":"2023-08-01T19:55:59.622626+0000","last_active":"2023-08-01T19:56:06.009455+0000","last_peered":"2023-08-01T19:56:06.009455+0000","last_clean":"2023-08-01T19:55:57.553632+0000","last_became_active":"2023-08-01T19:55:59.622626+0000","last_became_peered":"2023-08-01T19:55:59.622626+0000","last_unstale":"2023-08-01T19:56:06.009455+0000","last_undegraded":"2023-08-01T19:56:06.009455+0000","last_fullsized":"2023-08-01T19:55:59.561109+0000","mapping_epoch":62,"log_start":"0'0","ondisk_log_start":"0'0","created":16,"last_epoch_clean":17,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-08-01T19:54:04.040663+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-08-01T19:54:04.040663+0000","last_clean_scrub_stamp":"2023-08-01T19:54:04.040663+0000","objects_scrubbed":0,"log_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-08-03T01:54:08.999648+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[0],"acting":[0],"avail_no_missing":["0"],"object_location_counts":[],"blocked_by":[],"up_primary":0,"acting_primary":0,"purged_snaps":[]},{"pgid":"5.d","version":"67'13522","reported_seq":13584,"reported_epoch":67,"state":"active+undersized+degraded","last_fresh":"2023-08-01T19:56:11.059803+0000","last_change":"2023-08-01T19:55:59.565872+0000","last_active":"2023-08-01T19:56:11.059803+0000","last_peered":"2023-08-01T19:56:11.059803+0000","last_clean":"2023-08-01T19:55:58.548569+0000","last_became_active":"2023-08-01T19:55:59.565872+0000","last_became_peered":"2023-08-01T19:55:59.565872+0000","last_unstale":"2023-08-01T19:56:11.059803+0000","last_undegraded":"2023-08-01T19:55:59.560398+0000","last_fullsized":"2023-08-01T19:55:59.560355+0000","mapping_epoch":62,"log_start":"49'9500","ondisk_log_start":"49'9500","created":19,"last_epoch_clean":20,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-08-01T19:54:22.116710+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-08-01T19:54:22.116710+0000","last_clean_scrub_stamp":"2023-08-01T19:54:22.116710+0000","objects_scrubbed":0,"log_size":4022,"ondisk_log_size":4022,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-08-03T04:07:05.896239+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":189464600,"num_objects":2892,"num_object_clones":0,"num_object_copies":5784,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":2892,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":2892,"num_whiteouts":0,"num_read":1,"num_read_kb":1,"num_write":13522,"num_write_kb":525185,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[2],"acting":[2],"avail_no_missing":["2"],"object_location_counts":[{"shards":"2","objects":2892}],"blocked_by":[],"up_primary":2,"acting_primary":2,"purged_snaps":[]},{"pgid":"3.b","version":"17'2","reported_seq":67,"reported_epoch":66,"state":"active+undersized+degraded","last_fresh":"2023-08-01T19:56:06.009315+0000","last_change":"2023-08-01T19:55:59.622524+0000","last_active":"2023-08-01T19:56:06.009315+0000","last_peered":"2023-08-01T19:56:06.009315+0000","last_clean":"2023-08-01T19:55:57.553453+0000","last_became_active":"2023-08-01T19:55:59.622524+0000","last_became_peered":"2023-08-01T19:55:59.622524+0000","last_unstale":"2023-08-01T19:56:06.009315+0000","last_undegraded":"2023-08-01T19:55:59.560397+0000","last_fullsized":"2023-08-01T19:55:59.560287+0000","mapping_epoch":62,"log_start":"0'0","ondisk_log_start":"0'0","created":15,"last_epoch_clean":16,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-08-01T19:54:03.032665+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-08-01T19:54:03.032665+0000","last_clean_scrub_stamp":"2023-08-01T19:54:03.032665+0000","objects_scrubbed":0,"log_size":2,"ondisk_log_size":2,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-08-02T22:03:16.863353+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":1,"num_object_clones":0,"num_object_copies":2,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":1,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":1,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":1,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":1,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[0],"acting":[0],"avail_no_missing":["0"],"object_location_counts":[{"shards":"0","objects":1}],"blocked_by":[],"up_primary":0,"acting_primary":0,"purged_snaps":[]},{"pgid":"4.c","version":"0'0","reported_seq":13,"reported_epoch":66,"state":"active+undersized","last_fresh":"2023-08-01T19:56:06.008088+0000","last_change":"2023-08-01T19:55:59.621540+0000","last_active":"2023-08-01T19:56:06.008088+0000","last_peered":"2023-08-01T19:56:06.008088+0000","last_clean":"2023-08-01T19:54:04.040663+0000","last_became_active":"2023-08-01T19:55:59.621540+0000","last_became_peered":"2023-08-01T19:55:59.621540+0000","last_unstale":"2023-08-01T19:56:06.008088+0000","last_undegraded":"2023-08-01T19:56:06.008088+0000","last_fullsized":"2023-08-01T19:55:59.559909+0000","mapping_epoch":62,"log_start":"0'0","ondisk_log_start":"0'0","created":16,"last_epoch_clean":17,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-08-01T19:54:04.040663+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-08-01T19:54:04.040663+0000","last_clean_scrub_stamp":"2023-08-01T19:54:04.040663+0000","objects_scrubbed":0,"log_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-08-02T22:55:29.789790+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[0],"acting":[0],"avail_no_missing":["0"],"object_location_counts":[],"blocked_by":[],"up_primary":0,"acting_primary":0,"purged_snaps":[]},{"pgid":"5.c","version":"67'13635","reported_seq":13694,"reported_epoch":67,"state":"active+undersized+degraded","last_fresh":"2023-08-01T19:56:09.964075+0000","last_change":"2023-08-01T19:55:59.568457+0000","last_active":"2023-08-01T19:56:09.964075+0000","last_peered":"2023-08-01T19:56:09.964075+0000","last_clean":"2023-08-01T19:55:58.546577+0000","last_became_active":"2023-08-01T19:55:59.568457+0000","last_became_peered":"2023-08-01T19:55:59.568457+0000","last_unstale":"2023-08-01T19:56:09.964075+0000","last_undegraded":"2023-08-01T19:55:59.560219+0000","last_fullsized":"2023-08-01T19:55:59.560128+0000","mapping_epoch":62,"log_start":"50'10100","ondisk_log_start":"50'10100","created":19,"last_epoch_clean":20,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-08-01T19:54:22.116710+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-08-01T19:54:22.116710+0000","last_clean_scrub_stamp":"2023-08-01T19:54:22.116710+0000","objects_scrubbed":0,"log_size":3535,"ondisk_log_size":3535,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-08-03T05:54:21.741036+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":194838528,"num_objects":2973,"num_object_clones":0,"num_object_copies":5946,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":2973,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":2973,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":13635,"num_write_kb":531456,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[0],"acting":[0],"avail_no_missing":["0"],"object_location_counts":[{"shards":"0","objects":2973}],"blocked_by":[],"up_primary":0,"acting_primary":0,"purged_snaps":[]},{"pgid":"3.a","version":"0'0","reported_seq":44,"reported_epoch":66,"state":"active+undersized","last_fresh":"2023-08-01T19:56:06.008617+0000","last_change":"2023-08-01T19:55:59.627263+0000","last_active":"2023-08-01T19:56:06.008617+0000","last_peered":"2023-08-01T19:56:06.008617+0000","last_clean":"2023-08-01T19:55:57.553231+0000","last_became_active":"2023-08-01T19:55:59.627263+0000","last_became_peered":"2023-08-01T19:55:59.627263+0000","last_unstale":"2023-08-01T19:56:06.008617+0000","last_undegraded":"2023-08-01T19:56:06.008617+0000","last_fullsized":"2023-08-01T19:55:59.561274+0000","mapping_epoch":62,"log_start":"0'0","ondisk_log_start":"0'0","created":15,"last_epoch_clean":41,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-08-01T19:54:03.032665+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-08-01T19:54:03.032665+0000","last_clean_scrub_stamp":"2023-08-01T19:54:03.032665+0000","objects_scrubbed":0,"log_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-08-03T00:05:24.381186+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[0],"acting":[0],"avail_no_missing":["0"],"object_location_counts":[],"blocked_by":[],"up_primary":0,"acting_primary":0,"purged_snaps":[]},{"pgid":"4.d","version":"0'0","reported_seq":13,"reported_epoch":66,"state":"active+undersized","last_fresh":"2023-08-01T19:56:06.005427+0000","last_change":"2023-08-01T19:55:59.565047+0000","last_active":"2023-08-01T19:56:06.005427+0000","last_peered":"2023-08-01T19:56:06.005427+0000","last_clean":"2023-08-01T19:54:04.040663+0000","last_became_active":"2023-08-01T19:55:59.565047+0000","last_became_peered":"2023-08-01T19:55:59.565047+0000","last_unstale":"2023-08-01T19:56:06.005427+0000","last_undegraded":"2023-08-01T19:56:06.005427+0000","last_fullsized":"2023-08-01T19:55:59.559265+0000","mapping_epoch":62,"log_start":"0'0","ondisk_log_start":"0'0","created":16,"last_epoch_clean":17,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-08-01T19:54:04.040663+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-08-01T19:54:04.040663+0000","last_clean_scrub_stamp":"2023-08-01T19:54:04.040663+0000","objects_scrubbed":0,"log_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-08-02T20:07:37.690967+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[2],"acting":[2],"avail_no_missing":["2"],"object_location_counts":[],"blocked_by":[],"up_primary":2,"acting_primary":2,"purged_snaps":[]},{"pgid":"5.f","version":"67'13915","reported_seq":13984,"reported_epoch":67,"state":"active+undersized+degraded","last_fresh":"2023-08-01T19:56:11.072042+0000","last_change":"2023-08-01T19:55:59.564292+0000","last_active":"2023-08-01T19:56:11.072042+0000","last_peered":"2023-08-01T19:56:11.072042+0000","last_clean":"2023-08-01T19:55:58.539522+0000","last_became_active":"2023-08-01T19:55:59.564292+0000","last_became_peered":"2023-08-01T19:55:59.564292+0000","last_unstale":"2023-08-01T19:56:11.072042+0000","last_undegraded":"2023-08-01T19:55:59.560326+0000","last_fullsized":"2023-08-01T19:55:59.560248+0000","mapping_epoch":62,"log_start":"50'9900","ondisk_log_start":"50'9900","created":19,"last_epoch_clean":41,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-08-01T19:54:22.116710+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-08-01T19:54:22.116710+0000","last_clean_scrub_stamp":"2023-08-01T19:54:22.116710+0000","objects_scrubbed":0,"log_size":4015,"ondisk_log_size":4015,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-08-03T00:20:56.314414+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":187236352,"num_objects":2857,"num_object_clones":0,"num_object_copies":5714,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":2857,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":2857,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":13915,"num_write_kb":536704,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[2],"acting":[2],"avail_no_missing":["2"],"object_location_counts":[{"shards":"2","objects":2857}],"blocked_by":[],"up_primary":2,"acting_primary":2,"purged_snaps":[]},{"pgid":"3.9","version":"0'0","reported_seq":65,"reported_epoch":66,"state":"active+undersized","last_fresh":"2023-08-01T19:56:06.003547+0000","last_change":"2023-08-01T19:55:59.560963+0000","last_active":"2023-08-01T19:56:06.003547+0000","last_peered":"2023-08-01T19:56:06.003547+0000","last_clean":"2023-08-01T19:55:57.554915+0000","last_became_active":"2023-08-01T19:55:59.560963+0000","last_became_peered":"2023-08-01T19:55:59.560963+0000","last_unstale":"2023-08-01T19:56:06.003547+0000","last_undegraded":"2023-08-01T19:56:06.003547+0000","last_fullsized":"2023-08-01T19:55:59.557978+0000","mapping_epoch":62,"log_start":"0'0","ondisk_log_start":"0'0","created":15,"last_epoch_clean":16,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-08-01T19:54:03.032665+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-08-01T19:54:03.032665+0000","last_clean_scrub_stamp":"2023-08-01T19:54:03.032665+0000","objects_scrubbed":0,"log_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-08-03T04:02:17.487101+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[2],"acting":[2],"avail_no_missing":["2"],"object_location_counts":[],"blocked_by":[],"up_primary":2,"acting_primary":2,"purged_snaps":[]},{"pgid":"4.e","version":"0'0","reported_seq":44,"reported_epoch":66,"state":"active+undersized","last_fresh":"2023-08-01T19:56:06.004359+0000","last_change":"2023-08-01T19:55:59.563121+0000","last_active":"2023-08-01T19:56:06.004359+0000","last_peered":"2023-08-01T19:56:06.004359+0000","last_clean":"2023-08-01T19:55:57.555080+0000","last_became_active":"2023-08-01T19:55:59.563121+0000","last_became_peered":"2023-08-01T19:55:59.563121+0000","last_unstale":"2023-08-01T19:56:06.004359+0000","last_undegraded":"2023-08-01T19:56:06.004359+0000","last_fullsized":"2023-08-01T19:55:59.559384+0000","mapping_epoch":62,"log_start":"0'0","ondisk_log_start":"0'0","created":16,"last_epoch_clean":41,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-08-01T19:54:04.040663+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-08-01T19:54:04.040663+0000","last_clean_scrub_stamp":"2023-08-01T19:54:04.040663+0000","objects_scrubbed":0,"log_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-08-02T22:50:57.372982+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[2],"acting":[2],"avail_no_missing":["2"],"object_location_counts":[],"blocked_by":[],"up_primary":2,"acting_primary":2,"purged_snaps":[]},{"pgid":"5.e","version":"67'13848","reported_seq":13902,"reported_epoch":67,"state":"active+clean","last_fresh":"2023-08-01T19:56:11.092956+0000","last_change":"2023-08-01T19:54:23.138341+0000","last_active":"2023-08-01T19:56:11.092956+0000","last_peered":"2023-08-01T19:56:11.092956+0000","last_clean":"2023-08-01T19:56:11.092956+0000","last_became_active":"2023-08-01T19:54:23.138119+0000","last_became_peered":"2023-08-01T19:54:23.138119+0000","last_unstale":"2023-08-01T19:56:11.092956+0000","last_undegraded":"2023-08-01T19:56:11.092956+0000","last_fullsized":"2023-08-01T19:56:11.092956+0000","mapping_epoch":19,"log_start":"49'9900","ondisk_log_start":"49'9900","created":19,"last_epoch_clean":20,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-08-01T19:54:22.116710+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-08-01T19:54:22.116710+0000","last_clean_scrub_stamp":"2023-08-01T19:54:22.116710+0000","objects_scrubbed":0,"log_size":3948,"ondisk_log_size":3948,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-08-03T07:48:27.709982+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":189005824,"num_objects":2884,"num_object_clones":0,"num_object_copies":5768,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":2884,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":13848,"num_write_kb":535424,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[2,0],"acting":[2,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":2,"acting_primary":2,"purged_snaps":[]},{"pgid":"3.8","version":"0'0","reported_seq":59,"reported_epoch":66,"state":"active+clean","last_fresh":"2023-08-01T19:56:06.003710+0000","last_change":"2023-08-01T19:54:04.063990+0000","last_active":"2023-08-01T19:56:06.003710+0000","last_peered":"2023-08-01T19:56:06.003710+0000","last_clean":"2023-08-01T19:56:06.003710+0000","last_became_active":"2023-08-01T19:54:04.063652+0000","last_became_peered":"2023-08-01T19:54:04.063652+0000","last_unstale":"2023-08-01T19:56:06.003710+0000","last_undegraded":"2023-08-01T19:56:06.003710+0000","last_fullsized":"2023-08-01T19:56:06.003710+0000","mapping_epoch":15,"log_start":"0'0","ondisk_log_start":"0'0","created":15,"last_epoch_clean":16,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-08-01T19:54:03.032665+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-08-01T19:54:03.032665+0000","last_clean_scrub_stamp":"2023-08-01T19:54:03.032665+0000","objects_scrubbed":0,"log_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-08-03T05:30:28.028091+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[2,0],"acting":[2,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":2,"acting_primary":2,"purged_snaps":[]},{"pgid":"4.f","version":"0'0","reported_seq":58,"reported_epoch":66,"state":"active+clean","last_fresh":"2023-08-01T19:56:06.008771+0000","last_change":"2023-08-01T19:54:04.469648+0000","last_active":"2023-08-01T19:56:06.008771+0000","last_peered":"2023-08-01T19:56:06.008771+0000","last_clean":"2023-08-01T19:56:06.008771+0000","last_became_active":"2023-08-01T19:54:04.468445+0000","last_became_peered":"2023-08-01T19:54:04.468445+0000","last_unstale":"2023-08-01T19:56:06.008771+0000","last_undegraded":"2023-08-01T19:56:06.008771+0000","last_fullsized":"2023-08-01T19:56:06.008771+0000","mapping_epoch":16,"log_start":"0'0","ondisk_log_start":"0'0","created":16,"last_epoch_clean":17,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-08-01T19:54:04.040663+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-08-01T19:54:04.040663+0000","last_clean_scrub_stamp":"2023-08-01T19:54:04.040663+0000","objects_scrubbed":0,"log_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-08-03T05:46:11.085577+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[0,2],"acting":[0,2],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":0,"acting_primary":0,"purged_snaps":[]},{"pgid":"5.3","version":"67'13856","reported_seq":13917,"reported_epoch":67,"state":"active+undersized+degraded","last_fresh":"2023-08-01T19:56:09.959413+0000","last_change":"2023-08-01T19:55:59.568332+0000","last_active":"2023-08-01T19:56:09.959413+0000","last_peered":"2023-08-01T19:56:09.959413+0000","last_clean":"2023-08-01T19:55:58.559012+0000","last_became_active":"2023-08-01T19:55:59.568332+0000","last_became_peered":"2023-08-01T19:55:59.568332+0000","last_unstale":"2023-08-01T19:56:09.959413+0000","last_undegraded":"2023-08-01T19:55:59.559588+0000","last_fullsized":"2023-08-01T19:55:59.559503+0000","mapping_epoch":62,"log_start":"50'10300","ondisk_log_start":"50'10300","created":19,"last_epoch_clean":20,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-08-01T19:54:22.116710+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-08-01T19:54:22.116710+0000","last_clean_scrub_stamp":"2023-08-01T19:54:22.116710+0000","objects_scrubbed":0,"log_size":3556,"ondisk_log_size":3556,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-08-03T00:14:40.397704+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":203161600,"num_objects":3100,"num_object_clones":0,"num_object_copies":6200,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":3100,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":3100,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":13856,"num_write_kb":542592,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[0],"acting":[0],"avail_no_missing":["0"],"object_location_counts":[{"shards":"0","objects":3100}],"blocked_by":[],"up_primary":0,"acting_primary":0,"purged_snaps":[]},{"pgid":"2.4","version":"0'0","reported_seq":25,"reported_epoch":66,"state":"active+clean","last_fresh":"2023-08-01T19:56:06.004471+0000","last_change":"2023-08-01T19:55:45.082520+0000","last_active":"2023-08-01T19:56:06.004471+0000","last_peered":"2023-08-01T19:56:06.004471+0000","last_clean":"2023-08-01T19:56:06.004471+0000","last_became_active":"2023-08-01T19:55:45.081842+0000","last_became_peered":"2023-08-01T19:55:45.081842+0000","last_unstale":"2023-08-01T19:56:06.004471+0000","last_undegraded":"2023-08-01T19:56:06.004471+0000","last_fullsized":"2023-08-01T19:56:06.004471+0000","mapping_epoch":53,"log_start":"0'0","ondisk_log_start":"0'0","created":12,"last_epoch_clean":54,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-08-01T19:53:57.959448+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-08-01T19:53:57.959448+0000","last_clean_scrub_stamp":"2023-08-01T19:53:57.959448+0000","objects_scrubbed":0,"log_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-08-03T06:33:27.745291+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[2,0],"acting":[2,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":2,"acting_primary":2,"purged_snaps":[]},{"pgid":"3.5","version":"0'0","reported_seq":44,"reported_epoch":66,"state":"active+undersized","last_fresh":"2023-08-01T19:56:06.009552+0000","last_change":"2023-08-01T19:55:59.623574+0000","last_active":"2023-08-01T19:56:06.009552+0000","last_peered":"2023-08-01T19:56:06.009552+0000","last_clean":"2023-08-01T19:55:57.553517+0000","last_became_active":"2023-08-01T19:55:59.623574+0000","last_became_peered":"2023-08-01T19:55:59.623574+0000","last_unstale":"2023-08-01T19:56:06.009552+0000","last_undegraded":"2023-08-01T19:56:06.009552+0000","last_fullsized":"2023-08-01T19:55:59.560537+0000","mapping_epoch":62,"log_start":"0'0","ondisk_log_start":"0'0","created":15,"last_epoch_clean":41,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-08-01T19:54:03.032665+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-08-01T19:54:03.032665+0000","last_clean_scrub_stamp":"2023-08-01T19:54:03.032665+0000","objects_scrubbed":0,"log_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-08-03T04:50:30.181229+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[0],"acting":[0],"avail_no_missing":["0"],"object_location_counts":[],"blocked_by":[],"up_primary":0,"acting_primary":0,"purged_snaps":[]},{"pgid":"4.2","version":"0'0","reported_seq":64,"reported_epoch":66,"state":"active+undersized","last_fresh":"2023-08-01T19:56:06.004001+0000","last_change":"2023-08-01T19:55:59.563169+0000","last_active":"2023-08-01T19:56:06.004001+0000","last_peered":"2023-08-01T19:56:06.004001+0000","last_clean":"2023-08-01T19:55:57.556883+0000","last_became_active":"2023-08-01T19:55:59.563169+0000","last_became_peered":"2023-08-01T19:55:59.563169+0000","last_unstale":"2023-08-01T19:56:06.004001+0000","last_undegraded":"2023-08-01T19:56:06.004001+0000","last_fullsized":"2023-08-01T19:55:59.558595+0000","mapping_epoch":62,"log_start":"0'0","ondisk_log_start":"0'0","created":16,"last_epoch_clean":17,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-08-01T19:54:04.040663+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-08-01T19:54:04.040663+0000","last_clean_scrub_stamp":"2023-08-01T19:54:04.040663+0000","objects_scrubbed":0,"log_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-08-03T05:56:55.653213+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[2],"acting":[2],"avail_no_missing":["2"],"object_location_counts":[],"blocked_by":[],"up_primary":2,"acting_primary":2,"purged_snaps":[]},{"pgid":"5.5","version":"67'13546","reported_seq":13620,"reported_epoch":67,"state":"active+undersized+degraded","last_fresh":"2023-08-01T19:56:09.988248+0000","last_change":"2023-08-01T19:55:59.568522+0000","last_active":"2023-08-01T19:56:09.988248+0000","last_peered":"2023-08-01T19:56:09.988248+0000","last_clean":"2023-08-01T19:55:58.556144+0000","last_became_active":"2023-08-01T19:55:59.568522+0000","last_became_peered":"2023-08-01T19:55:59.568522+0000","last_unstale":"2023-08-01T19:56:09.988248+0000","last_undegraded":"2023-08-01T19:55:59.560224+0000","last_fullsized":"2023-08-01T19:55:59.560097+0000","mapping_epoch":62,"log_start":"50'9927","ondisk_log_start":"50'9927","created":19,"last_epoch_clean":58,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-08-01T19:54:22.116710+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-08-01T19:54:22.116710+0000","last_clean_scrub_stamp":"2023-08-01T19:54:22.116710+0000","objects_scrubbed":0,"log_size":3619,"ondisk_log_size":3619,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-08-03T06:36:53.930956+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":196476928,"num_objects":2998,"num_object_clones":0,"num_object_copies":5996,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":2998,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":2998,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":13546,"num_write_kb":529408,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[0],"acting":[0],"avail_no_missing":["0"],"object_location_counts":[{"shards":"0","objects":2998}],"blocked_by":[],"up_primary":0,"acting_primary":0,"purged_snaps":[]},{"pgid":"2.2","version":"0'0","reported_seq":13,"reported_epoch":66,"state":"active+undersized","last_fresh":"2023-08-01T19:56:06.008893+0000","last_change":"2023-08-01T19:55:59.627445+0000","last_active":"2023-08-01T19:56:06.008893+0000","last_peered":"2023-08-01T19:56:06.008893+0000","last_clean":"2023-08-01T19:53:57.959448+0000","last_became_active":"2023-08-01T19:55:59.627445+0000","last_became_peered":"2023-08-01T19:55:59.627445+0000","last_unstale":"2023-08-01T19:56:06.008893+0000","last_undegraded":"2023-08-01T19:56:06.008893+0000","last_fullsized":"2023-08-01T19:55:59.562807+0000","mapping_epoch":62,"log_start":"0'0","ondisk_log_start":"0'0","created":12,"last_epoch_clean":13,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-08-01T19:53:57.959448+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-08-01T19:53:57.959448+0000","last_clean_scrub_stamp":"2023-08-01T19:53:57.959448+0000","objects_scrubbed":0,"log_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-08-02T20:05:42.378882+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[0],"acting":[0],"avail_no_missing":["0"],"object_location_counts":[],"blocked_by":[],"up_primary":0,"acting_primary":0,"purged_snaps":[]},{"pgid":"3.3","version":"0'0","reported_seq":13,"reported_epoch":66,"state":"active+undersized","last_fresh":"2023-08-01T19:56:06.009843+0000","last_change":"2023-08-01T19:55:59.623240+0000","last_active":"2023-08-01T19:56:06.009843+0000","last_peered":"2023-08-01T19:56:06.009843+0000","last_clean":"2023-08-01T19:54:03.032665+0000","last_became_active":"2023-08-01T19:55:59.623240+0000","last_became_peered":"2023-08-01T19:55:59.623240+0000","last_unstale":"2023-08-01T19:56:06.009843+0000","last_undegraded":"2023-08-01T19:56:06.009843+0000","last_fullsized":"2023-08-01T19:55:59.561640+0000","mapping_epoch":62,"log_start":"0'0","ondisk_log_start":"0'0","created":15,"last_epoch_clean":16,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-08-01T19:54:03.032665+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-08-01T19:54:03.032665+0000","last_clean_scrub_stamp":"2023-08-01T19:54:03.032665+0000","objects_scrubbed":0,"log_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-08-03T06:14:26.272644+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[0],"acting":[0],"avail_no_missing":["0"],"object_location_counts":[],"blocked_by":[],"up_primary":0,"acting_primary":0,"purged_snaps":[]},{"pgid":"4.4","version":"0'0","reported_seq":63,"reported_epoch":66,"state":"active+clean","last_fresh":"2023-08-01T19:56:06.008462+0000","last_change":"2023-08-01T19:55:51.123771+0000","last_active":"2023-08-01T19:56:06.008462+0000","last_peered":"2023-08-01T19:56:06.008462+0000","last_clean":"2023-08-01T19:56:06.008462+0000","last_became_active":"2023-08-01T19:55:51.123234+0000","last_became_peered":"2023-08-01T19:55:51.123234+0000","last_unstale":"2023-08-01T19:56:06.008462+0000","last_undegraded":"2023-08-01T19:56:06.008462+0000","last_fullsized":"2023-08-01T19:56:06.008462+0000","mapping_epoch":57,"log_start":"0'0","ondisk_log_start":"0'0","created":16,"last_epoch_clean":58,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-08-01T19:54:04.040663+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-08-01T19:54:04.040663+0000","last_clean_scrub_stamp":"2023-08-01T19:54:04.040663+0000","objects_scrubbed":0,"log_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-08-03T03:31:09.357540+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[0,2],"acting":[0,2],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":0,"acting_primary":0,"purged_snaps":[]},{"pgid":"5.6","version":"67'13602","reported_seq":13662,"reported_epoch":67,"state":"active+undersized+degraded","last_fresh":"2023-08-01T19:56:09.988094+0000","last_change":"2023-08-01T19:55:59.569142+0000","last_active":"2023-08-01T19:56:09.988094+0000","last_peered":"2023-08-01T19:56:09.988094+0000","last_clean":"2023-08-01T19:55:58.559144+0000","last_became_active":"2023-08-01T19:55:59.569142+0000","last_became_peered":"2023-08-01T19:55:59.569142+0000","last_unstale":"2023-08-01T19:56:09.988094+0000","last_undegraded":"2023-08-01T19:55:59.560641+0000","last_fullsized":"2023-08-01T19:55:59.560551+0000","mapping_epoch":62,"log_start":"50'10000","ondisk_log_start":"50'10000","created":19,"last_epoch_clean":20,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-08-01T19:54:22.116710+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-08-01T19:54:22.116710+0000","last_clean_scrub_stamp":"2023-08-01T19:54:22.116710+0000","objects_scrubbed":0,"log_size":3602,"ondisk_log_size":3602,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-08-02T22:54:17.393787+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":200278016,"num_objects":3056,"num_object_clones":0,"num_object_copies":6112,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":3056,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":3056,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":13602,"num_write_kb":533056,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[0],"acting":[0],"avail_no_missing":["0"],"object_location_counts":[{"shards":"0","objects":3056}],"blocked_by":[],"up_primary":0,"acting_primary":0,"purged_snaps":[]},{"pgid":"2.1","version":"0'0","reported_seq":62,"reported_epoch":66,"state":"active+clean","last_fresh":"2023-08-01T19:56:06.007884+0000","last_change":"2023-08-01T19:53:58.973700+0000","last_active":"2023-08-01T19:56:06.007884+0000","last_peered":"2023-08-01T19:56:06.007884+0000","last_clean":"2023-08-01T19:56:06.007884+0000","last_became_active":"2023-08-01T19:53:58.973285+0000","last_became_peered":"2023-08-01T19:53:58.973285+0000","last_unstale":"2023-08-01T19:56:06.007884+0000","last_undegraded":"2023-08-01T19:56:06.007884+0000","last_fullsized":"2023-08-01T19:56:06.007884+0000","mapping_epoch":12,"log_start":"0'0","ondisk_log_start":"0'0","created":12,"last_epoch_clean":13,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-08-01T19:53:57.959448+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-08-01T19:53:57.959448+0000","last_clean_scrub_stamp":"2023-08-01T19:53:57.959448+0000","objects_scrubbed":0,"log_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-08-02T21:26:02.570824+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[0,2],"acting":[0,2],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":0,"acting_primary":0,"purged_snaps":[]},{"pgid":"3.0","version":"0'0","reported_seq":65,"reported_epoch":66,"state":"active+undersized","last_fresh":"2023-08-01T19:56:06.003704+0000","last_change":"2023-08-01T19:55:59.563403+0000","last_active":"2023-08-01T19:56:06.003704+0000","last_peered":"2023-08-01T19:56:06.003704+0000","last_clean":"2023-08-01T19:55:57.554576+0000","last_became_active":"2023-08-01T19:55:59.563403+0000","last_became_peered":"2023-08-01T19:55:59.563403+0000","last_unstale":"2023-08-01T19:56:06.003704+0000","last_undegraded":"2023-08-01T19:56:06.003704+0000","last_fullsized":"2023-08-01T19:55:59.558405+0000","mapping_epoch":62,"log_start":"0'0","ondisk_log_start":"0'0","created":15,"last_epoch_clean":16,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-08-01T19:54:03.032665+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-08-01T19:54:03.032665+0000","last_clean_scrub_stamp":"2023-08-01T19:54:03.032665+0000","objects_scrubbed":0,"log_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-08-03T06:30:22.393228+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[2],"acting":[2],"avail_no_missing":["2"],"object_location_counts":[],"blocked_by":[],"up_primary":2,"acting_primary":2,"purged_snaps":[]},{"pgid":"4.7","version":"0'0","reported_seq":63,"reported_epoch":66,"state":"active+clean","last_fresh":"2023-08-01T19:56:06.009167+0000","last_change":"2023-08-01T19:55:51.123762+0000","last_active":"2023-08-01T19:56:06.009167+0000","last_peered":"2023-08-01T19:56:06.009167+0000","last_clean":"2023-08-01T19:56:06.009167+0000","last_became_active":"2023-08-01T19:55:51.123494+0000","last_became_peered":"2023-08-01T19:55:51.123494+0000","last_unstale":"2023-08-01T19:56:06.009167+0000","last_undegraded":"2023-08-01T19:56:06.009167+0000","last_fullsized":"2023-08-01T19:56:06.009167+0000","mapping_epoch":57,"log_start":"0'0","ondisk_log_start":"0'0","created":16,"last_epoch_clean":58,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-08-01T19:54:04.040663+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-08-01T19:54:04.040663+0000","last_clean_scrub_stamp":"2023-08-01T19:54:04.040663+0000","objects_scrubbed":0,"log_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-08-02T20:31:20.814631+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[0,2],"acting":[0,2],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":0,"acting_primary":0,"purged_snaps":[]},{"pgid":"5.4","version":"67'13676","reported_seq":13728,"reported_epoch":67,"state":"active+clean","last_fresh":"2023-08-01T19:56:11.084266+0000","last_change":"2023-08-01T19:54:23.138253+0000","last_active":"2023-08-01T19:56:11.084266+0000","last_peered":"2023-08-01T19:56:11.084266+0000","last_clean":"2023-08-01T19:56:11.084266+0000","last_became_active":"2023-08-01T19:54:23.137915+0000","last_became_peered":"2023-08-01T19:54:23.137915+0000","last_unstale":"2023-08-01T19:56:11.084266+0000","last_undegraded":"2023-08-01T19:56:11.084266+0000","last_fullsized":"2023-08-01T19:56:11.084266+0000","mapping_epoch":19,"log_start":"49'9700","ondisk_log_start":"49'9700","created":19,"last_epoch_clean":20,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-08-01T19:54:22.116710+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-08-01T19:54:22.116710+0000","last_clean_scrub_stamp":"2023-08-01T19:54:22.116710+0000","objects_scrubbed":0,"log_size":3976,"ondisk_log_size":3976,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-08-03T07:20:04.946515+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":185073664,"num_objects":2824,"num_object_clones":0,"num_object_copies":5648,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":2824,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":13676,"num_write_kb":528000,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[2,0],"acting":[2,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":2,"acting_primary":2,"purged_snaps":[]},{"pgid":"2.3","version":"0'0","reported_seq":13,"reported_epoch":66,"state":"active+undersized","last_fresh":"2023-08-01T19:56:06.009434+0000","last_change":"2023-08-01T19:55:59.622758+0000","last_active":"2023-08-01T19:56:06.009434+0000","last_peered":"2023-08-01T19:56:06.009434+0000","last_clean":"2023-08-01T19:53:57.959448+0000","last_became_active":"2023-08-01T19:55:59.622758+0000","last_became_peered":"2023-08-01T19:55:59.622758+0000","last_unstale":"2023-08-01T19:56:06.009434+0000","last_undegraded":"2023-08-01T19:56:06.009434+0000","last_fullsized":"2023-08-01T19:55:59.560569+0000","mapping_epoch":62,"log_start":"0'0","ondisk_log_start":"0'0","created":12,"last_epoch_clean":13,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-08-01T19:53:57.959448+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-08-01T19:53:57.959448+0000","last_clean_scrub_stamp":"2023-08-01T19:53:57.959448+0000","objects_scrubbed":0,"log_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-08-03T05:08:53.677920+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[0],"acting":[0],"avail_no_missing":["0"],"object_location_counts":[],"blocked_by":[],"up_primary":0,"acting_primary":0,"purged_snaps":[]},{"pgid":"1.0","version":"10'157","reported_seq":215,"reported_epoch":66,"state":"active+undersized+degraded","last_fresh":"2023-08-01T19:56:06.003562+0000","last_change":"2023-08-01T19:55:59.562808+0000","last_active":"2023-08-01T19:56:06.003562+0000","last_peered":"2023-08-01T19:56:06.003562+0000","last_clean":"2023-08-01T19:53:52.549833+0000","last_became_active":"2023-08-01T19:55:59.562808+0000","last_became_peered":"2023-08-01T19:55:59.562808+0000","last_unstale":"2023-08-01T19:56:06.003562+0000","last_undegraded":"2023-08-01T19:55:59.558077+0000","last_fullsized":"2023-08-01T19:55:59.557999+0000","mapping_epoch":62,"log_start":"0'0","ondisk_log_start":"0'0","created":9,"last_epoch_clean":10,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-08-01T19:53:50.735626+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-08-01T19:53:50.735626+0000","last_clean_scrub_stamp":"2023-08-01T19:53:50.735626+0000","objects_scrubbed":0,"log_size":157,"ondisk_log_size":157,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-08-02T23:49:15.841053+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":590368,"num_objects":2,"num_object_clones":0,"num_object_copies":4,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":2,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":2,"num_whiteouts":0,"num_read":136,"num_read_kb":118,"num_write":203,"num_write_kb":3460,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[2],"acting":[2],"avail_no_missing":["2"],"object_location_counts":[{"shards":"2","objects":2}],"blocked_by":[],"up_primary":2,"acting_primary":2,"purged_snaps":[]},{"pgid":"3.2","version":"0'0","reported_seq":64,"reported_epoch":66,"state":"active+clean","last_fresh":"2023-08-01T19:56:06.008726+0000","last_change":"2023-08-01T19:55:51.124010+0000","last_active":"2023-08-01T19:56:06.008726+0000","last_peered":"2023-08-01T19:56:06.008726+0000","last_clean":"2023-08-01T19:56:06.008726+0000","last_became_active":"2023-08-01T19:55:51.122980+0000","last_became_peered":"2023-08-01T19:55:51.122980+0000","last_unstale":"2023-08-01T19:56:06.008726+0000","last_undegraded":"2023-08-01T19:56:06.008726+0000","last_fullsized":"2023-08-01T19:56:06.008726+0000","mapping_epoch":57,"log_start":"0'0","ondisk_log_start":"0'0","created":15,"last_epoch_clean":58,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-08-01T19:54:03.032665+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-08-01T19:54:03.032665+0000","last_clean_scrub_stamp":"2023-08-01T19:54:03.032665+0000","objects_scrubbed":0,"log_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-08-03T01:20:25.704047+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[0,2],"acting":[0,2],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":0,"acting_primary":0,"purged_snaps":[]},{"pgid":"4.5","version":"0'0","reported_seq":44,"reported_epoch":66,"state":"active+undersized","last_fresh":"2023-08-01T19:56:06.004464+0000","last_change":"2023-08-01T19:55:59.563866+0000","last_active":"2023-08-01T19:56:06.004464+0000","last_peered":"2023-08-01T19:56:06.004464+0000","last_clean":"2023-08-01T19:55:57.555376+0000","last_became_active":"2023-08-01T19:55:59.563866+0000","last_became_peered":"2023-08-01T19:55:59.563866+0000","last_unstale":"2023-08-01T19:56:06.004464+0000","last_undegraded":"2023-08-01T19:56:06.004464+0000","last_fullsized":"2023-08-01T19:55:59.558891+0000","mapping_epoch":62,"log_start":"0'0","ondisk_log_start":"0'0","created":16,"last_epoch_clean":41,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-08-01T19:54:04.040663+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-08-01T19:54:04.040663+0000","last_clean_scrub_stamp":"2023-08-01T19:54:04.040663+0000","objects_scrubbed":0,"log_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-08-03T06:06:42.521766+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[2],"acting":[2],"avail_no_missing":["2"],"object_location_counts":[],"blocked_by":[],"up_primary":2,"acting_primary":2,"purged_snaps":[]},{"pgid":"5.7","version":"67'13679","reported_seq":13738,"reported_epoch":67,"state":"active+undersized+degraded","last_fresh":"2023-08-01T19:56:09.988931+0000","last_change":"2023-08-01T19:55:59.570795+0000","last_active":"2023-08-01T19:56:09.988931+0000","last_peered":"2023-08-01T19:56:09.988931+0000","last_clean":"2023-08-01T19:55:58.546917+0000","last_became_active":"2023-08-01T19:55:59.570795+0000","last_became_peered":"2023-08-01T19:55:59.570795+0000","last_unstale":"2023-08-01T19:56:09.988931+0000","last_undegraded":"2023-08-01T19:55:59.561675+0000","last_fullsized":"2023-08-01T19:55:59.561598+0000","mapping_epoch":62,"log_start":"50'10113","ondisk_log_start":"50'10113","created":19,"last_epoch_clean":20,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-08-01T19:54:22.116710+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-08-01T19:54:22.116710+0000","last_clean_scrub_stamp":"2023-08-01T19:54:22.116710+0000","objects_scrubbed":0,"log_size":3566,"ondisk_log_size":3566,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-08-02T20:46:27.913758+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":197853184,"num_objects":3019,"num_object_clones":0,"num_object_copies":6038,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":3019,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":3019,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":13679,"num_write_kb":534336,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[0],"acting":[0],"avail_no_missing":["0"],"object_location_counts":[{"shards":"0","objects":3019}],"blocked_by":[],"up_primary":0,"acting_primary":0,"purged_snaps":[]},{"pgid":"2.0","version":"0'0","reported_seq":13,"reported_epoch":66,"state":"active+undersized","last_fresh":"2023-08-01T19:56:06.003826+0000","last_change":"2023-08-01T19:55:59.563575+0000","last_active":"2023-08-01T19:56:06.003826+0000","last_peered":"2023-08-01T19:56:06.003826+0000","last_clean":"2023-08-01T19:53:57.959448+0000","last_became_active":"2023-08-01T19:55:59.563575+0000","last_became_peered":"2023-08-01T19:55:59.563575+0000","last_unstale":"2023-08-01T19:56:06.003826+0000","last_undegraded":"2023-08-01T19:56:06.003826+0000","last_fullsized":"2023-08-01T19:55:59.559014+0000","mapping_epoch":62,"log_start":"0'0","ondisk_log_start":"0'0","created":12,"last_epoch_clean":13,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-08-01T19:53:57.959448+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-08-01T19:53:57.959448+0000","last_clean_scrub_stamp":"2023-08-01T19:53:57.959448+0000","objects_scrubbed":0,"log_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-08-02T23:29:02.307887+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[2],"acting":[2],"avail_no_missing":["2"],"object_location_counts":[],"blocked_by":[],"up_primary":2,"acting_primary":2,"purged_snaps":[]},{"pgid":"3.1","version":"0'0","reported_seq":70,"reported_epoch":66,"state":"active+undersized","last_fresh":"2023-08-01T19:56:06.007705+0000","last_change":"2023-08-01T19:55:59.568820+0000","last_active":"2023-08-01T19:56:06.007705+0000","last_peered":"2023-08-01T19:56:06.007705+0000","last_clean":"2023-08-01T19:55:57.552962+0000","last_became_active":"2023-08-01T19:55:59.568820+0000","last_became_peered":"2023-08-01T19:55:59.568820+0000","last_unstale":"2023-08-01T19:56:06.007705+0000","last_undegraded":"2023-08-01T19:56:06.007705+0000","last_fullsized":"2023-08-01T19:55:59.559485+0000","mapping_epoch":62,"log_start":"0'0","ondisk_log_start":"0'0","created":15,"last_epoch_clean":58,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-08-01T19:54:03.032665+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-08-01T19:54:03.032665+0000","last_clean_scrub_stamp":"2023-08-01T19:54:03.032665+0000","objects_scrubbed":0,"log_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-08-03T03:40:01.058863+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[0],"acting":[0],"avail_no_missing":["0"],"object_location_counts":[],"blocked_by":[],"up_primary":0,"acting_primary":0,"purged_snaps":[]},{"pgid":"4.6","version":"0'0","reported_seq":58,"reported_epoch":66,"state":"active+clean","last_fresh":"2023-08-01T19:56:06.005371+0000","last_change":"2023-08-01T19:54:04.469877+0000","last_active":"2023-08-01T19:56:06.005371+0000","last_peered":"2023-08-01T19:56:06.005371+0000","last_clean":"2023-08-01T19:56:06.005371+0000","last_became_active":"2023-08-01T19:54:04.469528+0000","last_became_peered":"2023-08-01T19:54:04.469528+0000","last_unstale":"2023-08-01T19:56:06.005371+0000","last_undegraded":"2023-08-01T19:56:06.005371+0000","last_fullsized":"2023-08-01T19:56:06.005371+0000","mapping_epoch":16,"log_start":"0'0","ondisk_log_start":"0'0","created":16,"last_epoch_clean":17,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-08-01T19:54:04.040663+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-08-01T19:54:04.040663+0000","last_clean_scrub_stamp":"2023-08-01T19:54:04.040663+0000","objects_scrubbed":0,"log_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-08-03T02:24:19.067602+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[2,0],"acting":[2,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":2,"acting_primary":2,"purged_snaps":[]},{"pgid":"5.2","version":"67'14080","reported_seq":14158,"reported_epoch":67,"state":"active+undersized+degraded","last_fresh":"2023-08-01T19:56:09.977721+0000","last_change":"2023-08-01T19:55:59.563823+0000","last_active":"2023-08-01T19:56:09.977721+0000","last_peered":"2023-08-01T19:56:09.977721+0000","last_clean":"2023-08-01T19:55:58.546952+0000","last_became_active":"2023-08-01T19:55:59.563823+0000","last_became_peered":"2023-08-01T19:55:59.563823+0000","last_unstale":"2023-08-01T19:56:09.977721+0000","last_undegraded":"2023-08-01T19:55:59.559522+0000","last_fullsized":"2023-08-01T19:55:59.559379+0000","mapping_epoch":62,"log_start":"50'10468","ondisk_log_start":"50'10468","created":19,"last_epoch_clean":54,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-08-01T19:54:22.116710+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-08-01T19:54:22.116710+0000","last_clean_scrub_stamp":"2023-08-01T19:54:22.116710+0000","objects_scrubbed":0,"log_size":3612,"ondisk_log_size":3612,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-08-03T00:10:13.172660+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":201588736,"num_objects":3076,"num_object_clones":0,"num_object_copies":6152,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":3076,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":3076,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":14080,"num_write_kb":548992,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":1,"num_bytes_recovered":65536,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[0],"acting":[0],"avail_no_missing":["0"],"object_location_counts":[{"shards":"0","objects":3076}],"blocked_by":[],"up_primary":0,"acting_primary":0,"purged_snaps":[]},{"pgid":"2.5","version":"0'0","reported_seq":62,"reported_epoch":66,"state":"active+clean","last_fresh":"2023-08-01T19:56:06.005591+0000","last_change":"2023-08-01T19:53:58.970683+0000","last_active":"2023-08-01T19:56:06.005591+0000","last_peered":"2023-08-01T19:56:06.005591+0000","last_clean":"2023-08-01T19:56:06.005591+0000","last_became_active":"2023-08-01T19:53:58.970437+0000","last_became_peered":"2023-08-01T19:53:58.970437+0000","last_unstale":"2023-08-01T19:56:06.005591+0000","last_undegraded":"2023-08-01T19:56:06.005591+0000","last_fullsized":"2023-08-01T19:56:06.005591+0000","mapping_epoch":12,"log_start":"0'0","ondisk_log_start":"0'0","created":12,"last_epoch_clean":13,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-08-01T19:53:57.959448+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-08-01T19:53:57.959448+0000","last_clean_scrub_stamp":"2023-08-01T19:53:57.959448+0000","objects_scrubbed":0,"log_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-08-02T23:54:08.273426+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[2,0],"acting":[2,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":2,"acting_primary":2,"purged_snaps":[]},{"pgid":"3.4","version":"0'0","reported_seq":25,"reported_epoch":66,"state":"active+clean","last_fresh":"2023-08-01T19:56:06.004559+0000","last_change":"2023-08-01T19:55:45.082528+0000","last_active":"2023-08-01T19:56:06.004559+0000","last_peered":"2023-08-01T19:56:06.004559+0000","last_clean":"2023-08-01T19:56:06.004559+0000","last_became_active":"2023-08-01T19:55:45.082155+0000","last_became_peered":"2023-08-01T19:55:45.082155+0000","last_unstale":"2023-08-01T19:56:06.004559+0000","last_undegraded":"2023-08-01T19:56:06.004559+0000","last_fullsized":"2023-08-01T19:56:06.004559+0000","mapping_epoch":53,"log_start":"0'0","ondisk_log_start":"0'0","created":15,"last_epoch_clean":54,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-08-01T19:54:03.032665+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-08-01T19:54:03.032665+0000","last_clean_scrub_stamp":"2023-08-01T19:54:03.032665+0000","objects_scrubbed":0,"log_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-08-02T20:04:47.048806+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[2,0],"acting":[2,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":2,"acting_primary":2,"purged_snaps":[]},{"pgid":"4.3","version":"0'0","reported_seq":64,"reported_epoch":66,"state":"active+undersized","last_fresh":"2023-08-01T19:56:06.004232+0000","last_change":"2023-08-01T19:55:59.563285+0000","last_active":"2023-08-01T19:56:06.004232+0000","last_peered":"2023-08-01T19:56:06.004232+0000","last_clean":"2023-08-01T19:55:57.554958+0000","last_became_active":"2023-08-01T19:55:59.563285+0000","last_became_peered":"2023-08-01T19:55:59.563285+0000","last_unstale":"2023-08-01T19:56:06.004232+0000","last_undegraded":"2023-08-01T19:56:06.004232+0000","last_fullsized":"2023-08-01T19:55:59.558261+0000","mapping_epoch":62,"log_start":"0'0","ondisk_log_start":"0'0","created":16,"last_epoch_clean":17,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-08-01T19:54:04.040663+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-08-01T19:54:04.040663+0000","last_clean_scrub_stamp":"2023-08-01T19:54:04.040663+0000","objects_scrubbed":0,"log_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-08-03T03:17:46.943062+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[2],"acting":[2],"avail_no_missing":["2"],"object_location_counts":[],"blocked_by":[],"up_primary":2,"acting_primary":2,"purged_snaps":[]},{"pgid":"5.1","version":"67'13572","reported_seq":13653,"reported_epoch":67,"state":"active+undersized+degraded","last_fresh":"2023-08-01T19:56:09.969521+0000","last_change":"2023-08-01T19:55:59.570323+0000","last_active":"2023-08-01T19:56:09.969521+0000","last_peered":"2023-08-01T19:56:09.969521+0000","last_clean":"2023-08-01T19:55:58.559141+0000","last_became_active":"2023-08-01T19:55:59.570323+0000","last_became_peered":"2023-08-01T19:55:59.570323+0000","last_unstale":"2023-08-01T19:56:09.969521+0000","last_undegraded":"2023-08-01T19:55:59.561328+0000","last_fullsized":"2023-08-01T19:55:59.561227+0000","mapping_epoch":62,"log_start":"50'9986","ondisk_log_start":"50'9986","created":19,"last_epoch_clean":58,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-08-01T19:54:22.116710+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-08-01T19:54:22.116710+0000","last_clean_scrub_stamp":"2023-08-01T19:54:22.116710+0000","objects_scrubbed":0,"log_size":3586,"ondisk_log_size":3586,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-08-03T07:33:12.821160+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":195297280,"num_objects":2980,"num_object_clones":0,"num_object_copies":5960,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":2980,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":2980,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":13572,"num_write_kb":529664,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[0],"acting":[0],"avail_no_missing":["0"],"object_location_counts":[{"shards":"0","objects":2980}],"blocked_by":[],"up_primary":0,"acting_primary":0,"purged_snaps":[]},{"pgid":"3.7","version":"17'2","reported_seq":61,"reported_epoch":66,"state":"active+clean","last_fresh":"2023-08-01T19:56:06.008690+0000","last_change":"2023-08-01T19:54:04.065147+0000","last_active":"2023-08-01T19:56:06.008690+0000","last_peered":"2023-08-01T19:56:06.008690+0000","last_clean":"2023-08-01T19:56:06.008690+0000","last_became_active":"2023-08-01T19:54:04.064779+0000","last_became_peered":"2023-08-01T19:54:04.064779+0000","last_unstale":"2023-08-01T19:56:06.008690+0000","last_undegraded":"2023-08-01T19:56:06.008690+0000","last_fullsized":"2023-08-01T19:56:06.008690+0000","mapping_epoch":15,"log_start":"0'0","ondisk_log_start":"0'0","created":15,"last_epoch_clean":16,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-08-01T19:54:03.032665+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-08-01T19:54:03.032665+0000","last_clean_scrub_stamp":"2023-08-01T19:54:03.032665+0000","objects_scrubbed":0,"log_size":2,"ondisk_log_size":2,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-08-03T03:43:45.667663+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":1,"num_object_clones":0,"num_object_copies":2,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":1,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":3,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":1,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[0,2],"acting":[0,2],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":0,"acting_primary":0,"purged_snaps":[]},{"pgid":"2.6","version":"0'0","reported_seq":67,"reported_epoch":66,"state":"active+clean","last_fresh":"2023-08-01T19:56:06.010936+0000","last_change":"2023-08-01T19:55:51.124478+0000","last_active":"2023-08-01T19:56:06.010936+0000","last_peered":"2023-08-01T19:56:06.010936+0000","last_clean":"2023-08-01T19:56:06.010936+0000","last_became_active":"2023-08-01T19:55:51.124246+0000","last_became_peered":"2023-08-01T19:55:51.124246+0000","last_unstale":"2023-08-01T19:56:06.010936+0000","last_undegraded":"2023-08-01T19:56:06.010936+0000","last_fullsized":"2023-08-01T19:56:06.010936+0000","mapping_epoch":57,"log_start":"0'0","ondisk_log_start":"0'0","created":12,"last_epoch_clean":58,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-08-01T19:53:57.959448+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-08-01T19:53:57.959448+0000","last_clean_scrub_stamp":"2023-08-01T19:53:57.959448+0000","objects_scrubbed":0,"log_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-08-03T06:32:57.755974+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[0,2],"acting":[0,2],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":0,"acting_primary":0,"purged_snaps":[]},{"pgid":"4.0","version":"0'0","reported_seq":64,"reported_epoch":66,"state":"active+undersized","last_fresh":"2023-08-01T19:56:06.010097+0000","last_change":"2023-08-01T19:55:59.568333+0000","last_active":"2023-08-01T19:56:06.010097+0000","last_peered":"2023-08-01T19:56:06.010097+0000","last_clean":"2023-08-01T19:55:57.552865+0000","last_became_active":"2023-08-01T19:55:59.568333+0000","last_became_peered":"2023-08-01T19:55:59.568333+0000","last_unstale":"2023-08-01T19:56:06.010097+0000","last_undegraded":"2023-08-01T19:56:06.010097+0000","last_fullsized":"2023-08-01T19:55:59.559649+0000","mapping_epoch":62,"log_start":"0'0","ondisk_log_start":"0'0","created":16,"last_epoch_clean":17,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-08-01T19:54:04.040663+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-08-01T19:54:04.040663+0000","last_clean_scrub_stamp":"2023-08-01T19:54:04.040663+0000","objects_scrubbed":0,"log_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-08-03T01:36:08.081350+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[0],"acting":[0],"avail_no_missing":["0"],"object_location_counts":[],"blocked_by":[],"up_primary":0,"acting_primary":0,"purged_snaps":[]},{"pgid":"5.0","version":"67'14048","reported_seq":14103,"reported_epoch":67,"state":"active+clean","last_fresh":"2023-08-01T19:56:11.090455+0000","last_change":"2023-08-01T19:54:23.138369+0000","last_active":"2023-08-01T19:56:11.090455+0000","last_peered":"2023-08-01T19:56:11.090455+0000","last_clean":"2023-08-01T19:56:11.090455+0000","last_became_active":"2023-08-01T19:54:23.137857+0000","last_became_peered":"2023-08-01T19:54:23.137857+0000","last_unstale":"2023-08-01T19:56:11.090455+0000","last_undegraded":"2023-08-01T19:56:11.090455+0000","last_fullsized":"2023-08-01T19:56:11.090455+0000","mapping_epoch":19,"log_start":"50'10100","ondisk_log_start":"50'10100","created":19,"last_epoch_clean":20,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-08-01T19:54:22.116710+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-08-01T19:54:22.116710+0000","last_clean_scrub_stamp":"2023-08-01T19:54:22.116710+0000","objects_scrubbed":0,"log_size":3948,"ondisk_log_size":3948,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-08-03T06:02:44.391298+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":190447616,"num_objects":2906,"num_object_clones":0,"num_object_copies":5812,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":2906,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":14048,"num_write_kb":542528,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[2,0],"acting":[2,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":2,"acting_primary":2,"purged_snaps":[]},{"pgid":"2.7","version":"0'0","reported_seq":44,"reported_epoch":66,"state":"active+undersized","last_fresh":"2023-08-01T19:56:06.004524+0000","last_change":"2023-08-01T19:55:59.563861+0000","last_active":"2023-08-01T19:56:06.004524+0000","last_peered":"2023-08-01T19:56:06.004524+0000","last_clean":"2023-08-01T19:55:57.557143+0000","last_became_active":"2023-08-01T19:55:59.563861+0000","last_became_peered":"2023-08-01T19:55:59.563861+0000","last_unstale":"2023-08-01T19:56:06.004524+0000","last_undegraded":"2023-08-01T19:56:06.004524+0000","last_fullsized":"2023-08-01T19:55:59.559998+0000","mapping_epoch":62,"log_start":"0'0","ondisk_log_start":"0'0","created":12,"last_epoch_clean":41,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-08-01T19:53:57.959448+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-08-01T19:53:57.959448+0000","last_clean_scrub_stamp":"2023-08-01T19:53:57.959448+0000","objects_scrubbed":0,"log_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-08-03T05:28:45.376667+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[2],"acting":[2],"avail_no_missing":["2"],"object_location_counts":[],"blocked_by":[],"up_primary":2,"acting_primary":2,"purged_snaps":[]},{"pgid":"3.6","version":"18'1","reported_seq":66,"reported_epoch":66,"state":"active+undersized+degraded","last_fresh":"2023-08-01T19:56:06.010450+0000","last_change":"2023-08-01T19:55:59.620355+0000","last_active":"2023-08-01T19:56:06.010450+0000","last_peered":"2023-08-01T19:56:06.010450+0000","last_clean":"2023-08-01T19:55:57.554007+0000","last_became_active":"2023-08-01T19:55:59.620355+0000","last_became_peered":"2023-08-01T19:55:59.620355+0000","last_unstale":"2023-08-01T19:56:06.010450+0000","last_undegraded":"2023-08-01T19:55:59.561677+0000","last_fullsized":"2023-08-01T19:55:59.561590+0000","mapping_epoch":62,"log_start":"0'0","ondisk_log_start":"0'0","created":15,"last_epoch_clean":16,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-08-01T19:54:03.032665+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-08-01T19:54:03.032665+0000","last_clean_scrub_stamp":"2023-08-01T19:54:03.032665+0000","objects_scrubbed":0,"log_size":1,"ondisk_log_size":1,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-08-03T05:30:20.566957+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":1,"num_object_clones":0,"num_object_copies":2,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":1,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":1,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":1,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":1,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[0],"acting":[0],"avail_no_missing":["0"],"object_location_counts":[{"shards":"0","objects":1}],"blocked_by":[],"up_primary":0,"acting_primary":0,"purged_snaps":[]},{"pgid":"4.1","version":"0'0","reported_seq":64,"reported_epoch":66,"state":"active+undersized","last_fresh":"2023-08-01T19:56:06.003752+0000","last_change":"2023-08-01T19:55:59.563089+0000","last_active":"2023-08-01T19:56:06.003752+0000","last_peered":"2023-08-01T19:56:06.003752+0000","last_clean":"2023-08-01T19:55:57.554996+0000","last_became_active":"2023-08-01T19:55:59.563089+0000","last_became_peered":"2023-08-01T19:55:59.563089+0000","last_unstale":"2023-08-01T19:56:06.003752+0000","last_undegraded":"2023-08-01T19:56:06.003752+0000","last_fullsized":"2023-08-01T19:55:59.558480+0000","mapping_epoch":62,"log_start":"0'0","ondisk_log_start":"0'0","created":16,"last_epoch_clean":17,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-08-01T19:54:04.040663+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-08-01T19:54:04.040663+0000","last_clean_scrub_stamp":"2023-08-01T19:54:04.040663+0000","objects_scrubbed":0,"log_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-08-02T20:06:04.654195+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[2],"acting":[2],"avail_no_missing":["2"],"object_location_counts":[],"blocked_by":[],"up_primary":2,"acting_primary":2,"purged_snaps":[]},{"pgid":"3.1b","version":"17'1","reported_seq":66,"reported_epoch":66,"state":"active+undersized","last_fresh":"2023-08-01T19:56:06.004242+0000","last_change":"2023-08-01T19:55:59.563716+0000","last_active":"2023-08-01T19:56:06.004242+0000","last_peered":"2023-08-01T19:56:06.004242+0000","last_clean":"2023-08-01T19:55:57.555048+0000","last_became_active":"2023-08-01T19:55:59.563716+0000","last_became_peered":"2023-08-01T19:55:59.563716+0000","last_unstale":"2023-08-01T19:56:06.004242+0000","last_undegraded":"2023-08-01T19:56:06.004242+0000","last_fullsized":"2023-08-01T19:55:59.558443+0000","mapping_epoch":62,"log_start":"0'0","ondisk_log_start":"0'0","created":15,"last_epoch_clean":16,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-08-01T19:54:03.032665+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-08-01T19:54:03.032665+0000","last_clean_scrub_stamp":"2023-08-01T19:54:03.032665+0000","objects_scrubbed":0,"log_size":1,"ondisk_log_size":1,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-08-02T22:25:53.299247+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[2],"acting":[2],"avail_no_missing":["2"],"object_location_counts":[],"blocked_by":[],"up_primary":2,"acting_primary":2,"purged_snaps":[]},{"pgid":"4.1c","version":"0'0","reported_seq":58,"reported_epoch":66,"state":"active+clean","last_fresh":"2023-08-01T19:56:06.004657+0000","last_change":"2023-08-01T19:54:04.466766+0000","last_active":"2023-08-01T19:56:06.004657+0000","last_peered":"2023-08-01T19:56:06.004657+0000","last_clean":"2023-08-01T19:56:06.004657+0000","last_became_active":"2023-08-01T19:54:04.466417+0000","last_became_peered":"2023-08-01T19:54:04.466417+0000","last_unstale":"2023-08-01T19:56:06.004657+0000","last_undegraded":"2023-08-01T19:56:06.004657+0000","last_fullsized":"2023-08-01T19:56:06.004657+0000","mapping_epoch":16,"log_start":"0'0","ondisk_log_start":"0'0","created":16,"last_epoch_clean":17,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-08-01T19:54:04.040663+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-08-01T19:54:04.040663+0000","last_clean_scrub_stamp":"2023-08-01T19:54:04.040663+0000","objects_scrubbed":0,"log_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-08-02T22:01:53.643825+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[2,0],"acting":[2,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":2,"acting_primary":2,"purged_snaps":[]},{"pgid":"3.1c","version":"17'2","reported_seq":57,"reported_epoch":66,"state":"active+undersized+degraded","last_fresh":"2023-08-01T19:56:06.008906+0000","last_change":"2023-08-01T19:55:59.622163+0000","last_active":"2023-08-01T19:56:06.008906+0000","last_peered":"2023-08-01T19:56:06.008906+0000","last_clean":"2023-08-01T19:55:57.553856+0000","last_became_active":"2023-08-01T19:55:59.622163+0000","last_became_peered":"2023-08-01T19:55:59.622163+0000","last_unstale":"2023-08-01T19:56:06.008906+0000","last_undegraded":"2023-08-01T19:55:59.563024+0000","last_fullsized":"2023-08-01T19:55:59.562932+0000","mapping_epoch":62,"log_start":"0'0","ondisk_log_start":"0'0","created":15,"last_epoch_clean":58,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-08-01T19:54:03.032665+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-08-01T19:54:03.032665+0000","last_clean_scrub_stamp":"2023-08-01T19:54:03.032665+0000","objects_scrubbed":0,"log_size":2,"ondisk_log_size":2,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-08-02T22:41:07.467071+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":1,"num_object_clones":0,"num_object_copies":2,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":1,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":1,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":3,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":1,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[0],"acting":[0],"avail_no_missing":["0"],"object_location_counts":[{"shards":"0","objects":1}],"blocked_by":[],"up_primary":0,"acting_primary":0,"purged_snaps":[]},{"pgid":"4.1b","version":"0'0","reported_seq":13,"reported_epoch":66,"state":"active+undersized","last_fresh":"2023-08-01T19:56:06.008911+0000","last_change":"2023-08-01T19:55:59.622285+0000","last_active":"2023-08-01T19:56:06.008911+0000","last_peered":"2023-08-01T19:56:06.008911+0000","last_clean":"2023-08-01T19:54:04.040663+0000","last_became_active":"2023-08-01T19:55:59.622285+0000","last_became_peered":"2023-08-01T19:55:59.622285+0000","last_unstale":"2023-08-01T19:56:06.008911+0000","last_undegraded":"2023-08-01T19:56:06.008911+0000","last_fullsized":"2023-08-01T19:55:59.559730+0000","mapping_epoch":62,"log_start":"0'0","ondisk_log_start":"0'0","created":16,"last_epoch_clean":17,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-08-01T19:54:04.040663+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-08-01T19:54:04.040663+0000","last_clean_scrub_stamp":"2023-08-01T19:54:04.040663+0000","objects_scrubbed":0,"log_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-08-03T06:11:11.191844+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[0],"acting":[0],"avail_no_missing":["0"],"object_location_counts":[],"blocked_by":[],"up_primary":0,"acting_primary":0,"purged_snaps":[]},{"pgid":"3.1d","version":"17'2","reported_seq":67,"reported_epoch":66,"state":"active+undersized+degraded","last_fresh":"2023-08-01T19:56:06.005688+0000","last_change":"2023-08-01T19:55:59.565788+0000","last_active":"2023-08-01T19:56:06.005688+0000","last_peered":"2023-08-01T19:56:06.005688+0000","last_clean":"2023-08-01T19:55:57.555814+0000","last_became_active":"2023-08-01T19:55:59.565788+0000","last_became_peered":"2023-08-01T19:55:59.565788+0000","last_unstale":"2023-08-01T19:56:06.005688+0000","last_undegraded":"2023-08-01T19:55:59.560345+0000","last_fullsized":"2023-08-01T19:55:59.560277+0000","mapping_epoch":62,"log_start":"0'0","ondisk_log_start":"0'0","created":15,"last_epoch_clean":16,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-08-01T19:54:03.032665+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-08-01T19:54:03.032665+0000","last_clean_scrub_stamp":"2023-08-01T19:54:03.032665+0000","objects_scrubbed":0,"log_size":2,"ondisk_log_size":2,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-08-02T23:17:27.753738+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":1,"num_object_clones":0,"num_object_copies":2,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":1,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":1,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":3,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":1,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[2],"acting":[2],"avail_no_missing":["2"],"object_location_counts":[{"shards":"2","objects":1}],"blocked_by":[],"up_primary":2,"acting_primary":2,"purged_snaps":[]},{"pgid":"4.1a","version":"0'0","reported_seq":13,"reported_epoch":66,"state":"active+undersized","last_fresh":"2023-08-01T19:56:06.007743+0000","last_change":"2023-08-01T19:55:59.627072+0000","last_active":"2023-08-01T19:56:06.007743+0000","last_peered":"2023-08-01T19:56:06.007743+0000","last_clean":"2023-08-01T19:54:04.040663+0000","last_became_active":"2023-08-01T19:55:59.627072+0000","last_became_peered":"2023-08-01T19:55:59.627072+0000","last_unstale":"2023-08-01T19:56:06.007743+0000","last_undegraded":"2023-08-01T19:56:06.007743+0000","last_fullsized":"2023-08-01T19:55:59.559529+0000","mapping_epoch":62,"log_start":"0'0","ondisk_log_start":"0'0","created":16,"last_epoch_clean":17,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-08-01T19:54:04.040663+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-08-01T19:54:04.040663+0000","last_clean_scrub_stamp":"2023-08-01T19:54:04.040663+0000","objects_scrubbed":0,"log_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-08-02T20:25:02.908694+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[0],"acting":[0],"avail_no_missing":["0"],"object_location_counts":[],"blocked_by":[],"up_primary":0,"acting_primary":0,"purged_snaps":[]},{"pgid":"3.1e","version":"17'1","reported_seq":65,"reported_epoch":66,"state":"active+clean","last_fresh":"2023-08-01T19:56:06.010862+0000","last_change":"2023-08-01T19:55:51.123532+0000","last_active":"2023-08-01T19:56:06.010862+0000","last_peered":"2023-08-01T19:56:06.010862+0000","last_clean":"2023-08-01T19:56:06.010862+0000","last_became_active":"2023-08-01T19:55:51.123215+0000","last_became_peered":"2023-08-01T19:55:51.123215+0000","last_unstale":"2023-08-01T19:56:06.010862+0000","last_undegraded":"2023-08-01T19:56:06.010862+0000","last_fullsized":"2023-08-01T19:56:06.010862+0000","mapping_epoch":57,"log_start":"0'0","ondisk_log_start":"0'0","created":15,"last_epoch_clean":58,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-08-01T19:54:03.032665+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-08-01T19:54:03.032665+0000","last_clean_scrub_stamp":"2023-08-01T19:54:03.032665+0000","objects_scrubbed":0,"log_size":1,"ondisk_log_size":1,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-08-02T20:32:15.423088+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[0,2],"acting":[0,2],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":0,"acting_primary":0,"purged_snaps":[]},{"pgid":"4.19","version":"0'0","reported_seq":58,"reported_epoch":66,"state":"active+clean","last_fresh":"2023-08-01T19:56:06.004074+0000","last_change":"2023-08-01T19:54:04.467017+0000","last_active":"2023-08-01T19:56:06.004074+0000","last_peered":"2023-08-01T19:56:06.004074+0000","last_clean":"2023-08-01T19:56:06.004074+0000","last_became_active":"2023-08-01T19:54:04.466339+0000","last_became_peered":"2023-08-01T19:54:04.466339+0000","last_unstale":"2023-08-01T19:56:06.004074+0000","last_undegraded":"2023-08-01T19:56:06.004074+0000","last_fullsized":"2023-08-01T19:56:06.004074+0000","mapping_epoch":16,"log_start":"0'0","ondisk_log_start":"0'0","created":16,"last_epoch_clean":17,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-08-01T19:54:04.040663+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-08-01T19:54:04.040663+0000","last_clean_scrub_stamp":"2023-08-01T19:54:04.040663+0000","objects_scrubbed":0,"log_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-08-03T04:07:57.222873+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[2,0],"acting":[2,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":2,"acting_primary":2,"purged_snaps":[]},{"pgid":"3.1f","version":"17'4","reported_seq":69,"reported_epoch":66,"state":"active+undersized+degraded","last_fresh":"2023-08-01T19:56:06.008873+0000","last_change":"2023-08-01T19:55:59.569819+0000","last_active":"2023-08-01T19:56:06.008873+0000","last_peered":"2023-08-01T19:56:06.008873+0000","last_clean":"2023-08-01T19:55:57.553787+0000","last_became_active":"2023-08-01T19:55:59.569819+0000","last_became_peered":"2023-08-01T19:55:59.569819+0000","last_unstale":"2023-08-01T19:56:06.008873+0000","last_undegraded":"2023-08-01T19:55:59.561281+0000","last_fullsized":"2023-08-01T19:55:59.560747+0000","mapping_epoch":62,"log_start":"0'0","ondisk_log_start":"0'0","created":15,"last_epoch_clean":16,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-08-01T19:54:03.032665+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-08-01T19:54:03.032665+0000","last_clean_scrub_stamp":"2023-08-01T19:54:03.032665+0000","objects_scrubbed":0,"log_size":4,"ondisk_log_size":4,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-08-02T23:16:38.156461+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":554,"num_objects":2,"num_object_clones":0,"num_object_copies":4,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":2,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":2,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":4,"num_write_kb":1,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":1,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[0],"acting":[0],"avail_no_missing":["0"],"object_location_counts":[{"shards":"0","objects":2}],"blocked_by":[],"up_primary":0,"acting_primary":0,"purged_snaps":[]},{"pgid":"4.18","version":"0'0","reported_seq":44,"reported_epoch":66,"state":"active+undersized","last_fresh":"2023-08-01T19:56:06.010571+0000","last_change":"2023-08-01T19:55:59.570017+0000","last_active":"2023-08-01T19:56:06.010571+0000","last_peered":"2023-08-01T19:56:06.010571+0000","last_clean":"2023-08-01T19:55:57.553021+0000","last_became_active":"2023-08-01T19:55:59.570017+0000","last_became_peered":"2023-08-01T19:55:59.570017+0000","last_unstale":"2023-08-01T19:56:06.010571+0000","last_undegraded":"2023-08-01T19:56:06.010571+0000","last_fullsized":"2023-08-01T19:55:59.560942+0000","mapping_epoch":62,"log_start":"0'0","ondisk_log_start":"0'0","created":16,"last_epoch_clean":41,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-08-01T19:54:04.040663+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-08-01T19:54:04.040663+0000","last_clean_scrub_stamp":"2023-08-01T19:54:04.040663+0000","objects_scrubbed":0,"log_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-08-02T22:13:38.764604+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[0],"acting":[0],"avail_no_missing":["0"],"object_location_counts":[],"blocked_by":[],"up_primary":0,"acting_primary":0,"purged_snaps":[]},{"pgid":"4.20","version":"0'0","reported_seq":13,"reported_epoch":66,"state":"active+undersized","last_fresh":"2023-08-01T19:56:06.010054+0000","last_change":"2023-08-01T19:55:59.568624+0000","last_active":"2023-08-01T19:56:06.010054+0000","last_peered":"2023-08-01T19:56:06.010054+0000","last_clean":"2023-08-01T19:54:04.040663+0000","last_became_active":"2023-08-01T19:55:59.568624+0000","last_became_peered":"2023-08-01T19:55:59.568624+0000","last_unstale":"2023-08-01T19:56:06.010054+0000","last_undegraded":"2023-08-01T19:56:06.010054+0000","last_fullsized":"2023-08-01T19:55:59.559660+0000","mapping_epoch":62,"log_start":"0'0","ondisk_log_start":"0'0","created":16,"last_epoch_clean":17,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-08-01T19:54:04.040663+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-08-01T19:54:04.040663+0000","last_clean_scrub_stamp":"2023-08-01T19:54:04.040663+0000","objects_scrubbed":0,"log_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-08-02T22:48:45.374422+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[0],"acting":[0],"avail_no_missing":["0"],"object_location_counts":[],"blocked_by":[],"up_primary":0,"acting_primary":0,"purged_snaps":[]},{"pgid":"4.21","version":"0'0","reported_seq":63,"reported_epoch":66,"state":"active+clean","last_fresh":"2023-08-01T19:56:06.007812+0000","last_change":"2023-08-01T19:55:51.123193+0000","last_active":"2023-08-01T19:56:06.007812+0000","last_peered":"2023-08-01T19:56:06.007812+0000","last_clean":"2023-08-01T19:56:06.007812+0000","last_became_active":"2023-08-01T19:55:51.122680+0000","last_became_peered":"2023-08-01T19:55:51.122680+0000","last_unstale":"2023-08-01T19:56:06.007812+0000","last_undegraded":"2023-08-01T19:56:06.007812+0000","last_fullsized":"2023-08-01T19:56:06.007812+0000","mapping_epoch":57,"log_start":"0'0","ondisk_log_start":"0'0","created":16,"last_epoch_clean":58,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-08-01T19:54:04.040663+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-08-01T19:54:04.040663+0000","last_clean_scrub_stamp":"2023-08-01T19:54:04.040663+0000","objects_scrubbed":0,"log_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-08-02T20:21:26.838834+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[0,2],"acting":[0,2],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":0,"acting_primary":0,"purged_snaps":[]},{"pgid":"4.22","version":"0'0","reported_seq":64,"reported_epoch":66,"state":"active+undersized","last_fresh":"2023-08-01T19:56:06.004064+0000","last_change":"2023-08-01T19:55:59.563986+0000","last_active":"2023-08-01T19:56:06.004064+0000","last_peered":"2023-08-01T19:56:06.004064+0000","last_clean":"2023-08-01T19:55:57.554932+0000","last_became_active":"2023-08-01T19:55:59.563986+0000","last_became_peered":"2023-08-01T19:55:59.563986+0000","last_unstale":"2023-08-01T19:56:06.004064+0000","last_undegraded":"2023-08-01T19:56:06.004064+0000","last_fullsized":"2023-08-01T19:55:59.558857+0000","mapping_epoch":62,"log_start":"0'0","ondisk_log_start":"0'0","created":16,"last_epoch_clean":17,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-08-01T19:54:04.040663+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-08-01T19:54:04.040663+0000","last_clean_scrub_stamp":"2023-08-01T19:54:04.040663+0000","objects_scrubbed":0,"log_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-08-03T06:31:28.947682+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[2],"acting":[2],"avail_no_missing":["2"],"object_location_counts":[],"blocked_by":[],"up_primary":2,"acting_primary":2,"purged_snaps":[]},{"pgid":"4.23","version":"0'0","reported_seq":25,"reported_epoch":66,"state":"active+clean","last_fresh":"2023-08-01T19:56:06.004365+0000","last_change":"2023-08-01T19:55:45.081439+0000","last_active":"2023-08-01T19:56:06.004365+0000","last_peered":"2023-08-01T19:56:06.004365+0000","last_clean":"2023-08-01T19:56:06.004365+0000","last_became_active":"2023-08-01T19:55:45.081115+0000","last_became_peered":"2023-08-01T19:55:45.081115+0000","last_unstale":"2023-08-01T19:56:06.004365+0000","last_undegraded":"2023-08-01T19:56:06.004365+0000","last_fullsized":"2023-08-01T19:56:06.004365+0000","mapping_epoch":53,"log_start":"0'0","ondisk_log_start":"0'0","created":16,"last_epoch_clean":54,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-08-01T19:54:04.040663+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-08-01T19:54:04.040663+0000","last_clean_scrub_stamp":"2023-08-01T19:54:04.040663+0000","objects_scrubbed":0,"log_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-08-02T22:55:09.649626+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[2,0],"acting":[2,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":2,"acting_primary":2,"purged_snaps":[]},{"pgid":"4.24","version":"0'0","reported_seq":64,"reported_epoch":66,"state":"active+undersized","last_fresh":"2023-08-01T19:56:06.005412+0000","last_change":"2023-08-01T19:55:59.563539+0000","last_active":"2023-08-01T19:56:06.005412+0000","last_peered":"2023-08-01T19:56:06.005412+0000","last_clean":"2023-08-01T19:55:57.555492+0000","last_became_active":"2023-08-01T19:55:59.563539+0000","last_became_peered":"2023-08-01T19:55:59.563539+0000","last_unstale":"2023-08-01T19:56:06.005412+0000","last_undegraded":"2023-08-01T19:56:06.005412+0000","last_fullsized":"2023-08-01T19:55:59.559118+0000","mapping_epoch":62,"log_start":"0'0","ondisk_log_start":"0'0","created":16,"last_epoch_clean":17,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-08-01T19:54:04.040663+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-08-01T19:54:04.040663+0000","last_clean_scrub_stamp":"2023-08-01T19:54:04.040663+0000","objects_scrubbed":0,"log_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-08-02T22:30:51.251380+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[2],"acting":[2],"avail_no_missing":["2"],"object_location_counts":[],"blocked_by":[],"up_primary":2,"acting_primary":2,"purged_snaps":[]}],"pool_stats":[{"poolid":5,"num_pg":16,"stat_sum":{"num_bytes":3101294616,"num_objects":47323,"num_object_clones":0,"num_object_copies":94646,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":29866,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":47323,"num_whiteouts":0,"num_read":1,"num_read_kb":1,"num_write":219995,"num_write_kb":8554113,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":1,"num_bytes_recovered":65536,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"store_stats":{"total":0,"available":0,"internally_reserved":0,"allocated":465080320,"data_stored":7441154096,"data_compressed":35719814,"data_compressed_allocated":465072128,"data_compressed_original":7441154048,"omap_allocated":0,"internal_metadata":0},"log_size":60501,"ondisk_log_size":60501,"up":22,"acting":22,"num_store_stats":3},{"poolid":4,"num_pg":64,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"store_stats":{"total":0,"available":0,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},"log_size":0,"ondisk_log_size":0,"up":87,"acting":87,"num_store_stats":3},{"poolid":3,"num_pg":32,"stat_sum":{"num_bytes":2306,"num_objects":22,"num_object_clones":0,"num_object_copies":44,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":21,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":22,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":45,"num_write_kb":13,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":14,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"store_stats":{"total":0,"available":0,"internally_reserved":0,"allocated":65536,"data_stored":4612,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},"log_size":39,"ondisk_log_size":39,"up":39,"acting":39,"num_store_stats":3},{"poolid":1,"num_pg":1,"stat_sum":{"num_bytes":590368,"num_objects":2,"num_object_clones":0,"num_object_copies":4,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":2,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":2,"num_whiteouts":0,"num_read":136,"num_read_kb":118,"num_write":203,"num_write_kb":3460,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"store_stats":{"total":0,"available":0,"internally_reserved":0,"allocated":114688,"data_stored":1180736,"data_compressed":20662,"data_compressed_allocated":73728,"data_compressed_original":1146880,"omap_allocated":0,"internal_metadata":0},"log_size":157,"ondisk_log_size":157,"up":1,"acting":1,"num_store_stats":2},{"poolid":2,"num_pg":8,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"store_stats":{"total":0,"available":0,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},"log_size":0,"ondisk_log_size":0,"up":12,"acting":12,"num_store_stats":3}],"osd_stats":[{"osd":2,"up_from":9,"seq":38654705696,"num_pgs":76,"num_osds":1,"num_per_pool_osds":1,"num_per_pool_omap_osds":1,"kb":94371840,"kb_used":236896,"kb_used_data":105932,"kb_used_omap":0,"kb_used_meta":130944,"kb_avail":94134944,"statfs":{"total":96636764160,"available":96394182656,"internally_reserved":0,"allocated":108474368,"data_stored":1722963674,"data_compressed":8280200,"data_compressed_allocated":107667456,"data_compressed_original":1722662912,"omap_allocated":0,"internal_metadata":134086656},"hb_peers":[0],"snap_trim_queue_len":0,"num_snap_trimming":0,"num_shards_repaired":0,"op_queue_age_hist":{"histogram":[],"upper_bound":1},"perf_stat":{"commit_latency_ms":3,"apply_latency_ms":3,"commit_latency_ns":3000000,"apply_latency_ns":3000000},"alerts":[],"network_ping_times":[{"osd":0,"last update":"Tue Aug 1 19:55:53 2023","interfaces":[{"interface":"back","average":{"1min":0.312,"5min":0.44800000000000001,"15min":0.47099999999999997},"min":{"1min":0.17699999999999999,"5min":0.17699999999999999,"15min":0.17699999999999999},"max":{"1min":1.7989999999999999,"5min":2.5529999999999999,"15min":2.5529999999999999},"last":0.26000000000000001},{"interface":"front","average":{"1min":0.44900000000000001,"5min":0.437,"15min":0.435},"min":{"1min":0.187,"5min":0.187,"15min":0.187},"max":{"1min":1.659,"5min":1.659,"15min":1.659},"last":0.21099999999999999}]},{"osd":1,"last update":"Tue Aug 1 19:55:53 2023","interfaces":[{"interface":"back","average":{"1min":0.33400000000000002,"5min":0.42599999999999999,"15min":0.442},"min":{"1min":0.20300000000000001,"5min":0.188,"15min":0.188},"max":{"1min":1.9350000000000001,"5min":1.9350000000000001,"15min":1.9350000000000001},"last":0.27700000000000002},{"interface":"front","average":{"1min":0.23799999999999999,"5min":0.39300000000000002,"15min":0.41899999999999998},"min":{"1min":0.19500000000000001,"5min":0.19500000000000001,"15min":0.19500000000000001},"max":{"1min":0.27800000000000002,"5min":0.98699999999999999,"15min":0.98699999999999999},"last":0.254}]}]},{"osd":0,"up_from":8,"seq":34359738399,"num_pgs":85,"num_osds":1,"num_per_pool_osds":1,"num_per_pool_omap_osds":1,"kb":94371840,"kb_used":329904,"kb_used_data":164092,"kb_used_omap":0,"kb_used_meta":165760,"kb_avail":94041936,"statfs":{"total":96636764160,"available":96298942464,"internally_reserved":0,"allocated":168030208,"data_stored":2676510776,"data_compressed":12849875,"data_compressed_allocated":167264256,"data_compressed_original":2676228096,"omap_allocated":0,"internal_metadata":169738240},"hb_peers":[2],"snap_trim_queue_len":0,"num_snap_trimming":0,"num_shards_repaired":0,"op_queue_age_hist":{"histogram":[],"upper_bound":1},"perf_stat":{"commit_latency_ms":4,"apply_latency_ms":4,"commit_latency_ns":4000000,"apply_latency_ns":4000000},"alerts":[],"network_ping_times":[{"osd":1,"last update":"Tue Aug 1 19:55:53 2023","interfaces":[{"interface":"back","average":{"1min":0.42499999999999999,"5min":0.375,"15min":0.36699999999999999},"min":{"1min":0.16300000000000001,"5min":0.16300000000000001,"15min":0.16300000000000001},"max":{"1min":1.7609999999999999,"5min":1.7609999999999999,"15min":1.7609999999999999},"last":3.9809999999999999},{"interface":"front","average":{"1min":0.41099999999999998,"5min":0.39900000000000002,"15min":0.39700000000000002},"min":{"1min":0.186,"5min":0.186,"15min":0.186},"max":{"1min":2.0960000000000001,"5min":2.0960000000000001,"15min":2.0960000000000001},"last":0.29299999999999998}]},{"osd":2,"last update":"Tue Aug 1 19:55:58 2023","interfaces":[{"interface":"back","average":{"1min":0.47899999999999998,"5min":0.40400000000000003,"15min":0.39200000000000002},"min":{"1min":0.20599999999999999,"5min":0.20300000000000001,"15min":0.20300000000000001},"max":{"1min":2.1400000000000001,"5min":2.1400000000000001,"15min":2.1400000000000001},"last":0.221},{"interface":"front","average":{"1min":0.52500000000000002,"5min":0.433,"15min":0.41799999999999998},"min":{"1min":0.224,"5min":0.218,"15min":0.218},"max":{"1min":1.8480000000000001,"5min":1.8480000000000001,"15min":1.8480000000000001},"last":0.23499999999999999}]}]},{"osd":1,"up_from":8,"seq":34359738395,"num_pgs":81,"num_osds":1,"num_per_pool_osds":1,"num_per_pool_omap_osds":1,"kb":94371840,"kb_used":324936,"kb_used_data":196528,"kb_used_omap":0,"kb_used_meta":128384,"kb_avail":94046904,"statfs":{"total":96636764160,"available":96304029696,"internally_reserved":0,"allocated":201244672,"data_stored":3208692527,"data_compressed":15401053,"data_compressed_allocated":200527872,"data_compressed_original":3208429568,"omap_allocated":0,"internal_metadata":131465216},"hb_peers":[0,2],"snap_trim_queue_len":0,"num_snap_trimming":0,"num_shards_repaired":0,"op_queue_age_hist":{"histogram":[],"upper_bound":1},"perf_stat":{"commit_latency_ms":3,"apply_latency_ms":3,"commit_latency_ns":3000000,"apply_latency_ns":3000000},"alerts":[],"network_ping_times":[{"osd":0,"last update":"Tue Aug 1 19:55:51 2023","interfaces":[{"interface":"back","average":{"1min":0.32200000000000001,"5min":0.57499999999999996,"15min":0.61699999999999999},"min":{"1min":0.18099999999999999,"5min":0.17299999999999999,"15min":0.17299999999999999},"max":{"1min":1.585,"5min":2.1709999999999998,"15min":2.1709999999999998},"last":0.27500000000000002},{"interface":"front","average":{"1min":0.48799999999999999,"5min":0.39100000000000001,"15min":0.375},"min":{"1min":0.193,"5min":0.193,"15min":0.193},"max":{"1min":2.1890000000000001,"5min":2.1890000000000001,"15min":2.1890000000000001},"last":2.1890000000000001}]},{"osd":2,"last update":"Tue Aug 1 19:54:54 2023","interfaces":[{"interface":"back","average":{"1min":0.378,"5min":0.378,"15min":0.378},"min":{"1min":0.17599999999999999,"5min":0.17599999999999999,"15min":0.17599999999999999},"max":{"1min":0.84899999999999998,"5min":0.84899999999999998,"15min":0.84899999999999998},"last":0.26300000000000001},{"interface":"front","average":{"1min":0.45300000000000001,"5min":0.45300000000000001,"15min":0.45300000000000001},"min":{"1min":0.20999999999999999,"5min":0.20999999999999999,"15min":0.20999999999999999},"max":{"1min":1.468,"5min":1.468,"15min":1.468},"last":0.313}]}]}],"pool_statfs":[{"poolid":1,"osd":1,"total":0,"available":0,"internally_reserved":0,"allocated":57344,"data_stored":590368,"data_compressed":10331,"data_compressed_allocated":36864,"data_compressed_original":573440,"omap_allocated":0,"internal_metadata":0},{"poolid":1,"osd":2,"total":0,"available":0,"internally_reserved":0,"allocated":57344,"data_stored":590368,"data_compressed":10331,"data_compressed_allocated":36864,"data_compressed_original":573440,"omap_allocated":0,"internal_metadata":0},{"poolid":2,"osd":0,"total":0,"available":0,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":2,"osd":1,"total":0,"available":0,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":2,"osd":2,"total":0,"available":0,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":3,"osd":0,"total":0,"available":0,"internally_reserved":0,"allocated":8192,"data_stored":588,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":3,"osd":1,"total":0,"available":0,"internally_reserved":0,"allocated":32768,"data_stored":2306,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":3,"osd":2,"total":0,"available":0,"internally_reserved":0,"allocated":24576,"data_stored":1718,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":4,"osd":0,"total":0,"available":0,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":4,"osd":1,"total":0,"available":0,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":4,"osd":2,"total":0,"available":0,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":5,"osd":0,"total":0,"available":0,"internally_reserved":0,"allocated":161132544,"data_stored":2578120704,"data_compressed":12379817,"data_compressed_allocated":161132544,"data_compressed_original":2578120704,"omap_allocated":0,"internal_metadata":0},{"poolid":5,"osd":1,"total":0,"available":0,"internally_reserved":0,"allocated":197578752,"data_stored":3161194520,"data_compressed":15167154,"data_compressed_allocated":197574656,"data_compressed_original":3161194496,"omap_allocated":0,"internal_metadata":0},{"poolid":5,"osd":2,"total":0,"available":0,"internally_reserved":0,"allocated":106369024,"data_stored":1701838872,"data_compressed":8172843,"data_compressed_allocated":106364928,"data_compressed_original":1701838848,"omap_allocated":0,"internal_metadata":0}]}} 2023-08-01T19:56:15.077 INFO:tasks.thrashosds.thrasher:Setting 2.5 to [2, 0, 1] 2023-08-01T19:56:15.077 INFO:tasks.thrashosds.thrasher:cmd ['osd', 'pg-upmap-items', '2.5', '2', '0', '1'] 2023-08-01T19:56:15.078 DEBUG:teuthology.orchestra.run.smithi006:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 120 ceph --cluster ceph osd pg-upmap-items 2.5 2 0 1 2023-08-01T19:56:15.098 INFO:teuthology.orchestra.run.smithi006.stderr:noscrub is unset 2023-08-01T19:56:15.128 INFO:tasks.ceph.osd.2.smithi155.stderr:2023-08-01T19:56:15.128+0000 7faa5c6ac700 -1 received signal: Hangup from /usr/bin/python3 /bin/daemon-helper kill ceph-osd -f --cluster ceph -i 2 (PID: 111337) UID: 0 2023-08-01T19:56:15.176 INFO:teuthology.orchestra.run.smithi008.stdout:ERROR: (22) Invalid argument 2023-08-01T19:56:15.176 INFO:teuthology.orchestra.run.smithi008.stdout:op_tracker tracking is not enabled now, so no ops are tracked currently, even those get stuck. Please enable "osd_enable_op_tracker", and the tracker will start to track new ops received afterwards. 2023-08-01T19:56:15.184 DEBUG:teuthology.orchestra.run.smithi006:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 120 ceph --cluster ceph -- tell 'osd.*' injectargs --osd_enable_op_tracker=true 2023-08-01T19:56:15.194 DEBUG:teuthology.orchestra.run.smithi155:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 30 ceph --cluster ceph --admin-daemon /var/run/ceph/ceph-osd.2.asok dump_ops_in_flight 2023-08-01T19:56:15.238 INFO:tasks.ceph.osd.2.smithi155.stderr:2023-08-01T19:56:15.238+0000 7faa5c6ac700 -1 received signal: Hangup from /usr/bin/python3 /bin/daemon-helper kill ceph-osd -f --cluster ceph -i 2 (PID: 111337) UID: 0 2023-08-01T19:56:15.330 INFO:tasks.ceph.osd.2.smithi155.stderr:2023-08-01T19:56:15.329+0000 7faa5c6ac700 -1 received signal: Hangup from /usr/bin/python3 /bin/daemon-helper kill ceph-osd -f --cluster ceph -i 2 (PID: 111337) UID: 0 2023-08-01T19:56:15.348 INFO:teuthology.orchestra.run.smithi006.stdout:osd.0: {} 2023-08-01T19:56:15.360 INFO:teuthology.orchestra.run.smithi155.stdout:ERROR: (22) Invalid argument 2023-08-01T19:56:15.360 INFO:teuthology.orchestra.run.smithi155.stdout:op_tracker tracking is not enabled now, so no ops are tracked currently, even those get stuck. Please enable "osd_enable_op_tracker", and the tracker will start to track new ops received afterwards. 2023-08-01T19:56:15.370 INFO:teuthology.orchestra.run.smithi006.stdout:osd.2: {} 2023-08-01T19:56:15.370 INFO:teuthology.orchestra.run.smithi006.stderr:osd.0: osd_enable_op_tracker = 'true' 2023-08-01T19:56:15.371 INFO:teuthology.orchestra.run.smithi006.stderr:Error ENXIO: problem getting command descriptions from osd.1 2023-08-01T19:56:15.371 INFO:teuthology.orchestra.run.smithi006.stderr:osd.2: osd_enable_op_tracker = 'true' 2023-08-01T19:56:15.372 DEBUG:teuthology.orchestra.run.smithi155:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 30 ceph --cluster ceph --admin-daemon /var/run/ceph/ceph-osd.2.asok dump_blocked_ops 2023-08-01T19:56:15.373 DEBUG:teuthology.orchestra.run:got remote process result: 6 2023-08-01T19:56:15.374 INFO:tasks.thrashosds.thrasher:Failed to tell all osds, ignoring 2023-08-01T19:56:15.430 INFO:tasks.ceph.osd.0.smithi008.stderr:2023-08-01T19:56:15.429+0000 7f16a58f4700 -1 received signal: Hangup from /usr/bin/python3 /bin/daemon-helper kill ceph-osd -f --cluster ceph -i 0 (PID: 111179) UID: 0 2023-08-01T19:56:15.466 INFO:teuthology.orchestra.run.smithi006.stderr:Error EINVAL: you must specify pairs of osd ids to be remapped 2023-08-01T19:56:15.469 DEBUG:teuthology.orchestra.run:got remote process result: 22 2023-08-01T19:56:15.469 INFO:tasks.thrashosds.thrasher:Failed to rm-pg-upmap-items, ignoring 2023-08-01T19:56:15.521 INFO:tasks.daemonwatchdog.daemon_watchdog:daemon ceph.osd.1 is failed for ~12s 2023-08-01T19:56:15.531 INFO:tasks.ceph.osd.0.smithi008.stderr:2023-08-01T19:56:15.530+0000 7f16a58f4700 -1 received signal: Hangup from /usr/bin/python3 /bin/daemon-helper kill ceph-osd -f --cluster ceph -i 0 (PID: 111179) UID: 0 2023-08-01T19:56:15.572 INFO:teuthology.orchestra.run.smithi155.stdout:{ 2023-08-01T19:56:15.573 INFO:teuthology.orchestra.run.smithi155.stdout: "ops": [], 2023-08-01T19:56:15.573 INFO:teuthology.orchestra.run.smithi155.stdout: "complaint_time": 30, 2023-08-01T19:56:15.573 INFO:teuthology.orchestra.run.smithi155.stdout: "num_blocked_ops": 0 2023-08-01T19:56:15.573 INFO:teuthology.orchestra.run.smithi155.stdout:} 2023-08-01T19:56:15.585 DEBUG:teuthology.orchestra.run.smithi155:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 30 ceph --cluster ceph --admin-daemon /var/run/ceph/ceph-osd.2.asok dump_historic_ops 2023-08-01T19:56:15.633 INFO:tasks.ceph.osd.2.smithi155.stderr:2023-08-01T19:56:15.632+0000 7faa5c6ac700 -1 received signal: Hangup from /usr/bin/python3 /bin/daemon-helper kill ceph-osd -f --cluster ceph -i 2 (PID: 111337) UID: 0 2023-08-01T19:56:15.734 INFO:tasks.ceph.osd.2.smithi155.stderr:2023-08-01T19:56:15.733+0000 7faa5c6ac700 -1 received signal: Hangup from /usr/bin/python3 /bin/daemon-helper kill ceph-osd -f --cluster ceph -i 2 (PID: 111337) UID: 0 2023-08-01T19:56:15.756 INFO:teuthology.orchestra.run.smithi155.stdout:{ 2023-08-01T19:56:15.756 INFO:teuthology.orchestra.run.smithi155.stdout: "size": 20, 2023-08-01T19:56:15.756 INFO:teuthology.orchestra.run.smithi155.stdout: "duration": 600, 2023-08-01T19:56:15.757 INFO:teuthology.orchestra.run.smithi155.stdout: "ops": [ 2023-08-01T19:56:15.757 INFO:teuthology.orchestra.run.smithi155.stdout: { 2023-08-01T19:56:15.757 INFO:teuthology.orchestra.run.smithi155.stdout: "description": "osd_op(client.4668.0:100237 5.4 5:2d68bec9:::benchmark_data_smithi006_114134_object100236:head [set-alloc-hint object_size 65536 write_size 65536,write 0~65536] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e37)", 2023-08-01T19:56:15.757 INFO:teuthology.orchestra.run.smithi155.stdout: "initiated_at": "2023-08-01T19:55:05.147736+0000", 2023-08-01T19:56:15.757 INFO:teuthology.orchestra.run.smithi155.stdout: "age": 70.605828829999993, 2023-08-01T19:56:15.757 INFO:teuthology.orchestra.run.smithi155.stdout: "duration": 0.071299464000000007, 2023-08-01T19:56:15.757 INFO:teuthology.orchestra.run.smithi155.stdout: "type_data": { 2023-08-01T19:56:15.758 INFO:teuthology.orchestra.run.smithi155.stdout: "flag_point": "commit sent; apply or cleanup", 2023-08-01T19:56:15.758 INFO:teuthology.orchestra.run.smithi155.stdout: "client_info": { 2023-08-01T19:56:15.758 INFO:teuthology.orchestra.run.smithi155.stdout: "client": "client.4668", 2023-08-01T19:56:15.758 INFO:teuthology.orchestra.run.smithi155.stdout: "client_addr": "172.21.15.6:0/1709472247", 2023-08-01T19:56:15.758 INFO:teuthology.orchestra.run.smithi155.stdout: "tid": 100237 2023-08-01T19:56:15.758 INFO:teuthology.orchestra.run.smithi155.stdout: }, 2023-08-01T19:56:15.758 INFO:teuthology.orchestra.run.smithi155.stdout: "events": [ 2023-08-01T19:56:15.759 INFO:teuthology.orchestra.run.smithi155.stdout: { 2023-08-01T19:56:15.759 INFO:teuthology.orchestra.run.smithi155.stdout: "event": "initiated", 2023-08-01T19:56:15.759 INFO:teuthology.orchestra.run.smithi155.stdout: "time": "2023-08-01T19:55:05.147736+0000", 2023-08-01T19:56:15.759 INFO:teuthology.orchestra.run.smithi155.stdout: "duration": 0 2023-08-01T19:56:15.759 INFO:teuthology.orchestra.run.smithi155.stdout: }, 2023-08-01T19:56:15.759 INFO:teuthology.orchestra.run.smithi155.stdout: { 2023-08-01T19:56:15.759 INFO:teuthology.orchestra.run.smithi155.stdout: "event": "throttled", 2023-08-01T19:56:15.760 INFO:teuthology.orchestra.run.smithi155.stdout: "time": "2023-08-01T19:55:05.147736+0000", 2023-08-01T19:56:15.760 INFO:teuthology.orchestra.run.smithi155.stdout: "duration": 0 2023-08-01T19:56:15.760 INFO:teuthology.orchestra.run.smithi155.stdout: }, 2023-08-01T19:56:15.760 INFO:teuthology.orchestra.run.smithi155.stdout: { 2023-08-01T19:56:15.760 INFO:teuthology.orchestra.run.smithi155.stdout: "event": "header_read", 2023-08-01T19:56:15.760 INFO:teuthology.orchestra.run.smithi155.stdout: "time": "2023-08-01T19:55:05.147736+0000", 2023-08-01T19:56:15.760 INFO:teuthology.orchestra.run.smithi155.stdout: "duration": 4294967295.9999995 2023-08-01T19:56:15.761 INFO:teuthology.orchestra.run.smithi155.stdout: }, 2023-08-01T19:56:15.761 INFO:teuthology.orchestra.run.smithi155.stdout: { 2023-08-01T19:56:15.761 INFO:teuthology.orchestra.run.smithi155.stdout: "event": "all_read", 2023-08-01T19:56:15.761 INFO:teuthology.orchestra.run.smithi155.stdout: "time": "2023-08-01T19:55:05.147766+0000", 2023-08-01T19:56:15.761 INFO:teuthology.orchestra.run.smithi155.stdout: "duration": 3.0394000000000001e-05 2023-08-01T19:56:15.763 INFO:teuthology.orchestra.run.smithi155.stdout: }, 2023-08-01T19:56:15.763 INFO:teuthology.orchestra.run.smithi155.stdout: { 2023-08-01T19:56:15.763 INFO:teuthology.orchestra.run.smithi155.stdout: "event": "dispatched", 2023-08-01T19:56:15.764 INFO:teuthology.orchestra.run.smithi155.stdout: "time": "2023-08-01T19:55:05.147771+0000", 2023-08-01T19:56:15.764 INFO:teuthology.orchestra.run.smithi155.stdout: "duration": 4.25e-06 2023-08-01T19:56:15.764 INFO:teuthology.orchestra.run.smithi155.stdout: }, 2023-08-01T19:56:15.764 INFO:teuthology.orchestra.run.smithi155.stdout: { 2023-08-01T19:56:15.764 INFO:teuthology.orchestra.run.smithi155.stdout: "event": "queued_for_pg", 2023-08-01T19:56:15.764 INFO:teuthology.orchestra.run.smithi155.stdout: "time": "2023-08-01T19:55:05.147773+0000", 2023-08-01T19:56:15.764 INFO:teuthology.orchestra.run.smithi155.stdout: "duration": 2.4159999999999998e-06 2023-08-01T19:56:15.765 INFO:teuthology.orchestra.run.smithi155.stdout: }, 2023-08-01T19:56:15.765 INFO:teuthology.orchestra.run.smithi155.stdout: { 2023-08-01T19:56:15.765 INFO:teuthology.orchestra.run.smithi155.stdout: "event": "reached_pg", 2023-08-01T19:56:15.765 INFO:teuthology.orchestra.run.smithi155.stdout: "time": "2023-08-01T19:55:05.149903+0000", 2023-08-01T19:56:15.765 INFO:teuthology.orchestra.run.smithi155.stdout: "duration": 0.002129948 2023-08-01T19:56:15.765 INFO:teuthology.orchestra.run.smithi155.stdout: }, 2023-08-01T19:56:15.765 INFO:teuthology.orchestra.run.smithi155.stdout: { 2023-08-01T19:56:15.766 INFO:teuthology.orchestra.run.smithi155.stdout: "event": "started", 2023-08-01T19:56:15.766 INFO:teuthology.orchestra.run.smithi155.stdout: "time": "2023-08-01T19:55:05.149982+0000", 2023-08-01T19:56:15.766 INFO:teuthology.orchestra.run.smithi155.stdout: "duration": 7.8706000000000002e-05 2023-08-01T19:56:15.766 INFO:teuthology.orchestra.run.smithi155.stdout: }, 2023-08-01T19:56:15.766 INFO:teuthology.orchestra.run.smithi155.stdout: { 2023-08-01T19:56:15.766 INFO:teuthology.orchestra.run.smithi155.stdout: "event": "waiting for subops from 0", 2023-08-01T19:56:15.766 INFO:teuthology.orchestra.run.smithi155.stdout: "time": "2023-08-01T19:55:05.150066+0000", 2023-08-01T19:56:15.767 INFO:teuthology.orchestra.run.smithi155.stdout: "duration": 8.4241999999999997e-05 2023-08-01T19:56:15.767 INFO:teuthology.orchestra.run.smithi155.stdout: }, 2023-08-01T19:56:15.767 INFO:teuthology.orchestra.run.smithi155.stdout: { 2023-08-01T19:56:15.767 INFO:teuthology.orchestra.run.smithi155.stdout: "event": "op_commit", 2023-08-01T19:56:15.767 INFO:teuthology.orchestra.run.smithi155.stdout: "time": "2023-08-01T19:55:05.154994+0000", 2023-08-01T19:56:15.767 INFO:teuthology.orchestra.run.smithi155.stdout: "duration": 0.0049277050000000001 2023-08-01T19:56:15.767 INFO:teuthology.orchestra.run.smithi155.stdout: }, 2023-08-01T19:56:15.767 INFO:teuthology.orchestra.run.smithi155.stdout: { 2023-08-01T19:56:15.768 INFO:teuthology.orchestra.run.smithi155.stdout: "event": "sub_op_commit_rec", 2023-08-01T19:56:15.768 INFO:teuthology.orchestra.run.smithi155.stdout: "time": "2023-08-01T19:55:05.218933+0000", 2023-08-01T19:56:15.768 INFO:teuthology.orchestra.run.smithi155.stdout: "duration": 0.063939916999999999 2023-08-01T19:56:15.768 INFO:teuthology.orchestra.run.smithi155.stdout: }, 2023-08-01T19:56:15.768 INFO:teuthology.orchestra.run.smithi155.stdout: { 2023-08-01T19:56:15.768 INFO:teuthology.orchestra.run.smithi155.stdout: "event": "commit_sent", 2023-08-01T19:56:15.768 INFO:teuthology.orchestra.run.smithi155.stdout: "time": "2023-08-01T19:55:05.218989+0000", 2023-08-01T19:56:15.769 INFO:teuthology.orchestra.run.smithi155.stdout: "duration": 5.5772000000000001e-05 2023-08-01T19:56:15.769 INFO:teuthology.orchestra.run.smithi155.stdout: }, 2023-08-01T19:56:15.769 INFO:teuthology.orchestra.run.smithi155.stdout: { 2023-08-01T19:56:15.769 INFO:teuthology.orchestra.run.smithi155.stdout: "event": "done", 2023-08-01T19:56:15.769 INFO:teuthology.orchestra.run.smithi155.stdout: "time": "2023-08-01T19:55:05.219036+0000", 2023-08-01T19:56:15.769 INFO:teuthology.orchestra.run.smithi155.stdout: "duration": 4.6526000000000001e-05 2023-08-01T19:56:15.769 INFO:teuthology.orchestra.run.smithi155.stdout: } 2023-08-01T19:56:15.770 INFO:teuthology.orchestra.run.smithi155.stdout: ] 2023-08-01T19:56:15.770 INFO:teuthology.orchestra.run.smithi155.stdout: } 2023-08-01T19:56:15.770 INFO:teuthology.orchestra.run.smithi155.stdout: }, 2023-08-01T19:56:15.770 INFO:teuthology.orchestra.run.smithi155.stdout: { 2023-08-01T19:56:15.770 INFO:teuthology.orchestra.run.smithi155.stdout: "description": "osd_op(client.4668.0:100242 5.8 5:16a314b8:::benchmark_data_smithi006_114134_object100241:head [set-alloc-hint object_size 65536 write_size 65536,write 0~65536] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e37)", 2023-08-01T19:56:15.770 INFO:teuthology.orchestra.run.smithi155.stdout: "initiated_at": "2023-08-01T19:55:05.150616+0000", 2023-08-01T19:56:15.770 INFO:teuthology.orchestra.run.smithi155.stdout: "age": 70.602949199999998, 2023-08-01T19:56:15.771 INFO:teuthology.orchestra.run.smithi155.stdout: "duration": 0.071105065999999995, 2023-08-01T19:56:15.771 INFO:teuthology.orchestra.run.smithi155.stdout: "type_data": { 2023-08-01T19:56:15.771 INFO:teuthology.orchestra.run.smithi155.stdout: "flag_point": "commit sent; apply or cleanup", 2023-08-01T19:56:15.771 INFO:teuthology.orchestra.run.smithi155.stdout: "client_info": { 2023-08-01T19:56:15.771 INFO:teuthology.orchestra.run.smithi155.stdout: "client": "client.4668", 2023-08-01T19:56:15.771 INFO:teuthology.orchestra.run.smithi155.stdout: "client_addr": "172.21.15.6:0/1709472247", 2023-08-01T19:56:15.771 INFO:teuthology.orchestra.run.smithi155.stdout: "tid": 100242 2023-08-01T19:56:15.771 INFO:teuthology.orchestra.run.smithi155.stdout: }, 2023-08-01T19:56:15.772 INFO:teuthology.orchestra.run.smithi155.stdout: "events": [ 2023-08-01T19:56:15.772 INFO:teuthology.orchestra.run.smithi155.stdout: { 2023-08-01T19:56:15.772 INFO:teuthology.orchestra.run.smithi155.stdout: "event": "initiated", 2023-08-01T19:56:15.772 INFO:teuthology.orchestra.run.smithi155.stdout: "time": "2023-08-01T19:55:05.150616+0000", 2023-08-01T19:56:15.772 INFO:teuthology.orchestra.run.smithi155.stdout: "duration": 0 2023-08-01T19:56:15.772 INFO:teuthology.orchestra.run.smithi155.stdout: }, 2023-08-01T19:56:15.772 INFO:teuthology.orchestra.run.smithi155.stdout: { 2023-08-01T19:56:15.773 INFO:teuthology.orchestra.run.smithi155.stdout: "event": "throttled", 2023-08-01T19:56:15.773 INFO:teuthology.orchestra.run.smithi155.stdout: "time": "2023-08-01T19:55:05.150616+0000", 2023-08-01T19:56:15.773 INFO:teuthology.orchestra.run.smithi155.stdout: "duration": 0 2023-08-01T19:56:15.773 INFO:teuthology.orchestra.run.smithi155.stdout: }, 2023-08-01T19:56:15.773 INFO:teuthology.orchestra.run.smithi155.stdout: { 2023-08-01T19:56:15.773 INFO:teuthology.orchestra.run.smithi155.stdout: "event": "header_read", 2023-08-01T19:56:15.773 INFO:teuthology.orchestra.run.smithi155.stdout: "time": "2023-08-01T19:55:05.150615+0000", 2023-08-01T19:56:15.774 INFO:teuthology.orchestra.run.smithi155.stdout: "duration": 4294967295.999999 2023-08-01T19:56:15.774 INFO:teuthology.orchestra.run.smithi155.stdout: }, 2023-08-01T19:56:15.774 INFO:teuthology.orchestra.run.smithi155.stdout: { 2023-08-01T19:56:15.774 INFO:teuthology.orchestra.run.smithi155.stdout: "event": "all_read", 2023-08-01T19:56:15.774 INFO:teuthology.orchestra.run.smithi155.stdout: "time": "2023-08-01T19:55:05.150696+0000", 2023-08-01T19:56:15.774 INFO:teuthology.orchestra.run.smithi155.stdout: "duration": 8.0852000000000004e-05 2023-08-01T19:56:15.774 INFO:teuthology.orchestra.run.smithi155.stdout: }, 2023-08-01T19:56:15.775 INFO:teuthology.orchestra.run.smithi155.stdout: { 2023-08-01T19:56:15.775 INFO:teuthology.orchestra.run.smithi155.stdout: "event": "dispatched", 2023-08-01T19:56:15.775 INFO:teuthology.orchestra.run.smithi155.stdout: "time": "2023-08-01T19:55:05.150708+0000", 2023-08-01T19:56:15.775 INFO:teuthology.orchestra.run.smithi155.stdout: "duration": 1.2116999999999999e-05 2023-08-01T19:56:15.775 INFO:teuthology.orchestra.run.smithi155.stdout: }, 2023-08-01T19:56:15.775 INFO:teuthology.orchestra.run.smithi155.stdout: { 2023-08-01T19:56:15.775 INFO:teuthology.orchestra.run.smithi155.stdout: "event": "queued_for_pg", 2023-08-01T19:56:15.776 INFO:teuthology.orchestra.run.smithi155.stdout: "time": "2023-08-01T19:55:05.150713+0000", 2023-08-01T19:56:15.776 INFO:teuthology.orchestra.run.smithi155.stdout: "duration": 5.4620000000000004e-06 2023-08-01T19:56:15.776 INFO:teuthology.orchestra.run.smithi155.stdout: }, 2023-08-01T19:56:15.776 INFO:teuthology.orchestra.run.smithi155.stdout: { 2023-08-01T19:56:15.776 INFO:teuthology.orchestra.run.smithi155.stdout: "event": "reached_pg", 2023-08-01T19:56:15.776 INFO:teuthology.orchestra.run.smithi155.stdout: "time": "2023-08-01T19:55:05.150761+0000", 2023-08-01T19:56:15.776 INFO:teuthology.orchestra.run.smithi155.stdout: "duration": 4.7429000000000003e-05 2023-08-01T19:56:15.777 INFO:teuthology.orchestra.run.smithi155.stdout: }, 2023-08-01T19:56:15.777 INFO:teuthology.orchestra.run.smithi155.stdout: { 2023-08-01T19:56:15.777 INFO:teuthology.orchestra.run.smithi155.stdout: "event": "started", 2023-08-01T19:56:15.777 INFO:teuthology.orchestra.run.smithi155.stdout: "time": "2023-08-01T19:55:05.150856+0000", 2023-08-01T19:56:15.777 INFO:teuthology.orchestra.run.smithi155.stdout: "duration": 9.5356e-05 2023-08-01T19:56:15.777 INFO:teuthology.orchestra.run.smithi155.stdout: }, 2023-08-01T19:56:15.777 INFO:teuthology.orchestra.run.smithi155.stdout: { 2023-08-01T19:56:15.777 INFO:teuthology.orchestra.run.smithi155.stdout: "event": "waiting for subops from 0", 2023-08-01T19:56:15.778 INFO:teuthology.orchestra.run.smithi155.stdout: "time": "2023-08-01T19:55:05.150999+0000", 2023-08-01T19:56:15.778 INFO:teuthology.orchestra.run.smithi155.stdout: "duration": 0.00014234499999999999 2023-08-01T19:56:15.778 INFO:teuthology.orchestra.run.smithi155.stdout: }, 2023-08-01T19:56:15.778 INFO:teuthology.orchestra.run.smithi155.stdout: { 2023-08-01T19:56:15.778 INFO:teuthology.orchestra.run.smithi155.stdout: "event": "sub_op_commit_rec", 2023-08-01T19:56:15.778 INFO:teuthology.orchestra.run.smithi155.stdout: "time": "2023-08-01T19:55:05.219001+0000", 2023-08-01T19:56:15.778 INFO:teuthology.orchestra.run.smithi155.stdout: "duration": 0.068002776000000001 2023-08-01T19:56:15.779 INFO:teuthology.orchestra.run.smithi155.stdout: }, 2023-08-01T19:56:15.779 INFO:teuthology.orchestra.run.smithi155.stdout: { 2023-08-01T19:56:15.779 INFO:teuthology.orchestra.run.smithi155.stdout: "event": "op_commit", 2023-08-01T19:56:15.779 INFO:teuthology.orchestra.run.smithi155.stdout: "time": "2023-08-01T19:55:05.221635+0000", 2023-08-01T19:56:15.779 INFO:teuthology.orchestra.run.smithi155.stdout: "duration": 0.0026340579999999999 2023-08-01T19:56:15.779 INFO:teuthology.orchestra.run.smithi155.stdout: }, 2023-08-01T19:56:15.779 INFO:teuthology.orchestra.run.smithi155.stdout: { 2023-08-01T19:56:15.780 INFO:teuthology.orchestra.run.smithi155.stdout: "event": "commit_sent", 2023-08-01T19:56:15.780 INFO:teuthology.orchestra.run.smithi155.stdout: "time": "2023-08-01T19:55:05.221682+0000", 2023-08-01T19:56:15.780 INFO:teuthology.orchestra.run.smithi155.stdout: "duration": 4.7123999999999998e-05 2023-08-01T19:56:15.780 INFO:teuthology.orchestra.run.smithi155.stdout: }, 2023-08-01T19:56:15.780 INFO:teuthology.orchestra.run.smithi155.stdout: { 2023-08-01T19:56:15.780 INFO:teuthology.orchestra.run.smithi155.stdout: "event": "done", 2023-08-01T19:56:15.780 INFO:teuthology.orchestra.run.smithi155.stdout: "time": "2023-08-01T19:55:05.221721+0000", 2023-08-01T19:56:15.781 INFO:teuthology.orchestra.run.smithi155.stdout: "duration": 3.8529999999999999e-05 2023-08-01T19:56:15.781 INFO:teuthology.orchestra.run.smithi155.stdout: } 2023-08-01T19:56:15.781 INFO:teuthology.orchestra.run.smithi155.stdout: ] 2023-08-01T19:56:15.781 INFO:teuthology.orchestra.run.smithi155.stdout: } 2023-08-01T19:56:15.781 INFO:teuthology.orchestra.run.smithi155.stdout: }, 2023-08-01T19:56:15.781 INFO:teuthology.orchestra.run.smithi155.stdout: { 2023-08-01T19:56:15.781 INFO:teuthology.orchestra.run.smithi155.stdout: "description": "osd_repop(client.4668.0:100240 5.a e37/19 5:5313c5b9:::benchmark_data_smithi006_114134_object100239:head v 37'6227, mlcod=37'6225)", 2023-08-01T19:56:15.781 INFO:teuthology.orchestra.run.smithi155.stdout: "initiated_at": "2023-08-01T19:55:05.150778+0000", 2023-08-01T19:56:15.782 INFO:teuthology.orchestra.run.smithi155.stdout: "age": 70.602786999000003, 2023-08-01T19:56:15.782 INFO:teuthology.orchestra.run.smithi155.stdout: "duration": 0.073362533999999993, 2023-08-01T19:56:15.782 INFO:teuthology.orchestra.run.smithi155.stdout: "type_data": { 2023-08-01T19:56:15.782 INFO:teuthology.orchestra.run.smithi155.stdout: "flag_point": "commit sent; apply or cleanup", 2023-08-01T19:56:15.782 INFO:teuthology.orchestra.run.smithi155.stdout: "events": [ 2023-08-01T19:56:15.782 INFO:teuthology.orchestra.run.smithi155.stdout: { 2023-08-01T19:56:15.782 INFO:teuthology.orchestra.run.smithi155.stdout: "event": "initiated", 2023-08-01T19:56:15.783 INFO:teuthology.orchestra.run.smithi155.stdout: "time": "2023-08-01T19:55:05.150778+0000", 2023-08-01T19:56:15.783 INFO:teuthology.orchestra.run.smithi155.stdout: "duration": 0 2023-08-01T19:56:15.783 INFO:teuthology.orchestra.run.smithi155.stdout: }, 2023-08-01T19:56:15.783 INFO:teuthology.orchestra.run.smithi155.stdout: { 2023-08-01T19:56:15.783 INFO:teuthology.orchestra.run.smithi155.stdout: "event": "throttled", 2023-08-01T19:56:15.783 INFO:teuthology.orchestra.run.smithi155.stdout: "time": "2023-08-01T19:55:05.150778+0000", 2023-08-01T19:56:15.783 INFO:teuthology.orchestra.run.smithi155.stdout: "duration": 0 2023-08-01T19:56:15.784 INFO:teuthology.orchestra.run.smithi155.stdout: }, 2023-08-01T19:56:15.784 INFO:teuthology.orchestra.run.smithi155.stdout: { 2023-08-01T19:56:15.784 INFO:teuthology.orchestra.run.smithi155.stdout: "event": "header_read", 2023-08-01T19:56:15.784 INFO:teuthology.orchestra.run.smithi155.stdout: "time": "2023-08-01T19:55:05.150778+0000", 2023-08-01T19:56:15.784 INFO:teuthology.orchestra.run.smithi155.stdout: "duration": 4294967295.9999995 2023-08-01T19:56:15.784 INFO:teuthology.orchestra.run.smithi155.stdout: }, 2023-08-01T19:56:15.784 INFO:teuthology.orchestra.run.smithi155.stdout: { 2023-08-01T19:56:15.785 INFO:teuthology.orchestra.run.smithi155.stdout: "event": "all_read", 2023-08-01T19:56:15.785 INFO:teuthology.orchestra.run.smithi155.stdout: "time": "2023-08-01T19:55:05.150811+0000", 2023-08-01T19:56:15.785 INFO:teuthology.orchestra.run.smithi155.stdout: "duration": 3.3664000000000002e-05 2023-08-01T19:56:15.785 INFO:teuthology.orchestra.run.smithi155.stdout: }, 2023-08-01T19:56:15.785 INFO:teuthology.orchestra.run.smithi155.stdout: { 2023-08-01T19:56:15.785 INFO:teuthology.orchestra.run.smithi155.stdout: "event": "dispatched", 2023-08-01T19:56:15.785 INFO:teuthology.orchestra.run.smithi155.stdout: "time": "2023-08-01T19:55:05.150818+0000", 2023-08-01T19:56:15.786 INFO:teuthology.orchestra.run.smithi155.stdout: "duration": 6.5769999999999999e-06 2023-08-01T19:56:15.786 INFO:teuthology.orchestra.run.smithi155.stdout: }, 2023-08-01T19:56:15.786 INFO:teuthology.orchestra.run.smithi155.stdout: { 2023-08-01T19:56:15.786 INFO:teuthology.orchestra.run.smithi155.stdout: "event": "queued_for_pg", 2023-08-01T19:56:15.786 INFO:teuthology.orchestra.run.smithi155.stdout: "time": "2023-08-01T19:55:05.150822+0000", 2023-08-01T19:56:15.786 INFO:teuthology.orchestra.run.smithi155.stdout: "duration": 4.0060000000000003e-06 2023-08-01T19:56:15.786 INFO:teuthology.orchestra.run.smithi155.stdout: }, 2023-08-01T19:56:15.786 INFO:teuthology.orchestra.run.smithi155.stdout: { 2023-08-01T19:56:15.787 INFO:teuthology.orchestra.run.smithi155.stdout: "event": "reached_pg", 2023-08-01T19:56:15.787 INFO:teuthology.orchestra.run.smithi155.stdout: "time": "2023-08-01T19:55:05.150855+0000", 2023-08-01T19:56:15.787 INFO:teuthology.orchestra.run.smithi155.stdout: "duration": 3.3204999999999998e-05 2023-08-01T19:56:15.787 INFO:teuthology.orchestra.run.smithi155.stdout: }, 2023-08-01T19:56:15.787 INFO:teuthology.orchestra.run.smithi155.stdout: { 2023-08-01T19:56:15.787 INFO:teuthology.orchestra.run.smithi155.stdout: "event": "started", 2023-08-01T19:56:15.787 INFO:teuthology.orchestra.run.smithi155.stdout: "time": "2023-08-01T19:55:05.150873+0000", 2023-08-01T19:56:15.788 INFO:teuthology.orchestra.run.smithi155.stdout: "duration": 1.8139999999999999e-05 2023-08-01T19:56:15.788 INFO:teuthology.orchestra.run.smithi155.stdout: }, 2023-08-01T19:56:15.788 INFO:teuthology.orchestra.run.smithi155.stdout: { 2023-08-01T19:56:15.788 INFO:teuthology.orchestra.run.smithi155.stdout: "event": "commit_sent", 2023-08-01T19:56:15.788 INFO:teuthology.orchestra.run.smithi155.stdout: "time": "2023-08-01T19:55:05.224095+0000", 2023-08-01T19:56:15.788 INFO:teuthology.orchestra.run.smithi155.stdout: "duration": 0.073221895999999995 2023-08-01T19:56:15.788 INFO:teuthology.orchestra.run.smithi155.stdout: }, 2023-08-01T19:56:15.789 INFO:teuthology.orchestra.run.smithi155.stdout: { 2023-08-01T19:56:15.789 INFO:teuthology.orchestra.run.smithi155.stdout: "event": "done", 2023-08-01T19:56:15.789 INFO:teuthology.orchestra.run.smithi155.stdout: "time": "2023-08-01T19:55:05.224141+0000", 2023-08-01T19:56:15.789 INFO:teuthology.orchestra.run.smithi155.stdout: "duration": 4.5385e-05 2023-08-01T19:56:15.789 INFO:teuthology.orchestra.run.smithi155.stdout: } 2023-08-01T19:56:15.789 INFO:teuthology.orchestra.run.smithi155.stdout: ] 2023-08-01T19:56:15.789 INFO:teuthology.orchestra.run.smithi155.stdout: } 2023-08-01T19:56:15.790 INFO:teuthology.orchestra.run.smithi155.stdout: }, 2023-08-01T19:56:15.790 INFO:teuthology.orchestra.run.smithi155.stdout: { 2023-08-01T19:56:15.790 INFO:teuthology.orchestra.run.smithi155.stdout: "description": "osd_op(client.4668.0:100245 5.e 5:71869c66:::benchmark_data_smithi006_114134_object100244:head [set-alloc-hint object_size 65536 write_size 65536,write 0~65536] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e37)", 2023-08-01T19:56:15.790 INFO:teuthology.orchestra.run.smithi155.stdout: "initiated_at": "2023-08-01T19:55:05.150991+0000", 2023-08-01T19:56:15.790 INFO:teuthology.orchestra.run.smithi155.stdout: "age": 70.602574211999993, 2023-08-01T19:56:15.790 INFO:teuthology.orchestra.run.smithi155.stdout: "duration": 0.070734490999999997, 2023-08-01T19:56:15.790 INFO:teuthology.orchestra.run.smithi155.stdout: "type_data": { 2023-08-01T19:56:15.791 INFO:teuthology.orchestra.run.smithi155.stdout: "flag_point": "commit sent; apply or cleanup", 2023-08-01T19:56:15.791 INFO:teuthology.orchestra.run.smithi155.stdout: "client_info": { 2023-08-01T19:56:15.791 INFO:teuthology.orchestra.run.smithi155.stdout: "client": "client.4668", 2023-08-01T19:56:15.791 INFO:teuthology.orchestra.run.smithi155.stdout: "client_addr": "172.21.15.6:0/1709472247", 2023-08-01T19:56:15.791 INFO:teuthology.orchestra.run.smithi155.stdout: "tid": 100245 2023-08-01T19:56:15.791 INFO:teuthology.orchestra.run.smithi155.stdout: }, 2023-08-01T19:56:15.791 INFO:teuthology.orchestra.run.smithi155.stdout: "events": [ 2023-08-01T19:56:15.792 INFO:teuthology.orchestra.run.smithi155.stdout: { 2023-08-01T19:56:15.792 INFO:teuthology.orchestra.run.smithi155.stdout: "event": "initiated", 2023-08-01T19:56:15.792 INFO:teuthology.orchestra.run.smithi155.stdout: "time": "2023-08-01T19:55:05.150991+0000", 2023-08-01T19:56:15.792 INFO:teuthology.orchestra.run.smithi155.stdout: "duration": 0 2023-08-01T19:56:15.792 INFO:teuthology.orchestra.run.smithi155.stdout: }, 2023-08-01T19:56:15.792 INFO:teuthology.orchestra.run.smithi155.stdout: { 2023-08-01T19:56:15.792 INFO:teuthology.orchestra.run.smithi155.stdout: "event": "throttled", 2023-08-01T19:56:15.793 INFO:teuthology.orchestra.run.smithi155.stdout: "time": "2023-08-01T19:55:05.150991+0000", 2023-08-01T19:56:15.793 INFO:teuthology.orchestra.run.smithi155.stdout: "duration": 0 2023-08-01T19:56:15.793 INFO:teuthology.orchestra.run.smithi155.stdout: }, 2023-08-01T19:56:15.793 INFO:teuthology.orchestra.run.smithi155.stdout: { 2023-08-01T19:56:15.793 INFO:teuthology.orchestra.run.smithi155.stdout: "event": "header_read", 2023-08-01T19:56:15.793 INFO:teuthology.orchestra.run.smithi155.stdout: "time": "2023-08-01T19:55:05.150990+0000", 2023-08-01T19:56:15.793 INFO:teuthology.orchestra.run.smithi155.stdout: "duration": 4294967295.999999 2023-08-01T19:56:15.793 INFO:teuthology.orchestra.run.smithi155.stdout: }, 2023-08-01T19:56:15.794 INFO:teuthology.orchestra.run.smithi155.stdout: { 2023-08-01T19:56:15.794 INFO:teuthology.orchestra.run.smithi155.stdout: "event": "all_read", 2023-08-01T19:56:15.794 INFO:teuthology.orchestra.run.smithi155.stdout: "time": "2023-08-01T19:55:05.151108+0000", 2023-08-01T19:56:15.794 INFO:teuthology.orchestra.run.smithi155.stdout: "duration": 0.00011849300000000001 2023-08-01T19:56:15.794 INFO:teuthology.orchestra.run.smithi155.stdout: }, 2023-08-01T19:56:15.794 INFO:teuthology.orchestra.run.smithi155.stdout: { 2023-08-01T19:56:15.794 INFO:teuthology.orchestra.run.smithi155.stdout: "event": "dispatched", 2023-08-01T19:56:15.795 INFO:teuthology.orchestra.run.smithi155.stdout: "time": "2023-08-01T19:55:05.151117+0000", 2023-08-01T19:56:15.795 INFO:teuthology.orchestra.run.smithi155.stdout: "duration": 8.1040000000000007e-06 2023-08-01T19:56:15.795 INFO:teuthology.orchestra.run.smithi155.stdout: }, 2023-08-01T19:56:15.795 INFO:teuthology.orchestra.run.smithi155.stdout: { 2023-08-01T19:56:15.795 INFO:teuthology.orchestra.run.smithi155.stdout: "event": "queued_for_pg", 2023-08-01T19:56:15.795 INFO:teuthology.orchestra.run.smithi155.stdout: "time": "2023-08-01T19:55:05.151121+0000", 2023-08-01T19:56:15.795 INFO:teuthology.orchestra.run.smithi155.stdout: "duration": 4.2019999999999997e-06 2023-08-01T19:56:15.796 INFO:teuthology.orchestra.run.smithi155.stdout: }, 2023-08-01T19:56:15.796 INFO:teuthology.orchestra.run.smithi155.stdout: { 2023-08-01T19:56:15.796 INFO:teuthology.orchestra.run.smithi155.stdout: "event": "reached_pg", 2023-08-01T19:56:15.796 INFO:teuthology.orchestra.run.smithi155.stdout: "time": "2023-08-01T19:55:05.151162+0000", 2023-08-01T19:56:15.796 INFO:teuthology.orchestra.run.smithi155.stdout: "duration": 4.1448e-05 2023-08-01T19:56:15.796 INFO:teuthology.orchestra.run.smithi155.stdout: }, 2023-08-01T19:56:15.796 INFO:teuthology.orchestra.run.smithi155.stdout: { 2023-08-01T19:56:15.797 INFO:teuthology.orchestra.run.smithi155.stdout: "event": "started", 2023-08-01T19:56:15.797 INFO:teuthology.orchestra.run.smithi155.stdout: "time": "2023-08-01T19:55:05.151281+0000", 2023-08-01T19:56:15.797 INFO:teuthology.orchestra.run.smithi155.stdout: "duration": 0.000119141 2023-08-01T19:56:15.797 INFO:teuthology.orchestra.run.smithi155.stdout: }, 2023-08-01T19:56:15.797 INFO:teuthology.orchestra.run.smithi155.stdout: { 2023-08-01T19:56:15.797 INFO:teuthology.orchestra.run.smithi155.stdout: "event": "waiting for subops from 0", 2023-08-01T19:56:15.797 INFO:teuthology.orchestra.run.smithi155.stdout: "time": "2023-08-01T19:55:05.151443+0000", 2023-08-01T19:56:15.798 INFO:teuthology.orchestra.run.smithi155.stdout: "duration": 0.00016181600000000001 2023-08-01T19:56:15.798 INFO:teuthology.orchestra.run.smithi155.stdout: }, 2023-08-01T19:56:15.798 INFO:teuthology.orchestra.run.smithi155.stdout: { 2023-08-01T19:56:15.798 INFO:teuthology.orchestra.run.smithi155.stdout: "event": "sub_op_commit_rec", 2023-08-01T19:56:15.798 INFO:teuthology.orchestra.run.smithi155.stdout: "time": "2023-08-01T19:55:05.219101+0000", 2023-08-01T19:56:15.798 INFO:teuthology.orchestra.run.smithi155.stdout: "duration": 0.067658037000000004 2023-08-01T19:56:15.798 INFO:teuthology.orchestra.run.smithi155.stdout: }, 2023-08-01T19:56:15.799 INFO:teuthology.orchestra.run.smithi155.stdout: { 2023-08-01T19:56:15.799 INFO:teuthology.orchestra.run.smithi155.stdout: "event": "op_commit", 2023-08-01T19:56:15.799 INFO:teuthology.orchestra.run.smithi155.stdout: "time": "2023-08-01T19:55:05.221646+0000", 2023-08-01T19:56:15.799 INFO:teuthology.orchestra.run.smithi155.stdout: "duration": 0.0025450540000000002 2023-08-01T19:56:15.799 INFO:teuthology.orchestra.run.smithi155.stdout: }, 2023-08-01T19:56:15.799 INFO:teuthology.orchestra.run.smithi155.stdout: { 2023-08-01T19:56:15.799 INFO:teuthology.orchestra.run.smithi155.stdout: "event": "commit_sent", 2023-08-01T19:56:15.800 INFO:teuthology.orchestra.run.smithi155.stdout: "time": "2023-08-01T19:55:05.221689+0000", 2023-08-01T19:56:15.800 INFO:teuthology.orchestra.run.smithi155.stdout: "duration": 4.3078999999999999e-05 2023-08-01T19:56:15.800 INFO:teuthology.orchestra.run.smithi155.stdout: }, 2023-08-01T19:56:15.800 INFO:teuthology.orchestra.run.smithi155.stdout: { 2023-08-01T19:56:15.800 INFO:teuthology.orchestra.run.smithi155.stdout: "event": "done", 2023-08-01T19:56:15.800 INFO:teuthology.orchestra.run.smithi155.stdout: "time": "2023-08-01T19:55:05.221725+0000", 2023-08-01T19:56:15.800 INFO:teuthology.orchestra.run.smithi155.stdout: "duration": 3.6137999999999999e-05 2023-08-01T19:56:15.801 INFO:teuthology.orchestra.run.smithi155.stdout: } 2023-08-01T19:56:15.801 INFO:teuthology.orchestra.run.smithi155.stdout: ] 2023-08-01T19:56:15.801 INFO:teuthology.orchestra.run.smithi155.stdout: } 2023-08-01T19:56:15.801 INFO:teuthology.orchestra.run.smithi155.stdout: }, 2023-08-01T19:56:15.801 INFO:teuthology.orchestra.run.smithi155.stdout: { 2023-08-01T19:56:15.801 INFO:teuthology.orchestra.run.smithi155.stdout: "description": "osd_repop(client.4668.0:100243 5.a e37/19 5:5e8193b6:::benchmark_data_smithi006_114134_object100242:head v 37'6228, mlcod=37'6225)", 2023-08-01T19:56:15.801 INFO:teuthology.orchestra.run.smithi155.stdout: "initiated_at": "2023-08-01T19:55:05.151148+0000", 2023-08-01T19:56:15.801 INFO:teuthology.orchestra.run.smithi155.stdout: "age": 70.602417200999994, 2023-08-01T19:56:15.802 INFO:teuthology.orchestra.run.smithi155.stdout: "duration": 0.073020370000000001, 2023-08-01T19:56:15.802 INFO:teuthology.orchestra.run.smithi155.stdout: "type_data": { 2023-08-01T19:56:15.802 INFO:teuthology.orchestra.run.smithi155.stdout: "flag_point": "commit sent; apply or cleanup", 2023-08-01T19:56:15.802 INFO:teuthology.orchestra.run.smithi155.stdout: "events": [ 2023-08-01T19:56:15.802 INFO:teuthology.orchestra.run.smithi155.stdout: { 2023-08-01T19:56:15.802 INFO:teuthology.orchestra.run.smithi155.stdout: "event": "initiated", 2023-08-01T19:56:15.802 INFO:teuthology.orchestra.run.smithi155.stdout: "time": "2023-08-01T19:55:05.151148+0000", 2023-08-01T19:56:15.803 INFO:teuthology.orchestra.run.smithi155.stdout: "duration": 0 2023-08-01T19:56:15.803 INFO:teuthology.orchestra.run.smithi155.stdout: }, 2023-08-01T19:56:15.803 INFO:teuthology.orchestra.run.smithi155.stdout: { 2023-08-01T19:56:15.803 INFO:teuthology.orchestra.run.smithi155.stdout: "event": "throttled", 2023-08-01T19:56:15.803 INFO:teuthology.orchestra.run.smithi155.stdout: "time": "2023-08-01T19:55:05.151148+0000", 2023-08-01T19:56:15.803 INFO:teuthology.orchestra.run.smithi155.stdout: "duration": 0 2023-08-01T19:56:15.803 INFO:teuthology.orchestra.run.smithi155.stdout: }, 2023-08-01T19:56:15.804 INFO:teuthology.orchestra.run.smithi155.stdout: { 2023-08-01T19:56:15.804 INFO:teuthology.orchestra.run.smithi155.stdout: "event": "header_read", 2023-08-01T19:56:15.804 INFO:teuthology.orchestra.run.smithi155.stdout: "time": "2023-08-01T19:55:05.151147+0000", 2023-08-01T19:56:15.804 INFO:teuthology.orchestra.run.smithi155.stdout: "duration": 4294967295.9999995 2023-08-01T19:56:15.804 INFO:teuthology.orchestra.run.smithi155.stdout: }, 2023-08-01T19:56:15.804 INFO:teuthology.orchestra.run.smithi155.stdout: { 2023-08-01T19:56:15.804 INFO:teuthology.orchestra.run.smithi155.stdout: "event": "all_read", 2023-08-01T19:56:15.805 INFO:teuthology.orchestra.run.smithi155.stdout: "time": "2023-08-01T19:55:05.151231+0000", 2023-08-01T19:56:15.805 INFO:teuthology.orchestra.run.smithi155.stdout: "duration": 8.3135999999999998e-05 2023-08-01T19:56:15.805 INFO:teuthology.orchestra.run.smithi155.stdout: }, 2023-08-01T19:56:15.805 INFO:teuthology.orchestra.run.smithi155.stdout: { 2023-08-01T19:56:15.805 INFO:teuthology.orchestra.run.smithi155.stdout: "event": "dispatched", 2023-08-01T19:56:15.805 INFO:teuthology.orchestra.run.smithi155.stdout: "time": "2023-08-01T19:55:05.151239+0000", 2023-08-01T19:56:15.805 INFO:teuthology.orchestra.run.smithi155.stdout: "duration": 8.7469999999999994e-06 2023-08-01T19:56:15.805 INFO:teuthology.orchestra.run.smithi155.stdout: }, 2023-08-01T19:56:15.806 INFO:teuthology.orchestra.run.smithi155.stdout: { 2023-08-01T19:56:15.806 INFO:teuthology.orchestra.run.smithi155.stdout: "event": "queued_for_pg", 2023-08-01T19:56:15.806 INFO:teuthology.orchestra.run.smithi155.stdout: "time": "2023-08-01T19:55:05.151244+0000", 2023-08-01T19:56:15.806 INFO:teuthology.orchestra.run.smithi155.stdout: "duration": 4.4800000000000003e-06 2023-08-01T19:56:15.806 INFO:teuthology.orchestra.run.smithi155.stdout: }, 2023-08-01T19:56:15.806 INFO:teuthology.orchestra.run.smithi155.stdout: { 2023-08-01T19:56:15.806 INFO:teuthology.orchestra.run.smithi155.stdout: "event": "reached_pg", 2023-08-01T19:56:15.807 INFO:teuthology.orchestra.run.smithi155.stdout: "time": "2023-08-01T19:55:05.152938+0000", 2023-08-01T19:56:15.807 INFO:teuthology.orchestra.run.smithi155.stdout: "duration": 0.001693824 2023-08-01T19:56:15.807 INFO:teuthology.orchestra.run.smithi155.stdout: }, 2023-08-01T19:56:15.807 INFO:teuthology.orchestra.run.smithi155.stdout: { 2023-08-01T19:56:15.807 INFO:teuthology.orchestra.run.smithi155.stdout: "event": "started", 2023-08-01T19:56:15.807 INFO:teuthology.orchestra.run.smithi155.stdout: "time": "2023-08-01T19:55:05.152956+0000", 2023-08-01T19:56:15.807 INFO:teuthology.orchestra.run.smithi155.stdout: "duration": 1.8287e-05 2023-08-01T19:56:15.808 INFO:teuthology.orchestra.run.smithi155.stdout: }, 2023-08-01T19:56:15.808 INFO:teuthology.orchestra.run.smithi155.stdout: { 2023-08-01T19:56:15.808 INFO:teuthology.orchestra.run.smithi155.stdout: "event": "commit_sent", 2023-08-01T19:56:15.808 INFO:teuthology.orchestra.run.smithi155.stdout: "time": "2023-08-01T19:55:05.224145+0000", 2023-08-01T19:56:15.808 INFO:teuthology.orchestra.run.smithi155.stdout: "duration": 0.071189447000000003 2023-08-01T19:56:15.808 INFO:teuthology.orchestra.run.smithi155.stdout: }, 2023-08-01T19:56:15.808 INFO:teuthology.orchestra.run.smithi155.stdout: { 2023-08-01T19:56:15.809 INFO:teuthology.orchestra.run.smithi155.stdout: "event": "done", 2023-08-01T19:56:15.809 INFO:teuthology.orchestra.run.smithi155.stdout: "time": "2023-08-01T19:55:05.224168+0000", 2023-08-01T19:56:15.809 INFO:teuthology.orchestra.run.smithi155.stdout: "duration": 2.3008999999999999e-05 2023-08-01T19:56:15.809 INFO:teuthology.orchestra.run.smithi155.stdout: } 2023-08-01T19:56:15.809 INFO:teuthology.orchestra.run.smithi155.stdout: ] 2023-08-01T19:56:15.809 INFO:teuthology.orchestra.run.smithi155.stdout: } 2023-08-01T19:56:15.809 INFO:teuthology.orchestra.run.smithi155.stdout: }, 2023-08-01T19:56:15.809 INFO:teuthology.orchestra.run.smithi155.stdout: { 2023-08-01T19:56:15.810 INFO:teuthology.orchestra.run.smithi155.stdout: "description": "osd_repop(client.4668.0:100244 5.9 e37/19 5:92f56a12:::benchmark_data_smithi006_114134_object100243:head v 37'6294, mlcod=37'6292)", 2023-08-01T19:56:15.810 INFO:teuthology.orchestra.run.smithi155.stdout: "initiated_at": "2023-08-01T19:55:05.151325+0000", 2023-08-01T19:56:15.810 INFO:teuthology.orchestra.run.smithi155.stdout: "age": 70.602239855999997, 2023-08-01T19:56:15.810 INFO:teuthology.orchestra.run.smithi155.stdout: "duration": 0.071883673999999995, 2023-08-01T19:56:15.810 INFO:teuthology.orchestra.run.smithi155.stdout: "type_data": { 2023-08-01T19:56:15.810 INFO:teuthology.orchestra.run.smithi155.stdout: "flag_point": "commit sent; apply or cleanup", 2023-08-01T19:56:15.810 INFO:teuthology.orchestra.run.smithi155.stdout: "events": [ 2023-08-01T19:56:15.811 INFO:teuthology.orchestra.run.smithi155.stdout: { 2023-08-01T19:56:15.811 INFO:teuthology.orchestra.run.smithi155.stdout: "event": "initiated", 2023-08-01T19:56:15.811 INFO:teuthology.orchestra.run.smithi155.stdout: "time": "2023-08-01T19:55:05.151325+0000", 2023-08-01T19:56:15.811 INFO:teuthology.orchestra.run.smithi155.stdout: "duration": 0 2023-08-01T19:56:15.811 INFO:teuthology.orchestra.run.smithi155.stdout: }, 2023-08-01T19:56:15.811 INFO:teuthology.orchestra.run.smithi155.stdout: { 2023-08-01T19:56:15.811 INFO:teuthology.orchestra.run.smithi155.stdout: "event": "throttled", 2023-08-01T19:56:15.812 INFO:teuthology.orchestra.run.smithi155.stdout: "time": "2023-08-01T19:55:05.151325+0000", 2023-08-01T19:56:15.812 INFO:teuthology.orchestra.run.smithi155.stdout: "duration": 0 2023-08-01T19:56:15.812 INFO:teuthology.orchestra.run.smithi155.stdout: }, 2023-08-01T19:56:15.812 INFO:teuthology.orchestra.run.smithi155.stdout: { 2023-08-01T19:56:15.812 INFO:teuthology.orchestra.run.smithi155.stdout: "event": "header_read", 2023-08-01T19:56:15.812 INFO:teuthology.orchestra.run.smithi155.stdout: "time": "2023-08-01T19:55:05.151325+0000", 2023-08-01T19:56:15.812 INFO:teuthology.orchestra.run.smithi155.stdout: "duration": 4294967295.9999995 2023-08-01T19:56:15.813 INFO:teuthology.orchestra.run.smithi155.stdout: }, 2023-08-01T19:56:15.813 INFO:teuthology.orchestra.run.smithi155.stdout: { 2023-08-01T19:56:15.813 INFO:teuthology.orchestra.run.smithi155.stdout: "event": "all_read", 2023-08-01T19:56:15.813 INFO:teuthology.orchestra.run.smithi155.stdout: "time": "2023-08-01T19:55:05.151390+0000", 2023-08-01T19:56:15.813 INFO:teuthology.orchestra.run.smithi155.stdout: "duration": 6.5456999999999993e-05 2023-08-01T19:56:15.813 INFO:teuthology.orchestra.run.smithi155.stdout: }, 2023-08-01T19:56:15.814 INFO:teuthology.orchestra.run.smithi155.stdout: { 2023-08-01T19:56:15.814 INFO:teuthology.orchestra.run.smithi155.stdout: "event": "dispatched", 2023-08-01T19:56:15.814 INFO:teuthology.orchestra.run.smithi155.stdout: "time": "2023-08-01T19:55:05.151396+0000", 2023-08-01T19:56:15.814 INFO:teuthology.orchestra.run.smithi155.stdout: "duration": 5.9190000000000004e-06 2023-08-01T19:56:15.814 INFO:teuthology.orchestra.run.smithi155.stdout: }, 2023-08-01T19:56:15.814 INFO:teuthology.orchestra.run.smithi155.stdout: { 2023-08-01T19:56:15.814 INFO:teuthology.orchestra.run.smithi155.stdout: "event": "queued_for_pg", 2023-08-01T19:56:15.814 INFO:teuthology.orchestra.run.smithi155.stdout: "time": "2023-08-01T19:55:05.151400+0000", 2023-08-01T19:56:15.815 INFO:teuthology.orchestra.run.smithi155.stdout: "duration": 4.1030000000000004e-06 2023-08-01T19:56:15.815 INFO:teuthology.orchestra.run.smithi155.stdout: }, 2023-08-01T19:56:15.815 INFO:teuthology.orchestra.run.smithi155.stdout: { 2023-08-01T19:56:15.815 INFO:teuthology.orchestra.run.smithi155.stdout: "event": "reached_pg", 2023-08-01T19:56:15.815 INFO:teuthology.orchestra.run.smithi155.stdout: "time": "2023-08-01T19:55:05.151452+0000", 2023-08-01T19:56:15.815 INFO:teuthology.orchestra.run.smithi155.stdout: "duration": 5.2136999999999999e-05 2023-08-01T19:56:15.815 INFO:teuthology.orchestra.run.smithi155.stdout: }, 2023-08-01T19:56:15.816 INFO:teuthology.orchestra.run.smithi155.stdout: { 2023-08-01T19:56:15.816 INFO:teuthology.orchestra.run.smithi155.stdout: "event": "started", 2023-08-01T19:56:15.816 INFO:teuthology.orchestra.run.smithi155.stdout: "time": "2023-08-01T19:55:05.151470+0000", 2023-08-01T19:56:15.816 INFO:teuthology.orchestra.run.smithi155.stdout: "duration": 1.8e-05 2023-08-01T19:56:15.816 INFO:teuthology.orchestra.run.smithi155.stdout: }, 2023-08-01T19:56:15.816 INFO:teuthology.orchestra.run.smithi155.stdout: { 2023-08-01T19:56:15.816 INFO:teuthology.orchestra.run.smithi155.stdout: "event": "commit_sent", 2023-08-01T19:56:15.817 INFO:teuthology.orchestra.run.smithi155.stdout: "time": "2023-08-01T19:55:05.223183+0000", 2023-08-01T19:56:15.817 INFO:teuthology.orchestra.run.smithi155.stdout: "duration": 0.071712622000000004 2023-08-01T19:56:15.817 INFO:teuthology.orchestra.run.smithi155.stdout: }, 2023-08-01T19:56:15.817 INFO:teuthology.orchestra.run.smithi155.stdout: { 2023-08-01T19:56:15.817 INFO:teuthology.orchestra.run.smithi155.stdout: "event": "done", 2023-08-01T19:56:15.817 INFO:teuthology.orchestra.run.smithi155.stdout: "time": "2023-08-01T19:55:05.223209+0000", 2023-08-01T19:56:15.817 INFO:teuthology.orchestra.run.smithi155.stdout: "duration": 2.5956e-05 2023-08-01T19:56:15.818 INFO:teuthology.orchestra.run.smithi155.stdout: } 2023-08-01T19:56:15.818 INFO:teuthology.orchestra.run.smithi155.stdout: ] 2023-08-01T19:56:15.818 INFO:teuthology.orchestra.run.smithi155.stdout: } 2023-08-01T19:56:15.818 INFO:teuthology.orchestra.run.smithi155.stdout: }, 2023-08-01T19:56:15.818 INFO:teuthology.orchestra.run.smithi155.stdout: { 2023-08-01T19:56:15.818 INFO:teuthology.orchestra.run.smithi155.stdout: "description": "osd_op(client.4668.0:100249 5.b 5:d0666827:::benchmark_data_smithi006_114134_object100248:head [set-alloc-hint object_size 65536 write_size 65536,write 0~65536] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e37)", 2023-08-01T19:56:15.818 INFO:teuthology.orchestra.run.smithi155.stdout: "initiated_at": "2023-08-01T19:55:05.153614+0000", 2023-08-01T19:56:15.819 INFO:teuthology.orchestra.run.smithi155.stdout: "age": 70.599951430999994, 2023-08-01T19:56:15.819 INFO:teuthology.orchestra.run.smithi155.stdout: "duration": 0.069286118999999993, 2023-08-01T19:56:15.819 INFO:teuthology.orchestra.run.smithi155.stdout: "type_data": { 2023-08-01T19:56:15.819 INFO:teuthology.orchestra.run.smithi155.stdout: "flag_point": "commit sent; apply or cleanup", 2023-08-01T19:56:15.819 INFO:teuthology.orchestra.run.smithi155.stdout: "client_info": { 2023-08-01T19:56:15.819 INFO:teuthology.orchestra.run.smithi155.stdout: "client": "client.4668", 2023-08-01T19:56:15.819 INFO:teuthology.orchestra.run.smithi155.stdout: "client_addr": "172.21.15.6:0/1709472247", 2023-08-01T19:56:15.819 INFO:teuthology.orchestra.run.smithi155.stdout: "tid": 100249 2023-08-01T19:56:15.820 INFO:teuthology.orchestra.run.smithi155.stdout: }, 2023-08-01T19:56:15.820 INFO:teuthology.orchestra.run.smithi155.stdout: "events": [ 2023-08-01T19:56:15.820 INFO:teuthology.orchestra.run.smithi155.stdout: { 2023-08-01T19:56:15.820 INFO:teuthology.orchestra.run.smithi155.stdout: "event": "initiated", 2023-08-01T19:56:15.820 INFO:teuthology.orchestra.run.smithi155.stdout: "time": "2023-08-01T19:55:05.153614+0000", 2023-08-01T19:56:15.820 INFO:teuthology.orchestra.run.smithi155.stdout: "duration": 0 2023-08-01T19:56:15.820 INFO:teuthology.orchestra.run.smithi155.stdout: }, 2023-08-01T19:56:15.821 INFO:teuthology.orchestra.run.smithi155.stdout: { 2023-08-01T19:56:15.821 INFO:teuthology.orchestra.run.smithi155.stdout: "event": "throttled", 2023-08-01T19:56:15.821 INFO:teuthology.orchestra.run.smithi155.stdout: "time": "2023-08-01T19:55:05.153614+0000", 2023-08-01T19:56:15.821 INFO:teuthology.orchestra.run.smithi155.stdout: "duration": 0 2023-08-01T19:56:15.821 INFO:teuthology.orchestra.run.smithi155.stdout: }, 2023-08-01T19:56:15.821 INFO:teuthology.orchestra.run.smithi155.stdout: { 2023-08-01T19:56:15.821 INFO:teuthology.orchestra.run.smithi155.stdout: "event": "header_read", 2023-08-01T19:56:15.822 INFO:teuthology.orchestra.run.smithi155.stdout: "time": "2023-08-01T19:55:05.153612+0000", 2023-08-01T19:56:15.822 INFO:teuthology.orchestra.run.smithi155.stdout: "duration": 4294967295.9999986 2023-08-01T19:56:15.822 INFO:teuthology.orchestra.run.smithi155.stdout: }, 2023-08-01T19:56:15.822 INFO:teuthology.orchestra.run.smithi155.stdout: { 2023-08-01T19:56:15.822 INFO:teuthology.orchestra.run.smithi155.stdout: "event": "all_read", 2023-08-01T19:56:15.822 INFO:teuthology.orchestra.run.smithi155.stdout: "time": "2023-08-01T19:55:05.153694+0000", 2023-08-01T19:56:15.822 INFO:teuthology.orchestra.run.smithi155.stdout: "duration": 8.1618000000000004e-05 2023-08-01T19:56:15.823 INFO:teuthology.orchestra.run.smithi155.stdout: }, 2023-08-01T19:56:15.823 INFO:teuthology.orchestra.run.smithi155.stdout: { 2023-08-01T19:56:15.823 INFO:teuthology.orchestra.run.smithi155.stdout: "event": "dispatched", 2023-08-01T19:56:15.823 INFO:teuthology.orchestra.run.smithi155.stdout: "time": "2023-08-01T19:55:05.153713+0000", 2023-08-01T19:56:15.823 INFO:teuthology.orchestra.run.smithi155.stdout: "duration": 1.9069999999999999e-05 2023-08-01T19:56:15.823 INFO:teuthology.orchestra.run.smithi155.stdout: }, 2023-08-01T19:56:15.823 INFO:teuthology.orchestra.run.smithi155.stdout: { 2023-08-01T19:56:15.823 INFO:teuthology.orchestra.run.smithi155.stdout: "event": "queued_for_pg", 2023-08-01T19:56:15.824 INFO:teuthology.orchestra.run.smithi155.stdout: "time": "2023-08-01T19:55:05.153726+0000", 2023-08-01T19:56:15.824 INFO:teuthology.orchestra.run.smithi155.stdout: "duration": 1.238e-05 2023-08-01T19:56:15.824 INFO:teuthology.orchestra.run.smithi155.stdout: }, 2023-08-01T19:56:15.824 INFO:teuthology.orchestra.run.smithi155.stdout: { 2023-08-01T19:56:15.824 INFO:teuthology.orchestra.run.smithi155.stdout: "event": "reached_pg", 2023-08-01T19:56:15.824 INFO:teuthology.orchestra.run.smithi155.stdout: "time": "2023-08-01T19:55:05.153761+0000", 2023-08-01T19:56:15.824 INFO:teuthology.orchestra.run.smithi155.stdout: "duration": 3.5046999999999998e-05 2023-08-01T19:56:15.825 INFO:teuthology.orchestra.run.smithi155.stdout: }, 2023-08-01T19:56:15.825 INFO:teuthology.orchestra.run.smithi155.stdout: { 2023-08-01T19:56:15.825 INFO:teuthology.orchestra.run.smithi155.stdout: "event": "started", 2023-08-01T19:56:15.825 INFO:teuthology.orchestra.run.smithi155.stdout: "time": "2023-08-01T19:55:05.153896+0000", 2023-08-01T19:56:15.825 INFO:teuthology.orchestra.run.smithi155.stdout: "duration": 0.00013575800000000001 2023-08-01T19:56:15.825 INFO:teuthology.orchestra.run.smithi155.stdout: }, 2023-08-01T19:56:15.825 INFO:teuthology.orchestra.run.smithi155.stdout: { 2023-08-01T19:56:15.826 INFO:teuthology.orchestra.run.smithi155.stdout: "event": "waiting for subops from 0", 2023-08-01T19:56:15.826 INFO:teuthology.orchestra.run.smithi155.stdout: "time": "2023-08-01T19:55:05.154043+0000", 2023-08-01T19:56:15.826 INFO:teuthology.orchestra.run.smithi155.stdout: "duration": 0.00014650700000000001 2023-08-01T19:56:15.826 INFO:teuthology.orchestra.run.smithi155.stdout: }, 2023-08-01T19:56:15.826 INFO:teuthology.orchestra.run.smithi155.stdout: { 2023-08-01T19:56:15.826 INFO:teuthology.orchestra.run.smithi155.stdout: "event": "sub_op_commit_rec", 2023-08-01T19:56:15.826 INFO:teuthology.orchestra.run.smithi155.stdout: "time": "2023-08-01T19:55:05.221876+0000", 2023-08-01T19:56:15.827 INFO:teuthology.orchestra.run.smithi155.stdout: "duration": 0.067832796000000001 2023-08-01T19:56:15.827 INFO:teuthology.orchestra.run.smithi155.stdout: }, 2023-08-01T19:56:15.827 INFO:teuthology.orchestra.run.smithi155.stdout: { 2023-08-01T19:56:15.827 INFO:teuthology.orchestra.run.smithi155.stdout: "event": "op_commit", 2023-08-01T19:56:15.827 INFO:teuthology.orchestra.run.smithi155.stdout: "time": "2023-08-01T19:55:05.222813+0000", 2023-08-01T19:56:15.827 INFO:teuthology.orchestra.run.smithi155.stdout: "duration": 0.00093755300000000004 2023-08-01T19:56:15.827 INFO:teuthology.orchestra.run.smithi155.stdout: }, 2023-08-01T19:56:15.827 INFO:teuthology.orchestra.run.smithi155.stdout: { 2023-08-01T19:56:15.828 INFO:teuthology.orchestra.run.smithi155.stdout: "event": "commit_sent", 2023-08-01T19:56:15.828 INFO:teuthology.orchestra.run.smithi155.stdout: "time": "2023-08-01T19:55:05.222861+0000", 2023-08-01T19:56:15.828 INFO:teuthology.orchestra.run.smithi155.stdout: "duration": 4.8013999999999998e-05 2023-08-01T19:56:15.828 INFO:teuthology.orchestra.run.smithi155.stdout: }, 2023-08-01T19:56:15.828 INFO:teuthology.orchestra.run.smithi155.stdout: { 2023-08-01T19:56:15.828 INFO:teuthology.orchestra.run.smithi155.stdout: "event": "done", 2023-08-01T19:56:15.828 INFO:teuthology.orchestra.run.smithi155.stdout: "time": "2023-08-01T19:55:05.222900+0000", 2023-08-01T19:56:15.829 INFO:teuthology.orchestra.run.smithi155.stdout: "duration": 3.8634999999999999e-05 2023-08-01T19:56:15.829 INFO:teuthology.orchestra.run.smithi155.stdout: } 2023-08-01T19:56:15.829 INFO:teuthology.orchestra.run.smithi155.stdout: ] 2023-08-01T19:56:15.829 INFO:teuthology.orchestra.run.smithi155.stdout: } 2023-08-01T19:56:15.829 INFO:teuthology.orchestra.run.smithi155.stdout: }, 2023-08-01T19:56:15.829 INFO:teuthology.orchestra.run.smithi155.stdout: { 2023-08-01T19:56:15.829 INFO:teuthology.orchestra.run.smithi155.stdout: "description": "osd_op(client.4668.0:100251 5.b 5:d853df24:::benchmark_data_smithi006_114134_object100250:head [set-alloc-hint object_size 65536 write_size 65536,write 0~65536] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e37)", 2023-08-01T19:56:15.830 INFO:teuthology.orchestra.run.smithi155.stdout: "initiated_at": "2023-08-01T19:55:05.153737+0000", 2023-08-01T19:56:15.830 INFO:teuthology.orchestra.run.smithi155.stdout: "age": 70.599828416999998, 2023-08-01T19:56:15.830 INFO:teuthology.orchestra.run.smithi155.stdout: "duration": 0.071366545000000003, 2023-08-01T19:56:15.830 INFO:teuthology.orchestra.run.smithi155.stdout: "type_data": { 2023-08-01T19:56:15.830 INFO:teuthology.orchestra.run.smithi155.stdout: "flag_point": "commit sent; apply or cleanup", 2023-08-01T19:56:15.830 INFO:teuthology.orchestra.run.smithi155.stdout: "client_info": { 2023-08-01T19:56:15.830 INFO:teuthology.orchestra.run.smithi155.stdout: "client": "client.4668", 2023-08-01T19:56:15.831 INFO:teuthology.orchestra.run.smithi155.stdout: "client_addr": "172.21.15.6:0/1709472247", 2023-08-01T19:56:15.831 INFO:teuthology.orchestra.run.smithi155.stdout: "tid": 100251 2023-08-01T19:56:15.831 INFO:teuthology.orchestra.run.smithi155.stdout: }, 2023-08-01T19:56:15.831 INFO:teuthology.orchestra.run.smithi155.stdout: "events": [ 2023-08-01T19:56:15.831 INFO:teuthology.orchestra.run.smithi155.stdout: { 2023-08-01T19:56:15.831 INFO:teuthology.orchestra.run.smithi155.stdout: "event": "initiated", 2023-08-01T19:56:15.831 INFO:teuthology.orchestra.run.smithi155.stdout: "time": "2023-08-01T19:55:05.153737+0000", 2023-08-01T19:56:15.832 INFO:teuthology.orchestra.run.smithi155.stdout: "duration": 0 2023-08-01T19:56:15.832 INFO:teuthology.orchestra.run.smithi155.stdout: }, 2023-08-01T19:56:15.832 INFO:teuthology.orchestra.run.smithi155.stdout: { 2023-08-01T19:56:15.832 INFO:teuthology.orchestra.run.smithi155.stdout: "event": "throttled", 2023-08-01T19:56:15.832 INFO:teuthology.orchestra.run.smithi155.stdout: "time": "2023-08-01T19:55:05.153737+0000", 2023-08-01T19:56:15.832 INFO:teuthology.orchestra.run.smithi155.stdout: "duration": 0 2023-08-01T19:56:15.832 INFO:teuthology.orchestra.run.smithi155.stdout: }, 2023-08-01T19:56:15.833 INFO:teuthology.orchestra.run.smithi155.stdout: { 2023-08-01T19:56:15.833 INFO:teuthology.orchestra.run.smithi155.stdout: "event": "header_read", 2023-08-01T19:56:15.833 INFO:teuthology.orchestra.run.smithi155.stdout: "time": "2023-08-01T19:55:05.153736+0000", 2023-08-01T19:56:15.833 INFO:teuthology.orchestra.run.smithi155.stdout: "duration": 4294967295.9999995 2023-08-01T19:56:15.833 INFO:teuthology.orchestra.run.smithi155.stdout: }, 2023-08-01T19:56:15.833 INFO:teuthology.orchestra.run.smithi155.stdout: { 2023-08-01T19:56:15.833 INFO:teuthology.orchestra.run.smithi155.stdout: "event": "all_read", 2023-08-01T19:56:15.834 INFO:teuthology.orchestra.run.smithi155.stdout: "time": "2023-08-01T19:55:05.153784+0000", 2023-08-01T19:56:15.834 INFO:teuthology.orchestra.run.smithi155.stdout: "duration": 4.7660000000000001e-05 2023-08-01T19:56:15.834 INFO:teuthology.orchestra.run.smithi155.stdout: }, 2023-08-01T19:56:15.834 INFO:teuthology.orchestra.run.smithi155.stdout: { 2023-08-01T19:56:15.834 INFO:teuthology.orchestra.run.smithi155.stdout: "event": "dispatched", 2023-08-01T19:56:15.834 INFO:teuthology.orchestra.run.smithi155.stdout: "time": "2023-08-01T19:55:05.153793+0000", 2023-08-01T19:56:15.834 INFO:teuthology.orchestra.run.smithi155.stdout: "duration": 8.7150000000000004e-06 2023-08-01T19:56:15.835 INFO:teuthology.orchestra.run.smithi155.stdout: }, 2023-08-01T19:56:15.835 INFO:teuthology.orchestra.run.smithi155.stdout: { 2023-08-01T19:56:15.835 INFO:teuthology.orchestra.run.smithi155.stdout: "event": "queued_for_pg", 2023-08-01T19:56:15.835 INFO:teuthology.orchestra.run.smithi155.stdout: "time": "2023-08-01T19:55:05.153800+0000", 2023-08-01T19:56:15.835 INFO:teuthology.orchestra.run.smithi155.stdout: "duration": 7.2459999999999997e-06 2023-08-01T19:56:15.835 INFO:teuthology.orchestra.run.smithi155.stdout: }, 2023-08-01T19:56:15.835 INFO:teuthology.orchestra.run.smithi155.stdout: { 2023-08-01T19:56:15.836 INFO:teuthology.orchestra.run.smithi155.stdout: "event": "reached_pg", 2023-08-01T19:56:15.836 INFO:teuthology.orchestra.run.smithi155.stdout: "time": "2023-08-01T19:55:05.156241+0000", 2023-08-01T19:56:15.836 INFO:teuthology.orchestra.run.smithi155.stdout: "duration": 0.0024415359999999998 2023-08-01T19:56:15.836 INFO:teuthology.orchestra.run.smithi155.stdout: }, 2023-08-01T19:56:15.836 INFO:teuthology.orchestra.run.smithi155.stdout: { 2023-08-01T19:56:15.836 INFO:teuthology.orchestra.run.smithi155.stdout: "event": "started", 2023-08-01T19:56:15.836 INFO:teuthology.orchestra.run.smithi155.stdout: "time": "2023-08-01T19:55:05.219045+0000", 2023-08-01T19:56:15.837 INFO:teuthology.orchestra.run.smithi155.stdout: "duration": 0.062803855000000006 2023-08-01T19:56:15.837 INFO:teuthology.orchestra.run.smithi155.stdout: }, 2023-08-01T19:56:15.837 INFO:teuthology.orchestra.run.smithi155.stdout: { 2023-08-01T19:56:15.837 INFO:teuthology.orchestra.run.smithi155.stdout: "event": "waiting for subops from 0", 2023-08-01T19:56:15.837 INFO:teuthology.orchestra.run.smithi155.stdout: "time": "2023-08-01T19:55:05.219238+0000", 2023-08-01T19:56:15.837 INFO:teuthology.orchestra.run.smithi155.stdout: "duration": 0.00019241500000000001 2023-08-01T19:56:15.837 INFO:teuthology.orchestra.run.smithi155.stdout: }, 2023-08-01T19:56:15.838 INFO:teuthology.orchestra.run.smithi155.stdout: { 2023-08-01T19:56:15.838 INFO:teuthology.orchestra.run.smithi155.stdout: "event": "sub_op_commit_rec", 2023-08-01T19:56:15.838 INFO:teuthology.orchestra.run.smithi155.stdout: "time": "2023-08-01T19:55:05.223300+0000", 2023-08-01T19:56:15.838 INFO:teuthology.orchestra.run.smithi155.stdout: "duration": 0.0040626509999999996 2023-08-01T19:56:15.838 INFO:teuthology.orchestra.run.smithi155.stdout: }, 2023-08-01T19:56:15.838 INFO:teuthology.orchestra.run.smithi155.stdout: { 2023-08-01T19:56:15.838 INFO:teuthology.orchestra.run.smithi155.stdout: "event": "op_commit", 2023-08-01T19:56:15.839 INFO:teuthology.orchestra.run.smithi155.stdout: "time": "2023-08-01T19:55:05.225020+0000", 2023-08-01T19:56:15.839 INFO:teuthology.orchestra.run.smithi155.stdout: "duration": 0.0017201 2023-08-01T19:56:15.839 INFO:teuthology.orchestra.run.smithi155.stdout: }, 2023-08-01T19:56:15.839 INFO:teuthology.orchestra.run.smithi155.stdout: { 2023-08-01T19:56:15.839 INFO:teuthology.orchestra.run.smithi155.stdout: "event": "commit_sent", 2023-08-01T19:56:15.839 INFO:teuthology.orchestra.run.smithi155.stdout: "time": "2023-08-01T19:55:05.225066+0000", 2023-08-01T19:56:15.839 INFO:teuthology.orchestra.run.smithi155.stdout: "duration": 4.6143000000000002e-05 2023-08-01T19:56:15.840 INFO:teuthology.orchestra.run.smithi155.stdout: }, 2023-08-01T19:56:15.840 INFO:teuthology.orchestra.run.smithi155.stdout: { 2023-08-01T19:56:15.840 INFO:teuthology.orchestra.run.smithi155.stdout: "event": "done", 2023-08-01T19:56:15.840 INFO:teuthology.orchestra.run.smithi155.stdout: "time": "2023-08-01T19:55:05.225103+0000", 2023-08-01T19:56:15.840 INFO:teuthology.orchestra.run.smithi155.stdout: "duration": 3.6789999999999998e-05 2023-08-01T19:56:15.840 INFO:teuthology.orchestra.run.smithi155.stdout: } 2023-08-01T19:56:15.840 INFO:teuthology.orchestra.run.smithi155.stdout: ] 2023-08-01T19:56:15.841 INFO:teuthology.orchestra.run.smithi155.stdout: } 2023-08-01T19:56:15.841 INFO:teuthology.orchestra.run.smithi155.stdout: }, 2023-08-01T19:56:15.841 INFO:teuthology.orchestra.run.smithi155.stdout: { 2023-08-01T19:56:15.841 INFO:teuthology.orchestra.run.smithi155.stdout: "description": "osd_op(client.4668.0:100252 5.0 5:01f90c3c:::benchmark_data_smithi006_114134_object100251:head [set-alloc-hint object_size 65536 write_size 65536,write 0~65536] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e37)", 2023-08-01T19:56:15.841 INFO:teuthology.orchestra.run.smithi155.stdout: "initiated_at": "2023-08-01T19:55:05.154048+0000", 2023-08-01T19:56:15.841 INFO:teuthology.orchestra.run.smithi155.stdout: "age": 70.599517169999999, 2023-08-01T19:56:15.841 INFO:teuthology.orchestra.run.smithi155.stdout: "duration": 0.070156683999999997, 2023-08-01T19:56:15.842 INFO:teuthology.orchestra.run.smithi155.stdout: "type_data": { 2023-08-01T19:56:15.842 INFO:teuthology.orchestra.run.smithi155.stdout: "flag_point": "commit sent; apply or cleanup", 2023-08-01T19:56:15.842 INFO:teuthology.orchestra.run.smithi155.stdout: "client_info": { 2023-08-01T19:56:15.842 INFO:teuthology.orchestra.run.smithi155.stdout: "client": "client.4668", 2023-08-01T19:56:15.842 INFO:teuthology.orchestra.run.smithi155.stdout: "client_addr": "172.21.15.6:0/1709472247", 2023-08-01T19:56:15.842 INFO:teuthology.orchestra.run.smithi155.stdout: "tid": 100252 2023-08-01T19:56:15.842 INFO:teuthology.orchestra.run.smithi155.stdout: }, 2023-08-01T19:56:15.843 INFO:teuthology.orchestra.run.smithi155.stdout: "events": [ 2023-08-01T19:56:15.843 INFO:teuthology.orchestra.run.smithi155.stdout: { 2023-08-01T19:56:15.843 INFO:teuthology.orchestra.run.smithi155.stdout: "event": "initiated", 2023-08-01T19:56:15.843 INFO:teuthology.orchestra.run.smithi155.stdout: "time": "2023-08-01T19:55:05.154048+0000", 2023-08-01T19:56:15.843 INFO:teuthology.orchestra.run.smithi155.stdout: "duration": 0 2023-08-01T19:56:15.843 INFO:teuthology.orchestra.run.smithi155.stdout: }, 2023-08-01T19:56:15.844 INFO:teuthology.orchestra.run.smithi155.stdout: { 2023-08-01T19:56:15.844 INFO:teuthology.orchestra.run.smithi155.stdout: "event": "throttled", 2023-08-01T19:56:15.844 INFO:teuthology.orchestra.run.smithi155.stdout: "time": "2023-08-01T19:55:05.154048+0000", 2023-08-01T19:56:15.844 INFO:teuthology.orchestra.run.smithi155.stdout: "duration": 0 2023-08-01T19:56:15.844 INFO:teuthology.orchestra.run.smithi155.stdout: }, 2023-08-01T19:56:15.844 INFO:teuthology.orchestra.run.smithi155.stdout: { 2023-08-01T19:56:15.844 INFO:teuthology.orchestra.run.smithi155.stdout: "event": "header_read", 2023-08-01T19:56:15.845 INFO:teuthology.orchestra.run.smithi155.stdout: "time": "2023-08-01T19:55:05.154047+0000", 2023-08-01T19:56:15.845 INFO:teuthology.orchestra.run.smithi155.stdout: "duration": 4294967295.999999 2023-08-01T19:56:15.845 INFO:teuthology.orchestra.run.smithi155.stdout: }, 2023-08-01T19:56:15.845 INFO:teuthology.orchestra.run.smithi155.stdout: { 2023-08-01T19:56:15.845 INFO:teuthology.orchestra.run.smithi155.stdout: "event": "all_read", 2023-08-01T19:56:15.845 INFO:teuthology.orchestra.run.smithi155.stdout: "time": "2023-08-01T19:55:05.154115+0000", 2023-08-01T19:56:15.845 INFO:teuthology.orchestra.run.smithi155.stdout: "duration": 6.7545999999999993e-05 2023-08-01T19:56:15.845 INFO:teuthology.orchestra.run.smithi155.stdout: }, 2023-08-01T19:56:15.846 INFO:teuthology.orchestra.run.smithi155.stdout: { 2023-08-01T19:56:15.846 INFO:teuthology.orchestra.run.smithi155.stdout: "event": "dispatched", 2023-08-01T19:56:15.846 INFO:teuthology.orchestra.run.smithi155.stdout: "time": "2023-08-01T19:55:05.154125+0000", 2023-08-01T19:56:15.846 INFO:teuthology.orchestra.run.smithi155.stdout: "duration": 1.0669000000000001e-05 2023-08-01T19:56:15.846 INFO:teuthology.orchestra.run.smithi155.stdout: }, 2023-08-01T19:56:15.846 INFO:teuthology.orchestra.run.smithi155.stdout: { 2023-08-01T19:56:15.846 INFO:teuthology.orchestra.run.smithi155.stdout: "event": "queued_for_pg", 2023-08-01T19:56:15.847 INFO:teuthology.orchestra.run.smithi155.stdout: "time": "2023-08-01T19:55:05.154131+0000", 2023-08-01T19:56:15.847 INFO:teuthology.orchestra.run.smithi155.stdout: "duration": 6.0349999999999998e-06 2023-08-01T19:56:15.847 INFO:teuthology.orchestra.run.smithi155.stdout: }, 2023-08-01T19:56:15.847 INFO:teuthology.orchestra.run.smithi155.stdout: { 2023-08-01T19:56:15.847 INFO:teuthology.orchestra.run.smithi155.stdout: "event": "reached_pg", 2023-08-01T19:56:15.847 INFO:teuthology.orchestra.run.smithi155.stdout: "time": "2023-08-01T19:55:05.154174+0000", 2023-08-01T19:56:15.847 INFO:teuthology.orchestra.run.smithi155.stdout: "duration": 4.2429000000000003e-05 2023-08-01T19:56:15.848 INFO:teuthology.orchestra.run.smithi155.stdout: }, 2023-08-01T19:56:15.848 INFO:teuthology.orchestra.run.smithi155.stdout: { 2023-08-01T19:56:15.848 INFO:teuthology.orchestra.run.smithi155.stdout: "event": "started", 2023-08-01T19:56:15.848 INFO:teuthology.orchestra.run.smithi155.stdout: "time": "2023-08-01T19:55:05.154287+0000", 2023-08-01T19:56:15.848 INFO:teuthology.orchestra.run.smithi155.stdout: "duration": 0.000113138 2023-08-01T19:56:15.848 INFO:teuthology.orchestra.run.smithi155.stdout: }, 2023-08-01T19:56:15.848 INFO:teuthology.orchestra.run.smithi155.stdout: { 2023-08-01T19:56:15.849 INFO:teuthology.orchestra.run.smithi155.stdout: "event": "waiting for subops from 0", 2023-08-01T19:56:15.849 INFO:teuthology.orchestra.run.smithi155.stdout: "time": "2023-08-01T19:55:05.154420+0000", 2023-08-01T19:56:15.849 INFO:teuthology.orchestra.run.smithi155.stdout: "duration": 0.000133292 2023-08-01T19:56:15.849 INFO:teuthology.orchestra.run.smithi155.stdout: }, 2023-08-01T19:56:15.849 INFO:teuthology.orchestra.run.smithi155.stdout: { 2023-08-01T19:56:15.849 INFO:teuthology.orchestra.run.smithi155.stdout: "event": "sub_op_commit_rec", 2023-08-01T19:56:15.849 INFO:teuthology.orchestra.run.smithi155.stdout: "time": "2023-08-01T19:55:05.219034+0000", 2023-08-01T19:56:15.850 INFO:teuthology.orchestra.run.smithi155.stdout: "duration": 0.064613429999999999 2023-08-01T19:56:15.850 INFO:teuthology.orchestra.run.smithi155.stdout: }, 2023-08-01T19:56:15.850 INFO:teuthology.orchestra.run.smithi155.stdout: { 2023-08-01T19:56:15.850 INFO:teuthology.orchestra.run.smithi155.stdout: "event": "op_commit", 2023-08-01T19:56:15.850 INFO:teuthology.orchestra.run.smithi155.stdout: "time": "2023-08-01T19:55:05.224138+0000", 2023-08-01T19:56:15.850 INFO:teuthology.orchestra.run.smithi155.stdout: "duration": 0.0051041999999999997 2023-08-01T19:56:15.850 INFO:teuthology.orchestra.run.smithi155.stdout: }, 2023-08-01T19:56:15.851 INFO:teuthology.orchestra.run.smithi155.stdout: { 2023-08-01T19:56:15.851 INFO:teuthology.orchestra.run.smithi155.stdout: "event": "commit_sent", 2023-08-01T19:56:15.851 INFO:teuthology.orchestra.run.smithi155.stdout: "time": "2023-08-01T19:55:05.224171+0000", 2023-08-01T19:56:15.851 INFO:teuthology.orchestra.run.smithi155.stdout: "duration": 3.3345e-05 2023-08-01T19:56:15.851 INFO:teuthology.orchestra.run.smithi155.stdout: }, 2023-08-01T19:56:15.851 INFO:teuthology.orchestra.run.smithi155.stdout: { 2023-08-01T19:56:15.851 INFO:teuthology.orchestra.run.smithi155.stdout: "event": "done", 2023-08-01T19:56:15.851 INFO:teuthology.orchestra.run.smithi155.stdout: "time": "2023-08-01T19:55:05.224205+0000", 2023-08-01T19:56:15.852 INFO:teuthology.orchestra.run.smithi155.stdout: "duration": 3.3525999999999997e-05 2023-08-01T19:56:15.852 INFO:teuthology.orchestra.run.smithi155.stdout: } 2023-08-01T19:56:15.852 INFO:teuthology.orchestra.run.smithi155.stdout: ] 2023-08-01T19:56:15.852 INFO:teuthology.orchestra.run.smithi155.stdout: } 2023-08-01T19:56:15.852 INFO:teuthology.orchestra.run.smithi155.stdout: }, 2023-08-01T19:56:15.852 INFO:teuthology.orchestra.run.smithi155.stdout: { 2023-08-01T19:56:15.853 INFO:teuthology.orchestra.run.smithi155.stdout: "description": "osd_repop_reply(client.4668.0:100237 5.4 e37/19 ondisk, result = 0)", 2023-08-01T19:56:15.853 INFO:teuthology.orchestra.run.smithi155.stdout: "initiated_at": "2023-08-01T19:55:05.156249+0000", 2023-08-01T19:56:15.853 INFO:teuthology.orchestra.run.smithi155.stdout: "age": 70.597316225, 2023-08-01T19:56:15.853 INFO:teuthology.orchestra.run.smithi155.stdout: "duration": 0.062792549000000003, 2023-08-01T19:56:15.853 INFO:teuthology.orchestra.run.smithi155.stdout: "type_data": { 2023-08-01T19:56:15.853 INFO:teuthology.orchestra.run.smithi155.stdout: "flag_point": "started", 2023-08-01T19:56:15.853 INFO:teuthology.orchestra.run.smithi155.stdout: "events": [ 2023-08-01T19:56:15.853 INFO:teuthology.orchestra.run.smithi155.stdout: { 2023-08-01T19:56:15.854 INFO:teuthology.orchestra.run.smithi155.stdout: "event": "initiated", 2023-08-01T19:56:15.854 INFO:teuthology.orchestra.run.smithi155.stdout: "time": "2023-08-01T19:55:05.156249+0000", 2023-08-01T19:56:15.854 INFO:teuthology.orchestra.run.smithi155.stdout: "duration": 0 2023-08-01T19:56:15.854 INFO:teuthology.orchestra.run.smithi155.stdout: }, 2023-08-01T19:56:15.854 INFO:teuthology.orchestra.run.smithi155.stdout: { 2023-08-01T19:56:15.854 INFO:teuthology.orchestra.run.smithi155.stdout: "event": "throttled", 2023-08-01T19:56:15.855 INFO:teuthology.orchestra.run.smithi155.stdout: "time": "2023-08-01T19:55:05.156249+0000", 2023-08-01T19:56:15.855 INFO:teuthology.orchestra.run.smithi155.stdout: "duration": 0 2023-08-01T19:56:15.855 INFO:teuthology.orchestra.run.smithi155.stdout: }, 2023-08-01T19:56:15.855 INFO:teuthology.orchestra.run.smithi155.stdout: { 2023-08-01T19:56:15.855 INFO:teuthology.orchestra.run.smithi155.stdout: "event": "header_read", 2023-08-01T19:56:15.855 INFO:teuthology.orchestra.run.smithi155.stdout: "time": "2023-08-01T19:55:05.156248+0000", 2023-08-01T19:56:15.855 INFO:teuthology.orchestra.run.smithi155.stdout: "duration": 4294967295.9999995 2023-08-01T19:56:15.856 INFO:teuthology.orchestra.run.smithi155.stdout: }, 2023-08-01T19:56:15.856 INFO:teuthology.orchestra.run.smithi155.stdout: { 2023-08-01T19:56:15.856 INFO:teuthology.orchestra.run.smithi155.stdout: "event": "all_read", 2023-08-01T19:56:15.856 INFO:teuthology.orchestra.run.smithi155.stdout: "time": "2023-08-01T19:55:05.156252+0000", 2023-08-01T19:56:15.856 INFO:teuthology.orchestra.run.smithi155.stdout: "duration": 3.9999999999999998e-06 2023-08-01T19:56:15.856 INFO:teuthology.orchestra.run.smithi155.stdout: }, 2023-08-01T19:56:15.857 INFO:teuthology.orchestra.run.smithi155.stdout: { 2023-08-01T19:56:15.857 INFO:teuthology.orchestra.run.smithi155.stdout: "event": "dispatched", 2023-08-01T19:56:15.857 INFO:teuthology.orchestra.run.smithi155.stdout: "time": "2023-08-01T19:55:05.218844+0000", 2023-08-01T19:56:15.857 INFO:teuthology.orchestra.run.smithi155.stdout: "duration": 0.062591516999999999 2023-08-01T19:56:15.857 INFO:teuthology.orchestra.run.smithi155.stdout: }, 2023-08-01T19:56:15.857 INFO:teuthology.orchestra.run.smithi155.stdout: { 2023-08-01T19:56:15.857 INFO:teuthology.orchestra.run.smithi155.stdout: "event": "queued_for_pg", 2023-08-01T19:56:15.858 INFO:teuthology.orchestra.run.smithi155.stdout: "time": "2023-08-01T19:55:05.218862+0000", 2023-08-01T19:56:15.858 INFO:teuthology.orchestra.run.smithi155.stdout: "duration": 1.7666e-05 2023-08-01T19:56:15.858 INFO:teuthology.orchestra.run.smithi155.stdout: }, 2023-08-01T19:56:15.858 INFO:teuthology.orchestra.run.smithi155.stdout: { 2023-08-01T19:56:15.858 INFO:teuthology.orchestra.run.smithi155.stdout: "event": "reached_pg", 2023-08-01T19:56:15.858 INFO:teuthology.orchestra.run.smithi155.stdout: "time": "2023-08-01T19:55:05.218914+0000", 2023-08-01T19:56:15.858 INFO:teuthology.orchestra.run.smithi155.stdout: "duration": 5.2565999999999998e-05 2023-08-01T19:56:15.858 INFO:teuthology.orchestra.run.smithi155.stdout: }, 2023-08-01T19:56:15.859 INFO:teuthology.orchestra.run.smithi155.stdout: { 2023-08-01T19:56:15.859 INFO:teuthology.orchestra.run.smithi155.stdout: "event": "started", 2023-08-01T19:56:15.859 INFO:teuthology.orchestra.run.smithi155.stdout: "time": "2023-08-01T19:55:05.218925+0000", 2023-08-01T19:56:15.859 INFO:teuthology.orchestra.run.smithi155.stdout: "duration": 1.1375e-05 2023-08-01T19:56:15.859 INFO:teuthology.orchestra.run.smithi155.stdout: }, 2023-08-01T19:56:15.859 INFO:teuthology.orchestra.run.smithi155.stdout: { 2023-08-01T19:56:15.859 INFO:teuthology.orchestra.run.smithi155.stdout: "event": "done", 2023-08-01T19:56:15.860 INFO:teuthology.orchestra.run.smithi155.stdout: "time": "2023-08-01T19:55:05.219041+0000", 2023-08-01T19:56:15.860 INFO:teuthology.orchestra.run.smithi155.stdout: "duration": 0.000115977 2023-08-01T19:56:15.860 INFO:teuthology.orchestra.run.smithi155.stdout: } 2023-08-01T19:56:15.860 INFO:teuthology.orchestra.run.smithi155.stdout: ] 2023-08-01T19:56:15.860 INFO:teuthology.orchestra.run.smithi155.stdout: } 2023-08-01T19:56:15.860 INFO:teuthology.orchestra.run.smithi155.stdout: }, 2023-08-01T19:56:15.861 INFO:teuthology.orchestra.run.smithi155.stdout: { 2023-08-01T19:56:15.861 INFO:teuthology.orchestra.run.smithi155.stdout: "description": "osd_repop(client.4668.0:100253 5.f e37/19 5:f7bbce05:::benchmark_data_smithi006_114134_object100252:head v 37'6323, mlcod=37'6321)", 2023-08-01T19:56:15.861 INFO:teuthology.orchestra.run.smithi155.stdout: "initiated_at": "2023-08-01T19:55:05.156952+0000", 2023-08-01T19:56:15.861 INFO:teuthology.orchestra.run.smithi155.stdout: "age": 70.596613161999997, 2023-08-01T19:56:15.861 INFO:teuthology.orchestra.run.smithi155.stdout: "duration": 0.068018577999999996, 2023-08-01T19:56:15.861 INFO:teuthology.orchestra.run.smithi155.stdout: "type_data": { 2023-08-01T19:56:15.861 INFO:teuthology.orchestra.run.smithi155.stdout: "flag_point": "commit sent; apply or cleanup", 2023-08-01T19:56:15.862 INFO:teuthology.orchestra.run.smithi155.stdout: "events": [ 2023-08-01T19:56:15.862 INFO:teuthology.orchestra.run.smithi155.stdout: { 2023-08-01T19:56:15.862 INFO:teuthology.orchestra.run.smithi155.stdout: "event": "initiated", 2023-08-01T19:56:15.862 INFO:teuthology.orchestra.run.smithi155.stdout: "time": "2023-08-01T19:55:05.156952+0000", 2023-08-01T19:56:15.862 INFO:teuthology.orchestra.run.smithi155.stdout: "duration": 0 2023-08-01T19:56:15.862 INFO:teuthology.orchestra.run.smithi155.stdout: }, 2023-08-01T19:56:15.862 INFO:teuthology.orchestra.run.smithi155.stdout: { 2023-08-01T19:56:15.863 INFO:teuthology.orchestra.run.smithi155.stdout: "event": "throttled", 2023-08-01T19:56:15.863 INFO:teuthology.orchestra.run.smithi155.stdout: "time": "2023-08-01T19:55:05.156952+0000", 2023-08-01T19:56:15.863 INFO:teuthology.orchestra.run.smithi155.stdout: "duration": 0 2023-08-01T19:56:15.863 INFO:teuthology.orchestra.run.smithi155.stdout: }, 2023-08-01T19:56:15.863 INFO:teuthology.orchestra.run.smithi155.stdout: { 2023-08-01T19:56:15.863 INFO:teuthology.orchestra.run.smithi155.stdout: "event": "header_read", 2023-08-01T19:56:15.863 INFO:teuthology.orchestra.run.smithi155.stdout: "time": "2023-08-01T19:55:05.156951+0000", 2023-08-01T19:56:15.863 INFO:teuthology.orchestra.run.smithi155.stdout: "duration": 4294967295.999999 2023-08-01T19:56:15.864 INFO:teuthology.orchestra.run.smithi155.stdout: }, 2023-08-01T19:56:15.864 INFO:teuthology.orchestra.run.smithi155.stdout: { 2023-08-01T19:56:15.864 INFO:teuthology.orchestra.run.smithi155.stdout: "event": "all_read", 2023-08-01T19:56:15.864 INFO:teuthology.orchestra.run.smithi155.stdout: "time": "2023-08-01T19:55:05.156989+0000", 2023-08-01T19:56:15.864 INFO:teuthology.orchestra.run.smithi155.stdout: "duration": 3.8175e-05 2023-08-01T19:56:15.864 INFO:teuthology.orchestra.run.smithi155.stdout: }, 2023-08-01T19:56:15.864 INFO:teuthology.orchestra.run.smithi155.stdout: { 2023-08-01T19:56:15.865 INFO:teuthology.orchestra.run.smithi155.stdout: "event": "dispatched", 2023-08-01T19:56:15.865 INFO:teuthology.orchestra.run.smithi155.stdout: "time": "2023-08-01T19:55:05.218842+0000", 2023-08-01T19:56:15.865 INFO:teuthology.orchestra.run.smithi155.stdout: "duration": 0.061852299999999999 2023-08-01T19:56:15.865 INFO:teuthology.orchestra.run.smithi155.stdout: }, 2023-08-01T19:56:15.865 INFO:teuthology.orchestra.run.smithi155.stdout: { 2023-08-01T19:56:15.865 INFO:teuthology.orchestra.run.smithi155.stdout: "event": "queued_for_pg", 2023-08-01T19:56:15.865 INFO:teuthology.orchestra.run.smithi155.stdout: "time": "2023-08-01T19:55:05.218862+0000", 2023-08-01T19:56:15.866 INFO:teuthology.orchestra.run.smithi155.stdout: "duration": 1.9854999999999999e-05 2023-08-01T19:56:15.866 INFO:teuthology.orchestra.run.smithi155.stdout: }, 2023-08-01T19:56:15.866 INFO:teuthology.orchestra.run.smithi155.stdout: { 2023-08-01T19:56:15.866 INFO:teuthology.orchestra.run.smithi155.stdout: "event": "reached_pg", 2023-08-01T19:56:15.866 INFO:teuthology.orchestra.run.smithi155.stdout: "time": "2023-08-01T19:55:05.218918+0000", 2023-08-01T19:56:15.866 INFO:teuthology.orchestra.run.smithi155.stdout: "duration": 5.6570000000000002e-05 2023-08-01T19:56:15.866 INFO:teuthology.orchestra.run.smithi155.stdout: }, 2023-08-01T19:56:15.867 INFO:teuthology.orchestra.run.smithi155.stdout: { 2023-08-01T19:56:15.867 INFO:teuthology.orchestra.run.smithi155.stdout: "event": "started", 2023-08-01T19:56:15.867 INFO:teuthology.orchestra.run.smithi155.stdout: "time": "2023-08-01T19:55:05.218940+0000", 2023-08-01T19:56:15.867 INFO:teuthology.orchestra.run.smithi155.stdout: "duration": 2.1804e-05 2023-08-01T19:56:15.867 INFO:teuthology.orchestra.run.smithi155.stdout: }, 2023-08-01T19:56:15.867 INFO:teuthology.orchestra.run.smithi155.stdout: { 2023-08-01T19:56:15.867 INFO:teuthology.orchestra.run.smithi155.stdout: "event": "commit_sent", 2023-08-01T19:56:15.868 INFO:teuthology.orchestra.run.smithi155.stdout: "time": "2023-08-01T19:55:05.224928+0000", 2023-08-01T19:56:15.868 INFO:teuthology.orchestra.run.smithi155.stdout: "duration": 0.0059876759999999999 2023-08-01T19:56:15.868 INFO:teuthology.orchestra.run.smithi155.stdout: }, 2023-08-01T19:56:15.868 INFO:teuthology.orchestra.run.smithi155.stdout: { 2023-08-01T19:56:15.868 INFO:teuthology.orchestra.run.smithi155.stdout: "event": "done", 2023-08-01T19:56:15.868 INFO:teuthology.orchestra.run.smithi155.stdout: "time": "2023-08-01T19:55:05.224971+0000", 2023-08-01T19:56:15.868 INFO:teuthology.orchestra.run.smithi155.stdout: "duration": 4.2929999999999997e-05 2023-08-01T19:56:15.869 INFO:teuthology.orchestra.run.smithi155.stdout: } 2023-08-01T19:56:15.869 INFO:teuthology.orchestra.run.smithi155.stdout: ] 2023-08-01T19:56:15.869 INFO:teuthology.orchestra.run.smithi155.stdout: } 2023-08-01T19:56:15.869 INFO:teuthology.orchestra.run.smithi155.stdout: }, 2023-08-01T19:56:15.869 INFO:teuthology.orchestra.run.smithi155.stdout: { 2023-08-01T19:56:15.869 INFO:teuthology.orchestra.run.smithi155.stdout: "description": "osd_op(client.4668.0:100927 5.0 5:00608ec6:::benchmark_data_smithi006_114134_object100926:head [set-alloc-hint object_size 65536 write_size 65536,write 0~65536] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e37)", 2023-08-01T19:56:15.869 INFO:teuthology.orchestra.run.smithi155.stdout: "initiated_at": "2023-08-01T19:55:05.561169+0000", 2023-08-01T19:56:15.870 INFO:teuthology.orchestra.run.smithi155.stdout: "age": 70.192396259000006, 2023-08-01T19:56:15.870 INFO:teuthology.orchestra.run.smithi155.stdout: "duration": 0.066411687999999997, 2023-08-01T19:56:15.870 INFO:teuthology.orchestra.run.smithi155.stdout: "type_data": { 2023-08-01T19:56:15.870 INFO:teuthology.orchestra.run.smithi155.stdout: "flag_point": "commit sent; apply or cleanup", 2023-08-01T19:56:15.870 INFO:teuthology.orchestra.run.smithi155.stdout: "client_info": { 2023-08-01T19:56:15.870 INFO:teuthology.orchestra.run.smithi155.stdout: "client": "client.4668", 2023-08-01T19:56:15.870 INFO:teuthology.orchestra.run.smithi155.stdout: "client_addr": "172.21.15.6:0/1709472247", 2023-08-01T19:56:15.871 INFO:teuthology.orchestra.run.smithi155.stdout: "tid": 100927 2023-08-01T19:56:15.871 INFO:teuthology.orchestra.run.smithi155.stdout: }, 2023-08-01T19:56:15.871 INFO:teuthology.orchestra.run.smithi155.stdout: "events": [ 2023-08-01T19:56:15.871 INFO:teuthology.orchestra.run.smithi155.stdout: { 2023-08-01T19:56:15.871 INFO:teuthology.orchestra.run.smithi155.stdout: "event": "initiated", 2023-08-01T19:56:15.871 INFO:teuthology.orchestra.run.smithi155.stdout: "time": "2023-08-01T19:55:05.561169+0000", 2023-08-01T19:56:15.871 INFO:teuthology.orchestra.run.smithi155.stdout: "duration": 0 2023-08-01T19:56:15.872 INFO:teuthology.orchestra.run.smithi155.stdout: }, 2023-08-01T19:56:15.872 INFO:teuthology.orchestra.run.smithi155.stdout: { 2023-08-01T19:56:15.872 INFO:teuthology.orchestra.run.smithi155.stdout: "event": "throttled", 2023-08-01T19:56:15.872 INFO:teuthology.orchestra.run.smithi155.stdout: "time": "2023-08-01T19:55:05.561169+0000", 2023-08-01T19:56:15.872 INFO:teuthology.orchestra.run.smithi155.stdout: "duration": 0 2023-08-01T19:56:15.872 INFO:teuthology.orchestra.run.smithi155.stdout: }, 2023-08-01T19:56:15.872 INFO:teuthology.orchestra.run.smithi155.stdout: { 2023-08-01T19:56:15.873 INFO:teuthology.orchestra.run.smithi155.stdout: "event": "header_read", 2023-08-01T19:56:15.873 INFO:teuthology.orchestra.run.smithi155.stdout: "time": "2023-08-01T19:55:05.561168+0000", 2023-08-01T19:56:15.873 INFO:teuthology.orchestra.run.smithi155.stdout: "duration": 4294967295.9999995 2023-08-01T19:56:15.873 INFO:teuthology.orchestra.run.smithi155.stdout: }, 2023-08-01T19:56:15.873 INFO:teuthology.orchestra.run.smithi155.stdout: { 2023-08-01T19:56:15.873 INFO:teuthology.orchestra.run.smithi155.stdout: "event": "all_read", 2023-08-01T19:56:15.873 INFO:teuthology.orchestra.run.smithi155.stdout: "time": "2023-08-01T19:55:05.561218+0000", 2023-08-01T19:56:15.873 INFO:teuthology.orchestra.run.smithi155.stdout: "duration": 4.9379999999999998e-05 2023-08-01T19:56:15.874 INFO:teuthology.orchestra.run.smithi155.stdout: }, 2023-08-01T19:56:15.874 INFO:teuthology.orchestra.run.smithi155.stdout: { 2023-08-01T19:56:15.874 INFO:teuthology.orchestra.run.smithi155.stdout: "event": "dispatched", 2023-08-01T19:56:15.874 INFO:teuthology.orchestra.run.smithi155.stdout: "time": "2023-08-01T19:55:05.561225+0000", 2023-08-01T19:56:15.874 INFO:teuthology.orchestra.run.smithi155.stdout: "duration": 7.114e-06 2023-08-01T19:56:15.874 INFO:teuthology.orchestra.run.smithi155.stdout: }, 2023-08-01T19:56:15.874 INFO:teuthology.orchestra.run.smithi155.stdout: { 2023-08-01T19:56:15.875 INFO:teuthology.orchestra.run.smithi155.stdout: "event": "queued_for_pg", 2023-08-01T19:56:15.875 INFO:teuthology.orchestra.run.smithi155.stdout: "time": "2023-08-01T19:55:05.561229+0000", 2023-08-01T19:56:15.875 INFO:teuthology.orchestra.run.smithi155.stdout: "duration": 4.2180000000000001e-06 2023-08-01T19:56:15.875 INFO:teuthology.orchestra.run.smithi155.stdout: }, 2023-08-01T19:56:15.875 INFO:teuthology.orchestra.run.smithi155.stdout: { 2023-08-01T19:56:15.875 INFO:teuthology.orchestra.run.smithi155.stdout: "event": "reached_pg", 2023-08-01T19:56:15.875 INFO:teuthology.orchestra.run.smithi155.stdout: "time": "2023-08-01T19:55:05.564737+0000", 2023-08-01T19:56:15.876 INFO:teuthology.orchestra.run.smithi155.stdout: "duration": 0.0035081869999999999 2023-08-01T19:56:15.876 INFO:teuthology.orchestra.run.smithi155.stdout: }, 2023-08-01T19:56:15.876 INFO:teuthology.orchestra.run.smithi155.stdout: { 2023-08-01T19:56:15.876 INFO:teuthology.orchestra.run.smithi155.stdout: "event": "started", 2023-08-01T19:56:15.876 INFO:teuthology.orchestra.run.smithi155.stdout: "time": "2023-08-01T19:55:05.564859+0000", 2023-08-01T19:56:15.876 INFO:teuthology.orchestra.run.smithi155.stdout: "duration": 0.00012165800000000001 2023-08-01T19:56:15.876 INFO:teuthology.orchestra.run.smithi155.stdout: }, 2023-08-01T19:56:15.877 INFO:teuthology.orchestra.run.smithi155.stdout: { 2023-08-01T19:56:15.877 INFO:teuthology.orchestra.run.smithi155.stdout: "event": "waiting for subops from 0", 2023-08-01T19:56:15.877 INFO:teuthology.orchestra.run.smithi155.stdout: "time": "2023-08-01T19:55:05.565009+0000", 2023-08-01T19:56:15.877 INFO:teuthology.orchestra.run.smithi155.stdout: "duration": 0.00014979699999999999 2023-08-01T19:56:15.877 INFO:teuthology.orchestra.run.smithi155.stdout: }, 2023-08-01T19:56:15.877 INFO:teuthology.orchestra.run.smithi155.stdout: { 2023-08-01T19:56:15.877 INFO:teuthology.orchestra.run.smithi155.stdout: "event": "op_commit", 2023-08-01T19:56:15.877 INFO:teuthology.orchestra.run.smithi155.stdout: "time": "2023-08-01T19:55:05.568007+0000", 2023-08-01T19:56:15.878 INFO:teuthology.orchestra.run.smithi155.stdout: "duration": 0.00299796 2023-08-01T19:56:15.878 INFO:teuthology.orchestra.run.smithi155.stdout: }, 2023-08-01T19:56:15.878 INFO:teuthology.orchestra.run.smithi155.stdout: { 2023-08-01T19:56:15.878 INFO:teuthology.orchestra.run.smithi155.stdout: "event": "sub_op_commit_rec", 2023-08-01T19:56:15.878 INFO:teuthology.orchestra.run.smithi155.stdout: "time": "2023-08-01T19:55:05.627520+0000", 2023-08-01T19:56:15.878 INFO:teuthology.orchestra.run.smithi155.stdout: "duration": 0.059513636000000002 2023-08-01T19:56:15.878 INFO:teuthology.orchestra.run.smithi155.stdout: }, 2023-08-01T19:56:15.879 INFO:teuthology.orchestra.run.smithi155.stdout: { 2023-08-01T19:56:15.879 INFO:teuthology.orchestra.run.smithi155.stdout: "event": "commit_sent", 2023-08-01T19:56:15.879 INFO:teuthology.orchestra.run.smithi155.stdout: "time": "2023-08-01T19:55:05.627553+0000", 2023-08-01T19:56:15.879 INFO:teuthology.orchestra.run.smithi155.stdout: "duration": 3.2635999999999997e-05 2023-08-01T19:56:15.879 INFO:teuthology.orchestra.run.smithi155.stdout: }, 2023-08-01T19:56:15.879 INFO:teuthology.orchestra.run.smithi155.stdout: { 2023-08-01T19:56:15.879 INFO:teuthology.orchestra.run.smithi155.stdout: "event": "done", 2023-08-01T19:56:15.880 INFO:teuthology.orchestra.run.smithi155.stdout: "time": "2023-08-01T19:55:05.627581+0000", 2023-08-01T19:56:15.880 INFO:teuthology.orchestra.run.smithi155.stdout: "duration": 2.7681000000000001e-05 2023-08-01T19:56:15.880 INFO:teuthology.orchestra.run.smithi155.stdout: } 2023-08-01T19:56:15.880 INFO:teuthology.orchestra.run.smithi155.stdout: ] 2023-08-01T19:56:15.880 INFO:teuthology.orchestra.run.smithi155.stdout: } 2023-08-01T19:56:15.880 INFO:teuthology.orchestra.run.smithi155.stdout: }, 2023-08-01T19:56:15.880 INFO:teuthology.orchestra.run.smithi155.stdout: { 2023-08-01T19:56:15.881 INFO:teuthology.orchestra.run.smithi155.stdout: "description": "osd_op(client.4668.0:100935 5.e 5:7895b14e:::benchmark_data_smithi006_114134_object100934:head [set-alloc-hint object_size 65536 write_size 65536,write 0~65536] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e37)", 2023-08-01T19:56:15.881 INFO:teuthology.orchestra.run.smithi155.stdout: "initiated_at": "2023-08-01T19:55:05.566666+0000", 2023-08-01T19:56:15.881 INFO:teuthology.orchestra.run.smithi155.stdout: "age": 70.186898959000004, 2023-08-01T19:56:15.881 INFO:teuthology.orchestra.run.smithi155.stdout: "duration": 0.064309016999999996, 2023-08-01T19:56:15.881 INFO:teuthology.orchestra.run.smithi155.stdout: "type_data": { 2023-08-01T19:56:15.881 INFO:teuthology.orchestra.run.smithi155.stdout: "flag_point": "commit sent; apply or cleanup", 2023-08-01T19:56:15.881 INFO:teuthology.orchestra.run.smithi155.stdout: "client_info": { 2023-08-01T19:56:15.881 INFO:teuthology.orchestra.run.smithi155.stdout: "client": "client.4668", 2023-08-01T19:56:15.882 INFO:teuthology.orchestra.run.smithi155.stdout: "client_addr": "172.21.15.6:0/1709472247", 2023-08-01T19:56:15.882 INFO:teuthology.orchestra.run.smithi155.stdout: "tid": 100935 2023-08-01T19:56:15.882 INFO:teuthology.orchestra.run.smithi155.stdout: }, 2023-08-01T19:56:15.882 INFO:teuthology.orchestra.run.smithi155.stdout: "events": [ 2023-08-01T19:56:15.882 INFO:teuthology.orchestra.run.smithi155.stdout: { 2023-08-01T19:56:15.882 INFO:teuthology.orchestra.run.smithi155.stdout: "event": "initiated", 2023-08-01T19:56:15.883 INFO:teuthology.orchestra.run.smithi155.stdout: "time": "2023-08-01T19:55:05.566666+0000", 2023-08-01T19:56:15.883 INFO:teuthology.orchestra.run.smithi155.stdout: "duration": 0 2023-08-01T19:56:15.883 INFO:teuthology.orchestra.run.smithi155.stdout: }, 2023-08-01T19:56:15.883 INFO:teuthology.orchestra.run.smithi155.stdout: { 2023-08-01T19:56:15.883 INFO:teuthology.orchestra.run.smithi155.stdout: "event": "throttled", 2023-08-01T19:56:15.883 INFO:teuthology.orchestra.run.smithi155.stdout: "time": "2023-08-01T19:55:05.566666+0000", 2023-08-01T19:56:15.883 INFO:teuthology.orchestra.run.smithi155.stdout: "duration": 0 2023-08-01T19:56:15.883 INFO:teuthology.orchestra.run.smithi155.stdout: }, 2023-08-01T19:56:15.884 INFO:teuthology.orchestra.run.smithi155.stdout: { 2023-08-01T19:56:15.884 INFO:teuthology.orchestra.run.smithi155.stdout: "event": "header_read", 2023-08-01T19:56:15.884 INFO:teuthology.orchestra.run.smithi155.stdout: "time": "2023-08-01T19:55:05.566665+0000", 2023-08-01T19:56:15.884 INFO:teuthology.orchestra.run.smithi155.stdout: "duration": 4294967295.9999986 2023-08-01T19:56:15.884 INFO:teuthology.orchestra.run.smithi155.stdout: }, 2023-08-01T19:56:15.884 INFO:teuthology.orchestra.run.smithi155.stdout: { 2023-08-01T19:56:15.884 INFO:teuthology.orchestra.run.smithi155.stdout: "event": "all_read", 2023-08-01T19:56:15.885 INFO:teuthology.orchestra.run.smithi155.stdout: "time": "2023-08-01T19:55:05.566754+0000", 2023-08-01T19:56:15.885 INFO:teuthology.orchestra.run.smithi155.stdout: "duration": 8.9425999999999994e-05 2023-08-01T19:56:15.885 INFO:teuthology.orchestra.run.smithi155.stdout: }, 2023-08-01T19:56:15.885 INFO:teuthology.orchestra.run.smithi155.stdout: { 2023-08-01T19:56:15.885 INFO:teuthology.orchestra.run.smithi155.stdout: "event": "dispatched", 2023-08-01T19:56:15.885 INFO:teuthology.orchestra.run.smithi155.stdout: "time": "2023-08-01T19:55:05.566766+0000", 2023-08-01T19:56:15.885 INFO:teuthology.orchestra.run.smithi155.stdout: "duration": 1.2018000000000001e-05 2023-08-01T19:56:15.886 INFO:teuthology.orchestra.run.smithi155.stdout: }, 2023-08-01T19:56:15.886 INFO:teuthology.orchestra.run.smithi155.stdout: { 2023-08-01T19:56:15.886 INFO:teuthology.orchestra.run.smithi155.stdout: "event": "queued_for_pg", 2023-08-01T19:56:15.886 INFO:teuthology.orchestra.run.smithi155.stdout: "time": "2023-08-01T19:55:05.566772+0000", 2023-08-01T19:56:15.886 INFO:teuthology.orchestra.run.smithi155.stdout: "duration": 6.0190000000000003e-06 2023-08-01T19:56:15.886 INFO:teuthology.orchestra.run.smithi155.stdout: }, 2023-08-01T19:56:15.886 INFO:teuthology.orchestra.run.smithi155.stdout: { 2023-08-01T19:56:15.887 INFO:teuthology.orchestra.run.smithi155.stdout: "event": "reached_pg", 2023-08-01T19:56:15.887 INFO:teuthology.orchestra.run.smithi155.stdout: "time": "2023-08-01T19:55:05.566800+0000", 2023-08-01T19:56:15.887 INFO:teuthology.orchestra.run.smithi155.stdout: "duration": 2.7835999999999999e-05 2023-08-01T19:56:15.887 INFO:teuthology.orchestra.run.smithi155.stdout: }, 2023-08-01T19:56:15.887 INFO:teuthology.orchestra.run.smithi155.stdout: { 2023-08-01T19:56:15.887 INFO:teuthology.orchestra.run.smithi155.stdout: "event": "started", 2023-08-01T19:56:15.887 INFO:teuthology.orchestra.run.smithi155.stdout: "time": "2023-08-01T19:55:05.566879+0000", 2023-08-01T19:56:15.887 INFO:teuthology.orchestra.run.smithi155.stdout: "duration": 7.9105999999999998e-05 2023-08-01T19:56:15.888 INFO:teuthology.orchestra.run.smithi155.stdout: }, 2023-08-01T19:56:15.888 INFO:teuthology.orchestra.run.smithi155.stdout: { 2023-08-01T19:56:15.888 INFO:teuthology.orchestra.run.smithi155.stdout: "event": "waiting for subops from 0", 2023-08-01T19:56:15.888 INFO:teuthology.orchestra.run.smithi155.stdout: "time": "2023-08-01T19:55:05.566971+0000", 2023-08-01T19:56:15.888 INFO:teuthology.orchestra.run.smithi155.stdout: "duration": 9.1817999999999994e-05 2023-08-01T19:56:15.888 INFO:teuthology.orchestra.run.smithi155.stdout: }, 2023-08-01T19:56:15.888 INFO:teuthology.orchestra.run.smithi155.stdout: { 2023-08-01T19:56:15.889 INFO:teuthology.orchestra.run.smithi155.stdout: "event": "op_commit", 2023-08-01T19:56:15.889 INFO:teuthology.orchestra.run.smithi155.stdout: "time": "2023-08-01T19:55:05.571475+0000", 2023-08-01T19:56:15.889 INFO:teuthology.orchestra.run.smithi155.stdout: "duration": 0.0045039499999999996 2023-08-01T19:56:15.889 INFO:teuthology.orchestra.run.smithi155.stdout: }, 2023-08-01T19:56:15.889 INFO:teuthology.orchestra.run.smithi155.stdout: { 2023-08-01T19:56:15.889 INFO:teuthology.orchestra.run.smithi155.stdout: "event": "sub_op_commit_rec", 2023-08-01T19:56:15.889 INFO:teuthology.orchestra.run.smithi155.stdout: "time": "2023-08-01T19:55:05.630884+0000", 2023-08-01T19:56:15.890 INFO:teuthology.orchestra.run.smithi155.stdout: "duration": 0.059409181999999998 2023-08-01T19:56:15.890 INFO:teuthology.orchestra.run.smithi155.stdout: }, 2023-08-01T19:56:15.890 INFO:teuthology.orchestra.run.smithi155.stdout: { 2023-08-01T19:56:15.890 INFO:teuthology.orchestra.run.smithi155.stdout: "event": "commit_sent", 2023-08-01T19:56:15.890 INFO:teuthology.orchestra.run.smithi155.stdout: "time": "2023-08-01T19:55:05.630930+0000", 2023-08-01T19:56:15.890 INFO:teuthology.orchestra.run.smithi155.stdout: "duration": 4.5507999999999999e-05 2023-08-01T19:56:15.890 INFO:teuthology.orchestra.run.smithi155.stdout: }, 2023-08-01T19:56:15.890 INFO:teuthology.orchestra.run.smithi155.stdout: { 2023-08-01T19:56:15.891 INFO:teuthology.orchestra.run.smithi155.stdout: "event": "done", 2023-08-01T19:56:15.891 INFO:teuthology.orchestra.run.smithi155.stdout: "time": "2023-08-01T19:55:05.630975+0000", 2023-08-01T19:56:15.891 INFO:teuthology.orchestra.run.smithi155.stdout: "duration": 4.5441000000000001e-05 2023-08-01T19:56:15.891 INFO:teuthology.orchestra.run.smithi155.stdout: } 2023-08-01T19:56:15.891 INFO:teuthology.orchestra.run.smithi155.stdout: ] 2023-08-01T19:56:15.891 INFO:teuthology.orchestra.run.smithi155.stdout: } 2023-08-01T19:56:15.891 INFO:teuthology.orchestra.run.smithi155.stdout: }, 2023-08-01T19:56:15.892 INFO:teuthology.orchestra.run.smithi155.stdout: { 2023-08-01T19:56:15.892 INFO:teuthology.orchestra.run.smithi155.stdout: "description": "osd_op(client.4668.0:100941 5.e 5:736a6ac6:::benchmark_data_smithi006_114134_object100940:head [set-alloc-hint object_size 65536 write_size 65536,write 0~65536] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e37)", 2023-08-01T19:56:15.892 INFO:teuthology.orchestra.run.smithi155.stdout: "initiated_at": "2023-08-01T19:55:05.569750+0000", 2023-08-01T19:56:15.892 INFO:teuthology.orchestra.run.smithi155.stdout: "age": 70.183815065999994, 2023-08-01T19:56:15.892 INFO:teuthology.orchestra.run.smithi155.stdout: "duration": 0.065431331999999995, 2023-08-01T19:56:15.892 INFO:teuthology.orchestra.run.smithi155.stdout: "type_data": { 2023-08-01T19:56:15.892 INFO:teuthology.orchestra.run.smithi155.stdout: "flag_point": "commit sent; apply or cleanup", 2023-08-01T19:56:15.893 INFO:teuthology.orchestra.run.smithi155.stdout: "client_info": { 2023-08-01T19:56:15.893 INFO:teuthology.orchestra.run.smithi155.stdout: "client": "client.4668", 2023-08-01T19:56:15.893 INFO:teuthology.orchestra.run.smithi155.stdout: "client_addr": "172.21.15.6:0/1709472247", 2023-08-01T19:56:15.893 INFO:teuthology.orchestra.run.smithi155.stdout: "tid": 100941 2023-08-01T19:56:15.893 INFO:teuthology.orchestra.run.smithi155.stdout: }, 2023-08-01T19:56:15.893 INFO:teuthology.orchestra.run.smithi155.stdout: "events": [ 2023-08-01T19:56:15.893 INFO:teuthology.orchestra.run.smithi155.stdout: { 2023-08-01T19:56:15.894 INFO:teuthology.orchestra.run.smithi155.stdout: "event": "initiated", 2023-08-01T19:56:15.894 INFO:teuthology.orchestra.run.smithi155.stdout: "time": "2023-08-01T19:55:05.569750+0000", 2023-08-01T19:56:15.894 INFO:teuthology.orchestra.run.smithi155.stdout: "duration": 0 2023-08-01T19:56:15.894 INFO:teuthology.orchestra.run.smithi155.stdout: }, 2023-08-01T19:56:15.894 INFO:teuthology.orchestra.run.smithi155.stdout: { 2023-08-01T19:56:15.894 INFO:teuthology.orchestra.run.smithi155.stdout: "event": "throttled", 2023-08-01T19:56:15.894 INFO:teuthology.orchestra.run.smithi155.stdout: "time": "2023-08-01T19:55:05.569750+0000", 2023-08-01T19:56:15.895 INFO:teuthology.orchestra.run.smithi155.stdout: "duration": 0 2023-08-01T19:56:15.895 INFO:teuthology.orchestra.run.smithi155.stdout: }, 2023-08-01T19:56:15.895 INFO:teuthology.orchestra.run.smithi155.stdout: { 2023-08-01T19:56:15.895 INFO:teuthology.orchestra.run.smithi155.stdout: "event": "header_read", 2023-08-01T19:56:15.895 INFO:teuthology.orchestra.run.smithi155.stdout: "time": "2023-08-01T19:55:05.569749+0000", 2023-08-01T19:56:15.895 INFO:teuthology.orchestra.run.smithi155.stdout: "duration": 4294967295.999999 2023-08-01T19:56:15.895 INFO:teuthology.orchestra.run.smithi155.stdout: }, 2023-08-01T19:56:15.895 INFO:teuthology.orchestra.run.smithi155.stdout: { 2023-08-01T19:56:15.896 INFO:teuthology.orchestra.run.smithi155.stdout: "event": "all_read", 2023-08-01T19:56:15.896 INFO:teuthology.orchestra.run.smithi155.stdout: "time": "2023-08-01T19:55:05.569861+0000", 2023-08-01T19:56:15.896 INFO:teuthology.orchestra.run.smithi155.stdout: "duration": 0.000111333 2023-08-01T19:56:15.896 INFO:teuthology.orchestra.run.smithi155.stdout: }, 2023-08-01T19:56:15.896 INFO:teuthology.orchestra.run.smithi155.stdout: { 2023-08-01T19:56:15.896 INFO:teuthology.orchestra.run.smithi155.stdout: "event": "dispatched", 2023-08-01T19:56:15.896 INFO:teuthology.orchestra.run.smithi155.stdout: "time": "2023-08-01T19:55:05.569869+0000", 2023-08-01T19:56:15.897 INFO:teuthology.orchestra.run.smithi155.stdout: "duration": 8.8589999999999994e-06 2023-08-01T19:56:15.897 INFO:teuthology.orchestra.run.smithi155.stdout: }, 2023-08-01T19:56:15.897 INFO:teuthology.orchestra.run.smithi155.stdout: { 2023-08-01T19:56:15.897 INFO:teuthology.orchestra.run.smithi155.stdout: "event": "queued_for_pg", 2023-08-01T19:56:15.897 INFO:teuthology.orchestra.run.smithi155.stdout: "time": "2023-08-01T19:55:05.569874+0000", 2023-08-01T19:56:15.897 INFO:teuthology.orchestra.run.smithi155.stdout: "duration": 4.1679999999999997e-06 2023-08-01T19:56:15.897 INFO:teuthology.orchestra.run.smithi155.stdout: }, 2023-08-01T19:56:15.898 INFO:teuthology.orchestra.run.smithi155.stdout: { 2023-08-01T19:56:15.898 INFO:teuthology.orchestra.run.smithi155.stdout: "event": "reached_pg", 2023-08-01T19:56:15.898 INFO:teuthology.orchestra.run.smithi155.stdout: "time": "2023-08-01T19:55:05.569904+0000", 2023-08-01T19:56:15.898 INFO:teuthology.orchestra.run.smithi155.stdout: "duration": 3.0920999999999998e-05 2023-08-01T19:56:15.898 INFO:teuthology.orchestra.run.smithi155.stdout: }, 2023-08-01T19:56:15.898 INFO:teuthology.orchestra.run.smithi155.stdout: { 2023-08-01T19:56:15.898 INFO:teuthology.orchestra.run.smithi155.stdout: "event": "started", 2023-08-01T19:56:15.899 INFO:teuthology.orchestra.run.smithi155.stdout: "time": "2023-08-01T19:55:05.569998+0000", 2023-08-01T19:56:15.899 INFO:teuthology.orchestra.run.smithi155.stdout: "duration": 9.3086999999999998e-05 2023-08-01T19:56:15.899 INFO:teuthology.orchestra.run.smithi155.stdout: }, 2023-08-01T19:56:15.899 INFO:teuthology.orchestra.run.smithi155.stdout: { 2023-08-01T19:56:15.899 INFO:teuthology.orchestra.run.smithi155.stdout: "event": "waiting for subops from 0", 2023-08-01T19:56:15.899 INFO:teuthology.orchestra.run.smithi155.stdout: "time": "2023-08-01T19:55:05.570093+0000", 2023-08-01T19:56:15.899 INFO:teuthology.orchestra.run.smithi155.stdout: "duration": 9.5768999999999997e-05 2023-08-01T19:56:15.899 INFO:teuthology.orchestra.run.smithi155.stdout: }, 2023-08-01T19:56:15.900 INFO:teuthology.orchestra.run.smithi155.stdout: { 2023-08-01T19:56:15.900 INFO:teuthology.orchestra.run.smithi155.stdout: "event": "op_commit", 2023-08-01T19:56:15.900 INFO:teuthology.orchestra.run.smithi155.stdout: "time": "2023-08-01T19:55:05.572839+0000", 2023-08-01T19:56:15.900 INFO:teuthology.orchestra.run.smithi155.stdout: "duration": 0.0027460050000000001 2023-08-01T19:56:15.900 INFO:teuthology.orchestra.run.smithi155.stdout: }, 2023-08-01T19:56:15.900 INFO:teuthology.orchestra.run.smithi155.stdout: { 2023-08-01T19:56:15.900 INFO:teuthology.orchestra.run.smithi155.stdout: "event": "sub_op_commit_rec", 2023-08-01T19:56:15.901 INFO:teuthology.orchestra.run.smithi155.stdout: "time": "2023-08-01T19:55:05.635114+0000", 2023-08-01T19:56:15.901 INFO:teuthology.orchestra.run.smithi155.stdout: "duration": 0.062274297999999999 2023-08-01T19:56:15.901 INFO:teuthology.orchestra.run.smithi155.stdout: }, 2023-08-01T19:56:15.901 INFO:teuthology.orchestra.run.smithi155.stdout: { 2023-08-01T19:56:15.901 INFO:teuthology.orchestra.run.smithi155.stdout: "event": "commit_sent", 2023-08-01T19:56:15.901 INFO:teuthology.orchestra.run.smithi155.stdout: "time": "2023-08-01T19:55:05.635143+0000", 2023-08-01T19:56:15.901 INFO:teuthology.orchestra.run.smithi155.stdout: "duration": 2.9430000000000001e-05 2023-08-01T19:56:15.902 INFO:teuthology.orchestra.run.smithi155.stdout: }, 2023-08-01T19:56:15.902 INFO:teuthology.orchestra.run.smithi155.stdout: { 2023-08-01T19:56:15.902 INFO:teuthology.orchestra.run.smithi155.stdout: "event": "done", 2023-08-01T19:56:15.902 INFO:teuthology.orchestra.run.smithi155.stdout: "time": "2023-08-01T19:55:05.635181+0000", 2023-08-01T19:56:15.902 INFO:teuthology.orchestra.run.smithi155.stdout: "duration": 3.8352000000000001e-05 2023-08-01T19:56:15.902 INFO:teuthology.orchestra.run.smithi155.stdout: } 2023-08-01T19:56:15.902 INFO:teuthology.orchestra.run.smithi155.stdout: ] 2023-08-01T19:56:15.903 INFO:teuthology.orchestra.run.smithi155.stdout: } 2023-08-01T19:56:15.903 INFO:teuthology.orchestra.run.smithi155.stdout: }, 2023-08-01T19:56:15.903 INFO:teuthology.orchestra.run.smithi155.stdout: { 2023-08-01T19:56:15.903 INFO:teuthology.orchestra.run.smithi155.stdout: "description": "osd_op(client.4668.0:100945 5.e 5:73df68dd:::benchmark_data_smithi006_114134_object100944:head [set-alloc-hint object_size 65536 write_size 65536,write 0~65536] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e37)", 2023-08-01T19:56:15.903 INFO:teuthology.orchestra.run.smithi155.stdout: "initiated_at": "2023-08-01T19:55:05.576784+0000", 2023-08-01T19:56:15.903 INFO:teuthology.orchestra.run.smithi155.stdout: "age": 70.176781481000006, 2023-08-01T19:56:15.903 INFO:teuthology.orchestra.run.smithi155.stdout: "duration": 0.058512994999999998, 2023-08-01T19:56:15.904 INFO:teuthology.orchestra.run.smithi155.stdout: "type_data": { 2023-08-01T19:56:15.904 INFO:teuthology.orchestra.run.smithi155.stdout: "flag_point": "commit sent; apply or cleanup", 2023-08-01T19:56:15.904 INFO:teuthology.orchestra.run.smithi155.stdout: "client_info": { 2023-08-01T19:56:15.904 INFO:teuthology.orchestra.run.smithi155.stdout: "client": "client.4668", 2023-08-01T19:56:15.904 INFO:teuthology.orchestra.run.smithi155.stdout: "client_addr": "172.21.15.6:0/1709472247", 2023-08-01T19:56:15.904 INFO:teuthology.orchestra.run.smithi155.stdout: "tid": 100945 2023-08-01T19:56:15.904 INFO:teuthology.orchestra.run.smithi155.stdout: }, 2023-08-01T19:56:15.905 INFO:teuthology.orchestra.run.smithi155.stdout: "events": [ 2023-08-01T19:56:15.905 INFO:teuthology.orchestra.run.smithi155.stdout: { 2023-08-01T19:56:15.905 INFO:teuthology.orchestra.run.smithi155.stdout: "event": "initiated", 2023-08-01T19:56:15.905 INFO:teuthology.orchestra.run.smithi155.stdout: "time": "2023-08-01T19:55:05.576784+0000", 2023-08-01T19:56:15.905 INFO:teuthology.orchestra.run.smithi155.stdout: "duration": 0 2023-08-01T19:56:15.905 INFO:teuthology.orchestra.run.smithi155.stdout: }, 2023-08-01T19:56:15.905 INFO:teuthology.orchestra.run.smithi155.stdout: { 2023-08-01T19:56:15.905 INFO:teuthology.orchestra.run.smithi155.stdout: "event": "throttled", 2023-08-01T19:56:15.906 INFO:teuthology.orchestra.run.smithi155.stdout: "time": "2023-08-01T19:55:05.576784+0000", 2023-08-01T19:56:15.906 INFO:teuthology.orchestra.run.smithi155.stdout: "duration": 0 2023-08-01T19:56:15.906 INFO:teuthology.orchestra.run.smithi155.stdout: }, 2023-08-01T19:56:15.906 INFO:teuthology.orchestra.run.smithi155.stdout: { 2023-08-01T19:56:15.906 INFO:teuthology.orchestra.run.smithi155.stdout: "event": "header_read", 2023-08-01T19:56:15.906 INFO:teuthology.orchestra.run.smithi155.stdout: "time": "2023-08-01T19:55:05.576783+0000", 2023-08-01T19:56:15.906 INFO:teuthology.orchestra.run.smithi155.stdout: "duration": 4294967295.9999995 2023-08-01T19:56:15.907 INFO:teuthology.orchestra.run.smithi155.stdout: }, 2023-08-01T19:56:15.907 INFO:teuthology.orchestra.run.smithi155.stdout: { 2023-08-01T19:56:15.907 INFO:teuthology.orchestra.run.smithi155.stdout: "event": "all_read", 2023-08-01T19:56:15.907 INFO:teuthology.orchestra.run.smithi155.stdout: "time": "2023-08-01T19:55:05.576807+0000", 2023-08-01T19:56:15.907 INFO:teuthology.orchestra.run.smithi155.stdout: "duration": 2.3651000000000001e-05 2023-08-01T19:56:15.907 INFO:teuthology.orchestra.run.smithi155.stdout: }, 2023-08-01T19:56:15.907 INFO:teuthology.orchestra.run.smithi155.stdout: { 2023-08-01T19:56:15.908 INFO:teuthology.orchestra.run.smithi155.stdout: "event": "dispatched", 2023-08-01T19:56:15.908 INFO:teuthology.orchestra.run.smithi155.stdout: "time": "2023-08-01T19:55:05.576817+0000", 2023-08-01T19:56:15.908 INFO:teuthology.orchestra.run.smithi155.stdout: "duration": 9.9389999999999992e-06 2023-08-01T19:56:15.908 INFO:teuthology.orchestra.run.smithi155.stdout: }, 2023-08-01T19:56:15.908 INFO:teuthology.orchestra.run.smithi155.stdout: { 2023-08-01T19:56:15.908 INFO:teuthology.orchestra.run.smithi155.stdout: "event": "queued_for_pg", 2023-08-01T19:56:15.908 INFO:teuthology.orchestra.run.smithi155.stdout: "time": "2023-08-01T19:55:05.576820+0000", 2023-08-01T19:56:15.909 INFO:teuthology.orchestra.run.smithi155.stdout: "duration": 3.2619999999999999e-06 2023-08-01T19:56:15.909 INFO:teuthology.orchestra.run.smithi155.stdout: }, 2023-08-01T19:56:15.909 INFO:teuthology.orchestra.run.smithi155.stdout: { 2023-08-01T19:56:15.909 INFO:teuthology.orchestra.run.smithi155.stdout: "event": "reached_pg", 2023-08-01T19:56:15.909 INFO:teuthology.orchestra.run.smithi155.stdout: "time": "2023-08-01T19:55:05.576849+0000", 2023-08-01T19:56:15.909 INFO:teuthology.orchestra.run.smithi155.stdout: "duration": 2.8880000000000001e-05 2023-08-01T19:56:15.909 INFO:teuthology.orchestra.run.smithi155.stdout: }, 2023-08-01T19:56:15.909 INFO:teuthology.orchestra.run.smithi155.stdout: { 2023-08-01T19:56:15.910 INFO:teuthology.orchestra.run.smithi155.stdout: "event": "started", 2023-08-01T19:56:15.910 INFO:teuthology.orchestra.run.smithi155.stdout: "time": "2023-08-01T19:55:05.576940+0000", 2023-08-01T19:56:15.910 INFO:teuthology.orchestra.run.smithi155.stdout: "duration": 9.0570999999999997e-05 2023-08-01T19:56:15.910 INFO:teuthology.orchestra.run.smithi155.stdout: }, 2023-08-01T19:56:15.910 INFO:teuthology.orchestra.run.smithi155.stdout: { 2023-08-01T19:56:15.910 INFO:teuthology.orchestra.run.smithi155.stdout: "event": "waiting for subops from 0", 2023-08-01T19:56:15.910 INFO:teuthology.orchestra.run.smithi155.stdout: "time": "2023-08-01T19:55:05.577027+0000", 2023-08-01T19:56:15.911 INFO:teuthology.orchestra.run.smithi155.stdout: "duration": 8.7237999999999994e-05 2023-08-01T19:56:15.911 INFO:teuthology.orchestra.run.smithi155.stdout: }, 2023-08-01T19:56:15.911 INFO:teuthology.orchestra.run.smithi155.stdout: { 2023-08-01T19:56:15.911 INFO:teuthology.orchestra.run.smithi155.stdout: "event": "op_commit", 2023-08-01T19:56:15.911 INFO:teuthology.orchestra.run.smithi155.stdout: "time": "2023-08-01T19:55:05.579624+0000", 2023-08-01T19:56:15.911 INFO:teuthology.orchestra.run.smithi155.stdout: "duration": 0.0025971200000000001 2023-08-01T19:56:15.911 INFO:teuthology.orchestra.run.smithi155.stdout: }, 2023-08-01T19:56:15.912 INFO:teuthology.orchestra.run.smithi155.stdout: { 2023-08-01T19:56:15.912 INFO:teuthology.orchestra.run.smithi155.stdout: "event": "sub_op_commit_rec", 2023-08-01T19:56:15.912 INFO:teuthology.orchestra.run.smithi155.stdout: "time": "2023-08-01T19:55:05.635218+0000", 2023-08-01T19:56:15.912 INFO:teuthology.orchestra.run.smithi155.stdout: "duration": 0.055594487999999997 2023-08-01T19:56:15.912 INFO:teuthology.orchestra.run.smithi155.stdout: }, 2023-08-01T19:56:15.912 INFO:teuthology.orchestra.run.smithi155.stdout: { 2023-08-01T19:56:15.912 INFO:teuthology.orchestra.run.smithi155.stdout: "event": "commit_sent", 2023-08-01T19:56:15.913 INFO:teuthology.orchestra.run.smithi155.stdout: "time": "2023-08-01T19:55:05.635262+0000", 2023-08-01T19:56:15.913 INFO:teuthology.orchestra.run.smithi155.stdout: "duration": 4.3380999999999997e-05 2023-08-01T19:56:15.913 INFO:teuthology.orchestra.run.smithi155.stdout: }, 2023-08-01T19:56:15.913 INFO:teuthology.orchestra.run.smithi155.stdout: { 2023-08-01T19:56:15.913 INFO:teuthology.orchestra.run.smithi155.stdout: "event": "done", 2023-08-01T19:56:15.913 INFO:teuthology.orchestra.run.smithi155.stdout: "time": "2023-08-01T19:55:05.635297+0000", 2023-08-01T19:56:15.913 INFO:teuthology.orchestra.run.smithi155.stdout: "duration": 3.4842000000000003e-05 2023-08-01T19:56:15.914 INFO:teuthology.orchestra.run.smithi155.stdout: } 2023-08-01T19:56:15.914 INFO:teuthology.orchestra.run.smithi155.stdout: ] 2023-08-01T19:56:15.914 INFO:teuthology.orchestra.run.smithi155.stdout: } 2023-08-01T19:56:15.914 INFO:teuthology.orchestra.run.smithi155.stdout: }, 2023-08-01T19:56:15.914 INFO:teuthology.orchestra.run.smithi155.stdout: { 2023-08-01T19:56:15.914 INFO:teuthology.orchestra.run.smithi155.stdout: "description": "osd_op(client.4668.0:100947 5.4 5:23e8fc27:::benchmark_data_smithi006_114134_object100946:head [set-alloc-hint object_size 65536 write_size 65536,write 0~65536] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e37)", 2023-08-01T19:56:15.914 INFO:teuthology.orchestra.run.smithi155.stdout: "initiated_at": "2023-08-01T19:55:05.576840+0000", 2023-08-01T19:56:15.915 INFO:teuthology.orchestra.run.smithi155.stdout: "age": 70.176725426000004, 2023-08-01T19:56:15.915 INFO:teuthology.orchestra.run.smithi155.stdout: "duration": 0.058423127999999998, 2023-08-01T19:56:15.915 INFO:teuthology.orchestra.run.smithi155.stdout: "type_data": { 2023-08-01T19:56:15.915 INFO:teuthology.orchestra.run.smithi155.stdout: "flag_point": "commit sent; apply or cleanup", 2023-08-01T19:56:15.915 INFO:teuthology.orchestra.run.smithi155.stdout: "client_info": { 2023-08-01T19:56:15.915 INFO:teuthology.orchestra.run.smithi155.stdout: "client": "client.4668", 2023-08-01T19:56:15.915 INFO:teuthology.orchestra.run.smithi155.stdout: "client_addr": "172.21.15.6:0/1709472247", 2023-08-01T19:56:15.915 INFO:teuthology.orchestra.run.smithi155.stdout: "tid": 100947 2023-08-01T19:56:15.916 INFO:teuthology.orchestra.run.smithi155.stdout: }, 2023-08-01T19:56:15.916 INFO:teuthology.orchestra.run.smithi155.stdout: "events": [ 2023-08-01T19:56:15.916 INFO:teuthology.orchestra.run.smithi155.stdout: { 2023-08-01T19:56:15.916 INFO:teuthology.orchestra.run.smithi155.stdout: "event": "initiated", 2023-08-01T19:56:15.916 INFO:teuthology.orchestra.run.smithi155.stdout: "time": "2023-08-01T19:55:05.576840+0000", 2023-08-01T19:56:15.916 INFO:teuthology.orchestra.run.smithi155.stdout: "duration": 0 2023-08-01T19:56:15.916 INFO:teuthology.orchestra.run.smithi155.stdout: }, 2023-08-01T19:56:15.917 INFO:teuthology.orchestra.run.smithi155.stdout: { 2023-08-01T19:56:15.917 INFO:teuthology.orchestra.run.smithi155.stdout: "event": "throttled", 2023-08-01T19:56:15.917 INFO:teuthology.orchestra.run.smithi155.stdout: "time": "2023-08-01T19:55:05.576840+0000", 2023-08-01T19:56:15.917 INFO:teuthology.orchestra.run.smithi155.stdout: "duration": 0 2023-08-01T19:56:15.917 INFO:teuthology.orchestra.run.smithi155.stdout: }, 2023-08-01T19:56:15.917 INFO:teuthology.orchestra.run.smithi155.stdout: { 2023-08-01T19:56:15.917 INFO:teuthology.orchestra.run.smithi155.stdout: "event": "header_read", 2023-08-01T19:56:15.918 INFO:teuthology.orchestra.run.smithi155.stdout: "time": "2023-08-01T19:55:05.576839+0000", 2023-08-01T19:56:15.918 INFO:teuthology.orchestra.run.smithi155.stdout: "duration": 4294967295.9999995 2023-08-01T19:56:15.918 INFO:teuthology.orchestra.run.smithi155.stdout: }, 2023-08-01T19:56:15.918 INFO:teuthology.orchestra.run.smithi155.stdout: { 2023-08-01T19:56:15.918 INFO:teuthology.orchestra.run.smithi155.stdout: "event": "all_read", 2023-08-01T19:56:15.918 INFO:teuthology.orchestra.run.smithi155.stdout: "time": "2023-08-01T19:55:05.576893+0000", 2023-08-01T19:56:15.918 INFO:teuthology.orchestra.run.smithi155.stdout: "duration": 5.3893000000000001e-05 2023-08-01T19:56:15.919 INFO:teuthology.orchestra.run.smithi155.stdout: }, 2023-08-01T19:56:15.919 INFO:teuthology.orchestra.run.smithi155.stdout: { 2023-08-01T19:56:15.919 INFO:teuthology.orchestra.run.smithi155.stdout: "event": "dispatched", 2023-08-01T19:56:15.919 INFO:teuthology.orchestra.run.smithi155.stdout: "time": "2023-08-01T19:55:05.576902+0000", 2023-08-01T19:56:15.919 INFO:teuthology.orchestra.run.smithi155.stdout: "duration": 8.7520000000000002e-06 2023-08-01T19:56:15.919 INFO:teuthology.orchestra.run.smithi155.stdout: }, 2023-08-01T19:56:15.919 INFO:teuthology.orchestra.run.smithi155.stdout: { 2023-08-01T19:56:15.920 INFO:teuthology.orchestra.run.smithi155.stdout: "event": "queued_for_pg", 2023-08-01T19:56:15.920 INFO:teuthology.orchestra.run.smithi155.stdout: "time": "2023-08-01T19:55:05.576905+0000", 2023-08-01T19:56:15.920 INFO:teuthology.orchestra.run.smithi155.stdout: "duration": 3.01e-06 2023-08-01T19:56:15.920 INFO:teuthology.orchestra.run.smithi155.stdout: }, 2023-08-01T19:56:15.920 INFO:teuthology.orchestra.run.smithi155.stdout: { 2023-08-01T19:56:15.920 INFO:teuthology.orchestra.run.smithi155.stdout: "event": "reached_pg", 2023-08-01T19:56:15.920 INFO:teuthology.orchestra.run.smithi155.stdout: "time": "2023-08-01T19:55:05.579641+0000", 2023-08-01T19:56:15.920 INFO:teuthology.orchestra.run.smithi155.stdout: "duration": 0.0027366880000000001 2023-08-01T19:56:15.921 INFO:teuthology.orchestra.run.smithi155.stdout: }, 2023-08-01T19:56:15.921 INFO:teuthology.orchestra.run.smithi155.stdout: { 2023-08-01T19:56:15.921 INFO:teuthology.orchestra.run.smithi155.stdout: "event": "started", 2023-08-01T19:56:15.921 INFO:teuthology.orchestra.run.smithi155.stdout: "time": "2023-08-01T19:55:05.579734+0000", 2023-08-01T19:56:15.921 INFO:teuthology.orchestra.run.smithi155.stdout: "duration": 9.2590000000000006e-05 2023-08-01T19:56:15.921 INFO:teuthology.orchestra.run.smithi155.stdout: }, 2023-08-01T19:56:15.921 INFO:teuthology.orchestra.run.smithi155.stdout: { 2023-08-01T19:56:15.922 INFO:teuthology.orchestra.run.smithi155.stdout: "event": "waiting for subops from 0", 2023-08-01T19:56:15.922 INFO:teuthology.orchestra.run.smithi155.stdout: "time": "2023-08-01T19:55:05.579825+0000", 2023-08-01T19:56:15.922 INFO:teuthology.orchestra.run.smithi155.stdout: "duration": 9.0964999999999994e-05 2023-08-01T19:56:15.922 INFO:teuthology.orchestra.run.smithi155.stdout: }, 2023-08-01T19:56:15.922 INFO:teuthology.orchestra.run.smithi155.stdout: { 2023-08-01T19:56:15.922 INFO:teuthology.orchestra.run.smithi155.stdout: "event": "op_commit", 2023-08-01T19:56:15.922 INFO:teuthology.orchestra.run.smithi155.stdout: "time": "2023-08-01T19:55:05.585041+0000", 2023-08-01T19:56:15.923 INFO:teuthology.orchestra.run.smithi155.stdout: "duration": 0.0052159670000000002 2023-08-01T19:56:15.923 INFO:teuthology.orchestra.run.smithi155.stdout: }, 2023-08-01T19:56:15.923 INFO:teuthology.orchestra.run.smithi155.stdout: { 2023-08-01T19:56:15.923 INFO:teuthology.orchestra.run.smithi155.stdout: "event": "sub_op_commit_rec", 2023-08-01T19:56:15.923 INFO:teuthology.orchestra.run.smithi155.stdout: "time": "2023-08-01T19:55:05.635199+0000", 2023-08-01T19:56:15.923 INFO:teuthology.orchestra.run.smithi155.stdout: "duration": 0.050158023000000003 2023-08-01T19:56:15.923 INFO:teuthology.orchestra.run.smithi155.stdout: }, 2023-08-01T19:56:15.924 INFO:teuthology.orchestra.run.smithi155.stdout: { 2023-08-01T19:56:15.924 INFO:teuthology.orchestra.run.smithi155.stdout: "event": "commit_sent", 2023-08-01T19:56:15.924 INFO:teuthology.orchestra.run.smithi155.stdout: "time": "2023-08-01T19:55:05.635227+0000", 2023-08-01T19:56:15.924 INFO:teuthology.orchestra.run.smithi155.stdout: "duration": 2.7821e-05 2023-08-01T19:56:15.924 INFO:teuthology.orchestra.run.smithi155.stdout: }, 2023-08-01T19:56:15.924 INFO:teuthology.orchestra.run.smithi155.stdout: { 2023-08-01T19:56:15.924 INFO:teuthology.orchestra.run.smithi155.stdout: "event": "done", 2023-08-01T19:56:15.925 INFO:teuthology.orchestra.run.smithi155.stdout: "time": "2023-08-01T19:55:05.635263+0000", 2023-08-01T19:56:15.925 INFO:teuthology.orchestra.run.smithi155.stdout: "duration": 3.6081000000000002e-05 2023-08-01T19:56:15.925 INFO:teuthology.orchestra.run.smithi155.stdout: } 2023-08-01T19:56:15.925 INFO:teuthology.orchestra.run.smithi155.stdout: ] 2023-08-01T19:56:15.925 INFO:teuthology.orchestra.run.smithi155.stdout: } 2023-08-01T19:56:15.925 INFO:teuthology.orchestra.run.smithi155.stdout: }, 2023-08-01T19:56:15.925 INFO:teuthology.orchestra.run.smithi155.stdout: { 2023-08-01T19:56:15.925 INFO:teuthology.orchestra.run.smithi155.stdout: "description": "osd_op(client.4668.0:197408 5.d 5:bbda375a:::benchmark_data_smithi006_114134_object63747:head [delete] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e61)", 2023-08-01T19:56:15.926 INFO:teuthology.orchestra.run.smithi155.stdout: "initiated_at": "2023-08-01T19:55:58.559714+0000", 2023-08-01T19:56:15.926 INFO:teuthology.orchestra.run.smithi155.stdout: "age": 17.193851438999999, 2023-08-01T19:56:15.926 INFO:teuthology.orchestra.run.smithi155.stdout: "duration": 1.047043671, 2023-08-01T19:56:15.926 INFO:teuthology.orchestra.run.smithi155.stdout: "type_data": { 2023-08-01T19:56:15.926 INFO:teuthology.orchestra.run.smithi155.stdout: "flag_point": "commit sent; apply or cleanup", 2023-08-01T19:56:15.926 INFO:teuthology.orchestra.run.smithi155.stdout: "client_info": { 2023-08-01T19:56:15.926 INFO:teuthology.orchestra.run.smithi155.stdout: "client": "client.4668", 2023-08-01T19:56:15.927 INFO:teuthology.orchestra.run.smithi155.stdout: "client_addr": "172.21.15.6:0/1709472247", 2023-08-01T19:56:15.927 INFO:teuthology.orchestra.run.smithi155.stdout: "tid": 197408 2023-08-01T19:56:15.927 INFO:teuthology.orchestra.run.smithi155.stdout: }, 2023-08-01T19:56:15.927 INFO:teuthology.orchestra.run.smithi155.stdout: "events": [ 2023-08-01T19:56:15.927 INFO:teuthology.orchestra.run.smithi155.stdout: { 2023-08-01T19:56:15.927 INFO:teuthology.orchestra.run.smithi155.stdout: "event": "initiated", 2023-08-01T19:56:15.927 INFO:teuthology.orchestra.run.smithi155.stdout: "time": "2023-08-01T19:55:58.559714+0000", 2023-08-01T19:56:15.928 INFO:teuthology.orchestra.run.smithi155.stdout: "duration": 0 2023-08-01T19:56:15.928 INFO:teuthology.orchestra.run.smithi155.stdout: }, 2023-08-01T19:56:15.928 INFO:teuthology.orchestra.run.smithi155.stdout: { 2023-08-01T19:56:15.928 INFO:teuthology.orchestra.run.smithi155.stdout: "event": "throttled", 2023-08-01T19:56:15.928 INFO:teuthology.orchestra.run.smithi155.stdout: "time": "2023-08-01T19:55:58.559714+0000", 2023-08-01T19:56:15.928 INFO:teuthology.orchestra.run.smithi155.stdout: "duration": 0 2023-08-01T19:56:15.928 INFO:teuthology.orchestra.run.smithi155.stdout: }, 2023-08-01T19:56:15.929 INFO:teuthology.orchestra.run.smithi155.stdout: { 2023-08-01T19:56:15.929 INFO:teuthology.orchestra.run.smithi155.stdout: "event": "header_read", 2023-08-01T19:56:15.929 INFO:teuthology.orchestra.run.smithi155.stdout: "time": "2023-08-01T19:55:58.559713+0000", 2023-08-01T19:56:15.929 INFO:teuthology.orchestra.run.smithi155.stdout: "duration": 4294967295.999999 2023-08-01T19:56:15.929 INFO:teuthology.orchestra.run.smithi155.stdout: }, 2023-08-01T19:56:15.929 INFO:teuthology.orchestra.run.smithi155.stdout: { 2023-08-01T19:56:15.929 INFO:teuthology.orchestra.run.smithi155.stdout: "event": "all_read", 2023-08-01T19:56:15.930 INFO:teuthology.orchestra.run.smithi155.stdout: "time": "2023-08-01T19:55:58.559717+0000", 2023-08-01T19:56:15.930 INFO:teuthology.orchestra.run.smithi155.stdout: "duration": 4.2860000000000001e-06 2023-08-01T19:56:15.930 INFO:teuthology.orchestra.run.smithi155.stdout: }, 2023-08-01T19:56:15.930 INFO:teuthology.orchestra.run.smithi155.stdout: { 2023-08-01T19:56:15.930 INFO:teuthology.orchestra.run.smithi155.stdout: "event": "dispatched", 2023-08-01T19:56:15.930 INFO:teuthology.orchestra.run.smithi155.stdout: "time": "2023-08-01T19:55:58.559774+0000", 2023-08-01T19:56:15.930 INFO:teuthology.orchestra.run.smithi155.stdout: "duration": 5.6508999999999997e-05 2023-08-01T19:56:15.931 INFO:teuthology.orchestra.run.smithi155.stdout: }, 2023-08-01T19:56:15.931 INFO:teuthology.orchestra.run.smithi155.stdout: { 2023-08-01T19:56:15.931 INFO:teuthology.orchestra.run.smithi155.stdout: "event": "queued_for_pg", 2023-08-01T19:56:15.931 INFO:teuthology.orchestra.run.smithi155.stdout: "time": "2023-08-01T19:55:58.559781+0000", 2023-08-01T19:56:15.931 INFO:teuthology.orchestra.run.smithi155.stdout: "duration": 7.1829999999999997e-06 2023-08-01T19:56:15.931 INFO:teuthology.orchestra.run.smithi155.stdout: }, 2023-08-01T19:56:15.931 INFO:teuthology.orchestra.run.smithi155.stdout: { 2023-08-01T19:56:15.932 INFO:teuthology.orchestra.run.smithi155.stdout: "event": "reached_pg", 2023-08-01T19:56:15.932 INFO:teuthology.orchestra.run.smithi155.stdout: "time": "2023-08-01T19:55:58.571621+0000", 2023-08-01T19:56:15.932 INFO:teuthology.orchestra.run.smithi155.stdout: "duration": 0.011840603999999999 2023-08-01T19:56:15.932 INFO:teuthology.orchestra.run.smithi155.stdout: }, 2023-08-01T19:56:15.932 INFO:teuthology.orchestra.run.smithi155.stdout: { 2023-08-01T19:56:15.932 INFO:teuthology.orchestra.run.smithi155.stdout: "event": "waiting for peered", 2023-08-01T19:56:15.932 INFO:teuthology.orchestra.run.smithi155.stdout: "time": "2023-08-01T19:55:58.571630+0000", 2023-08-01T19:56:15.933 INFO:teuthology.orchestra.run.smithi155.stdout: "duration": 8.9770000000000006e-06 2023-08-01T19:56:15.933 INFO:teuthology.orchestra.run.smithi155.stdout: }, 2023-08-01T19:56:15.933 INFO:teuthology.orchestra.run.smithi155.stdout: { 2023-08-01T19:56:15.933 INFO:teuthology.orchestra.run.smithi155.stdout: "event": "reached_pg", 2023-08-01T19:56:15.933 INFO:teuthology.orchestra.run.smithi155.stdout: "time": "2023-08-01T19:55:59.601300+0000", 2023-08-01T19:56:15.933 INFO:teuthology.orchestra.run.smithi155.stdout: "duration": 1.0296694989999999 2023-08-01T19:56:15.933 INFO:teuthology.orchestra.run.smithi155.stdout: }, 2023-08-01T19:56:15.934 INFO:teuthology.orchestra.run.smithi155.stdout: { 2023-08-01T19:56:15.934 INFO:teuthology.orchestra.run.smithi155.stdout: "event": "started", 2023-08-01T19:56:15.934 INFO:teuthology.orchestra.run.smithi155.stdout: "time": "2023-08-01T19:55:59.601448+0000", 2023-08-01T19:56:15.934 INFO:teuthology.orchestra.run.smithi155.stdout: "duration": 0.00014828399999999999 2023-08-01T19:56:15.934 INFO:teuthology.orchestra.run.smithi155.stdout: }, 2023-08-01T19:56:15.934 INFO:teuthology.orchestra.run.smithi155.stdout: { 2023-08-01T19:56:15.934 INFO:teuthology.orchestra.run.smithi155.stdout: "event": "op_commit", 2023-08-01T19:56:15.935 INFO:teuthology.orchestra.run.smithi155.stdout: "time": "2023-08-01T19:55:59.606616+0000", 2023-08-01T19:56:15.935 INFO:teuthology.orchestra.run.smithi155.stdout: "duration": 0.0051679769999999998 2023-08-01T19:56:15.935 INFO:teuthology.orchestra.run.smithi155.stdout: }, 2023-08-01T19:56:15.935 INFO:teuthology.orchestra.run.smithi155.stdout: { 2023-08-01T19:56:15.935 INFO:teuthology.orchestra.run.smithi155.stdout: "event": "commit_sent", 2023-08-01T19:56:15.935 INFO:teuthology.orchestra.run.smithi155.stdout: "time": "2023-08-01T19:55:59.606662+0000", 2023-08-01T19:56:15.935 INFO:teuthology.orchestra.run.smithi155.stdout: "duration": 4.5843000000000001e-05 2023-08-01T19:56:15.936 INFO:teuthology.orchestra.run.smithi155.stdout: }, 2023-08-01T19:56:15.936 INFO:teuthology.orchestra.run.smithi155.stdout: { 2023-08-01T19:56:15.936 INFO:teuthology.orchestra.run.smithi155.stdout: "event": "done", 2023-08-01T19:56:15.936 INFO:teuthology.orchestra.run.smithi155.stdout: "time": "2023-08-01T19:55:59.606757+0000", 2023-08-01T19:56:15.936 INFO:teuthology.orchestra.run.smithi155.stdout: "duration": 9.5373999999999999e-05 2023-08-01T19:56:15.936 INFO:teuthology.orchestra.run.smithi155.stdout: } 2023-08-01T19:56:15.936 INFO:teuthology.orchestra.run.smithi155.stdout: ] 2023-08-01T19:56:15.937 INFO:teuthology.orchestra.run.smithi155.stdout: } 2023-08-01T19:56:15.937 INFO:teuthology.orchestra.run.smithi155.stdout: }, 2023-08-01T19:56:15.937 INFO:teuthology.orchestra.run.smithi155.stdout: { 2023-08-01T19:56:15.937 INFO:teuthology.orchestra.run.smithi155.stdout: "description": "osd_op(client.4668.0:197416 5.d 5:bd99e66d:::benchmark_data_smithi006_114134_object63755:head [delete] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e62)", 2023-08-01T19:56:15.937 INFO:teuthology.orchestra.run.smithi155.stdout: "initiated_at": "2023-08-01T19:55:58.577369+0000", 2023-08-01T19:56:15.937 INFO:teuthology.orchestra.run.smithi155.stdout: "age": 17.176196462, 2023-08-01T19:56:15.937 INFO:teuthology.orchestra.run.smithi155.stdout: "duration": 1.0300980120000001, 2023-08-01T19:56:15.937 INFO:teuthology.orchestra.run.smithi155.stdout: "type_data": { 2023-08-01T19:56:15.938 INFO:teuthology.orchestra.run.smithi155.stdout: "flag_point": "commit sent; apply or cleanup", 2023-08-01T19:56:15.938 INFO:teuthology.orchestra.run.smithi155.stdout: "client_info": { 2023-08-01T19:56:15.938 INFO:teuthology.orchestra.run.smithi155.stdout: "client": "client.4668", 2023-08-01T19:56:15.938 INFO:teuthology.orchestra.run.smithi155.stdout: "client_addr": "172.21.15.6:0/1709472247", 2023-08-01T19:56:15.938 INFO:teuthology.orchestra.run.smithi155.stdout: "tid": 197416 2023-08-01T19:56:15.938 INFO:teuthology.orchestra.run.smithi155.stdout: }, 2023-08-01T19:56:15.938 INFO:teuthology.orchestra.run.smithi155.stdout: "events": [ 2023-08-01T19:56:15.939 INFO:teuthology.orchestra.run.smithi155.stdout: { 2023-08-01T19:56:15.939 INFO:teuthology.orchestra.run.smithi155.stdout: "event": "initiated", 2023-08-01T19:56:15.939 INFO:teuthology.orchestra.run.smithi155.stdout: "time": "2023-08-01T19:55:58.577369+0000", 2023-08-01T19:56:15.939 INFO:teuthology.orchestra.run.smithi155.stdout: "duration": 0 2023-08-01T19:56:15.939 INFO:teuthology.orchestra.run.smithi155.stdout: }, 2023-08-01T19:56:15.939 INFO:teuthology.orchestra.run.smithi155.stdout: { 2023-08-01T19:56:15.939 INFO:teuthology.orchestra.run.smithi155.stdout: "event": "throttled", 2023-08-01T19:56:15.940 INFO:teuthology.orchestra.run.smithi155.stdout: "time": "2023-08-01T19:55:58.577369+0000", 2023-08-01T19:56:15.940 INFO:teuthology.orchestra.run.smithi155.stdout: "duration": 0 2023-08-01T19:56:15.940 INFO:teuthology.orchestra.run.smithi155.stdout: }, 2023-08-01T19:56:15.940 INFO:teuthology.orchestra.run.smithi155.stdout: { 2023-08-01T19:56:15.940 INFO:teuthology.orchestra.run.smithi155.stdout: "event": "header_read", 2023-08-01T19:56:15.940 INFO:teuthology.orchestra.run.smithi155.stdout: "time": "2023-08-01T19:55:58.577368+0000", 2023-08-01T19:56:15.940 INFO:teuthology.orchestra.run.smithi155.stdout: "duration": 4294967295.9999995 2023-08-01T19:56:15.941 INFO:teuthology.orchestra.run.smithi155.stdout: }, 2023-08-01T19:56:15.941 INFO:teuthology.orchestra.run.smithi155.stdout: { 2023-08-01T19:56:15.941 INFO:teuthology.orchestra.run.smithi155.stdout: "event": "all_read", 2023-08-01T19:56:15.941 INFO:teuthology.orchestra.run.smithi155.stdout: "time": "2023-08-01T19:55:58.577370+0000", 2023-08-01T19:56:15.941 INFO:teuthology.orchestra.run.smithi155.stdout: "duration": 2.1150000000000001e-06 2023-08-01T19:56:15.941 INFO:teuthology.orchestra.run.smithi155.stdout: }, 2023-08-01T19:56:15.941 INFO:teuthology.orchestra.run.smithi155.stdout: { 2023-08-01T19:56:15.941 INFO:teuthology.orchestra.run.smithi155.stdout: "event": "dispatched", 2023-08-01T19:56:15.942 INFO:teuthology.orchestra.run.smithi155.stdout: "time": "2023-08-01T19:55:58.577377+0000", 2023-08-01T19:56:15.942 INFO:teuthology.orchestra.run.smithi155.stdout: "duration": 6.6610000000000003e-06 2023-08-01T19:56:15.942 INFO:teuthology.orchestra.run.smithi155.stdout: }, 2023-08-01T19:56:15.942 INFO:teuthology.orchestra.run.smithi155.stdout: { 2023-08-01T19:56:15.942 INFO:teuthology.orchestra.run.smithi155.stdout: "event": "queued_for_pg", 2023-08-01T19:56:15.942 INFO:teuthology.orchestra.run.smithi155.stdout: "time": "2023-08-01T19:55:58.577380+0000", 2023-08-01T19:56:15.942 INFO:teuthology.orchestra.run.smithi155.stdout: "duration": 2.7360000000000001e-06 2023-08-01T19:56:15.943 INFO:teuthology.orchestra.run.smithi155.stdout: }, 2023-08-01T19:56:15.943 INFO:teuthology.orchestra.run.smithi155.stdout: { 2023-08-01T19:56:15.943 INFO:teuthology.orchestra.run.smithi155.stdout: "event": "reached_pg", 2023-08-01T19:56:15.943 INFO:teuthology.orchestra.run.smithi155.stdout: "time": "2023-08-01T19:55:58.577405+0000", 2023-08-01T19:56:15.943 INFO:teuthology.orchestra.run.smithi155.stdout: "duration": 2.4929000000000001e-05 2023-08-01T19:56:15.943 INFO:teuthology.orchestra.run.smithi155.stdout: }, 2023-08-01T19:56:15.943 INFO:teuthology.orchestra.run.smithi155.stdout: { 2023-08-01T19:56:15.944 INFO:teuthology.orchestra.run.smithi155.stdout: "event": "waiting for peered", 2023-08-01T19:56:15.944 INFO:teuthology.orchestra.run.smithi155.stdout: "time": "2023-08-01T19:55:58.577409+0000", 2023-08-01T19:56:15.944 INFO:teuthology.orchestra.run.smithi155.stdout: "duration": 4.0799999999999999e-06 2023-08-01T19:56:15.944 INFO:teuthology.orchestra.run.smithi155.stdout: }, 2023-08-01T19:56:15.944 INFO:teuthology.orchestra.run.smithi155.stdout: { 2023-08-01T19:56:15.944 INFO:teuthology.orchestra.run.smithi155.stdout: "event": "reached_pg", 2023-08-01T19:56:15.944 INFO:teuthology.orchestra.run.smithi155.stdout: "time": "2023-08-01T19:55:59.603639+0000", 2023-08-01T19:56:15.945 INFO:teuthology.orchestra.run.smithi155.stdout: "duration": 1.0262299349999999 2023-08-01T19:56:15.945 INFO:teuthology.orchestra.run.smithi155.stdout: }, 2023-08-01T19:56:15.945 INFO:teuthology.orchestra.run.smithi155.stdout: { 2023-08-01T19:56:15.945 INFO:teuthology.orchestra.run.smithi155.stdout: "event": "started", 2023-08-01T19:56:15.945 INFO:teuthology.orchestra.run.smithi155.stdout: "time": "2023-08-01T19:55:59.603772+0000", 2023-08-01T19:56:15.945 INFO:teuthology.orchestra.run.smithi155.stdout: "duration": 0.000133153 2023-08-01T19:56:15.945 INFO:teuthology.orchestra.run.smithi155.stdout: }, 2023-08-01T19:56:15.946 INFO:teuthology.orchestra.run.smithi155.stdout: { 2023-08-01T19:56:15.946 INFO:teuthology.orchestra.run.smithi155.stdout: "event": "op_commit", 2023-08-01T19:56:15.946 INFO:teuthology.orchestra.run.smithi155.stdout: "time": "2023-08-01T19:55:59.607354+0000", 2023-08-01T19:56:15.946 INFO:teuthology.orchestra.run.smithi155.stdout: "duration": 0.0035819599999999999 2023-08-01T19:56:15.946 INFO:teuthology.orchestra.run.smithi155.stdout: }, 2023-08-01T19:56:15.946 INFO:teuthology.orchestra.run.smithi155.stdout: { 2023-08-01T19:56:15.946 INFO:teuthology.orchestra.run.smithi155.stdout: "event": "commit_sent", 2023-08-01T19:56:15.947 INFO:teuthology.orchestra.run.smithi155.stdout: "time": "2023-08-01T19:55:59.607396+0000", 2023-08-01T19:56:15.947 INFO:teuthology.orchestra.run.smithi155.stdout: "duration": 4.2423999999999999e-05 2023-08-01T19:56:15.947 INFO:teuthology.orchestra.run.smithi155.stdout: }, 2023-08-01T19:56:15.947 INFO:teuthology.orchestra.run.smithi155.stdout: { 2023-08-01T19:56:15.947 INFO:teuthology.orchestra.run.smithi155.stdout: "event": "done", 2023-08-01T19:56:15.947 INFO:teuthology.orchestra.run.smithi155.stdout: "time": "2023-08-01T19:55:59.607467+0000", 2023-08-01T19:56:15.947 INFO:teuthology.orchestra.run.smithi155.stdout: "duration": 7.0360999999999999e-05 2023-08-01T19:56:15.948 INFO:teuthology.orchestra.run.smithi155.stdout: } 2023-08-01T19:56:15.948 INFO:teuthology.orchestra.run.smithi155.stdout: ] 2023-08-01T19:56:15.948 INFO:teuthology.orchestra.run.smithi155.stdout: } 2023-08-01T19:56:15.948 INFO:teuthology.orchestra.run.smithi155.stdout: }, 2023-08-01T19:56:15.948 INFO:teuthology.orchestra.run.smithi155.stdout: { 2023-08-01T19:56:15.948 INFO:teuthology.orchestra.run.smithi155.stdout: "description": "osd_op(client.4668.0:197419 5.d 5:be7dc7c9:::benchmark_data_smithi006_114134_object63758:head [delete] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e62)", 2023-08-01T19:56:15.948 INFO:teuthology.orchestra.run.smithi155.stdout: "initiated_at": "2023-08-01T19:55:58.580223+0000", 2023-08-01T19:56:15.949 INFO:teuthology.orchestra.run.smithi155.stdout: "age": 17.173342511000001, 2023-08-01T19:56:15.949 INFO:teuthology.orchestra.run.smithi155.stdout: "duration": 1.0286139439999999, 2023-08-01T19:56:15.949 INFO:teuthology.orchestra.run.smithi155.stdout: "type_data": { 2023-08-01T19:56:15.949 INFO:teuthology.orchestra.run.smithi155.stdout: "flag_point": "commit sent; apply or cleanup", 2023-08-01T19:56:15.949 INFO:teuthology.orchestra.run.smithi155.stdout: "client_info": { 2023-08-01T19:56:15.949 INFO:teuthology.orchestra.run.smithi155.stdout: "client": "client.4668", 2023-08-01T19:56:15.949 INFO:teuthology.orchestra.run.smithi155.stdout: "client_addr": "172.21.15.6:0/1709472247", 2023-08-01T19:56:15.950 INFO:teuthology.orchestra.run.smithi155.stdout: "tid": 197419 2023-08-01T19:56:15.950 INFO:teuthology.orchestra.run.smithi155.stdout: }, 2023-08-01T19:56:15.950 INFO:teuthology.orchestra.run.smithi155.stdout: "events": [ 2023-08-01T19:56:15.950 INFO:teuthology.orchestra.run.smithi155.stdout: { 2023-08-01T19:56:15.950 INFO:teuthology.orchestra.run.smithi155.stdout: "event": "initiated", 2023-08-01T19:56:15.950 INFO:teuthology.orchestra.run.smithi155.stdout: "time": "2023-08-01T19:55:58.580223+0000", 2023-08-01T19:56:15.950 INFO:teuthology.orchestra.run.smithi155.stdout: "duration": 0 2023-08-01T19:56:15.951 INFO:teuthology.orchestra.run.smithi155.stdout: }, 2023-08-01T19:56:15.951 INFO:teuthology.orchestra.run.smithi155.stdout: { 2023-08-01T19:56:15.951 INFO:teuthology.orchestra.run.smithi155.stdout: "event": "throttled", 2023-08-01T19:56:15.951 INFO:teuthology.orchestra.run.smithi155.stdout: "time": "2023-08-01T19:55:58.580223+0000", 2023-08-01T19:56:15.951 INFO:teuthology.orchestra.run.smithi155.stdout: "duration": 0 2023-08-01T19:56:15.951 INFO:teuthology.orchestra.run.smithi155.stdout: }, 2023-08-01T19:56:15.951 INFO:teuthology.orchestra.run.smithi155.stdout: { 2023-08-01T19:56:15.952 INFO:teuthology.orchestra.run.smithi155.stdout: "event": "header_read", 2023-08-01T19:56:15.952 INFO:teuthology.orchestra.run.smithi155.stdout: "time": "2023-08-01T19:55:58.580222+0000", 2023-08-01T19:56:15.952 INFO:teuthology.orchestra.run.smithi155.stdout: "duration": 4294967295.9999995 2023-08-01T19:56:15.952 INFO:teuthology.orchestra.run.smithi155.stdout: }, 2023-08-01T19:56:15.952 INFO:teuthology.orchestra.run.smithi155.stdout: { 2023-08-01T19:56:15.952 INFO:teuthology.orchestra.run.smithi155.stdout: "event": "all_read", 2023-08-01T19:56:15.952 INFO:teuthology.orchestra.run.smithi155.stdout: "time": "2023-08-01T19:55:58.580225+0000", 2023-08-01T19:56:15.953 INFO:teuthology.orchestra.run.smithi155.stdout: "duration": 3.2820000000000001e-06 2023-08-01T19:56:15.953 INFO:teuthology.orchestra.run.smithi155.stdout: }, 2023-08-01T19:56:15.953 INFO:teuthology.orchestra.run.smithi155.stdout: { 2023-08-01T19:56:15.953 INFO:teuthology.orchestra.run.smithi155.stdout: "event": "dispatched", 2023-08-01T19:56:15.953 INFO:teuthology.orchestra.run.smithi155.stdout: "time": "2023-08-01T19:55:58.580233+0000", 2023-08-01T19:56:15.953 INFO:teuthology.orchestra.run.smithi155.stdout: "duration": 7.34e-06 2023-08-01T19:56:15.953 INFO:teuthology.orchestra.run.smithi155.stdout: }, 2023-08-01T19:56:15.954 INFO:teuthology.orchestra.run.smithi155.stdout: { 2023-08-01T19:56:15.954 INFO:teuthology.orchestra.run.smithi155.stdout: "event": "queued_for_pg", 2023-08-01T19:56:15.954 INFO:teuthology.orchestra.run.smithi155.stdout: "time": "2023-08-01T19:55:58.580236+0000", 2023-08-01T19:56:15.954 INFO:teuthology.orchestra.run.smithi155.stdout: "duration": 3.473e-06 2023-08-01T19:56:15.954 INFO:teuthology.orchestra.run.smithi155.stdout: }, 2023-08-01T19:56:15.954 INFO:teuthology.orchestra.run.smithi155.stdout: { 2023-08-01T19:56:15.954 INFO:teuthology.orchestra.run.smithi155.stdout: "event": "reached_pg", 2023-08-01T19:56:15.955 INFO:teuthology.orchestra.run.smithi155.stdout: "time": "2023-08-01T19:55:58.580267+0000", 2023-08-01T19:56:15.955 INFO:teuthology.orchestra.run.smithi155.stdout: "duration": 3.0479000000000001e-05 2023-08-01T19:56:15.955 INFO:teuthology.orchestra.run.smithi155.stdout: }, 2023-08-01T19:56:15.955 INFO:teuthology.orchestra.run.smithi155.stdout: { 2023-08-01T19:56:15.955 INFO:teuthology.orchestra.run.smithi155.stdout: "event": "waiting for peered", 2023-08-01T19:56:15.955 INFO:teuthology.orchestra.run.smithi155.stdout: "time": "2023-08-01T19:55:58.580272+0000", 2023-08-01T19:56:15.955 INFO:teuthology.orchestra.run.smithi155.stdout: "duration": 5.011e-06 2023-08-01T19:56:15.956 INFO:teuthology.orchestra.run.smithi155.stdout: }, 2023-08-01T19:56:15.956 INFO:teuthology.orchestra.run.smithi155.stdout: { 2023-08-01T19:56:15.956 INFO:teuthology.orchestra.run.smithi155.stdout: "event": "reached_pg", 2023-08-01T19:56:15.956 INFO:teuthology.orchestra.run.smithi155.stdout: "time": "2023-08-01T19:55:59.604970+0000", 2023-08-01T19:56:15.956 INFO:teuthology.orchestra.run.smithi155.stdout: "duration": 1.0246984189999999 2023-08-01T19:56:15.956 INFO:teuthology.orchestra.run.smithi155.stdout: }, 2023-08-01T19:56:15.956 INFO:teuthology.orchestra.run.smithi155.stdout: { 2023-08-01T19:56:15.957 INFO:teuthology.orchestra.run.smithi155.stdout: "event": "started", 2023-08-01T19:56:15.957 INFO:teuthology.orchestra.run.smithi155.stdout: "time": "2023-08-01T19:55:59.605085+0000", 2023-08-01T19:56:15.957 INFO:teuthology.orchestra.run.smithi155.stdout: "duration": 0.00011531000000000001 2023-08-01T19:56:15.957 INFO:teuthology.orchestra.run.smithi155.stdout: }, 2023-08-01T19:56:15.957 INFO:teuthology.orchestra.run.smithi155.stdout: { 2023-08-01T19:56:15.957 INFO:teuthology.orchestra.run.smithi155.stdout: "event": "op_commit", 2023-08-01T19:56:15.957 INFO:teuthology.orchestra.run.smithi155.stdout: "time": "2023-08-01T19:55:59.608733+0000", 2023-08-01T19:56:15.958 INFO:teuthology.orchestra.run.smithi155.stdout: "duration": 0.0036478090000000001 2023-08-01T19:56:15.958 INFO:teuthology.orchestra.run.smithi155.stdout: }, 2023-08-01T19:56:15.958 INFO:teuthology.orchestra.run.smithi155.stdout: { 2023-08-01T19:56:15.958 INFO:teuthology.orchestra.run.smithi155.stdout: "event": "commit_sent", 2023-08-01T19:56:15.958 INFO:teuthology.orchestra.run.smithi155.stdout: "time": "2023-08-01T19:55:59.608771+0000", 2023-08-01T19:56:15.958 INFO:teuthology.orchestra.run.smithi155.stdout: "duration": 3.8033e-05 2023-08-01T19:56:15.958 INFO:teuthology.orchestra.run.smithi155.stdout: }, 2023-08-01T19:56:15.959 INFO:teuthology.orchestra.run.smithi155.stdout: { 2023-08-01T19:56:15.959 INFO:teuthology.orchestra.run.smithi155.stdout: "event": "done", 2023-08-01T19:56:15.959 INFO:teuthology.orchestra.run.smithi155.stdout: "time": "2023-08-01T19:55:59.608837+0000", 2023-08-01T19:56:15.959 INFO:teuthology.orchestra.run.smithi155.stdout: "duration": 6.5364000000000006e-05 2023-08-01T19:56:15.959 INFO:teuthology.orchestra.run.smithi155.stdout: } 2023-08-01T19:56:15.959 INFO:teuthology.orchestra.run.smithi155.stdout: ] 2023-08-01T19:56:15.959 INFO:teuthology.orchestra.run.smithi155.stdout: } 2023-08-01T19:56:15.960 INFO:teuthology.orchestra.run.smithi155.stdout: }, 2023-08-01T19:56:15.960 INFO:teuthology.orchestra.run.smithi155.stdout: { 2023-08-01T19:56:15.960 INFO:teuthology.orchestra.run.smithi155.stdout: "description": "osd_op(client.4668.0:197420 5.9 5:92a2efe5:::benchmark_data_smithi006_114134_object63759:head [delete] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e62)", 2023-08-01T19:56:15.960 INFO:teuthology.orchestra.run.smithi155.stdout: "initiated_at": "2023-08-01T19:55:58.582230+0000", 2023-08-01T19:56:15.960 INFO:teuthology.orchestra.run.smithi155.stdout: "age": 17.171335201000002, 2023-08-01T19:56:15.960 INFO:teuthology.orchestra.run.smithi155.stdout: "duration": 1.0095353739999999, 2023-08-01T19:56:15.960 INFO:teuthology.orchestra.run.smithi155.stdout: "type_data": { 2023-08-01T19:56:15.961 INFO:teuthology.orchestra.run.smithi155.stdout: "flag_point": "commit sent; apply or cleanup", 2023-08-01T19:56:15.961 INFO:teuthology.orchestra.run.smithi155.stdout: "client_info": { 2023-08-01T19:56:15.961 INFO:teuthology.orchestra.run.smithi155.stdout: "client": "client.4668", 2023-08-01T19:56:15.961 INFO:teuthology.orchestra.run.smithi155.stdout: "client_addr": "172.21.15.6:0/1709472247", 2023-08-01T19:56:15.961 INFO:teuthology.orchestra.run.smithi155.stdout: "tid": 197420 2023-08-01T19:56:15.961 INFO:teuthology.orchestra.run.smithi155.stdout: }, 2023-08-01T19:56:15.961 INFO:teuthology.orchestra.run.smithi155.stdout: "events": [ 2023-08-01T19:56:15.961 INFO:teuthology.orchestra.run.smithi155.stdout: { 2023-08-01T19:56:15.962 INFO:teuthology.orchestra.run.smithi155.stdout: "event": "initiated", 2023-08-01T19:56:15.962 INFO:teuthology.orchestra.run.smithi155.stdout: "time": "2023-08-01T19:55:58.582230+0000", 2023-08-01T19:56:15.962 INFO:teuthology.orchestra.run.smithi155.stdout: "duration": 0 2023-08-01T19:56:15.962 INFO:teuthology.orchestra.run.smithi155.stdout: }, 2023-08-01T19:56:15.962 INFO:teuthology.orchestra.run.smithi155.stdout: { 2023-08-01T19:56:15.962 INFO:teuthology.orchestra.run.smithi155.stdout: "event": "throttled", 2023-08-01T19:56:15.962 INFO:teuthology.orchestra.run.smithi155.stdout: "time": "2023-08-01T19:55:58.582230+0000", 2023-08-01T19:56:15.963 INFO:teuthology.orchestra.run.smithi155.stdout: "duration": 0 2023-08-01T19:56:15.963 INFO:teuthology.orchestra.run.smithi155.stdout: }, 2023-08-01T19:56:15.963 INFO:teuthology.orchestra.run.smithi155.stdout: { 2023-08-01T19:56:15.963 INFO:teuthology.orchestra.run.smithi155.stdout: "event": "header_read", 2023-08-01T19:56:15.963 INFO:teuthology.orchestra.run.smithi155.stdout: "time": "2023-08-01T19:55:58.582229+0000", 2023-08-01T19:56:15.963 INFO:teuthology.orchestra.run.smithi155.stdout: "duration": 4294967295.9999995 2023-08-01T19:56:15.963 INFO:teuthology.orchestra.run.smithi155.stdout: }, 2023-08-01T19:56:15.964 INFO:teuthology.orchestra.run.smithi155.stdout: { 2023-08-01T19:56:15.964 INFO:teuthology.orchestra.run.smithi155.stdout: "event": "all_read", 2023-08-01T19:56:15.964 INFO:teuthology.orchestra.run.smithi155.stdout: "time": "2023-08-01T19:55:58.582233+0000", 2023-08-01T19:56:15.964 INFO:teuthology.orchestra.run.smithi155.stdout: "duration": 3.7869999999999999e-06 2023-08-01T19:56:15.964 INFO:teuthology.orchestra.run.smithi155.stdout: }, 2023-08-01T19:56:15.964 INFO:teuthology.orchestra.run.smithi155.stdout: { 2023-08-01T19:56:15.964 INFO:teuthology.orchestra.run.smithi155.stdout: "event": "dispatched", 2023-08-01T19:56:15.965 INFO:teuthology.orchestra.run.smithi155.stdout: "time": "2023-08-01T19:55:58.582241+0000", 2023-08-01T19:56:15.965 INFO:teuthology.orchestra.run.smithi155.stdout: "duration": 7.6909999999999997e-06 2023-08-01T19:56:15.965 INFO:teuthology.orchestra.run.smithi155.stdout: }, 2023-08-01T19:56:15.965 INFO:teuthology.orchestra.run.smithi155.stdout: { 2023-08-01T19:56:15.965 INFO:teuthology.orchestra.run.smithi155.stdout: "event": "queued_for_pg", 2023-08-01T19:56:15.965 INFO:teuthology.orchestra.run.smithi155.stdout: "time": "2023-08-01T19:55:58.582244+0000", 2023-08-01T19:56:15.965 INFO:teuthology.orchestra.run.smithi155.stdout: "duration": 3.6770000000000001e-06 2023-08-01T19:56:15.966 INFO:teuthology.orchestra.run.smithi155.stdout: }, 2023-08-01T19:56:15.966 INFO:teuthology.orchestra.run.smithi155.stdout: { 2023-08-01T19:56:15.966 INFO:teuthology.orchestra.run.smithi155.stdout: "event": "reached_pg", 2023-08-01T19:56:15.966 INFO:teuthology.orchestra.run.smithi155.stdout: "time": "2023-08-01T19:55:58.582274+0000", 2023-08-01T19:56:15.966 INFO:teuthology.orchestra.run.smithi155.stdout: "duration": 3.0074e-05 2023-08-01T19:56:15.966 INFO:teuthology.orchestra.run.smithi155.stdout: }, 2023-08-01T19:56:15.966 INFO:teuthology.orchestra.run.smithi155.stdout: { 2023-08-01T19:56:15.967 INFO:teuthology.orchestra.run.smithi155.stdout: "event": "waiting for peered", 2023-08-01T19:56:15.967 INFO:teuthology.orchestra.run.smithi155.stdout: "time": "2023-08-01T19:55:58.582281+0000", 2023-08-01T19:56:15.967 INFO:teuthology.orchestra.run.smithi155.stdout: "duration": 6.297e-06 2023-08-01T19:56:15.967 INFO:teuthology.orchestra.run.smithi155.stdout: }, 2023-08-01T19:56:15.967 INFO:teuthology.orchestra.run.smithi155.stdout: { 2023-08-01T19:56:15.967 INFO:teuthology.orchestra.run.smithi155.stdout: "event": "reached_pg", 2023-08-01T19:56:15.967 INFO:teuthology.orchestra.run.smithi155.stdout: "time": "2023-08-01T19:55:59.586809+0000", 2023-08-01T19:56:15.967 INFO:teuthology.orchestra.run.smithi155.stdout: "duration": 1.0045281720000001 2023-08-01T19:56:15.968 INFO:teuthology.orchestra.run.smithi155.stdout: }, 2023-08-01T19:56:15.968 INFO:teuthology.orchestra.run.smithi155.stdout: { 2023-08-01T19:56:15.968 INFO:teuthology.orchestra.run.smithi155.stdout: "event": "started", 2023-08-01T19:56:15.968 INFO:teuthology.orchestra.run.smithi155.stdout: "time": "2023-08-01T19:55:59.586910+0000", 2023-08-01T19:56:15.968 INFO:teuthology.orchestra.run.smithi155.stdout: "duration": 0.000100898 2023-08-01T19:56:15.968 INFO:teuthology.orchestra.run.smithi155.stdout: }, 2023-08-01T19:56:15.968 INFO:teuthology.orchestra.run.smithi155.stdout: { 2023-08-01T19:56:15.969 INFO:teuthology.orchestra.run.smithi155.stdout: "event": "op_commit", 2023-08-01T19:56:15.969 INFO:teuthology.orchestra.run.smithi155.stdout: "time": "2023-08-01T19:55:59.591679+0000", 2023-08-01T19:56:15.969 INFO:teuthology.orchestra.run.smithi155.stdout: "duration": 0.004769471 2023-08-01T19:56:15.969 INFO:teuthology.orchestra.run.smithi155.stdout: }, 2023-08-01T19:56:15.969 INFO:teuthology.orchestra.run.smithi155.stdout: { 2023-08-01T19:56:15.969 INFO:teuthology.orchestra.run.smithi155.stdout: "event": "commit_sent", 2023-08-01T19:56:15.969 INFO:teuthology.orchestra.run.smithi155.stdout: "time": "2023-08-01T19:55:59.591721+0000", 2023-08-01T19:56:15.970 INFO:teuthology.orchestra.run.smithi155.stdout: "duration": 4.1953000000000003e-05 2023-08-01T19:56:15.970 INFO:teuthology.orchestra.run.smithi155.stdout: }, 2023-08-01T19:56:15.970 INFO:teuthology.orchestra.run.smithi155.stdout: { 2023-08-01T19:56:15.970 INFO:teuthology.orchestra.run.smithi155.stdout: "event": "done", 2023-08-01T19:56:15.970 INFO:teuthology.orchestra.run.smithi155.stdout: "time": "2023-08-01T19:55:59.591765+0000", 2023-08-01T19:56:15.970 INFO:teuthology.orchestra.run.smithi155.stdout: "duration": 4.4030999999999999e-05 2023-08-01T19:56:15.970 INFO:teuthology.orchestra.run.smithi155.stdout: } 2023-08-01T19:56:15.971 INFO:teuthology.orchestra.run.smithi155.stdout: ] 2023-08-01T19:56:15.971 INFO:teuthology.orchestra.run.smithi155.stdout: } 2023-08-01T19:56:15.971 INFO:teuthology.orchestra.run.smithi155.stdout: } 2023-08-01T19:56:15.971 INFO:teuthology.orchestra.run.smithi155.stdout: ] 2023-08-01T19:56:15.971 INFO:teuthology.orchestra.run.smithi155.stdout:} 2023-08-01T19:56:15.972 INFO:tasks.ceph.osd.0.smithi008.stderr:2023-08-01T19:56:15.970+0000 7f16a58f4700 -1 received signal: Hangup from /usr/bin/python3 /bin/daemon-helper kill ceph-osd -f --cluster ceph -i 0 (PID: 111179) UID: 0 2023-08-01T19:56:15.973 DEBUG:teuthology.orchestra.run.smithi008:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 30 ceph --cluster ceph --admin-daemon /var/run/ceph/ceph-osd.0.asok dump_ops_in_flight 2023-08-01T19:56:16.073 INFO:tasks.ceph.osd.0.smithi008.stderr:2023-08-01T19:56:16.071+0000 7f16a58f4700 -1 received signal: Hangup from /usr/bin/python3 /bin/daemon-helper kill ceph-osd -f --cluster ceph -i 0 (PID: 111179) UID: 0 2023-08-01T19:56:16.166 INFO:teuthology.orchestra.run.smithi008.stdout:{ 2023-08-01T19:56:16.167 INFO:teuthology.orchestra.run.smithi008.stdout: "ops": [ 2023-08-01T19:56:16.167 INFO:teuthology.orchestra.run.smithi008.stdout: { 2023-08-01T19:56:16.167 INFO:teuthology.orchestra.run.smithi008.stdout: "description": "osd_op(client.4668.0:231500 5.a 5:5554226e:::benchmark_data_smithi006_114134_object97839:head [delete] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e69)", 2023-08-01T19:56:16.167 INFO:teuthology.orchestra.run.smithi008.stdout: "initiated_at": "2023-08-01T19:56:16.151677+0000", 2023-08-01T19:56:16.167 INFO:teuthology.orchestra.run.smithi008.stdout: "age": 0.011948548999999999, 2023-08-01T19:56:16.167 INFO:teuthology.orchestra.run.smithi008.stdout: "duration": 0.011968698999999999, 2023-08-01T19:56:16.167 INFO:teuthology.orchestra.run.smithi008.stdout: "type_data": { 2023-08-01T19:56:16.168 INFO:teuthology.orchestra.run.smithi008.stdout: "flag_point": "waiting for sub ops", 2023-08-01T19:56:16.168 INFO:teuthology.orchestra.run.smithi008.stdout: "client_info": { 2023-08-01T19:56:16.168 INFO:teuthology.orchestra.run.smithi008.stdout: "client": "client.4668", 2023-08-01T19:56:16.168 INFO:teuthology.orchestra.run.smithi008.stdout: "client_addr": "172.21.15.6:0/1709472247", 2023-08-01T19:56:16.168 INFO:teuthology.orchestra.run.smithi008.stdout: "tid": 231500 2023-08-01T19:56:16.168 INFO:teuthology.orchestra.run.smithi008.stdout: }, 2023-08-01T19:56:16.168 INFO:teuthology.orchestra.run.smithi008.stdout: "events": [ 2023-08-01T19:56:16.168 INFO:teuthology.orchestra.run.smithi008.stdout: { 2023-08-01T19:56:16.169 INFO:teuthology.orchestra.run.smithi008.stdout: "event": "initiated", 2023-08-01T19:56:16.169 INFO:teuthology.orchestra.run.smithi008.stdout: "time": "2023-08-01T19:56:16.151677+0000", 2023-08-01T19:56:16.169 INFO:teuthology.orchestra.run.smithi008.stdout: "duration": 0 2023-08-01T19:56:16.169 INFO:teuthology.orchestra.run.smithi008.stdout: }, 2023-08-01T19:56:16.169 INFO:teuthology.orchestra.run.smithi008.stdout: { 2023-08-01T19:56:16.169 INFO:teuthology.orchestra.run.smithi008.stdout: "event": "throttled", 2023-08-01T19:56:16.169 INFO:teuthology.orchestra.run.smithi008.stdout: "time": "2023-08-01T19:56:16.151677+0000", 2023-08-01T19:56:16.170 INFO:teuthology.orchestra.run.smithi008.stdout: "duration": 0 2023-08-01T19:56:16.170 INFO:teuthology.orchestra.run.smithi008.stdout: }, 2023-08-01T19:56:16.170 INFO:teuthology.orchestra.run.smithi008.stdout: { 2023-08-01T19:56:16.170 INFO:teuthology.orchestra.run.smithi008.stdout: "event": "header_read", 2023-08-01T19:56:16.170 INFO:teuthology.orchestra.run.smithi008.stdout: "time": "2023-08-01T19:56:16.151677+0000", 2023-08-01T19:56:16.170 INFO:teuthology.orchestra.run.smithi008.stdout: "duration": 4294967295.999999 2023-08-01T19:56:16.170 INFO:teuthology.orchestra.run.smithi008.stdout: }, 2023-08-01T19:56:16.170 INFO:teuthology.orchestra.run.smithi008.stdout: { 2023-08-01T19:56:16.171 INFO:teuthology.orchestra.run.smithi008.stdout: "event": "all_read", 2023-08-01T19:56:16.171 INFO:teuthology.orchestra.run.smithi008.stdout: "time": "2023-08-01T19:56:16.151681+0000", 2023-08-01T19:56:16.171 INFO:teuthology.orchestra.run.smithi008.stdout: "duration": 4.121e-06 2023-08-01T19:56:16.171 INFO:teuthology.orchestra.run.smithi008.stdout: }, 2023-08-01T19:56:16.171 INFO:teuthology.orchestra.run.smithi008.stdout: { 2023-08-01T19:56:16.171 INFO:teuthology.orchestra.run.smithi008.stdout: "event": "dispatched", 2023-08-01T19:56:16.171 INFO:teuthology.orchestra.run.smithi008.stdout: "time": "2023-08-01T19:56:16.151689+0000", 2023-08-01T19:56:16.171 INFO:teuthology.orchestra.run.smithi008.stdout: "duration": 8.4619999999999996e-06 2023-08-01T19:56:16.172 INFO:teuthology.orchestra.run.smithi008.stdout: }, 2023-08-01T19:56:16.172 INFO:teuthology.orchestra.run.smithi008.stdout: { 2023-08-01T19:56:16.172 INFO:teuthology.orchestra.run.smithi008.stdout: "event": "queued_for_pg", 2023-08-01T19:56:16.172 INFO:teuthology.orchestra.run.smithi008.stdout: "time": "2023-08-01T19:56:16.151697+0000", 2023-08-01T19:56:16.172 INFO:teuthology.orchestra.run.smithi008.stdout: "duration": 7.559e-06 2023-08-01T19:56:16.172 INFO:teuthology.orchestra.run.smithi008.stdout: }, 2023-08-01T19:56:16.172 INFO:teuthology.orchestra.run.smithi008.stdout: { 2023-08-01T19:56:16.172 INFO:teuthology.orchestra.run.smithi008.stdout: "event": "reached_pg", 2023-08-01T19:56:16.173 INFO:teuthology.orchestra.run.smithi008.stdout: "time": "2023-08-01T19:56:16.154807+0000", 2023-08-01T19:56:16.173 INFO:teuthology.orchestra.run.smithi008.stdout: "duration": 0.0031099859999999999 2023-08-01T19:56:16.173 INFO:teuthology.orchestra.run.smithi008.stdout: }, 2023-08-01T19:56:16.173 INFO:teuthology.orchestra.run.smithi008.stdout: { 2023-08-01T19:56:16.173 INFO:teuthology.orchestra.run.smithi008.stdout: "event": "started", 2023-08-01T19:56:16.173 INFO:teuthology.orchestra.run.smithi008.stdout: "time": "2023-08-01T19:56:16.154939+0000", 2023-08-01T19:56:16.173 INFO:teuthology.orchestra.run.smithi008.stdout: "duration": 0.00013207400000000001 2023-08-01T19:56:16.174 INFO:teuthology.orchestra.run.smithi008.stdout: }, 2023-08-01T19:56:16.174 INFO:teuthology.orchestra.run.smithi008.stdout: { 2023-08-01T19:56:16.174 INFO:teuthology.orchestra.run.smithi008.stdout: "event": "waiting for subops from 2", 2023-08-01T19:56:16.174 INFO:teuthology.orchestra.run.smithi008.stdout: "time": "2023-08-01T19:56:16.155057+0000", 2023-08-01T19:56:16.174 INFO:teuthology.orchestra.run.smithi008.stdout: "duration": 0.00011826499999999999 2023-08-01T19:56:16.174 INFO:teuthology.orchestra.run.smithi008.stdout: }, 2023-08-01T19:56:16.174 INFO:teuthology.orchestra.run.smithi008.stdout: { 2023-08-01T19:56:16.174 INFO:teuthology.orchestra.run.smithi008.stdout: "event": "sub_op_commit_rec", 2023-08-01T19:56:16.175 INFO:teuthology.orchestra.run.smithi008.stdout: "time": "2023-08-01T19:56:16.160817+0000", 2023-08-01T19:56:16.175 INFO:teuthology.orchestra.run.smithi008.stdout: "duration": 0.0057604539999999999 2023-08-01T19:56:16.175 INFO:teuthology.orchestra.run.smithi008.stdout: } 2023-08-01T19:56:16.175 INFO:teuthology.orchestra.run.smithi008.stdout: ] 2023-08-01T19:56:16.175 INFO:teuthology.orchestra.run.smithi008.stdout: } 2023-08-01T19:56:16.175 INFO:teuthology.orchestra.run.smithi008.stdout: }, 2023-08-01T19:56:16.175 INFO:teuthology.orchestra.run.smithi008.stdout: { 2023-08-01T19:56:16.175 INFO:teuthology.orchestra.run.smithi008.stdout: "description": "osd_op(client.4668.0:231501 5.5 5:af2d4115:::benchmark_data_smithi006_114134_object97840:head [delete] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e69)", 2023-08-01T19:56:16.176 INFO:teuthology.orchestra.run.smithi008.stdout: "initiated_at": "2023-08-01T19:56:16.154544+0000", 2023-08-01T19:56:16.176 INFO:teuthology.orchestra.run.smithi008.stdout: "age": 0.0090817780000000004, 2023-08-01T19:56:16.176 INFO:teuthology.orchestra.run.smithi008.stdout: "duration": 0.0091561579999999993, 2023-08-01T19:56:16.176 INFO:teuthology.orchestra.run.smithi008.stdout: "type_data": { 2023-08-01T19:56:16.176 INFO:teuthology.orchestra.run.smithi008.stdout: "flag_point": "started", 2023-08-01T19:56:16.176 INFO:teuthology.orchestra.run.smithi008.stdout: "client_info": { 2023-08-01T19:56:16.176 INFO:teuthology.orchestra.run.smithi008.stdout: "client": "client.4668", 2023-08-01T19:56:16.176 INFO:teuthology.orchestra.run.smithi008.stdout: "client_addr": "172.21.15.6:0/1709472247", 2023-08-01T19:56:16.177 INFO:teuthology.orchestra.run.smithi008.stdout: "tid": 231501 2023-08-01T19:56:16.177 INFO:teuthology.orchestra.run.smithi008.stdout: }, 2023-08-01T19:56:16.177 INFO:teuthology.orchestra.run.smithi008.stdout: "events": [ 2023-08-01T19:56:16.177 INFO:teuthology.orchestra.run.smithi008.stdout: { 2023-08-01T19:56:16.177 INFO:teuthology.orchestra.run.smithi008.stdout: "event": "initiated", 2023-08-01T19:56:16.177 INFO:teuthology.orchestra.run.smithi008.stdout: "time": "2023-08-01T19:56:16.154544+0000", 2023-08-01T19:56:16.177 INFO:teuthology.orchestra.run.smithi008.stdout: "duration": 0 2023-08-01T19:56:16.177 INFO:teuthology.orchestra.run.smithi008.stdout: }, 2023-08-01T19:56:16.178 INFO:teuthology.orchestra.run.smithi008.stdout: { 2023-08-01T19:56:16.178 INFO:teuthology.orchestra.run.smithi008.stdout: "event": "throttled", 2023-08-01T19:56:16.178 INFO:teuthology.orchestra.run.smithi008.stdout: "time": "2023-08-01T19:56:16.154544+0000", 2023-08-01T19:56:16.178 INFO:teuthology.orchestra.run.smithi008.stdout: "duration": 0 2023-08-01T19:56:16.178 INFO:teuthology.orchestra.run.smithi008.stdout: }, 2023-08-01T19:56:16.178 INFO:teuthology.orchestra.run.smithi008.stdout: { 2023-08-01T19:56:16.178 INFO:teuthology.orchestra.run.smithi008.stdout: "event": "header_read", 2023-08-01T19:56:16.178 INFO:teuthology.orchestra.run.smithi008.stdout: "time": "2023-08-01T19:56:16.154543+0000", 2023-08-01T19:56:16.179 INFO:teuthology.orchestra.run.smithi008.stdout: "duration": 4294967295.999999 2023-08-01T19:56:16.179 INFO:teuthology.orchestra.run.smithi008.stdout: }, 2023-08-01T19:56:16.179 INFO:teuthology.orchestra.run.smithi008.stdout: { 2023-08-01T19:56:16.179 INFO:teuthology.orchestra.run.smithi008.stdout: "event": "all_read", 2023-08-01T19:56:16.179 INFO:teuthology.orchestra.run.smithi008.stdout: "time": "2023-08-01T19:56:16.154548+0000", 2023-08-01T19:56:16.179 INFO:teuthology.orchestra.run.smithi008.stdout: "duration": 4.7829999999999998e-06 2023-08-01T19:56:16.180 INFO:teuthology.orchestra.run.smithi008.stdout: }, 2023-08-01T19:56:16.180 INFO:teuthology.orchestra.run.smithi008.stdout: { 2023-08-01T19:56:16.180 INFO:teuthology.orchestra.run.smithi008.stdout: "event": "dispatched", 2023-08-01T19:56:16.180 INFO:teuthology.orchestra.run.smithi008.stdout: "time": "2023-08-01T19:56:16.154559+0000", 2023-08-01T19:56:16.180 INFO:teuthology.orchestra.run.smithi008.stdout: "duration": 1.0349e-05 2023-08-01T19:56:16.180 INFO:teuthology.orchestra.run.smithi008.stdout: }, 2023-08-01T19:56:16.180 INFO:teuthology.orchestra.run.smithi008.stdout: { 2023-08-01T19:56:16.181 INFO:teuthology.orchestra.run.smithi008.stdout: "event": "queued_for_pg", 2023-08-01T19:56:16.181 INFO:teuthology.orchestra.run.smithi008.stdout: "time": "2023-08-01T19:56:16.154565+0000", 2023-08-01T19:56:16.181 INFO:teuthology.orchestra.run.smithi008.stdout: "duration": 6.9269999999999999e-06 2023-08-01T19:56:16.181 INFO:teuthology.orchestra.run.smithi008.stdout: }, 2023-08-01T19:56:16.181 INFO:teuthology.orchestra.run.smithi008.stdout: { 2023-08-01T19:56:16.181 INFO:teuthology.orchestra.run.smithi008.stdout: "event": "reached_pg", 2023-08-01T19:56:16.181 INFO:teuthology.orchestra.run.smithi008.stdout: "time": "2023-08-01T19:56:16.154613+0000", 2023-08-01T19:56:16.181 INFO:teuthology.orchestra.run.smithi008.stdout: "duration": 4.7580000000000002e-05 2023-08-01T19:56:16.182 INFO:teuthology.orchestra.run.smithi008.stdout: }, 2023-08-01T19:56:16.182 INFO:teuthology.orchestra.run.smithi008.stdout: { 2023-08-01T19:56:16.182 INFO:teuthology.orchestra.run.smithi008.stdout: "event": "started", 2023-08-01T19:56:16.182 INFO:teuthology.orchestra.run.smithi008.stdout: "time": "2023-08-01T19:56:16.154707+0000", 2023-08-01T19:56:16.182 INFO:teuthology.orchestra.run.smithi008.stdout: "duration": 9.3863000000000006e-05 2023-08-01T19:56:16.182 INFO:teuthology.orchestra.run.smithi008.stdout: } 2023-08-01T19:56:16.182 INFO:teuthology.orchestra.run.smithi008.stdout: ] 2023-08-01T19:56:16.183 INFO:teuthology.orchestra.run.smithi008.stdout: } 2023-08-01T19:56:16.183 INFO:teuthology.orchestra.run.smithi008.stdout: }, 2023-08-01T19:56:16.183 INFO:teuthology.orchestra.run.smithi008.stdout: { 2023-08-01T19:56:16.183 INFO:teuthology.orchestra.run.smithi008.stdout: "description": "osd_op(client.4668.0:231503 5.5 5:acda13c2:::benchmark_data_smithi006_114134_object97842:head [delete] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e69)", 2023-08-01T19:56:16.183 INFO:teuthology.orchestra.run.smithi008.stdout: "initiated_at": "2023-08-01T19:56:16.156047+0000", 2023-08-01T19:56:16.183 INFO:teuthology.orchestra.run.smithi008.stdout: "age": 0.0075793199999999996, 2023-08-01T19:56:16.183 INFO:teuthology.orchestra.run.smithi008.stdout: "duration": 0.0077208900000000002, 2023-08-01T19:56:16.183 INFO:teuthology.orchestra.run.smithi008.stdout: "type_data": { 2023-08-01T19:56:16.184 INFO:teuthology.orchestra.run.smithi008.stdout: "flag_point": "started", 2023-08-01T19:56:16.184 INFO:teuthology.orchestra.run.smithi008.stdout: "client_info": { 2023-08-01T19:56:16.184 INFO:teuthology.orchestra.run.smithi008.stdout: "client": "client.4668", 2023-08-01T19:56:16.184 INFO:teuthology.orchestra.run.smithi008.stdout: "client_addr": "172.21.15.6:0/1709472247", 2023-08-01T19:56:16.184 INFO:teuthology.orchestra.run.smithi008.stdout: "tid": 231503 2023-08-01T19:56:16.184 INFO:teuthology.orchestra.run.smithi008.stdout: }, 2023-08-01T19:56:16.184 INFO:teuthology.orchestra.run.smithi008.stdout: "events": [ 2023-08-01T19:56:16.185 INFO:teuthology.orchestra.run.smithi008.stdout: { 2023-08-01T19:56:16.185 INFO:teuthology.orchestra.run.smithi008.stdout: "event": "initiated", 2023-08-01T19:56:16.185 INFO:teuthology.orchestra.run.smithi008.stdout: "time": "2023-08-01T19:56:16.156047+0000", 2023-08-01T19:56:16.185 INFO:teuthology.orchestra.run.smithi008.stdout: "duration": 0 2023-08-01T19:56:16.185 INFO:teuthology.orchestra.run.smithi008.stdout: }, 2023-08-01T19:56:16.185 INFO:teuthology.orchestra.run.smithi008.stdout: { 2023-08-01T19:56:16.185 INFO:teuthology.orchestra.run.smithi008.stdout: "event": "throttled", 2023-08-01T19:56:16.185 INFO:teuthology.orchestra.run.smithi008.stdout: "time": "2023-08-01T19:56:16.156047+0000", 2023-08-01T19:56:16.186 INFO:teuthology.orchestra.run.smithi008.stdout: "duration": 0 2023-08-01T19:56:16.186 INFO:teuthology.orchestra.run.smithi008.stdout: }, 2023-08-01T19:56:16.186 INFO:teuthology.orchestra.run.smithi008.stdout: { 2023-08-01T19:56:16.186 INFO:teuthology.orchestra.run.smithi008.stdout: "event": "header_read", 2023-08-01T19:56:16.186 INFO:teuthology.orchestra.run.smithi008.stdout: "time": "2023-08-01T19:56:16.156046+0000", 2023-08-01T19:56:16.186 INFO:teuthology.orchestra.run.smithi008.stdout: "duration": 4294967295.9999995 2023-08-01T19:56:16.186 INFO:teuthology.orchestra.run.smithi008.stdout: }, 2023-08-01T19:56:16.186 INFO:teuthology.orchestra.run.smithi008.stdout: { 2023-08-01T19:56:16.187 INFO:teuthology.orchestra.run.smithi008.stdout: "event": "all_read", 2023-08-01T19:56:16.187 INFO:teuthology.orchestra.run.smithi008.stdout: "time": "2023-08-01T19:56:16.156050+0000", 2023-08-01T19:56:16.187 INFO:teuthology.orchestra.run.smithi008.stdout: "duration": 3.5820000000000002e-06 2023-08-01T19:56:16.187 INFO:teuthology.orchestra.run.smithi008.stdout: }, 2023-08-01T19:56:16.187 INFO:teuthology.orchestra.run.smithi008.stdout: { 2023-08-01T19:56:16.187 INFO:teuthology.orchestra.run.smithi008.stdout: "event": "dispatched", 2023-08-01T19:56:16.187 INFO:teuthology.orchestra.run.smithi008.stdout: "time": "2023-08-01T19:56:16.156059+0000", 2023-08-01T19:56:16.187 INFO:teuthology.orchestra.run.smithi008.stdout: "duration": 9.1619999999999997e-06 2023-08-01T19:56:16.188 INFO:teuthology.orchestra.run.smithi008.stdout: }, 2023-08-01T19:56:16.188 INFO:teuthology.orchestra.run.smithi008.stdout: { 2023-08-01T19:56:16.188 INFO:teuthology.orchestra.run.smithi008.stdout: "event": "queued_for_pg", 2023-08-01T19:56:16.188 INFO:teuthology.orchestra.run.smithi008.stdout: "time": "2023-08-01T19:56:16.156065+0000", 2023-08-01T19:56:16.188 INFO:teuthology.orchestra.run.smithi008.stdout: "duration": 5.9580000000000004e-06 2023-08-01T19:56:16.188 INFO:teuthology.orchestra.run.smithi008.stdout: }, 2023-08-01T19:56:16.188 INFO:teuthology.orchestra.run.smithi008.stdout: { 2023-08-01T19:56:16.188 INFO:teuthology.orchestra.run.smithi008.stdout: "event": "reached_pg", 2023-08-01T19:56:16.189 INFO:teuthology.orchestra.run.smithi008.stdout: "time": "2023-08-01T19:56:16.156804+0000", 2023-08-01T19:56:16.189 INFO:teuthology.orchestra.run.smithi008.stdout: "duration": 0.00073909300000000002 2023-08-01T19:56:16.189 INFO:teuthology.orchestra.run.smithi008.stdout: }, 2023-08-01T19:56:16.189 INFO:teuthology.orchestra.run.smithi008.stdout: { 2023-08-01T19:56:16.189 INFO:teuthology.orchestra.run.smithi008.stdout: "event": "started", 2023-08-01T19:56:16.189 INFO:teuthology.orchestra.run.smithi008.stdout: "time": "2023-08-01T19:56:16.156921+0000", 2023-08-01T19:56:16.189 INFO:teuthology.orchestra.run.smithi008.stdout: "duration": 0.000117391 2023-08-01T19:56:16.189 INFO:teuthology.orchestra.run.smithi008.stdout: } 2023-08-01T19:56:16.190 INFO:teuthology.orchestra.run.smithi008.stdout: ] 2023-08-01T19:56:16.190 INFO:teuthology.orchestra.run.smithi008.stdout: } 2023-08-01T19:56:16.190 INFO:teuthology.orchestra.run.smithi008.stdout: }, 2023-08-01T19:56:16.190 INFO:teuthology.orchestra.run.smithi008.stdout: { 2023-08-01T19:56:16.190 INFO:teuthology.orchestra.run.smithi008.stdout: "description": "osd_op(client.4668.0:231505 5.6 5:6be6f799:::benchmark_data_smithi006_114134_object97844:head [delete] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e69)", 2023-08-01T19:56:16.190 INFO:teuthology.orchestra.run.smithi008.stdout: "initiated_at": "2023-08-01T19:56:16.156074+0000", 2023-08-01T19:56:16.190 INFO:teuthology.orchestra.run.smithi008.stdout: "age": 0.007551828, 2023-08-01T19:56:16.191 INFO:teuthology.orchestra.run.smithi008.stdout: "duration": 0.0077753659999999997, 2023-08-01T19:56:16.191 INFO:teuthology.orchestra.run.smithi008.stdout: "type_data": { 2023-08-01T19:56:16.191 INFO:teuthology.orchestra.run.smithi008.stdout: "flag_point": "commit sent; apply or cleanup", 2023-08-01T19:56:16.191 INFO:teuthology.orchestra.run.smithi008.stdout: "client_info": { 2023-08-01T19:56:16.191 INFO:teuthology.orchestra.run.smithi008.stdout: "client": "client.4668", 2023-08-01T19:56:16.191 INFO:teuthology.orchestra.run.smithi008.stdout: "client_addr": "172.21.15.6:0/1709472247", 2023-08-01T19:56:16.191 INFO:teuthology.orchestra.run.smithi008.stdout: "tid": 231505 2023-08-01T19:56:16.192 INFO:teuthology.orchestra.run.smithi008.stdout: }, 2023-08-01T19:56:16.192 INFO:teuthology.orchestra.run.smithi008.stdout: "events": [ 2023-08-01T19:56:16.192 INFO:teuthology.orchestra.run.smithi008.stdout: { 2023-08-01T19:56:16.192 INFO:teuthology.orchestra.run.smithi008.stdout: "event": "initiated", 2023-08-01T19:56:16.192 INFO:teuthology.orchestra.run.smithi008.stdout: "time": "2023-08-01T19:56:16.156074+0000", 2023-08-01T19:56:16.192 INFO:teuthology.orchestra.run.smithi008.stdout: "duration": 0 2023-08-01T19:56:16.192 INFO:teuthology.orchestra.run.smithi008.stdout: }, 2023-08-01T19:56:16.193 INFO:teuthology.orchestra.run.smithi008.stdout: { 2023-08-01T19:56:16.193 INFO:teuthology.orchestra.run.smithi008.stdout: "event": "throttled", 2023-08-01T19:56:16.193 INFO:teuthology.orchestra.run.smithi008.stdout: "time": "2023-08-01T19:56:16.156074+0000", 2023-08-01T19:56:16.193 INFO:teuthology.orchestra.run.smithi008.stdout: "duration": 0 2023-08-01T19:56:16.193 INFO:teuthology.orchestra.run.smithi008.stdout: }, 2023-08-01T19:56:16.193 INFO:teuthology.orchestra.run.smithi008.stdout: { 2023-08-01T19:56:16.193 INFO:teuthology.orchestra.run.smithi008.stdout: "event": "header_read", 2023-08-01T19:56:16.193 INFO:teuthology.orchestra.run.smithi008.stdout: "time": "2023-08-01T19:56:16.156074+0000", 2023-08-01T19:56:16.194 INFO:teuthology.orchestra.run.smithi008.stdout: "duration": 4294967295.9999995 2023-08-01T19:56:16.194 INFO:teuthology.orchestra.run.smithi008.stdout: }, 2023-08-01T19:56:16.194 INFO:teuthology.orchestra.run.smithi008.stdout: { 2023-08-01T19:56:16.194 INFO:teuthology.orchestra.run.smithi008.stdout: "event": "all_read", 2023-08-01T19:56:16.194 INFO:teuthology.orchestra.run.smithi008.stdout: "time": "2023-08-01T19:56:16.156077+0000", 2023-08-01T19:56:16.194 INFO:teuthology.orchestra.run.smithi008.stdout: "duration": 2.937e-06 2023-08-01T19:56:16.194 INFO:teuthology.orchestra.run.smithi008.stdout: }, 2023-08-01T19:56:16.194 INFO:teuthology.orchestra.run.smithi008.stdout: { 2023-08-01T19:56:16.195 INFO:teuthology.orchestra.run.smithi008.stdout: "event": "dispatched", 2023-08-01T19:56:16.195 INFO:teuthology.orchestra.run.smithi008.stdout: "time": "2023-08-01T19:56:16.156084+0000", 2023-08-01T19:56:16.195 INFO:teuthology.orchestra.run.smithi008.stdout: "duration": 7.6890000000000004e-06 2023-08-01T19:56:16.195 INFO:teuthology.orchestra.run.smithi008.stdout: }, 2023-08-01T19:56:16.195 INFO:teuthology.orchestra.run.smithi008.stdout: { 2023-08-01T19:56:16.195 INFO:teuthology.orchestra.run.smithi008.stdout: "event": "queued_for_pg", 2023-08-01T19:56:16.195 INFO:teuthology.orchestra.run.smithi008.stdout: "time": "2023-08-01T19:56:16.156089+0000", 2023-08-01T19:56:16.195 INFO:teuthology.orchestra.run.smithi008.stdout: "duration": 4.8369999999999996e-06 2023-08-01T19:56:16.196 INFO:teuthology.orchestra.run.smithi008.stdout: }, 2023-08-01T19:56:16.196 INFO:teuthology.orchestra.run.smithi008.stdout: { 2023-08-01T19:56:16.196 INFO:teuthology.orchestra.run.smithi008.stdout: "event": "reached_pg", 2023-08-01T19:56:16.196 INFO:teuthology.orchestra.run.smithi008.stdout: "time": "2023-08-01T19:56:16.156353+0000", 2023-08-01T19:56:16.196 INFO:teuthology.orchestra.run.smithi008.stdout: "duration": 0.00026363100000000001 2023-08-01T19:56:16.196 INFO:teuthology.orchestra.run.smithi008.stdout: }, 2023-08-01T19:56:16.196 INFO:teuthology.orchestra.run.smithi008.stdout: { 2023-08-01T19:56:16.197 INFO:teuthology.orchestra.run.smithi008.stdout: "event": "started", 2023-08-01T19:56:16.197 INFO:teuthology.orchestra.run.smithi008.stdout: "time": "2023-08-01T19:56:16.156459+0000", 2023-08-01T19:56:16.197 INFO:teuthology.orchestra.run.smithi008.stdout: "duration": 0.000106289 2023-08-01T19:56:16.197 INFO:teuthology.orchestra.run.smithi008.stdout: }, 2023-08-01T19:56:16.197 INFO:teuthology.orchestra.run.smithi008.stdout: { 2023-08-01T19:56:16.197 INFO:teuthology.orchestra.run.smithi008.stdout: "event": "op_commit", 2023-08-01T19:56:16.197 INFO:teuthology.orchestra.run.smithi008.stdout: "time": "2023-08-01T19:56:16.163801+0000", 2023-08-01T19:56:16.197 INFO:teuthology.orchestra.run.smithi008.stdout: "duration": 0.0073416549999999999 2023-08-01T19:56:16.198 INFO:teuthology.orchestra.run.smithi008.stdout: }, 2023-08-01T19:56:16.198 INFO:teuthology.orchestra.run.smithi008.stdout: { 2023-08-01T19:56:16.198 INFO:teuthology.orchestra.run.smithi008.stdout: "event": "commit_sent", 2023-08-01T19:56:16.198 INFO:teuthology.orchestra.run.smithi008.stdout: "time": "2023-08-01T19:56:16.163847+0000", 2023-08-01T19:56:16.198 INFO:teuthology.orchestra.run.smithi008.stdout: "duration": 4.5861e-05 2023-08-01T19:56:16.198 INFO:teuthology.orchestra.run.smithi008.stdout: } 2023-08-01T19:56:16.198 INFO:teuthology.orchestra.run.smithi008.stdout: ] 2023-08-01T19:56:16.198 INFO:teuthology.orchestra.run.smithi008.stdout: } 2023-08-01T19:56:16.199 INFO:teuthology.orchestra.run.smithi008.stdout: }, 2023-08-01T19:56:16.199 INFO:teuthology.orchestra.run.smithi008.stdout: { 2023-08-01T19:56:16.199 INFO:teuthology.orchestra.run.smithi008.stdout: "description": "osd_repop(client.4668.0:231504 5.0 e69/19 5:03b24dae:::benchmark_data_smithi006_114134_object97843:head v 69'14694, mlcod=69'14690)", 2023-08-01T19:56:16.199 INFO:teuthology.orchestra.run.smithi008.stdout: "initiated_at": "2023-08-01T19:56:16.156293+0000", 2023-08-01T19:56:16.199 INFO:teuthology.orchestra.run.smithi008.stdout: "age": 0.0073328389999999999, 2023-08-01T19:56:16.199 INFO:teuthology.orchestra.run.smithi008.stdout: "duration": 0.0076565340000000004, 2023-08-01T19:56:16.199 INFO:teuthology.orchestra.run.smithi008.stdout: "type_data": { 2023-08-01T19:56:16.199 INFO:teuthology.orchestra.run.smithi008.stdout: "flag_point": "started", 2023-08-01T19:56:16.200 INFO:teuthology.orchestra.run.smithi008.stdout: "events": [ 2023-08-01T19:56:16.200 INFO:teuthology.orchestra.run.smithi008.stdout: { 2023-08-01T19:56:16.200 INFO:teuthology.orchestra.run.smithi008.stdout: "event": "initiated", 2023-08-01T19:56:16.200 INFO:teuthology.orchestra.run.smithi008.stdout: "time": "2023-08-01T19:56:16.156293+0000", 2023-08-01T19:56:16.200 INFO:teuthology.orchestra.run.smithi008.stdout: "duration": 0 2023-08-01T19:56:16.200 INFO:teuthology.orchestra.run.smithi008.stdout: }, 2023-08-01T19:56:16.200 INFO:teuthology.orchestra.run.smithi008.stdout: { 2023-08-01T19:56:16.200 INFO:teuthology.orchestra.run.smithi008.stdout: "event": "throttled", 2023-08-01T19:56:16.201 INFO:teuthology.orchestra.run.smithi008.stdout: "time": "2023-08-01T19:56:16.156293+0000", 2023-08-01T19:56:16.201 INFO:teuthology.orchestra.run.smithi008.stdout: "duration": 0 2023-08-01T19:56:16.201 INFO:teuthology.orchestra.run.smithi008.stdout: }, 2023-08-01T19:56:16.201 INFO:teuthology.orchestra.run.smithi008.stdout: { 2023-08-01T19:56:16.201 INFO:teuthology.orchestra.run.smithi008.stdout: "event": "header_read", 2023-08-01T19:56:16.201 INFO:teuthology.orchestra.run.smithi008.stdout: "time": "2023-08-01T19:56:16.156293+0000", 2023-08-01T19:56:16.201 INFO:teuthology.orchestra.run.smithi008.stdout: "duration": 4294967295.9999995 2023-08-01T19:56:16.201 INFO:teuthology.orchestra.run.smithi008.stdout: }, 2023-08-01T19:56:16.202 INFO:teuthology.orchestra.run.smithi008.stdout: { 2023-08-01T19:56:16.202 INFO:teuthology.orchestra.run.smithi008.stdout: "event": "all_read", 2023-08-01T19:56:16.202 INFO:teuthology.orchestra.run.smithi008.stdout: "time": "2023-08-01T19:56:16.156297+0000", 2023-08-01T19:56:16.202 INFO:teuthology.orchestra.run.smithi008.stdout: "duration": 4.0720000000000001e-06 2023-08-01T19:56:16.202 INFO:teuthology.orchestra.run.smithi008.stdout: }, 2023-08-01T19:56:16.202 INFO:teuthology.orchestra.run.smithi008.stdout: { 2023-08-01T19:56:16.202 INFO:teuthology.orchestra.run.smithi008.stdout: "event": "dispatched", 2023-08-01T19:56:16.202 INFO:teuthology.orchestra.run.smithi008.stdout: "time": "2023-08-01T19:56:16.156310+0000", 2023-08-01T19:56:16.203 INFO:teuthology.orchestra.run.smithi008.stdout: "duration": 1.3507e-05 2023-08-01T19:56:16.203 INFO:teuthology.orchestra.run.smithi008.stdout: }, 2023-08-01T19:56:16.203 INFO:teuthology.orchestra.run.smithi008.stdout: { 2023-08-01T19:56:16.203 INFO:teuthology.orchestra.run.smithi008.stdout: "event": "queued_for_pg", 2023-08-01T19:56:16.203 INFO:teuthology.orchestra.run.smithi008.stdout: "time": "2023-08-01T19:56:16.156313+0000", 2023-08-01T19:56:16.203 INFO:teuthology.orchestra.run.smithi008.stdout: "duration": 3.1360000000000001e-06 2023-08-01T19:56:16.203 INFO:teuthology.orchestra.run.smithi008.stdout: }, 2023-08-01T19:56:16.204 INFO:teuthology.orchestra.run.smithi008.stdout: { 2023-08-01T19:56:16.204 INFO:teuthology.orchestra.run.smithi008.stdout: "event": "reached_pg", 2023-08-01T19:56:16.204 INFO:teuthology.orchestra.run.smithi008.stdout: "time": "2023-08-01T19:56:16.156418+0000", 2023-08-01T19:56:16.204 INFO:teuthology.orchestra.run.smithi008.stdout: "duration": 0.000104676 2023-08-01T19:56:16.204 INFO:teuthology.orchestra.run.smithi008.stdout: }, 2023-08-01T19:56:16.204 INFO:teuthology.orchestra.run.smithi008.stdout: { 2023-08-01T19:56:16.204 INFO:teuthology.orchestra.run.smithi008.stdout: "event": "started", 2023-08-01T19:56:16.204 INFO:teuthology.orchestra.run.smithi008.stdout: "time": "2023-08-01T19:56:16.156436+0000", 2023-08-01T19:56:16.205 INFO:teuthology.orchestra.run.smithi008.stdout: "duration": 1.8284e-05 2023-08-01T19:56:16.205 INFO:teuthology.orchestra.run.smithi008.stdout: } 2023-08-01T19:56:16.205 INFO:teuthology.orchestra.run.smithi008.stdout: ] 2023-08-01T19:56:16.205 INFO:teuthology.orchestra.run.smithi008.stdout: } 2023-08-01T19:56:16.205 INFO:teuthology.orchestra.run.smithi008.stdout: }, 2023-08-01T19:56:16.205 INFO:teuthology.orchestra.run.smithi008.stdout: { 2023-08-01T19:56:16.205 INFO:teuthology.orchestra.run.smithi008.stdout: "description": "osd_op(client.4668.0:231506 5.2 5:4386b9a3:::benchmark_data_smithi006_114134_object97845:head [delete] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e69)", 2023-08-01T19:56:16.205 INFO:teuthology.orchestra.run.smithi008.stdout: "initiated_at": "2023-08-01T19:56:16.156322+0000", 2023-08-01T19:56:16.206 INFO:teuthology.orchestra.run.smithi008.stdout: "age": 0.0073042999999999997, 2023-08-01T19:56:16.206 INFO:teuthology.orchestra.run.smithi008.stdout: "duration": 0.0076679900000000004, 2023-08-01T19:56:16.206 INFO:teuthology.orchestra.run.smithi008.stdout: "type_data": { 2023-08-01T19:56:16.206 INFO:teuthology.orchestra.run.smithi008.stdout: "flag_point": "commit sent; apply or cleanup", 2023-08-01T19:56:16.206 INFO:teuthology.orchestra.run.smithi008.stdout: "client_info": { 2023-08-01T19:56:16.206 INFO:teuthology.orchestra.run.smithi008.stdout: "client": "client.4668", 2023-08-01T19:56:16.206 INFO:teuthology.orchestra.run.smithi008.stdout: "client_addr": "172.21.15.6:0/1709472247", 2023-08-01T19:56:16.206 INFO:teuthology.orchestra.run.smithi008.stdout: "tid": 231506 2023-08-01T19:56:16.207 INFO:teuthology.orchestra.run.smithi008.stdout: }, 2023-08-01T19:56:16.207 INFO:teuthology.orchestra.run.smithi008.stdout: "events": [ 2023-08-01T19:56:16.207 INFO:teuthology.orchestra.run.smithi008.stdout: { 2023-08-01T19:56:16.207 INFO:teuthology.orchestra.run.smithi008.stdout: "event": "initiated", 2023-08-01T19:56:16.207 INFO:teuthology.orchestra.run.smithi008.stdout: "time": "2023-08-01T19:56:16.156322+0000", 2023-08-01T19:56:16.207 INFO:teuthology.orchestra.run.smithi008.stdout: "duration": 0 2023-08-01T19:56:16.207 INFO:teuthology.orchestra.run.smithi008.stdout: }, 2023-08-01T19:56:16.208 INFO:teuthology.orchestra.run.smithi008.stdout: { 2023-08-01T19:56:16.208 INFO:teuthology.orchestra.run.smithi008.stdout: "event": "throttled", 2023-08-01T19:56:16.208 INFO:teuthology.orchestra.run.smithi008.stdout: "time": "2023-08-01T19:56:16.156322+0000", 2023-08-01T19:56:16.208 INFO:teuthology.orchestra.run.smithi008.stdout: "duration": 0 2023-08-01T19:56:16.208 INFO:teuthology.orchestra.run.smithi008.stdout: }, 2023-08-01T19:56:16.208 INFO:teuthology.orchestra.run.smithi008.stdout: { 2023-08-01T19:56:16.208 INFO:teuthology.orchestra.run.smithi008.stdout: "event": "header_read", 2023-08-01T19:56:16.208 INFO:teuthology.orchestra.run.smithi008.stdout: "time": "2023-08-01T19:56:16.156321+0000", 2023-08-01T19:56:16.209 INFO:teuthology.orchestra.run.smithi008.stdout: "duration": 4294967295.999999 2023-08-01T19:56:16.209 INFO:teuthology.orchestra.run.smithi008.stdout: }, 2023-08-01T19:56:16.209 INFO:teuthology.orchestra.run.smithi008.stdout: { 2023-08-01T19:56:16.209 INFO:teuthology.orchestra.run.smithi008.stdout: "event": "all_read", 2023-08-01T19:56:16.209 INFO:teuthology.orchestra.run.smithi008.stdout: "time": "2023-08-01T19:56:16.156325+0000", 2023-08-01T19:56:16.209 INFO:teuthology.orchestra.run.smithi008.stdout: "duration": 4.5739999999999997e-06 2023-08-01T19:56:16.209 INFO:teuthology.orchestra.run.smithi008.stdout: }, 2023-08-01T19:56:16.209 INFO:teuthology.orchestra.run.smithi008.stdout: { 2023-08-01T19:56:16.210 INFO:teuthology.orchestra.run.smithi008.stdout: "event": "dispatched", 2023-08-01T19:56:16.210 INFO:teuthology.orchestra.run.smithi008.stdout: "time": "2023-08-01T19:56:16.156338+0000", 2023-08-01T19:56:16.210 INFO:teuthology.orchestra.run.smithi008.stdout: "duration": 1.2133000000000001e-05 2023-08-01T19:56:16.210 INFO:teuthology.orchestra.run.smithi008.stdout: }, 2023-08-01T19:56:16.210 INFO:teuthology.orchestra.run.smithi008.stdout: { 2023-08-01T19:56:16.210 INFO:teuthology.orchestra.run.smithi008.stdout: "event": "queued_for_pg", 2023-08-01T19:56:16.210 INFO:teuthology.orchestra.run.smithi008.stdout: "time": "2023-08-01T19:56:16.156348+0000", 2023-08-01T19:56:16.210 INFO:teuthology.orchestra.run.smithi008.stdout: "duration": 9.9529999999999994e-06 2023-08-01T19:56:16.211 INFO:teuthology.orchestra.run.smithi008.stdout: }, 2023-08-01T19:56:16.211 INFO:teuthology.orchestra.run.smithi008.stdout: { 2023-08-01T19:56:16.211 INFO:teuthology.orchestra.run.smithi008.stdout: "event": "reached_pg", 2023-08-01T19:56:16.211 INFO:teuthology.orchestra.run.smithi008.stdout: "time": "2023-08-01T19:56:16.156459+0000", 2023-08-01T19:56:16.211 INFO:teuthology.orchestra.run.smithi008.stdout: "duration": 0.00011129300000000001 2023-08-01T19:56:16.211 INFO:teuthology.orchestra.run.smithi008.stdout: }, 2023-08-01T19:56:16.211 INFO:teuthology.orchestra.run.smithi008.stdout: { 2023-08-01T19:56:16.211 INFO:teuthology.orchestra.run.smithi008.stdout: "event": "started", 2023-08-01T19:56:16.212 INFO:teuthology.orchestra.run.smithi008.stdout: "time": "2023-08-01T19:56:16.156582+0000", 2023-08-01T19:56:16.212 INFO:teuthology.orchestra.run.smithi008.stdout: "duration": 0.00012337900000000001 2023-08-01T19:56:16.212 INFO:teuthology.orchestra.run.smithi008.stdout: }, 2023-08-01T19:56:16.212 INFO:teuthology.orchestra.run.smithi008.stdout: { 2023-08-01T19:56:16.212 INFO:teuthology.orchestra.run.smithi008.stdout: "event": "op_commit", 2023-08-01T19:56:16.212 INFO:teuthology.orchestra.run.smithi008.stdout: "time": "2023-08-01T19:56:16.163937+0000", 2023-08-01T19:56:16.212 INFO:teuthology.orchestra.run.smithi008.stdout: "duration": 0.0073547769999999998 2023-08-01T19:56:16.213 INFO:teuthology.orchestra.run.smithi008.stdout: }, 2023-08-01T19:56:16.213 INFO:teuthology.orchestra.run.smithi008.stdout: { 2023-08-01T19:56:16.213 INFO:teuthology.orchestra.run.smithi008.stdout: "event": "commit_sent", 2023-08-01T19:56:16.213 INFO:teuthology.orchestra.run.smithi008.stdout: "time": "2023-08-01T19:56:16.163980+0000", 2023-08-01T19:56:16.213 INFO:teuthology.orchestra.run.smithi008.stdout: "duration": 4.2809999999999998e-05 2023-08-01T19:56:16.213 INFO:teuthology.orchestra.run.smithi008.stdout: } 2023-08-01T19:56:16.213 INFO:teuthology.orchestra.run.smithi008.stdout: ] 2023-08-01T19:56:16.213 INFO:teuthology.orchestra.run.smithi008.stdout: } 2023-08-01T19:56:16.214 INFO:teuthology.orchestra.run.smithi008.stdout: }, 2023-08-01T19:56:16.214 INFO:teuthology.orchestra.run.smithi008.stdout: { 2023-08-01T19:56:16.214 INFO:teuthology.orchestra.run.smithi008.stdout: "description": "osd_op(client.4668.0:231508 5.a 5:56894224:::benchmark_data_smithi006_114134_object97847:head [delete] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e69)", 2023-08-01T19:56:16.214 INFO:teuthology.orchestra.run.smithi008.stdout: "initiated_at": "2023-08-01T19:56:16.158255+0000", 2023-08-01T19:56:16.214 INFO:teuthology.orchestra.run.smithi008.stdout: "age": 0.0053706759999999996, 2023-08-01T19:56:16.214 INFO:teuthology.orchestra.run.smithi008.stdout: "duration": 0.0058074270000000004, 2023-08-01T19:56:16.214 INFO:teuthology.orchestra.run.smithi008.stdout: "type_data": { 2023-08-01T19:56:16.215 INFO:teuthology.orchestra.run.smithi008.stdout: "flag_point": "waiting for sub ops", 2023-08-01T19:56:16.215 INFO:teuthology.orchestra.run.smithi008.stdout: "client_info": { 2023-08-01T19:56:16.215 INFO:teuthology.orchestra.run.smithi008.stdout: "client": "client.4668", 2023-08-01T19:56:16.215 INFO:teuthology.orchestra.run.smithi008.stdout: "client_addr": "172.21.15.6:0/1709472247", 2023-08-01T19:56:16.215 INFO:teuthology.orchestra.run.smithi008.stdout: "tid": 231508 2023-08-01T19:56:16.215 INFO:teuthology.orchestra.run.smithi008.stdout: }, 2023-08-01T19:56:16.215 INFO:teuthology.orchestra.run.smithi008.stdout: "events": [ 2023-08-01T19:56:16.215 INFO:teuthology.orchestra.run.smithi008.stdout: { 2023-08-01T19:56:16.216 INFO:teuthology.orchestra.run.smithi008.stdout: "event": "initiated", 2023-08-01T19:56:16.216 INFO:teuthology.orchestra.run.smithi008.stdout: "time": "2023-08-01T19:56:16.158255+0000", 2023-08-01T19:56:16.216 INFO:teuthology.orchestra.run.smithi008.stdout: "duration": 0 2023-08-01T19:56:16.216 INFO:teuthology.orchestra.run.smithi008.stdout: }, 2023-08-01T19:56:16.216 INFO:teuthology.orchestra.run.smithi008.stdout: { 2023-08-01T19:56:16.216 INFO:teuthology.orchestra.run.smithi008.stdout: "event": "throttled", 2023-08-01T19:56:16.216 INFO:teuthology.orchestra.run.smithi008.stdout: "time": "2023-08-01T19:56:16.158255+0000", 2023-08-01T19:56:16.216 INFO:teuthology.orchestra.run.smithi008.stdout: "duration": 0 2023-08-01T19:56:16.217 INFO:teuthology.orchestra.run.smithi008.stdout: }, 2023-08-01T19:56:16.217 INFO:teuthology.orchestra.run.smithi008.stdout: { 2023-08-01T19:56:16.217 INFO:teuthology.orchestra.run.smithi008.stdout: "event": "header_read", 2023-08-01T19:56:16.217 INFO:teuthology.orchestra.run.smithi008.stdout: "time": "2023-08-01T19:56:16.158254+0000", 2023-08-01T19:56:16.217 INFO:teuthology.orchestra.run.smithi008.stdout: "duration": 4294967295.999999 2023-08-01T19:56:16.217 INFO:teuthology.orchestra.run.smithi008.stdout: }, 2023-08-01T19:56:16.217 INFO:teuthology.orchestra.run.smithi008.stdout: { 2023-08-01T19:56:16.217 INFO:teuthology.orchestra.run.smithi008.stdout: "event": "all_read", 2023-08-01T19:56:16.218 INFO:teuthology.orchestra.run.smithi008.stdout: "time": "2023-08-01T19:56:16.158260+0000", 2023-08-01T19:56:16.218 INFO:teuthology.orchestra.run.smithi008.stdout: "duration": 5.4489999999999998e-06 2023-08-01T19:56:16.218 INFO:teuthology.orchestra.run.smithi008.stdout: }, 2023-08-01T19:56:16.218 INFO:teuthology.orchestra.run.smithi008.stdout: { 2023-08-01T19:56:16.218 INFO:teuthology.orchestra.run.smithi008.stdout: "event": "dispatched", 2023-08-01T19:56:16.218 INFO:teuthology.orchestra.run.smithi008.stdout: "time": "2023-08-01T19:56:16.158271+0000", 2023-08-01T19:56:16.218 INFO:teuthology.orchestra.run.smithi008.stdout: "duration": 1.0835999999999999e-05 2023-08-01T19:56:16.218 INFO:teuthology.orchestra.run.smithi008.stdout: }, 2023-08-01T19:56:16.219 INFO:teuthology.orchestra.run.smithi008.stdout: { 2023-08-01T19:56:16.219 INFO:teuthology.orchestra.run.smithi008.stdout: "event": "queued_for_pg", 2023-08-01T19:56:16.219 INFO:teuthology.orchestra.run.smithi008.stdout: "time": "2023-08-01T19:56:16.158278+0000", 2023-08-01T19:56:16.219 INFO:teuthology.orchestra.run.smithi008.stdout: "duration": 6.9820000000000002e-06 2023-08-01T19:56:16.219 INFO:teuthology.orchestra.run.smithi008.stdout: }, 2023-08-01T19:56:16.219 INFO:teuthology.orchestra.run.smithi008.stdout: { 2023-08-01T19:56:16.219 INFO:teuthology.orchestra.run.smithi008.stdout: "event": "reached_pg", 2023-08-01T19:56:16.219 INFO:teuthology.orchestra.run.smithi008.stdout: "time": "2023-08-01T19:56:16.158318+0000", 2023-08-01T19:56:16.220 INFO:teuthology.orchestra.run.smithi008.stdout: "duration": 4.0389000000000002e-05 2023-08-01T19:56:16.220 INFO:teuthology.orchestra.run.smithi008.stdout: }, 2023-08-01T19:56:16.220 INFO:teuthology.orchestra.run.smithi008.stdout: { 2023-08-01T19:56:16.220 INFO:teuthology.orchestra.run.smithi008.stdout: "event": "started", 2023-08-01T19:56:16.220 INFO:teuthology.orchestra.run.smithi008.stdout: "time": "2023-08-01T19:56:16.158449+0000", 2023-08-01T19:56:16.220 INFO:teuthology.orchestra.run.smithi008.stdout: "duration": 0.00013054200000000001 2023-08-01T19:56:16.220 INFO:teuthology.orchestra.run.smithi008.stdout: }, 2023-08-01T19:56:16.221 INFO:teuthology.orchestra.run.smithi008.stdout: { 2023-08-01T19:56:16.221 INFO:teuthology.orchestra.run.smithi008.stdout: "event": "waiting for subops from 2", 2023-08-01T19:56:16.221 INFO:teuthology.orchestra.run.smithi008.stdout: "time": "2023-08-01T19:56:16.158572+0000", 2023-08-01T19:56:16.221 INFO:teuthology.orchestra.run.smithi008.stdout: "duration": 0.00012355299999999999 2023-08-01T19:56:16.221 INFO:teuthology.orchestra.run.smithi008.stdout: }, 2023-08-01T19:56:16.221 INFO:teuthology.orchestra.run.smithi008.stdout: { 2023-08-01T19:56:16.221 INFO:teuthology.orchestra.run.smithi008.stdout: "event": "sub_op_commit_rec", 2023-08-01T19:56:16.221 INFO:teuthology.orchestra.run.smithi008.stdout: "time": "2023-08-01T19:56:16.162135+0000", 2023-08-01T19:56:16.222 INFO:teuthology.orchestra.run.smithi008.stdout: "duration": 0.0035631069999999998 2023-08-01T19:56:16.222 INFO:teuthology.orchestra.run.smithi008.stdout: } 2023-08-01T19:56:16.222 INFO:teuthology.orchestra.run.smithi008.stdout: ] 2023-08-01T19:56:16.222 INFO:teuthology.orchestra.run.smithi008.stdout: } 2023-08-01T19:56:16.222 INFO:teuthology.orchestra.run.smithi008.stdout: }, 2023-08-01T19:56:16.222 INFO:teuthology.orchestra.run.smithi008.stdout: { 2023-08-01T19:56:16.222 INFO:teuthology.orchestra.run.smithi008.stdout: "description": "osd_op(client.4668.0:231509 5.6 5:656ae302:::benchmark_data_smithi006_114134_object97848:head [delete] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e69)", 2023-08-01T19:56:16.222 INFO:teuthology.orchestra.run.smithi008.stdout: "initiated_at": "2023-08-01T19:56:16.158287+0000", 2023-08-01T19:56:16.223 INFO:teuthology.orchestra.run.smithi008.stdout: "age": 0.0053392480000000004, 2023-08-01T19:56:16.223 INFO:teuthology.orchestra.run.smithi008.stdout: "duration": 0.0058288639999999996, 2023-08-01T19:56:16.223 INFO:teuthology.orchestra.run.smithi008.stdout: "type_data": { 2023-08-01T19:56:16.223 INFO:teuthology.orchestra.run.smithi008.stdout: "flag_point": "started", 2023-08-01T19:56:16.223 INFO:teuthology.orchestra.run.smithi008.stdout: "client_info": { 2023-08-01T19:56:16.223 INFO:teuthology.orchestra.run.smithi008.stdout: "client": "client.4668", 2023-08-01T19:56:16.223 INFO:teuthology.orchestra.run.smithi008.stdout: "client_addr": "172.21.15.6:0/1709472247", 2023-08-01T19:56:16.223 INFO:teuthology.orchestra.run.smithi008.stdout: "tid": 231509 2023-08-01T19:56:16.224 INFO:teuthology.orchestra.run.smithi008.stdout: }, 2023-08-01T19:56:16.224 INFO:teuthology.orchestra.run.smithi008.stdout: "events": [ 2023-08-01T19:56:16.224 INFO:teuthology.orchestra.run.smithi008.stdout: { 2023-08-01T19:56:16.224 INFO:teuthology.orchestra.run.smithi008.stdout: "event": "initiated", 2023-08-01T19:56:16.224 INFO:teuthology.orchestra.run.smithi008.stdout: "time": "2023-08-01T19:56:16.158287+0000", 2023-08-01T19:56:16.224 INFO:teuthology.orchestra.run.smithi008.stdout: "duration": 0 2023-08-01T19:56:16.224 INFO:teuthology.orchestra.run.smithi008.stdout: }, 2023-08-01T19:56:16.225 INFO:teuthology.orchestra.run.smithi008.stdout: { 2023-08-01T19:56:16.225 INFO:teuthology.orchestra.run.smithi008.stdout: "event": "throttled", 2023-08-01T19:56:16.225 INFO:teuthology.orchestra.run.smithi008.stdout: "time": "2023-08-01T19:56:16.158287+0000", 2023-08-01T19:56:16.225 INFO:teuthology.orchestra.run.smithi008.stdout: "duration": 0 2023-08-01T19:56:16.225 INFO:teuthology.orchestra.run.smithi008.stdout: }, 2023-08-01T19:56:16.225 INFO:teuthology.orchestra.run.smithi008.stdout: { 2023-08-01T19:56:16.225 INFO:teuthology.orchestra.run.smithi008.stdout: "event": "header_read", 2023-08-01T19:56:16.225 INFO:teuthology.orchestra.run.smithi008.stdout: "time": "2023-08-01T19:56:16.158286+0000", 2023-08-01T19:56:16.226 INFO:teuthology.orchestra.run.smithi008.stdout: "duration": 4294967295.9999995 2023-08-01T19:56:16.226 INFO:teuthology.orchestra.run.smithi008.stdout: }, 2023-08-01T19:56:16.226 INFO:teuthology.orchestra.run.smithi008.stdout: { 2023-08-01T19:56:16.226 INFO:teuthology.orchestra.run.smithi008.stdout: "event": "all_read", 2023-08-01T19:56:16.226 INFO:teuthology.orchestra.run.smithi008.stdout: "time": "2023-08-01T19:56:16.158289+0000", 2023-08-01T19:56:16.226 INFO:teuthology.orchestra.run.smithi008.stdout: "duration": 2.3130000000000001e-06 2023-08-01T19:56:16.226 INFO:teuthology.orchestra.run.smithi008.stdout: }, 2023-08-01T19:56:16.226 INFO:teuthology.orchestra.run.smithi008.stdout: { 2023-08-01T19:56:16.227 INFO:teuthology.orchestra.run.smithi008.stdout: "event": "dispatched", 2023-08-01T19:56:16.227 INFO:teuthology.orchestra.run.smithi008.stdout: "time": "2023-08-01T19:56:16.158295+0000", 2023-08-01T19:56:16.227 INFO:teuthology.orchestra.run.smithi008.stdout: "duration": 5.9580000000000004e-06 2023-08-01T19:56:16.227 INFO:teuthology.orchestra.run.smithi008.stdout: }, 2023-08-01T19:56:16.227 INFO:teuthology.orchestra.run.smithi008.stdout: { 2023-08-01T19:56:16.227 INFO:teuthology.orchestra.run.smithi008.stdout: "event": "queued_for_pg", 2023-08-01T19:56:16.227 INFO:teuthology.orchestra.run.smithi008.stdout: "time": "2023-08-01T19:56:16.158300+0000", 2023-08-01T19:56:16.227 INFO:teuthology.orchestra.run.smithi008.stdout: "duration": 5.0220000000000004e-06 2023-08-01T19:56:16.228 INFO:teuthology.orchestra.run.smithi008.stdout: }, 2023-08-01T19:56:16.228 INFO:teuthology.orchestra.run.smithi008.stdout: { 2023-08-01T19:56:16.228 INFO:teuthology.orchestra.run.smithi008.stdout: "event": "reached_pg", 2023-08-01T19:56:16.228 INFO:teuthology.orchestra.run.smithi008.stdout: "time": "2023-08-01T19:56:16.158628+0000", 2023-08-01T19:56:16.228 INFO:teuthology.orchestra.run.smithi008.stdout: "duration": 0.000328451 2023-08-01T19:56:16.228 INFO:teuthology.orchestra.run.smithi008.stdout: }, 2023-08-01T19:56:16.228 INFO:teuthology.orchestra.run.smithi008.stdout: { 2023-08-01T19:56:16.228 INFO:teuthology.orchestra.run.smithi008.stdout: "event": "started", 2023-08-01T19:56:16.229 INFO:teuthology.orchestra.run.smithi008.stdout: "time": "2023-08-01T19:56:16.158697+0000", 2023-08-01T19:56:16.229 INFO:teuthology.orchestra.run.smithi008.stdout: "duration": 6.8765999999999999e-05 2023-08-01T19:56:16.229 INFO:teuthology.orchestra.run.smithi008.stdout: } 2023-08-01T19:56:16.229 INFO:teuthology.orchestra.run.smithi008.stdout: ] 2023-08-01T19:56:16.229 INFO:teuthology.orchestra.run.smithi008.stdout: } 2023-08-01T19:56:16.229 INFO:teuthology.orchestra.run.smithi008.stdout: }, 2023-08-01T19:56:16.229 INFO:teuthology.orchestra.run.smithi008.stdout: { 2023-08-01T19:56:16.229 INFO:teuthology.orchestra.run.smithi008.stdout: "description": "osd_op(client.4668.0:231511 5.1 5:8bde72ab:::benchmark_data_smithi006_114134_object97850:head [delete] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e69)", 2023-08-01T19:56:16.230 INFO:teuthology.orchestra.run.smithi008.stdout: "initiated_at": "2023-08-01T19:56:16.158778+0000", 2023-08-01T19:56:16.230 INFO:teuthology.orchestra.run.smithi008.stdout: "age": 0.0048483509999999999, 2023-08-01T19:56:16.230 INFO:teuthology.orchestra.run.smithi008.stdout: "duration": 0.0053944070000000004, 2023-08-01T19:56:16.230 INFO:teuthology.orchestra.run.smithi008.stdout: "type_data": { 2023-08-01T19:56:16.230 INFO:teuthology.orchestra.run.smithi008.stdout: "flag_point": "started", 2023-08-01T19:56:16.230 INFO:teuthology.orchestra.run.smithi008.stdout: "client_info": { 2023-08-01T19:56:16.230 INFO:teuthology.orchestra.run.smithi008.stdout: "client": "client.4668", 2023-08-01T19:56:16.231 INFO:teuthology.orchestra.run.smithi008.stdout: "client_addr": "172.21.15.6:0/1709472247", 2023-08-01T19:56:16.231 INFO:teuthology.orchestra.run.smithi008.stdout: "tid": 231511 2023-08-01T19:56:16.231 INFO:teuthology.orchestra.run.smithi008.stdout: }, 2023-08-01T19:56:16.231 INFO:teuthology.orchestra.run.smithi008.stdout: "events": [ 2023-08-01T19:56:16.231 INFO:teuthology.orchestra.run.smithi008.stdout: { 2023-08-01T19:56:16.231 INFO:teuthology.orchestra.run.smithi008.stdout: "event": "initiated", 2023-08-01T19:56:16.231 INFO:teuthology.orchestra.run.smithi008.stdout: "time": "2023-08-01T19:56:16.158778+0000", 2023-08-01T19:56:16.232 INFO:teuthology.orchestra.run.smithi008.stdout: "duration": 0 2023-08-01T19:56:16.232 INFO:teuthology.orchestra.run.smithi008.stdout: }, 2023-08-01T19:56:16.232 INFO:teuthology.orchestra.run.smithi008.stdout: { 2023-08-01T19:56:16.232 INFO:teuthology.orchestra.run.smithi008.stdout: "event": "throttled", 2023-08-01T19:56:16.232 INFO:teuthology.orchestra.run.smithi008.stdout: "time": "2023-08-01T19:56:16.158778+0000", 2023-08-01T19:56:16.232 INFO:teuthology.orchestra.run.smithi008.stdout: "duration": 0 2023-08-01T19:56:16.232 INFO:teuthology.orchestra.run.smithi008.stdout: }, 2023-08-01T19:56:16.233 INFO:teuthology.orchestra.run.smithi008.stdout: { 2023-08-01T19:56:16.233 INFO:teuthology.orchestra.run.smithi008.stdout: "event": "header_read", 2023-08-01T19:56:16.233 INFO:teuthology.orchestra.run.smithi008.stdout: "time": "2023-08-01T19:56:16.158777+0000", 2023-08-01T19:56:16.233 INFO:teuthology.orchestra.run.smithi008.stdout: "duration": 4294967295.9999995 2023-08-01T19:56:16.233 INFO:teuthology.orchestra.run.smithi008.stdout: }, 2023-08-01T19:56:16.233 INFO:teuthology.orchestra.run.smithi008.stdout: { 2023-08-01T19:56:16.233 INFO:teuthology.orchestra.run.smithi008.stdout: "event": "all_read", 2023-08-01T19:56:16.234 INFO:teuthology.orchestra.run.smithi008.stdout: "time": "2023-08-01T19:56:16.158781+0000", 2023-08-01T19:56:16.234 INFO:teuthology.orchestra.run.smithi008.stdout: "duration": 3.6610000000000002e-06 2023-08-01T19:56:16.234 INFO:teuthology.orchestra.run.smithi008.stdout: }, 2023-08-01T19:56:16.234 INFO:teuthology.orchestra.run.smithi008.stdout: { 2023-08-01T19:56:16.234 INFO:teuthology.orchestra.run.smithi008.stdout: "event": "dispatched", 2023-08-01T19:56:16.234 INFO:teuthology.orchestra.run.smithi008.stdout: "time": "2023-08-01T19:56:16.158788+0000", 2023-08-01T19:56:16.234 INFO:teuthology.orchestra.run.smithi008.stdout: "duration": 7.3270000000000003e-06 2023-08-01T19:56:16.235 INFO:teuthology.orchestra.run.smithi008.stdout: }, 2023-08-01T19:56:16.235 INFO:teuthology.orchestra.run.smithi008.stdout: { 2023-08-01T19:56:16.235 INFO:teuthology.orchestra.run.smithi008.stdout: "event": "queued_for_pg", 2023-08-01T19:56:16.235 INFO:teuthology.orchestra.run.smithi008.stdout: "time": "2023-08-01T19:56:16.158793+0000", 2023-08-01T19:56:16.235 INFO:teuthology.orchestra.run.smithi008.stdout: "duration": 4.7129999999999996e-06 2023-08-01T19:56:16.235 INFO:teuthology.orchestra.run.smithi008.stdout: }, 2023-08-01T19:56:16.235 INFO:teuthology.orchestra.run.smithi008.stdout: { 2023-08-01T19:56:16.236 INFO:teuthology.orchestra.run.smithi008.stdout: "event": "reached_pg", 2023-08-01T19:56:16.236 INFO:teuthology.orchestra.run.smithi008.stdout: "time": "2023-08-01T19:56:16.158833+0000", 2023-08-01T19:56:16.236 INFO:teuthology.orchestra.run.smithi008.stdout: "duration": 4.0519000000000003e-05 2023-08-01T19:56:16.236 INFO:teuthology.orchestra.run.smithi008.stdout: }, 2023-08-01T19:56:16.236 INFO:teuthology.orchestra.run.smithi008.stdout: { 2023-08-01T19:56:16.236 INFO:teuthology.orchestra.run.smithi008.stdout: "event": "started", 2023-08-01T19:56:16.236 INFO:teuthology.orchestra.run.smithi008.stdout: "time": "2023-08-01T19:56:16.158955+0000", 2023-08-01T19:56:16.237 INFO:teuthology.orchestra.run.smithi008.stdout: "duration": 0.00012209699999999999 2023-08-01T19:56:16.237 INFO:teuthology.orchestra.run.smithi008.stdout: } 2023-08-01T19:56:16.237 INFO:teuthology.orchestra.run.smithi008.stdout: ] 2023-08-01T19:56:16.237 INFO:teuthology.orchestra.run.smithi008.stdout: } 2023-08-01T19:56:16.237 INFO:teuthology.orchestra.run.smithi008.stdout: }, 2023-08-01T19:56:16.237 INFO:teuthology.orchestra.run.smithi008.stdout: { 2023-08-01T19:56:16.237 INFO:teuthology.orchestra.run.smithi008.stdout: "description": "osd_repop(client.4668.0:231510 5.4 e69/19 5:243de9dd:::benchmark_data_smithi006_114134_object97849:head v 69'14310, mlcod=69'14308)", 2023-08-01T19:56:16.238 INFO:teuthology.orchestra.run.smithi008.stdout: "initiated_at": "2023-08-01T19:56:16.159072+0000", 2023-08-01T19:56:16.238 INFO:teuthology.orchestra.run.smithi008.stdout: "age": 0.0045540800000000003, 2023-08-01T19:56:16.238 INFO:teuthology.orchestra.run.smithi008.stdout: "duration": 0.0051796689999999996, 2023-08-01T19:56:16.238 INFO:teuthology.orchestra.run.smithi008.stdout: "type_data": { 2023-08-01T19:56:16.238 INFO:teuthology.orchestra.run.smithi008.stdout: "flag_point": "started", 2023-08-01T19:56:16.238 INFO:teuthology.orchestra.run.smithi008.stdout: "events": [ 2023-08-01T19:56:16.238 INFO:teuthology.orchestra.run.smithi008.stdout: { 2023-08-01T19:56:16.239 INFO:teuthology.orchestra.run.smithi008.stdout: "event": "initiated", 2023-08-01T19:56:16.239 INFO:teuthology.orchestra.run.smithi008.stdout: "time": "2023-08-01T19:56:16.159072+0000", 2023-08-01T19:56:16.239 INFO:teuthology.orchestra.run.smithi008.stdout: "duration": 0 2023-08-01T19:56:16.239 INFO:teuthology.orchestra.run.smithi008.stdout: }, 2023-08-01T19:56:16.239 INFO:teuthology.orchestra.run.smithi008.stdout: { 2023-08-01T19:56:16.239 INFO:teuthology.orchestra.run.smithi008.stdout: "event": "throttled", 2023-08-01T19:56:16.239 INFO:teuthology.orchestra.run.smithi008.stdout: "time": "2023-08-01T19:56:16.159072+0000", 2023-08-01T19:56:16.239 INFO:teuthology.orchestra.run.smithi008.stdout: "duration": 0 2023-08-01T19:56:16.240 INFO:teuthology.orchestra.run.smithi008.stdout: }, 2023-08-01T19:56:16.240 INFO:teuthology.orchestra.run.smithi008.stdout: { 2023-08-01T19:56:16.240 INFO:teuthology.orchestra.run.smithi008.stdout: "event": "header_read", 2023-08-01T19:56:16.240 INFO:teuthology.orchestra.run.smithi008.stdout: "time": "2023-08-01T19:56:16.159071+0000", 2023-08-01T19:56:16.240 INFO:teuthology.orchestra.run.smithi008.stdout: "duration": 4294967295.9999995 2023-08-01T19:56:16.240 INFO:teuthology.orchestra.run.smithi008.stdout: }, 2023-08-01T19:56:16.240 INFO:teuthology.orchestra.run.smithi008.stdout: { 2023-08-01T19:56:16.240 INFO:teuthology.orchestra.run.smithi008.stdout: "event": "all_read", 2023-08-01T19:56:16.241 INFO:teuthology.orchestra.run.smithi008.stdout: "time": "2023-08-01T19:56:16.159076+0000", 2023-08-01T19:56:16.241 INFO:teuthology.orchestra.run.smithi008.stdout: "duration": 4.9599999999999999e-06 2023-08-01T19:56:16.241 INFO:teuthology.orchestra.run.smithi008.stdout: }, 2023-08-01T19:56:16.241 INFO:teuthology.orchestra.run.smithi008.stdout: { 2023-08-01T19:56:16.241 INFO:teuthology.orchestra.run.smithi008.stdout: "event": "dispatched", 2023-08-01T19:56:16.241 INFO:teuthology.orchestra.run.smithi008.stdout: "time": "2023-08-01T19:56:16.159082+0000", 2023-08-01T19:56:16.241 INFO:teuthology.orchestra.run.smithi008.stdout: "duration": 5.3120000000000001e-06 2023-08-01T19:56:16.241 INFO:teuthology.orchestra.run.smithi008.stdout: }, 2023-08-01T19:56:16.242 INFO:teuthology.orchestra.run.smithi008.stdout: { 2023-08-01T19:56:16.242 INFO:teuthology.orchestra.run.smithi008.stdout: "event": "queued_for_pg", 2023-08-01T19:56:16.242 INFO:teuthology.orchestra.run.smithi008.stdout: "time": "2023-08-01T19:56:16.159085+0000", 2023-08-01T19:56:16.242 INFO:teuthology.orchestra.run.smithi008.stdout: "duration": 3.3450000000000002e-06 2023-08-01T19:56:16.242 INFO:teuthology.orchestra.run.smithi008.stdout: }, 2023-08-01T19:56:16.242 INFO:teuthology.orchestra.run.smithi008.stdout: { 2023-08-01T19:56:16.242 INFO:teuthology.orchestra.run.smithi008.stdout: "event": "reached_pg", 2023-08-01T19:56:16.242 INFO:teuthology.orchestra.run.smithi008.stdout: "time": "2023-08-01T19:56:16.159118+0000", 2023-08-01T19:56:16.243 INFO:teuthology.orchestra.run.smithi008.stdout: "duration": 3.2863e-05 2023-08-01T19:56:16.243 INFO:teuthology.orchestra.run.smithi008.stdout: }, 2023-08-01T19:56:16.243 INFO:teuthology.orchestra.run.smithi008.stdout: { 2023-08-01T19:56:16.243 INFO:teuthology.orchestra.run.smithi008.stdout: "event": "started", 2023-08-01T19:56:16.243 INFO:teuthology.orchestra.run.smithi008.stdout: "time": "2023-08-01T19:56:16.159130+0000", 2023-08-01T19:56:16.243 INFO:teuthology.orchestra.run.smithi008.stdout: "duration": 1.2523e-05 2023-08-01T19:56:16.243 INFO:teuthology.orchestra.run.smithi008.stdout: } 2023-08-01T19:56:16.243 INFO:teuthology.orchestra.run.smithi008.stdout: ] 2023-08-01T19:56:16.244 INFO:teuthology.orchestra.run.smithi008.stdout: } 2023-08-01T19:56:16.244 INFO:teuthology.orchestra.run.smithi008.stdout: }, 2023-08-01T19:56:16.244 INFO:teuthology.orchestra.run.smithi008.stdout: { 2023-08-01T19:56:16.244 INFO:teuthology.orchestra.run.smithi008.stdout: "description": "osd_op(client.4668.0:231514 5.2 5:4de36347:::benchmark_data_smithi006_114134_object97853:head [delete] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e69)", 2023-08-01T19:56:16.244 INFO:teuthology.orchestra.run.smithi008.stdout: "initiated_at": "2023-08-01T19:56:16.160425+0000", 2023-08-01T19:56:16.244 INFO:teuthology.orchestra.run.smithi008.stdout: "age": 0.0032004550000000001, 2023-08-01T19:56:16.244 INFO:teuthology.orchestra.run.smithi008.stdout: "duration": 0.0038991709999999999, 2023-08-01T19:56:16.245 INFO:teuthology.orchestra.run.smithi008.stdout: "type_data": { 2023-08-01T19:56:16.245 INFO:teuthology.orchestra.run.smithi008.stdout: "flag_point": "started", 2023-08-01T19:56:16.245 INFO:teuthology.orchestra.run.smithi008.stdout: "client_info": { 2023-08-01T19:56:16.245 INFO:teuthology.orchestra.run.smithi008.stdout: "client": "client.4668", 2023-08-01T19:56:16.245 INFO:teuthology.orchestra.run.smithi008.stdout: "client_addr": "172.21.15.6:0/1709472247", 2023-08-01T19:56:16.245 INFO:teuthology.orchestra.run.smithi008.stdout: "tid": 231514 2023-08-01T19:56:16.245 INFO:teuthology.orchestra.run.smithi008.stdout: }, 2023-08-01T19:56:16.245 INFO:teuthology.orchestra.run.smithi008.stdout: "events": [ 2023-08-01T19:56:16.246 INFO:teuthology.orchestra.run.smithi008.stdout: { 2023-08-01T19:56:16.246 INFO:teuthology.orchestra.run.smithi008.stdout: "event": "initiated", 2023-08-01T19:56:16.246 INFO:teuthology.orchestra.run.smithi008.stdout: "time": "2023-08-01T19:56:16.160425+0000", 2023-08-01T19:56:16.246 INFO:teuthology.orchestra.run.smithi008.stdout: "duration": 0 2023-08-01T19:56:16.246 INFO:teuthology.orchestra.run.smithi008.stdout: }, 2023-08-01T19:56:16.246 INFO:teuthology.orchestra.run.smithi008.stdout: { 2023-08-01T19:56:16.246 INFO:teuthology.orchestra.run.smithi008.stdout: "event": "throttled", 2023-08-01T19:56:16.246 INFO:teuthology.orchestra.run.smithi008.stdout: "time": "2023-08-01T19:56:16.160425+0000", 2023-08-01T19:56:16.247 INFO:teuthology.orchestra.run.smithi008.stdout: "duration": 0 2023-08-01T19:56:16.247 INFO:teuthology.orchestra.run.smithi008.stdout: }, 2023-08-01T19:56:16.247 INFO:teuthology.orchestra.run.smithi008.stdout: { 2023-08-01T19:56:16.247 INFO:teuthology.orchestra.run.smithi008.stdout: "event": "header_read", 2023-08-01T19:56:16.247 INFO:teuthology.orchestra.run.smithi008.stdout: "time": "2023-08-01T19:56:16.160425+0000", 2023-08-01T19:56:16.247 INFO:teuthology.orchestra.run.smithi008.stdout: "duration": 4294967295.999999 2023-08-01T19:56:16.247 INFO:teuthology.orchestra.run.smithi008.stdout: }, 2023-08-01T19:56:16.247 INFO:teuthology.orchestra.run.smithi008.stdout: { 2023-08-01T19:56:16.248 INFO:teuthology.orchestra.run.smithi008.stdout: "event": "all_read", 2023-08-01T19:56:16.248 INFO:teuthology.orchestra.run.smithi008.stdout: "time": "2023-08-01T19:56:16.160429+0000", 2023-08-01T19:56:16.248 INFO:teuthology.orchestra.run.smithi008.stdout: "duration": 4.5719999999999996e-06 2023-08-01T19:56:16.248 INFO:teuthology.orchestra.run.smithi008.stdout: }, 2023-08-01T19:56:16.248 INFO:teuthology.orchestra.run.smithi008.stdout: { 2023-08-01T19:56:16.248 INFO:teuthology.orchestra.run.smithi008.stdout: "event": "dispatched", 2023-08-01T19:56:16.248 INFO:teuthology.orchestra.run.smithi008.stdout: "time": "2023-08-01T19:56:16.160440+0000", 2023-08-01T19:56:16.248 INFO:teuthology.orchestra.run.smithi008.stdout: "duration": 1.0987e-05 2023-08-01T19:56:16.249 INFO:teuthology.orchestra.run.smithi008.stdout: }, 2023-08-01T19:56:16.249 INFO:teuthology.orchestra.run.smithi008.stdout: { 2023-08-01T19:56:16.249 INFO:teuthology.orchestra.run.smithi008.stdout: "event": "queued_for_pg", 2023-08-01T19:56:16.249 INFO:teuthology.orchestra.run.smithi008.stdout: "time": "2023-08-01T19:56:16.160445+0000", 2023-08-01T19:56:16.249 INFO:teuthology.orchestra.run.smithi008.stdout: "duration": 5.3279999999999996e-06 2023-08-01T19:56:16.249 INFO:teuthology.orchestra.run.smithi008.stdout: }, 2023-08-01T19:56:16.249 INFO:teuthology.orchestra.run.smithi008.stdout: { 2023-08-01T19:56:16.250 INFO:teuthology.orchestra.run.smithi008.stdout: "event": "reached_pg", 2023-08-01T19:56:16.250 INFO:teuthology.orchestra.run.smithi008.stdout: "time": "2023-08-01T19:56:16.160500+0000", 2023-08-01T19:56:16.250 INFO:teuthology.orchestra.run.smithi008.stdout: "duration": 5.4490999999999997e-05 2023-08-01T19:56:16.250 INFO:teuthology.orchestra.run.smithi008.stdout: }, 2023-08-01T19:56:16.250 INFO:teuthology.orchestra.run.smithi008.stdout: { 2023-08-01T19:56:16.250 INFO:teuthology.orchestra.run.smithi008.stdout: "event": "started", 2023-08-01T19:56:16.250 INFO:teuthology.orchestra.run.smithi008.stdout: "time": "2023-08-01T19:56:16.160655+0000", 2023-08-01T19:56:16.250 INFO:teuthology.orchestra.run.smithi008.stdout: "duration": 0.00015484200000000001 2023-08-01T19:56:16.251 INFO:teuthology.orchestra.run.smithi008.stdout: } 2023-08-01T19:56:16.251 INFO:teuthology.orchestra.run.smithi008.stdout: ] 2023-08-01T19:56:16.251 INFO:teuthology.orchestra.run.smithi008.stdout: } 2023-08-01T19:56:16.251 INFO:teuthology.orchestra.run.smithi008.stdout: }, 2023-08-01T19:56:16.251 INFO:teuthology.orchestra.run.smithi008.stdout: { 2023-08-01T19:56:16.251 INFO:teuthology.orchestra.run.smithi008.stdout: "description": "osd_repop(client.4668.0:231512 5.8 e69/19 5:1598788c:::benchmark_data_smithi006_114134_object97851:head v 69'14514, mlcod=69'14512)", 2023-08-01T19:56:16.251 INFO:teuthology.orchestra.run.smithi008.stdout: "initiated_at": "2023-08-01T19:56:16.160508+0000", 2023-08-01T19:56:16.251 INFO:teuthology.orchestra.run.smithi008.stdout: "age": 0.0031175349999999998, 2023-08-01T19:56:16.252 INFO:teuthology.orchestra.run.smithi008.stdout: "duration": 0.0039018109999999998, 2023-08-01T19:56:16.252 INFO:teuthology.orchestra.run.smithi008.stdout: "type_data": { 2023-08-01T19:56:16.252 INFO:teuthology.orchestra.run.smithi008.stdout: "flag_point": "started", 2023-08-01T19:56:16.252 INFO:teuthology.orchestra.run.smithi008.stdout: "events": [ 2023-08-01T19:56:16.252 INFO:teuthology.orchestra.run.smithi008.stdout: { 2023-08-01T19:56:16.252 INFO:teuthology.orchestra.run.smithi008.stdout: "event": "initiated", 2023-08-01T19:56:16.252 INFO:teuthology.orchestra.run.smithi008.stdout: "time": "2023-08-01T19:56:16.160508+0000", 2023-08-01T19:56:16.253 INFO:teuthology.orchestra.run.smithi008.stdout: "duration": 0 2023-08-01T19:56:16.253 INFO:teuthology.orchestra.run.smithi008.stdout: }, 2023-08-01T19:56:16.253 INFO:teuthology.orchestra.run.smithi008.stdout: { 2023-08-01T19:56:16.253 INFO:teuthology.orchestra.run.smithi008.stdout: "event": "throttled", 2023-08-01T19:56:16.253 INFO:teuthology.orchestra.run.smithi008.stdout: "time": "2023-08-01T19:56:16.160508+0000", 2023-08-01T19:56:16.253 INFO:teuthology.orchestra.run.smithi008.stdout: "duration": 0 2023-08-01T19:56:16.253 INFO:teuthology.orchestra.run.smithi008.stdout: }, 2023-08-01T19:56:16.253 INFO:teuthology.orchestra.run.smithi008.stdout: { 2023-08-01T19:56:16.254 INFO:teuthology.orchestra.run.smithi008.stdout: "event": "header_read", 2023-08-01T19:56:16.254 INFO:teuthology.orchestra.run.smithi008.stdout: "time": "2023-08-01T19:56:16.160508+0000", 2023-08-01T19:56:16.254 INFO:teuthology.orchestra.run.smithi008.stdout: "duration": 4294967295.9999995 2023-08-01T19:56:16.254 INFO:teuthology.orchestra.run.smithi008.stdout: }, 2023-08-01T19:56:16.254 INFO:teuthology.orchestra.run.smithi008.stdout: { 2023-08-01T19:56:16.254 INFO:teuthology.orchestra.run.smithi008.stdout: "event": "all_read", 2023-08-01T19:56:16.254 INFO:teuthology.orchestra.run.smithi008.stdout: "time": "2023-08-01T19:56:16.160513+0000", 2023-08-01T19:56:16.254 INFO:teuthology.orchestra.run.smithi008.stdout: "duration": 4.7870000000000001e-06 2023-08-01T19:56:16.255 INFO:teuthology.orchestra.run.smithi008.stdout: }, 2023-08-01T19:56:16.255 INFO:teuthology.orchestra.run.smithi008.stdout: { 2023-08-01T19:56:16.255 INFO:teuthology.orchestra.run.smithi008.stdout: "event": "dispatched", 2023-08-01T19:56:16.255 INFO:teuthology.orchestra.run.smithi008.stdout: "time": "2023-08-01T19:56:16.160523+0000", 2023-08-01T19:56:16.255 INFO:teuthology.orchestra.run.smithi008.stdout: "duration": 1.0584000000000001e-05 2023-08-01T19:56:16.255 INFO:teuthology.orchestra.run.smithi008.stdout: }, 2023-08-01T19:56:16.255 INFO:teuthology.orchestra.run.smithi008.stdout: { 2023-08-01T19:56:16.255 INFO:teuthology.orchestra.run.smithi008.stdout: "event": "queued_for_pg", 2023-08-01T19:56:16.256 INFO:teuthology.orchestra.run.smithi008.stdout: "time": "2023-08-01T19:56:16.160528+0000", 2023-08-01T19:56:16.256 INFO:teuthology.orchestra.run.smithi008.stdout: "duration": 4.4750000000000004e-06 2023-08-01T19:56:16.256 INFO:teuthology.orchestra.run.smithi008.stdout: }, 2023-08-01T19:56:16.256 INFO:teuthology.orchestra.run.smithi008.stdout: { 2023-08-01T19:56:16.256 INFO:teuthology.orchestra.run.smithi008.stdout: "event": "reached_pg", 2023-08-01T19:56:16.256 INFO:teuthology.orchestra.run.smithi008.stdout: "time": "2023-08-01T19:56:16.160560+0000", 2023-08-01T19:56:16.256 INFO:teuthology.orchestra.run.smithi008.stdout: "duration": 3.2058999999999999e-05 2023-08-01T19:56:16.256 INFO:teuthology.orchestra.run.smithi008.stdout: }, 2023-08-01T19:56:16.257 INFO:teuthology.orchestra.run.smithi008.stdout: { 2023-08-01T19:56:16.257 INFO:teuthology.orchestra.run.smithi008.stdout: "event": "started", 2023-08-01T19:56:16.257 INFO:teuthology.orchestra.run.smithi008.stdout: "time": "2023-08-01T19:56:16.160585+0000", 2023-08-01T19:56:16.257 INFO:teuthology.orchestra.run.smithi008.stdout: "duration": 2.4992999999999999e-05 2023-08-01T19:56:16.257 INFO:teuthology.orchestra.run.smithi008.stdout: } 2023-08-01T19:56:16.257 INFO:teuthology.orchestra.run.smithi008.stdout: ] 2023-08-01T19:56:16.257 INFO:teuthology.orchestra.run.smithi008.stdout: } 2023-08-01T19:56:16.257 INFO:teuthology.orchestra.run.smithi008.stdout: }, 2023-08-01T19:56:16.258 INFO:teuthology.orchestra.run.smithi008.stdout: { 2023-08-01T19:56:16.258 INFO:teuthology.orchestra.run.smithi008.stdout: "description": "osd_repop(client.4668.0:231513 5.4 e69/19 5:2440ca2f:::benchmark_data_smithi006_114134_object97852:head v 69'14311, mlcod=69'14308)", 2023-08-01T19:56:16.258 INFO:teuthology.orchestra.run.smithi008.stdout: "initiated_at": "2023-08-01T19:56:16.160788+0000", 2023-08-01T19:56:16.258 INFO:teuthology.orchestra.run.smithi008.stdout: "age": 0.0028376690000000001, 2023-08-01T19:56:16.258 INFO:teuthology.orchestra.run.smithi008.stdout: "duration": 0.0036950020000000002, 2023-08-01T19:56:16.258 INFO:teuthology.orchestra.run.smithi008.stdout: "type_data": { 2023-08-01T19:56:16.258 INFO:teuthology.orchestra.run.smithi008.stdout: "flag_point": "started", 2023-08-01T19:56:16.258 INFO:teuthology.orchestra.run.smithi008.stdout: "events": [ 2023-08-01T19:56:16.259 INFO:teuthology.orchestra.run.smithi008.stdout: { 2023-08-01T19:56:16.259 INFO:teuthology.orchestra.run.smithi008.stdout: "event": "initiated", 2023-08-01T19:56:16.259 INFO:teuthology.orchestra.run.smithi008.stdout: "time": "2023-08-01T19:56:16.160788+0000", 2023-08-01T19:56:16.259 INFO:teuthology.orchestra.run.smithi008.stdout: "duration": 0 2023-08-01T19:56:16.259 INFO:teuthology.orchestra.run.smithi008.stdout: }, 2023-08-01T19:56:16.259 INFO:teuthology.orchestra.run.smithi008.stdout: { 2023-08-01T19:56:16.259 INFO:teuthology.orchestra.run.smithi008.stdout: "event": "throttled", 2023-08-01T19:56:16.259 INFO:teuthology.orchestra.run.smithi008.stdout: "time": "2023-08-01T19:56:16.160788+0000", 2023-08-01T19:56:16.260 INFO:teuthology.orchestra.run.smithi008.stdout: "duration": 0 2023-08-01T19:56:16.260 INFO:teuthology.orchestra.run.smithi008.stdout: }, 2023-08-01T19:56:16.260 INFO:teuthology.orchestra.run.smithi008.stdout: { 2023-08-01T19:56:16.260 INFO:teuthology.orchestra.run.smithi008.stdout: "event": "header_read", 2023-08-01T19:56:16.260 INFO:teuthology.orchestra.run.smithi008.stdout: "time": "2023-08-01T19:56:16.160788+0000", 2023-08-01T19:56:16.260 INFO:teuthology.orchestra.run.smithi008.stdout: "duration": 4294967295.9999995 2023-08-01T19:56:16.260 INFO:teuthology.orchestra.run.smithi008.stdout: }, 2023-08-01T19:56:16.261 INFO:teuthology.orchestra.run.smithi008.stdout: { 2023-08-01T19:56:16.261 INFO:teuthology.orchestra.run.smithi008.stdout: "event": "all_read", 2023-08-01T19:56:16.261 INFO:teuthology.orchestra.run.smithi008.stdout: "time": "2023-08-01T19:56:16.160794+0000", 2023-08-01T19:56:16.261 INFO:teuthology.orchestra.run.smithi008.stdout: "duration": 6.5429999999999999e-06 2023-08-01T19:56:16.261 INFO:teuthology.orchestra.run.smithi008.stdout: }, 2023-08-01T19:56:16.261 INFO:teuthology.orchestra.run.smithi008.stdout: { 2023-08-01T19:56:16.261 INFO:teuthology.orchestra.run.smithi008.stdout: "event": "dispatched", 2023-08-01T19:56:16.261 INFO:teuthology.orchestra.run.smithi008.stdout: "time": "2023-08-01T19:56:16.160803+0000", 2023-08-01T19:56:16.262 INFO:teuthology.orchestra.run.smithi008.stdout: "duration": 9.2769999999999994e-06 2023-08-01T19:56:16.262 INFO:teuthology.orchestra.run.smithi008.stdout: }, 2023-08-01T19:56:16.262 INFO:teuthology.orchestra.run.smithi008.stdout: { 2023-08-01T19:56:16.262 INFO:teuthology.orchestra.run.smithi008.stdout: "event": "queued_for_pg", 2023-08-01T19:56:16.262 INFO:teuthology.orchestra.run.smithi008.stdout: "time": "2023-08-01T19:56:16.160809+0000", 2023-08-01T19:56:16.262 INFO:teuthology.orchestra.run.smithi008.stdout: "duration": 5.9209999999999997e-06 2023-08-01T19:56:16.262 INFO:teuthology.orchestra.run.smithi008.stdout: }, 2023-08-01T19:56:16.262 INFO:teuthology.orchestra.run.smithi008.stdout: { 2023-08-01T19:56:16.263 INFO:teuthology.orchestra.run.smithi008.stdout: "event": "reached_pg", 2023-08-01T19:56:16.263 INFO:teuthology.orchestra.run.smithi008.stdout: "time": "2023-08-01T19:56:16.160842+0000", 2023-08-01T19:56:16.263 INFO:teuthology.orchestra.run.smithi008.stdout: "duration": 3.2237999999999999e-05 2023-08-01T19:56:16.263 INFO:teuthology.orchestra.run.smithi008.stdout: }, 2023-08-01T19:56:16.263 INFO:teuthology.orchestra.run.smithi008.stdout: { 2023-08-01T19:56:16.263 INFO:teuthology.orchestra.run.smithi008.stdout: "event": "started", 2023-08-01T19:56:16.263 INFO:teuthology.orchestra.run.smithi008.stdout: "time": "2023-08-01T19:56:16.160859+0000", 2023-08-01T19:56:16.264 INFO:teuthology.orchestra.run.smithi008.stdout: "duration": 1.7470999999999999e-05 2023-08-01T19:56:16.264 INFO:teuthology.orchestra.run.smithi008.stdout: } 2023-08-01T19:56:16.264 INFO:teuthology.orchestra.run.smithi008.stdout: ] 2023-08-01T19:56:16.264 INFO:teuthology.orchestra.run.smithi008.stdout: } 2023-08-01T19:56:16.264 INFO:teuthology.orchestra.run.smithi008.stdout: }, 2023-08-01T19:56:16.264 INFO:teuthology.orchestra.run.smithi008.stdout: { 2023-08-01T19:56:16.264 INFO:teuthology.orchestra.run.smithi008.stdout: "description": "osd_repop(client.4668.0:231515 5.8 e69/19 5:1e56e562:::benchmark_data_smithi006_114134_object97854:head v 69'14515, mlcod=69'14512)", 2023-08-01T19:56:16.264 INFO:teuthology.orchestra.run.smithi008.stdout: "initiated_at": "2023-08-01T19:56:16.162185+0000", 2023-08-01T19:56:16.265 INFO:teuthology.orchestra.run.smithi008.stdout: "age": 0.0014407000000000001, 2023-08-01T19:56:16.265 INFO:teuthology.orchestra.run.smithi008.stdout: "duration": 0.002373305, 2023-08-01T19:56:16.265 INFO:teuthology.orchestra.run.smithi008.stdout: "type_data": { 2023-08-01T19:56:16.265 INFO:teuthology.orchestra.run.smithi008.stdout: "flag_point": "started", 2023-08-01T19:56:16.265 INFO:teuthology.orchestra.run.smithi008.stdout: "events": [ 2023-08-01T19:56:16.265 INFO:teuthology.orchestra.run.smithi008.stdout: { 2023-08-01T19:56:16.265 INFO:teuthology.orchestra.run.smithi008.stdout: "event": "initiated", 2023-08-01T19:56:16.265 INFO:teuthology.orchestra.run.smithi008.stdout: "time": "2023-08-01T19:56:16.162185+0000", 2023-08-01T19:56:16.266 INFO:teuthology.orchestra.run.smithi008.stdout: "duration": 0 2023-08-01T19:56:16.266 INFO:teuthology.orchestra.run.smithi008.stdout: }, 2023-08-01T19:56:16.266 INFO:teuthology.orchestra.run.smithi008.stdout: { 2023-08-01T19:56:16.266 INFO:teuthology.orchestra.run.smithi008.stdout: "event": "throttled", 2023-08-01T19:56:16.266 INFO:teuthology.orchestra.run.smithi008.stdout: "time": "2023-08-01T19:56:16.162185+0000", 2023-08-01T19:56:16.266 INFO:teuthology.orchestra.run.smithi008.stdout: "duration": 0 2023-08-01T19:56:16.266 INFO:teuthology.orchestra.run.smithi008.stdout: }, 2023-08-01T19:56:16.267 INFO:teuthology.orchestra.run.smithi008.stdout: { 2023-08-01T19:56:16.267 INFO:teuthology.orchestra.run.smithi008.stdout: "event": "header_read", 2023-08-01T19:56:16.267 INFO:teuthology.orchestra.run.smithi008.stdout: "time": "2023-08-01T19:56:16.162185+0000", 2023-08-01T19:56:16.267 INFO:teuthology.orchestra.run.smithi008.stdout: "duration": 4294967295.9999995 2023-08-01T19:56:16.267 INFO:teuthology.orchestra.run.smithi008.stdout: }, 2023-08-01T19:56:16.267 INFO:teuthology.orchestra.run.smithi008.stdout: { 2023-08-01T19:56:16.267 INFO:teuthology.orchestra.run.smithi008.stdout: "event": "all_read", 2023-08-01T19:56:16.268 INFO:teuthology.orchestra.run.smithi008.stdout: "time": "2023-08-01T19:56:16.162191+0000", 2023-08-01T19:56:16.268 INFO:teuthology.orchestra.run.smithi008.stdout: "duration": 5.9329999999999998e-06 2023-08-01T19:56:16.268 INFO:teuthology.orchestra.run.smithi008.stdout: }, 2023-08-01T19:56:16.268 INFO:teuthology.orchestra.run.smithi008.stdout: { 2023-08-01T19:56:16.268 INFO:teuthology.orchestra.run.smithi008.stdout: "event": "dispatched", 2023-08-01T19:56:16.268 INFO:teuthology.orchestra.run.smithi008.stdout: "time": "2023-08-01T19:56:16.162204+0000", 2023-08-01T19:56:16.268 INFO:teuthology.orchestra.run.smithi008.stdout: "duration": 1.3064000000000001e-05 2023-08-01T19:56:16.269 INFO:teuthology.orchestra.run.smithi008.stdout: }, 2023-08-01T19:56:16.269 INFO:teuthology.orchestra.run.smithi008.stdout: { 2023-08-01T19:56:16.269 INFO:teuthology.orchestra.run.smithi008.stdout: "event": "queued_for_pg", 2023-08-01T19:56:16.269 INFO:teuthology.orchestra.run.smithi008.stdout: "time": "2023-08-01T19:56:16.162209+0000", 2023-08-01T19:56:16.269 INFO:teuthology.orchestra.run.smithi008.stdout: "duration": 5.3669999999999996e-06 2023-08-01T19:56:16.269 INFO:teuthology.orchestra.run.smithi008.stdout: }, 2023-08-01T19:56:16.269 INFO:teuthology.orchestra.run.smithi008.stdout: { 2023-08-01T19:56:16.269 INFO:teuthology.orchestra.run.smithi008.stdout: "event": "reached_pg", 2023-08-01T19:56:16.270 INFO:teuthology.orchestra.run.smithi008.stdout: "time": "2023-08-01T19:56:16.162232+0000", 2023-08-01T19:56:16.270 INFO:teuthology.orchestra.run.smithi008.stdout: "duration": 2.3005000000000001e-05 2023-08-01T19:56:16.270 INFO:teuthology.orchestra.run.smithi008.stdout: }, 2023-08-01T19:56:16.270 INFO:teuthology.orchestra.run.smithi008.stdout: { 2023-08-01T19:56:16.270 INFO:teuthology.orchestra.run.smithi008.stdout: "event": "started", 2023-08-01T19:56:16.270 INFO:teuthology.orchestra.run.smithi008.stdout: "time": "2023-08-01T19:56:16.162243+0000", 2023-08-01T19:56:16.270 INFO:teuthology.orchestra.run.smithi008.stdout: "duration": 1.0643e-05 2023-08-01T19:56:16.271 INFO:teuthology.orchestra.run.smithi008.stdout: } 2023-08-01T19:56:16.271 INFO:teuthology.orchestra.run.smithi008.stdout: ] 2023-08-01T19:56:16.271 INFO:teuthology.orchestra.run.smithi008.stdout: } 2023-08-01T19:56:16.271 INFO:teuthology.orchestra.run.smithi008.stdout: }, 2023-08-01T19:56:16.271 INFO:teuthology.orchestra.run.smithi008.stdout: { 2023-08-01T19:56:16.271 INFO:teuthology.orchestra.run.smithi008.stdout: "description": "osd_repop(client.4668.0:231516 5.0 e69/19 5:01b0ab85:::benchmark_data_smithi006_114134_object97855:head v 69'14695, mlcod=69'14692)", 2023-08-01T19:56:16.271 INFO:teuthology.orchestra.run.smithi008.stdout: "initiated_at": "2023-08-01T19:56:16.162475+0000", 2023-08-01T19:56:16.271 INFO:teuthology.orchestra.run.smithi008.stdout: "age": 0.0011509000000000001, 2023-08-01T19:56:16.272 INFO:teuthology.orchestra.run.smithi008.stdout: "duration": 0.0021557500000000001, 2023-08-01T19:56:16.272 INFO:teuthology.orchestra.run.smithi008.stdout: "type_data": { 2023-08-01T19:56:16.272 INFO:teuthology.orchestra.run.smithi008.stdout: "flag_point": "started", 2023-08-01T19:56:16.272 INFO:teuthology.orchestra.run.smithi008.stdout: "events": [ 2023-08-01T19:56:16.272 INFO:teuthology.orchestra.run.smithi008.stdout: { 2023-08-01T19:56:16.272 INFO:teuthology.orchestra.run.smithi008.stdout: "event": "initiated", 2023-08-01T19:56:16.272 INFO:teuthology.orchestra.run.smithi008.stdout: "time": "2023-08-01T19:56:16.162475+0000", 2023-08-01T19:56:16.273 INFO:teuthology.orchestra.run.smithi008.stdout: "duration": 0 2023-08-01T19:56:16.273 INFO:teuthology.orchestra.run.smithi008.stdout: }, 2023-08-01T19:56:16.273 INFO:teuthology.orchestra.run.smithi008.stdout: { 2023-08-01T19:56:16.273 INFO:teuthology.orchestra.run.smithi008.stdout: "event": "throttled", 2023-08-01T19:56:16.273 INFO:teuthology.orchestra.run.smithi008.stdout: "time": "2023-08-01T19:56:16.162475+0000", 2023-08-01T19:56:16.273 INFO:teuthology.orchestra.run.smithi008.stdout: "duration": 0 2023-08-01T19:56:16.273 INFO:teuthology.orchestra.run.smithi008.stdout: }, 2023-08-01T19:56:16.274 INFO:teuthology.orchestra.run.smithi008.stdout: { 2023-08-01T19:56:16.274 INFO:teuthology.orchestra.run.smithi008.stdout: "event": "header_read", 2023-08-01T19:56:16.274 INFO:teuthology.orchestra.run.smithi008.stdout: "time": "2023-08-01T19:56:16.162475+0000", 2023-08-01T19:56:16.274 INFO:teuthology.orchestra.run.smithi008.stdout: "duration": 4294967295.9999995 2023-08-01T19:56:16.274 INFO:teuthology.orchestra.run.smithi008.stdout: }, 2023-08-01T19:56:16.274 INFO:teuthology.orchestra.run.smithi008.stdout: { 2023-08-01T19:56:16.274 INFO:teuthology.orchestra.run.smithi008.stdout: "event": "all_read", 2023-08-01T19:56:16.274 INFO:teuthology.orchestra.run.smithi008.stdout: "time": "2023-08-01T19:56:16.162479+0000", 2023-08-01T19:56:16.275 INFO:teuthology.orchestra.run.smithi008.stdout: "duration": 3.9689999999999996e-06 2023-08-01T19:56:16.275 INFO:teuthology.orchestra.run.smithi008.stdout: }, 2023-08-01T19:56:16.275 INFO:teuthology.orchestra.run.smithi008.stdout: { 2023-08-01T19:56:16.275 INFO:teuthology.orchestra.run.smithi008.stdout: "event": "dispatched", 2023-08-01T19:56:16.275 INFO:teuthology.orchestra.run.smithi008.stdout: "time": "2023-08-01T19:56:16.162486+0000", 2023-08-01T19:56:16.275 INFO:teuthology.orchestra.run.smithi008.stdout: "duration": 7.3819999999999998e-06 2023-08-01T19:56:16.275 INFO:teuthology.orchestra.run.smithi008.stdout: }, 2023-08-01T19:56:16.276 INFO:teuthology.orchestra.run.smithi008.stdout: { 2023-08-01T19:56:16.276 INFO:teuthology.orchestra.run.smithi008.stdout: "event": "queued_for_pg", 2023-08-01T19:56:16.276 INFO:teuthology.orchestra.run.smithi008.stdout: "time": "2023-08-01T19:56:16.162491+0000", 2023-08-01T19:56:16.276 INFO:teuthology.orchestra.run.smithi008.stdout: "duration": 4.7400000000000004e-06 2023-08-01T19:56:16.276 INFO:teuthology.orchestra.run.smithi008.stdout: }, 2023-08-01T19:56:16.276 INFO:teuthology.orchestra.run.smithi008.stdout: { 2023-08-01T19:56:16.276 INFO:teuthology.orchestra.run.smithi008.stdout: "event": "reached_pg", 2023-08-01T19:56:16.276 INFO:teuthology.orchestra.run.smithi008.stdout: "time": "2023-08-01T19:56:16.162522+0000", 2023-08-01T19:56:16.277 INFO:teuthology.orchestra.run.smithi008.stdout: "duration": 3.1538999999999997e-05 2023-08-01T19:56:16.277 INFO:teuthology.orchestra.run.smithi008.stdout: }, 2023-08-01T19:56:16.277 INFO:teuthology.orchestra.run.smithi008.stdout: { 2023-08-01T19:56:16.277 INFO:teuthology.orchestra.run.smithi008.stdout: "event": "started", 2023-08-01T19:56:16.277 INFO:teuthology.orchestra.run.smithi008.stdout: "time": "2023-08-01T19:56:16.162541+0000", 2023-08-01T19:56:16.277 INFO:teuthology.orchestra.run.smithi008.stdout: "duration": 1.9031000000000001e-05 2023-08-01T19:56:16.277 INFO:teuthology.orchestra.run.smithi008.stdout: } 2023-08-01T19:56:16.278 INFO:teuthology.orchestra.run.smithi008.stdout: ] 2023-08-01T19:56:16.278 INFO:teuthology.orchestra.run.smithi008.stdout: } 2023-08-01T19:56:16.278 INFO:teuthology.orchestra.run.smithi008.stdout: }, 2023-08-01T19:56:16.278 INFO:teuthology.orchestra.run.smithi008.stdout: { 2023-08-01T19:56:16.278 INFO:teuthology.orchestra.run.smithi008.stdout: "description": "osd_op(client.4668.0:231518 5.2 5:47a58794:::benchmark_data_smithi006_114134_object97857:head [delete] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e69)", 2023-08-01T19:56:16.278 INFO:teuthology.orchestra.run.smithi008.stdout: "initiated_at": "2023-08-01T19:56:16.164118+0000", 2023-08-01T19:56:16.278 INFO:teuthology.orchestra.run.smithi008.stdout: "age": 4294967295.9995074, 2023-08-01T19:56:16.278 INFO:teuthology.orchestra.run.smithi008.stdout: "duration": 0.00058235700000000004, 2023-08-01T19:56:16.279 INFO:teuthology.orchestra.run.smithi008.stdout: "type_data": { 2023-08-01T19:56:16.279 INFO:teuthology.orchestra.run.smithi008.stdout: "flag_point": "started", 2023-08-01T19:56:16.279 INFO:teuthology.orchestra.run.smithi008.stdout: "client_info": { 2023-08-01T19:56:16.279 INFO:teuthology.orchestra.run.smithi008.stdout: "client": "client.4668", 2023-08-01T19:56:16.279 INFO:teuthology.orchestra.run.smithi008.stdout: "client_addr": "172.21.15.6:0/1709472247", 2023-08-01T19:56:16.279 INFO:teuthology.orchestra.run.smithi008.stdout: "tid": 231518 2023-08-01T19:56:16.279 INFO:teuthology.orchestra.run.smithi008.stdout: }, 2023-08-01T19:56:16.280 INFO:teuthology.orchestra.run.smithi008.stdout: "events": [ 2023-08-01T19:56:16.280 INFO:teuthology.orchestra.run.smithi008.stdout: { 2023-08-01T19:56:16.280 INFO:teuthology.orchestra.run.smithi008.stdout: "event": "initiated", 2023-08-01T19:56:16.280 INFO:teuthology.orchestra.run.smithi008.stdout: "time": "2023-08-01T19:56:16.164118+0000", 2023-08-01T19:56:16.280 INFO:teuthology.orchestra.run.smithi008.stdout: "duration": 0 2023-08-01T19:56:16.280 INFO:teuthology.orchestra.run.smithi008.stdout: }, 2023-08-01T19:56:16.280 INFO:teuthology.orchestra.run.smithi008.stdout: { 2023-08-01T19:56:16.280 INFO:teuthology.orchestra.run.smithi008.stdout: "event": "throttled", 2023-08-01T19:56:16.281 INFO:teuthology.orchestra.run.smithi008.stdout: "time": "2023-08-01T19:56:16.164118+0000", 2023-08-01T19:56:16.281 INFO:teuthology.orchestra.run.smithi008.stdout: "duration": 0 2023-08-01T19:56:16.281 INFO:teuthology.orchestra.run.smithi008.stdout: }, 2023-08-01T19:56:16.281 INFO:teuthology.orchestra.run.smithi008.stdout: { 2023-08-01T19:56:16.281 INFO:teuthology.orchestra.run.smithi008.stdout: "event": "header_read", 2023-08-01T19:56:16.281 INFO:teuthology.orchestra.run.smithi008.stdout: "time": "2023-08-01T19:56:16.164117+0000", 2023-08-01T19:56:16.281 INFO:teuthology.orchestra.run.smithi008.stdout: "duration": 4294967295.999999 2023-08-01T19:56:16.281 INFO:teuthology.orchestra.run.smithi008.stdout: }, 2023-08-01T19:56:16.282 INFO:teuthology.orchestra.run.smithi008.stdout: { 2023-08-01T19:56:16.282 INFO:teuthology.orchestra.run.smithi008.stdout: "event": "all_read", 2023-08-01T19:56:16.282 INFO:teuthology.orchestra.run.smithi008.stdout: "time": "2023-08-01T19:56:16.164123+0000", 2023-08-01T19:56:16.282 INFO:teuthology.orchestra.run.smithi008.stdout: "duration": 5.5010000000000004e-06 2023-08-01T19:56:16.282 INFO:teuthology.orchestra.run.smithi008.stdout: }, 2023-08-01T19:56:16.282 INFO:teuthology.orchestra.run.smithi008.stdout: { 2023-08-01T19:56:16.282 INFO:teuthology.orchestra.run.smithi008.stdout: "event": "dispatched", 2023-08-01T19:56:16.282 INFO:teuthology.orchestra.run.smithi008.stdout: "time": "2023-08-01T19:56:16.164131+0000", 2023-08-01T19:56:16.283 INFO:teuthology.orchestra.run.smithi008.stdout: "duration": 8.3729999999999993e-06 2023-08-01T19:56:16.283 INFO:teuthology.orchestra.run.smithi008.stdout: }, 2023-08-01T19:56:16.283 INFO:teuthology.orchestra.run.smithi008.stdout: { 2023-08-01T19:56:16.283 INFO:teuthology.orchestra.run.smithi008.stdout: "event": "queued_for_pg", 2023-08-01T19:56:16.283 INFO:teuthology.orchestra.run.smithi008.stdout: "time": "2023-08-01T19:56:16.164136+0000", 2023-08-01T19:56:16.283 INFO:teuthology.orchestra.run.smithi008.stdout: "duration": 4.2760000000000002e-06 2023-08-01T19:56:16.283 INFO:teuthology.orchestra.run.smithi008.stdout: }, 2023-08-01T19:56:16.283 INFO:teuthology.orchestra.run.smithi008.stdout: { 2023-08-01T19:56:16.284 INFO:teuthology.orchestra.run.smithi008.stdout: "event": "reached_pg", 2023-08-01T19:56:16.284 INFO:teuthology.orchestra.run.smithi008.stdout: "time": "2023-08-01T19:56:16.164185+0000", 2023-08-01T19:56:16.284 INFO:teuthology.orchestra.run.smithi008.stdout: "duration": 4.9580999999999998e-05 2023-08-01T19:56:16.284 INFO:teuthology.orchestra.run.smithi008.stdout: }, 2023-08-01T19:56:16.284 INFO:teuthology.orchestra.run.smithi008.stdout: { 2023-08-01T19:56:16.284 INFO:teuthology.orchestra.run.smithi008.stdout: "event": "started", 2023-08-01T19:56:16.284 INFO:teuthology.orchestra.run.smithi008.stdout: "time": "2023-08-01T19:56:16.164332+0000", 2023-08-01T19:56:16.285 INFO:teuthology.orchestra.run.smithi008.stdout: "duration": 0.00014690499999999999 2023-08-01T19:56:16.285 INFO:teuthology.orchestra.run.smithi008.stdout: } 2023-08-01T19:56:16.285 INFO:teuthology.orchestra.run.smithi008.stdout: ] 2023-08-01T19:56:16.285 INFO:teuthology.orchestra.run.smithi008.stdout: } 2023-08-01T19:56:16.285 INFO:teuthology.orchestra.run.smithi008.stdout: }, 2023-08-01T19:56:16.285 INFO:teuthology.orchestra.run.smithi008.stdout: { 2023-08-01T19:56:16.285 INFO:teuthology.orchestra.run.smithi008.stdout: "description": "osd_op(client.4668.0:231520 5.2 5.84e887f2 (undecoded) ondisk+write+known_if_redirected+supports_pool_eio e69)", 2023-08-01T19:56:16.285 INFO:teuthology.orchestra.run.smithi008.stdout: "initiated_at": "2023-08-01T19:56:16.164145+0000", 2023-08-01T19:56:16.286 INFO:teuthology.orchestra.run.smithi008.stdout: "age": 4294967295.9994812, 2023-08-01T19:56:16.286 INFO:teuthology.orchestra.run.smithi008.stdout: "duration": 0.00062981099999999998, 2023-08-01T19:56:16.286 INFO:teuthology.orchestra.run.smithi008.stdout: "type_data": { 2023-08-01T19:56:16.286 INFO:teuthology.orchestra.run.smithi008.stdout: "flag_point": "queued for pg", 2023-08-01T19:56:16.286 INFO:teuthology.orchestra.run.smithi008.stdout: "client_info": { 2023-08-01T19:56:16.286 INFO:teuthology.orchestra.run.smithi008.stdout: "client": "client.4668", 2023-08-01T19:56:16.286 INFO:teuthology.orchestra.run.smithi008.stdout: "client_addr": "172.21.15.6:0/1709472247", 2023-08-01T19:56:16.286 INFO:teuthology.orchestra.run.smithi008.stdout: "tid": 231520 2023-08-01T19:56:16.287 INFO:teuthology.orchestra.run.smithi008.stdout: }, 2023-08-01T19:56:16.287 INFO:teuthology.orchestra.run.smithi008.stdout: "events": [ 2023-08-01T19:56:16.287 INFO:teuthology.orchestra.run.smithi008.stdout: { 2023-08-01T19:56:16.287 INFO:teuthology.orchestra.run.smithi008.stdout: "event": "initiated", 2023-08-01T19:56:16.287 INFO:teuthology.orchestra.run.smithi008.stdout: "time": "2023-08-01T19:56:16.164145+0000", 2023-08-01T19:56:16.287 INFO:teuthology.orchestra.run.smithi008.stdout: "duration": 0 2023-08-01T19:56:16.287 INFO:teuthology.orchestra.run.smithi008.stdout: }, 2023-08-01T19:56:16.287 INFO:teuthology.orchestra.run.smithi008.stdout: { 2023-08-01T19:56:16.288 INFO:teuthology.orchestra.run.smithi008.stdout: "event": "throttled", 2023-08-01T19:56:16.288 INFO:teuthology.orchestra.run.smithi008.stdout: "time": "2023-08-01T19:56:16.164145+0000", 2023-08-01T19:56:16.288 INFO:teuthology.orchestra.run.smithi008.stdout: "duration": 0 2023-08-01T19:56:16.288 INFO:teuthology.orchestra.run.smithi008.stdout: }, 2023-08-01T19:56:16.288 INFO:teuthology.orchestra.run.smithi008.stdout: { 2023-08-01T19:56:16.288 INFO:teuthology.orchestra.run.smithi008.stdout: "event": "header_read", 2023-08-01T19:56:16.288 INFO:teuthology.orchestra.run.smithi008.stdout: "time": "2023-08-01T19:56:16.164144+0000", 2023-08-01T19:56:16.289 INFO:teuthology.orchestra.run.smithi008.stdout: "duration": 4294967295.9999995 2023-08-01T19:56:16.289 INFO:teuthology.orchestra.run.smithi008.stdout: }, 2023-08-01T19:56:16.289 INFO:teuthology.orchestra.run.smithi008.stdout: { 2023-08-01T19:56:16.289 INFO:teuthology.orchestra.run.smithi008.stdout: "event": "all_read", 2023-08-01T19:56:16.289 INFO:teuthology.orchestra.run.smithi008.stdout: "time": "2023-08-01T19:56:16.164146+0000", 2023-08-01T19:56:16.289 INFO:teuthology.orchestra.run.smithi008.stdout: "duration": 1.9769999999999999e-06 2023-08-01T19:56:16.289 INFO:teuthology.orchestra.run.smithi008.stdout: }, 2023-08-01T19:56:16.289 INFO:teuthology.orchestra.run.smithi008.stdout: { 2023-08-01T19:56:16.290 INFO:teuthology.orchestra.run.smithi008.stdout: "event": "dispatched", 2023-08-01T19:56:16.290 INFO:teuthology.orchestra.run.smithi008.stdout: "time": "2023-08-01T19:56:16.164155+0000", 2023-08-01T19:56:16.290 INFO:teuthology.orchestra.run.smithi008.stdout: "duration": 8.5590000000000006e-06 2023-08-01T19:56:16.290 INFO:teuthology.orchestra.run.smithi008.stdout: }, 2023-08-01T19:56:16.290 INFO:teuthology.orchestra.run.smithi008.stdout: { 2023-08-01T19:56:16.290 INFO:teuthology.orchestra.run.smithi008.stdout: "event": "queued_for_pg", 2023-08-01T19:56:16.290 INFO:teuthology.orchestra.run.smithi008.stdout: "time": "2023-08-01T19:56:16.164158+0000", 2023-08-01T19:56:16.290 INFO:teuthology.orchestra.run.smithi008.stdout: "duration": 3.0800000000000002e-06 2023-08-01T19:56:16.291 INFO:teuthology.orchestra.run.smithi008.stdout: } 2023-08-01T19:56:16.291 INFO:teuthology.orchestra.run.smithi008.stdout: ] 2023-08-01T19:56:16.291 INFO:teuthology.orchestra.run.smithi008.stdout: } 2023-08-01T19:56:16.291 INFO:teuthology.orchestra.run.smithi008.stdout: }, 2023-08-01T19:56:16.291 INFO:teuthology.orchestra.run.smithi008.stdout: { 2023-08-01T19:56:16.291 INFO:teuthology.orchestra.run.smithi008.stdout: "description": "osd_op(client.4668.0:231522 5.2 5.b78b6e52 (undecoded) ondisk+write+known_if_redirected+supports_pool_eio e69)", 2023-08-01T19:56:16.291 INFO:teuthology.orchestra.run.smithi008.stdout: "initiated_at": "2023-08-01T19:56:16.164178+0000", 2023-08-01T19:56:16.292 INFO:teuthology.orchestra.run.smithi008.stdout: "age": 4294967295.9994483, 2023-08-01T19:56:16.292 INFO:teuthology.orchestra.run.smithi008.stdout: "duration": 0.00065712500000000005, 2023-08-01T19:56:16.292 INFO:teuthology.orchestra.run.smithi008.stdout: "type_data": { 2023-08-01T19:56:16.292 INFO:teuthology.orchestra.run.smithi008.stdout: "flag_point": "queued for pg", 2023-08-01T19:56:16.292 INFO:teuthology.orchestra.run.smithi008.stdout: "client_info": { 2023-08-01T19:56:16.292 INFO:teuthology.orchestra.run.smithi008.stdout: "client": "client.4668", 2023-08-01T19:56:16.292 INFO:teuthology.orchestra.run.smithi008.stdout: "client_addr": "172.21.15.6:0/1709472247", 2023-08-01T19:56:16.292 INFO:teuthology.orchestra.run.smithi008.stdout: "tid": 231522 2023-08-01T19:56:16.293 INFO:teuthology.orchestra.run.smithi008.stdout: }, 2023-08-01T19:56:16.293 INFO:teuthology.orchestra.run.smithi008.stdout: "events": [ 2023-08-01T19:56:16.293 INFO:teuthology.orchestra.run.smithi008.stdout: { 2023-08-01T19:56:16.293 INFO:teuthology.orchestra.run.smithi008.stdout: "event": "initiated", 2023-08-01T19:56:16.293 INFO:teuthology.orchestra.run.smithi008.stdout: "time": "2023-08-01T19:56:16.164178+0000", 2023-08-01T19:56:16.293 INFO:teuthology.orchestra.run.smithi008.stdout: "duration": 0 2023-08-01T19:56:16.293 INFO:teuthology.orchestra.run.smithi008.stdout: }, 2023-08-01T19:56:16.294 INFO:teuthology.orchestra.run.smithi008.stdout: { 2023-08-01T19:56:16.294 INFO:teuthology.orchestra.run.smithi008.stdout: "event": "throttled", 2023-08-01T19:56:16.294 INFO:teuthology.orchestra.run.smithi008.stdout: "time": "2023-08-01T19:56:16.164178+0000", 2023-08-01T19:56:16.294 INFO:teuthology.orchestra.run.smithi008.stdout: "duration": 0 2023-08-01T19:56:16.294 INFO:teuthology.orchestra.run.smithi008.stdout: }, 2023-08-01T19:56:16.294 INFO:teuthology.orchestra.run.smithi008.stdout: { 2023-08-01T19:56:16.294 INFO:teuthology.orchestra.run.smithi008.stdout: "event": "header_read", 2023-08-01T19:56:16.294 INFO:teuthology.orchestra.run.smithi008.stdout: "time": "2023-08-01T19:56:16.164177+0000", 2023-08-01T19:56:16.295 INFO:teuthology.orchestra.run.smithi008.stdout: "duration": 4294967295.9999995 2023-08-01T19:56:16.295 INFO:teuthology.orchestra.run.smithi008.stdout: }, 2023-08-01T19:56:16.295 INFO:teuthology.orchestra.run.smithi008.stdout: { 2023-08-01T19:56:16.295 INFO:teuthology.orchestra.run.smithi008.stdout: "event": "all_read", 2023-08-01T19:56:16.295 INFO:teuthology.orchestra.run.smithi008.stdout: "time": "2023-08-01T19:56:16.164179+0000", 2023-08-01T19:56:16.295 INFO:teuthology.orchestra.run.smithi008.stdout: "duration": 2.1770000000000001e-06 2023-08-01T19:56:16.295 INFO:teuthology.orchestra.run.smithi008.stdout: }, 2023-08-01T19:56:16.295 INFO:teuthology.orchestra.run.smithi008.stdout: { 2023-08-01T19:56:16.296 INFO:teuthology.orchestra.run.smithi008.stdout: "event": "dispatched", 2023-08-01T19:56:16.296 INFO:teuthology.orchestra.run.smithi008.stdout: "time": "2023-08-01T19:56:16.164190+0000", 2023-08-01T19:56:16.296 INFO:teuthology.orchestra.run.smithi008.stdout: "duration": 1.075e-05 2023-08-01T19:56:16.296 INFO:teuthology.orchestra.run.smithi008.stdout: }, 2023-08-01T19:56:16.296 INFO:teuthology.orchestra.run.smithi008.stdout: { 2023-08-01T19:56:16.296 INFO:teuthology.orchestra.run.smithi008.stdout: "event": "queued_for_pg", 2023-08-01T19:56:16.296 INFO:teuthology.orchestra.run.smithi008.stdout: "time": "2023-08-01T19:56:16.164194+0000", 2023-08-01T19:56:16.297 INFO:teuthology.orchestra.run.smithi008.stdout: "duration": 3.4960000000000001e-06 2023-08-01T19:56:16.297 INFO:teuthology.orchestra.run.smithi008.stdout: } 2023-08-01T19:56:16.297 INFO:teuthology.orchestra.run.smithi008.stdout: ] 2023-08-01T19:56:16.297 INFO:teuthology.orchestra.run.smithi008.stdout: } 2023-08-01T19:56:16.297 INFO:teuthology.orchestra.run.smithi008.stdout: }, 2023-08-01T19:56:16.297 INFO:teuthology.orchestra.run.smithi008.stdout: { 2023-08-01T19:56:16.297 INFO:teuthology.orchestra.run.smithi008.stdout: "description": "osd_op(client.4668.0:231523 5.6 5:6e17d8cf:::benchmark_data_smithi006_114134_object97862:head [delete] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e69)", 2023-08-01T19:56:16.297 INFO:teuthology.orchestra.run.smithi008.stdout: "initiated_at": "2023-08-01T19:56:16.164459+0000", 2023-08-01T19:56:16.298 INFO:teuthology.orchestra.run.smithi008.stdout: "age": 4294967295.9991665, 2023-08-01T19:56:16.298 INFO:teuthology.orchestra.run.smithi008.stdout: "duration": 0.00043793100000000002, 2023-08-01T19:56:16.298 INFO:teuthology.orchestra.run.smithi008.stdout: "type_data": { 2023-08-01T19:56:16.298 INFO:teuthology.orchestra.run.smithi008.stdout: "flag_point": "started", 2023-08-01T19:56:16.298 INFO:teuthology.orchestra.run.smithi008.stdout: "client_info": { 2023-08-01T19:56:16.298 INFO:teuthology.orchestra.run.smithi008.stdout: "client": "client.4668", 2023-08-01T19:56:16.298 INFO:teuthology.orchestra.run.smithi008.stdout: "client_addr": "172.21.15.6:0/1709472247", 2023-08-01T19:56:16.298 INFO:teuthology.orchestra.run.smithi008.stdout: "tid": 231523 2023-08-01T19:56:16.299 INFO:teuthology.orchestra.run.smithi008.stdout: }, 2023-08-01T19:56:16.299 INFO:teuthology.orchestra.run.smithi008.stdout: "events": [ 2023-08-01T19:56:16.299 INFO:teuthology.orchestra.run.smithi008.stdout: { 2023-08-01T19:56:16.299 INFO:teuthology.orchestra.run.smithi008.stdout: "event": "initiated", 2023-08-01T19:56:16.299 INFO:teuthology.orchestra.run.smithi008.stdout: "time": "2023-08-01T19:56:16.164459+0000", 2023-08-01T19:56:16.299 INFO:teuthology.orchestra.run.smithi008.stdout: "duration": 0 2023-08-01T19:56:16.299 INFO:teuthology.orchestra.run.smithi008.stdout: }, 2023-08-01T19:56:16.300 INFO:teuthology.orchestra.run.smithi008.stdout: { 2023-08-01T19:56:16.300 INFO:teuthology.orchestra.run.smithi008.stdout: "event": "throttled", 2023-08-01T19:56:16.300 INFO:teuthology.orchestra.run.smithi008.stdout: "time": "2023-08-01T19:56:16.164459+0000", 2023-08-01T19:56:16.300 INFO:teuthology.orchestra.run.smithi008.stdout: "duration": 0 2023-08-01T19:56:16.300 INFO:teuthology.orchestra.run.smithi008.stdout: }, 2023-08-01T19:56:16.300 INFO:teuthology.orchestra.run.smithi008.stdout: { 2023-08-01T19:56:16.300 INFO:teuthology.orchestra.run.smithi008.stdout: "event": "header_read", 2023-08-01T19:56:16.300 INFO:teuthology.orchestra.run.smithi008.stdout: "time": "2023-08-01T19:56:16.164459+0000", 2023-08-01T19:56:16.301 INFO:teuthology.orchestra.run.smithi008.stdout: "duration": 4294967295.9999995 2023-08-01T19:56:16.301 INFO:teuthology.orchestra.run.smithi008.stdout: }, 2023-08-01T19:56:16.301 INFO:teuthology.orchestra.run.smithi008.stdout: { 2023-08-01T19:56:16.301 INFO:teuthology.orchestra.run.smithi008.stdout: "event": "all_read", 2023-08-01T19:56:16.301 INFO:teuthology.orchestra.run.smithi008.stdout: "time": "2023-08-01T19:56:16.164462+0000", 2023-08-01T19:56:16.301 INFO:teuthology.orchestra.run.smithi008.stdout: "duration": 3.2990000000000001e-06 2023-08-01T19:56:16.301 INFO:teuthology.orchestra.run.smithi008.stdout: }, 2023-08-01T19:56:16.302 INFO:teuthology.orchestra.run.smithi008.stdout: { 2023-08-01T19:56:16.302 INFO:teuthology.orchestra.run.smithi008.stdout: "event": "dispatched", 2023-08-01T19:56:16.302 INFO:teuthology.orchestra.run.smithi008.stdout: "time": "2023-08-01T19:56:16.164472+0000", 2023-08-01T19:56:16.302 INFO:teuthology.orchestra.run.smithi008.stdout: "duration": 1.0131e-05 2023-08-01T19:56:16.302 INFO:teuthology.orchestra.run.smithi008.stdout: }, 2023-08-01T19:56:16.302 INFO:teuthology.orchestra.run.smithi008.stdout: { 2023-08-01T19:56:16.302 INFO:teuthology.orchestra.run.smithi008.stdout: "event": "queued_for_pg", 2023-08-01T19:56:16.302 INFO:teuthology.orchestra.run.smithi008.stdout: "time": "2023-08-01T19:56:16.164475+0000", 2023-08-01T19:56:16.303 INFO:teuthology.orchestra.run.smithi008.stdout: "duration": 3.2109999999999998e-06 2023-08-01T19:56:16.303 INFO:teuthology.orchestra.run.smithi008.stdout: }, 2023-08-01T19:56:16.303 INFO:teuthology.orchestra.run.smithi008.stdout: { 2023-08-01T19:56:16.303 INFO:teuthology.orchestra.run.smithi008.stdout: "event": "reached_pg", 2023-08-01T19:56:16.303 INFO:teuthology.orchestra.run.smithi008.stdout: "time": "2023-08-01T19:56:16.164516+0000", 2023-08-01T19:56:16.303 INFO:teuthology.orchestra.run.smithi008.stdout: "duration": 4.0358999999999998e-05 2023-08-01T19:56:16.303 INFO:teuthology.orchestra.run.smithi008.stdout: }, 2023-08-01T19:56:16.303 INFO:teuthology.orchestra.run.smithi008.stdout: { 2023-08-01T19:56:16.304 INFO:teuthology.orchestra.run.smithi008.stdout: "event": "started", 2023-08-01T19:56:16.304 INFO:teuthology.orchestra.run.smithi008.stdout: "time": "2023-08-01T19:56:16.164645+0000", 2023-08-01T19:56:16.304 INFO:teuthology.orchestra.run.smithi008.stdout: "duration": 0.00012888999999999999 2023-08-01T19:56:16.304 INFO:teuthology.orchestra.run.smithi008.stdout: } 2023-08-01T19:56:16.304 INFO:teuthology.orchestra.run.smithi008.stdout: ] 2023-08-01T19:56:16.304 INFO:teuthology.orchestra.run.smithi008.stdout: } 2023-08-01T19:56:16.304 INFO:teuthology.orchestra.run.smithi008.stdout: }, 2023-08-01T19:56:16.305 INFO:teuthology.orchestra.run.smithi008.stdout: { 2023-08-01T19:56:16.305 INFO:teuthology.orchestra.run.smithi008.stdout: "description": "osd_repop(client.4668.0:231517 5.8 e69/19 5:1aed020d:::benchmark_data_smithi006_114134_object97856:head v 69'14516, mlcod=69'14512)", 2023-08-01T19:56:16.305 INFO:teuthology.orchestra.run.smithi008.stdout: "initiated_at": "2023-08-01T19:56:16.164524+0000", 2023-08-01T19:56:16.305 INFO:teuthology.orchestra.run.smithi008.stdout: "age": 4294967295.9991016, 2023-08-01T19:56:16.305 INFO:teuthology.orchestra.run.smithi008.stdout: "duration": 0.00044163699999999999, 2023-08-01T19:56:16.305 INFO:teuthology.orchestra.run.smithi008.stdout: "type_data": { 2023-08-01T19:56:16.305 INFO:teuthology.orchestra.run.smithi008.stdout: "flag_point": "started", 2023-08-01T19:56:16.305 INFO:teuthology.orchestra.run.smithi008.stdout: "events": [ 2023-08-01T19:56:16.306 INFO:teuthology.orchestra.run.smithi008.stdout: { 2023-08-01T19:56:16.306 INFO:teuthology.orchestra.run.smithi008.stdout: "event": "initiated", 2023-08-01T19:56:16.306 INFO:teuthology.orchestra.run.smithi008.stdout: "time": "2023-08-01T19:56:16.164524+0000", 2023-08-01T19:56:16.306 INFO:teuthology.orchestra.run.smithi008.stdout: "duration": 0 2023-08-01T19:56:16.306 INFO:teuthology.orchestra.run.smithi008.stdout: }, 2023-08-01T19:56:16.306 INFO:teuthology.orchestra.run.smithi008.stdout: { 2023-08-01T19:56:16.306 INFO:teuthology.orchestra.run.smithi008.stdout: "event": "throttled", 2023-08-01T19:56:16.306 INFO:teuthology.orchestra.run.smithi008.stdout: "time": "2023-08-01T19:56:16.164524+0000", 2023-08-01T19:56:16.307 INFO:teuthology.orchestra.run.smithi008.stdout: "duration": 0 2023-08-01T19:56:16.307 INFO:teuthology.orchestra.run.smithi008.stdout: }, 2023-08-01T19:56:16.307 INFO:teuthology.orchestra.run.smithi008.stdout: { 2023-08-01T19:56:16.307 INFO:teuthology.orchestra.run.smithi008.stdout: "event": "header_read", 2023-08-01T19:56:16.307 INFO:teuthology.orchestra.run.smithi008.stdout: "time": "2023-08-01T19:56:16.164524+0000", 2023-08-01T19:56:16.307 INFO:teuthology.orchestra.run.smithi008.stdout: "duration": 4294967295.9999995 2023-08-01T19:56:16.307 INFO:teuthology.orchestra.run.smithi008.stdout: }, 2023-08-01T19:56:16.307 INFO:teuthology.orchestra.run.smithi008.stdout: { 2023-08-01T19:56:16.308 INFO:teuthology.orchestra.run.smithi008.stdout: "event": "all_read", 2023-08-01T19:56:16.308 INFO:teuthology.orchestra.run.smithi008.stdout: "time": "2023-08-01T19:56:16.164528+0000", 2023-08-01T19:56:16.308 INFO:teuthology.orchestra.run.smithi008.stdout: "duration": 4.1930000000000003e-06 2023-08-01T19:56:16.308 INFO:teuthology.orchestra.run.smithi008.stdout: }, 2023-08-01T19:56:16.308 INFO:teuthology.orchestra.run.smithi008.stdout: { 2023-08-01T19:56:16.308 INFO:teuthology.orchestra.run.smithi008.stdout: "event": "dispatched", 2023-08-01T19:56:16.308 INFO:teuthology.orchestra.run.smithi008.stdout: "time": "2023-08-01T19:56:16.164533+0000", 2023-08-01T19:56:16.308 INFO:teuthology.orchestra.run.smithi008.stdout: "duration": 5.1499999999999998e-06 2023-08-01T19:56:16.309 INFO:teuthology.orchestra.run.smithi008.stdout: }, 2023-08-01T19:56:16.309 INFO:teuthology.orchestra.run.smithi008.stdout: { 2023-08-01T19:56:16.309 INFO:teuthology.orchestra.run.smithi008.stdout: "event": "queued_for_pg", 2023-08-01T19:56:16.309 INFO:teuthology.orchestra.run.smithi008.stdout: "time": "2023-08-01T19:56:16.164536+0000", 2023-08-01T19:56:16.309 INFO:teuthology.orchestra.run.smithi008.stdout: "duration": 3.05e-06 2023-08-01T19:56:16.309 INFO:teuthology.orchestra.run.smithi008.stdout: }, 2023-08-01T19:56:16.309 INFO:teuthology.orchestra.run.smithi008.stdout: { 2023-08-01T19:56:16.309 INFO:teuthology.orchestra.run.smithi008.stdout: "event": "reached_pg", 2023-08-01T19:56:16.310 INFO:teuthology.orchestra.run.smithi008.stdout: "time": "2023-08-01T19:56:16.164569+0000", 2023-08-01T19:56:16.310 INFO:teuthology.orchestra.run.smithi008.stdout: "duration": 3.2225999999999999e-05 2023-08-01T19:56:16.310 INFO:teuthology.orchestra.run.smithi008.stdout: }, 2023-08-01T19:56:16.310 INFO:teuthology.orchestra.run.smithi008.stdout: { 2023-08-01T19:56:16.310 INFO:teuthology.orchestra.run.smithi008.stdout: "event": "started", 2023-08-01T19:56:16.310 INFO:teuthology.orchestra.run.smithi008.stdout: "time": "2023-08-01T19:56:16.164586+0000", 2023-08-01T19:56:16.310 INFO:teuthology.orchestra.run.smithi008.stdout: "duration": 1.7853999999999999e-05 2023-08-01T19:56:16.310 INFO:teuthology.orchestra.run.smithi008.stdout: } 2023-08-01T19:56:16.311 INFO:teuthology.orchestra.run.smithi008.stdout: ] 2023-08-01T19:56:16.311 INFO:teuthology.orchestra.run.smithi008.stdout: } 2023-08-01T19:56:16.311 INFO:teuthology.orchestra.run.smithi008.stdout: }, 2023-08-01T19:56:16.311 INFO:teuthology.orchestra.run.smithi008.stdout: { 2023-08-01T19:56:16.311 INFO:teuthology.orchestra.run.smithi008.stdout: "description": "osd_repop(client.4668.0:231521 5.0 e69/19 5:004dd483:::benchmark_data_smithi006_114134_object97860:head v 69'14696, mlcod=69'14693)", 2023-08-01T19:56:16.311 INFO:teuthology.orchestra.run.smithi008.stdout: "initiated_at": "2023-08-01T19:56:16.164637+0000", 2023-08-01T19:56:16.311 INFO:teuthology.orchestra.run.smithi008.stdout: "age": 4294967295.9989886, 2023-08-01T19:56:16.312 INFO:teuthology.orchestra.run.smithi008.stdout: "duration": 0.00041179500000000001, 2023-08-01T19:56:16.312 INFO:teuthology.orchestra.run.smithi008.stdout: "type_data": { 2023-08-01T19:56:16.312 INFO:teuthology.orchestra.run.smithi008.stdout: "flag_point": "started", 2023-08-01T19:56:16.312 INFO:teuthology.orchestra.run.smithi008.stdout: "events": [ 2023-08-01T19:56:16.312 INFO:teuthology.orchestra.run.smithi008.stdout: { 2023-08-01T19:56:16.312 INFO:teuthology.orchestra.run.smithi008.stdout: "event": "initiated", 2023-08-01T19:56:16.312 INFO:teuthology.orchestra.run.smithi008.stdout: "time": "2023-08-01T19:56:16.164637+0000", 2023-08-01T19:56:16.312 INFO:teuthology.orchestra.run.smithi008.stdout: "duration": 0 2023-08-01T19:56:16.313 INFO:teuthology.orchestra.run.smithi008.stdout: }, 2023-08-01T19:56:16.313 INFO:teuthology.orchestra.run.smithi008.stdout: { 2023-08-01T19:56:16.313 INFO:teuthology.orchestra.run.smithi008.stdout: "event": "throttled", 2023-08-01T19:56:16.313 INFO:teuthology.orchestra.run.smithi008.stdout: "time": "2023-08-01T19:56:16.164637+0000", 2023-08-01T19:56:16.313 INFO:teuthology.orchestra.run.smithi008.stdout: "duration": 0 2023-08-01T19:56:16.313 INFO:teuthology.orchestra.run.smithi008.stdout: }, 2023-08-01T19:56:16.313 INFO:teuthology.orchestra.run.smithi008.stdout: { 2023-08-01T19:56:16.313 INFO:teuthology.orchestra.run.smithi008.stdout: "event": "header_read", 2023-08-01T19:56:16.314 INFO:teuthology.orchestra.run.smithi008.stdout: "time": "2023-08-01T19:56:16.164637+0000", 2023-08-01T19:56:16.314 INFO:teuthology.orchestra.run.smithi008.stdout: "duration": 4294967295.9999995 2023-08-01T19:56:16.314 INFO:teuthology.orchestra.run.smithi008.stdout: }, 2023-08-01T19:56:16.314 INFO:teuthology.orchestra.run.smithi008.stdout: { 2023-08-01T19:56:16.314 INFO:teuthology.orchestra.run.smithi008.stdout: "event": "all_read", 2023-08-01T19:56:16.314 INFO:teuthology.orchestra.run.smithi008.stdout: "time": "2023-08-01T19:56:16.164641+0000", 2023-08-01T19:56:16.314 INFO:teuthology.orchestra.run.smithi008.stdout: "duration": 4.0090000000000001e-06 2023-08-01T19:56:16.314 INFO:teuthology.orchestra.run.smithi008.stdout: }, 2023-08-01T19:56:16.315 INFO:teuthology.orchestra.run.smithi008.stdout: { 2023-08-01T19:56:16.315 INFO:teuthology.orchestra.run.smithi008.stdout: "event": "dispatched", 2023-08-01T19:56:16.315 INFO:teuthology.orchestra.run.smithi008.stdout: "time": "2023-08-01T19:56:16.164646+0000", 2023-08-01T19:56:16.315 INFO:teuthology.orchestra.run.smithi008.stdout: "duration": 5.3720000000000004e-06 2023-08-01T19:56:16.315 INFO:teuthology.orchestra.run.smithi008.stdout: }, 2023-08-01T19:56:16.315 INFO:teuthology.orchestra.run.smithi008.stdout: { 2023-08-01T19:56:16.315 INFO:teuthology.orchestra.run.smithi008.stdout: "event": "queued_for_pg", 2023-08-01T19:56:16.315 INFO:teuthology.orchestra.run.smithi008.stdout: "time": "2023-08-01T19:56:16.164649+0000", 2023-08-01T19:56:16.316 INFO:teuthology.orchestra.run.smithi008.stdout: "duration": 2.9550000000000001e-06 2023-08-01T19:56:16.316 INFO:teuthology.orchestra.run.smithi008.stdout: }, 2023-08-01T19:56:16.316 INFO:teuthology.orchestra.run.smithi008.stdout: { 2023-08-01T19:56:16.316 INFO:teuthology.orchestra.run.smithi008.stdout: "event": "reached_pg", 2023-08-01T19:56:16.316 INFO:teuthology.orchestra.run.smithi008.stdout: "time": "2023-08-01T19:56:16.164675+0000", 2023-08-01T19:56:16.316 INFO:teuthology.orchestra.run.smithi008.stdout: "duration": 2.6103999999999999e-05 2023-08-01T19:56:16.316 INFO:teuthology.orchestra.run.smithi008.stdout: }, 2023-08-01T19:56:16.316 INFO:teuthology.orchestra.run.smithi008.stdout: { 2023-08-01T19:56:16.317 INFO:teuthology.orchestra.run.smithi008.stdout: "event": "started", 2023-08-01T19:56:16.317 INFO:teuthology.orchestra.run.smithi008.stdout: "time": "2023-08-01T19:56:16.164687+0000", 2023-08-01T19:56:16.317 INFO:teuthology.orchestra.run.smithi008.stdout: "duration": 1.1209000000000001e-05 2023-08-01T19:56:16.317 INFO:teuthology.orchestra.run.smithi008.stdout: } 2023-08-01T19:56:16.317 INFO:teuthology.orchestra.run.smithi008.stdout: ] 2023-08-01T19:56:16.317 INFO:teuthology.orchestra.run.smithi008.stdout: } 2023-08-01T19:56:16.317 INFO:teuthology.orchestra.run.smithi008.stdout: } 2023-08-01T19:56:16.318 INFO:teuthology.orchestra.run.smithi008.stdout: ], 2023-08-01T19:56:16.318 INFO:teuthology.orchestra.run.smithi008.stdout: "num_ops": 21 2023-08-01T19:56:16.318 INFO:teuthology.orchestra.run.smithi008.stdout:} 2023-08-01T19:56:16.319 DEBUG:teuthology.orchestra.run.smithi008:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 30 ceph --cluster ceph --admin-daemon /var/run/ceph/ceph-osd.0.asok dump_blocked_ops 2023-08-01T19:56:16.319 INFO:tasks.ceph.osd.0.smithi008.stderr:2023-08-01T19:56:16.317+0000 7f16a58f4700 -1 received signal: Hangup from /usr/bin/python3 /bin/daemon-helper kill ceph-osd -f --cluster ceph -i 0 (PID: 111179) UID: 0 2023-08-01T19:56:16.420 INFO:tasks.ceph.osd.0.smithi008.stderr:2023-08-01T19:56:16.419+0000 7f16a58f4700 -1 received signal: Hangup from /usr/bin/python3 /bin/daemon-helper kill ceph-osd -f --cluster ceph -i 0 (PID: 111179) UID: 0 2023-08-01T19:56:16.521 INFO:tasks.ceph.osd.0.smithi008.stderr:2023-08-01T19:56:16.520+0000 7f16a58f4700 -1 received signal: Hangup from /usr/bin/python3 /bin/daemon-helper kill ceph-osd -f --cluster ceph -i 0 (PID: 111179) UID: 0 2023-08-01T19:56:16.543 INFO:teuthology.orchestra.run.smithi008.stdout:{ 2023-08-01T19:56:16.543 INFO:teuthology.orchestra.run.smithi008.stdout: "ops": [], 2023-08-01T19:56:16.544 INFO:teuthology.orchestra.run.smithi008.stdout: "complaint_time": 30, 2023-08-01T19:56:16.544 INFO:teuthology.orchestra.run.smithi008.stdout: "num_blocked_ops": 0 2023-08-01T19:56:16.544 INFO:teuthology.orchestra.run.smithi008.stdout:} 2023-08-01T19:56:16.558 DEBUG:teuthology.orchestra.run.smithi008:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 30 ceph --cluster ceph --admin-daemon /var/run/ceph/ceph-osd.0.asok dump_historic_ops 2023-08-01T19:56:16.621 INFO:tasks.ceph.osd.2.smithi155.stderr:2023-08-01T19:56:16.620+0000 7faa5c6ac700 -1 received signal: Hangup from /usr/bin/python3 /bin/daemon-helper kill ceph-osd -f --cluster ceph -i 2 (PID: 111337) UID: 0 2023-08-01T19:56:16.722 INFO:tasks.ceph.osd.0.smithi008.stderr:2023-08-01T19:56:16.720+0000 7f16a58f4700 -1 received signal: Hangup from /usr/bin/python3 /bin/daemon-helper kill ceph-osd -f --cluster ceph -i 0 (PID: 111179) UID: 0 2023-08-01T19:56:16.781 INFO:teuthology.orchestra.run.smithi008.stdout:{ 2023-08-01T19:56:16.782 INFO:teuthology.orchestra.run.smithi008.stdout: "size": 20, 2023-08-01T19:56:16.782 INFO:teuthology.orchestra.run.smithi008.stdout: "duration": 600, 2023-08-01T19:56:16.782 INFO:teuthology.orchestra.run.smithi008.stdout: "ops": [ 2023-08-01T19:56:16.782 INFO:teuthology.orchestra.run.smithi008.stdout: { 2023-08-01T19:56:16.782 INFO:teuthology.orchestra.run.smithi008.stdout: "description": "osd_op(client.4668.0:100240 5.a 5:5313c5b9:::benchmark_data_smithi006_114134_object100239:head [set-alloc-hint object_size 65536 write_size 65536,write 0~65536] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e37)", 2023-08-01T19:56:16.782 INFO:teuthology.orchestra.run.smithi008.stdout: "initiated_at": "2023-08-01T19:55:05.148399+0000", 2023-08-01T19:56:16.782 INFO:teuthology.orchestra.run.smithi008.stdout: "age": 71.630269260000006, 2023-08-01T19:56:16.783 INFO:teuthology.orchestra.run.smithi008.stdout: "duration": 0.077278904999999995, 2023-08-01T19:56:16.783 INFO:teuthology.orchestra.run.smithi008.stdout: "type_data": { 2023-08-01T19:56:16.783 INFO:teuthology.orchestra.run.smithi008.stdout: "flag_point": "commit sent; apply or cleanup", 2023-08-01T19:56:16.783 INFO:teuthology.orchestra.run.smithi008.stdout: "client_info": { 2023-08-01T19:56:16.783 INFO:teuthology.orchestra.run.smithi008.stdout: "client": "client.4668", 2023-08-01T19:56:16.783 INFO:teuthology.orchestra.run.smithi008.stdout: "client_addr": "172.21.15.6:0/1709472247", 2023-08-01T19:56:16.783 INFO:teuthology.orchestra.run.smithi008.stdout: "tid": 100240 2023-08-01T19:56:16.784 INFO:teuthology.orchestra.run.smithi008.stdout: }, 2023-08-01T19:56:16.784 INFO:teuthology.orchestra.run.smithi008.stdout: "events": [ 2023-08-01T19:56:16.784 INFO:teuthology.orchestra.run.smithi008.stdout: { 2023-08-01T19:56:16.784 INFO:teuthology.orchestra.run.smithi008.stdout: "event": "initiated", 2023-08-01T19:56:16.784 INFO:teuthology.orchestra.run.smithi008.stdout: "time": "2023-08-01T19:55:05.148399+0000", 2023-08-01T19:56:16.784 INFO:teuthology.orchestra.run.smithi008.stdout: "duration": 0 2023-08-01T19:56:16.784 INFO:teuthology.orchestra.run.smithi008.stdout: }, 2023-08-01T19:56:16.784 INFO:teuthology.orchestra.run.smithi008.stdout: { 2023-08-01T19:56:16.785 INFO:teuthology.orchestra.run.smithi008.stdout: "event": "throttled", 2023-08-01T19:56:16.785 INFO:teuthology.orchestra.run.smithi008.stdout: "time": "2023-08-01T19:55:05.148399+0000", 2023-08-01T19:56:16.785 INFO:teuthology.orchestra.run.smithi008.stdout: "duration": 0 2023-08-01T19:56:16.785 INFO:teuthology.orchestra.run.smithi008.stdout: }, 2023-08-01T19:56:16.785 INFO:teuthology.orchestra.run.smithi008.stdout: { 2023-08-01T19:56:16.785 INFO:teuthology.orchestra.run.smithi008.stdout: "event": "header_read", 2023-08-01T19:56:16.785 INFO:teuthology.orchestra.run.smithi008.stdout: "time": "2023-08-01T19:55:05.148398+0000", 2023-08-01T19:56:16.785 INFO:teuthology.orchestra.run.smithi008.stdout: "duration": 4294967295.999999 2023-08-01T19:56:16.786 INFO:teuthology.orchestra.run.smithi008.stdout: }, 2023-08-01T19:56:16.786 INFO:teuthology.orchestra.run.smithi008.stdout: { 2023-08-01T19:56:16.786 INFO:teuthology.orchestra.run.smithi008.stdout: "event": "all_read", 2023-08-01T19:56:16.786 INFO:teuthology.orchestra.run.smithi008.stdout: "time": "2023-08-01T19:55:05.148492+0000", 2023-08-01T19:56:16.786 INFO:teuthology.orchestra.run.smithi008.stdout: "duration": 9.3892000000000002e-05 2023-08-01T19:56:16.786 INFO:teuthology.orchestra.run.smithi008.stdout: }, 2023-08-01T19:56:16.786 INFO:teuthology.orchestra.run.smithi008.stdout: { 2023-08-01T19:56:16.786 INFO:teuthology.orchestra.run.smithi008.stdout: "event": "dispatched", 2023-08-01T19:56:16.787 INFO:teuthology.orchestra.run.smithi008.stdout: "time": "2023-08-01T19:55:05.148503+0000", 2023-08-01T19:56:16.787 INFO:teuthology.orchestra.run.smithi008.stdout: "duration": 1.0951000000000001e-05 2023-08-01T19:56:16.787 INFO:teuthology.orchestra.run.smithi008.stdout: }, 2023-08-01T19:56:16.787 INFO:teuthology.orchestra.run.smithi008.stdout: { 2023-08-01T19:56:16.787 INFO:teuthology.orchestra.run.smithi008.stdout: "event": "queued_for_pg", 2023-08-01T19:56:16.787 INFO:teuthology.orchestra.run.smithi008.stdout: "time": "2023-08-01T19:55:05.148508+0000", 2023-08-01T19:56:16.787 INFO:teuthology.orchestra.run.smithi008.stdout: "duration": 5.0080000000000002e-06 2023-08-01T19:56:16.788 INFO:teuthology.orchestra.run.smithi008.stdout: }, 2023-08-01T19:56:16.788 INFO:teuthology.orchestra.run.smithi008.stdout: { 2023-08-01T19:56:16.788 INFO:teuthology.orchestra.run.smithi008.stdout: "event": "reached_pg", 2023-08-01T19:56:16.788 INFO:teuthology.orchestra.run.smithi008.stdout: "time": "2023-08-01T19:55:05.148548+0000", 2023-08-01T19:56:16.788 INFO:teuthology.orchestra.run.smithi008.stdout: "duration": 4.0358999999999998e-05 2023-08-01T19:56:16.788 INFO:teuthology.orchestra.run.smithi008.stdout: }, 2023-08-01T19:56:16.788 INFO:teuthology.orchestra.run.smithi008.stdout: { 2023-08-01T19:56:16.788 INFO:teuthology.orchestra.run.smithi008.stdout: "event": "started", 2023-08-01T19:56:16.789 INFO:teuthology.orchestra.run.smithi008.stdout: "time": "2023-08-01T19:55:05.148666+0000", 2023-08-01T19:56:16.789 INFO:teuthology.orchestra.run.smithi008.stdout: "duration": 0.000117621 2023-08-01T19:56:16.789 INFO:teuthology.orchestra.run.smithi008.stdout: }, 2023-08-01T19:56:16.789 INFO:teuthology.orchestra.run.smithi008.stdout: { 2023-08-01T19:56:16.789 INFO:teuthology.orchestra.run.smithi008.stdout: "event": "waiting for subops from 2", 2023-08-01T19:56:16.789 INFO:teuthology.orchestra.run.smithi008.stdout: "time": "2023-08-01T19:55:05.148805+0000", 2023-08-01T19:56:16.789 INFO:teuthology.orchestra.run.smithi008.stdout: "duration": 0.000139176 2023-08-01T19:56:16.789 INFO:teuthology.orchestra.run.smithi008.stdout: }, 2023-08-01T19:56:16.790 INFO:teuthology.orchestra.run.smithi008.stdout: { 2023-08-01T19:56:16.790 INFO:teuthology.orchestra.run.smithi008.stdout: "event": "op_commit", 2023-08-01T19:56:16.790 INFO:teuthology.orchestra.run.smithi008.stdout: "time": "2023-08-01T19:55:05.156143+0000", 2023-08-01T19:56:16.790 INFO:teuthology.orchestra.run.smithi008.stdout: "duration": 0.007338041 2023-08-01T19:56:16.790 INFO:teuthology.orchestra.run.smithi008.stdout: }, 2023-08-01T19:56:16.790 INFO:teuthology.orchestra.run.smithi008.stdout: { 2023-08-01T19:56:16.790 INFO:teuthology.orchestra.run.smithi008.stdout: "event": "sub_op_commit_rec", 2023-08-01T19:56:16.791 INFO:teuthology.orchestra.run.smithi008.stdout: "time": "2023-08-01T19:55:05.225581+0000", 2023-08-01T19:56:16.791 INFO:teuthology.orchestra.run.smithi008.stdout: "duration": 0.069438402999999996 2023-08-01T19:56:16.791 INFO:teuthology.orchestra.run.smithi008.stdout: }, 2023-08-01T19:56:16.791 INFO:teuthology.orchestra.run.smithi008.stdout: { 2023-08-01T19:56:16.791 INFO:teuthology.orchestra.run.smithi008.stdout: "event": "commit_sent", 2023-08-01T19:56:16.791 INFO:teuthology.orchestra.run.smithi008.stdout: "time": "2023-08-01T19:55:05.225632+0000", 2023-08-01T19:56:16.791 INFO:teuthology.orchestra.run.smithi008.stdout: "duration": 5.0382e-05 2023-08-01T19:56:16.791 INFO:teuthology.orchestra.run.smithi008.stdout: }, 2023-08-01T19:56:16.792 INFO:teuthology.orchestra.run.smithi008.stdout: { 2023-08-01T19:56:16.792 INFO:teuthology.orchestra.run.smithi008.stdout: "event": "done", 2023-08-01T19:56:16.792 INFO:teuthology.orchestra.run.smithi008.stdout: "time": "2023-08-01T19:55:05.225677+0000", 2023-08-01T19:56:16.792 INFO:teuthology.orchestra.run.smithi008.stdout: "duration": 4.5893000000000003e-05 2023-08-01T19:56:16.792 INFO:teuthology.orchestra.run.smithi008.stdout: } 2023-08-01T19:56:16.792 INFO:teuthology.orchestra.run.smithi008.stdout: ] 2023-08-01T19:56:16.792 INFO:teuthology.orchestra.run.smithi008.stdout: } 2023-08-01T19:56:16.792 INFO:teuthology.orchestra.run.smithi008.stdout: }, 2023-08-01T19:56:16.793 INFO:teuthology.orchestra.run.smithi008.stdout: { 2023-08-01T19:56:16.793 INFO:teuthology.orchestra.run.smithi008.stdout: "description": "osd_op(client.4668.0:100243 5.a 5:5e8193b6:::benchmark_data_smithi006_114134_object100242:head [set-alloc-hint object_size 65536 write_size 65536,write 0~65536] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e37)", 2023-08-01T19:56:16.793 INFO:teuthology.orchestra.run.smithi008.stdout: "initiated_at": "2023-08-01T19:55:05.150737+0000", 2023-08-01T19:56:16.793 INFO:teuthology.orchestra.run.smithi008.stdout: "age": 71.627930805000005, 2023-08-01T19:56:16.793 INFO:teuthology.orchestra.run.smithi008.stdout: "duration": 0.075019885999999994, 2023-08-01T19:56:16.793 INFO:teuthology.orchestra.run.smithi008.stdout: "type_data": { 2023-08-01T19:56:16.793 INFO:teuthology.orchestra.run.smithi008.stdout: "flag_point": "commit sent; apply or cleanup", 2023-08-01T19:56:16.794 INFO:teuthology.orchestra.run.smithi008.stdout: "client_info": { 2023-08-01T19:56:16.794 INFO:teuthology.orchestra.run.smithi008.stdout: "client": "client.4668", 2023-08-01T19:56:16.794 INFO:teuthology.orchestra.run.smithi008.stdout: "client_addr": "172.21.15.6:0/1709472247", 2023-08-01T19:56:16.794 INFO:teuthology.orchestra.run.smithi008.stdout: "tid": 100243 2023-08-01T19:56:16.794 INFO:teuthology.orchestra.run.smithi008.stdout: }, 2023-08-01T19:56:16.794 INFO:teuthology.orchestra.run.smithi008.stdout: "events": [ 2023-08-01T19:56:16.794 INFO:teuthology.orchestra.run.smithi008.stdout: { 2023-08-01T19:56:16.794 INFO:teuthology.orchestra.run.smithi008.stdout: "event": "initiated", 2023-08-01T19:56:16.795 INFO:teuthology.orchestra.run.smithi008.stdout: "time": "2023-08-01T19:55:05.150737+0000", 2023-08-01T19:56:16.795 INFO:teuthology.orchestra.run.smithi008.stdout: "duration": 0 2023-08-01T19:56:16.795 INFO:teuthology.orchestra.run.smithi008.stdout: }, 2023-08-01T19:56:16.795 INFO:teuthology.orchestra.run.smithi008.stdout: { 2023-08-01T19:56:16.795 INFO:teuthology.orchestra.run.smithi008.stdout: "event": "throttled", 2023-08-01T19:56:16.795 INFO:teuthology.orchestra.run.smithi008.stdout: "time": "2023-08-01T19:55:05.150737+0000", 2023-08-01T19:56:16.795 INFO:teuthology.orchestra.run.smithi008.stdout: "duration": 0 2023-08-01T19:56:16.795 INFO:teuthology.orchestra.run.smithi008.stdout: }, 2023-08-01T19:56:16.796 INFO:teuthology.orchestra.run.smithi008.stdout: { 2023-08-01T19:56:16.796 INFO:teuthology.orchestra.run.smithi008.stdout: "event": "header_read", 2023-08-01T19:56:16.796 INFO:teuthology.orchestra.run.smithi008.stdout: "time": "2023-08-01T19:55:05.150736+0000", 2023-08-01T19:56:16.796 INFO:teuthology.orchestra.run.smithi008.stdout: "duration": 4294967295.999999 2023-08-01T19:56:16.796 INFO:teuthology.orchestra.run.smithi008.stdout: }, 2023-08-01T19:56:16.796 INFO:teuthology.orchestra.run.smithi008.stdout: { 2023-08-01T19:56:16.796 INFO:teuthology.orchestra.run.smithi008.stdout: "event": "all_read", 2023-08-01T19:56:16.796 INFO:teuthology.orchestra.run.smithi008.stdout: "time": "2023-08-01T19:55:05.150780+0000", 2023-08-01T19:56:16.797 INFO:teuthology.orchestra.run.smithi008.stdout: "duration": 4.3578999999999997e-05 2023-08-01T19:56:16.797 INFO:teuthology.orchestra.run.smithi008.stdout: }, 2023-08-01T19:56:16.797 INFO:teuthology.orchestra.run.smithi008.stdout: { 2023-08-01T19:56:16.797 INFO:teuthology.orchestra.run.smithi008.stdout: "event": "dispatched", 2023-08-01T19:56:16.797 INFO:teuthology.orchestra.run.smithi008.stdout: "time": "2023-08-01T19:55:05.150791+0000", 2023-08-01T19:56:16.797 INFO:teuthology.orchestra.run.smithi008.stdout: "duration": 1.0963e-05 2023-08-01T19:56:16.797 INFO:teuthology.orchestra.run.smithi008.stdout: }, 2023-08-01T19:56:16.797 INFO:teuthology.orchestra.run.smithi008.stdout: { 2023-08-01T19:56:16.798 INFO:teuthology.orchestra.run.smithi008.stdout: "event": "queued_for_pg", 2023-08-01T19:56:16.798 INFO:teuthology.orchestra.run.smithi008.stdout: "time": "2023-08-01T19:55:05.150797+0000", 2023-08-01T19:56:16.798 INFO:teuthology.orchestra.run.smithi008.stdout: "duration": 5.9780000000000002e-06 2023-08-01T19:56:16.798 INFO:teuthology.orchestra.run.smithi008.stdout: }, 2023-08-01T19:56:16.798 INFO:teuthology.orchestra.run.smithi008.stdout: { 2023-08-01T19:56:16.798 INFO:teuthology.orchestra.run.smithi008.stdout: "event": "reached_pg", 2023-08-01T19:56:16.798 INFO:teuthology.orchestra.run.smithi008.stdout: "time": "2023-08-01T19:55:05.150833+0000", 2023-08-01T19:56:16.798 INFO:teuthology.orchestra.run.smithi008.stdout: "duration": 3.6000000000000001e-05 2023-08-01T19:56:16.799 INFO:teuthology.orchestra.run.smithi008.stdout: }, 2023-08-01T19:56:16.799 INFO:teuthology.orchestra.run.smithi008.stdout: { 2023-08-01T19:56:16.799 INFO:teuthology.orchestra.run.smithi008.stdout: "event": "started", 2023-08-01T19:56:16.799 INFO:teuthology.orchestra.run.smithi008.stdout: "time": "2023-08-01T19:55:05.150951+0000", 2023-08-01T19:56:16.799 INFO:teuthology.orchestra.run.smithi008.stdout: "duration": 0.00011827799999999999 2023-08-01T19:56:16.799 INFO:teuthology.orchestra.run.smithi008.stdout: }, 2023-08-01T19:56:16.799 INFO:teuthology.orchestra.run.smithi008.stdout: { 2023-08-01T19:56:16.799 INFO:teuthology.orchestra.run.smithi008.stdout: "event": "waiting for subops from 2", 2023-08-01T19:56:16.800 INFO:teuthology.orchestra.run.smithi008.stdout: "time": "2023-08-01T19:55:05.151111+0000", 2023-08-01T19:56:16.800 INFO:teuthology.orchestra.run.smithi008.stdout: "duration": 0.00015961299999999999 2023-08-01T19:56:16.800 INFO:teuthology.orchestra.run.smithi008.stdout: }, 2023-08-01T19:56:16.800 INFO:teuthology.orchestra.run.smithi008.stdout: { 2023-08-01T19:56:16.800 INFO:teuthology.orchestra.run.smithi008.stdout: "event": "op_commit", 2023-08-01T19:56:16.800 INFO:teuthology.orchestra.run.smithi008.stdout: "time": "2023-08-01T19:55:05.156247+0000", 2023-08-01T19:56:16.800 INFO:teuthology.orchestra.run.smithi008.stdout: "duration": 0.005136524 2023-08-01T19:56:16.801 INFO:teuthology.orchestra.run.smithi008.stdout: }, 2023-08-01T19:56:16.801 INFO:teuthology.orchestra.run.smithi008.stdout: { 2023-08-01T19:56:16.801 INFO:teuthology.orchestra.run.smithi008.stdout: "event": "sub_op_commit_rec", 2023-08-01T19:56:16.801 INFO:teuthology.orchestra.run.smithi008.stdout: "time": "2023-08-01T19:55:05.225705+0000", 2023-08-01T19:56:16.801 INFO:teuthology.orchestra.run.smithi008.stdout: "duration": 0.069458377000000002 2023-08-01T19:56:16.801 INFO:teuthology.orchestra.run.smithi008.stdout: }, 2023-08-01T19:56:16.801 INFO:teuthology.orchestra.run.smithi008.stdout: { 2023-08-01T19:56:16.801 INFO:teuthology.orchestra.run.smithi008.stdout: "event": "commit_sent", 2023-08-01T19:56:16.802 INFO:teuthology.orchestra.run.smithi008.stdout: "time": "2023-08-01T19:55:05.225736+0000", 2023-08-01T19:56:16.802 INFO:teuthology.orchestra.run.smithi008.stdout: "duration": 3.0388000000000001e-05 2023-08-01T19:56:16.802 INFO:teuthology.orchestra.run.smithi008.stdout: }, 2023-08-01T19:56:16.802 INFO:teuthology.orchestra.run.smithi008.stdout: { 2023-08-01T19:56:16.802 INFO:teuthology.orchestra.run.smithi008.stdout: "event": "done", 2023-08-01T19:56:16.802 INFO:teuthology.orchestra.run.smithi008.stdout: "time": "2023-08-01T19:55:05.225757+0000", 2023-08-01T19:56:16.802 INFO:teuthology.orchestra.run.smithi008.stdout: "duration": 2.1090999999999998e-05 2023-08-01T19:56:16.802 INFO:teuthology.orchestra.run.smithi008.stdout: } 2023-08-01T19:56:16.803 INFO:teuthology.orchestra.run.smithi008.stdout: ] 2023-08-01T19:56:16.803 INFO:teuthology.orchestra.run.smithi008.stdout: } 2023-08-01T19:56:16.803 INFO:teuthology.orchestra.run.smithi008.stdout: }, 2023-08-01T19:56:16.803 INFO:teuthology.orchestra.run.smithi008.stdout: { 2023-08-01T19:56:16.803 INFO:teuthology.orchestra.run.smithi008.stdout: "description": "osd_op(client.4668.0:100933 5.5 5:af92e9f2:::benchmark_data_smithi006_114134_object100932:head [set-alloc-hint object_size 65536 write_size 65536,write 0~65536] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e37)", 2023-08-01T19:56:16.803 INFO:teuthology.orchestra.run.smithi008.stdout: "initiated_at": "2023-08-01T19:55:05.566634+0000", 2023-08-01T19:56:16.803 INFO:teuthology.orchestra.run.smithi008.stdout: "age": 71.212033934000004, 2023-08-01T19:56:16.803 INFO:teuthology.orchestra.run.smithi008.stdout: "duration": 0.065909364999999998, 2023-08-01T19:56:16.804 INFO:teuthology.orchestra.run.smithi008.stdout: "type_data": { 2023-08-01T19:56:16.804 INFO:teuthology.orchestra.run.smithi008.stdout: "flag_point": "commit sent; apply or cleanup", 2023-08-01T19:56:16.804 INFO:teuthology.orchestra.run.smithi008.stdout: "client_info": { 2023-08-01T19:56:16.804 INFO:teuthology.orchestra.run.smithi008.stdout: "client": "client.4668", 2023-08-01T19:56:16.804 INFO:teuthology.orchestra.run.smithi008.stdout: "client_addr": "172.21.15.6:0/1709472247", 2023-08-01T19:56:16.804 INFO:teuthology.orchestra.run.smithi008.stdout: "tid": 100933 2023-08-01T19:56:16.804 INFO:teuthology.orchestra.run.smithi008.stdout: }, 2023-08-01T19:56:16.804 INFO:teuthology.orchestra.run.smithi008.stdout: "events": [ 2023-08-01T19:56:16.805 INFO:teuthology.orchestra.run.smithi008.stdout: { 2023-08-01T19:56:16.805 INFO:teuthology.orchestra.run.smithi008.stdout: "event": "initiated", 2023-08-01T19:56:16.805 INFO:teuthology.orchestra.run.smithi008.stdout: "time": "2023-08-01T19:55:05.566634+0000", 2023-08-01T19:56:16.805 INFO:teuthology.orchestra.run.smithi008.stdout: "duration": 0 2023-08-01T19:56:16.805 INFO:teuthology.orchestra.run.smithi008.stdout: }, 2023-08-01T19:56:16.805 INFO:teuthology.orchestra.run.smithi008.stdout: { 2023-08-01T19:56:16.805 INFO:teuthology.orchestra.run.smithi008.stdout: "event": "throttled", 2023-08-01T19:56:16.805 INFO:teuthology.orchestra.run.smithi008.stdout: "time": "2023-08-01T19:55:05.566634+0000", 2023-08-01T19:56:16.806 INFO:teuthology.orchestra.run.smithi008.stdout: "duration": 0 2023-08-01T19:56:16.806 INFO:teuthology.orchestra.run.smithi008.stdout: }, 2023-08-01T19:56:16.806 INFO:teuthology.orchestra.run.smithi008.stdout: { 2023-08-01T19:56:16.806 INFO:teuthology.orchestra.run.smithi008.stdout: "event": "header_read", 2023-08-01T19:56:16.806 INFO:teuthology.orchestra.run.smithi008.stdout: "time": "2023-08-01T19:55:05.566630+0000", 2023-08-01T19:56:16.806 INFO:teuthology.orchestra.run.smithi008.stdout: "duration": 4294967295.9999962 2023-08-01T19:56:16.806 INFO:teuthology.orchestra.run.smithi008.stdout: }, 2023-08-01T19:56:16.807 INFO:teuthology.orchestra.run.smithi008.stdout: { 2023-08-01T19:56:16.807 INFO:teuthology.orchestra.run.smithi008.stdout: "event": "all_read", 2023-08-01T19:56:16.807 INFO:teuthology.orchestra.run.smithi008.stdout: "time": "2023-08-01T19:55:05.566736+0000", 2023-08-01T19:56:16.807 INFO:teuthology.orchestra.run.smithi008.stdout: "duration": 0.000105752 2023-08-01T19:56:16.807 INFO:teuthology.orchestra.run.smithi008.stdout: }, 2023-08-01T19:56:16.807 INFO:teuthology.orchestra.run.smithi008.stdout: { 2023-08-01T19:56:16.807 INFO:teuthology.orchestra.run.smithi008.stdout: "event": "dispatched", 2023-08-01T19:56:16.807 INFO:teuthology.orchestra.run.smithi008.stdout: "time": "2023-08-01T19:55:05.566742+0000", 2023-08-01T19:56:16.808 INFO:teuthology.orchestra.run.smithi008.stdout: "duration": 5.8209999999999998e-06 2023-08-01T19:56:16.808 INFO:teuthology.orchestra.run.smithi008.stdout: }, 2023-08-01T19:56:16.808 INFO:teuthology.orchestra.run.smithi008.stdout: { 2023-08-01T19:56:16.808 INFO:teuthology.orchestra.run.smithi008.stdout: "event": "queued_for_pg", 2023-08-01T19:56:16.808 INFO:teuthology.orchestra.run.smithi008.stdout: "time": "2023-08-01T19:55:05.566745+0000", 2023-08-01T19:56:16.808 INFO:teuthology.orchestra.run.smithi008.stdout: "duration": 3.337e-06 2023-08-01T19:56:16.808 INFO:teuthology.orchestra.run.smithi008.stdout: }, 2023-08-01T19:56:16.808 INFO:teuthology.orchestra.run.smithi008.stdout: { 2023-08-01T19:56:16.809 INFO:teuthology.orchestra.run.smithi008.stdout: "event": "reached_pg", 2023-08-01T19:56:16.809 INFO:teuthology.orchestra.run.smithi008.stdout: "time": "2023-08-01T19:55:05.568175+0000", 2023-08-01T19:56:16.809 INFO:teuthology.orchestra.run.smithi008.stdout: "duration": 0.001429647 2023-08-01T19:56:16.809 INFO:teuthology.orchestra.run.smithi008.stdout: }, 2023-08-01T19:56:16.809 INFO:teuthology.orchestra.run.smithi008.stdout: { 2023-08-01T19:56:16.809 INFO:teuthology.orchestra.run.smithi008.stdout: "event": "started", 2023-08-01T19:56:16.809 INFO:teuthology.orchestra.run.smithi008.stdout: "time": "2023-08-01T19:55:05.568288+0000", 2023-08-01T19:56:16.809 INFO:teuthology.orchestra.run.smithi008.stdout: "duration": 0.000113353 2023-08-01T19:56:16.810 INFO:teuthology.orchestra.run.smithi008.stdout: }, 2023-08-01T19:56:16.810 INFO:teuthology.orchestra.run.smithi008.stdout: { 2023-08-01T19:56:16.810 INFO:teuthology.orchestra.run.smithi008.stdout: "event": "waiting for subops from 1", 2023-08-01T19:56:16.810 INFO:teuthology.orchestra.run.smithi008.stdout: "time": "2023-08-01T19:55:05.568425+0000", 2023-08-01T19:56:16.810 INFO:teuthology.orchestra.run.smithi008.stdout: "duration": 0.000137346 2023-08-01T19:56:16.810 INFO:teuthology.orchestra.run.smithi008.stdout: }, 2023-08-01T19:56:16.810 INFO:teuthology.orchestra.run.smithi008.stdout: { 2023-08-01T19:56:16.810 INFO:teuthology.orchestra.run.smithi008.stdout: "event": "sub_op_commit_rec", 2023-08-01T19:56:16.811 INFO:teuthology.orchestra.run.smithi008.stdout: "time": "2023-08-01T19:55:05.629320+0000", 2023-08-01T19:56:16.811 INFO:teuthology.orchestra.run.smithi008.stdout: "duration": 0.060894491000000002 2023-08-01T19:56:16.811 INFO:teuthology.orchestra.run.smithi008.stdout: }, 2023-08-01T19:56:16.811 INFO:teuthology.orchestra.run.smithi008.stdout: { 2023-08-01T19:56:16.811 INFO:teuthology.orchestra.run.smithi008.stdout: "event": "op_commit", 2023-08-01T19:56:16.811 INFO:teuthology.orchestra.run.smithi008.stdout: "time": "2023-08-01T19:55:05.632452+0000", 2023-08-01T19:56:16.811 INFO:teuthology.orchestra.run.smithi008.stdout: "duration": 0.003131909 2023-08-01T19:56:16.811 INFO:teuthology.orchestra.run.smithi008.stdout: }, 2023-08-01T19:56:16.812 INFO:teuthology.orchestra.run.smithi008.stdout: { 2023-08-01T19:56:16.812 INFO:teuthology.orchestra.run.smithi008.stdout: "event": "commit_sent", 2023-08-01T19:56:16.812 INFO:teuthology.orchestra.run.smithi008.stdout: "time": "2023-08-01T19:55:05.632503+0000", 2023-08-01T19:56:16.812 INFO:teuthology.orchestra.run.smithi008.stdout: "duration": 5.1295000000000003e-05 2023-08-01T19:56:16.812 INFO:teuthology.orchestra.run.smithi008.stdout: }, 2023-08-01T19:56:16.812 INFO:teuthology.orchestra.run.smithi008.stdout: { 2023-08-01T19:56:16.812 INFO:teuthology.orchestra.run.smithi008.stdout: "event": "done", 2023-08-01T19:56:16.812 INFO:teuthology.orchestra.run.smithi008.stdout: "time": "2023-08-01T19:55:05.632543+0000", 2023-08-01T19:56:16.813 INFO:teuthology.orchestra.run.smithi008.stdout: "duration": 4.0234000000000001e-05 2023-08-01T19:56:16.813 INFO:teuthology.orchestra.run.smithi008.stdout: } 2023-08-01T19:56:16.813 INFO:teuthology.orchestra.run.smithi008.stdout: ] 2023-08-01T19:56:16.813 INFO:teuthology.orchestra.run.smithi008.stdout: } 2023-08-01T19:56:16.813 INFO:teuthology.orchestra.run.smithi008.stdout: }, 2023-08-01T19:56:16.813 INFO:teuthology.orchestra.run.smithi008.stdout: { 2023-08-01T19:56:16.813 INFO:teuthology.orchestra.run.smithi008.stdout: "description": "osd_op(client.4668.0:100939 5.5 5:a75fa6e3:::benchmark_data_smithi006_114134_object100938:head [set-alloc-hint object_size 65536 write_size 65536,write 0~65536] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e37)", 2023-08-01T19:56:16.814 INFO:teuthology.orchestra.run.smithi008.stdout: "initiated_at": "2023-08-01T19:55:05.569740+0000", 2023-08-01T19:56:16.814 INFO:teuthology.orchestra.run.smithi008.stdout: "age": 71.208928263000004, 2023-08-01T19:56:16.814 INFO:teuthology.orchestra.run.smithi008.stdout: "duration": 0.067753412999999998, 2023-08-01T19:56:16.814 INFO:teuthology.orchestra.run.smithi008.stdout: "type_data": { 2023-08-01T19:56:16.814 INFO:teuthology.orchestra.run.smithi008.stdout: "flag_point": "commit sent; apply or cleanup", 2023-08-01T19:56:16.814 INFO:teuthology.orchestra.run.smithi008.stdout: "client_info": { 2023-08-01T19:56:16.814 INFO:teuthology.orchestra.run.smithi008.stdout: "client": "client.4668", 2023-08-01T19:56:16.814 INFO:teuthology.orchestra.run.smithi008.stdout: "client_addr": "172.21.15.6:0/1709472247", 2023-08-01T19:56:16.815 INFO:teuthology.orchestra.run.smithi008.stdout: "tid": 100939 2023-08-01T19:56:16.815 INFO:teuthology.orchestra.run.smithi008.stdout: }, 2023-08-01T19:56:16.815 INFO:teuthology.orchestra.run.smithi008.stdout: "events": [ 2023-08-01T19:56:16.815 INFO:teuthology.orchestra.run.smithi008.stdout: { 2023-08-01T19:56:16.815 INFO:teuthology.orchestra.run.smithi008.stdout: "event": "initiated", 2023-08-01T19:56:16.815 INFO:teuthology.orchestra.run.smithi008.stdout: "time": "2023-08-01T19:55:05.569740+0000", 2023-08-01T19:56:16.815 INFO:teuthology.orchestra.run.smithi008.stdout: "duration": 0 2023-08-01T19:56:16.815 INFO:teuthology.orchestra.run.smithi008.stdout: }, 2023-08-01T19:56:16.816 INFO:teuthology.orchestra.run.smithi008.stdout: { 2023-08-01T19:56:16.816 INFO:teuthology.orchestra.run.smithi008.stdout: "event": "throttled", 2023-08-01T19:56:16.816 INFO:teuthology.orchestra.run.smithi008.stdout: "time": "2023-08-01T19:55:05.569740+0000", 2023-08-01T19:56:16.816 INFO:teuthology.orchestra.run.smithi008.stdout: "duration": 0 2023-08-01T19:56:16.816 INFO:teuthology.orchestra.run.smithi008.stdout: }, 2023-08-01T19:56:16.816 INFO:teuthology.orchestra.run.smithi008.stdout: { 2023-08-01T19:56:16.816 INFO:teuthology.orchestra.run.smithi008.stdout: "event": "header_read", 2023-08-01T19:56:16.817 INFO:teuthology.orchestra.run.smithi008.stdout: "time": "2023-08-01T19:55:05.569739+0000", 2023-08-01T19:56:16.817 INFO:teuthology.orchestra.run.smithi008.stdout: "duration": 4294967295.9999995 2023-08-01T19:56:16.817 INFO:teuthology.orchestra.run.smithi008.stdout: }, 2023-08-01T19:56:16.817 INFO:teuthology.orchestra.run.smithi008.stdout: { 2023-08-01T19:56:16.817 INFO:teuthology.orchestra.run.smithi008.stdout: "event": "all_read", 2023-08-01T19:56:16.817 INFO:teuthology.orchestra.run.smithi008.stdout: "time": "2023-08-01T19:55:05.569839+0000", 2023-08-01T19:56:16.817 INFO:teuthology.orchestra.run.smithi008.stdout: "duration": 0.000100219 2023-08-01T19:56:16.817 INFO:teuthology.orchestra.run.smithi008.stdout: }, 2023-08-01T19:56:16.818 INFO:teuthology.orchestra.run.smithi008.stdout: { 2023-08-01T19:56:16.818 INFO:teuthology.orchestra.run.smithi008.stdout: "event": "dispatched", 2023-08-01T19:56:16.818 INFO:teuthology.orchestra.run.smithi008.stdout: "time": "2023-08-01T19:55:05.569846+0000", 2023-08-01T19:56:16.818 INFO:teuthology.orchestra.run.smithi008.stdout: "duration": 7.3150000000000003e-06 2023-08-01T19:56:16.818 INFO:teuthology.orchestra.run.smithi008.stdout: }, 2023-08-01T19:56:16.818 INFO:teuthology.orchestra.run.smithi008.stdout: { 2023-08-01T19:56:16.818 INFO:teuthology.orchestra.run.smithi008.stdout: "event": "queued_for_pg", 2023-08-01T19:56:16.818 INFO:teuthology.orchestra.run.smithi008.stdout: "time": "2023-08-01T19:55:05.569850+0000", 2023-08-01T19:56:16.819 INFO:teuthology.orchestra.run.smithi008.stdout: "duration": 3.3299999999999999e-06 2023-08-01T19:56:16.819 INFO:teuthology.orchestra.run.smithi008.stdout: }, 2023-08-01T19:56:16.819 INFO:teuthology.orchestra.run.smithi008.stdout: { 2023-08-01T19:56:16.819 INFO:teuthology.orchestra.run.smithi008.stdout: "event": "reached_pg", 2023-08-01T19:56:16.819 INFO:teuthology.orchestra.run.smithi008.stdout: "time": "2023-08-01T19:55:05.626991+0000", 2023-08-01T19:56:16.819 INFO:teuthology.orchestra.run.smithi008.stdout: "duration": 0.057141585000000002 2023-08-01T19:56:16.819 INFO:teuthology.orchestra.run.smithi008.stdout: }, 2023-08-01T19:56:16.820 INFO:teuthology.orchestra.run.smithi008.stdout: { 2023-08-01T19:56:16.820 INFO:teuthology.orchestra.run.smithi008.stdout: "event": "started", 2023-08-01T19:56:16.820 INFO:teuthology.orchestra.run.smithi008.stdout: "time": "2023-08-01T19:55:05.627111+0000", 2023-08-01T19:56:16.820 INFO:teuthology.orchestra.run.smithi008.stdout: "duration": 0.000119238 2023-08-01T19:56:16.820 INFO:teuthology.orchestra.run.smithi008.stdout: }, 2023-08-01T19:56:16.820 INFO:teuthology.orchestra.run.smithi008.stdout: { 2023-08-01T19:56:16.820 INFO:teuthology.orchestra.run.smithi008.stdout: "event": "waiting for subops from 1", 2023-08-01T19:56:16.820 INFO:teuthology.orchestra.run.smithi008.stdout: "time": "2023-08-01T19:55:05.627253+0000", 2023-08-01T19:56:16.821 INFO:teuthology.orchestra.run.smithi008.stdout: "duration": 0.000142822 2023-08-01T19:56:16.821 INFO:teuthology.orchestra.run.smithi008.stdout: }, 2023-08-01T19:56:16.821 INFO:teuthology.orchestra.run.smithi008.stdout: { 2023-08-01T19:56:16.821 INFO:teuthology.orchestra.run.smithi008.stdout: "event": "op_commit", 2023-08-01T19:56:16.821 INFO:teuthology.orchestra.run.smithi008.stdout: "time": "2023-08-01T19:55:05.632555+0000", 2023-08-01T19:56:16.821 INFO:teuthology.orchestra.run.smithi008.stdout: "duration": 0.0053012449999999996 2023-08-01T19:56:16.821 INFO:teuthology.orchestra.run.smithi008.stdout: }, 2023-08-01T19:56:16.822 INFO:teuthology.orchestra.run.smithi008.stdout: { 2023-08-01T19:56:16.822 INFO:teuthology.orchestra.run.smithi008.stdout: "event": "sub_op_commit_rec", 2023-08-01T19:56:16.822 INFO:teuthology.orchestra.run.smithi008.stdout: "time": "2023-08-01T19:55:05.637380+0000", 2023-08-01T19:56:16.822 INFO:teuthology.orchestra.run.smithi008.stdout: "duration": 0.0048257639999999997 2023-08-01T19:56:16.822 INFO:teuthology.orchestra.run.smithi008.stdout: }, 2023-08-01T19:56:16.822 INFO:teuthology.orchestra.run.smithi008.stdout: { 2023-08-01T19:56:16.822 INFO:teuthology.orchestra.run.smithi008.stdout: "event": "commit_sent", 2023-08-01T19:56:16.822 INFO:teuthology.orchestra.run.smithi008.stdout: "time": "2023-08-01T19:55:05.637454+0000", 2023-08-01T19:56:16.823 INFO:teuthology.orchestra.run.smithi008.stdout: "duration": 7.3578999999999995e-05 2023-08-01T19:56:16.823 INFO:teuthology.orchestra.run.smithi008.stdout: }, 2023-08-01T19:56:16.823 INFO:teuthology.orchestra.run.smithi008.stdout: { 2023-08-01T19:56:16.823 INFO:teuthology.orchestra.run.smithi008.stdout: "event": "done", 2023-08-01T19:56:16.823 INFO:teuthology.orchestra.run.smithi008.stdout: "time": "2023-08-01T19:55:05.637493+0000", 2023-08-01T19:56:16.823 INFO:teuthology.orchestra.run.smithi008.stdout: "duration": 3.8986999999999998e-05 2023-08-01T19:56:16.823 INFO:teuthology.orchestra.run.smithi008.stdout: } 2023-08-01T19:56:16.823 INFO:teuthology.orchestra.run.smithi008.stdout: ] 2023-08-01T19:56:16.824 INFO:teuthology.orchestra.run.smithi008.stdout: } 2023-08-01T19:56:16.824 INFO:teuthology.orchestra.run.smithi008.stdout: }, 2023-08-01T19:56:16.824 INFO:teuthology.orchestra.run.smithi008.stdout: { 2023-08-01T19:56:16.824 INFO:teuthology.orchestra.run.smithi008.stdout: "description": "osd_op(client.4668.0:107863 5.3 5:cbdd875a:::benchmark_data_smithi006_114134_object107862:head [set-alloc-hint object_size 65536 write_size 65536,write 0~65536] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e38)", 2023-08-01T19:56:16.824 INFO:teuthology.orchestra.run.smithi008.stdout: "initiated_at": "2023-08-01T19:55:09.278851+0000", 2023-08-01T19:56:16.824 INFO:teuthology.orchestra.run.smithi008.stdout: "age": 67.499816523000007, 2023-08-01T19:56:16.824 INFO:teuthology.orchestra.run.smithi008.stdout: "duration": 0.071378853000000006, 2023-08-01T19:56:16.825 INFO:teuthology.orchestra.run.smithi008.stdout: "type_data": { 2023-08-01T19:56:16.825 INFO:teuthology.orchestra.run.smithi008.stdout: "flag_point": "commit sent; apply or cleanup", 2023-08-01T19:56:16.825 INFO:teuthology.orchestra.run.smithi008.stdout: "client_info": { 2023-08-01T19:56:16.825 INFO:teuthology.orchestra.run.smithi008.stdout: "client": "client.4668", 2023-08-01T19:56:16.825 INFO:teuthology.orchestra.run.smithi008.stdout: "client_addr": "172.21.15.6:0/1709472247", 2023-08-01T19:56:16.825 INFO:teuthology.orchestra.run.smithi008.stdout: "tid": 107863 2023-08-01T19:56:16.825 INFO:teuthology.orchestra.run.smithi008.stdout: }, 2023-08-01T19:56:16.825 INFO:teuthology.orchestra.run.smithi008.stdout: "events": [ 2023-08-01T19:56:16.826 INFO:teuthology.orchestra.run.smithi008.stdout: { 2023-08-01T19:56:16.826 INFO:teuthology.orchestra.run.smithi008.stdout: "event": "initiated", 2023-08-01T19:56:16.826 INFO:teuthology.orchestra.run.smithi008.stdout: "time": "2023-08-01T19:55:09.278851+0000", 2023-08-01T19:56:16.826 INFO:teuthology.orchestra.run.smithi008.stdout: "duration": 0 2023-08-01T19:56:16.826 INFO:teuthology.orchestra.run.smithi008.stdout: }, 2023-08-01T19:56:16.826 INFO:teuthology.orchestra.run.smithi008.stdout: { 2023-08-01T19:56:16.826 INFO:teuthology.orchestra.run.smithi008.stdout: "event": "throttled", 2023-08-01T19:56:16.826 INFO:teuthology.orchestra.run.smithi008.stdout: "time": "2023-08-01T19:55:09.278851+0000", 2023-08-01T19:56:16.827 INFO:teuthology.orchestra.run.smithi008.stdout: "duration": 0 2023-08-01T19:56:16.827 INFO:teuthology.orchestra.run.smithi008.stdout: }, 2023-08-01T19:56:16.827 INFO:teuthology.orchestra.run.smithi008.stdout: { 2023-08-01T19:56:16.827 INFO:teuthology.orchestra.run.smithi008.stdout: "event": "header_read", 2023-08-01T19:56:16.827 INFO:teuthology.orchestra.run.smithi008.stdout: "time": "2023-08-01T19:55:09.278850+0000", 2023-08-01T19:56:16.827 INFO:teuthology.orchestra.run.smithi008.stdout: "duration": 4294967295.999999 2023-08-01T19:56:16.827 INFO:teuthology.orchestra.run.smithi008.stdout: }, 2023-08-01T19:56:16.827 INFO:teuthology.orchestra.run.smithi008.stdout: { 2023-08-01T19:56:16.828 INFO:teuthology.orchestra.run.smithi008.stdout: "event": "all_read", 2023-08-01T19:56:16.828 INFO:teuthology.orchestra.run.smithi008.stdout: "time": "2023-08-01T19:55:09.278945+0000", 2023-08-01T19:56:16.828 INFO:teuthology.orchestra.run.smithi008.stdout: "duration": 9.4388000000000005e-05 2023-08-01T19:56:16.828 INFO:teuthology.orchestra.run.smithi008.stdout: }, 2023-08-01T19:56:16.828 INFO:teuthology.orchestra.run.smithi008.stdout: { 2023-08-01T19:56:16.828 INFO:teuthology.orchestra.run.smithi008.stdout: "event": "dispatched", 2023-08-01T19:56:16.828 INFO:teuthology.orchestra.run.smithi008.stdout: "time": "2023-08-01T19:55:09.278955+0000", 2023-08-01T19:56:16.828 INFO:teuthology.orchestra.run.smithi008.stdout: "duration": 1.0413e-05 2023-08-01T19:56:16.829 INFO:teuthology.orchestra.run.smithi008.stdout: }, 2023-08-01T19:56:16.829 INFO:teuthology.orchestra.run.smithi008.stdout: { 2023-08-01T19:56:16.829 INFO:teuthology.orchestra.run.smithi008.stdout: "event": "queued_for_pg", 2023-08-01T19:56:16.829 INFO:teuthology.orchestra.run.smithi008.stdout: "time": "2023-08-01T19:55:09.278962+0000", 2023-08-01T19:56:16.829 INFO:teuthology.orchestra.run.smithi008.stdout: "duration": 6.2169999999999999e-06 2023-08-01T19:56:16.829 INFO:teuthology.orchestra.run.smithi008.stdout: }, 2023-08-01T19:56:16.829 INFO:teuthology.orchestra.run.smithi008.stdout: { 2023-08-01T19:56:16.830 INFO:teuthology.orchestra.run.smithi008.stdout: "event": "reached_pg", 2023-08-01T19:56:16.830 INFO:teuthology.orchestra.run.smithi008.stdout: "time": "2023-08-01T19:55:09.280363+0000", 2023-08-01T19:56:16.830 INFO:teuthology.orchestra.run.smithi008.stdout: "duration": 0.0014014489999999999 2023-08-01T19:56:16.830 INFO:teuthology.orchestra.run.smithi008.stdout: }, 2023-08-01T19:56:16.830 INFO:teuthology.orchestra.run.smithi008.stdout: { 2023-08-01T19:56:16.830 INFO:teuthology.orchestra.run.smithi008.stdout: "event": "started", 2023-08-01T19:56:16.830 INFO:teuthology.orchestra.run.smithi008.stdout: "time": "2023-08-01T19:55:09.280488+0000", 2023-08-01T19:56:16.830 INFO:teuthology.orchestra.run.smithi008.stdout: "duration": 0.00012474099999999999 2023-08-01T19:56:16.831 INFO:teuthology.orchestra.run.smithi008.stdout: }, 2023-08-01T19:56:16.831 INFO:teuthology.orchestra.run.smithi008.stdout: { 2023-08-01T19:56:16.831 INFO:teuthology.orchestra.run.smithi008.stdout: "event": "waiting for subops from 1", 2023-08-01T19:56:16.831 INFO:teuthology.orchestra.run.smithi008.stdout: "time": "2023-08-01T19:55:09.280626+0000", 2023-08-01T19:56:16.831 INFO:teuthology.orchestra.run.smithi008.stdout: "duration": 0.000138193 2023-08-01T19:56:16.831 INFO:teuthology.orchestra.run.smithi008.stdout: }, 2023-08-01T19:56:16.831 INFO:teuthology.orchestra.run.smithi008.stdout: { 2023-08-01T19:56:16.831 INFO:teuthology.orchestra.run.smithi008.stdout: "event": "op_commit", 2023-08-01T19:56:16.832 INFO:teuthology.orchestra.run.smithi008.stdout: "time": "2023-08-01T19:55:09.285958+0000", 2023-08-01T19:56:16.832 INFO:teuthology.orchestra.run.smithi008.stdout: "duration": 0.0053317130000000001 2023-08-01T19:56:16.832 INFO:teuthology.orchestra.run.smithi008.stdout: }, 2023-08-01T19:56:16.832 INFO:teuthology.orchestra.run.smithi008.stdout: { 2023-08-01T19:56:16.832 INFO:teuthology.orchestra.run.smithi008.stdout: "event": "sub_op_commit_rec", 2023-08-01T19:56:16.832 INFO:teuthology.orchestra.run.smithi008.stdout: "time": "2023-08-01T19:55:09.350151+0000", 2023-08-01T19:56:16.832 INFO:teuthology.orchestra.run.smithi008.stdout: "duration": 0.064193202000000005 2023-08-01T19:56:16.832 INFO:teuthology.orchestra.run.smithi008.stdout: }, 2023-08-01T19:56:16.833 INFO:teuthology.orchestra.run.smithi008.stdout: { 2023-08-01T19:56:16.833 INFO:teuthology.orchestra.run.smithi008.stdout: "event": "commit_sent", 2023-08-01T19:56:16.833 INFO:teuthology.orchestra.run.smithi008.stdout: "time": "2023-08-01T19:55:09.350188+0000", 2023-08-01T19:56:16.833 INFO:teuthology.orchestra.run.smithi008.stdout: "duration": 3.7549999999999998e-05 2023-08-01T19:56:16.833 INFO:teuthology.orchestra.run.smithi008.stdout: }, 2023-08-01T19:56:16.833 INFO:teuthology.orchestra.run.smithi008.stdout: { 2023-08-01T19:56:16.833 INFO:teuthology.orchestra.run.smithi008.stdout: "event": "done", 2023-08-01T19:56:16.834 INFO:teuthology.orchestra.run.smithi008.stdout: "time": "2023-08-01T19:55:09.350230+0000", 2023-08-01T19:56:16.834 INFO:teuthology.orchestra.run.smithi008.stdout: "duration": 4.1804999999999997e-05 2023-08-01T19:56:16.834 INFO:teuthology.orchestra.run.smithi008.stdout: } 2023-08-01T19:56:16.834 INFO:teuthology.orchestra.run.smithi008.stdout: ] 2023-08-01T19:56:16.834 INFO:teuthology.orchestra.run.smithi008.stdout: } 2023-08-01T19:56:16.834 INFO:teuthology.orchestra.run.smithi008.stdout: }, 2023-08-01T19:56:16.834 INFO:teuthology.orchestra.run.smithi008.stdout: { 2023-08-01T19:56:16.834 INFO:teuthology.orchestra.run.smithi008.stdout: "description": "osd_op(client.4668.0:107865 5.3 5:c2ebb96d:::benchmark_data_smithi006_114134_object107864:head [set-alloc-hint object_size 65536 write_size 65536,write 0~65536] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e38)", 2023-08-01T19:56:16.835 INFO:teuthology.orchestra.run.smithi008.stdout: "initiated_at": "2023-08-01T19:55:09.279020+0000", 2023-08-01T19:56:16.835 INFO:teuthology.orchestra.run.smithi008.stdout: "age": 67.499647851000006, 2023-08-01T19:56:16.835 INFO:teuthology.orchestra.run.smithi008.stdout: "duration": 0.072892565000000006, 2023-08-01T19:56:16.835 INFO:teuthology.orchestra.run.smithi008.stdout: "type_data": { 2023-08-01T19:56:16.835 INFO:teuthology.orchestra.run.smithi008.stdout: "flag_point": "commit sent; apply or cleanup", 2023-08-01T19:56:16.835 INFO:teuthology.orchestra.run.smithi008.stdout: "client_info": { 2023-08-01T19:56:16.835 INFO:teuthology.orchestra.run.smithi008.stdout: "client": "client.4668", 2023-08-01T19:56:16.835 INFO:teuthology.orchestra.run.smithi008.stdout: "client_addr": "172.21.15.6:0/1709472247", 2023-08-01T19:56:16.836 INFO:teuthology.orchestra.run.smithi008.stdout: "tid": 107865 2023-08-01T19:56:16.836 INFO:teuthology.orchestra.run.smithi008.stdout: }, 2023-08-01T19:56:16.836 INFO:teuthology.orchestra.run.smithi008.stdout: "events": [ 2023-08-01T19:56:16.836 INFO:teuthology.orchestra.run.smithi008.stdout: { 2023-08-01T19:56:16.836 INFO:teuthology.orchestra.run.smithi008.stdout: "event": "initiated", 2023-08-01T19:56:16.836 INFO:teuthology.orchestra.run.smithi008.stdout: "time": "2023-08-01T19:55:09.279020+0000", 2023-08-01T19:56:16.836 INFO:teuthology.orchestra.run.smithi008.stdout: "duration": 0 2023-08-01T19:56:16.837 INFO:teuthology.orchestra.run.smithi008.stdout: }, 2023-08-01T19:56:16.837 INFO:teuthology.orchestra.run.smithi008.stdout: { 2023-08-01T19:56:16.837 INFO:teuthology.orchestra.run.smithi008.stdout: "event": "throttled", 2023-08-01T19:56:16.837 INFO:teuthology.orchestra.run.smithi008.stdout: "time": "2023-08-01T19:55:09.279020+0000", 2023-08-01T19:56:16.837 INFO:teuthology.orchestra.run.smithi008.stdout: "duration": 0 2023-08-01T19:56:16.837 INFO:teuthology.orchestra.run.smithi008.stdout: }, 2023-08-01T19:56:16.837 INFO:teuthology.orchestra.run.smithi008.stdout: { 2023-08-01T19:56:16.838 INFO:teuthology.orchestra.run.smithi008.stdout: "event": "header_read", 2023-08-01T19:56:16.838 INFO:teuthology.orchestra.run.smithi008.stdout: "time": "2023-08-01T19:55:09.279019+0000", 2023-08-01T19:56:16.838 INFO:teuthology.orchestra.run.smithi008.stdout: "duration": 4294967295.999999 2023-08-01T19:56:16.838 INFO:teuthology.orchestra.run.smithi008.stdout: }, 2023-08-01T19:56:16.838 INFO:teuthology.orchestra.run.smithi008.stdout: { 2023-08-01T19:56:16.838 INFO:teuthology.orchestra.run.smithi008.stdout: "event": "all_read", 2023-08-01T19:56:16.838 INFO:teuthology.orchestra.run.smithi008.stdout: "time": "2023-08-01T19:55:09.279087+0000", 2023-08-01T19:56:16.839 INFO:teuthology.orchestra.run.smithi008.stdout: "duration": 6.8392000000000005e-05 2023-08-01T19:56:16.839 INFO:teuthology.orchestra.run.smithi008.stdout: }, 2023-08-01T19:56:16.839 INFO:teuthology.orchestra.run.smithi008.stdout: { 2023-08-01T19:56:16.839 INFO:teuthology.orchestra.run.smithi008.stdout: "event": "dispatched", 2023-08-01T19:56:16.839 INFO:teuthology.orchestra.run.smithi008.stdout: "time": "2023-08-01T19:55:09.279095+0000", 2023-08-01T19:56:16.839 INFO:teuthology.orchestra.run.smithi008.stdout: "duration": 8.0989999999999999e-06 2023-08-01T19:56:16.839 INFO:teuthology.orchestra.run.smithi008.stdout: }, 2023-08-01T19:56:16.839 INFO:teuthology.orchestra.run.smithi008.stdout: { 2023-08-01T19:56:16.840 INFO:teuthology.orchestra.run.smithi008.stdout: "event": "queued_for_pg", 2023-08-01T19:56:16.840 INFO:teuthology.orchestra.run.smithi008.stdout: "time": "2023-08-01T19:55:09.279101+0000", 2023-08-01T19:56:16.840 INFO:teuthology.orchestra.run.smithi008.stdout: "duration": 5.0390000000000004e-06 2023-08-01T19:56:16.840 INFO:teuthology.orchestra.run.smithi008.stdout: }, 2023-08-01T19:56:16.840 INFO:teuthology.orchestra.run.smithi008.stdout: { 2023-08-01T19:56:16.840 INFO:teuthology.orchestra.run.smithi008.stdout: "event": "reached_pg", 2023-08-01T19:56:16.840 INFO:teuthology.orchestra.run.smithi008.stdout: "time": "2023-08-01T19:55:09.282574+0000", 2023-08-01T19:56:16.841 INFO:teuthology.orchestra.run.smithi008.stdout: "duration": 0.0034730619999999999 2023-08-01T19:56:16.841 INFO:teuthology.orchestra.run.smithi008.stdout: }, 2023-08-01T19:56:16.841 INFO:teuthology.orchestra.run.smithi008.stdout: { 2023-08-01T19:56:16.841 INFO:teuthology.orchestra.run.smithi008.stdout: "event": "started", 2023-08-01T19:56:16.841 INFO:teuthology.orchestra.run.smithi008.stdout: "time": "2023-08-01T19:55:09.282705+0000", 2023-08-01T19:56:16.841 INFO:teuthology.orchestra.run.smithi008.stdout: "duration": 0.00013133400000000001 2023-08-01T19:56:16.841 INFO:teuthology.orchestra.run.smithi008.stdout: }, 2023-08-01T19:56:16.841 INFO:teuthology.orchestra.run.smithi008.stdout: { 2023-08-01T19:56:16.842 INFO:teuthology.orchestra.run.smithi008.stdout: "event": "waiting for subops from 1", 2023-08-01T19:56:16.842 INFO:teuthology.orchestra.run.smithi008.stdout: "time": "2023-08-01T19:55:09.283067+0000", 2023-08-01T19:56:16.842 INFO:teuthology.orchestra.run.smithi008.stdout: "duration": 0.00036195299999999998 2023-08-01T19:56:16.842 INFO:teuthology.orchestra.run.smithi008.stdout: }, 2023-08-01T19:56:16.842 INFO:teuthology.orchestra.run.smithi008.stdout: { 2023-08-01T19:56:16.842 INFO:teuthology.orchestra.run.smithi008.stdout: "event": "op_commit", 2023-08-01T19:56:16.842 INFO:teuthology.orchestra.run.smithi008.stdout: "time": "2023-08-01T19:55:09.288196+0000", 2023-08-01T19:56:16.842 INFO:teuthology.orchestra.run.smithi008.stdout: "duration": 0.0051293780000000004 2023-08-01T19:56:16.843 INFO:teuthology.orchestra.run.smithi008.stdout: }, 2023-08-01T19:56:16.843 INFO:teuthology.orchestra.run.smithi008.stdout: { 2023-08-01T19:56:16.843 INFO:teuthology.orchestra.run.smithi008.stdout: "event": "sub_op_commit_rec", 2023-08-01T19:56:16.843 INFO:teuthology.orchestra.run.smithi008.stdout: "time": "2023-08-01T19:55:09.351832+0000", 2023-08-01T19:56:16.843 INFO:teuthology.orchestra.run.smithi008.stdout: "duration": 0.063636076 2023-08-01T19:56:16.843 INFO:teuthology.orchestra.run.smithi008.stdout: }, 2023-08-01T19:56:16.843 INFO:teuthology.orchestra.run.smithi008.stdout: { 2023-08-01T19:56:16.843 INFO:teuthology.orchestra.run.smithi008.stdout: "event": "commit_sent", 2023-08-01T19:56:16.844 INFO:teuthology.orchestra.run.smithi008.stdout: "time": "2023-08-01T19:55:09.351878+0000", 2023-08-01T19:56:16.844 INFO:teuthology.orchestra.run.smithi008.stdout: "duration": 4.5408999999999998e-05 2023-08-01T19:56:16.844 INFO:teuthology.orchestra.run.smithi008.stdout: }, 2023-08-01T19:56:16.844 INFO:teuthology.orchestra.run.smithi008.stdout: { 2023-08-01T19:56:16.844 INFO:teuthology.orchestra.run.smithi008.stdout: "event": "done", 2023-08-01T19:56:16.844 INFO:teuthology.orchestra.run.smithi008.stdout: "time": "2023-08-01T19:55:09.351913+0000", 2023-08-01T19:56:16.844 INFO:teuthology.orchestra.run.smithi008.stdout: "duration": 3.4808999999999998e-05 2023-08-01T19:56:16.844 INFO:teuthology.orchestra.run.smithi008.stdout: } 2023-08-01T19:56:16.845 INFO:teuthology.orchestra.run.smithi008.stdout: ] 2023-08-01T19:56:16.845 INFO:teuthology.orchestra.run.smithi008.stdout: } 2023-08-01T19:56:16.845 INFO:teuthology.orchestra.run.smithi008.stdout: }, 2023-08-01T19:56:16.845 INFO:teuthology.orchestra.run.smithi008.stdout: { 2023-08-01T19:56:16.845 INFO:teuthology.orchestra.run.smithi008.stdout: "description": "osd_op(client.4668.0:107869 5.c 5:31910384:::benchmark_data_smithi006_114134_object107868:head [set-alloc-hint object_size 65536 write_size 65536,write 0~65536] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e38)", 2023-08-01T19:56:16.845 INFO:teuthology.orchestra.run.smithi008.stdout: "initiated_at": "2023-08-01T19:55:09.283205+0000", 2023-08-01T19:56:16.845 INFO:teuthology.orchestra.run.smithi008.stdout: "age": 67.495462685999996, 2023-08-01T19:56:16.846 INFO:teuthology.orchestra.run.smithi008.stdout: "duration": 0.068611808999999996, 2023-08-01T19:56:16.846 INFO:teuthology.orchestra.run.smithi008.stdout: "type_data": { 2023-08-01T19:56:16.846 INFO:teuthology.orchestra.run.smithi008.stdout: "flag_point": "commit sent; apply or cleanup", 2023-08-01T19:56:16.846 INFO:teuthology.orchestra.run.smithi008.stdout: "client_info": { 2023-08-01T19:56:16.846 INFO:teuthology.orchestra.run.smithi008.stdout: "client": "client.4668", 2023-08-01T19:56:16.846 INFO:teuthology.orchestra.run.smithi008.stdout: "client_addr": "172.21.15.6:0/1709472247", 2023-08-01T19:56:16.846 INFO:teuthology.orchestra.run.smithi008.stdout: "tid": 107869 2023-08-01T19:56:16.847 INFO:teuthology.orchestra.run.smithi008.stdout: }, 2023-08-01T19:56:16.847 INFO:teuthology.orchestra.run.smithi008.stdout: "events": [ 2023-08-01T19:56:16.847 INFO:teuthology.orchestra.run.smithi008.stdout: { 2023-08-01T19:56:16.847 INFO:teuthology.orchestra.run.smithi008.stdout: "event": "initiated", 2023-08-01T19:56:16.847 INFO:teuthology.orchestra.run.smithi008.stdout: "time": "2023-08-01T19:55:09.283205+0000", 2023-08-01T19:56:16.847 INFO:teuthology.orchestra.run.smithi008.stdout: "duration": 0 2023-08-01T19:56:16.847 INFO:teuthology.orchestra.run.smithi008.stdout: }, 2023-08-01T19:56:16.847 INFO:teuthology.orchestra.run.smithi008.stdout: { 2023-08-01T19:56:16.848 INFO:teuthology.orchestra.run.smithi008.stdout: "event": "throttled", 2023-08-01T19:56:16.848 INFO:teuthology.orchestra.run.smithi008.stdout: "time": "2023-08-01T19:55:09.283205+0000", 2023-08-01T19:56:16.848 INFO:teuthology.orchestra.run.smithi008.stdout: "duration": 0 2023-08-01T19:56:16.848 INFO:teuthology.orchestra.run.smithi008.stdout: }, 2023-08-01T19:56:16.848 INFO:teuthology.orchestra.run.smithi008.stdout: { 2023-08-01T19:56:16.848 INFO:teuthology.orchestra.run.smithi008.stdout: "event": "header_read", 2023-08-01T19:56:16.848 INFO:teuthology.orchestra.run.smithi008.stdout: "time": "2023-08-01T19:55:09.283204+0000", 2023-08-01T19:56:16.848 INFO:teuthology.orchestra.run.smithi008.stdout: "duration": 4294967295.999999 2023-08-01T19:56:16.849 INFO:teuthology.orchestra.run.smithi008.stdout: }, 2023-08-01T19:56:16.849 INFO:teuthology.orchestra.run.smithi008.stdout: { 2023-08-01T19:56:16.849 INFO:teuthology.orchestra.run.smithi008.stdout: "event": "all_read", 2023-08-01T19:56:16.849 INFO:teuthology.orchestra.run.smithi008.stdout: "time": "2023-08-01T19:55:09.283300+0000", 2023-08-01T19:56:16.849 INFO:teuthology.orchestra.run.smithi008.stdout: "duration": 9.6280000000000007e-05 2023-08-01T19:56:16.849 INFO:teuthology.orchestra.run.smithi008.stdout: }, 2023-08-01T19:56:16.849 INFO:teuthology.orchestra.run.smithi008.stdout: { 2023-08-01T19:56:16.849 INFO:teuthology.orchestra.run.smithi008.stdout: "event": "dispatched", 2023-08-01T19:56:16.850 INFO:teuthology.orchestra.run.smithi008.stdout: "time": "2023-08-01T19:55:09.283314+0000", 2023-08-01T19:56:16.850 INFO:teuthology.orchestra.run.smithi008.stdout: "duration": 1.3344e-05 2023-08-01T19:56:16.850 INFO:teuthology.orchestra.run.smithi008.stdout: }, 2023-08-01T19:56:16.850 INFO:teuthology.orchestra.run.smithi008.stdout: { 2023-08-01T19:56:16.850 INFO:teuthology.orchestra.run.smithi008.stdout: "event": "queued_for_pg", 2023-08-01T19:56:16.850 INFO:teuthology.orchestra.run.smithi008.stdout: "time": "2023-08-01T19:55:09.283320+0000", 2023-08-01T19:56:16.850 INFO:teuthology.orchestra.run.smithi008.stdout: "duration": 6.0299999999999999e-06 2023-08-01T19:56:16.850 INFO:teuthology.orchestra.run.smithi008.stdout: }, 2023-08-01T19:56:16.851 INFO:teuthology.orchestra.run.smithi008.stdout: { 2023-08-01T19:56:16.851 INFO:teuthology.orchestra.run.smithi008.stdout: "event": "reached_pg", 2023-08-01T19:56:16.851 INFO:teuthology.orchestra.run.smithi008.stdout: "time": "2023-08-01T19:55:09.283365+0000", 2023-08-01T19:56:16.851 INFO:teuthology.orchestra.run.smithi008.stdout: "duration": 4.5578999999999998e-05 2023-08-01T19:56:16.851 INFO:teuthology.orchestra.run.smithi008.stdout: }, 2023-08-01T19:56:16.851 INFO:teuthology.orchestra.run.smithi008.stdout: { 2023-08-01T19:56:16.851 INFO:teuthology.orchestra.run.smithi008.stdout: "event": "started", 2023-08-01T19:56:16.851 INFO:teuthology.orchestra.run.smithi008.stdout: "time": "2023-08-01T19:55:09.283490+0000", 2023-08-01T19:56:16.852 INFO:teuthology.orchestra.run.smithi008.stdout: "duration": 0.00012473700000000001 2023-08-01T19:56:16.852 INFO:teuthology.orchestra.run.smithi008.stdout: }, 2023-08-01T19:56:16.852 INFO:teuthology.orchestra.run.smithi008.stdout: { 2023-08-01T19:56:16.852 INFO:teuthology.orchestra.run.smithi008.stdout: "event": "waiting for subops from 1", 2023-08-01T19:56:16.852 INFO:teuthology.orchestra.run.smithi008.stdout: "time": "2023-08-01T19:55:09.283637+0000", 2023-08-01T19:56:16.852 INFO:teuthology.orchestra.run.smithi008.stdout: "duration": 0.00014715600000000001 2023-08-01T19:56:16.852 INFO:teuthology.orchestra.run.smithi008.stdout: }, 2023-08-01T19:56:16.853 INFO:teuthology.orchestra.run.smithi008.stdout: { 2023-08-01T19:56:16.853 INFO:teuthology.orchestra.run.smithi008.stdout: "event": "op_commit", 2023-08-01T19:56:16.853 INFO:teuthology.orchestra.run.smithi008.stdout: "time": "2023-08-01T19:55:09.288214+0000", 2023-08-01T19:56:16.853 INFO:teuthology.orchestra.run.smithi008.stdout: "duration": 0.0045769560000000001 2023-08-01T19:56:16.853 INFO:teuthology.orchestra.run.smithi008.stdout: }, 2023-08-01T19:56:16.853 INFO:teuthology.orchestra.run.smithi008.stdout: { 2023-08-01T19:56:16.853 INFO:teuthology.orchestra.run.smithi008.stdout: "event": "sub_op_commit_rec", 2023-08-01T19:56:16.853 INFO:teuthology.orchestra.run.smithi008.stdout: "time": "2023-08-01T19:55:09.351721+0000", 2023-08-01T19:56:16.854 INFO:teuthology.orchestra.run.smithi008.stdout: "duration": 0.063507383000000001 2023-08-01T19:56:16.854 INFO:teuthology.orchestra.run.smithi008.stdout: }, 2023-08-01T19:56:16.854 INFO:teuthology.orchestra.run.smithi008.stdout: { 2023-08-01T19:56:16.854 INFO:teuthology.orchestra.run.smithi008.stdout: "event": "commit_sent", 2023-08-01T19:56:16.854 INFO:teuthology.orchestra.run.smithi008.stdout: "time": "2023-08-01T19:55:09.351777+0000", 2023-08-01T19:56:16.854 INFO:teuthology.orchestra.run.smithi008.stdout: "duration": 5.5733999999999999e-05 2023-08-01T19:56:16.854 INFO:teuthology.orchestra.run.smithi008.stdout: }, 2023-08-01T19:56:16.854 INFO:teuthology.orchestra.run.smithi008.stdout: { 2023-08-01T19:56:16.855 INFO:teuthology.orchestra.run.smithi008.stdout: "event": "done", 2023-08-01T19:56:16.855 INFO:teuthology.orchestra.run.smithi008.stdout: "time": "2023-08-01T19:55:09.351817+0000", 2023-08-01T19:56:16.855 INFO:teuthology.orchestra.run.smithi008.stdout: "duration": 3.9765000000000003e-05 2023-08-01T19:56:16.855 INFO:teuthology.orchestra.run.smithi008.stdout: } 2023-08-01T19:56:16.855 INFO:teuthology.orchestra.run.smithi008.stdout: ] 2023-08-01T19:56:16.855 INFO:teuthology.orchestra.run.smithi008.stdout: } 2023-08-01T19:56:16.855 INFO:teuthology.orchestra.run.smithi008.stdout: }, 2023-08-01T19:56:16.855 INFO:teuthology.orchestra.run.smithi008.stdout: { 2023-08-01T19:56:16.856 INFO:teuthology.orchestra.run.smithi008.stdout: "description": "osd_op(client.4668.0:107874 5.3 5:ce4c2799:::benchmark_data_smithi006_114134_object107873:head [set-alloc-hint object_size 65536 write_size 65536,write 0~65536] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e38)", 2023-08-01T19:56:16.856 INFO:teuthology.orchestra.run.smithi008.stdout: "initiated_at": "2023-08-01T19:55:09.286239+0000", 2023-08-01T19:56:16.856 INFO:teuthology.orchestra.run.smithi008.stdout: "age": 67.492429181000006, 2023-08-01T19:56:16.856 INFO:teuthology.orchestra.run.smithi008.stdout: "duration": 0.068224389999999996, 2023-08-01T19:56:16.856 INFO:teuthology.orchestra.run.smithi008.stdout: "type_data": { 2023-08-01T19:56:16.856 INFO:teuthology.orchestra.run.smithi008.stdout: "flag_point": "commit sent; apply or cleanup", 2023-08-01T19:56:16.856 INFO:teuthology.orchestra.run.smithi008.stdout: "client_info": { 2023-08-01T19:56:16.857 INFO:teuthology.orchestra.run.smithi008.stdout: "client": "client.4668", 2023-08-01T19:56:16.857 INFO:teuthology.orchestra.run.smithi008.stdout: "client_addr": "172.21.15.6:0/1709472247", 2023-08-01T19:56:16.857 INFO:teuthology.orchestra.run.smithi008.stdout: "tid": 107874 2023-08-01T19:56:16.857 INFO:teuthology.orchestra.run.smithi008.stdout: }, 2023-08-01T19:56:16.857 INFO:teuthology.orchestra.run.smithi008.stdout: "events": [ 2023-08-01T19:56:16.857 INFO:teuthology.orchestra.run.smithi008.stdout: { 2023-08-01T19:56:16.857 INFO:teuthology.orchestra.run.smithi008.stdout: "event": "initiated", 2023-08-01T19:56:16.857 INFO:teuthology.orchestra.run.smithi008.stdout: "time": "2023-08-01T19:55:09.286239+0000", 2023-08-01T19:56:16.858 INFO:teuthology.orchestra.run.smithi008.stdout: "duration": 0 2023-08-01T19:56:16.858 INFO:teuthology.orchestra.run.smithi008.stdout: }, 2023-08-01T19:56:16.858 INFO:teuthology.orchestra.run.smithi008.stdout: { 2023-08-01T19:56:16.858 INFO:teuthology.orchestra.run.smithi008.stdout: "event": "throttled", 2023-08-01T19:56:16.858 INFO:teuthology.orchestra.run.smithi008.stdout: "time": "2023-08-01T19:55:09.286239+0000", 2023-08-01T19:56:16.858 INFO:teuthology.orchestra.run.smithi008.stdout: "duration": 0 2023-08-01T19:56:16.858 INFO:teuthology.orchestra.run.smithi008.stdout: }, 2023-08-01T19:56:16.858 INFO:teuthology.orchestra.run.smithi008.stdout: { 2023-08-01T19:56:16.859 INFO:teuthology.orchestra.run.smithi008.stdout: "event": "header_read", 2023-08-01T19:56:16.859 INFO:teuthology.orchestra.run.smithi008.stdout: "time": "2023-08-01T19:55:09.286238+0000", 2023-08-01T19:56:16.859 INFO:teuthology.orchestra.run.smithi008.stdout: "duration": 4294967295.999999 2023-08-01T19:56:16.859 INFO:teuthology.orchestra.run.smithi008.stdout: }, 2023-08-01T19:56:16.859 INFO:teuthology.orchestra.run.smithi008.stdout: { 2023-08-01T19:56:16.859 INFO:teuthology.orchestra.run.smithi008.stdout: "event": "all_read", 2023-08-01T19:56:16.859 INFO:teuthology.orchestra.run.smithi008.stdout: "time": "2023-08-01T19:55:09.286310+0000", 2023-08-01T19:56:16.859 INFO:teuthology.orchestra.run.smithi008.stdout: "duration": 7.2583999999999995e-05 2023-08-01T19:56:16.860 INFO:teuthology.orchestra.run.smithi008.stdout: }, 2023-08-01T19:56:16.860 INFO:teuthology.orchestra.run.smithi008.stdout: { 2023-08-01T19:56:16.860 INFO:teuthology.orchestra.run.smithi008.stdout: "event": "dispatched", 2023-08-01T19:56:16.860 INFO:teuthology.orchestra.run.smithi008.stdout: "time": "2023-08-01T19:55:09.286323+0000", 2023-08-01T19:56:16.860 INFO:teuthology.orchestra.run.smithi008.stdout: "duration": 1.3151e-05 2023-08-01T19:56:16.860 INFO:teuthology.orchestra.run.smithi008.stdout: }, 2023-08-01T19:56:16.860 INFO:teuthology.orchestra.run.smithi008.stdout: { 2023-08-01T19:56:16.861 INFO:teuthology.orchestra.run.smithi008.stdout: "event": "queued_for_pg", 2023-08-01T19:56:16.861 INFO:teuthology.orchestra.run.smithi008.stdout: "time": "2023-08-01T19:55:09.286329+0000", 2023-08-01T19:56:16.861 INFO:teuthology.orchestra.run.smithi008.stdout: "duration": 5.8719999999999999e-06 2023-08-01T19:56:16.861 INFO:teuthology.orchestra.run.smithi008.stdout: }, 2023-08-01T19:56:16.861 INFO:teuthology.orchestra.run.smithi008.stdout: { 2023-08-01T19:56:16.861 INFO:teuthology.orchestra.run.smithi008.stdout: "event": "reached_pg", 2023-08-01T19:56:16.861 INFO:teuthology.orchestra.run.smithi008.stdout: "time": "2023-08-01T19:55:09.286392+0000", 2023-08-01T19:56:16.861 INFO:teuthology.orchestra.run.smithi008.stdout: "duration": 6.2378000000000005e-05 2023-08-01T19:56:16.862 INFO:teuthology.orchestra.run.smithi008.stdout: }, 2023-08-01T19:56:16.862 INFO:teuthology.orchestra.run.smithi008.stdout: { 2023-08-01T19:56:16.862 INFO:teuthology.orchestra.run.smithi008.stdout: "event": "started", 2023-08-01T19:56:16.862 INFO:teuthology.orchestra.run.smithi008.stdout: "time": "2023-08-01T19:55:09.286473+0000", 2023-08-01T19:56:16.862 INFO:teuthology.orchestra.run.smithi008.stdout: "duration": 8.1327000000000002e-05 2023-08-01T19:56:16.862 INFO:teuthology.orchestra.run.smithi008.stdout: }, 2023-08-01T19:56:16.862 INFO:teuthology.orchestra.run.smithi008.stdout: { 2023-08-01T19:56:16.862 INFO:teuthology.orchestra.run.smithi008.stdout: "event": "waiting for subops from 1", 2023-08-01T19:56:16.863 INFO:teuthology.orchestra.run.smithi008.stdout: "time": "2023-08-01T19:55:09.286557+0000", 2023-08-01T19:56:16.863 INFO:teuthology.orchestra.run.smithi008.stdout: "duration": 8.4140000000000004e-05 2023-08-01T19:56:16.863 INFO:teuthology.orchestra.run.smithi008.stdout: }, 2023-08-01T19:56:16.863 INFO:teuthology.orchestra.run.smithi008.stdout: { 2023-08-01T19:56:16.863 INFO:teuthology.orchestra.run.smithi008.stdout: "event": "op_commit", 2023-08-01T19:56:16.863 INFO:teuthology.orchestra.run.smithi008.stdout: "time": "2023-08-01T19:55:09.290681+0000", 2023-08-01T19:56:16.863 INFO:teuthology.orchestra.run.smithi008.stdout: "duration": 0.0041242420000000002 2023-08-01T19:56:16.863 INFO:teuthology.orchestra.run.smithi008.stdout: }, 2023-08-01T19:56:16.864 INFO:teuthology.orchestra.run.smithi008.stdout: { 2023-08-01T19:56:16.864 INFO:teuthology.orchestra.run.smithi008.stdout: "event": "sub_op_commit_rec", 2023-08-01T19:56:16.864 INFO:teuthology.orchestra.run.smithi008.stdout: "time": "2023-08-01T19:55:09.354372+0000", 2023-08-01T19:56:16.864 INFO:teuthology.orchestra.run.smithi008.stdout: "duration": 0.063690438000000002 2023-08-01T19:56:16.864 INFO:teuthology.orchestra.run.smithi008.stdout: }, 2023-08-01T19:56:16.864 INFO:teuthology.orchestra.run.smithi008.stdout: { 2023-08-01T19:56:16.864 INFO:teuthology.orchestra.run.smithi008.stdout: "event": "commit_sent", 2023-08-01T19:56:16.865 INFO:teuthology.orchestra.run.smithi008.stdout: "time": "2023-08-01T19:55:09.354421+0000", 2023-08-01T19:56:16.865 INFO:teuthology.orchestra.run.smithi008.stdout: "duration": 4.9413000000000003e-05 2023-08-01T19:56:16.865 INFO:teuthology.orchestra.run.smithi008.stdout: }, 2023-08-01T19:56:16.865 INFO:teuthology.orchestra.run.smithi008.stdout: { 2023-08-01T19:56:16.865 INFO:teuthology.orchestra.run.smithi008.stdout: "event": "done", 2023-08-01T19:56:16.865 INFO:teuthology.orchestra.run.smithi008.stdout: "time": "2023-08-01T19:55:09.354463+0000", 2023-08-01T19:56:16.865 INFO:teuthology.orchestra.run.smithi008.stdout: "duration": 4.1924e-05 2023-08-01T19:56:16.865 INFO:teuthology.orchestra.run.smithi008.stdout: } 2023-08-01T19:56:16.866 INFO:teuthology.orchestra.run.smithi008.stdout: ] 2023-08-01T19:56:16.866 INFO:teuthology.orchestra.run.smithi008.stdout: } 2023-08-01T19:56:16.866 INFO:teuthology.orchestra.run.smithi008.stdout: }, 2023-08-01T19:56:16.866 INFO:teuthology.orchestra.run.smithi008.stdout: { 2023-08-01T19:56:16.866 INFO:teuthology.orchestra.run.smithi008.stdout: "description": "osd_op(client.4668.0:197398 5.1 5:809d7164:::benchmark_data_smithi006_114134_object63737:head [delete] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e61)", 2023-08-01T19:56:16.866 INFO:teuthology.orchestra.run.smithi008.stdout: "initiated_at": "2023-08-01T19:55:58.554713+0000", 2023-08-01T19:56:16.866 INFO:teuthology.orchestra.run.smithi008.stdout: "age": 18.223954493000001, 2023-08-01T19:56:16.866 INFO:teuthology.orchestra.run.smithi008.stdout: "duration": 1.0661326660000001, 2023-08-01T19:56:16.867 INFO:teuthology.orchestra.run.smithi008.stdout: "type_data": { 2023-08-01T19:56:16.867 INFO:teuthology.orchestra.run.smithi008.stdout: "flag_point": "reached pg", 2023-08-01T19:56:16.867 INFO:teuthology.orchestra.run.smithi008.stdout: "client_info": { 2023-08-01T19:56:16.867 INFO:teuthology.orchestra.run.smithi008.stdout: "client": "client.4668", 2023-08-01T19:56:16.867 INFO:teuthology.orchestra.run.smithi008.stdout: "client_addr": "172.21.15.6:0/1709472247", 2023-08-01T19:56:16.867 INFO:teuthology.orchestra.run.smithi008.stdout: "tid": 197398 2023-08-01T19:56:16.867 INFO:teuthology.orchestra.run.smithi008.stdout: }, 2023-08-01T19:56:16.867 INFO:teuthology.orchestra.run.smithi008.stdout: "events": [ 2023-08-01T19:56:16.868 INFO:teuthology.orchestra.run.smithi008.stdout: { 2023-08-01T19:56:16.868 INFO:teuthology.orchestra.run.smithi008.stdout: "event": "initiated", 2023-08-01T19:56:16.868 INFO:teuthology.orchestra.run.smithi008.stdout: "time": "2023-08-01T19:55:58.554713+0000", 2023-08-01T19:56:16.868 INFO:teuthology.orchestra.run.smithi008.stdout: "duration": 0 2023-08-01T19:56:16.868 INFO:teuthology.orchestra.run.smithi008.stdout: }, 2023-08-01T19:56:16.868 INFO:teuthology.orchestra.run.smithi008.stdout: { 2023-08-01T19:56:16.868 INFO:teuthology.orchestra.run.smithi008.stdout: "event": "throttled", 2023-08-01T19:56:16.868 INFO:teuthology.orchestra.run.smithi008.stdout: "time": "2023-08-01T19:55:58.554713+0000", 2023-08-01T19:56:16.869 INFO:teuthology.orchestra.run.smithi008.stdout: "duration": 0 2023-08-01T19:56:16.869 INFO:teuthology.orchestra.run.smithi008.stdout: }, 2023-08-01T19:56:16.869 INFO:teuthology.orchestra.run.smithi008.stdout: { 2023-08-01T19:56:16.869 INFO:teuthology.orchestra.run.smithi008.stdout: "event": "header_read", 2023-08-01T19:56:16.869 INFO:teuthology.orchestra.run.smithi008.stdout: "time": "2023-08-01T19:55:58.554713+0000", 2023-08-01T19:56:16.869 INFO:teuthology.orchestra.run.smithi008.stdout: "duration": 4294967295.999999 2023-08-01T19:56:16.869 INFO:teuthology.orchestra.run.smithi008.stdout: }, 2023-08-01T19:56:16.869 INFO:teuthology.orchestra.run.smithi008.stdout: { 2023-08-01T19:56:16.870 INFO:teuthology.orchestra.run.smithi008.stdout: "event": "all_read", 2023-08-01T19:56:16.870 INFO:teuthology.orchestra.run.smithi008.stdout: "time": "2023-08-01T19:55:58.554717+0000", 2023-08-01T19:56:16.870 INFO:teuthology.orchestra.run.smithi008.stdout: "duration": 4.7389999999999999e-06 2023-08-01T19:56:16.870 INFO:teuthology.orchestra.run.smithi008.stdout: }, 2023-08-01T19:56:16.870 INFO:teuthology.orchestra.run.smithi008.stdout: { 2023-08-01T19:56:16.870 INFO:teuthology.orchestra.run.smithi008.stdout: "event": "dispatched", 2023-08-01T19:56:16.870 INFO:teuthology.orchestra.run.smithi008.stdout: "time": "2023-08-01T19:55:58.554725+0000", 2023-08-01T19:56:16.870 INFO:teuthology.orchestra.run.smithi008.stdout: "duration": 7.9820000000000008e-06 2023-08-01T19:56:16.871 INFO:teuthology.orchestra.run.smithi008.stdout: }, 2023-08-01T19:56:16.871 INFO:teuthology.orchestra.run.smithi008.stdout: { 2023-08-01T19:56:16.871 INFO:teuthology.orchestra.run.smithi008.stdout: "event": "queued_for_pg", 2023-08-01T19:56:16.871 INFO:teuthology.orchestra.run.smithi008.stdout: "time": "2023-08-01T19:55:58.554730+0000", 2023-08-01T19:56:16.871 INFO:teuthology.orchestra.run.smithi008.stdout: "duration": 4.318e-06 2023-08-01T19:56:16.871 INFO:teuthology.orchestra.run.smithi008.stdout: }, 2023-08-01T19:56:16.871 INFO:teuthology.orchestra.run.smithi008.stdout: { 2023-08-01T19:56:16.871 INFO:teuthology.orchestra.run.smithi008.stdout: "event": "reached_pg", 2023-08-01T19:56:16.872 INFO:teuthology.orchestra.run.smithi008.stdout: "time": "2023-08-01T19:55:58.554767+0000", 2023-08-01T19:56:16.872 INFO:teuthology.orchestra.run.smithi008.stdout: "duration": 3.7778000000000003e-05 2023-08-01T19:56:16.872 INFO:teuthology.orchestra.run.smithi008.stdout: }, 2023-08-01T19:56:16.872 INFO:teuthology.orchestra.run.smithi008.stdout: { 2023-08-01T19:56:16.872 INFO:teuthology.orchestra.run.smithi008.stdout: "event": "started", 2023-08-01T19:56:16.872 INFO:teuthology.orchestra.run.smithi008.stdout: "time": "2023-08-01T19:55:58.554874+0000", 2023-08-01T19:56:16.872 INFO:teuthology.orchestra.run.smithi008.stdout: "duration": 0.000106613 2023-08-01T19:56:16.873 INFO:teuthology.orchestra.run.smithi008.stdout: }, 2023-08-01T19:56:16.873 INFO:teuthology.orchestra.run.smithi008.stdout: { 2023-08-01T19:56:16.873 INFO:teuthology.orchestra.run.smithi008.stdout: "event": "waiting for subops from 1", 2023-08-01T19:56:16.873 INFO:teuthology.orchestra.run.smithi008.stdout: "time": "2023-08-01T19:55:58.554941+0000", 2023-08-01T19:56:16.873 INFO:teuthology.orchestra.run.smithi008.stdout: "duration": 6.6569000000000006e-05 2023-08-01T19:56:16.873 INFO:teuthology.orchestra.run.smithi008.stdout: }, 2023-08-01T19:56:16.873 INFO:teuthology.orchestra.run.smithi008.stdout: { 2023-08-01T19:56:16.873 INFO:teuthology.orchestra.run.smithi008.stdout: "event": "reached_pg", 2023-08-01T19:56:16.874 INFO:teuthology.orchestra.run.smithi008.stdout: "time": "2023-08-01T19:55:58.569436+0000", 2023-08-01T19:56:16.874 INFO:teuthology.orchestra.run.smithi008.stdout: "duration": 0.014495413 2023-08-01T19:56:16.874 INFO:teuthology.orchestra.run.smithi008.stdout: }, 2023-08-01T19:56:16.874 INFO:teuthology.orchestra.run.smithi008.stdout: { 2023-08-01T19:56:16.874 INFO:teuthology.orchestra.run.smithi008.stdout: "event": "waiting for peered", 2023-08-01T19:56:16.874 INFO:teuthology.orchestra.run.smithi008.stdout: "time": "2023-08-01T19:55:58.569441+0000", 2023-08-01T19:56:16.874 INFO:teuthology.orchestra.run.smithi008.stdout: "duration": 5.1109999999999999e-06 2023-08-01T19:56:16.874 INFO:teuthology.orchestra.run.smithi008.stdout: }, 2023-08-01T19:56:16.875 INFO:teuthology.orchestra.run.smithi008.stdout: { 2023-08-01T19:56:16.875 INFO:teuthology.orchestra.run.smithi008.stdout: "event": "reached_pg", 2023-08-01T19:56:16.875 INFO:teuthology.orchestra.run.smithi008.stdout: "time": "2023-08-01T19:55:59.620748+0000", 2023-08-01T19:56:16.875 INFO:teuthology.orchestra.run.smithi008.stdout: "duration": 1.0513071810000001 2023-08-01T19:56:16.875 INFO:teuthology.orchestra.run.smithi008.stdout: }, 2023-08-01T19:56:16.875 INFO:teuthology.orchestra.run.smithi008.stdout: { 2023-08-01T19:56:16.875 INFO:teuthology.orchestra.run.smithi008.stdout: "event": "done", 2023-08-01T19:56:16.875 INFO:teuthology.orchestra.run.smithi008.stdout: "time": "2023-08-01T19:55:59.620846+0000", 2023-08-01T19:56:16.876 INFO:teuthology.orchestra.run.smithi008.stdout: "duration": 9.7739999999999996e-05 2023-08-01T19:56:16.876 INFO:teuthology.orchestra.run.smithi008.stdout: } 2023-08-01T19:56:16.876 INFO:teuthology.orchestra.run.smithi008.stdout: ] 2023-08-01T19:56:16.876 INFO:teuthology.orchestra.run.smithi008.stdout: } 2023-08-01T19:56:16.876 INFO:teuthology.orchestra.run.smithi008.stdout: }, 2023-08-01T19:56:16.876 INFO:teuthology.orchestra.run.smithi008.stdout: { 2023-08-01T19:56:16.876 INFO:teuthology.orchestra.run.smithi008.stdout: "description": "osd_op(client.4668.0:197400 5.c 5:30dad7f9:::benchmark_data_smithi006_114134_object63739:head [delete] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e61)", 2023-08-01T19:56:16.876 INFO:teuthology.orchestra.run.smithi008.stdout: "initiated_at": "2023-08-01T19:55:58.556576+0000", 2023-08-01T19:56:16.877 INFO:teuthology.orchestra.run.smithi008.stdout: "age": 18.222091643999999, 2023-08-01T19:56:16.877 INFO:teuthology.orchestra.run.smithi008.stdout: "duration": 1.062559968, 2023-08-01T19:56:16.877 INFO:teuthology.orchestra.run.smithi008.stdout: "type_data": { 2023-08-01T19:56:16.877 INFO:teuthology.orchestra.run.smithi008.stdout: "flag_point": "reached pg", 2023-08-01T19:56:16.877 INFO:teuthology.orchestra.run.smithi008.stdout: "client_info": { 2023-08-01T19:56:16.877 INFO:teuthology.orchestra.run.smithi008.stdout: "client": "client.4668", 2023-08-01T19:56:16.877 INFO:teuthology.orchestra.run.smithi008.stdout: "client_addr": "172.21.15.6:0/1709472247", 2023-08-01T19:56:16.878 INFO:teuthology.orchestra.run.smithi008.stdout: "tid": 197400 2023-08-01T19:56:16.878 INFO:teuthology.orchestra.run.smithi008.stdout: }, 2023-08-01T19:56:16.878 INFO:teuthology.orchestra.run.smithi008.stdout: "events": [ 2023-08-01T19:56:16.878 INFO:teuthology.orchestra.run.smithi008.stdout: { 2023-08-01T19:56:16.878 INFO:teuthology.orchestra.run.smithi008.stdout: "event": "initiated", 2023-08-01T19:56:16.878 INFO:teuthology.orchestra.run.smithi008.stdout: "time": "2023-08-01T19:55:58.556576+0000", 2023-08-01T19:56:16.878 INFO:teuthology.orchestra.run.smithi008.stdout: "duration": 0 2023-08-01T19:56:16.878 INFO:teuthology.orchestra.run.smithi008.stdout: }, 2023-08-01T19:56:16.879 INFO:teuthology.orchestra.run.smithi008.stdout: { 2023-08-01T19:56:16.879 INFO:teuthology.orchestra.run.smithi008.stdout: "event": "throttled", 2023-08-01T19:56:16.879 INFO:teuthology.orchestra.run.smithi008.stdout: "time": "2023-08-01T19:55:58.556576+0000", 2023-08-01T19:56:16.879 INFO:teuthology.orchestra.run.smithi008.stdout: "duration": 0 2023-08-01T19:56:16.879 INFO:teuthology.orchestra.run.smithi008.stdout: }, 2023-08-01T19:56:16.879 INFO:teuthology.orchestra.run.smithi008.stdout: { 2023-08-01T19:56:16.879 INFO:teuthology.orchestra.run.smithi008.stdout: "event": "header_read", 2023-08-01T19:56:16.879 INFO:teuthology.orchestra.run.smithi008.stdout: "time": "2023-08-01T19:55:58.556575+0000", 2023-08-01T19:56:16.880 INFO:teuthology.orchestra.run.smithi008.stdout: "duration": 4294967295.999999 2023-08-01T19:56:16.880 INFO:teuthology.orchestra.run.smithi008.stdout: }, 2023-08-01T19:56:16.880 INFO:teuthology.orchestra.run.smithi008.stdout: { 2023-08-01T19:56:16.880 INFO:teuthology.orchestra.run.smithi008.stdout: "event": "all_read", 2023-08-01T19:56:16.880 INFO:teuthology.orchestra.run.smithi008.stdout: "time": "2023-08-01T19:55:58.556580+0000", 2023-08-01T19:56:16.880 INFO:teuthology.orchestra.run.smithi008.stdout: "duration": 4.2860000000000001e-06 2023-08-01T19:56:16.880 INFO:teuthology.orchestra.run.smithi008.stdout: }, 2023-08-01T19:56:16.880 INFO:teuthology.orchestra.run.smithi008.stdout: { 2023-08-01T19:56:16.881 INFO:teuthology.orchestra.run.smithi008.stdout: "event": "dispatched", 2023-08-01T19:56:16.881 INFO:teuthology.orchestra.run.smithi008.stdout: "time": "2023-08-01T19:55:58.556589+0000", 2023-08-01T19:56:16.881 INFO:teuthology.orchestra.run.smithi008.stdout: "duration": 9.6500000000000008e-06 2023-08-01T19:56:16.881 INFO:teuthology.orchestra.run.smithi008.stdout: }, 2023-08-01T19:56:16.881 INFO:teuthology.orchestra.run.smithi008.stdout: { 2023-08-01T19:56:16.881 INFO:teuthology.orchestra.run.smithi008.stdout: "event": "queued_for_pg", 2023-08-01T19:56:16.881 INFO:teuthology.orchestra.run.smithi008.stdout: "time": "2023-08-01T19:55:58.556596+0000", 2023-08-01T19:56:16.881 INFO:teuthology.orchestra.run.smithi008.stdout: "duration": 6.1430000000000003e-06 2023-08-01T19:56:16.882 INFO:teuthology.orchestra.run.smithi008.stdout: }, 2023-08-01T19:56:16.882 INFO:teuthology.orchestra.run.smithi008.stdout: { 2023-08-01T19:56:16.882 INFO:teuthology.orchestra.run.smithi008.stdout: "event": "reached_pg", 2023-08-01T19:56:16.882 INFO:teuthology.orchestra.run.smithi008.stdout: "time": "2023-08-01T19:55:58.556634+0000", 2023-08-01T19:56:16.882 INFO:teuthology.orchestra.run.smithi008.stdout: "duration": 3.8080000000000001e-05 2023-08-01T19:56:16.882 INFO:teuthology.orchestra.run.smithi008.stdout: }, 2023-08-01T19:56:16.882 INFO:teuthology.orchestra.run.smithi008.stdout: { 2023-08-01T19:56:16.883 INFO:teuthology.orchestra.run.smithi008.stdout: "event": "started", 2023-08-01T19:56:16.883 INFO:teuthology.orchestra.run.smithi008.stdout: "time": "2023-08-01T19:55:58.556754+0000", 2023-08-01T19:56:16.883 INFO:teuthology.orchestra.run.smithi008.stdout: "duration": 0.000120444 2023-08-01T19:56:16.883 INFO:teuthology.orchestra.run.smithi008.stdout: }, 2023-08-01T19:56:16.883 INFO:teuthology.orchestra.run.smithi008.stdout: { 2023-08-01T19:56:16.883 INFO:teuthology.orchestra.run.smithi008.stdout: "event": "waiting for subops from 1", 2023-08-01T19:56:16.883 INFO:teuthology.orchestra.run.smithi008.stdout: "time": "2023-08-01T19:55:58.556875+0000", 2023-08-01T19:56:16.883 INFO:teuthology.orchestra.run.smithi008.stdout: "duration": 0.00012100900000000001 2023-08-01T19:56:16.884 INFO:teuthology.orchestra.run.smithi008.stdout: }, 2023-08-01T19:56:16.884 INFO:teuthology.orchestra.run.smithi008.stdout: { 2023-08-01T19:56:16.884 INFO:teuthology.orchestra.run.smithi008.stdout: "event": "reached_pg", 2023-08-01T19:56:16.884 INFO:teuthology.orchestra.run.smithi008.stdout: "time": "2023-08-01T19:55:58.567406+0000", 2023-08-01T19:56:16.884 INFO:teuthology.orchestra.run.smithi008.stdout: "duration": 0.010531351 2023-08-01T19:56:16.884 INFO:teuthology.orchestra.run.smithi008.stdout: }, 2023-08-01T19:56:16.884 INFO:teuthology.orchestra.run.smithi008.stdout: { 2023-08-01T19:56:16.884 INFO:teuthology.orchestra.run.smithi008.stdout: "event": "waiting for peered", 2023-08-01T19:56:16.885 INFO:teuthology.orchestra.run.smithi008.stdout: "time": "2023-08-01T19:55:58.567414+0000", 2023-08-01T19:56:16.885 INFO:teuthology.orchestra.run.smithi008.stdout: "duration": 7.9189999999999999e-06 2023-08-01T19:56:16.885 INFO:teuthology.orchestra.run.smithi008.stdout: }, 2023-08-01T19:56:16.885 INFO:teuthology.orchestra.run.smithi008.stdout: { 2023-08-01T19:56:16.885 INFO:teuthology.orchestra.run.smithi008.stdout: "event": "reached_pg", 2023-08-01T19:56:16.885 INFO:teuthology.orchestra.run.smithi008.stdout: "time": "2023-08-01T19:55:59.619054+0000", 2023-08-01T19:56:16.885 INFO:teuthology.orchestra.run.smithi008.stdout: "duration": 1.0516396269999999 2023-08-01T19:56:16.885 INFO:teuthology.orchestra.run.smithi008.stdout: }, 2023-08-01T19:56:16.886 INFO:teuthology.orchestra.run.smithi008.stdout: { 2023-08-01T19:56:16.886 INFO:teuthology.orchestra.run.smithi008.stdout: "event": "done", 2023-08-01T19:56:16.886 INFO:teuthology.orchestra.run.smithi008.stdout: "time": "2023-08-01T19:55:59.619136+0000", 2023-08-01T19:56:16.886 INFO:teuthology.orchestra.run.smithi008.stdout: "duration": 8.2208999999999998e-05 2023-08-01T19:56:16.886 INFO:teuthology.orchestra.run.smithi008.stdout: } 2023-08-01T19:56:16.886 INFO:teuthology.orchestra.run.smithi008.stdout: ] 2023-08-01T19:56:16.886 INFO:teuthology.orchestra.run.smithi008.stdout: } 2023-08-01T19:56:16.886 INFO:teuthology.orchestra.run.smithi008.stdout: }, 2023-08-01T19:56:16.887 INFO:teuthology.orchestra.run.smithi008.stdout: { 2023-08-01T19:56:16.887 INFO:teuthology.orchestra.run.smithi008.stdout: "description": "osd_op(client.4668.0:197401 5.1 5:88b38567:::benchmark_data_smithi006_114134_object63740:head [delete] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e61)", 2023-08-01T19:56:16.887 INFO:teuthology.orchestra.run.smithi008.stdout: "initiated_at": "2023-08-01T19:55:58.556607+0000", 2023-08-01T19:56:16.887 INFO:teuthology.orchestra.run.smithi008.stdout: "age": 18.222061220000001, 2023-08-01T19:56:16.887 INFO:teuthology.orchestra.run.smithi008.stdout: "duration": 1.0643254870000001, 2023-08-01T19:56:16.887 INFO:teuthology.orchestra.run.smithi008.stdout: "type_data": { 2023-08-01T19:56:16.887 INFO:teuthology.orchestra.run.smithi008.stdout: "flag_point": "reached pg", 2023-08-01T19:56:16.888 INFO:teuthology.orchestra.run.smithi008.stdout: "client_info": { 2023-08-01T19:56:16.888 INFO:teuthology.orchestra.run.smithi008.stdout: "client": "client.4668", 2023-08-01T19:56:16.888 INFO:teuthology.orchestra.run.smithi008.stdout: "client_addr": "172.21.15.6:0/1709472247", 2023-08-01T19:56:16.888 INFO:teuthology.orchestra.run.smithi008.stdout: "tid": 197401 2023-08-01T19:56:16.888 INFO:teuthology.orchestra.run.smithi008.stdout: }, 2023-08-01T19:56:16.888 INFO:teuthology.orchestra.run.smithi008.stdout: "events": [ 2023-08-01T19:56:16.888 INFO:teuthology.orchestra.run.smithi008.stdout: { 2023-08-01T19:56:16.888 INFO:teuthology.orchestra.run.smithi008.stdout: "event": "initiated", 2023-08-01T19:56:16.889 INFO:teuthology.orchestra.run.smithi008.stdout: "time": "2023-08-01T19:55:58.556607+0000", 2023-08-01T19:56:16.889 INFO:teuthology.orchestra.run.smithi008.stdout: "duration": 0 2023-08-01T19:56:16.889 INFO:teuthology.orchestra.run.smithi008.stdout: }, 2023-08-01T19:56:16.889 INFO:teuthology.orchestra.run.smithi008.stdout: { 2023-08-01T19:56:16.889 INFO:teuthology.orchestra.run.smithi008.stdout: "event": "throttled", 2023-08-01T19:56:16.889 INFO:teuthology.orchestra.run.smithi008.stdout: "time": "2023-08-01T19:55:58.556607+0000", 2023-08-01T19:56:16.889 INFO:teuthology.orchestra.run.smithi008.stdout: "duration": 0 2023-08-01T19:56:16.889 INFO:teuthology.orchestra.run.smithi008.stdout: }, 2023-08-01T19:56:16.890 INFO:teuthology.orchestra.run.smithi008.stdout: { 2023-08-01T19:56:16.890 INFO:teuthology.orchestra.run.smithi008.stdout: "event": "header_read", 2023-08-01T19:56:16.890 INFO:teuthology.orchestra.run.smithi008.stdout: "time": "2023-08-01T19:55:58.556606+0000", 2023-08-01T19:56:16.890 INFO:teuthology.orchestra.run.smithi008.stdout: "duration": 4294967295.9999995 2023-08-01T19:56:16.890 INFO:teuthology.orchestra.run.smithi008.stdout: }, 2023-08-01T19:56:16.890 INFO:teuthology.orchestra.run.smithi008.stdout: { 2023-08-01T19:56:16.890 INFO:teuthology.orchestra.run.smithi008.stdout: "event": "all_read", 2023-08-01T19:56:16.890 INFO:teuthology.orchestra.run.smithi008.stdout: "time": "2023-08-01T19:55:58.556609+0000", 2023-08-01T19:56:16.891 INFO:teuthology.orchestra.run.smithi008.stdout: "duration": 3.1750000000000001e-06 2023-08-01T19:56:16.891 INFO:teuthology.orchestra.run.smithi008.stdout: }, 2023-08-01T19:56:16.891 INFO:teuthology.orchestra.run.smithi008.stdout: { 2023-08-01T19:56:16.891 INFO:teuthology.orchestra.run.smithi008.stdout: "event": "dispatched", 2023-08-01T19:56:16.891 INFO:teuthology.orchestra.run.smithi008.stdout: "time": "2023-08-01T19:55:58.556617+0000", 2023-08-01T19:56:16.891 INFO:teuthology.orchestra.run.smithi008.stdout: "duration": 7.2760000000000003e-06 2023-08-01T19:56:16.891 INFO:teuthology.orchestra.run.smithi008.stdout: }, 2023-08-01T19:56:16.891 INFO:teuthology.orchestra.run.smithi008.stdout: { 2023-08-01T19:56:16.892 INFO:teuthology.orchestra.run.smithi008.stdout: "event": "queued_for_pg", 2023-08-01T19:56:16.892 INFO:teuthology.orchestra.run.smithi008.stdout: "time": "2023-08-01T19:55:58.556621+0000", 2023-08-01T19:56:16.892 INFO:teuthology.orchestra.run.smithi008.stdout: "duration": 4.8219999999999997e-06 2023-08-01T19:56:16.892 INFO:teuthology.orchestra.run.smithi008.stdout: }, 2023-08-01T19:56:16.892 INFO:teuthology.orchestra.run.smithi008.stdout: { 2023-08-01T19:56:16.892 INFO:teuthology.orchestra.run.smithi008.stdout: "event": "reached_pg", 2023-08-01T19:56:16.892 INFO:teuthology.orchestra.run.smithi008.stdout: "time": "2023-08-01T19:55:58.556651+0000", 2023-08-01T19:56:16.892 INFO:teuthology.orchestra.run.smithi008.stdout: "duration": 2.9921999999999999e-05 2023-08-01T19:56:16.893 INFO:teuthology.orchestra.run.smithi008.stdout: }, 2023-08-01T19:56:16.893 INFO:teuthology.orchestra.run.smithi008.stdout: { 2023-08-01T19:56:16.893 INFO:teuthology.orchestra.run.smithi008.stdout: "event": "started", 2023-08-01T19:56:16.893 INFO:teuthology.orchestra.run.smithi008.stdout: "time": "2023-08-01T19:55:58.556755+0000", 2023-08-01T19:56:16.893 INFO:teuthology.orchestra.run.smithi008.stdout: "duration": 0.000103309 2023-08-01T19:56:16.893 INFO:teuthology.orchestra.run.smithi008.stdout: }, 2023-08-01T19:56:16.893 INFO:teuthology.orchestra.run.smithi008.stdout: { 2023-08-01T19:56:16.894 INFO:teuthology.orchestra.run.smithi008.stdout: "event": "waiting for subops from 1", 2023-08-01T19:56:16.894 INFO:teuthology.orchestra.run.smithi008.stdout: "time": "2023-08-01T19:55:58.556875+0000", 2023-08-01T19:56:16.894 INFO:teuthology.orchestra.run.smithi008.stdout: "duration": 0.000120424 2023-08-01T19:56:16.894 INFO:teuthology.orchestra.run.smithi008.stdout: }, 2023-08-01T19:56:16.894 INFO:teuthology.orchestra.run.smithi008.stdout: { 2023-08-01T19:56:16.894 INFO:teuthology.orchestra.run.smithi008.stdout: "event": "reached_pg", 2023-08-01T19:56:16.894 INFO:teuthology.orchestra.run.smithi008.stdout: "time": "2023-08-01T19:55:58.569459+0000", 2023-08-01T19:56:16.894 INFO:teuthology.orchestra.run.smithi008.stdout: "duration": 0.012583776 2023-08-01T19:56:16.895 INFO:teuthology.orchestra.run.smithi008.stdout: }, 2023-08-01T19:56:16.895 INFO:teuthology.orchestra.run.smithi008.stdout: { 2023-08-01T19:56:16.895 INFO:teuthology.orchestra.run.smithi008.stdout: "event": "waiting for peered", 2023-08-01T19:56:16.895 INFO:teuthology.orchestra.run.smithi008.stdout: "time": "2023-08-01T19:55:58.569462+0000", 2023-08-01T19:56:16.895 INFO:teuthology.orchestra.run.smithi008.stdout: "duration": 2.74e-06 2023-08-01T19:56:16.895 INFO:teuthology.orchestra.run.smithi008.stdout: }, 2023-08-01T19:56:16.895 INFO:teuthology.orchestra.run.smithi008.stdout: { 2023-08-01T19:56:16.895 INFO:teuthology.orchestra.run.smithi008.stdout: "event": "reached_pg", 2023-08-01T19:56:16.896 INFO:teuthology.orchestra.run.smithi008.stdout: "time": "2023-08-01T19:55:59.620880+0000", 2023-08-01T19:56:16.896 INFO:teuthology.orchestra.run.smithi008.stdout: "duration": 1.0514181279999999 2023-08-01T19:56:16.896 INFO:teuthology.orchestra.run.smithi008.stdout: }, 2023-08-01T19:56:16.896 INFO:teuthology.orchestra.run.smithi008.stdout: { 2023-08-01T19:56:16.896 INFO:teuthology.orchestra.run.smithi008.stdout: "event": "done", 2023-08-01T19:56:16.896 INFO:teuthology.orchestra.run.smithi008.stdout: "time": "2023-08-01T19:55:59.620932+0000", 2023-08-01T19:56:16.896 INFO:teuthology.orchestra.run.smithi008.stdout: "duration": 5.2404000000000002e-05 2023-08-01T19:56:16.896 INFO:teuthology.orchestra.run.smithi008.stdout: } 2023-08-01T19:56:16.897 INFO:teuthology.orchestra.run.smithi008.stdout: ] 2023-08-01T19:56:16.897 INFO:teuthology.orchestra.run.smithi008.stdout: } 2023-08-01T19:56:16.897 INFO:teuthology.orchestra.run.smithi008.stdout: }, 2023-08-01T19:56:16.897 INFO:teuthology.orchestra.run.smithi008.stdout: { 2023-08-01T19:56:16.897 INFO:teuthology.orchestra.run.smithi008.stdout: "description": "osd_op(client.4668.0:197402 5.c 5:3f057b78:::benchmark_data_smithi006_114134_object63741:head [delete] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e61)", 2023-08-01T19:56:16.897 INFO:teuthology.orchestra.run.smithi008.stdout: "initiated_at": "2023-08-01T19:55:58.556632+0000", 2023-08-01T19:56:16.897 INFO:teuthology.orchestra.run.smithi008.stdout: "age": 18.222035850000001, 2023-08-01T19:56:16.897 INFO:teuthology.orchestra.run.smithi008.stdout: "duration": 1.0625773970000001, 2023-08-01T19:56:16.898 INFO:teuthology.orchestra.run.smithi008.stdout: "type_data": { 2023-08-01T19:56:16.898 INFO:teuthology.orchestra.run.smithi008.stdout: "flag_point": "reached pg", 2023-08-01T19:56:16.898 INFO:teuthology.orchestra.run.smithi008.stdout: "client_info": { 2023-08-01T19:56:16.898 INFO:teuthology.orchestra.run.smithi008.stdout: "client": "client.4668", 2023-08-01T19:56:16.898 INFO:teuthology.orchestra.run.smithi008.stdout: "client_addr": "172.21.15.6:0/1709472247", 2023-08-01T19:56:16.898 INFO:teuthology.orchestra.run.smithi008.stdout: "tid": 197402 2023-08-01T19:56:16.898 INFO:teuthology.orchestra.run.smithi008.stdout: }, 2023-08-01T19:56:16.898 INFO:teuthology.orchestra.run.smithi008.stdout: "events": [ 2023-08-01T19:56:16.899 INFO:teuthology.orchestra.run.smithi008.stdout: { 2023-08-01T19:56:16.899 INFO:teuthology.orchestra.run.smithi008.stdout: "event": "initiated", 2023-08-01T19:56:16.899 INFO:teuthology.orchestra.run.smithi008.stdout: "time": "2023-08-01T19:55:58.556632+0000", 2023-08-01T19:56:16.899 INFO:teuthology.orchestra.run.smithi008.stdout: "duration": 0 2023-08-01T19:56:16.899 INFO:teuthology.orchestra.run.smithi008.stdout: }, 2023-08-01T19:56:16.899 INFO:teuthology.orchestra.run.smithi008.stdout: { 2023-08-01T19:56:16.899 INFO:teuthology.orchestra.run.smithi008.stdout: "event": "throttled", 2023-08-01T19:56:16.899 INFO:teuthology.orchestra.run.smithi008.stdout: "time": "2023-08-01T19:55:58.556632+0000", 2023-08-01T19:56:16.900 INFO:teuthology.orchestra.run.smithi008.stdout: "duration": 0 2023-08-01T19:56:16.900 INFO:teuthology.orchestra.run.smithi008.stdout: }, 2023-08-01T19:56:16.900 INFO:teuthology.orchestra.run.smithi008.stdout: { 2023-08-01T19:56:16.900 INFO:teuthology.orchestra.run.smithi008.stdout: "event": "header_read", 2023-08-01T19:56:16.900 INFO:teuthology.orchestra.run.smithi008.stdout: "time": "2023-08-01T19:55:58.556632+0000", 2023-08-01T19:56:16.900 INFO:teuthology.orchestra.run.smithi008.stdout: "duration": 4294967295.9999995 2023-08-01T19:56:16.900 INFO:teuthology.orchestra.run.smithi008.stdout: }, 2023-08-01T19:56:16.901 INFO:teuthology.orchestra.run.smithi008.stdout: { 2023-08-01T19:56:16.901 INFO:teuthology.orchestra.run.smithi008.stdout: "event": "all_read", 2023-08-01T19:56:16.901 INFO:teuthology.orchestra.run.smithi008.stdout: "time": "2023-08-01T19:55:58.556634+0000", 2023-08-01T19:56:16.901 INFO:teuthology.orchestra.run.smithi008.stdout: "duration": 2.8940000000000002e-06 2023-08-01T19:56:16.901 INFO:teuthology.orchestra.run.smithi008.stdout: }, 2023-08-01T19:56:16.901 INFO:teuthology.orchestra.run.smithi008.stdout: { 2023-08-01T19:56:16.901 INFO:teuthology.orchestra.run.smithi008.stdout: "event": "dispatched", 2023-08-01T19:56:16.901 INFO:teuthology.orchestra.run.smithi008.stdout: "time": "2023-08-01T19:55:58.556641+0000", 2023-08-01T19:56:16.902 INFO:teuthology.orchestra.run.smithi008.stdout: "duration": 6.8449999999999997e-06 2023-08-01T19:56:16.902 INFO:teuthology.orchestra.run.smithi008.stdout: }, 2023-08-01T19:56:16.902 INFO:teuthology.orchestra.run.smithi008.stdout: { 2023-08-01T19:56:16.902 INFO:teuthology.orchestra.run.smithi008.stdout: "event": "queued_for_pg", 2023-08-01T19:56:16.902 INFO:teuthology.orchestra.run.smithi008.stdout: "time": "2023-08-01T19:55:58.556646+0000", 2023-08-01T19:56:16.902 INFO:teuthology.orchestra.run.smithi008.stdout: "duration": 5.2070000000000003e-06 2023-08-01T19:56:16.902 INFO:teuthology.orchestra.run.smithi008.stdout: }, 2023-08-01T19:56:16.902 INFO:teuthology.orchestra.run.smithi008.stdout: { 2023-08-01T19:56:16.903 INFO:teuthology.orchestra.run.smithi008.stdout: "event": "reached_pg", 2023-08-01T19:56:16.903 INFO:teuthology.orchestra.run.smithi008.stdout: "time": "2023-08-01T19:55:58.558870+0000", 2023-08-01T19:56:16.903 INFO:teuthology.orchestra.run.smithi008.stdout: "duration": 0.0022237730000000001 2023-08-01T19:56:16.903 INFO:teuthology.orchestra.run.smithi008.stdout: }, 2023-08-01T19:56:16.903 INFO:teuthology.orchestra.run.smithi008.stdout: { 2023-08-01T19:56:16.903 INFO:teuthology.orchestra.run.smithi008.stdout: "event": "started", 2023-08-01T19:56:16.903 INFO:teuthology.orchestra.run.smithi008.stdout: "time": "2023-08-01T19:55:58.559013+0000", 2023-08-01T19:56:16.903 INFO:teuthology.orchestra.run.smithi008.stdout: "duration": 0.00014289899999999999 2023-08-01T19:56:16.904 INFO:teuthology.orchestra.run.smithi008.stdout: }, 2023-08-01T19:56:16.904 INFO:teuthology.orchestra.run.smithi008.stdout: { 2023-08-01T19:56:16.904 INFO:teuthology.orchestra.run.smithi008.stdout: "event": "waiting for subops from 1", 2023-08-01T19:56:16.904 INFO:teuthology.orchestra.run.smithi008.stdout: "time": "2023-08-01T19:55:58.559137+0000", 2023-08-01T19:56:16.904 INFO:teuthology.orchestra.run.smithi008.stdout: "duration": 0.00012428499999999999 2023-08-01T19:56:16.904 INFO:teuthology.orchestra.run.smithi008.stdout: }, 2023-08-01T19:56:16.904 INFO:teuthology.orchestra.run.smithi008.stdout: { 2023-08-01T19:56:16.905 INFO:teuthology.orchestra.run.smithi008.stdout: "event": "reached_pg", 2023-08-01T19:56:16.905 INFO:teuthology.orchestra.run.smithi008.stdout: "time": "2023-08-01T19:55:58.567438+0000", 2023-08-01T19:56:16.905 INFO:teuthology.orchestra.run.smithi008.stdout: "duration": 0.0083003190000000004 2023-08-01T19:56:16.905 INFO:teuthology.orchestra.run.smithi008.stdout: }, 2023-08-01T19:56:16.905 INFO:teuthology.orchestra.run.smithi008.stdout: { 2023-08-01T19:56:16.905 INFO:teuthology.orchestra.run.smithi008.stdout: "event": "waiting for peered", 2023-08-01T19:56:16.905 INFO:teuthology.orchestra.run.smithi008.stdout: "time": "2023-08-01T19:55:58.567443+0000", 2023-08-01T19:56:16.905 INFO:teuthology.orchestra.run.smithi008.stdout: "duration": 5.1739999999999999e-06 2023-08-01T19:56:16.906 INFO:teuthology.orchestra.run.smithi008.stdout: }, 2023-08-01T19:56:16.906 INFO:teuthology.orchestra.run.smithi008.stdout: { 2023-08-01T19:56:16.906 INFO:teuthology.orchestra.run.smithi008.stdout: "event": "reached_pg", 2023-08-01T19:56:16.906 INFO:teuthology.orchestra.run.smithi008.stdout: "time": "2023-08-01T19:55:59.619164+0000", 2023-08-01T19:56:16.906 INFO:teuthology.orchestra.run.smithi008.stdout: "duration": 1.0517206750000001 2023-08-01T19:56:16.906 INFO:teuthology.orchestra.run.smithi008.stdout: }, 2023-08-01T19:56:16.906 INFO:teuthology.orchestra.run.smithi008.stdout: { 2023-08-01T19:56:16.906 INFO:teuthology.orchestra.run.smithi008.stdout: "event": "done", 2023-08-01T19:56:16.907 INFO:teuthology.orchestra.run.smithi008.stdout: "time": "2023-08-01T19:55:59.619209+0000", 2023-08-01T19:56:16.907 INFO:teuthology.orchestra.run.smithi008.stdout: "duration": 4.5800000000000002e-05 2023-08-01T19:56:16.907 INFO:teuthology.orchestra.run.smithi008.stdout: } 2023-08-01T19:56:16.907 INFO:teuthology.orchestra.run.smithi008.stdout: ] 2023-08-01T19:56:16.907 INFO:teuthology.orchestra.run.smithi008.stdout: } 2023-08-01T19:56:16.907 INFO:teuthology.orchestra.run.smithi008.stdout: }, 2023-08-01T19:56:16.907 INFO:teuthology.orchestra.run.smithi008.stdout: { 2023-08-01T19:56:16.907 INFO:teuthology.orchestra.run.smithi008.stdout: "description": "osd_op(client.4668.0:197404 5.5 5:a3c9c1bd:::benchmark_data_smithi006_114134_object63743:head [delete] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e61)", 2023-08-01T19:56:16.908 INFO:teuthology.orchestra.run.smithi008.stdout: "initiated_at": "2023-08-01T19:55:58.556653+0000", 2023-08-01T19:56:16.908 INFO:teuthology.orchestra.run.smithi008.stdout: "age": 18.222014896000001, 2023-08-01T19:56:16.908 INFO:teuthology.orchestra.run.smithi008.stdout: "duration": 1.061865576, 2023-08-01T19:56:16.908 INFO:teuthology.orchestra.run.smithi008.stdout: "type_data": { 2023-08-01T19:56:16.908 INFO:teuthology.orchestra.run.smithi008.stdout: "flag_point": "reached pg", 2023-08-01T19:56:16.908 INFO:teuthology.orchestra.run.smithi008.stdout: "client_info": { 2023-08-01T19:56:16.908 INFO:teuthology.orchestra.run.smithi008.stdout: "client": "client.4668", 2023-08-01T19:56:16.909 INFO:teuthology.orchestra.run.smithi008.stdout: "client_addr": "172.21.15.6:0/1709472247", 2023-08-01T19:56:16.909 INFO:teuthology.orchestra.run.smithi008.stdout: "tid": 197404 2023-08-01T19:56:16.909 INFO:teuthology.orchestra.run.smithi008.stdout: }, 2023-08-01T19:56:16.909 INFO:teuthology.orchestra.run.smithi008.stdout: "events": [ 2023-08-01T19:56:16.909 INFO:teuthology.orchestra.run.smithi008.stdout: { 2023-08-01T19:56:16.909 INFO:teuthology.orchestra.run.smithi008.stdout: "event": "initiated", 2023-08-01T19:56:16.909 INFO:teuthology.orchestra.run.smithi008.stdout: "time": "2023-08-01T19:55:58.556653+0000", 2023-08-01T19:56:16.909 INFO:teuthology.orchestra.run.smithi008.stdout: "duration": 0 2023-08-01T19:56:16.910 INFO:teuthology.orchestra.run.smithi008.stdout: }, 2023-08-01T19:56:16.910 INFO:teuthology.orchestra.run.smithi008.stdout: { 2023-08-01T19:56:16.910 INFO:teuthology.orchestra.run.smithi008.stdout: "event": "throttled", 2023-08-01T19:56:16.910 INFO:teuthology.orchestra.run.smithi008.stdout: "time": "2023-08-01T19:55:58.556653+0000", 2023-08-01T19:56:16.910 INFO:teuthology.orchestra.run.smithi008.stdout: "duration": 0 2023-08-01T19:56:16.910 INFO:teuthology.orchestra.run.smithi008.stdout: }, 2023-08-01T19:56:16.910 INFO:teuthology.orchestra.run.smithi008.stdout: { 2023-08-01T19:56:16.910 INFO:teuthology.orchestra.run.smithi008.stdout: "event": "header_read", 2023-08-01T19:56:16.911 INFO:teuthology.orchestra.run.smithi008.stdout: "time": "2023-08-01T19:55:58.556653+0000", 2023-08-01T19:56:16.911 INFO:teuthology.orchestra.run.smithi008.stdout: "duration": 4294967295.9999995 2023-08-01T19:56:16.911 INFO:teuthology.orchestra.run.smithi008.stdout: }, 2023-08-01T19:56:16.911 INFO:teuthology.orchestra.run.smithi008.stdout: { 2023-08-01T19:56:16.911 INFO:teuthology.orchestra.run.smithi008.stdout: "event": "all_read", 2023-08-01T19:56:16.911 INFO:teuthology.orchestra.run.smithi008.stdout: "time": "2023-08-01T19:55:58.556655+0000", 2023-08-01T19:56:16.911 INFO:teuthology.orchestra.run.smithi008.stdout: "duration": 2.435e-06 2023-08-01T19:56:16.911 INFO:teuthology.orchestra.run.smithi008.stdout: }, 2023-08-01T19:56:16.912 INFO:teuthology.orchestra.run.smithi008.stdout: { 2023-08-01T19:56:16.912 INFO:teuthology.orchestra.run.smithi008.stdout: "event": "dispatched", 2023-08-01T19:56:16.912 INFO:teuthology.orchestra.run.smithi008.stdout: "time": "2023-08-01T19:55:58.556661+0000", 2023-08-01T19:56:16.912 INFO:teuthology.orchestra.run.smithi008.stdout: "duration": 6.0599999999999996e-06 2023-08-01T19:56:16.912 INFO:teuthology.orchestra.run.smithi008.stdout: }, 2023-08-01T19:56:16.912 INFO:teuthology.orchestra.run.smithi008.stdout: { 2023-08-01T19:56:16.912 INFO:teuthology.orchestra.run.smithi008.stdout: "event": "queued_for_pg", 2023-08-01T19:56:16.912 INFO:teuthology.orchestra.run.smithi008.stdout: "time": "2023-08-01T19:55:58.556666+0000", 2023-08-01T19:56:16.913 INFO:teuthology.orchestra.run.smithi008.stdout: "duration": 4.9620000000000001e-06 2023-08-01T19:56:16.913 INFO:teuthology.orchestra.run.smithi008.stdout: }, 2023-08-01T19:56:16.913 INFO:teuthology.orchestra.run.smithi008.stdout: { 2023-08-01T19:56:16.913 INFO:teuthology.orchestra.run.smithi008.stdout: "event": "reached_pg", 2023-08-01T19:56:16.913 INFO:teuthology.orchestra.run.smithi008.stdout: "time": "2023-08-01T19:55:58.556698+0000", 2023-08-01T19:56:16.913 INFO:teuthology.orchestra.run.smithi008.stdout: "duration": 3.2302999999999999e-05 2023-08-01T19:56:16.913 INFO:teuthology.orchestra.run.smithi008.stdout: }, 2023-08-01T19:56:16.913 INFO:teuthology.orchestra.run.smithi008.stdout: { 2023-08-01T19:56:16.914 INFO:teuthology.orchestra.run.smithi008.stdout: "event": "started", 2023-08-01T19:56:16.914 INFO:teuthology.orchestra.run.smithi008.stdout: "time": "2023-08-01T19:55:58.556773+0000", 2023-08-01T19:56:16.914 INFO:teuthology.orchestra.run.smithi008.stdout: "duration": 7.4431999999999995e-05 2023-08-01T19:56:16.914 INFO:teuthology.orchestra.run.smithi008.stdout: }, 2023-08-01T19:56:16.914 INFO:teuthology.orchestra.run.smithi008.stdout: { 2023-08-01T19:56:16.914 INFO:teuthology.orchestra.run.smithi008.stdout: "event": "waiting for subops from 1", 2023-08-01T19:56:16.914 INFO:teuthology.orchestra.run.smithi008.stdout: "time": "2023-08-01T19:55:58.556837+0000", 2023-08-01T19:56:16.914 INFO:teuthology.orchestra.run.smithi008.stdout: "duration": 6.4522000000000003e-05 2023-08-01T19:56:16.915 INFO:teuthology.orchestra.run.smithi008.stdout: }, 2023-08-01T19:56:16.915 INFO:teuthology.orchestra.run.smithi008.stdout: { 2023-08-01T19:56:16.915 INFO:teuthology.orchestra.run.smithi008.stdout: "event": "reached_pg", 2023-08-01T19:56:16.915 INFO:teuthology.orchestra.run.smithi008.stdout: "time": "2023-08-01T19:55:58.563930+0000", 2023-08-01T19:56:16.915 INFO:teuthology.orchestra.run.smithi008.stdout: "duration": 0.0070929030000000002 2023-08-01T19:56:16.915 INFO:teuthology.orchestra.run.smithi008.stdout: }, 2023-08-01T19:56:16.915 INFO:teuthology.orchestra.run.smithi008.stdout: { 2023-08-01T19:56:16.916 INFO:teuthology.orchestra.run.smithi008.stdout: "event": "waiting for peered", 2023-08-01T19:56:16.916 INFO:teuthology.orchestra.run.smithi008.stdout: "time": "2023-08-01T19:55:58.563939+0000", 2023-08-01T19:56:16.916 INFO:teuthology.orchestra.run.smithi008.stdout: "duration": 8.6079999999999996e-06 2023-08-01T19:56:16.916 INFO:teuthology.orchestra.run.smithi008.stdout: }, 2023-08-01T19:56:16.916 INFO:teuthology.orchestra.run.smithi008.stdout: { 2023-08-01T19:56:16.916 INFO:teuthology.orchestra.run.smithi008.stdout: "event": "reached_pg", 2023-08-01T19:56:16.916 INFO:teuthology.orchestra.run.smithi008.stdout: "time": "2023-08-01T19:55:59.618422+0000", 2023-08-01T19:56:16.916 INFO:teuthology.orchestra.run.smithi008.stdout: "duration": 1.054483295 2023-08-01T19:56:16.917 INFO:teuthology.orchestra.run.smithi008.stdout: }, 2023-08-01T19:56:16.917 INFO:teuthology.orchestra.run.smithi008.stdout: { 2023-08-01T19:56:16.917 INFO:teuthology.orchestra.run.smithi008.stdout: "event": "done", 2023-08-01T19:56:16.917 INFO:teuthology.orchestra.run.smithi008.stdout: "time": "2023-08-01T19:55:59.618519+0000", 2023-08-01T19:56:16.917 INFO:teuthology.orchestra.run.smithi008.stdout: "duration": 9.6471000000000005e-05 2023-08-01T19:56:16.917 INFO:teuthology.orchestra.run.smithi008.stdout: } 2023-08-01T19:56:16.917 INFO:teuthology.orchestra.run.smithi008.stdout: ] 2023-08-01T19:56:16.917 INFO:teuthology.orchestra.run.smithi008.stdout: } 2023-08-01T19:56:16.918 INFO:teuthology.orchestra.run.smithi008.stdout: }, 2023-08-01T19:56:16.918 INFO:teuthology.orchestra.run.smithi008.stdout: { 2023-08-01T19:56:16.918 INFO:teuthology.orchestra.run.smithi008.stdout: "description": "osd_op(client.4668.0:197407 5.1 5:85528fae:::benchmark_data_smithi006_114134_object63746:head [delete] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e61)", 2023-08-01T19:56:16.918 INFO:teuthology.orchestra.run.smithi008.stdout: "initiated_at": "2023-08-01T19:55:58.559216+0000", 2023-08-01T19:56:16.918 INFO:teuthology.orchestra.run.smithi008.stdout: "age": 18.219452248, 2023-08-01T19:56:16.918 INFO:teuthology.orchestra.run.smithi008.stdout: "duration": 1.061802277, 2023-08-01T19:56:16.918 INFO:teuthology.orchestra.run.smithi008.stdout: "type_data": { 2023-08-01T19:56:16.918 INFO:teuthology.orchestra.run.smithi008.stdout: "flag_point": "reached pg", 2023-08-01T19:56:16.919 INFO:teuthology.orchestra.run.smithi008.stdout: "client_info": { 2023-08-01T19:56:16.919 INFO:teuthology.orchestra.run.smithi008.stdout: "client": "client.4668", 2023-08-01T19:56:16.919 INFO:teuthology.orchestra.run.smithi008.stdout: "client_addr": "172.21.15.6:0/1709472247", 2023-08-01T19:56:16.919 INFO:teuthology.orchestra.run.smithi008.stdout: "tid": 197407 2023-08-01T19:56:16.919 INFO:teuthology.orchestra.run.smithi008.stdout: }, 2023-08-01T19:56:16.919 INFO:teuthology.orchestra.run.smithi008.stdout: "events": [ 2023-08-01T19:56:16.919 INFO:teuthology.orchestra.run.smithi008.stdout: { 2023-08-01T19:56:16.919 INFO:teuthology.orchestra.run.smithi008.stdout: "event": "initiated", 2023-08-01T19:56:16.920 INFO:teuthology.orchestra.run.smithi008.stdout: "time": "2023-08-01T19:55:58.559216+0000", 2023-08-01T19:56:16.920 INFO:teuthology.orchestra.run.smithi008.stdout: "duration": 0 2023-08-01T19:56:16.920 INFO:teuthology.orchestra.run.smithi008.stdout: }, 2023-08-01T19:56:16.920 INFO:teuthology.orchestra.run.smithi008.stdout: { 2023-08-01T19:56:16.920 INFO:teuthology.orchestra.run.smithi008.stdout: "event": "throttled", 2023-08-01T19:56:16.920 INFO:teuthology.orchestra.run.smithi008.stdout: "time": "2023-08-01T19:55:58.559216+0000", 2023-08-01T19:56:16.920 INFO:teuthology.orchestra.run.smithi008.stdout: "duration": 0 2023-08-01T19:56:16.921 INFO:teuthology.orchestra.run.smithi008.stdout: }, 2023-08-01T19:56:16.921 INFO:teuthology.orchestra.run.smithi008.stdout: { 2023-08-01T19:56:16.921 INFO:teuthology.orchestra.run.smithi008.stdout: "event": "header_read", 2023-08-01T19:56:16.921 INFO:teuthology.orchestra.run.smithi008.stdout: "time": "2023-08-01T19:55:58.559215+0000", 2023-08-01T19:56:16.921 INFO:teuthology.orchestra.run.smithi008.stdout: "duration": 4294967295.999999 2023-08-01T19:56:16.921 INFO:teuthology.orchestra.run.smithi008.stdout: }, 2023-08-01T19:56:16.921 INFO:teuthology.orchestra.run.smithi008.stdout: { 2023-08-01T19:56:16.921 INFO:teuthology.orchestra.run.smithi008.stdout: "event": "all_read", 2023-08-01T19:56:16.922 INFO:teuthology.orchestra.run.smithi008.stdout: "time": "2023-08-01T19:55:58.559220+0000", 2023-08-01T19:56:16.922 INFO:teuthology.orchestra.run.smithi008.stdout: "duration": 5.3879999999999999e-06 2023-08-01T19:56:16.922 INFO:teuthology.orchestra.run.smithi008.stdout: }, 2023-08-01T19:56:16.922 INFO:teuthology.orchestra.run.smithi008.stdout: { 2023-08-01T19:56:16.922 INFO:teuthology.orchestra.run.smithi008.stdout: "event": "dispatched", 2023-08-01T19:56:16.922 INFO:teuthology.orchestra.run.smithi008.stdout: "time": "2023-08-01T19:55:58.559230+0000", 2023-08-01T19:56:16.922 INFO:teuthology.orchestra.run.smithi008.stdout: "duration": 9.6590000000000002e-06 2023-08-01T19:56:16.922 INFO:teuthology.orchestra.run.smithi008.stdout: }, 2023-08-01T19:56:16.923 INFO:teuthology.orchestra.run.smithi008.stdout: { 2023-08-01T19:56:16.923 INFO:teuthology.orchestra.run.smithi008.stdout: "event": "queued_for_pg", 2023-08-01T19:56:16.923 INFO:teuthology.orchestra.run.smithi008.stdout: "time": "2023-08-01T19:55:58.559235+0000", 2023-08-01T19:56:16.923 INFO:teuthology.orchestra.run.smithi008.stdout: "duration": 5.575e-06 2023-08-01T19:56:16.923 INFO:teuthology.orchestra.run.smithi008.stdout: }, 2023-08-01T19:56:16.923 INFO:teuthology.orchestra.run.smithi008.stdout: { 2023-08-01T19:56:16.923 INFO:teuthology.orchestra.run.smithi008.stdout: "event": "reached_pg", 2023-08-01T19:56:16.923 INFO:teuthology.orchestra.run.smithi008.stdout: "time": "2023-08-01T19:55:58.559279+0000", 2023-08-01T19:56:16.924 INFO:teuthology.orchestra.run.smithi008.stdout: "duration": 4.3273999999999999e-05 2023-08-01T19:56:16.924 INFO:teuthology.orchestra.run.smithi008.stdout: }, 2023-08-01T19:56:16.924 INFO:teuthology.orchestra.run.smithi008.stdout: { 2023-08-01T19:56:16.924 INFO:teuthology.orchestra.run.smithi008.stdout: "event": "started", 2023-08-01T19:56:16.924 INFO:teuthology.orchestra.run.smithi008.stdout: "time": "2023-08-01T19:55:58.559403+0000", 2023-08-01T19:56:16.924 INFO:teuthology.orchestra.run.smithi008.stdout: "duration": 0.000124781 2023-08-01T19:56:16.924 INFO:teuthology.orchestra.run.smithi008.stdout: }, 2023-08-01T19:56:16.924 INFO:teuthology.orchestra.run.smithi008.stdout: { 2023-08-01T19:56:16.925 INFO:teuthology.orchestra.run.smithi008.stdout: "event": "waiting for subops from 1", 2023-08-01T19:56:16.925 INFO:teuthology.orchestra.run.smithi008.stdout: "time": "2023-08-01T19:55:58.559561+0000", 2023-08-01T19:56:16.925 INFO:teuthology.orchestra.run.smithi008.stdout: "duration": 0.000157773 2023-08-01T19:56:16.925 INFO:teuthology.orchestra.run.smithi008.stdout: }, 2023-08-01T19:56:16.925 INFO:teuthology.orchestra.run.smithi008.stdout: { 2023-08-01T19:56:16.925 INFO:teuthology.orchestra.run.smithi008.stdout: "event": "reached_pg", 2023-08-01T19:56:16.925 INFO:teuthology.orchestra.run.smithi008.stdout: "time": "2023-08-01T19:55:58.569498+0000", 2023-08-01T19:56:16.925 INFO:teuthology.orchestra.run.smithi008.stdout: "duration": 0.0099367069999999995 2023-08-01T19:56:16.926 INFO:teuthology.orchestra.run.smithi008.stdout: }, 2023-08-01T19:56:16.926 INFO:teuthology.orchestra.run.smithi008.stdout: { 2023-08-01T19:56:16.926 INFO:teuthology.orchestra.run.smithi008.stdout: "event": "waiting for peered", 2023-08-01T19:56:16.926 INFO:teuthology.orchestra.run.smithi008.stdout: "time": "2023-08-01T19:55:58.569756+0000", 2023-08-01T19:56:16.926 INFO:teuthology.orchestra.run.smithi008.stdout: "duration": 0.00025830800000000001 2023-08-01T19:56:16.926 INFO:teuthology.orchestra.run.smithi008.stdout: }, 2023-08-01T19:56:16.926 INFO:teuthology.orchestra.run.smithi008.stdout: { 2023-08-01T19:56:16.927 INFO:teuthology.orchestra.run.smithi008.stdout: "event": "reached_pg", 2023-08-01T19:56:16.927 INFO:teuthology.orchestra.run.smithi008.stdout: "time": "2023-08-01T19:55:59.620962+0000", 2023-08-01T19:56:16.927 INFO:teuthology.orchestra.run.smithi008.stdout: "duration": 1.0512062129999999 2023-08-01T19:56:16.927 INFO:teuthology.orchestra.run.smithi008.stdout: }, 2023-08-01T19:56:16.927 INFO:teuthology.orchestra.run.smithi008.stdout: { 2023-08-01T19:56:16.927 INFO:teuthology.orchestra.run.smithi008.stdout: "event": "done", 2023-08-01T19:56:16.927 INFO:teuthology.orchestra.run.smithi008.stdout: "time": "2023-08-01T19:55:59.621018+0000", 2023-08-01T19:56:16.927 INFO:teuthology.orchestra.run.smithi008.stdout: "duration": 5.5498999999999998e-05 2023-08-01T19:56:16.928 INFO:teuthology.orchestra.run.smithi008.stdout: } 2023-08-01T19:56:16.928 INFO:teuthology.orchestra.run.smithi008.stdout: ] 2023-08-01T19:56:16.928 INFO:teuthology.orchestra.run.smithi008.stdout: } 2023-08-01T19:56:16.928 INFO:teuthology.orchestra.run.smithi008.stdout: }, 2023-08-01T19:56:16.928 INFO:teuthology.orchestra.run.smithi008.stdout: { 2023-08-01T19:56:16.928 INFO:teuthology.orchestra.run.smithi008.stdout: "description": "osd_op(client.4668.0:197396 5.2 5:43f8487b:::benchmark_data_smithi006_114134_object63735:head [delete] snapc 0=[] RETRY=1 ondisk+retry+write+known_if_redirected+supports_pool_eio e62)", 2023-08-01T19:56:16.928 INFO:teuthology.orchestra.run.smithi008.stdout: "initiated_at": "2023-08-01T19:55:58.564585+0000", 2023-08-01T19:56:16.929 INFO:teuthology.orchestra.run.smithi008.stdout: "age": 18.214083274, 2023-08-01T19:56:16.929 INFO:teuthology.orchestra.run.smithi008.stdout: "duration": 1.0535085049999999, 2023-08-01T19:56:16.929 INFO:teuthology.orchestra.run.smithi008.stdout: "type_data": { 2023-08-01T19:56:16.929 INFO:teuthology.orchestra.run.smithi008.stdout: "flag_point": "reached pg", 2023-08-01T19:56:16.929 INFO:teuthology.orchestra.run.smithi008.stdout: "client_info": { 2023-08-01T19:56:16.929 INFO:teuthology.orchestra.run.smithi008.stdout: "client": "client.4668", 2023-08-01T19:56:16.929 INFO:teuthology.orchestra.run.smithi008.stdout: "client_addr": "172.21.15.6:0/1709472247", 2023-08-01T19:56:16.929 INFO:teuthology.orchestra.run.smithi008.stdout: "tid": 197396 2023-08-01T19:56:16.930 INFO:teuthology.orchestra.run.smithi008.stdout: }, 2023-08-01T19:56:16.930 INFO:teuthology.orchestra.run.smithi008.stdout: "events": [ 2023-08-01T19:56:16.930 INFO:teuthology.orchestra.run.smithi008.stdout: { 2023-08-01T19:56:16.930 INFO:teuthology.orchestra.run.smithi008.stdout: "event": "initiated", 2023-08-01T19:56:16.930 INFO:teuthology.orchestra.run.smithi008.stdout: "time": "2023-08-01T19:55:58.564585+0000", 2023-08-01T19:56:16.930 INFO:teuthology.orchestra.run.smithi008.stdout: "duration": 0 2023-08-01T19:56:16.930 INFO:teuthology.orchestra.run.smithi008.stdout: }, 2023-08-01T19:56:16.930 INFO:teuthology.orchestra.run.smithi008.stdout: { 2023-08-01T19:56:16.931 INFO:teuthology.orchestra.run.smithi008.stdout: "event": "throttled", 2023-08-01T19:56:16.931 INFO:teuthology.orchestra.run.smithi008.stdout: "time": "2023-08-01T19:55:58.564585+0000", 2023-08-01T19:56:16.931 INFO:teuthology.orchestra.run.smithi008.stdout: "duration": 0 2023-08-01T19:56:16.931 INFO:teuthology.orchestra.run.smithi008.stdout: }, 2023-08-01T19:56:16.931 INFO:teuthology.orchestra.run.smithi008.stdout: { 2023-08-01T19:56:16.931 INFO:teuthology.orchestra.run.smithi008.stdout: "event": "header_read", 2023-08-01T19:56:16.931 INFO:teuthology.orchestra.run.smithi008.stdout: "time": "2023-08-01T19:55:58.564583+0000", 2023-08-01T19:56:16.932 INFO:teuthology.orchestra.run.smithi008.stdout: "duration": 4294967295.9999981 2023-08-01T19:56:16.932 INFO:teuthology.orchestra.run.smithi008.stdout: }, 2023-08-01T19:56:16.932 INFO:teuthology.orchestra.run.smithi008.stdout: { 2023-08-01T19:56:16.932 INFO:teuthology.orchestra.run.smithi008.stdout: "event": "all_read", 2023-08-01T19:56:16.932 INFO:teuthology.orchestra.run.smithi008.stdout: "time": "2023-08-01T19:55:58.564591+0000", 2023-08-01T19:56:16.932 INFO:teuthology.orchestra.run.smithi008.stdout: "duration": 8.2169999999999994e-06 2023-08-01T19:56:16.932 INFO:teuthology.orchestra.run.smithi008.stdout: }, 2023-08-01T19:56:16.932 INFO:teuthology.orchestra.run.smithi008.stdout: { 2023-08-01T19:56:16.933 INFO:teuthology.orchestra.run.smithi008.stdout: "event": "dispatched", 2023-08-01T19:56:16.933 INFO:teuthology.orchestra.run.smithi008.stdout: "time": "2023-08-01T19:55:58.564603+0000", 2023-08-01T19:56:16.933 INFO:teuthology.orchestra.run.smithi008.stdout: "duration": 1.186e-05 2023-08-01T19:56:16.933 INFO:teuthology.orchestra.run.smithi008.stdout: }, 2023-08-01T19:56:16.933 INFO:teuthology.orchestra.run.smithi008.stdout: { 2023-08-01T19:56:16.933 INFO:teuthology.orchestra.run.smithi008.stdout: "event": "queued_for_pg", 2023-08-01T19:56:16.933 INFO:teuthology.orchestra.run.smithi008.stdout: "time": "2023-08-01T19:55:58.564609+0000", 2023-08-01T19:56:16.933 INFO:teuthology.orchestra.run.smithi008.stdout: "duration": 6.4130000000000003e-06 2023-08-01T19:56:16.934 INFO:teuthology.orchestra.run.smithi008.stdout: }, 2023-08-01T19:56:16.934 INFO:teuthology.orchestra.run.smithi008.stdout: { 2023-08-01T19:56:16.934 INFO:teuthology.orchestra.run.smithi008.stdout: "event": "reached_pg", 2023-08-01T19:56:16.934 INFO:teuthology.orchestra.run.smithi008.stdout: "time": "2023-08-01T19:55:58.573439+0000", 2023-08-01T19:56:16.934 INFO:teuthology.orchestra.run.smithi008.stdout: "duration": 0.0088303310000000003 2023-08-01T19:56:16.934 INFO:teuthology.orchestra.run.smithi008.stdout: }, 2023-08-01T19:56:16.934 INFO:teuthology.orchestra.run.smithi008.stdout: { 2023-08-01T19:56:16.934 INFO:teuthology.orchestra.run.smithi008.stdout: "event": "waiting for peered", 2023-08-01T19:56:16.935 INFO:teuthology.orchestra.run.smithi008.stdout: "time": "2023-08-01T19:55:58.573448+0000", 2023-08-01T19:56:16.935 INFO:teuthology.orchestra.run.smithi008.stdout: "duration": 8.2910000000000007e-06 2023-08-01T19:56:16.935 INFO:teuthology.orchestra.run.smithi008.stdout: }, 2023-08-01T19:56:16.935 INFO:teuthology.orchestra.run.smithi008.stdout: { 2023-08-01T19:56:16.935 INFO:teuthology.orchestra.run.smithi008.stdout: "event": "reached_pg", 2023-08-01T19:56:16.935 INFO:teuthology.orchestra.run.smithi008.stdout: "time": "2023-08-01T19:55:59.617892+0000", 2023-08-01T19:56:16.935 INFO:teuthology.orchestra.run.smithi008.stdout: "duration": 1.0444446380000001 2023-08-01T19:56:16.936 INFO:teuthology.orchestra.run.smithi008.stdout: }, 2023-08-01T19:56:16.936 INFO:teuthology.orchestra.run.smithi008.stdout: { 2023-08-01T19:56:16.936 INFO:teuthology.orchestra.run.smithi008.stdout: "event": "done", 2023-08-01T19:56:16.936 INFO:teuthology.orchestra.run.smithi008.stdout: "time": "2023-08-01T19:55:59.618093+0000", 2023-08-01T19:56:16.936 INFO:teuthology.orchestra.run.smithi008.stdout: "duration": 0.00020066300000000001 2023-08-01T19:56:16.936 INFO:teuthology.orchestra.run.smithi008.stdout: } 2023-08-01T19:56:16.936 INFO:teuthology.orchestra.run.smithi008.stdout: ] 2023-08-01T19:56:16.936 INFO:teuthology.orchestra.run.smithi008.stdout: } 2023-08-01T19:56:16.937 INFO:teuthology.orchestra.run.smithi008.stdout: }, 2023-08-01T19:56:16.937 INFO:teuthology.orchestra.run.smithi008.stdout: { 2023-08-01T19:56:16.937 INFO:teuthology.orchestra.run.smithi008.stdout: "description": "osd_op(client.4668.0:197411 5.7 5:ebefbc20:::benchmark_data_smithi006_114134_object63750:head [delete] snapc 0=[] RETRY=1 ondisk+retry+write+known_if_redirected+supports_pool_eio e62)", 2023-08-01T19:56:16.937 INFO:teuthology.orchestra.run.smithi008.stdout: "initiated_at": "2023-08-01T19:55:58.564619+0000", 2023-08-01T19:56:16.937 INFO:teuthology.orchestra.run.smithi008.stdout: "age": 18.214048599000002, 2023-08-01T19:56:16.937 INFO:teuthology.orchestra.run.smithi008.stdout: "duration": 1.0686062569999999, 2023-08-01T19:56:16.937 INFO:teuthology.orchestra.run.smithi008.stdout: "type_data": { 2023-08-01T19:56:16.937 INFO:teuthology.orchestra.run.smithi008.stdout: "flag_point": "commit sent; apply or cleanup", 2023-08-01T19:56:16.938 INFO:teuthology.orchestra.run.smithi008.stdout: "client_info": { 2023-08-01T19:56:16.938 INFO:teuthology.orchestra.run.smithi008.stdout: "client": "client.4668", 2023-08-01T19:56:16.938 INFO:teuthology.orchestra.run.smithi008.stdout: "client_addr": "172.21.15.6:0/1709472247", 2023-08-01T19:56:16.938 INFO:teuthology.orchestra.run.smithi008.stdout: "tid": 197411 2023-08-01T19:56:16.938 INFO:teuthology.orchestra.run.smithi008.stdout: }, 2023-08-01T19:56:16.938 INFO:teuthology.orchestra.run.smithi008.stdout: "events": [ 2023-08-01T19:56:16.938 INFO:teuthology.orchestra.run.smithi008.stdout: { 2023-08-01T19:56:16.939 INFO:teuthology.orchestra.run.smithi008.stdout: "event": "initiated", 2023-08-01T19:56:16.939 INFO:teuthology.orchestra.run.smithi008.stdout: "time": "2023-08-01T19:55:58.564619+0000", 2023-08-01T19:56:16.939 INFO:teuthology.orchestra.run.smithi008.stdout: "duration": 0 2023-08-01T19:56:16.939 INFO:teuthology.orchestra.run.smithi008.stdout: }, 2023-08-01T19:56:16.939 INFO:teuthology.orchestra.run.smithi008.stdout: { 2023-08-01T19:56:16.939 INFO:teuthology.orchestra.run.smithi008.stdout: "event": "throttled", 2023-08-01T19:56:16.939 INFO:teuthology.orchestra.run.smithi008.stdout: "time": "2023-08-01T19:55:58.564619+0000", 2023-08-01T19:56:16.939 INFO:teuthology.orchestra.run.smithi008.stdout: "duration": 0 2023-08-01T19:56:16.940 INFO:teuthology.orchestra.run.smithi008.stdout: }, 2023-08-01T19:56:16.940 INFO:teuthology.orchestra.run.smithi008.stdout: { 2023-08-01T19:56:16.940 INFO:teuthology.orchestra.run.smithi008.stdout: "event": "header_read", 2023-08-01T19:56:16.940 INFO:teuthology.orchestra.run.smithi008.stdout: "time": "2023-08-01T19:55:58.564619+0000", 2023-08-01T19:56:16.940 INFO:teuthology.orchestra.run.smithi008.stdout: "duration": 4294967295.9999995 2023-08-01T19:56:16.940 INFO:teuthology.orchestra.run.smithi008.stdout: }, 2023-08-01T19:56:16.940 INFO:teuthology.orchestra.run.smithi008.stdout: { 2023-08-01T19:56:16.940 INFO:teuthology.orchestra.run.smithi008.stdout: "event": "all_read", 2023-08-01T19:56:16.941 INFO:teuthology.orchestra.run.smithi008.stdout: "time": "2023-08-01T19:55:58.564621+0000", 2023-08-01T19:56:16.941 INFO:teuthology.orchestra.run.smithi008.stdout: "duration": 2.6139999999999999e-06 2023-08-01T19:56:16.941 INFO:teuthology.orchestra.run.smithi008.stdout: }, 2023-08-01T19:56:16.941 INFO:teuthology.orchestra.run.smithi008.stdout: { 2023-08-01T19:56:16.941 INFO:teuthology.orchestra.run.smithi008.stdout: "event": "dispatched", 2023-08-01T19:56:16.941 INFO:teuthology.orchestra.run.smithi008.stdout: "time": "2023-08-01T19:55:58.564627+0000", 2023-08-01T19:56:16.941 INFO:teuthology.orchestra.run.smithi008.stdout: "duration": 5.1150000000000002e-06 2023-08-01T19:56:16.942 INFO:teuthology.orchestra.run.smithi008.stdout: }, 2023-08-01T19:56:16.942 INFO:teuthology.orchestra.run.smithi008.stdout: { 2023-08-01T19:56:16.942 INFO:teuthology.orchestra.run.smithi008.stdout: "event": "queued_for_pg", 2023-08-01T19:56:16.942 INFO:teuthology.orchestra.run.smithi008.stdout: "time": "2023-08-01T19:55:58.564631+0000", 2023-08-01T19:56:16.942 INFO:teuthology.orchestra.run.smithi008.stdout: "duration": 4.702e-06 2023-08-01T19:56:16.942 INFO:teuthology.orchestra.run.smithi008.stdout: }, 2023-08-01T19:56:16.942 INFO:teuthology.orchestra.run.smithi008.stdout: { 2023-08-01T19:56:16.942 INFO:teuthology.orchestra.run.smithi008.stdout: "event": "reached_pg", 2023-08-01T19:56:16.943 INFO:teuthology.orchestra.run.smithi008.stdout: "time": "2023-08-01T19:55:58.565520+0000", 2023-08-01T19:56:16.943 INFO:teuthology.orchestra.run.smithi008.stdout: "duration": 0.00088893399999999997 2023-08-01T19:56:16.943 INFO:teuthology.orchestra.run.smithi008.stdout: }, 2023-08-01T19:56:16.943 INFO:teuthology.orchestra.run.smithi008.stdout: { 2023-08-01T19:56:16.943 INFO:teuthology.orchestra.run.smithi008.stdout: "event": "waiting for peered", 2023-08-01T19:56:16.943 INFO:teuthology.orchestra.run.smithi008.stdout: "time": "2023-08-01T19:55:58.565528+0000", 2023-08-01T19:56:16.943 INFO:teuthology.orchestra.run.smithi008.stdout: "duration": 7.5410000000000003e-06 2023-08-01T19:56:16.944 INFO:teuthology.orchestra.run.smithi008.stdout: }, 2023-08-01T19:56:16.944 INFO:teuthology.orchestra.run.smithi008.stdout: { 2023-08-01T19:56:16.944 INFO:teuthology.orchestra.run.smithi008.stdout: "event": "reached_pg", 2023-08-01T19:56:16.944 INFO:teuthology.orchestra.run.smithi008.stdout: "time": "2023-08-01T19:55:59.622374+0000", 2023-08-01T19:56:16.944 INFO:teuthology.orchestra.run.smithi008.stdout: "duration": 1.05684588 2023-08-01T19:56:16.944 INFO:teuthology.orchestra.run.smithi008.stdout: }, 2023-08-01T19:56:16.944 INFO:teuthology.orchestra.run.smithi008.stdout: { 2023-08-01T19:56:16.945 INFO:teuthology.orchestra.run.smithi008.stdout: "event": "started", 2023-08-01T19:56:16.945 INFO:teuthology.orchestra.run.smithi008.stdout: "time": "2023-08-01T19:55:59.624156+0000", 2023-08-01T19:56:16.945 INFO:teuthology.orchestra.run.smithi008.stdout: "duration": 0.0017826129999999999 2023-08-01T19:56:16.945 INFO:teuthology.orchestra.run.smithi008.stdout: }, 2023-08-01T19:56:16.945 INFO:teuthology.orchestra.run.smithi008.stdout: { 2023-08-01T19:56:16.945 INFO:teuthology.orchestra.run.smithi008.stdout: "event": "op_commit", 2023-08-01T19:56:16.945 INFO:teuthology.orchestra.run.smithi008.stdout: "time": "2023-08-01T19:55:59.633131+0000", 2023-08-01T19:56:16.945 INFO:teuthology.orchestra.run.smithi008.stdout: "duration": 0.0089745740000000008 2023-08-01T19:56:16.946 INFO:teuthology.orchestra.run.smithi008.stdout: }, 2023-08-01T19:56:16.946 INFO:teuthology.orchestra.run.smithi008.stdout: { 2023-08-01T19:56:16.946 INFO:teuthology.orchestra.run.smithi008.stdout: "event": "commit_sent", 2023-08-01T19:56:16.946 INFO:teuthology.orchestra.run.smithi008.stdout: "time": "2023-08-01T19:55:59.633173+0000", 2023-08-01T19:56:16.946 INFO:teuthology.orchestra.run.smithi008.stdout: "duration": 4.2645000000000003e-05 2023-08-01T19:56:16.946 INFO:teuthology.orchestra.run.smithi008.stdout: }, 2023-08-01T19:56:16.946 INFO:teuthology.orchestra.run.smithi008.stdout: { 2023-08-01T19:56:16.947 INFO:teuthology.orchestra.run.smithi008.stdout: "event": "done", 2023-08-01T19:56:16.947 INFO:teuthology.orchestra.run.smithi008.stdout: "time": "2023-08-01T19:55:59.633225+0000", 2023-08-01T19:56:16.947 INFO:teuthology.orchestra.run.smithi008.stdout: "duration": 5.2003999999999999e-05 2023-08-01T19:56:16.947 INFO:teuthology.orchestra.run.smithi008.stdout: } 2023-08-01T19:56:16.947 INFO:teuthology.orchestra.run.smithi008.stdout: ] 2023-08-01T19:56:16.947 INFO:teuthology.orchestra.run.smithi008.stdout: } 2023-08-01T19:56:16.947 INFO:teuthology.orchestra.run.smithi008.stdout: }, 2023-08-01T19:56:16.947 INFO:teuthology.orchestra.run.smithi008.stdout: { 2023-08-01T19:56:16.948 INFO:teuthology.orchestra.run.smithi008.stdout: "description": "osd_op(client.4668.0:197413 5.5 5:a6ff9d8a:::benchmark_data_smithi006_114134_object63752:head [delete] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e62)", 2023-08-01T19:56:16.948 INFO:teuthology.orchestra.run.smithi008.stdout: "initiated_at": "2023-08-01T19:55:58.573778+0000", 2023-08-01T19:56:16.948 INFO:teuthology.orchestra.run.smithi008.stdout: "age": 18.204889633000001, 2023-08-01T19:56:16.948 INFO:teuthology.orchestra.run.smithi008.stdout: "duration": 1.054781371, 2023-08-01T19:56:16.948 INFO:teuthology.orchestra.run.smithi008.stdout: "type_data": { 2023-08-01T19:56:16.948 INFO:teuthology.orchestra.run.smithi008.stdout: "flag_point": "commit sent; apply or cleanup", 2023-08-01T19:56:16.948 INFO:teuthology.orchestra.run.smithi008.stdout: "client_info": { 2023-08-01T19:56:16.949 INFO:teuthology.orchestra.run.smithi008.stdout: "client": "client.4668", 2023-08-01T19:56:16.949 INFO:teuthology.orchestra.run.smithi008.stdout: "client_addr": "172.21.15.6:0/1709472247", 2023-08-01T19:56:16.949 INFO:teuthology.orchestra.run.smithi008.stdout: "tid": 197413 2023-08-01T19:56:16.949 INFO:teuthology.orchestra.run.smithi008.stdout: }, 2023-08-01T19:56:16.949 INFO:teuthology.orchestra.run.smithi008.stdout: "events": [ 2023-08-01T19:56:16.949 INFO:teuthology.orchestra.run.smithi008.stdout: { 2023-08-01T19:56:16.949 INFO:teuthology.orchestra.run.smithi008.stdout: "event": "initiated", 2023-08-01T19:56:16.949 INFO:teuthology.orchestra.run.smithi008.stdout: "time": "2023-08-01T19:55:58.573778+0000", 2023-08-01T19:56:16.950 INFO:teuthology.orchestra.run.smithi008.stdout: "duration": 0 2023-08-01T19:56:16.950 INFO:teuthology.orchestra.run.smithi008.stdout: }, 2023-08-01T19:56:16.950 INFO:teuthology.orchestra.run.smithi008.stdout: { 2023-08-01T19:56:16.950 INFO:teuthology.orchestra.run.smithi008.stdout: "event": "throttled", 2023-08-01T19:56:16.950 INFO:teuthology.orchestra.run.smithi008.stdout: "time": "2023-08-01T19:55:58.573778+0000", 2023-08-01T19:56:16.950 INFO:teuthology.orchestra.run.smithi008.stdout: "duration": 0 2023-08-01T19:56:16.950 INFO:teuthology.orchestra.run.smithi008.stdout: }, 2023-08-01T19:56:16.950 INFO:teuthology.orchestra.run.smithi008.stdout: { 2023-08-01T19:56:16.951 INFO:teuthology.orchestra.run.smithi008.stdout: "event": "header_read", 2023-08-01T19:56:16.951 INFO:teuthology.orchestra.run.smithi008.stdout: "time": "2023-08-01T19:55:58.573776+0000", 2023-08-01T19:56:16.951 INFO:teuthology.orchestra.run.smithi008.stdout: "duration": 4294967295.9999981 2023-08-01T19:56:16.951 INFO:teuthology.orchestra.run.smithi008.stdout: }, 2023-08-01T19:56:16.951 INFO:teuthology.orchestra.run.smithi008.stdout: { 2023-08-01T19:56:16.951 INFO:teuthology.orchestra.run.smithi008.stdout: "event": "all_read", 2023-08-01T19:56:16.951 INFO:teuthology.orchestra.run.smithi008.stdout: "time": "2023-08-01T19:55:58.573784+0000", 2023-08-01T19:56:16.951 INFO:teuthology.orchestra.run.smithi008.stdout: "duration": 8.2490000000000001e-06 2023-08-01T19:56:16.952 INFO:teuthology.orchestra.run.smithi008.stdout: }, 2023-08-01T19:56:16.952 INFO:teuthology.orchestra.run.smithi008.stdout: { 2023-08-01T19:56:16.952 INFO:teuthology.orchestra.run.smithi008.stdout: "event": "dispatched", 2023-08-01T19:56:16.952 INFO:teuthology.orchestra.run.smithi008.stdout: "time": "2023-08-01T19:55:58.574230+0000", 2023-08-01T19:56:16.952 INFO:teuthology.orchestra.run.smithi008.stdout: "duration": 0.00044558400000000001 2023-08-01T19:56:16.952 INFO:teuthology.orchestra.run.smithi008.stdout: }, 2023-08-01T19:56:16.952 INFO:teuthology.orchestra.run.smithi008.stdout: { 2023-08-01T19:56:16.953 INFO:teuthology.orchestra.run.smithi008.stdout: "event": "queued_for_pg", 2023-08-01T19:56:16.953 INFO:teuthology.orchestra.run.smithi008.stdout: "time": "2023-08-01T19:55:58.574240+0000", 2023-08-01T19:56:16.953 INFO:teuthology.orchestra.run.smithi008.stdout: "duration": 9.7699999999999996e-06 2023-08-01T19:56:16.953 INFO:teuthology.orchestra.run.smithi008.stdout: }, 2023-08-01T19:56:16.953 INFO:teuthology.orchestra.run.smithi008.stdout: { 2023-08-01T19:56:16.953 INFO:teuthology.orchestra.run.smithi008.stdout: "event": "reached_pg", 2023-08-01T19:56:16.953 INFO:teuthology.orchestra.run.smithi008.stdout: "time": "2023-08-01T19:55:58.574292+0000", 2023-08-01T19:56:16.953 INFO:teuthology.orchestra.run.smithi008.stdout: "duration": 5.2101000000000001e-05 2023-08-01T19:56:16.954 INFO:teuthology.orchestra.run.smithi008.stdout: }, 2023-08-01T19:56:16.954 INFO:teuthology.orchestra.run.smithi008.stdout: { 2023-08-01T19:56:16.954 INFO:teuthology.orchestra.run.smithi008.stdout: "event": "waiting for peered", 2023-08-01T19:56:16.954 INFO:teuthology.orchestra.run.smithi008.stdout: "time": "2023-08-01T19:55:58.574299+0000", 2023-08-01T19:56:16.954 INFO:teuthology.orchestra.run.smithi008.stdout: "duration": 7.3420000000000002e-06 2023-08-01T19:56:16.954 INFO:teuthology.orchestra.run.smithi008.stdout: }, 2023-08-01T19:56:16.954 INFO:teuthology.orchestra.run.smithi008.stdout: { 2023-08-01T19:56:16.954 INFO:teuthology.orchestra.run.smithi008.stdout: "event": "reached_pg", 2023-08-01T19:56:16.955 INFO:teuthology.orchestra.run.smithi008.stdout: "time": "2023-08-01T19:55:59.618545+0000", 2023-08-01T19:56:16.955 INFO:teuthology.orchestra.run.smithi008.stdout: "duration": 1.044245922 2023-08-01T19:56:16.955 INFO:teuthology.orchestra.run.smithi008.stdout: }, 2023-08-01T19:56:16.955 INFO:teuthology.orchestra.run.smithi008.stdout: { 2023-08-01T19:56:16.955 INFO:teuthology.orchestra.run.smithi008.stdout: "event": "started", 2023-08-01T19:56:16.955 INFO:teuthology.orchestra.run.smithi008.stdout: "time": "2023-08-01T19:55:59.618855+0000", 2023-08-01T19:56:16.955 INFO:teuthology.orchestra.run.smithi008.stdout: "duration": 0.00030964099999999999 2023-08-01T19:56:16.955 INFO:teuthology.orchestra.run.smithi008.stdout: }, 2023-08-01T19:56:16.956 INFO:teuthology.orchestra.run.smithi008.stdout: { 2023-08-01T19:56:16.956 INFO:teuthology.orchestra.run.smithi008.stdout: "event": "op_commit", 2023-08-01T19:56:16.956 INFO:teuthology.orchestra.run.smithi008.stdout: "time": "2023-08-01T19:55:59.628438+0000", 2023-08-01T19:56:16.956 INFO:teuthology.orchestra.run.smithi008.stdout: "duration": 0.0095832939999999991 2023-08-01T19:56:16.956 INFO:teuthology.orchestra.run.smithi008.stdout: }, 2023-08-01T19:56:16.956 INFO:teuthology.orchestra.run.smithi008.stdout: { 2023-08-01T19:56:16.956 INFO:teuthology.orchestra.run.smithi008.stdout: "event": "commit_sent", 2023-08-01T19:56:16.957 INFO:teuthology.orchestra.run.smithi008.stdout: "time": "2023-08-01T19:55:59.628479+0000", 2023-08-01T19:56:16.957 INFO:teuthology.orchestra.run.smithi008.stdout: "duration": 4.1350000000000002e-05 2023-08-01T19:56:16.957 INFO:teuthology.orchestra.run.smithi008.stdout: }, 2023-08-01T19:56:16.957 INFO:teuthology.orchestra.run.smithi008.stdout: { 2023-08-01T19:56:16.957 INFO:teuthology.orchestra.run.smithi008.stdout: "event": "done", 2023-08-01T19:56:16.957 INFO:teuthology.orchestra.run.smithi008.stdout: "time": "2023-08-01T19:55:59.628560+0000", 2023-08-01T19:56:16.957 INFO:teuthology.orchestra.run.smithi008.stdout: "duration": 8.0080999999999994e-05 2023-08-01T19:56:16.957 INFO:teuthology.orchestra.run.smithi008.stdout: } 2023-08-01T19:56:16.958 INFO:teuthology.orchestra.run.smithi008.stdout: ] 2023-08-01T19:56:16.958 INFO:teuthology.orchestra.run.smithi008.stdout: } 2023-08-01T19:56:16.958 INFO:teuthology.orchestra.run.smithi008.stdout: }, 2023-08-01T19:56:16.958 INFO:teuthology.orchestra.run.smithi008.stdout: { 2023-08-01T19:56:16.958 INFO:teuthology.orchestra.run.smithi008.stdout: "description": "osd_op(client.4668.0:197415 5.c 5:3e539c01:::benchmark_data_smithi006_114134_object63754:head [delete] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e62)", 2023-08-01T19:56:16.958 INFO:teuthology.orchestra.run.smithi008.stdout: "initiated_at": "2023-08-01T19:55:58.577434+0000", 2023-08-01T19:56:16.958 INFO:teuthology.orchestra.run.smithi008.stdout: "age": 18.201233876, 2023-08-01T19:56:16.958 INFO:teuthology.orchestra.run.smithi008.stdout: "duration": 1.0520807059999999, 2023-08-01T19:56:16.959 INFO:teuthology.orchestra.run.smithi008.stdout: "type_data": { 2023-08-01T19:56:16.959 INFO:teuthology.orchestra.run.smithi008.stdout: "flag_point": "commit sent; apply or cleanup", 2023-08-01T19:56:16.959 INFO:teuthology.orchestra.run.smithi008.stdout: "client_info": { 2023-08-01T19:56:16.959 INFO:teuthology.orchestra.run.smithi008.stdout: "client": "client.4668", 2023-08-01T19:56:16.959 INFO:teuthology.orchestra.run.smithi008.stdout: "client_addr": "172.21.15.6:0/1709472247", 2023-08-01T19:56:16.959 INFO:teuthology.orchestra.run.smithi008.stdout: "tid": 197415 2023-08-01T19:56:16.959 INFO:teuthology.orchestra.run.smithi008.stdout: }, 2023-08-01T19:56:16.960 INFO:teuthology.orchestra.run.smithi008.stdout: "events": [ 2023-08-01T19:56:16.960 INFO:teuthology.orchestra.run.smithi008.stdout: { 2023-08-01T19:56:16.960 INFO:teuthology.orchestra.run.smithi008.stdout: "event": "initiated", 2023-08-01T19:56:16.960 INFO:teuthology.orchestra.run.smithi008.stdout: "time": "2023-08-01T19:55:58.577434+0000", 2023-08-01T19:56:16.960 INFO:teuthology.orchestra.run.smithi008.stdout: "duration": 0 2023-08-01T19:56:16.960 INFO:teuthology.orchestra.run.smithi008.stdout: }, 2023-08-01T19:56:16.960 INFO:teuthology.orchestra.run.smithi008.stdout: { 2023-08-01T19:56:16.960 INFO:teuthology.orchestra.run.smithi008.stdout: "event": "throttled", 2023-08-01T19:56:16.961 INFO:teuthology.orchestra.run.smithi008.stdout: "time": "2023-08-01T19:55:58.577434+0000", 2023-08-01T19:56:16.961 INFO:teuthology.orchestra.run.smithi008.stdout: "duration": 0 2023-08-01T19:56:16.961 INFO:teuthology.orchestra.run.smithi008.stdout: }, 2023-08-01T19:56:16.961 INFO:teuthology.orchestra.run.smithi008.stdout: { 2023-08-01T19:56:16.961 INFO:teuthology.orchestra.run.smithi008.stdout: "event": "header_read", 2023-08-01T19:56:16.961 INFO:teuthology.orchestra.run.smithi008.stdout: "time": "2023-08-01T19:55:58.577432+0000", 2023-08-01T19:56:16.961 INFO:teuthology.orchestra.run.smithi008.stdout: "duration": 4294967295.9999986 2023-08-01T19:56:16.961 INFO:teuthology.orchestra.run.smithi008.stdout: }, 2023-08-01T19:56:16.962 INFO:teuthology.orchestra.run.smithi008.stdout: { 2023-08-01T19:56:16.962 INFO:teuthology.orchestra.run.smithi008.stdout: "event": "all_read", 2023-08-01T19:56:16.962 INFO:teuthology.orchestra.run.smithi008.stdout: "time": "2023-08-01T19:55:58.577440+0000", 2023-08-01T19:56:16.962 INFO:teuthology.orchestra.run.smithi008.stdout: "duration": 7.5480000000000004e-06 2023-08-01T19:56:16.962 INFO:teuthology.orchestra.run.smithi008.stdout: }, 2023-08-01T19:56:16.962 INFO:teuthology.orchestra.run.smithi008.stdout: { 2023-08-01T19:56:16.962 INFO:teuthology.orchestra.run.smithi008.stdout: "event": "dispatched", 2023-08-01T19:56:16.962 INFO:teuthology.orchestra.run.smithi008.stdout: "time": "2023-08-01T19:55:58.577454+0000", 2023-08-01T19:56:16.963 INFO:teuthology.orchestra.run.smithi008.stdout: "duration": 1.4216000000000001e-05 2023-08-01T19:56:16.963 INFO:teuthology.orchestra.run.smithi008.stdout: }, 2023-08-01T19:56:16.963 INFO:teuthology.orchestra.run.smithi008.stdout: { 2023-08-01T19:56:16.963 INFO:teuthology.orchestra.run.smithi008.stdout: "event": "queued_for_pg", 2023-08-01T19:56:16.963 INFO:teuthology.orchestra.run.smithi008.stdout: "time": "2023-08-01T19:55:58.577463+0000", 2023-08-01T19:56:16.963 INFO:teuthology.orchestra.run.smithi008.stdout: "duration": 8.2900000000000002e-06 2023-08-01T19:56:16.963 INFO:teuthology.orchestra.run.smithi008.stdout: }, 2023-08-01T19:56:16.963 INFO:teuthology.orchestra.run.smithi008.stdout: { 2023-08-01T19:56:16.964 INFO:teuthology.orchestra.run.smithi008.stdout: "event": "reached_pg", 2023-08-01T19:56:16.964 INFO:teuthology.orchestra.run.smithi008.stdout: "time": "2023-08-01T19:55:58.577498+0000", 2023-08-01T19:56:16.964 INFO:teuthology.orchestra.run.smithi008.stdout: "duration": 3.5302000000000002e-05 2023-08-01T19:56:16.964 INFO:teuthology.orchestra.run.smithi008.stdout: }, 2023-08-01T19:56:16.964 INFO:teuthology.orchestra.run.smithi008.stdout: { 2023-08-01T19:56:16.964 INFO:teuthology.orchestra.run.smithi008.stdout: "event": "waiting for peered", 2023-08-01T19:56:16.964 INFO:teuthology.orchestra.run.smithi008.stdout: "time": "2023-08-01T19:55:58.577503+0000", 2023-08-01T19:56:16.964 INFO:teuthology.orchestra.run.smithi008.stdout: "duration": 4.8409999999999999e-06 2023-08-01T19:56:16.965 INFO:teuthology.orchestra.run.smithi008.stdout: }, 2023-08-01T19:56:16.965 INFO:teuthology.orchestra.run.smithi008.stdout: { 2023-08-01T19:56:16.965 INFO:teuthology.orchestra.run.smithi008.stdout: "event": "reached_pg", 2023-08-01T19:56:16.965 INFO:teuthology.orchestra.run.smithi008.stdout: "time": "2023-08-01T19:55:59.619229+0000", 2023-08-01T19:56:16.965 INFO:teuthology.orchestra.run.smithi008.stdout: "duration": 1.041726119 2023-08-01T19:56:16.965 INFO:teuthology.orchestra.run.smithi008.stdout: }, 2023-08-01T19:56:16.965 INFO:teuthology.orchestra.run.smithi008.stdout: { 2023-08-01T19:56:16.966 INFO:teuthology.orchestra.run.smithi008.stdout: "event": "started", 2023-08-01T19:56:16.966 INFO:teuthology.orchestra.run.smithi008.stdout: "time": "2023-08-01T19:55:59.619326+0000", 2023-08-01T19:56:16.966 INFO:teuthology.orchestra.run.smithi008.stdout: "duration": 9.7044000000000001e-05 2023-08-01T19:56:16.966 INFO:teuthology.orchestra.run.smithi008.stdout: }, 2023-08-01T19:56:16.966 INFO:teuthology.orchestra.run.smithi008.stdout: { 2023-08-01T19:56:16.966 INFO:teuthology.orchestra.run.smithi008.stdout: "event": "op_commit", 2023-08-01T19:56:16.966 INFO:teuthology.orchestra.run.smithi008.stdout: "time": "2023-08-01T19:55:59.629399+0000", 2023-08-01T19:56:16.966 INFO:teuthology.orchestra.run.smithi008.stdout: "duration": 0.010073014 2023-08-01T19:56:16.967 INFO:teuthology.orchestra.run.smithi008.stdout: }, 2023-08-01T19:56:16.967 INFO:teuthology.orchestra.run.smithi008.stdout: { 2023-08-01T19:56:16.967 INFO:teuthology.orchestra.run.smithi008.stdout: "event": "commit_sent", 2023-08-01T19:56:16.967 INFO:teuthology.orchestra.run.smithi008.stdout: "time": "2023-08-01T19:55:59.629443+0000", 2023-08-01T19:56:16.967 INFO:teuthology.orchestra.run.smithi008.stdout: "duration": 4.3739999999999998e-05 2023-08-01T19:56:16.967 INFO:teuthology.orchestra.run.smithi008.stdout: }, 2023-08-01T19:56:16.967 INFO:teuthology.orchestra.run.smithi008.stdout: { 2023-08-01T19:56:16.967 INFO:teuthology.orchestra.run.smithi008.stdout: "event": "done", 2023-08-01T19:56:16.968 INFO:teuthology.orchestra.run.smithi008.stdout: "time": "2023-08-01T19:55:59.629515+0000", 2023-08-01T19:56:16.968 INFO:teuthology.orchestra.run.smithi008.stdout: "duration": 7.2089999999999996e-05 2023-08-01T19:56:16.968 INFO:teuthology.orchestra.run.smithi008.stdout: } 2023-08-01T19:56:16.968 INFO:teuthology.orchestra.run.smithi008.stdout: ] 2023-08-01T19:56:16.968 INFO:teuthology.orchestra.run.smithi008.stdout: } 2023-08-01T19:56:16.968 INFO:teuthology.orchestra.run.smithi008.stdout: }, 2023-08-01T19:56:16.968 INFO:teuthology.orchestra.run.smithi008.stdout: { 2023-08-01T19:56:16.968 INFO:teuthology.orchestra.run.smithi008.stdout: "description": "osd_op(client.4668.0:197417 5.7 5:eb36cb7d:::benchmark_data_smithi006_114134_object63756:head [delete] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e62)", 2023-08-01T19:56:16.969 INFO:teuthology.orchestra.run.smithi008.stdout: "initiated_at": "2023-08-01T19:55:58.578162+0000", 2023-08-01T19:56:16.969 INFO:teuthology.orchestra.run.smithi008.stdout: "age": 18.200505579000001, 2023-08-01T19:56:16.969 INFO:teuthology.orchestra.run.smithi008.stdout: "duration": 1.0582469299999999, 2023-08-01T19:56:16.969 INFO:teuthology.orchestra.run.smithi008.stdout: "type_data": { 2023-08-01T19:56:16.969 INFO:teuthology.orchestra.run.smithi008.stdout: "flag_point": "commit sent; apply or cleanup", 2023-08-01T19:56:16.969 INFO:teuthology.orchestra.run.smithi008.stdout: "client_info": { 2023-08-01T19:56:16.969 INFO:teuthology.orchestra.run.smithi008.stdout: "client": "client.4668", 2023-08-01T19:56:16.969 INFO:teuthology.orchestra.run.smithi008.stdout: "client_addr": "172.21.15.6:0/1709472247", 2023-08-01T19:56:16.970 INFO:teuthology.orchestra.run.smithi008.stdout: "tid": 197417 2023-08-01T19:56:16.970 INFO:teuthology.orchestra.run.smithi008.stdout: }, 2023-08-01T19:56:16.970 INFO:teuthology.orchestra.run.smithi008.stdout: "events": [ 2023-08-01T19:56:16.970 INFO:teuthology.orchestra.run.smithi008.stdout: { 2023-08-01T19:56:16.970 INFO:teuthology.orchestra.run.smithi008.stdout: "event": "initiated", 2023-08-01T19:56:16.970 INFO:teuthology.orchestra.run.smithi008.stdout: "time": "2023-08-01T19:55:58.578162+0000", 2023-08-01T19:56:16.970 INFO:teuthology.orchestra.run.smithi008.stdout: "duration": 0 2023-08-01T19:56:16.970 INFO:teuthology.orchestra.run.smithi008.stdout: }, 2023-08-01T19:56:16.971 INFO:teuthology.orchestra.run.smithi008.stdout: { 2023-08-01T19:56:16.971 INFO:teuthology.orchestra.run.smithi008.stdout: "event": "throttled", 2023-08-01T19:56:16.971 INFO:teuthology.orchestra.run.smithi008.stdout: "time": "2023-08-01T19:55:58.578162+0000", 2023-08-01T19:56:16.971 INFO:teuthology.orchestra.run.smithi008.stdout: "duration": 0 2023-08-01T19:56:16.971 INFO:teuthology.orchestra.run.smithi008.stdout: }, 2023-08-01T19:56:16.971 INFO:teuthology.orchestra.run.smithi008.stdout: { 2023-08-01T19:56:16.971 INFO:teuthology.orchestra.run.smithi008.stdout: "event": "header_read", 2023-08-01T19:56:16.971 INFO:teuthology.orchestra.run.smithi008.stdout: "time": "2023-08-01T19:55:58.578161+0000", 2023-08-01T19:56:16.972 INFO:teuthology.orchestra.run.smithi008.stdout: "duration": 4294967295.999999 2023-08-01T19:56:16.972 INFO:teuthology.orchestra.run.smithi008.stdout: }, 2023-08-01T19:56:16.972 INFO:teuthology.orchestra.run.smithi008.stdout: { 2023-08-01T19:56:16.972 INFO:teuthology.orchestra.run.smithi008.stdout: "event": "all_read", 2023-08-01T19:56:16.972 INFO:teuthology.orchestra.run.smithi008.stdout: "time": "2023-08-01T19:55:58.578166+0000", 2023-08-01T19:56:16.972 INFO:teuthology.orchestra.run.smithi008.stdout: "duration": 4.6589999999999998e-06 2023-08-01T19:56:16.972 INFO:teuthology.orchestra.run.smithi008.stdout: }, 2023-08-01T19:56:16.973 INFO:teuthology.orchestra.run.smithi008.stdout: { 2023-08-01T19:56:16.973 INFO:teuthology.orchestra.run.smithi008.stdout: "event": "dispatched", 2023-08-01T19:56:16.973 INFO:teuthology.orchestra.run.smithi008.stdout: "time": "2023-08-01T19:55:58.578177+0000", 2023-08-01T19:56:16.973 INFO:teuthology.orchestra.run.smithi008.stdout: "duration": 1.0512e-05 2023-08-01T19:56:16.973 INFO:teuthology.orchestra.run.smithi008.stdout: }, 2023-08-01T19:56:16.973 INFO:teuthology.orchestra.run.smithi008.stdout: { 2023-08-01T19:56:16.973 INFO:teuthology.orchestra.run.smithi008.stdout: "event": "queued_for_pg", 2023-08-01T19:56:16.973 INFO:teuthology.orchestra.run.smithi008.stdout: "time": "2023-08-01T19:55:58.578182+0000", 2023-08-01T19:56:16.974 INFO:teuthology.orchestra.run.smithi008.stdout: "duration": 5.6540000000000004e-06 2023-08-01T19:56:16.974 INFO:teuthology.orchestra.run.smithi008.stdout: }, 2023-08-01T19:56:16.974 INFO:teuthology.orchestra.run.smithi008.stdout: { 2023-08-01T19:56:16.974 INFO:teuthology.orchestra.run.smithi008.stdout: "event": "reached_pg", 2023-08-01T19:56:16.974 INFO:teuthology.orchestra.run.smithi008.stdout: "time": "2023-08-01T19:55:58.578221+0000", 2023-08-01T19:56:16.974 INFO:teuthology.orchestra.run.smithi008.stdout: "duration": 3.8764999999999999e-05 2023-08-01T19:56:16.974 INFO:teuthology.orchestra.run.smithi008.stdout: }, 2023-08-01T19:56:16.974 INFO:teuthology.orchestra.run.smithi008.stdout: { 2023-08-01T19:56:16.975 INFO:teuthology.orchestra.run.smithi008.stdout: "event": "waiting for peered", 2023-08-01T19:56:16.975 INFO:teuthology.orchestra.run.smithi008.stdout: "time": "2023-08-01T19:55:58.578226+0000", 2023-08-01T19:56:16.975 INFO:teuthology.orchestra.run.smithi008.stdout: "duration": 4.6319999999999999e-06 2023-08-01T19:56:16.975 INFO:teuthology.orchestra.run.smithi008.stdout: }, 2023-08-01T19:56:16.975 INFO:teuthology.orchestra.run.smithi008.stdout: { 2023-08-01T19:56:16.975 INFO:teuthology.orchestra.run.smithi008.stdout: "event": "reached_pg", 2023-08-01T19:56:16.975 INFO:teuthology.orchestra.run.smithi008.stdout: "time": "2023-08-01T19:55:59.628027+0000", 2023-08-01T19:56:16.975 INFO:teuthology.orchestra.run.smithi008.stdout: "duration": 1.049801261 2023-08-01T19:56:16.976 INFO:teuthology.orchestra.run.smithi008.stdout: }, 2023-08-01T19:56:16.976 INFO:teuthology.orchestra.run.smithi008.stdout: { 2023-08-01T19:56:16.976 INFO:teuthology.orchestra.run.smithi008.stdout: "event": "started", 2023-08-01T19:56:16.976 INFO:teuthology.orchestra.run.smithi008.stdout: "time": "2023-08-01T19:55:59.628156+0000", 2023-08-01T19:56:16.976 INFO:teuthology.orchestra.run.smithi008.stdout: "duration": 0.00012906899999999999 2023-08-01T19:56:16.976 INFO:teuthology.orchestra.run.smithi008.stdout: }, 2023-08-01T19:56:16.976 INFO:teuthology.orchestra.run.smithi008.stdout: { 2023-08-01T19:56:16.976 INFO:teuthology.orchestra.run.smithi008.stdout: "event": "op_commit", 2023-08-01T19:56:16.977 INFO:teuthology.orchestra.run.smithi008.stdout: "time": "2023-08-01T19:55:59.636292+0000", 2023-08-01T19:56:16.977 INFO:teuthology.orchestra.run.smithi008.stdout: "duration": 0.0081362859999999995 2023-08-01T19:56:16.977 INFO:teuthology.orchestra.run.smithi008.stdout: }, 2023-08-01T19:56:16.977 INFO:teuthology.orchestra.run.smithi008.stdout: { 2023-08-01T19:56:16.977 INFO:teuthology.orchestra.run.smithi008.stdout: "event": "commit_sent", 2023-08-01T19:56:16.977 INFO:teuthology.orchestra.run.smithi008.stdout: "time": "2023-08-01T19:55:59.636343+0000", 2023-08-01T19:56:16.977 INFO:teuthology.orchestra.run.smithi008.stdout: "duration": 5.0603000000000003e-05 2023-08-01T19:56:16.978 INFO:teuthology.orchestra.run.smithi008.stdout: }, 2023-08-01T19:56:16.978 INFO:teuthology.orchestra.run.smithi008.stdout: { 2023-08-01T19:56:16.978 INFO:teuthology.orchestra.run.smithi008.stdout: "event": "done", 2023-08-01T19:56:16.978 INFO:teuthology.orchestra.run.smithi008.stdout: "time": "2023-08-01T19:55:59.636409+0000", 2023-08-01T19:56:16.978 INFO:teuthology.orchestra.run.smithi008.stdout: "duration": 6.6353999999999995e-05 2023-08-01T19:56:16.978 INFO:teuthology.orchestra.run.smithi008.stdout: } 2023-08-01T19:56:16.978 INFO:teuthology.orchestra.run.smithi008.stdout: ] 2023-08-01T19:56:16.978 INFO:teuthology.orchestra.run.smithi008.stdout: } 2023-08-01T19:56:16.979 INFO:teuthology.orchestra.run.smithi008.stdout: }, 2023-08-01T19:56:16.979 INFO:teuthology.orchestra.run.smithi008.stdout: { 2023-08-01T19:56:16.979 INFO:teuthology.orchestra.run.smithi008.stdout: "description": "osd_op(client.4668.0:197418 5.2 5:4ba84ab7:::benchmark_data_smithi006_114134_object63757:head [delete] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e62)", 2023-08-01T19:56:16.979 INFO:teuthology.orchestra.run.smithi008.stdout: "initiated_at": "2023-08-01T19:55:58.580297+0000", 2023-08-01T19:56:16.979 INFO:teuthology.orchestra.run.smithi008.stdout: "age": 18.198371225999999, 2023-08-01T19:56:16.979 INFO:teuthology.orchestra.run.smithi008.stdout: "duration": 1.0529485839999999, 2023-08-01T19:56:16.979 INFO:teuthology.orchestra.run.smithi008.stdout: "type_data": { 2023-08-01T19:56:16.979 INFO:teuthology.orchestra.run.smithi008.stdout: "flag_point": "commit sent; apply or cleanup", 2023-08-01T19:56:16.980 INFO:teuthology.orchestra.run.smithi008.stdout: "client_info": { 2023-08-01T19:56:16.980 INFO:teuthology.orchestra.run.smithi008.stdout: "client": "client.4668", 2023-08-01T19:56:16.980 INFO:teuthology.orchestra.run.smithi008.stdout: "client_addr": "172.21.15.6:0/1709472247", 2023-08-01T19:56:16.980 INFO:teuthology.orchestra.run.smithi008.stdout: "tid": 197418 2023-08-01T19:56:16.980 INFO:teuthology.orchestra.run.smithi008.stdout: }, 2023-08-01T19:56:16.980 INFO:teuthology.orchestra.run.smithi008.stdout: "events": [ 2023-08-01T19:56:16.980 INFO:teuthology.orchestra.run.smithi008.stdout: { 2023-08-01T19:56:16.980 INFO:teuthology.orchestra.run.smithi008.stdout: "event": "initiated", 2023-08-01T19:56:16.981 INFO:teuthology.orchestra.run.smithi008.stdout: "time": "2023-08-01T19:55:58.580297+0000", 2023-08-01T19:56:16.981 INFO:teuthology.orchestra.run.smithi008.stdout: "duration": 0 2023-08-01T19:56:16.981 INFO:teuthology.orchestra.run.smithi008.stdout: }, 2023-08-01T19:56:16.981 INFO:teuthology.orchestra.run.smithi008.stdout: { 2023-08-01T19:56:16.981 INFO:teuthology.orchestra.run.smithi008.stdout: "event": "throttled", 2023-08-01T19:56:16.981 INFO:teuthology.orchestra.run.smithi008.stdout: "time": "2023-08-01T19:55:58.580297+0000", 2023-08-01T19:56:16.981 INFO:teuthology.orchestra.run.smithi008.stdout: "duration": 0 2023-08-01T19:56:16.981 INFO:teuthology.orchestra.run.smithi008.stdout: }, 2023-08-01T19:56:16.982 INFO:teuthology.orchestra.run.smithi008.stdout: { 2023-08-01T19:56:16.982 INFO:teuthology.orchestra.run.smithi008.stdout: "event": "header_read", 2023-08-01T19:56:16.982 INFO:teuthology.orchestra.run.smithi008.stdout: "time": "2023-08-01T19:55:58.580296+0000", 2023-08-01T19:56:16.982 INFO:teuthology.orchestra.run.smithi008.stdout: "duration": 4294967295.999999 2023-08-01T19:56:16.982 INFO:teuthology.orchestra.run.smithi008.stdout: }, 2023-08-01T19:56:16.982 INFO:teuthology.orchestra.run.smithi008.stdout: { 2023-08-01T19:56:16.982 INFO:teuthology.orchestra.run.smithi008.stdout: "event": "all_read", 2023-08-01T19:56:16.982 INFO:teuthology.orchestra.run.smithi008.stdout: "time": "2023-08-01T19:55:58.580302+0000", 2023-08-01T19:56:16.983 INFO:teuthology.orchestra.run.smithi008.stdout: "duration": 6.032e-06 2023-08-01T19:56:16.983 INFO:teuthology.orchestra.run.smithi008.stdout: }, 2023-08-01T19:56:16.983 INFO:teuthology.orchestra.run.smithi008.stdout: { 2023-08-01T19:56:16.983 INFO:teuthology.orchestra.run.smithi008.stdout: "event": "dispatched", 2023-08-01T19:56:16.983 INFO:teuthology.orchestra.run.smithi008.stdout: "time": "2023-08-01T19:55:58.580315+0000", 2023-08-01T19:56:16.983 INFO:teuthology.orchestra.run.smithi008.stdout: "duration": 1.327e-05 2023-08-01T19:56:16.983 INFO:teuthology.orchestra.run.smithi008.stdout: }, 2023-08-01T19:56:16.983 INFO:teuthology.orchestra.run.smithi008.stdout: { 2023-08-01T19:56:16.984 INFO:teuthology.orchestra.run.smithi008.stdout: "event": "queued_for_pg", 2023-08-01T19:56:16.984 INFO:teuthology.orchestra.run.smithi008.stdout: "time": "2023-08-01T19:55:58.580321+0000", 2023-08-01T19:56:16.984 INFO:teuthology.orchestra.run.smithi008.stdout: "duration": 6.3980000000000004e-06 2023-08-01T19:56:16.984 INFO:teuthology.orchestra.run.smithi008.stdout: }, 2023-08-01T19:56:16.984 INFO:teuthology.orchestra.run.smithi008.stdout: { 2023-08-01T19:56:16.984 INFO:teuthology.orchestra.run.smithi008.stdout: "event": "reached_pg", 2023-08-01T19:56:16.984 INFO:teuthology.orchestra.run.smithi008.stdout: "time": "2023-08-01T19:55:58.580372+0000", 2023-08-01T19:56:16.985 INFO:teuthology.orchestra.run.smithi008.stdout: "duration": 5.0219000000000001e-05 2023-08-01T19:56:16.985 INFO:teuthology.orchestra.run.smithi008.stdout: }, 2023-08-01T19:56:16.985 INFO:teuthology.orchestra.run.smithi008.stdout: { 2023-08-01T19:56:16.985 INFO:teuthology.orchestra.run.smithi008.stdout: "event": "waiting for peered", 2023-08-01T19:56:16.985 INFO:teuthology.orchestra.run.smithi008.stdout: "time": "2023-08-01T19:55:58.580378+0000", 2023-08-01T19:56:16.985 INFO:teuthology.orchestra.run.smithi008.stdout: "duration": 6.6529999999999997e-06 2023-08-01T19:56:16.985 INFO:teuthology.orchestra.run.smithi008.stdout: }, 2023-08-01T19:56:16.985 INFO:teuthology.orchestra.run.smithi008.stdout: { 2023-08-01T19:56:16.986 INFO:teuthology.orchestra.run.smithi008.stdout: "event": "reached_pg", 2023-08-01T19:56:16.986 INFO:teuthology.orchestra.run.smithi008.stdout: "time": "2023-08-01T19:55:59.618188+0000", 2023-08-01T19:56:16.986 INFO:teuthology.orchestra.run.smithi008.stdout: "duration": 1.037810267 2023-08-01T19:56:16.986 INFO:teuthology.orchestra.run.smithi008.stdout: }, 2023-08-01T19:56:16.986 INFO:teuthology.orchestra.run.smithi008.stdout: { 2023-08-01T19:56:16.986 INFO:teuthology.orchestra.run.smithi008.stdout: "event": "started", 2023-08-01T19:56:16.986 INFO:teuthology.orchestra.run.smithi008.stdout: "time": "2023-08-01T19:55:59.618308+0000", 2023-08-01T19:56:16.986 INFO:teuthology.orchestra.run.smithi008.stdout: "duration": 0.00011959 2023-08-01T19:56:16.987 INFO:teuthology.orchestra.run.smithi008.stdout: }, 2023-08-01T19:56:16.987 INFO:teuthology.orchestra.run.smithi008.stdout: { 2023-08-01T19:56:16.987 INFO:teuthology.orchestra.run.smithi008.stdout: "event": "op_commit", 2023-08-01T19:56:16.987 INFO:teuthology.orchestra.run.smithi008.stdout: "time": "2023-08-01T19:55:59.633122+0000", 2023-08-01T19:56:16.987 INFO:teuthology.orchestra.run.smithi008.stdout: "duration": 0.014814280000000001 2023-08-01T19:56:16.987 INFO:teuthology.orchestra.run.smithi008.stdout: }, 2023-08-01T19:56:16.987 INFO:teuthology.orchestra.run.smithi008.stdout: { 2023-08-01T19:56:16.987 INFO:teuthology.orchestra.run.smithi008.stdout: "event": "commit_sent", 2023-08-01T19:56:16.988 INFO:teuthology.orchestra.run.smithi008.stdout: "time": "2023-08-01T19:55:59.633167+0000", 2023-08-01T19:56:16.988 INFO:teuthology.orchestra.run.smithi008.stdout: "duration": 4.4651999999999999e-05 2023-08-01T19:56:16.988 INFO:teuthology.orchestra.run.smithi008.stdout: }, 2023-08-01T19:56:16.988 INFO:teuthology.orchestra.run.smithi008.stdout: { 2023-08-01T19:56:16.988 INFO:teuthology.orchestra.run.smithi008.stdout: "event": "done", 2023-08-01T19:56:16.988 INFO:teuthology.orchestra.run.smithi008.stdout: "time": "2023-08-01T19:55:59.633245+0000", 2023-08-01T19:56:16.988 INFO:teuthology.orchestra.run.smithi008.stdout: "duration": 7.8215999999999998e-05 2023-08-01T19:56:16.989 INFO:teuthology.orchestra.run.smithi008.stdout: } 2023-08-01T19:56:16.989 INFO:teuthology.orchestra.run.smithi008.stdout: ] 2023-08-01T19:56:16.989 INFO:teuthology.orchestra.run.smithi008.stdout: } 2023-08-01T19:56:16.989 INFO:teuthology.orchestra.run.smithi008.stdout: } 2023-08-01T19:56:16.989 INFO:teuthology.orchestra.run.smithi008.stdout: ] 2023-08-01T19:56:16.989 INFO:teuthology.orchestra.run.smithi008.stdout:} 2023-08-01T19:56:16.990 DEBUG:teuthology.orchestra.run.smithi155:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 30 ceph --cluster ceph --admin-daemon /var/run/ceph/ceph-osd.2.asok dump_ops_in_flight 2023-08-01T19:56:16.991 INFO:tasks.ceph.osd.2.smithi155.stderr:2023-08-01T19:56:16.989+0000 7faa5c6ac700 -1 received signal: Hangup from /usr/bin/python3 /bin/daemon-helper kill ceph-osd -f --cluster ceph -i 2 (PID: 111337) UID: 0 2023-08-01T19:56:17.091 INFO:tasks.ceph.osd.0.smithi008.stderr:2023-08-01T19:56:17.090+0000 7f16a58f4700 -1 received signal: Hangup from /usr/bin/python3 /bin/daemon-helper kill ceph-osd -f --cluster ceph -i 0 (PID: 111179) UID: 0 2023-08-01T19:56:17.110 DEBUG:teuthology.orchestra.run.smithi006:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 120 ceph --cluster ceph osd unset nodeep-scrub 2023-08-01T19:56:17.151 INFO:teuthology.orchestra.run.smithi155.stdout:{ 2023-08-01T19:56:17.152 INFO:teuthology.orchestra.run.smithi155.stdout: "ops": [ 2023-08-01T19:56:17.152 INFO:teuthology.orchestra.run.smithi155.stdout: { 2023-08-01T19:56:17.152 INFO:teuthology.orchestra.run.smithi155.stdout: "description": "osd_op(client.4668.0:233547 5.b 5:d9623e7a:::benchmark_data_smithi006_114134_object99886:head [delete] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e69)", 2023-08-01T19:56:17.152 INFO:teuthology.orchestra.run.smithi155.stdout: "initiated_at": "2023-08-01T19:56:17.143527+0000", 2023-08-01T19:56:17.152 INFO:teuthology.orchestra.run.smithi155.stdout: "age": 0.0071958910000000003, 2023-08-01T19:56:17.152 INFO:teuthology.orchestra.run.smithi155.stdout: "duration": 0.0072211979999999999, 2023-08-01T19:56:17.153 INFO:teuthology.orchestra.run.smithi155.stdout: "type_data": { 2023-08-01T19:56:17.153 INFO:teuthology.orchestra.run.smithi155.stdout: "flag_point": "waiting for sub ops", 2023-08-01T19:56:17.153 INFO:teuthology.orchestra.run.smithi155.stdout: "client_info": { 2023-08-01T19:56:17.153 INFO:teuthology.orchestra.run.smithi155.stdout: "client": "client.4668", 2023-08-01T19:56:17.153 INFO:teuthology.orchestra.run.smithi155.stdout: "client_addr": "172.21.15.6:0/1709472247", 2023-08-01T19:56:17.153 INFO:teuthology.orchestra.run.smithi155.stdout: "tid": 233547 2023-08-01T19:56:17.153 INFO:teuthology.orchestra.run.smithi155.stdout: }, 2023-08-01T19:56:17.153 INFO:teuthology.orchestra.run.smithi155.stdout: "events": [ 2023-08-01T19:56:17.154 INFO:teuthology.orchestra.run.smithi155.stdout: { 2023-08-01T19:56:17.154 INFO:teuthology.orchestra.run.smithi155.stdout: "event": "initiated", 2023-08-01T19:56:17.154 INFO:teuthology.orchestra.run.smithi155.stdout: "time": "2023-08-01T19:56:17.143527+0000", 2023-08-01T19:56:17.154 INFO:teuthology.orchestra.run.smithi155.stdout: "duration": 0 2023-08-01T19:56:17.154 INFO:teuthology.orchestra.run.smithi155.stdout: }, 2023-08-01T19:56:17.154 INFO:teuthology.orchestra.run.smithi155.stdout: { 2023-08-01T19:56:17.154 INFO:teuthology.orchestra.run.smithi155.stdout: "event": "throttled", 2023-08-01T19:56:17.154 INFO:teuthology.orchestra.run.smithi155.stdout: "time": "2023-08-01T19:56:17.143527+0000", 2023-08-01T19:56:17.155 INFO:teuthology.orchestra.run.smithi155.stdout: "duration": 0 2023-08-01T19:56:17.155 INFO:teuthology.orchestra.run.smithi155.stdout: }, 2023-08-01T19:56:17.155 INFO:teuthology.orchestra.run.smithi155.stdout: { 2023-08-01T19:56:17.155 INFO:teuthology.orchestra.run.smithi155.stdout: "event": "header_read", 2023-08-01T19:56:17.155 INFO:teuthology.orchestra.run.smithi155.stdout: "time": "2023-08-01T19:56:17.143526+0000", 2023-08-01T19:56:17.155 INFO:teuthology.orchestra.run.smithi155.stdout: "duration": 4294967295.999999 2023-08-01T19:56:17.155 INFO:teuthology.orchestra.run.smithi155.stdout: }, 2023-08-01T19:56:17.155 INFO:teuthology.orchestra.run.smithi155.stdout: { 2023-08-01T19:56:17.156 INFO:teuthology.orchestra.run.smithi155.stdout: "event": "all_read", 2023-08-01T19:56:17.156 INFO:teuthology.orchestra.run.smithi155.stdout: "time": "2023-08-01T19:56:17.143531+0000", 2023-08-01T19:56:17.156 INFO:teuthology.orchestra.run.smithi155.stdout: "duration": 4.5140000000000003e-06 2023-08-01T19:56:17.156 INFO:teuthology.orchestra.run.smithi155.stdout: }, 2023-08-01T19:56:17.156 INFO:teuthology.orchestra.run.smithi155.stdout: { 2023-08-01T19:56:17.156 INFO:teuthology.orchestra.run.smithi155.stdout: "event": "dispatched", 2023-08-01T19:56:17.156 INFO:teuthology.orchestra.run.smithi155.stdout: "time": "2023-08-01T19:56:17.143537+0000", 2023-08-01T19:56:17.157 INFO:teuthology.orchestra.run.smithi155.stdout: "duration": 6.0650000000000004e-06 2023-08-01T19:56:17.157 INFO:teuthology.orchestra.run.smithi155.stdout: }, 2023-08-01T19:56:17.157 INFO:teuthology.orchestra.run.smithi155.stdout: { 2023-08-01T19:56:17.157 INFO:teuthology.orchestra.run.smithi155.stdout: "event": "queued_for_pg", 2023-08-01T19:56:17.157 INFO:teuthology.orchestra.run.smithi155.stdout: "time": "2023-08-01T19:56:17.143540+0000", 2023-08-01T19:56:17.157 INFO:teuthology.orchestra.run.smithi155.stdout: "duration": 3.5209999999999998e-06 2023-08-01T19:56:17.157 INFO:teuthology.orchestra.run.smithi155.stdout: }, 2023-08-01T19:56:17.157 INFO:teuthology.orchestra.run.smithi155.stdout: { 2023-08-01T19:56:17.158 INFO:teuthology.orchestra.run.smithi155.stdout: "event": "reached_pg", 2023-08-01T19:56:17.158 INFO:teuthology.orchestra.run.smithi155.stdout: "time": "2023-08-01T19:56:17.143789+0000", 2023-08-01T19:56:17.158 INFO:teuthology.orchestra.run.smithi155.stdout: "duration": 0.00024876400000000001 2023-08-01T19:56:17.158 INFO:teuthology.orchestra.run.smithi155.stdout: }, 2023-08-01T19:56:17.158 INFO:teuthology.orchestra.run.smithi155.stdout: { 2023-08-01T19:56:17.158 INFO:teuthology.orchestra.run.smithi155.stdout: "event": "started", 2023-08-01T19:56:17.158 INFO:teuthology.orchestra.run.smithi155.stdout: "time": "2023-08-01T19:56:17.143909+0000", 2023-08-01T19:56:17.158 INFO:teuthology.orchestra.run.smithi155.stdout: "duration": 0.000119833 2023-08-01T19:56:17.159 INFO:teuthology.orchestra.run.smithi155.stdout: }, 2023-08-01T19:56:17.159 INFO:teuthology.orchestra.run.smithi155.stdout: { 2023-08-01T19:56:17.159 INFO:teuthology.orchestra.run.smithi155.stdout: "event": "waiting for subops from 0", 2023-08-01T19:56:17.159 INFO:teuthology.orchestra.run.smithi155.stdout: "time": "2023-08-01T19:56:17.144027+0000", 2023-08-01T19:56:17.159 INFO:teuthology.orchestra.run.smithi155.stdout: "duration": 0.000117484 2023-08-01T19:56:17.159 INFO:teuthology.orchestra.run.smithi155.stdout: }, 2023-08-01T19:56:17.159 INFO:teuthology.orchestra.run.smithi155.stdout: { 2023-08-01T19:56:17.159 INFO:teuthology.orchestra.run.smithi155.stdout: "event": "op_commit", 2023-08-01T19:56:17.160 INFO:teuthology.orchestra.run.smithi155.stdout: "time": "2023-08-01T19:56:17.147671+0000", 2023-08-01T19:56:17.160 INFO:teuthology.orchestra.run.smithi155.stdout: "duration": 0.0036443479999999999 2023-08-01T19:56:17.160 INFO:teuthology.orchestra.run.smithi155.stdout: } 2023-08-01T19:56:17.160 INFO:teuthology.orchestra.run.smithi155.stdout: ] 2023-08-01T19:56:17.160 INFO:teuthology.orchestra.run.smithi155.stdout: } 2023-08-01T19:56:17.160 INFO:teuthology.orchestra.run.smithi155.stdout: }, 2023-08-01T19:56:17.160 INFO:teuthology.orchestra.run.smithi155.stdout: { 2023-08-01T19:56:17.161 INFO:teuthology.orchestra.run.smithi155.stdout: "description": "osd_op(client.4668.0:233551 5.8 5:1dd53664:::benchmark_data_smithi006_114134_object99890:head [delete] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e69)", 2023-08-01T19:56:17.161 INFO:teuthology.orchestra.run.smithi155.stdout: "initiated_at": "2023-08-01T19:56:17.144337+0000", 2023-08-01T19:56:17.161 INFO:teuthology.orchestra.run.smithi155.stdout: "age": 0.0063856809999999998, 2023-08-01T19:56:17.161 INFO:teuthology.orchestra.run.smithi155.stdout: "duration": 0.0064887479999999999, 2023-08-01T19:56:17.161 INFO:teuthology.orchestra.run.smithi155.stdout: "type_data": { 2023-08-01T19:56:17.161 INFO:teuthology.orchestra.run.smithi155.stdout: "flag_point": "waiting for sub ops", 2023-08-01T19:56:17.161 INFO:teuthology.orchestra.run.smithi155.stdout: "client_info": { 2023-08-01T19:56:17.161 INFO:teuthology.orchestra.run.smithi155.stdout: "client": "client.4668", 2023-08-01T19:56:17.162 INFO:teuthology.orchestra.run.smithi155.stdout: "client_addr": "172.21.15.6:0/1709472247", 2023-08-01T19:56:17.162 INFO:teuthology.orchestra.run.smithi155.stdout: "tid": 233551 2023-08-01T19:56:17.162 INFO:teuthology.orchestra.run.smithi155.stdout: }, 2023-08-01T19:56:17.162 INFO:teuthology.orchestra.run.smithi155.stdout: "events": [ 2023-08-01T19:56:17.162 INFO:teuthology.orchestra.run.smithi155.stdout: { 2023-08-01T19:56:17.162 INFO:teuthology.orchestra.run.smithi155.stdout: "event": "initiated", 2023-08-01T19:56:17.162 INFO:teuthology.orchestra.run.smithi155.stdout: "time": "2023-08-01T19:56:17.144337+0000", 2023-08-01T19:56:17.163 INFO:teuthology.orchestra.run.smithi155.stdout: "duration": 0 2023-08-01T19:56:17.163 INFO:teuthology.orchestra.run.smithi155.stdout: }, 2023-08-01T19:56:17.163 INFO:teuthology.orchestra.run.smithi155.stdout: { 2023-08-01T19:56:17.163 INFO:teuthology.orchestra.run.smithi155.stdout: "event": "throttled", 2023-08-01T19:56:17.163 INFO:teuthology.orchestra.run.smithi155.stdout: "time": "2023-08-01T19:56:17.144337+0000", 2023-08-01T19:56:17.163 INFO:teuthology.orchestra.run.smithi155.stdout: "duration": 0 2023-08-01T19:56:17.163 INFO:teuthology.orchestra.run.smithi155.stdout: }, 2023-08-01T19:56:17.163 INFO:teuthology.orchestra.run.smithi155.stdout: { 2023-08-01T19:56:17.164 INFO:teuthology.orchestra.run.smithi155.stdout: "event": "header_read", 2023-08-01T19:56:17.164 INFO:teuthology.orchestra.run.smithi155.stdout: "time": "2023-08-01T19:56:17.144337+0000", 2023-08-01T19:56:17.164 INFO:teuthology.orchestra.run.smithi155.stdout: "duration": 4294967295.9999995 2023-08-01T19:56:17.164 INFO:teuthology.orchestra.run.smithi155.stdout: }, 2023-08-01T19:56:17.164 INFO:teuthology.orchestra.run.smithi155.stdout: { 2023-08-01T19:56:17.164 INFO:teuthology.orchestra.run.smithi155.stdout: "event": "all_read", 2023-08-01T19:56:17.164 INFO:teuthology.orchestra.run.smithi155.stdout: "time": "2023-08-01T19:56:17.144341+0000", 2023-08-01T19:56:17.164 INFO:teuthology.orchestra.run.smithi155.stdout: "duration": 3.8879999999999999e-06 2023-08-01T19:56:17.165 INFO:teuthology.orchestra.run.smithi155.stdout: }, 2023-08-01T19:56:17.165 INFO:teuthology.orchestra.run.smithi155.stdout: { 2023-08-01T19:56:17.165 INFO:teuthology.orchestra.run.smithi155.stdout: "event": "dispatched", 2023-08-01T19:56:17.165 INFO:teuthology.orchestra.run.smithi155.stdout: "time": "2023-08-01T19:56:17.144348+0000", 2023-08-01T19:56:17.165 INFO:teuthology.orchestra.run.smithi155.stdout: "duration": 7.5580000000000003e-06 2023-08-01T19:56:17.165 INFO:teuthology.orchestra.run.smithi155.stdout: }, 2023-08-01T19:56:17.165 INFO:teuthology.orchestra.run.smithi155.stdout: { 2023-08-01T19:56:17.165 INFO:teuthology.orchestra.run.smithi155.stdout: "event": "queued_for_pg", 2023-08-01T19:56:17.166 INFO:teuthology.orchestra.run.smithi155.stdout: "time": "2023-08-01T19:56:17.144352+0000", 2023-08-01T19:56:17.166 INFO:teuthology.orchestra.run.smithi155.stdout: "duration": 3.9639999999999997e-06 2023-08-01T19:56:17.166 INFO:teuthology.orchestra.run.smithi155.stdout: }, 2023-08-01T19:56:17.166 INFO:teuthology.orchestra.run.smithi155.stdout: { 2023-08-01T19:56:17.166 INFO:teuthology.orchestra.run.smithi155.stdout: "event": "reached_pg", 2023-08-01T19:56:17.166 INFO:teuthology.orchestra.run.smithi155.stdout: "time": "2023-08-01T19:56:17.144378+0000", 2023-08-01T19:56:17.166 INFO:teuthology.orchestra.run.smithi155.stdout: "duration": 2.5358999999999999e-05 2023-08-01T19:56:17.166 INFO:teuthology.orchestra.run.smithi155.stdout: }, 2023-08-01T19:56:17.167 INFO:teuthology.orchestra.run.smithi155.stdout: { 2023-08-01T19:56:17.167 INFO:teuthology.orchestra.run.smithi155.stdout: "event": "started", 2023-08-01T19:56:17.167 INFO:teuthology.orchestra.run.smithi155.stdout: "time": "2023-08-01T19:56:17.144470+0000", 2023-08-01T19:56:17.167 INFO:teuthology.orchestra.run.smithi155.stdout: "duration": 9.2606000000000001e-05 2023-08-01T19:56:17.167 INFO:teuthology.orchestra.run.smithi155.stdout: }, 2023-08-01T19:56:17.167 INFO:teuthology.orchestra.run.smithi155.stdout: { 2023-08-01T19:56:17.167 INFO:teuthology.orchestra.run.smithi155.stdout: "event": "waiting for subops from 0", 2023-08-01T19:56:17.167 INFO:teuthology.orchestra.run.smithi155.stdout: "time": "2023-08-01T19:56:17.144586+0000", 2023-08-01T19:56:17.168 INFO:teuthology.orchestra.run.smithi155.stdout: "duration": 0.000116131 2023-08-01T19:56:17.168 INFO:teuthology.orchestra.run.smithi155.stdout: }, 2023-08-01T19:56:17.168 INFO:teuthology.orchestra.run.smithi155.stdout: { 2023-08-01T19:56:17.168 INFO:teuthology.orchestra.run.smithi155.stdout: "event": "op_commit", 2023-08-01T19:56:17.168 INFO:teuthology.orchestra.run.smithi155.stdout: "time": "2023-08-01T19:56:17.149153+0000", 2023-08-01T19:56:17.168 INFO:teuthology.orchestra.run.smithi155.stdout: "duration": 0.0045670900000000002 2023-08-01T19:56:17.168 INFO:teuthology.orchestra.run.smithi155.stdout: } 2023-08-01T19:56:17.168 INFO:teuthology.orchestra.run.smithi155.stdout: ] 2023-08-01T19:56:17.169 INFO:teuthology.orchestra.run.smithi155.stdout: } 2023-08-01T19:56:17.169 INFO:teuthology.orchestra.run.smithi155.stdout: }, 2023-08-01T19:56:17.169 INFO:teuthology.orchestra.run.smithi155.stdout: { 2023-08-01T19:56:17.169 INFO:teuthology.orchestra.run.smithi155.stdout: "description": "osd_op(client.4668.0:233562 5.f 5:fa0a20f7:::benchmark_data_smithi006_114134_object99901:head [delete] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e69)", 2023-08-01T19:56:17.169 INFO:teuthology.orchestra.run.smithi155.stdout: "initiated_at": "2023-08-01T19:56:17.148861+0000", 2023-08-01T19:56:17.169 INFO:teuthology.orchestra.run.smithi155.stdout: "age": 0.0018623380000000001, 2023-08-01T19:56:17.169 INFO:teuthology.orchestra.run.smithi155.stdout: "duration": 0.0020168870000000002, 2023-08-01T19:56:17.169 INFO:teuthology.orchestra.run.smithi155.stdout: "type_data": { 2023-08-01T19:56:17.170 INFO:teuthology.orchestra.run.smithi155.stdout: "flag_point": "started", 2023-08-01T19:56:17.170 INFO:teuthology.orchestra.run.smithi155.stdout: "client_info": { 2023-08-01T19:56:17.170 INFO:teuthology.orchestra.run.smithi155.stdout: "client": "client.4668", 2023-08-01T19:56:17.170 INFO:teuthology.orchestra.run.smithi155.stdout: "client_addr": "172.21.15.6:0/1709472247", 2023-08-01T19:56:17.170 INFO:teuthology.orchestra.run.smithi155.stdout: "tid": 233562 2023-08-01T19:56:17.170 INFO:teuthology.orchestra.run.smithi155.stdout: }, 2023-08-01T19:56:17.170 INFO:teuthology.orchestra.run.smithi155.stdout: "events": [ 2023-08-01T19:56:17.170 INFO:teuthology.orchestra.run.smithi155.stdout: { 2023-08-01T19:56:17.171 INFO:teuthology.orchestra.run.smithi155.stdout: "event": "initiated", 2023-08-01T19:56:17.171 INFO:teuthology.orchestra.run.smithi155.stdout: "time": "2023-08-01T19:56:17.148861+0000", 2023-08-01T19:56:17.171 INFO:teuthology.orchestra.run.smithi155.stdout: "duration": 0 2023-08-01T19:56:17.171 INFO:teuthology.orchestra.run.smithi155.stdout: }, 2023-08-01T19:56:17.171 INFO:teuthology.orchestra.run.smithi155.stdout: { 2023-08-01T19:56:17.171 INFO:teuthology.orchestra.run.smithi155.stdout: "event": "throttled", 2023-08-01T19:56:17.171 INFO:teuthology.orchestra.run.smithi155.stdout: "time": "2023-08-01T19:56:17.148861+0000", 2023-08-01T19:56:17.171 INFO:teuthology.orchestra.run.smithi155.stdout: "duration": 0 2023-08-01T19:56:17.172 INFO:teuthology.orchestra.run.smithi155.stdout: }, 2023-08-01T19:56:17.172 INFO:teuthology.orchestra.run.smithi155.stdout: { 2023-08-01T19:56:17.172 INFO:teuthology.orchestra.run.smithi155.stdout: "event": "header_read", 2023-08-01T19:56:17.172 INFO:teuthology.orchestra.run.smithi155.stdout: "time": "2023-08-01T19:56:17.148860+0000", 2023-08-01T19:56:17.172 INFO:teuthology.orchestra.run.smithi155.stdout: "duration": 4294967295.999999 2023-08-01T19:56:17.172 INFO:teuthology.orchestra.run.smithi155.stdout: }, 2023-08-01T19:56:17.172 INFO:teuthology.orchestra.run.smithi155.stdout: { 2023-08-01T19:56:17.172 INFO:teuthology.orchestra.run.smithi155.stdout: "event": "all_read", 2023-08-01T19:56:17.173 INFO:teuthology.orchestra.run.smithi155.stdout: "time": "2023-08-01T19:56:17.148865+0000", 2023-08-01T19:56:17.173 INFO:teuthology.orchestra.run.smithi155.stdout: "duration": 5.198e-06 2023-08-01T19:56:17.173 INFO:teuthology.orchestra.run.smithi155.stdout: }, 2023-08-01T19:56:17.173 INFO:teuthology.orchestra.run.smithi155.stdout: { 2023-08-01T19:56:17.173 INFO:teuthology.orchestra.run.smithi155.stdout: "event": "dispatched", 2023-08-01T19:56:17.173 INFO:teuthology.orchestra.run.smithi155.stdout: "time": "2023-08-01T19:56:17.148877+0000", 2023-08-01T19:56:17.173 INFO:teuthology.orchestra.run.smithi155.stdout: "duration": 1.2041999999999999e-05 2023-08-01T19:56:17.173 INFO:teuthology.orchestra.run.smithi155.stdout: }, 2023-08-01T19:56:17.174 INFO:teuthology.orchestra.run.smithi155.stdout: { 2023-08-01T19:56:17.174 INFO:teuthology.orchestra.run.smithi155.stdout: "event": "queued_for_pg", 2023-08-01T19:56:17.174 INFO:teuthology.orchestra.run.smithi155.stdout: "time": "2023-08-01T19:56:17.148884+0000", 2023-08-01T19:56:17.174 INFO:teuthology.orchestra.run.smithi155.stdout: "duration": 7.2429999999999999e-06 2023-08-01T19:56:17.174 INFO:teuthology.orchestra.run.smithi155.stdout: }, 2023-08-01T19:56:17.174 INFO:teuthology.orchestra.run.smithi155.stdout: { 2023-08-01T19:56:17.174 INFO:teuthology.orchestra.run.smithi155.stdout: "event": "reached_pg", 2023-08-01T19:56:17.175 INFO:teuthology.orchestra.run.smithi155.stdout: "time": "2023-08-01T19:56:17.148922+0000", 2023-08-01T19:56:17.175 INFO:teuthology.orchestra.run.smithi155.stdout: "duration": 3.8118999999999999e-05 2023-08-01T19:56:17.175 INFO:teuthology.orchestra.run.smithi155.stdout: }, 2023-08-01T19:56:17.175 INFO:teuthology.orchestra.run.smithi155.stdout: { 2023-08-01T19:56:17.175 INFO:teuthology.orchestra.run.smithi155.stdout: "event": "started", 2023-08-01T19:56:17.175 INFO:teuthology.orchestra.run.smithi155.stdout: "time": "2023-08-01T19:56:17.149042+0000", 2023-08-01T19:56:17.175 INFO:teuthology.orchestra.run.smithi155.stdout: "duration": 0.000119654 2023-08-01T19:56:17.176 INFO:teuthology.orchestra.run.smithi155.stdout: } 2023-08-01T19:56:17.176 INFO:teuthology.orchestra.run.smithi155.stdout: ] 2023-08-01T19:56:17.176 INFO:teuthology.orchestra.run.smithi155.stdout: } 2023-08-01T19:56:17.176 INFO:teuthology.orchestra.run.smithi155.stdout: }, 2023-08-01T19:56:17.176 INFO:teuthology.orchestra.run.smithi155.stdout: { 2023-08-01T19:56:17.176 INFO:teuthology.orchestra.run.smithi155.stdout: "description": "osd_op(client.4668.0:233563 5.4 5:2f9ea740:::benchmark_data_smithi006_114134_object99902:head [delete] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e69)", 2023-08-01T19:56:17.176 INFO:teuthology.orchestra.run.smithi155.stdout: "initiated_at": "2023-08-01T19:56:17.149881+0000", 2023-08-01T19:56:17.176 INFO:teuthology.orchestra.run.smithi155.stdout: "age": 0.00084172399999999997, 2023-08-01T19:56:17.177 INFO:teuthology.orchestra.run.smithi155.stdout: "duration": 0.0010373330000000001, 2023-08-01T19:56:17.177 INFO:teuthology.orchestra.run.smithi155.stdout: "type_data": { 2023-08-01T19:56:17.177 INFO:teuthology.orchestra.run.smithi155.stdout: "flag_point": "waiting for sub ops", 2023-08-01T19:56:17.177 INFO:teuthology.orchestra.run.smithi155.stdout: "client_info": { 2023-08-01T19:56:17.177 INFO:teuthology.orchestra.run.smithi155.stdout: "client": "client.4668", 2023-08-01T19:56:17.177 INFO:teuthology.orchestra.run.smithi155.stdout: "client_addr": "172.21.15.6:0/1709472247", 2023-08-01T19:56:17.177 INFO:teuthology.orchestra.run.smithi155.stdout: "tid": 233563 2023-08-01T19:56:17.178 INFO:teuthology.orchestra.run.smithi155.stdout: }, 2023-08-01T19:56:17.178 INFO:teuthology.orchestra.run.smithi155.stdout: "events": [ 2023-08-01T19:56:17.178 INFO:teuthology.orchestra.run.smithi155.stdout: { 2023-08-01T19:56:17.178 INFO:teuthology.orchestra.run.smithi155.stdout: "event": "initiated", 2023-08-01T19:56:17.178 INFO:teuthology.orchestra.run.smithi155.stdout: "time": "2023-08-01T19:56:17.149881+0000", 2023-08-01T19:56:17.178 INFO:teuthology.orchestra.run.smithi155.stdout: "duration": 0 2023-08-01T19:56:17.178 INFO:teuthology.orchestra.run.smithi155.stdout: }, 2023-08-01T19:56:17.178 INFO:teuthology.orchestra.run.smithi155.stdout: { 2023-08-01T19:56:17.179 INFO:teuthology.orchestra.run.smithi155.stdout: "event": "throttled", 2023-08-01T19:56:17.179 INFO:teuthology.orchestra.run.smithi155.stdout: "time": "2023-08-01T19:56:17.149881+0000", 2023-08-01T19:56:17.179 INFO:teuthology.orchestra.run.smithi155.stdout: "duration": 0 2023-08-01T19:56:17.179 INFO:teuthology.orchestra.run.smithi155.stdout: }, 2023-08-01T19:56:17.179 INFO:teuthology.orchestra.run.smithi155.stdout: { 2023-08-01T19:56:17.179 INFO:teuthology.orchestra.run.smithi155.stdout: "event": "header_read", 2023-08-01T19:56:17.179 INFO:teuthology.orchestra.run.smithi155.stdout: "time": "2023-08-01T19:56:17.149881+0000", 2023-08-01T19:56:17.179 INFO:teuthology.orchestra.run.smithi155.stdout: "duration": 4294967295.999999 2023-08-01T19:56:17.180 INFO:teuthology.orchestra.run.smithi155.stdout: }, 2023-08-01T19:56:17.180 INFO:teuthology.orchestra.run.smithi155.stdout: { 2023-08-01T19:56:17.180 INFO:teuthology.orchestra.run.smithi155.stdout: "event": "all_read", 2023-08-01T19:56:17.180 INFO:teuthology.orchestra.run.smithi155.stdout: "time": "2023-08-01T19:56:17.149888+0000", 2023-08-01T19:56:17.180 INFO:teuthology.orchestra.run.smithi155.stdout: "duration": 7.0999999999999998e-06 2023-08-01T19:56:17.180 INFO:teuthology.orchestra.run.smithi155.stdout: }, 2023-08-01T19:56:17.180 INFO:teuthology.orchestra.run.smithi155.stdout: { 2023-08-01T19:56:17.180 INFO:teuthology.orchestra.run.smithi155.stdout: "event": "dispatched", 2023-08-01T19:56:17.181 INFO:teuthology.orchestra.run.smithi155.stdout: "time": "2023-08-01T19:56:17.149901+0000", 2023-08-01T19:56:17.181 INFO:teuthology.orchestra.run.smithi155.stdout: "duration": 1.306e-05 2023-08-01T19:56:17.181 INFO:teuthology.orchestra.run.smithi155.stdout: }, 2023-08-01T19:56:17.181 INFO:teuthology.orchestra.run.smithi155.stdout: { 2023-08-01T19:56:17.181 INFO:teuthology.orchestra.run.smithi155.stdout: "event": "queued_for_pg", 2023-08-01T19:56:17.181 INFO:teuthology.orchestra.run.smithi155.stdout: "time": "2023-08-01T19:56:17.149907+0000", 2023-08-01T19:56:17.181 INFO:teuthology.orchestra.run.smithi155.stdout: "duration": 6.0689999999999998e-06 2023-08-01T19:56:17.181 INFO:teuthology.orchestra.run.smithi155.stdout: }, 2023-08-01T19:56:17.182 INFO:teuthology.orchestra.run.smithi155.stdout: { 2023-08-01T19:56:17.182 INFO:teuthology.orchestra.run.smithi155.stdout: "event": "reached_pg", 2023-08-01T19:56:17.182 INFO:teuthology.orchestra.run.smithi155.stdout: "time": "2023-08-01T19:56:17.149941+0000", 2023-08-01T19:56:17.182 INFO:teuthology.orchestra.run.smithi155.stdout: "duration": 3.4181999999999999e-05 2023-08-01T19:56:17.182 INFO:teuthology.orchestra.run.smithi155.stdout: }, 2023-08-01T19:56:17.182 INFO:teuthology.orchestra.run.smithi155.stdout: { 2023-08-01T19:56:17.182 INFO:teuthology.orchestra.run.smithi155.stdout: "event": "started", 2023-08-01T19:56:17.182 INFO:teuthology.orchestra.run.smithi155.stdout: "time": "2023-08-01T19:56:17.150017+0000", 2023-08-01T19:56:17.183 INFO:teuthology.orchestra.run.smithi155.stdout: "duration": 7.6101999999999997e-05 2023-08-01T19:56:17.183 INFO:teuthology.orchestra.run.smithi155.stdout: }, 2023-08-01T19:56:17.183 INFO:teuthology.orchestra.run.smithi155.stdout: { 2023-08-01T19:56:17.183 INFO:teuthology.orchestra.run.smithi155.stdout: "event": "waiting for subops from 0", 2023-08-01T19:56:17.183 INFO:teuthology.orchestra.run.smithi155.stdout: "time": "2023-08-01T19:56:17.150079+0000", 2023-08-01T19:56:17.183 INFO:teuthology.orchestra.run.smithi155.stdout: "duration": 6.1962000000000001e-05 2023-08-01T19:56:17.183 INFO:teuthology.orchestra.run.smithi155.stdout: } 2023-08-01T19:56:17.183 INFO:teuthology.orchestra.run.smithi155.stdout: ] 2023-08-01T19:56:17.184 INFO:teuthology.orchestra.run.smithi155.stdout: } 2023-08-01T19:56:17.184 INFO:teuthology.orchestra.run.smithi155.stdout: }, 2023-08-01T19:56:17.184 INFO:teuthology.orchestra.run.smithi155.stdout: { 2023-08-01T19:56:17.184 INFO:teuthology.orchestra.run.smithi155.stdout: "description": "osd_op(client.4668.0:233564 5.4 5.317e774 (undecoded) ondisk+write+known_if_redirected+supports_pool_eio e69)", 2023-08-01T19:56:17.184 INFO:teuthology.orchestra.run.smithi155.stdout: "initiated_at": "2023-08-01T19:56:17.150419+0000", 2023-08-01T19:56:17.184 INFO:teuthology.orchestra.run.smithi155.stdout: "age": 0.000304653, 2023-08-01T19:56:17.184 INFO:teuthology.orchestra.run.smithi155.stdout: "duration": 0.00054237100000000004, 2023-08-01T19:56:17.184 INFO:teuthology.orchestra.run.smithi155.stdout: "type_data": { 2023-08-01T19:56:17.185 INFO:teuthology.orchestra.run.smithi155.stdout: "flag_point": "queued for pg", 2023-08-01T19:56:17.185 INFO:teuthology.orchestra.run.smithi155.stdout: "client_info": { 2023-08-01T19:56:17.185 INFO:teuthology.orchestra.run.smithi155.stdout: "client": "client.4668", 2023-08-01T19:56:17.185 INFO:teuthology.orchestra.run.smithi155.stdout: "client_addr": "172.21.15.6:0/1709472247", 2023-08-01T19:56:17.185 INFO:teuthology.orchestra.run.smithi155.stdout: "tid": 233564 2023-08-01T19:56:17.185 INFO:teuthology.orchestra.run.smithi155.stdout: }, 2023-08-01T19:56:17.185 INFO:teuthology.orchestra.run.smithi155.stdout: "events": [ 2023-08-01T19:56:17.185 INFO:teuthology.orchestra.run.smithi155.stdout: { 2023-08-01T19:56:17.186 INFO:teuthology.orchestra.run.smithi155.stdout: "event": "initiated", 2023-08-01T19:56:17.186 INFO:teuthology.orchestra.run.smithi155.stdout: "time": "2023-08-01T19:56:17.150419+0000", 2023-08-01T19:56:17.186 INFO:teuthology.orchestra.run.smithi155.stdout: "duration": 0 2023-08-01T19:56:17.186 INFO:teuthology.orchestra.run.smithi155.stdout: }, 2023-08-01T19:56:17.186 INFO:teuthology.orchestra.run.smithi155.stdout: { 2023-08-01T19:56:17.186 INFO:teuthology.orchestra.run.smithi155.stdout: "event": "throttled", 2023-08-01T19:56:17.186 INFO:teuthology.orchestra.run.smithi155.stdout: "time": "2023-08-01T19:56:17.150419+0000", 2023-08-01T19:56:17.186 INFO:teuthology.orchestra.run.smithi155.stdout: "duration": 0 2023-08-01T19:56:17.187 INFO:teuthology.orchestra.run.smithi155.stdout: }, 2023-08-01T19:56:17.187 INFO:teuthology.orchestra.run.smithi155.stdout: { 2023-08-01T19:56:17.187 INFO:teuthology.orchestra.run.smithi155.stdout: "event": "header_read", 2023-08-01T19:56:17.187 INFO:teuthology.orchestra.run.smithi155.stdout: "time": "2023-08-01T19:56:17.150418+0000", 2023-08-01T19:56:17.187 INFO:teuthology.orchestra.run.smithi155.stdout: "duration": 4294967295.999999 2023-08-01T19:56:17.187 INFO:teuthology.orchestra.run.smithi155.stdout: }, 2023-08-01T19:56:17.187 INFO:teuthology.orchestra.run.smithi155.stdout: { 2023-08-01T19:56:17.187 INFO:teuthology.orchestra.run.smithi155.stdout: "event": "all_read", 2023-08-01T19:56:17.188 INFO:teuthology.orchestra.run.smithi155.stdout: "time": "2023-08-01T19:56:17.150423+0000", 2023-08-01T19:56:17.188 INFO:teuthology.orchestra.run.smithi155.stdout: "duration": 4.8160000000000001e-06 2023-08-01T19:56:17.188 INFO:teuthology.orchestra.run.smithi155.stdout: }, 2023-08-01T19:56:17.188 INFO:teuthology.orchestra.run.smithi155.stdout: { 2023-08-01T19:56:17.188 INFO:teuthology.orchestra.run.smithi155.stdout: "event": "dispatched", 2023-08-01T19:56:17.188 INFO:teuthology.orchestra.run.smithi155.stdout: "time": "2023-08-01T19:56:17.150435+0000", 2023-08-01T19:56:17.188 INFO:teuthology.orchestra.run.smithi155.stdout: "duration": 1.2335e-05 2023-08-01T19:56:17.189 INFO:teuthology.orchestra.run.smithi155.stdout: }, 2023-08-01T19:56:17.189 INFO:teuthology.orchestra.run.smithi155.stdout: { 2023-08-01T19:56:17.189 INFO:teuthology.orchestra.run.smithi155.stdout: "event": "queued_for_pg", 2023-08-01T19:56:17.189 INFO:teuthology.orchestra.run.smithi155.stdout: "time": "2023-08-01T19:56:17.150441+0000", 2023-08-01T19:56:17.189 INFO:teuthology.orchestra.run.smithi155.stdout: "duration": 6.0929999999999999e-06 2023-08-01T19:56:17.189 INFO:teuthology.orchestra.run.smithi155.stdout: } 2023-08-01T19:56:17.189 INFO:teuthology.orchestra.run.smithi155.stdout: ] 2023-08-01T19:56:17.189 INFO:teuthology.orchestra.run.smithi155.stdout: } 2023-08-01T19:56:17.190 INFO:teuthology.orchestra.run.smithi155.stdout: } 2023-08-01T19:56:17.190 INFO:teuthology.orchestra.run.smithi155.stdout: ], 2023-08-01T19:56:17.190 INFO:teuthology.orchestra.run.smithi155.stdout: "num_ops": 5 2023-08-01T19:56:17.190 INFO:teuthology.orchestra.run.smithi155.stdout:} 2023-08-01T19:56:17.191 DEBUG:teuthology.orchestra.run.smithi155:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 30 ceph --cluster ceph --admin-daemon /var/run/ceph/ceph-osd.2.asok dump_blocked_ops 2023-08-01T19:56:17.192 INFO:tasks.ceph.osd.0.smithi008.stderr:2023-08-01T19:56:17.190+0000 7f16a58f4700 -1 received signal: Hangup from /usr/bin/python3 /bin/daemon-helper kill ceph-osd -f --cluster ceph -i 0 (PID: 111179) UID: 0 2023-08-01T19:56:17.293 INFO:tasks.ceph.osd.2.smithi155.stderr:2023-08-01T19:56:17.292+0000 7faa5c6ac700 -1 received signal: Hangup from /usr/bin/python3 /bin/daemon-helper kill ceph-osd -f --cluster ceph -i 2 (PID: 111337) UID: 0 2023-08-01T19:56:17.361 INFO:teuthology.orchestra.run.smithi155.stdout:{ 2023-08-01T19:56:17.361 INFO:teuthology.orchestra.run.smithi155.stdout: "ops": [], 2023-08-01T19:56:17.361 INFO:teuthology.orchestra.run.smithi155.stdout: "complaint_time": 30, 2023-08-01T19:56:17.361 INFO:teuthology.orchestra.run.smithi155.stdout: "num_blocked_ops": 0 2023-08-01T19:56:17.362 INFO:teuthology.orchestra.run.smithi155.stdout:} 2023-08-01T19:56:17.373 DEBUG:teuthology.orchestra.run.smithi155:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 30 ceph --cluster ceph --admin-daemon /var/run/ceph/ceph-osd.2.asok dump_historic_ops 2023-08-01T19:56:17.375 DEBUG:teuthology.orchestra.run.smithi006:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 120 ceph --cluster ceph -- tell 'osd.*' injectargs --osd_enable_op_tracker=false 2023-08-01T19:56:17.414 INFO:tasks.ceph.osd.2.smithi155.stderr:2023-08-01T19:56:17.414+0000 7faa5c6ac700 -1 received signal: Hangup from /usr/bin/python3 /bin/daemon-helper kill ceph-osd -f --cluster ceph -i 2 (PID: 111337) UID: 0 2023-08-01T19:56:17.495 INFO:tasks.ceph.osd.2.smithi155.stderr:2023-08-01T19:56:17.494+0000 7faa5c6ac700 -1 received signal: Hangup from /usr/bin/python3 /bin/daemon-helper kill ceph-osd -f --cluster ceph -i 2 (PID: 111337) UID: 0 2023-08-01T19:56:17.515 INFO:teuthology.orchestra.run.smithi006.stderr:nodeep-scrub is unset 2023-08-01T19:56:17.525 INFO:teuthology.orchestra.run.smithi006.stdout:osd.0: {} 2023-08-01T19:56:17.546 INFO:teuthology.orchestra.run.smithi006.stdout:osd.2: {} 2023-08-01T19:56:17.546 INFO:teuthology.orchestra.run.smithi006.stderr:osd.0: osd_enable_op_tracker = 'false' 2023-08-01T19:56:17.546 INFO:teuthology.orchestra.run.smithi006.stderr:Error ENXIO: problem getting command descriptions from osd.1 2023-08-01T19:56:17.546 INFO:teuthology.orchestra.run.smithi006.stderr:osd.2: osd_enable_op_tracker = 'false' 2023-08-01T19:56:17.548 DEBUG:teuthology.orchestra.run:got remote process result: 6 2023-08-01T19:56:17.549 INFO:tasks.thrashosds.thrasher:Failed to tell all osds, ignoring 2023-08-01T19:56:17.571 INFO:teuthology.orchestra.run.smithi155.stdout:ERROR: (22) Invalid argument 2023-08-01T19:56:17.572 INFO:teuthology.orchestra.run.smithi155.stdout:op_tracker tracking is not enabled now, so no ops are tracked currently, even those get stuck. Please enable "osd_enable_op_tracker", and the tracker will start to track new ops received afterwards. 2023-08-01T19:56:17.584 DEBUG:teuthology.orchestra.run.smithi008:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 30 ceph --cluster ceph --admin-daemon /var/run/ceph/ceph-osd.0.asok dump_ops_in_flight 2023-08-01T19:56:17.628 INFO:tasks.ceph.osd.0.smithi008.stderr:2023-08-01T19:56:17.626+0000 7f16a58f4700 -1 received signal: Hangup from /usr/bin/python3 /bin/daemon-helper kill ceph-osd -f --cluster ceph -i 0 (PID: 111179) UID: 0 2023-08-01T19:56:17.696 INFO:tasks.ceph.osd.0.smithi008.stderr:2023-08-01T19:56:17.694+0000 7f16a58f4700 -1 received signal: Hangup from /usr/bin/python3 /bin/daemon-helper kill ceph-osd -f --cluster ceph -i 0 (PID: 111179) UID: 0 2023-08-01T19:56:17.771 INFO:teuthology.orchestra.run.smithi008.stdout:ERROR: (22) Invalid argument 2023-08-01T19:56:17.771 INFO:teuthology.orchestra.run.smithi008.stdout:op_tracker tracking is not enabled now, so no ops are tracked currently, even those get stuck. Please enable "osd_enable_op_tracker", and the tracker will start to track new ops received afterwards. 2023-08-01T19:56:17.787 DEBUG:teuthology.orchestra.run.smithi008:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 30 ceph --cluster ceph --admin-daemon /var/run/ceph/ceph-osd.0.asok dump_blocked_ops 2023-08-01T19:56:17.830 INFO:tasks.ceph.osd.0.smithi008.stderr:2023-08-01T19:56:17.828+0000 7f16a58f4700 -1 received signal: Hangup from /usr/bin/python3 /bin/daemon-helper kill ceph-osd -f --cluster ceph -i 0 (PID: 111179) UID: 0 2023-08-01T19:56:17.899 INFO:tasks.ceph.osd.0.smithi008.stderr:2023-08-01T19:56:17.897+0000 7f16a58f4700 -1 received signal: Hangup from /usr/bin/python3 /bin/daemon-helper kill ceph-osd -f --cluster ceph -i 0 (PID: 111179) UID: 0 2023-08-01T19:56:17.998 INFO:tasks.ceph.osd.0.smithi008.stderr:2023-08-01T19:56:17.997+0000 7f16a58f4700 -1 received signal: Hangup from /usr/bin/python3 /bin/daemon-helper kill ceph-osd -f --cluster ceph -i 0 (PID: 111179) UID: 0 2023-08-01T19:56:18.010 INFO:teuthology.orchestra.run.smithi008.stdout:ERROR: (22) Invalid argument 2023-08-01T19:56:18.010 INFO:teuthology.orchestra.run.smithi008.stdout:op_tracker tracking is not enabled now, so no ops are tracked currently, even those get stuck. Please enable "osd_enable_op_tracker", and the tracker will start to track new ops received afterwards. 2023-08-01T19:56:18.026 DEBUG:teuthology.orchestra.run.smithi008:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 30 ceph --cluster ceph --admin-daemon /var/run/ceph/ceph-osd.0.asok dump_historic_ops 2023-08-01T19:56:18.099 INFO:tasks.ceph.osd.2.smithi155.stderr:2023-08-01T19:56:18.098+0000 7faa5c6ac700 -1 received signal: Hangup from /usr/bin/python3 /bin/daemon-helper kill ceph-osd -f --cluster ceph -i 2 (PID: 111337) UID: 0 2023-08-01T19:56:18.199 INFO:tasks.ceph.osd.0.smithi008.stderr:2023-08-01T19:56:18.197+0000 7f16a58f4700 -1 received signal: Hangup from /usr/bin/python3 /bin/daemon-helper kill ceph-osd -f --cluster ceph -i 0 (PID: 111179) UID: 0 2023-08-01T19:56:18.250 INFO:teuthology.orchestra.run.smithi008.stdout:ERROR: (22) Invalid argument 2023-08-01T19:56:18.251 INFO:teuthology.orchestra.run.smithi008.stdout:op_tracker tracking is not enabled now, so no ops are tracked currently, even those get stuck. Please enable "osd_enable_op_tracker", and the tracker will start to track new ops received afterwards. 2023-08-01T19:56:18.262 DEBUG:teuthology.orchestra.run.smithi155:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 30 ceph --cluster ceph --admin-daemon /var/run/ceph/ceph-osd.2.asok dump_ops_in_flight 2023-08-01T19:56:18.302 INFO:tasks.ceph.osd.0.smithi008.stderr:2023-08-01T19:56:18.301+0000 7f16a58f4700 -1 received signal: Hangup from /usr/bin/python3 /bin/daemon-helper kill ceph-osd -f --cluster ceph -i 0 (PID: 111179) UID: 0 2023-08-01T19:56:18.401 INFO:tasks.ceph.osd.0.smithi008.stderr:2023-08-01T19:56:18.399+0000 7f16a58f4700 -1 received signal: Hangup from /usr/bin/python3 /bin/daemon-helper kill ceph-osd -f --cluster ceph -i 0 (PID: 111179) UID: 0 2023-08-01T19:56:18.422 INFO:teuthology.orchestra.run.smithi155.stdout:ERROR: (22) Invalid argument 2023-08-01T19:56:18.423 INFO:teuthology.orchestra.run.smithi155.stdout:op_tracker tracking is not enabled now, so no ops are tracked currently, even those get stuck. Please enable "osd_enable_op_tracker", and the tracker will start to track new ops received afterwards. 2023-08-01T19:56:18.436 DEBUG:teuthology.orchestra.run.smithi155:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 30 ceph --cluster ceph --admin-daemon /var/run/ceph/ceph-osd.2.asok dump_blocked_ops 2023-08-01T19:56:18.501 INFO:tasks.ceph.osd.0.smithi008.stderr:2023-08-01T19:56:18.500+0000 7f16a58f4700 -1 received signal: Hangup from /usr/bin/python3 /bin/daemon-helper kill ceph-osd -f --cluster ceph -i 0 (PID: 111179) UID: 0 2023-08-01T19:56:18.594 INFO:teuthology.orchestra.run.smithi155.stdout:ERROR: (22) Invalid argument 2023-08-01T19:56:18.594 INFO:teuthology.orchestra.run.smithi155.stdout:op_tracker tracking is not enabled now, so no ops are tracked currently, even those get stuck. Please enable "osd_enable_op_tracker", and the tracker will start to track new ops received afterwards. 2023-08-01T19:56:18.602 INFO:tasks.ceph.osd.2.smithi155.stderr:2023-08-01T19:56:18.601+0000 7faa5c6ac700 -1 received signal: Hangup from /usr/bin/python3 /bin/daemon-helper kill ceph-osd -f --cluster ceph -i 2 (PID: 111337) UID: 0 2023-08-01T19:56:18.607 DEBUG:teuthology.orchestra.run.smithi155:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 30 ceph --cluster ceph --admin-daemon /var/run/ceph/ceph-osd.2.asok dump_historic_ops 2023-08-01T19:56:18.703 INFO:tasks.ceph.osd.0.smithi008.stderr:2023-08-01T19:56:18.702+0000 7f16a58f4700 -1 received signal: Hangup from /usr/bin/python3 /bin/daemon-helper kill ceph-osd -f --cluster ceph -i 0 (PID: 111179) UID: 0 2023-08-01T19:56:18.804 INFO:tasks.ceph.osd.2.smithi155.stderr:2023-08-01T19:56:18.802+0000 7faa5c6ac700 -1 received signal: Hangup from /usr/bin/python3 /bin/daemon-helper kill ceph-osd -f --cluster ceph -i 2 (PID: 111337) UID: 0 2023-08-01T19:56:18.810 INFO:teuthology.orchestra.run.smithi155.stdout:ERROR: (22) Invalid argument 2023-08-01T19:56:18.810 INFO:teuthology.orchestra.run.smithi155.stdout:op_tracker tracking is not enabled now, so no ops are tracked currently, even those get stuck. Please enable "osd_enable_op_tracker", and the tracker will start to track new ops received afterwards. 2023-08-01T19:56:18.823 DEBUG:teuthology.orchestra.run.smithi008:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 30 ceph --cluster ceph --admin-daemon /var/run/ceph/ceph-osd.0.asok dump_ops_in_flight 2023-08-01T19:56:18.905 INFO:tasks.ceph.osd.2.smithi155.stderr:2023-08-01T19:56:18.903+0000 7faa5c6ac700 -1 received signal: Hangup from /usr/bin/python3 /bin/daemon-helper kill ceph-osd -f --cluster ceph -i 2 (PID: 111337) UID: 0 2023-08-01T19:56:19.005 INFO:tasks.ceph.osd.0.smithi008.stderr:2023-08-01T19:56:19.004+0000 7f16a58f4700 -1 received signal: Hangup from /usr/bin/python3 /bin/daemon-helper kill ceph-osd -f --cluster ceph -i 0 (PID: 111179) UID: 0 2023-08-01T19:56:19.017 INFO:teuthology.orchestra.run.smithi008.stdout:ERROR: (22) Invalid argument 2023-08-01T19:56:19.017 INFO:teuthology.orchestra.run.smithi008.stdout:op_tracker tracking is not enabled now, so no ops are tracked currently, even those get stuck. Please enable "osd_enable_op_tracker", and the tracker will start to track new ops received afterwards. 2023-08-01T19:56:19.031 DEBUG:teuthology.orchestra.run.smithi008:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 30 ceph --cluster ceph --admin-daemon /var/run/ceph/ceph-osd.0.asok dump_blocked_ops 2023-08-01T19:56:19.113 INFO:tasks.ceph.osd.0.smithi008.stderr:2023-08-01T19:56:19.112+0000 7f16a58f4700 -1 received signal: Hangup from /usr/bin/python3 /bin/daemon-helper kill ceph-osd -f --cluster ceph -i 0 (PID: 111179) UID: 0 2023-08-01T19:56:19.208 INFO:tasks.ceph.osd.2.smithi155.stderr:2023-08-01T19:56:19.206+0000 7faa5c6ac700 -1 received signal: Hangup from /usr/bin/python3 /bin/daemon-helper kill ceph-osd -f --cluster ceph -i 2 (PID: 111337) UID: 0 2023-08-01T19:56:19.255 INFO:teuthology.orchestra.run.smithi008.stdout:ERROR: (22) Invalid argument 2023-08-01T19:56:19.256 INFO:teuthology.orchestra.run.smithi008.stdout:op_tracker tracking is not enabled now, so no ops are tracked currently, even those get stuck. Please enable "osd_enable_op_tracker", and the tracker will start to track new ops received afterwards. 2023-08-01T19:56:19.267 DEBUG:teuthology.orchestra.run.smithi008:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 30 ceph --cluster ceph --admin-daemon /var/run/ceph/ceph-osd.0.asok dump_historic_ops 2023-08-01T19:56:19.309 INFO:tasks.ceph.osd.0.smithi008.stderr:2023-08-01T19:56:19.307+0000 7f16a58f4700 -1 received signal: Hangup from /usr/bin/python3 /bin/daemon-helper kill ceph-osd -f --cluster ceph -i 0 (PID: 111179) UID: 0 2023-08-01T19:56:19.410 INFO:tasks.ceph.osd.0.smithi008.stderr:2023-08-01T19:56:19.408+0000 7f16a58f4700 -1 received signal: Hangup from /usr/bin/python3 /bin/daemon-helper kill ceph-osd -f --cluster ceph -i 0 (PID: 111179) UID: 0 2023-08-01T19:56:19.488 INFO:teuthology.orchestra.run.smithi008.stdout:ERROR: (22) Invalid argument 2023-08-01T19:56:19.489 INFO:teuthology.orchestra.run.smithi008.stdout:op_tracker tracking is not enabled now, so no ops are tracked currently, even those get stuck. Please enable "osd_enable_op_tracker", and the tracker will start to track new ops received afterwards. 2023-08-01T19:56:19.503 DEBUG:teuthology.orchestra.run.smithi155:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 30 ceph --cluster ceph --admin-daemon /var/run/ceph/ceph-osd.2.asok dump_ops_in_flight 2023-08-01T19:56:19.527 DEBUG:teuthology.orchestra.run.smithi006:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 120 ceph --cluster ceph osd set noscrub 2023-08-01T19:56:19.543 INFO:tasks.ceph.osd.0.smithi008.stderr:2023-08-01T19:56:19.542+0000 7f16a58f4700 -1 received signal: Hangup from /usr/bin/python3 /bin/daemon-helper kill ceph-osd -f --cluster ceph -i 0 (PID: 111179) UID: 0 2023-08-01T19:56:19.550 DEBUG:teuthology.orchestra.run.smithi006:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 120 ceph --cluster ceph -- tell 'osd.*' injectargs --osd_enable_op_tracker=true 2023-08-01T19:56:19.611 INFO:tasks.ceph.osd.0.smithi008.stderr:2023-08-01T19:56:19.610+0000 7f16a58f4700 -1 received signal: Hangup from /usr/bin/python3 /bin/daemon-helper kill ceph-osd -f --cluster ceph -i 0 (PID: 111179) UID: 0 2023-08-01T19:56:19.675 INFO:teuthology.orchestra.run.smithi155.stdout:ERROR: (22) Invalid argument 2023-08-01T19:56:19.675 INFO:teuthology.orchestra.run.smithi155.stdout:op_tracker tracking is not enabled now, so no ops are tracked currently, even those get stuck. Please enable "osd_enable_op_tracker", and the tracker will start to track new ops received afterwards. 2023-08-01T19:56:19.688 DEBUG:teuthology.orchestra.run.smithi155:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 30 ceph --cluster ceph --admin-daemon /var/run/ceph/ceph-osd.2.asok dump_blocked_ops 2023-08-01T19:56:19.712 INFO:tasks.ceph.osd.0.smithi008.stderr:2023-08-01T19:56:19.711+0000 7f16a58f4700 -1 received signal: Hangup from /usr/bin/python3 /bin/daemon-helper kill ceph-osd -f --cluster ceph -i 0 (PID: 111179) UID: 0 2023-08-01T19:56:19.722 INFO:teuthology.orchestra.run.smithi006.stdout:osd.0: {} 2023-08-01T19:56:19.744 INFO:teuthology.orchestra.run.smithi006.stdout:osd.2: {} 2023-08-01T19:56:19.744 INFO:teuthology.orchestra.run.smithi006.stderr:osd.0: osd_enable_op_tracker = 'true' 2023-08-01T19:56:19.745 INFO:teuthology.orchestra.run.smithi006.stderr:Error ENXIO: problem getting command descriptions from osd.1 2023-08-01T19:56:19.745 INFO:teuthology.orchestra.run.smithi006.stderr:osd.2: osd_enable_op_tracker = 'true' 2023-08-01T19:56:19.747 DEBUG:teuthology.orchestra.run:got remote process result: 6 2023-08-01T19:56:19.747 INFO:tasks.thrashosds.thrasher:Failed to tell all osds, ignoring 2023-08-01T19:56:19.813 INFO:tasks.ceph.osd.0.smithi008.stderr:2023-08-01T19:56:19.811+0000 7f16a58f4700 -1 received signal: Hangup from /usr/bin/python3 /bin/daemon-helper kill ceph-osd -f --cluster ceph -i 0 (PID: 111179) UID: 0 2023-08-01T19:56:19.859 INFO:teuthology.orchestra.run.smithi155.stdout:{ 2023-08-01T19:56:19.859 INFO:teuthology.orchestra.run.smithi155.stdout: "ops": [], 2023-08-01T19:56:19.859 INFO:teuthology.orchestra.run.smithi155.stdout: "complaint_time": 30, 2023-08-01T19:56:19.860 INFO:teuthology.orchestra.run.smithi155.stdout: "num_blocked_ops": 0 2023-08-01T19:56:19.860 INFO:teuthology.orchestra.run.smithi155.stdout:} 2023-08-01T19:56:19.873 DEBUG:teuthology.orchestra.run.smithi155:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 30 ceph --cluster ceph --admin-daemon /var/run/ceph/ceph-osd.2.asok dump_historic_ops 2023-08-01T19:56:19.915 INFO:tasks.ceph.osd.0.smithi008.stderr:2023-08-01T19:56:19.914+0000 7f16a58f4700 -1 received signal: Hangup from /usr/bin/python3 /bin/daemon-helper kill ceph-osd -f --cluster ceph -i 0 (PID: 111179) UID: 0 2023-08-01T19:56:20.015 INFO:tasks.ceph.osd.0.smithi008.stderr:2023-08-01T19:56:20.013+0000 7f16a58f4700 -1 received signal: Hangup from /usr/bin/python3 /bin/daemon-helper kill ceph-osd -f --cluster ceph -i 0 (PID: 111179) UID: 0 2023-08-01T19:56:20.035 INFO:teuthology.orchestra.run.smithi155.stdout:{ 2023-08-01T19:56:20.035 INFO:teuthology.orchestra.run.smithi155.stdout: "size": 20, 2023-08-01T19:56:20.036 INFO:teuthology.orchestra.run.smithi155.stdout: "duration": 600, 2023-08-01T19:56:20.036 INFO:teuthology.orchestra.run.smithi155.stdout: "ops": [ 2023-08-01T19:56:20.036 INFO:teuthology.orchestra.run.smithi155.stdout: { 2023-08-01T19:56:20.036 INFO:teuthology.orchestra.run.smithi155.stdout: "description": "osd_op(client.4668.0:100237 5.4 5:2d68bec9:::benchmark_data_smithi006_114134_object100236:head [set-alloc-hint object_size 65536 write_size 65536,write 0~65536] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e37)", 2023-08-01T19:56:20.036 INFO:teuthology.orchestra.run.smithi155.stdout: "initiated_at": "2023-08-01T19:55:05.147736+0000", 2023-08-01T19:56:20.036 INFO:teuthology.orchestra.run.smithi155.stdout: "age": 74.885146046000003, 2023-08-01T19:56:20.036 INFO:teuthology.orchestra.run.smithi155.stdout: "duration": 0.071299464000000007, 2023-08-01T19:56:20.037 INFO:teuthology.orchestra.run.smithi155.stdout: "type_data": { 2023-08-01T19:56:20.037 INFO:teuthology.orchestra.run.smithi155.stdout: "flag_point": "commit sent; apply or cleanup", 2023-08-01T19:56:20.037 INFO:teuthology.orchestra.run.smithi155.stdout: "client_info": { 2023-08-01T19:56:20.037 INFO:teuthology.orchestra.run.smithi155.stdout: "client": "client.4668", 2023-08-01T19:56:20.037 INFO:teuthology.orchestra.run.smithi155.stdout: "client_addr": "172.21.15.6:0/1709472247", 2023-08-01T19:56:20.037 INFO:teuthology.orchestra.run.smithi155.stdout: "tid": 100237 2023-08-01T19:56:20.037 INFO:teuthology.orchestra.run.smithi155.stdout: }, 2023-08-01T19:56:20.037 INFO:teuthology.orchestra.run.smithi155.stdout: "events": [ 2023-08-01T19:56:20.038 INFO:teuthology.orchestra.run.smithi155.stdout: { 2023-08-01T19:56:20.038 INFO:teuthology.orchestra.run.smithi155.stdout: "event": "initiated", 2023-08-01T19:56:20.038 INFO:teuthology.orchestra.run.smithi155.stdout: "time": "2023-08-01T19:55:05.147736+0000", 2023-08-01T19:56:20.038 INFO:teuthology.orchestra.run.smithi155.stdout: "duration": 0 2023-08-01T19:56:20.038 INFO:teuthology.orchestra.run.smithi155.stdout: }, 2023-08-01T19:56:20.038 INFO:teuthology.orchestra.run.smithi155.stdout: { 2023-08-01T19:56:20.038 INFO:teuthology.orchestra.run.smithi155.stdout: "event": "throttled", 2023-08-01T19:56:20.038 INFO:teuthology.orchestra.run.smithi155.stdout: "time": "2023-08-01T19:55:05.147736+0000", 2023-08-01T19:56:20.039 INFO:teuthology.orchestra.run.smithi155.stdout: "duration": 0 2023-08-01T19:56:20.039 INFO:teuthology.orchestra.run.smithi155.stdout: }, 2023-08-01T19:56:20.039 INFO:teuthology.orchestra.run.smithi155.stdout: { 2023-08-01T19:56:20.039 INFO:teuthology.orchestra.run.smithi155.stdout: "event": "header_read", 2023-08-01T19:56:20.039 INFO:teuthology.orchestra.run.smithi155.stdout: "time": "2023-08-01T19:55:05.147736+0000", 2023-08-01T19:56:20.039 INFO:teuthology.orchestra.run.smithi155.stdout: "duration": 4294967295.9999995 2023-08-01T19:56:20.039 INFO:teuthology.orchestra.run.smithi155.stdout: }, 2023-08-01T19:56:20.039 INFO:teuthology.orchestra.run.smithi155.stdout: { 2023-08-01T19:56:20.040 INFO:teuthology.orchestra.run.smithi155.stdout: "event": "all_read", 2023-08-01T19:56:20.040 INFO:teuthology.orchestra.run.smithi155.stdout: "time": "2023-08-01T19:55:05.147766+0000", 2023-08-01T19:56:20.040 INFO:teuthology.orchestra.run.smithi155.stdout: "duration": 3.0394000000000001e-05 2023-08-01T19:56:20.040 INFO:teuthology.orchestra.run.smithi155.stdout: }, 2023-08-01T19:56:20.040 INFO:teuthology.orchestra.run.smithi155.stdout: { 2023-08-01T19:56:20.040 INFO:teuthology.orchestra.run.smithi155.stdout: "event": "dispatched", 2023-08-01T19:56:20.040 INFO:teuthology.orchestra.run.smithi155.stdout: "time": "2023-08-01T19:55:05.147771+0000", 2023-08-01T19:56:20.041 INFO:teuthology.orchestra.run.smithi155.stdout: "duration": 4.25e-06 2023-08-01T19:56:20.041 INFO:teuthology.orchestra.run.smithi155.stdout: }, 2023-08-01T19:56:20.041 INFO:teuthology.orchestra.run.smithi155.stdout: { 2023-08-01T19:56:20.041 INFO:teuthology.orchestra.run.smithi155.stdout: "event": "queued_for_pg", 2023-08-01T19:56:20.041 INFO:teuthology.orchestra.run.smithi155.stdout: "time": "2023-08-01T19:55:05.147773+0000", 2023-08-01T19:56:20.041 INFO:teuthology.orchestra.run.smithi155.stdout: "duration": 2.4159999999999998e-06 2023-08-01T19:56:20.041 INFO:teuthology.orchestra.run.smithi155.stdout: }, 2023-08-01T19:56:20.041 INFO:teuthology.orchestra.run.smithi155.stdout: { 2023-08-01T19:56:20.042 INFO:teuthology.orchestra.run.smithi155.stdout: "event": "reached_pg", 2023-08-01T19:56:20.042 INFO:teuthology.orchestra.run.smithi155.stdout: "time": "2023-08-01T19:55:05.149903+0000", 2023-08-01T19:56:20.042 INFO:teuthology.orchestra.run.smithi155.stdout: "duration": 0.002129948 2023-08-01T19:56:20.042 INFO:teuthology.orchestra.run.smithi155.stdout: }, 2023-08-01T19:56:20.042 INFO:teuthology.orchestra.run.smithi155.stdout: { 2023-08-01T19:56:20.042 INFO:teuthology.orchestra.run.smithi155.stdout: "event": "started", 2023-08-01T19:56:20.042 INFO:teuthology.orchestra.run.smithi155.stdout: "time": "2023-08-01T19:55:05.149982+0000", 2023-08-01T19:56:20.043 INFO:teuthology.orchestra.run.smithi155.stdout: "duration": 7.8706000000000002e-05 2023-08-01T19:56:20.043 INFO:teuthology.orchestra.run.smithi155.stdout: }, 2023-08-01T19:56:20.043 INFO:teuthology.orchestra.run.smithi155.stdout: { 2023-08-01T19:56:20.043 INFO:teuthology.orchestra.run.smithi155.stdout: "event": "waiting for subops from 0", 2023-08-01T19:56:20.043 INFO:teuthology.orchestra.run.smithi155.stdout: "time": "2023-08-01T19:55:05.150066+0000", 2023-08-01T19:56:20.043 INFO:teuthology.orchestra.run.smithi155.stdout: "duration": 8.4241999999999997e-05 2023-08-01T19:56:20.043 INFO:teuthology.orchestra.run.smithi155.stdout: }, 2023-08-01T19:56:20.043 INFO:teuthology.orchestra.run.smithi155.stdout: { 2023-08-01T19:56:20.044 INFO:teuthology.orchestra.run.smithi155.stdout: "event": "op_commit", 2023-08-01T19:56:20.044 INFO:teuthology.orchestra.run.smithi155.stdout: "time": "2023-08-01T19:55:05.154994+0000", 2023-08-01T19:56:20.044 INFO:teuthology.orchestra.run.smithi155.stdout: "duration": 0.0049277050000000001 2023-08-01T19:56:20.044 INFO:teuthology.orchestra.run.smithi155.stdout: }, 2023-08-01T19:56:20.044 INFO:teuthology.orchestra.run.smithi155.stdout: { 2023-08-01T19:56:20.044 INFO:teuthology.orchestra.run.smithi155.stdout: "event": "sub_op_commit_rec", 2023-08-01T19:56:20.044 INFO:teuthology.orchestra.run.smithi155.stdout: "time": "2023-08-01T19:55:05.218933+0000", 2023-08-01T19:56:20.045 INFO:teuthology.orchestra.run.smithi155.stdout: "duration": 0.063939916999999999 2023-08-01T19:56:20.045 INFO:teuthology.orchestra.run.smithi155.stdout: }, 2023-08-01T19:56:20.045 INFO:teuthology.orchestra.run.smithi155.stdout: { 2023-08-01T19:56:20.045 INFO:teuthology.orchestra.run.smithi155.stdout: "event": "commit_sent", 2023-08-01T19:56:20.045 INFO:teuthology.orchestra.run.smithi155.stdout: "time": "2023-08-01T19:55:05.218989+0000", 2023-08-01T19:56:20.045 INFO:teuthology.orchestra.run.smithi155.stdout: "duration": 5.5772000000000001e-05 2023-08-01T19:56:20.045 INFO:teuthology.orchestra.run.smithi155.stdout: }, 2023-08-01T19:56:20.045 INFO:teuthology.orchestra.run.smithi155.stdout: { 2023-08-01T19:56:20.046 INFO:teuthology.orchestra.run.smithi155.stdout: "event": "done", 2023-08-01T19:56:20.046 INFO:teuthology.orchestra.run.smithi155.stdout: "time": "2023-08-01T19:55:05.219036+0000", 2023-08-01T19:56:20.046 INFO:teuthology.orchestra.run.smithi155.stdout: "duration": 4.6526000000000001e-05 2023-08-01T19:56:20.046 INFO:teuthology.orchestra.run.smithi155.stdout: } 2023-08-01T19:56:20.046 INFO:teuthology.orchestra.run.smithi155.stdout: ] 2023-08-01T19:56:20.046 INFO:teuthology.orchestra.run.smithi155.stdout: } 2023-08-01T19:56:20.046 INFO:teuthology.orchestra.run.smithi155.stdout: }, 2023-08-01T19:56:20.047 INFO:teuthology.orchestra.run.smithi155.stdout: { 2023-08-01T19:56:20.047 INFO:teuthology.orchestra.run.smithi155.stdout: "description": "osd_op(client.4668.0:100242 5.8 5:16a314b8:::benchmark_data_smithi006_114134_object100241:head [set-alloc-hint object_size 65536 write_size 65536,write 0~65536] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e37)", 2023-08-01T19:56:20.047 INFO:teuthology.orchestra.run.smithi155.stdout: "initiated_at": "2023-08-01T19:55:05.150616+0000", 2023-08-01T19:56:20.047 INFO:teuthology.orchestra.run.smithi155.stdout: "age": 74.882266415999993, 2023-08-01T19:56:20.047 INFO:teuthology.orchestra.run.smithi155.stdout: "duration": 0.071105065999999995, 2023-08-01T19:56:20.047 INFO:teuthology.orchestra.run.smithi155.stdout: "type_data": { 2023-08-01T19:56:20.047 INFO:teuthology.orchestra.run.smithi155.stdout: "flag_point": "commit sent; apply or cleanup", 2023-08-01T19:56:20.047 INFO:teuthology.orchestra.run.smithi155.stdout: "client_info": { 2023-08-01T19:56:20.048 INFO:teuthology.orchestra.run.smithi155.stdout: "client": "client.4668", 2023-08-01T19:56:20.048 INFO:teuthology.orchestra.run.smithi155.stdout: "client_addr": "172.21.15.6:0/1709472247", 2023-08-01T19:56:20.048 INFO:teuthology.orchestra.run.smithi155.stdout: "tid": 100242 2023-08-01T19:56:20.048 INFO:teuthology.orchestra.run.smithi155.stdout: }, 2023-08-01T19:56:20.048 INFO:teuthology.orchestra.run.smithi155.stdout: "events": [ 2023-08-01T19:56:20.048 INFO:teuthology.orchestra.run.smithi155.stdout: { 2023-08-01T19:56:20.048 INFO:teuthology.orchestra.run.smithi155.stdout: "event": "initiated", 2023-08-01T19:56:20.048 INFO:teuthology.orchestra.run.smithi155.stdout: "time": "2023-08-01T19:55:05.150616+0000", 2023-08-01T19:56:20.049 INFO:teuthology.orchestra.run.smithi155.stdout: "duration": 0 2023-08-01T19:56:20.049 INFO:teuthology.orchestra.run.smithi155.stdout: }, 2023-08-01T19:56:20.049 INFO:teuthology.orchestra.run.smithi155.stdout: { 2023-08-01T19:56:20.049 INFO:teuthology.orchestra.run.smithi155.stdout: "event": "throttled", 2023-08-01T19:56:20.049 INFO:teuthology.orchestra.run.smithi155.stdout: "time": "2023-08-01T19:55:05.150616+0000", 2023-08-01T19:56:20.049 INFO:teuthology.orchestra.run.smithi155.stdout: "duration": 0 2023-08-01T19:56:20.049 INFO:teuthology.orchestra.run.smithi155.stdout: }, 2023-08-01T19:56:20.049 INFO:teuthology.orchestra.run.smithi155.stdout: { 2023-08-01T19:56:20.050 INFO:teuthology.orchestra.run.smithi155.stdout: "event": "header_read", 2023-08-01T19:56:20.050 INFO:teuthology.orchestra.run.smithi155.stdout: "time": "2023-08-01T19:55:05.150615+0000", 2023-08-01T19:56:20.050 INFO:teuthology.orchestra.run.smithi155.stdout: "duration": 4294967295.999999 2023-08-01T19:56:20.050 INFO:teuthology.orchestra.run.smithi155.stdout: }, 2023-08-01T19:56:20.050 INFO:teuthology.orchestra.run.smithi155.stdout: { 2023-08-01T19:56:20.050 INFO:teuthology.orchestra.run.smithi155.stdout: "event": "all_read", 2023-08-01T19:56:20.050 INFO:teuthology.orchestra.run.smithi155.stdout: "time": "2023-08-01T19:55:05.150696+0000", 2023-08-01T19:56:20.050 INFO:teuthology.orchestra.run.smithi155.stdout: "duration": 8.0852000000000004e-05 2023-08-01T19:56:20.051 INFO:teuthology.orchestra.run.smithi155.stdout: }, 2023-08-01T19:56:20.051 INFO:teuthology.orchestra.run.smithi155.stdout: { 2023-08-01T19:56:20.051 INFO:teuthology.orchestra.run.smithi155.stdout: "event": "dispatched", 2023-08-01T19:56:20.051 INFO:teuthology.orchestra.run.smithi155.stdout: "time": "2023-08-01T19:55:05.150708+0000", 2023-08-01T19:56:20.051 INFO:teuthology.orchestra.run.smithi155.stdout: "duration": 1.2116999999999999e-05 2023-08-01T19:56:20.051 INFO:teuthology.orchestra.run.smithi155.stdout: }, 2023-08-01T19:56:20.051 INFO:teuthology.orchestra.run.smithi155.stdout: { 2023-08-01T19:56:20.051 INFO:teuthology.orchestra.run.smithi155.stdout: "event": "queued_for_pg", 2023-08-01T19:56:20.052 INFO:teuthology.orchestra.run.smithi155.stdout: "time": "2023-08-01T19:55:05.150713+0000", 2023-08-01T19:56:20.052 INFO:teuthology.orchestra.run.smithi155.stdout: "duration": 5.4620000000000004e-06 2023-08-01T19:56:20.052 INFO:teuthology.orchestra.run.smithi155.stdout: }, 2023-08-01T19:56:20.052 INFO:teuthology.orchestra.run.smithi155.stdout: { 2023-08-01T19:56:20.052 INFO:teuthology.orchestra.run.smithi155.stdout: "event": "reached_pg", 2023-08-01T19:56:20.052 INFO:teuthology.orchestra.run.smithi155.stdout: "time": "2023-08-01T19:55:05.150761+0000", 2023-08-01T19:56:20.052 INFO:teuthology.orchestra.run.smithi155.stdout: "duration": 4.7429000000000003e-05 2023-08-01T19:56:20.053 INFO:teuthology.orchestra.run.smithi155.stdout: }, 2023-08-01T19:56:20.053 INFO:teuthology.orchestra.run.smithi155.stdout: { 2023-08-01T19:56:20.053 INFO:teuthology.orchestra.run.smithi155.stdout: "event": "started", 2023-08-01T19:56:20.053 INFO:teuthology.orchestra.run.smithi155.stdout: "time": "2023-08-01T19:55:05.150856+0000", 2023-08-01T19:56:20.053 INFO:teuthology.orchestra.run.smithi155.stdout: "duration": 9.5356e-05 2023-08-01T19:56:20.053 INFO:teuthology.orchestra.run.smithi155.stdout: }, 2023-08-01T19:56:20.053 INFO:teuthology.orchestra.run.smithi155.stdout: { 2023-08-01T19:56:20.053 INFO:teuthology.orchestra.run.smithi155.stdout: "event": "waiting for subops from 0", 2023-08-01T19:56:20.054 INFO:teuthology.orchestra.run.smithi155.stdout: "time": "2023-08-01T19:55:05.150999+0000", 2023-08-01T19:56:20.054 INFO:teuthology.orchestra.run.smithi155.stdout: "duration": 0.00014234499999999999 2023-08-01T19:56:20.054 INFO:teuthology.orchestra.run.smithi155.stdout: }, 2023-08-01T19:56:20.054 INFO:teuthology.orchestra.run.smithi155.stdout: { 2023-08-01T19:56:20.054 INFO:teuthology.orchestra.run.smithi155.stdout: "event": "sub_op_commit_rec", 2023-08-01T19:56:20.054 INFO:teuthology.orchestra.run.smithi155.stdout: "time": "2023-08-01T19:55:05.219001+0000", 2023-08-01T19:56:20.054 INFO:teuthology.orchestra.run.smithi155.stdout: "duration": 0.068002776000000001 2023-08-01T19:56:20.054 INFO:teuthology.orchestra.run.smithi155.stdout: }, 2023-08-01T19:56:20.055 INFO:teuthology.orchestra.run.smithi155.stdout: { 2023-08-01T19:56:20.055 INFO:teuthology.orchestra.run.smithi155.stdout: "event": "op_commit", 2023-08-01T19:56:20.055 INFO:teuthology.orchestra.run.smithi155.stdout: "time": "2023-08-01T19:55:05.221635+0000", 2023-08-01T19:56:20.055 INFO:teuthology.orchestra.run.smithi155.stdout: "duration": 0.0026340579999999999 2023-08-01T19:56:20.055 INFO:teuthology.orchestra.run.smithi155.stdout: }, 2023-08-01T19:56:20.055 INFO:teuthology.orchestra.run.smithi155.stdout: { 2023-08-01T19:56:20.055 INFO:teuthology.orchestra.run.smithi155.stdout: "event": "commit_sent", 2023-08-01T19:56:20.055 INFO:teuthology.orchestra.run.smithi155.stdout: "time": "2023-08-01T19:55:05.221682+0000", 2023-08-01T19:56:20.056 INFO:teuthology.orchestra.run.smithi155.stdout: "duration": 4.7123999999999998e-05 2023-08-01T19:56:20.056 INFO:teuthology.orchestra.run.smithi155.stdout: }, 2023-08-01T19:56:20.056 INFO:teuthology.orchestra.run.smithi155.stdout: { 2023-08-01T19:56:20.056 INFO:teuthology.orchestra.run.smithi155.stdout: "event": "done", 2023-08-01T19:56:20.056 INFO:teuthology.orchestra.run.smithi155.stdout: "time": "2023-08-01T19:55:05.221721+0000", 2023-08-01T19:56:20.056 INFO:teuthology.orchestra.run.smithi155.stdout: "duration": 3.8529999999999999e-05 2023-08-01T19:56:20.056 INFO:teuthology.orchestra.run.smithi155.stdout: } 2023-08-01T19:56:20.056 INFO:teuthology.orchestra.run.smithi155.stdout: ] 2023-08-01T19:56:20.057 INFO:teuthology.orchestra.run.smithi155.stdout: } 2023-08-01T19:56:20.057 INFO:teuthology.orchestra.run.smithi155.stdout: }, 2023-08-01T19:56:20.057 INFO:teuthology.orchestra.run.smithi155.stdout: { 2023-08-01T19:56:20.057 INFO:teuthology.orchestra.run.smithi155.stdout: "description": "osd_repop(client.4668.0:100240 5.a e37/19 5:5313c5b9:::benchmark_data_smithi006_114134_object100239:head v 37'6227, mlcod=37'6225)", 2023-08-01T19:56:20.057 INFO:teuthology.orchestra.run.smithi155.stdout: "initiated_at": "2023-08-01T19:55:05.150778+0000", 2023-08-01T19:56:20.057 INFO:teuthology.orchestra.run.smithi155.stdout: "age": 74.882104214999998, 2023-08-01T19:56:20.057 INFO:teuthology.orchestra.run.smithi155.stdout: "duration": 0.073362533999999993, 2023-08-01T19:56:20.057 INFO:teuthology.orchestra.run.smithi155.stdout: "type_data": { 2023-08-01T19:56:20.058 INFO:teuthology.orchestra.run.smithi155.stdout: "flag_point": "commit sent; apply or cleanup", 2023-08-01T19:56:20.058 INFO:teuthology.orchestra.run.smithi155.stdout: "events": [ 2023-08-01T19:56:20.058 INFO:teuthology.orchestra.run.smithi155.stdout: { 2023-08-01T19:56:20.058 INFO:teuthology.orchestra.run.smithi155.stdout: "event": "initiated", 2023-08-01T19:56:20.058 INFO:teuthology.orchestra.run.smithi155.stdout: "time": "2023-08-01T19:55:05.150778+0000", 2023-08-01T19:56:20.058 INFO:teuthology.orchestra.run.smithi155.stdout: "duration": 0 2023-08-01T19:56:20.058 INFO:teuthology.orchestra.run.smithi155.stdout: }, 2023-08-01T19:56:20.058 INFO:teuthology.orchestra.run.smithi155.stdout: { 2023-08-01T19:56:20.059 INFO:teuthology.orchestra.run.smithi155.stdout: "event": "throttled", 2023-08-01T19:56:20.059 INFO:teuthology.orchestra.run.smithi155.stdout: "time": "2023-08-01T19:55:05.150778+0000", 2023-08-01T19:56:20.059 INFO:teuthology.orchestra.run.smithi155.stdout: "duration": 0 2023-08-01T19:56:20.059 INFO:teuthology.orchestra.run.smithi155.stdout: }, 2023-08-01T19:56:20.059 INFO:teuthology.orchestra.run.smithi155.stdout: { 2023-08-01T19:56:20.059 INFO:teuthology.orchestra.run.smithi155.stdout: "event": "header_read", 2023-08-01T19:56:20.059 INFO:teuthology.orchestra.run.smithi155.stdout: "time": "2023-08-01T19:55:05.150778+0000", 2023-08-01T19:56:20.059 INFO:teuthology.orchestra.run.smithi155.stdout: "duration": 4294967295.9999995 2023-08-01T19:56:20.060 INFO:teuthology.orchestra.run.smithi155.stdout: }, 2023-08-01T19:56:20.060 INFO:teuthology.orchestra.run.smithi155.stdout: { 2023-08-01T19:56:20.060 INFO:teuthology.orchestra.run.smithi155.stdout: "event": "all_read", 2023-08-01T19:56:20.060 INFO:teuthology.orchestra.run.smithi155.stdout: "time": "2023-08-01T19:55:05.150811+0000", 2023-08-01T19:56:20.060 INFO:teuthology.orchestra.run.smithi155.stdout: "duration": 3.3664000000000002e-05 2023-08-01T19:56:20.060 INFO:teuthology.orchestra.run.smithi155.stdout: }, 2023-08-01T19:56:20.061 INFO:teuthology.orchestra.run.smithi155.stdout: { 2023-08-01T19:56:20.061 INFO:teuthology.orchestra.run.smithi155.stdout: "event": "dispatched", 2023-08-01T19:56:20.061 INFO:teuthology.orchestra.run.smithi155.stdout: "time": "2023-08-01T19:55:05.150818+0000", 2023-08-01T19:56:20.061 INFO:teuthology.orchestra.run.smithi155.stdout: "duration": 6.5769999999999999e-06 2023-08-01T19:56:20.061 INFO:teuthology.orchestra.run.smithi155.stdout: }, 2023-08-01T19:56:20.061 INFO:teuthology.orchestra.run.smithi155.stdout: { 2023-08-01T19:56:20.061 INFO:teuthology.orchestra.run.smithi155.stdout: "event": "queued_for_pg", 2023-08-01T19:56:20.061 INFO:teuthology.orchestra.run.smithi155.stdout: "time": "2023-08-01T19:55:05.150822+0000", 2023-08-01T19:56:20.062 INFO:teuthology.orchestra.run.smithi155.stdout: "duration": 4.0060000000000003e-06 2023-08-01T19:56:20.062 INFO:teuthology.orchestra.run.smithi155.stdout: }, 2023-08-01T19:56:20.062 INFO:teuthology.orchestra.run.smithi155.stdout: { 2023-08-01T19:56:20.062 INFO:teuthology.orchestra.run.smithi155.stdout: "event": "reached_pg", 2023-08-01T19:56:20.062 INFO:teuthology.orchestra.run.smithi155.stdout: "time": "2023-08-01T19:55:05.150855+0000", 2023-08-01T19:56:20.062 INFO:teuthology.orchestra.run.smithi155.stdout: "duration": 3.3204999999999998e-05 2023-08-01T19:56:20.062 INFO:teuthology.orchestra.run.smithi155.stdout: }, 2023-08-01T19:56:20.063 INFO:teuthology.orchestra.run.smithi155.stdout: { 2023-08-01T19:56:20.063 INFO:teuthology.orchestra.run.smithi155.stdout: "event": "started", 2023-08-01T19:56:20.063 INFO:teuthology.orchestra.run.smithi155.stdout: "time": "2023-08-01T19:55:05.150873+0000", 2023-08-01T19:56:20.063 INFO:teuthology.orchestra.run.smithi155.stdout: "duration": 1.8139999999999999e-05 2023-08-01T19:56:20.063 INFO:teuthology.orchestra.run.smithi155.stdout: }, 2023-08-01T19:56:20.063 INFO:teuthology.orchestra.run.smithi155.stdout: { 2023-08-01T19:56:20.063 INFO:teuthology.orchestra.run.smithi155.stdout: "event": "commit_sent", 2023-08-01T19:56:20.063 INFO:teuthology.orchestra.run.smithi155.stdout: "time": "2023-08-01T19:55:05.224095+0000", 2023-08-01T19:56:20.064 INFO:teuthology.orchestra.run.smithi155.stdout: "duration": 0.073221895999999995 2023-08-01T19:56:20.064 INFO:teuthology.orchestra.run.smithi155.stdout: }, 2023-08-01T19:56:20.064 INFO:teuthology.orchestra.run.smithi155.stdout: { 2023-08-01T19:56:20.064 INFO:teuthology.orchestra.run.smithi155.stdout: "event": "done", 2023-08-01T19:56:20.064 INFO:teuthology.orchestra.run.smithi155.stdout: "time": "2023-08-01T19:55:05.224141+0000", 2023-08-01T19:56:20.064 INFO:teuthology.orchestra.run.smithi155.stdout: "duration": 4.5385e-05 2023-08-01T19:56:20.064 INFO:teuthology.orchestra.run.smithi155.stdout: } 2023-08-01T19:56:20.064 INFO:teuthology.orchestra.run.smithi155.stdout: ] 2023-08-01T19:56:20.065 INFO:teuthology.orchestra.run.smithi155.stdout: } 2023-08-01T19:56:20.065 INFO:teuthology.orchestra.run.smithi155.stdout: }, 2023-08-01T19:56:20.065 INFO:teuthology.orchestra.run.smithi155.stdout: { 2023-08-01T19:56:20.065 INFO:teuthology.orchestra.run.smithi155.stdout: "description": "osd_op(client.4668.0:100245 5.e 5:71869c66:::benchmark_data_smithi006_114134_object100244:head [set-alloc-hint object_size 65536 write_size 65536,write 0~65536] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e37)", 2023-08-01T19:56:20.065 INFO:teuthology.orchestra.run.smithi155.stdout: "initiated_at": "2023-08-01T19:55:05.150991+0000", 2023-08-01T19:56:20.065 INFO:teuthology.orchestra.run.smithi155.stdout: "age": 74.881891428000003, 2023-08-01T19:56:20.065 INFO:teuthology.orchestra.run.smithi155.stdout: "duration": 0.070734490999999997, 2023-08-01T19:56:20.066 INFO:teuthology.orchestra.run.smithi155.stdout: "type_data": { 2023-08-01T19:56:20.066 INFO:teuthology.orchestra.run.smithi155.stdout: "flag_point": "commit sent; apply or cleanup", 2023-08-01T19:56:20.066 INFO:teuthology.orchestra.run.smithi155.stdout: "client_info": { 2023-08-01T19:56:20.066 INFO:teuthology.orchestra.run.smithi155.stdout: "client": "client.4668", 2023-08-01T19:56:20.066 INFO:teuthology.orchestra.run.smithi155.stdout: "client_addr": "172.21.15.6:0/1709472247", 2023-08-01T19:56:20.066 INFO:teuthology.orchestra.run.smithi155.stdout: "tid": 100245 2023-08-01T19:56:20.066 INFO:teuthology.orchestra.run.smithi155.stdout: }, 2023-08-01T19:56:20.067 INFO:teuthology.orchestra.run.smithi155.stdout: "events": [ 2023-08-01T19:56:20.067 INFO:teuthology.orchestra.run.smithi155.stdout: { 2023-08-01T19:56:20.067 INFO:teuthology.orchestra.run.smithi155.stdout: "event": "initiated", 2023-08-01T19:56:20.067 INFO:teuthology.orchestra.run.smithi155.stdout: "time": "2023-08-01T19:55:05.150991+0000", 2023-08-01T19:56:20.067 INFO:teuthology.orchestra.run.smithi155.stdout: "duration": 0 2023-08-01T19:56:20.067 INFO:teuthology.orchestra.run.smithi155.stdout: }, 2023-08-01T19:56:20.067 INFO:teuthology.orchestra.run.smithi155.stdout: { 2023-08-01T19:56:20.067 INFO:teuthology.orchestra.run.smithi155.stdout: "event": "throttled", 2023-08-01T19:56:20.068 INFO:teuthology.orchestra.run.smithi155.stdout: "time": "2023-08-01T19:55:05.150991+0000", 2023-08-01T19:56:20.068 INFO:teuthology.orchestra.run.smithi155.stdout: "duration": 0 2023-08-01T19:56:20.068 INFO:teuthology.orchestra.run.smithi155.stdout: }, 2023-08-01T19:56:20.068 INFO:teuthology.orchestra.run.smithi155.stdout: { 2023-08-01T19:56:20.068 INFO:teuthology.orchestra.run.smithi155.stdout: "event": "header_read", 2023-08-01T19:56:20.068 INFO:teuthology.orchestra.run.smithi155.stdout: "time": "2023-08-01T19:55:05.150990+0000", 2023-08-01T19:56:20.068 INFO:teuthology.orchestra.run.smithi155.stdout: "duration": 4294967295.999999 2023-08-01T19:56:20.069 INFO:teuthology.orchestra.run.smithi155.stdout: }, 2023-08-01T19:56:20.069 INFO:teuthology.orchestra.run.smithi155.stdout: { 2023-08-01T19:56:20.069 INFO:teuthology.orchestra.run.smithi155.stdout: "event": "all_read", 2023-08-01T19:56:20.069 INFO:teuthology.orchestra.run.smithi155.stdout: "time": "2023-08-01T19:55:05.151108+0000", 2023-08-01T19:56:20.069 INFO:teuthology.orchestra.run.smithi155.stdout: "duration": 0.00011849300000000001 2023-08-01T19:56:20.069 INFO:teuthology.orchestra.run.smithi155.stdout: }, 2023-08-01T19:56:20.069 INFO:teuthology.orchestra.run.smithi155.stdout: { 2023-08-01T19:56:20.070 INFO:teuthology.orchestra.run.smithi155.stdout: "event": "dispatched", 2023-08-01T19:56:20.070 INFO:teuthology.orchestra.run.smithi155.stdout: "time": "2023-08-01T19:55:05.151117+0000", 2023-08-01T19:56:20.070 INFO:teuthology.orchestra.run.smithi155.stdout: "duration": 8.1040000000000007e-06 2023-08-01T19:56:20.070 INFO:teuthology.orchestra.run.smithi155.stdout: }, 2023-08-01T19:56:20.070 INFO:teuthology.orchestra.run.smithi155.stdout: { 2023-08-01T19:56:20.070 INFO:teuthology.orchestra.run.smithi155.stdout: "event": "queued_for_pg", 2023-08-01T19:56:20.070 INFO:teuthology.orchestra.run.smithi155.stdout: "time": "2023-08-01T19:55:05.151121+0000", 2023-08-01T19:56:20.070 INFO:teuthology.orchestra.run.smithi155.stdout: "duration": 4.2019999999999997e-06 2023-08-01T19:56:20.071 INFO:teuthology.orchestra.run.smithi155.stdout: }, 2023-08-01T19:56:20.071 INFO:teuthology.orchestra.run.smithi155.stdout: { 2023-08-01T19:56:20.071 INFO:teuthology.orchestra.run.smithi155.stdout: "event": "reached_pg", 2023-08-01T19:56:20.071 INFO:teuthology.orchestra.run.smithi155.stdout: "time": "2023-08-01T19:55:05.151162+0000", 2023-08-01T19:56:20.071 INFO:teuthology.orchestra.run.smithi155.stdout: "duration": 4.1448e-05 2023-08-01T19:56:20.071 INFO:teuthology.orchestra.run.smithi155.stdout: }, 2023-08-01T19:56:20.071 INFO:teuthology.orchestra.run.smithi155.stdout: { 2023-08-01T19:56:20.071 INFO:teuthology.orchestra.run.smithi155.stdout: "event": "started", 2023-08-01T19:56:20.072 INFO:teuthology.orchestra.run.smithi155.stdout: "time": "2023-08-01T19:55:05.151281+0000", 2023-08-01T19:56:20.072 INFO:teuthology.orchestra.run.smithi155.stdout: "duration": 0.000119141 2023-08-01T19:56:20.072 INFO:teuthology.orchestra.run.smithi155.stdout: }, 2023-08-01T19:56:20.072 INFO:teuthology.orchestra.run.smithi155.stdout: { 2023-08-01T19:56:20.072 INFO:teuthology.orchestra.run.smithi155.stdout: "event": "waiting for subops from 0", 2023-08-01T19:56:20.072 INFO:teuthology.orchestra.run.smithi155.stdout: "time": "2023-08-01T19:55:05.151443+0000", 2023-08-01T19:56:20.072 INFO:teuthology.orchestra.run.smithi155.stdout: "duration": 0.00016181600000000001 2023-08-01T19:56:20.072 INFO:teuthology.orchestra.run.smithi155.stdout: }, 2023-08-01T19:56:20.073 INFO:teuthology.orchestra.run.smithi155.stdout: { 2023-08-01T19:56:20.073 INFO:teuthology.orchestra.run.smithi155.stdout: "event": "sub_op_commit_rec", 2023-08-01T19:56:20.073 INFO:teuthology.orchestra.run.smithi155.stdout: "time": "2023-08-01T19:55:05.219101+0000", 2023-08-01T19:56:20.073 INFO:teuthology.orchestra.run.smithi155.stdout: "duration": 0.067658037000000004 2023-08-01T19:56:20.073 INFO:teuthology.orchestra.run.smithi155.stdout: }, 2023-08-01T19:56:20.073 INFO:teuthology.orchestra.run.smithi155.stdout: { 2023-08-01T19:56:20.073 INFO:teuthology.orchestra.run.smithi155.stdout: "event": "op_commit", 2023-08-01T19:56:20.074 INFO:teuthology.orchestra.run.smithi155.stdout: "time": "2023-08-01T19:55:05.221646+0000", 2023-08-01T19:56:20.074 INFO:teuthology.orchestra.run.smithi155.stdout: "duration": 0.0025450540000000002 2023-08-01T19:56:20.074 INFO:teuthology.orchestra.run.smithi155.stdout: }, 2023-08-01T19:56:20.074 INFO:teuthology.orchestra.run.smithi155.stdout: { 2023-08-01T19:56:20.074 INFO:teuthology.orchestra.run.smithi155.stdout: "event": "commit_sent", 2023-08-01T19:56:20.074 INFO:teuthology.orchestra.run.smithi155.stdout: "time": "2023-08-01T19:55:05.221689+0000", 2023-08-01T19:56:20.074 INFO:teuthology.orchestra.run.smithi155.stdout: "duration": 4.3078999999999999e-05 2023-08-01T19:56:20.074 INFO:teuthology.orchestra.run.smithi155.stdout: }, 2023-08-01T19:56:20.075 INFO:teuthology.orchestra.run.smithi155.stdout: { 2023-08-01T19:56:20.075 INFO:teuthology.orchestra.run.smithi155.stdout: "event": "done", 2023-08-01T19:56:20.075 INFO:teuthology.orchestra.run.smithi155.stdout: "time": "2023-08-01T19:55:05.221725+0000", 2023-08-01T19:56:20.075 INFO:teuthology.orchestra.run.smithi155.stdout: "duration": 3.6137999999999999e-05 2023-08-01T19:56:20.075 INFO:teuthology.orchestra.run.smithi155.stdout: } 2023-08-01T19:56:20.075 INFO:teuthology.orchestra.run.smithi155.stdout: ] 2023-08-01T19:56:20.075 INFO:teuthology.orchestra.run.smithi155.stdout: } 2023-08-01T19:56:20.075 INFO:teuthology.orchestra.run.smithi155.stdout: }, 2023-08-01T19:56:20.076 INFO:teuthology.orchestra.run.smithi155.stdout: { 2023-08-01T19:56:20.076 INFO:teuthology.orchestra.run.smithi155.stdout: "description": "osd_repop(client.4668.0:100243 5.a e37/19 5:5e8193b6:::benchmark_data_smithi006_114134_object100242:head v 37'6228, mlcod=37'6225)", 2023-08-01T19:56:20.076 INFO:teuthology.orchestra.run.smithi155.stdout: "initiated_at": "2023-08-01T19:55:05.151148+0000", 2023-08-01T19:56:20.076 INFO:teuthology.orchestra.run.smithi155.stdout: "age": 74.881734417000004, 2023-08-01T19:56:20.076 INFO:teuthology.orchestra.run.smithi155.stdout: "duration": 0.073020370000000001, 2023-08-01T19:56:20.076 INFO:teuthology.orchestra.run.smithi155.stdout: "type_data": { 2023-08-01T19:56:20.076 INFO:teuthology.orchestra.run.smithi155.stdout: "flag_point": "commit sent; apply or cleanup", 2023-08-01T19:56:20.076 INFO:teuthology.orchestra.run.smithi155.stdout: "events": [ 2023-08-01T19:56:20.077 INFO:teuthology.orchestra.run.smithi155.stdout: { 2023-08-01T19:56:20.077 INFO:teuthology.orchestra.run.smithi155.stdout: "event": "initiated", 2023-08-01T19:56:20.077 INFO:teuthology.orchestra.run.smithi155.stdout: "time": "2023-08-01T19:55:05.151148+0000", 2023-08-01T19:56:20.077 INFO:teuthology.orchestra.run.smithi155.stdout: "duration": 0 2023-08-01T19:56:20.077 INFO:teuthology.orchestra.run.smithi155.stdout: }, 2023-08-01T19:56:20.077 INFO:teuthology.orchestra.run.smithi155.stdout: { 2023-08-01T19:56:20.077 INFO:teuthology.orchestra.run.smithi155.stdout: "event": "throttled", 2023-08-01T19:56:20.078 INFO:teuthology.orchestra.run.smithi155.stdout: "time": "2023-08-01T19:55:05.151148+0000", 2023-08-01T19:56:20.078 INFO:teuthology.orchestra.run.smithi155.stdout: "duration": 0 2023-08-01T19:56:20.078 INFO:teuthology.orchestra.run.smithi155.stdout: }, 2023-08-01T19:56:20.078 INFO:teuthology.orchestra.run.smithi155.stdout: { 2023-08-01T19:56:20.078 INFO:teuthology.orchestra.run.smithi155.stdout: "event": "header_read", 2023-08-01T19:56:20.078 INFO:teuthology.orchestra.run.smithi155.stdout: "time": "2023-08-01T19:55:05.151147+0000", 2023-08-01T19:56:20.078 INFO:teuthology.orchestra.run.smithi155.stdout: "duration": 4294967295.9999995 2023-08-01T19:56:20.078 INFO:teuthology.orchestra.run.smithi155.stdout: }, 2023-08-01T19:56:20.079 INFO:teuthology.orchestra.run.smithi155.stdout: { 2023-08-01T19:56:20.079 INFO:teuthology.orchestra.run.smithi155.stdout: "event": "all_read", 2023-08-01T19:56:20.079 INFO:teuthology.orchestra.run.smithi155.stdout: "time": "2023-08-01T19:55:05.151231+0000", 2023-08-01T19:56:20.079 INFO:teuthology.orchestra.run.smithi155.stdout: "duration": 8.3135999999999998e-05 2023-08-01T19:56:20.079 INFO:teuthology.orchestra.run.smithi155.stdout: }, 2023-08-01T19:56:20.079 INFO:teuthology.orchestra.run.smithi155.stdout: { 2023-08-01T19:56:20.079 INFO:teuthology.orchestra.run.smithi155.stdout: "event": "dispatched", 2023-08-01T19:56:20.079 INFO:teuthology.orchestra.run.smithi155.stdout: "time": "2023-08-01T19:55:05.151239+0000", 2023-08-01T19:56:20.080 INFO:teuthology.orchestra.run.smithi155.stdout: "duration": 8.7469999999999994e-06 2023-08-01T19:56:20.080 INFO:teuthology.orchestra.run.smithi155.stdout: }, 2023-08-01T19:56:20.080 INFO:teuthology.orchestra.run.smithi155.stdout: { 2023-08-01T19:56:20.080 INFO:teuthology.orchestra.run.smithi155.stdout: "event": "queued_for_pg", 2023-08-01T19:56:20.080 INFO:teuthology.orchestra.run.smithi155.stdout: "time": "2023-08-01T19:55:05.151244+0000", 2023-08-01T19:56:20.080 INFO:teuthology.orchestra.run.smithi155.stdout: "duration": 4.4800000000000003e-06 2023-08-01T19:56:20.080 INFO:teuthology.orchestra.run.smithi155.stdout: }, 2023-08-01T19:56:20.081 INFO:teuthology.orchestra.run.smithi155.stdout: { 2023-08-01T19:56:20.081 INFO:teuthology.orchestra.run.smithi155.stdout: "event": "reached_pg", 2023-08-01T19:56:20.081 INFO:teuthology.orchestra.run.smithi155.stdout: "time": "2023-08-01T19:55:05.152938+0000", 2023-08-01T19:56:20.081 INFO:teuthology.orchestra.run.smithi155.stdout: "duration": 0.001693824 2023-08-01T19:56:20.081 INFO:teuthology.orchestra.run.smithi155.stdout: }, 2023-08-01T19:56:20.081 INFO:teuthology.orchestra.run.smithi155.stdout: { 2023-08-01T19:56:20.081 INFO:teuthology.orchestra.run.smithi155.stdout: "event": "started", 2023-08-01T19:56:20.081 INFO:teuthology.orchestra.run.smithi155.stdout: "time": "2023-08-01T19:55:05.152956+0000", 2023-08-01T19:56:20.082 INFO:teuthology.orchestra.run.smithi155.stdout: "duration": 1.8287e-05 2023-08-01T19:56:20.082 INFO:teuthology.orchestra.run.smithi155.stdout: }, 2023-08-01T19:56:20.082 INFO:teuthology.orchestra.run.smithi155.stdout: { 2023-08-01T19:56:20.082 INFO:teuthology.orchestra.run.smithi155.stdout: "event": "commit_sent", 2023-08-01T19:56:20.082 INFO:teuthology.orchestra.run.smithi155.stdout: "time": "2023-08-01T19:55:05.224145+0000", 2023-08-01T19:56:20.082 INFO:teuthology.orchestra.run.smithi155.stdout: "duration": 0.071189447000000003 2023-08-01T19:56:20.082 INFO:teuthology.orchestra.run.smithi155.stdout: }, 2023-08-01T19:56:20.083 INFO:teuthology.orchestra.run.smithi155.stdout: { 2023-08-01T19:56:20.083 INFO:teuthology.orchestra.run.smithi155.stdout: "event": "done", 2023-08-01T19:56:20.083 INFO:teuthology.orchestra.run.smithi155.stdout: "time": "2023-08-01T19:55:05.224168+0000", 2023-08-01T19:56:20.083 INFO:teuthology.orchestra.run.smithi155.stdout: "duration": 2.3008999999999999e-05 2023-08-01T19:56:20.083 INFO:teuthology.orchestra.run.smithi155.stdout: } 2023-08-01T19:56:20.083 INFO:teuthology.orchestra.run.smithi155.stdout: ] 2023-08-01T19:56:20.083 INFO:teuthology.orchestra.run.smithi155.stdout: } 2023-08-01T19:56:20.083 INFO:teuthology.orchestra.run.smithi155.stdout: }, 2023-08-01T19:56:20.084 INFO:teuthology.orchestra.run.smithi155.stdout: { 2023-08-01T19:56:20.084 INFO:teuthology.orchestra.run.smithi155.stdout: "description": "osd_repop(client.4668.0:100244 5.9 e37/19 5:92f56a12:::benchmark_data_smithi006_114134_object100243:head v 37'6294, mlcod=37'6292)", 2023-08-01T19:56:20.084 INFO:teuthology.orchestra.run.smithi155.stdout: "initiated_at": "2023-08-01T19:55:05.151325+0000", 2023-08-01T19:56:20.084 INFO:teuthology.orchestra.run.smithi155.stdout: "age": 74.881557072000007, 2023-08-01T19:56:20.084 INFO:teuthology.orchestra.run.smithi155.stdout: "duration": 0.071883673999999995, 2023-08-01T19:56:20.084 INFO:teuthology.orchestra.run.smithi155.stdout: "type_data": { 2023-08-01T19:56:20.084 INFO:teuthology.orchestra.run.smithi155.stdout: "flag_point": "commit sent; apply or cleanup", 2023-08-01T19:56:20.084 INFO:teuthology.orchestra.run.smithi155.stdout: "events": [ 2023-08-01T19:56:20.085 INFO:teuthology.orchestra.run.smithi155.stdout: { 2023-08-01T19:56:20.085 INFO:teuthology.orchestra.run.smithi155.stdout: "event": "initiated", 2023-08-01T19:56:20.085 INFO:teuthology.orchestra.run.smithi155.stdout: "time": "2023-08-01T19:55:05.151325+0000", 2023-08-01T19:56:20.085 INFO:teuthology.orchestra.run.smithi155.stdout: "duration": 0 2023-08-01T19:56:20.085 INFO:teuthology.orchestra.run.smithi155.stdout: }, 2023-08-01T19:56:20.085 INFO:teuthology.orchestra.run.smithi155.stdout: { 2023-08-01T19:56:20.085 INFO:teuthology.orchestra.run.smithi155.stdout: "event": "throttled", 2023-08-01T19:56:20.086 INFO:teuthology.orchestra.run.smithi155.stdout: "time": "2023-08-01T19:55:05.151325+0000", 2023-08-01T19:56:20.086 INFO:teuthology.orchestra.run.smithi155.stdout: "duration": 0 2023-08-01T19:56:20.086 INFO:teuthology.orchestra.run.smithi155.stdout: }, 2023-08-01T19:56:20.086 INFO:teuthology.orchestra.run.smithi155.stdout: { 2023-08-01T19:56:20.086 INFO:teuthology.orchestra.run.smithi155.stdout: "event": "header_read", 2023-08-01T19:56:20.086 INFO:teuthology.orchestra.run.smithi155.stdout: "time": "2023-08-01T19:55:05.151325+0000", 2023-08-01T19:56:20.086 INFO:teuthology.orchestra.run.smithi155.stdout: "duration": 4294967295.9999995 2023-08-01T19:56:20.086 INFO:teuthology.orchestra.run.smithi155.stdout: }, 2023-08-01T19:56:20.087 INFO:teuthology.orchestra.run.smithi155.stdout: { 2023-08-01T19:56:20.087 INFO:teuthology.orchestra.run.smithi155.stdout: "event": "all_read", 2023-08-01T19:56:20.087 INFO:teuthology.orchestra.run.smithi155.stdout: "time": "2023-08-01T19:55:05.151390+0000", 2023-08-01T19:56:20.087 INFO:teuthology.orchestra.run.smithi155.stdout: "duration": 6.5456999999999993e-05 2023-08-01T19:56:20.087 INFO:teuthology.orchestra.run.smithi155.stdout: }, 2023-08-01T19:56:20.087 INFO:teuthology.orchestra.run.smithi155.stdout: { 2023-08-01T19:56:20.087 INFO:teuthology.orchestra.run.smithi155.stdout: "event": "dispatched", 2023-08-01T19:56:20.087 INFO:teuthology.orchestra.run.smithi155.stdout: "time": "2023-08-01T19:55:05.151396+0000", 2023-08-01T19:56:20.088 INFO:teuthology.orchestra.run.smithi155.stdout: "duration": 5.9190000000000004e-06 2023-08-01T19:56:20.088 INFO:teuthology.orchestra.run.smithi155.stdout: }, 2023-08-01T19:56:20.088 INFO:teuthology.orchestra.run.smithi155.stdout: { 2023-08-01T19:56:20.088 INFO:teuthology.orchestra.run.smithi155.stdout: "event": "queued_for_pg", 2023-08-01T19:56:20.088 INFO:teuthology.orchestra.run.smithi155.stdout: "time": "2023-08-01T19:55:05.151400+0000", 2023-08-01T19:56:20.088 INFO:teuthology.orchestra.run.smithi155.stdout: "duration": 4.1030000000000004e-06 2023-08-01T19:56:20.088 INFO:teuthology.orchestra.run.smithi155.stdout: }, 2023-08-01T19:56:20.088 INFO:teuthology.orchestra.run.smithi155.stdout: { 2023-08-01T19:56:20.089 INFO:teuthology.orchestra.run.smithi155.stdout: "event": "reached_pg", 2023-08-01T19:56:20.089 INFO:teuthology.orchestra.run.smithi155.stdout: "time": "2023-08-01T19:55:05.151452+0000", 2023-08-01T19:56:20.089 INFO:teuthology.orchestra.run.smithi155.stdout: "duration": 5.2136999999999999e-05 2023-08-01T19:56:20.089 INFO:teuthology.orchestra.run.smithi155.stdout: }, 2023-08-01T19:56:20.090 INFO:teuthology.orchestra.run.smithi155.stdout: { 2023-08-01T19:56:20.090 INFO:teuthology.orchestra.run.smithi155.stdout: "event": "started", 2023-08-01T19:56:20.090 INFO:teuthology.orchestra.run.smithi155.stdout: "time": "2023-08-01T19:55:05.151470+0000", 2023-08-01T19:56:20.090 INFO:teuthology.orchestra.run.smithi155.stdout: "duration": 1.8e-05 2023-08-01T19:56:20.090 INFO:teuthology.orchestra.run.smithi155.stdout: }, 2023-08-01T19:56:20.090 INFO:teuthology.orchestra.run.smithi155.stdout: { 2023-08-01T19:56:20.090 INFO:teuthology.orchestra.run.smithi155.stdout: "event": "commit_sent", 2023-08-01T19:56:20.091 INFO:teuthology.orchestra.run.smithi155.stdout: "time": "2023-08-01T19:55:05.223183+0000", 2023-08-01T19:56:20.091 INFO:teuthology.orchestra.run.smithi155.stdout: "duration": 0.071712622000000004 2023-08-01T19:56:20.091 INFO:teuthology.orchestra.run.smithi155.stdout: }, 2023-08-01T19:56:20.091 INFO:teuthology.orchestra.run.smithi155.stdout: { 2023-08-01T19:56:20.091 INFO:teuthology.orchestra.run.smithi155.stdout: "event": "done", 2023-08-01T19:56:20.091 INFO:teuthology.orchestra.run.smithi155.stdout: "time": "2023-08-01T19:55:05.223209+0000", 2023-08-01T19:56:20.091 INFO:teuthology.orchestra.run.smithi155.stdout: "duration": 2.5956e-05 2023-08-01T19:56:20.091 INFO:teuthology.orchestra.run.smithi155.stdout: } 2023-08-01T19:56:20.092 INFO:teuthology.orchestra.run.smithi155.stdout: ] 2023-08-01T19:56:20.092 INFO:teuthology.orchestra.run.smithi155.stdout: } 2023-08-01T19:56:20.092 INFO:teuthology.orchestra.run.smithi155.stdout: }, 2023-08-01T19:56:20.092 INFO:teuthology.orchestra.run.smithi155.stdout: { 2023-08-01T19:56:20.092 INFO:teuthology.orchestra.run.smithi155.stdout: "description": "osd_op(client.4668.0:100249 5.b 5:d0666827:::benchmark_data_smithi006_114134_object100248:head [set-alloc-hint object_size 65536 write_size 65536,write 0~65536] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e37)", 2023-08-01T19:56:20.092 INFO:teuthology.orchestra.run.smithi155.stdout: "initiated_at": "2023-08-01T19:55:05.153614+0000", 2023-08-01T19:56:20.092 INFO:teuthology.orchestra.run.smithi155.stdout: "age": 74.879268647000004, 2023-08-01T19:56:20.093 INFO:teuthology.orchestra.run.smithi155.stdout: "duration": 0.069286118999999993, 2023-08-01T19:56:20.093 INFO:teuthology.orchestra.run.smithi155.stdout: "type_data": { 2023-08-01T19:56:20.093 INFO:teuthology.orchestra.run.smithi155.stdout: "flag_point": "commit sent; apply or cleanup", 2023-08-01T19:56:20.093 INFO:teuthology.orchestra.run.smithi155.stdout: "client_info": { 2023-08-01T19:56:20.093 INFO:teuthology.orchestra.run.smithi155.stdout: "client": "client.4668", 2023-08-01T19:56:20.093 INFO:teuthology.orchestra.run.smithi155.stdout: "client_addr": "172.21.15.6:0/1709472247", 2023-08-01T19:56:20.094 INFO:teuthology.orchestra.run.smithi155.stdout: "tid": 100249 2023-08-01T19:56:20.094 INFO:teuthology.orchestra.run.smithi155.stdout: }, 2023-08-01T19:56:20.094 INFO:teuthology.orchestra.run.smithi155.stdout: "events": [ 2023-08-01T19:56:20.094 INFO:teuthology.orchestra.run.smithi155.stdout: { 2023-08-01T19:56:20.094 INFO:teuthology.orchestra.run.smithi155.stdout: "event": "initiated", 2023-08-01T19:56:20.094 INFO:teuthology.orchestra.run.smithi155.stdout: "time": "2023-08-01T19:55:05.153614+0000", 2023-08-01T19:56:20.094 INFO:teuthology.orchestra.run.smithi155.stdout: "duration": 0 2023-08-01T19:56:20.095 INFO:teuthology.orchestra.run.smithi155.stdout: }, 2023-08-01T19:56:20.095 INFO:teuthology.orchestra.run.smithi155.stdout: { 2023-08-01T19:56:20.095 INFO:teuthology.orchestra.run.smithi155.stdout: "event": "throttled", 2023-08-01T19:56:20.095 INFO:teuthology.orchestra.run.smithi155.stdout: "time": "2023-08-01T19:55:05.153614+0000", 2023-08-01T19:56:20.095 INFO:teuthology.orchestra.run.smithi155.stdout: "duration": 0 2023-08-01T19:56:20.095 INFO:teuthology.orchestra.run.smithi155.stdout: }, 2023-08-01T19:56:20.095 INFO:teuthology.orchestra.run.smithi155.stdout: { 2023-08-01T19:56:20.096 INFO:teuthology.orchestra.run.smithi155.stdout: "event": "header_read", 2023-08-01T19:56:20.096 INFO:teuthology.orchestra.run.smithi155.stdout: "time": "2023-08-01T19:55:05.153612+0000", 2023-08-01T19:56:20.096 INFO:teuthology.orchestra.run.smithi155.stdout: "duration": 4294967295.9999986 2023-08-01T19:56:20.096 INFO:teuthology.orchestra.run.smithi155.stdout: }, 2023-08-01T19:56:20.096 INFO:teuthology.orchestra.run.smithi155.stdout: { 2023-08-01T19:56:20.096 INFO:teuthology.orchestra.run.smithi155.stdout: "event": "all_read", 2023-08-01T19:56:20.096 INFO:teuthology.orchestra.run.smithi155.stdout: "time": "2023-08-01T19:55:05.153694+0000", 2023-08-01T19:56:20.097 INFO:teuthology.orchestra.run.smithi155.stdout: "duration": 8.1618000000000004e-05 2023-08-01T19:56:20.097 INFO:teuthology.orchestra.run.smithi155.stdout: }, 2023-08-01T19:56:20.097 INFO:teuthology.orchestra.run.smithi155.stdout: { 2023-08-01T19:56:20.097 INFO:teuthology.orchestra.run.smithi155.stdout: "event": "dispatched", 2023-08-01T19:56:20.097 INFO:teuthology.orchestra.run.smithi155.stdout: "time": "2023-08-01T19:55:05.153713+0000", 2023-08-01T19:56:20.097 INFO:teuthology.orchestra.run.smithi155.stdout: "duration": 1.9069999999999999e-05 2023-08-01T19:56:20.097 INFO:teuthology.orchestra.run.smithi155.stdout: }, 2023-08-01T19:56:20.098 INFO:teuthology.orchestra.run.smithi155.stdout: { 2023-08-01T19:56:20.098 INFO:teuthology.orchestra.run.smithi155.stdout: "event": "queued_for_pg", 2023-08-01T19:56:20.098 INFO:teuthology.orchestra.run.smithi155.stdout: "time": "2023-08-01T19:55:05.153726+0000", 2023-08-01T19:56:20.098 INFO:teuthology.orchestra.run.smithi155.stdout: "duration": 1.238e-05 2023-08-01T19:56:20.098 INFO:teuthology.orchestra.run.smithi155.stdout: }, 2023-08-01T19:56:20.098 INFO:teuthology.orchestra.run.smithi155.stdout: { 2023-08-01T19:56:20.098 INFO:teuthology.orchestra.run.smithi155.stdout: "event": "reached_pg", 2023-08-01T19:56:20.098 INFO:teuthology.orchestra.run.smithi155.stdout: "time": "2023-08-01T19:55:05.153761+0000", 2023-08-01T19:56:20.099 INFO:teuthology.orchestra.run.smithi155.stdout: "duration": 3.5046999999999998e-05 2023-08-01T19:56:20.099 INFO:teuthology.orchestra.run.smithi155.stdout: }, 2023-08-01T19:56:20.099 INFO:teuthology.orchestra.run.smithi155.stdout: { 2023-08-01T19:56:20.099 INFO:teuthology.orchestra.run.smithi155.stdout: "event": "started", 2023-08-01T19:56:20.099 INFO:teuthology.orchestra.run.smithi155.stdout: "time": "2023-08-01T19:55:05.153896+0000", 2023-08-01T19:56:20.099 INFO:teuthology.orchestra.run.smithi155.stdout: "duration": 0.00013575800000000001 2023-08-01T19:56:20.099 INFO:teuthology.orchestra.run.smithi155.stdout: }, 2023-08-01T19:56:20.099 INFO:teuthology.orchestra.run.smithi155.stdout: { 2023-08-01T19:56:20.100 INFO:teuthology.orchestra.run.smithi155.stdout: "event": "waiting for subops from 0", 2023-08-01T19:56:20.100 INFO:teuthology.orchestra.run.smithi155.stdout: "time": "2023-08-01T19:55:05.154043+0000", 2023-08-01T19:56:20.100 INFO:teuthology.orchestra.run.smithi155.stdout: "duration": 0.00014650700000000001 2023-08-01T19:56:20.100 INFO:teuthology.orchestra.run.smithi155.stdout: }, 2023-08-01T19:56:20.100 INFO:teuthology.orchestra.run.smithi155.stdout: { 2023-08-01T19:56:20.100 INFO:teuthology.orchestra.run.smithi155.stdout: "event": "sub_op_commit_rec", 2023-08-01T19:56:20.100 INFO:teuthology.orchestra.run.smithi155.stdout: "time": "2023-08-01T19:55:05.221876+0000", 2023-08-01T19:56:20.100 INFO:teuthology.orchestra.run.smithi155.stdout: "duration": 0.067832796000000001 2023-08-01T19:56:20.101 INFO:teuthology.orchestra.run.smithi155.stdout: }, 2023-08-01T19:56:20.101 INFO:teuthology.orchestra.run.smithi155.stdout: { 2023-08-01T19:56:20.101 INFO:teuthology.orchestra.run.smithi155.stdout: "event": "op_commit", 2023-08-01T19:56:20.101 INFO:teuthology.orchestra.run.smithi155.stdout: "time": "2023-08-01T19:55:05.222813+0000", 2023-08-01T19:56:20.101 INFO:teuthology.orchestra.run.smithi155.stdout: "duration": 0.00093755300000000004 2023-08-01T19:56:20.101 INFO:teuthology.orchestra.run.smithi155.stdout: }, 2023-08-01T19:56:20.101 INFO:teuthology.orchestra.run.smithi155.stdout: { 2023-08-01T19:56:20.102 INFO:teuthology.orchestra.run.smithi155.stdout: "event": "commit_sent", 2023-08-01T19:56:20.102 INFO:teuthology.orchestra.run.smithi155.stdout: "time": "2023-08-01T19:55:05.222861+0000", 2023-08-01T19:56:20.102 INFO:teuthology.orchestra.run.smithi155.stdout: "duration": 4.8013999999999998e-05 2023-08-01T19:56:20.102 INFO:teuthology.orchestra.run.smithi155.stdout: }, 2023-08-01T19:56:20.102 INFO:teuthology.orchestra.run.smithi155.stdout: { 2023-08-01T19:56:20.102 INFO:teuthology.orchestra.run.smithi155.stdout: "event": "done", 2023-08-01T19:56:20.102 INFO:teuthology.orchestra.run.smithi155.stdout: "time": "2023-08-01T19:55:05.222900+0000", 2023-08-01T19:56:20.102 INFO:teuthology.orchestra.run.smithi155.stdout: "duration": 3.8634999999999999e-05 2023-08-01T19:56:20.103 INFO:teuthology.orchestra.run.smithi155.stdout: } 2023-08-01T19:56:20.103 INFO:teuthology.orchestra.run.smithi155.stdout: ] 2023-08-01T19:56:20.103 INFO:teuthology.orchestra.run.smithi155.stdout: } 2023-08-01T19:56:20.103 INFO:teuthology.orchestra.run.smithi155.stdout: }, 2023-08-01T19:56:20.103 INFO:teuthology.orchestra.run.smithi155.stdout: { 2023-08-01T19:56:20.103 INFO:teuthology.orchestra.run.smithi155.stdout: "description": "osd_op(client.4668.0:100251 5.b 5:d853df24:::benchmark_data_smithi006_114134_object100250:head [set-alloc-hint object_size 65536 write_size 65536,write 0~65536] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e37)", 2023-08-01T19:56:20.103 INFO:teuthology.orchestra.run.smithi155.stdout: "initiated_at": "2023-08-01T19:55:05.153737+0000", 2023-08-01T19:56:20.103 INFO:teuthology.orchestra.run.smithi155.stdout: "age": 74.879145632999993, 2023-08-01T19:56:20.104 INFO:teuthology.orchestra.run.smithi155.stdout: "duration": 0.071366545000000003, 2023-08-01T19:56:20.104 INFO:teuthology.orchestra.run.smithi155.stdout: "type_data": { 2023-08-01T19:56:20.104 INFO:teuthology.orchestra.run.smithi155.stdout: "flag_point": "commit sent; apply or cleanup", 2023-08-01T19:56:20.104 INFO:teuthology.orchestra.run.smithi155.stdout: "client_info": { 2023-08-01T19:56:20.104 INFO:teuthology.orchestra.run.smithi155.stdout: "client": "client.4668", 2023-08-01T19:56:20.104 INFO:teuthology.orchestra.run.smithi155.stdout: "client_addr": "172.21.15.6:0/1709472247", 2023-08-01T19:56:20.104 INFO:teuthology.orchestra.run.smithi155.stdout: "tid": 100251 2023-08-01T19:56:20.105 INFO:teuthology.orchestra.run.smithi155.stdout: }, 2023-08-01T19:56:20.105 INFO:teuthology.orchestra.run.smithi155.stdout: "events": [ 2023-08-01T19:56:20.105 INFO:teuthology.orchestra.run.smithi155.stdout: { 2023-08-01T19:56:20.105 INFO:teuthology.orchestra.run.smithi155.stdout: "event": "initiated", 2023-08-01T19:56:20.105 INFO:teuthology.orchestra.run.smithi155.stdout: "time": "2023-08-01T19:55:05.153737+0000", 2023-08-01T19:56:20.105 INFO:teuthology.orchestra.run.smithi155.stdout: "duration": 0 2023-08-01T19:56:20.105 INFO:teuthology.orchestra.run.smithi155.stdout: }, 2023-08-01T19:56:20.106 INFO:teuthology.orchestra.run.smithi155.stdout: { 2023-08-01T19:56:20.106 INFO:teuthology.orchestra.run.smithi155.stdout: "event": "throttled", 2023-08-01T19:56:20.106 INFO:teuthology.orchestra.run.smithi155.stdout: "time": "2023-08-01T19:55:05.153737+0000", 2023-08-01T19:56:20.106 INFO:teuthology.orchestra.run.smithi155.stdout: "duration": 0 2023-08-01T19:56:20.106 INFO:teuthology.orchestra.run.smithi155.stdout: }, 2023-08-01T19:56:20.106 INFO:teuthology.orchestra.run.smithi155.stdout: { 2023-08-01T19:56:20.106 INFO:teuthology.orchestra.run.smithi155.stdout: "event": "header_read", 2023-08-01T19:56:20.106 INFO:teuthology.orchestra.run.smithi155.stdout: "time": "2023-08-01T19:55:05.153736+0000", 2023-08-01T19:56:20.107 INFO:teuthology.orchestra.run.smithi155.stdout: "duration": 4294967295.9999995 2023-08-01T19:56:20.107 INFO:teuthology.orchestra.run.smithi155.stdout: }, 2023-08-01T19:56:20.107 INFO:teuthology.orchestra.run.smithi155.stdout: { 2023-08-01T19:56:20.107 INFO:teuthology.orchestra.run.smithi155.stdout: "event": "all_read", 2023-08-01T19:56:20.107 INFO:teuthology.orchestra.run.smithi155.stdout: "time": "2023-08-01T19:55:05.153784+0000", 2023-08-01T19:56:20.107 INFO:teuthology.orchestra.run.smithi155.stdout: "duration": 4.7660000000000001e-05 2023-08-01T19:56:20.107 INFO:teuthology.orchestra.run.smithi155.stdout: }, 2023-08-01T19:56:20.107 INFO:teuthology.orchestra.run.smithi155.stdout: { 2023-08-01T19:56:20.108 INFO:teuthology.orchestra.run.smithi155.stdout: "event": "dispatched", 2023-08-01T19:56:20.108 INFO:teuthology.orchestra.run.smithi155.stdout: "time": "2023-08-01T19:55:05.153793+0000", 2023-08-01T19:56:20.108 INFO:teuthology.orchestra.run.smithi155.stdout: "duration": 8.7150000000000004e-06 2023-08-01T19:56:20.108 INFO:teuthology.orchestra.run.smithi155.stdout: }, 2023-08-01T19:56:20.108 INFO:teuthology.orchestra.run.smithi155.stdout: { 2023-08-01T19:56:20.108 INFO:teuthology.orchestra.run.smithi155.stdout: "event": "queued_for_pg", 2023-08-01T19:56:20.108 INFO:teuthology.orchestra.run.smithi155.stdout: "time": "2023-08-01T19:55:05.153800+0000", 2023-08-01T19:56:20.108 INFO:teuthology.orchestra.run.smithi155.stdout: "duration": 7.2459999999999997e-06 2023-08-01T19:56:20.109 INFO:teuthology.orchestra.run.smithi155.stdout: }, 2023-08-01T19:56:20.109 INFO:teuthology.orchestra.run.smithi155.stdout: { 2023-08-01T19:56:20.109 INFO:teuthology.orchestra.run.smithi155.stdout: "event": "reached_pg", 2023-08-01T19:56:20.109 INFO:teuthology.orchestra.run.smithi155.stdout: "time": "2023-08-01T19:55:05.156241+0000", 2023-08-01T19:56:20.109 INFO:teuthology.orchestra.run.smithi155.stdout: "duration": 0.0024415359999999998 2023-08-01T19:56:20.109 INFO:teuthology.orchestra.run.smithi155.stdout: }, 2023-08-01T19:56:20.109 INFO:teuthology.orchestra.run.smithi155.stdout: { 2023-08-01T19:56:20.110 INFO:teuthology.orchestra.run.smithi155.stdout: "event": "started", 2023-08-01T19:56:20.110 INFO:teuthology.orchestra.run.smithi155.stdout: "time": "2023-08-01T19:55:05.219045+0000", 2023-08-01T19:56:20.110 INFO:teuthology.orchestra.run.smithi155.stdout: "duration": 0.062803855000000006 2023-08-01T19:56:20.110 INFO:teuthology.orchestra.run.smithi155.stdout: }, 2023-08-01T19:56:20.110 INFO:teuthology.orchestra.run.smithi155.stdout: { 2023-08-01T19:56:20.110 INFO:teuthology.orchestra.run.smithi155.stdout: "event": "waiting for subops from 0", 2023-08-01T19:56:20.110 INFO:teuthology.orchestra.run.smithi155.stdout: "time": "2023-08-01T19:55:05.219238+0000", 2023-08-01T19:56:20.110 INFO:teuthology.orchestra.run.smithi155.stdout: "duration": 0.00019241500000000001 2023-08-01T19:56:20.111 INFO:teuthology.orchestra.run.smithi155.stdout: }, 2023-08-01T19:56:20.111 INFO:teuthology.orchestra.run.smithi155.stdout: { 2023-08-01T19:56:20.111 INFO:teuthology.orchestra.run.smithi155.stdout: "event": "sub_op_commit_rec", 2023-08-01T19:56:20.111 INFO:teuthology.orchestra.run.smithi155.stdout: "time": "2023-08-01T19:55:05.223300+0000", 2023-08-01T19:56:20.111 INFO:teuthology.orchestra.run.smithi155.stdout: "duration": 0.0040626509999999996 2023-08-01T19:56:20.111 INFO:teuthology.orchestra.run.smithi155.stdout: }, 2023-08-01T19:56:20.111 INFO:teuthology.orchestra.run.smithi155.stdout: { 2023-08-01T19:56:20.112 INFO:teuthology.orchestra.run.smithi155.stdout: "event": "op_commit", 2023-08-01T19:56:20.112 INFO:teuthology.orchestra.run.smithi155.stdout: "time": "2023-08-01T19:55:05.225020+0000", 2023-08-01T19:56:20.112 INFO:teuthology.orchestra.run.smithi155.stdout: "duration": 0.0017201 2023-08-01T19:56:20.112 INFO:teuthology.orchestra.run.smithi155.stdout: }, 2023-08-01T19:56:20.112 INFO:teuthology.orchestra.run.smithi155.stdout: { 2023-08-01T19:56:20.112 INFO:teuthology.orchestra.run.smithi155.stdout: "event": "commit_sent", 2023-08-01T19:56:20.112 INFO:teuthology.orchestra.run.smithi155.stdout: "time": "2023-08-01T19:55:05.225066+0000", 2023-08-01T19:56:20.112 INFO:teuthology.orchestra.run.smithi155.stdout: "duration": 4.6143000000000002e-05 2023-08-01T19:56:20.113 INFO:teuthology.orchestra.run.smithi155.stdout: }, 2023-08-01T19:56:20.113 INFO:teuthology.orchestra.run.smithi155.stdout: { 2023-08-01T19:56:20.113 INFO:teuthology.orchestra.run.smithi155.stdout: "event": "done", 2023-08-01T19:56:20.113 INFO:teuthology.orchestra.run.smithi155.stdout: "time": "2023-08-01T19:55:05.225103+0000", 2023-08-01T19:56:20.113 INFO:teuthology.orchestra.run.smithi155.stdout: "duration": 3.6789999999999998e-05 2023-08-01T19:56:20.113 INFO:teuthology.orchestra.run.smithi155.stdout: } 2023-08-01T19:56:20.114 INFO:teuthology.orchestra.run.smithi155.stdout: ] 2023-08-01T19:56:20.114 INFO:teuthology.orchestra.run.smithi155.stdout: } 2023-08-01T19:56:20.114 INFO:teuthology.orchestra.run.smithi155.stdout: }, 2023-08-01T19:56:20.114 INFO:teuthology.orchestra.run.smithi155.stdout: { 2023-08-01T19:56:20.114 INFO:teuthology.orchestra.run.smithi155.stdout: "description": "osd_op(client.4668.0:100252 5.0 5:01f90c3c:::benchmark_data_smithi006_114134_object100251:head [set-alloc-hint object_size 65536 write_size 65536,write 0~65536] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e37)", 2023-08-01T19:56:20.114 INFO:teuthology.orchestra.run.smithi155.stdout: "initiated_at": "2023-08-01T19:55:05.154048+0000", 2023-08-01T19:56:20.114 INFO:teuthology.orchestra.run.smithi155.stdout: "age": 74.878834385999994, 2023-08-01T19:56:20.114 INFO:teuthology.orchestra.run.smithi155.stdout: "duration": 0.070156683999999997, 2023-08-01T19:56:20.115 INFO:teuthology.orchestra.run.smithi155.stdout: "type_data": { 2023-08-01T19:56:20.115 INFO:teuthology.orchestra.run.smithi155.stdout: "flag_point": "commit sent; apply or cleanup", 2023-08-01T19:56:20.115 INFO:teuthology.orchestra.run.smithi155.stdout: "client_info": { 2023-08-01T19:56:20.115 INFO:teuthology.orchestra.run.smithi155.stdout: "client": "client.4668", 2023-08-01T19:56:20.115 INFO:teuthology.orchestra.run.smithi155.stdout: "client_addr": "172.21.15.6:0/1709472247", 2023-08-01T19:56:20.115 INFO:teuthology.orchestra.run.smithi155.stdout: "tid": 100252 2023-08-01T19:56:20.115 INFO:teuthology.orchestra.run.smithi155.stdout: }, 2023-08-01T19:56:20.115 INFO:teuthology.orchestra.run.smithi155.stdout: "events": [ 2023-08-01T19:56:20.116 INFO:teuthology.orchestra.run.smithi155.stdout: { 2023-08-01T19:56:20.116 INFO:teuthology.orchestra.run.smithi155.stdout: "event": "initiated", 2023-08-01T19:56:20.116 INFO:teuthology.orchestra.run.smithi155.stdout: "time": "2023-08-01T19:55:05.154048+0000", 2023-08-01T19:56:20.116 INFO:teuthology.orchestra.run.smithi155.stdout: "duration": 0 2023-08-01T19:56:20.116 INFO:teuthology.orchestra.run.smithi155.stdout: }, 2023-08-01T19:56:20.116 INFO:teuthology.orchestra.run.smithi155.stdout: { 2023-08-01T19:56:20.116 INFO:teuthology.orchestra.run.smithi155.stdout: "event": "throttled", 2023-08-01T19:56:20.117 INFO:teuthology.orchestra.run.smithi155.stdout: "time": "2023-08-01T19:55:05.154048+0000", 2023-08-01T19:56:20.117 INFO:teuthology.orchestra.run.smithi155.stdout: "duration": 0 2023-08-01T19:56:20.117 INFO:teuthology.orchestra.run.smithi155.stdout: }, 2023-08-01T19:56:20.117 INFO:teuthology.orchestra.run.smithi155.stdout: { 2023-08-01T19:56:20.117 INFO:teuthology.orchestra.run.smithi155.stdout: "event": "header_read", 2023-08-01T19:56:20.117 INFO:teuthology.orchestra.run.smithi155.stdout: "time": "2023-08-01T19:55:05.154047+0000", 2023-08-01T19:56:20.117 INFO:teuthology.orchestra.run.smithi155.stdout: "duration": 4294967295.999999 2023-08-01T19:56:20.117 INFO:teuthology.orchestra.run.smithi155.stdout: }, 2023-08-01T19:56:20.118 INFO:teuthology.orchestra.run.smithi155.stdout: { 2023-08-01T19:56:20.118 INFO:teuthology.orchestra.run.smithi155.stdout: "event": "all_read", 2023-08-01T19:56:20.118 INFO:teuthology.orchestra.run.smithi155.stdout: "time": "2023-08-01T19:55:05.154115+0000", 2023-08-01T19:56:20.118 INFO:teuthology.orchestra.run.smithi155.stdout: "duration": 6.7545999999999993e-05 2023-08-01T19:56:20.118 INFO:teuthology.orchestra.run.smithi155.stdout: }, 2023-08-01T19:56:20.118 INFO:teuthology.orchestra.run.smithi155.stdout: { 2023-08-01T19:56:20.118 INFO:teuthology.orchestra.run.smithi155.stdout: "event": "dispatched", 2023-08-01T19:56:20.118 INFO:teuthology.orchestra.run.smithi155.stdout: "time": "2023-08-01T19:55:05.154125+0000", 2023-08-01T19:56:20.119 INFO:teuthology.orchestra.run.smithi155.stdout: "duration": 1.0669000000000001e-05 2023-08-01T19:56:20.119 INFO:teuthology.orchestra.run.smithi155.stdout: }, 2023-08-01T19:56:20.119 INFO:teuthology.orchestra.run.smithi155.stdout: { 2023-08-01T19:56:20.119 INFO:teuthology.orchestra.run.smithi155.stdout: "event": "queued_for_pg", 2023-08-01T19:56:20.119 INFO:teuthology.orchestra.run.smithi155.stdout: "time": "2023-08-01T19:55:05.154131+0000", 2023-08-01T19:56:20.119 INFO:teuthology.orchestra.run.smithi155.stdout: "duration": 6.0349999999999998e-06 2023-08-01T19:56:20.119 INFO:teuthology.orchestra.run.smithi155.stdout: }, 2023-08-01T19:56:20.119 INFO:teuthology.orchestra.run.smithi155.stdout: { 2023-08-01T19:56:20.120 INFO:teuthology.orchestra.run.smithi155.stdout: "event": "reached_pg", 2023-08-01T19:56:20.120 INFO:teuthology.orchestra.run.smithi155.stdout: "time": "2023-08-01T19:55:05.154174+0000", 2023-08-01T19:56:20.120 INFO:teuthology.orchestra.run.smithi155.stdout: "duration": 4.2429000000000003e-05 2023-08-01T19:56:20.120 INFO:teuthology.orchestra.run.smithi155.stdout: }, 2023-08-01T19:56:20.120 INFO:teuthology.orchestra.run.smithi155.stdout: { 2023-08-01T19:56:20.120 INFO:teuthology.orchestra.run.smithi155.stdout: "event": "started", 2023-08-01T19:56:20.120 INFO:teuthology.orchestra.run.smithi155.stdout: "time": "2023-08-01T19:55:05.154287+0000", 2023-08-01T19:56:20.120 INFO:teuthology.orchestra.run.smithi155.stdout: "duration": 0.000113138 2023-08-01T19:56:20.121 INFO:teuthology.orchestra.run.smithi155.stdout: }, 2023-08-01T19:56:20.121 INFO:teuthology.orchestra.run.smithi155.stdout: { 2023-08-01T19:56:20.121 INFO:teuthology.orchestra.run.smithi155.stdout: "event": "waiting for subops from 0", 2023-08-01T19:56:20.121 INFO:teuthology.orchestra.run.smithi155.stdout: "time": "2023-08-01T19:55:05.154420+0000", 2023-08-01T19:56:20.121 INFO:teuthology.orchestra.run.smithi155.stdout: "duration": 0.000133292 2023-08-01T19:56:20.121 INFO:teuthology.orchestra.run.smithi155.stdout: }, 2023-08-01T19:56:20.121 INFO:teuthology.orchestra.run.smithi155.stdout: { 2023-08-01T19:56:20.121 INFO:teuthology.orchestra.run.smithi155.stdout: "event": "sub_op_commit_rec", 2023-08-01T19:56:20.122 INFO:teuthology.orchestra.run.smithi155.stdout: "time": "2023-08-01T19:55:05.219034+0000", 2023-08-01T19:56:20.122 INFO:teuthology.orchestra.run.smithi155.stdout: "duration": 0.064613429999999999 2023-08-01T19:56:20.122 INFO:teuthology.orchestra.run.smithi155.stdout: }, 2023-08-01T19:56:20.122 INFO:teuthology.orchestra.run.smithi155.stdout: { 2023-08-01T19:56:20.122 INFO:teuthology.orchestra.run.smithi155.stdout: "event": "op_commit", 2023-08-01T19:56:20.122 INFO:teuthology.orchestra.run.smithi155.stdout: "time": "2023-08-01T19:55:05.224138+0000", 2023-08-01T19:56:20.122 INFO:teuthology.orchestra.run.smithi155.stdout: "duration": 0.0051041999999999997 2023-08-01T19:56:20.122 INFO:teuthology.orchestra.run.smithi155.stdout: }, 2023-08-01T19:56:20.123 INFO:teuthology.orchestra.run.smithi155.stdout: { 2023-08-01T19:56:20.123 INFO:teuthology.orchestra.run.smithi155.stdout: "event": "commit_sent", 2023-08-01T19:56:20.123 INFO:teuthology.orchestra.run.smithi155.stdout: "time": "2023-08-01T19:55:05.224171+0000", 2023-08-01T19:56:20.123 INFO:teuthology.orchestra.run.smithi155.stdout: "duration": 3.3345e-05 2023-08-01T19:56:20.123 INFO:teuthology.orchestra.run.smithi155.stdout: }, 2023-08-01T19:56:20.123 INFO:teuthology.orchestra.run.smithi155.stdout: { 2023-08-01T19:56:20.123 INFO:teuthology.orchestra.run.smithi155.stdout: "event": "done", 2023-08-01T19:56:20.124 INFO:teuthology.orchestra.run.smithi155.stdout: "time": "2023-08-01T19:55:05.224205+0000", 2023-08-01T19:56:20.124 INFO:teuthology.orchestra.run.smithi155.stdout: "duration": 3.3525999999999997e-05 2023-08-01T19:56:20.124 INFO:teuthology.orchestra.run.smithi155.stdout: } 2023-08-01T19:56:20.124 INFO:teuthology.orchestra.run.smithi155.stdout: ] 2023-08-01T19:56:20.125 INFO:teuthology.orchestra.run.smithi155.stdout: } 2023-08-01T19:56:20.125 INFO:teuthology.orchestra.run.smithi155.stdout: }, 2023-08-01T19:56:20.125 INFO:teuthology.orchestra.run.smithi155.stdout: { 2023-08-01T19:56:20.125 INFO:teuthology.orchestra.run.smithi155.stdout: "description": "osd_repop_reply(client.4668.0:100237 5.4 e37/19 ondisk, result = 0)", 2023-08-01T19:56:20.125 INFO:teuthology.orchestra.run.smithi155.stdout: "initiated_at": "2023-08-01T19:55:05.156249+0000", 2023-08-01T19:56:20.125 INFO:teuthology.orchestra.run.smithi155.stdout: "age": 74.876633440999996, 2023-08-01T19:56:20.125 INFO:teuthology.orchestra.run.smithi155.stdout: "duration": 0.062792549000000003, 2023-08-01T19:56:20.126 INFO:teuthology.orchestra.run.smithi155.stdout: "type_data": { 2023-08-01T19:56:20.126 INFO:teuthology.orchestra.run.smithi155.stdout: "flag_point": "started", 2023-08-01T19:56:20.126 INFO:teuthology.orchestra.run.smithi155.stdout: "events": [ 2023-08-01T19:56:20.127 INFO:teuthology.orchestra.run.smithi155.stdout: { 2023-08-01T19:56:20.127 INFO:teuthology.orchestra.run.smithi155.stdout: "event": "initiated", 2023-08-01T19:56:20.127 INFO:teuthology.orchestra.run.smithi155.stdout: "time": "2023-08-01T19:55:05.156249+0000", 2023-08-01T19:56:20.127 INFO:teuthology.orchestra.run.smithi155.stdout: "duration": 0 2023-08-01T19:56:20.128 INFO:teuthology.orchestra.run.smithi155.stdout: }, 2023-08-01T19:56:20.128 INFO:teuthology.orchestra.run.smithi155.stdout: { 2023-08-01T19:56:20.128 INFO:teuthology.orchestra.run.smithi155.stdout: "event": "throttled", 2023-08-01T19:56:20.128 INFO:teuthology.orchestra.run.smithi155.stdout: "time": "2023-08-01T19:55:05.156249+0000", 2023-08-01T19:56:20.128 INFO:teuthology.orchestra.run.smithi155.stdout: "duration": 0 2023-08-01T19:56:20.129 INFO:teuthology.orchestra.run.smithi155.stdout: }, 2023-08-01T19:56:20.129 INFO:teuthology.orchestra.run.smithi155.stdout: { 2023-08-01T19:56:20.129 INFO:teuthology.orchestra.run.smithi155.stdout: "event": "header_read", 2023-08-01T19:56:20.129 INFO:teuthology.orchestra.run.smithi155.stdout: "time": "2023-08-01T19:55:05.156248+0000", 2023-08-01T19:56:20.129 INFO:teuthology.orchestra.run.smithi155.stdout: "duration": 4294967295.9999995 2023-08-01T19:56:20.129 INFO:teuthology.orchestra.run.smithi155.stdout: }, 2023-08-01T19:56:20.130 INFO:teuthology.orchestra.run.smithi155.stdout: { 2023-08-01T19:56:20.130 INFO:teuthology.orchestra.run.smithi155.stdout: "event": "all_read", 2023-08-01T19:56:20.130 INFO:teuthology.orchestra.run.smithi155.stdout: "time": "2023-08-01T19:55:05.156252+0000", 2023-08-01T19:56:20.130 INFO:teuthology.orchestra.run.smithi155.stdout: "duration": 3.9999999999999998e-06 2023-08-01T19:56:20.130 INFO:teuthology.orchestra.run.smithi155.stdout: }, 2023-08-01T19:56:20.130 INFO:teuthology.orchestra.run.smithi155.stdout: { 2023-08-01T19:56:20.131 INFO:teuthology.orchestra.run.smithi155.stdout: "event": "dispatched", 2023-08-01T19:56:20.131 INFO:teuthology.orchestra.run.smithi155.stdout: "time": "2023-08-01T19:55:05.218844+0000", 2023-08-01T19:56:20.131 INFO:teuthology.orchestra.run.smithi155.stdout: "duration": 0.062591516999999999 2023-08-01T19:56:20.131 INFO:teuthology.orchestra.run.smithi155.stdout: }, 2023-08-01T19:56:20.131 INFO:teuthology.orchestra.run.smithi155.stdout: { 2023-08-01T19:56:20.131 INFO:teuthology.orchestra.run.smithi155.stdout: "event": "queued_for_pg", 2023-08-01T19:56:20.131 INFO:teuthology.orchestra.run.smithi155.stdout: "time": "2023-08-01T19:55:05.218862+0000", 2023-08-01T19:56:20.132 INFO:teuthology.orchestra.run.smithi155.stdout: "duration": 1.7666e-05 2023-08-01T19:56:20.132 INFO:teuthology.orchestra.run.smithi155.stdout: }, 2023-08-01T19:56:20.132 INFO:teuthology.orchestra.run.smithi155.stdout: { 2023-08-01T19:56:20.132 INFO:teuthology.orchestra.run.smithi155.stdout: "event": "reached_pg", 2023-08-01T19:56:20.132 INFO:teuthology.orchestra.run.smithi155.stdout: "time": "2023-08-01T19:55:05.218914+0000", 2023-08-01T19:56:20.132 INFO:teuthology.orchestra.run.smithi155.stdout: "duration": 5.2565999999999998e-05 2023-08-01T19:56:20.132 INFO:teuthology.orchestra.run.smithi155.stdout: }, 2023-08-01T19:56:20.132 INFO:teuthology.orchestra.run.smithi155.stdout: { 2023-08-01T19:56:20.133 INFO:teuthology.orchestra.run.smithi155.stdout: "event": "started", 2023-08-01T19:56:20.133 INFO:teuthology.orchestra.run.smithi155.stdout: "time": "2023-08-01T19:55:05.218925+0000", 2023-08-01T19:56:20.133 INFO:teuthology.orchestra.run.smithi155.stdout: "duration": 1.1375e-05 2023-08-01T19:56:20.133 INFO:teuthology.orchestra.run.smithi155.stdout: }, 2023-08-01T19:56:20.133 INFO:teuthology.orchestra.run.smithi155.stdout: { 2023-08-01T19:56:20.133 INFO:teuthology.orchestra.run.smithi155.stdout: "event": "done", 2023-08-01T19:56:20.133 INFO:teuthology.orchestra.run.smithi155.stdout: "time": "2023-08-01T19:55:05.219041+0000", 2023-08-01T19:56:20.133 INFO:teuthology.orchestra.run.smithi155.stdout: "duration": 0.000115977 2023-08-01T19:56:20.134 INFO:teuthology.orchestra.run.smithi155.stdout: } 2023-08-01T19:56:20.134 INFO:teuthology.orchestra.run.smithi155.stdout: ] 2023-08-01T19:56:20.134 INFO:teuthology.orchestra.run.smithi155.stdout: } 2023-08-01T19:56:20.134 INFO:teuthology.orchestra.run.smithi155.stdout: }, 2023-08-01T19:56:20.134 INFO:teuthology.orchestra.run.smithi155.stdout: { 2023-08-01T19:56:20.134 INFO:teuthology.orchestra.run.smithi155.stdout: "description": "osd_repop(client.4668.0:100253 5.f e37/19 5:f7bbce05:::benchmark_data_smithi006_114134_object100252:head v 37'6323, mlcod=37'6321)", 2023-08-01T19:56:20.134 INFO:teuthology.orchestra.run.smithi155.stdout: "initiated_at": "2023-08-01T19:55:05.156952+0000", 2023-08-01T19:56:20.134 INFO:teuthology.orchestra.run.smithi155.stdout: "age": 74.875930378000007, 2023-08-01T19:56:20.135 INFO:teuthology.orchestra.run.smithi155.stdout: "duration": 0.068018577999999996, 2023-08-01T19:56:20.135 INFO:teuthology.orchestra.run.smithi155.stdout: "type_data": { 2023-08-01T19:56:20.135 INFO:teuthology.orchestra.run.smithi155.stdout: "flag_point": "commit sent; apply or cleanup", 2023-08-01T19:56:20.135 INFO:teuthology.orchestra.run.smithi155.stdout: "events": [ 2023-08-01T19:56:20.135 INFO:teuthology.orchestra.run.smithi155.stdout: { 2023-08-01T19:56:20.135 INFO:teuthology.orchestra.run.smithi155.stdout: "event": "initiated", 2023-08-01T19:56:20.135 INFO:teuthology.orchestra.run.smithi155.stdout: "time": "2023-08-01T19:55:05.156952+0000", 2023-08-01T19:56:20.135 INFO:teuthology.orchestra.run.smithi155.stdout: "duration": 0 2023-08-01T19:56:20.136 INFO:teuthology.orchestra.run.smithi155.stdout: }, 2023-08-01T19:56:20.136 INFO:teuthology.orchestra.run.smithi155.stdout: { 2023-08-01T19:56:20.136 INFO:teuthology.orchestra.run.smithi155.stdout: "event": "throttled", 2023-08-01T19:56:20.136 INFO:teuthology.orchestra.run.smithi155.stdout: "time": "2023-08-01T19:55:05.156952+0000", 2023-08-01T19:56:20.136 INFO:teuthology.orchestra.run.smithi155.stdout: "duration": 0 2023-08-01T19:56:20.136 INFO:teuthology.orchestra.run.smithi155.stdout: }, 2023-08-01T19:56:20.136 INFO:teuthology.orchestra.run.smithi155.stdout: { 2023-08-01T19:56:20.137 INFO:teuthology.orchestra.run.smithi155.stdout: "event": "header_read", 2023-08-01T19:56:20.137 INFO:teuthology.orchestra.run.smithi155.stdout: "time": "2023-08-01T19:55:05.156951+0000", 2023-08-01T19:56:20.137 INFO:teuthology.orchestra.run.smithi155.stdout: "duration": 4294967295.999999 2023-08-01T19:56:20.137 INFO:teuthology.orchestra.run.smithi155.stdout: }, 2023-08-01T19:56:20.137 INFO:teuthology.orchestra.run.smithi155.stdout: { 2023-08-01T19:56:20.137 INFO:teuthology.orchestra.run.smithi155.stdout: "event": "all_read", 2023-08-01T19:56:20.137 INFO:teuthology.orchestra.run.smithi155.stdout: "time": "2023-08-01T19:55:05.156989+0000", 2023-08-01T19:56:20.137 INFO:teuthology.orchestra.run.smithi155.stdout: "duration": 3.8175e-05 2023-08-01T19:56:20.138 INFO:teuthology.orchestra.run.smithi155.stdout: }, 2023-08-01T19:56:20.138 INFO:teuthology.orchestra.run.smithi155.stdout: { 2023-08-01T19:56:20.138 INFO:teuthology.orchestra.run.smithi155.stdout: "event": "dispatched", 2023-08-01T19:56:20.138 INFO:teuthology.orchestra.run.smithi155.stdout: "time": "2023-08-01T19:55:05.218842+0000", 2023-08-01T19:56:20.138 INFO:teuthology.orchestra.run.smithi155.stdout: "duration": 0.061852299999999999 2023-08-01T19:56:20.138 INFO:teuthology.orchestra.run.smithi155.stdout: }, 2023-08-01T19:56:20.138 INFO:teuthology.orchestra.run.smithi155.stdout: { 2023-08-01T19:56:20.138 INFO:teuthology.orchestra.run.smithi155.stdout: "event": "queued_for_pg", 2023-08-01T19:56:20.139 INFO:teuthology.orchestra.run.smithi155.stdout: "time": "2023-08-01T19:55:05.218862+0000", 2023-08-01T19:56:20.139 INFO:teuthology.orchestra.run.smithi155.stdout: "duration": 1.9854999999999999e-05 2023-08-01T19:56:20.139 INFO:teuthology.orchestra.run.smithi155.stdout: }, 2023-08-01T19:56:20.139 INFO:teuthology.orchestra.run.smithi155.stdout: { 2023-08-01T19:56:20.139 INFO:teuthology.orchestra.run.smithi155.stdout: "event": "reached_pg", 2023-08-01T19:56:20.139 INFO:teuthology.orchestra.run.smithi155.stdout: "time": "2023-08-01T19:55:05.218918+0000", 2023-08-01T19:56:20.139 INFO:teuthology.orchestra.run.smithi155.stdout: "duration": 5.6570000000000002e-05 2023-08-01T19:56:20.139 INFO:teuthology.orchestra.run.smithi155.stdout: }, 2023-08-01T19:56:20.140 INFO:teuthology.orchestra.run.smithi155.stdout: { 2023-08-01T19:56:20.140 INFO:teuthology.orchestra.run.smithi155.stdout: "event": "started", 2023-08-01T19:56:20.140 INFO:teuthology.orchestra.run.smithi155.stdout: "time": "2023-08-01T19:55:05.218940+0000", 2023-08-01T19:56:20.140 INFO:teuthology.orchestra.run.smithi155.stdout: "duration": 2.1804e-05 2023-08-01T19:56:20.140 INFO:teuthology.orchestra.run.smithi155.stdout: }, 2023-08-01T19:56:20.140 INFO:teuthology.orchestra.run.smithi155.stdout: { 2023-08-01T19:56:20.140 INFO:teuthology.orchestra.run.smithi155.stdout: "event": "commit_sent", 2023-08-01T19:56:20.140 INFO:teuthology.orchestra.run.smithi155.stdout: "time": "2023-08-01T19:55:05.224928+0000", 2023-08-01T19:56:20.141 INFO:teuthology.orchestra.run.smithi155.stdout: "duration": 0.0059876759999999999 2023-08-01T19:56:20.141 INFO:teuthology.orchestra.run.smithi155.stdout: }, 2023-08-01T19:56:20.141 INFO:teuthology.orchestra.run.smithi155.stdout: { 2023-08-01T19:56:20.141 INFO:teuthology.orchestra.run.smithi155.stdout: "event": "done", 2023-08-01T19:56:20.141 INFO:teuthology.orchestra.run.smithi155.stdout: "time": "2023-08-01T19:55:05.224971+0000", 2023-08-01T19:56:20.141 INFO:teuthology.orchestra.run.smithi155.stdout: "duration": 4.2929999999999997e-05 2023-08-01T19:56:20.141 INFO:teuthology.orchestra.run.smithi155.stdout: } 2023-08-01T19:56:20.142 INFO:teuthology.orchestra.run.smithi155.stdout: ] 2023-08-01T19:56:20.142 INFO:teuthology.orchestra.run.smithi155.stdout: } 2023-08-01T19:56:20.142 INFO:teuthology.orchestra.run.smithi155.stdout: }, 2023-08-01T19:56:20.142 INFO:teuthology.orchestra.run.smithi155.stdout: { 2023-08-01T19:56:20.142 INFO:teuthology.orchestra.run.smithi155.stdout: "description": "osd_op(client.4668.0:100927 5.0 5:00608ec6:::benchmark_data_smithi006_114134_object100926:head [set-alloc-hint object_size 65536 write_size 65536,write 0~65536] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e37)", 2023-08-01T19:56:20.142 INFO:teuthology.orchestra.run.smithi155.stdout: "initiated_at": "2023-08-01T19:55:05.561169+0000", 2023-08-01T19:56:20.142 INFO:teuthology.orchestra.run.smithi155.stdout: "age": 74.471713475000001, 2023-08-01T19:56:20.142 INFO:teuthology.orchestra.run.smithi155.stdout: "duration": 0.066411687999999997, 2023-08-01T19:56:20.143 INFO:teuthology.orchestra.run.smithi155.stdout: "type_data": { 2023-08-01T19:56:20.143 INFO:teuthology.orchestra.run.smithi155.stdout: "flag_point": "commit sent; apply or cleanup", 2023-08-01T19:56:20.143 INFO:teuthology.orchestra.run.smithi155.stdout: "client_info": { 2023-08-01T19:56:20.143 INFO:teuthology.orchestra.run.smithi155.stdout: "client": "client.4668", 2023-08-01T19:56:20.143 INFO:teuthology.orchestra.run.smithi155.stdout: "client_addr": "172.21.15.6:0/1709472247", 2023-08-01T19:56:20.143 INFO:teuthology.orchestra.run.smithi155.stdout: "tid": 100927 2023-08-01T19:56:20.143 INFO:teuthology.orchestra.run.smithi155.stdout: }, 2023-08-01T19:56:20.143 INFO:teuthology.orchestra.run.smithi155.stdout: "events": [ 2023-08-01T19:56:20.144 INFO:teuthology.orchestra.run.smithi155.stdout: { 2023-08-01T19:56:20.144 INFO:teuthology.orchestra.run.smithi155.stdout: "event": "initiated", 2023-08-01T19:56:20.144 INFO:teuthology.orchestra.run.smithi155.stdout: "time": "2023-08-01T19:55:05.561169+0000", 2023-08-01T19:56:20.144 INFO:teuthology.orchestra.run.smithi155.stdout: "duration": 0 2023-08-01T19:56:20.144 INFO:teuthology.orchestra.run.smithi155.stdout: }, 2023-08-01T19:56:20.144 INFO:teuthology.orchestra.run.smithi155.stdout: { 2023-08-01T19:56:20.144 INFO:teuthology.orchestra.run.smithi155.stdout: "event": "throttled", 2023-08-01T19:56:20.144 INFO:teuthology.orchestra.run.smithi155.stdout: "time": "2023-08-01T19:55:05.561169+0000", 2023-08-01T19:56:20.145 INFO:teuthology.orchestra.run.smithi155.stdout: "duration": 0 2023-08-01T19:56:20.145 INFO:teuthology.orchestra.run.smithi155.stdout: }, 2023-08-01T19:56:20.145 INFO:teuthology.orchestra.run.smithi155.stdout: { 2023-08-01T19:56:20.145 INFO:teuthology.orchestra.run.smithi155.stdout: "event": "header_read", 2023-08-01T19:56:20.145 INFO:teuthology.orchestra.run.smithi155.stdout: "time": "2023-08-01T19:55:05.561168+0000", 2023-08-01T19:56:20.145 INFO:teuthology.orchestra.run.smithi155.stdout: "duration": 4294967295.9999995 2023-08-01T19:56:20.145 INFO:teuthology.orchestra.run.smithi155.stdout: }, 2023-08-01T19:56:20.145 INFO:teuthology.orchestra.run.smithi155.stdout: { 2023-08-01T19:56:20.146 INFO:teuthology.orchestra.run.smithi155.stdout: "event": "all_read", 2023-08-01T19:56:20.146 INFO:teuthology.orchestra.run.smithi155.stdout: "time": "2023-08-01T19:55:05.561218+0000", 2023-08-01T19:56:20.146 INFO:teuthology.orchestra.run.smithi155.stdout: "duration": 4.9379999999999998e-05 2023-08-01T19:56:20.146 INFO:teuthology.orchestra.run.smithi155.stdout: }, 2023-08-01T19:56:20.146 INFO:teuthology.orchestra.run.smithi155.stdout: { 2023-08-01T19:56:20.146 INFO:teuthology.orchestra.run.smithi155.stdout: "event": "dispatched", 2023-08-01T19:56:20.146 INFO:teuthology.orchestra.run.smithi155.stdout: "time": "2023-08-01T19:55:05.561225+0000", 2023-08-01T19:56:20.146 INFO:teuthology.orchestra.run.smithi155.stdout: "duration": 7.114e-06 2023-08-01T19:56:20.147 INFO:teuthology.orchestra.run.smithi155.stdout: }, 2023-08-01T19:56:20.147 INFO:teuthology.orchestra.run.smithi155.stdout: { 2023-08-01T19:56:20.147 INFO:teuthology.orchestra.run.smithi155.stdout: "event": "queued_for_pg", 2023-08-01T19:56:20.147 INFO:teuthology.orchestra.run.smithi155.stdout: "time": "2023-08-01T19:55:05.561229+0000", 2023-08-01T19:56:20.147 INFO:teuthology.orchestra.run.smithi155.stdout: "duration": 4.2180000000000001e-06 2023-08-01T19:56:20.147 INFO:teuthology.orchestra.run.smithi155.stdout: }, 2023-08-01T19:56:20.147 INFO:teuthology.orchestra.run.smithi155.stdout: { 2023-08-01T19:56:20.147 INFO:teuthology.orchestra.run.smithi155.stdout: "event": "reached_pg", 2023-08-01T19:56:20.148 INFO:teuthology.orchestra.run.smithi155.stdout: "time": "2023-08-01T19:55:05.564737+0000", 2023-08-01T19:56:20.148 INFO:teuthology.orchestra.run.smithi155.stdout: "duration": 0.0035081869999999999 2023-08-01T19:56:20.148 INFO:teuthology.orchestra.run.smithi155.stdout: }, 2023-08-01T19:56:20.148 INFO:teuthology.orchestra.run.smithi155.stdout: { 2023-08-01T19:56:20.148 INFO:teuthology.orchestra.run.smithi155.stdout: "event": "started", 2023-08-01T19:56:20.148 INFO:teuthology.orchestra.run.smithi155.stdout: "time": "2023-08-01T19:55:05.564859+0000", 2023-08-01T19:56:20.148 INFO:teuthology.orchestra.run.smithi155.stdout: "duration": 0.00012165800000000001 2023-08-01T19:56:20.149 INFO:teuthology.orchestra.run.smithi155.stdout: }, 2023-08-01T19:56:20.149 INFO:teuthology.orchestra.run.smithi155.stdout: { 2023-08-01T19:56:20.149 INFO:teuthology.orchestra.run.smithi155.stdout: "event": "waiting for subops from 0", 2023-08-01T19:56:20.149 INFO:teuthology.orchestra.run.smithi155.stdout: "time": "2023-08-01T19:55:05.565009+0000", 2023-08-01T19:56:20.149 INFO:teuthology.orchestra.run.smithi155.stdout: "duration": 0.00014979699999999999 2023-08-01T19:56:20.149 INFO:teuthology.orchestra.run.smithi155.stdout: }, 2023-08-01T19:56:20.149 INFO:teuthology.orchestra.run.smithi155.stdout: { 2023-08-01T19:56:20.149 INFO:teuthology.orchestra.run.smithi155.stdout: "event": "op_commit", 2023-08-01T19:56:20.150 INFO:teuthology.orchestra.run.smithi155.stdout: "time": "2023-08-01T19:55:05.568007+0000", 2023-08-01T19:56:20.150 INFO:teuthology.orchestra.run.smithi155.stdout: "duration": 0.00299796 2023-08-01T19:56:20.150 INFO:teuthology.orchestra.run.smithi155.stdout: }, 2023-08-01T19:56:20.150 INFO:teuthology.orchestra.run.smithi155.stdout: { 2023-08-01T19:56:20.150 INFO:teuthology.orchestra.run.smithi155.stdout: "event": "sub_op_commit_rec", 2023-08-01T19:56:20.150 INFO:teuthology.orchestra.run.smithi155.stdout: "time": "2023-08-01T19:55:05.627520+0000", 2023-08-01T19:56:20.150 INFO:teuthology.orchestra.run.smithi155.stdout: "duration": 0.059513636000000002 2023-08-01T19:56:20.151 INFO:teuthology.orchestra.run.smithi155.stdout: }, 2023-08-01T19:56:20.151 INFO:teuthology.orchestra.run.smithi155.stdout: { 2023-08-01T19:56:20.151 INFO:teuthology.orchestra.run.smithi155.stdout: "event": "commit_sent", 2023-08-01T19:56:20.151 INFO:teuthology.orchestra.run.smithi155.stdout: "time": "2023-08-01T19:55:05.627553+0000", 2023-08-01T19:56:20.151 INFO:teuthology.orchestra.run.smithi155.stdout: "duration": 3.2635999999999997e-05 2023-08-01T19:56:20.151 INFO:teuthology.orchestra.run.smithi155.stdout: }, 2023-08-01T19:56:20.151 INFO:teuthology.orchestra.run.smithi155.stdout: { 2023-08-01T19:56:20.151 INFO:teuthology.orchestra.run.smithi155.stdout: "event": "done", 2023-08-01T19:56:20.152 INFO:teuthology.orchestra.run.smithi155.stdout: "time": "2023-08-01T19:55:05.627581+0000", 2023-08-01T19:56:20.152 INFO:teuthology.orchestra.run.smithi155.stdout: "duration": 2.7681000000000001e-05 2023-08-01T19:56:20.152 INFO:teuthology.orchestra.run.smithi155.stdout: } 2023-08-01T19:56:20.152 INFO:teuthology.orchestra.run.smithi155.stdout: ] 2023-08-01T19:56:20.152 INFO:teuthology.orchestra.run.smithi155.stdout: } 2023-08-01T19:56:20.152 INFO:teuthology.orchestra.run.smithi155.stdout: }, 2023-08-01T19:56:20.152 INFO:teuthology.orchestra.run.smithi155.stdout: { 2023-08-01T19:56:20.152 INFO:teuthology.orchestra.run.smithi155.stdout: "description": "osd_op(client.4668.0:100935 5.e 5:7895b14e:::benchmark_data_smithi006_114134_object100934:head [set-alloc-hint object_size 65536 write_size 65536,write 0~65536] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e37)", 2023-08-01T19:56:20.153 INFO:teuthology.orchestra.run.smithi155.stdout: "initiated_at": "2023-08-01T19:55:05.566666+0000", 2023-08-01T19:56:20.153 INFO:teuthology.orchestra.run.smithi155.stdout: "age": 74.466216175, 2023-08-01T19:56:20.153 INFO:teuthology.orchestra.run.smithi155.stdout: "duration": 0.064309016999999996, 2023-08-01T19:56:20.153 INFO:teuthology.orchestra.run.smithi155.stdout: "type_data": { 2023-08-01T19:56:20.153 INFO:teuthology.orchestra.run.smithi155.stdout: "flag_point": "commit sent; apply or cleanup", 2023-08-01T19:56:20.153 INFO:teuthology.orchestra.run.smithi155.stdout: "client_info": { 2023-08-01T19:56:20.153 INFO:teuthology.orchestra.run.smithi155.stdout: "client": "client.4668", 2023-08-01T19:56:20.154 INFO:teuthology.orchestra.run.smithi155.stdout: "client_addr": "172.21.15.6:0/1709472247", 2023-08-01T19:56:20.154 INFO:teuthology.orchestra.run.smithi155.stdout: "tid": 100935 2023-08-01T19:56:20.154 INFO:teuthology.orchestra.run.smithi155.stdout: }, 2023-08-01T19:56:20.154 INFO:teuthology.orchestra.run.smithi155.stdout: "events": [ 2023-08-01T19:56:20.154 INFO:teuthology.orchestra.run.smithi155.stdout: { 2023-08-01T19:56:20.154 INFO:teuthology.orchestra.run.smithi155.stdout: "event": "initiated", 2023-08-01T19:56:20.154 INFO:teuthology.orchestra.run.smithi155.stdout: "time": "2023-08-01T19:55:05.566666+0000", 2023-08-01T19:56:20.154 INFO:teuthology.orchestra.run.smithi155.stdout: "duration": 0 2023-08-01T19:56:20.155 INFO:teuthology.orchestra.run.smithi155.stdout: }, 2023-08-01T19:56:20.155 INFO:teuthology.orchestra.run.smithi155.stdout: { 2023-08-01T19:56:20.155 INFO:teuthology.orchestra.run.smithi155.stdout: "event": "throttled", 2023-08-01T19:56:20.155 INFO:teuthology.orchestra.run.smithi155.stdout: "time": "2023-08-01T19:55:05.566666+0000", 2023-08-01T19:56:20.155 INFO:teuthology.orchestra.run.smithi155.stdout: "duration": 0 2023-08-01T19:56:20.155 INFO:teuthology.orchestra.run.smithi155.stdout: }, 2023-08-01T19:56:20.155 INFO:teuthology.orchestra.run.smithi155.stdout: { 2023-08-01T19:56:20.155 INFO:teuthology.orchestra.run.smithi155.stdout: "event": "header_read", 2023-08-01T19:56:20.156 INFO:teuthology.orchestra.run.smithi155.stdout: "time": "2023-08-01T19:55:05.566665+0000", 2023-08-01T19:56:20.156 INFO:teuthology.orchestra.run.smithi155.stdout: "duration": 4294967295.9999986 2023-08-01T19:56:20.156 INFO:teuthology.orchestra.run.smithi155.stdout: }, 2023-08-01T19:56:20.156 INFO:teuthology.orchestra.run.smithi155.stdout: { 2023-08-01T19:56:20.156 INFO:teuthology.orchestra.run.smithi155.stdout: "event": "all_read", 2023-08-01T19:56:20.156 INFO:teuthology.orchestra.run.smithi155.stdout: "time": "2023-08-01T19:55:05.566754+0000", 2023-08-01T19:56:20.156 INFO:teuthology.orchestra.run.smithi155.stdout: "duration": 8.9425999999999994e-05 2023-08-01T19:56:20.156 INFO:teuthology.orchestra.run.smithi155.stdout: }, 2023-08-01T19:56:20.157 INFO:teuthology.orchestra.run.smithi155.stdout: { 2023-08-01T19:56:20.157 INFO:teuthology.orchestra.run.smithi155.stdout: "event": "dispatched", 2023-08-01T19:56:20.157 INFO:teuthology.orchestra.run.smithi155.stdout: "time": "2023-08-01T19:55:05.566766+0000", 2023-08-01T19:56:20.157 INFO:teuthology.orchestra.run.smithi155.stdout: "duration": 1.2018000000000001e-05 2023-08-01T19:56:20.157 INFO:teuthology.orchestra.run.smithi155.stdout: }, 2023-08-01T19:56:20.157 INFO:teuthology.orchestra.run.smithi155.stdout: { 2023-08-01T19:56:20.157 INFO:teuthology.orchestra.run.smithi155.stdout: "event": "queued_for_pg", 2023-08-01T19:56:20.157 INFO:teuthology.orchestra.run.smithi155.stdout: "time": "2023-08-01T19:55:05.566772+0000", 2023-08-01T19:56:20.158 INFO:teuthology.orchestra.run.smithi155.stdout: "duration": 6.0190000000000003e-06 2023-08-01T19:56:20.158 INFO:teuthology.orchestra.run.smithi155.stdout: }, 2023-08-01T19:56:20.158 INFO:teuthology.orchestra.run.smithi155.stdout: { 2023-08-01T19:56:20.158 INFO:teuthology.orchestra.run.smithi155.stdout: "event": "reached_pg", 2023-08-01T19:56:20.158 INFO:teuthology.orchestra.run.smithi155.stdout: "time": "2023-08-01T19:55:05.566800+0000", 2023-08-01T19:56:20.158 INFO:teuthology.orchestra.run.smithi155.stdout: "duration": 2.7835999999999999e-05 2023-08-01T19:56:20.158 INFO:teuthology.orchestra.run.smithi155.stdout: }, 2023-08-01T19:56:20.158 INFO:teuthology.orchestra.run.smithi155.stdout: { 2023-08-01T19:56:20.159 INFO:teuthology.orchestra.run.smithi155.stdout: "event": "started", 2023-08-01T19:56:20.159 INFO:teuthology.orchestra.run.smithi155.stdout: "time": "2023-08-01T19:55:05.566879+0000", 2023-08-01T19:56:20.159 INFO:teuthology.orchestra.run.smithi155.stdout: "duration": 7.9105999999999998e-05 2023-08-01T19:56:20.159 INFO:teuthology.orchestra.run.smithi155.stdout: }, 2023-08-01T19:56:20.159 INFO:teuthology.orchestra.run.smithi155.stdout: { 2023-08-01T19:56:20.159 INFO:teuthology.orchestra.run.smithi155.stdout: "event": "waiting for subops from 0", 2023-08-01T19:56:20.159 INFO:teuthology.orchestra.run.smithi155.stdout: "time": "2023-08-01T19:55:05.566971+0000", 2023-08-01T19:56:20.159 INFO:teuthology.orchestra.run.smithi155.stdout: "duration": 9.1817999999999994e-05 2023-08-01T19:56:20.160 INFO:teuthology.orchestra.run.smithi155.stdout: }, 2023-08-01T19:56:20.160 INFO:teuthology.orchestra.run.smithi155.stdout: { 2023-08-01T19:56:20.160 INFO:teuthology.orchestra.run.smithi155.stdout: "event": "op_commit", 2023-08-01T19:56:20.160 INFO:teuthology.orchestra.run.smithi155.stdout: "time": "2023-08-01T19:55:05.571475+0000", 2023-08-01T19:56:20.160 INFO:teuthology.orchestra.run.smithi155.stdout: "duration": 0.0045039499999999996 2023-08-01T19:56:20.160 INFO:teuthology.orchestra.run.smithi155.stdout: }, 2023-08-01T19:56:20.160 INFO:teuthology.orchestra.run.smithi155.stdout: { 2023-08-01T19:56:20.160 INFO:teuthology.orchestra.run.smithi155.stdout: "event": "sub_op_commit_rec", 2023-08-01T19:56:20.161 INFO:teuthology.orchestra.run.smithi155.stdout: "time": "2023-08-01T19:55:05.630884+0000", 2023-08-01T19:56:20.161 INFO:teuthology.orchestra.run.smithi155.stdout: "duration": 0.059409181999999998 2023-08-01T19:56:20.161 INFO:teuthology.orchestra.run.smithi155.stdout: }, 2023-08-01T19:56:20.161 INFO:teuthology.orchestra.run.smithi155.stdout: { 2023-08-01T19:56:20.161 INFO:teuthology.orchestra.run.smithi155.stdout: "event": "commit_sent", 2023-08-01T19:56:20.161 INFO:teuthology.orchestra.run.smithi155.stdout: "time": "2023-08-01T19:55:05.630930+0000", 2023-08-01T19:56:20.161 INFO:teuthology.orchestra.run.smithi155.stdout: "duration": 4.5507999999999999e-05 2023-08-01T19:56:20.161 INFO:teuthology.orchestra.run.smithi155.stdout: }, 2023-08-01T19:56:20.162 INFO:teuthology.orchestra.run.smithi155.stdout: { 2023-08-01T19:56:20.162 INFO:teuthology.orchestra.run.smithi155.stdout: "event": "done", 2023-08-01T19:56:20.162 INFO:teuthology.orchestra.run.smithi155.stdout: "time": "2023-08-01T19:55:05.630975+0000", 2023-08-01T19:56:20.162 INFO:teuthology.orchestra.run.smithi155.stdout: "duration": 4.5441000000000001e-05 2023-08-01T19:56:20.162 INFO:teuthology.orchestra.run.smithi155.stdout: } 2023-08-01T19:56:20.162 INFO:teuthology.orchestra.run.smithi155.stdout: ] 2023-08-01T19:56:20.162 INFO:teuthology.orchestra.run.smithi155.stdout: } 2023-08-01T19:56:20.163 INFO:teuthology.orchestra.run.smithi155.stdout: }, 2023-08-01T19:56:20.163 INFO:teuthology.orchestra.run.smithi155.stdout: { 2023-08-01T19:56:20.163 INFO:teuthology.orchestra.run.smithi155.stdout: "description": "osd_op(client.4668.0:100941 5.e 5:736a6ac6:::benchmark_data_smithi006_114134_object100940:head [set-alloc-hint object_size 65536 write_size 65536,write 0~65536] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e37)", 2023-08-01T19:56:20.163 INFO:teuthology.orchestra.run.smithi155.stdout: "initiated_at": "2023-08-01T19:55:05.569750+0000", 2023-08-01T19:56:20.163 INFO:teuthology.orchestra.run.smithi155.stdout: "age": 74.463132282000004, 2023-08-01T19:56:20.163 INFO:teuthology.orchestra.run.smithi155.stdout: "duration": 0.065431331999999995, 2023-08-01T19:56:20.163 INFO:teuthology.orchestra.run.smithi155.stdout: "type_data": { 2023-08-01T19:56:20.163 INFO:teuthology.orchestra.run.smithi155.stdout: "flag_point": "commit sent; apply or cleanup", 2023-08-01T19:56:20.164 INFO:teuthology.orchestra.run.smithi155.stdout: "client_info": { 2023-08-01T19:56:20.164 INFO:teuthology.orchestra.run.smithi155.stdout: "client": "client.4668", 2023-08-01T19:56:20.164 INFO:teuthology.orchestra.run.smithi155.stdout: "client_addr": "172.21.15.6:0/1709472247", 2023-08-01T19:56:20.164 INFO:teuthology.orchestra.run.smithi155.stdout: "tid": 100941 2023-08-01T19:56:20.164 INFO:teuthology.orchestra.run.smithi155.stdout: }, 2023-08-01T19:56:20.164 INFO:teuthology.orchestra.run.smithi155.stdout: "events": [ 2023-08-01T19:56:20.164 INFO:teuthology.orchestra.run.smithi155.stdout: { 2023-08-01T19:56:20.165 INFO:teuthology.orchestra.run.smithi155.stdout: "event": "initiated", 2023-08-01T19:56:20.165 INFO:teuthology.orchestra.run.smithi155.stdout: "time": "2023-08-01T19:55:05.569750+0000", 2023-08-01T19:56:20.165 INFO:teuthology.orchestra.run.smithi155.stdout: "duration": 0 2023-08-01T19:56:20.165 INFO:teuthology.orchestra.run.smithi155.stdout: }, 2023-08-01T19:56:20.165 INFO:teuthology.orchestra.run.smithi155.stdout: { 2023-08-01T19:56:20.165 INFO:teuthology.orchestra.run.smithi155.stdout: "event": "throttled", 2023-08-01T19:56:20.165 INFO:teuthology.orchestra.run.smithi155.stdout: "time": "2023-08-01T19:55:05.569750+0000", 2023-08-01T19:56:20.165 INFO:teuthology.orchestra.run.smithi155.stdout: "duration": 0 2023-08-01T19:56:20.166 INFO:teuthology.orchestra.run.smithi155.stdout: }, 2023-08-01T19:56:20.166 INFO:teuthology.orchestra.run.smithi155.stdout: { 2023-08-01T19:56:20.166 INFO:teuthology.orchestra.run.smithi155.stdout: "event": "header_read", 2023-08-01T19:56:20.166 INFO:teuthology.orchestra.run.smithi155.stdout: "time": "2023-08-01T19:55:05.569749+0000", 2023-08-01T19:56:20.166 INFO:teuthology.orchestra.run.smithi155.stdout: "duration": 4294967295.999999 2023-08-01T19:56:20.166 INFO:teuthology.orchestra.run.smithi155.stdout: }, 2023-08-01T19:56:20.166 INFO:teuthology.orchestra.run.smithi155.stdout: { 2023-08-01T19:56:20.166 INFO:teuthology.orchestra.run.smithi155.stdout: "event": "all_read", 2023-08-01T19:56:20.167 INFO:teuthology.orchestra.run.smithi155.stdout: "time": "2023-08-01T19:55:05.569861+0000", 2023-08-01T19:56:20.167 INFO:teuthology.orchestra.run.smithi155.stdout: "duration": 0.000111333 2023-08-01T19:56:20.167 INFO:teuthology.orchestra.run.smithi155.stdout: }, 2023-08-01T19:56:20.167 INFO:teuthology.orchestra.run.smithi155.stdout: { 2023-08-01T19:56:20.167 INFO:teuthology.orchestra.run.smithi155.stdout: "event": "dispatched", 2023-08-01T19:56:20.167 INFO:teuthology.orchestra.run.smithi155.stdout: "time": "2023-08-01T19:55:05.569869+0000", 2023-08-01T19:56:20.167 INFO:teuthology.orchestra.run.smithi155.stdout: "duration": 8.8589999999999994e-06 2023-08-01T19:56:20.167 INFO:teuthology.orchestra.run.smithi155.stdout: }, 2023-08-01T19:56:20.168 INFO:teuthology.orchestra.run.smithi155.stdout: { 2023-08-01T19:56:20.168 INFO:teuthology.orchestra.run.smithi155.stdout: "event": "queued_for_pg", 2023-08-01T19:56:20.168 INFO:teuthology.orchestra.run.smithi155.stdout: "time": "2023-08-01T19:55:05.569874+0000", 2023-08-01T19:56:20.168 INFO:teuthology.orchestra.run.smithi155.stdout: "duration": 4.1679999999999997e-06 2023-08-01T19:56:20.168 INFO:teuthology.orchestra.run.smithi155.stdout: }, 2023-08-01T19:56:20.168 INFO:teuthology.orchestra.run.smithi155.stdout: { 2023-08-01T19:56:20.168 INFO:teuthology.orchestra.run.smithi155.stdout: "event": "reached_pg", 2023-08-01T19:56:20.168 INFO:teuthology.orchestra.run.smithi155.stdout: "time": "2023-08-01T19:55:05.569904+0000", 2023-08-01T19:56:20.169 INFO:teuthology.orchestra.run.smithi155.stdout: "duration": 3.0920999999999998e-05 2023-08-01T19:56:20.169 INFO:teuthology.orchestra.run.smithi155.stdout: }, 2023-08-01T19:56:20.169 INFO:teuthology.orchestra.run.smithi155.stdout: { 2023-08-01T19:56:20.169 INFO:teuthology.orchestra.run.smithi155.stdout: "event": "started", 2023-08-01T19:56:20.169 INFO:teuthology.orchestra.run.smithi155.stdout: "time": "2023-08-01T19:55:05.569998+0000", 2023-08-01T19:56:20.169 INFO:teuthology.orchestra.run.smithi155.stdout: "duration": 9.3086999999999998e-05 2023-08-01T19:56:20.169 INFO:teuthology.orchestra.run.smithi155.stdout: }, 2023-08-01T19:56:20.169 INFO:teuthology.orchestra.run.smithi155.stdout: { 2023-08-01T19:56:20.170 INFO:teuthology.orchestra.run.smithi155.stdout: "event": "waiting for subops from 0", 2023-08-01T19:56:20.170 INFO:teuthology.orchestra.run.smithi155.stdout: "time": "2023-08-01T19:55:05.570093+0000", 2023-08-01T19:56:20.170 INFO:teuthology.orchestra.run.smithi155.stdout: "duration": 9.5768999999999997e-05 2023-08-01T19:56:20.170 INFO:teuthology.orchestra.run.smithi155.stdout: }, 2023-08-01T19:56:20.170 INFO:teuthology.orchestra.run.smithi155.stdout: { 2023-08-01T19:56:20.170 INFO:teuthology.orchestra.run.smithi155.stdout: "event": "op_commit", 2023-08-01T19:56:20.170 INFO:teuthology.orchestra.run.smithi155.stdout: "time": "2023-08-01T19:55:05.572839+0000", 2023-08-01T19:56:20.170 INFO:teuthology.orchestra.run.smithi155.stdout: "duration": 0.0027460050000000001 2023-08-01T19:56:20.171 INFO:teuthology.orchestra.run.smithi155.stdout: }, 2023-08-01T19:56:20.171 INFO:teuthology.orchestra.run.smithi155.stdout: { 2023-08-01T19:56:20.171 INFO:teuthology.orchestra.run.smithi155.stdout: "event": "sub_op_commit_rec", 2023-08-01T19:56:20.171 INFO:teuthology.orchestra.run.smithi155.stdout: "time": "2023-08-01T19:55:05.635114+0000", 2023-08-01T19:56:20.171 INFO:teuthology.orchestra.run.smithi155.stdout: "duration": 0.062274297999999999 2023-08-01T19:56:20.171 INFO:teuthology.orchestra.run.smithi155.stdout: }, 2023-08-01T19:56:20.171 INFO:teuthology.orchestra.run.smithi155.stdout: { 2023-08-01T19:56:20.171 INFO:teuthology.orchestra.run.smithi155.stdout: "event": "commit_sent", 2023-08-01T19:56:20.172 INFO:teuthology.orchestra.run.smithi155.stdout: "time": "2023-08-01T19:55:05.635143+0000", 2023-08-01T19:56:20.172 INFO:teuthology.orchestra.run.smithi155.stdout: "duration": 2.9430000000000001e-05 2023-08-01T19:56:20.172 INFO:teuthology.orchestra.run.smithi155.stdout: }, 2023-08-01T19:56:20.172 INFO:teuthology.orchestra.run.smithi155.stdout: { 2023-08-01T19:56:20.172 INFO:teuthology.orchestra.run.smithi155.stdout: "event": "done", 2023-08-01T19:56:20.172 INFO:teuthology.orchestra.run.smithi155.stdout: "time": "2023-08-01T19:55:05.635181+0000", 2023-08-01T19:56:20.172 INFO:teuthology.orchestra.run.smithi155.stdout: "duration": 3.8352000000000001e-05 2023-08-01T19:56:20.173 INFO:teuthology.orchestra.run.smithi155.stdout: } 2023-08-01T19:56:20.173 INFO:teuthology.orchestra.run.smithi155.stdout: ] 2023-08-01T19:56:20.173 INFO:teuthology.orchestra.run.smithi155.stdout: } 2023-08-01T19:56:20.173 INFO:teuthology.orchestra.run.smithi155.stdout: }, 2023-08-01T19:56:20.173 INFO:teuthology.orchestra.run.smithi155.stdout: { 2023-08-01T19:56:20.173 INFO:teuthology.orchestra.run.smithi155.stdout: "description": "osd_op(client.4668.0:100945 5.e 5:73df68dd:::benchmark_data_smithi006_114134_object100944:head [set-alloc-hint object_size 65536 write_size 65536,write 0~65536] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e37)", 2023-08-01T19:56:20.173 INFO:teuthology.orchestra.run.smithi155.stdout: "initiated_at": "2023-08-01T19:55:05.576784+0000", 2023-08-01T19:56:20.174 INFO:teuthology.orchestra.run.smithi155.stdout: "age": 74.456098697000002, 2023-08-01T19:56:20.174 INFO:teuthology.orchestra.run.smithi155.stdout: "duration": 0.058512994999999998, 2023-08-01T19:56:20.174 INFO:teuthology.orchestra.run.smithi155.stdout: "type_data": { 2023-08-01T19:56:20.174 INFO:teuthology.orchestra.run.smithi155.stdout: "flag_point": "commit sent; apply or cleanup", 2023-08-01T19:56:20.174 INFO:teuthology.orchestra.run.smithi155.stdout: "client_info": { 2023-08-01T19:56:20.174 INFO:teuthology.orchestra.run.smithi155.stdout: "client": "client.4668", 2023-08-01T19:56:20.174 INFO:teuthology.orchestra.run.smithi155.stdout: "client_addr": "172.21.15.6:0/1709472247", 2023-08-01T19:56:20.174 INFO:teuthology.orchestra.run.smithi155.stdout: "tid": 100945 2023-08-01T19:56:20.175 INFO:teuthology.orchestra.run.smithi155.stdout: }, 2023-08-01T19:56:20.175 INFO:teuthology.orchestra.run.smithi155.stdout: "events": [ 2023-08-01T19:56:20.175 INFO:teuthology.orchestra.run.smithi155.stdout: { 2023-08-01T19:56:20.175 INFO:teuthology.orchestra.run.smithi155.stdout: "event": "initiated", 2023-08-01T19:56:20.175 INFO:teuthology.orchestra.run.smithi155.stdout: "time": "2023-08-01T19:55:05.576784+0000", 2023-08-01T19:56:20.175 INFO:teuthology.orchestra.run.smithi155.stdout: "duration": 0 2023-08-01T19:56:20.175 INFO:teuthology.orchestra.run.smithi155.stdout: }, 2023-08-01T19:56:20.175 INFO:teuthology.orchestra.run.smithi155.stdout: { 2023-08-01T19:56:20.176 INFO:teuthology.orchestra.run.smithi155.stdout: "event": "throttled", 2023-08-01T19:56:20.176 INFO:teuthology.orchestra.run.smithi155.stdout: "time": "2023-08-01T19:55:05.576784+0000", 2023-08-01T19:56:20.176 INFO:teuthology.orchestra.run.smithi155.stdout: "duration": 0 2023-08-01T19:56:20.176 INFO:teuthology.orchestra.run.smithi155.stdout: }, 2023-08-01T19:56:20.176 INFO:teuthology.orchestra.run.smithi155.stdout: { 2023-08-01T19:56:20.176 INFO:teuthology.orchestra.run.smithi155.stdout: "event": "header_read", 2023-08-01T19:56:20.176 INFO:teuthology.orchestra.run.smithi155.stdout: "time": "2023-08-01T19:55:05.576783+0000", 2023-08-01T19:56:20.177 INFO:teuthology.orchestra.run.smithi155.stdout: "duration": 4294967295.9999995 2023-08-01T19:56:20.177 INFO:teuthology.orchestra.run.smithi155.stdout: }, 2023-08-01T19:56:20.177 INFO:teuthology.orchestra.run.smithi155.stdout: { 2023-08-01T19:56:20.177 INFO:teuthology.orchestra.run.smithi155.stdout: "event": "all_read", 2023-08-01T19:56:20.177 INFO:teuthology.orchestra.run.smithi155.stdout: "time": "2023-08-01T19:55:05.576807+0000", 2023-08-01T19:56:20.177 INFO:teuthology.orchestra.run.smithi155.stdout: "duration": 2.3651000000000001e-05 2023-08-01T19:56:20.177 INFO:teuthology.orchestra.run.smithi155.stdout: }, 2023-08-01T19:56:20.177 INFO:teuthology.orchestra.run.smithi155.stdout: { 2023-08-01T19:56:20.178 INFO:teuthology.orchestra.run.smithi155.stdout: "event": "dispatched", 2023-08-01T19:56:20.178 INFO:teuthology.orchestra.run.smithi155.stdout: "time": "2023-08-01T19:55:05.576817+0000", 2023-08-01T19:56:20.178 INFO:teuthology.orchestra.run.smithi155.stdout: "duration": 9.9389999999999992e-06 2023-08-01T19:56:20.178 INFO:teuthology.orchestra.run.smithi155.stdout: }, 2023-08-01T19:56:20.178 INFO:teuthology.orchestra.run.smithi155.stdout: { 2023-08-01T19:56:20.178 INFO:teuthology.orchestra.run.smithi155.stdout: "event": "queued_for_pg", 2023-08-01T19:56:20.178 INFO:teuthology.orchestra.run.smithi155.stdout: "time": "2023-08-01T19:55:05.576820+0000", 2023-08-01T19:56:20.178 INFO:teuthology.orchestra.run.smithi155.stdout: "duration": 3.2619999999999999e-06 2023-08-01T19:56:20.179 INFO:teuthology.orchestra.run.smithi155.stdout: }, 2023-08-01T19:56:20.179 INFO:teuthology.orchestra.run.smithi155.stdout: { 2023-08-01T19:56:20.179 INFO:teuthology.orchestra.run.smithi155.stdout: "event": "reached_pg", 2023-08-01T19:56:20.179 INFO:teuthology.orchestra.run.smithi155.stdout: "time": "2023-08-01T19:55:05.576849+0000", 2023-08-01T19:56:20.179 INFO:teuthology.orchestra.run.smithi155.stdout: "duration": 2.8880000000000001e-05 2023-08-01T19:56:20.179 INFO:teuthology.orchestra.run.smithi155.stdout: }, 2023-08-01T19:56:20.179 INFO:teuthology.orchestra.run.smithi155.stdout: { 2023-08-01T19:56:20.179 INFO:teuthology.orchestra.run.smithi155.stdout: "event": "started", 2023-08-01T19:56:20.180 INFO:teuthology.orchestra.run.smithi155.stdout: "time": "2023-08-01T19:55:05.576940+0000", 2023-08-01T19:56:20.180 INFO:teuthology.orchestra.run.smithi155.stdout: "duration": 9.0570999999999997e-05 2023-08-01T19:56:20.180 INFO:teuthology.orchestra.run.smithi155.stdout: }, 2023-08-01T19:56:20.180 INFO:teuthology.orchestra.run.smithi155.stdout: { 2023-08-01T19:56:20.180 INFO:teuthology.orchestra.run.smithi155.stdout: "event": "waiting for subops from 0", 2023-08-01T19:56:20.180 INFO:teuthology.orchestra.run.smithi155.stdout: "time": "2023-08-01T19:55:05.577027+0000", 2023-08-01T19:56:20.180 INFO:teuthology.orchestra.run.smithi155.stdout: "duration": 8.7237999999999994e-05 2023-08-01T19:56:20.181 INFO:teuthology.orchestra.run.smithi155.stdout: }, 2023-08-01T19:56:20.181 INFO:teuthology.orchestra.run.smithi155.stdout: { 2023-08-01T19:56:20.181 INFO:teuthology.orchestra.run.smithi155.stdout: "event": "op_commit", 2023-08-01T19:56:20.181 INFO:teuthology.orchestra.run.smithi155.stdout: "time": "2023-08-01T19:55:05.579624+0000", 2023-08-01T19:56:20.181 INFO:teuthology.orchestra.run.smithi155.stdout: "duration": 0.0025971200000000001 2023-08-01T19:56:20.181 INFO:teuthology.orchestra.run.smithi155.stdout: }, 2023-08-01T19:56:20.181 INFO:teuthology.orchestra.run.smithi155.stdout: { 2023-08-01T19:56:20.181 INFO:teuthology.orchestra.run.smithi155.stdout: "event": "sub_op_commit_rec", 2023-08-01T19:56:20.182 INFO:teuthology.orchestra.run.smithi155.stdout: "time": "2023-08-01T19:55:05.635218+0000", 2023-08-01T19:56:20.182 INFO:teuthology.orchestra.run.smithi155.stdout: "duration": 0.055594487999999997 2023-08-01T19:56:20.182 INFO:teuthology.orchestra.run.smithi155.stdout: }, 2023-08-01T19:56:20.182 INFO:teuthology.orchestra.run.smithi155.stdout: { 2023-08-01T19:56:20.182 INFO:teuthology.orchestra.run.smithi155.stdout: "event": "commit_sent", 2023-08-01T19:56:20.182 INFO:teuthology.orchestra.run.smithi155.stdout: "time": "2023-08-01T19:55:05.635262+0000", 2023-08-01T19:56:20.182 INFO:teuthology.orchestra.run.smithi155.stdout: "duration": 4.3380999999999997e-05 2023-08-01T19:56:20.182 INFO:teuthology.orchestra.run.smithi155.stdout: }, 2023-08-01T19:56:20.183 INFO:teuthology.orchestra.run.smithi155.stdout: { 2023-08-01T19:56:20.183 INFO:teuthology.orchestra.run.smithi155.stdout: "event": "done", 2023-08-01T19:56:20.183 INFO:teuthology.orchestra.run.smithi155.stdout: "time": "2023-08-01T19:55:05.635297+0000", 2023-08-01T19:56:20.183 INFO:teuthology.orchestra.run.smithi155.stdout: "duration": 3.4842000000000003e-05 2023-08-01T19:56:20.183 INFO:teuthology.orchestra.run.smithi155.stdout: } 2023-08-01T19:56:20.183 INFO:teuthology.orchestra.run.smithi155.stdout: ] 2023-08-01T19:56:20.183 INFO:teuthology.orchestra.run.smithi155.stdout: } 2023-08-01T19:56:20.183 INFO:teuthology.orchestra.run.smithi155.stdout: }, 2023-08-01T19:56:20.184 INFO:teuthology.orchestra.run.smithi155.stdout: { 2023-08-01T19:56:20.184 INFO:teuthology.orchestra.run.smithi155.stdout: "description": "osd_op(client.4668.0:100947 5.4 5:23e8fc27:::benchmark_data_smithi006_114134_object100946:head [set-alloc-hint object_size 65536 write_size 65536,write 0~65536] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e37)", 2023-08-01T19:56:20.184 INFO:teuthology.orchestra.run.smithi155.stdout: "initiated_at": "2023-08-01T19:55:05.576840+0000", 2023-08-01T19:56:20.184 INFO:teuthology.orchestra.run.smithi155.stdout: "age": 74.456042642, 2023-08-01T19:56:20.184 INFO:teuthology.orchestra.run.smithi155.stdout: "duration": 0.058423127999999998, 2023-08-01T19:56:20.184 INFO:teuthology.orchestra.run.smithi155.stdout: "type_data": { 2023-08-01T19:56:20.184 INFO:teuthology.orchestra.run.smithi155.stdout: "flag_point": "commit sent; apply or cleanup", 2023-08-01T19:56:20.184 INFO:teuthology.orchestra.run.smithi155.stdout: "client_info": { 2023-08-01T19:56:20.185 INFO:teuthology.orchestra.run.smithi155.stdout: "client": "client.4668", 2023-08-01T19:56:20.185 INFO:teuthology.orchestra.run.smithi155.stdout: "client_addr": "172.21.15.6:0/1709472247", 2023-08-01T19:56:20.185 INFO:teuthology.orchestra.run.smithi155.stdout: "tid": 100947 2023-08-01T19:56:20.185 INFO:teuthology.orchestra.run.smithi155.stdout: }, 2023-08-01T19:56:20.185 INFO:teuthology.orchestra.run.smithi155.stdout: "events": [ 2023-08-01T19:56:20.185 INFO:teuthology.orchestra.run.smithi155.stdout: { 2023-08-01T19:56:20.185 INFO:teuthology.orchestra.run.smithi155.stdout: "event": "initiated", 2023-08-01T19:56:20.186 INFO:teuthology.orchestra.run.smithi155.stdout: "time": "2023-08-01T19:55:05.576840+0000", 2023-08-01T19:56:20.186 INFO:teuthology.orchestra.run.smithi155.stdout: "duration": 0 2023-08-01T19:56:20.186 INFO:teuthology.orchestra.run.smithi155.stdout: }, 2023-08-01T19:56:20.186 INFO:teuthology.orchestra.run.smithi155.stdout: { 2023-08-01T19:56:20.186 INFO:teuthology.orchestra.run.smithi155.stdout: "event": "throttled", 2023-08-01T19:56:20.186 INFO:teuthology.orchestra.run.smithi155.stdout: "time": "2023-08-01T19:55:05.576840+0000", 2023-08-01T19:56:20.186 INFO:teuthology.orchestra.run.smithi155.stdout: "duration": 0 2023-08-01T19:56:20.186 INFO:teuthology.orchestra.run.smithi155.stdout: }, 2023-08-01T19:56:20.187 INFO:teuthology.orchestra.run.smithi155.stdout: { 2023-08-01T19:56:20.187 INFO:teuthology.orchestra.run.smithi155.stdout: "event": "header_read", 2023-08-01T19:56:20.187 INFO:teuthology.orchestra.run.smithi155.stdout: "time": "2023-08-01T19:55:05.576839+0000", 2023-08-01T19:56:20.187 INFO:teuthology.orchestra.run.smithi155.stdout: "duration": 4294967295.9999995 2023-08-01T19:56:20.187 INFO:teuthology.orchestra.run.smithi155.stdout: }, 2023-08-01T19:56:20.187 INFO:teuthology.orchestra.run.smithi155.stdout: { 2023-08-01T19:56:20.187 INFO:teuthology.orchestra.run.smithi155.stdout: "event": "all_read", 2023-08-01T19:56:20.188 INFO:teuthology.orchestra.run.smithi155.stdout: "time": "2023-08-01T19:55:05.576893+0000", 2023-08-01T19:56:20.188 INFO:teuthology.orchestra.run.smithi155.stdout: "duration": 5.3893000000000001e-05 2023-08-01T19:56:20.188 INFO:teuthology.orchestra.run.smithi155.stdout: }, 2023-08-01T19:56:20.188 INFO:teuthology.orchestra.run.smithi155.stdout: { 2023-08-01T19:56:20.188 INFO:teuthology.orchestra.run.smithi155.stdout: "event": "dispatched", 2023-08-01T19:56:20.188 INFO:teuthology.orchestra.run.smithi155.stdout: "time": "2023-08-01T19:55:05.576902+0000", 2023-08-01T19:56:20.188 INFO:teuthology.orchestra.run.smithi155.stdout: "duration": 8.7520000000000002e-06 2023-08-01T19:56:20.188 INFO:teuthology.orchestra.run.smithi155.stdout: }, 2023-08-01T19:56:20.189 INFO:teuthology.orchestra.run.smithi155.stdout: { 2023-08-01T19:56:20.189 INFO:teuthology.orchestra.run.smithi155.stdout: "event": "queued_for_pg", 2023-08-01T19:56:20.189 INFO:teuthology.orchestra.run.smithi155.stdout: "time": "2023-08-01T19:55:05.576905+0000", 2023-08-01T19:56:20.189 INFO:teuthology.orchestra.run.smithi155.stdout: "duration": 3.01e-06 2023-08-01T19:56:20.189 INFO:teuthology.orchestra.run.smithi155.stdout: }, 2023-08-01T19:56:20.189 INFO:teuthology.orchestra.run.smithi155.stdout: { 2023-08-01T19:56:20.189 INFO:teuthology.orchestra.run.smithi155.stdout: "event": "reached_pg", 2023-08-01T19:56:20.189 INFO:teuthology.orchestra.run.smithi155.stdout: "time": "2023-08-01T19:55:05.579641+0000", 2023-08-01T19:56:20.190 INFO:teuthology.orchestra.run.smithi155.stdout: "duration": 0.0027366880000000001 2023-08-01T19:56:20.190 INFO:teuthology.orchestra.run.smithi155.stdout: }, 2023-08-01T19:56:20.190 INFO:teuthology.orchestra.run.smithi155.stdout: { 2023-08-01T19:56:20.190 INFO:teuthology.orchestra.run.smithi155.stdout: "event": "started", 2023-08-01T19:56:20.190 INFO:teuthology.orchestra.run.smithi155.stdout: "time": "2023-08-01T19:55:05.579734+0000", 2023-08-01T19:56:20.191 INFO:teuthology.orchestra.run.smithi155.stdout: "duration": 9.2590000000000006e-05 2023-08-01T19:56:20.191 INFO:teuthology.orchestra.run.smithi155.stdout: }, 2023-08-01T19:56:20.191 INFO:teuthology.orchestra.run.smithi155.stdout: { 2023-08-01T19:56:20.191 INFO:teuthology.orchestra.run.smithi155.stdout: "event": "waiting for subops from 0", 2023-08-01T19:56:20.191 INFO:teuthology.orchestra.run.smithi155.stdout: "time": "2023-08-01T19:55:05.579825+0000", 2023-08-01T19:56:20.191 INFO:teuthology.orchestra.run.smithi155.stdout: "duration": 9.0964999999999994e-05 2023-08-01T19:56:20.192 INFO:teuthology.orchestra.run.smithi155.stdout: }, 2023-08-01T19:56:20.192 INFO:teuthology.orchestra.run.smithi155.stdout: { 2023-08-01T19:56:20.192 INFO:teuthology.orchestra.run.smithi155.stdout: "event": "op_commit", 2023-08-01T19:56:20.192 INFO:teuthology.orchestra.run.smithi155.stdout: "time": "2023-08-01T19:55:05.585041+0000", 2023-08-01T19:56:20.192 INFO:teuthology.orchestra.run.smithi155.stdout: "duration": 0.0052159670000000002 2023-08-01T19:56:20.192 INFO:teuthology.orchestra.run.smithi155.stdout: }, 2023-08-01T19:56:20.192 INFO:teuthology.orchestra.run.smithi155.stdout: { 2023-08-01T19:56:20.192 INFO:teuthology.orchestra.run.smithi155.stdout: "event": "sub_op_commit_rec", 2023-08-01T19:56:20.193 INFO:teuthology.orchestra.run.smithi155.stdout: "time": "2023-08-01T19:55:05.635199+0000", 2023-08-01T19:56:20.193 INFO:teuthology.orchestra.run.smithi155.stdout: "duration": 0.050158023000000003 2023-08-01T19:56:20.193 INFO:teuthology.orchestra.run.smithi155.stdout: }, 2023-08-01T19:56:20.193 INFO:teuthology.orchestra.run.smithi155.stdout: { 2023-08-01T19:56:20.193 INFO:teuthology.orchestra.run.smithi155.stdout: "event": "commit_sent", 2023-08-01T19:56:20.193 INFO:teuthology.orchestra.run.smithi155.stdout: "time": "2023-08-01T19:55:05.635227+0000", 2023-08-01T19:56:20.193 INFO:teuthology.orchestra.run.smithi155.stdout: "duration": 2.7821e-05 2023-08-01T19:56:20.193 INFO:teuthology.orchestra.run.smithi155.stdout: }, 2023-08-01T19:56:20.194 INFO:teuthology.orchestra.run.smithi155.stdout: { 2023-08-01T19:56:20.194 INFO:teuthology.orchestra.run.smithi155.stdout: "event": "done", 2023-08-01T19:56:20.194 INFO:teuthology.orchestra.run.smithi155.stdout: "time": "2023-08-01T19:55:05.635263+0000", 2023-08-01T19:56:20.194 INFO:teuthology.orchestra.run.smithi155.stdout: "duration": 3.6081000000000002e-05 2023-08-01T19:56:20.194 INFO:teuthology.orchestra.run.smithi155.stdout: } 2023-08-01T19:56:20.194 INFO:teuthology.orchestra.run.smithi155.stdout: ] 2023-08-01T19:56:20.194 INFO:teuthology.orchestra.run.smithi155.stdout: } 2023-08-01T19:56:20.195 INFO:teuthology.orchestra.run.smithi155.stdout: }, 2023-08-01T19:56:20.195 INFO:teuthology.orchestra.run.smithi155.stdout: { 2023-08-01T19:56:20.195 INFO:teuthology.orchestra.run.smithi155.stdout: "description": "osd_op(client.4668.0:197408 5.d 5:bbda375a:::benchmark_data_smithi006_114134_object63747:head [delete] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e61)", 2023-08-01T19:56:20.195 INFO:teuthology.orchestra.run.smithi155.stdout: "initiated_at": "2023-08-01T19:55:58.559714+0000", 2023-08-01T19:56:20.195 INFO:teuthology.orchestra.run.smithi155.stdout: "age": 21.473168654999998, 2023-08-01T19:56:20.195 INFO:teuthology.orchestra.run.smithi155.stdout: "duration": 1.047043671, 2023-08-01T19:56:20.195 INFO:teuthology.orchestra.run.smithi155.stdout: "type_data": { 2023-08-01T19:56:20.195 INFO:teuthology.orchestra.run.smithi155.stdout: "flag_point": "commit sent; apply or cleanup", 2023-08-01T19:56:20.196 INFO:teuthology.orchestra.run.smithi155.stdout: "client_info": { 2023-08-01T19:56:20.196 INFO:teuthology.orchestra.run.smithi155.stdout: "client": "client.4668", 2023-08-01T19:56:20.196 INFO:teuthology.orchestra.run.smithi155.stdout: "client_addr": "172.21.15.6:0/1709472247", 2023-08-01T19:56:20.196 INFO:teuthology.orchestra.run.smithi155.stdout: "tid": 197408 2023-08-01T19:56:20.196 INFO:teuthology.orchestra.run.smithi155.stdout: }, 2023-08-01T19:56:20.196 INFO:teuthology.orchestra.run.smithi155.stdout: "events": [ 2023-08-01T19:56:20.196 INFO:teuthology.orchestra.run.smithi155.stdout: { 2023-08-01T19:56:20.196 INFO:teuthology.orchestra.run.smithi155.stdout: "event": "initiated", 2023-08-01T19:56:20.197 INFO:teuthology.orchestra.run.smithi155.stdout: "time": "2023-08-01T19:55:58.559714+0000", 2023-08-01T19:56:20.197 INFO:teuthology.orchestra.run.smithi155.stdout: "duration": 0 2023-08-01T19:56:20.197 INFO:teuthology.orchestra.run.smithi155.stdout: }, 2023-08-01T19:56:20.197 INFO:teuthology.orchestra.run.smithi155.stdout: { 2023-08-01T19:56:20.197 INFO:teuthology.orchestra.run.smithi155.stdout: "event": "throttled", 2023-08-01T19:56:20.197 INFO:teuthology.orchestra.run.smithi155.stdout: "time": "2023-08-01T19:55:58.559714+0000", 2023-08-01T19:56:20.197 INFO:teuthology.orchestra.run.smithi155.stdout: "duration": 0 2023-08-01T19:56:20.198 INFO:teuthology.orchestra.run.smithi155.stdout: }, 2023-08-01T19:56:20.198 INFO:teuthology.orchestra.run.smithi155.stdout: { 2023-08-01T19:56:20.198 INFO:teuthology.orchestra.run.smithi155.stdout: "event": "header_read", 2023-08-01T19:56:20.198 INFO:teuthology.orchestra.run.smithi155.stdout: "time": "2023-08-01T19:55:58.559713+0000", 2023-08-01T19:56:20.198 INFO:teuthology.orchestra.run.smithi155.stdout: "duration": 4294967295.999999 2023-08-01T19:56:20.198 INFO:teuthology.orchestra.run.smithi155.stdout: }, 2023-08-01T19:56:20.198 INFO:teuthology.orchestra.run.smithi155.stdout: { 2023-08-01T19:56:20.198 INFO:teuthology.orchestra.run.smithi155.stdout: "event": "all_read", 2023-08-01T19:56:20.199 INFO:teuthology.orchestra.run.smithi155.stdout: "time": "2023-08-01T19:55:58.559717+0000", 2023-08-01T19:56:20.199 INFO:teuthology.orchestra.run.smithi155.stdout: "duration": 4.2860000000000001e-06 2023-08-01T19:56:20.199 INFO:teuthology.orchestra.run.smithi155.stdout: }, 2023-08-01T19:56:20.199 INFO:teuthology.orchestra.run.smithi155.stdout: { 2023-08-01T19:56:20.199 INFO:teuthology.orchestra.run.smithi155.stdout: "event": "dispatched", 2023-08-01T19:56:20.199 INFO:teuthology.orchestra.run.smithi155.stdout: "time": "2023-08-01T19:55:58.559774+0000", 2023-08-01T19:56:20.199 INFO:teuthology.orchestra.run.smithi155.stdout: "duration": 5.6508999999999997e-05 2023-08-01T19:56:20.199 INFO:teuthology.orchestra.run.smithi155.stdout: }, 2023-08-01T19:56:20.200 INFO:teuthology.orchestra.run.smithi155.stdout: { 2023-08-01T19:56:20.200 INFO:teuthology.orchestra.run.smithi155.stdout: "event": "queued_for_pg", 2023-08-01T19:56:20.200 INFO:teuthology.orchestra.run.smithi155.stdout: "time": "2023-08-01T19:55:58.559781+0000", 2023-08-01T19:56:20.200 INFO:teuthology.orchestra.run.smithi155.stdout: "duration": 7.1829999999999997e-06 2023-08-01T19:56:20.200 INFO:teuthology.orchestra.run.smithi155.stdout: }, 2023-08-01T19:56:20.200 INFO:teuthology.orchestra.run.smithi155.stdout: { 2023-08-01T19:56:20.200 INFO:teuthology.orchestra.run.smithi155.stdout: "event": "reached_pg", 2023-08-01T19:56:20.200 INFO:teuthology.orchestra.run.smithi155.stdout: "time": "2023-08-01T19:55:58.571621+0000", 2023-08-01T19:56:20.201 INFO:teuthology.orchestra.run.smithi155.stdout: "duration": 0.011840603999999999 2023-08-01T19:56:20.201 INFO:teuthology.orchestra.run.smithi155.stdout: }, 2023-08-01T19:56:20.201 INFO:teuthology.orchestra.run.smithi155.stdout: { 2023-08-01T19:56:20.201 INFO:teuthology.orchestra.run.smithi155.stdout: "event": "waiting for peered", 2023-08-01T19:56:20.201 INFO:teuthology.orchestra.run.smithi155.stdout: "time": "2023-08-01T19:55:58.571630+0000", 2023-08-01T19:56:20.201 INFO:teuthology.orchestra.run.smithi155.stdout: "duration": 8.9770000000000006e-06 2023-08-01T19:56:20.201 INFO:teuthology.orchestra.run.smithi155.stdout: }, 2023-08-01T19:56:20.201 INFO:teuthology.orchestra.run.smithi155.stdout: { 2023-08-01T19:56:20.202 INFO:teuthology.orchestra.run.smithi155.stdout: "event": "reached_pg", 2023-08-01T19:56:20.202 INFO:teuthology.orchestra.run.smithi155.stdout: "time": "2023-08-01T19:55:59.601300+0000", 2023-08-01T19:56:20.202 INFO:teuthology.orchestra.run.smithi155.stdout: "duration": 1.0296694989999999 2023-08-01T19:56:20.202 INFO:teuthology.orchestra.run.smithi155.stdout: }, 2023-08-01T19:56:20.202 INFO:teuthology.orchestra.run.smithi155.stdout: { 2023-08-01T19:56:20.202 INFO:teuthology.orchestra.run.smithi155.stdout: "event": "started", 2023-08-01T19:56:20.202 INFO:teuthology.orchestra.run.smithi155.stdout: "time": "2023-08-01T19:55:59.601448+0000", 2023-08-01T19:56:20.202 INFO:teuthology.orchestra.run.smithi155.stdout: "duration": 0.00014828399999999999 2023-08-01T19:56:20.203 INFO:teuthology.orchestra.run.smithi155.stdout: }, 2023-08-01T19:56:20.203 INFO:teuthology.orchestra.run.smithi155.stdout: { 2023-08-01T19:56:20.203 INFO:teuthology.orchestra.run.smithi155.stdout: "event": "op_commit", 2023-08-01T19:56:20.203 INFO:teuthology.orchestra.run.smithi155.stdout: "time": "2023-08-01T19:55:59.606616+0000", 2023-08-01T19:56:20.203 INFO:teuthology.orchestra.run.smithi155.stdout: "duration": 0.0051679769999999998 2023-08-01T19:56:20.203 INFO:teuthology.orchestra.run.smithi155.stdout: }, 2023-08-01T19:56:20.203 INFO:teuthology.orchestra.run.smithi155.stdout: { 2023-08-01T19:56:20.203 INFO:teuthology.orchestra.run.smithi155.stdout: "event": "commit_sent", 2023-08-01T19:56:20.204 INFO:teuthology.orchestra.run.smithi155.stdout: "time": "2023-08-01T19:55:59.606662+0000", 2023-08-01T19:56:20.204 INFO:teuthology.orchestra.run.smithi155.stdout: "duration": 4.5843000000000001e-05 2023-08-01T19:56:20.204 INFO:teuthology.orchestra.run.smithi155.stdout: }, 2023-08-01T19:56:20.204 INFO:teuthology.orchestra.run.smithi155.stdout: { 2023-08-01T19:56:20.204 INFO:teuthology.orchestra.run.smithi155.stdout: "event": "done", 2023-08-01T19:56:20.204 INFO:teuthology.orchestra.run.smithi155.stdout: "time": "2023-08-01T19:55:59.606757+0000", 2023-08-01T19:56:20.204 INFO:teuthology.orchestra.run.smithi155.stdout: "duration": 9.5373999999999999e-05 2023-08-01T19:56:20.205 INFO:teuthology.orchestra.run.smithi155.stdout: } 2023-08-01T19:56:20.205 INFO:teuthology.orchestra.run.smithi155.stdout: ] 2023-08-01T19:56:20.205 INFO:teuthology.orchestra.run.smithi155.stdout: } 2023-08-01T19:56:20.205 INFO:teuthology.orchestra.run.smithi155.stdout: }, 2023-08-01T19:56:20.205 INFO:teuthology.orchestra.run.smithi155.stdout: { 2023-08-01T19:56:20.205 INFO:teuthology.orchestra.run.smithi155.stdout: "description": "osd_op(client.4668.0:197416 5.d 5:bd99e66d:::benchmark_data_smithi006_114134_object63755:head [delete] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e62)", 2023-08-01T19:56:20.205 INFO:teuthology.orchestra.run.smithi155.stdout: "initiated_at": "2023-08-01T19:55:58.577369+0000", 2023-08-01T19:56:20.205 INFO:teuthology.orchestra.run.smithi155.stdout: "age": 21.455513677999999, 2023-08-01T19:56:20.206 INFO:teuthology.orchestra.run.smithi155.stdout: "duration": 1.0300980120000001, 2023-08-01T19:56:20.206 INFO:teuthology.orchestra.run.smithi155.stdout: "type_data": { 2023-08-01T19:56:20.206 INFO:teuthology.orchestra.run.smithi155.stdout: "flag_point": "commit sent; apply or cleanup", 2023-08-01T19:56:20.206 INFO:teuthology.orchestra.run.smithi155.stdout: "client_info": { 2023-08-01T19:56:20.206 INFO:teuthology.orchestra.run.smithi155.stdout: "client": "client.4668", 2023-08-01T19:56:20.206 INFO:teuthology.orchestra.run.smithi155.stdout: "client_addr": "172.21.15.6:0/1709472247", 2023-08-01T19:56:20.206 INFO:teuthology.orchestra.run.smithi155.stdout: "tid": 197416 2023-08-01T19:56:20.207 INFO:teuthology.orchestra.run.smithi155.stdout: }, 2023-08-01T19:56:20.207 INFO:teuthology.orchestra.run.smithi155.stdout: "events": [ 2023-08-01T19:56:20.207 INFO:teuthology.orchestra.run.smithi155.stdout: { 2023-08-01T19:56:20.207 INFO:teuthology.orchestra.run.smithi155.stdout: "event": "initiated", 2023-08-01T19:56:20.207 INFO:teuthology.orchestra.run.smithi155.stdout: "time": "2023-08-01T19:55:58.577369+0000", 2023-08-01T19:56:20.207 INFO:teuthology.orchestra.run.smithi155.stdout: "duration": 0 2023-08-01T19:56:20.207 INFO:teuthology.orchestra.run.smithi155.stdout: }, 2023-08-01T19:56:20.208 INFO:teuthology.orchestra.run.smithi155.stdout: { 2023-08-01T19:56:20.208 INFO:teuthology.orchestra.run.smithi155.stdout: "event": "throttled", 2023-08-01T19:56:20.208 INFO:teuthology.orchestra.run.smithi155.stdout: "time": "2023-08-01T19:55:58.577369+0000", 2023-08-01T19:56:20.208 INFO:teuthology.orchestra.run.smithi155.stdout: "duration": 0 2023-08-01T19:56:20.208 INFO:teuthology.orchestra.run.smithi155.stdout: }, 2023-08-01T19:56:20.208 INFO:teuthology.orchestra.run.smithi155.stdout: { 2023-08-01T19:56:20.208 INFO:teuthology.orchestra.run.smithi155.stdout: "event": "header_read", 2023-08-01T19:56:20.208 INFO:teuthology.orchestra.run.smithi155.stdout: "time": "2023-08-01T19:55:58.577368+0000", 2023-08-01T19:56:20.209 INFO:teuthology.orchestra.run.smithi155.stdout: "duration": 4294967295.9999995 2023-08-01T19:56:20.209 INFO:teuthology.orchestra.run.smithi155.stdout: }, 2023-08-01T19:56:20.209 INFO:teuthology.orchestra.run.smithi155.stdout: { 2023-08-01T19:56:20.209 INFO:teuthology.orchestra.run.smithi155.stdout: "event": "all_read", 2023-08-01T19:56:20.209 INFO:teuthology.orchestra.run.smithi155.stdout: "time": "2023-08-01T19:55:58.577370+0000", 2023-08-01T19:56:20.209 INFO:teuthology.orchestra.run.smithi155.stdout: "duration": 2.1150000000000001e-06 2023-08-01T19:56:20.209 INFO:teuthology.orchestra.run.smithi155.stdout: }, 2023-08-01T19:56:20.210 INFO:teuthology.orchestra.run.smithi155.stdout: { 2023-08-01T19:56:20.210 INFO:teuthology.orchestra.run.smithi155.stdout: "event": "dispatched", 2023-08-01T19:56:20.210 INFO:teuthology.orchestra.run.smithi155.stdout: "time": "2023-08-01T19:55:58.577377+0000", 2023-08-01T19:56:20.210 INFO:teuthology.orchestra.run.smithi155.stdout: "duration": 6.6610000000000003e-06 2023-08-01T19:56:20.210 INFO:teuthology.orchestra.run.smithi155.stdout: }, 2023-08-01T19:56:20.210 INFO:teuthology.orchestra.run.smithi155.stdout: { 2023-08-01T19:56:20.210 INFO:teuthology.orchestra.run.smithi155.stdout: "event": "queued_for_pg", 2023-08-01T19:56:20.210 INFO:teuthology.orchestra.run.smithi155.stdout: "time": "2023-08-01T19:55:58.577380+0000", 2023-08-01T19:56:20.211 INFO:teuthology.orchestra.run.smithi155.stdout: "duration": 2.7360000000000001e-06 2023-08-01T19:56:20.211 INFO:teuthology.orchestra.run.smithi155.stdout: }, 2023-08-01T19:56:20.211 INFO:teuthology.orchestra.run.smithi155.stdout: { 2023-08-01T19:56:20.211 INFO:teuthology.orchestra.run.smithi155.stdout: "event": "reached_pg", 2023-08-01T19:56:20.211 INFO:teuthology.orchestra.run.smithi155.stdout: "time": "2023-08-01T19:55:58.577405+0000", 2023-08-01T19:56:20.211 INFO:teuthology.orchestra.run.smithi155.stdout: "duration": 2.4929000000000001e-05 2023-08-01T19:56:20.211 INFO:teuthology.orchestra.run.smithi155.stdout: }, 2023-08-01T19:56:20.212 INFO:teuthology.orchestra.run.smithi155.stdout: { 2023-08-01T19:56:20.212 INFO:teuthology.orchestra.run.smithi155.stdout: "event": "waiting for peered", 2023-08-01T19:56:20.212 INFO:teuthology.orchestra.run.smithi155.stdout: "time": "2023-08-01T19:55:58.577409+0000", 2023-08-01T19:56:20.212 INFO:teuthology.orchestra.run.smithi155.stdout: "duration": 4.0799999999999999e-06 2023-08-01T19:56:20.212 INFO:teuthology.orchestra.run.smithi155.stdout: }, 2023-08-01T19:56:20.212 INFO:teuthology.orchestra.run.smithi155.stdout: { 2023-08-01T19:56:20.212 INFO:teuthology.orchestra.run.smithi155.stdout: "event": "reached_pg", 2023-08-01T19:56:20.213 INFO:teuthology.orchestra.run.smithi155.stdout: "time": "2023-08-01T19:55:59.603639+0000", 2023-08-01T19:56:20.213 INFO:teuthology.orchestra.run.smithi155.stdout: "duration": 1.0262299349999999 2023-08-01T19:56:20.213 INFO:teuthology.orchestra.run.smithi155.stdout: }, 2023-08-01T19:56:20.213 INFO:teuthology.orchestra.run.smithi155.stdout: { 2023-08-01T19:56:20.213 INFO:teuthology.orchestra.run.smithi155.stdout: "event": "started", 2023-08-01T19:56:20.213 INFO:teuthology.orchestra.run.smithi155.stdout: "time": "2023-08-01T19:55:59.603772+0000", 2023-08-01T19:56:20.213 INFO:teuthology.orchestra.run.smithi155.stdout: "duration": 0.000133153 2023-08-01T19:56:20.213 INFO:teuthology.orchestra.run.smithi155.stdout: }, 2023-08-01T19:56:20.214 INFO:teuthology.orchestra.run.smithi155.stdout: { 2023-08-01T19:56:20.214 INFO:teuthology.orchestra.run.smithi155.stdout: "event": "op_commit", 2023-08-01T19:56:20.214 INFO:teuthology.orchestra.run.smithi155.stdout: "time": "2023-08-01T19:55:59.607354+0000", 2023-08-01T19:56:20.214 INFO:teuthology.orchestra.run.smithi155.stdout: "duration": 0.0035819599999999999 2023-08-01T19:56:20.214 INFO:teuthology.orchestra.run.smithi155.stdout: }, 2023-08-01T19:56:20.214 INFO:teuthology.orchestra.run.smithi155.stdout: { 2023-08-01T19:56:20.214 INFO:teuthology.orchestra.run.smithi155.stdout: "event": "commit_sent", 2023-08-01T19:56:20.214 INFO:teuthology.orchestra.run.smithi155.stdout: "time": "2023-08-01T19:55:59.607396+0000", 2023-08-01T19:56:20.215 INFO:teuthology.orchestra.run.smithi155.stdout: "duration": 4.2423999999999999e-05 2023-08-01T19:56:20.215 INFO:teuthology.orchestra.run.smithi155.stdout: }, 2023-08-01T19:56:20.215 INFO:teuthology.orchestra.run.smithi155.stdout: { 2023-08-01T19:56:20.215 INFO:teuthology.orchestra.run.smithi155.stdout: "event": "done", 2023-08-01T19:56:20.215 INFO:teuthology.orchestra.run.smithi155.stdout: "time": "2023-08-01T19:55:59.607467+0000", 2023-08-01T19:56:20.215 INFO:teuthology.orchestra.run.smithi155.stdout: "duration": 7.0360999999999999e-05 2023-08-01T19:56:20.215 INFO:teuthology.orchestra.run.smithi155.stdout: } 2023-08-01T19:56:20.215 INFO:teuthology.orchestra.run.smithi155.stdout: ] 2023-08-01T19:56:20.216 INFO:teuthology.orchestra.run.smithi155.stdout: } 2023-08-01T19:56:20.216 INFO:teuthology.orchestra.run.smithi155.stdout: }, 2023-08-01T19:56:20.216 INFO:teuthology.orchestra.run.smithi155.stdout: { 2023-08-01T19:56:20.216 INFO:teuthology.orchestra.run.smithi155.stdout: "description": "osd_op(client.4668.0:197419 5.d 5:be7dc7c9:::benchmark_data_smithi006_114134_object63758:head [delete] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e62)", 2023-08-01T19:56:20.216 INFO:teuthology.orchestra.run.smithi155.stdout: "initiated_at": "2023-08-01T19:55:58.580223+0000", 2023-08-01T19:56:20.216 INFO:teuthology.orchestra.run.smithi155.stdout: "age": 21.452659727, 2023-08-01T19:56:20.216 INFO:teuthology.orchestra.run.smithi155.stdout: "duration": 1.0286139439999999, 2023-08-01T19:56:20.217 INFO:teuthology.orchestra.run.smithi155.stdout: "type_data": { 2023-08-01T19:56:20.217 INFO:teuthology.orchestra.run.smithi155.stdout: "flag_point": "commit sent; apply or cleanup", 2023-08-01T19:56:20.217 INFO:teuthology.orchestra.run.smithi155.stdout: "client_info": { 2023-08-01T19:56:20.217 INFO:teuthology.orchestra.run.smithi155.stdout: "client": "client.4668", 2023-08-01T19:56:20.217 INFO:teuthology.orchestra.run.smithi155.stdout: "client_addr": "172.21.15.6:0/1709472247", 2023-08-01T19:56:20.217 INFO:teuthology.orchestra.run.smithi155.stdout: "tid": 197419 2023-08-01T19:56:20.217 INFO:teuthology.orchestra.run.smithi155.stdout: }, 2023-08-01T19:56:20.217 INFO:teuthology.orchestra.run.smithi155.stdout: "events": [ 2023-08-01T19:56:20.218 INFO:teuthology.orchestra.run.smithi155.stdout: { 2023-08-01T19:56:20.218 INFO:teuthology.orchestra.run.smithi155.stdout: "event": "initiated", 2023-08-01T19:56:20.218 INFO:teuthology.orchestra.run.smithi155.stdout: "time": "2023-08-01T19:55:58.580223+0000", 2023-08-01T19:56:20.218 INFO:teuthology.orchestra.run.smithi155.stdout: "duration": 0 2023-08-01T19:56:20.218 INFO:teuthology.orchestra.run.smithi155.stdout: }, 2023-08-01T19:56:20.218 INFO:teuthology.orchestra.run.smithi155.stdout: { 2023-08-01T19:56:20.218 INFO:teuthology.orchestra.run.smithi155.stdout: "event": "throttled", 2023-08-01T19:56:20.218 INFO:teuthology.orchestra.run.smithi155.stdout: "time": "2023-08-01T19:55:58.580223+0000", 2023-08-01T19:56:20.219 INFO:teuthology.orchestra.run.smithi155.stdout: "duration": 0 2023-08-01T19:56:20.219 INFO:teuthology.orchestra.run.smithi155.stdout: }, 2023-08-01T19:56:20.219 INFO:teuthology.orchestra.run.smithi155.stdout: { 2023-08-01T19:56:20.219 INFO:teuthology.orchestra.run.smithi155.stdout: "event": "header_read", 2023-08-01T19:56:20.219 INFO:teuthology.orchestra.run.smithi155.stdout: "time": "2023-08-01T19:55:58.580222+0000", 2023-08-01T19:56:20.219 INFO:teuthology.orchestra.run.smithi155.stdout: "duration": 4294967295.9999995 2023-08-01T19:56:20.219 INFO:teuthology.orchestra.run.smithi155.stdout: }, 2023-08-01T19:56:20.219 INFO:teuthology.orchestra.run.smithi155.stdout: { 2023-08-01T19:56:20.220 INFO:teuthology.orchestra.run.smithi155.stdout: "event": "all_read", 2023-08-01T19:56:20.220 INFO:teuthology.orchestra.run.smithi155.stdout: "time": "2023-08-01T19:55:58.580225+0000", 2023-08-01T19:56:20.220 INFO:teuthology.orchestra.run.smithi155.stdout: "duration": 3.2820000000000001e-06 2023-08-01T19:56:20.220 INFO:teuthology.orchestra.run.smithi155.stdout: }, 2023-08-01T19:56:20.220 INFO:teuthology.orchestra.run.smithi155.stdout: { 2023-08-01T19:56:20.220 INFO:teuthology.orchestra.run.smithi155.stdout: "event": "dispatched", 2023-08-01T19:56:20.220 INFO:teuthology.orchestra.run.smithi155.stdout: "time": "2023-08-01T19:55:58.580233+0000", 2023-08-01T19:56:20.220 INFO:teuthology.orchestra.run.smithi155.stdout: "duration": 7.34e-06 2023-08-01T19:56:20.221 INFO:teuthology.orchestra.run.smithi155.stdout: }, 2023-08-01T19:56:20.221 INFO:teuthology.orchestra.run.smithi155.stdout: { 2023-08-01T19:56:20.221 INFO:teuthology.orchestra.run.smithi155.stdout: "event": "queued_for_pg", 2023-08-01T19:56:20.221 INFO:teuthology.orchestra.run.smithi155.stdout: "time": "2023-08-01T19:55:58.580236+0000", 2023-08-01T19:56:20.221 INFO:teuthology.orchestra.run.smithi155.stdout: "duration": 3.473e-06 2023-08-01T19:56:20.221 INFO:teuthology.orchestra.run.smithi155.stdout: }, 2023-08-01T19:56:20.221 INFO:teuthology.orchestra.run.smithi155.stdout: { 2023-08-01T19:56:20.221 INFO:teuthology.orchestra.run.smithi155.stdout: "event": "reached_pg", 2023-08-01T19:56:20.222 INFO:teuthology.orchestra.run.smithi155.stdout: "time": "2023-08-01T19:55:58.580267+0000", 2023-08-01T19:56:20.222 INFO:teuthology.orchestra.run.smithi155.stdout: "duration": 3.0479000000000001e-05 2023-08-01T19:56:20.222 INFO:teuthology.orchestra.run.smithi155.stdout: }, 2023-08-01T19:56:20.222 INFO:teuthology.orchestra.run.smithi155.stdout: { 2023-08-01T19:56:20.222 INFO:teuthology.orchestra.run.smithi155.stdout: "event": "waiting for peered", 2023-08-01T19:56:20.222 INFO:teuthology.orchestra.run.smithi155.stdout: "time": "2023-08-01T19:55:58.580272+0000", 2023-08-01T19:56:20.222 INFO:teuthology.orchestra.run.smithi155.stdout: "duration": 5.011e-06 2023-08-01T19:56:20.222 INFO:teuthology.orchestra.run.smithi155.stdout: }, 2023-08-01T19:56:20.223 INFO:teuthology.orchestra.run.smithi155.stdout: { 2023-08-01T19:56:20.223 INFO:teuthology.orchestra.run.smithi155.stdout: "event": "reached_pg", 2023-08-01T19:56:20.223 INFO:teuthology.orchestra.run.smithi155.stdout: "time": "2023-08-01T19:55:59.604970+0000", 2023-08-01T19:56:20.223 INFO:teuthology.orchestra.run.smithi155.stdout: "duration": 1.0246984189999999 2023-08-01T19:56:20.223 INFO:teuthology.orchestra.run.smithi155.stdout: }, 2023-08-01T19:56:20.223 INFO:teuthology.orchestra.run.smithi155.stdout: { 2023-08-01T19:56:20.223 INFO:teuthology.orchestra.run.smithi155.stdout: "event": "started", 2023-08-01T19:56:20.224 INFO:teuthology.orchestra.run.smithi155.stdout: "time": "2023-08-01T19:55:59.605085+0000", 2023-08-01T19:56:20.224 INFO:teuthology.orchestra.run.smithi155.stdout: "duration": 0.00011531000000000001 2023-08-01T19:56:20.224 INFO:teuthology.orchestra.run.smithi155.stdout: }, 2023-08-01T19:56:20.224 INFO:teuthology.orchestra.run.smithi155.stdout: { 2023-08-01T19:56:20.224 INFO:teuthology.orchestra.run.smithi155.stdout: "event": "op_commit", 2023-08-01T19:56:20.224 INFO:teuthology.orchestra.run.smithi155.stdout: "time": "2023-08-01T19:55:59.608733+0000", 2023-08-01T19:56:20.224 INFO:teuthology.orchestra.run.smithi155.stdout: "duration": 0.0036478090000000001 2023-08-01T19:56:20.224 INFO:teuthology.orchestra.run.smithi155.stdout: }, 2023-08-01T19:56:20.225 INFO:teuthology.orchestra.run.smithi155.stdout: { 2023-08-01T19:56:20.225 INFO:teuthology.orchestra.run.smithi155.stdout: "event": "commit_sent", 2023-08-01T19:56:20.225 INFO:teuthology.orchestra.run.smithi155.stdout: "time": "2023-08-01T19:55:59.608771+0000", 2023-08-01T19:56:20.225 INFO:teuthology.orchestra.run.smithi155.stdout: "duration": 3.8033e-05 2023-08-01T19:56:20.225 INFO:teuthology.orchestra.run.smithi155.stdout: }, 2023-08-01T19:56:20.225 INFO:teuthology.orchestra.run.smithi155.stdout: { 2023-08-01T19:56:20.225 INFO:teuthology.orchestra.run.smithi155.stdout: "event": "done", 2023-08-01T19:56:20.226 INFO:teuthology.orchestra.run.smithi155.stdout: "time": "2023-08-01T19:55:59.608837+0000", 2023-08-01T19:56:20.226 INFO:teuthology.orchestra.run.smithi155.stdout: "duration": 6.5364000000000006e-05 2023-08-01T19:56:20.226 INFO:teuthology.orchestra.run.smithi155.stdout: } 2023-08-01T19:56:20.226 INFO:teuthology.orchestra.run.smithi155.stdout: ] 2023-08-01T19:56:20.226 INFO:teuthology.orchestra.run.smithi155.stdout: } 2023-08-01T19:56:20.226 INFO:teuthology.orchestra.run.smithi155.stdout: }, 2023-08-01T19:56:20.226 INFO:teuthology.orchestra.run.smithi155.stdout: { 2023-08-01T19:56:20.227 INFO:teuthology.orchestra.run.smithi155.stdout: "description": "osd_op(client.4668.0:197420 5.9 5:92a2efe5:::benchmark_data_smithi006_114134_object63759:head [delete] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e62)", 2023-08-01T19:56:20.227 INFO:teuthology.orchestra.run.smithi155.stdout: "initiated_at": "2023-08-01T19:55:58.582230+0000", 2023-08-01T19:56:20.227 INFO:teuthology.orchestra.run.smithi155.stdout: "age": 21.450652417000001, 2023-08-01T19:56:20.227 INFO:teuthology.orchestra.run.smithi155.stdout: "duration": 1.0095353739999999, 2023-08-01T19:56:20.227 INFO:teuthology.orchestra.run.smithi155.stdout: "type_data": { 2023-08-01T19:56:20.227 INFO:teuthology.orchestra.run.smithi155.stdout: "flag_point": "commit sent; apply or cleanup", 2023-08-01T19:56:20.227 INFO:teuthology.orchestra.run.smithi155.stdout: "client_info": { 2023-08-01T19:56:20.227 INFO:teuthology.orchestra.run.smithi155.stdout: "client": "client.4668", 2023-08-01T19:56:20.228 INFO:teuthology.orchestra.run.smithi155.stdout: "client_addr": "172.21.15.6:0/1709472247", 2023-08-01T19:56:20.228 INFO:teuthology.orchestra.run.smithi155.stdout: "tid": 197420 2023-08-01T19:56:20.228 INFO:teuthology.orchestra.run.smithi155.stdout: }, 2023-08-01T19:56:20.228 INFO:teuthology.orchestra.run.smithi155.stdout: "events": [ 2023-08-01T19:56:20.228 INFO:teuthology.orchestra.run.smithi155.stdout: { 2023-08-01T19:56:20.228 INFO:teuthology.orchestra.run.smithi155.stdout: "event": "initiated", 2023-08-01T19:56:20.229 INFO:teuthology.orchestra.run.smithi155.stdout: "time": "2023-08-01T19:55:58.582230+0000", 2023-08-01T19:56:20.229 INFO:teuthology.orchestra.run.smithi155.stdout: "duration": 0 2023-08-01T19:56:20.229 INFO:teuthology.orchestra.run.smithi155.stdout: }, 2023-08-01T19:56:20.229 INFO:teuthology.orchestra.run.smithi155.stdout: { 2023-08-01T19:56:20.229 INFO:teuthology.orchestra.run.smithi155.stdout: "event": "throttled", 2023-08-01T19:56:20.229 INFO:teuthology.orchestra.run.smithi155.stdout: "time": "2023-08-01T19:55:58.582230+0000", 2023-08-01T19:56:20.229 INFO:teuthology.orchestra.run.smithi155.stdout: "duration": 0 2023-08-01T19:56:20.229 INFO:teuthology.orchestra.run.smithi155.stdout: }, 2023-08-01T19:56:20.230 INFO:teuthology.orchestra.run.smithi155.stdout: { 2023-08-01T19:56:20.230 INFO:teuthology.orchestra.run.smithi155.stdout: "event": "header_read", 2023-08-01T19:56:20.230 INFO:teuthology.orchestra.run.smithi155.stdout: "time": "2023-08-01T19:55:58.582229+0000", 2023-08-01T19:56:20.230 INFO:teuthology.orchestra.run.smithi155.stdout: "duration": 4294967295.9999995 2023-08-01T19:56:20.230 INFO:teuthology.orchestra.run.smithi155.stdout: }, 2023-08-01T19:56:20.230 INFO:teuthology.orchestra.run.smithi155.stdout: { 2023-08-01T19:56:20.230 INFO:teuthology.orchestra.run.smithi155.stdout: "event": "all_read", 2023-08-01T19:56:20.231 INFO:teuthology.orchestra.run.smithi155.stdout: "time": "2023-08-01T19:55:58.582233+0000", 2023-08-01T19:56:20.231 INFO:teuthology.orchestra.run.smithi155.stdout: "duration": 3.7869999999999999e-06 2023-08-01T19:56:20.231 INFO:teuthology.orchestra.run.smithi155.stdout: }, 2023-08-01T19:56:20.231 INFO:teuthology.orchestra.run.smithi155.stdout: { 2023-08-01T19:56:20.231 INFO:teuthology.orchestra.run.smithi155.stdout: "event": "dispatched", 2023-08-01T19:56:20.231 INFO:teuthology.orchestra.run.smithi155.stdout: "time": "2023-08-01T19:55:58.582241+0000", 2023-08-01T19:56:20.231 INFO:teuthology.orchestra.run.smithi155.stdout: "duration": 7.6909999999999997e-06 2023-08-01T19:56:20.231 INFO:teuthology.orchestra.run.smithi155.stdout: }, 2023-08-01T19:56:20.232 INFO:teuthology.orchestra.run.smithi155.stdout: { 2023-08-01T19:56:20.232 INFO:teuthology.orchestra.run.smithi155.stdout: "event": "queued_for_pg", 2023-08-01T19:56:20.232 INFO:teuthology.orchestra.run.smithi155.stdout: "time": "2023-08-01T19:55:58.582244+0000", 2023-08-01T19:56:20.232 INFO:teuthology.orchestra.run.smithi155.stdout: "duration": 3.6770000000000001e-06 2023-08-01T19:56:20.232 INFO:teuthology.orchestra.run.smithi155.stdout: }, 2023-08-01T19:56:20.232 INFO:teuthology.orchestra.run.smithi155.stdout: { 2023-08-01T19:56:20.232 INFO:teuthology.orchestra.run.smithi155.stdout: "event": "reached_pg", 2023-08-01T19:56:20.233 INFO:teuthology.orchestra.run.smithi155.stdout: "time": "2023-08-01T19:55:58.582274+0000", 2023-08-01T19:56:20.233 INFO:teuthology.orchestra.run.smithi155.stdout: "duration": 3.0074e-05 2023-08-01T19:56:20.233 INFO:teuthology.orchestra.run.smithi155.stdout: }, 2023-08-01T19:56:20.233 INFO:teuthology.orchestra.run.smithi155.stdout: { 2023-08-01T19:56:20.233 INFO:teuthology.orchestra.run.smithi155.stdout: "event": "waiting for peered", 2023-08-01T19:56:20.233 INFO:teuthology.orchestra.run.smithi155.stdout: "time": "2023-08-01T19:55:58.582281+0000", 2023-08-01T19:56:20.233 INFO:teuthology.orchestra.run.smithi155.stdout: "duration": 6.297e-06 2023-08-01T19:56:20.233 INFO:teuthology.orchestra.run.smithi155.stdout: }, 2023-08-01T19:56:20.234 INFO:teuthology.orchestra.run.smithi155.stdout: { 2023-08-01T19:56:20.234 INFO:teuthology.orchestra.run.smithi155.stdout: "event": "reached_pg", 2023-08-01T19:56:20.234 INFO:teuthology.orchestra.run.smithi155.stdout: "time": "2023-08-01T19:55:59.586809+0000", 2023-08-01T19:56:20.234 INFO:teuthology.orchestra.run.smithi155.stdout: "duration": 1.0045281720000001 2023-08-01T19:56:20.234 INFO:teuthology.orchestra.run.smithi155.stdout: }, 2023-08-01T19:56:20.234 INFO:teuthology.orchestra.run.smithi155.stdout: { 2023-08-01T19:56:20.234 INFO:teuthology.orchestra.run.smithi155.stdout: "event": "started", 2023-08-01T19:56:20.234 INFO:teuthology.orchestra.run.smithi155.stdout: "time": "2023-08-01T19:55:59.586910+0000", 2023-08-01T19:56:20.235 INFO:teuthology.orchestra.run.smithi155.stdout: "duration": 0.000100898 2023-08-01T19:56:20.235 INFO:teuthology.orchestra.run.smithi155.stdout: }, 2023-08-01T19:56:20.235 INFO:teuthology.orchestra.run.smithi155.stdout: { 2023-08-01T19:56:20.235 INFO:teuthology.orchestra.run.smithi155.stdout: "event": "op_commit", 2023-08-01T19:56:20.235 INFO:teuthology.orchestra.run.smithi155.stdout: "time": "2023-08-01T19:55:59.591679+0000", 2023-08-01T19:56:20.235 INFO:teuthology.orchestra.run.smithi155.stdout: "duration": 0.004769471 2023-08-01T19:56:20.235 INFO:teuthology.orchestra.run.smithi155.stdout: }, 2023-08-01T19:56:20.235 INFO:teuthology.orchestra.run.smithi155.stdout: { 2023-08-01T19:56:20.236 INFO:teuthology.orchestra.run.smithi155.stdout: "event": "commit_sent", 2023-08-01T19:56:20.236 INFO:teuthology.orchestra.run.smithi155.stdout: "time": "2023-08-01T19:55:59.591721+0000", 2023-08-01T19:56:20.236 INFO:teuthology.orchestra.run.smithi155.stdout: "duration": 4.1953000000000003e-05 2023-08-01T19:56:20.236 INFO:teuthology.orchestra.run.smithi155.stdout: }, 2023-08-01T19:56:20.236 INFO:teuthology.orchestra.run.smithi155.stdout: { 2023-08-01T19:56:20.236 INFO:teuthology.orchestra.run.smithi155.stdout: "event": "done", 2023-08-01T19:56:20.236 INFO:teuthology.orchestra.run.smithi155.stdout: "time": "2023-08-01T19:55:59.591765+0000", 2023-08-01T19:56:20.236 INFO:teuthology.orchestra.run.smithi155.stdout: "duration": 4.4030999999999999e-05 2023-08-01T19:56:20.237 INFO:teuthology.orchestra.run.smithi155.stdout: } 2023-08-01T19:56:20.237 INFO:teuthology.orchestra.run.smithi155.stdout: ] 2023-08-01T19:56:20.237 INFO:teuthology.orchestra.run.smithi155.stdout: } 2023-08-01T19:56:20.237 INFO:teuthology.orchestra.run.smithi155.stdout: } 2023-08-01T19:56:20.237 INFO:teuthology.orchestra.run.smithi155.stdout: ] 2023-08-01T19:56:20.237 INFO:teuthology.orchestra.run.smithi155.stdout:} 2023-08-01T19:56:20.238 DEBUG:teuthology.orchestra.run.smithi008:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 30 ceph --cluster ceph --admin-daemon /var/run/ceph/ceph-osd.0.asok dump_ops_in_flight 2023-08-01T19:56:20.239 INFO:tasks.ceph.osd.0.smithi008.stderr:2023-08-01T19:56:20.236+0000 7f16a58f4700 -1 received signal: Hangup from /usr/bin/python3 /bin/daemon-helper kill ceph-osd -f --cluster ceph -i 0 (PID: 111179) UID: 0 2023-08-01T19:56:20.339 INFO:tasks.ceph.osd.2.smithi155.stderr:2023-08-01T19:56:20.337+0000 7faa5c6ac700 -1 received signal: Hangup from /usr/bin/python3 /bin/daemon-helper kill ceph-osd -f --cluster ceph -i 2 (PID: 111337) UID: 0 2023-08-01T19:56:20.428 INFO:teuthology.orchestra.run.smithi008.stdout:{ 2023-08-01T19:56:20.429 INFO:teuthology.orchestra.run.smithi008.stdout: "ops": [ 2023-08-01T19:56:20.429 INFO:teuthology.orchestra.run.smithi008.stdout: { 2023-08-01T19:56:20.429 INFO:teuthology.orchestra.run.smithi008.stdout: "description": "osd_repop(client.4668.0:240266 5.8 e70/19 5:191daf9c:::benchmark_data_smithi006_114134_object106605:head v 70'15083, mlcod=70'15080)", 2023-08-01T19:56:20.429 INFO:teuthology.orchestra.run.smithi008.stdout: "initiated_at": "2023-08-01T19:56:20.413922+0000", 2023-08-01T19:56:20.429 INFO:teuthology.orchestra.run.smithi008.stdout: "age": 0.0087868700000000004, 2023-08-01T19:56:20.429 INFO:teuthology.orchestra.run.smithi008.stdout: "duration": 0.0088050690000000004, 2023-08-01T19:56:20.429 INFO:teuthology.orchestra.run.smithi008.stdout: "type_data": { 2023-08-01T19:56:20.430 INFO:teuthology.orchestra.run.smithi008.stdout: "flag_point": "started", 2023-08-01T19:56:20.430 INFO:teuthology.orchestra.run.smithi008.stdout: "events": [ 2023-08-01T19:56:20.430 INFO:teuthology.orchestra.run.smithi008.stdout: { 2023-08-01T19:56:20.430 INFO:teuthology.orchestra.run.smithi008.stdout: "event": "initiated", 2023-08-01T19:56:20.430 INFO:teuthology.orchestra.run.smithi008.stdout: "time": "2023-08-01T19:56:20.413922+0000", 2023-08-01T19:56:20.430 INFO:teuthology.orchestra.run.smithi008.stdout: "duration": 0 2023-08-01T19:56:20.430 INFO:teuthology.orchestra.run.smithi008.stdout: }, 2023-08-01T19:56:20.431 INFO:teuthology.orchestra.run.smithi008.stdout: { 2023-08-01T19:56:20.431 INFO:teuthology.orchestra.run.smithi008.stdout: "event": "throttled", 2023-08-01T19:56:20.431 INFO:teuthology.orchestra.run.smithi008.stdout: "time": "2023-08-01T19:56:20.413922+0000", 2023-08-01T19:56:20.431 INFO:teuthology.orchestra.run.smithi008.stdout: "duration": 0 2023-08-01T19:56:20.431 INFO:teuthology.orchestra.run.smithi008.stdout: }, 2023-08-01T19:56:20.431 INFO:teuthology.orchestra.run.smithi008.stdout: { 2023-08-01T19:56:20.431 INFO:teuthology.orchestra.run.smithi008.stdout: "event": "header_read", 2023-08-01T19:56:20.431 INFO:teuthology.orchestra.run.smithi008.stdout: "time": "2023-08-01T19:56:20.413921+0000", 2023-08-01T19:56:20.432 INFO:teuthology.orchestra.run.smithi008.stdout: "duration": 4294967295.9999995 2023-08-01T19:56:20.432 INFO:teuthology.orchestra.run.smithi008.stdout: }, 2023-08-01T19:56:20.432 INFO:teuthology.orchestra.run.smithi008.stdout: { 2023-08-01T19:56:20.432 INFO:teuthology.orchestra.run.smithi008.stdout: "event": "all_read", 2023-08-01T19:56:20.432 INFO:teuthology.orchestra.run.smithi008.stdout: "time": "2023-08-01T19:56:20.413926+0000", 2023-08-01T19:56:20.432 INFO:teuthology.orchestra.run.smithi008.stdout: "duration": 4.8890000000000001e-06 2023-08-01T19:56:20.433 INFO:teuthology.orchestra.run.smithi008.stdout: }, 2023-08-01T19:56:20.433 INFO:teuthology.orchestra.run.smithi008.stdout: { 2023-08-01T19:56:20.433 INFO:teuthology.orchestra.run.smithi008.stdout: "event": "dispatched", 2023-08-01T19:56:20.433 INFO:teuthology.orchestra.run.smithi008.stdout: "time": "2023-08-01T19:56:20.413934+0000", 2023-08-01T19:56:20.433 INFO:teuthology.orchestra.run.smithi008.stdout: "duration": 8.4770000000000003e-06 2023-08-01T19:56:20.433 INFO:teuthology.orchestra.run.smithi008.stdout: }, 2023-08-01T19:56:20.433 INFO:teuthology.orchestra.run.smithi008.stdout: { 2023-08-01T19:56:20.433 INFO:teuthology.orchestra.run.smithi008.stdout: "event": "queued_for_pg", 2023-08-01T19:56:20.434 INFO:teuthology.orchestra.run.smithi008.stdout: "time": "2023-08-01T19:56:20.413940+0000", 2023-08-01T19:56:20.434 INFO:teuthology.orchestra.run.smithi008.stdout: "duration": 5.7320000000000003e-06 2023-08-01T19:56:20.434 INFO:teuthology.orchestra.run.smithi008.stdout: }, 2023-08-01T19:56:20.434 INFO:teuthology.orchestra.run.smithi008.stdout: { 2023-08-01T19:56:20.434 INFO:teuthology.orchestra.run.smithi008.stdout: "event": "reached_pg", 2023-08-01T19:56:20.434 INFO:teuthology.orchestra.run.smithi008.stdout: "time": "2023-08-01T19:56:20.414581+0000", 2023-08-01T19:56:20.434 INFO:teuthology.orchestra.run.smithi008.stdout: "duration": 0.00064066199999999996 2023-08-01T19:56:20.434 INFO:teuthology.orchestra.run.smithi008.stdout: }, 2023-08-01T19:56:20.435 INFO:teuthology.orchestra.run.smithi008.stdout: { 2023-08-01T19:56:20.435 INFO:teuthology.orchestra.run.smithi008.stdout: "event": "started", 2023-08-01T19:56:20.435 INFO:teuthology.orchestra.run.smithi008.stdout: "time": "2023-08-01T19:56:20.414602+0000", 2023-08-01T19:56:20.435 INFO:teuthology.orchestra.run.smithi008.stdout: "duration": 2.1484999999999998e-05 2023-08-01T19:56:20.435 INFO:teuthology.orchestra.run.smithi008.stdout: } 2023-08-01T19:56:20.435 INFO:teuthology.orchestra.run.smithi008.stdout: ] 2023-08-01T19:56:20.435 INFO:teuthology.orchestra.run.smithi008.stdout: } 2023-08-01T19:56:20.436 INFO:teuthology.orchestra.run.smithi008.stdout: }, 2023-08-01T19:56:20.436 INFO:teuthology.orchestra.run.smithi008.stdout: { 2023-08-01T19:56:20.436 INFO:teuthology.orchestra.run.smithi008.stdout: "description": "osd_op(client.4668.0:240268 5.5 5:ac14f1f5:::benchmark_data_smithi006_114134_object106607:head [delete] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e70)", 2023-08-01T19:56:20.436 INFO:teuthology.orchestra.run.smithi008.stdout: "initiated_at": "2023-08-01T19:56:20.414714+0000", 2023-08-01T19:56:20.436 INFO:teuthology.orchestra.run.smithi008.stdout: "age": 0.0079945569999999994, 2023-08-01T19:56:20.436 INFO:teuthology.orchestra.run.smithi008.stdout: "duration": 0.0080569990000000005, 2023-08-01T19:56:20.436 INFO:teuthology.orchestra.run.smithi008.stdout: "type_data": { 2023-08-01T19:56:20.436 INFO:teuthology.orchestra.run.smithi008.stdout: "flag_point": "started", 2023-08-01T19:56:20.437 INFO:teuthology.orchestra.run.smithi008.stdout: "client_info": { 2023-08-01T19:56:20.437 INFO:teuthology.orchestra.run.smithi008.stdout: "client": "client.4668", 2023-08-01T19:56:20.437 INFO:teuthology.orchestra.run.smithi008.stdout: "client_addr": "172.21.15.6:0/1709472247", 2023-08-01T19:56:20.437 INFO:teuthology.orchestra.run.smithi008.stdout: "tid": 240268 2023-08-01T19:56:20.437 INFO:teuthology.orchestra.run.smithi008.stdout: }, 2023-08-01T19:56:20.437 INFO:teuthology.orchestra.run.smithi008.stdout: "events": [ 2023-08-01T19:56:20.437 INFO:teuthology.orchestra.run.smithi008.stdout: { 2023-08-01T19:56:20.438 INFO:teuthology.orchestra.run.smithi008.stdout: "event": "initiated", 2023-08-01T19:56:20.438 INFO:teuthology.orchestra.run.smithi008.stdout: "time": "2023-08-01T19:56:20.414714+0000", 2023-08-01T19:56:20.438 INFO:teuthology.orchestra.run.smithi008.stdout: "duration": 0 2023-08-01T19:56:20.438 INFO:teuthology.orchestra.run.smithi008.stdout: }, 2023-08-01T19:56:20.438 INFO:teuthology.orchestra.run.smithi008.stdout: { 2023-08-01T19:56:20.438 INFO:teuthology.orchestra.run.smithi008.stdout: "event": "throttled", 2023-08-01T19:56:20.438 INFO:teuthology.orchestra.run.smithi008.stdout: "time": "2023-08-01T19:56:20.414714+0000", 2023-08-01T19:56:20.438 INFO:teuthology.orchestra.run.smithi008.stdout: "duration": 0 2023-08-01T19:56:20.439 INFO:teuthology.orchestra.run.smithi008.stdout: }, 2023-08-01T19:56:20.439 INFO:teuthology.orchestra.run.smithi008.stdout: { 2023-08-01T19:56:20.439 INFO:teuthology.orchestra.run.smithi008.stdout: "event": "header_read", 2023-08-01T19:56:20.439 INFO:teuthology.orchestra.run.smithi008.stdout: "time": "2023-08-01T19:56:20.414713+0000", 2023-08-01T19:56:20.439 INFO:teuthology.orchestra.run.smithi008.stdout: "duration": 4294967295.999999 2023-08-01T19:56:20.439 INFO:teuthology.orchestra.run.smithi008.stdout: }, 2023-08-01T19:56:20.439 INFO:teuthology.orchestra.run.smithi008.stdout: { 2023-08-01T19:56:20.440 INFO:teuthology.orchestra.run.smithi008.stdout: "event": "all_read", 2023-08-01T19:56:20.440 INFO:teuthology.orchestra.run.smithi008.stdout: "time": "2023-08-01T19:56:20.414718+0000", 2023-08-01T19:56:20.440 INFO:teuthology.orchestra.run.smithi008.stdout: "duration": 5.2279999999999998e-06 2023-08-01T19:56:20.440 INFO:teuthology.orchestra.run.smithi008.stdout: }, 2023-08-01T19:56:20.440 INFO:teuthology.orchestra.run.smithi008.stdout: { 2023-08-01T19:56:20.440 INFO:teuthology.orchestra.run.smithi008.stdout: "event": "dispatched", 2023-08-01T19:56:20.440 INFO:teuthology.orchestra.run.smithi008.stdout: "time": "2023-08-01T19:56:20.414730+0000", 2023-08-01T19:56:20.440 INFO:teuthology.orchestra.run.smithi008.stdout: "duration": 1.2007e-05 2023-08-01T19:56:20.441 INFO:teuthology.orchestra.run.smithi008.stdout: }, 2023-08-01T19:56:20.441 INFO:teuthology.orchestra.run.smithi008.stdout: { 2023-08-01T19:56:20.441 INFO:teuthology.orchestra.run.smithi008.stdout: "event": "queued_for_pg", 2023-08-01T19:56:20.441 INFO:teuthology.orchestra.run.smithi008.stdout: "time": "2023-08-01T19:56:20.414736+0000", 2023-08-01T19:56:20.441 INFO:teuthology.orchestra.run.smithi008.stdout: "duration": 5.9440000000000002e-06 2023-08-01T19:56:20.441 INFO:teuthology.orchestra.run.smithi008.stdout: }, 2023-08-01T19:56:20.441 INFO:teuthology.orchestra.run.smithi008.stdout: { 2023-08-01T19:56:20.442 INFO:teuthology.orchestra.run.smithi008.stdout: "event": "reached_pg", 2023-08-01T19:56:20.442 INFO:teuthology.orchestra.run.smithi008.stdout: "time": "2023-08-01T19:56:20.416727+0000", 2023-08-01T19:56:20.442 INFO:teuthology.orchestra.run.smithi008.stdout: "duration": 0.0019907309999999999 2023-08-01T19:56:20.442 INFO:teuthology.orchestra.run.smithi008.stdout: }, 2023-08-01T19:56:20.442 INFO:teuthology.orchestra.run.smithi008.stdout: { 2023-08-01T19:56:20.442 INFO:teuthology.orchestra.run.smithi008.stdout: "event": "started", 2023-08-01T19:56:20.442 INFO:teuthology.orchestra.run.smithi008.stdout: "time": "2023-08-01T19:56:20.416873+0000", 2023-08-01T19:56:20.442 INFO:teuthology.orchestra.run.smithi008.stdout: "duration": 0.00014581199999999999 2023-08-01T19:56:20.443 INFO:teuthology.orchestra.run.smithi008.stdout: } 2023-08-01T19:56:20.443 INFO:teuthology.orchestra.run.smithi008.stdout: ] 2023-08-01T19:56:20.443 INFO:teuthology.orchestra.run.smithi008.stdout: } 2023-08-01T19:56:20.443 INFO:teuthology.orchestra.run.smithi008.stdout: }, 2023-08-01T19:56:20.443 INFO:teuthology.orchestra.run.smithi008.stdout: { 2023-08-01T19:56:20.443 INFO:teuthology.orchestra.run.smithi008.stdout: "description": "osd_repop(client.4668.0:240269 5.8 e70/19 5:102dd6d7:::benchmark_data_smithi006_114134_object106608:head v 70'15084, mlcod=70'15080)", 2023-08-01T19:56:20.443 INFO:teuthology.orchestra.run.smithi008.stdout: "initiated_at": "2023-08-01T19:56:20.416231+0000", 2023-08-01T19:56:20.443 INFO:teuthology.orchestra.run.smithi008.stdout: "age": 0.0064778379999999997, 2023-08-01T19:56:20.444 INFO:teuthology.orchestra.run.smithi008.stdout: "duration": 0.0065833610000000002, 2023-08-01T19:56:20.444 INFO:teuthology.orchestra.run.smithi008.stdout: "type_data": { 2023-08-01T19:56:20.444 INFO:teuthology.orchestra.run.smithi008.stdout: "flag_point": "started", 2023-08-01T19:56:20.444 INFO:teuthology.orchestra.run.smithi008.stdout: "events": [ 2023-08-01T19:56:20.444 INFO:teuthology.orchestra.run.smithi008.stdout: { 2023-08-01T19:56:20.444 INFO:teuthology.orchestra.run.smithi008.stdout: "event": "initiated", 2023-08-01T19:56:20.444 INFO:teuthology.orchestra.run.smithi008.stdout: "time": "2023-08-01T19:56:20.416231+0000", 2023-08-01T19:56:20.445 INFO:teuthology.orchestra.run.smithi008.stdout: "duration": 0 2023-08-01T19:56:20.445 INFO:teuthology.orchestra.run.smithi008.stdout: }, 2023-08-01T19:56:20.445 INFO:teuthology.orchestra.run.smithi008.stdout: { 2023-08-01T19:56:20.445 INFO:teuthology.orchestra.run.smithi008.stdout: "event": "throttled", 2023-08-01T19:56:20.445 INFO:teuthology.orchestra.run.smithi008.stdout: "time": "2023-08-01T19:56:20.416231+0000", 2023-08-01T19:56:20.445 INFO:teuthology.orchestra.run.smithi008.stdout: "duration": 0 2023-08-01T19:56:20.445 INFO:teuthology.orchestra.run.smithi008.stdout: }, 2023-08-01T19:56:20.445 INFO:teuthology.orchestra.run.smithi008.stdout: { 2023-08-01T19:56:20.446 INFO:teuthology.orchestra.run.smithi008.stdout: "event": "header_read", 2023-08-01T19:56:20.446 INFO:teuthology.orchestra.run.smithi008.stdout: "time": "2023-08-01T19:56:20.416230+0000", 2023-08-01T19:56:20.446 INFO:teuthology.orchestra.run.smithi008.stdout: "duration": 4294967295.9999995 2023-08-01T19:56:20.446 INFO:teuthology.orchestra.run.smithi008.stdout: }, 2023-08-01T19:56:20.446 INFO:teuthology.orchestra.run.smithi008.stdout: { 2023-08-01T19:56:20.446 INFO:teuthology.orchestra.run.smithi008.stdout: "event": "all_read", 2023-08-01T19:56:20.446 INFO:teuthology.orchestra.run.smithi008.stdout: "time": "2023-08-01T19:56:20.416234+0000", 2023-08-01T19:56:20.447 INFO:teuthology.orchestra.run.smithi008.stdout: "duration": 4.2320000000000003e-06 2023-08-01T19:56:20.447 INFO:teuthology.orchestra.run.smithi008.stdout: }, 2023-08-01T19:56:20.447 INFO:teuthology.orchestra.run.smithi008.stdout: { 2023-08-01T19:56:20.447 INFO:teuthology.orchestra.run.smithi008.stdout: "event": "dispatched", 2023-08-01T19:56:20.447 INFO:teuthology.orchestra.run.smithi008.stdout: "time": "2023-08-01T19:56:20.416242+0000", 2023-08-01T19:56:20.447 INFO:teuthology.orchestra.run.smithi008.stdout: "duration": 7.5669999999999997e-06 2023-08-01T19:56:20.447 INFO:teuthology.orchestra.run.smithi008.stdout: }, 2023-08-01T19:56:20.447 INFO:teuthology.orchestra.run.smithi008.stdout: { 2023-08-01T19:56:20.448 INFO:teuthology.orchestra.run.smithi008.stdout: "event": "queued_for_pg", 2023-08-01T19:56:20.448 INFO:teuthology.orchestra.run.smithi008.stdout: "time": "2023-08-01T19:56:20.416248+0000", 2023-08-01T19:56:20.448 INFO:teuthology.orchestra.run.smithi008.stdout: "duration": 5.8409999999999996e-06 2023-08-01T19:56:20.448 INFO:teuthology.orchestra.run.smithi008.stdout: }, 2023-08-01T19:56:20.448 INFO:teuthology.orchestra.run.smithi008.stdout: { 2023-08-01T19:56:20.448 INFO:teuthology.orchestra.run.smithi008.stdout: "event": "reached_pg", 2023-08-01T19:56:20.449 INFO:teuthology.orchestra.run.smithi008.stdout: "time": "2023-08-01T19:56:20.416700+0000", 2023-08-01T19:56:20.449 INFO:teuthology.orchestra.run.smithi008.stdout: "duration": 0.00045220699999999999 2023-08-01T19:56:20.449 INFO:teuthology.orchestra.run.smithi008.stdout: }, 2023-08-01T19:56:20.449 INFO:teuthology.orchestra.run.smithi008.stdout: { 2023-08-01T19:56:20.449 INFO:teuthology.orchestra.run.smithi008.stdout: "event": "started", 2023-08-01T19:56:20.449 INFO:teuthology.orchestra.run.smithi008.stdout: "time": "2023-08-01T19:56:20.416719+0000", 2023-08-01T19:56:20.449 INFO:teuthology.orchestra.run.smithi008.stdout: "duration": 1.8512000000000002e-05 2023-08-01T19:56:20.450 INFO:teuthology.orchestra.run.smithi008.stdout: } 2023-08-01T19:56:20.450 INFO:teuthology.orchestra.run.smithi008.stdout: ] 2023-08-01T19:56:20.450 INFO:teuthology.orchestra.run.smithi008.stdout: } 2023-08-01T19:56:20.450 INFO:teuthology.orchestra.run.smithi008.stdout: }, 2023-08-01T19:56:20.450 INFO:teuthology.orchestra.run.smithi008.stdout: { 2023-08-01T19:56:20.450 INFO:teuthology.orchestra.run.smithi008.stdout: "description": "osd_op(client.4668.0:240270 5.7 5:ec404524:::benchmark_data_smithi006_114134_object106609:head [delete] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e70)", 2023-08-01T19:56:20.451 INFO:teuthology.orchestra.run.smithi008.stdout: "initiated_at": "2023-08-01T19:56:20.417007+0000", 2023-08-01T19:56:20.451 INFO:teuthology.orchestra.run.smithi008.stdout: "age": 0.0057017409999999998, 2023-08-01T19:56:20.451 INFO:teuthology.orchestra.run.smithi008.stdout: "duration": 0.0058436699999999996, 2023-08-01T19:56:20.451 INFO:teuthology.orchestra.run.smithi008.stdout: "type_data": { 2023-08-01T19:56:20.451 INFO:teuthology.orchestra.run.smithi008.stdout: "flag_point": "started", 2023-08-01T19:56:20.451 INFO:teuthology.orchestra.run.smithi008.stdout: "client_info": { 2023-08-01T19:56:20.451 INFO:teuthology.orchestra.run.smithi008.stdout: "client": "client.4668", 2023-08-01T19:56:20.451 INFO:teuthology.orchestra.run.smithi008.stdout: "client_addr": "172.21.15.6:0/1709472247", 2023-08-01T19:56:20.452 INFO:teuthology.orchestra.run.smithi008.stdout: "tid": 240270 2023-08-01T19:56:20.452 INFO:teuthology.orchestra.run.smithi008.stdout: }, 2023-08-01T19:56:20.452 INFO:teuthology.orchestra.run.smithi008.stdout: "events": [ 2023-08-01T19:56:20.452 INFO:teuthology.orchestra.run.smithi008.stdout: { 2023-08-01T19:56:20.452 INFO:teuthology.orchestra.run.smithi008.stdout: "event": "initiated", 2023-08-01T19:56:20.452 INFO:teuthology.orchestra.run.smithi008.stdout: "time": "2023-08-01T19:56:20.417007+0000", 2023-08-01T19:56:20.452 INFO:teuthology.orchestra.run.smithi008.stdout: "duration": 0 2023-08-01T19:56:20.453 INFO:teuthology.orchestra.run.smithi008.stdout: }, 2023-08-01T19:56:20.453 INFO:teuthology.orchestra.run.smithi008.stdout: { 2023-08-01T19:56:20.453 INFO:teuthology.orchestra.run.smithi008.stdout: "event": "throttled", 2023-08-01T19:56:20.453 INFO:teuthology.orchestra.run.smithi008.stdout: "time": "2023-08-01T19:56:20.417007+0000", 2023-08-01T19:56:20.453 INFO:teuthology.orchestra.run.smithi008.stdout: "duration": 0 2023-08-01T19:56:20.453 INFO:teuthology.orchestra.run.smithi008.stdout: }, 2023-08-01T19:56:20.453 INFO:teuthology.orchestra.run.smithi008.stdout: { 2023-08-01T19:56:20.453 INFO:teuthology.orchestra.run.smithi008.stdout: "event": "header_read", 2023-08-01T19:56:20.454 INFO:teuthology.orchestra.run.smithi008.stdout: "time": "2023-08-01T19:56:20.417006+0000", 2023-08-01T19:56:20.454 INFO:teuthology.orchestra.run.smithi008.stdout: "duration": 4294967295.9999995 2023-08-01T19:56:20.454 INFO:teuthology.orchestra.run.smithi008.stdout: }, 2023-08-01T19:56:20.454 INFO:teuthology.orchestra.run.smithi008.stdout: { 2023-08-01T19:56:20.454 INFO:teuthology.orchestra.run.smithi008.stdout: "event": "all_read", 2023-08-01T19:56:20.454 INFO:teuthology.orchestra.run.smithi008.stdout: "time": "2023-08-01T19:56:20.417010+0000", 2023-08-01T19:56:20.454 INFO:teuthology.orchestra.run.smithi008.stdout: "duration": 4.3320000000000002e-06 2023-08-01T19:56:20.455 INFO:teuthology.orchestra.run.smithi008.stdout: }, 2023-08-01T19:56:20.455 INFO:teuthology.orchestra.run.smithi008.stdout: { 2023-08-01T19:56:20.455 INFO:teuthology.orchestra.run.smithi008.stdout: "event": "dispatched", 2023-08-01T19:56:20.455 INFO:teuthology.orchestra.run.smithi008.stdout: "time": "2023-08-01T19:56:20.417019+0000", 2023-08-01T19:56:20.455 INFO:teuthology.orchestra.run.smithi008.stdout: "duration": 8.7420000000000003e-06 2023-08-01T19:56:20.455 INFO:teuthology.orchestra.run.smithi008.stdout: }, 2023-08-01T19:56:20.455 INFO:teuthology.orchestra.run.smithi008.stdout: { 2023-08-01T19:56:20.456 INFO:teuthology.orchestra.run.smithi008.stdout: "event": "queued_for_pg", 2023-08-01T19:56:20.456 INFO:teuthology.orchestra.run.smithi008.stdout: "time": "2023-08-01T19:56:20.417024+0000", 2023-08-01T19:56:20.456 INFO:teuthology.orchestra.run.smithi008.stdout: "duration": 4.5689999999999998e-06 2023-08-01T19:56:20.456 INFO:teuthology.orchestra.run.smithi008.stdout: }, 2023-08-01T19:56:20.456 INFO:teuthology.orchestra.run.smithi008.stdout: { 2023-08-01T19:56:20.456 INFO:teuthology.orchestra.run.smithi008.stdout: "event": "reached_pg", 2023-08-01T19:56:20.456 INFO:teuthology.orchestra.run.smithi008.stdout: "time": "2023-08-01T19:56:20.417059+0000", 2023-08-01T19:56:20.456 INFO:teuthology.orchestra.run.smithi008.stdout: "duration": 3.5726999999999999e-05 2023-08-01T19:56:20.457 INFO:teuthology.orchestra.run.smithi008.stdout: }, 2023-08-01T19:56:20.457 INFO:teuthology.orchestra.run.smithi008.stdout: { 2023-08-01T19:56:20.457 INFO:teuthology.orchestra.run.smithi008.stdout: "event": "started", 2023-08-01T19:56:20.457 INFO:teuthology.orchestra.run.smithi008.stdout: "time": "2023-08-01T19:56:20.417192+0000", 2023-08-01T19:56:20.457 INFO:teuthology.orchestra.run.smithi008.stdout: "duration": 0.00013291099999999999 2023-08-01T19:56:20.457 INFO:teuthology.orchestra.run.smithi008.stdout: } 2023-08-01T19:56:20.457 INFO:teuthology.orchestra.run.smithi008.stdout: ] 2023-08-01T19:56:20.457 INFO:teuthology.orchestra.run.smithi008.stdout: } 2023-08-01T19:56:20.458 INFO:teuthology.orchestra.run.smithi008.stdout: }, 2023-08-01T19:56:20.458 INFO:teuthology.orchestra.run.smithi008.stdout: { 2023-08-01T19:56:20.458 INFO:teuthology.orchestra.run.smithi008.stdout: "description": "osd_op(client.4668.0:240271 5.5 5:ab25ee3c:::benchmark_data_smithi006_114134_object106610:head [delete] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e70)", 2023-08-01T19:56:20.458 INFO:teuthology.orchestra.run.smithi008.stdout: "initiated_at": "2023-08-01T19:56:20.417033+0000", 2023-08-01T19:56:20.458 INFO:teuthology.orchestra.run.smithi008.stdout: "age": 0.0056756899999999997, 2023-08-01T19:56:20.458 INFO:teuthology.orchestra.run.smithi008.stdout: "duration": 0.00585821, 2023-08-01T19:56:20.458 INFO:teuthology.orchestra.run.smithi008.stdout: "type_data": { 2023-08-01T19:56:20.459 INFO:teuthology.orchestra.run.smithi008.stdout: "flag_point": "started", 2023-08-01T19:56:20.459 INFO:teuthology.orchestra.run.smithi008.stdout: "client_info": { 2023-08-01T19:56:20.459 INFO:teuthology.orchestra.run.smithi008.stdout: "client": "client.4668", 2023-08-01T19:56:20.459 INFO:teuthology.orchestra.run.smithi008.stdout: "client_addr": "172.21.15.6:0/1709472247", 2023-08-01T19:56:20.459 INFO:teuthology.orchestra.run.smithi008.stdout: "tid": 240271 2023-08-01T19:56:20.459 INFO:teuthology.orchestra.run.smithi008.stdout: }, 2023-08-01T19:56:20.459 INFO:teuthology.orchestra.run.smithi008.stdout: "events": [ 2023-08-01T19:56:20.459 INFO:teuthology.orchestra.run.smithi008.stdout: { 2023-08-01T19:56:20.460 INFO:teuthology.orchestra.run.smithi008.stdout: "event": "initiated", 2023-08-01T19:56:20.460 INFO:teuthology.orchestra.run.smithi008.stdout: "time": "2023-08-01T19:56:20.417033+0000", 2023-08-01T19:56:20.460 INFO:teuthology.orchestra.run.smithi008.stdout: "duration": 0 2023-08-01T19:56:20.460 INFO:teuthology.orchestra.run.smithi008.stdout: }, 2023-08-01T19:56:20.460 INFO:teuthology.orchestra.run.smithi008.stdout: { 2023-08-01T19:56:20.460 INFO:teuthology.orchestra.run.smithi008.stdout: "event": "throttled", 2023-08-01T19:56:20.460 INFO:teuthology.orchestra.run.smithi008.stdout: "time": "2023-08-01T19:56:20.417033+0000", 2023-08-01T19:56:20.460 INFO:teuthology.orchestra.run.smithi008.stdout: "duration": 0 2023-08-01T19:56:20.461 INFO:teuthology.orchestra.run.smithi008.stdout: }, 2023-08-01T19:56:20.461 INFO:teuthology.orchestra.run.smithi008.stdout: { 2023-08-01T19:56:20.461 INFO:teuthology.orchestra.run.smithi008.stdout: "event": "header_read", 2023-08-01T19:56:20.461 INFO:teuthology.orchestra.run.smithi008.stdout: "time": "2023-08-01T19:56:20.417032+0000", 2023-08-01T19:56:20.461 INFO:teuthology.orchestra.run.smithi008.stdout: "duration": 4294967295.9999995 2023-08-01T19:56:20.461 INFO:teuthology.orchestra.run.smithi008.stdout: }, 2023-08-01T19:56:20.461 INFO:teuthology.orchestra.run.smithi008.stdout: { 2023-08-01T19:56:20.461 INFO:teuthology.orchestra.run.smithi008.stdout: "event": "all_read", 2023-08-01T19:56:20.462 INFO:teuthology.orchestra.run.smithi008.stdout: "time": "2023-08-01T19:56:20.417035+0000", 2023-08-01T19:56:20.462 INFO:teuthology.orchestra.run.smithi008.stdout: "duration": 2.9129999999999999e-06 2023-08-01T19:56:20.462 INFO:teuthology.orchestra.run.smithi008.stdout: }, 2023-08-01T19:56:20.462 INFO:teuthology.orchestra.run.smithi008.stdout: { 2023-08-01T19:56:20.462 INFO:teuthology.orchestra.run.smithi008.stdout: "event": "dispatched", 2023-08-01T19:56:20.462 INFO:teuthology.orchestra.run.smithi008.stdout: "time": "2023-08-01T19:56:20.417042+0000", 2023-08-01T19:56:20.462 INFO:teuthology.orchestra.run.smithi008.stdout: "duration": 6.3099999999999997e-06 2023-08-01T19:56:20.463 INFO:teuthology.orchestra.run.smithi008.stdout: }, 2023-08-01T19:56:20.463 INFO:teuthology.orchestra.run.smithi008.stdout: { 2023-08-01T19:56:20.463 INFO:teuthology.orchestra.run.smithi008.stdout: "event": "queued_for_pg", 2023-08-01T19:56:20.463 INFO:teuthology.orchestra.run.smithi008.stdout: "time": "2023-08-01T19:56:20.417046+0000", 2023-08-01T19:56:20.463 INFO:teuthology.orchestra.run.smithi008.stdout: "duration": 4.5360000000000003e-06 2023-08-01T19:56:20.463 INFO:teuthology.orchestra.run.smithi008.stdout: }, 2023-08-01T19:56:20.463 INFO:teuthology.orchestra.run.smithi008.stdout: { 2023-08-01T19:56:20.463 INFO:teuthology.orchestra.run.smithi008.stdout: "event": "reached_pg", 2023-08-01T19:56:20.464 INFO:teuthology.orchestra.run.smithi008.stdout: "time": "2023-08-01T19:56:20.418761+0000", 2023-08-01T19:56:20.464 INFO:teuthology.orchestra.run.smithi008.stdout: "duration": 0.001715236 2023-08-01T19:56:20.464 INFO:teuthology.orchestra.run.smithi008.stdout: }, 2023-08-01T19:56:20.464 INFO:teuthology.orchestra.run.smithi008.stdout: { 2023-08-01T19:56:20.464 INFO:teuthology.orchestra.run.smithi008.stdout: "event": "started", 2023-08-01T19:56:20.464 INFO:teuthology.orchestra.run.smithi008.stdout: "time": "2023-08-01T19:56:20.418886+0000", 2023-08-01T19:56:20.464 INFO:teuthology.orchestra.run.smithi008.stdout: "duration": 0.00012468900000000001 2023-08-01T19:56:20.465 INFO:teuthology.orchestra.run.smithi008.stdout: } 2023-08-01T19:56:20.465 INFO:teuthology.orchestra.run.smithi008.stdout: ] 2023-08-01T19:56:20.465 INFO:teuthology.orchestra.run.smithi008.stdout: } 2023-08-01T19:56:20.465 INFO:teuthology.orchestra.run.smithi008.stdout: }, 2023-08-01T19:56:20.465 INFO:teuthology.orchestra.run.smithi008.stdout: { 2023-08-01T19:56:20.465 INFO:teuthology.orchestra.run.smithi008.stdout: "description": "osd_op(client.4668.0:240272 5.6 5:6a24116c:::benchmark_data_smithi006_114134_object106611:head [delete] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e70)", 2023-08-01T19:56:20.465 INFO:teuthology.orchestra.run.smithi008.stdout: "initiated_at": "2023-08-01T19:56:20.417053+0000", 2023-08-01T19:56:20.465 INFO:teuthology.orchestra.run.smithi008.stdout: "age": 0.0056555729999999997, 2023-08-01T19:56:20.466 INFO:teuthology.orchestra.run.smithi008.stdout: "duration": 0.0058778479999999998, 2023-08-01T19:56:20.466 INFO:teuthology.orchestra.run.smithi008.stdout: "type_data": { 2023-08-01T19:56:20.466 INFO:teuthology.orchestra.run.smithi008.stdout: "flag_point": "started", 2023-08-01T19:56:20.466 INFO:teuthology.orchestra.run.smithi008.stdout: "client_info": { 2023-08-01T19:56:20.466 INFO:teuthology.orchestra.run.smithi008.stdout: "client": "client.4668", 2023-08-01T19:56:20.466 INFO:teuthology.orchestra.run.smithi008.stdout: "client_addr": "172.21.15.6:0/1709472247", 2023-08-01T19:56:20.466 INFO:teuthology.orchestra.run.smithi008.stdout: "tid": 240272 2023-08-01T19:56:20.466 INFO:teuthology.orchestra.run.smithi008.stdout: }, 2023-08-01T19:56:20.467 INFO:teuthology.orchestra.run.smithi008.stdout: "events": [ 2023-08-01T19:56:20.467 INFO:teuthology.orchestra.run.smithi008.stdout: { 2023-08-01T19:56:20.467 INFO:teuthology.orchestra.run.smithi008.stdout: "event": "initiated", 2023-08-01T19:56:20.467 INFO:teuthology.orchestra.run.smithi008.stdout: "time": "2023-08-01T19:56:20.417053+0000", 2023-08-01T19:56:20.467 INFO:teuthology.orchestra.run.smithi008.stdout: "duration": 0 2023-08-01T19:56:20.467 INFO:teuthology.orchestra.run.smithi008.stdout: }, 2023-08-01T19:56:20.467 INFO:teuthology.orchestra.run.smithi008.stdout: { 2023-08-01T19:56:20.468 INFO:teuthology.orchestra.run.smithi008.stdout: "event": "throttled", 2023-08-01T19:56:20.468 INFO:teuthology.orchestra.run.smithi008.stdout: "time": "2023-08-01T19:56:20.417053+0000", 2023-08-01T19:56:20.468 INFO:teuthology.orchestra.run.smithi008.stdout: "duration": 0 2023-08-01T19:56:20.468 INFO:teuthology.orchestra.run.smithi008.stdout: }, 2023-08-01T19:56:20.468 INFO:teuthology.orchestra.run.smithi008.stdout: { 2023-08-01T19:56:20.468 INFO:teuthology.orchestra.run.smithi008.stdout: "event": "header_read", 2023-08-01T19:56:20.468 INFO:teuthology.orchestra.run.smithi008.stdout: "time": "2023-08-01T19:56:20.417052+0000", 2023-08-01T19:56:20.468 INFO:teuthology.orchestra.run.smithi008.stdout: "duration": 4294967295.9999995 2023-08-01T19:56:20.469 INFO:teuthology.orchestra.run.smithi008.stdout: }, 2023-08-01T19:56:20.469 INFO:teuthology.orchestra.run.smithi008.stdout: { 2023-08-01T19:56:20.469 INFO:teuthology.orchestra.run.smithi008.stdout: "event": "all_read", 2023-08-01T19:56:20.469 INFO:teuthology.orchestra.run.smithi008.stdout: "time": "2023-08-01T19:56:20.417055+0000", 2023-08-01T19:56:20.469 INFO:teuthology.orchestra.run.smithi008.stdout: "duration": 2.5720000000000001e-06 2023-08-01T19:56:20.469 INFO:teuthology.orchestra.run.smithi008.stdout: }, 2023-08-01T19:56:20.469 INFO:teuthology.orchestra.run.smithi008.stdout: { 2023-08-01T19:56:20.469 INFO:teuthology.orchestra.run.smithi008.stdout: "event": "dispatched", 2023-08-01T19:56:20.470 INFO:teuthology.orchestra.run.smithi008.stdout: "time": "2023-08-01T19:56:20.417061+0000", 2023-08-01T19:56:20.470 INFO:teuthology.orchestra.run.smithi008.stdout: "duration": 5.9920000000000004e-06 2023-08-01T19:56:20.470 INFO:teuthology.orchestra.run.smithi008.stdout: }, 2023-08-01T19:56:20.470 INFO:teuthology.orchestra.run.smithi008.stdout: { 2023-08-01T19:56:20.470 INFO:teuthology.orchestra.run.smithi008.stdout: "event": "queued_for_pg", 2023-08-01T19:56:20.470 INFO:teuthology.orchestra.run.smithi008.stdout: "time": "2023-08-01T19:56:20.417065+0000", 2023-08-01T19:56:20.470 INFO:teuthology.orchestra.run.smithi008.stdout: "duration": 3.9330000000000003e-06 2023-08-01T19:56:20.471 INFO:teuthology.orchestra.run.smithi008.stdout: }, 2023-08-01T19:56:20.471 INFO:teuthology.orchestra.run.smithi008.stdout: { 2023-08-01T19:56:20.471 INFO:teuthology.orchestra.run.smithi008.stdout: "event": "reached_pg", 2023-08-01T19:56:20.471 INFO:teuthology.orchestra.run.smithi008.stdout: "time": "2023-08-01T19:56:20.417103+0000", 2023-08-01T19:56:20.471 INFO:teuthology.orchestra.run.smithi008.stdout: "duration": 3.7667999999999999e-05 2023-08-01T19:56:20.471 INFO:teuthology.orchestra.run.smithi008.stdout: }, 2023-08-01T19:56:20.471 INFO:teuthology.orchestra.run.smithi008.stdout: { 2023-08-01T19:56:20.471 INFO:teuthology.orchestra.run.smithi008.stdout: "event": "started", 2023-08-01T19:56:20.472 INFO:teuthology.orchestra.run.smithi008.stdout: "time": "2023-08-01T19:56:20.417236+0000", 2023-08-01T19:56:20.472 INFO:teuthology.orchestra.run.smithi008.stdout: "duration": 0.000133456 2023-08-01T19:56:20.472 INFO:teuthology.orchestra.run.smithi008.stdout: } 2023-08-01T19:56:20.472 INFO:teuthology.orchestra.run.smithi008.stdout: ] 2023-08-01T19:56:20.472 INFO:teuthology.orchestra.run.smithi008.stdout: } 2023-08-01T19:56:20.472 INFO:teuthology.orchestra.run.smithi008.stdout: }, 2023-08-01T19:56:20.472 INFO:teuthology.orchestra.run.smithi008.stdout: { 2023-08-01T19:56:20.472 INFO:teuthology.orchestra.run.smithi008.stdout: "description": "osd_op(client.4668.0:240273 5.c 5:39c5f734:::benchmark_data_smithi006_114134_object106612:head [delete] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e70)", 2023-08-01T19:56:20.473 INFO:teuthology.orchestra.run.smithi008.stdout: "initiated_at": "2023-08-01T19:56:20.417076+0000", 2023-08-01T19:56:20.473 INFO:teuthology.orchestra.run.smithi008.stdout: "age": 0.0056321219999999998, 2023-08-01T19:56:20.473 INFO:teuthology.orchestra.run.smithi008.stdout: "duration": 0.005893779, 2023-08-01T19:56:20.473 INFO:teuthology.orchestra.run.smithi008.stdout: "type_data": { 2023-08-01T19:56:20.473 INFO:teuthology.orchestra.run.smithi008.stdout: "flag_point": "started", 2023-08-01T19:56:20.473 INFO:teuthology.orchestra.run.smithi008.stdout: "client_info": { 2023-08-01T19:56:20.473 INFO:teuthology.orchestra.run.smithi008.stdout: "client": "client.4668", 2023-08-01T19:56:20.473 INFO:teuthology.orchestra.run.smithi008.stdout: "client_addr": "172.21.15.6:0/1709472247", 2023-08-01T19:56:20.474 INFO:teuthology.orchestra.run.smithi008.stdout: "tid": 240273 2023-08-01T19:56:20.474 INFO:teuthology.orchestra.run.smithi008.stdout: }, 2023-08-01T19:56:20.474 INFO:teuthology.orchestra.run.smithi008.stdout: "events": [ 2023-08-01T19:56:20.474 INFO:teuthology.orchestra.run.smithi008.stdout: { 2023-08-01T19:56:20.474 INFO:teuthology.orchestra.run.smithi008.stdout: "event": "initiated", 2023-08-01T19:56:20.474 INFO:teuthology.orchestra.run.smithi008.stdout: "time": "2023-08-01T19:56:20.417076+0000", 2023-08-01T19:56:20.474 INFO:teuthology.orchestra.run.smithi008.stdout: "duration": 0 2023-08-01T19:56:20.474 INFO:teuthology.orchestra.run.smithi008.stdout: }, 2023-08-01T19:56:20.475 INFO:teuthology.orchestra.run.smithi008.stdout: { 2023-08-01T19:56:20.475 INFO:teuthology.orchestra.run.smithi008.stdout: "event": "throttled", 2023-08-01T19:56:20.475 INFO:teuthology.orchestra.run.smithi008.stdout: "time": "2023-08-01T19:56:20.417076+0000", 2023-08-01T19:56:20.475 INFO:teuthology.orchestra.run.smithi008.stdout: "duration": 0 2023-08-01T19:56:20.475 INFO:teuthology.orchestra.run.smithi008.stdout: }, 2023-08-01T19:56:20.475 INFO:teuthology.orchestra.run.smithi008.stdout: { 2023-08-01T19:56:20.475 INFO:teuthology.orchestra.run.smithi008.stdout: "event": "header_read", 2023-08-01T19:56:20.476 INFO:teuthology.orchestra.run.smithi008.stdout: "time": "2023-08-01T19:56:20.417076+0000", 2023-08-01T19:56:20.476 INFO:teuthology.orchestra.run.smithi008.stdout: "duration": 4294967295.9999995 2023-08-01T19:56:20.476 INFO:teuthology.orchestra.run.smithi008.stdout: }, 2023-08-01T19:56:20.476 INFO:teuthology.orchestra.run.smithi008.stdout: { 2023-08-01T19:56:20.476 INFO:teuthology.orchestra.run.smithi008.stdout: "event": "all_read", 2023-08-01T19:56:20.476 INFO:teuthology.orchestra.run.smithi008.stdout: "time": "2023-08-01T19:56:20.417078+0000", 2023-08-01T19:56:20.476 INFO:teuthology.orchestra.run.smithi008.stdout: "duration": 2.3530000000000002e-06 2023-08-01T19:56:20.476 INFO:teuthology.orchestra.run.smithi008.stdout: }, 2023-08-01T19:56:20.477 INFO:teuthology.orchestra.run.smithi008.stdout: { 2023-08-01T19:56:20.477 INFO:teuthology.orchestra.run.smithi008.stdout: "event": "dispatched", 2023-08-01T19:56:20.477 INFO:teuthology.orchestra.run.smithi008.stdout: "time": "2023-08-01T19:56:20.417085+0000", 2023-08-01T19:56:20.477 INFO:teuthology.orchestra.run.smithi008.stdout: "duration": 6.64e-06 2023-08-01T19:56:20.477 INFO:teuthology.orchestra.run.smithi008.stdout: }, 2023-08-01T19:56:20.477 INFO:teuthology.orchestra.run.smithi008.stdout: { 2023-08-01T19:56:20.477 INFO:teuthology.orchestra.run.smithi008.stdout: "event": "queued_for_pg", 2023-08-01T19:56:20.477 INFO:teuthology.orchestra.run.smithi008.stdout: "time": "2023-08-01T19:56:20.417089+0000", 2023-08-01T19:56:20.478 INFO:teuthology.orchestra.run.smithi008.stdout: "duration": 4.2479999999999998e-06 2023-08-01T19:56:20.478 INFO:teuthology.orchestra.run.smithi008.stdout: }, 2023-08-01T19:56:20.478 INFO:teuthology.orchestra.run.smithi008.stdout: { 2023-08-01T19:56:20.478 INFO:teuthology.orchestra.run.smithi008.stdout: "event": "reached_pg", 2023-08-01T19:56:20.478 INFO:teuthology.orchestra.run.smithi008.stdout: "time": "2023-08-01T19:56:20.417161+0000", 2023-08-01T19:56:20.478 INFO:teuthology.orchestra.run.smithi008.stdout: "duration": 7.1685000000000002e-05 2023-08-01T19:56:20.478 INFO:teuthology.orchestra.run.smithi008.stdout: }, 2023-08-01T19:56:20.479 INFO:teuthology.orchestra.run.smithi008.stdout: { 2023-08-01T19:56:20.479 INFO:teuthology.orchestra.run.smithi008.stdout: "event": "started", 2023-08-01T19:56:20.479 INFO:teuthology.orchestra.run.smithi008.stdout: "time": "2023-08-01T19:56:20.417283+0000", 2023-08-01T19:56:20.479 INFO:teuthology.orchestra.run.smithi008.stdout: "duration": 0.000122416 2023-08-01T19:56:20.479 INFO:teuthology.orchestra.run.smithi008.stdout: } 2023-08-01T19:56:20.479 INFO:teuthology.orchestra.run.smithi008.stdout: ] 2023-08-01T19:56:20.479 INFO:teuthology.orchestra.run.smithi008.stdout: } 2023-08-01T19:56:20.480 INFO:teuthology.orchestra.run.smithi008.stdout: }, 2023-08-01T19:56:20.480 INFO:teuthology.orchestra.run.smithi008.stdout: { 2023-08-01T19:56:20.480 INFO:teuthology.orchestra.run.smithi008.stdout: "description": "osd_op(client.4668.0:240274 5.a 5:5f45c7ee:::benchmark_data_smithi006_114134_object106613:head [delete] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e70)", 2023-08-01T19:56:20.480 INFO:teuthology.orchestra.run.smithi008.stdout: "initiated_at": "2023-08-01T19:56:20.417098+0000", 2023-08-01T19:56:20.480 INFO:teuthology.orchestra.run.smithi008.stdout: "age": 0.005610093, 2023-08-01T19:56:20.480 INFO:teuthology.orchestra.run.smithi008.stdout: "duration": 0.0059277899999999996, 2023-08-01T19:56:20.480 INFO:teuthology.orchestra.run.smithi008.stdout: "type_data": { 2023-08-01T19:56:20.481 INFO:teuthology.orchestra.run.smithi008.stdout: "flag_point": "waiting for sub ops", 2023-08-01T19:56:20.481 INFO:teuthology.orchestra.run.smithi008.stdout: "client_info": { 2023-08-01T19:56:20.481 INFO:teuthology.orchestra.run.smithi008.stdout: "client": "client.4668", 2023-08-01T19:56:20.481 INFO:teuthology.orchestra.run.smithi008.stdout: "client_addr": "172.21.15.6:0/1709472247", 2023-08-01T19:56:20.481 INFO:teuthology.orchestra.run.smithi008.stdout: "tid": 240274 2023-08-01T19:56:20.481 INFO:teuthology.orchestra.run.smithi008.stdout: }, 2023-08-01T19:56:20.481 INFO:teuthology.orchestra.run.smithi008.stdout: "events": [ 2023-08-01T19:56:20.481 INFO:teuthology.orchestra.run.smithi008.stdout: { 2023-08-01T19:56:20.482 INFO:teuthology.orchestra.run.smithi008.stdout: "event": "initiated", 2023-08-01T19:56:20.482 INFO:teuthology.orchestra.run.smithi008.stdout: "time": "2023-08-01T19:56:20.417098+0000", 2023-08-01T19:56:20.482 INFO:teuthology.orchestra.run.smithi008.stdout: "duration": 0 2023-08-01T19:56:20.482 INFO:teuthology.orchestra.run.smithi008.stdout: }, 2023-08-01T19:56:20.482 INFO:teuthology.orchestra.run.smithi008.stdout: { 2023-08-01T19:56:20.482 INFO:teuthology.orchestra.run.smithi008.stdout: "event": "throttled", 2023-08-01T19:56:20.482 INFO:teuthology.orchestra.run.smithi008.stdout: "time": "2023-08-01T19:56:20.417098+0000", 2023-08-01T19:56:20.483 INFO:teuthology.orchestra.run.smithi008.stdout: "duration": 0 2023-08-01T19:56:20.483 INFO:teuthology.orchestra.run.smithi008.stdout: }, 2023-08-01T19:56:20.483 INFO:teuthology.orchestra.run.smithi008.stdout: { 2023-08-01T19:56:20.483 INFO:teuthology.orchestra.run.smithi008.stdout: "event": "header_read", 2023-08-01T19:56:20.483 INFO:teuthology.orchestra.run.smithi008.stdout: "time": "2023-08-01T19:56:20.417098+0000", 2023-08-01T19:56:20.483 INFO:teuthology.orchestra.run.smithi008.stdout: "duration": 4294967295.9999995 2023-08-01T19:56:20.483 INFO:teuthology.orchestra.run.smithi008.stdout: }, 2023-08-01T19:56:20.484 INFO:teuthology.orchestra.run.smithi008.stdout: { 2023-08-01T19:56:20.484 INFO:teuthology.orchestra.run.smithi008.stdout: "event": "all_read", 2023-08-01T19:56:20.484 INFO:teuthology.orchestra.run.smithi008.stdout: "time": "2023-08-01T19:56:20.417101+0000", 2023-08-01T19:56:20.484 INFO:teuthology.orchestra.run.smithi008.stdout: "duration": 2.6730000000000001e-06 2023-08-01T19:56:20.484 INFO:teuthology.orchestra.run.smithi008.stdout: }, 2023-08-01T19:56:20.484 INFO:teuthology.orchestra.run.smithi008.stdout: { 2023-08-01T19:56:20.484 INFO:teuthology.orchestra.run.smithi008.stdout: "event": "dispatched", 2023-08-01T19:56:20.484 INFO:teuthology.orchestra.run.smithi008.stdout: "time": "2023-08-01T19:56:20.417107+0000", 2023-08-01T19:56:20.485 INFO:teuthology.orchestra.run.smithi008.stdout: "duration": 6.2890000000000003e-06 2023-08-01T19:56:20.485 INFO:teuthology.orchestra.run.smithi008.stdout: }, 2023-08-01T19:56:20.485 INFO:teuthology.orchestra.run.smithi008.stdout: { 2023-08-01T19:56:20.485 INFO:teuthology.orchestra.run.smithi008.stdout: "event": "queued_for_pg", 2023-08-01T19:56:20.485 INFO:teuthology.orchestra.run.smithi008.stdout: "time": "2023-08-01T19:56:20.417112+0000", 2023-08-01T19:56:20.485 INFO:teuthology.orchestra.run.smithi008.stdout: "duration": 4.8670000000000002e-06 2023-08-01T19:56:20.485 INFO:teuthology.orchestra.run.smithi008.stdout: }, 2023-08-01T19:56:20.486 INFO:teuthology.orchestra.run.smithi008.stdout: { 2023-08-01T19:56:20.486 INFO:teuthology.orchestra.run.smithi008.stdout: "event": "reached_pg", 2023-08-01T19:56:20.486 INFO:teuthology.orchestra.run.smithi008.stdout: "time": "2023-08-01T19:56:20.417468+0000", 2023-08-01T19:56:20.486 INFO:teuthology.orchestra.run.smithi008.stdout: "duration": 0.00035625000000000001 2023-08-01T19:56:20.486 INFO:teuthology.orchestra.run.smithi008.stdout: }, 2023-08-01T19:56:20.486 INFO:teuthology.orchestra.run.smithi008.stdout: { 2023-08-01T19:56:20.486 INFO:teuthology.orchestra.run.smithi008.stdout: "event": "started", 2023-08-01T19:56:20.486 INFO:teuthology.orchestra.run.smithi008.stdout: "time": "2023-08-01T19:56:20.417578+0000", 2023-08-01T19:56:20.487 INFO:teuthology.orchestra.run.smithi008.stdout: "duration": 0.000109607 2023-08-01T19:56:20.487 INFO:teuthology.orchestra.run.smithi008.stdout: }, 2023-08-01T19:56:20.487 INFO:teuthology.orchestra.run.smithi008.stdout: { 2023-08-01T19:56:20.487 INFO:teuthology.orchestra.run.smithi008.stdout: "event": "waiting for subops from 2", 2023-08-01T19:56:20.487 INFO:teuthology.orchestra.run.smithi008.stdout: "time": "2023-08-01T19:56:20.417686+0000", 2023-08-01T19:56:20.487 INFO:teuthology.orchestra.run.smithi008.stdout: "duration": 0.000108087 2023-08-01T19:56:20.487 INFO:teuthology.orchestra.run.smithi008.stdout: } 2023-08-01T19:56:20.487 INFO:teuthology.orchestra.run.smithi008.stdout: ] 2023-08-01T19:56:20.488 INFO:teuthology.orchestra.run.smithi008.stdout: } 2023-08-01T19:56:20.488 INFO:teuthology.orchestra.run.smithi008.stdout: }, 2023-08-01T19:56:20.488 INFO:teuthology.orchestra.run.smithi008.stdout: { 2023-08-01T19:56:20.488 INFO:teuthology.orchestra.run.smithi008.stdout: "description": "osd_op(client.4668.0:240277 5.a 5:556580c4:::benchmark_data_smithi006_114134_object106616:head [delete] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e70)", 2023-08-01T19:56:20.488 INFO:teuthology.orchestra.run.smithi008.stdout: "initiated_at": "2023-08-01T19:56:20.418750+0000", 2023-08-01T19:56:20.488 INFO:teuthology.orchestra.run.smithi008.stdout: "age": 0.003958736, 2023-08-01T19:56:20.488 INFO:teuthology.orchestra.run.smithi008.stdout: "duration": 0.0043565599999999998, 2023-08-01T19:56:20.489 INFO:teuthology.orchestra.run.smithi008.stdout: "type_data": { 2023-08-01T19:56:20.489 INFO:teuthology.orchestra.run.smithi008.stdout: "flag_point": "waiting for sub ops", 2023-08-01T19:56:20.489 INFO:teuthology.orchestra.run.smithi008.stdout: "client_info": { 2023-08-01T19:56:20.489 INFO:teuthology.orchestra.run.smithi008.stdout: "client": "client.4668", 2023-08-01T19:56:20.489 INFO:teuthology.orchestra.run.smithi008.stdout: "client_addr": "172.21.15.6:0/1709472247", 2023-08-01T19:56:20.489 INFO:teuthology.orchestra.run.smithi008.stdout: "tid": 240277 2023-08-01T19:56:20.489 INFO:teuthology.orchestra.run.smithi008.stdout: }, 2023-08-01T19:56:20.489 INFO:teuthology.orchestra.run.smithi008.stdout: "events": [ 2023-08-01T19:56:20.490 INFO:teuthology.orchestra.run.smithi008.stdout: { 2023-08-01T19:56:20.490 INFO:teuthology.orchestra.run.smithi008.stdout: "event": "initiated", 2023-08-01T19:56:20.490 INFO:teuthology.orchestra.run.smithi008.stdout: "time": "2023-08-01T19:56:20.418750+0000", 2023-08-01T19:56:20.490 INFO:teuthology.orchestra.run.smithi008.stdout: "duration": 0 2023-08-01T19:56:20.490 INFO:teuthology.orchestra.run.smithi008.stdout: }, 2023-08-01T19:56:20.490 INFO:teuthology.orchestra.run.smithi008.stdout: { 2023-08-01T19:56:20.490 INFO:teuthology.orchestra.run.smithi008.stdout: "event": "throttled", 2023-08-01T19:56:20.490 INFO:teuthology.orchestra.run.smithi008.stdout: "time": "2023-08-01T19:56:20.418750+0000", 2023-08-01T19:56:20.491 INFO:teuthology.orchestra.run.smithi008.stdout: "duration": 0 2023-08-01T19:56:20.491 INFO:teuthology.orchestra.run.smithi008.stdout: }, 2023-08-01T19:56:20.491 INFO:teuthology.orchestra.run.smithi008.stdout: { 2023-08-01T19:56:20.491 INFO:teuthology.orchestra.run.smithi008.stdout: "event": "header_read", 2023-08-01T19:56:20.491 INFO:teuthology.orchestra.run.smithi008.stdout: "time": "2023-08-01T19:56:20.418749+0000", 2023-08-01T19:56:20.491 INFO:teuthology.orchestra.run.smithi008.stdout: "duration": 4294967295.999999 2023-08-01T19:56:20.491 INFO:teuthology.orchestra.run.smithi008.stdout: }, 2023-08-01T19:56:20.491 INFO:teuthology.orchestra.run.smithi008.stdout: { 2023-08-01T19:56:20.492 INFO:teuthology.orchestra.run.smithi008.stdout: "event": "all_read", 2023-08-01T19:56:20.492 INFO:teuthology.orchestra.run.smithi008.stdout: "time": "2023-08-01T19:56:20.418754+0000", 2023-08-01T19:56:20.492 INFO:teuthology.orchestra.run.smithi008.stdout: "duration": 5.8680000000000004e-06 2023-08-01T19:56:20.492 INFO:teuthology.orchestra.run.smithi008.stdout: }, 2023-08-01T19:56:20.492 INFO:teuthology.orchestra.run.smithi008.stdout: { 2023-08-01T19:56:20.492 INFO:teuthology.orchestra.run.smithi008.stdout: "event": "dispatched", 2023-08-01T19:56:20.492 INFO:teuthology.orchestra.run.smithi008.stdout: "time": "2023-08-01T19:56:20.418765+0000", 2023-08-01T19:56:20.493 INFO:teuthology.orchestra.run.smithi008.stdout: "duration": 1.0127e-05 2023-08-01T19:56:20.493 INFO:teuthology.orchestra.run.smithi008.stdout: }, 2023-08-01T19:56:20.493 INFO:teuthology.orchestra.run.smithi008.stdout: { 2023-08-01T19:56:20.493 INFO:teuthology.orchestra.run.smithi008.stdout: "event": "queued_for_pg", 2023-08-01T19:56:20.493 INFO:teuthology.orchestra.run.smithi008.stdout: "time": "2023-08-01T19:56:20.418771+0000", 2023-08-01T19:56:20.493 INFO:teuthology.orchestra.run.smithi008.stdout: "duration": 6.28e-06 2023-08-01T19:56:20.493 INFO:teuthology.orchestra.run.smithi008.stdout: }, 2023-08-01T19:56:20.493 INFO:teuthology.orchestra.run.smithi008.stdout: { 2023-08-01T19:56:20.494 INFO:teuthology.orchestra.run.smithi008.stdout: "event": "reached_pg", 2023-08-01T19:56:20.494 INFO:teuthology.orchestra.run.smithi008.stdout: "time": "2023-08-01T19:56:20.419575+0000", 2023-08-01T19:56:20.494 INFO:teuthology.orchestra.run.smithi008.stdout: "duration": 0.00080402800000000003 2023-08-01T19:56:20.494 INFO:teuthology.orchestra.run.smithi008.stdout: }, 2023-08-01T19:56:20.494 INFO:teuthology.orchestra.run.smithi008.stdout: { 2023-08-01T19:56:20.494 INFO:teuthology.orchestra.run.smithi008.stdout: "event": "started", 2023-08-01T19:56:20.494 INFO:teuthology.orchestra.run.smithi008.stdout: "time": "2023-08-01T19:56:20.419717+0000", 2023-08-01T19:56:20.494 INFO:teuthology.orchestra.run.smithi008.stdout: "duration": 0.00014232900000000001 2023-08-01T19:56:20.495 INFO:teuthology.orchestra.run.smithi008.stdout: }, 2023-08-01T19:56:20.495 INFO:teuthology.orchestra.run.smithi008.stdout: { 2023-08-01T19:56:20.495 INFO:teuthology.orchestra.run.smithi008.stdout: "event": "waiting for subops from 2", 2023-08-01T19:56:20.495 INFO:teuthology.orchestra.run.smithi008.stdout: "time": "2023-08-01T19:56:20.419845+0000", 2023-08-01T19:56:20.495 INFO:teuthology.orchestra.run.smithi008.stdout: "duration": 0.000127546 2023-08-01T19:56:20.495 INFO:teuthology.orchestra.run.smithi008.stdout: } 2023-08-01T19:56:20.495 INFO:teuthology.orchestra.run.smithi008.stdout: ] 2023-08-01T19:56:20.495 INFO:teuthology.orchestra.run.smithi008.stdout: } 2023-08-01T19:56:20.496 INFO:teuthology.orchestra.run.smithi008.stdout: }, 2023-08-01T19:56:20.496 INFO:teuthology.orchestra.run.smithi008.stdout: { 2023-08-01T19:56:20.496 INFO:teuthology.orchestra.run.smithi008.stdout: "description": "osd_repop(client.4668.0:240275 5.8 e70/19 5:1d6408ce:::benchmark_data_smithi006_114134_object106614:head v 70'15085, mlcod=70'15081)", 2023-08-01T19:56:20.496 INFO:teuthology.orchestra.run.smithi008.stdout: "initiated_at": "2023-08-01T19:56:20.419203+0000", 2023-08-01T19:56:20.496 INFO:teuthology.orchestra.run.smithi008.stdout: "age": 0.0035056219999999999, 2023-08-01T19:56:20.496 INFO:teuthology.orchestra.run.smithi008.stdout: "duration": 0.0039593919999999999, 2023-08-01T19:56:20.496 INFO:teuthology.orchestra.run.smithi008.stdout: "type_data": { 2023-08-01T19:56:20.497 INFO:teuthology.orchestra.run.smithi008.stdout: "flag_point": "started", 2023-08-01T19:56:20.497 INFO:teuthology.orchestra.run.smithi008.stdout: "events": [ 2023-08-01T19:56:20.497 INFO:teuthology.orchestra.run.smithi008.stdout: { 2023-08-01T19:56:20.497 INFO:teuthology.orchestra.run.smithi008.stdout: "event": "initiated", 2023-08-01T19:56:20.497 INFO:teuthology.orchestra.run.smithi008.stdout: "time": "2023-08-01T19:56:20.419203+0000", 2023-08-01T19:56:20.497 INFO:teuthology.orchestra.run.smithi008.stdout: "duration": 0 2023-08-01T19:56:20.497 INFO:teuthology.orchestra.run.smithi008.stdout: }, 2023-08-01T19:56:20.497 INFO:teuthology.orchestra.run.smithi008.stdout: { 2023-08-01T19:56:20.498 INFO:teuthology.orchestra.run.smithi008.stdout: "event": "throttled", 2023-08-01T19:56:20.498 INFO:teuthology.orchestra.run.smithi008.stdout: "time": "2023-08-01T19:56:20.419203+0000", 2023-08-01T19:56:20.498 INFO:teuthology.orchestra.run.smithi008.stdout: "duration": 0 2023-08-01T19:56:20.498 INFO:teuthology.orchestra.run.smithi008.stdout: }, 2023-08-01T19:56:20.498 INFO:teuthology.orchestra.run.smithi008.stdout: { 2023-08-01T19:56:20.498 INFO:teuthology.orchestra.run.smithi008.stdout: "event": "header_read", 2023-08-01T19:56:20.498 INFO:teuthology.orchestra.run.smithi008.stdout: "time": "2023-08-01T19:56:20.419202+0000", 2023-08-01T19:56:20.498 INFO:teuthology.orchestra.run.smithi008.stdout: "duration": 4294967295.9999995 2023-08-01T19:56:20.499 INFO:teuthology.orchestra.run.smithi008.stdout: }, 2023-08-01T19:56:20.499 INFO:teuthology.orchestra.run.smithi008.stdout: { 2023-08-01T19:56:20.499 INFO:teuthology.orchestra.run.smithi008.stdout: "event": "all_read", 2023-08-01T19:56:20.499 INFO:teuthology.orchestra.run.smithi008.stdout: "time": "2023-08-01T19:56:20.419209+0000", 2023-08-01T19:56:20.499 INFO:teuthology.orchestra.run.smithi008.stdout: "duration": 6.5889999999999999e-06 2023-08-01T19:56:20.499 INFO:teuthology.orchestra.run.smithi008.stdout: }, 2023-08-01T19:56:20.499 INFO:teuthology.orchestra.run.smithi008.stdout: { 2023-08-01T19:56:20.499 INFO:teuthology.orchestra.run.smithi008.stdout: "event": "dispatched", 2023-08-01T19:56:20.500 INFO:teuthology.orchestra.run.smithi008.stdout: "time": "2023-08-01T19:56:20.419227+0000", 2023-08-01T19:56:20.500 INFO:teuthology.orchestra.run.smithi008.stdout: "duration": 1.8595000000000001e-05 2023-08-01T19:56:20.500 INFO:teuthology.orchestra.run.smithi008.stdout: }, 2023-08-01T19:56:20.500 INFO:teuthology.orchestra.run.smithi008.stdout: { 2023-08-01T19:56:20.500 INFO:teuthology.orchestra.run.smithi008.stdout: "event": "queued_for_pg", 2023-08-01T19:56:20.500 INFO:teuthology.orchestra.run.smithi008.stdout: "time": "2023-08-01T19:56:20.419233+0000", 2023-08-01T19:56:20.500 INFO:teuthology.orchestra.run.smithi008.stdout: "duration": 5.3770000000000004e-06 2023-08-01T19:56:20.501 INFO:teuthology.orchestra.run.smithi008.stdout: }, 2023-08-01T19:56:20.501 INFO:teuthology.orchestra.run.smithi008.stdout: { 2023-08-01T19:56:20.501 INFO:teuthology.orchestra.run.smithi008.stdout: "event": "reached_pg", 2023-08-01T19:56:20.501 INFO:teuthology.orchestra.run.smithi008.stdout: "time": "2023-08-01T19:56:20.419334+0000", 2023-08-01T19:56:20.501 INFO:teuthology.orchestra.run.smithi008.stdout: "duration": 0.000101309 2023-08-01T19:56:20.501 INFO:teuthology.orchestra.run.smithi008.stdout: }, 2023-08-01T19:56:20.501 INFO:teuthology.orchestra.run.smithi008.stdout: { 2023-08-01T19:56:20.501 INFO:teuthology.orchestra.run.smithi008.stdout: "event": "started", 2023-08-01T19:56:20.502 INFO:teuthology.orchestra.run.smithi008.stdout: "time": "2023-08-01T19:56:20.419362+0000", 2023-08-01T19:56:20.502 INFO:teuthology.orchestra.run.smithi008.stdout: "duration": 2.8347000000000002e-05 2023-08-01T19:56:20.502 INFO:teuthology.orchestra.run.smithi008.stdout: } 2023-08-01T19:56:20.502 INFO:teuthology.orchestra.run.smithi008.stdout: ] 2023-08-01T19:56:20.502 INFO:teuthology.orchestra.run.smithi008.stdout: } 2023-08-01T19:56:20.502 INFO:teuthology.orchestra.run.smithi008.stdout: }, 2023-08-01T19:56:20.502 INFO:teuthology.orchestra.run.smithi008.stdout: { 2023-08-01T19:56:20.502 INFO:teuthology.orchestra.run.smithi008.stdout: "description": "osd_repop(client.4668.0:240276 5.0 e70/19 5:0eaefb07:::benchmark_data_smithi006_114134_object106615:head v 70'15260, mlcod=70'15257)", 2023-08-01T19:56:20.503 INFO:teuthology.orchestra.run.smithi008.stdout: "initiated_at": "2023-08-01T19:56:20.419242+0000", 2023-08-01T19:56:20.503 INFO:teuthology.orchestra.run.smithi008.stdout: "age": 0.003466074, 2023-08-01T19:56:20.503 INFO:teuthology.orchestra.run.smithi008.stdout: "duration": 0.0039578340000000004, 2023-08-01T19:56:20.503 INFO:teuthology.orchestra.run.smithi008.stdout: "type_data": { 2023-08-01T19:56:20.503 INFO:teuthology.orchestra.run.smithi008.stdout: "flag_point": "started", 2023-08-01T19:56:20.503 INFO:teuthology.orchestra.run.smithi008.stdout: "events": [ 2023-08-01T19:56:20.503 INFO:teuthology.orchestra.run.smithi008.stdout: { 2023-08-01T19:56:20.504 INFO:teuthology.orchestra.run.smithi008.stdout: "event": "initiated", 2023-08-01T19:56:20.504 INFO:teuthology.orchestra.run.smithi008.stdout: "time": "2023-08-01T19:56:20.419242+0000", 2023-08-01T19:56:20.504 INFO:teuthology.orchestra.run.smithi008.stdout: "duration": 0 2023-08-01T19:56:20.504 INFO:teuthology.orchestra.run.smithi008.stdout: }, 2023-08-01T19:56:20.504 INFO:teuthology.orchestra.run.smithi008.stdout: { 2023-08-01T19:56:20.504 INFO:teuthology.orchestra.run.smithi008.stdout: "event": "throttled", 2023-08-01T19:56:20.504 INFO:teuthology.orchestra.run.smithi008.stdout: "time": "2023-08-01T19:56:20.419242+0000", 2023-08-01T19:56:20.505 INFO:teuthology.orchestra.run.smithi008.stdout: "duration": 0 2023-08-01T19:56:20.505 INFO:teuthology.orchestra.run.smithi008.stdout: }, 2023-08-01T19:56:20.505 INFO:teuthology.orchestra.run.smithi008.stdout: { 2023-08-01T19:56:20.505 INFO:teuthology.orchestra.run.smithi008.stdout: "event": "header_read", 2023-08-01T19:56:20.505 INFO:teuthology.orchestra.run.smithi008.stdout: "time": "2023-08-01T19:56:20.419242+0000", 2023-08-01T19:56:20.505 INFO:teuthology.orchestra.run.smithi008.stdout: "duration": 4294967295.9999995 2023-08-01T19:56:20.505 INFO:teuthology.orchestra.run.smithi008.stdout: }, 2023-08-01T19:56:20.505 INFO:teuthology.orchestra.run.smithi008.stdout: { 2023-08-01T19:56:20.506 INFO:teuthology.orchestra.run.smithi008.stdout: "event": "all_read", 2023-08-01T19:56:20.506 INFO:teuthology.orchestra.run.smithi008.stdout: "time": "2023-08-01T19:56:20.419246+0000", 2023-08-01T19:56:20.506 INFO:teuthology.orchestra.run.smithi008.stdout: "duration": 3.9469999999999996e-06 2023-08-01T19:56:20.506 INFO:teuthology.orchestra.run.smithi008.stdout: }, 2023-08-01T19:56:20.506 INFO:teuthology.orchestra.run.smithi008.stdout: { 2023-08-01T19:56:20.506 INFO:teuthology.orchestra.run.smithi008.stdout: "event": "dispatched", 2023-08-01T19:56:20.506 INFO:teuthology.orchestra.run.smithi008.stdout: "time": "2023-08-01T19:56:20.419252+0000", 2023-08-01T19:56:20.507 INFO:teuthology.orchestra.run.smithi008.stdout: "duration": 5.8969999999999996e-06 2023-08-01T19:56:20.507 INFO:teuthology.orchestra.run.smithi008.stdout: }, 2023-08-01T19:56:20.507 INFO:teuthology.orchestra.run.smithi008.stdout: { 2023-08-01T19:56:20.507 INFO:teuthology.orchestra.run.smithi008.stdout: "event": "queued_for_pg", 2023-08-01T19:56:20.507 INFO:teuthology.orchestra.run.smithi008.stdout: "time": "2023-08-01T19:56:20.419256+0000", 2023-08-01T19:56:20.507 INFO:teuthology.orchestra.run.smithi008.stdout: "duration": 4.4510000000000002e-06 2023-08-01T19:56:20.507 INFO:teuthology.orchestra.run.smithi008.stdout: }, 2023-08-01T19:56:20.507 INFO:teuthology.orchestra.run.smithi008.stdout: { 2023-08-01T19:56:20.508 INFO:teuthology.orchestra.run.smithi008.stdout: "event": "reached_pg", 2023-08-01T19:56:20.508 INFO:teuthology.orchestra.run.smithi008.stdout: "time": "2023-08-01T19:56:20.420394+0000", 2023-08-01T19:56:20.508 INFO:teuthology.orchestra.run.smithi008.stdout: "duration": 0.0011375619999999999 2023-08-01T19:56:20.508 INFO:teuthology.orchestra.run.smithi008.stdout: }, 2023-08-01T19:56:20.508 INFO:teuthology.orchestra.run.smithi008.stdout: { 2023-08-01T19:56:20.508 INFO:teuthology.orchestra.run.smithi008.stdout: "event": "started", 2023-08-01T19:56:20.508 INFO:teuthology.orchestra.run.smithi008.stdout: "time": "2023-08-01T19:56:20.420406+0000", 2023-08-01T19:56:20.509 INFO:teuthology.orchestra.run.smithi008.stdout: "duration": 1.2082999999999999e-05 2023-08-01T19:56:20.509 INFO:teuthology.orchestra.run.smithi008.stdout: } 2023-08-01T19:56:20.509 INFO:teuthology.orchestra.run.smithi008.stdout: ] 2023-08-01T19:56:20.509 INFO:teuthology.orchestra.run.smithi008.stdout: } 2023-08-01T19:56:20.509 INFO:teuthology.orchestra.run.smithi008.stdout: }, 2023-08-01T19:56:20.509 INFO:teuthology.orchestra.run.smithi008.stdout: { 2023-08-01T19:56:20.509 INFO:teuthology.orchestra.run.smithi008.stdout: "description": "osd_op(client.4668.0:240280 5.c 5:369cdfb0:::benchmark_data_smithi006_114134_object106619:head [delete] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e70)", 2023-08-01T19:56:20.509 INFO:teuthology.orchestra.run.smithi008.stdout: "initiated_at": "2023-08-01T19:56:20.421592+0000", 2023-08-01T19:56:20.510 INFO:teuthology.orchestra.run.smithi008.stdout: "age": 0.001116463, 2023-08-01T19:56:20.510 INFO:teuthology.orchestra.run.smithi008.stdout: "duration": 0.0016438480000000001, 2023-08-01T19:56:20.510 INFO:teuthology.orchestra.run.smithi008.stdout: "type_data": { 2023-08-01T19:56:20.510 INFO:teuthology.orchestra.run.smithi008.stdout: "flag_point": "started", 2023-08-01T19:56:20.510 INFO:teuthology.orchestra.run.smithi008.stdout: "client_info": { 2023-08-01T19:56:20.510 INFO:teuthology.orchestra.run.smithi008.stdout: "client": "client.4668", 2023-08-01T19:56:20.510 INFO:teuthology.orchestra.run.smithi008.stdout: "client_addr": "172.21.15.6:0/1709472247", 2023-08-01T19:56:20.511 INFO:teuthology.orchestra.run.smithi008.stdout: "tid": 240280 2023-08-01T19:56:20.511 INFO:teuthology.orchestra.run.smithi008.stdout: }, 2023-08-01T19:56:20.511 INFO:teuthology.orchestra.run.smithi008.stdout: "events": [ 2023-08-01T19:56:20.511 INFO:teuthology.orchestra.run.smithi008.stdout: { 2023-08-01T19:56:20.511 INFO:teuthology.orchestra.run.smithi008.stdout: "event": "initiated", 2023-08-01T19:56:20.511 INFO:teuthology.orchestra.run.smithi008.stdout: "time": "2023-08-01T19:56:20.421592+0000", 2023-08-01T19:56:20.511 INFO:teuthology.orchestra.run.smithi008.stdout: "duration": 0 2023-08-01T19:56:20.511 INFO:teuthology.orchestra.run.smithi008.stdout: }, 2023-08-01T19:56:20.512 INFO:teuthology.orchestra.run.smithi008.stdout: { 2023-08-01T19:56:20.512 INFO:teuthology.orchestra.run.smithi008.stdout: "event": "throttled", 2023-08-01T19:56:20.512 INFO:teuthology.orchestra.run.smithi008.stdout: "time": "2023-08-01T19:56:20.421592+0000", 2023-08-01T19:56:20.512 INFO:teuthology.orchestra.run.smithi008.stdout: "duration": 0 2023-08-01T19:56:20.512 INFO:teuthology.orchestra.run.smithi008.stdout: }, 2023-08-01T19:56:20.512 INFO:teuthology.orchestra.run.smithi008.stdout: { 2023-08-01T19:56:20.512 INFO:teuthology.orchestra.run.smithi008.stdout: "event": "header_read", 2023-08-01T19:56:20.512 INFO:teuthology.orchestra.run.smithi008.stdout: "time": "2023-08-01T19:56:20.421591+0000", 2023-08-01T19:56:20.513 INFO:teuthology.orchestra.run.smithi008.stdout: "duration": 4294967295.999999 2023-08-01T19:56:20.513 INFO:teuthology.orchestra.run.smithi008.stdout: }, 2023-08-01T19:56:20.513 INFO:teuthology.orchestra.run.smithi008.stdout: { 2023-08-01T19:56:20.513 INFO:teuthology.orchestra.run.smithi008.stdout: "event": "all_read", 2023-08-01T19:56:20.513 INFO:teuthology.orchestra.run.smithi008.stdout: "time": "2023-08-01T19:56:20.421596+0000", 2023-08-01T19:56:20.513 INFO:teuthology.orchestra.run.smithi008.stdout: "duration": 4.7829999999999998e-06 2023-08-01T19:56:20.513 INFO:teuthology.orchestra.run.smithi008.stdout: }, 2023-08-01T19:56:20.513 INFO:teuthology.orchestra.run.smithi008.stdout: { 2023-08-01T19:56:20.514 INFO:teuthology.orchestra.run.smithi008.stdout: "event": "dispatched", 2023-08-01T19:56:20.514 INFO:teuthology.orchestra.run.smithi008.stdout: "time": "2023-08-01T19:56:20.421605+0000", 2023-08-01T19:56:20.514 INFO:teuthology.orchestra.run.smithi008.stdout: "duration": 9.2310000000000002e-06 2023-08-01T19:56:20.514 INFO:teuthology.orchestra.run.smithi008.stdout: }, 2023-08-01T19:56:20.514 INFO:teuthology.orchestra.run.smithi008.stdout: { 2023-08-01T19:56:20.514 INFO:teuthology.orchestra.run.smithi008.stdout: "event": "queued_for_pg", 2023-08-01T19:56:20.514 INFO:teuthology.orchestra.run.smithi008.stdout: "time": "2023-08-01T19:56:20.421612+0000", 2023-08-01T19:56:20.514 INFO:teuthology.orchestra.run.smithi008.stdout: "duration": 6.4010000000000002e-06 2023-08-01T19:56:20.515 INFO:teuthology.orchestra.run.smithi008.stdout: }, 2023-08-01T19:56:20.515 INFO:teuthology.orchestra.run.smithi008.stdout: { 2023-08-01T19:56:20.515 INFO:teuthology.orchestra.run.smithi008.stdout: "event": "reached_pg", 2023-08-01T19:56:20.515 INFO:teuthology.orchestra.run.smithi008.stdout: "time": "2023-08-01T19:56:20.421655+0000", 2023-08-01T19:56:20.515 INFO:teuthology.orchestra.run.smithi008.stdout: "duration": 4.3074999999999997e-05 2023-08-01T19:56:20.515 INFO:teuthology.orchestra.run.smithi008.stdout: }, 2023-08-01T19:56:20.515 INFO:teuthology.orchestra.run.smithi008.stdout: { 2023-08-01T19:56:20.516 INFO:teuthology.orchestra.run.smithi008.stdout: "event": "started", 2023-08-01T19:56:20.516 INFO:teuthology.orchestra.run.smithi008.stdout: "time": "2023-08-01T19:56:20.421797+0000", 2023-08-01T19:56:20.516 INFO:teuthology.orchestra.run.smithi008.stdout: "duration": 0.000142251 2023-08-01T19:56:20.516 INFO:teuthology.orchestra.run.smithi008.stdout: } 2023-08-01T19:56:20.516 INFO:teuthology.orchestra.run.smithi008.stdout: ] 2023-08-01T19:56:20.516 INFO:teuthology.orchestra.run.smithi008.stdout: } 2023-08-01T19:56:20.516 INFO:teuthology.orchestra.run.smithi008.stdout: }, 2023-08-01T19:56:20.516 INFO:teuthology.orchestra.run.smithi008.stdout: { 2023-08-01T19:56:20.517 INFO:teuthology.orchestra.run.smithi008.stdout: "description": "osd_repop(client.4668.0:240279 5.0 e70/19 5:03434bc6:::benchmark_data_smithi006_114134_object106618:head v 70'15261, mlcod=70'15257)", 2023-08-01T19:56:20.517 INFO:teuthology.orchestra.run.smithi008.stdout: "initiated_at": "2023-08-01T19:56:20.421897+0000", 2023-08-01T19:56:20.517 INFO:teuthology.orchestra.run.smithi008.stdout: "age": 0.00081196299999999996, 2023-08-01T19:56:20.517 INFO:teuthology.orchestra.run.smithi008.stdout: "duration": 0.0013775619999999999, 2023-08-01T19:56:20.517 INFO:teuthology.orchestra.run.smithi008.stdout: "type_data": { 2023-08-01T19:56:20.517 INFO:teuthology.orchestra.run.smithi008.stdout: "flag_point": "started", 2023-08-01T19:56:20.517 INFO:teuthology.orchestra.run.smithi008.stdout: "events": [ 2023-08-01T19:56:20.518 INFO:teuthology.orchestra.run.smithi008.stdout: { 2023-08-01T19:56:20.518 INFO:teuthology.orchestra.run.smithi008.stdout: "event": "initiated", 2023-08-01T19:56:20.518 INFO:teuthology.orchestra.run.smithi008.stdout: "time": "2023-08-01T19:56:20.421897+0000", 2023-08-01T19:56:20.518 INFO:teuthology.orchestra.run.smithi008.stdout: "duration": 0 2023-08-01T19:56:20.518 INFO:teuthology.orchestra.run.smithi008.stdout: }, 2023-08-01T19:56:20.518 INFO:teuthology.orchestra.run.smithi008.stdout: { 2023-08-01T19:56:20.518 INFO:teuthology.orchestra.run.smithi008.stdout: "event": "throttled", 2023-08-01T19:56:20.518 INFO:teuthology.orchestra.run.smithi008.stdout: "time": "2023-08-01T19:56:20.421897+0000", 2023-08-01T19:56:20.519 INFO:teuthology.orchestra.run.smithi008.stdout: "duration": 0 2023-08-01T19:56:20.519 INFO:teuthology.orchestra.run.smithi008.stdout: }, 2023-08-01T19:56:20.519 INFO:teuthology.orchestra.run.smithi008.stdout: { 2023-08-01T19:56:20.519 INFO:teuthology.orchestra.run.smithi008.stdout: "event": "header_read", 2023-08-01T19:56:20.519 INFO:teuthology.orchestra.run.smithi008.stdout: "time": "2023-08-01T19:56:20.421896+0000", 2023-08-01T19:56:20.519 INFO:teuthology.orchestra.run.smithi008.stdout: "duration": 4294967295.999999 2023-08-01T19:56:20.519 INFO:teuthology.orchestra.run.smithi008.stdout: }, 2023-08-01T19:56:20.519 INFO:teuthology.orchestra.run.smithi008.stdout: { 2023-08-01T19:56:20.520 INFO:teuthology.orchestra.run.smithi008.stdout: "event": "all_read", 2023-08-01T19:56:20.520 INFO:teuthology.orchestra.run.smithi008.stdout: "time": "2023-08-01T19:56:20.421902+0000", 2023-08-01T19:56:20.520 INFO:teuthology.orchestra.run.smithi008.stdout: "duration": 6.0769999999999996e-06 2023-08-01T19:56:20.520 INFO:teuthology.orchestra.run.smithi008.stdout: }, 2023-08-01T19:56:20.520 INFO:teuthology.orchestra.run.smithi008.stdout: { 2023-08-01T19:56:20.520 INFO:teuthology.orchestra.run.smithi008.stdout: "event": "dispatched", 2023-08-01T19:56:20.520 INFO:teuthology.orchestra.run.smithi008.stdout: "time": "2023-08-01T19:56:20.421911+0000", 2023-08-01T19:56:20.520 INFO:teuthology.orchestra.run.smithi008.stdout: "duration": 8.9549999999999998e-06 2023-08-01T19:56:20.521 INFO:teuthology.orchestra.run.smithi008.stdout: }, 2023-08-01T19:56:20.521 INFO:teuthology.orchestra.run.smithi008.stdout: { 2023-08-01T19:56:20.521 INFO:teuthology.orchestra.run.smithi008.stdout: "event": "queued_for_pg", 2023-08-01T19:56:20.521 INFO:teuthology.orchestra.run.smithi008.stdout: "time": "2023-08-01T19:56:20.421916+0000", 2023-08-01T19:56:20.521 INFO:teuthology.orchestra.run.smithi008.stdout: "duration": 5.4569999999999996e-06 2023-08-01T19:56:20.521 INFO:teuthology.orchestra.run.smithi008.stdout: }, 2023-08-01T19:56:20.521 INFO:teuthology.orchestra.run.smithi008.stdout: { 2023-08-01T19:56:20.521 INFO:teuthology.orchestra.run.smithi008.stdout: "event": "reached_pg", 2023-08-01T19:56:20.522 INFO:teuthology.orchestra.run.smithi008.stdout: "time": "2023-08-01T19:56:20.422048+0000", 2023-08-01T19:56:20.522 INFO:teuthology.orchestra.run.smithi008.stdout: "duration": 0.000131321 2023-08-01T19:56:20.522 INFO:teuthology.orchestra.run.smithi008.stdout: }, 2023-08-01T19:56:20.522 INFO:teuthology.orchestra.run.smithi008.stdout: { 2023-08-01T19:56:20.522 INFO:teuthology.orchestra.run.smithi008.stdout: "event": "started", 2023-08-01T19:56:20.522 INFO:teuthology.orchestra.run.smithi008.stdout: "time": "2023-08-01T19:56:20.422061+0000", 2023-08-01T19:56:20.522 INFO:teuthology.orchestra.run.smithi008.stdout: "duration": 1.3730000000000001e-05 2023-08-01T19:56:20.522 INFO:teuthology.orchestra.run.smithi008.stdout: } 2023-08-01T19:56:20.523 INFO:teuthology.orchestra.run.smithi008.stdout: ] 2023-08-01T19:56:20.523 INFO:teuthology.orchestra.run.smithi008.stdout: } 2023-08-01T19:56:20.523 INFO:teuthology.orchestra.run.smithi008.stdout: } 2023-08-01T19:56:20.523 INFO:teuthology.orchestra.run.smithi008.stdout: ], 2023-08-01T19:56:20.523 INFO:teuthology.orchestra.run.smithi008.stdout: "num_ops": 13 2023-08-01T19:56:20.523 INFO:teuthology.orchestra.run.smithi008.stdout:} 2023-08-01T19:56:20.524 INFO:tasks.thrashosds.thrasher:in_osds: [0, 1, 2] out_osds: [] dead_osds: [1] live_osds: [0, 2] 2023-08-01T19:56:20.524 INFO:tasks.thrashosds.thrasher:choose_action: min_in 4 min_out 0 min_live 2 min_dead 0 chance_down 1.00 2023-08-01T19:56:20.524 INFO:tasks.thrashosds.thrasher:primary_affinity 2023-08-01T19:56:20.524 INFO:tasks.thrashosds.thrasher:Setting osd 2 primary_affinity to 0.000000 2023-08-01T19:56:20.525 DEBUG:teuthology.orchestra.run.smithi006:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 120 ceph --cluster ceph osd primary-affinity 2 0 2023-08-01T19:56:20.526 DEBUG:teuthology.orchestra.run.smithi008:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 30 ceph --cluster ceph --admin-daemon /var/run/ceph/ceph-osd.0.asok dump_blocked_ops 2023-08-01T19:56:20.527 INFO:tasks.ceph.osd.0.smithi008.stderr:2023-08-01T19:56:20.523+0000 7f16a58f4700 -1 received signal: Hangup from /usr/bin/python3 /bin/daemon-helper kill ceph-osd -f --cluster ceph -i 0 (PID: 111179) UID: 0 2023-08-01T19:56:20.625 INFO:tasks.ceph.osd.2.smithi155.stderr:2023-08-01T19:56:20.623+0000 7faa5c6ac700 -1 received signal: Hangup from /usr/bin/python3 /bin/daemon-helper kill ceph-osd -f --cluster ceph -i 2 (PID: 111337) UID: 0 2023-08-01T19:56:20.726 INFO:tasks.ceph.osd.0.smithi008.stderr:2023-08-01T19:56:20.725+0000 7f16a58f4700 -1 received signal: Hangup from /usr/bin/python3 /bin/daemon-helper kill ceph-osd -f --cluster ceph -i 0 (PID: 111179) UID: 0 2023-08-01T19:56:20.756 INFO:teuthology.orchestra.run.smithi008.stdout:{ 2023-08-01T19:56:20.756 INFO:teuthology.orchestra.run.smithi008.stdout: "ops": [], 2023-08-01T19:56:20.756 INFO:teuthology.orchestra.run.smithi008.stdout: "complaint_time": 30, 2023-08-01T19:56:20.756 INFO:teuthology.orchestra.run.smithi008.stdout: "num_blocked_ops": 0 2023-08-01T19:56:20.756 INFO:teuthology.orchestra.run.smithi008.stdout:} 2023-08-01T19:56:20.763 INFO:teuthology.orchestra.run.smithi006.stderr:noscrub is set 2023-08-01T19:56:20.770 DEBUG:teuthology.orchestra.run.smithi008:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 30 ceph --cluster ceph --admin-daemon /var/run/ceph/ceph-osd.0.asok dump_historic_ops 2023-08-01T19:56:20.827 INFO:tasks.ceph.osd.2.smithi155.stderr:2023-08-01T19:56:20.825+0000 7faa5c6ac700 -1 received signal: Hangup from /usr/bin/python3 /bin/daemon-helper kill ceph-osd -f --cluster ceph -i 2 (PID: 111337) UID: 0 2023-08-01T19:56:20.928 INFO:tasks.ceph.osd.2.smithi155.stderr:2023-08-01T19:56:20.926+0000 7faa5c6ac700 -1 received signal: Hangup from /usr/bin/python3 /bin/daemon-helper kill ceph-osd -f --cluster ceph -i 2 (PID: 111337) UID: 0 2023-08-01T19:56:21.002 INFO:teuthology.orchestra.run.smithi008.stdout:{ 2023-08-01T19:56:21.002 INFO:teuthology.orchestra.run.smithi008.stdout: "size": 20, 2023-08-01T19:56:21.003 INFO:teuthology.orchestra.run.smithi008.stdout: "duration": 600, 2023-08-01T19:56:21.003 INFO:teuthology.orchestra.run.smithi008.stdout: "ops": [ 2023-08-01T19:56:21.003 INFO:teuthology.orchestra.run.smithi008.stdout: { 2023-08-01T19:56:21.003 INFO:teuthology.orchestra.run.smithi008.stdout: "description": "osd_op(client.4668.0:100240 5.a 5:5313c5b9:::benchmark_data_smithi006_114134_object100239:head [set-alloc-hint object_size 65536 write_size 65536,write 0~65536] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e37)", 2023-08-01T19:56:21.003 INFO:teuthology.orchestra.run.smithi008.stdout: "initiated_at": "2023-08-01T19:55:05.148399+0000", 2023-08-01T19:56:21.003 INFO:teuthology.orchestra.run.smithi008.stdout: "age": 75.850214037000001, 2023-08-01T19:56:21.003 INFO:teuthology.orchestra.run.smithi008.stdout: "duration": 0.077278904999999995, 2023-08-01T19:56:21.004 INFO:teuthology.orchestra.run.smithi008.stdout: "type_data": { 2023-08-01T19:56:21.004 INFO:teuthology.orchestra.run.smithi008.stdout: "flag_point": "commit sent; apply or cleanup", 2023-08-01T19:56:21.004 INFO:teuthology.orchestra.run.smithi008.stdout: "client_info": { 2023-08-01T19:56:21.004 INFO:teuthology.orchestra.run.smithi008.stdout: "client": "client.4668", 2023-08-01T19:56:21.004 INFO:teuthology.orchestra.run.smithi008.stdout: "client_addr": "172.21.15.6:0/1709472247", 2023-08-01T19:56:21.004 INFO:teuthology.orchestra.run.smithi008.stdout: "tid": 100240 2023-08-01T19:56:21.004 INFO:teuthology.orchestra.run.smithi008.stdout: }, 2023-08-01T19:56:21.005 INFO:teuthology.orchestra.run.smithi008.stdout: "events": [ 2023-08-01T19:56:21.005 INFO:teuthology.orchestra.run.smithi008.stdout: { 2023-08-01T19:56:21.005 INFO:teuthology.orchestra.run.smithi008.stdout: "event": "initiated", 2023-08-01T19:56:21.005 INFO:teuthology.orchestra.run.smithi008.stdout: "time": "2023-08-01T19:55:05.148399+0000", 2023-08-01T19:56:21.005 INFO:teuthology.orchestra.run.smithi008.stdout: "duration": 0 2023-08-01T19:56:21.005 INFO:teuthology.orchestra.run.smithi008.stdout: }, 2023-08-01T19:56:21.005 INFO:teuthology.orchestra.run.smithi008.stdout: { 2023-08-01T19:56:21.006 INFO:teuthology.orchestra.run.smithi008.stdout: "event": "throttled", 2023-08-01T19:56:21.006 INFO:teuthology.orchestra.run.smithi008.stdout: "time": "2023-08-01T19:55:05.148399+0000", 2023-08-01T19:56:21.006 INFO:teuthology.orchestra.run.smithi008.stdout: "duration": 0 2023-08-01T19:56:21.006 INFO:teuthology.orchestra.run.smithi008.stdout: }, 2023-08-01T19:56:21.006 INFO:teuthology.orchestra.run.smithi008.stdout: { 2023-08-01T19:56:21.006 INFO:teuthology.orchestra.run.smithi008.stdout: "event": "header_read", 2023-08-01T19:56:21.006 INFO:teuthology.orchestra.run.smithi008.stdout: "time": "2023-08-01T19:55:05.148398+0000", 2023-08-01T19:56:21.007 INFO:teuthology.orchestra.run.smithi008.stdout: "duration": 4294967295.999999 2023-08-01T19:56:21.007 INFO:teuthology.orchestra.run.smithi008.stdout: }, 2023-08-01T19:56:21.007 INFO:teuthology.orchestra.run.smithi008.stdout: { 2023-08-01T19:56:21.007 INFO:teuthology.orchestra.run.smithi008.stdout: "event": "all_read", 2023-08-01T19:56:21.007 INFO:teuthology.orchestra.run.smithi008.stdout: "time": "2023-08-01T19:55:05.148492+0000", 2023-08-01T19:56:21.007 INFO:teuthology.orchestra.run.smithi008.stdout: "duration": 9.3892000000000002e-05 2023-08-01T19:56:21.007 INFO:teuthology.orchestra.run.smithi008.stdout: }, 2023-08-01T19:56:21.007 INFO:teuthology.orchestra.run.smithi008.stdout: { 2023-08-01T19:56:21.008 INFO:teuthology.orchestra.run.smithi008.stdout: "event": "dispatched", 2023-08-01T19:56:21.008 INFO:teuthology.orchestra.run.smithi008.stdout: "time": "2023-08-01T19:55:05.148503+0000", 2023-08-01T19:56:21.008 INFO:teuthology.orchestra.run.smithi008.stdout: "duration": 1.0951000000000001e-05 2023-08-01T19:56:21.008 INFO:teuthology.orchestra.run.smithi008.stdout: }, 2023-08-01T19:56:21.008 INFO:teuthology.orchestra.run.smithi008.stdout: { 2023-08-01T19:56:21.008 INFO:teuthology.orchestra.run.smithi008.stdout: "event": "queued_for_pg", 2023-08-01T19:56:21.008 INFO:teuthology.orchestra.run.smithi008.stdout: "time": "2023-08-01T19:55:05.148508+0000", 2023-08-01T19:56:21.009 INFO:teuthology.orchestra.run.smithi008.stdout: "duration": 5.0080000000000002e-06 2023-08-01T19:56:21.009 INFO:teuthology.orchestra.run.smithi008.stdout: }, 2023-08-01T19:56:21.009 INFO:teuthology.orchestra.run.smithi008.stdout: { 2023-08-01T19:56:21.009 INFO:teuthology.orchestra.run.smithi008.stdout: "event": "reached_pg", 2023-08-01T19:56:21.009 INFO:teuthology.orchestra.run.smithi008.stdout: "time": "2023-08-01T19:55:05.148548+0000", 2023-08-01T19:56:21.009 INFO:teuthology.orchestra.run.smithi008.stdout: "duration": 4.0358999999999998e-05 2023-08-01T19:56:21.010 INFO:teuthology.orchestra.run.smithi008.stdout: }, 2023-08-01T19:56:21.010 INFO:teuthology.orchestra.run.smithi008.stdout: { 2023-08-01T19:56:21.010 INFO:teuthology.orchestra.run.smithi008.stdout: "event": "started", 2023-08-01T19:56:21.010 INFO:teuthology.orchestra.run.smithi008.stdout: "time": "2023-08-01T19:55:05.148666+0000", 2023-08-01T19:56:21.010 INFO:teuthology.orchestra.run.smithi008.stdout: "duration": 0.000117621 2023-08-01T19:56:21.010 INFO:teuthology.orchestra.run.smithi008.stdout: }, 2023-08-01T19:56:21.010 INFO:teuthology.orchestra.run.smithi008.stdout: { 2023-08-01T19:56:21.011 INFO:teuthology.orchestra.run.smithi008.stdout: "event": "waiting for subops from 2", 2023-08-01T19:56:21.011 INFO:teuthology.orchestra.run.smithi008.stdout: "time": "2023-08-01T19:55:05.148805+0000", 2023-08-01T19:56:21.011 INFO:teuthology.orchestra.run.smithi008.stdout: "duration": 0.000139176 2023-08-01T19:56:21.011 INFO:teuthology.orchestra.run.smithi008.stdout: }, 2023-08-01T19:56:21.011 INFO:teuthology.orchestra.run.smithi008.stdout: { 2023-08-01T19:56:21.011 INFO:teuthology.orchestra.run.smithi008.stdout: "event": "op_commit", 2023-08-01T19:56:21.011 INFO:teuthology.orchestra.run.smithi008.stdout: "time": "2023-08-01T19:55:05.156143+0000", 2023-08-01T19:56:21.011 INFO:teuthology.orchestra.run.smithi008.stdout: "duration": 0.007338041 2023-08-01T19:56:21.012 INFO:teuthology.orchestra.run.smithi008.stdout: }, 2023-08-01T19:56:21.012 INFO:teuthology.orchestra.run.smithi008.stdout: { 2023-08-01T19:56:21.012 INFO:teuthology.orchestra.run.smithi008.stdout: "event": "sub_op_commit_rec", 2023-08-01T19:56:21.012 INFO:teuthology.orchestra.run.smithi008.stdout: "time": "2023-08-01T19:55:05.225581+0000", 2023-08-01T19:56:21.012 INFO:teuthology.orchestra.run.smithi008.stdout: "duration": 0.069438402999999996 2023-08-01T19:56:21.012 INFO:teuthology.orchestra.run.smithi008.stdout: }, 2023-08-01T19:56:21.012 INFO:teuthology.orchestra.run.smithi008.stdout: { 2023-08-01T19:56:21.013 INFO:teuthology.orchestra.run.smithi008.stdout: "event": "commit_sent", 2023-08-01T19:56:21.013 INFO:teuthology.orchestra.run.smithi008.stdout: "time": "2023-08-01T19:55:05.225632+0000", 2023-08-01T19:56:21.013 INFO:teuthology.orchestra.run.smithi008.stdout: "duration": 5.0382e-05 2023-08-01T19:56:21.013 INFO:teuthology.orchestra.run.smithi008.stdout: }, 2023-08-01T19:56:21.013 INFO:teuthology.orchestra.run.smithi008.stdout: { 2023-08-01T19:56:21.013 INFO:teuthology.orchestra.run.smithi008.stdout: "event": "done", 2023-08-01T19:56:21.013 INFO:teuthology.orchestra.run.smithi008.stdout: "time": "2023-08-01T19:55:05.225677+0000", 2023-08-01T19:56:21.013 INFO:teuthology.orchestra.run.smithi008.stdout: "duration": 4.5893000000000003e-05 2023-08-01T19:56:21.014 INFO:teuthology.orchestra.run.smithi008.stdout: } 2023-08-01T19:56:21.014 INFO:teuthology.orchestra.run.smithi008.stdout: ] 2023-08-01T19:56:21.014 INFO:teuthology.orchestra.run.smithi008.stdout: } 2023-08-01T19:56:21.014 INFO:teuthology.orchestra.run.smithi008.stdout: }, 2023-08-01T19:56:21.014 INFO:teuthology.orchestra.run.smithi008.stdout: { 2023-08-01T19:56:21.014 INFO:teuthology.orchestra.run.smithi008.stdout: "description": "osd_op(client.4668.0:100243 5.a 5:5e8193b6:::benchmark_data_smithi006_114134_object100242:head [set-alloc-hint object_size 65536 write_size 65536,write 0~65536] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e37)", 2023-08-01T19:56:21.014 INFO:teuthology.orchestra.run.smithi008.stdout: "initiated_at": "2023-08-01T19:55:05.150737+0000", 2023-08-01T19:56:21.015 INFO:teuthology.orchestra.run.smithi008.stdout: "age": 75.847875582, 2023-08-01T19:56:21.015 INFO:teuthology.orchestra.run.smithi008.stdout: "duration": 0.075019885999999994, 2023-08-01T19:56:21.015 INFO:teuthology.orchestra.run.smithi008.stdout: "type_data": { 2023-08-01T19:56:21.015 INFO:teuthology.orchestra.run.smithi008.stdout: "flag_point": "commit sent; apply or cleanup", 2023-08-01T19:56:21.015 INFO:teuthology.orchestra.run.smithi008.stdout: "client_info": { 2023-08-01T19:56:21.015 INFO:teuthology.orchestra.run.smithi008.stdout: "client": "client.4668", 2023-08-01T19:56:21.015 INFO:teuthology.orchestra.run.smithi008.stdout: "client_addr": "172.21.15.6:0/1709472247", 2023-08-01T19:56:21.015 INFO:teuthology.orchestra.run.smithi008.stdout: "tid": 100243 2023-08-01T19:56:21.016 INFO:teuthology.orchestra.run.smithi008.stdout: }, 2023-08-01T19:56:21.016 INFO:teuthology.orchestra.run.smithi008.stdout: "events": [ 2023-08-01T19:56:21.016 INFO:teuthology.orchestra.run.smithi008.stdout: { 2023-08-01T19:56:21.016 INFO:teuthology.orchestra.run.smithi008.stdout: "event": "initiated", 2023-08-01T19:56:21.016 INFO:teuthology.orchestra.run.smithi008.stdout: "time": "2023-08-01T19:55:05.150737+0000", 2023-08-01T19:56:21.016 INFO:teuthology.orchestra.run.smithi008.stdout: "duration": 0 2023-08-01T19:56:21.016 INFO:teuthology.orchestra.run.smithi008.stdout: }, 2023-08-01T19:56:21.017 INFO:teuthology.orchestra.run.smithi008.stdout: { 2023-08-01T19:56:21.017 INFO:teuthology.orchestra.run.smithi008.stdout: "event": "throttled", 2023-08-01T19:56:21.017 INFO:teuthology.orchestra.run.smithi008.stdout: "time": "2023-08-01T19:55:05.150737+0000", 2023-08-01T19:56:21.017 INFO:teuthology.orchestra.run.smithi008.stdout: "duration": 0 2023-08-01T19:56:21.017 INFO:teuthology.orchestra.run.smithi008.stdout: }, 2023-08-01T19:56:21.017 INFO:teuthology.orchestra.run.smithi008.stdout: { 2023-08-01T19:56:21.017 INFO:teuthology.orchestra.run.smithi008.stdout: "event": "header_read", 2023-08-01T19:56:21.017 INFO:teuthology.orchestra.run.smithi008.stdout: "time": "2023-08-01T19:55:05.150736+0000", 2023-08-01T19:56:21.018 INFO:teuthology.orchestra.run.smithi008.stdout: "duration": 4294967295.999999 2023-08-01T19:56:21.018 INFO:teuthology.orchestra.run.smithi008.stdout: }, 2023-08-01T19:56:21.018 INFO:teuthology.orchestra.run.smithi008.stdout: { 2023-08-01T19:56:21.018 INFO:teuthology.orchestra.run.smithi008.stdout: "event": "all_read", 2023-08-01T19:56:21.018 INFO:teuthology.orchestra.run.smithi008.stdout: "time": "2023-08-01T19:55:05.150780+0000", 2023-08-01T19:56:21.018 INFO:teuthology.orchestra.run.smithi008.stdout: "duration": 4.3578999999999997e-05 2023-08-01T19:56:21.018 INFO:teuthology.orchestra.run.smithi008.stdout: }, 2023-08-01T19:56:21.019 INFO:teuthology.orchestra.run.smithi008.stdout: { 2023-08-01T19:56:21.019 INFO:teuthology.orchestra.run.smithi008.stdout: "event": "dispatched", 2023-08-01T19:56:21.019 INFO:teuthology.orchestra.run.smithi008.stdout: "time": "2023-08-01T19:55:05.150791+0000", 2023-08-01T19:56:21.019 INFO:teuthology.orchestra.run.smithi008.stdout: "duration": 1.0963e-05 2023-08-01T19:56:21.019 INFO:teuthology.orchestra.run.smithi008.stdout: }, 2023-08-01T19:56:21.019 INFO:teuthology.orchestra.run.smithi008.stdout: { 2023-08-01T19:56:21.019 INFO:teuthology.orchestra.run.smithi008.stdout: "event": "queued_for_pg", 2023-08-01T19:56:21.019 INFO:teuthology.orchestra.run.smithi008.stdout: "time": "2023-08-01T19:55:05.150797+0000", 2023-08-01T19:56:21.020 INFO:teuthology.orchestra.run.smithi008.stdout: "duration": 5.9780000000000002e-06 2023-08-01T19:56:21.020 INFO:teuthology.orchestra.run.smithi008.stdout: }, 2023-08-01T19:56:21.020 INFO:teuthology.orchestra.run.smithi008.stdout: { 2023-08-01T19:56:21.020 INFO:teuthology.orchestra.run.smithi008.stdout: "event": "reached_pg", 2023-08-01T19:56:21.020 INFO:teuthology.orchestra.run.smithi008.stdout: "time": "2023-08-01T19:55:05.150833+0000", 2023-08-01T19:56:21.020 INFO:teuthology.orchestra.run.smithi008.stdout: "duration": 3.6000000000000001e-05 2023-08-01T19:56:21.020 INFO:teuthology.orchestra.run.smithi008.stdout: }, 2023-08-01T19:56:21.021 INFO:teuthology.orchestra.run.smithi008.stdout: { 2023-08-01T19:56:21.021 INFO:teuthology.orchestra.run.smithi008.stdout: "event": "started", 2023-08-01T19:56:21.021 INFO:teuthology.orchestra.run.smithi008.stdout: "time": "2023-08-01T19:55:05.150951+0000", 2023-08-01T19:56:21.021 INFO:teuthology.orchestra.run.smithi008.stdout: "duration": 0.00011827799999999999 2023-08-01T19:56:21.021 INFO:teuthology.orchestra.run.smithi008.stdout: }, 2023-08-01T19:56:21.021 INFO:teuthology.orchestra.run.smithi008.stdout: { 2023-08-01T19:56:21.021 INFO:teuthology.orchestra.run.smithi008.stdout: "event": "waiting for subops from 2", 2023-08-01T19:56:21.022 INFO:teuthology.orchestra.run.smithi008.stdout: "time": "2023-08-01T19:55:05.151111+0000", 2023-08-01T19:56:21.022 INFO:teuthology.orchestra.run.smithi008.stdout: "duration": 0.00015961299999999999 2023-08-01T19:56:21.022 INFO:teuthology.orchestra.run.smithi008.stdout: }, 2023-08-01T19:56:21.022 INFO:teuthology.orchestra.run.smithi008.stdout: { 2023-08-01T19:56:21.022 INFO:teuthology.orchestra.run.smithi008.stdout: "event": "op_commit", 2023-08-01T19:56:21.022 INFO:teuthology.orchestra.run.smithi008.stdout: "time": "2023-08-01T19:55:05.156247+0000", 2023-08-01T19:56:21.022 INFO:teuthology.orchestra.run.smithi008.stdout: "duration": 0.005136524 2023-08-01T19:56:21.022 INFO:teuthology.orchestra.run.smithi008.stdout: }, 2023-08-01T19:56:21.023 INFO:teuthology.orchestra.run.smithi008.stdout: { 2023-08-01T19:56:21.023 INFO:teuthology.orchestra.run.smithi008.stdout: "event": "sub_op_commit_rec", 2023-08-01T19:56:21.023 INFO:teuthology.orchestra.run.smithi008.stdout: "time": "2023-08-01T19:55:05.225705+0000", 2023-08-01T19:56:21.023 INFO:teuthology.orchestra.run.smithi008.stdout: "duration": 0.069458377000000002 2023-08-01T19:56:21.023 INFO:teuthology.orchestra.run.smithi008.stdout: }, 2023-08-01T19:56:21.023 INFO:teuthology.orchestra.run.smithi008.stdout: { 2023-08-01T19:56:21.023 INFO:teuthology.orchestra.run.smithi008.stdout: "event": "commit_sent", 2023-08-01T19:56:21.023 INFO:teuthology.orchestra.run.smithi008.stdout: "time": "2023-08-01T19:55:05.225736+0000", 2023-08-01T19:56:21.024 INFO:teuthology.orchestra.run.smithi008.stdout: "duration": 3.0388000000000001e-05 2023-08-01T19:56:21.024 INFO:teuthology.orchestra.run.smithi008.stdout: }, 2023-08-01T19:56:21.024 INFO:teuthology.orchestra.run.smithi008.stdout: { 2023-08-01T19:56:21.024 INFO:teuthology.orchestra.run.smithi008.stdout: "event": "done", 2023-08-01T19:56:21.024 INFO:teuthology.orchestra.run.smithi008.stdout: "time": "2023-08-01T19:55:05.225757+0000", 2023-08-01T19:56:21.024 INFO:teuthology.orchestra.run.smithi008.stdout: "duration": 2.1090999999999998e-05 2023-08-01T19:56:21.024 INFO:teuthology.orchestra.run.smithi008.stdout: } 2023-08-01T19:56:21.024 INFO:teuthology.orchestra.run.smithi008.stdout: ] 2023-08-01T19:56:21.025 INFO:teuthology.orchestra.run.smithi008.stdout: } 2023-08-01T19:56:21.025 INFO:teuthology.orchestra.run.smithi008.stdout: }, 2023-08-01T19:56:21.025 INFO:teuthology.orchestra.run.smithi008.stdout: { 2023-08-01T19:56:21.025 INFO:teuthology.orchestra.run.smithi008.stdout: "description": "osd_op(client.4668.0:100933 5.5 5:af92e9f2:::benchmark_data_smithi006_114134_object100932:head [set-alloc-hint object_size 65536 write_size 65536,write 0~65536] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e37)", 2023-08-01T19:56:21.025 INFO:teuthology.orchestra.run.smithi008.stdout: "initiated_at": "2023-08-01T19:55:05.566634+0000", 2023-08-01T19:56:21.025 INFO:teuthology.orchestra.run.smithi008.stdout: "age": 75.431978710999999, 2023-08-01T19:56:21.025 INFO:teuthology.orchestra.run.smithi008.stdout: "duration": 0.065909364999999998, 2023-08-01T19:56:21.026 INFO:teuthology.orchestra.run.smithi008.stdout: "type_data": { 2023-08-01T19:56:21.026 INFO:teuthology.orchestra.run.smithi008.stdout: "flag_point": "commit sent; apply or cleanup", 2023-08-01T19:56:21.026 INFO:teuthology.orchestra.run.smithi008.stdout: "client_info": { 2023-08-01T19:56:21.026 INFO:teuthology.orchestra.run.smithi008.stdout: "client": "client.4668", 2023-08-01T19:56:21.026 INFO:teuthology.orchestra.run.smithi008.stdout: "client_addr": "172.21.15.6:0/1709472247", 2023-08-01T19:56:21.026 INFO:teuthology.orchestra.run.smithi008.stdout: "tid": 100933 2023-08-01T19:56:21.026 INFO:teuthology.orchestra.run.smithi008.stdout: }, 2023-08-01T19:56:21.026 INFO:teuthology.orchestra.run.smithi008.stdout: "events": [ 2023-08-01T19:56:21.027 INFO:teuthology.orchestra.run.smithi008.stdout: { 2023-08-01T19:56:21.027 INFO:teuthology.orchestra.run.smithi008.stdout: "event": "initiated", 2023-08-01T19:56:21.027 INFO:teuthology.orchestra.run.smithi008.stdout: "time": "2023-08-01T19:55:05.566634+0000", 2023-08-01T19:56:21.027 INFO:teuthology.orchestra.run.smithi008.stdout: "duration": 0 2023-08-01T19:56:21.027 INFO:teuthology.orchestra.run.smithi008.stdout: }, 2023-08-01T19:56:21.027 INFO:teuthology.orchestra.run.smithi008.stdout: { 2023-08-01T19:56:21.028 INFO:teuthology.orchestra.run.smithi008.stdout: "event": "throttled", 2023-08-01T19:56:21.028 INFO:teuthology.orchestra.run.smithi008.stdout: "time": "2023-08-01T19:55:05.566634+0000", 2023-08-01T19:56:21.028 INFO:teuthology.orchestra.run.smithi008.stdout: "duration": 0 2023-08-01T19:56:21.028 INFO:teuthology.orchestra.run.smithi008.stdout: }, 2023-08-01T19:56:21.028 INFO:teuthology.orchestra.run.smithi008.stdout: { 2023-08-01T19:56:21.028 INFO:teuthology.orchestra.run.smithi008.stdout: "event": "header_read", 2023-08-01T19:56:21.028 INFO:teuthology.orchestra.run.smithi008.stdout: "time": "2023-08-01T19:55:05.566630+0000", 2023-08-01T19:56:21.029 INFO:teuthology.orchestra.run.smithi008.stdout: "duration": 4294967295.9999962 2023-08-01T19:56:21.029 INFO:teuthology.orchestra.run.smithi008.stdout: }, 2023-08-01T19:56:21.029 INFO:teuthology.orchestra.run.smithi008.stdout: { 2023-08-01T19:56:21.029 INFO:teuthology.orchestra.run.smithi008.stdout: "event": "all_read", 2023-08-01T19:56:21.029 INFO:teuthology.orchestra.run.smithi008.stdout: "time": "2023-08-01T19:55:05.566736+0000", 2023-08-01T19:56:21.029 INFO:teuthology.orchestra.run.smithi008.stdout: "duration": 0.000105752 2023-08-01T19:56:21.029 INFO:teuthology.orchestra.run.smithi008.stdout: }, 2023-08-01T19:56:21.029 INFO:teuthology.orchestra.run.smithi008.stdout: { 2023-08-01T19:56:21.030 INFO:teuthology.orchestra.run.smithi008.stdout: "event": "dispatched", 2023-08-01T19:56:21.030 INFO:teuthology.orchestra.run.smithi008.stdout: "time": "2023-08-01T19:55:05.566742+0000", 2023-08-01T19:56:21.030 INFO:teuthology.orchestra.run.smithi008.stdout: "duration": 5.8209999999999998e-06 2023-08-01T19:56:21.030 INFO:teuthology.orchestra.run.smithi008.stdout: }, 2023-08-01T19:56:21.030 INFO:teuthology.orchestra.run.smithi008.stdout: { 2023-08-01T19:56:21.030 INFO:teuthology.orchestra.run.smithi008.stdout: "event": "queued_for_pg", 2023-08-01T19:56:21.030 INFO:teuthology.orchestra.run.smithi008.stdout: "time": "2023-08-01T19:55:05.566745+0000", 2023-08-01T19:56:21.031 INFO:teuthology.orchestra.run.smithi008.stdout: "duration": 3.337e-06 2023-08-01T19:56:21.031 INFO:teuthology.orchestra.run.smithi008.stdout: }, 2023-08-01T19:56:21.031 INFO:teuthology.orchestra.run.smithi008.stdout: { 2023-08-01T19:56:21.031 INFO:teuthology.orchestra.run.smithi008.stdout: "event": "reached_pg", 2023-08-01T19:56:21.031 INFO:teuthology.orchestra.run.smithi008.stdout: "time": "2023-08-01T19:55:05.568175+0000", 2023-08-01T19:56:21.031 INFO:teuthology.orchestra.run.smithi008.stdout: "duration": 0.001429647 2023-08-01T19:56:21.031 INFO:teuthology.orchestra.run.smithi008.stdout: }, 2023-08-01T19:56:21.031 INFO:teuthology.orchestra.run.smithi008.stdout: { 2023-08-01T19:56:21.032 INFO:teuthology.orchestra.run.smithi008.stdout: "event": "started", 2023-08-01T19:56:21.032 INFO:teuthology.orchestra.run.smithi008.stdout: "time": "2023-08-01T19:55:05.568288+0000", 2023-08-01T19:56:21.032 INFO:teuthology.orchestra.run.smithi008.stdout: "duration": 0.000113353 2023-08-01T19:56:21.032 INFO:teuthology.orchestra.run.smithi008.stdout: }, 2023-08-01T19:56:21.032 INFO:teuthology.orchestra.run.smithi008.stdout: { 2023-08-01T19:56:21.032 INFO:teuthology.orchestra.run.smithi008.stdout: "event": "waiting for subops from 1", 2023-08-01T19:56:21.032 INFO:teuthology.orchestra.run.smithi008.stdout: "time": "2023-08-01T19:55:05.568425+0000", 2023-08-01T19:56:21.032 INFO:teuthology.orchestra.run.smithi008.stdout: "duration": 0.000137346 2023-08-01T19:56:21.033 INFO:teuthology.orchestra.run.smithi008.stdout: }, 2023-08-01T19:56:21.033 INFO:teuthology.orchestra.run.smithi008.stdout: { 2023-08-01T19:56:21.033 INFO:teuthology.orchestra.run.smithi008.stdout: "event": "sub_op_commit_rec", 2023-08-01T19:56:21.033 INFO:teuthology.orchestra.run.smithi008.stdout: "time": "2023-08-01T19:55:05.629320+0000", 2023-08-01T19:56:21.033 INFO:teuthology.orchestra.run.smithi008.stdout: "duration": 0.060894491000000002 2023-08-01T19:56:21.033 INFO:teuthology.orchestra.run.smithi008.stdout: }, 2023-08-01T19:56:21.033 INFO:teuthology.orchestra.run.smithi008.stdout: { 2023-08-01T19:56:21.033 INFO:teuthology.orchestra.run.smithi008.stdout: "event": "op_commit", 2023-08-01T19:56:21.034 INFO:teuthology.orchestra.run.smithi008.stdout: "time": "2023-08-01T19:55:05.632452+0000", 2023-08-01T19:56:21.034 INFO:teuthology.orchestra.run.smithi008.stdout: "duration": 0.003131909 2023-08-01T19:56:21.034 INFO:teuthology.orchestra.run.smithi008.stdout: }, 2023-08-01T19:56:21.034 INFO:teuthology.orchestra.run.smithi008.stdout: { 2023-08-01T19:56:21.034 INFO:teuthology.orchestra.run.smithi008.stdout: "event": "commit_sent", 2023-08-01T19:56:21.034 INFO:teuthology.orchestra.run.smithi008.stdout: "time": "2023-08-01T19:55:05.632503+0000", 2023-08-01T19:56:21.034 INFO:teuthology.orchestra.run.smithi008.stdout: "duration": 5.1295000000000003e-05 2023-08-01T19:56:21.035 INFO:teuthology.orchestra.run.smithi008.stdout: }, 2023-08-01T19:56:21.035 INFO:teuthology.orchestra.run.smithi008.stdout: { 2023-08-01T19:56:21.035 INFO:teuthology.orchestra.run.smithi008.stdout: "event": "done", 2023-08-01T19:56:21.035 INFO:teuthology.orchestra.run.smithi008.stdout: "time": "2023-08-01T19:55:05.632543+0000", 2023-08-01T19:56:21.035 INFO:teuthology.orchestra.run.smithi008.stdout: "duration": 4.0234000000000001e-05 2023-08-01T19:56:21.035 INFO:teuthology.orchestra.run.smithi008.stdout: } 2023-08-01T19:56:21.035 INFO:teuthology.orchestra.run.smithi008.stdout: ] 2023-08-01T19:56:21.036 INFO:teuthology.orchestra.run.smithi008.stdout: } 2023-08-01T19:56:21.036 INFO:teuthology.orchestra.run.smithi008.stdout: }, 2023-08-01T19:56:21.036 INFO:teuthology.orchestra.run.smithi008.stdout: { 2023-08-01T19:56:21.036 INFO:teuthology.orchestra.run.smithi008.stdout: "description": "osd_op(client.4668.0:100939 5.5 5:a75fa6e3:::benchmark_data_smithi006_114134_object100938:head [set-alloc-hint object_size 65536 write_size 65536,write 0~65536] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e37)", 2023-08-01T19:56:21.036 INFO:teuthology.orchestra.run.smithi008.stdout: "initiated_at": "2023-08-01T19:55:05.569740+0000", 2023-08-01T19:56:21.036 INFO:teuthology.orchestra.run.smithi008.stdout: "age": 75.428873039999999, 2023-08-01T19:56:21.036 INFO:teuthology.orchestra.run.smithi008.stdout: "duration": 0.067753412999999998, 2023-08-01T19:56:21.037 INFO:teuthology.orchestra.run.smithi008.stdout: "type_data": { 2023-08-01T19:56:21.037 INFO:teuthology.orchestra.run.smithi008.stdout: "flag_point": "commit sent; apply or cleanup", 2023-08-01T19:56:21.037 INFO:teuthology.orchestra.run.smithi008.stdout: "client_info": { 2023-08-01T19:56:21.037 INFO:teuthology.orchestra.run.smithi008.stdout: "client": "client.4668", 2023-08-01T19:56:21.037 INFO:teuthology.orchestra.run.smithi008.stdout: "client_addr": "172.21.15.6:0/1709472247", 2023-08-01T19:56:21.037 INFO:teuthology.orchestra.run.smithi008.stdout: "tid": 100939 2023-08-01T19:56:21.037 INFO:teuthology.orchestra.run.smithi008.stdout: }, 2023-08-01T19:56:21.037 INFO:teuthology.orchestra.run.smithi008.stdout: "events": [ 2023-08-01T19:56:21.038 INFO:teuthology.orchestra.run.smithi008.stdout: { 2023-08-01T19:56:21.038 INFO:teuthology.orchestra.run.smithi008.stdout: "event": "initiated", 2023-08-01T19:56:21.038 INFO:teuthology.orchestra.run.smithi008.stdout: "time": "2023-08-01T19:55:05.569740+0000", 2023-08-01T19:56:21.038 INFO:teuthology.orchestra.run.smithi008.stdout: "duration": 0 2023-08-01T19:56:21.038 INFO:teuthology.orchestra.run.smithi008.stdout: }, 2023-08-01T19:56:21.038 INFO:teuthology.orchestra.run.smithi008.stdout: { 2023-08-01T19:56:21.038 INFO:teuthology.orchestra.run.smithi008.stdout: "event": "throttled", 2023-08-01T19:56:21.038 INFO:teuthology.orchestra.run.smithi008.stdout: "time": "2023-08-01T19:55:05.569740+0000", 2023-08-01T19:56:21.039 INFO:teuthology.orchestra.run.smithi008.stdout: "duration": 0 2023-08-01T19:56:21.039 INFO:teuthology.orchestra.run.smithi008.stdout: }, 2023-08-01T19:56:21.039 INFO:teuthology.orchestra.run.smithi008.stdout: { 2023-08-01T19:56:21.039 INFO:teuthology.orchestra.run.smithi008.stdout: "event": "header_read", 2023-08-01T19:56:21.039 INFO:teuthology.orchestra.run.smithi008.stdout: "time": "2023-08-01T19:55:05.569739+0000", 2023-08-01T19:56:21.039 INFO:teuthology.orchestra.run.smithi008.stdout: "duration": 4294967295.9999995 2023-08-01T19:56:21.039 INFO:teuthology.orchestra.run.smithi008.stdout: }, 2023-08-01T19:56:21.039 INFO:teuthology.orchestra.run.smithi008.stdout: { 2023-08-01T19:56:21.040 INFO:teuthology.orchestra.run.smithi008.stdout: "event": "all_read", 2023-08-01T19:56:21.040 INFO:teuthology.orchestra.run.smithi008.stdout: "time": "2023-08-01T19:55:05.569839+0000", 2023-08-01T19:56:21.040 INFO:teuthology.orchestra.run.smithi008.stdout: "duration": 0.000100219 2023-08-01T19:56:21.040 INFO:teuthology.orchestra.run.smithi008.stdout: }, 2023-08-01T19:56:21.040 INFO:teuthology.orchestra.run.smithi008.stdout: { 2023-08-01T19:56:21.040 INFO:teuthology.orchestra.run.smithi008.stdout: "event": "dispatched", 2023-08-01T19:56:21.040 INFO:teuthology.orchestra.run.smithi008.stdout: "time": "2023-08-01T19:55:05.569846+0000", 2023-08-01T19:56:21.041 INFO:teuthology.orchestra.run.smithi008.stdout: "duration": 7.3150000000000003e-06 2023-08-01T19:56:21.041 INFO:teuthology.orchestra.run.smithi008.stdout: }, 2023-08-01T19:56:21.041 INFO:teuthology.orchestra.run.smithi008.stdout: { 2023-08-01T19:56:21.041 INFO:teuthology.orchestra.run.smithi008.stdout: "event": "queued_for_pg", 2023-08-01T19:56:21.041 INFO:teuthology.orchestra.run.smithi008.stdout: "time": "2023-08-01T19:55:05.569850+0000", 2023-08-01T19:56:21.041 INFO:teuthology.orchestra.run.smithi008.stdout: "duration": 3.3299999999999999e-06 2023-08-01T19:56:21.041 INFO:teuthology.orchestra.run.smithi008.stdout: }, 2023-08-01T19:56:21.041 INFO:teuthology.orchestra.run.smithi008.stdout: { 2023-08-01T19:56:21.042 INFO:teuthology.orchestra.run.smithi008.stdout: "event": "reached_pg", 2023-08-01T19:56:21.042 INFO:teuthology.orchestra.run.smithi008.stdout: "time": "2023-08-01T19:55:05.626991+0000", 2023-08-01T19:56:21.042 INFO:teuthology.orchestra.run.smithi008.stdout: "duration": 0.057141585000000002 2023-08-01T19:56:21.042 INFO:teuthology.orchestra.run.smithi008.stdout: }, 2023-08-01T19:56:21.042 INFO:teuthology.orchestra.run.smithi008.stdout: { 2023-08-01T19:56:21.042 INFO:teuthology.orchestra.run.smithi008.stdout: "event": "started", 2023-08-01T19:56:21.042 INFO:teuthology.orchestra.run.smithi008.stdout: "time": "2023-08-01T19:55:05.627111+0000", 2023-08-01T19:56:21.042 INFO:teuthology.orchestra.run.smithi008.stdout: "duration": 0.000119238 2023-08-01T19:56:21.043 INFO:teuthology.orchestra.run.smithi008.stdout: }, 2023-08-01T19:56:21.043 INFO:teuthology.orchestra.run.smithi008.stdout: { 2023-08-01T19:56:21.043 INFO:teuthology.orchestra.run.smithi008.stdout: "event": "waiting for subops from 1", 2023-08-01T19:56:21.043 INFO:teuthology.orchestra.run.smithi008.stdout: "time": "2023-08-01T19:55:05.627253+0000", 2023-08-01T19:56:21.043 INFO:teuthology.orchestra.run.smithi008.stdout: "duration": 0.000142822 2023-08-01T19:56:21.043 INFO:teuthology.orchestra.run.smithi008.stdout: }, 2023-08-01T19:56:21.043 INFO:teuthology.orchestra.run.smithi008.stdout: { 2023-08-01T19:56:21.043 INFO:teuthology.orchestra.run.smithi008.stdout: "event": "op_commit", 2023-08-01T19:56:21.044 INFO:teuthology.orchestra.run.smithi008.stdout: "time": "2023-08-01T19:55:05.632555+0000", 2023-08-01T19:56:21.044 INFO:teuthology.orchestra.run.smithi008.stdout: "duration": 0.0053012449999999996 2023-08-01T19:56:21.044 INFO:teuthology.orchestra.run.smithi008.stdout: }, 2023-08-01T19:56:21.044 INFO:teuthology.orchestra.run.smithi008.stdout: { 2023-08-01T19:56:21.044 INFO:teuthology.orchestra.run.smithi008.stdout: "event": "sub_op_commit_rec", 2023-08-01T19:56:21.044 INFO:teuthology.orchestra.run.smithi008.stdout: "time": "2023-08-01T19:55:05.637380+0000", 2023-08-01T19:56:21.044 INFO:teuthology.orchestra.run.smithi008.stdout: "duration": 0.0048257639999999997 2023-08-01T19:56:21.045 INFO:teuthology.orchestra.run.smithi008.stdout: }, 2023-08-01T19:56:21.045 INFO:teuthology.orchestra.run.smithi008.stdout: { 2023-08-01T19:56:21.045 INFO:teuthology.orchestra.run.smithi008.stdout: "event": "commit_sent", 2023-08-01T19:56:21.045 INFO:teuthology.orchestra.run.smithi008.stdout: "time": "2023-08-01T19:55:05.637454+0000", 2023-08-01T19:56:21.045 INFO:teuthology.orchestra.run.smithi008.stdout: "duration": 7.3578999999999995e-05 2023-08-01T19:56:21.045 INFO:teuthology.orchestra.run.smithi008.stdout: }, 2023-08-01T19:56:21.045 INFO:teuthology.orchestra.run.smithi008.stdout: { 2023-08-01T19:56:21.046 INFO:teuthology.orchestra.run.smithi008.stdout: "event": "done", 2023-08-01T19:56:21.046 INFO:teuthology.orchestra.run.smithi008.stdout: "time": "2023-08-01T19:55:05.637493+0000", 2023-08-01T19:56:21.046 INFO:teuthology.orchestra.run.smithi008.stdout: "duration": 3.8986999999999998e-05 2023-08-01T19:56:21.046 INFO:teuthology.orchestra.run.smithi008.stdout: } 2023-08-01T19:56:21.046 INFO:teuthology.orchestra.run.smithi008.stdout: ] 2023-08-01T19:56:21.046 INFO:teuthology.orchestra.run.smithi008.stdout: } 2023-08-01T19:56:21.046 INFO:teuthology.orchestra.run.smithi008.stdout: }, 2023-08-01T19:56:21.047 INFO:teuthology.orchestra.run.smithi008.stdout: { 2023-08-01T19:56:21.047 INFO:teuthology.orchestra.run.smithi008.stdout: "description": "osd_op(client.4668.0:107863 5.3 5:cbdd875a:::benchmark_data_smithi006_114134_object107862:head [set-alloc-hint object_size 65536 write_size 65536,write 0~65536] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e38)", 2023-08-01T19:56:21.047 INFO:teuthology.orchestra.run.smithi008.stdout: "initiated_at": "2023-08-01T19:55:09.278851+0000", 2023-08-01T19:56:21.047 INFO:teuthology.orchestra.run.smithi008.stdout: "age": 71.719761300000002, 2023-08-01T19:56:21.047 INFO:teuthology.orchestra.run.smithi008.stdout: "duration": 0.071378853000000006, 2023-08-01T19:56:21.047 INFO:teuthology.orchestra.run.smithi008.stdout: "type_data": { 2023-08-01T19:56:21.047 INFO:teuthology.orchestra.run.smithi008.stdout: "flag_point": "commit sent; apply or cleanup", 2023-08-01T19:56:21.048 INFO:teuthology.orchestra.run.smithi008.stdout: "client_info": { 2023-08-01T19:56:21.048 INFO:teuthology.orchestra.run.smithi008.stdout: "client": "client.4668", 2023-08-01T19:56:21.048 INFO:teuthology.orchestra.run.smithi008.stdout: "client_addr": "172.21.15.6:0/1709472247", 2023-08-01T19:56:21.048 INFO:teuthology.orchestra.run.smithi008.stdout: "tid": 107863 2023-08-01T19:56:21.048 INFO:teuthology.orchestra.run.smithi008.stdout: }, 2023-08-01T19:56:21.048 INFO:teuthology.orchestra.run.smithi008.stdout: "events": [ 2023-08-01T19:56:21.048 INFO:teuthology.orchestra.run.smithi008.stdout: { 2023-08-01T19:56:21.048 INFO:teuthology.orchestra.run.smithi008.stdout: "event": "initiated", 2023-08-01T19:56:21.049 INFO:teuthology.orchestra.run.smithi008.stdout: "time": "2023-08-01T19:55:09.278851+0000", 2023-08-01T19:56:21.049 INFO:teuthology.orchestra.run.smithi008.stdout: "duration": 0 2023-08-01T19:56:21.049 INFO:teuthology.orchestra.run.smithi008.stdout: }, 2023-08-01T19:56:21.049 INFO:teuthology.orchestra.run.smithi008.stdout: { 2023-08-01T19:56:21.049 INFO:teuthology.orchestra.run.smithi008.stdout: "event": "throttled", 2023-08-01T19:56:21.049 INFO:teuthology.orchestra.run.smithi008.stdout: "time": "2023-08-01T19:55:09.278851+0000", 2023-08-01T19:56:21.049 INFO:teuthology.orchestra.run.smithi008.stdout: "duration": 0 2023-08-01T19:56:21.050 INFO:teuthology.orchestra.run.smithi008.stdout: }, 2023-08-01T19:56:21.050 INFO:teuthology.orchestra.run.smithi008.stdout: { 2023-08-01T19:56:21.050 INFO:teuthology.orchestra.run.smithi008.stdout: "event": "header_read", 2023-08-01T19:56:21.050 INFO:teuthology.orchestra.run.smithi008.stdout: "time": "2023-08-01T19:55:09.278850+0000", 2023-08-01T19:56:21.050 INFO:teuthology.orchestra.run.smithi008.stdout: "duration": 4294967295.999999 2023-08-01T19:56:21.050 INFO:teuthology.orchestra.run.smithi008.stdout: }, 2023-08-01T19:56:21.050 INFO:teuthology.orchestra.run.smithi008.stdout: { 2023-08-01T19:56:21.050 INFO:teuthology.orchestra.run.smithi008.stdout: "event": "all_read", 2023-08-01T19:56:21.051 INFO:teuthology.orchestra.run.smithi008.stdout: "time": "2023-08-01T19:55:09.278945+0000", 2023-08-01T19:56:21.051 INFO:teuthology.orchestra.run.smithi008.stdout: "duration": 9.4388000000000005e-05 2023-08-01T19:56:21.051 INFO:teuthology.orchestra.run.smithi008.stdout: }, 2023-08-01T19:56:21.051 INFO:teuthology.orchestra.run.smithi008.stdout: { 2023-08-01T19:56:21.051 INFO:teuthology.orchestra.run.smithi008.stdout: "event": "dispatched", 2023-08-01T19:56:21.051 INFO:teuthology.orchestra.run.smithi008.stdout: "time": "2023-08-01T19:55:09.278955+0000", 2023-08-01T19:56:21.051 INFO:teuthology.orchestra.run.smithi008.stdout: "duration": 1.0413e-05 2023-08-01T19:56:21.051 INFO:teuthology.orchestra.run.smithi008.stdout: }, 2023-08-01T19:56:21.052 INFO:teuthology.orchestra.run.smithi008.stdout: { 2023-08-01T19:56:21.052 INFO:teuthology.orchestra.run.smithi008.stdout: "event": "queued_for_pg", 2023-08-01T19:56:21.052 INFO:teuthology.orchestra.run.smithi008.stdout: "time": "2023-08-01T19:55:09.278962+0000", 2023-08-01T19:56:21.052 INFO:teuthology.orchestra.run.smithi008.stdout: "duration": 6.2169999999999999e-06 2023-08-01T19:56:21.052 INFO:teuthology.orchestra.run.smithi008.stdout: }, 2023-08-01T19:56:21.052 INFO:teuthology.orchestra.run.smithi008.stdout: { 2023-08-01T19:56:21.052 INFO:teuthology.orchestra.run.smithi008.stdout: "event": "reached_pg", 2023-08-01T19:56:21.053 INFO:teuthology.orchestra.run.smithi008.stdout: "time": "2023-08-01T19:55:09.280363+0000", 2023-08-01T19:56:21.053 INFO:teuthology.orchestra.run.smithi008.stdout: "duration": 0.0014014489999999999 2023-08-01T19:56:21.053 INFO:teuthology.orchestra.run.smithi008.stdout: }, 2023-08-01T19:56:21.053 INFO:teuthology.orchestra.run.smithi008.stdout: { 2023-08-01T19:56:21.053 INFO:teuthology.orchestra.run.smithi008.stdout: "event": "started", 2023-08-01T19:56:21.053 INFO:teuthology.orchestra.run.smithi008.stdout: "time": "2023-08-01T19:55:09.280488+0000", 2023-08-01T19:56:21.053 INFO:teuthology.orchestra.run.smithi008.stdout: "duration": 0.00012474099999999999 2023-08-01T19:56:21.053 INFO:teuthology.orchestra.run.smithi008.stdout: }, 2023-08-01T19:56:21.054 INFO:teuthology.orchestra.run.smithi008.stdout: { 2023-08-01T19:56:21.054 INFO:teuthology.orchestra.run.smithi008.stdout: "event": "waiting for subops from 1", 2023-08-01T19:56:21.054 INFO:teuthology.orchestra.run.smithi008.stdout: "time": "2023-08-01T19:55:09.280626+0000", 2023-08-01T19:56:21.054 INFO:teuthology.orchestra.run.smithi008.stdout: "duration": 0.000138193 2023-08-01T19:56:21.054 INFO:teuthology.orchestra.run.smithi008.stdout: }, 2023-08-01T19:56:21.054 INFO:teuthology.orchestra.run.smithi008.stdout: { 2023-08-01T19:56:21.054 INFO:teuthology.orchestra.run.smithi008.stdout: "event": "op_commit", 2023-08-01T19:56:21.054 INFO:teuthology.orchestra.run.smithi008.stdout: "time": "2023-08-01T19:55:09.285958+0000", 2023-08-01T19:56:21.055 INFO:teuthology.orchestra.run.smithi008.stdout: "duration": 0.0053317130000000001 2023-08-01T19:56:21.055 INFO:teuthology.orchestra.run.smithi008.stdout: }, 2023-08-01T19:56:21.055 INFO:teuthology.orchestra.run.smithi008.stdout: { 2023-08-01T19:56:21.055 INFO:teuthology.orchestra.run.smithi008.stdout: "event": "sub_op_commit_rec", 2023-08-01T19:56:21.055 INFO:teuthology.orchestra.run.smithi008.stdout: "time": "2023-08-01T19:55:09.350151+0000", 2023-08-01T19:56:21.055 INFO:teuthology.orchestra.run.smithi008.stdout: "duration": 0.064193202000000005 2023-08-01T19:56:21.055 INFO:teuthology.orchestra.run.smithi008.stdout: }, 2023-08-01T19:56:21.056 INFO:teuthology.orchestra.run.smithi008.stdout: { 2023-08-01T19:56:21.056 INFO:teuthology.orchestra.run.smithi008.stdout: "event": "commit_sent", 2023-08-01T19:56:21.056 INFO:teuthology.orchestra.run.smithi008.stdout: "time": "2023-08-01T19:55:09.350188+0000", 2023-08-01T19:56:21.056 INFO:teuthology.orchestra.run.smithi008.stdout: "duration": 3.7549999999999998e-05 2023-08-01T19:56:21.056 INFO:teuthology.orchestra.run.smithi008.stdout: }, 2023-08-01T19:56:21.056 INFO:teuthology.orchestra.run.smithi008.stdout: { 2023-08-01T19:56:21.056 INFO:teuthology.orchestra.run.smithi008.stdout: "event": "done", 2023-08-01T19:56:21.056 INFO:teuthology.orchestra.run.smithi008.stdout: "time": "2023-08-01T19:55:09.350230+0000", 2023-08-01T19:56:21.057 INFO:teuthology.orchestra.run.smithi008.stdout: "duration": 4.1804999999999997e-05 2023-08-01T19:56:21.057 INFO:teuthology.orchestra.run.smithi008.stdout: } 2023-08-01T19:56:21.057 INFO:teuthology.orchestra.run.smithi008.stdout: ] 2023-08-01T19:56:21.057 INFO:teuthology.orchestra.run.smithi008.stdout: } 2023-08-01T19:56:21.057 INFO:teuthology.orchestra.run.smithi008.stdout: }, 2023-08-01T19:56:21.057 INFO:teuthology.orchestra.run.smithi008.stdout: { 2023-08-01T19:56:21.057 INFO:teuthology.orchestra.run.smithi008.stdout: "description": "osd_op(client.4668.0:107865 5.3 5:c2ebb96d:::benchmark_data_smithi006_114134_object107864:head [set-alloc-hint object_size 65536 write_size 65536,write 0~65536] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e38)", 2023-08-01T19:56:21.057 INFO:teuthology.orchestra.run.smithi008.stdout: "initiated_at": "2023-08-01T19:55:09.279020+0000", 2023-08-01T19:56:21.058 INFO:teuthology.orchestra.run.smithi008.stdout: "age": 71.719592628000001, 2023-08-01T19:56:21.058 INFO:teuthology.orchestra.run.smithi008.stdout: "duration": 0.072892565000000006, 2023-08-01T19:56:21.058 INFO:teuthology.orchestra.run.smithi008.stdout: "type_data": { 2023-08-01T19:56:21.058 INFO:teuthology.orchestra.run.smithi008.stdout: "flag_point": "commit sent; apply or cleanup", 2023-08-01T19:56:21.058 INFO:teuthology.orchestra.run.smithi008.stdout: "client_info": { 2023-08-01T19:56:21.058 INFO:teuthology.orchestra.run.smithi008.stdout: "client": "client.4668", 2023-08-01T19:56:21.058 INFO:teuthology.orchestra.run.smithi008.stdout: "client_addr": "172.21.15.6:0/1709472247", 2023-08-01T19:56:21.059 INFO:teuthology.orchestra.run.smithi008.stdout: "tid": 107865 2023-08-01T19:56:21.059 INFO:teuthology.orchestra.run.smithi008.stdout: }, 2023-08-01T19:56:21.059 INFO:teuthology.orchestra.run.smithi008.stdout: "events": [ 2023-08-01T19:56:21.059 INFO:teuthology.orchestra.run.smithi008.stdout: { 2023-08-01T19:56:21.059 INFO:teuthology.orchestra.run.smithi008.stdout: "event": "initiated", 2023-08-01T19:56:21.059 INFO:teuthology.orchestra.run.smithi008.stdout: "time": "2023-08-01T19:55:09.279020+0000", 2023-08-01T19:56:21.059 INFO:teuthology.orchestra.run.smithi008.stdout: "duration": 0 2023-08-01T19:56:21.060 INFO:teuthology.orchestra.run.smithi008.stdout: }, 2023-08-01T19:56:21.060 INFO:teuthology.orchestra.run.smithi008.stdout: { 2023-08-01T19:56:21.060 INFO:teuthology.orchestra.run.smithi008.stdout: "event": "throttled", 2023-08-01T19:56:21.060 INFO:teuthology.orchestra.run.smithi008.stdout: "time": "2023-08-01T19:55:09.279020+0000", 2023-08-01T19:56:21.060 INFO:teuthology.orchestra.run.smithi008.stdout: "duration": 0 2023-08-01T19:56:21.060 INFO:teuthology.orchestra.run.smithi008.stdout: }, 2023-08-01T19:56:21.060 INFO:teuthology.orchestra.run.smithi008.stdout: { 2023-08-01T19:56:21.061 INFO:teuthology.orchestra.run.smithi008.stdout: "event": "header_read", 2023-08-01T19:56:21.061 INFO:teuthology.orchestra.run.smithi008.stdout: "time": "2023-08-01T19:55:09.279019+0000", 2023-08-01T19:56:21.061 INFO:teuthology.orchestra.run.smithi008.stdout: "duration": 4294967295.999999 2023-08-01T19:56:21.061 INFO:teuthology.orchestra.run.smithi008.stdout: }, 2023-08-01T19:56:21.061 INFO:teuthology.orchestra.run.smithi008.stdout: { 2023-08-01T19:56:21.061 INFO:teuthology.orchestra.run.smithi008.stdout: "event": "all_read", 2023-08-01T19:56:21.061 INFO:teuthology.orchestra.run.smithi008.stdout: "time": "2023-08-01T19:55:09.279087+0000", 2023-08-01T19:56:21.061 INFO:teuthology.orchestra.run.smithi008.stdout: "duration": 6.8392000000000005e-05 2023-08-01T19:56:21.062 INFO:teuthology.orchestra.run.smithi008.stdout: }, 2023-08-01T19:56:21.062 INFO:teuthology.orchestra.run.smithi008.stdout: { 2023-08-01T19:56:21.062 INFO:teuthology.orchestra.run.smithi008.stdout: "event": "dispatched", 2023-08-01T19:56:21.062 INFO:teuthology.orchestra.run.smithi008.stdout: "time": "2023-08-01T19:55:09.279095+0000", 2023-08-01T19:56:21.062 INFO:teuthology.orchestra.run.smithi008.stdout: "duration": 8.0989999999999999e-06 2023-08-01T19:56:21.062 INFO:teuthology.orchestra.run.smithi008.stdout: }, 2023-08-01T19:56:21.062 INFO:teuthology.orchestra.run.smithi008.stdout: { 2023-08-01T19:56:21.062 INFO:teuthology.orchestra.run.smithi008.stdout: "event": "queued_for_pg", 2023-08-01T19:56:21.063 INFO:teuthology.orchestra.run.smithi008.stdout: "time": "2023-08-01T19:55:09.279101+0000", 2023-08-01T19:56:21.063 INFO:teuthology.orchestra.run.smithi008.stdout: "duration": 5.0390000000000004e-06 2023-08-01T19:56:21.063 INFO:teuthology.orchestra.run.smithi008.stdout: }, 2023-08-01T19:56:21.063 INFO:teuthology.orchestra.run.smithi008.stdout: { 2023-08-01T19:56:21.063 INFO:teuthology.orchestra.run.smithi008.stdout: "event": "reached_pg", 2023-08-01T19:56:21.063 INFO:teuthology.orchestra.run.smithi008.stdout: "time": "2023-08-01T19:55:09.282574+0000", 2023-08-01T19:56:21.063 INFO:teuthology.orchestra.run.smithi008.stdout: "duration": 0.0034730619999999999 2023-08-01T19:56:21.063 INFO:teuthology.orchestra.run.smithi008.stdout: }, 2023-08-01T19:56:21.064 INFO:teuthology.orchestra.run.smithi008.stdout: { 2023-08-01T19:56:21.064 INFO:teuthology.orchestra.run.smithi008.stdout: "event": "started", 2023-08-01T19:56:21.064 INFO:teuthology.orchestra.run.smithi008.stdout: "time": "2023-08-01T19:55:09.282705+0000", 2023-08-01T19:56:21.064 INFO:teuthology.orchestra.run.smithi008.stdout: "duration": 0.00013133400000000001 2023-08-01T19:56:21.064 INFO:teuthology.orchestra.run.smithi008.stdout: }, 2023-08-01T19:56:21.064 INFO:teuthology.orchestra.run.smithi008.stdout: { 2023-08-01T19:56:21.064 INFO:teuthology.orchestra.run.smithi008.stdout: "event": "waiting for subops from 1", 2023-08-01T19:56:21.065 INFO:teuthology.orchestra.run.smithi008.stdout: "time": "2023-08-01T19:55:09.283067+0000", 2023-08-01T19:56:21.065 INFO:teuthology.orchestra.run.smithi008.stdout: "duration": 0.00036195299999999998 2023-08-01T19:56:21.065 INFO:teuthology.orchestra.run.smithi008.stdout: }, 2023-08-01T19:56:21.065 INFO:teuthology.orchestra.run.smithi008.stdout: { 2023-08-01T19:56:21.065 INFO:teuthology.orchestra.run.smithi008.stdout: "event": "op_commit", 2023-08-01T19:56:21.065 INFO:teuthology.orchestra.run.smithi008.stdout: "time": "2023-08-01T19:55:09.288196+0000", 2023-08-01T19:56:21.065 INFO:teuthology.orchestra.run.smithi008.stdout: "duration": 0.0051293780000000004 2023-08-01T19:56:21.065 INFO:teuthology.orchestra.run.smithi008.stdout: }, 2023-08-01T19:56:21.066 INFO:teuthology.orchestra.run.smithi008.stdout: { 2023-08-01T19:56:21.066 INFO:teuthology.orchestra.run.smithi008.stdout: "event": "sub_op_commit_rec", 2023-08-01T19:56:21.066 INFO:teuthology.orchestra.run.smithi008.stdout: "time": "2023-08-01T19:55:09.351832+0000", 2023-08-01T19:56:21.066 INFO:teuthology.orchestra.run.smithi008.stdout: "duration": 0.063636076 2023-08-01T19:56:21.066 INFO:teuthology.orchestra.run.smithi008.stdout: }, 2023-08-01T19:56:21.066 INFO:teuthology.orchestra.run.smithi008.stdout: { 2023-08-01T19:56:21.066 INFO:teuthology.orchestra.run.smithi008.stdout: "event": "commit_sent", 2023-08-01T19:56:21.066 INFO:teuthology.orchestra.run.smithi008.stdout: "time": "2023-08-01T19:55:09.351878+0000", 2023-08-01T19:56:21.067 INFO:teuthology.orchestra.run.smithi008.stdout: "duration": 4.5408999999999998e-05 2023-08-01T19:56:21.067 INFO:teuthology.orchestra.run.smithi008.stdout: }, 2023-08-01T19:56:21.067 INFO:teuthology.orchestra.run.smithi008.stdout: { 2023-08-01T19:56:21.067 INFO:teuthology.orchestra.run.smithi008.stdout: "event": "done", 2023-08-01T19:56:21.067 INFO:teuthology.orchestra.run.smithi008.stdout: "time": "2023-08-01T19:55:09.351913+0000", 2023-08-01T19:56:21.067 INFO:teuthology.orchestra.run.smithi008.stdout: "duration": 3.4808999999999998e-05 2023-08-01T19:56:21.067 INFO:teuthology.orchestra.run.smithi008.stdout: } 2023-08-01T19:56:21.067 INFO:teuthology.orchestra.run.smithi008.stdout: ] 2023-08-01T19:56:21.068 INFO:teuthology.orchestra.run.smithi008.stdout: } 2023-08-01T19:56:21.068 INFO:teuthology.orchestra.run.smithi008.stdout: }, 2023-08-01T19:56:21.068 INFO:teuthology.orchestra.run.smithi008.stdout: { 2023-08-01T19:56:21.068 INFO:teuthology.orchestra.run.smithi008.stdout: "description": "osd_op(client.4668.0:107869 5.c 5:31910384:::benchmark_data_smithi006_114134_object107868:head [set-alloc-hint object_size 65536 write_size 65536,write 0~65536] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e38)", 2023-08-01T19:56:21.068 INFO:teuthology.orchestra.run.smithi008.stdout: "initiated_at": "2023-08-01T19:55:09.283205+0000", 2023-08-01T19:56:21.068 INFO:teuthology.orchestra.run.smithi008.stdout: "age": 71.715407463000005, 2023-08-01T19:56:21.068 INFO:teuthology.orchestra.run.smithi008.stdout: "duration": 0.068611808999999996, 2023-08-01T19:56:21.069 INFO:teuthology.orchestra.run.smithi008.stdout: "type_data": { 2023-08-01T19:56:21.069 INFO:teuthology.orchestra.run.smithi008.stdout: "flag_point": "commit sent; apply or cleanup", 2023-08-01T19:56:21.069 INFO:teuthology.orchestra.run.smithi008.stdout: "client_info": { 2023-08-01T19:56:21.069 INFO:teuthology.orchestra.run.smithi008.stdout: "client": "client.4668", 2023-08-01T19:56:21.069 INFO:teuthology.orchestra.run.smithi008.stdout: "client_addr": "172.21.15.6:0/1709472247", 2023-08-01T19:56:21.069 INFO:teuthology.orchestra.run.smithi008.stdout: "tid": 107869 2023-08-01T19:56:21.069 INFO:teuthology.orchestra.run.smithi008.stdout: }, 2023-08-01T19:56:21.069 INFO:teuthology.orchestra.run.smithi008.stdout: "events": [ 2023-08-01T19:56:21.070 INFO:teuthology.orchestra.run.smithi008.stdout: { 2023-08-01T19:56:21.070 INFO:teuthology.orchestra.run.smithi008.stdout: "event": "initiated", 2023-08-01T19:56:21.070 INFO:teuthology.orchestra.run.smithi008.stdout: "time": "2023-08-01T19:55:09.283205+0000", 2023-08-01T19:56:21.070 INFO:teuthology.orchestra.run.smithi008.stdout: "duration": 0 2023-08-01T19:56:21.070 INFO:teuthology.orchestra.run.smithi008.stdout: }, 2023-08-01T19:56:21.070 INFO:teuthology.orchestra.run.smithi008.stdout: { 2023-08-01T19:56:21.070 INFO:teuthology.orchestra.run.smithi008.stdout: "event": "throttled", 2023-08-01T19:56:21.071 INFO:teuthology.orchestra.run.smithi008.stdout: "time": "2023-08-01T19:55:09.283205+0000", 2023-08-01T19:56:21.071 INFO:teuthology.orchestra.run.smithi008.stdout: "duration": 0 2023-08-01T19:56:21.071 INFO:teuthology.orchestra.run.smithi008.stdout: }, 2023-08-01T19:56:21.071 INFO:teuthology.orchestra.run.smithi008.stdout: { 2023-08-01T19:56:21.071 INFO:teuthology.orchestra.run.smithi008.stdout: "event": "header_read", 2023-08-01T19:56:21.071 INFO:teuthology.orchestra.run.smithi008.stdout: "time": "2023-08-01T19:55:09.283204+0000", 2023-08-01T19:56:21.071 INFO:teuthology.orchestra.run.smithi008.stdout: "duration": 4294967295.999999 2023-08-01T19:56:21.071 INFO:teuthology.orchestra.run.smithi008.stdout: }, 2023-08-01T19:56:21.072 INFO:teuthology.orchestra.run.smithi008.stdout: { 2023-08-01T19:56:21.072 INFO:teuthology.orchestra.run.smithi008.stdout: "event": "all_read", 2023-08-01T19:56:21.072 INFO:teuthology.orchestra.run.smithi008.stdout: "time": "2023-08-01T19:55:09.283300+0000", 2023-08-01T19:56:21.072 INFO:teuthology.orchestra.run.smithi008.stdout: "duration": 9.6280000000000007e-05 2023-08-01T19:56:21.072 INFO:teuthology.orchestra.run.smithi008.stdout: }, 2023-08-01T19:56:21.072 INFO:teuthology.orchestra.run.smithi008.stdout: { 2023-08-01T19:56:21.072 INFO:teuthology.orchestra.run.smithi008.stdout: "event": "dispatched", 2023-08-01T19:56:21.073 INFO:teuthology.orchestra.run.smithi008.stdout: "time": "2023-08-01T19:55:09.283314+0000", 2023-08-01T19:56:21.073 INFO:teuthology.orchestra.run.smithi008.stdout: "duration": 1.3344e-05 2023-08-01T19:56:21.073 INFO:teuthology.orchestra.run.smithi008.stdout: }, 2023-08-01T19:56:21.073 INFO:teuthology.orchestra.run.smithi008.stdout: { 2023-08-01T19:56:21.073 INFO:teuthology.orchestra.run.smithi008.stdout: "event": "queued_for_pg", 2023-08-01T19:56:21.073 INFO:teuthology.orchestra.run.smithi008.stdout: "time": "2023-08-01T19:55:09.283320+0000", 2023-08-01T19:56:21.073 INFO:teuthology.orchestra.run.smithi008.stdout: "duration": 6.0299999999999999e-06 2023-08-01T19:56:21.073 INFO:teuthology.orchestra.run.smithi008.stdout: }, 2023-08-01T19:56:21.074 INFO:teuthology.orchestra.run.smithi008.stdout: { 2023-08-01T19:56:21.074 INFO:teuthology.orchestra.run.smithi008.stdout: "event": "reached_pg", 2023-08-01T19:56:21.074 INFO:teuthology.orchestra.run.smithi008.stdout: "time": "2023-08-01T19:55:09.283365+0000", 2023-08-01T19:56:21.074 INFO:teuthology.orchestra.run.smithi008.stdout: "duration": 4.5578999999999998e-05 2023-08-01T19:56:21.074 INFO:teuthology.orchestra.run.smithi008.stdout: }, 2023-08-01T19:56:21.074 INFO:teuthology.orchestra.run.smithi008.stdout: { 2023-08-01T19:56:21.074 INFO:teuthology.orchestra.run.smithi008.stdout: "event": "started", 2023-08-01T19:56:21.074 INFO:teuthology.orchestra.run.smithi008.stdout: "time": "2023-08-01T19:55:09.283490+0000", 2023-08-01T19:56:21.075 INFO:teuthology.orchestra.run.smithi008.stdout: "duration": 0.00012473700000000001 2023-08-01T19:56:21.075 INFO:teuthology.orchestra.run.smithi008.stdout: }, 2023-08-01T19:56:21.075 INFO:teuthology.orchestra.run.smithi008.stdout: { 2023-08-01T19:56:21.075 INFO:teuthology.orchestra.run.smithi008.stdout: "event": "waiting for subops from 1", 2023-08-01T19:56:21.075 INFO:teuthology.orchestra.run.smithi008.stdout: "time": "2023-08-01T19:55:09.283637+0000", 2023-08-01T19:56:21.075 INFO:teuthology.orchestra.run.smithi008.stdout: "duration": 0.00014715600000000001 2023-08-01T19:56:21.075 INFO:teuthology.orchestra.run.smithi008.stdout: }, 2023-08-01T19:56:21.075 INFO:teuthology.orchestra.run.smithi008.stdout: { 2023-08-01T19:56:21.076 INFO:teuthology.orchestra.run.smithi008.stdout: "event": "op_commit", 2023-08-01T19:56:21.076 INFO:teuthology.orchestra.run.smithi008.stdout: "time": "2023-08-01T19:55:09.288214+0000", 2023-08-01T19:56:21.076 INFO:teuthology.orchestra.run.smithi008.stdout: "duration": 0.0045769560000000001 2023-08-01T19:56:21.076 INFO:teuthology.orchestra.run.smithi008.stdout: }, 2023-08-01T19:56:21.076 INFO:teuthology.orchestra.run.smithi008.stdout: { 2023-08-01T19:56:21.076 INFO:teuthology.orchestra.run.smithi008.stdout: "event": "sub_op_commit_rec", 2023-08-01T19:56:21.076 INFO:teuthology.orchestra.run.smithi008.stdout: "time": "2023-08-01T19:55:09.351721+0000", 2023-08-01T19:56:21.077 INFO:teuthology.orchestra.run.smithi008.stdout: "duration": 0.063507383000000001 2023-08-01T19:56:21.077 INFO:teuthology.orchestra.run.smithi008.stdout: }, 2023-08-01T19:56:21.077 INFO:teuthology.orchestra.run.smithi008.stdout: { 2023-08-01T19:56:21.077 INFO:teuthology.orchestra.run.smithi008.stdout: "event": "commit_sent", 2023-08-01T19:56:21.077 INFO:teuthology.orchestra.run.smithi008.stdout: "time": "2023-08-01T19:55:09.351777+0000", 2023-08-01T19:56:21.077 INFO:teuthology.orchestra.run.smithi008.stdout: "duration": 5.5733999999999999e-05 2023-08-01T19:56:21.077 INFO:teuthology.orchestra.run.smithi008.stdout: }, 2023-08-01T19:56:21.077 INFO:teuthology.orchestra.run.smithi008.stdout: { 2023-08-01T19:56:21.078 INFO:teuthology.orchestra.run.smithi008.stdout: "event": "done", 2023-08-01T19:56:21.078 INFO:teuthology.orchestra.run.smithi008.stdout: "time": "2023-08-01T19:55:09.351817+0000", 2023-08-01T19:56:21.078 INFO:teuthology.orchestra.run.smithi008.stdout: "duration": 3.9765000000000003e-05 2023-08-01T19:56:21.078 INFO:teuthology.orchestra.run.smithi008.stdout: } 2023-08-01T19:56:21.078 INFO:teuthology.orchestra.run.smithi008.stdout: ] 2023-08-01T19:56:21.078 INFO:teuthology.orchestra.run.smithi008.stdout: } 2023-08-01T19:56:21.078 INFO:teuthology.orchestra.run.smithi008.stdout: }, 2023-08-01T19:56:21.079 INFO:teuthology.orchestra.run.smithi008.stdout: { 2023-08-01T19:56:21.079 INFO:teuthology.orchestra.run.smithi008.stdout: "description": "osd_op(client.4668.0:107874 5.3 5:ce4c2799:::benchmark_data_smithi006_114134_object107873:head [set-alloc-hint object_size 65536 write_size 65536,write 0~65536] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e38)", 2023-08-01T19:56:21.079 INFO:teuthology.orchestra.run.smithi008.stdout: "initiated_at": "2023-08-01T19:55:09.286239+0000", 2023-08-01T19:56:21.079 INFO:teuthology.orchestra.run.smithi008.stdout: "age": 71.712373958000001, 2023-08-01T19:56:21.079 INFO:teuthology.orchestra.run.smithi008.stdout: "duration": 0.068224389999999996, 2023-08-01T19:56:21.079 INFO:teuthology.orchestra.run.smithi008.stdout: "type_data": { 2023-08-01T19:56:21.079 INFO:teuthology.orchestra.run.smithi008.stdout: "flag_point": "commit sent; apply or cleanup", 2023-08-01T19:56:21.080 INFO:teuthology.orchestra.run.smithi008.stdout: "client_info": { 2023-08-01T19:56:21.080 INFO:teuthology.orchestra.run.smithi008.stdout: "client": "client.4668", 2023-08-01T19:56:21.080 INFO:teuthology.orchestra.run.smithi008.stdout: "client_addr": "172.21.15.6:0/1709472247", 2023-08-01T19:56:21.080 INFO:teuthology.orchestra.run.smithi008.stdout: "tid": 107874 2023-08-01T19:56:21.080 INFO:teuthology.orchestra.run.smithi008.stdout: }, 2023-08-01T19:56:21.080 INFO:teuthology.orchestra.run.smithi008.stdout: "events": [ 2023-08-01T19:56:21.080 INFO:teuthology.orchestra.run.smithi008.stdout: { 2023-08-01T19:56:21.080 INFO:teuthology.orchestra.run.smithi008.stdout: "event": "initiated", 2023-08-01T19:56:21.081 INFO:teuthology.orchestra.run.smithi008.stdout: "time": "2023-08-01T19:55:09.286239+0000", 2023-08-01T19:56:21.081 INFO:teuthology.orchestra.run.smithi008.stdout: "duration": 0 2023-08-01T19:56:21.081 INFO:teuthology.orchestra.run.smithi008.stdout: }, 2023-08-01T19:56:21.081 INFO:teuthology.orchestra.run.smithi008.stdout: { 2023-08-01T19:56:21.081 INFO:teuthology.orchestra.run.smithi008.stdout: "event": "throttled", 2023-08-01T19:56:21.081 INFO:teuthology.orchestra.run.smithi008.stdout: "time": "2023-08-01T19:55:09.286239+0000", 2023-08-01T19:56:21.081 INFO:teuthology.orchestra.run.smithi008.stdout: "duration": 0 2023-08-01T19:56:21.081 INFO:teuthology.orchestra.run.smithi008.stdout: }, 2023-08-01T19:56:21.082 INFO:teuthology.orchestra.run.smithi008.stdout: { 2023-08-01T19:56:21.082 INFO:teuthology.orchestra.run.smithi008.stdout: "event": "header_read", 2023-08-01T19:56:21.082 INFO:teuthology.orchestra.run.smithi008.stdout: "time": "2023-08-01T19:55:09.286238+0000", 2023-08-01T19:56:21.082 INFO:teuthology.orchestra.run.smithi008.stdout: "duration": 4294967295.999999 2023-08-01T19:56:21.082 INFO:teuthology.orchestra.run.smithi008.stdout: }, 2023-08-01T19:56:21.082 INFO:teuthology.orchestra.run.smithi008.stdout: { 2023-08-01T19:56:21.083 INFO:teuthology.orchestra.run.smithi008.stdout: "event": "all_read", 2023-08-01T19:56:21.083 INFO:teuthology.orchestra.run.smithi008.stdout: "time": "2023-08-01T19:55:09.286310+0000", 2023-08-01T19:56:21.083 INFO:teuthology.orchestra.run.smithi008.stdout: "duration": 7.2583999999999995e-05 2023-08-01T19:56:21.083 INFO:teuthology.orchestra.run.smithi008.stdout: }, 2023-08-01T19:56:21.083 INFO:teuthology.orchestra.run.smithi008.stdout: { 2023-08-01T19:56:21.083 INFO:teuthology.orchestra.run.smithi008.stdout: "event": "dispatched", 2023-08-01T19:56:21.083 INFO:teuthology.orchestra.run.smithi008.stdout: "time": "2023-08-01T19:55:09.286323+0000", 2023-08-01T19:56:21.084 INFO:teuthology.orchestra.run.smithi008.stdout: "duration": 1.3151e-05 2023-08-01T19:56:21.084 INFO:teuthology.orchestra.run.smithi008.stdout: }, 2023-08-01T19:56:21.084 INFO:teuthology.orchestra.run.smithi008.stdout: { 2023-08-01T19:56:21.084 INFO:teuthology.orchestra.run.smithi008.stdout: "event": "queued_for_pg", 2023-08-01T19:56:21.084 INFO:teuthology.orchestra.run.smithi008.stdout: "time": "2023-08-01T19:55:09.286329+0000", 2023-08-01T19:56:21.084 INFO:teuthology.orchestra.run.smithi008.stdout: "duration": 5.8719999999999999e-06 2023-08-01T19:56:21.084 INFO:teuthology.orchestra.run.smithi008.stdout: }, 2023-08-01T19:56:21.084 INFO:teuthology.orchestra.run.smithi008.stdout: { 2023-08-01T19:56:21.085 INFO:teuthology.orchestra.run.smithi008.stdout: "event": "reached_pg", 2023-08-01T19:56:21.085 INFO:teuthology.orchestra.run.smithi008.stdout: "time": "2023-08-01T19:55:09.286392+0000", 2023-08-01T19:56:21.085 INFO:teuthology.orchestra.run.smithi008.stdout: "duration": 6.2378000000000005e-05 2023-08-01T19:56:21.085 INFO:teuthology.orchestra.run.smithi008.stdout: }, 2023-08-01T19:56:21.085 INFO:teuthology.orchestra.run.smithi008.stdout: { 2023-08-01T19:56:21.085 INFO:teuthology.orchestra.run.smithi008.stdout: "event": "started", 2023-08-01T19:56:21.085 INFO:teuthology.orchestra.run.smithi008.stdout: "time": "2023-08-01T19:55:09.286473+0000", 2023-08-01T19:56:21.086 INFO:teuthology.orchestra.run.smithi008.stdout: "duration": 8.1327000000000002e-05 2023-08-01T19:56:21.086 INFO:teuthology.orchestra.run.smithi008.stdout: }, 2023-08-01T19:56:21.086 INFO:teuthology.orchestra.run.smithi008.stdout: { 2023-08-01T19:56:21.086 INFO:teuthology.orchestra.run.smithi008.stdout: "event": "waiting for subops from 1", 2023-08-01T19:56:21.086 INFO:teuthology.orchestra.run.smithi008.stdout: "time": "2023-08-01T19:55:09.286557+0000", 2023-08-01T19:56:21.086 INFO:teuthology.orchestra.run.smithi008.stdout: "duration": 8.4140000000000004e-05 2023-08-01T19:56:21.086 INFO:teuthology.orchestra.run.smithi008.stdout: }, 2023-08-01T19:56:21.086 INFO:teuthology.orchestra.run.smithi008.stdout: { 2023-08-01T19:56:21.087 INFO:teuthology.orchestra.run.smithi008.stdout: "event": "op_commit", 2023-08-01T19:56:21.087 INFO:teuthology.orchestra.run.smithi008.stdout: "time": "2023-08-01T19:55:09.290681+0000", 2023-08-01T19:56:21.087 INFO:teuthology.orchestra.run.smithi008.stdout: "duration": 0.0041242420000000002 2023-08-01T19:56:21.087 INFO:teuthology.orchestra.run.smithi008.stdout: }, 2023-08-01T19:56:21.087 INFO:teuthology.orchestra.run.smithi008.stdout: { 2023-08-01T19:56:21.087 INFO:teuthology.orchestra.run.smithi008.stdout: "event": "sub_op_commit_rec", 2023-08-01T19:56:21.087 INFO:teuthology.orchestra.run.smithi008.stdout: "time": "2023-08-01T19:55:09.354372+0000", 2023-08-01T19:56:21.088 INFO:teuthology.orchestra.run.smithi008.stdout: "duration": 0.063690438000000002 2023-08-01T19:56:21.088 INFO:teuthology.orchestra.run.smithi008.stdout: }, 2023-08-01T19:56:21.088 INFO:teuthology.orchestra.run.smithi008.stdout: { 2023-08-01T19:56:21.088 INFO:teuthology.orchestra.run.smithi008.stdout: "event": "commit_sent", 2023-08-01T19:56:21.088 INFO:teuthology.orchestra.run.smithi008.stdout: "time": "2023-08-01T19:55:09.354421+0000", 2023-08-01T19:56:21.088 INFO:teuthology.orchestra.run.smithi008.stdout: "duration": 4.9413000000000003e-05 2023-08-01T19:56:21.088 INFO:teuthology.orchestra.run.smithi008.stdout: }, 2023-08-01T19:56:21.088 INFO:teuthology.orchestra.run.smithi008.stdout: { 2023-08-01T19:56:21.089 INFO:teuthology.orchestra.run.smithi008.stdout: "event": "done", 2023-08-01T19:56:21.089 INFO:teuthology.orchestra.run.smithi008.stdout: "time": "2023-08-01T19:55:09.354463+0000", 2023-08-01T19:56:21.089 INFO:teuthology.orchestra.run.smithi008.stdout: "duration": 4.1924e-05 2023-08-01T19:56:21.089 INFO:teuthology.orchestra.run.smithi008.stdout: } 2023-08-01T19:56:21.089 INFO:teuthology.orchestra.run.smithi008.stdout: ] 2023-08-01T19:56:21.089 INFO:teuthology.orchestra.run.smithi008.stdout: } 2023-08-01T19:56:21.089 INFO:teuthology.orchestra.run.smithi008.stdout: }, 2023-08-01T19:56:21.089 INFO:teuthology.orchestra.run.smithi008.stdout: { 2023-08-01T19:56:21.090 INFO:teuthology.orchestra.run.smithi008.stdout: "description": "osd_op(client.4668.0:197398 5.1 5:809d7164:::benchmark_data_smithi006_114134_object63737:head [delete] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e61)", 2023-08-01T19:56:21.090 INFO:teuthology.orchestra.run.smithi008.stdout: "initiated_at": "2023-08-01T19:55:58.554713+0000", 2023-08-01T19:56:21.090 INFO:teuthology.orchestra.run.smithi008.stdout: "age": 22.443899269999999, 2023-08-01T19:56:21.090 INFO:teuthology.orchestra.run.smithi008.stdout: "duration": 1.0661326660000001, 2023-08-01T19:56:21.090 INFO:teuthology.orchestra.run.smithi008.stdout: "type_data": { 2023-08-01T19:56:21.090 INFO:teuthology.orchestra.run.smithi008.stdout: "flag_point": "reached pg", 2023-08-01T19:56:21.090 INFO:teuthology.orchestra.run.smithi008.stdout: "client_info": { 2023-08-01T19:56:21.091 INFO:teuthology.orchestra.run.smithi008.stdout: "client": "client.4668", 2023-08-01T19:56:21.091 INFO:teuthology.orchestra.run.smithi008.stdout: "client_addr": "172.21.15.6:0/1709472247", 2023-08-01T19:56:21.091 INFO:teuthology.orchestra.run.smithi008.stdout: "tid": 197398 2023-08-01T19:56:21.091 INFO:teuthology.orchestra.run.smithi008.stdout: }, 2023-08-01T19:56:21.091 INFO:teuthology.orchestra.run.smithi008.stdout: "events": [ 2023-08-01T19:56:21.091 INFO:teuthology.orchestra.run.smithi008.stdout: { 2023-08-01T19:56:21.091 INFO:teuthology.orchestra.run.smithi008.stdout: "event": "initiated", 2023-08-01T19:56:21.091 INFO:teuthology.orchestra.run.smithi008.stdout: "time": "2023-08-01T19:55:58.554713+0000", 2023-08-01T19:56:21.092 INFO:teuthology.orchestra.run.smithi008.stdout: "duration": 0 2023-08-01T19:56:21.092 INFO:teuthology.orchestra.run.smithi008.stdout: }, 2023-08-01T19:56:21.092 INFO:teuthology.orchestra.run.smithi008.stdout: { 2023-08-01T19:56:21.092 INFO:teuthology.orchestra.run.smithi008.stdout: "event": "throttled", 2023-08-01T19:56:21.092 INFO:teuthology.orchestra.run.smithi008.stdout: "time": "2023-08-01T19:55:58.554713+0000", 2023-08-01T19:56:21.092 INFO:teuthology.orchestra.run.smithi008.stdout: "duration": 0 2023-08-01T19:56:21.092 INFO:teuthology.orchestra.run.smithi008.stdout: }, 2023-08-01T19:56:21.092 INFO:teuthology.orchestra.run.smithi008.stdout: { 2023-08-01T19:56:21.093 INFO:teuthology.orchestra.run.smithi008.stdout: "event": "header_read", 2023-08-01T19:56:21.093 INFO:teuthology.orchestra.run.smithi008.stdout: "time": "2023-08-01T19:55:58.554713+0000", 2023-08-01T19:56:21.093 INFO:teuthology.orchestra.run.smithi008.stdout: "duration": 4294967295.999999 2023-08-01T19:56:21.093 INFO:teuthology.orchestra.run.smithi008.stdout: }, 2023-08-01T19:56:21.093 INFO:teuthology.orchestra.run.smithi008.stdout: { 2023-08-01T19:56:21.093 INFO:teuthology.orchestra.run.smithi008.stdout: "event": "all_read", 2023-08-01T19:56:21.093 INFO:teuthology.orchestra.run.smithi008.stdout: "time": "2023-08-01T19:55:58.554717+0000", 2023-08-01T19:56:21.093 INFO:teuthology.orchestra.run.smithi008.stdout: "duration": 4.7389999999999999e-06 2023-08-01T19:56:21.094 INFO:teuthology.orchestra.run.smithi008.stdout: }, 2023-08-01T19:56:21.094 INFO:teuthology.orchestra.run.smithi008.stdout: { 2023-08-01T19:56:21.094 INFO:teuthology.orchestra.run.smithi008.stdout: "event": "dispatched", 2023-08-01T19:56:21.094 INFO:teuthology.orchestra.run.smithi008.stdout: "time": "2023-08-01T19:55:58.554725+0000", 2023-08-01T19:56:21.094 INFO:teuthology.orchestra.run.smithi008.stdout: "duration": 7.9820000000000008e-06 2023-08-01T19:56:21.094 INFO:teuthology.orchestra.run.smithi008.stdout: }, 2023-08-01T19:56:21.094 INFO:teuthology.orchestra.run.smithi008.stdout: { 2023-08-01T19:56:21.094 INFO:teuthology.orchestra.run.smithi008.stdout: "event": "queued_for_pg", 2023-08-01T19:56:21.095 INFO:teuthology.orchestra.run.smithi008.stdout: "time": "2023-08-01T19:55:58.554730+0000", 2023-08-01T19:56:21.095 INFO:teuthology.orchestra.run.smithi008.stdout: "duration": 4.318e-06 2023-08-01T19:56:21.095 INFO:teuthology.orchestra.run.smithi008.stdout: }, 2023-08-01T19:56:21.095 INFO:teuthology.orchestra.run.smithi008.stdout: { 2023-08-01T19:56:21.095 INFO:teuthology.orchestra.run.smithi008.stdout: "event": "reached_pg", 2023-08-01T19:56:21.095 INFO:teuthology.orchestra.run.smithi008.stdout: "time": "2023-08-01T19:55:58.554767+0000", 2023-08-01T19:56:21.095 INFO:teuthology.orchestra.run.smithi008.stdout: "duration": 3.7778000000000003e-05 2023-08-01T19:56:21.096 INFO:teuthology.orchestra.run.smithi008.stdout: }, 2023-08-01T19:56:21.096 INFO:teuthology.orchestra.run.smithi008.stdout: { 2023-08-01T19:56:21.096 INFO:teuthology.orchestra.run.smithi008.stdout: "event": "started", 2023-08-01T19:56:21.096 INFO:teuthology.orchestra.run.smithi008.stdout: "time": "2023-08-01T19:55:58.554874+0000", 2023-08-01T19:56:21.096 INFO:teuthology.orchestra.run.smithi008.stdout: "duration": 0.000106613 2023-08-01T19:56:21.096 INFO:teuthology.orchestra.run.smithi008.stdout: }, 2023-08-01T19:56:21.097 INFO:teuthology.orchestra.run.smithi008.stdout: { 2023-08-01T19:56:21.097 INFO:teuthology.orchestra.run.smithi008.stdout: "event": "waiting for subops from 1", 2023-08-01T19:56:21.097 INFO:teuthology.orchestra.run.smithi008.stdout: "time": "2023-08-01T19:55:58.554941+0000", 2023-08-01T19:56:21.097 INFO:teuthology.orchestra.run.smithi008.stdout: "duration": 6.6569000000000006e-05 2023-08-01T19:56:21.097 INFO:teuthology.orchestra.run.smithi008.stdout: }, 2023-08-01T19:56:21.097 INFO:teuthology.orchestra.run.smithi008.stdout: { 2023-08-01T19:56:21.097 INFO:teuthology.orchestra.run.smithi008.stdout: "event": "reached_pg", 2023-08-01T19:56:21.097 INFO:teuthology.orchestra.run.smithi008.stdout: "time": "2023-08-01T19:55:58.569436+0000", 2023-08-01T19:56:21.098 INFO:teuthology.orchestra.run.smithi008.stdout: "duration": 0.014495413 2023-08-01T19:56:21.098 INFO:teuthology.orchestra.run.smithi008.stdout: }, 2023-08-01T19:56:21.098 INFO:teuthology.orchestra.run.smithi008.stdout: { 2023-08-01T19:56:21.098 INFO:teuthology.orchestra.run.smithi008.stdout: "event": "waiting for peered", 2023-08-01T19:56:21.098 INFO:teuthology.orchestra.run.smithi008.stdout: "time": "2023-08-01T19:55:58.569441+0000", 2023-08-01T19:56:21.098 INFO:teuthology.orchestra.run.smithi008.stdout: "duration": 5.1109999999999999e-06 2023-08-01T19:56:21.098 INFO:teuthology.orchestra.run.smithi008.stdout: }, 2023-08-01T19:56:21.098 INFO:teuthology.orchestra.run.smithi008.stdout: { 2023-08-01T19:56:21.099 INFO:teuthology.orchestra.run.smithi008.stdout: "event": "reached_pg", 2023-08-01T19:56:21.099 INFO:teuthology.orchestra.run.smithi008.stdout: "time": "2023-08-01T19:55:59.620748+0000", 2023-08-01T19:56:21.099 INFO:teuthology.orchestra.run.smithi008.stdout: "duration": 1.0513071810000001 2023-08-01T19:56:21.099 INFO:teuthology.orchestra.run.smithi008.stdout: }, 2023-08-01T19:56:21.099 INFO:teuthology.orchestra.run.smithi008.stdout: { 2023-08-01T19:56:21.099 INFO:teuthology.orchestra.run.smithi008.stdout: "event": "done", 2023-08-01T19:56:21.099 INFO:teuthology.orchestra.run.smithi008.stdout: "time": "2023-08-01T19:55:59.620846+0000", 2023-08-01T19:56:21.100 INFO:teuthology.orchestra.run.smithi008.stdout: "duration": 9.7739999999999996e-05 2023-08-01T19:56:21.100 INFO:teuthology.orchestra.run.smithi008.stdout: } 2023-08-01T19:56:21.100 INFO:teuthology.orchestra.run.smithi008.stdout: ] 2023-08-01T19:56:21.100 INFO:teuthology.orchestra.run.smithi008.stdout: } 2023-08-01T19:56:21.100 INFO:teuthology.orchestra.run.smithi008.stdout: }, 2023-08-01T19:56:21.100 INFO:teuthology.orchestra.run.smithi008.stdout: { 2023-08-01T19:56:21.100 INFO:teuthology.orchestra.run.smithi008.stdout: "description": "osd_op(client.4668.0:197400 5.c 5:30dad7f9:::benchmark_data_smithi006_114134_object63739:head [delete] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e61)", 2023-08-01T19:56:21.101 INFO:teuthology.orchestra.run.smithi008.stdout: "initiated_at": "2023-08-01T19:55:58.556576+0000", 2023-08-01T19:56:21.101 INFO:teuthology.orchestra.run.smithi008.stdout: "age": 22.442036421000001, 2023-08-01T19:56:21.101 INFO:teuthology.orchestra.run.smithi008.stdout: "duration": 1.062559968, 2023-08-01T19:56:21.101 INFO:teuthology.orchestra.run.smithi008.stdout: "type_data": { 2023-08-01T19:56:21.101 INFO:teuthology.orchestra.run.smithi008.stdout: "flag_point": "reached pg", 2023-08-01T19:56:21.101 INFO:teuthology.orchestra.run.smithi008.stdout: "client_info": { 2023-08-01T19:56:21.101 INFO:teuthology.orchestra.run.smithi008.stdout: "client": "client.4668", 2023-08-01T19:56:21.101 INFO:teuthology.orchestra.run.smithi008.stdout: "client_addr": "172.21.15.6:0/1709472247", 2023-08-01T19:56:21.102 INFO:teuthology.orchestra.run.smithi008.stdout: "tid": 197400 2023-08-01T19:56:21.102 INFO:teuthology.orchestra.run.smithi008.stdout: }, 2023-08-01T19:56:21.102 INFO:teuthology.orchestra.run.smithi008.stdout: "events": [ 2023-08-01T19:56:21.102 INFO:teuthology.orchestra.run.smithi008.stdout: { 2023-08-01T19:56:21.102 INFO:teuthology.orchestra.run.smithi008.stdout: "event": "initiated", 2023-08-01T19:56:21.102 INFO:teuthology.orchestra.run.smithi008.stdout: "time": "2023-08-01T19:55:58.556576+0000", 2023-08-01T19:56:21.102 INFO:teuthology.orchestra.run.smithi008.stdout: "duration": 0 2023-08-01T19:56:21.102 INFO:teuthology.orchestra.run.smithi008.stdout: }, 2023-08-01T19:56:21.103 INFO:teuthology.orchestra.run.smithi008.stdout: { 2023-08-01T19:56:21.103 INFO:teuthology.orchestra.run.smithi008.stdout: "event": "throttled", 2023-08-01T19:56:21.103 INFO:teuthology.orchestra.run.smithi008.stdout: "time": "2023-08-01T19:55:58.556576+0000", 2023-08-01T19:56:21.103 INFO:teuthology.orchestra.run.smithi008.stdout: "duration": 0 2023-08-01T19:56:21.103 INFO:teuthology.orchestra.run.smithi008.stdout: }, 2023-08-01T19:56:21.103 INFO:teuthology.orchestra.run.smithi008.stdout: { 2023-08-01T19:56:21.103 INFO:teuthology.orchestra.run.smithi008.stdout: "event": "header_read", 2023-08-01T19:56:21.104 INFO:teuthology.orchestra.run.smithi008.stdout: "time": "2023-08-01T19:55:58.556575+0000", 2023-08-01T19:56:21.104 INFO:teuthology.orchestra.run.smithi008.stdout: "duration": 4294967295.999999 2023-08-01T19:56:21.104 INFO:teuthology.orchestra.run.smithi008.stdout: }, 2023-08-01T19:56:21.104 INFO:teuthology.orchestra.run.smithi008.stdout: { 2023-08-01T19:56:21.104 INFO:teuthology.orchestra.run.smithi008.stdout: "event": "all_read", 2023-08-01T19:56:21.104 INFO:teuthology.orchestra.run.smithi008.stdout: "time": "2023-08-01T19:55:58.556580+0000", 2023-08-01T19:56:21.104 INFO:teuthology.orchestra.run.smithi008.stdout: "duration": 4.2860000000000001e-06 2023-08-01T19:56:21.105 INFO:teuthology.orchestra.run.smithi008.stdout: }, 2023-08-01T19:56:21.105 INFO:teuthology.orchestra.run.smithi008.stdout: { 2023-08-01T19:56:21.105 INFO:teuthology.orchestra.run.smithi008.stdout: "event": "dispatched", 2023-08-01T19:56:21.105 INFO:teuthology.orchestra.run.smithi008.stdout: "time": "2023-08-01T19:55:58.556589+0000", 2023-08-01T19:56:21.105 INFO:teuthology.orchestra.run.smithi008.stdout: "duration": 9.6500000000000008e-06 2023-08-01T19:56:21.105 INFO:teuthology.orchestra.run.smithi008.stdout: }, 2023-08-01T19:56:21.105 INFO:teuthology.orchestra.run.smithi008.stdout: { 2023-08-01T19:56:21.105 INFO:teuthology.orchestra.run.smithi008.stdout: "event": "queued_for_pg", 2023-08-01T19:56:21.106 INFO:teuthology.orchestra.run.smithi008.stdout: "time": "2023-08-01T19:55:58.556596+0000", 2023-08-01T19:56:21.106 INFO:teuthology.orchestra.run.smithi008.stdout: "duration": 6.1430000000000003e-06 2023-08-01T19:56:21.106 INFO:teuthology.orchestra.run.smithi008.stdout: }, 2023-08-01T19:56:21.106 INFO:teuthology.orchestra.run.smithi008.stdout: { 2023-08-01T19:56:21.106 INFO:teuthology.orchestra.run.smithi008.stdout: "event": "reached_pg", 2023-08-01T19:56:21.106 INFO:teuthology.orchestra.run.smithi008.stdout: "time": "2023-08-01T19:55:58.556634+0000", 2023-08-01T19:56:21.106 INFO:teuthology.orchestra.run.smithi008.stdout: "duration": 3.8080000000000001e-05 2023-08-01T19:56:21.106 INFO:teuthology.orchestra.run.smithi008.stdout: }, 2023-08-01T19:56:21.107 INFO:teuthology.orchestra.run.smithi008.stdout: { 2023-08-01T19:56:21.107 INFO:teuthology.orchestra.run.smithi008.stdout: "event": "started", 2023-08-01T19:56:21.107 INFO:teuthology.orchestra.run.smithi008.stdout: "time": "2023-08-01T19:55:58.556754+0000", 2023-08-01T19:56:21.107 INFO:teuthology.orchestra.run.smithi008.stdout: "duration": 0.000120444 2023-08-01T19:56:21.107 INFO:teuthology.orchestra.run.smithi008.stdout: }, 2023-08-01T19:56:21.107 INFO:teuthology.orchestra.run.smithi008.stdout: { 2023-08-01T19:56:21.108 INFO:teuthology.orchestra.run.smithi008.stdout: "event": "waiting for subops from 1", 2023-08-01T19:56:21.108 INFO:teuthology.orchestra.run.smithi008.stdout: "time": "2023-08-01T19:55:58.556875+0000", 2023-08-01T19:56:21.108 INFO:teuthology.orchestra.run.smithi008.stdout: "duration": 0.00012100900000000001 2023-08-01T19:56:21.108 INFO:teuthology.orchestra.run.smithi008.stdout: }, 2023-08-01T19:56:21.108 INFO:teuthology.orchestra.run.smithi008.stdout: { 2023-08-01T19:56:21.108 INFO:teuthology.orchestra.run.smithi008.stdout: "event": "reached_pg", 2023-08-01T19:56:21.108 INFO:teuthology.orchestra.run.smithi008.stdout: "time": "2023-08-01T19:55:58.567406+0000", 2023-08-01T19:56:21.108 INFO:teuthology.orchestra.run.smithi008.stdout: "duration": 0.010531351 2023-08-01T19:56:21.109 INFO:teuthology.orchestra.run.smithi008.stdout: }, 2023-08-01T19:56:21.109 INFO:teuthology.orchestra.run.smithi008.stdout: { 2023-08-01T19:56:21.109 INFO:teuthology.orchestra.run.smithi008.stdout: "event": "waiting for peered", 2023-08-01T19:56:21.109 INFO:teuthology.orchestra.run.smithi008.stdout: "time": "2023-08-01T19:55:58.567414+0000", 2023-08-01T19:56:21.109 INFO:teuthology.orchestra.run.smithi008.stdout: "duration": 7.9189999999999999e-06 2023-08-01T19:56:21.109 INFO:teuthology.orchestra.run.smithi008.stdout: }, 2023-08-01T19:56:21.109 INFO:teuthology.orchestra.run.smithi008.stdout: { 2023-08-01T19:56:21.109 INFO:teuthology.orchestra.run.smithi008.stdout: "event": "reached_pg", 2023-08-01T19:56:21.110 INFO:teuthology.orchestra.run.smithi008.stdout: "time": "2023-08-01T19:55:59.619054+0000", 2023-08-01T19:56:21.110 INFO:teuthology.orchestra.run.smithi008.stdout: "duration": 1.0516396269999999 2023-08-01T19:56:21.110 INFO:teuthology.orchestra.run.smithi008.stdout: }, 2023-08-01T19:56:21.110 INFO:teuthology.orchestra.run.smithi008.stdout: { 2023-08-01T19:56:21.110 INFO:teuthology.orchestra.run.smithi008.stdout: "event": "done", 2023-08-01T19:56:21.110 INFO:teuthology.orchestra.run.smithi008.stdout: "time": "2023-08-01T19:55:59.619136+0000", 2023-08-01T19:56:21.110 INFO:teuthology.orchestra.run.smithi008.stdout: "duration": 8.2208999999999998e-05 2023-08-01T19:56:21.110 INFO:teuthology.orchestra.run.smithi008.stdout: } 2023-08-01T19:56:21.111 INFO:teuthology.orchestra.run.smithi008.stdout: ] 2023-08-01T19:56:21.111 INFO:teuthology.orchestra.run.smithi008.stdout: } 2023-08-01T19:56:21.111 INFO:teuthology.orchestra.run.smithi008.stdout: }, 2023-08-01T19:56:21.111 INFO:teuthology.orchestra.run.smithi008.stdout: { 2023-08-01T19:56:21.111 INFO:teuthology.orchestra.run.smithi008.stdout: "description": "osd_op(client.4668.0:197401 5.1 5:88b38567:::benchmark_data_smithi006_114134_object63740:head [delete] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e61)", 2023-08-01T19:56:21.111 INFO:teuthology.orchestra.run.smithi008.stdout: "initiated_at": "2023-08-01T19:55:58.556607+0000", 2023-08-01T19:56:21.111 INFO:teuthology.orchestra.run.smithi008.stdout: "age": 22.442005996999999, 2023-08-01T19:56:21.112 INFO:teuthology.orchestra.run.smithi008.stdout: "duration": 1.0643254870000001, 2023-08-01T19:56:21.112 INFO:teuthology.orchestra.run.smithi008.stdout: "type_data": { 2023-08-01T19:56:21.112 INFO:teuthology.orchestra.run.smithi008.stdout: "flag_point": "reached pg", 2023-08-01T19:56:21.112 INFO:teuthology.orchestra.run.smithi008.stdout: "client_info": { 2023-08-01T19:56:21.112 INFO:teuthology.orchestra.run.smithi008.stdout: "client": "client.4668", 2023-08-01T19:56:21.112 INFO:teuthology.orchestra.run.smithi008.stdout: "client_addr": "172.21.15.6:0/1709472247", 2023-08-01T19:56:21.112 INFO:teuthology.orchestra.run.smithi008.stdout: "tid": 197401 2023-08-01T19:56:21.112 INFO:teuthology.orchestra.run.smithi008.stdout: }, 2023-08-01T19:56:21.113 INFO:teuthology.orchestra.run.smithi008.stdout: "events": [ 2023-08-01T19:56:21.113 INFO:teuthology.orchestra.run.smithi008.stdout: { 2023-08-01T19:56:21.113 INFO:teuthology.orchestra.run.smithi008.stdout: "event": "initiated", 2023-08-01T19:56:21.113 INFO:teuthology.orchestra.run.smithi008.stdout: "time": "2023-08-01T19:55:58.556607+0000", 2023-08-01T19:56:21.113 INFO:teuthology.orchestra.run.smithi008.stdout: "duration": 0 2023-08-01T19:56:21.113 INFO:teuthology.orchestra.run.smithi008.stdout: }, 2023-08-01T19:56:21.113 INFO:teuthology.orchestra.run.smithi008.stdout: { 2023-08-01T19:56:21.113 INFO:teuthology.orchestra.run.smithi008.stdout: "event": "throttled", 2023-08-01T19:56:21.114 INFO:teuthology.orchestra.run.smithi008.stdout: "time": "2023-08-01T19:55:58.556607+0000", 2023-08-01T19:56:21.114 INFO:teuthology.orchestra.run.smithi008.stdout: "duration": 0 2023-08-01T19:56:21.114 INFO:teuthology.orchestra.run.smithi008.stdout: }, 2023-08-01T19:56:21.114 INFO:teuthology.orchestra.run.smithi008.stdout: { 2023-08-01T19:56:21.114 INFO:teuthology.orchestra.run.smithi008.stdout: "event": "header_read", 2023-08-01T19:56:21.114 INFO:teuthology.orchestra.run.smithi008.stdout: "time": "2023-08-01T19:55:58.556606+0000", 2023-08-01T19:56:21.114 INFO:teuthology.orchestra.run.smithi008.stdout: "duration": 4294967295.9999995 2023-08-01T19:56:21.114 INFO:teuthology.orchestra.run.smithi008.stdout: }, 2023-08-01T19:56:21.115 INFO:teuthology.orchestra.run.smithi008.stdout: { 2023-08-01T19:56:21.115 INFO:teuthology.orchestra.run.smithi008.stdout: "event": "all_read", 2023-08-01T19:56:21.115 INFO:teuthology.orchestra.run.smithi008.stdout: "time": "2023-08-01T19:55:58.556609+0000", 2023-08-01T19:56:21.115 INFO:teuthology.orchestra.run.smithi008.stdout: "duration": 3.1750000000000001e-06 2023-08-01T19:56:21.115 INFO:teuthology.orchestra.run.smithi008.stdout: }, 2023-08-01T19:56:21.115 INFO:teuthology.orchestra.run.smithi008.stdout: { 2023-08-01T19:56:21.115 INFO:teuthology.orchestra.run.smithi008.stdout: "event": "dispatched", 2023-08-01T19:56:21.115 INFO:teuthology.orchestra.run.smithi008.stdout: "time": "2023-08-01T19:55:58.556617+0000", 2023-08-01T19:56:21.116 INFO:teuthology.orchestra.run.smithi008.stdout: "duration": 7.2760000000000003e-06 2023-08-01T19:56:21.116 INFO:teuthology.orchestra.run.smithi008.stdout: }, 2023-08-01T19:56:21.116 INFO:teuthology.orchestra.run.smithi008.stdout: { 2023-08-01T19:56:21.116 INFO:teuthology.orchestra.run.smithi008.stdout: "event": "queued_for_pg", 2023-08-01T19:56:21.116 INFO:teuthology.orchestra.run.smithi008.stdout: "time": "2023-08-01T19:55:58.556621+0000", 2023-08-01T19:56:21.116 INFO:teuthology.orchestra.run.smithi008.stdout: "duration": 4.8219999999999997e-06 2023-08-01T19:56:21.116 INFO:teuthology.orchestra.run.smithi008.stdout: }, 2023-08-01T19:56:21.117 INFO:teuthology.orchestra.run.smithi008.stdout: { 2023-08-01T19:56:21.117 INFO:teuthology.orchestra.run.smithi008.stdout: "event": "reached_pg", 2023-08-01T19:56:21.117 INFO:teuthology.orchestra.run.smithi008.stdout: "time": "2023-08-01T19:55:58.556651+0000", 2023-08-01T19:56:21.117 INFO:teuthology.orchestra.run.smithi008.stdout: "duration": 2.9921999999999999e-05 2023-08-01T19:56:21.117 INFO:teuthology.orchestra.run.smithi008.stdout: }, 2023-08-01T19:56:21.117 INFO:teuthology.orchestra.run.smithi008.stdout: { 2023-08-01T19:56:21.117 INFO:teuthology.orchestra.run.smithi008.stdout: "event": "started", 2023-08-01T19:56:21.117 INFO:teuthology.orchestra.run.smithi008.stdout: "time": "2023-08-01T19:55:58.556755+0000", 2023-08-01T19:56:21.118 INFO:teuthology.orchestra.run.smithi008.stdout: "duration": 0.000103309 2023-08-01T19:56:21.118 INFO:teuthology.orchestra.run.smithi008.stdout: }, 2023-08-01T19:56:21.118 INFO:teuthology.orchestra.run.smithi008.stdout: { 2023-08-01T19:56:21.118 INFO:teuthology.orchestra.run.smithi008.stdout: "event": "waiting for subops from 1", 2023-08-01T19:56:21.118 INFO:teuthology.orchestra.run.smithi008.stdout: "time": "2023-08-01T19:55:58.556875+0000", 2023-08-01T19:56:21.118 INFO:teuthology.orchestra.run.smithi008.stdout: "duration": 0.000120424 2023-08-01T19:56:21.118 INFO:teuthology.orchestra.run.smithi008.stdout: }, 2023-08-01T19:56:21.118 INFO:teuthology.orchestra.run.smithi008.stdout: { 2023-08-01T19:56:21.119 INFO:teuthology.orchestra.run.smithi008.stdout: "event": "reached_pg", 2023-08-01T19:56:21.119 INFO:teuthology.orchestra.run.smithi008.stdout: "time": "2023-08-01T19:55:58.569459+0000", 2023-08-01T19:56:21.119 INFO:teuthology.orchestra.run.smithi008.stdout: "duration": 0.012583776 2023-08-01T19:56:21.119 INFO:teuthology.orchestra.run.smithi008.stdout: }, 2023-08-01T19:56:21.119 INFO:teuthology.orchestra.run.smithi008.stdout: { 2023-08-01T19:56:21.119 INFO:teuthology.orchestra.run.smithi008.stdout: "event": "waiting for peered", 2023-08-01T19:56:21.119 INFO:teuthology.orchestra.run.smithi008.stdout: "time": "2023-08-01T19:55:58.569462+0000", 2023-08-01T19:56:21.119 INFO:teuthology.orchestra.run.smithi008.stdout: "duration": 2.74e-06 2023-08-01T19:56:21.120 INFO:teuthology.orchestra.run.smithi008.stdout: }, 2023-08-01T19:56:21.120 INFO:teuthology.orchestra.run.smithi008.stdout: { 2023-08-01T19:56:21.120 INFO:teuthology.orchestra.run.smithi008.stdout: "event": "reached_pg", 2023-08-01T19:56:21.120 INFO:teuthology.orchestra.run.smithi008.stdout: "time": "2023-08-01T19:55:59.620880+0000", 2023-08-01T19:56:21.120 INFO:teuthology.orchestra.run.smithi008.stdout: "duration": 1.0514181279999999 2023-08-01T19:56:21.120 INFO:teuthology.orchestra.run.smithi008.stdout: }, 2023-08-01T19:56:21.120 INFO:teuthology.orchestra.run.smithi008.stdout: { 2023-08-01T19:56:21.120 INFO:teuthology.orchestra.run.smithi008.stdout: "event": "done", 2023-08-01T19:56:21.121 INFO:teuthology.orchestra.run.smithi008.stdout: "time": "2023-08-01T19:55:59.620932+0000", 2023-08-01T19:56:21.121 INFO:teuthology.orchestra.run.smithi008.stdout: "duration": 5.2404000000000002e-05 2023-08-01T19:56:21.121 INFO:teuthology.orchestra.run.smithi008.stdout: } 2023-08-01T19:56:21.121 INFO:teuthology.orchestra.run.smithi008.stdout: ] 2023-08-01T19:56:21.121 INFO:teuthology.orchestra.run.smithi008.stdout: } 2023-08-01T19:56:21.121 INFO:teuthology.orchestra.run.smithi008.stdout: }, 2023-08-01T19:56:21.121 INFO:teuthology.orchestra.run.smithi008.stdout: { 2023-08-01T19:56:21.122 INFO:teuthology.orchestra.run.smithi008.stdout: "description": "osd_op(client.4668.0:197402 5.c 5:3f057b78:::benchmark_data_smithi006_114134_object63741:head [delete] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e61)", 2023-08-01T19:56:21.122 INFO:teuthology.orchestra.run.smithi008.stdout: "initiated_at": "2023-08-01T19:55:58.556632+0000", 2023-08-01T19:56:21.122 INFO:teuthology.orchestra.run.smithi008.stdout: "age": 22.441980627, 2023-08-01T19:56:21.122 INFO:teuthology.orchestra.run.smithi008.stdout: "duration": 1.0625773970000001, 2023-08-01T19:56:21.122 INFO:teuthology.orchestra.run.smithi008.stdout: "type_data": { 2023-08-01T19:56:21.122 INFO:teuthology.orchestra.run.smithi008.stdout: "flag_point": "reached pg", 2023-08-01T19:56:21.122 INFO:teuthology.orchestra.run.smithi008.stdout: "client_info": { 2023-08-01T19:56:21.122 INFO:teuthology.orchestra.run.smithi008.stdout: "client": "client.4668", 2023-08-01T19:56:21.123 INFO:teuthology.orchestra.run.smithi008.stdout: "client_addr": "172.21.15.6:0/1709472247", 2023-08-01T19:56:21.123 INFO:teuthology.orchestra.run.smithi008.stdout: "tid": 197402 2023-08-01T19:56:21.123 INFO:teuthology.orchestra.run.smithi008.stdout: }, 2023-08-01T19:56:21.123 INFO:teuthology.orchestra.run.smithi008.stdout: "events": [ 2023-08-01T19:56:21.123 INFO:teuthology.orchestra.run.smithi008.stdout: { 2023-08-01T19:56:21.123 INFO:teuthology.orchestra.run.smithi008.stdout: "event": "initiated", 2023-08-01T19:56:21.123 INFO:teuthology.orchestra.run.smithi008.stdout: "time": "2023-08-01T19:55:58.556632+0000", 2023-08-01T19:56:21.123 INFO:teuthology.orchestra.run.smithi008.stdout: "duration": 0 2023-08-01T19:56:21.124 INFO:teuthology.orchestra.run.smithi008.stdout: }, 2023-08-01T19:56:21.124 INFO:teuthology.orchestra.run.smithi008.stdout: { 2023-08-01T19:56:21.124 INFO:teuthology.orchestra.run.smithi008.stdout: "event": "throttled", 2023-08-01T19:56:21.124 INFO:teuthology.orchestra.run.smithi008.stdout: "time": "2023-08-01T19:55:58.556632+0000", 2023-08-01T19:56:21.124 INFO:teuthology.orchestra.run.smithi008.stdout: "duration": 0 2023-08-01T19:56:21.124 INFO:teuthology.orchestra.run.smithi008.stdout: }, 2023-08-01T19:56:21.124 INFO:teuthology.orchestra.run.smithi008.stdout: { 2023-08-01T19:56:21.125 INFO:teuthology.orchestra.run.smithi008.stdout: "event": "header_read", 2023-08-01T19:56:21.125 INFO:teuthology.orchestra.run.smithi008.stdout: "time": "2023-08-01T19:55:58.556632+0000", 2023-08-01T19:56:21.125 INFO:teuthology.orchestra.run.smithi008.stdout: "duration": 4294967295.9999995 2023-08-01T19:56:21.125 INFO:teuthology.orchestra.run.smithi008.stdout: }, 2023-08-01T19:56:21.125 INFO:teuthology.orchestra.run.smithi008.stdout: { 2023-08-01T19:56:21.125 INFO:teuthology.orchestra.run.smithi008.stdout: "event": "all_read", 2023-08-01T19:56:21.125 INFO:teuthology.orchestra.run.smithi008.stdout: "time": "2023-08-01T19:55:58.556634+0000", 2023-08-01T19:56:21.126 INFO:teuthology.orchestra.run.smithi008.stdout: "duration": 2.8940000000000002e-06 2023-08-01T19:56:21.126 INFO:teuthology.orchestra.run.smithi008.stdout: }, 2023-08-01T19:56:21.126 INFO:teuthology.orchestra.run.smithi008.stdout: { 2023-08-01T19:56:21.126 INFO:teuthology.orchestra.run.smithi008.stdout: "event": "dispatched", 2023-08-01T19:56:21.126 INFO:teuthology.orchestra.run.smithi008.stdout: "time": "2023-08-01T19:55:58.556641+0000", 2023-08-01T19:56:21.126 INFO:teuthology.orchestra.run.smithi008.stdout: "duration": 6.8449999999999997e-06 2023-08-01T19:56:21.126 INFO:teuthology.orchestra.run.smithi008.stdout: }, 2023-08-01T19:56:21.126 INFO:teuthology.orchestra.run.smithi008.stdout: { 2023-08-01T19:56:21.127 INFO:teuthology.orchestra.run.smithi008.stdout: "event": "queued_for_pg", 2023-08-01T19:56:21.127 INFO:teuthology.orchestra.run.smithi008.stdout: "time": "2023-08-01T19:55:58.556646+0000", 2023-08-01T19:56:21.127 INFO:teuthology.orchestra.run.smithi008.stdout: "duration": 5.2070000000000003e-06 2023-08-01T19:56:21.127 INFO:teuthology.orchestra.run.smithi008.stdout: }, 2023-08-01T19:56:21.127 INFO:teuthology.orchestra.run.smithi008.stdout: { 2023-08-01T19:56:21.127 INFO:teuthology.orchestra.run.smithi008.stdout: "event": "reached_pg", 2023-08-01T19:56:21.127 INFO:teuthology.orchestra.run.smithi008.stdout: "time": "2023-08-01T19:55:58.558870+0000", 2023-08-01T19:56:21.127 INFO:teuthology.orchestra.run.smithi008.stdout: "duration": 0.0022237730000000001 2023-08-01T19:56:21.128 INFO:teuthology.orchestra.run.smithi008.stdout: }, 2023-08-01T19:56:21.128 INFO:teuthology.orchestra.run.smithi008.stdout: { 2023-08-01T19:56:21.128 INFO:teuthology.orchestra.run.smithi008.stdout: "event": "started", 2023-08-01T19:56:21.128 INFO:teuthology.orchestra.run.smithi008.stdout: "time": "2023-08-01T19:55:58.559013+0000", 2023-08-01T19:56:21.128 INFO:teuthology.orchestra.run.smithi008.stdout: "duration": 0.00014289899999999999 2023-08-01T19:56:21.128 INFO:teuthology.orchestra.run.smithi008.stdout: }, 2023-08-01T19:56:21.128 INFO:teuthology.orchestra.run.smithi008.stdout: { 2023-08-01T19:56:21.129 INFO:teuthology.orchestra.run.smithi008.stdout: "event": "waiting for subops from 1", 2023-08-01T19:56:21.129 INFO:teuthology.orchestra.run.smithi008.stdout: "time": "2023-08-01T19:55:58.559137+0000", 2023-08-01T19:56:21.129 INFO:teuthology.orchestra.run.smithi008.stdout: "duration": 0.00012428499999999999 2023-08-01T19:56:21.129 INFO:teuthology.orchestra.run.smithi008.stdout: }, 2023-08-01T19:56:21.129 INFO:teuthology.orchestra.run.smithi008.stdout: { 2023-08-01T19:56:21.129 INFO:teuthology.orchestra.run.smithi008.stdout: "event": "reached_pg", 2023-08-01T19:56:21.129 INFO:teuthology.orchestra.run.smithi008.stdout: "time": "2023-08-01T19:55:58.567438+0000", 2023-08-01T19:56:21.130 INFO:teuthology.orchestra.run.smithi008.stdout: "duration": 0.0083003190000000004 2023-08-01T19:56:21.130 INFO:teuthology.orchestra.run.smithi008.stdout: }, 2023-08-01T19:56:21.130 INFO:teuthology.orchestra.run.smithi008.stdout: { 2023-08-01T19:56:21.130 INFO:teuthology.orchestra.run.smithi008.stdout: "event": "waiting for peered", 2023-08-01T19:56:21.130 INFO:teuthology.orchestra.run.smithi008.stdout: "time": "2023-08-01T19:55:58.567443+0000", 2023-08-01T19:56:21.130 INFO:teuthology.orchestra.run.smithi008.stdout: "duration": 5.1739999999999999e-06 2023-08-01T19:56:21.130 INFO:teuthology.orchestra.run.smithi008.stdout: }, 2023-08-01T19:56:21.131 INFO:teuthology.orchestra.run.smithi008.stdout: { 2023-08-01T19:56:21.131 INFO:teuthology.orchestra.run.smithi008.stdout: "event": "reached_pg", 2023-08-01T19:56:21.131 INFO:teuthology.orchestra.run.smithi008.stdout: "time": "2023-08-01T19:55:59.619164+0000", 2023-08-01T19:56:21.131 INFO:teuthology.orchestra.run.smithi008.stdout: "duration": 1.0517206750000001 2023-08-01T19:56:21.131 INFO:teuthology.orchestra.run.smithi008.stdout: }, 2023-08-01T19:56:21.131 INFO:teuthology.orchestra.run.smithi008.stdout: { 2023-08-01T19:56:21.132 INFO:teuthology.orchestra.run.smithi008.stdout: "event": "done", 2023-08-01T19:56:21.132 INFO:teuthology.orchestra.run.smithi008.stdout: "time": "2023-08-01T19:55:59.619209+0000", 2023-08-01T19:56:21.132 INFO:teuthology.orchestra.run.smithi008.stdout: "duration": 4.5800000000000002e-05 2023-08-01T19:56:21.132 INFO:teuthology.orchestra.run.smithi008.stdout: } 2023-08-01T19:56:21.132 INFO:teuthology.orchestra.run.smithi008.stdout: ] 2023-08-01T19:56:21.132 INFO:teuthology.orchestra.run.smithi008.stdout: } 2023-08-01T19:56:21.132 INFO:teuthology.orchestra.run.smithi008.stdout: }, 2023-08-01T19:56:21.132 INFO:teuthology.orchestra.run.smithi008.stdout: { 2023-08-01T19:56:21.133 INFO:teuthology.orchestra.run.smithi008.stdout: "description": "osd_op(client.4668.0:197404 5.5 5:a3c9c1bd:::benchmark_data_smithi006_114134_object63743:head [delete] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e61)", 2023-08-01T19:56:21.133 INFO:teuthology.orchestra.run.smithi008.stdout: "initiated_at": "2023-08-01T19:55:58.556653+0000", 2023-08-01T19:56:21.133 INFO:teuthology.orchestra.run.smithi008.stdout: "age": 22.441959672999999, 2023-08-01T19:56:21.133 INFO:teuthology.orchestra.run.smithi008.stdout: "duration": 1.061865576, 2023-08-01T19:56:21.133 INFO:teuthology.orchestra.run.smithi008.stdout: "type_data": { 2023-08-01T19:56:21.133 INFO:teuthology.orchestra.run.smithi008.stdout: "flag_point": "reached pg", 2023-08-01T19:56:21.133 INFO:teuthology.orchestra.run.smithi008.stdout: "client_info": { 2023-08-01T19:56:21.134 INFO:teuthology.orchestra.run.smithi008.stdout: "client": "client.4668", 2023-08-01T19:56:21.134 INFO:teuthology.orchestra.run.smithi008.stdout: "client_addr": "172.21.15.6:0/1709472247", 2023-08-01T19:56:21.134 INFO:teuthology.orchestra.run.smithi008.stdout: "tid": 197404 2023-08-01T19:56:21.134 INFO:teuthology.orchestra.run.smithi008.stdout: }, 2023-08-01T19:56:21.134 INFO:teuthology.orchestra.run.smithi008.stdout: "events": [ 2023-08-01T19:56:21.134 INFO:teuthology.orchestra.run.smithi008.stdout: { 2023-08-01T19:56:21.134 INFO:teuthology.orchestra.run.smithi008.stdout: "event": "initiated", 2023-08-01T19:56:21.134 INFO:teuthology.orchestra.run.smithi008.stdout: "time": "2023-08-01T19:55:58.556653+0000", 2023-08-01T19:56:21.135 INFO:teuthology.orchestra.run.smithi008.stdout: "duration": 0 2023-08-01T19:56:21.135 INFO:teuthology.orchestra.run.smithi008.stdout: }, 2023-08-01T19:56:21.135 INFO:teuthology.orchestra.run.smithi008.stdout: { 2023-08-01T19:56:21.135 INFO:teuthology.orchestra.run.smithi008.stdout: "event": "throttled", 2023-08-01T19:56:21.135 INFO:teuthology.orchestra.run.smithi008.stdout: "time": "2023-08-01T19:55:58.556653+0000", 2023-08-01T19:56:21.135 INFO:teuthology.orchestra.run.smithi008.stdout: "duration": 0 2023-08-01T19:56:21.135 INFO:teuthology.orchestra.run.smithi008.stdout: }, 2023-08-01T19:56:21.135 INFO:teuthology.orchestra.run.smithi008.stdout: { 2023-08-01T19:56:21.136 INFO:teuthology.orchestra.run.smithi008.stdout: "event": "header_read", 2023-08-01T19:56:21.136 INFO:teuthology.orchestra.run.smithi008.stdout: "time": "2023-08-01T19:55:58.556653+0000", 2023-08-01T19:56:21.136 INFO:teuthology.orchestra.run.smithi008.stdout: "duration": 4294967295.9999995 2023-08-01T19:56:21.136 INFO:teuthology.orchestra.run.smithi008.stdout: }, 2023-08-01T19:56:21.136 INFO:teuthology.orchestra.run.smithi008.stdout: { 2023-08-01T19:56:21.136 INFO:teuthology.orchestra.run.smithi008.stdout: "event": "all_read", 2023-08-01T19:56:21.136 INFO:teuthology.orchestra.run.smithi008.stdout: "time": "2023-08-01T19:55:58.556655+0000", 2023-08-01T19:56:21.136 INFO:teuthology.orchestra.run.smithi008.stdout: "duration": 2.435e-06 2023-08-01T19:56:21.137 INFO:teuthology.orchestra.run.smithi008.stdout: }, 2023-08-01T19:56:21.137 INFO:teuthology.orchestra.run.smithi008.stdout: { 2023-08-01T19:56:21.137 INFO:teuthology.orchestra.run.smithi008.stdout: "event": "dispatched", 2023-08-01T19:56:21.137 INFO:teuthology.orchestra.run.smithi008.stdout: "time": "2023-08-01T19:55:58.556661+0000", 2023-08-01T19:56:21.137 INFO:teuthology.orchestra.run.smithi008.stdout: "duration": 6.0599999999999996e-06 2023-08-01T19:56:21.137 INFO:teuthology.orchestra.run.smithi008.stdout: }, 2023-08-01T19:56:21.137 INFO:teuthology.orchestra.run.smithi008.stdout: { 2023-08-01T19:56:21.138 INFO:teuthology.orchestra.run.smithi008.stdout: "event": "queued_for_pg", 2023-08-01T19:56:21.138 INFO:teuthology.orchestra.run.smithi008.stdout: "time": "2023-08-01T19:55:58.556666+0000", 2023-08-01T19:56:21.138 INFO:teuthology.orchestra.run.smithi008.stdout: "duration": 4.9620000000000001e-06 2023-08-01T19:56:21.138 INFO:teuthology.orchestra.run.smithi008.stdout: }, 2023-08-01T19:56:21.138 INFO:teuthology.orchestra.run.smithi008.stdout: { 2023-08-01T19:56:21.138 INFO:teuthology.orchestra.run.smithi008.stdout: "event": "reached_pg", 2023-08-01T19:56:21.138 INFO:teuthology.orchestra.run.smithi008.stdout: "time": "2023-08-01T19:55:58.556698+0000", 2023-08-01T19:56:21.138 INFO:teuthology.orchestra.run.smithi008.stdout: "duration": 3.2302999999999999e-05 2023-08-01T19:56:21.139 INFO:teuthology.orchestra.run.smithi008.stdout: }, 2023-08-01T19:56:21.139 INFO:teuthology.orchestra.run.smithi008.stdout: { 2023-08-01T19:56:21.139 INFO:teuthology.orchestra.run.smithi008.stdout: "event": "started", 2023-08-01T19:56:21.139 INFO:teuthology.orchestra.run.smithi008.stdout: "time": "2023-08-01T19:55:58.556773+0000", 2023-08-01T19:56:21.139 INFO:teuthology.orchestra.run.smithi008.stdout: "duration": 7.4431999999999995e-05 2023-08-01T19:56:21.139 INFO:teuthology.orchestra.run.smithi008.stdout: }, 2023-08-01T19:56:21.139 INFO:teuthology.orchestra.run.smithi008.stdout: { 2023-08-01T19:56:21.140 INFO:teuthology.orchestra.run.smithi008.stdout: "event": "waiting for subops from 1", 2023-08-01T19:56:21.140 INFO:teuthology.orchestra.run.smithi008.stdout: "time": "2023-08-01T19:55:58.556837+0000", 2023-08-01T19:56:21.140 INFO:teuthology.orchestra.run.smithi008.stdout: "duration": 6.4522000000000003e-05 2023-08-01T19:56:21.140 INFO:teuthology.orchestra.run.smithi008.stdout: }, 2023-08-01T19:56:21.140 INFO:teuthology.orchestra.run.smithi008.stdout: { 2023-08-01T19:56:21.140 INFO:teuthology.orchestra.run.smithi008.stdout: "event": "reached_pg", 2023-08-01T19:56:21.141 INFO:teuthology.orchestra.run.smithi008.stdout: "time": "2023-08-01T19:55:58.563930+0000", 2023-08-01T19:56:21.141 INFO:teuthology.orchestra.run.smithi008.stdout: "duration": 0.0070929030000000002 2023-08-01T19:56:21.141 INFO:teuthology.orchestra.run.smithi008.stdout: }, 2023-08-01T19:56:21.141 INFO:teuthology.orchestra.run.smithi008.stdout: { 2023-08-01T19:56:21.141 INFO:teuthology.orchestra.run.smithi008.stdout: "event": "waiting for peered", 2023-08-01T19:56:21.141 INFO:teuthology.orchestra.run.smithi008.stdout: "time": "2023-08-01T19:55:58.563939+0000", 2023-08-01T19:56:21.141 INFO:teuthology.orchestra.run.smithi008.stdout: "duration": 8.6079999999999996e-06 2023-08-01T19:56:21.141 INFO:teuthology.orchestra.run.smithi008.stdout: }, 2023-08-01T19:56:21.142 INFO:teuthology.orchestra.run.smithi008.stdout: { 2023-08-01T19:56:21.142 INFO:teuthology.orchestra.run.smithi008.stdout: "event": "reached_pg", 2023-08-01T19:56:21.142 INFO:teuthology.orchestra.run.smithi008.stdout: "time": "2023-08-01T19:55:59.618422+0000", 2023-08-01T19:56:21.142 INFO:teuthology.orchestra.run.smithi008.stdout: "duration": 1.054483295 2023-08-01T19:56:21.142 INFO:teuthology.orchestra.run.smithi008.stdout: }, 2023-08-01T19:56:21.142 INFO:teuthology.orchestra.run.smithi008.stdout: { 2023-08-01T19:56:21.142 INFO:teuthology.orchestra.run.smithi008.stdout: "event": "done", 2023-08-01T19:56:21.143 INFO:teuthology.orchestra.run.smithi008.stdout: "time": "2023-08-01T19:55:59.618519+0000", 2023-08-01T19:56:21.143 INFO:teuthology.orchestra.run.smithi008.stdout: "duration": 9.6471000000000005e-05 2023-08-01T19:56:21.143 INFO:teuthology.orchestra.run.smithi008.stdout: } 2023-08-01T19:56:21.143 INFO:teuthology.orchestra.run.smithi008.stdout: ] 2023-08-01T19:56:21.143 INFO:teuthology.orchestra.run.smithi008.stdout: } 2023-08-01T19:56:21.143 INFO:teuthology.orchestra.run.smithi008.stdout: }, 2023-08-01T19:56:21.143 INFO:teuthology.orchestra.run.smithi008.stdout: { 2023-08-01T19:56:21.143 INFO:teuthology.orchestra.run.smithi008.stdout: "description": "osd_op(client.4668.0:197407 5.1 5:85528fae:::benchmark_data_smithi006_114134_object63746:head [delete] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e61)", 2023-08-01T19:56:21.144 INFO:teuthology.orchestra.run.smithi008.stdout: "initiated_at": "2023-08-01T19:55:58.559216+0000", 2023-08-01T19:56:21.144 INFO:teuthology.orchestra.run.smithi008.stdout: "age": 22.439397025000002, 2023-08-01T19:56:21.144 INFO:teuthology.orchestra.run.smithi008.stdout: "duration": 1.061802277, 2023-08-01T19:56:21.144 INFO:teuthology.orchestra.run.smithi008.stdout: "type_data": { 2023-08-01T19:56:21.144 INFO:teuthology.orchestra.run.smithi008.stdout: "flag_point": "reached pg", 2023-08-01T19:56:21.144 INFO:teuthology.orchestra.run.smithi008.stdout: "client_info": { 2023-08-01T19:56:21.144 INFO:teuthology.orchestra.run.smithi008.stdout: "client": "client.4668", 2023-08-01T19:56:21.144 INFO:teuthology.orchestra.run.smithi008.stdout: "client_addr": "172.21.15.6:0/1709472247", 2023-08-01T19:56:21.145 INFO:teuthology.orchestra.run.smithi008.stdout: "tid": 197407 2023-08-01T19:56:21.145 INFO:teuthology.orchestra.run.smithi008.stdout: }, 2023-08-01T19:56:21.145 INFO:teuthology.orchestra.run.smithi008.stdout: "events": [ 2023-08-01T19:56:21.145 INFO:teuthology.orchestra.run.smithi008.stdout: { 2023-08-01T19:56:21.145 INFO:teuthology.orchestra.run.smithi008.stdout: "event": "initiated", 2023-08-01T19:56:21.145 INFO:teuthology.orchestra.run.smithi008.stdout: "time": "2023-08-01T19:55:58.559216+0000", 2023-08-01T19:56:21.145 INFO:teuthology.orchestra.run.smithi008.stdout: "duration": 0 2023-08-01T19:56:21.145 INFO:teuthology.orchestra.run.smithi008.stdout: }, 2023-08-01T19:56:21.146 INFO:teuthology.orchestra.run.smithi008.stdout: { 2023-08-01T19:56:21.146 INFO:teuthology.orchestra.run.smithi008.stdout: "event": "throttled", 2023-08-01T19:56:21.146 INFO:teuthology.orchestra.run.smithi008.stdout: "time": "2023-08-01T19:55:58.559216+0000", 2023-08-01T19:56:21.146 INFO:teuthology.orchestra.run.smithi008.stdout: "duration": 0 2023-08-01T19:56:21.146 INFO:teuthology.orchestra.run.smithi008.stdout: }, 2023-08-01T19:56:21.146 INFO:teuthology.orchestra.run.smithi008.stdout: { 2023-08-01T19:56:21.146 INFO:teuthology.orchestra.run.smithi008.stdout: "event": "header_read", 2023-08-01T19:56:21.146 INFO:teuthology.orchestra.run.smithi008.stdout: "time": "2023-08-01T19:55:58.559215+0000", 2023-08-01T19:56:21.147 INFO:teuthology.orchestra.run.smithi008.stdout: "duration": 4294967295.999999 2023-08-01T19:56:21.147 INFO:teuthology.orchestra.run.smithi008.stdout: }, 2023-08-01T19:56:21.147 INFO:teuthology.orchestra.run.smithi008.stdout: { 2023-08-01T19:56:21.147 INFO:teuthology.orchestra.run.smithi008.stdout: "event": "all_read", 2023-08-01T19:56:21.147 INFO:teuthology.orchestra.run.smithi008.stdout: "time": "2023-08-01T19:55:58.559220+0000", 2023-08-01T19:56:21.147 INFO:teuthology.orchestra.run.smithi008.stdout: "duration": 5.3879999999999999e-06 2023-08-01T19:56:21.147 INFO:teuthology.orchestra.run.smithi008.stdout: }, 2023-08-01T19:56:21.147 INFO:teuthology.orchestra.run.smithi008.stdout: { 2023-08-01T19:56:21.148 INFO:teuthology.orchestra.run.smithi008.stdout: "event": "dispatched", 2023-08-01T19:56:21.148 INFO:teuthology.orchestra.run.smithi008.stdout: "time": "2023-08-01T19:55:58.559230+0000", 2023-08-01T19:56:21.148 INFO:teuthology.orchestra.run.smithi008.stdout: "duration": 9.6590000000000002e-06 2023-08-01T19:56:21.148 INFO:teuthology.orchestra.run.smithi008.stdout: }, 2023-08-01T19:56:21.148 INFO:teuthology.orchestra.run.smithi008.stdout: { 2023-08-01T19:56:21.148 INFO:teuthology.orchestra.run.smithi008.stdout: "event": "queued_for_pg", 2023-08-01T19:56:21.148 INFO:teuthology.orchestra.run.smithi008.stdout: "time": "2023-08-01T19:55:58.559235+0000", 2023-08-01T19:56:21.149 INFO:teuthology.orchestra.run.smithi008.stdout: "duration": 5.575e-06 2023-08-01T19:56:21.149 INFO:teuthology.orchestra.run.smithi008.stdout: }, 2023-08-01T19:56:21.149 INFO:teuthology.orchestra.run.smithi008.stdout: { 2023-08-01T19:56:21.149 INFO:teuthology.orchestra.run.smithi008.stdout: "event": "reached_pg", 2023-08-01T19:56:21.149 INFO:teuthology.orchestra.run.smithi008.stdout: "time": "2023-08-01T19:55:58.559279+0000", 2023-08-01T19:56:21.149 INFO:teuthology.orchestra.run.smithi008.stdout: "duration": 4.3273999999999999e-05 2023-08-01T19:56:21.149 INFO:teuthology.orchestra.run.smithi008.stdout: }, 2023-08-01T19:56:21.149 INFO:teuthology.orchestra.run.smithi008.stdout: { 2023-08-01T19:56:21.150 INFO:teuthology.orchestra.run.smithi008.stdout: "event": "started", 2023-08-01T19:56:21.150 INFO:teuthology.orchestra.run.smithi008.stdout: "time": "2023-08-01T19:55:58.559403+0000", 2023-08-01T19:56:21.150 INFO:teuthology.orchestra.run.smithi008.stdout: "duration": 0.000124781 2023-08-01T19:56:21.150 INFO:teuthology.orchestra.run.smithi008.stdout: }, 2023-08-01T19:56:21.150 INFO:teuthology.orchestra.run.smithi008.stdout: { 2023-08-01T19:56:21.150 INFO:teuthology.orchestra.run.smithi008.stdout: "event": "waiting for subops from 1", 2023-08-01T19:56:21.150 INFO:teuthology.orchestra.run.smithi008.stdout: "time": "2023-08-01T19:55:58.559561+0000", 2023-08-01T19:56:21.151 INFO:teuthology.orchestra.run.smithi008.stdout: "duration": 0.000157773 2023-08-01T19:56:21.151 INFO:teuthology.orchestra.run.smithi008.stdout: }, 2023-08-01T19:56:21.151 INFO:teuthology.orchestra.run.smithi008.stdout: { 2023-08-01T19:56:21.151 INFO:teuthology.orchestra.run.smithi008.stdout: "event": "reached_pg", 2023-08-01T19:56:21.151 INFO:teuthology.orchestra.run.smithi008.stdout: "time": "2023-08-01T19:55:58.569498+0000", 2023-08-01T19:56:21.151 INFO:teuthology.orchestra.run.smithi008.stdout: "duration": 0.0099367069999999995 2023-08-01T19:56:21.151 INFO:teuthology.orchestra.run.smithi008.stdout: }, 2023-08-01T19:56:21.152 INFO:teuthology.orchestra.run.smithi008.stdout: { 2023-08-01T19:56:21.152 INFO:teuthology.orchestra.run.smithi008.stdout: "event": "waiting for peered", 2023-08-01T19:56:21.152 INFO:teuthology.orchestra.run.smithi008.stdout: "time": "2023-08-01T19:55:58.569756+0000", 2023-08-01T19:56:21.152 INFO:teuthology.orchestra.run.smithi008.stdout: "duration": 0.00025830800000000001 2023-08-01T19:56:21.152 INFO:teuthology.orchestra.run.smithi008.stdout: }, 2023-08-01T19:56:21.152 INFO:teuthology.orchestra.run.smithi008.stdout: { 2023-08-01T19:56:21.152 INFO:teuthology.orchestra.run.smithi008.stdout: "event": "reached_pg", 2023-08-01T19:56:21.152 INFO:teuthology.orchestra.run.smithi008.stdout: "time": "2023-08-01T19:55:59.620962+0000", 2023-08-01T19:56:21.153 INFO:teuthology.orchestra.run.smithi008.stdout: "duration": 1.0512062129999999 2023-08-01T19:56:21.153 INFO:teuthology.orchestra.run.smithi008.stdout: }, 2023-08-01T19:56:21.153 INFO:teuthology.orchestra.run.smithi008.stdout: { 2023-08-01T19:56:21.153 INFO:teuthology.orchestra.run.smithi008.stdout: "event": "done", 2023-08-01T19:56:21.153 INFO:teuthology.orchestra.run.smithi008.stdout: "time": "2023-08-01T19:55:59.621018+0000", 2023-08-01T19:56:21.153 INFO:teuthology.orchestra.run.smithi008.stdout: "duration": 5.5498999999999998e-05 2023-08-01T19:56:21.153 INFO:teuthology.orchestra.run.smithi008.stdout: } 2023-08-01T19:56:21.153 INFO:teuthology.orchestra.run.smithi008.stdout: ] 2023-08-01T19:56:21.154 INFO:teuthology.orchestra.run.smithi008.stdout: } 2023-08-01T19:56:21.154 INFO:teuthology.orchestra.run.smithi008.stdout: }, 2023-08-01T19:56:21.154 INFO:teuthology.orchestra.run.smithi008.stdout: { 2023-08-01T19:56:21.154 INFO:teuthology.orchestra.run.smithi008.stdout: "description": "osd_op(client.4668.0:197396 5.2 5:43f8487b:::benchmark_data_smithi006_114134_object63735:head [delete] snapc 0=[] RETRY=1 ondisk+retry+write+known_if_redirected+supports_pool_eio e62)", 2023-08-01T19:56:21.154 INFO:teuthology.orchestra.run.smithi008.stdout: "initiated_at": "2023-08-01T19:55:58.564585+0000", 2023-08-01T19:56:21.154 INFO:teuthology.orchestra.run.smithi008.stdout: "age": 22.434028050999999, 2023-08-01T19:56:21.155 INFO:teuthology.orchestra.run.smithi008.stdout: "duration": 1.0535085049999999, 2023-08-01T19:56:21.155 INFO:teuthology.orchestra.run.smithi008.stdout: "type_data": { 2023-08-01T19:56:21.155 INFO:teuthology.orchestra.run.smithi008.stdout: "flag_point": "reached pg", 2023-08-01T19:56:21.155 INFO:teuthology.orchestra.run.smithi008.stdout: "client_info": { 2023-08-01T19:56:21.155 INFO:teuthology.orchestra.run.smithi008.stdout: "client": "client.4668", 2023-08-01T19:56:21.155 INFO:teuthology.orchestra.run.smithi008.stdout: "client_addr": "172.21.15.6:0/1709472247", 2023-08-01T19:56:21.156 INFO:teuthology.orchestra.run.smithi008.stdout: "tid": 197396 2023-08-01T19:56:21.156 INFO:teuthology.orchestra.run.smithi008.stdout: }, 2023-08-01T19:56:21.156 INFO:teuthology.orchestra.run.smithi008.stdout: "events": [ 2023-08-01T19:56:21.156 INFO:teuthology.orchestra.run.smithi008.stdout: { 2023-08-01T19:56:21.156 INFO:teuthology.orchestra.run.smithi008.stdout: "event": "initiated", 2023-08-01T19:56:21.156 INFO:teuthology.orchestra.run.smithi008.stdout: "time": "2023-08-01T19:55:58.564585+0000", 2023-08-01T19:56:21.156 INFO:teuthology.orchestra.run.smithi008.stdout: "duration": 0 2023-08-01T19:56:21.157 INFO:teuthology.orchestra.run.smithi008.stdout: }, 2023-08-01T19:56:21.157 INFO:teuthology.orchestra.run.smithi008.stdout: { 2023-08-01T19:56:21.157 INFO:teuthology.orchestra.run.smithi008.stdout: "event": "throttled", 2023-08-01T19:56:21.157 INFO:teuthology.orchestra.run.smithi008.stdout: "time": "2023-08-01T19:55:58.564585+0000", 2023-08-01T19:56:21.157 INFO:teuthology.orchestra.run.smithi008.stdout: "duration": 0 2023-08-01T19:56:21.157 INFO:teuthology.orchestra.run.smithi008.stdout: }, 2023-08-01T19:56:21.157 INFO:teuthology.orchestra.run.smithi008.stdout: { 2023-08-01T19:56:21.158 INFO:teuthology.orchestra.run.smithi008.stdout: "event": "header_read", 2023-08-01T19:56:21.158 INFO:teuthology.orchestra.run.smithi008.stdout: "time": "2023-08-01T19:55:58.564583+0000", 2023-08-01T19:56:21.158 INFO:teuthology.orchestra.run.smithi008.stdout: "duration": 4294967295.9999981 2023-08-01T19:56:21.158 INFO:teuthology.orchestra.run.smithi008.stdout: }, 2023-08-01T19:56:21.158 INFO:teuthology.orchestra.run.smithi008.stdout: { 2023-08-01T19:56:21.158 INFO:teuthology.orchestra.run.smithi008.stdout: "event": "all_read", 2023-08-01T19:56:21.158 INFO:teuthology.orchestra.run.smithi008.stdout: "time": "2023-08-01T19:55:58.564591+0000", 2023-08-01T19:56:21.158 INFO:teuthology.orchestra.run.smithi008.stdout: "duration": 8.2169999999999994e-06 2023-08-01T19:56:21.159 INFO:teuthology.orchestra.run.smithi008.stdout: }, 2023-08-01T19:56:21.159 INFO:teuthology.orchestra.run.smithi008.stdout: { 2023-08-01T19:56:21.159 INFO:teuthology.orchestra.run.smithi008.stdout: "event": "dispatched", 2023-08-01T19:56:21.159 INFO:teuthology.orchestra.run.smithi008.stdout: "time": "2023-08-01T19:55:58.564603+0000", 2023-08-01T19:56:21.159 INFO:teuthology.orchestra.run.smithi008.stdout: "duration": 1.186e-05 2023-08-01T19:56:21.159 INFO:teuthology.orchestra.run.smithi008.stdout: }, 2023-08-01T19:56:21.159 INFO:teuthology.orchestra.run.smithi008.stdout: { 2023-08-01T19:56:21.160 INFO:teuthology.orchestra.run.smithi008.stdout: "event": "queued_for_pg", 2023-08-01T19:56:21.160 INFO:teuthology.orchestra.run.smithi008.stdout: "time": "2023-08-01T19:55:58.564609+0000", 2023-08-01T19:56:21.160 INFO:teuthology.orchestra.run.smithi008.stdout: "duration": 6.4130000000000003e-06 2023-08-01T19:56:21.160 INFO:teuthology.orchestra.run.smithi008.stdout: }, 2023-08-01T19:56:21.160 INFO:teuthology.orchestra.run.smithi008.stdout: { 2023-08-01T19:56:21.160 INFO:teuthology.orchestra.run.smithi008.stdout: "event": "reached_pg", 2023-08-01T19:56:21.160 INFO:teuthology.orchestra.run.smithi008.stdout: "time": "2023-08-01T19:55:58.573439+0000", 2023-08-01T19:56:21.161 INFO:teuthology.orchestra.run.smithi008.stdout: "duration": 0.0088303310000000003 2023-08-01T19:56:21.161 INFO:teuthology.orchestra.run.smithi008.stdout: }, 2023-08-01T19:56:21.161 INFO:teuthology.orchestra.run.smithi008.stdout: { 2023-08-01T19:56:21.161 INFO:teuthology.orchestra.run.smithi008.stdout: "event": "waiting for peered", 2023-08-01T19:56:21.161 INFO:teuthology.orchestra.run.smithi008.stdout: "time": "2023-08-01T19:55:58.573448+0000", 2023-08-01T19:56:21.161 INFO:teuthology.orchestra.run.smithi008.stdout: "duration": 8.2910000000000007e-06 2023-08-01T19:56:21.161 INFO:teuthology.orchestra.run.smithi008.stdout: }, 2023-08-01T19:56:21.161 INFO:teuthology.orchestra.run.smithi008.stdout: { 2023-08-01T19:56:21.162 INFO:teuthology.orchestra.run.smithi008.stdout: "event": "reached_pg", 2023-08-01T19:56:21.162 INFO:teuthology.orchestra.run.smithi008.stdout: "time": "2023-08-01T19:55:59.617892+0000", 2023-08-01T19:56:21.162 INFO:teuthology.orchestra.run.smithi008.stdout: "duration": 1.0444446380000001 2023-08-01T19:56:21.162 INFO:teuthology.orchestra.run.smithi008.stdout: }, 2023-08-01T19:56:21.162 INFO:teuthology.orchestra.run.smithi008.stdout: { 2023-08-01T19:56:21.162 INFO:teuthology.orchestra.run.smithi008.stdout: "event": "done", 2023-08-01T19:56:21.162 INFO:teuthology.orchestra.run.smithi008.stdout: "time": "2023-08-01T19:55:59.618093+0000", 2023-08-01T19:56:21.163 INFO:teuthology.orchestra.run.smithi008.stdout: "duration": 0.00020066300000000001 2023-08-01T19:56:21.163 INFO:teuthology.orchestra.run.smithi008.stdout: } 2023-08-01T19:56:21.163 INFO:teuthology.orchestra.run.smithi008.stdout: ] 2023-08-01T19:56:21.163 INFO:teuthology.orchestra.run.smithi008.stdout: } 2023-08-01T19:56:21.163 INFO:teuthology.orchestra.run.smithi008.stdout: }, 2023-08-01T19:56:21.163 INFO:teuthology.orchestra.run.smithi008.stdout: { 2023-08-01T19:56:21.163 INFO:teuthology.orchestra.run.smithi008.stdout: "description": "osd_op(client.4668.0:197411 5.7 5:ebefbc20:::benchmark_data_smithi006_114134_object63750:head [delete] snapc 0=[] RETRY=1 ondisk+retry+write+known_if_redirected+supports_pool_eio e62)", 2023-08-01T19:56:21.164 INFO:teuthology.orchestra.run.smithi008.stdout: "initiated_at": "2023-08-01T19:55:58.564619+0000", 2023-08-01T19:56:21.164 INFO:teuthology.orchestra.run.smithi008.stdout: "age": 22.433993376, 2023-08-01T19:56:21.164 INFO:teuthology.orchestra.run.smithi008.stdout: "duration": 1.0686062569999999, 2023-08-01T19:56:21.164 INFO:teuthology.orchestra.run.smithi008.stdout: "type_data": { 2023-08-01T19:56:21.164 INFO:teuthology.orchestra.run.smithi008.stdout: "flag_point": "commit sent; apply or cleanup", 2023-08-01T19:56:21.164 INFO:teuthology.orchestra.run.smithi008.stdout: "client_info": { 2023-08-01T19:56:21.164 INFO:teuthology.orchestra.run.smithi008.stdout: "client": "client.4668", 2023-08-01T19:56:21.165 INFO:teuthology.orchestra.run.smithi008.stdout: "client_addr": "172.21.15.6:0/1709472247", 2023-08-01T19:56:21.165 INFO:teuthology.orchestra.run.smithi008.stdout: "tid": 197411 2023-08-01T19:56:21.165 INFO:teuthology.orchestra.run.smithi008.stdout: }, 2023-08-01T19:56:21.165 INFO:teuthology.orchestra.run.smithi008.stdout: "events": [ 2023-08-01T19:56:21.165 INFO:teuthology.orchestra.run.smithi008.stdout: { 2023-08-01T19:56:21.165 INFO:teuthology.orchestra.run.smithi008.stdout: "event": "initiated", 2023-08-01T19:56:21.165 INFO:teuthology.orchestra.run.smithi008.stdout: "time": "2023-08-01T19:55:58.564619+0000", 2023-08-01T19:56:21.165 INFO:teuthology.orchestra.run.smithi008.stdout: "duration": 0 2023-08-01T19:56:21.166 INFO:teuthology.orchestra.run.smithi008.stdout: }, 2023-08-01T19:56:21.166 INFO:teuthology.orchestra.run.smithi008.stdout: { 2023-08-01T19:56:21.166 INFO:teuthology.orchestra.run.smithi008.stdout: "event": "throttled", 2023-08-01T19:56:21.166 INFO:teuthology.orchestra.run.smithi008.stdout: "time": "2023-08-01T19:55:58.564619+0000", 2023-08-01T19:56:21.166 INFO:teuthology.orchestra.run.smithi008.stdout: "duration": 0 2023-08-01T19:56:21.166 INFO:teuthology.orchestra.run.smithi008.stdout: }, 2023-08-01T19:56:21.166 INFO:teuthology.orchestra.run.smithi008.stdout: { 2023-08-01T19:56:21.166 INFO:teuthology.orchestra.run.smithi008.stdout: "event": "header_read", 2023-08-01T19:56:21.167 INFO:teuthology.orchestra.run.smithi008.stdout: "time": "2023-08-01T19:55:58.564619+0000", 2023-08-01T19:56:21.167 INFO:teuthology.orchestra.run.smithi008.stdout: "duration": 4294967295.9999995 2023-08-01T19:56:21.167 INFO:teuthology.orchestra.run.smithi008.stdout: }, 2023-08-01T19:56:21.167 INFO:teuthology.orchestra.run.smithi008.stdout: { 2023-08-01T19:56:21.167 INFO:teuthology.orchestra.run.smithi008.stdout: "event": "all_read", 2023-08-01T19:56:21.167 INFO:teuthology.orchestra.run.smithi008.stdout: "time": "2023-08-01T19:55:58.564621+0000", 2023-08-01T19:56:21.167 INFO:teuthology.orchestra.run.smithi008.stdout: "duration": 2.6139999999999999e-06 2023-08-01T19:56:21.167 INFO:teuthology.orchestra.run.smithi008.stdout: }, 2023-08-01T19:56:21.168 INFO:teuthology.orchestra.run.smithi008.stdout: { 2023-08-01T19:56:21.168 INFO:teuthology.orchestra.run.smithi008.stdout: "event": "dispatched", 2023-08-01T19:56:21.168 INFO:teuthology.orchestra.run.smithi008.stdout: "time": "2023-08-01T19:55:58.564627+0000", 2023-08-01T19:56:21.168 INFO:teuthology.orchestra.run.smithi008.stdout: "duration": 5.1150000000000002e-06 2023-08-01T19:56:21.168 INFO:teuthology.orchestra.run.smithi008.stdout: }, 2023-08-01T19:56:21.168 INFO:teuthology.orchestra.run.smithi008.stdout: { 2023-08-01T19:56:21.168 INFO:teuthology.orchestra.run.smithi008.stdout: "event": "queued_for_pg", 2023-08-01T19:56:21.169 INFO:teuthology.orchestra.run.smithi008.stdout: "time": "2023-08-01T19:55:58.564631+0000", 2023-08-01T19:56:21.169 INFO:teuthology.orchestra.run.smithi008.stdout: "duration": 4.702e-06 2023-08-01T19:56:21.169 INFO:teuthology.orchestra.run.smithi008.stdout: }, 2023-08-01T19:56:21.169 INFO:teuthology.orchestra.run.smithi008.stdout: { 2023-08-01T19:56:21.169 INFO:teuthology.orchestra.run.smithi008.stdout: "event": "reached_pg", 2023-08-01T19:56:21.169 INFO:teuthology.orchestra.run.smithi008.stdout: "time": "2023-08-01T19:55:58.565520+0000", 2023-08-01T19:56:21.169 INFO:teuthology.orchestra.run.smithi008.stdout: "duration": 0.00088893399999999997 2023-08-01T19:56:21.170 INFO:teuthology.orchestra.run.smithi008.stdout: }, 2023-08-01T19:56:21.170 INFO:teuthology.orchestra.run.smithi008.stdout: { 2023-08-01T19:56:21.170 INFO:teuthology.orchestra.run.smithi008.stdout: "event": "waiting for peered", 2023-08-01T19:56:21.170 INFO:teuthology.orchestra.run.smithi008.stdout: "time": "2023-08-01T19:55:58.565528+0000", 2023-08-01T19:56:21.170 INFO:teuthology.orchestra.run.smithi008.stdout: "duration": 7.5410000000000003e-06 2023-08-01T19:56:21.170 INFO:teuthology.orchestra.run.smithi008.stdout: }, 2023-08-01T19:56:21.170 INFO:teuthology.orchestra.run.smithi008.stdout: { 2023-08-01T19:56:21.170 INFO:teuthology.orchestra.run.smithi008.stdout: "event": "reached_pg", 2023-08-01T19:56:21.171 INFO:teuthology.orchestra.run.smithi008.stdout: "time": "2023-08-01T19:55:59.622374+0000", 2023-08-01T19:56:21.171 INFO:teuthology.orchestra.run.smithi008.stdout: "duration": 1.05684588 2023-08-01T19:56:21.171 INFO:teuthology.orchestra.run.smithi008.stdout: }, 2023-08-01T19:56:21.171 INFO:teuthology.orchestra.run.smithi008.stdout: { 2023-08-01T19:56:21.171 INFO:teuthology.orchestra.run.smithi008.stdout: "event": "started", 2023-08-01T19:56:21.171 INFO:teuthology.orchestra.run.smithi008.stdout: "time": "2023-08-01T19:55:59.624156+0000", 2023-08-01T19:56:21.171 INFO:teuthology.orchestra.run.smithi008.stdout: "duration": 0.0017826129999999999 2023-08-01T19:56:21.171 INFO:teuthology.orchestra.run.smithi008.stdout: }, 2023-08-01T19:56:21.172 INFO:teuthology.orchestra.run.smithi008.stdout: { 2023-08-01T19:56:21.172 INFO:teuthology.orchestra.run.smithi008.stdout: "event": "op_commit", 2023-08-01T19:56:21.172 INFO:teuthology.orchestra.run.smithi008.stdout: "time": "2023-08-01T19:55:59.633131+0000", 2023-08-01T19:56:21.172 INFO:teuthology.orchestra.run.smithi008.stdout: "duration": 0.0089745740000000008 2023-08-01T19:56:21.172 INFO:teuthology.orchestra.run.smithi008.stdout: }, 2023-08-01T19:56:21.172 INFO:teuthology.orchestra.run.smithi008.stdout: { 2023-08-01T19:56:21.172 INFO:teuthology.orchestra.run.smithi008.stdout: "event": "commit_sent", 2023-08-01T19:56:21.172 INFO:teuthology.orchestra.run.smithi008.stdout: "time": "2023-08-01T19:55:59.633173+0000", 2023-08-01T19:56:21.173 INFO:teuthology.orchestra.run.smithi008.stdout: "duration": 4.2645000000000003e-05 2023-08-01T19:56:21.173 INFO:teuthology.orchestra.run.smithi008.stdout: }, 2023-08-01T19:56:21.173 INFO:teuthology.orchestra.run.smithi008.stdout: { 2023-08-01T19:56:21.173 INFO:teuthology.orchestra.run.smithi008.stdout: "event": "done", 2023-08-01T19:56:21.173 INFO:teuthology.orchestra.run.smithi008.stdout: "time": "2023-08-01T19:55:59.633225+0000", 2023-08-01T19:56:21.173 INFO:teuthology.orchestra.run.smithi008.stdout: "duration": 5.2003999999999999e-05 2023-08-01T19:56:21.173 INFO:teuthology.orchestra.run.smithi008.stdout: } 2023-08-01T19:56:21.174 INFO:teuthology.orchestra.run.smithi008.stdout: ] 2023-08-01T19:56:21.174 INFO:teuthology.orchestra.run.smithi008.stdout: } 2023-08-01T19:56:21.174 INFO:teuthology.orchestra.run.smithi008.stdout: }, 2023-08-01T19:56:21.174 INFO:teuthology.orchestra.run.smithi008.stdout: { 2023-08-01T19:56:21.174 INFO:teuthology.orchestra.run.smithi008.stdout: "description": "osd_op(client.4668.0:197413 5.5 5:a6ff9d8a:::benchmark_data_smithi006_114134_object63752:head [delete] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e62)", 2023-08-01T19:56:21.174 INFO:teuthology.orchestra.run.smithi008.stdout: "initiated_at": "2023-08-01T19:55:58.573778+0000", 2023-08-01T19:56:21.174 INFO:teuthology.orchestra.run.smithi008.stdout: "age": 22.424834409999999, 2023-08-01T19:56:21.174 INFO:teuthology.orchestra.run.smithi008.stdout: "duration": 1.054781371, 2023-08-01T19:56:21.175 INFO:teuthology.orchestra.run.smithi008.stdout: "type_data": { 2023-08-01T19:56:21.175 INFO:teuthology.orchestra.run.smithi008.stdout: "flag_point": "commit sent; apply or cleanup", 2023-08-01T19:56:21.175 INFO:teuthology.orchestra.run.smithi008.stdout: "client_info": { 2023-08-01T19:56:21.175 INFO:teuthology.orchestra.run.smithi008.stdout: "client": "client.4668", 2023-08-01T19:56:21.175 INFO:teuthology.orchestra.run.smithi008.stdout: "client_addr": "172.21.15.6:0/1709472247", 2023-08-01T19:56:21.175 INFO:teuthology.orchestra.run.smithi008.stdout: "tid": 197413 2023-08-01T19:56:21.175 INFO:teuthology.orchestra.run.smithi008.stdout: }, 2023-08-01T19:56:21.175 INFO:teuthology.orchestra.run.smithi008.stdout: "events": [ 2023-08-01T19:56:21.176 INFO:teuthology.orchestra.run.smithi008.stdout: { 2023-08-01T19:56:21.176 INFO:teuthology.orchestra.run.smithi008.stdout: "event": "initiated", 2023-08-01T19:56:21.176 INFO:teuthology.orchestra.run.smithi008.stdout: "time": "2023-08-01T19:55:58.573778+0000", 2023-08-01T19:56:21.176 INFO:teuthology.orchestra.run.smithi008.stdout: "duration": 0 2023-08-01T19:56:21.176 INFO:teuthology.orchestra.run.smithi008.stdout: }, 2023-08-01T19:56:21.176 INFO:teuthology.orchestra.run.smithi008.stdout: { 2023-08-01T19:56:21.177 INFO:teuthology.orchestra.run.smithi008.stdout: "event": "throttled", 2023-08-01T19:56:21.177 INFO:teuthology.orchestra.run.smithi008.stdout: "time": "2023-08-01T19:55:58.573778+0000", 2023-08-01T19:56:21.177 INFO:teuthology.orchestra.run.smithi008.stdout: "duration": 0 2023-08-01T19:56:21.177 INFO:teuthology.orchestra.run.smithi008.stdout: }, 2023-08-01T19:56:21.177 INFO:teuthology.orchestra.run.smithi008.stdout: { 2023-08-01T19:56:21.177 INFO:teuthology.orchestra.run.smithi008.stdout: "event": "header_read", 2023-08-01T19:56:21.178 INFO:teuthology.orchestra.run.smithi008.stdout: "time": "2023-08-01T19:55:58.573776+0000", 2023-08-01T19:56:21.178 INFO:teuthology.orchestra.run.smithi008.stdout: "duration": 4294967295.9999981 2023-08-01T19:56:21.178 INFO:teuthology.orchestra.run.smithi008.stdout: }, 2023-08-01T19:56:21.178 INFO:teuthology.orchestra.run.smithi008.stdout: { 2023-08-01T19:56:21.178 INFO:teuthology.orchestra.run.smithi008.stdout: "event": "all_read", 2023-08-01T19:56:21.178 INFO:teuthology.orchestra.run.smithi008.stdout: "time": "2023-08-01T19:55:58.573784+0000", 2023-08-01T19:56:21.178 INFO:teuthology.orchestra.run.smithi008.stdout: "duration": 8.2490000000000001e-06 2023-08-01T19:56:21.179 INFO:teuthology.orchestra.run.smithi008.stdout: }, 2023-08-01T19:56:21.179 INFO:teuthology.orchestra.run.smithi008.stdout: { 2023-08-01T19:56:21.179 INFO:teuthology.orchestra.run.smithi008.stdout: "event": "dispatched", 2023-08-01T19:56:21.179 INFO:teuthology.orchestra.run.smithi008.stdout: "time": "2023-08-01T19:55:58.574230+0000", 2023-08-01T19:56:21.179 INFO:teuthology.orchestra.run.smithi008.stdout: "duration": 0.00044558400000000001 2023-08-01T19:56:21.179 INFO:teuthology.orchestra.run.smithi008.stdout: }, 2023-08-01T19:56:21.180 INFO:teuthology.orchestra.run.smithi008.stdout: { 2023-08-01T19:56:21.180 INFO:teuthology.orchestra.run.smithi008.stdout: "event": "queued_for_pg", 2023-08-01T19:56:21.180 INFO:teuthology.orchestra.run.smithi008.stdout: "time": "2023-08-01T19:55:58.574240+0000", 2023-08-01T19:56:21.180 INFO:teuthology.orchestra.run.smithi008.stdout: "duration": 9.7699999999999996e-06 2023-08-01T19:56:21.180 INFO:teuthology.orchestra.run.smithi008.stdout: }, 2023-08-01T19:56:21.180 INFO:teuthology.orchestra.run.smithi008.stdout: { 2023-08-01T19:56:21.181 INFO:teuthology.orchestra.run.smithi008.stdout: "event": "reached_pg", 2023-08-01T19:56:21.181 INFO:teuthology.orchestra.run.smithi008.stdout: "time": "2023-08-01T19:55:58.574292+0000", 2023-08-01T19:56:21.181 INFO:teuthology.orchestra.run.smithi008.stdout: "duration": 5.2101000000000001e-05 2023-08-01T19:56:21.181 INFO:teuthology.orchestra.run.smithi008.stdout: }, 2023-08-01T19:56:21.181 INFO:teuthology.orchestra.run.smithi008.stdout: { 2023-08-01T19:56:21.181 INFO:teuthology.orchestra.run.smithi008.stdout: "event": "waiting for peered", 2023-08-01T19:56:21.181 INFO:teuthology.orchestra.run.smithi008.stdout: "time": "2023-08-01T19:55:58.574299+0000", 2023-08-01T19:56:21.182 INFO:teuthology.orchestra.run.smithi008.stdout: "duration": 7.3420000000000002e-06 2023-08-01T19:56:21.182 INFO:teuthology.orchestra.run.smithi008.stdout: }, 2023-08-01T19:56:21.182 INFO:teuthology.orchestra.run.smithi008.stdout: { 2023-08-01T19:56:21.182 INFO:teuthology.orchestra.run.smithi008.stdout: "event": "reached_pg", 2023-08-01T19:56:21.182 INFO:teuthology.orchestra.run.smithi008.stdout: "time": "2023-08-01T19:55:59.618545+0000", 2023-08-01T19:56:21.182 INFO:teuthology.orchestra.run.smithi008.stdout: "duration": 1.044245922 2023-08-01T19:56:21.182 INFO:teuthology.orchestra.run.smithi008.stdout: }, 2023-08-01T19:56:21.183 INFO:teuthology.orchestra.run.smithi008.stdout: { 2023-08-01T19:56:21.183 INFO:teuthology.orchestra.run.smithi008.stdout: "event": "started", 2023-08-01T19:56:21.183 INFO:teuthology.orchestra.run.smithi008.stdout: "time": "2023-08-01T19:55:59.618855+0000", 2023-08-01T19:56:21.183 INFO:teuthology.orchestra.run.smithi008.stdout: "duration": 0.00030964099999999999 2023-08-01T19:56:21.183 INFO:teuthology.orchestra.run.smithi008.stdout: }, 2023-08-01T19:56:21.183 INFO:teuthology.orchestra.run.smithi008.stdout: { 2023-08-01T19:56:21.184 INFO:teuthology.orchestra.run.smithi008.stdout: "event": "op_commit", 2023-08-01T19:56:21.184 INFO:teuthology.orchestra.run.smithi008.stdout: "time": "2023-08-01T19:55:59.628438+0000", 2023-08-01T19:56:21.184 INFO:teuthology.orchestra.run.smithi008.stdout: "duration": 0.0095832939999999991 2023-08-01T19:56:21.184 INFO:teuthology.orchestra.run.smithi008.stdout: }, 2023-08-01T19:56:21.184 INFO:teuthology.orchestra.run.smithi008.stdout: { 2023-08-01T19:56:21.184 INFO:teuthology.orchestra.run.smithi008.stdout: "event": "commit_sent", 2023-08-01T19:56:21.184 INFO:teuthology.orchestra.run.smithi008.stdout: "time": "2023-08-01T19:55:59.628479+0000", 2023-08-01T19:56:21.185 INFO:teuthology.orchestra.run.smithi008.stdout: "duration": 4.1350000000000002e-05 2023-08-01T19:56:21.185 INFO:teuthology.orchestra.run.smithi008.stdout: }, 2023-08-01T19:56:21.185 INFO:teuthology.orchestra.run.smithi008.stdout: { 2023-08-01T19:56:21.185 INFO:teuthology.orchestra.run.smithi008.stdout: "event": "done", 2023-08-01T19:56:21.185 INFO:teuthology.orchestra.run.smithi008.stdout: "time": "2023-08-01T19:55:59.628560+0000", 2023-08-01T19:56:21.185 INFO:teuthology.orchestra.run.smithi008.stdout: "duration": 8.0080999999999994e-05 2023-08-01T19:56:21.185 INFO:teuthology.orchestra.run.smithi008.stdout: } 2023-08-01T19:56:21.185 INFO:teuthology.orchestra.run.smithi008.stdout: ] 2023-08-01T19:56:21.186 INFO:teuthology.orchestra.run.smithi008.stdout: } 2023-08-01T19:56:21.186 INFO:teuthology.orchestra.run.smithi008.stdout: }, 2023-08-01T19:56:21.186 INFO:teuthology.orchestra.run.smithi008.stdout: { 2023-08-01T19:56:21.186 INFO:teuthology.orchestra.run.smithi008.stdout: "description": "osd_op(client.4668.0:197415 5.c 5:3e539c01:::benchmark_data_smithi006_114134_object63754:head [delete] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e62)", 2023-08-01T19:56:21.186 INFO:teuthology.orchestra.run.smithi008.stdout: "initiated_at": "2023-08-01T19:55:58.577434+0000", 2023-08-01T19:56:21.186 INFO:teuthology.orchestra.run.smithi008.stdout: "age": 22.421178652999998, 2023-08-01T19:56:21.186 INFO:teuthology.orchestra.run.smithi008.stdout: "duration": 1.0520807059999999, 2023-08-01T19:56:21.187 INFO:teuthology.orchestra.run.smithi008.stdout: "type_data": { 2023-08-01T19:56:21.187 INFO:teuthology.orchestra.run.smithi008.stdout: "flag_point": "commit sent; apply or cleanup", 2023-08-01T19:56:21.187 INFO:teuthology.orchestra.run.smithi008.stdout: "client_info": { 2023-08-01T19:56:21.187 INFO:teuthology.orchestra.run.smithi008.stdout: "client": "client.4668", 2023-08-01T19:56:21.187 INFO:teuthology.orchestra.run.smithi008.stdout: "client_addr": "172.21.15.6:0/1709472247", 2023-08-01T19:56:21.187 INFO:teuthology.orchestra.run.smithi008.stdout: "tid": 197415 2023-08-01T19:56:21.187 INFO:teuthology.orchestra.run.smithi008.stdout: }, 2023-08-01T19:56:21.187 INFO:teuthology.orchestra.run.smithi008.stdout: "events": [ 2023-08-01T19:56:21.188 INFO:teuthology.orchestra.run.smithi008.stdout: { 2023-08-01T19:56:21.188 INFO:teuthology.orchestra.run.smithi008.stdout: "event": "initiated", 2023-08-01T19:56:21.188 INFO:teuthology.orchestra.run.smithi008.stdout: "time": "2023-08-01T19:55:58.577434+0000", 2023-08-01T19:56:21.188 INFO:teuthology.orchestra.run.smithi008.stdout: "duration": 0 2023-08-01T19:56:21.188 INFO:teuthology.orchestra.run.smithi008.stdout: }, 2023-08-01T19:56:21.188 INFO:teuthology.orchestra.run.smithi008.stdout: { 2023-08-01T19:56:21.188 INFO:teuthology.orchestra.run.smithi008.stdout: "event": "throttled", 2023-08-01T19:56:21.189 INFO:teuthology.orchestra.run.smithi008.stdout: "time": "2023-08-01T19:55:58.577434+0000", 2023-08-01T19:56:21.189 INFO:teuthology.orchestra.run.smithi008.stdout: "duration": 0 2023-08-01T19:56:21.189 INFO:teuthology.orchestra.run.smithi008.stdout: }, 2023-08-01T19:56:21.189 INFO:teuthology.orchestra.run.smithi008.stdout: { 2023-08-01T19:56:21.189 INFO:teuthology.orchestra.run.smithi008.stdout: "event": "header_read", 2023-08-01T19:56:21.189 INFO:teuthology.orchestra.run.smithi008.stdout: "time": "2023-08-01T19:55:58.577432+0000", 2023-08-01T19:56:21.189 INFO:teuthology.orchestra.run.smithi008.stdout: "duration": 4294967295.9999986 2023-08-01T19:56:21.189 INFO:teuthology.orchestra.run.smithi008.stdout: }, 2023-08-01T19:56:21.190 INFO:teuthology.orchestra.run.smithi008.stdout: { 2023-08-01T19:56:21.190 INFO:teuthology.orchestra.run.smithi008.stdout: "event": "all_read", 2023-08-01T19:56:21.190 INFO:teuthology.orchestra.run.smithi008.stdout: "time": "2023-08-01T19:55:58.577440+0000", 2023-08-01T19:56:21.190 INFO:teuthology.orchestra.run.smithi008.stdout: "duration": 7.5480000000000004e-06 2023-08-01T19:56:21.190 INFO:teuthology.orchestra.run.smithi008.stdout: }, 2023-08-01T19:56:21.190 INFO:teuthology.orchestra.run.smithi008.stdout: { 2023-08-01T19:56:21.190 INFO:teuthology.orchestra.run.smithi008.stdout: "event": "dispatched", 2023-08-01T19:56:21.191 INFO:teuthology.orchestra.run.smithi008.stdout: "time": "2023-08-01T19:55:58.577454+0000", 2023-08-01T19:56:21.191 INFO:teuthology.orchestra.run.smithi008.stdout: "duration": 1.4216000000000001e-05 2023-08-01T19:56:21.191 INFO:teuthology.orchestra.run.smithi008.stdout: }, 2023-08-01T19:56:21.191 INFO:teuthology.orchestra.run.smithi008.stdout: { 2023-08-01T19:56:21.191 INFO:teuthology.orchestra.run.smithi008.stdout: "event": "queued_for_pg", 2023-08-01T19:56:21.191 INFO:teuthology.orchestra.run.smithi008.stdout: "time": "2023-08-01T19:55:58.577463+0000", 2023-08-01T19:56:21.191 INFO:teuthology.orchestra.run.smithi008.stdout: "duration": 8.2900000000000002e-06 2023-08-01T19:56:21.191 INFO:teuthology.orchestra.run.smithi008.stdout: }, 2023-08-01T19:56:21.192 INFO:teuthology.orchestra.run.smithi008.stdout: { 2023-08-01T19:56:21.192 INFO:teuthology.orchestra.run.smithi008.stdout: "event": "reached_pg", 2023-08-01T19:56:21.192 INFO:teuthology.orchestra.run.smithi008.stdout: "time": "2023-08-01T19:55:58.577498+0000", 2023-08-01T19:56:21.192 INFO:teuthology.orchestra.run.smithi008.stdout: "duration": 3.5302000000000002e-05 2023-08-01T19:56:21.192 INFO:teuthology.orchestra.run.smithi008.stdout: }, 2023-08-01T19:56:21.192 INFO:teuthology.orchestra.run.smithi008.stdout: { 2023-08-01T19:56:21.192 INFO:teuthology.orchestra.run.smithi008.stdout: "event": "waiting for peered", 2023-08-01T19:56:21.192 INFO:teuthology.orchestra.run.smithi008.stdout: "time": "2023-08-01T19:55:58.577503+0000", 2023-08-01T19:56:21.193 INFO:teuthology.orchestra.run.smithi008.stdout: "duration": 4.8409999999999999e-06 2023-08-01T19:56:21.193 INFO:teuthology.orchestra.run.smithi008.stdout: }, 2023-08-01T19:56:21.193 INFO:teuthology.orchestra.run.smithi008.stdout: { 2023-08-01T19:56:21.193 INFO:teuthology.orchestra.run.smithi008.stdout: "event": "reached_pg", 2023-08-01T19:56:21.193 INFO:teuthology.orchestra.run.smithi008.stdout: "time": "2023-08-01T19:55:59.619229+0000", 2023-08-01T19:56:21.193 INFO:teuthology.orchestra.run.smithi008.stdout: "duration": 1.041726119 2023-08-01T19:56:21.193 INFO:teuthology.orchestra.run.smithi008.stdout: }, 2023-08-01T19:56:21.194 INFO:teuthology.orchestra.run.smithi008.stdout: { 2023-08-01T19:56:21.194 INFO:teuthology.orchestra.run.smithi008.stdout: "event": "started", 2023-08-01T19:56:21.194 INFO:teuthology.orchestra.run.smithi008.stdout: "time": "2023-08-01T19:55:59.619326+0000", 2023-08-01T19:56:21.194 INFO:teuthology.orchestra.run.smithi008.stdout: "duration": 9.7044000000000001e-05 2023-08-01T19:56:21.194 INFO:teuthology.orchestra.run.smithi008.stdout: }, 2023-08-01T19:56:21.194 INFO:teuthology.orchestra.run.smithi008.stdout: { 2023-08-01T19:56:21.194 INFO:teuthology.orchestra.run.smithi008.stdout: "event": "op_commit", 2023-08-01T19:56:21.194 INFO:teuthology.orchestra.run.smithi008.stdout: "time": "2023-08-01T19:55:59.629399+0000", 2023-08-01T19:56:21.195 INFO:teuthology.orchestra.run.smithi008.stdout: "duration": 0.010073014 2023-08-01T19:56:21.195 INFO:teuthology.orchestra.run.smithi008.stdout: }, 2023-08-01T19:56:21.195 INFO:teuthology.orchestra.run.smithi008.stdout: { 2023-08-01T19:56:21.195 INFO:teuthology.orchestra.run.smithi008.stdout: "event": "commit_sent", 2023-08-01T19:56:21.195 INFO:teuthology.orchestra.run.smithi008.stdout: "time": "2023-08-01T19:55:59.629443+0000", 2023-08-01T19:56:21.195 INFO:teuthology.orchestra.run.smithi008.stdout: "duration": 4.3739999999999998e-05 2023-08-01T19:56:21.195 INFO:teuthology.orchestra.run.smithi008.stdout: }, 2023-08-01T19:56:21.195 INFO:teuthology.orchestra.run.smithi008.stdout: { 2023-08-01T19:56:21.196 INFO:teuthology.orchestra.run.smithi008.stdout: "event": "done", 2023-08-01T19:56:21.196 INFO:teuthology.orchestra.run.smithi008.stdout: "time": "2023-08-01T19:55:59.629515+0000", 2023-08-01T19:56:21.196 INFO:teuthology.orchestra.run.smithi008.stdout: "duration": 7.2089999999999996e-05 2023-08-01T19:56:21.196 INFO:teuthology.orchestra.run.smithi008.stdout: } 2023-08-01T19:56:21.196 INFO:teuthology.orchestra.run.smithi008.stdout: ] 2023-08-01T19:56:21.196 INFO:teuthology.orchestra.run.smithi008.stdout: } 2023-08-01T19:56:21.196 INFO:teuthology.orchestra.run.smithi008.stdout: }, 2023-08-01T19:56:21.196 INFO:teuthology.orchestra.run.smithi008.stdout: { 2023-08-01T19:56:21.197 INFO:teuthology.orchestra.run.smithi008.stdout: "description": "osd_op(client.4668.0:197417 5.7 5:eb36cb7d:::benchmark_data_smithi006_114134_object63756:head [delete] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e62)", 2023-08-01T19:56:21.197 INFO:teuthology.orchestra.run.smithi008.stdout: "initiated_at": "2023-08-01T19:55:58.578162+0000", 2023-08-01T19:56:21.197 INFO:teuthology.orchestra.run.smithi008.stdout: "age": 22.420450356, 2023-08-01T19:56:21.197 INFO:teuthology.orchestra.run.smithi008.stdout: "duration": 1.0582469299999999, 2023-08-01T19:56:21.197 INFO:teuthology.orchestra.run.smithi008.stdout: "type_data": { 2023-08-01T19:56:21.197 INFO:teuthology.orchestra.run.smithi008.stdout: "flag_point": "commit sent; apply or cleanup", 2023-08-01T19:56:21.197 INFO:teuthology.orchestra.run.smithi008.stdout: "client_info": { 2023-08-01T19:56:21.198 INFO:teuthology.orchestra.run.smithi008.stdout: "client": "client.4668", 2023-08-01T19:56:21.198 INFO:teuthology.orchestra.run.smithi008.stdout: "client_addr": "172.21.15.6:0/1709472247", 2023-08-01T19:56:21.198 INFO:teuthology.orchestra.run.smithi008.stdout: "tid": 197417 2023-08-01T19:56:21.198 INFO:teuthology.orchestra.run.smithi008.stdout: }, 2023-08-01T19:56:21.198 INFO:teuthology.orchestra.run.smithi008.stdout: "events": [ 2023-08-01T19:56:21.198 INFO:teuthology.orchestra.run.smithi008.stdout: { 2023-08-01T19:56:21.198 INFO:teuthology.orchestra.run.smithi008.stdout: "event": "initiated", 2023-08-01T19:56:21.198 INFO:teuthology.orchestra.run.smithi008.stdout: "time": "2023-08-01T19:55:58.578162+0000", 2023-08-01T19:56:21.199 INFO:teuthology.orchestra.run.smithi008.stdout: "duration": 0 2023-08-01T19:56:21.199 INFO:teuthology.orchestra.run.smithi008.stdout: }, 2023-08-01T19:56:21.199 INFO:teuthology.orchestra.run.smithi008.stdout: { 2023-08-01T19:56:21.199 INFO:teuthology.orchestra.run.smithi008.stdout: "event": "throttled", 2023-08-01T19:56:21.199 INFO:teuthology.orchestra.run.smithi008.stdout: "time": "2023-08-01T19:55:58.578162+0000", 2023-08-01T19:56:21.199 INFO:teuthology.orchestra.run.smithi008.stdout: "duration": 0 2023-08-01T19:56:21.199 INFO:teuthology.orchestra.run.smithi008.stdout: }, 2023-08-01T19:56:21.199 INFO:teuthology.orchestra.run.smithi008.stdout: { 2023-08-01T19:56:21.200 INFO:teuthology.orchestra.run.smithi008.stdout: "event": "header_read", 2023-08-01T19:56:21.200 INFO:teuthology.orchestra.run.smithi008.stdout: "time": "2023-08-01T19:55:58.578161+0000", 2023-08-01T19:56:21.200 INFO:teuthology.orchestra.run.smithi008.stdout: "duration": 4294967295.999999 2023-08-01T19:56:21.200 INFO:teuthology.orchestra.run.smithi008.stdout: }, 2023-08-01T19:56:21.200 INFO:teuthology.orchestra.run.smithi008.stdout: { 2023-08-01T19:56:21.200 INFO:teuthology.orchestra.run.smithi008.stdout: "event": "all_read", 2023-08-01T19:56:21.200 INFO:teuthology.orchestra.run.smithi008.stdout: "time": "2023-08-01T19:55:58.578166+0000", 2023-08-01T19:56:21.201 INFO:teuthology.orchestra.run.smithi008.stdout: "duration": 4.6589999999999998e-06 2023-08-01T19:56:21.201 INFO:teuthology.orchestra.run.smithi008.stdout: }, 2023-08-01T19:56:21.201 INFO:teuthology.orchestra.run.smithi008.stdout: { 2023-08-01T19:56:21.201 INFO:teuthology.orchestra.run.smithi008.stdout: "event": "dispatched", 2023-08-01T19:56:21.201 INFO:teuthology.orchestra.run.smithi008.stdout: "time": "2023-08-01T19:55:58.578177+0000", 2023-08-01T19:56:21.201 INFO:teuthology.orchestra.run.smithi008.stdout: "duration": 1.0512e-05 2023-08-01T19:56:21.201 INFO:teuthology.orchestra.run.smithi008.stdout: }, 2023-08-01T19:56:21.201 INFO:teuthology.orchestra.run.smithi008.stdout: { 2023-08-01T19:56:21.202 INFO:teuthology.orchestra.run.smithi008.stdout: "event": "queued_for_pg", 2023-08-01T19:56:21.202 INFO:teuthology.orchestra.run.smithi008.stdout: "time": "2023-08-01T19:55:58.578182+0000", 2023-08-01T19:56:21.202 INFO:teuthology.orchestra.run.smithi008.stdout: "duration": 5.6540000000000004e-06 2023-08-01T19:56:21.202 INFO:teuthology.orchestra.run.smithi008.stdout: }, 2023-08-01T19:56:21.202 INFO:teuthology.orchestra.run.smithi008.stdout: { 2023-08-01T19:56:21.202 INFO:teuthology.orchestra.run.smithi008.stdout: "event": "reached_pg", 2023-08-01T19:56:21.203 INFO:teuthology.orchestra.run.smithi008.stdout: "time": "2023-08-01T19:55:58.578221+0000", 2023-08-01T19:56:21.203 INFO:teuthology.orchestra.run.smithi008.stdout: "duration": 3.8764999999999999e-05 2023-08-01T19:56:21.203 INFO:teuthology.orchestra.run.smithi008.stdout: }, 2023-08-01T19:56:21.203 INFO:teuthology.orchestra.run.smithi008.stdout: { 2023-08-01T19:56:21.203 INFO:teuthology.orchestra.run.smithi008.stdout: "event": "waiting for peered", 2023-08-01T19:56:21.203 INFO:teuthology.orchestra.run.smithi008.stdout: "time": "2023-08-01T19:55:58.578226+0000", 2023-08-01T19:56:21.203 INFO:teuthology.orchestra.run.smithi008.stdout: "duration": 4.6319999999999999e-06 2023-08-01T19:56:21.204 INFO:teuthology.orchestra.run.smithi008.stdout: }, 2023-08-01T19:56:21.204 INFO:teuthology.orchestra.run.smithi008.stdout: { 2023-08-01T19:56:21.204 INFO:teuthology.orchestra.run.smithi008.stdout: "event": "reached_pg", 2023-08-01T19:56:21.204 INFO:teuthology.orchestra.run.smithi008.stdout: "time": "2023-08-01T19:55:59.628027+0000", 2023-08-01T19:56:21.204 INFO:teuthology.orchestra.run.smithi008.stdout: "duration": 1.049801261 2023-08-01T19:56:21.204 INFO:teuthology.orchestra.run.smithi008.stdout: }, 2023-08-01T19:56:21.204 INFO:teuthology.orchestra.run.smithi008.stdout: { 2023-08-01T19:56:21.204 INFO:teuthology.orchestra.run.smithi008.stdout: "event": "started", 2023-08-01T19:56:21.205 INFO:teuthology.orchestra.run.smithi008.stdout: "time": "2023-08-01T19:55:59.628156+0000", 2023-08-01T19:56:21.205 INFO:teuthology.orchestra.run.smithi008.stdout: "duration": 0.00012906899999999999 2023-08-01T19:56:21.205 INFO:teuthology.orchestra.run.smithi008.stdout: }, 2023-08-01T19:56:21.205 INFO:teuthology.orchestra.run.smithi008.stdout: { 2023-08-01T19:56:21.205 INFO:teuthology.orchestra.run.smithi008.stdout: "event": "op_commit", 2023-08-01T19:56:21.205 INFO:teuthology.orchestra.run.smithi008.stdout: "time": "2023-08-01T19:55:59.636292+0000", 2023-08-01T19:56:21.205 INFO:teuthology.orchestra.run.smithi008.stdout: "duration": 0.0081362859999999995 2023-08-01T19:56:21.206 INFO:teuthology.orchestra.run.smithi008.stdout: }, 2023-08-01T19:56:21.206 INFO:teuthology.orchestra.run.smithi008.stdout: { 2023-08-01T19:56:21.206 INFO:teuthology.orchestra.run.smithi008.stdout: "event": "commit_sent", 2023-08-01T19:56:21.206 INFO:teuthology.orchestra.run.smithi008.stdout: "time": "2023-08-01T19:55:59.636343+0000", 2023-08-01T19:56:21.206 INFO:teuthology.orchestra.run.smithi008.stdout: "duration": 5.0603000000000003e-05 2023-08-01T19:56:21.206 INFO:teuthology.orchestra.run.smithi008.stdout: }, 2023-08-01T19:56:21.206 INFO:teuthology.orchestra.run.smithi008.stdout: { 2023-08-01T19:56:21.206 INFO:teuthology.orchestra.run.smithi008.stdout: "event": "done", 2023-08-01T19:56:21.207 INFO:teuthology.orchestra.run.smithi008.stdout: "time": "2023-08-01T19:55:59.636409+0000", 2023-08-01T19:56:21.207 INFO:teuthology.orchestra.run.smithi008.stdout: "duration": 6.6353999999999995e-05 2023-08-01T19:56:21.207 INFO:teuthology.orchestra.run.smithi008.stdout: } 2023-08-01T19:56:21.207 INFO:teuthology.orchestra.run.smithi008.stdout: ] 2023-08-01T19:56:21.207 INFO:teuthology.orchestra.run.smithi008.stdout: } 2023-08-01T19:56:21.207 INFO:teuthology.orchestra.run.smithi008.stdout: }, 2023-08-01T19:56:21.207 INFO:teuthology.orchestra.run.smithi008.stdout: { 2023-08-01T19:56:21.207 INFO:teuthology.orchestra.run.smithi008.stdout: "description": "osd_op(client.4668.0:197418 5.2 5:4ba84ab7:::benchmark_data_smithi006_114134_object63757:head [delete] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e62)", 2023-08-01T19:56:21.208 INFO:teuthology.orchestra.run.smithi008.stdout: "initiated_at": "2023-08-01T19:55:58.580297+0000", 2023-08-01T19:56:21.208 INFO:teuthology.orchestra.run.smithi008.stdout: "age": 22.418316003000001, 2023-08-01T19:56:21.208 INFO:teuthology.orchestra.run.smithi008.stdout: "duration": 1.0529485839999999, 2023-08-01T19:56:21.208 INFO:teuthology.orchestra.run.smithi008.stdout: "type_data": { 2023-08-01T19:56:21.208 INFO:teuthology.orchestra.run.smithi008.stdout: "flag_point": "commit sent; apply or cleanup", 2023-08-01T19:56:21.208 INFO:teuthology.orchestra.run.smithi008.stdout: "client_info": { 2023-08-01T19:56:21.208 INFO:teuthology.orchestra.run.smithi008.stdout: "client": "client.4668", 2023-08-01T19:56:21.209 INFO:teuthology.orchestra.run.smithi008.stdout: "client_addr": "172.21.15.6:0/1709472247", 2023-08-01T19:56:21.209 INFO:teuthology.orchestra.run.smithi008.stdout: "tid": 197418 2023-08-01T19:56:21.209 INFO:teuthology.orchestra.run.smithi008.stdout: }, 2023-08-01T19:56:21.209 INFO:teuthology.orchestra.run.smithi008.stdout: "events": [ 2023-08-01T19:56:21.209 INFO:teuthology.orchestra.run.smithi008.stdout: { 2023-08-01T19:56:21.209 INFO:teuthology.orchestra.run.smithi008.stdout: "event": "initiated", 2023-08-01T19:56:21.209 INFO:teuthology.orchestra.run.smithi008.stdout: "time": "2023-08-01T19:55:58.580297+0000", 2023-08-01T19:56:21.209 INFO:teuthology.orchestra.run.smithi008.stdout: "duration": 0 2023-08-01T19:56:21.210 INFO:teuthology.orchestra.run.smithi008.stdout: }, 2023-08-01T19:56:21.210 INFO:teuthology.orchestra.run.smithi008.stdout: { 2023-08-01T19:56:21.210 INFO:teuthology.orchestra.run.smithi008.stdout: "event": "throttled", 2023-08-01T19:56:21.210 INFO:teuthology.orchestra.run.smithi008.stdout: "time": "2023-08-01T19:55:58.580297+0000", 2023-08-01T19:56:21.210 INFO:teuthology.orchestra.run.smithi008.stdout: "duration": 0 2023-08-01T19:56:21.210 INFO:teuthology.orchestra.run.smithi008.stdout: }, 2023-08-01T19:56:21.210 INFO:teuthology.orchestra.run.smithi008.stdout: { 2023-08-01T19:56:21.210 INFO:teuthology.orchestra.run.smithi008.stdout: "event": "header_read", 2023-08-01T19:56:21.211 INFO:teuthology.orchestra.run.smithi008.stdout: "time": "2023-08-01T19:55:58.580296+0000", 2023-08-01T19:56:21.211 INFO:teuthology.orchestra.run.smithi008.stdout: "duration": 4294967295.999999 2023-08-01T19:56:21.211 INFO:teuthology.orchestra.run.smithi008.stdout: }, 2023-08-01T19:56:21.211 INFO:teuthology.orchestra.run.smithi008.stdout: { 2023-08-01T19:56:21.211 INFO:teuthology.orchestra.run.smithi008.stdout: "event": "all_read", 2023-08-01T19:56:21.211 INFO:teuthology.orchestra.run.smithi008.stdout: "time": "2023-08-01T19:55:58.580302+0000", 2023-08-01T19:56:21.211 INFO:teuthology.orchestra.run.smithi008.stdout: "duration": 6.032e-06 2023-08-01T19:56:21.211 INFO:teuthology.orchestra.run.smithi008.stdout: }, 2023-08-01T19:56:21.212 INFO:teuthology.orchestra.run.smithi008.stdout: { 2023-08-01T19:56:21.212 INFO:teuthology.orchestra.run.smithi008.stdout: "event": "dispatched", 2023-08-01T19:56:21.212 INFO:teuthology.orchestra.run.smithi008.stdout: "time": "2023-08-01T19:55:58.580315+0000", 2023-08-01T19:56:21.212 INFO:teuthology.orchestra.run.smithi008.stdout: "duration": 1.327e-05 2023-08-01T19:56:21.212 INFO:teuthology.orchestra.run.smithi008.stdout: }, 2023-08-01T19:56:21.212 INFO:teuthology.orchestra.run.smithi008.stdout: { 2023-08-01T19:56:21.212 INFO:teuthology.orchestra.run.smithi008.stdout: "event": "queued_for_pg", 2023-08-01T19:56:21.213 INFO:teuthology.orchestra.run.smithi008.stdout: "time": "2023-08-01T19:55:58.580321+0000", 2023-08-01T19:56:21.213 INFO:teuthology.orchestra.run.smithi008.stdout: "duration": 6.3980000000000004e-06 2023-08-01T19:56:21.213 INFO:teuthology.orchestra.run.smithi008.stdout: }, 2023-08-01T19:56:21.213 INFO:teuthology.orchestra.run.smithi008.stdout: { 2023-08-01T19:56:21.213 INFO:teuthology.orchestra.run.smithi008.stdout: "event": "reached_pg", 2023-08-01T19:56:21.213 INFO:teuthology.orchestra.run.smithi008.stdout: "time": "2023-08-01T19:55:58.580372+0000", 2023-08-01T19:56:21.213 INFO:teuthology.orchestra.run.smithi008.stdout: "duration": 5.0219000000000001e-05 2023-08-01T19:56:21.213 INFO:teuthology.orchestra.run.smithi008.stdout: }, 2023-08-01T19:56:21.214 INFO:teuthology.orchestra.run.smithi008.stdout: { 2023-08-01T19:56:21.214 INFO:teuthology.orchestra.run.smithi008.stdout: "event": "waiting for peered", 2023-08-01T19:56:21.214 INFO:teuthology.orchestra.run.smithi008.stdout: "time": "2023-08-01T19:55:58.580378+0000", 2023-08-01T19:56:21.214 INFO:teuthology.orchestra.run.smithi008.stdout: "duration": 6.6529999999999997e-06 2023-08-01T19:56:21.214 INFO:teuthology.orchestra.run.smithi008.stdout: }, 2023-08-01T19:56:21.214 INFO:teuthology.orchestra.run.smithi008.stdout: { 2023-08-01T19:56:21.214 INFO:teuthology.orchestra.run.smithi008.stdout: "event": "reached_pg", 2023-08-01T19:56:21.214 INFO:teuthology.orchestra.run.smithi008.stdout: "time": "2023-08-01T19:55:59.618188+0000", 2023-08-01T19:56:21.215 INFO:teuthology.orchestra.run.smithi008.stdout: "duration": 1.037810267 2023-08-01T19:56:21.215 INFO:teuthology.orchestra.run.smithi008.stdout: }, 2023-08-01T19:56:21.215 INFO:teuthology.orchestra.run.smithi008.stdout: { 2023-08-01T19:56:21.215 INFO:teuthology.orchestra.run.smithi008.stdout: "event": "started", 2023-08-01T19:56:21.215 INFO:teuthology.orchestra.run.smithi008.stdout: "time": "2023-08-01T19:55:59.618308+0000", 2023-08-01T19:56:21.215 INFO:teuthology.orchestra.run.smithi008.stdout: "duration": 0.00011959 2023-08-01T19:56:21.215 INFO:teuthology.orchestra.run.smithi008.stdout: }, 2023-08-01T19:56:21.215 INFO:teuthology.orchestra.run.smithi008.stdout: { 2023-08-01T19:56:21.216 INFO:teuthology.orchestra.run.smithi008.stdout: "event": "op_commit", 2023-08-01T19:56:21.216 INFO:teuthology.orchestra.run.smithi008.stdout: "time": "2023-08-01T19:55:59.633122+0000", 2023-08-01T19:56:21.216 INFO:teuthology.orchestra.run.smithi008.stdout: "duration": 0.014814280000000001 2023-08-01T19:56:21.216 INFO:teuthology.orchestra.run.smithi008.stdout: }, 2023-08-01T19:56:21.216 INFO:teuthology.orchestra.run.smithi008.stdout: { 2023-08-01T19:56:21.216 INFO:teuthology.orchestra.run.smithi008.stdout: "event": "commit_sent", 2023-08-01T19:56:21.216 INFO:teuthology.orchestra.run.smithi008.stdout: "time": "2023-08-01T19:55:59.633167+0000", 2023-08-01T19:56:21.217 INFO:teuthology.orchestra.run.smithi008.stdout: "duration": 4.4651999999999999e-05 2023-08-01T19:56:21.217 INFO:teuthology.orchestra.run.smithi008.stdout: }, 2023-08-01T19:56:21.217 INFO:teuthology.orchestra.run.smithi008.stdout: { 2023-08-01T19:56:21.217 INFO:teuthology.orchestra.run.smithi008.stdout: "event": "done", 2023-08-01T19:56:21.217 INFO:teuthology.orchestra.run.smithi008.stdout: "time": "2023-08-01T19:55:59.633245+0000", 2023-08-01T19:56:21.217 INFO:teuthology.orchestra.run.smithi008.stdout: "duration": 7.8215999999999998e-05 2023-08-01T19:56:21.217 INFO:teuthology.orchestra.run.smithi008.stdout: } 2023-08-01T19:56:21.217 INFO:teuthology.orchestra.run.smithi008.stdout: ] 2023-08-01T19:56:21.218 INFO:teuthology.orchestra.run.smithi008.stdout: } 2023-08-01T19:56:21.218 INFO:teuthology.orchestra.run.smithi008.stdout: } 2023-08-01T19:56:21.218 INFO:teuthology.orchestra.run.smithi008.stdout: ] 2023-08-01T19:56:21.218 INFO:teuthology.orchestra.run.smithi008.stdout:} 2023-08-01T19:56:21.219 DEBUG:teuthology.orchestra.run.smithi155:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 30 ceph --cluster ceph --admin-daemon /var/run/ceph/ceph-osd.2.asok dump_ops_in_flight 2023-08-01T19:56:21.220 INFO:tasks.ceph.osd.0.smithi008.stderr:2023-08-01T19:56:21.217+0000 7f16a58f4700 -1 received signal: Hangup from /usr/bin/python3 /bin/daemon-helper kill ceph-osd -f --cluster ceph -i 0 (PID: 111179) UID: 0 2023-08-01T19:56:21.320 INFO:tasks.ceph.osd.0.smithi008.stderr:2023-08-01T19:56:21.318+0000 7f16a58f4700 -1 received signal: Hangup from /usr/bin/python3 /bin/daemon-helper kill ceph-osd -f --cluster ceph -i 0 (PID: 111179) UID: 0 2023-08-01T19:56:21.398 INFO:teuthology.orchestra.run.smithi155.stdout:{ 2023-08-01T19:56:21.398 INFO:teuthology.orchestra.run.smithi155.stdout: "ops": [ 2023-08-01T19:56:21.398 INFO:teuthology.orchestra.run.smithi155.stdout: { 2023-08-01T19:56:21.398 INFO:teuthology.orchestra.run.smithi155.stdout: "description": "osd_op(client.4668.0:242294 5.8 5:10fde165:::benchmark_data_smithi006_114134_object108633:head [delete] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e71)", 2023-08-01T19:56:21.398 INFO:teuthology.orchestra.run.smithi155.stdout: "initiated_at": "2023-08-01T19:56:21.390364+0000", 2023-08-01T19:56:21.399 INFO:teuthology.orchestra.run.smithi155.stdout: "age": 0.0051513840000000002, 2023-08-01T19:56:21.399 INFO:teuthology.orchestra.run.smithi155.stdout: "duration": 0.0051798829999999997, 2023-08-01T19:56:21.399 INFO:teuthology.orchestra.run.smithi155.stdout: "type_data": { 2023-08-01T19:56:21.399 INFO:teuthology.orchestra.run.smithi155.stdout: "flag_point": "waiting for sub ops", 2023-08-01T19:56:21.399 INFO:teuthology.orchestra.run.smithi155.stdout: "client_info": { 2023-08-01T19:56:21.399 INFO:teuthology.orchestra.run.smithi155.stdout: "client": "client.4668", 2023-08-01T19:56:21.399 INFO:teuthology.orchestra.run.smithi155.stdout: "client_addr": "172.21.15.6:0/1709472247", 2023-08-01T19:56:21.400 INFO:teuthology.orchestra.run.smithi155.stdout: "tid": 242294 2023-08-01T19:56:21.400 INFO:teuthology.orchestra.run.smithi155.stdout: }, 2023-08-01T19:56:21.400 INFO:teuthology.orchestra.run.smithi155.stdout: "events": [ 2023-08-01T19:56:21.400 INFO:teuthology.orchestra.run.smithi155.stdout: { 2023-08-01T19:56:21.400 INFO:teuthology.orchestra.run.smithi155.stdout: "event": "initiated", 2023-08-01T19:56:21.400 INFO:teuthology.orchestra.run.smithi155.stdout: "time": "2023-08-01T19:56:21.390364+0000", 2023-08-01T19:56:21.400 INFO:teuthology.orchestra.run.smithi155.stdout: "duration": 0 2023-08-01T19:56:21.400 INFO:teuthology.orchestra.run.smithi155.stdout: }, 2023-08-01T19:56:21.401 INFO:teuthology.orchestra.run.smithi155.stdout: { 2023-08-01T19:56:21.401 INFO:teuthology.orchestra.run.smithi155.stdout: "event": "throttled", 2023-08-01T19:56:21.401 INFO:teuthology.orchestra.run.smithi155.stdout: "time": "2023-08-01T19:56:21.390364+0000", 2023-08-01T19:56:21.401 INFO:teuthology.orchestra.run.smithi155.stdout: "duration": 0 2023-08-01T19:56:21.401 INFO:teuthology.orchestra.run.smithi155.stdout: }, 2023-08-01T19:56:21.402 INFO:teuthology.orchestra.run.smithi155.stdout: { 2023-08-01T19:56:21.402 INFO:teuthology.orchestra.run.smithi155.stdout: "event": "header_read", 2023-08-01T19:56:21.402 INFO:teuthology.orchestra.run.smithi155.stdout: "time": "2023-08-01T19:56:21.390363+0000", 2023-08-01T19:56:21.402 INFO:teuthology.orchestra.run.smithi155.stdout: "duration": 4294967295.999999 2023-08-01T19:56:21.402 INFO:teuthology.orchestra.run.smithi155.stdout: }, 2023-08-01T19:56:21.402 INFO:teuthology.orchestra.run.smithi155.stdout: { 2023-08-01T19:56:21.402 INFO:teuthology.orchestra.run.smithi155.stdout: "event": "all_read", 2023-08-01T19:56:21.402 INFO:teuthology.orchestra.run.smithi155.stdout: "time": "2023-08-01T19:56:21.390368+0000", 2023-08-01T19:56:21.403 INFO:teuthology.orchestra.run.smithi155.stdout: "duration": 4.493e-06 2023-08-01T19:56:21.403 INFO:teuthology.orchestra.run.smithi155.stdout: }, 2023-08-01T19:56:21.403 INFO:teuthology.orchestra.run.smithi155.stdout: { 2023-08-01T19:56:21.403 INFO:teuthology.orchestra.run.smithi155.stdout: "event": "dispatched", 2023-08-01T19:56:21.403 INFO:teuthology.orchestra.run.smithi155.stdout: "time": "2023-08-01T19:56:21.390377+0000", 2023-08-01T19:56:21.403 INFO:teuthology.orchestra.run.smithi155.stdout: "duration": 9.3929999999999997e-06 2023-08-01T19:56:21.403 INFO:teuthology.orchestra.run.smithi155.stdout: }, 2023-08-01T19:56:21.404 INFO:teuthology.orchestra.run.smithi155.stdout: { 2023-08-01T19:56:21.404 INFO:teuthology.orchestra.run.smithi155.stdout: "event": "queued_for_pg", 2023-08-01T19:56:21.404 INFO:teuthology.orchestra.run.smithi155.stdout: "time": "2023-08-01T19:56:21.390382+0000", 2023-08-01T19:56:21.404 INFO:teuthology.orchestra.run.smithi155.stdout: "duration": 4.5299999999999998e-06 2023-08-01T19:56:21.404 INFO:teuthology.orchestra.run.smithi155.stdout: }, 2023-08-01T19:56:21.404 INFO:teuthology.orchestra.run.smithi155.stdout: { 2023-08-01T19:56:21.404 INFO:teuthology.orchestra.run.smithi155.stdout: "event": "reached_pg", 2023-08-01T19:56:21.404 INFO:teuthology.orchestra.run.smithi155.stdout: "time": "2023-08-01T19:56:21.390417+0000", 2023-08-01T19:56:21.405 INFO:teuthology.orchestra.run.smithi155.stdout: "duration": 3.5410000000000001e-05 2023-08-01T19:56:21.405 INFO:teuthology.orchestra.run.smithi155.stdout: }, 2023-08-01T19:56:21.405 INFO:teuthology.orchestra.run.smithi155.stdout: { 2023-08-01T19:56:21.405 INFO:teuthology.orchestra.run.smithi155.stdout: "event": "started", 2023-08-01T19:56:21.405 INFO:teuthology.orchestra.run.smithi155.stdout: "time": "2023-08-01T19:56:21.390532+0000", 2023-08-01T19:56:21.405 INFO:teuthology.orchestra.run.smithi155.stdout: "duration": 0.000115532 2023-08-01T19:56:21.405 INFO:teuthology.orchestra.run.smithi155.stdout: }, 2023-08-01T19:56:21.406 INFO:teuthology.orchestra.run.smithi155.stdout: { 2023-08-01T19:56:21.406 INFO:teuthology.orchestra.run.smithi155.stdout: "event": "waiting for subops from 0", 2023-08-01T19:56:21.406 INFO:teuthology.orchestra.run.smithi155.stdout: "time": "2023-08-01T19:56:21.390648+0000", 2023-08-01T19:56:21.406 INFO:teuthology.orchestra.run.smithi155.stdout: "duration": 0.000115278 2023-08-01T19:56:21.406 INFO:teuthology.orchestra.run.smithi155.stdout: } 2023-08-01T19:56:21.406 INFO:teuthology.orchestra.run.smithi155.stdout: ] 2023-08-01T19:56:21.406 INFO:teuthology.orchestra.run.smithi155.stdout: } 2023-08-01T19:56:21.406 INFO:teuthology.orchestra.run.smithi155.stdout: }, 2023-08-01T19:56:21.407 INFO:teuthology.orchestra.run.smithi155.stdout: { 2023-08-01T19:56:21.407 INFO:teuthology.orchestra.run.smithi155.stdout: "description": "osd_op(client.4668.0:242295 5.e 5:76426d75:::benchmark_data_smithi006_114134_object108634:head [delete] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e71)", 2023-08-01T19:56:21.407 INFO:teuthology.orchestra.run.smithi155.stdout: "initiated_at": "2023-08-01T19:56:21.390392+0000", 2023-08-01T19:56:21.407 INFO:teuthology.orchestra.run.smithi155.stdout: "age": 0.0051230989999999999, 2023-08-01T19:56:21.407 INFO:teuthology.orchestra.run.smithi155.stdout: "duration": 0.0052433799999999997, 2023-08-01T19:56:21.407 INFO:teuthology.orchestra.run.smithi155.stdout: "type_data": { 2023-08-01T19:56:21.407 INFO:teuthology.orchestra.run.smithi155.stdout: "flag_point": "waiting for sub ops", 2023-08-01T19:56:21.407 INFO:teuthology.orchestra.run.smithi155.stdout: "client_info": { 2023-08-01T19:56:21.408 INFO:teuthology.orchestra.run.smithi155.stdout: "client": "client.4668", 2023-08-01T19:56:21.408 INFO:teuthology.orchestra.run.smithi155.stdout: "client_addr": "172.21.15.6:0/1709472247", 2023-08-01T19:56:21.408 INFO:teuthology.orchestra.run.smithi155.stdout: "tid": 242295 2023-08-01T19:56:21.408 INFO:teuthology.orchestra.run.smithi155.stdout: }, 2023-08-01T19:56:21.408 INFO:teuthology.orchestra.run.smithi155.stdout: "events": [ 2023-08-01T19:56:21.408 INFO:teuthology.orchestra.run.smithi155.stdout: { 2023-08-01T19:56:21.408 INFO:teuthology.orchestra.run.smithi155.stdout: "event": "initiated", 2023-08-01T19:56:21.409 INFO:teuthology.orchestra.run.smithi155.stdout: "time": "2023-08-01T19:56:21.390392+0000", 2023-08-01T19:56:21.409 INFO:teuthology.orchestra.run.smithi155.stdout: "duration": 0 2023-08-01T19:56:21.409 INFO:teuthology.orchestra.run.smithi155.stdout: }, 2023-08-01T19:56:21.409 INFO:teuthology.orchestra.run.smithi155.stdout: { 2023-08-01T19:56:21.409 INFO:teuthology.orchestra.run.smithi155.stdout: "event": "throttled", 2023-08-01T19:56:21.409 INFO:teuthology.orchestra.run.smithi155.stdout: "time": "2023-08-01T19:56:21.390392+0000", 2023-08-01T19:56:21.409 INFO:teuthology.orchestra.run.smithi155.stdout: "duration": 0 2023-08-01T19:56:21.409 INFO:teuthology.orchestra.run.smithi155.stdout: }, 2023-08-01T19:56:21.410 INFO:teuthology.orchestra.run.smithi155.stdout: { 2023-08-01T19:56:21.410 INFO:teuthology.orchestra.run.smithi155.stdout: "event": "header_read", 2023-08-01T19:56:21.410 INFO:teuthology.orchestra.run.smithi155.stdout: "time": "2023-08-01T19:56:21.390392+0000", 2023-08-01T19:56:21.410 INFO:teuthology.orchestra.run.smithi155.stdout: "duration": 4294967295.9999995 2023-08-01T19:56:21.410 INFO:teuthology.orchestra.run.smithi155.stdout: }, 2023-08-01T19:56:21.410 INFO:teuthology.orchestra.run.smithi155.stdout: { 2023-08-01T19:56:21.410 INFO:teuthology.orchestra.run.smithi155.stdout: "event": "all_read", 2023-08-01T19:56:21.410 INFO:teuthology.orchestra.run.smithi155.stdout: "time": "2023-08-01T19:56:21.390394+0000", 2023-08-01T19:56:21.411 INFO:teuthology.orchestra.run.smithi155.stdout: "duration": 2.2359999999999999e-06 2023-08-01T19:56:21.411 INFO:teuthology.orchestra.run.smithi155.stdout: }, 2023-08-01T19:56:21.411 INFO:teuthology.orchestra.run.smithi155.stdout: { 2023-08-01T19:56:21.411 INFO:teuthology.orchestra.run.smithi155.stdout: "event": "dispatched", 2023-08-01T19:56:21.411 INFO:teuthology.orchestra.run.smithi155.stdout: "time": "2023-08-01T19:56:21.390401+0000", 2023-08-01T19:56:21.411 INFO:teuthology.orchestra.run.smithi155.stdout: "duration": 6.5060000000000001e-06 2023-08-01T19:56:21.411 INFO:teuthology.orchestra.run.smithi155.stdout: }, 2023-08-01T19:56:21.411 INFO:teuthology.orchestra.run.smithi155.stdout: { 2023-08-01T19:56:21.412 INFO:teuthology.orchestra.run.smithi155.stdout: "event": "queued_for_pg", 2023-08-01T19:56:21.412 INFO:teuthology.orchestra.run.smithi155.stdout: "time": "2023-08-01T19:56:21.390404+0000", 2023-08-01T19:56:21.412 INFO:teuthology.orchestra.run.smithi155.stdout: "duration": 3.0240000000000002e-06 2023-08-01T19:56:21.412 INFO:teuthology.orchestra.run.smithi155.stdout: }, 2023-08-01T19:56:21.412 INFO:teuthology.orchestra.run.smithi155.stdout: { 2023-08-01T19:56:21.412 INFO:teuthology.orchestra.run.smithi155.stdout: "event": "reached_pg", 2023-08-01T19:56:21.412 INFO:teuthology.orchestra.run.smithi155.stdout: "time": "2023-08-01T19:56:21.390431+0000", 2023-08-01T19:56:21.412 INFO:teuthology.orchestra.run.smithi155.stdout: "duration": 2.7413e-05 2023-08-01T19:56:21.413 INFO:teuthology.orchestra.run.smithi155.stdout: }, 2023-08-01T19:56:21.413 INFO:teuthology.orchestra.run.smithi155.stdout: { 2023-08-01T19:56:21.413 INFO:teuthology.orchestra.run.smithi155.stdout: "event": "started", 2023-08-01T19:56:21.413 INFO:teuthology.orchestra.run.smithi155.stdout: "time": "2023-08-01T19:56:21.390549+0000", 2023-08-01T19:56:21.413 INFO:teuthology.orchestra.run.smithi155.stdout: "duration": 0.00011814100000000001 2023-08-01T19:56:21.413 INFO:teuthology.orchestra.run.smithi155.stdout: }, 2023-08-01T19:56:21.413 INFO:teuthology.orchestra.run.smithi155.stdout: { 2023-08-01T19:56:21.414 INFO:teuthology.orchestra.run.smithi155.stdout: "event": "waiting for subops from 0", 2023-08-01T19:56:21.414 INFO:teuthology.orchestra.run.smithi155.stdout: "time": "2023-08-01T19:56:21.390662+0000", 2023-08-01T19:56:21.414 INFO:teuthology.orchestra.run.smithi155.stdout: "duration": 0.000113105 2023-08-01T19:56:21.414 INFO:teuthology.orchestra.run.smithi155.stdout: } 2023-08-01T19:56:21.414 INFO:teuthology.orchestra.run.smithi155.stdout: ] 2023-08-01T19:56:21.414 INFO:teuthology.orchestra.run.smithi155.stdout: } 2023-08-01T19:56:21.414 INFO:teuthology.orchestra.run.smithi155.stdout: }, 2023-08-01T19:56:21.414 INFO:teuthology.orchestra.run.smithi155.stdout: { 2023-08-01T19:56:21.415 INFO:teuthology.orchestra.run.smithi155.stdout: "description": "osd_op(client.4668.0:242296 5.0 5:06fa2b39:::benchmark_data_smithi006_114134_object108635:head [delete] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e71)", 2023-08-01T19:56:21.415 INFO:teuthology.orchestra.run.smithi155.stdout: "initiated_at": "2023-08-01T19:56:21.390411+0000", 2023-08-01T19:56:21.415 INFO:teuthology.orchestra.run.smithi155.stdout: "age": 0.005104155, 2023-08-01T19:56:21.415 INFO:teuthology.orchestra.run.smithi155.stdout: "duration": 0.0053174199999999998, 2023-08-01T19:56:21.415 INFO:teuthology.orchestra.run.smithi155.stdout: "type_data": { 2023-08-01T19:56:21.415 INFO:teuthology.orchestra.run.smithi155.stdout: "flag_point": "waiting for sub ops", 2023-08-01T19:56:21.415 INFO:teuthology.orchestra.run.smithi155.stdout: "client_info": { 2023-08-01T19:56:21.415 INFO:teuthology.orchestra.run.smithi155.stdout: "client": "client.4668", 2023-08-01T19:56:21.416 INFO:teuthology.orchestra.run.smithi155.stdout: "client_addr": "172.21.15.6:0/1709472247", 2023-08-01T19:56:21.416 INFO:teuthology.orchestra.run.smithi155.stdout: "tid": 242296 2023-08-01T19:56:21.416 INFO:teuthology.orchestra.run.smithi155.stdout: }, 2023-08-01T19:56:21.416 INFO:teuthology.orchestra.run.smithi155.stdout: "events": [ 2023-08-01T19:56:21.416 INFO:teuthology.orchestra.run.smithi155.stdout: { 2023-08-01T19:56:21.416 INFO:teuthology.orchestra.run.smithi155.stdout: "event": "initiated", 2023-08-01T19:56:21.416 INFO:teuthology.orchestra.run.smithi155.stdout: "time": "2023-08-01T19:56:21.390411+0000", 2023-08-01T19:56:21.416 INFO:teuthology.orchestra.run.smithi155.stdout: "duration": 0 2023-08-01T19:56:21.417 INFO:teuthology.orchestra.run.smithi155.stdout: }, 2023-08-01T19:56:21.417 INFO:teuthology.orchestra.run.smithi155.stdout: { 2023-08-01T19:56:21.417 INFO:teuthology.orchestra.run.smithi155.stdout: "event": "throttled", 2023-08-01T19:56:21.417 INFO:teuthology.orchestra.run.smithi155.stdout: "time": "2023-08-01T19:56:21.390411+0000", 2023-08-01T19:56:21.417 INFO:teuthology.orchestra.run.smithi155.stdout: "duration": 0 2023-08-01T19:56:21.417 INFO:teuthology.orchestra.run.smithi155.stdout: }, 2023-08-01T19:56:21.417 INFO:teuthology.orchestra.run.smithi155.stdout: { 2023-08-01T19:56:21.417 INFO:teuthology.orchestra.run.smithi155.stdout: "event": "header_read", 2023-08-01T19:56:21.418 INFO:teuthology.orchestra.run.smithi155.stdout: "time": "2023-08-01T19:56:21.390411+0000", 2023-08-01T19:56:21.418 INFO:teuthology.orchestra.run.smithi155.stdout: "duration": 4294967295.9999995 2023-08-01T19:56:21.418 INFO:teuthology.orchestra.run.smithi155.stdout: }, 2023-08-01T19:56:21.418 INFO:teuthology.orchestra.run.smithi155.stdout: { 2023-08-01T19:56:21.418 INFO:teuthology.orchestra.run.smithi155.stdout: "event": "all_read", 2023-08-01T19:56:21.418 INFO:teuthology.orchestra.run.smithi155.stdout: "time": "2023-08-01T19:56:21.390413+0000", 2023-08-01T19:56:21.418 INFO:teuthology.orchestra.run.smithi155.stdout: "duration": 2.638e-06 2023-08-01T19:56:21.418 INFO:teuthology.orchestra.run.smithi155.stdout: }, 2023-08-01T19:56:21.419 INFO:teuthology.orchestra.run.smithi155.stdout: { 2023-08-01T19:56:21.419 INFO:teuthology.orchestra.run.smithi155.stdout: "event": "dispatched", 2023-08-01T19:56:21.419 INFO:teuthology.orchestra.run.smithi155.stdout: "time": "2023-08-01T19:56:21.390419+0000", 2023-08-01T19:56:21.419 INFO:teuthology.orchestra.run.smithi155.stdout: "duration": 5.6670000000000001e-06 2023-08-01T19:56:21.419 INFO:teuthology.orchestra.run.smithi155.stdout: }, 2023-08-01T19:56:21.419 INFO:teuthology.orchestra.run.smithi155.stdout: { 2023-08-01T19:56:21.419 INFO:teuthology.orchestra.run.smithi155.stdout: "event": "queued_for_pg", 2023-08-01T19:56:21.420 INFO:teuthology.orchestra.run.smithi155.stdout: "time": "2023-08-01T19:56:21.390423+0000", 2023-08-01T19:56:21.420 INFO:teuthology.orchestra.run.smithi155.stdout: "duration": 3.6559999999999998e-06 2023-08-01T19:56:21.420 INFO:teuthology.orchestra.run.smithi155.stdout: }, 2023-08-01T19:56:21.420 INFO:teuthology.orchestra.run.smithi155.stdout: { 2023-08-01T19:56:21.420 INFO:teuthology.orchestra.run.smithi155.stdout: "event": "reached_pg", 2023-08-01T19:56:21.420 INFO:teuthology.orchestra.run.smithi155.stdout: "time": "2023-08-01T19:56:21.390448+0000", 2023-08-01T19:56:21.420 INFO:teuthology.orchestra.run.smithi155.stdout: "duration": 2.5616e-05 2023-08-01T19:56:21.420 INFO:teuthology.orchestra.run.smithi155.stdout: }, 2023-08-01T19:56:21.421 INFO:teuthology.orchestra.run.smithi155.stdout: { 2023-08-01T19:56:21.421 INFO:teuthology.orchestra.run.smithi155.stdout: "event": "started", 2023-08-01T19:56:21.421 INFO:teuthology.orchestra.run.smithi155.stdout: "time": "2023-08-01T19:56:21.390550+0000", 2023-08-01T19:56:21.421 INFO:teuthology.orchestra.run.smithi155.stdout: "duration": 0.000101729 2023-08-01T19:56:21.421 INFO:teuthology.orchestra.run.smithi155.stdout: }, 2023-08-01T19:56:21.421 INFO:teuthology.orchestra.run.smithi155.stdout: { 2023-08-01T19:56:21.421 INFO:teuthology.orchestra.run.smithi155.stdout: "event": "waiting for subops from 0", 2023-08-01T19:56:21.421 INFO:teuthology.orchestra.run.smithi155.stdout: "time": "2023-08-01T19:56:21.390662+0000", 2023-08-01T19:56:21.422 INFO:teuthology.orchestra.run.smithi155.stdout: "duration": 0.000112198 2023-08-01T19:56:21.422 INFO:teuthology.orchestra.run.smithi155.stdout: }, 2023-08-01T19:56:21.422 INFO:teuthology.orchestra.run.smithi155.stdout: { 2023-08-01T19:56:21.422 INFO:teuthology.orchestra.run.smithi155.stdout: "event": "sub_op_commit_rec", 2023-08-01T19:56:21.422 INFO:teuthology.orchestra.run.smithi155.stdout: "time": "2023-08-01T19:56:21.395380+0000", 2023-08-01T19:56:21.422 INFO:teuthology.orchestra.run.smithi155.stdout: "duration": 0.0047177909999999998 2023-08-01T19:56:21.422 INFO:teuthology.orchestra.run.smithi155.stdout: } 2023-08-01T19:56:21.423 INFO:teuthology.orchestra.run.smithi155.stdout: ] 2023-08-01T19:56:21.423 INFO:teuthology.orchestra.run.smithi155.stdout: } 2023-08-01T19:56:21.423 INFO:teuthology.orchestra.run.smithi155.stdout: }, 2023-08-01T19:56:21.423 INFO:teuthology.orchestra.run.smithi155.stdout: { 2023-08-01T19:56:21.423 INFO:teuthology.orchestra.run.smithi155.stdout: "description": "osd_op(client.4668.0:242298 5.9 5:9210a400:::benchmark_data_smithi006_114134_object108637:head [delete] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e71)", 2023-08-01T19:56:21.423 INFO:teuthology.orchestra.run.smithi155.stdout: "initiated_at": "2023-08-01T19:56:21.392673+0000", 2023-08-01T19:56:21.423 INFO:teuthology.orchestra.run.smithi155.stdout: "age": 0.0028424969999999998, 2023-08-01T19:56:21.423 INFO:teuthology.orchestra.run.smithi155.stdout: "duration": 0.0031385919999999999, 2023-08-01T19:56:21.424 INFO:teuthology.orchestra.run.smithi155.stdout: "type_data": { 2023-08-01T19:56:21.424 INFO:teuthology.orchestra.run.smithi155.stdout: "flag_point": "started", 2023-08-01T19:56:21.424 INFO:teuthology.orchestra.run.smithi155.stdout: "client_info": { 2023-08-01T19:56:21.424 INFO:teuthology.orchestra.run.smithi155.stdout: "client": "client.4668", 2023-08-01T19:56:21.424 INFO:teuthology.orchestra.run.smithi155.stdout: "client_addr": "172.21.15.6:0/1709472247", 2023-08-01T19:56:21.424 INFO:teuthology.orchestra.run.smithi155.stdout: "tid": 242298 2023-08-01T19:56:21.424 INFO:teuthology.orchestra.run.smithi155.stdout: }, 2023-08-01T19:56:21.424 INFO:teuthology.orchestra.run.smithi155.stdout: "events": [ 2023-08-01T19:56:21.425 INFO:teuthology.orchestra.run.smithi155.stdout: { 2023-08-01T19:56:21.425 INFO:teuthology.orchestra.run.smithi155.stdout: "event": "initiated", 2023-08-01T19:56:21.425 INFO:teuthology.orchestra.run.smithi155.stdout: "time": "2023-08-01T19:56:21.392673+0000", 2023-08-01T19:56:21.425 INFO:teuthology.orchestra.run.smithi155.stdout: "duration": 0 2023-08-01T19:56:21.425 INFO:teuthology.orchestra.run.smithi155.stdout: }, 2023-08-01T19:56:21.425 INFO:teuthology.orchestra.run.smithi155.stdout: { 2023-08-01T19:56:21.425 INFO:teuthology.orchestra.run.smithi155.stdout: "event": "throttled", 2023-08-01T19:56:21.426 INFO:teuthology.orchestra.run.smithi155.stdout: "time": "2023-08-01T19:56:21.392673+0000", 2023-08-01T19:56:21.426 INFO:teuthology.orchestra.run.smithi155.stdout: "duration": 0 2023-08-01T19:56:21.426 INFO:teuthology.orchestra.run.smithi155.stdout: }, 2023-08-01T19:56:21.426 INFO:teuthology.orchestra.run.smithi155.stdout: { 2023-08-01T19:56:21.426 INFO:teuthology.orchestra.run.smithi155.stdout: "event": "header_read", 2023-08-01T19:56:21.426 INFO:teuthology.orchestra.run.smithi155.stdout: "time": "2023-08-01T19:56:21.392672+0000", 2023-08-01T19:56:21.426 INFO:teuthology.orchestra.run.smithi155.stdout: "duration": 4294967295.9999995 2023-08-01T19:56:21.426 INFO:teuthology.orchestra.run.smithi155.stdout: }, 2023-08-01T19:56:21.427 INFO:teuthology.orchestra.run.smithi155.stdout: { 2023-08-01T19:56:21.427 INFO:teuthology.orchestra.run.smithi155.stdout: "event": "all_read", 2023-08-01T19:56:21.427 INFO:teuthology.orchestra.run.smithi155.stdout: "time": "2023-08-01T19:56:21.392676+0000", 2023-08-01T19:56:21.427 INFO:teuthology.orchestra.run.smithi155.stdout: "duration": 3.9169999999999999e-06 2023-08-01T19:56:21.427 INFO:teuthology.orchestra.run.smithi155.stdout: }, 2023-08-01T19:56:21.427 INFO:teuthology.orchestra.run.smithi155.stdout: { 2023-08-01T19:56:21.427 INFO:teuthology.orchestra.run.smithi155.stdout: "event": "dispatched", 2023-08-01T19:56:21.427 INFO:teuthology.orchestra.run.smithi155.stdout: "time": "2023-08-01T19:56:21.392684+0000", 2023-08-01T19:56:21.428 INFO:teuthology.orchestra.run.smithi155.stdout: "duration": 7.8089999999999993e-06 2023-08-01T19:56:21.428 INFO:teuthology.orchestra.run.smithi155.stdout: }, 2023-08-01T19:56:21.428 INFO:teuthology.orchestra.run.smithi155.stdout: { 2023-08-01T19:56:21.428 INFO:teuthology.orchestra.run.smithi155.stdout: "event": "queued_for_pg", 2023-08-01T19:56:21.428 INFO:teuthology.orchestra.run.smithi155.stdout: "time": "2023-08-01T19:56:21.392687+0000", 2023-08-01T19:56:21.428 INFO:teuthology.orchestra.run.smithi155.stdout: "duration": 3.4659999999999999e-06 2023-08-01T19:56:21.428 INFO:teuthology.orchestra.run.smithi155.stdout: }, 2023-08-01T19:56:21.428 INFO:teuthology.orchestra.run.smithi155.stdout: { 2023-08-01T19:56:21.429 INFO:teuthology.orchestra.run.smithi155.stdout: "event": "reached_pg", 2023-08-01T19:56:21.429 INFO:teuthology.orchestra.run.smithi155.stdout: "time": "2023-08-01T19:56:21.392951+0000", 2023-08-01T19:56:21.429 INFO:teuthology.orchestra.run.smithi155.stdout: "duration": 0.000263393 2023-08-01T19:56:21.429 INFO:teuthology.orchestra.run.smithi155.stdout: }, 2023-08-01T19:56:21.429 INFO:teuthology.orchestra.run.smithi155.stdout: { 2023-08-01T19:56:21.429 INFO:teuthology.orchestra.run.smithi155.stdout: "event": "started", 2023-08-01T19:56:21.429 INFO:teuthology.orchestra.run.smithi155.stdout: "time": "2023-08-01T19:56:21.393085+0000", 2023-08-01T19:56:21.429 INFO:teuthology.orchestra.run.smithi155.stdout: "duration": 0.00013416799999999999 2023-08-01T19:56:21.430 INFO:teuthology.orchestra.run.smithi155.stdout: } 2023-08-01T19:56:21.430 INFO:teuthology.orchestra.run.smithi155.stdout: ] 2023-08-01T19:56:21.430 INFO:teuthology.orchestra.run.smithi155.stdout: } 2023-08-01T19:56:21.430 INFO:teuthology.orchestra.run.smithi155.stdout: }, 2023-08-01T19:56:21.430 INFO:teuthology.orchestra.run.smithi155.stdout: { 2023-08-01T19:56:21.430 INFO:teuthology.orchestra.run.smithi155.stdout: "description": "osd_op(client.4668.0:242299 5.9 5:94c1c1b7:::benchmark_data_smithi006_114134_object108638:head [delete] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e71)", 2023-08-01T19:56:21.430 INFO:teuthology.orchestra.run.smithi155.stdout: "initiated_at": "2023-08-01T19:56:21.392748+0000", 2023-08-01T19:56:21.430 INFO:teuthology.orchestra.run.smithi155.stdout: "age": 0.0027674069999999999, 2023-08-01T19:56:21.431 INFO:teuthology.orchestra.run.smithi155.stdout: "duration": 0.0031330590000000001, 2023-08-01T19:56:21.431 INFO:teuthology.orchestra.run.smithi155.stdout: "type_data": { 2023-08-01T19:56:21.431 INFO:teuthology.orchestra.run.smithi155.stdout: "flag_point": "started", 2023-08-01T19:56:21.431 INFO:teuthology.orchestra.run.smithi155.stdout: "client_info": { 2023-08-01T19:56:21.431 INFO:teuthology.orchestra.run.smithi155.stdout: "client": "client.4668", 2023-08-01T19:56:21.431 INFO:teuthology.orchestra.run.smithi155.stdout: "client_addr": "172.21.15.6:0/1709472247", 2023-08-01T19:56:21.431 INFO:teuthology.orchestra.run.smithi155.stdout: "tid": 242299 2023-08-01T19:56:21.432 INFO:teuthology.orchestra.run.smithi155.stdout: }, 2023-08-01T19:56:21.432 INFO:teuthology.orchestra.run.smithi155.stdout: "events": [ 2023-08-01T19:56:21.432 INFO:teuthology.orchestra.run.smithi155.stdout: { 2023-08-01T19:56:21.432 INFO:teuthology.orchestra.run.smithi155.stdout: "event": "initiated", 2023-08-01T19:56:21.432 INFO:teuthology.orchestra.run.smithi155.stdout: "time": "2023-08-01T19:56:21.392748+0000", 2023-08-01T19:56:21.432 INFO:teuthology.orchestra.run.smithi155.stdout: "duration": 0 2023-08-01T19:56:21.432 INFO:teuthology.orchestra.run.smithi155.stdout: }, 2023-08-01T19:56:21.432 INFO:teuthology.orchestra.run.smithi155.stdout: { 2023-08-01T19:56:21.433 INFO:teuthology.orchestra.run.smithi155.stdout: "event": "throttled", 2023-08-01T19:56:21.433 INFO:teuthology.orchestra.run.smithi155.stdout: "time": "2023-08-01T19:56:21.392748+0000", 2023-08-01T19:56:21.433 INFO:teuthology.orchestra.run.smithi155.stdout: "duration": 0 2023-08-01T19:56:21.433 INFO:teuthology.orchestra.run.smithi155.stdout: }, 2023-08-01T19:56:21.433 INFO:teuthology.orchestra.run.smithi155.stdout: { 2023-08-01T19:56:21.433 INFO:teuthology.orchestra.run.smithi155.stdout: "event": "header_read", 2023-08-01T19:56:21.433 INFO:teuthology.orchestra.run.smithi155.stdout: "time": "2023-08-01T19:56:21.392748+0000", 2023-08-01T19:56:21.433 INFO:teuthology.orchestra.run.smithi155.stdout: "duration": 4294967295.9999995 2023-08-01T19:56:21.434 INFO:teuthology.orchestra.run.smithi155.stdout: }, 2023-08-01T19:56:21.434 INFO:teuthology.orchestra.run.smithi155.stdout: { 2023-08-01T19:56:21.434 INFO:teuthology.orchestra.run.smithi155.stdout: "event": "all_read", 2023-08-01T19:56:21.434 INFO:teuthology.orchestra.run.smithi155.stdout: "time": "2023-08-01T19:56:21.392750+0000", 2023-08-01T19:56:21.434 INFO:teuthology.orchestra.run.smithi155.stdout: "duration": 2.0899999999999999e-06 2023-08-01T19:56:21.434 INFO:teuthology.orchestra.run.smithi155.stdout: }, 2023-08-01T19:56:21.434 INFO:teuthology.orchestra.run.smithi155.stdout: { 2023-08-01T19:56:21.435 INFO:teuthology.orchestra.run.smithi155.stdout: "event": "dispatched", 2023-08-01T19:56:21.435 INFO:teuthology.orchestra.run.smithi155.stdout: "time": "2023-08-01T19:56:21.392757+0000", 2023-08-01T19:56:21.435 INFO:teuthology.orchestra.run.smithi155.stdout: "duration": 7.5549999999999997e-06 2023-08-01T19:56:21.435 INFO:teuthology.orchestra.run.smithi155.stdout: }, 2023-08-01T19:56:21.435 INFO:teuthology.orchestra.run.smithi155.stdout: { 2023-08-01T19:56:21.435 INFO:teuthology.orchestra.run.smithi155.stdout: "event": "queued_for_pg", 2023-08-01T19:56:21.435 INFO:teuthology.orchestra.run.smithi155.stdout: "time": "2023-08-01T19:56:21.392761+0000", 2023-08-01T19:56:21.435 INFO:teuthology.orchestra.run.smithi155.stdout: "duration": 3.3469999999999999e-06 2023-08-01T19:56:21.436 INFO:teuthology.orchestra.run.smithi155.stdout: }, 2023-08-01T19:56:21.436 INFO:teuthology.orchestra.run.smithi155.stdout: { 2023-08-01T19:56:21.436 INFO:teuthology.orchestra.run.smithi155.stdout: "event": "reached_pg", 2023-08-01T19:56:21.436 INFO:teuthology.orchestra.run.smithi155.stdout: "time": "2023-08-01T19:56:21.394771+0000", 2023-08-01T19:56:21.436 INFO:teuthology.orchestra.run.smithi155.stdout: "duration": 0.002010801 2023-08-01T19:56:21.436 INFO:teuthology.orchestra.run.smithi155.stdout: }, 2023-08-01T19:56:21.436 INFO:teuthology.orchestra.run.smithi155.stdout: { 2023-08-01T19:56:21.436 INFO:teuthology.orchestra.run.smithi155.stdout: "event": "started", 2023-08-01T19:56:21.437 INFO:teuthology.orchestra.run.smithi155.stdout: "time": "2023-08-01T19:56:21.394868+0000", 2023-08-01T19:56:21.437 INFO:teuthology.orchestra.run.smithi155.stdout: "duration": 9.6210000000000002e-05 2023-08-01T19:56:21.437 INFO:teuthology.orchestra.run.smithi155.stdout: } 2023-08-01T19:56:21.437 INFO:teuthology.orchestra.run.smithi155.stdout: ] 2023-08-01T19:56:21.437 INFO:teuthology.orchestra.run.smithi155.stdout: } 2023-08-01T19:56:21.437 INFO:teuthology.orchestra.run.smithi155.stdout: }, 2023-08-01T19:56:21.437 INFO:teuthology.orchestra.run.smithi155.stdout: { 2023-08-01T19:56:21.437 INFO:teuthology.orchestra.run.smithi155.stdout: "description": "osd_op(client.4668.0:242300 5.e 5:7e628cd1:::benchmark_data_smithi006_114134_object108639:head [delete] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e71)", 2023-08-01T19:56:21.438 INFO:teuthology.orchestra.run.smithi155.stdout: "initiated_at": "2023-08-01T19:56:21.393117+0000", 2023-08-01T19:56:21.438 INFO:teuthology.orchestra.run.smithi155.stdout: "age": 0.002398786, 2023-08-01T19:56:21.438 INFO:teuthology.orchestra.run.smithi155.stdout: "duration": 0.0028331139999999999, 2023-08-01T19:56:21.438 INFO:teuthology.orchestra.run.smithi155.stdout: "type_data": { 2023-08-01T19:56:21.438 INFO:teuthology.orchestra.run.smithi155.stdout: "flag_point": "waiting for sub ops", 2023-08-01T19:56:21.438 INFO:teuthology.orchestra.run.smithi155.stdout: "client_info": { 2023-08-01T19:56:21.438 INFO:teuthology.orchestra.run.smithi155.stdout: "client": "client.4668", 2023-08-01T19:56:21.438 INFO:teuthology.orchestra.run.smithi155.stdout: "client_addr": "172.21.15.6:0/1709472247", 2023-08-01T19:56:21.439 INFO:teuthology.orchestra.run.smithi155.stdout: "tid": 242300 2023-08-01T19:56:21.439 INFO:teuthology.orchestra.run.smithi155.stdout: }, 2023-08-01T19:56:21.439 INFO:teuthology.orchestra.run.smithi155.stdout: "events": [ 2023-08-01T19:56:21.439 INFO:teuthology.orchestra.run.smithi155.stdout: { 2023-08-01T19:56:21.439 INFO:teuthology.orchestra.run.smithi155.stdout: "event": "initiated", 2023-08-01T19:56:21.439 INFO:teuthology.orchestra.run.smithi155.stdout: "time": "2023-08-01T19:56:21.393117+0000", 2023-08-01T19:56:21.439 INFO:teuthology.orchestra.run.smithi155.stdout: "duration": 0 2023-08-01T19:56:21.439 INFO:teuthology.orchestra.run.smithi155.stdout: }, 2023-08-01T19:56:21.440 INFO:teuthology.orchestra.run.smithi155.stdout: { 2023-08-01T19:56:21.440 INFO:teuthology.orchestra.run.smithi155.stdout: "event": "throttled", 2023-08-01T19:56:21.440 INFO:teuthology.orchestra.run.smithi155.stdout: "time": "2023-08-01T19:56:21.393117+0000", 2023-08-01T19:56:21.440 INFO:teuthology.orchestra.run.smithi155.stdout: "duration": 0 2023-08-01T19:56:21.440 INFO:teuthology.orchestra.run.smithi155.stdout: }, 2023-08-01T19:56:21.440 INFO:teuthology.orchestra.run.smithi155.stdout: { 2023-08-01T19:56:21.440 INFO:teuthology.orchestra.run.smithi155.stdout: "event": "header_read", 2023-08-01T19:56:21.440 INFO:teuthology.orchestra.run.smithi155.stdout: "time": "2023-08-01T19:56:21.393116+0000", 2023-08-01T19:56:21.441 INFO:teuthology.orchestra.run.smithi155.stdout: "duration": 4294967295.9999995 2023-08-01T19:56:21.441 INFO:teuthology.orchestra.run.smithi155.stdout: }, 2023-08-01T19:56:21.441 INFO:teuthology.orchestra.run.smithi155.stdout: { 2023-08-01T19:56:21.441 INFO:teuthology.orchestra.run.smithi155.stdout: "event": "all_read", 2023-08-01T19:56:21.441 INFO:teuthology.orchestra.run.smithi155.stdout: "time": "2023-08-01T19:56:21.393120+0000", 2023-08-01T19:56:21.441 INFO:teuthology.orchestra.run.smithi155.stdout: "duration": 4.3599999999999998e-06 2023-08-01T19:56:21.441 INFO:teuthology.orchestra.run.smithi155.stdout: }, 2023-08-01T19:56:21.441 INFO:teuthology.orchestra.run.smithi155.stdout: { 2023-08-01T19:56:21.442 INFO:teuthology.orchestra.run.smithi155.stdout: "event": "dispatched", 2023-08-01T19:56:21.442 INFO:teuthology.orchestra.run.smithi155.stdout: "time": "2023-08-01T19:56:21.393128+0000", 2023-08-01T19:56:21.442 INFO:teuthology.orchestra.run.smithi155.stdout: "duration": 8.2509999999999994e-06 2023-08-01T19:56:21.442 INFO:teuthology.orchestra.run.smithi155.stdout: }, 2023-08-01T19:56:21.442 INFO:teuthology.orchestra.run.smithi155.stdout: { 2023-08-01T19:56:21.442 INFO:teuthology.orchestra.run.smithi155.stdout: "event": "queued_for_pg", 2023-08-01T19:56:21.442 INFO:teuthology.orchestra.run.smithi155.stdout: "time": "2023-08-01T19:56:21.393134+0000", 2023-08-01T19:56:21.443 INFO:teuthology.orchestra.run.smithi155.stdout: "duration": 6.0480000000000004e-06 2023-08-01T19:56:21.443 INFO:teuthology.orchestra.run.smithi155.stdout: }, 2023-08-01T19:56:21.443 INFO:teuthology.orchestra.run.smithi155.stdout: { 2023-08-01T19:56:21.443 INFO:teuthology.orchestra.run.smithi155.stdout: "event": "reached_pg", 2023-08-01T19:56:21.443 INFO:teuthology.orchestra.run.smithi155.stdout: "time": "2023-08-01T19:56:21.393165+0000", 2023-08-01T19:56:21.443 INFO:teuthology.orchestra.run.smithi155.stdout: "duration": 3.0901000000000001e-05 2023-08-01T19:56:21.443 INFO:teuthology.orchestra.run.smithi155.stdout: }, 2023-08-01T19:56:21.443 INFO:teuthology.orchestra.run.smithi155.stdout: { 2023-08-01T19:56:21.444 INFO:teuthology.orchestra.run.smithi155.stdout: "event": "started", 2023-08-01T19:56:21.444 INFO:teuthology.orchestra.run.smithi155.stdout: "time": "2023-08-01T19:56:21.393256+0000", 2023-08-01T19:56:21.444 INFO:teuthology.orchestra.run.smithi155.stdout: "duration": 9.0251e-05 2023-08-01T19:56:21.444 INFO:teuthology.orchestra.run.smithi155.stdout: }, 2023-08-01T19:56:21.444 INFO:teuthology.orchestra.run.smithi155.stdout: { 2023-08-01T19:56:21.444 INFO:teuthology.orchestra.run.smithi155.stdout: "event": "waiting for subops from 0", 2023-08-01T19:56:21.444 INFO:teuthology.orchestra.run.smithi155.stdout: "time": "2023-08-01T19:56:21.393337+0000", 2023-08-01T19:56:21.444 INFO:teuthology.orchestra.run.smithi155.stdout: "duration": 8.0865999999999995e-05 2023-08-01T19:56:21.445 INFO:teuthology.orchestra.run.smithi155.stdout: } 2023-08-01T19:56:21.445 INFO:teuthology.orchestra.run.smithi155.stdout: ] 2023-08-01T19:56:21.445 INFO:teuthology.orchestra.run.smithi155.stdout: } 2023-08-01T19:56:21.445 INFO:teuthology.orchestra.run.smithi155.stdout: }, 2023-08-01T19:56:21.445 INFO:teuthology.orchestra.run.smithi155.stdout: { 2023-08-01T19:56:21.445 INFO:teuthology.orchestra.run.smithi155.stdout: "description": "osd_op(client.4668.0:242301 5.f 5:fb443dce:::benchmark_data_smithi006_114134_object108640:head [delete] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e71)", 2023-08-01T19:56:21.445 INFO:teuthology.orchestra.run.smithi155.stdout: "initiated_at": "2023-08-01T19:56:21.393143+0000", 2023-08-01T19:56:21.445 INFO:teuthology.orchestra.run.smithi155.stdout: "age": 0.00237221, 2023-08-01T19:56:21.446 INFO:teuthology.orchestra.run.smithi155.stdout: "duration": 0.0028819729999999999, 2023-08-01T19:56:21.446 INFO:teuthology.orchestra.run.smithi155.stdout: "type_data": { 2023-08-01T19:56:21.446 INFO:teuthology.orchestra.run.smithi155.stdout: "flag_point": "started", 2023-08-01T19:56:21.446 INFO:teuthology.orchestra.run.smithi155.stdout: "client_info": { 2023-08-01T19:56:21.446 INFO:teuthology.orchestra.run.smithi155.stdout: "client": "client.4668", 2023-08-01T19:56:21.446 INFO:teuthology.orchestra.run.smithi155.stdout: "client_addr": "172.21.15.6:0/1709472247", 2023-08-01T19:56:21.446 INFO:teuthology.orchestra.run.smithi155.stdout: "tid": 242301 2023-08-01T19:56:21.446 INFO:teuthology.orchestra.run.smithi155.stdout: }, 2023-08-01T19:56:21.447 INFO:teuthology.orchestra.run.smithi155.stdout: "events": [ 2023-08-01T19:56:21.447 INFO:teuthology.orchestra.run.smithi155.stdout: { 2023-08-01T19:56:21.447 INFO:teuthology.orchestra.run.smithi155.stdout: "event": "initiated", 2023-08-01T19:56:21.447 INFO:teuthology.orchestra.run.smithi155.stdout: "time": "2023-08-01T19:56:21.393143+0000", 2023-08-01T19:56:21.447 INFO:teuthology.orchestra.run.smithi155.stdout: "duration": 0 2023-08-01T19:56:21.447 INFO:teuthology.orchestra.run.smithi155.stdout: }, 2023-08-01T19:56:21.447 INFO:teuthology.orchestra.run.smithi155.stdout: { 2023-08-01T19:56:21.447 INFO:teuthology.orchestra.run.smithi155.stdout: "event": "throttled", 2023-08-01T19:56:21.448 INFO:teuthology.orchestra.run.smithi155.stdout: "time": "2023-08-01T19:56:21.393143+0000", 2023-08-01T19:56:21.448 INFO:teuthology.orchestra.run.smithi155.stdout: "duration": 0 2023-08-01T19:56:21.448 INFO:teuthology.orchestra.run.smithi155.stdout: }, 2023-08-01T19:56:21.448 INFO:teuthology.orchestra.run.smithi155.stdout: { 2023-08-01T19:56:21.448 INFO:teuthology.orchestra.run.smithi155.stdout: "event": "header_read", 2023-08-01T19:56:21.448 INFO:teuthology.orchestra.run.smithi155.stdout: "time": "2023-08-01T19:56:21.393143+0000", 2023-08-01T19:56:21.448 INFO:teuthology.orchestra.run.smithi155.stdout: "duration": 4294967295.9999995 2023-08-01T19:56:21.449 INFO:teuthology.orchestra.run.smithi155.stdout: }, 2023-08-01T19:56:21.449 INFO:teuthology.orchestra.run.smithi155.stdout: { 2023-08-01T19:56:21.449 INFO:teuthology.orchestra.run.smithi155.stdout: "event": "all_read", 2023-08-01T19:56:21.449 INFO:teuthology.orchestra.run.smithi155.stdout: "time": "2023-08-01T19:56:21.393145+0000", 2023-08-01T19:56:21.449 INFO:teuthology.orchestra.run.smithi155.stdout: "duration": 2.3800000000000001e-06 2023-08-01T19:56:21.449 INFO:teuthology.orchestra.run.smithi155.stdout: }, 2023-08-01T19:56:21.449 INFO:teuthology.orchestra.run.smithi155.stdout: { 2023-08-01T19:56:21.450 INFO:teuthology.orchestra.run.smithi155.stdout: "event": "dispatched", 2023-08-01T19:56:21.450 INFO:teuthology.orchestra.run.smithi155.stdout: "time": "2023-08-01T19:56:21.393151+0000", 2023-08-01T19:56:21.450 INFO:teuthology.orchestra.run.smithi155.stdout: "duration": 6.1630000000000001e-06 2023-08-01T19:56:21.450 INFO:teuthology.orchestra.run.smithi155.stdout: }, 2023-08-01T19:56:21.450 INFO:teuthology.orchestra.run.smithi155.stdout: { 2023-08-01T19:56:21.450 INFO:teuthology.orchestra.run.smithi155.stdout: "event": "queued_for_pg", 2023-08-01T19:56:21.450 INFO:teuthology.orchestra.run.smithi155.stdout: "time": "2023-08-01T19:56:21.393156+0000", 2023-08-01T19:56:21.450 INFO:teuthology.orchestra.run.smithi155.stdout: "duration": 4.972e-06 2023-08-01T19:56:21.451 INFO:teuthology.orchestra.run.smithi155.stdout: }, 2023-08-01T19:56:21.451 INFO:teuthology.orchestra.run.smithi155.stdout: { 2023-08-01T19:56:21.451 INFO:teuthology.orchestra.run.smithi155.stdout: "event": "reached_pg", 2023-08-01T19:56:21.451 INFO:teuthology.orchestra.run.smithi155.stdout: "time": "2023-08-01T19:56:21.393236+0000", 2023-08-01T19:56:21.451 INFO:teuthology.orchestra.run.smithi155.stdout: "duration": 8.0273999999999997e-05 2023-08-01T19:56:21.451 INFO:teuthology.orchestra.run.smithi155.stdout: }, 2023-08-01T19:56:21.451 INFO:teuthology.orchestra.run.smithi155.stdout: { 2023-08-01T19:56:21.451 INFO:teuthology.orchestra.run.smithi155.stdout: "event": "started", 2023-08-01T19:56:21.452 INFO:teuthology.orchestra.run.smithi155.stdout: "time": "2023-08-01T19:56:21.393362+0000", 2023-08-01T19:56:21.452 INFO:teuthology.orchestra.run.smithi155.stdout: "duration": 0.000125726 2023-08-01T19:56:21.452 INFO:teuthology.orchestra.run.smithi155.stdout: } 2023-08-01T19:56:21.452 INFO:teuthology.orchestra.run.smithi155.stdout: ] 2023-08-01T19:56:21.452 INFO:teuthology.orchestra.run.smithi155.stdout: } 2023-08-01T19:56:21.452 INFO:teuthology.orchestra.run.smithi155.stdout: }, 2023-08-01T19:56:21.452 INFO:teuthology.orchestra.run.smithi155.stdout: { 2023-08-01T19:56:21.452 INFO:teuthology.orchestra.run.smithi155.stdout: "description": "osd_op(client.4668.0:242302 5.e 5:7e8ea09f:::benchmark_data_smithi006_114134_object108641:head [delete] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e71)", 2023-08-01T19:56:21.453 INFO:teuthology.orchestra.run.smithi155.stdout: "initiated_at": "2023-08-01T19:56:21.393168+0000", 2023-08-01T19:56:21.453 INFO:teuthology.orchestra.run.smithi155.stdout: "age": 0.0023468299999999998, 2023-08-01T19:56:21.453 INFO:teuthology.orchestra.run.smithi155.stdout: "duration": 0.0029259189999999999, 2023-08-01T19:56:21.453 INFO:teuthology.orchestra.run.smithi155.stdout: "type_data": { 2023-08-01T19:56:21.453 INFO:teuthology.orchestra.run.smithi155.stdout: "flag_point": "waiting for sub ops", 2023-08-01T19:56:21.453 INFO:teuthology.orchestra.run.smithi155.stdout: "client_info": { 2023-08-01T19:56:21.453 INFO:teuthology.orchestra.run.smithi155.stdout: "client": "client.4668", 2023-08-01T19:56:21.454 INFO:teuthology.orchestra.run.smithi155.stdout: "client_addr": "172.21.15.6:0/1709472247", 2023-08-01T19:56:21.454 INFO:teuthology.orchestra.run.smithi155.stdout: "tid": 242302 2023-08-01T19:56:21.454 INFO:teuthology.orchestra.run.smithi155.stdout: }, 2023-08-01T19:56:21.454 INFO:teuthology.orchestra.run.smithi155.stdout: "events": [ 2023-08-01T19:56:21.454 INFO:teuthology.orchestra.run.smithi155.stdout: { 2023-08-01T19:56:21.454 INFO:teuthology.orchestra.run.smithi155.stdout: "event": "initiated", 2023-08-01T19:56:21.454 INFO:teuthology.orchestra.run.smithi155.stdout: "time": "2023-08-01T19:56:21.393168+0000", 2023-08-01T19:56:21.454 INFO:teuthology.orchestra.run.smithi155.stdout: "duration": 0 2023-08-01T19:56:21.455 INFO:teuthology.orchestra.run.smithi155.stdout: }, 2023-08-01T19:56:21.455 INFO:teuthology.orchestra.run.smithi155.stdout: { 2023-08-01T19:56:21.455 INFO:teuthology.orchestra.run.smithi155.stdout: "event": "throttled", 2023-08-01T19:56:21.455 INFO:teuthology.orchestra.run.smithi155.stdout: "time": "2023-08-01T19:56:21.393168+0000", 2023-08-01T19:56:21.455 INFO:teuthology.orchestra.run.smithi155.stdout: "duration": 0 2023-08-01T19:56:21.455 INFO:teuthology.orchestra.run.smithi155.stdout: }, 2023-08-01T19:56:21.455 INFO:teuthology.orchestra.run.smithi155.stdout: { 2023-08-01T19:56:21.455 INFO:teuthology.orchestra.run.smithi155.stdout: "event": "header_read", 2023-08-01T19:56:21.456 INFO:teuthology.orchestra.run.smithi155.stdout: "time": "2023-08-01T19:56:21.393168+0000", 2023-08-01T19:56:21.456 INFO:teuthology.orchestra.run.smithi155.stdout: "duration": 4294967295.9999995 2023-08-01T19:56:21.456 INFO:teuthology.orchestra.run.smithi155.stdout: }, 2023-08-01T19:56:21.456 INFO:teuthology.orchestra.run.smithi155.stdout: { 2023-08-01T19:56:21.456 INFO:teuthology.orchestra.run.smithi155.stdout: "event": "all_read", 2023-08-01T19:56:21.456 INFO:teuthology.orchestra.run.smithi155.stdout: "time": "2023-08-01T19:56:21.393170+0000", 2023-08-01T19:56:21.456 INFO:teuthology.orchestra.run.smithi155.stdout: "duration": 2.0990000000000001e-06 2023-08-01T19:56:21.456 INFO:teuthology.orchestra.run.smithi155.stdout: }, 2023-08-01T19:56:21.457 INFO:teuthology.orchestra.run.smithi155.stdout: { 2023-08-01T19:56:21.457 INFO:teuthology.orchestra.run.smithi155.stdout: "event": "dispatched", 2023-08-01T19:56:21.457 INFO:teuthology.orchestra.run.smithi155.stdout: "time": "2023-08-01T19:56:21.393174+0000", 2023-08-01T19:56:21.457 INFO:teuthology.orchestra.run.smithi155.stdout: "duration": 4.262e-06 2023-08-01T19:56:21.457 INFO:teuthology.orchestra.run.smithi155.stdout: }, 2023-08-01T19:56:21.457 INFO:teuthology.orchestra.run.smithi155.stdout: { 2023-08-01T19:56:21.457 INFO:teuthology.orchestra.run.smithi155.stdout: "event": "queued_for_pg", 2023-08-01T19:56:21.457 INFO:teuthology.orchestra.run.smithi155.stdout: "time": "2023-08-01T19:56:21.393182+0000", 2023-08-01T19:56:21.458 INFO:teuthology.orchestra.run.smithi155.stdout: "duration": 7.9170000000000006e-06 2023-08-01T19:56:21.458 INFO:teuthology.orchestra.run.smithi155.stdout: }, 2023-08-01T19:56:21.458 INFO:teuthology.orchestra.run.smithi155.stdout: { 2023-08-01T19:56:21.458 INFO:teuthology.orchestra.run.smithi155.stdout: "event": "reached_pg", 2023-08-01T19:56:21.458 INFO:teuthology.orchestra.run.smithi155.stdout: "time": "2023-08-01T19:56:21.394848+0000", 2023-08-01T19:56:21.458 INFO:teuthology.orchestra.run.smithi155.stdout: "duration": 0.0016652819999999999 2023-08-01T19:56:21.458 INFO:teuthology.orchestra.run.smithi155.stdout: }, 2023-08-01T19:56:21.458 INFO:teuthology.orchestra.run.smithi155.stdout: { 2023-08-01T19:56:21.459 INFO:teuthology.orchestra.run.smithi155.stdout: "event": "started", 2023-08-01T19:56:21.459 INFO:teuthology.orchestra.run.smithi155.stdout: "time": "2023-08-01T19:56:21.394951+0000", 2023-08-01T19:56:21.459 INFO:teuthology.orchestra.run.smithi155.stdout: "duration": 0.000103781 2023-08-01T19:56:21.459 INFO:teuthology.orchestra.run.smithi155.stdout: }, 2023-08-01T19:56:21.459 INFO:teuthology.orchestra.run.smithi155.stdout: { 2023-08-01T19:56:21.459 INFO:teuthology.orchestra.run.smithi155.stdout: "event": "waiting for subops from 0", 2023-08-01T19:56:21.459 INFO:teuthology.orchestra.run.smithi155.stdout: "time": "2023-08-01T19:56:21.395056+0000", 2023-08-01T19:56:21.459 INFO:teuthology.orchestra.run.smithi155.stdout: "duration": 0.000104794 2023-08-01T19:56:21.460 INFO:teuthology.orchestra.run.smithi155.stdout: } 2023-08-01T19:56:21.460 INFO:teuthology.orchestra.run.smithi155.stdout: ] 2023-08-01T19:56:21.460 INFO:teuthology.orchestra.run.smithi155.stdout: } 2023-08-01T19:56:21.460 INFO:teuthology.orchestra.run.smithi155.stdout: }, 2023-08-01T19:56:21.460 INFO:teuthology.orchestra.run.smithi155.stdout: { 2023-08-01T19:56:21.460 INFO:teuthology.orchestra.run.smithi155.stdout: "description": "osd_op(client.4668.0:242303 5.9 5.390fc259 (undecoded) ondisk+write+known_if_redirected+supports_pool_eio e71)", 2023-08-01T19:56:21.460 INFO:teuthology.orchestra.run.smithi155.stdout: "initiated_at": "2023-08-01T19:56:21.393188+0000", 2023-08-01T19:56:21.461 INFO:teuthology.orchestra.run.smithi155.stdout: "age": 0.0023277459999999999, 2023-08-01T19:56:21.461 INFO:teuthology.orchestra.run.smithi155.stdout: "duration": 0.0029799129999999998, 2023-08-01T19:56:21.461 INFO:teuthology.orchestra.run.smithi155.stdout: "type_data": { 2023-08-01T19:56:21.461 INFO:teuthology.orchestra.run.smithi155.stdout: "flag_point": "queued for pg", 2023-08-01T19:56:21.461 INFO:teuthology.orchestra.run.smithi155.stdout: "client_info": { 2023-08-01T19:56:21.461 INFO:teuthology.orchestra.run.smithi155.stdout: "client": "client.4668", 2023-08-01T19:56:21.461 INFO:teuthology.orchestra.run.smithi155.stdout: "client_addr": "172.21.15.6:0/1709472247", 2023-08-01T19:56:21.461 INFO:teuthology.orchestra.run.smithi155.stdout: "tid": 242303 2023-08-01T19:56:21.462 INFO:teuthology.orchestra.run.smithi155.stdout: }, 2023-08-01T19:56:21.462 INFO:teuthology.orchestra.run.smithi155.stdout: "events": [ 2023-08-01T19:56:21.462 INFO:teuthology.orchestra.run.smithi155.stdout: { 2023-08-01T19:56:21.462 INFO:teuthology.orchestra.run.smithi155.stdout: "event": "initiated", 2023-08-01T19:56:21.462 INFO:teuthology.orchestra.run.smithi155.stdout: "time": "2023-08-01T19:56:21.393188+0000", 2023-08-01T19:56:21.462 INFO:teuthology.orchestra.run.smithi155.stdout: "duration": 0 2023-08-01T19:56:21.462 INFO:teuthology.orchestra.run.smithi155.stdout: }, 2023-08-01T19:56:21.462 INFO:teuthology.orchestra.run.smithi155.stdout: { 2023-08-01T19:56:21.463 INFO:teuthology.orchestra.run.smithi155.stdout: "event": "throttled", 2023-08-01T19:56:21.463 INFO:teuthology.orchestra.run.smithi155.stdout: "time": "2023-08-01T19:56:21.393188+0000", 2023-08-01T19:56:21.463 INFO:teuthology.orchestra.run.smithi155.stdout: "duration": 0 2023-08-01T19:56:21.463 INFO:teuthology.orchestra.run.smithi155.stdout: }, 2023-08-01T19:56:21.463 INFO:teuthology.orchestra.run.smithi155.stdout: { 2023-08-01T19:56:21.463 INFO:teuthology.orchestra.run.smithi155.stdout: "event": "header_read", 2023-08-01T19:56:21.463 INFO:teuthology.orchestra.run.smithi155.stdout: "time": "2023-08-01T19:56:21.393187+0000", 2023-08-01T19:56:21.463 INFO:teuthology.orchestra.run.smithi155.stdout: "duration": 4294967295.9999995 2023-08-01T19:56:21.464 INFO:teuthology.orchestra.run.smithi155.stdout: }, 2023-08-01T19:56:21.464 INFO:teuthology.orchestra.run.smithi155.stdout: { 2023-08-01T19:56:21.464 INFO:teuthology.orchestra.run.smithi155.stdout: "event": "all_read", 2023-08-01T19:56:21.464 INFO:teuthology.orchestra.run.smithi155.stdout: "time": "2023-08-01T19:56:21.393189+0000", 2023-08-01T19:56:21.464 INFO:teuthology.orchestra.run.smithi155.stdout: "duration": 1.8610000000000001e-06 2023-08-01T19:56:21.464 INFO:teuthology.orchestra.run.smithi155.stdout: }, 2023-08-01T19:56:21.464 INFO:teuthology.orchestra.run.smithi155.stdout: { 2023-08-01T19:56:21.464 INFO:teuthology.orchestra.run.smithi155.stdout: "event": "dispatched", 2023-08-01T19:56:21.465 INFO:teuthology.orchestra.run.smithi155.stdout: "time": "2023-08-01T19:56:21.393193+0000", 2023-08-01T19:56:21.465 INFO:teuthology.orchestra.run.smithi155.stdout: "duration": 4.3139999999999997e-06 2023-08-01T19:56:21.465 INFO:teuthology.orchestra.run.smithi155.stdout: }, 2023-08-01T19:56:21.465 INFO:teuthology.orchestra.run.smithi155.stdout: { 2023-08-01T19:56:21.465 INFO:teuthology.orchestra.run.smithi155.stdout: "event": "queued_for_pg", 2023-08-01T19:56:21.465 INFO:teuthology.orchestra.run.smithi155.stdout: "time": "2023-08-01T19:56:21.393196+0000", 2023-08-01T19:56:21.465 INFO:teuthology.orchestra.run.smithi155.stdout: "duration": 2.159e-06 2023-08-01T19:56:21.465 INFO:teuthology.orchestra.run.smithi155.stdout: } 2023-08-01T19:56:21.466 INFO:teuthology.orchestra.run.smithi155.stdout: ] 2023-08-01T19:56:21.466 INFO:teuthology.orchestra.run.smithi155.stdout: } 2023-08-01T19:56:21.466 INFO:teuthology.orchestra.run.smithi155.stdout: }, 2023-08-01T19:56:21.466 INFO:teuthology.orchestra.run.smithi155.stdout: { 2023-08-01T19:56:21.466 INFO:teuthology.orchestra.run.smithi155.stdout: "description": "osd_op(client.4668.0:242304 5.4 5:2e3294e9:::benchmark_data_smithi006_114134_object108643:head [delete] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e71)", 2023-08-01T19:56:21.466 INFO:teuthology.orchestra.run.smithi155.stdout: "initiated_at": "2023-08-01T19:56:21.393198+0000", 2023-08-01T19:56:21.466 INFO:teuthology.orchestra.run.smithi155.stdout: "age": 0.0023171989999999998, 2023-08-01T19:56:21.466 INFO:teuthology.orchestra.run.smithi155.stdout: "duration": 0.0030333439999999999, 2023-08-01T19:56:21.467 INFO:teuthology.orchestra.run.smithi155.stdout: "type_data": { 2023-08-01T19:56:21.467 INFO:teuthology.orchestra.run.smithi155.stdout: "flag_point": "waiting for sub ops", 2023-08-01T19:56:21.467 INFO:teuthology.orchestra.run.smithi155.stdout: "client_info": { 2023-08-01T19:56:21.467 INFO:teuthology.orchestra.run.smithi155.stdout: "client": "client.4668", 2023-08-01T19:56:21.467 INFO:teuthology.orchestra.run.smithi155.stdout: "client_addr": "172.21.15.6:0/1709472247", 2023-08-01T19:56:21.467 INFO:teuthology.orchestra.run.smithi155.stdout: "tid": 242304 2023-08-01T19:56:21.467 INFO:teuthology.orchestra.run.smithi155.stdout: }, 2023-08-01T19:56:21.467 INFO:teuthology.orchestra.run.smithi155.stdout: "events": [ 2023-08-01T19:56:21.468 INFO:teuthology.orchestra.run.smithi155.stdout: { 2023-08-01T19:56:21.468 INFO:teuthology.orchestra.run.smithi155.stdout: "event": "initiated", 2023-08-01T19:56:21.468 INFO:teuthology.orchestra.run.smithi155.stdout: "time": "2023-08-01T19:56:21.393198+0000", 2023-08-01T19:56:21.468 INFO:teuthology.orchestra.run.smithi155.stdout: "duration": 0 2023-08-01T19:56:21.468 INFO:teuthology.orchestra.run.smithi155.stdout: }, 2023-08-01T19:56:21.468 INFO:teuthology.orchestra.run.smithi155.stdout: { 2023-08-01T19:56:21.468 INFO:teuthology.orchestra.run.smithi155.stdout: "event": "throttled", 2023-08-01T19:56:21.469 INFO:teuthology.orchestra.run.smithi155.stdout: "time": "2023-08-01T19:56:21.393198+0000", 2023-08-01T19:56:21.469 INFO:teuthology.orchestra.run.smithi155.stdout: "duration": 0 2023-08-01T19:56:21.469 INFO:teuthology.orchestra.run.smithi155.stdout: }, 2023-08-01T19:56:21.469 INFO:teuthology.orchestra.run.smithi155.stdout: { 2023-08-01T19:56:21.469 INFO:teuthology.orchestra.run.smithi155.stdout: "event": "header_read", 2023-08-01T19:56:21.469 INFO:teuthology.orchestra.run.smithi155.stdout: "time": "2023-08-01T19:56:21.393198+0000", 2023-08-01T19:56:21.469 INFO:teuthology.orchestra.run.smithi155.stdout: "duration": 4294967296 2023-08-01T19:56:21.470 INFO:teuthology.orchestra.run.smithi155.stdout: }, 2023-08-01T19:56:21.470 INFO:teuthology.orchestra.run.smithi155.stdout: { 2023-08-01T19:56:21.470 INFO:teuthology.orchestra.run.smithi155.stdout: "event": "all_read", 2023-08-01T19:56:21.470 INFO:teuthology.orchestra.run.smithi155.stdout: "time": "2023-08-01T19:56:21.393199+0000", 2023-08-01T19:56:21.470 INFO:teuthology.orchestra.run.smithi155.stdout: "duration": 1.412e-06 2023-08-01T19:56:21.471 INFO:teuthology.orchestra.run.smithi155.stdout: }, 2023-08-01T19:56:21.471 INFO:teuthology.orchestra.run.smithi155.stdout: { 2023-08-01T19:56:21.471 INFO:teuthology.orchestra.run.smithi155.stdout: "event": "dispatched", 2023-08-01T19:56:21.471 INFO:teuthology.orchestra.run.smithi155.stdout: "time": "2023-08-01T19:56:21.393202+0000", 2023-08-01T19:56:21.471 INFO:teuthology.orchestra.run.smithi155.stdout: "duration": 3.0680000000000001e-06 2023-08-01T19:56:21.471 INFO:teuthology.orchestra.run.smithi155.stdout: }, 2023-08-01T19:56:21.472 INFO:teuthology.orchestra.run.smithi155.stdout: { 2023-08-01T19:56:21.472 INFO:teuthology.orchestra.run.smithi155.stdout: "event": "queued_for_pg", 2023-08-01T19:56:21.472 INFO:teuthology.orchestra.run.smithi155.stdout: "time": "2023-08-01T19:56:21.393204+0000", 2023-08-01T19:56:21.472 INFO:teuthology.orchestra.run.smithi155.stdout: "duration": 1.9309999999999998e-06 2023-08-01T19:56:21.472 INFO:teuthology.orchestra.run.smithi155.stdout: }, 2023-08-01T19:56:21.473 INFO:teuthology.orchestra.run.smithi155.stdout: { 2023-08-01T19:56:21.473 INFO:teuthology.orchestra.run.smithi155.stdout: "event": "reached_pg", 2023-08-01T19:56:21.473 INFO:teuthology.orchestra.run.smithi155.stdout: "time": "2023-08-01T19:56:21.393236+0000", 2023-08-01T19:56:21.473 INFO:teuthology.orchestra.run.smithi155.stdout: "duration": 3.1547000000000001e-05 2023-08-01T19:56:21.473 INFO:teuthology.orchestra.run.smithi155.stdout: }, 2023-08-01T19:56:21.474 INFO:teuthology.orchestra.run.smithi155.stdout: { 2023-08-01T19:56:21.474 INFO:teuthology.orchestra.run.smithi155.stdout: "event": "started", 2023-08-01T19:56:21.474 INFO:teuthology.orchestra.run.smithi155.stdout: "time": "2023-08-01T19:56:21.393346+0000", 2023-08-01T19:56:21.474 INFO:teuthology.orchestra.run.smithi155.stdout: "duration": 0.00011054599999999999 2023-08-01T19:56:21.474 INFO:teuthology.orchestra.run.smithi155.stdout: }, 2023-08-01T19:56:21.475 INFO:teuthology.orchestra.run.smithi155.stdout: { 2023-08-01T19:56:21.475 INFO:teuthology.orchestra.run.smithi155.stdout: "event": "waiting for subops from 0", 2023-08-01T19:56:21.475 INFO:teuthology.orchestra.run.smithi155.stdout: "time": "2023-08-01T19:56:21.393681+0000", 2023-08-01T19:56:21.475 INFO:teuthology.orchestra.run.smithi155.stdout: "duration": 0.00033436000000000002 2023-08-01T19:56:21.475 INFO:teuthology.orchestra.run.smithi155.stdout: } 2023-08-01T19:56:21.475 INFO:teuthology.orchestra.run.smithi155.stdout: ] 2023-08-01T19:56:21.476 INFO:teuthology.orchestra.run.smithi155.stdout: } 2023-08-01T19:56:21.476 INFO:teuthology.orchestra.run.smithi155.stdout: }, 2023-08-01T19:56:21.476 INFO:teuthology.orchestra.run.smithi155.stdout: { 2023-08-01T19:56:21.476 INFO:teuthology.orchestra.run.smithi155.stdout: "description": "osd_op(client.4668.0:242307 5.0 5:05f01514:::benchmark_data_smithi006_114134_object108646:head [delete] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e71)", 2023-08-01T19:56:21.476 INFO:teuthology.orchestra.run.smithi155.stdout: "initiated_at": "2023-08-01T19:56:21.393297+0000", 2023-08-01T19:56:21.476 INFO:teuthology.orchestra.run.smithi155.stdout: "age": 0.0022186089999999999, 2023-08-01T19:56:21.476 INFO:teuthology.orchestra.run.smithi155.stdout: "duration": 0.0030122819999999998, 2023-08-01T19:56:21.477 INFO:teuthology.orchestra.run.smithi155.stdout: "type_data": { 2023-08-01T19:56:21.477 INFO:teuthology.orchestra.run.smithi155.stdout: "flag_point": "waiting for sub ops", 2023-08-01T19:56:21.477 INFO:teuthology.orchestra.run.smithi155.stdout: "client_info": { 2023-08-01T19:56:21.477 INFO:teuthology.orchestra.run.smithi155.stdout: "client": "client.4668", 2023-08-01T19:56:21.477 INFO:teuthology.orchestra.run.smithi155.stdout: "client_addr": "172.21.15.6:0/1709472247", 2023-08-01T19:56:21.477 INFO:teuthology.orchestra.run.smithi155.stdout: "tid": 242307 2023-08-01T19:56:21.477 INFO:teuthology.orchestra.run.smithi155.stdout: }, 2023-08-01T19:56:21.477 INFO:teuthology.orchestra.run.smithi155.stdout: "events": [ 2023-08-01T19:56:21.478 INFO:teuthology.orchestra.run.smithi155.stdout: { 2023-08-01T19:56:21.478 INFO:teuthology.orchestra.run.smithi155.stdout: "event": "initiated", 2023-08-01T19:56:21.478 INFO:teuthology.orchestra.run.smithi155.stdout: "time": "2023-08-01T19:56:21.393297+0000", 2023-08-01T19:56:21.478 INFO:teuthology.orchestra.run.smithi155.stdout: "duration": 0 2023-08-01T19:56:21.478 INFO:teuthology.orchestra.run.smithi155.stdout: }, 2023-08-01T19:56:21.478 INFO:teuthology.orchestra.run.smithi155.stdout: { 2023-08-01T19:56:21.478 INFO:teuthology.orchestra.run.smithi155.stdout: "event": "throttled", 2023-08-01T19:56:21.479 INFO:teuthology.orchestra.run.smithi155.stdout: "time": "2023-08-01T19:56:21.393297+0000", 2023-08-01T19:56:21.479 INFO:teuthology.orchestra.run.smithi155.stdout: "duration": 0 2023-08-01T19:56:21.479 INFO:teuthology.orchestra.run.smithi155.stdout: }, 2023-08-01T19:56:21.479 INFO:teuthology.orchestra.run.smithi155.stdout: { 2023-08-01T19:56:21.479 INFO:teuthology.orchestra.run.smithi155.stdout: "event": "header_read", 2023-08-01T19:56:21.479 INFO:teuthology.orchestra.run.smithi155.stdout: "time": "2023-08-01T19:56:21.393296+0000", 2023-08-01T19:56:21.479 INFO:teuthology.orchestra.run.smithi155.stdout: "duration": 4294967295.9999995 2023-08-01T19:56:21.479 INFO:teuthology.orchestra.run.smithi155.stdout: }, 2023-08-01T19:56:21.480 INFO:teuthology.orchestra.run.smithi155.stdout: { 2023-08-01T19:56:21.480 INFO:teuthology.orchestra.run.smithi155.stdout: "event": "all_read", 2023-08-01T19:56:21.480 INFO:teuthology.orchestra.run.smithi155.stdout: "time": "2023-08-01T19:56:21.393300+0000", 2023-08-01T19:56:21.480 INFO:teuthology.orchestra.run.smithi155.stdout: "duration": 3.7100000000000001e-06 2023-08-01T19:56:21.480 INFO:teuthology.orchestra.run.smithi155.stdout: }, 2023-08-01T19:56:21.480 INFO:teuthology.orchestra.run.smithi155.stdout: { 2023-08-01T19:56:21.480 INFO:teuthology.orchestra.run.smithi155.stdout: "event": "dispatched", 2023-08-01T19:56:21.480 INFO:teuthology.orchestra.run.smithi155.stdout: "time": "2023-08-01T19:56:21.393310+0000", 2023-08-01T19:56:21.481 INFO:teuthology.orchestra.run.smithi155.stdout: "duration": 1.0684e-05 2023-08-01T19:56:21.481 INFO:teuthology.orchestra.run.smithi155.stdout: }, 2023-08-01T19:56:21.481 INFO:teuthology.orchestra.run.smithi155.stdout: { 2023-08-01T19:56:21.481 INFO:teuthology.orchestra.run.smithi155.stdout: "event": "queued_for_pg", 2023-08-01T19:56:21.481 INFO:teuthology.orchestra.run.smithi155.stdout: "time": "2023-08-01T19:56:21.393315+0000", 2023-08-01T19:56:21.481 INFO:teuthology.orchestra.run.smithi155.stdout: "duration": 4.9389999999999996e-06 2023-08-01T19:56:21.481 INFO:teuthology.orchestra.run.smithi155.stdout: }, 2023-08-01T19:56:21.482 INFO:teuthology.orchestra.run.smithi155.stdout: { 2023-08-01T19:56:21.482 INFO:teuthology.orchestra.run.smithi155.stdout: "event": "reached_pg", 2023-08-01T19:56:21.482 INFO:teuthology.orchestra.run.smithi155.stdout: "time": "2023-08-01T19:56:21.395392+0000", 2023-08-01T19:56:21.482 INFO:teuthology.orchestra.run.smithi155.stdout: "duration": 0.0020768290000000001 2023-08-01T19:56:21.482 INFO:teuthology.orchestra.run.smithi155.stdout: }, 2023-08-01T19:56:21.482 INFO:teuthology.orchestra.run.smithi155.stdout: { 2023-08-01T19:56:21.482 INFO:teuthology.orchestra.run.smithi155.stdout: "event": "started", 2023-08-01T19:56:21.482 INFO:teuthology.orchestra.run.smithi155.stdout: "time": "2023-08-01T19:56:21.395489+0000", 2023-08-01T19:56:21.483 INFO:teuthology.orchestra.run.smithi155.stdout: "duration": 9.7027000000000005e-05 2023-08-01T19:56:21.483 INFO:teuthology.orchestra.run.smithi155.stdout: }, 2023-08-01T19:56:21.483 INFO:teuthology.orchestra.run.smithi155.stdout: { 2023-08-01T19:56:21.483 INFO:teuthology.orchestra.run.smithi155.stdout: "event": "waiting for subops from 0", 2023-08-01T19:56:21.483 INFO:teuthology.orchestra.run.smithi155.stdout: "time": "2023-08-01T19:56:21.395597+0000", 2023-08-01T19:56:21.483 INFO:teuthology.orchestra.run.smithi155.stdout: "duration": 0.000108193 2023-08-01T19:56:21.483 INFO:teuthology.orchestra.run.smithi155.stdout: } 2023-08-01T19:56:21.483 INFO:teuthology.orchestra.run.smithi155.stdout: ] 2023-08-01T19:56:21.484 INFO:teuthology.orchestra.run.smithi155.stdout: } 2023-08-01T19:56:21.484 INFO:teuthology.orchestra.run.smithi155.stdout: }, 2023-08-01T19:56:21.484 INFO:teuthology.orchestra.run.smithi155.stdout: { 2023-08-01T19:56:21.484 INFO:teuthology.orchestra.run.smithi155.stdout: "description": "osd_repop_reply(client.4668.0:242295 5.e e71/19)", 2023-08-01T19:56:21.484 INFO:teuthology.orchestra.run.smithi155.stdout: "initiated_at": "2023-08-01T19:56:21.395233+0000", 2023-08-01T19:56:21.484 INFO:teuthology.orchestra.run.smithi155.stdout: "age": 0.00028270200000000002, 2023-08-01T19:56:21.484 INFO:teuthology.orchestra.run.smithi155.stdout: "duration": 0.0011473449999999999, 2023-08-01T19:56:21.485 INFO:teuthology.orchestra.run.smithi155.stdout: "type_data": { 2023-08-01T19:56:21.485 INFO:teuthology.orchestra.run.smithi155.stdout: "flag_point": "queued for pg", 2023-08-01T19:56:21.485 INFO:teuthology.orchestra.run.smithi155.stdout: "events": [ 2023-08-01T19:56:21.485 INFO:teuthology.orchestra.run.smithi155.stdout: { 2023-08-01T19:56:21.485 INFO:teuthology.orchestra.run.smithi155.stdout: "event": "initiated", 2023-08-01T19:56:21.485 INFO:teuthology.orchestra.run.smithi155.stdout: "time": "2023-08-01T19:56:21.395233+0000", 2023-08-01T19:56:21.485 INFO:teuthology.orchestra.run.smithi155.stdout: "duration": 0 2023-08-01T19:56:21.485 INFO:teuthology.orchestra.run.smithi155.stdout: }, 2023-08-01T19:56:21.486 INFO:teuthology.orchestra.run.smithi155.stdout: { 2023-08-01T19:56:21.486 INFO:teuthology.orchestra.run.smithi155.stdout: "event": "throttled", 2023-08-01T19:56:21.486 INFO:teuthology.orchestra.run.smithi155.stdout: "time": "2023-08-01T19:56:21.395233+0000", 2023-08-01T19:56:21.486 INFO:teuthology.orchestra.run.smithi155.stdout: "duration": 0 2023-08-01T19:56:21.486 INFO:teuthology.orchestra.run.smithi155.stdout: }, 2023-08-01T19:56:21.486 INFO:teuthology.orchestra.run.smithi155.stdout: { 2023-08-01T19:56:21.486 INFO:teuthology.orchestra.run.smithi155.stdout: "event": "header_read", 2023-08-01T19:56:21.486 INFO:teuthology.orchestra.run.smithi155.stdout: "time": "2023-08-01T19:56:21.395232+0000", 2023-08-01T19:56:21.487 INFO:teuthology.orchestra.run.smithi155.stdout: "duration": 4294967296 2023-08-01T19:56:21.487 INFO:teuthology.orchestra.run.smithi155.stdout: }, 2023-08-01T19:56:21.487 INFO:teuthology.orchestra.run.smithi155.stdout: { 2023-08-01T19:56:21.487 INFO:teuthology.orchestra.run.smithi155.stdout: "event": "all_read", 2023-08-01T19:56:21.487 INFO:teuthology.orchestra.run.smithi155.stdout: "time": "2023-08-01T19:56:21.395234+0000", 2023-08-01T19:56:21.487 INFO:teuthology.orchestra.run.smithi155.stdout: "duration": 2.052e-06 2023-08-01T19:56:21.487 INFO:teuthology.orchestra.run.smithi155.stdout: }, 2023-08-01T19:56:21.487 INFO:teuthology.orchestra.run.smithi155.stdout: { 2023-08-01T19:56:21.488 INFO:teuthology.orchestra.run.smithi155.stdout: "event": "dispatched", 2023-08-01T19:56:21.488 INFO:teuthology.orchestra.run.smithi155.stdout: "time": "2023-08-01T19:56:21.395241+0000", 2023-08-01T19:56:21.488 INFO:teuthology.orchestra.run.smithi155.stdout: "duration": 6.1739999999999997e-06 2023-08-01T19:56:21.488 INFO:teuthology.orchestra.run.smithi155.stdout: }, 2023-08-01T19:56:21.488 INFO:teuthology.orchestra.run.smithi155.stdout: { 2023-08-01T19:56:21.488 INFO:teuthology.orchestra.run.smithi155.stdout: "event": "queued_for_pg", 2023-08-01T19:56:21.488 INFO:teuthology.orchestra.run.smithi155.stdout: "time": "2023-08-01T19:56:21.395244+0000", 2023-08-01T19:56:21.488 INFO:teuthology.orchestra.run.smithi155.stdout: "duration": 3.2679999999999999e-06 2023-08-01T19:56:21.489 INFO:teuthology.orchestra.run.smithi155.stdout: } 2023-08-01T19:56:21.489 INFO:teuthology.orchestra.run.smithi155.stdout: ] 2023-08-01T19:56:21.489 INFO:teuthology.orchestra.run.smithi155.stdout: } 2023-08-01T19:56:21.489 INFO:teuthology.orchestra.run.smithi155.stdout: }, 2023-08-01T19:56:21.489 INFO:teuthology.orchestra.run.smithi155.stdout: { 2023-08-01T19:56:21.489 INFO:teuthology.orchestra.run.smithi155.stdout: "description": "osd_op(client.4668.0:242308 5.d 5:b65de27f:::benchmark_data_smithi006_114134_object108647:head [delete] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e71)", 2023-08-01T19:56:21.489 INFO:teuthology.orchestra.run.smithi155.stdout: "initiated_at": "2023-08-01T19:56:21.396199+0000", 2023-08-01T19:56:21.489 INFO:teuthology.orchestra.run.smithi155.stdout: "age": 4294967295.9993167, 2023-08-01T19:56:21.490 INFO:teuthology.orchestra.run.smithi155.stdout: "duration": 0.00023801200000000001, 2023-08-01T19:56:21.490 INFO:teuthology.orchestra.run.smithi155.stdout: "type_data": { 2023-08-01T19:56:21.490 INFO:teuthology.orchestra.run.smithi155.stdout: "flag_point": "started", 2023-08-01T19:56:21.490 INFO:teuthology.orchestra.run.smithi155.stdout: "client_info": { 2023-08-01T19:56:21.490 INFO:teuthology.orchestra.run.smithi155.stdout: "client": "client.4668", 2023-08-01T19:56:21.490 INFO:teuthology.orchestra.run.smithi155.stdout: "client_addr": "172.21.15.6:0/1709472247", 2023-08-01T19:56:21.490 INFO:teuthology.orchestra.run.smithi155.stdout: "tid": 242308 2023-08-01T19:56:21.490 INFO:teuthology.orchestra.run.smithi155.stdout: }, 2023-08-01T19:56:21.491 INFO:teuthology.orchestra.run.smithi155.stdout: "events": [ 2023-08-01T19:56:21.491 INFO:teuthology.orchestra.run.smithi155.stdout: { 2023-08-01T19:56:21.491 INFO:teuthology.orchestra.run.smithi155.stdout: "event": "initiated", 2023-08-01T19:56:21.491 INFO:teuthology.orchestra.run.smithi155.stdout: "time": "2023-08-01T19:56:21.396199+0000", 2023-08-01T19:56:21.491 INFO:teuthology.orchestra.run.smithi155.stdout: "duration": 0 2023-08-01T19:56:21.491 INFO:teuthology.orchestra.run.smithi155.stdout: }, 2023-08-01T19:56:21.491 INFO:teuthology.orchestra.run.smithi155.stdout: { 2023-08-01T19:56:21.492 INFO:teuthology.orchestra.run.smithi155.stdout: "event": "throttled", 2023-08-01T19:56:21.492 INFO:teuthology.orchestra.run.smithi155.stdout: "time": "2023-08-01T19:56:21.396199+0000", 2023-08-01T19:56:21.492 INFO:teuthology.orchestra.run.smithi155.stdout: "duration": 0 2023-08-01T19:56:21.492 INFO:teuthology.orchestra.run.smithi155.stdout: }, 2023-08-01T19:56:21.492 INFO:teuthology.orchestra.run.smithi155.stdout: { 2023-08-01T19:56:21.492 INFO:teuthology.orchestra.run.smithi155.stdout: "event": "header_read", 2023-08-01T19:56:21.492 INFO:teuthology.orchestra.run.smithi155.stdout: "time": "2023-08-01T19:56:21.396198+0000", 2023-08-01T19:56:21.492 INFO:teuthology.orchestra.run.smithi155.stdout: "duration": 4294967295.999999 2023-08-01T19:56:21.493 INFO:teuthology.orchestra.run.smithi155.stdout: }, 2023-08-01T19:56:21.493 INFO:teuthology.orchestra.run.smithi155.stdout: { 2023-08-01T19:56:21.493 INFO:teuthology.orchestra.run.smithi155.stdout: "event": "all_read", 2023-08-01T19:56:21.493 INFO:teuthology.orchestra.run.smithi155.stdout: "time": "2023-08-01T19:56:21.396204+0000", 2023-08-01T19:56:21.493 INFO:teuthology.orchestra.run.smithi155.stdout: "duration": 6.3160000000000002e-06 2023-08-01T19:56:21.493 INFO:teuthology.orchestra.run.smithi155.stdout: }, 2023-08-01T19:56:21.493 INFO:teuthology.orchestra.run.smithi155.stdout: { 2023-08-01T19:56:21.493 INFO:teuthology.orchestra.run.smithi155.stdout: "event": "dispatched", 2023-08-01T19:56:21.494 INFO:teuthology.orchestra.run.smithi155.stdout: "time": "2023-08-01T19:56:21.396216+0000", 2023-08-01T19:56:21.494 INFO:teuthology.orchestra.run.smithi155.stdout: "duration": 1.2413e-05 2023-08-01T19:56:21.494 INFO:teuthology.orchestra.run.smithi155.stdout: }, 2023-08-01T19:56:21.494 INFO:teuthology.orchestra.run.smithi155.stdout: { 2023-08-01T19:56:21.494 INFO:teuthology.orchestra.run.smithi155.stdout: "event": "queued_for_pg", 2023-08-01T19:56:21.494 INFO:teuthology.orchestra.run.smithi155.stdout: "time": "2023-08-01T19:56:21.396223+0000", 2023-08-01T19:56:21.494 INFO:teuthology.orchestra.run.smithi155.stdout: "duration": 6.7329999999999997e-06 2023-08-01T19:56:21.494 INFO:teuthology.orchestra.run.smithi155.stdout: }, 2023-08-01T19:56:21.495 INFO:teuthology.orchestra.run.smithi155.stdout: { 2023-08-01T19:56:21.495 INFO:teuthology.orchestra.run.smithi155.stdout: "event": "reached_pg", 2023-08-01T19:56:21.495 INFO:teuthology.orchestra.run.smithi155.stdout: "time": "2023-08-01T19:56:21.396264+0000", 2023-08-01T19:56:21.495 INFO:teuthology.orchestra.run.smithi155.stdout: "duration": 4.087e-05 2023-08-01T19:56:21.495 INFO:teuthology.orchestra.run.smithi155.stdout: }, 2023-08-01T19:56:21.495 INFO:teuthology.orchestra.run.smithi155.stdout: { 2023-08-01T19:56:21.496 INFO:teuthology.orchestra.run.smithi155.stdout: "event": "started", 2023-08-01T19:56:21.496 INFO:teuthology.orchestra.run.smithi155.stdout: "time": "2023-08-01T19:56:21.396385+0000", 2023-08-01T19:56:21.496 INFO:teuthology.orchestra.run.smithi155.stdout: "duration": 0.000121243 2023-08-01T19:56:21.496 INFO:teuthology.orchestra.run.smithi155.stdout: } 2023-08-01T19:56:21.496 INFO:teuthology.orchestra.run.smithi155.stdout: ] 2023-08-01T19:56:21.496 INFO:teuthology.orchestra.run.smithi155.stdout: } 2023-08-01T19:56:21.496 INFO:teuthology.orchestra.run.smithi155.stdout: } 2023-08-01T19:56:21.497 INFO:teuthology.orchestra.run.smithi155.stdout: ], 2023-08-01T19:56:21.497 INFO:teuthology.orchestra.run.smithi155.stdout: "num_ops": 13 2023-08-01T19:56:21.497 INFO:teuthology.orchestra.run.smithi155.stdout:} 2023-08-01T19:56:21.498 DEBUG:teuthology.orchestra.run.smithi155:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 30 ceph --cluster ceph --admin-daemon /var/run/ceph/ceph-osd.2.asok dump_blocked_ops 2023-08-01T19:56:21.499 INFO:tasks.ceph.osd.2.smithi155.stderr:2023-08-01T19:56:21.496+0000 7faa5c6ac700 -1 received signal: Hangup from /usr/bin/python3 /bin/daemon-helper kill ceph-osd -f --cluster ceph -i 2 (PID: 111337) UID: 0 2023-08-01T19:56:21.599 INFO:tasks.daemonwatchdog.daemon_watchdog:daemon ceph.osd.1 is failed for ~18s 2023-08-01T19:56:21.599 INFO:tasks.ceph.osd.0.smithi008.stderr:2023-08-01T19:56:21.597+0000 7f16a58f4700 -1 received signal: Hangup from /usr/bin/python3 /bin/daemon-helper kill ceph-osd -f --cluster ceph -i 0 (PID: 111179) UID: 0 2023-08-01T19:56:21.700 INFO:tasks.ceph.osd.2.smithi155.stderr:2023-08-01T19:56:21.698+0000 7faa5c6ac700 -1 received signal: Hangup from /usr/bin/python3 /bin/daemon-helper kill ceph-osd -f --cluster ceph -i 2 (PID: 111337) UID: 0 2023-08-01T19:56:21.702 INFO:teuthology.orchestra.run.smithi155.stdout:{ 2023-08-01T19:56:21.702 INFO:teuthology.orchestra.run.smithi155.stdout: "ops": [], 2023-08-01T19:56:21.702 INFO:teuthology.orchestra.run.smithi155.stdout: "complaint_time": 30, 2023-08-01T19:56:21.702 INFO:teuthology.orchestra.run.smithi155.stdout: "num_blocked_ops": 0 2023-08-01T19:56:21.702 INFO:teuthology.orchestra.run.smithi155.stdout:} 2023-08-01T19:56:21.715 DEBUG:teuthology.orchestra.run.smithi155:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 30 ceph --cluster ceph --admin-daemon /var/run/ceph/ceph-osd.2.asok dump_historic_ops 2023-08-01T19:56:21.749 DEBUG:teuthology.orchestra.run.smithi006:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 120 ceph --cluster ceph -- tell 'osd.*' injectargs --osd_enable_op_tracker=false 2023-08-01T19:56:21.765 INFO:teuthology.orchestra.run.smithi006.stderr:set osd.2 primary-affinity to 0 (802) 2023-08-01T19:56:21.801 INFO:tasks.ceph.osd.0.smithi008.stderr:2023-08-01T19:56:21.799+0000 7f16a58f4700 -1 received signal: Hangup from /usr/bin/python3 /bin/daemon-helper kill ceph-osd -f --cluster ceph -i 0 (PID: 111179) UID: 0 2023-08-01T19:56:21.889 INFO:teuthology.orchestra.run.smithi155.stdout:{ 2023-08-01T19:56:21.889 INFO:teuthology.orchestra.run.smithi155.stdout: "size": 20, 2023-08-01T19:56:21.889 INFO:teuthology.orchestra.run.smithi155.stdout: "duration": 600, 2023-08-01T19:56:21.890 INFO:teuthology.orchestra.run.smithi155.stdout: "ops": [ 2023-08-01T19:56:21.890 INFO:teuthology.orchestra.run.smithi155.stdout: { 2023-08-01T19:56:21.890 INFO:teuthology.orchestra.run.smithi155.stdout: "description": "osd_op(client.4668.0:100237 5.4 5:2d68bec9:::benchmark_data_smithi006_114134_object100236:head [set-alloc-hint object_size 65536 write_size 65536,write 0~65536] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e37)", 2023-08-01T19:56:21.890 INFO:teuthology.orchestra.run.smithi155.stdout: "initiated_at": "2023-08-01T19:55:05.147736+0000", 2023-08-01T19:56:21.890 INFO:teuthology.orchestra.run.smithi155.stdout: "age": 76.739201519000005, 2023-08-01T19:56:21.890 INFO:teuthology.orchestra.run.smithi155.stdout: "duration": 0.071299464000000007, 2023-08-01T19:56:21.890 INFO:teuthology.orchestra.run.smithi155.stdout: "type_data": { 2023-08-01T19:56:21.891 INFO:teuthology.orchestra.run.smithi155.stdout: "flag_point": "commit sent; apply or cleanup", 2023-08-01T19:56:21.891 INFO:teuthology.orchestra.run.smithi155.stdout: "client_info": { 2023-08-01T19:56:21.891 INFO:teuthology.orchestra.run.smithi155.stdout: "client": "client.4668", 2023-08-01T19:56:21.891 INFO:teuthology.orchestra.run.smithi155.stdout: "client_addr": "172.21.15.6:0/1709472247", 2023-08-01T19:56:21.891 INFO:teuthology.orchestra.run.smithi155.stdout: "tid": 100237 2023-08-01T19:56:21.891 INFO:teuthology.orchestra.run.smithi155.stdout: }, 2023-08-01T19:56:21.891 INFO:teuthology.orchestra.run.smithi155.stdout: "events": [ 2023-08-01T19:56:21.891 INFO:teuthology.orchestra.run.smithi155.stdout: { 2023-08-01T19:56:21.892 INFO:teuthology.orchestra.run.smithi155.stdout: "event": "initiated", 2023-08-01T19:56:21.892 INFO:teuthology.orchestra.run.smithi155.stdout: "time": "2023-08-01T19:55:05.147736+0000", 2023-08-01T19:56:21.892 INFO:teuthology.orchestra.run.smithi155.stdout: "duration": 0 2023-08-01T19:56:21.892 INFO:teuthology.orchestra.run.smithi155.stdout: }, 2023-08-01T19:56:21.892 INFO:teuthology.orchestra.run.smithi155.stdout: { 2023-08-01T19:56:21.892 INFO:teuthology.orchestra.run.smithi155.stdout: "event": "throttled", 2023-08-01T19:56:21.892 INFO:teuthology.orchestra.run.smithi155.stdout: "time": "2023-08-01T19:55:05.147736+0000", 2023-08-01T19:56:21.893 INFO:teuthology.orchestra.run.smithi155.stdout: "duration": 0 2023-08-01T19:56:21.893 INFO:teuthology.orchestra.run.smithi155.stdout: }, 2023-08-01T19:56:21.893 INFO:teuthology.orchestra.run.smithi155.stdout: { 2023-08-01T19:56:21.893 INFO:teuthology.orchestra.run.smithi155.stdout: "event": "header_read", 2023-08-01T19:56:21.893 INFO:teuthology.orchestra.run.smithi155.stdout: "time": "2023-08-01T19:55:05.147736+0000", 2023-08-01T19:56:21.893 INFO:teuthology.orchestra.run.smithi155.stdout: "duration": 4294967295.9999995 2023-08-01T19:56:21.893 INFO:teuthology.orchestra.run.smithi155.stdout: }, 2023-08-01T19:56:21.893 INFO:teuthology.orchestra.run.smithi155.stdout: { 2023-08-01T19:56:21.894 INFO:teuthology.orchestra.run.smithi155.stdout: "event": "all_read", 2023-08-01T19:56:21.894 INFO:teuthology.orchestra.run.smithi155.stdout: "time": "2023-08-01T19:55:05.147766+0000", 2023-08-01T19:56:21.894 INFO:teuthology.orchestra.run.smithi155.stdout: "duration": 3.0394000000000001e-05 2023-08-01T19:56:21.894 INFO:teuthology.orchestra.run.smithi155.stdout: }, 2023-08-01T19:56:21.894 INFO:teuthology.orchestra.run.smithi155.stdout: { 2023-08-01T19:56:21.894 INFO:teuthology.orchestra.run.smithi155.stdout: "event": "dispatched", 2023-08-01T19:56:21.894 INFO:teuthology.orchestra.run.smithi155.stdout: "time": "2023-08-01T19:55:05.147771+0000", 2023-08-01T19:56:21.894 INFO:teuthology.orchestra.run.smithi155.stdout: "duration": 4.25e-06 2023-08-01T19:56:21.895 INFO:teuthology.orchestra.run.smithi155.stdout: }, 2023-08-01T19:56:21.895 INFO:teuthology.orchestra.run.smithi155.stdout: { 2023-08-01T19:56:21.895 INFO:teuthology.orchestra.run.smithi155.stdout: "event": "queued_for_pg", 2023-08-01T19:56:21.895 INFO:teuthology.orchestra.run.smithi155.stdout: "time": "2023-08-01T19:55:05.147773+0000", 2023-08-01T19:56:21.895 INFO:teuthology.orchestra.run.smithi155.stdout: "duration": 2.4159999999999998e-06 2023-08-01T19:56:21.895 INFO:teuthology.orchestra.run.smithi155.stdout: }, 2023-08-01T19:56:21.895 INFO:teuthology.orchestra.run.smithi155.stdout: { 2023-08-01T19:56:21.895 INFO:teuthology.orchestra.run.smithi155.stdout: "event": "reached_pg", 2023-08-01T19:56:21.896 INFO:teuthology.orchestra.run.smithi155.stdout: "time": "2023-08-01T19:55:05.149903+0000", 2023-08-01T19:56:21.896 INFO:teuthology.orchestra.run.smithi155.stdout: "duration": 0.002129948 2023-08-01T19:56:21.896 INFO:teuthology.orchestra.run.smithi155.stdout: }, 2023-08-01T19:56:21.896 INFO:teuthology.orchestra.run.smithi155.stdout: { 2023-08-01T19:56:21.896 INFO:teuthology.orchestra.run.smithi155.stdout: "event": "started", 2023-08-01T19:56:21.896 INFO:teuthology.orchestra.run.smithi155.stdout: "time": "2023-08-01T19:55:05.149982+0000", 2023-08-01T19:56:21.896 INFO:teuthology.orchestra.run.smithi155.stdout: "duration": 7.8706000000000002e-05 2023-08-01T19:56:21.897 INFO:teuthology.orchestra.run.smithi155.stdout: }, 2023-08-01T19:56:21.897 INFO:teuthology.orchestra.run.smithi155.stdout: { 2023-08-01T19:56:21.897 INFO:teuthology.orchestra.run.smithi155.stdout: "event": "waiting for subops from 0", 2023-08-01T19:56:21.897 INFO:teuthology.orchestra.run.smithi155.stdout: "time": "2023-08-01T19:55:05.150066+0000", 2023-08-01T19:56:21.897 INFO:teuthology.orchestra.run.smithi155.stdout: "duration": 8.4241999999999997e-05 2023-08-01T19:56:21.897 INFO:teuthology.orchestra.run.smithi155.stdout: }, 2023-08-01T19:56:21.897 INFO:teuthology.orchestra.run.smithi155.stdout: { 2023-08-01T19:56:21.897 INFO:teuthology.orchestra.run.smithi155.stdout: "event": "op_commit", 2023-08-01T19:56:21.898 INFO:teuthology.orchestra.run.smithi155.stdout: "time": "2023-08-01T19:55:05.154994+0000", 2023-08-01T19:56:21.898 INFO:teuthology.orchestra.run.smithi155.stdout: "duration": 0.0049277050000000001 2023-08-01T19:56:21.898 INFO:teuthology.orchestra.run.smithi155.stdout: }, 2023-08-01T19:56:21.898 INFO:teuthology.orchestra.run.smithi155.stdout: { 2023-08-01T19:56:21.898 INFO:teuthology.orchestra.run.smithi155.stdout: "event": "sub_op_commit_rec", 2023-08-01T19:56:21.898 INFO:teuthology.orchestra.run.smithi155.stdout: "time": "2023-08-01T19:55:05.218933+0000", 2023-08-01T19:56:21.898 INFO:teuthology.orchestra.run.smithi155.stdout: "duration": 0.063939916999999999 2023-08-01T19:56:21.898 INFO:teuthology.orchestra.run.smithi155.stdout: }, 2023-08-01T19:56:21.899 INFO:teuthology.orchestra.run.smithi155.stdout: { 2023-08-01T19:56:21.899 INFO:teuthology.orchestra.run.smithi155.stdout: "event": "commit_sent", 2023-08-01T19:56:21.899 INFO:teuthology.orchestra.run.smithi155.stdout: "time": "2023-08-01T19:55:05.218989+0000", 2023-08-01T19:56:21.899 INFO:teuthology.orchestra.run.smithi155.stdout: "duration": 5.5772000000000001e-05 2023-08-01T19:56:21.899 INFO:teuthology.orchestra.run.smithi155.stdout: }, 2023-08-01T19:56:21.899 INFO:teuthology.orchestra.run.smithi155.stdout: { 2023-08-01T19:56:21.899 INFO:teuthology.orchestra.run.smithi155.stdout: "event": "done", 2023-08-01T19:56:21.899 INFO:teuthology.orchestra.run.smithi155.stdout: "time": "2023-08-01T19:55:05.219036+0000", 2023-08-01T19:56:21.900 INFO:teuthology.orchestra.run.smithi155.stdout: "duration": 4.6526000000000001e-05 2023-08-01T19:56:21.900 INFO:teuthology.orchestra.run.smithi155.stdout: } 2023-08-01T19:56:21.900 INFO:teuthology.orchestra.run.smithi155.stdout: ] 2023-08-01T19:56:21.900 INFO:teuthology.orchestra.run.smithi155.stdout: } 2023-08-01T19:56:21.900 INFO:teuthology.orchestra.run.smithi155.stdout: }, 2023-08-01T19:56:21.900 INFO:teuthology.orchestra.run.smithi155.stdout: { 2023-08-01T19:56:21.900 INFO:teuthology.orchestra.run.smithi155.stdout: "description": "osd_op(client.4668.0:100242 5.8 5:16a314b8:::benchmark_data_smithi006_114134_object100241:head [set-alloc-hint object_size 65536 write_size 65536,write 0~65536] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e37)", 2023-08-01T19:56:21.901 INFO:teuthology.orchestra.run.smithi155.stdout: "initiated_at": "2023-08-01T19:55:05.150616+0000", 2023-08-01T19:56:21.901 INFO:teuthology.orchestra.run.smithi155.stdout: "age": 76.736321888999996, 2023-08-01T19:56:21.901 INFO:teuthology.orchestra.run.smithi155.stdout: "duration": 0.071105065999999995, 2023-08-01T19:56:21.901 INFO:teuthology.orchestra.run.smithi155.stdout: "type_data": { 2023-08-01T19:56:21.901 INFO:teuthology.orchestra.run.smithi155.stdout: "flag_point": "commit sent; apply or cleanup", 2023-08-01T19:56:21.901 INFO:teuthology.orchestra.run.smithi155.stdout: "client_info": { 2023-08-01T19:56:21.901 INFO:teuthology.orchestra.run.smithi155.stdout: "client": "client.4668", 2023-08-01T19:56:21.901 INFO:teuthology.orchestra.run.smithi155.stdout: "client_addr": "172.21.15.6:0/1709472247", 2023-08-01T19:56:21.902 INFO:teuthology.orchestra.run.smithi155.stdout: "tid": 100242 2023-08-01T19:56:21.902 INFO:teuthology.orchestra.run.smithi155.stdout: }, 2023-08-01T19:56:21.902 INFO:teuthology.orchestra.run.smithi155.stdout: "events": [ 2023-08-01T19:56:21.902 INFO:teuthology.orchestra.run.smithi155.stdout: { 2023-08-01T19:56:21.902 INFO:teuthology.orchestra.run.smithi155.stdout: "event": "initiated", 2023-08-01T19:56:21.902 INFO:teuthology.orchestra.run.smithi155.stdout: "time": "2023-08-01T19:55:05.150616+0000", 2023-08-01T19:56:21.902 INFO:teuthology.orchestra.run.smithi155.stdout: "duration": 0 2023-08-01T19:56:21.902 INFO:teuthology.orchestra.run.smithi155.stdout: }, 2023-08-01T19:56:21.903 INFO:teuthology.orchestra.run.smithi155.stdout: { 2023-08-01T19:56:21.903 INFO:teuthology.orchestra.run.smithi155.stdout: "event": "throttled", 2023-08-01T19:56:21.903 INFO:teuthology.orchestra.run.smithi155.stdout: "time": "2023-08-01T19:55:05.150616+0000", 2023-08-01T19:56:21.903 INFO:teuthology.orchestra.run.smithi155.stdout: "duration": 0 2023-08-01T19:56:21.903 INFO:teuthology.orchestra.run.smithi155.stdout: }, 2023-08-01T19:56:21.903 INFO:teuthology.orchestra.run.smithi155.stdout: { 2023-08-01T19:56:21.903 INFO:teuthology.orchestra.run.smithi155.stdout: "event": "header_read", 2023-08-01T19:56:21.903 INFO:teuthology.orchestra.run.smithi155.stdout: "time": "2023-08-01T19:55:05.150615+0000", 2023-08-01T19:56:21.904 INFO:teuthology.orchestra.run.smithi155.stdout: "duration": 4294967295.999999 2023-08-01T19:56:21.904 INFO:teuthology.orchestra.run.smithi155.stdout: }, 2023-08-01T19:56:21.904 INFO:teuthology.orchestra.run.smithi155.stdout: { 2023-08-01T19:56:21.904 INFO:teuthology.orchestra.run.smithi155.stdout: "event": "all_read", 2023-08-01T19:56:21.904 INFO:teuthology.orchestra.run.smithi155.stdout: "time": "2023-08-01T19:55:05.150696+0000", 2023-08-01T19:56:21.904 INFO:teuthology.orchestra.run.smithi155.stdout: "duration": 8.0852000000000004e-05 2023-08-01T19:56:21.904 INFO:teuthology.orchestra.run.smithi155.stdout: }, 2023-08-01T19:56:21.904 INFO:teuthology.orchestra.run.smithi155.stdout: { 2023-08-01T19:56:21.905 INFO:teuthology.orchestra.run.smithi155.stdout: "event": "dispatched", 2023-08-01T19:56:21.905 INFO:teuthology.orchestra.run.smithi155.stdout: "time": "2023-08-01T19:55:05.150708+0000", 2023-08-01T19:56:21.905 INFO:teuthology.orchestra.run.smithi155.stdout: "duration": 1.2116999999999999e-05 2023-08-01T19:56:21.905 INFO:teuthology.orchestra.run.smithi155.stdout: }, 2023-08-01T19:56:21.905 INFO:teuthology.orchestra.run.smithi155.stdout: { 2023-08-01T19:56:21.905 INFO:teuthology.orchestra.run.smithi155.stdout: "event": "queued_for_pg", 2023-08-01T19:56:21.905 INFO:teuthology.orchestra.run.smithi155.stdout: "time": "2023-08-01T19:55:05.150713+0000", 2023-08-01T19:56:21.906 INFO:teuthology.orchestra.run.smithi155.stdout: "duration": 5.4620000000000004e-06 2023-08-01T19:56:21.906 INFO:teuthology.orchestra.run.smithi155.stdout: }, 2023-08-01T19:56:21.906 INFO:teuthology.orchestra.run.smithi155.stdout: { 2023-08-01T19:56:21.906 INFO:teuthology.orchestra.run.smithi155.stdout: "event": "reached_pg", 2023-08-01T19:56:21.906 INFO:teuthology.orchestra.run.smithi155.stdout: "time": "2023-08-01T19:55:05.150761+0000", 2023-08-01T19:56:21.906 INFO:teuthology.orchestra.run.smithi155.stdout: "duration": 4.7429000000000003e-05 2023-08-01T19:56:21.906 INFO:teuthology.orchestra.run.smithi155.stdout: }, 2023-08-01T19:56:21.906 INFO:teuthology.orchestra.run.smithi155.stdout: { 2023-08-01T19:56:21.907 INFO:teuthology.orchestra.run.smithi155.stdout: "event": "started", 2023-08-01T19:56:21.907 INFO:teuthology.orchestra.run.smithi155.stdout: "time": "2023-08-01T19:55:05.150856+0000", 2023-08-01T19:56:21.907 INFO:teuthology.orchestra.run.smithi155.stdout: "duration": 9.5356e-05 2023-08-01T19:56:21.907 INFO:teuthology.orchestra.run.smithi155.stdout: }, 2023-08-01T19:56:21.907 INFO:teuthology.orchestra.run.smithi155.stdout: { 2023-08-01T19:56:21.907 INFO:teuthology.orchestra.run.smithi155.stdout: "event": "waiting for subops from 0", 2023-08-01T19:56:21.907 INFO:teuthology.orchestra.run.smithi155.stdout: "time": "2023-08-01T19:55:05.150999+0000", 2023-08-01T19:56:21.908 INFO:teuthology.orchestra.run.smithi155.stdout: "duration": 0.00014234499999999999 2023-08-01T19:56:21.908 INFO:teuthology.orchestra.run.smithi155.stdout: }, 2023-08-01T19:56:21.908 INFO:teuthology.orchestra.run.smithi155.stdout: { 2023-08-01T19:56:21.908 INFO:teuthology.orchestra.run.smithi155.stdout: "event": "sub_op_commit_rec", 2023-08-01T19:56:21.908 INFO:teuthology.orchestra.run.smithi155.stdout: "time": "2023-08-01T19:55:05.219001+0000", 2023-08-01T19:56:21.908 INFO:teuthology.orchestra.run.smithi155.stdout: "duration": 0.068002776000000001 2023-08-01T19:56:21.908 INFO:teuthology.orchestra.run.smithi155.stdout: }, 2023-08-01T19:56:21.909 INFO:teuthology.orchestra.run.smithi155.stdout: { 2023-08-01T19:56:21.909 INFO:teuthology.orchestra.run.smithi155.stdout: "event": "op_commit", 2023-08-01T19:56:21.909 INFO:teuthology.orchestra.run.smithi155.stdout: "time": "2023-08-01T19:55:05.221635+0000", 2023-08-01T19:56:21.909 INFO:teuthology.orchestra.run.smithi155.stdout: "duration": 0.0026340579999999999 2023-08-01T19:56:21.909 INFO:teuthology.orchestra.run.smithi155.stdout: }, 2023-08-01T19:56:21.909 INFO:teuthology.orchestra.run.smithi155.stdout: { 2023-08-01T19:56:21.909 INFO:teuthology.orchestra.run.smithi155.stdout: "event": "commit_sent", 2023-08-01T19:56:21.909 INFO:teuthology.orchestra.run.smithi155.stdout: "time": "2023-08-01T19:55:05.221682+0000", 2023-08-01T19:56:21.910 INFO:teuthology.orchestra.run.smithi155.stdout: "duration": 4.7123999999999998e-05 2023-08-01T19:56:21.910 INFO:teuthology.orchestra.run.smithi155.stdout: }, 2023-08-01T19:56:21.910 INFO:teuthology.orchestra.run.smithi155.stdout: { 2023-08-01T19:56:21.910 INFO:teuthology.orchestra.run.smithi155.stdout: "event": "done", 2023-08-01T19:56:21.910 INFO:teuthology.orchestra.run.smithi155.stdout: "time": "2023-08-01T19:55:05.221721+0000", 2023-08-01T19:56:21.910 INFO:teuthology.orchestra.run.smithi155.stdout: "duration": 3.8529999999999999e-05 2023-08-01T19:56:21.910 INFO:teuthology.orchestra.run.smithi155.stdout: } 2023-08-01T19:56:21.910 INFO:teuthology.orchestra.run.smithi155.stdout: ] 2023-08-01T19:56:21.911 INFO:teuthology.orchestra.run.smithi155.stdout: } 2023-08-01T19:56:21.911 INFO:teuthology.orchestra.run.smithi155.stdout: }, 2023-08-01T19:56:21.911 INFO:teuthology.orchestra.run.smithi155.stdout: { 2023-08-01T19:56:21.911 INFO:teuthology.orchestra.run.smithi155.stdout: "description": "osd_repop(client.4668.0:100240 5.a e37/19 5:5313c5b9:::benchmark_data_smithi006_114134_object100239:head v 37'6227, mlcod=37'6225)", 2023-08-01T19:56:21.911 INFO:teuthology.orchestra.run.smithi155.stdout: "initiated_at": "2023-08-01T19:55:05.150778+0000", 2023-08-01T19:56:21.911 INFO:teuthology.orchestra.run.smithi155.stdout: "age": 76.736159688000001, 2023-08-01T19:56:21.911 INFO:teuthology.orchestra.run.smithi155.stdout: "duration": 0.073362533999999993, 2023-08-01T19:56:21.911 INFO:teuthology.orchestra.run.smithi155.stdout: "type_data": { 2023-08-01T19:56:21.912 INFO:teuthology.orchestra.run.smithi155.stdout: "flag_point": "commit sent; apply or cleanup", 2023-08-01T19:56:21.912 INFO:teuthology.orchestra.run.smithi155.stdout: "events": [ 2023-08-01T19:56:21.912 INFO:teuthology.orchestra.run.smithi155.stdout: { 2023-08-01T19:56:21.912 INFO:teuthology.orchestra.run.smithi155.stdout: "event": "initiated", 2023-08-01T19:56:21.912 INFO:teuthology.orchestra.run.smithi155.stdout: "time": "2023-08-01T19:55:05.150778+0000", 2023-08-01T19:56:21.912 INFO:teuthology.orchestra.run.smithi155.stdout: "duration": 0 2023-08-01T19:56:21.912 INFO:teuthology.orchestra.run.smithi155.stdout: }, 2023-08-01T19:56:21.913 INFO:teuthology.orchestra.run.smithi155.stdout: { 2023-08-01T19:56:21.913 INFO:teuthology.orchestra.run.smithi155.stdout: "event": "throttled", 2023-08-01T19:56:21.913 INFO:teuthology.orchestra.run.smithi155.stdout: "time": "2023-08-01T19:55:05.150778+0000", 2023-08-01T19:56:21.913 INFO:teuthology.orchestra.run.smithi155.stdout: "duration": 0 2023-08-01T19:56:21.913 INFO:teuthology.orchestra.run.smithi155.stdout: }, 2023-08-01T19:56:21.913 INFO:teuthology.orchestra.run.smithi155.stdout: { 2023-08-01T19:56:21.913 INFO:teuthology.orchestra.run.smithi155.stdout: "event": "header_read", 2023-08-01T19:56:21.913 INFO:teuthology.orchestra.run.smithi155.stdout: "time": "2023-08-01T19:55:05.150778+0000", 2023-08-01T19:56:21.914 INFO:teuthology.orchestra.run.smithi155.stdout: "duration": 4294967295.9999995 2023-08-01T19:56:21.914 INFO:teuthology.orchestra.run.smithi155.stdout: }, 2023-08-01T19:56:21.914 INFO:teuthology.orchestra.run.smithi155.stdout: { 2023-08-01T19:56:21.914 INFO:teuthology.orchestra.run.smithi155.stdout: "event": "all_read", 2023-08-01T19:56:21.914 INFO:teuthology.orchestra.run.smithi155.stdout: "time": "2023-08-01T19:55:05.150811+0000", 2023-08-01T19:56:21.914 INFO:teuthology.orchestra.run.smithi155.stdout: "duration": 3.3664000000000002e-05 2023-08-01T19:56:21.914 INFO:teuthology.orchestra.run.smithi155.stdout: }, 2023-08-01T19:56:21.915 INFO:teuthology.orchestra.run.smithi155.stdout: { 2023-08-01T19:56:21.915 INFO:teuthology.orchestra.run.smithi155.stdout: "event": "dispatched", 2023-08-01T19:56:21.915 INFO:teuthology.orchestra.run.smithi155.stdout: "time": "2023-08-01T19:55:05.150818+0000", 2023-08-01T19:56:21.915 INFO:teuthology.orchestra.run.smithi155.stdout: "duration": 6.5769999999999999e-06 2023-08-01T19:56:21.915 INFO:teuthology.orchestra.run.smithi155.stdout: }, 2023-08-01T19:56:21.915 INFO:teuthology.orchestra.run.smithi155.stdout: { 2023-08-01T19:56:21.915 INFO:teuthology.orchestra.run.smithi155.stdout: "event": "queued_for_pg", 2023-08-01T19:56:21.916 INFO:teuthology.orchestra.run.smithi155.stdout: "time": "2023-08-01T19:55:05.150822+0000", 2023-08-01T19:56:21.916 INFO:teuthology.orchestra.run.smithi155.stdout: "duration": 4.0060000000000003e-06 2023-08-01T19:56:21.916 INFO:teuthology.orchestra.run.smithi155.stdout: }, 2023-08-01T19:56:21.916 INFO:teuthology.orchestra.run.smithi155.stdout: { 2023-08-01T19:56:21.916 INFO:teuthology.orchestra.run.smithi155.stdout: "event": "reached_pg", 2023-08-01T19:56:21.916 INFO:teuthology.orchestra.run.smithi155.stdout: "time": "2023-08-01T19:55:05.150855+0000", 2023-08-01T19:56:21.916 INFO:teuthology.orchestra.run.smithi155.stdout: "duration": 3.3204999999999998e-05 2023-08-01T19:56:21.916 INFO:teuthology.orchestra.run.smithi155.stdout: }, 2023-08-01T19:56:21.917 INFO:teuthology.orchestra.run.smithi155.stdout: { 2023-08-01T19:56:21.917 INFO:teuthology.orchestra.run.smithi155.stdout: "event": "started", 2023-08-01T19:56:21.917 INFO:teuthology.orchestra.run.smithi155.stdout: "time": "2023-08-01T19:55:05.150873+0000", 2023-08-01T19:56:21.917 INFO:teuthology.orchestra.run.smithi155.stdout: "duration": 1.8139999999999999e-05 2023-08-01T19:56:21.917 INFO:teuthology.orchestra.run.smithi155.stdout: }, 2023-08-01T19:56:21.917 INFO:teuthology.orchestra.run.smithi155.stdout: { 2023-08-01T19:56:21.917 INFO:teuthology.orchestra.run.smithi155.stdout: "event": "commit_sent", 2023-08-01T19:56:21.917 INFO:teuthology.orchestra.run.smithi155.stdout: "time": "2023-08-01T19:55:05.224095+0000", 2023-08-01T19:56:21.918 INFO:teuthology.orchestra.run.smithi155.stdout: "duration": 0.073221895999999995 2023-08-01T19:56:21.918 INFO:teuthology.orchestra.run.smithi155.stdout: }, 2023-08-01T19:56:21.918 INFO:teuthology.orchestra.run.smithi155.stdout: { 2023-08-01T19:56:21.918 INFO:teuthology.orchestra.run.smithi155.stdout: "event": "done", 2023-08-01T19:56:21.918 INFO:teuthology.orchestra.run.smithi155.stdout: "time": "2023-08-01T19:55:05.224141+0000", 2023-08-01T19:56:21.918 INFO:teuthology.orchestra.run.smithi155.stdout: "duration": 4.5385e-05 2023-08-01T19:56:21.918 INFO:teuthology.orchestra.run.smithi155.stdout: } 2023-08-01T19:56:21.918 INFO:teuthology.orchestra.run.smithi155.stdout: ] 2023-08-01T19:56:21.919 INFO:teuthology.orchestra.run.smithi155.stdout: } 2023-08-01T19:56:21.919 INFO:teuthology.orchestra.run.smithi155.stdout: }, 2023-08-01T19:56:21.919 INFO:teuthology.orchestra.run.smithi155.stdout: { 2023-08-01T19:56:21.919 INFO:teuthology.orchestra.run.smithi155.stdout: "description": "osd_op(client.4668.0:100245 5.e 5:71869c66:::benchmark_data_smithi006_114134_object100244:head [set-alloc-hint object_size 65536 write_size 65536,write 0~65536] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e37)", 2023-08-01T19:56:21.919 INFO:teuthology.orchestra.run.smithi155.stdout: "initiated_at": "2023-08-01T19:55:05.150991+0000", 2023-08-01T19:56:21.919 INFO:teuthology.orchestra.run.smithi155.stdout: "age": 76.735946901000005, 2023-08-01T19:56:21.919 INFO:teuthology.orchestra.run.smithi155.stdout: "duration": 0.070734490999999997, 2023-08-01T19:56:21.919 INFO:teuthology.orchestra.run.smithi155.stdout: "type_data": { 2023-08-01T19:56:21.920 INFO:teuthology.orchestra.run.smithi155.stdout: "flag_point": "commit sent; apply or cleanup", 2023-08-01T19:56:21.920 INFO:teuthology.orchestra.run.smithi155.stdout: "client_info": { 2023-08-01T19:56:21.920 INFO:teuthology.orchestra.run.smithi155.stdout: "client": "client.4668", 2023-08-01T19:56:21.920 INFO:teuthology.orchestra.run.smithi155.stdout: "client_addr": "172.21.15.6:0/1709472247", 2023-08-01T19:56:21.920 INFO:teuthology.orchestra.run.smithi155.stdout: "tid": 100245 2023-08-01T19:56:21.920 INFO:teuthology.orchestra.run.smithi155.stdout: }, 2023-08-01T19:56:21.920 INFO:teuthology.orchestra.run.smithi155.stdout: "events": [ 2023-08-01T19:56:21.921 INFO:teuthology.orchestra.run.smithi155.stdout: { 2023-08-01T19:56:21.921 INFO:teuthology.orchestra.run.smithi155.stdout: "event": "initiated", 2023-08-01T19:56:21.921 INFO:teuthology.orchestra.run.smithi155.stdout: "time": "2023-08-01T19:55:05.150991+0000", 2023-08-01T19:56:21.921 INFO:teuthology.orchestra.run.smithi155.stdout: "duration": 0 2023-08-01T19:56:21.921 INFO:teuthology.orchestra.run.smithi155.stdout: }, 2023-08-01T19:56:21.921 INFO:teuthology.orchestra.run.smithi155.stdout: { 2023-08-01T19:56:21.921 INFO:teuthology.orchestra.run.smithi155.stdout: "event": "throttled", 2023-08-01T19:56:21.921 INFO:teuthology.orchestra.run.smithi155.stdout: "time": "2023-08-01T19:55:05.150991+0000", 2023-08-01T19:56:21.922 INFO:teuthology.orchestra.run.smithi155.stdout: "duration": 0 2023-08-01T19:56:21.922 INFO:teuthology.orchestra.run.smithi155.stdout: }, 2023-08-01T19:56:21.922 INFO:teuthology.orchestra.run.smithi155.stdout: { 2023-08-01T19:56:21.922 INFO:teuthology.orchestra.run.smithi155.stdout: "event": "header_read", 2023-08-01T19:56:21.922 INFO:teuthology.orchestra.run.smithi155.stdout: "time": "2023-08-01T19:55:05.150990+0000", 2023-08-01T19:56:21.922 INFO:teuthology.orchestra.run.smithi155.stdout: "duration": 4294967295.999999 2023-08-01T19:56:21.922 INFO:teuthology.orchestra.run.smithi155.stdout: }, 2023-08-01T19:56:21.922 INFO:teuthology.orchestra.run.smithi155.stdout: { 2023-08-01T19:56:21.923 INFO:teuthology.orchestra.run.smithi155.stdout: "event": "all_read", 2023-08-01T19:56:21.923 INFO:teuthology.orchestra.run.smithi155.stdout: "time": "2023-08-01T19:55:05.151108+0000", 2023-08-01T19:56:21.923 INFO:teuthology.orchestra.run.smithi155.stdout: "duration": 0.00011849300000000001 2023-08-01T19:56:21.923 INFO:teuthology.orchestra.run.smithi155.stdout: }, 2023-08-01T19:56:21.923 INFO:teuthology.orchestra.run.smithi155.stdout: { 2023-08-01T19:56:21.923 INFO:teuthology.orchestra.run.smithi155.stdout: "event": "dispatched", 2023-08-01T19:56:21.923 INFO:teuthology.orchestra.run.smithi155.stdout: "time": "2023-08-01T19:55:05.151117+0000", 2023-08-01T19:56:21.923 INFO:teuthology.orchestra.run.smithi155.stdout: "duration": 8.1040000000000007e-06 2023-08-01T19:56:21.924 INFO:teuthology.orchestra.run.smithi155.stdout: }, 2023-08-01T19:56:21.924 INFO:teuthology.orchestra.run.smithi155.stdout: { 2023-08-01T19:56:21.924 INFO:teuthology.orchestra.run.smithi155.stdout: "event": "queued_for_pg", 2023-08-01T19:56:21.924 INFO:teuthology.orchestra.run.smithi155.stdout: "time": "2023-08-01T19:55:05.151121+0000", 2023-08-01T19:56:21.924 INFO:teuthology.orchestra.run.smithi155.stdout: "duration": 4.2019999999999997e-06 2023-08-01T19:56:21.924 INFO:teuthology.orchestra.run.smithi155.stdout: }, 2023-08-01T19:56:21.924 INFO:teuthology.orchestra.run.smithi155.stdout: { 2023-08-01T19:56:21.924 INFO:teuthology.orchestra.run.smithi155.stdout: "event": "reached_pg", 2023-08-01T19:56:21.925 INFO:teuthology.orchestra.run.smithi155.stdout: "time": "2023-08-01T19:55:05.151162+0000", 2023-08-01T19:56:21.925 INFO:teuthology.orchestra.run.smithi155.stdout: "duration": 4.1448e-05 2023-08-01T19:56:21.925 INFO:teuthology.orchestra.run.smithi155.stdout: }, 2023-08-01T19:56:21.925 INFO:teuthology.orchestra.run.smithi155.stdout: { 2023-08-01T19:56:21.925 INFO:teuthology.orchestra.run.smithi155.stdout: "event": "started", 2023-08-01T19:56:21.925 INFO:teuthology.orchestra.run.smithi155.stdout: "time": "2023-08-01T19:55:05.151281+0000", 2023-08-01T19:56:21.925 INFO:teuthology.orchestra.run.smithi155.stdout: "duration": 0.000119141 2023-08-01T19:56:21.925 INFO:teuthology.orchestra.run.smithi155.stdout: }, 2023-08-01T19:56:21.926 INFO:teuthology.orchestra.run.smithi155.stdout: { 2023-08-01T19:56:21.926 INFO:teuthology.orchestra.run.smithi155.stdout: "event": "waiting for subops from 0", 2023-08-01T19:56:21.926 INFO:teuthology.orchestra.run.smithi155.stdout: "time": "2023-08-01T19:55:05.151443+0000", 2023-08-01T19:56:21.926 INFO:teuthology.orchestra.run.smithi155.stdout: "duration": 0.00016181600000000001 2023-08-01T19:56:21.926 INFO:teuthology.orchestra.run.smithi155.stdout: }, 2023-08-01T19:56:21.926 INFO:teuthology.orchestra.run.smithi155.stdout: { 2023-08-01T19:56:21.926 INFO:teuthology.orchestra.run.smithi155.stdout: "event": "sub_op_commit_rec", 2023-08-01T19:56:21.926 INFO:teuthology.orchestra.run.smithi155.stdout: "time": "2023-08-01T19:55:05.219101+0000", 2023-08-01T19:56:21.927 INFO:teuthology.orchestra.run.smithi155.stdout: "duration": 0.067658037000000004 2023-08-01T19:56:21.927 INFO:teuthology.orchestra.run.smithi155.stdout: }, 2023-08-01T19:56:21.927 INFO:teuthology.orchestra.run.smithi155.stdout: { 2023-08-01T19:56:21.927 INFO:teuthology.orchestra.run.smithi155.stdout: "event": "op_commit", 2023-08-01T19:56:21.927 INFO:teuthology.orchestra.run.smithi155.stdout: "time": "2023-08-01T19:55:05.221646+0000", 2023-08-01T19:56:21.927 INFO:teuthology.orchestra.run.smithi155.stdout: "duration": 0.0025450540000000002 2023-08-01T19:56:21.927 INFO:teuthology.orchestra.run.smithi155.stdout: }, 2023-08-01T19:56:21.928 INFO:teuthology.orchestra.run.smithi155.stdout: { 2023-08-01T19:56:21.928 INFO:teuthology.orchestra.run.smithi155.stdout: "event": "commit_sent", 2023-08-01T19:56:21.928 INFO:teuthology.orchestra.run.smithi155.stdout: "time": "2023-08-01T19:55:05.221689+0000", 2023-08-01T19:56:21.928 INFO:teuthology.orchestra.run.smithi155.stdout: "duration": 4.3078999999999999e-05 2023-08-01T19:56:21.928 INFO:teuthology.orchestra.run.smithi155.stdout: }, 2023-08-01T19:56:21.928 INFO:teuthology.orchestra.run.smithi155.stdout: { 2023-08-01T19:56:21.928 INFO:teuthology.orchestra.run.smithi155.stdout: "event": "done", 2023-08-01T19:56:21.928 INFO:teuthology.orchestra.run.smithi155.stdout: "time": "2023-08-01T19:55:05.221725+0000", 2023-08-01T19:56:21.929 INFO:teuthology.orchestra.run.smithi155.stdout: "duration": 3.6137999999999999e-05 2023-08-01T19:56:21.929 INFO:teuthology.orchestra.run.smithi155.stdout: } 2023-08-01T19:56:21.929 INFO:teuthology.orchestra.run.smithi155.stdout: ] 2023-08-01T19:56:21.929 INFO:teuthology.orchestra.run.smithi155.stdout: } 2023-08-01T19:56:21.929 INFO:teuthology.orchestra.run.smithi155.stdout: }, 2023-08-01T19:56:21.929 INFO:teuthology.orchestra.run.smithi155.stdout: { 2023-08-01T19:56:21.929 INFO:teuthology.orchestra.run.smithi155.stdout: "description": "osd_repop(client.4668.0:100243 5.a e37/19 5:5e8193b6:::benchmark_data_smithi006_114134_object100242:head v 37'6228, mlcod=37'6225)", 2023-08-01T19:56:21.929 INFO:teuthology.orchestra.run.smithi155.stdout: "initiated_at": "2023-08-01T19:55:05.151148+0000", 2023-08-01T19:56:21.930 INFO:teuthology.orchestra.run.smithi155.stdout: "age": 76.735789890000007, 2023-08-01T19:56:21.930 INFO:teuthology.orchestra.run.smithi155.stdout: "duration": 0.073020370000000001, 2023-08-01T19:56:21.930 INFO:teuthology.orchestra.run.smithi155.stdout: "type_data": { 2023-08-01T19:56:21.930 INFO:teuthology.orchestra.run.smithi155.stdout: "flag_point": "commit sent; apply or cleanup", 2023-08-01T19:56:21.930 INFO:teuthology.orchestra.run.smithi155.stdout: "events": [ 2023-08-01T19:56:21.930 INFO:teuthology.orchestra.run.smithi155.stdout: { 2023-08-01T19:56:21.930 INFO:teuthology.orchestra.run.smithi155.stdout: "event": "initiated", 2023-08-01T19:56:21.931 INFO:teuthology.orchestra.run.smithi155.stdout: "time": "2023-08-01T19:55:05.151148+0000", 2023-08-01T19:56:21.931 INFO:teuthology.orchestra.run.smithi155.stdout: "duration": 0 2023-08-01T19:56:21.931 INFO:teuthology.orchestra.run.smithi155.stdout: }, 2023-08-01T19:56:21.931 INFO:teuthology.orchestra.run.smithi155.stdout: { 2023-08-01T19:56:21.931 INFO:teuthology.orchestra.run.smithi155.stdout: "event": "throttled", 2023-08-01T19:56:21.931 INFO:teuthology.orchestra.run.smithi155.stdout: "time": "2023-08-01T19:55:05.151148+0000", 2023-08-01T19:56:21.931 INFO:teuthology.orchestra.run.smithi155.stdout: "duration": 0 2023-08-01T19:56:21.931 INFO:teuthology.orchestra.run.smithi155.stdout: }, 2023-08-01T19:56:21.932 INFO:teuthology.orchestra.run.smithi155.stdout: { 2023-08-01T19:56:21.932 INFO:teuthology.orchestra.run.smithi155.stdout: "event": "header_read", 2023-08-01T19:56:21.932 INFO:teuthology.orchestra.run.smithi155.stdout: "time": "2023-08-01T19:55:05.151147+0000", 2023-08-01T19:56:21.932 INFO:teuthology.orchestra.run.smithi155.stdout: "duration": 4294967295.9999995 2023-08-01T19:56:21.932 INFO:teuthology.orchestra.run.smithi155.stdout: }, 2023-08-01T19:56:21.932 INFO:teuthology.orchestra.run.smithi155.stdout: { 2023-08-01T19:56:21.932 INFO:teuthology.orchestra.run.smithi155.stdout: "event": "all_read", 2023-08-01T19:56:21.933 INFO:teuthology.orchestra.run.smithi155.stdout: "time": "2023-08-01T19:55:05.151231+0000", 2023-08-01T19:56:21.933 INFO:teuthology.orchestra.run.smithi155.stdout: "duration": 8.3135999999999998e-05 2023-08-01T19:56:21.933 INFO:teuthology.orchestra.run.smithi155.stdout: }, 2023-08-01T19:56:21.933 INFO:teuthology.orchestra.run.smithi155.stdout: { 2023-08-01T19:56:21.933 INFO:teuthology.orchestra.run.smithi155.stdout: "event": "dispatched", 2023-08-01T19:56:21.933 INFO:teuthology.orchestra.run.smithi155.stdout: "time": "2023-08-01T19:55:05.151239+0000", 2023-08-01T19:56:21.933 INFO:teuthology.orchestra.run.smithi155.stdout: "duration": 8.7469999999999994e-06 2023-08-01T19:56:21.933 INFO:teuthology.orchestra.run.smithi155.stdout: }, 2023-08-01T19:56:21.934 INFO:teuthology.orchestra.run.smithi155.stdout: { 2023-08-01T19:56:21.934 INFO:teuthology.orchestra.run.smithi155.stdout: "event": "queued_for_pg", 2023-08-01T19:56:21.934 INFO:teuthology.orchestra.run.smithi155.stdout: "time": "2023-08-01T19:55:05.151244+0000", 2023-08-01T19:56:21.934 INFO:teuthology.orchestra.run.smithi155.stdout: "duration": 4.4800000000000003e-06 2023-08-01T19:56:21.934 INFO:teuthology.orchestra.run.smithi155.stdout: }, 2023-08-01T19:56:21.934 INFO:teuthology.orchestra.run.smithi155.stdout: { 2023-08-01T19:56:21.934 INFO:teuthology.orchestra.run.smithi155.stdout: "event": "reached_pg", 2023-08-01T19:56:21.934 INFO:teuthology.orchestra.run.smithi155.stdout: "time": "2023-08-01T19:55:05.152938+0000", 2023-08-01T19:56:21.935 INFO:teuthology.orchestra.run.smithi155.stdout: "duration": 0.001693824 2023-08-01T19:56:21.935 INFO:teuthology.orchestra.run.smithi155.stdout: }, 2023-08-01T19:56:21.935 INFO:teuthology.orchestra.run.smithi155.stdout: { 2023-08-01T19:56:21.935 INFO:teuthology.orchestra.run.smithi155.stdout: "event": "started", 2023-08-01T19:56:21.935 INFO:teuthology.orchestra.run.smithi155.stdout: "time": "2023-08-01T19:55:05.152956+0000", 2023-08-01T19:56:21.935 INFO:teuthology.orchestra.run.smithi155.stdout: "duration": 1.8287e-05 2023-08-01T19:56:21.935 INFO:teuthology.orchestra.run.smithi155.stdout: }, 2023-08-01T19:56:21.936 INFO:teuthology.orchestra.run.smithi155.stdout: { 2023-08-01T19:56:21.936 INFO:teuthology.orchestra.run.smithi155.stdout: "event": "commit_sent", 2023-08-01T19:56:21.936 INFO:teuthology.orchestra.run.smithi155.stdout: "time": "2023-08-01T19:55:05.224145+0000", 2023-08-01T19:56:21.936 INFO:teuthology.orchestra.run.smithi155.stdout: "duration": 0.071189447000000003 2023-08-01T19:56:21.936 INFO:teuthology.orchestra.run.smithi155.stdout: }, 2023-08-01T19:56:21.936 INFO:teuthology.orchestra.run.smithi155.stdout: { 2023-08-01T19:56:21.936 INFO:teuthology.orchestra.run.smithi155.stdout: "event": "done", 2023-08-01T19:56:21.936 INFO:teuthology.orchestra.run.smithi155.stdout: "time": "2023-08-01T19:55:05.224168+0000", 2023-08-01T19:56:21.937 INFO:teuthology.orchestra.run.smithi155.stdout: "duration": 2.3008999999999999e-05 2023-08-01T19:56:21.937 INFO:teuthology.orchestra.run.smithi155.stdout: } 2023-08-01T19:56:21.937 INFO:teuthology.orchestra.run.smithi155.stdout: ] 2023-08-01T19:56:21.937 INFO:teuthology.orchestra.run.smithi155.stdout: } 2023-08-01T19:56:21.937 INFO:teuthology.orchestra.run.smithi155.stdout: }, 2023-08-01T19:56:21.937 INFO:teuthology.orchestra.run.smithi155.stdout: { 2023-08-01T19:56:21.937 INFO:teuthology.orchestra.run.smithi155.stdout: "description": "osd_repop(client.4668.0:100244 5.9 e37/19 5:92f56a12:::benchmark_data_smithi006_114134_object100243:head v 37'6294, mlcod=37'6292)", 2023-08-01T19:56:21.937 INFO:teuthology.orchestra.run.smithi155.stdout: "initiated_at": "2023-08-01T19:55:05.151325+0000", 2023-08-01T19:56:21.938 INFO:teuthology.orchestra.run.smithi155.stdout: "age": 76.735612544999995, 2023-08-01T19:56:21.938 INFO:teuthology.orchestra.run.smithi155.stdout: "duration": 0.071883673999999995, 2023-08-01T19:56:21.938 INFO:teuthology.orchestra.run.smithi155.stdout: "type_data": { 2023-08-01T19:56:21.938 INFO:teuthology.orchestra.run.smithi155.stdout: "flag_point": "commit sent; apply or cleanup", 2023-08-01T19:56:21.938 INFO:teuthology.orchestra.run.smithi155.stdout: "events": [ 2023-08-01T19:56:21.938 INFO:teuthology.orchestra.run.smithi155.stdout: { 2023-08-01T19:56:21.938 INFO:teuthology.orchestra.run.smithi155.stdout: "event": "initiated", 2023-08-01T19:56:21.938 INFO:teuthology.orchestra.run.smithi155.stdout: "time": "2023-08-01T19:55:05.151325+0000", 2023-08-01T19:56:21.939 INFO:teuthology.orchestra.run.smithi155.stdout: "duration": 0 2023-08-01T19:56:21.939 INFO:teuthology.orchestra.run.smithi155.stdout: }, 2023-08-01T19:56:21.939 INFO:teuthology.orchestra.run.smithi155.stdout: { 2023-08-01T19:56:21.939 INFO:teuthology.orchestra.run.smithi155.stdout: "event": "throttled", 2023-08-01T19:56:21.939 INFO:teuthology.orchestra.run.smithi155.stdout: "time": "2023-08-01T19:55:05.151325+0000", 2023-08-01T19:56:21.939 INFO:teuthology.orchestra.run.smithi155.stdout: "duration": 0 2023-08-01T19:56:21.939 INFO:teuthology.orchestra.run.smithi155.stdout: }, 2023-08-01T19:56:21.939 INFO:teuthology.orchestra.run.smithi155.stdout: { 2023-08-01T19:56:21.940 INFO:teuthology.orchestra.run.smithi155.stdout: "event": "header_read", 2023-08-01T19:56:21.940 INFO:teuthology.orchestra.run.smithi155.stdout: "time": "2023-08-01T19:55:05.151325+0000", 2023-08-01T19:56:21.940 INFO:teuthology.orchestra.run.smithi155.stdout: "duration": 4294967295.9999995 2023-08-01T19:56:21.940 INFO:teuthology.orchestra.run.smithi155.stdout: }, 2023-08-01T19:56:21.940 INFO:teuthology.orchestra.run.smithi155.stdout: { 2023-08-01T19:56:21.940 INFO:teuthology.orchestra.run.smithi155.stdout: "event": "all_read", 2023-08-01T19:56:21.940 INFO:teuthology.orchestra.run.smithi155.stdout: "time": "2023-08-01T19:55:05.151390+0000", 2023-08-01T19:56:21.941 INFO:teuthology.orchestra.run.smithi155.stdout: "duration": 6.5456999999999993e-05 2023-08-01T19:56:21.941 INFO:teuthology.orchestra.run.smithi155.stdout: }, 2023-08-01T19:56:21.941 INFO:teuthology.orchestra.run.smithi155.stdout: { 2023-08-01T19:56:21.941 INFO:teuthology.orchestra.run.smithi155.stdout: "event": "dispatched", 2023-08-01T19:56:21.941 INFO:teuthology.orchestra.run.smithi155.stdout: "time": "2023-08-01T19:55:05.151396+0000", 2023-08-01T19:56:21.941 INFO:teuthology.orchestra.run.smithi155.stdout: "duration": 5.9190000000000004e-06 2023-08-01T19:56:21.941 INFO:teuthology.orchestra.run.smithi155.stdout: }, 2023-08-01T19:56:21.941 INFO:teuthology.orchestra.run.smithi155.stdout: { 2023-08-01T19:56:21.942 INFO:teuthology.orchestra.run.smithi155.stdout: "event": "queued_for_pg", 2023-08-01T19:56:21.942 INFO:teuthology.orchestra.run.smithi155.stdout: "time": "2023-08-01T19:55:05.151400+0000", 2023-08-01T19:56:21.942 INFO:teuthology.orchestra.run.smithi155.stdout: "duration": 4.1030000000000004e-06 2023-08-01T19:56:21.942 INFO:teuthology.orchestra.run.smithi155.stdout: }, 2023-08-01T19:56:21.942 INFO:teuthology.orchestra.run.smithi155.stdout: { 2023-08-01T19:56:21.942 INFO:teuthology.orchestra.run.smithi155.stdout: "event": "reached_pg", 2023-08-01T19:56:21.942 INFO:teuthology.orchestra.run.smithi155.stdout: "time": "2023-08-01T19:55:05.151452+0000", 2023-08-01T19:56:21.942 INFO:teuthology.orchestra.run.smithi155.stdout: "duration": 5.2136999999999999e-05 2023-08-01T19:56:21.943 INFO:teuthology.orchestra.run.smithi155.stdout: }, 2023-08-01T19:56:21.943 INFO:teuthology.orchestra.run.smithi155.stdout: { 2023-08-01T19:56:21.943 INFO:teuthology.orchestra.run.smithi155.stdout: "event": "started", 2023-08-01T19:56:21.943 INFO:teuthology.orchestra.run.smithi155.stdout: "time": "2023-08-01T19:55:05.151470+0000", 2023-08-01T19:56:21.943 INFO:teuthology.orchestra.run.smithi155.stdout: "duration": 1.8e-05 2023-08-01T19:56:21.943 INFO:teuthology.orchestra.run.smithi155.stdout: }, 2023-08-01T19:56:21.943 INFO:teuthology.orchestra.run.smithi155.stdout: { 2023-08-01T19:56:21.943 INFO:teuthology.orchestra.run.smithi155.stdout: "event": "commit_sent", 2023-08-01T19:56:21.944 INFO:teuthology.orchestra.run.smithi155.stdout: "time": "2023-08-01T19:55:05.223183+0000", 2023-08-01T19:56:21.944 INFO:teuthology.orchestra.run.smithi155.stdout: "duration": 0.071712622000000004 2023-08-01T19:56:21.944 INFO:teuthology.orchestra.run.smithi155.stdout: }, 2023-08-01T19:56:21.944 INFO:teuthology.orchestra.run.smithi155.stdout: { 2023-08-01T19:56:21.944 INFO:teuthology.orchestra.run.smithi155.stdout: "event": "done", 2023-08-01T19:56:21.944 INFO:teuthology.orchestra.run.smithi155.stdout: "time": "2023-08-01T19:55:05.223209+0000", 2023-08-01T19:56:21.944 INFO:teuthology.orchestra.run.smithi155.stdout: "duration": 2.5956e-05 2023-08-01T19:56:21.944 INFO:teuthology.orchestra.run.smithi155.stdout: } 2023-08-01T19:56:21.945 INFO:teuthology.orchestra.run.smithi155.stdout: ] 2023-08-01T19:56:21.945 INFO:teuthology.orchestra.run.smithi155.stdout: } 2023-08-01T19:56:21.945 INFO:teuthology.orchestra.run.smithi155.stdout: }, 2023-08-01T19:56:21.945 INFO:teuthology.orchestra.run.smithi155.stdout: { 2023-08-01T19:56:21.945 INFO:teuthology.orchestra.run.smithi155.stdout: "description": "osd_op(client.4668.0:100249 5.b 5:d0666827:::benchmark_data_smithi006_114134_object100248:head [set-alloc-hint object_size 65536 write_size 65536,write 0~65536] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e37)", 2023-08-01T19:56:21.945 INFO:teuthology.orchestra.run.smithi155.stdout: "initiated_at": "2023-08-01T19:55:05.153614+0000", 2023-08-01T19:56:21.945 INFO:teuthology.orchestra.run.smithi155.stdout: "age": 76.733324120000006, 2023-08-01T19:56:21.946 INFO:teuthology.orchestra.run.smithi155.stdout: "duration": 0.069286118999999993, 2023-08-01T19:56:21.946 INFO:teuthology.orchestra.run.smithi155.stdout: "type_data": { 2023-08-01T19:56:21.946 INFO:teuthology.orchestra.run.smithi155.stdout: "flag_point": "commit sent; apply or cleanup", 2023-08-01T19:56:21.946 INFO:teuthology.orchestra.run.smithi155.stdout: "client_info": { 2023-08-01T19:56:21.946 INFO:teuthology.orchestra.run.smithi155.stdout: "client": "client.4668", 2023-08-01T19:56:21.946 INFO:teuthology.orchestra.run.smithi155.stdout: "client_addr": "172.21.15.6:0/1709472247", 2023-08-01T19:56:21.946 INFO:teuthology.orchestra.run.smithi155.stdout: "tid": 100249 2023-08-01T19:56:21.946 INFO:teuthology.orchestra.run.smithi155.stdout: }, 2023-08-01T19:56:21.947 INFO:teuthology.orchestra.run.smithi155.stdout: "events": [ 2023-08-01T19:56:21.947 INFO:teuthology.orchestra.run.smithi155.stdout: { 2023-08-01T19:56:21.947 INFO:teuthology.orchestra.run.smithi155.stdout: "event": "initiated", 2023-08-01T19:56:21.947 INFO:teuthology.orchestra.run.smithi155.stdout: "time": "2023-08-01T19:55:05.153614+0000", 2023-08-01T19:56:21.947 INFO:teuthology.orchestra.run.smithi155.stdout: "duration": 0 2023-08-01T19:56:21.947 INFO:teuthology.orchestra.run.smithi155.stdout: }, 2023-08-01T19:56:21.947 INFO:teuthology.orchestra.run.smithi155.stdout: { 2023-08-01T19:56:21.947 INFO:teuthology.orchestra.run.smithi155.stdout: "event": "throttled", 2023-08-01T19:56:21.948 INFO:teuthology.orchestra.run.smithi155.stdout: "time": "2023-08-01T19:55:05.153614+0000", 2023-08-01T19:56:21.948 INFO:teuthology.orchestra.run.smithi155.stdout: "duration": 0 2023-08-01T19:56:21.948 INFO:teuthology.orchestra.run.smithi155.stdout: }, 2023-08-01T19:56:21.948 INFO:teuthology.orchestra.run.smithi155.stdout: { 2023-08-01T19:56:21.948 INFO:teuthology.orchestra.run.smithi155.stdout: "event": "header_read", 2023-08-01T19:56:21.948 INFO:teuthology.orchestra.run.smithi155.stdout: "time": "2023-08-01T19:55:05.153612+0000", 2023-08-01T19:56:21.948 INFO:teuthology.orchestra.run.smithi155.stdout: "duration": 4294967295.9999986 2023-08-01T19:56:21.949 INFO:teuthology.orchestra.run.smithi155.stdout: }, 2023-08-01T19:56:21.949 INFO:teuthology.orchestra.run.smithi155.stdout: { 2023-08-01T19:56:21.949 INFO:teuthology.orchestra.run.smithi155.stdout: "event": "all_read", 2023-08-01T19:56:21.949 INFO:teuthology.orchestra.run.smithi155.stdout: "time": "2023-08-01T19:55:05.153694+0000", 2023-08-01T19:56:21.949 INFO:teuthology.orchestra.run.smithi155.stdout: "duration": 8.1618000000000004e-05 2023-08-01T19:56:21.949 INFO:teuthology.orchestra.run.smithi155.stdout: }, 2023-08-01T19:56:21.949 INFO:teuthology.orchestra.run.smithi155.stdout: { 2023-08-01T19:56:21.949 INFO:teuthology.orchestra.run.smithi155.stdout: "event": "dispatched", 2023-08-01T19:56:21.950 INFO:teuthology.orchestra.run.smithi155.stdout: "time": "2023-08-01T19:55:05.153713+0000", 2023-08-01T19:56:21.950 INFO:teuthology.orchestra.run.smithi155.stdout: "duration": 1.9069999999999999e-05 2023-08-01T19:56:21.950 INFO:teuthology.orchestra.run.smithi155.stdout: }, 2023-08-01T19:56:21.950 INFO:teuthology.orchestra.run.smithi155.stdout: { 2023-08-01T19:56:21.950 INFO:teuthology.orchestra.run.smithi155.stdout: "event": "queued_for_pg", 2023-08-01T19:56:21.950 INFO:teuthology.orchestra.run.smithi155.stdout: "time": "2023-08-01T19:55:05.153726+0000", 2023-08-01T19:56:21.950 INFO:teuthology.orchestra.run.smithi155.stdout: "duration": 1.238e-05 2023-08-01T19:56:21.950 INFO:teuthology.orchestra.run.smithi155.stdout: }, 2023-08-01T19:56:21.951 INFO:teuthology.orchestra.run.smithi155.stdout: { 2023-08-01T19:56:21.951 INFO:teuthology.orchestra.run.smithi155.stdout: "event": "reached_pg", 2023-08-01T19:56:21.951 INFO:teuthology.orchestra.run.smithi155.stdout: "time": "2023-08-01T19:55:05.153761+0000", 2023-08-01T19:56:21.951 INFO:teuthology.orchestra.run.smithi155.stdout: "duration": 3.5046999999999998e-05 2023-08-01T19:56:21.951 INFO:teuthology.orchestra.run.smithi155.stdout: }, 2023-08-01T19:56:21.951 INFO:teuthology.orchestra.run.smithi155.stdout: { 2023-08-01T19:56:21.951 INFO:teuthology.orchestra.run.smithi155.stdout: "event": "started", 2023-08-01T19:56:21.951 INFO:teuthology.orchestra.run.smithi155.stdout: "time": "2023-08-01T19:55:05.153896+0000", 2023-08-01T19:56:21.952 INFO:teuthology.orchestra.run.smithi155.stdout: "duration": 0.00013575800000000001 2023-08-01T19:56:21.952 INFO:teuthology.orchestra.run.smithi155.stdout: }, 2023-08-01T19:56:21.952 INFO:teuthology.orchestra.run.smithi155.stdout: { 2023-08-01T19:56:21.952 INFO:teuthology.orchestra.run.smithi155.stdout: "event": "waiting for subops from 0", 2023-08-01T19:56:21.952 INFO:teuthology.orchestra.run.smithi155.stdout: "time": "2023-08-01T19:55:05.154043+0000", 2023-08-01T19:56:21.952 INFO:teuthology.orchestra.run.smithi155.stdout: "duration": 0.00014650700000000001 2023-08-01T19:56:21.952 INFO:teuthology.orchestra.run.smithi155.stdout: }, 2023-08-01T19:56:21.952 INFO:teuthology.orchestra.run.smithi155.stdout: { 2023-08-01T19:56:21.953 INFO:teuthology.orchestra.run.smithi155.stdout: "event": "sub_op_commit_rec", 2023-08-01T19:56:21.953 INFO:teuthology.orchestra.run.smithi155.stdout: "time": "2023-08-01T19:55:05.221876+0000", 2023-08-01T19:56:21.953 INFO:teuthology.orchestra.run.smithi155.stdout: "duration": 0.067832796000000001 2023-08-01T19:56:21.953 INFO:teuthology.orchestra.run.smithi155.stdout: }, 2023-08-01T19:56:21.953 INFO:teuthology.orchestra.run.smithi155.stdout: { 2023-08-01T19:56:21.953 INFO:teuthology.orchestra.run.smithi155.stdout: "event": "op_commit", 2023-08-01T19:56:21.953 INFO:teuthology.orchestra.run.smithi155.stdout: "time": "2023-08-01T19:55:05.222813+0000", 2023-08-01T19:56:21.953 INFO:teuthology.orchestra.run.smithi155.stdout: "duration": 0.00093755300000000004 2023-08-01T19:56:21.954 INFO:teuthology.orchestra.run.smithi155.stdout: }, 2023-08-01T19:56:21.954 INFO:teuthology.orchestra.run.smithi155.stdout: { 2023-08-01T19:56:21.954 INFO:teuthology.orchestra.run.smithi155.stdout: "event": "commit_sent", 2023-08-01T19:56:21.954 INFO:teuthology.orchestra.run.smithi155.stdout: "time": "2023-08-01T19:55:05.222861+0000", 2023-08-01T19:56:21.954 INFO:teuthology.orchestra.run.smithi155.stdout: "duration": 4.8013999999999998e-05 2023-08-01T19:56:21.954 INFO:teuthology.orchestra.run.smithi155.stdout: }, 2023-08-01T19:56:21.954 INFO:teuthology.orchestra.run.smithi155.stdout: { 2023-08-01T19:56:21.954 INFO:teuthology.orchestra.run.smithi155.stdout: "event": "done", 2023-08-01T19:56:21.955 INFO:teuthology.orchestra.run.smithi155.stdout: "time": "2023-08-01T19:55:05.222900+0000", 2023-08-01T19:56:21.955 INFO:teuthology.orchestra.run.smithi155.stdout: "duration": 3.8634999999999999e-05 2023-08-01T19:56:21.955 INFO:teuthology.orchestra.run.smithi155.stdout: } 2023-08-01T19:56:21.955 INFO:teuthology.orchestra.run.smithi155.stdout: ] 2023-08-01T19:56:21.955 INFO:teuthology.orchestra.run.smithi155.stdout: } 2023-08-01T19:56:21.955 INFO:teuthology.orchestra.run.smithi155.stdout: }, 2023-08-01T19:56:21.955 INFO:teuthology.orchestra.run.smithi155.stdout: { 2023-08-01T19:56:21.955 INFO:teuthology.orchestra.run.smithi155.stdout: "description": "osd_op(client.4668.0:100251 5.b 5:d853df24:::benchmark_data_smithi006_114134_object100250:head [set-alloc-hint object_size 65536 write_size 65536,write 0~65536] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e37)", 2023-08-01T19:56:21.956 INFO:teuthology.orchestra.run.smithi155.stdout: "initiated_at": "2023-08-01T19:55:05.153737+0000", 2023-08-01T19:56:21.956 INFO:teuthology.orchestra.run.smithi155.stdout: "age": 76.733201105999996, 2023-08-01T19:56:21.956 INFO:teuthology.orchestra.run.smithi155.stdout: "duration": 0.071366545000000003, 2023-08-01T19:56:21.956 INFO:teuthology.orchestra.run.smithi155.stdout: "type_data": { 2023-08-01T19:56:21.956 INFO:teuthology.orchestra.run.smithi155.stdout: "flag_point": "commit sent; apply or cleanup", 2023-08-01T19:56:21.956 INFO:teuthology.orchestra.run.smithi155.stdout: "client_info": { 2023-08-01T19:56:21.956 INFO:teuthology.orchestra.run.smithi155.stdout: "client": "client.4668", 2023-08-01T19:56:21.957 INFO:teuthology.orchestra.run.smithi155.stdout: "client_addr": "172.21.15.6:0/1709472247", 2023-08-01T19:56:21.957 INFO:teuthology.orchestra.run.smithi155.stdout: "tid": 100251 2023-08-01T19:56:21.957 INFO:teuthology.orchestra.run.smithi155.stdout: }, 2023-08-01T19:56:21.957 INFO:teuthology.orchestra.run.smithi155.stdout: "events": [ 2023-08-01T19:56:21.957 INFO:teuthology.orchestra.run.smithi155.stdout: { 2023-08-01T19:56:21.957 INFO:teuthology.orchestra.run.smithi155.stdout: "event": "initiated", 2023-08-01T19:56:21.957 INFO:teuthology.orchestra.run.smithi155.stdout: "time": "2023-08-01T19:55:05.153737+0000", 2023-08-01T19:56:21.957 INFO:teuthology.orchestra.run.smithi155.stdout: "duration": 0 2023-08-01T19:56:21.958 INFO:teuthology.orchestra.run.smithi155.stdout: }, 2023-08-01T19:56:21.958 INFO:teuthology.orchestra.run.smithi155.stdout: { 2023-08-01T19:56:21.958 INFO:teuthology.orchestra.run.smithi155.stdout: "event": "throttled", 2023-08-01T19:56:21.958 INFO:teuthology.orchestra.run.smithi155.stdout: "time": "2023-08-01T19:55:05.153737+0000", 2023-08-01T19:56:21.958 INFO:teuthology.orchestra.run.smithi155.stdout: "duration": 0 2023-08-01T19:56:21.958 INFO:teuthology.orchestra.run.smithi155.stdout: }, 2023-08-01T19:56:21.958 INFO:teuthology.orchestra.run.smithi155.stdout: { 2023-08-01T19:56:21.958 INFO:teuthology.orchestra.run.smithi155.stdout: "event": "header_read", 2023-08-01T19:56:21.959 INFO:teuthology.orchestra.run.smithi155.stdout: "time": "2023-08-01T19:55:05.153736+0000", 2023-08-01T19:56:21.959 INFO:teuthology.orchestra.run.smithi155.stdout: "duration": 4294967295.9999995 2023-08-01T19:56:21.959 INFO:teuthology.orchestra.run.smithi155.stdout: }, 2023-08-01T19:56:21.959 INFO:teuthology.orchestra.run.smithi155.stdout: { 2023-08-01T19:56:21.959 INFO:teuthology.orchestra.run.smithi155.stdout: "event": "all_read", 2023-08-01T19:56:21.959 INFO:teuthology.orchestra.run.smithi155.stdout: "time": "2023-08-01T19:55:05.153784+0000", 2023-08-01T19:56:21.959 INFO:teuthology.orchestra.run.smithi155.stdout: "duration": 4.7660000000000001e-05 2023-08-01T19:56:21.959 INFO:teuthology.orchestra.run.smithi155.stdout: }, 2023-08-01T19:56:21.960 INFO:teuthology.orchestra.run.smithi155.stdout: { 2023-08-01T19:56:21.960 INFO:teuthology.orchestra.run.smithi155.stdout: "event": "dispatched", 2023-08-01T19:56:21.960 INFO:teuthology.orchestra.run.smithi155.stdout: "time": "2023-08-01T19:55:05.153793+0000", 2023-08-01T19:56:21.960 INFO:teuthology.orchestra.run.smithi155.stdout: "duration": 8.7150000000000004e-06 2023-08-01T19:56:21.960 INFO:teuthology.orchestra.run.smithi155.stdout: }, 2023-08-01T19:56:21.960 INFO:teuthology.orchestra.run.smithi155.stdout: { 2023-08-01T19:56:21.960 INFO:teuthology.orchestra.run.smithi155.stdout: "event": "queued_for_pg", 2023-08-01T19:56:21.961 INFO:teuthology.orchestra.run.smithi155.stdout: "time": "2023-08-01T19:55:05.153800+0000", 2023-08-01T19:56:21.961 INFO:teuthology.orchestra.run.smithi155.stdout: "duration": 7.2459999999999997e-06 2023-08-01T19:56:21.961 INFO:teuthology.orchestra.run.smithi155.stdout: }, 2023-08-01T19:56:21.961 INFO:teuthology.orchestra.run.smithi155.stdout: { 2023-08-01T19:56:21.961 INFO:teuthology.orchestra.run.smithi155.stdout: "event": "reached_pg", 2023-08-01T19:56:21.961 INFO:teuthology.orchestra.run.smithi155.stdout: "time": "2023-08-01T19:55:05.156241+0000", 2023-08-01T19:56:21.961 INFO:teuthology.orchestra.run.smithi155.stdout: "duration": 0.0024415359999999998 2023-08-01T19:56:21.961 INFO:teuthology.orchestra.run.smithi155.stdout: }, 2023-08-01T19:56:21.962 INFO:teuthology.orchestra.run.smithi155.stdout: { 2023-08-01T19:56:21.962 INFO:teuthology.orchestra.run.smithi155.stdout: "event": "started", 2023-08-01T19:56:21.962 INFO:teuthology.orchestra.run.smithi155.stdout: "time": "2023-08-01T19:55:05.219045+0000", 2023-08-01T19:56:21.962 INFO:teuthology.orchestra.run.smithi155.stdout: "duration": 0.062803855000000006 2023-08-01T19:56:21.962 INFO:teuthology.orchestra.run.smithi155.stdout: }, 2023-08-01T19:56:21.962 INFO:teuthology.orchestra.run.smithi155.stdout: { 2023-08-01T19:56:21.962 INFO:teuthology.orchestra.run.smithi155.stdout: "event": "waiting for subops from 0", 2023-08-01T19:56:21.962 INFO:teuthology.orchestra.run.smithi155.stdout: "time": "2023-08-01T19:55:05.219238+0000", 2023-08-01T19:56:21.963 INFO:teuthology.orchestra.run.smithi155.stdout: "duration": 0.00019241500000000001 2023-08-01T19:56:21.963 INFO:teuthology.orchestra.run.smithi155.stdout: }, 2023-08-01T19:56:21.963 INFO:teuthology.orchestra.run.smithi155.stdout: { 2023-08-01T19:56:21.963 INFO:teuthology.orchestra.run.smithi155.stdout: "event": "sub_op_commit_rec", 2023-08-01T19:56:21.963 INFO:teuthology.orchestra.run.smithi155.stdout: "time": "2023-08-01T19:55:05.223300+0000", 2023-08-01T19:56:21.963 INFO:teuthology.orchestra.run.smithi155.stdout: "duration": 0.0040626509999999996 2023-08-01T19:56:21.963 INFO:teuthology.orchestra.run.smithi155.stdout: }, 2023-08-01T19:56:21.963 INFO:teuthology.orchestra.run.smithi155.stdout: { 2023-08-01T19:56:21.964 INFO:teuthology.orchestra.run.smithi155.stdout: "event": "op_commit", 2023-08-01T19:56:21.964 INFO:teuthology.orchestra.run.smithi155.stdout: "time": "2023-08-01T19:55:05.225020+0000", 2023-08-01T19:56:21.964 INFO:teuthology.orchestra.run.smithi155.stdout: "duration": 0.0017201 2023-08-01T19:56:21.964 INFO:teuthology.orchestra.run.smithi155.stdout: }, 2023-08-01T19:56:21.964 INFO:teuthology.orchestra.run.smithi155.stdout: { 2023-08-01T19:56:21.964 INFO:teuthology.orchestra.run.smithi155.stdout: "event": "commit_sent", 2023-08-01T19:56:21.964 INFO:teuthology.orchestra.run.smithi155.stdout: "time": "2023-08-01T19:55:05.225066+0000", 2023-08-01T19:56:21.965 INFO:teuthology.orchestra.run.smithi155.stdout: "duration": 4.6143000000000002e-05 2023-08-01T19:56:21.965 INFO:teuthology.orchestra.run.smithi155.stdout: }, 2023-08-01T19:56:21.965 INFO:teuthology.orchestra.run.smithi155.stdout: { 2023-08-01T19:56:21.965 INFO:teuthology.orchestra.run.smithi155.stdout: "event": "done", 2023-08-01T19:56:21.965 INFO:teuthology.orchestra.run.smithi155.stdout: "time": "2023-08-01T19:55:05.225103+0000", 2023-08-01T19:56:21.965 INFO:teuthology.orchestra.run.smithi155.stdout: "duration": 3.6789999999999998e-05 2023-08-01T19:56:21.965 INFO:teuthology.orchestra.run.smithi155.stdout: } 2023-08-01T19:56:21.965 INFO:teuthology.orchestra.run.smithi155.stdout: ] 2023-08-01T19:56:21.966 INFO:teuthology.orchestra.run.smithi155.stdout: } 2023-08-01T19:56:21.966 INFO:teuthology.orchestra.run.smithi155.stdout: }, 2023-08-01T19:56:21.966 INFO:teuthology.orchestra.run.smithi155.stdout: { 2023-08-01T19:56:21.966 INFO:teuthology.orchestra.run.smithi155.stdout: "description": "osd_op(client.4668.0:100252 5.0 5:01f90c3c:::benchmark_data_smithi006_114134_object100251:head [set-alloc-hint object_size 65536 write_size 65536,write 0~65536] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e37)", 2023-08-01T19:56:21.966 INFO:teuthology.orchestra.run.smithi155.stdout: "initiated_at": "2023-08-01T19:55:05.154048+0000", 2023-08-01T19:56:21.966 INFO:teuthology.orchestra.run.smithi155.stdout: "age": 76.732889858999997, 2023-08-01T19:56:21.966 INFO:teuthology.orchestra.run.smithi155.stdout: "duration": 0.070156683999999997, 2023-08-01T19:56:21.966 INFO:teuthology.orchestra.run.smithi155.stdout: "type_data": { 2023-08-01T19:56:21.967 INFO:teuthology.orchestra.run.smithi155.stdout: "flag_point": "commit sent; apply or cleanup", 2023-08-01T19:56:21.967 INFO:teuthology.orchestra.run.smithi155.stdout: "client_info": { 2023-08-01T19:56:21.967 INFO:teuthology.orchestra.run.smithi155.stdout: "client": "client.4668", 2023-08-01T19:56:21.967 INFO:teuthology.orchestra.run.smithi155.stdout: "client_addr": "172.21.15.6:0/1709472247", 2023-08-01T19:56:21.967 INFO:teuthology.orchestra.run.smithi155.stdout: "tid": 100252 2023-08-01T19:56:21.967 INFO:teuthology.orchestra.run.smithi155.stdout: }, 2023-08-01T19:56:21.967 INFO:teuthology.orchestra.run.smithi155.stdout: "events": [ 2023-08-01T19:56:21.967 INFO:teuthology.orchestra.run.smithi155.stdout: { 2023-08-01T19:56:21.968 INFO:teuthology.orchestra.run.smithi155.stdout: "event": "initiated", 2023-08-01T19:56:21.968 INFO:teuthology.orchestra.run.smithi155.stdout: "time": "2023-08-01T19:55:05.154048+0000", 2023-08-01T19:56:21.968 INFO:teuthology.orchestra.run.smithi155.stdout: "duration": 0 2023-08-01T19:56:21.968 INFO:teuthology.orchestra.run.smithi155.stdout: }, 2023-08-01T19:56:21.968 INFO:teuthology.orchestra.run.smithi155.stdout: { 2023-08-01T19:56:21.968 INFO:teuthology.orchestra.run.smithi155.stdout: "event": "throttled", 2023-08-01T19:56:21.968 INFO:teuthology.orchestra.run.smithi155.stdout: "time": "2023-08-01T19:55:05.154048+0000", 2023-08-01T19:56:21.969 INFO:teuthology.orchestra.run.smithi155.stdout: "duration": 0 2023-08-01T19:56:21.969 INFO:teuthology.orchestra.run.smithi155.stdout: }, 2023-08-01T19:56:21.969 INFO:teuthology.orchestra.run.smithi155.stdout: { 2023-08-01T19:56:21.969 INFO:teuthology.orchestra.run.smithi155.stdout: "event": "header_read", 2023-08-01T19:56:21.969 INFO:teuthology.orchestra.run.smithi155.stdout: "time": "2023-08-01T19:55:05.154047+0000", 2023-08-01T19:56:21.969 INFO:teuthology.orchestra.run.smithi155.stdout: "duration": 4294967295.999999 2023-08-01T19:56:21.969 INFO:teuthology.orchestra.run.smithi155.stdout: }, 2023-08-01T19:56:21.969 INFO:teuthology.orchestra.run.smithi155.stdout: { 2023-08-01T19:56:21.970 INFO:teuthology.orchestra.run.smithi155.stdout: "event": "all_read", 2023-08-01T19:56:21.970 INFO:teuthology.orchestra.run.smithi155.stdout: "time": "2023-08-01T19:55:05.154115+0000", 2023-08-01T19:56:21.970 INFO:teuthology.orchestra.run.smithi155.stdout: "duration": 6.7545999999999993e-05 2023-08-01T19:56:21.970 INFO:teuthology.orchestra.run.smithi155.stdout: }, 2023-08-01T19:56:21.970 INFO:teuthology.orchestra.run.smithi155.stdout: { 2023-08-01T19:56:21.970 INFO:teuthology.orchestra.run.smithi155.stdout: "event": "dispatched", 2023-08-01T19:56:21.970 INFO:teuthology.orchestra.run.smithi155.stdout: "time": "2023-08-01T19:55:05.154125+0000", 2023-08-01T19:56:21.970 INFO:teuthology.orchestra.run.smithi155.stdout: "duration": 1.0669000000000001e-05 2023-08-01T19:56:21.971 INFO:teuthology.orchestra.run.smithi155.stdout: }, 2023-08-01T19:56:21.971 INFO:teuthology.orchestra.run.smithi155.stdout: { 2023-08-01T19:56:21.971 INFO:teuthology.orchestra.run.smithi155.stdout: "event": "queued_for_pg", 2023-08-01T19:56:21.971 INFO:teuthology.orchestra.run.smithi155.stdout: "time": "2023-08-01T19:55:05.154131+0000", 2023-08-01T19:56:21.971 INFO:teuthology.orchestra.run.smithi155.stdout: "duration": 6.0349999999999998e-06 2023-08-01T19:56:21.971 INFO:teuthology.orchestra.run.smithi155.stdout: }, 2023-08-01T19:56:21.971 INFO:teuthology.orchestra.run.smithi155.stdout: { 2023-08-01T19:56:21.971 INFO:teuthology.orchestra.run.smithi155.stdout: "event": "reached_pg", 2023-08-01T19:56:21.972 INFO:teuthology.orchestra.run.smithi155.stdout: "time": "2023-08-01T19:55:05.154174+0000", 2023-08-01T19:56:21.972 INFO:teuthology.orchestra.run.smithi155.stdout: "duration": 4.2429000000000003e-05 2023-08-01T19:56:21.972 INFO:teuthology.orchestra.run.smithi155.stdout: }, 2023-08-01T19:56:21.972 INFO:teuthology.orchestra.run.smithi155.stdout: { 2023-08-01T19:56:21.972 INFO:teuthology.orchestra.run.smithi155.stdout: "event": "started", 2023-08-01T19:56:21.972 INFO:teuthology.orchestra.run.smithi155.stdout: "time": "2023-08-01T19:55:05.154287+0000", 2023-08-01T19:56:21.972 INFO:teuthology.orchestra.run.smithi155.stdout: "duration": 0.000113138 2023-08-01T19:56:21.972 INFO:teuthology.orchestra.run.smithi155.stdout: }, 2023-08-01T19:56:21.973 INFO:teuthology.orchestra.run.smithi155.stdout: { 2023-08-01T19:56:21.973 INFO:teuthology.orchestra.run.smithi155.stdout: "event": "waiting for subops from 0", 2023-08-01T19:56:21.973 INFO:teuthology.orchestra.run.smithi155.stdout: "time": "2023-08-01T19:55:05.154420+0000", 2023-08-01T19:56:21.973 INFO:teuthology.orchestra.run.smithi155.stdout: "duration": 0.000133292 2023-08-01T19:56:21.973 INFO:teuthology.orchestra.run.smithi155.stdout: }, 2023-08-01T19:56:21.973 INFO:teuthology.orchestra.run.smithi155.stdout: { 2023-08-01T19:56:21.973 INFO:teuthology.orchestra.run.smithi155.stdout: "event": "sub_op_commit_rec", 2023-08-01T19:56:21.973 INFO:teuthology.orchestra.run.smithi155.stdout: "time": "2023-08-01T19:55:05.219034+0000", 2023-08-01T19:56:21.974 INFO:teuthology.orchestra.run.smithi155.stdout: "duration": 0.064613429999999999 2023-08-01T19:56:21.974 INFO:teuthology.orchestra.run.smithi155.stdout: }, 2023-08-01T19:56:21.974 INFO:teuthology.orchestra.run.smithi155.stdout: { 2023-08-01T19:56:21.974 INFO:teuthology.orchestra.run.smithi155.stdout: "event": "op_commit", 2023-08-01T19:56:21.974 INFO:teuthology.orchestra.run.smithi155.stdout: "time": "2023-08-01T19:55:05.224138+0000", 2023-08-01T19:56:21.974 INFO:teuthology.orchestra.run.smithi155.stdout: "duration": 0.0051041999999999997 2023-08-01T19:56:21.974 INFO:teuthology.orchestra.run.smithi155.stdout: }, 2023-08-01T19:56:21.975 INFO:teuthology.orchestra.run.smithi155.stdout: { 2023-08-01T19:56:21.975 INFO:teuthology.orchestra.run.smithi155.stdout: "event": "commit_sent", 2023-08-01T19:56:21.975 INFO:teuthology.orchestra.run.smithi155.stdout: "time": "2023-08-01T19:55:05.224171+0000", 2023-08-01T19:56:21.975 INFO:teuthology.orchestra.run.smithi155.stdout: "duration": 3.3345e-05 2023-08-01T19:56:21.975 INFO:teuthology.orchestra.run.smithi155.stdout: }, 2023-08-01T19:56:21.975 INFO:teuthology.orchestra.run.smithi155.stdout: { 2023-08-01T19:56:21.975 INFO:teuthology.orchestra.run.smithi155.stdout: "event": "done", 2023-08-01T19:56:21.975 INFO:teuthology.orchestra.run.smithi155.stdout: "time": "2023-08-01T19:55:05.224205+0000", 2023-08-01T19:56:21.976 INFO:teuthology.orchestra.run.smithi155.stdout: "duration": 3.3525999999999997e-05 2023-08-01T19:56:21.976 INFO:teuthology.orchestra.run.smithi155.stdout: } 2023-08-01T19:56:21.976 INFO:teuthology.orchestra.run.smithi155.stdout: ] 2023-08-01T19:56:21.976 INFO:teuthology.orchestra.run.smithi155.stdout: } 2023-08-01T19:56:21.976 INFO:teuthology.orchestra.run.smithi155.stdout: }, 2023-08-01T19:56:21.976 INFO:teuthology.orchestra.run.smithi155.stdout: { 2023-08-01T19:56:21.976 INFO:teuthology.orchestra.run.smithi155.stdout: "description": "osd_repop_reply(client.4668.0:100237 5.4 e37/19 ondisk, result = 0)", 2023-08-01T19:56:21.977 INFO:teuthology.orchestra.run.smithi155.stdout: "initiated_at": "2023-08-01T19:55:05.156249+0000", 2023-08-01T19:56:21.977 INFO:teuthology.orchestra.run.smithi155.stdout: "age": 76.730688913999998, 2023-08-01T19:56:21.977 INFO:teuthology.orchestra.run.smithi155.stdout: "duration": 0.062792549000000003, 2023-08-01T19:56:21.977 INFO:teuthology.orchestra.run.smithi155.stdout: "type_data": { 2023-08-01T19:56:21.977 INFO:teuthology.orchestra.run.smithi155.stdout: "flag_point": "started", 2023-08-01T19:56:21.977 INFO:teuthology.orchestra.run.smithi155.stdout: "events": [ 2023-08-01T19:56:21.977 INFO:teuthology.orchestra.run.smithi155.stdout: { 2023-08-01T19:56:21.977 INFO:teuthology.orchestra.run.smithi155.stdout: "event": "initiated", 2023-08-01T19:56:21.978 INFO:teuthology.orchestra.run.smithi155.stdout: "time": "2023-08-01T19:55:05.156249+0000", 2023-08-01T19:56:21.978 INFO:teuthology.orchestra.run.smithi155.stdout: "duration": 0 2023-08-01T19:56:21.978 INFO:teuthology.orchestra.run.smithi155.stdout: }, 2023-08-01T19:56:21.978 INFO:teuthology.orchestra.run.smithi155.stdout: { 2023-08-01T19:56:21.978 INFO:teuthology.orchestra.run.smithi155.stdout: "event": "throttled", 2023-08-01T19:56:21.978 INFO:teuthology.orchestra.run.smithi155.stdout: "time": "2023-08-01T19:55:05.156249+0000", 2023-08-01T19:56:21.978 INFO:teuthology.orchestra.run.smithi155.stdout: "duration": 0 2023-08-01T19:56:21.979 INFO:teuthology.orchestra.run.smithi155.stdout: }, 2023-08-01T19:56:21.979 INFO:teuthology.orchestra.run.smithi155.stdout: { 2023-08-01T19:56:21.979 INFO:teuthology.orchestra.run.smithi155.stdout: "event": "header_read", 2023-08-01T19:56:21.979 INFO:teuthology.orchestra.run.smithi155.stdout: "time": "2023-08-01T19:55:05.156248+0000", 2023-08-01T19:56:21.979 INFO:teuthology.orchestra.run.smithi155.stdout: "duration": 4294967295.9999995 2023-08-01T19:56:21.979 INFO:teuthology.orchestra.run.smithi155.stdout: }, 2023-08-01T19:56:21.979 INFO:teuthology.orchestra.run.smithi155.stdout: { 2023-08-01T19:56:21.979 INFO:teuthology.orchestra.run.smithi155.stdout: "event": "all_read", 2023-08-01T19:56:21.980 INFO:teuthology.orchestra.run.smithi155.stdout: "time": "2023-08-01T19:55:05.156252+0000", 2023-08-01T19:56:21.980 INFO:teuthology.orchestra.run.smithi155.stdout: "duration": 3.9999999999999998e-06 2023-08-01T19:56:21.980 INFO:teuthology.orchestra.run.smithi155.stdout: }, 2023-08-01T19:56:21.980 INFO:teuthology.orchestra.run.smithi155.stdout: { 2023-08-01T19:56:21.980 INFO:teuthology.orchestra.run.smithi155.stdout: "event": "dispatched", 2023-08-01T19:56:21.980 INFO:teuthology.orchestra.run.smithi155.stdout: "time": "2023-08-01T19:55:05.218844+0000", 2023-08-01T19:56:21.980 INFO:teuthology.orchestra.run.smithi155.stdout: "duration": 0.062591516999999999 2023-08-01T19:56:21.980 INFO:teuthology.orchestra.run.smithi155.stdout: }, 2023-08-01T19:56:21.981 INFO:teuthology.orchestra.run.smithi155.stdout: { 2023-08-01T19:56:21.981 INFO:teuthology.orchestra.run.smithi155.stdout: "event": "queued_for_pg", 2023-08-01T19:56:21.981 INFO:teuthology.orchestra.run.smithi155.stdout: "time": "2023-08-01T19:55:05.218862+0000", 2023-08-01T19:56:21.981 INFO:teuthology.orchestra.run.smithi155.stdout: "duration": 1.7666e-05 2023-08-01T19:56:21.981 INFO:teuthology.orchestra.run.smithi155.stdout: }, 2023-08-01T19:56:21.981 INFO:teuthology.orchestra.run.smithi155.stdout: { 2023-08-01T19:56:21.981 INFO:teuthology.orchestra.run.smithi155.stdout: "event": "reached_pg", 2023-08-01T19:56:21.981 INFO:teuthology.orchestra.run.smithi155.stdout: "time": "2023-08-01T19:55:05.218914+0000", 2023-08-01T19:56:21.982 INFO:teuthology.orchestra.run.smithi155.stdout: "duration": 5.2565999999999998e-05 2023-08-01T19:56:21.982 INFO:teuthology.orchestra.run.smithi155.stdout: }, 2023-08-01T19:56:21.982 INFO:teuthology.orchestra.run.smithi155.stdout: { 2023-08-01T19:56:21.982 INFO:teuthology.orchestra.run.smithi155.stdout: "event": "started", 2023-08-01T19:56:21.982 INFO:teuthology.orchestra.run.smithi155.stdout: "time": "2023-08-01T19:55:05.218925+0000", 2023-08-01T19:56:21.982 INFO:teuthology.orchestra.run.smithi155.stdout: "duration": 1.1375e-05 2023-08-01T19:56:21.982 INFO:teuthology.orchestra.run.smithi155.stdout: }, 2023-08-01T19:56:21.982 INFO:teuthology.orchestra.run.smithi155.stdout: { 2023-08-01T19:56:21.983 INFO:teuthology.orchestra.run.smithi155.stdout: "event": "done", 2023-08-01T19:56:21.983 INFO:teuthology.orchestra.run.smithi155.stdout: "time": "2023-08-01T19:55:05.219041+0000", 2023-08-01T19:56:21.983 INFO:teuthology.orchestra.run.smithi155.stdout: "duration": 0.000115977 2023-08-01T19:56:21.983 INFO:teuthology.orchestra.run.smithi155.stdout: } 2023-08-01T19:56:21.983 INFO:teuthology.orchestra.run.smithi155.stdout: ] 2023-08-01T19:56:21.983 INFO:teuthology.orchestra.run.smithi155.stdout: } 2023-08-01T19:56:21.983 INFO:teuthology.orchestra.run.smithi155.stdout: }, 2023-08-01T19:56:21.983 INFO:teuthology.orchestra.run.smithi155.stdout: { 2023-08-01T19:56:21.984 INFO:teuthology.orchestra.run.smithi155.stdout: "description": "osd_repop(client.4668.0:100253 5.f e37/19 5:f7bbce05:::benchmark_data_smithi006_114134_object100252:head v 37'6323, mlcod=37'6321)", 2023-08-01T19:56:21.984 INFO:teuthology.orchestra.run.smithi155.stdout: "initiated_at": "2023-08-01T19:55:05.156952+0000", 2023-08-01T19:56:21.984 INFO:teuthology.orchestra.run.smithi155.stdout: "age": 76.729985850999995, 2023-08-01T19:56:21.984 INFO:teuthology.orchestra.run.smithi155.stdout: "duration": 0.068018577999999996, 2023-08-01T19:56:21.984 INFO:teuthology.orchestra.run.smithi155.stdout: "type_data": { 2023-08-01T19:56:21.984 INFO:teuthology.orchestra.run.smithi155.stdout: "flag_point": "commit sent; apply or cleanup", 2023-08-01T19:56:21.984 INFO:teuthology.orchestra.run.smithi155.stdout: "events": [ 2023-08-01T19:56:21.985 INFO:teuthology.orchestra.run.smithi155.stdout: { 2023-08-01T19:56:21.985 INFO:teuthology.orchestra.run.smithi155.stdout: "event": "initiated", 2023-08-01T19:56:21.985 INFO:teuthology.orchestra.run.smithi155.stdout: "time": "2023-08-01T19:55:05.156952+0000", 2023-08-01T19:56:21.985 INFO:teuthology.orchestra.run.smithi155.stdout: "duration": 0 2023-08-01T19:56:21.985 INFO:teuthology.orchestra.run.smithi155.stdout: }, 2023-08-01T19:56:21.985 INFO:teuthology.orchestra.run.smithi155.stdout: { 2023-08-01T19:56:21.985 INFO:teuthology.orchestra.run.smithi155.stdout: "event": "throttled", 2023-08-01T19:56:21.985 INFO:teuthology.orchestra.run.smithi155.stdout: "time": "2023-08-01T19:55:05.156952+0000", 2023-08-01T19:56:21.986 INFO:teuthology.orchestra.run.smithi155.stdout: "duration": 0 2023-08-01T19:56:21.986 INFO:teuthology.orchestra.run.smithi155.stdout: }, 2023-08-01T19:56:21.986 INFO:teuthology.orchestra.run.smithi155.stdout: { 2023-08-01T19:56:21.986 INFO:teuthology.orchestra.run.smithi155.stdout: "event": "header_read", 2023-08-01T19:56:21.986 INFO:teuthology.orchestra.run.smithi155.stdout: "time": "2023-08-01T19:55:05.156951+0000", 2023-08-01T19:56:21.986 INFO:teuthology.orchestra.run.smithi155.stdout: "duration": 4294967295.999999 2023-08-01T19:56:21.986 INFO:teuthology.orchestra.run.smithi155.stdout: }, 2023-08-01T19:56:21.986 INFO:teuthology.orchestra.run.smithi155.stdout: { 2023-08-01T19:56:21.987 INFO:teuthology.orchestra.run.smithi155.stdout: "event": "all_read", 2023-08-01T19:56:21.987 INFO:teuthology.orchestra.run.smithi155.stdout: "time": "2023-08-01T19:55:05.156989+0000", 2023-08-01T19:56:21.987 INFO:teuthology.orchestra.run.smithi155.stdout: "duration": 3.8175e-05 2023-08-01T19:56:21.987 INFO:teuthology.orchestra.run.smithi155.stdout: }, 2023-08-01T19:56:21.987 INFO:teuthology.orchestra.run.smithi155.stdout: { 2023-08-01T19:56:21.987 INFO:teuthology.orchestra.run.smithi155.stdout: "event": "dispatched", 2023-08-01T19:56:21.987 INFO:teuthology.orchestra.run.smithi155.stdout: "time": "2023-08-01T19:55:05.218842+0000", 2023-08-01T19:56:21.987 INFO:teuthology.orchestra.run.smithi155.stdout: "duration": 0.061852299999999999 2023-08-01T19:56:21.988 INFO:teuthology.orchestra.run.smithi155.stdout: }, 2023-08-01T19:56:21.988 INFO:teuthology.orchestra.run.smithi155.stdout: { 2023-08-01T19:56:21.988 INFO:teuthology.orchestra.run.smithi155.stdout: "event": "queued_for_pg", 2023-08-01T19:56:21.988 INFO:teuthology.orchestra.run.smithi155.stdout: "time": "2023-08-01T19:55:05.218862+0000", 2023-08-01T19:56:21.988 INFO:teuthology.orchestra.run.smithi155.stdout: "duration": 1.9854999999999999e-05 2023-08-01T19:56:21.988 INFO:teuthology.orchestra.run.smithi155.stdout: }, 2023-08-01T19:56:21.988 INFO:teuthology.orchestra.run.smithi155.stdout: { 2023-08-01T19:56:21.988 INFO:teuthology.orchestra.run.smithi155.stdout: "event": "reached_pg", 2023-08-01T19:56:21.989 INFO:teuthology.orchestra.run.smithi155.stdout: "time": "2023-08-01T19:55:05.218918+0000", 2023-08-01T19:56:21.989 INFO:teuthology.orchestra.run.smithi155.stdout: "duration": 5.6570000000000002e-05 2023-08-01T19:56:21.989 INFO:teuthology.orchestra.run.smithi155.stdout: }, 2023-08-01T19:56:21.989 INFO:teuthology.orchestra.run.smithi155.stdout: { 2023-08-01T19:56:21.989 INFO:teuthology.orchestra.run.smithi155.stdout: "event": "started", 2023-08-01T19:56:21.989 INFO:teuthology.orchestra.run.smithi155.stdout: "time": "2023-08-01T19:55:05.218940+0000", 2023-08-01T19:56:21.989 INFO:teuthology.orchestra.run.smithi155.stdout: "duration": 2.1804e-05 2023-08-01T19:56:21.989 INFO:teuthology.orchestra.run.smithi155.stdout: }, 2023-08-01T19:56:21.990 INFO:teuthology.orchestra.run.smithi155.stdout: { 2023-08-01T19:56:21.990 INFO:teuthology.orchestra.run.smithi155.stdout: "event": "commit_sent", 2023-08-01T19:56:21.990 INFO:teuthology.orchestra.run.smithi155.stdout: "time": "2023-08-01T19:55:05.224928+0000", 2023-08-01T19:56:21.990 INFO:teuthology.orchestra.run.smithi155.stdout: "duration": 0.0059876759999999999 2023-08-01T19:56:21.990 INFO:teuthology.orchestra.run.smithi155.stdout: }, 2023-08-01T19:56:21.990 INFO:teuthology.orchestra.run.smithi155.stdout: { 2023-08-01T19:56:21.990 INFO:teuthology.orchestra.run.smithi155.stdout: "event": "done", 2023-08-01T19:56:21.990 INFO:teuthology.orchestra.run.smithi155.stdout: "time": "2023-08-01T19:55:05.224971+0000", 2023-08-01T19:56:21.991 INFO:teuthology.orchestra.run.smithi155.stdout: "duration": 4.2929999999999997e-05 2023-08-01T19:56:21.991 INFO:teuthology.orchestra.run.smithi155.stdout: } 2023-08-01T19:56:21.991 INFO:teuthology.orchestra.run.smithi155.stdout: ] 2023-08-01T19:56:21.991 INFO:teuthology.orchestra.run.smithi155.stdout: } 2023-08-01T19:56:21.991 INFO:teuthology.orchestra.run.smithi155.stdout: }, 2023-08-01T19:56:21.991 INFO:teuthology.orchestra.run.smithi155.stdout: { 2023-08-01T19:56:21.991 INFO:teuthology.orchestra.run.smithi155.stdout: "description": "osd_op(client.4668.0:100927 5.0 5:00608ec6:::benchmark_data_smithi006_114134_object100926:head [set-alloc-hint object_size 65536 write_size 65536,write 0~65536] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e37)", 2023-08-01T19:56:21.991 INFO:teuthology.orchestra.run.smithi155.stdout: "initiated_at": "2023-08-01T19:55:05.561169+0000", 2023-08-01T19:56:21.992 INFO:teuthology.orchestra.run.smithi155.stdout: "age": 76.325768948000004, 2023-08-01T19:56:21.992 INFO:teuthology.orchestra.run.smithi155.stdout: "duration": 0.066411687999999997, 2023-08-01T19:56:21.992 INFO:teuthology.orchestra.run.smithi155.stdout: "type_data": { 2023-08-01T19:56:21.992 INFO:teuthology.orchestra.run.smithi155.stdout: "flag_point": "commit sent; apply or cleanup", 2023-08-01T19:56:21.992 INFO:teuthology.orchestra.run.smithi155.stdout: "client_info": { 2023-08-01T19:56:21.992 INFO:teuthology.orchestra.run.smithi155.stdout: "client": "client.4668", 2023-08-01T19:56:21.992 INFO:teuthology.orchestra.run.smithi155.stdout: "client_addr": "172.21.15.6:0/1709472247", 2023-08-01T19:56:21.993 INFO:teuthology.orchestra.run.smithi155.stdout: "tid": 100927 2023-08-01T19:56:21.993 INFO:teuthology.orchestra.run.smithi155.stdout: }, 2023-08-01T19:56:21.993 INFO:teuthology.orchestra.run.smithi155.stdout: "events": [ 2023-08-01T19:56:21.993 INFO:teuthology.orchestra.run.smithi155.stdout: { 2023-08-01T19:56:21.993 INFO:teuthology.orchestra.run.smithi155.stdout: "event": "initiated", 2023-08-01T19:56:21.993 INFO:teuthology.orchestra.run.smithi155.stdout: "time": "2023-08-01T19:55:05.561169+0000", 2023-08-01T19:56:21.993 INFO:teuthology.orchestra.run.smithi155.stdout: "duration": 0 2023-08-01T19:56:21.993 INFO:teuthology.orchestra.run.smithi155.stdout: }, 2023-08-01T19:56:21.994 INFO:teuthology.orchestra.run.smithi155.stdout: { 2023-08-01T19:56:21.994 INFO:teuthology.orchestra.run.smithi155.stdout: "event": "throttled", 2023-08-01T19:56:21.994 INFO:teuthology.orchestra.run.smithi155.stdout: "time": "2023-08-01T19:55:05.561169+0000", 2023-08-01T19:56:21.994 INFO:teuthology.orchestra.run.smithi155.stdout: "duration": 0 2023-08-01T19:56:21.994 INFO:teuthology.orchestra.run.smithi155.stdout: }, 2023-08-01T19:56:21.994 INFO:teuthology.orchestra.run.smithi155.stdout: { 2023-08-01T19:56:21.994 INFO:teuthology.orchestra.run.smithi155.stdout: "event": "header_read", 2023-08-01T19:56:21.994 INFO:teuthology.orchestra.run.smithi155.stdout: "time": "2023-08-01T19:55:05.561168+0000", 2023-08-01T19:56:21.995 INFO:teuthology.orchestra.run.smithi155.stdout: "duration": 4294967295.9999995 2023-08-01T19:56:21.995 INFO:teuthology.orchestra.run.smithi155.stdout: }, 2023-08-01T19:56:21.995 INFO:teuthology.orchestra.run.smithi155.stdout: { 2023-08-01T19:56:21.995 INFO:teuthology.orchestra.run.smithi155.stdout: "event": "all_read", 2023-08-01T19:56:21.995 INFO:teuthology.orchestra.run.smithi155.stdout: "time": "2023-08-01T19:55:05.561218+0000", 2023-08-01T19:56:21.995 INFO:teuthology.orchestra.run.smithi155.stdout: "duration": 4.9379999999999998e-05 2023-08-01T19:56:21.995 INFO:teuthology.orchestra.run.smithi155.stdout: }, 2023-08-01T19:56:21.995 INFO:teuthology.orchestra.run.smithi155.stdout: { 2023-08-01T19:56:21.996 INFO:teuthology.orchestra.run.smithi155.stdout: "event": "dispatched", 2023-08-01T19:56:21.996 INFO:teuthology.orchestra.run.smithi155.stdout: "time": "2023-08-01T19:55:05.561225+0000", 2023-08-01T19:56:21.996 INFO:teuthology.orchestra.run.smithi155.stdout: "duration": 7.114e-06 2023-08-01T19:56:21.996 INFO:teuthology.orchestra.run.smithi155.stdout: }, 2023-08-01T19:56:21.996 INFO:teuthology.orchestra.run.smithi155.stdout: { 2023-08-01T19:56:21.996 INFO:teuthology.orchestra.run.smithi155.stdout: "event": "queued_for_pg", 2023-08-01T19:56:21.996 INFO:teuthology.orchestra.run.smithi155.stdout: "time": "2023-08-01T19:55:05.561229+0000", 2023-08-01T19:56:21.997 INFO:teuthology.orchestra.run.smithi155.stdout: "duration": 4.2180000000000001e-06 2023-08-01T19:56:21.997 INFO:teuthology.orchestra.run.smithi155.stdout: }, 2023-08-01T19:56:21.997 INFO:teuthology.orchestra.run.smithi155.stdout: { 2023-08-01T19:56:21.997 INFO:teuthology.orchestra.run.smithi155.stdout: "event": "reached_pg", 2023-08-01T19:56:21.997 INFO:teuthology.orchestra.run.smithi155.stdout: "time": "2023-08-01T19:55:05.564737+0000", 2023-08-01T19:56:21.997 INFO:teuthology.orchestra.run.smithi155.stdout: "duration": 0.0035081869999999999 2023-08-01T19:56:21.997 INFO:teuthology.orchestra.run.smithi155.stdout: }, 2023-08-01T19:56:21.997 INFO:teuthology.orchestra.run.smithi155.stdout: { 2023-08-01T19:56:21.998 INFO:teuthology.orchestra.run.smithi155.stdout: "event": "started", 2023-08-01T19:56:21.998 INFO:teuthology.orchestra.run.smithi155.stdout: "time": "2023-08-01T19:55:05.564859+0000", 2023-08-01T19:56:21.998 INFO:teuthology.orchestra.run.smithi155.stdout: "duration": 0.00012165800000000001 2023-08-01T19:56:21.998 INFO:teuthology.orchestra.run.smithi155.stdout: }, 2023-08-01T19:56:21.998 INFO:teuthology.orchestra.run.smithi155.stdout: { 2023-08-01T19:56:21.998 INFO:teuthology.orchestra.run.smithi155.stdout: "event": "waiting for subops from 0", 2023-08-01T19:56:21.998 INFO:teuthology.orchestra.run.smithi155.stdout: "time": "2023-08-01T19:55:05.565009+0000", 2023-08-01T19:56:21.998 INFO:teuthology.orchestra.run.smithi155.stdout: "duration": 0.00014979699999999999 2023-08-01T19:56:21.999 INFO:teuthology.orchestra.run.smithi155.stdout: }, 2023-08-01T19:56:21.999 INFO:teuthology.orchestra.run.smithi155.stdout: { 2023-08-01T19:56:21.999 INFO:teuthology.orchestra.run.smithi155.stdout: "event": "op_commit", 2023-08-01T19:56:21.999 INFO:teuthology.orchestra.run.smithi155.stdout: "time": "2023-08-01T19:55:05.568007+0000", 2023-08-01T19:56:21.999 INFO:teuthology.orchestra.run.smithi155.stdout: "duration": 0.00299796 2023-08-01T19:56:21.999 INFO:teuthology.orchestra.run.smithi155.stdout: }, 2023-08-01T19:56:21.999 INFO:teuthology.orchestra.run.smithi155.stdout: { 2023-08-01T19:56:21.999 INFO:teuthology.orchestra.run.smithi155.stdout: "event": "sub_op_commit_rec", 2023-08-01T19:56:22.000 INFO:teuthology.orchestra.run.smithi155.stdout: "time": "2023-08-01T19:55:05.627520+0000", 2023-08-01T19:56:22.000 INFO:teuthology.orchestra.run.smithi155.stdout: "duration": 0.059513636000000002 2023-08-01T19:56:22.000 INFO:teuthology.orchestra.run.smithi155.stdout: }, 2023-08-01T19:56:22.000 INFO:teuthology.orchestra.run.smithi155.stdout: { 2023-08-01T19:56:22.000 INFO:teuthology.orchestra.run.smithi155.stdout: "event": "commit_sent", 2023-08-01T19:56:22.000 INFO:teuthology.orchestra.run.smithi155.stdout: "time": "2023-08-01T19:55:05.627553+0000", 2023-08-01T19:56:22.000 INFO:teuthology.orchestra.run.smithi155.stdout: "duration": 3.2635999999999997e-05 2023-08-01T19:56:22.000 INFO:teuthology.orchestra.run.smithi155.stdout: }, 2023-08-01T19:56:22.001 INFO:teuthology.orchestra.run.smithi155.stdout: { 2023-08-01T19:56:22.001 INFO:teuthology.orchestra.run.smithi155.stdout: "event": "done", 2023-08-01T19:56:22.001 INFO:teuthology.orchestra.run.smithi155.stdout: "time": "2023-08-01T19:55:05.627581+0000", 2023-08-01T19:56:22.001 INFO:teuthology.orchestra.run.smithi155.stdout: "duration": 2.7681000000000001e-05 2023-08-01T19:56:22.001 INFO:teuthology.orchestra.run.smithi155.stdout: } 2023-08-01T19:56:22.001 INFO:teuthology.orchestra.run.smithi155.stdout: ] 2023-08-01T19:56:22.001 INFO:teuthology.orchestra.run.smithi155.stdout: } 2023-08-01T19:56:22.001 INFO:teuthology.orchestra.run.smithi155.stdout: }, 2023-08-01T19:56:22.002 INFO:teuthology.orchestra.run.smithi155.stdout: { 2023-08-01T19:56:22.002 INFO:teuthology.orchestra.run.smithi155.stdout: "description": "osd_op(client.4668.0:100935 5.e 5:7895b14e:::benchmark_data_smithi006_114134_object100934:head [set-alloc-hint object_size 65536 write_size 65536,write 0~65536] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e37)", 2023-08-01T19:56:22.002 INFO:teuthology.orchestra.run.smithi155.stdout: "initiated_at": "2023-08-01T19:55:05.566666+0000", 2023-08-01T19:56:22.002 INFO:teuthology.orchestra.run.smithi155.stdout: "age": 76.320271648000002, 2023-08-01T19:56:22.002 INFO:teuthology.orchestra.run.smithi155.stdout: "duration": 0.064309016999999996, 2023-08-01T19:56:22.002 INFO:teuthology.orchestra.run.smithi155.stdout: "type_data": { 2023-08-01T19:56:22.002 INFO:teuthology.orchestra.run.smithi155.stdout: "flag_point": "commit sent; apply or cleanup", 2023-08-01T19:56:22.002 INFO:teuthology.orchestra.run.smithi155.stdout: "client_info": { 2023-08-01T19:56:22.003 INFO:teuthology.orchestra.run.smithi155.stdout: "client": "client.4668", 2023-08-01T19:56:22.003 INFO:teuthology.orchestra.run.smithi155.stdout: "client_addr": "172.21.15.6:0/1709472247", 2023-08-01T19:56:22.003 INFO:teuthology.orchestra.run.smithi155.stdout: "tid": 100935 2023-08-01T19:56:22.003 INFO:teuthology.orchestra.run.smithi155.stdout: }, 2023-08-01T19:56:22.003 INFO:teuthology.orchestra.run.smithi155.stdout: "events": [ 2023-08-01T19:56:22.003 INFO:teuthology.orchestra.run.smithi155.stdout: { 2023-08-01T19:56:22.003 INFO:teuthology.orchestra.run.smithi155.stdout: "event": "initiated", 2023-08-01T19:56:22.004 INFO:teuthology.orchestra.run.smithi155.stdout: "time": "2023-08-01T19:55:05.566666+0000", 2023-08-01T19:56:22.004 INFO:teuthology.orchestra.run.smithi155.stdout: "duration": 0 2023-08-01T19:56:22.004 INFO:teuthology.orchestra.run.smithi155.stdout: }, 2023-08-01T19:56:22.004 INFO:teuthology.orchestra.run.smithi155.stdout: { 2023-08-01T19:56:22.004 INFO:teuthology.orchestra.run.smithi155.stdout: "event": "throttled", 2023-08-01T19:56:22.004 INFO:teuthology.orchestra.run.smithi155.stdout: "time": "2023-08-01T19:55:05.566666+0000", 2023-08-01T19:56:22.004 INFO:teuthology.orchestra.run.smithi155.stdout: "duration": 0 2023-08-01T19:56:22.004 INFO:teuthology.orchestra.run.smithi155.stdout: }, 2023-08-01T19:56:22.005 INFO:teuthology.orchestra.run.smithi155.stdout: { 2023-08-01T19:56:22.005 INFO:teuthology.orchestra.run.smithi155.stdout: "event": "header_read", 2023-08-01T19:56:22.005 INFO:teuthology.orchestra.run.smithi155.stdout: "time": "2023-08-01T19:55:05.566665+0000", 2023-08-01T19:56:22.005 INFO:teuthology.orchestra.run.smithi155.stdout: "duration": 4294967295.9999986 2023-08-01T19:56:22.005 INFO:teuthology.orchestra.run.smithi155.stdout: }, 2023-08-01T19:56:22.005 INFO:teuthology.orchestra.run.smithi155.stdout: { 2023-08-01T19:56:22.005 INFO:teuthology.orchestra.run.smithi155.stdout: "event": "all_read", 2023-08-01T19:56:22.005 INFO:teuthology.orchestra.run.smithi155.stdout: "time": "2023-08-01T19:55:05.566754+0000", 2023-08-01T19:56:22.006 INFO:teuthology.orchestra.run.smithi155.stdout: "duration": 8.9425999999999994e-05 2023-08-01T19:56:22.006 INFO:teuthology.orchestra.run.smithi155.stdout: }, 2023-08-01T19:56:22.006 INFO:teuthology.orchestra.run.smithi155.stdout: { 2023-08-01T19:56:22.006 INFO:teuthology.orchestra.run.smithi155.stdout: "event": "dispatched", 2023-08-01T19:56:22.006 INFO:teuthology.orchestra.run.smithi155.stdout: "time": "2023-08-01T19:55:05.566766+0000", 2023-08-01T19:56:22.006 INFO:teuthology.orchestra.run.smithi155.stdout: "duration": 1.2018000000000001e-05 2023-08-01T19:56:22.006 INFO:teuthology.orchestra.run.smithi155.stdout: }, 2023-08-01T19:56:22.007 INFO:teuthology.orchestra.run.smithi155.stdout: { 2023-08-01T19:56:22.007 INFO:teuthology.orchestra.run.smithi155.stdout: "event": "queued_for_pg", 2023-08-01T19:56:22.007 INFO:teuthology.orchestra.run.smithi155.stdout: "time": "2023-08-01T19:55:05.566772+0000", 2023-08-01T19:56:22.007 INFO:teuthology.orchestra.run.smithi155.stdout: "duration": 6.0190000000000003e-06 2023-08-01T19:56:22.007 INFO:teuthology.orchestra.run.smithi155.stdout: }, 2023-08-01T19:56:22.007 INFO:teuthology.orchestra.run.smithi155.stdout: { 2023-08-01T19:56:22.007 INFO:teuthology.orchestra.run.smithi155.stdout: "event": "reached_pg", 2023-08-01T19:56:22.007 INFO:teuthology.orchestra.run.smithi155.stdout: "time": "2023-08-01T19:55:05.566800+0000", 2023-08-01T19:56:22.008 INFO:teuthology.orchestra.run.smithi155.stdout: "duration": 2.7835999999999999e-05 2023-08-01T19:56:22.008 INFO:teuthology.orchestra.run.smithi155.stdout: }, 2023-08-01T19:56:22.008 INFO:teuthology.orchestra.run.smithi155.stdout: { 2023-08-01T19:56:22.008 INFO:teuthology.orchestra.run.smithi155.stdout: "event": "started", 2023-08-01T19:56:22.008 INFO:teuthology.orchestra.run.smithi155.stdout: "time": "2023-08-01T19:55:05.566879+0000", 2023-08-01T19:56:22.008 INFO:teuthology.orchestra.run.smithi155.stdout: "duration": 7.9105999999999998e-05 2023-08-01T19:56:22.008 INFO:teuthology.orchestra.run.smithi155.stdout: }, 2023-08-01T19:56:22.009 INFO:teuthology.orchestra.run.smithi155.stdout: { 2023-08-01T19:56:22.009 INFO:teuthology.orchestra.run.smithi155.stdout: "event": "waiting for subops from 0", 2023-08-01T19:56:22.009 INFO:teuthology.orchestra.run.smithi155.stdout: "time": "2023-08-01T19:55:05.566971+0000", 2023-08-01T19:56:22.009 INFO:teuthology.orchestra.run.smithi155.stdout: "duration": 9.1817999999999994e-05 2023-08-01T19:56:22.009 INFO:teuthology.orchestra.run.smithi155.stdout: }, 2023-08-01T19:56:22.009 INFO:teuthology.orchestra.run.smithi155.stdout: { 2023-08-01T19:56:22.009 INFO:teuthology.orchestra.run.smithi155.stdout: "event": "op_commit", 2023-08-01T19:56:22.009 INFO:teuthology.orchestra.run.smithi155.stdout: "time": "2023-08-01T19:55:05.571475+0000", 2023-08-01T19:56:22.010 INFO:teuthology.orchestra.run.smithi155.stdout: "duration": 0.0045039499999999996 2023-08-01T19:56:22.010 INFO:teuthology.orchestra.run.smithi155.stdout: }, 2023-08-01T19:56:22.010 INFO:teuthology.orchestra.run.smithi155.stdout: { 2023-08-01T19:56:22.010 INFO:teuthology.orchestra.run.smithi155.stdout: "event": "sub_op_commit_rec", 2023-08-01T19:56:22.010 INFO:teuthology.orchestra.run.smithi155.stdout: "time": "2023-08-01T19:55:05.630884+0000", 2023-08-01T19:56:22.010 INFO:teuthology.orchestra.run.smithi155.stdout: "duration": 0.059409181999999998 2023-08-01T19:56:22.010 INFO:teuthology.orchestra.run.smithi155.stdout: }, 2023-08-01T19:56:22.010 INFO:teuthology.orchestra.run.smithi155.stdout: { 2023-08-01T19:56:22.011 INFO:teuthology.orchestra.run.smithi155.stdout: "event": "commit_sent", 2023-08-01T19:56:22.011 INFO:teuthology.orchestra.run.smithi155.stdout: "time": "2023-08-01T19:55:05.630930+0000", 2023-08-01T19:56:22.011 INFO:teuthology.orchestra.run.smithi155.stdout: "duration": 4.5507999999999999e-05 2023-08-01T19:56:22.011 INFO:teuthology.orchestra.run.smithi155.stdout: }, 2023-08-01T19:56:22.011 INFO:teuthology.orchestra.run.smithi155.stdout: { 2023-08-01T19:56:22.011 INFO:teuthology.orchestra.run.smithi155.stdout: "event": "done", 2023-08-01T19:56:22.011 INFO:teuthology.orchestra.run.smithi155.stdout: "time": "2023-08-01T19:55:05.630975+0000", 2023-08-01T19:56:22.011 INFO:teuthology.orchestra.run.smithi155.stdout: "duration": 4.5441000000000001e-05 2023-08-01T19:56:22.012 INFO:teuthology.orchestra.run.smithi155.stdout: } 2023-08-01T19:56:22.012 INFO:teuthology.orchestra.run.smithi155.stdout: ] 2023-08-01T19:56:22.012 INFO:teuthology.orchestra.run.smithi155.stdout: } 2023-08-01T19:56:22.012 INFO:teuthology.orchestra.run.smithi155.stdout: }, 2023-08-01T19:56:22.012 INFO:teuthology.orchestra.run.smithi155.stdout: { 2023-08-01T19:56:22.012 INFO:teuthology.orchestra.run.smithi155.stdout: "description": "osd_op(client.4668.0:100941 5.e 5:736a6ac6:::benchmark_data_smithi006_114134_object100940:head [set-alloc-hint object_size 65536 write_size 65536,write 0~65536] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e37)", 2023-08-01T19:56:22.012 INFO:teuthology.orchestra.run.smithi155.stdout: "initiated_at": "2023-08-01T19:55:05.569750+0000", 2023-08-01T19:56:22.013 INFO:teuthology.orchestra.run.smithi155.stdout: "age": 76.317187755000006, 2023-08-01T19:56:22.013 INFO:teuthology.orchestra.run.smithi155.stdout: "duration": 0.065431331999999995, 2023-08-01T19:56:22.013 INFO:teuthology.orchestra.run.smithi155.stdout: "type_data": { 2023-08-01T19:56:22.013 INFO:teuthology.orchestra.run.smithi155.stdout: "flag_point": "commit sent; apply or cleanup", 2023-08-01T19:56:22.013 INFO:teuthology.orchestra.run.smithi155.stdout: "client_info": { 2023-08-01T19:56:22.013 INFO:teuthology.orchestra.run.smithi155.stdout: "client": "client.4668", 2023-08-01T19:56:22.013 INFO:teuthology.orchestra.run.smithi155.stdout: "client_addr": "172.21.15.6:0/1709472247", 2023-08-01T19:56:22.013 INFO:teuthology.orchestra.run.smithi155.stdout: "tid": 100941 2023-08-01T19:56:22.014 INFO:teuthology.orchestra.run.smithi155.stdout: }, 2023-08-01T19:56:22.014 INFO:teuthology.orchestra.run.smithi155.stdout: "events": [ 2023-08-01T19:56:22.014 INFO:teuthology.orchestra.run.smithi155.stdout: { 2023-08-01T19:56:22.014 INFO:teuthology.orchestra.run.smithi155.stdout: "event": "initiated", 2023-08-01T19:56:22.014 INFO:teuthology.orchestra.run.smithi155.stdout: "time": "2023-08-01T19:55:05.569750+0000", 2023-08-01T19:56:22.014 INFO:teuthology.orchestra.run.smithi155.stdout: "duration": 0 2023-08-01T19:56:22.014 INFO:teuthology.orchestra.run.smithi155.stdout: }, 2023-08-01T19:56:22.014 INFO:teuthology.orchestra.run.smithi155.stdout: { 2023-08-01T19:56:22.015 INFO:teuthology.orchestra.run.smithi155.stdout: "event": "throttled", 2023-08-01T19:56:22.015 INFO:teuthology.orchestra.run.smithi155.stdout: "time": "2023-08-01T19:55:05.569750+0000", 2023-08-01T19:56:22.015 INFO:teuthology.orchestra.run.smithi155.stdout: "duration": 0 2023-08-01T19:56:22.015 INFO:teuthology.orchestra.run.smithi155.stdout: }, 2023-08-01T19:56:22.015 INFO:teuthology.orchestra.run.smithi155.stdout: { 2023-08-01T19:56:22.015 INFO:teuthology.orchestra.run.smithi155.stdout: "event": "header_read", 2023-08-01T19:56:22.015 INFO:teuthology.orchestra.run.smithi155.stdout: "time": "2023-08-01T19:55:05.569749+0000", 2023-08-01T19:56:22.015 INFO:teuthology.orchestra.run.smithi155.stdout: "duration": 4294967295.999999 2023-08-01T19:56:22.016 INFO:teuthology.orchestra.run.smithi155.stdout: }, 2023-08-01T19:56:22.016 INFO:teuthology.orchestra.run.smithi155.stdout: { 2023-08-01T19:56:22.016 INFO:teuthology.orchestra.run.smithi155.stdout: "event": "all_read", 2023-08-01T19:56:22.016 INFO:teuthology.orchestra.run.smithi155.stdout: "time": "2023-08-01T19:55:05.569861+0000", 2023-08-01T19:56:22.016 INFO:teuthology.orchestra.run.smithi155.stdout: "duration": 0.000111333 2023-08-01T19:56:22.016 INFO:teuthology.orchestra.run.smithi155.stdout: }, 2023-08-01T19:56:22.016 INFO:teuthology.orchestra.run.smithi155.stdout: { 2023-08-01T19:56:22.017 INFO:teuthology.orchestra.run.smithi155.stdout: "event": "dispatched", 2023-08-01T19:56:22.017 INFO:teuthology.orchestra.run.smithi155.stdout: "time": "2023-08-01T19:55:05.569869+0000", 2023-08-01T19:56:22.017 INFO:teuthology.orchestra.run.smithi155.stdout: "duration": 8.8589999999999994e-06 2023-08-01T19:56:22.017 INFO:teuthology.orchestra.run.smithi155.stdout: }, 2023-08-01T19:56:22.017 INFO:teuthology.orchestra.run.smithi155.stdout: { 2023-08-01T19:56:22.017 INFO:teuthology.orchestra.run.smithi155.stdout: "event": "queued_for_pg", 2023-08-01T19:56:22.017 INFO:teuthology.orchestra.run.smithi155.stdout: "time": "2023-08-01T19:55:05.569874+0000", 2023-08-01T19:56:22.017 INFO:teuthology.orchestra.run.smithi155.stdout: "duration": 4.1679999999999997e-06 2023-08-01T19:56:22.018 INFO:teuthology.orchestra.run.smithi155.stdout: }, 2023-08-01T19:56:22.018 INFO:teuthology.orchestra.run.smithi155.stdout: { 2023-08-01T19:56:22.018 INFO:teuthology.orchestra.run.smithi155.stdout: "event": "reached_pg", 2023-08-01T19:56:22.018 INFO:teuthology.orchestra.run.smithi155.stdout: "time": "2023-08-01T19:55:05.569904+0000", 2023-08-01T19:56:22.018 INFO:teuthology.orchestra.run.smithi155.stdout: "duration": 3.0920999999999998e-05 2023-08-01T19:56:22.018 INFO:teuthology.orchestra.run.smithi155.stdout: }, 2023-08-01T19:56:22.018 INFO:teuthology.orchestra.run.smithi155.stdout: { 2023-08-01T19:56:22.018 INFO:teuthology.orchestra.run.smithi155.stdout: "event": "started", 2023-08-01T19:56:22.019 INFO:teuthology.orchestra.run.smithi155.stdout: "time": "2023-08-01T19:55:05.569998+0000", 2023-08-01T19:56:22.019 INFO:teuthology.orchestra.run.smithi155.stdout: "duration": 9.3086999999999998e-05 2023-08-01T19:56:22.019 INFO:teuthology.orchestra.run.smithi155.stdout: }, 2023-08-01T19:56:22.019 INFO:teuthology.orchestra.run.smithi155.stdout: { 2023-08-01T19:56:22.019 INFO:teuthology.orchestra.run.smithi155.stdout: "event": "waiting for subops from 0", 2023-08-01T19:56:22.019 INFO:teuthology.orchestra.run.smithi155.stdout: "time": "2023-08-01T19:55:05.570093+0000", 2023-08-01T19:56:22.019 INFO:teuthology.orchestra.run.smithi155.stdout: "duration": 9.5768999999999997e-05 2023-08-01T19:56:22.019 INFO:teuthology.orchestra.run.smithi155.stdout: }, 2023-08-01T19:56:22.020 INFO:teuthology.orchestra.run.smithi155.stdout: { 2023-08-01T19:56:22.020 INFO:teuthology.orchestra.run.smithi155.stdout: "event": "op_commit", 2023-08-01T19:56:22.020 INFO:teuthology.orchestra.run.smithi155.stdout: "time": "2023-08-01T19:55:05.572839+0000", 2023-08-01T19:56:22.020 INFO:teuthology.orchestra.run.smithi155.stdout: "duration": 0.0027460050000000001 2023-08-01T19:56:22.020 INFO:teuthology.orchestra.run.smithi155.stdout: }, 2023-08-01T19:56:22.020 INFO:teuthology.orchestra.run.smithi155.stdout: { 2023-08-01T19:56:22.020 INFO:teuthology.orchestra.run.smithi155.stdout: "event": "sub_op_commit_rec", 2023-08-01T19:56:22.021 INFO:teuthology.orchestra.run.smithi155.stdout: "time": "2023-08-01T19:55:05.635114+0000", 2023-08-01T19:56:22.021 INFO:teuthology.orchestra.run.smithi155.stdout: "duration": 0.062274297999999999 2023-08-01T19:56:22.021 INFO:teuthology.orchestra.run.smithi155.stdout: }, 2023-08-01T19:56:22.021 INFO:teuthology.orchestra.run.smithi155.stdout: { 2023-08-01T19:56:22.021 INFO:teuthology.orchestra.run.smithi155.stdout: "event": "commit_sent", 2023-08-01T19:56:22.021 INFO:teuthology.orchestra.run.smithi155.stdout: "time": "2023-08-01T19:55:05.635143+0000", 2023-08-01T19:56:22.021 INFO:teuthology.orchestra.run.smithi155.stdout: "duration": 2.9430000000000001e-05 2023-08-01T19:56:22.021 INFO:teuthology.orchestra.run.smithi155.stdout: }, 2023-08-01T19:56:22.022 INFO:teuthology.orchestra.run.smithi155.stdout: { 2023-08-01T19:56:22.022 INFO:teuthology.orchestra.run.smithi155.stdout: "event": "done", 2023-08-01T19:56:22.022 INFO:teuthology.orchestra.run.smithi155.stdout: "time": "2023-08-01T19:55:05.635181+0000", 2023-08-01T19:56:22.022 INFO:teuthology.orchestra.run.smithi155.stdout: "duration": 3.8352000000000001e-05 2023-08-01T19:56:22.022 INFO:teuthology.orchestra.run.smithi155.stdout: } 2023-08-01T19:56:22.022 INFO:teuthology.orchestra.run.smithi155.stdout: ] 2023-08-01T19:56:22.022 INFO:teuthology.orchestra.run.smithi155.stdout: } 2023-08-01T19:56:22.022 INFO:teuthology.orchestra.run.smithi155.stdout: }, 2023-08-01T19:56:22.023 INFO:teuthology.orchestra.run.smithi155.stdout: { 2023-08-01T19:56:22.023 INFO:teuthology.orchestra.run.smithi155.stdout: "description": "osd_op(client.4668.0:100945 5.e 5:73df68dd:::benchmark_data_smithi006_114134_object100944:head [set-alloc-hint object_size 65536 write_size 65536,write 0~65536] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e37)", 2023-08-01T19:56:22.023 INFO:teuthology.orchestra.run.smithi155.stdout: "initiated_at": "2023-08-01T19:55:05.576784+0000", 2023-08-01T19:56:22.023 INFO:teuthology.orchestra.run.smithi155.stdout: "age": 76.310154170000004, 2023-08-01T19:56:22.023 INFO:teuthology.orchestra.run.smithi155.stdout: "duration": 0.058512994999999998, 2023-08-01T19:56:22.023 INFO:teuthology.orchestra.run.smithi155.stdout: "type_data": { 2023-08-01T19:56:22.023 INFO:teuthology.orchestra.run.smithi155.stdout: "flag_point": "commit sent; apply or cleanup", 2023-08-01T19:56:22.023 INFO:teuthology.orchestra.run.smithi155.stdout: "client_info": { 2023-08-01T19:56:22.024 INFO:teuthology.orchestra.run.smithi155.stdout: "client": "client.4668", 2023-08-01T19:56:22.024 INFO:teuthology.orchestra.run.smithi155.stdout: "client_addr": "172.21.15.6:0/1709472247", 2023-08-01T19:56:22.024 INFO:teuthology.orchestra.run.smithi155.stdout: "tid": 100945 2023-08-01T19:56:22.024 INFO:teuthology.orchestra.run.smithi155.stdout: }, 2023-08-01T19:56:22.024 INFO:teuthology.orchestra.run.smithi155.stdout: "events": [ 2023-08-01T19:56:22.024 INFO:teuthology.orchestra.run.smithi155.stdout: { 2023-08-01T19:56:22.024 INFO:teuthology.orchestra.run.smithi155.stdout: "event": "initiated", 2023-08-01T19:56:22.025 INFO:teuthology.orchestra.run.smithi155.stdout: "time": "2023-08-01T19:55:05.576784+0000", 2023-08-01T19:56:22.025 INFO:teuthology.orchestra.run.smithi155.stdout: "duration": 0 2023-08-01T19:56:22.025 INFO:teuthology.orchestra.run.smithi155.stdout: }, 2023-08-01T19:56:22.025 INFO:teuthology.orchestra.run.smithi155.stdout: { 2023-08-01T19:56:22.025 INFO:teuthology.orchestra.run.smithi155.stdout: "event": "throttled", 2023-08-01T19:56:22.025 INFO:teuthology.orchestra.run.smithi155.stdout: "time": "2023-08-01T19:55:05.576784+0000", 2023-08-01T19:56:22.025 INFO:teuthology.orchestra.run.smithi155.stdout: "duration": 0 2023-08-01T19:56:22.025 INFO:teuthology.orchestra.run.smithi155.stdout: }, 2023-08-01T19:56:22.026 INFO:teuthology.orchestra.run.smithi155.stdout: { 2023-08-01T19:56:22.026 INFO:teuthology.orchestra.run.smithi155.stdout: "event": "header_read", 2023-08-01T19:56:22.026 INFO:teuthology.orchestra.run.smithi155.stdout: "time": "2023-08-01T19:55:05.576783+0000", 2023-08-01T19:56:22.026 INFO:teuthology.orchestra.run.smithi155.stdout: "duration": 4294967295.9999995 2023-08-01T19:56:22.026 INFO:teuthology.orchestra.run.smithi155.stdout: }, 2023-08-01T19:56:22.026 INFO:teuthology.orchestra.run.smithi155.stdout: { 2023-08-01T19:56:22.026 INFO:teuthology.orchestra.run.smithi155.stdout: "event": "all_read", 2023-08-01T19:56:22.026 INFO:teuthology.orchestra.run.smithi155.stdout: "time": "2023-08-01T19:55:05.576807+0000", 2023-08-01T19:56:22.027 INFO:teuthology.orchestra.run.smithi155.stdout: "duration": 2.3651000000000001e-05 2023-08-01T19:56:22.027 INFO:teuthology.orchestra.run.smithi155.stdout: }, 2023-08-01T19:56:22.027 INFO:teuthology.orchestra.run.smithi155.stdout: { 2023-08-01T19:56:22.027 INFO:teuthology.orchestra.run.smithi155.stdout: "event": "dispatched", 2023-08-01T19:56:22.027 INFO:teuthology.orchestra.run.smithi155.stdout: "time": "2023-08-01T19:55:05.576817+0000", 2023-08-01T19:56:22.027 INFO:teuthology.orchestra.run.smithi155.stdout: "duration": 9.9389999999999992e-06 2023-08-01T19:56:22.027 INFO:teuthology.orchestra.run.smithi155.stdout: }, 2023-08-01T19:56:22.027 INFO:teuthology.orchestra.run.smithi155.stdout: { 2023-08-01T19:56:22.028 INFO:teuthology.orchestra.run.smithi155.stdout: "event": "queued_for_pg", 2023-08-01T19:56:22.028 INFO:teuthology.orchestra.run.smithi155.stdout: "time": "2023-08-01T19:55:05.576820+0000", 2023-08-01T19:56:22.028 INFO:teuthology.orchestra.run.smithi155.stdout: "duration": 3.2619999999999999e-06 2023-08-01T19:56:22.028 INFO:teuthology.orchestra.run.smithi155.stdout: }, 2023-08-01T19:56:22.028 INFO:teuthology.orchestra.run.smithi155.stdout: { 2023-08-01T19:56:22.028 INFO:teuthology.orchestra.run.smithi155.stdout: "event": "reached_pg", 2023-08-01T19:56:22.028 INFO:teuthology.orchestra.run.smithi155.stdout: "time": "2023-08-01T19:55:05.576849+0000", 2023-08-01T19:56:22.028 INFO:teuthology.orchestra.run.smithi155.stdout: "duration": 2.8880000000000001e-05 2023-08-01T19:56:22.029 INFO:teuthology.orchestra.run.smithi155.stdout: }, 2023-08-01T19:56:22.029 INFO:teuthology.orchestra.run.smithi155.stdout: { 2023-08-01T19:56:22.029 INFO:teuthology.orchestra.run.smithi155.stdout: "event": "started", 2023-08-01T19:56:22.029 INFO:teuthology.orchestra.run.smithi155.stdout: "time": "2023-08-01T19:55:05.576940+0000", 2023-08-01T19:56:22.029 INFO:teuthology.orchestra.run.smithi155.stdout: "duration": 9.0570999999999997e-05 2023-08-01T19:56:22.029 INFO:teuthology.orchestra.run.smithi155.stdout: }, 2023-08-01T19:56:22.029 INFO:teuthology.orchestra.run.smithi155.stdout: { 2023-08-01T19:56:22.029 INFO:teuthology.orchestra.run.smithi155.stdout: "event": "waiting for subops from 0", 2023-08-01T19:56:22.030 INFO:teuthology.orchestra.run.smithi155.stdout: "time": "2023-08-01T19:55:05.577027+0000", 2023-08-01T19:56:22.030 INFO:teuthology.orchestra.run.smithi155.stdout: "duration": 8.7237999999999994e-05 2023-08-01T19:56:22.030 INFO:teuthology.orchestra.run.smithi155.stdout: }, 2023-08-01T19:56:22.030 INFO:teuthology.orchestra.run.smithi155.stdout: { 2023-08-01T19:56:22.030 INFO:teuthology.orchestra.run.smithi155.stdout: "event": "op_commit", 2023-08-01T19:56:22.030 INFO:teuthology.orchestra.run.smithi155.stdout: "time": "2023-08-01T19:55:05.579624+0000", 2023-08-01T19:56:22.030 INFO:teuthology.orchestra.run.smithi155.stdout: "duration": 0.0025971200000000001 2023-08-01T19:56:22.030 INFO:teuthology.orchestra.run.smithi155.stdout: }, 2023-08-01T19:56:22.031 INFO:teuthology.orchestra.run.smithi155.stdout: { 2023-08-01T19:56:22.031 INFO:teuthology.orchestra.run.smithi155.stdout: "event": "sub_op_commit_rec", 2023-08-01T19:56:22.031 INFO:teuthology.orchestra.run.smithi155.stdout: "time": "2023-08-01T19:55:05.635218+0000", 2023-08-01T19:56:22.031 INFO:teuthology.orchestra.run.smithi155.stdout: "duration": 0.055594487999999997 2023-08-01T19:56:22.031 INFO:teuthology.orchestra.run.smithi155.stdout: }, 2023-08-01T19:56:22.031 INFO:teuthology.orchestra.run.smithi155.stdout: { 2023-08-01T19:56:22.031 INFO:teuthology.orchestra.run.smithi155.stdout: "event": "commit_sent", 2023-08-01T19:56:22.031 INFO:teuthology.orchestra.run.smithi155.stdout: "time": "2023-08-01T19:55:05.635262+0000", 2023-08-01T19:56:22.032 INFO:teuthology.orchestra.run.smithi155.stdout: "duration": 4.3380999999999997e-05 2023-08-01T19:56:22.032 INFO:teuthology.orchestra.run.smithi155.stdout: }, 2023-08-01T19:56:22.032 INFO:teuthology.orchestra.run.smithi155.stdout: { 2023-08-01T19:56:22.032 INFO:teuthology.orchestra.run.smithi155.stdout: "event": "done", 2023-08-01T19:56:22.032 INFO:teuthology.orchestra.run.smithi155.stdout: "time": "2023-08-01T19:55:05.635297+0000", 2023-08-01T19:56:22.032 INFO:teuthology.orchestra.run.smithi155.stdout: "duration": 3.4842000000000003e-05 2023-08-01T19:56:22.032 INFO:teuthology.orchestra.run.smithi155.stdout: } 2023-08-01T19:56:22.033 INFO:teuthology.orchestra.run.smithi155.stdout: ] 2023-08-01T19:56:22.033 INFO:teuthology.orchestra.run.smithi155.stdout: } 2023-08-01T19:56:22.033 INFO:teuthology.orchestra.run.smithi155.stdout: }, 2023-08-01T19:56:22.033 INFO:teuthology.orchestra.run.smithi155.stdout: { 2023-08-01T19:56:22.033 INFO:teuthology.orchestra.run.smithi155.stdout: "description": "osd_op(client.4668.0:100947 5.4 5:23e8fc27:::benchmark_data_smithi006_114134_object100946:head [set-alloc-hint object_size 65536 write_size 65536,write 0~65536] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e37)", 2023-08-01T19:56:22.033 INFO:teuthology.orchestra.run.smithi155.stdout: "initiated_at": "2023-08-01T19:55:05.576840+0000", 2023-08-01T19:56:22.033 INFO:teuthology.orchestra.run.smithi155.stdout: "age": 76.310098115000002, 2023-08-01T19:56:22.033 INFO:teuthology.orchestra.run.smithi155.stdout: "duration": 0.058423127999999998, 2023-08-01T19:56:22.034 INFO:teuthology.orchestra.run.smithi155.stdout: "type_data": { 2023-08-01T19:56:22.034 INFO:teuthology.orchestra.run.smithi155.stdout: "flag_point": "commit sent; apply or cleanup", 2023-08-01T19:56:22.034 INFO:teuthology.orchestra.run.smithi155.stdout: "client_info": { 2023-08-01T19:56:22.034 INFO:teuthology.orchestra.run.smithi155.stdout: "client": "client.4668", 2023-08-01T19:56:22.034 INFO:teuthology.orchestra.run.smithi155.stdout: "client_addr": "172.21.15.6:0/1709472247", 2023-08-01T19:56:22.034 INFO:teuthology.orchestra.run.smithi155.stdout: "tid": 100947 2023-08-01T19:56:22.034 INFO:teuthology.orchestra.run.smithi155.stdout: }, 2023-08-01T19:56:22.034 INFO:teuthology.orchestra.run.smithi155.stdout: "events": [ 2023-08-01T19:56:22.035 INFO:teuthology.orchestra.run.smithi155.stdout: { 2023-08-01T19:56:22.035 INFO:teuthology.orchestra.run.smithi155.stdout: "event": "initiated", 2023-08-01T19:56:22.035 INFO:teuthology.orchestra.run.smithi155.stdout: "time": "2023-08-01T19:55:05.576840+0000", 2023-08-01T19:56:22.035 INFO:teuthology.orchestra.run.smithi155.stdout: "duration": 0 2023-08-01T19:56:22.035 INFO:teuthology.orchestra.run.smithi155.stdout: }, 2023-08-01T19:56:22.035 INFO:teuthology.orchestra.run.smithi155.stdout: { 2023-08-01T19:56:22.035 INFO:teuthology.orchestra.run.smithi155.stdout: "event": "throttled", 2023-08-01T19:56:22.036 INFO:teuthology.orchestra.run.smithi155.stdout: "time": "2023-08-01T19:55:05.576840+0000", 2023-08-01T19:56:22.036 INFO:teuthology.orchestra.run.smithi155.stdout: "duration": 0 2023-08-01T19:56:22.036 INFO:teuthology.orchestra.run.smithi155.stdout: }, 2023-08-01T19:56:22.036 INFO:teuthology.orchestra.run.smithi155.stdout: { 2023-08-01T19:56:22.036 INFO:teuthology.orchestra.run.smithi155.stdout: "event": "header_read", 2023-08-01T19:56:22.036 INFO:teuthology.orchestra.run.smithi155.stdout: "time": "2023-08-01T19:55:05.576839+0000", 2023-08-01T19:56:22.036 INFO:teuthology.orchestra.run.smithi155.stdout: "duration": 4294967295.9999995 2023-08-01T19:56:22.036 INFO:teuthology.orchestra.run.smithi155.stdout: }, 2023-08-01T19:56:22.037 INFO:teuthology.orchestra.run.smithi155.stdout: { 2023-08-01T19:56:22.037 INFO:teuthology.orchestra.run.smithi155.stdout: "event": "all_read", 2023-08-01T19:56:22.037 INFO:teuthology.orchestra.run.smithi155.stdout: "time": "2023-08-01T19:55:05.576893+0000", 2023-08-01T19:56:22.037 INFO:teuthology.orchestra.run.smithi155.stdout: "duration": 5.3893000000000001e-05 2023-08-01T19:56:22.037 INFO:teuthology.orchestra.run.smithi155.stdout: }, 2023-08-01T19:56:22.037 INFO:teuthology.orchestra.run.smithi155.stdout: { 2023-08-01T19:56:22.037 INFO:teuthology.orchestra.run.smithi155.stdout: "event": "dispatched", 2023-08-01T19:56:22.037 INFO:teuthology.orchestra.run.smithi155.stdout: "time": "2023-08-01T19:55:05.576902+0000", 2023-08-01T19:56:22.038 INFO:teuthology.orchestra.run.smithi155.stdout: "duration": 8.7520000000000002e-06 2023-08-01T19:56:22.038 INFO:teuthology.orchestra.run.smithi155.stdout: }, 2023-08-01T19:56:22.038 INFO:teuthology.orchestra.run.smithi155.stdout: { 2023-08-01T19:56:22.038 INFO:teuthology.orchestra.run.smithi155.stdout: "event": "queued_for_pg", 2023-08-01T19:56:22.038 INFO:teuthology.orchestra.run.smithi155.stdout: "time": "2023-08-01T19:55:05.576905+0000", 2023-08-01T19:56:22.038 INFO:teuthology.orchestra.run.smithi155.stdout: "duration": 3.01e-06 2023-08-01T19:56:22.038 INFO:teuthology.orchestra.run.smithi155.stdout: }, 2023-08-01T19:56:22.038 INFO:teuthology.orchestra.run.smithi155.stdout: { 2023-08-01T19:56:22.039 INFO:teuthology.orchestra.run.smithi155.stdout: "event": "reached_pg", 2023-08-01T19:56:22.039 INFO:teuthology.orchestra.run.smithi155.stdout: "time": "2023-08-01T19:55:05.579641+0000", 2023-08-01T19:56:22.039 INFO:teuthology.orchestra.run.smithi155.stdout: "duration": 0.0027366880000000001 2023-08-01T19:56:22.039 INFO:teuthology.orchestra.run.smithi155.stdout: }, 2023-08-01T19:56:22.039 INFO:teuthology.orchestra.run.smithi155.stdout: { 2023-08-01T19:56:22.039 INFO:teuthology.orchestra.run.smithi155.stdout: "event": "started", 2023-08-01T19:56:22.039 INFO:teuthology.orchestra.run.smithi155.stdout: "time": "2023-08-01T19:55:05.579734+0000", 2023-08-01T19:56:22.040 INFO:teuthology.orchestra.run.smithi155.stdout: "duration": 9.2590000000000006e-05 2023-08-01T19:56:22.040 INFO:teuthology.orchestra.run.smithi155.stdout: }, 2023-08-01T19:56:22.040 INFO:teuthology.orchestra.run.smithi155.stdout: { 2023-08-01T19:56:22.040 INFO:teuthology.orchestra.run.smithi155.stdout: "event": "waiting for subops from 0", 2023-08-01T19:56:22.040 INFO:teuthology.orchestra.run.smithi155.stdout: "time": "2023-08-01T19:55:05.579825+0000", 2023-08-01T19:56:22.040 INFO:teuthology.orchestra.run.smithi155.stdout: "duration": 9.0964999999999994e-05 2023-08-01T19:56:22.040 INFO:teuthology.orchestra.run.smithi155.stdout: }, 2023-08-01T19:56:22.040 INFO:teuthology.orchestra.run.smithi155.stdout: { 2023-08-01T19:56:22.041 INFO:teuthology.orchestra.run.smithi155.stdout: "event": "op_commit", 2023-08-01T19:56:22.041 INFO:teuthology.orchestra.run.smithi155.stdout: "time": "2023-08-01T19:55:05.585041+0000", 2023-08-01T19:56:22.041 INFO:teuthology.orchestra.run.smithi155.stdout: "duration": 0.0052159670000000002 2023-08-01T19:56:22.041 INFO:teuthology.orchestra.run.smithi155.stdout: }, 2023-08-01T19:56:22.041 INFO:teuthology.orchestra.run.smithi155.stdout: { 2023-08-01T19:56:22.041 INFO:teuthology.orchestra.run.smithi155.stdout: "event": "sub_op_commit_rec", 2023-08-01T19:56:22.041 INFO:teuthology.orchestra.run.smithi155.stdout: "time": "2023-08-01T19:55:05.635199+0000", 2023-08-01T19:56:22.041 INFO:teuthology.orchestra.run.smithi155.stdout: "duration": 0.050158023000000003 2023-08-01T19:56:22.042 INFO:teuthology.orchestra.run.smithi155.stdout: }, 2023-08-01T19:56:22.042 INFO:teuthology.orchestra.run.smithi155.stdout: { 2023-08-01T19:56:22.042 INFO:teuthology.orchestra.run.smithi155.stdout: "event": "commit_sent", 2023-08-01T19:56:22.042 INFO:teuthology.orchestra.run.smithi155.stdout: "time": "2023-08-01T19:55:05.635227+0000", 2023-08-01T19:56:22.042 INFO:teuthology.orchestra.run.smithi155.stdout: "duration": 2.7821e-05 2023-08-01T19:56:22.042 INFO:teuthology.orchestra.run.smithi155.stdout: }, 2023-08-01T19:56:22.042 INFO:teuthology.orchestra.run.smithi155.stdout: { 2023-08-01T19:56:22.042 INFO:teuthology.orchestra.run.smithi155.stdout: "event": "done", 2023-08-01T19:56:22.043 INFO:teuthology.orchestra.run.smithi155.stdout: "time": "2023-08-01T19:55:05.635263+0000", 2023-08-01T19:56:22.043 INFO:teuthology.orchestra.run.smithi155.stdout: "duration": 3.6081000000000002e-05 2023-08-01T19:56:22.043 INFO:teuthology.orchestra.run.smithi155.stdout: } 2023-08-01T19:56:22.043 INFO:teuthology.orchestra.run.smithi155.stdout: ] 2023-08-01T19:56:22.043 INFO:teuthology.orchestra.run.smithi155.stdout: } 2023-08-01T19:56:22.043 INFO:teuthology.orchestra.run.smithi155.stdout: }, 2023-08-01T19:56:22.043 INFO:teuthology.orchestra.run.smithi155.stdout: { 2023-08-01T19:56:22.044 INFO:teuthology.orchestra.run.smithi155.stdout: "description": "osd_op(client.4668.0:197408 5.d 5:bbda375a:::benchmark_data_smithi006_114134_object63747:head [delete] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e61)", 2023-08-01T19:56:22.044 INFO:teuthology.orchestra.run.smithi155.stdout: "initiated_at": "2023-08-01T19:55:58.559714+0000", 2023-08-01T19:56:22.044 INFO:teuthology.orchestra.run.smithi155.stdout: "age": 23.327224128000001, 2023-08-01T19:56:22.044 INFO:teuthology.orchestra.run.smithi155.stdout: "duration": 1.047043671, 2023-08-01T19:56:22.044 INFO:teuthology.orchestra.run.smithi155.stdout: "type_data": { 2023-08-01T19:56:22.044 INFO:teuthology.orchestra.run.smithi155.stdout: "flag_point": "commit sent; apply or cleanup", 2023-08-01T19:56:22.044 INFO:teuthology.orchestra.run.smithi155.stdout: "client_info": { 2023-08-01T19:56:22.044 INFO:teuthology.orchestra.run.smithi155.stdout: "client": "client.4668", 2023-08-01T19:56:22.045 INFO:teuthology.orchestra.run.smithi155.stdout: "client_addr": "172.21.15.6:0/1709472247", 2023-08-01T19:56:22.045 INFO:teuthology.orchestra.run.smithi155.stdout: "tid": 197408 2023-08-01T19:56:22.045 INFO:teuthology.orchestra.run.smithi155.stdout: }, 2023-08-01T19:56:22.045 INFO:teuthology.orchestra.run.smithi155.stdout: "events": [ 2023-08-01T19:56:22.045 INFO:teuthology.orchestra.run.smithi155.stdout: { 2023-08-01T19:56:22.045 INFO:teuthology.orchestra.run.smithi155.stdout: "event": "initiated", 2023-08-01T19:56:22.045 INFO:teuthology.orchestra.run.smithi155.stdout: "time": "2023-08-01T19:55:58.559714+0000", 2023-08-01T19:56:22.045 INFO:teuthology.orchestra.run.smithi155.stdout: "duration": 0 2023-08-01T19:56:22.046 INFO:teuthology.orchestra.run.smithi155.stdout: }, 2023-08-01T19:56:22.046 INFO:teuthology.orchestra.run.smithi155.stdout: { 2023-08-01T19:56:22.046 INFO:teuthology.orchestra.run.smithi155.stdout: "event": "throttled", 2023-08-01T19:56:22.046 INFO:teuthology.orchestra.run.smithi155.stdout: "time": "2023-08-01T19:55:58.559714+0000", 2023-08-01T19:56:22.046 INFO:teuthology.orchestra.run.smithi155.stdout: "duration": 0 2023-08-01T19:56:22.046 INFO:teuthology.orchestra.run.smithi155.stdout: }, 2023-08-01T19:56:22.046 INFO:teuthology.orchestra.run.smithi155.stdout: { 2023-08-01T19:56:22.046 INFO:teuthology.orchestra.run.smithi155.stdout: "event": "header_read", 2023-08-01T19:56:22.047 INFO:teuthology.orchestra.run.smithi155.stdout: "time": "2023-08-01T19:55:58.559713+0000", 2023-08-01T19:56:22.047 INFO:teuthology.orchestra.run.smithi155.stdout: "duration": 4294967295.999999 2023-08-01T19:56:22.047 INFO:teuthology.orchestra.run.smithi155.stdout: }, 2023-08-01T19:56:22.047 INFO:teuthology.orchestra.run.smithi155.stdout: { 2023-08-01T19:56:22.047 INFO:teuthology.orchestra.run.smithi155.stdout: "event": "all_read", 2023-08-01T19:56:22.047 INFO:teuthology.orchestra.run.smithi155.stdout: "time": "2023-08-01T19:55:58.559717+0000", 2023-08-01T19:56:22.047 INFO:teuthology.orchestra.run.smithi155.stdout: "duration": 4.2860000000000001e-06 2023-08-01T19:56:22.047 INFO:teuthology.orchestra.run.smithi155.stdout: }, 2023-08-01T19:56:22.048 INFO:teuthology.orchestra.run.smithi155.stdout: { 2023-08-01T19:56:22.048 INFO:teuthology.orchestra.run.smithi155.stdout: "event": "dispatched", 2023-08-01T19:56:22.048 INFO:teuthology.orchestra.run.smithi155.stdout: "time": "2023-08-01T19:55:58.559774+0000", 2023-08-01T19:56:22.048 INFO:teuthology.orchestra.run.smithi155.stdout: "duration": 5.6508999999999997e-05 2023-08-01T19:56:22.048 INFO:teuthology.orchestra.run.smithi155.stdout: }, 2023-08-01T19:56:22.048 INFO:teuthology.orchestra.run.smithi155.stdout: { 2023-08-01T19:56:22.048 INFO:teuthology.orchestra.run.smithi155.stdout: "event": "queued_for_pg", 2023-08-01T19:56:22.049 INFO:teuthology.orchestra.run.smithi155.stdout: "time": "2023-08-01T19:55:58.559781+0000", 2023-08-01T19:56:22.049 INFO:teuthology.orchestra.run.smithi155.stdout: "duration": 7.1829999999999997e-06 2023-08-01T19:56:22.049 INFO:teuthology.orchestra.run.smithi155.stdout: }, 2023-08-01T19:56:22.049 INFO:teuthology.orchestra.run.smithi155.stdout: { 2023-08-01T19:56:22.049 INFO:teuthology.orchestra.run.smithi155.stdout: "event": "reached_pg", 2023-08-01T19:56:22.049 INFO:teuthology.orchestra.run.smithi155.stdout: "time": "2023-08-01T19:55:58.571621+0000", 2023-08-01T19:56:22.049 INFO:teuthology.orchestra.run.smithi155.stdout: "duration": 0.011840603999999999 2023-08-01T19:56:22.049 INFO:teuthology.orchestra.run.smithi155.stdout: }, 2023-08-01T19:56:22.050 INFO:teuthology.orchestra.run.smithi155.stdout: { 2023-08-01T19:56:22.050 INFO:teuthology.orchestra.run.smithi155.stdout: "event": "waiting for peered", 2023-08-01T19:56:22.050 INFO:teuthology.orchestra.run.smithi155.stdout: "time": "2023-08-01T19:55:58.571630+0000", 2023-08-01T19:56:22.050 INFO:teuthology.orchestra.run.smithi155.stdout: "duration": 8.9770000000000006e-06 2023-08-01T19:56:22.050 INFO:teuthology.orchestra.run.smithi155.stdout: }, 2023-08-01T19:56:22.050 INFO:teuthology.orchestra.run.smithi155.stdout: { 2023-08-01T19:56:22.050 INFO:teuthology.orchestra.run.smithi155.stdout: "event": "reached_pg", 2023-08-01T19:56:22.050 INFO:teuthology.orchestra.run.smithi155.stdout: "time": "2023-08-01T19:55:59.601300+0000", 2023-08-01T19:56:22.051 INFO:teuthology.orchestra.run.smithi155.stdout: "duration": 1.0296694989999999 2023-08-01T19:56:22.051 INFO:teuthology.orchestra.run.smithi155.stdout: }, 2023-08-01T19:56:22.051 INFO:teuthology.orchestra.run.smithi155.stdout: { 2023-08-01T19:56:22.051 INFO:teuthology.orchestra.run.smithi155.stdout: "event": "started", 2023-08-01T19:56:22.051 INFO:teuthology.orchestra.run.smithi155.stdout: "time": "2023-08-01T19:55:59.601448+0000", 2023-08-01T19:56:22.051 INFO:teuthology.orchestra.run.smithi155.stdout: "duration": 0.00014828399999999999 2023-08-01T19:56:22.051 INFO:teuthology.orchestra.run.smithi155.stdout: }, 2023-08-01T19:56:22.051 INFO:teuthology.orchestra.run.smithi155.stdout: { 2023-08-01T19:56:22.052 INFO:teuthology.orchestra.run.smithi155.stdout: "event": "op_commit", 2023-08-01T19:56:22.052 INFO:teuthology.orchestra.run.smithi155.stdout: "time": "2023-08-01T19:55:59.606616+0000", 2023-08-01T19:56:22.052 INFO:teuthology.orchestra.run.smithi155.stdout: "duration": 0.0051679769999999998 2023-08-01T19:56:22.052 INFO:teuthology.orchestra.run.smithi155.stdout: }, 2023-08-01T19:56:22.052 INFO:teuthology.orchestra.run.smithi155.stdout: { 2023-08-01T19:56:22.052 INFO:teuthology.orchestra.run.smithi155.stdout: "event": "commit_sent", 2023-08-01T19:56:22.052 INFO:teuthology.orchestra.run.smithi155.stdout: "time": "2023-08-01T19:55:59.606662+0000", 2023-08-01T19:56:22.052 INFO:teuthology.orchestra.run.smithi155.stdout: "duration": 4.5843000000000001e-05 2023-08-01T19:56:22.053 INFO:teuthology.orchestra.run.smithi155.stdout: }, 2023-08-01T19:56:22.053 INFO:teuthology.orchestra.run.smithi155.stdout: { 2023-08-01T19:56:22.053 INFO:teuthology.orchestra.run.smithi155.stdout: "event": "done", 2023-08-01T19:56:22.053 INFO:teuthology.orchestra.run.smithi155.stdout: "time": "2023-08-01T19:55:59.606757+0000", 2023-08-01T19:56:22.053 INFO:teuthology.orchestra.run.smithi155.stdout: "duration": 9.5373999999999999e-05 2023-08-01T19:56:22.053 INFO:teuthology.orchestra.run.smithi155.stdout: } 2023-08-01T19:56:22.053 INFO:teuthology.orchestra.run.smithi155.stdout: ] 2023-08-01T19:56:22.054 INFO:teuthology.orchestra.run.smithi155.stdout: } 2023-08-01T19:56:22.054 INFO:teuthology.orchestra.run.smithi155.stdout: }, 2023-08-01T19:56:22.054 INFO:teuthology.orchestra.run.smithi155.stdout: { 2023-08-01T19:56:22.054 INFO:teuthology.orchestra.run.smithi155.stdout: "description": "osd_op(client.4668.0:197416 5.d 5:bd99e66d:::benchmark_data_smithi006_114134_object63755:head [delete] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e62)", 2023-08-01T19:56:22.054 INFO:teuthology.orchestra.run.smithi155.stdout: "initiated_at": "2023-08-01T19:55:58.577369+0000", 2023-08-01T19:56:22.054 INFO:teuthology.orchestra.run.smithi155.stdout: "age": 23.309569151000002, 2023-08-01T19:56:22.054 INFO:teuthology.orchestra.run.smithi155.stdout: "duration": 1.0300980120000001, 2023-08-01T19:56:22.054 INFO:teuthology.orchestra.run.smithi155.stdout: "type_data": { 2023-08-01T19:56:22.055 INFO:teuthology.orchestra.run.smithi155.stdout: "flag_point": "commit sent; apply or cleanup", 2023-08-01T19:56:22.055 INFO:teuthology.orchestra.run.smithi155.stdout: "client_info": { 2023-08-01T19:56:22.055 INFO:teuthology.orchestra.run.smithi155.stdout: "client": "client.4668", 2023-08-01T19:56:22.055 INFO:teuthology.orchestra.run.smithi155.stdout: "client_addr": "172.21.15.6:0/1709472247", 2023-08-01T19:56:22.055 INFO:teuthology.orchestra.run.smithi155.stdout: "tid": 197416 2023-08-01T19:56:22.055 INFO:teuthology.orchestra.run.smithi155.stdout: }, 2023-08-01T19:56:22.055 INFO:teuthology.orchestra.run.smithi155.stdout: "events": [ 2023-08-01T19:56:22.055 INFO:teuthology.orchestra.run.smithi155.stdout: { 2023-08-01T19:56:22.056 INFO:teuthology.orchestra.run.smithi155.stdout: "event": "initiated", 2023-08-01T19:56:22.056 INFO:teuthology.orchestra.run.smithi155.stdout: "time": "2023-08-01T19:55:58.577369+0000", 2023-08-01T19:56:22.056 INFO:teuthology.orchestra.run.smithi155.stdout: "duration": 0 2023-08-01T19:56:22.056 INFO:teuthology.orchestra.run.smithi155.stdout: }, 2023-08-01T19:56:22.056 INFO:teuthology.orchestra.run.smithi155.stdout: { 2023-08-01T19:56:22.056 INFO:teuthology.orchestra.run.smithi155.stdout: "event": "throttled", 2023-08-01T19:56:22.056 INFO:teuthology.orchestra.run.smithi155.stdout: "time": "2023-08-01T19:55:58.577369+0000", 2023-08-01T19:56:22.057 INFO:teuthology.orchestra.run.smithi155.stdout: "duration": 0 2023-08-01T19:56:22.057 INFO:teuthology.orchestra.run.smithi155.stdout: }, 2023-08-01T19:56:22.057 INFO:teuthology.orchestra.run.smithi155.stdout: { 2023-08-01T19:56:22.057 INFO:teuthology.orchestra.run.smithi155.stdout: "event": "header_read", 2023-08-01T19:56:22.057 INFO:teuthology.orchestra.run.smithi155.stdout: "time": "2023-08-01T19:55:58.577368+0000", 2023-08-01T19:56:22.057 INFO:teuthology.orchestra.run.smithi155.stdout: "duration": 4294967295.9999995 2023-08-01T19:56:22.057 INFO:teuthology.orchestra.run.smithi155.stdout: }, 2023-08-01T19:56:22.058 INFO:teuthology.orchestra.run.smithi155.stdout: { 2023-08-01T19:56:22.058 INFO:teuthology.orchestra.run.smithi155.stdout: "event": "all_read", 2023-08-01T19:56:22.058 INFO:teuthology.orchestra.run.smithi155.stdout: "time": "2023-08-01T19:55:58.577370+0000", 2023-08-01T19:56:22.058 INFO:teuthology.orchestra.run.smithi155.stdout: "duration": 2.1150000000000001e-06 2023-08-01T19:56:22.058 INFO:teuthology.orchestra.run.smithi155.stdout: }, 2023-08-01T19:56:22.058 INFO:teuthology.orchestra.run.smithi155.stdout: { 2023-08-01T19:56:22.058 INFO:teuthology.orchestra.run.smithi155.stdout: "event": "dispatched", 2023-08-01T19:56:22.058 INFO:teuthology.orchestra.run.smithi155.stdout: "time": "2023-08-01T19:55:58.577377+0000", 2023-08-01T19:56:22.059 INFO:teuthology.orchestra.run.smithi155.stdout: "duration": 6.6610000000000003e-06 2023-08-01T19:56:22.059 INFO:teuthology.orchestra.run.smithi155.stdout: }, 2023-08-01T19:56:22.059 INFO:teuthology.orchestra.run.smithi155.stdout: { 2023-08-01T19:56:22.059 INFO:teuthology.orchestra.run.smithi155.stdout: "event": "queued_for_pg", 2023-08-01T19:56:22.059 INFO:teuthology.orchestra.run.smithi155.stdout: "time": "2023-08-01T19:55:58.577380+0000", 2023-08-01T19:56:22.059 INFO:teuthology.orchestra.run.smithi155.stdout: "duration": 2.7360000000000001e-06 2023-08-01T19:56:22.059 INFO:teuthology.orchestra.run.smithi155.stdout: }, 2023-08-01T19:56:22.059 INFO:teuthology.orchestra.run.smithi155.stdout: { 2023-08-01T19:56:22.060 INFO:teuthology.orchestra.run.smithi155.stdout: "event": "reached_pg", 2023-08-01T19:56:22.060 INFO:teuthology.orchestra.run.smithi155.stdout: "time": "2023-08-01T19:55:58.577405+0000", 2023-08-01T19:56:22.060 INFO:teuthology.orchestra.run.smithi155.stdout: "duration": 2.4929000000000001e-05 2023-08-01T19:56:22.060 INFO:teuthology.orchestra.run.smithi155.stdout: }, 2023-08-01T19:56:22.060 INFO:teuthology.orchestra.run.smithi155.stdout: { 2023-08-01T19:56:22.060 INFO:teuthology.orchestra.run.smithi155.stdout: "event": "waiting for peered", 2023-08-01T19:56:22.060 INFO:teuthology.orchestra.run.smithi155.stdout: "time": "2023-08-01T19:55:58.577409+0000", 2023-08-01T19:56:22.060 INFO:teuthology.orchestra.run.smithi155.stdout: "duration": 4.0799999999999999e-06 2023-08-01T19:56:22.061 INFO:teuthology.orchestra.run.smithi155.stdout: }, 2023-08-01T19:56:22.061 INFO:teuthology.orchestra.run.smithi155.stdout: { 2023-08-01T19:56:22.061 INFO:teuthology.orchestra.run.smithi155.stdout: "event": "reached_pg", 2023-08-01T19:56:22.061 INFO:teuthology.orchestra.run.smithi155.stdout: "time": "2023-08-01T19:55:59.603639+0000", 2023-08-01T19:56:22.061 INFO:teuthology.orchestra.run.smithi155.stdout: "duration": 1.0262299349999999 2023-08-01T19:56:22.061 INFO:teuthology.orchestra.run.smithi155.stdout: }, 2023-08-01T19:56:22.061 INFO:teuthology.orchestra.run.smithi155.stdout: { 2023-08-01T19:56:22.061 INFO:teuthology.orchestra.run.smithi155.stdout: "event": "started", 2023-08-01T19:56:22.062 INFO:teuthology.orchestra.run.smithi155.stdout: "time": "2023-08-01T19:55:59.603772+0000", 2023-08-01T19:56:22.062 INFO:teuthology.orchestra.run.smithi155.stdout: "duration": 0.000133153 2023-08-01T19:56:22.062 INFO:teuthology.orchestra.run.smithi155.stdout: }, 2023-08-01T19:56:22.062 INFO:teuthology.orchestra.run.smithi155.stdout: { 2023-08-01T19:56:22.062 INFO:teuthology.orchestra.run.smithi155.stdout: "event": "op_commit", 2023-08-01T19:56:22.062 INFO:teuthology.orchestra.run.smithi155.stdout: "time": "2023-08-01T19:55:59.607354+0000", 2023-08-01T19:56:22.062 INFO:teuthology.orchestra.run.smithi155.stdout: "duration": 0.0035819599999999999 2023-08-01T19:56:22.062 INFO:teuthology.orchestra.run.smithi155.stdout: }, 2023-08-01T19:56:22.063 INFO:teuthology.orchestra.run.smithi155.stdout: { 2023-08-01T19:56:22.063 INFO:teuthology.orchestra.run.smithi155.stdout: "event": "commit_sent", 2023-08-01T19:56:22.063 INFO:teuthology.orchestra.run.smithi155.stdout: "time": "2023-08-01T19:55:59.607396+0000", 2023-08-01T19:56:22.063 INFO:teuthology.orchestra.run.smithi155.stdout: "duration": 4.2423999999999999e-05 2023-08-01T19:56:22.063 INFO:teuthology.orchestra.run.smithi155.stdout: }, 2023-08-01T19:56:22.063 INFO:teuthology.orchestra.run.smithi155.stdout: { 2023-08-01T19:56:22.063 INFO:teuthology.orchestra.run.smithi155.stdout: "event": "done", 2023-08-01T19:56:22.063 INFO:teuthology.orchestra.run.smithi155.stdout: "time": "2023-08-01T19:55:59.607467+0000", 2023-08-01T19:56:22.064 INFO:teuthology.orchestra.run.smithi155.stdout: "duration": 7.0360999999999999e-05 2023-08-01T19:56:22.064 INFO:teuthology.orchestra.run.smithi155.stdout: } 2023-08-01T19:56:22.064 INFO:teuthology.orchestra.run.smithi155.stdout: ] 2023-08-01T19:56:22.064 INFO:teuthology.orchestra.run.smithi155.stdout: } 2023-08-01T19:56:22.064 INFO:teuthology.orchestra.run.smithi155.stdout: }, 2023-08-01T19:56:22.064 INFO:teuthology.orchestra.run.smithi155.stdout: { 2023-08-01T19:56:22.064 INFO:teuthology.orchestra.run.smithi155.stdout: "description": "osd_op(client.4668.0:197419 5.d 5:be7dc7c9:::benchmark_data_smithi006_114134_object63758:head [delete] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e62)", 2023-08-01T19:56:22.065 INFO:teuthology.orchestra.run.smithi155.stdout: "initiated_at": "2023-08-01T19:55:58.580223+0000", 2023-08-01T19:56:22.065 INFO:teuthology.orchestra.run.smithi155.stdout: "age": 23.306715199999999, 2023-08-01T19:56:22.065 INFO:teuthology.orchestra.run.smithi155.stdout: "duration": 1.0286139439999999, 2023-08-01T19:56:22.065 INFO:teuthology.orchestra.run.smithi155.stdout: "type_data": { 2023-08-01T19:56:22.065 INFO:teuthology.orchestra.run.smithi155.stdout: "flag_point": "commit sent; apply or cleanup", 2023-08-01T19:56:22.065 INFO:teuthology.orchestra.run.smithi155.stdout: "client_info": { 2023-08-01T19:56:22.065 INFO:teuthology.orchestra.run.smithi155.stdout: "client": "client.4668", 2023-08-01T19:56:22.065 INFO:teuthology.orchestra.run.smithi155.stdout: "client_addr": "172.21.15.6:0/1709472247", 2023-08-01T19:56:22.066 INFO:teuthology.orchestra.run.smithi155.stdout: "tid": 197419 2023-08-01T19:56:22.066 INFO:teuthology.orchestra.run.smithi155.stdout: }, 2023-08-01T19:56:22.066 INFO:teuthology.orchestra.run.smithi155.stdout: "events": [ 2023-08-01T19:56:22.066 INFO:teuthology.orchestra.run.smithi155.stdout: { 2023-08-01T19:56:22.066 INFO:teuthology.orchestra.run.smithi155.stdout: "event": "initiated", 2023-08-01T19:56:22.066 INFO:teuthology.orchestra.run.smithi155.stdout: "time": "2023-08-01T19:55:58.580223+0000", 2023-08-01T19:56:22.066 INFO:teuthology.orchestra.run.smithi155.stdout: "duration": 0 2023-08-01T19:56:22.066 INFO:teuthology.orchestra.run.smithi155.stdout: }, 2023-08-01T19:56:22.067 INFO:teuthology.orchestra.run.smithi155.stdout: { 2023-08-01T19:56:22.067 INFO:teuthology.orchestra.run.smithi155.stdout: "event": "throttled", 2023-08-01T19:56:22.067 INFO:teuthology.orchestra.run.smithi155.stdout: "time": "2023-08-01T19:55:58.580223+0000", 2023-08-01T19:56:22.067 INFO:teuthology.orchestra.run.smithi155.stdout: "duration": 0 2023-08-01T19:56:22.067 INFO:teuthology.orchestra.run.smithi155.stdout: }, 2023-08-01T19:56:22.067 INFO:teuthology.orchestra.run.smithi155.stdout: { 2023-08-01T19:56:22.067 INFO:teuthology.orchestra.run.smithi155.stdout: "event": "header_read", 2023-08-01T19:56:22.067 INFO:teuthology.orchestra.run.smithi155.stdout: "time": "2023-08-01T19:55:58.580222+0000", 2023-08-01T19:56:22.068 INFO:teuthology.orchestra.run.smithi155.stdout: "duration": 4294967295.9999995 2023-08-01T19:56:22.068 INFO:teuthology.orchestra.run.smithi155.stdout: }, 2023-08-01T19:56:22.068 INFO:teuthology.orchestra.run.smithi155.stdout: { 2023-08-01T19:56:22.068 INFO:teuthology.orchestra.run.smithi155.stdout: "event": "all_read", 2023-08-01T19:56:22.068 INFO:teuthology.orchestra.run.smithi155.stdout: "time": "2023-08-01T19:55:58.580225+0000", 2023-08-01T19:56:22.068 INFO:teuthology.orchestra.run.smithi155.stdout: "duration": 3.2820000000000001e-06 2023-08-01T19:56:22.068 INFO:teuthology.orchestra.run.smithi155.stdout: }, 2023-08-01T19:56:22.068 INFO:teuthology.orchestra.run.smithi155.stdout: { 2023-08-01T19:56:22.069 INFO:teuthology.orchestra.run.smithi155.stdout: "event": "dispatched", 2023-08-01T19:56:22.069 INFO:teuthology.orchestra.run.smithi155.stdout: "time": "2023-08-01T19:55:58.580233+0000", 2023-08-01T19:56:22.069 INFO:teuthology.orchestra.run.smithi155.stdout: "duration": 7.34e-06 2023-08-01T19:56:22.069 INFO:teuthology.orchestra.run.smithi155.stdout: }, 2023-08-01T19:56:22.069 INFO:teuthology.orchestra.run.smithi155.stdout: { 2023-08-01T19:56:22.069 INFO:teuthology.orchestra.run.smithi155.stdout: "event": "queued_for_pg", 2023-08-01T19:56:22.069 INFO:teuthology.orchestra.run.smithi155.stdout: "time": "2023-08-01T19:55:58.580236+0000", 2023-08-01T19:56:22.069 INFO:teuthology.orchestra.run.smithi155.stdout: "duration": 3.473e-06 2023-08-01T19:56:22.070 INFO:teuthology.orchestra.run.smithi155.stdout: }, 2023-08-01T19:56:22.070 INFO:teuthology.orchestra.run.smithi155.stdout: { 2023-08-01T19:56:22.070 INFO:teuthology.orchestra.run.smithi155.stdout: "event": "reached_pg", 2023-08-01T19:56:22.070 INFO:teuthology.orchestra.run.smithi155.stdout: "time": "2023-08-01T19:55:58.580267+0000", 2023-08-01T19:56:22.070 INFO:teuthology.orchestra.run.smithi155.stdout: "duration": 3.0479000000000001e-05 2023-08-01T19:56:22.070 INFO:teuthology.orchestra.run.smithi155.stdout: }, 2023-08-01T19:56:22.070 INFO:teuthology.orchestra.run.smithi155.stdout: { 2023-08-01T19:56:22.070 INFO:teuthology.orchestra.run.smithi155.stdout: "event": "waiting for peered", 2023-08-01T19:56:22.071 INFO:teuthology.orchestra.run.smithi155.stdout: "time": "2023-08-01T19:55:58.580272+0000", 2023-08-01T19:56:22.071 INFO:teuthology.orchestra.run.smithi155.stdout: "duration": 5.011e-06 2023-08-01T19:56:22.071 INFO:teuthology.orchestra.run.smithi155.stdout: }, 2023-08-01T19:56:22.071 INFO:teuthology.orchestra.run.smithi155.stdout: { 2023-08-01T19:56:22.071 INFO:teuthology.orchestra.run.smithi155.stdout: "event": "reached_pg", 2023-08-01T19:56:22.071 INFO:teuthology.orchestra.run.smithi155.stdout: "time": "2023-08-01T19:55:59.604970+0000", 2023-08-01T19:56:22.071 INFO:teuthology.orchestra.run.smithi155.stdout: "duration": 1.0246984189999999 2023-08-01T19:56:22.072 INFO:teuthology.orchestra.run.smithi155.stdout: }, 2023-08-01T19:56:22.072 INFO:teuthology.orchestra.run.smithi155.stdout: { 2023-08-01T19:56:22.072 INFO:teuthology.orchestra.run.smithi155.stdout: "event": "started", 2023-08-01T19:56:22.072 INFO:teuthology.orchestra.run.smithi155.stdout: "time": "2023-08-01T19:55:59.605085+0000", 2023-08-01T19:56:22.072 INFO:teuthology.orchestra.run.smithi155.stdout: "duration": 0.00011531000000000001 2023-08-01T19:56:22.072 INFO:teuthology.orchestra.run.smithi155.stdout: }, 2023-08-01T19:56:22.072 INFO:teuthology.orchestra.run.smithi155.stdout: { 2023-08-01T19:56:22.072 INFO:teuthology.orchestra.run.smithi155.stdout: "event": "op_commit", 2023-08-01T19:56:22.073 INFO:teuthology.orchestra.run.smithi155.stdout: "time": "2023-08-01T19:55:59.608733+0000", 2023-08-01T19:56:22.073 INFO:teuthology.orchestra.run.smithi155.stdout: "duration": 0.0036478090000000001 2023-08-01T19:56:22.073 INFO:teuthology.orchestra.run.smithi155.stdout: }, 2023-08-01T19:56:22.073 INFO:teuthology.orchestra.run.smithi155.stdout: { 2023-08-01T19:56:22.073 INFO:teuthology.orchestra.run.smithi155.stdout: "event": "commit_sent", 2023-08-01T19:56:22.073 INFO:teuthology.orchestra.run.smithi155.stdout: "time": "2023-08-01T19:55:59.608771+0000", 2023-08-01T19:56:22.073 INFO:teuthology.orchestra.run.smithi155.stdout: "duration": 3.8033e-05 2023-08-01T19:56:22.073 INFO:teuthology.orchestra.run.smithi155.stdout: }, 2023-08-01T19:56:22.074 INFO:teuthology.orchestra.run.smithi155.stdout: { 2023-08-01T19:56:22.074 INFO:teuthology.orchestra.run.smithi155.stdout: "event": "done", 2023-08-01T19:56:22.074 INFO:teuthology.orchestra.run.smithi155.stdout: "time": "2023-08-01T19:55:59.608837+0000", 2023-08-01T19:56:22.074 INFO:teuthology.orchestra.run.smithi155.stdout: "duration": 6.5364000000000006e-05 2023-08-01T19:56:22.074 INFO:teuthology.orchestra.run.smithi155.stdout: } 2023-08-01T19:56:22.074 INFO:teuthology.orchestra.run.smithi155.stdout: ] 2023-08-01T19:56:22.074 INFO:teuthology.orchestra.run.smithi155.stdout: } 2023-08-01T19:56:22.074 INFO:teuthology.orchestra.run.smithi155.stdout: }, 2023-08-01T19:56:22.075 INFO:teuthology.orchestra.run.smithi155.stdout: { 2023-08-01T19:56:22.075 INFO:teuthology.orchestra.run.smithi155.stdout: "description": "osd_op(client.4668.0:197420 5.9 5:92a2efe5:::benchmark_data_smithi006_114134_object63759:head [delete] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e62)", 2023-08-01T19:56:22.075 INFO:teuthology.orchestra.run.smithi155.stdout: "initiated_at": "2023-08-01T19:55:58.582230+0000", 2023-08-01T19:56:22.075 INFO:teuthology.orchestra.run.smithi155.stdout: "age": 23.30470789, 2023-08-01T19:56:22.075 INFO:teuthology.orchestra.run.smithi155.stdout: "duration": 1.0095353739999999, 2023-08-01T19:56:22.075 INFO:teuthology.orchestra.run.smithi155.stdout: "type_data": { 2023-08-01T19:56:22.075 INFO:teuthology.orchestra.run.smithi155.stdout: "flag_point": "commit sent; apply or cleanup", 2023-08-01T19:56:22.075 INFO:teuthology.orchestra.run.smithi155.stdout: "client_info": { 2023-08-01T19:56:22.076 INFO:teuthology.orchestra.run.smithi155.stdout: "client": "client.4668", 2023-08-01T19:56:22.076 INFO:teuthology.orchestra.run.smithi155.stdout: "client_addr": "172.21.15.6:0/1709472247", 2023-08-01T19:56:22.076 INFO:teuthology.orchestra.run.smithi155.stdout: "tid": 197420 2023-08-01T19:56:22.076 INFO:teuthology.orchestra.run.smithi155.stdout: }, 2023-08-01T19:56:22.076 INFO:teuthology.orchestra.run.smithi155.stdout: "events": [ 2023-08-01T19:56:22.076 INFO:teuthology.orchestra.run.smithi155.stdout: { 2023-08-01T19:56:22.076 INFO:teuthology.orchestra.run.smithi155.stdout: "event": "initiated", 2023-08-01T19:56:22.076 INFO:teuthology.orchestra.run.smithi155.stdout: "time": "2023-08-01T19:55:58.582230+0000", 2023-08-01T19:56:22.077 INFO:teuthology.orchestra.run.smithi155.stdout: "duration": 0 2023-08-01T19:56:22.077 INFO:teuthology.orchestra.run.smithi155.stdout: }, 2023-08-01T19:56:22.077 INFO:teuthology.orchestra.run.smithi155.stdout: { 2023-08-01T19:56:22.077 INFO:teuthology.orchestra.run.smithi155.stdout: "event": "throttled", 2023-08-01T19:56:22.077 INFO:teuthology.orchestra.run.smithi155.stdout: "time": "2023-08-01T19:55:58.582230+0000", 2023-08-01T19:56:22.077 INFO:teuthology.orchestra.run.smithi155.stdout: "duration": 0 2023-08-01T19:56:22.077 INFO:teuthology.orchestra.run.smithi155.stdout: }, 2023-08-01T19:56:22.077 INFO:teuthology.orchestra.run.smithi155.stdout: { 2023-08-01T19:56:22.078 INFO:teuthology.orchestra.run.smithi155.stdout: "event": "header_read", 2023-08-01T19:56:22.078 INFO:teuthology.orchestra.run.smithi155.stdout: "time": "2023-08-01T19:55:58.582229+0000", 2023-08-01T19:56:22.078 INFO:teuthology.orchestra.run.smithi155.stdout: "duration": 4294967295.9999995 2023-08-01T19:56:22.078 INFO:teuthology.orchestra.run.smithi155.stdout: }, 2023-08-01T19:56:22.078 INFO:teuthology.orchestra.run.smithi155.stdout: { 2023-08-01T19:56:22.078 INFO:teuthology.orchestra.run.smithi155.stdout: "event": "all_read", 2023-08-01T19:56:22.078 INFO:teuthology.orchestra.run.smithi155.stdout: "time": "2023-08-01T19:55:58.582233+0000", 2023-08-01T19:56:22.079 INFO:teuthology.orchestra.run.smithi155.stdout: "duration": 3.7869999999999999e-06 2023-08-01T19:56:22.079 INFO:teuthology.orchestra.run.smithi155.stdout: }, 2023-08-01T19:56:22.079 INFO:teuthology.orchestra.run.smithi155.stdout: { 2023-08-01T19:56:22.079 INFO:teuthology.orchestra.run.smithi155.stdout: "event": "dispatched", 2023-08-01T19:56:22.079 INFO:teuthology.orchestra.run.smithi155.stdout: "time": "2023-08-01T19:55:58.582241+0000", 2023-08-01T19:56:22.079 INFO:teuthology.orchestra.run.smithi155.stdout: "duration": 7.6909999999999997e-06 2023-08-01T19:56:22.079 INFO:teuthology.orchestra.run.smithi155.stdout: }, 2023-08-01T19:56:22.079 INFO:teuthology.orchestra.run.smithi155.stdout: { 2023-08-01T19:56:22.080 INFO:teuthology.orchestra.run.smithi155.stdout: "event": "queued_for_pg", 2023-08-01T19:56:22.080 INFO:teuthology.orchestra.run.smithi155.stdout: "time": "2023-08-01T19:55:58.582244+0000", 2023-08-01T19:56:22.080 INFO:teuthology.orchestra.run.smithi155.stdout: "duration": 3.6770000000000001e-06 2023-08-01T19:56:22.080 INFO:teuthology.orchestra.run.smithi155.stdout: }, 2023-08-01T19:56:22.080 INFO:teuthology.orchestra.run.smithi155.stdout: { 2023-08-01T19:56:22.080 INFO:teuthology.orchestra.run.smithi155.stdout: "event": "reached_pg", 2023-08-01T19:56:22.080 INFO:teuthology.orchestra.run.smithi155.stdout: "time": "2023-08-01T19:55:58.582274+0000", 2023-08-01T19:56:22.080 INFO:teuthology.orchestra.run.smithi155.stdout: "duration": 3.0074e-05 2023-08-01T19:56:22.081 INFO:teuthology.orchestra.run.smithi155.stdout: }, 2023-08-01T19:56:22.081 INFO:teuthology.orchestra.run.smithi155.stdout: { 2023-08-01T19:56:22.081 INFO:teuthology.orchestra.run.smithi155.stdout: "event": "waiting for peered", 2023-08-01T19:56:22.081 INFO:teuthology.orchestra.run.smithi155.stdout: "time": "2023-08-01T19:55:58.582281+0000", 2023-08-01T19:56:22.081 INFO:teuthology.orchestra.run.smithi155.stdout: "duration": 6.297e-06 2023-08-01T19:56:22.081 INFO:teuthology.orchestra.run.smithi155.stdout: }, 2023-08-01T19:56:22.081 INFO:teuthology.orchestra.run.smithi155.stdout: { 2023-08-01T19:56:22.081 INFO:teuthology.orchestra.run.smithi155.stdout: "event": "reached_pg", 2023-08-01T19:56:22.082 INFO:teuthology.orchestra.run.smithi155.stdout: "time": "2023-08-01T19:55:59.586809+0000", 2023-08-01T19:56:22.082 INFO:teuthology.orchestra.run.smithi155.stdout: "duration": 1.0045281720000001 2023-08-01T19:56:22.082 INFO:teuthology.orchestra.run.smithi155.stdout: }, 2023-08-01T19:56:22.082 INFO:teuthology.orchestra.run.smithi155.stdout: { 2023-08-01T19:56:22.082 INFO:teuthology.orchestra.run.smithi155.stdout: "event": "started", 2023-08-01T19:56:22.082 INFO:teuthology.orchestra.run.smithi155.stdout: "time": "2023-08-01T19:55:59.586910+0000", 2023-08-01T19:56:22.082 INFO:teuthology.orchestra.run.smithi155.stdout: "duration": 0.000100898 2023-08-01T19:56:22.082 INFO:teuthology.orchestra.run.smithi155.stdout: }, 2023-08-01T19:56:22.083 INFO:teuthology.orchestra.run.smithi155.stdout: { 2023-08-01T19:56:22.083 INFO:teuthology.orchestra.run.smithi155.stdout: "event": "op_commit", 2023-08-01T19:56:22.083 INFO:teuthology.orchestra.run.smithi155.stdout: "time": "2023-08-01T19:55:59.591679+0000", 2023-08-01T19:56:22.083 INFO:teuthology.orchestra.run.smithi155.stdout: "duration": 0.004769471 2023-08-01T19:56:22.083 INFO:teuthology.orchestra.run.smithi155.stdout: }, 2023-08-01T19:56:22.083 INFO:teuthology.orchestra.run.smithi155.stdout: { 2023-08-01T19:56:22.083 INFO:teuthology.orchestra.run.smithi155.stdout: "event": "commit_sent", 2023-08-01T19:56:22.083 INFO:teuthology.orchestra.run.smithi155.stdout: "time": "2023-08-01T19:55:59.591721+0000", 2023-08-01T19:56:22.084 INFO:teuthology.orchestra.run.smithi155.stdout: "duration": 4.1953000000000003e-05 2023-08-01T19:56:22.084 INFO:teuthology.orchestra.run.smithi155.stdout: }, 2023-08-01T19:56:22.084 INFO:teuthology.orchestra.run.smithi155.stdout: { 2023-08-01T19:56:22.084 INFO:teuthology.orchestra.run.smithi155.stdout: "event": "done", 2023-08-01T19:56:22.084 INFO:teuthology.orchestra.run.smithi155.stdout: "time": "2023-08-01T19:55:59.591765+0000", 2023-08-01T19:56:22.084 INFO:teuthology.orchestra.run.smithi155.stdout: "duration": 4.4030999999999999e-05 2023-08-01T19:56:22.084 INFO:teuthology.orchestra.run.smithi155.stdout: } 2023-08-01T19:56:22.084 INFO:teuthology.orchestra.run.smithi155.stdout: ] 2023-08-01T19:56:22.085 INFO:teuthology.orchestra.run.smithi155.stdout: } 2023-08-01T19:56:22.085 INFO:teuthology.orchestra.run.smithi155.stdout: } 2023-08-01T19:56:22.085 INFO:teuthology.orchestra.run.smithi155.stdout: ] 2023-08-01T19:56:22.085 INFO:teuthology.orchestra.run.smithi155.stdout:} 2023-08-01T19:56:22.086 INFO:teuthology.orchestra.run.smithi006.stdout:osd.0: {} 2023-08-01T19:56:22.086 INFO:teuthology.orchestra.run.smithi006.stdout:osd.2: {} 2023-08-01T19:56:22.087 DEBUG:teuthology.orchestra.run:got remote process result: 6 2023-08-01T19:56:22.087 DEBUG:teuthology.orchestra.run.smithi008:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 30 ceph --cluster ceph --admin-daemon /var/run/ceph/ceph-osd.0.asok dump_ops_in_flight 2023-08-01T19:56:22.088 INFO:teuthology.orchestra.run.smithi006.stderr:osd.0: osd_enable_op_tracker = 'false' 2023-08-01T19:56:22.088 INFO:teuthology.orchestra.run.smithi006.stderr:Error ENXIO: problem getting command descriptions from osd.1 2023-08-01T19:56:22.088 INFO:teuthology.orchestra.run.smithi006.stderr:osd.2: osd_enable_op_tracker = 'false' 2023-08-01T19:56:22.088 INFO:tasks.thrashosds.thrasher:Failed to tell all osds, ignoring 2023-08-01T19:56:22.089 INFO:tasks.ceph.osd.0.smithi008.stderr:2023-08-01T19:56:22.085+0000 7f16a58f4700 -1 received signal: Hangup from /usr/bin/python3 /bin/daemon-helper kill ceph-osd -f --cluster ceph -i 0 (PID: 111179) UID: 0 2023-08-01T19:56:22.187 INFO:tasks.ceph.osd.0.smithi008.stderr:2023-08-01T19:56:22.185+0000 7f16a58f4700 -1 received signal: Hangup from /usr/bin/python3 /bin/daemon-helper kill ceph-osd -f --cluster ceph -i 0 (PID: 111179) UID: 0 2023-08-01T19:56:22.219 INFO:teuthology.orchestra.run.smithi008.stdout:ERROR: (22) Invalid argument 2023-08-01T19:56:22.219 INFO:teuthology.orchestra.run.smithi008.stdout:op_tracker tracking is not enabled now, so no ops are tracked currently, even those get stuck. Please enable "osd_enable_op_tracker", and the tracker will start to track new ops received afterwards. 2023-08-01T19:56:22.229 DEBUG:teuthology.orchestra.run.smithi008:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 30 ceph --cluster ceph --admin-daemon /var/run/ceph/ceph-osd.0.asok dump_blocked_ops 2023-08-01T19:56:22.288 INFO:tasks.ceph.osd.2.smithi155.stderr:2023-08-01T19:56:22.286+0000 7faa5c6ac700 -1 received signal: Hangup from /usr/bin/python3 /bin/daemon-helper kill ceph-osd -f --cluster ceph -i 2 (PID: 111337) UID: 0 2023-08-01T19:56:22.389 INFO:tasks.ceph.osd.0.smithi008.stderr:2023-08-01T19:56:22.387+0000 7f16a58f4700 -1 received signal: Hangup from /usr/bin/python3 /bin/daemon-helper kill ceph-osd -f --cluster ceph -i 0 (PID: 111179) UID: 0 2023-08-01T19:56:22.396 INFO:teuthology.orchestra.run.smithi008.stdout:ERROR: (22) Invalid argument 2023-08-01T19:56:22.396 INFO:teuthology.orchestra.run.smithi008.stdout:op_tracker tracking is not enabled now, so no ops are tracked currently, even those get stuck. Please enable "osd_enable_op_tracker", and the tracker will start to track new ops received afterwards. 2023-08-01T19:56:22.406 DEBUG:teuthology.orchestra.run.smithi008:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 30 ceph --cluster ceph --admin-daemon /var/run/ceph/ceph-osd.0.asok dump_historic_ops 2023-08-01T19:56:22.490 INFO:tasks.ceph.osd.0.smithi008.stderr:2023-08-01T19:56:22.488+0000 7f16a58f4700 -1 received signal: Hangup from /usr/bin/python3 /bin/daemon-helper kill ceph-osd -f --cluster ceph -i 0 (PID: 111179) UID: 0 2023-08-01T19:56:22.574 INFO:teuthology.orchestra.run.smithi008.stdout:ERROR: (22) Invalid argument 2023-08-01T19:56:22.575 INFO:teuthology.orchestra.run.smithi008.stdout:op_tracker tracking is not enabled now, so no ops are tracked currently, even those get stuck. Please enable "osd_enable_op_tracker", and the tracker will start to track new ops received afterwards. 2023-08-01T19:56:22.584 DEBUG:teuthology.orchestra.run.smithi155:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 30 ceph --cluster ceph --admin-daemon /var/run/ceph/ceph-osd.2.asok dump_ops_in_flight 2023-08-01T19:56:22.626 INFO:tasks.ceph.osd.0.smithi008.stderr:2023-08-01T19:56:22.625+0000 7f16a58f4700 -1 received signal: Hangup from /usr/bin/python3 /bin/daemon-helper kill ceph-osd -f --cluster ceph -i 0 (PID: 111179) UID: 0 2023-08-01T19:56:22.691 INFO:tasks.ceph.osd.0.smithi008.stderr:2023-08-01T19:56:22.690+0000 7f16a58f4700 -1 received signal: Hangup from /usr/bin/python3 /bin/daemon-helper kill ceph-osd -f --cluster ceph -i 0 (PID: 111179) UID: 0 2023-08-01T19:56:22.712 INFO:teuthology.orchestra.run.smithi155.stdout:ERROR: (22) Invalid argument 2023-08-01T19:56:22.713 INFO:teuthology.orchestra.run.smithi155.stdout:op_tracker tracking is not enabled now, so no ops are tracked currently, even those get stuck. Please enable "osd_enable_op_tracker", and the tracker will start to track new ops received afterwards. 2023-08-01T19:56:22.722 DEBUG:teuthology.orchestra.run.smithi155:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 30 ceph --cluster ceph --admin-daemon /var/run/ceph/ceph-osd.2.asok dump_blocked_ops 2023-08-01T19:56:22.775 DEBUG:teuthology.orchestra.run.smithi006:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 120 ceph --cluster ceph osd set nodeep-scrub 2023-08-01T19:56:22.792 INFO:tasks.ceph.osd.2.smithi155.stderr:2023-08-01T19:56:22.791+0000 7faa5c6ac700 -1 received signal: Hangup from /usr/bin/python3 /bin/daemon-helper kill ceph-osd -f --cluster ceph -i 2 (PID: 111337) UID: 0 2023-08-01T19:56:22.865 INFO:teuthology.orchestra.run.smithi155.stdout:ERROR: (22) Invalid argument 2023-08-01T19:56:22.865 INFO:teuthology.orchestra.run.smithi155.stdout:op_tracker tracking is not enabled now, so no ops are tracked currently, even those get stuck. Please enable "osd_enable_op_tracker", and the tracker will start to track new ops received afterwards. 2023-08-01T19:56:22.878 DEBUG:teuthology.orchestra.run.smithi155:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 30 ceph --cluster ceph --admin-daemon /var/run/ceph/ceph-osd.2.asok dump_historic_ops 2023-08-01T19:56:22.919 INFO:tasks.ceph.osd.2.smithi155.stderr:2023-08-01T19:56:22.917+0000 7faa5c6ac700 -1 received signal: Hangup from /usr/bin/python3 /bin/daemon-helper kill ceph-osd -f --cluster ceph -i 2 (PID: 111337) UID: 0 2023-08-01T19:56:22.994 INFO:tasks.ceph.osd.2.smithi155.stderr:2023-08-01T19:56:22.992+0000 7faa5c6ac700 -1 received signal: Hangup from /usr/bin/python3 /bin/daemon-helper kill ceph-osd -f --cluster ceph -i 2 (PID: 111337) UID: 0 2023-08-01T19:56:23.074 INFO:teuthology.orchestra.run.smithi155.stdout:ERROR: (22) Invalid argument 2023-08-01T19:56:23.075 INFO:teuthology.orchestra.run.smithi155.stdout:op_tracker tracking is not enabled now, so no ops are tracked currently, even those get stuck. Please enable "osd_enable_op_tracker", and the tracker will start to track new ops received afterwards. 2023-08-01T19:56:23.087 DEBUG:teuthology.orchestra.run.smithi008:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 30 ceph --cluster ceph --admin-daemon /var/run/ceph/ceph-osd.0.asok dump_ops_in_flight 2023-08-01T19:56:23.132 INFO:tasks.ceph.osd.0.smithi008.stderr:2023-08-01T19:56:23.130+0000 7f16a58f4700 -1 received signal: Hangup from /usr/bin/python3 /bin/daemon-helper kill ceph-osd -f --cluster ceph -i 0 (PID: 111179) UID: 0 2023-08-01T19:56:23.196 INFO:tasks.ceph.osd.0.smithi008.stderr:2023-08-01T19:56:23.194+0000 7f16a58f4700 -1 received signal: Hangup from /usr/bin/python3 /bin/daemon-helper kill ceph-osd -f --cluster ceph -i 0 (PID: 111179) UID: 0 2023-08-01T19:56:23.273 INFO:teuthology.orchestra.run.smithi008.stdout:ERROR: (22) Invalid argument 2023-08-01T19:56:23.273 INFO:teuthology.orchestra.run.smithi008.stdout:op_tracker tracking is not enabled now, so no ops are tracked currently, even those get stuck. Please enable "osd_enable_op_tracker", and the tracker will start to track new ops received afterwards. 2023-08-01T19:56:23.288 DEBUG:teuthology.orchestra.run.smithi008:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 30 ceph --cluster ceph --admin-daemon /var/run/ceph/ceph-osd.0.asok dump_blocked_ops 2023-08-01T19:56:23.328 INFO:tasks.ceph.osd.0.smithi008.stderr:2023-08-01T19:56:23.327+0000 7f16a58f4700 -1 received signal: Hangup from /usr/bin/python3 /bin/daemon-helper kill ceph-osd -f --cluster ceph -i 0 (PID: 111179) UID: 0 2023-08-01T19:56:23.397 INFO:tasks.ceph.osd.0.smithi008.stderr:2023-08-01T19:56:23.395+0000 7f16a58f4700 -1 received signal: Hangup from /usr/bin/python3 /bin/daemon-helper kill ceph-osd -f --cluster ceph -i 0 (PID: 111179) UID: 0 2023-08-01T19:56:23.497 INFO:tasks.ceph.osd.0.smithi008.stderr:2023-08-01T19:56:23.495+0000 7f16a58f4700 -1 received signal: Hangup from /usr/bin/python3 /bin/daemon-helper kill ceph-osd -f --cluster ceph -i 0 (PID: 111179) UID: 0 2023-08-01T19:56:23.518 INFO:teuthology.orchestra.run.smithi008.stdout:ERROR: (22) Invalid argument 2023-08-01T19:56:23.518 INFO:teuthology.orchestra.run.smithi008.stdout:op_tracker tracking is not enabled now, so no ops are tracked currently, even those get stuck. Please enable "osd_enable_op_tracker", and the tracker will start to track new ops received afterwards. 2023-08-01T19:56:23.533 DEBUG:teuthology.orchestra.run.smithi008:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 30 ceph --cluster ceph --admin-daemon /var/run/ceph/ceph-osd.0.asok dump_historic_ops 2023-08-01T19:56:23.598 INFO:tasks.ceph.osd.2.smithi155.stderr:2023-08-01T19:56:23.597+0000 7faa5c6ac700 -1 received signal: Hangup from /usr/bin/python3 /bin/daemon-helper kill ceph-osd -f --cluster ceph -i 2 (PID: 111337) UID: 0 2023-08-01T19:56:23.699 INFO:tasks.ceph.osd.0.smithi008.stderr:2023-08-01T19:56:23.697+0000 7f16a58f4700 -1 received signal: Hangup from /usr/bin/python3 /bin/daemon-helper kill ceph-osd -f --cluster ceph -i 0 (PID: 111179) UID: 0 2023-08-01T19:56:23.751 INFO:teuthology.orchestra.run.smithi008.stdout:ERROR: (22) Invalid argument 2023-08-01T19:56:23.751 INFO:teuthology.orchestra.run.smithi008.stdout:op_tracker tracking is not enabled now, so no ops are tracked currently, even those get stuck. Please enable "osd_enable_op_tracker", and the tracker will start to track new ops received afterwards. 2023-08-01T19:56:23.765 DEBUG:teuthology.orchestra.run.smithi155:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 30 ceph --cluster ceph --admin-daemon /var/run/ceph/ceph-osd.2.asok dump_ops_in_flight 2023-08-01T19:56:23.771 INFO:teuthology.orchestra.run.smithi006.stderr:nodeep-scrub is set 2023-08-01T19:56:23.809 INFO:tasks.ceph.osd.2.smithi155.stderr:2023-08-01T19:56:23.808+0000 7faa5c6ac700 -1 received signal: Hangup from /usr/bin/python3 /bin/daemon-helper kill ceph-osd -f --cluster ceph -i 2 (PID: 111337) UID: 0 2023-08-01T19:56:23.901 INFO:tasks.ceph.osd.0.smithi008.stderr:2023-08-01T19:56:23.899+0000 7f16a58f4700 -1 received signal: Hangup from /usr/bin/python3 /bin/daemon-helper kill ceph-osd -f --cluster ceph -i 0 (PID: 111179) UID: 0 2023-08-01T19:56:23.927 INFO:teuthology.orchestra.run.smithi155.stdout:ERROR: (22) Invalid argument 2023-08-01T19:56:23.927 INFO:teuthology.orchestra.run.smithi155.stdout:op_tracker tracking is not enabled now, so no ops are tracked currently, even those get stuck. Please enable "osd_enable_op_tracker", and the tracker will start to track new ops received afterwards. 2023-08-01T19:56:23.940 DEBUG:teuthology.orchestra.run.smithi155:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 30 ceph --cluster ceph --admin-daemon /var/run/ceph/ceph-osd.2.asok dump_blocked_ops 2023-08-01T19:56:24.001 INFO:tasks.ceph.osd.0.smithi008.stderr:2023-08-01T19:56:24.000+0000 7f16a58f4700 -1 received signal: Hangup from /usr/bin/python3 /bin/daemon-helper kill ceph-osd -f --cluster ceph -i 0 (PID: 111179) UID: 0 2023-08-01T19:56:24.089 DEBUG:teuthology.orchestra.run.smithi006:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 120 ceph --cluster ceph -- tell 'osd.*' injectargs --osd_enable_op_tracker=true 2023-08-01T19:56:24.102 INFO:tasks.ceph.osd.0.smithi008.stderr:2023-08-01T19:56:24.100+0000 7f16a58f4700 -1 received signal: Hangup from /usr/bin/python3 /bin/daemon-helper kill ceph-osd -f --cluster ceph -i 0 (PID: 111179) UID: 0 2023-08-01T19:56:24.136 INFO:teuthology.orchestra.run.smithi155.stdout:ERROR: (22) Invalid argument 2023-08-01T19:56:24.136 INFO:teuthology.orchestra.run.smithi155.stdout:op_tracker tracking is not enabled now, so no ops are tracked currently, even those get stuck. Please enable "osd_enable_op_tracker", and the tracker will start to track new ops received afterwards. 2023-08-01T19:56:24.149 DEBUG:teuthology.orchestra.run.smithi155:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 30 ceph --cluster ceph --admin-daemon /var/run/ceph/ceph-osd.2.asok dump_historic_ops 2023-08-01T19:56:24.202 INFO:tasks.ceph.osd.2.smithi155.stderr:2023-08-01T19:56:24.201+0000 7faa5c6ac700 -1 received signal: Hangup from /usr/bin/python3 /bin/daemon-helper kill ceph-osd -f --cluster ceph -i 2 (PID: 111337) UID: 0 2023-08-01T19:56:24.236 INFO:teuthology.orchestra.run.smithi006.stdout:osd.0: {} 2023-08-01T19:56:24.257 INFO:teuthology.orchestra.run.smithi006.stdout:osd.2: {} 2023-08-01T19:56:24.257 INFO:teuthology.orchestra.run.smithi006.stderr:osd.0: osd_enable_op_tracker = 'true' 2023-08-01T19:56:24.257 INFO:teuthology.orchestra.run.smithi006.stderr:Error ENXIO: problem getting command descriptions from osd.1 2023-08-01T19:56:24.257 INFO:teuthology.orchestra.run.smithi006.stderr:osd.2: osd_enable_op_tracker = 'true' 2023-08-01T19:56:24.259 DEBUG:teuthology.orchestra.run:got remote process result: 6 2023-08-01T19:56:24.260 INFO:tasks.thrashosds.thrasher:Failed to tell all osds, ignoring 2023-08-01T19:56:24.303 INFO:tasks.ceph.osd.0.smithi008.stderr:2023-08-01T19:56:24.302+0000 7f16a58f4700 -1 received signal: Hangup from /usr/bin/python3 /bin/daemon-helper kill ceph-osd -f --cluster ceph -i 0 (PID: 111179) UID: 0 2023-08-01T19:56:24.306 INFO:teuthology.orchestra.run.smithi155.stdout:{ 2023-08-01T19:56:24.307 INFO:teuthology.orchestra.run.smithi155.stdout: "size": 20, 2023-08-01T19:56:24.307 INFO:teuthology.orchestra.run.smithi155.stdout: "duration": 600, 2023-08-01T19:56:24.307 INFO:teuthology.orchestra.run.smithi155.stdout: "ops": [ 2023-08-01T19:56:24.307 INFO:teuthology.orchestra.run.smithi155.stdout: { 2023-08-01T19:56:24.307 INFO:teuthology.orchestra.run.smithi155.stdout: "description": "osd_op(client.4668.0:100237 5.4 5:2d68bec9:::benchmark_data_smithi006_114134_object100236:head [set-alloc-hint object_size 65536 write_size 65536,write 0~65536] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e37)", 2023-08-01T19:56:24.307 INFO:teuthology.orchestra.run.smithi155.stdout: "initiated_at": "2023-08-01T19:55:05.147736+0000", 2023-08-01T19:56:24.308 INFO:teuthology.orchestra.run.smithi155.stdout: "age": 79.156273056000003, 2023-08-01T19:56:24.308 INFO:teuthology.orchestra.run.smithi155.stdout: "duration": 0.071299464000000007, 2023-08-01T19:56:24.308 INFO:teuthology.orchestra.run.smithi155.stdout: "type_data": { 2023-08-01T19:56:24.308 INFO:teuthology.orchestra.run.smithi155.stdout: "flag_point": "commit sent; apply or cleanup", 2023-08-01T19:56:24.308 INFO:teuthology.orchestra.run.smithi155.stdout: "client_info": { 2023-08-01T19:56:24.308 INFO:teuthology.orchestra.run.smithi155.stdout: "client": "client.4668", 2023-08-01T19:56:24.308 INFO:teuthology.orchestra.run.smithi155.stdout: "client_addr": "172.21.15.6:0/1709472247", 2023-08-01T19:56:24.309 INFO:teuthology.orchestra.run.smithi155.stdout: "tid": 100237 2023-08-01T19:56:24.309 INFO:teuthology.orchestra.run.smithi155.stdout: }, 2023-08-01T19:56:24.309 INFO:teuthology.orchestra.run.smithi155.stdout: "events": [ 2023-08-01T19:56:24.309 INFO:teuthology.orchestra.run.smithi155.stdout: { 2023-08-01T19:56:24.309 INFO:teuthology.orchestra.run.smithi155.stdout: "event": "initiated", 2023-08-01T19:56:24.309 INFO:teuthology.orchestra.run.smithi155.stdout: "time": "2023-08-01T19:55:05.147736+0000", 2023-08-01T19:56:24.309 INFO:teuthology.orchestra.run.smithi155.stdout: "duration": 0 2023-08-01T19:56:24.309 INFO:teuthology.orchestra.run.smithi155.stdout: }, 2023-08-01T19:56:24.310 INFO:teuthology.orchestra.run.smithi155.stdout: { 2023-08-01T19:56:24.310 INFO:teuthology.orchestra.run.smithi155.stdout: "event": "throttled", 2023-08-01T19:56:24.310 INFO:teuthology.orchestra.run.smithi155.stdout: "time": "2023-08-01T19:55:05.147736+0000", 2023-08-01T19:56:24.310 INFO:teuthology.orchestra.run.smithi155.stdout: "duration": 0 2023-08-01T19:56:24.310 INFO:teuthology.orchestra.run.smithi155.stdout: }, 2023-08-01T19:56:24.310 INFO:teuthology.orchestra.run.smithi155.stdout: { 2023-08-01T19:56:24.310 INFO:teuthology.orchestra.run.smithi155.stdout: "event": "header_read", 2023-08-01T19:56:24.311 INFO:teuthology.orchestra.run.smithi155.stdout: "time": "2023-08-01T19:55:05.147736+0000", 2023-08-01T19:56:24.311 INFO:teuthology.orchestra.run.smithi155.stdout: "duration": 4294967295.9999995 2023-08-01T19:56:24.311 INFO:teuthology.orchestra.run.smithi155.stdout: }, 2023-08-01T19:56:24.311 INFO:teuthology.orchestra.run.smithi155.stdout: { 2023-08-01T19:56:24.311 INFO:teuthology.orchestra.run.smithi155.stdout: "event": "all_read", 2023-08-01T19:56:24.311 INFO:teuthology.orchestra.run.smithi155.stdout: "time": "2023-08-01T19:55:05.147766+0000", 2023-08-01T19:56:24.311 INFO:teuthology.orchestra.run.smithi155.stdout: "duration": 3.0394000000000001e-05 2023-08-01T19:56:24.311 INFO:teuthology.orchestra.run.smithi155.stdout: }, 2023-08-01T19:56:24.312 INFO:teuthology.orchestra.run.smithi155.stdout: { 2023-08-01T19:56:24.312 INFO:teuthology.orchestra.run.smithi155.stdout: "event": "dispatched", 2023-08-01T19:56:24.312 INFO:teuthology.orchestra.run.smithi155.stdout: "time": "2023-08-01T19:55:05.147771+0000", 2023-08-01T19:56:24.312 INFO:teuthology.orchestra.run.smithi155.stdout: "duration": 4.25e-06 2023-08-01T19:56:24.312 INFO:teuthology.orchestra.run.smithi155.stdout: }, 2023-08-01T19:56:24.312 INFO:teuthology.orchestra.run.smithi155.stdout: { 2023-08-01T19:56:24.312 INFO:teuthology.orchestra.run.smithi155.stdout: "event": "queued_for_pg", 2023-08-01T19:56:24.312 INFO:teuthology.orchestra.run.smithi155.stdout: "time": "2023-08-01T19:55:05.147773+0000", 2023-08-01T19:56:24.313 INFO:teuthology.orchestra.run.smithi155.stdout: "duration": 2.4159999999999998e-06 2023-08-01T19:56:24.313 INFO:teuthology.orchestra.run.smithi155.stdout: }, 2023-08-01T19:56:24.313 INFO:teuthology.orchestra.run.smithi155.stdout: { 2023-08-01T19:56:24.313 INFO:teuthology.orchestra.run.smithi155.stdout: "event": "reached_pg", 2023-08-01T19:56:24.313 INFO:teuthology.orchestra.run.smithi155.stdout: "time": "2023-08-01T19:55:05.149903+0000", 2023-08-01T19:56:24.313 INFO:teuthology.orchestra.run.smithi155.stdout: "duration": 0.002129948 2023-08-01T19:56:24.313 INFO:teuthology.orchestra.run.smithi155.stdout: }, 2023-08-01T19:56:24.313 INFO:teuthology.orchestra.run.smithi155.stdout: { 2023-08-01T19:56:24.314 INFO:teuthology.orchestra.run.smithi155.stdout: "event": "started", 2023-08-01T19:56:24.314 INFO:teuthology.orchestra.run.smithi155.stdout: "time": "2023-08-01T19:55:05.149982+0000", 2023-08-01T19:56:24.314 INFO:teuthology.orchestra.run.smithi155.stdout: "duration": 7.8706000000000002e-05 2023-08-01T19:56:24.314 INFO:teuthology.orchestra.run.smithi155.stdout: }, 2023-08-01T19:56:24.314 INFO:teuthology.orchestra.run.smithi155.stdout: { 2023-08-01T19:56:24.314 INFO:teuthology.orchestra.run.smithi155.stdout: "event": "waiting for subops from 0", 2023-08-01T19:56:24.314 INFO:teuthology.orchestra.run.smithi155.stdout: "time": "2023-08-01T19:55:05.150066+0000", 2023-08-01T19:56:24.314 INFO:teuthology.orchestra.run.smithi155.stdout: "duration": 8.4241999999999997e-05 2023-08-01T19:56:24.315 INFO:teuthology.orchestra.run.smithi155.stdout: }, 2023-08-01T19:56:24.315 INFO:teuthology.orchestra.run.smithi155.stdout: { 2023-08-01T19:56:24.315 INFO:teuthology.orchestra.run.smithi155.stdout: "event": "op_commit", 2023-08-01T19:56:24.315 INFO:teuthology.orchestra.run.smithi155.stdout: "time": "2023-08-01T19:55:05.154994+0000", 2023-08-01T19:56:24.315 INFO:teuthology.orchestra.run.smithi155.stdout: "duration": 0.0049277050000000001 2023-08-01T19:56:24.315 INFO:teuthology.orchestra.run.smithi155.stdout: }, 2023-08-01T19:56:24.315 INFO:teuthology.orchestra.run.smithi155.stdout: { 2023-08-01T19:56:24.316 INFO:teuthology.orchestra.run.smithi155.stdout: "event": "sub_op_commit_rec", 2023-08-01T19:56:24.316 INFO:teuthology.orchestra.run.smithi155.stdout: "time": "2023-08-01T19:55:05.218933+0000", 2023-08-01T19:56:24.316 INFO:teuthology.orchestra.run.smithi155.stdout: "duration": 0.063939916999999999 2023-08-01T19:56:24.316 INFO:teuthology.orchestra.run.smithi155.stdout: }, 2023-08-01T19:56:24.316 INFO:teuthology.orchestra.run.smithi155.stdout: { 2023-08-01T19:56:24.316 INFO:teuthology.orchestra.run.smithi155.stdout: "event": "commit_sent", 2023-08-01T19:56:24.316 INFO:teuthology.orchestra.run.smithi155.stdout: "time": "2023-08-01T19:55:05.218989+0000", 2023-08-01T19:56:24.316 INFO:teuthology.orchestra.run.smithi155.stdout: "duration": 5.5772000000000001e-05 2023-08-01T19:56:24.317 INFO:teuthology.orchestra.run.smithi155.stdout: }, 2023-08-01T19:56:24.317 INFO:teuthology.orchestra.run.smithi155.stdout: { 2023-08-01T19:56:24.317 INFO:teuthology.orchestra.run.smithi155.stdout: "event": "done", 2023-08-01T19:56:24.317 INFO:teuthology.orchestra.run.smithi155.stdout: "time": "2023-08-01T19:55:05.219036+0000", 2023-08-01T19:56:24.317 INFO:teuthology.orchestra.run.smithi155.stdout: "duration": 4.6526000000000001e-05 2023-08-01T19:56:24.317 INFO:teuthology.orchestra.run.smithi155.stdout: } 2023-08-01T19:56:24.317 INFO:teuthology.orchestra.run.smithi155.stdout: ] 2023-08-01T19:56:24.317 INFO:teuthology.orchestra.run.smithi155.stdout: } 2023-08-01T19:56:24.318 INFO:teuthology.orchestra.run.smithi155.stdout: }, 2023-08-01T19:56:24.318 INFO:teuthology.orchestra.run.smithi155.stdout: { 2023-08-01T19:56:24.318 INFO:teuthology.orchestra.run.smithi155.stdout: "description": "osd_op(client.4668.0:100242 5.8 5:16a314b8:::benchmark_data_smithi006_114134_object100241:head [set-alloc-hint object_size 65536 write_size 65536,write 0~65536] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e37)", 2023-08-01T19:56:24.318 INFO:teuthology.orchestra.run.smithi155.stdout: "initiated_at": "2023-08-01T19:55:05.150616+0000", 2023-08-01T19:56:24.318 INFO:teuthology.orchestra.run.smithi155.stdout: "age": 79.153393425999994, 2023-08-01T19:56:24.318 INFO:teuthology.orchestra.run.smithi155.stdout: "duration": 0.071105065999999995, 2023-08-01T19:56:24.318 INFO:teuthology.orchestra.run.smithi155.stdout: "type_data": { 2023-08-01T19:56:24.319 INFO:teuthology.orchestra.run.smithi155.stdout: "flag_point": "commit sent; apply or cleanup", 2023-08-01T19:56:24.319 INFO:teuthology.orchestra.run.smithi155.stdout: "client_info": { 2023-08-01T19:56:24.319 INFO:teuthology.orchestra.run.smithi155.stdout: "client": "client.4668", 2023-08-01T19:56:24.319 INFO:teuthology.orchestra.run.smithi155.stdout: "client_addr": "172.21.15.6:0/1709472247", 2023-08-01T19:56:24.319 INFO:teuthology.orchestra.run.smithi155.stdout: "tid": 100242 2023-08-01T19:56:24.319 INFO:teuthology.orchestra.run.smithi155.stdout: }, 2023-08-01T19:56:24.319 INFO:teuthology.orchestra.run.smithi155.stdout: "events": [ 2023-08-01T19:56:24.319 INFO:teuthology.orchestra.run.smithi155.stdout: { 2023-08-01T19:56:24.320 INFO:teuthology.orchestra.run.smithi155.stdout: "event": "initiated", 2023-08-01T19:56:24.320 INFO:teuthology.orchestra.run.smithi155.stdout: "time": "2023-08-01T19:55:05.150616+0000", 2023-08-01T19:56:24.320 INFO:teuthology.orchestra.run.smithi155.stdout: "duration": 0 2023-08-01T19:56:24.320 INFO:teuthology.orchestra.run.smithi155.stdout: }, 2023-08-01T19:56:24.320 INFO:teuthology.orchestra.run.smithi155.stdout: { 2023-08-01T19:56:24.320 INFO:teuthology.orchestra.run.smithi155.stdout: "event": "throttled", 2023-08-01T19:56:24.320 INFO:teuthology.orchestra.run.smithi155.stdout: "time": "2023-08-01T19:55:05.150616+0000", 2023-08-01T19:56:24.320 INFO:teuthology.orchestra.run.smithi155.stdout: "duration": 0 2023-08-01T19:56:24.321 INFO:teuthology.orchestra.run.smithi155.stdout: }, 2023-08-01T19:56:24.321 INFO:teuthology.orchestra.run.smithi155.stdout: { 2023-08-01T19:56:24.321 INFO:teuthology.orchestra.run.smithi155.stdout: "event": "header_read", 2023-08-01T19:56:24.321 INFO:teuthology.orchestra.run.smithi155.stdout: "time": "2023-08-01T19:55:05.150615+0000", 2023-08-01T19:56:24.321 INFO:teuthology.orchestra.run.smithi155.stdout: "duration": 4294967295.999999 2023-08-01T19:56:24.321 INFO:teuthology.orchestra.run.smithi155.stdout: }, 2023-08-01T19:56:24.321 INFO:teuthology.orchestra.run.smithi155.stdout: { 2023-08-01T19:56:24.322 INFO:teuthology.orchestra.run.smithi155.stdout: "event": "all_read", 2023-08-01T19:56:24.322 INFO:teuthology.orchestra.run.smithi155.stdout: "time": "2023-08-01T19:55:05.150696+0000", 2023-08-01T19:56:24.322 INFO:teuthology.orchestra.run.smithi155.stdout: "duration": 8.0852000000000004e-05 2023-08-01T19:56:24.322 INFO:teuthology.orchestra.run.smithi155.stdout: }, 2023-08-01T19:56:24.322 INFO:teuthology.orchestra.run.smithi155.stdout: { 2023-08-01T19:56:24.322 INFO:teuthology.orchestra.run.smithi155.stdout: "event": "dispatched", 2023-08-01T19:56:24.322 INFO:teuthology.orchestra.run.smithi155.stdout: "time": "2023-08-01T19:55:05.150708+0000", 2023-08-01T19:56:24.322 INFO:teuthology.orchestra.run.smithi155.stdout: "duration": 1.2116999999999999e-05 2023-08-01T19:56:24.323 INFO:teuthology.orchestra.run.smithi155.stdout: }, 2023-08-01T19:56:24.323 INFO:teuthology.orchestra.run.smithi155.stdout: { 2023-08-01T19:56:24.323 INFO:teuthology.orchestra.run.smithi155.stdout: "event": "queued_for_pg", 2023-08-01T19:56:24.323 INFO:teuthology.orchestra.run.smithi155.stdout: "time": "2023-08-01T19:55:05.150713+0000", 2023-08-01T19:56:24.323 INFO:teuthology.orchestra.run.smithi155.stdout: "duration": 5.4620000000000004e-06 2023-08-01T19:56:24.323 INFO:teuthology.orchestra.run.smithi155.stdout: }, 2023-08-01T19:56:24.323 INFO:teuthology.orchestra.run.smithi155.stdout: { 2023-08-01T19:56:24.323 INFO:teuthology.orchestra.run.smithi155.stdout: "event": "reached_pg", 2023-08-01T19:56:24.324 INFO:teuthology.orchestra.run.smithi155.stdout: "time": "2023-08-01T19:55:05.150761+0000", 2023-08-01T19:56:24.324 INFO:teuthology.orchestra.run.smithi155.stdout: "duration": 4.7429000000000003e-05 2023-08-01T19:56:24.324 INFO:teuthology.orchestra.run.smithi155.stdout: }, 2023-08-01T19:56:24.324 INFO:teuthology.orchestra.run.smithi155.stdout: { 2023-08-01T19:56:24.324 INFO:teuthology.orchestra.run.smithi155.stdout: "event": "started", 2023-08-01T19:56:24.324 INFO:teuthology.orchestra.run.smithi155.stdout: "time": "2023-08-01T19:55:05.150856+0000", 2023-08-01T19:56:24.324 INFO:teuthology.orchestra.run.smithi155.stdout: "duration": 9.5356e-05 2023-08-01T19:56:24.324 INFO:teuthology.orchestra.run.smithi155.stdout: }, 2023-08-01T19:56:24.325 INFO:teuthology.orchestra.run.smithi155.stdout: { 2023-08-01T19:56:24.325 INFO:teuthology.orchestra.run.smithi155.stdout: "event": "waiting for subops from 0", 2023-08-01T19:56:24.325 INFO:teuthology.orchestra.run.smithi155.stdout: "time": "2023-08-01T19:55:05.150999+0000", 2023-08-01T19:56:24.325 INFO:teuthology.orchestra.run.smithi155.stdout: "duration": 0.00014234499999999999 2023-08-01T19:56:24.325 INFO:teuthology.orchestra.run.smithi155.stdout: }, 2023-08-01T19:56:24.325 INFO:teuthology.orchestra.run.smithi155.stdout: { 2023-08-01T19:56:24.325 INFO:teuthology.orchestra.run.smithi155.stdout: "event": "sub_op_commit_rec", 2023-08-01T19:56:24.326 INFO:teuthology.orchestra.run.smithi155.stdout: "time": "2023-08-01T19:55:05.219001+0000", 2023-08-01T19:56:24.326 INFO:teuthology.orchestra.run.smithi155.stdout: "duration": 0.068002776000000001 2023-08-01T19:56:24.326 INFO:teuthology.orchestra.run.smithi155.stdout: }, 2023-08-01T19:56:24.326 INFO:teuthology.orchestra.run.smithi155.stdout: { 2023-08-01T19:56:24.326 INFO:teuthology.orchestra.run.smithi155.stdout: "event": "op_commit", 2023-08-01T19:56:24.326 INFO:teuthology.orchestra.run.smithi155.stdout: "time": "2023-08-01T19:55:05.221635+0000", 2023-08-01T19:56:24.326 INFO:teuthology.orchestra.run.smithi155.stdout: "duration": 0.0026340579999999999 2023-08-01T19:56:24.326 INFO:teuthology.orchestra.run.smithi155.stdout: }, 2023-08-01T19:56:24.327 INFO:teuthology.orchestra.run.smithi155.stdout: { 2023-08-01T19:56:24.327 INFO:teuthology.orchestra.run.smithi155.stdout: "event": "commit_sent", 2023-08-01T19:56:24.327 INFO:teuthology.orchestra.run.smithi155.stdout: "time": "2023-08-01T19:55:05.221682+0000", 2023-08-01T19:56:24.327 INFO:teuthology.orchestra.run.smithi155.stdout: "duration": 4.7123999999999998e-05 2023-08-01T19:56:24.327 INFO:teuthology.orchestra.run.smithi155.stdout: }, 2023-08-01T19:56:24.327 INFO:teuthology.orchestra.run.smithi155.stdout: { 2023-08-01T19:56:24.327 INFO:teuthology.orchestra.run.smithi155.stdout: "event": "done", 2023-08-01T19:56:24.327 INFO:teuthology.orchestra.run.smithi155.stdout: "time": "2023-08-01T19:55:05.221721+0000", 2023-08-01T19:56:24.328 INFO:teuthology.orchestra.run.smithi155.stdout: "duration": 3.8529999999999999e-05 2023-08-01T19:56:24.328 INFO:teuthology.orchestra.run.smithi155.stdout: } 2023-08-01T19:56:24.328 INFO:teuthology.orchestra.run.smithi155.stdout: ] 2023-08-01T19:56:24.328 INFO:teuthology.orchestra.run.smithi155.stdout: } 2023-08-01T19:56:24.328 INFO:teuthology.orchestra.run.smithi155.stdout: }, 2023-08-01T19:56:24.328 INFO:teuthology.orchestra.run.smithi155.stdout: { 2023-08-01T19:56:24.328 INFO:teuthology.orchestra.run.smithi155.stdout: "description": "osd_repop(client.4668.0:100240 5.a e37/19 5:5313c5b9:::benchmark_data_smithi006_114134_object100239:head v 37'6227, mlcod=37'6225)", 2023-08-01T19:56:24.329 INFO:teuthology.orchestra.run.smithi155.stdout: "initiated_at": "2023-08-01T19:55:05.150778+0000", 2023-08-01T19:56:24.329 INFO:teuthology.orchestra.run.smithi155.stdout: "age": 79.153231224999999, 2023-08-01T19:56:24.329 INFO:teuthology.orchestra.run.smithi155.stdout: "duration": 0.073362533999999993, 2023-08-01T19:56:24.329 INFO:teuthology.orchestra.run.smithi155.stdout: "type_data": { 2023-08-01T19:56:24.329 INFO:teuthology.orchestra.run.smithi155.stdout: "flag_point": "commit sent; apply or cleanup", 2023-08-01T19:56:24.329 INFO:teuthology.orchestra.run.smithi155.stdout: "events": [ 2023-08-01T19:56:24.329 INFO:teuthology.orchestra.run.smithi155.stdout: { 2023-08-01T19:56:24.330 INFO:teuthology.orchestra.run.smithi155.stdout: "event": "initiated", 2023-08-01T19:56:24.330 INFO:teuthology.orchestra.run.smithi155.stdout: "time": "2023-08-01T19:55:05.150778+0000", 2023-08-01T19:56:24.330 INFO:teuthology.orchestra.run.smithi155.stdout: "duration": 0 2023-08-01T19:56:24.330 INFO:teuthology.orchestra.run.smithi155.stdout: }, 2023-08-01T19:56:24.330 INFO:teuthology.orchestra.run.smithi155.stdout: { 2023-08-01T19:56:24.330 INFO:teuthology.orchestra.run.smithi155.stdout: "event": "throttled", 2023-08-01T19:56:24.330 INFO:teuthology.orchestra.run.smithi155.stdout: "time": "2023-08-01T19:55:05.150778+0000", 2023-08-01T19:56:24.330 INFO:teuthology.orchestra.run.smithi155.stdout: "duration": 0 2023-08-01T19:56:24.331 INFO:teuthology.orchestra.run.smithi155.stdout: }, 2023-08-01T19:56:24.331 INFO:teuthology.orchestra.run.smithi155.stdout: { 2023-08-01T19:56:24.331 INFO:teuthology.orchestra.run.smithi155.stdout: "event": "header_read", 2023-08-01T19:56:24.331 INFO:teuthology.orchestra.run.smithi155.stdout: "time": "2023-08-01T19:55:05.150778+0000", 2023-08-01T19:56:24.331 INFO:teuthology.orchestra.run.smithi155.stdout: "duration": 4294967295.9999995 2023-08-01T19:56:24.331 INFO:teuthology.orchestra.run.smithi155.stdout: }, 2023-08-01T19:56:24.331 INFO:teuthology.orchestra.run.smithi155.stdout: { 2023-08-01T19:56:24.331 INFO:teuthology.orchestra.run.smithi155.stdout: "event": "all_read", 2023-08-01T19:56:24.332 INFO:teuthology.orchestra.run.smithi155.stdout: "time": "2023-08-01T19:55:05.150811+0000", 2023-08-01T19:56:24.332 INFO:teuthology.orchestra.run.smithi155.stdout: "duration": 3.3664000000000002e-05 2023-08-01T19:56:24.332 INFO:teuthology.orchestra.run.smithi155.stdout: }, 2023-08-01T19:56:24.332 INFO:teuthology.orchestra.run.smithi155.stdout: { 2023-08-01T19:56:24.332 INFO:teuthology.orchestra.run.smithi155.stdout: "event": "dispatched", 2023-08-01T19:56:24.332 INFO:teuthology.orchestra.run.smithi155.stdout: "time": "2023-08-01T19:55:05.150818+0000", 2023-08-01T19:56:24.332 INFO:teuthology.orchestra.run.smithi155.stdout: "duration": 6.5769999999999999e-06 2023-08-01T19:56:24.332 INFO:teuthology.orchestra.run.smithi155.stdout: }, 2023-08-01T19:56:24.333 INFO:teuthology.orchestra.run.smithi155.stdout: { 2023-08-01T19:56:24.333 INFO:teuthology.orchestra.run.smithi155.stdout: "event": "queued_for_pg", 2023-08-01T19:56:24.333 INFO:teuthology.orchestra.run.smithi155.stdout: "time": "2023-08-01T19:55:05.150822+0000", 2023-08-01T19:56:24.333 INFO:teuthology.orchestra.run.smithi155.stdout: "duration": 4.0060000000000003e-06 2023-08-01T19:56:24.333 INFO:teuthology.orchestra.run.smithi155.stdout: }, 2023-08-01T19:56:24.333 INFO:teuthology.orchestra.run.smithi155.stdout: { 2023-08-01T19:56:24.333 INFO:teuthology.orchestra.run.smithi155.stdout: "event": "reached_pg", 2023-08-01T19:56:24.334 INFO:teuthology.orchestra.run.smithi155.stdout: "time": "2023-08-01T19:55:05.150855+0000", 2023-08-01T19:56:24.334 INFO:teuthology.orchestra.run.smithi155.stdout: "duration": 3.3204999999999998e-05 2023-08-01T19:56:24.334 INFO:teuthology.orchestra.run.smithi155.stdout: }, 2023-08-01T19:56:24.334 INFO:teuthology.orchestra.run.smithi155.stdout: { 2023-08-01T19:56:24.334 INFO:teuthology.orchestra.run.smithi155.stdout: "event": "started", 2023-08-01T19:56:24.334 INFO:teuthology.orchestra.run.smithi155.stdout: "time": "2023-08-01T19:55:05.150873+0000", 2023-08-01T19:56:24.334 INFO:teuthology.orchestra.run.smithi155.stdout: "duration": 1.8139999999999999e-05 2023-08-01T19:56:24.334 INFO:teuthology.orchestra.run.smithi155.stdout: }, 2023-08-01T19:56:24.335 INFO:teuthology.orchestra.run.smithi155.stdout: { 2023-08-01T19:56:24.335 INFO:teuthology.orchestra.run.smithi155.stdout: "event": "commit_sent", 2023-08-01T19:56:24.335 INFO:teuthology.orchestra.run.smithi155.stdout: "time": "2023-08-01T19:55:05.224095+0000", 2023-08-01T19:56:24.335 INFO:teuthology.orchestra.run.smithi155.stdout: "duration": 0.073221895999999995 2023-08-01T19:56:24.335 INFO:teuthology.orchestra.run.smithi155.stdout: }, 2023-08-01T19:56:24.335 INFO:teuthology.orchestra.run.smithi155.stdout: { 2023-08-01T19:56:24.335 INFO:teuthology.orchestra.run.smithi155.stdout: "event": "done", 2023-08-01T19:56:24.335 INFO:teuthology.orchestra.run.smithi155.stdout: "time": "2023-08-01T19:55:05.224141+0000", 2023-08-01T19:56:24.336 INFO:teuthology.orchestra.run.smithi155.stdout: "duration": 4.5385e-05 2023-08-01T19:56:24.336 INFO:teuthology.orchestra.run.smithi155.stdout: } 2023-08-01T19:56:24.336 INFO:teuthology.orchestra.run.smithi155.stdout: ] 2023-08-01T19:56:24.336 INFO:teuthology.orchestra.run.smithi155.stdout: } 2023-08-01T19:56:24.336 INFO:teuthology.orchestra.run.smithi155.stdout: }, 2023-08-01T19:56:24.336 INFO:teuthology.orchestra.run.smithi155.stdout: { 2023-08-01T19:56:24.336 INFO:teuthology.orchestra.run.smithi155.stdout: "description": "osd_op(client.4668.0:100245 5.e 5:71869c66:::benchmark_data_smithi006_114134_object100244:head [set-alloc-hint object_size 65536 write_size 65536,write 0~65536] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e37)", 2023-08-01T19:56:24.336 INFO:teuthology.orchestra.run.smithi155.stdout: "initiated_at": "2023-08-01T19:55:05.150991+0000", 2023-08-01T19:56:24.337 INFO:teuthology.orchestra.run.smithi155.stdout: "age": 79.153018438000004, 2023-08-01T19:56:24.337 INFO:teuthology.orchestra.run.smithi155.stdout: "duration": 0.070734490999999997, 2023-08-01T19:56:24.337 INFO:teuthology.orchestra.run.smithi155.stdout: "type_data": { 2023-08-01T19:56:24.337 INFO:teuthology.orchestra.run.smithi155.stdout: "flag_point": "commit sent; apply or cleanup", 2023-08-01T19:56:24.337 INFO:teuthology.orchestra.run.smithi155.stdout: "client_info": { 2023-08-01T19:56:24.337 INFO:teuthology.orchestra.run.smithi155.stdout: "client": "client.4668", 2023-08-01T19:56:24.337 INFO:teuthology.orchestra.run.smithi155.stdout: "client_addr": "172.21.15.6:0/1709472247", 2023-08-01T19:56:24.337 INFO:teuthology.orchestra.run.smithi155.stdout: "tid": 100245 2023-08-01T19:56:24.338 INFO:teuthology.orchestra.run.smithi155.stdout: }, 2023-08-01T19:56:24.338 INFO:teuthology.orchestra.run.smithi155.stdout: "events": [ 2023-08-01T19:56:24.338 INFO:teuthology.orchestra.run.smithi155.stdout: { 2023-08-01T19:56:24.338 INFO:teuthology.orchestra.run.smithi155.stdout: "event": "initiated", 2023-08-01T19:56:24.338 INFO:teuthology.orchestra.run.smithi155.stdout: "time": "2023-08-01T19:55:05.150991+0000", 2023-08-01T19:56:24.338 INFO:teuthology.orchestra.run.smithi155.stdout: "duration": 0 2023-08-01T19:56:24.338 INFO:teuthology.orchestra.run.smithi155.stdout: }, 2023-08-01T19:56:24.339 INFO:teuthology.orchestra.run.smithi155.stdout: { 2023-08-01T19:56:24.339 INFO:teuthology.orchestra.run.smithi155.stdout: "event": "throttled", 2023-08-01T19:56:24.339 INFO:teuthology.orchestra.run.smithi155.stdout: "time": "2023-08-01T19:55:05.150991+0000", 2023-08-01T19:56:24.339 INFO:teuthology.orchestra.run.smithi155.stdout: "duration": 0 2023-08-01T19:56:24.339 INFO:teuthology.orchestra.run.smithi155.stdout: }, 2023-08-01T19:56:24.339 INFO:teuthology.orchestra.run.smithi155.stdout: { 2023-08-01T19:56:24.339 INFO:teuthology.orchestra.run.smithi155.stdout: "event": "header_read", 2023-08-01T19:56:24.339 INFO:teuthology.orchestra.run.smithi155.stdout: "time": "2023-08-01T19:55:05.150990+0000", 2023-08-01T19:56:24.340 INFO:teuthology.orchestra.run.smithi155.stdout: "duration": 4294967295.999999 2023-08-01T19:56:24.340 INFO:teuthology.orchestra.run.smithi155.stdout: }, 2023-08-01T19:56:24.340 INFO:teuthology.orchestra.run.smithi155.stdout: { 2023-08-01T19:56:24.340 INFO:teuthology.orchestra.run.smithi155.stdout: "event": "all_read", 2023-08-01T19:56:24.340 INFO:teuthology.orchestra.run.smithi155.stdout: "time": "2023-08-01T19:55:05.151108+0000", 2023-08-01T19:56:24.340 INFO:teuthology.orchestra.run.smithi155.stdout: "duration": 0.00011849300000000001 2023-08-01T19:56:24.340 INFO:teuthology.orchestra.run.smithi155.stdout: }, 2023-08-01T19:56:24.340 INFO:teuthology.orchestra.run.smithi155.stdout: { 2023-08-01T19:56:24.341 INFO:teuthology.orchestra.run.smithi155.stdout: "event": "dispatched", 2023-08-01T19:56:24.341 INFO:teuthology.orchestra.run.smithi155.stdout: "time": "2023-08-01T19:55:05.151117+0000", 2023-08-01T19:56:24.341 INFO:teuthology.orchestra.run.smithi155.stdout: "duration": 8.1040000000000007e-06 2023-08-01T19:56:24.341 INFO:teuthology.orchestra.run.smithi155.stdout: }, 2023-08-01T19:56:24.341 INFO:teuthology.orchestra.run.smithi155.stdout: { 2023-08-01T19:56:24.341 INFO:teuthology.orchestra.run.smithi155.stdout: "event": "queued_for_pg", 2023-08-01T19:56:24.341 INFO:teuthology.orchestra.run.smithi155.stdout: "time": "2023-08-01T19:55:05.151121+0000", 2023-08-01T19:56:24.341 INFO:teuthology.orchestra.run.smithi155.stdout: "duration": 4.2019999999999997e-06 2023-08-01T19:56:24.342 INFO:teuthology.orchestra.run.smithi155.stdout: }, 2023-08-01T19:56:24.342 INFO:teuthology.orchestra.run.smithi155.stdout: { 2023-08-01T19:56:24.342 INFO:teuthology.orchestra.run.smithi155.stdout: "event": "reached_pg", 2023-08-01T19:56:24.342 INFO:teuthology.orchestra.run.smithi155.stdout: "time": "2023-08-01T19:55:05.151162+0000", 2023-08-01T19:56:24.342 INFO:teuthology.orchestra.run.smithi155.stdout: "duration": 4.1448e-05 2023-08-01T19:56:24.342 INFO:teuthology.orchestra.run.smithi155.stdout: }, 2023-08-01T19:56:24.342 INFO:teuthology.orchestra.run.smithi155.stdout: { 2023-08-01T19:56:24.343 INFO:teuthology.orchestra.run.smithi155.stdout: "event": "started", 2023-08-01T19:56:24.343 INFO:teuthology.orchestra.run.smithi155.stdout: "time": "2023-08-01T19:55:05.151281+0000", 2023-08-01T19:56:24.343 INFO:teuthology.orchestra.run.smithi155.stdout: "duration": 0.000119141 2023-08-01T19:56:24.343 INFO:teuthology.orchestra.run.smithi155.stdout: }, 2023-08-01T19:56:24.343 INFO:teuthology.orchestra.run.smithi155.stdout: { 2023-08-01T19:56:24.343 INFO:teuthology.orchestra.run.smithi155.stdout: "event": "waiting for subops from 0", 2023-08-01T19:56:24.343 INFO:teuthology.orchestra.run.smithi155.stdout: "time": "2023-08-01T19:55:05.151443+0000", 2023-08-01T19:56:24.344 INFO:teuthology.orchestra.run.smithi155.stdout: "duration": 0.00016181600000000001 2023-08-01T19:56:24.344 INFO:teuthology.orchestra.run.smithi155.stdout: }, 2023-08-01T19:56:24.344 INFO:teuthology.orchestra.run.smithi155.stdout: { 2023-08-01T19:56:24.344 INFO:teuthology.orchestra.run.smithi155.stdout: "event": "sub_op_commit_rec", 2023-08-01T19:56:24.344 INFO:teuthology.orchestra.run.smithi155.stdout: "time": "2023-08-01T19:55:05.219101+0000", 2023-08-01T19:56:24.344 INFO:teuthology.orchestra.run.smithi155.stdout: "duration": 0.067658037000000004 2023-08-01T19:56:24.344 INFO:teuthology.orchestra.run.smithi155.stdout: }, 2023-08-01T19:56:24.344 INFO:teuthology.orchestra.run.smithi155.stdout: { 2023-08-01T19:56:24.345 INFO:teuthology.orchestra.run.smithi155.stdout: "event": "op_commit", 2023-08-01T19:56:24.345 INFO:teuthology.orchestra.run.smithi155.stdout: "time": "2023-08-01T19:55:05.221646+0000", 2023-08-01T19:56:24.345 INFO:teuthology.orchestra.run.smithi155.stdout: "duration": 0.0025450540000000002 2023-08-01T19:56:24.345 INFO:teuthology.orchestra.run.smithi155.stdout: }, 2023-08-01T19:56:24.345 INFO:teuthology.orchestra.run.smithi155.stdout: { 2023-08-01T19:56:24.345 INFO:teuthology.orchestra.run.smithi155.stdout: "event": "commit_sent", 2023-08-01T19:56:24.345 INFO:teuthology.orchestra.run.smithi155.stdout: "time": "2023-08-01T19:55:05.221689+0000", 2023-08-01T19:56:24.345 INFO:teuthology.orchestra.run.smithi155.stdout: "duration": 4.3078999999999999e-05 2023-08-01T19:56:24.346 INFO:teuthology.orchestra.run.smithi155.stdout: }, 2023-08-01T19:56:24.346 INFO:teuthology.orchestra.run.smithi155.stdout: { 2023-08-01T19:56:24.346 INFO:teuthology.orchestra.run.smithi155.stdout: "event": "done", 2023-08-01T19:56:24.346 INFO:teuthology.orchestra.run.smithi155.stdout: "time": "2023-08-01T19:55:05.221725+0000", 2023-08-01T19:56:24.346 INFO:teuthology.orchestra.run.smithi155.stdout: "duration": 3.6137999999999999e-05 2023-08-01T19:56:24.346 INFO:teuthology.orchestra.run.smithi155.stdout: } 2023-08-01T19:56:24.346 INFO:teuthology.orchestra.run.smithi155.stdout: ] 2023-08-01T19:56:24.346 INFO:teuthology.orchestra.run.smithi155.stdout: } 2023-08-01T19:56:24.347 INFO:teuthology.orchestra.run.smithi155.stdout: }, 2023-08-01T19:56:24.347 INFO:teuthology.orchestra.run.smithi155.stdout: { 2023-08-01T19:56:24.347 INFO:teuthology.orchestra.run.smithi155.stdout: "description": "osd_repop(client.4668.0:100243 5.a e37/19 5:5e8193b6:::benchmark_data_smithi006_114134_object100242:head v 37'6228, mlcod=37'6225)", 2023-08-01T19:56:24.347 INFO:teuthology.orchestra.run.smithi155.stdout: "initiated_at": "2023-08-01T19:55:05.151148+0000", 2023-08-01T19:56:24.347 INFO:teuthology.orchestra.run.smithi155.stdout: "age": 79.152861427000005, 2023-08-01T19:56:24.347 INFO:teuthology.orchestra.run.smithi155.stdout: "duration": 0.073020370000000001, 2023-08-01T19:56:24.347 INFO:teuthology.orchestra.run.smithi155.stdout: "type_data": { 2023-08-01T19:56:24.348 INFO:teuthology.orchestra.run.smithi155.stdout: "flag_point": "commit sent; apply or cleanup", 2023-08-01T19:56:24.348 INFO:teuthology.orchestra.run.smithi155.stdout: "events": [ 2023-08-01T19:56:24.348 INFO:teuthology.orchestra.run.smithi155.stdout: { 2023-08-01T19:56:24.348 INFO:teuthology.orchestra.run.smithi155.stdout: "event": "initiated", 2023-08-01T19:56:24.348 INFO:teuthology.orchestra.run.smithi155.stdout: "time": "2023-08-01T19:55:05.151148+0000", 2023-08-01T19:56:24.348 INFO:teuthology.orchestra.run.smithi155.stdout: "duration": 0 2023-08-01T19:56:24.348 INFO:teuthology.orchestra.run.smithi155.stdout: }, 2023-08-01T19:56:24.348 INFO:teuthology.orchestra.run.smithi155.stdout: { 2023-08-01T19:56:24.349 INFO:teuthology.orchestra.run.smithi155.stdout: "event": "throttled", 2023-08-01T19:56:24.349 INFO:teuthology.orchestra.run.smithi155.stdout: "time": "2023-08-01T19:55:05.151148+0000", 2023-08-01T19:56:24.349 INFO:teuthology.orchestra.run.smithi155.stdout: "duration": 0 2023-08-01T19:56:24.349 INFO:teuthology.orchestra.run.smithi155.stdout: }, 2023-08-01T19:56:24.349 INFO:teuthology.orchestra.run.smithi155.stdout: { 2023-08-01T19:56:24.349 INFO:teuthology.orchestra.run.smithi155.stdout: "event": "header_read", 2023-08-01T19:56:24.349 INFO:teuthology.orchestra.run.smithi155.stdout: "time": "2023-08-01T19:55:05.151147+0000", 2023-08-01T19:56:24.349 INFO:teuthology.orchestra.run.smithi155.stdout: "duration": 4294967295.9999995 2023-08-01T19:56:24.350 INFO:teuthology.orchestra.run.smithi155.stdout: }, 2023-08-01T19:56:24.350 INFO:teuthology.orchestra.run.smithi155.stdout: { 2023-08-01T19:56:24.350 INFO:teuthology.orchestra.run.smithi155.stdout: "event": "all_read", 2023-08-01T19:56:24.350 INFO:teuthology.orchestra.run.smithi155.stdout: "time": "2023-08-01T19:55:05.151231+0000", 2023-08-01T19:56:24.350 INFO:teuthology.orchestra.run.smithi155.stdout: "duration": 8.3135999999999998e-05 2023-08-01T19:56:24.350 INFO:teuthology.orchestra.run.smithi155.stdout: }, 2023-08-01T19:56:24.350 INFO:teuthology.orchestra.run.smithi155.stdout: { 2023-08-01T19:56:24.350 INFO:teuthology.orchestra.run.smithi155.stdout: "event": "dispatched", 2023-08-01T19:56:24.351 INFO:teuthology.orchestra.run.smithi155.stdout: "time": "2023-08-01T19:55:05.151239+0000", 2023-08-01T19:56:24.351 INFO:teuthology.orchestra.run.smithi155.stdout: "duration": 8.7469999999999994e-06 2023-08-01T19:56:24.351 INFO:teuthology.orchestra.run.smithi155.stdout: }, 2023-08-01T19:56:24.351 INFO:teuthology.orchestra.run.smithi155.stdout: { 2023-08-01T19:56:24.351 INFO:teuthology.orchestra.run.smithi155.stdout: "event": "queued_for_pg", 2023-08-01T19:56:24.351 INFO:teuthology.orchestra.run.smithi155.stdout: "time": "2023-08-01T19:55:05.151244+0000", 2023-08-01T19:56:24.351 INFO:teuthology.orchestra.run.smithi155.stdout: "duration": 4.4800000000000003e-06 2023-08-01T19:56:24.351 INFO:teuthology.orchestra.run.smithi155.stdout: }, 2023-08-01T19:56:24.352 INFO:teuthology.orchestra.run.smithi155.stdout: { 2023-08-01T19:56:24.352 INFO:teuthology.orchestra.run.smithi155.stdout: "event": "reached_pg", 2023-08-01T19:56:24.352 INFO:teuthology.orchestra.run.smithi155.stdout: "time": "2023-08-01T19:55:05.152938+0000", 2023-08-01T19:56:24.352 INFO:teuthology.orchestra.run.smithi155.stdout: "duration": 0.001693824 2023-08-01T19:56:24.352 INFO:teuthology.orchestra.run.smithi155.stdout: }, 2023-08-01T19:56:24.352 INFO:teuthology.orchestra.run.smithi155.stdout: { 2023-08-01T19:56:24.352 INFO:teuthology.orchestra.run.smithi155.stdout: "event": "started", 2023-08-01T19:56:24.353 INFO:teuthology.orchestra.run.smithi155.stdout: "time": "2023-08-01T19:55:05.152956+0000", 2023-08-01T19:56:24.353 INFO:teuthology.orchestra.run.smithi155.stdout: "duration": 1.8287e-05 2023-08-01T19:56:24.353 INFO:teuthology.orchestra.run.smithi155.stdout: }, 2023-08-01T19:56:24.353 INFO:teuthology.orchestra.run.smithi155.stdout: { 2023-08-01T19:56:24.353 INFO:teuthology.orchestra.run.smithi155.stdout: "event": "commit_sent", 2023-08-01T19:56:24.353 INFO:teuthology.orchestra.run.smithi155.stdout: "time": "2023-08-01T19:55:05.224145+0000", 2023-08-01T19:56:24.353 INFO:teuthology.orchestra.run.smithi155.stdout: "duration": 0.071189447000000003 2023-08-01T19:56:24.353 INFO:teuthology.orchestra.run.smithi155.stdout: }, 2023-08-01T19:56:24.354 INFO:teuthology.orchestra.run.smithi155.stdout: { 2023-08-01T19:56:24.354 INFO:teuthology.orchestra.run.smithi155.stdout: "event": "done", 2023-08-01T19:56:24.354 INFO:teuthology.orchestra.run.smithi155.stdout: "time": "2023-08-01T19:55:05.224168+0000", 2023-08-01T19:56:24.354 INFO:teuthology.orchestra.run.smithi155.stdout: "duration": 2.3008999999999999e-05 2023-08-01T19:56:24.354 INFO:teuthology.orchestra.run.smithi155.stdout: } 2023-08-01T19:56:24.354 INFO:teuthology.orchestra.run.smithi155.stdout: ] 2023-08-01T19:56:24.354 INFO:teuthology.orchestra.run.smithi155.stdout: } 2023-08-01T19:56:24.354 INFO:teuthology.orchestra.run.smithi155.stdout: }, 2023-08-01T19:56:24.355 INFO:teuthology.orchestra.run.smithi155.stdout: { 2023-08-01T19:56:24.355 INFO:teuthology.orchestra.run.smithi155.stdout: "description": "osd_repop(client.4668.0:100244 5.9 e37/19 5:92f56a12:::benchmark_data_smithi006_114134_object100243:head v 37'6294, mlcod=37'6292)", 2023-08-01T19:56:24.355 INFO:teuthology.orchestra.run.smithi155.stdout: "initiated_at": "2023-08-01T19:55:05.151325+0000", 2023-08-01T19:56:24.355 INFO:teuthology.orchestra.run.smithi155.stdout: "age": 79.152684081999993, 2023-08-01T19:56:24.355 INFO:teuthology.orchestra.run.smithi155.stdout: "duration": 0.071883673999999995, 2023-08-01T19:56:24.355 INFO:teuthology.orchestra.run.smithi155.stdout: "type_data": { 2023-08-01T19:56:24.355 INFO:teuthology.orchestra.run.smithi155.stdout: "flag_point": "commit sent; apply or cleanup", 2023-08-01T19:56:24.355 INFO:teuthology.orchestra.run.smithi155.stdout: "events": [ 2023-08-01T19:56:24.356 INFO:teuthology.orchestra.run.smithi155.stdout: { 2023-08-01T19:56:24.356 INFO:teuthology.orchestra.run.smithi155.stdout: "event": "initiated", 2023-08-01T19:56:24.356 INFO:teuthology.orchestra.run.smithi155.stdout: "time": "2023-08-01T19:55:05.151325+0000", 2023-08-01T19:56:24.356 INFO:teuthology.orchestra.run.smithi155.stdout: "duration": 0 2023-08-01T19:56:24.356 INFO:teuthology.orchestra.run.smithi155.stdout: }, 2023-08-01T19:56:24.356 INFO:teuthology.orchestra.run.smithi155.stdout: { 2023-08-01T19:56:24.356 INFO:teuthology.orchestra.run.smithi155.stdout: "event": "throttled", 2023-08-01T19:56:24.357 INFO:teuthology.orchestra.run.smithi155.stdout: "time": "2023-08-01T19:55:05.151325+0000", 2023-08-01T19:56:24.357 INFO:teuthology.orchestra.run.smithi155.stdout: "duration": 0 2023-08-01T19:56:24.357 INFO:teuthology.orchestra.run.smithi155.stdout: }, 2023-08-01T19:56:24.357 INFO:teuthology.orchestra.run.smithi155.stdout: { 2023-08-01T19:56:24.357 INFO:teuthology.orchestra.run.smithi155.stdout: "event": "header_read", 2023-08-01T19:56:24.357 INFO:teuthology.orchestra.run.smithi155.stdout: "time": "2023-08-01T19:55:05.151325+0000", 2023-08-01T19:56:24.357 INFO:teuthology.orchestra.run.smithi155.stdout: "duration": 4294967295.9999995 2023-08-01T19:56:24.357 INFO:teuthology.orchestra.run.smithi155.stdout: }, 2023-08-01T19:56:24.358 INFO:teuthology.orchestra.run.smithi155.stdout: { 2023-08-01T19:56:24.358 INFO:teuthology.orchestra.run.smithi155.stdout: "event": "all_read", 2023-08-01T19:56:24.358 INFO:teuthology.orchestra.run.smithi155.stdout: "time": "2023-08-01T19:55:05.151390+0000", 2023-08-01T19:56:24.358 INFO:teuthology.orchestra.run.smithi155.stdout: "duration": 6.5456999999999993e-05 2023-08-01T19:56:24.358 INFO:teuthology.orchestra.run.smithi155.stdout: }, 2023-08-01T19:56:24.358 INFO:teuthology.orchestra.run.smithi155.stdout: { 2023-08-01T19:56:24.358 INFO:teuthology.orchestra.run.smithi155.stdout: "event": "dispatched", 2023-08-01T19:56:24.358 INFO:teuthology.orchestra.run.smithi155.stdout: "time": "2023-08-01T19:55:05.151396+0000", 2023-08-01T19:56:24.359 INFO:teuthology.orchestra.run.smithi155.stdout: "duration": 5.9190000000000004e-06 2023-08-01T19:56:24.359 INFO:teuthology.orchestra.run.smithi155.stdout: }, 2023-08-01T19:56:24.359 INFO:teuthology.orchestra.run.smithi155.stdout: { 2023-08-01T19:56:24.359 INFO:teuthology.orchestra.run.smithi155.stdout: "event": "queued_for_pg", 2023-08-01T19:56:24.359 INFO:teuthology.orchestra.run.smithi155.stdout: "time": "2023-08-01T19:55:05.151400+0000", 2023-08-01T19:56:24.359 INFO:teuthology.orchestra.run.smithi155.stdout: "duration": 4.1030000000000004e-06 2023-08-01T19:56:24.359 INFO:teuthology.orchestra.run.smithi155.stdout: }, 2023-08-01T19:56:24.359 INFO:teuthology.orchestra.run.smithi155.stdout: { 2023-08-01T19:56:24.360 INFO:teuthology.orchestra.run.smithi155.stdout: "event": "reached_pg", 2023-08-01T19:56:24.360 INFO:teuthology.orchestra.run.smithi155.stdout: "time": "2023-08-01T19:55:05.151452+0000", 2023-08-01T19:56:24.360 INFO:teuthology.orchestra.run.smithi155.stdout: "duration": 5.2136999999999999e-05 2023-08-01T19:56:24.360 INFO:teuthology.orchestra.run.smithi155.stdout: }, 2023-08-01T19:56:24.360 INFO:teuthology.orchestra.run.smithi155.stdout: { 2023-08-01T19:56:24.360 INFO:teuthology.orchestra.run.smithi155.stdout: "event": "started", 2023-08-01T19:56:24.360 INFO:teuthology.orchestra.run.smithi155.stdout: "time": "2023-08-01T19:55:05.151470+0000", 2023-08-01T19:56:24.361 INFO:teuthology.orchestra.run.smithi155.stdout: "duration": 1.8e-05 2023-08-01T19:56:24.361 INFO:teuthology.orchestra.run.smithi155.stdout: }, 2023-08-01T19:56:24.361 INFO:teuthology.orchestra.run.smithi155.stdout: { 2023-08-01T19:56:24.361 INFO:teuthology.orchestra.run.smithi155.stdout: "event": "commit_sent", 2023-08-01T19:56:24.361 INFO:teuthology.orchestra.run.smithi155.stdout: "time": "2023-08-01T19:55:05.223183+0000", 2023-08-01T19:56:24.361 INFO:teuthology.orchestra.run.smithi155.stdout: "duration": 0.071712622000000004 2023-08-01T19:56:24.361 INFO:teuthology.orchestra.run.smithi155.stdout: }, 2023-08-01T19:56:24.361 INFO:teuthology.orchestra.run.smithi155.stdout: { 2023-08-01T19:56:24.362 INFO:teuthology.orchestra.run.smithi155.stdout: "event": "done", 2023-08-01T19:56:24.362 INFO:teuthology.orchestra.run.smithi155.stdout: "time": "2023-08-01T19:55:05.223209+0000", 2023-08-01T19:56:24.362 INFO:teuthology.orchestra.run.smithi155.stdout: "duration": 2.5956e-05 2023-08-01T19:56:24.362 INFO:teuthology.orchestra.run.smithi155.stdout: } 2023-08-01T19:56:24.362 INFO:teuthology.orchestra.run.smithi155.stdout: ] 2023-08-01T19:56:24.362 INFO:teuthology.orchestra.run.smithi155.stdout: } 2023-08-01T19:56:24.362 INFO:teuthology.orchestra.run.smithi155.stdout: }, 2023-08-01T19:56:24.362 INFO:teuthology.orchestra.run.smithi155.stdout: { 2023-08-01T19:56:24.363 INFO:teuthology.orchestra.run.smithi155.stdout: "description": "osd_op(client.4668.0:100249 5.b 5:d0666827:::benchmark_data_smithi006_114134_object100248:head [set-alloc-hint object_size 65536 write_size 65536,write 0~65536] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e37)", 2023-08-01T19:56:24.363 INFO:teuthology.orchestra.run.smithi155.stdout: "initiated_at": "2023-08-01T19:55:05.153614+0000", 2023-08-01T19:56:24.363 INFO:teuthology.orchestra.run.smithi155.stdout: "age": 79.150395657000004, 2023-08-01T19:56:24.363 INFO:teuthology.orchestra.run.smithi155.stdout: "duration": 0.069286118999999993, 2023-08-01T19:56:24.363 INFO:teuthology.orchestra.run.smithi155.stdout: "type_data": { 2023-08-01T19:56:24.363 INFO:teuthology.orchestra.run.smithi155.stdout: "flag_point": "commit sent; apply or cleanup", 2023-08-01T19:56:24.363 INFO:teuthology.orchestra.run.smithi155.stdout: "client_info": { 2023-08-01T19:56:24.364 INFO:teuthology.orchestra.run.smithi155.stdout: "client": "client.4668", 2023-08-01T19:56:24.364 INFO:teuthology.orchestra.run.smithi155.stdout: "client_addr": "172.21.15.6:0/1709472247", 2023-08-01T19:56:24.364 INFO:teuthology.orchestra.run.smithi155.stdout: "tid": 100249 2023-08-01T19:56:24.364 INFO:teuthology.orchestra.run.smithi155.stdout: }, 2023-08-01T19:56:24.364 INFO:teuthology.orchestra.run.smithi155.stdout: "events": [ 2023-08-01T19:56:24.364 INFO:teuthology.orchestra.run.smithi155.stdout: { 2023-08-01T19:56:24.364 INFO:teuthology.orchestra.run.smithi155.stdout: "event": "initiated", 2023-08-01T19:56:24.364 INFO:teuthology.orchestra.run.smithi155.stdout: "time": "2023-08-01T19:55:05.153614+0000", 2023-08-01T19:56:24.365 INFO:teuthology.orchestra.run.smithi155.stdout: "duration": 0 2023-08-01T19:56:24.365 INFO:teuthology.orchestra.run.smithi155.stdout: }, 2023-08-01T19:56:24.365 INFO:teuthology.orchestra.run.smithi155.stdout: { 2023-08-01T19:56:24.365 INFO:teuthology.orchestra.run.smithi155.stdout: "event": "throttled", 2023-08-01T19:56:24.365 INFO:teuthology.orchestra.run.smithi155.stdout: "time": "2023-08-01T19:55:05.153614+0000", 2023-08-01T19:56:24.365 INFO:teuthology.orchestra.run.smithi155.stdout: "duration": 0 2023-08-01T19:56:24.365 INFO:teuthology.orchestra.run.smithi155.stdout: }, 2023-08-01T19:56:24.365 INFO:teuthology.orchestra.run.smithi155.stdout: { 2023-08-01T19:56:24.366 INFO:teuthology.orchestra.run.smithi155.stdout: "event": "header_read", 2023-08-01T19:56:24.366 INFO:teuthology.orchestra.run.smithi155.stdout: "time": "2023-08-01T19:55:05.153612+0000", 2023-08-01T19:56:24.366 INFO:teuthology.orchestra.run.smithi155.stdout: "duration": 4294967295.9999986 2023-08-01T19:56:24.366 INFO:teuthology.orchestra.run.smithi155.stdout: }, 2023-08-01T19:56:24.366 INFO:teuthology.orchestra.run.smithi155.stdout: { 2023-08-01T19:56:24.366 INFO:teuthology.orchestra.run.smithi155.stdout: "event": "all_read", 2023-08-01T19:56:24.366 INFO:teuthology.orchestra.run.smithi155.stdout: "time": "2023-08-01T19:55:05.153694+0000", 2023-08-01T19:56:24.366 INFO:teuthology.orchestra.run.smithi155.stdout: "duration": 8.1618000000000004e-05 2023-08-01T19:56:24.367 INFO:teuthology.orchestra.run.smithi155.stdout: }, 2023-08-01T19:56:24.367 INFO:teuthology.orchestra.run.smithi155.stdout: { 2023-08-01T19:56:24.367 INFO:teuthology.orchestra.run.smithi155.stdout: "event": "dispatched", 2023-08-01T19:56:24.367 INFO:teuthology.orchestra.run.smithi155.stdout: "time": "2023-08-01T19:55:05.153713+0000", 2023-08-01T19:56:24.367 INFO:teuthology.orchestra.run.smithi155.stdout: "duration": 1.9069999999999999e-05 2023-08-01T19:56:24.367 INFO:teuthology.orchestra.run.smithi155.stdout: }, 2023-08-01T19:56:24.367 INFO:teuthology.orchestra.run.smithi155.stdout: { 2023-08-01T19:56:24.367 INFO:teuthology.orchestra.run.smithi155.stdout: "event": "queued_for_pg", 2023-08-01T19:56:24.368 INFO:teuthology.orchestra.run.smithi155.stdout: "time": "2023-08-01T19:55:05.153726+0000", 2023-08-01T19:56:24.368 INFO:teuthology.orchestra.run.smithi155.stdout: "duration": 1.238e-05 2023-08-01T19:56:24.368 INFO:teuthology.orchestra.run.smithi155.stdout: }, 2023-08-01T19:56:24.368 INFO:teuthology.orchestra.run.smithi155.stdout: { 2023-08-01T19:56:24.368 INFO:teuthology.orchestra.run.smithi155.stdout: "event": "reached_pg", 2023-08-01T19:56:24.368 INFO:teuthology.orchestra.run.smithi155.stdout: "time": "2023-08-01T19:55:05.153761+0000", 2023-08-01T19:56:24.368 INFO:teuthology.orchestra.run.smithi155.stdout: "duration": 3.5046999999999998e-05 2023-08-01T19:56:24.369 INFO:teuthology.orchestra.run.smithi155.stdout: }, 2023-08-01T19:56:24.369 INFO:teuthology.orchestra.run.smithi155.stdout: { 2023-08-01T19:56:24.369 INFO:teuthology.orchestra.run.smithi155.stdout: "event": "started", 2023-08-01T19:56:24.369 INFO:teuthology.orchestra.run.smithi155.stdout: "time": "2023-08-01T19:55:05.153896+0000", 2023-08-01T19:56:24.369 INFO:teuthology.orchestra.run.smithi155.stdout: "duration": 0.00013575800000000001 2023-08-01T19:56:24.369 INFO:teuthology.orchestra.run.smithi155.stdout: }, 2023-08-01T19:56:24.369 INFO:teuthology.orchestra.run.smithi155.stdout: { 2023-08-01T19:56:24.369 INFO:teuthology.orchestra.run.smithi155.stdout: "event": "waiting for subops from 0", 2023-08-01T19:56:24.370 INFO:teuthology.orchestra.run.smithi155.stdout: "time": "2023-08-01T19:55:05.154043+0000", 2023-08-01T19:56:24.370 INFO:teuthology.orchestra.run.smithi155.stdout: "duration": 0.00014650700000000001 2023-08-01T19:56:24.370 INFO:teuthology.orchestra.run.smithi155.stdout: }, 2023-08-01T19:56:24.370 INFO:teuthology.orchestra.run.smithi155.stdout: { 2023-08-01T19:56:24.370 INFO:teuthology.orchestra.run.smithi155.stdout: "event": "sub_op_commit_rec", 2023-08-01T19:56:24.370 INFO:teuthology.orchestra.run.smithi155.stdout: "time": "2023-08-01T19:55:05.221876+0000", 2023-08-01T19:56:24.370 INFO:teuthology.orchestra.run.smithi155.stdout: "duration": 0.067832796000000001 2023-08-01T19:56:24.371 INFO:teuthology.orchestra.run.smithi155.stdout: }, 2023-08-01T19:56:24.371 INFO:teuthology.orchestra.run.smithi155.stdout: { 2023-08-01T19:56:24.371 INFO:teuthology.orchestra.run.smithi155.stdout: "event": "op_commit", 2023-08-01T19:56:24.371 INFO:teuthology.orchestra.run.smithi155.stdout: "time": "2023-08-01T19:55:05.222813+0000", 2023-08-01T19:56:24.371 INFO:teuthology.orchestra.run.smithi155.stdout: "duration": 0.00093755300000000004 2023-08-01T19:56:24.371 INFO:teuthology.orchestra.run.smithi155.stdout: }, 2023-08-01T19:56:24.371 INFO:teuthology.orchestra.run.smithi155.stdout: { 2023-08-01T19:56:24.371 INFO:teuthology.orchestra.run.smithi155.stdout: "event": "commit_sent", 2023-08-01T19:56:24.372 INFO:teuthology.orchestra.run.smithi155.stdout: "time": "2023-08-01T19:55:05.222861+0000", 2023-08-01T19:56:24.372 INFO:teuthology.orchestra.run.smithi155.stdout: "duration": 4.8013999999999998e-05 2023-08-01T19:56:24.372 INFO:teuthology.orchestra.run.smithi155.stdout: }, 2023-08-01T19:56:24.372 INFO:teuthology.orchestra.run.smithi155.stdout: { 2023-08-01T19:56:24.372 INFO:teuthology.orchestra.run.smithi155.stdout: "event": "done", 2023-08-01T19:56:24.372 INFO:teuthology.orchestra.run.smithi155.stdout: "time": "2023-08-01T19:55:05.222900+0000", 2023-08-01T19:56:24.372 INFO:teuthology.orchestra.run.smithi155.stdout: "duration": 3.8634999999999999e-05 2023-08-01T19:56:24.372 INFO:teuthology.orchestra.run.smithi155.stdout: } 2023-08-01T19:56:24.373 INFO:teuthology.orchestra.run.smithi155.stdout: ] 2023-08-01T19:56:24.373 INFO:teuthology.orchestra.run.smithi155.stdout: } 2023-08-01T19:56:24.373 INFO:teuthology.orchestra.run.smithi155.stdout: }, 2023-08-01T19:56:24.373 INFO:teuthology.orchestra.run.smithi155.stdout: { 2023-08-01T19:56:24.373 INFO:teuthology.orchestra.run.smithi155.stdout: "description": "osd_op(client.4668.0:100251 5.b 5:d853df24:::benchmark_data_smithi006_114134_object100250:head [set-alloc-hint object_size 65536 write_size 65536,write 0~65536] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e37)", 2023-08-01T19:56:24.373 INFO:teuthology.orchestra.run.smithi155.stdout: "initiated_at": "2023-08-01T19:55:05.153737+0000", 2023-08-01T19:56:24.373 INFO:teuthology.orchestra.run.smithi155.stdout: "age": 79.150272642999994, 2023-08-01T19:56:24.373 INFO:teuthology.orchestra.run.smithi155.stdout: "duration": 0.071366545000000003, 2023-08-01T19:56:24.374 INFO:teuthology.orchestra.run.smithi155.stdout: "type_data": { 2023-08-01T19:56:24.374 INFO:teuthology.orchestra.run.smithi155.stdout: "flag_point": "commit sent; apply or cleanup", 2023-08-01T19:56:24.374 INFO:teuthology.orchestra.run.smithi155.stdout: "client_info": { 2023-08-01T19:56:24.374 INFO:teuthology.orchestra.run.smithi155.stdout: "client": "client.4668", 2023-08-01T19:56:24.374 INFO:teuthology.orchestra.run.smithi155.stdout: "client_addr": "172.21.15.6:0/1709472247", 2023-08-01T19:56:24.374 INFO:teuthology.orchestra.run.smithi155.stdout: "tid": 100251 2023-08-01T19:56:24.374 INFO:teuthology.orchestra.run.smithi155.stdout: }, 2023-08-01T19:56:24.375 INFO:teuthology.orchestra.run.smithi155.stdout: "events": [ 2023-08-01T19:56:24.375 INFO:teuthology.orchestra.run.smithi155.stdout: { 2023-08-01T19:56:24.375 INFO:teuthology.orchestra.run.smithi155.stdout: "event": "initiated", 2023-08-01T19:56:24.375 INFO:teuthology.orchestra.run.smithi155.stdout: "time": "2023-08-01T19:55:05.153737+0000", 2023-08-01T19:56:24.375 INFO:teuthology.orchestra.run.smithi155.stdout: "duration": 0 2023-08-01T19:56:24.375 INFO:teuthology.orchestra.run.smithi155.stdout: }, 2023-08-01T19:56:24.375 INFO:teuthology.orchestra.run.smithi155.stdout: { 2023-08-01T19:56:24.376 INFO:teuthology.orchestra.run.smithi155.stdout: "event": "throttled", 2023-08-01T19:56:24.376 INFO:teuthology.orchestra.run.smithi155.stdout: "time": "2023-08-01T19:55:05.153737+0000", 2023-08-01T19:56:24.376 INFO:teuthology.orchestra.run.smithi155.stdout: "duration": 0 2023-08-01T19:56:24.376 INFO:teuthology.orchestra.run.smithi155.stdout: }, 2023-08-01T19:56:24.376 INFO:teuthology.orchestra.run.smithi155.stdout: { 2023-08-01T19:56:24.376 INFO:teuthology.orchestra.run.smithi155.stdout: "event": "header_read", 2023-08-01T19:56:24.376 INFO:teuthology.orchestra.run.smithi155.stdout: "time": "2023-08-01T19:55:05.153736+0000", 2023-08-01T19:56:24.376 INFO:teuthology.orchestra.run.smithi155.stdout: "duration": 4294967295.9999995 2023-08-01T19:56:24.377 INFO:teuthology.orchestra.run.smithi155.stdout: }, 2023-08-01T19:56:24.377 INFO:teuthology.orchestra.run.smithi155.stdout: { 2023-08-01T19:56:24.377 INFO:teuthology.orchestra.run.smithi155.stdout: "event": "all_read", 2023-08-01T19:56:24.377 INFO:teuthology.orchestra.run.smithi155.stdout: "time": "2023-08-01T19:55:05.153784+0000", 2023-08-01T19:56:24.377 INFO:teuthology.orchestra.run.smithi155.stdout: "duration": 4.7660000000000001e-05 2023-08-01T19:56:24.377 INFO:teuthology.orchestra.run.smithi155.stdout: }, 2023-08-01T19:56:24.377 INFO:teuthology.orchestra.run.smithi155.stdout: { 2023-08-01T19:56:24.377 INFO:teuthology.orchestra.run.smithi155.stdout: "event": "dispatched", 2023-08-01T19:56:24.378 INFO:teuthology.orchestra.run.smithi155.stdout: "time": "2023-08-01T19:55:05.153793+0000", 2023-08-01T19:56:24.378 INFO:teuthology.orchestra.run.smithi155.stdout: "duration": 8.7150000000000004e-06 2023-08-01T19:56:24.378 INFO:teuthology.orchestra.run.smithi155.stdout: }, 2023-08-01T19:56:24.378 INFO:teuthology.orchestra.run.smithi155.stdout: { 2023-08-01T19:56:24.378 INFO:teuthology.orchestra.run.smithi155.stdout: "event": "queued_for_pg", 2023-08-01T19:56:24.378 INFO:teuthology.orchestra.run.smithi155.stdout: "time": "2023-08-01T19:55:05.153800+0000", 2023-08-01T19:56:24.378 INFO:teuthology.orchestra.run.smithi155.stdout: "duration": 7.2459999999999997e-06 2023-08-01T19:56:24.378 INFO:teuthology.orchestra.run.smithi155.stdout: }, 2023-08-01T19:56:24.379 INFO:teuthology.orchestra.run.smithi155.stdout: { 2023-08-01T19:56:24.379 INFO:teuthology.orchestra.run.smithi155.stdout: "event": "reached_pg", 2023-08-01T19:56:24.379 INFO:teuthology.orchestra.run.smithi155.stdout: "time": "2023-08-01T19:55:05.156241+0000", 2023-08-01T19:56:24.379 INFO:teuthology.orchestra.run.smithi155.stdout: "duration": 0.0024415359999999998 2023-08-01T19:56:24.379 INFO:teuthology.orchestra.run.smithi155.stdout: }, 2023-08-01T19:56:24.379 INFO:teuthology.orchestra.run.smithi155.stdout: { 2023-08-01T19:56:24.379 INFO:teuthology.orchestra.run.smithi155.stdout: "event": "started", 2023-08-01T19:56:24.380 INFO:teuthology.orchestra.run.smithi155.stdout: "time": "2023-08-01T19:55:05.219045+0000", 2023-08-01T19:56:24.380 INFO:teuthology.orchestra.run.smithi155.stdout: "duration": 0.062803855000000006 2023-08-01T19:56:24.380 INFO:teuthology.orchestra.run.smithi155.stdout: }, 2023-08-01T19:56:24.380 INFO:teuthology.orchestra.run.smithi155.stdout: { 2023-08-01T19:56:24.380 INFO:teuthology.orchestra.run.smithi155.stdout: "event": "waiting for subops from 0", 2023-08-01T19:56:24.380 INFO:teuthology.orchestra.run.smithi155.stdout: "time": "2023-08-01T19:55:05.219238+0000", 2023-08-01T19:56:24.380 INFO:teuthology.orchestra.run.smithi155.stdout: "duration": 0.00019241500000000001 2023-08-01T19:56:24.380 INFO:teuthology.orchestra.run.smithi155.stdout: }, 2023-08-01T19:56:24.381 INFO:teuthology.orchestra.run.smithi155.stdout: { 2023-08-01T19:56:24.381 INFO:teuthology.orchestra.run.smithi155.stdout: "event": "sub_op_commit_rec", 2023-08-01T19:56:24.381 INFO:teuthology.orchestra.run.smithi155.stdout: "time": "2023-08-01T19:55:05.223300+0000", 2023-08-01T19:56:24.381 INFO:teuthology.orchestra.run.smithi155.stdout: "duration": 0.0040626509999999996 2023-08-01T19:56:24.381 INFO:teuthology.orchestra.run.smithi155.stdout: }, 2023-08-01T19:56:24.381 INFO:teuthology.orchestra.run.smithi155.stdout: { 2023-08-01T19:56:24.381 INFO:teuthology.orchestra.run.smithi155.stdout: "event": "op_commit", 2023-08-01T19:56:24.381 INFO:teuthology.orchestra.run.smithi155.stdout: "time": "2023-08-01T19:55:05.225020+0000", 2023-08-01T19:56:24.382 INFO:teuthology.orchestra.run.smithi155.stdout: "duration": 0.0017201 2023-08-01T19:56:24.382 INFO:teuthology.orchestra.run.smithi155.stdout: }, 2023-08-01T19:56:24.382 INFO:teuthology.orchestra.run.smithi155.stdout: { 2023-08-01T19:56:24.382 INFO:teuthology.orchestra.run.smithi155.stdout: "event": "commit_sent", 2023-08-01T19:56:24.382 INFO:teuthology.orchestra.run.smithi155.stdout: "time": "2023-08-01T19:55:05.225066+0000", 2023-08-01T19:56:24.382 INFO:teuthology.orchestra.run.smithi155.stdout: "duration": 4.6143000000000002e-05 2023-08-01T19:56:24.382 INFO:teuthology.orchestra.run.smithi155.stdout: }, 2023-08-01T19:56:24.383 INFO:teuthology.orchestra.run.smithi155.stdout: { 2023-08-01T19:56:24.383 INFO:teuthology.orchestra.run.smithi155.stdout: "event": "done", 2023-08-01T19:56:24.383 INFO:teuthology.orchestra.run.smithi155.stdout: "time": "2023-08-01T19:55:05.225103+0000", 2023-08-01T19:56:24.383 INFO:teuthology.orchestra.run.smithi155.stdout: "duration": 3.6789999999999998e-05 2023-08-01T19:56:24.383 INFO:teuthology.orchestra.run.smithi155.stdout: } 2023-08-01T19:56:24.383 INFO:teuthology.orchestra.run.smithi155.stdout: ] 2023-08-01T19:56:24.383 INFO:teuthology.orchestra.run.smithi155.stdout: } 2023-08-01T19:56:24.383 INFO:teuthology.orchestra.run.smithi155.stdout: }, 2023-08-01T19:56:24.384 INFO:teuthology.orchestra.run.smithi155.stdout: { 2023-08-01T19:56:24.384 INFO:teuthology.orchestra.run.smithi155.stdout: "description": "osd_op(client.4668.0:100252 5.0 5:01f90c3c:::benchmark_data_smithi006_114134_object100251:head [set-alloc-hint object_size 65536 write_size 65536,write 0~65536] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e37)", 2023-08-01T19:56:24.384 INFO:teuthology.orchestra.run.smithi155.stdout: "initiated_at": "2023-08-01T19:55:05.154048+0000", 2023-08-01T19:56:24.384 INFO:teuthology.orchestra.run.smithi155.stdout: "age": 79.149961395999995, 2023-08-01T19:56:24.384 INFO:teuthology.orchestra.run.smithi155.stdout: "duration": 0.070156683999999997, 2023-08-01T19:56:24.384 INFO:teuthology.orchestra.run.smithi155.stdout: "type_data": { 2023-08-01T19:56:24.384 INFO:teuthology.orchestra.run.smithi155.stdout: "flag_point": "commit sent; apply or cleanup", 2023-08-01T19:56:24.384 INFO:teuthology.orchestra.run.smithi155.stdout: "client_info": { 2023-08-01T19:56:24.385 INFO:teuthology.orchestra.run.smithi155.stdout: "client": "client.4668", 2023-08-01T19:56:24.385 INFO:teuthology.orchestra.run.smithi155.stdout: "client_addr": "172.21.15.6:0/1709472247", 2023-08-01T19:56:24.385 INFO:teuthology.orchestra.run.smithi155.stdout: "tid": 100252 2023-08-01T19:56:24.385 INFO:teuthology.orchestra.run.smithi155.stdout: }, 2023-08-01T19:56:24.385 INFO:teuthology.orchestra.run.smithi155.stdout: "events": [ 2023-08-01T19:56:24.385 INFO:teuthology.orchestra.run.smithi155.stdout: { 2023-08-01T19:56:24.385 INFO:teuthology.orchestra.run.smithi155.stdout: "event": "initiated", 2023-08-01T19:56:24.385 INFO:teuthology.orchestra.run.smithi155.stdout: "time": "2023-08-01T19:55:05.154048+0000", 2023-08-01T19:56:24.386 INFO:teuthology.orchestra.run.smithi155.stdout: "duration": 0 2023-08-01T19:56:24.386 INFO:teuthology.orchestra.run.smithi155.stdout: }, 2023-08-01T19:56:24.386 INFO:teuthology.orchestra.run.smithi155.stdout: { 2023-08-01T19:56:24.386 INFO:teuthology.orchestra.run.smithi155.stdout: "event": "throttled", 2023-08-01T19:56:24.386 INFO:teuthology.orchestra.run.smithi155.stdout: "time": "2023-08-01T19:55:05.154048+0000", 2023-08-01T19:56:24.386 INFO:teuthology.orchestra.run.smithi155.stdout: "duration": 0 2023-08-01T19:56:24.386 INFO:teuthology.orchestra.run.smithi155.stdout: }, 2023-08-01T19:56:24.387 INFO:teuthology.orchestra.run.smithi155.stdout: { 2023-08-01T19:56:24.387 INFO:teuthology.orchestra.run.smithi155.stdout: "event": "header_read", 2023-08-01T19:56:24.387 INFO:teuthology.orchestra.run.smithi155.stdout: "time": "2023-08-01T19:55:05.154047+0000", 2023-08-01T19:56:24.387 INFO:teuthology.orchestra.run.smithi155.stdout: "duration": 4294967295.999999 2023-08-01T19:56:24.387 INFO:teuthology.orchestra.run.smithi155.stdout: }, 2023-08-01T19:56:24.387 INFO:teuthology.orchestra.run.smithi155.stdout: { 2023-08-01T19:56:24.387 INFO:teuthology.orchestra.run.smithi155.stdout: "event": "all_read", 2023-08-01T19:56:24.387 INFO:teuthology.orchestra.run.smithi155.stdout: "time": "2023-08-01T19:55:05.154115+0000", 2023-08-01T19:56:24.388 INFO:teuthology.orchestra.run.smithi155.stdout: "duration": 6.7545999999999993e-05 2023-08-01T19:56:24.388 INFO:teuthology.orchestra.run.smithi155.stdout: }, 2023-08-01T19:56:24.388 INFO:teuthology.orchestra.run.smithi155.stdout: { 2023-08-01T19:56:24.388 INFO:teuthology.orchestra.run.smithi155.stdout: "event": "dispatched", 2023-08-01T19:56:24.388 INFO:teuthology.orchestra.run.smithi155.stdout: "time": "2023-08-01T19:55:05.154125+0000", 2023-08-01T19:56:24.388 INFO:teuthology.orchestra.run.smithi155.stdout: "duration": 1.0669000000000001e-05 2023-08-01T19:56:24.388 INFO:teuthology.orchestra.run.smithi155.stdout: }, 2023-08-01T19:56:24.388 INFO:teuthology.orchestra.run.smithi155.stdout: { 2023-08-01T19:56:24.389 INFO:teuthology.orchestra.run.smithi155.stdout: "event": "queued_for_pg", 2023-08-01T19:56:24.389 INFO:teuthology.orchestra.run.smithi155.stdout: "time": "2023-08-01T19:55:05.154131+0000", 2023-08-01T19:56:24.389 INFO:teuthology.orchestra.run.smithi155.stdout: "duration": 6.0349999999999998e-06 2023-08-01T19:56:24.389 INFO:teuthology.orchestra.run.smithi155.stdout: }, 2023-08-01T19:56:24.389 INFO:teuthology.orchestra.run.smithi155.stdout: { 2023-08-01T19:56:24.389 INFO:teuthology.orchestra.run.smithi155.stdout: "event": "reached_pg", 2023-08-01T19:56:24.389 INFO:teuthology.orchestra.run.smithi155.stdout: "time": "2023-08-01T19:55:05.154174+0000", 2023-08-01T19:56:24.390 INFO:teuthology.orchestra.run.smithi155.stdout: "duration": 4.2429000000000003e-05 2023-08-01T19:56:24.390 INFO:teuthology.orchestra.run.smithi155.stdout: }, 2023-08-01T19:56:24.390 INFO:teuthology.orchestra.run.smithi155.stdout: { 2023-08-01T19:56:24.390 INFO:teuthology.orchestra.run.smithi155.stdout: "event": "started", 2023-08-01T19:56:24.390 INFO:teuthology.orchestra.run.smithi155.stdout: "time": "2023-08-01T19:55:05.154287+0000", 2023-08-01T19:56:24.390 INFO:teuthology.orchestra.run.smithi155.stdout: "duration": 0.000113138 2023-08-01T19:56:24.390 INFO:teuthology.orchestra.run.smithi155.stdout: }, 2023-08-01T19:56:24.390 INFO:teuthology.orchestra.run.smithi155.stdout: { 2023-08-01T19:56:24.391 INFO:teuthology.orchestra.run.smithi155.stdout: "event": "waiting for subops from 0", 2023-08-01T19:56:24.391 INFO:teuthology.orchestra.run.smithi155.stdout: "time": "2023-08-01T19:55:05.154420+0000", 2023-08-01T19:56:24.391 INFO:teuthology.orchestra.run.smithi155.stdout: "duration": 0.000133292 2023-08-01T19:56:24.391 INFO:teuthology.orchestra.run.smithi155.stdout: }, 2023-08-01T19:56:24.391 INFO:teuthology.orchestra.run.smithi155.stdout: { 2023-08-01T19:56:24.391 INFO:teuthology.orchestra.run.smithi155.stdout: "event": "sub_op_commit_rec", 2023-08-01T19:56:24.391 INFO:teuthology.orchestra.run.smithi155.stdout: "time": "2023-08-01T19:55:05.219034+0000", 2023-08-01T19:56:24.391 INFO:teuthology.orchestra.run.smithi155.stdout: "duration": 0.064613429999999999 2023-08-01T19:56:24.392 INFO:teuthology.orchestra.run.smithi155.stdout: }, 2023-08-01T19:56:24.392 INFO:teuthology.orchestra.run.smithi155.stdout: { 2023-08-01T19:56:24.392 INFO:teuthology.orchestra.run.smithi155.stdout: "event": "op_commit", 2023-08-01T19:56:24.392 INFO:teuthology.orchestra.run.smithi155.stdout: "time": "2023-08-01T19:55:05.224138+0000", 2023-08-01T19:56:24.392 INFO:teuthology.orchestra.run.smithi155.stdout: "duration": 0.0051041999999999997 2023-08-01T19:56:24.392 INFO:teuthology.orchestra.run.smithi155.stdout: }, 2023-08-01T19:56:24.392 INFO:teuthology.orchestra.run.smithi155.stdout: { 2023-08-01T19:56:24.393 INFO:teuthology.orchestra.run.smithi155.stdout: "event": "commit_sent", 2023-08-01T19:56:24.393 INFO:teuthology.orchestra.run.smithi155.stdout: "time": "2023-08-01T19:55:05.224171+0000", 2023-08-01T19:56:24.393 INFO:teuthology.orchestra.run.smithi155.stdout: "duration": 3.3345e-05 2023-08-01T19:56:24.393 INFO:teuthology.orchestra.run.smithi155.stdout: }, 2023-08-01T19:56:24.393 INFO:teuthology.orchestra.run.smithi155.stdout: { 2023-08-01T19:56:24.393 INFO:teuthology.orchestra.run.smithi155.stdout: "event": "done", 2023-08-01T19:56:24.393 INFO:teuthology.orchestra.run.smithi155.stdout: "time": "2023-08-01T19:55:05.224205+0000", 2023-08-01T19:56:24.393 INFO:teuthology.orchestra.run.smithi155.stdout: "duration": 3.3525999999999997e-05 2023-08-01T19:56:24.394 INFO:teuthology.orchestra.run.smithi155.stdout: } 2023-08-01T19:56:24.394 INFO:teuthology.orchestra.run.smithi155.stdout: ] 2023-08-01T19:56:24.394 INFO:teuthology.orchestra.run.smithi155.stdout: } 2023-08-01T19:56:24.394 INFO:teuthology.orchestra.run.smithi155.stdout: }, 2023-08-01T19:56:24.394 INFO:teuthology.orchestra.run.smithi155.stdout: { 2023-08-01T19:56:24.394 INFO:teuthology.orchestra.run.smithi155.stdout: "description": "osd_repop_reply(client.4668.0:100237 5.4 e37/19 ondisk, result = 0)", 2023-08-01T19:56:24.394 INFO:teuthology.orchestra.run.smithi155.stdout: "initiated_at": "2023-08-01T19:55:05.156249+0000", 2023-08-01T19:56:24.394 INFO:teuthology.orchestra.run.smithi155.stdout: "age": 79.147760450999996, 2023-08-01T19:56:24.395 INFO:teuthology.orchestra.run.smithi155.stdout: "duration": 0.062792549000000003, 2023-08-01T19:56:24.395 INFO:teuthology.orchestra.run.smithi155.stdout: "type_data": { 2023-08-01T19:56:24.395 INFO:teuthology.orchestra.run.smithi155.stdout: "flag_point": "started", 2023-08-01T19:56:24.395 INFO:teuthology.orchestra.run.smithi155.stdout: "events": [ 2023-08-01T19:56:24.395 INFO:teuthology.orchestra.run.smithi155.stdout: { 2023-08-01T19:56:24.395 INFO:teuthology.orchestra.run.smithi155.stdout: "event": "initiated", 2023-08-01T19:56:24.395 INFO:teuthology.orchestra.run.smithi155.stdout: "time": "2023-08-01T19:55:05.156249+0000", 2023-08-01T19:56:24.395 INFO:teuthology.orchestra.run.smithi155.stdout: "duration": 0 2023-08-01T19:56:24.396 INFO:teuthology.orchestra.run.smithi155.stdout: }, 2023-08-01T19:56:24.396 INFO:teuthology.orchestra.run.smithi155.stdout: { 2023-08-01T19:56:24.396 INFO:teuthology.orchestra.run.smithi155.stdout: "event": "throttled", 2023-08-01T19:56:24.396 INFO:teuthology.orchestra.run.smithi155.stdout: "time": "2023-08-01T19:55:05.156249+0000", 2023-08-01T19:56:24.396 INFO:teuthology.orchestra.run.smithi155.stdout: "duration": 0 2023-08-01T19:56:24.396 INFO:teuthology.orchestra.run.smithi155.stdout: }, 2023-08-01T19:56:24.396 INFO:teuthology.orchestra.run.smithi155.stdout: { 2023-08-01T19:56:24.396 INFO:teuthology.orchestra.run.smithi155.stdout: "event": "header_read", 2023-08-01T19:56:24.397 INFO:teuthology.orchestra.run.smithi155.stdout: "time": "2023-08-01T19:55:05.156248+0000", 2023-08-01T19:56:24.397 INFO:teuthology.orchestra.run.smithi155.stdout: "duration": 4294967295.9999995 2023-08-01T19:56:24.397 INFO:teuthology.orchestra.run.smithi155.stdout: }, 2023-08-01T19:56:24.397 INFO:teuthology.orchestra.run.smithi155.stdout: { 2023-08-01T19:56:24.397 INFO:teuthology.orchestra.run.smithi155.stdout: "event": "all_read", 2023-08-01T19:56:24.397 INFO:teuthology.orchestra.run.smithi155.stdout: "time": "2023-08-01T19:55:05.156252+0000", 2023-08-01T19:56:24.397 INFO:teuthology.orchestra.run.smithi155.stdout: "duration": 3.9999999999999998e-06 2023-08-01T19:56:24.397 INFO:teuthology.orchestra.run.smithi155.stdout: }, 2023-08-01T19:56:24.398 INFO:teuthology.orchestra.run.smithi155.stdout: { 2023-08-01T19:56:24.398 INFO:teuthology.orchestra.run.smithi155.stdout: "event": "dispatched", 2023-08-01T19:56:24.398 INFO:teuthology.orchestra.run.smithi155.stdout: "time": "2023-08-01T19:55:05.218844+0000", 2023-08-01T19:56:24.398 INFO:teuthology.orchestra.run.smithi155.stdout: "duration": 0.062591516999999999 2023-08-01T19:56:24.398 INFO:teuthology.orchestra.run.smithi155.stdout: }, 2023-08-01T19:56:24.398 INFO:teuthology.orchestra.run.smithi155.stdout: { 2023-08-01T19:56:24.398 INFO:teuthology.orchestra.run.smithi155.stdout: "event": "queued_for_pg", 2023-08-01T19:56:24.398 INFO:teuthology.orchestra.run.smithi155.stdout: "time": "2023-08-01T19:55:05.218862+0000", 2023-08-01T19:56:24.399 INFO:teuthology.orchestra.run.smithi155.stdout: "duration": 1.7666e-05 2023-08-01T19:56:24.399 INFO:teuthology.orchestra.run.smithi155.stdout: }, 2023-08-01T19:56:24.399 INFO:teuthology.orchestra.run.smithi155.stdout: { 2023-08-01T19:56:24.399 INFO:teuthology.orchestra.run.smithi155.stdout: "event": "reached_pg", 2023-08-01T19:56:24.399 INFO:teuthology.orchestra.run.smithi155.stdout: "time": "2023-08-01T19:55:05.218914+0000", 2023-08-01T19:56:24.399 INFO:teuthology.orchestra.run.smithi155.stdout: "duration": 5.2565999999999998e-05 2023-08-01T19:56:24.399 INFO:teuthology.orchestra.run.smithi155.stdout: }, 2023-08-01T19:56:24.400 INFO:teuthology.orchestra.run.smithi155.stdout: { 2023-08-01T19:56:24.400 INFO:teuthology.orchestra.run.smithi155.stdout: "event": "started", 2023-08-01T19:56:24.400 INFO:teuthology.orchestra.run.smithi155.stdout: "time": "2023-08-01T19:55:05.218925+0000", 2023-08-01T19:56:24.400 INFO:teuthology.orchestra.run.smithi155.stdout: "duration": 1.1375e-05 2023-08-01T19:56:24.400 INFO:teuthology.orchestra.run.smithi155.stdout: }, 2023-08-01T19:56:24.400 INFO:teuthology.orchestra.run.smithi155.stdout: { 2023-08-01T19:56:24.400 INFO:teuthology.orchestra.run.smithi155.stdout: "event": "done", 2023-08-01T19:56:24.400 INFO:teuthology.orchestra.run.smithi155.stdout: "time": "2023-08-01T19:55:05.219041+0000", 2023-08-01T19:56:24.401 INFO:teuthology.orchestra.run.smithi155.stdout: "duration": 0.000115977 2023-08-01T19:56:24.401 INFO:teuthology.orchestra.run.smithi155.stdout: } 2023-08-01T19:56:24.401 INFO:teuthology.orchestra.run.smithi155.stdout: ] 2023-08-01T19:56:24.401 INFO:teuthology.orchestra.run.smithi155.stdout: } 2023-08-01T19:56:24.401 INFO:teuthology.orchestra.run.smithi155.stdout: }, 2023-08-01T19:56:24.401 INFO:teuthology.orchestra.run.smithi155.stdout: { 2023-08-01T19:56:24.401 INFO:teuthology.orchestra.run.smithi155.stdout: "description": "osd_repop(client.4668.0:100253 5.f e37/19 5:f7bbce05:::benchmark_data_smithi006_114134_object100252:head v 37'6323, mlcod=37'6321)", 2023-08-01T19:56:24.402 INFO:teuthology.orchestra.run.smithi155.stdout: "initiated_at": "2023-08-01T19:55:05.156952+0000", 2023-08-01T19:56:24.402 INFO:teuthology.orchestra.run.smithi155.stdout: "age": 79.147057387999993, 2023-08-01T19:56:24.402 INFO:teuthology.orchestra.run.smithi155.stdout: "duration": 0.068018577999999996, 2023-08-01T19:56:24.402 INFO:teuthology.orchestra.run.smithi155.stdout: "type_data": { 2023-08-01T19:56:24.402 INFO:teuthology.orchestra.run.smithi155.stdout: "flag_point": "commit sent; apply or cleanup", 2023-08-01T19:56:24.402 INFO:teuthology.orchestra.run.smithi155.stdout: "events": [ 2023-08-01T19:56:24.402 INFO:teuthology.orchestra.run.smithi155.stdout: { 2023-08-01T19:56:24.402 INFO:teuthology.orchestra.run.smithi155.stdout: "event": "initiated", 2023-08-01T19:56:24.403 INFO:teuthology.orchestra.run.smithi155.stdout: "time": "2023-08-01T19:55:05.156952+0000", 2023-08-01T19:56:24.403 INFO:teuthology.orchestra.run.smithi155.stdout: "duration": 0 2023-08-01T19:56:24.403 INFO:teuthology.orchestra.run.smithi155.stdout: }, 2023-08-01T19:56:24.403 INFO:teuthology.orchestra.run.smithi155.stdout: { 2023-08-01T19:56:24.403 INFO:teuthology.orchestra.run.smithi155.stdout: "event": "throttled", 2023-08-01T19:56:24.403 INFO:teuthology.orchestra.run.smithi155.stdout: "time": "2023-08-01T19:55:05.156952+0000", 2023-08-01T19:56:24.403 INFO:teuthology.orchestra.run.smithi155.stdout: "duration": 0 2023-08-01T19:56:24.403 INFO:teuthology.orchestra.run.smithi155.stdout: }, 2023-08-01T19:56:24.404 INFO:teuthology.orchestra.run.smithi155.stdout: { 2023-08-01T19:56:24.404 INFO:teuthology.orchestra.run.smithi155.stdout: "event": "header_read", 2023-08-01T19:56:24.404 INFO:teuthology.orchestra.run.smithi155.stdout: "time": "2023-08-01T19:55:05.156951+0000", 2023-08-01T19:56:24.404 INFO:teuthology.orchestra.run.smithi155.stdout: "duration": 4294967295.999999 2023-08-01T19:56:24.404 INFO:teuthology.orchestra.run.smithi155.stdout: }, 2023-08-01T19:56:24.404 INFO:teuthology.orchestra.run.smithi155.stdout: { 2023-08-01T19:56:24.404 INFO:teuthology.orchestra.run.smithi155.stdout: "event": "all_read", 2023-08-01T19:56:24.405 INFO:teuthology.orchestra.run.smithi155.stdout: "time": "2023-08-01T19:55:05.156989+0000", 2023-08-01T19:56:24.405 INFO:teuthology.orchestra.run.smithi155.stdout: "duration": 3.8175e-05 2023-08-01T19:56:24.405 INFO:teuthology.orchestra.run.smithi155.stdout: }, 2023-08-01T19:56:24.405 INFO:teuthology.orchestra.run.smithi155.stdout: { 2023-08-01T19:56:24.405 INFO:teuthology.orchestra.run.smithi155.stdout: "event": "dispatched", 2023-08-01T19:56:24.405 INFO:teuthology.orchestra.run.smithi155.stdout: "time": "2023-08-01T19:55:05.218842+0000", 2023-08-01T19:56:24.405 INFO:teuthology.orchestra.run.smithi155.stdout: "duration": 0.061852299999999999 2023-08-01T19:56:24.405 INFO:teuthology.orchestra.run.smithi155.stdout: }, 2023-08-01T19:56:24.406 INFO:teuthology.orchestra.run.smithi155.stdout: { 2023-08-01T19:56:24.406 INFO:teuthology.orchestra.run.smithi155.stdout: "event": "queued_for_pg", 2023-08-01T19:56:24.406 INFO:teuthology.orchestra.run.smithi155.stdout: "time": "2023-08-01T19:55:05.218862+0000", 2023-08-01T19:56:24.406 INFO:teuthology.orchestra.run.smithi155.stdout: "duration": 1.9854999999999999e-05 2023-08-01T19:56:24.406 INFO:teuthology.orchestra.run.smithi155.stdout: }, 2023-08-01T19:56:24.406 INFO:teuthology.orchestra.run.smithi155.stdout: { 2023-08-01T19:56:24.406 INFO:teuthology.orchestra.run.smithi155.stdout: "event": "reached_pg", 2023-08-01T19:56:24.406 INFO:teuthology.orchestra.run.smithi155.stdout: "time": "2023-08-01T19:55:05.218918+0000", 2023-08-01T19:56:24.407 INFO:teuthology.orchestra.run.smithi155.stdout: "duration": 5.6570000000000002e-05 2023-08-01T19:56:24.407 INFO:teuthology.orchestra.run.smithi155.stdout: }, 2023-08-01T19:56:24.407 INFO:teuthology.orchestra.run.smithi155.stdout: { 2023-08-01T19:56:24.407 INFO:teuthology.orchestra.run.smithi155.stdout: "event": "started", 2023-08-01T19:56:24.407 INFO:teuthology.orchestra.run.smithi155.stdout: "time": "2023-08-01T19:55:05.218940+0000", 2023-08-01T19:56:24.407 INFO:teuthology.orchestra.run.smithi155.stdout: "duration": 2.1804e-05 2023-08-01T19:56:24.407 INFO:teuthology.orchestra.run.smithi155.stdout: }, 2023-08-01T19:56:24.408 INFO:teuthology.orchestra.run.smithi155.stdout: { 2023-08-01T19:56:24.408 INFO:teuthology.orchestra.run.smithi155.stdout: "event": "commit_sent", 2023-08-01T19:56:24.408 INFO:teuthology.orchestra.run.smithi155.stdout: "time": "2023-08-01T19:55:05.224928+0000", 2023-08-01T19:56:24.408 INFO:teuthology.orchestra.run.smithi155.stdout: "duration": 0.0059876759999999999 2023-08-01T19:56:24.408 INFO:teuthology.orchestra.run.smithi155.stdout: }, 2023-08-01T19:56:24.408 INFO:teuthology.orchestra.run.smithi155.stdout: { 2023-08-01T19:56:24.408 INFO:teuthology.orchestra.run.smithi155.stdout: "event": "done", 2023-08-01T19:56:24.408 INFO:teuthology.orchestra.run.smithi155.stdout: "time": "2023-08-01T19:55:05.224971+0000", 2023-08-01T19:56:24.409 INFO:teuthology.orchestra.run.smithi155.stdout: "duration": 4.2929999999999997e-05 2023-08-01T19:56:24.409 INFO:teuthology.orchestra.run.smithi155.stdout: } 2023-08-01T19:56:24.409 INFO:teuthology.orchestra.run.smithi155.stdout: ] 2023-08-01T19:56:24.409 INFO:teuthology.orchestra.run.smithi155.stdout: } 2023-08-01T19:56:24.409 INFO:teuthology.orchestra.run.smithi155.stdout: }, 2023-08-01T19:56:24.409 INFO:teuthology.orchestra.run.smithi155.stdout: { 2023-08-01T19:56:24.409 INFO:teuthology.orchestra.run.smithi155.stdout: "description": "osd_op(client.4668.0:100927 5.0 5:00608ec6:::benchmark_data_smithi006_114134_object100926:head [set-alloc-hint object_size 65536 write_size 65536,write 0~65536] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e37)", 2023-08-01T19:56:24.409 INFO:teuthology.orchestra.run.smithi155.stdout: "initiated_at": "2023-08-01T19:55:05.561169+0000", 2023-08-01T19:56:24.410 INFO:teuthology.orchestra.run.smithi155.stdout: "age": 78.742840485000002, 2023-08-01T19:56:24.410 INFO:teuthology.orchestra.run.smithi155.stdout: "duration": 0.066411687999999997, 2023-08-01T19:56:24.410 INFO:teuthology.orchestra.run.smithi155.stdout: "type_data": { 2023-08-01T19:56:24.410 INFO:teuthology.orchestra.run.smithi155.stdout: "flag_point": "commit sent; apply or cleanup", 2023-08-01T19:56:24.410 INFO:teuthology.orchestra.run.smithi155.stdout: "client_info": { 2023-08-01T19:56:24.410 INFO:teuthology.orchestra.run.smithi155.stdout: "client": "client.4668", 2023-08-01T19:56:24.410 INFO:teuthology.orchestra.run.smithi155.stdout: "client_addr": "172.21.15.6:0/1709472247", 2023-08-01T19:56:24.410 INFO:teuthology.orchestra.run.smithi155.stdout: "tid": 100927 2023-08-01T19:56:24.411 INFO:teuthology.orchestra.run.smithi155.stdout: }, 2023-08-01T19:56:24.411 INFO:teuthology.orchestra.run.smithi155.stdout: "events": [ 2023-08-01T19:56:24.411 INFO:teuthology.orchestra.run.smithi155.stdout: { 2023-08-01T19:56:24.411 INFO:teuthology.orchestra.run.smithi155.stdout: "event": "initiated", 2023-08-01T19:56:24.411 INFO:teuthology.orchestra.run.smithi155.stdout: "time": "2023-08-01T19:55:05.561169+0000", 2023-08-01T19:56:24.411 INFO:teuthology.orchestra.run.smithi155.stdout: "duration": 0 2023-08-01T19:56:24.411 INFO:teuthology.orchestra.run.smithi155.stdout: }, 2023-08-01T19:56:24.411 INFO:teuthology.orchestra.run.smithi155.stdout: { 2023-08-01T19:56:24.412 INFO:teuthology.orchestra.run.smithi155.stdout: "event": "throttled", 2023-08-01T19:56:24.412 INFO:teuthology.orchestra.run.smithi155.stdout: "time": "2023-08-01T19:55:05.561169+0000", 2023-08-01T19:56:24.412 INFO:teuthology.orchestra.run.smithi155.stdout: "duration": 0 2023-08-01T19:56:24.412 INFO:teuthology.orchestra.run.smithi155.stdout: }, 2023-08-01T19:56:24.412 INFO:teuthology.orchestra.run.smithi155.stdout: { 2023-08-01T19:56:24.412 INFO:teuthology.orchestra.run.smithi155.stdout: "event": "header_read", 2023-08-01T19:56:24.412 INFO:teuthology.orchestra.run.smithi155.stdout: "time": "2023-08-01T19:55:05.561168+0000", 2023-08-01T19:56:24.413 INFO:teuthology.orchestra.run.smithi155.stdout: "duration": 4294967295.9999995 2023-08-01T19:56:24.413 INFO:teuthology.orchestra.run.smithi155.stdout: }, 2023-08-01T19:56:24.413 INFO:teuthology.orchestra.run.smithi155.stdout: { 2023-08-01T19:56:24.413 INFO:teuthology.orchestra.run.smithi155.stdout: "event": "all_read", 2023-08-01T19:56:24.413 INFO:teuthology.orchestra.run.smithi155.stdout: "time": "2023-08-01T19:55:05.561218+0000", 2023-08-01T19:56:24.413 INFO:teuthology.orchestra.run.smithi155.stdout: "duration": 4.9379999999999998e-05 2023-08-01T19:56:24.413 INFO:teuthology.orchestra.run.smithi155.stdout: }, 2023-08-01T19:56:24.414 INFO:teuthology.orchestra.run.smithi155.stdout: { 2023-08-01T19:56:24.414 INFO:teuthology.orchestra.run.smithi155.stdout: "event": "dispatched", 2023-08-01T19:56:24.414 INFO:teuthology.orchestra.run.smithi155.stdout: "time": "2023-08-01T19:55:05.561225+0000", 2023-08-01T19:56:24.414 INFO:teuthology.orchestra.run.smithi155.stdout: "duration": 7.114e-06 2023-08-01T19:56:24.414 INFO:teuthology.orchestra.run.smithi155.stdout: }, 2023-08-01T19:56:24.414 INFO:teuthology.orchestra.run.smithi155.stdout: { 2023-08-01T19:56:24.414 INFO:teuthology.orchestra.run.smithi155.stdout: "event": "queued_for_pg", 2023-08-01T19:56:24.414 INFO:teuthology.orchestra.run.smithi155.stdout: "time": "2023-08-01T19:55:05.561229+0000", 2023-08-01T19:56:24.415 INFO:teuthology.orchestra.run.smithi155.stdout: "duration": 4.2180000000000001e-06 2023-08-01T19:56:24.415 INFO:teuthology.orchestra.run.smithi155.stdout: }, 2023-08-01T19:56:24.415 INFO:teuthology.orchestra.run.smithi155.stdout: { 2023-08-01T19:56:24.415 INFO:teuthology.orchestra.run.smithi155.stdout: "event": "reached_pg", 2023-08-01T19:56:24.415 INFO:teuthology.orchestra.run.smithi155.stdout: "time": "2023-08-01T19:55:05.564737+0000", 2023-08-01T19:56:24.415 INFO:teuthology.orchestra.run.smithi155.stdout: "duration": 0.0035081869999999999 2023-08-01T19:56:24.415 INFO:teuthology.orchestra.run.smithi155.stdout: }, 2023-08-01T19:56:24.415 INFO:teuthology.orchestra.run.smithi155.stdout: { 2023-08-01T19:56:24.416 INFO:teuthology.orchestra.run.smithi155.stdout: "event": "started", 2023-08-01T19:56:24.416 INFO:teuthology.orchestra.run.smithi155.stdout: "time": "2023-08-01T19:55:05.564859+0000", 2023-08-01T19:56:24.416 INFO:teuthology.orchestra.run.smithi155.stdout: "duration": 0.00012165800000000001 2023-08-01T19:56:24.416 INFO:teuthology.orchestra.run.smithi155.stdout: }, 2023-08-01T19:56:24.416 INFO:teuthology.orchestra.run.smithi155.stdout: { 2023-08-01T19:56:24.416 INFO:teuthology.orchestra.run.smithi155.stdout: "event": "waiting for subops from 0", 2023-08-01T19:56:24.416 INFO:teuthology.orchestra.run.smithi155.stdout: "time": "2023-08-01T19:55:05.565009+0000", 2023-08-01T19:56:24.416 INFO:teuthology.orchestra.run.smithi155.stdout: "duration": 0.00014979699999999999 2023-08-01T19:56:24.417 INFO:teuthology.orchestra.run.smithi155.stdout: }, 2023-08-01T19:56:24.417 INFO:teuthology.orchestra.run.smithi155.stdout: { 2023-08-01T19:56:24.417 INFO:teuthology.orchestra.run.smithi155.stdout: "event": "op_commit", 2023-08-01T19:56:24.417 INFO:teuthology.orchestra.run.smithi155.stdout: "time": "2023-08-01T19:55:05.568007+0000", 2023-08-01T19:56:24.417 INFO:teuthology.orchestra.run.smithi155.stdout: "duration": 0.00299796 2023-08-01T19:56:24.417 INFO:teuthology.orchestra.run.smithi155.stdout: }, 2023-08-01T19:56:24.417 INFO:teuthology.orchestra.run.smithi155.stdout: { 2023-08-01T19:56:24.418 INFO:teuthology.orchestra.run.smithi155.stdout: "event": "sub_op_commit_rec", 2023-08-01T19:56:24.418 INFO:teuthology.orchestra.run.smithi155.stdout: "time": "2023-08-01T19:55:05.627520+0000", 2023-08-01T19:56:24.418 INFO:teuthology.orchestra.run.smithi155.stdout: "duration": 0.059513636000000002 2023-08-01T19:56:24.418 INFO:teuthology.orchestra.run.smithi155.stdout: }, 2023-08-01T19:56:24.418 INFO:teuthology.orchestra.run.smithi155.stdout: { 2023-08-01T19:56:24.418 INFO:teuthology.orchestra.run.smithi155.stdout: "event": "commit_sent", 2023-08-01T19:56:24.418 INFO:teuthology.orchestra.run.smithi155.stdout: "time": "2023-08-01T19:55:05.627553+0000", 2023-08-01T19:56:24.418 INFO:teuthology.orchestra.run.smithi155.stdout: "duration": 3.2635999999999997e-05 2023-08-01T19:56:24.419 INFO:teuthology.orchestra.run.smithi155.stdout: }, 2023-08-01T19:56:24.419 INFO:teuthology.orchestra.run.smithi155.stdout: { 2023-08-01T19:56:24.419 INFO:teuthology.orchestra.run.smithi155.stdout: "event": "done", 2023-08-01T19:56:24.419 INFO:teuthology.orchestra.run.smithi155.stdout: "time": "2023-08-01T19:55:05.627581+0000", 2023-08-01T19:56:24.419 INFO:teuthology.orchestra.run.smithi155.stdout: "duration": 2.7681000000000001e-05 2023-08-01T19:56:24.419 INFO:teuthology.orchestra.run.smithi155.stdout: } 2023-08-01T19:56:24.419 INFO:teuthology.orchestra.run.smithi155.stdout: ] 2023-08-01T19:56:24.419 INFO:teuthology.orchestra.run.smithi155.stdout: } 2023-08-01T19:56:24.420 INFO:teuthology.orchestra.run.smithi155.stdout: }, 2023-08-01T19:56:24.420 INFO:teuthology.orchestra.run.smithi155.stdout: { 2023-08-01T19:56:24.420 INFO:teuthology.orchestra.run.smithi155.stdout: "description": "osd_op(client.4668.0:100935 5.e 5:7895b14e:::benchmark_data_smithi006_114134_object100934:head [set-alloc-hint object_size 65536 write_size 65536,write 0~65536] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e37)", 2023-08-01T19:56:24.420 INFO:teuthology.orchestra.run.smithi155.stdout: "initiated_at": "2023-08-01T19:55:05.566666+0000", 2023-08-01T19:56:24.420 INFO:teuthology.orchestra.run.smithi155.stdout: "age": 78.737343185, 2023-08-01T19:56:24.420 INFO:teuthology.orchestra.run.smithi155.stdout: "duration": 0.064309016999999996, 2023-08-01T19:56:24.420 INFO:teuthology.orchestra.run.smithi155.stdout: "type_data": { 2023-08-01T19:56:24.421 INFO:teuthology.orchestra.run.smithi155.stdout: "flag_point": "commit sent; apply or cleanup", 2023-08-01T19:56:24.421 INFO:teuthology.orchestra.run.smithi155.stdout: "client_info": { 2023-08-01T19:56:24.421 INFO:teuthology.orchestra.run.smithi155.stdout: "client": "client.4668", 2023-08-01T19:56:24.421 INFO:teuthology.orchestra.run.smithi155.stdout: "client_addr": "172.21.15.6:0/1709472247", 2023-08-01T19:56:24.421 INFO:teuthology.orchestra.run.smithi155.stdout: "tid": 100935 2023-08-01T19:56:24.421 INFO:teuthology.orchestra.run.smithi155.stdout: }, 2023-08-01T19:56:24.421 INFO:teuthology.orchestra.run.smithi155.stdout: "events": [ 2023-08-01T19:56:24.421 INFO:teuthology.orchestra.run.smithi155.stdout: { 2023-08-01T19:56:24.422 INFO:teuthology.orchestra.run.smithi155.stdout: "event": "initiated", 2023-08-01T19:56:24.422 INFO:teuthology.orchestra.run.smithi155.stdout: "time": "2023-08-01T19:55:05.566666+0000", 2023-08-01T19:56:24.422 INFO:teuthology.orchestra.run.smithi155.stdout: "duration": 0 2023-08-01T19:56:24.422 INFO:teuthology.orchestra.run.smithi155.stdout: }, 2023-08-01T19:56:24.422 INFO:teuthology.orchestra.run.smithi155.stdout: { 2023-08-01T19:56:24.422 INFO:teuthology.orchestra.run.smithi155.stdout: "event": "throttled", 2023-08-01T19:56:24.422 INFO:teuthology.orchestra.run.smithi155.stdout: "time": "2023-08-01T19:55:05.566666+0000", 2023-08-01T19:56:24.423 INFO:teuthology.orchestra.run.smithi155.stdout: "duration": 0 2023-08-01T19:56:24.423 INFO:teuthology.orchestra.run.smithi155.stdout: }, 2023-08-01T19:56:24.423 INFO:teuthology.orchestra.run.smithi155.stdout: { 2023-08-01T19:56:24.423 INFO:teuthology.orchestra.run.smithi155.stdout: "event": "header_read", 2023-08-01T19:56:24.423 INFO:teuthology.orchestra.run.smithi155.stdout: "time": "2023-08-01T19:55:05.566665+0000", 2023-08-01T19:56:24.423 INFO:teuthology.orchestra.run.smithi155.stdout: "duration": 4294967295.9999986 2023-08-01T19:56:24.423 INFO:teuthology.orchestra.run.smithi155.stdout: }, 2023-08-01T19:56:24.423 INFO:teuthology.orchestra.run.smithi155.stdout: { 2023-08-01T19:56:24.424 INFO:teuthology.orchestra.run.smithi155.stdout: "event": "all_read", 2023-08-01T19:56:24.424 INFO:teuthology.orchestra.run.smithi155.stdout: "time": "2023-08-01T19:55:05.566754+0000", 2023-08-01T19:56:24.424 INFO:teuthology.orchestra.run.smithi155.stdout: "duration": 8.9425999999999994e-05 2023-08-01T19:56:24.424 INFO:teuthology.orchestra.run.smithi155.stdout: }, 2023-08-01T19:56:24.424 INFO:teuthology.orchestra.run.smithi155.stdout: { 2023-08-01T19:56:24.424 INFO:teuthology.orchestra.run.smithi155.stdout: "event": "dispatched", 2023-08-01T19:56:24.424 INFO:teuthology.orchestra.run.smithi155.stdout: "time": "2023-08-01T19:55:05.566766+0000", 2023-08-01T19:56:24.424 INFO:teuthology.orchestra.run.smithi155.stdout: "duration": 1.2018000000000001e-05 2023-08-01T19:56:24.425 INFO:teuthology.orchestra.run.smithi155.stdout: }, 2023-08-01T19:56:24.425 INFO:teuthology.orchestra.run.smithi155.stdout: { 2023-08-01T19:56:24.425 INFO:teuthology.orchestra.run.smithi155.stdout: "event": "queued_for_pg", 2023-08-01T19:56:24.425 INFO:teuthology.orchestra.run.smithi155.stdout: "time": "2023-08-01T19:55:05.566772+0000", 2023-08-01T19:56:24.425 INFO:teuthology.orchestra.run.smithi155.stdout: "duration": 6.0190000000000003e-06 2023-08-01T19:56:24.425 INFO:teuthology.orchestra.run.smithi155.stdout: }, 2023-08-01T19:56:24.425 INFO:teuthology.orchestra.run.smithi155.stdout: { 2023-08-01T19:56:24.425 INFO:teuthology.orchestra.run.smithi155.stdout: "event": "reached_pg", 2023-08-01T19:56:24.426 INFO:teuthology.orchestra.run.smithi155.stdout: "time": "2023-08-01T19:55:05.566800+0000", 2023-08-01T19:56:24.426 INFO:teuthology.orchestra.run.smithi155.stdout: "duration": 2.7835999999999999e-05 2023-08-01T19:56:24.426 INFO:teuthology.orchestra.run.smithi155.stdout: }, 2023-08-01T19:56:24.426 INFO:teuthology.orchestra.run.smithi155.stdout: { 2023-08-01T19:56:24.426 INFO:teuthology.orchestra.run.smithi155.stdout: "event": "started", 2023-08-01T19:56:24.426 INFO:teuthology.orchestra.run.smithi155.stdout: "time": "2023-08-01T19:55:05.566879+0000", 2023-08-01T19:56:24.426 INFO:teuthology.orchestra.run.smithi155.stdout: "duration": 7.9105999999999998e-05 2023-08-01T19:56:24.426 INFO:teuthology.orchestra.run.smithi155.stdout: }, 2023-08-01T19:56:24.427 INFO:teuthology.orchestra.run.smithi155.stdout: { 2023-08-01T19:56:24.427 INFO:teuthology.orchestra.run.smithi155.stdout: "event": "waiting for subops from 0", 2023-08-01T19:56:24.427 INFO:teuthology.orchestra.run.smithi155.stdout: "time": "2023-08-01T19:55:05.566971+0000", 2023-08-01T19:56:24.427 INFO:teuthology.orchestra.run.smithi155.stdout: "duration": 9.1817999999999994e-05 2023-08-01T19:56:24.427 INFO:teuthology.orchestra.run.smithi155.stdout: }, 2023-08-01T19:56:24.427 INFO:teuthology.orchestra.run.smithi155.stdout: { 2023-08-01T19:56:24.427 INFO:teuthology.orchestra.run.smithi155.stdout: "event": "op_commit", 2023-08-01T19:56:24.427 INFO:teuthology.orchestra.run.smithi155.stdout: "time": "2023-08-01T19:55:05.571475+0000", 2023-08-01T19:56:24.428 INFO:teuthology.orchestra.run.smithi155.stdout: "duration": 0.0045039499999999996 2023-08-01T19:56:24.428 INFO:teuthology.orchestra.run.smithi155.stdout: }, 2023-08-01T19:56:24.428 INFO:teuthology.orchestra.run.smithi155.stdout: { 2023-08-01T19:56:24.428 INFO:teuthology.orchestra.run.smithi155.stdout: "event": "sub_op_commit_rec", 2023-08-01T19:56:24.428 INFO:teuthology.orchestra.run.smithi155.stdout: "time": "2023-08-01T19:55:05.630884+0000", 2023-08-01T19:56:24.428 INFO:teuthology.orchestra.run.smithi155.stdout: "duration": 0.059409181999999998 2023-08-01T19:56:24.428 INFO:teuthology.orchestra.run.smithi155.stdout: }, 2023-08-01T19:56:24.429 INFO:teuthology.orchestra.run.smithi155.stdout: { 2023-08-01T19:56:24.429 INFO:teuthology.orchestra.run.smithi155.stdout: "event": "commit_sent", 2023-08-01T19:56:24.429 INFO:teuthology.orchestra.run.smithi155.stdout: "time": "2023-08-01T19:55:05.630930+0000", 2023-08-01T19:56:24.429 INFO:teuthology.orchestra.run.smithi155.stdout: "duration": 4.5507999999999999e-05 2023-08-01T19:56:24.429 INFO:teuthology.orchestra.run.smithi155.stdout: }, 2023-08-01T19:56:24.429 INFO:teuthology.orchestra.run.smithi155.stdout: { 2023-08-01T19:56:24.429 INFO:teuthology.orchestra.run.smithi155.stdout: "event": "done", 2023-08-01T19:56:24.429 INFO:teuthology.orchestra.run.smithi155.stdout: "time": "2023-08-01T19:55:05.630975+0000", 2023-08-01T19:56:24.430 INFO:teuthology.orchestra.run.smithi155.stdout: "duration": 4.5441000000000001e-05 2023-08-01T19:56:24.430 INFO:teuthology.orchestra.run.smithi155.stdout: } 2023-08-01T19:56:24.430 INFO:teuthology.orchestra.run.smithi155.stdout: ] 2023-08-01T19:56:24.430 INFO:teuthology.orchestra.run.smithi155.stdout: } 2023-08-01T19:56:24.430 INFO:teuthology.orchestra.run.smithi155.stdout: }, 2023-08-01T19:56:24.430 INFO:teuthology.orchestra.run.smithi155.stdout: { 2023-08-01T19:56:24.430 INFO:teuthology.orchestra.run.smithi155.stdout: "description": "osd_op(client.4668.0:100941 5.e 5:736a6ac6:::benchmark_data_smithi006_114134_object100940:head [set-alloc-hint object_size 65536 write_size 65536,write 0~65536] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e37)", 2023-08-01T19:56:24.430 INFO:teuthology.orchestra.run.smithi155.stdout: "initiated_at": "2023-08-01T19:55:05.569750+0000", 2023-08-01T19:56:24.431 INFO:teuthology.orchestra.run.smithi155.stdout: "age": 78.734259292000004, 2023-08-01T19:56:24.431 INFO:teuthology.orchestra.run.smithi155.stdout: "duration": 0.065431331999999995, 2023-08-01T19:56:24.431 INFO:teuthology.orchestra.run.smithi155.stdout: "type_data": { 2023-08-01T19:56:24.431 INFO:teuthology.orchestra.run.smithi155.stdout: "flag_point": "commit sent; apply or cleanup", 2023-08-01T19:56:24.431 INFO:teuthology.orchestra.run.smithi155.stdout: "client_info": { 2023-08-01T19:56:24.431 INFO:teuthology.orchestra.run.smithi155.stdout: "client": "client.4668", 2023-08-01T19:56:24.431 INFO:teuthology.orchestra.run.smithi155.stdout: "client_addr": "172.21.15.6:0/1709472247", 2023-08-01T19:56:24.431 INFO:teuthology.orchestra.run.smithi155.stdout: "tid": 100941 2023-08-01T19:56:24.432 INFO:teuthology.orchestra.run.smithi155.stdout: }, 2023-08-01T19:56:24.432 INFO:teuthology.orchestra.run.smithi155.stdout: "events": [ 2023-08-01T19:56:24.432 INFO:teuthology.orchestra.run.smithi155.stdout: { 2023-08-01T19:56:24.432 INFO:teuthology.orchestra.run.smithi155.stdout: "event": "initiated", 2023-08-01T19:56:24.432 INFO:teuthology.orchestra.run.smithi155.stdout: "time": "2023-08-01T19:55:05.569750+0000", 2023-08-01T19:56:24.432 INFO:teuthology.orchestra.run.smithi155.stdout: "duration": 0 2023-08-01T19:56:24.432 INFO:teuthology.orchestra.run.smithi155.stdout: }, 2023-08-01T19:56:24.433 INFO:teuthology.orchestra.run.smithi155.stdout: { 2023-08-01T19:56:24.433 INFO:teuthology.orchestra.run.smithi155.stdout: "event": "throttled", 2023-08-01T19:56:24.433 INFO:teuthology.orchestra.run.smithi155.stdout: "time": "2023-08-01T19:55:05.569750+0000", 2023-08-01T19:56:24.433 INFO:teuthology.orchestra.run.smithi155.stdout: "duration": 0 2023-08-01T19:56:24.433 INFO:teuthology.orchestra.run.smithi155.stdout: }, 2023-08-01T19:56:24.433 INFO:teuthology.orchestra.run.smithi155.stdout: { 2023-08-01T19:56:24.433 INFO:teuthology.orchestra.run.smithi155.stdout: "event": "header_read", 2023-08-01T19:56:24.433 INFO:teuthology.orchestra.run.smithi155.stdout: "time": "2023-08-01T19:55:05.569749+0000", 2023-08-01T19:56:24.434 INFO:teuthology.orchestra.run.smithi155.stdout: "duration": 4294967295.999999 2023-08-01T19:56:24.434 INFO:teuthology.orchestra.run.smithi155.stdout: }, 2023-08-01T19:56:24.434 INFO:teuthology.orchestra.run.smithi155.stdout: { 2023-08-01T19:56:24.434 INFO:teuthology.orchestra.run.smithi155.stdout: "event": "all_read", 2023-08-01T19:56:24.434 INFO:teuthology.orchestra.run.smithi155.stdout: "time": "2023-08-01T19:55:05.569861+0000", 2023-08-01T19:56:24.434 INFO:teuthology.orchestra.run.smithi155.stdout: "duration": 0.000111333 2023-08-01T19:56:24.434 INFO:teuthology.orchestra.run.smithi155.stdout: }, 2023-08-01T19:56:24.434 INFO:teuthology.orchestra.run.smithi155.stdout: { 2023-08-01T19:56:24.435 INFO:teuthology.orchestra.run.smithi155.stdout: "event": "dispatched", 2023-08-01T19:56:24.435 INFO:teuthology.orchestra.run.smithi155.stdout: "time": "2023-08-01T19:55:05.569869+0000", 2023-08-01T19:56:24.435 INFO:teuthology.orchestra.run.smithi155.stdout: "duration": 8.8589999999999994e-06 2023-08-01T19:56:24.435 INFO:teuthology.orchestra.run.smithi155.stdout: }, 2023-08-01T19:56:24.435 INFO:teuthology.orchestra.run.smithi155.stdout: { 2023-08-01T19:56:24.435 INFO:teuthology.orchestra.run.smithi155.stdout: "event": "queued_for_pg", 2023-08-01T19:56:24.435 INFO:teuthology.orchestra.run.smithi155.stdout: "time": "2023-08-01T19:55:05.569874+0000", 2023-08-01T19:56:24.436 INFO:teuthology.orchestra.run.smithi155.stdout: "duration": 4.1679999999999997e-06 2023-08-01T19:56:24.436 INFO:teuthology.orchestra.run.smithi155.stdout: }, 2023-08-01T19:56:24.436 INFO:teuthology.orchestra.run.smithi155.stdout: { 2023-08-01T19:56:24.436 INFO:teuthology.orchestra.run.smithi155.stdout: "event": "reached_pg", 2023-08-01T19:56:24.436 INFO:teuthology.orchestra.run.smithi155.stdout: "time": "2023-08-01T19:55:05.569904+0000", 2023-08-01T19:56:24.436 INFO:teuthology.orchestra.run.smithi155.stdout: "duration": 3.0920999999999998e-05 2023-08-01T19:56:24.436 INFO:teuthology.orchestra.run.smithi155.stdout: }, 2023-08-01T19:56:24.436 INFO:teuthology.orchestra.run.smithi155.stdout: { 2023-08-01T19:56:24.437 INFO:teuthology.orchestra.run.smithi155.stdout: "event": "started", 2023-08-01T19:56:24.437 INFO:teuthology.orchestra.run.smithi155.stdout: "time": "2023-08-01T19:55:05.569998+0000", 2023-08-01T19:56:24.437 INFO:teuthology.orchestra.run.smithi155.stdout: "duration": 9.3086999999999998e-05 2023-08-01T19:56:24.437 INFO:teuthology.orchestra.run.smithi155.stdout: }, 2023-08-01T19:56:24.437 INFO:teuthology.orchestra.run.smithi155.stdout: { 2023-08-01T19:56:24.437 INFO:teuthology.orchestra.run.smithi155.stdout: "event": "waiting for subops from 0", 2023-08-01T19:56:24.437 INFO:teuthology.orchestra.run.smithi155.stdout: "time": "2023-08-01T19:55:05.570093+0000", 2023-08-01T19:56:24.437 INFO:teuthology.orchestra.run.smithi155.stdout: "duration": 9.5768999999999997e-05 2023-08-01T19:56:24.438 INFO:teuthology.orchestra.run.smithi155.stdout: }, 2023-08-01T19:56:24.438 INFO:teuthology.orchestra.run.smithi155.stdout: { 2023-08-01T19:56:24.438 INFO:teuthology.orchestra.run.smithi155.stdout: "event": "op_commit", 2023-08-01T19:56:24.438 INFO:teuthology.orchestra.run.smithi155.stdout: "time": "2023-08-01T19:55:05.572839+0000", 2023-08-01T19:56:24.438 INFO:teuthology.orchestra.run.smithi155.stdout: "duration": 0.0027460050000000001 2023-08-01T19:56:24.438 INFO:teuthology.orchestra.run.smithi155.stdout: }, 2023-08-01T19:56:24.438 INFO:teuthology.orchestra.run.smithi155.stdout: { 2023-08-01T19:56:24.438 INFO:teuthology.orchestra.run.smithi155.stdout: "event": "sub_op_commit_rec", 2023-08-01T19:56:24.439 INFO:teuthology.orchestra.run.smithi155.stdout: "time": "2023-08-01T19:55:05.635114+0000", 2023-08-01T19:56:24.439 INFO:teuthology.orchestra.run.smithi155.stdout: "duration": 0.062274297999999999 2023-08-01T19:56:24.439 INFO:teuthology.orchestra.run.smithi155.stdout: }, 2023-08-01T19:56:24.439 INFO:teuthology.orchestra.run.smithi155.stdout: { 2023-08-01T19:56:24.439 INFO:teuthology.orchestra.run.smithi155.stdout: "event": "commit_sent", 2023-08-01T19:56:24.439 INFO:teuthology.orchestra.run.smithi155.stdout: "time": "2023-08-01T19:55:05.635143+0000", 2023-08-01T19:56:24.439 INFO:teuthology.orchestra.run.smithi155.stdout: "duration": 2.9430000000000001e-05 2023-08-01T19:56:24.439 INFO:teuthology.orchestra.run.smithi155.stdout: }, 2023-08-01T19:56:24.440 INFO:teuthology.orchestra.run.smithi155.stdout: { 2023-08-01T19:56:24.440 INFO:teuthology.orchestra.run.smithi155.stdout: "event": "done", 2023-08-01T19:56:24.440 INFO:teuthology.orchestra.run.smithi155.stdout: "time": "2023-08-01T19:55:05.635181+0000", 2023-08-01T19:56:24.440 INFO:teuthology.orchestra.run.smithi155.stdout: "duration": 3.8352000000000001e-05 2023-08-01T19:56:24.440 INFO:teuthology.orchestra.run.smithi155.stdout: } 2023-08-01T19:56:24.440 INFO:teuthology.orchestra.run.smithi155.stdout: ] 2023-08-01T19:56:24.440 INFO:teuthology.orchestra.run.smithi155.stdout: } 2023-08-01T19:56:24.441 INFO:teuthology.orchestra.run.smithi155.stdout: }, 2023-08-01T19:56:24.441 INFO:teuthology.orchestra.run.smithi155.stdout: { 2023-08-01T19:56:24.441 INFO:teuthology.orchestra.run.smithi155.stdout: "description": "osd_op(client.4668.0:100945 5.e 5:73df68dd:::benchmark_data_smithi006_114134_object100944:head [set-alloc-hint object_size 65536 write_size 65536,write 0~65536] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e37)", 2023-08-01T19:56:24.441 INFO:teuthology.orchestra.run.smithi155.stdout: "initiated_at": "2023-08-01T19:55:05.576784+0000", 2023-08-01T19:56:24.441 INFO:teuthology.orchestra.run.smithi155.stdout: "age": 78.727225707000002, 2023-08-01T19:56:24.441 INFO:teuthology.orchestra.run.smithi155.stdout: "duration": 0.058512994999999998, 2023-08-01T19:56:24.441 INFO:teuthology.orchestra.run.smithi155.stdout: "type_data": { 2023-08-01T19:56:24.441 INFO:teuthology.orchestra.run.smithi155.stdout: "flag_point": "commit sent; apply or cleanup", 2023-08-01T19:56:24.442 INFO:teuthology.orchestra.run.smithi155.stdout: "client_info": { 2023-08-01T19:56:24.442 INFO:teuthology.orchestra.run.smithi155.stdout: "client": "client.4668", 2023-08-01T19:56:24.442 INFO:teuthology.orchestra.run.smithi155.stdout: "client_addr": "172.21.15.6:0/1709472247", 2023-08-01T19:56:24.442 INFO:teuthology.orchestra.run.smithi155.stdout: "tid": 100945 2023-08-01T19:56:24.442 INFO:teuthology.orchestra.run.smithi155.stdout: }, 2023-08-01T19:56:24.442 INFO:teuthology.orchestra.run.smithi155.stdout: "events": [ 2023-08-01T19:56:24.442 INFO:teuthology.orchestra.run.smithi155.stdout: { 2023-08-01T19:56:24.442 INFO:teuthology.orchestra.run.smithi155.stdout: "event": "initiated", 2023-08-01T19:56:24.443 INFO:teuthology.orchestra.run.smithi155.stdout: "time": "2023-08-01T19:55:05.576784+0000", 2023-08-01T19:56:24.443 INFO:teuthology.orchestra.run.smithi155.stdout: "duration": 0 2023-08-01T19:56:24.443 INFO:teuthology.orchestra.run.smithi155.stdout: }, 2023-08-01T19:56:24.443 INFO:teuthology.orchestra.run.smithi155.stdout: { 2023-08-01T19:56:24.443 INFO:teuthology.orchestra.run.smithi155.stdout: "event": "throttled", 2023-08-01T19:56:24.443 INFO:teuthology.orchestra.run.smithi155.stdout: "time": "2023-08-01T19:55:05.576784+0000", 2023-08-01T19:56:24.443 INFO:teuthology.orchestra.run.smithi155.stdout: "duration": 0 2023-08-01T19:56:24.443 INFO:teuthology.orchestra.run.smithi155.stdout: }, 2023-08-01T19:56:24.444 INFO:teuthology.orchestra.run.smithi155.stdout: { 2023-08-01T19:56:24.444 INFO:teuthology.orchestra.run.smithi155.stdout: "event": "header_read", 2023-08-01T19:56:24.444 INFO:teuthology.orchestra.run.smithi155.stdout: "time": "2023-08-01T19:55:05.576783+0000", 2023-08-01T19:56:24.444 INFO:teuthology.orchestra.run.smithi155.stdout: "duration": 4294967295.9999995 2023-08-01T19:56:24.444 INFO:teuthology.orchestra.run.smithi155.stdout: }, 2023-08-01T19:56:24.444 INFO:teuthology.orchestra.run.smithi155.stdout: { 2023-08-01T19:56:24.444 INFO:teuthology.orchestra.run.smithi155.stdout: "event": "all_read", 2023-08-01T19:56:24.445 INFO:teuthology.orchestra.run.smithi155.stdout: "time": "2023-08-01T19:55:05.576807+0000", 2023-08-01T19:56:24.445 INFO:teuthology.orchestra.run.smithi155.stdout: "duration": 2.3651000000000001e-05 2023-08-01T19:56:24.445 INFO:teuthology.orchestra.run.smithi155.stdout: }, 2023-08-01T19:56:24.445 INFO:teuthology.orchestra.run.smithi155.stdout: { 2023-08-01T19:56:24.445 INFO:teuthology.orchestra.run.smithi155.stdout: "event": "dispatched", 2023-08-01T19:56:24.445 INFO:teuthology.orchestra.run.smithi155.stdout: "time": "2023-08-01T19:55:05.576817+0000", 2023-08-01T19:56:24.445 INFO:teuthology.orchestra.run.smithi155.stdout: "duration": 9.9389999999999992e-06 2023-08-01T19:56:24.445 INFO:teuthology.orchestra.run.smithi155.stdout: }, 2023-08-01T19:56:24.446 INFO:teuthology.orchestra.run.smithi155.stdout: { 2023-08-01T19:56:24.446 INFO:teuthology.orchestra.run.smithi155.stdout: "event": "queued_for_pg", 2023-08-01T19:56:24.446 INFO:teuthology.orchestra.run.smithi155.stdout: "time": "2023-08-01T19:55:05.576820+0000", 2023-08-01T19:56:24.446 INFO:teuthology.orchestra.run.smithi155.stdout: "duration": 3.2619999999999999e-06 2023-08-01T19:56:24.446 INFO:teuthology.orchestra.run.smithi155.stdout: }, 2023-08-01T19:56:24.446 INFO:teuthology.orchestra.run.smithi155.stdout: { 2023-08-01T19:56:24.446 INFO:teuthology.orchestra.run.smithi155.stdout: "event": "reached_pg", 2023-08-01T19:56:24.446 INFO:teuthology.orchestra.run.smithi155.stdout: "time": "2023-08-01T19:55:05.576849+0000", 2023-08-01T19:56:24.447 INFO:teuthology.orchestra.run.smithi155.stdout: "duration": 2.8880000000000001e-05 2023-08-01T19:56:24.447 INFO:teuthology.orchestra.run.smithi155.stdout: }, 2023-08-01T19:56:24.447 INFO:teuthology.orchestra.run.smithi155.stdout: { 2023-08-01T19:56:24.447 INFO:teuthology.orchestra.run.smithi155.stdout: "event": "started", 2023-08-01T19:56:24.447 INFO:teuthology.orchestra.run.smithi155.stdout: "time": "2023-08-01T19:55:05.576940+0000", 2023-08-01T19:56:24.447 INFO:teuthology.orchestra.run.smithi155.stdout: "duration": 9.0570999999999997e-05 2023-08-01T19:56:24.447 INFO:teuthology.orchestra.run.smithi155.stdout: }, 2023-08-01T19:56:24.447 INFO:teuthology.orchestra.run.smithi155.stdout: { 2023-08-01T19:56:24.448 INFO:teuthology.orchestra.run.smithi155.stdout: "event": "waiting for subops from 0", 2023-08-01T19:56:24.448 INFO:teuthology.orchestra.run.smithi155.stdout: "time": "2023-08-01T19:55:05.577027+0000", 2023-08-01T19:56:24.448 INFO:teuthology.orchestra.run.smithi155.stdout: "duration": 8.7237999999999994e-05 2023-08-01T19:56:24.448 INFO:teuthology.orchestra.run.smithi155.stdout: }, 2023-08-01T19:56:24.448 INFO:teuthology.orchestra.run.smithi155.stdout: { 2023-08-01T19:56:24.448 INFO:teuthology.orchestra.run.smithi155.stdout: "event": "op_commit", 2023-08-01T19:56:24.448 INFO:teuthology.orchestra.run.smithi155.stdout: "time": "2023-08-01T19:55:05.579624+0000", 2023-08-01T19:56:24.449 INFO:teuthology.orchestra.run.smithi155.stdout: "duration": 0.0025971200000000001 2023-08-01T19:56:24.449 INFO:teuthology.orchestra.run.smithi155.stdout: }, 2023-08-01T19:56:24.449 INFO:teuthology.orchestra.run.smithi155.stdout: { 2023-08-01T19:56:24.449 INFO:teuthology.orchestra.run.smithi155.stdout: "event": "sub_op_commit_rec", 2023-08-01T19:56:24.449 INFO:teuthology.orchestra.run.smithi155.stdout: "time": "2023-08-01T19:55:05.635218+0000", 2023-08-01T19:56:24.449 INFO:teuthology.orchestra.run.smithi155.stdout: "duration": 0.055594487999999997 2023-08-01T19:56:24.449 INFO:teuthology.orchestra.run.smithi155.stdout: }, 2023-08-01T19:56:24.449 INFO:teuthology.orchestra.run.smithi155.stdout: { 2023-08-01T19:56:24.450 INFO:teuthology.orchestra.run.smithi155.stdout: "event": "commit_sent", 2023-08-01T19:56:24.450 INFO:teuthology.orchestra.run.smithi155.stdout: "time": "2023-08-01T19:55:05.635262+0000", 2023-08-01T19:56:24.450 INFO:teuthology.orchestra.run.smithi155.stdout: "duration": 4.3380999999999997e-05 2023-08-01T19:56:24.450 INFO:teuthology.orchestra.run.smithi155.stdout: }, 2023-08-01T19:56:24.450 INFO:teuthology.orchestra.run.smithi155.stdout: { 2023-08-01T19:56:24.450 INFO:teuthology.orchestra.run.smithi155.stdout: "event": "done", 2023-08-01T19:56:24.450 INFO:teuthology.orchestra.run.smithi155.stdout: "time": "2023-08-01T19:55:05.635297+0000", 2023-08-01T19:56:24.450 INFO:teuthology.orchestra.run.smithi155.stdout: "duration": 3.4842000000000003e-05 2023-08-01T19:56:24.451 INFO:teuthology.orchestra.run.smithi155.stdout: } 2023-08-01T19:56:24.451 INFO:teuthology.orchestra.run.smithi155.stdout: ] 2023-08-01T19:56:24.451 INFO:teuthology.orchestra.run.smithi155.stdout: } 2023-08-01T19:56:24.451 INFO:teuthology.orchestra.run.smithi155.stdout: }, 2023-08-01T19:56:24.451 INFO:teuthology.orchestra.run.smithi155.stdout: { 2023-08-01T19:56:24.451 INFO:teuthology.orchestra.run.smithi155.stdout: "description": "osd_op(client.4668.0:100947 5.4 5:23e8fc27:::benchmark_data_smithi006_114134_object100946:head [set-alloc-hint object_size 65536 write_size 65536,write 0~65536] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e37)", 2023-08-01T19:56:24.451 INFO:teuthology.orchestra.run.smithi155.stdout: "initiated_at": "2023-08-01T19:55:05.576840+0000", 2023-08-01T19:56:24.451 INFO:teuthology.orchestra.run.smithi155.stdout: "age": 78.727169652000001, 2023-08-01T19:56:24.452 INFO:teuthology.orchestra.run.smithi155.stdout: "duration": 0.058423127999999998, 2023-08-01T19:56:24.452 INFO:teuthology.orchestra.run.smithi155.stdout: "type_data": { 2023-08-01T19:56:24.452 INFO:teuthology.orchestra.run.smithi155.stdout: "flag_point": "commit sent; apply or cleanup", 2023-08-01T19:56:24.452 INFO:teuthology.orchestra.run.smithi155.stdout: "client_info": { 2023-08-01T19:56:24.452 INFO:teuthology.orchestra.run.smithi155.stdout: "client": "client.4668", 2023-08-01T19:56:24.452 INFO:teuthology.orchestra.run.smithi155.stdout: "client_addr": "172.21.15.6:0/1709472247", 2023-08-01T19:56:24.452 INFO:teuthology.orchestra.run.smithi155.stdout: "tid": 100947 2023-08-01T19:56:24.453 INFO:teuthology.orchestra.run.smithi155.stdout: }, 2023-08-01T19:56:24.453 INFO:teuthology.orchestra.run.smithi155.stdout: "events": [ 2023-08-01T19:56:24.453 INFO:teuthology.orchestra.run.smithi155.stdout: { 2023-08-01T19:56:24.453 INFO:teuthology.orchestra.run.smithi155.stdout: "event": "initiated", 2023-08-01T19:56:24.453 INFO:teuthology.orchestra.run.smithi155.stdout: "time": "2023-08-01T19:55:05.576840+0000", 2023-08-01T19:56:24.453 INFO:teuthology.orchestra.run.smithi155.stdout: "duration": 0 2023-08-01T19:56:24.453 INFO:teuthology.orchestra.run.smithi155.stdout: }, 2023-08-01T19:56:24.453 INFO:teuthology.orchestra.run.smithi155.stdout: { 2023-08-01T19:56:24.454 INFO:teuthology.orchestra.run.smithi155.stdout: "event": "throttled", 2023-08-01T19:56:24.454 INFO:teuthology.orchestra.run.smithi155.stdout: "time": "2023-08-01T19:55:05.576840+0000", 2023-08-01T19:56:24.454 INFO:teuthology.orchestra.run.smithi155.stdout: "duration": 0 2023-08-01T19:56:24.454 INFO:teuthology.orchestra.run.smithi155.stdout: }, 2023-08-01T19:56:24.454 INFO:teuthology.orchestra.run.smithi155.stdout: { 2023-08-01T19:56:24.454 INFO:teuthology.orchestra.run.smithi155.stdout: "event": "header_read", 2023-08-01T19:56:24.454 INFO:teuthology.orchestra.run.smithi155.stdout: "time": "2023-08-01T19:55:05.576839+0000", 2023-08-01T19:56:24.454 INFO:teuthology.orchestra.run.smithi155.stdout: "duration": 4294967295.9999995 2023-08-01T19:56:24.455 INFO:teuthology.orchestra.run.smithi155.stdout: }, 2023-08-01T19:56:24.455 INFO:teuthology.orchestra.run.smithi155.stdout: { 2023-08-01T19:56:24.455 INFO:teuthology.orchestra.run.smithi155.stdout: "event": "all_read", 2023-08-01T19:56:24.455 INFO:teuthology.orchestra.run.smithi155.stdout: "time": "2023-08-01T19:55:05.576893+0000", 2023-08-01T19:56:24.455 INFO:teuthology.orchestra.run.smithi155.stdout: "duration": 5.3893000000000001e-05 2023-08-01T19:56:24.455 INFO:teuthology.orchestra.run.smithi155.stdout: }, 2023-08-01T19:56:24.455 INFO:teuthology.orchestra.run.smithi155.stdout: { 2023-08-01T19:56:24.455 INFO:teuthology.orchestra.run.smithi155.stdout: "event": "dispatched", 2023-08-01T19:56:24.456 INFO:teuthology.orchestra.run.smithi155.stdout: "time": "2023-08-01T19:55:05.576902+0000", 2023-08-01T19:56:24.456 INFO:teuthology.orchestra.run.smithi155.stdout: "duration": 8.7520000000000002e-06 2023-08-01T19:56:24.456 INFO:teuthology.orchestra.run.smithi155.stdout: }, 2023-08-01T19:56:24.456 INFO:teuthology.orchestra.run.smithi155.stdout: { 2023-08-01T19:56:24.456 INFO:teuthology.orchestra.run.smithi155.stdout: "event": "queued_for_pg", 2023-08-01T19:56:24.456 INFO:teuthology.orchestra.run.smithi155.stdout: "time": "2023-08-01T19:55:05.576905+0000", 2023-08-01T19:56:24.456 INFO:teuthology.orchestra.run.smithi155.stdout: "duration": 3.01e-06 2023-08-01T19:56:24.457 INFO:teuthology.orchestra.run.smithi155.stdout: }, 2023-08-01T19:56:24.457 INFO:teuthology.orchestra.run.smithi155.stdout: { 2023-08-01T19:56:24.457 INFO:teuthology.orchestra.run.smithi155.stdout: "event": "reached_pg", 2023-08-01T19:56:24.457 INFO:teuthology.orchestra.run.smithi155.stdout: "time": "2023-08-01T19:55:05.579641+0000", 2023-08-01T19:56:24.457 INFO:teuthology.orchestra.run.smithi155.stdout: "duration": 0.0027366880000000001 2023-08-01T19:56:24.457 INFO:teuthology.orchestra.run.smithi155.stdout: }, 2023-08-01T19:56:24.457 INFO:teuthology.orchestra.run.smithi155.stdout: { 2023-08-01T19:56:24.457 INFO:teuthology.orchestra.run.smithi155.stdout: "event": "started", 2023-08-01T19:56:24.458 INFO:teuthology.orchestra.run.smithi155.stdout: "time": "2023-08-01T19:55:05.579734+0000", 2023-08-01T19:56:24.458 INFO:teuthology.orchestra.run.smithi155.stdout: "duration": 9.2590000000000006e-05 2023-08-01T19:56:24.458 INFO:teuthology.orchestra.run.smithi155.stdout: }, 2023-08-01T19:56:24.458 INFO:teuthology.orchestra.run.smithi155.stdout: { 2023-08-01T19:56:24.458 INFO:teuthology.orchestra.run.smithi155.stdout: "event": "waiting for subops from 0", 2023-08-01T19:56:24.458 INFO:teuthology.orchestra.run.smithi155.stdout: "time": "2023-08-01T19:55:05.579825+0000", 2023-08-01T19:56:24.458 INFO:teuthology.orchestra.run.smithi155.stdout: "duration": 9.0964999999999994e-05 2023-08-01T19:56:24.458 INFO:teuthology.orchestra.run.smithi155.stdout: }, 2023-08-01T19:56:24.459 INFO:teuthology.orchestra.run.smithi155.stdout: { 2023-08-01T19:56:24.459 INFO:teuthology.orchestra.run.smithi155.stdout: "event": "op_commit", 2023-08-01T19:56:24.459 INFO:teuthology.orchestra.run.smithi155.stdout: "time": "2023-08-01T19:55:05.585041+0000", 2023-08-01T19:56:24.459 INFO:teuthology.orchestra.run.smithi155.stdout: "duration": 0.0052159670000000002 2023-08-01T19:56:24.459 INFO:teuthology.orchestra.run.smithi155.stdout: }, 2023-08-01T19:56:24.459 INFO:teuthology.orchestra.run.smithi155.stdout: { 2023-08-01T19:56:24.459 INFO:teuthology.orchestra.run.smithi155.stdout: "event": "sub_op_commit_rec", 2023-08-01T19:56:24.459 INFO:teuthology.orchestra.run.smithi155.stdout: "time": "2023-08-01T19:55:05.635199+0000", 2023-08-01T19:56:24.460 INFO:teuthology.orchestra.run.smithi155.stdout: "duration": 0.050158023000000003 2023-08-01T19:56:24.460 INFO:teuthology.orchestra.run.smithi155.stdout: }, 2023-08-01T19:56:24.460 INFO:teuthology.orchestra.run.smithi155.stdout: { 2023-08-01T19:56:24.460 INFO:teuthology.orchestra.run.smithi155.stdout: "event": "commit_sent", 2023-08-01T19:56:24.460 INFO:teuthology.orchestra.run.smithi155.stdout: "time": "2023-08-01T19:55:05.635227+0000", 2023-08-01T19:56:24.460 INFO:teuthology.orchestra.run.smithi155.stdout: "duration": 2.7821e-05 2023-08-01T19:56:24.460 INFO:teuthology.orchestra.run.smithi155.stdout: }, 2023-08-01T19:56:24.460 INFO:teuthology.orchestra.run.smithi155.stdout: { 2023-08-01T19:56:24.461 INFO:teuthology.orchestra.run.smithi155.stdout: "event": "done", 2023-08-01T19:56:24.461 INFO:teuthology.orchestra.run.smithi155.stdout: "time": "2023-08-01T19:55:05.635263+0000", 2023-08-01T19:56:24.461 INFO:teuthology.orchestra.run.smithi155.stdout: "duration": 3.6081000000000002e-05 2023-08-01T19:56:24.461 INFO:teuthology.orchestra.run.smithi155.stdout: } 2023-08-01T19:56:24.461 INFO:teuthology.orchestra.run.smithi155.stdout: ] 2023-08-01T19:56:24.461 INFO:teuthology.orchestra.run.smithi155.stdout: } 2023-08-01T19:56:24.461 INFO:teuthology.orchestra.run.smithi155.stdout: }, 2023-08-01T19:56:24.461 INFO:teuthology.orchestra.run.smithi155.stdout: { 2023-08-01T19:56:24.462 INFO:teuthology.orchestra.run.smithi155.stdout: "description": "osd_op(client.4668.0:197408 5.d 5:bbda375a:::benchmark_data_smithi006_114134_object63747:head [delete] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e61)", 2023-08-01T19:56:24.462 INFO:teuthology.orchestra.run.smithi155.stdout: "initiated_at": "2023-08-01T19:55:58.559714+0000", 2023-08-01T19:56:24.462 INFO:teuthology.orchestra.run.smithi155.stdout: "age": 25.744295664999999, 2023-08-01T19:56:24.462 INFO:teuthology.orchestra.run.smithi155.stdout: "duration": 1.047043671, 2023-08-01T19:56:24.462 INFO:teuthology.orchestra.run.smithi155.stdout: "type_data": { 2023-08-01T19:56:24.462 INFO:teuthology.orchestra.run.smithi155.stdout: "flag_point": "commit sent; apply or cleanup", 2023-08-01T19:56:24.462 INFO:teuthology.orchestra.run.smithi155.stdout: "client_info": { 2023-08-01T19:56:24.462 INFO:teuthology.orchestra.run.smithi155.stdout: "client": "client.4668", 2023-08-01T19:56:24.463 INFO:teuthology.orchestra.run.smithi155.stdout: "client_addr": "172.21.15.6:0/1709472247", 2023-08-01T19:56:24.463 INFO:teuthology.orchestra.run.smithi155.stdout: "tid": 197408 2023-08-01T19:56:24.463 INFO:teuthology.orchestra.run.smithi155.stdout: }, 2023-08-01T19:56:24.463 INFO:teuthology.orchestra.run.smithi155.stdout: "events": [ 2023-08-01T19:56:24.463 INFO:teuthology.orchestra.run.smithi155.stdout: { 2023-08-01T19:56:24.463 INFO:teuthology.orchestra.run.smithi155.stdout: "event": "initiated", 2023-08-01T19:56:24.463 INFO:teuthology.orchestra.run.smithi155.stdout: "time": "2023-08-01T19:55:58.559714+0000", 2023-08-01T19:56:24.464 INFO:teuthology.orchestra.run.smithi155.stdout: "duration": 0 2023-08-01T19:56:24.464 INFO:teuthology.orchestra.run.smithi155.stdout: }, 2023-08-01T19:56:24.464 INFO:teuthology.orchestra.run.smithi155.stdout: { 2023-08-01T19:56:24.464 INFO:teuthology.orchestra.run.smithi155.stdout: "event": "throttled", 2023-08-01T19:56:24.464 INFO:teuthology.orchestra.run.smithi155.stdout: "time": "2023-08-01T19:55:58.559714+0000", 2023-08-01T19:56:24.464 INFO:teuthology.orchestra.run.smithi155.stdout: "duration": 0 2023-08-01T19:56:24.464 INFO:teuthology.orchestra.run.smithi155.stdout: }, 2023-08-01T19:56:24.464 INFO:teuthology.orchestra.run.smithi155.stdout: { 2023-08-01T19:56:24.465 INFO:teuthology.orchestra.run.smithi155.stdout: "event": "header_read", 2023-08-01T19:56:24.465 INFO:teuthology.orchestra.run.smithi155.stdout: "time": "2023-08-01T19:55:58.559713+0000", 2023-08-01T19:56:24.465 INFO:teuthology.orchestra.run.smithi155.stdout: "duration": 4294967295.999999 2023-08-01T19:56:24.465 INFO:teuthology.orchestra.run.smithi155.stdout: }, 2023-08-01T19:56:24.465 INFO:teuthology.orchestra.run.smithi155.stdout: { 2023-08-01T19:56:24.465 INFO:teuthology.orchestra.run.smithi155.stdout: "event": "all_read", 2023-08-01T19:56:24.465 INFO:teuthology.orchestra.run.smithi155.stdout: "time": "2023-08-01T19:55:58.559717+0000", 2023-08-01T19:56:24.465 INFO:teuthology.orchestra.run.smithi155.stdout: "duration": 4.2860000000000001e-06 2023-08-01T19:56:24.466 INFO:teuthology.orchestra.run.smithi155.stdout: }, 2023-08-01T19:56:24.466 INFO:teuthology.orchestra.run.smithi155.stdout: { 2023-08-01T19:56:24.466 INFO:teuthology.orchestra.run.smithi155.stdout: "event": "dispatched", 2023-08-01T19:56:24.466 INFO:teuthology.orchestra.run.smithi155.stdout: "time": "2023-08-01T19:55:58.559774+0000", 2023-08-01T19:56:24.466 INFO:teuthology.orchestra.run.smithi155.stdout: "duration": 5.6508999999999997e-05 2023-08-01T19:56:24.466 INFO:teuthology.orchestra.run.smithi155.stdout: }, 2023-08-01T19:56:24.466 INFO:teuthology.orchestra.run.smithi155.stdout: { 2023-08-01T19:56:24.466 INFO:teuthology.orchestra.run.smithi155.stdout: "event": "queued_for_pg", 2023-08-01T19:56:24.467 INFO:teuthology.orchestra.run.smithi155.stdout: "time": "2023-08-01T19:55:58.559781+0000", 2023-08-01T19:56:24.467 INFO:teuthology.orchestra.run.smithi155.stdout: "duration": 7.1829999999999997e-06 2023-08-01T19:56:24.467 INFO:teuthology.orchestra.run.smithi155.stdout: }, 2023-08-01T19:56:24.467 INFO:teuthology.orchestra.run.smithi155.stdout: { 2023-08-01T19:56:24.467 INFO:teuthology.orchestra.run.smithi155.stdout: "event": "reached_pg", 2023-08-01T19:56:24.467 INFO:teuthology.orchestra.run.smithi155.stdout: "time": "2023-08-01T19:55:58.571621+0000", 2023-08-01T19:56:24.467 INFO:teuthology.orchestra.run.smithi155.stdout: "duration": 0.011840603999999999 2023-08-01T19:56:24.467 INFO:teuthology.orchestra.run.smithi155.stdout: }, 2023-08-01T19:56:24.468 INFO:teuthology.orchestra.run.smithi155.stdout: { 2023-08-01T19:56:24.468 INFO:teuthology.orchestra.run.smithi155.stdout: "event": "waiting for peered", 2023-08-01T19:56:24.468 INFO:teuthology.orchestra.run.smithi155.stdout: "time": "2023-08-01T19:55:58.571630+0000", 2023-08-01T19:56:24.468 INFO:teuthology.orchestra.run.smithi155.stdout: "duration": 8.9770000000000006e-06 2023-08-01T19:56:24.468 INFO:teuthology.orchestra.run.smithi155.stdout: }, 2023-08-01T19:56:24.468 INFO:teuthology.orchestra.run.smithi155.stdout: { 2023-08-01T19:56:24.468 INFO:teuthology.orchestra.run.smithi155.stdout: "event": "reached_pg", 2023-08-01T19:56:24.469 INFO:teuthology.orchestra.run.smithi155.stdout: "time": "2023-08-01T19:55:59.601300+0000", 2023-08-01T19:56:24.469 INFO:teuthology.orchestra.run.smithi155.stdout: "duration": 1.0296694989999999 2023-08-01T19:56:24.469 INFO:teuthology.orchestra.run.smithi155.stdout: }, 2023-08-01T19:56:24.469 INFO:teuthology.orchestra.run.smithi155.stdout: { 2023-08-01T19:56:24.469 INFO:teuthology.orchestra.run.smithi155.stdout: "event": "started", 2023-08-01T19:56:24.469 INFO:teuthology.orchestra.run.smithi155.stdout: "time": "2023-08-01T19:55:59.601448+0000", 2023-08-01T19:56:24.469 INFO:teuthology.orchestra.run.smithi155.stdout: "duration": 0.00014828399999999999 2023-08-01T19:56:24.469 INFO:teuthology.orchestra.run.smithi155.stdout: }, 2023-08-01T19:56:24.470 INFO:teuthology.orchestra.run.smithi155.stdout: { 2023-08-01T19:56:24.470 INFO:teuthology.orchestra.run.smithi155.stdout: "event": "op_commit", 2023-08-01T19:56:24.470 INFO:teuthology.orchestra.run.smithi155.stdout: "time": "2023-08-01T19:55:59.606616+0000", 2023-08-01T19:56:24.470 INFO:teuthology.orchestra.run.smithi155.stdout: "duration": 0.0051679769999999998 2023-08-01T19:56:24.470 INFO:teuthology.orchestra.run.smithi155.stdout: }, 2023-08-01T19:56:24.470 INFO:teuthology.orchestra.run.smithi155.stdout: { 2023-08-01T19:56:24.470 INFO:teuthology.orchestra.run.smithi155.stdout: "event": "commit_sent", 2023-08-01T19:56:24.470 INFO:teuthology.orchestra.run.smithi155.stdout: "time": "2023-08-01T19:55:59.606662+0000", 2023-08-01T19:56:24.471 INFO:teuthology.orchestra.run.smithi155.stdout: "duration": 4.5843000000000001e-05 2023-08-01T19:56:24.471 INFO:teuthology.orchestra.run.smithi155.stdout: }, 2023-08-01T19:56:24.471 INFO:teuthology.orchestra.run.smithi155.stdout: { 2023-08-01T19:56:24.471 INFO:teuthology.orchestra.run.smithi155.stdout: "event": "done", 2023-08-01T19:56:24.471 INFO:teuthology.orchestra.run.smithi155.stdout: "time": "2023-08-01T19:55:59.606757+0000", 2023-08-01T19:56:24.471 INFO:teuthology.orchestra.run.smithi155.stdout: "duration": 9.5373999999999999e-05 2023-08-01T19:56:24.471 INFO:teuthology.orchestra.run.smithi155.stdout: } 2023-08-01T19:56:24.471 INFO:teuthology.orchestra.run.smithi155.stdout: ] 2023-08-01T19:56:24.472 INFO:teuthology.orchestra.run.smithi155.stdout: } 2023-08-01T19:56:24.472 INFO:teuthology.orchestra.run.smithi155.stdout: }, 2023-08-01T19:56:24.472 INFO:teuthology.orchestra.run.smithi155.stdout: { 2023-08-01T19:56:24.472 INFO:teuthology.orchestra.run.smithi155.stdout: "description": "osd_op(client.4668.0:197416 5.d 5:bd99e66d:::benchmark_data_smithi006_114134_object63755:head [delete] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e62)", 2023-08-01T19:56:24.472 INFO:teuthology.orchestra.run.smithi155.stdout: "initiated_at": "2023-08-01T19:55:58.577369+0000", 2023-08-01T19:56:24.472 INFO:teuthology.orchestra.run.smithi155.stdout: "age": 25.726640688, 2023-08-01T19:56:24.472 INFO:teuthology.orchestra.run.smithi155.stdout: "duration": 1.0300980120000001, 2023-08-01T19:56:24.473 INFO:teuthology.orchestra.run.smithi155.stdout: "type_data": { 2023-08-01T19:56:24.473 INFO:teuthology.orchestra.run.smithi155.stdout: "flag_point": "commit sent; apply or cleanup", 2023-08-01T19:56:24.473 INFO:teuthology.orchestra.run.smithi155.stdout: "client_info": { 2023-08-01T19:56:24.473 INFO:teuthology.orchestra.run.smithi155.stdout: "client": "client.4668", 2023-08-01T19:56:24.473 INFO:teuthology.orchestra.run.smithi155.stdout: "client_addr": "172.21.15.6:0/1709472247", 2023-08-01T19:56:24.473 INFO:teuthology.orchestra.run.smithi155.stdout: "tid": 197416 2023-08-01T19:56:24.473 INFO:teuthology.orchestra.run.smithi155.stdout: }, 2023-08-01T19:56:24.473 INFO:teuthology.orchestra.run.smithi155.stdout: "events": [ 2023-08-01T19:56:24.474 INFO:teuthology.orchestra.run.smithi155.stdout: { 2023-08-01T19:56:24.474 INFO:teuthology.orchestra.run.smithi155.stdout: "event": "initiated", 2023-08-01T19:56:24.474 INFO:teuthology.orchestra.run.smithi155.stdout: "time": "2023-08-01T19:55:58.577369+0000", 2023-08-01T19:56:24.474 INFO:teuthology.orchestra.run.smithi155.stdout: "duration": 0 2023-08-01T19:56:24.474 INFO:teuthology.orchestra.run.smithi155.stdout: }, 2023-08-01T19:56:24.474 INFO:teuthology.orchestra.run.smithi155.stdout: { 2023-08-01T19:56:24.474 INFO:teuthology.orchestra.run.smithi155.stdout: "event": "throttled", 2023-08-01T19:56:24.474 INFO:teuthology.orchestra.run.smithi155.stdout: "time": "2023-08-01T19:55:58.577369+0000", 2023-08-01T19:56:24.475 INFO:teuthology.orchestra.run.smithi155.stdout: "duration": 0 2023-08-01T19:56:24.475 INFO:teuthology.orchestra.run.smithi155.stdout: }, 2023-08-01T19:56:24.475 INFO:teuthology.orchestra.run.smithi155.stdout: { 2023-08-01T19:56:24.475 INFO:teuthology.orchestra.run.smithi155.stdout: "event": "header_read", 2023-08-01T19:56:24.475 INFO:teuthology.orchestra.run.smithi155.stdout: "time": "2023-08-01T19:55:58.577368+0000", 2023-08-01T19:56:24.475 INFO:teuthology.orchestra.run.smithi155.stdout: "duration": 4294967295.9999995 2023-08-01T19:56:24.475 INFO:teuthology.orchestra.run.smithi155.stdout: }, 2023-08-01T19:56:24.475 INFO:teuthology.orchestra.run.smithi155.stdout: { 2023-08-01T19:56:24.476 INFO:teuthology.orchestra.run.smithi155.stdout: "event": "all_read", 2023-08-01T19:56:24.476 INFO:teuthology.orchestra.run.smithi155.stdout: "time": "2023-08-01T19:55:58.577370+0000", 2023-08-01T19:56:24.476 INFO:teuthology.orchestra.run.smithi155.stdout: "duration": 2.1150000000000001e-06 2023-08-01T19:56:24.476 INFO:teuthology.orchestra.run.smithi155.stdout: }, 2023-08-01T19:56:24.476 INFO:teuthology.orchestra.run.smithi155.stdout: { 2023-08-01T19:56:24.476 INFO:teuthology.orchestra.run.smithi155.stdout: "event": "dispatched", 2023-08-01T19:56:24.476 INFO:teuthology.orchestra.run.smithi155.stdout: "time": "2023-08-01T19:55:58.577377+0000", 2023-08-01T19:56:24.477 INFO:teuthology.orchestra.run.smithi155.stdout: "duration": 6.6610000000000003e-06 2023-08-01T19:56:24.477 INFO:teuthology.orchestra.run.smithi155.stdout: }, 2023-08-01T19:56:24.477 INFO:teuthology.orchestra.run.smithi155.stdout: { 2023-08-01T19:56:24.477 INFO:teuthology.orchestra.run.smithi155.stdout: "event": "queued_for_pg", 2023-08-01T19:56:24.477 INFO:teuthology.orchestra.run.smithi155.stdout: "time": "2023-08-01T19:55:58.577380+0000", 2023-08-01T19:56:24.477 INFO:teuthology.orchestra.run.smithi155.stdout: "duration": 2.7360000000000001e-06 2023-08-01T19:56:24.477 INFO:teuthology.orchestra.run.smithi155.stdout: }, 2023-08-01T19:56:24.477 INFO:teuthology.orchestra.run.smithi155.stdout: { 2023-08-01T19:56:24.478 INFO:teuthology.orchestra.run.smithi155.stdout: "event": "reached_pg", 2023-08-01T19:56:24.478 INFO:teuthology.orchestra.run.smithi155.stdout: "time": "2023-08-01T19:55:58.577405+0000", 2023-08-01T19:56:24.478 INFO:teuthology.orchestra.run.smithi155.stdout: "duration": 2.4929000000000001e-05 2023-08-01T19:56:24.478 INFO:teuthology.orchestra.run.smithi155.stdout: }, 2023-08-01T19:56:24.478 INFO:teuthology.orchestra.run.smithi155.stdout: { 2023-08-01T19:56:24.478 INFO:teuthology.orchestra.run.smithi155.stdout: "event": "waiting for peered", 2023-08-01T19:56:24.478 INFO:teuthology.orchestra.run.smithi155.stdout: "time": "2023-08-01T19:55:58.577409+0000", 2023-08-01T19:56:24.478 INFO:teuthology.orchestra.run.smithi155.stdout: "duration": 4.0799999999999999e-06 2023-08-01T19:56:24.479 INFO:teuthology.orchestra.run.smithi155.stdout: }, 2023-08-01T19:56:24.479 INFO:teuthology.orchestra.run.smithi155.stdout: { 2023-08-01T19:56:24.479 INFO:teuthology.orchestra.run.smithi155.stdout: "event": "reached_pg", 2023-08-01T19:56:24.479 INFO:teuthology.orchestra.run.smithi155.stdout: "time": "2023-08-01T19:55:59.603639+0000", 2023-08-01T19:56:24.479 INFO:teuthology.orchestra.run.smithi155.stdout: "duration": 1.0262299349999999 2023-08-01T19:56:24.479 INFO:teuthology.orchestra.run.smithi155.stdout: }, 2023-08-01T19:56:24.479 INFO:teuthology.orchestra.run.smithi155.stdout: { 2023-08-01T19:56:24.479 INFO:teuthology.orchestra.run.smithi155.stdout: "event": "started", 2023-08-01T19:56:24.480 INFO:teuthology.orchestra.run.smithi155.stdout: "time": "2023-08-01T19:55:59.603772+0000", 2023-08-01T19:56:24.480 INFO:teuthology.orchestra.run.smithi155.stdout: "duration": 0.000133153 2023-08-01T19:56:24.480 INFO:teuthology.orchestra.run.smithi155.stdout: }, 2023-08-01T19:56:24.480 INFO:teuthology.orchestra.run.smithi155.stdout: { 2023-08-01T19:56:24.480 INFO:teuthology.orchestra.run.smithi155.stdout: "event": "op_commit", 2023-08-01T19:56:24.480 INFO:teuthology.orchestra.run.smithi155.stdout: "time": "2023-08-01T19:55:59.607354+0000", 2023-08-01T19:56:24.480 INFO:teuthology.orchestra.run.smithi155.stdout: "duration": 0.0035819599999999999 2023-08-01T19:56:24.480 INFO:teuthology.orchestra.run.smithi155.stdout: }, 2023-08-01T19:56:24.481 INFO:teuthology.orchestra.run.smithi155.stdout: { 2023-08-01T19:56:24.481 INFO:teuthology.orchestra.run.smithi155.stdout: "event": "commit_sent", 2023-08-01T19:56:24.481 INFO:teuthology.orchestra.run.smithi155.stdout: "time": "2023-08-01T19:55:59.607396+0000", 2023-08-01T19:56:24.481 INFO:teuthology.orchestra.run.smithi155.stdout: "duration": 4.2423999999999999e-05 2023-08-01T19:56:24.481 INFO:teuthology.orchestra.run.smithi155.stdout: }, 2023-08-01T19:56:24.481 INFO:teuthology.orchestra.run.smithi155.stdout: { 2023-08-01T19:56:24.481 INFO:teuthology.orchestra.run.smithi155.stdout: "event": "done", 2023-08-01T19:56:24.482 INFO:teuthology.orchestra.run.smithi155.stdout: "time": "2023-08-01T19:55:59.607467+0000", 2023-08-01T19:56:24.482 INFO:teuthology.orchestra.run.smithi155.stdout: "duration": 7.0360999999999999e-05 2023-08-01T19:56:24.482 INFO:teuthology.orchestra.run.smithi155.stdout: } 2023-08-01T19:56:24.482 INFO:teuthology.orchestra.run.smithi155.stdout: ] 2023-08-01T19:56:24.482 INFO:teuthology.orchestra.run.smithi155.stdout: } 2023-08-01T19:56:24.482 INFO:teuthology.orchestra.run.smithi155.stdout: }, 2023-08-01T19:56:24.482 INFO:teuthology.orchestra.run.smithi155.stdout: { 2023-08-01T19:56:24.482 INFO:teuthology.orchestra.run.smithi155.stdout: "description": "osd_op(client.4668.0:197419 5.d 5:be7dc7c9:::benchmark_data_smithi006_114134_object63758:head [delete] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e62)", 2023-08-01T19:56:24.483 INFO:teuthology.orchestra.run.smithi155.stdout: "initiated_at": "2023-08-01T19:55:58.580223+0000", 2023-08-01T19:56:24.483 INFO:teuthology.orchestra.run.smithi155.stdout: "age": 25.723786737000001, 2023-08-01T19:56:24.483 INFO:teuthology.orchestra.run.smithi155.stdout: "duration": 1.0286139439999999, 2023-08-01T19:56:24.483 INFO:teuthology.orchestra.run.smithi155.stdout: "type_data": { 2023-08-01T19:56:24.483 INFO:teuthology.orchestra.run.smithi155.stdout: "flag_point": "commit sent; apply or cleanup", 2023-08-01T19:56:24.483 INFO:teuthology.orchestra.run.smithi155.stdout: "client_info": { 2023-08-01T19:56:24.483 INFO:teuthology.orchestra.run.smithi155.stdout: "client": "client.4668", 2023-08-01T19:56:24.483 INFO:teuthology.orchestra.run.smithi155.stdout: "client_addr": "172.21.15.6:0/1709472247", 2023-08-01T19:56:24.484 INFO:teuthology.orchestra.run.smithi155.stdout: "tid": 197419 2023-08-01T19:56:24.484 INFO:teuthology.orchestra.run.smithi155.stdout: }, 2023-08-01T19:56:24.484 INFO:teuthology.orchestra.run.smithi155.stdout: "events": [ 2023-08-01T19:56:24.484 INFO:teuthology.orchestra.run.smithi155.stdout: { 2023-08-01T19:56:24.484 INFO:teuthology.orchestra.run.smithi155.stdout: "event": "initiated", 2023-08-01T19:56:24.484 INFO:teuthology.orchestra.run.smithi155.stdout: "time": "2023-08-01T19:55:58.580223+0000", 2023-08-01T19:56:24.484 INFO:teuthology.orchestra.run.smithi155.stdout: "duration": 0 2023-08-01T19:56:24.485 INFO:teuthology.orchestra.run.smithi155.stdout: }, 2023-08-01T19:56:24.485 INFO:teuthology.orchestra.run.smithi155.stdout: { 2023-08-01T19:56:24.485 INFO:teuthology.orchestra.run.smithi155.stdout: "event": "throttled", 2023-08-01T19:56:24.485 INFO:teuthology.orchestra.run.smithi155.stdout: "time": "2023-08-01T19:55:58.580223+0000", 2023-08-01T19:56:24.485 INFO:teuthology.orchestra.run.smithi155.stdout: "duration": 0 2023-08-01T19:56:24.485 INFO:teuthology.orchestra.run.smithi155.stdout: }, 2023-08-01T19:56:24.485 INFO:teuthology.orchestra.run.smithi155.stdout: { 2023-08-01T19:56:24.485 INFO:teuthology.orchestra.run.smithi155.stdout: "event": "header_read", 2023-08-01T19:56:24.486 INFO:teuthology.orchestra.run.smithi155.stdout: "time": "2023-08-01T19:55:58.580222+0000", 2023-08-01T19:56:24.486 INFO:teuthology.orchestra.run.smithi155.stdout: "duration": 4294967295.9999995 2023-08-01T19:56:24.486 INFO:teuthology.orchestra.run.smithi155.stdout: }, 2023-08-01T19:56:24.486 INFO:teuthology.orchestra.run.smithi155.stdout: { 2023-08-01T19:56:24.486 INFO:teuthology.orchestra.run.smithi155.stdout: "event": "all_read", 2023-08-01T19:56:24.486 INFO:teuthology.orchestra.run.smithi155.stdout: "time": "2023-08-01T19:55:58.580225+0000", 2023-08-01T19:56:24.486 INFO:teuthology.orchestra.run.smithi155.stdout: "duration": 3.2820000000000001e-06 2023-08-01T19:56:24.487 INFO:teuthology.orchestra.run.smithi155.stdout: }, 2023-08-01T19:56:24.487 INFO:teuthology.orchestra.run.smithi155.stdout: { 2023-08-01T19:56:24.487 INFO:teuthology.orchestra.run.smithi155.stdout: "event": "dispatched", 2023-08-01T19:56:24.487 INFO:teuthology.orchestra.run.smithi155.stdout: "time": "2023-08-01T19:55:58.580233+0000", 2023-08-01T19:56:24.487 INFO:teuthology.orchestra.run.smithi155.stdout: "duration": 7.34e-06 2023-08-01T19:56:24.487 INFO:teuthology.orchestra.run.smithi155.stdout: }, 2023-08-01T19:56:24.487 INFO:teuthology.orchestra.run.smithi155.stdout: { 2023-08-01T19:56:24.487 INFO:teuthology.orchestra.run.smithi155.stdout: "event": "queued_for_pg", 2023-08-01T19:56:24.488 INFO:teuthology.orchestra.run.smithi155.stdout: "time": "2023-08-01T19:55:58.580236+0000", 2023-08-01T19:56:24.488 INFO:teuthology.orchestra.run.smithi155.stdout: "duration": 3.473e-06 2023-08-01T19:56:24.488 INFO:teuthology.orchestra.run.smithi155.stdout: }, 2023-08-01T19:56:24.488 INFO:teuthology.orchestra.run.smithi155.stdout: { 2023-08-01T19:56:24.488 INFO:teuthology.orchestra.run.smithi155.stdout: "event": "reached_pg", 2023-08-01T19:56:24.488 INFO:teuthology.orchestra.run.smithi155.stdout: "time": "2023-08-01T19:55:58.580267+0000", 2023-08-01T19:56:24.488 INFO:teuthology.orchestra.run.smithi155.stdout: "duration": 3.0479000000000001e-05 2023-08-01T19:56:24.489 INFO:teuthology.orchestra.run.smithi155.stdout: }, 2023-08-01T19:56:24.489 INFO:teuthology.orchestra.run.smithi155.stdout: { 2023-08-01T19:56:24.489 INFO:teuthology.orchestra.run.smithi155.stdout: "event": "waiting for peered", 2023-08-01T19:56:24.489 INFO:teuthology.orchestra.run.smithi155.stdout: "time": "2023-08-01T19:55:58.580272+0000", 2023-08-01T19:56:24.489 INFO:teuthology.orchestra.run.smithi155.stdout: "duration": 5.011e-06 2023-08-01T19:56:24.489 INFO:teuthology.orchestra.run.smithi155.stdout: }, 2023-08-01T19:56:24.489 INFO:teuthology.orchestra.run.smithi155.stdout: { 2023-08-01T19:56:24.489 INFO:teuthology.orchestra.run.smithi155.stdout: "event": "reached_pg", 2023-08-01T19:56:24.490 INFO:teuthology.orchestra.run.smithi155.stdout: "time": "2023-08-01T19:55:59.604970+0000", 2023-08-01T19:56:24.490 INFO:teuthology.orchestra.run.smithi155.stdout: "duration": 1.0246984189999999 2023-08-01T19:56:24.490 INFO:teuthology.orchestra.run.smithi155.stdout: }, 2023-08-01T19:56:24.490 INFO:teuthology.orchestra.run.smithi155.stdout: { 2023-08-01T19:56:24.490 INFO:teuthology.orchestra.run.smithi155.stdout: "event": "started", 2023-08-01T19:56:24.490 INFO:teuthology.orchestra.run.smithi155.stdout: "time": "2023-08-01T19:55:59.605085+0000", 2023-08-01T19:56:24.490 INFO:teuthology.orchestra.run.smithi155.stdout: "duration": 0.00011531000000000001 2023-08-01T19:56:24.490 INFO:teuthology.orchestra.run.smithi155.stdout: }, 2023-08-01T19:56:24.491 INFO:teuthology.orchestra.run.smithi155.stdout: { 2023-08-01T19:56:24.491 INFO:teuthology.orchestra.run.smithi155.stdout: "event": "op_commit", 2023-08-01T19:56:24.491 INFO:teuthology.orchestra.run.smithi155.stdout: "time": "2023-08-01T19:55:59.608733+0000", 2023-08-01T19:56:24.491 INFO:teuthology.orchestra.run.smithi155.stdout: "duration": 0.0036478090000000001 2023-08-01T19:56:24.491 INFO:teuthology.orchestra.run.smithi155.stdout: }, 2023-08-01T19:56:24.491 INFO:teuthology.orchestra.run.smithi155.stdout: { 2023-08-01T19:56:24.491 INFO:teuthology.orchestra.run.smithi155.stdout: "event": "commit_sent", 2023-08-01T19:56:24.492 INFO:teuthology.orchestra.run.smithi155.stdout: "time": "2023-08-01T19:55:59.608771+0000", 2023-08-01T19:56:24.492 INFO:teuthology.orchestra.run.smithi155.stdout: "duration": 3.8033e-05 2023-08-01T19:56:24.492 INFO:teuthology.orchestra.run.smithi155.stdout: }, 2023-08-01T19:56:24.492 INFO:teuthology.orchestra.run.smithi155.stdout: { 2023-08-01T19:56:24.492 INFO:teuthology.orchestra.run.smithi155.stdout: "event": "done", 2023-08-01T19:56:24.492 INFO:teuthology.orchestra.run.smithi155.stdout: "time": "2023-08-01T19:55:59.608837+0000", 2023-08-01T19:56:24.492 INFO:teuthology.orchestra.run.smithi155.stdout: "duration": 6.5364000000000006e-05 2023-08-01T19:56:24.492 INFO:teuthology.orchestra.run.smithi155.stdout: } 2023-08-01T19:56:24.493 INFO:teuthology.orchestra.run.smithi155.stdout: ] 2023-08-01T19:56:24.493 INFO:teuthology.orchestra.run.smithi155.stdout: } 2023-08-01T19:56:24.493 INFO:teuthology.orchestra.run.smithi155.stdout: }, 2023-08-01T19:56:24.493 INFO:teuthology.orchestra.run.smithi155.stdout: { 2023-08-01T19:56:24.493 INFO:teuthology.orchestra.run.smithi155.stdout: "description": "osd_op(client.4668.0:197420 5.9 5:92a2efe5:::benchmark_data_smithi006_114134_object63759:head [delete] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e62)", 2023-08-01T19:56:24.493 INFO:teuthology.orchestra.run.smithi155.stdout: "initiated_at": "2023-08-01T19:55:58.582230+0000", 2023-08-01T19:56:24.493 INFO:teuthology.orchestra.run.smithi155.stdout: "age": 25.721779427000001, 2023-08-01T19:56:24.494 INFO:teuthology.orchestra.run.smithi155.stdout: "duration": 1.0095353739999999, 2023-08-01T19:56:24.494 INFO:teuthology.orchestra.run.smithi155.stdout: "type_data": { 2023-08-01T19:56:24.494 INFO:teuthology.orchestra.run.smithi155.stdout: "flag_point": "commit sent; apply or cleanup", 2023-08-01T19:56:24.494 INFO:teuthology.orchestra.run.smithi155.stdout: "client_info": { 2023-08-01T19:56:24.494 INFO:teuthology.orchestra.run.smithi155.stdout: "client": "client.4668", 2023-08-01T19:56:24.494 INFO:teuthology.orchestra.run.smithi155.stdout: "client_addr": "172.21.15.6:0/1709472247", 2023-08-01T19:56:24.494 INFO:teuthology.orchestra.run.smithi155.stdout: "tid": 197420 2023-08-01T19:56:24.494 INFO:teuthology.orchestra.run.smithi155.stdout: }, 2023-08-01T19:56:24.495 INFO:teuthology.orchestra.run.smithi155.stdout: "events": [ 2023-08-01T19:56:24.495 INFO:teuthology.orchestra.run.smithi155.stdout: { 2023-08-01T19:56:24.495 INFO:teuthology.orchestra.run.smithi155.stdout: "event": "initiated", 2023-08-01T19:56:24.495 INFO:teuthology.orchestra.run.smithi155.stdout: "time": "2023-08-01T19:55:58.582230+0000", 2023-08-01T19:56:24.495 INFO:teuthology.orchestra.run.smithi155.stdout: "duration": 0 2023-08-01T19:56:24.495 INFO:teuthology.orchestra.run.smithi155.stdout: }, 2023-08-01T19:56:24.495 INFO:teuthology.orchestra.run.smithi155.stdout: { 2023-08-01T19:56:24.495 INFO:teuthology.orchestra.run.smithi155.stdout: "event": "throttled", 2023-08-01T19:56:24.496 INFO:teuthology.orchestra.run.smithi155.stdout: "time": "2023-08-01T19:55:58.582230+0000", 2023-08-01T19:56:24.496 INFO:teuthology.orchestra.run.smithi155.stdout: "duration": 0 2023-08-01T19:56:24.496 INFO:teuthology.orchestra.run.smithi155.stdout: }, 2023-08-01T19:56:24.496 INFO:teuthology.orchestra.run.smithi155.stdout: { 2023-08-01T19:56:24.496 INFO:teuthology.orchestra.run.smithi155.stdout: "event": "header_read", 2023-08-01T19:56:24.496 INFO:teuthology.orchestra.run.smithi155.stdout: "time": "2023-08-01T19:55:58.582229+0000", 2023-08-01T19:56:24.496 INFO:teuthology.orchestra.run.smithi155.stdout: "duration": 4294967295.9999995 2023-08-01T19:56:24.497 INFO:teuthology.orchestra.run.smithi155.stdout: }, 2023-08-01T19:56:24.497 INFO:teuthology.orchestra.run.smithi155.stdout: { 2023-08-01T19:56:24.497 INFO:teuthology.orchestra.run.smithi155.stdout: "event": "all_read", 2023-08-01T19:56:24.497 INFO:teuthology.orchestra.run.smithi155.stdout: "time": "2023-08-01T19:55:58.582233+0000", 2023-08-01T19:56:24.497 INFO:teuthology.orchestra.run.smithi155.stdout: "duration": 3.7869999999999999e-06 2023-08-01T19:56:24.497 INFO:teuthology.orchestra.run.smithi155.stdout: }, 2023-08-01T19:56:24.497 INFO:teuthology.orchestra.run.smithi155.stdout: { 2023-08-01T19:56:24.497 INFO:teuthology.orchestra.run.smithi155.stdout: "event": "dispatched", 2023-08-01T19:56:24.498 INFO:teuthology.orchestra.run.smithi155.stdout: "time": "2023-08-01T19:55:58.582241+0000", 2023-08-01T19:56:24.498 INFO:teuthology.orchestra.run.smithi155.stdout: "duration": 7.6909999999999997e-06 2023-08-01T19:56:24.498 INFO:teuthology.orchestra.run.smithi155.stdout: }, 2023-08-01T19:56:24.498 INFO:teuthology.orchestra.run.smithi155.stdout: { 2023-08-01T19:56:24.498 INFO:teuthology.orchestra.run.smithi155.stdout: "event": "queued_for_pg", 2023-08-01T19:56:24.498 INFO:teuthology.orchestra.run.smithi155.stdout: "time": "2023-08-01T19:55:58.582244+0000", 2023-08-01T19:56:24.498 INFO:teuthology.orchestra.run.smithi155.stdout: "duration": 3.6770000000000001e-06 2023-08-01T19:56:24.498 INFO:teuthology.orchestra.run.smithi155.stdout: }, 2023-08-01T19:56:24.499 INFO:teuthology.orchestra.run.smithi155.stdout: { 2023-08-01T19:56:24.499 INFO:teuthology.orchestra.run.smithi155.stdout: "event": "reached_pg", 2023-08-01T19:56:24.499 INFO:teuthology.orchestra.run.smithi155.stdout: "time": "2023-08-01T19:55:58.582274+0000", 2023-08-01T19:56:24.499 INFO:teuthology.orchestra.run.smithi155.stdout: "duration": 3.0074e-05 2023-08-01T19:56:24.499 INFO:teuthology.orchestra.run.smithi155.stdout: }, 2023-08-01T19:56:24.499 INFO:teuthology.orchestra.run.smithi155.stdout: { 2023-08-01T19:56:24.499 INFO:teuthology.orchestra.run.smithi155.stdout: "event": "waiting for peered", 2023-08-01T19:56:24.499 INFO:teuthology.orchestra.run.smithi155.stdout: "time": "2023-08-01T19:55:58.582281+0000", 2023-08-01T19:56:24.500 INFO:teuthology.orchestra.run.smithi155.stdout: "duration": 6.297e-06 2023-08-01T19:56:24.500 INFO:teuthology.orchestra.run.smithi155.stdout: }, 2023-08-01T19:56:24.500 INFO:teuthology.orchestra.run.smithi155.stdout: { 2023-08-01T19:56:24.500 INFO:teuthology.orchestra.run.smithi155.stdout: "event": "reached_pg", 2023-08-01T19:56:24.500 INFO:teuthology.orchestra.run.smithi155.stdout: "time": "2023-08-01T19:55:59.586809+0000", 2023-08-01T19:56:24.500 INFO:teuthology.orchestra.run.smithi155.stdout: "duration": 1.0045281720000001 2023-08-01T19:56:24.500 INFO:teuthology.orchestra.run.smithi155.stdout: }, 2023-08-01T19:56:24.500 INFO:teuthology.orchestra.run.smithi155.stdout: { 2023-08-01T19:56:24.501 INFO:teuthology.orchestra.run.smithi155.stdout: "event": "started", 2023-08-01T19:56:24.501 INFO:teuthology.orchestra.run.smithi155.stdout: "time": "2023-08-01T19:55:59.586910+0000", 2023-08-01T19:56:24.501 INFO:teuthology.orchestra.run.smithi155.stdout: "duration": 0.000100898 2023-08-01T19:56:24.501 INFO:teuthology.orchestra.run.smithi155.stdout: }, 2023-08-01T19:56:24.501 INFO:teuthology.orchestra.run.smithi155.stdout: { 2023-08-01T19:56:24.501 INFO:teuthology.orchestra.run.smithi155.stdout: "event": "op_commit", 2023-08-01T19:56:24.501 INFO:teuthology.orchestra.run.smithi155.stdout: "time": "2023-08-01T19:55:59.591679+0000", 2023-08-01T19:56:24.502 INFO:teuthology.orchestra.run.smithi155.stdout: "duration": 0.004769471 2023-08-01T19:56:24.502 INFO:teuthology.orchestra.run.smithi155.stdout: }, 2023-08-01T19:56:24.502 INFO:teuthology.orchestra.run.smithi155.stdout: { 2023-08-01T19:56:24.502 INFO:teuthology.orchestra.run.smithi155.stdout: "event": "commit_sent", 2023-08-01T19:56:24.502 INFO:teuthology.orchestra.run.smithi155.stdout: "time": "2023-08-01T19:55:59.591721+0000", 2023-08-01T19:56:24.502 INFO:teuthology.orchestra.run.smithi155.stdout: "duration": 4.1953000000000003e-05 2023-08-01T19:56:24.502 INFO:teuthology.orchestra.run.smithi155.stdout: }, 2023-08-01T19:56:24.502 INFO:teuthology.orchestra.run.smithi155.stdout: { 2023-08-01T19:56:24.503 INFO:teuthology.orchestra.run.smithi155.stdout: "event": "done", 2023-08-01T19:56:24.503 INFO:teuthology.orchestra.run.smithi155.stdout: "time": "2023-08-01T19:55:59.591765+0000", 2023-08-01T19:56:24.503 INFO:teuthology.orchestra.run.smithi155.stdout: "duration": 4.4030999999999999e-05 2023-08-01T19:56:24.503 INFO:teuthology.orchestra.run.smithi155.stdout: } 2023-08-01T19:56:24.503 INFO:teuthology.orchestra.run.smithi155.stdout: ] 2023-08-01T19:56:24.503 INFO:teuthology.orchestra.run.smithi155.stdout: } 2023-08-01T19:56:24.503 INFO:teuthology.orchestra.run.smithi155.stdout: } 2023-08-01T19:56:24.503 INFO:teuthology.orchestra.run.smithi155.stdout: ] 2023-08-01T19:56:24.504 INFO:teuthology.orchestra.run.smithi155.stdout:} 2023-08-01T19:56:24.505 INFO:tasks.ceph.osd.2.smithi155.stderr:2023-08-01T19:56:24.503+0000 7faa5c6ac700 -1 received signal: Hangup from /usr/bin/python3 /bin/daemon-helper kill ceph-osd -f --cluster ceph -i 2 (PID: 111337) UID: 0 2023-08-01T19:56:24.505 DEBUG:teuthology.orchestra.run.smithi008:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 30 ceph --cluster ceph --admin-daemon /var/run/ceph/ceph-osd.0.asok dump_ops_in_flight 2023-08-01T19:56:24.605 INFO:tasks.ceph.osd.0.smithi008.stderr:2023-08-01T19:56:24.604+0000 7f16a58f4700 -1 received signal: Hangup from /usr/bin/python3 /bin/daemon-helper kill ceph-osd -f --cluster ceph -i 0 (PID: 111179) UID: 0 2023-08-01T19:56:24.697 INFO:teuthology.orchestra.run.smithi008.stdout:{ 2023-08-01T19:56:24.697 INFO:teuthology.orchestra.run.smithi008.stdout: "ops": [ 2023-08-01T19:56:24.697 INFO:teuthology.orchestra.run.smithi008.stdout: { 2023-08-01T19:56:24.698 INFO:teuthology.orchestra.run.smithi008.stdout: "description": "osd_op(client.4668.0:246942 5.4 5:2a64d749:::benchmark_data_smithi006_114134_object113281:head [delete] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e74)", 2023-08-01T19:56:24.698 INFO:teuthology.orchestra.run.smithi008.stdout: "initiated_at": "2023-08-01T19:56:24.681002+0000", 2023-08-01T19:56:24.698 INFO:teuthology.orchestra.run.smithi008.stdout: "age": 0.0081447039999999991, 2023-08-01T19:56:24.698 INFO:teuthology.orchestra.run.smithi008.stdout: "duration": 0.0081719870000000003, 2023-08-01T19:56:24.698 INFO:teuthology.orchestra.run.smithi008.stdout: "type_data": { 2023-08-01T19:56:24.698 INFO:teuthology.orchestra.run.smithi008.stdout: "flag_point": "waiting for sub ops", 2023-08-01T19:56:24.698 INFO:teuthology.orchestra.run.smithi008.stdout: "client_info": { 2023-08-01T19:56:24.699 INFO:teuthology.orchestra.run.smithi008.stdout: "client": "client.4668", 2023-08-01T19:56:24.699 INFO:teuthology.orchestra.run.smithi008.stdout: "client_addr": "172.21.15.6:0/1709472247", 2023-08-01T19:56:24.699 INFO:teuthology.orchestra.run.smithi008.stdout: "tid": 246942 2023-08-01T19:56:24.699 INFO:teuthology.orchestra.run.smithi008.stdout: }, 2023-08-01T19:56:24.699 INFO:teuthology.orchestra.run.smithi008.stdout: "events": [ 2023-08-01T19:56:24.699 INFO:teuthology.orchestra.run.smithi008.stdout: { 2023-08-01T19:56:24.699 INFO:teuthology.orchestra.run.smithi008.stdout: "event": "initiated", 2023-08-01T19:56:24.700 INFO:teuthology.orchestra.run.smithi008.stdout: "time": "2023-08-01T19:56:24.681002+0000", 2023-08-01T19:56:24.700 INFO:teuthology.orchestra.run.smithi008.stdout: "duration": 0 2023-08-01T19:56:24.700 INFO:teuthology.orchestra.run.smithi008.stdout: }, 2023-08-01T19:56:24.700 INFO:teuthology.orchestra.run.smithi008.stdout: { 2023-08-01T19:56:24.700 INFO:teuthology.orchestra.run.smithi008.stdout: "event": "throttled", 2023-08-01T19:56:24.700 INFO:teuthology.orchestra.run.smithi008.stdout: "time": "2023-08-01T19:56:24.681002+0000", 2023-08-01T19:56:24.700 INFO:teuthology.orchestra.run.smithi008.stdout: "duration": 0 2023-08-01T19:56:24.700 INFO:teuthology.orchestra.run.smithi008.stdout: }, 2023-08-01T19:56:24.701 INFO:teuthology.orchestra.run.smithi008.stdout: { 2023-08-01T19:56:24.701 INFO:teuthology.orchestra.run.smithi008.stdout: "event": "header_read", 2023-08-01T19:56:24.701 INFO:teuthology.orchestra.run.smithi008.stdout: "time": "2023-08-01T19:56:24.681001+0000", 2023-08-01T19:56:24.701 INFO:teuthology.orchestra.run.smithi008.stdout: "duration": 4294967295.999999 2023-08-01T19:56:24.701 INFO:teuthology.orchestra.run.smithi008.stdout: }, 2023-08-01T19:56:24.701 INFO:teuthology.orchestra.run.smithi008.stdout: { 2023-08-01T19:56:24.701 INFO:teuthology.orchestra.run.smithi008.stdout: "event": "all_read", 2023-08-01T19:56:24.701 INFO:teuthology.orchestra.run.smithi008.stdout: "time": "2023-08-01T19:56:24.681007+0000", 2023-08-01T19:56:24.702 INFO:teuthology.orchestra.run.smithi008.stdout: "duration": 5.2270000000000001e-06 2023-08-01T19:56:24.702 INFO:teuthology.orchestra.run.smithi008.stdout: }, 2023-08-01T19:56:24.702 INFO:teuthology.orchestra.run.smithi008.stdout: { 2023-08-01T19:56:24.702 INFO:teuthology.orchestra.run.smithi008.stdout: "event": "dispatched", 2023-08-01T19:56:24.702 INFO:teuthology.orchestra.run.smithi008.stdout: "time": "2023-08-01T19:56:24.681020+0000", 2023-08-01T19:56:24.702 INFO:teuthology.orchestra.run.smithi008.stdout: "duration": 1.3434e-05 2023-08-01T19:56:24.702 INFO:teuthology.orchestra.run.smithi008.stdout: }, 2023-08-01T19:56:24.702 INFO:teuthology.orchestra.run.smithi008.stdout: { 2023-08-01T19:56:24.703 INFO:teuthology.orchestra.run.smithi008.stdout: "event": "queued_for_pg", 2023-08-01T19:56:24.703 INFO:teuthology.orchestra.run.smithi008.stdout: "time": "2023-08-01T19:56:24.681027+0000", 2023-08-01T19:56:24.703 INFO:teuthology.orchestra.run.smithi008.stdout: "duration": 6.4649999999999999e-06 2023-08-01T19:56:24.703 INFO:teuthology.orchestra.run.smithi008.stdout: }, 2023-08-01T19:56:24.703 INFO:teuthology.orchestra.run.smithi008.stdout: { 2023-08-01T19:56:24.703 INFO:teuthology.orchestra.run.smithi008.stdout: "event": "reached_pg", 2023-08-01T19:56:24.703 INFO:teuthology.orchestra.run.smithi008.stdout: "time": "2023-08-01T19:56:24.681071+0000", 2023-08-01T19:56:24.704 INFO:teuthology.orchestra.run.smithi008.stdout: "duration": 4.4227999999999997e-05 2023-08-01T19:56:24.704 INFO:teuthology.orchestra.run.smithi008.stdout: }, 2023-08-01T19:56:24.704 INFO:teuthology.orchestra.run.smithi008.stdout: { 2023-08-01T19:56:24.704 INFO:teuthology.orchestra.run.smithi008.stdout: "event": "started", 2023-08-01T19:56:24.704 INFO:teuthology.orchestra.run.smithi008.stdout: "time": "2023-08-01T19:56:24.681194+0000", 2023-08-01T19:56:24.704 INFO:teuthology.orchestra.run.smithi008.stdout: "duration": 0.000123621 2023-08-01T19:56:24.704 INFO:teuthology.orchestra.run.smithi008.stdout: }, 2023-08-01T19:56:24.704 INFO:teuthology.orchestra.run.smithi008.stdout: { 2023-08-01T19:56:24.705 INFO:teuthology.orchestra.run.smithi008.stdout: "event": "waiting for subops from 2", 2023-08-01T19:56:24.705 INFO:teuthology.orchestra.run.smithi008.stdout: "time": "2023-08-01T19:56:24.681641+0000", 2023-08-01T19:56:24.705 INFO:teuthology.orchestra.run.smithi008.stdout: "duration": 0.00044685200000000002 2023-08-01T19:56:24.705 INFO:teuthology.orchestra.run.smithi008.stdout: }, 2023-08-01T19:56:24.705 INFO:teuthology.orchestra.run.smithi008.stdout: { 2023-08-01T19:56:24.705 INFO:teuthology.orchestra.run.smithi008.stdout: "event": "sub_op_commit_rec", 2023-08-01T19:56:24.705 INFO:teuthology.orchestra.run.smithi008.stdout: "time": "2023-08-01T19:56:24.686335+0000", 2023-08-01T19:56:24.705 INFO:teuthology.orchestra.run.smithi008.stdout: "duration": 0.004693376 2023-08-01T19:56:24.706 INFO:teuthology.orchestra.run.smithi008.stdout: } 2023-08-01T19:56:24.706 INFO:teuthology.orchestra.run.smithi008.stdout: ] 2023-08-01T19:56:24.706 INFO:teuthology.orchestra.run.smithi008.stdout: } 2023-08-01T19:56:24.706 INFO:teuthology.orchestra.run.smithi008.stdout: }, 2023-08-01T19:56:24.706 INFO:teuthology.orchestra.run.smithi008.stdout: { 2023-08-01T19:56:24.706 INFO:teuthology.orchestra.run.smithi008.stdout: "description": "osd_op(client.4668.0:246943 5.a 5:5359492f:::benchmark_data_smithi006_114134_object113282:head [delete] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e74)", 2023-08-01T19:56:24.706 INFO:teuthology.orchestra.run.smithi008.stdout: "initiated_at": "2023-08-01T19:56:24.681038+0000", 2023-08-01T19:56:24.707 INFO:teuthology.orchestra.run.smithi008.stdout: "age": 0.0081088749999999998, 2023-08-01T19:56:24.707 INFO:teuthology.orchestra.run.smithi008.stdout: "duration": 0.0082413509999999992, 2023-08-01T19:56:24.707 INFO:teuthology.orchestra.run.smithi008.stdout: "type_data": { 2023-08-01T19:56:24.707 INFO:teuthology.orchestra.run.smithi008.stdout: "flag_point": "waiting for sub ops", 2023-08-01T19:56:24.707 INFO:teuthology.orchestra.run.smithi008.stdout: "client_info": { 2023-08-01T19:56:24.707 INFO:teuthology.orchestra.run.smithi008.stdout: "client": "client.4668", 2023-08-01T19:56:24.707 INFO:teuthology.orchestra.run.smithi008.stdout: "client_addr": "172.21.15.6:0/1709472247", 2023-08-01T19:56:24.708 INFO:teuthology.orchestra.run.smithi008.stdout: "tid": 246943 2023-08-01T19:56:24.708 INFO:teuthology.orchestra.run.smithi008.stdout: }, 2023-08-01T19:56:24.708 INFO:teuthology.orchestra.run.smithi008.stdout: "events": [ 2023-08-01T19:56:24.708 INFO:teuthology.orchestra.run.smithi008.stdout: { 2023-08-01T19:56:24.708 INFO:teuthology.orchestra.run.smithi008.stdout: "event": "initiated", 2023-08-01T19:56:24.708 INFO:teuthology.orchestra.run.smithi008.stdout: "time": "2023-08-01T19:56:24.681038+0000", 2023-08-01T19:56:24.708 INFO:teuthology.orchestra.run.smithi008.stdout: "duration": 0 2023-08-01T19:56:24.708 INFO:teuthology.orchestra.run.smithi008.stdout: }, 2023-08-01T19:56:24.709 INFO:teuthology.orchestra.run.smithi008.stdout: { 2023-08-01T19:56:24.709 INFO:teuthology.orchestra.run.smithi008.stdout: "event": "throttled", 2023-08-01T19:56:24.709 INFO:teuthology.orchestra.run.smithi008.stdout: "time": "2023-08-01T19:56:24.681038+0000", 2023-08-01T19:56:24.709 INFO:teuthology.orchestra.run.smithi008.stdout: "duration": 0 2023-08-01T19:56:24.709 INFO:teuthology.orchestra.run.smithi008.stdout: }, 2023-08-01T19:56:24.709 INFO:teuthology.orchestra.run.smithi008.stdout: { 2023-08-01T19:56:24.709 INFO:teuthology.orchestra.run.smithi008.stdout: "event": "header_read", 2023-08-01T19:56:24.709 INFO:teuthology.orchestra.run.smithi008.stdout: "time": "2023-08-01T19:56:24.681038+0000", 2023-08-01T19:56:24.710 INFO:teuthology.orchestra.run.smithi008.stdout: "duration": 4294967295.9999995 2023-08-01T19:56:24.710 INFO:teuthology.orchestra.run.smithi008.stdout: }, 2023-08-01T19:56:24.710 INFO:teuthology.orchestra.run.smithi008.stdout: { 2023-08-01T19:56:24.710 INFO:teuthology.orchestra.run.smithi008.stdout: "event": "all_read", 2023-08-01T19:56:24.710 INFO:teuthology.orchestra.run.smithi008.stdout: "time": "2023-08-01T19:56:24.681041+0000", 2023-08-01T19:56:24.710 INFO:teuthology.orchestra.run.smithi008.stdout: "duration": 3.2890000000000002e-06 2023-08-01T19:56:24.710 INFO:teuthology.orchestra.run.smithi008.stdout: }, 2023-08-01T19:56:24.710 INFO:teuthology.orchestra.run.smithi008.stdout: { 2023-08-01T19:56:24.711 INFO:teuthology.orchestra.run.smithi008.stdout: "event": "dispatched", 2023-08-01T19:56:24.711 INFO:teuthology.orchestra.run.smithi008.stdout: "time": "2023-08-01T19:56:24.681050+0000", 2023-08-01T19:56:24.711 INFO:teuthology.orchestra.run.smithi008.stdout: "duration": 9.4690000000000003e-06 2023-08-01T19:56:24.711 INFO:teuthology.orchestra.run.smithi008.stdout: }, 2023-08-01T19:56:24.711 INFO:teuthology.orchestra.run.smithi008.stdout: { 2023-08-01T19:56:24.711 INFO:teuthology.orchestra.run.smithi008.stdout: "event": "queued_for_pg", 2023-08-01T19:56:24.711 INFO:teuthology.orchestra.run.smithi008.stdout: "time": "2023-08-01T19:56:24.681055+0000", 2023-08-01T19:56:24.711 INFO:teuthology.orchestra.run.smithi008.stdout: "duration": 5.0050000000000004e-06 2023-08-01T19:56:24.712 INFO:teuthology.orchestra.run.smithi008.stdout: }, 2023-08-01T19:56:24.712 INFO:teuthology.orchestra.run.smithi008.stdout: { 2023-08-01T19:56:24.712 INFO:teuthology.orchestra.run.smithi008.stdout: "event": "reached_pg", 2023-08-01T19:56:24.712 INFO:teuthology.orchestra.run.smithi008.stdout: "time": "2023-08-01T19:56:24.681097+0000", 2023-08-01T19:56:24.712 INFO:teuthology.orchestra.run.smithi008.stdout: "duration": 4.1173e-05 2023-08-01T19:56:24.712 INFO:teuthology.orchestra.run.smithi008.stdout: }, 2023-08-01T19:56:24.712 INFO:teuthology.orchestra.run.smithi008.stdout: { 2023-08-01T19:56:24.712 INFO:teuthology.orchestra.run.smithi008.stdout: "event": "started", 2023-08-01T19:56:24.713 INFO:teuthology.orchestra.run.smithi008.stdout: "time": "2023-08-01T19:56:24.681224+0000", 2023-08-01T19:56:24.713 INFO:teuthology.orchestra.run.smithi008.stdout: "duration": 0.000127019 2023-08-01T19:56:24.713 INFO:teuthology.orchestra.run.smithi008.stdout: }, 2023-08-01T19:56:24.713 INFO:teuthology.orchestra.run.smithi008.stdout: { 2023-08-01T19:56:24.713 INFO:teuthology.orchestra.run.smithi008.stdout: "event": "waiting for subops from 2", 2023-08-01T19:56:24.713 INFO:teuthology.orchestra.run.smithi008.stdout: "time": "2023-08-01T19:56:24.681351+0000", 2023-08-01T19:56:24.713 INFO:teuthology.orchestra.run.smithi008.stdout: "duration": 0.00012764100000000001 2023-08-01T19:56:24.714 INFO:teuthology.orchestra.run.smithi008.stdout: }, 2023-08-01T19:56:24.714 INFO:teuthology.orchestra.run.smithi008.stdout: { 2023-08-01T19:56:24.714 INFO:teuthology.orchestra.run.smithi008.stdout: "event": "sub_op_commit_rec", 2023-08-01T19:56:24.714 INFO:teuthology.orchestra.run.smithi008.stdout: "time": "2023-08-01T19:56:24.686830+0000", 2023-08-01T19:56:24.714 INFO:teuthology.orchestra.run.smithi008.stdout: "duration": 0.005479149 2023-08-01T19:56:24.714 INFO:teuthology.orchestra.run.smithi008.stdout: } 2023-08-01T19:56:24.714 INFO:teuthology.orchestra.run.smithi008.stdout: ] 2023-08-01T19:56:24.714 INFO:teuthology.orchestra.run.smithi008.stdout: } 2023-08-01T19:56:24.715 INFO:teuthology.orchestra.run.smithi008.stdout: }, 2023-08-01T19:56:24.715 INFO:teuthology.orchestra.run.smithi008.stdout: { 2023-08-01T19:56:24.715 INFO:teuthology.orchestra.run.smithi008.stdout: "description": "osd_op(client.4668.0:246944 5.a 5:593ae3d3:::benchmark_data_smithi006_114134_object113283:head [delete] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e74)", 2023-08-01T19:56:24.715 INFO:teuthology.orchestra.run.smithi008.stdout: "initiated_at": "2023-08-01T19:56:24.683810+0000", 2023-08-01T19:56:24.715 INFO:teuthology.orchestra.run.smithi008.stdout: "age": 0.0053375100000000002, 2023-08-01T19:56:24.715 INFO:teuthology.orchestra.run.smithi008.stdout: "duration": 0.0055892789999999999, 2023-08-01T19:56:24.715 INFO:teuthology.orchestra.run.smithi008.stdout: "type_data": { 2023-08-01T19:56:24.715 INFO:teuthology.orchestra.run.smithi008.stdout: "flag_point": "waiting for sub ops", 2023-08-01T19:56:24.716 INFO:teuthology.orchestra.run.smithi008.stdout: "client_info": { 2023-08-01T19:56:24.716 INFO:teuthology.orchestra.run.smithi008.stdout: "client": "client.4668", 2023-08-01T19:56:24.716 INFO:teuthology.orchestra.run.smithi008.stdout: "client_addr": "172.21.15.6:0/1709472247", 2023-08-01T19:56:24.716 INFO:teuthology.orchestra.run.smithi008.stdout: "tid": 246944 2023-08-01T19:56:24.716 INFO:teuthology.orchestra.run.smithi008.stdout: }, 2023-08-01T19:56:24.716 INFO:teuthology.orchestra.run.smithi008.stdout: "events": [ 2023-08-01T19:56:24.716 INFO:teuthology.orchestra.run.smithi008.stdout: { 2023-08-01T19:56:24.717 INFO:teuthology.orchestra.run.smithi008.stdout: "event": "initiated", 2023-08-01T19:56:24.717 INFO:teuthology.orchestra.run.smithi008.stdout: "time": "2023-08-01T19:56:24.683810+0000", 2023-08-01T19:56:24.717 INFO:teuthology.orchestra.run.smithi008.stdout: "duration": 0 2023-08-01T19:56:24.717 INFO:teuthology.orchestra.run.smithi008.stdout: }, 2023-08-01T19:56:24.717 INFO:teuthology.orchestra.run.smithi008.stdout: { 2023-08-01T19:56:24.717 INFO:teuthology.orchestra.run.smithi008.stdout: "event": "throttled", 2023-08-01T19:56:24.717 INFO:teuthology.orchestra.run.smithi008.stdout: "time": "2023-08-01T19:56:24.683810+0000", 2023-08-01T19:56:24.717 INFO:teuthology.orchestra.run.smithi008.stdout: "duration": 0 2023-08-01T19:56:24.718 INFO:teuthology.orchestra.run.smithi008.stdout: }, 2023-08-01T19:56:24.718 INFO:teuthology.orchestra.run.smithi008.stdout: { 2023-08-01T19:56:24.718 INFO:teuthology.orchestra.run.smithi008.stdout: "event": "header_read", 2023-08-01T19:56:24.718 INFO:teuthology.orchestra.run.smithi008.stdout: "time": "2023-08-01T19:56:24.683809+0000", 2023-08-01T19:56:24.718 INFO:teuthology.orchestra.run.smithi008.stdout: "duration": 4294967295.9999995 2023-08-01T19:56:24.718 INFO:teuthology.orchestra.run.smithi008.stdout: }, 2023-08-01T19:56:24.718 INFO:teuthology.orchestra.run.smithi008.stdout: { 2023-08-01T19:56:24.718 INFO:teuthology.orchestra.run.smithi008.stdout: "event": "all_read", 2023-08-01T19:56:24.719 INFO:teuthology.orchestra.run.smithi008.stdout: "time": "2023-08-01T19:56:24.683813+0000", 2023-08-01T19:56:24.719 INFO:teuthology.orchestra.run.smithi008.stdout: "duration": 3.67e-06 2023-08-01T19:56:24.719 INFO:teuthology.orchestra.run.smithi008.stdout: }, 2023-08-01T19:56:24.719 INFO:teuthology.orchestra.run.smithi008.stdout: { 2023-08-01T19:56:24.719 INFO:teuthology.orchestra.run.smithi008.stdout: "event": "dispatched", 2023-08-01T19:56:24.719 INFO:teuthology.orchestra.run.smithi008.stdout: "time": "2023-08-01T19:56:24.683821+0000", 2023-08-01T19:56:24.719 INFO:teuthology.orchestra.run.smithi008.stdout: "duration": 8.8049999999999996e-06 2023-08-01T19:56:24.719 INFO:teuthology.orchestra.run.smithi008.stdout: }, 2023-08-01T19:56:24.720 INFO:teuthology.orchestra.run.smithi008.stdout: { 2023-08-01T19:56:24.720 INFO:teuthology.orchestra.run.smithi008.stdout: "event": "queued_for_pg", 2023-08-01T19:56:24.720 INFO:teuthology.orchestra.run.smithi008.stdout: "time": "2023-08-01T19:56:24.683826+0000", 2023-08-01T19:56:24.720 INFO:teuthology.orchestra.run.smithi008.stdout: "duration": 4.2359999999999998e-06 2023-08-01T19:56:24.720 INFO:teuthology.orchestra.run.smithi008.stdout: }, 2023-08-01T19:56:24.720 INFO:teuthology.orchestra.run.smithi008.stdout: { 2023-08-01T19:56:24.720 INFO:teuthology.orchestra.run.smithi008.stdout: "event": "reached_pg", 2023-08-01T19:56:24.720 INFO:teuthology.orchestra.run.smithi008.stdout: "time": "2023-08-01T19:56:24.683864+0000", 2023-08-01T19:56:24.721 INFO:teuthology.orchestra.run.smithi008.stdout: "duration": 3.8668999999999999e-05 2023-08-01T19:56:24.721 INFO:teuthology.orchestra.run.smithi008.stdout: }, 2023-08-01T19:56:24.721 INFO:teuthology.orchestra.run.smithi008.stdout: { 2023-08-01T19:56:24.721 INFO:teuthology.orchestra.run.smithi008.stdout: "event": "started", 2023-08-01T19:56:24.721 INFO:teuthology.orchestra.run.smithi008.stdout: "time": "2023-08-01T19:56:24.683971+0000", 2023-08-01T19:56:24.721 INFO:teuthology.orchestra.run.smithi008.stdout: "duration": 0.00010668800000000001 2023-08-01T19:56:24.721 INFO:teuthology.orchestra.run.smithi008.stdout: }, 2023-08-01T19:56:24.721 INFO:teuthology.orchestra.run.smithi008.stdout: { 2023-08-01T19:56:24.722 INFO:teuthology.orchestra.run.smithi008.stdout: "event": "waiting for subops from 2", 2023-08-01T19:56:24.722 INFO:teuthology.orchestra.run.smithi008.stdout: "time": "2023-08-01T19:56:24.684034+0000", 2023-08-01T19:56:24.722 INFO:teuthology.orchestra.run.smithi008.stdout: "duration": 6.3250000000000006e-05 2023-08-01T19:56:24.722 INFO:teuthology.orchestra.run.smithi008.stdout: }, 2023-08-01T19:56:24.722 INFO:teuthology.orchestra.run.smithi008.stdout: { 2023-08-01T19:56:24.722 INFO:teuthology.orchestra.run.smithi008.stdout: "event": "sub_op_commit_rec", 2023-08-01T19:56:24.722 INFO:teuthology.orchestra.run.smithi008.stdout: "time": "2023-08-01T19:56:24.689358+0000", 2023-08-01T19:56:24.723 INFO:teuthology.orchestra.run.smithi008.stdout: "duration": 0.0053237120000000004 2023-08-01T19:56:24.723 INFO:teuthology.orchestra.run.smithi008.stdout: } 2023-08-01T19:56:24.723 INFO:teuthology.orchestra.run.smithi008.stdout: ] 2023-08-01T19:56:24.723 INFO:teuthology.orchestra.run.smithi008.stdout: } 2023-08-01T19:56:24.723 INFO:teuthology.orchestra.run.smithi008.stdout: }, 2023-08-01T19:56:24.723 INFO:teuthology.orchestra.run.smithi008.stdout: { 2023-08-01T19:56:24.723 INFO:teuthology.orchestra.run.smithi008.stdout: "description": "osd_op(client.4668.0:246947 5.6 5:6a20811f:::benchmark_data_smithi006_114134_object113286:head [delete] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e74)", 2023-08-01T19:56:24.723 INFO:teuthology.orchestra.run.smithi008.stdout: "initiated_at": "2023-08-01T19:56:24.683840+0000", 2023-08-01T19:56:24.724 INFO:teuthology.orchestra.run.smithi008.stdout: "age": 0.0053067770000000004, 2023-08-01T19:56:24.724 INFO:teuthology.orchestra.run.smithi008.stdout: "duration": 0.0056706439999999999, 2023-08-01T19:56:24.724 INFO:teuthology.orchestra.run.smithi008.stdout: "type_data": { 2023-08-01T19:56:24.724 INFO:teuthology.orchestra.run.smithi008.stdout: "flag_point": "started", 2023-08-01T19:56:24.724 INFO:teuthology.orchestra.run.smithi008.stdout: "client_info": { 2023-08-01T19:56:24.724 INFO:teuthology.orchestra.run.smithi008.stdout: "client": "client.4668", 2023-08-01T19:56:24.724 INFO:teuthology.orchestra.run.smithi008.stdout: "client_addr": "172.21.15.6:0/1709472247", 2023-08-01T19:56:24.725 INFO:teuthology.orchestra.run.smithi008.stdout: "tid": 246947 2023-08-01T19:56:24.725 INFO:teuthology.orchestra.run.smithi008.stdout: }, 2023-08-01T19:56:24.725 INFO:teuthology.orchestra.run.smithi008.stdout: "events": [ 2023-08-01T19:56:24.725 INFO:teuthology.orchestra.run.smithi008.stdout: { 2023-08-01T19:56:24.725 INFO:teuthology.orchestra.run.smithi008.stdout: "event": "initiated", 2023-08-01T19:56:24.725 INFO:teuthology.orchestra.run.smithi008.stdout: "time": "2023-08-01T19:56:24.683840+0000", 2023-08-01T19:56:24.725 INFO:teuthology.orchestra.run.smithi008.stdout: "duration": 0 2023-08-01T19:56:24.725 INFO:teuthology.orchestra.run.smithi008.stdout: }, 2023-08-01T19:56:24.726 INFO:teuthology.orchestra.run.smithi008.stdout: { 2023-08-01T19:56:24.726 INFO:teuthology.orchestra.run.smithi008.stdout: "event": "throttled", 2023-08-01T19:56:24.726 INFO:teuthology.orchestra.run.smithi008.stdout: "time": "2023-08-01T19:56:24.683840+0000", 2023-08-01T19:56:24.726 INFO:teuthology.orchestra.run.smithi008.stdout: "duration": 0 2023-08-01T19:56:24.726 INFO:teuthology.orchestra.run.smithi008.stdout: }, 2023-08-01T19:56:24.726 INFO:teuthology.orchestra.run.smithi008.stdout: { 2023-08-01T19:56:24.726 INFO:teuthology.orchestra.run.smithi008.stdout: "event": "header_read", 2023-08-01T19:56:24.726 INFO:teuthology.orchestra.run.smithi008.stdout: "time": "2023-08-01T19:56:24.683840+0000", 2023-08-01T19:56:24.727 INFO:teuthology.orchestra.run.smithi008.stdout: "duration": 4294967295.9999995 2023-08-01T19:56:24.727 INFO:teuthology.orchestra.run.smithi008.stdout: }, 2023-08-01T19:56:24.727 INFO:teuthology.orchestra.run.smithi008.stdout: { 2023-08-01T19:56:24.727 INFO:teuthology.orchestra.run.smithi008.stdout: "event": "all_read", 2023-08-01T19:56:24.727 INFO:teuthology.orchestra.run.smithi008.stdout: "time": "2023-08-01T19:56:24.683843+0000", 2023-08-01T19:56:24.727 INFO:teuthology.orchestra.run.smithi008.stdout: "duration": 3.619e-06 2023-08-01T19:56:24.727 INFO:teuthology.orchestra.run.smithi008.stdout: }, 2023-08-01T19:56:24.728 INFO:teuthology.orchestra.run.smithi008.stdout: { 2023-08-01T19:56:24.728 INFO:teuthology.orchestra.run.smithi008.stdout: "event": "dispatched", 2023-08-01T19:56:24.728 INFO:teuthology.orchestra.run.smithi008.stdout: "time": "2023-08-01T19:56:24.683851+0000", 2023-08-01T19:56:24.728 INFO:teuthology.orchestra.run.smithi008.stdout: "duration": 7.3119999999999996e-06 2023-08-01T19:56:24.728 INFO:teuthology.orchestra.run.smithi008.stdout: }, 2023-08-01T19:56:24.728 INFO:teuthology.orchestra.run.smithi008.stdout: { 2023-08-01T19:56:24.728 INFO:teuthology.orchestra.run.smithi008.stdout: "event": "queued_for_pg", 2023-08-01T19:56:24.728 INFO:teuthology.orchestra.run.smithi008.stdout: "time": "2023-08-01T19:56:24.683856+0000", 2023-08-01T19:56:24.729 INFO:teuthology.orchestra.run.smithi008.stdout: "duration": 4.9960000000000001e-06 2023-08-01T19:56:24.729 INFO:teuthology.orchestra.run.smithi008.stdout: }, 2023-08-01T19:56:24.729 INFO:teuthology.orchestra.run.smithi008.stdout: { 2023-08-01T19:56:24.729 INFO:teuthology.orchestra.run.smithi008.stdout: "event": "reached_pg", 2023-08-01T19:56:24.729 INFO:teuthology.orchestra.run.smithi008.stdout: "time": "2023-08-01T19:56:24.683894+0000", 2023-08-01T19:56:24.729 INFO:teuthology.orchestra.run.smithi008.stdout: "duration": 3.8531000000000001e-05 2023-08-01T19:56:24.729 INFO:teuthology.orchestra.run.smithi008.stdout: }, 2023-08-01T19:56:24.730 INFO:teuthology.orchestra.run.smithi008.stdout: { 2023-08-01T19:56:24.730 INFO:teuthology.orchestra.run.smithi008.stdout: "event": "started", 2023-08-01T19:56:24.730 INFO:teuthology.orchestra.run.smithi008.stdout: "time": "2023-08-01T19:56:24.684024+0000", 2023-08-01T19:56:24.730 INFO:teuthology.orchestra.run.smithi008.stdout: "duration": 0.000129753 2023-08-01T19:56:24.730 INFO:teuthology.orchestra.run.smithi008.stdout: } 2023-08-01T19:56:24.730 INFO:teuthology.orchestra.run.smithi008.stdout: ] 2023-08-01T19:56:24.730 INFO:teuthology.orchestra.run.smithi008.stdout: } 2023-08-01T19:56:24.730 INFO:teuthology.orchestra.run.smithi008.stdout: }, 2023-08-01T19:56:24.731 INFO:teuthology.orchestra.run.smithi008.stdout: { 2023-08-01T19:56:24.731 INFO:teuthology.orchestra.run.smithi008.stdout: "description": "osd_op(client.4668.0:246948 5.e 5:7d0f7500:::benchmark_data_smithi006_114134_object113287:head [delete] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e74)", 2023-08-01T19:56:24.731 INFO:teuthology.orchestra.run.smithi008.stdout: "initiated_at": "2023-08-01T19:56:24.683868+0000", 2023-08-01T19:56:24.731 INFO:teuthology.orchestra.run.smithi008.stdout: "age": 0.005279494, 2023-08-01T19:56:24.731 INFO:teuthology.orchestra.run.smithi008.stdout: "duration": 0.005731346, 2023-08-01T19:56:24.731 INFO:teuthology.orchestra.run.smithi008.stdout: "type_data": { 2023-08-01T19:56:24.731 INFO:teuthology.orchestra.run.smithi008.stdout: "flag_point": "waiting for sub ops", 2023-08-01T19:56:24.731 INFO:teuthology.orchestra.run.smithi008.stdout: "client_info": { 2023-08-01T19:56:24.732 INFO:teuthology.orchestra.run.smithi008.stdout: "client": "client.4668", 2023-08-01T19:56:24.732 INFO:teuthology.orchestra.run.smithi008.stdout: "client_addr": "172.21.15.6:0/1709472247", 2023-08-01T19:56:24.732 INFO:teuthology.orchestra.run.smithi008.stdout: "tid": 246948 2023-08-01T19:56:24.732 INFO:teuthology.orchestra.run.smithi008.stdout: }, 2023-08-01T19:56:24.732 INFO:teuthology.orchestra.run.smithi008.stdout: "events": [ 2023-08-01T19:56:24.732 INFO:teuthology.orchestra.run.smithi008.stdout: { 2023-08-01T19:56:24.732 INFO:teuthology.orchestra.run.smithi008.stdout: "event": "initiated", 2023-08-01T19:56:24.733 INFO:teuthology.orchestra.run.smithi008.stdout: "time": "2023-08-01T19:56:24.683868+0000", 2023-08-01T19:56:24.733 INFO:teuthology.orchestra.run.smithi008.stdout: "duration": 0 2023-08-01T19:56:24.733 INFO:teuthology.orchestra.run.smithi008.stdout: }, 2023-08-01T19:56:24.733 INFO:teuthology.orchestra.run.smithi008.stdout: { 2023-08-01T19:56:24.733 INFO:teuthology.orchestra.run.smithi008.stdout: "event": "throttled", 2023-08-01T19:56:24.733 INFO:teuthology.orchestra.run.smithi008.stdout: "time": "2023-08-01T19:56:24.683868+0000", 2023-08-01T19:56:24.733 INFO:teuthology.orchestra.run.smithi008.stdout: "duration": 0 2023-08-01T19:56:24.733 INFO:teuthology.orchestra.run.smithi008.stdout: }, 2023-08-01T19:56:24.734 INFO:teuthology.orchestra.run.smithi008.stdout: { 2023-08-01T19:56:24.734 INFO:teuthology.orchestra.run.smithi008.stdout: "event": "header_read", 2023-08-01T19:56:24.734 INFO:teuthology.orchestra.run.smithi008.stdout: "time": "2023-08-01T19:56:24.683867+0000", 2023-08-01T19:56:24.734 INFO:teuthology.orchestra.run.smithi008.stdout: "duration": 4294967295.9999995 2023-08-01T19:56:24.734 INFO:teuthology.orchestra.run.smithi008.stdout: }, 2023-08-01T19:56:24.734 INFO:teuthology.orchestra.run.smithi008.stdout: { 2023-08-01T19:56:24.734 INFO:teuthology.orchestra.run.smithi008.stdout: "event": "all_read", 2023-08-01T19:56:24.734 INFO:teuthology.orchestra.run.smithi008.stdout: "time": "2023-08-01T19:56:24.683870+0000", 2023-08-01T19:56:24.735 INFO:teuthology.orchestra.run.smithi008.stdout: "duration": 2.9340000000000002e-06 2023-08-01T19:56:24.735 INFO:teuthology.orchestra.run.smithi008.stdout: }, 2023-08-01T19:56:24.735 INFO:teuthology.orchestra.run.smithi008.stdout: { 2023-08-01T19:56:24.735 INFO:teuthology.orchestra.run.smithi008.stdout: "event": "dispatched", 2023-08-01T19:56:24.735 INFO:teuthology.orchestra.run.smithi008.stdout: "time": "2023-08-01T19:56:24.683877+0000", 2023-08-01T19:56:24.735 INFO:teuthology.orchestra.run.smithi008.stdout: "duration": 6.781e-06 2023-08-01T19:56:24.735 INFO:teuthology.orchestra.run.smithi008.stdout: }, 2023-08-01T19:56:24.735 INFO:teuthology.orchestra.run.smithi008.stdout: { 2023-08-01T19:56:24.736 INFO:teuthology.orchestra.run.smithi008.stdout: "event": "queued_for_pg", 2023-08-01T19:56:24.736 INFO:teuthology.orchestra.run.smithi008.stdout: "time": "2023-08-01T19:56:24.683883+0000", 2023-08-01T19:56:24.736 INFO:teuthology.orchestra.run.smithi008.stdout: "duration": 5.7939999999999999e-06 2023-08-01T19:56:24.736 INFO:teuthology.orchestra.run.smithi008.stdout: }, 2023-08-01T19:56:24.736 INFO:teuthology.orchestra.run.smithi008.stdout: { 2023-08-01T19:56:24.736 INFO:teuthology.orchestra.run.smithi008.stdout: "event": "reached_pg", 2023-08-01T19:56:24.736 INFO:teuthology.orchestra.run.smithi008.stdout: "time": "2023-08-01T19:56:24.683910+0000", 2023-08-01T19:56:24.736 INFO:teuthology.orchestra.run.smithi008.stdout: "duration": 2.7733999999999999e-05 2023-08-01T19:56:24.737 INFO:teuthology.orchestra.run.smithi008.stdout: }, 2023-08-01T19:56:24.737 INFO:teuthology.orchestra.run.smithi008.stdout: { 2023-08-01T19:56:24.737 INFO:teuthology.orchestra.run.smithi008.stdout: "event": "started", 2023-08-01T19:56:24.737 INFO:teuthology.orchestra.run.smithi008.stdout: "time": "2023-08-01T19:56:24.684023+0000", 2023-08-01T19:56:24.737 INFO:teuthology.orchestra.run.smithi008.stdout: "duration": 0.000112762 2023-08-01T19:56:24.737 INFO:teuthology.orchestra.run.smithi008.stdout: }, 2023-08-01T19:56:24.737 INFO:teuthology.orchestra.run.smithi008.stdout: { 2023-08-01T19:56:24.737 INFO:teuthology.orchestra.run.smithi008.stdout: "event": "waiting for subops from 2", 2023-08-01T19:56:24.738 INFO:teuthology.orchestra.run.smithi008.stdout: "time": "2023-08-01T19:56:24.684134+0000", 2023-08-01T19:56:24.738 INFO:teuthology.orchestra.run.smithi008.stdout: "duration": 0.00011124 2023-08-01T19:56:24.738 INFO:teuthology.orchestra.run.smithi008.stdout: }, 2023-08-01T19:56:24.738 INFO:teuthology.orchestra.run.smithi008.stdout: { 2023-08-01T19:56:24.738 INFO:teuthology.orchestra.run.smithi008.stdout: "event": "sub_op_commit_rec", 2023-08-01T19:56:24.738 INFO:teuthology.orchestra.run.smithi008.stdout: "time": "2023-08-01T19:56:24.687856+0000", 2023-08-01T19:56:24.738 INFO:teuthology.orchestra.run.smithi008.stdout: "duration": 0.003722 2023-08-01T19:56:24.739 INFO:teuthology.orchestra.run.smithi008.stdout: } 2023-08-01T19:56:24.739 INFO:teuthology.orchestra.run.smithi008.stdout: ] 2023-08-01T19:56:24.739 INFO:teuthology.orchestra.run.smithi008.stdout: } 2023-08-01T19:56:24.739 INFO:teuthology.orchestra.run.smithi008.stdout: }, 2023-08-01T19:56:24.739 INFO:teuthology.orchestra.run.smithi008.stdout: { 2023-08-01T19:56:24.739 INFO:teuthology.orchestra.run.smithi008.stdout: "description": "osd_op(client.4668.0:246950 5.a 5:56c34f44:::benchmark_data_smithi006_114134_object113289:head [delete] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e74)", 2023-08-01T19:56:24.739 INFO:teuthology.orchestra.run.smithi008.stdout: "initiated_at": "2023-08-01T19:56:24.683889+0000", 2023-08-01T19:56:24.739 INFO:teuthology.orchestra.run.smithi008.stdout: "age": 0.0052579949999999997, 2023-08-01T19:56:24.740 INFO:teuthology.orchestra.run.smithi008.stdout: "duration": 0.00580257, 2023-08-01T19:56:24.740 INFO:teuthology.orchestra.run.smithi008.stdout: "type_data": { 2023-08-01T19:56:24.740 INFO:teuthology.orchestra.run.smithi008.stdout: "flag_point": "waiting for sub ops", 2023-08-01T19:56:24.740 INFO:teuthology.orchestra.run.smithi008.stdout: "client_info": { 2023-08-01T19:56:24.740 INFO:teuthology.orchestra.run.smithi008.stdout: "client": "client.4668", 2023-08-01T19:56:24.740 INFO:teuthology.orchestra.run.smithi008.stdout: "client_addr": "172.21.15.6:0/1709472247", 2023-08-01T19:56:24.740 INFO:teuthology.orchestra.run.smithi008.stdout: "tid": 246950 2023-08-01T19:56:24.740 INFO:teuthology.orchestra.run.smithi008.stdout: }, 2023-08-01T19:56:24.741 INFO:teuthology.orchestra.run.smithi008.stdout: "events": [ 2023-08-01T19:56:24.741 INFO:teuthology.orchestra.run.smithi008.stdout: { 2023-08-01T19:56:24.741 INFO:teuthology.orchestra.run.smithi008.stdout: "event": "initiated", 2023-08-01T19:56:24.741 INFO:teuthology.orchestra.run.smithi008.stdout: "time": "2023-08-01T19:56:24.683889+0000", 2023-08-01T19:56:24.741 INFO:teuthology.orchestra.run.smithi008.stdout: "duration": 0 2023-08-01T19:56:24.741 INFO:teuthology.orchestra.run.smithi008.stdout: }, 2023-08-01T19:56:24.741 INFO:teuthology.orchestra.run.smithi008.stdout: { 2023-08-01T19:56:24.741 INFO:teuthology.orchestra.run.smithi008.stdout: "event": "throttled", 2023-08-01T19:56:24.742 INFO:teuthology.orchestra.run.smithi008.stdout: "time": "2023-08-01T19:56:24.683889+0000", 2023-08-01T19:56:24.742 INFO:teuthology.orchestra.run.smithi008.stdout: "duration": 0 2023-08-01T19:56:24.742 INFO:teuthology.orchestra.run.smithi008.stdout: }, 2023-08-01T19:56:24.742 INFO:teuthology.orchestra.run.smithi008.stdout: { 2023-08-01T19:56:24.742 INFO:teuthology.orchestra.run.smithi008.stdout: "event": "header_read", 2023-08-01T19:56:24.742 INFO:teuthology.orchestra.run.smithi008.stdout: "time": "2023-08-01T19:56:24.683889+0000", 2023-08-01T19:56:24.742 INFO:teuthology.orchestra.run.smithi008.stdout: "duration": 4294967295.9999995 2023-08-01T19:56:24.742 INFO:teuthology.orchestra.run.smithi008.stdout: }, 2023-08-01T19:56:24.743 INFO:teuthology.orchestra.run.smithi008.stdout: { 2023-08-01T19:56:24.743 INFO:teuthology.orchestra.run.smithi008.stdout: "event": "all_read", 2023-08-01T19:56:24.743 INFO:teuthology.orchestra.run.smithi008.stdout: "time": "2023-08-01T19:56:24.683891+0000", 2023-08-01T19:56:24.743 INFO:teuthology.orchestra.run.smithi008.stdout: "duration": 2.2900000000000001e-06 2023-08-01T19:56:24.743 INFO:teuthology.orchestra.run.smithi008.stdout: }, 2023-08-01T19:56:24.743 INFO:teuthology.orchestra.run.smithi008.stdout: { 2023-08-01T19:56:24.743 INFO:teuthology.orchestra.run.smithi008.stdout: "event": "dispatched", 2023-08-01T19:56:24.743 INFO:teuthology.orchestra.run.smithi008.stdout: "time": "2023-08-01T19:56:24.683897+0000", 2023-08-01T19:56:24.744 INFO:teuthology.orchestra.run.smithi008.stdout: "duration": 6.0639999999999999e-06 2023-08-01T19:56:24.744 INFO:teuthology.orchestra.run.smithi008.stdout: }, 2023-08-01T19:56:24.744 INFO:teuthology.orchestra.run.smithi008.stdout: { 2023-08-01T19:56:24.744 INFO:teuthology.orchestra.run.smithi008.stdout: "event": "queued_for_pg", 2023-08-01T19:56:24.744 INFO:teuthology.orchestra.run.smithi008.stdout: "time": "2023-08-01T19:56:24.683901+0000", 2023-08-01T19:56:24.744 INFO:teuthology.orchestra.run.smithi008.stdout: "duration": 3.8349999999999997e-06 2023-08-01T19:56:24.744 INFO:teuthology.orchestra.run.smithi008.stdout: }, 2023-08-01T19:56:24.744 INFO:teuthology.orchestra.run.smithi008.stdout: { 2023-08-01T19:56:24.745 INFO:teuthology.orchestra.run.smithi008.stdout: "event": "reached_pg", 2023-08-01T19:56:24.745 INFO:teuthology.orchestra.run.smithi008.stdout: "time": "2023-08-01T19:56:24.685266+0000", 2023-08-01T19:56:24.745 INFO:teuthology.orchestra.run.smithi008.stdout: "duration": 0.0013653789999999999 2023-08-01T19:56:24.745 INFO:teuthology.orchestra.run.smithi008.stdout: }, 2023-08-01T19:56:24.745 INFO:teuthology.orchestra.run.smithi008.stdout: { 2023-08-01T19:56:24.745 INFO:teuthology.orchestra.run.smithi008.stdout: "event": "started", 2023-08-01T19:56:24.745 INFO:teuthology.orchestra.run.smithi008.stdout: "time": "2023-08-01T19:56:24.685341+0000", 2023-08-01T19:56:24.746 INFO:teuthology.orchestra.run.smithi008.stdout: "duration": 7.4982999999999997e-05 2023-08-01T19:56:24.746 INFO:teuthology.orchestra.run.smithi008.stdout: }, 2023-08-01T19:56:24.746 INFO:teuthology.orchestra.run.smithi008.stdout: { 2023-08-01T19:56:24.746 INFO:teuthology.orchestra.run.smithi008.stdout: "event": "waiting for subops from 2", 2023-08-01T19:56:24.746 INFO:teuthology.orchestra.run.smithi008.stdout: "time": "2023-08-01T19:56:24.685410+0000", 2023-08-01T19:56:24.746 INFO:teuthology.orchestra.run.smithi008.stdout: "duration": 6.8967000000000006e-05 2023-08-01T19:56:24.746 INFO:teuthology.orchestra.run.smithi008.stdout: }, 2023-08-01T19:56:24.746 INFO:teuthology.orchestra.run.smithi008.stdout: { 2023-08-01T19:56:24.747 INFO:teuthology.orchestra.run.smithi008.stdout: "event": "sub_op_commit_rec", 2023-08-01T19:56:24.747 INFO:teuthology.orchestra.run.smithi008.stdout: "time": "2023-08-01T19:56:24.689467+0000", 2023-08-01T19:56:24.747 INFO:teuthology.orchestra.run.smithi008.stdout: "duration": 0.0040563789999999997 2023-08-01T19:56:24.747 INFO:teuthology.orchestra.run.smithi008.stdout: } 2023-08-01T19:56:24.747 INFO:teuthology.orchestra.run.smithi008.stdout: ] 2023-08-01T19:56:24.747 INFO:teuthology.orchestra.run.smithi008.stdout: } 2023-08-01T19:56:24.747 INFO:teuthology.orchestra.run.smithi008.stdout: }, 2023-08-01T19:56:24.747 INFO:teuthology.orchestra.run.smithi008.stdout: { 2023-08-01T19:56:24.748 INFO:teuthology.orchestra.run.smithi008.stdout: "description": "osd_op(client.4668.0:246951 5.1 5:8ced494c:::benchmark_data_smithi006_114134_object113290:head [delete] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e74)", 2023-08-01T19:56:24.748 INFO:teuthology.orchestra.run.smithi008.stdout: "initiated_at": "2023-08-01T19:56:24.683907+0000", 2023-08-01T19:56:24.748 INFO:teuthology.orchestra.run.smithi008.stdout: "age": 0.0052401089999999997, 2023-08-01T19:56:24.748 INFO:teuthology.orchestra.run.smithi008.stdout: "duration": 0.0058798899999999996, 2023-08-01T19:56:24.748 INFO:teuthology.orchestra.run.smithi008.stdout: "type_data": { 2023-08-01T19:56:24.748 INFO:teuthology.orchestra.run.smithi008.stdout: "flag_point": "started", 2023-08-01T19:56:24.748 INFO:teuthology.orchestra.run.smithi008.stdout: "client_info": { 2023-08-01T19:56:24.748 INFO:teuthology.orchestra.run.smithi008.stdout: "client": "client.4668", 2023-08-01T19:56:24.749 INFO:teuthology.orchestra.run.smithi008.stdout: "client_addr": "172.21.15.6:0/1709472247", 2023-08-01T19:56:24.749 INFO:teuthology.orchestra.run.smithi008.stdout: "tid": 246951 2023-08-01T19:56:24.749 INFO:teuthology.orchestra.run.smithi008.stdout: }, 2023-08-01T19:56:24.749 INFO:teuthology.orchestra.run.smithi008.stdout: "events": [ 2023-08-01T19:56:24.749 INFO:teuthology.orchestra.run.smithi008.stdout: { 2023-08-01T19:56:24.749 INFO:teuthology.orchestra.run.smithi008.stdout: "event": "initiated", 2023-08-01T19:56:24.749 INFO:teuthology.orchestra.run.smithi008.stdout: "time": "2023-08-01T19:56:24.683907+0000", 2023-08-01T19:56:24.750 INFO:teuthology.orchestra.run.smithi008.stdout: "duration": 0 2023-08-01T19:56:24.750 INFO:teuthology.orchestra.run.smithi008.stdout: }, 2023-08-01T19:56:24.750 INFO:teuthology.orchestra.run.smithi008.stdout: { 2023-08-01T19:56:24.750 INFO:teuthology.orchestra.run.smithi008.stdout: "event": "throttled", 2023-08-01T19:56:24.750 INFO:teuthology.orchestra.run.smithi008.stdout: "time": "2023-08-01T19:56:24.683907+0000", 2023-08-01T19:56:24.750 INFO:teuthology.orchestra.run.smithi008.stdout: "duration": 0 2023-08-01T19:56:24.750 INFO:teuthology.orchestra.run.smithi008.stdout: }, 2023-08-01T19:56:24.750 INFO:teuthology.orchestra.run.smithi008.stdout: { 2023-08-01T19:56:24.751 INFO:teuthology.orchestra.run.smithi008.stdout: "event": "header_read", 2023-08-01T19:56:24.751 INFO:teuthology.orchestra.run.smithi008.stdout: "time": "2023-08-01T19:56:24.683907+0000", 2023-08-01T19:56:24.751 INFO:teuthology.orchestra.run.smithi008.stdout: "duration": 4294967295.9999995 2023-08-01T19:56:24.751 INFO:teuthology.orchestra.run.smithi008.stdout: }, 2023-08-01T19:56:24.751 INFO:teuthology.orchestra.run.smithi008.stdout: { 2023-08-01T19:56:24.751 INFO:teuthology.orchestra.run.smithi008.stdout: "event": "all_read", 2023-08-01T19:56:24.751 INFO:teuthology.orchestra.run.smithi008.stdout: "time": "2023-08-01T19:56:24.683909+0000", 2023-08-01T19:56:24.751 INFO:teuthology.orchestra.run.smithi008.stdout: "duration": 2.3199999999999998e-06 2023-08-01T19:56:24.752 INFO:teuthology.orchestra.run.smithi008.stdout: }, 2023-08-01T19:56:24.752 INFO:teuthology.orchestra.run.smithi008.stdout: { 2023-08-01T19:56:24.752 INFO:teuthology.orchestra.run.smithi008.stdout: "event": "dispatched", 2023-08-01T19:56:24.752 INFO:teuthology.orchestra.run.smithi008.stdout: "time": "2023-08-01T19:56:24.683915+0000", 2023-08-01T19:56:24.752 INFO:teuthology.orchestra.run.smithi008.stdout: "duration": 5.7309999999999998e-06 2023-08-01T19:56:24.752 INFO:teuthology.orchestra.run.smithi008.stdout: }, 2023-08-01T19:56:24.752 INFO:teuthology.orchestra.run.smithi008.stdout: { 2023-08-01T19:56:24.752 INFO:teuthology.orchestra.run.smithi008.stdout: "event": "queued_for_pg", 2023-08-01T19:56:24.753 INFO:teuthology.orchestra.run.smithi008.stdout: "time": "2023-08-01T19:56:24.683919+0000", 2023-08-01T19:56:24.753 INFO:teuthology.orchestra.run.smithi008.stdout: "duration": 3.9509999999999999e-06 2023-08-01T19:56:24.753 INFO:teuthology.orchestra.run.smithi008.stdout: }, 2023-08-01T19:56:24.753 INFO:teuthology.orchestra.run.smithi008.stdout: { 2023-08-01T19:56:24.753 INFO:teuthology.orchestra.run.smithi008.stdout: "event": "reached_pg", 2023-08-01T19:56:24.753 INFO:teuthology.orchestra.run.smithi008.stdout: "time": "2023-08-01T19:56:24.683960+0000", 2023-08-01T19:56:24.753 INFO:teuthology.orchestra.run.smithi008.stdout: "duration": 4.1387000000000002e-05 2023-08-01T19:56:24.753 INFO:teuthology.orchestra.run.smithi008.stdout: }, 2023-08-01T19:56:24.754 INFO:teuthology.orchestra.run.smithi008.stdout: { 2023-08-01T19:56:24.754 INFO:teuthology.orchestra.run.smithi008.stdout: "event": "started", 2023-08-01T19:56:24.754 INFO:teuthology.orchestra.run.smithi008.stdout: "time": "2023-08-01T19:56:24.684088+0000", 2023-08-01T19:56:24.754 INFO:teuthology.orchestra.run.smithi008.stdout: "duration": 0.000128233 2023-08-01T19:56:24.754 INFO:teuthology.orchestra.run.smithi008.stdout: } 2023-08-01T19:56:24.754 INFO:teuthology.orchestra.run.smithi008.stdout: ] 2023-08-01T19:56:24.754 INFO:teuthology.orchestra.run.smithi008.stdout: } 2023-08-01T19:56:24.754 INFO:teuthology.orchestra.run.smithi008.stdout: }, 2023-08-01T19:56:24.755 INFO:teuthology.orchestra.run.smithi008.stdout: { 2023-08-01T19:56:24.755 INFO:teuthology.orchestra.run.smithi008.stdout: "description": "osd_op(client.4668.0:246952 5.4 5:2956ea77:::benchmark_data_smithi006_114134_object113291:head [delete] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e74)", 2023-08-01T19:56:24.755 INFO:teuthology.orchestra.run.smithi008.stdout: "initiated_at": "2023-08-01T19:56:24.684064+0000", 2023-08-01T19:56:24.755 INFO:teuthology.orchestra.run.smithi008.stdout: "age": 0.0050828260000000004, 2023-08-01T19:56:24.755 INFO:teuthology.orchestra.run.smithi008.stdout: "duration": 0.0058071429999999999, 2023-08-01T19:56:24.755 INFO:teuthology.orchestra.run.smithi008.stdout: "type_data": { 2023-08-01T19:56:24.755 INFO:teuthology.orchestra.run.smithi008.stdout: "flag_point": "waiting for sub ops", 2023-08-01T19:56:24.755 INFO:teuthology.orchestra.run.smithi008.stdout: "client_info": { 2023-08-01T19:56:24.756 INFO:teuthology.orchestra.run.smithi008.stdout: "client": "client.4668", 2023-08-01T19:56:24.756 INFO:teuthology.orchestra.run.smithi008.stdout: "client_addr": "172.21.15.6:0/1709472247", 2023-08-01T19:56:24.756 INFO:teuthology.orchestra.run.smithi008.stdout: "tid": 246952 2023-08-01T19:56:24.756 INFO:teuthology.orchestra.run.smithi008.stdout: }, 2023-08-01T19:56:24.756 INFO:teuthology.orchestra.run.smithi008.stdout: "events": [ 2023-08-01T19:56:24.756 INFO:teuthology.orchestra.run.smithi008.stdout: { 2023-08-01T19:56:24.756 INFO:teuthology.orchestra.run.smithi008.stdout: "event": "initiated", 2023-08-01T19:56:24.757 INFO:teuthology.orchestra.run.smithi008.stdout: "time": "2023-08-01T19:56:24.684064+0000", 2023-08-01T19:56:24.757 INFO:teuthology.orchestra.run.smithi008.stdout: "duration": 0 2023-08-01T19:56:24.757 INFO:teuthology.orchestra.run.smithi008.stdout: }, 2023-08-01T19:56:24.757 INFO:teuthology.orchestra.run.smithi008.stdout: { 2023-08-01T19:56:24.757 INFO:teuthology.orchestra.run.smithi008.stdout: "event": "throttled", 2023-08-01T19:56:24.757 INFO:teuthology.orchestra.run.smithi008.stdout: "time": "2023-08-01T19:56:24.684064+0000", 2023-08-01T19:56:24.757 INFO:teuthology.orchestra.run.smithi008.stdout: "duration": 0 2023-08-01T19:56:24.758 INFO:teuthology.orchestra.run.smithi008.stdout: }, 2023-08-01T19:56:24.758 INFO:teuthology.orchestra.run.smithi008.stdout: { 2023-08-01T19:56:24.758 INFO:teuthology.orchestra.run.smithi008.stdout: "event": "header_read", 2023-08-01T19:56:24.758 INFO:teuthology.orchestra.run.smithi008.stdout: "time": "2023-08-01T19:56:24.684063+0000", 2023-08-01T19:56:24.758 INFO:teuthology.orchestra.run.smithi008.stdout: "duration": 4294967295.999999 2023-08-01T19:56:24.758 INFO:teuthology.orchestra.run.smithi008.stdout: }, 2023-08-01T19:56:24.758 INFO:teuthology.orchestra.run.smithi008.stdout: { 2023-08-01T19:56:24.758 INFO:teuthology.orchestra.run.smithi008.stdout: "event": "all_read", 2023-08-01T19:56:24.759 INFO:teuthology.orchestra.run.smithi008.stdout: "time": "2023-08-01T19:56:24.684068+0000", 2023-08-01T19:56:24.759 INFO:teuthology.orchestra.run.smithi008.stdout: "duration": 4.5689999999999998e-06 2023-08-01T19:56:24.759 INFO:teuthology.orchestra.run.smithi008.stdout: }, 2023-08-01T19:56:24.759 INFO:teuthology.orchestra.run.smithi008.stdout: { 2023-08-01T19:56:24.759 INFO:teuthology.orchestra.run.smithi008.stdout: "event": "dispatched", 2023-08-01T19:56:24.759 INFO:teuthology.orchestra.run.smithi008.stdout: "time": "2023-08-01T19:56:24.684077+0000", 2023-08-01T19:56:24.759 INFO:teuthology.orchestra.run.smithi008.stdout: "duration": 8.8170000000000005e-06 2023-08-01T19:56:24.760 INFO:teuthology.orchestra.run.smithi008.stdout: }, 2023-08-01T19:56:24.760 INFO:teuthology.orchestra.run.smithi008.stdout: { 2023-08-01T19:56:24.760 INFO:teuthology.orchestra.run.smithi008.stdout: "event": "queued_for_pg", 2023-08-01T19:56:24.760 INFO:teuthology.orchestra.run.smithi008.stdout: "time": "2023-08-01T19:56:24.684084+0000", 2023-08-01T19:56:24.760 INFO:teuthology.orchestra.run.smithi008.stdout: "duration": 7.7079999999999997e-06 2023-08-01T19:56:24.760 INFO:teuthology.orchestra.run.smithi008.stdout: }, 2023-08-01T19:56:24.760 INFO:teuthology.orchestra.run.smithi008.stdout: { 2023-08-01T19:56:24.760 INFO:teuthology.orchestra.run.smithi008.stdout: "event": "reached_pg", 2023-08-01T19:56:24.761 INFO:teuthology.orchestra.run.smithi008.stdout: "time": "2023-08-01T19:56:24.684210+0000", 2023-08-01T19:56:24.761 INFO:teuthology.orchestra.run.smithi008.stdout: "duration": 0.00012510700000000001 2023-08-01T19:56:24.761 INFO:teuthology.orchestra.run.smithi008.stdout: }, 2023-08-01T19:56:24.761 INFO:teuthology.orchestra.run.smithi008.stdout: { 2023-08-01T19:56:24.761 INFO:teuthology.orchestra.run.smithi008.stdout: "event": "started", 2023-08-01T19:56:24.761 INFO:teuthology.orchestra.run.smithi008.stdout: "time": "2023-08-01T19:56:24.684322+0000", 2023-08-01T19:56:24.761 INFO:teuthology.orchestra.run.smithi008.stdout: "duration": 0.000112108 2023-08-01T19:56:24.761 INFO:teuthology.orchestra.run.smithi008.stdout: }, 2023-08-01T19:56:24.762 INFO:teuthology.orchestra.run.smithi008.stdout: { 2023-08-01T19:56:24.762 INFO:teuthology.orchestra.run.smithi008.stdout: "event": "waiting for subops from 2", 2023-08-01T19:56:24.762 INFO:teuthology.orchestra.run.smithi008.stdout: "time": "2023-08-01T19:56:24.684426+0000", 2023-08-01T19:56:24.762 INFO:teuthology.orchestra.run.smithi008.stdout: "duration": 0.000103911 2023-08-01T19:56:24.762 INFO:teuthology.orchestra.run.smithi008.stdout: }, 2023-08-01T19:56:24.762 INFO:teuthology.orchestra.run.smithi008.stdout: { 2023-08-01T19:56:24.762 INFO:teuthology.orchestra.run.smithi008.stdout: "event": "sub_op_commit_rec", 2023-08-01T19:56:24.762 INFO:teuthology.orchestra.run.smithi008.stdout: "time": "2023-08-01T19:56:24.689493+0000", 2023-08-01T19:56:24.763 INFO:teuthology.orchestra.run.smithi008.stdout: "duration": 0.0050675149999999999 2023-08-01T19:56:24.763 INFO:teuthology.orchestra.run.smithi008.stdout: } 2023-08-01T19:56:24.763 INFO:teuthology.orchestra.run.smithi008.stdout: ] 2023-08-01T19:56:24.763 INFO:teuthology.orchestra.run.smithi008.stdout: } 2023-08-01T19:56:24.763 INFO:teuthology.orchestra.run.smithi008.stdout: }, 2023-08-01T19:56:24.763 INFO:teuthology.orchestra.run.smithi008.stdout: { 2023-08-01T19:56:24.763 INFO:teuthology.orchestra.run.smithi008.stdout: "description": "osd_op(client.4668.0:246953 5.4 5:26143f25:::benchmark_data_smithi006_114134_object113292:head [delete] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e74)", 2023-08-01T19:56:24.763 INFO:teuthology.orchestra.run.smithi008.stdout: "initiated_at": "2023-08-01T19:56:24.687142+0000", 2023-08-01T19:56:24.764 INFO:teuthology.orchestra.run.smithi008.stdout: "age": 0.002005265, 2023-08-01T19:56:24.764 INFO:teuthology.orchestra.run.smithi008.stdout: "duration": 0.0028215390000000001, 2023-08-01T19:56:24.764 INFO:teuthology.orchestra.run.smithi008.stdout: "type_data": { 2023-08-01T19:56:24.764 INFO:teuthology.orchestra.run.smithi008.stdout: "flag_point": "waiting for sub ops", 2023-08-01T19:56:24.764 INFO:teuthology.orchestra.run.smithi008.stdout: "client_info": { 2023-08-01T19:56:24.764 INFO:teuthology.orchestra.run.smithi008.stdout: "client": "client.4668", 2023-08-01T19:56:24.764 INFO:teuthology.orchestra.run.smithi008.stdout: "client_addr": "172.21.15.6:0/1709472247", 2023-08-01T19:56:24.764 INFO:teuthology.orchestra.run.smithi008.stdout: "tid": 246953 2023-08-01T19:56:24.765 INFO:teuthology.orchestra.run.smithi008.stdout: }, 2023-08-01T19:56:24.765 INFO:teuthology.orchestra.run.smithi008.stdout: "events": [ 2023-08-01T19:56:24.765 INFO:teuthology.orchestra.run.smithi008.stdout: { 2023-08-01T19:56:24.765 INFO:teuthology.orchestra.run.smithi008.stdout: "event": "initiated", 2023-08-01T19:56:24.765 INFO:teuthology.orchestra.run.smithi008.stdout: "time": "2023-08-01T19:56:24.687142+0000", 2023-08-01T19:56:24.765 INFO:teuthology.orchestra.run.smithi008.stdout: "duration": 0 2023-08-01T19:56:24.765 INFO:teuthology.orchestra.run.smithi008.stdout: }, 2023-08-01T19:56:24.766 INFO:teuthology.orchestra.run.smithi008.stdout: { 2023-08-01T19:56:24.766 INFO:teuthology.orchestra.run.smithi008.stdout: "event": "throttled", 2023-08-01T19:56:24.766 INFO:teuthology.orchestra.run.smithi008.stdout: "time": "2023-08-01T19:56:24.687142+0000", 2023-08-01T19:56:24.766 INFO:teuthology.orchestra.run.smithi008.stdout: "duration": 0 2023-08-01T19:56:24.766 INFO:teuthology.orchestra.run.smithi008.stdout: }, 2023-08-01T19:56:24.766 INFO:teuthology.orchestra.run.smithi008.stdout: { 2023-08-01T19:56:24.766 INFO:teuthology.orchestra.run.smithi008.stdout: "event": "header_read", 2023-08-01T19:56:24.766 INFO:teuthology.orchestra.run.smithi008.stdout: "time": "2023-08-01T19:56:24.687141+0000", 2023-08-01T19:56:24.767 INFO:teuthology.orchestra.run.smithi008.stdout: "duration": 4294967295.999999 2023-08-01T19:56:24.767 INFO:teuthology.orchestra.run.smithi008.stdout: }, 2023-08-01T19:56:24.767 INFO:teuthology.orchestra.run.smithi008.stdout: { 2023-08-01T19:56:24.767 INFO:teuthology.orchestra.run.smithi008.stdout: "event": "all_read", 2023-08-01T19:56:24.767 INFO:teuthology.orchestra.run.smithi008.stdout: "time": "2023-08-01T19:56:24.687145+0000", 2023-08-01T19:56:24.767 INFO:teuthology.orchestra.run.smithi008.stdout: "duration": 3.8940000000000003e-06 2023-08-01T19:56:24.767 INFO:teuthology.orchestra.run.smithi008.stdout: }, 2023-08-01T19:56:24.767 INFO:teuthology.orchestra.run.smithi008.stdout: { 2023-08-01T19:56:24.768 INFO:teuthology.orchestra.run.smithi008.stdout: "event": "dispatched", 2023-08-01T19:56:24.768 INFO:teuthology.orchestra.run.smithi008.stdout: "time": "2023-08-01T19:56:24.687154+0000", 2023-08-01T19:56:24.768 INFO:teuthology.orchestra.run.smithi008.stdout: "duration": 9.02e-06 2023-08-01T19:56:24.768 INFO:teuthology.orchestra.run.smithi008.stdout: }, 2023-08-01T19:56:24.768 INFO:teuthology.orchestra.run.smithi008.stdout: { 2023-08-01T19:56:24.768 INFO:teuthology.orchestra.run.smithi008.stdout: "event": "queued_for_pg", 2023-08-01T19:56:24.768 INFO:teuthology.orchestra.run.smithi008.stdout: "time": "2023-08-01T19:56:24.687158+0000", 2023-08-01T19:56:24.768 INFO:teuthology.orchestra.run.smithi008.stdout: "duration": 4.1849999999999997e-06 2023-08-01T19:56:24.769 INFO:teuthology.orchestra.run.smithi008.stdout: }, 2023-08-01T19:56:24.769 INFO:teuthology.orchestra.run.smithi008.stdout: { 2023-08-01T19:56:24.769 INFO:teuthology.orchestra.run.smithi008.stdout: "event": "reached_pg", 2023-08-01T19:56:24.769 INFO:teuthology.orchestra.run.smithi008.stdout: "time": "2023-08-01T19:56:24.687195+0000", 2023-08-01T19:56:24.769 INFO:teuthology.orchestra.run.smithi008.stdout: "duration": 3.7268000000000003e-05 2023-08-01T19:56:24.769 INFO:teuthology.orchestra.run.smithi008.stdout: }, 2023-08-01T19:56:24.769 INFO:teuthology.orchestra.run.smithi008.stdout: { 2023-08-01T19:56:24.769 INFO:teuthology.orchestra.run.smithi008.stdout: "event": "started", 2023-08-01T19:56:24.770 INFO:teuthology.orchestra.run.smithi008.stdout: "time": "2023-08-01T19:56:24.687313+0000", 2023-08-01T19:56:24.770 INFO:teuthology.orchestra.run.smithi008.stdout: "duration": 0.000117942 2023-08-01T19:56:24.770 INFO:teuthology.orchestra.run.smithi008.stdout: }, 2023-08-01T19:56:24.770 INFO:teuthology.orchestra.run.smithi008.stdout: { 2023-08-01T19:56:24.770 INFO:teuthology.orchestra.run.smithi008.stdout: "event": "waiting for subops from 2", 2023-08-01T19:56:24.770 INFO:teuthology.orchestra.run.smithi008.stdout: "time": "2023-08-01T19:56:24.687433+0000", 2023-08-01T19:56:24.770 INFO:teuthology.orchestra.run.smithi008.stdout: "duration": 0.00011922 2023-08-01T19:56:24.770 INFO:teuthology.orchestra.run.smithi008.stdout: } 2023-08-01T19:56:24.771 INFO:teuthology.orchestra.run.smithi008.stdout: ] 2023-08-01T19:56:24.771 INFO:teuthology.orchestra.run.smithi008.stdout: } 2023-08-01T19:56:24.771 INFO:teuthology.orchestra.run.smithi008.stdout: }, 2023-08-01T19:56:24.771 INFO:teuthology.orchestra.run.smithi008.stdout: { 2023-08-01T19:56:24.771 INFO:teuthology.orchestra.run.smithi008.stdout: "description": "osd_op(client.4668.0:246954 5.2 5:40ee3862:::benchmark_data_smithi006_114134_object113293:head [delete] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e74)", 2023-08-01T19:56:24.771 INFO:teuthology.orchestra.run.smithi008.stdout: "initiated_at": "2023-08-01T19:56:24.687170+0000", 2023-08-01T19:56:24.771 INFO:teuthology.orchestra.run.smithi008.stdout: "age": 0.001977435, 2023-08-01T19:56:24.771 INFO:teuthology.orchestra.run.smithi008.stdout: "duration": 0.0028467570000000001, 2023-08-01T19:56:24.772 INFO:teuthology.orchestra.run.smithi008.stdout: "type_data": { 2023-08-01T19:56:24.772 INFO:teuthology.orchestra.run.smithi008.stdout: "flag_point": "started", 2023-08-01T19:56:24.772 INFO:teuthology.orchestra.run.smithi008.stdout: "client_info": { 2023-08-01T19:56:24.772 INFO:teuthology.orchestra.run.smithi008.stdout: "client": "client.4668", 2023-08-01T19:56:24.772 INFO:teuthology.orchestra.run.smithi008.stdout: "client_addr": "172.21.15.6:0/1709472247", 2023-08-01T19:56:24.772 INFO:teuthology.orchestra.run.smithi008.stdout: "tid": 246954 2023-08-01T19:56:24.772 INFO:teuthology.orchestra.run.smithi008.stdout: }, 2023-08-01T19:56:24.773 INFO:teuthology.orchestra.run.smithi008.stdout: "events": [ 2023-08-01T19:56:24.773 INFO:teuthology.orchestra.run.smithi008.stdout: { 2023-08-01T19:56:24.773 INFO:teuthology.orchestra.run.smithi008.stdout: "event": "initiated", 2023-08-01T19:56:24.773 INFO:teuthology.orchestra.run.smithi008.stdout: "time": "2023-08-01T19:56:24.687170+0000", 2023-08-01T19:56:24.773 INFO:teuthology.orchestra.run.smithi008.stdout: "duration": 0 2023-08-01T19:56:24.773 INFO:teuthology.orchestra.run.smithi008.stdout: }, 2023-08-01T19:56:24.773 INFO:teuthology.orchestra.run.smithi008.stdout: { 2023-08-01T19:56:24.773 INFO:teuthology.orchestra.run.smithi008.stdout: "event": "throttled", 2023-08-01T19:56:24.774 INFO:teuthology.orchestra.run.smithi008.stdout: "time": "2023-08-01T19:56:24.687170+0000", 2023-08-01T19:56:24.774 INFO:teuthology.orchestra.run.smithi008.stdout: "duration": 0 2023-08-01T19:56:24.774 INFO:teuthology.orchestra.run.smithi008.stdout: }, 2023-08-01T19:56:24.774 INFO:teuthology.orchestra.run.smithi008.stdout: { 2023-08-01T19:56:24.774 INFO:teuthology.orchestra.run.smithi008.stdout: "event": "header_read", 2023-08-01T19:56:24.774 INFO:teuthology.orchestra.run.smithi008.stdout: "time": "2023-08-01T19:56:24.687169+0000", 2023-08-01T19:56:24.774 INFO:teuthology.orchestra.run.smithi008.stdout: "duration": 4294967295.9999995 2023-08-01T19:56:24.775 INFO:teuthology.orchestra.run.smithi008.stdout: }, 2023-08-01T19:56:24.775 INFO:teuthology.orchestra.run.smithi008.stdout: { 2023-08-01T19:56:24.775 INFO:teuthology.orchestra.run.smithi008.stdout: "event": "all_read", 2023-08-01T19:56:24.775 INFO:teuthology.orchestra.run.smithi008.stdout: "time": "2023-08-01T19:56:24.687171+0000", 2023-08-01T19:56:24.775 INFO:teuthology.orchestra.run.smithi008.stdout: "duration": 2.1610000000000001e-06 2023-08-01T19:56:24.775 INFO:teuthology.orchestra.run.smithi008.stdout: }, 2023-08-01T19:56:24.775 INFO:teuthology.orchestra.run.smithi008.stdout: { 2023-08-01T19:56:24.775 INFO:teuthology.orchestra.run.smithi008.stdout: "event": "dispatched", 2023-08-01T19:56:24.776 INFO:teuthology.orchestra.run.smithi008.stdout: "time": "2023-08-01T19:56:24.687176+0000", 2023-08-01T19:56:24.776 INFO:teuthology.orchestra.run.smithi008.stdout: "duration": 4.262e-06 2023-08-01T19:56:24.776 INFO:teuthology.orchestra.run.smithi008.stdout: }, 2023-08-01T19:56:24.776 INFO:teuthology.orchestra.run.smithi008.stdout: { 2023-08-01T19:56:24.776 INFO:teuthology.orchestra.run.smithi008.stdout: "event": "queued_for_pg", 2023-08-01T19:56:24.776 INFO:teuthology.orchestra.run.smithi008.stdout: "time": "2023-08-01T19:56:24.687179+0000", 2023-08-01T19:56:24.776 INFO:teuthology.orchestra.run.smithi008.stdout: "duration": 2.8559999999999998e-06 2023-08-01T19:56:24.776 INFO:teuthology.orchestra.run.smithi008.stdout: }, 2023-08-01T19:56:24.777 INFO:teuthology.orchestra.run.smithi008.stdout: { 2023-08-01T19:56:24.777 INFO:teuthology.orchestra.run.smithi008.stdout: "event": "reached_pg", 2023-08-01T19:56:24.777 INFO:teuthology.orchestra.run.smithi008.stdout: "time": "2023-08-01T19:56:24.687211+0000", 2023-08-01T19:56:24.777 INFO:teuthology.orchestra.run.smithi008.stdout: "duration": 3.2509999999999999e-05 2023-08-01T19:56:24.777 INFO:teuthology.orchestra.run.smithi008.stdout: }, 2023-08-01T19:56:24.777 INFO:teuthology.orchestra.run.smithi008.stdout: { 2023-08-01T19:56:24.777 INFO:teuthology.orchestra.run.smithi008.stdout: "event": "started", 2023-08-01T19:56:24.777 INFO:teuthology.orchestra.run.smithi008.stdout: "time": "2023-08-01T19:56:24.687320+0000", 2023-08-01T19:56:24.778 INFO:teuthology.orchestra.run.smithi008.stdout: "duration": 0.00010893200000000001 2023-08-01T19:56:24.778 INFO:teuthology.orchestra.run.smithi008.stdout: } 2023-08-01T19:56:24.778 INFO:teuthology.orchestra.run.smithi008.stdout: ] 2023-08-01T19:56:24.778 INFO:teuthology.orchestra.run.smithi008.stdout: } 2023-08-01T19:56:24.778 INFO:teuthology.orchestra.run.smithi008.stdout: }, 2023-08-01T19:56:24.778 INFO:teuthology.orchestra.run.smithi008.stdout: { 2023-08-01T19:56:24.778 INFO:teuthology.orchestra.run.smithi008.stdout: "description": "osd_op(client.4668.0:246955 5.6 5:6f257de3:::benchmark_data_smithi006_114134_object113294:head [delete] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e74)", 2023-08-01T19:56:24.779 INFO:teuthology.orchestra.run.smithi008.stdout: "initiated_at": "2023-08-01T19:56:24.687185+0000", 2023-08-01T19:56:24.779 INFO:teuthology.orchestra.run.smithi008.stdout: "age": 0.0019620240000000001, 2023-08-01T19:56:24.779 INFO:teuthology.orchestra.run.smithi008.stdout: "duration": 0.002876389, 2023-08-01T19:56:24.779 INFO:teuthology.orchestra.run.smithi008.stdout: "type_data": { 2023-08-01T19:56:24.779 INFO:teuthology.orchestra.run.smithi008.stdout: "flag_point": "started", 2023-08-01T19:56:24.779 INFO:teuthology.orchestra.run.smithi008.stdout: "client_info": { 2023-08-01T19:56:24.779 INFO:teuthology.orchestra.run.smithi008.stdout: "client": "client.4668", 2023-08-01T19:56:24.779 INFO:teuthology.orchestra.run.smithi008.stdout: "client_addr": "172.21.15.6:0/1709472247", 2023-08-01T19:56:24.780 INFO:teuthology.orchestra.run.smithi008.stdout: "tid": 246955 2023-08-01T19:56:24.780 INFO:teuthology.orchestra.run.smithi008.stdout: }, 2023-08-01T19:56:24.780 INFO:teuthology.orchestra.run.smithi008.stdout: "events": [ 2023-08-01T19:56:24.780 INFO:teuthology.orchestra.run.smithi008.stdout: { 2023-08-01T19:56:24.780 INFO:teuthology.orchestra.run.smithi008.stdout: "event": "initiated", 2023-08-01T19:56:24.780 INFO:teuthology.orchestra.run.smithi008.stdout: "time": "2023-08-01T19:56:24.687185+0000", 2023-08-01T19:56:24.780 INFO:teuthology.orchestra.run.smithi008.stdout: "duration": 0 2023-08-01T19:56:24.780 INFO:teuthology.orchestra.run.smithi008.stdout: }, 2023-08-01T19:56:24.781 INFO:teuthology.orchestra.run.smithi008.stdout: { 2023-08-01T19:56:24.781 INFO:teuthology.orchestra.run.smithi008.stdout: "event": "throttled", 2023-08-01T19:56:24.781 INFO:teuthology.orchestra.run.smithi008.stdout: "time": "2023-08-01T19:56:24.687185+0000", 2023-08-01T19:56:24.781 INFO:teuthology.orchestra.run.smithi008.stdout: "duration": 0 2023-08-01T19:56:24.781 INFO:teuthology.orchestra.run.smithi008.stdout: }, 2023-08-01T19:56:24.781 INFO:teuthology.orchestra.run.smithi008.stdout: { 2023-08-01T19:56:24.781 INFO:teuthology.orchestra.run.smithi008.stdout: "event": "header_read", 2023-08-01T19:56:24.781 INFO:teuthology.orchestra.run.smithi008.stdout: "time": "2023-08-01T19:56:24.687185+0000", 2023-08-01T19:56:24.782 INFO:teuthology.orchestra.run.smithi008.stdout: "duration": 4294967295.9999995 2023-08-01T19:56:24.782 INFO:teuthology.orchestra.run.smithi008.stdout: }, 2023-08-01T19:56:24.782 INFO:teuthology.orchestra.run.smithi008.stdout: { 2023-08-01T19:56:24.782 INFO:teuthology.orchestra.run.smithi008.stdout: "event": "all_read", 2023-08-01T19:56:24.782 INFO:teuthology.orchestra.run.smithi008.stdout: "time": "2023-08-01T19:56:24.687187+0000", 2023-08-01T19:56:24.782 INFO:teuthology.orchestra.run.smithi008.stdout: "duration": 2.2589999999999999e-06 2023-08-01T19:56:24.782 INFO:teuthology.orchestra.run.smithi008.stdout: }, 2023-08-01T19:56:24.782 INFO:teuthology.orchestra.run.smithi008.stdout: { 2023-08-01T19:56:24.783 INFO:teuthology.orchestra.run.smithi008.stdout: "event": "dispatched", 2023-08-01T19:56:24.783 INFO:teuthology.orchestra.run.smithi008.stdout: "time": "2023-08-01T19:56:24.687194+0000", 2023-08-01T19:56:24.783 INFO:teuthology.orchestra.run.smithi008.stdout: "duration": 7.0670000000000003e-06 2023-08-01T19:56:24.783 INFO:teuthology.orchestra.run.smithi008.stdout: }, 2023-08-01T19:56:24.783 INFO:teuthology.orchestra.run.smithi008.stdout: { 2023-08-01T19:56:24.783 INFO:teuthology.orchestra.run.smithi008.stdout: "event": "queued_for_pg", 2023-08-01T19:56:24.783 INFO:teuthology.orchestra.run.smithi008.stdout: "time": "2023-08-01T19:56:24.687198+0000", 2023-08-01T19:56:24.783 INFO:teuthology.orchestra.run.smithi008.stdout: "duration": 4.1200000000000004e-06 2023-08-01T19:56:24.784 INFO:teuthology.orchestra.run.smithi008.stdout: }, 2023-08-01T19:56:24.784 INFO:teuthology.orchestra.run.smithi008.stdout: { 2023-08-01T19:56:24.784 INFO:teuthology.orchestra.run.smithi008.stdout: "event": "reached_pg", 2023-08-01T19:56:24.784 INFO:teuthology.orchestra.run.smithi008.stdout: "time": "2023-08-01T19:56:24.687234+0000", 2023-08-01T19:56:24.784 INFO:teuthology.orchestra.run.smithi008.stdout: "duration": 3.5932000000000001e-05 2023-08-01T19:56:24.784 INFO:teuthology.orchestra.run.smithi008.stdout: }, 2023-08-01T19:56:24.784 INFO:teuthology.orchestra.run.smithi008.stdout: { 2023-08-01T19:56:24.785 INFO:teuthology.orchestra.run.smithi008.stdout: "event": "started", 2023-08-01T19:56:24.785 INFO:teuthology.orchestra.run.smithi008.stdout: "time": "2023-08-01T19:56:24.687368+0000", 2023-08-01T19:56:24.785 INFO:teuthology.orchestra.run.smithi008.stdout: "duration": 0.00013408499999999999 2023-08-01T19:56:24.785 INFO:teuthology.orchestra.run.smithi008.stdout: } 2023-08-01T19:56:24.785 INFO:teuthology.orchestra.run.smithi008.stdout: ] 2023-08-01T19:56:24.785 INFO:teuthology.orchestra.run.smithi008.stdout: } 2023-08-01T19:56:24.785 INFO:teuthology.orchestra.run.smithi008.stdout: }, 2023-08-01T19:56:24.785 INFO:teuthology.orchestra.run.smithi008.stdout: { 2023-08-01T19:56:24.786 INFO:teuthology.orchestra.run.smithi008.stdout: "description": "osd_op(client.4668.0:246956 5.5 5:afa776de:::benchmark_data_smithi006_114134_object113295:head [delete] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e74)", 2023-08-01T19:56:24.786 INFO:teuthology.orchestra.run.smithi008.stdout: "initiated_at": "2023-08-01T19:56:24.687208+0000", 2023-08-01T19:56:24.786 INFO:teuthology.orchestra.run.smithi008.stdout: "age": 0.0019387230000000001, 2023-08-01T19:56:24.786 INFO:teuthology.orchestra.run.smithi008.stdout: "duration": 0.0029093729999999998, 2023-08-01T19:56:24.786 INFO:teuthology.orchestra.run.smithi008.stdout: "type_data": { 2023-08-01T19:56:24.786 INFO:teuthology.orchestra.run.smithi008.stdout: "flag_point": "started", 2023-08-01T19:56:24.786 INFO:teuthology.orchestra.run.smithi008.stdout: "client_info": { 2023-08-01T19:56:24.786 INFO:teuthology.orchestra.run.smithi008.stdout: "client": "client.4668", 2023-08-01T19:56:24.787 INFO:teuthology.orchestra.run.smithi008.stdout: "client_addr": "172.21.15.6:0/1709472247", 2023-08-01T19:56:24.787 INFO:teuthology.orchestra.run.smithi008.stdout: "tid": 246956 2023-08-01T19:56:24.787 INFO:teuthology.orchestra.run.smithi008.stdout: }, 2023-08-01T19:56:24.787 INFO:teuthology.orchestra.run.smithi008.stdout: "events": [ 2023-08-01T19:56:24.787 INFO:teuthology.orchestra.run.smithi008.stdout: { 2023-08-01T19:56:24.787 INFO:teuthology.orchestra.run.smithi008.stdout: "event": "initiated", 2023-08-01T19:56:24.787 INFO:teuthology.orchestra.run.smithi008.stdout: "time": "2023-08-01T19:56:24.687208+0000", 2023-08-01T19:56:24.787 INFO:teuthology.orchestra.run.smithi008.stdout: "duration": 0 2023-08-01T19:56:24.788 INFO:teuthology.orchestra.run.smithi008.stdout: }, 2023-08-01T19:56:24.788 INFO:teuthology.orchestra.run.smithi008.stdout: { 2023-08-01T19:56:24.788 INFO:teuthology.orchestra.run.smithi008.stdout: "event": "throttled", 2023-08-01T19:56:24.788 INFO:teuthology.orchestra.run.smithi008.stdout: "time": "2023-08-01T19:56:24.687208+0000", 2023-08-01T19:56:24.788 INFO:teuthology.orchestra.run.smithi008.stdout: "duration": 0 2023-08-01T19:56:24.788 INFO:teuthology.orchestra.run.smithi008.stdout: }, 2023-08-01T19:56:24.788 INFO:teuthology.orchestra.run.smithi008.stdout: { 2023-08-01T19:56:24.789 INFO:teuthology.orchestra.run.smithi008.stdout: "event": "header_read", 2023-08-01T19:56:24.789 INFO:teuthology.orchestra.run.smithi008.stdout: "time": "2023-08-01T19:56:24.687208+0000", 2023-08-01T19:56:24.789 INFO:teuthology.orchestra.run.smithi008.stdout: "duration": 4294967295.9999995 2023-08-01T19:56:24.789 INFO:teuthology.orchestra.run.smithi008.stdout: }, 2023-08-01T19:56:24.789 INFO:teuthology.orchestra.run.smithi008.stdout: { 2023-08-01T19:56:24.789 INFO:teuthology.orchestra.run.smithi008.stdout: "event": "all_read", 2023-08-01T19:56:24.789 INFO:teuthology.orchestra.run.smithi008.stdout: "time": "2023-08-01T19:56:24.687211+0000", 2023-08-01T19:56:24.789 INFO:teuthology.orchestra.run.smithi008.stdout: "duration": 2.8260000000000001e-06 2023-08-01T19:56:24.790 INFO:teuthology.orchestra.run.smithi008.stdout: }, 2023-08-01T19:56:24.790 INFO:teuthology.orchestra.run.smithi008.stdout: { 2023-08-01T19:56:24.790 INFO:teuthology.orchestra.run.smithi008.stdout: "event": "dispatched", 2023-08-01T19:56:24.790 INFO:teuthology.orchestra.run.smithi008.stdout: "time": "2023-08-01T19:56:24.687216+0000", 2023-08-01T19:56:24.790 INFO:teuthology.orchestra.run.smithi008.stdout: "duration": 4.7650000000000001e-06 2023-08-01T19:56:24.790 INFO:teuthology.orchestra.run.smithi008.stdout: }, 2023-08-01T19:56:24.790 INFO:teuthology.orchestra.run.smithi008.stdout: { 2023-08-01T19:56:24.790 INFO:teuthology.orchestra.run.smithi008.stdout: "event": "queued_for_pg", 2023-08-01T19:56:24.791 INFO:teuthology.orchestra.run.smithi008.stdout: "time": "2023-08-01T19:56:24.687218+0000", 2023-08-01T19:56:24.791 INFO:teuthology.orchestra.run.smithi008.stdout: "duration": 2.3999999999999999e-06 2023-08-01T19:56:24.791 INFO:teuthology.orchestra.run.smithi008.stdout: }, 2023-08-01T19:56:24.791 INFO:teuthology.orchestra.run.smithi008.stdout: { 2023-08-01T19:56:24.791 INFO:teuthology.orchestra.run.smithi008.stdout: "event": "reached_pg", 2023-08-01T19:56:24.791 INFO:teuthology.orchestra.run.smithi008.stdout: "time": "2023-08-01T19:56:24.687530+0000", 2023-08-01T19:56:24.791 INFO:teuthology.orchestra.run.smithi008.stdout: "duration": 0.00031202600000000002 2023-08-01T19:56:24.791 INFO:teuthology.orchestra.run.smithi008.stdout: }, 2023-08-01T19:56:24.792 INFO:teuthology.orchestra.run.smithi008.stdout: { 2023-08-01T19:56:24.792 INFO:teuthology.orchestra.run.smithi008.stdout: "event": "started", 2023-08-01T19:56:24.792 INFO:teuthology.orchestra.run.smithi008.stdout: "time": "2023-08-01T19:56:24.687644+0000", 2023-08-01T19:56:24.792 INFO:teuthology.orchestra.run.smithi008.stdout: "duration": 0.000114362 2023-08-01T19:56:24.792 INFO:teuthology.orchestra.run.smithi008.stdout: } 2023-08-01T19:56:24.792 INFO:teuthology.orchestra.run.smithi008.stdout: ] 2023-08-01T19:56:24.792 INFO:teuthology.orchestra.run.smithi008.stdout: } 2023-08-01T19:56:24.793 INFO:teuthology.orchestra.run.smithi008.stdout: }, 2023-08-01T19:56:24.793 INFO:teuthology.orchestra.run.smithi008.stdout: { 2023-08-01T19:56:24.793 INFO:teuthology.orchestra.run.smithi008.stdout: "description": "osd_op(client.4668.0:246957 5.5 5.5cd5f8c5 (undecoded) ondisk+write+known_if_redirected+supports_pool_eio e74)", 2023-08-01T19:56:24.793 INFO:teuthology.orchestra.run.smithi008.stdout: "initiated_at": "2023-08-01T19:56:24.687226+0000", 2023-08-01T19:56:24.793 INFO:teuthology.orchestra.run.smithi008.stdout: "age": 0.0019209019999999999, 2023-08-01T19:56:24.793 INFO:teuthology.orchestra.run.smithi008.stdout: "duration": 0.0029588000000000001, 2023-08-01T19:56:24.793 INFO:teuthology.orchestra.run.smithi008.stdout: "type_data": { 2023-08-01T19:56:24.794 INFO:teuthology.orchestra.run.smithi008.stdout: "flag_point": "queued for pg", 2023-08-01T19:56:24.794 INFO:teuthology.orchestra.run.smithi008.stdout: "client_info": { 2023-08-01T19:56:24.794 INFO:teuthology.orchestra.run.smithi008.stdout: "client": "client.4668", 2023-08-01T19:56:24.794 INFO:teuthology.orchestra.run.smithi008.stdout: "client_addr": "172.21.15.6:0/1709472247", 2023-08-01T19:56:24.794 INFO:teuthology.orchestra.run.smithi008.stdout: "tid": 246957 2023-08-01T19:56:24.794 INFO:teuthology.orchestra.run.smithi008.stdout: }, 2023-08-01T19:56:24.794 INFO:teuthology.orchestra.run.smithi008.stdout: "events": [ 2023-08-01T19:56:24.794 INFO:teuthology.orchestra.run.smithi008.stdout: { 2023-08-01T19:56:24.795 INFO:teuthology.orchestra.run.smithi008.stdout: "event": "initiated", 2023-08-01T19:56:24.795 INFO:teuthology.orchestra.run.smithi008.stdout: "time": "2023-08-01T19:56:24.687226+0000", 2023-08-01T19:56:24.795 INFO:teuthology.orchestra.run.smithi008.stdout: "duration": 0 2023-08-01T19:56:24.795 INFO:teuthology.orchestra.run.smithi008.stdout: }, 2023-08-01T19:56:24.795 INFO:teuthology.orchestra.run.smithi008.stdout: { 2023-08-01T19:56:24.795 INFO:teuthology.orchestra.run.smithi008.stdout: "event": "throttled", 2023-08-01T19:56:24.795 INFO:teuthology.orchestra.run.smithi008.stdout: "time": "2023-08-01T19:56:24.687226+0000", 2023-08-01T19:56:24.795 INFO:teuthology.orchestra.run.smithi008.stdout: "duration": 0 2023-08-01T19:56:24.796 INFO:teuthology.orchestra.run.smithi008.stdout: }, 2023-08-01T19:56:24.796 INFO:teuthology.orchestra.run.smithi008.stdout: { 2023-08-01T19:56:24.796 INFO:teuthology.orchestra.run.smithi008.stdout: "event": "header_read", 2023-08-01T19:56:24.796 INFO:teuthology.orchestra.run.smithi008.stdout: "time": "2023-08-01T19:56:24.687226+0000", 2023-08-01T19:56:24.796 INFO:teuthology.orchestra.run.smithi008.stdout: "duration": 4294967295.9999995 2023-08-01T19:56:24.796 INFO:teuthology.orchestra.run.smithi008.stdout: }, 2023-08-01T19:56:24.796 INFO:teuthology.orchestra.run.smithi008.stdout: { 2023-08-01T19:56:24.797 INFO:teuthology.orchestra.run.smithi008.stdout: "event": "all_read", 2023-08-01T19:56:24.797 INFO:teuthology.orchestra.run.smithi008.stdout: "time": "2023-08-01T19:56:24.687228+0000", 2023-08-01T19:56:24.797 INFO:teuthology.orchestra.run.smithi008.stdout: "duration": 1.863e-06 2023-08-01T19:56:24.797 INFO:teuthology.orchestra.run.smithi008.stdout: }, 2023-08-01T19:56:24.797 INFO:teuthology.orchestra.run.smithi008.stdout: { 2023-08-01T19:56:24.797 INFO:teuthology.orchestra.run.smithi008.stdout: "event": "dispatched", 2023-08-01T19:56:24.797 INFO:teuthology.orchestra.run.smithi008.stdout: "time": "2023-08-01T19:56:24.687231+0000", 2023-08-01T19:56:24.797 INFO:teuthology.orchestra.run.smithi008.stdout: "duration": 3.4259999999999999e-06 2023-08-01T19:56:24.798 INFO:teuthology.orchestra.run.smithi008.stdout: }, 2023-08-01T19:56:24.798 INFO:teuthology.orchestra.run.smithi008.stdout: { 2023-08-01T19:56:24.798 INFO:teuthology.orchestra.run.smithi008.stdout: "event": "queued_for_pg", 2023-08-01T19:56:24.798 INFO:teuthology.orchestra.run.smithi008.stdout: "time": "2023-08-01T19:56:24.687233+0000", 2023-08-01T19:56:24.798 INFO:teuthology.orchestra.run.smithi008.stdout: "duration": 2.3020000000000002e-06 2023-08-01T19:56:24.798 INFO:teuthology.orchestra.run.smithi008.stdout: } 2023-08-01T19:56:24.798 INFO:teuthology.orchestra.run.smithi008.stdout: ] 2023-08-01T19:56:24.798 INFO:teuthology.orchestra.run.smithi008.stdout: } 2023-08-01T19:56:24.799 INFO:teuthology.orchestra.run.smithi008.stdout: }, 2023-08-01T19:56:24.799 INFO:teuthology.orchestra.run.smithi008.stdout: { 2023-08-01T19:56:24.799 INFO:teuthology.orchestra.run.smithi008.stdout: "description": "osd_op(client.4668.0:246958 5.2 5:4738cc8b:::benchmark_data_smithi006_114134_object113297:head [delete] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e74)", 2023-08-01T19:56:24.799 INFO:teuthology.orchestra.run.smithi008.stdout: "initiated_at": "2023-08-01T19:56:24.688121+0000", 2023-08-01T19:56:24.799 INFO:teuthology.orchestra.run.smithi008.stdout: "age": 0.001025719, 2023-08-01T19:56:24.799 INFO:teuthology.orchestra.run.smithi008.stdout: "duration": 0.0021275109999999999, 2023-08-01T19:56:24.800 INFO:teuthology.orchestra.run.smithi008.stdout: "type_data": { 2023-08-01T19:56:24.800 INFO:teuthology.orchestra.run.smithi008.stdout: "flag_point": "started", 2023-08-01T19:56:24.800 INFO:teuthology.orchestra.run.smithi008.stdout: "client_info": { 2023-08-01T19:56:24.800 INFO:teuthology.orchestra.run.smithi008.stdout: "client": "client.4668", 2023-08-01T19:56:24.800 INFO:teuthology.orchestra.run.smithi008.stdout: "client_addr": "172.21.15.6:0/1709472247", 2023-08-01T19:56:24.800 INFO:teuthology.orchestra.run.smithi008.stdout: "tid": 246958 2023-08-01T19:56:24.800 INFO:teuthology.orchestra.run.smithi008.stdout: }, 2023-08-01T19:56:24.801 INFO:teuthology.orchestra.run.smithi008.stdout: "events": [ 2023-08-01T19:56:24.801 INFO:teuthology.orchestra.run.smithi008.stdout: { 2023-08-01T19:56:24.801 INFO:teuthology.orchestra.run.smithi008.stdout: "event": "initiated", 2023-08-01T19:56:24.801 INFO:teuthology.orchestra.run.smithi008.stdout: "time": "2023-08-01T19:56:24.688121+0000", 2023-08-01T19:56:24.801 INFO:teuthology.orchestra.run.smithi008.stdout: "duration": 0 2023-08-01T19:56:24.801 INFO:teuthology.orchestra.run.smithi008.stdout: }, 2023-08-01T19:56:24.801 INFO:teuthology.orchestra.run.smithi008.stdout: { 2023-08-01T19:56:24.801 INFO:teuthology.orchestra.run.smithi008.stdout: "event": "throttled", 2023-08-01T19:56:24.802 INFO:teuthology.orchestra.run.smithi008.stdout: "time": "2023-08-01T19:56:24.688121+0000", 2023-08-01T19:56:24.802 INFO:teuthology.orchestra.run.smithi008.stdout: "duration": 0 2023-08-01T19:56:24.802 INFO:teuthology.orchestra.run.smithi008.stdout: }, 2023-08-01T19:56:24.802 INFO:teuthology.orchestra.run.smithi008.stdout: { 2023-08-01T19:56:24.802 INFO:teuthology.orchestra.run.smithi008.stdout: "event": "header_read", 2023-08-01T19:56:24.802 INFO:teuthology.orchestra.run.smithi008.stdout: "time": "2023-08-01T19:56:24.688121+0000", 2023-08-01T19:56:24.802 INFO:teuthology.orchestra.run.smithi008.stdout: "duration": 4294967295.999999 2023-08-01T19:56:24.802 INFO:teuthology.orchestra.run.smithi008.stdout: }, 2023-08-01T19:56:24.803 INFO:teuthology.orchestra.run.smithi008.stdout: { 2023-08-01T19:56:24.803 INFO:teuthology.orchestra.run.smithi008.stdout: "event": "all_read", 2023-08-01T19:56:24.803 INFO:teuthology.orchestra.run.smithi008.stdout: "time": "2023-08-01T19:56:24.688125+0000", 2023-08-01T19:56:24.803 INFO:teuthology.orchestra.run.smithi008.stdout: "duration": 4.6079999999999998e-06 2023-08-01T19:56:24.803 INFO:teuthology.orchestra.run.smithi008.stdout: }, 2023-08-01T19:56:24.803 INFO:teuthology.orchestra.run.smithi008.stdout: { 2023-08-01T19:56:24.803 INFO:teuthology.orchestra.run.smithi008.stdout: "event": "dispatched", 2023-08-01T19:56:24.804 INFO:teuthology.orchestra.run.smithi008.stdout: "time": "2023-08-01T19:56:24.688136+0000", 2023-08-01T19:56:24.804 INFO:teuthology.orchestra.run.smithi008.stdout: "duration": 1.0689999999999999e-05 2023-08-01T19:56:24.804 INFO:teuthology.orchestra.run.smithi008.stdout: }, 2023-08-01T19:56:24.804 INFO:teuthology.orchestra.run.smithi008.stdout: { 2023-08-01T19:56:24.804 INFO:teuthology.orchestra.run.smithi008.stdout: "event": "queued_for_pg", 2023-08-01T19:56:24.804 INFO:teuthology.orchestra.run.smithi008.stdout: "time": "2023-08-01T19:56:24.688141+0000", 2023-08-01T19:56:24.804 INFO:teuthology.orchestra.run.smithi008.stdout: "duration": 5.1359999999999996e-06 2023-08-01T19:56:24.804 INFO:teuthology.orchestra.run.smithi008.stdout: }, 2023-08-01T19:56:24.805 INFO:teuthology.orchestra.run.smithi008.stdout: { 2023-08-01T19:56:24.805 INFO:teuthology.orchestra.run.smithi008.stdout: "event": "reached_pg", 2023-08-01T19:56:24.805 INFO:teuthology.orchestra.run.smithi008.stdout: "time": "2023-08-01T19:56:24.689381+0000", 2023-08-01T19:56:24.805 INFO:teuthology.orchestra.run.smithi008.stdout: "duration": 0.001240044 2023-08-01T19:56:24.805 INFO:teuthology.orchestra.run.smithi008.stdout: }, 2023-08-01T19:56:24.805 INFO:teuthology.orchestra.run.smithi008.stdout: { 2023-08-01T19:56:24.805 INFO:teuthology.orchestra.run.smithi008.stdout: "event": "started", 2023-08-01T19:56:24.805 INFO:teuthology.orchestra.run.smithi008.stdout: "time": "2023-08-01T19:56:24.689516+0000", 2023-08-01T19:56:24.806 INFO:teuthology.orchestra.run.smithi008.stdout: "duration": 0.00013446199999999999 2023-08-01T19:56:24.806 INFO:teuthology.orchestra.run.smithi008.stdout: } 2023-08-01T19:56:24.806 INFO:teuthology.orchestra.run.smithi008.stdout: ] 2023-08-01T19:56:24.806 INFO:teuthology.orchestra.run.smithi008.stdout: } 2023-08-01T19:56:24.806 INFO:teuthology.orchestra.run.smithi008.stdout: }, 2023-08-01T19:56:24.806 INFO:teuthology.orchestra.run.smithi008.stdout: { 2023-08-01T19:56:24.806 INFO:teuthology.orchestra.run.smithi008.stdout: "description": "osd_op(client.4668.0:246959 5.c 5:3f5a66e5:::benchmark_data_smithi006_114134_object113298:head [delete] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e74)", 2023-08-01T19:56:24.806 INFO:teuthology.orchestra.run.smithi008.stdout: "initiated_at": "2023-08-01T19:56:24.688147+0000", 2023-08-01T19:56:24.807 INFO:teuthology.orchestra.run.smithi008.stdout: "age": 0.001000164, 2023-08-01T19:56:24.807 INFO:teuthology.orchestra.run.smithi008.stdout: "duration": 0.0021810570000000001, 2023-08-01T19:56:24.807 INFO:teuthology.orchestra.run.smithi008.stdout: "type_data": { 2023-08-01T19:56:24.807 INFO:teuthology.orchestra.run.smithi008.stdout: "flag_point": "started", 2023-08-01T19:56:24.807 INFO:teuthology.orchestra.run.smithi008.stdout: "client_info": { 2023-08-01T19:56:24.807 INFO:teuthology.orchestra.run.smithi008.stdout: "client": "client.4668", 2023-08-01T19:56:24.807 INFO:teuthology.orchestra.run.smithi008.stdout: "client_addr": "172.21.15.6:0/1709472247", 2023-08-01T19:56:24.808 INFO:teuthology.orchestra.run.smithi008.stdout: "tid": 246959 2023-08-01T19:56:24.808 INFO:teuthology.orchestra.run.smithi008.stdout: }, 2023-08-01T19:56:24.808 INFO:teuthology.orchestra.run.smithi008.stdout: "events": [ 2023-08-01T19:56:24.808 INFO:teuthology.orchestra.run.smithi008.stdout: { 2023-08-01T19:56:24.808 INFO:teuthology.orchestra.run.smithi008.stdout: "event": "initiated", 2023-08-01T19:56:24.808 INFO:teuthology.orchestra.run.smithi008.stdout: "time": "2023-08-01T19:56:24.688147+0000", 2023-08-01T19:56:24.808 INFO:teuthology.orchestra.run.smithi008.stdout: "duration": 0 2023-08-01T19:56:24.808 INFO:teuthology.orchestra.run.smithi008.stdout: }, 2023-08-01T19:56:24.809 INFO:teuthology.orchestra.run.smithi008.stdout: { 2023-08-01T19:56:24.809 INFO:teuthology.orchestra.run.smithi008.stdout: "event": "throttled", 2023-08-01T19:56:24.809 INFO:teuthology.orchestra.run.smithi008.stdout: "time": "2023-08-01T19:56:24.688147+0000", 2023-08-01T19:56:24.809 INFO:teuthology.orchestra.run.smithi008.stdout: "duration": 0 2023-08-01T19:56:24.809 INFO:teuthology.orchestra.run.smithi008.stdout: }, 2023-08-01T19:56:24.809 INFO:teuthology.orchestra.run.smithi008.stdout: { 2023-08-01T19:56:24.809 INFO:teuthology.orchestra.run.smithi008.stdout: "event": "header_read", 2023-08-01T19:56:24.810 INFO:teuthology.orchestra.run.smithi008.stdout: "time": "2023-08-01T19:56:24.688147+0000", 2023-08-01T19:56:24.810 INFO:teuthology.orchestra.run.smithi008.stdout: "duration": 4294967295.9999995 2023-08-01T19:56:24.810 INFO:teuthology.orchestra.run.smithi008.stdout: }, 2023-08-01T19:56:24.810 INFO:teuthology.orchestra.run.smithi008.stdout: { 2023-08-01T19:56:24.810 INFO:teuthology.orchestra.run.smithi008.stdout: "event": "all_read", 2023-08-01T19:56:24.810 INFO:teuthology.orchestra.run.smithi008.stdout: "time": "2023-08-01T19:56:24.688149+0000", 2023-08-01T19:56:24.810 INFO:teuthology.orchestra.run.smithi008.stdout: "duration": 2.4540000000000001e-06 2023-08-01T19:56:24.810 INFO:teuthology.orchestra.run.smithi008.stdout: }, 2023-08-01T19:56:24.811 INFO:teuthology.orchestra.run.smithi008.stdout: { 2023-08-01T19:56:24.811 INFO:teuthology.orchestra.run.smithi008.stdout: "event": "dispatched", 2023-08-01T19:56:24.811 INFO:teuthology.orchestra.run.smithi008.stdout: "time": "2023-08-01T19:56:24.688156+0000", 2023-08-01T19:56:24.811 INFO:teuthology.orchestra.run.smithi008.stdout: "duration": 6.6329999999999999e-06 2023-08-01T19:56:24.811 INFO:teuthology.orchestra.run.smithi008.stdout: }, 2023-08-01T19:56:24.811 INFO:teuthology.orchestra.run.smithi008.stdout: { 2023-08-01T19:56:24.811 INFO:teuthology.orchestra.run.smithi008.stdout: "event": "queued_for_pg", 2023-08-01T19:56:24.811 INFO:teuthology.orchestra.run.smithi008.stdout: "time": "2023-08-01T19:56:24.688159+0000", 2023-08-01T19:56:24.812 INFO:teuthology.orchestra.run.smithi008.stdout: "duration": 3.7270000000000001e-06 2023-08-01T19:56:24.812 INFO:teuthology.orchestra.run.smithi008.stdout: }, 2023-08-01T19:56:24.812 INFO:teuthology.orchestra.run.smithi008.stdout: { 2023-08-01T19:56:24.812 INFO:teuthology.orchestra.run.smithi008.stdout: "event": "reached_pg", 2023-08-01T19:56:24.812 INFO:teuthology.orchestra.run.smithi008.stdout: "time": "2023-08-01T19:56:24.688742+0000", 2023-08-01T19:56:24.812 INFO:teuthology.orchestra.run.smithi008.stdout: "duration": 0.00058268299999999996 2023-08-01T19:56:24.812 INFO:teuthology.orchestra.run.smithi008.stdout: }, 2023-08-01T19:56:24.812 INFO:teuthology.orchestra.run.smithi008.stdout: { 2023-08-01T19:56:24.813 INFO:teuthology.orchestra.run.smithi008.stdout: "event": "started", 2023-08-01T19:56:24.813 INFO:teuthology.orchestra.run.smithi008.stdout: "time": "2023-08-01T19:56:24.688865+0000", 2023-08-01T19:56:24.813 INFO:teuthology.orchestra.run.smithi008.stdout: "duration": 0.00012266299999999999 2023-08-01T19:56:24.813 INFO:teuthology.orchestra.run.smithi008.stdout: } 2023-08-01T19:56:24.813 INFO:teuthology.orchestra.run.smithi008.stdout: ] 2023-08-01T19:56:24.813 INFO:teuthology.orchestra.run.smithi008.stdout: } 2023-08-01T19:56:24.813 INFO:teuthology.orchestra.run.smithi008.stdout: }, 2023-08-01T19:56:24.813 INFO:teuthology.orchestra.run.smithi008.stdout: { 2023-08-01T19:56:24.814 INFO:teuthology.orchestra.run.smithi008.stdout: "description": "osd_op(client.4668.0:246960 5.7 5:edf99d7e:::benchmark_data_smithi006_114134_object113299:head [delete] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e74)", 2023-08-01T19:56:24.814 INFO:teuthology.orchestra.run.smithi008.stdout: "initiated_at": "2023-08-01T19:56:24.689686+0000", 2023-08-01T19:56:24.814 INFO:teuthology.orchestra.run.smithi008.stdout: "age": 4294967295.9994612, 2023-08-01T19:56:24.814 INFO:teuthology.orchestra.run.smithi008.stdout: "duration": 0.00073036200000000003, 2023-08-01T19:56:24.814 INFO:teuthology.orchestra.run.smithi008.stdout: "type_data": { 2023-08-01T19:56:24.814 INFO:teuthology.orchestra.run.smithi008.stdout: "flag_point": "started", 2023-08-01T19:56:24.814 INFO:teuthology.orchestra.run.smithi008.stdout: "client_info": { 2023-08-01T19:56:24.814 INFO:teuthology.orchestra.run.smithi008.stdout: "client": "client.4668", 2023-08-01T19:56:24.815 INFO:teuthology.orchestra.run.smithi008.stdout: "client_addr": "172.21.15.6:0/1709472247", 2023-08-01T19:56:24.815 INFO:teuthology.orchestra.run.smithi008.stdout: "tid": 246960 2023-08-01T19:56:24.815 INFO:teuthology.orchestra.run.smithi008.stdout: }, 2023-08-01T19:56:24.815 INFO:teuthology.orchestra.run.smithi008.stdout: "events": [ 2023-08-01T19:56:24.815 INFO:teuthology.orchestra.run.smithi008.stdout: { 2023-08-01T19:56:24.815 INFO:teuthology.orchestra.run.smithi008.stdout: "event": "initiated", 2023-08-01T19:56:24.815 INFO:teuthology.orchestra.run.smithi008.stdout: "time": "2023-08-01T19:56:24.689686+0000", 2023-08-01T19:56:24.816 INFO:teuthology.orchestra.run.smithi008.stdout: "duration": 0 2023-08-01T19:56:24.816 INFO:teuthology.orchestra.run.smithi008.stdout: }, 2023-08-01T19:56:24.816 INFO:teuthology.orchestra.run.smithi008.stdout: { 2023-08-01T19:56:24.816 INFO:teuthology.orchestra.run.smithi008.stdout: "event": "throttled", 2023-08-01T19:56:24.816 INFO:teuthology.orchestra.run.smithi008.stdout: "time": "2023-08-01T19:56:24.689686+0000", 2023-08-01T19:56:24.816 INFO:teuthology.orchestra.run.smithi008.stdout: "duration": 0 2023-08-01T19:56:24.816 INFO:teuthology.orchestra.run.smithi008.stdout: }, 2023-08-01T19:56:24.816 INFO:teuthology.orchestra.run.smithi008.stdout: { 2023-08-01T19:56:24.817 INFO:teuthology.orchestra.run.smithi008.stdout: "event": "header_read", 2023-08-01T19:56:24.817 INFO:teuthology.orchestra.run.smithi008.stdout: "time": "2023-08-01T19:56:24.689685+0000", 2023-08-01T19:56:24.817 INFO:teuthology.orchestra.run.smithi008.stdout: "duration": 4294967295.999999 2023-08-01T19:56:24.817 INFO:teuthology.orchestra.run.smithi008.stdout: }, 2023-08-01T19:56:24.817 INFO:teuthology.orchestra.run.smithi008.stdout: { 2023-08-01T19:56:24.817 INFO:teuthology.orchestra.run.smithi008.stdout: "event": "all_read", 2023-08-01T19:56:24.817 INFO:teuthology.orchestra.run.smithi008.stdout: "time": "2023-08-01T19:56:24.689690+0000", 2023-08-01T19:56:24.817 INFO:teuthology.orchestra.run.smithi008.stdout: "duration": 4.9269999999999996e-06 2023-08-01T19:56:24.818 INFO:teuthology.orchestra.run.smithi008.stdout: }, 2023-08-01T19:56:24.818 INFO:teuthology.orchestra.run.smithi008.stdout: { 2023-08-01T19:56:24.818 INFO:teuthology.orchestra.run.smithi008.stdout: "event": "dispatched", 2023-08-01T19:56:24.818 INFO:teuthology.orchestra.run.smithi008.stdout: "time": "2023-08-01T19:56:24.689702+0000", 2023-08-01T19:56:24.818 INFO:teuthology.orchestra.run.smithi008.stdout: "duration": 1.208e-05 2023-08-01T19:56:24.818 INFO:teuthology.orchestra.run.smithi008.stdout: }, 2023-08-01T19:56:24.818 INFO:teuthology.orchestra.run.smithi008.stdout: { 2023-08-01T19:56:24.818 INFO:teuthology.orchestra.run.smithi008.stdout: "event": "queued_for_pg", 2023-08-01T19:56:24.819 INFO:teuthology.orchestra.run.smithi008.stdout: "time": "2023-08-01T19:56:24.689707+0000", 2023-08-01T19:56:24.819 INFO:teuthology.orchestra.run.smithi008.stdout: "duration": 5.519e-06 2023-08-01T19:56:24.819 INFO:teuthology.orchestra.run.smithi008.stdout: }, 2023-08-01T19:56:24.819 INFO:teuthology.orchestra.run.smithi008.stdout: { 2023-08-01T19:56:24.819 INFO:teuthology.orchestra.run.smithi008.stdout: "event": "reached_pg", 2023-08-01T19:56:24.819 INFO:teuthology.orchestra.run.smithi008.stdout: "time": "2023-08-01T19:56:24.689747+0000", 2023-08-01T19:56:24.819 INFO:teuthology.orchestra.run.smithi008.stdout: "duration": 3.9938000000000003e-05 2023-08-01T19:56:24.819 INFO:teuthology.orchestra.run.smithi008.stdout: }, 2023-08-01T19:56:24.820 INFO:teuthology.orchestra.run.smithi008.stdout: { 2023-08-01T19:56:24.820 INFO:teuthology.orchestra.run.smithi008.stdout: "event": "started", 2023-08-01T19:56:24.820 INFO:teuthology.orchestra.run.smithi008.stdout: "time": "2023-08-01T19:56:24.689823+0000", 2023-08-01T19:56:24.820 INFO:teuthology.orchestra.run.smithi008.stdout: "duration": 7.5318e-05 2023-08-01T19:56:24.820 INFO:teuthology.orchestra.run.smithi008.stdout: } 2023-08-01T19:56:24.820 INFO:teuthology.orchestra.run.smithi008.stdout: ] 2023-08-01T19:56:24.820 INFO:teuthology.orchestra.run.smithi008.stdout: } 2023-08-01T19:56:24.821 INFO:teuthology.orchestra.run.smithi008.stdout: } 2023-08-01T19:56:24.821 INFO:teuthology.orchestra.run.smithi008.stdout: ], 2023-08-01T19:56:24.821 INFO:teuthology.orchestra.run.smithi008.stdout: "num_ops": 16 2023-08-01T19:56:24.821 INFO:teuthology.orchestra.run.smithi008.stdout:} 2023-08-01T19:56:24.822 DEBUG:teuthology.orchestra.run.smithi008:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 30 ceph --cluster ceph --admin-daemon /var/run/ceph/ceph-osd.0.asok dump_blocked_ops 2023-08-01T19:56:24.823 INFO:tasks.ceph.osd.0.smithi008.stderr:2023-08-01T19:56:24.822+0000 7f16a58f4700 -1 received signal: Hangup from /usr/bin/python3 /bin/daemon-helper kill ceph-osd -f --cluster ceph -i 0 (PID: 111179) UID: 0 2023-08-01T19:56:24.922 INFO:tasks.ceph.osd.2.smithi155.stderr:2023-08-01T19:56:24.921+0000 7faa5c6ac700 -1 received signal: Hangup from /usr/bin/python3 /bin/daemon-helper kill ceph-osd -f --cluster ceph -i 2 (PID: 111337) UID: 0 2023-08-01T19:56:25.025 INFO:tasks.ceph.osd.0.smithi008.stderr:2023-08-01T19:56:25.024+0000 7f16a58f4700 -1 received signal: Hangup from /usr/bin/python3 /bin/daemon-helper kill ceph-osd -f --cluster ceph -i 0 (PID: 111179) UID: 0 2023-08-01T19:56:25.072 INFO:teuthology.orchestra.run.smithi008.stdout:{ 2023-08-01T19:56:25.072 INFO:teuthology.orchestra.run.smithi008.stdout: "ops": [], 2023-08-01T19:56:25.072 INFO:teuthology.orchestra.run.smithi008.stdout: "complaint_time": 30, 2023-08-01T19:56:25.072 INFO:teuthology.orchestra.run.smithi008.stdout: "num_blocked_ops": 0 2023-08-01T19:56:25.073 INFO:teuthology.orchestra.run.smithi008.stdout:} 2023-08-01T19:56:25.087 DEBUG:teuthology.orchestra.run.smithi008:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 30 ceph --cluster ceph --admin-daemon /var/run/ceph/ceph-osd.0.asok dump_historic_ops 2023-08-01T19:56:25.129 INFO:tasks.ceph.osd.0.smithi008.stderr:2023-08-01T19:56:25.127+0000 7f16a58f4700 -1 received signal: Hangup from /usr/bin/python3 /bin/daemon-helper kill ceph-osd -f --cluster ceph -i 0 (PID: 111179) UID: 0 2023-08-01T19:56:25.225 INFO:tasks.ceph.osd.2.smithi155.stderr:2023-08-01T19:56:25.223+0000 7faa5c6ac700 -1 received signal: Hangup from /usr/bin/python3 /bin/daemon-helper kill ceph-osd -f --cluster ceph -i 2 (PID: 111337) UID: 0 2023-08-01T19:56:25.316 INFO:teuthology.orchestra.run.smithi008.stdout:{ 2023-08-01T19:56:25.316 INFO:teuthology.orchestra.run.smithi008.stdout: "size": 20, 2023-08-01T19:56:25.316 INFO:teuthology.orchestra.run.smithi008.stdout: "duration": 600, 2023-08-01T19:56:25.316 INFO:teuthology.orchestra.run.smithi008.stdout: "ops": [ 2023-08-01T19:56:25.316 INFO:teuthology.orchestra.run.smithi008.stdout: { 2023-08-01T19:56:25.317 INFO:teuthology.orchestra.run.smithi008.stdout: "description": "osd_op(client.4668.0:100240 5.a 5:5313c5b9:::benchmark_data_smithi006_114134_object100239:head [set-alloc-hint object_size 65536 write_size 65536,write 0~65536] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e37)", 2023-08-01T19:56:25.317 INFO:teuthology.orchestra.run.smithi008.stdout: "initiated_at": "2023-08-01T19:55:05.148399+0000", 2023-08-01T19:56:25.317 INFO:teuthology.orchestra.run.smithi008.stdout: "age": 80.164963423000003, 2023-08-01T19:56:25.317 INFO:teuthology.orchestra.run.smithi008.stdout: "duration": 0.077278904999999995, 2023-08-01T19:56:25.317 INFO:teuthology.orchestra.run.smithi008.stdout: "type_data": { 2023-08-01T19:56:25.317 INFO:teuthology.orchestra.run.smithi008.stdout: "flag_point": "commit sent; apply or cleanup", 2023-08-01T19:56:25.318 INFO:teuthology.orchestra.run.smithi008.stdout: "client_info": { 2023-08-01T19:56:25.318 INFO:teuthology.orchestra.run.smithi008.stdout: "client": "client.4668", 2023-08-01T19:56:25.318 INFO:teuthology.orchestra.run.smithi008.stdout: "client_addr": "172.21.15.6:0/1709472247", 2023-08-01T19:56:25.318 INFO:teuthology.orchestra.run.smithi008.stdout: "tid": 100240 2023-08-01T19:56:25.318 INFO:teuthology.orchestra.run.smithi008.stdout: }, 2023-08-01T19:56:25.318 INFO:teuthology.orchestra.run.smithi008.stdout: "events": [ 2023-08-01T19:56:25.318 INFO:teuthology.orchestra.run.smithi008.stdout: { 2023-08-01T19:56:25.319 INFO:teuthology.orchestra.run.smithi008.stdout: "event": "initiated", 2023-08-01T19:56:25.319 INFO:teuthology.orchestra.run.smithi008.stdout: "time": "2023-08-01T19:55:05.148399+0000", 2023-08-01T19:56:25.319 INFO:teuthology.orchestra.run.smithi008.stdout: "duration": 0 2023-08-01T19:56:25.319 INFO:teuthology.orchestra.run.smithi008.stdout: }, 2023-08-01T19:56:25.319 INFO:teuthology.orchestra.run.smithi008.stdout: { 2023-08-01T19:56:25.319 INFO:teuthology.orchestra.run.smithi008.stdout: "event": "throttled", 2023-08-01T19:56:25.319 INFO:teuthology.orchestra.run.smithi008.stdout: "time": "2023-08-01T19:55:05.148399+0000", 2023-08-01T19:56:25.319 INFO:teuthology.orchestra.run.smithi008.stdout: "duration": 0 2023-08-01T19:56:25.320 INFO:teuthology.orchestra.run.smithi008.stdout: }, 2023-08-01T19:56:25.320 INFO:teuthology.orchestra.run.smithi008.stdout: { 2023-08-01T19:56:25.320 INFO:teuthology.orchestra.run.smithi008.stdout: "event": "header_read", 2023-08-01T19:56:25.320 INFO:teuthology.orchestra.run.smithi008.stdout: "time": "2023-08-01T19:55:05.148398+0000", 2023-08-01T19:56:25.320 INFO:teuthology.orchestra.run.smithi008.stdout: "duration": 4294967295.999999 2023-08-01T19:56:25.320 INFO:teuthology.orchestra.run.smithi008.stdout: }, 2023-08-01T19:56:25.320 INFO:teuthology.orchestra.run.smithi008.stdout: { 2023-08-01T19:56:25.320 INFO:teuthology.orchestra.run.smithi008.stdout: "event": "all_read", 2023-08-01T19:56:25.321 INFO:teuthology.orchestra.run.smithi008.stdout: "time": "2023-08-01T19:55:05.148492+0000", 2023-08-01T19:56:25.321 INFO:teuthology.orchestra.run.smithi008.stdout: "duration": 9.3892000000000002e-05 2023-08-01T19:56:25.321 INFO:teuthology.orchestra.run.smithi008.stdout: }, 2023-08-01T19:56:25.321 INFO:teuthology.orchestra.run.smithi008.stdout: { 2023-08-01T19:56:25.321 INFO:teuthology.orchestra.run.smithi008.stdout: "event": "dispatched", 2023-08-01T19:56:25.321 INFO:teuthology.orchestra.run.smithi008.stdout: "time": "2023-08-01T19:55:05.148503+0000", 2023-08-01T19:56:25.321 INFO:teuthology.orchestra.run.smithi008.stdout: "duration": 1.0951000000000001e-05 2023-08-01T19:56:25.321 INFO:teuthology.orchestra.run.smithi008.stdout: }, 2023-08-01T19:56:25.322 INFO:teuthology.orchestra.run.smithi008.stdout: { 2023-08-01T19:56:25.322 INFO:teuthology.orchestra.run.smithi008.stdout: "event": "queued_for_pg", 2023-08-01T19:56:25.322 INFO:teuthology.orchestra.run.smithi008.stdout: "time": "2023-08-01T19:55:05.148508+0000", 2023-08-01T19:56:25.322 INFO:teuthology.orchestra.run.smithi008.stdout: "duration": 5.0080000000000002e-06 2023-08-01T19:56:25.322 INFO:teuthology.orchestra.run.smithi008.stdout: }, 2023-08-01T19:56:25.322 INFO:teuthology.orchestra.run.smithi008.stdout: { 2023-08-01T19:56:25.322 INFO:teuthology.orchestra.run.smithi008.stdout: "event": "reached_pg", 2023-08-01T19:56:25.322 INFO:teuthology.orchestra.run.smithi008.stdout: "time": "2023-08-01T19:55:05.148548+0000", 2023-08-01T19:56:25.323 INFO:teuthology.orchestra.run.smithi008.stdout: "duration": 4.0358999999999998e-05 2023-08-01T19:56:25.323 INFO:teuthology.orchestra.run.smithi008.stdout: }, 2023-08-01T19:56:25.323 INFO:teuthology.orchestra.run.smithi008.stdout: { 2023-08-01T19:56:25.323 INFO:teuthology.orchestra.run.smithi008.stdout: "event": "started", 2023-08-01T19:56:25.323 INFO:teuthology.orchestra.run.smithi008.stdout: "time": "2023-08-01T19:55:05.148666+0000", 2023-08-01T19:56:25.323 INFO:teuthology.orchestra.run.smithi008.stdout: "duration": 0.000117621 2023-08-01T19:56:25.323 INFO:teuthology.orchestra.run.smithi008.stdout: }, 2023-08-01T19:56:25.324 INFO:teuthology.orchestra.run.smithi008.stdout: { 2023-08-01T19:56:25.324 INFO:teuthology.orchestra.run.smithi008.stdout: "event": "waiting for subops from 2", 2023-08-01T19:56:25.324 INFO:teuthology.orchestra.run.smithi008.stdout: "time": "2023-08-01T19:55:05.148805+0000", 2023-08-01T19:56:25.324 INFO:teuthology.orchestra.run.smithi008.stdout: "duration": 0.000139176 2023-08-01T19:56:25.324 INFO:teuthology.orchestra.run.smithi008.stdout: }, 2023-08-01T19:56:25.324 INFO:teuthology.orchestra.run.smithi008.stdout: { 2023-08-01T19:56:25.324 INFO:teuthology.orchestra.run.smithi008.stdout: "event": "op_commit", 2023-08-01T19:56:25.324 INFO:teuthology.orchestra.run.smithi008.stdout: "time": "2023-08-01T19:55:05.156143+0000", 2023-08-01T19:56:25.325 INFO:teuthology.orchestra.run.smithi008.stdout: "duration": 0.007338041 2023-08-01T19:56:25.325 INFO:teuthology.orchestra.run.smithi008.stdout: }, 2023-08-01T19:56:25.325 INFO:teuthology.orchestra.run.smithi008.stdout: { 2023-08-01T19:56:25.325 INFO:teuthology.orchestra.run.smithi008.stdout: "event": "sub_op_commit_rec", 2023-08-01T19:56:25.325 INFO:teuthology.orchestra.run.smithi008.stdout: "time": "2023-08-01T19:55:05.225581+0000", 2023-08-01T19:56:25.325 INFO:teuthology.orchestra.run.smithi008.stdout: "duration": 0.069438402999999996 2023-08-01T19:56:25.325 INFO:teuthology.orchestra.run.smithi008.stdout: }, 2023-08-01T19:56:25.325 INFO:teuthology.orchestra.run.smithi008.stdout: { 2023-08-01T19:56:25.326 INFO:teuthology.orchestra.run.smithi008.stdout: "event": "commit_sent", 2023-08-01T19:56:25.326 INFO:teuthology.orchestra.run.smithi008.stdout: "time": "2023-08-01T19:55:05.225632+0000", 2023-08-01T19:56:25.326 INFO:teuthology.orchestra.run.smithi008.stdout: "duration": 5.0382e-05 2023-08-01T19:56:25.326 INFO:teuthology.orchestra.run.smithi008.stdout: }, 2023-08-01T19:56:25.326 INFO:teuthology.orchestra.run.smithi008.stdout: { 2023-08-01T19:56:25.326 INFO:teuthology.orchestra.run.smithi008.stdout: "event": "done", 2023-08-01T19:56:25.326 INFO:teuthology.orchestra.run.smithi008.stdout: "time": "2023-08-01T19:55:05.225677+0000", 2023-08-01T19:56:25.326 INFO:teuthology.orchestra.run.smithi008.stdout: "duration": 4.5893000000000003e-05 2023-08-01T19:56:25.327 INFO:teuthology.orchestra.run.smithi008.stdout: } 2023-08-01T19:56:25.327 INFO:teuthology.orchestra.run.smithi008.stdout: ] 2023-08-01T19:56:25.327 INFO:teuthology.orchestra.run.smithi008.stdout: } 2023-08-01T19:56:25.327 INFO:teuthology.orchestra.run.smithi008.stdout: }, 2023-08-01T19:56:25.327 INFO:teuthology.orchestra.run.smithi008.stdout: { 2023-08-01T19:56:25.327 INFO:teuthology.orchestra.run.smithi008.stdout: "description": "osd_op(client.4668.0:100243 5.a 5:5e8193b6:::benchmark_data_smithi006_114134_object100242:head [set-alloc-hint object_size 65536 write_size 65536,write 0~65536] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e37)", 2023-08-01T19:56:25.327 INFO:teuthology.orchestra.run.smithi008.stdout: "initiated_at": "2023-08-01T19:55:05.150737+0000", 2023-08-01T19:56:25.327 INFO:teuthology.orchestra.run.smithi008.stdout: "age": 80.162624968000003, 2023-08-01T19:56:25.328 INFO:teuthology.orchestra.run.smithi008.stdout: "duration": 0.075019885999999994, 2023-08-01T19:56:25.328 INFO:teuthology.orchestra.run.smithi008.stdout: "type_data": { 2023-08-01T19:56:25.328 INFO:teuthology.orchestra.run.smithi008.stdout: "flag_point": "commit sent; apply or cleanup", 2023-08-01T19:56:25.328 INFO:teuthology.orchestra.run.smithi008.stdout: "client_info": { 2023-08-01T19:56:25.328 INFO:teuthology.orchestra.run.smithi008.stdout: "client": "client.4668", 2023-08-01T19:56:25.328 INFO:teuthology.orchestra.run.smithi008.stdout: "client_addr": "172.21.15.6:0/1709472247", 2023-08-01T19:56:25.328 INFO:teuthology.orchestra.run.smithi008.stdout: "tid": 100243 2023-08-01T19:56:25.329 INFO:teuthology.orchestra.run.smithi008.stdout: }, 2023-08-01T19:56:25.329 INFO:teuthology.orchestra.run.smithi008.stdout: "events": [ 2023-08-01T19:56:25.329 INFO:teuthology.orchestra.run.smithi008.stdout: { 2023-08-01T19:56:25.329 INFO:teuthology.orchestra.run.smithi008.stdout: "event": "initiated", 2023-08-01T19:56:25.329 INFO:teuthology.orchestra.run.smithi008.stdout: "time": "2023-08-01T19:55:05.150737+0000", 2023-08-01T19:56:25.329 INFO:teuthology.orchestra.run.smithi008.stdout: "duration": 0 2023-08-01T19:56:25.329 INFO:teuthology.orchestra.run.smithi008.stdout: }, 2023-08-01T19:56:25.329 INFO:teuthology.orchestra.run.smithi008.stdout: { 2023-08-01T19:56:25.330 INFO:teuthology.orchestra.run.smithi008.stdout: "event": "throttled", 2023-08-01T19:56:25.330 INFO:teuthology.orchestra.run.smithi008.stdout: "time": "2023-08-01T19:55:05.150737+0000", 2023-08-01T19:56:25.330 INFO:teuthology.orchestra.run.smithi008.stdout: "duration": 0 2023-08-01T19:56:25.330 INFO:teuthology.orchestra.run.smithi008.stdout: }, 2023-08-01T19:56:25.330 INFO:teuthology.orchestra.run.smithi008.stdout: { 2023-08-01T19:56:25.330 INFO:teuthology.orchestra.run.smithi008.stdout: "event": "header_read", 2023-08-01T19:56:25.330 INFO:teuthology.orchestra.run.smithi008.stdout: "time": "2023-08-01T19:55:05.150736+0000", 2023-08-01T19:56:25.330 INFO:teuthology.orchestra.run.smithi008.stdout: "duration": 4294967295.999999 2023-08-01T19:56:25.331 INFO:teuthology.orchestra.run.smithi008.stdout: }, 2023-08-01T19:56:25.331 INFO:teuthology.orchestra.run.smithi008.stdout: { 2023-08-01T19:56:25.331 INFO:teuthology.orchestra.run.smithi008.stdout: "event": "all_read", 2023-08-01T19:56:25.331 INFO:teuthology.orchestra.run.smithi008.stdout: "time": "2023-08-01T19:55:05.150780+0000", 2023-08-01T19:56:25.331 INFO:teuthology.orchestra.run.smithi008.stdout: "duration": 4.3578999999999997e-05 2023-08-01T19:56:25.331 INFO:teuthology.orchestra.run.smithi008.stdout: }, 2023-08-01T19:56:25.331 INFO:teuthology.orchestra.run.smithi008.stdout: { 2023-08-01T19:56:25.331 INFO:teuthology.orchestra.run.smithi008.stdout: "event": "dispatched", 2023-08-01T19:56:25.332 INFO:teuthology.orchestra.run.smithi008.stdout: "time": "2023-08-01T19:55:05.150791+0000", 2023-08-01T19:56:25.332 INFO:teuthology.orchestra.run.smithi008.stdout: "duration": 1.0963e-05 2023-08-01T19:56:25.332 INFO:teuthology.orchestra.run.smithi008.stdout: }, 2023-08-01T19:56:25.332 INFO:teuthology.orchestra.run.smithi008.stdout: { 2023-08-01T19:56:25.332 INFO:teuthology.orchestra.run.smithi008.stdout: "event": "queued_for_pg", 2023-08-01T19:56:25.332 INFO:teuthology.orchestra.run.smithi008.stdout: "time": "2023-08-01T19:55:05.150797+0000", 2023-08-01T19:56:25.332 INFO:teuthology.orchestra.run.smithi008.stdout: "duration": 5.9780000000000002e-06 2023-08-01T19:56:25.333 INFO:teuthology.orchestra.run.smithi008.stdout: }, 2023-08-01T19:56:25.333 INFO:teuthology.orchestra.run.smithi008.stdout: { 2023-08-01T19:56:25.333 INFO:teuthology.orchestra.run.smithi008.stdout: "event": "reached_pg", 2023-08-01T19:56:25.333 INFO:teuthology.orchestra.run.smithi008.stdout: "time": "2023-08-01T19:55:05.150833+0000", 2023-08-01T19:56:25.333 INFO:teuthology.orchestra.run.smithi008.stdout: "duration": 3.6000000000000001e-05 2023-08-01T19:56:25.333 INFO:teuthology.orchestra.run.smithi008.stdout: }, 2023-08-01T19:56:25.333 INFO:teuthology.orchestra.run.smithi008.stdout: { 2023-08-01T19:56:25.333 INFO:teuthology.orchestra.run.smithi008.stdout: "event": "started", 2023-08-01T19:56:25.334 INFO:teuthology.orchestra.run.smithi008.stdout: "time": "2023-08-01T19:55:05.150951+0000", 2023-08-01T19:56:25.334 INFO:teuthology.orchestra.run.smithi008.stdout: "duration": 0.00011827799999999999 2023-08-01T19:56:25.334 INFO:teuthology.orchestra.run.smithi008.stdout: }, 2023-08-01T19:56:25.334 INFO:teuthology.orchestra.run.smithi008.stdout: { 2023-08-01T19:56:25.334 INFO:teuthology.orchestra.run.smithi008.stdout: "event": "waiting for subops from 2", 2023-08-01T19:56:25.334 INFO:teuthology.orchestra.run.smithi008.stdout: "time": "2023-08-01T19:55:05.151111+0000", 2023-08-01T19:56:25.334 INFO:teuthology.orchestra.run.smithi008.stdout: "duration": 0.00015961299999999999 2023-08-01T19:56:25.335 INFO:teuthology.orchestra.run.smithi008.stdout: }, 2023-08-01T19:56:25.335 INFO:teuthology.orchestra.run.smithi008.stdout: { 2023-08-01T19:56:25.335 INFO:teuthology.orchestra.run.smithi008.stdout: "event": "op_commit", 2023-08-01T19:56:25.335 INFO:teuthology.orchestra.run.smithi008.stdout: "time": "2023-08-01T19:55:05.156247+0000", 2023-08-01T19:56:25.335 INFO:teuthology.orchestra.run.smithi008.stdout: "duration": 0.005136524 2023-08-01T19:56:25.335 INFO:teuthology.orchestra.run.smithi008.stdout: }, 2023-08-01T19:56:25.335 INFO:teuthology.orchestra.run.smithi008.stdout: { 2023-08-01T19:56:25.335 INFO:teuthology.orchestra.run.smithi008.stdout: "event": "sub_op_commit_rec", 2023-08-01T19:56:25.336 INFO:teuthology.orchestra.run.smithi008.stdout: "time": "2023-08-01T19:55:05.225705+0000", 2023-08-01T19:56:25.336 INFO:teuthology.orchestra.run.smithi008.stdout: "duration": 0.069458377000000002 2023-08-01T19:56:25.336 INFO:teuthology.orchestra.run.smithi008.stdout: }, 2023-08-01T19:56:25.336 INFO:teuthology.orchestra.run.smithi008.stdout: { 2023-08-01T19:56:25.336 INFO:teuthology.orchestra.run.smithi008.stdout: "event": "commit_sent", 2023-08-01T19:56:25.336 INFO:teuthology.orchestra.run.smithi008.stdout: "time": "2023-08-01T19:55:05.225736+0000", 2023-08-01T19:56:25.336 INFO:teuthology.orchestra.run.smithi008.stdout: "duration": 3.0388000000000001e-05 2023-08-01T19:56:25.337 INFO:teuthology.orchestra.run.smithi008.stdout: }, 2023-08-01T19:56:25.337 INFO:teuthology.orchestra.run.smithi008.stdout: { 2023-08-01T19:56:25.337 INFO:teuthology.orchestra.run.smithi008.stdout: "event": "done", 2023-08-01T19:56:25.337 INFO:teuthology.orchestra.run.smithi008.stdout: "time": "2023-08-01T19:55:05.225757+0000", 2023-08-01T19:56:25.337 INFO:teuthology.orchestra.run.smithi008.stdout: "duration": 2.1090999999999998e-05 2023-08-01T19:56:25.337 INFO:teuthology.orchestra.run.smithi008.stdout: } 2023-08-01T19:56:25.337 INFO:teuthology.orchestra.run.smithi008.stdout: ] 2023-08-01T19:56:25.337 INFO:teuthology.orchestra.run.smithi008.stdout: } 2023-08-01T19:56:25.338 INFO:teuthology.orchestra.run.smithi008.stdout: }, 2023-08-01T19:56:25.338 INFO:teuthology.orchestra.run.smithi008.stdout: { 2023-08-01T19:56:25.338 INFO:teuthology.orchestra.run.smithi008.stdout: "description": "osd_op(client.4668.0:100933 5.5 5:af92e9f2:::benchmark_data_smithi006_114134_object100932:head [set-alloc-hint object_size 65536 write_size 65536,write 0~65536] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e37)", 2023-08-01T19:56:25.338 INFO:teuthology.orchestra.run.smithi008.stdout: "initiated_at": "2023-08-01T19:55:05.566634+0000", 2023-08-01T19:56:25.338 INFO:teuthology.orchestra.run.smithi008.stdout: "age": 79.746728097000002, 2023-08-01T19:56:25.338 INFO:teuthology.orchestra.run.smithi008.stdout: "duration": 0.065909364999999998, 2023-08-01T19:56:25.338 INFO:teuthology.orchestra.run.smithi008.stdout: "type_data": { 2023-08-01T19:56:25.338 INFO:teuthology.orchestra.run.smithi008.stdout: "flag_point": "commit sent; apply or cleanup", 2023-08-01T19:56:25.339 INFO:teuthology.orchestra.run.smithi008.stdout: "client_info": { 2023-08-01T19:56:25.339 INFO:teuthology.orchestra.run.smithi008.stdout: "client": "client.4668", 2023-08-01T19:56:25.339 INFO:teuthology.orchestra.run.smithi008.stdout: "client_addr": "172.21.15.6:0/1709472247", 2023-08-01T19:56:25.339 INFO:teuthology.orchestra.run.smithi008.stdout: "tid": 100933 2023-08-01T19:56:25.339 INFO:teuthology.orchestra.run.smithi008.stdout: }, 2023-08-01T19:56:25.339 INFO:teuthology.orchestra.run.smithi008.stdout: "events": [ 2023-08-01T19:56:25.339 INFO:teuthology.orchestra.run.smithi008.stdout: { 2023-08-01T19:56:25.339 INFO:teuthology.orchestra.run.smithi008.stdout: "event": "initiated", 2023-08-01T19:56:25.340 INFO:teuthology.orchestra.run.smithi008.stdout: "time": "2023-08-01T19:55:05.566634+0000", 2023-08-01T19:56:25.340 INFO:teuthology.orchestra.run.smithi008.stdout: "duration": 0 2023-08-01T19:56:25.340 INFO:teuthology.orchestra.run.smithi008.stdout: }, 2023-08-01T19:56:25.340 INFO:teuthology.orchestra.run.smithi008.stdout: { 2023-08-01T19:56:25.340 INFO:teuthology.orchestra.run.smithi008.stdout: "event": "throttled", 2023-08-01T19:56:25.340 INFO:teuthology.orchestra.run.smithi008.stdout: "time": "2023-08-01T19:55:05.566634+0000", 2023-08-01T19:56:25.340 INFO:teuthology.orchestra.run.smithi008.stdout: "duration": 0 2023-08-01T19:56:25.341 INFO:teuthology.orchestra.run.smithi008.stdout: }, 2023-08-01T19:56:25.341 INFO:teuthology.orchestra.run.smithi008.stdout: { 2023-08-01T19:56:25.341 INFO:teuthology.orchestra.run.smithi008.stdout: "event": "header_read", 2023-08-01T19:56:25.341 INFO:teuthology.orchestra.run.smithi008.stdout: "time": "2023-08-01T19:55:05.566630+0000", 2023-08-01T19:56:25.341 INFO:teuthology.orchestra.run.smithi008.stdout: "duration": 4294967295.9999962 2023-08-01T19:56:25.341 INFO:teuthology.orchestra.run.smithi008.stdout: }, 2023-08-01T19:56:25.341 INFO:teuthology.orchestra.run.smithi008.stdout: { 2023-08-01T19:56:25.341 INFO:teuthology.orchestra.run.smithi008.stdout: "event": "all_read", 2023-08-01T19:56:25.342 INFO:teuthology.orchestra.run.smithi008.stdout: "time": "2023-08-01T19:55:05.566736+0000", 2023-08-01T19:56:25.342 INFO:teuthology.orchestra.run.smithi008.stdout: "duration": 0.000105752 2023-08-01T19:56:25.342 INFO:teuthology.orchestra.run.smithi008.stdout: }, 2023-08-01T19:56:25.342 INFO:teuthology.orchestra.run.smithi008.stdout: { 2023-08-01T19:56:25.342 INFO:teuthology.orchestra.run.smithi008.stdout: "event": "dispatched", 2023-08-01T19:56:25.342 INFO:teuthology.orchestra.run.smithi008.stdout: "time": "2023-08-01T19:55:05.566742+0000", 2023-08-01T19:56:25.342 INFO:teuthology.orchestra.run.smithi008.stdout: "duration": 5.8209999999999998e-06 2023-08-01T19:56:25.342 INFO:teuthology.orchestra.run.smithi008.stdout: }, 2023-08-01T19:56:25.343 INFO:teuthology.orchestra.run.smithi008.stdout: { 2023-08-01T19:56:25.343 INFO:teuthology.orchestra.run.smithi008.stdout: "event": "queued_for_pg", 2023-08-01T19:56:25.343 INFO:teuthology.orchestra.run.smithi008.stdout: "time": "2023-08-01T19:55:05.566745+0000", 2023-08-01T19:56:25.343 INFO:teuthology.orchestra.run.smithi008.stdout: "duration": 3.337e-06 2023-08-01T19:56:25.343 INFO:teuthology.orchestra.run.smithi008.stdout: }, 2023-08-01T19:56:25.343 INFO:teuthology.orchestra.run.smithi008.stdout: { 2023-08-01T19:56:25.343 INFO:teuthology.orchestra.run.smithi008.stdout: "event": "reached_pg", 2023-08-01T19:56:25.343 INFO:teuthology.orchestra.run.smithi008.stdout: "time": "2023-08-01T19:55:05.568175+0000", 2023-08-01T19:56:25.344 INFO:teuthology.orchestra.run.smithi008.stdout: "duration": 0.001429647 2023-08-01T19:56:25.344 INFO:teuthology.orchestra.run.smithi008.stdout: }, 2023-08-01T19:56:25.344 INFO:teuthology.orchestra.run.smithi008.stdout: { 2023-08-01T19:56:25.344 INFO:teuthology.orchestra.run.smithi008.stdout: "event": "started", 2023-08-01T19:56:25.344 INFO:teuthology.orchestra.run.smithi008.stdout: "time": "2023-08-01T19:55:05.568288+0000", 2023-08-01T19:56:25.344 INFO:teuthology.orchestra.run.smithi008.stdout: "duration": 0.000113353 2023-08-01T19:56:25.344 INFO:teuthology.orchestra.run.smithi008.stdout: }, 2023-08-01T19:56:25.344 INFO:teuthology.orchestra.run.smithi008.stdout: { 2023-08-01T19:56:25.345 INFO:teuthology.orchestra.run.smithi008.stdout: "event": "waiting for subops from 1", 2023-08-01T19:56:25.345 INFO:teuthology.orchestra.run.smithi008.stdout: "time": "2023-08-01T19:55:05.568425+0000", 2023-08-01T19:56:25.345 INFO:teuthology.orchestra.run.smithi008.stdout: "duration": 0.000137346 2023-08-01T19:56:25.345 INFO:teuthology.orchestra.run.smithi008.stdout: }, 2023-08-01T19:56:25.345 INFO:teuthology.orchestra.run.smithi008.stdout: { 2023-08-01T19:56:25.345 INFO:teuthology.orchestra.run.smithi008.stdout: "event": "sub_op_commit_rec", 2023-08-01T19:56:25.345 INFO:teuthology.orchestra.run.smithi008.stdout: "time": "2023-08-01T19:55:05.629320+0000", 2023-08-01T19:56:25.346 INFO:teuthology.orchestra.run.smithi008.stdout: "duration": 0.060894491000000002 2023-08-01T19:56:25.346 INFO:teuthology.orchestra.run.smithi008.stdout: }, 2023-08-01T19:56:25.346 INFO:teuthology.orchestra.run.smithi008.stdout: { 2023-08-01T19:56:25.346 INFO:teuthology.orchestra.run.smithi008.stdout: "event": "op_commit", 2023-08-01T19:56:25.346 INFO:teuthology.orchestra.run.smithi008.stdout: "time": "2023-08-01T19:55:05.632452+0000", 2023-08-01T19:56:25.346 INFO:teuthology.orchestra.run.smithi008.stdout: "duration": 0.003131909 2023-08-01T19:56:25.346 INFO:teuthology.orchestra.run.smithi008.stdout: }, 2023-08-01T19:56:25.346 INFO:teuthology.orchestra.run.smithi008.stdout: { 2023-08-01T19:56:25.347 INFO:teuthology.orchestra.run.smithi008.stdout: "event": "commit_sent", 2023-08-01T19:56:25.347 INFO:teuthology.orchestra.run.smithi008.stdout: "time": "2023-08-01T19:55:05.632503+0000", 2023-08-01T19:56:25.347 INFO:teuthology.orchestra.run.smithi008.stdout: "duration": 5.1295000000000003e-05 2023-08-01T19:56:25.347 INFO:teuthology.orchestra.run.smithi008.stdout: }, 2023-08-01T19:56:25.347 INFO:teuthology.orchestra.run.smithi008.stdout: { 2023-08-01T19:56:25.347 INFO:teuthology.orchestra.run.smithi008.stdout: "event": "done", 2023-08-01T19:56:25.347 INFO:teuthology.orchestra.run.smithi008.stdout: "time": "2023-08-01T19:55:05.632543+0000", 2023-08-01T19:56:25.347 INFO:teuthology.orchestra.run.smithi008.stdout: "duration": 4.0234000000000001e-05 2023-08-01T19:56:25.348 INFO:teuthology.orchestra.run.smithi008.stdout: } 2023-08-01T19:56:25.348 INFO:teuthology.orchestra.run.smithi008.stdout: ] 2023-08-01T19:56:25.348 INFO:teuthology.orchestra.run.smithi008.stdout: } 2023-08-01T19:56:25.348 INFO:teuthology.orchestra.run.smithi008.stdout: }, 2023-08-01T19:56:25.348 INFO:teuthology.orchestra.run.smithi008.stdout: { 2023-08-01T19:56:25.348 INFO:teuthology.orchestra.run.smithi008.stdout: "description": "osd_op(client.4668.0:100939 5.5 5:a75fa6e3:::benchmark_data_smithi006_114134_object100938:head [set-alloc-hint object_size 65536 write_size 65536,write 0~65536] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e37)", 2023-08-01T19:56:25.348 INFO:teuthology.orchestra.run.smithi008.stdout: "initiated_at": "2023-08-01T19:55:05.569740+0000", 2023-08-01T19:56:25.348 INFO:teuthology.orchestra.run.smithi008.stdout: "age": 79.743622426000002, 2023-08-01T19:56:25.349 INFO:teuthology.orchestra.run.smithi008.stdout: "duration": 0.067753412999999998, 2023-08-01T19:56:25.349 INFO:teuthology.orchestra.run.smithi008.stdout: "type_data": { 2023-08-01T19:56:25.349 INFO:teuthology.orchestra.run.smithi008.stdout: "flag_point": "commit sent; apply or cleanup", 2023-08-01T19:56:25.349 INFO:teuthology.orchestra.run.smithi008.stdout: "client_info": { 2023-08-01T19:56:25.349 INFO:teuthology.orchestra.run.smithi008.stdout: "client": "client.4668", 2023-08-01T19:56:25.349 INFO:teuthology.orchestra.run.smithi008.stdout: "client_addr": "172.21.15.6:0/1709472247", 2023-08-01T19:56:25.349 INFO:teuthology.orchestra.run.smithi008.stdout: "tid": 100939 2023-08-01T19:56:25.349 INFO:teuthology.orchestra.run.smithi008.stdout: }, 2023-08-01T19:56:25.350 INFO:teuthology.orchestra.run.smithi008.stdout: "events": [ 2023-08-01T19:56:25.350 INFO:teuthology.orchestra.run.smithi008.stdout: { 2023-08-01T19:56:25.350 INFO:teuthology.orchestra.run.smithi008.stdout: "event": "initiated", 2023-08-01T19:56:25.350 INFO:teuthology.orchestra.run.smithi008.stdout: "time": "2023-08-01T19:55:05.569740+0000", 2023-08-01T19:56:25.350 INFO:teuthology.orchestra.run.smithi008.stdout: "duration": 0 2023-08-01T19:56:25.350 INFO:teuthology.orchestra.run.smithi008.stdout: }, 2023-08-01T19:56:25.350 INFO:teuthology.orchestra.run.smithi008.stdout: { 2023-08-01T19:56:25.350 INFO:teuthology.orchestra.run.smithi008.stdout: "event": "throttled", 2023-08-01T19:56:25.351 INFO:teuthology.orchestra.run.smithi008.stdout: "time": "2023-08-01T19:55:05.569740+0000", 2023-08-01T19:56:25.351 INFO:teuthology.orchestra.run.smithi008.stdout: "duration": 0 2023-08-01T19:56:25.351 INFO:teuthology.orchestra.run.smithi008.stdout: }, 2023-08-01T19:56:25.351 INFO:teuthology.orchestra.run.smithi008.stdout: { 2023-08-01T19:56:25.351 INFO:teuthology.orchestra.run.smithi008.stdout: "event": "header_read", 2023-08-01T19:56:25.351 INFO:teuthology.orchestra.run.smithi008.stdout: "time": "2023-08-01T19:55:05.569739+0000", 2023-08-01T19:56:25.351 INFO:teuthology.orchestra.run.smithi008.stdout: "duration": 4294967295.9999995 2023-08-01T19:56:25.351 INFO:teuthology.orchestra.run.smithi008.stdout: }, 2023-08-01T19:56:25.352 INFO:teuthology.orchestra.run.smithi008.stdout: { 2023-08-01T19:56:25.352 INFO:teuthology.orchestra.run.smithi008.stdout: "event": "all_read", 2023-08-01T19:56:25.352 INFO:teuthology.orchestra.run.smithi008.stdout: "time": "2023-08-01T19:55:05.569839+0000", 2023-08-01T19:56:25.352 INFO:teuthology.orchestra.run.smithi008.stdout: "duration": 0.000100219 2023-08-01T19:56:25.352 INFO:teuthology.orchestra.run.smithi008.stdout: }, 2023-08-01T19:56:25.352 INFO:teuthology.orchestra.run.smithi008.stdout: { 2023-08-01T19:56:25.352 INFO:teuthology.orchestra.run.smithi008.stdout: "event": "dispatched", 2023-08-01T19:56:25.353 INFO:teuthology.orchestra.run.smithi008.stdout: "time": "2023-08-01T19:55:05.569846+0000", 2023-08-01T19:56:25.353 INFO:teuthology.orchestra.run.smithi008.stdout: "duration": 7.3150000000000003e-06 2023-08-01T19:56:25.353 INFO:teuthology.orchestra.run.smithi008.stdout: }, 2023-08-01T19:56:25.353 INFO:teuthology.orchestra.run.smithi008.stdout: { 2023-08-01T19:56:25.353 INFO:teuthology.orchestra.run.smithi008.stdout: "event": "queued_for_pg", 2023-08-01T19:56:25.353 INFO:teuthology.orchestra.run.smithi008.stdout: "time": "2023-08-01T19:55:05.569850+0000", 2023-08-01T19:56:25.353 INFO:teuthology.orchestra.run.smithi008.stdout: "duration": 3.3299999999999999e-06 2023-08-01T19:56:25.353 INFO:teuthology.orchestra.run.smithi008.stdout: }, 2023-08-01T19:56:25.354 INFO:teuthology.orchestra.run.smithi008.stdout: { 2023-08-01T19:56:25.354 INFO:teuthology.orchestra.run.smithi008.stdout: "event": "reached_pg", 2023-08-01T19:56:25.354 INFO:teuthology.orchestra.run.smithi008.stdout: "time": "2023-08-01T19:55:05.626991+0000", 2023-08-01T19:56:25.354 INFO:teuthology.orchestra.run.smithi008.stdout: "duration": 0.057141585000000002 2023-08-01T19:56:25.354 INFO:teuthology.orchestra.run.smithi008.stdout: }, 2023-08-01T19:56:25.354 INFO:teuthology.orchestra.run.smithi008.stdout: { 2023-08-01T19:56:25.354 INFO:teuthology.orchestra.run.smithi008.stdout: "event": "started", 2023-08-01T19:56:25.354 INFO:teuthology.orchestra.run.smithi008.stdout: "time": "2023-08-01T19:55:05.627111+0000", 2023-08-01T19:56:25.355 INFO:teuthology.orchestra.run.smithi008.stdout: "duration": 0.000119238 2023-08-01T19:56:25.355 INFO:teuthology.orchestra.run.smithi008.stdout: }, 2023-08-01T19:56:25.355 INFO:teuthology.orchestra.run.smithi008.stdout: { 2023-08-01T19:56:25.355 INFO:teuthology.orchestra.run.smithi008.stdout: "event": "waiting for subops from 1", 2023-08-01T19:56:25.355 INFO:teuthology.orchestra.run.smithi008.stdout: "time": "2023-08-01T19:55:05.627253+0000", 2023-08-01T19:56:25.355 INFO:teuthology.orchestra.run.smithi008.stdout: "duration": 0.000142822 2023-08-01T19:56:25.355 INFO:teuthology.orchestra.run.smithi008.stdout: }, 2023-08-01T19:56:25.356 INFO:teuthology.orchestra.run.smithi008.stdout: { 2023-08-01T19:56:25.356 INFO:teuthology.orchestra.run.smithi008.stdout: "event": "op_commit", 2023-08-01T19:56:25.356 INFO:teuthology.orchestra.run.smithi008.stdout: "time": "2023-08-01T19:55:05.632555+0000", 2023-08-01T19:56:25.356 INFO:teuthology.orchestra.run.smithi008.stdout: "duration": 0.0053012449999999996 2023-08-01T19:56:25.356 INFO:teuthology.orchestra.run.smithi008.stdout: }, 2023-08-01T19:56:25.356 INFO:teuthology.orchestra.run.smithi008.stdout: { 2023-08-01T19:56:25.356 INFO:teuthology.orchestra.run.smithi008.stdout: "event": "sub_op_commit_rec", 2023-08-01T19:56:25.356 INFO:teuthology.orchestra.run.smithi008.stdout: "time": "2023-08-01T19:55:05.637380+0000", 2023-08-01T19:56:25.357 INFO:teuthology.orchestra.run.smithi008.stdout: "duration": 0.0048257639999999997 2023-08-01T19:56:25.357 INFO:teuthology.orchestra.run.smithi008.stdout: }, 2023-08-01T19:56:25.357 INFO:teuthology.orchestra.run.smithi008.stdout: { 2023-08-01T19:56:25.357 INFO:teuthology.orchestra.run.smithi008.stdout: "event": "commit_sent", 2023-08-01T19:56:25.357 INFO:teuthology.orchestra.run.smithi008.stdout: "time": "2023-08-01T19:55:05.637454+0000", 2023-08-01T19:56:25.357 INFO:teuthology.orchestra.run.smithi008.stdout: "duration": 7.3578999999999995e-05 2023-08-01T19:56:25.357 INFO:teuthology.orchestra.run.smithi008.stdout: }, 2023-08-01T19:56:25.357 INFO:teuthology.orchestra.run.smithi008.stdout: { 2023-08-01T19:56:25.358 INFO:teuthology.orchestra.run.smithi008.stdout: "event": "done", 2023-08-01T19:56:25.358 INFO:teuthology.orchestra.run.smithi008.stdout: "time": "2023-08-01T19:55:05.637493+0000", 2023-08-01T19:56:25.358 INFO:teuthology.orchestra.run.smithi008.stdout: "duration": 3.8986999999999998e-05 2023-08-01T19:56:25.358 INFO:teuthology.orchestra.run.smithi008.stdout: } 2023-08-01T19:56:25.358 INFO:teuthology.orchestra.run.smithi008.stdout: ] 2023-08-01T19:56:25.358 INFO:teuthology.orchestra.run.smithi008.stdout: } 2023-08-01T19:56:25.358 INFO:teuthology.orchestra.run.smithi008.stdout: }, 2023-08-01T19:56:25.358 INFO:teuthology.orchestra.run.smithi008.stdout: { 2023-08-01T19:56:25.359 INFO:teuthology.orchestra.run.smithi008.stdout: "description": "osd_op(client.4668.0:107863 5.3 5:cbdd875a:::benchmark_data_smithi006_114134_object107862:head [set-alloc-hint object_size 65536 write_size 65536,write 0~65536] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e38)", 2023-08-01T19:56:25.359 INFO:teuthology.orchestra.run.smithi008.stdout: "initiated_at": "2023-08-01T19:55:09.278851+0000", 2023-08-01T19:56:25.359 INFO:teuthology.orchestra.run.smithi008.stdout: "age": 76.034510686000004, 2023-08-01T19:56:25.359 INFO:teuthology.orchestra.run.smithi008.stdout: "duration": 0.071378853000000006, 2023-08-01T19:56:25.359 INFO:teuthology.orchestra.run.smithi008.stdout: "type_data": { 2023-08-01T19:56:25.359 INFO:teuthology.orchestra.run.smithi008.stdout: "flag_point": "commit sent; apply or cleanup", 2023-08-01T19:56:25.359 INFO:teuthology.orchestra.run.smithi008.stdout: "client_info": { 2023-08-01T19:56:25.359 INFO:teuthology.orchestra.run.smithi008.stdout: "client": "client.4668", 2023-08-01T19:56:25.360 INFO:teuthology.orchestra.run.smithi008.stdout: "client_addr": "172.21.15.6:0/1709472247", 2023-08-01T19:56:25.360 INFO:teuthology.orchestra.run.smithi008.stdout: "tid": 107863 2023-08-01T19:56:25.360 INFO:teuthology.orchestra.run.smithi008.stdout: }, 2023-08-01T19:56:25.360 INFO:teuthology.orchestra.run.smithi008.stdout: "events": [ 2023-08-01T19:56:25.360 INFO:teuthology.orchestra.run.smithi008.stdout: { 2023-08-01T19:56:25.360 INFO:teuthology.orchestra.run.smithi008.stdout: "event": "initiated", 2023-08-01T19:56:25.360 INFO:teuthology.orchestra.run.smithi008.stdout: "time": "2023-08-01T19:55:09.278851+0000", 2023-08-01T19:56:25.361 INFO:teuthology.orchestra.run.smithi008.stdout: "duration": 0 2023-08-01T19:56:25.361 INFO:teuthology.orchestra.run.smithi008.stdout: }, 2023-08-01T19:56:25.361 INFO:teuthology.orchestra.run.smithi008.stdout: { 2023-08-01T19:56:25.361 INFO:teuthology.orchestra.run.smithi008.stdout: "event": "throttled", 2023-08-01T19:56:25.361 INFO:teuthology.orchestra.run.smithi008.stdout: "time": "2023-08-01T19:55:09.278851+0000", 2023-08-01T19:56:25.361 INFO:teuthology.orchestra.run.smithi008.stdout: "duration": 0 2023-08-01T19:56:25.361 INFO:teuthology.orchestra.run.smithi008.stdout: }, 2023-08-01T19:56:25.361 INFO:teuthology.orchestra.run.smithi008.stdout: { 2023-08-01T19:56:25.362 INFO:teuthology.orchestra.run.smithi008.stdout: "event": "header_read", 2023-08-01T19:56:25.362 INFO:teuthology.orchestra.run.smithi008.stdout: "time": "2023-08-01T19:55:09.278850+0000", 2023-08-01T19:56:25.362 INFO:teuthology.orchestra.run.smithi008.stdout: "duration": 4294967295.999999 2023-08-01T19:56:25.362 INFO:teuthology.orchestra.run.smithi008.stdout: }, 2023-08-01T19:56:25.362 INFO:teuthology.orchestra.run.smithi008.stdout: { 2023-08-01T19:56:25.362 INFO:teuthology.orchestra.run.smithi008.stdout: "event": "all_read", 2023-08-01T19:56:25.362 INFO:teuthology.orchestra.run.smithi008.stdout: "time": "2023-08-01T19:55:09.278945+0000", 2023-08-01T19:56:25.362 INFO:teuthology.orchestra.run.smithi008.stdout: "duration": 9.4388000000000005e-05 2023-08-01T19:56:25.363 INFO:teuthology.orchestra.run.smithi008.stdout: }, 2023-08-01T19:56:25.363 INFO:teuthology.orchestra.run.smithi008.stdout: { 2023-08-01T19:56:25.363 INFO:teuthology.orchestra.run.smithi008.stdout: "event": "dispatched", 2023-08-01T19:56:25.363 INFO:teuthology.orchestra.run.smithi008.stdout: "time": "2023-08-01T19:55:09.278955+0000", 2023-08-01T19:56:25.363 INFO:teuthology.orchestra.run.smithi008.stdout: "duration": 1.0413e-05 2023-08-01T19:56:25.363 INFO:teuthology.orchestra.run.smithi008.stdout: }, 2023-08-01T19:56:25.363 INFO:teuthology.orchestra.run.smithi008.stdout: { 2023-08-01T19:56:25.363 INFO:teuthology.orchestra.run.smithi008.stdout: "event": "queued_for_pg", 2023-08-01T19:56:25.364 INFO:teuthology.orchestra.run.smithi008.stdout: "time": "2023-08-01T19:55:09.278962+0000", 2023-08-01T19:56:25.364 INFO:teuthology.orchestra.run.smithi008.stdout: "duration": 6.2169999999999999e-06 2023-08-01T19:56:25.364 INFO:teuthology.orchestra.run.smithi008.stdout: }, 2023-08-01T19:56:25.364 INFO:teuthology.orchestra.run.smithi008.stdout: { 2023-08-01T19:56:25.364 INFO:teuthology.orchestra.run.smithi008.stdout: "event": "reached_pg", 2023-08-01T19:56:25.364 INFO:teuthology.orchestra.run.smithi008.stdout: "time": "2023-08-01T19:55:09.280363+0000", 2023-08-01T19:56:25.364 INFO:teuthology.orchestra.run.smithi008.stdout: "duration": 0.0014014489999999999 2023-08-01T19:56:25.364 INFO:teuthology.orchestra.run.smithi008.stdout: }, 2023-08-01T19:56:25.365 INFO:teuthology.orchestra.run.smithi008.stdout: { 2023-08-01T19:56:25.365 INFO:teuthology.orchestra.run.smithi008.stdout: "event": "started", 2023-08-01T19:56:25.365 INFO:teuthology.orchestra.run.smithi008.stdout: "time": "2023-08-01T19:55:09.280488+0000", 2023-08-01T19:56:25.365 INFO:teuthology.orchestra.run.smithi008.stdout: "duration": 0.00012474099999999999 2023-08-01T19:56:25.365 INFO:teuthology.orchestra.run.smithi008.stdout: }, 2023-08-01T19:56:25.365 INFO:teuthology.orchestra.run.smithi008.stdout: { 2023-08-01T19:56:25.365 INFO:teuthology.orchestra.run.smithi008.stdout: "event": "waiting for subops from 1", 2023-08-01T19:56:25.366 INFO:teuthology.orchestra.run.smithi008.stdout: "time": "2023-08-01T19:55:09.280626+0000", 2023-08-01T19:56:25.366 INFO:teuthology.orchestra.run.smithi008.stdout: "duration": 0.000138193 2023-08-01T19:56:25.366 INFO:teuthology.orchestra.run.smithi008.stdout: }, 2023-08-01T19:56:25.366 INFO:teuthology.orchestra.run.smithi008.stdout: { 2023-08-01T19:56:25.366 INFO:teuthology.orchestra.run.smithi008.stdout: "event": "op_commit", 2023-08-01T19:56:25.366 INFO:teuthology.orchestra.run.smithi008.stdout: "time": "2023-08-01T19:55:09.285958+0000", 2023-08-01T19:56:25.366 INFO:teuthology.orchestra.run.smithi008.stdout: "duration": 0.0053317130000000001 2023-08-01T19:56:25.366 INFO:teuthology.orchestra.run.smithi008.stdout: }, 2023-08-01T19:56:25.367 INFO:teuthology.orchestra.run.smithi008.stdout: { 2023-08-01T19:56:25.367 INFO:teuthology.orchestra.run.smithi008.stdout: "event": "sub_op_commit_rec", 2023-08-01T19:56:25.367 INFO:teuthology.orchestra.run.smithi008.stdout: "time": "2023-08-01T19:55:09.350151+0000", 2023-08-01T19:56:25.367 INFO:teuthology.orchestra.run.smithi008.stdout: "duration": 0.064193202000000005 2023-08-01T19:56:25.367 INFO:teuthology.orchestra.run.smithi008.stdout: }, 2023-08-01T19:56:25.367 INFO:teuthology.orchestra.run.smithi008.stdout: { 2023-08-01T19:56:25.367 INFO:teuthology.orchestra.run.smithi008.stdout: "event": "commit_sent", 2023-08-01T19:56:25.367 INFO:teuthology.orchestra.run.smithi008.stdout: "time": "2023-08-01T19:55:09.350188+0000", 2023-08-01T19:56:25.368 INFO:teuthology.orchestra.run.smithi008.stdout: "duration": 3.7549999999999998e-05 2023-08-01T19:56:25.368 INFO:teuthology.orchestra.run.smithi008.stdout: }, 2023-08-01T19:56:25.368 INFO:teuthology.orchestra.run.smithi008.stdout: { 2023-08-01T19:56:25.368 INFO:teuthology.orchestra.run.smithi008.stdout: "event": "done", 2023-08-01T19:56:25.368 INFO:teuthology.orchestra.run.smithi008.stdout: "time": "2023-08-01T19:55:09.350230+0000", 2023-08-01T19:56:25.368 INFO:teuthology.orchestra.run.smithi008.stdout: "duration": 4.1804999999999997e-05 2023-08-01T19:56:25.368 INFO:teuthology.orchestra.run.smithi008.stdout: } 2023-08-01T19:56:25.368 INFO:teuthology.orchestra.run.smithi008.stdout: ] 2023-08-01T19:56:25.369 INFO:teuthology.orchestra.run.smithi008.stdout: } 2023-08-01T19:56:25.369 INFO:teuthology.orchestra.run.smithi008.stdout: }, 2023-08-01T19:56:25.369 INFO:teuthology.orchestra.run.smithi008.stdout: { 2023-08-01T19:56:25.369 INFO:teuthology.orchestra.run.smithi008.stdout: "description": "osd_op(client.4668.0:107865 5.3 5:c2ebb96d:::benchmark_data_smithi006_114134_object107864:head [set-alloc-hint object_size 65536 write_size 65536,write 0~65536] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e38)", 2023-08-01T19:56:25.369 INFO:teuthology.orchestra.run.smithi008.stdout: "initiated_at": "2023-08-01T19:55:09.279020+0000", 2023-08-01T19:56:25.369 INFO:teuthology.orchestra.run.smithi008.stdout: "age": 76.034342014000003, 2023-08-01T19:56:25.369 INFO:teuthology.orchestra.run.smithi008.stdout: "duration": 0.072892565000000006, 2023-08-01T19:56:25.370 INFO:teuthology.orchestra.run.smithi008.stdout: "type_data": { 2023-08-01T19:56:25.370 INFO:teuthology.orchestra.run.smithi008.stdout: "flag_point": "commit sent; apply or cleanup", 2023-08-01T19:56:25.370 INFO:teuthology.orchestra.run.smithi008.stdout: "client_info": { 2023-08-01T19:56:25.370 INFO:teuthology.orchestra.run.smithi008.stdout: "client": "client.4668", 2023-08-01T19:56:25.370 INFO:teuthology.orchestra.run.smithi008.stdout: "client_addr": "172.21.15.6:0/1709472247", 2023-08-01T19:56:25.370 INFO:teuthology.orchestra.run.smithi008.stdout: "tid": 107865 2023-08-01T19:56:25.370 INFO:teuthology.orchestra.run.smithi008.stdout: }, 2023-08-01T19:56:25.370 INFO:teuthology.orchestra.run.smithi008.stdout: "events": [ 2023-08-01T19:56:25.371 INFO:teuthology.orchestra.run.smithi008.stdout: { 2023-08-01T19:56:25.371 INFO:teuthology.orchestra.run.smithi008.stdout: "event": "initiated", 2023-08-01T19:56:25.371 INFO:teuthology.orchestra.run.smithi008.stdout: "time": "2023-08-01T19:55:09.279020+0000", 2023-08-01T19:56:25.371 INFO:teuthology.orchestra.run.smithi008.stdout: "duration": 0 2023-08-01T19:56:25.371 INFO:teuthology.orchestra.run.smithi008.stdout: }, 2023-08-01T19:56:25.371 INFO:teuthology.orchestra.run.smithi008.stdout: { 2023-08-01T19:56:25.371 INFO:teuthology.orchestra.run.smithi008.stdout: "event": "throttled", 2023-08-01T19:56:25.371 INFO:teuthology.orchestra.run.smithi008.stdout: "time": "2023-08-01T19:55:09.279020+0000", 2023-08-01T19:56:25.372 INFO:teuthology.orchestra.run.smithi008.stdout: "duration": 0 2023-08-01T19:56:25.372 INFO:teuthology.orchestra.run.smithi008.stdout: }, 2023-08-01T19:56:25.372 INFO:teuthology.orchestra.run.smithi008.stdout: { 2023-08-01T19:56:25.372 INFO:teuthology.orchestra.run.smithi008.stdout: "event": "header_read", 2023-08-01T19:56:25.372 INFO:teuthology.orchestra.run.smithi008.stdout: "time": "2023-08-01T19:55:09.279019+0000", 2023-08-01T19:56:25.372 INFO:teuthology.orchestra.run.smithi008.stdout: "duration": 4294967295.999999 2023-08-01T19:56:25.372 INFO:teuthology.orchestra.run.smithi008.stdout: }, 2023-08-01T19:56:25.373 INFO:teuthology.orchestra.run.smithi008.stdout: { 2023-08-01T19:56:25.373 INFO:teuthology.orchestra.run.smithi008.stdout: "event": "all_read", 2023-08-01T19:56:25.373 INFO:teuthology.orchestra.run.smithi008.stdout: "time": "2023-08-01T19:55:09.279087+0000", 2023-08-01T19:56:25.373 INFO:teuthology.orchestra.run.smithi008.stdout: "duration": 6.8392000000000005e-05 2023-08-01T19:56:25.373 INFO:teuthology.orchestra.run.smithi008.stdout: }, 2023-08-01T19:56:25.373 INFO:teuthology.orchestra.run.smithi008.stdout: { 2023-08-01T19:56:25.373 INFO:teuthology.orchestra.run.smithi008.stdout: "event": "dispatched", 2023-08-01T19:56:25.373 INFO:teuthology.orchestra.run.smithi008.stdout: "time": "2023-08-01T19:55:09.279095+0000", 2023-08-01T19:56:25.374 INFO:teuthology.orchestra.run.smithi008.stdout: "duration": 8.0989999999999999e-06 2023-08-01T19:56:25.374 INFO:teuthology.orchestra.run.smithi008.stdout: }, 2023-08-01T19:56:25.374 INFO:teuthology.orchestra.run.smithi008.stdout: { 2023-08-01T19:56:25.374 INFO:teuthology.orchestra.run.smithi008.stdout: "event": "queued_for_pg", 2023-08-01T19:56:25.374 INFO:teuthology.orchestra.run.smithi008.stdout: "time": "2023-08-01T19:55:09.279101+0000", 2023-08-01T19:56:25.374 INFO:teuthology.orchestra.run.smithi008.stdout: "duration": 5.0390000000000004e-06 2023-08-01T19:56:25.374 INFO:teuthology.orchestra.run.smithi008.stdout: }, 2023-08-01T19:56:25.374 INFO:teuthology.orchestra.run.smithi008.stdout: { 2023-08-01T19:56:25.375 INFO:teuthology.orchestra.run.smithi008.stdout: "event": "reached_pg", 2023-08-01T19:56:25.375 INFO:teuthology.orchestra.run.smithi008.stdout: "time": "2023-08-01T19:55:09.282574+0000", 2023-08-01T19:56:25.375 INFO:teuthology.orchestra.run.smithi008.stdout: "duration": 0.0034730619999999999 2023-08-01T19:56:25.375 INFO:teuthology.orchestra.run.smithi008.stdout: }, 2023-08-01T19:56:25.375 INFO:teuthology.orchestra.run.smithi008.stdout: { 2023-08-01T19:56:25.375 INFO:teuthology.orchestra.run.smithi008.stdout: "event": "started", 2023-08-01T19:56:25.375 INFO:teuthology.orchestra.run.smithi008.stdout: "time": "2023-08-01T19:55:09.282705+0000", 2023-08-01T19:56:25.375 INFO:teuthology.orchestra.run.smithi008.stdout: "duration": 0.00013133400000000001 2023-08-01T19:56:25.376 INFO:teuthology.orchestra.run.smithi008.stdout: }, 2023-08-01T19:56:25.376 INFO:teuthology.orchestra.run.smithi008.stdout: { 2023-08-01T19:56:25.376 INFO:teuthology.orchestra.run.smithi008.stdout: "event": "waiting for subops from 1", 2023-08-01T19:56:25.376 INFO:teuthology.orchestra.run.smithi008.stdout: "time": "2023-08-01T19:55:09.283067+0000", 2023-08-01T19:56:25.376 INFO:teuthology.orchestra.run.smithi008.stdout: "duration": 0.00036195299999999998 2023-08-01T19:56:25.376 INFO:teuthology.orchestra.run.smithi008.stdout: }, 2023-08-01T19:56:25.376 INFO:teuthology.orchestra.run.smithi008.stdout: { 2023-08-01T19:56:25.377 INFO:teuthology.orchestra.run.smithi008.stdout: "event": "op_commit", 2023-08-01T19:56:25.377 INFO:teuthology.orchestra.run.smithi008.stdout: "time": "2023-08-01T19:55:09.288196+0000", 2023-08-01T19:56:25.377 INFO:teuthology.orchestra.run.smithi008.stdout: "duration": 0.0051293780000000004 2023-08-01T19:56:25.377 INFO:teuthology.orchestra.run.smithi008.stdout: }, 2023-08-01T19:56:25.377 INFO:teuthology.orchestra.run.smithi008.stdout: { 2023-08-01T19:56:25.377 INFO:teuthology.orchestra.run.smithi008.stdout: "event": "sub_op_commit_rec", 2023-08-01T19:56:25.377 INFO:teuthology.orchestra.run.smithi008.stdout: "time": "2023-08-01T19:55:09.351832+0000", 2023-08-01T19:56:25.377 INFO:teuthology.orchestra.run.smithi008.stdout: "duration": 0.063636076 2023-08-01T19:56:25.378 INFO:teuthology.orchestra.run.smithi008.stdout: }, 2023-08-01T19:56:25.378 INFO:teuthology.orchestra.run.smithi008.stdout: { 2023-08-01T19:56:25.378 INFO:teuthology.orchestra.run.smithi008.stdout: "event": "commit_sent", 2023-08-01T19:56:25.378 INFO:teuthology.orchestra.run.smithi008.stdout: "time": "2023-08-01T19:55:09.351878+0000", 2023-08-01T19:56:25.378 INFO:teuthology.orchestra.run.smithi008.stdout: "duration": 4.5408999999999998e-05 2023-08-01T19:56:25.378 INFO:teuthology.orchestra.run.smithi008.stdout: }, 2023-08-01T19:56:25.378 INFO:teuthology.orchestra.run.smithi008.stdout: { 2023-08-01T19:56:25.379 INFO:teuthology.orchestra.run.smithi008.stdout: "event": "done", 2023-08-01T19:56:25.379 INFO:teuthology.orchestra.run.smithi008.stdout: "time": "2023-08-01T19:55:09.351913+0000", 2023-08-01T19:56:25.379 INFO:teuthology.orchestra.run.smithi008.stdout: "duration": 3.4808999999999998e-05 2023-08-01T19:56:25.379 INFO:teuthology.orchestra.run.smithi008.stdout: } 2023-08-01T19:56:25.379 INFO:teuthology.orchestra.run.smithi008.stdout: ] 2023-08-01T19:56:25.379 INFO:teuthology.orchestra.run.smithi008.stdout: } 2023-08-01T19:56:25.379 INFO:teuthology.orchestra.run.smithi008.stdout: }, 2023-08-01T19:56:25.379 INFO:teuthology.orchestra.run.smithi008.stdout: { 2023-08-01T19:56:25.380 INFO:teuthology.orchestra.run.smithi008.stdout: "description": "osd_op(client.4668.0:107869 5.c 5:31910384:::benchmark_data_smithi006_114134_object107868:head [set-alloc-hint object_size 65536 write_size 65536,write 0~65536] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e38)", 2023-08-01T19:56:25.380 INFO:teuthology.orchestra.run.smithi008.stdout: "initiated_at": "2023-08-01T19:55:09.283205+0000", 2023-08-01T19:56:25.380 INFO:teuthology.orchestra.run.smithi008.stdout: "age": 76.030156848999994, 2023-08-01T19:56:25.380 INFO:teuthology.orchestra.run.smithi008.stdout: "duration": 0.068611808999999996, 2023-08-01T19:56:25.380 INFO:teuthology.orchestra.run.smithi008.stdout: "type_data": { 2023-08-01T19:56:25.380 INFO:teuthology.orchestra.run.smithi008.stdout: "flag_point": "commit sent; apply or cleanup", 2023-08-01T19:56:25.380 INFO:teuthology.orchestra.run.smithi008.stdout: "client_info": { 2023-08-01T19:56:25.380 INFO:teuthology.orchestra.run.smithi008.stdout: "client": "client.4668", 2023-08-01T19:56:25.381 INFO:teuthology.orchestra.run.smithi008.stdout: "client_addr": "172.21.15.6:0/1709472247", 2023-08-01T19:56:25.381 INFO:teuthology.orchestra.run.smithi008.stdout: "tid": 107869 2023-08-01T19:56:25.381 INFO:teuthology.orchestra.run.smithi008.stdout: }, 2023-08-01T19:56:25.381 INFO:teuthology.orchestra.run.smithi008.stdout: "events": [ 2023-08-01T19:56:25.381 INFO:teuthology.orchestra.run.smithi008.stdout: { 2023-08-01T19:56:25.381 INFO:teuthology.orchestra.run.smithi008.stdout: "event": "initiated", 2023-08-01T19:56:25.381 INFO:teuthology.orchestra.run.smithi008.stdout: "time": "2023-08-01T19:55:09.283205+0000", 2023-08-01T19:56:25.381 INFO:teuthology.orchestra.run.smithi008.stdout: "duration": 0 2023-08-01T19:56:25.382 INFO:teuthology.orchestra.run.smithi008.stdout: }, 2023-08-01T19:56:25.382 INFO:teuthology.orchestra.run.smithi008.stdout: { 2023-08-01T19:56:25.382 INFO:teuthology.orchestra.run.smithi008.stdout: "event": "throttled", 2023-08-01T19:56:25.382 INFO:teuthology.orchestra.run.smithi008.stdout: "time": "2023-08-01T19:55:09.283205+0000", 2023-08-01T19:56:25.382 INFO:teuthology.orchestra.run.smithi008.stdout: "duration": 0 2023-08-01T19:56:25.382 INFO:teuthology.orchestra.run.smithi008.stdout: }, 2023-08-01T19:56:25.382 INFO:teuthology.orchestra.run.smithi008.stdout: { 2023-08-01T19:56:25.383 INFO:teuthology.orchestra.run.smithi008.stdout: "event": "header_read", 2023-08-01T19:56:25.383 INFO:teuthology.orchestra.run.smithi008.stdout: "time": "2023-08-01T19:55:09.283204+0000", 2023-08-01T19:56:25.383 INFO:teuthology.orchestra.run.smithi008.stdout: "duration": 4294967295.999999 2023-08-01T19:56:25.383 INFO:teuthology.orchestra.run.smithi008.stdout: }, 2023-08-01T19:56:25.383 INFO:teuthology.orchestra.run.smithi008.stdout: { 2023-08-01T19:56:25.383 INFO:teuthology.orchestra.run.smithi008.stdout: "event": "all_read", 2023-08-01T19:56:25.383 INFO:teuthology.orchestra.run.smithi008.stdout: "time": "2023-08-01T19:55:09.283300+0000", 2023-08-01T19:56:25.383 INFO:teuthology.orchestra.run.smithi008.stdout: "duration": 9.6280000000000007e-05 2023-08-01T19:56:25.384 INFO:teuthology.orchestra.run.smithi008.stdout: }, 2023-08-01T19:56:25.384 INFO:teuthology.orchestra.run.smithi008.stdout: { 2023-08-01T19:56:25.384 INFO:teuthology.orchestra.run.smithi008.stdout: "event": "dispatched", 2023-08-01T19:56:25.384 INFO:teuthology.orchestra.run.smithi008.stdout: "time": "2023-08-01T19:55:09.283314+0000", 2023-08-01T19:56:25.384 INFO:teuthology.orchestra.run.smithi008.stdout: "duration": 1.3344e-05 2023-08-01T19:56:25.384 INFO:teuthology.orchestra.run.smithi008.stdout: }, 2023-08-01T19:56:25.384 INFO:teuthology.orchestra.run.smithi008.stdout: { 2023-08-01T19:56:25.385 INFO:teuthology.orchestra.run.smithi008.stdout: "event": "queued_for_pg", 2023-08-01T19:56:25.385 INFO:teuthology.orchestra.run.smithi008.stdout: "time": "2023-08-01T19:55:09.283320+0000", 2023-08-01T19:56:25.385 INFO:teuthology.orchestra.run.smithi008.stdout: "duration": 6.0299999999999999e-06 2023-08-01T19:56:25.385 INFO:teuthology.orchestra.run.smithi008.stdout: }, 2023-08-01T19:56:25.385 INFO:teuthology.orchestra.run.smithi008.stdout: { 2023-08-01T19:56:25.385 INFO:teuthology.orchestra.run.smithi008.stdout: "event": "reached_pg", 2023-08-01T19:56:25.385 INFO:teuthology.orchestra.run.smithi008.stdout: "time": "2023-08-01T19:55:09.283365+0000", 2023-08-01T19:56:25.385 INFO:teuthology.orchestra.run.smithi008.stdout: "duration": 4.5578999999999998e-05 2023-08-01T19:56:25.386 INFO:teuthology.orchestra.run.smithi008.stdout: }, 2023-08-01T19:56:25.386 INFO:teuthology.orchestra.run.smithi008.stdout: { 2023-08-01T19:56:25.386 INFO:teuthology.orchestra.run.smithi008.stdout: "event": "started", 2023-08-01T19:56:25.386 INFO:teuthology.orchestra.run.smithi008.stdout: "time": "2023-08-01T19:55:09.283490+0000", 2023-08-01T19:56:25.386 INFO:teuthology.orchestra.run.smithi008.stdout: "duration": 0.00012473700000000001 2023-08-01T19:56:25.386 INFO:teuthology.orchestra.run.smithi008.stdout: }, 2023-08-01T19:56:25.386 INFO:teuthology.orchestra.run.smithi008.stdout: { 2023-08-01T19:56:25.386 INFO:teuthology.orchestra.run.smithi008.stdout: "event": "waiting for subops from 1", 2023-08-01T19:56:25.387 INFO:teuthology.orchestra.run.smithi008.stdout: "time": "2023-08-01T19:55:09.283637+0000", 2023-08-01T19:56:25.387 INFO:teuthology.orchestra.run.smithi008.stdout: "duration": 0.00014715600000000001 2023-08-01T19:56:25.387 INFO:teuthology.orchestra.run.smithi008.stdout: }, 2023-08-01T19:56:25.387 INFO:teuthology.orchestra.run.smithi008.stdout: { 2023-08-01T19:56:25.387 INFO:teuthology.orchestra.run.smithi008.stdout: "event": "op_commit", 2023-08-01T19:56:25.387 INFO:teuthology.orchestra.run.smithi008.stdout: "time": "2023-08-01T19:55:09.288214+0000", 2023-08-01T19:56:25.387 INFO:teuthology.orchestra.run.smithi008.stdout: "duration": 0.0045769560000000001 2023-08-01T19:56:25.387 INFO:teuthology.orchestra.run.smithi008.stdout: }, 2023-08-01T19:56:25.388 INFO:teuthology.orchestra.run.smithi008.stdout: { 2023-08-01T19:56:25.388 INFO:teuthology.orchestra.run.smithi008.stdout: "event": "sub_op_commit_rec", 2023-08-01T19:56:25.388 INFO:teuthology.orchestra.run.smithi008.stdout: "time": "2023-08-01T19:55:09.351721+0000", 2023-08-01T19:56:25.388 INFO:teuthology.orchestra.run.smithi008.stdout: "duration": 0.063507383000000001 2023-08-01T19:56:25.388 INFO:teuthology.orchestra.run.smithi008.stdout: }, 2023-08-01T19:56:25.388 INFO:teuthology.orchestra.run.smithi008.stdout: { 2023-08-01T19:56:25.388 INFO:teuthology.orchestra.run.smithi008.stdout: "event": "commit_sent", 2023-08-01T19:56:25.389 INFO:teuthology.orchestra.run.smithi008.stdout: "time": "2023-08-01T19:55:09.351777+0000", 2023-08-01T19:56:25.389 INFO:teuthology.orchestra.run.smithi008.stdout: "duration": 5.5733999999999999e-05 2023-08-01T19:56:25.389 INFO:teuthology.orchestra.run.smithi008.stdout: }, 2023-08-01T19:56:25.389 INFO:teuthology.orchestra.run.smithi008.stdout: { 2023-08-01T19:56:25.389 INFO:teuthology.orchestra.run.smithi008.stdout: "event": "done", 2023-08-01T19:56:25.389 INFO:teuthology.orchestra.run.smithi008.stdout: "time": "2023-08-01T19:55:09.351817+0000", 2023-08-01T19:56:25.389 INFO:teuthology.orchestra.run.smithi008.stdout: "duration": 3.9765000000000003e-05 2023-08-01T19:56:25.389 INFO:teuthology.orchestra.run.smithi008.stdout: } 2023-08-01T19:56:25.390 INFO:teuthology.orchestra.run.smithi008.stdout: ] 2023-08-01T19:56:25.390 INFO:teuthology.orchestra.run.smithi008.stdout: } 2023-08-01T19:56:25.390 INFO:teuthology.orchestra.run.smithi008.stdout: }, 2023-08-01T19:56:25.390 INFO:teuthology.orchestra.run.smithi008.stdout: { 2023-08-01T19:56:25.390 INFO:teuthology.orchestra.run.smithi008.stdout: "description": "osd_op(client.4668.0:107874 5.3 5:ce4c2799:::benchmark_data_smithi006_114134_object107873:head [set-alloc-hint object_size 65536 write_size 65536,write 0~65536] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e38)", 2023-08-01T19:56:25.390 INFO:teuthology.orchestra.run.smithi008.stdout: "initiated_at": "2023-08-01T19:55:09.286239+0000", 2023-08-01T19:56:25.390 INFO:teuthology.orchestra.run.smithi008.stdout: "age": 76.027123344000003, 2023-08-01T19:56:25.390 INFO:teuthology.orchestra.run.smithi008.stdout: "duration": 0.068224389999999996, 2023-08-01T19:56:25.391 INFO:teuthology.orchestra.run.smithi008.stdout: "type_data": { 2023-08-01T19:56:25.391 INFO:teuthology.orchestra.run.smithi008.stdout: "flag_point": "commit sent; apply or cleanup", 2023-08-01T19:56:25.391 INFO:teuthology.orchestra.run.smithi008.stdout: "client_info": { 2023-08-01T19:56:25.391 INFO:teuthology.orchestra.run.smithi008.stdout: "client": "client.4668", 2023-08-01T19:56:25.391 INFO:teuthology.orchestra.run.smithi008.stdout: "client_addr": "172.21.15.6:0/1709472247", 2023-08-01T19:56:25.391 INFO:teuthology.orchestra.run.smithi008.stdout: "tid": 107874 2023-08-01T19:56:25.391 INFO:teuthology.orchestra.run.smithi008.stdout: }, 2023-08-01T19:56:25.391 INFO:teuthology.orchestra.run.smithi008.stdout: "events": [ 2023-08-01T19:56:25.392 INFO:teuthology.orchestra.run.smithi008.stdout: { 2023-08-01T19:56:25.392 INFO:teuthology.orchestra.run.smithi008.stdout: "event": "initiated", 2023-08-01T19:56:25.392 INFO:teuthology.orchestra.run.smithi008.stdout: "time": "2023-08-01T19:55:09.286239+0000", 2023-08-01T19:56:25.392 INFO:teuthology.orchestra.run.smithi008.stdout: "duration": 0 2023-08-01T19:56:25.392 INFO:teuthology.orchestra.run.smithi008.stdout: }, 2023-08-01T19:56:25.392 INFO:teuthology.orchestra.run.smithi008.stdout: { 2023-08-01T19:56:25.392 INFO:teuthology.orchestra.run.smithi008.stdout: "event": "throttled", 2023-08-01T19:56:25.393 INFO:teuthology.orchestra.run.smithi008.stdout: "time": "2023-08-01T19:55:09.286239+0000", 2023-08-01T19:56:25.393 INFO:teuthology.orchestra.run.smithi008.stdout: "duration": 0 2023-08-01T19:56:25.393 INFO:teuthology.orchestra.run.smithi008.stdout: }, 2023-08-01T19:56:25.393 INFO:teuthology.orchestra.run.smithi008.stdout: { 2023-08-01T19:56:25.393 INFO:teuthology.orchestra.run.smithi008.stdout: "event": "header_read", 2023-08-01T19:56:25.393 INFO:teuthology.orchestra.run.smithi008.stdout: "time": "2023-08-01T19:55:09.286238+0000", 2023-08-01T19:56:25.393 INFO:teuthology.orchestra.run.smithi008.stdout: "duration": 4294967295.999999 2023-08-01T19:56:25.393 INFO:teuthology.orchestra.run.smithi008.stdout: }, 2023-08-01T19:56:25.394 INFO:teuthology.orchestra.run.smithi008.stdout: { 2023-08-01T19:56:25.394 INFO:teuthology.orchestra.run.smithi008.stdout: "event": "all_read", 2023-08-01T19:56:25.394 INFO:teuthology.orchestra.run.smithi008.stdout: "time": "2023-08-01T19:55:09.286310+0000", 2023-08-01T19:56:25.394 INFO:teuthology.orchestra.run.smithi008.stdout: "duration": 7.2583999999999995e-05 2023-08-01T19:56:25.394 INFO:teuthology.orchestra.run.smithi008.stdout: }, 2023-08-01T19:56:25.394 INFO:teuthology.orchestra.run.smithi008.stdout: { 2023-08-01T19:56:25.394 INFO:teuthology.orchestra.run.smithi008.stdout: "event": "dispatched", 2023-08-01T19:56:25.394 INFO:teuthology.orchestra.run.smithi008.stdout: "time": "2023-08-01T19:55:09.286323+0000", 2023-08-01T19:56:25.395 INFO:teuthology.orchestra.run.smithi008.stdout: "duration": 1.3151e-05 2023-08-01T19:56:25.395 INFO:teuthology.orchestra.run.smithi008.stdout: }, 2023-08-01T19:56:25.395 INFO:teuthology.orchestra.run.smithi008.stdout: { 2023-08-01T19:56:25.395 INFO:teuthology.orchestra.run.smithi008.stdout: "event": "queued_for_pg", 2023-08-01T19:56:25.395 INFO:teuthology.orchestra.run.smithi008.stdout: "time": "2023-08-01T19:55:09.286329+0000", 2023-08-01T19:56:25.395 INFO:teuthology.orchestra.run.smithi008.stdout: "duration": 5.8719999999999999e-06 2023-08-01T19:56:25.395 INFO:teuthology.orchestra.run.smithi008.stdout: }, 2023-08-01T19:56:25.395 INFO:teuthology.orchestra.run.smithi008.stdout: { 2023-08-01T19:56:25.396 INFO:teuthology.orchestra.run.smithi008.stdout: "event": "reached_pg", 2023-08-01T19:56:25.396 INFO:teuthology.orchestra.run.smithi008.stdout: "time": "2023-08-01T19:55:09.286392+0000", 2023-08-01T19:56:25.396 INFO:teuthology.orchestra.run.smithi008.stdout: "duration": 6.2378000000000005e-05 2023-08-01T19:56:25.396 INFO:teuthology.orchestra.run.smithi008.stdout: }, 2023-08-01T19:56:25.396 INFO:teuthology.orchestra.run.smithi008.stdout: { 2023-08-01T19:56:25.396 INFO:teuthology.orchestra.run.smithi008.stdout: "event": "started", 2023-08-01T19:56:25.396 INFO:teuthology.orchestra.run.smithi008.stdout: "time": "2023-08-01T19:55:09.286473+0000", 2023-08-01T19:56:25.396 INFO:teuthology.orchestra.run.smithi008.stdout: "duration": 8.1327000000000002e-05 2023-08-01T19:56:25.397 INFO:teuthology.orchestra.run.smithi008.stdout: }, 2023-08-01T19:56:25.397 INFO:teuthology.orchestra.run.smithi008.stdout: { 2023-08-01T19:56:25.397 INFO:teuthology.orchestra.run.smithi008.stdout: "event": "waiting for subops from 1", 2023-08-01T19:56:25.397 INFO:teuthology.orchestra.run.smithi008.stdout: "time": "2023-08-01T19:55:09.286557+0000", 2023-08-01T19:56:25.397 INFO:teuthology.orchestra.run.smithi008.stdout: "duration": 8.4140000000000004e-05 2023-08-01T19:56:25.397 INFO:teuthology.orchestra.run.smithi008.stdout: }, 2023-08-01T19:56:25.397 INFO:teuthology.orchestra.run.smithi008.stdout: { 2023-08-01T19:56:25.397 INFO:teuthology.orchestra.run.smithi008.stdout: "event": "op_commit", 2023-08-01T19:56:25.398 INFO:teuthology.orchestra.run.smithi008.stdout: "time": "2023-08-01T19:55:09.290681+0000", 2023-08-01T19:56:25.398 INFO:teuthology.orchestra.run.smithi008.stdout: "duration": 0.0041242420000000002 2023-08-01T19:56:25.398 INFO:teuthology.orchestra.run.smithi008.stdout: }, 2023-08-01T19:56:25.398 INFO:teuthology.orchestra.run.smithi008.stdout: { 2023-08-01T19:56:25.398 INFO:teuthology.orchestra.run.smithi008.stdout: "event": "sub_op_commit_rec", 2023-08-01T19:56:25.398 INFO:teuthology.orchestra.run.smithi008.stdout: "time": "2023-08-01T19:55:09.354372+0000", 2023-08-01T19:56:25.398 INFO:teuthology.orchestra.run.smithi008.stdout: "duration": 0.063690438000000002 2023-08-01T19:56:25.399 INFO:teuthology.orchestra.run.smithi008.stdout: }, 2023-08-01T19:56:25.399 INFO:teuthology.orchestra.run.smithi008.stdout: { 2023-08-01T19:56:25.399 INFO:teuthology.orchestra.run.smithi008.stdout: "event": "commit_sent", 2023-08-01T19:56:25.399 INFO:teuthology.orchestra.run.smithi008.stdout: "time": "2023-08-01T19:55:09.354421+0000", 2023-08-01T19:56:25.399 INFO:teuthology.orchestra.run.smithi008.stdout: "duration": 4.9413000000000003e-05 2023-08-01T19:56:25.399 INFO:teuthology.orchestra.run.smithi008.stdout: }, 2023-08-01T19:56:25.399 INFO:teuthology.orchestra.run.smithi008.stdout: { 2023-08-01T19:56:25.399 INFO:teuthology.orchestra.run.smithi008.stdout: "event": "done", 2023-08-01T19:56:25.400 INFO:teuthology.orchestra.run.smithi008.stdout: "time": "2023-08-01T19:55:09.354463+0000", 2023-08-01T19:56:25.400 INFO:teuthology.orchestra.run.smithi008.stdout: "duration": 4.1924e-05 2023-08-01T19:56:25.400 INFO:teuthology.orchestra.run.smithi008.stdout: } 2023-08-01T19:56:25.400 INFO:teuthology.orchestra.run.smithi008.stdout: ] 2023-08-01T19:56:25.400 INFO:teuthology.orchestra.run.smithi008.stdout: } 2023-08-01T19:56:25.400 INFO:teuthology.orchestra.run.smithi008.stdout: }, 2023-08-01T19:56:25.400 INFO:teuthology.orchestra.run.smithi008.stdout: { 2023-08-01T19:56:25.400 INFO:teuthology.orchestra.run.smithi008.stdout: "description": "osd_op(client.4668.0:197398 5.1 5:809d7164:::benchmark_data_smithi006_114134_object63737:head [delete] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e61)", 2023-08-01T19:56:25.401 INFO:teuthology.orchestra.run.smithi008.stdout: "initiated_at": "2023-08-01T19:55:58.554713+0000", 2023-08-01T19:56:25.401 INFO:teuthology.orchestra.run.smithi008.stdout: "age": 26.758648655999998, 2023-08-01T19:56:25.401 INFO:teuthology.orchestra.run.smithi008.stdout: "duration": 1.0661326660000001, 2023-08-01T19:56:25.401 INFO:teuthology.orchestra.run.smithi008.stdout: "type_data": { 2023-08-01T19:56:25.401 INFO:teuthology.orchestra.run.smithi008.stdout: "flag_point": "reached pg", 2023-08-01T19:56:25.401 INFO:teuthology.orchestra.run.smithi008.stdout: "client_info": { 2023-08-01T19:56:25.401 INFO:teuthology.orchestra.run.smithi008.stdout: "client": "client.4668", 2023-08-01T19:56:25.401 INFO:teuthology.orchestra.run.smithi008.stdout: "client_addr": "172.21.15.6:0/1709472247", 2023-08-01T19:56:25.402 INFO:teuthology.orchestra.run.smithi008.stdout: "tid": 197398 2023-08-01T19:56:25.402 INFO:teuthology.orchestra.run.smithi008.stdout: }, 2023-08-01T19:56:25.402 INFO:teuthology.orchestra.run.smithi008.stdout: "events": [ 2023-08-01T19:56:25.402 INFO:teuthology.orchestra.run.smithi008.stdout: { 2023-08-01T19:56:25.402 INFO:teuthology.orchestra.run.smithi008.stdout: "event": "initiated", 2023-08-01T19:56:25.402 INFO:teuthology.orchestra.run.smithi008.stdout: "time": "2023-08-01T19:55:58.554713+0000", 2023-08-01T19:56:25.402 INFO:teuthology.orchestra.run.smithi008.stdout: "duration": 0 2023-08-01T19:56:25.402 INFO:teuthology.orchestra.run.smithi008.stdout: }, 2023-08-01T19:56:25.403 INFO:teuthology.orchestra.run.smithi008.stdout: { 2023-08-01T19:56:25.403 INFO:teuthology.orchestra.run.smithi008.stdout: "event": "throttled", 2023-08-01T19:56:25.403 INFO:teuthology.orchestra.run.smithi008.stdout: "time": "2023-08-01T19:55:58.554713+0000", 2023-08-01T19:56:25.403 INFO:teuthology.orchestra.run.smithi008.stdout: "duration": 0 2023-08-01T19:56:25.403 INFO:teuthology.orchestra.run.smithi008.stdout: }, 2023-08-01T19:56:25.403 INFO:teuthology.orchestra.run.smithi008.stdout: { 2023-08-01T19:56:25.403 INFO:teuthology.orchestra.run.smithi008.stdout: "event": "header_read", 2023-08-01T19:56:25.404 INFO:teuthology.orchestra.run.smithi008.stdout: "time": "2023-08-01T19:55:58.554713+0000", 2023-08-01T19:56:25.404 INFO:teuthology.orchestra.run.smithi008.stdout: "duration": 4294967295.999999 2023-08-01T19:56:25.404 INFO:teuthology.orchestra.run.smithi008.stdout: }, 2023-08-01T19:56:25.404 INFO:teuthology.orchestra.run.smithi008.stdout: { 2023-08-01T19:56:25.404 INFO:teuthology.orchestra.run.smithi008.stdout: "event": "all_read", 2023-08-01T19:56:25.404 INFO:teuthology.orchestra.run.smithi008.stdout: "time": "2023-08-01T19:55:58.554717+0000", 2023-08-01T19:56:25.404 INFO:teuthology.orchestra.run.smithi008.stdout: "duration": 4.7389999999999999e-06 2023-08-01T19:56:25.404 INFO:teuthology.orchestra.run.smithi008.stdout: }, 2023-08-01T19:56:25.405 INFO:teuthology.orchestra.run.smithi008.stdout: { 2023-08-01T19:56:25.405 INFO:teuthology.orchestra.run.smithi008.stdout: "event": "dispatched", 2023-08-01T19:56:25.405 INFO:teuthology.orchestra.run.smithi008.stdout: "time": "2023-08-01T19:55:58.554725+0000", 2023-08-01T19:56:25.405 INFO:teuthology.orchestra.run.smithi008.stdout: "duration": 7.9820000000000008e-06 2023-08-01T19:56:25.405 INFO:teuthology.orchestra.run.smithi008.stdout: }, 2023-08-01T19:56:25.405 INFO:teuthology.orchestra.run.smithi008.stdout: { 2023-08-01T19:56:25.405 INFO:teuthology.orchestra.run.smithi008.stdout: "event": "queued_for_pg", 2023-08-01T19:56:25.406 INFO:teuthology.orchestra.run.smithi008.stdout: "time": "2023-08-01T19:55:58.554730+0000", 2023-08-01T19:56:25.406 INFO:teuthology.orchestra.run.smithi008.stdout: "duration": 4.318e-06 2023-08-01T19:56:25.406 INFO:teuthology.orchestra.run.smithi008.stdout: }, 2023-08-01T19:56:25.406 INFO:teuthology.orchestra.run.smithi008.stdout: { 2023-08-01T19:56:25.406 INFO:teuthology.orchestra.run.smithi008.stdout: "event": "reached_pg", 2023-08-01T19:56:25.406 INFO:teuthology.orchestra.run.smithi008.stdout: "time": "2023-08-01T19:55:58.554767+0000", 2023-08-01T19:56:25.406 INFO:teuthology.orchestra.run.smithi008.stdout: "duration": 3.7778000000000003e-05 2023-08-01T19:56:25.406 INFO:teuthology.orchestra.run.smithi008.stdout: }, 2023-08-01T19:56:25.407 INFO:teuthology.orchestra.run.smithi008.stdout: { 2023-08-01T19:56:25.407 INFO:teuthology.orchestra.run.smithi008.stdout: "event": "started", 2023-08-01T19:56:25.407 INFO:teuthology.orchestra.run.smithi008.stdout: "time": "2023-08-01T19:55:58.554874+0000", 2023-08-01T19:56:25.407 INFO:teuthology.orchestra.run.smithi008.stdout: "duration": 0.000106613 2023-08-01T19:56:25.407 INFO:teuthology.orchestra.run.smithi008.stdout: }, 2023-08-01T19:56:25.407 INFO:teuthology.orchestra.run.smithi008.stdout: { 2023-08-01T19:56:25.407 INFO:teuthology.orchestra.run.smithi008.stdout: "event": "waiting for subops from 1", 2023-08-01T19:56:25.407 INFO:teuthology.orchestra.run.smithi008.stdout: "time": "2023-08-01T19:55:58.554941+0000", 2023-08-01T19:56:25.408 INFO:teuthology.orchestra.run.smithi008.stdout: "duration": 6.6569000000000006e-05 2023-08-01T19:56:25.408 INFO:teuthology.orchestra.run.smithi008.stdout: }, 2023-08-01T19:56:25.408 INFO:teuthology.orchestra.run.smithi008.stdout: { 2023-08-01T19:56:25.408 INFO:teuthology.orchestra.run.smithi008.stdout: "event": "reached_pg", 2023-08-01T19:56:25.408 INFO:teuthology.orchestra.run.smithi008.stdout: "time": "2023-08-01T19:55:58.569436+0000", 2023-08-01T19:56:25.408 INFO:teuthology.orchestra.run.smithi008.stdout: "duration": 0.014495413 2023-08-01T19:56:25.408 INFO:teuthology.orchestra.run.smithi008.stdout: }, 2023-08-01T19:56:25.409 INFO:teuthology.orchestra.run.smithi008.stdout: { 2023-08-01T19:56:25.409 INFO:teuthology.orchestra.run.smithi008.stdout: "event": "waiting for peered", 2023-08-01T19:56:25.409 INFO:teuthology.orchestra.run.smithi008.stdout: "time": "2023-08-01T19:55:58.569441+0000", 2023-08-01T19:56:25.409 INFO:teuthology.orchestra.run.smithi008.stdout: "duration": 5.1109999999999999e-06 2023-08-01T19:56:25.409 INFO:teuthology.orchestra.run.smithi008.stdout: }, 2023-08-01T19:56:25.409 INFO:teuthology.orchestra.run.smithi008.stdout: { 2023-08-01T19:56:25.409 INFO:teuthology.orchestra.run.smithi008.stdout: "event": "reached_pg", 2023-08-01T19:56:25.409 INFO:teuthology.orchestra.run.smithi008.stdout: "time": "2023-08-01T19:55:59.620748+0000", 2023-08-01T19:56:25.410 INFO:teuthology.orchestra.run.smithi008.stdout: "duration": 1.0513071810000001 2023-08-01T19:56:25.410 INFO:teuthology.orchestra.run.smithi008.stdout: }, 2023-08-01T19:56:25.410 INFO:teuthology.orchestra.run.smithi008.stdout: { 2023-08-01T19:56:25.410 INFO:teuthology.orchestra.run.smithi008.stdout: "event": "done", 2023-08-01T19:56:25.410 INFO:teuthology.orchestra.run.smithi008.stdout: "time": "2023-08-01T19:55:59.620846+0000", 2023-08-01T19:56:25.410 INFO:teuthology.orchestra.run.smithi008.stdout: "duration": 9.7739999999999996e-05 2023-08-01T19:56:25.410 INFO:teuthology.orchestra.run.smithi008.stdout: } 2023-08-01T19:56:25.410 INFO:teuthology.orchestra.run.smithi008.stdout: ] 2023-08-01T19:56:25.411 INFO:teuthology.orchestra.run.smithi008.stdout: } 2023-08-01T19:56:25.411 INFO:teuthology.orchestra.run.smithi008.stdout: }, 2023-08-01T19:56:25.411 INFO:teuthology.orchestra.run.smithi008.stdout: { 2023-08-01T19:56:25.411 INFO:teuthology.orchestra.run.smithi008.stdout: "description": "osd_op(client.4668.0:197400 5.c 5:30dad7f9:::benchmark_data_smithi006_114134_object63739:head [delete] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e61)", 2023-08-01T19:56:25.411 INFO:teuthology.orchestra.run.smithi008.stdout: "initiated_at": "2023-08-01T19:55:58.556576+0000", 2023-08-01T19:56:25.411 INFO:teuthology.orchestra.run.smithi008.stdout: "age": 26.756785807, 2023-08-01T19:56:25.411 INFO:teuthology.orchestra.run.smithi008.stdout: "duration": 1.062559968, 2023-08-01T19:56:25.411 INFO:teuthology.orchestra.run.smithi008.stdout: "type_data": { 2023-08-01T19:56:25.412 INFO:teuthology.orchestra.run.smithi008.stdout: "flag_point": "reached pg", 2023-08-01T19:56:25.412 INFO:teuthology.orchestra.run.smithi008.stdout: "client_info": { 2023-08-01T19:56:25.412 INFO:teuthology.orchestra.run.smithi008.stdout: "client": "client.4668", 2023-08-01T19:56:25.412 INFO:teuthology.orchestra.run.smithi008.stdout: "client_addr": "172.21.15.6:0/1709472247", 2023-08-01T19:56:25.412 INFO:teuthology.orchestra.run.smithi008.stdout: "tid": 197400 2023-08-01T19:56:25.412 INFO:teuthology.orchestra.run.smithi008.stdout: }, 2023-08-01T19:56:25.412 INFO:teuthology.orchestra.run.smithi008.stdout: "events": [ 2023-08-01T19:56:25.413 INFO:teuthology.orchestra.run.smithi008.stdout: { 2023-08-01T19:56:25.413 INFO:teuthology.orchestra.run.smithi008.stdout: "event": "initiated", 2023-08-01T19:56:25.413 INFO:teuthology.orchestra.run.smithi008.stdout: "time": "2023-08-01T19:55:58.556576+0000", 2023-08-01T19:56:25.413 INFO:teuthology.orchestra.run.smithi008.stdout: "duration": 0 2023-08-01T19:56:25.413 INFO:teuthology.orchestra.run.smithi008.stdout: }, 2023-08-01T19:56:25.413 INFO:teuthology.orchestra.run.smithi008.stdout: { 2023-08-01T19:56:25.413 INFO:teuthology.orchestra.run.smithi008.stdout: "event": "throttled", 2023-08-01T19:56:25.413 INFO:teuthology.orchestra.run.smithi008.stdout: "time": "2023-08-01T19:55:58.556576+0000", 2023-08-01T19:56:25.414 INFO:teuthology.orchestra.run.smithi008.stdout: "duration": 0 2023-08-01T19:56:25.414 INFO:teuthology.orchestra.run.smithi008.stdout: }, 2023-08-01T19:56:25.414 INFO:teuthology.orchestra.run.smithi008.stdout: { 2023-08-01T19:56:25.414 INFO:teuthology.orchestra.run.smithi008.stdout: "event": "header_read", 2023-08-01T19:56:25.414 INFO:teuthology.orchestra.run.smithi008.stdout: "time": "2023-08-01T19:55:58.556575+0000", 2023-08-01T19:56:25.414 INFO:teuthology.orchestra.run.smithi008.stdout: "duration": 4294967295.999999 2023-08-01T19:56:25.414 INFO:teuthology.orchestra.run.smithi008.stdout: }, 2023-08-01T19:56:25.414 INFO:teuthology.orchestra.run.smithi008.stdout: { 2023-08-01T19:56:25.415 INFO:teuthology.orchestra.run.smithi008.stdout: "event": "all_read", 2023-08-01T19:56:25.415 INFO:teuthology.orchestra.run.smithi008.stdout: "time": "2023-08-01T19:55:58.556580+0000", 2023-08-01T19:56:25.415 INFO:teuthology.orchestra.run.smithi008.stdout: "duration": 4.2860000000000001e-06 2023-08-01T19:56:25.415 INFO:teuthology.orchestra.run.smithi008.stdout: }, 2023-08-01T19:56:25.415 INFO:teuthology.orchestra.run.smithi008.stdout: { 2023-08-01T19:56:25.415 INFO:teuthology.orchestra.run.smithi008.stdout: "event": "dispatched", 2023-08-01T19:56:25.415 INFO:teuthology.orchestra.run.smithi008.stdout: "time": "2023-08-01T19:55:58.556589+0000", 2023-08-01T19:56:25.415 INFO:teuthology.orchestra.run.smithi008.stdout: "duration": 9.6500000000000008e-06 2023-08-01T19:56:25.416 INFO:teuthology.orchestra.run.smithi008.stdout: }, 2023-08-01T19:56:25.416 INFO:teuthology.orchestra.run.smithi008.stdout: { 2023-08-01T19:56:25.416 INFO:teuthology.orchestra.run.smithi008.stdout: "event": "queued_for_pg", 2023-08-01T19:56:25.416 INFO:teuthology.orchestra.run.smithi008.stdout: "time": "2023-08-01T19:55:58.556596+0000", 2023-08-01T19:56:25.416 INFO:teuthology.orchestra.run.smithi008.stdout: "duration": 6.1430000000000003e-06 2023-08-01T19:56:25.416 INFO:teuthology.orchestra.run.smithi008.stdout: }, 2023-08-01T19:56:25.416 INFO:teuthology.orchestra.run.smithi008.stdout: { 2023-08-01T19:56:25.417 INFO:teuthology.orchestra.run.smithi008.stdout: "event": "reached_pg", 2023-08-01T19:56:25.417 INFO:teuthology.orchestra.run.smithi008.stdout: "time": "2023-08-01T19:55:58.556634+0000", 2023-08-01T19:56:25.417 INFO:teuthology.orchestra.run.smithi008.stdout: "duration": 3.8080000000000001e-05 2023-08-01T19:56:25.417 INFO:teuthology.orchestra.run.smithi008.stdout: }, 2023-08-01T19:56:25.417 INFO:teuthology.orchestra.run.smithi008.stdout: { 2023-08-01T19:56:25.417 INFO:teuthology.orchestra.run.smithi008.stdout: "event": "started", 2023-08-01T19:56:25.417 INFO:teuthology.orchestra.run.smithi008.stdout: "time": "2023-08-01T19:55:58.556754+0000", 2023-08-01T19:56:25.417 INFO:teuthology.orchestra.run.smithi008.stdout: "duration": 0.000120444 2023-08-01T19:56:25.418 INFO:teuthology.orchestra.run.smithi008.stdout: }, 2023-08-01T19:56:25.418 INFO:teuthology.orchestra.run.smithi008.stdout: { 2023-08-01T19:56:25.418 INFO:teuthology.orchestra.run.smithi008.stdout: "event": "waiting for subops from 1", 2023-08-01T19:56:25.418 INFO:teuthology.orchestra.run.smithi008.stdout: "time": "2023-08-01T19:55:58.556875+0000", 2023-08-01T19:56:25.418 INFO:teuthology.orchestra.run.smithi008.stdout: "duration": 0.00012100900000000001 2023-08-01T19:56:25.418 INFO:teuthology.orchestra.run.smithi008.stdout: }, 2023-08-01T19:56:25.418 INFO:teuthology.orchestra.run.smithi008.stdout: { 2023-08-01T19:56:25.419 INFO:teuthology.orchestra.run.smithi008.stdout: "event": "reached_pg", 2023-08-01T19:56:25.419 INFO:teuthology.orchestra.run.smithi008.stdout: "time": "2023-08-01T19:55:58.567406+0000", 2023-08-01T19:56:25.419 INFO:teuthology.orchestra.run.smithi008.stdout: "duration": 0.010531351 2023-08-01T19:56:25.419 INFO:teuthology.orchestra.run.smithi008.stdout: }, 2023-08-01T19:56:25.419 INFO:teuthology.orchestra.run.smithi008.stdout: { 2023-08-01T19:56:25.419 INFO:teuthology.orchestra.run.smithi008.stdout: "event": "waiting for peered", 2023-08-01T19:56:25.419 INFO:teuthology.orchestra.run.smithi008.stdout: "time": "2023-08-01T19:55:58.567414+0000", 2023-08-01T19:56:25.419 INFO:teuthology.orchestra.run.smithi008.stdout: "duration": 7.9189999999999999e-06 2023-08-01T19:56:25.420 INFO:teuthology.orchestra.run.smithi008.stdout: }, 2023-08-01T19:56:25.420 INFO:teuthology.orchestra.run.smithi008.stdout: { 2023-08-01T19:56:25.420 INFO:teuthology.orchestra.run.smithi008.stdout: "event": "reached_pg", 2023-08-01T19:56:25.420 INFO:teuthology.orchestra.run.smithi008.stdout: "time": "2023-08-01T19:55:59.619054+0000", 2023-08-01T19:56:25.420 INFO:teuthology.orchestra.run.smithi008.stdout: "duration": 1.0516396269999999 2023-08-01T19:56:25.420 INFO:teuthology.orchestra.run.smithi008.stdout: }, 2023-08-01T19:56:25.420 INFO:teuthology.orchestra.run.smithi008.stdout: { 2023-08-01T19:56:25.420 INFO:teuthology.orchestra.run.smithi008.stdout: "event": "done", 2023-08-01T19:56:25.421 INFO:teuthology.orchestra.run.smithi008.stdout: "time": "2023-08-01T19:55:59.619136+0000", 2023-08-01T19:56:25.421 INFO:teuthology.orchestra.run.smithi008.stdout: "duration": 8.2208999999999998e-05 2023-08-01T19:56:25.421 INFO:teuthology.orchestra.run.smithi008.stdout: } 2023-08-01T19:56:25.421 INFO:teuthology.orchestra.run.smithi008.stdout: ] 2023-08-01T19:56:25.421 INFO:teuthology.orchestra.run.smithi008.stdout: } 2023-08-01T19:56:25.421 INFO:teuthology.orchestra.run.smithi008.stdout: }, 2023-08-01T19:56:25.421 INFO:teuthology.orchestra.run.smithi008.stdout: { 2023-08-01T19:56:25.422 INFO:teuthology.orchestra.run.smithi008.stdout: "description": "osd_op(client.4668.0:197401 5.1 5:88b38567:::benchmark_data_smithi006_114134_object63740:head [delete] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e61)", 2023-08-01T19:56:25.422 INFO:teuthology.orchestra.run.smithi008.stdout: "initiated_at": "2023-08-01T19:55:58.556607+0000", 2023-08-01T19:56:25.422 INFO:teuthology.orchestra.run.smithi008.stdout: "age": 26.756755383000002, 2023-08-01T19:56:25.422 INFO:teuthology.orchestra.run.smithi008.stdout: "duration": 1.0643254870000001, 2023-08-01T19:56:25.422 INFO:teuthology.orchestra.run.smithi008.stdout: "type_data": { 2023-08-01T19:56:25.422 INFO:teuthology.orchestra.run.smithi008.stdout: "flag_point": "reached pg", 2023-08-01T19:56:25.422 INFO:teuthology.orchestra.run.smithi008.stdout: "client_info": { 2023-08-01T19:56:25.422 INFO:teuthology.orchestra.run.smithi008.stdout: "client": "client.4668", 2023-08-01T19:56:25.423 INFO:teuthology.orchestra.run.smithi008.stdout: "client_addr": "172.21.15.6:0/1709472247", 2023-08-01T19:56:25.423 INFO:teuthology.orchestra.run.smithi008.stdout: "tid": 197401 2023-08-01T19:56:25.423 INFO:teuthology.orchestra.run.smithi008.stdout: }, 2023-08-01T19:56:25.423 INFO:teuthology.orchestra.run.smithi008.stdout: "events": [ 2023-08-01T19:56:25.423 INFO:teuthology.orchestra.run.smithi008.stdout: { 2023-08-01T19:56:25.423 INFO:teuthology.orchestra.run.smithi008.stdout: "event": "initiated", 2023-08-01T19:56:25.423 INFO:teuthology.orchestra.run.smithi008.stdout: "time": "2023-08-01T19:55:58.556607+0000", 2023-08-01T19:56:25.424 INFO:teuthology.orchestra.run.smithi008.stdout: "duration": 0 2023-08-01T19:56:25.424 INFO:teuthology.orchestra.run.smithi008.stdout: }, 2023-08-01T19:56:25.424 INFO:teuthology.orchestra.run.smithi008.stdout: { 2023-08-01T19:56:25.424 INFO:teuthology.orchestra.run.smithi008.stdout: "event": "throttled", 2023-08-01T19:56:25.424 INFO:teuthology.orchestra.run.smithi008.stdout: "time": "2023-08-01T19:55:58.556607+0000", 2023-08-01T19:56:25.424 INFO:teuthology.orchestra.run.smithi008.stdout: "duration": 0 2023-08-01T19:56:25.424 INFO:teuthology.orchestra.run.smithi008.stdout: }, 2023-08-01T19:56:25.425 INFO:teuthology.orchestra.run.smithi008.stdout: { 2023-08-01T19:56:25.425 INFO:teuthology.orchestra.run.smithi008.stdout: "event": "header_read", 2023-08-01T19:56:25.425 INFO:teuthology.orchestra.run.smithi008.stdout: "time": "2023-08-01T19:55:58.556606+0000", 2023-08-01T19:56:25.425 INFO:teuthology.orchestra.run.smithi008.stdout: "duration": 4294967295.9999995 2023-08-01T19:56:25.425 INFO:teuthology.orchestra.run.smithi008.stdout: }, 2023-08-01T19:56:25.425 INFO:teuthology.orchestra.run.smithi008.stdout: { 2023-08-01T19:56:25.425 INFO:teuthology.orchestra.run.smithi008.stdout: "event": "all_read", 2023-08-01T19:56:25.425 INFO:teuthology.orchestra.run.smithi008.stdout: "time": "2023-08-01T19:55:58.556609+0000", 2023-08-01T19:56:25.426 INFO:teuthology.orchestra.run.smithi008.stdout: "duration": 3.1750000000000001e-06 2023-08-01T19:56:25.426 INFO:teuthology.orchestra.run.smithi008.stdout: }, 2023-08-01T19:56:25.426 INFO:teuthology.orchestra.run.smithi008.stdout: { 2023-08-01T19:56:25.426 INFO:teuthology.orchestra.run.smithi008.stdout: "event": "dispatched", 2023-08-01T19:56:25.426 INFO:teuthology.orchestra.run.smithi008.stdout: "time": "2023-08-01T19:55:58.556617+0000", 2023-08-01T19:56:25.426 INFO:teuthology.orchestra.run.smithi008.stdout: "duration": 7.2760000000000003e-06 2023-08-01T19:56:25.426 INFO:teuthology.orchestra.run.smithi008.stdout: }, 2023-08-01T19:56:25.427 INFO:teuthology.orchestra.run.smithi008.stdout: { 2023-08-01T19:56:25.427 INFO:teuthology.orchestra.run.smithi008.stdout: "event": "queued_for_pg", 2023-08-01T19:56:25.427 INFO:teuthology.orchestra.run.smithi008.stdout: "time": "2023-08-01T19:55:58.556621+0000", 2023-08-01T19:56:25.427 INFO:teuthology.orchestra.run.smithi008.stdout: "duration": 4.8219999999999997e-06 2023-08-01T19:56:25.427 INFO:teuthology.orchestra.run.smithi008.stdout: }, 2023-08-01T19:56:25.427 INFO:teuthology.orchestra.run.smithi008.stdout: { 2023-08-01T19:56:25.427 INFO:teuthology.orchestra.run.smithi008.stdout: "event": "reached_pg", 2023-08-01T19:56:25.428 INFO:teuthology.orchestra.run.smithi008.stdout: "time": "2023-08-01T19:55:58.556651+0000", 2023-08-01T19:56:25.428 INFO:teuthology.orchestra.run.smithi008.stdout: "duration": 2.9921999999999999e-05 2023-08-01T19:56:25.428 INFO:teuthology.orchestra.run.smithi008.stdout: }, 2023-08-01T19:56:25.428 INFO:teuthology.orchestra.run.smithi008.stdout: { 2023-08-01T19:56:25.428 INFO:teuthology.orchestra.run.smithi008.stdout: "event": "started", 2023-08-01T19:56:25.428 INFO:teuthology.orchestra.run.smithi008.stdout: "time": "2023-08-01T19:55:58.556755+0000", 2023-08-01T19:56:25.428 INFO:teuthology.orchestra.run.smithi008.stdout: "duration": 0.000103309 2023-08-01T19:56:25.428 INFO:teuthology.orchestra.run.smithi008.stdout: }, 2023-08-01T19:56:25.429 INFO:teuthology.orchestra.run.smithi008.stdout: { 2023-08-01T19:56:25.429 INFO:teuthology.orchestra.run.smithi008.stdout: "event": "waiting for subops from 1", 2023-08-01T19:56:25.429 INFO:teuthology.orchestra.run.smithi008.stdout: "time": "2023-08-01T19:55:58.556875+0000", 2023-08-01T19:56:25.429 INFO:teuthology.orchestra.run.smithi008.stdout: "duration": 0.000120424 2023-08-01T19:56:25.429 INFO:teuthology.orchestra.run.smithi008.stdout: }, 2023-08-01T19:56:25.429 INFO:teuthology.orchestra.run.smithi008.stdout: { 2023-08-01T19:56:25.429 INFO:teuthology.orchestra.run.smithi008.stdout: "event": "reached_pg", 2023-08-01T19:56:25.430 INFO:teuthology.orchestra.run.smithi008.stdout: "time": "2023-08-01T19:55:58.569459+0000", 2023-08-01T19:56:25.430 INFO:teuthology.orchestra.run.smithi008.stdout: "duration": 0.012583776 2023-08-01T19:56:25.430 INFO:teuthology.orchestra.run.smithi008.stdout: }, 2023-08-01T19:56:25.430 INFO:teuthology.orchestra.run.smithi008.stdout: { 2023-08-01T19:56:25.430 INFO:teuthology.orchestra.run.smithi008.stdout: "event": "waiting for peered", 2023-08-01T19:56:25.430 INFO:teuthology.orchestra.run.smithi008.stdout: "time": "2023-08-01T19:55:58.569462+0000", 2023-08-01T19:56:25.430 INFO:teuthology.orchestra.run.smithi008.stdout: "duration": 2.74e-06 2023-08-01T19:56:25.430 INFO:teuthology.orchestra.run.smithi008.stdout: }, 2023-08-01T19:56:25.431 INFO:teuthology.orchestra.run.smithi008.stdout: { 2023-08-01T19:56:25.431 INFO:teuthology.orchestra.run.smithi008.stdout: "event": "reached_pg", 2023-08-01T19:56:25.431 INFO:teuthology.orchestra.run.smithi008.stdout: "time": "2023-08-01T19:55:59.620880+0000", 2023-08-01T19:56:25.431 INFO:teuthology.orchestra.run.smithi008.stdout: "duration": 1.0514181279999999 2023-08-01T19:56:25.431 INFO:teuthology.orchestra.run.smithi008.stdout: }, 2023-08-01T19:56:25.431 INFO:teuthology.orchestra.run.smithi008.stdout: { 2023-08-01T19:56:25.431 INFO:teuthology.orchestra.run.smithi008.stdout: "event": "done", 2023-08-01T19:56:25.431 INFO:teuthology.orchestra.run.smithi008.stdout: "time": "2023-08-01T19:55:59.620932+0000", 2023-08-01T19:56:25.432 INFO:teuthology.orchestra.run.smithi008.stdout: "duration": 5.2404000000000002e-05 2023-08-01T19:56:25.432 INFO:teuthology.orchestra.run.smithi008.stdout: } 2023-08-01T19:56:25.432 INFO:teuthology.orchestra.run.smithi008.stdout: ] 2023-08-01T19:56:25.432 INFO:teuthology.orchestra.run.smithi008.stdout: } 2023-08-01T19:56:25.432 INFO:teuthology.orchestra.run.smithi008.stdout: }, 2023-08-01T19:56:25.432 INFO:teuthology.orchestra.run.smithi008.stdout: { 2023-08-01T19:56:25.432 INFO:teuthology.orchestra.run.smithi008.stdout: "description": "osd_op(client.4668.0:197402 5.c 5:3f057b78:::benchmark_data_smithi006_114134_object63741:head [delete] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e61)", 2023-08-01T19:56:25.433 INFO:teuthology.orchestra.run.smithi008.stdout: "initiated_at": "2023-08-01T19:55:58.556632+0000", 2023-08-01T19:56:25.433 INFO:teuthology.orchestra.run.smithi008.stdout: "age": 26.756730012999999, 2023-08-01T19:56:25.433 INFO:teuthology.orchestra.run.smithi008.stdout: "duration": 1.0625773970000001, 2023-08-01T19:56:25.433 INFO:teuthology.orchestra.run.smithi008.stdout: "type_data": { 2023-08-01T19:56:25.433 INFO:teuthology.orchestra.run.smithi008.stdout: "flag_point": "reached pg", 2023-08-01T19:56:25.433 INFO:teuthology.orchestra.run.smithi008.stdout: "client_info": { 2023-08-01T19:56:25.433 INFO:teuthology.orchestra.run.smithi008.stdout: "client": "client.4668", 2023-08-01T19:56:25.433 INFO:teuthology.orchestra.run.smithi008.stdout: "client_addr": "172.21.15.6:0/1709472247", 2023-08-01T19:56:25.434 INFO:teuthology.orchestra.run.smithi008.stdout: "tid": 197402 2023-08-01T19:56:25.434 INFO:teuthology.orchestra.run.smithi008.stdout: }, 2023-08-01T19:56:25.434 INFO:teuthology.orchestra.run.smithi008.stdout: "events": [ 2023-08-01T19:56:25.434 INFO:teuthology.orchestra.run.smithi008.stdout: { 2023-08-01T19:56:25.434 INFO:teuthology.orchestra.run.smithi008.stdout: "event": "initiated", 2023-08-01T19:56:25.434 INFO:teuthology.orchestra.run.smithi008.stdout: "time": "2023-08-01T19:55:58.556632+0000", 2023-08-01T19:56:25.434 INFO:teuthology.orchestra.run.smithi008.stdout: "duration": 0 2023-08-01T19:56:25.434 INFO:teuthology.orchestra.run.smithi008.stdout: }, 2023-08-01T19:56:25.435 INFO:teuthology.orchestra.run.smithi008.stdout: { 2023-08-01T19:56:25.435 INFO:teuthology.orchestra.run.smithi008.stdout: "event": "throttled", 2023-08-01T19:56:25.435 INFO:teuthology.orchestra.run.smithi008.stdout: "time": "2023-08-01T19:55:58.556632+0000", 2023-08-01T19:56:25.435 INFO:teuthology.orchestra.run.smithi008.stdout: "duration": 0 2023-08-01T19:56:25.435 INFO:teuthology.orchestra.run.smithi008.stdout: }, 2023-08-01T19:56:25.435 INFO:teuthology.orchestra.run.smithi008.stdout: { 2023-08-01T19:56:25.435 INFO:teuthology.orchestra.run.smithi008.stdout: "event": "header_read", 2023-08-01T19:56:25.435 INFO:teuthology.orchestra.run.smithi008.stdout: "time": "2023-08-01T19:55:58.556632+0000", 2023-08-01T19:56:25.436 INFO:teuthology.orchestra.run.smithi008.stdout: "duration": 4294967295.9999995 2023-08-01T19:56:25.436 INFO:teuthology.orchestra.run.smithi008.stdout: }, 2023-08-01T19:56:25.436 INFO:teuthology.orchestra.run.smithi008.stdout: { 2023-08-01T19:56:25.436 INFO:teuthology.orchestra.run.smithi008.stdout: "event": "all_read", 2023-08-01T19:56:25.436 INFO:teuthology.orchestra.run.smithi008.stdout: "time": "2023-08-01T19:55:58.556634+0000", 2023-08-01T19:56:25.436 INFO:teuthology.orchestra.run.smithi008.stdout: "duration": 2.8940000000000002e-06 2023-08-01T19:56:25.436 INFO:teuthology.orchestra.run.smithi008.stdout: }, 2023-08-01T19:56:25.437 INFO:teuthology.orchestra.run.smithi008.stdout: { 2023-08-01T19:56:25.437 INFO:teuthology.orchestra.run.smithi008.stdout: "event": "dispatched", 2023-08-01T19:56:25.437 INFO:teuthology.orchestra.run.smithi008.stdout: "time": "2023-08-01T19:55:58.556641+0000", 2023-08-01T19:56:25.437 INFO:teuthology.orchestra.run.smithi008.stdout: "duration": 6.8449999999999997e-06 2023-08-01T19:56:25.437 INFO:teuthology.orchestra.run.smithi008.stdout: }, 2023-08-01T19:56:25.437 INFO:teuthology.orchestra.run.smithi008.stdout: { 2023-08-01T19:56:25.437 INFO:teuthology.orchestra.run.smithi008.stdout: "event": "queued_for_pg", 2023-08-01T19:56:25.437 INFO:teuthology.orchestra.run.smithi008.stdout: "time": "2023-08-01T19:55:58.556646+0000", 2023-08-01T19:56:25.438 INFO:teuthology.orchestra.run.smithi008.stdout: "duration": 5.2070000000000003e-06 2023-08-01T19:56:25.438 INFO:teuthology.orchestra.run.smithi008.stdout: }, 2023-08-01T19:56:25.438 INFO:teuthology.orchestra.run.smithi008.stdout: { 2023-08-01T19:56:25.438 INFO:teuthology.orchestra.run.smithi008.stdout: "event": "reached_pg", 2023-08-01T19:56:25.438 INFO:teuthology.orchestra.run.smithi008.stdout: "time": "2023-08-01T19:55:58.558870+0000", 2023-08-01T19:56:25.438 INFO:teuthology.orchestra.run.smithi008.stdout: "duration": 0.0022237730000000001 2023-08-01T19:56:25.438 INFO:teuthology.orchestra.run.smithi008.stdout: }, 2023-08-01T19:56:25.438 INFO:teuthology.orchestra.run.smithi008.stdout: { 2023-08-01T19:56:25.439 INFO:teuthology.orchestra.run.smithi008.stdout: "event": "started", 2023-08-01T19:56:25.439 INFO:teuthology.orchestra.run.smithi008.stdout: "time": "2023-08-01T19:55:58.559013+0000", 2023-08-01T19:56:25.439 INFO:teuthology.orchestra.run.smithi008.stdout: "duration": 0.00014289899999999999 2023-08-01T19:56:25.439 INFO:teuthology.orchestra.run.smithi008.stdout: }, 2023-08-01T19:56:25.439 INFO:teuthology.orchestra.run.smithi008.stdout: { 2023-08-01T19:56:25.439 INFO:teuthology.orchestra.run.smithi008.stdout: "event": "waiting for subops from 1", 2023-08-01T19:56:25.439 INFO:teuthology.orchestra.run.smithi008.stdout: "time": "2023-08-01T19:55:58.559137+0000", 2023-08-01T19:56:25.439 INFO:teuthology.orchestra.run.smithi008.stdout: "duration": 0.00012428499999999999 2023-08-01T19:56:25.440 INFO:teuthology.orchestra.run.smithi008.stdout: }, 2023-08-01T19:56:25.440 INFO:teuthology.orchestra.run.smithi008.stdout: { 2023-08-01T19:56:25.440 INFO:teuthology.orchestra.run.smithi008.stdout: "event": "reached_pg", 2023-08-01T19:56:25.440 INFO:teuthology.orchestra.run.smithi008.stdout: "time": "2023-08-01T19:55:58.567438+0000", 2023-08-01T19:56:25.440 INFO:teuthology.orchestra.run.smithi008.stdout: "duration": 0.0083003190000000004 2023-08-01T19:56:25.440 INFO:teuthology.orchestra.run.smithi008.stdout: }, 2023-08-01T19:56:25.440 INFO:teuthology.orchestra.run.smithi008.stdout: { 2023-08-01T19:56:25.441 INFO:teuthology.orchestra.run.smithi008.stdout: "event": "waiting for peered", 2023-08-01T19:56:25.441 INFO:teuthology.orchestra.run.smithi008.stdout: "time": "2023-08-01T19:55:58.567443+0000", 2023-08-01T19:56:25.441 INFO:teuthology.orchestra.run.smithi008.stdout: "duration": 5.1739999999999999e-06 2023-08-01T19:56:25.441 INFO:teuthology.orchestra.run.smithi008.stdout: }, 2023-08-01T19:56:25.441 INFO:teuthology.orchestra.run.smithi008.stdout: { 2023-08-01T19:56:25.441 INFO:teuthology.orchestra.run.smithi008.stdout: "event": "reached_pg", 2023-08-01T19:56:25.441 INFO:teuthology.orchestra.run.smithi008.stdout: "time": "2023-08-01T19:55:59.619164+0000", 2023-08-01T19:56:25.441 INFO:teuthology.orchestra.run.smithi008.stdout: "duration": 1.0517206750000001 2023-08-01T19:56:25.442 INFO:teuthology.orchestra.run.smithi008.stdout: }, 2023-08-01T19:56:25.442 INFO:teuthology.orchestra.run.smithi008.stdout: { 2023-08-01T19:56:25.442 INFO:teuthology.orchestra.run.smithi008.stdout: "event": "done", 2023-08-01T19:56:25.442 INFO:teuthology.orchestra.run.smithi008.stdout: "time": "2023-08-01T19:55:59.619209+0000", 2023-08-01T19:56:25.442 INFO:teuthology.orchestra.run.smithi008.stdout: "duration": 4.5800000000000002e-05 2023-08-01T19:56:25.442 INFO:teuthology.orchestra.run.smithi008.stdout: } 2023-08-01T19:56:25.442 INFO:teuthology.orchestra.run.smithi008.stdout: ] 2023-08-01T19:56:25.442 INFO:teuthology.orchestra.run.smithi008.stdout: } 2023-08-01T19:56:25.443 INFO:teuthology.orchestra.run.smithi008.stdout: }, 2023-08-01T19:56:25.443 INFO:teuthology.orchestra.run.smithi008.stdout: { 2023-08-01T19:56:25.443 INFO:teuthology.orchestra.run.smithi008.stdout: "description": "osd_op(client.4668.0:197404 5.5 5:a3c9c1bd:::benchmark_data_smithi006_114134_object63743:head [delete] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e61)", 2023-08-01T19:56:25.443 INFO:teuthology.orchestra.run.smithi008.stdout: "initiated_at": "2023-08-01T19:55:58.556653+0000", 2023-08-01T19:56:25.443 INFO:teuthology.orchestra.run.smithi008.stdout: "age": 26.756709058999999, 2023-08-01T19:56:25.443 INFO:teuthology.orchestra.run.smithi008.stdout: "duration": 1.061865576, 2023-08-01T19:56:25.443 INFO:teuthology.orchestra.run.smithi008.stdout: "type_data": { 2023-08-01T19:56:25.443 INFO:teuthology.orchestra.run.smithi008.stdout: "flag_point": "reached pg", 2023-08-01T19:56:25.444 INFO:teuthology.orchestra.run.smithi008.stdout: "client_info": { 2023-08-01T19:56:25.444 INFO:teuthology.orchestra.run.smithi008.stdout: "client": "client.4668", 2023-08-01T19:56:25.444 INFO:teuthology.orchestra.run.smithi008.stdout: "client_addr": "172.21.15.6:0/1709472247", 2023-08-01T19:56:25.444 INFO:teuthology.orchestra.run.smithi008.stdout: "tid": 197404 2023-08-01T19:56:25.444 INFO:teuthology.orchestra.run.smithi008.stdout: }, 2023-08-01T19:56:25.444 INFO:teuthology.orchestra.run.smithi008.stdout: "events": [ 2023-08-01T19:56:25.444 INFO:teuthology.orchestra.run.smithi008.stdout: { 2023-08-01T19:56:25.445 INFO:teuthology.orchestra.run.smithi008.stdout: "event": "initiated", 2023-08-01T19:56:25.445 INFO:teuthology.orchestra.run.smithi008.stdout: "time": "2023-08-01T19:55:58.556653+0000", 2023-08-01T19:56:25.445 INFO:teuthology.orchestra.run.smithi008.stdout: "duration": 0 2023-08-01T19:56:25.445 INFO:teuthology.orchestra.run.smithi008.stdout: }, 2023-08-01T19:56:25.445 INFO:teuthology.orchestra.run.smithi008.stdout: { 2023-08-01T19:56:25.445 INFO:teuthology.orchestra.run.smithi008.stdout: "event": "throttled", 2023-08-01T19:56:25.445 INFO:teuthology.orchestra.run.smithi008.stdout: "time": "2023-08-01T19:55:58.556653+0000", 2023-08-01T19:56:25.445 INFO:teuthology.orchestra.run.smithi008.stdout: "duration": 0 2023-08-01T19:56:25.446 INFO:teuthology.orchestra.run.smithi008.stdout: }, 2023-08-01T19:56:25.446 INFO:teuthology.orchestra.run.smithi008.stdout: { 2023-08-01T19:56:25.446 INFO:teuthology.orchestra.run.smithi008.stdout: "event": "header_read", 2023-08-01T19:56:25.446 INFO:teuthology.orchestra.run.smithi008.stdout: "time": "2023-08-01T19:55:58.556653+0000", 2023-08-01T19:56:25.446 INFO:teuthology.orchestra.run.smithi008.stdout: "duration": 4294967295.9999995 2023-08-01T19:56:25.446 INFO:teuthology.orchestra.run.smithi008.stdout: }, 2023-08-01T19:56:25.446 INFO:teuthology.orchestra.run.smithi008.stdout: { 2023-08-01T19:56:25.446 INFO:teuthology.orchestra.run.smithi008.stdout: "event": "all_read", 2023-08-01T19:56:25.447 INFO:teuthology.orchestra.run.smithi008.stdout: "time": "2023-08-01T19:55:58.556655+0000", 2023-08-01T19:56:25.447 INFO:teuthology.orchestra.run.smithi008.stdout: "duration": 2.435e-06 2023-08-01T19:56:25.447 INFO:teuthology.orchestra.run.smithi008.stdout: }, 2023-08-01T19:56:25.447 INFO:teuthology.orchestra.run.smithi008.stdout: { 2023-08-01T19:56:25.447 INFO:teuthology.orchestra.run.smithi008.stdout: "event": "dispatched", 2023-08-01T19:56:25.447 INFO:teuthology.orchestra.run.smithi008.stdout: "time": "2023-08-01T19:55:58.556661+0000", 2023-08-01T19:56:25.447 INFO:teuthology.orchestra.run.smithi008.stdout: "duration": 6.0599999999999996e-06 2023-08-01T19:56:25.447 INFO:teuthology.orchestra.run.smithi008.stdout: }, 2023-08-01T19:56:25.448 INFO:teuthology.orchestra.run.smithi008.stdout: { 2023-08-01T19:56:25.448 INFO:teuthology.orchestra.run.smithi008.stdout: "event": "queued_for_pg", 2023-08-01T19:56:25.448 INFO:teuthology.orchestra.run.smithi008.stdout: "time": "2023-08-01T19:55:58.556666+0000", 2023-08-01T19:56:25.448 INFO:teuthology.orchestra.run.smithi008.stdout: "duration": 4.9620000000000001e-06 2023-08-01T19:56:25.448 INFO:teuthology.orchestra.run.smithi008.stdout: }, 2023-08-01T19:56:25.448 INFO:teuthology.orchestra.run.smithi008.stdout: { 2023-08-01T19:56:25.448 INFO:teuthology.orchestra.run.smithi008.stdout: "event": "reached_pg", 2023-08-01T19:56:25.449 INFO:teuthology.orchestra.run.smithi008.stdout: "time": "2023-08-01T19:55:58.556698+0000", 2023-08-01T19:56:25.449 INFO:teuthology.orchestra.run.smithi008.stdout: "duration": 3.2302999999999999e-05 2023-08-01T19:56:25.449 INFO:teuthology.orchestra.run.smithi008.stdout: }, 2023-08-01T19:56:25.449 INFO:teuthology.orchestra.run.smithi008.stdout: { 2023-08-01T19:56:25.449 INFO:teuthology.orchestra.run.smithi008.stdout: "event": "started", 2023-08-01T19:56:25.449 INFO:teuthology.orchestra.run.smithi008.stdout: "time": "2023-08-01T19:55:58.556773+0000", 2023-08-01T19:56:25.449 INFO:teuthology.orchestra.run.smithi008.stdout: "duration": 7.4431999999999995e-05 2023-08-01T19:56:25.449 INFO:teuthology.orchestra.run.smithi008.stdout: }, 2023-08-01T19:56:25.450 INFO:teuthology.orchestra.run.smithi008.stdout: { 2023-08-01T19:56:25.450 INFO:teuthology.orchestra.run.smithi008.stdout: "event": "waiting for subops from 1", 2023-08-01T19:56:25.450 INFO:teuthology.orchestra.run.smithi008.stdout: "time": "2023-08-01T19:55:58.556837+0000", 2023-08-01T19:56:25.450 INFO:teuthology.orchestra.run.smithi008.stdout: "duration": 6.4522000000000003e-05 2023-08-01T19:56:25.450 INFO:teuthology.orchestra.run.smithi008.stdout: }, 2023-08-01T19:56:25.450 INFO:teuthology.orchestra.run.smithi008.stdout: { 2023-08-01T19:56:25.450 INFO:teuthology.orchestra.run.smithi008.stdout: "event": "reached_pg", 2023-08-01T19:56:25.450 INFO:teuthology.orchestra.run.smithi008.stdout: "time": "2023-08-01T19:55:58.563930+0000", 2023-08-01T19:56:25.451 INFO:teuthology.orchestra.run.smithi008.stdout: "duration": 0.0070929030000000002 2023-08-01T19:56:25.451 INFO:teuthology.orchestra.run.smithi008.stdout: }, 2023-08-01T19:56:25.451 INFO:teuthology.orchestra.run.smithi008.stdout: { 2023-08-01T19:56:25.451 INFO:teuthology.orchestra.run.smithi008.stdout: "event": "waiting for peered", 2023-08-01T19:56:25.451 INFO:teuthology.orchestra.run.smithi008.stdout: "time": "2023-08-01T19:55:58.563939+0000", 2023-08-01T19:56:25.451 INFO:teuthology.orchestra.run.smithi008.stdout: "duration": 8.6079999999999996e-06 2023-08-01T19:56:25.451 INFO:teuthology.orchestra.run.smithi008.stdout: }, 2023-08-01T19:56:25.451 INFO:teuthology.orchestra.run.smithi008.stdout: { 2023-08-01T19:56:25.452 INFO:teuthology.orchestra.run.smithi008.stdout: "event": "reached_pg", 2023-08-01T19:56:25.452 INFO:teuthology.orchestra.run.smithi008.stdout: "time": "2023-08-01T19:55:59.618422+0000", 2023-08-01T19:56:25.452 INFO:teuthology.orchestra.run.smithi008.stdout: "duration": 1.054483295 2023-08-01T19:56:25.452 INFO:teuthology.orchestra.run.smithi008.stdout: }, 2023-08-01T19:56:25.452 INFO:teuthology.orchestra.run.smithi008.stdout: { 2023-08-01T19:56:25.452 INFO:teuthology.orchestra.run.smithi008.stdout: "event": "done", 2023-08-01T19:56:25.452 INFO:teuthology.orchestra.run.smithi008.stdout: "time": "2023-08-01T19:55:59.618519+0000", 2023-08-01T19:56:25.453 INFO:teuthology.orchestra.run.smithi008.stdout: "duration": 9.6471000000000005e-05 2023-08-01T19:56:25.453 INFO:teuthology.orchestra.run.smithi008.stdout: } 2023-08-01T19:56:25.453 INFO:teuthology.orchestra.run.smithi008.stdout: ] 2023-08-01T19:56:25.453 INFO:teuthology.orchestra.run.smithi008.stdout: } 2023-08-01T19:56:25.453 INFO:teuthology.orchestra.run.smithi008.stdout: }, 2023-08-01T19:56:25.453 INFO:teuthology.orchestra.run.smithi008.stdout: { 2023-08-01T19:56:25.453 INFO:teuthology.orchestra.run.smithi008.stdout: "description": "osd_op(client.4668.0:197407 5.1 5:85528fae:::benchmark_data_smithi006_114134_object63746:head [delete] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e61)", 2023-08-01T19:56:25.453 INFO:teuthology.orchestra.run.smithi008.stdout: "initiated_at": "2023-08-01T19:55:58.559216+0000", 2023-08-01T19:56:25.454 INFO:teuthology.orchestra.run.smithi008.stdout: "age": 26.754146411000001, 2023-08-01T19:56:25.454 INFO:teuthology.orchestra.run.smithi008.stdout: "duration": 1.061802277, 2023-08-01T19:56:25.454 INFO:teuthology.orchestra.run.smithi008.stdout: "type_data": { 2023-08-01T19:56:25.454 INFO:teuthology.orchestra.run.smithi008.stdout: "flag_point": "reached pg", 2023-08-01T19:56:25.454 INFO:teuthology.orchestra.run.smithi008.stdout: "client_info": { 2023-08-01T19:56:25.454 INFO:teuthology.orchestra.run.smithi008.stdout: "client": "client.4668", 2023-08-01T19:56:25.454 INFO:teuthology.orchestra.run.smithi008.stdout: "client_addr": "172.21.15.6:0/1709472247", 2023-08-01T19:56:25.454 INFO:teuthology.orchestra.run.smithi008.stdout: "tid": 197407 2023-08-01T19:56:25.455 INFO:teuthology.orchestra.run.smithi008.stdout: }, 2023-08-01T19:56:25.455 INFO:teuthology.orchestra.run.smithi008.stdout: "events": [ 2023-08-01T19:56:25.455 INFO:teuthology.orchestra.run.smithi008.stdout: { 2023-08-01T19:56:25.455 INFO:teuthology.orchestra.run.smithi008.stdout: "event": "initiated", 2023-08-01T19:56:25.455 INFO:teuthology.orchestra.run.smithi008.stdout: "time": "2023-08-01T19:55:58.559216+0000", 2023-08-01T19:56:25.455 INFO:teuthology.orchestra.run.smithi008.stdout: "duration": 0 2023-08-01T19:56:25.455 INFO:teuthology.orchestra.run.smithi008.stdout: }, 2023-08-01T19:56:25.455 INFO:teuthology.orchestra.run.smithi008.stdout: { 2023-08-01T19:56:25.456 INFO:teuthology.orchestra.run.smithi008.stdout: "event": "throttled", 2023-08-01T19:56:25.456 INFO:teuthology.orchestra.run.smithi008.stdout: "time": "2023-08-01T19:55:58.559216+0000", 2023-08-01T19:56:25.456 INFO:teuthology.orchestra.run.smithi008.stdout: "duration": 0 2023-08-01T19:56:25.456 INFO:teuthology.orchestra.run.smithi008.stdout: }, 2023-08-01T19:56:25.456 INFO:teuthology.orchestra.run.smithi008.stdout: { 2023-08-01T19:56:25.456 INFO:teuthology.orchestra.run.smithi008.stdout: "event": "header_read", 2023-08-01T19:56:25.456 INFO:teuthology.orchestra.run.smithi008.stdout: "time": "2023-08-01T19:55:58.559215+0000", 2023-08-01T19:56:25.456 INFO:teuthology.orchestra.run.smithi008.stdout: "duration": 4294967295.999999 2023-08-01T19:56:25.457 INFO:teuthology.orchestra.run.smithi008.stdout: }, 2023-08-01T19:56:25.457 INFO:teuthology.orchestra.run.smithi008.stdout: { 2023-08-01T19:56:25.457 INFO:teuthology.orchestra.run.smithi008.stdout: "event": "all_read", 2023-08-01T19:56:25.457 INFO:teuthology.orchestra.run.smithi008.stdout: "time": "2023-08-01T19:55:58.559220+0000", 2023-08-01T19:56:25.457 INFO:teuthology.orchestra.run.smithi008.stdout: "duration": 5.3879999999999999e-06 2023-08-01T19:56:25.457 INFO:teuthology.orchestra.run.smithi008.stdout: }, 2023-08-01T19:56:25.457 INFO:teuthology.orchestra.run.smithi008.stdout: { 2023-08-01T19:56:25.457 INFO:teuthology.orchestra.run.smithi008.stdout: "event": "dispatched", 2023-08-01T19:56:25.458 INFO:teuthology.orchestra.run.smithi008.stdout: "time": "2023-08-01T19:55:58.559230+0000", 2023-08-01T19:56:25.458 INFO:teuthology.orchestra.run.smithi008.stdout: "duration": 9.6590000000000002e-06 2023-08-01T19:56:25.458 INFO:teuthology.orchestra.run.smithi008.stdout: }, 2023-08-01T19:56:25.458 INFO:teuthology.orchestra.run.smithi008.stdout: { 2023-08-01T19:56:25.458 INFO:teuthology.orchestra.run.smithi008.stdout: "event": "queued_for_pg", 2023-08-01T19:56:25.458 INFO:teuthology.orchestra.run.smithi008.stdout: "time": "2023-08-01T19:55:58.559235+0000", 2023-08-01T19:56:25.458 INFO:teuthology.orchestra.run.smithi008.stdout: "duration": 5.575e-06 2023-08-01T19:56:25.459 INFO:teuthology.orchestra.run.smithi008.stdout: }, 2023-08-01T19:56:25.459 INFO:teuthology.orchestra.run.smithi008.stdout: { 2023-08-01T19:56:25.459 INFO:teuthology.orchestra.run.smithi008.stdout: "event": "reached_pg", 2023-08-01T19:56:25.459 INFO:teuthology.orchestra.run.smithi008.stdout: "time": "2023-08-01T19:55:58.559279+0000", 2023-08-01T19:56:25.459 INFO:teuthology.orchestra.run.smithi008.stdout: "duration": 4.3273999999999999e-05 2023-08-01T19:56:25.459 INFO:teuthology.orchestra.run.smithi008.stdout: }, 2023-08-01T19:56:25.459 INFO:teuthology.orchestra.run.smithi008.stdout: { 2023-08-01T19:56:25.459 INFO:teuthology.orchestra.run.smithi008.stdout: "event": "started", 2023-08-01T19:56:25.460 INFO:teuthology.orchestra.run.smithi008.stdout: "time": "2023-08-01T19:55:58.559403+0000", 2023-08-01T19:56:25.460 INFO:teuthology.orchestra.run.smithi008.stdout: "duration": 0.000124781 2023-08-01T19:56:25.460 INFO:teuthology.orchestra.run.smithi008.stdout: }, 2023-08-01T19:56:25.460 INFO:teuthology.orchestra.run.smithi008.stdout: { 2023-08-01T19:56:25.460 INFO:teuthology.orchestra.run.smithi008.stdout: "event": "waiting for subops from 1", 2023-08-01T19:56:25.460 INFO:teuthology.orchestra.run.smithi008.stdout: "time": "2023-08-01T19:55:58.559561+0000", 2023-08-01T19:56:25.460 INFO:teuthology.orchestra.run.smithi008.stdout: "duration": 0.000157773 2023-08-01T19:56:25.460 INFO:teuthology.orchestra.run.smithi008.stdout: }, 2023-08-01T19:56:25.461 INFO:teuthology.orchestra.run.smithi008.stdout: { 2023-08-01T19:56:25.461 INFO:teuthology.orchestra.run.smithi008.stdout: "event": "reached_pg", 2023-08-01T19:56:25.461 INFO:teuthology.orchestra.run.smithi008.stdout: "time": "2023-08-01T19:55:58.569498+0000", 2023-08-01T19:56:25.461 INFO:teuthology.orchestra.run.smithi008.stdout: "duration": 0.0099367069999999995 2023-08-01T19:56:25.461 INFO:teuthology.orchestra.run.smithi008.stdout: }, 2023-08-01T19:56:25.461 INFO:teuthology.orchestra.run.smithi008.stdout: { 2023-08-01T19:56:25.461 INFO:teuthology.orchestra.run.smithi008.stdout: "event": "waiting for peered", 2023-08-01T19:56:25.461 INFO:teuthology.orchestra.run.smithi008.stdout: "time": "2023-08-01T19:55:58.569756+0000", 2023-08-01T19:56:25.462 INFO:teuthology.orchestra.run.smithi008.stdout: "duration": 0.00025830800000000001 2023-08-01T19:56:25.462 INFO:teuthology.orchestra.run.smithi008.stdout: }, 2023-08-01T19:56:25.462 INFO:teuthology.orchestra.run.smithi008.stdout: { 2023-08-01T19:56:25.462 INFO:teuthology.orchestra.run.smithi008.stdout: "event": "reached_pg", 2023-08-01T19:56:25.462 INFO:teuthology.orchestra.run.smithi008.stdout: "time": "2023-08-01T19:55:59.620962+0000", 2023-08-01T19:56:25.462 INFO:teuthology.orchestra.run.smithi008.stdout: "duration": 1.0512062129999999 2023-08-01T19:56:25.462 INFO:teuthology.orchestra.run.smithi008.stdout: }, 2023-08-01T19:56:25.462 INFO:teuthology.orchestra.run.smithi008.stdout: { 2023-08-01T19:56:25.463 INFO:teuthology.orchestra.run.smithi008.stdout: "event": "done", 2023-08-01T19:56:25.463 INFO:teuthology.orchestra.run.smithi008.stdout: "time": "2023-08-01T19:55:59.621018+0000", 2023-08-01T19:56:25.463 INFO:teuthology.orchestra.run.smithi008.stdout: "duration": 5.5498999999999998e-05 2023-08-01T19:56:25.463 INFO:teuthology.orchestra.run.smithi008.stdout: } 2023-08-01T19:56:25.463 INFO:teuthology.orchestra.run.smithi008.stdout: ] 2023-08-01T19:56:25.463 INFO:teuthology.orchestra.run.smithi008.stdout: } 2023-08-01T19:56:25.463 INFO:teuthology.orchestra.run.smithi008.stdout: }, 2023-08-01T19:56:25.463 INFO:teuthology.orchestra.run.smithi008.stdout: { 2023-08-01T19:56:25.464 INFO:teuthology.orchestra.run.smithi008.stdout: "description": "osd_op(client.4668.0:197396 5.2 5:43f8487b:::benchmark_data_smithi006_114134_object63735:head [delete] snapc 0=[] RETRY=1 ondisk+retry+write+known_if_redirected+supports_pool_eio e62)", 2023-08-01T19:56:25.464 INFO:teuthology.orchestra.run.smithi008.stdout: "initiated_at": "2023-08-01T19:55:58.564585+0000", 2023-08-01T19:56:25.464 INFO:teuthology.orchestra.run.smithi008.stdout: "age": 26.748777437000001, 2023-08-01T19:56:25.464 INFO:teuthology.orchestra.run.smithi008.stdout: "duration": 1.0535085049999999, 2023-08-01T19:56:25.464 INFO:teuthology.orchestra.run.smithi008.stdout: "type_data": { 2023-08-01T19:56:25.464 INFO:teuthology.orchestra.run.smithi008.stdout: "flag_point": "reached pg", 2023-08-01T19:56:25.464 INFO:teuthology.orchestra.run.smithi008.stdout: "client_info": { 2023-08-01T19:56:25.465 INFO:teuthology.orchestra.run.smithi008.stdout: "client": "client.4668", 2023-08-01T19:56:25.465 INFO:teuthology.orchestra.run.smithi008.stdout: "client_addr": "172.21.15.6:0/1709472247", 2023-08-01T19:56:25.465 INFO:teuthology.orchestra.run.smithi008.stdout: "tid": 197396 2023-08-01T19:56:25.465 INFO:teuthology.orchestra.run.smithi008.stdout: }, 2023-08-01T19:56:25.465 INFO:teuthology.orchestra.run.smithi008.stdout: "events": [ 2023-08-01T19:56:25.465 INFO:teuthology.orchestra.run.smithi008.stdout: { 2023-08-01T19:56:25.465 INFO:teuthology.orchestra.run.smithi008.stdout: "event": "initiated", 2023-08-01T19:56:25.465 INFO:teuthology.orchestra.run.smithi008.stdout: "time": "2023-08-01T19:55:58.564585+0000", 2023-08-01T19:56:25.466 INFO:teuthology.orchestra.run.smithi008.stdout: "duration": 0 2023-08-01T19:56:25.466 INFO:teuthology.orchestra.run.smithi008.stdout: }, 2023-08-01T19:56:25.466 INFO:teuthology.orchestra.run.smithi008.stdout: { 2023-08-01T19:56:25.466 INFO:teuthology.orchestra.run.smithi008.stdout: "event": "throttled", 2023-08-01T19:56:25.466 INFO:teuthology.orchestra.run.smithi008.stdout: "time": "2023-08-01T19:55:58.564585+0000", 2023-08-01T19:56:25.466 INFO:teuthology.orchestra.run.smithi008.stdout: "duration": 0 2023-08-01T19:56:25.466 INFO:teuthology.orchestra.run.smithi008.stdout: }, 2023-08-01T19:56:25.466 INFO:teuthology.orchestra.run.smithi008.stdout: { 2023-08-01T19:56:25.467 INFO:teuthology.orchestra.run.smithi008.stdout: "event": "header_read", 2023-08-01T19:56:25.467 INFO:teuthology.orchestra.run.smithi008.stdout: "time": "2023-08-01T19:55:58.564583+0000", 2023-08-01T19:56:25.467 INFO:teuthology.orchestra.run.smithi008.stdout: "duration": 4294967295.9999981 2023-08-01T19:56:25.467 INFO:teuthology.orchestra.run.smithi008.stdout: }, 2023-08-01T19:56:25.467 INFO:teuthology.orchestra.run.smithi008.stdout: { 2023-08-01T19:56:25.467 INFO:teuthology.orchestra.run.smithi008.stdout: "event": "all_read", 2023-08-01T19:56:25.467 INFO:teuthology.orchestra.run.smithi008.stdout: "time": "2023-08-01T19:55:58.564591+0000", 2023-08-01T19:56:25.467 INFO:teuthology.orchestra.run.smithi008.stdout: "duration": 8.2169999999999994e-06 2023-08-01T19:56:25.468 INFO:teuthology.orchestra.run.smithi008.stdout: }, 2023-08-01T19:56:25.468 INFO:teuthology.orchestra.run.smithi008.stdout: { 2023-08-01T19:56:25.468 INFO:teuthology.orchestra.run.smithi008.stdout: "event": "dispatched", 2023-08-01T19:56:25.468 INFO:teuthology.orchestra.run.smithi008.stdout: "time": "2023-08-01T19:55:58.564603+0000", 2023-08-01T19:56:25.468 INFO:teuthology.orchestra.run.smithi008.stdout: "duration": 1.186e-05 2023-08-01T19:56:25.468 INFO:teuthology.orchestra.run.smithi008.stdout: }, 2023-08-01T19:56:25.468 INFO:teuthology.orchestra.run.smithi008.stdout: { 2023-08-01T19:56:25.469 INFO:teuthology.orchestra.run.smithi008.stdout: "event": "queued_for_pg", 2023-08-01T19:56:25.469 INFO:teuthology.orchestra.run.smithi008.stdout: "time": "2023-08-01T19:55:58.564609+0000", 2023-08-01T19:56:25.469 INFO:teuthology.orchestra.run.smithi008.stdout: "duration": 6.4130000000000003e-06 2023-08-01T19:56:25.469 INFO:teuthology.orchestra.run.smithi008.stdout: }, 2023-08-01T19:56:25.469 INFO:teuthology.orchestra.run.smithi008.stdout: { 2023-08-01T19:56:25.469 INFO:teuthology.orchestra.run.smithi008.stdout: "event": "reached_pg", 2023-08-01T19:56:25.469 INFO:teuthology.orchestra.run.smithi008.stdout: "time": "2023-08-01T19:55:58.573439+0000", 2023-08-01T19:56:25.469 INFO:teuthology.orchestra.run.smithi008.stdout: "duration": 0.0088303310000000003 2023-08-01T19:56:25.470 INFO:teuthology.orchestra.run.smithi008.stdout: }, 2023-08-01T19:56:25.470 INFO:teuthology.orchestra.run.smithi008.stdout: { 2023-08-01T19:56:25.470 INFO:teuthology.orchestra.run.smithi008.stdout: "event": "waiting for peered", 2023-08-01T19:56:25.470 INFO:teuthology.orchestra.run.smithi008.stdout: "time": "2023-08-01T19:55:58.573448+0000", 2023-08-01T19:56:25.470 INFO:teuthology.orchestra.run.smithi008.stdout: "duration": 8.2910000000000007e-06 2023-08-01T19:56:25.470 INFO:teuthology.orchestra.run.smithi008.stdout: }, 2023-08-01T19:56:25.470 INFO:teuthology.orchestra.run.smithi008.stdout: { 2023-08-01T19:56:25.470 INFO:teuthology.orchestra.run.smithi008.stdout: "event": "reached_pg", 2023-08-01T19:56:25.471 INFO:teuthology.orchestra.run.smithi008.stdout: "time": "2023-08-01T19:55:59.617892+0000", 2023-08-01T19:56:25.471 INFO:teuthology.orchestra.run.smithi008.stdout: "duration": 1.0444446380000001 2023-08-01T19:56:25.471 INFO:teuthology.orchestra.run.smithi008.stdout: }, 2023-08-01T19:56:25.471 INFO:teuthology.orchestra.run.smithi008.stdout: { 2023-08-01T19:56:25.471 INFO:teuthology.orchestra.run.smithi008.stdout: "event": "done", 2023-08-01T19:56:25.471 INFO:teuthology.orchestra.run.smithi008.stdout: "time": "2023-08-01T19:55:59.618093+0000", 2023-08-01T19:56:25.471 INFO:teuthology.orchestra.run.smithi008.stdout: "duration": 0.00020066300000000001 2023-08-01T19:56:25.471 INFO:teuthology.orchestra.run.smithi008.stdout: } 2023-08-01T19:56:25.472 INFO:teuthology.orchestra.run.smithi008.stdout: ] 2023-08-01T19:56:25.472 INFO:teuthology.orchestra.run.smithi008.stdout: } 2023-08-01T19:56:25.472 INFO:teuthology.orchestra.run.smithi008.stdout: }, 2023-08-01T19:56:25.472 INFO:teuthology.orchestra.run.smithi008.stdout: { 2023-08-01T19:56:25.472 INFO:teuthology.orchestra.run.smithi008.stdout: "description": "osd_op(client.4668.0:197411 5.7 5:ebefbc20:::benchmark_data_smithi006_114134_object63750:head [delete] snapc 0=[] RETRY=1 ondisk+retry+write+known_if_redirected+supports_pool_eio e62)", 2023-08-01T19:56:25.472 INFO:teuthology.orchestra.run.smithi008.stdout: "initiated_at": "2023-08-01T19:55:58.564619+0000", 2023-08-01T19:56:25.472 INFO:teuthology.orchestra.run.smithi008.stdout: "age": 26.748742761999999, 2023-08-01T19:56:25.472 INFO:teuthology.orchestra.run.smithi008.stdout: "duration": 1.0686062569999999, 2023-08-01T19:56:25.473 INFO:teuthology.orchestra.run.smithi008.stdout: "type_data": { 2023-08-01T19:56:25.473 INFO:teuthology.orchestra.run.smithi008.stdout: "flag_point": "commit sent; apply or cleanup", 2023-08-01T19:56:25.473 INFO:teuthology.orchestra.run.smithi008.stdout: "client_info": { 2023-08-01T19:56:25.473 INFO:teuthology.orchestra.run.smithi008.stdout: "client": "client.4668", 2023-08-01T19:56:25.473 INFO:teuthology.orchestra.run.smithi008.stdout: "client_addr": "172.21.15.6:0/1709472247", 2023-08-01T19:56:25.473 INFO:teuthology.orchestra.run.smithi008.stdout: "tid": 197411 2023-08-01T19:56:25.473 INFO:teuthology.orchestra.run.smithi008.stdout: }, 2023-08-01T19:56:25.473 INFO:teuthology.orchestra.run.smithi008.stdout: "events": [ 2023-08-01T19:56:25.474 INFO:teuthology.orchestra.run.smithi008.stdout: { 2023-08-01T19:56:25.474 INFO:teuthology.orchestra.run.smithi008.stdout: "event": "initiated", 2023-08-01T19:56:25.474 INFO:teuthology.orchestra.run.smithi008.stdout: "time": "2023-08-01T19:55:58.564619+0000", 2023-08-01T19:56:25.474 INFO:teuthology.orchestra.run.smithi008.stdout: "duration": 0 2023-08-01T19:56:25.474 INFO:teuthology.orchestra.run.smithi008.stdout: }, 2023-08-01T19:56:25.474 INFO:teuthology.orchestra.run.smithi008.stdout: { 2023-08-01T19:56:25.474 INFO:teuthology.orchestra.run.smithi008.stdout: "event": "throttled", 2023-08-01T19:56:25.475 INFO:teuthology.orchestra.run.smithi008.stdout: "time": "2023-08-01T19:55:58.564619+0000", 2023-08-01T19:56:25.475 INFO:teuthology.orchestra.run.smithi008.stdout: "duration": 0 2023-08-01T19:56:25.475 INFO:teuthology.orchestra.run.smithi008.stdout: }, 2023-08-01T19:56:25.475 INFO:teuthology.orchestra.run.smithi008.stdout: { 2023-08-01T19:56:25.475 INFO:teuthology.orchestra.run.smithi008.stdout: "event": "header_read", 2023-08-01T19:56:25.475 INFO:teuthology.orchestra.run.smithi008.stdout: "time": "2023-08-01T19:55:58.564619+0000", 2023-08-01T19:56:25.475 INFO:teuthology.orchestra.run.smithi008.stdout: "duration": 4294967295.9999995 2023-08-01T19:56:25.475 INFO:teuthology.orchestra.run.smithi008.stdout: }, 2023-08-01T19:56:25.476 INFO:teuthology.orchestra.run.smithi008.stdout: { 2023-08-01T19:56:25.476 INFO:teuthology.orchestra.run.smithi008.stdout: "event": "all_read", 2023-08-01T19:56:25.476 INFO:teuthology.orchestra.run.smithi008.stdout: "time": "2023-08-01T19:55:58.564621+0000", 2023-08-01T19:56:25.476 INFO:teuthology.orchestra.run.smithi008.stdout: "duration": 2.6139999999999999e-06 2023-08-01T19:56:25.476 INFO:teuthology.orchestra.run.smithi008.stdout: }, 2023-08-01T19:56:25.476 INFO:teuthology.orchestra.run.smithi008.stdout: { 2023-08-01T19:56:25.476 INFO:teuthology.orchestra.run.smithi008.stdout: "event": "dispatched", 2023-08-01T19:56:25.476 INFO:teuthology.orchestra.run.smithi008.stdout: "time": "2023-08-01T19:55:58.564627+0000", 2023-08-01T19:56:25.477 INFO:teuthology.orchestra.run.smithi008.stdout: "duration": 5.1150000000000002e-06 2023-08-01T19:56:25.477 INFO:teuthology.orchestra.run.smithi008.stdout: }, 2023-08-01T19:56:25.477 INFO:teuthology.orchestra.run.smithi008.stdout: { 2023-08-01T19:56:25.477 INFO:teuthology.orchestra.run.smithi008.stdout: "event": "queued_for_pg", 2023-08-01T19:56:25.477 INFO:teuthology.orchestra.run.smithi008.stdout: "time": "2023-08-01T19:55:58.564631+0000", 2023-08-01T19:56:25.477 INFO:teuthology.orchestra.run.smithi008.stdout: "duration": 4.702e-06 2023-08-01T19:56:25.477 INFO:teuthology.orchestra.run.smithi008.stdout: }, 2023-08-01T19:56:25.478 INFO:teuthology.orchestra.run.smithi008.stdout: { 2023-08-01T19:56:25.478 INFO:teuthology.orchestra.run.smithi008.stdout: "event": "reached_pg", 2023-08-01T19:56:25.478 INFO:teuthology.orchestra.run.smithi008.stdout: "time": "2023-08-01T19:55:58.565520+0000", 2023-08-01T19:56:25.478 INFO:teuthology.orchestra.run.smithi008.stdout: "duration": 0.00088893399999999997 2023-08-01T19:56:25.478 INFO:teuthology.orchestra.run.smithi008.stdout: }, 2023-08-01T19:56:25.478 INFO:teuthology.orchestra.run.smithi008.stdout: { 2023-08-01T19:56:25.478 INFO:teuthology.orchestra.run.smithi008.stdout: "event": "waiting for peered", 2023-08-01T19:56:25.478 INFO:teuthology.orchestra.run.smithi008.stdout: "time": "2023-08-01T19:55:58.565528+0000", 2023-08-01T19:56:25.479 INFO:teuthology.orchestra.run.smithi008.stdout: "duration": 7.5410000000000003e-06 2023-08-01T19:56:25.479 INFO:teuthology.orchestra.run.smithi008.stdout: }, 2023-08-01T19:56:25.479 INFO:teuthology.orchestra.run.smithi008.stdout: { 2023-08-01T19:56:25.479 INFO:teuthology.orchestra.run.smithi008.stdout: "event": "reached_pg", 2023-08-01T19:56:25.479 INFO:teuthology.orchestra.run.smithi008.stdout: "time": "2023-08-01T19:55:59.622374+0000", 2023-08-01T19:56:25.479 INFO:teuthology.orchestra.run.smithi008.stdout: "duration": 1.05684588 2023-08-01T19:56:25.479 INFO:teuthology.orchestra.run.smithi008.stdout: }, 2023-08-01T19:56:25.479 INFO:teuthology.orchestra.run.smithi008.stdout: { 2023-08-01T19:56:25.480 INFO:teuthology.orchestra.run.smithi008.stdout: "event": "started", 2023-08-01T19:56:25.480 INFO:teuthology.orchestra.run.smithi008.stdout: "time": "2023-08-01T19:55:59.624156+0000", 2023-08-01T19:56:25.480 INFO:teuthology.orchestra.run.smithi008.stdout: "duration": 0.0017826129999999999 2023-08-01T19:56:25.480 INFO:teuthology.orchestra.run.smithi008.stdout: }, 2023-08-01T19:56:25.480 INFO:teuthology.orchestra.run.smithi008.stdout: { 2023-08-01T19:56:25.480 INFO:teuthology.orchestra.run.smithi008.stdout: "event": "op_commit", 2023-08-01T19:56:25.480 INFO:teuthology.orchestra.run.smithi008.stdout: "time": "2023-08-01T19:55:59.633131+0000", 2023-08-01T19:56:25.481 INFO:teuthology.orchestra.run.smithi008.stdout: "duration": 0.0089745740000000008 2023-08-01T19:56:25.481 INFO:teuthology.orchestra.run.smithi008.stdout: }, 2023-08-01T19:56:25.481 INFO:teuthology.orchestra.run.smithi008.stdout: { 2023-08-01T19:56:25.481 INFO:teuthology.orchestra.run.smithi008.stdout: "event": "commit_sent", 2023-08-01T19:56:25.481 INFO:teuthology.orchestra.run.smithi008.stdout: "time": "2023-08-01T19:55:59.633173+0000", 2023-08-01T19:56:25.481 INFO:teuthology.orchestra.run.smithi008.stdout: "duration": 4.2645000000000003e-05 2023-08-01T19:56:25.481 INFO:teuthology.orchestra.run.smithi008.stdout: }, 2023-08-01T19:56:25.481 INFO:teuthology.orchestra.run.smithi008.stdout: { 2023-08-01T19:56:25.482 INFO:teuthology.orchestra.run.smithi008.stdout: "event": "done", 2023-08-01T19:56:25.482 INFO:teuthology.orchestra.run.smithi008.stdout: "time": "2023-08-01T19:55:59.633225+0000", 2023-08-01T19:56:25.482 INFO:teuthology.orchestra.run.smithi008.stdout: "duration": 5.2003999999999999e-05 2023-08-01T19:56:25.482 INFO:teuthology.orchestra.run.smithi008.stdout: } 2023-08-01T19:56:25.482 INFO:teuthology.orchestra.run.smithi008.stdout: ] 2023-08-01T19:56:25.482 INFO:teuthology.orchestra.run.smithi008.stdout: } 2023-08-01T19:56:25.482 INFO:teuthology.orchestra.run.smithi008.stdout: }, 2023-08-01T19:56:25.482 INFO:teuthology.orchestra.run.smithi008.stdout: { 2023-08-01T19:56:25.483 INFO:teuthology.orchestra.run.smithi008.stdout: "description": "osd_op(client.4668.0:197413 5.5 5:a6ff9d8a:::benchmark_data_smithi006_114134_object63752:head [delete] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e62)", 2023-08-01T19:56:25.483 INFO:teuthology.orchestra.run.smithi008.stdout: "initiated_at": "2023-08-01T19:55:58.573778+0000", 2023-08-01T19:56:25.483 INFO:teuthology.orchestra.run.smithi008.stdout: "age": 26.739583796000002, 2023-08-01T19:56:25.483 INFO:teuthology.orchestra.run.smithi008.stdout: "duration": 1.054781371, 2023-08-01T19:56:25.483 INFO:teuthology.orchestra.run.smithi008.stdout: "type_data": { 2023-08-01T19:56:25.483 INFO:teuthology.orchestra.run.smithi008.stdout: "flag_point": "commit sent; apply or cleanup", 2023-08-01T19:56:25.483 INFO:teuthology.orchestra.run.smithi008.stdout: "client_info": { 2023-08-01T19:56:25.483 INFO:teuthology.orchestra.run.smithi008.stdout: "client": "client.4668", 2023-08-01T19:56:25.484 INFO:teuthology.orchestra.run.smithi008.stdout: "client_addr": "172.21.15.6:0/1709472247", 2023-08-01T19:56:25.484 INFO:teuthology.orchestra.run.smithi008.stdout: "tid": 197413 2023-08-01T19:56:25.484 INFO:teuthology.orchestra.run.smithi008.stdout: }, 2023-08-01T19:56:25.484 INFO:teuthology.orchestra.run.smithi008.stdout: "events": [ 2023-08-01T19:56:25.484 INFO:teuthology.orchestra.run.smithi008.stdout: { 2023-08-01T19:56:25.484 INFO:teuthology.orchestra.run.smithi008.stdout: "event": "initiated", 2023-08-01T19:56:25.484 INFO:teuthology.orchestra.run.smithi008.stdout: "time": "2023-08-01T19:55:58.573778+0000", 2023-08-01T19:56:25.484 INFO:teuthology.orchestra.run.smithi008.stdout: "duration": 0 2023-08-01T19:56:25.485 INFO:teuthology.orchestra.run.smithi008.stdout: }, 2023-08-01T19:56:25.485 INFO:teuthology.orchestra.run.smithi008.stdout: { 2023-08-01T19:56:25.485 INFO:teuthology.orchestra.run.smithi008.stdout: "event": "throttled", 2023-08-01T19:56:25.485 INFO:teuthology.orchestra.run.smithi008.stdout: "time": "2023-08-01T19:55:58.573778+0000", 2023-08-01T19:56:25.485 INFO:teuthology.orchestra.run.smithi008.stdout: "duration": 0 2023-08-01T19:56:25.485 INFO:teuthology.orchestra.run.smithi008.stdout: }, 2023-08-01T19:56:25.485 INFO:teuthology.orchestra.run.smithi008.stdout: { 2023-08-01T19:56:25.485 INFO:teuthology.orchestra.run.smithi008.stdout: "event": "header_read", 2023-08-01T19:56:25.486 INFO:teuthology.orchestra.run.smithi008.stdout: "time": "2023-08-01T19:55:58.573776+0000", 2023-08-01T19:56:25.486 INFO:teuthology.orchestra.run.smithi008.stdout: "duration": 4294967295.9999981 2023-08-01T19:56:25.486 INFO:teuthology.orchestra.run.smithi008.stdout: }, 2023-08-01T19:56:25.486 INFO:teuthology.orchestra.run.smithi008.stdout: { 2023-08-01T19:56:25.486 INFO:teuthology.orchestra.run.smithi008.stdout: "event": "all_read", 2023-08-01T19:56:25.486 INFO:teuthology.orchestra.run.smithi008.stdout: "time": "2023-08-01T19:55:58.573784+0000", 2023-08-01T19:56:25.486 INFO:teuthology.orchestra.run.smithi008.stdout: "duration": 8.2490000000000001e-06 2023-08-01T19:56:25.486 INFO:teuthology.orchestra.run.smithi008.stdout: }, 2023-08-01T19:56:25.487 INFO:teuthology.orchestra.run.smithi008.stdout: { 2023-08-01T19:56:25.487 INFO:teuthology.orchestra.run.smithi008.stdout: "event": "dispatched", 2023-08-01T19:56:25.487 INFO:teuthology.orchestra.run.smithi008.stdout: "time": "2023-08-01T19:55:58.574230+0000", 2023-08-01T19:56:25.487 INFO:teuthology.orchestra.run.smithi008.stdout: "duration": 0.00044558400000000001 2023-08-01T19:56:25.487 INFO:teuthology.orchestra.run.smithi008.stdout: }, 2023-08-01T19:56:25.487 INFO:teuthology.orchestra.run.smithi008.stdout: { 2023-08-01T19:56:25.487 INFO:teuthology.orchestra.run.smithi008.stdout: "event": "queued_for_pg", 2023-08-01T19:56:25.488 INFO:teuthology.orchestra.run.smithi008.stdout: "time": "2023-08-01T19:55:58.574240+0000", 2023-08-01T19:56:25.488 INFO:teuthology.orchestra.run.smithi008.stdout: "duration": 9.7699999999999996e-06 2023-08-01T19:56:25.488 INFO:teuthology.orchestra.run.smithi008.stdout: }, 2023-08-01T19:56:25.488 INFO:teuthology.orchestra.run.smithi008.stdout: { 2023-08-01T19:56:25.488 INFO:teuthology.orchestra.run.smithi008.stdout: "event": "reached_pg", 2023-08-01T19:56:25.488 INFO:teuthology.orchestra.run.smithi008.stdout: "time": "2023-08-01T19:55:58.574292+0000", 2023-08-01T19:56:25.488 INFO:teuthology.orchestra.run.smithi008.stdout: "duration": 5.2101000000000001e-05 2023-08-01T19:56:25.488 INFO:teuthology.orchestra.run.smithi008.stdout: }, 2023-08-01T19:56:25.489 INFO:teuthology.orchestra.run.smithi008.stdout: { 2023-08-01T19:56:25.489 INFO:teuthology.orchestra.run.smithi008.stdout: "event": "waiting for peered", 2023-08-01T19:56:25.489 INFO:teuthology.orchestra.run.smithi008.stdout: "time": "2023-08-01T19:55:58.574299+0000", 2023-08-01T19:56:25.489 INFO:teuthology.orchestra.run.smithi008.stdout: "duration": 7.3420000000000002e-06 2023-08-01T19:56:25.489 INFO:teuthology.orchestra.run.smithi008.stdout: }, 2023-08-01T19:56:25.489 INFO:teuthology.orchestra.run.smithi008.stdout: { 2023-08-01T19:56:25.489 INFO:teuthology.orchestra.run.smithi008.stdout: "event": "reached_pg", 2023-08-01T19:56:25.489 INFO:teuthology.orchestra.run.smithi008.stdout: "time": "2023-08-01T19:55:59.618545+0000", 2023-08-01T19:56:25.490 INFO:teuthology.orchestra.run.smithi008.stdout: "duration": 1.044245922 2023-08-01T19:56:25.490 INFO:teuthology.orchestra.run.smithi008.stdout: }, 2023-08-01T19:56:25.490 INFO:teuthology.orchestra.run.smithi008.stdout: { 2023-08-01T19:56:25.490 INFO:teuthology.orchestra.run.smithi008.stdout: "event": "started", 2023-08-01T19:56:25.490 INFO:teuthology.orchestra.run.smithi008.stdout: "time": "2023-08-01T19:55:59.618855+0000", 2023-08-01T19:56:25.490 INFO:teuthology.orchestra.run.smithi008.stdout: "duration": 0.00030964099999999999 2023-08-01T19:56:25.490 INFO:teuthology.orchestra.run.smithi008.stdout: }, 2023-08-01T19:56:25.490 INFO:teuthology.orchestra.run.smithi008.stdout: { 2023-08-01T19:56:25.491 INFO:teuthology.orchestra.run.smithi008.stdout: "event": "op_commit", 2023-08-01T19:56:25.491 INFO:teuthology.orchestra.run.smithi008.stdout: "time": "2023-08-01T19:55:59.628438+0000", 2023-08-01T19:56:25.491 INFO:teuthology.orchestra.run.smithi008.stdout: "duration": 0.0095832939999999991 2023-08-01T19:56:25.491 INFO:teuthology.orchestra.run.smithi008.stdout: }, 2023-08-01T19:56:25.491 INFO:teuthology.orchestra.run.smithi008.stdout: { 2023-08-01T19:56:25.491 INFO:teuthology.orchestra.run.smithi008.stdout: "event": "commit_sent", 2023-08-01T19:56:25.491 INFO:teuthology.orchestra.run.smithi008.stdout: "time": "2023-08-01T19:55:59.628479+0000", 2023-08-01T19:56:25.492 INFO:teuthology.orchestra.run.smithi008.stdout: "duration": 4.1350000000000002e-05 2023-08-01T19:56:25.492 INFO:teuthology.orchestra.run.smithi008.stdout: }, 2023-08-01T19:56:25.492 INFO:teuthology.orchestra.run.smithi008.stdout: { 2023-08-01T19:56:25.492 INFO:teuthology.orchestra.run.smithi008.stdout: "event": "done", 2023-08-01T19:56:25.492 INFO:teuthology.orchestra.run.smithi008.stdout: "time": "2023-08-01T19:55:59.628560+0000", 2023-08-01T19:56:25.492 INFO:teuthology.orchestra.run.smithi008.stdout: "duration": 8.0080999999999994e-05 2023-08-01T19:56:25.492 INFO:teuthology.orchestra.run.smithi008.stdout: } 2023-08-01T19:56:25.492 INFO:teuthology.orchestra.run.smithi008.stdout: ] 2023-08-01T19:56:25.493 INFO:teuthology.orchestra.run.smithi008.stdout: } 2023-08-01T19:56:25.493 INFO:teuthology.orchestra.run.smithi008.stdout: }, 2023-08-01T19:56:25.493 INFO:teuthology.orchestra.run.smithi008.stdout: { 2023-08-01T19:56:25.493 INFO:teuthology.orchestra.run.smithi008.stdout: "description": "osd_op(client.4668.0:197415 5.c 5:3e539c01:::benchmark_data_smithi006_114134_object63754:head [delete] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e62)", 2023-08-01T19:56:25.493 INFO:teuthology.orchestra.run.smithi008.stdout: "initiated_at": "2023-08-01T19:55:58.577434+0000", 2023-08-01T19:56:25.493 INFO:teuthology.orchestra.run.smithi008.stdout: "age": 26.735928039000001, 2023-08-01T19:56:25.493 INFO:teuthology.orchestra.run.smithi008.stdout: "duration": 1.0520807059999999, 2023-08-01T19:56:25.493 INFO:teuthology.orchestra.run.smithi008.stdout: "type_data": { 2023-08-01T19:56:25.494 INFO:teuthology.orchestra.run.smithi008.stdout: "flag_point": "commit sent; apply or cleanup", 2023-08-01T19:56:25.494 INFO:teuthology.orchestra.run.smithi008.stdout: "client_info": { 2023-08-01T19:56:25.494 INFO:teuthology.orchestra.run.smithi008.stdout: "client": "client.4668", 2023-08-01T19:56:25.494 INFO:teuthology.orchestra.run.smithi008.stdout: "client_addr": "172.21.15.6:0/1709472247", 2023-08-01T19:56:25.494 INFO:teuthology.orchestra.run.smithi008.stdout: "tid": 197415 2023-08-01T19:56:25.494 INFO:teuthology.orchestra.run.smithi008.stdout: }, 2023-08-01T19:56:25.494 INFO:teuthology.orchestra.run.smithi008.stdout: "events": [ 2023-08-01T19:56:25.494 INFO:teuthology.orchestra.run.smithi008.stdout: { 2023-08-01T19:56:25.495 INFO:teuthology.orchestra.run.smithi008.stdout: "event": "initiated", 2023-08-01T19:56:25.495 INFO:teuthology.orchestra.run.smithi008.stdout: "time": "2023-08-01T19:55:58.577434+0000", 2023-08-01T19:56:25.495 INFO:teuthology.orchestra.run.smithi008.stdout: "duration": 0 2023-08-01T19:56:25.495 INFO:teuthology.orchestra.run.smithi008.stdout: }, 2023-08-01T19:56:25.495 INFO:teuthology.orchestra.run.smithi008.stdout: { 2023-08-01T19:56:25.495 INFO:teuthology.orchestra.run.smithi008.stdout: "event": "throttled", 2023-08-01T19:56:25.495 INFO:teuthology.orchestra.run.smithi008.stdout: "time": "2023-08-01T19:55:58.577434+0000", 2023-08-01T19:56:25.495 INFO:teuthology.orchestra.run.smithi008.stdout: "duration": 0 2023-08-01T19:56:25.496 INFO:teuthology.orchestra.run.smithi008.stdout: }, 2023-08-01T19:56:25.496 INFO:teuthology.orchestra.run.smithi008.stdout: { 2023-08-01T19:56:25.496 INFO:teuthology.orchestra.run.smithi008.stdout: "event": "header_read", 2023-08-01T19:56:25.496 INFO:teuthology.orchestra.run.smithi008.stdout: "time": "2023-08-01T19:55:58.577432+0000", 2023-08-01T19:56:25.496 INFO:teuthology.orchestra.run.smithi008.stdout: "duration": 4294967295.9999986 2023-08-01T19:56:25.496 INFO:teuthology.orchestra.run.smithi008.stdout: }, 2023-08-01T19:56:25.496 INFO:teuthology.orchestra.run.smithi008.stdout: { 2023-08-01T19:56:25.497 INFO:teuthology.orchestra.run.smithi008.stdout: "event": "all_read", 2023-08-01T19:56:25.497 INFO:teuthology.orchestra.run.smithi008.stdout: "time": "2023-08-01T19:55:58.577440+0000", 2023-08-01T19:56:25.497 INFO:teuthology.orchestra.run.smithi008.stdout: "duration": 7.5480000000000004e-06 2023-08-01T19:56:25.497 INFO:teuthology.orchestra.run.smithi008.stdout: }, 2023-08-01T19:56:25.497 INFO:teuthology.orchestra.run.smithi008.stdout: { 2023-08-01T19:56:25.497 INFO:teuthology.orchestra.run.smithi008.stdout: "event": "dispatched", 2023-08-01T19:56:25.497 INFO:teuthology.orchestra.run.smithi008.stdout: "time": "2023-08-01T19:55:58.577454+0000", 2023-08-01T19:56:25.497 INFO:teuthology.orchestra.run.smithi008.stdout: "duration": 1.4216000000000001e-05 2023-08-01T19:56:25.498 INFO:teuthology.orchestra.run.smithi008.stdout: }, 2023-08-01T19:56:25.498 INFO:teuthology.orchestra.run.smithi008.stdout: { 2023-08-01T19:56:25.498 INFO:teuthology.orchestra.run.smithi008.stdout: "event": "queued_for_pg", 2023-08-01T19:56:25.498 INFO:teuthology.orchestra.run.smithi008.stdout: "time": "2023-08-01T19:55:58.577463+0000", 2023-08-01T19:56:25.498 INFO:teuthology.orchestra.run.smithi008.stdout: "duration": 8.2900000000000002e-06 2023-08-01T19:56:25.498 INFO:teuthology.orchestra.run.smithi008.stdout: }, 2023-08-01T19:56:25.498 INFO:teuthology.orchestra.run.smithi008.stdout: { 2023-08-01T19:56:25.498 INFO:teuthology.orchestra.run.smithi008.stdout: "event": "reached_pg", 2023-08-01T19:56:25.499 INFO:teuthology.orchestra.run.smithi008.stdout: "time": "2023-08-01T19:55:58.577498+0000", 2023-08-01T19:56:25.499 INFO:teuthology.orchestra.run.smithi008.stdout: "duration": 3.5302000000000002e-05 2023-08-01T19:56:25.499 INFO:teuthology.orchestra.run.smithi008.stdout: }, 2023-08-01T19:56:25.499 INFO:teuthology.orchestra.run.smithi008.stdout: { 2023-08-01T19:56:25.499 INFO:teuthology.orchestra.run.smithi008.stdout: "event": "waiting for peered", 2023-08-01T19:56:25.499 INFO:teuthology.orchestra.run.smithi008.stdout: "time": "2023-08-01T19:55:58.577503+0000", 2023-08-01T19:56:25.499 INFO:teuthology.orchestra.run.smithi008.stdout: "duration": 4.8409999999999999e-06 2023-08-01T19:56:25.499 INFO:teuthology.orchestra.run.smithi008.stdout: }, 2023-08-01T19:56:25.500 INFO:teuthology.orchestra.run.smithi008.stdout: { 2023-08-01T19:56:25.500 INFO:teuthology.orchestra.run.smithi008.stdout: "event": "reached_pg", 2023-08-01T19:56:25.500 INFO:teuthology.orchestra.run.smithi008.stdout: "time": "2023-08-01T19:55:59.619229+0000", 2023-08-01T19:56:25.500 INFO:teuthology.orchestra.run.smithi008.stdout: "duration": 1.041726119 2023-08-01T19:56:25.500 INFO:teuthology.orchestra.run.smithi008.stdout: }, 2023-08-01T19:56:25.500 INFO:teuthology.orchestra.run.smithi008.stdout: { 2023-08-01T19:56:25.500 INFO:teuthology.orchestra.run.smithi008.stdout: "event": "started", 2023-08-01T19:56:25.500 INFO:teuthology.orchestra.run.smithi008.stdout: "time": "2023-08-01T19:55:59.619326+0000", 2023-08-01T19:56:25.501 INFO:teuthology.orchestra.run.smithi008.stdout: "duration": 9.7044000000000001e-05 2023-08-01T19:56:25.501 INFO:teuthology.orchestra.run.smithi008.stdout: }, 2023-08-01T19:56:25.501 INFO:teuthology.orchestra.run.smithi008.stdout: { 2023-08-01T19:56:25.501 INFO:teuthology.orchestra.run.smithi008.stdout: "event": "op_commit", 2023-08-01T19:56:25.501 INFO:teuthology.orchestra.run.smithi008.stdout: "time": "2023-08-01T19:55:59.629399+0000", 2023-08-01T19:56:25.501 INFO:teuthology.orchestra.run.smithi008.stdout: "duration": 0.010073014 2023-08-01T19:56:25.501 INFO:teuthology.orchestra.run.smithi008.stdout: }, 2023-08-01T19:56:25.502 INFO:teuthology.orchestra.run.smithi008.stdout: { 2023-08-01T19:56:25.502 INFO:teuthology.orchestra.run.smithi008.stdout: "event": "commit_sent", 2023-08-01T19:56:25.502 INFO:teuthology.orchestra.run.smithi008.stdout: "time": "2023-08-01T19:55:59.629443+0000", 2023-08-01T19:56:25.502 INFO:teuthology.orchestra.run.smithi008.stdout: "duration": 4.3739999999999998e-05 2023-08-01T19:56:25.502 INFO:teuthology.orchestra.run.smithi008.stdout: }, 2023-08-01T19:56:25.502 INFO:teuthology.orchestra.run.smithi008.stdout: { 2023-08-01T19:56:25.502 INFO:teuthology.orchestra.run.smithi008.stdout: "event": "done", 2023-08-01T19:56:25.502 INFO:teuthology.orchestra.run.smithi008.stdout: "time": "2023-08-01T19:55:59.629515+0000", 2023-08-01T19:56:25.503 INFO:teuthology.orchestra.run.smithi008.stdout: "duration": 7.2089999999999996e-05 2023-08-01T19:56:25.503 INFO:teuthology.orchestra.run.smithi008.stdout: } 2023-08-01T19:56:25.503 INFO:teuthology.orchestra.run.smithi008.stdout: ] 2023-08-01T19:56:25.503 INFO:teuthology.orchestra.run.smithi008.stdout: } 2023-08-01T19:56:25.503 INFO:teuthology.orchestra.run.smithi008.stdout: }, 2023-08-01T19:56:25.503 INFO:teuthology.orchestra.run.smithi008.stdout: { 2023-08-01T19:56:25.503 INFO:teuthology.orchestra.run.smithi008.stdout: "description": "osd_op(client.4668.0:197417 5.7 5:eb36cb7d:::benchmark_data_smithi006_114134_object63756:head [delete] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e62)", 2023-08-01T19:56:25.503 INFO:teuthology.orchestra.run.smithi008.stdout: "initiated_at": "2023-08-01T19:55:58.578162+0000", 2023-08-01T19:56:25.504 INFO:teuthology.orchestra.run.smithi008.stdout: "age": 26.735199741999999, 2023-08-01T19:56:25.504 INFO:teuthology.orchestra.run.smithi008.stdout: "duration": 1.0582469299999999, 2023-08-01T19:56:25.504 INFO:teuthology.orchestra.run.smithi008.stdout: "type_data": { 2023-08-01T19:56:25.504 INFO:teuthology.orchestra.run.smithi008.stdout: "flag_point": "commit sent; apply or cleanup", 2023-08-01T19:56:25.504 INFO:teuthology.orchestra.run.smithi008.stdout: "client_info": { 2023-08-01T19:56:25.504 INFO:teuthology.orchestra.run.smithi008.stdout: "client": "client.4668", 2023-08-01T19:56:25.504 INFO:teuthology.orchestra.run.smithi008.stdout: "client_addr": "172.21.15.6:0/1709472247", 2023-08-01T19:56:25.504 INFO:teuthology.orchestra.run.smithi008.stdout: "tid": 197417 2023-08-01T19:56:25.505 INFO:teuthology.orchestra.run.smithi008.stdout: }, 2023-08-01T19:56:25.505 INFO:teuthology.orchestra.run.smithi008.stdout: "events": [ 2023-08-01T19:56:25.505 INFO:teuthology.orchestra.run.smithi008.stdout: { 2023-08-01T19:56:25.505 INFO:teuthology.orchestra.run.smithi008.stdout: "event": "initiated", 2023-08-01T19:56:25.505 INFO:teuthology.orchestra.run.smithi008.stdout: "time": "2023-08-01T19:55:58.578162+0000", 2023-08-01T19:56:25.505 INFO:teuthology.orchestra.run.smithi008.stdout: "duration": 0 2023-08-01T19:56:25.505 INFO:teuthology.orchestra.run.smithi008.stdout: }, 2023-08-01T19:56:25.505 INFO:teuthology.orchestra.run.smithi008.stdout: { 2023-08-01T19:56:25.506 INFO:teuthology.orchestra.run.smithi008.stdout: "event": "throttled", 2023-08-01T19:56:25.506 INFO:teuthology.orchestra.run.smithi008.stdout: "time": "2023-08-01T19:55:58.578162+0000", 2023-08-01T19:56:25.506 INFO:teuthology.orchestra.run.smithi008.stdout: "duration": 0 2023-08-01T19:56:25.506 INFO:teuthology.orchestra.run.smithi008.stdout: }, 2023-08-01T19:56:25.506 INFO:teuthology.orchestra.run.smithi008.stdout: { 2023-08-01T19:56:25.506 INFO:teuthology.orchestra.run.smithi008.stdout: "event": "header_read", 2023-08-01T19:56:25.506 INFO:teuthology.orchestra.run.smithi008.stdout: "time": "2023-08-01T19:55:58.578161+0000", 2023-08-01T19:56:25.506 INFO:teuthology.orchestra.run.smithi008.stdout: "duration": 4294967295.999999 2023-08-01T19:56:25.507 INFO:teuthology.orchestra.run.smithi008.stdout: }, 2023-08-01T19:56:25.507 INFO:teuthology.orchestra.run.smithi008.stdout: { 2023-08-01T19:56:25.507 INFO:teuthology.orchestra.run.smithi008.stdout: "event": "all_read", 2023-08-01T19:56:25.507 INFO:teuthology.orchestra.run.smithi008.stdout: "time": "2023-08-01T19:55:58.578166+0000", 2023-08-01T19:56:25.507 INFO:teuthology.orchestra.run.smithi008.stdout: "duration": 4.6589999999999998e-06 2023-08-01T19:56:25.507 INFO:teuthology.orchestra.run.smithi008.stdout: }, 2023-08-01T19:56:25.507 INFO:teuthology.orchestra.run.smithi008.stdout: { 2023-08-01T19:56:25.508 INFO:teuthology.orchestra.run.smithi008.stdout: "event": "dispatched", 2023-08-01T19:56:25.508 INFO:teuthology.orchestra.run.smithi008.stdout: "time": "2023-08-01T19:55:58.578177+0000", 2023-08-01T19:56:25.508 INFO:teuthology.orchestra.run.smithi008.stdout: "duration": 1.0512e-05 2023-08-01T19:56:25.508 INFO:teuthology.orchestra.run.smithi008.stdout: }, 2023-08-01T19:56:25.508 INFO:teuthology.orchestra.run.smithi008.stdout: { 2023-08-01T19:56:25.508 INFO:teuthology.orchestra.run.smithi008.stdout: "event": "queued_for_pg", 2023-08-01T19:56:25.508 INFO:teuthology.orchestra.run.smithi008.stdout: "time": "2023-08-01T19:55:58.578182+0000", 2023-08-01T19:56:25.508 INFO:teuthology.orchestra.run.smithi008.stdout: "duration": 5.6540000000000004e-06 2023-08-01T19:56:25.509 INFO:teuthology.orchestra.run.smithi008.stdout: }, 2023-08-01T19:56:25.509 INFO:teuthology.orchestra.run.smithi008.stdout: { 2023-08-01T19:56:25.509 INFO:teuthology.orchestra.run.smithi008.stdout: "event": "reached_pg", 2023-08-01T19:56:25.509 INFO:teuthology.orchestra.run.smithi008.stdout: "time": "2023-08-01T19:55:58.578221+0000", 2023-08-01T19:56:25.509 INFO:teuthology.orchestra.run.smithi008.stdout: "duration": 3.8764999999999999e-05 2023-08-01T19:56:25.509 INFO:teuthology.orchestra.run.smithi008.stdout: }, 2023-08-01T19:56:25.509 INFO:teuthology.orchestra.run.smithi008.stdout: { 2023-08-01T19:56:25.509 INFO:teuthology.orchestra.run.smithi008.stdout: "event": "waiting for peered", 2023-08-01T19:56:25.510 INFO:teuthology.orchestra.run.smithi008.stdout: "time": "2023-08-01T19:55:58.578226+0000", 2023-08-01T19:56:25.510 INFO:teuthology.orchestra.run.smithi008.stdout: "duration": 4.6319999999999999e-06 2023-08-01T19:56:25.510 INFO:teuthology.orchestra.run.smithi008.stdout: }, 2023-08-01T19:56:25.510 INFO:teuthology.orchestra.run.smithi008.stdout: { 2023-08-01T19:56:25.510 INFO:teuthology.orchestra.run.smithi008.stdout: "event": "reached_pg", 2023-08-01T19:56:25.510 INFO:teuthology.orchestra.run.smithi008.stdout: "time": "2023-08-01T19:55:59.628027+0000", 2023-08-01T19:56:25.510 INFO:teuthology.orchestra.run.smithi008.stdout: "duration": 1.049801261 2023-08-01T19:56:25.510 INFO:teuthology.orchestra.run.smithi008.stdout: }, 2023-08-01T19:56:25.511 INFO:teuthology.orchestra.run.smithi008.stdout: { 2023-08-01T19:56:25.511 INFO:teuthology.orchestra.run.smithi008.stdout: "event": "started", 2023-08-01T19:56:25.511 INFO:teuthology.orchestra.run.smithi008.stdout: "time": "2023-08-01T19:55:59.628156+0000", 2023-08-01T19:56:25.511 INFO:teuthology.orchestra.run.smithi008.stdout: "duration": 0.00012906899999999999 2023-08-01T19:56:25.511 INFO:teuthology.orchestra.run.smithi008.stdout: }, 2023-08-01T19:56:25.511 INFO:teuthology.orchestra.run.smithi008.stdout: { 2023-08-01T19:56:25.511 INFO:teuthology.orchestra.run.smithi008.stdout: "event": "op_commit", 2023-08-01T19:56:25.511 INFO:teuthology.orchestra.run.smithi008.stdout: "time": "2023-08-01T19:55:59.636292+0000", 2023-08-01T19:56:25.512 INFO:teuthology.orchestra.run.smithi008.stdout: "duration": 0.0081362859999999995 2023-08-01T19:56:25.512 INFO:teuthology.orchestra.run.smithi008.stdout: }, 2023-08-01T19:56:25.512 INFO:teuthology.orchestra.run.smithi008.stdout: { 2023-08-01T19:56:25.512 INFO:teuthology.orchestra.run.smithi008.stdout: "event": "commit_sent", 2023-08-01T19:56:25.512 INFO:teuthology.orchestra.run.smithi008.stdout: "time": "2023-08-01T19:55:59.636343+0000", 2023-08-01T19:56:25.512 INFO:teuthology.orchestra.run.smithi008.stdout: "duration": 5.0603000000000003e-05 2023-08-01T19:56:25.512 INFO:teuthology.orchestra.run.smithi008.stdout: }, 2023-08-01T19:56:25.513 INFO:teuthology.orchestra.run.smithi008.stdout: { 2023-08-01T19:56:25.513 INFO:teuthology.orchestra.run.smithi008.stdout: "event": "done", 2023-08-01T19:56:25.513 INFO:teuthology.orchestra.run.smithi008.stdout: "time": "2023-08-01T19:55:59.636409+0000", 2023-08-01T19:56:25.513 INFO:teuthology.orchestra.run.smithi008.stdout: "duration": 6.6353999999999995e-05 2023-08-01T19:56:25.513 INFO:teuthology.orchestra.run.smithi008.stdout: } 2023-08-01T19:56:25.513 INFO:teuthology.orchestra.run.smithi008.stdout: ] 2023-08-01T19:56:25.513 INFO:teuthology.orchestra.run.smithi008.stdout: } 2023-08-01T19:56:25.513 INFO:teuthology.orchestra.run.smithi008.stdout: }, 2023-08-01T19:56:25.514 INFO:teuthology.orchestra.run.smithi008.stdout: { 2023-08-01T19:56:25.514 INFO:teuthology.orchestra.run.smithi008.stdout: "description": "osd_op(client.4668.0:197418 5.2 5:4ba84ab7:::benchmark_data_smithi006_114134_object63757:head [delete] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e62)", 2023-08-01T19:56:25.514 INFO:teuthology.orchestra.run.smithi008.stdout: "initiated_at": "2023-08-01T19:55:58.580297+0000", 2023-08-01T19:56:25.514 INFO:teuthology.orchestra.run.smithi008.stdout: "age": 26.733065389, 2023-08-01T19:56:25.514 INFO:teuthology.orchestra.run.smithi008.stdout: "duration": 1.0529485839999999, 2023-08-01T19:56:25.514 INFO:teuthology.orchestra.run.smithi008.stdout: "type_data": { 2023-08-01T19:56:25.514 INFO:teuthology.orchestra.run.smithi008.stdout: "flag_point": "commit sent; apply or cleanup", 2023-08-01T19:56:25.515 INFO:teuthology.orchestra.run.smithi008.stdout: "client_info": { 2023-08-01T19:56:25.515 INFO:teuthology.orchestra.run.smithi008.stdout: "client": "client.4668", 2023-08-01T19:56:25.515 INFO:teuthology.orchestra.run.smithi008.stdout: "client_addr": "172.21.15.6:0/1709472247", 2023-08-01T19:56:25.515 INFO:teuthology.orchestra.run.smithi008.stdout: "tid": 197418 2023-08-01T19:56:25.515 INFO:teuthology.orchestra.run.smithi008.stdout: }, 2023-08-01T19:56:25.515 INFO:teuthology.orchestra.run.smithi008.stdout: "events": [ 2023-08-01T19:56:25.515 INFO:teuthology.orchestra.run.smithi008.stdout: { 2023-08-01T19:56:25.515 INFO:teuthology.orchestra.run.smithi008.stdout: "event": "initiated", 2023-08-01T19:56:25.516 INFO:teuthology.orchestra.run.smithi008.stdout: "time": "2023-08-01T19:55:58.580297+0000", 2023-08-01T19:56:25.516 INFO:teuthology.orchestra.run.smithi008.stdout: "duration": 0 2023-08-01T19:56:25.516 INFO:teuthology.orchestra.run.smithi008.stdout: }, 2023-08-01T19:56:25.516 INFO:teuthology.orchestra.run.smithi008.stdout: { 2023-08-01T19:56:25.516 INFO:teuthology.orchestra.run.smithi008.stdout: "event": "throttled", 2023-08-01T19:56:25.516 INFO:teuthology.orchestra.run.smithi008.stdout: "time": "2023-08-01T19:55:58.580297+0000", 2023-08-01T19:56:25.516 INFO:teuthology.orchestra.run.smithi008.stdout: "duration": 0 2023-08-01T19:56:25.516 INFO:teuthology.orchestra.run.smithi008.stdout: }, 2023-08-01T19:56:25.517 INFO:teuthology.orchestra.run.smithi008.stdout: { 2023-08-01T19:56:25.517 INFO:teuthology.orchestra.run.smithi008.stdout: "event": "header_read", 2023-08-01T19:56:25.517 INFO:teuthology.orchestra.run.smithi008.stdout: "time": "2023-08-01T19:55:58.580296+0000", 2023-08-01T19:56:25.517 INFO:teuthology.orchestra.run.smithi008.stdout: "duration": 4294967295.999999 2023-08-01T19:56:25.517 INFO:teuthology.orchestra.run.smithi008.stdout: }, 2023-08-01T19:56:25.517 INFO:teuthology.orchestra.run.smithi008.stdout: { 2023-08-01T19:56:25.517 INFO:teuthology.orchestra.run.smithi008.stdout: "event": "all_read", 2023-08-01T19:56:25.517 INFO:teuthology.orchestra.run.smithi008.stdout: "time": "2023-08-01T19:55:58.580302+0000", 2023-08-01T19:56:25.518 INFO:teuthology.orchestra.run.smithi008.stdout: "duration": 6.032e-06 2023-08-01T19:56:25.518 INFO:teuthology.orchestra.run.smithi008.stdout: }, 2023-08-01T19:56:25.518 INFO:teuthology.orchestra.run.smithi008.stdout: { 2023-08-01T19:56:25.518 INFO:teuthology.orchestra.run.smithi008.stdout: "event": "dispatched", 2023-08-01T19:56:25.518 INFO:teuthology.orchestra.run.smithi008.stdout: "time": "2023-08-01T19:55:58.580315+0000", 2023-08-01T19:56:25.518 INFO:teuthology.orchestra.run.smithi008.stdout: "duration": 1.327e-05 2023-08-01T19:56:25.518 INFO:teuthology.orchestra.run.smithi008.stdout: }, 2023-08-01T19:56:25.518 INFO:teuthology.orchestra.run.smithi008.stdout: { 2023-08-01T19:56:25.519 INFO:teuthology.orchestra.run.smithi008.stdout: "event": "queued_for_pg", 2023-08-01T19:56:25.519 INFO:teuthology.orchestra.run.smithi008.stdout: "time": "2023-08-01T19:55:58.580321+0000", 2023-08-01T19:56:25.519 INFO:teuthology.orchestra.run.smithi008.stdout: "duration": 6.3980000000000004e-06 2023-08-01T19:56:25.519 INFO:teuthology.orchestra.run.smithi008.stdout: }, 2023-08-01T19:56:25.519 INFO:teuthology.orchestra.run.smithi008.stdout: { 2023-08-01T19:56:25.519 INFO:teuthology.orchestra.run.smithi008.stdout: "event": "reached_pg", 2023-08-01T19:56:25.519 INFO:teuthology.orchestra.run.smithi008.stdout: "time": "2023-08-01T19:55:58.580372+0000", 2023-08-01T19:56:25.519 INFO:teuthology.orchestra.run.smithi008.stdout: "duration": 5.0219000000000001e-05 2023-08-01T19:56:25.520 INFO:teuthology.orchestra.run.smithi008.stdout: }, 2023-08-01T19:56:25.520 INFO:teuthology.orchestra.run.smithi008.stdout: { 2023-08-01T19:56:25.520 INFO:teuthology.orchestra.run.smithi008.stdout: "event": "waiting for peered", 2023-08-01T19:56:25.520 INFO:teuthology.orchestra.run.smithi008.stdout: "time": "2023-08-01T19:55:58.580378+0000", 2023-08-01T19:56:25.520 INFO:teuthology.orchestra.run.smithi008.stdout: "duration": 6.6529999999999997e-06 2023-08-01T19:56:25.520 INFO:teuthology.orchestra.run.smithi008.stdout: }, 2023-08-01T19:56:25.520 INFO:teuthology.orchestra.run.smithi008.stdout: { 2023-08-01T19:56:25.521 INFO:teuthology.orchestra.run.smithi008.stdout: "event": "reached_pg", 2023-08-01T19:56:25.521 INFO:teuthology.orchestra.run.smithi008.stdout: "time": "2023-08-01T19:55:59.618188+0000", 2023-08-01T19:56:25.521 INFO:teuthology.orchestra.run.smithi008.stdout: "duration": 1.037810267 2023-08-01T19:56:25.521 INFO:teuthology.orchestra.run.smithi008.stdout: }, 2023-08-01T19:56:25.521 INFO:teuthology.orchestra.run.smithi008.stdout: { 2023-08-01T19:56:25.521 INFO:teuthology.orchestra.run.smithi008.stdout: "event": "started", 2023-08-01T19:56:25.521 INFO:teuthology.orchestra.run.smithi008.stdout: "time": "2023-08-01T19:55:59.618308+0000", 2023-08-01T19:56:25.521 INFO:teuthology.orchestra.run.smithi008.stdout: "duration": 0.00011959 2023-08-01T19:56:25.522 INFO:teuthology.orchestra.run.smithi008.stdout: }, 2023-08-01T19:56:25.522 INFO:teuthology.orchestra.run.smithi008.stdout: { 2023-08-01T19:56:25.522 INFO:teuthology.orchestra.run.smithi008.stdout: "event": "op_commit", 2023-08-01T19:56:25.522 INFO:teuthology.orchestra.run.smithi008.stdout: "time": "2023-08-01T19:55:59.633122+0000", 2023-08-01T19:56:25.522 INFO:teuthology.orchestra.run.smithi008.stdout: "duration": 0.014814280000000001 2023-08-01T19:56:25.522 INFO:teuthology.orchestra.run.smithi008.stdout: }, 2023-08-01T19:56:25.522 INFO:teuthology.orchestra.run.smithi008.stdout: { 2023-08-01T19:56:25.522 INFO:teuthology.orchestra.run.smithi008.stdout: "event": "commit_sent", 2023-08-01T19:56:25.523 INFO:teuthology.orchestra.run.smithi008.stdout: "time": "2023-08-01T19:55:59.633167+0000", 2023-08-01T19:56:25.523 INFO:teuthology.orchestra.run.smithi008.stdout: "duration": 4.4651999999999999e-05 2023-08-01T19:56:25.523 INFO:teuthology.orchestra.run.smithi008.stdout: }, 2023-08-01T19:56:25.523 INFO:teuthology.orchestra.run.smithi008.stdout: { 2023-08-01T19:56:25.523 INFO:teuthology.orchestra.run.smithi008.stdout: "event": "done", 2023-08-01T19:56:25.523 INFO:teuthology.orchestra.run.smithi008.stdout: "time": "2023-08-01T19:55:59.633245+0000", 2023-08-01T19:56:25.523 INFO:teuthology.orchestra.run.smithi008.stdout: "duration": 7.8215999999999998e-05 2023-08-01T19:56:25.523 INFO:teuthology.orchestra.run.smithi008.stdout: } 2023-08-01T19:56:25.524 INFO:teuthology.orchestra.run.smithi008.stdout: ] 2023-08-01T19:56:25.524 INFO:teuthology.orchestra.run.smithi008.stdout: } 2023-08-01T19:56:25.524 INFO:teuthology.orchestra.run.smithi008.stdout: } 2023-08-01T19:56:25.524 INFO:teuthology.orchestra.run.smithi008.stdout: ] 2023-08-01T19:56:25.524 INFO:teuthology.orchestra.run.smithi008.stdout:} 2023-08-01T19:56:25.525 DEBUG:teuthology.orchestra.run.smithi155:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 30 ceph --cluster ceph --admin-daemon /var/run/ceph/ceph-osd.2.asok dump_ops_in_flight 2023-08-01T19:56:25.526 INFO:tasks.ceph.osd.0.smithi008.stderr:2023-08-01T19:56:25.524+0000 7f16a58f4700 -1 received signal: Hangup from /usr/bin/python3 /bin/daemon-helper kill ceph-osd -f --cluster ceph -i 0 (PID: 111179) UID: 0 2023-08-01T19:56:25.625 INFO:tasks.ceph.osd.2.smithi155.stderr:2023-08-01T19:56:25.624+0000 7faa5c6ac700 -1 received signal: Hangup from /usr/bin/python3 /bin/daemon-helper kill ceph-osd -f --cluster ceph -i 2 (PID: 111337) UID: 0 2023-08-01T19:56:25.679 INFO:teuthology.orchestra.run.smithi155.stdout:{ 2023-08-01T19:56:25.679 INFO:teuthology.orchestra.run.smithi155.stdout: "ops": [ 2023-08-01T19:56:25.680 INFO:teuthology.orchestra.run.smithi155.stdout: { 2023-08-01T19:56:25.680 INFO:teuthology.orchestra.run.smithi155.stdout: "description": "osd_op(client.4668.0:249003 5.0 5:0909ab91:::benchmark_data_smithi006_114134_object115342:head [delete] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e74)", 2023-08-01T19:56:25.680 INFO:teuthology.orchestra.run.smithi155.stdout: "initiated_at": "2023-08-01T19:56:25.670541+0000", 2023-08-01T19:56:25.680 INFO:teuthology.orchestra.run.smithi155.stdout: "age": 0.0081494129999999994, 2023-08-01T19:56:25.680 INFO:teuthology.orchestra.run.smithi155.stdout: "duration": 0.0081680999999999993, 2023-08-01T19:56:25.680 INFO:teuthology.orchestra.run.smithi155.stdout: "type_data": { 2023-08-01T19:56:25.680 INFO:teuthology.orchestra.run.smithi155.stdout: "flag_point": "waiting for sub ops", 2023-08-01T19:56:25.681 INFO:teuthology.orchestra.run.smithi155.stdout: "client_info": { 2023-08-01T19:56:25.681 INFO:teuthology.orchestra.run.smithi155.stdout: "client": "client.4668", 2023-08-01T19:56:25.681 INFO:teuthology.orchestra.run.smithi155.stdout: "client_addr": "172.21.15.6:0/1709472247", 2023-08-01T19:56:25.681 INFO:teuthology.orchestra.run.smithi155.stdout: "tid": 249003 2023-08-01T19:56:25.681 INFO:teuthology.orchestra.run.smithi155.stdout: }, 2023-08-01T19:56:25.681 INFO:teuthology.orchestra.run.smithi155.stdout: "events": [ 2023-08-01T19:56:25.681 INFO:teuthology.orchestra.run.smithi155.stdout: { 2023-08-01T19:56:25.681 INFO:teuthology.orchestra.run.smithi155.stdout: "event": "initiated", 2023-08-01T19:56:25.682 INFO:teuthology.orchestra.run.smithi155.stdout: "time": "2023-08-01T19:56:25.670541+0000", 2023-08-01T19:56:25.682 INFO:teuthology.orchestra.run.smithi155.stdout: "duration": 0 2023-08-01T19:56:25.682 INFO:teuthology.orchestra.run.smithi155.stdout: }, 2023-08-01T19:56:25.682 INFO:teuthology.orchestra.run.smithi155.stdout: { 2023-08-01T19:56:25.682 INFO:teuthology.orchestra.run.smithi155.stdout: "event": "throttled", 2023-08-01T19:56:25.682 INFO:teuthology.orchestra.run.smithi155.stdout: "time": "2023-08-01T19:56:25.670541+0000", 2023-08-01T19:56:25.682 INFO:teuthology.orchestra.run.smithi155.stdout: "duration": 0 2023-08-01T19:56:25.682 INFO:teuthology.orchestra.run.smithi155.stdout: }, 2023-08-01T19:56:25.683 INFO:teuthology.orchestra.run.smithi155.stdout: { 2023-08-01T19:56:25.683 INFO:teuthology.orchestra.run.smithi155.stdout: "event": "header_read", 2023-08-01T19:56:25.683 INFO:teuthology.orchestra.run.smithi155.stdout: "time": "2023-08-01T19:56:25.670540+0000", 2023-08-01T19:56:25.683 INFO:teuthology.orchestra.run.smithi155.stdout: "duration": 4294967295.999999 2023-08-01T19:56:25.683 INFO:teuthology.orchestra.run.smithi155.stdout: }, 2023-08-01T19:56:25.683 INFO:teuthology.orchestra.run.smithi155.stdout: { 2023-08-01T19:56:25.683 INFO:teuthology.orchestra.run.smithi155.stdout: "event": "all_read", 2023-08-01T19:56:25.683 INFO:teuthology.orchestra.run.smithi155.stdout: "time": "2023-08-01T19:56:25.670544+0000", 2023-08-01T19:56:25.684 INFO:teuthology.orchestra.run.smithi155.stdout: "duration": 3.8530000000000002e-06 2023-08-01T19:56:25.684 INFO:teuthology.orchestra.run.smithi155.stdout: }, 2023-08-01T19:56:25.684 INFO:teuthology.orchestra.run.smithi155.stdout: { 2023-08-01T19:56:25.684 INFO:teuthology.orchestra.run.smithi155.stdout: "event": "dispatched", 2023-08-01T19:56:25.684 INFO:teuthology.orchestra.run.smithi155.stdout: "time": "2023-08-01T19:56:25.670552+0000", 2023-08-01T19:56:25.684 INFO:teuthology.orchestra.run.smithi155.stdout: "duration": 8.2740000000000007e-06 2023-08-01T19:56:25.684 INFO:teuthology.orchestra.run.smithi155.stdout: }, 2023-08-01T19:56:25.685 INFO:teuthology.orchestra.run.smithi155.stdout: { 2023-08-01T19:56:25.685 INFO:teuthology.orchestra.run.smithi155.stdout: "event": "queued_for_pg", 2023-08-01T19:56:25.685 INFO:teuthology.orchestra.run.smithi155.stdout: "time": "2023-08-01T19:56:25.670563+0000", 2023-08-01T19:56:25.685 INFO:teuthology.orchestra.run.smithi155.stdout: "duration": 1.0494e-05 2023-08-01T19:56:25.685 INFO:teuthology.orchestra.run.smithi155.stdout: }, 2023-08-01T19:56:25.685 INFO:teuthology.orchestra.run.smithi155.stdout: { 2023-08-01T19:56:25.685 INFO:teuthology.orchestra.run.smithi155.stdout: "event": "reached_pg", 2023-08-01T19:56:25.685 INFO:teuthology.orchestra.run.smithi155.stdout: "time": "2023-08-01T19:56:25.670590+0000", 2023-08-01T19:56:25.686 INFO:teuthology.orchestra.run.smithi155.stdout: "duration": 2.7467e-05 2023-08-01T19:56:25.686 INFO:teuthology.orchestra.run.smithi155.stdout: }, 2023-08-01T19:56:25.686 INFO:teuthology.orchestra.run.smithi155.stdout: { 2023-08-01T19:56:25.686 INFO:teuthology.orchestra.run.smithi155.stdout: "event": "started", 2023-08-01T19:56:25.686 INFO:teuthology.orchestra.run.smithi155.stdout: "time": "2023-08-01T19:56:25.670668+0000", 2023-08-01T19:56:25.686 INFO:teuthology.orchestra.run.smithi155.stdout: "duration": 7.7862999999999996e-05 2023-08-01T19:56:25.686 INFO:teuthology.orchestra.run.smithi155.stdout: }, 2023-08-01T19:56:25.686 INFO:teuthology.orchestra.run.smithi155.stdout: { 2023-08-01T19:56:25.687 INFO:teuthology.orchestra.run.smithi155.stdout: "event": "waiting for subops from 0", 2023-08-01T19:56:25.687 INFO:teuthology.orchestra.run.smithi155.stdout: "time": "2023-08-01T19:56:25.670733+0000", 2023-08-01T19:56:25.687 INFO:teuthology.orchestra.run.smithi155.stdout: "duration": 6.4924000000000004e-05 2023-08-01T19:56:25.687 INFO:teuthology.orchestra.run.smithi155.stdout: }, 2023-08-01T19:56:25.687 INFO:teuthology.orchestra.run.smithi155.stdout: { 2023-08-01T19:56:25.687 INFO:teuthology.orchestra.run.smithi155.stdout: "event": "op_commit", 2023-08-01T19:56:25.687 INFO:teuthology.orchestra.run.smithi155.stdout: "time": "2023-08-01T19:56:25.674035+0000", 2023-08-01T19:56:25.687 INFO:teuthology.orchestra.run.smithi155.stdout: "duration": 0.003301834 2023-08-01T19:56:25.688 INFO:teuthology.orchestra.run.smithi155.stdout: } 2023-08-01T19:56:25.688 INFO:teuthology.orchestra.run.smithi155.stdout: ] 2023-08-01T19:56:25.688 INFO:teuthology.orchestra.run.smithi155.stdout: } 2023-08-01T19:56:25.688 INFO:teuthology.orchestra.run.smithi155.stdout: }, 2023-08-01T19:56:25.688 INFO:teuthology.orchestra.run.smithi155.stdout: { 2023-08-01T19:56:25.688 INFO:teuthology.orchestra.run.smithi155.stdout: "description": "osd_op(client.4668.0:249007 5.0 5:02a9f58b:::benchmark_data_smithi006_114134_object115346:head [delete] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e74)", 2023-08-01T19:56:25.688 INFO:teuthology.orchestra.run.smithi155.stdout: "initiated_at": "2023-08-01T19:56:25.672302+0000", 2023-08-01T19:56:25.689 INFO:teuthology.orchestra.run.smithi155.stdout: "age": 0.0063876430000000001, 2023-08-01T19:56:25.689 INFO:teuthology.orchestra.run.smithi155.stdout: "duration": 0.0064605790000000001, 2023-08-01T19:56:25.689 INFO:teuthology.orchestra.run.smithi155.stdout: "type_data": { 2023-08-01T19:56:25.689 INFO:teuthology.orchestra.run.smithi155.stdout: "flag_point": "waiting for sub ops", 2023-08-01T19:56:25.689 INFO:teuthology.orchestra.run.smithi155.stdout: "client_info": { 2023-08-01T19:56:25.689 INFO:teuthology.orchestra.run.smithi155.stdout: "client": "client.4668", 2023-08-01T19:56:25.689 INFO:teuthology.orchestra.run.smithi155.stdout: "client_addr": "172.21.15.6:0/1709472247", 2023-08-01T19:56:25.689 INFO:teuthology.orchestra.run.smithi155.stdout: "tid": 249007 2023-08-01T19:56:25.690 INFO:teuthology.orchestra.run.smithi155.stdout: }, 2023-08-01T19:56:25.690 INFO:teuthology.orchestra.run.smithi155.stdout: "events": [ 2023-08-01T19:56:25.690 INFO:teuthology.orchestra.run.smithi155.stdout: { 2023-08-01T19:56:25.690 INFO:teuthology.orchestra.run.smithi155.stdout: "event": "initiated", 2023-08-01T19:56:25.690 INFO:teuthology.orchestra.run.smithi155.stdout: "time": "2023-08-01T19:56:25.672302+0000", 2023-08-01T19:56:25.690 INFO:teuthology.orchestra.run.smithi155.stdout: "duration": 0 2023-08-01T19:56:25.690 INFO:teuthology.orchestra.run.smithi155.stdout: }, 2023-08-01T19:56:25.690 INFO:teuthology.orchestra.run.smithi155.stdout: { 2023-08-01T19:56:25.691 INFO:teuthology.orchestra.run.smithi155.stdout: "event": "throttled", 2023-08-01T19:56:25.691 INFO:teuthology.orchestra.run.smithi155.stdout: "time": "2023-08-01T19:56:25.672302+0000", 2023-08-01T19:56:25.691 INFO:teuthology.orchestra.run.smithi155.stdout: "duration": 0 2023-08-01T19:56:25.691 INFO:teuthology.orchestra.run.smithi155.stdout: }, 2023-08-01T19:56:25.691 INFO:teuthology.orchestra.run.smithi155.stdout: { 2023-08-01T19:56:25.691 INFO:teuthology.orchestra.run.smithi155.stdout: "event": "header_read", 2023-08-01T19:56:25.691 INFO:teuthology.orchestra.run.smithi155.stdout: "time": "2023-08-01T19:56:25.672302+0000", 2023-08-01T19:56:25.691 INFO:teuthology.orchestra.run.smithi155.stdout: "duration": 4294967295.9999995 2023-08-01T19:56:25.692 INFO:teuthology.orchestra.run.smithi155.stdout: }, 2023-08-01T19:56:25.692 INFO:teuthology.orchestra.run.smithi155.stdout: { 2023-08-01T19:56:25.692 INFO:teuthology.orchestra.run.smithi155.stdout: "event": "all_read", 2023-08-01T19:56:25.692 INFO:teuthology.orchestra.run.smithi155.stdout: "time": "2023-08-01T19:56:25.672306+0000", 2023-08-01T19:56:25.692 INFO:teuthology.orchestra.run.smithi155.stdout: "duration": 4.5560000000000001e-06 2023-08-01T19:56:25.692 INFO:teuthology.orchestra.run.smithi155.stdout: }, 2023-08-01T19:56:25.692 INFO:teuthology.orchestra.run.smithi155.stdout: { 2023-08-01T19:56:25.692 INFO:teuthology.orchestra.run.smithi155.stdout: "event": "dispatched", 2023-08-01T19:56:25.693 INFO:teuthology.orchestra.run.smithi155.stdout: "time": "2023-08-01T19:56:25.672318+0000", 2023-08-01T19:56:25.693 INFO:teuthology.orchestra.run.smithi155.stdout: "duration": 1.1335000000000001e-05 2023-08-01T19:56:25.693 INFO:teuthology.orchestra.run.smithi155.stdout: }, 2023-08-01T19:56:25.693 INFO:teuthology.orchestra.run.smithi155.stdout: { 2023-08-01T19:56:25.693 INFO:teuthology.orchestra.run.smithi155.stdout: "event": "queued_for_pg", 2023-08-01T19:56:25.693 INFO:teuthology.orchestra.run.smithi155.stdout: "time": "2023-08-01T19:56:25.672324+0000", 2023-08-01T19:56:25.693 INFO:teuthology.orchestra.run.smithi155.stdout: "duration": 6.4799999999999998e-06 2023-08-01T19:56:25.693 INFO:teuthology.orchestra.run.smithi155.stdout: }, 2023-08-01T19:56:25.694 INFO:teuthology.orchestra.run.smithi155.stdout: { 2023-08-01T19:56:25.694 INFO:teuthology.orchestra.run.smithi155.stdout: "event": "reached_pg", 2023-08-01T19:56:25.694 INFO:teuthology.orchestra.run.smithi155.stdout: "time": "2023-08-01T19:56:25.672359+0000", 2023-08-01T19:56:25.694 INFO:teuthology.orchestra.run.smithi155.stdout: "duration": 3.4854999999999997e-05 2023-08-01T19:56:25.694 INFO:teuthology.orchestra.run.smithi155.stdout: }, 2023-08-01T19:56:25.694 INFO:teuthology.orchestra.run.smithi155.stdout: { 2023-08-01T19:56:25.694 INFO:teuthology.orchestra.run.smithi155.stdout: "event": "started", 2023-08-01T19:56:25.694 INFO:teuthology.orchestra.run.smithi155.stdout: "time": "2023-08-01T19:56:25.672474+0000", 2023-08-01T19:56:25.695 INFO:teuthology.orchestra.run.smithi155.stdout: "duration": 0.000115407 2023-08-01T19:56:25.695 INFO:teuthology.orchestra.run.smithi155.stdout: }, 2023-08-01T19:56:25.695 INFO:teuthology.orchestra.run.smithi155.stdout: { 2023-08-01T19:56:25.695 INFO:teuthology.orchestra.run.smithi155.stdout: "event": "waiting for subops from 0", 2023-08-01T19:56:25.695 INFO:teuthology.orchestra.run.smithi155.stdout: "time": "2023-08-01T19:56:25.672585+0000", 2023-08-01T19:56:25.695 INFO:teuthology.orchestra.run.smithi155.stdout: "duration": 0.000110878 2023-08-01T19:56:25.695 INFO:teuthology.orchestra.run.smithi155.stdout: }, 2023-08-01T19:56:25.695 INFO:teuthology.orchestra.run.smithi155.stdout: { 2023-08-01T19:56:25.696 INFO:teuthology.orchestra.run.smithi155.stdout: "event": "op_commit", 2023-08-01T19:56:25.696 INFO:teuthology.orchestra.run.smithi155.stdout: "time": "2023-08-01T19:56:25.676542+0000", 2023-08-01T19:56:25.696 INFO:teuthology.orchestra.run.smithi155.stdout: "duration": 0.0039567259999999998 2023-08-01T19:56:25.696 INFO:teuthology.orchestra.run.smithi155.stdout: } 2023-08-01T19:56:25.696 INFO:teuthology.orchestra.run.smithi155.stdout: ] 2023-08-01T19:56:25.696 INFO:teuthology.orchestra.run.smithi155.stdout: } 2023-08-01T19:56:25.696 INFO:teuthology.orchestra.run.smithi155.stdout: }, 2023-08-01T19:56:25.697 INFO:teuthology.orchestra.run.smithi155.stdout: { 2023-08-01T19:56:25.697 INFO:teuthology.orchestra.run.smithi155.stdout: "description": "osd_op(client.4668.0:249009 5.0 5:0c6e599c:::benchmark_data_smithi006_114134_object115348:head [delete] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e74)", 2023-08-01T19:56:25.697 INFO:teuthology.orchestra.run.smithi155.stdout: "initiated_at": "2023-08-01T19:56:25.674282+0000", 2023-08-01T19:56:25.697 INFO:teuthology.orchestra.run.smithi155.stdout: "age": 0.0044078440000000002, 2023-08-01T19:56:25.697 INFO:teuthology.orchestra.run.smithi155.stdout: "duration": 0.0045266769999999998, 2023-08-01T19:56:25.697 INFO:teuthology.orchestra.run.smithi155.stdout: "type_data": { 2023-08-01T19:56:25.697 INFO:teuthology.orchestra.run.smithi155.stdout: "flag_point": "waiting for sub ops", 2023-08-01T19:56:25.697 INFO:teuthology.orchestra.run.smithi155.stdout: "client_info": { 2023-08-01T19:56:25.698 INFO:teuthology.orchestra.run.smithi155.stdout: "client": "client.4668", 2023-08-01T19:56:25.698 INFO:teuthology.orchestra.run.smithi155.stdout: "client_addr": "172.21.15.6:0/1709472247", 2023-08-01T19:56:25.698 INFO:teuthology.orchestra.run.smithi155.stdout: "tid": 249009 2023-08-01T19:56:25.698 INFO:teuthology.orchestra.run.smithi155.stdout: }, 2023-08-01T19:56:25.698 INFO:teuthology.orchestra.run.smithi155.stdout: "events": [ 2023-08-01T19:56:25.698 INFO:teuthology.orchestra.run.smithi155.stdout: { 2023-08-01T19:56:25.698 INFO:teuthology.orchestra.run.smithi155.stdout: "event": "initiated", 2023-08-01T19:56:25.698 INFO:teuthology.orchestra.run.smithi155.stdout: "time": "2023-08-01T19:56:25.674282+0000", 2023-08-01T19:56:25.699 INFO:teuthology.orchestra.run.smithi155.stdout: "duration": 0 2023-08-01T19:56:25.699 INFO:teuthology.orchestra.run.smithi155.stdout: }, 2023-08-01T19:56:25.699 INFO:teuthology.orchestra.run.smithi155.stdout: { 2023-08-01T19:56:25.699 INFO:teuthology.orchestra.run.smithi155.stdout: "event": "throttled", 2023-08-01T19:56:25.699 INFO:teuthology.orchestra.run.smithi155.stdout: "time": "2023-08-01T19:56:25.674282+0000", 2023-08-01T19:56:25.699 INFO:teuthology.orchestra.run.smithi155.stdout: "duration": 0 2023-08-01T19:56:25.699 INFO:teuthology.orchestra.run.smithi155.stdout: }, 2023-08-01T19:56:25.699 INFO:teuthology.orchestra.run.smithi155.stdout: { 2023-08-01T19:56:25.700 INFO:teuthology.orchestra.run.smithi155.stdout: "event": "header_read", 2023-08-01T19:56:25.700 INFO:teuthology.orchestra.run.smithi155.stdout: "time": "2023-08-01T19:56:25.674281+0000", 2023-08-01T19:56:25.700 INFO:teuthology.orchestra.run.smithi155.stdout: "duration": 4294967295.999999 2023-08-01T19:56:25.700 INFO:teuthology.orchestra.run.smithi155.stdout: }, 2023-08-01T19:56:25.700 INFO:teuthology.orchestra.run.smithi155.stdout: { 2023-08-01T19:56:25.700 INFO:teuthology.orchestra.run.smithi155.stdout: "event": "all_read", 2023-08-01T19:56:25.700 INFO:teuthology.orchestra.run.smithi155.stdout: "time": "2023-08-01T19:56:25.674287+0000", 2023-08-01T19:56:25.700 INFO:teuthology.orchestra.run.smithi155.stdout: "duration": 5.2329999999999997e-06 2023-08-01T19:56:25.701 INFO:teuthology.orchestra.run.smithi155.stdout: }, 2023-08-01T19:56:25.701 INFO:teuthology.orchestra.run.smithi155.stdout: { 2023-08-01T19:56:25.701 INFO:teuthology.orchestra.run.smithi155.stdout: "event": "dispatched", 2023-08-01T19:56:25.701 INFO:teuthology.orchestra.run.smithi155.stdout: "time": "2023-08-01T19:56:25.674298+0000", 2023-08-01T19:56:25.701 INFO:teuthology.orchestra.run.smithi155.stdout: "duration": 1.1090000000000001e-05 2023-08-01T19:56:25.701 INFO:teuthology.orchestra.run.smithi155.stdout: }, 2023-08-01T19:56:25.701 INFO:teuthology.orchestra.run.smithi155.stdout: { 2023-08-01T19:56:25.701 INFO:teuthology.orchestra.run.smithi155.stdout: "event": "queued_for_pg", 2023-08-01T19:56:25.702 INFO:teuthology.orchestra.run.smithi155.stdout: "time": "2023-08-01T19:56:25.674304+0000", 2023-08-01T19:56:25.702 INFO:teuthology.orchestra.run.smithi155.stdout: "duration": 5.9050000000000002e-06 2023-08-01T19:56:25.702 INFO:teuthology.orchestra.run.smithi155.stdout: }, 2023-08-01T19:56:25.702 INFO:teuthology.orchestra.run.smithi155.stdout: { 2023-08-01T19:56:25.702 INFO:teuthology.orchestra.run.smithi155.stdout: "event": "reached_pg", 2023-08-01T19:56:25.702 INFO:teuthology.orchestra.run.smithi155.stdout: "time": "2023-08-01T19:56:25.674328+0000", 2023-08-01T19:56:25.702 INFO:teuthology.orchestra.run.smithi155.stdout: "duration": 2.4375999999999998e-05 2023-08-01T19:56:25.702 INFO:teuthology.orchestra.run.smithi155.stdout: }, 2023-08-01T19:56:25.703 INFO:teuthology.orchestra.run.smithi155.stdout: { 2023-08-01T19:56:25.703 INFO:teuthology.orchestra.run.smithi155.stdout: "event": "started", 2023-08-01T19:56:25.703 INFO:teuthology.orchestra.run.smithi155.stdout: "time": "2023-08-01T19:56:25.674401+0000", 2023-08-01T19:56:25.703 INFO:teuthology.orchestra.run.smithi155.stdout: "duration": 7.3132000000000004e-05 2023-08-01T19:56:25.703 INFO:teuthology.orchestra.run.smithi155.stdout: }, 2023-08-01T19:56:25.703 INFO:teuthology.orchestra.run.smithi155.stdout: { 2023-08-01T19:56:25.703 INFO:teuthology.orchestra.run.smithi155.stdout: "event": "waiting for subops from 0", 2023-08-01T19:56:25.703 INFO:teuthology.orchestra.run.smithi155.stdout: "time": "2023-08-01T19:56:25.674462+0000", 2023-08-01T19:56:25.704 INFO:teuthology.orchestra.run.smithi155.stdout: "duration": 6.1134000000000001e-05 2023-08-01T19:56:25.704 INFO:teuthology.orchestra.run.smithi155.stdout: }, 2023-08-01T19:56:25.704 INFO:teuthology.orchestra.run.smithi155.stdout: { 2023-08-01T19:56:25.704 INFO:teuthology.orchestra.run.smithi155.stdout: "event": "op_commit", 2023-08-01T19:56:25.704 INFO:teuthology.orchestra.run.smithi155.stdout: "time": "2023-08-01T19:56:25.677905+0000", 2023-08-01T19:56:25.704 INFO:teuthology.orchestra.run.smithi155.stdout: "duration": 0.0034425110000000001 2023-08-01T19:56:25.704 INFO:teuthology.orchestra.run.smithi155.stdout: } 2023-08-01T19:56:25.705 INFO:teuthology.orchestra.run.smithi155.stdout: ] 2023-08-01T19:56:25.705 INFO:teuthology.orchestra.run.smithi155.stdout: } 2023-08-01T19:56:25.705 INFO:teuthology.orchestra.run.smithi155.stdout: } 2023-08-01T19:56:25.705 INFO:teuthology.orchestra.run.smithi155.stdout: ], 2023-08-01T19:56:25.705 INFO:teuthology.orchestra.run.smithi155.stdout: "num_ops": 3 2023-08-01T19:56:25.705 INFO:teuthology.orchestra.run.smithi155.stdout:} 2023-08-01T19:56:25.706 DEBUG:teuthology.orchestra.run.smithi155:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 30 ceph --cluster ceph --admin-daemon /var/run/ceph/ceph-osd.2.asok dump_blocked_ops 2023-08-01T19:56:25.747 INFO:tasks.ceph.osd.2.smithi155.stderr:2023-08-01T19:56:25.746+0000 7faa5c6ac700 -1 received signal: Hangup from /usr/bin/python3 /bin/daemon-helper kill ceph-osd -f --cluster ceph -i 2 (PID: 111337) UID: 0 2023-08-01T19:56:25.784 DEBUG:teuthology.orchestra.run.smithi006:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 120 ceph --cluster ceph osd unset noscrub 2023-08-01T19:56:25.827 INFO:tasks.ceph.osd.2.smithi155.stderr:2023-08-01T19:56:25.825+0000 7faa5c6ac700 -1 received signal: Hangup from /usr/bin/python3 /bin/daemon-helper kill ceph-osd -f --cluster ceph -i 2 (PID: 111337) UID: 0 2023-08-01T19:56:25.917 INFO:teuthology.orchestra.run.smithi155.stdout:{ 2023-08-01T19:56:25.917 INFO:teuthology.orchestra.run.smithi155.stdout: "ops": [], 2023-08-01T19:56:25.917 INFO:teuthology.orchestra.run.smithi155.stdout: "complaint_time": 30, 2023-08-01T19:56:25.918 INFO:teuthology.orchestra.run.smithi155.stdout: "num_blocked_ops": 0 2023-08-01T19:56:25.918 INFO:teuthology.orchestra.run.smithi155.stdout:} 2023-08-01T19:56:25.928 INFO:tasks.ceph.osd.2.smithi155.stderr:2023-08-01T19:56:25.926+0000 7faa5c6ac700 -1 received signal: Hangup from /usr/bin/python3 /bin/daemon-helper kill ceph-osd -f --cluster ceph -i 2 (PID: 111337) UID: 0 2023-08-01T19:56:25.929 DEBUG:teuthology.orchestra.run.smithi155:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 30 ceph --cluster ceph --admin-daemon /var/run/ceph/ceph-osd.2.asok dump_historic_ops 2023-08-01T19:56:26.028 INFO:tasks.ceph.osd.2.smithi155.stderr:2023-08-01T19:56:26.027+0000 7faa5c6ac700 -1 received signal: Hangup from /usr/bin/python3 /bin/daemon-helper kill ceph-osd -f --cluster ceph -i 2 (PID: 111337) UID: 0 2023-08-01T19:56:26.130 INFO:tasks.ceph.osd.0.smithi008.stderr:2023-08-01T19:56:26.129+0000 7f16a58f4700 -1 received signal: Hangup from /usr/bin/python3 /bin/daemon-helper kill ceph-osd -f --cluster ceph -i 0 (PID: 111179) UID: 0 2023-08-01T19:56:26.138 INFO:teuthology.orchestra.run.smithi155.stdout:{ 2023-08-01T19:56:26.138 INFO:teuthology.orchestra.run.smithi155.stdout: "size": 20, 2023-08-01T19:56:26.138 INFO:teuthology.orchestra.run.smithi155.stdout: "duration": 600, 2023-08-01T19:56:26.138 INFO:teuthology.orchestra.run.smithi155.stdout: "ops": [ 2023-08-01T19:56:26.139 INFO:teuthology.orchestra.run.smithi155.stdout: { 2023-08-01T19:56:26.139 INFO:teuthology.orchestra.run.smithi155.stdout: "description": "osd_op(client.4668.0:100237 5.4 5:2d68bec9:::benchmark_data_smithi006_114134_object100236:head [set-alloc-hint object_size 65536 write_size 65536,write 0~65536] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e37)", 2023-08-01T19:56:26.139 INFO:teuthology.orchestra.run.smithi155.stdout: "initiated_at": "2023-08-01T19:55:05.147736+0000", 2023-08-01T19:56:26.139 INFO:teuthology.orchestra.run.smithi155.stdout: "age": 80.988073262, 2023-08-01T19:56:26.139 INFO:teuthology.orchestra.run.smithi155.stdout: "duration": 0.071299464000000007, 2023-08-01T19:56:26.139 INFO:teuthology.orchestra.run.smithi155.stdout: "type_data": { 2023-08-01T19:56:26.139 INFO:teuthology.orchestra.run.smithi155.stdout: "flag_point": "commit sent; apply or cleanup", 2023-08-01T19:56:26.140 INFO:teuthology.orchestra.run.smithi155.stdout: "client_info": { 2023-08-01T19:56:26.140 INFO:teuthology.orchestra.run.smithi155.stdout: "client": "client.4668", 2023-08-01T19:56:26.140 INFO:teuthology.orchestra.run.smithi155.stdout: "client_addr": "172.21.15.6:0/1709472247", 2023-08-01T19:56:26.140 INFO:teuthology.orchestra.run.smithi155.stdout: "tid": 100237 2023-08-01T19:56:26.140 INFO:teuthology.orchestra.run.smithi155.stdout: }, 2023-08-01T19:56:26.140 INFO:teuthology.orchestra.run.smithi155.stdout: "events": [ 2023-08-01T19:56:26.140 INFO:teuthology.orchestra.run.smithi155.stdout: { 2023-08-01T19:56:26.141 INFO:teuthology.orchestra.run.smithi155.stdout: "event": "initiated", 2023-08-01T19:56:26.141 INFO:teuthology.orchestra.run.smithi155.stdout: "time": "2023-08-01T19:55:05.147736+0000", 2023-08-01T19:56:26.141 INFO:teuthology.orchestra.run.smithi155.stdout: "duration": 0 2023-08-01T19:56:26.141 INFO:teuthology.orchestra.run.smithi155.stdout: }, 2023-08-01T19:56:26.141 INFO:teuthology.orchestra.run.smithi155.stdout: { 2023-08-01T19:56:26.141 INFO:teuthology.orchestra.run.smithi155.stdout: "event": "throttled", 2023-08-01T19:56:26.141 INFO:teuthology.orchestra.run.smithi155.stdout: "time": "2023-08-01T19:55:05.147736+0000", 2023-08-01T19:56:26.141 INFO:teuthology.orchestra.run.smithi155.stdout: "duration": 0 2023-08-01T19:56:26.142 INFO:teuthology.orchestra.run.smithi155.stdout: }, 2023-08-01T19:56:26.142 INFO:teuthology.orchestra.run.smithi155.stdout: { 2023-08-01T19:56:26.142 INFO:teuthology.orchestra.run.smithi155.stdout: "event": "header_read", 2023-08-01T19:56:26.142 INFO:teuthology.orchestra.run.smithi155.stdout: "time": "2023-08-01T19:55:05.147736+0000", 2023-08-01T19:56:26.142 INFO:teuthology.orchestra.run.smithi155.stdout: "duration": 4294967295.9999995 2023-08-01T19:56:26.142 INFO:teuthology.orchestra.run.smithi155.stdout: }, 2023-08-01T19:56:26.142 INFO:teuthology.orchestra.run.smithi155.stdout: { 2023-08-01T19:56:26.142 INFO:teuthology.orchestra.run.smithi155.stdout: "event": "all_read", 2023-08-01T19:56:26.143 INFO:teuthology.orchestra.run.smithi155.stdout: "time": "2023-08-01T19:55:05.147766+0000", 2023-08-01T19:56:26.143 INFO:teuthology.orchestra.run.smithi155.stdout: "duration": 3.0394000000000001e-05 2023-08-01T19:56:26.143 INFO:teuthology.orchestra.run.smithi155.stdout: }, 2023-08-01T19:56:26.143 INFO:teuthology.orchestra.run.smithi155.stdout: { 2023-08-01T19:56:26.143 INFO:teuthology.orchestra.run.smithi155.stdout: "event": "dispatched", 2023-08-01T19:56:26.143 INFO:teuthology.orchestra.run.smithi155.stdout: "time": "2023-08-01T19:55:05.147771+0000", 2023-08-01T19:56:26.143 INFO:teuthology.orchestra.run.smithi155.stdout: "duration": 4.25e-06 2023-08-01T19:56:26.144 INFO:teuthology.orchestra.run.smithi155.stdout: }, 2023-08-01T19:56:26.144 INFO:teuthology.orchestra.run.smithi155.stdout: { 2023-08-01T19:56:26.144 INFO:teuthology.orchestra.run.smithi155.stdout: "event": "queued_for_pg", 2023-08-01T19:56:26.144 INFO:teuthology.orchestra.run.smithi155.stdout: "time": "2023-08-01T19:55:05.147773+0000", 2023-08-01T19:56:26.144 INFO:teuthology.orchestra.run.smithi155.stdout: "duration": 2.4159999999999998e-06 2023-08-01T19:56:26.144 INFO:teuthology.orchestra.run.smithi155.stdout: }, 2023-08-01T19:56:26.144 INFO:teuthology.orchestra.run.smithi155.stdout: { 2023-08-01T19:56:26.144 INFO:teuthology.orchestra.run.smithi155.stdout: "event": "reached_pg", 2023-08-01T19:56:26.145 INFO:teuthology.orchestra.run.smithi155.stdout: "time": "2023-08-01T19:55:05.149903+0000", 2023-08-01T19:56:26.145 INFO:teuthology.orchestra.run.smithi155.stdout: "duration": 0.002129948 2023-08-01T19:56:26.145 INFO:teuthology.orchestra.run.smithi155.stdout: }, 2023-08-01T19:56:26.145 INFO:teuthology.orchestra.run.smithi155.stdout: { 2023-08-01T19:56:26.145 INFO:teuthology.orchestra.run.smithi155.stdout: "event": "started", 2023-08-01T19:56:26.146 INFO:teuthology.orchestra.run.smithi155.stdout: "time": "2023-08-01T19:55:05.149982+0000", 2023-08-01T19:56:26.146 INFO:teuthology.orchestra.run.smithi155.stdout: "duration": 7.8706000000000002e-05 2023-08-01T19:56:26.146 INFO:teuthology.orchestra.run.smithi155.stdout: }, 2023-08-01T19:56:26.146 INFO:teuthology.orchestra.run.smithi155.stdout: { 2023-08-01T19:56:26.146 INFO:teuthology.orchestra.run.smithi155.stdout: "event": "waiting for subops from 0", 2023-08-01T19:56:26.146 INFO:teuthology.orchestra.run.smithi155.stdout: "time": "2023-08-01T19:55:05.150066+0000", 2023-08-01T19:56:26.146 INFO:teuthology.orchestra.run.smithi155.stdout: "duration": 8.4241999999999997e-05 2023-08-01T19:56:26.146 INFO:teuthology.orchestra.run.smithi155.stdout: }, 2023-08-01T19:56:26.147 INFO:teuthology.orchestra.run.smithi155.stdout: { 2023-08-01T19:56:26.147 INFO:teuthology.orchestra.run.smithi155.stdout: "event": "op_commit", 2023-08-01T19:56:26.147 INFO:teuthology.orchestra.run.smithi155.stdout: "time": "2023-08-01T19:55:05.154994+0000", 2023-08-01T19:56:26.147 INFO:teuthology.orchestra.run.smithi155.stdout: "duration": 0.0049277050000000001 2023-08-01T19:56:26.147 INFO:teuthology.orchestra.run.smithi155.stdout: }, 2023-08-01T19:56:26.147 INFO:teuthology.orchestra.run.smithi155.stdout: { 2023-08-01T19:56:26.147 INFO:teuthology.orchestra.run.smithi155.stdout: "event": "sub_op_commit_rec", 2023-08-01T19:56:26.147 INFO:teuthology.orchestra.run.smithi155.stdout: "time": "2023-08-01T19:55:05.218933+0000", 2023-08-01T19:56:26.148 INFO:teuthology.orchestra.run.smithi155.stdout: "duration": 0.063939916999999999 2023-08-01T19:56:26.148 INFO:teuthology.orchestra.run.smithi155.stdout: }, 2023-08-01T19:56:26.148 INFO:teuthology.orchestra.run.smithi155.stdout: { 2023-08-01T19:56:26.148 INFO:teuthology.orchestra.run.smithi155.stdout: "event": "commit_sent", 2023-08-01T19:56:26.148 INFO:teuthology.orchestra.run.smithi155.stdout: "time": "2023-08-01T19:55:05.218989+0000", 2023-08-01T19:56:26.148 INFO:teuthology.orchestra.run.smithi155.stdout: "duration": 5.5772000000000001e-05 2023-08-01T19:56:26.148 INFO:teuthology.orchestra.run.smithi155.stdout: }, 2023-08-01T19:56:26.149 INFO:teuthology.orchestra.run.smithi155.stdout: { 2023-08-01T19:56:26.149 INFO:teuthology.orchestra.run.smithi155.stdout: "event": "done", 2023-08-01T19:56:26.149 INFO:teuthology.orchestra.run.smithi155.stdout: "time": "2023-08-01T19:55:05.219036+0000", 2023-08-01T19:56:26.149 INFO:teuthology.orchestra.run.smithi155.stdout: "duration": 4.6526000000000001e-05 2023-08-01T19:56:26.149 INFO:teuthology.orchestra.run.smithi155.stdout: } 2023-08-01T19:56:26.149 INFO:teuthology.orchestra.run.smithi155.stdout: ] 2023-08-01T19:56:26.149 INFO:teuthology.orchestra.run.smithi155.stdout: } 2023-08-01T19:56:26.149 INFO:teuthology.orchestra.run.smithi155.stdout: }, 2023-08-01T19:56:26.150 INFO:teuthology.orchestra.run.smithi155.stdout: { 2023-08-01T19:56:26.150 INFO:teuthology.orchestra.run.smithi155.stdout: "description": "osd_op(client.4668.0:100242 5.8 5:16a314b8:::benchmark_data_smithi006_114134_object100241:head [set-alloc-hint object_size 65536 write_size 65536,write 0~65536] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e37)", 2023-08-01T19:56:26.150 INFO:teuthology.orchestra.run.smithi155.stdout: "initiated_at": "2023-08-01T19:55:05.150616+0000", 2023-08-01T19:56:26.150 INFO:teuthology.orchestra.run.smithi155.stdout: "age": 80.985193632000005, 2023-08-01T19:56:26.150 INFO:teuthology.orchestra.run.smithi155.stdout: "duration": 0.071105065999999995, 2023-08-01T19:56:26.150 INFO:teuthology.orchestra.run.smithi155.stdout: "type_data": { 2023-08-01T19:56:26.150 INFO:teuthology.orchestra.run.smithi155.stdout: "flag_point": "commit sent; apply or cleanup", 2023-08-01T19:56:26.150 INFO:teuthology.orchestra.run.smithi155.stdout: "client_info": { 2023-08-01T19:56:26.151 INFO:teuthology.orchestra.run.smithi155.stdout: "client": "client.4668", 2023-08-01T19:56:26.151 INFO:teuthology.orchestra.run.smithi155.stdout: "client_addr": "172.21.15.6:0/1709472247", 2023-08-01T19:56:26.151 INFO:teuthology.orchestra.run.smithi155.stdout: "tid": 100242 2023-08-01T19:56:26.151 INFO:teuthology.orchestra.run.smithi155.stdout: }, 2023-08-01T19:56:26.151 INFO:teuthology.orchestra.run.smithi155.stdout: "events": [ 2023-08-01T19:56:26.151 INFO:teuthology.orchestra.run.smithi155.stdout: { 2023-08-01T19:56:26.151 INFO:teuthology.orchestra.run.smithi155.stdout: "event": "initiated", 2023-08-01T19:56:26.151 INFO:teuthology.orchestra.run.smithi155.stdout: "time": "2023-08-01T19:55:05.150616+0000", 2023-08-01T19:56:26.152 INFO:teuthology.orchestra.run.smithi155.stdout: "duration": 0 2023-08-01T19:56:26.152 INFO:teuthology.orchestra.run.smithi155.stdout: }, 2023-08-01T19:56:26.152 INFO:teuthology.orchestra.run.smithi155.stdout: { 2023-08-01T19:56:26.152 INFO:teuthology.orchestra.run.smithi155.stdout: "event": "throttled", 2023-08-01T19:56:26.152 INFO:teuthology.orchestra.run.smithi155.stdout: "time": "2023-08-01T19:55:05.150616+0000", 2023-08-01T19:56:26.152 INFO:teuthology.orchestra.run.smithi155.stdout: "duration": 0 2023-08-01T19:56:26.152 INFO:teuthology.orchestra.run.smithi155.stdout: }, 2023-08-01T19:56:26.152 INFO:teuthology.orchestra.run.smithi155.stdout: { 2023-08-01T19:56:26.153 INFO:teuthology.orchestra.run.smithi155.stdout: "event": "header_read", 2023-08-01T19:56:26.153 INFO:teuthology.orchestra.run.smithi155.stdout: "time": "2023-08-01T19:55:05.150615+0000", 2023-08-01T19:56:26.153 INFO:teuthology.orchestra.run.smithi155.stdout: "duration": 4294967295.999999 2023-08-01T19:56:26.153 INFO:teuthology.orchestra.run.smithi155.stdout: }, 2023-08-01T19:56:26.153 INFO:teuthology.orchestra.run.smithi155.stdout: { 2023-08-01T19:56:26.153 INFO:teuthology.orchestra.run.smithi155.stdout: "event": "all_read", 2023-08-01T19:56:26.153 INFO:teuthology.orchestra.run.smithi155.stdout: "time": "2023-08-01T19:55:05.150696+0000", 2023-08-01T19:56:26.154 INFO:teuthology.orchestra.run.smithi155.stdout: "duration": 8.0852000000000004e-05 2023-08-01T19:56:26.154 INFO:teuthology.orchestra.run.smithi155.stdout: }, 2023-08-01T19:56:26.154 INFO:teuthology.orchestra.run.smithi155.stdout: { 2023-08-01T19:56:26.154 INFO:teuthology.orchestra.run.smithi155.stdout: "event": "dispatched", 2023-08-01T19:56:26.154 INFO:teuthology.orchestra.run.smithi155.stdout: "time": "2023-08-01T19:55:05.150708+0000", 2023-08-01T19:56:26.154 INFO:teuthology.orchestra.run.smithi155.stdout: "duration": 1.2116999999999999e-05 2023-08-01T19:56:26.154 INFO:teuthology.orchestra.run.smithi155.stdout: }, 2023-08-01T19:56:26.154 INFO:teuthology.orchestra.run.smithi155.stdout: { 2023-08-01T19:56:26.155 INFO:teuthology.orchestra.run.smithi155.stdout: "event": "queued_for_pg", 2023-08-01T19:56:26.155 INFO:teuthology.orchestra.run.smithi155.stdout: "time": "2023-08-01T19:55:05.150713+0000", 2023-08-01T19:56:26.155 INFO:teuthology.orchestra.run.smithi155.stdout: "duration": 5.4620000000000004e-06 2023-08-01T19:56:26.155 INFO:teuthology.orchestra.run.smithi155.stdout: }, 2023-08-01T19:56:26.155 INFO:teuthology.orchestra.run.smithi155.stdout: { 2023-08-01T19:56:26.155 INFO:teuthology.orchestra.run.smithi155.stdout: "event": "reached_pg", 2023-08-01T19:56:26.155 INFO:teuthology.orchestra.run.smithi155.stdout: "time": "2023-08-01T19:55:05.150761+0000", 2023-08-01T19:56:26.155 INFO:teuthology.orchestra.run.smithi155.stdout: "duration": 4.7429000000000003e-05 2023-08-01T19:56:26.156 INFO:teuthology.orchestra.run.smithi155.stdout: }, 2023-08-01T19:56:26.156 INFO:teuthology.orchestra.run.smithi155.stdout: { 2023-08-01T19:56:26.156 INFO:teuthology.orchestra.run.smithi155.stdout: "event": "started", 2023-08-01T19:56:26.156 INFO:teuthology.orchestra.run.smithi155.stdout: "time": "2023-08-01T19:55:05.150856+0000", 2023-08-01T19:56:26.156 INFO:teuthology.orchestra.run.smithi155.stdout: "duration": 9.5356e-05 2023-08-01T19:56:26.156 INFO:teuthology.orchestra.run.smithi155.stdout: }, 2023-08-01T19:56:26.156 INFO:teuthology.orchestra.run.smithi155.stdout: { 2023-08-01T19:56:26.156 INFO:teuthology.orchestra.run.smithi155.stdout: "event": "waiting for subops from 0", 2023-08-01T19:56:26.157 INFO:teuthology.orchestra.run.smithi155.stdout: "time": "2023-08-01T19:55:05.150999+0000", 2023-08-01T19:56:26.157 INFO:teuthology.orchestra.run.smithi155.stdout: "duration": 0.00014234499999999999 2023-08-01T19:56:26.157 INFO:teuthology.orchestra.run.smithi155.stdout: }, 2023-08-01T19:56:26.157 INFO:teuthology.orchestra.run.smithi155.stdout: { 2023-08-01T19:56:26.157 INFO:teuthology.orchestra.run.smithi155.stdout: "event": "sub_op_commit_rec", 2023-08-01T19:56:26.157 INFO:teuthology.orchestra.run.smithi155.stdout: "time": "2023-08-01T19:55:05.219001+0000", 2023-08-01T19:56:26.157 INFO:teuthology.orchestra.run.smithi155.stdout: "duration": 0.068002776000000001 2023-08-01T19:56:26.157 INFO:teuthology.orchestra.run.smithi155.stdout: }, 2023-08-01T19:56:26.158 INFO:teuthology.orchestra.run.smithi155.stdout: { 2023-08-01T19:56:26.158 INFO:teuthology.orchestra.run.smithi155.stdout: "event": "op_commit", 2023-08-01T19:56:26.158 INFO:teuthology.orchestra.run.smithi155.stdout: "time": "2023-08-01T19:55:05.221635+0000", 2023-08-01T19:56:26.158 INFO:teuthology.orchestra.run.smithi155.stdout: "duration": 0.0026340579999999999 2023-08-01T19:56:26.158 INFO:teuthology.orchestra.run.smithi155.stdout: }, 2023-08-01T19:56:26.158 INFO:teuthology.orchestra.run.smithi155.stdout: { 2023-08-01T19:56:26.158 INFO:teuthology.orchestra.run.smithi155.stdout: "event": "commit_sent", 2023-08-01T19:56:26.159 INFO:teuthology.orchestra.run.smithi155.stdout: "time": "2023-08-01T19:55:05.221682+0000", 2023-08-01T19:56:26.159 INFO:teuthology.orchestra.run.smithi155.stdout: "duration": 4.7123999999999998e-05 2023-08-01T19:56:26.159 INFO:teuthology.orchestra.run.smithi155.stdout: }, 2023-08-01T19:56:26.159 INFO:teuthology.orchestra.run.smithi155.stdout: { 2023-08-01T19:56:26.159 INFO:teuthology.orchestra.run.smithi155.stdout: "event": "done", 2023-08-01T19:56:26.159 INFO:teuthology.orchestra.run.smithi155.stdout: "time": "2023-08-01T19:55:05.221721+0000", 2023-08-01T19:56:26.159 INFO:teuthology.orchestra.run.smithi155.stdout: "duration": 3.8529999999999999e-05 2023-08-01T19:56:26.159 INFO:teuthology.orchestra.run.smithi155.stdout: } 2023-08-01T19:56:26.160 INFO:teuthology.orchestra.run.smithi155.stdout: ] 2023-08-01T19:56:26.160 INFO:teuthology.orchestra.run.smithi155.stdout: } 2023-08-01T19:56:26.160 INFO:teuthology.orchestra.run.smithi155.stdout: }, 2023-08-01T19:56:26.160 INFO:teuthology.orchestra.run.smithi155.stdout: { 2023-08-01T19:56:26.160 INFO:teuthology.orchestra.run.smithi155.stdout: "description": "osd_repop(client.4668.0:100240 5.a e37/19 5:5313c5b9:::benchmark_data_smithi006_114134_object100239:head v 37'6227, mlcod=37'6225)", 2023-08-01T19:56:26.160 INFO:teuthology.orchestra.run.smithi155.stdout: "initiated_at": "2023-08-01T19:55:05.150778+0000", 2023-08-01T19:56:26.160 INFO:teuthology.orchestra.run.smithi155.stdout: "age": 80.985031430999996, 2023-08-01T19:56:26.161 INFO:teuthology.orchestra.run.smithi155.stdout: "duration": 0.073362533999999993, 2023-08-01T19:56:26.161 INFO:teuthology.orchestra.run.smithi155.stdout: "type_data": { 2023-08-01T19:56:26.161 INFO:teuthology.orchestra.run.smithi155.stdout: "flag_point": "commit sent; apply or cleanup", 2023-08-01T19:56:26.161 INFO:teuthology.orchestra.run.smithi155.stdout: "events": [ 2023-08-01T19:56:26.161 INFO:teuthology.orchestra.run.smithi155.stdout: { 2023-08-01T19:56:26.161 INFO:teuthology.orchestra.run.smithi155.stdout: "event": "initiated", 2023-08-01T19:56:26.161 INFO:teuthology.orchestra.run.smithi155.stdout: "time": "2023-08-01T19:55:05.150778+0000", 2023-08-01T19:56:26.162 INFO:teuthology.orchestra.run.smithi155.stdout: "duration": 0 2023-08-01T19:56:26.162 INFO:teuthology.orchestra.run.smithi155.stdout: }, 2023-08-01T19:56:26.162 INFO:teuthology.orchestra.run.smithi155.stdout: { 2023-08-01T19:56:26.162 INFO:teuthology.orchestra.run.smithi155.stdout: "event": "throttled", 2023-08-01T19:56:26.162 INFO:teuthology.orchestra.run.smithi155.stdout: "time": "2023-08-01T19:55:05.150778+0000", 2023-08-01T19:56:26.162 INFO:teuthology.orchestra.run.smithi155.stdout: "duration": 0 2023-08-01T19:56:26.162 INFO:teuthology.orchestra.run.smithi155.stdout: }, 2023-08-01T19:56:26.162 INFO:teuthology.orchestra.run.smithi155.stdout: { 2023-08-01T19:56:26.163 INFO:teuthology.orchestra.run.smithi155.stdout: "event": "header_read", 2023-08-01T19:56:26.163 INFO:teuthology.orchestra.run.smithi155.stdout: "time": "2023-08-01T19:55:05.150778+0000", 2023-08-01T19:56:26.163 INFO:teuthology.orchestra.run.smithi155.stdout: "duration": 4294967295.9999995 2023-08-01T19:56:26.163 INFO:teuthology.orchestra.run.smithi155.stdout: }, 2023-08-01T19:56:26.163 INFO:teuthology.orchestra.run.smithi155.stdout: { 2023-08-01T19:56:26.163 INFO:teuthology.orchestra.run.smithi155.stdout: "event": "all_read", 2023-08-01T19:56:26.163 INFO:teuthology.orchestra.run.smithi155.stdout: "time": "2023-08-01T19:55:05.150811+0000", 2023-08-01T19:56:26.163 INFO:teuthology.orchestra.run.smithi155.stdout: "duration": 3.3664000000000002e-05 2023-08-01T19:56:26.164 INFO:teuthology.orchestra.run.smithi155.stdout: }, 2023-08-01T19:56:26.164 INFO:teuthology.orchestra.run.smithi155.stdout: { 2023-08-01T19:56:26.164 INFO:teuthology.orchestra.run.smithi155.stdout: "event": "dispatched", 2023-08-01T19:56:26.164 INFO:teuthology.orchestra.run.smithi155.stdout: "time": "2023-08-01T19:55:05.150818+0000", 2023-08-01T19:56:26.164 INFO:teuthology.orchestra.run.smithi155.stdout: "duration": 6.5769999999999999e-06 2023-08-01T19:56:26.164 INFO:teuthology.orchestra.run.smithi155.stdout: }, 2023-08-01T19:56:26.164 INFO:teuthology.orchestra.run.smithi155.stdout: { 2023-08-01T19:56:26.165 INFO:teuthology.orchestra.run.smithi155.stdout: "event": "queued_for_pg", 2023-08-01T19:56:26.165 INFO:teuthology.orchestra.run.smithi155.stdout: "time": "2023-08-01T19:55:05.150822+0000", 2023-08-01T19:56:26.165 INFO:teuthology.orchestra.run.smithi155.stdout: "duration": 4.0060000000000003e-06 2023-08-01T19:56:26.165 INFO:teuthology.orchestra.run.smithi155.stdout: }, 2023-08-01T19:56:26.165 INFO:teuthology.orchestra.run.smithi155.stdout: { 2023-08-01T19:56:26.165 INFO:teuthology.orchestra.run.smithi155.stdout: "event": "reached_pg", 2023-08-01T19:56:26.165 INFO:teuthology.orchestra.run.smithi155.stdout: "time": "2023-08-01T19:55:05.150855+0000", 2023-08-01T19:56:26.165 INFO:teuthology.orchestra.run.smithi155.stdout: "duration": 3.3204999999999998e-05 2023-08-01T19:56:26.166 INFO:teuthology.orchestra.run.smithi155.stdout: }, 2023-08-01T19:56:26.166 INFO:teuthology.orchestra.run.smithi155.stdout: { 2023-08-01T19:56:26.166 INFO:teuthology.orchestra.run.smithi155.stdout: "event": "started", 2023-08-01T19:56:26.166 INFO:teuthology.orchestra.run.smithi155.stdout: "time": "2023-08-01T19:55:05.150873+0000", 2023-08-01T19:56:26.166 INFO:teuthology.orchestra.run.smithi155.stdout: "duration": 1.8139999999999999e-05 2023-08-01T19:56:26.166 INFO:teuthology.orchestra.run.smithi155.stdout: }, 2023-08-01T19:56:26.166 INFO:teuthology.orchestra.run.smithi155.stdout: { 2023-08-01T19:56:26.166 INFO:teuthology.orchestra.run.smithi155.stdout: "event": "commit_sent", 2023-08-01T19:56:26.167 INFO:teuthology.orchestra.run.smithi155.stdout: "time": "2023-08-01T19:55:05.224095+0000", 2023-08-01T19:56:26.167 INFO:teuthology.orchestra.run.smithi155.stdout: "duration": 0.073221895999999995 2023-08-01T19:56:26.167 INFO:teuthology.orchestra.run.smithi155.stdout: }, 2023-08-01T19:56:26.167 INFO:teuthology.orchestra.run.smithi155.stdout: { 2023-08-01T19:56:26.167 INFO:teuthology.orchestra.run.smithi155.stdout: "event": "done", 2023-08-01T19:56:26.167 INFO:teuthology.orchestra.run.smithi155.stdout: "time": "2023-08-01T19:55:05.224141+0000", 2023-08-01T19:56:26.167 INFO:teuthology.orchestra.run.smithi155.stdout: "duration": 4.5385e-05 2023-08-01T19:56:26.167 INFO:teuthology.orchestra.run.smithi155.stdout: } 2023-08-01T19:56:26.168 INFO:teuthology.orchestra.run.smithi155.stdout: ] 2023-08-01T19:56:26.168 INFO:teuthology.orchestra.run.smithi155.stdout: } 2023-08-01T19:56:26.168 INFO:teuthology.orchestra.run.smithi155.stdout: }, 2023-08-01T19:56:26.168 INFO:teuthology.orchestra.run.smithi155.stdout: { 2023-08-01T19:56:26.168 INFO:teuthology.orchestra.run.smithi155.stdout: "description": "osd_op(client.4668.0:100245 5.e 5:71869c66:::benchmark_data_smithi006_114134_object100244:head [set-alloc-hint object_size 65536 write_size 65536,write 0~65536] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e37)", 2023-08-01T19:56:26.168 INFO:teuthology.orchestra.run.smithi155.stdout: "initiated_at": "2023-08-01T19:55:05.150991+0000", 2023-08-01T19:56:26.168 INFO:teuthology.orchestra.run.smithi155.stdout: "age": 80.984818644000001, 2023-08-01T19:56:26.169 INFO:teuthology.orchestra.run.smithi155.stdout: "duration": 0.070734490999999997, 2023-08-01T19:56:26.169 INFO:teuthology.orchestra.run.smithi155.stdout: "type_data": { 2023-08-01T19:56:26.169 INFO:teuthology.orchestra.run.smithi155.stdout: "flag_point": "commit sent; apply or cleanup", 2023-08-01T19:56:26.169 INFO:teuthology.orchestra.run.smithi155.stdout: "client_info": { 2023-08-01T19:56:26.169 INFO:teuthology.orchestra.run.smithi155.stdout: "client": "client.4668", 2023-08-01T19:56:26.169 INFO:teuthology.orchestra.run.smithi155.stdout: "client_addr": "172.21.15.6:0/1709472247", 2023-08-01T19:56:26.169 INFO:teuthology.orchestra.run.smithi155.stdout: "tid": 100245 2023-08-01T19:56:26.169 INFO:teuthology.orchestra.run.smithi155.stdout: }, 2023-08-01T19:56:26.170 INFO:teuthology.orchestra.run.smithi155.stdout: "events": [ 2023-08-01T19:56:26.170 INFO:teuthology.orchestra.run.smithi155.stdout: { 2023-08-01T19:56:26.170 INFO:teuthology.orchestra.run.smithi155.stdout: "event": "initiated", 2023-08-01T19:56:26.170 INFO:teuthology.orchestra.run.smithi155.stdout: "time": "2023-08-01T19:55:05.150991+0000", 2023-08-01T19:56:26.170 INFO:teuthology.orchestra.run.smithi155.stdout: "duration": 0 2023-08-01T19:56:26.170 INFO:teuthology.orchestra.run.smithi155.stdout: }, 2023-08-01T19:56:26.170 INFO:teuthology.orchestra.run.smithi155.stdout: { 2023-08-01T19:56:26.170 INFO:teuthology.orchestra.run.smithi155.stdout: "event": "throttled", 2023-08-01T19:56:26.171 INFO:teuthology.orchestra.run.smithi155.stdout: "time": "2023-08-01T19:55:05.150991+0000", 2023-08-01T19:56:26.171 INFO:teuthology.orchestra.run.smithi155.stdout: "duration": 0 2023-08-01T19:56:26.171 INFO:teuthology.orchestra.run.smithi155.stdout: }, 2023-08-01T19:56:26.171 INFO:teuthology.orchestra.run.smithi155.stdout: { 2023-08-01T19:56:26.171 INFO:teuthology.orchestra.run.smithi155.stdout: "event": "header_read", 2023-08-01T19:56:26.171 INFO:teuthology.orchestra.run.smithi155.stdout: "time": "2023-08-01T19:55:05.150990+0000", 2023-08-01T19:56:26.171 INFO:teuthology.orchestra.run.smithi155.stdout: "duration": 4294967295.999999 2023-08-01T19:56:26.171 INFO:teuthology.orchestra.run.smithi155.stdout: }, 2023-08-01T19:56:26.172 INFO:teuthology.orchestra.run.smithi155.stdout: { 2023-08-01T19:56:26.172 INFO:teuthology.orchestra.run.smithi155.stdout: "event": "all_read", 2023-08-01T19:56:26.172 INFO:teuthology.orchestra.run.smithi155.stdout: "time": "2023-08-01T19:55:05.151108+0000", 2023-08-01T19:56:26.172 INFO:teuthology.orchestra.run.smithi155.stdout: "duration": 0.00011849300000000001 2023-08-01T19:56:26.172 INFO:teuthology.orchestra.run.smithi155.stdout: }, 2023-08-01T19:56:26.172 INFO:teuthology.orchestra.run.smithi155.stdout: { 2023-08-01T19:56:26.172 INFO:teuthology.orchestra.run.smithi155.stdout: "event": "dispatched", 2023-08-01T19:56:26.172 INFO:teuthology.orchestra.run.smithi155.stdout: "time": "2023-08-01T19:55:05.151117+0000", 2023-08-01T19:56:26.173 INFO:teuthology.orchestra.run.smithi155.stdout: "duration": 8.1040000000000007e-06 2023-08-01T19:56:26.173 INFO:teuthology.orchestra.run.smithi155.stdout: }, 2023-08-01T19:56:26.173 INFO:teuthology.orchestra.run.smithi155.stdout: { 2023-08-01T19:56:26.173 INFO:teuthology.orchestra.run.smithi155.stdout: "event": "queued_for_pg", 2023-08-01T19:56:26.173 INFO:teuthology.orchestra.run.smithi155.stdout: "time": "2023-08-01T19:55:05.151121+0000", 2023-08-01T19:56:26.173 INFO:teuthology.orchestra.run.smithi155.stdout: "duration": 4.2019999999999997e-06 2023-08-01T19:56:26.173 INFO:teuthology.orchestra.run.smithi155.stdout: }, 2023-08-01T19:56:26.174 INFO:teuthology.orchestra.run.smithi155.stdout: { 2023-08-01T19:56:26.174 INFO:teuthology.orchestra.run.smithi155.stdout: "event": "reached_pg", 2023-08-01T19:56:26.174 INFO:teuthology.orchestra.run.smithi155.stdout: "time": "2023-08-01T19:55:05.151162+0000", 2023-08-01T19:56:26.174 INFO:teuthology.orchestra.run.smithi155.stdout: "duration": 4.1448e-05 2023-08-01T19:56:26.174 INFO:teuthology.orchestra.run.smithi155.stdout: }, 2023-08-01T19:56:26.174 INFO:teuthology.orchestra.run.smithi155.stdout: { 2023-08-01T19:56:26.174 INFO:teuthology.orchestra.run.smithi155.stdout: "event": "started", 2023-08-01T19:56:26.174 INFO:teuthology.orchestra.run.smithi155.stdout: "time": "2023-08-01T19:55:05.151281+0000", 2023-08-01T19:56:26.175 INFO:teuthology.orchestra.run.smithi155.stdout: "duration": 0.000119141 2023-08-01T19:56:26.175 INFO:teuthology.orchestra.run.smithi155.stdout: }, 2023-08-01T19:56:26.175 INFO:teuthology.orchestra.run.smithi155.stdout: { 2023-08-01T19:56:26.175 INFO:teuthology.orchestra.run.smithi155.stdout: "event": "waiting for subops from 0", 2023-08-01T19:56:26.175 INFO:teuthology.orchestra.run.smithi155.stdout: "time": "2023-08-01T19:55:05.151443+0000", 2023-08-01T19:56:26.175 INFO:teuthology.orchestra.run.smithi155.stdout: "duration": 0.00016181600000000001 2023-08-01T19:56:26.175 INFO:teuthology.orchestra.run.smithi155.stdout: }, 2023-08-01T19:56:26.175 INFO:teuthology.orchestra.run.smithi155.stdout: { 2023-08-01T19:56:26.176 INFO:teuthology.orchestra.run.smithi155.stdout: "event": "sub_op_commit_rec", 2023-08-01T19:56:26.176 INFO:teuthology.orchestra.run.smithi155.stdout: "time": "2023-08-01T19:55:05.219101+0000", 2023-08-01T19:56:26.176 INFO:teuthology.orchestra.run.smithi155.stdout: "duration": 0.067658037000000004 2023-08-01T19:56:26.176 INFO:teuthology.orchestra.run.smithi155.stdout: }, 2023-08-01T19:56:26.176 INFO:teuthology.orchestra.run.smithi155.stdout: { 2023-08-01T19:56:26.176 INFO:teuthology.orchestra.run.smithi155.stdout: "event": "op_commit", 2023-08-01T19:56:26.176 INFO:teuthology.orchestra.run.smithi155.stdout: "time": "2023-08-01T19:55:05.221646+0000", 2023-08-01T19:56:26.177 INFO:teuthology.orchestra.run.smithi155.stdout: "duration": 0.0025450540000000002 2023-08-01T19:56:26.177 INFO:teuthology.orchestra.run.smithi155.stdout: }, 2023-08-01T19:56:26.177 INFO:teuthology.orchestra.run.smithi155.stdout: { 2023-08-01T19:56:26.177 INFO:teuthology.orchestra.run.smithi155.stdout: "event": "commit_sent", 2023-08-01T19:56:26.177 INFO:teuthology.orchestra.run.smithi155.stdout: "time": "2023-08-01T19:55:05.221689+0000", 2023-08-01T19:56:26.177 INFO:teuthology.orchestra.run.smithi155.stdout: "duration": 4.3078999999999999e-05 2023-08-01T19:56:26.177 INFO:teuthology.orchestra.run.smithi155.stdout: }, 2023-08-01T19:56:26.177 INFO:teuthology.orchestra.run.smithi155.stdout: { 2023-08-01T19:56:26.178 INFO:teuthology.orchestra.run.smithi155.stdout: "event": "done", 2023-08-01T19:56:26.178 INFO:teuthology.orchestra.run.smithi155.stdout: "time": "2023-08-01T19:55:05.221725+0000", 2023-08-01T19:56:26.178 INFO:teuthology.orchestra.run.smithi155.stdout: "duration": 3.6137999999999999e-05 2023-08-01T19:56:26.178 INFO:teuthology.orchestra.run.smithi155.stdout: } 2023-08-01T19:56:26.178 INFO:teuthology.orchestra.run.smithi155.stdout: ] 2023-08-01T19:56:26.178 INFO:teuthology.orchestra.run.smithi155.stdout: } 2023-08-01T19:56:26.178 INFO:teuthology.orchestra.run.smithi155.stdout: }, 2023-08-01T19:56:26.178 INFO:teuthology.orchestra.run.smithi155.stdout: { 2023-08-01T19:56:26.179 INFO:teuthology.orchestra.run.smithi155.stdout: "description": "osd_repop(client.4668.0:100243 5.a e37/19 5:5e8193b6:::benchmark_data_smithi006_114134_object100242:head v 37'6228, mlcod=37'6225)", 2023-08-01T19:56:26.179 INFO:teuthology.orchestra.run.smithi155.stdout: "initiated_at": "2023-08-01T19:55:05.151148+0000", 2023-08-01T19:56:26.179 INFO:teuthology.orchestra.run.smithi155.stdout: "age": 80.984661633000002, 2023-08-01T19:56:26.179 INFO:teuthology.orchestra.run.smithi155.stdout: "duration": 0.073020370000000001, 2023-08-01T19:56:26.179 INFO:teuthology.orchestra.run.smithi155.stdout: "type_data": { 2023-08-01T19:56:26.179 INFO:teuthology.orchestra.run.smithi155.stdout: "flag_point": "commit sent; apply or cleanup", 2023-08-01T19:56:26.179 INFO:teuthology.orchestra.run.smithi155.stdout: "events": [ 2023-08-01T19:56:26.179 INFO:teuthology.orchestra.run.smithi155.stdout: { 2023-08-01T19:56:26.180 INFO:teuthology.orchestra.run.smithi155.stdout: "event": "initiated", 2023-08-01T19:56:26.180 INFO:teuthology.orchestra.run.smithi155.stdout: "time": "2023-08-01T19:55:05.151148+0000", 2023-08-01T19:56:26.180 INFO:teuthology.orchestra.run.smithi155.stdout: "duration": 0 2023-08-01T19:56:26.180 INFO:teuthology.orchestra.run.smithi155.stdout: }, 2023-08-01T19:56:26.180 INFO:teuthology.orchestra.run.smithi155.stdout: { 2023-08-01T19:56:26.180 INFO:teuthology.orchestra.run.smithi155.stdout: "event": "throttled", 2023-08-01T19:56:26.180 INFO:teuthology.orchestra.run.smithi155.stdout: "time": "2023-08-01T19:55:05.151148+0000", 2023-08-01T19:56:26.180 INFO:teuthology.orchestra.run.smithi155.stdout: "duration": 0 2023-08-01T19:56:26.181 INFO:teuthology.orchestra.run.smithi155.stdout: }, 2023-08-01T19:56:26.181 INFO:teuthology.orchestra.run.smithi155.stdout: { 2023-08-01T19:56:26.181 INFO:teuthology.orchestra.run.smithi155.stdout: "event": "header_read", 2023-08-01T19:56:26.181 INFO:teuthology.orchestra.run.smithi155.stdout: "time": "2023-08-01T19:55:05.151147+0000", 2023-08-01T19:56:26.181 INFO:teuthology.orchestra.run.smithi155.stdout: "duration": 4294967295.9999995 2023-08-01T19:56:26.181 INFO:teuthology.orchestra.run.smithi155.stdout: }, 2023-08-01T19:56:26.181 INFO:teuthology.orchestra.run.smithi155.stdout: { 2023-08-01T19:56:26.181 INFO:teuthology.orchestra.run.smithi155.stdout: "event": "all_read", 2023-08-01T19:56:26.182 INFO:teuthology.orchestra.run.smithi155.stdout: "time": "2023-08-01T19:55:05.151231+0000", 2023-08-01T19:56:26.182 INFO:teuthology.orchestra.run.smithi155.stdout: "duration": 8.3135999999999998e-05 2023-08-01T19:56:26.182 INFO:teuthology.orchestra.run.smithi155.stdout: }, 2023-08-01T19:56:26.182 INFO:teuthology.orchestra.run.smithi155.stdout: { 2023-08-01T19:56:26.182 INFO:teuthology.orchestra.run.smithi155.stdout: "event": "dispatched", 2023-08-01T19:56:26.182 INFO:teuthology.orchestra.run.smithi155.stdout: "time": "2023-08-01T19:55:05.151239+0000", 2023-08-01T19:56:26.182 INFO:teuthology.orchestra.run.smithi155.stdout: "duration": 8.7469999999999994e-06 2023-08-01T19:56:26.182 INFO:teuthology.orchestra.run.smithi155.stdout: }, 2023-08-01T19:56:26.183 INFO:teuthology.orchestra.run.smithi155.stdout: { 2023-08-01T19:56:26.183 INFO:teuthology.orchestra.run.smithi155.stdout: "event": "queued_for_pg", 2023-08-01T19:56:26.183 INFO:teuthology.orchestra.run.smithi155.stdout: "time": "2023-08-01T19:55:05.151244+0000", 2023-08-01T19:56:26.183 INFO:teuthology.orchestra.run.smithi155.stdout: "duration": 4.4800000000000003e-06 2023-08-01T19:56:26.183 INFO:teuthology.orchestra.run.smithi155.stdout: }, 2023-08-01T19:56:26.183 INFO:teuthology.orchestra.run.smithi155.stdout: { 2023-08-01T19:56:26.183 INFO:teuthology.orchestra.run.smithi155.stdout: "event": "reached_pg", 2023-08-01T19:56:26.183 INFO:teuthology.orchestra.run.smithi155.stdout: "time": "2023-08-01T19:55:05.152938+0000", 2023-08-01T19:56:26.184 INFO:teuthology.orchestra.run.smithi155.stdout: "duration": 0.001693824 2023-08-01T19:56:26.184 INFO:teuthology.orchestra.run.smithi155.stdout: }, 2023-08-01T19:56:26.184 INFO:teuthology.orchestra.run.smithi155.stdout: { 2023-08-01T19:56:26.184 INFO:teuthology.orchestra.run.smithi155.stdout: "event": "started", 2023-08-01T19:56:26.184 INFO:teuthology.orchestra.run.smithi155.stdout: "time": "2023-08-01T19:55:05.152956+0000", 2023-08-01T19:56:26.184 INFO:teuthology.orchestra.run.smithi155.stdout: "duration": 1.8287e-05 2023-08-01T19:56:26.184 INFO:teuthology.orchestra.run.smithi155.stdout: }, 2023-08-01T19:56:26.185 INFO:teuthology.orchestra.run.smithi155.stdout: { 2023-08-01T19:56:26.185 INFO:teuthology.orchestra.run.smithi155.stdout: "event": "commit_sent", 2023-08-01T19:56:26.185 INFO:teuthology.orchestra.run.smithi155.stdout: "time": "2023-08-01T19:55:05.224145+0000", 2023-08-01T19:56:26.185 INFO:teuthology.orchestra.run.smithi155.stdout: "duration": 0.071189447000000003 2023-08-01T19:56:26.185 INFO:teuthology.orchestra.run.smithi155.stdout: }, 2023-08-01T19:56:26.185 INFO:teuthology.orchestra.run.smithi155.stdout: { 2023-08-01T19:56:26.185 INFO:teuthology.orchestra.run.smithi155.stdout: "event": "done", 2023-08-01T19:56:26.185 INFO:teuthology.orchestra.run.smithi155.stdout: "time": "2023-08-01T19:55:05.224168+0000", 2023-08-01T19:56:26.186 INFO:teuthology.orchestra.run.smithi155.stdout: "duration": 2.3008999999999999e-05 2023-08-01T19:56:26.186 INFO:teuthology.orchestra.run.smithi155.stdout: } 2023-08-01T19:56:26.186 INFO:teuthology.orchestra.run.smithi155.stdout: ] 2023-08-01T19:56:26.186 INFO:teuthology.orchestra.run.smithi155.stdout: } 2023-08-01T19:56:26.186 INFO:teuthology.orchestra.run.smithi155.stdout: }, 2023-08-01T19:56:26.186 INFO:teuthology.orchestra.run.smithi155.stdout: { 2023-08-01T19:56:26.186 INFO:teuthology.orchestra.run.smithi155.stdout: "description": "osd_repop(client.4668.0:100244 5.9 e37/19 5:92f56a12:::benchmark_data_smithi006_114134_object100243:head v 37'6294, mlcod=37'6292)", 2023-08-01T19:56:26.186 INFO:teuthology.orchestra.run.smithi155.stdout: "initiated_at": "2023-08-01T19:55:05.151325+0000", 2023-08-01T19:56:26.187 INFO:teuthology.orchestra.run.smithi155.stdout: "age": 80.984484288000004, 2023-08-01T19:56:26.187 INFO:teuthology.orchestra.run.smithi155.stdout: "duration": 0.071883673999999995, 2023-08-01T19:56:26.187 INFO:teuthology.orchestra.run.smithi155.stdout: "type_data": { 2023-08-01T19:56:26.187 INFO:teuthology.orchestra.run.smithi155.stdout: "flag_point": "commit sent; apply or cleanup", 2023-08-01T19:56:26.187 INFO:teuthology.orchestra.run.smithi155.stdout: "events": [ 2023-08-01T19:56:26.187 INFO:teuthology.orchestra.run.smithi155.stdout: { 2023-08-01T19:56:26.187 INFO:teuthology.orchestra.run.smithi155.stdout: "event": "initiated", 2023-08-01T19:56:26.187 INFO:teuthology.orchestra.run.smithi155.stdout: "time": "2023-08-01T19:55:05.151325+0000", 2023-08-01T19:56:26.188 INFO:teuthology.orchestra.run.smithi155.stdout: "duration": 0 2023-08-01T19:56:26.188 INFO:teuthology.orchestra.run.smithi155.stdout: }, 2023-08-01T19:56:26.188 INFO:teuthology.orchestra.run.smithi155.stdout: { 2023-08-01T19:56:26.188 INFO:teuthology.orchestra.run.smithi155.stdout: "event": "throttled", 2023-08-01T19:56:26.188 INFO:teuthology.orchestra.run.smithi155.stdout: "time": "2023-08-01T19:55:05.151325+0000", 2023-08-01T19:56:26.188 INFO:teuthology.orchestra.run.smithi155.stdout: "duration": 0 2023-08-01T19:56:26.188 INFO:teuthology.orchestra.run.smithi155.stdout: }, 2023-08-01T19:56:26.188 INFO:teuthology.orchestra.run.smithi155.stdout: { 2023-08-01T19:56:26.189 INFO:teuthology.orchestra.run.smithi155.stdout: "event": "header_read", 2023-08-01T19:56:26.189 INFO:teuthology.orchestra.run.smithi155.stdout: "time": "2023-08-01T19:55:05.151325+0000", 2023-08-01T19:56:26.189 INFO:teuthology.orchestra.run.smithi155.stdout: "duration": 4294967295.9999995 2023-08-01T19:56:26.189 INFO:teuthology.orchestra.run.smithi155.stdout: }, 2023-08-01T19:56:26.189 INFO:teuthology.orchestra.run.smithi155.stdout: { 2023-08-01T19:56:26.189 INFO:teuthology.orchestra.run.smithi155.stdout: "event": "all_read", 2023-08-01T19:56:26.189 INFO:teuthology.orchestra.run.smithi155.stdout: "time": "2023-08-01T19:55:05.151390+0000", 2023-08-01T19:56:26.189 INFO:teuthology.orchestra.run.smithi155.stdout: "duration": 6.5456999999999993e-05 2023-08-01T19:56:26.190 INFO:teuthology.orchestra.run.smithi155.stdout: }, 2023-08-01T19:56:26.190 INFO:teuthology.orchestra.run.smithi155.stdout: { 2023-08-01T19:56:26.190 INFO:teuthology.orchestra.run.smithi155.stdout: "event": "dispatched", 2023-08-01T19:56:26.190 INFO:teuthology.orchestra.run.smithi155.stdout: "time": "2023-08-01T19:55:05.151396+0000", 2023-08-01T19:56:26.190 INFO:teuthology.orchestra.run.smithi155.stdout: "duration": 5.9190000000000004e-06 2023-08-01T19:56:26.190 INFO:teuthology.orchestra.run.smithi155.stdout: }, 2023-08-01T19:56:26.190 INFO:teuthology.orchestra.run.smithi155.stdout: { 2023-08-01T19:56:26.190 INFO:teuthology.orchestra.run.smithi155.stdout: "event": "queued_for_pg", 2023-08-01T19:56:26.191 INFO:teuthology.orchestra.run.smithi155.stdout: "time": "2023-08-01T19:55:05.151400+0000", 2023-08-01T19:56:26.191 INFO:teuthology.orchestra.run.smithi155.stdout: "duration": 4.1030000000000004e-06 2023-08-01T19:56:26.191 INFO:teuthology.orchestra.run.smithi155.stdout: }, 2023-08-01T19:56:26.191 INFO:teuthology.orchestra.run.smithi155.stdout: { 2023-08-01T19:56:26.191 INFO:teuthology.orchestra.run.smithi155.stdout: "event": "reached_pg", 2023-08-01T19:56:26.191 INFO:teuthology.orchestra.run.smithi155.stdout: "time": "2023-08-01T19:55:05.151452+0000", 2023-08-01T19:56:26.191 INFO:teuthology.orchestra.run.smithi155.stdout: "duration": 5.2136999999999999e-05 2023-08-01T19:56:26.192 INFO:teuthology.orchestra.run.smithi155.stdout: }, 2023-08-01T19:56:26.192 INFO:teuthology.orchestra.run.smithi155.stdout: { 2023-08-01T19:56:26.192 INFO:teuthology.orchestra.run.smithi155.stdout: "event": "started", 2023-08-01T19:56:26.192 INFO:teuthology.orchestra.run.smithi155.stdout: "time": "2023-08-01T19:55:05.151470+0000", 2023-08-01T19:56:26.192 INFO:teuthology.orchestra.run.smithi155.stdout: "duration": 1.8e-05 2023-08-01T19:56:26.192 INFO:teuthology.orchestra.run.smithi155.stdout: }, 2023-08-01T19:56:26.192 INFO:teuthology.orchestra.run.smithi155.stdout: { 2023-08-01T19:56:26.192 INFO:teuthology.orchestra.run.smithi155.stdout: "event": "commit_sent", 2023-08-01T19:56:26.193 INFO:teuthology.orchestra.run.smithi155.stdout: "time": "2023-08-01T19:55:05.223183+0000", 2023-08-01T19:56:26.193 INFO:teuthology.orchestra.run.smithi155.stdout: "duration": 0.071712622000000004 2023-08-01T19:56:26.193 INFO:teuthology.orchestra.run.smithi155.stdout: }, 2023-08-01T19:56:26.193 INFO:teuthology.orchestra.run.smithi155.stdout: { 2023-08-01T19:56:26.193 INFO:teuthology.orchestra.run.smithi155.stdout: "event": "done", 2023-08-01T19:56:26.193 INFO:teuthology.orchestra.run.smithi155.stdout: "time": "2023-08-01T19:55:05.223209+0000", 2023-08-01T19:56:26.193 INFO:teuthology.orchestra.run.smithi155.stdout: "duration": 2.5956e-05 2023-08-01T19:56:26.193 INFO:teuthology.orchestra.run.smithi155.stdout: } 2023-08-01T19:56:26.194 INFO:teuthology.orchestra.run.smithi155.stdout: ] 2023-08-01T19:56:26.194 INFO:teuthology.orchestra.run.smithi155.stdout: } 2023-08-01T19:56:26.194 INFO:teuthology.orchestra.run.smithi155.stdout: }, 2023-08-01T19:56:26.194 INFO:teuthology.orchestra.run.smithi155.stdout: { 2023-08-01T19:56:26.194 INFO:teuthology.orchestra.run.smithi155.stdout: "description": "osd_op(client.4668.0:100249 5.b 5:d0666827:::benchmark_data_smithi006_114134_object100248:head [set-alloc-hint object_size 65536 write_size 65536,write 0~65536] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e37)", 2023-08-01T19:56:26.194 INFO:teuthology.orchestra.run.smithi155.stdout: "initiated_at": "2023-08-01T19:55:05.153614+0000", 2023-08-01T19:56:26.194 INFO:teuthology.orchestra.run.smithi155.stdout: "age": 80.982195863000001, 2023-08-01T19:56:26.194 INFO:teuthology.orchestra.run.smithi155.stdout: "duration": 0.069286118999999993, 2023-08-01T19:56:26.195 INFO:teuthology.orchestra.run.smithi155.stdout: "type_data": { 2023-08-01T19:56:26.195 INFO:teuthology.orchestra.run.smithi155.stdout: "flag_point": "commit sent; apply or cleanup", 2023-08-01T19:56:26.195 INFO:teuthology.orchestra.run.smithi155.stdout: "client_info": { 2023-08-01T19:56:26.195 INFO:teuthology.orchestra.run.smithi155.stdout: "client": "client.4668", 2023-08-01T19:56:26.195 INFO:teuthology.orchestra.run.smithi155.stdout: "client_addr": "172.21.15.6:0/1709472247", 2023-08-01T19:56:26.195 INFO:teuthology.orchestra.run.smithi155.stdout: "tid": 100249 2023-08-01T19:56:26.195 INFO:teuthology.orchestra.run.smithi155.stdout: }, 2023-08-01T19:56:26.195 INFO:teuthology.orchestra.run.smithi155.stdout: "events": [ 2023-08-01T19:56:26.196 INFO:teuthology.orchestra.run.smithi155.stdout: { 2023-08-01T19:56:26.196 INFO:teuthology.orchestra.run.smithi155.stdout: "event": "initiated", 2023-08-01T19:56:26.196 INFO:teuthology.orchestra.run.smithi155.stdout: "time": "2023-08-01T19:55:05.153614+0000", 2023-08-01T19:56:26.196 INFO:teuthology.orchestra.run.smithi155.stdout: "duration": 0 2023-08-01T19:56:26.196 INFO:teuthology.orchestra.run.smithi155.stdout: }, 2023-08-01T19:56:26.196 INFO:teuthology.orchestra.run.smithi155.stdout: { 2023-08-01T19:56:26.196 INFO:teuthology.orchestra.run.smithi155.stdout: "event": "throttled", 2023-08-01T19:56:26.196 INFO:teuthology.orchestra.run.smithi155.stdout: "time": "2023-08-01T19:55:05.153614+0000", 2023-08-01T19:56:26.197 INFO:teuthology.orchestra.run.smithi155.stdout: "duration": 0 2023-08-01T19:56:26.197 INFO:teuthology.orchestra.run.smithi155.stdout: }, 2023-08-01T19:56:26.197 INFO:teuthology.orchestra.run.smithi155.stdout: { 2023-08-01T19:56:26.197 INFO:teuthology.orchestra.run.smithi155.stdout: "event": "header_read", 2023-08-01T19:56:26.197 INFO:teuthology.orchestra.run.smithi155.stdout: "time": "2023-08-01T19:55:05.153612+0000", 2023-08-01T19:56:26.197 INFO:teuthology.orchestra.run.smithi155.stdout: "duration": 4294967295.9999986 2023-08-01T19:56:26.197 INFO:teuthology.orchestra.run.smithi155.stdout: }, 2023-08-01T19:56:26.197 INFO:teuthology.orchestra.run.smithi155.stdout: { 2023-08-01T19:56:26.198 INFO:teuthology.orchestra.run.smithi155.stdout: "event": "all_read", 2023-08-01T19:56:26.198 INFO:teuthology.orchestra.run.smithi155.stdout: "time": "2023-08-01T19:55:05.153694+0000", 2023-08-01T19:56:26.198 INFO:teuthology.orchestra.run.smithi155.stdout: "duration": 8.1618000000000004e-05 2023-08-01T19:56:26.198 INFO:teuthology.orchestra.run.smithi155.stdout: }, 2023-08-01T19:56:26.198 INFO:teuthology.orchestra.run.smithi155.stdout: { 2023-08-01T19:56:26.198 INFO:teuthology.orchestra.run.smithi155.stdout: "event": "dispatched", 2023-08-01T19:56:26.198 INFO:teuthology.orchestra.run.smithi155.stdout: "time": "2023-08-01T19:55:05.153713+0000", 2023-08-01T19:56:26.198 INFO:teuthology.orchestra.run.smithi155.stdout: "duration": 1.9069999999999999e-05 2023-08-01T19:56:26.199 INFO:teuthology.orchestra.run.smithi155.stdout: }, 2023-08-01T19:56:26.199 INFO:teuthology.orchestra.run.smithi155.stdout: { 2023-08-01T19:56:26.199 INFO:teuthology.orchestra.run.smithi155.stdout: "event": "queued_for_pg", 2023-08-01T19:56:26.199 INFO:teuthology.orchestra.run.smithi155.stdout: "time": "2023-08-01T19:55:05.153726+0000", 2023-08-01T19:56:26.199 INFO:teuthology.orchestra.run.smithi155.stdout: "duration": 1.238e-05 2023-08-01T19:56:26.199 INFO:teuthology.orchestra.run.smithi155.stdout: }, 2023-08-01T19:56:26.199 INFO:teuthology.orchestra.run.smithi155.stdout: { 2023-08-01T19:56:26.199 INFO:teuthology.orchestra.run.smithi155.stdout: "event": "reached_pg", 2023-08-01T19:56:26.200 INFO:teuthology.orchestra.run.smithi155.stdout: "time": "2023-08-01T19:55:05.153761+0000", 2023-08-01T19:56:26.200 INFO:teuthology.orchestra.run.smithi155.stdout: "duration": 3.5046999999999998e-05 2023-08-01T19:56:26.200 INFO:teuthology.orchestra.run.smithi155.stdout: }, 2023-08-01T19:56:26.200 INFO:teuthology.orchestra.run.smithi155.stdout: { 2023-08-01T19:56:26.200 INFO:teuthology.orchestra.run.smithi155.stdout: "event": "started", 2023-08-01T19:56:26.200 INFO:teuthology.orchestra.run.smithi155.stdout: "time": "2023-08-01T19:55:05.153896+0000", 2023-08-01T19:56:26.200 INFO:teuthology.orchestra.run.smithi155.stdout: "duration": 0.00013575800000000001 2023-08-01T19:56:26.201 INFO:teuthology.orchestra.run.smithi155.stdout: }, 2023-08-01T19:56:26.201 INFO:teuthology.orchestra.run.smithi155.stdout: { 2023-08-01T19:56:26.201 INFO:teuthology.orchestra.run.smithi155.stdout: "event": "waiting for subops from 0", 2023-08-01T19:56:26.201 INFO:teuthology.orchestra.run.smithi155.stdout: "time": "2023-08-01T19:55:05.154043+0000", 2023-08-01T19:56:26.201 INFO:teuthology.orchestra.run.smithi155.stdout: "duration": 0.00014650700000000001 2023-08-01T19:56:26.201 INFO:teuthology.orchestra.run.smithi155.stdout: }, 2023-08-01T19:56:26.201 INFO:teuthology.orchestra.run.smithi155.stdout: { 2023-08-01T19:56:26.201 INFO:teuthology.orchestra.run.smithi155.stdout: "event": "sub_op_commit_rec", 2023-08-01T19:56:26.202 INFO:teuthology.orchestra.run.smithi155.stdout: "time": "2023-08-01T19:55:05.221876+0000", 2023-08-01T19:56:26.202 INFO:teuthology.orchestra.run.smithi155.stdout: "duration": 0.067832796000000001 2023-08-01T19:56:26.202 INFO:teuthology.orchestra.run.smithi155.stdout: }, 2023-08-01T19:56:26.202 INFO:teuthology.orchestra.run.smithi155.stdout: { 2023-08-01T19:56:26.202 INFO:teuthology.orchestra.run.smithi155.stdout: "event": "op_commit", 2023-08-01T19:56:26.202 INFO:teuthology.orchestra.run.smithi155.stdout: "time": "2023-08-01T19:55:05.222813+0000", 2023-08-01T19:56:26.202 INFO:teuthology.orchestra.run.smithi155.stdout: "duration": 0.00093755300000000004 2023-08-01T19:56:26.202 INFO:teuthology.orchestra.run.smithi155.stdout: }, 2023-08-01T19:56:26.203 INFO:teuthology.orchestra.run.smithi155.stdout: { 2023-08-01T19:56:26.203 INFO:teuthology.orchestra.run.smithi155.stdout: "event": "commit_sent", 2023-08-01T19:56:26.203 INFO:teuthology.orchestra.run.smithi155.stdout: "time": "2023-08-01T19:55:05.222861+0000", 2023-08-01T19:56:26.203 INFO:teuthology.orchestra.run.smithi155.stdout: "duration": 4.8013999999999998e-05 2023-08-01T19:56:26.203 INFO:teuthology.orchestra.run.smithi155.stdout: }, 2023-08-01T19:56:26.203 INFO:teuthology.orchestra.run.smithi155.stdout: { 2023-08-01T19:56:26.204 INFO:teuthology.orchestra.run.smithi155.stdout: "event": "done", 2023-08-01T19:56:26.204 INFO:teuthology.orchestra.run.smithi155.stdout: "time": "2023-08-01T19:55:05.222900+0000", 2023-08-01T19:56:26.204 INFO:teuthology.orchestra.run.smithi155.stdout: "duration": 3.8634999999999999e-05 2023-08-01T19:56:26.204 INFO:teuthology.orchestra.run.smithi155.stdout: } 2023-08-01T19:56:26.204 INFO:teuthology.orchestra.run.smithi155.stdout: ] 2023-08-01T19:56:26.204 INFO:teuthology.orchestra.run.smithi155.stdout: } 2023-08-01T19:56:26.204 INFO:teuthology.orchestra.run.smithi155.stdout: }, 2023-08-01T19:56:26.204 INFO:teuthology.orchestra.run.smithi155.stdout: { 2023-08-01T19:56:26.205 INFO:teuthology.orchestra.run.smithi155.stdout: "description": "osd_op(client.4668.0:100251 5.b 5:d853df24:::benchmark_data_smithi006_114134_object100250:head [set-alloc-hint object_size 65536 write_size 65536,write 0~65536] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e37)", 2023-08-01T19:56:26.205 INFO:teuthology.orchestra.run.smithi155.stdout: "initiated_at": "2023-08-01T19:55:05.153737+0000", 2023-08-01T19:56:26.205 INFO:teuthology.orchestra.run.smithi155.stdout: "age": 80.982072849000005, 2023-08-01T19:56:26.205 INFO:teuthology.orchestra.run.smithi155.stdout: "duration": 0.071366545000000003, 2023-08-01T19:56:26.205 INFO:teuthology.orchestra.run.smithi155.stdout: "type_data": { 2023-08-01T19:56:26.205 INFO:teuthology.orchestra.run.smithi155.stdout: "flag_point": "commit sent; apply or cleanup", 2023-08-01T19:56:26.205 INFO:teuthology.orchestra.run.smithi155.stdout: "client_info": { 2023-08-01T19:56:26.205 INFO:teuthology.orchestra.run.smithi155.stdout: "client": "client.4668", 2023-08-01T19:56:26.206 INFO:teuthology.orchestra.run.smithi155.stdout: "client_addr": "172.21.15.6:0/1709472247", 2023-08-01T19:56:26.206 INFO:teuthology.orchestra.run.smithi155.stdout: "tid": 100251 2023-08-01T19:56:26.206 INFO:teuthology.orchestra.run.smithi155.stdout: }, 2023-08-01T19:56:26.206 INFO:teuthology.orchestra.run.smithi155.stdout: "events": [ 2023-08-01T19:56:26.206 INFO:teuthology.orchestra.run.smithi155.stdout: { 2023-08-01T19:56:26.206 INFO:teuthology.orchestra.run.smithi155.stdout: "event": "initiated", 2023-08-01T19:56:26.206 INFO:teuthology.orchestra.run.smithi155.stdout: "time": "2023-08-01T19:55:05.153737+0000", 2023-08-01T19:56:26.206 INFO:teuthology.orchestra.run.smithi155.stdout: "duration": 0 2023-08-01T19:56:26.207 INFO:teuthology.orchestra.run.smithi155.stdout: }, 2023-08-01T19:56:26.207 INFO:teuthology.orchestra.run.smithi155.stdout: { 2023-08-01T19:56:26.207 INFO:teuthology.orchestra.run.smithi155.stdout: "event": "throttled", 2023-08-01T19:56:26.207 INFO:teuthology.orchestra.run.smithi155.stdout: "time": "2023-08-01T19:55:05.153737+0000", 2023-08-01T19:56:26.207 INFO:teuthology.orchestra.run.smithi155.stdout: "duration": 0 2023-08-01T19:56:26.207 INFO:teuthology.orchestra.run.smithi155.stdout: }, 2023-08-01T19:56:26.207 INFO:teuthology.orchestra.run.smithi155.stdout: { 2023-08-01T19:56:26.207 INFO:teuthology.orchestra.run.smithi155.stdout: "event": "header_read", 2023-08-01T19:56:26.208 INFO:teuthology.orchestra.run.smithi155.stdout: "time": "2023-08-01T19:55:05.153736+0000", 2023-08-01T19:56:26.208 INFO:teuthology.orchestra.run.smithi155.stdout: "duration": 4294967295.9999995 2023-08-01T19:56:26.208 INFO:teuthology.orchestra.run.smithi155.stdout: }, 2023-08-01T19:56:26.208 INFO:teuthology.orchestra.run.smithi155.stdout: { 2023-08-01T19:56:26.208 INFO:teuthology.orchestra.run.smithi155.stdout: "event": "all_read", 2023-08-01T19:56:26.208 INFO:teuthology.orchestra.run.smithi155.stdout: "time": "2023-08-01T19:55:05.153784+0000", 2023-08-01T19:56:26.208 INFO:teuthology.orchestra.run.smithi155.stdout: "duration": 4.7660000000000001e-05 2023-08-01T19:56:26.208 INFO:teuthology.orchestra.run.smithi155.stdout: }, 2023-08-01T19:56:26.209 INFO:teuthology.orchestra.run.smithi155.stdout: { 2023-08-01T19:56:26.209 INFO:teuthology.orchestra.run.smithi155.stdout: "event": "dispatched", 2023-08-01T19:56:26.209 INFO:teuthology.orchestra.run.smithi155.stdout: "time": "2023-08-01T19:55:05.153793+0000", 2023-08-01T19:56:26.209 INFO:teuthology.orchestra.run.smithi155.stdout: "duration": 8.7150000000000004e-06 2023-08-01T19:56:26.209 INFO:teuthology.orchestra.run.smithi155.stdout: }, 2023-08-01T19:56:26.209 INFO:teuthology.orchestra.run.smithi155.stdout: { 2023-08-01T19:56:26.209 INFO:teuthology.orchestra.run.smithi155.stdout: "event": "queued_for_pg", 2023-08-01T19:56:26.209 INFO:teuthology.orchestra.run.smithi155.stdout: "time": "2023-08-01T19:55:05.153800+0000", 2023-08-01T19:56:26.210 INFO:teuthology.orchestra.run.smithi155.stdout: "duration": 7.2459999999999997e-06 2023-08-01T19:56:26.210 INFO:teuthology.orchestra.run.smithi155.stdout: }, 2023-08-01T19:56:26.210 INFO:teuthology.orchestra.run.smithi155.stdout: { 2023-08-01T19:56:26.210 INFO:teuthology.orchestra.run.smithi155.stdout: "event": "reached_pg", 2023-08-01T19:56:26.210 INFO:teuthology.orchestra.run.smithi155.stdout: "time": "2023-08-01T19:55:05.156241+0000", 2023-08-01T19:56:26.210 INFO:teuthology.orchestra.run.smithi155.stdout: "duration": 0.0024415359999999998 2023-08-01T19:56:26.210 INFO:teuthology.orchestra.run.smithi155.stdout: }, 2023-08-01T19:56:26.211 INFO:teuthology.orchestra.run.smithi155.stdout: { 2023-08-01T19:56:26.211 INFO:teuthology.orchestra.run.smithi155.stdout: "event": "started", 2023-08-01T19:56:26.211 INFO:teuthology.orchestra.run.smithi155.stdout: "time": "2023-08-01T19:55:05.219045+0000", 2023-08-01T19:56:26.211 INFO:teuthology.orchestra.run.smithi155.stdout: "duration": 0.062803855000000006 2023-08-01T19:56:26.211 INFO:teuthology.orchestra.run.smithi155.stdout: }, 2023-08-01T19:56:26.211 INFO:teuthology.orchestra.run.smithi155.stdout: { 2023-08-01T19:56:26.211 INFO:teuthology.orchestra.run.smithi155.stdout: "event": "waiting for subops from 0", 2023-08-01T19:56:26.212 INFO:teuthology.orchestra.run.smithi155.stdout: "time": "2023-08-01T19:55:05.219238+0000", 2023-08-01T19:56:26.212 INFO:teuthology.orchestra.run.smithi155.stdout: "duration": 0.00019241500000000001 2023-08-01T19:56:26.212 INFO:teuthology.orchestra.run.smithi155.stdout: }, 2023-08-01T19:56:26.212 INFO:teuthology.orchestra.run.smithi155.stdout: { 2023-08-01T19:56:26.212 INFO:teuthology.orchestra.run.smithi155.stdout: "event": "sub_op_commit_rec", 2023-08-01T19:56:26.212 INFO:teuthology.orchestra.run.smithi155.stdout: "time": "2023-08-01T19:55:05.223300+0000", 2023-08-01T19:56:26.212 INFO:teuthology.orchestra.run.smithi155.stdout: "duration": 0.0040626509999999996 2023-08-01T19:56:26.212 INFO:teuthology.orchestra.run.smithi155.stdout: }, 2023-08-01T19:56:26.213 INFO:teuthology.orchestra.run.smithi155.stdout: { 2023-08-01T19:56:26.213 INFO:teuthology.orchestra.run.smithi155.stdout: "event": "op_commit", 2023-08-01T19:56:26.213 INFO:teuthology.orchestra.run.smithi155.stdout: "time": "2023-08-01T19:55:05.225020+0000", 2023-08-01T19:56:26.213 INFO:teuthology.orchestra.run.smithi155.stdout: "duration": 0.0017201 2023-08-01T19:56:26.213 INFO:teuthology.orchestra.run.smithi155.stdout: }, 2023-08-01T19:56:26.213 INFO:teuthology.orchestra.run.smithi155.stdout: { 2023-08-01T19:56:26.213 INFO:teuthology.orchestra.run.smithi155.stdout: "event": "commit_sent", 2023-08-01T19:56:26.213 INFO:teuthology.orchestra.run.smithi155.stdout: "time": "2023-08-01T19:55:05.225066+0000", 2023-08-01T19:56:26.214 INFO:teuthology.orchestra.run.smithi155.stdout: "duration": 4.6143000000000002e-05 2023-08-01T19:56:26.214 INFO:teuthology.orchestra.run.smithi155.stdout: }, 2023-08-01T19:56:26.214 INFO:teuthology.orchestra.run.smithi155.stdout: { 2023-08-01T19:56:26.214 INFO:teuthology.orchestra.run.smithi155.stdout: "event": "done", 2023-08-01T19:56:26.214 INFO:teuthology.orchestra.run.smithi155.stdout: "time": "2023-08-01T19:55:05.225103+0000", 2023-08-01T19:56:26.214 INFO:teuthology.orchestra.run.smithi155.stdout: "duration": 3.6789999999999998e-05 2023-08-01T19:56:26.214 INFO:teuthology.orchestra.run.smithi155.stdout: } 2023-08-01T19:56:26.215 INFO:teuthology.orchestra.run.smithi155.stdout: ] 2023-08-01T19:56:26.215 INFO:teuthology.orchestra.run.smithi155.stdout: } 2023-08-01T19:56:26.215 INFO:teuthology.orchestra.run.smithi155.stdout: }, 2023-08-01T19:56:26.215 INFO:teuthology.orchestra.run.smithi155.stdout: { 2023-08-01T19:56:26.215 INFO:teuthology.orchestra.run.smithi155.stdout: "description": "osd_op(client.4668.0:100252 5.0 5:01f90c3c:::benchmark_data_smithi006_114134_object100251:head [set-alloc-hint object_size 65536 write_size 65536,write 0~65536] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e37)", 2023-08-01T19:56:26.215 INFO:teuthology.orchestra.run.smithi155.stdout: "initiated_at": "2023-08-01T19:55:05.154048+0000", 2023-08-01T19:56:26.215 INFO:teuthology.orchestra.run.smithi155.stdout: "age": 80.981761602000006, 2023-08-01T19:56:26.215 INFO:teuthology.orchestra.run.smithi155.stdout: "duration": 0.070156683999999997, 2023-08-01T19:56:26.216 INFO:teuthology.orchestra.run.smithi155.stdout: "type_data": { 2023-08-01T19:56:26.216 INFO:teuthology.orchestra.run.smithi155.stdout: "flag_point": "commit sent; apply or cleanup", 2023-08-01T19:56:26.216 INFO:teuthology.orchestra.run.smithi155.stdout: "client_info": { 2023-08-01T19:56:26.216 INFO:teuthology.orchestra.run.smithi155.stdout: "client": "client.4668", 2023-08-01T19:56:26.216 INFO:teuthology.orchestra.run.smithi155.stdout: "client_addr": "172.21.15.6:0/1709472247", 2023-08-01T19:56:26.216 INFO:teuthology.orchestra.run.smithi155.stdout: "tid": 100252 2023-08-01T19:56:26.216 INFO:teuthology.orchestra.run.smithi155.stdout: }, 2023-08-01T19:56:26.216 INFO:teuthology.orchestra.run.smithi155.stdout: "events": [ 2023-08-01T19:56:26.217 INFO:teuthology.orchestra.run.smithi155.stdout: { 2023-08-01T19:56:26.217 INFO:teuthology.orchestra.run.smithi155.stdout: "event": "initiated", 2023-08-01T19:56:26.217 INFO:teuthology.orchestra.run.smithi155.stdout: "time": "2023-08-01T19:55:05.154048+0000", 2023-08-01T19:56:26.217 INFO:teuthology.orchestra.run.smithi155.stdout: "duration": 0 2023-08-01T19:56:26.217 INFO:teuthology.orchestra.run.smithi155.stdout: }, 2023-08-01T19:56:26.217 INFO:teuthology.orchestra.run.smithi155.stdout: { 2023-08-01T19:56:26.217 INFO:teuthology.orchestra.run.smithi155.stdout: "event": "throttled", 2023-08-01T19:56:26.217 INFO:teuthology.orchestra.run.smithi155.stdout: "time": "2023-08-01T19:55:05.154048+0000", 2023-08-01T19:56:26.218 INFO:teuthology.orchestra.run.smithi155.stdout: "duration": 0 2023-08-01T19:56:26.218 INFO:teuthology.orchestra.run.smithi155.stdout: }, 2023-08-01T19:56:26.218 INFO:teuthology.orchestra.run.smithi155.stdout: { 2023-08-01T19:56:26.218 INFO:teuthology.orchestra.run.smithi155.stdout: "event": "header_read", 2023-08-01T19:56:26.218 INFO:teuthology.orchestra.run.smithi155.stdout: "time": "2023-08-01T19:55:05.154047+0000", 2023-08-01T19:56:26.218 INFO:teuthology.orchestra.run.smithi155.stdout: "duration": 4294967295.999999 2023-08-01T19:56:26.218 INFO:teuthology.orchestra.run.smithi155.stdout: }, 2023-08-01T19:56:26.218 INFO:teuthology.orchestra.run.smithi155.stdout: { 2023-08-01T19:56:26.219 INFO:teuthology.orchestra.run.smithi155.stdout: "event": "all_read", 2023-08-01T19:56:26.219 INFO:teuthology.orchestra.run.smithi155.stdout: "time": "2023-08-01T19:55:05.154115+0000", 2023-08-01T19:56:26.219 INFO:teuthology.orchestra.run.smithi155.stdout: "duration": 6.7545999999999993e-05 2023-08-01T19:56:26.219 INFO:teuthology.orchestra.run.smithi155.stdout: }, 2023-08-01T19:56:26.219 INFO:teuthology.orchestra.run.smithi155.stdout: { 2023-08-01T19:56:26.219 INFO:teuthology.orchestra.run.smithi155.stdout: "event": "dispatched", 2023-08-01T19:56:26.219 INFO:teuthology.orchestra.run.smithi155.stdout: "time": "2023-08-01T19:55:05.154125+0000", 2023-08-01T19:56:26.219 INFO:teuthology.orchestra.run.smithi155.stdout: "duration": 1.0669000000000001e-05 2023-08-01T19:56:26.220 INFO:teuthology.orchestra.run.smithi155.stdout: }, 2023-08-01T19:56:26.220 INFO:teuthology.orchestra.run.smithi155.stdout: { 2023-08-01T19:56:26.220 INFO:teuthology.orchestra.run.smithi155.stdout: "event": "queued_for_pg", 2023-08-01T19:56:26.220 INFO:teuthology.orchestra.run.smithi155.stdout: "time": "2023-08-01T19:55:05.154131+0000", 2023-08-01T19:56:26.220 INFO:teuthology.orchestra.run.smithi155.stdout: "duration": 6.0349999999999998e-06 2023-08-01T19:56:26.220 INFO:teuthology.orchestra.run.smithi155.stdout: }, 2023-08-01T19:56:26.220 INFO:teuthology.orchestra.run.smithi155.stdout: { 2023-08-01T19:56:26.220 INFO:teuthology.orchestra.run.smithi155.stdout: "event": "reached_pg", 2023-08-01T19:56:26.221 INFO:teuthology.orchestra.run.smithi155.stdout: "time": "2023-08-01T19:55:05.154174+0000", 2023-08-01T19:56:26.221 INFO:teuthology.orchestra.run.smithi155.stdout: "duration": 4.2429000000000003e-05 2023-08-01T19:56:26.221 INFO:teuthology.orchestra.run.smithi155.stdout: }, 2023-08-01T19:56:26.221 INFO:teuthology.orchestra.run.smithi155.stdout: { 2023-08-01T19:56:26.221 INFO:teuthology.orchestra.run.smithi155.stdout: "event": "started", 2023-08-01T19:56:26.221 INFO:teuthology.orchestra.run.smithi155.stdout: "time": "2023-08-01T19:55:05.154287+0000", 2023-08-01T19:56:26.221 INFO:teuthology.orchestra.run.smithi155.stdout: "duration": 0.000113138 2023-08-01T19:56:26.222 INFO:teuthology.orchestra.run.smithi155.stdout: }, 2023-08-01T19:56:26.222 INFO:teuthology.orchestra.run.smithi155.stdout: { 2023-08-01T19:56:26.222 INFO:teuthology.orchestra.run.smithi155.stdout: "event": "waiting for subops from 0", 2023-08-01T19:56:26.222 INFO:teuthology.orchestra.run.smithi155.stdout: "time": "2023-08-01T19:55:05.154420+0000", 2023-08-01T19:56:26.222 INFO:teuthology.orchestra.run.smithi155.stdout: "duration": 0.000133292 2023-08-01T19:56:26.222 INFO:teuthology.orchestra.run.smithi155.stdout: }, 2023-08-01T19:56:26.222 INFO:teuthology.orchestra.run.smithi155.stdout: { 2023-08-01T19:56:26.222 INFO:teuthology.orchestra.run.smithi155.stdout: "event": "sub_op_commit_rec", 2023-08-01T19:56:26.223 INFO:teuthology.orchestra.run.smithi155.stdout: "time": "2023-08-01T19:55:05.219034+0000", 2023-08-01T19:56:26.223 INFO:teuthology.orchestra.run.smithi155.stdout: "duration": 0.064613429999999999 2023-08-01T19:56:26.223 INFO:teuthology.orchestra.run.smithi155.stdout: }, 2023-08-01T19:56:26.223 INFO:teuthology.orchestra.run.smithi155.stdout: { 2023-08-01T19:56:26.223 INFO:teuthology.orchestra.run.smithi155.stdout: "event": "op_commit", 2023-08-01T19:56:26.223 INFO:teuthology.orchestra.run.smithi155.stdout: "time": "2023-08-01T19:55:05.224138+0000", 2023-08-01T19:56:26.223 INFO:teuthology.orchestra.run.smithi155.stdout: "duration": 0.0051041999999999997 2023-08-01T19:56:26.223 INFO:teuthology.orchestra.run.smithi155.stdout: }, 2023-08-01T19:56:26.224 INFO:teuthology.orchestra.run.smithi155.stdout: { 2023-08-01T19:56:26.224 INFO:teuthology.orchestra.run.smithi155.stdout: "event": "commit_sent", 2023-08-01T19:56:26.224 INFO:teuthology.orchestra.run.smithi155.stdout: "time": "2023-08-01T19:55:05.224171+0000", 2023-08-01T19:56:26.224 INFO:teuthology.orchestra.run.smithi155.stdout: "duration": 3.3345e-05 2023-08-01T19:56:26.224 INFO:teuthology.orchestra.run.smithi155.stdout: }, 2023-08-01T19:56:26.224 INFO:teuthology.orchestra.run.smithi155.stdout: { 2023-08-01T19:56:26.224 INFO:teuthology.orchestra.run.smithi155.stdout: "event": "done", 2023-08-01T19:56:26.224 INFO:teuthology.orchestra.run.smithi155.stdout: "time": "2023-08-01T19:55:05.224205+0000", 2023-08-01T19:56:26.225 INFO:teuthology.orchestra.run.smithi155.stdout: "duration": 3.3525999999999997e-05 2023-08-01T19:56:26.225 INFO:teuthology.orchestra.run.smithi155.stdout: } 2023-08-01T19:56:26.225 INFO:teuthology.orchestra.run.smithi155.stdout: ] 2023-08-01T19:56:26.225 INFO:teuthology.orchestra.run.smithi155.stdout: } 2023-08-01T19:56:26.225 INFO:teuthology.orchestra.run.smithi155.stdout: }, 2023-08-01T19:56:26.225 INFO:teuthology.orchestra.run.smithi155.stdout: { 2023-08-01T19:56:26.225 INFO:teuthology.orchestra.run.smithi155.stdout: "description": "osd_repop_reply(client.4668.0:100237 5.4 e37/19 ondisk, result = 0)", 2023-08-01T19:56:26.225 INFO:teuthology.orchestra.run.smithi155.stdout: "initiated_at": "2023-08-01T19:55:05.156249+0000", 2023-08-01T19:56:26.226 INFO:teuthology.orchestra.run.smithi155.stdout: "age": 80.979560656999993, 2023-08-01T19:56:26.226 INFO:teuthology.orchestra.run.smithi155.stdout: "duration": 0.062792549000000003, 2023-08-01T19:56:26.226 INFO:teuthology.orchestra.run.smithi155.stdout: "type_data": { 2023-08-01T19:56:26.226 INFO:teuthology.orchestra.run.smithi155.stdout: "flag_point": "started", 2023-08-01T19:56:26.226 INFO:teuthology.orchestra.run.smithi155.stdout: "events": [ 2023-08-01T19:56:26.226 INFO:teuthology.orchestra.run.smithi155.stdout: { 2023-08-01T19:56:26.226 INFO:teuthology.orchestra.run.smithi155.stdout: "event": "initiated", 2023-08-01T19:56:26.226 INFO:teuthology.orchestra.run.smithi155.stdout: "time": "2023-08-01T19:55:05.156249+0000", 2023-08-01T19:56:26.227 INFO:teuthology.orchestra.run.smithi155.stdout: "duration": 0 2023-08-01T19:56:26.227 INFO:teuthology.orchestra.run.smithi155.stdout: }, 2023-08-01T19:56:26.227 INFO:teuthology.orchestra.run.smithi155.stdout: { 2023-08-01T19:56:26.227 INFO:teuthology.orchestra.run.smithi155.stdout: "event": "throttled", 2023-08-01T19:56:26.227 INFO:teuthology.orchestra.run.smithi155.stdout: "time": "2023-08-01T19:55:05.156249+0000", 2023-08-01T19:56:26.227 INFO:teuthology.orchestra.run.smithi155.stdout: "duration": 0 2023-08-01T19:56:26.227 INFO:teuthology.orchestra.run.smithi155.stdout: }, 2023-08-01T19:56:26.227 INFO:teuthology.orchestra.run.smithi155.stdout: { 2023-08-01T19:56:26.228 INFO:teuthology.orchestra.run.smithi155.stdout: "event": "header_read", 2023-08-01T19:56:26.228 INFO:teuthology.orchestra.run.smithi155.stdout: "time": "2023-08-01T19:55:05.156248+0000", 2023-08-01T19:56:26.228 INFO:teuthology.orchestra.run.smithi155.stdout: "duration": 4294967295.9999995 2023-08-01T19:56:26.228 INFO:teuthology.orchestra.run.smithi155.stdout: }, 2023-08-01T19:56:26.228 INFO:teuthology.orchestra.run.smithi155.stdout: { 2023-08-01T19:56:26.228 INFO:teuthology.orchestra.run.smithi155.stdout: "event": "all_read", 2023-08-01T19:56:26.228 INFO:teuthology.orchestra.run.smithi155.stdout: "time": "2023-08-01T19:55:05.156252+0000", 2023-08-01T19:56:26.229 INFO:teuthology.orchestra.run.smithi155.stdout: "duration": 3.9999999999999998e-06 2023-08-01T19:56:26.229 INFO:teuthology.orchestra.run.smithi155.stdout: }, 2023-08-01T19:56:26.229 INFO:teuthology.orchestra.run.smithi155.stdout: { 2023-08-01T19:56:26.229 INFO:teuthology.orchestra.run.smithi155.stdout: "event": "dispatched", 2023-08-01T19:56:26.229 INFO:teuthology.orchestra.run.smithi155.stdout: "time": "2023-08-01T19:55:05.218844+0000", 2023-08-01T19:56:26.229 INFO:teuthology.orchestra.run.smithi155.stdout: "duration": 0.062591516999999999 2023-08-01T19:56:26.229 INFO:teuthology.orchestra.run.smithi155.stdout: }, 2023-08-01T19:56:26.229 INFO:teuthology.orchestra.run.smithi155.stdout: { 2023-08-01T19:56:26.230 INFO:teuthology.orchestra.run.smithi155.stdout: "event": "queued_for_pg", 2023-08-01T19:56:26.230 INFO:teuthology.orchestra.run.smithi155.stdout: "time": "2023-08-01T19:55:05.218862+0000", 2023-08-01T19:56:26.230 INFO:teuthology.orchestra.run.smithi155.stdout: "duration": 1.7666e-05 2023-08-01T19:56:26.230 INFO:teuthology.orchestra.run.smithi155.stdout: }, 2023-08-01T19:56:26.230 INFO:teuthology.orchestra.run.smithi155.stdout: { 2023-08-01T19:56:26.230 INFO:teuthology.orchestra.run.smithi155.stdout: "event": "reached_pg", 2023-08-01T19:56:26.230 INFO:teuthology.orchestra.run.smithi155.stdout: "time": "2023-08-01T19:55:05.218914+0000", 2023-08-01T19:56:26.230 INFO:teuthology.orchestra.run.smithi155.stdout: "duration": 5.2565999999999998e-05 2023-08-01T19:56:26.231 INFO:teuthology.orchestra.run.smithi155.stdout: }, 2023-08-01T19:56:26.231 INFO:teuthology.orchestra.run.smithi155.stdout: { 2023-08-01T19:56:26.231 INFO:teuthology.orchestra.run.smithi155.stdout: "event": "started", 2023-08-01T19:56:26.231 INFO:teuthology.orchestra.run.smithi155.stdout: "time": "2023-08-01T19:55:05.218925+0000", 2023-08-01T19:56:26.231 INFO:teuthology.orchestra.run.smithi155.stdout: "duration": 1.1375e-05 2023-08-01T19:56:26.231 INFO:teuthology.orchestra.run.smithi155.stdout: }, 2023-08-01T19:56:26.231 INFO:teuthology.orchestra.run.smithi155.stdout: { 2023-08-01T19:56:26.231 INFO:teuthology.orchestra.run.smithi155.stdout: "event": "done", 2023-08-01T19:56:26.232 INFO:teuthology.orchestra.run.smithi155.stdout: "time": "2023-08-01T19:55:05.219041+0000", 2023-08-01T19:56:26.232 INFO:teuthology.orchestra.run.smithi155.stdout: "duration": 0.000115977 2023-08-01T19:56:26.232 INFO:teuthology.orchestra.run.smithi155.stdout: } 2023-08-01T19:56:26.232 INFO:teuthology.orchestra.run.smithi155.stdout: ] 2023-08-01T19:56:26.232 INFO:teuthology.orchestra.run.smithi155.stdout: } 2023-08-01T19:56:26.232 INFO:teuthology.orchestra.run.smithi155.stdout: }, 2023-08-01T19:56:26.232 INFO:teuthology.orchestra.run.smithi155.stdout: { 2023-08-01T19:56:26.232 INFO:teuthology.orchestra.run.smithi155.stdout: "description": "osd_repop(client.4668.0:100253 5.f e37/19 5:f7bbce05:::benchmark_data_smithi006_114134_object100252:head v 37'6323, mlcod=37'6321)", 2023-08-01T19:56:26.233 INFO:teuthology.orchestra.run.smithi155.stdout: "initiated_at": "2023-08-01T19:55:05.156952+0000", 2023-08-01T19:56:26.233 INFO:teuthology.orchestra.run.smithi155.stdout: "age": 80.978857594000004, 2023-08-01T19:56:26.233 INFO:teuthology.orchestra.run.smithi155.stdout: "duration": 0.068018577999999996, 2023-08-01T19:56:26.233 INFO:teuthology.orchestra.run.smithi155.stdout: "type_data": { 2023-08-01T19:56:26.233 INFO:teuthology.orchestra.run.smithi155.stdout: "flag_point": "commit sent; apply or cleanup", 2023-08-01T19:56:26.233 INFO:teuthology.orchestra.run.smithi155.stdout: "events": [ 2023-08-01T19:56:26.233 INFO:teuthology.orchestra.run.smithi155.stdout: { 2023-08-01T19:56:26.233 INFO:teuthology.orchestra.run.smithi155.stdout: "event": "initiated", 2023-08-01T19:56:26.234 INFO:teuthology.orchestra.run.smithi155.stdout: "time": "2023-08-01T19:55:05.156952+0000", 2023-08-01T19:56:26.234 INFO:teuthology.orchestra.run.smithi155.stdout: "duration": 0 2023-08-01T19:56:26.234 INFO:teuthology.orchestra.run.smithi155.stdout: }, 2023-08-01T19:56:26.234 INFO:teuthology.orchestra.run.smithi155.stdout: { 2023-08-01T19:56:26.234 INFO:teuthology.orchestra.run.smithi155.stdout: "event": "throttled", 2023-08-01T19:56:26.234 INFO:teuthology.orchestra.run.smithi155.stdout: "time": "2023-08-01T19:55:05.156952+0000", 2023-08-01T19:56:26.234 INFO:teuthology.orchestra.run.smithi155.stdout: "duration": 0 2023-08-01T19:56:26.234 INFO:teuthology.orchestra.run.smithi155.stdout: }, 2023-08-01T19:56:26.235 INFO:teuthology.orchestra.run.smithi155.stdout: { 2023-08-01T19:56:26.235 INFO:teuthology.orchestra.run.smithi155.stdout: "event": "header_read", 2023-08-01T19:56:26.235 INFO:teuthology.orchestra.run.smithi155.stdout: "time": "2023-08-01T19:55:05.156951+0000", 2023-08-01T19:56:26.235 INFO:teuthology.orchestra.run.smithi155.stdout: "duration": 4294967295.999999 2023-08-01T19:56:26.235 INFO:teuthology.orchestra.run.smithi155.stdout: }, 2023-08-01T19:56:26.235 INFO:teuthology.orchestra.run.smithi155.stdout: { 2023-08-01T19:56:26.235 INFO:teuthology.orchestra.run.smithi155.stdout: "event": "all_read", 2023-08-01T19:56:26.235 INFO:teuthology.orchestra.run.smithi155.stdout: "time": "2023-08-01T19:55:05.156989+0000", 2023-08-01T19:56:26.236 INFO:teuthology.orchestra.run.smithi155.stdout: "duration": 3.8175e-05 2023-08-01T19:56:26.236 INFO:teuthology.orchestra.run.smithi155.stdout: }, 2023-08-01T19:56:26.236 INFO:teuthology.orchestra.run.smithi155.stdout: { 2023-08-01T19:56:26.236 INFO:teuthology.orchestra.run.smithi155.stdout: "event": "dispatched", 2023-08-01T19:56:26.236 INFO:teuthology.orchestra.run.smithi155.stdout: "time": "2023-08-01T19:55:05.218842+0000", 2023-08-01T19:56:26.236 INFO:teuthology.orchestra.run.smithi155.stdout: "duration": 0.061852299999999999 2023-08-01T19:56:26.236 INFO:teuthology.orchestra.run.smithi155.stdout: }, 2023-08-01T19:56:26.237 INFO:teuthology.orchestra.run.smithi155.stdout: { 2023-08-01T19:56:26.237 INFO:teuthology.orchestra.run.smithi155.stdout: "event": "queued_for_pg", 2023-08-01T19:56:26.237 INFO:teuthology.orchestra.run.smithi155.stdout: "time": "2023-08-01T19:55:05.218862+0000", 2023-08-01T19:56:26.237 INFO:teuthology.orchestra.run.smithi155.stdout: "duration": 1.9854999999999999e-05 2023-08-01T19:56:26.237 INFO:teuthology.orchestra.run.smithi155.stdout: }, 2023-08-01T19:56:26.237 INFO:teuthology.orchestra.run.smithi155.stdout: { 2023-08-01T19:56:26.237 INFO:teuthology.orchestra.run.smithi155.stdout: "event": "reached_pg", 2023-08-01T19:56:26.237 INFO:teuthology.orchestra.run.smithi155.stdout: "time": "2023-08-01T19:55:05.218918+0000", 2023-08-01T19:56:26.238 INFO:teuthology.orchestra.run.smithi155.stdout: "duration": 5.6570000000000002e-05 2023-08-01T19:56:26.238 INFO:teuthology.orchestra.run.smithi155.stdout: }, 2023-08-01T19:56:26.238 INFO:teuthology.orchestra.run.smithi155.stdout: { 2023-08-01T19:56:26.238 INFO:teuthology.orchestra.run.smithi155.stdout: "event": "started", 2023-08-01T19:56:26.238 INFO:teuthology.orchestra.run.smithi155.stdout: "time": "2023-08-01T19:55:05.218940+0000", 2023-08-01T19:56:26.238 INFO:teuthology.orchestra.run.smithi155.stdout: "duration": 2.1804e-05 2023-08-01T19:56:26.238 INFO:teuthology.orchestra.run.smithi155.stdout: }, 2023-08-01T19:56:26.238 INFO:teuthology.orchestra.run.smithi155.stdout: { 2023-08-01T19:56:26.239 INFO:teuthology.orchestra.run.smithi155.stdout: "event": "commit_sent", 2023-08-01T19:56:26.239 INFO:teuthology.orchestra.run.smithi155.stdout: "time": "2023-08-01T19:55:05.224928+0000", 2023-08-01T19:56:26.239 INFO:teuthology.orchestra.run.smithi155.stdout: "duration": 0.0059876759999999999 2023-08-01T19:56:26.239 INFO:teuthology.orchestra.run.smithi155.stdout: }, 2023-08-01T19:56:26.239 INFO:teuthology.orchestra.run.smithi155.stdout: { 2023-08-01T19:56:26.239 INFO:teuthology.orchestra.run.smithi155.stdout: "event": "done", 2023-08-01T19:56:26.239 INFO:teuthology.orchestra.run.smithi155.stdout: "time": "2023-08-01T19:55:05.224971+0000", 2023-08-01T19:56:26.239 INFO:teuthology.orchestra.run.smithi155.stdout: "duration": 4.2929999999999997e-05 2023-08-01T19:56:26.240 INFO:teuthology.orchestra.run.smithi155.stdout: } 2023-08-01T19:56:26.240 INFO:teuthology.orchestra.run.smithi155.stdout: ] 2023-08-01T19:56:26.240 INFO:teuthology.orchestra.run.smithi155.stdout: } 2023-08-01T19:56:26.240 INFO:teuthology.orchestra.run.smithi155.stdout: }, 2023-08-01T19:56:26.240 INFO:teuthology.orchestra.run.smithi155.stdout: { 2023-08-01T19:56:26.240 INFO:teuthology.orchestra.run.smithi155.stdout: "description": "osd_op(client.4668.0:100927 5.0 5:00608ec6:::benchmark_data_smithi006_114134_object100926:head [set-alloc-hint object_size 65536 write_size 65536,write 0~65536] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e37)", 2023-08-01T19:56:26.240 INFO:teuthology.orchestra.run.smithi155.stdout: "initiated_at": "2023-08-01T19:55:05.561169+0000", 2023-08-01T19:56:26.241 INFO:teuthology.orchestra.run.smithi155.stdout: "age": 80.574640690999999, 2023-08-01T19:56:26.241 INFO:teuthology.orchestra.run.smithi155.stdout: "duration": 0.066411687999999997, 2023-08-01T19:56:26.241 INFO:teuthology.orchestra.run.smithi155.stdout: "type_data": { 2023-08-01T19:56:26.241 INFO:teuthology.orchestra.run.smithi155.stdout: "flag_point": "commit sent; apply or cleanup", 2023-08-01T19:56:26.241 INFO:teuthology.orchestra.run.smithi155.stdout: "client_info": { 2023-08-01T19:56:26.241 INFO:teuthology.orchestra.run.smithi155.stdout: "client": "client.4668", 2023-08-01T19:56:26.241 INFO:teuthology.orchestra.run.smithi155.stdout: "client_addr": "172.21.15.6:0/1709472247", 2023-08-01T19:56:26.241 INFO:teuthology.orchestra.run.smithi155.stdout: "tid": 100927 2023-08-01T19:56:26.242 INFO:teuthology.orchestra.run.smithi155.stdout: }, 2023-08-01T19:56:26.242 INFO:teuthology.orchestra.run.smithi155.stdout: "events": [ 2023-08-01T19:56:26.242 INFO:teuthology.orchestra.run.smithi155.stdout: { 2023-08-01T19:56:26.242 INFO:teuthology.orchestra.run.smithi155.stdout: "event": "initiated", 2023-08-01T19:56:26.242 INFO:teuthology.orchestra.run.smithi155.stdout: "time": "2023-08-01T19:55:05.561169+0000", 2023-08-01T19:56:26.242 INFO:teuthology.orchestra.run.smithi155.stdout: "duration": 0 2023-08-01T19:56:26.242 INFO:teuthology.orchestra.run.smithi155.stdout: }, 2023-08-01T19:56:26.242 INFO:teuthology.orchestra.run.smithi155.stdout: { 2023-08-01T19:56:26.243 INFO:teuthology.orchestra.run.smithi155.stdout: "event": "throttled", 2023-08-01T19:56:26.243 INFO:teuthology.orchestra.run.smithi155.stdout: "time": "2023-08-01T19:55:05.561169+0000", 2023-08-01T19:56:26.243 INFO:teuthology.orchestra.run.smithi155.stdout: "duration": 0 2023-08-01T19:56:26.243 INFO:teuthology.orchestra.run.smithi155.stdout: }, 2023-08-01T19:56:26.243 INFO:teuthology.orchestra.run.smithi155.stdout: { 2023-08-01T19:56:26.243 INFO:teuthology.orchestra.run.smithi155.stdout: "event": "header_read", 2023-08-01T19:56:26.243 INFO:teuthology.orchestra.run.smithi155.stdout: "time": "2023-08-01T19:55:05.561168+0000", 2023-08-01T19:56:26.243 INFO:teuthology.orchestra.run.smithi155.stdout: "duration": 4294967295.9999995 2023-08-01T19:56:26.244 INFO:teuthology.orchestra.run.smithi155.stdout: }, 2023-08-01T19:56:26.244 INFO:teuthology.orchestra.run.smithi155.stdout: { 2023-08-01T19:56:26.244 INFO:teuthology.orchestra.run.smithi155.stdout: "event": "all_read", 2023-08-01T19:56:26.244 INFO:teuthology.orchestra.run.smithi155.stdout: "time": "2023-08-01T19:55:05.561218+0000", 2023-08-01T19:56:26.244 INFO:teuthology.orchestra.run.smithi155.stdout: "duration": 4.9379999999999998e-05 2023-08-01T19:56:26.244 INFO:teuthology.orchestra.run.smithi155.stdout: }, 2023-08-01T19:56:26.244 INFO:teuthology.orchestra.run.smithi155.stdout: { 2023-08-01T19:56:26.244 INFO:teuthology.orchestra.run.smithi155.stdout: "event": "dispatched", 2023-08-01T19:56:26.245 INFO:teuthology.orchestra.run.smithi155.stdout: "time": "2023-08-01T19:55:05.561225+0000", 2023-08-01T19:56:26.245 INFO:teuthology.orchestra.run.smithi155.stdout: "duration": 7.114e-06 2023-08-01T19:56:26.245 INFO:teuthology.orchestra.run.smithi155.stdout: }, 2023-08-01T19:56:26.245 INFO:teuthology.orchestra.run.smithi155.stdout: { 2023-08-01T19:56:26.245 INFO:teuthology.orchestra.run.smithi155.stdout: "event": "queued_for_pg", 2023-08-01T19:56:26.245 INFO:teuthology.orchestra.run.smithi155.stdout: "time": "2023-08-01T19:55:05.561229+0000", 2023-08-01T19:56:26.245 INFO:teuthology.orchestra.run.smithi155.stdout: "duration": 4.2180000000000001e-06 2023-08-01T19:56:26.246 INFO:teuthology.orchestra.run.smithi155.stdout: }, 2023-08-01T19:56:26.246 INFO:teuthology.orchestra.run.smithi155.stdout: { 2023-08-01T19:56:26.246 INFO:teuthology.orchestra.run.smithi155.stdout: "event": "reached_pg", 2023-08-01T19:56:26.246 INFO:teuthology.orchestra.run.smithi155.stdout: "time": "2023-08-01T19:55:05.564737+0000", 2023-08-01T19:56:26.246 INFO:teuthology.orchestra.run.smithi155.stdout: "duration": 0.0035081869999999999 2023-08-01T19:56:26.246 INFO:teuthology.orchestra.run.smithi155.stdout: }, 2023-08-01T19:56:26.246 INFO:teuthology.orchestra.run.smithi155.stdout: { 2023-08-01T19:56:26.246 INFO:teuthology.orchestra.run.smithi155.stdout: "event": "started", 2023-08-01T19:56:26.247 INFO:teuthology.orchestra.run.smithi155.stdout: "time": "2023-08-01T19:55:05.564859+0000", 2023-08-01T19:56:26.247 INFO:teuthology.orchestra.run.smithi155.stdout: "duration": 0.00012165800000000001 2023-08-01T19:56:26.247 INFO:teuthology.orchestra.run.smithi155.stdout: }, 2023-08-01T19:56:26.247 INFO:teuthology.orchestra.run.smithi155.stdout: { 2023-08-01T19:56:26.247 INFO:teuthology.orchestra.run.smithi155.stdout: "event": "waiting for subops from 0", 2023-08-01T19:56:26.247 INFO:teuthology.orchestra.run.smithi155.stdout: "time": "2023-08-01T19:55:05.565009+0000", 2023-08-01T19:56:26.247 INFO:teuthology.orchestra.run.smithi155.stdout: "duration": 0.00014979699999999999 2023-08-01T19:56:26.247 INFO:teuthology.orchestra.run.smithi155.stdout: }, 2023-08-01T19:56:26.248 INFO:teuthology.orchestra.run.smithi155.stdout: { 2023-08-01T19:56:26.248 INFO:teuthology.orchestra.run.smithi155.stdout: "event": "op_commit", 2023-08-01T19:56:26.248 INFO:teuthology.orchestra.run.smithi155.stdout: "time": "2023-08-01T19:55:05.568007+0000", 2023-08-01T19:56:26.248 INFO:teuthology.orchestra.run.smithi155.stdout: "duration": 0.00299796 2023-08-01T19:56:26.248 INFO:teuthology.orchestra.run.smithi155.stdout: }, 2023-08-01T19:56:26.248 INFO:teuthology.orchestra.run.smithi155.stdout: { 2023-08-01T19:56:26.248 INFO:teuthology.orchestra.run.smithi155.stdout: "event": "sub_op_commit_rec", 2023-08-01T19:56:26.249 INFO:teuthology.orchestra.run.smithi155.stdout: "time": "2023-08-01T19:55:05.627520+0000", 2023-08-01T19:56:26.249 INFO:teuthology.orchestra.run.smithi155.stdout: "duration": 0.059513636000000002 2023-08-01T19:56:26.249 INFO:teuthology.orchestra.run.smithi155.stdout: }, 2023-08-01T19:56:26.249 INFO:teuthology.orchestra.run.smithi155.stdout: { 2023-08-01T19:56:26.249 INFO:teuthology.orchestra.run.smithi155.stdout: "event": "commit_sent", 2023-08-01T19:56:26.249 INFO:teuthology.orchestra.run.smithi155.stdout: "time": "2023-08-01T19:55:05.627553+0000", 2023-08-01T19:56:26.249 INFO:teuthology.orchestra.run.smithi155.stdout: "duration": 3.2635999999999997e-05 2023-08-01T19:56:26.249 INFO:teuthology.orchestra.run.smithi155.stdout: }, 2023-08-01T19:56:26.250 INFO:teuthology.orchestra.run.smithi155.stdout: { 2023-08-01T19:56:26.250 INFO:teuthology.orchestra.run.smithi155.stdout: "event": "done", 2023-08-01T19:56:26.250 INFO:teuthology.orchestra.run.smithi155.stdout: "time": "2023-08-01T19:55:05.627581+0000", 2023-08-01T19:56:26.250 INFO:teuthology.orchestra.run.smithi155.stdout: "duration": 2.7681000000000001e-05 2023-08-01T19:56:26.250 INFO:teuthology.orchestra.run.smithi155.stdout: } 2023-08-01T19:56:26.250 INFO:teuthology.orchestra.run.smithi155.stdout: ] 2023-08-01T19:56:26.250 INFO:teuthology.orchestra.run.smithi155.stdout: } 2023-08-01T19:56:26.250 INFO:teuthology.orchestra.run.smithi155.stdout: }, 2023-08-01T19:56:26.251 INFO:teuthology.orchestra.run.smithi155.stdout: { 2023-08-01T19:56:26.251 INFO:teuthology.orchestra.run.smithi155.stdout: "description": "osd_op(client.4668.0:100935 5.e 5:7895b14e:::benchmark_data_smithi006_114134_object100934:head [set-alloc-hint object_size 65536 write_size 65536,write 0~65536] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e37)", 2023-08-01T19:56:26.251 INFO:teuthology.orchestra.run.smithi155.stdout: "initiated_at": "2023-08-01T19:55:05.566666+0000", 2023-08-01T19:56:26.251 INFO:teuthology.orchestra.run.smithi155.stdout: "age": 80.569143390999997, 2023-08-01T19:56:26.251 INFO:teuthology.orchestra.run.smithi155.stdout: "duration": 0.064309016999999996, 2023-08-01T19:56:26.251 INFO:teuthology.orchestra.run.smithi155.stdout: "type_data": { 2023-08-01T19:56:26.251 INFO:teuthology.orchestra.run.smithi155.stdout: "flag_point": "commit sent; apply or cleanup", 2023-08-01T19:56:26.251 INFO:teuthology.orchestra.run.smithi155.stdout: "client_info": { 2023-08-01T19:56:26.252 INFO:teuthology.orchestra.run.smithi155.stdout: "client": "client.4668", 2023-08-01T19:56:26.252 INFO:teuthology.orchestra.run.smithi155.stdout: "client_addr": "172.21.15.6:0/1709472247", 2023-08-01T19:56:26.252 INFO:teuthology.orchestra.run.smithi155.stdout: "tid": 100935 2023-08-01T19:56:26.252 INFO:teuthology.orchestra.run.smithi155.stdout: }, 2023-08-01T19:56:26.252 INFO:teuthology.orchestra.run.smithi155.stdout: "events": [ 2023-08-01T19:56:26.252 INFO:teuthology.orchestra.run.smithi155.stdout: { 2023-08-01T19:56:26.252 INFO:teuthology.orchestra.run.smithi155.stdout: "event": "initiated", 2023-08-01T19:56:26.252 INFO:teuthology.orchestra.run.smithi155.stdout: "time": "2023-08-01T19:55:05.566666+0000", 2023-08-01T19:56:26.253 INFO:teuthology.orchestra.run.smithi155.stdout: "duration": 0 2023-08-01T19:56:26.253 INFO:teuthology.orchestra.run.smithi155.stdout: }, 2023-08-01T19:56:26.253 INFO:teuthology.orchestra.run.smithi155.stdout: { 2023-08-01T19:56:26.253 INFO:teuthology.orchestra.run.smithi155.stdout: "event": "throttled", 2023-08-01T19:56:26.253 INFO:teuthology.orchestra.run.smithi155.stdout: "time": "2023-08-01T19:55:05.566666+0000", 2023-08-01T19:56:26.253 INFO:teuthology.orchestra.run.smithi155.stdout: "duration": 0 2023-08-01T19:56:26.253 INFO:teuthology.orchestra.run.smithi155.stdout: }, 2023-08-01T19:56:26.253 INFO:teuthology.orchestra.run.smithi155.stdout: { 2023-08-01T19:56:26.254 INFO:teuthology.orchestra.run.smithi155.stdout: "event": "header_read", 2023-08-01T19:56:26.254 INFO:teuthology.orchestra.run.smithi155.stdout: "time": "2023-08-01T19:55:05.566665+0000", 2023-08-01T19:56:26.254 INFO:teuthology.orchestra.run.smithi155.stdout: "duration": 4294967295.9999986 2023-08-01T19:56:26.254 INFO:teuthology.orchestra.run.smithi155.stdout: }, 2023-08-01T19:56:26.254 INFO:teuthology.orchestra.run.smithi155.stdout: { 2023-08-01T19:56:26.254 INFO:teuthology.orchestra.run.smithi155.stdout: "event": "all_read", 2023-08-01T19:56:26.254 INFO:teuthology.orchestra.run.smithi155.stdout: "time": "2023-08-01T19:55:05.566754+0000", 2023-08-01T19:56:26.254 INFO:teuthology.orchestra.run.smithi155.stdout: "duration": 8.9425999999999994e-05 2023-08-01T19:56:26.255 INFO:teuthology.orchestra.run.smithi155.stdout: }, 2023-08-01T19:56:26.255 INFO:teuthology.orchestra.run.smithi155.stdout: { 2023-08-01T19:56:26.255 INFO:teuthology.orchestra.run.smithi155.stdout: "event": "dispatched", 2023-08-01T19:56:26.255 INFO:teuthology.orchestra.run.smithi155.stdout: "time": "2023-08-01T19:55:05.566766+0000", 2023-08-01T19:56:26.255 INFO:teuthology.orchestra.run.smithi155.stdout: "duration": 1.2018000000000001e-05 2023-08-01T19:56:26.255 INFO:teuthology.orchestra.run.smithi155.stdout: }, 2023-08-01T19:56:26.255 INFO:teuthology.orchestra.run.smithi155.stdout: { 2023-08-01T19:56:26.255 INFO:teuthology.orchestra.run.smithi155.stdout: "event": "queued_for_pg", 2023-08-01T19:56:26.256 INFO:teuthology.orchestra.run.smithi155.stdout: "time": "2023-08-01T19:55:05.566772+0000", 2023-08-01T19:56:26.256 INFO:teuthology.orchestra.run.smithi155.stdout: "duration": 6.0190000000000003e-06 2023-08-01T19:56:26.256 INFO:teuthology.orchestra.run.smithi155.stdout: }, 2023-08-01T19:56:26.256 INFO:teuthology.orchestra.run.smithi155.stdout: { 2023-08-01T19:56:26.256 INFO:teuthology.orchestra.run.smithi155.stdout: "event": "reached_pg", 2023-08-01T19:56:26.256 INFO:teuthology.orchestra.run.smithi155.stdout: "time": "2023-08-01T19:55:05.566800+0000", 2023-08-01T19:56:26.256 INFO:teuthology.orchestra.run.smithi155.stdout: "duration": 2.7835999999999999e-05 2023-08-01T19:56:26.257 INFO:teuthology.orchestra.run.smithi155.stdout: }, 2023-08-01T19:56:26.257 INFO:teuthology.orchestra.run.smithi155.stdout: { 2023-08-01T19:56:26.257 INFO:teuthology.orchestra.run.smithi155.stdout: "event": "started", 2023-08-01T19:56:26.257 INFO:teuthology.orchestra.run.smithi155.stdout: "time": "2023-08-01T19:55:05.566879+0000", 2023-08-01T19:56:26.257 INFO:teuthology.orchestra.run.smithi155.stdout: "duration": 7.9105999999999998e-05 2023-08-01T19:56:26.257 INFO:teuthology.orchestra.run.smithi155.stdout: }, 2023-08-01T19:56:26.257 INFO:teuthology.orchestra.run.smithi155.stdout: { 2023-08-01T19:56:26.258 INFO:teuthology.orchestra.run.smithi155.stdout: "event": "waiting for subops from 0", 2023-08-01T19:56:26.258 INFO:teuthology.orchestra.run.smithi155.stdout: "time": "2023-08-01T19:55:05.566971+0000", 2023-08-01T19:56:26.258 INFO:teuthology.orchestra.run.smithi155.stdout: "duration": 9.1817999999999994e-05 2023-08-01T19:56:26.258 INFO:teuthology.orchestra.run.smithi155.stdout: }, 2023-08-01T19:56:26.258 INFO:teuthology.orchestra.run.smithi155.stdout: { 2023-08-01T19:56:26.258 INFO:teuthology.orchestra.run.smithi155.stdout: "event": "op_commit", 2023-08-01T19:56:26.258 INFO:teuthology.orchestra.run.smithi155.stdout: "time": "2023-08-01T19:55:05.571475+0000", 2023-08-01T19:56:26.258 INFO:teuthology.orchestra.run.smithi155.stdout: "duration": 0.0045039499999999996 2023-08-01T19:56:26.259 INFO:teuthology.orchestra.run.smithi155.stdout: }, 2023-08-01T19:56:26.259 INFO:teuthology.orchestra.run.smithi155.stdout: { 2023-08-01T19:56:26.259 INFO:teuthology.orchestra.run.smithi155.stdout: "event": "sub_op_commit_rec", 2023-08-01T19:56:26.259 INFO:teuthology.orchestra.run.smithi155.stdout: "time": "2023-08-01T19:55:05.630884+0000", 2023-08-01T19:56:26.259 INFO:teuthology.orchestra.run.smithi155.stdout: "duration": 0.059409181999999998 2023-08-01T19:56:26.259 INFO:teuthology.orchestra.run.smithi155.stdout: }, 2023-08-01T19:56:26.259 INFO:teuthology.orchestra.run.smithi155.stdout: { 2023-08-01T19:56:26.259 INFO:teuthology.orchestra.run.smithi155.stdout: "event": "commit_sent", 2023-08-01T19:56:26.260 INFO:teuthology.orchestra.run.smithi155.stdout: "time": "2023-08-01T19:55:05.630930+0000", 2023-08-01T19:56:26.260 INFO:teuthology.orchestra.run.smithi155.stdout: "duration": 4.5507999999999999e-05 2023-08-01T19:56:26.260 INFO:teuthology.orchestra.run.smithi155.stdout: }, 2023-08-01T19:56:26.260 INFO:teuthology.orchestra.run.smithi155.stdout: { 2023-08-01T19:56:26.260 INFO:teuthology.orchestra.run.smithi155.stdout: "event": "done", 2023-08-01T19:56:26.260 INFO:teuthology.orchestra.run.smithi155.stdout: "time": "2023-08-01T19:55:05.630975+0000", 2023-08-01T19:56:26.260 INFO:teuthology.orchestra.run.smithi155.stdout: "duration": 4.5441000000000001e-05 2023-08-01T19:56:26.260 INFO:teuthology.orchestra.run.smithi155.stdout: } 2023-08-01T19:56:26.261 INFO:teuthology.orchestra.run.smithi155.stdout: ] 2023-08-01T19:56:26.261 INFO:teuthology.orchestra.run.smithi155.stdout: } 2023-08-01T19:56:26.261 INFO:teuthology.orchestra.run.smithi155.stdout: }, 2023-08-01T19:56:26.261 INFO:teuthology.orchestra.run.smithi155.stdout: { 2023-08-01T19:56:26.261 INFO:teuthology.orchestra.run.smithi155.stdout: "description": "osd_op(client.4668.0:100941 5.e 5:736a6ac6:::benchmark_data_smithi006_114134_object100940:head [set-alloc-hint object_size 65536 write_size 65536,write 0~65536] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e37)", 2023-08-01T19:56:26.261 INFO:teuthology.orchestra.run.smithi155.stdout: "initiated_at": "2023-08-01T19:55:05.569750+0000", 2023-08-01T19:56:26.261 INFO:teuthology.orchestra.run.smithi155.stdout: "age": 80.566059498000001, 2023-08-01T19:56:26.262 INFO:teuthology.orchestra.run.smithi155.stdout: "duration": 0.065431331999999995, 2023-08-01T19:56:26.262 INFO:teuthology.orchestra.run.smithi155.stdout: "type_data": { 2023-08-01T19:56:26.262 INFO:teuthology.orchestra.run.smithi155.stdout: "flag_point": "commit sent; apply or cleanup", 2023-08-01T19:56:26.262 INFO:teuthology.orchestra.run.smithi155.stdout: "client_info": { 2023-08-01T19:56:26.262 INFO:teuthology.orchestra.run.smithi155.stdout: "client": "client.4668", 2023-08-01T19:56:26.262 INFO:teuthology.orchestra.run.smithi155.stdout: "client_addr": "172.21.15.6:0/1709472247", 2023-08-01T19:56:26.262 INFO:teuthology.orchestra.run.smithi155.stdout: "tid": 100941 2023-08-01T19:56:26.262 INFO:teuthology.orchestra.run.smithi155.stdout: }, 2023-08-01T19:56:26.263 INFO:teuthology.orchestra.run.smithi155.stdout: "events": [ 2023-08-01T19:56:26.263 INFO:teuthology.orchestra.run.smithi155.stdout: { 2023-08-01T19:56:26.263 INFO:teuthology.orchestra.run.smithi155.stdout: "event": "initiated", 2023-08-01T19:56:26.263 INFO:teuthology.orchestra.run.smithi155.stdout: "time": "2023-08-01T19:55:05.569750+0000", 2023-08-01T19:56:26.263 INFO:teuthology.orchestra.run.smithi155.stdout: "duration": 0 2023-08-01T19:56:26.263 INFO:teuthology.orchestra.run.smithi155.stdout: }, 2023-08-01T19:56:26.263 INFO:teuthology.orchestra.run.smithi155.stdout: { 2023-08-01T19:56:26.263 INFO:teuthology.orchestra.run.smithi155.stdout: "event": "throttled", 2023-08-01T19:56:26.264 INFO:teuthology.orchestra.run.smithi155.stdout: "time": "2023-08-01T19:55:05.569750+0000", 2023-08-01T19:56:26.264 INFO:teuthology.orchestra.run.smithi155.stdout: "duration": 0 2023-08-01T19:56:26.264 INFO:teuthology.orchestra.run.smithi155.stdout: }, 2023-08-01T19:56:26.264 INFO:teuthology.orchestra.run.smithi155.stdout: { 2023-08-01T19:56:26.264 INFO:teuthology.orchestra.run.smithi155.stdout: "event": "header_read", 2023-08-01T19:56:26.264 INFO:teuthology.orchestra.run.smithi155.stdout: "time": "2023-08-01T19:55:05.569749+0000", 2023-08-01T19:56:26.264 INFO:teuthology.orchestra.run.smithi155.stdout: "duration": 4294967295.999999 2023-08-01T19:56:26.265 INFO:teuthology.orchestra.run.smithi155.stdout: }, 2023-08-01T19:56:26.265 INFO:teuthology.orchestra.run.smithi155.stdout: { 2023-08-01T19:56:26.265 INFO:teuthology.orchestra.run.smithi155.stdout: "event": "all_read", 2023-08-01T19:56:26.265 INFO:teuthology.orchestra.run.smithi155.stdout: "time": "2023-08-01T19:55:05.569861+0000", 2023-08-01T19:56:26.265 INFO:teuthology.orchestra.run.smithi155.stdout: "duration": 0.000111333 2023-08-01T19:56:26.265 INFO:teuthology.orchestra.run.smithi155.stdout: }, 2023-08-01T19:56:26.265 INFO:teuthology.orchestra.run.smithi155.stdout: { 2023-08-01T19:56:26.265 INFO:teuthology.orchestra.run.smithi155.stdout: "event": "dispatched", 2023-08-01T19:56:26.266 INFO:teuthology.orchestra.run.smithi155.stdout: "time": "2023-08-01T19:55:05.569869+0000", 2023-08-01T19:56:26.266 INFO:teuthology.orchestra.run.smithi155.stdout: "duration": 8.8589999999999994e-06 2023-08-01T19:56:26.266 INFO:teuthology.orchestra.run.smithi155.stdout: }, 2023-08-01T19:56:26.266 INFO:teuthology.orchestra.run.smithi155.stdout: { 2023-08-01T19:56:26.266 INFO:teuthology.orchestra.run.smithi155.stdout: "event": "queued_for_pg", 2023-08-01T19:56:26.266 INFO:teuthology.orchestra.run.smithi155.stdout: "time": "2023-08-01T19:55:05.569874+0000", 2023-08-01T19:56:26.266 INFO:teuthology.orchestra.run.smithi155.stdout: "duration": 4.1679999999999997e-06 2023-08-01T19:56:26.266 INFO:teuthology.orchestra.run.smithi155.stdout: }, 2023-08-01T19:56:26.267 INFO:teuthology.orchestra.run.smithi155.stdout: { 2023-08-01T19:56:26.267 INFO:teuthology.orchestra.run.smithi155.stdout: "event": "reached_pg", 2023-08-01T19:56:26.267 INFO:teuthology.orchestra.run.smithi155.stdout: "time": "2023-08-01T19:55:05.569904+0000", 2023-08-01T19:56:26.267 INFO:teuthology.orchestra.run.smithi155.stdout: "duration": 3.0920999999999998e-05 2023-08-01T19:56:26.267 INFO:teuthology.orchestra.run.smithi155.stdout: }, 2023-08-01T19:56:26.267 INFO:teuthology.orchestra.run.smithi155.stdout: { 2023-08-01T19:56:26.267 INFO:teuthology.orchestra.run.smithi155.stdout: "event": "started", 2023-08-01T19:56:26.267 INFO:teuthology.orchestra.run.smithi155.stdout: "time": "2023-08-01T19:55:05.569998+0000", 2023-08-01T19:56:26.268 INFO:teuthology.orchestra.run.smithi155.stdout: "duration": 9.3086999999999998e-05 2023-08-01T19:56:26.268 INFO:teuthology.orchestra.run.smithi155.stdout: }, 2023-08-01T19:56:26.268 INFO:teuthology.orchestra.run.smithi155.stdout: { 2023-08-01T19:56:26.268 INFO:teuthology.orchestra.run.smithi155.stdout: "event": "waiting for subops from 0", 2023-08-01T19:56:26.268 INFO:teuthology.orchestra.run.smithi155.stdout: "time": "2023-08-01T19:55:05.570093+0000", 2023-08-01T19:56:26.268 INFO:teuthology.orchestra.run.smithi155.stdout: "duration": 9.5768999999999997e-05 2023-08-01T19:56:26.268 INFO:teuthology.orchestra.run.smithi155.stdout: }, 2023-08-01T19:56:26.269 INFO:teuthology.orchestra.run.smithi155.stdout: { 2023-08-01T19:56:26.269 INFO:teuthology.orchestra.run.smithi155.stdout: "event": "op_commit", 2023-08-01T19:56:26.269 INFO:teuthology.orchestra.run.smithi155.stdout: "time": "2023-08-01T19:55:05.572839+0000", 2023-08-01T19:56:26.269 INFO:teuthology.orchestra.run.smithi155.stdout: "duration": 0.0027460050000000001 2023-08-01T19:56:26.269 INFO:teuthology.orchestra.run.smithi155.stdout: }, 2023-08-01T19:56:26.269 INFO:teuthology.orchestra.run.smithi155.stdout: { 2023-08-01T19:56:26.269 INFO:teuthology.orchestra.run.smithi155.stdout: "event": "sub_op_commit_rec", 2023-08-01T19:56:26.269 INFO:teuthology.orchestra.run.smithi155.stdout: "time": "2023-08-01T19:55:05.635114+0000", 2023-08-01T19:56:26.270 INFO:teuthology.orchestra.run.smithi155.stdout: "duration": 0.062274297999999999 2023-08-01T19:56:26.270 INFO:teuthology.orchestra.run.smithi155.stdout: }, 2023-08-01T19:56:26.270 INFO:teuthology.orchestra.run.smithi155.stdout: { 2023-08-01T19:56:26.270 INFO:teuthology.orchestra.run.smithi155.stdout: "event": "commit_sent", 2023-08-01T19:56:26.270 INFO:teuthology.orchestra.run.smithi155.stdout: "time": "2023-08-01T19:55:05.635143+0000", 2023-08-01T19:56:26.270 INFO:teuthology.orchestra.run.smithi155.stdout: "duration": 2.9430000000000001e-05 2023-08-01T19:56:26.270 INFO:teuthology.orchestra.run.smithi155.stdout: }, 2023-08-01T19:56:26.271 INFO:teuthology.orchestra.run.smithi155.stdout: { 2023-08-01T19:56:26.271 INFO:teuthology.orchestra.run.smithi155.stdout: "event": "done", 2023-08-01T19:56:26.271 INFO:teuthology.orchestra.run.smithi155.stdout: "time": "2023-08-01T19:55:05.635181+0000", 2023-08-01T19:56:26.271 INFO:teuthology.orchestra.run.smithi155.stdout: "duration": 3.8352000000000001e-05 2023-08-01T19:56:26.271 INFO:teuthology.orchestra.run.smithi155.stdout: } 2023-08-01T19:56:26.271 INFO:teuthology.orchestra.run.smithi155.stdout: ] 2023-08-01T19:56:26.271 INFO:teuthology.orchestra.run.smithi155.stdout: } 2023-08-01T19:56:26.271 INFO:teuthology.orchestra.run.smithi155.stdout: }, 2023-08-01T19:56:26.272 INFO:teuthology.orchestra.run.smithi155.stdout: { 2023-08-01T19:56:26.272 INFO:teuthology.orchestra.run.smithi155.stdout: "description": "osd_op(client.4668.0:100945 5.e 5:73df68dd:::benchmark_data_smithi006_114134_object100944:head [set-alloc-hint object_size 65536 write_size 65536,write 0~65536] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e37)", 2023-08-01T19:56:26.272 INFO:teuthology.orchestra.run.smithi155.stdout: "initiated_at": "2023-08-01T19:55:05.576784+0000", 2023-08-01T19:56:26.272 INFO:teuthology.orchestra.run.smithi155.stdout: "age": 80.559025912999999, 2023-08-01T19:56:26.272 INFO:teuthology.orchestra.run.smithi155.stdout: "duration": 0.058512994999999998, 2023-08-01T19:56:26.272 INFO:teuthology.orchestra.run.smithi155.stdout: "type_data": { 2023-08-01T19:56:26.272 INFO:teuthology.orchestra.run.smithi155.stdout: "flag_point": "commit sent; apply or cleanup", 2023-08-01T19:56:26.272 INFO:teuthology.orchestra.run.smithi155.stdout: "client_info": { 2023-08-01T19:56:26.273 INFO:teuthology.orchestra.run.smithi155.stdout: "client": "client.4668", 2023-08-01T19:56:26.273 INFO:teuthology.orchestra.run.smithi155.stdout: "client_addr": "172.21.15.6:0/1709472247", 2023-08-01T19:56:26.273 INFO:teuthology.orchestra.run.smithi155.stdout: "tid": 100945 2023-08-01T19:56:26.273 INFO:teuthology.orchestra.run.smithi155.stdout: }, 2023-08-01T19:56:26.273 INFO:teuthology.orchestra.run.smithi155.stdout: "events": [ 2023-08-01T19:56:26.273 INFO:teuthology.orchestra.run.smithi155.stdout: { 2023-08-01T19:56:26.273 INFO:teuthology.orchestra.run.smithi155.stdout: "event": "initiated", 2023-08-01T19:56:26.273 INFO:teuthology.orchestra.run.smithi155.stdout: "time": "2023-08-01T19:55:05.576784+0000", 2023-08-01T19:56:26.274 INFO:teuthology.orchestra.run.smithi155.stdout: "duration": 0 2023-08-01T19:56:26.274 INFO:teuthology.orchestra.run.smithi155.stdout: }, 2023-08-01T19:56:26.274 INFO:teuthology.orchestra.run.smithi155.stdout: { 2023-08-01T19:56:26.274 INFO:teuthology.orchestra.run.smithi155.stdout: "event": "throttled", 2023-08-01T19:56:26.274 INFO:teuthology.orchestra.run.smithi155.stdout: "time": "2023-08-01T19:55:05.576784+0000", 2023-08-01T19:56:26.274 INFO:teuthology.orchestra.run.smithi155.stdout: "duration": 0 2023-08-01T19:56:26.274 INFO:teuthology.orchestra.run.smithi155.stdout: }, 2023-08-01T19:56:26.275 INFO:teuthology.orchestra.run.smithi155.stdout: { 2023-08-01T19:56:26.275 INFO:teuthology.orchestra.run.smithi155.stdout: "event": "header_read", 2023-08-01T19:56:26.275 INFO:teuthology.orchestra.run.smithi155.stdout: "time": "2023-08-01T19:55:05.576783+0000", 2023-08-01T19:56:26.275 INFO:teuthology.orchestra.run.smithi155.stdout: "duration": 4294967295.9999995 2023-08-01T19:56:26.275 INFO:teuthology.orchestra.run.smithi155.stdout: }, 2023-08-01T19:56:26.275 INFO:teuthology.orchestra.run.smithi155.stdout: { 2023-08-01T19:56:26.275 INFO:teuthology.orchestra.run.smithi155.stdout: "event": "all_read", 2023-08-01T19:56:26.275 INFO:teuthology.orchestra.run.smithi155.stdout: "time": "2023-08-01T19:55:05.576807+0000", 2023-08-01T19:56:26.276 INFO:teuthology.orchestra.run.smithi155.stdout: "duration": 2.3651000000000001e-05 2023-08-01T19:56:26.276 INFO:teuthology.orchestra.run.smithi155.stdout: }, 2023-08-01T19:56:26.276 INFO:teuthology.orchestra.run.smithi155.stdout: { 2023-08-01T19:56:26.276 INFO:teuthology.orchestra.run.smithi155.stdout: "event": "dispatched", 2023-08-01T19:56:26.276 INFO:teuthology.orchestra.run.smithi155.stdout: "time": "2023-08-01T19:55:05.576817+0000", 2023-08-01T19:56:26.276 INFO:teuthology.orchestra.run.smithi155.stdout: "duration": 9.9389999999999992e-06 2023-08-01T19:56:26.276 INFO:teuthology.orchestra.run.smithi155.stdout: }, 2023-08-01T19:56:26.276 INFO:teuthology.orchestra.run.smithi155.stdout: { 2023-08-01T19:56:26.277 INFO:teuthology.orchestra.run.smithi155.stdout: "event": "queued_for_pg", 2023-08-01T19:56:26.277 INFO:teuthology.orchestra.run.smithi155.stdout: "time": "2023-08-01T19:55:05.576820+0000", 2023-08-01T19:56:26.277 INFO:teuthology.orchestra.run.smithi155.stdout: "duration": 3.2619999999999999e-06 2023-08-01T19:56:26.277 INFO:teuthology.orchestra.run.smithi155.stdout: }, 2023-08-01T19:56:26.277 INFO:teuthology.orchestra.run.smithi155.stdout: { 2023-08-01T19:56:26.277 INFO:teuthology.orchestra.run.smithi155.stdout: "event": "reached_pg", 2023-08-01T19:56:26.277 INFO:teuthology.orchestra.run.smithi155.stdout: "time": "2023-08-01T19:55:05.576849+0000", 2023-08-01T19:56:26.278 INFO:teuthology.orchestra.run.smithi155.stdout: "duration": 2.8880000000000001e-05 2023-08-01T19:56:26.278 INFO:teuthology.orchestra.run.smithi155.stdout: }, 2023-08-01T19:56:26.278 INFO:teuthology.orchestra.run.smithi155.stdout: { 2023-08-01T19:56:26.278 INFO:teuthology.orchestra.run.smithi155.stdout: "event": "started", 2023-08-01T19:56:26.278 INFO:teuthology.orchestra.run.smithi155.stdout: "time": "2023-08-01T19:55:05.576940+0000", 2023-08-01T19:56:26.278 INFO:teuthology.orchestra.run.smithi155.stdout: "duration": 9.0570999999999997e-05 2023-08-01T19:56:26.278 INFO:teuthology.orchestra.run.smithi155.stdout: }, 2023-08-01T19:56:26.278 INFO:teuthology.orchestra.run.smithi155.stdout: { 2023-08-01T19:56:26.279 INFO:teuthology.orchestra.run.smithi155.stdout: "event": "waiting for subops from 0", 2023-08-01T19:56:26.279 INFO:teuthology.orchestra.run.smithi155.stdout: "time": "2023-08-01T19:55:05.577027+0000", 2023-08-01T19:56:26.279 INFO:teuthology.orchestra.run.smithi155.stdout: "duration": 8.7237999999999994e-05 2023-08-01T19:56:26.279 INFO:teuthology.orchestra.run.smithi155.stdout: }, 2023-08-01T19:56:26.279 INFO:teuthology.orchestra.run.smithi155.stdout: { 2023-08-01T19:56:26.279 INFO:teuthology.orchestra.run.smithi155.stdout: "event": "op_commit", 2023-08-01T19:56:26.279 INFO:teuthology.orchestra.run.smithi155.stdout: "time": "2023-08-01T19:55:05.579624+0000", 2023-08-01T19:56:26.279 INFO:teuthology.orchestra.run.smithi155.stdout: "duration": 0.0025971200000000001 2023-08-01T19:56:26.280 INFO:teuthology.orchestra.run.smithi155.stdout: }, 2023-08-01T19:56:26.280 INFO:teuthology.orchestra.run.smithi155.stdout: { 2023-08-01T19:56:26.280 INFO:teuthology.orchestra.run.smithi155.stdout: "event": "sub_op_commit_rec", 2023-08-01T19:56:26.280 INFO:teuthology.orchestra.run.smithi155.stdout: "time": "2023-08-01T19:55:05.635218+0000", 2023-08-01T19:56:26.280 INFO:teuthology.orchestra.run.smithi155.stdout: "duration": 0.055594487999999997 2023-08-01T19:56:26.280 INFO:teuthology.orchestra.run.smithi155.stdout: }, 2023-08-01T19:56:26.280 INFO:teuthology.orchestra.run.smithi155.stdout: { 2023-08-01T19:56:26.280 INFO:teuthology.orchestra.run.smithi155.stdout: "event": "commit_sent", 2023-08-01T19:56:26.281 INFO:teuthology.orchestra.run.smithi155.stdout: "time": "2023-08-01T19:55:05.635262+0000", 2023-08-01T19:56:26.281 INFO:teuthology.orchestra.run.smithi155.stdout: "duration": 4.3380999999999997e-05 2023-08-01T19:56:26.281 INFO:teuthology.orchestra.run.smithi155.stdout: }, 2023-08-01T19:56:26.281 INFO:teuthology.orchestra.run.smithi155.stdout: { 2023-08-01T19:56:26.281 INFO:teuthology.orchestra.run.smithi155.stdout: "event": "done", 2023-08-01T19:56:26.281 INFO:teuthology.orchestra.run.smithi155.stdout: "time": "2023-08-01T19:55:05.635297+0000", 2023-08-01T19:56:26.281 INFO:teuthology.orchestra.run.smithi155.stdout: "duration": 3.4842000000000003e-05 2023-08-01T19:56:26.281 INFO:teuthology.orchestra.run.smithi155.stdout: } 2023-08-01T19:56:26.282 INFO:teuthology.orchestra.run.smithi155.stdout: ] 2023-08-01T19:56:26.282 INFO:teuthology.orchestra.run.smithi155.stdout: } 2023-08-01T19:56:26.282 INFO:teuthology.orchestra.run.smithi155.stdout: }, 2023-08-01T19:56:26.282 INFO:teuthology.orchestra.run.smithi155.stdout: { 2023-08-01T19:56:26.282 INFO:teuthology.orchestra.run.smithi155.stdout: "description": "osd_op(client.4668.0:100947 5.4 5:23e8fc27:::benchmark_data_smithi006_114134_object100946:head [set-alloc-hint object_size 65536 write_size 65536,write 0~65536] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e37)", 2023-08-01T19:56:26.282 INFO:teuthology.orchestra.run.smithi155.stdout: "initiated_at": "2023-08-01T19:55:05.576840+0000", 2023-08-01T19:56:26.282 INFO:teuthology.orchestra.run.smithi155.stdout: "age": 80.558969857999998, 2023-08-01T19:56:26.282 INFO:teuthology.orchestra.run.smithi155.stdout: "duration": 0.058423127999999998, 2023-08-01T19:56:26.283 INFO:teuthology.orchestra.run.smithi155.stdout: "type_data": { 2023-08-01T19:56:26.283 INFO:teuthology.orchestra.run.smithi155.stdout: "flag_point": "commit sent; apply or cleanup", 2023-08-01T19:56:26.283 INFO:teuthology.orchestra.run.smithi155.stdout: "client_info": { 2023-08-01T19:56:26.283 INFO:teuthology.orchestra.run.smithi155.stdout: "client": "client.4668", 2023-08-01T19:56:26.283 INFO:teuthology.orchestra.run.smithi155.stdout: "client_addr": "172.21.15.6:0/1709472247", 2023-08-01T19:56:26.283 INFO:teuthology.orchestra.run.smithi155.stdout: "tid": 100947 2023-08-01T19:56:26.283 INFO:teuthology.orchestra.run.smithi155.stdout: }, 2023-08-01T19:56:26.283 INFO:teuthology.orchestra.run.smithi155.stdout: "events": [ 2023-08-01T19:56:26.284 INFO:teuthology.orchestra.run.smithi155.stdout: { 2023-08-01T19:56:26.284 INFO:teuthology.orchestra.run.smithi155.stdout: "event": "initiated", 2023-08-01T19:56:26.284 INFO:teuthology.orchestra.run.smithi155.stdout: "time": "2023-08-01T19:55:05.576840+0000", 2023-08-01T19:56:26.284 INFO:teuthology.orchestra.run.smithi155.stdout: "duration": 0 2023-08-01T19:56:26.284 INFO:teuthology.orchestra.run.smithi155.stdout: }, 2023-08-01T19:56:26.284 INFO:teuthology.orchestra.run.smithi155.stdout: { 2023-08-01T19:56:26.284 INFO:teuthology.orchestra.run.smithi155.stdout: "event": "throttled", 2023-08-01T19:56:26.285 INFO:teuthology.orchestra.run.smithi155.stdout: "time": "2023-08-01T19:55:05.576840+0000", 2023-08-01T19:56:26.285 INFO:teuthology.orchestra.run.smithi155.stdout: "duration": 0 2023-08-01T19:56:26.285 INFO:teuthology.orchestra.run.smithi155.stdout: }, 2023-08-01T19:56:26.285 INFO:teuthology.orchestra.run.smithi155.stdout: { 2023-08-01T19:56:26.285 INFO:teuthology.orchestra.run.smithi155.stdout: "event": "header_read", 2023-08-01T19:56:26.285 INFO:teuthology.orchestra.run.smithi155.stdout: "time": "2023-08-01T19:55:05.576839+0000", 2023-08-01T19:56:26.285 INFO:teuthology.orchestra.run.smithi155.stdout: "duration": 4294967295.9999995 2023-08-01T19:56:26.285 INFO:teuthology.orchestra.run.smithi155.stdout: }, 2023-08-01T19:56:26.286 INFO:teuthology.orchestra.run.smithi155.stdout: { 2023-08-01T19:56:26.286 INFO:teuthology.orchestra.run.smithi155.stdout: "event": "all_read", 2023-08-01T19:56:26.286 INFO:teuthology.orchestra.run.smithi155.stdout: "time": "2023-08-01T19:55:05.576893+0000", 2023-08-01T19:56:26.286 INFO:teuthology.orchestra.run.smithi155.stdout: "duration": 5.3893000000000001e-05 2023-08-01T19:56:26.286 INFO:teuthology.orchestra.run.smithi155.stdout: }, 2023-08-01T19:56:26.286 INFO:teuthology.orchestra.run.smithi155.stdout: { 2023-08-01T19:56:26.286 INFO:teuthology.orchestra.run.smithi155.stdout: "event": "dispatched", 2023-08-01T19:56:26.286 INFO:teuthology.orchestra.run.smithi155.stdout: "time": "2023-08-01T19:55:05.576902+0000", 2023-08-01T19:56:26.287 INFO:teuthology.orchestra.run.smithi155.stdout: "duration": 8.7520000000000002e-06 2023-08-01T19:56:26.287 INFO:teuthology.orchestra.run.smithi155.stdout: }, 2023-08-01T19:56:26.287 INFO:teuthology.orchestra.run.smithi155.stdout: { 2023-08-01T19:56:26.287 INFO:teuthology.orchestra.run.smithi155.stdout: "event": "queued_for_pg", 2023-08-01T19:56:26.287 INFO:teuthology.orchestra.run.smithi155.stdout: "time": "2023-08-01T19:55:05.576905+0000", 2023-08-01T19:56:26.287 INFO:teuthology.orchestra.run.smithi155.stdout: "duration": 3.01e-06 2023-08-01T19:56:26.287 INFO:teuthology.orchestra.run.smithi155.stdout: }, 2023-08-01T19:56:26.287 INFO:teuthology.orchestra.run.smithi155.stdout: { 2023-08-01T19:56:26.288 INFO:teuthology.orchestra.run.smithi155.stdout: "event": "reached_pg", 2023-08-01T19:56:26.288 INFO:teuthology.orchestra.run.smithi155.stdout: "time": "2023-08-01T19:55:05.579641+0000", 2023-08-01T19:56:26.288 INFO:teuthology.orchestra.run.smithi155.stdout: "duration": 0.0027366880000000001 2023-08-01T19:56:26.288 INFO:teuthology.orchestra.run.smithi155.stdout: }, 2023-08-01T19:56:26.288 INFO:teuthology.orchestra.run.smithi155.stdout: { 2023-08-01T19:56:26.288 INFO:teuthology.orchestra.run.smithi155.stdout: "event": "started", 2023-08-01T19:56:26.288 INFO:teuthology.orchestra.run.smithi155.stdout: "time": "2023-08-01T19:55:05.579734+0000", 2023-08-01T19:56:26.288 INFO:teuthology.orchestra.run.smithi155.stdout: "duration": 9.2590000000000006e-05 2023-08-01T19:56:26.289 INFO:teuthology.orchestra.run.smithi155.stdout: }, 2023-08-01T19:56:26.289 INFO:teuthology.orchestra.run.smithi155.stdout: { 2023-08-01T19:56:26.289 INFO:teuthology.orchestra.run.smithi155.stdout: "event": "waiting for subops from 0", 2023-08-01T19:56:26.289 INFO:teuthology.orchestra.run.smithi155.stdout: "time": "2023-08-01T19:55:05.579825+0000", 2023-08-01T19:56:26.289 INFO:teuthology.orchestra.run.smithi155.stdout: "duration": 9.0964999999999994e-05 2023-08-01T19:56:26.289 INFO:teuthology.orchestra.run.smithi155.stdout: }, 2023-08-01T19:56:26.289 INFO:teuthology.orchestra.run.smithi155.stdout: { 2023-08-01T19:56:26.289 INFO:teuthology.orchestra.run.smithi155.stdout: "event": "op_commit", 2023-08-01T19:56:26.290 INFO:teuthology.orchestra.run.smithi155.stdout: "time": "2023-08-01T19:55:05.585041+0000", 2023-08-01T19:56:26.290 INFO:teuthology.orchestra.run.smithi155.stdout: "duration": 0.0052159670000000002 2023-08-01T19:56:26.290 INFO:teuthology.orchestra.run.smithi155.stdout: }, 2023-08-01T19:56:26.290 INFO:teuthology.orchestra.run.smithi155.stdout: { 2023-08-01T19:56:26.290 INFO:teuthology.orchestra.run.smithi155.stdout: "event": "sub_op_commit_rec", 2023-08-01T19:56:26.290 INFO:teuthology.orchestra.run.smithi155.stdout: "time": "2023-08-01T19:55:05.635199+0000", 2023-08-01T19:56:26.290 INFO:teuthology.orchestra.run.smithi155.stdout: "duration": 0.050158023000000003 2023-08-01T19:56:26.291 INFO:teuthology.orchestra.run.smithi155.stdout: }, 2023-08-01T19:56:26.291 INFO:teuthology.orchestra.run.smithi155.stdout: { 2023-08-01T19:56:26.291 INFO:teuthology.orchestra.run.smithi155.stdout: "event": "commit_sent", 2023-08-01T19:56:26.291 INFO:teuthology.orchestra.run.smithi155.stdout: "time": "2023-08-01T19:55:05.635227+0000", 2023-08-01T19:56:26.291 INFO:teuthology.orchestra.run.smithi155.stdout: "duration": 2.7821e-05 2023-08-01T19:56:26.291 INFO:teuthology.orchestra.run.smithi155.stdout: }, 2023-08-01T19:56:26.291 INFO:teuthology.orchestra.run.smithi155.stdout: { 2023-08-01T19:56:26.291 INFO:teuthology.orchestra.run.smithi155.stdout: "event": "done", 2023-08-01T19:56:26.292 INFO:teuthology.orchestra.run.smithi155.stdout: "time": "2023-08-01T19:55:05.635263+0000", 2023-08-01T19:56:26.292 INFO:teuthology.orchestra.run.smithi155.stdout: "duration": 3.6081000000000002e-05 2023-08-01T19:56:26.292 INFO:teuthology.orchestra.run.smithi155.stdout: } 2023-08-01T19:56:26.292 INFO:teuthology.orchestra.run.smithi155.stdout: ] 2023-08-01T19:56:26.292 INFO:teuthology.orchestra.run.smithi155.stdout: } 2023-08-01T19:56:26.292 INFO:teuthology.orchestra.run.smithi155.stdout: }, 2023-08-01T19:56:26.292 INFO:teuthology.orchestra.run.smithi155.stdout: { 2023-08-01T19:56:26.292 INFO:teuthology.orchestra.run.smithi155.stdout: "description": "osd_op(client.4668.0:197408 5.d 5:bbda375a:::benchmark_data_smithi006_114134_object63747:head [delete] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e61)", 2023-08-01T19:56:26.293 INFO:teuthology.orchestra.run.smithi155.stdout: "initiated_at": "2023-08-01T19:55:58.559714+0000", 2023-08-01T19:56:26.293 INFO:teuthology.orchestra.run.smithi155.stdout: "age": 27.576095871, 2023-08-01T19:56:26.293 INFO:teuthology.orchestra.run.smithi155.stdout: "duration": 1.047043671, 2023-08-01T19:56:26.293 INFO:teuthology.orchestra.run.smithi155.stdout: "type_data": { 2023-08-01T19:56:26.293 INFO:teuthology.orchestra.run.smithi155.stdout: "flag_point": "commit sent; apply or cleanup", 2023-08-01T19:56:26.293 INFO:teuthology.orchestra.run.smithi155.stdout: "client_info": { 2023-08-01T19:56:26.293 INFO:teuthology.orchestra.run.smithi155.stdout: "client": "client.4668", 2023-08-01T19:56:26.293 INFO:teuthology.orchestra.run.smithi155.stdout: "client_addr": "172.21.15.6:0/1709472247", 2023-08-01T19:56:26.294 INFO:teuthology.orchestra.run.smithi155.stdout: "tid": 197408 2023-08-01T19:56:26.294 INFO:teuthology.orchestra.run.smithi155.stdout: }, 2023-08-01T19:56:26.294 INFO:teuthology.orchestra.run.smithi155.stdout: "events": [ 2023-08-01T19:56:26.294 INFO:teuthology.orchestra.run.smithi155.stdout: { 2023-08-01T19:56:26.294 INFO:teuthology.orchestra.run.smithi155.stdout: "event": "initiated", 2023-08-01T19:56:26.294 INFO:teuthology.orchestra.run.smithi155.stdout: "time": "2023-08-01T19:55:58.559714+0000", 2023-08-01T19:56:26.294 INFO:teuthology.orchestra.run.smithi155.stdout: "duration": 0 2023-08-01T19:56:26.294 INFO:teuthology.orchestra.run.smithi155.stdout: }, 2023-08-01T19:56:26.295 INFO:teuthology.orchestra.run.smithi155.stdout: { 2023-08-01T19:56:26.295 INFO:teuthology.orchestra.run.smithi155.stdout: "event": "throttled", 2023-08-01T19:56:26.295 INFO:teuthology.orchestra.run.smithi155.stdout: "time": "2023-08-01T19:55:58.559714+0000", 2023-08-01T19:56:26.295 INFO:teuthology.orchestra.run.smithi155.stdout: "duration": 0 2023-08-01T19:56:26.295 INFO:teuthology.orchestra.run.smithi155.stdout: }, 2023-08-01T19:56:26.295 INFO:teuthology.orchestra.run.smithi155.stdout: { 2023-08-01T19:56:26.295 INFO:teuthology.orchestra.run.smithi155.stdout: "event": "header_read", 2023-08-01T19:56:26.295 INFO:teuthology.orchestra.run.smithi155.stdout: "time": "2023-08-01T19:55:58.559713+0000", 2023-08-01T19:56:26.296 INFO:teuthology.orchestra.run.smithi155.stdout: "duration": 4294967295.999999 2023-08-01T19:56:26.296 INFO:teuthology.orchestra.run.smithi155.stdout: }, 2023-08-01T19:56:26.296 INFO:teuthology.orchestra.run.smithi155.stdout: { 2023-08-01T19:56:26.296 INFO:teuthology.orchestra.run.smithi155.stdout: "event": "all_read", 2023-08-01T19:56:26.296 INFO:teuthology.orchestra.run.smithi155.stdout: "time": "2023-08-01T19:55:58.559717+0000", 2023-08-01T19:56:26.296 INFO:teuthology.orchestra.run.smithi155.stdout: "duration": 4.2860000000000001e-06 2023-08-01T19:56:26.296 INFO:teuthology.orchestra.run.smithi155.stdout: }, 2023-08-01T19:56:26.297 INFO:teuthology.orchestra.run.smithi155.stdout: { 2023-08-01T19:56:26.297 INFO:teuthology.orchestra.run.smithi155.stdout: "event": "dispatched", 2023-08-01T19:56:26.297 INFO:teuthology.orchestra.run.smithi155.stdout: "time": "2023-08-01T19:55:58.559774+0000", 2023-08-01T19:56:26.297 INFO:teuthology.orchestra.run.smithi155.stdout: "duration": 5.6508999999999997e-05 2023-08-01T19:56:26.297 INFO:teuthology.orchestra.run.smithi155.stdout: }, 2023-08-01T19:56:26.297 INFO:teuthology.orchestra.run.smithi155.stdout: { 2023-08-01T19:56:26.297 INFO:teuthology.orchestra.run.smithi155.stdout: "event": "queued_for_pg", 2023-08-01T19:56:26.297 INFO:teuthology.orchestra.run.smithi155.stdout: "time": "2023-08-01T19:55:58.559781+0000", 2023-08-01T19:56:26.298 INFO:teuthology.orchestra.run.smithi155.stdout: "duration": 7.1829999999999997e-06 2023-08-01T19:56:26.298 INFO:teuthology.orchestra.run.smithi155.stdout: }, 2023-08-01T19:56:26.298 INFO:teuthology.orchestra.run.smithi155.stdout: { 2023-08-01T19:56:26.298 INFO:teuthology.orchestra.run.smithi155.stdout: "event": "reached_pg", 2023-08-01T19:56:26.298 INFO:teuthology.orchestra.run.smithi155.stdout: "time": "2023-08-01T19:55:58.571621+0000", 2023-08-01T19:56:26.298 INFO:teuthology.orchestra.run.smithi155.stdout: "duration": 0.011840603999999999 2023-08-01T19:56:26.298 INFO:teuthology.orchestra.run.smithi155.stdout: }, 2023-08-01T19:56:26.298 INFO:teuthology.orchestra.run.smithi155.stdout: { 2023-08-01T19:56:26.299 INFO:teuthology.orchestra.run.smithi155.stdout: "event": "waiting for peered", 2023-08-01T19:56:26.299 INFO:teuthology.orchestra.run.smithi155.stdout: "time": "2023-08-01T19:55:58.571630+0000", 2023-08-01T19:56:26.299 INFO:teuthology.orchestra.run.smithi155.stdout: "duration": 8.9770000000000006e-06 2023-08-01T19:56:26.299 INFO:teuthology.orchestra.run.smithi155.stdout: }, 2023-08-01T19:56:26.299 INFO:teuthology.orchestra.run.smithi155.stdout: { 2023-08-01T19:56:26.299 INFO:teuthology.orchestra.run.smithi155.stdout: "event": "reached_pg", 2023-08-01T19:56:26.299 INFO:teuthology.orchestra.run.smithi155.stdout: "time": "2023-08-01T19:55:59.601300+0000", 2023-08-01T19:56:26.299 INFO:teuthology.orchestra.run.smithi155.stdout: "duration": 1.0296694989999999 2023-08-01T19:56:26.300 INFO:teuthology.orchestra.run.smithi155.stdout: }, 2023-08-01T19:56:26.300 INFO:teuthology.orchestra.run.smithi155.stdout: { 2023-08-01T19:56:26.300 INFO:teuthology.orchestra.run.smithi155.stdout: "event": "started", 2023-08-01T19:56:26.300 INFO:teuthology.orchestra.run.smithi155.stdout: "time": "2023-08-01T19:55:59.601448+0000", 2023-08-01T19:56:26.300 INFO:teuthology.orchestra.run.smithi155.stdout: "duration": 0.00014828399999999999 2023-08-01T19:56:26.300 INFO:teuthology.orchestra.run.smithi155.stdout: }, 2023-08-01T19:56:26.300 INFO:teuthology.orchestra.run.smithi155.stdout: { 2023-08-01T19:56:26.301 INFO:teuthology.orchestra.run.smithi155.stdout: "event": "op_commit", 2023-08-01T19:56:26.301 INFO:teuthology.orchestra.run.smithi155.stdout: "time": "2023-08-01T19:55:59.606616+0000", 2023-08-01T19:56:26.301 INFO:teuthology.orchestra.run.smithi155.stdout: "duration": 0.0051679769999999998 2023-08-01T19:56:26.301 INFO:teuthology.orchestra.run.smithi155.stdout: }, 2023-08-01T19:56:26.301 INFO:teuthology.orchestra.run.smithi155.stdout: { 2023-08-01T19:56:26.301 INFO:teuthology.orchestra.run.smithi155.stdout: "event": "commit_sent", 2023-08-01T19:56:26.301 INFO:teuthology.orchestra.run.smithi155.stdout: "time": "2023-08-01T19:55:59.606662+0000", 2023-08-01T19:56:26.301 INFO:teuthology.orchestra.run.smithi155.stdout: "duration": 4.5843000000000001e-05 2023-08-01T19:56:26.302 INFO:teuthology.orchestra.run.smithi155.stdout: }, 2023-08-01T19:56:26.302 INFO:teuthology.orchestra.run.smithi155.stdout: { 2023-08-01T19:56:26.302 INFO:teuthology.orchestra.run.smithi155.stdout: "event": "done", 2023-08-01T19:56:26.302 INFO:teuthology.orchestra.run.smithi155.stdout: "time": "2023-08-01T19:55:59.606757+0000", 2023-08-01T19:56:26.302 INFO:teuthology.orchestra.run.smithi155.stdout: "duration": 9.5373999999999999e-05 2023-08-01T19:56:26.302 INFO:teuthology.orchestra.run.smithi155.stdout: } 2023-08-01T19:56:26.302 INFO:teuthology.orchestra.run.smithi155.stdout: ] 2023-08-01T19:56:26.302 INFO:teuthology.orchestra.run.smithi155.stdout: } 2023-08-01T19:56:26.303 INFO:teuthology.orchestra.run.smithi155.stdout: }, 2023-08-01T19:56:26.303 INFO:teuthology.orchestra.run.smithi155.stdout: { 2023-08-01T19:56:26.303 INFO:teuthology.orchestra.run.smithi155.stdout: "description": "osd_op(client.4668.0:197416 5.d 5:bd99e66d:::benchmark_data_smithi006_114134_object63755:head [delete] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e62)", 2023-08-01T19:56:26.303 INFO:teuthology.orchestra.run.smithi155.stdout: "initiated_at": "2023-08-01T19:55:58.577369+0000", 2023-08-01T19:56:26.303 INFO:teuthology.orchestra.run.smithi155.stdout: "age": 27.558440894, 2023-08-01T19:56:26.303 INFO:teuthology.orchestra.run.smithi155.stdout: "duration": 1.0300980120000001, 2023-08-01T19:56:26.303 INFO:teuthology.orchestra.run.smithi155.stdout: "type_data": { 2023-08-01T19:56:26.303 INFO:teuthology.orchestra.run.smithi155.stdout: "flag_point": "commit sent; apply or cleanup", 2023-08-01T19:56:26.304 INFO:teuthology.orchestra.run.smithi155.stdout: "client_info": { 2023-08-01T19:56:26.304 INFO:teuthology.orchestra.run.smithi155.stdout: "client": "client.4668", 2023-08-01T19:56:26.304 INFO:teuthology.orchestra.run.smithi155.stdout: "client_addr": "172.21.15.6:0/1709472247", 2023-08-01T19:56:26.304 INFO:teuthology.orchestra.run.smithi155.stdout: "tid": 197416 2023-08-01T19:56:26.304 INFO:teuthology.orchestra.run.smithi155.stdout: }, 2023-08-01T19:56:26.304 INFO:teuthology.orchestra.run.smithi155.stdout: "events": [ 2023-08-01T19:56:26.304 INFO:teuthology.orchestra.run.smithi155.stdout: { 2023-08-01T19:56:26.304 INFO:teuthology.orchestra.run.smithi155.stdout: "event": "initiated", 2023-08-01T19:56:26.305 INFO:teuthology.orchestra.run.smithi155.stdout: "time": "2023-08-01T19:55:58.577369+0000", 2023-08-01T19:56:26.305 INFO:teuthology.orchestra.run.smithi155.stdout: "duration": 0 2023-08-01T19:56:26.305 INFO:teuthology.orchestra.run.smithi155.stdout: }, 2023-08-01T19:56:26.305 INFO:teuthology.orchestra.run.smithi155.stdout: { 2023-08-01T19:56:26.305 INFO:teuthology.orchestra.run.smithi155.stdout: "event": "throttled", 2023-08-01T19:56:26.305 INFO:teuthology.orchestra.run.smithi155.stdout: "time": "2023-08-01T19:55:58.577369+0000", 2023-08-01T19:56:26.305 INFO:teuthology.orchestra.run.smithi155.stdout: "duration": 0 2023-08-01T19:56:26.305 INFO:teuthology.orchestra.run.smithi155.stdout: }, 2023-08-01T19:56:26.306 INFO:teuthology.orchestra.run.smithi155.stdout: { 2023-08-01T19:56:26.306 INFO:teuthology.orchestra.run.smithi155.stdout: "event": "header_read", 2023-08-01T19:56:26.306 INFO:teuthology.orchestra.run.smithi155.stdout: "time": "2023-08-01T19:55:58.577368+0000", 2023-08-01T19:56:26.306 INFO:teuthology.orchestra.run.smithi155.stdout: "duration": 4294967295.9999995 2023-08-01T19:56:26.306 INFO:teuthology.orchestra.run.smithi155.stdout: }, 2023-08-01T19:56:26.306 INFO:teuthology.orchestra.run.smithi155.stdout: { 2023-08-01T19:56:26.306 INFO:teuthology.orchestra.run.smithi155.stdout: "event": "all_read", 2023-08-01T19:56:26.306 INFO:teuthology.orchestra.run.smithi155.stdout: "time": "2023-08-01T19:55:58.577370+0000", 2023-08-01T19:56:26.307 INFO:teuthology.orchestra.run.smithi155.stdout: "duration": 2.1150000000000001e-06 2023-08-01T19:56:26.307 INFO:teuthology.orchestra.run.smithi155.stdout: }, 2023-08-01T19:56:26.307 INFO:teuthology.orchestra.run.smithi155.stdout: { 2023-08-01T19:56:26.307 INFO:teuthology.orchestra.run.smithi155.stdout: "event": "dispatched", 2023-08-01T19:56:26.307 INFO:teuthology.orchestra.run.smithi155.stdout: "time": "2023-08-01T19:55:58.577377+0000", 2023-08-01T19:56:26.307 INFO:teuthology.orchestra.run.smithi155.stdout: "duration": 6.6610000000000003e-06 2023-08-01T19:56:26.307 INFO:teuthology.orchestra.run.smithi155.stdout: }, 2023-08-01T19:56:26.307 INFO:teuthology.orchestra.run.smithi155.stdout: { 2023-08-01T19:56:26.308 INFO:teuthology.orchestra.run.smithi155.stdout: "event": "queued_for_pg", 2023-08-01T19:56:26.308 INFO:teuthology.orchestra.run.smithi155.stdout: "time": "2023-08-01T19:55:58.577380+0000", 2023-08-01T19:56:26.308 INFO:teuthology.orchestra.run.smithi155.stdout: "duration": 2.7360000000000001e-06 2023-08-01T19:56:26.308 INFO:teuthology.orchestra.run.smithi155.stdout: }, 2023-08-01T19:56:26.308 INFO:teuthology.orchestra.run.smithi155.stdout: { 2023-08-01T19:56:26.308 INFO:teuthology.orchestra.run.smithi155.stdout: "event": "reached_pg", 2023-08-01T19:56:26.308 INFO:teuthology.orchestra.run.smithi155.stdout: "time": "2023-08-01T19:55:58.577405+0000", 2023-08-01T19:56:26.308 INFO:teuthology.orchestra.run.smithi155.stdout: "duration": 2.4929000000000001e-05 2023-08-01T19:56:26.309 INFO:teuthology.orchestra.run.smithi155.stdout: }, 2023-08-01T19:56:26.309 INFO:teuthology.orchestra.run.smithi155.stdout: { 2023-08-01T19:56:26.309 INFO:teuthology.orchestra.run.smithi155.stdout: "event": "waiting for peered", 2023-08-01T19:56:26.309 INFO:teuthology.orchestra.run.smithi155.stdout: "time": "2023-08-01T19:55:58.577409+0000", 2023-08-01T19:56:26.309 INFO:teuthology.orchestra.run.smithi155.stdout: "duration": 4.0799999999999999e-06 2023-08-01T19:56:26.309 INFO:teuthology.orchestra.run.smithi155.stdout: }, 2023-08-01T19:56:26.309 INFO:teuthology.orchestra.run.smithi155.stdout: { 2023-08-01T19:56:26.310 INFO:teuthology.orchestra.run.smithi155.stdout: "event": "reached_pg", 2023-08-01T19:56:26.310 INFO:teuthology.orchestra.run.smithi155.stdout: "time": "2023-08-01T19:55:59.603639+0000", 2023-08-01T19:56:26.310 INFO:teuthology.orchestra.run.smithi155.stdout: "duration": 1.0262299349999999 2023-08-01T19:56:26.310 INFO:teuthology.orchestra.run.smithi155.stdout: }, 2023-08-01T19:56:26.310 INFO:teuthology.orchestra.run.smithi155.stdout: { 2023-08-01T19:56:26.310 INFO:teuthology.orchestra.run.smithi155.stdout: "event": "started", 2023-08-01T19:56:26.310 INFO:teuthology.orchestra.run.smithi155.stdout: "time": "2023-08-01T19:55:59.603772+0000", 2023-08-01T19:56:26.310 INFO:teuthology.orchestra.run.smithi155.stdout: "duration": 0.000133153 2023-08-01T19:56:26.311 INFO:teuthology.orchestra.run.smithi155.stdout: }, 2023-08-01T19:56:26.311 INFO:teuthology.orchestra.run.smithi155.stdout: { 2023-08-01T19:56:26.311 INFO:teuthology.orchestra.run.smithi155.stdout: "event": "op_commit", 2023-08-01T19:56:26.311 INFO:teuthology.orchestra.run.smithi155.stdout: "time": "2023-08-01T19:55:59.607354+0000", 2023-08-01T19:56:26.311 INFO:teuthology.orchestra.run.smithi155.stdout: "duration": 0.0035819599999999999 2023-08-01T19:56:26.311 INFO:teuthology.orchestra.run.smithi155.stdout: }, 2023-08-01T19:56:26.311 INFO:teuthology.orchestra.run.smithi155.stdout: { 2023-08-01T19:56:26.311 INFO:teuthology.orchestra.run.smithi155.stdout: "event": "commit_sent", 2023-08-01T19:56:26.312 INFO:teuthology.orchestra.run.smithi155.stdout: "time": "2023-08-01T19:55:59.607396+0000", 2023-08-01T19:56:26.312 INFO:teuthology.orchestra.run.smithi155.stdout: "duration": 4.2423999999999999e-05 2023-08-01T19:56:26.312 INFO:teuthology.orchestra.run.smithi155.stdout: }, 2023-08-01T19:56:26.312 INFO:teuthology.orchestra.run.smithi155.stdout: { 2023-08-01T19:56:26.312 INFO:teuthology.orchestra.run.smithi155.stdout: "event": "done", 2023-08-01T19:56:26.312 INFO:teuthology.orchestra.run.smithi155.stdout: "time": "2023-08-01T19:55:59.607467+0000", 2023-08-01T19:56:26.312 INFO:teuthology.orchestra.run.smithi155.stdout: "duration": 7.0360999999999999e-05 2023-08-01T19:56:26.312 INFO:teuthology.orchestra.run.smithi155.stdout: } 2023-08-01T19:56:26.313 INFO:teuthology.orchestra.run.smithi155.stdout: ] 2023-08-01T19:56:26.313 INFO:teuthology.orchestra.run.smithi155.stdout: } 2023-08-01T19:56:26.313 INFO:teuthology.orchestra.run.smithi155.stdout: }, 2023-08-01T19:56:26.313 INFO:teuthology.orchestra.run.smithi155.stdout: { 2023-08-01T19:56:26.313 INFO:teuthology.orchestra.run.smithi155.stdout: "description": "osd_op(client.4668.0:197419 5.d 5:be7dc7c9:::benchmark_data_smithi006_114134_object63758:head [delete] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e62)", 2023-08-01T19:56:26.313 INFO:teuthology.orchestra.run.smithi155.stdout: "initiated_at": "2023-08-01T19:55:58.580223+0000", 2023-08-01T19:56:26.313 INFO:teuthology.orchestra.run.smithi155.stdout: "age": 27.555586943000002, 2023-08-01T19:56:26.313 INFO:teuthology.orchestra.run.smithi155.stdout: "duration": 1.0286139439999999, 2023-08-01T19:56:26.314 INFO:teuthology.orchestra.run.smithi155.stdout: "type_data": { 2023-08-01T19:56:26.314 INFO:teuthology.orchestra.run.smithi155.stdout: "flag_point": "commit sent; apply or cleanup", 2023-08-01T19:56:26.314 INFO:teuthology.orchestra.run.smithi155.stdout: "client_info": { 2023-08-01T19:56:26.314 INFO:teuthology.orchestra.run.smithi155.stdout: "client": "client.4668", 2023-08-01T19:56:26.314 INFO:teuthology.orchestra.run.smithi155.stdout: "client_addr": "172.21.15.6:0/1709472247", 2023-08-01T19:56:26.314 INFO:teuthology.orchestra.run.smithi155.stdout: "tid": 197419 2023-08-01T19:56:26.314 INFO:teuthology.orchestra.run.smithi155.stdout: }, 2023-08-01T19:56:26.314 INFO:teuthology.orchestra.run.smithi155.stdout: "events": [ 2023-08-01T19:56:26.315 INFO:teuthology.orchestra.run.smithi155.stdout: { 2023-08-01T19:56:26.315 INFO:teuthology.orchestra.run.smithi155.stdout: "event": "initiated", 2023-08-01T19:56:26.315 INFO:teuthology.orchestra.run.smithi155.stdout: "time": "2023-08-01T19:55:58.580223+0000", 2023-08-01T19:56:26.315 INFO:teuthology.orchestra.run.smithi155.stdout: "duration": 0 2023-08-01T19:56:26.315 INFO:teuthology.orchestra.run.smithi155.stdout: }, 2023-08-01T19:56:26.315 INFO:teuthology.orchestra.run.smithi155.stdout: { 2023-08-01T19:56:26.315 INFO:teuthology.orchestra.run.smithi155.stdout: "event": "throttled", 2023-08-01T19:56:26.315 INFO:teuthology.orchestra.run.smithi155.stdout: "time": "2023-08-01T19:55:58.580223+0000", 2023-08-01T19:56:26.316 INFO:teuthology.orchestra.run.smithi155.stdout: "duration": 0 2023-08-01T19:56:26.316 INFO:teuthology.orchestra.run.smithi155.stdout: }, 2023-08-01T19:56:26.316 INFO:teuthology.orchestra.run.smithi155.stdout: { 2023-08-01T19:56:26.316 INFO:teuthology.orchestra.run.smithi155.stdout: "event": "header_read", 2023-08-01T19:56:26.316 INFO:teuthology.orchestra.run.smithi155.stdout: "time": "2023-08-01T19:55:58.580222+0000", 2023-08-01T19:56:26.316 INFO:teuthology.orchestra.run.smithi155.stdout: "duration": 4294967295.9999995 2023-08-01T19:56:26.316 INFO:teuthology.orchestra.run.smithi155.stdout: }, 2023-08-01T19:56:26.317 INFO:teuthology.orchestra.run.smithi155.stdout: { 2023-08-01T19:56:26.317 INFO:teuthology.orchestra.run.smithi155.stdout: "event": "all_read", 2023-08-01T19:56:26.317 INFO:teuthology.orchestra.run.smithi155.stdout: "time": "2023-08-01T19:55:58.580225+0000", 2023-08-01T19:56:26.317 INFO:teuthology.orchestra.run.smithi155.stdout: "duration": 3.2820000000000001e-06 2023-08-01T19:56:26.317 INFO:teuthology.orchestra.run.smithi155.stdout: }, 2023-08-01T19:56:26.317 INFO:teuthology.orchestra.run.smithi155.stdout: { 2023-08-01T19:56:26.317 INFO:teuthology.orchestra.run.smithi155.stdout: "event": "dispatched", 2023-08-01T19:56:26.317 INFO:teuthology.orchestra.run.smithi155.stdout: "time": "2023-08-01T19:55:58.580233+0000", 2023-08-01T19:56:26.318 INFO:teuthology.orchestra.run.smithi155.stdout: "duration": 7.34e-06 2023-08-01T19:56:26.318 INFO:teuthology.orchestra.run.smithi155.stdout: }, 2023-08-01T19:56:26.318 INFO:teuthology.orchestra.run.smithi155.stdout: { 2023-08-01T19:56:26.318 INFO:teuthology.orchestra.run.smithi155.stdout: "event": "queued_for_pg", 2023-08-01T19:56:26.318 INFO:teuthology.orchestra.run.smithi155.stdout: "time": "2023-08-01T19:55:58.580236+0000", 2023-08-01T19:56:26.318 INFO:teuthology.orchestra.run.smithi155.stdout: "duration": 3.473e-06 2023-08-01T19:56:26.318 INFO:teuthology.orchestra.run.smithi155.stdout: }, 2023-08-01T19:56:26.318 INFO:teuthology.orchestra.run.smithi155.stdout: { 2023-08-01T19:56:26.319 INFO:teuthology.orchestra.run.smithi155.stdout: "event": "reached_pg", 2023-08-01T19:56:26.319 INFO:teuthology.orchestra.run.smithi155.stdout: "time": "2023-08-01T19:55:58.580267+0000", 2023-08-01T19:56:26.319 INFO:teuthology.orchestra.run.smithi155.stdout: "duration": 3.0479000000000001e-05 2023-08-01T19:56:26.319 INFO:teuthology.orchestra.run.smithi155.stdout: }, 2023-08-01T19:56:26.319 INFO:teuthology.orchestra.run.smithi155.stdout: { 2023-08-01T19:56:26.319 INFO:teuthology.orchestra.run.smithi155.stdout: "event": "waiting for peered", 2023-08-01T19:56:26.319 INFO:teuthology.orchestra.run.smithi155.stdout: "time": "2023-08-01T19:55:58.580272+0000", 2023-08-01T19:56:26.319 INFO:teuthology.orchestra.run.smithi155.stdout: "duration": 5.011e-06 2023-08-01T19:56:26.320 INFO:teuthology.orchestra.run.smithi155.stdout: }, 2023-08-01T19:56:26.320 INFO:teuthology.orchestra.run.smithi155.stdout: { 2023-08-01T19:56:26.320 INFO:teuthology.orchestra.run.smithi155.stdout: "event": "reached_pg", 2023-08-01T19:56:26.320 INFO:teuthology.orchestra.run.smithi155.stdout: "time": "2023-08-01T19:55:59.604970+0000", 2023-08-01T19:56:26.320 INFO:teuthology.orchestra.run.smithi155.stdout: "duration": 1.0246984189999999 2023-08-01T19:56:26.320 INFO:teuthology.orchestra.run.smithi155.stdout: }, 2023-08-01T19:56:26.320 INFO:teuthology.orchestra.run.smithi155.stdout: { 2023-08-01T19:56:26.320 INFO:teuthology.orchestra.run.smithi155.stdout: "event": "started", 2023-08-01T19:56:26.321 INFO:teuthology.orchestra.run.smithi155.stdout: "time": "2023-08-01T19:55:59.605085+0000", 2023-08-01T19:56:26.321 INFO:teuthology.orchestra.run.smithi155.stdout: "duration": 0.00011531000000000001 2023-08-01T19:56:26.321 INFO:teuthology.orchestra.run.smithi155.stdout: }, 2023-08-01T19:56:26.321 INFO:teuthology.orchestra.run.smithi155.stdout: { 2023-08-01T19:56:26.321 INFO:teuthology.orchestra.run.smithi155.stdout: "event": "op_commit", 2023-08-01T19:56:26.321 INFO:teuthology.orchestra.run.smithi155.stdout: "time": "2023-08-01T19:55:59.608733+0000", 2023-08-01T19:56:26.321 INFO:teuthology.orchestra.run.smithi155.stdout: "duration": 0.0036478090000000001 2023-08-01T19:56:26.321 INFO:teuthology.orchestra.run.smithi155.stdout: }, 2023-08-01T19:56:26.322 INFO:teuthology.orchestra.run.smithi155.stdout: { 2023-08-01T19:56:26.322 INFO:teuthology.orchestra.run.smithi155.stdout: "event": "commit_sent", 2023-08-01T19:56:26.322 INFO:teuthology.orchestra.run.smithi155.stdout: "time": "2023-08-01T19:55:59.608771+0000", 2023-08-01T19:56:26.322 INFO:teuthology.orchestra.run.smithi155.stdout: "duration": 3.8033e-05 2023-08-01T19:56:26.322 INFO:teuthology.orchestra.run.smithi155.stdout: }, 2023-08-01T19:56:26.322 INFO:teuthology.orchestra.run.smithi155.stdout: { 2023-08-01T19:56:26.322 INFO:teuthology.orchestra.run.smithi155.stdout: "event": "done", 2023-08-01T19:56:26.322 INFO:teuthology.orchestra.run.smithi155.stdout: "time": "2023-08-01T19:55:59.608837+0000", 2023-08-01T19:56:26.323 INFO:teuthology.orchestra.run.smithi155.stdout: "duration": 6.5364000000000006e-05 2023-08-01T19:56:26.323 INFO:teuthology.orchestra.run.smithi155.stdout: } 2023-08-01T19:56:26.323 INFO:teuthology.orchestra.run.smithi155.stdout: ] 2023-08-01T19:56:26.323 INFO:teuthology.orchestra.run.smithi155.stdout: } 2023-08-01T19:56:26.323 INFO:teuthology.orchestra.run.smithi155.stdout: }, 2023-08-01T19:56:26.323 INFO:teuthology.orchestra.run.smithi155.stdout: { 2023-08-01T19:56:26.323 INFO:teuthology.orchestra.run.smithi155.stdout: "description": "osd_op(client.4668.0:197420 5.9 5:92a2efe5:::benchmark_data_smithi006_114134_object63759:head [delete] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e62)", 2023-08-01T19:56:26.323 INFO:teuthology.orchestra.run.smithi155.stdout: "initiated_at": "2023-08-01T19:55:58.582230+0000", 2023-08-01T19:56:26.324 INFO:teuthology.orchestra.run.smithi155.stdout: "age": 27.553579632999998, 2023-08-01T19:56:26.324 INFO:teuthology.orchestra.run.smithi155.stdout: "duration": 1.0095353739999999, 2023-08-01T19:56:26.324 INFO:teuthology.orchestra.run.smithi155.stdout: "type_data": { 2023-08-01T19:56:26.324 INFO:teuthology.orchestra.run.smithi155.stdout: "flag_point": "commit sent; apply or cleanup", 2023-08-01T19:56:26.324 INFO:teuthology.orchestra.run.smithi155.stdout: "client_info": { 2023-08-01T19:56:26.324 INFO:teuthology.orchestra.run.smithi155.stdout: "client": "client.4668", 2023-08-01T19:56:26.324 INFO:teuthology.orchestra.run.smithi155.stdout: "client_addr": "172.21.15.6:0/1709472247", 2023-08-01T19:56:26.325 INFO:teuthology.orchestra.run.smithi155.stdout: "tid": 197420 2023-08-01T19:56:26.325 INFO:teuthology.orchestra.run.smithi155.stdout: }, 2023-08-01T19:56:26.325 INFO:teuthology.orchestra.run.smithi155.stdout: "events": [ 2023-08-01T19:56:26.325 INFO:teuthology.orchestra.run.smithi155.stdout: { 2023-08-01T19:56:26.325 INFO:teuthology.orchestra.run.smithi155.stdout: "event": "initiated", 2023-08-01T19:56:26.325 INFO:teuthology.orchestra.run.smithi155.stdout: "time": "2023-08-01T19:55:58.582230+0000", 2023-08-01T19:56:26.325 INFO:teuthology.orchestra.run.smithi155.stdout: "duration": 0 2023-08-01T19:56:26.325 INFO:teuthology.orchestra.run.smithi155.stdout: }, 2023-08-01T19:56:26.326 INFO:teuthology.orchestra.run.smithi155.stdout: { 2023-08-01T19:56:26.326 INFO:teuthology.orchestra.run.smithi155.stdout: "event": "throttled", 2023-08-01T19:56:26.326 INFO:teuthology.orchestra.run.smithi155.stdout: "time": "2023-08-01T19:55:58.582230+0000", 2023-08-01T19:56:26.326 INFO:teuthology.orchestra.run.smithi155.stdout: "duration": 0 2023-08-01T19:56:26.326 INFO:teuthology.orchestra.run.smithi155.stdout: }, 2023-08-01T19:56:26.326 INFO:teuthology.orchestra.run.smithi155.stdout: { 2023-08-01T19:56:26.326 INFO:teuthology.orchestra.run.smithi155.stdout: "event": "header_read", 2023-08-01T19:56:26.326 INFO:teuthology.orchestra.run.smithi155.stdout: "time": "2023-08-01T19:55:58.582229+0000", 2023-08-01T19:56:26.327 INFO:teuthology.orchestra.run.smithi155.stdout: "duration": 4294967295.9999995 2023-08-01T19:56:26.327 INFO:teuthology.orchestra.run.smithi155.stdout: }, 2023-08-01T19:56:26.327 INFO:teuthology.orchestra.run.smithi155.stdout: { 2023-08-01T19:56:26.327 INFO:teuthology.orchestra.run.smithi155.stdout: "event": "all_read", 2023-08-01T19:56:26.327 INFO:teuthology.orchestra.run.smithi155.stdout: "time": "2023-08-01T19:55:58.582233+0000", 2023-08-01T19:56:26.327 INFO:teuthology.orchestra.run.smithi155.stdout: "duration": 3.7869999999999999e-06 2023-08-01T19:56:26.327 INFO:teuthology.orchestra.run.smithi155.stdout: }, 2023-08-01T19:56:26.327 INFO:teuthology.orchestra.run.smithi155.stdout: { 2023-08-01T19:56:26.328 INFO:teuthology.orchestra.run.smithi155.stdout: "event": "dispatched", 2023-08-01T19:56:26.328 INFO:teuthology.orchestra.run.smithi155.stdout: "time": "2023-08-01T19:55:58.582241+0000", 2023-08-01T19:56:26.328 INFO:teuthology.orchestra.run.smithi155.stdout: "duration": 7.6909999999999997e-06 2023-08-01T19:56:26.328 INFO:teuthology.orchestra.run.smithi155.stdout: }, 2023-08-01T19:56:26.328 INFO:teuthology.orchestra.run.smithi155.stdout: { 2023-08-01T19:56:26.328 INFO:teuthology.orchestra.run.smithi155.stdout: "event": "queued_for_pg", 2023-08-01T19:56:26.328 INFO:teuthology.orchestra.run.smithi155.stdout: "time": "2023-08-01T19:55:58.582244+0000", 2023-08-01T19:56:26.328 INFO:teuthology.orchestra.run.smithi155.stdout: "duration": 3.6770000000000001e-06 2023-08-01T19:56:26.329 INFO:teuthology.orchestra.run.smithi155.stdout: }, 2023-08-01T19:56:26.329 INFO:teuthology.orchestra.run.smithi155.stdout: { 2023-08-01T19:56:26.329 INFO:teuthology.orchestra.run.smithi155.stdout: "event": "reached_pg", 2023-08-01T19:56:26.329 INFO:teuthology.orchestra.run.smithi155.stdout: "time": "2023-08-01T19:55:58.582274+0000", 2023-08-01T19:56:26.329 INFO:teuthology.orchestra.run.smithi155.stdout: "duration": 3.0074e-05 2023-08-01T19:56:26.329 INFO:teuthology.orchestra.run.smithi155.stdout: }, 2023-08-01T19:56:26.329 INFO:teuthology.orchestra.run.smithi155.stdout: { 2023-08-01T19:56:26.329 INFO:teuthology.orchestra.run.smithi155.stdout: "event": "waiting for peered", 2023-08-01T19:56:26.330 INFO:teuthology.orchestra.run.smithi155.stdout: "time": "2023-08-01T19:55:58.582281+0000", 2023-08-01T19:56:26.330 INFO:teuthology.orchestra.run.smithi155.stdout: "duration": 6.297e-06 2023-08-01T19:56:26.330 INFO:teuthology.orchestra.run.smithi155.stdout: }, 2023-08-01T19:56:26.330 INFO:teuthology.orchestra.run.smithi155.stdout: { 2023-08-01T19:56:26.330 INFO:teuthology.orchestra.run.smithi155.stdout: "event": "reached_pg", 2023-08-01T19:56:26.330 INFO:teuthology.orchestra.run.smithi155.stdout: "time": "2023-08-01T19:55:59.586809+0000", 2023-08-01T19:56:26.330 INFO:teuthology.orchestra.run.smithi155.stdout: "duration": 1.0045281720000001 2023-08-01T19:56:26.330 INFO:teuthology.orchestra.run.smithi155.stdout: }, 2023-08-01T19:56:26.331 INFO:teuthology.orchestra.run.smithi155.stdout: { 2023-08-01T19:56:26.331 INFO:teuthology.orchestra.run.smithi155.stdout: "event": "started", 2023-08-01T19:56:26.331 INFO:teuthology.orchestra.run.smithi155.stdout: "time": "2023-08-01T19:55:59.586910+0000", 2023-08-01T19:56:26.331 INFO:teuthology.orchestra.run.smithi155.stdout: "duration": 0.000100898 2023-08-01T19:56:26.331 INFO:teuthology.orchestra.run.smithi155.stdout: }, 2023-08-01T19:56:26.331 INFO:teuthology.orchestra.run.smithi155.stdout: { 2023-08-01T19:56:26.331 INFO:teuthology.orchestra.run.smithi155.stdout: "event": "op_commit", 2023-08-01T19:56:26.331 INFO:teuthology.orchestra.run.smithi155.stdout: "time": "2023-08-01T19:55:59.591679+0000", 2023-08-01T19:56:26.332 INFO:teuthology.orchestra.run.smithi155.stdout: "duration": 0.004769471 2023-08-01T19:56:26.332 INFO:teuthology.orchestra.run.smithi155.stdout: }, 2023-08-01T19:56:26.332 INFO:teuthology.orchestra.run.smithi155.stdout: { 2023-08-01T19:56:26.332 INFO:teuthology.orchestra.run.smithi155.stdout: "event": "commit_sent", 2023-08-01T19:56:26.332 INFO:teuthology.orchestra.run.smithi155.stdout: "time": "2023-08-01T19:55:59.591721+0000", 2023-08-01T19:56:26.332 INFO:teuthology.orchestra.run.smithi155.stdout: "duration": 4.1953000000000003e-05 2023-08-01T19:56:26.332 INFO:teuthology.orchestra.run.smithi155.stdout: }, 2023-08-01T19:56:26.332 INFO:teuthology.orchestra.run.smithi155.stdout: { 2023-08-01T19:56:26.333 INFO:teuthology.orchestra.run.smithi155.stdout: "event": "done", 2023-08-01T19:56:26.333 INFO:teuthology.orchestra.run.smithi155.stdout: "time": "2023-08-01T19:55:59.591765+0000", 2023-08-01T19:56:26.333 INFO:teuthology.orchestra.run.smithi155.stdout: "duration": 4.4030999999999999e-05 2023-08-01T19:56:26.333 INFO:teuthology.orchestra.run.smithi155.stdout: } 2023-08-01T19:56:26.333 INFO:teuthology.orchestra.run.smithi155.stdout: ] 2023-08-01T19:56:26.333 INFO:teuthology.orchestra.run.smithi155.stdout: } 2023-08-01T19:56:26.333 INFO:teuthology.orchestra.run.smithi155.stdout: } 2023-08-01T19:56:26.334 INFO:teuthology.orchestra.run.smithi155.stdout: ] 2023-08-01T19:56:26.334 INFO:teuthology.orchestra.run.smithi155.stdout:} 2023-08-01T19:56:26.334 DEBUG:teuthology.orchestra.run.smithi006:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 120 ceph --cluster ceph -- tell 'osd.*' injectargs --osd_enable_op_tracker=false 2023-08-01T19:56:26.335 INFO:tasks.ceph.osd.0.smithi008.stderr:2023-08-01T19:56:26.334+0000 7f16a58f4700 -1 received signal: Hangup from /usr/bin/python3 /bin/daemon-helper kill ceph-osd -f --cluster ceph -i 0 (PID: 111179) UID: 0 2023-08-01T19:56:26.336 DEBUG:teuthology.orchestra.run.smithi008:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 30 ceph --cluster ceph --admin-daemon /var/run/ceph/ceph-osd.0.asok dump_ops_in_flight 2023-08-01T19:56:26.435 INFO:tasks.ceph.osd.0.smithi008.stderr:2023-08-01T19:56:26.434+0000 7f16a58f4700 -1 received signal: Hangup from /usr/bin/python3 /bin/daemon-helper kill ceph-osd -f --cluster ceph -i 0 (PID: 111179) UID: 0 2023-08-01T19:56:26.483 INFO:teuthology.orchestra.run.smithi006.stdout:osd.0: {} 2023-08-01T19:56:26.503 INFO:teuthology.orchestra.run.smithi006.stdout:osd.2: {} 2023-08-01T19:56:26.503 INFO:teuthology.orchestra.run.smithi006.stderr:osd.0: osd_enable_op_tracker = 'false' 2023-08-01T19:56:26.503 INFO:teuthology.orchestra.run.smithi006.stderr:Error ENXIO: problem getting command descriptions from osd.1 2023-08-01T19:56:26.503 INFO:teuthology.orchestra.run.smithi006.stderr:osd.2: osd_enable_op_tracker = 'false' 2023-08-01T19:56:26.505 DEBUG:teuthology.orchestra.run:got remote process result: 6 2023-08-01T19:56:26.506 INFO:tasks.thrashosds.thrasher:Failed to tell all osds, ignoring 2023-08-01T19:56:26.521 INFO:teuthology.orchestra.run.smithi008.stdout:ERROR: (22) Invalid argument 2023-08-01T19:56:26.521 INFO:teuthology.orchestra.run.smithi008.stdout:op_tracker tracking is not enabled now, so no ops are tracked currently, even those get stuck. Please enable "osd_enable_op_tracker", and the tracker will start to track new ops received afterwards. 2023-08-01T19:56:26.536 DEBUG:teuthology.orchestra.run.smithi008:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 30 ceph --cluster ceph --admin-daemon /var/run/ceph/ceph-osd.0.asok dump_blocked_ops 2023-08-01T19:56:26.537 INFO:tasks.ceph.osd.0.smithi008.stderr:2023-08-01T19:56:26.536+0000 7f16a58f4700 -1 received signal: Hangup from /usr/bin/python3 /bin/daemon-helper kill ceph-osd -f --cluster ceph -i 0 (PID: 111179) UID: 0 2023-08-01T19:56:26.636 INFO:tasks.ceph.osd.2.smithi155.stderr:2023-08-01T19:56:26.634+0000 7faa5c6ac700 -1 received signal: Hangup from /usr/bin/python3 /bin/daemon-helper kill ceph-osd -f --cluster ceph -i 2 (PID: 111337) UID: 0 2023-08-01T19:56:26.722 INFO:teuthology.orchestra.run.smithi008.stdout:ERROR: (22) Invalid argument 2023-08-01T19:56:26.722 INFO:teuthology.orchestra.run.smithi008.stdout:op_tracker tracking is not enabled now, so no ops are tracked currently, even those get stuck. Please enable "osd_enable_op_tracker", and the tracker will start to track new ops received afterwards. 2023-08-01T19:56:26.737 DEBUG:teuthology.orchestra.run.smithi008:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 30 ceph --cluster ceph --admin-daemon /var/run/ceph/ceph-osd.0.asok dump_historic_ops 2023-08-01T19:56:26.737 INFO:tasks.ceph.osd.0.smithi008.stderr:2023-08-01T19:56:26.736+0000 7f16a58f4700 -1 received signal: Hangup from /usr/bin/python3 /bin/daemon-helper kill ceph-osd -f --cluster ceph -i 0 (PID: 111179) UID: 0 2023-08-01T19:56:26.778 INFO:tasks.thrashosds.thrasher:in_osds: [0, 1, 2] out_osds: [] dead_osds: [1] live_osds: [0, 2] 2023-08-01T19:56:26.778 INFO:tasks.thrashosds.thrasher:choose_action: min_in 4 min_out 0 min_live 2 min_dead 0 chance_down 1.00 2023-08-01T19:56:26.778 INFO:tasks.thrashosds.thrasher:thrash_pg_upmap_items 2023-08-01T19:56:26.778 DEBUG:teuthology.orchestra.run.smithi006:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 120 ceph --cluster ceph osd dump -f json-pretty 2023-08-01T19:56:26.836 INFO:tasks.ceph.osd.2.smithi155.stderr:2023-08-01T19:56:26.835+0000 7faa5c6ac700 -1 received signal: Hangup from /usr/bin/python3 /bin/daemon-helper kill ceph-osd -f --cluster ceph -i 2 (PID: 111337) UID: 0 2023-08-01T19:56:26.937 INFO:tasks.ceph.osd.2.smithi155.stderr:2023-08-01T19:56:26.935+0000 7faa5c6ac700 -1 received signal: Hangup from /usr/bin/python3 /bin/daemon-helper kill ceph-osd -f --cluster ceph -i 2 (PID: 111337) UID: 0 2023-08-01T19:56:26.959 INFO:teuthology.orchestra.run.smithi008.stdout:ERROR: (22) Invalid argument 2023-08-01T19:56:26.959 INFO:teuthology.orchestra.run.smithi008.stdout:op_tracker tracking is not enabled now, so no ops are tracked currently, even those get stuck. Please enable "osd_enable_op_tracker", and the tracker will start to track new ops received afterwards. 2023-08-01T19:56:26.975 DEBUG:teuthology.orchestra.run.smithi155:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 30 ceph --cluster ceph --admin-daemon /var/run/ceph/ceph-osd.2.asok dump_ops_in_flight 2023-08-01T19:56:27.038 INFO:tasks.ceph.osd.2.smithi155.stderr:2023-08-01T19:56:27.036+0000 7faa5c6ac700 -1 received signal: Hangup from /usr/bin/python3 /bin/daemon-helper kill ceph-osd -f --cluster ceph -i 2 (PID: 111337) UID: 0 2023-08-01T19:56:27.064 INFO:teuthology.orchestra.run.smithi006.stderr:noscrub is unset 2023-08-01T19:56:27.110 INFO:teuthology.orchestra.run.smithi006.stdout: 2023-08-01T19:56:27.111 INFO:teuthology.orchestra.run.smithi006.stdout:{ 2023-08-01T19:56:27.111 INFO:teuthology.orchestra.run.smithi006.stdout: "epoch": 75, 2023-08-01T19:56:27.111 INFO:teuthology.orchestra.run.smithi006.stdout: "fsid": "a0e420cc-4df1-42a5-8bd4-a98c309a9349", 2023-08-01T19:56:27.111 INFO:teuthology.orchestra.run.smithi006.stdout: "created": "2023-08-01T19:53:41.279588+0000", 2023-08-01T19:56:27.111 INFO:teuthology.orchestra.run.smithi006.stdout: "modified": "2023-08-01T19:56:27.054440+0000", 2023-08-01T19:56:27.111 INFO:teuthology.orchestra.run.smithi006.stdout: "last_up_change": "2023-08-01T19:55:58.549095+0000", 2023-08-01T19:56:27.111 INFO:teuthology.orchestra.run.smithi006.stdout: "last_in_change": "2023-08-01T19:53:42.974751+0000", 2023-08-01T19:56:27.112 INFO:teuthology.orchestra.run.smithi006.stdout: "flags": "nodeep-scrub,sortbitwise,recovery_deletes,purged_snapdirs,pglog_hardlimit", 2023-08-01T19:56:27.112 INFO:teuthology.orchestra.run.smithi006.stdout: "flags_num": 5804032, 2023-08-01T19:56:27.112 INFO:teuthology.orchestra.run.smithi006.stdout: "flags_set": [ 2023-08-01T19:56:27.112 INFO:teuthology.orchestra.run.smithi006.stdout: "nodeep-scrub", 2023-08-01T19:56:27.112 INFO:teuthology.orchestra.run.smithi006.stdout: "pglog_hardlimit", 2023-08-01T19:56:27.112 INFO:teuthology.orchestra.run.smithi006.stdout: "purged_snapdirs", 2023-08-01T19:56:27.112 INFO:teuthology.orchestra.run.smithi006.stdout: "recovery_deletes", 2023-08-01T19:56:27.112 INFO:teuthology.orchestra.run.smithi006.stdout: "sortbitwise" 2023-08-01T19:56:27.113 INFO:teuthology.orchestra.run.smithi006.stdout: ], 2023-08-01T19:56:27.113 INFO:teuthology.orchestra.run.smithi006.stdout: "crush_version": 5, 2023-08-01T19:56:27.113 INFO:teuthology.orchestra.run.smithi006.stdout: "full_ratio": 0.94999998807907104, 2023-08-01T19:56:27.113 INFO:teuthology.orchestra.run.smithi006.stdout: "backfillfull_ratio": 0.89999997615814209, 2023-08-01T19:56:27.113 INFO:teuthology.orchestra.run.smithi006.stdout: "nearfull_ratio": 0.85000002384185791, 2023-08-01T19:56:27.113 INFO:teuthology.orchestra.run.smithi006.stdout: "cluster_snapshot": "", 2023-08-01T19:56:27.113 INFO:teuthology.orchestra.run.smithi006.stdout: "pool_max": 5, 2023-08-01T19:56:27.113 INFO:teuthology.orchestra.run.smithi006.stdout: "max_osd": 3, 2023-08-01T19:56:27.114 INFO:teuthology.orchestra.run.smithi006.stdout: "require_min_compat_client": "luminous", 2023-08-01T19:56:27.114 INFO:teuthology.orchestra.run.smithi006.stdout: "min_compat_client": "jewel", 2023-08-01T19:56:27.114 INFO:teuthology.orchestra.run.smithi006.stdout: "require_osd_release": "quincy", 2023-08-01T19:56:27.114 INFO:teuthology.orchestra.run.smithi006.stdout: "pools": [ 2023-08-01T19:56:27.114 INFO:teuthology.orchestra.run.smithi006.stdout: { 2023-08-01T19:56:27.114 INFO:teuthology.orchestra.run.smithi006.stdout: "pool": 1, 2023-08-01T19:56:27.114 INFO:teuthology.orchestra.run.smithi006.stdout: "pool_name": ".mgr", 2023-08-01T19:56:27.115 INFO:teuthology.orchestra.run.smithi006.stdout: "create_time": "2023-08-01T19:53:49.961944+0000", 2023-08-01T19:56:27.115 INFO:teuthology.orchestra.run.smithi006.stdout: "flags": 1, 2023-08-01T19:56:27.115 INFO:teuthology.orchestra.run.smithi006.stdout: "flags_names": "hashpspool", 2023-08-01T19:56:27.115 INFO:teuthology.orchestra.run.smithi006.stdout: "type": 1, 2023-08-01T19:56:27.115 INFO:teuthology.orchestra.run.smithi006.stdout: "size": 2, 2023-08-01T19:56:27.115 INFO:teuthology.orchestra.run.smithi006.stdout: "min_size": 1, 2023-08-01T19:56:27.115 INFO:teuthology.orchestra.run.smithi006.stdout: "crush_rule": 0, 2023-08-01T19:56:27.115 INFO:teuthology.orchestra.run.smithi006.stdout: "peering_crush_bucket_count": 0, 2023-08-01T19:56:27.116 INFO:teuthology.orchestra.run.smithi006.stdout: "peering_crush_bucket_target": 0, 2023-08-01T19:56:27.116 INFO:teuthology.orchestra.run.smithi006.stdout: "peering_crush_bucket_barrier": 0, 2023-08-01T19:56:27.116 INFO:teuthology.orchestra.run.smithi006.stdout: "peering_crush_bucket_mandatory_member": 2147483647, 2023-08-01T19:56:27.116 INFO:teuthology.orchestra.run.smithi006.stdout: "object_hash": 2, 2023-08-01T19:56:27.116 INFO:teuthology.orchestra.run.smithi006.stdout: "pg_autoscale_mode": "off", 2023-08-01T19:56:27.116 INFO:teuthology.orchestra.run.smithi006.stdout: "pg_num": 1, 2023-08-01T19:56:27.116 INFO:teuthology.orchestra.run.smithi006.stdout: "pg_placement_num": 1, 2023-08-01T19:56:27.116 INFO:teuthology.orchestra.run.smithi006.stdout: "pg_placement_num_target": 1, 2023-08-01T19:56:27.117 INFO:teuthology.orchestra.run.smithi006.stdout: "pg_num_target": 1, 2023-08-01T19:56:27.117 INFO:teuthology.orchestra.run.smithi006.stdout: "pg_num_pending": 1, 2023-08-01T19:56:27.117 INFO:teuthology.orchestra.run.smithi006.stdout: "last_pg_merge_meta": { 2023-08-01T19:56:27.117 INFO:teuthology.orchestra.run.smithi006.stdout: "source_pgid": "0.0", 2023-08-01T19:56:27.117 INFO:teuthology.orchestra.run.smithi006.stdout: "ready_epoch": 0, 2023-08-01T19:56:27.117 INFO:teuthology.orchestra.run.smithi006.stdout: "last_epoch_started": 0, 2023-08-01T19:56:27.117 INFO:teuthology.orchestra.run.smithi006.stdout: "last_epoch_clean": 0, 2023-08-01T19:56:27.117 INFO:teuthology.orchestra.run.smithi006.stdout: "source_version": "0'0", 2023-08-01T19:56:27.118 INFO:teuthology.orchestra.run.smithi006.stdout: "target_version": "0'0" 2023-08-01T19:56:27.118 INFO:teuthology.orchestra.run.smithi006.stdout: }, 2023-08-01T19:56:27.118 INFO:teuthology.orchestra.run.smithi006.stdout: "last_change": "11", 2023-08-01T19:56:27.118 INFO:teuthology.orchestra.run.smithi006.stdout: "last_force_op_resend": "0", 2023-08-01T19:56:27.118 INFO:teuthology.orchestra.run.smithi006.stdout: "last_force_op_resend_prenautilus": "0", 2023-08-01T19:56:27.118 INFO:teuthology.orchestra.run.smithi006.stdout: "last_force_op_resend_preluminous": "0", 2023-08-01T19:56:27.118 INFO:teuthology.orchestra.run.smithi006.stdout: "auid": 0, 2023-08-01T19:56:27.118 INFO:teuthology.orchestra.run.smithi006.stdout: "snap_mode": "selfmanaged", 2023-08-01T19:56:27.119 INFO:teuthology.orchestra.run.smithi006.stdout: "snap_seq": 0, 2023-08-01T19:56:27.119 INFO:teuthology.orchestra.run.smithi006.stdout: "snap_epoch": 0, 2023-08-01T19:56:27.119 INFO:teuthology.orchestra.run.smithi006.stdout: "pool_snaps": [], 2023-08-01T19:56:27.119 INFO:teuthology.orchestra.run.smithi006.stdout: "removed_snaps": "[]", 2023-08-01T19:56:27.119 INFO:teuthology.orchestra.run.smithi006.stdout: "quota_max_bytes": 0, 2023-08-01T19:56:27.119 INFO:teuthology.orchestra.run.smithi006.stdout: "quota_max_objects": 0, 2023-08-01T19:56:27.119 INFO:teuthology.orchestra.run.smithi006.stdout: "tiers": [], 2023-08-01T19:56:27.120 INFO:teuthology.orchestra.run.smithi006.stdout: "tier_of": -1, 2023-08-01T19:56:27.120 INFO:teuthology.orchestra.run.smithi006.stdout: "read_tier": -1, 2023-08-01T19:56:27.120 INFO:teuthology.orchestra.run.smithi006.stdout: "write_tier": -1, 2023-08-01T19:56:27.120 INFO:teuthology.orchestra.run.smithi006.stdout: "cache_mode": "none", 2023-08-01T19:56:27.120 INFO:teuthology.orchestra.run.smithi006.stdout: "target_max_bytes": 0, 2023-08-01T19:56:27.120 INFO:teuthology.orchestra.run.smithi006.stdout: "target_max_objects": 0, 2023-08-01T19:56:27.120 INFO:teuthology.orchestra.run.smithi006.stdout: "cache_target_dirty_ratio_micro": 400000, 2023-08-01T19:56:27.120 INFO:teuthology.orchestra.run.smithi006.stdout: "cache_target_dirty_high_ratio_micro": 600000, 2023-08-01T19:56:27.121 INFO:teuthology.orchestra.run.smithi006.stdout: "cache_target_full_ratio_micro": 800000, 2023-08-01T19:56:27.121 INFO:teuthology.orchestra.run.smithi006.stdout: "cache_min_flush_age": 0, 2023-08-01T19:56:27.121 INFO:teuthology.orchestra.run.smithi006.stdout: "cache_min_evict_age": 0, 2023-08-01T19:56:27.121 INFO:teuthology.orchestra.run.smithi006.stdout: "erasure_code_profile": "", 2023-08-01T19:56:27.121 INFO:teuthology.orchestra.run.smithi006.stdout: "hit_set_params": { 2023-08-01T19:56:27.121 INFO:teuthology.orchestra.run.smithi006.stdout: "type": "none" 2023-08-01T19:56:27.121 INFO:teuthology.orchestra.run.smithi006.stdout: }, 2023-08-01T19:56:27.121 INFO:teuthology.orchestra.run.smithi006.stdout: "hit_set_period": 0, 2023-08-01T19:56:27.122 INFO:teuthology.orchestra.run.smithi006.stdout: "hit_set_count": 0, 2023-08-01T19:56:27.122 INFO:teuthology.orchestra.run.smithi006.stdout: "use_gmt_hitset": true, 2023-08-01T19:56:27.122 INFO:teuthology.orchestra.run.smithi006.stdout: "min_read_recency_for_promote": 0, 2023-08-01T19:56:27.122 INFO:teuthology.orchestra.run.smithi006.stdout: "min_write_recency_for_promote": 0, 2023-08-01T19:56:27.122 INFO:teuthology.orchestra.run.smithi006.stdout: "hit_set_grade_decay_rate": 0, 2023-08-01T19:56:27.122 INFO:teuthology.orchestra.run.smithi006.stdout: "hit_set_search_last_n": 0, 2023-08-01T19:56:27.122 INFO:teuthology.orchestra.run.smithi006.stdout: "grade_table": [], 2023-08-01T19:56:27.122 INFO:teuthology.orchestra.run.smithi006.stdout: "stripe_width": 0, 2023-08-01T19:56:27.123 INFO:teuthology.orchestra.run.smithi006.stdout: "expected_num_objects": 0, 2023-08-01T19:56:27.123 INFO:teuthology.orchestra.run.smithi006.stdout: "fast_read": false, 2023-08-01T19:56:27.123 INFO:teuthology.orchestra.run.smithi006.stdout: "options": { 2023-08-01T19:56:27.123 INFO:teuthology.orchestra.run.smithi006.stdout: "pg_num_max": 32, 2023-08-01T19:56:27.123 INFO:teuthology.orchestra.run.smithi006.stdout: "pg_num_min": 1 2023-08-01T19:56:27.123 INFO:teuthology.orchestra.run.smithi006.stdout: }, 2023-08-01T19:56:27.123 INFO:teuthology.orchestra.run.smithi006.stdout: "application_metadata": { 2023-08-01T19:56:27.124 INFO:teuthology.orchestra.run.smithi006.stdout: "mgr": {} 2023-08-01T19:56:27.124 INFO:teuthology.orchestra.run.smithi006.stdout: } 2023-08-01T19:56:27.124 INFO:teuthology.orchestra.run.smithi006.stdout: }, 2023-08-01T19:56:27.124 INFO:teuthology.orchestra.run.smithi006.stdout: { 2023-08-01T19:56:27.124 INFO:teuthology.orchestra.run.smithi006.stdout: "pool": 2, 2023-08-01T19:56:27.124 INFO:teuthology.orchestra.run.smithi006.stdout: "pool_name": "rbd", 2023-08-01T19:56:27.124 INFO:teuthology.orchestra.run.smithi006.stdout: "create_time": "2023-08-01T19:53:57.404091+0000", 2023-08-01T19:56:27.124 INFO:teuthology.orchestra.run.smithi006.stdout: "flags": 1, 2023-08-01T19:56:27.125 INFO:teuthology.orchestra.run.smithi006.stdout: "flags_names": "hashpspool", 2023-08-01T19:56:27.125 INFO:teuthology.orchestra.run.smithi006.stdout: "type": 1, 2023-08-01T19:56:27.125 INFO:teuthology.orchestra.run.smithi006.stdout: "size": 2, 2023-08-01T19:56:27.125 INFO:teuthology.orchestra.run.smithi006.stdout: "min_size": 1, 2023-08-01T19:56:27.125 INFO:teuthology.orchestra.run.smithi006.stdout: "crush_rule": 0, 2023-08-01T19:56:27.125 INFO:teuthology.orchestra.run.smithi006.stdout: "peering_crush_bucket_count": 0, 2023-08-01T19:56:27.125 INFO:teuthology.orchestra.run.smithi006.stdout: "peering_crush_bucket_target": 0, 2023-08-01T19:56:27.125 INFO:teuthology.orchestra.run.smithi006.stdout: "peering_crush_bucket_barrier": 0, 2023-08-01T19:56:27.126 INFO:teuthology.orchestra.run.smithi006.stdout: "peering_crush_bucket_mandatory_member": 2147483647, 2023-08-01T19:56:27.126 INFO:teuthology.orchestra.run.smithi006.stdout: "object_hash": 2, 2023-08-01T19:56:27.126 INFO:teuthology.orchestra.run.smithi006.stdout: "pg_autoscale_mode": "off", 2023-08-01T19:56:27.126 INFO:teuthology.orchestra.run.smithi006.stdout: "pg_num": 8, 2023-08-01T19:56:27.126 INFO:teuthology.orchestra.run.smithi006.stdout: "pg_placement_num": 8, 2023-08-01T19:56:27.126 INFO:teuthology.orchestra.run.smithi006.stdout: "pg_placement_num_target": 8, 2023-08-01T19:56:27.126 INFO:teuthology.orchestra.run.smithi006.stdout: "pg_num_target": 8, 2023-08-01T19:56:27.127 INFO:teuthology.orchestra.run.smithi006.stdout: "pg_num_pending": 8, 2023-08-01T19:56:27.127 INFO:teuthology.orchestra.run.smithi006.stdout: "last_pg_merge_meta": { 2023-08-01T19:56:27.127 INFO:teuthology.orchestra.run.smithi006.stdout: "source_pgid": "0.0", 2023-08-01T19:56:27.127 INFO:teuthology.orchestra.run.smithi006.stdout: "ready_epoch": 0, 2023-08-01T19:56:27.127 INFO:teuthology.orchestra.run.smithi006.stdout: "last_epoch_started": 0, 2023-08-01T19:56:27.127 INFO:teuthology.orchestra.run.smithi006.stdout: "last_epoch_clean": 0, 2023-08-01T19:56:27.127 INFO:teuthology.orchestra.run.smithi006.stdout: "source_version": "0'0", 2023-08-01T19:56:27.128 INFO:teuthology.orchestra.run.smithi006.stdout: "target_version": "0'0" 2023-08-01T19:56:27.128 INFO:teuthology.orchestra.run.smithi006.stdout: }, 2023-08-01T19:56:27.128 INFO:teuthology.orchestra.run.smithi006.stdout: "last_change": "14", 2023-08-01T19:56:27.128 INFO:teuthology.orchestra.run.smithi006.stdout: "last_force_op_resend": "0", 2023-08-01T19:56:27.128 INFO:teuthology.orchestra.run.smithi006.stdout: "last_force_op_resend_prenautilus": "0", 2023-08-01T19:56:27.128 INFO:teuthology.orchestra.run.smithi006.stdout: "last_force_op_resend_preluminous": "0", 2023-08-01T19:56:27.128 INFO:teuthology.orchestra.run.smithi006.stdout: "auid": 0, 2023-08-01T19:56:27.128 INFO:teuthology.orchestra.run.smithi006.stdout: "snap_mode": "selfmanaged", 2023-08-01T19:56:27.129 INFO:teuthology.orchestra.run.smithi006.stdout: "snap_seq": 0, 2023-08-01T19:56:27.129 INFO:teuthology.orchestra.run.smithi006.stdout: "snap_epoch": 0, 2023-08-01T19:56:27.129 INFO:teuthology.orchestra.run.smithi006.stdout: "pool_snaps": [], 2023-08-01T19:56:27.129 INFO:teuthology.orchestra.run.smithi006.stdout: "removed_snaps": "[]", 2023-08-01T19:56:27.129 INFO:teuthology.orchestra.run.smithi006.stdout: "quota_max_bytes": 0, 2023-08-01T19:56:27.129 INFO:teuthology.orchestra.run.smithi006.stdout: "quota_max_objects": 0, 2023-08-01T19:56:27.129 INFO:teuthology.orchestra.run.smithi006.stdout: "tiers": [], 2023-08-01T19:56:27.129 INFO:teuthology.orchestra.run.smithi006.stdout: "tier_of": -1, 2023-08-01T19:56:27.130 INFO:teuthology.orchestra.run.smithi006.stdout: "read_tier": -1, 2023-08-01T19:56:27.130 INFO:teuthology.orchestra.run.smithi006.stdout: "write_tier": -1, 2023-08-01T19:56:27.130 INFO:teuthology.orchestra.run.smithi006.stdout: "cache_mode": "none", 2023-08-01T19:56:27.130 INFO:teuthology.orchestra.run.smithi006.stdout: "target_max_bytes": 0, 2023-08-01T19:56:27.130 INFO:teuthology.orchestra.run.smithi006.stdout: "target_max_objects": 0, 2023-08-01T19:56:27.130 INFO:teuthology.orchestra.run.smithi006.stdout: "cache_target_dirty_ratio_micro": 400000, 2023-08-01T19:56:27.130 INFO:teuthology.orchestra.run.smithi006.stdout: "cache_target_dirty_high_ratio_micro": 600000, 2023-08-01T19:56:27.130 INFO:teuthology.orchestra.run.smithi006.stdout: "cache_target_full_ratio_micro": 800000, 2023-08-01T19:56:27.131 INFO:teuthology.orchestra.run.smithi006.stdout: "cache_min_flush_age": 0, 2023-08-01T19:56:27.131 INFO:teuthology.orchestra.run.smithi006.stdout: "cache_min_evict_age": 0, 2023-08-01T19:56:27.131 INFO:teuthology.orchestra.run.smithi006.stdout: "erasure_code_profile": "", 2023-08-01T19:56:27.131 INFO:teuthology.orchestra.run.smithi006.stdout: "hit_set_params": { 2023-08-01T19:56:27.131 INFO:teuthology.orchestra.run.smithi006.stdout: "type": "none" 2023-08-01T19:56:27.131 INFO:teuthology.orchestra.run.smithi006.stdout: }, 2023-08-01T19:56:27.131 INFO:teuthology.orchestra.run.smithi006.stdout: "hit_set_period": 0, 2023-08-01T19:56:27.131 INFO:teuthology.orchestra.run.smithi006.stdout: "hit_set_count": 0, 2023-08-01T19:56:27.132 INFO:teuthology.orchestra.run.smithi006.stdout: "use_gmt_hitset": true, 2023-08-01T19:56:27.132 INFO:teuthology.orchestra.run.smithi006.stdout: "min_read_recency_for_promote": 0, 2023-08-01T19:56:27.132 INFO:teuthology.orchestra.run.smithi006.stdout: "min_write_recency_for_promote": 0, 2023-08-01T19:56:27.132 INFO:teuthology.orchestra.run.smithi006.stdout: "hit_set_grade_decay_rate": 0, 2023-08-01T19:56:27.132 INFO:teuthology.orchestra.run.smithi006.stdout: "hit_set_search_last_n": 0, 2023-08-01T19:56:27.132 INFO:teuthology.orchestra.run.smithi006.stdout: "grade_table": [], 2023-08-01T19:56:27.132 INFO:teuthology.orchestra.run.smithi006.stdout: "stripe_width": 0, 2023-08-01T19:56:27.133 INFO:teuthology.orchestra.run.smithi006.stdout: "expected_num_objects": 0, 2023-08-01T19:56:27.133 INFO:teuthology.orchestra.run.smithi006.stdout: "fast_read": false, 2023-08-01T19:56:27.133 INFO:teuthology.orchestra.run.smithi006.stdout: "options": {}, 2023-08-01T19:56:27.133 INFO:teuthology.orchestra.run.smithi006.stdout: "application_metadata": { 2023-08-01T19:56:27.133 INFO:teuthology.orchestra.run.smithi006.stdout: "rbd": {} 2023-08-01T19:56:27.133 INFO:teuthology.orchestra.run.smithi006.stdout: } 2023-08-01T19:56:27.133 INFO:teuthology.orchestra.run.smithi006.stdout: }, 2023-08-01T19:56:27.133 INFO:teuthology.orchestra.run.smithi006.stdout: { 2023-08-01T19:56:27.134 INFO:teuthology.orchestra.run.smithi006.stdout: "pool": 3, 2023-08-01T19:56:27.134 INFO:teuthology.orchestra.run.smithi006.stdout: "pool_name": "cephfs_metadata", 2023-08-01T19:56:27.134 INFO:teuthology.orchestra.run.smithi006.stdout: "create_time": "2023-08-01T19:54:02.111247+0000", 2023-08-01T19:56:27.134 INFO:teuthology.orchestra.run.smithi006.stdout: "flags": 1, 2023-08-01T19:56:27.134 INFO:teuthology.orchestra.run.smithi006.stdout: "flags_names": "hashpspool", 2023-08-01T19:56:27.134 INFO:teuthology.orchestra.run.smithi006.stdout: "type": 1, 2023-08-01T19:56:27.134 INFO:teuthology.orchestra.run.smithi006.stdout: "size": 2, 2023-08-01T19:56:27.134 INFO:teuthology.orchestra.run.smithi006.stdout: "min_size": 1, 2023-08-01T19:56:27.135 INFO:teuthology.orchestra.run.smithi006.stdout: "crush_rule": 0, 2023-08-01T19:56:27.135 INFO:teuthology.orchestra.run.smithi006.stdout: "peering_crush_bucket_count": 0, 2023-08-01T19:56:27.135 INFO:teuthology.orchestra.run.smithi006.stdout: "peering_crush_bucket_target": 0, 2023-08-01T19:56:27.135 INFO:teuthology.orchestra.run.smithi006.stdout: "peering_crush_bucket_barrier": 0, 2023-08-01T19:56:27.135 INFO:teuthology.orchestra.run.smithi006.stdout: "peering_crush_bucket_mandatory_member": 2147483647, 2023-08-01T19:56:27.135 INFO:teuthology.orchestra.run.smithi006.stdout: "object_hash": 2, 2023-08-01T19:56:27.135 INFO:teuthology.orchestra.run.smithi006.stdout: "pg_autoscale_mode": "off", 2023-08-01T19:56:27.135 INFO:teuthology.orchestra.run.smithi006.stdout: "pg_num": 32, 2023-08-01T19:56:27.136 INFO:teuthology.orchestra.run.smithi006.stdout: "pg_placement_num": 32, 2023-08-01T19:56:27.136 INFO:teuthology.orchestra.run.smithi006.stdout: "pg_placement_num_target": 32, 2023-08-01T19:56:27.136 INFO:teuthology.orchestra.run.smithi006.stdout: "pg_num_target": 32, 2023-08-01T19:56:27.136 INFO:teuthology.orchestra.run.smithi006.stdout: "pg_num_pending": 32, 2023-08-01T19:56:27.136 INFO:teuthology.orchestra.run.smithi006.stdout: "last_pg_merge_meta": { 2023-08-01T19:56:27.136 INFO:teuthology.orchestra.run.smithi006.stdout: "source_pgid": "0.0", 2023-08-01T19:56:27.136 INFO:teuthology.orchestra.run.smithi006.stdout: "ready_epoch": 0, 2023-08-01T19:56:27.137 INFO:teuthology.orchestra.run.smithi006.stdout: "last_epoch_started": 0, 2023-08-01T19:56:27.137 INFO:teuthology.orchestra.run.smithi006.stdout: "last_epoch_clean": 0, 2023-08-01T19:56:27.137 INFO:teuthology.orchestra.run.smithi006.stdout: "source_version": "0'0", 2023-08-01T19:56:27.137 INFO:teuthology.orchestra.run.smithi006.stdout: "target_version": "0'0" 2023-08-01T19:56:27.137 INFO:teuthology.orchestra.run.smithi006.stdout: }, 2023-08-01T19:56:27.137 INFO:teuthology.orchestra.run.smithi006.stdout: "last_change": "17", 2023-08-01T19:56:27.137 INFO:teuthology.orchestra.run.smithi006.stdout: "last_force_op_resend": "0", 2023-08-01T19:56:27.137 INFO:teuthology.orchestra.run.smithi006.stdout: "last_force_op_resend_prenautilus": "0", 2023-08-01T19:56:27.138 INFO:teuthology.orchestra.run.smithi006.stdout: "last_force_op_resend_preluminous": "0", 2023-08-01T19:56:27.138 INFO:teuthology.orchestra.run.smithi006.stdout: "auid": 0, 2023-08-01T19:56:27.138 INFO:teuthology.orchestra.run.smithi006.stdout: "snap_mode": "selfmanaged", 2023-08-01T19:56:27.138 INFO:teuthology.orchestra.run.smithi006.stdout: "snap_seq": 0, 2023-08-01T19:56:27.138 INFO:teuthology.orchestra.run.smithi006.stdout: "snap_epoch": 0, 2023-08-01T19:56:27.138 INFO:teuthology.orchestra.run.smithi006.stdout: "pool_snaps": [], 2023-08-01T19:56:27.138 INFO:teuthology.orchestra.run.smithi006.stdout: "removed_snaps": "[]", 2023-08-01T19:56:27.138 INFO:teuthology.orchestra.run.smithi006.stdout: "quota_max_bytes": 0, 2023-08-01T19:56:27.139 INFO:teuthology.orchestra.run.smithi006.stdout: "quota_max_objects": 0, 2023-08-01T19:56:27.139 INFO:teuthology.orchestra.run.smithi006.stdout: "tiers": [], 2023-08-01T19:56:27.139 INFO:teuthology.orchestra.run.smithi006.stdout: "tier_of": -1, 2023-08-01T19:56:27.139 INFO:teuthology.orchestra.run.smithi006.stdout: "read_tier": -1, 2023-08-01T19:56:27.139 INFO:teuthology.orchestra.run.smithi006.stdout: "write_tier": -1, 2023-08-01T19:56:27.139 INFO:teuthology.orchestra.run.smithi006.stdout: "cache_mode": "none", 2023-08-01T19:56:27.139 INFO:teuthology.orchestra.run.smithi006.stdout: "target_max_bytes": 0, 2023-08-01T19:56:27.139 INFO:teuthology.orchestra.run.smithi006.stdout: "target_max_objects": 0, 2023-08-01T19:56:27.140 INFO:teuthology.orchestra.run.smithi006.stdout: "cache_target_dirty_ratio_micro": 400000, 2023-08-01T19:56:27.140 INFO:teuthology.orchestra.run.smithi006.stdout: "cache_target_dirty_high_ratio_micro": 600000, 2023-08-01T19:56:27.140 INFO:teuthology.orchestra.run.smithi006.stdout: "cache_target_full_ratio_micro": 800000, 2023-08-01T19:56:27.140 INFO:teuthology.orchestra.run.smithi006.stdout: "cache_min_flush_age": 0, 2023-08-01T19:56:27.140 INFO:teuthology.orchestra.run.smithi006.stdout: "cache_min_evict_age": 0, 2023-08-01T19:56:27.140 INFO:teuthology.orchestra.run.smithi006.stdout: "erasure_code_profile": "", 2023-08-01T19:56:27.140 INFO:teuthology.orchestra.run.smithi006.stdout: "hit_set_params": { 2023-08-01T19:56:27.140 INFO:teuthology.orchestra.run.smithi006.stdout: "type": "none" 2023-08-01T19:56:27.141 INFO:teuthology.orchestra.run.smithi006.stdout: }, 2023-08-01T19:56:27.141 INFO:teuthology.orchestra.run.smithi006.stdout: "hit_set_period": 0, 2023-08-01T19:56:27.141 INFO:teuthology.orchestra.run.smithi006.stdout: "hit_set_count": 0, 2023-08-01T19:56:27.141 INFO:teuthology.orchestra.run.smithi006.stdout: "use_gmt_hitset": true, 2023-08-01T19:56:27.141 INFO:teuthology.orchestra.run.smithi006.stdout: "min_read_recency_for_promote": 0, 2023-08-01T19:56:27.141 INFO:teuthology.orchestra.run.smithi006.stdout: "min_write_recency_for_promote": 0, 2023-08-01T19:56:27.141 INFO:teuthology.orchestra.run.smithi006.stdout: "hit_set_grade_decay_rate": 0, 2023-08-01T19:56:27.142 INFO:teuthology.orchestra.run.smithi006.stdout: "hit_set_search_last_n": 0, 2023-08-01T19:56:27.142 INFO:teuthology.orchestra.run.smithi006.stdout: "grade_table": [], 2023-08-01T19:56:27.142 INFO:teuthology.orchestra.run.smithi006.stdout: "stripe_width": 0, 2023-08-01T19:56:27.142 INFO:teuthology.orchestra.run.smithi006.stdout: "expected_num_objects": 0, 2023-08-01T19:56:27.142 INFO:teuthology.orchestra.run.smithi006.stdout: "fast_read": false, 2023-08-01T19:56:27.142 INFO:teuthology.orchestra.run.smithi006.stdout: "options": { 2023-08-01T19:56:27.142 INFO:teuthology.orchestra.run.smithi006.stdout: "pg_autoscale_bias": 4, 2023-08-01T19:56:27.142 INFO:teuthology.orchestra.run.smithi006.stdout: "pg_num_min": 16, 2023-08-01T19:56:27.143 INFO:teuthology.orchestra.run.smithi006.stdout: "recovery_priority": 5 2023-08-01T19:56:27.143 INFO:teuthology.orchestra.run.smithi006.stdout: }, 2023-08-01T19:56:27.143 INFO:teuthology.orchestra.run.smithi006.stdout: "application_metadata": { 2023-08-01T19:56:27.143 INFO:teuthology.orchestra.run.smithi006.stdout: "cephfs": { 2023-08-01T19:56:27.143 INFO:teuthology.orchestra.run.smithi006.stdout: "metadata": "cephfs" 2023-08-01T19:56:27.143 INFO:teuthology.orchestra.run.smithi006.stdout: } 2023-08-01T19:56:27.143 INFO:teuthology.orchestra.run.smithi006.stdout: } 2023-08-01T19:56:27.143 INFO:teuthology.orchestra.run.smithi006.stdout: }, 2023-08-01T19:56:27.144 INFO:teuthology.orchestra.run.smithi006.stdout: { 2023-08-01T19:56:27.144 INFO:teuthology.orchestra.run.smithi006.stdout: "pool": 4, 2023-08-01T19:56:27.144 INFO:teuthology.orchestra.run.smithi006.stdout: "pool_name": "cephfs_data", 2023-08-01T19:56:27.144 INFO:teuthology.orchestra.run.smithi006.stdout: "create_time": "2023-08-01T19:54:03.430277+0000", 2023-08-01T19:56:27.144 INFO:teuthology.orchestra.run.smithi006.stdout: "flags": 1, 2023-08-01T19:56:27.144 INFO:teuthology.orchestra.run.smithi006.stdout: "flags_names": "hashpspool", 2023-08-01T19:56:27.144 INFO:teuthology.orchestra.run.smithi006.stdout: "type": 1, 2023-08-01T19:56:27.145 INFO:teuthology.orchestra.run.smithi006.stdout: "size": 2, 2023-08-01T19:56:27.145 INFO:teuthology.orchestra.run.smithi006.stdout: "min_size": 1, 2023-08-01T19:56:27.145 INFO:teuthology.orchestra.run.smithi006.stdout: "crush_rule": 0, 2023-08-01T19:56:27.145 INFO:teuthology.orchestra.run.smithi006.stdout: "peering_crush_bucket_count": 0, 2023-08-01T19:56:27.145 INFO:teuthology.orchestra.run.smithi006.stdout: "peering_crush_bucket_target": 0, 2023-08-01T19:56:27.145 INFO:teuthology.orchestra.run.smithi006.stdout: "peering_crush_bucket_barrier": 0, 2023-08-01T19:56:27.145 INFO:teuthology.orchestra.run.smithi006.stdout: "peering_crush_bucket_mandatory_member": 2147483647, 2023-08-01T19:56:27.145 INFO:teuthology.orchestra.run.smithi006.stdout: "object_hash": 2, 2023-08-01T19:56:27.146 INFO:teuthology.orchestra.run.smithi006.stdout: "pg_autoscale_mode": "off", 2023-08-01T19:56:27.146 INFO:teuthology.orchestra.run.smithi006.stdout: "pg_num": 64, 2023-08-01T19:56:27.146 INFO:teuthology.orchestra.run.smithi006.stdout: "pg_placement_num": 64, 2023-08-01T19:56:27.146 INFO:teuthology.orchestra.run.smithi006.stdout: "pg_placement_num_target": 64, 2023-08-01T19:56:27.146 INFO:teuthology.orchestra.run.smithi006.stdout: "pg_num_target": 64, 2023-08-01T19:56:27.146 INFO:teuthology.orchestra.run.smithi006.stdout: "pg_num_pending": 64, 2023-08-01T19:56:27.146 INFO:teuthology.orchestra.run.smithi006.stdout: "last_pg_merge_meta": { 2023-08-01T19:56:27.147 INFO:teuthology.orchestra.run.smithi006.stdout: "source_pgid": "0.0", 2023-08-01T19:56:27.147 INFO:teuthology.orchestra.run.smithi006.stdout: "ready_epoch": 0, 2023-08-01T19:56:27.147 INFO:teuthology.orchestra.run.smithi006.stdout: "last_epoch_started": 0, 2023-08-01T19:56:27.147 INFO:teuthology.orchestra.run.smithi006.stdout: "last_epoch_clean": 0, 2023-08-01T19:56:27.147 INFO:teuthology.orchestra.run.smithi006.stdout: "source_version": "0'0", 2023-08-01T19:56:27.147 INFO:teuthology.orchestra.run.smithi006.stdout: "target_version": "0'0" 2023-08-01T19:56:27.147 INFO:teuthology.orchestra.run.smithi006.stdout: }, 2023-08-01T19:56:27.147 INFO:teuthology.orchestra.run.smithi006.stdout: "last_change": "18", 2023-08-01T19:56:27.148 INFO:teuthology.orchestra.run.smithi006.stdout: "last_force_op_resend": "0", 2023-08-01T19:56:27.148 INFO:teuthology.orchestra.run.smithi006.stdout: "last_force_op_resend_prenautilus": "0", 2023-08-01T19:56:27.148 INFO:teuthology.orchestra.run.smithi006.stdout: "last_force_op_resend_preluminous": "0", 2023-08-01T19:56:27.148 INFO:teuthology.orchestra.run.smithi006.stdout: "auid": 0, 2023-08-01T19:56:27.148 INFO:teuthology.orchestra.run.smithi006.stdout: "snap_mode": "selfmanaged", 2023-08-01T19:56:27.148 INFO:teuthology.orchestra.run.smithi006.stdout: "snap_seq": 0, 2023-08-01T19:56:27.148 INFO:teuthology.orchestra.run.smithi006.stdout: "snap_epoch": 0, 2023-08-01T19:56:27.148 INFO:teuthology.orchestra.run.smithi006.stdout: "pool_snaps": [], 2023-08-01T19:56:27.149 INFO:teuthology.orchestra.run.smithi006.stdout: "removed_snaps": "[]", 2023-08-01T19:56:27.149 INFO:teuthology.orchestra.run.smithi006.stdout: "quota_max_bytes": 0, 2023-08-01T19:56:27.149 INFO:teuthology.orchestra.run.smithi006.stdout: "quota_max_objects": 0, 2023-08-01T19:56:27.149 INFO:teuthology.orchestra.run.smithi006.stdout: "tiers": [], 2023-08-01T19:56:27.149 INFO:teuthology.orchestra.run.smithi006.stdout: "tier_of": -1, 2023-08-01T19:56:27.149 INFO:teuthology.orchestra.run.smithi006.stdout: "read_tier": -1, 2023-08-01T19:56:27.149 INFO:teuthology.orchestra.run.smithi006.stdout: "write_tier": -1, 2023-08-01T19:56:27.150 INFO:teuthology.orchestra.run.smithi006.stdout: "cache_mode": "none", 2023-08-01T19:56:27.150 INFO:teuthology.orchestra.run.smithi006.stdout: "target_max_bytes": 0, 2023-08-01T19:56:27.150 INFO:teuthology.orchestra.run.smithi006.stdout: "target_max_objects": 0, 2023-08-01T19:56:27.150 INFO:teuthology.orchestra.run.smithi006.stdout: "cache_target_dirty_ratio_micro": 400000, 2023-08-01T19:56:27.150 INFO:teuthology.orchestra.run.smithi006.stdout: "cache_target_dirty_high_ratio_micro": 600000, 2023-08-01T19:56:27.150 INFO:teuthology.orchestra.run.smithi006.stdout: "cache_target_full_ratio_micro": 800000, 2023-08-01T19:56:27.150 INFO:teuthology.orchestra.run.smithi006.stdout: "cache_min_flush_age": 0, 2023-08-01T19:56:27.150 INFO:teuthology.orchestra.run.smithi006.stdout: "cache_min_evict_age": 0, 2023-08-01T19:56:27.151 INFO:teuthology.orchestra.run.smithi006.stdout: "erasure_code_profile": "", 2023-08-01T19:56:27.151 INFO:teuthology.orchestra.run.smithi006.stdout: "hit_set_params": { 2023-08-01T19:56:27.151 INFO:teuthology.orchestra.run.smithi006.stdout: "type": "none" 2023-08-01T19:56:27.151 INFO:teuthology.orchestra.run.smithi006.stdout: }, 2023-08-01T19:56:27.151 INFO:teuthology.orchestra.run.smithi006.stdout: "hit_set_period": 0, 2023-08-01T19:56:27.151 INFO:teuthology.orchestra.run.smithi006.stdout: "hit_set_count": 0, 2023-08-01T19:56:27.151 INFO:teuthology.orchestra.run.smithi006.stdout: "use_gmt_hitset": true, 2023-08-01T19:56:27.151 INFO:teuthology.orchestra.run.smithi006.stdout: "min_read_recency_for_promote": 0, 2023-08-01T19:56:27.152 INFO:teuthology.orchestra.run.smithi006.stdout: "min_write_recency_for_promote": 0, 2023-08-01T19:56:27.152 INFO:teuthology.orchestra.run.smithi006.stdout: "hit_set_grade_decay_rate": 0, 2023-08-01T19:56:27.152 INFO:teuthology.orchestra.run.smithi006.stdout: "hit_set_search_last_n": 0, 2023-08-01T19:56:27.152 INFO:teuthology.orchestra.run.smithi006.stdout: "grade_table": [], 2023-08-01T19:56:27.152 INFO:teuthology.orchestra.run.smithi006.stdout: "stripe_width": 0, 2023-08-01T19:56:27.152 INFO:teuthology.orchestra.run.smithi006.stdout: "expected_num_objects": 0, 2023-08-01T19:56:27.152 INFO:teuthology.orchestra.run.smithi006.stdout: "fast_read": false, 2023-08-01T19:56:27.152 INFO:teuthology.orchestra.run.smithi006.stdout: "options": { 2023-08-01T19:56:27.153 INFO:teuthology.orchestra.run.smithi006.stdout: "pg_num_min": 64, 2023-08-01T19:56:27.153 INFO:teuthology.orchestra.run.smithi006.stdout: "target_size_ratio": 0.89999997615814209 2023-08-01T19:56:27.153 INFO:teuthology.orchestra.run.smithi006.stdout: }, 2023-08-01T19:56:27.153 INFO:teuthology.orchestra.run.smithi006.stdout: "application_metadata": { 2023-08-01T19:56:27.153 INFO:teuthology.orchestra.run.smithi006.stdout: "cephfs": { 2023-08-01T19:56:27.153 INFO:teuthology.orchestra.run.smithi006.stdout: "data": "cephfs" 2023-08-01T19:56:27.153 INFO:teuthology.orchestra.run.smithi006.stdout: } 2023-08-01T19:56:27.153 INFO:teuthology.orchestra.run.smithi006.stdout: } 2023-08-01T19:56:27.154 INFO:teuthology.orchestra.run.smithi006.stdout: }, 2023-08-01T19:56:27.154 INFO:teuthology.orchestra.run.smithi006.stdout: { 2023-08-01T19:56:27.154 INFO:teuthology.orchestra.run.smithi006.stdout: "pool": 5, 2023-08-01T19:56:27.154 INFO:teuthology.orchestra.run.smithi006.stdout: "pool_name": "unique_pool_0", 2023-08-01T19:56:27.154 INFO:teuthology.orchestra.run.smithi006.stdout: "create_time": "2023-08-01T19:54:21.165668+0000", 2023-08-01T19:56:27.154 INFO:teuthology.orchestra.run.smithi006.stdout: "flags": 1, 2023-08-01T19:56:27.154 INFO:teuthology.orchestra.run.smithi006.stdout: "flags_names": "hashpspool", 2023-08-01T19:56:27.155 INFO:teuthology.orchestra.run.smithi006.stdout: "type": 1, 2023-08-01T19:56:27.155 INFO:teuthology.orchestra.run.smithi006.stdout: "size": 2, 2023-08-01T19:56:27.155 INFO:teuthology.orchestra.run.smithi006.stdout: "min_size": 1, 2023-08-01T19:56:27.155 INFO:teuthology.orchestra.run.smithi006.stdout: "crush_rule": 0, 2023-08-01T19:56:27.155 INFO:teuthology.orchestra.run.smithi006.stdout: "peering_crush_bucket_count": 0, 2023-08-01T19:56:27.155 INFO:teuthology.orchestra.run.smithi006.stdout: "peering_crush_bucket_target": 0, 2023-08-01T19:56:27.155 INFO:teuthology.orchestra.run.smithi006.stdout: "peering_crush_bucket_barrier": 0, 2023-08-01T19:56:27.155 INFO:teuthology.orchestra.run.smithi006.stdout: "peering_crush_bucket_mandatory_member": 2147483647, 2023-08-01T19:56:27.156 INFO:teuthology.orchestra.run.smithi006.stdout: "object_hash": 2, 2023-08-01T19:56:27.156 INFO:teuthology.orchestra.run.smithi006.stdout: "pg_autoscale_mode": "off", 2023-08-01T19:56:27.156 INFO:teuthology.orchestra.run.smithi006.stdout: "pg_num": 16, 2023-08-01T19:56:27.156 INFO:teuthology.orchestra.run.smithi006.stdout: "pg_placement_num": 16, 2023-08-01T19:56:27.156 INFO:teuthology.orchestra.run.smithi006.stdout: "pg_placement_num_target": 16, 2023-08-01T19:56:27.156 INFO:teuthology.orchestra.run.smithi006.stdout: "pg_num_target": 16, 2023-08-01T19:56:27.156 INFO:teuthology.orchestra.run.smithi006.stdout: "pg_num_pending": 16, 2023-08-01T19:56:27.156 INFO:teuthology.orchestra.run.smithi006.stdout: "last_pg_merge_meta": { 2023-08-01T19:56:27.157 INFO:teuthology.orchestra.run.smithi006.stdout: "source_pgid": "0.0", 2023-08-01T19:56:27.157 INFO:teuthology.orchestra.run.smithi006.stdout: "ready_epoch": 0, 2023-08-01T19:56:27.157 INFO:teuthology.orchestra.run.smithi006.stdout: "last_epoch_started": 0, 2023-08-01T19:56:27.157 INFO:teuthology.orchestra.run.smithi006.stdout: "last_epoch_clean": 0, 2023-08-01T19:56:27.157 INFO:teuthology.orchestra.run.smithi006.stdout: "source_version": "0'0", 2023-08-01T19:56:27.157 INFO:teuthology.orchestra.run.smithi006.stdout: "target_version": "0'0" 2023-08-01T19:56:27.157 INFO:teuthology.orchestra.run.smithi006.stdout: }, 2023-08-01T19:56:27.157 INFO:teuthology.orchestra.run.smithi006.stdout: "last_change": "21", 2023-08-01T19:56:27.158 INFO:teuthology.orchestra.run.smithi006.stdout: "last_force_op_resend": "0", 2023-08-01T19:56:27.158 INFO:teuthology.orchestra.run.smithi006.stdout: "last_force_op_resend_prenautilus": "0", 2023-08-01T19:56:27.158 INFO:teuthology.orchestra.run.smithi006.stdout: "last_force_op_resend_preluminous": "0", 2023-08-01T19:56:27.158 INFO:teuthology.orchestra.run.smithi006.stdout: "auid": 0, 2023-08-01T19:56:27.158 INFO:teuthology.orchestra.run.smithi006.stdout: "snap_mode": "selfmanaged", 2023-08-01T19:56:27.158 INFO:teuthology.orchestra.run.smithi006.stdout: "snap_seq": 0, 2023-08-01T19:56:27.158 INFO:teuthology.orchestra.run.smithi006.stdout: "snap_epoch": 0, 2023-08-01T19:56:27.158 INFO:teuthology.orchestra.run.smithi006.stdout: "pool_snaps": [], 2023-08-01T19:56:27.159 INFO:teuthology.orchestra.run.smithi006.stdout: "removed_snaps": "[]", 2023-08-01T19:56:27.159 INFO:teuthology.orchestra.run.smithi006.stdout: "quota_max_bytes": 0, 2023-08-01T19:56:27.159 INFO:teuthology.orchestra.run.smithi006.stdout: "quota_max_objects": 0, 2023-08-01T19:56:27.159 INFO:teuthology.orchestra.run.smithi006.stdout: "tiers": [], 2023-08-01T19:56:27.159 INFO:teuthology.orchestra.run.smithi006.stdout: "tier_of": -1, 2023-08-01T19:56:27.159 INFO:teuthology.orchestra.run.smithi006.stdout: "read_tier": -1, 2023-08-01T19:56:27.159 INFO:teuthology.orchestra.run.smithi006.stdout: "write_tier": -1, 2023-08-01T19:56:27.159 INFO:teuthology.orchestra.run.smithi006.stdout: "cache_mode": "none", 2023-08-01T19:56:27.160 INFO:teuthology.orchestra.run.smithi006.stdout: "target_max_bytes": 0, 2023-08-01T19:56:27.160 INFO:teuthology.orchestra.run.smithi006.stdout: "target_max_objects": 0, 2023-08-01T19:56:27.160 INFO:teuthology.orchestra.run.smithi006.stdout: "cache_target_dirty_ratio_micro": 400000, 2023-08-01T19:56:27.160 INFO:teuthology.orchestra.run.smithi006.stdout: "cache_target_dirty_high_ratio_micro": 600000, 2023-08-01T19:56:27.160 INFO:teuthology.orchestra.run.smithi006.stdout: "cache_target_full_ratio_micro": 800000, 2023-08-01T19:56:27.160 INFO:teuthology.orchestra.run.smithi006.stdout: "cache_min_flush_age": 0, 2023-08-01T19:56:27.160 INFO:teuthology.orchestra.run.smithi006.stdout: "cache_min_evict_age": 0, 2023-08-01T19:56:27.161 INFO:teuthology.orchestra.run.smithi006.stdout: "erasure_code_profile": "", 2023-08-01T19:56:27.161 INFO:teuthology.orchestra.run.smithi006.stdout: "hit_set_params": { 2023-08-01T19:56:27.161 INFO:teuthology.orchestra.run.smithi006.stdout: "type": "none" 2023-08-01T19:56:27.161 INFO:teuthology.orchestra.run.smithi006.stdout: }, 2023-08-01T19:56:27.161 INFO:teuthology.orchestra.run.smithi006.stdout: "hit_set_period": 0, 2023-08-01T19:56:27.161 INFO:teuthology.orchestra.run.smithi006.stdout: "hit_set_count": 0, 2023-08-01T19:56:27.161 INFO:teuthology.orchestra.run.smithi006.stdout: "use_gmt_hitset": true, 2023-08-01T19:56:27.161 INFO:teuthology.orchestra.run.smithi006.stdout: "min_read_recency_for_promote": 0, 2023-08-01T19:56:27.162 INFO:teuthology.orchestra.run.smithi006.stdout: "min_write_recency_for_promote": 0, 2023-08-01T19:56:27.162 INFO:teuthology.orchestra.run.smithi006.stdout: "hit_set_grade_decay_rate": 0, 2023-08-01T19:56:27.162 INFO:teuthology.orchestra.run.smithi006.stdout: "hit_set_search_last_n": 0, 2023-08-01T19:56:27.162 INFO:teuthology.orchestra.run.smithi006.stdout: "grade_table": [], 2023-08-01T19:56:27.162 INFO:teuthology.orchestra.run.smithi006.stdout: "stripe_width": 0, 2023-08-01T19:56:27.162 INFO:teuthology.orchestra.run.smithi006.stdout: "expected_num_objects": 0, 2023-08-01T19:56:27.162 INFO:teuthology.orchestra.run.smithi006.stdout: "fast_read": false, 2023-08-01T19:56:27.162 INFO:teuthology.orchestra.run.smithi006.stdout: "options": {}, 2023-08-01T19:56:27.163 INFO:teuthology.orchestra.run.smithi006.stdout: "application_metadata": { 2023-08-01T19:56:27.163 INFO:teuthology.orchestra.run.smithi006.stdout: "rados": {} 2023-08-01T19:56:27.163 INFO:teuthology.orchestra.run.smithi006.stdout: } 2023-08-01T19:56:27.163 INFO:teuthology.orchestra.run.smithi006.stdout: } 2023-08-01T19:56:27.163 INFO:teuthology.orchestra.run.smithi006.stdout: ], 2023-08-01T19:56:27.163 INFO:teuthology.orchestra.run.smithi006.stdout: "osds": [ 2023-08-01T19:56:27.163 INFO:teuthology.orchestra.run.smithi006.stdout: { 2023-08-01T19:56:27.163 INFO:teuthology.orchestra.run.smithi006.stdout: "osd": 0, 2023-08-01T19:56:27.164 INFO:teuthology.orchestra.run.smithi006.stdout: "uuid": "5dd675c7-2777-48f2-8009-ff0e0d4c7086", 2023-08-01T19:56:27.164 INFO:teuthology.orchestra.run.smithi006.stdout: "up": 1, 2023-08-01T19:56:27.164 INFO:teuthology.orchestra.run.smithi006.stdout: "in": 1, 2023-08-01T19:56:27.164 INFO:teuthology.orchestra.run.smithi006.stdout: "weight": 1, 2023-08-01T19:56:27.164 INFO:teuthology.orchestra.run.smithi006.stdout: "primary_affinity": 0.822052001953125, 2023-08-01T19:56:27.164 INFO:teuthology.orchestra.run.smithi006.stdout: "last_clean_begin": 0, 2023-08-01T19:56:27.164 INFO:teuthology.orchestra.run.smithi006.stdout: "last_clean_end": 0, 2023-08-01T19:56:27.165 INFO:teuthology.orchestra.run.smithi006.stdout: "up_from": 8, 2023-08-01T19:56:27.165 INFO:teuthology.orchestra.run.smithi006.stdout: "up_thru": 72, 2023-08-01T19:56:27.165 INFO:teuthology.orchestra.run.smithi006.stdout: "down_at": 0, 2023-08-01T19:56:27.165 INFO:teuthology.orchestra.run.smithi006.stdout: "lost_at": 0, 2023-08-01T19:56:27.165 INFO:teuthology.orchestra.run.smithi006.stdout: "public_addrs": { 2023-08-01T19:56:27.165 INFO:teuthology.orchestra.run.smithi006.stdout: "addrvec": [ 2023-08-01T19:56:27.165 INFO:teuthology.orchestra.run.smithi006.stdout: { 2023-08-01T19:56:27.165 INFO:teuthology.orchestra.run.smithi006.stdout: "type": "v2", 2023-08-01T19:56:27.166 INFO:teuthology.orchestra.run.smithi006.stdout: "addr": "172.21.15.8:6800", 2023-08-01T19:56:27.166 INFO:teuthology.orchestra.run.smithi006.stdout: "nonce": 111181 2023-08-01T19:56:27.166 INFO:teuthology.orchestra.run.smithi006.stdout: }, 2023-08-01T19:56:27.166 INFO:teuthology.orchestra.run.smithi006.stdout: { 2023-08-01T19:56:27.166 INFO:teuthology.orchestra.run.smithi006.stdout: "type": "v1", 2023-08-01T19:56:27.166 INFO:teuthology.orchestra.run.smithi006.stdout: "addr": "172.21.15.8:6801", 2023-08-01T19:56:27.166 INFO:teuthology.orchestra.run.smithi006.stdout: "nonce": 111181 2023-08-01T19:56:27.166 INFO:teuthology.orchestra.run.smithi006.stdout: } 2023-08-01T19:56:27.167 INFO:teuthology.orchestra.run.smithi006.stdout: ] 2023-08-01T19:56:27.167 INFO:teuthology.orchestra.run.smithi006.stdout: }, 2023-08-01T19:56:27.167 INFO:teuthology.orchestra.run.smithi006.stdout: "cluster_addrs": { 2023-08-01T19:56:27.167 INFO:teuthology.orchestra.run.smithi006.stdout: "addrvec": [ 2023-08-01T19:56:27.167 INFO:teuthology.orchestra.run.smithi006.stdout: { 2023-08-01T19:56:27.167 INFO:teuthology.orchestra.run.smithi006.stdout: "type": "v2", 2023-08-01T19:56:27.167 INFO:teuthology.orchestra.run.smithi006.stdout: "addr": "172.21.15.8:6802", 2023-08-01T19:56:27.167 INFO:teuthology.orchestra.run.smithi006.stdout: "nonce": 111181 2023-08-01T19:56:27.168 INFO:teuthology.orchestra.run.smithi006.stdout: }, 2023-08-01T19:56:27.168 INFO:teuthology.orchestra.run.smithi006.stdout: { 2023-08-01T19:56:27.168 INFO:teuthology.orchestra.run.smithi006.stdout: "type": "v1", 2023-08-01T19:56:27.168 INFO:teuthology.orchestra.run.smithi006.stdout: "addr": "172.21.15.8:6803", 2023-08-01T19:56:27.168 INFO:teuthology.orchestra.run.smithi006.stdout: "nonce": 111181 2023-08-01T19:56:27.168 INFO:teuthology.orchestra.run.smithi006.stdout: } 2023-08-01T19:56:27.168 INFO:teuthology.orchestra.run.smithi006.stdout: ] 2023-08-01T19:56:27.168 INFO:teuthology.orchestra.run.smithi006.stdout: }, 2023-08-01T19:56:27.169 INFO:teuthology.orchestra.run.smithi006.stdout: "heartbeat_back_addrs": { 2023-08-01T19:56:27.169 INFO:teuthology.orchestra.run.smithi006.stdout: "addrvec": [ 2023-08-01T19:56:27.169 INFO:teuthology.orchestra.run.smithi006.stdout: { 2023-08-01T19:56:27.169 INFO:teuthology.orchestra.run.smithi006.stdout: "type": "v2", 2023-08-01T19:56:27.169 INFO:teuthology.orchestra.run.smithi006.stdout: "addr": "172.21.15.8:6806", 2023-08-01T19:56:27.169 INFO:teuthology.orchestra.run.smithi006.stdout: "nonce": 111181 2023-08-01T19:56:27.169 INFO:teuthology.orchestra.run.smithi006.stdout: }, 2023-08-01T19:56:27.170 INFO:teuthology.orchestra.run.smithi006.stdout: { 2023-08-01T19:56:27.170 INFO:teuthology.orchestra.run.smithi006.stdout: "type": "v1", 2023-08-01T19:56:27.170 INFO:teuthology.orchestra.run.smithi006.stdout: "addr": "172.21.15.8:6807", 2023-08-01T19:56:27.170 INFO:teuthology.orchestra.run.smithi006.stdout: "nonce": 111181 2023-08-01T19:56:27.170 INFO:teuthology.orchestra.run.smithi006.stdout: } 2023-08-01T19:56:27.170 INFO:teuthology.orchestra.run.smithi006.stdout: ] 2023-08-01T19:56:27.170 INFO:teuthology.orchestra.run.smithi006.stdout: }, 2023-08-01T19:56:27.170 INFO:teuthology.orchestra.run.smithi006.stdout: "heartbeat_front_addrs": { 2023-08-01T19:56:27.171 INFO:teuthology.orchestra.run.smithi006.stdout: "addrvec": [ 2023-08-01T19:56:27.171 INFO:teuthology.orchestra.run.smithi006.stdout: { 2023-08-01T19:56:27.171 INFO:teuthology.orchestra.run.smithi006.stdout: "type": "v2", 2023-08-01T19:56:27.171 INFO:teuthology.orchestra.run.smithi006.stdout: "addr": "172.21.15.8:6804", 2023-08-01T19:56:27.171 INFO:teuthology.orchestra.run.smithi006.stdout: "nonce": 111181 2023-08-01T19:56:27.171 INFO:teuthology.orchestra.run.smithi006.stdout: }, 2023-08-01T19:56:27.171 INFO:teuthology.orchestra.run.smithi006.stdout: { 2023-08-01T19:56:27.171 INFO:teuthology.orchestra.run.smithi006.stdout: "type": "v1", 2023-08-01T19:56:27.172 INFO:teuthology.orchestra.run.smithi006.stdout: "addr": "172.21.15.8:6805", 2023-08-01T19:56:27.172 INFO:teuthology.orchestra.run.smithi006.stdout: "nonce": 111181 2023-08-01T19:56:27.172 INFO:teuthology.orchestra.run.smithi006.stdout: } 2023-08-01T19:56:27.172 INFO:teuthology.orchestra.run.smithi006.stdout: ] 2023-08-01T19:56:27.172 INFO:teuthology.orchestra.run.smithi006.stdout: }, 2023-08-01T19:56:27.172 INFO:teuthology.orchestra.run.smithi006.stdout: "public_addr": "172.21.15.8:6801/111181", 2023-08-01T19:56:27.172 INFO:teuthology.orchestra.run.smithi006.stdout: "cluster_addr": "172.21.15.8:6803/111181", 2023-08-01T19:56:27.172 INFO:teuthology.orchestra.run.smithi006.stdout: "heartbeat_back_addr": "172.21.15.8:6807/111181", 2023-08-01T19:56:27.173 INFO:teuthology.orchestra.run.smithi006.stdout: "heartbeat_front_addr": "172.21.15.8:6805/111181", 2023-08-01T19:56:27.173 INFO:teuthology.orchestra.run.smithi006.stdout: "state": [ 2023-08-01T19:56:27.173 INFO:teuthology.orchestra.run.smithi006.stdout: "exists", 2023-08-01T19:56:27.173 INFO:teuthology.orchestra.run.smithi006.stdout: "up" 2023-08-01T19:56:27.173 INFO:teuthology.orchestra.run.smithi006.stdout: ] 2023-08-01T19:56:27.173 INFO:teuthology.orchestra.run.smithi006.stdout: }, 2023-08-01T19:56:27.173 INFO:teuthology.orchestra.run.smithi006.stdout: { 2023-08-01T19:56:27.173 INFO:teuthology.orchestra.run.smithi006.stdout: "osd": 1, 2023-08-01T19:56:27.174 INFO:teuthology.orchestra.run.smithi006.stdout: "uuid": "7fc612c4-33ba-4a33-bca8-1f42ee8ed548", 2023-08-01T19:56:27.174 INFO:teuthology.orchestra.run.smithi006.stdout: "up": 0, 2023-08-01T19:56:27.174 INFO:teuthology.orchestra.run.smithi006.stdout: "in": 1, 2023-08-01T19:56:27.174 INFO:teuthology.orchestra.run.smithi006.stdout: "weight": 1, 2023-08-01T19:56:27.174 INFO:teuthology.orchestra.run.smithi006.stdout: "primary_affinity": 0.3376312255859375, 2023-08-01T19:56:27.174 INFO:teuthology.orchestra.run.smithi006.stdout: "last_clean_begin": 0, 2023-08-01T19:56:27.174 INFO:teuthology.orchestra.run.smithi006.stdout: "last_clean_end": 0, 2023-08-01T19:56:27.174 INFO:teuthology.orchestra.run.smithi006.stdout: "up_from": 8, 2023-08-01T19:56:27.175 INFO:teuthology.orchestra.run.smithi006.stdout: "up_thru": 53, 2023-08-01T19:56:27.175 INFO:teuthology.orchestra.run.smithi006.stdout: "down_at": 62, 2023-08-01T19:56:27.175 INFO:teuthology.orchestra.run.smithi006.stdout: "lost_at": 0, 2023-08-01T19:56:27.175 INFO:teuthology.orchestra.run.smithi006.stdout: "public_addrs": { 2023-08-01T19:56:27.175 INFO:teuthology.orchestra.run.smithi006.stdout: "addrvec": [ 2023-08-01T19:56:27.175 INFO:teuthology.orchestra.run.smithi006.stdout: { 2023-08-01T19:56:27.175 INFO:teuthology.orchestra.run.smithi006.stdout: "type": "v2", 2023-08-01T19:56:27.176 INFO:teuthology.orchestra.run.smithi006.stdout: "addr": "172.21.15.101:6800", 2023-08-01T19:56:27.176 INFO:teuthology.orchestra.run.smithi006.stdout: "nonce": 111143 2023-08-01T19:56:27.176 INFO:teuthology.orchestra.run.smithi006.stdout: }, 2023-08-01T19:56:27.176 INFO:teuthology.orchestra.run.smithi006.stdout: { 2023-08-01T19:56:27.176 INFO:teuthology.orchestra.run.smithi006.stdout: "type": "v1", 2023-08-01T19:56:27.176 INFO:teuthology.orchestra.run.smithi006.stdout: "addr": "172.21.15.101:6801", 2023-08-01T19:56:27.176 INFO:teuthology.orchestra.run.smithi006.stdout: "nonce": 111143 2023-08-01T19:56:27.176 INFO:teuthology.orchestra.run.smithi006.stdout: } 2023-08-01T19:56:27.177 INFO:teuthology.orchestra.run.smithi006.stdout: ] 2023-08-01T19:56:27.177 INFO:teuthology.orchestra.run.smithi006.stdout: }, 2023-08-01T19:56:27.177 INFO:teuthology.orchestra.run.smithi006.stdout: "cluster_addrs": { 2023-08-01T19:56:27.177 INFO:teuthology.orchestra.run.smithi006.stdout: "addrvec": [ 2023-08-01T19:56:27.177 INFO:teuthology.orchestra.run.smithi006.stdout: { 2023-08-01T19:56:27.177 INFO:teuthology.orchestra.run.smithi006.stdout: "type": "v2", 2023-08-01T19:56:27.177 INFO:teuthology.orchestra.run.smithi006.stdout: "addr": "172.21.15.101:6802", 2023-08-01T19:56:27.177 INFO:teuthology.orchestra.run.smithi006.stdout: "nonce": 111143 2023-08-01T19:56:27.178 INFO:teuthology.orchestra.run.smithi006.stdout: }, 2023-08-01T19:56:27.178 INFO:teuthology.orchestra.run.smithi006.stdout: { 2023-08-01T19:56:27.178 INFO:teuthology.orchestra.run.smithi006.stdout: "type": "v1", 2023-08-01T19:56:27.178 INFO:teuthology.orchestra.run.smithi006.stdout: "addr": "172.21.15.101:6803", 2023-08-01T19:56:27.178 INFO:teuthology.orchestra.run.smithi006.stdout: "nonce": 111143 2023-08-01T19:56:27.178 INFO:teuthology.orchestra.run.smithi006.stdout: } 2023-08-01T19:56:27.178 INFO:teuthology.orchestra.run.smithi006.stdout: ] 2023-08-01T19:56:27.178 INFO:teuthology.orchestra.run.smithi006.stdout: }, 2023-08-01T19:56:27.179 INFO:teuthology.orchestra.run.smithi006.stdout: "heartbeat_back_addrs": { 2023-08-01T19:56:27.179 INFO:teuthology.orchestra.run.smithi006.stdout: "addrvec": [ 2023-08-01T19:56:27.179 INFO:teuthology.orchestra.run.smithi006.stdout: { 2023-08-01T19:56:27.179 INFO:teuthology.orchestra.run.smithi006.stdout: "type": "v2", 2023-08-01T19:56:27.179 INFO:teuthology.orchestra.run.smithi006.stdout: "addr": "172.21.15.101:6806", 2023-08-01T19:56:27.179 INFO:teuthology.orchestra.run.smithi006.stdout: "nonce": 111143 2023-08-01T19:56:27.179 INFO:teuthology.orchestra.run.smithi006.stdout: }, 2023-08-01T19:56:27.179 INFO:teuthology.orchestra.run.smithi006.stdout: { 2023-08-01T19:56:27.180 INFO:teuthology.orchestra.run.smithi006.stdout: "type": "v1", 2023-08-01T19:56:27.180 INFO:teuthology.orchestra.run.smithi006.stdout: "addr": "172.21.15.101:6807", 2023-08-01T19:56:27.180 INFO:teuthology.orchestra.run.smithi006.stdout: "nonce": 111143 2023-08-01T19:56:27.180 INFO:teuthology.orchestra.run.smithi006.stdout: } 2023-08-01T19:56:27.180 INFO:teuthology.orchestra.run.smithi006.stdout: ] 2023-08-01T19:56:27.180 INFO:teuthology.orchestra.run.smithi006.stdout: }, 2023-08-01T19:56:27.180 INFO:teuthology.orchestra.run.smithi006.stdout: "heartbeat_front_addrs": { 2023-08-01T19:56:27.180 INFO:teuthology.orchestra.run.smithi006.stdout: "addrvec": [ 2023-08-01T19:56:27.181 INFO:teuthology.orchestra.run.smithi006.stdout: { 2023-08-01T19:56:27.181 INFO:teuthology.orchestra.run.smithi006.stdout: "type": "v2", 2023-08-01T19:56:27.181 INFO:teuthology.orchestra.run.smithi006.stdout: "addr": "172.21.15.101:6804", 2023-08-01T19:56:27.181 INFO:teuthology.orchestra.run.smithi006.stdout: "nonce": 111143 2023-08-01T19:56:27.181 INFO:teuthology.orchestra.run.smithi006.stdout: }, 2023-08-01T19:56:27.181 INFO:teuthology.orchestra.run.smithi006.stdout: { 2023-08-01T19:56:27.181 INFO:teuthology.orchestra.run.smithi006.stdout: "type": "v1", 2023-08-01T19:56:27.181 INFO:teuthology.orchestra.run.smithi006.stdout: "addr": "172.21.15.101:6805", 2023-08-01T19:56:27.182 INFO:teuthology.orchestra.run.smithi006.stdout: "nonce": 111143 2023-08-01T19:56:27.182 INFO:teuthology.orchestra.run.smithi006.stdout: } 2023-08-01T19:56:27.182 INFO:teuthology.orchestra.run.smithi006.stdout: ] 2023-08-01T19:56:27.182 INFO:teuthology.orchestra.run.smithi006.stdout: }, 2023-08-01T19:56:27.182 INFO:teuthology.orchestra.run.smithi006.stdout: "public_addr": "172.21.15.101:6801/111143", 2023-08-01T19:56:27.182 INFO:teuthology.orchestra.run.smithi006.stdout: "cluster_addr": "172.21.15.101:6803/111143", 2023-08-01T19:56:27.182 INFO:teuthology.orchestra.run.smithi006.stdout: "heartbeat_back_addr": "172.21.15.101:6807/111143", 2023-08-01T19:56:27.183 INFO:teuthology.orchestra.run.smithi006.stdout: "heartbeat_front_addr": "172.21.15.101:6805/111143", 2023-08-01T19:56:27.183 INFO:teuthology.orchestra.run.smithi006.stdout: "state": [ 2023-08-01T19:56:27.183 INFO:teuthology.orchestra.run.smithi006.stdout: "exists" 2023-08-01T19:56:27.183 INFO:teuthology.orchestra.run.smithi006.stdout: ] 2023-08-01T19:56:27.183 INFO:teuthology.orchestra.run.smithi006.stdout: }, 2023-08-01T19:56:27.183 INFO:teuthology.orchestra.run.smithi006.stdout: { 2023-08-01T19:56:27.183 INFO:teuthology.orchestra.run.smithi006.stdout: "osd": 2, 2023-08-01T19:56:27.183 INFO:teuthology.orchestra.run.smithi006.stdout: "uuid": "f85cadbc-4230-4772-8f39-62ed52e220b1", 2023-08-01T19:56:27.184 INFO:teuthology.orchestra.run.smithi006.stdout: "up": 1, 2023-08-01T19:56:27.184 INFO:teuthology.orchestra.run.smithi006.stdout: "in": 1, 2023-08-01T19:56:27.184 INFO:teuthology.orchestra.run.smithi006.stdout: "weight": 1, 2023-08-01T19:56:27.184 INFO:teuthology.orchestra.run.smithi006.stdout: "primary_affinity": 0, 2023-08-01T19:56:27.184 INFO:teuthology.orchestra.run.smithi006.stdout: "last_clean_begin": 0, 2023-08-01T19:56:27.184 INFO:teuthology.orchestra.run.smithi006.stdout: "last_clean_end": 0, 2023-08-01T19:56:27.184 INFO:teuthology.orchestra.run.smithi006.stdout: "up_from": 9, 2023-08-01T19:56:27.184 INFO:teuthology.orchestra.run.smithi006.stdout: "up_thru": 62, 2023-08-01T19:56:27.185 INFO:teuthology.orchestra.run.smithi006.stdout: "down_at": 0, 2023-08-01T19:56:27.185 INFO:teuthology.orchestra.run.smithi006.stdout: "lost_at": 0, 2023-08-01T19:56:27.185 INFO:teuthology.orchestra.run.smithi006.stdout: "public_addrs": { 2023-08-01T19:56:27.185 INFO:teuthology.orchestra.run.smithi006.stdout: "addrvec": [ 2023-08-01T19:56:27.185 INFO:teuthology.orchestra.run.smithi006.stdout: { 2023-08-01T19:56:27.185 INFO:teuthology.orchestra.run.smithi006.stdout: "type": "v2", 2023-08-01T19:56:27.185 INFO:teuthology.orchestra.run.smithi006.stdout: "addr": "172.21.15.155:6800", 2023-08-01T19:56:27.186 INFO:teuthology.orchestra.run.smithi006.stdout: "nonce": 111339 2023-08-01T19:56:27.186 INFO:teuthology.orchestra.run.smithi006.stdout: }, 2023-08-01T19:56:27.186 INFO:teuthology.orchestra.run.smithi006.stdout: { 2023-08-01T19:56:27.186 INFO:teuthology.orchestra.run.smithi006.stdout: "type": "v1", 2023-08-01T19:56:27.186 INFO:teuthology.orchestra.run.smithi006.stdout: "addr": "172.21.15.155:6801", 2023-08-01T19:56:27.186 INFO:teuthology.orchestra.run.smithi006.stdout: "nonce": 111339 2023-08-01T19:56:27.186 INFO:teuthology.orchestra.run.smithi006.stdout: } 2023-08-01T19:56:27.186 INFO:teuthology.orchestra.run.smithi006.stdout: ] 2023-08-01T19:56:27.187 INFO:teuthology.orchestra.run.smithi006.stdout: }, 2023-08-01T19:56:27.187 INFO:teuthology.orchestra.run.smithi006.stdout: "cluster_addrs": { 2023-08-01T19:56:27.187 INFO:teuthology.orchestra.run.smithi006.stdout: "addrvec": [ 2023-08-01T19:56:27.187 INFO:teuthology.orchestra.run.smithi006.stdout: { 2023-08-01T19:56:27.187 INFO:teuthology.orchestra.run.smithi006.stdout: "type": "v2", 2023-08-01T19:56:27.187 INFO:teuthology.orchestra.run.smithi006.stdout: "addr": "172.21.15.155:6802", 2023-08-01T19:56:27.187 INFO:teuthology.orchestra.run.smithi006.stdout: "nonce": 111339 2023-08-01T19:56:27.187 INFO:teuthology.orchestra.run.smithi006.stdout: }, 2023-08-01T19:56:27.188 INFO:teuthology.orchestra.run.smithi006.stdout: { 2023-08-01T19:56:27.188 INFO:teuthology.orchestra.run.smithi006.stdout: "type": "v1", 2023-08-01T19:56:27.188 INFO:teuthology.orchestra.run.smithi006.stdout: "addr": "172.21.15.155:6803", 2023-08-01T19:56:27.188 INFO:teuthology.orchestra.run.smithi006.stdout: "nonce": 111339 2023-08-01T19:56:27.188 INFO:teuthology.orchestra.run.smithi006.stdout: } 2023-08-01T19:56:27.188 INFO:teuthology.orchestra.run.smithi006.stdout: ] 2023-08-01T19:56:27.188 INFO:teuthology.orchestra.run.smithi006.stdout: }, 2023-08-01T19:56:27.189 INFO:teuthology.orchestra.run.smithi006.stdout: "heartbeat_back_addrs": { 2023-08-01T19:56:27.189 INFO:teuthology.orchestra.run.smithi006.stdout: "addrvec": [ 2023-08-01T19:56:27.189 INFO:teuthology.orchestra.run.smithi006.stdout: { 2023-08-01T19:56:27.189 INFO:teuthology.orchestra.run.smithi006.stdout: "type": "v2", 2023-08-01T19:56:27.189 INFO:teuthology.orchestra.run.smithi006.stdout: "addr": "172.21.15.155:6806", 2023-08-01T19:56:27.189 INFO:teuthology.orchestra.run.smithi006.stdout: "nonce": 111339 2023-08-01T19:56:27.189 INFO:teuthology.orchestra.run.smithi006.stdout: }, 2023-08-01T19:56:27.189 INFO:teuthology.orchestra.run.smithi006.stdout: { 2023-08-01T19:56:27.190 INFO:teuthology.orchestra.run.smithi006.stdout: "type": "v1", 2023-08-01T19:56:27.190 INFO:teuthology.orchestra.run.smithi006.stdout: "addr": "172.21.15.155:6807", 2023-08-01T19:56:27.190 INFO:teuthology.orchestra.run.smithi006.stdout: "nonce": 111339 2023-08-01T19:56:27.190 INFO:teuthology.orchestra.run.smithi006.stdout: } 2023-08-01T19:56:27.190 INFO:teuthology.orchestra.run.smithi006.stdout: ] 2023-08-01T19:56:27.190 INFO:teuthology.orchestra.run.smithi006.stdout: }, 2023-08-01T19:56:27.190 INFO:teuthology.orchestra.run.smithi006.stdout: "heartbeat_front_addrs": { 2023-08-01T19:56:27.190 INFO:teuthology.orchestra.run.smithi006.stdout: "addrvec": [ 2023-08-01T19:56:27.191 INFO:teuthology.orchestra.run.smithi006.stdout: { 2023-08-01T19:56:27.191 INFO:teuthology.orchestra.run.smithi006.stdout: "type": "v2", 2023-08-01T19:56:27.191 INFO:teuthology.orchestra.run.smithi006.stdout: "addr": "172.21.15.155:6804", 2023-08-01T19:56:27.191 INFO:teuthology.orchestra.run.smithi006.stdout: "nonce": 111339 2023-08-01T19:56:27.191 INFO:teuthology.orchestra.run.smithi006.stdout: }, 2023-08-01T19:56:27.191 INFO:teuthology.orchestra.run.smithi006.stdout: { 2023-08-01T19:56:27.191 INFO:teuthology.orchestra.run.smithi006.stdout: "type": "v1", 2023-08-01T19:56:27.191 INFO:teuthology.orchestra.run.smithi006.stdout: "addr": "172.21.15.155:6805", 2023-08-01T19:56:27.192 INFO:teuthology.orchestra.run.smithi006.stdout: "nonce": 111339 2023-08-01T19:56:27.192 INFO:teuthology.orchestra.run.smithi006.stdout: } 2023-08-01T19:56:27.192 INFO:teuthology.orchestra.run.smithi006.stdout: ] 2023-08-01T19:56:27.192 INFO:teuthology.orchestra.run.smithi006.stdout: }, 2023-08-01T19:56:27.192 INFO:teuthology.orchestra.run.smithi006.stdout: "public_addr": "172.21.15.155:6801/111339", 2023-08-01T19:56:27.192 INFO:teuthology.orchestra.run.smithi006.stdout: "cluster_addr": "172.21.15.155:6803/111339", 2023-08-01T19:56:27.192 INFO:teuthology.orchestra.run.smithi006.stdout: "heartbeat_back_addr": "172.21.15.155:6807/111339", 2023-08-01T19:56:27.192 INFO:teuthology.orchestra.run.smithi006.stdout: "heartbeat_front_addr": "172.21.15.155:6805/111339", 2023-08-01T19:56:27.193 INFO:teuthology.orchestra.run.smithi006.stdout: "state": [ 2023-08-01T19:56:27.193 INFO:teuthology.orchestra.run.smithi006.stdout: "exists", 2023-08-01T19:56:27.193 INFO:teuthology.orchestra.run.smithi006.stdout: "up" 2023-08-01T19:56:27.193 INFO:teuthology.orchestra.run.smithi006.stdout: ] 2023-08-01T19:56:27.193 INFO:teuthology.orchestra.run.smithi006.stdout: } 2023-08-01T19:56:27.193 INFO:teuthology.orchestra.run.smithi006.stdout: ], 2023-08-01T19:56:27.193 INFO:teuthology.orchestra.run.smithi006.stdout: "osd_xinfo": [ 2023-08-01T19:56:27.193 INFO:teuthology.orchestra.run.smithi006.stdout: { 2023-08-01T19:56:27.194 INFO:teuthology.orchestra.run.smithi006.stdout: "osd": 0, 2023-08-01T19:56:27.194 INFO:teuthology.orchestra.run.smithi006.stdout: "down_stamp": "0.000000", 2023-08-01T19:56:27.194 INFO:teuthology.orchestra.run.smithi006.stdout: "laggy_probability": 0, 2023-08-01T19:56:27.194 INFO:teuthology.orchestra.run.smithi006.stdout: "laggy_interval": 0, 2023-08-01T19:56:27.194 INFO:teuthology.orchestra.run.smithi006.stdout: "features": 4540138320759226367, 2023-08-01T19:56:27.194 INFO:teuthology.orchestra.run.smithi006.stdout: "old_weight": 0, 2023-08-01T19:56:27.194 INFO:teuthology.orchestra.run.smithi006.stdout: "last_purged_snaps_scrub": "2023-08-01T19:53:48.018154+0000", 2023-08-01T19:56:27.194 INFO:teuthology.orchestra.run.smithi006.stdout: "dead_epoch": 0 2023-08-01T19:56:27.195 INFO:teuthology.orchestra.run.smithi006.stdout: }, 2023-08-01T19:56:27.195 INFO:teuthology.orchestra.run.smithi006.stdout: { 2023-08-01T19:56:27.195 INFO:teuthology.orchestra.run.smithi006.stdout: "osd": 1, 2023-08-01T19:56:27.195 INFO:teuthology.orchestra.run.smithi006.stdout: "down_stamp": "0.000000", 2023-08-01T19:56:27.195 INFO:teuthology.orchestra.run.smithi006.stdout: "laggy_probability": 0, 2023-08-01T19:56:27.195 INFO:teuthology.orchestra.run.smithi006.stdout: "laggy_interval": 0, 2023-08-01T19:56:27.195 INFO:teuthology.orchestra.run.smithi006.stdout: "features": 4540138320759226367, 2023-08-01T19:56:27.195 INFO:teuthology.orchestra.run.smithi006.stdout: "old_weight": 0, 2023-08-01T19:56:27.196 INFO:teuthology.orchestra.run.smithi006.stdout: "last_purged_snaps_scrub": "2023-08-01T19:53:48.000488+0000", 2023-08-01T19:56:27.196 INFO:teuthology.orchestra.run.smithi006.stdout: "dead_epoch": 61 2023-08-01T19:56:27.196 INFO:teuthology.orchestra.run.smithi006.stdout: }, 2023-08-01T19:56:27.196 INFO:teuthology.orchestra.run.smithi006.stdout: { 2023-08-01T19:56:27.196 INFO:teuthology.orchestra.run.smithi006.stdout: "osd": 2, 2023-08-01T19:56:27.196 INFO:teuthology.orchestra.run.smithi006.stdout: "down_stamp": "0.000000", 2023-08-01T19:56:27.196 INFO:teuthology.orchestra.run.smithi006.stdout: "laggy_probability": 0, 2023-08-01T19:56:27.197 INFO:teuthology.orchestra.run.smithi006.stdout: "laggy_interval": 0, 2023-08-01T19:56:27.197 INFO:teuthology.orchestra.run.smithi006.stdout: "features": 4540138320759226367, 2023-08-01T19:56:27.197 INFO:teuthology.orchestra.run.smithi006.stdout: "old_weight": 0, 2023-08-01T19:56:27.197 INFO:teuthology.orchestra.run.smithi006.stdout: "last_purged_snaps_scrub": "2023-08-01T19:53:48.072529+0000", 2023-08-01T19:56:27.197 INFO:teuthology.orchestra.run.smithi006.stdout: "dead_epoch": 0 2023-08-01T19:56:27.197 INFO:teuthology.orchestra.run.smithi006.stdout: } 2023-08-01T19:56:27.197 INFO:teuthology.orchestra.run.smithi006.stdout: ], 2023-08-01T19:56:27.197 INFO:teuthology.orchestra.run.smithi006.stdout: "pg_upmap": [], 2023-08-01T19:56:27.198 INFO:teuthology.orchestra.run.smithi006.stdout: "pg_upmap_items": [], 2023-08-01T19:56:27.198 INFO:teuthology.orchestra.run.smithi006.stdout: "pg_temp": [], 2023-08-01T19:56:27.198 INFO:teuthology.orchestra.run.smithi006.stdout: "primary_temp": [], 2023-08-01T19:56:27.198 INFO:teuthology.orchestra.run.smithi006.stdout: "blocklist": {}, 2023-08-01T19:56:27.198 INFO:teuthology.orchestra.run.smithi006.stdout: "range_blocklist": {}, 2023-08-01T19:56:27.198 INFO:teuthology.orchestra.run.smithi006.stdout: "erasure_code_profiles": { 2023-08-01T19:56:27.198 INFO:teuthology.orchestra.run.smithi006.stdout: "default": { 2023-08-01T19:56:27.198 INFO:teuthology.orchestra.run.smithi006.stdout: "crush-failure-domain": "osd", 2023-08-01T19:56:27.199 INFO:teuthology.orchestra.run.smithi006.stdout: "k": "2", 2023-08-01T19:56:27.199 INFO:teuthology.orchestra.run.smithi006.stdout: "m": "1", 2023-08-01T19:56:27.199 INFO:teuthology.orchestra.run.smithi006.stdout: "plugin": "jerasure", 2023-08-01T19:56:27.199 INFO:teuthology.orchestra.run.smithi006.stdout: "technique": "reed_sol_van" 2023-08-01T19:56:27.199 INFO:teuthology.orchestra.run.smithi006.stdout: } 2023-08-01T19:56:27.199 INFO:teuthology.orchestra.run.smithi006.stdout: }, 2023-08-01T19:56:27.199 INFO:teuthology.orchestra.run.smithi006.stdout: "removed_snaps_queue": [], 2023-08-01T19:56:27.199 INFO:teuthology.orchestra.run.smithi006.stdout: "new_removed_snaps": [], 2023-08-01T19:56:27.200 INFO:teuthology.orchestra.run.smithi006.stdout: "new_purged_snaps": [], 2023-08-01T19:56:27.200 INFO:teuthology.orchestra.run.smithi006.stdout: "crush_node_flags": {}, 2023-08-01T19:56:27.200 INFO:teuthology.orchestra.run.smithi006.stdout: "device_class_flags": {}, 2023-08-01T19:56:27.200 INFO:teuthology.orchestra.run.smithi006.stdout: "stretch_mode": { 2023-08-01T19:56:27.200 INFO:teuthology.orchestra.run.smithi006.stdout: "stretch_mode_enabled": false, 2023-08-01T19:56:27.200 INFO:teuthology.orchestra.run.smithi006.stdout: "stretch_bucket_count": 0, 2023-08-01T19:56:27.200 INFO:teuthology.orchestra.run.smithi006.stdout: "degraded_stretch_mode": 0, 2023-08-01T19:56:27.200 INFO:teuthology.orchestra.run.smithi006.stdout: "recovering_stretch_mode": 0, 2023-08-01T19:56:27.201 INFO:teuthology.orchestra.run.smithi006.stdout: "stretch_mode_bucket": 0 2023-08-01T19:56:27.201 INFO:teuthology.orchestra.run.smithi006.stdout: } 2023-08-01T19:56:27.201 INFO:teuthology.orchestra.run.smithi006.stdout:} 2023-08-01T19:56:27.202 INFO:teuthology.orchestra.run.smithi155.stdout:ERROR: (22) Invalid argument 2023-08-01T19:56:27.202 INFO:teuthology.orchestra.run.smithi155.stdout:op_tracker tracking is not enabled now, so no ops are tracked currently, even those get stuck. Please enable "osd_enable_op_tracker", and the tracker will start to track new ops received afterwards. 2023-08-01T19:56:27.203 INFO:tasks.thrashosds.thrasher:j is {'epoch': 75, 'fsid': 'a0e420cc-4df1-42a5-8bd4-a98c309a9349', 'created': '2023-08-01T19:53:41.279588+0000', 'modified': '2023-08-01T19:56:27.054440+0000', 'last_up_change': '2023-08-01T19:55:58.549095+0000', 'last_in_change': '2023-08-01T19:53:42.974751+0000', 'flags': 'nodeep-scrub,sortbitwise,recovery_deletes,purged_snapdirs,pglog_hardlimit', 'flags_num': 5804032, 'flags_set': ['nodeep-scrub', 'pglog_hardlimit', 'purged_snapdirs', 'recovery_deletes', 'sortbitwise'], 'crush_version': 5, 'full_ratio': 0.949999988079071, 'backfillfull_ratio': 0.8999999761581421, 'nearfull_ratio': 0.8500000238418579, 'cluster_snapshot': '', 'pool_max': 5, 'max_osd': 3, 'require_min_compat_client': 'luminous', 'min_compat_client': 'jewel', 'require_osd_release': 'quincy', 'pools': [{'pool': 1, 'pool_name': '.mgr', 'create_time': '2023-08-01T19:53:49.961944+0000', 'flags': 1, 'flags_names': 'hashpspool', 'type': 1, 'size': 2, 'min_size': 1, 'crush_rule': 0, 'peering_crush_bucket_count': 0, 'peering_crush_bucket_target': 0, 'peering_crush_bucket_barrier': 0, 'peering_crush_bucket_mandatory_member': 2147483647, 'object_hash': 2, 'pg_autoscale_mode': 'off', 'pg_num': 1, 'pg_placement_num': 1, 'pg_placement_num_target': 1, 'pg_num_target': 1, 'pg_num_pending': 1, 'last_pg_merge_meta': {'source_pgid': '0.0', 'ready_epoch': 0, 'last_epoch_started': 0, 'last_epoch_clean': 0, 'source_version': "0'0", 'target_version': "0'0"}, 'last_change': '11', 'last_force_op_resend': '0', 'last_force_op_resend_prenautilus': '0', 'last_force_op_resend_preluminous': '0', 'auid': 0, 'snap_mode': 'selfmanaged', 'snap_seq': 0, 'snap_epoch': 0, 'pool_snaps': [], 'removed_snaps': '[]', 'quota_max_bytes': 0, 'quota_max_objects': 0, 'tiers': [], 'tier_of': -1, 'read_tier': -1, 'write_tier': -1, 'cache_mode': 'none', 'target_max_bytes': 0, 'target_max_objects': 0, 'cache_target_dirty_ratio_micro': 400000, 'cache_target_dirty_high_ratio_micro': 600000, 'cache_target_full_ratio_micro': 800000, 'cache_min_flush_age': 0, 'cache_min_evict_age': 0, 'erasure_code_profile': '', 'hit_set_params': {'type': 'none'}, 'hit_set_period': 0, 'hit_set_count': 0, 'use_gmt_hitset': True, 'min_read_recency_for_promote': 0, 'min_write_recency_for_promote': 0, 'hit_set_grade_decay_rate': 0, 'hit_set_search_last_n': 0, 'grade_table': [], 'stripe_width': 0, 'expected_num_objects': 0, 'fast_read': False, 'options': {'pg_num_max': 32, 'pg_num_min': 1}, 'application_metadata': {'mgr': {}}}, {'pool': 2, 'pool_name': 'rbd', 'create_time': '2023-08-01T19:53:57.404091+0000', 'flags': 1, 'flags_names': 'hashpspool', 'type': 1, 'size': 2, 'min_size': 1, 'crush_rule': 0, 'peering_crush_bucket_count': 0, 'peering_crush_bucket_target': 0, 'peering_crush_bucket_barrier': 0, 'peering_crush_bucket_mandatory_member': 2147483647, 'object_hash': 2, 'pg_autoscale_mode': 'off', 'pg_num': 8, 'pg_placement_num': 8, 'pg_placement_num_target': 8, 'pg_num_target': 8, 'pg_num_pending': 8, 'last_pg_merge_meta': {'source_pgid': '0.0', 'ready_epoch': 0, 'last_epoch_started': 0, 'last_epoch_clean': 0, 'source_version': "0'0", 'target_version': "0'0"}, 'last_change': '14', 'last_force_op_resend': '0', 'last_force_op_resend_prenautilus': '0', 'last_force_op_resend_preluminous': '0', 'auid': 0, 'snap_mode': 'selfmanaged', 'snap_seq': 0, 'snap_epoch': 0, 'pool_snaps': [], 'removed_snaps': '[]', 'quota_max_bytes': 0, 'quota_max_objects': 0, 'tiers': [], 'tier_of': -1, 'read_tier': -1, 'write_tier': -1, 'cache_mode': 'none', 'target_max_bytes': 0, 'target_max_objects': 0, 'cache_target_dirty_ratio_micro': 400000, 'cache_target_dirty_high_ratio_micro': 600000, 'cache_target_full_ratio_micro': 800000, 'cache_min_flush_age': 0, 'cache_min_evict_age': 0, 'erasure_code_profile': '', 'hit_set_params': {'type': 'none'}, 'hit_set_period': 0, 'hit_set_count': 0, 'use_gmt_hitset': True, 'min_read_recency_for_promote': 0, 'min_write_recency_for_promote': 0, 'hit_set_grade_decay_rate': 0, 'hit_set_search_last_n': 0, 'grade_table': [], 'stripe_width': 0, 'expected_num_objects': 0, 'fast_read': False, 'options': {}, 'application_metadata': {'rbd': {}}}, {'pool': 3, 'pool_name': 'cephfs_metadata', 'create_time': '2023-08-01T19:54:02.111247+0000', 'flags': 1, 'flags_names': 'hashpspool', 'type': 1, 'size': 2, 'min_size': 1, 'crush_rule': 0, 'peering_crush_bucket_count': 0, 'peering_crush_bucket_target': 0, 'peering_crush_bucket_barrier': 0, 'peering_crush_bucket_mandatory_member': 2147483647, 'object_hash': 2, 'pg_autoscale_mode': 'off', 'pg_num': 32, 'pg_placement_num': 32, 'pg_placement_num_target': 32, 'pg_num_target': 32, 'pg_num_pending': 32, 'last_pg_merge_meta': {'source_pgid': '0.0', 'ready_epoch': 0, 'last_epoch_started': 0, 'last_epoch_clean': 0, 'source_version': "0'0", 'target_version': "0'0"}, 'last_change': '17', 'last_force_op_resend': '0', 'last_force_op_resend_prenautilus': '0', 'last_force_op_resend_preluminous': '0', 'auid': 0, 'snap_mode': 'selfmanaged', 'snap_seq': 0, 'snap_epoch': 0, 'pool_snaps': [], 'removed_snaps': '[]', 'quota_max_bytes': 0, 'quota_max_objects': 0, 'tiers': [], 'tier_of': -1, 'read_tier': -1, 'write_tier': -1, 'cache_mode': 'none', 'target_max_bytes': 0, 'target_max_objects': 0, 'cache_target_dirty_ratio_micro': 400000, 'cache_target_dirty_high_ratio_micro': 600000, 'cache_target_full_ratio_micro': 800000, 'cache_min_flush_age': 0, 'cache_min_evict_age': 0, 'erasure_code_profile': '', 'hit_set_params': {'type': 'none'}, 'hit_set_period': 0, 'hit_set_count': 0, 'use_gmt_hitset': True, 'min_read_recency_for_promote': 0, 'min_write_recency_for_promote': 0, 'hit_set_grade_decay_rate': 0, 'hit_set_search_last_n': 0, 'grade_table': [], 'stripe_width': 0, 'expected_num_objects': 0, 'fast_read': False, 'options': {'pg_autoscale_bias': 4, 'pg_num_min': 16, 'recovery_priority': 5}, 'application_metadata': {'cephfs': {'metadata': 'cephfs'}}}, {'pool': 4, 'pool_name': 'cephfs_data', 'create_time': '2023-08-01T19:54:03.430277+0000', 'flags': 1, 'flags_names': 'hashpspool', 'type': 1, 'size': 2, 'min_size': 1, 'crush_rule': 0, 'peering_crush_bucket_count': 0, 'peering_crush_bucket_target': 0, 'peering_crush_bucket_barrier': 0, 'peering_crush_bucket_mandatory_member': 2147483647, 'object_hash': 2, 'pg_autoscale_mode': 'off', 'pg_num': 64, 'pg_placement_num': 64, 'pg_placement_num_target': 64, 'pg_num_target': 64, 'pg_num_pending': 64, 'last_pg_merge_meta': {'source_pgid': '0.0', 'ready_epoch': 0, 'last_epoch_started': 0, 'last_epoch_clean': 0, 'source_version': "0'0", 'target_version': "0'0"}, 'last_change': '18', 'last_force_op_resend': '0', 'last_force_op_resend_prenautilus': '0', 'last_force_op_resend_preluminous': '0', 'auid': 0, 'snap_mode': 'selfmanaged', 'snap_seq': 0, 'snap_epoch': 0, 'pool_snaps': [], 'removed_snaps': '[]', 'quota_max_bytes': 0, 'quota_max_objects': 0, 'tiers': [], 'tier_of': -1, 'read_tier': -1, 'write_tier': -1, 'cache_mode': 'none', 'target_max_bytes': 0, 'target_max_objects': 0, 'cache_target_dirty_ratio_micro': 400000, 'cache_target_dirty_high_ratio_micro': 600000, 'cache_target_full_ratio_micro': 800000, 'cache_min_flush_age': 0, 'cache_min_evict_age': 0, 'erasure_code_profile': '', 'hit_set_params': {'type': 'none'}, 'hit_set_period': 0, 'hit_set_count': 0, 'use_gmt_hitset': True, 'min_read_recency_for_promote': 0, 'min_write_recency_for_promote': 0, 'hit_set_grade_decay_rate': 0, 'hit_set_search_last_n': 0, 'grade_table': [], 'stripe_width': 0, 'expected_num_objects': 0, 'fast_read': False, 'options': {'pg_num_min': 64, 'target_size_ratio': 0.8999999761581421}, 'application_metadata': {'cephfs': {'data': 'cephfs'}}}, {'pool': 5, 'pool_name': 'unique_pool_0', 'create_time': '2023-08-01T19:54:21.165668+0000', 'flags': 1, 'flags_names': 'hashpspool', 'type': 1, 'size': 2, 'min_size': 1, 'crush_rule': 0, 'peering_crush_bucket_count': 0, 'peering_crush_bucket_target': 0, 'peering_crush_bucket_barrier': 0, 'peering_crush_bucket_mandatory_member': 2147483647, 'object_hash': 2, 'pg_autoscale_mode': 'off', 'pg_num': 16, 'pg_placement_num': 16, 'pg_placement_num_target': 16, 'pg_num_target': 16, 'pg_num_pending': 16, 'last_pg_merge_meta': {'source_pgid': '0.0', 'ready_epoch': 0, 'last_epoch_started': 0, 'last_epoch_clean': 0, 'source_version': "0'0", 'target_version': "0'0"}, 'last_change': '21', 'last_force_op_resend': '0', 'last_force_op_resend_prenautilus': '0', 'last_force_op_resend_preluminous': '0', 'auid': 0, 'snap_mode': 'selfmanaged', 'snap_seq': 0, 'snap_epoch': 0, 'pool_snaps': [], 'removed_snaps': '[]', 'quota_max_bytes': 0, 'quota_max_objects': 0, 'tiers': [], 'tier_of': -1, 'read_tier': -1, 'write_tier': -1, 'cache_mode': 'none', 'target_max_bytes': 0, 'target_max_objects': 0, 'cache_target_dirty_ratio_micro': 400000, 'cache_target_dirty_high_ratio_micro': 600000, 'cache_target_full_ratio_micro': 800000, 'cache_min_flush_age': 0, 'cache_min_evict_age': 0, 'erasure_code_profile': '', 'hit_set_params': {'type': 'none'}, 'hit_set_period': 0, 'hit_set_count': 0, 'use_gmt_hitset': True, 'min_read_recency_for_promote': 0, 'min_write_recency_for_promote': 0, 'hit_set_grade_decay_rate': 0, 'hit_set_search_last_n': 0, 'grade_table': [], 'stripe_width': 0, 'expected_num_objects': 0, 'fast_read': False, 'options': {}, 'application_metadata': {'rados': {}}}], 'osds': [{'osd': 0, 'uuid': '5dd675c7-2777-48f2-8009-ff0e0d4c7086', 'up': 1, 'in': 1, 'weight': 1, 'primary_affinity': 0.822052001953125, 'last_clean_begin': 0, 'last_clean_end': 0, 'up_from': 8, 'up_thru': 72, 'down_at': 0, 'lost_at': 0, 'public_addrs': {'addrvec': [{'type': 'v2', 'addr': '172.21.15.8:6800', 'nonce': 111181}, {'type': 'v1', 'addr': '172.21.15.8:6801', 'nonce': 111181}]}, 'cluster_addrs': {'addrvec': [{'type': 'v2', 'addr': '172.21.15.8:6802', 'nonce': 111181}, {'type': 'v1', 'addr': '172.21.15.8:6803', 'nonce': 111181}]}, 'heartbeat_back_addrs': {'addrvec': [{'type': 'v2', 'addr': '172.21.15.8:6806', 'nonce': 111181}, {'type': 'v1', 'addr': '172.21.15.8:6807', 'nonce': 111181}]}, 'heartbeat_front_addrs': {'addrvec': [{'type': 'v2', 'addr': '172.21.15.8:6804', 'nonce': 111181}, {'type': 'v1', 'addr': '172.21.15.8:6805', 'nonce': 111181}]}, 'public_addr': '172.21.15.8:6801/111181', 'cluster_addr': '172.21.15.8:6803/111181', 'heartbeat_back_addr': '172.21.15.8:6807/111181', 'heartbeat_front_addr': '172.21.15.8:6805/111181', 'state': ['exists', 'up']}, {'osd': 1, 'uuid': '7fc612c4-33ba-4a33-bca8-1f42ee8ed548', 'up': 0, 'in': 1, 'weight': 1, 'primary_affinity': 0.3376312255859375, 'last_clean_begin': 0, 'last_clean_end': 0, 'up_from': 8, 'up_thru': 53, 'down_at': 62, 'lost_at': 0, 'public_addrs': {'addrvec': [{'type': 'v2', 'addr': '172.21.15.101:6800', 'nonce': 111143}, {'type': 'v1', 'addr': '172.21.15.101:6801', 'nonce': 111143}]}, 'cluster_addrs': {'addrvec': [{'type': 'v2', 'addr': '172.21.15.101:6802', 'nonce': 111143}, {'type': 'v1', 'addr': '172.21.15.101:6803', 'nonce': 111143}]}, 'heartbeat_back_addrs': {'addrvec': [{'type': 'v2', 'addr': '172.21.15.101:6806', 'nonce': 111143}, {'type': 'v1', 'addr': '172.21.15.101:6807', 'nonce': 111143}]}, 'heartbeat_front_addrs': {'addrvec': [{'type': 'v2', 'addr': '172.21.15.101:6804', 'nonce': 111143}, {'type': 'v1', 'addr': '172.21.15.101:6805', 'nonce': 111143}]}, 'public_addr': '172.21.15.101:6801/111143', 'cluster_addr': '172.21.15.101:6803/111143', 'heartbeat_back_addr': '172.21.15.101:6807/111143', 'heartbeat_front_addr': '172.21.15.101:6805/111143', 'state': ['exists']}, {'osd': 2, 'uuid': 'f85cadbc-4230-4772-8f39-62ed52e220b1', 'up': 1, 'in': 1, 'weight': 1, 'primary_affinity': 0, 'last_clean_begin': 0, 'last_clean_end': 0, 'up_from': 9, 'up_thru': 62, 'down_at': 0, 'lost_at': 0, 'public_addrs': {'addrvec': [{'type': 'v2', 'addr': '172.21.15.155:6800', 'nonce': 111339}, {'type': 'v1', 'addr': '172.21.15.155:6801', 'nonce': 111339}]}, 'cluster_addrs': {'addrvec': [{'type': 'v2', 'addr': '172.21.15.155:6802', 'nonce': 111339}, {'type': 'v1', 'addr': '172.21.15.155:6803', 'nonce': 111339}]}, 'heartbeat_back_addrs': {'addrvec': [{'type': 'v2', 'addr': '172.21.15.155:6806', 'nonce': 111339}, {'type': 'v1', 'addr': '172.21.15.155:6807', 'nonce': 111339}]}, 'heartbeat_front_addrs': {'addrvec': [{'type': 'v2', 'addr': '172.21.15.155:6804', 'nonce': 111339}, {'type': 'v1', 'addr': '172.21.15.155:6805', 'nonce': 111339}]}, 'public_addr': '172.21.15.155:6801/111339', 'cluster_addr': '172.21.15.155:6803/111339', 'heartbeat_back_addr': '172.21.15.155:6807/111339', 'heartbeat_front_addr': '172.21.15.155:6805/111339', 'state': ['exists', 'up']}], 'osd_xinfo': [{'osd': 0, 'down_stamp': '0.000000', 'laggy_probability': 0, 'laggy_interval': 0, 'features': 4540138320759226367, 'old_weight': 0, 'last_purged_snaps_scrub': '2023-08-01T19:53:48.018154+0000', 'dead_epoch': 0}, {'osd': 1, 'down_stamp': '0.000000', 'laggy_probability': 0, 'laggy_interval': 0, 'features': 4540138320759226367, 'old_weight': 0, 'last_purged_snaps_scrub': '2023-08-01T19:53:48.000488+0000', 'dead_epoch': 61}, {'osd': 2, 'down_stamp': '0.000000', 'laggy_probability': 0, 'laggy_interval': 0, 'features': 4540138320759226367, 'old_weight': 0, 'last_purged_snaps_scrub': '2023-08-01T19:53:48.072529+0000', 'dead_epoch': 0}], 'pg_upmap': [], 'pg_upmap_items': [], 'pg_temp': [], 'primary_temp': [], 'blocklist': {}, 'range_blocklist': {}, 'erasure_code_profiles': {'default': {'crush-failure-domain': 'osd', 'k': '2', 'm': '1', 'plugin': 'jerasure', 'technique': 'reed_sol_van'}}, 'removed_snaps_queue': [], 'new_removed_snaps': [], 'new_purged_snaps': [], 'crush_node_flags': {}, 'device_class_flags': {}, 'stretch_mode': {'stretch_mode_enabled': False, 'stretch_bucket_count': 0, 'degraded_stretch_mode': 0, 'recovering_stretch_mode': 0, 'stretch_mode_bucket': 0}} 2023-08-01T19:56:27.204 INFO:tasks.thrashosds.thrasher:No pg_upmap entries; doing nothing 2023-08-01T19:56:27.204 DEBUG:teuthology.orchestra.run.smithi155:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 30 ceph --cluster ceph --admin-daemon /var/run/ceph/ceph-osd.2.asok dump_blocked_ops 2023-08-01T19:56:27.204 INFO:tasks.ceph.osd.2.smithi155.stderr:2023-08-01T19:56:27.200+0000 7faa5c6ac700 -1 received signal: Hangup from /usr/bin/python3 /bin/daemon-helper kill ceph-osd -f --cluster ceph -i 2 (PID: 111337) UID: 0 2023-08-01T19:56:27.302 INFO:tasks.ceph.osd.2.smithi155.stderr:2023-08-01T19:56:27.301+0000 7faa5c6ac700 -1 received signal: Hangup from /usr/bin/python3 /bin/daemon-helper kill ceph-osd -f --cluster ceph -i 2 (PID: 111337) UID: 0 2023-08-01T19:56:27.398 INFO:teuthology.orchestra.run.smithi155.stdout:ERROR: (22) Invalid argument 2023-08-01T19:56:27.398 INFO:teuthology.orchestra.run.smithi155.stdout:op_tracker tracking is not enabled now, so no ops are tracked currently, even those get stuck. Please enable "osd_enable_op_tracker", and the tracker will start to track new ops received afterwards. 2023-08-01T19:56:27.405 INFO:tasks.ceph.osd.2.smithi155.stderr:2023-08-01T19:56:27.402+0000 7faa5c6ac700 -1 received signal: Hangup from /usr/bin/python3 /bin/daemon-helper kill ceph-osd -f --cluster ceph -i 2 (PID: 111337) UID: 0 2023-08-01T19:56:27.406 INFO:tasks.daemonwatchdog.daemon_watchdog:daemon ceph.osd.1 is failed for ~24s 2023-08-01T19:56:27.411 DEBUG:teuthology.orchestra.run.smithi155:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 30 ceph --cluster ceph --admin-daemon /var/run/ceph/ceph-osd.2.asok dump_historic_ops 2023-08-01T19:56:27.504 INFO:tasks.ceph.osd.0.smithi008.stderr:2023-08-01T19:56:27.504+0000 7f16a58f4700 -1 received signal: Hangup from /usr/bin/python3 /bin/daemon-helper kill ceph-osd -f --cluster ceph -i 0 (PID: 111179) UID: 0 2023-08-01T19:56:27.605 INFO:tasks.ceph.osd.2.smithi155.stderr:2023-08-01T19:56:27.603+0000 7faa5c6ac700 -1 received signal: Hangup from /usr/bin/python3 /bin/daemon-helper kill ceph-osd -f --cluster ceph -i 2 (PID: 111337) UID: 0 2023-08-01T19:56:27.609 INFO:teuthology.orchestra.run.smithi155.stdout:ERROR: (22) Invalid argument 2023-08-01T19:56:27.609 INFO:teuthology.orchestra.run.smithi155.stdout:op_tracker tracking is not enabled now, so no ops are tracked currently, even those get stuck. Please enable "osd_enable_op_tracker", and the tracker will start to track new ops received afterwards. 2023-08-01T19:56:27.623 DEBUG:teuthology.orchestra.run.smithi008:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 30 ceph --cluster ceph --admin-daemon /var/run/ceph/ceph-osd.0.asok dump_ops_in_flight 2023-08-01T19:56:27.707 INFO:tasks.ceph.osd.0.smithi008.stderr:2023-08-01T19:56:27.706+0000 7f16a58f4700 -1 received signal: Hangup from /usr/bin/python3 /bin/daemon-helper kill ceph-osd -f --cluster ceph -i 0 (PID: 111179) UID: 0 2023-08-01T19:56:27.806 INFO:teuthology.orchestra.run.smithi008.stdout:ERROR: (22) Invalid argument 2023-08-01T19:56:27.806 INFO:teuthology.orchestra.run.smithi008.stdout:op_tracker tracking is not enabled now, so no ops are tracked currently, even those get stuck. Please enable "osd_enable_op_tracker", and the tracker will start to track new ops received afterwards. 2023-08-01T19:56:27.807 INFO:tasks.ceph.osd.0.smithi008.stderr:2023-08-01T19:56:27.805+0000 7f16a58f4700 -1 received signal: Hangup from /usr/bin/python3 /bin/daemon-helper kill ceph-osd -f --cluster ceph -i 0 (PID: 111179) UID: 0 2023-08-01T19:56:27.820 DEBUG:teuthology.orchestra.run.smithi008:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 30 ceph --cluster ceph --admin-daemon /var/run/ceph/ceph-osd.0.asok dump_blocked_ops 2023-08-01T19:56:27.912 INFO:tasks.ceph.osd.0.smithi008.stderr:2023-08-01T19:56:27.912+0000 7f16a58f4700 -1 received signal: Hangup from /usr/bin/python3 /bin/daemon-helper kill ceph-osd -f --cluster ceph -i 0 (PID: 111179) UID: 0 2023-08-01T19:56:28.010 INFO:tasks.ceph.osd.0.smithi008.stderr:2023-08-01T19:56:28.008+0000 7f16a58f4700 -1 received signal: Hangup from /usr/bin/python3 /bin/daemon-helper kill ceph-osd -f --cluster ceph -i 0 (PID: 111179) UID: 0 2023-08-01T19:56:28.045 INFO:teuthology.orchestra.run.smithi008.stdout:ERROR: (22) Invalid argument 2023-08-01T19:56:28.045 INFO:teuthology.orchestra.run.smithi008.stdout:op_tracker tracking is not enabled now, so no ops are tracked currently, even those get stuck. Please enable "osd_enable_op_tracker", and the tracker will start to track new ops received afterwards. 2023-08-01T19:56:28.062 DEBUG:teuthology.orchestra.run.smithi008:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 30 ceph --cluster ceph --admin-daemon /var/run/ceph/ceph-osd.0.asok dump_historic_ops 2023-08-01T19:56:28.147 INFO:tasks.ceph.osd.0.smithi008.stderr:2023-08-01T19:56:28.147+0000 7f16a58f4700 -1 received signal: Hangup from /usr/bin/python3 /bin/daemon-helper kill ceph-osd -f --cluster ceph -i 0 (PID: 111179) UID: 0 2023-08-01T19:56:28.210 INFO:tasks.ceph.osd.2.smithi155.stderr:2023-08-01T19:56:28.208+0000 7faa5c6ac700 -1 received signal: Hangup from /usr/bin/python3 /bin/daemon-helper kill ceph-osd -f --cluster ceph -i 2 (PID: 111337) UID: 0 2023-08-01T19:56:28.299 INFO:teuthology.orchestra.run.smithi008.stdout:ERROR: (22) Invalid argument 2023-08-01T19:56:28.299 INFO:teuthology.orchestra.run.smithi008.stdout:op_tracker tracking is not enabled now, so no ops are tracked currently, even those get stuck. Please enable "osd_enable_op_tracker", and the tracker will start to track new ops received afterwards. 2023-08-01T19:56:28.310 INFO:tasks.ceph.osd.0.smithi008.stderr:2023-08-01T19:56:28.310+0000 7f16a58f4700 -1 received signal: Hangup from /usr/bin/python3 /bin/daemon-helper kill ceph-osd -f --cluster ceph -i 0 (PID: 111179) UID: 0 2023-08-01T19:56:28.313 DEBUG:teuthology.orchestra.run.smithi155:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 30 ceph --cluster ceph --admin-daemon /var/run/ceph/ceph-osd.2.asok dump_ops_in_flight 2023-08-01T19:56:28.411 INFO:tasks.ceph.osd.0.smithi008.stderr:2023-08-01T19:56:28.410+0000 7f16a58f4700 -1 received signal: Hangup from /usr/bin/python3 /bin/daemon-helper kill ceph-osd -f --cluster ceph -i 0 (PID: 111179) UID: 0 2023-08-01T19:56:28.477 INFO:teuthology.orchestra.run.smithi155.stdout:ERROR: (22) Invalid argument 2023-08-01T19:56:28.477 INFO:teuthology.orchestra.run.smithi155.stdout:op_tracker tracking is not enabled now, so no ops are tracked currently, even those get stuck. Please enable "osd_enable_op_tracker", and the tracker will start to track new ops received afterwards. 2023-08-01T19:56:28.489 DEBUG:teuthology.orchestra.run.smithi155:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 30 ceph --cluster ceph --admin-daemon /var/run/ceph/ceph-osd.2.asok dump_blocked_ops 2023-08-01T19:56:28.506 DEBUG:teuthology.orchestra.run.smithi006:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 120 ceph --cluster ceph -- tell 'osd.*' injectargs --osd_enable_op_tracker=true 2023-08-01T19:56:28.511 INFO:tasks.ceph.osd.0.smithi008.stderr:2023-08-01T19:56:28.511+0000 7f16a58f4700 -1 received signal: Hangup from /usr/bin/python3 /bin/daemon-helper kill ceph-osd -f --cluster ceph -i 0 (PID: 111179) UID: 0 2023-08-01T19:56:28.612 INFO:tasks.ceph.osd.2.smithi155.stderr:2023-08-01T19:56:28.610+0000 7faa5c6ac700 -1 received signal: Hangup from /usr/bin/python3 /bin/daemon-helper kill ceph-osd -f --cluster ceph -i 2 (PID: 111337) UID: 0 2023-08-01T19:56:28.650 INFO:teuthology.orchestra.run.smithi155.stdout:ERROR: (22) Invalid argument 2023-08-01T19:56:28.651 INFO:teuthology.orchestra.run.smithi155.stdout:op_tracker tracking is not enabled now, so no ops are tracked currently, even those get stuck. Please enable "osd_enable_op_tracker", and the tracker will start to track new ops received afterwards. 2023-08-01T19:56:28.654 INFO:teuthology.orchestra.run.smithi006.stdout:osd.0: {} 2023-08-01T19:56:28.665 DEBUG:teuthology.orchestra.run.smithi155:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 30 ceph --cluster ceph --admin-daemon /var/run/ceph/ceph-osd.2.asok dump_historic_ops 2023-08-01T19:56:28.674 INFO:teuthology.orchestra.run.smithi006.stdout:osd.2: {} 2023-08-01T19:56:28.675 INFO:teuthology.orchestra.run.smithi006.stderr:osd.0: osd_enable_op_tracker = 'true' 2023-08-01T19:56:28.675 INFO:teuthology.orchestra.run.smithi006.stderr:Error ENXIO: problem getting command descriptions from osd.1 2023-08-01T19:56:28.675 INFO:teuthology.orchestra.run.smithi006.stderr:osd.2: osd_enable_op_tracker = 'true' 2023-08-01T19:56:28.677 DEBUG:teuthology.orchestra.run:got remote process result: 6 2023-08-01T19:56:28.677 INFO:tasks.thrashosds.thrasher:Failed to tell all osds, ignoring 2023-08-01T19:56:28.712 INFO:tasks.ceph.osd.0.smithi008.stderr:2023-08-01T19:56:28.712+0000 7f16a58f4700 -1 received signal: Hangup from /usr/bin/python3 /bin/daemon-helper kill ceph-osd -f --cluster ceph -i 0 (PID: 111179) UID: 0 2023-08-01T19:56:28.813 INFO:tasks.ceph.osd.0.smithi008.stderr:2023-08-01T19:56:28.812+0000 7f16a58f4700 -1 received signal: Hangup from /usr/bin/python3 /bin/daemon-helper kill ceph-osd -f --cluster ceph -i 0 (PID: 111179) UID: 0 2023-08-01T19:56:28.863 INFO:teuthology.orchestra.run.smithi155.stdout:{ 2023-08-01T19:56:28.863 INFO:teuthology.orchestra.run.smithi155.stdout: "size": 20, 2023-08-01T19:56:28.864 INFO:teuthology.orchestra.run.smithi155.stdout: "duration": 600, 2023-08-01T19:56:28.864 INFO:teuthology.orchestra.run.smithi155.stdout: "ops": [ 2023-08-01T19:56:28.864 INFO:teuthology.orchestra.run.smithi155.stdout: { 2023-08-01T19:56:28.864 INFO:teuthology.orchestra.run.smithi155.stdout: "description": "osd_op(client.4668.0:100237 5.4 5:2d68bec9:::benchmark_data_smithi006_114134_object100236:head [set-alloc-hint object_size 65536 write_size 65536,write 0~65536] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e37)", 2023-08-01T19:56:28.864 INFO:teuthology.orchestra.run.smithi155.stdout: "initiated_at": "2023-08-01T19:55:05.147736+0000", 2023-08-01T19:56:28.864 INFO:teuthology.orchestra.run.smithi155.stdout: "age": 83.712485524000002, 2023-08-01T19:56:28.864 INFO:teuthology.orchestra.run.smithi155.stdout: "duration": 0.071299464000000007, 2023-08-01T19:56:28.865 INFO:teuthology.orchestra.run.smithi155.stdout: "type_data": { 2023-08-01T19:56:28.865 INFO:teuthology.orchestra.run.smithi155.stdout: "flag_point": "commit sent; apply or cleanup", 2023-08-01T19:56:28.865 INFO:teuthology.orchestra.run.smithi155.stdout: "client_info": { 2023-08-01T19:56:28.865 INFO:teuthology.orchestra.run.smithi155.stdout: "client": "client.4668", 2023-08-01T19:56:28.865 INFO:teuthology.orchestra.run.smithi155.stdout: "client_addr": "172.21.15.6:0/1709472247", 2023-08-01T19:56:28.865 INFO:teuthology.orchestra.run.smithi155.stdout: "tid": 100237 2023-08-01T19:56:28.865 INFO:teuthology.orchestra.run.smithi155.stdout: }, 2023-08-01T19:56:28.866 INFO:teuthology.orchestra.run.smithi155.stdout: "events": [ 2023-08-01T19:56:28.866 INFO:teuthology.orchestra.run.smithi155.stdout: { 2023-08-01T19:56:28.866 INFO:teuthology.orchestra.run.smithi155.stdout: "event": "initiated", 2023-08-01T19:56:28.866 INFO:teuthology.orchestra.run.smithi155.stdout: "time": "2023-08-01T19:55:05.147736+0000", 2023-08-01T19:56:28.866 INFO:teuthology.orchestra.run.smithi155.stdout: "duration": 0 2023-08-01T19:56:28.866 INFO:teuthology.orchestra.run.smithi155.stdout: }, 2023-08-01T19:56:28.866 INFO:teuthology.orchestra.run.smithi155.stdout: { 2023-08-01T19:56:28.866 INFO:teuthology.orchestra.run.smithi155.stdout: "event": "throttled", 2023-08-01T19:56:28.867 INFO:teuthology.orchestra.run.smithi155.stdout: "time": "2023-08-01T19:55:05.147736+0000", 2023-08-01T19:56:28.867 INFO:teuthology.orchestra.run.smithi155.stdout: "duration": 0 2023-08-01T19:56:28.867 INFO:teuthology.orchestra.run.smithi155.stdout: }, 2023-08-01T19:56:28.867 INFO:teuthology.orchestra.run.smithi155.stdout: { 2023-08-01T19:56:28.867 INFO:teuthology.orchestra.run.smithi155.stdout: "event": "header_read", 2023-08-01T19:56:28.867 INFO:teuthology.orchestra.run.smithi155.stdout: "time": "2023-08-01T19:55:05.147736+0000", 2023-08-01T19:56:28.867 INFO:teuthology.orchestra.run.smithi155.stdout: "duration": 4294967295.9999995 2023-08-01T19:56:28.867 INFO:teuthology.orchestra.run.smithi155.stdout: }, 2023-08-01T19:56:28.868 INFO:teuthology.orchestra.run.smithi155.stdout: { 2023-08-01T19:56:28.868 INFO:teuthology.orchestra.run.smithi155.stdout: "event": "all_read", 2023-08-01T19:56:28.868 INFO:teuthology.orchestra.run.smithi155.stdout: "time": "2023-08-01T19:55:05.147766+0000", 2023-08-01T19:56:28.868 INFO:teuthology.orchestra.run.smithi155.stdout: "duration": 3.0394000000000001e-05 2023-08-01T19:56:28.868 INFO:teuthology.orchestra.run.smithi155.stdout: }, 2023-08-01T19:56:28.868 INFO:teuthology.orchestra.run.smithi155.stdout: { 2023-08-01T19:56:28.868 INFO:teuthology.orchestra.run.smithi155.stdout: "event": "dispatched", 2023-08-01T19:56:28.868 INFO:teuthology.orchestra.run.smithi155.stdout: "time": "2023-08-01T19:55:05.147771+0000", 2023-08-01T19:56:28.869 INFO:teuthology.orchestra.run.smithi155.stdout: "duration": 4.25e-06 2023-08-01T19:56:28.869 INFO:teuthology.orchestra.run.smithi155.stdout: }, 2023-08-01T19:56:28.869 INFO:teuthology.orchestra.run.smithi155.stdout: { 2023-08-01T19:56:28.869 INFO:teuthology.orchestra.run.smithi155.stdout: "event": "queued_for_pg", 2023-08-01T19:56:28.869 INFO:teuthology.orchestra.run.smithi155.stdout: "time": "2023-08-01T19:55:05.147773+0000", 2023-08-01T19:56:28.869 INFO:teuthology.orchestra.run.smithi155.stdout: "duration": 2.4159999999999998e-06 2023-08-01T19:56:28.869 INFO:teuthology.orchestra.run.smithi155.stdout: }, 2023-08-01T19:56:28.869 INFO:teuthology.orchestra.run.smithi155.stdout: { 2023-08-01T19:56:28.870 INFO:teuthology.orchestra.run.smithi155.stdout: "event": "reached_pg", 2023-08-01T19:56:28.870 INFO:teuthology.orchestra.run.smithi155.stdout: "time": "2023-08-01T19:55:05.149903+0000", 2023-08-01T19:56:28.870 INFO:teuthology.orchestra.run.smithi155.stdout: "duration": 0.002129948 2023-08-01T19:56:28.870 INFO:teuthology.orchestra.run.smithi155.stdout: }, 2023-08-01T19:56:28.870 INFO:teuthology.orchestra.run.smithi155.stdout: { 2023-08-01T19:56:28.870 INFO:teuthology.orchestra.run.smithi155.stdout: "event": "started", 2023-08-01T19:56:28.870 INFO:teuthology.orchestra.run.smithi155.stdout: "time": "2023-08-01T19:55:05.149982+0000", 2023-08-01T19:56:28.870 INFO:teuthology.orchestra.run.smithi155.stdout: "duration": 7.8706000000000002e-05 2023-08-01T19:56:28.871 INFO:teuthology.orchestra.run.smithi155.stdout: }, 2023-08-01T19:56:28.871 INFO:teuthology.orchestra.run.smithi155.stdout: { 2023-08-01T19:56:28.871 INFO:teuthology.orchestra.run.smithi155.stdout: "event": "waiting for subops from 0", 2023-08-01T19:56:28.871 INFO:teuthology.orchestra.run.smithi155.stdout: "time": "2023-08-01T19:55:05.150066+0000", 2023-08-01T19:56:28.871 INFO:teuthology.orchestra.run.smithi155.stdout: "duration": 8.4241999999999997e-05 2023-08-01T19:56:28.871 INFO:teuthology.orchestra.run.smithi155.stdout: }, 2023-08-01T19:56:28.871 INFO:teuthology.orchestra.run.smithi155.stdout: { 2023-08-01T19:56:28.872 INFO:teuthology.orchestra.run.smithi155.stdout: "event": "op_commit", 2023-08-01T19:56:28.872 INFO:teuthology.orchestra.run.smithi155.stdout: "time": "2023-08-01T19:55:05.154994+0000", 2023-08-01T19:56:28.872 INFO:teuthology.orchestra.run.smithi155.stdout: "duration": 0.0049277050000000001 2023-08-01T19:56:28.872 INFO:teuthology.orchestra.run.smithi155.stdout: }, 2023-08-01T19:56:28.872 INFO:teuthology.orchestra.run.smithi155.stdout: { 2023-08-01T19:56:28.872 INFO:teuthology.orchestra.run.smithi155.stdout: "event": "sub_op_commit_rec", 2023-08-01T19:56:28.872 INFO:teuthology.orchestra.run.smithi155.stdout: "time": "2023-08-01T19:55:05.218933+0000", 2023-08-01T19:56:28.872 INFO:teuthology.orchestra.run.smithi155.stdout: "duration": 0.063939916999999999 2023-08-01T19:56:28.873 INFO:teuthology.orchestra.run.smithi155.stdout: }, 2023-08-01T19:56:28.873 INFO:teuthology.orchestra.run.smithi155.stdout: { 2023-08-01T19:56:28.873 INFO:teuthology.orchestra.run.smithi155.stdout: "event": "commit_sent", 2023-08-01T19:56:28.873 INFO:teuthology.orchestra.run.smithi155.stdout: "time": "2023-08-01T19:55:05.218989+0000", 2023-08-01T19:56:28.873 INFO:teuthology.orchestra.run.smithi155.stdout: "duration": 5.5772000000000001e-05 2023-08-01T19:56:28.873 INFO:teuthology.orchestra.run.smithi155.stdout: }, 2023-08-01T19:56:28.873 INFO:teuthology.orchestra.run.smithi155.stdout: { 2023-08-01T19:56:28.873 INFO:teuthology.orchestra.run.smithi155.stdout: "event": "done", 2023-08-01T19:56:28.874 INFO:teuthology.orchestra.run.smithi155.stdout: "time": "2023-08-01T19:55:05.219036+0000", 2023-08-01T19:56:28.874 INFO:teuthology.orchestra.run.smithi155.stdout: "duration": 4.6526000000000001e-05 2023-08-01T19:56:28.874 INFO:teuthology.orchestra.run.smithi155.stdout: } 2023-08-01T19:56:28.874 INFO:teuthology.orchestra.run.smithi155.stdout: ] 2023-08-01T19:56:28.874 INFO:teuthology.orchestra.run.smithi155.stdout: } 2023-08-01T19:56:28.874 INFO:teuthology.orchestra.run.smithi155.stdout: }, 2023-08-01T19:56:28.874 INFO:teuthology.orchestra.run.smithi155.stdout: { 2023-08-01T19:56:28.874 INFO:teuthology.orchestra.run.smithi155.stdout: "description": "osd_op(client.4668.0:100242 5.8 5:16a314b8:::benchmark_data_smithi006_114134_object100241:head [set-alloc-hint object_size 65536 write_size 65536,write 0~65536] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e37)", 2023-08-01T19:56:28.875 INFO:teuthology.orchestra.run.smithi155.stdout: "initiated_at": "2023-08-01T19:55:05.150616+0000", 2023-08-01T19:56:28.875 INFO:teuthology.orchestra.run.smithi155.stdout: "age": 83.709605894000006, 2023-08-01T19:56:28.875 INFO:teuthology.orchestra.run.smithi155.stdout: "duration": 0.071105065999999995, 2023-08-01T19:56:28.875 INFO:teuthology.orchestra.run.smithi155.stdout: "type_data": { 2023-08-01T19:56:28.875 INFO:teuthology.orchestra.run.smithi155.stdout: "flag_point": "commit sent; apply or cleanup", 2023-08-01T19:56:28.875 INFO:teuthology.orchestra.run.smithi155.stdout: "client_info": { 2023-08-01T19:56:28.875 INFO:teuthology.orchestra.run.smithi155.stdout: "client": "client.4668", 2023-08-01T19:56:28.875 INFO:teuthology.orchestra.run.smithi155.stdout: "client_addr": "172.21.15.6:0/1709472247", 2023-08-01T19:56:28.876 INFO:teuthology.orchestra.run.smithi155.stdout: "tid": 100242 2023-08-01T19:56:28.876 INFO:teuthology.orchestra.run.smithi155.stdout: }, 2023-08-01T19:56:28.876 INFO:teuthology.orchestra.run.smithi155.stdout: "events": [ 2023-08-01T19:56:28.876 INFO:teuthology.orchestra.run.smithi155.stdout: { 2023-08-01T19:56:28.876 INFO:teuthology.orchestra.run.smithi155.stdout: "event": "initiated", 2023-08-01T19:56:28.876 INFO:teuthology.orchestra.run.smithi155.stdout: "time": "2023-08-01T19:55:05.150616+0000", 2023-08-01T19:56:28.876 INFO:teuthology.orchestra.run.smithi155.stdout: "duration": 0 2023-08-01T19:56:28.876 INFO:teuthology.orchestra.run.smithi155.stdout: }, 2023-08-01T19:56:28.877 INFO:teuthology.orchestra.run.smithi155.stdout: { 2023-08-01T19:56:28.877 INFO:teuthology.orchestra.run.smithi155.stdout: "event": "throttled", 2023-08-01T19:56:28.877 INFO:teuthology.orchestra.run.smithi155.stdout: "time": "2023-08-01T19:55:05.150616+0000", 2023-08-01T19:56:28.877 INFO:teuthology.orchestra.run.smithi155.stdout: "duration": 0 2023-08-01T19:56:28.877 INFO:teuthology.orchestra.run.smithi155.stdout: }, 2023-08-01T19:56:28.877 INFO:teuthology.orchestra.run.smithi155.stdout: { 2023-08-01T19:56:28.877 INFO:teuthology.orchestra.run.smithi155.stdout: "event": "header_read", 2023-08-01T19:56:28.877 INFO:teuthology.orchestra.run.smithi155.stdout: "time": "2023-08-01T19:55:05.150615+0000", 2023-08-01T19:56:28.878 INFO:teuthology.orchestra.run.smithi155.stdout: "duration": 4294967295.999999 2023-08-01T19:56:28.878 INFO:teuthology.orchestra.run.smithi155.stdout: }, 2023-08-01T19:56:28.878 INFO:teuthology.orchestra.run.smithi155.stdout: { 2023-08-01T19:56:28.878 INFO:teuthology.orchestra.run.smithi155.stdout: "event": "all_read", 2023-08-01T19:56:28.878 INFO:teuthology.orchestra.run.smithi155.stdout: "time": "2023-08-01T19:55:05.150696+0000", 2023-08-01T19:56:28.878 INFO:teuthology.orchestra.run.smithi155.stdout: "duration": 8.0852000000000004e-05 2023-08-01T19:56:28.878 INFO:teuthology.orchestra.run.smithi155.stdout: }, 2023-08-01T19:56:28.878 INFO:teuthology.orchestra.run.smithi155.stdout: { 2023-08-01T19:56:28.879 INFO:teuthology.orchestra.run.smithi155.stdout: "event": "dispatched", 2023-08-01T19:56:28.879 INFO:teuthology.orchestra.run.smithi155.stdout: "time": "2023-08-01T19:55:05.150708+0000", 2023-08-01T19:56:28.879 INFO:teuthology.orchestra.run.smithi155.stdout: "duration": 1.2116999999999999e-05 2023-08-01T19:56:28.879 INFO:teuthology.orchestra.run.smithi155.stdout: }, 2023-08-01T19:56:28.879 INFO:teuthology.orchestra.run.smithi155.stdout: { 2023-08-01T19:56:28.879 INFO:teuthology.orchestra.run.smithi155.stdout: "event": "queued_for_pg", 2023-08-01T19:56:28.879 INFO:teuthology.orchestra.run.smithi155.stdout: "time": "2023-08-01T19:55:05.150713+0000", 2023-08-01T19:56:28.879 INFO:teuthology.orchestra.run.smithi155.stdout: "duration": 5.4620000000000004e-06 2023-08-01T19:56:28.880 INFO:teuthology.orchestra.run.smithi155.stdout: }, 2023-08-01T19:56:28.880 INFO:teuthology.orchestra.run.smithi155.stdout: { 2023-08-01T19:56:28.880 INFO:teuthology.orchestra.run.smithi155.stdout: "event": "reached_pg", 2023-08-01T19:56:28.880 INFO:teuthology.orchestra.run.smithi155.stdout: "time": "2023-08-01T19:55:05.150761+0000", 2023-08-01T19:56:28.880 INFO:teuthology.orchestra.run.smithi155.stdout: "duration": 4.7429000000000003e-05 2023-08-01T19:56:28.880 INFO:teuthology.orchestra.run.smithi155.stdout: }, 2023-08-01T19:56:28.880 INFO:teuthology.orchestra.run.smithi155.stdout: { 2023-08-01T19:56:28.881 INFO:teuthology.orchestra.run.smithi155.stdout: "event": "started", 2023-08-01T19:56:28.881 INFO:teuthology.orchestra.run.smithi155.stdout: "time": "2023-08-01T19:55:05.150856+0000", 2023-08-01T19:56:28.881 INFO:teuthology.orchestra.run.smithi155.stdout: "duration": 9.5356e-05 2023-08-01T19:56:28.881 INFO:teuthology.orchestra.run.smithi155.stdout: }, 2023-08-01T19:56:28.881 INFO:teuthology.orchestra.run.smithi155.stdout: { 2023-08-01T19:56:28.881 INFO:teuthology.orchestra.run.smithi155.stdout: "event": "waiting for subops from 0", 2023-08-01T19:56:28.881 INFO:teuthology.orchestra.run.smithi155.stdout: "time": "2023-08-01T19:55:05.150999+0000", 2023-08-01T19:56:28.881 INFO:teuthology.orchestra.run.smithi155.stdout: "duration": 0.00014234499999999999 2023-08-01T19:56:28.882 INFO:teuthology.orchestra.run.smithi155.stdout: }, 2023-08-01T19:56:28.882 INFO:teuthology.orchestra.run.smithi155.stdout: { 2023-08-01T19:56:28.882 INFO:teuthology.orchestra.run.smithi155.stdout: "event": "sub_op_commit_rec", 2023-08-01T19:56:28.882 INFO:teuthology.orchestra.run.smithi155.stdout: "time": "2023-08-01T19:55:05.219001+0000", 2023-08-01T19:56:28.882 INFO:teuthology.orchestra.run.smithi155.stdout: "duration": 0.068002776000000001 2023-08-01T19:56:28.882 INFO:teuthology.orchestra.run.smithi155.stdout: }, 2023-08-01T19:56:28.882 INFO:teuthology.orchestra.run.smithi155.stdout: { 2023-08-01T19:56:28.882 INFO:teuthology.orchestra.run.smithi155.stdout: "event": "op_commit", 2023-08-01T19:56:28.883 INFO:teuthology.orchestra.run.smithi155.stdout: "time": "2023-08-01T19:55:05.221635+0000", 2023-08-01T19:56:28.883 INFO:teuthology.orchestra.run.smithi155.stdout: "duration": 0.0026340579999999999 2023-08-01T19:56:28.883 INFO:teuthology.orchestra.run.smithi155.stdout: }, 2023-08-01T19:56:28.883 INFO:teuthology.orchestra.run.smithi155.stdout: { 2023-08-01T19:56:28.883 INFO:teuthology.orchestra.run.smithi155.stdout: "event": "commit_sent", 2023-08-01T19:56:28.883 INFO:teuthology.orchestra.run.smithi155.stdout: "time": "2023-08-01T19:55:05.221682+0000", 2023-08-01T19:56:28.883 INFO:teuthology.orchestra.run.smithi155.stdout: "duration": 4.7123999999999998e-05 2023-08-01T19:56:28.884 INFO:teuthology.orchestra.run.smithi155.stdout: }, 2023-08-01T19:56:28.884 INFO:teuthology.orchestra.run.smithi155.stdout: { 2023-08-01T19:56:28.884 INFO:teuthology.orchestra.run.smithi155.stdout: "event": "done", 2023-08-01T19:56:28.884 INFO:teuthology.orchestra.run.smithi155.stdout: "time": "2023-08-01T19:55:05.221721+0000", 2023-08-01T19:56:28.884 INFO:teuthology.orchestra.run.smithi155.stdout: "duration": 3.8529999999999999e-05 2023-08-01T19:56:28.884 INFO:teuthology.orchestra.run.smithi155.stdout: } 2023-08-01T19:56:28.884 INFO:teuthology.orchestra.run.smithi155.stdout: ] 2023-08-01T19:56:28.884 INFO:teuthology.orchestra.run.smithi155.stdout: } 2023-08-01T19:56:28.885 INFO:teuthology.orchestra.run.smithi155.stdout: }, 2023-08-01T19:56:28.885 INFO:teuthology.orchestra.run.smithi155.stdout: { 2023-08-01T19:56:28.885 INFO:teuthology.orchestra.run.smithi155.stdout: "description": "osd_repop(client.4668.0:100240 5.a e37/19 5:5313c5b9:::benchmark_data_smithi006_114134_object100239:head v 37'6227, mlcod=37'6225)", 2023-08-01T19:56:28.885 INFO:teuthology.orchestra.run.smithi155.stdout: "initiated_at": "2023-08-01T19:55:05.150778+0000", 2023-08-01T19:56:28.885 INFO:teuthology.orchestra.run.smithi155.stdout: "age": 83.709443692999997, 2023-08-01T19:56:28.885 INFO:teuthology.orchestra.run.smithi155.stdout: "duration": 0.073362533999999993, 2023-08-01T19:56:28.885 INFO:teuthology.orchestra.run.smithi155.stdout: "type_data": { 2023-08-01T19:56:28.886 INFO:teuthology.orchestra.run.smithi155.stdout: "flag_point": "commit sent; apply or cleanup", 2023-08-01T19:56:28.886 INFO:teuthology.orchestra.run.smithi155.stdout: "events": [ 2023-08-01T19:56:28.886 INFO:teuthology.orchestra.run.smithi155.stdout: { 2023-08-01T19:56:28.886 INFO:teuthology.orchestra.run.smithi155.stdout: "event": "initiated", 2023-08-01T19:56:28.886 INFO:teuthology.orchestra.run.smithi155.stdout: "time": "2023-08-01T19:55:05.150778+0000", 2023-08-01T19:56:28.886 INFO:teuthology.orchestra.run.smithi155.stdout: "duration": 0 2023-08-01T19:56:28.886 INFO:teuthology.orchestra.run.smithi155.stdout: }, 2023-08-01T19:56:28.886 INFO:teuthology.orchestra.run.smithi155.stdout: { 2023-08-01T19:56:28.887 INFO:teuthology.orchestra.run.smithi155.stdout: "event": "throttled", 2023-08-01T19:56:28.887 INFO:teuthology.orchestra.run.smithi155.stdout: "time": "2023-08-01T19:55:05.150778+0000", 2023-08-01T19:56:28.887 INFO:teuthology.orchestra.run.smithi155.stdout: "duration": 0 2023-08-01T19:56:28.887 INFO:teuthology.orchestra.run.smithi155.stdout: }, 2023-08-01T19:56:28.887 INFO:teuthology.orchestra.run.smithi155.stdout: { 2023-08-01T19:56:28.887 INFO:teuthology.orchestra.run.smithi155.stdout: "event": "header_read", 2023-08-01T19:56:28.887 INFO:teuthology.orchestra.run.smithi155.stdout: "time": "2023-08-01T19:55:05.150778+0000", 2023-08-01T19:56:28.887 INFO:teuthology.orchestra.run.smithi155.stdout: "duration": 4294967295.9999995 2023-08-01T19:56:28.888 INFO:teuthology.orchestra.run.smithi155.stdout: }, 2023-08-01T19:56:28.888 INFO:teuthology.orchestra.run.smithi155.stdout: { 2023-08-01T19:56:28.888 INFO:teuthology.orchestra.run.smithi155.stdout: "event": "all_read", 2023-08-01T19:56:28.888 INFO:teuthology.orchestra.run.smithi155.stdout: "time": "2023-08-01T19:55:05.150811+0000", 2023-08-01T19:56:28.888 INFO:teuthology.orchestra.run.smithi155.stdout: "duration": 3.3664000000000002e-05 2023-08-01T19:56:28.888 INFO:teuthology.orchestra.run.smithi155.stdout: }, 2023-08-01T19:56:28.888 INFO:teuthology.orchestra.run.smithi155.stdout: { 2023-08-01T19:56:28.888 INFO:teuthology.orchestra.run.smithi155.stdout: "event": "dispatched", 2023-08-01T19:56:28.889 INFO:teuthology.orchestra.run.smithi155.stdout: "time": "2023-08-01T19:55:05.150818+0000", 2023-08-01T19:56:28.889 INFO:teuthology.orchestra.run.smithi155.stdout: "duration": 6.5769999999999999e-06 2023-08-01T19:56:28.889 INFO:teuthology.orchestra.run.smithi155.stdout: }, 2023-08-01T19:56:28.889 INFO:teuthology.orchestra.run.smithi155.stdout: { 2023-08-01T19:56:28.889 INFO:teuthology.orchestra.run.smithi155.stdout: "event": "queued_for_pg", 2023-08-01T19:56:28.889 INFO:teuthology.orchestra.run.smithi155.stdout: "time": "2023-08-01T19:55:05.150822+0000", 2023-08-01T19:56:28.889 INFO:teuthology.orchestra.run.smithi155.stdout: "duration": 4.0060000000000003e-06 2023-08-01T19:56:28.890 INFO:teuthology.orchestra.run.smithi155.stdout: }, 2023-08-01T19:56:28.890 INFO:teuthology.orchestra.run.smithi155.stdout: { 2023-08-01T19:56:28.890 INFO:teuthology.orchestra.run.smithi155.stdout: "event": "reached_pg", 2023-08-01T19:56:28.890 INFO:teuthology.orchestra.run.smithi155.stdout: "time": "2023-08-01T19:55:05.150855+0000", 2023-08-01T19:56:28.890 INFO:teuthology.orchestra.run.smithi155.stdout: "duration": 3.3204999999999998e-05 2023-08-01T19:56:28.890 INFO:teuthology.orchestra.run.smithi155.stdout: }, 2023-08-01T19:56:28.890 INFO:teuthology.orchestra.run.smithi155.stdout: { 2023-08-01T19:56:28.890 INFO:teuthology.orchestra.run.smithi155.stdout: "event": "started", 2023-08-01T19:56:28.891 INFO:teuthology.orchestra.run.smithi155.stdout: "time": "2023-08-01T19:55:05.150873+0000", 2023-08-01T19:56:28.891 INFO:teuthology.orchestra.run.smithi155.stdout: "duration": 1.8139999999999999e-05 2023-08-01T19:56:28.891 INFO:teuthology.orchestra.run.smithi155.stdout: }, 2023-08-01T19:56:28.891 INFO:teuthology.orchestra.run.smithi155.stdout: { 2023-08-01T19:56:28.891 INFO:teuthology.orchestra.run.smithi155.stdout: "event": "commit_sent", 2023-08-01T19:56:28.891 INFO:teuthology.orchestra.run.smithi155.stdout: "time": "2023-08-01T19:55:05.224095+0000", 2023-08-01T19:56:28.891 INFO:teuthology.orchestra.run.smithi155.stdout: "duration": 0.073221895999999995 2023-08-01T19:56:28.891 INFO:teuthology.orchestra.run.smithi155.stdout: }, 2023-08-01T19:56:28.892 INFO:teuthology.orchestra.run.smithi155.stdout: { 2023-08-01T19:56:28.892 INFO:teuthology.orchestra.run.smithi155.stdout: "event": "done", 2023-08-01T19:56:28.892 INFO:teuthology.orchestra.run.smithi155.stdout: "time": "2023-08-01T19:55:05.224141+0000", 2023-08-01T19:56:28.892 INFO:teuthology.orchestra.run.smithi155.stdout: "duration": 4.5385e-05 2023-08-01T19:56:28.892 INFO:teuthology.orchestra.run.smithi155.stdout: } 2023-08-01T19:56:28.892 INFO:teuthology.orchestra.run.smithi155.stdout: ] 2023-08-01T19:56:28.892 INFO:teuthology.orchestra.run.smithi155.stdout: } 2023-08-01T19:56:28.893 INFO:teuthology.orchestra.run.smithi155.stdout: }, 2023-08-01T19:56:28.893 INFO:teuthology.orchestra.run.smithi155.stdout: { 2023-08-01T19:56:28.893 INFO:teuthology.orchestra.run.smithi155.stdout: "description": "osd_op(client.4668.0:100245 5.e 5:71869c66:::benchmark_data_smithi006_114134_object100244:head [set-alloc-hint object_size 65536 write_size 65536,write 0~65536] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e37)", 2023-08-01T19:56:28.893 INFO:teuthology.orchestra.run.smithi155.stdout: "initiated_at": "2023-08-01T19:55:05.150991+0000", 2023-08-01T19:56:28.893 INFO:teuthology.orchestra.run.smithi155.stdout: "age": 83.709230906000002, 2023-08-01T19:56:28.893 INFO:teuthology.orchestra.run.smithi155.stdout: "duration": 0.070734490999999997, 2023-08-01T19:56:28.893 INFO:teuthology.orchestra.run.smithi155.stdout: "type_data": { 2023-08-01T19:56:28.893 INFO:teuthology.orchestra.run.smithi155.stdout: "flag_point": "commit sent; apply or cleanup", 2023-08-01T19:56:28.894 INFO:teuthology.orchestra.run.smithi155.stdout: "client_info": { 2023-08-01T19:56:28.894 INFO:teuthology.orchestra.run.smithi155.stdout: "client": "client.4668", 2023-08-01T19:56:28.894 INFO:teuthology.orchestra.run.smithi155.stdout: "client_addr": "172.21.15.6:0/1709472247", 2023-08-01T19:56:28.894 INFO:teuthology.orchestra.run.smithi155.stdout: "tid": 100245 2023-08-01T19:56:28.894 INFO:teuthology.orchestra.run.smithi155.stdout: }, 2023-08-01T19:56:28.894 INFO:teuthology.orchestra.run.smithi155.stdout: "events": [ 2023-08-01T19:56:28.894 INFO:teuthology.orchestra.run.smithi155.stdout: { 2023-08-01T19:56:28.895 INFO:teuthology.orchestra.run.smithi155.stdout: "event": "initiated", 2023-08-01T19:56:28.895 INFO:teuthology.orchestra.run.smithi155.stdout: "time": "2023-08-01T19:55:05.150991+0000", 2023-08-01T19:56:28.895 INFO:teuthology.orchestra.run.smithi155.stdout: "duration": 0 2023-08-01T19:56:28.895 INFO:teuthology.orchestra.run.smithi155.stdout: }, 2023-08-01T19:56:28.895 INFO:teuthology.orchestra.run.smithi155.stdout: { 2023-08-01T19:56:28.895 INFO:teuthology.orchestra.run.smithi155.stdout: "event": "throttled", 2023-08-01T19:56:28.895 INFO:teuthology.orchestra.run.smithi155.stdout: "time": "2023-08-01T19:55:05.150991+0000", 2023-08-01T19:56:28.895 INFO:teuthology.orchestra.run.smithi155.stdout: "duration": 0 2023-08-01T19:56:28.896 INFO:teuthology.orchestra.run.smithi155.stdout: }, 2023-08-01T19:56:28.896 INFO:teuthology.orchestra.run.smithi155.stdout: { 2023-08-01T19:56:28.896 INFO:teuthology.orchestra.run.smithi155.stdout: "event": "header_read", 2023-08-01T19:56:28.896 INFO:teuthology.orchestra.run.smithi155.stdout: "time": "2023-08-01T19:55:05.150990+0000", 2023-08-01T19:56:28.896 INFO:teuthology.orchestra.run.smithi155.stdout: "duration": 4294967295.999999 2023-08-01T19:56:28.896 INFO:teuthology.orchestra.run.smithi155.stdout: }, 2023-08-01T19:56:28.896 INFO:teuthology.orchestra.run.smithi155.stdout: { 2023-08-01T19:56:28.897 INFO:teuthology.orchestra.run.smithi155.stdout: "event": "all_read", 2023-08-01T19:56:28.897 INFO:teuthology.orchestra.run.smithi155.stdout: "time": "2023-08-01T19:55:05.151108+0000", 2023-08-01T19:56:28.897 INFO:teuthology.orchestra.run.smithi155.stdout: "duration": 0.00011849300000000001 2023-08-01T19:56:28.897 INFO:teuthology.orchestra.run.smithi155.stdout: }, 2023-08-01T19:56:28.897 INFO:teuthology.orchestra.run.smithi155.stdout: { 2023-08-01T19:56:28.897 INFO:teuthology.orchestra.run.smithi155.stdout: "event": "dispatched", 2023-08-01T19:56:28.897 INFO:teuthology.orchestra.run.smithi155.stdout: "time": "2023-08-01T19:55:05.151117+0000", 2023-08-01T19:56:28.897 INFO:teuthology.orchestra.run.smithi155.stdout: "duration": 8.1040000000000007e-06 2023-08-01T19:56:28.898 INFO:teuthology.orchestra.run.smithi155.stdout: }, 2023-08-01T19:56:28.898 INFO:teuthology.orchestra.run.smithi155.stdout: { 2023-08-01T19:56:28.898 INFO:teuthology.orchestra.run.smithi155.stdout: "event": "queued_for_pg", 2023-08-01T19:56:28.898 INFO:teuthology.orchestra.run.smithi155.stdout: "time": "2023-08-01T19:55:05.151121+0000", 2023-08-01T19:56:28.898 INFO:teuthology.orchestra.run.smithi155.stdout: "duration": 4.2019999999999997e-06 2023-08-01T19:56:28.898 INFO:teuthology.orchestra.run.smithi155.stdout: }, 2023-08-01T19:56:28.898 INFO:teuthology.orchestra.run.smithi155.stdout: { 2023-08-01T19:56:28.898 INFO:teuthology.orchestra.run.smithi155.stdout: "event": "reached_pg", 2023-08-01T19:56:28.899 INFO:teuthology.orchestra.run.smithi155.stdout: "time": "2023-08-01T19:55:05.151162+0000", 2023-08-01T19:56:28.899 INFO:teuthology.orchestra.run.smithi155.stdout: "duration": 4.1448e-05 2023-08-01T19:56:28.899 INFO:teuthology.orchestra.run.smithi155.stdout: }, 2023-08-01T19:56:28.899 INFO:teuthology.orchestra.run.smithi155.stdout: { 2023-08-01T19:56:28.899 INFO:teuthology.orchestra.run.smithi155.stdout: "event": "started", 2023-08-01T19:56:28.899 INFO:teuthology.orchestra.run.smithi155.stdout: "time": "2023-08-01T19:55:05.151281+0000", 2023-08-01T19:56:28.899 INFO:teuthology.orchestra.run.smithi155.stdout: "duration": 0.000119141 2023-08-01T19:56:28.899 INFO:teuthology.orchestra.run.smithi155.stdout: }, 2023-08-01T19:56:28.900 INFO:teuthology.orchestra.run.smithi155.stdout: { 2023-08-01T19:56:28.900 INFO:teuthology.orchestra.run.smithi155.stdout: "event": "waiting for subops from 0", 2023-08-01T19:56:28.900 INFO:teuthology.orchestra.run.smithi155.stdout: "time": "2023-08-01T19:55:05.151443+0000", 2023-08-01T19:56:28.900 INFO:teuthology.orchestra.run.smithi155.stdout: "duration": 0.00016181600000000001 2023-08-01T19:56:28.900 INFO:teuthology.orchestra.run.smithi155.stdout: }, 2023-08-01T19:56:28.900 INFO:teuthology.orchestra.run.smithi155.stdout: { 2023-08-01T19:56:28.900 INFO:teuthology.orchestra.run.smithi155.stdout: "event": "sub_op_commit_rec", 2023-08-01T19:56:28.900 INFO:teuthology.orchestra.run.smithi155.stdout: "time": "2023-08-01T19:55:05.219101+0000", 2023-08-01T19:56:28.901 INFO:teuthology.orchestra.run.smithi155.stdout: "duration": 0.067658037000000004 2023-08-01T19:56:28.901 INFO:teuthology.orchestra.run.smithi155.stdout: }, 2023-08-01T19:56:28.901 INFO:teuthology.orchestra.run.smithi155.stdout: { 2023-08-01T19:56:28.901 INFO:teuthology.orchestra.run.smithi155.stdout: "event": "op_commit", 2023-08-01T19:56:28.901 INFO:teuthology.orchestra.run.smithi155.stdout: "time": "2023-08-01T19:55:05.221646+0000", 2023-08-01T19:56:28.901 INFO:teuthology.orchestra.run.smithi155.stdout: "duration": 0.0025450540000000002 2023-08-01T19:56:28.901 INFO:teuthology.orchestra.run.smithi155.stdout: }, 2023-08-01T19:56:28.901 INFO:teuthology.orchestra.run.smithi155.stdout: { 2023-08-01T19:56:28.902 INFO:teuthology.orchestra.run.smithi155.stdout: "event": "commit_sent", 2023-08-01T19:56:28.902 INFO:teuthology.orchestra.run.smithi155.stdout: "time": "2023-08-01T19:55:05.221689+0000", 2023-08-01T19:56:28.902 INFO:teuthology.orchestra.run.smithi155.stdout: "duration": 4.3078999999999999e-05 2023-08-01T19:56:28.902 INFO:teuthology.orchestra.run.smithi155.stdout: }, 2023-08-01T19:56:28.902 INFO:teuthology.orchestra.run.smithi155.stdout: { 2023-08-01T19:56:28.902 INFO:teuthology.orchestra.run.smithi155.stdout: "event": "done", 2023-08-01T19:56:28.902 INFO:teuthology.orchestra.run.smithi155.stdout: "time": "2023-08-01T19:55:05.221725+0000", 2023-08-01T19:56:28.902 INFO:teuthology.orchestra.run.smithi155.stdout: "duration": 3.6137999999999999e-05 2023-08-01T19:56:28.903 INFO:teuthology.orchestra.run.smithi155.stdout: } 2023-08-01T19:56:28.903 INFO:teuthology.orchestra.run.smithi155.stdout: ] 2023-08-01T19:56:28.903 INFO:teuthology.orchestra.run.smithi155.stdout: } 2023-08-01T19:56:28.903 INFO:teuthology.orchestra.run.smithi155.stdout: }, 2023-08-01T19:56:28.903 INFO:teuthology.orchestra.run.smithi155.stdout: { 2023-08-01T19:56:28.903 INFO:teuthology.orchestra.run.smithi155.stdout: "description": "osd_repop(client.4668.0:100243 5.a e37/19 5:5e8193b6:::benchmark_data_smithi006_114134_object100242:head v 37'6228, mlcod=37'6225)", 2023-08-01T19:56:28.903 INFO:teuthology.orchestra.run.smithi155.stdout: "initiated_at": "2023-08-01T19:55:05.151148+0000", 2023-08-01T19:56:28.903 INFO:teuthology.orchestra.run.smithi155.stdout: "age": 83.709073895000003, 2023-08-01T19:56:28.904 INFO:teuthology.orchestra.run.smithi155.stdout: "duration": 0.073020370000000001, 2023-08-01T19:56:28.904 INFO:teuthology.orchestra.run.smithi155.stdout: "type_data": { 2023-08-01T19:56:28.904 INFO:teuthology.orchestra.run.smithi155.stdout: "flag_point": "commit sent; apply or cleanup", 2023-08-01T19:56:28.904 INFO:teuthology.orchestra.run.smithi155.stdout: "events": [ 2023-08-01T19:56:28.904 INFO:teuthology.orchestra.run.smithi155.stdout: { 2023-08-01T19:56:28.904 INFO:teuthology.orchestra.run.smithi155.stdout: "event": "initiated", 2023-08-01T19:56:28.904 INFO:teuthology.orchestra.run.smithi155.stdout: "time": "2023-08-01T19:55:05.151148+0000", 2023-08-01T19:56:28.905 INFO:teuthology.orchestra.run.smithi155.stdout: "duration": 0 2023-08-01T19:56:28.905 INFO:teuthology.orchestra.run.smithi155.stdout: }, 2023-08-01T19:56:28.905 INFO:teuthology.orchestra.run.smithi155.stdout: { 2023-08-01T19:56:28.905 INFO:teuthology.orchestra.run.smithi155.stdout: "event": "throttled", 2023-08-01T19:56:28.905 INFO:teuthology.orchestra.run.smithi155.stdout: "time": "2023-08-01T19:55:05.151148+0000", 2023-08-01T19:56:28.905 INFO:teuthology.orchestra.run.smithi155.stdout: "duration": 0 2023-08-01T19:56:28.905 INFO:teuthology.orchestra.run.smithi155.stdout: }, 2023-08-01T19:56:28.905 INFO:teuthology.orchestra.run.smithi155.stdout: { 2023-08-01T19:56:28.906 INFO:teuthology.orchestra.run.smithi155.stdout: "event": "header_read", 2023-08-01T19:56:28.906 INFO:teuthology.orchestra.run.smithi155.stdout: "time": "2023-08-01T19:55:05.151147+0000", 2023-08-01T19:56:28.906 INFO:teuthology.orchestra.run.smithi155.stdout: "duration": 4294967295.9999995 2023-08-01T19:56:28.906 INFO:teuthology.orchestra.run.smithi155.stdout: }, 2023-08-01T19:56:28.906 INFO:teuthology.orchestra.run.smithi155.stdout: { 2023-08-01T19:56:28.906 INFO:teuthology.orchestra.run.smithi155.stdout: "event": "all_read", 2023-08-01T19:56:28.906 INFO:teuthology.orchestra.run.smithi155.stdout: "time": "2023-08-01T19:55:05.151231+0000", 2023-08-01T19:56:28.907 INFO:teuthology.orchestra.run.smithi155.stdout: "duration": 8.3135999999999998e-05 2023-08-01T19:56:28.907 INFO:teuthology.orchestra.run.smithi155.stdout: }, 2023-08-01T19:56:28.907 INFO:teuthology.orchestra.run.smithi155.stdout: { 2023-08-01T19:56:28.907 INFO:teuthology.orchestra.run.smithi155.stdout: "event": "dispatched", 2023-08-01T19:56:28.907 INFO:teuthology.orchestra.run.smithi155.stdout: "time": "2023-08-01T19:55:05.151239+0000", 2023-08-01T19:56:28.907 INFO:teuthology.orchestra.run.smithi155.stdout: "duration": 8.7469999999999994e-06 2023-08-01T19:56:28.907 INFO:teuthology.orchestra.run.smithi155.stdout: }, 2023-08-01T19:56:28.907 INFO:teuthology.orchestra.run.smithi155.stdout: { 2023-08-01T19:56:28.908 INFO:teuthology.orchestra.run.smithi155.stdout: "event": "queued_for_pg", 2023-08-01T19:56:28.908 INFO:teuthology.orchestra.run.smithi155.stdout: "time": "2023-08-01T19:55:05.151244+0000", 2023-08-01T19:56:28.908 INFO:teuthology.orchestra.run.smithi155.stdout: "duration": 4.4800000000000003e-06 2023-08-01T19:56:28.908 INFO:teuthology.orchestra.run.smithi155.stdout: }, 2023-08-01T19:56:28.908 INFO:teuthology.orchestra.run.smithi155.stdout: { 2023-08-01T19:56:28.908 INFO:teuthology.orchestra.run.smithi155.stdout: "event": "reached_pg", 2023-08-01T19:56:28.908 INFO:teuthology.orchestra.run.smithi155.stdout: "time": "2023-08-01T19:55:05.152938+0000", 2023-08-01T19:56:28.908 INFO:teuthology.orchestra.run.smithi155.stdout: "duration": 0.001693824 2023-08-01T19:56:28.909 INFO:teuthology.orchestra.run.smithi155.stdout: }, 2023-08-01T19:56:28.909 INFO:teuthology.orchestra.run.smithi155.stdout: { 2023-08-01T19:56:28.909 INFO:teuthology.orchestra.run.smithi155.stdout: "event": "started", 2023-08-01T19:56:28.909 INFO:teuthology.orchestra.run.smithi155.stdout: "time": "2023-08-01T19:55:05.152956+0000", 2023-08-01T19:56:28.909 INFO:teuthology.orchestra.run.smithi155.stdout: "duration": 1.8287e-05 2023-08-01T19:56:28.909 INFO:teuthology.orchestra.run.smithi155.stdout: }, 2023-08-01T19:56:28.909 INFO:teuthology.orchestra.run.smithi155.stdout: { 2023-08-01T19:56:28.909 INFO:teuthology.orchestra.run.smithi155.stdout: "event": "commit_sent", 2023-08-01T19:56:28.910 INFO:teuthology.orchestra.run.smithi155.stdout: "time": "2023-08-01T19:55:05.224145+0000", 2023-08-01T19:56:28.910 INFO:teuthology.orchestra.run.smithi155.stdout: "duration": 0.071189447000000003 2023-08-01T19:56:28.910 INFO:teuthology.orchestra.run.smithi155.stdout: }, 2023-08-01T19:56:28.910 INFO:teuthology.orchestra.run.smithi155.stdout: { 2023-08-01T19:56:28.910 INFO:teuthology.orchestra.run.smithi155.stdout: "event": "done", 2023-08-01T19:56:28.910 INFO:teuthology.orchestra.run.smithi155.stdout: "time": "2023-08-01T19:55:05.224168+0000", 2023-08-01T19:56:28.910 INFO:teuthology.orchestra.run.smithi155.stdout: "duration": 2.3008999999999999e-05 2023-08-01T19:56:28.910 INFO:teuthology.orchestra.run.smithi155.stdout: } 2023-08-01T19:56:28.911 INFO:teuthology.orchestra.run.smithi155.stdout: ] 2023-08-01T19:56:28.911 INFO:teuthology.orchestra.run.smithi155.stdout: } 2023-08-01T19:56:28.911 INFO:teuthology.orchestra.run.smithi155.stdout: }, 2023-08-01T19:56:28.911 INFO:teuthology.orchestra.run.smithi155.stdout: { 2023-08-01T19:56:28.911 INFO:teuthology.orchestra.run.smithi155.stdout: "description": "osd_repop(client.4668.0:100244 5.9 e37/19 5:92f56a12:::benchmark_data_smithi006_114134_object100243:head v 37'6294, mlcod=37'6292)", 2023-08-01T19:56:28.911 INFO:teuthology.orchestra.run.smithi155.stdout: "initiated_at": "2023-08-01T19:55:05.151325+0000", 2023-08-01T19:56:28.911 INFO:teuthology.orchestra.run.smithi155.stdout: "age": 83.708896550000006, 2023-08-01T19:56:28.911 INFO:teuthology.orchestra.run.smithi155.stdout: "duration": 0.071883673999999995, 2023-08-01T19:56:28.912 INFO:teuthology.orchestra.run.smithi155.stdout: "type_data": { 2023-08-01T19:56:28.912 INFO:teuthology.orchestra.run.smithi155.stdout: "flag_point": "commit sent; apply or cleanup", 2023-08-01T19:56:28.912 INFO:teuthology.orchestra.run.smithi155.stdout: "events": [ 2023-08-01T19:56:28.912 INFO:teuthology.orchestra.run.smithi155.stdout: { 2023-08-01T19:56:28.912 INFO:teuthology.orchestra.run.smithi155.stdout: "event": "initiated", 2023-08-01T19:56:28.912 INFO:teuthology.orchestra.run.smithi155.stdout: "time": "2023-08-01T19:55:05.151325+0000", 2023-08-01T19:56:28.912 INFO:teuthology.orchestra.run.smithi155.stdout: "duration": 0 2023-08-01T19:56:28.913 INFO:teuthology.orchestra.run.smithi155.stdout: }, 2023-08-01T19:56:28.913 INFO:teuthology.orchestra.run.smithi155.stdout: { 2023-08-01T19:56:28.913 INFO:teuthology.orchestra.run.smithi155.stdout: "event": "throttled", 2023-08-01T19:56:28.913 INFO:teuthology.orchestra.run.smithi155.stdout: "time": "2023-08-01T19:55:05.151325+0000", 2023-08-01T19:56:28.913 INFO:teuthology.orchestra.run.smithi155.stdout: "duration": 0 2023-08-01T19:56:28.913 INFO:teuthology.orchestra.run.smithi155.stdout: }, 2023-08-01T19:56:28.913 INFO:teuthology.orchestra.run.smithi155.stdout: { 2023-08-01T19:56:28.913 INFO:teuthology.orchestra.run.smithi155.stdout: "event": "header_read", 2023-08-01T19:56:28.914 INFO:teuthology.orchestra.run.smithi155.stdout: "time": "2023-08-01T19:55:05.151325+0000", 2023-08-01T19:56:28.914 INFO:teuthology.orchestra.run.smithi155.stdout: "duration": 4294967295.9999995 2023-08-01T19:56:28.914 INFO:teuthology.orchestra.run.smithi155.stdout: }, 2023-08-01T19:56:28.914 INFO:teuthology.orchestra.run.smithi155.stdout: { 2023-08-01T19:56:28.914 INFO:teuthology.orchestra.run.smithi155.stdout: "event": "all_read", 2023-08-01T19:56:28.914 INFO:teuthology.orchestra.run.smithi155.stdout: "time": "2023-08-01T19:55:05.151390+0000", 2023-08-01T19:56:28.914 INFO:teuthology.orchestra.run.smithi155.stdout: "duration": 6.5456999999999993e-05 2023-08-01T19:56:28.914 INFO:teuthology.orchestra.run.smithi155.stdout: }, 2023-08-01T19:56:28.915 INFO:teuthology.orchestra.run.smithi155.stdout: { 2023-08-01T19:56:28.915 INFO:teuthology.orchestra.run.smithi155.stdout: "event": "dispatched", 2023-08-01T19:56:28.915 INFO:teuthology.orchestra.run.smithi155.stdout: "time": "2023-08-01T19:55:05.151396+0000", 2023-08-01T19:56:28.915 INFO:teuthology.orchestra.run.smithi155.stdout: "duration": 5.9190000000000004e-06 2023-08-01T19:56:28.915 INFO:teuthology.orchestra.run.smithi155.stdout: }, 2023-08-01T19:56:28.915 INFO:teuthology.orchestra.run.smithi155.stdout: { 2023-08-01T19:56:28.915 INFO:teuthology.orchestra.run.smithi155.stdout: "event": "queued_for_pg", 2023-08-01T19:56:28.915 INFO:teuthology.orchestra.run.smithi155.stdout: "time": "2023-08-01T19:55:05.151400+0000", 2023-08-01T19:56:28.916 INFO:teuthology.orchestra.run.smithi155.stdout: "duration": 4.1030000000000004e-06 2023-08-01T19:56:28.916 INFO:teuthology.orchestra.run.smithi155.stdout: }, 2023-08-01T19:56:28.916 INFO:teuthology.orchestra.run.smithi155.stdout: { 2023-08-01T19:56:28.916 INFO:teuthology.orchestra.run.smithi155.stdout: "event": "reached_pg", 2023-08-01T19:56:28.916 INFO:teuthology.orchestra.run.smithi155.stdout: "time": "2023-08-01T19:55:05.151452+0000", 2023-08-01T19:56:28.916 INFO:teuthology.orchestra.run.smithi155.stdout: "duration": 5.2136999999999999e-05 2023-08-01T19:56:28.916 INFO:teuthology.orchestra.run.smithi155.stdout: }, 2023-08-01T19:56:28.916 INFO:teuthology.orchestra.run.smithi155.stdout: { 2023-08-01T19:56:28.917 INFO:teuthology.orchestra.run.smithi155.stdout: "event": "started", 2023-08-01T19:56:28.917 INFO:teuthology.orchestra.run.smithi155.stdout: "time": "2023-08-01T19:55:05.151470+0000", 2023-08-01T19:56:28.917 INFO:teuthology.orchestra.run.smithi155.stdout: "duration": 1.8e-05 2023-08-01T19:56:28.917 INFO:teuthology.orchestra.run.smithi155.stdout: }, 2023-08-01T19:56:28.917 INFO:teuthology.orchestra.run.smithi155.stdout: { 2023-08-01T19:56:28.917 INFO:teuthology.orchestra.run.smithi155.stdout: "event": "commit_sent", 2023-08-01T19:56:28.917 INFO:teuthology.orchestra.run.smithi155.stdout: "time": "2023-08-01T19:55:05.223183+0000", 2023-08-01T19:56:28.917 INFO:teuthology.orchestra.run.smithi155.stdout: "duration": 0.071712622000000004 2023-08-01T19:56:28.918 INFO:teuthology.orchestra.run.smithi155.stdout: }, 2023-08-01T19:56:28.918 INFO:teuthology.orchestra.run.smithi155.stdout: { 2023-08-01T19:56:28.918 INFO:teuthology.orchestra.run.smithi155.stdout: "event": "done", 2023-08-01T19:56:28.918 INFO:teuthology.orchestra.run.smithi155.stdout: "time": "2023-08-01T19:55:05.223209+0000", 2023-08-01T19:56:28.918 INFO:teuthology.orchestra.run.smithi155.stdout: "duration": 2.5956e-05 2023-08-01T19:56:28.918 INFO:teuthology.orchestra.run.smithi155.stdout: } 2023-08-01T19:56:28.918 INFO:teuthology.orchestra.run.smithi155.stdout: ] 2023-08-01T19:56:28.918 INFO:teuthology.orchestra.run.smithi155.stdout: } 2023-08-01T19:56:28.919 INFO:teuthology.orchestra.run.smithi155.stdout: }, 2023-08-01T19:56:28.919 INFO:teuthology.orchestra.run.smithi155.stdout: { 2023-08-01T19:56:28.919 INFO:teuthology.orchestra.run.smithi155.stdout: "description": "osd_op(client.4668.0:100249 5.b 5:d0666827:::benchmark_data_smithi006_114134_object100248:head [set-alloc-hint object_size 65536 write_size 65536,write 0~65536] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e37)", 2023-08-01T19:56:28.919 INFO:teuthology.orchestra.run.smithi155.stdout: "initiated_at": "2023-08-01T19:55:05.153614+0000", 2023-08-01T19:56:28.919 INFO:teuthology.orchestra.run.smithi155.stdout: "age": 83.706608125000002, 2023-08-01T19:56:28.919 INFO:teuthology.orchestra.run.smithi155.stdout: "duration": 0.069286118999999993, 2023-08-01T19:56:28.919 INFO:teuthology.orchestra.run.smithi155.stdout: "type_data": { 2023-08-01T19:56:28.920 INFO:teuthology.orchestra.run.smithi155.stdout: "flag_point": "commit sent; apply or cleanup", 2023-08-01T19:56:28.920 INFO:teuthology.orchestra.run.smithi155.stdout: "client_info": { 2023-08-01T19:56:28.920 INFO:teuthology.orchestra.run.smithi155.stdout: "client": "client.4668", 2023-08-01T19:56:28.920 INFO:teuthology.orchestra.run.smithi155.stdout: "client_addr": "172.21.15.6:0/1709472247", 2023-08-01T19:56:28.920 INFO:teuthology.orchestra.run.smithi155.stdout: "tid": 100249 2023-08-01T19:56:28.920 INFO:teuthology.orchestra.run.smithi155.stdout: }, 2023-08-01T19:56:28.920 INFO:teuthology.orchestra.run.smithi155.stdout: "events": [ 2023-08-01T19:56:28.920 INFO:teuthology.orchestra.run.smithi155.stdout: { 2023-08-01T19:56:28.921 INFO:teuthology.orchestra.run.smithi155.stdout: "event": "initiated", 2023-08-01T19:56:28.921 INFO:teuthology.orchestra.run.smithi155.stdout: "time": "2023-08-01T19:55:05.153614+0000", 2023-08-01T19:56:28.921 INFO:teuthology.orchestra.run.smithi155.stdout: "duration": 0 2023-08-01T19:56:28.921 INFO:teuthology.orchestra.run.smithi155.stdout: }, 2023-08-01T19:56:28.921 INFO:teuthology.orchestra.run.smithi155.stdout: { 2023-08-01T19:56:28.921 INFO:teuthology.orchestra.run.smithi155.stdout: "event": "throttled", 2023-08-01T19:56:28.921 INFO:teuthology.orchestra.run.smithi155.stdout: "time": "2023-08-01T19:55:05.153614+0000", 2023-08-01T19:56:28.921 INFO:teuthology.orchestra.run.smithi155.stdout: "duration": 0 2023-08-01T19:56:28.922 INFO:teuthology.orchestra.run.smithi155.stdout: }, 2023-08-01T19:56:28.922 INFO:teuthology.orchestra.run.smithi155.stdout: { 2023-08-01T19:56:28.922 INFO:teuthology.orchestra.run.smithi155.stdout: "event": "header_read", 2023-08-01T19:56:28.922 INFO:teuthology.orchestra.run.smithi155.stdout: "time": "2023-08-01T19:55:05.153612+0000", 2023-08-01T19:56:28.922 INFO:teuthology.orchestra.run.smithi155.stdout: "duration": 4294967295.9999986 2023-08-01T19:56:28.922 INFO:teuthology.orchestra.run.smithi155.stdout: }, 2023-08-01T19:56:28.922 INFO:teuthology.orchestra.run.smithi155.stdout: { 2023-08-01T19:56:28.923 INFO:teuthology.orchestra.run.smithi155.stdout: "event": "all_read", 2023-08-01T19:56:28.923 INFO:teuthology.orchestra.run.smithi155.stdout: "time": "2023-08-01T19:55:05.153694+0000", 2023-08-01T19:56:28.923 INFO:teuthology.orchestra.run.smithi155.stdout: "duration": 8.1618000000000004e-05 2023-08-01T19:56:28.923 INFO:teuthology.orchestra.run.smithi155.stdout: }, 2023-08-01T19:56:28.923 INFO:teuthology.orchestra.run.smithi155.stdout: { 2023-08-01T19:56:28.923 INFO:teuthology.orchestra.run.smithi155.stdout: "event": "dispatched", 2023-08-01T19:56:28.923 INFO:teuthology.orchestra.run.smithi155.stdout: "time": "2023-08-01T19:55:05.153713+0000", 2023-08-01T19:56:28.923 INFO:teuthology.orchestra.run.smithi155.stdout: "duration": 1.9069999999999999e-05 2023-08-01T19:56:28.924 INFO:teuthology.orchestra.run.smithi155.stdout: }, 2023-08-01T19:56:28.924 INFO:teuthology.orchestra.run.smithi155.stdout: { 2023-08-01T19:56:28.924 INFO:teuthology.orchestra.run.smithi155.stdout: "event": "queued_for_pg", 2023-08-01T19:56:28.924 INFO:teuthology.orchestra.run.smithi155.stdout: "time": "2023-08-01T19:55:05.153726+0000", 2023-08-01T19:56:28.924 INFO:teuthology.orchestra.run.smithi155.stdout: "duration": 1.238e-05 2023-08-01T19:56:28.924 INFO:teuthology.orchestra.run.smithi155.stdout: }, 2023-08-01T19:56:28.924 INFO:teuthology.orchestra.run.smithi155.stdout: { 2023-08-01T19:56:28.924 INFO:teuthology.orchestra.run.smithi155.stdout: "event": "reached_pg", 2023-08-01T19:56:28.925 INFO:teuthology.orchestra.run.smithi155.stdout: "time": "2023-08-01T19:55:05.153761+0000", 2023-08-01T19:56:28.925 INFO:teuthology.orchestra.run.smithi155.stdout: "duration": 3.5046999999999998e-05 2023-08-01T19:56:28.925 INFO:teuthology.orchestra.run.smithi155.stdout: }, 2023-08-01T19:56:28.925 INFO:teuthology.orchestra.run.smithi155.stdout: { 2023-08-01T19:56:28.925 INFO:teuthology.orchestra.run.smithi155.stdout: "event": "started", 2023-08-01T19:56:28.925 INFO:teuthology.orchestra.run.smithi155.stdout: "time": "2023-08-01T19:55:05.153896+0000", 2023-08-01T19:56:28.925 INFO:teuthology.orchestra.run.smithi155.stdout: "duration": 0.00013575800000000001 2023-08-01T19:56:28.925 INFO:teuthology.orchestra.run.smithi155.stdout: }, 2023-08-01T19:56:28.926 INFO:teuthology.orchestra.run.smithi155.stdout: { 2023-08-01T19:56:28.926 INFO:teuthology.orchestra.run.smithi155.stdout: "event": "waiting for subops from 0", 2023-08-01T19:56:28.926 INFO:teuthology.orchestra.run.smithi155.stdout: "time": "2023-08-01T19:55:05.154043+0000", 2023-08-01T19:56:28.926 INFO:teuthology.orchestra.run.smithi155.stdout: "duration": 0.00014650700000000001 2023-08-01T19:56:28.926 INFO:teuthology.orchestra.run.smithi155.stdout: }, 2023-08-01T19:56:28.926 INFO:teuthology.orchestra.run.smithi155.stdout: { 2023-08-01T19:56:28.926 INFO:teuthology.orchestra.run.smithi155.stdout: "event": "sub_op_commit_rec", 2023-08-01T19:56:28.926 INFO:teuthology.orchestra.run.smithi155.stdout: "time": "2023-08-01T19:55:05.221876+0000", 2023-08-01T19:56:28.927 INFO:teuthology.orchestra.run.smithi155.stdout: "duration": 0.067832796000000001 2023-08-01T19:56:28.927 INFO:teuthology.orchestra.run.smithi155.stdout: }, 2023-08-01T19:56:28.927 INFO:teuthology.orchestra.run.smithi155.stdout: { 2023-08-01T19:56:28.927 INFO:teuthology.orchestra.run.smithi155.stdout: "event": "op_commit", 2023-08-01T19:56:28.927 INFO:teuthology.orchestra.run.smithi155.stdout: "time": "2023-08-01T19:55:05.222813+0000", 2023-08-01T19:56:28.927 INFO:teuthology.orchestra.run.smithi155.stdout: "duration": 0.00093755300000000004 2023-08-01T19:56:28.927 INFO:teuthology.orchestra.run.smithi155.stdout: }, 2023-08-01T19:56:28.927 INFO:teuthology.orchestra.run.smithi155.stdout: { 2023-08-01T19:56:28.928 INFO:teuthology.orchestra.run.smithi155.stdout: "event": "commit_sent", 2023-08-01T19:56:28.928 INFO:teuthology.orchestra.run.smithi155.stdout: "time": "2023-08-01T19:55:05.222861+0000", 2023-08-01T19:56:28.928 INFO:teuthology.orchestra.run.smithi155.stdout: "duration": 4.8013999999999998e-05 2023-08-01T19:56:28.928 INFO:teuthology.orchestra.run.smithi155.stdout: }, 2023-08-01T19:56:28.928 INFO:teuthology.orchestra.run.smithi155.stdout: { 2023-08-01T19:56:28.928 INFO:teuthology.orchestra.run.smithi155.stdout: "event": "done", 2023-08-01T19:56:28.928 INFO:teuthology.orchestra.run.smithi155.stdout: "time": "2023-08-01T19:55:05.222900+0000", 2023-08-01T19:56:28.929 INFO:teuthology.orchestra.run.smithi155.stdout: "duration": 3.8634999999999999e-05 2023-08-01T19:56:28.929 INFO:teuthology.orchestra.run.smithi155.stdout: } 2023-08-01T19:56:28.929 INFO:teuthology.orchestra.run.smithi155.stdout: ] 2023-08-01T19:56:28.929 INFO:teuthology.orchestra.run.smithi155.stdout: } 2023-08-01T19:56:28.929 INFO:teuthology.orchestra.run.smithi155.stdout: }, 2023-08-01T19:56:28.929 INFO:teuthology.orchestra.run.smithi155.stdout: { 2023-08-01T19:56:28.929 INFO:teuthology.orchestra.run.smithi155.stdout: "description": "osd_op(client.4668.0:100251 5.b 5:d853df24:::benchmark_data_smithi006_114134_object100250:head [set-alloc-hint object_size 65536 write_size 65536,write 0~65536] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e37)", 2023-08-01T19:56:28.929 INFO:teuthology.orchestra.run.smithi155.stdout: "initiated_at": "2023-08-01T19:55:05.153737+0000", 2023-08-01T19:56:28.930 INFO:teuthology.orchestra.run.smithi155.stdout: "age": 83.706485111000006, 2023-08-01T19:56:28.930 INFO:teuthology.orchestra.run.smithi155.stdout: "duration": 0.071366545000000003, 2023-08-01T19:56:28.930 INFO:teuthology.orchestra.run.smithi155.stdout: "type_data": { 2023-08-01T19:56:28.930 INFO:teuthology.orchestra.run.smithi155.stdout: "flag_point": "commit sent; apply or cleanup", 2023-08-01T19:56:28.930 INFO:teuthology.orchestra.run.smithi155.stdout: "client_info": { 2023-08-01T19:56:28.930 INFO:teuthology.orchestra.run.smithi155.stdout: "client": "client.4668", 2023-08-01T19:56:28.930 INFO:teuthology.orchestra.run.smithi155.stdout: "client_addr": "172.21.15.6:0/1709472247", 2023-08-01T19:56:28.930 INFO:teuthology.orchestra.run.smithi155.stdout: "tid": 100251 2023-08-01T19:56:28.931 INFO:teuthology.orchestra.run.smithi155.stdout: }, 2023-08-01T19:56:28.931 INFO:teuthology.orchestra.run.smithi155.stdout: "events": [ 2023-08-01T19:56:28.931 INFO:teuthology.orchestra.run.smithi155.stdout: { 2023-08-01T19:56:28.931 INFO:teuthology.orchestra.run.smithi155.stdout: "event": "initiated", 2023-08-01T19:56:28.931 INFO:teuthology.orchestra.run.smithi155.stdout: "time": "2023-08-01T19:55:05.153737+0000", 2023-08-01T19:56:28.931 INFO:teuthology.orchestra.run.smithi155.stdout: "duration": 0 2023-08-01T19:56:28.931 INFO:teuthology.orchestra.run.smithi155.stdout: }, 2023-08-01T19:56:28.931 INFO:teuthology.orchestra.run.smithi155.stdout: { 2023-08-01T19:56:28.932 INFO:teuthology.orchestra.run.smithi155.stdout: "event": "throttled", 2023-08-01T19:56:28.932 INFO:teuthology.orchestra.run.smithi155.stdout: "time": "2023-08-01T19:55:05.153737+0000", 2023-08-01T19:56:28.932 INFO:teuthology.orchestra.run.smithi155.stdout: "duration": 0 2023-08-01T19:56:28.932 INFO:teuthology.orchestra.run.smithi155.stdout: }, 2023-08-01T19:56:28.932 INFO:teuthology.orchestra.run.smithi155.stdout: { 2023-08-01T19:56:28.932 INFO:teuthology.orchestra.run.smithi155.stdout: "event": "header_read", 2023-08-01T19:56:28.932 INFO:teuthology.orchestra.run.smithi155.stdout: "time": "2023-08-01T19:55:05.153736+0000", 2023-08-01T19:56:28.932 INFO:teuthology.orchestra.run.smithi155.stdout: "duration": 4294967295.9999995 2023-08-01T19:56:28.933 INFO:teuthology.orchestra.run.smithi155.stdout: }, 2023-08-01T19:56:28.933 INFO:teuthology.orchestra.run.smithi155.stdout: { 2023-08-01T19:56:28.933 INFO:teuthology.orchestra.run.smithi155.stdout: "event": "all_read", 2023-08-01T19:56:28.933 INFO:teuthology.orchestra.run.smithi155.stdout: "time": "2023-08-01T19:55:05.153784+0000", 2023-08-01T19:56:28.933 INFO:teuthology.orchestra.run.smithi155.stdout: "duration": 4.7660000000000001e-05 2023-08-01T19:56:28.933 INFO:teuthology.orchestra.run.smithi155.stdout: }, 2023-08-01T19:56:28.933 INFO:teuthology.orchestra.run.smithi155.stdout: { 2023-08-01T19:56:28.933 INFO:teuthology.orchestra.run.smithi155.stdout: "event": "dispatched", 2023-08-01T19:56:28.934 INFO:teuthology.orchestra.run.smithi155.stdout: "time": "2023-08-01T19:55:05.153793+0000", 2023-08-01T19:56:28.934 INFO:teuthology.orchestra.run.smithi155.stdout: "duration": 8.7150000000000004e-06 2023-08-01T19:56:28.934 INFO:teuthology.orchestra.run.smithi155.stdout: }, 2023-08-01T19:56:28.934 INFO:teuthology.orchestra.run.smithi155.stdout: { 2023-08-01T19:56:28.934 INFO:teuthology.orchestra.run.smithi155.stdout: "event": "queued_for_pg", 2023-08-01T19:56:28.934 INFO:teuthology.orchestra.run.smithi155.stdout: "time": "2023-08-01T19:55:05.153800+0000", 2023-08-01T19:56:28.934 INFO:teuthology.orchestra.run.smithi155.stdout: "duration": 7.2459999999999997e-06 2023-08-01T19:56:28.934 INFO:teuthology.orchestra.run.smithi155.stdout: }, 2023-08-01T19:56:28.935 INFO:teuthology.orchestra.run.smithi155.stdout: { 2023-08-01T19:56:28.935 INFO:teuthology.orchestra.run.smithi155.stdout: "event": "reached_pg", 2023-08-01T19:56:28.935 INFO:teuthology.orchestra.run.smithi155.stdout: "time": "2023-08-01T19:55:05.156241+0000", 2023-08-01T19:56:28.935 INFO:teuthology.orchestra.run.smithi155.stdout: "duration": 0.0024415359999999998 2023-08-01T19:56:28.935 INFO:teuthology.orchestra.run.smithi155.stdout: }, 2023-08-01T19:56:28.935 INFO:teuthology.orchestra.run.smithi155.stdout: { 2023-08-01T19:56:28.935 INFO:teuthology.orchestra.run.smithi155.stdout: "event": "started", 2023-08-01T19:56:28.935 INFO:teuthology.orchestra.run.smithi155.stdout: "time": "2023-08-01T19:55:05.219045+0000", 2023-08-01T19:56:28.936 INFO:teuthology.orchestra.run.smithi155.stdout: "duration": 0.062803855000000006 2023-08-01T19:56:28.936 INFO:teuthology.orchestra.run.smithi155.stdout: }, 2023-08-01T19:56:28.936 INFO:teuthology.orchestra.run.smithi155.stdout: { 2023-08-01T19:56:28.936 INFO:teuthology.orchestra.run.smithi155.stdout: "event": "waiting for subops from 0", 2023-08-01T19:56:28.936 INFO:teuthology.orchestra.run.smithi155.stdout: "time": "2023-08-01T19:55:05.219238+0000", 2023-08-01T19:56:28.936 INFO:teuthology.orchestra.run.smithi155.stdout: "duration": 0.00019241500000000001 2023-08-01T19:56:28.936 INFO:teuthology.orchestra.run.smithi155.stdout: }, 2023-08-01T19:56:28.937 INFO:teuthology.orchestra.run.smithi155.stdout: { 2023-08-01T19:56:28.937 INFO:teuthology.orchestra.run.smithi155.stdout: "event": "sub_op_commit_rec", 2023-08-01T19:56:28.937 INFO:teuthology.orchestra.run.smithi155.stdout: "time": "2023-08-01T19:55:05.223300+0000", 2023-08-01T19:56:28.937 INFO:teuthology.orchestra.run.smithi155.stdout: "duration": 0.0040626509999999996 2023-08-01T19:56:28.937 INFO:teuthology.orchestra.run.smithi155.stdout: }, 2023-08-01T19:56:28.937 INFO:teuthology.orchestra.run.smithi155.stdout: { 2023-08-01T19:56:28.937 INFO:teuthology.orchestra.run.smithi155.stdout: "event": "op_commit", 2023-08-01T19:56:28.937 INFO:teuthology.orchestra.run.smithi155.stdout: "time": "2023-08-01T19:55:05.225020+0000", 2023-08-01T19:56:28.938 INFO:teuthology.orchestra.run.smithi155.stdout: "duration": 0.0017201 2023-08-01T19:56:28.938 INFO:teuthology.orchestra.run.smithi155.stdout: }, 2023-08-01T19:56:28.938 INFO:teuthology.orchestra.run.smithi155.stdout: { 2023-08-01T19:56:28.938 INFO:teuthology.orchestra.run.smithi155.stdout: "event": "commit_sent", 2023-08-01T19:56:28.938 INFO:teuthology.orchestra.run.smithi155.stdout: "time": "2023-08-01T19:55:05.225066+0000", 2023-08-01T19:56:28.938 INFO:teuthology.orchestra.run.smithi155.stdout: "duration": 4.6143000000000002e-05 2023-08-01T19:56:28.938 INFO:teuthology.orchestra.run.smithi155.stdout: }, 2023-08-01T19:56:28.938 INFO:teuthology.orchestra.run.smithi155.stdout: { 2023-08-01T19:56:28.939 INFO:teuthology.orchestra.run.smithi155.stdout: "event": "done", 2023-08-01T19:56:28.939 INFO:teuthology.orchestra.run.smithi155.stdout: "time": "2023-08-01T19:55:05.225103+0000", 2023-08-01T19:56:28.939 INFO:teuthology.orchestra.run.smithi155.stdout: "duration": 3.6789999999999998e-05 2023-08-01T19:56:28.939 INFO:teuthology.orchestra.run.smithi155.stdout: } 2023-08-01T19:56:28.939 INFO:teuthology.orchestra.run.smithi155.stdout: ] 2023-08-01T19:56:28.939 INFO:teuthology.orchestra.run.smithi155.stdout: } 2023-08-01T19:56:28.939 INFO:teuthology.orchestra.run.smithi155.stdout: }, 2023-08-01T19:56:28.939 INFO:teuthology.orchestra.run.smithi155.stdout: { 2023-08-01T19:56:28.940 INFO:teuthology.orchestra.run.smithi155.stdout: "description": "osd_op(client.4668.0:100252 5.0 5:01f90c3c:::benchmark_data_smithi006_114134_object100251:head [set-alloc-hint object_size 65536 write_size 65536,write 0~65536] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e37)", 2023-08-01T19:56:28.940 INFO:teuthology.orchestra.run.smithi155.stdout: "initiated_at": "2023-08-01T19:55:05.154048+0000", 2023-08-01T19:56:28.940 INFO:teuthology.orchestra.run.smithi155.stdout: "age": 83.706173863999993, 2023-08-01T19:56:28.940 INFO:teuthology.orchestra.run.smithi155.stdout: "duration": 0.070156683999999997, 2023-08-01T19:56:28.940 INFO:teuthology.orchestra.run.smithi155.stdout: "type_data": { 2023-08-01T19:56:28.940 INFO:teuthology.orchestra.run.smithi155.stdout: "flag_point": "commit sent; apply or cleanup", 2023-08-01T19:56:28.940 INFO:teuthology.orchestra.run.smithi155.stdout: "client_info": { 2023-08-01T19:56:28.941 INFO:teuthology.orchestra.run.smithi155.stdout: "client": "client.4668", 2023-08-01T19:56:28.941 INFO:teuthology.orchestra.run.smithi155.stdout: "client_addr": "172.21.15.6:0/1709472247", 2023-08-01T19:56:28.941 INFO:teuthology.orchestra.run.smithi155.stdout: "tid": 100252 2023-08-01T19:56:28.941 INFO:teuthology.orchestra.run.smithi155.stdout: }, 2023-08-01T19:56:28.941 INFO:teuthology.orchestra.run.smithi155.stdout: "events": [ 2023-08-01T19:56:28.941 INFO:teuthology.orchestra.run.smithi155.stdout: { 2023-08-01T19:56:28.941 INFO:teuthology.orchestra.run.smithi155.stdout: "event": "initiated", 2023-08-01T19:56:28.941 INFO:teuthology.orchestra.run.smithi155.stdout: "time": "2023-08-01T19:55:05.154048+0000", 2023-08-01T19:56:28.942 INFO:teuthology.orchestra.run.smithi155.stdout: "duration": 0 2023-08-01T19:56:28.942 INFO:teuthology.orchestra.run.smithi155.stdout: }, 2023-08-01T19:56:28.942 INFO:teuthology.orchestra.run.smithi155.stdout: { 2023-08-01T19:56:28.942 INFO:teuthology.orchestra.run.smithi155.stdout: "event": "throttled", 2023-08-01T19:56:28.942 INFO:teuthology.orchestra.run.smithi155.stdout: "time": "2023-08-01T19:55:05.154048+0000", 2023-08-01T19:56:28.942 INFO:teuthology.orchestra.run.smithi155.stdout: "duration": 0 2023-08-01T19:56:28.942 INFO:teuthology.orchestra.run.smithi155.stdout: }, 2023-08-01T19:56:28.942 INFO:teuthology.orchestra.run.smithi155.stdout: { 2023-08-01T19:56:28.943 INFO:teuthology.orchestra.run.smithi155.stdout: "event": "header_read", 2023-08-01T19:56:28.943 INFO:teuthology.orchestra.run.smithi155.stdout: "time": "2023-08-01T19:55:05.154047+0000", 2023-08-01T19:56:28.943 INFO:teuthology.orchestra.run.smithi155.stdout: "duration": 4294967295.999999 2023-08-01T19:56:28.943 INFO:teuthology.orchestra.run.smithi155.stdout: }, 2023-08-01T19:56:28.943 INFO:teuthology.orchestra.run.smithi155.stdout: { 2023-08-01T19:56:28.943 INFO:teuthology.orchestra.run.smithi155.stdout: "event": "all_read", 2023-08-01T19:56:28.943 INFO:teuthology.orchestra.run.smithi155.stdout: "time": "2023-08-01T19:55:05.154115+0000", 2023-08-01T19:56:28.943 INFO:teuthology.orchestra.run.smithi155.stdout: "duration": 6.7545999999999993e-05 2023-08-01T19:56:28.944 INFO:teuthology.orchestra.run.smithi155.stdout: }, 2023-08-01T19:56:28.944 INFO:teuthology.orchestra.run.smithi155.stdout: { 2023-08-01T19:56:28.944 INFO:teuthology.orchestra.run.smithi155.stdout: "event": "dispatched", 2023-08-01T19:56:28.944 INFO:teuthology.orchestra.run.smithi155.stdout: "time": "2023-08-01T19:55:05.154125+0000", 2023-08-01T19:56:28.944 INFO:teuthology.orchestra.run.smithi155.stdout: "duration": 1.0669000000000001e-05 2023-08-01T19:56:28.944 INFO:teuthology.orchestra.run.smithi155.stdout: }, 2023-08-01T19:56:28.944 INFO:teuthology.orchestra.run.smithi155.stdout: { 2023-08-01T19:56:28.944 INFO:teuthology.orchestra.run.smithi155.stdout: "event": "queued_for_pg", 2023-08-01T19:56:28.945 INFO:teuthology.orchestra.run.smithi155.stdout: "time": "2023-08-01T19:55:05.154131+0000", 2023-08-01T19:56:28.945 INFO:teuthology.orchestra.run.smithi155.stdout: "duration": 6.0349999999999998e-06 2023-08-01T19:56:28.945 INFO:teuthology.orchestra.run.smithi155.stdout: }, 2023-08-01T19:56:28.945 INFO:teuthology.orchestra.run.smithi155.stdout: { 2023-08-01T19:56:28.945 INFO:teuthology.orchestra.run.smithi155.stdout: "event": "reached_pg", 2023-08-01T19:56:28.945 INFO:teuthology.orchestra.run.smithi155.stdout: "time": "2023-08-01T19:55:05.154174+0000", 2023-08-01T19:56:28.945 INFO:teuthology.orchestra.run.smithi155.stdout: "duration": 4.2429000000000003e-05 2023-08-01T19:56:28.946 INFO:teuthology.orchestra.run.smithi155.stdout: }, 2023-08-01T19:56:28.946 INFO:teuthology.orchestra.run.smithi155.stdout: { 2023-08-01T19:56:28.946 INFO:teuthology.orchestra.run.smithi155.stdout: "event": "started", 2023-08-01T19:56:28.946 INFO:teuthology.orchestra.run.smithi155.stdout: "time": "2023-08-01T19:55:05.154287+0000", 2023-08-01T19:56:28.946 INFO:teuthology.orchestra.run.smithi155.stdout: "duration": 0.000113138 2023-08-01T19:56:28.946 INFO:teuthology.orchestra.run.smithi155.stdout: }, 2023-08-01T19:56:28.946 INFO:teuthology.orchestra.run.smithi155.stdout: { 2023-08-01T19:56:28.946 INFO:teuthology.orchestra.run.smithi155.stdout: "event": "waiting for subops from 0", 2023-08-01T19:56:28.947 INFO:teuthology.orchestra.run.smithi155.stdout: "time": "2023-08-01T19:55:05.154420+0000", 2023-08-01T19:56:28.947 INFO:teuthology.orchestra.run.smithi155.stdout: "duration": 0.000133292 2023-08-01T19:56:28.947 INFO:teuthology.orchestra.run.smithi155.stdout: }, 2023-08-01T19:56:28.947 INFO:teuthology.orchestra.run.smithi155.stdout: { 2023-08-01T19:56:28.947 INFO:teuthology.orchestra.run.smithi155.stdout: "event": "sub_op_commit_rec", 2023-08-01T19:56:28.947 INFO:teuthology.orchestra.run.smithi155.stdout: "time": "2023-08-01T19:55:05.219034+0000", 2023-08-01T19:56:28.947 INFO:teuthology.orchestra.run.smithi155.stdout: "duration": 0.064613429999999999 2023-08-01T19:56:28.947 INFO:teuthology.orchestra.run.smithi155.stdout: }, 2023-08-01T19:56:28.948 INFO:teuthology.orchestra.run.smithi155.stdout: { 2023-08-01T19:56:28.948 INFO:teuthology.orchestra.run.smithi155.stdout: "event": "op_commit", 2023-08-01T19:56:28.948 INFO:teuthology.orchestra.run.smithi155.stdout: "time": "2023-08-01T19:55:05.224138+0000", 2023-08-01T19:56:28.948 INFO:teuthology.orchestra.run.smithi155.stdout: "duration": 0.0051041999999999997 2023-08-01T19:56:28.948 INFO:teuthology.orchestra.run.smithi155.stdout: }, 2023-08-01T19:56:28.948 INFO:teuthology.orchestra.run.smithi155.stdout: { 2023-08-01T19:56:28.948 INFO:teuthology.orchestra.run.smithi155.stdout: "event": "commit_sent", 2023-08-01T19:56:28.948 INFO:teuthology.orchestra.run.smithi155.stdout: "time": "2023-08-01T19:55:05.224171+0000", 2023-08-01T19:56:28.949 INFO:teuthology.orchestra.run.smithi155.stdout: "duration": 3.3345e-05 2023-08-01T19:56:28.949 INFO:teuthology.orchestra.run.smithi155.stdout: }, 2023-08-01T19:56:28.949 INFO:teuthology.orchestra.run.smithi155.stdout: { 2023-08-01T19:56:28.949 INFO:teuthology.orchestra.run.smithi155.stdout: "event": "done", 2023-08-01T19:56:28.949 INFO:teuthology.orchestra.run.smithi155.stdout: "time": "2023-08-01T19:55:05.224205+0000", 2023-08-01T19:56:28.949 INFO:teuthology.orchestra.run.smithi155.stdout: "duration": 3.3525999999999997e-05 2023-08-01T19:56:28.949 INFO:teuthology.orchestra.run.smithi155.stdout: } 2023-08-01T19:56:28.949 INFO:teuthology.orchestra.run.smithi155.stdout: ] 2023-08-01T19:56:28.950 INFO:teuthology.orchestra.run.smithi155.stdout: } 2023-08-01T19:56:28.950 INFO:teuthology.orchestra.run.smithi155.stdout: }, 2023-08-01T19:56:28.950 INFO:teuthology.orchestra.run.smithi155.stdout: { 2023-08-01T19:56:28.950 INFO:teuthology.orchestra.run.smithi155.stdout: "description": "osd_repop_reply(client.4668.0:100237 5.4 e37/19 ondisk, result = 0)", 2023-08-01T19:56:28.950 INFO:teuthology.orchestra.run.smithi155.stdout: "initiated_at": "2023-08-01T19:55:05.156249+0000", 2023-08-01T19:56:28.950 INFO:teuthology.orchestra.run.smithi155.stdout: "age": 83.703972918999995, 2023-08-01T19:56:28.950 INFO:teuthology.orchestra.run.smithi155.stdout: "duration": 0.062792549000000003, 2023-08-01T19:56:28.950 INFO:teuthology.orchestra.run.smithi155.stdout: "type_data": { 2023-08-01T19:56:28.951 INFO:teuthology.orchestra.run.smithi155.stdout: "flag_point": "started", 2023-08-01T19:56:28.951 INFO:teuthology.orchestra.run.smithi155.stdout: "events": [ 2023-08-01T19:56:28.951 INFO:teuthology.orchestra.run.smithi155.stdout: { 2023-08-01T19:56:28.951 INFO:teuthology.orchestra.run.smithi155.stdout: "event": "initiated", 2023-08-01T19:56:28.951 INFO:teuthology.orchestra.run.smithi155.stdout: "time": "2023-08-01T19:55:05.156249+0000", 2023-08-01T19:56:28.951 INFO:teuthology.orchestra.run.smithi155.stdout: "duration": 0 2023-08-01T19:56:28.951 INFO:teuthology.orchestra.run.smithi155.stdout: }, 2023-08-01T19:56:28.952 INFO:teuthology.orchestra.run.smithi155.stdout: { 2023-08-01T19:56:28.952 INFO:teuthology.orchestra.run.smithi155.stdout: "event": "throttled", 2023-08-01T19:56:28.952 INFO:teuthology.orchestra.run.smithi155.stdout: "time": "2023-08-01T19:55:05.156249+0000", 2023-08-01T19:56:28.952 INFO:teuthology.orchestra.run.smithi155.stdout: "duration": 0 2023-08-01T19:56:28.952 INFO:teuthology.orchestra.run.smithi155.stdout: }, 2023-08-01T19:56:28.952 INFO:teuthology.orchestra.run.smithi155.stdout: { 2023-08-01T19:56:28.952 INFO:teuthology.orchestra.run.smithi155.stdout: "event": "header_read", 2023-08-01T19:56:28.952 INFO:teuthology.orchestra.run.smithi155.stdout: "time": "2023-08-01T19:55:05.156248+0000", 2023-08-01T19:56:28.953 INFO:teuthology.orchestra.run.smithi155.stdout: "duration": 4294967295.9999995 2023-08-01T19:56:28.953 INFO:teuthology.orchestra.run.smithi155.stdout: }, 2023-08-01T19:56:28.953 INFO:teuthology.orchestra.run.smithi155.stdout: { 2023-08-01T19:56:28.953 INFO:teuthology.orchestra.run.smithi155.stdout: "event": "all_read", 2023-08-01T19:56:28.953 INFO:teuthology.orchestra.run.smithi155.stdout: "time": "2023-08-01T19:55:05.156252+0000", 2023-08-01T19:56:28.953 INFO:teuthology.orchestra.run.smithi155.stdout: "duration": 3.9999999999999998e-06 2023-08-01T19:56:28.953 INFO:teuthology.orchestra.run.smithi155.stdout: }, 2023-08-01T19:56:28.953 INFO:teuthology.orchestra.run.smithi155.stdout: { 2023-08-01T19:56:28.954 INFO:teuthology.orchestra.run.smithi155.stdout: "event": "dispatched", 2023-08-01T19:56:28.955 INFO:teuthology.orchestra.run.smithi155.stdout: "time": "2023-08-01T19:55:05.218844+0000", 2023-08-01T19:56:28.955 INFO:teuthology.orchestra.run.smithi155.stdout: "duration": 0.062591516999999999 2023-08-01T19:56:28.955 INFO:teuthology.orchestra.run.smithi155.stdout: }, 2023-08-01T19:56:28.955 INFO:teuthology.orchestra.run.smithi155.stdout: { 2023-08-01T19:56:28.955 INFO:teuthology.orchestra.run.smithi155.stdout: "event": "queued_for_pg", 2023-08-01T19:56:28.955 INFO:teuthology.orchestra.run.smithi155.stdout: "time": "2023-08-01T19:55:05.218862+0000", 2023-08-01T19:56:28.956 INFO:teuthology.orchestra.run.smithi155.stdout: "duration": 1.7666e-05 2023-08-01T19:56:28.956 INFO:teuthology.orchestra.run.smithi155.stdout: }, 2023-08-01T19:56:28.956 INFO:teuthology.orchestra.run.smithi155.stdout: { 2023-08-01T19:56:28.956 INFO:teuthology.orchestra.run.smithi155.stdout: "event": "reached_pg", 2023-08-01T19:56:28.956 INFO:teuthology.orchestra.run.smithi155.stdout: "time": "2023-08-01T19:55:05.218914+0000", 2023-08-01T19:56:28.956 INFO:teuthology.orchestra.run.smithi155.stdout: "duration": 5.2565999999999998e-05 2023-08-01T19:56:28.956 INFO:teuthology.orchestra.run.smithi155.stdout: }, 2023-08-01T19:56:28.956 INFO:teuthology.orchestra.run.smithi155.stdout: { 2023-08-01T19:56:28.957 INFO:teuthology.orchestra.run.smithi155.stdout: "event": "started", 2023-08-01T19:56:28.957 INFO:teuthology.orchestra.run.smithi155.stdout: "time": "2023-08-01T19:55:05.218925+0000", 2023-08-01T19:56:28.957 INFO:teuthology.orchestra.run.smithi155.stdout: "duration": 1.1375e-05 2023-08-01T19:56:28.957 INFO:teuthology.orchestra.run.smithi155.stdout: }, 2023-08-01T19:56:28.957 INFO:teuthology.orchestra.run.smithi155.stdout: { 2023-08-01T19:56:28.957 INFO:teuthology.orchestra.run.smithi155.stdout: "event": "done", 2023-08-01T19:56:28.957 INFO:teuthology.orchestra.run.smithi155.stdout: "time": "2023-08-01T19:55:05.219041+0000", 2023-08-01T19:56:28.957 INFO:teuthology.orchestra.run.smithi155.stdout: "duration": 0.000115977 2023-08-01T19:56:28.958 INFO:teuthology.orchestra.run.smithi155.stdout: } 2023-08-01T19:56:28.958 INFO:teuthology.orchestra.run.smithi155.stdout: ] 2023-08-01T19:56:28.958 INFO:teuthology.orchestra.run.smithi155.stdout: } 2023-08-01T19:56:28.958 INFO:teuthology.orchestra.run.smithi155.stdout: }, 2023-08-01T19:56:28.958 INFO:teuthology.orchestra.run.smithi155.stdout: { 2023-08-01T19:56:28.958 INFO:teuthology.orchestra.run.smithi155.stdout: "description": "osd_repop(client.4668.0:100253 5.f e37/19 5:f7bbce05:::benchmark_data_smithi006_114134_object100252:head v 37'6323, mlcod=37'6321)", 2023-08-01T19:56:28.958 INFO:teuthology.orchestra.run.smithi155.stdout: "initiated_at": "2023-08-01T19:55:05.156952+0000", 2023-08-01T19:56:28.958 INFO:teuthology.orchestra.run.smithi155.stdout: "age": 83.703269856000006, 2023-08-01T19:56:28.959 INFO:teuthology.orchestra.run.smithi155.stdout: "duration": 0.068018577999999996, 2023-08-01T19:56:28.959 INFO:teuthology.orchestra.run.smithi155.stdout: "type_data": { 2023-08-01T19:56:28.959 INFO:teuthology.orchestra.run.smithi155.stdout: "flag_point": "commit sent; apply or cleanup", 2023-08-01T19:56:28.959 INFO:teuthology.orchestra.run.smithi155.stdout: "events": [ 2023-08-01T19:56:28.959 INFO:teuthology.orchestra.run.smithi155.stdout: { 2023-08-01T19:56:28.959 INFO:teuthology.orchestra.run.smithi155.stdout: "event": "initiated", 2023-08-01T19:56:28.959 INFO:teuthology.orchestra.run.smithi155.stdout: "time": "2023-08-01T19:55:05.156952+0000", 2023-08-01T19:56:28.960 INFO:teuthology.orchestra.run.smithi155.stdout: "duration": 0 2023-08-01T19:56:28.960 INFO:teuthology.orchestra.run.smithi155.stdout: }, 2023-08-01T19:56:28.960 INFO:teuthology.orchestra.run.smithi155.stdout: { 2023-08-01T19:56:28.960 INFO:teuthology.orchestra.run.smithi155.stdout: "event": "throttled", 2023-08-01T19:56:28.960 INFO:teuthology.orchestra.run.smithi155.stdout: "time": "2023-08-01T19:55:05.156952+0000", 2023-08-01T19:56:28.960 INFO:teuthology.orchestra.run.smithi155.stdout: "duration": 0 2023-08-01T19:56:28.960 INFO:teuthology.orchestra.run.smithi155.stdout: }, 2023-08-01T19:56:28.960 INFO:teuthology.orchestra.run.smithi155.stdout: { 2023-08-01T19:56:28.961 INFO:teuthology.orchestra.run.smithi155.stdout: "event": "header_read", 2023-08-01T19:56:28.961 INFO:teuthology.orchestra.run.smithi155.stdout: "time": "2023-08-01T19:55:05.156951+0000", 2023-08-01T19:56:28.961 INFO:teuthology.orchestra.run.smithi155.stdout: "duration": 4294967295.999999 2023-08-01T19:56:28.961 INFO:teuthology.orchestra.run.smithi155.stdout: }, 2023-08-01T19:56:28.961 INFO:teuthology.orchestra.run.smithi155.stdout: { 2023-08-01T19:56:28.961 INFO:teuthology.orchestra.run.smithi155.stdout: "event": "all_read", 2023-08-01T19:56:28.961 INFO:teuthology.orchestra.run.smithi155.stdout: "time": "2023-08-01T19:55:05.156989+0000", 2023-08-01T19:56:28.961 INFO:teuthology.orchestra.run.smithi155.stdout: "duration": 3.8175e-05 2023-08-01T19:56:28.962 INFO:teuthology.orchestra.run.smithi155.stdout: }, 2023-08-01T19:56:28.962 INFO:teuthology.orchestra.run.smithi155.stdout: { 2023-08-01T19:56:28.962 INFO:teuthology.orchestra.run.smithi155.stdout: "event": "dispatched", 2023-08-01T19:56:28.962 INFO:teuthology.orchestra.run.smithi155.stdout: "time": "2023-08-01T19:55:05.218842+0000", 2023-08-01T19:56:28.962 INFO:teuthology.orchestra.run.smithi155.stdout: "duration": 0.061852299999999999 2023-08-01T19:56:28.962 INFO:teuthology.orchestra.run.smithi155.stdout: }, 2023-08-01T19:56:28.962 INFO:teuthology.orchestra.run.smithi155.stdout: { 2023-08-01T19:56:28.962 INFO:teuthology.orchestra.run.smithi155.stdout: "event": "queued_for_pg", 2023-08-01T19:56:28.963 INFO:teuthology.orchestra.run.smithi155.stdout: "time": "2023-08-01T19:55:05.218862+0000", 2023-08-01T19:56:28.963 INFO:teuthology.orchestra.run.smithi155.stdout: "duration": 1.9854999999999999e-05 2023-08-01T19:56:28.963 INFO:teuthology.orchestra.run.smithi155.stdout: }, 2023-08-01T19:56:28.963 INFO:teuthology.orchestra.run.smithi155.stdout: { 2023-08-01T19:56:28.963 INFO:teuthology.orchestra.run.smithi155.stdout: "event": "reached_pg", 2023-08-01T19:56:28.963 INFO:teuthology.orchestra.run.smithi155.stdout: "time": "2023-08-01T19:55:05.218918+0000", 2023-08-01T19:56:28.963 INFO:teuthology.orchestra.run.smithi155.stdout: "duration": 5.6570000000000002e-05 2023-08-01T19:56:28.964 INFO:teuthology.orchestra.run.smithi155.stdout: }, 2023-08-01T19:56:28.964 INFO:teuthology.orchestra.run.smithi155.stdout: { 2023-08-01T19:56:28.964 INFO:teuthology.orchestra.run.smithi155.stdout: "event": "started", 2023-08-01T19:56:28.964 INFO:teuthology.orchestra.run.smithi155.stdout: "time": "2023-08-01T19:55:05.218940+0000", 2023-08-01T19:56:28.964 INFO:teuthology.orchestra.run.smithi155.stdout: "duration": 2.1804e-05 2023-08-01T19:56:28.964 INFO:teuthology.orchestra.run.smithi155.stdout: }, 2023-08-01T19:56:28.964 INFO:teuthology.orchestra.run.smithi155.stdout: { 2023-08-01T19:56:28.964 INFO:teuthology.orchestra.run.smithi155.stdout: "event": "commit_sent", 2023-08-01T19:56:28.965 INFO:teuthology.orchestra.run.smithi155.stdout: "time": "2023-08-01T19:55:05.224928+0000", 2023-08-01T19:56:28.965 INFO:teuthology.orchestra.run.smithi155.stdout: "duration": 0.0059876759999999999 2023-08-01T19:56:28.965 INFO:teuthology.orchestra.run.smithi155.stdout: }, 2023-08-01T19:56:28.965 INFO:teuthology.orchestra.run.smithi155.stdout: { 2023-08-01T19:56:28.965 INFO:teuthology.orchestra.run.smithi155.stdout: "event": "done", 2023-08-01T19:56:28.965 INFO:teuthology.orchestra.run.smithi155.stdout: "time": "2023-08-01T19:55:05.224971+0000", 2023-08-01T19:56:28.965 INFO:teuthology.orchestra.run.smithi155.stdout: "duration": 4.2929999999999997e-05 2023-08-01T19:56:28.965 INFO:teuthology.orchestra.run.smithi155.stdout: } 2023-08-01T19:56:28.966 INFO:teuthology.orchestra.run.smithi155.stdout: ] 2023-08-01T19:56:28.966 INFO:teuthology.orchestra.run.smithi155.stdout: } 2023-08-01T19:56:28.966 INFO:teuthology.orchestra.run.smithi155.stdout: }, 2023-08-01T19:56:28.966 INFO:teuthology.orchestra.run.smithi155.stdout: { 2023-08-01T19:56:28.966 INFO:teuthology.orchestra.run.smithi155.stdout: "description": "osd_op(client.4668.0:100927 5.0 5:00608ec6:::benchmark_data_smithi006_114134_object100926:head [set-alloc-hint object_size 65536 write_size 65536,write 0~65536] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e37)", 2023-08-01T19:56:28.966 INFO:teuthology.orchestra.run.smithi155.stdout: "initiated_at": "2023-08-01T19:55:05.561169+0000", 2023-08-01T19:56:28.966 INFO:teuthology.orchestra.run.smithi155.stdout: "age": 83.299052953, 2023-08-01T19:56:28.967 INFO:teuthology.orchestra.run.smithi155.stdout: "duration": 0.066411687999999997, 2023-08-01T19:56:28.967 INFO:teuthology.orchestra.run.smithi155.stdout: "type_data": { 2023-08-01T19:56:28.967 INFO:teuthology.orchestra.run.smithi155.stdout: "flag_point": "commit sent; apply or cleanup", 2023-08-01T19:56:28.967 INFO:teuthology.orchestra.run.smithi155.stdout: "client_info": { 2023-08-01T19:56:28.967 INFO:teuthology.orchestra.run.smithi155.stdout: "client": "client.4668", 2023-08-01T19:56:28.967 INFO:teuthology.orchestra.run.smithi155.stdout: "client_addr": "172.21.15.6:0/1709472247", 2023-08-01T19:56:28.967 INFO:teuthology.orchestra.run.smithi155.stdout: "tid": 100927 2023-08-01T19:56:28.967 INFO:teuthology.orchestra.run.smithi155.stdout: }, 2023-08-01T19:56:28.968 INFO:teuthology.orchestra.run.smithi155.stdout: "events": [ 2023-08-01T19:56:28.968 INFO:teuthology.orchestra.run.smithi155.stdout: { 2023-08-01T19:56:28.968 INFO:teuthology.orchestra.run.smithi155.stdout: "event": "initiated", 2023-08-01T19:56:28.968 INFO:teuthology.orchestra.run.smithi155.stdout: "time": "2023-08-01T19:55:05.561169+0000", 2023-08-01T19:56:28.968 INFO:teuthology.orchestra.run.smithi155.stdout: "duration": 0 2023-08-01T19:56:28.968 INFO:teuthology.orchestra.run.smithi155.stdout: }, 2023-08-01T19:56:28.968 INFO:teuthology.orchestra.run.smithi155.stdout: { 2023-08-01T19:56:28.968 INFO:teuthology.orchestra.run.smithi155.stdout: "event": "throttled", 2023-08-01T19:56:28.969 INFO:teuthology.orchestra.run.smithi155.stdout: "time": "2023-08-01T19:55:05.561169+0000", 2023-08-01T19:56:28.969 INFO:teuthology.orchestra.run.smithi155.stdout: "duration": 0 2023-08-01T19:56:28.969 INFO:teuthology.orchestra.run.smithi155.stdout: }, 2023-08-01T19:56:28.969 INFO:teuthology.orchestra.run.smithi155.stdout: { 2023-08-01T19:56:28.969 INFO:teuthology.orchestra.run.smithi155.stdout: "event": "header_read", 2023-08-01T19:56:28.969 INFO:teuthology.orchestra.run.smithi155.stdout: "time": "2023-08-01T19:55:05.561168+0000", 2023-08-01T19:56:28.969 INFO:teuthology.orchestra.run.smithi155.stdout: "duration": 4294967295.9999995 2023-08-01T19:56:28.969 INFO:teuthology.orchestra.run.smithi155.stdout: }, 2023-08-01T19:56:28.970 INFO:teuthology.orchestra.run.smithi155.stdout: { 2023-08-01T19:56:28.970 INFO:teuthology.orchestra.run.smithi155.stdout: "event": "all_read", 2023-08-01T19:56:28.970 INFO:teuthology.orchestra.run.smithi155.stdout: "time": "2023-08-01T19:55:05.561218+0000", 2023-08-01T19:56:28.970 INFO:teuthology.orchestra.run.smithi155.stdout: "duration": 4.9379999999999998e-05 2023-08-01T19:56:28.970 INFO:teuthology.orchestra.run.smithi155.stdout: }, 2023-08-01T19:56:28.970 INFO:teuthology.orchestra.run.smithi155.stdout: { 2023-08-01T19:56:28.970 INFO:teuthology.orchestra.run.smithi155.stdout: "event": "dispatched", 2023-08-01T19:56:28.971 INFO:teuthology.orchestra.run.smithi155.stdout: "time": "2023-08-01T19:55:05.561225+0000", 2023-08-01T19:56:28.971 INFO:teuthology.orchestra.run.smithi155.stdout: "duration": 7.114e-06 2023-08-01T19:56:28.971 INFO:teuthology.orchestra.run.smithi155.stdout: }, 2023-08-01T19:56:28.971 INFO:teuthology.orchestra.run.smithi155.stdout: { 2023-08-01T19:56:28.971 INFO:teuthology.orchestra.run.smithi155.stdout: "event": "queued_for_pg", 2023-08-01T19:56:28.971 INFO:teuthology.orchestra.run.smithi155.stdout: "time": "2023-08-01T19:55:05.561229+0000", 2023-08-01T19:56:28.971 INFO:teuthology.orchestra.run.smithi155.stdout: "duration": 4.2180000000000001e-06 2023-08-01T19:56:28.971 INFO:teuthology.orchestra.run.smithi155.stdout: }, 2023-08-01T19:56:28.972 INFO:teuthology.orchestra.run.smithi155.stdout: { 2023-08-01T19:56:28.972 INFO:teuthology.orchestra.run.smithi155.stdout: "event": "reached_pg", 2023-08-01T19:56:28.972 INFO:teuthology.orchestra.run.smithi155.stdout: "time": "2023-08-01T19:55:05.564737+0000", 2023-08-01T19:56:28.972 INFO:teuthology.orchestra.run.smithi155.stdout: "duration": 0.0035081869999999999 2023-08-01T19:56:28.972 INFO:teuthology.orchestra.run.smithi155.stdout: }, 2023-08-01T19:56:28.972 INFO:teuthology.orchestra.run.smithi155.stdout: { 2023-08-01T19:56:28.972 INFO:teuthology.orchestra.run.smithi155.stdout: "event": "started", 2023-08-01T19:56:28.972 INFO:teuthology.orchestra.run.smithi155.stdout: "time": "2023-08-01T19:55:05.564859+0000", 2023-08-01T19:56:28.973 INFO:teuthology.orchestra.run.smithi155.stdout: "duration": 0.00012165800000000001 2023-08-01T19:56:28.973 INFO:teuthology.orchestra.run.smithi155.stdout: }, 2023-08-01T19:56:28.973 INFO:teuthology.orchestra.run.smithi155.stdout: { 2023-08-01T19:56:28.973 INFO:teuthology.orchestra.run.smithi155.stdout: "event": "waiting for subops from 0", 2023-08-01T19:56:28.973 INFO:teuthology.orchestra.run.smithi155.stdout: "time": "2023-08-01T19:55:05.565009+0000", 2023-08-01T19:56:28.973 INFO:teuthology.orchestra.run.smithi155.stdout: "duration": 0.00014979699999999999 2023-08-01T19:56:28.973 INFO:teuthology.orchestra.run.smithi155.stdout: }, 2023-08-01T19:56:28.973 INFO:teuthology.orchestra.run.smithi155.stdout: { 2023-08-01T19:56:28.974 INFO:teuthology.orchestra.run.smithi155.stdout: "event": "op_commit", 2023-08-01T19:56:28.974 INFO:teuthology.orchestra.run.smithi155.stdout: "time": "2023-08-01T19:55:05.568007+0000", 2023-08-01T19:56:28.974 INFO:teuthology.orchestra.run.smithi155.stdout: "duration": 0.00299796 2023-08-01T19:56:28.974 INFO:teuthology.orchestra.run.smithi155.stdout: }, 2023-08-01T19:56:28.974 INFO:teuthology.orchestra.run.smithi155.stdout: { 2023-08-01T19:56:28.974 INFO:teuthology.orchestra.run.smithi155.stdout: "event": "sub_op_commit_rec", 2023-08-01T19:56:28.974 INFO:teuthology.orchestra.run.smithi155.stdout: "time": "2023-08-01T19:55:05.627520+0000", 2023-08-01T19:56:28.974 INFO:teuthology.orchestra.run.smithi155.stdout: "duration": 0.059513636000000002 2023-08-01T19:56:28.975 INFO:teuthology.orchestra.run.smithi155.stdout: }, 2023-08-01T19:56:28.975 INFO:teuthology.orchestra.run.smithi155.stdout: { 2023-08-01T19:56:28.975 INFO:teuthology.orchestra.run.smithi155.stdout: "event": "commit_sent", 2023-08-01T19:56:28.975 INFO:teuthology.orchestra.run.smithi155.stdout: "time": "2023-08-01T19:55:05.627553+0000", 2023-08-01T19:56:28.975 INFO:teuthology.orchestra.run.smithi155.stdout: "duration": 3.2635999999999997e-05 2023-08-01T19:56:28.975 INFO:teuthology.orchestra.run.smithi155.stdout: }, 2023-08-01T19:56:28.975 INFO:teuthology.orchestra.run.smithi155.stdout: { 2023-08-01T19:56:28.975 INFO:teuthology.orchestra.run.smithi155.stdout: "event": "done", 2023-08-01T19:56:28.976 INFO:teuthology.orchestra.run.smithi155.stdout: "time": "2023-08-01T19:55:05.627581+0000", 2023-08-01T19:56:28.976 INFO:teuthology.orchestra.run.smithi155.stdout: "duration": 2.7681000000000001e-05 2023-08-01T19:56:28.976 INFO:teuthology.orchestra.run.smithi155.stdout: } 2023-08-01T19:56:28.976 INFO:teuthology.orchestra.run.smithi155.stdout: ] 2023-08-01T19:56:28.976 INFO:teuthology.orchestra.run.smithi155.stdout: } 2023-08-01T19:56:28.976 INFO:teuthology.orchestra.run.smithi155.stdout: }, 2023-08-01T19:56:28.976 INFO:teuthology.orchestra.run.smithi155.stdout: { 2023-08-01T19:56:28.977 INFO:teuthology.orchestra.run.smithi155.stdout: "description": "osd_op(client.4668.0:100935 5.e 5:7895b14e:::benchmark_data_smithi006_114134_object100934:head [set-alloc-hint object_size 65536 write_size 65536,write 0~65536] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e37)", 2023-08-01T19:56:28.977 INFO:teuthology.orchestra.run.smithi155.stdout: "initiated_at": "2023-08-01T19:55:05.566666+0000", 2023-08-01T19:56:28.977 INFO:teuthology.orchestra.run.smithi155.stdout: "age": 83.293555652999999, 2023-08-01T19:56:28.977 INFO:teuthology.orchestra.run.smithi155.stdout: "duration": 0.064309016999999996, 2023-08-01T19:56:28.977 INFO:teuthology.orchestra.run.smithi155.stdout: "type_data": { 2023-08-01T19:56:28.977 INFO:teuthology.orchestra.run.smithi155.stdout: "flag_point": "commit sent; apply or cleanup", 2023-08-01T19:56:28.977 INFO:teuthology.orchestra.run.smithi155.stdout: "client_info": { 2023-08-01T19:56:28.977 INFO:teuthology.orchestra.run.smithi155.stdout: "client": "client.4668", 2023-08-01T19:56:28.978 INFO:teuthology.orchestra.run.smithi155.stdout: "client_addr": "172.21.15.6:0/1709472247", 2023-08-01T19:56:28.978 INFO:teuthology.orchestra.run.smithi155.stdout: "tid": 100935 2023-08-01T19:56:28.978 INFO:teuthology.orchestra.run.smithi155.stdout: }, 2023-08-01T19:56:28.978 INFO:teuthology.orchestra.run.smithi155.stdout: "events": [ 2023-08-01T19:56:28.978 INFO:teuthology.orchestra.run.smithi155.stdout: { 2023-08-01T19:56:28.978 INFO:teuthology.orchestra.run.smithi155.stdout: "event": "initiated", 2023-08-01T19:56:28.978 INFO:teuthology.orchestra.run.smithi155.stdout: "time": "2023-08-01T19:55:05.566666+0000", 2023-08-01T19:56:28.978 INFO:teuthology.orchestra.run.smithi155.stdout: "duration": 0 2023-08-01T19:56:28.979 INFO:teuthology.orchestra.run.smithi155.stdout: }, 2023-08-01T19:56:28.979 INFO:teuthology.orchestra.run.smithi155.stdout: { 2023-08-01T19:56:28.979 INFO:teuthology.orchestra.run.smithi155.stdout: "event": "throttled", 2023-08-01T19:56:28.979 INFO:teuthology.orchestra.run.smithi155.stdout: "time": "2023-08-01T19:55:05.566666+0000", 2023-08-01T19:56:28.979 INFO:teuthology.orchestra.run.smithi155.stdout: "duration": 0 2023-08-01T19:56:28.979 INFO:teuthology.orchestra.run.smithi155.stdout: }, 2023-08-01T19:56:28.979 INFO:teuthology.orchestra.run.smithi155.stdout: { 2023-08-01T19:56:28.979 INFO:teuthology.orchestra.run.smithi155.stdout: "event": "header_read", 2023-08-01T19:56:28.980 INFO:teuthology.orchestra.run.smithi155.stdout: "time": "2023-08-01T19:55:05.566665+0000", 2023-08-01T19:56:28.980 INFO:teuthology.orchestra.run.smithi155.stdout: "duration": 4294967295.9999986 2023-08-01T19:56:28.980 INFO:teuthology.orchestra.run.smithi155.stdout: }, 2023-08-01T19:56:28.980 INFO:teuthology.orchestra.run.smithi155.stdout: { 2023-08-01T19:56:28.980 INFO:teuthology.orchestra.run.smithi155.stdout: "event": "all_read", 2023-08-01T19:56:28.980 INFO:teuthology.orchestra.run.smithi155.stdout: "time": "2023-08-01T19:55:05.566754+0000", 2023-08-01T19:56:28.980 INFO:teuthology.orchestra.run.smithi155.stdout: "duration": 8.9425999999999994e-05 2023-08-01T19:56:28.980 INFO:teuthology.orchestra.run.smithi155.stdout: }, 2023-08-01T19:56:28.981 INFO:teuthology.orchestra.run.smithi155.stdout: { 2023-08-01T19:56:28.981 INFO:teuthology.orchestra.run.smithi155.stdout: "event": "dispatched", 2023-08-01T19:56:28.981 INFO:teuthology.orchestra.run.smithi155.stdout: "time": "2023-08-01T19:55:05.566766+0000", 2023-08-01T19:56:28.981 INFO:teuthology.orchestra.run.smithi155.stdout: "duration": 1.2018000000000001e-05 2023-08-01T19:56:28.981 INFO:teuthology.orchestra.run.smithi155.stdout: }, 2023-08-01T19:56:28.981 INFO:teuthology.orchestra.run.smithi155.stdout: { 2023-08-01T19:56:28.981 INFO:teuthology.orchestra.run.smithi155.stdout: "event": "queued_for_pg", 2023-08-01T19:56:28.981 INFO:teuthology.orchestra.run.smithi155.stdout: "time": "2023-08-01T19:55:05.566772+0000", 2023-08-01T19:56:28.982 INFO:teuthology.orchestra.run.smithi155.stdout: "duration": 6.0190000000000003e-06 2023-08-01T19:56:28.982 INFO:teuthology.orchestra.run.smithi155.stdout: }, 2023-08-01T19:56:28.982 INFO:teuthology.orchestra.run.smithi155.stdout: { 2023-08-01T19:56:28.982 INFO:teuthology.orchestra.run.smithi155.stdout: "event": "reached_pg", 2023-08-01T19:56:28.982 INFO:teuthology.orchestra.run.smithi155.stdout: "time": "2023-08-01T19:55:05.566800+0000", 2023-08-01T19:56:28.982 INFO:teuthology.orchestra.run.smithi155.stdout: "duration": 2.7835999999999999e-05 2023-08-01T19:56:28.982 INFO:teuthology.orchestra.run.smithi155.stdout: }, 2023-08-01T19:56:28.983 INFO:teuthology.orchestra.run.smithi155.stdout: { 2023-08-01T19:56:28.983 INFO:teuthology.orchestra.run.smithi155.stdout: "event": "started", 2023-08-01T19:56:28.983 INFO:teuthology.orchestra.run.smithi155.stdout: "time": "2023-08-01T19:55:05.566879+0000", 2023-08-01T19:56:28.983 INFO:teuthology.orchestra.run.smithi155.stdout: "duration": 7.9105999999999998e-05 2023-08-01T19:56:28.983 INFO:teuthology.orchestra.run.smithi155.stdout: }, 2023-08-01T19:56:28.983 INFO:teuthology.orchestra.run.smithi155.stdout: { 2023-08-01T19:56:28.983 INFO:teuthology.orchestra.run.smithi155.stdout: "event": "waiting for subops from 0", 2023-08-01T19:56:28.983 INFO:teuthology.orchestra.run.smithi155.stdout: "time": "2023-08-01T19:55:05.566971+0000", 2023-08-01T19:56:28.984 INFO:teuthology.orchestra.run.smithi155.stdout: "duration": 9.1817999999999994e-05 2023-08-01T19:56:28.984 INFO:teuthology.orchestra.run.smithi155.stdout: }, 2023-08-01T19:56:28.984 INFO:teuthology.orchestra.run.smithi155.stdout: { 2023-08-01T19:56:28.984 INFO:teuthology.orchestra.run.smithi155.stdout: "event": "op_commit", 2023-08-01T19:56:28.984 INFO:teuthology.orchestra.run.smithi155.stdout: "time": "2023-08-01T19:55:05.571475+0000", 2023-08-01T19:56:28.984 INFO:teuthology.orchestra.run.smithi155.stdout: "duration": 0.0045039499999999996 2023-08-01T19:56:28.984 INFO:teuthology.orchestra.run.smithi155.stdout: }, 2023-08-01T19:56:28.984 INFO:teuthology.orchestra.run.smithi155.stdout: { 2023-08-01T19:56:28.985 INFO:teuthology.orchestra.run.smithi155.stdout: "event": "sub_op_commit_rec", 2023-08-01T19:56:28.985 INFO:teuthology.orchestra.run.smithi155.stdout: "time": "2023-08-01T19:55:05.630884+0000", 2023-08-01T19:56:28.985 INFO:teuthology.orchestra.run.smithi155.stdout: "duration": 0.059409181999999998 2023-08-01T19:56:28.985 INFO:teuthology.orchestra.run.smithi155.stdout: }, 2023-08-01T19:56:28.985 INFO:teuthology.orchestra.run.smithi155.stdout: { 2023-08-01T19:56:28.985 INFO:teuthology.orchestra.run.smithi155.stdout: "event": "commit_sent", 2023-08-01T19:56:28.985 INFO:teuthology.orchestra.run.smithi155.stdout: "time": "2023-08-01T19:55:05.630930+0000", 2023-08-01T19:56:28.985 INFO:teuthology.orchestra.run.smithi155.stdout: "duration": 4.5507999999999999e-05 2023-08-01T19:56:28.986 INFO:teuthology.orchestra.run.smithi155.stdout: }, 2023-08-01T19:56:28.986 INFO:teuthology.orchestra.run.smithi155.stdout: { 2023-08-01T19:56:28.986 INFO:teuthology.orchestra.run.smithi155.stdout: "event": "done", 2023-08-01T19:56:28.986 INFO:teuthology.orchestra.run.smithi155.stdout: "time": "2023-08-01T19:55:05.630975+0000", 2023-08-01T19:56:28.986 INFO:teuthology.orchestra.run.smithi155.stdout: "duration": 4.5441000000000001e-05 2023-08-01T19:56:28.986 INFO:teuthology.orchestra.run.smithi155.stdout: } 2023-08-01T19:56:28.986 INFO:teuthology.orchestra.run.smithi155.stdout: ] 2023-08-01T19:56:28.986 INFO:teuthology.orchestra.run.smithi155.stdout: } 2023-08-01T19:56:28.987 INFO:teuthology.orchestra.run.smithi155.stdout: }, 2023-08-01T19:56:28.987 INFO:teuthology.orchestra.run.smithi155.stdout: { 2023-08-01T19:56:28.987 INFO:teuthology.orchestra.run.smithi155.stdout: "description": "osd_op(client.4668.0:100941 5.e 5:736a6ac6:::benchmark_data_smithi006_114134_object100940:head [set-alloc-hint object_size 65536 write_size 65536,write 0~65536] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e37)", 2023-08-01T19:56:28.987 INFO:teuthology.orchestra.run.smithi155.stdout: "initiated_at": "2023-08-01T19:55:05.569750+0000", 2023-08-01T19:56:28.987 INFO:teuthology.orchestra.run.smithi155.stdout: "age": 83.290471760000003, 2023-08-01T19:56:28.987 INFO:teuthology.orchestra.run.smithi155.stdout: "duration": 0.065431331999999995, 2023-08-01T19:56:28.987 INFO:teuthology.orchestra.run.smithi155.stdout: "type_data": { 2023-08-01T19:56:28.988 INFO:teuthology.orchestra.run.smithi155.stdout: "flag_point": "commit sent; apply or cleanup", 2023-08-01T19:56:28.988 INFO:teuthology.orchestra.run.smithi155.stdout: "client_info": { 2023-08-01T19:56:28.988 INFO:teuthology.orchestra.run.smithi155.stdout: "client": "client.4668", 2023-08-01T19:56:28.988 INFO:teuthology.orchestra.run.smithi155.stdout: "client_addr": "172.21.15.6:0/1709472247", 2023-08-01T19:56:28.988 INFO:teuthology.orchestra.run.smithi155.stdout: "tid": 100941 2023-08-01T19:56:28.988 INFO:teuthology.orchestra.run.smithi155.stdout: }, 2023-08-01T19:56:28.988 INFO:teuthology.orchestra.run.smithi155.stdout: "events": [ 2023-08-01T19:56:28.988 INFO:teuthology.orchestra.run.smithi155.stdout: { 2023-08-01T19:56:28.989 INFO:teuthology.orchestra.run.smithi155.stdout: "event": "initiated", 2023-08-01T19:56:28.989 INFO:teuthology.orchestra.run.smithi155.stdout: "time": "2023-08-01T19:55:05.569750+0000", 2023-08-01T19:56:28.989 INFO:teuthology.orchestra.run.smithi155.stdout: "duration": 0 2023-08-01T19:56:28.989 INFO:teuthology.orchestra.run.smithi155.stdout: }, 2023-08-01T19:56:28.989 INFO:teuthology.orchestra.run.smithi155.stdout: { 2023-08-01T19:56:28.989 INFO:teuthology.orchestra.run.smithi155.stdout: "event": "throttled", 2023-08-01T19:56:28.989 INFO:teuthology.orchestra.run.smithi155.stdout: "time": "2023-08-01T19:55:05.569750+0000", 2023-08-01T19:56:28.989 INFO:teuthology.orchestra.run.smithi155.stdout: "duration": 0 2023-08-01T19:56:28.990 INFO:teuthology.orchestra.run.smithi155.stdout: }, 2023-08-01T19:56:28.990 INFO:teuthology.orchestra.run.smithi155.stdout: { 2023-08-01T19:56:28.990 INFO:teuthology.orchestra.run.smithi155.stdout: "event": "header_read", 2023-08-01T19:56:28.990 INFO:teuthology.orchestra.run.smithi155.stdout: "time": "2023-08-01T19:55:05.569749+0000", 2023-08-01T19:56:28.990 INFO:teuthology.orchestra.run.smithi155.stdout: "duration": 4294967295.999999 2023-08-01T19:56:28.990 INFO:teuthology.orchestra.run.smithi155.stdout: }, 2023-08-01T19:56:28.990 INFO:teuthology.orchestra.run.smithi155.stdout: { 2023-08-01T19:56:28.991 INFO:teuthology.orchestra.run.smithi155.stdout: "event": "all_read", 2023-08-01T19:56:28.991 INFO:teuthology.orchestra.run.smithi155.stdout: "time": "2023-08-01T19:55:05.569861+0000", 2023-08-01T19:56:28.991 INFO:teuthology.orchestra.run.smithi155.stdout: "duration": 0.000111333 2023-08-01T19:56:28.991 INFO:teuthology.orchestra.run.smithi155.stdout: }, 2023-08-01T19:56:28.991 INFO:teuthology.orchestra.run.smithi155.stdout: { 2023-08-01T19:56:28.991 INFO:teuthology.orchestra.run.smithi155.stdout: "event": "dispatched", 2023-08-01T19:56:28.991 INFO:teuthology.orchestra.run.smithi155.stdout: "time": "2023-08-01T19:55:05.569869+0000", 2023-08-01T19:56:28.991 INFO:teuthology.orchestra.run.smithi155.stdout: "duration": 8.8589999999999994e-06 2023-08-01T19:56:28.992 INFO:teuthology.orchestra.run.smithi155.stdout: }, 2023-08-01T19:56:28.992 INFO:teuthology.orchestra.run.smithi155.stdout: { 2023-08-01T19:56:28.992 INFO:teuthology.orchestra.run.smithi155.stdout: "event": "queued_for_pg", 2023-08-01T19:56:28.992 INFO:teuthology.orchestra.run.smithi155.stdout: "time": "2023-08-01T19:55:05.569874+0000", 2023-08-01T19:56:28.992 INFO:teuthology.orchestra.run.smithi155.stdout: "duration": 4.1679999999999997e-06 2023-08-01T19:56:28.992 INFO:teuthology.orchestra.run.smithi155.stdout: }, 2023-08-01T19:56:28.992 INFO:teuthology.orchestra.run.smithi155.stdout: { 2023-08-01T19:56:28.993 INFO:teuthology.orchestra.run.smithi155.stdout: "event": "reached_pg", 2023-08-01T19:56:28.993 INFO:teuthology.orchestra.run.smithi155.stdout: "time": "2023-08-01T19:55:05.569904+0000", 2023-08-01T19:56:28.993 INFO:teuthology.orchestra.run.smithi155.stdout: "duration": 3.0920999999999998e-05 2023-08-01T19:56:28.993 INFO:teuthology.orchestra.run.smithi155.stdout: }, 2023-08-01T19:56:28.993 INFO:teuthology.orchestra.run.smithi155.stdout: { 2023-08-01T19:56:28.993 INFO:teuthology.orchestra.run.smithi155.stdout: "event": "started", 2023-08-01T19:56:28.993 INFO:teuthology.orchestra.run.smithi155.stdout: "time": "2023-08-01T19:55:05.569998+0000", 2023-08-01T19:56:28.993 INFO:teuthology.orchestra.run.smithi155.stdout: "duration": 9.3086999999999998e-05 2023-08-01T19:56:28.994 INFO:teuthology.orchestra.run.smithi155.stdout: }, 2023-08-01T19:56:28.994 INFO:teuthology.orchestra.run.smithi155.stdout: { 2023-08-01T19:56:28.994 INFO:teuthology.orchestra.run.smithi155.stdout: "event": "waiting for subops from 0", 2023-08-01T19:56:28.994 INFO:teuthology.orchestra.run.smithi155.stdout: "time": "2023-08-01T19:55:05.570093+0000", 2023-08-01T19:56:28.994 INFO:teuthology.orchestra.run.smithi155.stdout: "duration": 9.5768999999999997e-05 2023-08-01T19:56:28.994 INFO:teuthology.orchestra.run.smithi155.stdout: }, 2023-08-01T19:56:28.994 INFO:teuthology.orchestra.run.smithi155.stdout: { 2023-08-01T19:56:28.994 INFO:teuthology.orchestra.run.smithi155.stdout: "event": "op_commit", 2023-08-01T19:56:28.995 INFO:teuthology.orchestra.run.smithi155.stdout: "time": "2023-08-01T19:55:05.572839+0000", 2023-08-01T19:56:28.995 INFO:teuthology.orchestra.run.smithi155.stdout: "duration": 0.0027460050000000001 2023-08-01T19:56:28.995 INFO:teuthology.orchestra.run.smithi155.stdout: }, 2023-08-01T19:56:28.995 INFO:teuthology.orchestra.run.smithi155.stdout: { 2023-08-01T19:56:28.995 INFO:teuthology.orchestra.run.smithi155.stdout: "event": "sub_op_commit_rec", 2023-08-01T19:56:28.995 INFO:teuthology.orchestra.run.smithi155.stdout: "time": "2023-08-01T19:55:05.635114+0000", 2023-08-01T19:56:28.995 INFO:teuthology.orchestra.run.smithi155.stdout: "duration": 0.062274297999999999 2023-08-01T19:56:28.995 INFO:teuthology.orchestra.run.smithi155.stdout: }, 2023-08-01T19:56:28.996 INFO:teuthology.orchestra.run.smithi155.stdout: { 2023-08-01T19:56:28.996 INFO:teuthology.orchestra.run.smithi155.stdout: "event": "commit_sent", 2023-08-01T19:56:28.996 INFO:teuthology.orchestra.run.smithi155.stdout: "time": "2023-08-01T19:55:05.635143+0000", 2023-08-01T19:56:28.996 INFO:teuthology.orchestra.run.smithi155.stdout: "duration": 2.9430000000000001e-05 2023-08-01T19:56:28.996 INFO:teuthology.orchestra.run.smithi155.stdout: }, 2023-08-01T19:56:28.996 INFO:teuthology.orchestra.run.smithi155.stdout: { 2023-08-01T19:56:28.996 INFO:teuthology.orchestra.run.smithi155.stdout: "event": "done", 2023-08-01T19:56:28.996 INFO:teuthology.orchestra.run.smithi155.stdout: "time": "2023-08-01T19:55:05.635181+0000", 2023-08-01T19:56:28.997 INFO:teuthology.orchestra.run.smithi155.stdout: "duration": 3.8352000000000001e-05 2023-08-01T19:56:28.997 INFO:teuthology.orchestra.run.smithi155.stdout: } 2023-08-01T19:56:28.997 INFO:teuthology.orchestra.run.smithi155.stdout: ] 2023-08-01T19:56:28.997 INFO:teuthology.orchestra.run.smithi155.stdout: } 2023-08-01T19:56:28.997 INFO:teuthology.orchestra.run.smithi155.stdout: }, 2023-08-01T19:56:28.997 INFO:teuthology.orchestra.run.smithi155.stdout: { 2023-08-01T19:56:28.997 INFO:teuthology.orchestra.run.smithi155.stdout: "description": "osd_op(client.4668.0:100945 5.e 5:73df68dd:::benchmark_data_smithi006_114134_object100944:head [set-alloc-hint object_size 65536 write_size 65536,write 0~65536] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e37)", 2023-08-01T19:56:28.998 INFO:teuthology.orchestra.run.smithi155.stdout: "initiated_at": "2023-08-01T19:55:05.576784+0000", 2023-08-01T19:56:28.998 INFO:teuthology.orchestra.run.smithi155.stdout: "age": 83.283438175000001, 2023-08-01T19:56:28.998 INFO:teuthology.orchestra.run.smithi155.stdout: "duration": 0.058512994999999998, 2023-08-01T19:56:28.998 INFO:teuthology.orchestra.run.smithi155.stdout: "type_data": { 2023-08-01T19:56:28.998 INFO:teuthology.orchestra.run.smithi155.stdout: "flag_point": "commit sent; apply or cleanup", 2023-08-01T19:56:28.998 INFO:teuthology.orchestra.run.smithi155.stdout: "client_info": { 2023-08-01T19:56:28.998 INFO:teuthology.orchestra.run.smithi155.stdout: "client": "client.4668", 2023-08-01T19:56:28.998 INFO:teuthology.orchestra.run.smithi155.stdout: "client_addr": "172.21.15.6:0/1709472247", 2023-08-01T19:56:28.999 INFO:teuthology.orchestra.run.smithi155.stdout: "tid": 100945 2023-08-01T19:56:28.999 INFO:teuthology.orchestra.run.smithi155.stdout: }, 2023-08-01T19:56:28.999 INFO:teuthology.orchestra.run.smithi155.stdout: "events": [ 2023-08-01T19:56:28.999 INFO:teuthology.orchestra.run.smithi155.stdout: { 2023-08-01T19:56:28.999 INFO:teuthology.orchestra.run.smithi155.stdout: "event": "initiated", 2023-08-01T19:56:28.999 INFO:teuthology.orchestra.run.smithi155.stdout: "time": "2023-08-01T19:55:05.576784+0000", 2023-08-01T19:56:28.999 INFO:teuthology.orchestra.run.smithi155.stdout: "duration": 0 2023-08-01T19:56:28.999 INFO:teuthology.orchestra.run.smithi155.stdout: }, 2023-08-01T19:56:29.000 INFO:teuthology.orchestra.run.smithi155.stdout: { 2023-08-01T19:56:29.000 INFO:teuthology.orchestra.run.smithi155.stdout: "event": "throttled", 2023-08-01T19:56:29.000 INFO:teuthology.orchestra.run.smithi155.stdout: "time": "2023-08-01T19:55:05.576784+0000", 2023-08-01T19:56:29.000 INFO:teuthology.orchestra.run.smithi155.stdout: "duration": 0 2023-08-01T19:56:29.000 INFO:teuthology.orchestra.run.smithi155.stdout: }, 2023-08-01T19:56:29.000 INFO:teuthology.orchestra.run.smithi155.stdout: { 2023-08-01T19:56:29.000 INFO:teuthology.orchestra.run.smithi155.stdout: "event": "header_read", 2023-08-01T19:56:29.001 INFO:teuthology.orchestra.run.smithi155.stdout: "time": "2023-08-01T19:55:05.576783+0000", 2023-08-01T19:56:29.001 INFO:teuthology.orchestra.run.smithi155.stdout: "duration": 4294967295.9999995 2023-08-01T19:56:29.001 INFO:teuthology.orchestra.run.smithi155.stdout: }, 2023-08-01T19:56:29.001 INFO:teuthology.orchestra.run.smithi155.stdout: { 2023-08-01T19:56:29.001 INFO:teuthology.orchestra.run.smithi155.stdout: "event": "all_read", 2023-08-01T19:56:29.001 INFO:teuthology.orchestra.run.smithi155.stdout: "time": "2023-08-01T19:55:05.576807+0000", 2023-08-01T19:56:29.001 INFO:teuthology.orchestra.run.smithi155.stdout: "duration": 2.3651000000000001e-05 2023-08-01T19:56:29.002 INFO:teuthology.orchestra.run.smithi155.stdout: }, 2023-08-01T19:56:29.002 INFO:teuthology.orchestra.run.smithi155.stdout: { 2023-08-01T19:56:29.002 INFO:teuthology.orchestra.run.smithi155.stdout: "event": "dispatched", 2023-08-01T19:56:29.002 INFO:teuthology.orchestra.run.smithi155.stdout: "time": "2023-08-01T19:55:05.576817+0000", 2023-08-01T19:56:29.002 INFO:teuthology.orchestra.run.smithi155.stdout: "duration": 9.9389999999999992e-06 2023-08-01T19:56:29.002 INFO:teuthology.orchestra.run.smithi155.stdout: }, 2023-08-01T19:56:29.002 INFO:teuthology.orchestra.run.smithi155.stdout: { 2023-08-01T19:56:29.002 INFO:teuthology.orchestra.run.smithi155.stdout: "event": "queued_for_pg", 2023-08-01T19:56:29.003 INFO:teuthology.orchestra.run.smithi155.stdout: "time": "2023-08-01T19:55:05.576820+0000", 2023-08-01T19:56:29.003 INFO:teuthology.orchestra.run.smithi155.stdout: "duration": 3.2619999999999999e-06 2023-08-01T19:56:29.003 INFO:teuthology.orchestra.run.smithi155.stdout: }, 2023-08-01T19:56:29.003 INFO:teuthology.orchestra.run.smithi155.stdout: { 2023-08-01T19:56:29.003 INFO:teuthology.orchestra.run.smithi155.stdout: "event": "reached_pg", 2023-08-01T19:56:29.003 INFO:teuthology.orchestra.run.smithi155.stdout: "time": "2023-08-01T19:55:05.576849+0000", 2023-08-01T19:56:29.003 INFO:teuthology.orchestra.run.smithi155.stdout: "duration": 2.8880000000000001e-05 2023-08-01T19:56:29.003 INFO:teuthology.orchestra.run.smithi155.stdout: }, 2023-08-01T19:56:29.004 INFO:teuthology.orchestra.run.smithi155.stdout: { 2023-08-01T19:56:29.004 INFO:teuthology.orchestra.run.smithi155.stdout: "event": "started", 2023-08-01T19:56:29.004 INFO:teuthology.orchestra.run.smithi155.stdout: "time": "2023-08-01T19:55:05.576940+0000", 2023-08-01T19:56:29.004 INFO:teuthology.orchestra.run.smithi155.stdout: "duration": 9.0570999999999997e-05 2023-08-01T19:56:29.004 INFO:teuthology.orchestra.run.smithi155.stdout: }, 2023-08-01T19:56:29.004 INFO:teuthology.orchestra.run.smithi155.stdout: { 2023-08-01T19:56:29.004 INFO:teuthology.orchestra.run.smithi155.stdout: "event": "waiting for subops from 0", 2023-08-01T19:56:29.005 INFO:teuthology.orchestra.run.smithi155.stdout: "time": "2023-08-01T19:55:05.577027+0000", 2023-08-01T19:56:29.005 INFO:teuthology.orchestra.run.smithi155.stdout: "duration": 8.7237999999999994e-05 2023-08-01T19:56:29.005 INFO:teuthology.orchestra.run.smithi155.stdout: }, 2023-08-01T19:56:29.005 INFO:teuthology.orchestra.run.smithi155.stdout: { 2023-08-01T19:56:29.005 INFO:teuthology.orchestra.run.smithi155.stdout: "event": "op_commit", 2023-08-01T19:56:29.005 INFO:teuthology.orchestra.run.smithi155.stdout: "time": "2023-08-01T19:55:05.579624+0000", 2023-08-01T19:56:29.005 INFO:teuthology.orchestra.run.smithi155.stdout: "duration": 0.0025971200000000001 2023-08-01T19:56:29.006 INFO:teuthology.orchestra.run.smithi155.stdout: }, 2023-08-01T19:56:29.006 INFO:teuthology.orchestra.run.smithi155.stdout: { 2023-08-01T19:56:29.006 INFO:teuthology.orchestra.run.smithi155.stdout: "event": "sub_op_commit_rec", 2023-08-01T19:56:29.006 INFO:teuthology.orchestra.run.smithi155.stdout: "time": "2023-08-01T19:55:05.635218+0000", 2023-08-01T19:56:29.006 INFO:teuthology.orchestra.run.smithi155.stdout: "duration": 0.055594487999999997 2023-08-01T19:56:29.006 INFO:teuthology.orchestra.run.smithi155.stdout: }, 2023-08-01T19:56:29.006 INFO:teuthology.orchestra.run.smithi155.stdout: { 2023-08-01T19:56:29.006 INFO:teuthology.orchestra.run.smithi155.stdout: "event": "commit_sent", 2023-08-01T19:56:29.007 INFO:teuthology.orchestra.run.smithi155.stdout: "time": "2023-08-01T19:55:05.635262+0000", 2023-08-01T19:56:29.007 INFO:teuthology.orchestra.run.smithi155.stdout: "duration": 4.3380999999999997e-05 2023-08-01T19:56:29.007 INFO:teuthology.orchestra.run.smithi155.stdout: }, 2023-08-01T19:56:29.007 INFO:teuthology.orchestra.run.smithi155.stdout: { 2023-08-01T19:56:29.007 INFO:teuthology.orchestra.run.smithi155.stdout: "event": "done", 2023-08-01T19:56:29.007 INFO:teuthology.orchestra.run.smithi155.stdout: "time": "2023-08-01T19:55:05.635297+0000", 2023-08-01T19:56:29.007 INFO:teuthology.orchestra.run.smithi155.stdout: "duration": 3.4842000000000003e-05 2023-08-01T19:56:29.007 INFO:teuthology.orchestra.run.smithi155.stdout: } 2023-08-01T19:56:29.008 INFO:teuthology.orchestra.run.smithi155.stdout: ] 2023-08-01T19:56:29.008 INFO:teuthology.orchestra.run.smithi155.stdout: } 2023-08-01T19:56:29.008 INFO:teuthology.orchestra.run.smithi155.stdout: }, 2023-08-01T19:56:29.008 INFO:teuthology.orchestra.run.smithi155.stdout: { 2023-08-01T19:56:29.008 INFO:teuthology.orchestra.run.smithi155.stdout: "description": "osd_op(client.4668.0:100947 5.4 5:23e8fc27:::benchmark_data_smithi006_114134_object100946:head [set-alloc-hint object_size 65536 write_size 65536,write 0~65536] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e37)", 2023-08-01T19:56:29.008 INFO:teuthology.orchestra.run.smithi155.stdout: "initiated_at": "2023-08-01T19:55:05.576840+0000", 2023-08-01T19:56:29.008 INFO:teuthology.orchestra.run.smithi155.stdout: "age": 83.283382119999999, 2023-08-01T19:56:29.009 INFO:teuthology.orchestra.run.smithi155.stdout: "duration": 0.058423127999999998, 2023-08-01T19:56:29.009 INFO:teuthology.orchestra.run.smithi155.stdout: "type_data": { 2023-08-01T19:56:29.009 INFO:teuthology.orchestra.run.smithi155.stdout: "flag_point": "commit sent; apply or cleanup", 2023-08-01T19:56:29.009 INFO:teuthology.orchestra.run.smithi155.stdout: "client_info": { 2023-08-01T19:56:29.009 INFO:teuthology.orchestra.run.smithi155.stdout: "client": "client.4668", 2023-08-01T19:56:29.009 INFO:teuthology.orchestra.run.smithi155.stdout: "client_addr": "172.21.15.6:0/1709472247", 2023-08-01T19:56:29.009 INFO:teuthology.orchestra.run.smithi155.stdout: "tid": 100947 2023-08-01T19:56:29.009 INFO:teuthology.orchestra.run.smithi155.stdout: }, 2023-08-01T19:56:29.010 INFO:teuthology.orchestra.run.smithi155.stdout: "events": [ 2023-08-01T19:56:29.010 INFO:teuthology.orchestra.run.smithi155.stdout: { 2023-08-01T19:56:29.010 INFO:teuthology.orchestra.run.smithi155.stdout: "event": "initiated", 2023-08-01T19:56:29.010 INFO:teuthology.orchestra.run.smithi155.stdout: "time": "2023-08-01T19:55:05.576840+0000", 2023-08-01T19:56:29.010 INFO:teuthology.orchestra.run.smithi155.stdout: "duration": 0 2023-08-01T19:56:29.010 INFO:teuthology.orchestra.run.smithi155.stdout: }, 2023-08-01T19:56:29.010 INFO:teuthology.orchestra.run.smithi155.stdout: { 2023-08-01T19:56:29.010 INFO:teuthology.orchestra.run.smithi155.stdout: "event": "throttled", 2023-08-01T19:56:29.011 INFO:teuthology.orchestra.run.smithi155.stdout: "time": "2023-08-01T19:55:05.576840+0000", 2023-08-01T19:56:29.011 INFO:teuthology.orchestra.run.smithi155.stdout: "duration": 0 2023-08-01T19:56:29.011 INFO:teuthology.orchestra.run.smithi155.stdout: }, 2023-08-01T19:56:29.011 INFO:teuthology.orchestra.run.smithi155.stdout: { 2023-08-01T19:56:29.011 INFO:teuthology.orchestra.run.smithi155.stdout: "event": "header_read", 2023-08-01T19:56:29.011 INFO:teuthology.orchestra.run.smithi155.stdout: "time": "2023-08-01T19:55:05.576839+0000", 2023-08-01T19:56:29.011 INFO:teuthology.orchestra.run.smithi155.stdout: "duration": 4294967295.9999995 2023-08-01T19:56:29.011 INFO:teuthology.orchestra.run.smithi155.stdout: }, 2023-08-01T19:56:29.012 INFO:teuthology.orchestra.run.smithi155.stdout: { 2023-08-01T19:56:29.012 INFO:teuthology.orchestra.run.smithi155.stdout: "event": "all_read", 2023-08-01T19:56:29.012 INFO:teuthology.orchestra.run.smithi155.stdout: "time": "2023-08-01T19:55:05.576893+0000", 2023-08-01T19:56:29.012 INFO:teuthology.orchestra.run.smithi155.stdout: "duration": 5.3893000000000001e-05 2023-08-01T19:56:29.012 INFO:teuthology.orchestra.run.smithi155.stdout: }, 2023-08-01T19:56:29.012 INFO:teuthology.orchestra.run.smithi155.stdout: { 2023-08-01T19:56:29.012 INFO:teuthology.orchestra.run.smithi155.stdout: "event": "dispatched", 2023-08-01T19:56:29.013 INFO:teuthology.orchestra.run.smithi155.stdout: "time": "2023-08-01T19:55:05.576902+0000", 2023-08-01T19:56:29.013 INFO:teuthology.orchestra.run.smithi155.stdout: "duration": 8.7520000000000002e-06 2023-08-01T19:56:29.013 INFO:teuthology.orchestra.run.smithi155.stdout: }, 2023-08-01T19:56:29.013 INFO:teuthology.orchestra.run.smithi155.stdout: { 2023-08-01T19:56:29.013 INFO:teuthology.orchestra.run.smithi155.stdout: "event": "queued_for_pg", 2023-08-01T19:56:29.013 INFO:teuthology.orchestra.run.smithi155.stdout: "time": "2023-08-01T19:55:05.576905+0000", 2023-08-01T19:56:29.013 INFO:teuthology.orchestra.run.smithi155.stdout: "duration": 3.01e-06 2023-08-01T19:56:29.013 INFO:teuthology.orchestra.run.smithi155.stdout: }, 2023-08-01T19:56:29.014 INFO:teuthology.orchestra.run.smithi155.stdout: { 2023-08-01T19:56:29.014 INFO:teuthology.orchestra.run.smithi155.stdout: "event": "reached_pg", 2023-08-01T19:56:29.014 INFO:teuthology.orchestra.run.smithi155.stdout: "time": "2023-08-01T19:55:05.579641+0000", 2023-08-01T19:56:29.014 INFO:teuthology.orchestra.run.smithi155.stdout: "duration": 0.0027366880000000001 2023-08-01T19:56:29.014 INFO:teuthology.orchestra.run.smithi155.stdout: }, 2023-08-01T19:56:29.014 INFO:teuthology.orchestra.run.smithi155.stdout: { 2023-08-01T19:56:29.014 INFO:teuthology.orchestra.run.smithi155.stdout: "event": "started", 2023-08-01T19:56:29.014 INFO:teuthology.orchestra.run.smithi155.stdout: "time": "2023-08-01T19:55:05.579734+0000", 2023-08-01T19:56:29.015 INFO:teuthology.orchestra.run.smithi155.stdout: "duration": 9.2590000000000006e-05 2023-08-01T19:56:29.015 INFO:teuthology.orchestra.run.smithi155.stdout: }, 2023-08-01T19:56:29.015 INFO:teuthology.orchestra.run.smithi155.stdout: { 2023-08-01T19:56:29.015 INFO:teuthology.orchestra.run.smithi155.stdout: "event": "waiting for subops from 0", 2023-08-01T19:56:29.015 INFO:teuthology.orchestra.run.smithi155.stdout: "time": "2023-08-01T19:55:05.579825+0000", 2023-08-01T19:56:29.015 INFO:teuthology.orchestra.run.smithi155.stdout: "duration": 9.0964999999999994e-05 2023-08-01T19:56:29.015 INFO:teuthology.orchestra.run.smithi155.stdout: }, 2023-08-01T19:56:29.015 INFO:teuthology.orchestra.run.smithi155.stdout: { 2023-08-01T19:56:29.016 INFO:teuthology.orchestra.run.smithi155.stdout: "event": "op_commit", 2023-08-01T19:56:29.016 INFO:teuthology.orchestra.run.smithi155.stdout: "time": "2023-08-01T19:55:05.585041+0000", 2023-08-01T19:56:29.016 INFO:teuthology.orchestra.run.smithi155.stdout: "duration": 0.0052159670000000002 2023-08-01T19:56:29.016 INFO:teuthology.orchestra.run.smithi155.stdout: }, 2023-08-01T19:56:29.016 INFO:teuthology.orchestra.run.smithi155.stdout: { 2023-08-01T19:56:29.016 INFO:teuthology.orchestra.run.smithi155.stdout: "event": "sub_op_commit_rec", 2023-08-01T19:56:29.016 INFO:teuthology.orchestra.run.smithi155.stdout: "time": "2023-08-01T19:55:05.635199+0000", 2023-08-01T19:56:29.017 INFO:teuthology.orchestra.run.smithi155.stdout: "duration": 0.050158023000000003 2023-08-01T19:56:29.017 INFO:teuthology.orchestra.run.smithi155.stdout: }, 2023-08-01T19:56:29.017 INFO:teuthology.orchestra.run.smithi155.stdout: { 2023-08-01T19:56:29.017 INFO:teuthology.orchestra.run.smithi155.stdout: "event": "commit_sent", 2023-08-01T19:56:29.017 INFO:teuthology.orchestra.run.smithi155.stdout: "time": "2023-08-01T19:55:05.635227+0000", 2023-08-01T19:56:29.017 INFO:teuthology.orchestra.run.smithi155.stdout: "duration": 2.7821e-05 2023-08-01T19:56:29.017 INFO:teuthology.orchestra.run.smithi155.stdout: }, 2023-08-01T19:56:29.017 INFO:teuthology.orchestra.run.smithi155.stdout: { 2023-08-01T19:56:29.018 INFO:teuthology.orchestra.run.smithi155.stdout: "event": "done", 2023-08-01T19:56:29.018 INFO:teuthology.orchestra.run.smithi155.stdout: "time": "2023-08-01T19:55:05.635263+0000", 2023-08-01T19:56:29.018 INFO:teuthology.orchestra.run.smithi155.stdout: "duration": 3.6081000000000002e-05 2023-08-01T19:56:29.018 INFO:teuthology.orchestra.run.smithi155.stdout: } 2023-08-01T19:56:29.018 INFO:teuthology.orchestra.run.smithi155.stdout: ] 2023-08-01T19:56:29.018 INFO:teuthology.orchestra.run.smithi155.stdout: } 2023-08-01T19:56:29.018 INFO:teuthology.orchestra.run.smithi155.stdout: }, 2023-08-01T19:56:29.018 INFO:teuthology.orchestra.run.smithi155.stdout: { 2023-08-01T19:56:29.019 INFO:teuthology.orchestra.run.smithi155.stdout: "description": "osd_op(client.4668.0:197408 5.d 5:bbda375a:::benchmark_data_smithi006_114134_object63747:head [delete] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e61)", 2023-08-01T19:56:29.019 INFO:teuthology.orchestra.run.smithi155.stdout: "initiated_at": "2023-08-01T19:55:58.559714+0000", 2023-08-01T19:56:29.019 INFO:teuthology.orchestra.run.smithi155.stdout: "age": 30.300508133000001, 2023-08-01T19:56:29.019 INFO:teuthology.orchestra.run.smithi155.stdout: "duration": 1.047043671, 2023-08-01T19:56:29.019 INFO:teuthology.orchestra.run.smithi155.stdout: "type_data": { 2023-08-01T19:56:29.019 INFO:teuthology.orchestra.run.smithi155.stdout: "flag_point": "commit sent; apply or cleanup", 2023-08-01T19:56:29.019 INFO:teuthology.orchestra.run.smithi155.stdout: "client_info": { 2023-08-01T19:56:29.019 INFO:teuthology.orchestra.run.smithi155.stdout: "client": "client.4668", 2023-08-01T19:56:29.020 INFO:teuthology.orchestra.run.smithi155.stdout: "client_addr": "172.21.15.6:0/1709472247", 2023-08-01T19:56:29.020 INFO:teuthology.orchestra.run.smithi155.stdout: "tid": 197408 2023-08-01T19:56:29.020 INFO:teuthology.orchestra.run.smithi155.stdout: }, 2023-08-01T19:56:29.020 INFO:teuthology.orchestra.run.smithi155.stdout: "events": [ 2023-08-01T19:56:29.020 INFO:teuthology.orchestra.run.smithi155.stdout: { 2023-08-01T19:56:29.020 INFO:teuthology.orchestra.run.smithi155.stdout: "event": "initiated", 2023-08-01T19:56:29.020 INFO:teuthology.orchestra.run.smithi155.stdout: "time": "2023-08-01T19:55:58.559714+0000", 2023-08-01T19:56:29.021 INFO:teuthology.orchestra.run.smithi155.stdout: "duration": 0 2023-08-01T19:56:29.021 INFO:teuthology.orchestra.run.smithi155.stdout: }, 2023-08-01T19:56:29.021 INFO:teuthology.orchestra.run.smithi155.stdout: { 2023-08-01T19:56:29.021 INFO:teuthology.orchestra.run.smithi155.stdout: "event": "throttled", 2023-08-01T19:56:29.021 INFO:teuthology.orchestra.run.smithi155.stdout: "time": "2023-08-01T19:55:58.559714+0000", 2023-08-01T19:56:29.021 INFO:teuthology.orchestra.run.smithi155.stdout: "duration": 0 2023-08-01T19:56:29.021 INFO:teuthology.orchestra.run.smithi155.stdout: }, 2023-08-01T19:56:29.021 INFO:teuthology.orchestra.run.smithi155.stdout: { 2023-08-01T19:56:29.022 INFO:teuthology.orchestra.run.smithi155.stdout: "event": "header_read", 2023-08-01T19:56:29.022 INFO:teuthology.orchestra.run.smithi155.stdout: "time": "2023-08-01T19:55:58.559713+0000", 2023-08-01T19:56:29.022 INFO:teuthology.orchestra.run.smithi155.stdout: "duration": 4294967295.999999 2023-08-01T19:56:29.022 INFO:teuthology.orchestra.run.smithi155.stdout: }, 2023-08-01T19:56:29.022 INFO:teuthology.orchestra.run.smithi155.stdout: { 2023-08-01T19:56:29.022 INFO:teuthology.orchestra.run.smithi155.stdout: "event": "all_read", 2023-08-01T19:56:29.022 INFO:teuthology.orchestra.run.smithi155.stdout: "time": "2023-08-01T19:55:58.559717+0000", 2023-08-01T19:56:29.022 INFO:teuthology.orchestra.run.smithi155.stdout: "duration": 4.2860000000000001e-06 2023-08-01T19:56:29.023 INFO:teuthology.orchestra.run.smithi155.stdout: }, 2023-08-01T19:56:29.023 INFO:teuthology.orchestra.run.smithi155.stdout: { 2023-08-01T19:56:29.023 INFO:teuthology.orchestra.run.smithi155.stdout: "event": "dispatched", 2023-08-01T19:56:29.023 INFO:teuthology.orchestra.run.smithi155.stdout: "time": "2023-08-01T19:55:58.559774+0000", 2023-08-01T19:56:29.023 INFO:teuthology.orchestra.run.smithi155.stdout: "duration": 5.6508999999999997e-05 2023-08-01T19:56:29.023 INFO:teuthology.orchestra.run.smithi155.stdout: }, 2023-08-01T19:56:29.023 INFO:teuthology.orchestra.run.smithi155.stdout: { 2023-08-01T19:56:29.023 INFO:teuthology.orchestra.run.smithi155.stdout: "event": "queued_for_pg", 2023-08-01T19:56:29.024 INFO:teuthology.orchestra.run.smithi155.stdout: "time": "2023-08-01T19:55:58.559781+0000", 2023-08-01T19:56:29.024 INFO:teuthology.orchestra.run.smithi155.stdout: "duration": 7.1829999999999997e-06 2023-08-01T19:56:29.024 INFO:teuthology.orchestra.run.smithi155.stdout: }, 2023-08-01T19:56:29.024 INFO:teuthology.orchestra.run.smithi155.stdout: { 2023-08-01T19:56:29.024 INFO:teuthology.orchestra.run.smithi155.stdout: "event": "reached_pg", 2023-08-01T19:56:29.024 INFO:teuthology.orchestra.run.smithi155.stdout: "time": "2023-08-01T19:55:58.571621+0000", 2023-08-01T19:56:29.024 INFO:teuthology.orchestra.run.smithi155.stdout: "duration": 0.011840603999999999 2023-08-01T19:56:29.024 INFO:teuthology.orchestra.run.smithi155.stdout: }, 2023-08-01T19:56:29.025 INFO:teuthology.orchestra.run.smithi155.stdout: { 2023-08-01T19:56:29.025 INFO:teuthology.orchestra.run.smithi155.stdout: "event": "waiting for peered", 2023-08-01T19:56:29.025 INFO:teuthology.orchestra.run.smithi155.stdout: "time": "2023-08-01T19:55:58.571630+0000", 2023-08-01T19:56:29.025 INFO:teuthology.orchestra.run.smithi155.stdout: "duration": 8.9770000000000006e-06 2023-08-01T19:56:29.025 INFO:teuthology.orchestra.run.smithi155.stdout: }, 2023-08-01T19:56:29.025 INFO:teuthology.orchestra.run.smithi155.stdout: { 2023-08-01T19:56:29.025 INFO:teuthology.orchestra.run.smithi155.stdout: "event": "reached_pg", 2023-08-01T19:56:29.026 INFO:teuthology.orchestra.run.smithi155.stdout: "time": "2023-08-01T19:55:59.601300+0000", 2023-08-01T19:56:29.026 INFO:teuthology.orchestra.run.smithi155.stdout: "duration": 1.0296694989999999 2023-08-01T19:56:29.026 INFO:teuthology.orchestra.run.smithi155.stdout: }, 2023-08-01T19:56:29.026 INFO:teuthology.orchestra.run.smithi155.stdout: { 2023-08-01T19:56:29.026 INFO:teuthology.orchestra.run.smithi155.stdout: "event": "started", 2023-08-01T19:56:29.026 INFO:teuthology.orchestra.run.smithi155.stdout: "time": "2023-08-01T19:55:59.601448+0000", 2023-08-01T19:56:29.026 INFO:teuthology.orchestra.run.smithi155.stdout: "duration": 0.00014828399999999999 2023-08-01T19:56:29.026 INFO:teuthology.orchestra.run.smithi155.stdout: }, 2023-08-01T19:56:29.027 INFO:teuthology.orchestra.run.smithi155.stdout: { 2023-08-01T19:56:29.027 INFO:teuthology.orchestra.run.smithi155.stdout: "event": "op_commit", 2023-08-01T19:56:29.027 INFO:teuthology.orchestra.run.smithi155.stdout: "time": "2023-08-01T19:55:59.606616+0000", 2023-08-01T19:56:29.027 INFO:teuthology.orchestra.run.smithi155.stdout: "duration": 0.0051679769999999998 2023-08-01T19:56:29.027 INFO:teuthology.orchestra.run.smithi155.stdout: }, 2023-08-01T19:56:29.027 INFO:teuthology.orchestra.run.smithi155.stdout: { 2023-08-01T19:56:29.027 INFO:teuthology.orchestra.run.smithi155.stdout: "event": "commit_sent", 2023-08-01T19:56:29.027 INFO:teuthology.orchestra.run.smithi155.stdout: "time": "2023-08-01T19:55:59.606662+0000", 2023-08-01T19:56:29.028 INFO:teuthology.orchestra.run.smithi155.stdout: "duration": 4.5843000000000001e-05 2023-08-01T19:56:29.028 INFO:teuthology.orchestra.run.smithi155.stdout: }, 2023-08-01T19:56:29.028 INFO:teuthology.orchestra.run.smithi155.stdout: { 2023-08-01T19:56:29.028 INFO:teuthology.orchestra.run.smithi155.stdout: "event": "done", 2023-08-01T19:56:29.028 INFO:teuthology.orchestra.run.smithi155.stdout: "time": "2023-08-01T19:55:59.606757+0000", 2023-08-01T19:56:29.028 INFO:teuthology.orchestra.run.smithi155.stdout: "duration": 9.5373999999999999e-05 2023-08-01T19:56:29.028 INFO:teuthology.orchestra.run.smithi155.stdout: } 2023-08-01T19:56:29.028 INFO:teuthology.orchestra.run.smithi155.stdout: ] 2023-08-01T19:56:29.029 INFO:teuthology.orchestra.run.smithi155.stdout: } 2023-08-01T19:56:29.029 INFO:teuthology.orchestra.run.smithi155.stdout: }, 2023-08-01T19:56:29.029 INFO:teuthology.orchestra.run.smithi155.stdout: { 2023-08-01T19:56:29.029 INFO:teuthology.orchestra.run.smithi155.stdout: "description": "osd_op(client.4668.0:197416 5.d 5:bd99e66d:::benchmark_data_smithi006_114134_object63755:head [delete] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e62)", 2023-08-01T19:56:29.029 INFO:teuthology.orchestra.run.smithi155.stdout: "initiated_at": "2023-08-01T19:55:58.577369+0000", 2023-08-01T19:56:29.029 INFO:teuthology.orchestra.run.smithi155.stdout: "age": 30.282853156000002, 2023-08-01T19:56:29.029 INFO:teuthology.orchestra.run.smithi155.stdout: "duration": 1.0300980120000001, 2023-08-01T19:56:29.030 INFO:teuthology.orchestra.run.smithi155.stdout: "type_data": { 2023-08-01T19:56:29.030 INFO:teuthology.orchestra.run.smithi155.stdout: "flag_point": "commit sent; apply or cleanup", 2023-08-01T19:56:29.030 INFO:teuthology.orchestra.run.smithi155.stdout: "client_info": { 2023-08-01T19:56:29.030 INFO:teuthology.orchestra.run.smithi155.stdout: "client": "client.4668", 2023-08-01T19:56:29.030 INFO:teuthology.orchestra.run.smithi155.stdout: "client_addr": "172.21.15.6:0/1709472247", 2023-08-01T19:56:29.030 INFO:teuthology.orchestra.run.smithi155.stdout: "tid": 197416 2023-08-01T19:56:29.030 INFO:teuthology.orchestra.run.smithi155.stdout: }, 2023-08-01T19:56:29.030 INFO:teuthology.orchestra.run.smithi155.stdout: "events": [ 2023-08-01T19:56:29.031 INFO:teuthology.orchestra.run.smithi155.stdout: { 2023-08-01T19:56:29.031 INFO:teuthology.orchestra.run.smithi155.stdout: "event": "initiated", 2023-08-01T19:56:29.031 INFO:teuthology.orchestra.run.smithi155.stdout: "time": "2023-08-01T19:55:58.577369+0000", 2023-08-01T19:56:29.031 INFO:teuthology.orchestra.run.smithi155.stdout: "duration": 0 2023-08-01T19:56:29.031 INFO:teuthology.orchestra.run.smithi155.stdout: }, 2023-08-01T19:56:29.031 INFO:teuthology.orchestra.run.smithi155.stdout: { 2023-08-01T19:56:29.031 INFO:teuthology.orchestra.run.smithi155.stdout: "event": "throttled", 2023-08-01T19:56:29.031 INFO:teuthology.orchestra.run.smithi155.stdout: "time": "2023-08-01T19:55:58.577369+0000", 2023-08-01T19:56:29.032 INFO:teuthology.orchestra.run.smithi155.stdout: "duration": 0 2023-08-01T19:56:29.032 INFO:teuthology.orchestra.run.smithi155.stdout: }, 2023-08-01T19:56:29.032 INFO:teuthology.orchestra.run.smithi155.stdout: { 2023-08-01T19:56:29.032 INFO:teuthology.orchestra.run.smithi155.stdout: "event": "header_read", 2023-08-01T19:56:29.032 INFO:teuthology.orchestra.run.smithi155.stdout: "time": "2023-08-01T19:55:58.577368+0000", 2023-08-01T19:56:29.032 INFO:teuthology.orchestra.run.smithi155.stdout: "duration": 4294967295.9999995 2023-08-01T19:56:29.032 INFO:teuthology.orchestra.run.smithi155.stdout: }, 2023-08-01T19:56:29.032 INFO:teuthology.orchestra.run.smithi155.stdout: { 2023-08-01T19:56:29.033 INFO:teuthology.orchestra.run.smithi155.stdout: "event": "all_read", 2023-08-01T19:56:29.033 INFO:teuthology.orchestra.run.smithi155.stdout: "time": "2023-08-01T19:55:58.577370+0000", 2023-08-01T19:56:29.033 INFO:teuthology.orchestra.run.smithi155.stdout: "duration": 2.1150000000000001e-06 2023-08-01T19:56:29.033 INFO:teuthology.orchestra.run.smithi155.stdout: }, 2023-08-01T19:56:29.033 INFO:teuthology.orchestra.run.smithi155.stdout: { 2023-08-01T19:56:29.033 INFO:teuthology.orchestra.run.smithi155.stdout: "event": "dispatched", 2023-08-01T19:56:29.033 INFO:teuthology.orchestra.run.smithi155.stdout: "time": "2023-08-01T19:55:58.577377+0000", 2023-08-01T19:56:29.033 INFO:teuthology.orchestra.run.smithi155.stdout: "duration": 6.6610000000000003e-06 2023-08-01T19:56:29.034 INFO:teuthology.orchestra.run.smithi155.stdout: }, 2023-08-01T19:56:29.034 INFO:teuthology.orchestra.run.smithi155.stdout: { 2023-08-01T19:56:29.034 INFO:teuthology.orchestra.run.smithi155.stdout: "event": "queued_for_pg", 2023-08-01T19:56:29.034 INFO:teuthology.orchestra.run.smithi155.stdout: "time": "2023-08-01T19:55:58.577380+0000", 2023-08-01T19:56:29.034 INFO:teuthology.orchestra.run.smithi155.stdout: "duration": 2.7360000000000001e-06 2023-08-01T19:56:29.034 INFO:teuthology.orchestra.run.smithi155.stdout: }, 2023-08-01T19:56:29.034 INFO:teuthology.orchestra.run.smithi155.stdout: { 2023-08-01T19:56:29.034 INFO:teuthology.orchestra.run.smithi155.stdout: "event": "reached_pg", 2023-08-01T19:56:29.035 INFO:teuthology.orchestra.run.smithi155.stdout: "time": "2023-08-01T19:55:58.577405+0000", 2023-08-01T19:56:29.035 INFO:teuthology.orchestra.run.smithi155.stdout: "duration": 2.4929000000000001e-05 2023-08-01T19:56:29.035 INFO:teuthology.orchestra.run.smithi155.stdout: }, 2023-08-01T19:56:29.035 INFO:teuthology.orchestra.run.smithi155.stdout: { 2023-08-01T19:56:29.035 INFO:teuthology.orchestra.run.smithi155.stdout: "event": "waiting for peered", 2023-08-01T19:56:29.035 INFO:teuthology.orchestra.run.smithi155.stdout: "time": "2023-08-01T19:55:58.577409+0000", 2023-08-01T19:56:29.035 INFO:teuthology.orchestra.run.smithi155.stdout: "duration": 4.0799999999999999e-06 2023-08-01T19:56:29.036 INFO:teuthology.orchestra.run.smithi155.stdout: }, 2023-08-01T19:56:29.036 INFO:teuthology.orchestra.run.smithi155.stdout: { 2023-08-01T19:56:29.036 INFO:teuthology.orchestra.run.smithi155.stdout: "event": "reached_pg", 2023-08-01T19:56:29.036 INFO:teuthology.orchestra.run.smithi155.stdout: "time": "2023-08-01T19:55:59.603639+0000", 2023-08-01T19:56:29.036 INFO:teuthology.orchestra.run.smithi155.stdout: "duration": 1.0262299349999999 2023-08-01T19:56:29.036 INFO:teuthology.orchestra.run.smithi155.stdout: }, 2023-08-01T19:56:29.036 INFO:teuthology.orchestra.run.smithi155.stdout: { 2023-08-01T19:56:29.036 INFO:teuthology.orchestra.run.smithi155.stdout: "event": "started", 2023-08-01T19:56:29.037 INFO:teuthology.orchestra.run.smithi155.stdout: "time": "2023-08-01T19:55:59.603772+0000", 2023-08-01T19:56:29.037 INFO:teuthology.orchestra.run.smithi155.stdout: "duration": 0.000133153 2023-08-01T19:56:29.037 INFO:teuthology.orchestra.run.smithi155.stdout: }, 2023-08-01T19:56:29.037 INFO:teuthology.orchestra.run.smithi155.stdout: { 2023-08-01T19:56:29.037 INFO:teuthology.orchestra.run.smithi155.stdout: "event": "op_commit", 2023-08-01T19:56:29.037 INFO:teuthology.orchestra.run.smithi155.stdout: "time": "2023-08-01T19:55:59.607354+0000", 2023-08-01T19:56:29.037 INFO:teuthology.orchestra.run.smithi155.stdout: "duration": 0.0035819599999999999 2023-08-01T19:56:29.037 INFO:teuthology.orchestra.run.smithi155.stdout: }, 2023-08-01T19:56:29.038 INFO:teuthology.orchestra.run.smithi155.stdout: { 2023-08-01T19:56:29.038 INFO:teuthology.orchestra.run.smithi155.stdout: "event": "commit_sent", 2023-08-01T19:56:29.038 INFO:teuthology.orchestra.run.smithi155.stdout: "time": "2023-08-01T19:55:59.607396+0000", 2023-08-01T19:56:29.038 INFO:teuthology.orchestra.run.smithi155.stdout: "duration": 4.2423999999999999e-05 2023-08-01T19:56:29.038 INFO:teuthology.orchestra.run.smithi155.stdout: }, 2023-08-01T19:56:29.038 INFO:teuthology.orchestra.run.smithi155.stdout: { 2023-08-01T19:56:29.038 INFO:teuthology.orchestra.run.smithi155.stdout: "event": "done", 2023-08-01T19:56:29.038 INFO:teuthology.orchestra.run.smithi155.stdout: "time": "2023-08-01T19:55:59.607467+0000", 2023-08-01T19:56:29.039 INFO:teuthology.orchestra.run.smithi155.stdout: "duration": 7.0360999999999999e-05 2023-08-01T19:56:29.039 INFO:teuthology.orchestra.run.smithi155.stdout: } 2023-08-01T19:56:29.039 INFO:teuthology.orchestra.run.smithi155.stdout: ] 2023-08-01T19:56:29.039 INFO:teuthology.orchestra.run.smithi155.stdout: } 2023-08-01T19:56:29.039 INFO:teuthology.orchestra.run.smithi155.stdout: }, 2023-08-01T19:56:29.039 INFO:teuthology.orchestra.run.smithi155.stdout: { 2023-08-01T19:56:29.039 INFO:teuthology.orchestra.run.smithi155.stdout: "description": "osd_op(client.4668.0:197419 5.d 5:be7dc7c9:::benchmark_data_smithi006_114134_object63758:head [delete] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e62)", 2023-08-01T19:56:29.040 INFO:teuthology.orchestra.run.smithi155.stdout: "initiated_at": "2023-08-01T19:55:58.580223+0000", 2023-08-01T19:56:29.040 INFO:teuthology.orchestra.run.smithi155.stdout: "age": 30.279999204999999, 2023-08-01T19:56:29.040 INFO:teuthology.orchestra.run.smithi155.stdout: "duration": 1.0286139439999999, 2023-08-01T19:56:29.040 INFO:teuthology.orchestra.run.smithi155.stdout: "type_data": { 2023-08-01T19:56:29.040 INFO:teuthology.orchestra.run.smithi155.stdout: "flag_point": "commit sent; apply or cleanup", 2023-08-01T19:56:29.040 INFO:teuthology.orchestra.run.smithi155.stdout: "client_info": { 2023-08-01T19:56:29.040 INFO:teuthology.orchestra.run.smithi155.stdout: "client": "client.4668", 2023-08-01T19:56:29.040 INFO:teuthology.orchestra.run.smithi155.stdout: "client_addr": "172.21.15.6:0/1709472247", 2023-08-01T19:56:29.041 INFO:teuthology.orchestra.run.smithi155.stdout: "tid": 197419 2023-08-01T19:56:29.041 INFO:teuthology.orchestra.run.smithi155.stdout: }, 2023-08-01T19:56:29.041 INFO:teuthology.orchestra.run.smithi155.stdout: "events": [ 2023-08-01T19:56:29.041 INFO:teuthology.orchestra.run.smithi155.stdout: { 2023-08-01T19:56:29.041 INFO:teuthology.orchestra.run.smithi155.stdout: "event": "initiated", 2023-08-01T19:56:29.041 INFO:teuthology.orchestra.run.smithi155.stdout: "time": "2023-08-01T19:55:58.580223+0000", 2023-08-01T19:56:29.041 INFO:teuthology.orchestra.run.smithi155.stdout: "duration": 0 2023-08-01T19:56:29.041 INFO:teuthology.orchestra.run.smithi155.stdout: }, 2023-08-01T19:56:29.042 INFO:teuthology.orchestra.run.smithi155.stdout: { 2023-08-01T19:56:29.042 INFO:teuthology.orchestra.run.smithi155.stdout: "event": "throttled", 2023-08-01T19:56:29.042 INFO:teuthology.orchestra.run.smithi155.stdout: "time": "2023-08-01T19:55:58.580223+0000", 2023-08-01T19:56:29.042 INFO:teuthology.orchestra.run.smithi155.stdout: "duration": 0 2023-08-01T19:56:29.042 INFO:teuthology.orchestra.run.smithi155.stdout: }, 2023-08-01T19:56:29.042 INFO:teuthology.orchestra.run.smithi155.stdout: { 2023-08-01T19:56:29.042 INFO:teuthology.orchestra.run.smithi155.stdout: "event": "header_read", 2023-08-01T19:56:29.042 INFO:teuthology.orchestra.run.smithi155.stdout: "time": "2023-08-01T19:55:58.580222+0000", 2023-08-01T19:56:29.043 INFO:teuthology.orchestra.run.smithi155.stdout: "duration": 4294967295.9999995 2023-08-01T19:56:29.043 INFO:teuthology.orchestra.run.smithi155.stdout: }, 2023-08-01T19:56:29.043 INFO:teuthology.orchestra.run.smithi155.stdout: { 2023-08-01T19:56:29.043 INFO:teuthology.orchestra.run.smithi155.stdout: "event": "all_read", 2023-08-01T19:56:29.043 INFO:teuthology.orchestra.run.smithi155.stdout: "time": "2023-08-01T19:55:58.580225+0000", 2023-08-01T19:56:29.043 INFO:teuthology.orchestra.run.smithi155.stdout: "duration": 3.2820000000000001e-06 2023-08-01T19:56:29.043 INFO:teuthology.orchestra.run.smithi155.stdout: }, 2023-08-01T19:56:29.043 INFO:teuthology.orchestra.run.smithi155.stdout: { 2023-08-01T19:56:29.044 INFO:teuthology.orchestra.run.smithi155.stdout: "event": "dispatched", 2023-08-01T19:56:29.044 INFO:teuthology.orchestra.run.smithi155.stdout: "time": "2023-08-01T19:55:58.580233+0000", 2023-08-01T19:56:29.044 INFO:teuthology.orchestra.run.smithi155.stdout: "duration": 7.34e-06 2023-08-01T19:56:29.044 INFO:teuthology.orchestra.run.smithi155.stdout: }, 2023-08-01T19:56:29.044 INFO:teuthology.orchestra.run.smithi155.stdout: { 2023-08-01T19:56:29.044 INFO:teuthology.orchestra.run.smithi155.stdout: "event": "queued_for_pg", 2023-08-01T19:56:29.044 INFO:teuthology.orchestra.run.smithi155.stdout: "time": "2023-08-01T19:55:58.580236+0000", 2023-08-01T19:56:29.045 INFO:teuthology.orchestra.run.smithi155.stdout: "duration": 3.473e-06 2023-08-01T19:56:29.045 INFO:teuthology.orchestra.run.smithi155.stdout: }, 2023-08-01T19:56:29.045 INFO:teuthology.orchestra.run.smithi155.stdout: { 2023-08-01T19:56:29.045 INFO:teuthology.orchestra.run.smithi155.stdout: "event": "reached_pg", 2023-08-01T19:56:29.045 INFO:teuthology.orchestra.run.smithi155.stdout: "time": "2023-08-01T19:55:58.580267+0000", 2023-08-01T19:56:29.045 INFO:teuthology.orchestra.run.smithi155.stdout: "duration": 3.0479000000000001e-05 2023-08-01T19:56:29.045 INFO:teuthology.orchestra.run.smithi155.stdout: }, 2023-08-01T19:56:29.045 INFO:teuthology.orchestra.run.smithi155.stdout: { 2023-08-01T19:56:29.046 INFO:teuthology.orchestra.run.smithi155.stdout: "event": "waiting for peered", 2023-08-01T19:56:29.046 INFO:teuthology.orchestra.run.smithi155.stdout: "time": "2023-08-01T19:55:58.580272+0000", 2023-08-01T19:56:29.046 INFO:teuthology.orchestra.run.smithi155.stdout: "duration": 5.011e-06 2023-08-01T19:56:29.046 INFO:teuthology.orchestra.run.smithi155.stdout: }, 2023-08-01T19:56:29.046 INFO:teuthology.orchestra.run.smithi155.stdout: { 2023-08-01T19:56:29.046 INFO:teuthology.orchestra.run.smithi155.stdout: "event": "reached_pg", 2023-08-01T19:56:29.046 INFO:teuthology.orchestra.run.smithi155.stdout: "time": "2023-08-01T19:55:59.604970+0000", 2023-08-01T19:56:29.046 INFO:teuthology.orchestra.run.smithi155.stdout: "duration": 1.0246984189999999 2023-08-01T19:56:29.047 INFO:teuthology.orchestra.run.smithi155.stdout: }, 2023-08-01T19:56:29.047 INFO:teuthology.orchestra.run.smithi155.stdout: { 2023-08-01T19:56:29.047 INFO:teuthology.orchestra.run.smithi155.stdout: "event": "started", 2023-08-01T19:56:29.047 INFO:teuthology.orchestra.run.smithi155.stdout: "time": "2023-08-01T19:55:59.605085+0000", 2023-08-01T19:56:29.047 INFO:teuthology.orchestra.run.smithi155.stdout: "duration": 0.00011531000000000001 2023-08-01T19:56:29.047 INFO:teuthology.orchestra.run.smithi155.stdout: }, 2023-08-01T19:56:29.047 INFO:teuthology.orchestra.run.smithi155.stdout: { 2023-08-01T19:56:29.047 INFO:teuthology.orchestra.run.smithi155.stdout: "event": "op_commit", 2023-08-01T19:56:29.048 INFO:teuthology.orchestra.run.smithi155.stdout: "time": "2023-08-01T19:55:59.608733+0000", 2023-08-01T19:56:29.048 INFO:teuthology.orchestra.run.smithi155.stdout: "duration": 0.0036478090000000001 2023-08-01T19:56:29.048 INFO:teuthology.orchestra.run.smithi155.stdout: }, 2023-08-01T19:56:29.048 INFO:teuthology.orchestra.run.smithi155.stdout: { 2023-08-01T19:56:29.048 INFO:teuthology.orchestra.run.smithi155.stdout: "event": "commit_sent", 2023-08-01T19:56:29.048 INFO:teuthology.orchestra.run.smithi155.stdout: "time": "2023-08-01T19:55:59.608771+0000", 2023-08-01T19:56:29.048 INFO:teuthology.orchestra.run.smithi155.stdout: "duration": 3.8033e-05 2023-08-01T19:56:29.049 INFO:teuthology.orchestra.run.smithi155.stdout: }, 2023-08-01T19:56:29.049 INFO:teuthology.orchestra.run.smithi155.stdout: { 2023-08-01T19:56:29.049 INFO:teuthology.orchestra.run.smithi155.stdout: "event": "done", 2023-08-01T19:56:29.049 INFO:teuthology.orchestra.run.smithi155.stdout: "time": "2023-08-01T19:55:59.608837+0000", 2023-08-01T19:56:29.049 INFO:teuthology.orchestra.run.smithi155.stdout: "duration": 6.5364000000000006e-05 2023-08-01T19:56:29.049 INFO:teuthology.orchestra.run.smithi155.stdout: } 2023-08-01T19:56:29.049 INFO:teuthology.orchestra.run.smithi155.stdout: ] 2023-08-01T19:56:29.049 INFO:teuthology.orchestra.run.smithi155.stdout: } 2023-08-01T19:56:29.050 INFO:teuthology.orchestra.run.smithi155.stdout: }, 2023-08-01T19:56:29.050 INFO:teuthology.orchestra.run.smithi155.stdout: { 2023-08-01T19:56:29.050 INFO:teuthology.orchestra.run.smithi155.stdout: "description": "osd_op(client.4668.0:197420 5.9 5:92a2efe5:::benchmark_data_smithi006_114134_object63759:head [delete] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e62)", 2023-08-01T19:56:29.050 INFO:teuthology.orchestra.run.smithi155.stdout: "initiated_at": "2023-08-01T19:55:58.582230+0000", 2023-08-01T19:56:29.050 INFO:teuthology.orchestra.run.smithi155.stdout: "age": 30.277991895, 2023-08-01T19:56:29.050 INFO:teuthology.orchestra.run.smithi155.stdout: "duration": 1.0095353739999999, 2023-08-01T19:56:29.050 INFO:teuthology.orchestra.run.smithi155.stdout: "type_data": { 2023-08-01T19:56:29.051 INFO:teuthology.orchestra.run.smithi155.stdout: "flag_point": "commit sent; apply or cleanup", 2023-08-01T19:56:29.051 INFO:teuthology.orchestra.run.smithi155.stdout: "client_info": { 2023-08-01T19:56:29.051 INFO:teuthology.orchestra.run.smithi155.stdout: "client": "client.4668", 2023-08-01T19:56:29.051 INFO:teuthology.orchestra.run.smithi155.stdout: "client_addr": "172.21.15.6:0/1709472247", 2023-08-01T19:56:29.051 INFO:teuthology.orchestra.run.smithi155.stdout: "tid": 197420 2023-08-01T19:56:29.051 INFO:teuthology.orchestra.run.smithi155.stdout: }, 2023-08-01T19:56:29.051 INFO:teuthology.orchestra.run.smithi155.stdout: "events": [ 2023-08-01T19:56:29.051 INFO:teuthology.orchestra.run.smithi155.stdout: { 2023-08-01T19:56:29.052 INFO:teuthology.orchestra.run.smithi155.stdout: "event": "initiated", 2023-08-01T19:56:29.052 INFO:teuthology.orchestra.run.smithi155.stdout: "time": "2023-08-01T19:55:58.582230+0000", 2023-08-01T19:56:29.052 INFO:teuthology.orchestra.run.smithi155.stdout: "duration": 0 2023-08-01T19:56:29.052 INFO:teuthology.orchestra.run.smithi155.stdout: }, 2023-08-01T19:56:29.052 INFO:teuthology.orchestra.run.smithi155.stdout: { 2023-08-01T19:56:29.052 INFO:teuthology.orchestra.run.smithi155.stdout: "event": "throttled", 2023-08-01T19:56:29.052 INFO:teuthology.orchestra.run.smithi155.stdout: "time": "2023-08-01T19:55:58.582230+0000", 2023-08-01T19:56:29.053 INFO:teuthology.orchestra.run.smithi155.stdout: "duration": 0 2023-08-01T19:56:29.053 INFO:teuthology.orchestra.run.smithi155.stdout: }, 2023-08-01T19:56:29.053 INFO:teuthology.orchestra.run.smithi155.stdout: { 2023-08-01T19:56:29.053 INFO:teuthology.orchestra.run.smithi155.stdout: "event": "header_read", 2023-08-01T19:56:29.053 INFO:teuthology.orchestra.run.smithi155.stdout: "time": "2023-08-01T19:55:58.582229+0000", 2023-08-01T19:56:29.053 INFO:teuthology.orchestra.run.smithi155.stdout: "duration": 4294967295.9999995 2023-08-01T19:56:29.053 INFO:teuthology.orchestra.run.smithi155.stdout: }, 2023-08-01T19:56:29.053 INFO:teuthology.orchestra.run.smithi155.stdout: { 2023-08-01T19:56:29.054 INFO:teuthology.orchestra.run.smithi155.stdout: "event": "all_read", 2023-08-01T19:56:29.054 INFO:teuthology.orchestra.run.smithi155.stdout: "time": "2023-08-01T19:55:58.582233+0000", 2023-08-01T19:56:29.054 INFO:teuthology.orchestra.run.smithi155.stdout: "duration": 3.7869999999999999e-06 2023-08-01T19:56:29.054 INFO:teuthology.orchestra.run.smithi155.stdout: }, 2023-08-01T19:56:29.054 INFO:teuthology.orchestra.run.smithi155.stdout: { 2023-08-01T19:56:29.054 INFO:teuthology.orchestra.run.smithi155.stdout: "event": "dispatched", 2023-08-01T19:56:29.054 INFO:teuthology.orchestra.run.smithi155.stdout: "time": "2023-08-01T19:55:58.582241+0000", 2023-08-01T19:56:29.054 INFO:teuthology.orchestra.run.smithi155.stdout: "duration": 7.6909999999999997e-06 2023-08-01T19:56:29.055 INFO:teuthology.orchestra.run.smithi155.stdout: }, 2023-08-01T19:56:29.055 INFO:teuthology.orchestra.run.smithi155.stdout: { 2023-08-01T19:56:29.055 INFO:teuthology.orchestra.run.smithi155.stdout: "event": "queued_for_pg", 2023-08-01T19:56:29.055 INFO:teuthology.orchestra.run.smithi155.stdout: "time": "2023-08-01T19:55:58.582244+0000", 2023-08-01T19:56:29.055 INFO:teuthology.orchestra.run.smithi155.stdout: "duration": 3.6770000000000001e-06 2023-08-01T19:56:29.055 INFO:teuthology.orchestra.run.smithi155.stdout: }, 2023-08-01T19:56:29.055 INFO:teuthology.orchestra.run.smithi155.stdout: { 2023-08-01T19:56:29.056 INFO:teuthology.orchestra.run.smithi155.stdout: "event": "reached_pg", 2023-08-01T19:56:29.056 INFO:teuthology.orchestra.run.smithi155.stdout: "time": "2023-08-01T19:55:58.582274+0000", 2023-08-01T19:56:29.056 INFO:teuthology.orchestra.run.smithi155.stdout: "duration": 3.0074e-05 2023-08-01T19:56:29.056 INFO:teuthology.orchestra.run.smithi155.stdout: }, 2023-08-01T19:56:29.056 INFO:teuthology.orchestra.run.smithi155.stdout: { 2023-08-01T19:56:29.056 INFO:teuthology.orchestra.run.smithi155.stdout: "event": "waiting for peered", 2023-08-01T19:56:29.056 INFO:teuthology.orchestra.run.smithi155.stdout: "time": "2023-08-01T19:55:58.582281+0000", 2023-08-01T19:56:29.056 INFO:teuthology.orchestra.run.smithi155.stdout: "duration": 6.297e-06 2023-08-01T19:56:29.057 INFO:teuthology.orchestra.run.smithi155.stdout: }, 2023-08-01T19:56:29.057 INFO:teuthology.orchestra.run.smithi155.stdout: { 2023-08-01T19:56:29.057 INFO:teuthology.orchestra.run.smithi155.stdout: "event": "reached_pg", 2023-08-01T19:56:29.057 INFO:teuthology.orchestra.run.smithi155.stdout: "time": "2023-08-01T19:55:59.586809+0000", 2023-08-01T19:56:29.057 INFO:teuthology.orchestra.run.smithi155.stdout: "duration": 1.0045281720000001 2023-08-01T19:56:29.057 INFO:teuthology.orchestra.run.smithi155.stdout: }, 2023-08-01T19:56:29.057 INFO:teuthology.orchestra.run.smithi155.stdout: { 2023-08-01T19:56:29.057 INFO:teuthology.orchestra.run.smithi155.stdout: "event": "started", 2023-08-01T19:56:29.058 INFO:teuthology.orchestra.run.smithi155.stdout: "time": "2023-08-01T19:55:59.586910+0000", 2023-08-01T19:56:29.058 INFO:teuthology.orchestra.run.smithi155.stdout: "duration": 0.000100898 2023-08-01T19:56:29.058 INFO:teuthology.orchestra.run.smithi155.stdout: }, 2023-08-01T19:56:29.058 INFO:teuthology.orchestra.run.smithi155.stdout: { 2023-08-01T19:56:29.058 INFO:teuthology.orchestra.run.smithi155.stdout: "event": "op_commit", 2023-08-01T19:56:29.058 INFO:teuthology.orchestra.run.smithi155.stdout: "time": "2023-08-01T19:55:59.591679+0000", 2023-08-01T19:56:29.058 INFO:teuthology.orchestra.run.smithi155.stdout: "duration": 0.004769471 2023-08-01T19:56:29.058 INFO:teuthology.orchestra.run.smithi155.stdout: }, 2023-08-01T19:56:29.059 INFO:teuthology.orchestra.run.smithi155.stdout: { 2023-08-01T19:56:29.059 INFO:teuthology.orchestra.run.smithi155.stdout: "event": "commit_sent", 2023-08-01T19:56:29.059 INFO:teuthology.orchestra.run.smithi155.stdout: "time": "2023-08-01T19:55:59.591721+0000", 2023-08-01T19:56:29.059 INFO:teuthology.orchestra.run.smithi155.stdout: "duration": 4.1953000000000003e-05 2023-08-01T19:56:29.059 INFO:teuthology.orchestra.run.smithi155.stdout: }, 2023-08-01T19:56:29.059 INFO:teuthology.orchestra.run.smithi155.stdout: { 2023-08-01T19:56:29.059 INFO:teuthology.orchestra.run.smithi155.stdout: "event": "done", 2023-08-01T19:56:29.059 INFO:teuthology.orchestra.run.smithi155.stdout: "time": "2023-08-01T19:55:59.591765+0000", 2023-08-01T19:56:29.060 INFO:teuthology.orchestra.run.smithi155.stdout: "duration": 4.4030999999999999e-05 2023-08-01T19:56:29.060 INFO:teuthology.orchestra.run.smithi155.stdout: } 2023-08-01T19:56:29.060 INFO:teuthology.orchestra.run.smithi155.stdout: ] 2023-08-01T19:56:29.060 INFO:teuthology.orchestra.run.smithi155.stdout: } 2023-08-01T19:56:29.060 INFO:teuthology.orchestra.run.smithi155.stdout: } 2023-08-01T19:56:29.060 INFO:teuthology.orchestra.run.smithi155.stdout: ] 2023-08-01T19:56:29.060 INFO:teuthology.orchestra.run.smithi155.stdout:} 2023-08-01T19:56:29.062 INFO:tasks.ceph.osd.2.smithi155.stderr:2023-08-01T19:56:29.060+0000 7faa5c6ac700 -1 received signal: Hangup from /usr/bin/python3 /bin/daemon-helper kill ceph-osd -f --cluster ceph -i 2 (PID: 111337) UID: 0 2023-08-01T19:56:29.062 DEBUG:teuthology.orchestra.run.smithi008:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 30 ceph --cluster ceph --admin-daemon /var/run/ceph/ceph-osd.0.asok dump_ops_in_flight 2023-08-01T19:56:29.076 DEBUG:teuthology.orchestra.run.smithi006:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 120 ceph --cluster ceph osd unset nodeep-scrub 2023-08-01T19:56:29.162 INFO:tasks.ceph.osd.0.smithi008.stderr:2023-08-01T19:56:29.161+0000 7f16a58f4700 -1 received signal: Hangup from /usr/bin/python3 /bin/daemon-helper kill ceph-osd -f --cluster ceph -i 0 (PID: 111179) UID: 0 2023-08-01T19:56:29.260 INFO:teuthology.orchestra.run.smithi008.stdout:{ 2023-08-01T19:56:29.260 INFO:teuthology.orchestra.run.smithi008.stdout: "ops": [ 2023-08-01T19:56:29.260 INFO:teuthology.orchestra.run.smithi008.stdout: { 2023-08-01T19:56:29.260 INFO:teuthology.orchestra.run.smithi008.stdout: "description": "osd_op(client.4668.0:256378 5.1 5:87359ebf:::benchmark_data_smithi006_114134_object122717:head [delete] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e75)", 2023-08-01T19:56:29.261 INFO:teuthology.orchestra.run.smithi008.stdout: "initiated_at": "2023-08-01T19:56:29.255414+0000", 2023-08-01T19:56:29.261 INFO:teuthology.orchestra.run.smithi008.stdout: "age": 0.0020415390000000002, 2023-08-01T19:56:29.261 INFO:teuthology.orchestra.run.smithi008.stdout: "duration": 0.0020693199999999999, 2023-08-01T19:56:29.261 INFO:teuthology.orchestra.run.smithi008.stdout: "type_data": { 2023-08-01T19:56:29.261 INFO:teuthology.orchestra.run.smithi008.stdout: "flag_point": "started", 2023-08-01T19:56:29.261 INFO:teuthology.orchestra.run.smithi008.stdout: "client_info": { 2023-08-01T19:56:29.261 INFO:teuthology.orchestra.run.smithi008.stdout: "client": "client.4668", 2023-08-01T19:56:29.261 INFO:teuthology.orchestra.run.smithi008.stdout: "client_addr": "172.21.15.6:0/1709472247", 2023-08-01T19:56:29.262 INFO:teuthology.orchestra.run.smithi008.stdout: "tid": 256378 2023-08-01T19:56:29.262 INFO:teuthology.orchestra.run.smithi008.stdout: }, 2023-08-01T19:56:29.262 INFO:teuthology.orchestra.run.smithi008.stdout: "events": [ 2023-08-01T19:56:29.262 INFO:teuthology.orchestra.run.smithi008.stdout: { 2023-08-01T19:56:29.262 INFO:teuthology.orchestra.run.smithi008.stdout: "event": "initiated", 2023-08-01T19:56:29.262 INFO:teuthology.orchestra.run.smithi008.stdout: "time": "2023-08-01T19:56:29.255414+0000", 2023-08-01T19:56:29.262 INFO:teuthology.orchestra.run.smithi008.stdout: "duration": 0 2023-08-01T19:56:29.262 INFO:teuthology.orchestra.run.smithi008.stdout: }, 2023-08-01T19:56:29.263 INFO:teuthology.orchestra.run.smithi008.stdout: { 2023-08-01T19:56:29.263 INFO:teuthology.orchestra.run.smithi008.stdout: "event": "throttled", 2023-08-01T19:56:29.263 INFO:teuthology.orchestra.run.smithi008.stdout: "time": "2023-08-01T19:56:29.255414+0000", 2023-08-01T19:56:29.263 INFO:teuthology.orchestra.run.smithi008.stdout: "duration": 0 2023-08-01T19:56:29.263 INFO:teuthology.orchestra.run.smithi008.stdout: }, 2023-08-01T19:56:29.263 INFO:teuthology.orchestra.run.smithi008.stdout: { 2023-08-01T19:56:29.263 INFO:teuthology.orchestra.run.smithi008.stdout: "event": "header_read", 2023-08-01T19:56:29.263 INFO:teuthology.orchestra.run.smithi008.stdout: "time": "2023-08-01T19:56:29.255414+0000", 2023-08-01T19:56:29.264 INFO:teuthology.orchestra.run.smithi008.stdout: "duration": 4294967295.9999995 2023-08-01T19:56:29.264 INFO:teuthology.orchestra.run.smithi008.stdout: }, 2023-08-01T19:56:29.264 INFO:teuthology.orchestra.run.smithi008.stdout: { 2023-08-01T19:56:29.264 INFO:teuthology.orchestra.run.smithi008.stdout: "event": "all_read", 2023-08-01T19:56:29.264 INFO:teuthology.orchestra.run.smithi008.stdout: "time": "2023-08-01T19:56:29.255417+0000", 2023-08-01T19:56:29.264 INFO:teuthology.orchestra.run.smithi008.stdout: "duration": 2.633e-06 2023-08-01T19:56:29.264 INFO:teuthology.orchestra.run.smithi008.stdout: }, 2023-08-01T19:56:29.265 INFO:teuthology.orchestra.run.smithi008.stdout: { 2023-08-01T19:56:29.265 INFO:teuthology.orchestra.run.smithi008.stdout: "event": "dispatched", 2023-08-01T19:56:29.265 INFO:teuthology.orchestra.run.smithi008.stdout: "time": "2023-08-01T19:56:29.255423+0000", 2023-08-01T19:56:29.265 INFO:teuthology.orchestra.run.smithi008.stdout: "duration": 6.5350000000000001e-06 2023-08-01T19:56:29.265 INFO:teuthology.orchestra.run.smithi008.stdout: }, 2023-08-01T19:56:29.265 INFO:teuthology.orchestra.run.smithi008.stdout: { 2023-08-01T19:56:29.265 INFO:teuthology.orchestra.run.smithi008.stdout: "event": "queued_for_pg", 2023-08-01T19:56:29.266 INFO:teuthology.orchestra.run.smithi008.stdout: "time": "2023-08-01T19:56:29.255427+0000", 2023-08-01T19:56:29.266 INFO:teuthology.orchestra.run.smithi008.stdout: "duration": 3.8809999999999998e-06 2023-08-01T19:56:29.266 INFO:teuthology.orchestra.run.smithi008.stdout: }, 2023-08-01T19:56:29.266 INFO:teuthology.orchestra.run.smithi008.stdout: { 2023-08-01T19:56:29.266 INFO:teuthology.orchestra.run.smithi008.stdout: "event": "reached_pg", 2023-08-01T19:56:29.266 INFO:teuthology.orchestra.run.smithi008.stdout: "time": "2023-08-01T19:56:29.255486+0000", 2023-08-01T19:56:29.266 INFO:teuthology.orchestra.run.smithi008.stdout: "duration": 5.8986000000000001e-05 2023-08-01T19:56:29.266 INFO:teuthology.orchestra.run.smithi008.stdout: }, 2023-08-01T19:56:29.267 INFO:teuthology.orchestra.run.smithi008.stdout: { 2023-08-01T19:56:29.267 INFO:teuthology.orchestra.run.smithi008.stdout: "event": "started", 2023-08-01T19:56:29.267 INFO:teuthology.orchestra.run.smithi008.stdout: "time": "2023-08-01T19:56:29.255609+0000", 2023-08-01T19:56:29.267 INFO:teuthology.orchestra.run.smithi008.stdout: "duration": 0.00012327200000000001 2023-08-01T19:56:29.267 INFO:teuthology.orchestra.run.smithi008.stdout: } 2023-08-01T19:56:29.267 INFO:teuthology.orchestra.run.smithi008.stdout: ] 2023-08-01T19:56:29.267 INFO:teuthology.orchestra.run.smithi008.stdout: } 2023-08-01T19:56:29.267 INFO:teuthology.orchestra.run.smithi008.stdout: }, 2023-08-01T19:56:29.268 INFO:teuthology.orchestra.run.smithi008.stdout: { 2023-08-01T19:56:29.268 INFO:teuthology.orchestra.run.smithi008.stdout: "description": "osd_repop(client.4668.0:256379 5.0 e75/19 5:0121fb15:::benchmark_data_smithi006_114134_object122718:head v 75'16290, mlcod=75'16287)", 2023-08-01T19:56:29.268 INFO:teuthology.orchestra.run.smithi008.stdout: "initiated_at": "2023-08-01T19:56:29.257384+0000", 2023-08-01T19:56:29.268 INFO:teuthology.orchestra.run.smithi008.stdout: "age": 7.2317999999999994e-05, 2023-08-01T19:56:29.268 INFO:teuthology.orchestra.run.smithi008.stdout: "duration": 0.00020310099999999999, 2023-08-01T19:56:29.268 INFO:teuthology.orchestra.run.smithi008.stdout: "type_data": { 2023-08-01T19:56:29.268 INFO:teuthology.orchestra.run.smithi008.stdout: "flag_point": "started", 2023-08-01T19:56:29.269 INFO:teuthology.orchestra.run.smithi008.stdout: "events": [ 2023-08-01T19:56:29.269 INFO:teuthology.orchestra.run.smithi008.stdout: { 2023-08-01T19:56:29.269 INFO:teuthology.orchestra.run.smithi008.stdout: "event": "initiated", 2023-08-01T19:56:29.269 INFO:teuthology.orchestra.run.smithi008.stdout: "time": "2023-08-01T19:56:29.257384+0000", 2023-08-01T19:56:29.269 INFO:teuthology.orchestra.run.smithi008.stdout: "duration": 0 2023-08-01T19:56:29.269 INFO:teuthology.orchestra.run.smithi008.stdout: }, 2023-08-01T19:56:29.269 INFO:teuthology.orchestra.run.smithi008.stdout: { 2023-08-01T19:56:29.269 INFO:teuthology.orchestra.run.smithi008.stdout: "event": "throttled", 2023-08-01T19:56:29.270 INFO:teuthology.orchestra.run.smithi008.stdout: "time": "2023-08-01T19:56:29.257384+0000", 2023-08-01T19:56:29.270 INFO:teuthology.orchestra.run.smithi008.stdout: "duration": 0 2023-08-01T19:56:29.270 INFO:teuthology.orchestra.run.smithi008.stdout: }, 2023-08-01T19:56:29.270 INFO:teuthology.orchestra.run.smithi008.stdout: { 2023-08-01T19:56:29.270 INFO:teuthology.orchestra.run.smithi008.stdout: "event": "header_read", 2023-08-01T19:56:29.270 INFO:teuthology.orchestra.run.smithi008.stdout: "time": "2023-08-01T19:56:29.257383+0000", 2023-08-01T19:56:29.270 INFO:teuthology.orchestra.run.smithi008.stdout: "duration": 4294967295.999999 2023-08-01T19:56:29.271 INFO:teuthology.orchestra.run.smithi008.stdout: }, 2023-08-01T19:56:29.271 INFO:teuthology.orchestra.run.smithi008.stdout: { 2023-08-01T19:56:29.271 INFO:teuthology.orchestra.run.smithi008.stdout: "event": "all_read", 2023-08-01T19:56:29.271 INFO:teuthology.orchestra.run.smithi008.stdout: "time": "2023-08-01T19:56:29.257391+0000", 2023-08-01T19:56:29.271 INFO:teuthology.orchestra.run.smithi008.stdout: "duration": 7.7980000000000006e-06 2023-08-01T19:56:29.271 INFO:teuthology.orchestra.run.smithi008.stdout: }, 2023-08-01T19:56:29.271 INFO:teuthology.orchestra.run.smithi008.stdout: { 2023-08-01T19:56:29.271 INFO:teuthology.orchestra.run.smithi008.stdout: "event": "dispatched", 2023-08-01T19:56:29.272 INFO:teuthology.orchestra.run.smithi008.stdout: "time": "2023-08-01T19:56:29.257401+0000", 2023-08-01T19:56:29.272 INFO:teuthology.orchestra.run.smithi008.stdout: "duration": 9.8949999999999993e-06 2023-08-01T19:56:29.272 INFO:teuthology.orchestra.run.smithi008.stdout: }, 2023-08-01T19:56:29.272 INFO:teuthology.orchestra.run.smithi008.stdout: { 2023-08-01T19:56:29.272 INFO:teuthology.orchestra.run.smithi008.stdout: "event": "queued_for_pg", 2023-08-01T19:56:29.272 INFO:teuthology.orchestra.run.smithi008.stdout: "time": "2023-08-01T19:56:29.257406+0000", 2023-08-01T19:56:29.272 INFO:teuthology.orchestra.run.smithi008.stdout: "duration": 5.5600000000000001e-06 2023-08-01T19:56:29.272 INFO:teuthology.orchestra.run.smithi008.stdout: }, 2023-08-01T19:56:29.273 INFO:teuthology.orchestra.run.smithi008.stdout: { 2023-08-01T19:56:29.273 INFO:teuthology.orchestra.run.smithi008.stdout: "event": "reached_pg", 2023-08-01T19:56:29.273 INFO:teuthology.orchestra.run.smithi008.stdout: "time": "2023-08-01T19:56:29.257438+0000", 2023-08-01T19:56:29.273 INFO:teuthology.orchestra.run.smithi008.stdout: "duration": 3.2005999999999998e-05 2023-08-01T19:56:29.273 INFO:teuthology.orchestra.run.smithi008.stdout: }, 2023-08-01T19:56:29.273 INFO:teuthology.orchestra.run.smithi008.stdout: { 2023-08-01T19:56:29.273 INFO:teuthology.orchestra.run.smithi008.stdout: "event": "started", 2023-08-01T19:56:29.274 INFO:teuthology.orchestra.run.smithi008.stdout: "time": "2023-08-01T19:56:29.257458+0000", 2023-08-01T19:56:29.274 INFO:teuthology.orchestra.run.smithi008.stdout: "duration": 2.0137999999999999e-05 2023-08-01T19:56:29.274 INFO:teuthology.orchestra.run.smithi008.stdout: } 2023-08-01T19:56:29.274 INFO:teuthology.orchestra.run.smithi008.stdout: ] 2023-08-01T19:56:29.274 INFO:teuthology.orchestra.run.smithi008.stdout: } 2023-08-01T19:56:29.274 INFO:teuthology.orchestra.run.smithi008.stdout: }, 2023-08-01T19:56:29.274 INFO:teuthology.orchestra.run.smithi008.stdout: { 2023-08-01T19:56:29.274 INFO:teuthology.orchestra.run.smithi008.stdout: "description": "osd_repop_reply(client.4668.0:256363 5.a e75/19)", 2023-08-01T19:56:29.275 INFO:teuthology.orchestra.run.smithi008.stdout: "initiated_at": "2023-08-01T19:56:29.257416+0000", 2023-08-01T19:56:29.275 INFO:teuthology.orchestra.run.smithi008.stdout: "age": 4.0048e-05, 2023-08-01T19:56:29.275 INFO:teuthology.orchestra.run.smithi008.stdout: "duration": 0.00024437699999999999, 2023-08-01T19:56:29.275 INFO:teuthology.orchestra.run.smithi008.stdout: "type_data": { 2023-08-01T19:56:29.275 INFO:teuthology.orchestra.run.smithi008.stdout: "flag_point": "queued for pg", 2023-08-01T19:56:29.275 INFO:teuthology.orchestra.run.smithi008.stdout: "events": [ 2023-08-01T19:56:29.275 INFO:teuthology.orchestra.run.smithi008.stdout: { 2023-08-01T19:56:29.275 INFO:teuthology.orchestra.run.smithi008.stdout: "event": "initiated", 2023-08-01T19:56:29.276 INFO:teuthology.orchestra.run.smithi008.stdout: "time": "2023-08-01T19:56:29.257416+0000", 2023-08-01T19:56:29.276 INFO:teuthology.orchestra.run.smithi008.stdout: "duration": 0 2023-08-01T19:56:29.276 INFO:teuthology.orchestra.run.smithi008.stdout: }, 2023-08-01T19:56:29.276 INFO:teuthology.orchestra.run.smithi008.stdout: { 2023-08-01T19:56:29.276 INFO:teuthology.orchestra.run.smithi008.stdout: "event": "throttled", 2023-08-01T19:56:29.276 INFO:teuthology.orchestra.run.smithi008.stdout: "time": "2023-08-01T19:56:29.257416+0000", 2023-08-01T19:56:29.276 INFO:teuthology.orchestra.run.smithi008.stdout: "duration": 0 2023-08-01T19:56:29.276 INFO:teuthology.orchestra.run.smithi008.stdout: }, 2023-08-01T19:56:29.277 INFO:teuthology.orchestra.run.smithi008.stdout: { 2023-08-01T19:56:29.277 INFO:teuthology.orchestra.run.smithi008.stdout: "event": "header_read", 2023-08-01T19:56:29.277 INFO:teuthology.orchestra.run.smithi008.stdout: "time": "2023-08-01T19:56:29.257416+0000", 2023-08-01T19:56:29.277 INFO:teuthology.orchestra.run.smithi008.stdout: "duration": 4294967295.9999995 2023-08-01T19:56:29.277 INFO:teuthology.orchestra.run.smithi008.stdout: }, 2023-08-01T19:56:29.277 INFO:teuthology.orchestra.run.smithi008.stdout: { 2023-08-01T19:56:29.277 INFO:teuthology.orchestra.run.smithi008.stdout: "event": "all_read", 2023-08-01T19:56:29.277 INFO:teuthology.orchestra.run.smithi008.stdout: "time": "2023-08-01T19:56:29.257419+0000", 2023-08-01T19:56:29.278 INFO:teuthology.orchestra.run.smithi008.stdout: "duration": 2.9560000000000002e-06 2023-08-01T19:56:29.278 INFO:teuthology.orchestra.run.smithi008.stdout: }, 2023-08-01T19:56:29.278 INFO:teuthology.orchestra.run.smithi008.stdout: { 2023-08-01T19:56:29.278 INFO:teuthology.orchestra.run.smithi008.stdout: "event": "dispatched", 2023-08-01T19:56:29.278 INFO:teuthology.orchestra.run.smithi008.stdout: "time": "2023-08-01T19:56:29.257426+0000", 2023-08-01T19:56:29.278 INFO:teuthology.orchestra.run.smithi008.stdout: "duration": 7.311e-06 2023-08-01T19:56:29.278 INFO:teuthology.orchestra.run.smithi008.stdout: }, 2023-08-01T19:56:29.278 INFO:teuthology.orchestra.run.smithi008.stdout: { 2023-08-01T19:56:29.279 INFO:teuthology.orchestra.run.smithi008.stdout: "event": "queued_for_pg", 2023-08-01T19:56:29.279 INFO:teuthology.orchestra.run.smithi008.stdout: "time": "2023-08-01T19:56:29.257440+0000", 2023-08-01T19:56:29.279 INFO:teuthology.orchestra.run.smithi008.stdout: "duration": 1.3890000000000001e-05 2023-08-01T19:56:29.279 INFO:teuthology.orchestra.run.smithi008.stdout: } 2023-08-01T19:56:29.279 INFO:teuthology.orchestra.run.smithi008.stdout: ] 2023-08-01T19:56:29.279 INFO:teuthology.orchestra.run.smithi008.stdout: } 2023-08-01T19:56:29.279 INFO:teuthology.orchestra.run.smithi008.stdout: }, 2023-08-01T19:56:29.280 INFO:teuthology.orchestra.run.smithi008.stdout: { 2023-08-01T19:56:29.280 INFO:teuthology.orchestra.run.smithi008.stdout: "description": "osd_repop_reply(client.4668.0:256365 5.8 e75/72)", 2023-08-01T19:56:29.280 INFO:teuthology.orchestra.run.smithi008.stdout: "initiated_at": "2023-08-01T19:56:29.257448+0000", 2023-08-01T19:56:29.280 INFO:teuthology.orchestra.run.smithi008.stdout: "age": 7.9279999999999993e-06, 2023-08-01T19:56:29.280 INFO:teuthology.orchestra.run.smithi008.stdout: "duration": 0.00026504300000000002, 2023-08-01T19:56:29.280 INFO:teuthology.orchestra.run.smithi008.stdout: "type_data": { 2023-08-01T19:56:29.280 INFO:teuthology.orchestra.run.smithi008.stdout: "flag_point": "queued for pg", 2023-08-01T19:56:29.280 INFO:teuthology.orchestra.run.smithi008.stdout: "events": [ 2023-08-01T19:56:29.281 INFO:teuthology.orchestra.run.smithi008.stdout: { 2023-08-01T19:56:29.281 INFO:teuthology.orchestra.run.smithi008.stdout: "event": "initiated", 2023-08-01T19:56:29.281 INFO:teuthology.orchestra.run.smithi008.stdout: "time": "2023-08-01T19:56:29.257448+0000", 2023-08-01T19:56:29.281 INFO:teuthology.orchestra.run.smithi008.stdout: "duration": 0 2023-08-01T19:56:29.281 INFO:teuthology.orchestra.run.smithi008.stdout: }, 2023-08-01T19:56:29.281 INFO:teuthology.orchestra.run.smithi008.stdout: { 2023-08-01T19:56:29.281 INFO:teuthology.orchestra.run.smithi008.stdout: "event": "throttled", 2023-08-01T19:56:29.281 INFO:teuthology.orchestra.run.smithi008.stdout: "time": "2023-08-01T19:56:29.257448+0000", 2023-08-01T19:56:29.282 INFO:teuthology.orchestra.run.smithi008.stdout: "duration": 0 2023-08-01T19:56:29.282 INFO:teuthology.orchestra.run.smithi008.stdout: }, 2023-08-01T19:56:29.282 INFO:teuthology.orchestra.run.smithi008.stdout: { 2023-08-01T19:56:29.282 INFO:teuthology.orchestra.run.smithi008.stdout: "event": "header_read", 2023-08-01T19:56:29.282 INFO:teuthology.orchestra.run.smithi008.stdout: "time": "2023-08-01T19:56:29.257448+0000", 2023-08-01T19:56:29.282 INFO:teuthology.orchestra.run.smithi008.stdout: "duration": 4294967295.9999995 2023-08-01T19:56:29.282 INFO:teuthology.orchestra.run.smithi008.stdout: }, 2023-08-01T19:56:29.283 INFO:teuthology.orchestra.run.smithi008.stdout: { 2023-08-01T19:56:29.283 INFO:teuthology.orchestra.run.smithi008.stdout: "event": "all_read", 2023-08-01T19:56:29.283 INFO:teuthology.orchestra.run.smithi008.stdout: "time": "2023-08-01T19:56:29.257450+0000", 2023-08-01T19:56:29.283 INFO:teuthology.orchestra.run.smithi008.stdout: "duration": 2.5380000000000001e-06 2023-08-01T19:56:29.283 INFO:teuthology.orchestra.run.smithi008.stdout: }, 2023-08-01T19:56:29.283 INFO:teuthology.orchestra.run.smithi008.stdout: { 2023-08-01T19:56:29.283 INFO:teuthology.orchestra.run.smithi008.stdout: "event": "dispatched", 2023-08-01T19:56:29.283 INFO:teuthology.orchestra.run.smithi008.stdout: "time": "2023-08-01T19:56:29.257458+0000", 2023-08-01T19:56:29.284 INFO:teuthology.orchestra.run.smithi008.stdout: "duration": 7.3289999999999996e-06 2023-08-01T19:56:29.284 INFO:teuthology.orchestra.run.smithi008.stdout: }, 2023-08-01T19:56:29.284 INFO:teuthology.orchestra.run.smithi008.stdout: { 2023-08-01T19:56:29.284 INFO:teuthology.orchestra.run.smithi008.stdout: "event": "queued_for_pg", 2023-08-01T19:56:29.284 INFO:teuthology.orchestra.run.smithi008.stdout: "time": "2023-08-01T19:56:29.257462+0000", 2023-08-01T19:56:29.284 INFO:teuthology.orchestra.run.smithi008.stdout: "duration": 4.0439999999999997e-06 2023-08-01T19:56:29.284 INFO:teuthology.orchestra.run.smithi008.stdout: } 2023-08-01T19:56:29.285 INFO:teuthology.orchestra.run.smithi008.stdout: ] 2023-08-01T19:56:29.285 INFO:teuthology.orchestra.run.smithi008.stdout: } 2023-08-01T19:56:29.285 INFO:teuthology.orchestra.run.smithi008.stdout: }, 2023-08-01T19:56:29.285 INFO:teuthology.orchestra.run.smithi008.stdout: { 2023-08-01T19:56:29.285 INFO:teuthology.orchestra.run.smithi008.stdout: "description": "osd_op(client.4668.0:256363 5.a 5:55871068:::benchmark_data_smithi006_114134_object122702:head [delete] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e75)", 2023-08-01T19:56:29.285 INFO:teuthology.orchestra.run.smithi008.stdout: "initiated_at": "2023-08-01T19:56:29.250016+0000", 2023-08-01T19:56:29.285 INFO:teuthology.orchestra.run.smithi008.stdout: "age": 0.0074401739999999999, 2023-08-01T19:56:29.285 INFO:teuthology.orchestra.run.smithi008.stdout: "duration": 0.0077285890000000001, 2023-08-01T19:56:29.286 INFO:teuthology.orchestra.run.smithi008.stdout: "type_data": { 2023-08-01T19:56:29.286 INFO:teuthology.orchestra.run.smithi008.stdout: "flag_point": "waiting for sub ops", 2023-08-01T19:56:29.286 INFO:teuthology.orchestra.run.smithi008.stdout: "client_info": { 2023-08-01T19:56:29.286 INFO:teuthology.orchestra.run.smithi008.stdout: "client": "client.4668", 2023-08-01T19:56:29.286 INFO:teuthology.orchestra.run.smithi008.stdout: "client_addr": "172.21.15.6:0/1709472247", 2023-08-01T19:56:29.286 INFO:teuthology.orchestra.run.smithi008.stdout: "tid": 256363 2023-08-01T19:56:29.286 INFO:teuthology.orchestra.run.smithi008.stdout: }, 2023-08-01T19:56:29.287 INFO:teuthology.orchestra.run.smithi008.stdout: "events": [ 2023-08-01T19:56:29.287 INFO:teuthology.orchestra.run.smithi008.stdout: { 2023-08-01T19:56:29.287 INFO:teuthology.orchestra.run.smithi008.stdout: "event": "initiated", 2023-08-01T19:56:29.287 INFO:teuthology.orchestra.run.smithi008.stdout: "time": "2023-08-01T19:56:29.250016+0000", 2023-08-01T19:56:29.287 INFO:teuthology.orchestra.run.smithi008.stdout: "duration": 0 2023-08-01T19:56:29.287 INFO:teuthology.orchestra.run.smithi008.stdout: }, 2023-08-01T19:56:29.288 INFO:teuthology.orchestra.run.smithi008.stdout: { 2023-08-01T19:56:29.288 INFO:teuthology.orchestra.run.smithi008.stdout: "event": "throttled", 2023-08-01T19:56:29.288 INFO:teuthology.orchestra.run.smithi008.stdout: "time": "2023-08-01T19:56:29.250016+0000", 2023-08-01T19:56:29.288 INFO:teuthology.orchestra.run.smithi008.stdout: "duration": 0 2023-08-01T19:56:29.288 INFO:teuthology.orchestra.run.smithi008.stdout: }, 2023-08-01T19:56:29.288 INFO:teuthology.orchestra.run.smithi008.stdout: { 2023-08-01T19:56:29.288 INFO:teuthology.orchestra.run.smithi008.stdout: "event": "header_read", 2023-08-01T19:56:29.289 INFO:teuthology.orchestra.run.smithi008.stdout: "time": "2023-08-01T19:56:29.250015+0000", 2023-08-01T19:56:29.289 INFO:teuthology.orchestra.run.smithi008.stdout: "duration": 4294967295.9999995 2023-08-01T19:56:29.289 INFO:teuthology.orchestra.run.smithi008.stdout: }, 2023-08-01T19:56:29.289 INFO:teuthology.orchestra.run.smithi008.stdout: { 2023-08-01T19:56:29.289 INFO:teuthology.orchestra.run.smithi008.stdout: "event": "all_read", 2023-08-01T19:56:29.289 INFO:teuthology.orchestra.run.smithi008.stdout: "time": "2023-08-01T19:56:29.250018+0000", 2023-08-01T19:56:29.289 INFO:teuthology.orchestra.run.smithi008.stdout: "duration": 3.2600000000000001e-06 2023-08-01T19:56:29.289 INFO:teuthology.orchestra.run.smithi008.stdout: }, 2023-08-01T19:56:29.290 INFO:teuthology.orchestra.run.smithi008.stdout: { 2023-08-01T19:56:29.290 INFO:teuthology.orchestra.run.smithi008.stdout: "event": "dispatched", 2023-08-01T19:56:29.290 INFO:teuthology.orchestra.run.smithi008.stdout: "time": "2023-08-01T19:56:29.250025+0000", 2023-08-01T19:56:29.290 INFO:teuthology.orchestra.run.smithi008.stdout: "duration": 6.5899999999999996e-06 2023-08-01T19:56:29.290 INFO:teuthology.orchestra.run.smithi008.stdout: }, 2023-08-01T19:56:29.290 INFO:teuthology.orchestra.run.smithi008.stdout: { 2023-08-01T19:56:29.290 INFO:teuthology.orchestra.run.smithi008.stdout: "event": "queued_for_pg", 2023-08-01T19:56:29.290 INFO:teuthology.orchestra.run.smithi008.stdout: "time": "2023-08-01T19:56:29.250029+0000", 2023-08-01T19:56:29.291 INFO:teuthology.orchestra.run.smithi008.stdout: "duration": 4.3409999999999996e-06 2023-08-01T19:56:29.291 INFO:teuthology.orchestra.run.smithi008.stdout: }, 2023-08-01T19:56:29.291 INFO:teuthology.orchestra.run.smithi008.stdout: { 2023-08-01T19:56:29.291 INFO:teuthology.orchestra.run.smithi008.stdout: "event": "reached_pg", 2023-08-01T19:56:29.291 INFO:teuthology.orchestra.run.smithi008.stdout: "time": "2023-08-01T19:56:29.250072+0000", 2023-08-01T19:56:29.291 INFO:teuthology.orchestra.run.smithi008.stdout: "duration": 4.2273e-05 2023-08-01T19:56:29.291 INFO:teuthology.orchestra.run.smithi008.stdout: }, 2023-08-01T19:56:29.292 INFO:teuthology.orchestra.run.smithi008.stdout: { 2023-08-01T19:56:29.292 INFO:teuthology.orchestra.run.smithi008.stdout: "event": "started", 2023-08-01T19:56:29.292 INFO:teuthology.orchestra.run.smithi008.stdout: "time": "2023-08-01T19:56:29.252315+0000", 2023-08-01T19:56:29.292 INFO:teuthology.orchestra.run.smithi008.stdout: "duration": 0.0022431679999999998 2023-08-01T19:56:29.292 INFO:teuthology.orchestra.run.smithi008.stdout: }, 2023-08-01T19:56:29.292 INFO:teuthology.orchestra.run.smithi008.stdout: { 2023-08-01T19:56:29.292 INFO:teuthology.orchestra.run.smithi008.stdout: "event": "waiting for subops from 2", 2023-08-01T19:56:29.292 INFO:teuthology.orchestra.run.smithi008.stdout: "time": "2023-08-01T19:56:29.252444+0000", 2023-08-01T19:56:29.293 INFO:teuthology.orchestra.run.smithi008.stdout: "duration": 0.00012940799999999999 2023-08-01T19:56:29.293 INFO:teuthology.orchestra.run.smithi008.stdout: } 2023-08-01T19:56:29.293 INFO:teuthology.orchestra.run.smithi008.stdout: ] 2023-08-01T19:56:29.293 INFO:teuthology.orchestra.run.smithi008.stdout: } 2023-08-01T19:56:29.293 INFO:teuthology.orchestra.run.smithi008.stdout: }, 2023-08-01T19:56:29.293 INFO:teuthology.orchestra.run.smithi008.stdout: { 2023-08-01T19:56:29.293 INFO:teuthology.orchestra.run.smithi008.stdout: "description": "osd_op(client.4668.0:256365 5.8 5:1d2c0087:::benchmark_data_smithi006_114134_object122704:head [delete] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e75)", 2023-08-01T19:56:29.294 INFO:teuthology.orchestra.run.smithi008.stdout: "initiated_at": "2023-08-01T19:56:29.250062+0000", 2023-08-01T19:56:29.294 INFO:teuthology.orchestra.run.smithi008.stdout: "age": 0.0073940949999999998, 2023-08-01T19:56:29.294 INFO:teuthology.orchestra.run.smithi008.stdout: "duration": 0.0077272579999999999, 2023-08-01T19:56:29.294 INFO:teuthology.orchestra.run.smithi008.stdout: "type_data": { 2023-08-01T19:56:29.294 INFO:teuthology.orchestra.run.smithi008.stdout: "flag_point": "waiting for sub ops", 2023-08-01T19:56:29.294 INFO:teuthology.orchestra.run.smithi008.stdout: "client_info": { 2023-08-01T19:56:29.294 INFO:teuthology.orchestra.run.smithi008.stdout: "client": "client.4668", 2023-08-01T19:56:29.294 INFO:teuthology.orchestra.run.smithi008.stdout: "client_addr": "172.21.15.6:0/1709472247", 2023-08-01T19:56:29.295 INFO:teuthology.orchestra.run.smithi008.stdout: "tid": 256365 2023-08-01T19:56:29.295 INFO:teuthology.orchestra.run.smithi008.stdout: }, 2023-08-01T19:56:29.295 INFO:teuthology.orchestra.run.smithi008.stdout: "events": [ 2023-08-01T19:56:29.295 INFO:teuthology.orchestra.run.smithi008.stdout: { 2023-08-01T19:56:29.295 INFO:teuthology.orchestra.run.smithi008.stdout: "event": "initiated", 2023-08-01T19:56:29.295 INFO:teuthology.orchestra.run.smithi008.stdout: "time": "2023-08-01T19:56:29.250062+0000", 2023-08-01T19:56:29.295 INFO:teuthology.orchestra.run.smithi008.stdout: "duration": 0 2023-08-01T19:56:29.295 INFO:teuthology.orchestra.run.smithi008.stdout: }, 2023-08-01T19:56:29.296 INFO:teuthology.orchestra.run.smithi008.stdout: { 2023-08-01T19:56:29.296 INFO:teuthology.orchestra.run.smithi008.stdout: "event": "throttled", 2023-08-01T19:56:29.296 INFO:teuthology.orchestra.run.smithi008.stdout: "time": "2023-08-01T19:56:29.250062+0000", 2023-08-01T19:56:29.296 INFO:teuthology.orchestra.run.smithi008.stdout: "duration": 0 2023-08-01T19:56:29.296 INFO:teuthology.orchestra.run.smithi008.stdout: }, 2023-08-01T19:56:29.296 INFO:teuthology.orchestra.run.smithi008.stdout: { 2023-08-01T19:56:29.296 INFO:teuthology.orchestra.run.smithi008.stdout: "event": "header_read", 2023-08-01T19:56:29.296 INFO:teuthology.orchestra.run.smithi008.stdout: "time": "2023-08-01T19:56:29.250061+0000", 2023-08-01T19:56:29.297 INFO:teuthology.orchestra.run.smithi008.stdout: "duration": 4294967295.9999995 2023-08-01T19:56:29.297 INFO:teuthology.orchestra.run.smithi008.stdout: }, 2023-08-01T19:56:29.297 INFO:teuthology.orchestra.run.smithi008.stdout: { 2023-08-01T19:56:29.297 INFO:teuthology.orchestra.run.smithi008.stdout: "event": "all_read", 2023-08-01T19:56:29.297 INFO:teuthology.orchestra.run.smithi008.stdout: "time": "2023-08-01T19:56:29.250064+0000", 2023-08-01T19:56:29.297 INFO:teuthology.orchestra.run.smithi008.stdout: "duration": 2.4590000000000001e-06 2023-08-01T19:56:29.297 INFO:teuthology.orchestra.run.smithi008.stdout: }, 2023-08-01T19:56:29.297 INFO:teuthology.orchestra.run.smithi008.stdout: { 2023-08-01T19:56:29.298 INFO:teuthology.orchestra.run.smithi008.stdout: "event": "dispatched", 2023-08-01T19:56:29.298 INFO:teuthology.orchestra.run.smithi008.stdout: "time": "2023-08-01T19:56:29.250070+0000", 2023-08-01T19:56:29.298 INFO:teuthology.orchestra.run.smithi008.stdout: "duration": 6.1e-06 2023-08-01T19:56:29.298 INFO:teuthology.orchestra.run.smithi008.stdout: }, 2023-08-01T19:56:29.298 INFO:teuthology.orchestra.run.smithi008.stdout: { 2023-08-01T19:56:29.298 INFO:teuthology.orchestra.run.smithi008.stdout: "event": "queued_for_pg", 2023-08-01T19:56:29.298 INFO:teuthology.orchestra.run.smithi008.stdout: "time": "2023-08-01T19:56:29.250074+0000", 2023-08-01T19:56:29.298 INFO:teuthology.orchestra.run.smithi008.stdout: "duration": 4.1609999999999996e-06 2023-08-01T19:56:29.299 INFO:teuthology.orchestra.run.smithi008.stdout: }, 2023-08-01T19:56:29.299 INFO:teuthology.orchestra.run.smithi008.stdout: { 2023-08-01T19:56:29.299 INFO:teuthology.orchestra.run.smithi008.stdout: "event": "reached_pg", 2023-08-01T19:56:29.299 INFO:teuthology.orchestra.run.smithi008.stdout: "time": "2023-08-01T19:56:29.250155+0000", 2023-08-01T19:56:29.299 INFO:teuthology.orchestra.run.smithi008.stdout: "duration": 8.0824999999999999e-05 2023-08-01T19:56:29.299 INFO:teuthology.orchestra.run.smithi008.stdout: }, 2023-08-01T19:56:29.299 INFO:teuthology.orchestra.run.smithi008.stdout: { 2023-08-01T19:56:29.299 INFO:teuthology.orchestra.run.smithi008.stdout: "event": "started", 2023-08-01T19:56:29.300 INFO:teuthology.orchestra.run.smithi008.stdout: "time": "2023-08-01T19:56:29.250275+0000", 2023-08-01T19:56:29.300 INFO:teuthology.orchestra.run.smithi008.stdout: "duration": 0.000120209 2023-08-01T19:56:29.300 INFO:teuthology.orchestra.run.smithi008.stdout: }, 2023-08-01T19:56:29.300 INFO:teuthology.orchestra.run.smithi008.stdout: { 2023-08-01T19:56:29.300 INFO:teuthology.orchestra.run.smithi008.stdout: "event": "waiting for subops from 2", 2023-08-01T19:56:29.300 INFO:teuthology.orchestra.run.smithi008.stdout: "time": "2023-08-01T19:56:29.250397+0000", 2023-08-01T19:56:29.300 INFO:teuthology.orchestra.run.smithi008.stdout: "duration": 0.00012181299999999999 2023-08-01T19:56:29.301 INFO:teuthology.orchestra.run.smithi008.stdout: }, 2023-08-01T19:56:29.301 INFO:teuthology.orchestra.run.smithi008.stdout: { 2023-08-01T19:56:29.301 INFO:teuthology.orchestra.run.smithi008.stdout: "event": "op_commit", 2023-08-01T19:56:29.301 INFO:teuthology.orchestra.run.smithi008.stdout: "time": "2023-08-01T19:56:29.257378+0000", 2023-08-01T19:56:29.301 INFO:teuthology.orchestra.run.smithi008.stdout: "duration": 0.0069809420000000004 2023-08-01T19:56:29.301 INFO:teuthology.orchestra.run.smithi008.stdout: } 2023-08-01T19:56:29.301 INFO:teuthology.orchestra.run.smithi008.stdout: ] 2023-08-01T19:56:29.301 INFO:teuthology.orchestra.run.smithi008.stdout: } 2023-08-01T19:56:29.302 INFO:teuthology.orchestra.run.smithi008.stdout: }, 2023-08-01T19:56:29.302 INFO:teuthology.orchestra.run.smithi008.stdout: { 2023-08-01T19:56:29.302 INFO:teuthology.orchestra.run.smithi008.stdout: "description": "osd_op(client.4668.0:256369 5.2 5:4cbf273a:::benchmark_data_smithi006_114134_object122708:head [delete] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e75)", 2023-08-01T19:56:29.302 INFO:teuthology.orchestra.run.smithi008.stdout: "initiated_at": "2023-08-01T19:56:29.252554+0000", 2023-08-01T19:56:29.302 INFO:teuthology.orchestra.run.smithi008.stdout: "age": 0.0049022550000000003, 2023-08-01T19:56:29.302 INFO:teuthology.orchestra.run.smithi008.stdout: "duration": 0.0052808569999999999, 2023-08-01T19:56:29.302 INFO:teuthology.orchestra.run.smithi008.stdout: "type_data": { 2023-08-01T19:56:29.302 INFO:teuthology.orchestra.run.smithi008.stdout: "flag_point": "started", 2023-08-01T19:56:29.303 INFO:teuthology.orchestra.run.smithi008.stdout: "client_info": { 2023-08-01T19:56:29.303 INFO:teuthology.orchestra.run.smithi008.stdout: "client": "client.4668", 2023-08-01T19:56:29.303 INFO:teuthology.orchestra.run.smithi008.stdout: "client_addr": "172.21.15.6:0/1709472247", 2023-08-01T19:56:29.303 INFO:teuthology.orchestra.run.smithi008.stdout: "tid": 256369 2023-08-01T19:56:29.303 INFO:teuthology.orchestra.run.smithi008.stdout: }, 2023-08-01T19:56:29.303 INFO:teuthology.orchestra.run.smithi008.stdout: "events": [ 2023-08-01T19:56:29.303 INFO:teuthology.orchestra.run.smithi008.stdout: { 2023-08-01T19:56:29.303 INFO:teuthology.orchestra.run.smithi008.stdout: "event": "initiated", 2023-08-01T19:56:29.304 INFO:teuthology.orchestra.run.smithi008.stdout: "time": "2023-08-01T19:56:29.252554+0000", 2023-08-01T19:56:29.304 INFO:teuthology.orchestra.run.smithi008.stdout: "duration": 0 2023-08-01T19:56:29.304 INFO:teuthology.orchestra.run.smithi008.stdout: }, 2023-08-01T19:56:29.304 INFO:teuthology.orchestra.run.smithi008.stdout: { 2023-08-01T19:56:29.304 INFO:teuthology.orchestra.run.smithi008.stdout: "event": "throttled", 2023-08-01T19:56:29.304 INFO:teuthology.orchestra.run.smithi008.stdout: "time": "2023-08-01T19:56:29.252554+0000", 2023-08-01T19:56:29.304 INFO:teuthology.orchestra.run.smithi008.stdout: "duration": 0 2023-08-01T19:56:29.304 INFO:teuthology.orchestra.run.smithi008.stdout: }, 2023-08-01T19:56:29.305 INFO:teuthology.orchestra.run.smithi008.stdout: { 2023-08-01T19:56:29.305 INFO:teuthology.orchestra.run.smithi008.stdout: "event": "header_read", 2023-08-01T19:56:29.305 INFO:teuthology.orchestra.run.smithi008.stdout: "time": "2023-08-01T19:56:29.252553+0000", 2023-08-01T19:56:29.305 INFO:teuthology.orchestra.run.smithi008.stdout: "duration": 4294967295.9999995 2023-08-01T19:56:29.305 INFO:teuthology.orchestra.run.smithi008.stdout: }, 2023-08-01T19:56:29.305 INFO:teuthology.orchestra.run.smithi008.stdout: { 2023-08-01T19:56:29.305 INFO:teuthology.orchestra.run.smithi008.stdout: "event": "all_read", 2023-08-01T19:56:29.305 INFO:teuthology.orchestra.run.smithi008.stdout: "time": "2023-08-01T19:56:29.252556+0000", 2023-08-01T19:56:29.306 INFO:teuthology.orchestra.run.smithi008.stdout: "duration": 3.0510000000000001e-06 2023-08-01T19:56:29.306 INFO:teuthology.orchestra.run.smithi008.stdout: }, 2023-08-01T19:56:29.306 INFO:teuthology.orchestra.run.smithi008.stdout: { 2023-08-01T19:56:29.306 INFO:teuthology.orchestra.run.smithi008.stdout: "event": "dispatched", 2023-08-01T19:56:29.306 INFO:teuthology.orchestra.run.smithi008.stdout: "time": "2023-08-01T19:56:29.252564+0000", 2023-08-01T19:56:29.306 INFO:teuthology.orchestra.run.smithi008.stdout: "duration": 7.7919999999999993e-06 2023-08-01T19:56:29.306 INFO:teuthology.orchestra.run.smithi008.stdout: }, 2023-08-01T19:56:29.307 INFO:teuthology.orchestra.run.smithi008.stdout: { 2023-08-01T19:56:29.307 INFO:teuthology.orchestra.run.smithi008.stdout: "event": "queued_for_pg", 2023-08-01T19:56:29.307 INFO:teuthology.orchestra.run.smithi008.stdout: "time": "2023-08-01T19:56:29.252571+0000", 2023-08-01T19:56:29.307 INFO:teuthology.orchestra.run.smithi008.stdout: "duration": 6.5039999999999999e-06 2023-08-01T19:56:29.307 INFO:teuthology.orchestra.run.smithi008.stdout: }, 2023-08-01T19:56:29.307 INFO:teuthology.orchestra.run.smithi008.stdout: { 2023-08-01T19:56:29.307 INFO:teuthology.orchestra.run.smithi008.stdout: "event": "reached_pg", 2023-08-01T19:56:29.307 INFO:teuthology.orchestra.run.smithi008.stdout: "time": "2023-08-01T19:56:29.252602+0000", 2023-08-01T19:56:29.308 INFO:teuthology.orchestra.run.smithi008.stdout: "duration": 3.1899000000000001e-05 2023-08-01T19:56:29.308 INFO:teuthology.orchestra.run.smithi008.stdout: }, 2023-08-01T19:56:29.308 INFO:teuthology.orchestra.run.smithi008.stdout: { 2023-08-01T19:56:29.308 INFO:teuthology.orchestra.run.smithi008.stdout: "event": "started", 2023-08-01T19:56:29.308 INFO:teuthology.orchestra.run.smithi008.stdout: "time": "2023-08-01T19:56:29.252724+0000", 2023-08-01T19:56:29.308 INFO:teuthology.orchestra.run.smithi008.stdout: "duration": 0.00012176900000000001 2023-08-01T19:56:29.308 INFO:teuthology.orchestra.run.smithi008.stdout: } 2023-08-01T19:56:29.308 INFO:teuthology.orchestra.run.smithi008.stdout: ] 2023-08-01T19:56:29.309 INFO:teuthology.orchestra.run.smithi008.stdout: } 2023-08-01T19:56:29.309 INFO:teuthology.orchestra.run.smithi008.stdout: }, 2023-08-01T19:56:29.309 INFO:teuthology.orchestra.run.smithi008.stdout: { 2023-08-01T19:56:29.309 INFO:teuthology.orchestra.run.smithi008.stdout: "description": "osd_op(client.4668.0:256370 5.3 5:cf37e0c9:::benchmark_data_smithi006_114134_object122709:head [delete] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e75)", 2023-08-01T19:56:29.309 INFO:teuthology.orchestra.run.smithi008.stdout: "initiated_at": "2023-08-01T19:56:29.252586+0000", 2023-08-01T19:56:29.309 INFO:teuthology.orchestra.run.smithi008.stdout: "age": 0.0048700080000000003, 2023-08-01T19:56:29.309 INFO:teuthology.orchestra.run.smithi008.stdout: "duration": 0.0052870460000000001, 2023-08-01T19:56:29.310 INFO:teuthology.orchestra.run.smithi008.stdout: "type_data": { 2023-08-01T19:56:29.310 INFO:teuthology.orchestra.run.smithi008.stdout: "flag_point": "started", 2023-08-01T19:56:29.310 INFO:teuthology.orchestra.run.smithi008.stdout: "client_info": { 2023-08-01T19:56:29.310 INFO:teuthology.orchestra.run.smithi008.stdout: "client": "client.4668", 2023-08-01T19:56:29.310 INFO:teuthology.orchestra.run.smithi008.stdout: "client_addr": "172.21.15.6:0/1709472247", 2023-08-01T19:56:29.310 INFO:teuthology.orchestra.run.smithi008.stdout: "tid": 256370 2023-08-01T19:56:29.310 INFO:teuthology.orchestra.run.smithi008.stdout: }, 2023-08-01T19:56:29.310 INFO:teuthology.orchestra.run.smithi008.stdout: "events": [ 2023-08-01T19:56:29.311 INFO:teuthology.orchestra.run.smithi008.stdout: { 2023-08-01T19:56:29.311 INFO:teuthology.orchestra.run.smithi008.stdout: "event": "initiated", 2023-08-01T19:56:29.311 INFO:teuthology.orchestra.run.smithi008.stdout: "time": "2023-08-01T19:56:29.252586+0000", 2023-08-01T19:56:29.311 INFO:teuthology.orchestra.run.smithi008.stdout: "duration": 0 2023-08-01T19:56:29.311 INFO:teuthology.orchestra.run.smithi008.stdout: }, 2023-08-01T19:56:29.311 INFO:teuthology.orchestra.run.smithi008.stdout: { 2023-08-01T19:56:29.311 INFO:teuthology.orchestra.run.smithi008.stdout: "event": "throttled", 2023-08-01T19:56:29.311 INFO:teuthology.orchestra.run.smithi008.stdout: "time": "2023-08-01T19:56:29.252586+0000", 2023-08-01T19:56:29.312 INFO:teuthology.orchestra.run.smithi008.stdout: "duration": 0 2023-08-01T19:56:29.312 INFO:teuthology.orchestra.run.smithi008.stdout: }, 2023-08-01T19:56:29.312 INFO:teuthology.orchestra.run.smithi008.stdout: { 2023-08-01T19:56:29.312 INFO:teuthology.orchestra.run.smithi008.stdout: "event": "header_read", 2023-08-01T19:56:29.312 INFO:teuthology.orchestra.run.smithi008.stdout: "time": "2023-08-01T19:56:29.252585+0000", 2023-08-01T19:56:29.312 INFO:teuthology.orchestra.run.smithi008.stdout: "duration": 4294967295.9999995 2023-08-01T19:56:29.312 INFO:teuthology.orchestra.run.smithi008.stdout: }, 2023-08-01T19:56:29.313 INFO:teuthology.orchestra.run.smithi008.stdout: { 2023-08-01T19:56:29.313 INFO:teuthology.orchestra.run.smithi008.stdout: "event": "all_read", 2023-08-01T19:56:29.313 INFO:teuthology.orchestra.run.smithi008.stdout: "time": "2023-08-01T19:56:29.252589+0000", 2023-08-01T19:56:29.313 INFO:teuthology.orchestra.run.smithi008.stdout: "duration": 3.585e-06 2023-08-01T19:56:29.313 INFO:teuthology.orchestra.run.smithi008.stdout: }, 2023-08-01T19:56:29.313 INFO:teuthology.orchestra.run.smithi008.stdout: { 2023-08-01T19:56:29.313 INFO:teuthology.orchestra.run.smithi008.stdout: "event": "dispatched", 2023-08-01T19:56:29.313 INFO:teuthology.orchestra.run.smithi008.stdout: "time": "2023-08-01T19:56:29.252596+0000", 2023-08-01T19:56:29.314 INFO:teuthology.orchestra.run.smithi008.stdout: "duration": 7.2350000000000002e-06 2023-08-01T19:56:29.314 INFO:teuthology.orchestra.run.smithi008.stdout: }, 2023-08-01T19:56:29.314 INFO:teuthology.orchestra.run.smithi008.stdout: { 2023-08-01T19:56:29.314 INFO:teuthology.orchestra.run.smithi008.stdout: "event": "queued_for_pg", 2023-08-01T19:56:29.314 INFO:teuthology.orchestra.run.smithi008.stdout: "time": "2023-08-01T19:56:29.252600+0000", 2023-08-01T19:56:29.314 INFO:teuthology.orchestra.run.smithi008.stdout: "duration": 4.0999999999999997e-06 2023-08-01T19:56:29.314 INFO:teuthology.orchestra.run.smithi008.stdout: }, 2023-08-01T19:56:29.314 INFO:teuthology.orchestra.run.smithi008.stdout: { 2023-08-01T19:56:29.315 INFO:teuthology.orchestra.run.smithi008.stdout: "event": "reached_pg", 2023-08-01T19:56:29.315 INFO:teuthology.orchestra.run.smithi008.stdout: "time": "2023-08-01T19:56:29.252642+0000", 2023-08-01T19:56:29.315 INFO:teuthology.orchestra.run.smithi008.stdout: "duration": 4.1675000000000003e-05 2023-08-01T19:56:29.315 INFO:teuthology.orchestra.run.smithi008.stdout: }, 2023-08-01T19:56:29.315 INFO:teuthology.orchestra.run.smithi008.stdout: { 2023-08-01T19:56:29.315 INFO:teuthology.orchestra.run.smithi008.stdout: "event": "started", 2023-08-01T19:56:29.315 INFO:teuthology.orchestra.run.smithi008.stdout: "time": "2023-08-01T19:56:29.253439+0000", 2023-08-01T19:56:29.315 INFO:teuthology.orchestra.run.smithi008.stdout: "duration": 0.00079735699999999995 2023-08-01T19:56:29.316 INFO:teuthology.orchestra.run.smithi008.stdout: } 2023-08-01T19:56:29.316 INFO:teuthology.orchestra.run.smithi008.stdout: ] 2023-08-01T19:56:29.316 INFO:teuthology.orchestra.run.smithi008.stdout: } 2023-08-01T19:56:29.316 INFO:teuthology.orchestra.run.smithi008.stdout: }, 2023-08-01T19:56:29.316 INFO:teuthology.orchestra.run.smithi008.stdout: { 2023-08-01T19:56:29.316 INFO:teuthology.orchestra.run.smithi008.stdout: "description": "osd_op(client.4668.0:256372 5.3 5:c6ed6e7b:::benchmark_data_smithi006_114134_object122711:head [delete] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e75)", 2023-08-01T19:56:29.316 INFO:teuthology.orchestra.run.smithi008.stdout: "initiated_at": "2023-08-01T19:56:29.254615+0000", 2023-08-01T19:56:29.316 INFO:teuthology.orchestra.run.smithi008.stdout: "age": 0.0028411550000000002, 2023-08-01T19:56:29.317 INFO:teuthology.orchestra.run.smithi008.stdout: "duration": 0.0032989930000000001, 2023-08-01T19:56:29.317 INFO:teuthology.orchestra.run.smithi008.stdout: "type_data": { 2023-08-01T19:56:29.317 INFO:teuthology.orchestra.run.smithi008.stdout: "flag_point": "started", 2023-08-01T19:56:29.317 INFO:teuthology.orchestra.run.smithi008.stdout: "client_info": { 2023-08-01T19:56:29.317 INFO:teuthology.orchestra.run.smithi008.stdout: "client": "client.4668", 2023-08-01T19:56:29.317 INFO:teuthology.orchestra.run.smithi008.stdout: "client_addr": "172.21.15.6:0/1709472247", 2023-08-01T19:56:29.317 INFO:teuthology.orchestra.run.smithi008.stdout: "tid": 256372 2023-08-01T19:56:29.317 INFO:teuthology.orchestra.run.smithi008.stdout: }, 2023-08-01T19:56:29.318 INFO:teuthology.orchestra.run.smithi008.stdout: "events": [ 2023-08-01T19:56:29.318 INFO:teuthology.orchestra.run.smithi008.stdout: { 2023-08-01T19:56:29.318 INFO:teuthology.orchestra.run.smithi008.stdout: "event": "initiated", 2023-08-01T19:56:29.318 INFO:teuthology.orchestra.run.smithi008.stdout: "time": "2023-08-01T19:56:29.254615+0000", 2023-08-01T19:56:29.318 INFO:teuthology.orchestra.run.smithi008.stdout: "duration": 0 2023-08-01T19:56:29.318 INFO:teuthology.orchestra.run.smithi008.stdout: }, 2023-08-01T19:56:29.318 INFO:teuthology.orchestra.run.smithi008.stdout: { 2023-08-01T19:56:29.319 INFO:teuthology.orchestra.run.smithi008.stdout: "event": "throttled", 2023-08-01T19:56:29.319 INFO:teuthology.orchestra.run.smithi008.stdout: "time": "2023-08-01T19:56:29.254615+0000", 2023-08-01T19:56:29.319 INFO:teuthology.orchestra.run.smithi008.stdout: "duration": 0 2023-08-01T19:56:29.319 INFO:teuthology.orchestra.run.smithi008.stdout: }, 2023-08-01T19:56:29.319 INFO:teuthology.orchestra.run.smithi008.stdout: { 2023-08-01T19:56:29.319 INFO:teuthology.orchestra.run.smithi008.stdout: "event": "header_read", 2023-08-01T19:56:29.319 INFO:teuthology.orchestra.run.smithi008.stdout: "time": "2023-08-01T19:56:29.254614+0000", 2023-08-01T19:56:29.319 INFO:teuthology.orchestra.run.smithi008.stdout: "duration": 4294967295.999999 2023-08-01T19:56:29.320 INFO:teuthology.orchestra.run.smithi008.stdout: }, 2023-08-01T19:56:29.320 INFO:teuthology.orchestra.run.smithi008.stdout: { 2023-08-01T19:56:29.320 INFO:teuthology.orchestra.run.smithi008.stdout: "event": "all_read", 2023-08-01T19:56:29.320 INFO:teuthology.orchestra.run.smithi008.stdout: "time": "2023-08-01T19:56:29.254619+0000", 2023-08-01T19:56:29.320 INFO:teuthology.orchestra.run.smithi008.stdout: "duration": 5.4330000000000003e-06 2023-08-01T19:56:29.320 INFO:teuthology.orchestra.run.smithi008.stdout: }, 2023-08-01T19:56:29.320 INFO:teuthology.orchestra.run.smithi008.stdout: { 2023-08-01T19:56:29.320 INFO:teuthology.orchestra.run.smithi008.stdout: "event": "dispatched", 2023-08-01T19:56:29.321 INFO:teuthology.orchestra.run.smithi008.stdout: "time": "2023-08-01T19:56:29.254630+0000", 2023-08-01T19:56:29.321 INFO:teuthology.orchestra.run.smithi008.stdout: "duration": 1.1058e-05 2023-08-01T19:56:29.321 INFO:teuthology.orchestra.run.smithi008.stdout: }, 2023-08-01T19:56:29.321 INFO:teuthology.orchestra.run.smithi008.stdout: { 2023-08-01T19:56:29.321 INFO:teuthology.orchestra.run.smithi008.stdout: "event": "queued_for_pg", 2023-08-01T19:56:29.321 INFO:teuthology.orchestra.run.smithi008.stdout: "time": "2023-08-01T19:56:29.254637+0000", 2023-08-01T19:56:29.321 INFO:teuthology.orchestra.run.smithi008.stdout: "duration": 6.2709999999999998e-06 2023-08-01T19:56:29.321 INFO:teuthology.orchestra.run.smithi008.stdout: }, 2023-08-01T19:56:29.322 INFO:teuthology.orchestra.run.smithi008.stdout: { 2023-08-01T19:56:29.322 INFO:teuthology.orchestra.run.smithi008.stdout: "event": "reached_pg", 2023-08-01T19:56:29.322 INFO:teuthology.orchestra.run.smithi008.stdout: "time": "2023-08-01T19:56:29.255372+0000", 2023-08-01T19:56:29.322 INFO:teuthology.orchestra.run.smithi008.stdout: "duration": 0.00073521399999999998 2023-08-01T19:56:29.322 INFO:teuthology.orchestra.run.smithi008.stdout: }, 2023-08-01T19:56:29.322 INFO:teuthology.orchestra.run.smithi008.stdout: { 2023-08-01T19:56:29.322 INFO:teuthology.orchestra.run.smithi008.stdout: "event": "started", 2023-08-01T19:56:29.322 INFO:teuthology.orchestra.run.smithi008.stdout: "time": "2023-08-01T19:56:29.255510+0000", 2023-08-01T19:56:29.323 INFO:teuthology.orchestra.run.smithi008.stdout: "duration": 0.00013786500000000001 2023-08-01T19:56:29.323 INFO:teuthology.orchestra.run.smithi008.stdout: } 2023-08-01T19:56:29.323 INFO:teuthology.orchestra.run.smithi008.stdout: ] 2023-08-01T19:56:29.323 INFO:teuthology.orchestra.run.smithi008.stdout: } 2023-08-01T19:56:29.323 INFO:teuthology.orchestra.run.smithi008.stdout: }, 2023-08-01T19:56:29.323 INFO:teuthology.orchestra.run.smithi008.stdout: { 2023-08-01T19:56:29.323 INFO:teuthology.orchestra.run.smithi008.stdout: "description": "osd_op(client.4668.0:256374 5.5 5:a707a044:::benchmark_data_smithi006_114134_object122713:head [delete] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e75)", 2023-08-01T19:56:29.324 INFO:teuthology.orchestra.run.smithi008.stdout: "initiated_at": "2023-08-01T19:56:29.254678+0000", 2023-08-01T19:56:29.324 INFO:teuthology.orchestra.run.smithi008.stdout: "age": 0.0027784060000000002, 2023-08-01T19:56:29.324 INFO:teuthology.orchestra.run.smithi008.stdout: "duration": 0.0032747319999999998, 2023-08-01T19:56:29.324 INFO:teuthology.orchestra.run.smithi008.stdout: "type_data": { 2023-08-01T19:56:29.324 INFO:teuthology.orchestra.run.smithi008.stdout: "flag_point": "started", 2023-08-01T19:56:29.324 INFO:teuthology.orchestra.run.smithi008.stdout: "client_info": { 2023-08-01T19:56:29.324 INFO:teuthology.orchestra.run.smithi008.stdout: "client": "client.4668", 2023-08-01T19:56:29.324 INFO:teuthology.orchestra.run.smithi008.stdout: "client_addr": "172.21.15.6:0/1709472247", 2023-08-01T19:56:29.325 INFO:teuthology.orchestra.run.smithi008.stdout: "tid": 256374 2023-08-01T19:56:29.325 INFO:teuthology.orchestra.run.smithi008.stdout: }, 2023-08-01T19:56:29.325 INFO:teuthology.orchestra.run.smithi008.stdout: "events": [ 2023-08-01T19:56:29.325 INFO:teuthology.orchestra.run.smithi008.stdout: { 2023-08-01T19:56:29.325 INFO:teuthology.orchestra.run.smithi008.stdout: "event": "initiated", 2023-08-01T19:56:29.325 INFO:teuthology.orchestra.run.smithi008.stdout: "time": "2023-08-01T19:56:29.254678+0000", 2023-08-01T19:56:29.325 INFO:teuthology.orchestra.run.smithi008.stdout: "duration": 0 2023-08-01T19:56:29.325 INFO:teuthology.orchestra.run.smithi008.stdout: }, 2023-08-01T19:56:29.326 INFO:teuthology.orchestra.run.smithi008.stdout: { 2023-08-01T19:56:29.326 INFO:teuthology.orchestra.run.smithi008.stdout: "event": "throttled", 2023-08-01T19:56:29.326 INFO:teuthology.orchestra.run.smithi008.stdout: "time": "2023-08-01T19:56:29.254678+0000", 2023-08-01T19:56:29.326 INFO:teuthology.orchestra.run.smithi008.stdout: "duration": 0 2023-08-01T19:56:29.326 INFO:teuthology.orchestra.run.smithi008.stdout: }, 2023-08-01T19:56:29.326 INFO:teuthology.orchestra.run.smithi008.stdout: { 2023-08-01T19:56:29.326 INFO:teuthology.orchestra.run.smithi008.stdout: "event": "header_read", 2023-08-01T19:56:29.326 INFO:teuthology.orchestra.run.smithi008.stdout: "time": "2023-08-01T19:56:29.254677+0000", 2023-08-01T19:56:29.327 INFO:teuthology.orchestra.run.smithi008.stdout: "duration": 4294967295.9999995 2023-08-01T19:56:29.327 INFO:teuthology.orchestra.run.smithi008.stdout: }, 2023-08-01T19:56:29.327 INFO:teuthology.orchestra.run.smithi008.stdout: { 2023-08-01T19:56:29.327 INFO:teuthology.orchestra.run.smithi008.stdout: "event": "all_read", 2023-08-01T19:56:29.327 INFO:teuthology.orchestra.run.smithi008.stdout: "time": "2023-08-01T19:56:29.254681+0000", 2023-08-01T19:56:29.327 INFO:teuthology.orchestra.run.smithi008.stdout: "duration": 3.6789999999999998e-06 2023-08-01T19:56:29.327 INFO:teuthology.orchestra.run.smithi008.stdout: }, 2023-08-01T19:56:29.328 INFO:teuthology.orchestra.run.smithi008.stdout: { 2023-08-01T19:56:29.328 INFO:teuthology.orchestra.run.smithi008.stdout: "event": "dispatched", 2023-08-01T19:56:29.328 INFO:teuthology.orchestra.run.smithi008.stdout: "time": "2023-08-01T19:56:29.254691+0000", 2023-08-01T19:56:29.328 INFO:teuthology.orchestra.run.smithi008.stdout: "duration": 1.0519999999999999e-05 2023-08-01T19:56:29.328 INFO:teuthology.orchestra.run.smithi008.stdout: }, 2023-08-01T19:56:29.328 INFO:teuthology.orchestra.run.smithi008.stdout: { 2023-08-01T19:56:29.328 INFO:teuthology.orchestra.run.smithi008.stdout: "event": "queued_for_pg", 2023-08-01T19:56:29.328 INFO:teuthology.orchestra.run.smithi008.stdout: "time": "2023-08-01T19:56:29.254698+0000", 2023-08-01T19:56:29.329 INFO:teuthology.orchestra.run.smithi008.stdout: "duration": 7.0949999999999998e-06 2023-08-01T19:56:29.329 INFO:teuthology.orchestra.run.smithi008.stdout: }, 2023-08-01T19:56:29.329 INFO:teuthology.orchestra.run.smithi008.stdout: { 2023-08-01T19:56:29.329 INFO:teuthology.orchestra.run.smithi008.stdout: "event": "reached_pg", 2023-08-01T19:56:29.329 INFO:teuthology.orchestra.run.smithi008.stdout: "time": "2023-08-01T19:56:29.254734+0000", 2023-08-01T19:56:29.329 INFO:teuthology.orchestra.run.smithi008.stdout: "duration": 3.5475000000000002e-05 2023-08-01T19:56:29.329 INFO:teuthology.orchestra.run.smithi008.stdout: }, 2023-08-01T19:56:29.330 INFO:teuthology.orchestra.run.smithi008.stdout: { 2023-08-01T19:56:29.330 INFO:teuthology.orchestra.run.smithi008.stdout: "event": "started", 2023-08-01T19:56:29.330 INFO:teuthology.orchestra.run.smithi008.stdout: "time": "2023-08-01T19:56:29.254859+0000", 2023-08-01T19:56:29.330 INFO:teuthology.orchestra.run.smithi008.stdout: "duration": 0.00012539800000000001 2023-08-01T19:56:29.330 INFO:teuthology.orchestra.run.smithi008.stdout: } 2023-08-01T19:56:29.330 INFO:teuthology.orchestra.run.smithi008.stdout: ] 2023-08-01T19:56:29.330 INFO:teuthology.orchestra.run.smithi008.stdout: } 2023-08-01T19:56:29.330 INFO:teuthology.orchestra.run.smithi008.stdout: }, 2023-08-01T19:56:29.331 INFO:teuthology.orchestra.run.smithi008.stdout: { 2023-08-01T19:56:29.331 INFO:teuthology.orchestra.run.smithi008.stdout: "description": "osd_op(client.4668.0:256375 5.8 5:119f7a56:::benchmark_data_smithi006_114134_object122714:head [delete] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e75)", 2023-08-01T19:56:29.331 INFO:teuthology.orchestra.run.smithi008.stdout: "initiated_at": "2023-08-01T19:56:29.254836+0000", 2023-08-01T19:56:29.331 INFO:teuthology.orchestra.run.smithi008.stdout: "age": 0.0026197939999999999, 2023-08-01T19:56:29.331 INFO:teuthology.orchestra.run.smithi008.stdout: "duration": 0.0031544310000000001, 2023-08-01T19:56:29.331 INFO:teuthology.orchestra.run.smithi008.stdout: "type_data": { 2023-08-01T19:56:29.331 INFO:teuthology.orchestra.run.smithi008.stdout: "flag_point": "waiting for sub ops", 2023-08-01T19:56:29.332 INFO:teuthology.orchestra.run.smithi008.stdout: "client_info": { 2023-08-01T19:56:29.332 INFO:teuthology.orchestra.run.smithi008.stdout: "client": "client.4668", 2023-08-01T19:56:29.332 INFO:teuthology.orchestra.run.smithi008.stdout: "client_addr": "172.21.15.6:0/1709472247", 2023-08-01T19:56:29.332 INFO:teuthology.orchestra.run.smithi008.stdout: "tid": 256375 2023-08-01T19:56:29.332 INFO:teuthology.orchestra.run.smithi008.stdout: }, 2023-08-01T19:56:29.332 INFO:teuthology.orchestra.run.smithi008.stdout: "events": [ 2023-08-01T19:56:29.332 INFO:teuthology.orchestra.run.smithi008.stdout: { 2023-08-01T19:56:29.332 INFO:teuthology.orchestra.run.smithi008.stdout: "event": "initiated", 2023-08-01T19:56:29.333 INFO:teuthology.orchestra.run.smithi008.stdout: "time": "2023-08-01T19:56:29.254836+0000", 2023-08-01T19:56:29.333 INFO:teuthology.orchestra.run.smithi008.stdout: "duration": 0 2023-08-01T19:56:29.333 INFO:teuthology.orchestra.run.smithi008.stdout: }, 2023-08-01T19:56:29.333 INFO:teuthology.orchestra.run.smithi008.stdout: { 2023-08-01T19:56:29.333 INFO:teuthology.orchestra.run.smithi008.stdout: "event": "throttled", 2023-08-01T19:56:29.333 INFO:teuthology.orchestra.run.smithi008.stdout: "time": "2023-08-01T19:56:29.254836+0000", 2023-08-01T19:56:29.333 INFO:teuthology.orchestra.run.smithi008.stdout: "duration": 0 2023-08-01T19:56:29.333 INFO:teuthology.orchestra.run.smithi008.stdout: }, 2023-08-01T19:56:29.334 INFO:teuthology.orchestra.run.smithi008.stdout: { 2023-08-01T19:56:29.334 INFO:teuthology.orchestra.run.smithi008.stdout: "event": "header_read", 2023-08-01T19:56:29.334 INFO:teuthology.orchestra.run.smithi008.stdout: "time": "2023-08-01T19:56:29.254835+0000", 2023-08-01T19:56:29.334 INFO:teuthology.orchestra.run.smithi008.stdout: "duration": 4294967295.9999995 2023-08-01T19:56:29.334 INFO:teuthology.orchestra.run.smithi008.stdout: }, 2023-08-01T19:56:29.334 INFO:teuthology.orchestra.run.smithi008.stdout: { 2023-08-01T19:56:29.334 INFO:teuthology.orchestra.run.smithi008.stdout: "event": "all_read", 2023-08-01T19:56:29.334 INFO:teuthology.orchestra.run.smithi008.stdout: "time": "2023-08-01T19:56:29.254840+0000", 2023-08-01T19:56:29.335 INFO:teuthology.orchestra.run.smithi008.stdout: "duration": 4.4220000000000002e-06 2023-08-01T19:56:29.335 INFO:teuthology.orchestra.run.smithi008.stdout: }, 2023-08-01T19:56:29.335 INFO:teuthology.orchestra.run.smithi008.stdout: { 2023-08-01T19:56:29.335 INFO:teuthology.orchestra.run.smithi008.stdout: "event": "dispatched", 2023-08-01T19:56:29.335 INFO:teuthology.orchestra.run.smithi008.stdout: "time": "2023-08-01T19:56:29.254849+0000", 2023-08-01T19:56:29.335 INFO:teuthology.orchestra.run.smithi008.stdout: "duration": 8.6139999999999992e-06 2023-08-01T19:56:29.335 INFO:teuthology.orchestra.run.smithi008.stdout: }, 2023-08-01T19:56:29.335 INFO:teuthology.orchestra.run.smithi008.stdout: { 2023-08-01T19:56:29.336 INFO:teuthology.orchestra.run.smithi008.stdout: "event": "queued_for_pg", 2023-08-01T19:56:29.336 INFO:teuthology.orchestra.run.smithi008.stdout: "time": "2023-08-01T19:56:29.254854+0000", 2023-08-01T19:56:29.336 INFO:teuthology.orchestra.run.smithi008.stdout: "duration": 5.5520000000000004e-06 2023-08-01T19:56:29.336 INFO:teuthology.orchestra.run.smithi008.stdout: }, 2023-08-01T19:56:29.336 INFO:teuthology.orchestra.run.smithi008.stdout: { 2023-08-01T19:56:29.336 INFO:teuthology.orchestra.run.smithi008.stdout: "event": "reached_pg", 2023-08-01T19:56:29.336 INFO:teuthology.orchestra.run.smithi008.stdout: "time": "2023-08-01T19:56:29.255381+0000", 2023-08-01T19:56:29.337 INFO:teuthology.orchestra.run.smithi008.stdout: "duration": 0.00052727799999999995 2023-08-01T19:56:29.337 INFO:teuthology.orchestra.run.smithi008.stdout: }, 2023-08-01T19:56:29.337 INFO:teuthology.orchestra.run.smithi008.stdout: { 2023-08-01T19:56:29.337 INFO:teuthology.orchestra.run.smithi008.stdout: "event": "started", 2023-08-01T19:56:29.337 INFO:teuthology.orchestra.run.smithi008.stdout: "time": "2023-08-01T19:56:29.255489+0000", 2023-08-01T19:56:29.337 INFO:teuthology.orchestra.run.smithi008.stdout: "duration": 0.00010788799999999999 2023-08-01T19:56:29.337 INFO:teuthology.orchestra.run.smithi008.stdout: }, 2023-08-01T19:56:29.337 INFO:teuthology.orchestra.run.smithi008.stdout: { 2023-08-01T19:56:29.338 INFO:teuthology.orchestra.run.smithi008.stdout: "event": "waiting for subops from 2", 2023-08-01T19:56:29.338 INFO:teuthology.orchestra.run.smithi008.stdout: "time": "2023-08-01T19:56:29.255594+0000", 2023-08-01T19:56:29.338 INFO:teuthology.orchestra.run.smithi008.stdout: "duration": 0.000104998 2023-08-01T19:56:29.338 INFO:teuthology.orchestra.run.smithi008.stdout: } 2023-08-01T19:56:29.338 INFO:teuthology.orchestra.run.smithi008.stdout: ] 2023-08-01T19:56:29.338 INFO:teuthology.orchestra.run.smithi008.stdout: } 2023-08-01T19:56:29.338 INFO:teuthology.orchestra.run.smithi008.stdout: }, 2023-08-01T19:56:29.338 INFO:teuthology.orchestra.run.smithi008.stdout: { 2023-08-01T19:56:29.339 INFO:teuthology.orchestra.run.smithi008.stdout: "description": "osd_op(client.4668.0:256376 5.7 5:ea97318f:::benchmark_data_smithi006_114134_object122715:head [delete] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e75)", 2023-08-01T19:56:29.339 INFO:teuthology.orchestra.run.smithi008.stdout: "initiated_at": "2023-08-01T19:56:29.255364+0000", 2023-08-01T19:56:29.339 INFO:teuthology.orchestra.run.smithi008.stdout: "age": 0.0020921999999999998, 2023-08-01T19:56:29.339 INFO:teuthology.orchestra.run.smithi008.stdout: "duration": 0.002668541, 2023-08-01T19:56:29.339 INFO:teuthology.orchestra.run.smithi008.stdout: "type_data": { 2023-08-01T19:56:29.339 INFO:teuthology.orchestra.run.smithi008.stdout: "flag_point": "started", 2023-08-01T19:56:29.339 INFO:teuthology.orchestra.run.smithi008.stdout: "client_info": { 2023-08-01T19:56:29.339 INFO:teuthology.orchestra.run.smithi008.stdout: "client": "client.4668", 2023-08-01T19:56:29.340 INFO:teuthology.orchestra.run.smithi008.stdout: "client_addr": "172.21.15.6:0/1709472247", 2023-08-01T19:56:29.340 INFO:teuthology.orchestra.run.smithi008.stdout: "tid": 256376 2023-08-01T19:56:29.340 INFO:teuthology.orchestra.run.smithi008.stdout: }, 2023-08-01T19:56:29.340 INFO:teuthology.orchestra.run.smithi008.stdout: "events": [ 2023-08-01T19:56:29.340 INFO:teuthology.orchestra.run.smithi008.stdout: { 2023-08-01T19:56:29.340 INFO:teuthology.orchestra.run.smithi008.stdout: "event": "initiated", 2023-08-01T19:56:29.340 INFO:teuthology.orchestra.run.smithi008.stdout: "time": "2023-08-01T19:56:29.255364+0000", 2023-08-01T19:56:29.341 INFO:teuthology.orchestra.run.smithi008.stdout: "duration": 0 2023-08-01T19:56:29.341 INFO:teuthology.orchestra.run.smithi008.stdout: }, 2023-08-01T19:56:29.341 INFO:teuthology.orchestra.run.smithi008.stdout: { 2023-08-01T19:56:29.341 INFO:teuthology.orchestra.run.smithi008.stdout: "event": "throttled", 2023-08-01T19:56:29.341 INFO:teuthology.orchestra.run.smithi008.stdout: "time": "2023-08-01T19:56:29.255364+0000", 2023-08-01T19:56:29.341 INFO:teuthology.orchestra.run.smithi008.stdout: "duration": 0 2023-08-01T19:56:29.341 INFO:teuthology.orchestra.run.smithi008.stdout: }, 2023-08-01T19:56:29.341 INFO:teuthology.orchestra.run.smithi008.stdout: { 2023-08-01T19:56:29.342 INFO:teuthology.orchestra.run.smithi008.stdout: "event": "header_read", 2023-08-01T19:56:29.342 INFO:teuthology.orchestra.run.smithi008.stdout: "time": "2023-08-01T19:56:29.255363+0000", 2023-08-01T19:56:29.342 INFO:teuthology.orchestra.run.smithi008.stdout: "duration": 4294967295.999999 2023-08-01T19:56:29.342 INFO:teuthology.orchestra.run.smithi008.stdout: }, 2023-08-01T19:56:29.342 INFO:teuthology.orchestra.run.smithi008.stdout: { 2023-08-01T19:56:29.342 INFO:teuthology.orchestra.run.smithi008.stdout: "event": "all_read", 2023-08-01T19:56:29.342 INFO:teuthology.orchestra.run.smithi008.stdout: "time": "2023-08-01T19:56:29.255367+0000", 2023-08-01T19:56:29.342 INFO:teuthology.orchestra.run.smithi008.stdout: "duration": 3.9859999999999996e-06 2023-08-01T19:56:29.343 INFO:teuthology.orchestra.run.smithi008.stdout: }, 2023-08-01T19:56:29.343 INFO:teuthology.orchestra.run.smithi008.stdout: { 2023-08-01T19:56:29.343 INFO:teuthology.orchestra.run.smithi008.stdout: "event": "dispatched", 2023-08-01T19:56:29.343 INFO:teuthology.orchestra.run.smithi008.stdout: "time": "2023-08-01T19:56:29.255376+0000", 2023-08-01T19:56:29.343 INFO:teuthology.orchestra.run.smithi008.stdout: "duration": 9.3340000000000008e-06 2023-08-01T19:56:29.343 INFO:teuthology.orchestra.run.smithi008.stdout: }, 2023-08-01T19:56:29.343 INFO:teuthology.orchestra.run.smithi008.stdout: { 2023-08-01T19:56:29.343 INFO:teuthology.orchestra.run.smithi008.stdout: "event": "queued_for_pg", 2023-08-01T19:56:29.344 INFO:teuthology.orchestra.run.smithi008.stdout: "time": "2023-08-01T19:56:29.255382+0000", 2023-08-01T19:56:29.344 INFO:teuthology.orchestra.run.smithi008.stdout: "duration": 5.2750000000000003e-06 2023-08-01T19:56:29.344 INFO:teuthology.orchestra.run.smithi008.stdout: }, 2023-08-01T19:56:29.344 INFO:teuthology.orchestra.run.smithi008.stdout: { 2023-08-01T19:56:29.344 INFO:teuthology.orchestra.run.smithi008.stdout: "event": "reached_pg", 2023-08-01T19:56:29.344 INFO:teuthology.orchestra.run.smithi008.stdout: "time": "2023-08-01T19:56:29.255419+0000", 2023-08-01T19:56:29.344 INFO:teuthology.orchestra.run.smithi008.stdout: "duration": 3.7073000000000002e-05 2023-08-01T19:56:29.344 INFO:teuthology.orchestra.run.smithi008.stdout: }, 2023-08-01T19:56:29.345 INFO:teuthology.orchestra.run.smithi008.stdout: { 2023-08-01T19:56:29.345 INFO:teuthology.orchestra.run.smithi008.stdout: "event": "started", 2023-08-01T19:56:29.345 INFO:teuthology.orchestra.run.smithi008.stdout: "time": "2023-08-01T19:56:29.255538+0000", 2023-08-01T19:56:29.345 INFO:teuthology.orchestra.run.smithi008.stdout: "duration": 0.00011895099999999999 2023-08-01T19:56:29.345 INFO:teuthology.orchestra.run.smithi008.stdout: } 2023-08-01T19:56:29.345 INFO:teuthology.orchestra.run.smithi008.stdout: ] 2023-08-01T19:56:29.345 INFO:teuthology.orchestra.run.smithi008.stdout: } 2023-08-01T19:56:29.345 INFO:teuthology.orchestra.run.smithi008.stdout: }, 2023-08-01T19:56:29.346 INFO:teuthology.orchestra.run.smithi008.stdout: { 2023-08-01T19:56:29.346 INFO:teuthology.orchestra.run.smithi008.stdout: "description": "osd_op(client.4668.0:256377 5.a 5:59180c60:::benchmark_data_smithi006_114134_object122716:head [delete] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e75)", 2023-08-01T19:56:29.346 INFO:teuthology.orchestra.run.smithi008.stdout: "initiated_at": "2023-08-01T19:56:29.255392+0000", 2023-08-01T19:56:29.346 INFO:teuthology.orchestra.run.smithi008.stdout: "age": 0.0020640179999999999, 2023-08-01T19:56:29.346 INFO:teuthology.orchestra.run.smithi008.stdout: "duration": 0.0026786890000000002, 2023-08-01T19:56:29.346 INFO:teuthology.orchestra.run.smithi008.stdout: "type_data": { 2023-08-01T19:56:29.346 INFO:teuthology.orchestra.run.smithi008.stdout: "flag_point": "waiting for sub ops", 2023-08-01T19:56:29.346 INFO:teuthology.orchestra.run.smithi008.stdout: "client_info": { 2023-08-01T19:56:29.347 INFO:teuthology.orchestra.run.smithi008.stdout: "client": "client.4668", 2023-08-01T19:56:29.347 INFO:teuthology.orchestra.run.smithi008.stdout: "client_addr": "172.21.15.6:0/1709472247", 2023-08-01T19:56:29.347 INFO:teuthology.orchestra.run.smithi008.stdout: "tid": 256377 2023-08-01T19:56:29.347 INFO:teuthology.orchestra.run.smithi008.stdout: }, 2023-08-01T19:56:29.347 INFO:teuthology.orchestra.run.smithi008.stdout: "events": [ 2023-08-01T19:56:29.347 INFO:teuthology.orchestra.run.smithi008.stdout: { 2023-08-01T19:56:29.347 INFO:teuthology.orchestra.run.smithi008.stdout: "event": "initiated", 2023-08-01T19:56:29.347 INFO:teuthology.orchestra.run.smithi008.stdout: "time": "2023-08-01T19:56:29.255392+0000", 2023-08-01T19:56:29.348 INFO:teuthology.orchestra.run.smithi008.stdout: "duration": 0 2023-08-01T19:56:29.348 INFO:teuthology.orchestra.run.smithi008.stdout: }, 2023-08-01T19:56:29.348 INFO:teuthology.orchestra.run.smithi008.stdout: { 2023-08-01T19:56:29.348 INFO:teuthology.orchestra.run.smithi008.stdout: "event": "throttled", 2023-08-01T19:56:29.348 INFO:teuthology.orchestra.run.smithi008.stdout: "time": "2023-08-01T19:56:29.255392+0000", 2023-08-01T19:56:29.348 INFO:teuthology.orchestra.run.smithi008.stdout: "duration": 0 2023-08-01T19:56:29.348 INFO:teuthology.orchestra.run.smithi008.stdout: }, 2023-08-01T19:56:29.349 INFO:teuthology.orchestra.run.smithi008.stdout: { 2023-08-01T19:56:29.349 INFO:teuthology.orchestra.run.smithi008.stdout: "event": "header_read", 2023-08-01T19:56:29.349 INFO:teuthology.orchestra.run.smithi008.stdout: "time": "2023-08-01T19:56:29.255391+0000", 2023-08-01T19:56:29.349 INFO:teuthology.orchestra.run.smithi008.stdout: "duration": 4294967295.9999995 2023-08-01T19:56:29.349 INFO:teuthology.orchestra.run.smithi008.stdout: }, 2023-08-01T19:56:29.349 INFO:teuthology.orchestra.run.smithi008.stdout: { 2023-08-01T19:56:29.349 INFO:teuthology.orchestra.run.smithi008.stdout: "event": "all_read", 2023-08-01T19:56:29.349 INFO:teuthology.orchestra.run.smithi008.stdout: "time": "2023-08-01T19:56:29.255394+0000", 2023-08-01T19:56:29.350 INFO:teuthology.orchestra.run.smithi008.stdout: "duration": 2.7930000000000002e-06 2023-08-01T19:56:29.350 INFO:teuthology.orchestra.run.smithi008.stdout: }, 2023-08-01T19:56:29.350 INFO:teuthology.orchestra.run.smithi008.stdout: { 2023-08-01T19:56:29.350 INFO:teuthology.orchestra.run.smithi008.stdout: "event": "dispatched", 2023-08-01T19:56:29.350 INFO:teuthology.orchestra.run.smithi008.stdout: "time": "2023-08-01T19:56:29.255401+0000", 2023-08-01T19:56:29.350 INFO:teuthology.orchestra.run.smithi008.stdout: "duration": 6.7789999999999998e-06 2023-08-01T19:56:29.350 INFO:teuthology.orchestra.run.smithi008.stdout: }, 2023-08-01T19:56:29.350 INFO:teuthology.orchestra.run.smithi008.stdout: { 2023-08-01T19:56:29.351 INFO:teuthology.orchestra.run.smithi008.stdout: "event": "queued_for_pg", 2023-08-01T19:56:29.351 INFO:teuthology.orchestra.run.smithi008.stdout: "time": "2023-08-01T19:56:29.255405+0000", 2023-08-01T19:56:29.351 INFO:teuthology.orchestra.run.smithi008.stdout: "duration": 4.0269999999999997e-06 2023-08-01T19:56:29.351 INFO:teuthology.orchestra.run.smithi008.stdout: }, 2023-08-01T19:56:29.351 INFO:teuthology.orchestra.run.smithi008.stdout: { 2023-08-01T19:56:29.351 INFO:teuthology.orchestra.run.smithi008.stdout: "event": "reached_pg", 2023-08-01T19:56:29.351 INFO:teuthology.orchestra.run.smithi008.stdout: "time": "2023-08-01T19:56:29.255687+0000", 2023-08-01T19:56:29.351 INFO:teuthology.orchestra.run.smithi008.stdout: "duration": 0.00028195 2023-08-01T19:56:29.352 INFO:teuthology.orchestra.run.smithi008.stdout: }, 2023-08-01T19:56:29.352 INFO:teuthology.orchestra.run.smithi008.stdout: { 2023-08-01T19:56:29.352 INFO:teuthology.orchestra.run.smithi008.stdout: "event": "started", 2023-08-01T19:56:29.352 INFO:teuthology.orchestra.run.smithi008.stdout: "time": "2023-08-01T19:56:29.255802+0000", 2023-08-01T19:56:29.352 INFO:teuthology.orchestra.run.smithi008.stdout: "duration": 0.000114799 2023-08-01T19:56:29.352 INFO:teuthology.orchestra.run.smithi008.stdout: }, 2023-08-01T19:56:29.352 INFO:teuthology.orchestra.run.smithi008.stdout: { 2023-08-01T19:56:29.353 INFO:teuthology.orchestra.run.smithi008.stdout: "event": "waiting for subops from 2", 2023-08-01T19:56:29.353 INFO:teuthology.orchestra.run.smithi008.stdout: "time": "2023-08-01T19:56:29.255913+0000", 2023-08-01T19:56:29.353 INFO:teuthology.orchestra.run.smithi008.stdout: "duration": 0.000111353 2023-08-01T19:56:29.353 INFO:teuthology.orchestra.run.smithi008.stdout: } 2023-08-01T19:56:29.353 INFO:teuthology.orchestra.run.smithi008.stdout: ] 2023-08-01T19:56:29.353 INFO:teuthology.orchestra.run.smithi008.stdout: } 2023-08-01T19:56:29.353 INFO:teuthology.orchestra.run.smithi008.stdout: } 2023-08-01T19:56:29.353 INFO:teuthology.orchestra.run.smithi008.stdout: ], 2023-08-01T19:56:29.354 INFO:teuthology.orchestra.run.smithi008.stdout: "num_ops": 13 2023-08-01T19:56:29.354 INFO:teuthology.orchestra.run.smithi008.stdout:} 2023-08-01T19:56:29.355 DEBUG:teuthology.orchestra.run.smithi008:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 30 ceph --cluster ceph --admin-daemon /var/run/ceph/ceph-osd.0.asok dump_blocked_ops 2023-08-01T19:56:29.355 INFO:tasks.ceph.osd.0.smithi008.stderr:2023-08-01T19:56:29.354+0000 7f16a58f4700 -1 received signal: Hangup from /usr/bin/python3 /bin/daemon-helper kill ceph-osd -f --cluster ceph -i 0 (PID: 111179) UID: 0 2023-08-01T19:56:29.455 INFO:tasks.ceph.osd.0.smithi008.stderr:2023-08-01T19:56:29.455+0000 7f16a58f4700 -1 received signal: Hangup from /usr/bin/python3 /bin/daemon-helper kill ceph-osd -f --cluster ceph -i 0 (PID: 111179) UID: 0 2023-08-01T19:56:29.557 INFO:tasks.ceph.osd.0.smithi008.stderr:2023-08-01T19:56:29.556+0000 7f16a58f4700 -1 received signal: Hangup from /usr/bin/python3 /bin/daemon-helper kill ceph-osd -f --cluster ceph -i 0 (PID: 111179) UID: 0 2023-08-01T19:56:29.576 INFO:teuthology.orchestra.run.smithi008.stdout:{ 2023-08-01T19:56:29.577 INFO:teuthology.orchestra.run.smithi008.stdout: "ops": [], 2023-08-01T19:56:29.577 INFO:teuthology.orchestra.run.smithi008.stdout: "complaint_time": 30, 2023-08-01T19:56:29.577 INFO:teuthology.orchestra.run.smithi008.stdout: "num_blocked_ops": 0 2023-08-01T19:56:29.577 INFO:teuthology.orchestra.run.smithi008.stdout:} 2023-08-01T19:56:29.592 DEBUG:teuthology.orchestra.run.smithi008:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 30 ceph --cluster ceph --admin-daemon /var/run/ceph/ceph-osd.0.asok dump_historic_ops 2023-08-01T19:56:29.676 INFO:tasks.ceph.osd.0.smithi008.stderr:2023-08-01T19:56:29.676+0000 7f16a58f4700 -1 received signal: Hangup from /usr/bin/python3 /bin/daemon-helper kill ceph-osd -f --cluster ceph -i 0 (PID: 111179) UID: 0 2023-08-01T19:56:29.759 INFO:tasks.ceph.osd.0.smithi008.stderr:2023-08-01T19:56:29.758+0000 7f16a58f4700 -1 received signal: Hangup from /usr/bin/python3 /bin/daemon-helper kill ceph-osd -f --cluster ceph -i 0 (PID: 111179) UID: 0 2023-08-01T19:56:29.820 INFO:teuthology.orchestra.run.smithi008.stdout:{ 2023-08-01T19:56:29.820 INFO:teuthology.orchestra.run.smithi008.stdout: "size": 20, 2023-08-01T19:56:29.820 INFO:teuthology.orchestra.run.smithi008.stdout: "duration": 600, 2023-08-01T19:56:29.820 INFO:teuthology.orchestra.run.smithi008.stdout: "ops": [ 2023-08-01T19:56:29.821 INFO:teuthology.orchestra.run.smithi008.stdout: { 2023-08-01T19:56:29.821 INFO:teuthology.orchestra.run.smithi008.stdout: "description": "osd_op(client.4668.0:100240 5.a 5:5313c5b9:::benchmark_data_smithi006_114134_object100239:head [set-alloc-hint object_size 65536 write_size 65536,write 0~65536] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e37)", 2023-08-01T19:56:29.821 INFO:teuthology.orchestra.run.smithi008.stdout: "initiated_at": "2023-08-01T19:55:05.148399+0000", 2023-08-01T19:56:29.821 INFO:teuthology.orchestra.run.smithi008.stdout: "age": 84.668685280000005, 2023-08-01T19:56:29.821 INFO:teuthology.orchestra.run.smithi008.stdout: "duration": 0.077278904999999995, 2023-08-01T19:56:29.821 INFO:teuthology.orchestra.run.smithi008.stdout: "type_data": { 2023-08-01T19:56:29.821 INFO:teuthology.orchestra.run.smithi008.stdout: "flag_point": "commit sent; apply or cleanup", 2023-08-01T19:56:29.822 INFO:teuthology.orchestra.run.smithi008.stdout: "client_info": { 2023-08-01T19:56:29.822 INFO:teuthology.orchestra.run.smithi008.stdout: "client": "client.4668", 2023-08-01T19:56:29.822 INFO:teuthology.orchestra.run.smithi008.stdout: "client_addr": "172.21.15.6:0/1709472247", 2023-08-01T19:56:29.822 INFO:teuthology.orchestra.run.smithi008.stdout: "tid": 100240 2023-08-01T19:56:29.822 INFO:teuthology.orchestra.run.smithi008.stdout: }, 2023-08-01T19:56:29.822 INFO:teuthology.orchestra.run.smithi008.stdout: "events": [ 2023-08-01T19:56:29.822 INFO:teuthology.orchestra.run.smithi008.stdout: { 2023-08-01T19:56:29.822 INFO:teuthology.orchestra.run.smithi008.stdout: "event": "initiated", 2023-08-01T19:56:29.823 INFO:teuthology.orchestra.run.smithi008.stdout: "time": "2023-08-01T19:55:05.148399+0000", 2023-08-01T19:56:29.823 INFO:teuthology.orchestra.run.smithi008.stdout: "duration": 0 2023-08-01T19:56:29.823 INFO:teuthology.orchestra.run.smithi008.stdout: }, 2023-08-01T19:56:29.823 INFO:teuthology.orchestra.run.smithi008.stdout: { 2023-08-01T19:56:29.823 INFO:teuthology.orchestra.run.smithi008.stdout: "event": "throttled", 2023-08-01T19:56:29.823 INFO:teuthology.orchestra.run.smithi008.stdout: "time": "2023-08-01T19:55:05.148399+0000", 2023-08-01T19:56:29.823 INFO:teuthology.orchestra.run.smithi008.stdout: "duration": 0 2023-08-01T19:56:29.824 INFO:teuthology.orchestra.run.smithi008.stdout: }, 2023-08-01T19:56:29.824 INFO:teuthology.orchestra.run.smithi008.stdout: { 2023-08-01T19:56:29.824 INFO:teuthology.orchestra.run.smithi008.stdout: "event": "header_read", 2023-08-01T19:56:29.824 INFO:teuthology.orchestra.run.smithi008.stdout: "time": "2023-08-01T19:55:05.148398+0000", 2023-08-01T19:56:29.824 INFO:teuthology.orchestra.run.smithi008.stdout: "duration": 4294967295.999999 2023-08-01T19:56:29.824 INFO:teuthology.orchestra.run.smithi008.stdout: }, 2023-08-01T19:56:29.824 INFO:teuthology.orchestra.run.smithi008.stdout: { 2023-08-01T19:56:29.824 INFO:teuthology.orchestra.run.smithi008.stdout: "event": "all_read", 2023-08-01T19:56:29.825 INFO:teuthology.orchestra.run.smithi008.stdout: "time": "2023-08-01T19:55:05.148492+0000", 2023-08-01T19:56:29.825 INFO:teuthology.orchestra.run.smithi008.stdout: "duration": 9.3892000000000002e-05 2023-08-01T19:56:29.825 INFO:teuthology.orchestra.run.smithi008.stdout: }, 2023-08-01T19:56:29.825 INFO:teuthology.orchestra.run.smithi008.stdout: { 2023-08-01T19:56:29.825 INFO:teuthology.orchestra.run.smithi008.stdout: "event": "dispatched", 2023-08-01T19:56:29.825 INFO:teuthology.orchestra.run.smithi008.stdout: "time": "2023-08-01T19:55:05.148503+0000", 2023-08-01T19:56:29.825 INFO:teuthology.orchestra.run.smithi008.stdout: "duration": 1.0951000000000001e-05 2023-08-01T19:56:29.825 INFO:teuthology.orchestra.run.smithi008.stdout: }, 2023-08-01T19:56:29.826 INFO:teuthology.orchestra.run.smithi008.stdout: { 2023-08-01T19:56:29.826 INFO:teuthology.orchestra.run.smithi008.stdout: "event": "queued_for_pg", 2023-08-01T19:56:29.826 INFO:teuthology.orchestra.run.smithi008.stdout: "time": "2023-08-01T19:55:05.148508+0000", 2023-08-01T19:56:29.826 INFO:teuthology.orchestra.run.smithi008.stdout: "duration": 5.0080000000000002e-06 2023-08-01T19:56:29.826 INFO:teuthology.orchestra.run.smithi008.stdout: }, 2023-08-01T19:56:29.826 INFO:teuthology.orchestra.run.smithi008.stdout: { 2023-08-01T19:56:29.826 INFO:teuthology.orchestra.run.smithi008.stdout: "event": "reached_pg", 2023-08-01T19:56:29.827 INFO:teuthology.orchestra.run.smithi008.stdout: "time": "2023-08-01T19:55:05.148548+0000", 2023-08-01T19:56:29.827 INFO:teuthology.orchestra.run.smithi008.stdout: "duration": 4.0358999999999998e-05 2023-08-01T19:56:29.827 INFO:teuthology.orchestra.run.smithi008.stdout: }, 2023-08-01T19:56:29.827 INFO:teuthology.orchestra.run.smithi008.stdout: { 2023-08-01T19:56:29.827 INFO:teuthology.orchestra.run.smithi008.stdout: "event": "started", 2023-08-01T19:56:29.827 INFO:teuthology.orchestra.run.smithi008.stdout: "time": "2023-08-01T19:55:05.148666+0000", 2023-08-01T19:56:29.827 INFO:teuthology.orchestra.run.smithi008.stdout: "duration": 0.000117621 2023-08-01T19:56:29.827 INFO:teuthology.orchestra.run.smithi008.stdout: }, 2023-08-01T19:56:29.828 INFO:teuthology.orchestra.run.smithi008.stdout: { 2023-08-01T19:56:29.828 INFO:teuthology.orchestra.run.smithi008.stdout: "event": "waiting for subops from 2", 2023-08-01T19:56:29.828 INFO:teuthology.orchestra.run.smithi008.stdout: "time": "2023-08-01T19:55:05.148805+0000", 2023-08-01T19:56:29.828 INFO:teuthology.orchestra.run.smithi008.stdout: "duration": 0.000139176 2023-08-01T19:56:29.828 INFO:teuthology.orchestra.run.smithi008.stdout: }, 2023-08-01T19:56:29.828 INFO:teuthology.orchestra.run.smithi008.stdout: { 2023-08-01T19:56:29.828 INFO:teuthology.orchestra.run.smithi008.stdout: "event": "op_commit", 2023-08-01T19:56:29.828 INFO:teuthology.orchestra.run.smithi008.stdout: "time": "2023-08-01T19:55:05.156143+0000", 2023-08-01T19:56:29.829 INFO:teuthology.orchestra.run.smithi008.stdout: "duration": 0.007338041 2023-08-01T19:56:29.829 INFO:teuthology.orchestra.run.smithi008.stdout: }, 2023-08-01T19:56:29.829 INFO:teuthology.orchestra.run.smithi008.stdout: { 2023-08-01T19:56:29.829 INFO:teuthology.orchestra.run.smithi008.stdout: "event": "sub_op_commit_rec", 2023-08-01T19:56:29.829 INFO:teuthology.orchestra.run.smithi008.stdout: "time": "2023-08-01T19:55:05.225581+0000", 2023-08-01T19:56:29.829 INFO:teuthology.orchestra.run.smithi008.stdout: "duration": 0.069438402999999996 2023-08-01T19:56:29.829 INFO:teuthology.orchestra.run.smithi008.stdout: }, 2023-08-01T19:56:29.830 INFO:teuthology.orchestra.run.smithi008.stdout: { 2023-08-01T19:56:29.830 INFO:teuthology.orchestra.run.smithi008.stdout: "event": "commit_sent", 2023-08-01T19:56:29.830 INFO:teuthology.orchestra.run.smithi008.stdout: "time": "2023-08-01T19:55:05.225632+0000", 2023-08-01T19:56:29.830 INFO:teuthology.orchestra.run.smithi008.stdout: "duration": 5.0382e-05 2023-08-01T19:56:29.830 INFO:teuthology.orchestra.run.smithi008.stdout: }, 2023-08-01T19:56:29.830 INFO:teuthology.orchestra.run.smithi008.stdout: { 2023-08-01T19:56:29.830 INFO:teuthology.orchestra.run.smithi008.stdout: "event": "done", 2023-08-01T19:56:29.830 INFO:teuthology.orchestra.run.smithi008.stdout: "time": "2023-08-01T19:55:05.225677+0000", 2023-08-01T19:56:29.831 INFO:teuthology.orchestra.run.smithi008.stdout: "duration": 4.5893000000000003e-05 2023-08-01T19:56:29.831 INFO:teuthology.orchestra.run.smithi008.stdout: } 2023-08-01T19:56:29.831 INFO:teuthology.orchestra.run.smithi008.stdout: ] 2023-08-01T19:56:29.831 INFO:teuthology.orchestra.run.smithi008.stdout: } 2023-08-01T19:56:29.831 INFO:teuthology.orchestra.run.smithi008.stdout: }, 2023-08-01T19:56:29.831 INFO:teuthology.orchestra.run.smithi008.stdout: { 2023-08-01T19:56:29.831 INFO:teuthology.orchestra.run.smithi008.stdout: "description": "osd_op(client.4668.0:100243 5.a 5:5e8193b6:::benchmark_data_smithi006_114134_object100242:head [set-alloc-hint object_size 65536 write_size 65536,write 0~65536] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e37)", 2023-08-01T19:56:29.831 INFO:teuthology.orchestra.run.smithi008.stdout: "initiated_at": "2023-08-01T19:55:05.150737+0000", 2023-08-01T19:56:29.832 INFO:teuthology.orchestra.run.smithi008.stdout: "age": 84.666346825000005, 2023-08-01T19:56:29.832 INFO:teuthology.orchestra.run.smithi008.stdout: "duration": 0.075019885999999994, 2023-08-01T19:56:29.832 INFO:teuthology.orchestra.run.smithi008.stdout: "type_data": { 2023-08-01T19:56:29.832 INFO:teuthology.orchestra.run.smithi008.stdout: "flag_point": "commit sent; apply or cleanup", 2023-08-01T19:56:29.832 INFO:teuthology.orchestra.run.smithi008.stdout: "client_info": { 2023-08-01T19:56:29.832 INFO:teuthology.orchestra.run.smithi008.stdout: "client": "client.4668", 2023-08-01T19:56:29.832 INFO:teuthology.orchestra.run.smithi008.stdout: "client_addr": "172.21.15.6:0/1709472247", 2023-08-01T19:56:29.833 INFO:teuthology.orchestra.run.smithi008.stdout: "tid": 100243 2023-08-01T19:56:29.833 INFO:teuthology.orchestra.run.smithi008.stdout: }, 2023-08-01T19:56:29.833 INFO:teuthology.orchestra.run.smithi008.stdout: "events": [ 2023-08-01T19:56:29.833 INFO:teuthology.orchestra.run.smithi008.stdout: { 2023-08-01T19:56:29.833 INFO:teuthology.orchestra.run.smithi008.stdout: "event": "initiated", 2023-08-01T19:56:29.833 INFO:teuthology.orchestra.run.smithi008.stdout: "time": "2023-08-01T19:55:05.150737+0000", 2023-08-01T19:56:29.833 INFO:teuthology.orchestra.run.smithi008.stdout: "duration": 0 2023-08-01T19:56:29.833 INFO:teuthology.orchestra.run.smithi008.stdout: }, 2023-08-01T19:56:29.834 INFO:teuthology.orchestra.run.smithi008.stdout: { 2023-08-01T19:56:29.834 INFO:teuthology.orchestra.run.smithi008.stdout: "event": "throttled", 2023-08-01T19:56:29.834 INFO:teuthology.orchestra.run.smithi008.stdout: "time": "2023-08-01T19:55:05.150737+0000", 2023-08-01T19:56:29.834 INFO:teuthology.orchestra.run.smithi008.stdout: "duration": 0 2023-08-01T19:56:29.834 INFO:teuthology.orchestra.run.smithi008.stdout: }, 2023-08-01T19:56:29.834 INFO:teuthology.orchestra.run.smithi008.stdout: { 2023-08-01T19:56:29.834 INFO:teuthology.orchestra.run.smithi008.stdout: "event": "header_read", 2023-08-01T19:56:29.834 INFO:teuthology.orchestra.run.smithi008.stdout: "time": "2023-08-01T19:55:05.150736+0000", 2023-08-01T19:56:29.835 INFO:teuthology.orchestra.run.smithi008.stdout: "duration": 4294967295.999999 2023-08-01T19:56:29.835 INFO:teuthology.orchestra.run.smithi008.stdout: }, 2023-08-01T19:56:29.835 INFO:teuthology.orchestra.run.smithi008.stdout: { 2023-08-01T19:56:29.835 INFO:teuthology.orchestra.run.smithi008.stdout: "event": "all_read", 2023-08-01T19:56:29.835 INFO:teuthology.orchestra.run.smithi008.stdout: "time": "2023-08-01T19:55:05.150780+0000", 2023-08-01T19:56:29.835 INFO:teuthology.orchestra.run.smithi008.stdout: "duration": 4.3578999999999997e-05 2023-08-01T19:56:29.835 INFO:teuthology.orchestra.run.smithi008.stdout: }, 2023-08-01T19:56:29.835 INFO:teuthology.orchestra.run.smithi008.stdout: { 2023-08-01T19:56:29.836 INFO:teuthology.orchestra.run.smithi008.stdout: "event": "dispatched", 2023-08-01T19:56:29.836 INFO:teuthology.orchestra.run.smithi008.stdout: "time": "2023-08-01T19:55:05.150791+0000", 2023-08-01T19:56:29.836 INFO:teuthology.orchestra.run.smithi008.stdout: "duration": 1.0963e-05 2023-08-01T19:56:29.836 INFO:teuthology.orchestra.run.smithi008.stdout: }, 2023-08-01T19:56:29.836 INFO:teuthology.orchestra.run.smithi008.stdout: { 2023-08-01T19:56:29.836 INFO:teuthology.orchestra.run.smithi008.stdout: "event": "queued_for_pg", 2023-08-01T19:56:29.836 INFO:teuthology.orchestra.run.smithi008.stdout: "time": "2023-08-01T19:55:05.150797+0000", 2023-08-01T19:56:29.836 INFO:teuthology.orchestra.run.smithi008.stdout: "duration": 5.9780000000000002e-06 2023-08-01T19:56:29.837 INFO:teuthology.orchestra.run.smithi008.stdout: }, 2023-08-01T19:56:29.837 INFO:teuthology.orchestra.run.smithi008.stdout: { 2023-08-01T19:56:29.837 INFO:teuthology.orchestra.run.smithi008.stdout: "event": "reached_pg", 2023-08-01T19:56:29.837 INFO:teuthology.orchestra.run.smithi008.stdout: "time": "2023-08-01T19:55:05.150833+0000", 2023-08-01T19:56:29.837 INFO:teuthology.orchestra.run.smithi008.stdout: "duration": 3.6000000000000001e-05 2023-08-01T19:56:29.837 INFO:teuthology.orchestra.run.smithi008.stdout: }, 2023-08-01T19:56:29.837 INFO:teuthology.orchestra.run.smithi008.stdout: { 2023-08-01T19:56:29.837 INFO:teuthology.orchestra.run.smithi008.stdout: "event": "started", 2023-08-01T19:56:29.838 INFO:teuthology.orchestra.run.smithi008.stdout: "time": "2023-08-01T19:55:05.150951+0000", 2023-08-01T19:56:29.838 INFO:teuthology.orchestra.run.smithi008.stdout: "duration": 0.00011827799999999999 2023-08-01T19:56:29.838 INFO:teuthology.orchestra.run.smithi008.stdout: }, 2023-08-01T19:56:29.838 INFO:teuthology.orchestra.run.smithi008.stdout: { 2023-08-01T19:56:29.838 INFO:teuthology.orchestra.run.smithi008.stdout: "event": "waiting for subops from 2", 2023-08-01T19:56:29.838 INFO:teuthology.orchestra.run.smithi008.stdout: "time": "2023-08-01T19:55:05.151111+0000", 2023-08-01T19:56:29.838 INFO:teuthology.orchestra.run.smithi008.stdout: "duration": 0.00015961299999999999 2023-08-01T19:56:29.838 INFO:teuthology.orchestra.run.smithi008.stdout: }, 2023-08-01T19:56:29.839 INFO:teuthology.orchestra.run.smithi008.stdout: { 2023-08-01T19:56:29.839 INFO:teuthology.orchestra.run.smithi008.stdout: "event": "op_commit", 2023-08-01T19:56:29.839 INFO:teuthology.orchestra.run.smithi008.stdout: "time": "2023-08-01T19:55:05.156247+0000", 2023-08-01T19:56:29.839 INFO:teuthology.orchestra.run.smithi008.stdout: "duration": 0.005136524 2023-08-01T19:56:29.839 INFO:teuthology.orchestra.run.smithi008.stdout: }, 2023-08-01T19:56:29.839 INFO:teuthology.orchestra.run.smithi008.stdout: { 2023-08-01T19:56:29.839 INFO:teuthology.orchestra.run.smithi008.stdout: "event": "sub_op_commit_rec", 2023-08-01T19:56:29.840 INFO:teuthology.orchestra.run.smithi008.stdout: "time": "2023-08-01T19:55:05.225705+0000", 2023-08-01T19:56:29.840 INFO:teuthology.orchestra.run.smithi008.stdout: "duration": 0.069458377000000002 2023-08-01T19:56:29.840 INFO:teuthology.orchestra.run.smithi008.stdout: }, 2023-08-01T19:56:29.840 INFO:teuthology.orchestra.run.smithi008.stdout: { 2023-08-01T19:56:29.840 INFO:teuthology.orchestra.run.smithi008.stdout: "event": "commit_sent", 2023-08-01T19:56:29.840 INFO:teuthology.orchestra.run.smithi008.stdout: "time": "2023-08-01T19:55:05.225736+0000", 2023-08-01T19:56:29.840 INFO:teuthology.orchestra.run.smithi008.stdout: "duration": 3.0388000000000001e-05 2023-08-01T19:56:29.840 INFO:teuthology.orchestra.run.smithi008.stdout: }, 2023-08-01T19:56:29.841 INFO:teuthology.orchestra.run.smithi008.stdout: { 2023-08-01T19:56:29.841 INFO:teuthology.orchestra.run.smithi008.stdout: "event": "done", 2023-08-01T19:56:29.841 INFO:teuthology.orchestra.run.smithi008.stdout: "time": "2023-08-01T19:55:05.225757+0000", 2023-08-01T19:56:29.841 INFO:teuthology.orchestra.run.smithi008.stdout: "duration": 2.1090999999999998e-05 2023-08-01T19:56:29.841 INFO:teuthology.orchestra.run.smithi008.stdout: } 2023-08-01T19:56:29.841 INFO:teuthology.orchestra.run.smithi008.stdout: ] 2023-08-01T19:56:29.841 INFO:teuthology.orchestra.run.smithi008.stdout: } 2023-08-01T19:56:29.841 INFO:teuthology.orchestra.run.smithi008.stdout: }, 2023-08-01T19:56:29.842 INFO:teuthology.orchestra.run.smithi008.stdout: { 2023-08-01T19:56:29.842 INFO:teuthology.orchestra.run.smithi008.stdout: "description": "osd_op(client.4668.0:100933 5.5 5:af92e9f2:::benchmark_data_smithi006_114134_object100932:head [set-alloc-hint object_size 65536 write_size 65536,write 0~65536] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e37)", 2023-08-01T19:56:29.842 INFO:teuthology.orchestra.run.smithi008.stdout: "initiated_at": "2023-08-01T19:55:05.566634+0000", 2023-08-01T19:56:29.842 INFO:teuthology.orchestra.run.smithi008.stdout: "age": 84.250449954000004, 2023-08-01T19:56:29.842 INFO:teuthology.orchestra.run.smithi008.stdout: "duration": 0.065909364999999998, 2023-08-01T19:56:29.842 INFO:teuthology.orchestra.run.smithi008.stdout: "type_data": { 2023-08-01T19:56:29.842 INFO:teuthology.orchestra.run.smithi008.stdout: "flag_point": "commit sent; apply or cleanup", 2023-08-01T19:56:29.842 INFO:teuthology.orchestra.run.smithi008.stdout: "client_info": { 2023-08-01T19:56:29.843 INFO:teuthology.orchestra.run.smithi008.stdout: "client": "client.4668", 2023-08-01T19:56:29.843 INFO:teuthology.orchestra.run.smithi008.stdout: "client_addr": "172.21.15.6:0/1709472247", 2023-08-01T19:56:29.843 INFO:teuthology.orchestra.run.smithi008.stdout: "tid": 100933 2023-08-01T19:56:29.843 INFO:teuthology.orchestra.run.smithi008.stdout: }, 2023-08-01T19:56:29.843 INFO:teuthology.orchestra.run.smithi008.stdout: "events": [ 2023-08-01T19:56:29.843 INFO:teuthology.orchestra.run.smithi008.stdout: { 2023-08-01T19:56:29.843 INFO:teuthology.orchestra.run.smithi008.stdout: "event": "initiated", 2023-08-01T19:56:29.844 INFO:teuthology.orchestra.run.smithi008.stdout: "time": "2023-08-01T19:55:05.566634+0000", 2023-08-01T19:56:29.844 INFO:teuthology.orchestra.run.smithi008.stdout: "duration": 0 2023-08-01T19:56:29.844 INFO:teuthology.orchestra.run.smithi008.stdout: }, 2023-08-01T19:56:29.844 INFO:teuthology.orchestra.run.smithi008.stdout: { 2023-08-01T19:56:29.844 INFO:teuthology.orchestra.run.smithi008.stdout: "event": "throttled", 2023-08-01T19:56:29.844 INFO:teuthology.orchestra.run.smithi008.stdout: "time": "2023-08-01T19:55:05.566634+0000", 2023-08-01T19:56:29.844 INFO:teuthology.orchestra.run.smithi008.stdout: "duration": 0 2023-08-01T19:56:29.845 INFO:teuthology.orchestra.run.smithi008.stdout: }, 2023-08-01T19:56:29.845 INFO:teuthology.orchestra.run.smithi008.stdout: { 2023-08-01T19:56:29.845 INFO:teuthology.orchestra.run.smithi008.stdout: "event": "header_read", 2023-08-01T19:56:29.845 INFO:teuthology.orchestra.run.smithi008.stdout: "time": "2023-08-01T19:55:05.566630+0000", 2023-08-01T19:56:29.845 INFO:teuthology.orchestra.run.smithi008.stdout: "duration": 4294967295.9999962 2023-08-01T19:56:29.845 INFO:teuthology.orchestra.run.smithi008.stdout: }, 2023-08-01T19:56:29.845 INFO:teuthology.orchestra.run.smithi008.stdout: { 2023-08-01T19:56:29.845 INFO:teuthology.orchestra.run.smithi008.stdout: "event": "all_read", 2023-08-01T19:56:29.846 INFO:teuthology.orchestra.run.smithi008.stdout: "time": "2023-08-01T19:55:05.566736+0000", 2023-08-01T19:56:29.846 INFO:teuthology.orchestra.run.smithi008.stdout: "duration": 0.000105752 2023-08-01T19:56:29.846 INFO:teuthology.orchestra.run.smithi008.stdout: }, 2023-08-01T19:56:29.846 INFO:teuthology.orchestra.run.smithi008.stdout: { 2023-08-01T19:56:29.846 INFO:teuthology.orchestra.run.smithi008.stdout: "event": "dispatched", 2023-08-01T19:56:29.846 INFO:teuthology.orchestra.run.smithi008.stdout: "time": "2023-08-01T19:55:05.566742+0000", 2023-08-01T19:56:29.846 INFO:teuthology.orchestra.run.smithi008.stdout: "duration": 5.8209999999999998e-06 2023-08-01T19:56:29.846 INFO:teuthology.orchestra.run.smithi008.stdout: }, 2023-08-01T19:56:29.847 INFO:teuthology.orchestra.run.smithi008.stdout: { 2023-08-01T19:56:29.847 INFO:teuthology.orchestra.run.smithi008.stdout: "event": "queued_for_pg", 2023-08-01T19:56:29.847 INFO:teuthology.orchestra.run.smithi008.stdout: "time": "2023-08-01T19:55:05.566745+0000", 2023-08-01T19:56:29.847 INFO:teuthology.orchestra.run.smithi008.stdout: "duration": 3.337e-06 2023-08-01T19:56:29.847 INFO:teuthology.orchestra.run.smithi008.stdout: }, 2023-08-01T19:56:29.847 INFO:teuthology.orchestra.run.smithi008.stdout: { 2023-08-01T19:56:29.847 INFO:teuthology.orchestra.run.smithi008.stdout: "event": "reached_pg", 2023-08-01T19:56:29.848 INFO:teuthology.orchestra.run.smithi008.stdout: "time": "2023-08-01T19:55:05.568175+0000", 2023-08-01T19:56:29.848 INFO:teuthology.orchestra.run.smithi008.stdout: "duration": 0.001429647 2023-08-01T19:56:29.848 INFO:teuthology.orchestra.run.smithi008.stdout: }, 2023-08-01T19:56:29.848 INFO:teuthology.orchestra.run.smithi008.stdout: { 2023-08-01T19:56:29.848 INFO:teuthology.orchestra.run.smithi008.stdout: "event": "started", 2023-08-01T19:56:29.848 INFO:teuthology.orchestra.run.smithi008.stdout: "time": "2023-08-01T19:55:05.568288+0000", 2023-08-01T19:56:29.848 INFO:teuthology.orchestra.run.smithi008.stdout: "duration": 0.000113353 2023-08-01T19:56:29.848 INFO:teuthology.orchestra.run.smithi008.stdout: }, 2023-08-01T19:56:29.849 INFO:teuthology.orchestra.run.smithi008.stdout: { 2023-08-01T19:56:29.849 INFO:teuthology.orchestra.run.smithi008.stdout: "event": "waiting for subops from 1", 2023-08-01T19:56:29.849 INFO:teuthology.orchestra.run.smithi008.stdout: "time": "2023-08-01T19:55:05.568425+0000", 2023-08-01T19:56:29.849 INFO:teuthology.orchestra.run.smithi008.stdout: "duration": 0.000137346 2023-08-01T19:56:29.849 INFO:teuthology.orchestra.run.smithi008.stdout: }, 2023-08-01T19:56:29.849 INFO:teuthology.orchestra.run.smithi008.stdout: { 2023-08-01T19:56:29.849 INFO:teuthology.orchestra.run.smithi008.stdout: "event": "sub_op_commit_rec", 2023-08-01T19:56:29.849 INFO:teuthology.orchestra.run.smithi008.stdout: "time": "2023-08-01T19:55:05.629320+0000", 2023-08-01T19:56:29.850 INFO:teuthology.orchestra.run.smithi008.stdout: "duration": 0.060894491000000002 2023-08-01T19:56:29.850 INFO:teuthology.orchestra.run.smithi008.stdout: }, 2023-08-01T19:56:29.850 INFO:teuthology.orchestra.run.smithi008.stdout: { 2023-08-01T19:56:29.850 INFO:teuthology.orchestra.run.smithi008.stdout: "event": "op_commit", 2023-08-01T19:56:29.850 INFO:teuthology.orchestra.run.smithi008.stdout: "time": "2023-08-01T19:55:05.632452+0000", 2023-08-01T19:56:29.850 INFO:teuthology.orchestra.run.smithi008.stdout: "duration": 0.003131909 2023-08-01T19:56:29.850 INFO:teuthology.orchestra.run.smithi008.stdout: }, 2023-08-01T19:56:29.850 INFO:teuthology.orchestra.run.smithi008.stdout: { 2023-08-01T19:56:29.851 INFO:teuthology.orchestra.run.smithi008.stdout: "event": "commit_sent", 2023-08-01T19:56:29.851 INFO:teuthology.orchestra.run.smithi008.stdout: "time": "2023-08-01T19:55:05.632503+0000", 2023-08-01T19:56:29.851 INFO:teuthology.orchestra.run.smithi008.stdout: "duration": 5.1295000000000003e-05 2023-08-01T19:56:29.851 INFO:teuthology.orchestra.run.smithi008.stdout: }, 2023-08-01T19:56:29.851 INFO:teuthology.orchestra.run.smithi008.stdout: { 2023-08-01T19:56:29.851 INFO:teuthology.orchestra.run.smithi008.stdout: "event": "done", 2023-08-01T19:56:29.851 INFO:teuthology.orchestra.run.smithi008.stdout: "time": "2023-08-01T19:55:05.632543+0000", 2023-08-01T19:56:29.852 INFO:teuthology.orchestra.run.smithi008.stdout: "duration": 4.0234000000000001e-05 2023-08-01T19:56:29.852 INFO:teuthology.orchestra.run.smithi008.stdout: } 2023-08-01T19:56:29.852 INFO:teuthology.orchestra.run.smithi008.stdout: ] 2023-08-01T19:56:29.852 INFO:teuthology.orchestra.run.smithi008.stdout: } 2023-08-01T19:56:29.852 INFO:teuthology.orchestra.run.smithi008.stdout: }, 2023-08-01T19:56:29.852 INFO:teuthology.orchestra.run.smithi008.stdout: { 2023-08-01T19:56:29.852 INFO:teuthology.orchestra.run.smithi008.stdout: "description": "osd_op(client.4668.0:100939 5.5 5:a75fa6e3:::benchmark_data_smithi006_114134_object100938:head [set-alloc-hint object_size 65536 write_size 65536,write 0~65536] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e37)", 2023-08-01T19:56:29.852 INFO:teuthology.orchestra.run.smithi008.stdout: "initiated_at": "2023-08-01T19:55:05.569740+0000", 2023-08-01T19:56:29.853 INFO:teuthology.orchestra.run.smithi008.stdout: "age": 84.247344283000004, 2023-08-01T19:56:29.853 INFO:teuthology.orchestra.run.smithi008.stdout: "duration": 0.067753412999999998, 2023-08-01T19:56:29.853 INFO:teuthology.orchestra.run.smithi008.stdout: "type_data": { 2023-08-01T19:56:29.853 INFO:teuthology.orchestra.run.smithi008.stdout: "flag_point": "commit sent; apply or cleanup", 2023-08-01T19:56:29.853 INFO:teuthology.orchestra.run.smithi008.stdout: "client_info": { 2023-08-01T19:56:29.853 INFO:teuthology.orchestra.run.smithi008.stdout: "client": "client.4668", 2023-08-01T19:56:29.853 INFO:teuthology.orchestra.run.smithi008.stdout: "client_addr": "172.21.15.6:0/1709472247", 2023-08-01T19:56:29.853 INFO:teuthology.orchestra.run.smithi008.stdout: "tid": 100939 2023-08-01T19:56:29.854 INFO:teuthology.orchestra.run.smithi008.stdout: }, 2023-08-01T19:56:29.854 INFO:teuthology.orchestra.run.smithi008.stdout: "events": [ 2023-08-01T19:56:29.854 INFO:teuthology.orchestra.run.smithi008.stdout: { 2023-08-01T19:56:29.854 INFO:teuthology.orchestra.run.smithi008.stdout: "event": "initiated", 2023-08-01T19:56:29.854 INFO:teuthology.orchestra.run.smithi008.stdout: "time": "2023-08-01T19:55:05.569740+0000", 2023-08-01T19:56:29.854 INFO:teuthology.orchestra.run.smithi008.stdout: "duration": 0 2023-08-01T19:56:29.854 INFO:teuthology.orchestra.run.smithi008.stdout: }, 2023-08-01T19:56:29.854 INFO:teuthology.orchestra.run.smithi008.stdout: { 2023-08-01T19:56:29.855 INFO:teuthology.orchestra.run.smithi008.stdout: "event": "throttled", 2023-08-01T19:56:29.855 INFO:teuthology.orchestra.run.smithi008.stdout: "time": "2023-08-01T19:55:05.569740+0000", 2023-08-01T19:56:29.855 INFO:teuthology.orchestra.run.smithi008.stdout: "duration": 0 2023-08-01T19:56:29.855 INFO:teuthology.orchestra.run.smithi008.stdout: }, 2023-08-01T19:56:29.855 INFO:teuthology.orchestra.run.smithi008.stdout: { 2023-08-01T19:56:29.855 INFO:teuthology.orchestra.run.smithi008.stdout: "event": "header_read", 2023-08-01T19:56:29.855 INFO:teuthology.orchestra.run.smithi008.stdout: "time": "2023-08-01T19:55:05.569739+0000", 2023-08-01T19:56:29.856 INFO:teuthology.orchestra.run.smithi008.stdout: "duration": 4294967295.9999995 2023-08-01T19:56:29.856 INFO:teuthology.orchestra.run.smithi008.stdout: }, 2023-08-01T19:56:29.856 INFO:teuthology.orchestra.run.smithi008.stdout: { 2023-08-01T19:56:29.856 INFO:teuthology.orchestra.run.smithi008.stdout: "event": "all_read", 2023-08-01T19:56:29.856 INFO:teuthology.orchestra.run.smithi008.stdout: "time": "2023-08-01T19:55:05.569839+0000", 2023-08-01T19:56:29.856 INFO:teuthology.orchestra.run.smithi008.stdout: "duration": 0.000100219 2023-08-01T19:56:29.856 INFO:teuthology.orchestra.run.smithi008.stdout: }, 2023-08-01T19:56:29.856 INFO:teuthology.orchestra.run.smithi008.stdout: { 2023-08-01T19:56:29.857 INFO:teuthology.orchestra.run.smithi008.stdout: "event": "dispatched", 2023-08-01T19:56:29.857 INFO:teuthology.orchestra.run.smithi008.stdout: "time": "2023-08-01T19:55:05.569846+0000", 2023-08-01T19:56:29.857 INFO:teuthology.orchestra.run.smithi008.stdout: "duration": 7.3150000000000003e-06 2023-08-01T19:56:29.857 INFO:teuthology.orchestra.run.smithi008.stdout: }, 2023-08-01T19:56:29.857 INFO:teuthology.orchestra.run.smithi008.stdout: { 2023-08-01T19:56:29.857 INFO:teuthology.orchestra.run.smithi008.stdout: "event": "queued_for_pg", 2023-08-01T19:56:29.857 INFO:teuthology.orchestra.run.smithi008.stdout: "time": "2023-08-01T19:55:05.569850+0000", 2023-08-01T19:56:29.857 INFO:teuthology.orchestra.run.smithi008.stdout: "duration": 3.3299999999999999e-06 2023-08-01T19:56:29.858 INFO:teuthology.orchestra.run.smithi008.stdout: }, 2023-08-01T19:56:29.858 INFO:teuthology.orchestra.run.smithi008.stdout: { 2023-08-01T19:56:29.858 INFO:teuthology.orchestra.run.smithi008.stdout: "event": "reached_pg", 2023-08-01T19:56:29.858 INFO:teuthology.orchestra.run.smithi008.stdout: "time": "2023-08-01T19:55:05.626991+0000", 2023-08-01T19:56:29.858 INFO:teuthology.orchestra.run.smithi008.stdout: "duration": 0.057141585000000002 2023-08-01T19:56:29.858 INFO:teuthology.orchestra.run.smithi008.stdout: }, 2023-08-01T19:56:29.858 INFO:teuthology.orchestra.run.smithi008.stdout: { 2023-08-01T19:56:29.858 INFO:teuthology.orchestra.run.smithi008.stdout: "event": "started", 2023-08-01T19:56:29.859 INFO:teuthology.orchestra.run.smithi008.stdout: "time": "2023-08-01T19:55:05.627111+0000", 2023-08-01T19:56:29.859 INFO:teuthology.orchestra.run.smithi008.stdout: "duration": 0.000119238 2023-08-01T19:56:29.859 INFO:teuthology.orchestra.run.smithi008.stdout: }, 2023-08-01T19:56:29.859 INFO:teuthology.orchestra.run.smithi008.stdout: { 2023-08-01T19:56:29.859 INFO:teuthology.orchestra.run.smithi008.stdout: "event": "waiting for subops from 1", 2023-08-01T19:56:29.859 INFO:teuthology.orchestra.run.smithi008.stdout: "time": "2023-08-01T19:55:05.627253+0000", 2023-08-01T19:56:29.859 INFO:teuthology.orchestra.run.smithi008.stdout: "duration": 0.000142822 2023-08-01T19:56:29.860 INFO:teuthology.orchestra.run.smithi008.stdout: }, 2023-08-01T19:56:29.860 INFO:teuthology.orchestra.run.smithi008.stdout: { 2023-08-01T19:56:29.860 INFO:teuthology.orchestra.run.smithi008.stdout: "event": "op_commit", 2023-08-01T19:56:29.860 INFO:teuthology.orchestra.run.smithi008.stdout: "time": "2023-08-01T19:55:05.632555+0000", 2023-08-01T19:56:29.860 INFO:teuthology.orchestra.run.smithi008.stdout: "duration": 0.0053012449999999996 2023-08-01T19:56:29.860 INFO:teuthology.orchestra.run.smithi008.stdout: }, 2023-08-01T19:56:29.860 INFO:teuthology.orchestra.run.smithi008.stdout: { 2023-08-01T19:56:29.860 INFO:teuthology.orchestra.run.smithi008.stdout: "event": "sub_op_commit_rec", 2023-08-01T19:56:29.861 INFO:teuthology.orchestra.run.smithi008.stdout: "time": "2023-08-01T19:55:05.637380+0000", 2023-08-01T19:56:29.861 INFO:teuthology.orchestra.run.smithi008.stdout: "duration": 0.0048257639999999997 2023-08-01T19:56:29.861 INFO:teuthology.orchestra.run.smithi008.stdout: }, 2023-08-01T19:56:29.861 INFO:teuthology.orchestra.run.smithi008.stdout: { 2023-08-01T19:56:29.861 INFO:teuthology.orchestra.run.smithi008.stdout: "event": "commit_sent", 2023-08-01T19:56:29.861 INFO:teuthology.orchestra.run.smithi008.stdout: "time": "2023-08-01T19:55:05.637454+0000", 2023-08-01T19:56:29.861 INFO:teuthology.orchestra.run.smithi008.stdout: "duration": 7.3578999999999995e-05 2023-08-01T19:56:29.861 INFO:teuthology.orchestra.run.smithi008.stdout: }, 2023-08-01T19:56:29.862 INFO:teuthology.orchestra.run.smithi008.stdout: { 2023-08-01T19:56:29.862 INFO:teuthology.orchestra.run.smithi008.stdout: "event": "done", 2023-08-01T19:56:29.862 INFO:teuthology.orchestra.run.smithi008.stdout: "time": "2023-08-01T19:55:05.637493+0000", 2023-08-01T19:56:29.862 INFO:teuthology.orchestra.run.smithi008.stdout: "duration": 3.8986999999999998e-05 2023-08-01T19:56:29.862 INFO:teuthology.orchestra.run.smithi008.stdout: } 2023-08-01T19:56:29.862 INFO:teuthology.orchestra.run.smithi008.stdout: ] 2023-08-01T19:56:29.862 INFO:teuthology.orchestra.run.smithi008.stdout: } 2023-08-01T19:56:29.862 INFO:teuthology.orchestra.run.smithi008.stdout: }, 2023-08-01T19:56:29.863 INFO:teuthology.orchestra.run.smithi008.stdout: { 2023-08-01T19:56:29.863 INFO:teuthology.orchestra.run.smithi008.stdout: "description": "osd_op(client.4668.0:107863 5.3 5:cbdd875a:::benchmark_data_smithi006_114134_object107862:head [set-alloc-hint object_size 65536 write_size 65536,write 0~65536] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e38)", 2023-08-01T19:56:29.863 INFO:teuthology.orchestra.run.smithi008.stdout: "initiated_at": "2023-08-01T19:55:09.278851+0000", 2023-08-01T19:56:29.863 INFO:teuthology.orchestra.run.smithi008.stdout: "age": 80.538232543000007, 2023-08-01T19:56:29.863 INFO:teuthology.orchestra.run.smithi008.stdout: "duration": 0.071378853000000006, 2023-08-01T19:56:29.863 INFO:teuthology.orchestra.run.smithi008.stdout: "type_data": { 2023-08-01T19:56:29.863 INFO:teuthology.orchestra.run.smithi008.stdout: "flag_point": "commit sent; apply or cleanup", 2023-08-01T19:56:29.863 INFO:teuthology.orchestra.run.smithi008.stdout: "client_info": { 2023-08-01T19:56:29.864 INFO:teuthology.orchestra.run.smithi008.stdout: "client": "client.4668", 2023-08-01T19:56:29.864 INFO:teuthology.orchestra.run.smithi008.stdout: "client_addr": "172.21.15.6:0/1709472247", 2023-08-01T19:56:29.864 INFO:teuthology.orchestra.run.smithi008.stdout: "tid": 107863 2023-08-01T19:56:29.864 INFO:teuthology.orchestra.run.smithi008.stdout: }, 2023-08-01T19:56:29.864 INFO:teuthology.orchestra.run.smithi008.stdout: "events": [ 2023-08-01T19:56:29.864 INFO:teuthology.orchestra.run.smithi008.stdout: { 2023-08-01T19:56:29.864 INFO:teuthology.orchestra.run.smithi008.stdout: "event": "initiated", 2023-08-01T19:56:29.865 INFO:teuthology.orchestra.run.smithi008.stdout: "time": "2023-08-01T19:55:09.278851+0000", 2023-08-01T19:56:29.865 INFO:teuthology.orchestra.run.smithi008.stdout: "duration": 0 2023-08-01T19:56:29.865 INFO:teuthology.orchestra.run.smithi008.stdout: }, 2023-08-01T19:56:29.865 INFO:teuthology.orchestra.run.smithi008.stdout: { 2023-08-01T19:56:29.865 INFO:teuthology.orchestra.run.smithi008.stdout: "event": "throttled", 2023-08-01T19:56:29.865 INFO:teuthology.orchestra.run.smithi008.stdout: "time": "2023-08-01T19:55:09.278851+0000", 2023-08-01T19:56:29.865 INFO:teuthology.orchestra.run.smithi008.stdout: "duration": 0 2023-08-01T19:56:29.865 INFO:teuthology.orchestra.run.smithi008.stdout: }, 2023-08-01T19:56:29.866 INFO:teuthology.orchestra.run.smithi008.stdout: { 2023-08-01T19:56:29.866 INFO:teuthology.orchestra.run.smithi008.stdout: "event": "header_read", 2023-08-01T19:56:29.866 INFO:teuthology.orchestra.run.smithi008.stdout: "time": "2023-08-01T19:55:09.278850+0000", 2023-08-01T19:56:29.866 INFO:teuthology.orchestra.run.smithi008.stdout: "duration": 4294967295.999999 2023-08-01T19:56:29.866 INFO:teuthology.orchestra.run.smithi008.stdout: }, 2023-08-01T19:56:29.866 INFO:teuthology.orchestra.run.smithi008.stdout: { 2023-08-01T19:56:29.866 INFO:teuthology.orchestra.run.smithi008.stdout: "event": "all_read", 2023-08-01T19:56:29.866 INFO:teuthology.orchestra.run.smithi008.stdout: "time": "2023-08-01T19:55:09.278945+0000", 2023-08-01T19:56:29.867 INFO:teuthology.orchestra.run.smithi008.stdout: "duration": 9.4388000000000005e-05 2023-08-01T19:56:29.867 INFO:teuthology.orchestra.run.smithi008.stdout: }, 2023-08-01T19:56:29.867 INFO:teuthology.orchestra.run.smithi008.stdout: { 2023-08-01T19:56:29.867 INFO:teuthology.orchestra.run.smithi008.stdout: "event": "dispatched", 2023-08-01T19:56:29.867 INFO:teuthology.orchestra.run.smithi008.stdout: "time": "2023-08-01T19:55:09.278955+0000", 2023-08-01T19:56:29.867 INFO:teuthology.orchestra.run.smithi008.stdout: "duration": 1.0413e-05 2023-08-01T19:56:29.867 INFO:teuthology.orchestra.run.smithi008.stdout: }, 2023-08-01T19:56:29.867 INFO:teuthology.orchestra.run.smithi008.stdout: { 2023-08-01T19:56:29.868 INFO:teuthology.orchestra.run.smithi008.stdout: "event": "queued_for_pg", 2023-08-01T19:56:29.868 INFO:teuthology.orchestra.run.smithi008.stdout: "time": "2023-08-01T19:55:09.278962+0000", 2023-08-01T19:56:29.868 INFO:teuthology.orchestra.run.smithi008.stdout: "duration": 6.2169999999999999e-06 2023-08-01T19:56:29.868 INFO:teuthology.orchestra.run.smithi008.stdout: }, 2023-08-01T19:56:29.868 INFO:teuthology.orchestra.run.smithi008.stdout: { 2023-08-01T19:56:29.868 INFO:teuthology.orchestra.run.smithi008.stdout: "event": "reached_pg", 2023-08-01T19:56:29.868 INFO:teuthology.orchestra.run.smithi008.stdout: "time": "2023-08-01T19:55:09.280363+0000", 2023-08-01T19:56:29.869 INFO:teuthology.orchestra.run.smithi008.stdout: "duration": 0.0014014489999999999 2023-08-01T19:56:29.869 INFO:teuthology.orchestra.run.smithi008.stdout: }, 2023-08-01T19:56:29.869 INFO:teuthology.orchestra.run.smithi008.stdout: { 2023-08-01T19:56:29.869 INFO:teuthology.orchestra.run.smithi008.stdout: "event": "started", 2023-08-01T19:56:29.869 INFO:teuthology.orchestra.run.smithi008.stdout: "time": "2023-08-01T19:55:09.280488+0000", 2023-08-01T19:56:29.869 INFO:teuthology.orchestra.run.smithi008.stdout: "duration": 0.00012474099999999999 2023-08-01T19:56:29.869 INFO:teuthology.orchestra.run.smithi008.stdout: }, 2023-08-01T19:56:29.869 INFO:teuthology.orchestra.run.smithi008.stdout: { 2023-08-01T19:56:29.870 INFO:teuthology.orchestra.run.smithi008.stdout: "event": "waiting for subops from 1", 2023-08-01T19:56:29.870 INFO:teuthology.orchestra.run.smithi008.stdout: "time": "2023-08-01T19:55:09.280626+0000", 2023-08-01T19:56:29.870 INFO:teuthology.orchestra.run.smithi008.stdout: "duration": 0.000138193 2023-08-01T19:56:29.870 INFO:teuthology.orchestra.run.smithi008.stdout: }, 2023-08-01T19:56:29.870 INFO:teuthology.orchestra.run.smithi008.stdout: { 2023-08-01T19:56:29.870 INFO:teuthology.orchestra.run.smithi008.stdout: "event": "op_commit", 2023-08-01T19:56:29.870 INFO:teuthology.orchestra.run.smithi008.stdout: "time": "2023-08-01T19:55:09.285958+0000", 2023-08-01T19:56:29.870 INFO:teuthology.orchestra.run.smithi008.stdout: "duration": 0.0053317130000000001 2023-08-01T19:56:29.871 INFO:teuthology.orchestra.run.smithi008.stdout: }, 2023-08-01T19:56:29.871 INFO:teuthology.orchestra.run.smithi008.stdout: { 2023-08-01T19:56:29.871 INFO:teuthology.orchestra.run.smithi008.stdout: "event": "sub_op_commit_rec", 2023-08-01T19:56:29.871 INFO:teuthology.orchestra.run.smithi008.stdout: "time": "2023-08-01T19:55:09.350151+0000", 2023-08-01T19:56:29.871 INFO:teuthology.orchestra.run.smithi008.stdout: "duration": 0.064193202000000005 2023-08-01T19:56:29.871 INFO:teuthology.orchestra.run.smithi008.stdout: }, 2023-08-01T19:56:29.871 INFO:teuthology.orchestra.run.smithi008.stdout: { 2023-08-01T19:56:29.872 INFO:teuthology.orchestra.run.smithi008.stdout: "event": "commit_sent", 2023-08-01T19:56:29.872 INFO:teuthology.orchestra.run.smithi008.stdout: "time": "2023-08-01T19:55:09.350188+0000", 2023-08-01T19:56:29.872 INFO:teuthology.orchestra.run.smithi008.stdout: "duration": 3.7549999999999998e-05 2023-08-01T19:56:29.872 INFO:teuthology.orchestra.run.smithi008.stdout: }, 2023-08-01T19:56:29.872 INFO:teuthology.orchestra.run.smithi008.stdout: { 2023-08-01T19:56:29.872 INFO:teuthology.orchestra.run.smithi008.stdout: "event": "done", 2023-08-01T19:56:29.872 INFO:teuthology.orchestra.run.smithi008.stdout: "time": "2023-08-01T19:55:09.350230+0000", 2023-08-01T19:56:29.872 INFO:teuthology.orchestra.run.smithi008.stdout: "duration": 4.1804999999999997e-05 2023-08-01T19:56:29.873 INFO:teuthology.orchestra.run.smithi008.stdout: } 2023-08-01T19:56:29.873 INFO:teuthology.orchestra.run.smithi008.stdout: ] 2023-08-01T19:56:29.873 INFO:teuthology.orchestra.run.smithi008.stdout: } 2023-08-01T19:56:29.873 INFO:teuthology.orchestra.run.smithi008.stdout: }, 2023-08-01T19:56:29.873 INFO:teuthology.orchestra.run.smithi008.stdout: { 2023-08-01T19:56:29.873 INFO:teuthology.orchestra.run.smithi008.stdout: "description": "osd_op(client.4668.0:107865 5.3 5:c2ebb96d:::benchmark_data_smithi006_114134_object107864:head [set-alloc-hint object_size 65536 write_size 65536,write 0~65536] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e38)", 2023-08-01T19:56:29.873 INFO:teuthology.orchestra.run.smithi008.stdout: "initiated_at": "2023-08-01T19:55:09.279020+0000", 2023-08-01T19:56:29.874 INFO:teuthology.orchestra.run.smithi008.stdout: "age": 80.538063871000006, 2023-08-01T19:56:29.875 INFO:teuthology.orchestra.run.smithi008.stdout: "duration": 0.072892565000000006, 2023-08-01T19:56:29.875 INFO:teuthology.orchestra.run.smithi008.stdout: "type_data": { 2023-08-01T19:56:29.875 INFO:teuthology.orchestra.run.smithi008.stdout: "flag_point": "commit sent; apply or cleanup", 2023-08-01T19:56:29.876 INFO:teuthology.orchestra.run.smithi008.stdout: "client_info": { 2023-08-01T19:56:29.876 INFO:teuthology.orchestra.run.smithi008.stdout: "client": "client.4668", 2023-08-01T19:56:29.876 INFO:teuthology.orchestra.run.smithi008.stdout: "client_addr": "172.21.15.6:0/1709472247", 2023-08-01T19:56:29.876 INFO:teuthology.orchestra.run.smithi008.stdout: "tid": 107865 2023-08-01T19:56:29.876 INFO:teuthology.orchestra.run.smithi008.stdout: }, 2023-08-01T19:56:29.876 INFO:teuthology.orchestra.run.smithi008.stdout: "events": [ 2023-08-01T19:56:29.877 INFO:teuthology.orchestra.run.smithi008.stdout: { 2023-08-01T19:56:29.877 INFO:teuthology.orchestra.run.smithi008.stdout: "event": "initiated", 2023-08-01T19:56:29.877 INFO:teuthology.orchestra.run.smithi008.stdout: "time": "2023-08-01T19:55:09.279020+0000", 2023-08-01T19:56:29.877 INFO:teuthology.orchestra.run.smithi008.stdout: "duration": 0 2023-08-01T19:56:29.877 INFO:teuthology.orchestra.run.smithi008.stdout: }, 2023-08-01T19:56:29.877 INFO:teuthology.orchestra.run.smithi008.stdout: { 2023-08-01T19:56:29.877 INFO:teuthology.orchestra.run.smithi008.stdout: "event": "throttled", 2023-08-01T19:56:29.878 INFO:teuthology.orchestra.run.smithi008.stdout: "time": "2023-08-01T19:55:09.279020+0000", 2023-08-01T19:56:29.878 INFO:teuthology.orchestra.run.smithi008.stdout: "duration": 0 2023-08-01T19:56:29.878 INFO:teuthology.orchestra.run.smithi008.stdout: }, 2023-08-01T19:56:29.878 INFO:teuthology.orchestra.run.smithi008.stdout: { 2023-08-01T19:56:29.878 INFO:teuthology.orchestra.run.smithi008.stdout: "event": "header_read", 2023-08-01T19:56:29.878 INFO:teuthology.orchestra.run.smithi008.stdout: "time": "2023-08-01T19:55:09.279019+0000", 2023-08-01T19:56:29.878 INFO:teuthology.orchestra.run.smithi008.stdout: "duration": 4294967295.999999 2023-08-01T19:56:29.878 INFO:teuthology.orchestra.run.smithi008.stdout: }, 2023-08-01T19:56:29.879 INFO:teuthology.orchestra.run.smithi008.stdout: { 2023-08-01T19:56:29.879 INFO:teuthology.orchestra.run.smithi008.stdout: "event": "all_read", 2023-08-01T19:56:29.879 INFO:teuthology.orchestra.run.smithi008.stdout: "time": "2023-08-01T19:55:09.279087+0000", 2023-08-01T19:56:29.879 INFO:teuthology.orchestra.run.smithi008.stdout: "duration": 6.8392000000000005e-05 2023-08-01T19:56:29.879 INFO:teuthology.orchestra.run.smithi008.stdout: }, 2023-08-01T19:56:29.879 INFO:teuthology.orchestra.run.smithi008.stdout: { 2023-08-01T19:56:29.879 INFO:teuthology.orchestra.run.smithi008.stdout: "event": "dispatched", 2023-08-01T19:56:29.879 INFO:teuthology.orchestra.run.smithi008.stdout: "time": "2023-08-01T19:55:09.279095+0000", 2023-08-01T19:56:29.880 INFO:teuthology.orchestra.run.smithi008.stdout: "duration": 8.0989999999999999e-06 2023-08-01T19:56:29.880 INFO:teuthology.orchestra.run.smithi008.stdout: }, 2023-08-01T19:56:29.880 INFO:teuthology.orchestra.run.smithi008.stdout: { 2023-08-01T19:56:29.880 INFO:teuthology.orchestra.run.smithi008.stdout: "event": "queued_for_pg", 2023-08-01T19:56:29.880 INFO:teuthology.orchestra.run.smithi008.stdout: "time": "2023-08-01T19:55:09.279101+0000", 2023-08-01T19:56:29.880 INFO:teuthology.orchestra.run.smithi008.stdout: "duration": 5.0390000000000004e-06 2023-08-01T19:56:29.880 INFO:teuthology.orchestra.run.smithi008.stdout: }, 2023-08-01T19:56:29.881 INFO:teuthology.orchestra.run.smithi008.stdout: { 2023-08-01T19:56:29.881 INFO:teuthology.orchestra.run.smithi008.stdout: "event": "reached_pg", 2023-08-01T19:56:29.881 INFO:teuthology.orchestra.run.smithi008.stdout: "time": "2023-08-01T19:55:09.282574+0000", 2023-08-01T19:56:29.881 INFO:teuthology.orchestra.run.smithi008.stdout: "duration": 0.0034730619999999999 2023-08-01T19:56:29.881 INFO:teuthology.orchestra.run.smithi008.stdout: }, 2023-08-01T19:56:29.882 INFO:teuthology.orchestra.run.smithi008.stdout: { 2023-08-01T19:56:29.882 INFO:teuthology.orchestra.run.smithi008.stdout: "event": "started", 2023-08-01T19:56:29.882 INFO:teuthology.orchestra.run.smithi008.stdout: "time": "2023-08-01T19:55:09.282705+0000", 2023-08-01T19:56:29.882 INFO:teuthology.orchestra.run.smithi008.stdout: "duration": 0.00013133400000000001 2023-08-01T19:56:29.882 INFO:teuthology.orchestra.run.smithi008.stdout: }, 2023-08-01T19:56:29.882 INFO:teuthology.orchestra.run.smithi008.stdout: { 2023-08-01T19:56:29.882 INFO:teuthology.orchestra.run.smithi008.stdout: "event": "waiting for subops from 1", 2023-08-01T19:56:29.883 INFO:teuthology.orchestra.run.smithi008.stdout: "time": "2023-08-01T19:55:09.283067+0000", 2023-08-01T19:56:29.883 INFO:teuthology.orchestra.run.smithi008.stdout: "duration": 0.00036195299999999998 2023-08-01T19:56:29.883 INFO:teuthology.orchestra.run.smithi008.stdout: }, 2023-08-01T19:56:29.883 INFO:teuthology.orchestra.run.smithi008.stdout: { 2023-08-01T19:56:29.883 INFO:teuthology.orchestra.run.smithi008.stdout: "event": "op_commit", 2023-08-01T19:56:29.883 INFO:teuthology.orchestra.run.smithi008.stdout: "time": "2023-08-01T19:55:09.288196+0000", 2023-08-01T19:56:29.883 INFO:teuthology.orchestra.run.smithi008.stdout: "duration": 0.0051293780000000004 2023-08-01T19:56:29.883 INFO:teuthology.orchestra.run.smithi008.stdout: }, 2023-08-01T19:56:29.884 INFO:teuthology.orchestra.run.smithi008.stdout: { 2023-08-01T19:56:29.884 INFO:teuthology.orchestra.run.smithi008.stdout: "event": "sub_op_commit_rec", 2023-08-01T19:56:29.884 INFO:teuthology.orchestra.run.smithi008.stdout: "time": "2023-08-01T19:55:09.351832+0000", 2023-08-01T19:56:29.884 INFO:teuthology.orchestra.run.smithi008.stdout: "duration": 0.063636076 2023-08-01T19:56:29.884 INFO:teuthology.orchestra.run.smithi008.stdout: }, 2023-08-01T19:56:29.884 INFO:teuthology.orchestra.run.smithi008.stdout: { 2023-08-01T19:56:29.884 INFO:teuthology.orchestra.run.smithi008.stdout: "event": "commit_sent", 2023-08-01T19:56:29.884 INFO:teuthology.orchestra.run.smithi008.stdout: "time": "2023-08-01T19:55:09.351878+0000", 2023-08-01T19:56:29.885 INFO:teuthology.orchestra.run.smithi008.stdout: "duration": 4.5408999999999998e-05 2023-08-01T19:56:29.885 INFO:teuthology.orchestra.run.smithi008.stdout: }, 2023-08-01T19:56:29.885 INFO:teuthology.orchestra.run.smithi008.stdout: { 2023-08-01T19:56:29.885 INFO:teuthology.orchestra.run.smithi008.stdout: "event": "done", 2023-08-01T19:56:29.885 INFO:teuthology.orchestra.run.smithi008.stdout: "time": "2023-08-01T19:55:09.351913+0000", 2023-08-01T19:56:29.885 INFO:teuthology.orchestra.run.smithi008.stdout: "duration": 3.4808999999999998e-05 2023-08-01T19:56:29.885 INFO:teuthology.orchestra.run.smithi008.stdout: } 2023-08-01T19:56:29.886 INFO:teuthology.orchestra.run.smithi008.stdout: ] 2023-08-01T19:56:29.886 INFO:teuthology.orchestra.run.smithi008.stdout: } 2023-08-01T19:56:29.886 INFO:teuthology.orchestra.run.smithi008.stdout: }, 2023-08-01T19:56:29.886 INFO:teuthology.orchestra.run.smithi008.stdout: { 2023-08-01T19:56:29.886 INFO:teuthology.orchestra.run.smithi008.stdout: "description": "osd_op(client.4668.0:107869 5.c 5:31910384:::benchmark_data_smithi006_114134_object107868:head [set-alloc-hint object_size 65536 write_size 65536,write 0~65536] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e38)", 2023-08-01T19:56:29.886 INFO:teuthology.orchestra.run.smithi008.stdout: "initiated_at": "2023-08-01T19:55:09.283205+0000", 2023-08-01T19:56:29.886 INFO:teuthology.orchestra.run.smithi008.stdout: "age": 80.533878705999996, 2023-08-01T19:56:29.886 INFO:teuthology.orchestra.run.smithi008.stdout: "duration": 0.068611808999999996, 2023-08-01T19:56:29.887 INFO:teuthology.orchestra.run.smithi008.stdout: "type_data": { 2023-08-01T19:56:29.887 INFO:teuthology.orchestra.run.smithi008.stdout: "flag_point": "commit sent; apply or cleanup", 2023-08-01T19:56:29.887 INFO:teuthology.orchestra.run.smithi008.stdout: "client_info": { 2023-08-01T19:56:29.887 INFO:teuthology.orchestra.run.smithi008.stdout: "client": "client.4668", 2023-08-01T19:56:29.887 INFO:teuthology.orchestra.run.smithi008.stdout: "client_addr": "172.21.15.6:0/1709472247", 2023-08-01T19:56:29.887 INFO:teuthology.orchestra.run.smithi008.stdout: "tid": 107869 2023-08-01T19:56:29.887 INFO:teuthology.orchestra.run.smithi008.stdout: }, 2023-08-01T19:56:29.887 INFO:teuthology.orchestra.run.smithi008.stdout: "events": [ 2023-08-01T19:56:29.888 INFO:teuthology.orchestra.run.smithi008.stdout: { 2023-08-01T19:56:29.888 INFO:teuthology.orchestra.run.smithi008.stdout: "event": "initiated", 2023-08-01T19:56:29.888 INFO:teuthology.orchestra.run.smithi008.stdout: "time": "2023-08-01T19:55:09.283205+0000", 2023-08-01T19:56:29.888 INFO:teuthology.orchestra.run.smithi008.stdout: "duration": 0 2023-08-01T19:56:29.888 INFO:teuthology.orchestra.run.smithi008.stdout: }, 2023-08-01T19:56:29.888 INFO:teuthology.orchestra.run.smithi008.stdout: { 2023-08-01T19:56:29.888 INFO:teuthology.orchestra.run.smithi008.stdout: "event": "throttled", 2023-08-01T19:56:29.889 INFO:teuthology.orchestra.run.smithi008.stdout: "time": "2023-08-01T19:55:09.283205+0000", 2023-08-01T19:56:29.889 INFO:teuthology.orchestra.run.smithi008.stdout: "duration": 0 2023-08-01T19:56:29.889 INFO:teuthology.orchestra.run.smithi008.stdout: }, 2023-08-01T19:56:29.889 INFO:teuthology.orchestra.run.smithi008.stdout: { 2023-08-01T19:56:29.889 INFO:teuthology.orchestra.run.smithi008.stdout: "event": "header_read", 2023-08-01T19:56:29.889 INFO:teuthology.orchestra.run.smithi008.stdout: "time": "2023-08-01T19:55:09.283204+0000", 2023-08-01T19:56:29.889 INFO:teuthology.orchestra.run.smithi008.stdout: "duration": 4294967295.999999 2023-08-01T19:56:29.890 INFO:teuthology.orchestra.run.smithi008.stdout: }, 2023-08-01T19:56:29.890 INFO:teuthology.orchestra.run.smithi008.stdout: { 2023-08-01T19:56:29.890 INFO:teuthology.orchestra.run.smithi008.stdout: "event": "all_read", 2023-08-01T19:56:29.890 INFO:teuthology.orchestra.run.smithi008.stdout: "time": "2023-08-01T19:55:09.283300+0000", 2023-08-01T19:56:29.890 INFO:teuthology.orchestra.run.smithi008.stdout: "duration": 9.6280000000000007e-05 2023-08-01T19:56:29.890 INFO:teuthology.orchestra.run.smithi008.stdout: }, 2023-08-01T19:56:29.890 INFO:teuthology.orchestra.run.smithi008.stdout: { 2023-08-01T19:56:29.890 INFO:teuthology.orchestra.run.smithi008.stdout: "event": "dispatched", 2023-08-01T19:56:29.891 INFO:teuthology.orchestra.run.smithi008.stdout: "time": "2023-08-01T19:55:09.283314+0000", 2023-08-01T19:56:29.891 INFO:teuthology.orchestra.run.smithi008.stdout: "duration": 1.3344e-05 2023-08-01T19:56:29.891 INFO:teuthology.orchestra.run.smithi008.stdout: }, 2023-08-01T19:56:29.891 INFO:teuthology.orchestra.run.smithi008.stdout: { 2023-08-01T19:56:29.891 INFO:teuthology.orchestra.run.smithi008.stdout: "event": "queued_for_pg", 2023-08-01T19:56:29.891 INFO:teuthology.orchestra.run.smithi008.stdout: "time": "2023-08-01T19:55:09.283320+0000", 2023-08-01T19:56:29.891 INFO:teuthology.orchestra.run.smithi008.stdout: "duration": 6.0299999999999999e-06 2023-08-01T19:56:29.892 INFO:teuthology.orchestra.run.smithi008.stdout: }, 2023-08-01T19:56:29.892 INFO:teuthology.orchestra.run.smithi008.stdout: { 2023-08-01T19:56:29.892 INFO:teuthology.orchestra.run.smithi008.stdout: "event": "reached_pg", 2023-08-01T19:56:29.892 INFO:teuthology.orchestra.run.smithi008.stdout: "time": "2023-08-01T19:55:09.283365+0000", 2023-08-01T19:56:29.892 INFO:teuthology.orchestra.run.smithi008.stdout: "duration": 4.5578999999999998e-05 2023-08-01T19:56:29.892 INFO:teuthology.orchestra.run.smithi008.stdout: }, 2023-08-01T19:56:29.892 INFO:teuthology.orchestra.run.smithi008.stdout: { 2023-08-01T19:56:29.892 INFO:teuthology.orchestra.run.smithi008.stdout: "event": "started", 2023-08-01T19:56:29.893 INFO:teuthology.orchestra.run.smithi008.stdout: "time": "2023-08-01T19:55:09.283490+0000", 2023-08-01T19:56:29.893 INFO:teuthology.orchestra.run.smithi008.stdout: "duration": 0.00012473700000000001 2023-08-01T19:56:29.893 INFO:teuthology.orchestra.run.smithi008.stdout: }, 2023-08-01T19:56:29.893 INFO:teuthology.orchestra.run.smithi008.stdout: { 2023-08-01T19:56:29.893 INFO:teuthology.orchestra.run.smithi008.stdout: "event": "waiting for subops from 1", 2023-08-01T19:56:29.893 INFO:teuthology.orchestra.run.smithi008.stdout: "time": "2023-08-01T19:55:09.283637+0000", 2023-08-01T19:56:29.893 INFO:teuthology.orchestra.run.smithi008.stdout: "duration": 0.00014715600000000001 2023-08-01T19:56:29.893 INFO:teuthology.orchestra.run.smithi008.stdout: }, 2023-08-01T19:56:29.894 INFO:teuthology.orchestra.run.smithi008.stdout: { 2023-08-01T19:56:29.894 INFO:teuthology.orchestra.run.smithi008.stdout: "event": "op_commit", 2023-08-01T19:56:29.894 INFO:teuthology.orchestra.run.smithi008.stdout: "time": "2023-08-01T19:55:09.288214+0000", 2023-08-01T19:56:29.894 INFO:teuthology.orchestra.run.smithi008.stdout: "duration": 0.0045769560000000001 2023-08-01T19:56:29.894 INFO:teuthology.orchestra.run.smithi008.stdout: }, 2023-08-01T19:56:29.894 INFO:teuthology.orchestra.run.smithi008.stdout: { 2023-08-01T19:56:29.894 INFO:teuthology.orchestra.run.smithi008.stdout: "event": "sub_op_commit_rec", 2023-08-01T19:56:29.894 INFO:teuthology.orchestra.run.smithi008.stdout: "time": "2023-08-01T19:55:09.351721+0000", 2023-08-01T19:56:29.895 INFO:teuthology.orchestra.run.smithi008.stdout: "duration": 0.063507383000000001 2023-08-01T19:56:29.895 INFO:teuthology.orchestra.run.smithi008.stdout: }, 2023-08-01T19:56:29.895 INFO:teuthology.orchestra.run.smithi008.stdout: { 2023-08-01T19:56:29.895 INFO:teuthology.orchestra.run.smithi008.stdout: "event": "commit_sent", 2023-08-01T19:56:29.895 INFO:teuthology.orchestra.run.smithi008.stdout: "time": "2023-08-01T19:55:09.351777+0000", 2023-08-01T19:56:29.895 INFO:teuthology.orchestra.run.smithi008.stdout: "duration": 5.5733999999999999e-05 2023-08-01T19:56:29.895 INFO:teuthology.orchestra.run.smithi008.stdout: }, 2023-08-01T19:56:29.896 INFO:teuthology.orchestra.run.smithi008.stdout: { 2023-08-01T19:56:29.896 INFO:teuthology.orchestra.run.smithi008.stdout: "event": "done", 2023-08-01T19:56:29.896 INFO:teuthology.orchestra.run.smithi008.stdout: "time": "2023-08-01T19:55:09.351817+0000", 2023-08-01T19:56:29.896 INFO:teuthology.orchestra.run.smithi008.stdout: "duration": 3.9765000000000003e-05 2023-08-01T19:56:29.896 INFO:teuthology.orchestra.run.smithi008.stdout: } 2023-08-01T19:56:29.896 INFO:teuthology.orchestra.run.smithi008.stdout: ] 2023-08-01T19:56:29.896 INFO:teuthology.orchestra.run.smithi008.stdout: } 2023-08-01T19:56:29.896 INFO:teuthology.orchestra.run.smithi008.stdout: }, 2023-08-01T19:56:29.897 INFO:teuthology.orchestra.run.smithi008.stdout: { 2023-08-01T19:56:29.897 INFO:teuthology.orchestra.run.smithi008.stdout: "description": "osd_op(client.4668.0:107874 5.3 5:ce4c2799:::benchmark_data_smithi006_114134_object107873:head [set-alloc-hint object_size 65536 write_size 65536,write 0~65536] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e38)", 2023-08-01T19:56:29.897 INFO:teuthology.orchestra.run.smithi008.stdout: "initiated_at": "2023-08-01T19:55:09.286239+0000", 2023-08-01T19:56:29.897 INFO:teuthology.orchestra.run.smithi008.stdout: "age": 80.530845201000005, 2023-08-01T19:56:29.897 INFO:teuthology.orchestra.run.smithi008.stdout: "duration": 0.068224389999999996, 2023-08-01T19:56:29.897 INFO:teuthology.orchestra.run.smithi008.stdout: "type_data": { 2023-08-01T19:56:29.897 INFO:teuthology.orchestra.run.smithi008.stdout: "flag_point": "commit sent; apply or cleanup", 2023-08-01T19:56:29.898 INFO:teuthology.orchestra.run.smithi008.stdout: "client_info": { 2023-08-01T19:56:29.898 INFO:teuthology.orchestra.run.smithi008.stdout: "client": "client.4668", 2023-08-01T19:56:29.898 INFO:teuthology.orchestra.run.smithi008.stdout: "client_addr": "172.21.15.6:0/1709472247", 2023-08-01T19:56:29.898 INFO:teuthology.orchestra.run.smithi008.stdout: "tid": 107874 2023-08-01T19:56:29.898 INFO:teuthology.orchestra.run.smithi008.stdout: }, 2023-08-01T19:56:29.898 INFO:teuthology.orchestra.run.smithi008.stdout: "events": [ 2023-08-01T19:56:29.898 INFO:teuthology.orchestra.run.smithi008.stdout: { 2023-08-01T19:56:29.898 INFO:teuthology.orchestra.run.smithi008.stdout: "event": "initiated", 2023-08-01T19:56:29.899 INFO:teuthology.orchestra.run.smithi008.stdout: "time": "2023-08-01T19:55:09.286239+0000", 2023-08-01T19:56:29.899 INFO:teuthology.orchestra.run.smithi008.stdout: "duration": 0 2023-08-01T19:56:29.899 INFO:teuthology.orchestra.run.smithi008.stdout: }, 2023-08-01T19:56:29.899 INFO:teuthology.orchestra.run.smithi008.stdout: { 2023-08-01T19:56:29.899 INFO:teuthology.orchestra.run.smithi008.stdout: "event": "throttled", 2023-08-01T19:56:29.899 INFO:teuthology.orchestra.run.smithi008.stdout: "time": "2023-08-01T19:55:09.286239+0000", 2023-08-01T19:56:29.899 INFO:teuthology.orchestra.run.smithi008.stdout: "duration": 0 2023-08-01T19:56:29.899 INFO:teuthology.orchestra.run.smithi008.stdout: }, 2023-08-01T19:56:29.900 INFO:teuthology.orchestra.run.smithi008.stdout: { 2023-08-01T19:56:29.900 INFO:teuthology.orchestra.run.smithi008.stdout: "event": "header_read", 2023-08-01T19:56:29.900 INFO:teuthology.orchestra.run.smithi008.stdout: "time": "2023-08-01T19:55:09.286238+0000", 2023-08-01T19:56:29.900 INFO:teuthology.orchestra.run.smithi008.stdout: "duration": 4294967295.999999 2023-08-01T19:56:29.900 INFO:teuthology.orchestra.run.smithi008.stdout: }, 2023-08-01T19:56:29.900 INFO:teuthology.orchestra.run.smithi008.stdout: { 2023-08-01T19:56:29.900 INFO:teuthology.orchestra.run.smithi008.stdout: "event": "all_read", 2023-08-01T19:56:29.901 INFO:teuthology.orchestra.run.smithi008.stdout: "time": "2023-08-01T19:55:09.286310+0000", 2023-08-01T19:56:29.901 INFO:teuthology.orchestra.run.smithi008.stdout: "duration": 7.2583999999999995e-05 2023-08-01T19:56:29.901 INFO:teuthology.orchestra.run.smithi008.stdout: }, 2023-08-01T19:56:29.901 INFO:teuthology.orchestra.run.smithi008.stdout: { 2023-08-01T19:56:29.901 INFO:teuthology.orchestra.run.smithi008.stdout: "event": "dispatched", 2023-08-01T19:56:29.901 INFO:teuthology.orchestra.run.smithi008.stdout: "time": "2023-08-01T19:55:09.286323+0000", 2023-08-01T19:56:29.901 INFO:teuthology.orchestra.run.smithi008.stdout: "duration": 1.3151e-05 2023-08-01T19:56:29.902 INFO:teuthology.orchestra.run.smithi008.stdout: }, 2023-08-01T19:56:29.902 INFO:teuthology.orchestra.run.smithi008.stdout: { 2023-08-01T19:56:29.902 INFO:teuthology.orchestra.run.smithi008.stdout: "event": "queued_for_pg", 2023-08-01T19:56:29.902 INFO:teuthology.orchestra.run.smithi008.stdout: "time": "2023-08-01T19:55:09.286329+0000", 2023-08-01T19:56:29.902 INFO:teuthology.orchestra.run.smithi008.stdout: "duration": 5.8719999999999999e-06 2023-08-01T19:56:29.902 INFO:teuthology.orchestra.run.smithi008.stdout: }, 2023-08-01T19:56:29.902 INFO:teuthology.orchestra.run.smithi008.stdout: { 2023-08-01T19:56:29.902 INFO:teuthology.orchestra.run.smithi008.stdout: "event": "reached_pg", 2023-08-01T19:56:29.903 INFO:teuthology.orchestra.run.smithi008.stdout: "time": "2023-08-01T19:55:09.286392+0000", 2023-08-01T19:56:29.903 INFO:teuthology.orchestra.run.smithi008.stdout: "duration": 6.2378000000000005e-05 2023-08-01T19:56:29.903 INFO:teuthology.orchestra.run.smithi008.stdout: }, 2023-08-01T19:56:29.903 INFO:teuthology.orchestra.run.smithi008.stdout: { 2023-08-01T19:56:29.903 INFO:teuthology.orchestra.run.smithi008.stdout: "event": "started", 2023-08-01T19:56:29.903 INFO:teuthology.orchestra.run.smithi008.stdout: "time": "2023-08-01T19:55:09.286473+0000", 2023-08-01T19:56:29.903 INFO:teuthology.orchestra.run.smithi008.stdout: "duration": 8.1327000000000002e-05 2023-08-01T19:56:29.903 INFO:teuthology.orchestra.run.smithi008.stdout: }, 2023-08-01T19:56:29.904 INFO:teuthology.orchestra.run.smithi008.stdout: { 2023-08-01T19:56:29.904 INFO:teuthology.orchestra.run.smithi008.stdout: "event": "waiting for subops from 1", 2023-08-01T19:56:29.904 INFO:teuthology.orchestra.run.smithi008.stdout: "time": "2023-08-01T19:55:09.286557+0000", 2023-08-01T19:56:29.904 INFO:teuthology.orchestra.run.smithi008.stdout: "duration": 8.4140000000000004e-05 2023-08-01T19:56:29.904 INFO:teuthology.orchestra.run.smithi008.stdout: }, 2023-08-01T19:56:29.904 INFO:teuthology.orchestra.run.smithi008.stdout: { 2023-08-01T19:56:29.904 INFO:teuthology.orchestra.run.smithi008.stdout: "event": "op_commit", 2023-08-01T19:56:29.904 INFO:teuthology.orchestra.run.smithi008.stdout: "time": "2023-08-01T19:55:09.290681+0000", 2023-08-01T19:56:29.905 INFO:teuthology.orchestra.run.smithi008.stdout: "duration": 0.0041242420000000002 2023-08-01T19:56:29.905 INFO:teuthology.orchestra.run.smithi008.stdout: }, 2023-08-01T19:56:29.905 INFO:teuthology.orchestra.run.smithi008.stdout: { 2023-08-01T19:56:29.905 INFO:teuthology.orchestra.run.smithi008.stdout: "event": "sub_op_commit_rec", 2023-08-01T19:56:29.905 INFO:teuthology.orchestra.run.smithi008.stdout: "time": "2023-08-01T19:55:09.354372+0000", 2023-08-01T19:56:29.905 INFO:teuthology.orchestra.run.smithi008.stdout: "duration": 0.063690438000000002 2023-08-01T19:56:29.905 INFO:teuthology.orchestra.run.smithi008.stdout: }, 2023-08-01T19:56:29.906 INFO:teuthology.orchestra.run.smithi008.stdout: { 2023-08-01T19:56:29.906 INFO:teuthology.orchestra.run.smithi008.stdout: "event": "commit_sent", 2023-08-01T19:56:29.906 INFO:teuthology.orchestra.run.smithi008.stdout: "time": "2023-08-01T19:55:09.354421+0000", 2023-08-01T19:56:29.906 INFO:teuthology.orchestra.run.smithi008.stdout: "duration": 4.9413000000000003e-05 2023-08-01T19:56:29.906 INFO:teuthology.orchestra.run.smithi008.stdout: }, 2023-08-01T19:56:29.906 INFO:teuthology.orchestra.run.smithi008.stdout: { 2023-08-01T19:56:29.906 INFO:teuthology.orchestra.run.smithi008.stdout: "event": "done", 2023-08-01T19:56:29.906 INFO:teuthology.orchestra.run.smithi008.stdout: "time": "2023-08-01T19:55:09.354463+0000", 2023-08-01T19:56:29.907 INFO:teuthology.orchestra.run.smithi008.stdout: "duration": 4.1924e-05 2023-08-01T19:56:29.907 INFO:teuthology.orchestra.run.smithi008.stdout: } 2023-08-01T19:56:29.907 INFO:teuthology.orchestra.run.smithi008.stdout: ] 2023-08-01T19:56:29.907 INFO:teuthology.orchestra.run.smithi008.stdout: } 2023-08-01T19:56:29.907 INFO:teuthology.orchestra.run.smithi008.stdout: }, 2023-08-01T19:56:29.907 INFO:teuthology.orchestra.run.smithi008.stdout: { 2023-08-01T19:56:29.907 INFO:teuthology.orchestra.run.smithi008.stdout: "description": "osd_op(client.4668.0:197398 5.1 5:809d7164:::benchmark_data_smithi006_114134_object63737:head [delete] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e61)", 2023-08-01T19:56:29.907 INFO:teuthology.orchestra.run.smithi008.stdout: "initiated_at": "2023-08-01T19:55:58.554713+0000", 2023-08-01T19:56:29.908 INFO:teuthology.orchestra.run.smithi008.stdout: "age": 31.262370513, 2023-08-01T19:56:29.908 INFO:teuthology.orchestra.run.smithi008.stdout: "duration": 1.0661326660000001, 2023-08-01T19:56:29.908 INFO:teuthology.orchestra.run.smithi008.stdout: "type_data": { 2023-08-01T19:56:29.908 INFO:teuthology.orchestra.run.smithi008.stdout: "flag_point": "reached pg", 2023-08-01T19:56:29.908 INFO:teuthology.orchestra.run.smithi008.stdout: "client_info": { 2023-08-01T19:56:29.908 INFO:teuthology.orchestra.run.smithi008.stdout: "client": "client.4668", 2023-08-01T19:56:29.908 INFO:teuthology.orchestra.run.smithi008.stdout: "client_addr": "172.21.15.6:0/1709472247", 2023-08-01T19:56:29.909 INFO:teuthology.orchestra.run.smithi008.stdout: "tid": 197398 2023-08-01T19:56:29.909 INFO:teuthology.orchestra.run.smithi008.stdout: }, 2023-08-01T19:56:29.909 INFO:teuthology.orchestra.run.smithi008.stdout: "events": [ 2023-08-01T19:56:29.909 INFO:teuthology.orchestra.run.smithi008.stdout: { 2023-08-01T19:56:29.909 INFO:teuthology.orchestra.run.smithi008.stdout: "event": "initiated", 2023-08-01T19:56:29.909 INFO:teuthology.orchestra.run.smithi008.stdout: "time": "2023-08-01T19:55:58.554713+0000", 2023-08-01T19:56:29.909 INFO:teuthology.orchestra.run.smithi008.stdout: "duration": 0 2023-08-01T19:56:29.910 INFO:teuthology.orchestra.run.smithi008.stdout: }, 2023-08-01T19:56:29.910 INFO:teuthology.orchestra.run.smithi008.stdout: { 2023-08-01T19:56:29.910 INFO:teuthology.orchestra.run.smithi008.stdout: "event": "throttled", 2023-08-01T19:56:29.910 INFO:teuthology.orchestra.run.smithi008.stdout: "time": "2023-08-01T19:55:58.554713+0000", 2023-08-01T19:56:29.910 INFO:teuthology.orchestra.run.smithi008.stdout: "duration": 0 2023-08-01T19:56:29.910 INFO:teuthology.orchestra.run.smithi008.stdout: }, 2023-08-01T19:56:29.910 INFO:teuthology.orchestra.run.smithi008.stdout: { 2023-08-01T19:56:29.910 INFO:teuthology.orchestra.run.smithi008.stdout: "event": "header_read", 2023-08-01T19:56:29.911 INFO:teuthology.orchestra.run.smithi008.stdout: "time": "2023-08-01T19:55:58.554713+0000", 2023-08-01T19:56:29.911 INFO:teuthology.orchestra.run.smithi008.stdout: "duration": 4294967295.999999 2023-08-01T19:56:29.911 INFO:teuthology.orchestra.run.smithi008.stdout: }, 2023-08-01T19:56:29.911 INFO:teuthology.orchestra.run.smithi008.stdout: { 2023-08-01T19:56:29.911 INFO:teuthology.orchestra.run.smithi008.stdout: "event": "all_read", 2023-08-01T19:56:29.911 INFO:teuthology.orchestra.run.smithi008.stdout: "time": "2023-08-01T19:55:58.554717+0000", 2023-08-01T19:56:29.911 INFO:teuthology.orchestra.run.smithi008.stdout: "duration": 4.7389999999999999e-06 2023-08-01T19:56:29.912 INFO:teuthology.orchestra.run.smithi008.stdout: }, 2023-08-01T19:56:29.912 INFO:teuthology.orchestra.run.smithi008.stdout: { 2023-08-01T19:56:29.912 INFO:teuthology.orchestra.run.smithi008.stdout: "event": "dispatched", 2023-08-01T19:56:29.912 INFO:teuthology.orchestra.run.smithi008.stdout: "time": "2023-08-01T19:55:58.554725+0000", 2023-08-01T19:56:29.912 INFO:teuthology.orchestra.run.smithi008.stdout: "duration": 7.9820000000000008e-06 2023-08-01T19:56:29.912 INFO:teuthology.orchestra.run.smithi008.stdout: }, 2023-08-01T19:56:29.912 INFO:teuthology.orchestra.run.smithi008.stdout: { 2023-08-01T19:56:29.913 INFO:teuthology.orchestra.run.smithi008.stdout: "event": "queued_for_pg", 2023-08-01T19:56:29.913 INFO:teuthology.orchestra.run.smithi008.stdout: "time": "2023-08-01T19:55:58.554730+0000", 2023-08-01T19:56:29.913 INFO:teuthology.orchestra.run.smithi008.stdout: "duration": 4.318e-06 2023-08-01T19:56:29.913 INFO:teuthology.orchestra.run.smithi008.stdout: }, 2023-08-01T19:56:29.913 INFO:teuthology.orchestra.run.smithi008.stdout: { 2023-08-01T19:56:29.913 INFO:teuthology.orchestra.run.smithi008.stdout: "event": "reached_pg", 2023-08-01T19:56:29.913 INFO:teuthology.orchestra.run.smithi008.stdout: "time": "2023-08-01T19:55:58.554767+0000", 2023-08-01T19:56:29.913 INFO:teuthology.orchestra.run.smithi008.stdout: "duration": 3.7778000000000003e-05 2023-08-01T19:56:29.914 INFO:teuthology.orchestra.run.smithi008.stdout: }, 2023-08-01T19:56:29.914 INFO:teuthology.orchestra.run.smithi008.stdout: { 2023-08-01T19:56:29.914 INFO:teuthology.orchestra.run.smithi008.stdout: "event": "started", 2023-08-01T19:56:29.914 INFO:teuthology.orchestra.run.smithi008.stdout: "time": "2023-08-01T19:55:58.554874+0000", 2023-08-01T19:56:29.914 INFO:teuthology.orchestra.run.smithi008.stdout: "duration": 0.000106613 2023-08-01T19:56:29.914 INFO:teuthology.orchestra.run.smithi008.stdout: }, 2023-08-01T19:56:29.914 INFO:teuthology.orchestra.run.smithi008.stdout: { 2023-08-01T19:56:29.915 INFO:teuthology.orchestra.run.smithi008.stdout: "event": "waiting for subops from 1", 2023-08-01T19:56:29.915 INFO:teuthology.orchestra.run.smithi008.stdout: "time": "2023-08-01T19:55:58.554941+0000", 2023-08-01T19:56:29.915 INFO:teuthology.orchestra.run.smithi008.stdout: "duration": 6.6569000000000006e-05 2023-08-01T19:56:29.915 INFO:teuthology.orchestra.run.smithi008.stdout: }, 2023-08-01T19:56:29.915 INFO:teuthology.orchestra.run.smithi008.stdout: { 2023-08-01T19:56:29.915 INFO:teuthology.orchestra.run.smithi008.stdout: "event": "reached_pg", 2023-08-01T19:56:29.915 INFO:teuthology.orchestra.run.smithi008.stdout: "time": "2023-08-01T19:55:58.569436+0000", 2023-08-01T19:56:29.915 INFO:teuthology.orchestra.run.smithi008.stdout: "duration": 0.014495413 2023-08-01T19:56:29.916 INFO:teuthology.orchestra.run.smithi008.stdout: }, 2023-08-01T19:56:29.916 INFO:teuthology.orchestra.run.smithi008.stdout: { 2023-08-01T19:56:29.916 INFO:teuthology.orchestra.run.smithi008.stdout: "event": "waiting for peered", 2023-08-01T19:56:29.916 INFO:teuthology.orchestra.run.smithi008.stdout: "time": "2023-08-01T19:55:58.569441+0000", 2023-08-01T19:56:29.916 INFO:teuthology.orchestra.run.smithi008.stdout: "duration": 5.1109999999999999e-06 2023-08-01T19:56:29.916 INFO:teuthology.orchestra.run.smithi008.stdout: }, 2023-08-01T19:56:29.916 INFO:teuthology.orchestra.run.smithi008.stdout: { 2023-08-01T19:56:29.917 INFO:teuthology.orchestra.run.smithi008.stdout: "event": "reached_pg", 2023-08-01T19:56:29.917 INFO:teuthology.orchestra.run.smithi008.stdout: "time": "2023-08-01T19:55:59.620748+0000", 2023-08-01T19:56:29.917 INFO:teuthology.orchestra.run.smithi008.stdout: "duration": 1.0513071810000001 2023-08-01T19:56:29.917 INFO:teuthology.orchestra.run.smithi008.stdout: }, 2023-08-01T19:56:29.917 INFO:teuthology.orchestra.run.smithi008.stdout: { 2023-08-01T19:56:29.917 INFO:teuthology.orchestra.run.smithi008.stdout: "event": "done", 2023-08-01T19:56:29.917 INFO:teuthology.orchestra.run.smithi008.stdout: "time": "2023-08-01T19:55:59.620846+0000", 2023-08-01T19:56:29.918 INFO:teuthology.orchestra.run.smithi008.stdout: "duration": 9.7739999999999996e-05 2023-08-01T19:56:29.918 INFO:teuthology.orchestra.run.smithi008.stdout: } 2023-08-01T19:56:29.918 INFO:teuthology.orchestra.run.smithi008.stdout: ] 2023-08-01T19:56:29.918 INFO:teuthology.orchestra.run.smithi008.stdout: } 2023-08-01T19:56:29.918 INFO:teuthology.orchestra.run.smithi008.stdout: }, 2023-08-01T19:56:29.918 INFO:teuthology.orchestra.run.smithi008.stdout: { 2023-08-01T19:56:29.918 INFO:teuthology.orchestra.run.smithi008.stdout: "description": "osd_op(client.4668.0:197400 5.c 5:30dad7f9:::benchmark_data_smithi006_114134_object63739:head [delete] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e61)", 2023-08-01T19:56:29.919 INFO:teuthology.orchestra.run.smithi008.stdout: "initiated_at": "2023-08-01T19:55:58.556576+0000", 2023-08-01T19:56:29.919 INFO:teuthology.orchestra.run.smithi008.stdout: "age": 31.260507663999999, 2023-08-01T19:56:29.919 INFO:teuthology.orchestra.run.smithi008.stdout: "duration": 1.062559968, 2023-08-01T19:56:29.919 INFO:teuthology.orchestra.run.smithi008.stdout: "type_data": { 2023-08-01T19:56:29.919 INFO:teuthology.orchestra.run.smithi008.stdout: "flag_point": "reached pg", 2023-08-01T19:56:29.919 INFO:teuthology.orchestra.run.smithi008.stdout: "client_info": { 2023-08-01T19:56:29.919 INFO:teuthology.orchestra.run.smithi008.stdout: "client": "client.4668", 2023-08-01T19:56:29.919 INFO:teuthology.orchestra.run.smithi008.stdout: "client_addr": "172.21.15.6:0/1709472247", 2023-08-01T19:56:29.920 INFO:teuthology.orchestra.run.smithi008.stdout: "tid": 197400 2023-08-01T19:56:29.920 INFO:teuthology.orchestra.run.smithi008.stdout: }, 2023-08-01T19:56:29.920 INFO:teuthology.orchestra.run.smithi008.stdout: "events": [ 2023-08-01T19:56:29.920 INFO:teuthology.orchestra.run.smithi008.stdout: { 2023-08-01T19:56:29.920 INFO:teuthology.orchestra.run.smithi008.stdout: "event": "initiated", 2023-08-01T19:56:29.920 INFO:teuthology.orchestra.run.smithi008.stdout: "time": "2023-08-01T19:55:58.556576+0000", 2023-08-01T19:56:29.920 INFO:teuthology.orchestra.run.smithi008.stdout: "duration": 0 2023-08-01T19:56:29.921 INFO:teuthology.orchestra.run.smithi008.stdout: }, 2023-08-01T19:56:29.921 INFO:teuthology.orchestra.run.smithi008.stdout: { 2023-08-01T19:56:29.921 INFO:teuthology.orchestra.run.smithi008.stdout: "event": "throttled", 2023-08-01T19:56:29.921 INFO:teuthology.orchestra.run.smithi008.stdout: "time": "2023-08-01T19:55:58.556576+0000", 2023-08-01T19:56:29.921 INFO:teuthology.orchestra.run.smithi008.stdout: "duration": 0 2023-08-01T19:56:29.921 INFO:teuthology.orchestra.run.smithi008.stdout: }, 2023-08-01T19:56:29.922 INFO:teuthology.orchestra.run.smithi008.stdout: { 2023-08-01T19:56:29.922 INFO:teuthology.orchestra.run.smithi008.stdout: "event": "header_read", 2023-08-01T19:56:29.922 INFO:teuthology.orchestra.run.smithi008.stdout: "time": "2023-08-01T19:55:58.556575+0000", 2023-08-01T19:56:29.922 INFO:teuthology.orchestra.run.smithi008.stdout: "duration": 4294967295.999999 2023-08-01T19:56:29.922 INFO:teuthology.orchestra.run.smithi008.stdout: }, 2023-08-01T19:56:29.922 INFO:teuthology.orchestra.run.smithi008.stdout: { 2023-08-01T19:56:29.922 INFO:teuthology.orchestra.run.smithi008.stdout: "event": "all_read", 2023-08-01T19:56:29.922 INFO:teuthology.orchestra.run.smithi008.stdout: "time": "2023-08-01T19:55:58.556580+0000", 2023-08-01T19:56:29.923 INFO:teuthology.orchestra.run.smithi008.stdout: "duration": 4.2860000000000001e-06 2023-08-01T19:56:29.923 INFO:teuthology.orchestra.run.smithi008.stdout: }, 2023-08-01T19:56:29.923 INFO:teuthology.orchestra.run.smithi008.stdout: { 2023-08-01T19:56:29.923 INFO:teuthology.orchestra.run.smithi008.stdout: "event": "dispatched", 2023-08-01T19:56:29.923 INFO:teuthology.orchestra.run.smithi008.stdout: "time": "2023-08-01T19:55:58.556589+0000", 2023-08-01T19:56:29.923 INFO:teuthology.orchestra.run.smithi008.stdout: "duration": 9.6500000000000008e-06 2023-08-01T19:56:29.923 INFO:teuthology.orchestra.run.smithi008.stdout: }, 2023-08-01T19:56:29.923 INFO:teuthology.orchestra.run.smithi008.stdout: { 2023-08-01T19:56:29.924 INFO:teuthology.orchestra.run.smithi008.stdout: "event": "queued_for_pg", 2023-08-01T19:56:29.924 INFO:teuthology.orchestra.run.smithi008.stdout: "time": "2023-08-01T19:55:58.556596+0000", 2023-08-01T19:56:29.924 INFO:teuthology.orchestra.run.smithi008.stdout: "duration": 6.1430000000000003e-06 2023-08-01T19:56:29.924 INFO:teuthology.orchestra.run.smithi008.stdout: }, 2023-08-01T19:56:29.924 INFO:teuthology.orchestra.run.smithi008.stdout: { 2023-08-01T19:56:29.924 INFO:teuthology.orchestra.run.smithi008.stdout: "event": "reached_pg", 2023-08-01T19:56:29.924 INFO:teuthology.orchestra.run.smithi008.stdout: "time": "2023-08-01T19:55:58.556634+0000", 2023-08-01T19:56:29.924 INFO:teuthology.orchestra.run.smithi008.stdout: "duration": 3.8080000000000001e-05 2023-08-01T19:56:29.925 INFO:teuthology.orchestra.run.smithi008.stdout: }, 2023-08-01T19:56:29.925 INFO:teuthology.orchestra.run.smithi008.stdout: { 2023-08-01T19:56:29.925 INFO:teuthology.orchestra.run.smithi008.stdout: "event": "started", 2023-08-01T19:56:29.925 INFO:teuthology.orchestra.run.smithi008.stdout: "time": "2023-08-01T19:55:58.556754+0000", 2023-08-01T19:56:29.925 INFO:teuthology.orchestra.run.smithi008.stdout: "duration": 0.000120444 2023-08-01T19:56:29.925 INFO:teuthology.orchestra.run.smithi008.stdout: }, 2023-08-01T19:56:29.925 INFO:teuthology.orchestra.run.smithi008.stdout: { 2023-08-01T19:56:29.926 INFO:teuthology.orchestra.run.smithi008.stdout: "event": "waiting for subops from 1", 2023-08-01T19:56:29.926 INFO:teuthology.orchestra.run.smithi008.stdout: "time": "2023-08-01T19:55:58.556875+0000", 2023-08-01T19:56:29.926 INFO:teuthology.orchestra.run.smithi008.stdout: "duration": 0.00012100900000000001 2023-08-01T19:56:29.926 INFO:teuthology.orchestra.run.smithi008.stdout: }, 2023-08-01T19:56:29.926 INFO:teuthology.orchestra.run.smithi008.stdout: { 2023-08-01T19:56:29.926 INFO:teuthology.orchestra.run.smithi008.stdout: "event": "reached_pg", 2023-08-01T19:56:29.926 INFO:teuthology.orchestra.run.smithi008.stdout: "time": "2023-08-01T19:55:58.567406+0000", 2023-08-01T19:56:29.926 INFO:teuthology.orchestra.run.smithi008.stdout: "duration": 0.010531351 2023-08-01T19:56:29.927 INFO:teuthology.orchestra.run.smithi008.stdout: }, 2023-08-01T19:56:29.927 INFO:teuthology.orchestra.run.smithi008.stdout: { 2023-08-01T19:56:29.927 INFO:teuthology.orchestra.run.smithi008.stdout: "event": "waiting for peered", 2023-08-01T19:56:29.927 INFO:teuthology.orchestra.run.smithi008.stdout: "time": "2023-08-01T19:55:58.567414+0000", 2023-08-01T19:56:29.927 INFO:teuthology.orchestra.run.smithi008.stdout: "duration": 7.9189999999999999e-06 2023-08-01T19:56:29.927 INFO:teuthology.orchestra.run.smithi008.stdout: }, 2023-08-01T19:56:29.927 INFO:teuthology.orchestra.run.smithi008.stdout: { 2023-08-01T19:56:29.927 INFO:teuthology.orchestra.run.smithi008.stdout: "event": "reached_pg", 2023-08-01T19:56:29.928 INFO:teuthology.orchestra.run.smithi008.stdout: "time": "2023-08-01T19:55:59.619054+0000", 2023-08-01T19:56:29.928 INFO:teuthology.orchestra.run.smithi008.stdout: "duration": 1.0516396269999999 2023-08-01T19:56:29.928 INFO:teuthology.orchestra.run.smithi008.stdout: }, 2023-08-01T19:56:29.928 INFO:teuthology.orchestra.run.smithi008.stdout: { 2023-08-01T19:56:29.928 INFO:teuthology.orchestra.run.smithi008.stdout: "event": "done", 2023-08-01T19:56:29.928 INFO:teuthology.orchestra.run.smithi008.stdout: "time": "2023-08-01T19:55:59.619136+0000", 2023-08-01T19:56:29.928 INFO:teuthology.orchestra.run.smithi008.stdout: "duration": 8.2208999999999998e-05 2023-08-01T19:56:29.929 INFO:teuthology.orchestra.run.smithi008.stdout: } 2023-08-01T19:56:29.929 INFO:teuthology.orchestra.run.smithi008.stdout: ] 2023-08-01T19:56:29.929 INFO:teuthology.orchestra.run.smithi008.stdout: } 2023-08-01T19:56:29.929 INFO:teuthology.orchestra.run.smithi008.stdout: }, 2023-08-01T19:56:29.929 INFO:teuthology.orchestra.run.smithi008.stdout: { 2023-08-01T19:56:29.929 INFO:teuthology.orchestra.run.smithi008.stdout: "description": "osd_op(client.4668.0:197401 5.1 5:88b38567:::benchmark_data_smithi006_114134_object63740:head [delete] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e61)", 2023-08-01T19:56:29.929 INFO:teuthology.orchestra.run.smithi008.stdout: "initiated_at": "2023-08-01T19:55:58.556607+0000", 2023-08-01T19:56:29.930 INFO:teuthology.orchestra.run.smithi008.stdout: "age": 31.26047724, 2023-08-01T19:56:29.930 INFO:teuthology.orchestra.run.smithi008.stdout: "duration": 1.0643254870000001, 2023-08-01T19:56:29.930 INFO:teuthology.orchestra.run.smithi008.stdout: "type_data": { 2023-08-01T19:56:29.930 INFO:teuthology.orchestra.run.smithi008.stdout: "flag_point": "reached pg", 2023-08-01T19:56:29.930 INFO:teuthology.orchestra.run.smithi008.stdout: "client_info": { 2023-08-01T19:56:29.930 INFO:teuthology.orchestra.run.smithi008.stdout: "client": "client.4668", 2023-08-01T19:56:29.930 INFO:teuthology.orchestra.run.smithi008.stdout: "client_addr": "172.21.15.6:0/1709472247", 2023-08-01T19:56:29.930 INFO:teuthology.orchestra.run.smithi008.stdout: "tid": 197401 2023-08-01T19:56:29.931 INFO:teuthology.orchestra.run.smithi008.stdout: }, 2023-08-01T19:56:29.931 INFO:teuthology.orchestra.run.smithi008.stdout: "events": [ 2023-08-01T19:56:29.931 INFO:teuthology.orchestra.run.smithi008.stdout: { 2023-08-01T19:56:29.931 INFO:teuthology.orchestra.run.smithi008.stdout: "event": "initiated", 2023-08-01T19:56:29.931 INFO:teuthology.orchestra.run.smithi008.stdout: "time": "2023-08-01T19:55:58.556607+0000", 2023-08-01T19:56:29.931 INFO:teuthology.orchestra.run.smithi008.stdout: "duration": 0 2023-08-01T19:56:29.931 INFO:teuthology.orchestra.run.smithi008.stdout: }, 2023-08-01T19:56:29.932 INFO:teuthology.orchestra.run.smithi008.stdout: { 2023-08-01T19:56:29.932 INFO:teuthology.orchestra.run.smithi008.stdout: "event": "throttled", 2023-08-01T19:56:29.932 INFO:teuthology.orchestra.run.smithi008.stdout: "time": "2023-08-01T19:55:58.556607+0000", 2023-08-01T19:56:29.932 INFO:teuthology.orchestra.run.smithi008.stdout: "duration": 0 2023-08-01T19:56:29.932 INFO:teuthology.orchestra.run.smithi008.stdout: }, 2023-08-01T19:56:29.932 INFO:teuthology.orchestra.run.smithi008.stdout: { 2023-08-01T19:56:29.932 INFO:teuthology.orchestra.run.smithi008.stdout: "event": "header_read", 2023-08-01T19:56:29.932 INFO:teuthology.orchestra.run.smithi008.stdout: "time": "2023-08-01T19:55:58.556606+0000", 2023-08-01T19:56:29.933 INFO:teuthology.orchestra.run.smithi008.stdout: "duration": 4294967295.9999995 2023-08-01T19:56:29.933 INFO:teuthology.orchestra.run.smithi008.stdout: }, 2023-08-01T19:56:29.933 INFO:teuthology.orchestra.run.smithi008.stdout: { 2023-08-01T19:56:29.933 INFO:teuthology.orchestra.run.smithi008.stdout: "event": "all_read", 2023-08-01T19:56:29.933 INFO:teuthology.orchestra.run.smithi008.stdout: "time": "2023-08-01T19:55:58.556609+0000", 2023-08-01T19:56:29.933 INFO:teuthology.orchestra.run.smithi008.stdout: "duration": 3.1750000000000001e-06 2023-08-01T19:56:29.933 INFO:teuthology.orchestra.run.smithi008.stdout: }, 2023-08-01T19:56:29.934 INFO:teuthology.orchestra.run.smithi008.stdout: { 2023-08-01T19:56:29.934 INFO:teuthology.orchestra.run.smithi008.stdout: "event": "dispatched", 2023-08-01T19:56:29.934 INFO:teuthology.orchestra.run.smithi008.stdout: "time": "2023-08-01T19:55:58.556617+0000", 2023-08-01T19:56:29.934 INFO:teuthology.orchestra.run.smithi008.stdout: "duration": 7.2760000000000003e-06 2023-08-01T19:56:29.934 INFO:teuthology.orchestra.run.smithi008.stdout: }, 2023-08-01T19:56:29.934 INFO:teuthology.orchestra.run.smithi008.stdout: { 2023-08-01T19:56:29.934 INFO:teuthology.orchestra.run.smithi008.stdout: "event": "queued_for_pg", 2023-08-01T19:56:29.934 INFO:teuthology.orchestra.run.smithi008.stdout: "time": "2023-08-01T19:55:58.556621+0000", 2023-08-01T19:56:29.935 INFO:teuthology.orchestra.run.smithi008.stdout: "duration": 4.8219999999999997e-06 2023-08-01T19:56:29.935 INFO:teuthology.orchestra.run.smithi008.stdout: }, 2023-08-01T19:56:29.935 INFO:teuthology.orchestra.run.smithi008.stdout: { 2023-08-01T19:56:29.935 INFO:teuthology.orchestra.run.smithi008.stdout: "event": "reached_pg", 2023-08-01T19:56:29.935 INFO:teuthology.orchestra.run.smithi008.stdout: "time": "2023-08-01T19:55:58.556651+0000", 2023-08-01T19:56:29.935 INFO:teuthology.orchestra.run.smithi008.stdout: "duration": 2.9921999999999999e-05 2023-08-01T19:56:29.935 INFO:teuthology.orchestra.run.smithi008.stdout: }, 2023-08-01T19:56:29.935 INFO:teuthology.orchestra.run.smithi008.stdout: { 2023-08-01T19:56:29.936 INFO:teuthology.orchestra.run.smithi008.stdout: "event": "started", 2023-08-01T19:56:29.936 INFO:teuthology.orchestra.run.smithi008.stdout: "time": "2023-08-01T19:55:58.556755+0000", 2023-08-01T19:56:29.936 INFO:teuthology.orchestra.run.smithi008.stdout: "duration": 0.000103309 2023-08-01T19:56:29.936 INFO:teuthology.orchestra.run.smithi008.stdout: }, 2023-08-01T19:56:29.936 INFO:teuthology.orchestra.run.smithi008.stdout: { 2023-08-01T19:56:29.936 INFO:teuthology.orchestra.run.smithi008.stdout: "event": "waiting for subops from 1", 2023-08-01T19:56:29.936 INFO:teuthology.orchestra.run.smithi008.stdout: "time": "2023-08-01T19:55:58.556875+0000", 2023-08-01T19:56:29.936 INFO:teuthology.orchestra.run.smithi008.stdout: "duration": 0.000120424 2023-08-01T19:56:29.937 INFO:teuthology.orchestra.run.smithi008.stdout: }, 2023-08-01T19:56:29.937 INFO:teuthology.orchestra.run.smithi008.stdout: { 2023-08-01T19:56:29.937 INFO:teuthology.orchestra.run.smithi008.stdout: "event": "reached_pg", 2023-08-01T19:56:29.937 INFO:teuthology.orchestra.run.smithi008.stdout: "time": "2023-08-01T19:55:58.569459+0000", 2023-08-01T19:56:29.937 INFO:teuthology.orchestra.run.smithi008.stdout: "duration": 0.012583776 2023-08-01T19:56:29.937 INFO:teuthology.orchestra.run.smithi008.stdout: }, 2023-08-01T19:56:29.937 INFO:teuthology.orchestra.run.smithi008.stdout: { 2023-08-01T19:56:29.937 INFO:teuthology.orchestra.run.smithi008.stdout: "event": "waiting for peered", 2023-08-01T19:56:29.938 INFO:teuthology.orchestra.run.smithi008.stdout: "time": "2023-08-01T19:55:58.569462+0000", 2023-08-01T19:56:29.938 INFO:teuthology.orchestra.run.smithi008.stdout: "duration": 2.74e-06 2023-08-01T19:56:29.938 INFO:teuthology.orchestra.run.smithi008.stdout: }, 2023-08-01T19:56:29.938 INFO:teuthology.orchestra.run.smithi008.stdout: { 2023-08-01T19:56:29.938 INFO:teuthology.orchestra.run.smithi008.stdout: "event": "reached_pg", 2023-08-01T19:56:29.938 INFO:teuthology.orchestra.run.smithi008.stdout: "time": "2023-08-01T19:55:59.620880+0000", 2023-08-01T19:56:29.938 INFO:teuthology.orchestra.run.smithi008.stdout: "duration": 1.0514181279999999 2023-08-01T19:56:29.938 INFO:teuthology.orchestra.run.smithi008.stdout: }, 2023-08-01T19:56:29.939 INFO:teuthology.orchestra.run.smithi008.stdout: { 2023-08-01T19:56:29.939 INFO:teuthology.orchestra.run.smithi008.stdout: "event": "done", 2023-08-01T19:56:29.939 INFO:teuthology.orchestra.run.smithi008.stdout: "time": "2023-08-01T19:55:59.620932+0000", 2023-08-01T19:56:29.939 INFO:teuthology.orchestra.run.smithi008.stdout: "duration": 5.2404000000000002e-05 2023-08-01T19:56:29.939 INFO:teuthology.orchestra.run.smithi008.stdout: } 2023-08-01T19:56:29.939 INFO:teuthology.orchestra.run.smithi008.stdout: ] 2023-08-01T19:56:29.939 INFO:teuthology.orchestra.run.smithi008.stdout: } 2023-08-01T19:56:29.940 INFO:teuthology.orchestra.run.smithi008.stdout: }, 2023-08-01T19:56:29.940 INFO:teuthology.orchestra.run.smithi008.stdout: { 2023-08-01T19:56:29.940 INFO:teuthology.orchestra.run.smithi008.stdout: "description": "osd_op(client.4668.0:197402 5.c 5:3f057b78:::benchmark_data_smithi006_114134_object63741:head [delete] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e61)", 2023-08-01T19:56:29.940 INFO:teuthology.orchestra.run.smithi008.stdout: "initiated_at": "2023-08-01T19:55:58.556632+0000", 2023-08-01T19:56:29.940 INFO:teuthology.orchestra.run.smithi008.stdout: "age": 31.260451870000001, 2023-08-01T19:56:29.940 INFO:teuthology.orchestra.run.smithi008.stdout: "duration": 1.0625773970000001, 2023-08-01T19:56:29.940 INFO:teuthology.orchestra.run.smithi008.stdout: "type_data": { 2023-08-01T19:56:29.940 INFO:teuthology.orchestra.run.smithi008.stdout: "flag_point": "reached pg", 2023-08-01T19:56:29.941 INFO:teuthology.orchestra.run.smithi008.stdout: "client_info": { 2023-08-01T19:56:29.941 INFO:teuthology.orchestra.run.smithi008.stdout: "client": "client.4668", 2023-08-01T19:56:29.941 INFO:teuthology.orchestra.run.smithi008.stdout: "client_addr": "172.21.15.6:0/1709472247", 2023-08-01T19:56:29.941 INFO:teuthology.orchestra.run.smithi008.stdout: "tid": 197402 2023-08-01T19:56:29.941 INFO:teuthology.orchestra.run.smithi008.stdout: }, 2023-08-01T19:56:29.941 INFO:teuthology.orchestra.run.smithi008.stdout: "events": [ 2023-08-01T19:56:29.941 INFO:teuthology.orchestra.run.smithi008.stdout: { 2023-08-01T19:56:29.942 INFO:teuthology.orchestra.run.smithi008.stdout: "event": "initiated", 2023-08-01T19:56:29.942 INFO:teuthology.orchestra.run.smithi008.stdout: "time": "2023-08-01T19:55:58.556632+0000", 2023-08-01T19:56:29.942 INFO:teuthology.orchestra.run.smithi008.stdout: "duration": 0 2023-08-01T19:56:29.942 INFO:teuthology.orchestra.run.smithi008.stdout: }, 2023-08-01T19:56:29.942 INFO:teuthology.orchestra.run.smithi008.stdout: { 2023-08-01T19:56:29.942 INFO:teuthology.orchestra.run.smithi008.stdout: "event": "throttled", 2023-08-01T19:56:29.942 INFO:teuthology.orchestra.run.smithi008.stdout: "time": "2023-08-01T19:55:58.556632+0000", 2023-08-01T19:56:29.942 INFO:teuthology.orchestra.run.smithi008.stdout: "duration": 0 2023-08-01T19:56:29.943 INFO:teuthology.orchestra.run.smithi008.stdout: }, 2023-08-01T19:56:29.943 INFO:teuthology.orchestra.run.smithi008.stdout: { 2023-08-01T19:56:29.943 INFO:teuthology.orchestra.run.smithi008.stdout: "event": "header_read", 2023-08-01T19:56:29.943 INFO:teuthology.orchestra.run.smithi008.stdout: "time": "2023-08-01T19:55:58.556632+0000", 2023-08-01T19:56:29.943 INFO:teuthology.orchestra.run.smithi008.stdout: "duration": 4294967295.9999995 2023-08-01T19:56:29.943 INFO:teuthology.orchestra.run.smithi008.stdout: }, 2023-08-01T19:56:29.943 INFO:teuthology.orchestra.run.smithi008.stdout: { 2023-08-01T19:56:29.943 INFO:teuthology.orchestra.run.smithi008.stdout: "event": "all_read", 2023-08-01T19:56:29.944 INFO:teuthology.orchestra.run.smithi008.stdout: "time": "2023-08-01T19:55:58.556634+0000", 2023-08-01T19:56:29.944 INFO:teuthology.orchestra.run.smithi008.stdout: "duration": 2.8940000000000002e-06 2023-08-01T19:56:29.944 INFO:teuthology.orchestra.run.smithi008.stdout: }, 2023-08-01T19:56:29.944 INFO:teuthology.orchestra.run.smithi008.stdout: { 2023-08-01T19:56:29.944 INFO:teuthology.orchestra.run.smithi008.stdout: "event": "dispatched", 2023-08-01T19:56:29.944 INFO:teuthology.orchestra.run.smithi008.stdout: "time": "2023-08-01T19:55:58.556641+0000", 2023-08-01T19:56:29.944 INFO:teuthology.orchestra.run.smithi008.stdout: "duration": 6.8449999999999997e-06 2023-08-01T19:56:29.944 INFO:teuthology.orchestra.run.smithi008.stdout: }, 2023-08-01T19:56:29.945 INFO:teuthology.orchestra.run.smithi008.stdout: { 2023-08-01T19:56:29.945 INFO:teuthology.orchestra.run.smithi008.stdout: "event": "queued_for_pg", 2023-08-01T19:56:29.945 INFO:teuthology.orchestra.run.smithi008.stdout: "time": "2023-08-01T19:55:58.556646+0000", 2023-08-01T19:56:29.945 INFO:teuthology.orchestra.run.smithi008.stdout: "duration": 5.2070000000000003e-06 2023-08-01T19:56:29.945 INFO:teuthology.orchestra.run.smithi008.stdout: }, 2023-08-01T19:56:29.945 INFO:teuthology.orchestra.run.smithi008.stdout: { 2023-08-01T19:56:29.945 INFO:teuthology.orchestra.run.smithi008.stdout: "event": "reached_pg", 2023-08-01T19:56:29.945 INFO:teuthology.orchestra.run.smithi008.stdout: "time": "2023-08-01T19:55:58.558870+0000", 2023-08-01T19:56:29.946 INFO:teuthology.orchestra.run.smithi008.stdout: "duration": 0.0022237730000000001 2023-08-01T19:56:29.946 INFO:teuthology.orchestra.run.smithi008.stdout: }, 2023-08-01T19:56:29.946 INFO:teuthology.orchestra.run.smithi008.stdout: { 2023-08-01T19:56:29.946 INFO:teuthology.orchestra.run.smithi008.stdout: "event": "started", 2023-08-01T19:56:29.946 INFO:teuthology.orchestra.run.smithi008.stdout: "time": "2023-08-01T19:55:58.559013+0000", 2023-08-01T19:56:29.946 INFO:teuthology.orchestra.run.smithi008.stdout: "duration": 0.00014289899999999999 2023-08-01T19:56:29.946 INFO:teuthology.orchestra.run.smithi008.stdout: }, 2023-08-01T19:56:29.947 INFO:teuthology.orchestra.run.smithi008.stdout: { 2023-08-01T19:56:29.947 INFO:teuthology.orchestra.run.smithi008.stdout: "event": "waiting for subops from 1", 2023-08-01T19:56:29.947 INFO:teuthology.orchestra.run.smithi008.stdout: "time": "2023-08-01T19:55:58.559137+0000", 2023-08-01T19:56:29.947 INFO:teuthology.orchestra.run.smithi008.stdout: "duration": 0.00012428499999999999 2023-08-01T19:56:29.947 INFO:teuthology.orchestra.run.smithi008.stdout: }, 2023-08-01T19:56:29.947 INFO:teuthology.orchestra.run.smithi008.stdout: { 2023-08-01T19:56:29.947 INFO:teuthology.orchestra.run.smithi008.stdout: "event": "reached_pg", 2023-08-01T19:56:29.947 INFO:teuthology.orchestra.run.smithi008.stdout: "time": "2023-08-01T19:55:58.567438+0000", 2023-08-01T19:56:29.948 INFO:teuthology.orchestra.run.smithi008.stdout: "duration": 0.0083003190000000004 2023-08-01T19:56:29.948 INFO:teuthology.orchestra.run.smithi008.stdout: }, 2023-08-01T19:56:29.948 INFO:teuthology.orchestra.run.smithi008.stdout: { 2023-08-01T19:56:29.948 INFO:teuthology.orchestra.run.smithi008.stdout: "event": "waiting for peered", 2023-08-01T19:56:29.948 INFO:teuthology.orchestra.run.smithi008.stdout: "time": "2023-08-01T19:55:58.567443+0000", 2023-08-01T19:56:29.948 INFO:teuthology.orchestra.run.smithi008.stdout: "duration": 5.1739999999999999e-06 2023-08-01T19:56:29.948 INFO:teuthology.orchestra.run.smithi008.stdout: }, 2023-08-01T19:56:29.948 INFO:teuthology.orchestra.run.smithi008.stdout: { 2023-08-01T19:56:29.949 INFO:teuthology.orchestra.run.smithi008.stdout: "event": "reached_pg", 2023-08-01T19:56:29.949 INFO:teuthology.orchestra.run.smithi008.stdout: "time": "2023-08-01T19:55:59.619164+0000", 2023-08-01T19:56:29.949 INFO:teuthology.orchestra.run.smithi008.stdout: "duration": 1.0517206750000001 2023-08-01T19:56:29.949 INFO:teuthology.orchestra.run.smithi008.stdout: }, 2023-08-01T19:56:29.949 INFO:teuthology.orchestra.run.smithi008.stdout: { 2023-08-01T19:56:29.949 INFO:teuthology.orchestra.run.smithi008.stdout: "event": "done", 2023-08-01T19:56:29.949 INFO:teuthology.orchestra.run.smithi008.stdout: "time": "2023-08-01T19:55:59.619209+0000", 2023-08-01T19:56:29.950 INFO:teuthology.orchestra.run.smithi008.stdout: "duration": 4.5800000000000002e-05 2023-08-01T19:56:29.950 INFO:teuthology.orchestra.run.smithi008.stdout: } 2023-08-01T19:56:29.950 INFO:teuthology.orchestra.run.smithi008.stdout: ] 2023-08-01T19:56:29.950 INFO:teuthology.orchestra.run.smithi008.stdout: } 2023-08-01T19:56:29.950 INFO:teuthology.orchestra.run.smithi008.stdout: }, 2023-08-01T19:56:29.950 INFO:teuthology.orchestra.run.smithi008.stdout: { 2023-08-01T19:56:29.950 INFO:teuthology.orchestra.run.smithi008.stdout: "description": "osd_op(client.4668.0:197404 5.5 5:a3c9c1bd:::benchmark_data_smithi006_114134_object63743:head [delete] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e61)", 2023-08-01T19:56:29.951 INFO:teuthology.orchestra.run.smithi008.stdout: "initiated_at": "2023-08-01T19:55:58.556653+0000", 2023-08-01T19:56:29.951 INFO:teuthology.orchestra.run.smithi008.stdout: "age": 31.260430916000001, 2023-08-01T19:56:29.951 INFO:teuthology.orchestra.run.smithi008.stdout: "duration": 1.061865576, 2023-08-01T19:56:29.951 INFO:teuthology.orchestra.run.smithi008.stdout: "type_data": { 2023-08-01T19:56:29.951 INFO:teuthology.orchestra.run.smithi008.stdout: "flag_point": "reached pg", 2023-08-01T19:56:29.951 INFO:teuthology.orchestra.run.smithi008.stdout: "client_info": { 2023-08-01T19:56:29.951 INFO:teuthology.orchestra.run.smithi008.stdout: "client": "client.4668", 2023-08-01T19:56:29.951 INFO:teuthology.orchestra.run.smithi008.stdout: "client_addr": "172.21.15.6:0/1709472247", 2023-08-01T19:56:29.952 INFO:teuthology.orchestra.run.smithi008.stdout: "tid": 197404 2023-08-01T19:56:29.952 INFO:teuthology.orchestra.run.smithi008.stdout: }, 2023-08-01T19:56:29.952 INFO:teuthology.orchestra.run.smithi008.stdout: "events": [ 2023-08-01T19:56:29.952 INFO:teuthology.orchestra.run.smithi008.stdout: { 2023-08-01T19:56:29.952 INFO:teuthology.orchestra.run.smithi008.stdout: "event": "initiated", 2023-08-01T19:56:29.952 INFO:teuthology.orchestra.run.smithi008.stdout: "time": "2023-08-01T19:55:58.556653+0000", 2023-08-01T19:56:29.952 INFO:teuthology.orchestra.run.smithi008.stdout: "duration": 0 2023-08-01T19:56:29.953 INFO:teuthology.orchestra.run.smithi008.stdout: }, 2023-08-01T19:56:29.953 INFO:teuthology.orchestra.run.smithi008.stdout: { 2023-08-01T19:56:29.953 INFO:teuthology.orchestra.run.smithi008.stdout: "event": "throttled", 2023-08-01T19:56:29.953 INFO:teuthology.orchestra.run.smithi008.stdout: "time": "2023-08-01T19:55:58.556653+0000", 2023-08-01T19:56:29.953 INFO:teuthology.orchestra.run.smithi008.stdout: "duration": 0 2023-08-01T19:56:29.953 INFO:teuthology.orchestra.run.smithi008.stdout: }, 2023-08-01T19:56:29.953 INFO:teuthology.orchestra.run.smithi008.stdout: { 2023-08-01T19:56:29.953 INFO:teuthology.orchestra.run.smithi008.stdout: "event": "header_read", 2023-08-01T19:56:29.954 INFO:teuthology.orchestra.run.smithi008.stdout: "time": "2023-08-01T19:55:58.556653+0000", 2023-08-01T19:56:29.954 INFO:teuthology.orchestra.run.smithi008.stdout: "duration": 4294967295.9999995 2023-08-01T19:56:29.954 INFO:teuthology.orchestra.run.smithi008.stdout: }, 2023-08-01T19:56:29.954 INFO:teuthology.orchestra.run.smithi008.stdout: { 2023-08-01T19:56:29.954 INFO:teuthology.orchestra.run.smithi008.stdout: "event": "all_read", 2023-08-01T19:56:29.954 INFO:teuthology.orchestra.run.smithi008.stdout: "time": "2023-08-01T19:55:58.556655+0000", 2023-08-01T19:56:29.954 INFO:teuthology.orchestra.run.smithi008.stdout: "duration": 2.435e-06 2023-08-01T19:56:29.954 INFO:teuthology.orchestra.run.smithi008.stdout: }, 2023-08-01T19:56:29.955 INFO:teuthology.orchestra.run.smithi008.stdout: { 2023-08-01T19:56:29.955 INFO:teuthology.orchestra.run.smithi008.stdout: "event": "dispatched", 2023-08-01T19:56:29.955 INFO:teuthology.orchestra.run.smithi008.stdout: "time": "2023-08-01T19:55:58.556661+0000", 2023-08-01T19:56:29.955 INFO:teuthology.orchestra.run.smithi008.stdout: "duration": 6.0599999999999996e-06 2023-08-01T19:56:29.955 INFO:teuthology.orchestra.run.smithi008.stdout: }, 2023-08-01T19:56:29.955 INFO:teuthology.orchestra.run.smithi008.stdout: { 2023-08-01T19:56:29.955 INFO:teuthology.orchestra.run.smithi008.stdout: "event": "queued_for_pg", 2023-08-01T19:56:29.955 INFO:teuthology.orchestra.run.smithi008.stdout: "time": "2023-08-01T19:55:58.556666+0000", 2023-08-01T19:56:29.956 INFO:teuthology.orchestra.run.smithi008.stdout: "duration": 4.9620000000000001e-06 2023-08-01T19:56:29.956 INFO:teuthology.orchestra.run.smithi008.stdout: }, 2023-08-01T19:56:29.956 INFO:teuthology.orchestra.run.smithi008.stdout: { 2023-08-01T19:56:29.956 INFO:teuthology.orchestra.run.smithi008.stdout: "event": "reached_pg", 2023-08-01T19:56:29.956 INFO:teuthology.orchestra.run.smithi008.stdout: "time": "2023-08-01T19:55:58.556698+0000", 2023-08-01T19:56:29.956 INFO:teuthology.orchestra.run.smithi008.stdout: "duration": 3.2302999999999999e-05 2023-08-01T19:56:29.956 INFO:teuthology.orchestra.run.smithi008.stdout: }, 2023-08-01T19:56:29.957 INFO:teuthology.orchestra.run.smithi008.stdout: { 2023-08-01T19:56:29.957 INFO:teuthology.orchestra.run.smithi008.stdout: "event": "started", 2023-08-01T19:56:29.957 INFO:teuthology.orchestra.run.smithi008.stdout: "time": "2023-08-01T19:55:58.556773+0000", 2023-08-01T19:56:29.957 INFO:teuthology.orchestra.run.smithi008.stdout: "duration": 7.4431999999999995e-05 2023-08-01T19:56:29.957 INFO:teuthology.orchestra.run.smithi008.stdout: }, 2023-08-01T19:56:29.957 INFO:teuthology.orchestra.run.smithi008.stdout: { 2023-08-01T19:56:29.957 INFO:teuthology.orchestra.run.smithi008.stdout: "event": "waiting for subops from 1", 2023-08-01T19:56:29.957 INFO:teuthology.orchestra.run.smithi008.stdout: "time": "2023-08-01T19:55:58.556837+0000", 2023-08-01T19:56:29.958 INFO:teuthology.orchestra.run.smithi008.stdout: "duration": 6.4522000000000003e-05 2023-08-01T19:56:29.958 INFO:teuthology.orchestra.run.smithi008.stdout: }, 2023-08-01T19:56:29.958 INFO:teuthology.orchestra.run.smithi008.stdout: { 2023-08-01T19:56:29.958 INFO:teuthology.orchestra.run.smithi008.stdout: "event": "reached_pg", 2023-08-01T19:56:29.958 INFO:teuthology.orchestra.run.smithi008.stdout: "time": "2023-08-01T19:55:58.563930+0000", 2023-08-01T19:56:29.958 INFO:teuthology.orchestra.run.smithi008.stdout: "duration": 0.0070929030000000002 2023-08-01T19:56:29.958 INFO:teuthology.orchestra.run.smithi008.stdout: }, 2023-08-01T19:56:29.958 INFO:teuthology.orchestra.run.smithi008.stdout: { 2023-08-01T19:56:29.959 INFO:teuthology.orchestra.run.smithi008.stdout: "event": "waiting for peered", 2023-08-01T19:56:29.959 INFO:teuthology.orchestra.run.smithi008.stdout: "time": "2023-08-01T19:55:58.563939+0000", 2023-08-01T19:56:29.959 INFO:teuthology.orchestra.run.smithi008.stdout: "duration": 8.6079999999999996e-06 2023-08-01T19:56:29.959 INFO:teuthology.orchestra.run.smithi008.stdout: }, 2023-08-01T19:56:29.959 INFO:teuthology.orchestra.run.smithi008.stdout: { 2023-08-01T19:56:29.959 INFO:teuthology.orchestra.run.smithi008.stdout: "event": "reached_pg", 2023-08-01T19:56:29.959 INFO:teuthology.orchestra.run.smithi008.stdout: "time": "2023-08-01T19:55:59.618422+0000", 2023-08-01T19:56:29.960 INFO:teuthology.orchestra.run.smithi008.stdout: "duration": 1.054483295 2023-08-01T19:56:29.960 INFO:teuthology.orchestra.run.smithi008.stdout: }, 2023-08-01T19:56:29.960 INFO:teuthology.orchestra.run.smithi008.stdout: { 2023-08-01T19:56:29.960 INFO:teuthology.orchestra.run.smithi008.stdout: "event": "done", 2023-08-01T19:56:29.960 INFO:teuthology.orchestra.run.smithi008.stdout: "time": "2023-08-01T19:55:59.618519+0000", 2023-08-01T19:56:29.960 INFO:teuthology.orchestra.run.smithi008.stdout: "duration": 9.6471000000000005e-05 2023-08-01T19:56:29.960 INFO:teuthology.orchestra.run.smithi008.stdout: } 2023-08-01T19:56:29.960 INFO:teuthology.orchestra.run.smithi008.stdout: ] 2023-08-01T19:56:29.961 INFO:teuthology.orchestra.run.smithi008.stdout: } 2023-08-01T19:56:29.961 INFO:teuthology.orchestra.run.smithi008.stdout: }, 2023-08-01T19:56:29.961 INFO:teuthology.orchestra.run.smithi008.stdout: { 2023-08-01T19:56:29.961 INFO:teuthology.orchestra.run.smithi008.stdout: "description": "osd_op(client.4668.0:197407 5.1 5:85528fae:::benchmark_data_smithi006_114134_object63746:head [delete] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e61)", 2023-08-01T19:56:29.961 INFO:teuthology.orchestra.run.smithi008.stdout: "initiated_at": "2023-08-01T19:55:58.559216+0000", 2023-08-01T19:56:29.961 INFO:teuthology.orchestra.run.smithi008.stdout: "age": 31.257868267999999, 2023-08-01T19:56:29.961 INFO:teuthology.orchestra.run.smithi008.stdout: "duration": 1.061802277, 2023-08-01T19:56:29.961 INFO:teuthology.orchestra.run.smithi008.stdout: "type_data": { 2023-08-01T19:56:29.962 INFO:teuthology.orchestra.run.smithi008.stdout: "flag_point": "reached pg", 2023-08-01T19:56:29.962 INFO:teuthology.orchestra.run.smithi008.stdout: "client_info": { 2023-08-01T19:56:29.962 INFO:teuthology.orchestra.run.smithi008.stdout: "client": "client.4668", 2023-08-01T19:56:29.962 INFO:teuthology.orchestra.run.smithi008.stdout: "client_addr": "172.21.15.6:0/1709472247", 2023-08-01T19:56:29.962 INFO:teuthology.orchestra.run.smithi008.stdout: "tid": 197407 2023-08-01T19:56:29.962 INFO:teuthology.orchestra.run.smithi008.stdout: }, 2023-08-01T19:56:29.962 INFO:teuthology.orchestra.run.smithi008.stdout: "events": [ 2023-08-01T19:56:29.963 INFO:teuthology.orchestra.run.smithi008.stdout: { 2023-08-01T19:56:29.963 INFO:teuthology.orchestra.run.smithi008.stdout: "event": "initiated", 2023-08-01T19:56:29.963 INFO:teuthology.orchestra.run.smithi008.stdout: "time": "2023-08-01T19:55:58.559216+0000", 2023-08-01T19:56:29.963 INFO:teuthology.orchestra.run.smithi008.stdout: "duration": 0 2023-08-01T19:56:29.963 INFO:teuthology.orchestra.run.smithi008.stdout: }, 2023-08-01T19:56:29.963 INFO:teuthology.orchestra.run.smithi008.stdout: { 2023-08-01T19:56:29.963 INFO:teuthology.orchestra.run.smithi008.stdout: "event": "throttled", 2023-08-01T19:56:29.963 INFO:teuthology.orchestra.run.smithi008.stdout: "time": "2023-08-01T19:55:58.559216+0000", 2023-08-01T19:56:29.964 INFO:teuthology.orchestra.run.smithi008.stdout: "duration": 0 2023-08-01T19:56:29.964 INFO:teuthology.orchestra.run.smithi008.stdout: }, 2023-08-01T19:56:29.964 INFO:teuthology.orchestra.run.smithi008.stdout: { 2023-08-01T19:56:29.964 INFO:teuthology.orchestra.run.smithi008.stdout: "event": "header_read", 2023-08-01T19:56:29.964 INFO:teuthology.orchestra.run.smithi008.stdout: "time": "2023-08-01T19:55:58.559215+0000", 2023-08-01T19:56:29.964 INFO:teuthology.orchestra.run.smithi008.stdout: "duration": 4294967295.999999 2023-08-01T19:56:29.964 INFO:teuthology.orchestra.run.smithi008.stdout: }, 2023-08-01T19:56:29.965 INFO:teuthology.orchestra.run.smithi008.stdout: { 2023-08-01T19:56:29.965 INFO:teuthology.orchestra.run.smithi008.stdout: "event": "all_read", 2023-08-01T19:56:29.965 INFO:teuthology.orchestra.run.smithi008.stdout: "time": "2023-08-01T19:55:58.559220+0000", 2023-08-01T19:56:29.965 INFO:teuthology.orchestra.run.smithi008.stdout: "duration": 5.3879999999999999e-06 2023-08-01T19:56:29.965 INFO:teuthology.orchestra.run.smithi008.stdout: }, 2023-08-01T19:56:29.965 INFO:teuthology.orchestra.run.smithi008.stdout: { 2023-08-01T19:56:29.965 INFO:teuthology.orchestra.run.smithi008.stdout: "event": "dispatched", 2023-08-01T19:56:29.965 INFO:teuthology.orchestra.run.smithi008.stdout: "time": "2023-08-01T19:55:58.559230+0000", 2023-08-01T19:56:29.966 INFO:teuthology.orchestra.run.smithi008.stdout: "duration": 9.6590000000000002e-06 2023-08-01T19:56:29.966 INFO:teuthology.orchestra.run.smithi008.stdout: }, 2023-08-01T19:56:29.966 INFO:teuthology.orchestra.run.smithi008.stdout: { 2023-08-01T19:56:29.966 INFO:teuthology.orchestra.run.smithi008.stdout: "event": "queued_for_pg", 2023-08-01T19:56:29.966 INFO:teuthology.orchestra.run.smithi008.stdout: "time": "2023-08-01T19:55:58.559235+0000", 2023-08-01T19:56:29.966 INFO:teuthology.orchestra.run.smithi008.stdout: "duration": 5.575e-06 2023-08-01T19:56:29.966 INFO:teuthology.orchestra.run.smithi008.stdout: }, 2023-08-01T19:56:29.966 INFO:teuthology.orchestra.run.smithi008.stdout: { 2023-08-01T19:56:29.967 INFO:teuthology.orchestra.run.smithi008.stdout: "event": "reached_pg", 2023-08-01T19:56:29.967 INFO:teuthology.orchestra.run.smithi008.stdout: "time": "2023-08-01T19:55:58.559279+0000", 2023-08-01T19:56:29.967 INFO:teuthology.orchestra.run.smithi008.stdout: "duration": 4.3273999999999999e-05 2023-08-01T19:56:29.967 INFO:teuthology.orchestra.run.smithi008.stdout: }, 2023-08-01T19:56:29.967 INFO:teuthology.orchestra.run.smithi008.stdout: { 2023-08-01T19:56:29.967 INFO:teuthology.orchestra.run.smithi008.stdout: "event": "started", 2023-08-01T19:56:29.967 INFO:teuthology.orchestra.run.smithi008.stdout: "time": "2023-08-01T19:55:58.559403+0000", 2023-08-01T19:56:29.968 INFO:teuthology.orchestra.run.smithi008.stdout: "duration": 0.000124781 2023-08-01T19:56:29.968 INFO:teuthology.orchestra.run.smithi008.stdout: }, 2023-08-01T19:56:29.968 INFO:teuthology.orchestra.run.smithi008.stdout: { 2023-08-01T19:56:29.968 INFO:teuthology.orchestra.run.smithi008.stdout: "event": "waiting for subops from 1", 2023-08-01T19:56:29.968 INFO:teuthology.orchestra.run.smithi008.stdout: "time": "2023-08-01T19:55:58.559561+0000", 2023-08-01T19:56:29.968 INFO:teuthology.orchestra.run.smithi008.stdout: "duration": 0.000157773 2023-08-01T19:56:29.968 INFO:teuthology.orchestra.run.smithi008.stdout: }, 2023-08-01T19:56:29.968 INFO:teuthology.orchestra.run.smithi008.stdout: { 2023-08-01T19:56:29.969 INFO:teuthology.orchestra.run.smithi008.stdout: "event": "reached_pg", 2023-08-01T19:56:29.969 INFO:teuthology.orchestra.run.smithi008.stdout: "time": "2023-08-01T19:55:58.569498+0000", 2023-08-01T19:56:29.969 INFO:teuthology.orchestra.run.smithi008.stdout: "duration": 0.0099367069999999995 2023-08-01T19:56:29.969 INFO:teuthology.orchestra.run.smithi008.stdout: }, 2023-08-01T19:56:29.969 INFO:teuthology.orchestra.run.smithi008.stdout: { 2023-08-01T19:56:29.969 INFO:teuthology.orchestra.run.smithi008.stdout: "event": "waiting for peered", 2023-08-01T19:56:29.969 INFO:teuthology.orchestra.run.smithi008.stdout: "time": "2023-08-01T19:55:58.569756+0000", 2023-08-01T19:56:29.969 INFO:teuthology.orchestra.run.smithi008.stdout: "duration": 0.00025830800000000001 2023-08-01T19:56:29.970 INFO:teuthology.orchestra.run.smithi008.stdout: }, 2023-08-01T19:56:29.970 INFO:teuthology.orchestra.run.smithi008.stdout: { 2023-08-01T19:56:29.970 INFO:teuthology.orchestra.run.smithi008.stdout: "event": "reached_pg", 2023-08-01T19:56:29.970 INFO:teuthology.orchestra.run.smithi008.stdout: "time": "2023-08-01T19:55:59.620962+0000", 2023-08-01T19:56:29.970 INFO:teuthology.orchestra.run.smithi008.stdout: "duration": 1.0512062129999999 2023-08-01T19:56:29.970 INFO:teuthology.orchestra.run.smithi008.stdout: }, 2023-08-01T19:56:29.970 INFO:teuthology.orchestra.run.smithi008.stdout: { 2023-08-01T19:56:29.970 INFO:teuthology.orchestra.run.smithi008.stdout: "event": "done", 2023-08-01T19:56:29.971 INFO:teuthology.orchestra.run.smithi008.stdout: "time": "2023-08-01T19:55:59.621018+0000", 2023-08-01T19:56:29.971 INFO:teuthology.orchestra.run.smithi008.stdout: "duration": 5.5498999999999998e-05 2023-08-01T19:56:29.971 INFO:teuthology.orchestra.run.smithi008.stdout: } 2023-08-01T19:56:29.971 INFO:teuthology.orchestra.run.smithi008.stdout: ] 2023-08-01T19:56:29.971 INFO:teuthology.orchestra.run.smithi008.stdout: } 2023-08-01T19:56:29.971 INFO:teuthology.orchestra.run.smithi008.stdout: }, 2023-08-01T19:56:29.971 INFO:teuthology.orchestra.run.smithi008.stdout: { 2023-08-01T19:56:29.972 INFO:teuthology.orchestra.run.smithi008.stdout: "description": "osd_op(client.4668.0:197396 5.2 5:43f8487b:::benchmark_data_smithi006_114134_object63735:head [delete] snapc 0=[] RETRY=1 ondisk+retry+write+known_if_redirected+supports_pool_eio e62)", 2023-08-01T19:56:29.972 INFO:teuthology.orchestra.run.smithi008.stdout: "initiated_at": "2023-08-01T19:55:58.564585+0000", 2023-08-01T19:56:29.972 INFO:teuthology.orchestra.run.smithi008.stdout: "age": 31.252499294, 2023-08-01T19:56:29.972 INFO:teuthology.orchestra.run.smithi008.stdout: "duration": 1.0535085049999999, 2023-08-01T19:56:29.972 INFO:teuthology.orchestra.run.smithi008.stdout: "type_data": { 2023-08-01T19:56:29.972 INFO:teuthology.orchestra.run.smithi008.stdout: "flag_point": "reached pg", 2023-08-01T19:56:29.972 INFO:teuthology.orchestra.run.smithi008.stdout: "client_info": { 2023-08-01T19:56:29.972 INFO:teuthology.orchestra.run.smithi008.stdout: "client": "client.4668", 2023-08-01T19:56:29.973 INFO:teuthology.orchestra.run.smithi008.stdout: "client_addr": "172.21.15.6:0/1709472247", 2023-08-01T19:56:29.973 INFO:teuthology.orchestra.run.smithi008.stdout: "tid": 197396 2023-08-01T19:56:29.973 INFO:teuthology.orchestra.run.smithi008.stdout: }, 2023-08-01T19:56:29.973 INFO:teuthology.orchestra.run.smithi008.stdout: "events": [ 2023-08-01T19:56:29.973 INFO:teuthology.orchestra.run.smithi008.stdout: { 2023-08-01T19:56:29.973 INFO:teuthology.orchestra.run.smithi008.stdout: "event": "initiated", 2023-08-01T19:56:29.973 INFO:teuthology.orchestra.run.smithi008.stdout: "time": "2023-08-01T19:55:58.564585+0000", 2023-08-01T19:56:29.974 INFO:teuthology.orchestra.run.smithi008.stdout: "duration": 0 2023-08-01T19:56:29.974 INFO:teuthology.orchestra.run.smithi008.stdout: }, 2023-08-01T19:56:29.974 INFO:teuthology.orchestra.run.smithi008.stdout: { 2023-08-01T19:56:29.974 INFO:teuthology.orchestra.run.smithi008.stdout: "event": "throttled", 2023-08-01T19:56:29.974 INFO:teuthology.orchestra.run.smithi008.stdout: "time": "2023-08-01T19:55:58.564585+0000", 2023-08-01T19:56:29.974 INFO:teuthology.orchestra.run.smithi008.stdout: "duration": 0 2023-08-01T19:56:29.974 INFO:teuthology.orchestra.run.smithi008.stdout: }, 2023-08-01T19:56:29.974 INFO:teuthology.orchestra.run.smithi008.stdout: { 2023-08-01T19:56:29.975 INFO:teuthology.orchestra.run.smithi008.stdout: "event": "header_read", 2023-08-01T19:56:29.975 INFO:teuthology.orchestra.run.smithi008.stdout: "time": "2023-08-01T19:55:58.564583+0000", 2023-08-01T19:56:29.975 INFO:teuthology.orchestra.run.smithi008.stdout: "duration": 4294967295.9999981 2023-08-01T19:56:29.975 INFO:teuthology.orchestra.run.smithi008.stdout: }, 2023-08-01T19:56:29.975 INFO:teuthology.orchestra.run.smithi008.stdout: { 2023-08-01T19:56:29.975 INFO:teuthology.orchestra.run.smithi008.stdout: "event": "all_read", 2023-08-01T19:56:29.975 INFO:teuthology.orchestra.run.smithi008.stdout: "time": "2023-08-01T19:55:58.564591+0000", 2023-08-01T19:56:29.976 INFO:teuthology.orchestra.run.smithi008.stdout: "duration": 8.2169999999999994e-06 2023-08-01T19:56:29.976 INFO:teuthology.orchestra.run.smithi008.stdout: }, 2023-08-01T19:56:29.976 INFO:teuthology.orchestra.run.smithi008.stdout: { 2023-08-01T19:56:29.976 INFO:teuthology.orchestra.run.smithi008.stdout: "event": "dispatched", 2023-08-01T19:56:29.976 INFO:teuthology.orchestra.run.smithi008.stdout: "time": "2023-08-01T19:55:58.564603+0000", 2023-08-01T19:56:29.976 INFO:teuthology.orchestra.run.smithi008.stdout: "duration": 1.186e-05 2023-08-01T19:56:29.976 INFO:teuthology.orchestra.run.smithi008.stdout: }, 2023-08-01T19:56:29.977 INFO:teuthology.orchestra.run.smithi008.stdout: { 2023-08-01T19:56:29.977 INFO:teuthology.orchestra.run.smithi008.stdout: "event": "queued_for_pg", 2023-08-01T19:56:29.977 INFO:teuthology.orchestra.run.smithi008.stdout: "time": "2023-08-01T19:55:58.564609+0000", 2023-08-01T19:56:29.977 INFO:teuthology.orchestra.run.smithi008.stdout: "duration": 6.4130000000000003e-06 2023-08-01T19:56:29.977 INFO:teuthology.orchestra.run.smithi008.stdout: }, 2023-08-01T19:56:29.977 INFO:teuthology.orchestra.run.smithi008.stdout: { 2023-08-01T19:56:29.977 INFO:teuthology.orchestra.run.smithi008.stdout: "event": "reached_pg", 2023-08-01T19:56:29.977 INFO:teuthology.orchestra.run.smithi008.stdout: "time": "2023-08-01T19:55:58.573439+0000", 2023-08-01T19:56:29.978 INFO:teuthology.orchestra.run.smithi008.stdout: "duration": 0.0088303310000000003 2023-08-01T19:56:29.978 INFO:teuthology.orchestra.run.smithi008.stdout: }, 2023-08-01T19:56:29.978 INFO:teuthology.orchestra.run.smithi008.stdout: { 2023-08-01T19:56:29.978 INFO:teuthology.orchestra.run.smithi008.stdout: "event": "waiting for peered", 2023-08-01T19:56:29.978 INFO:teuthology.orchestra.run.smithi008.stdout: "time": "2023-08-01T19:55:58.573448+0000", 2023-08-01T19:56:29.978 INFO:teuthology.orchestra.run.smithi008.stdout: "duration": 8.2910000000000007e-06 2023-08-01T19:56:29.978 INFO:teuthology.orchestra.run.smithi008.stdout: }, 2023-08-01T19:56:29.979 INFO:teuthology.orchestra.run.smithi008.stdout: { 2023-08-01T19:56:29.979 INFO:teuthology.orchestra.run.smithi008.stdout: "event": "reached_pg", 2023-08-01T19:56:29.979 INFO:teuthology.orchestra.run.smithi008.stdout: "time": "2023-08-01T19:55:59.617892+0000", 2023-08-01T19:56:29.979 INFO:teuthology.orchestra.run.smithi008.stdout: "duration": 1.0444446380000001 2023-08-01T19:56:29.979 INFO:teuthology.orchestra.run.smithi008.stdout: }, 2023-08-01T19:56:29.979 INFO:teuthology.orchestra.run.smithi008.stdout: { 2023-08-01T19:56:29.979 INFO:teuthology.orchestra.run.smithi008.stdout: "event": "done", 2023-08-01T19:56:29.979 INFO:teuthology.orchestra.run.smithi008.stdout: "time": "2023-08-01T19:55:59.618093+0000", 2023-08-01T19:56:29.980 INFO:teuthology.orchestra.run.smithi008.stdout: "duration": 0.00020066300000000001 2023-08-01T19:56:29.980 INFO:teuthology.orchestra.run.smithi008.stdout: } 2023-08-01T19:56:29.980 INFO:teuthology.orchestra.run.smithi008.stdout: ] 2023-08-01T19:56:29.980 INFO:teuthology.orchestra.run.smithi008.stdout: } 2023-08-01T19:56:29.980 INFO:teuthology.orchestra.run.smithi008.stdout: }, 2023-08-01T19:56:29.980 INFO:teuthology.orchestra.run.smithi008.stdout: { 2023-08-01T19:56:29.980 INFO:teuthology.orchestra.run.smithi008.stdout: "description": "osd_op(client.4668.0:197411 5.7 5:ebefbc20:::benchmark_data_smithi006_114134_object63750:head [delete] snapc 0=[] RETRY=1 ondisk+retry+write+known_if_redirected+supports_pool_eio e62)", 2023-08-01T19:56:29.980 INFO:teuthology.orchestra.run.smithi008.stdout: "initiated_at": "2023-08-01T19:55:58.564619+0000", 2023-08-01T19:56:29.981 INFO:teuthology.orchestra.run.smithi008.stdout: "age": 31.252464619000001, 2023-08-01T19:56:29.981 INFO:teuthology.orchestra.run.smithi008.stdout: "duration": 1.0686062569999999, 2023-08-01T19:56:29.981 INFO:teuthology.orchestra.run.smithi008.stdout: "type_data": { 2023-08-01T19:56:29.981 INFO:teuthology.orchestra.run.smithi008.stdout: "flag_point": "commit sent; apply or cleanup", 2023-08-01T19:56:29.981 INFO:teuthology.orchestra.run.smithi008.stdout: "client_info": { 2023-08-01T19:56:29.981 INFO:teuthology.orchestra.run.smithi008.stdout: "client": "client.4668", 2023-08-01T19:56:29.981 INFO:teuthology.orchestra.run.smithi008.stdout: "client_addr": "172.21.15.6:0/1709472247", 2023-08-01T19:56:29.982 INFO:teuthology.orchestra.run.smithi008.stdout: "tid": 197411 2023-08-01T19:56:29.982 INFO:teuthology.orchestra.run.smithi008.stdout: }, 2023-08-01T19:56:29.982 INFO:teuthology.orchestra.run.smithi008.stdout: "events": [ 2023-08-01T19:56:29.982 INFO:teuthology.orchestra.run.smithi008.stdout: { 2023-08-01T19:56:29.982 INFO:teuthology.orchestra.run.smithi008.stdout: "event": "initiated", 2023-08-01T19:56:29.982 INFO:teuthology.orchestra.run.smithi008.stdout: "time": "2023-08-01T19:55:58.564619+0000", 2023-08-01T19:56:29.982 INFO:teuthology.orchestra.run.smithi008.stdout: "duration": 0 2023-08-01T19:56:29.983 INFO:teuthology.orchestra.run.smithi008.stdout: }, 2023-08-01T19:56:29.983 INFO:teuthology.orchestra.run.smithi008.stdout: { 2023-08-01T19:56:29.983 INFO:teuthology.orchestra.run.smithi008.stdout: "event": "throttled", 2023-08-01T19:56:29.983 INFO:teuthology.orchestra.run.smithi008.stdout: "time": "2023-08-01T19:55:58.564619+0000", 2023-08-01T19:56:29.983 INFO:teuthology.orchestra.run.smithi008.stdout: "duration": 0 2023-08-01T19:56:29.983 INFO:teuthology.orchestra.run.smithi008.stdout: }, 2023-08-01T19:56:29.983 INFO:teuthology.orchestra.run.smithi008.stdout: { 2023-08-01T19:56:29.983 INFO:teuthology.orchestra.run.smithi008.stdout: "event": "header_read", 2023-08-01T19:56:29.984 INFO:teuthology.orchestra.run.smithi008.stdout: "time": "2023-08-01T19:55:58.564619+0000", 2023-08-01T19:56:29.984 INFO:teuthology.orchestra.run.smithi008.stdout: "duration": 4294967295.9999995 2023-08-01T19:56:29.984 INFO:teuthology.orchestra.run.smithi008.stdout: }, 2023-08-01T19:56:29.984 INFO:teuthology.orchestra.run.smithi008.stdout: { 2023-08-01T19:56:29.984 INFO:teuthology.orchestra.run.smithi008.stdout: "event": "all_read", 2023-08-01T19:56:29.984 INFO:teuthology.orchestra.run.smithi008.stdout: "time": "2023-08-01T19:55:58.564621+0000", 2023-08-01T19:56:29.984 INFO:teuthology.orchestra.run.smithi008.stdout: "duration": 2.6139999999999999e-06 2023-08-01T19:56:29.985 INFO:teuthology.orchestra.run.smithi008.stdout: }, 2023-08-01T19:56:29.985 INFO:teuthology.orchestra.run.smithi008.stdout: { 2023-08-01T19:56:29.985 INFO:teuthology.orchestra.run.smithi008.stdout: "event": "dispatched", 2023-08-01T19:56:29.985 INFO:teuthology.orchestra.run.smithi008.stdout: "time": "2023-08-01T19:55:58.564627+0000", 2023-08-01T19:56:29.985 INFO:teuthology.orchestra.run.smithi008.stdout: "duration": 5.1150000000000002e-06 2023-08-01T19:56:29.985 INFO:teuthology.orchestra.run.smithi008.stdout: }, 2023-08-01T19:56:29.985 INFO:teuthology.orchestra.run.smithi008.stdout: { 2023-08-01T19:56:29.986 INFO:teuthology.orchestra.run.smithi008.stdout: "event": "queued_for_pg", 2023-08-01T19:56:29.986 INFO:teuthology.orchestra.run.smithi008.stdout: "time": "2023-08-01T19:55:58.564631+0000", 2023-08-01T19:56:29.986 INFO:teuthology.orchestra.run.smithi008.stdout: "duration": 4.702e-06 2023-08-01T19:56:29.986 INFO:teuthology.orchestra.run.smithi008.stdout: }, 2023-08-01T19:56:29.986 INFO:teuthology.orchestra.run.smithi008.stdout: { 2023-08-01T19:56:29.986 INFO:teuthology.orchestra.run.smithi008.stdout: "event": "reached_pg", 2023-08-01T19:56:29.986 INFO:teuthology.orchestra.run.smithi008.stdout: "time": "2023-08-01T19:55:58.565520+0000", 2023-08-01T19:56:29.986 INFO:teuthology.orchestra.run.smithi008.stdout: "duration": 0.00088893399999999997 2023-08-01T19:56:29.987 INFO:teuthology.orchestra.run.smithi008.stdout: }, 2023-08-01T19:56:29.987 INFO:teuthology.orchestra.run.smithi008.stdout: { 2023-08-01T19:56:29.987 INFO:teuthology.orchestra.run.smithi008.stdout: "event": "waiting for peered", 2023-08-01T19:56:29.987 INFO:teuthology.orchestra.run.smithi008.stdout: "time": "2023-08-01T19:55:58.565528+0000", 2023-08-01T19:56:29.987 INFO:teuthology.orchestra.run.smithi008.stdout: "duration": 7.5410000000000003e-06 2023-08-01T19:56:29.987 INFO:teuthology.orchestra.run.smithi008.stdout: }, 2023-08-01T19:56:29.987 INFO:teuthology.orchestra.run.smithi008.stdout: { 2023-08-01T19:56:29.987 INFO:teuthology.orchestra.run.smithi008.stdout: "event": "reached_pg", 2023-08-01T19:56:29.988 INFO:teuthology.orchestra.run.smithi008.stdout: "time": "2023-08-01T19:55:59.622374+0000", 2023-08-01T19:56:29.988 INFO:teuthology.orchestra.run.smithi008.stdout: "duration": 1.05684588 2023-08-01T19:56:29.988 INFO:teuthology.orchestra.run.smithi008.stdout: }, 2023-08-01T19:56:29.988 INFO:teuthology.orchestra.run.smithi008.stdout: { 2023-08-01T19:56:29.988 INFO:teuthology.orchestra.run.smithi008.stdout: "event": "started", 2023-08-01T19:56:29.988 INFO:teuthology.orchestra.run.smithi008.stdout: "time": "2023-08-01T19:55:59.624156+0000", 2023-08-01T19:56:29.988 INFO:teuthology.orchestra.run.smithi008.stdout: "duration": 0.0017826129999999999 2023-08-01T19:56:29.989 INFO:teuthology.orchestra.run.smithi008.stdout: }, 2023-08-01T19:56:29.989 INFO:teuthology.orchestra.run.smithi008.stdout: { 2023-08-01T19:56:29.989 INFO:teuthology.orchestra.run.smithi008.stdout: "event": "op_commit", 2023-08-01T19:56:29.989 INFO:teuthology.orchestra.run.smithi008.stdout: "time": "2023-08-01T19:55:59.633131+0000", 2023-08-01T19:56:29.989 INFO:teuthology.orchestra.run.smithi008.stdout: "duration": 0.0089745740000000008 2023-08-01T19:56:29.989 INFO:teuthology.orchestra.run.smithi008.stdout: }, 2023-08-01T19:56:29.989 INFO:teuthology.orchestra.run.smithi008.stdout: { 2023-08-01T19:56:29.989 INFO:teuthology.orchestra.run.smithi008.stdout: "event": "commit_sent", 2023-08-01T19:56:29.990 INFO:teuthology.orchestra.run.smithi008.stdout: "time": "2023-08-01T19:55:59.633173+0000", 2023-08-01T19:56:29.990 INFO:teuthology.orchestra.run.smithi008.stdout: "duration": 4.2645000000000003e-05 2023-08-01T19:56:29.990 INFO:teuthology.orchestra.run.smithi008.stdout: }, 2023-08-01T19:56:29.990 INFO:teuthology.orchestra.run.smithi008.stdout: { 2023-08-01T19:56:29.990 INFO:teuthology.orchestra.run.smithi008.stdout: "event": "done", 2023-08-01T19:56:29.990 INFO:teuthology.orchestra.run.smithi008.stdout: "time": "2023-08-01T19:55:59.633225+0000", 2023-08-01T19:56:29.990 INFO:teuthology.orchestra.run.smithi008.stdout: "duration": 5.2003999999999999e-05 2023-08-01T19:56:29.990 INFO:teuthology.orchestra.run.smithi008.stdout: } 2023-08-01T19:56:29.991 INFO:teuthology.orchestra.run.smithi008.stdout: ] 2023-08-01T19:56:29.991 INFO:teuthology.orchestra.run.smithi008.stdout: } 2023-08-01T19:56:29.991 INFO:teuthology.orchestra.run.smithi008.stdout: }, 2023-08-01T19:56:29.991 INFO:teuthology.orchestra.run.smithi008.stdout: { 2023-08-01T19:56:29.991 INFO:teuthology.orchestra.run.smithi008.stdout: "description": "osd_op(client.4668.0:197413 5.5 5:a6ff9d8a:::benchmark_data_smithi006_114134_object63752:head [delete] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e62)", 2023-08-01T19:56:29.991 INFO:teuthology.orchestra.run.smithi008.stdout: "initiated_at": "2023-08-01T19:55:58.573778+0000", 2023-08-01T19:56:29.991 INFO:teuthology.orchestra.run.smithi008.stdout: "age": 31.243305653, 2023-08-01T19:56:29.991 INFO:teuthology.orchestra.run.smithi008.stdout: "duration": 1.054781371, 2023-08-01T19:56:29.992 INFO:teuthology.orchestra.run.smithi008.stdout: "type_data": { 2023-08-01T19:56:29.992 INFO:teuthology.orchestra.run.smithi008.stdout: "flag_point": "commit sent; apply or cleanup", 2023-08-01T19:56:29.992 INFO:teuthology.orchestra.run.smithi008.stdout: "client_info": { 2023-08-01T19:56:29.992 INFO:teuthology.orchestra.run.smithi008.stdout: "client": "client.4668", 2023-08-01T19:56:29.992 INFO:teuthology.orchestra.run.smithi008.stdout: "client_addr": "172.21.15.6:0/1709472247", 2023-08-01T19:56:29.992 INFO:teuthology.orchestra.run.smithi008.stdout: "tid": 197413 2023-08-01T19:56:29.992 INFO:teuthology.orchestra.run.smithi008.stdout: }, 2023-08-01T19:56:29.993 INFO:teuthology.orchestra.run.smithi008.stdout: "events": [ 2023-08-01T19:56:29.993 INFO:teuthology.orchestra.run.smithi008.stdout: { 2023-08-01T19:56:29.993 INFO:teuthology.orchestra.run.smithi008.stdout: "event": "initiated", 2023-08-01T19:56:29.993 INFO:teuthology.orchestra.run.smithi008.stdout: "time": "2023-08-01T19:55:58.573778+0000", 2023-08-01T19:56:29.993 INFO:teuthology.orchestra.run.smithi008.stdout: "duration": 0 2023-08-01T19:56:29.993 INFO:teuthology.orchestra.run.smithi008.stdout: }, 2023-08-01T19:56:29.993 INFO:teuthology.orchestra.run.smithi008.stdout: { 2023-08-01T19:56:29.993 INFO:teuthology.orchestra.run.smithi008.stdout: "event": "throttled", 2023-08-01T19:56:29.994 INFO:teuthology.orchestra.run.smithi008.stdout: "time": "2023-08-01T19:55:58.573778+0000", 2023-08-01T19:56:29.994 INFO:teuthology.orchestra.run.smithi008.stdout: "duration": 0 2023-08-01T19:56:29.994 INFO:teuthology.orchestra.run.smithi008.stdout: }, 2023-08-01T19:56:29.994 INFO:teuthology.orchestra.run.smithi008.stdout: { 2023-08-01T19:56:29.994 INFO:teuthology.orchestra.run.smithi008.stdout: "event": "header_read", 2023-08-01T19:56:29.994 INFO:teuthology.orchestra.run.smithi008.stdout: "time": "2023-08-01T19:55:58.573776+0000", 2023-08-01T19:56:29.994 INFO:teuthology.orchestra.run.smithi008.stdout: "duration": 4294967295.9999981 2023-08-01T19:56:29.994 INFO:teuthology.orchestra.run.smithi008.stdout: }, 2023-08-01T19:56:29.995 INFO:teuthology.orchestra.run.smithi008.stdout: { 2023-08-01T19:56:29.995 INFO:teuthology.orchestra.run.smithi008.stdout: "event": "all_read", 2023-08-01T19:56:29.995 INFO:teuthology.orchestra.run.smithi008.stdout: "time": "2023-08-01T19:55:58.573784+0000", 2023-08-01T19:56:29.995 INFO:teuthology.orchestra.run.smithi008.stdout: "duration": 8.2490000000000001e-06 2023-08-01T19:56:29.995 INFO:teuthology.orchestra.run.smithi008.stdout: }, 2023-08-01T19:56:29.995 INFO:teuthology.orchestra.run.smithi008.stdout: { 2023-08-01T19:56:29.995 INFO:teuthology.orchestra.run.smithi008.stdout: "event": "dispatched", 2023-08-01T19:56:29.996 INFO:teuthology.orchestra.run.smithi008.stdout: "time": "2023-08-01T19:55:58.574230+0000", 2023-08-01T19:56:29.996 INFO:teuthology.orchestra.run.smithi008.stdout: "duration": 0.00044558400000000001 2023-08-01T19:56:29.996 INFO:teuthology.orchestra.run.smithi008.stdout: }, 2023-08-01T19:56:29.996 INFO:teuthology.orchestra.run.smithi008.stdout: { 2023-08-01T19:56:29.996 INFO:teuthology.orchestra.run.smithi008.stdout: "event": "queued_for_pg", 2023-08-01T19:56:29.996 INFO:teuthology.orchestra.run.smithi008.stdout: "time": "2023-08-01T19:55:58.574240+0000", 2023-08-01T19:56:29.996 INFO:teuthology.orchestra.run.smithi008.stdout: "duration": 9.7699999999999996e-06 2023-08-01T19:56:29.996 INFO:teuthology.orchestra.run.smithi008.stdout: }, 2023-08-01T19:56:29.997 INFO:teuthology.orchestra.run.smithi008.stdout: { 2023-08-01T19:56:29.997 INFO:teuthology.orchestra.run.smithi008.stdout: "event": "reached_pg", 2023-08-01T19:56:29.997 INFO:teuthology.orchestra.run.smithi008.stdout: "time": "2023-08-01T19:55:58.574292+0000", 2023-08-01T19:56:29.997 INFO:teuthology.orchestra.run.smithi008.stdout: "duration": 5.2101000000000001e-05 2023-08-01T19:56:29.997 INFO:teuthology.orchestra.run.smithi008.stdout: }, 2023-08-01T19:56:29.997 INFO:teuthology.orchestra.run.smithi008.stdout: { 2023-08-01T19:56:29.997 INFO:teuthology.orchestra.run.smithi008.stdout: "event": "waiting for peered", 2023-08-01T19:56:29.998 INFO:teuthology.orchestra.run.smithi008.stdout: "time": "2023-08-01T19:55:58.574299+0000", 2023-08-01T19:56:29.998 INFO:teuthology.orchestra.run.smithi008.stdout: "duration": 7.3420000000000002e-06 2023-08-01T19:56:29.998 INFO:teuthology.orchestra.run.smithi008.stdout: }, 2023-08-01T19:56:29.998 INFO:teuthology.orchestra.run.smithi008.stdout: { 2023-08-01T19:56:29.998 INFO:teuthology.orchestra.run.smithi008.stdout: "event": "reached_pg", 2023-08-01T19:56:29.998 INFO:teuthology.orchestra.run.smithi008.stdout: "time": "2023-08-01T19:55:59.618545+0000", 2023-08-01T19:56:29.998 INFO:teuthology.orchestra.run.smithi008.stdout: "duration": 1.044245922 2023-08-01T19:56:29.999 INFO:teuthology.orchestra.run.smithi008.stdout: }, 2023-08-01T19:56:29.999 INFO:teuthology.orchestra.run.smithi008.stdout: { 2023-08-01T19:56:29.999 INFO:teuthology.orchestra.run.smithi008.stdout: "event": "started", 2023-08-01T19:56:29.999 INFO:teuthology.orchestra.run.smithi008.stdout: "time": "2023-08-01T19:55:59.618855+0000", 2023-08-01T19:56:29.999 INFO:teuthology.orchestra.run.smithi008.stdout: "duration": 0.00030964099999999999 2023-08-01T19:56:29.999 INFO:teuthology.orchestra.run.smithi008.stdout: }, 2023-08-01T19:56:29.999 INFO:teuthology.orchestra.run.smithi008.stdout: { 2023-08-01T19:56:29.999 INFO:teuthology.orchestra.run.smithi008.stdout: "event": "op_commit", 2023-08-01T19:56:30.000 INFO:teuthology.orchestra.run.smithi008.stdout: "time": "2023-08-01T19:55:59.628438+0000", 2023-08-01T19:56:30.000 INFO:teuthology.orchestra.run.smithi008.stdout: "duration": 0.0095832939999999991 2023-08-01T19:56:30.000 INFO:teuthology.orchestra.run.smithi008.stdout: }, 2023-08-01T19:56:30.000 INFO:teuthology.orchestra.run.smithi008.stdout: { 2023-08-01T19:56:30.000 INFO:teuthology.orchestra.run.smithi008.stdout: "event": "commit_sent", 2023-08-01T19:56:30.000 INFO:teuthology.orchestra.run.smithi008.stdout: "time": "2023-08-01T19:55:59.628479+0000", 2023-08-01T19:56:30.000 INFO:teuthology.orchestra.run.smithi008.stdout: "duration": 4.1350000000000002e-05 2023-08-01T19:56:30.000 INFO:teuthology.orchestra.run.smithi008.stdout: }, 2023-08-01T19:56:30.001 INFO:teuthology.orchestra.run.smithi008.stdout: { 2023-08-01T19:56:30.001 INFO:teuthology.orchestra.run.smithi008.stdout: "event": "done", 2023-08-01T19:56:30.001 INFO:teuthology.orchestra.run.smithi008.stdout: "time": "2023-08-01T19:55:59.628560+0000", 2023-08-01T19:56:30.001 INFO:teuthology.orchestra.run.smithi008.stdout: "duration": 8.0080999999999994e-05 2023-08-01T19:56:30.001 INFO:teuthology.orchestra.run.smithi008.stdout: } 2023-08-01T19:56:30.001 INFO:teuthology.orchestra.run.smithi008.stdout: ] 2023-08-01T19:56:30.001 INFO:teuthology.orchestra.run.smithi008.stdout: } 2023-08-01T19:56:30.002 INFO:teuthology.orchestra.run.smithi008.stdout: }, 2023-08-01T19:56:30.002 INFO:teuthology.orchestra.run.smithi008.stdout: { 2023-08-01T19:56:30.002 INFO:teuthology.orchestra.run.smithi008.stdout: "description": "osd_op(client.4668.0:197415 5.c 5:3e539c01:::benchmark_data_smithi006_114134_object63754:head [delete] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e62)", 2023-08-01T19:56:30.002 INFO:teuthology.orchestra.run.smithi008.stdout: "initiated_at": "2023-08-01T19:55:58.577434+0000", 2023-08-01T19:56:30.002 INFO:teuthology.orchestra.run.smithi008.stdout: "age": 31.239649896, 2023-08-01T19:56:30.002 INFO:teuthology.orchestra.run.smithi008.stdout: "duration": 1.0520807059999999, 2023-08-01T19:56:30.002 INFO:teuthology.orchestra.run.smithi008.stdout: "type_data": { 2023-08-01T19:56:30.002 INFO:teuthology.orchestra.run.smithi008.stdout: "flag_point": "commit sent; apply or cleanup", 2023-08-01T19:56:30.003 INFO:teuthology.orchestra.run.smithi008.stdout: "client_info": { 2023-08-01T19:56:30.003 INFO:teuthology.orchestra.run.smithi008.stdout: "client": "client.4668", 2023-08-01T19:56:30.003 INFO:teuthology.orchestra.run.smithi008.stdout: "client_addr": "172.21.15.6:0/1709472247", 2023-08-01T19:56:30.003 INFO:teuthology.orchestra.run.smithi008.stdout: "tid": 197415 2023-08-01T19:56:30.003 INFO:teuthology.orchestra.run.smithi008.stdout: }, 2023-08-01T19:56:30.003 INFO:teuthology.orchestra.run.smithi008.stdout: "events": [ 2023-08-01T19:56:30.003 INFO:teuthology.orchestra.run.smithi008.stdout: { 2023-08-01T19:56:30.003 INFO:teuthology.orchestra.run.smithi008.stdout: "event": "initiated", 2023-08-01T19:56:30.004 INFO:teuthology.orchestra.run.smithi008.stdout: "time": "2023-08-01T19:55:58.577434+0000", 2023-08-01T19:56:30.004 INFO:teuthology.orchestra.run.smithi008.stdout: "duration": 0 2023-08-01T19:56:30.004 INFO:teuthology.orchestra.run.smithi008.stdout: }, 2023-08-01T19:56:30.004 INFO:teuthology.orchestra.run.smithi008.stdout: { 2023-08-01T19:56:30.004 INFO:teuthology.orchestra.run.smithi008.stdout: "event": "throttled", 2023-08-01T19:56:30.004 INFO:teuthology.orchestra.run.smithi008.stdout: "time": "2023-08-01T19:55:58.577434+0000", 2023-08-01T19:56:30.004 INFO:teuthology.orchestra.run.smithi008.stdout: "duration": 0 2023-08-01T19:56:30.005 INFO:teuthology.orchestra.run.smithi008.stdout: }, 2023-08-01T19:56:30.005 INFO:teuthology.orchestra.run.smithi008.stdout: { 2023-08-01T19:56:30.005 INFO:teuthology.orchestra.run.smithi008.stdout: "event": "header_read", 2023-08-01T19:56:30.005 INFO:teuthology.orchestra.run.smithi008.stdout: "time": "2023-08-01T19:55:58.577432+0000", 2023-08-01T19:56:30.005 INFO:teuthology.orchestra.run.smithi008.stdout: "duration": 4294967295.9999986 2023-08-01T19:56:30.005 INFO:teuthology.orchestra.run.smithi008.stdout: }, 2023-08-01T19:56:30.005 INFO:teuthology.orchestra.run.smithi008.stdout: { 2023-08-01T19:56:30.005 INFO:teuthology.orchestra.run.smithi008.stdout: "event": "all_read", 2023-08-01T19:56:30.006 INFO:teuthology.orchestra.run.smithi008.stdout: "time": "2023-08-01T19:55:58.577440+0000", 2023-08-01T19:56:30.006 INFO:teuthology.orchestra.run.smithi008.stdout: "duration": 7.5480000000000004e-06 2023-08-01T19:56:30.006 INFO:teuthology.orchestra.run.smithi008.stdout: }, 2023-08-01T19:56:30.006 INFO:teuthology.orchestra.run.smithi008.stdout: { 2023-08-01T19:56:30.006 INFO:teuthology.orchestra.run.smithi008.stdout: "event": "dispatched", 2023-08-01T19:56:30.006 INFO:teuthology.orchestra.run.smithi008.stdout: "time": "2023-08-01T19:55:58.577454+0000", 2023-08-01T19:56:30.006 INFO:teuthology.orchestra.run.smithi008.stdout: "duration": 1.4216000000000001e-05 2023-08-01T19:56:30.006 INFO:teuthology.orchestra.run.smithi008.stdout: }, 2023-08-01T19:56:30.007 INFO:teuthology.orchestra.run.smithi008.stdout: { 2023-08-01T19:56:30.007 INFO:teuthology.orchestra.run.smithi008.stdout: "event": "queued_for_pg", 2023-08-01T19:56:30.007 INFO:teuthology.orchestra.run.smithi008.stdout: "time": "2023-08-01T19:55:58.577463+0000", 2023-08-01T19:56:30.007 INFO:teuthology.orchestra.run.smithi008.stdout: "duration": 8.2900000000000002e-06 2023-08-01T19:56:30.007 INFO:teuthology.orchestra.run.smithi008.stdout: }, 2023-08-01T19:56:30.007 INFO:teuthology.orchestra.run.smithi008.stdout: { 2023-08-01T19:56:30.008 INFO:teuthology.orchestra.run.smithi008.stdout: "event": "reached_pg", 2023-08-01T19:56:30.008 INFO:teuthology.orchestra.run.smithi008.stdout: "time": "2023-08-01T19:55:58.577498+0000", 2023-08-01T19:56:30.008 INFO:teuthology.orchestra.run.smithi008.stdout: "duration": 3.5302000000000002e-05 2023-08-01T19:56:30.008 INFO:teuthology.orchestra.run.smithi008.stdout: }, 2023-08-01T19:56:30.008 INFO:teuthology.orchestra.run.smithi008.stdout: { 2023-08-01T19:56:30.008 INFO:teuthology.orchestra.run.smithi008.stdout: "event": "waiting for peered", 2023-08-01T19:56:30.008 INFO:teuthology.orchestra.run.smithi008.stdout: "time": "2023-08-01T19:55:58.577503+0000", 2023-08-01T19:56:30.009 INFO:teuthology.orchestra.run.smithi008.stdout: "duration": 4.8409999999999999e-06 2023-08-01T19:56:30.009 INFO:teuthology.orchestra.run.smithi008.stdout: }, 2023-08-01T19:56:30.009 INFO:teuthology.orchestra.run.smithi008.stdout: { 2023-08-01T19:56:30.009 INFO:teuthology.orchestra.run.smithi008.stdout: "event": "reached_pg", 2023-08-01T19:56:30.009 INFO:teuthology.orchestra.run.smithi008.stdout: "time": "2023-08-01T19:55:59.619229+0000", 2023-08-01T19:56:30.009 INFO:teuthology.orchestra.run.smithi008.stdout: "duration": 1.041726119 2023-08-01T19:56:30.009 INFO:teuthology.orchestra.run.smithi008.stdout: }, 2023-08-01T19:56:30.009 INFO:teuthology.orchestra.run.smithi008.stdout: { 2023-08-01T19:56:30.010 INFO:teuthology.orchestra.run.smithi008.stdout: "event": "started", 2023-08-01T19:56:30.010 INFO:teuthology.orchestra.run.smithi008.stdout: "time": "2023-08-01T19:55:59.619326+0000", 2023-08-01T19:56:30.010 INFO:teuthology.orchestra.run.smithi008.stdout: "duration": 9.7044000000000001e-05 2023-08-01T19:56:30.010 INFO:teuthology.orchestra.run.smithi008.stdout: }, 2023-08-01T19:56:30.010 INFO:teuthology.orchestra.run.smithi008.stdout: { 2023-08-01T19:56:30.010 INFO:teuthology.orchestra.run.smithi008.stdout: "event": "op_commit", 2023-08-01T19:56:30.010 INFO:teuthology.orchestra.run.smithi008.stdout: "time": "2023-08-01T19:55:59.629399+0000", 2023-08-01T19:56:30.011 INFO:teuthology.orchestra.run.smithi008.stdout: "duration": 0.010073014 2023-08-01T19:56:30.011 INFO:teuthology.orchestra.run.smithi008.stdout: }, 2023-08-01T19:56:30.011 INFO:teuthology.orchestra.run.smithi008.stdout: { 2023-08-01T19:56:30.011 INFO:teuthology.orchestra.run.smithi008.stdout: "event": "commit_sent", 2023-08-01T19:56:30.011 INFO:teuthology.orchestra.run.smithi008.stdout: "time": "2023-08-01T19:55:59.629443+0000", 2023-08-01T19:56:30.011 INFO:teuthology.orchestra.run.smithi008.stdout: "duration": 4.3739999999999998e-05 2023-08-01T19:56:30.011 INFO:teuthology.orchestra.run.smithi008.stdout: }, 2023-08-01T19:56:30.011 INFO:teuthology.orchestra.run.smithi008.stdout: { 2023-08-01T19:56:30.012 INFO:teuthology.orchestra.run.smithi008.stdout: "event": "done", 2023-08-01T19:56:30.012 INFO:teuthology.orchestra.run.smithi008.stdout: "time": "2023-08-01T19:55:59.629515+0000", 2023-08-01T19:56:30.012 INFO:teuthology.orchestra.run.smithi008.stdout: "duration": 7.2089999999999996e-05 2023-08-01T19:56:30.012 INFO:teuthology.orchestra.run.smithi008.stdout: } 2023-08-01T19:56:30.012 INFO:teuthology.orchestra.run.smithi008.stdout: ] 2023-08-01T19:56:30.012 INFO:teuthology.orchestra.run.smithi008.stdout: } 2023-08-01T19:56:30.012 INFO:teuthology.orchestra.run.smithi008.stdout: }, 2023-08-01T19:56:30.012 INFO:teuthology.orchestra.run.smithi008.stdout: { 2023-08-01T19:56:30.013 INFO:teuthology.orchestra.run.smithi008.stdout: "description": "osd_op(client.4668.0:197417 5.7 5:eb36cb7d:::benchmark_data_smithi006_114134_object63756:head [delete] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e62)", 2023-08-01T19:56:30.013 INFO:teuthology.orchestra.run.smithi008.stdout: "initiated_at": "2023-08-01T19:55:58.578162+0000", 2023-08-01T19:56:30.013 INFO:teuthology.orchestra.run.smithi008.stdout: "age": 31.238921599000001, 2023-08-01T19:56:30.013 INFO:teuthology.orchestra.run.smithi008.stdout: "duration": 1.0582469299999999, 2023-08-01T19:56:30.013 INFO:teuthology.orchestra.run.smithi008.stdout: "type_data": { 2023-08-01T19:56:30.013 INFO:teuthology.orchestra.run.smithi008.stdout: "flag_point": "commit sent; apply or cleanup", 2023-08-01T19:56:30.013 INFO:teuthology.orchestra.run.smithi008.stdout: "client_info": { 2023-08-01T19:56:30.014 INFO:teuthology.orchestra.run.smithi008.stdout: "client": "client.4668", 2023-08-01T19:56:30.014 INFO:teuthology.orchestra.run.smithi008.stdout: "client_addr": "172.21.15.6:0/1709472247", 2023-08-01T19:56:30.014 INFO:teuthology.orchestra.run.smithi008.stdout: "tid": 197417 2023-08-01T19:56:30.014 INFO:teuthology.orchestra.run.smithi008.stdout: }, 2023-08-01T19:56:30.014 INFO:teuthology.orchestra.run.smithi008.stdout: "events": [ 2023-08-01T19:56:30.014 INFO:teuthology.orchestra.run.smithi008.stdout: { 2023-08-01T19:56:30.014 INFO:teuthology.orchestra.run.smithi008.stdout: "event": "initiated", 2023-08-01T19:56:30.014 INFO:teuthology.orchestra.run.smithi008.stdout: "time": "2023-08-01T19:55:58.578162+0000", 2023-08-01T19:56:30.015 INFO:teuthology.orchestra.run.smithi008.stdout: "duration": 0 2023-08-01T19:56:30.015 INFO:teuthology.orchestra.run.smithi008.stdout: }, 2023-08-01T19:56:30.015 INFO:teuthology.orchestra.run.smithi008.stdout: { 2023-08-01T19:56:30.015 INFO:teuthology.orchestra.run.smithi008.stdout: "event": "throttled", 2023-08-01T19:56:30.015 INFO:teuthology.orchestra.run.smithi008.stdout: "time": "2023-08-01T19:55:58.578162+0000", 2023-08-01T19:56:30.015 INFO:teuthology.orchestra.run.smithi008.stdout: "duration": 0 2023-08-01T19:56:30.015 INFO:teuthology.orchestra.run.smithi008.stdout: }, 2023-08-01T19:56:30.016 INFO:teuthology.orchestra.run.smithi008.stdout: { 2023-08-01T19:56:30.016 INFO:teuthology.orchestra.run.smithi008.stdout: "event": "header_read", 2023-08-01T19:56:30.016 INFO:teuthology.orchestra.run.smithi008.stdout: "time": "2023-08-01T19:55:58.578161+0000", 2023-08-01T19:56:30.016 INFO:teuthology.orchestra.run.smithi008.stdout: "duration": 4294967295.999999 2023-08-01T19:56:30.016 INFO:teuthology.orchestra.run.smithi008.stdout: }, 2023-08-01T19:56:30.016 INFO:teuthology.orchestra.run.smithi008.stdout: { 2023-08-01T19:56:30.016 INFO:teuthology.orchestra.run.smithi008.stdout: "event": "all_read", 2023-08-01T19:56:30.017 INFO:teuthology.orchestra.run.smithi008.stdout: "time": "2023-08-01T19:55:58.578166+0000", 2023-08-01T19:56:30.017 INFO:teuthology.orchestra.run.smithi008.stdout: "duration": 4.6589999999999998e-06 2023-08-01T19:56:30.017 INFO:teuthology.orchestra.run.smithi008.stdout: }, 2023-08-01T19:56:30.017 INFO:teuthology.orchestra.run.smithi008.stdout: { 2023-08-01T19:56:30.017 INFO:teuthology.orchestra.run.smithi008.stdout: "event": "dispatched", 2023-08-01T19:56:30.017 INFO:teuthology.orchestra.run.smithi008.stdout: "time": "2023-08-01T19:55:58.578177+0000", 2023-08-01T19:56:30.017 INFO:teuthology.orchestra.run.smithi008.stdout: "duration": 1.0512e-05 2023-08-01T19:56:30.017 INFO:teuthology.orchestra.run.smithi008.stdout: }, 2023-08-01T19:56:30.018 INFO:teuthology.orchestra.run.smithi008.stdout: { 2023-08-01T19:56:30.018 INFO:teuthology.orchestra.run.smithi008.stdout: "event": "queued_for_pg", 2023-08-01T19:56:30.018 INFO:teuthology.orchestra.run.smithi008.stdout: "time": "2023-08-01T19:55:58.578182+0000", 2023-08-01T19:56:30.018 INFO:teuthology.orchestra.run.smithi008.stdout: "duration": 5.6540000000000004e-06 2023-08-01T19:56:30.018 INFO:teuthology.orchestra.run.smithi008.stdout: }, 2023-08-01T19:56:30.018 INFO:teuthology.orchestra.run.smithi008.stdout: { 2023-08-01T19:56:30.018 INFO:teuthology.orchestra.run.smithi008.stdout: "event": "reached_pg", 2023-08-01T19:56:30.018 INFO:teuthology.orchestra.run.smithi008.stdout: "time": "2023-08-01T19:55:58.578221+0000", 2023-08-01T19:56:30.019 INFO:teuthology.orchestra.run.smithi008.stdout: "duration": 3.8764999999999999e-05 2023-08-01T19:56:30.019 INFO:teuthology.orchestra.run.smithi008.stdout: }, 2023-08-01T19:56:30.019 INFO:teuthology.orchestra.run.smithi008.stdout: { 2023-08-01T19:56:30.019 INFO:teuthology.orchestra.run.smithi008.stdout: "event": "waiting for peered", 2023-08-01T19:56:30.019 INFO:teuthology.orchestra.run.smithi008.stdout: "time": "2023-08-01T19:55:58.578226+0000", 2023-08-01T19:56:30.019 INFO:teuthology.orchestra.run.smithi008.stdout: "duration": 4.6319999999999999e-06 2023-08-01T19:56:30.019 INFO:teuthology.orchestra.run.smithi008.stdout: }, 2023-08-01T19:56:30.020 INFO:teuthology.orchestra.run.smithi008.stdout: { 2023-08-01T19:56:30.020 INFO:teuthology.orchestra.run.smithi008.stdout: "event": "reached_pg", 2023-08-01T19:56:30.020 INFO:teuthology.orchestra.run.smithi008.stdout: "time": "2023-08-01T19:55:59.628027+0000", 2023-08-01T19:56:30.020 INFO:teuthology.orchestra.run.smithi008.stdout: "duration": 1.049801261 2023-08-01T19:56:30.020 INFO:teuthology.orchestra.run.smithi008.stdout: }, 2023-08-01T19:56:30.020 INFO:teuthology.orchestra.run.smithi008.stdout: { 2023-08-01T19:56:30.020 INFO:teuthology.orchestra.run.smithi008.stdout: "event": "started", 2023-08-01T19:56:30.020 INFO:teuthology.orchestra.run.smithi008.stdout: "time": "2023-08-01T19:55:59.628156+0000", 2023-08-01T19:56:30.021 INFO:teuthology.orchestra.run.smithi008.stdout: "duration": 0.00012906899999999999 2023-08-01T19:56:30.021 INFO:teuthology.orchestra.run.smithi008.stdout: }, 2023-08-01T19:56:30.021 INFO:teuthology.orchestra.run.smithi008.stdout: { 2023-08-01T19:56:30.021 INFO:teuthology.orchestra.run.smithi008.stdout: "event": "op_commit", 2023-08-01T19:56:30.021 INFO:teuthology.orchestra.run.smithi008.stdout: "time": "2023-08-01T19:55:59.636292+0000", 2023-08-01T19:56:30.021 INFO:teuthology.orchestra.run.smithi008.stdout: "duration": 0.0081362859999999995 2023-08-01T19:56:30.021 INFO:teuthology.orchestra.run.smithi008.stdout: }, 2023-08-01T19:56:30.022 INFO:teuthology.orchestra.run.smithi008.stdout: { 2023-08-01T19:56:30.022 INFO:teuthology.orchestra.run.smithi008.stdout: "event": "commit_sent", 2023-08-01T19:56:30.022 INFO:teuthology.orchestra.run.smithi008.stdout: "time": "2023-08-01T19:55:59.636343+0000", 2023-08-01T19:56:30.022 INFO:teuthology.orchestra.run.smithi008.stdout: "duration": 5.0603000000000003e-05 2023-08-01T19:56:30.022 INFO:teuthology.orchestra.run.smithi008.stdout: }, 2023-08-01T19:56:30.022 INFO:teuthology.orchestra.run.smithi008.stdout: { 2023-08-01T19:56:30.022 INFO:teuthology.orchestra.run.smithi008.stdout: "event": "done", 2023-08-01T19:56:30.022 INFO:teuthology.orchestra.run.smithi008.stdout: "time": "2023-08-01T19:55:59.636409+0000", 2023-08-01T19:56:30.023 INFO:teuthology.orchestra.run.smithi008.stdout: "duration": 6.6353999999999995e-05 2023-08-01T19:56:30.023 INFO:teuthology.orchestra.run.smithi008.stdout: } 2023-08-01T19:56:30.023 INFO:teuthology.orchestra.run.smithi008.stdout: ] 2023-08-01T19:56:30.023 INFO:teuthology.orchestra.run.smithi008.stdout: } 2023-08-01T19:56:30.023 INFO:teuthology.orchestra.run.smithi008.stdout: }, 2023-08-01T19:56:30.023 INFO:teuthology.orchestra.run.smithi008.stdout: { 2023-08-01T19:56:30.023 INFO:teuthology.orchestra.run.smithi008.stdout: "description": "osd_op(client.4668.0:197418 5.2 5:4ba84ab7:::benchmark_data_smithi006_114134_object63757:head [delete] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e62)", 2023-08-01T19:56:30.023 INFO:teuthology.orchestra.run.smithi008.stdout: "initiated_at": "2023-08-01T19:55:58.580297+0000", 2023-08-01T19:56:30.024 INFO:teuthology.orchestra.run.smithi008.stdout: "age": 31.236787245999999, 2023-08-01T19:56:30.024 INFO:teuthology.orchestra.run.smithi008.stdout: "duration": 1.0529485839999999, 2023-08-01T19:56:30.024 INFO:teuthology.orchestra.run.smithi008.stdout: "type_data": { 2023-08-01T19:56:30.024 INFO:teuthology.orchestra.run.smithi008.stdout: "flag_point": "commit sent; apply or cleanup", 2023-08-01T19:56:30.024 INFO:teuthology.orchestra.run.smithi008.stdout: "client_info": { 2023-08-01T19:56:30.024 INFO:teuthology.orchestra.run.smithi008.stdout: "client": "client.4668", 2023-08-01T19:56:30.024 INFO:teuthology.orchestra.run.smithi008.stdout: "client_addr": "172.21.15.6:0/1709472247", 2023-08-01T19:56:30.025 INFO:teuthology.orchestra.run.smithi008.stdout: "tid": 197418 2023-08-01T19:56:30.025 INFO:teuthology.orchestra.run.smithi008.stdout: }, 2023-08-01T19:56:30.025 INFO:teuthology.orchestra.run.smithi008.stdout: "events": [ 2023-08-01T19:56:30.025 INFO:teuthology.orchestra.run.smithi008.stdout: { 2023-08-01T19:56:30.025 INFO:teuthology.orchestra.run.smithi008.stdout: "event": "initiated", 2023-08-01T19:56:30.025 INFO:teuthology.orchestra.run.smithi008.stdout: "time": "2023-08-01T19:55:58.580297+0000", 2023-08-01T19:56:30.025 INFO:teuthology.orchestra.run.smithi008.stdout: "duration": 0 2023-08-01T19:56:30.025 INFO:teuthology.orchestra.run.smithi008.stdout: }, 2023-08-01T19:56:30.026 INFO:teuthology.orchestra.run.smithi008.stdout: { 2023-08-01T19:56:30.026 INFO:teuthology.orchestra.run.smithi008.stdout: "event": "throttled", 2023-08-01T19:56:30.026 INFO:teuthology.orchestra.run.smithi008.stdout: "time": "2023-08-01T19:55:58.580297+0000", 2023-08-01T19:56:30.026 INFO:teuthology.orchestra.run.smithi008.stdout: "duration": 0 2023-08-01T19:56:30.026 INFO:teuthology.orchestra.run.smithi008.stdout: }, 2023-08-01T19:56:30.026 INFO:teuthology.orchestra.run.smithi008.stdout: { 2023-08-01T19:56:30.026 INFO:teuthology.orchestra.run.smithi008.stdout: "event": "header_read", 2023-08-01T19:56:30.026 INFO:teuthology.orchestra.run.smithi008.stdout: "time": "2023-08-01T19:55:58.580296+0000", 2023-08-01T19:56:30.027 INFO:teuthology.orchestra.run.smithi008.stdout: "duration": 4294967295.999999 2023-08-01T19:56:30.027 INFO:teuthology.orchestra.run.smithi008.stdout: }, 2023-08-01T19:56:30.027 INFO:teuthology.orchestra.run.smithi008.stdout: { 2023-08-01T19:56:30.027 INFO:teuthology.orchestra.run.smithi008.stdout: "event": "all_read", 2023-08-01T19:56:30.027 INFO:teuthology.orchestra.run.smithi008.stdout: "time": "2023-08-01T19:55:58.580302+0000", 2023-08-01T19:56:30.027 INFO:teuthology.orchestra.run.smithi008.stdout: "duration": 6.032e-06 2023-08-01T19:56:30.027 INFO:teuthology.orchestra.run.smithi008.stdout: }, 2023-08-01T19:56:30.027 INFO:teuthology.orchestra.run.smithi008.stdout: { 2023-08-01T19:56:30.028 INFO:teuthology.orchestra.run.smithi008.stdout: "event": "dispatched", 2023-08-01T19:56:30.028 INFO:teuthology.orchestra.run.smithi008.stdout: "time": "2023-08-01T19:55:58.580315+0000", 2023-08-01T19:56:30.028 INFO:teuthology.orchestra.run.smithi008.stdout: "duration": 1.327e-05 2023-08-01T19:56:30.028 INFO:teuthology.orchestra.run.smithi008.stdout: }, 2023-08-01T19:56:30.028 INFO:teuthology.orchestra.run.smithi008.stdout: { 2023-08-01T19:56:30.028 INFO:teuthology.orchestra.run.smithi008.stdout: "event": "queued_for_pg", 2023-08-01T19:56:30.028 INFO:teuthology.orchestra.run.smithi008.stdout: "time": "2023-08-01T19:55:58.580321+0000", 2023-08-01T19:56:30.029 INFO:teuthology.orchestra.run.smithi008.stdout: "duration": 6.3980000000000004e-06 2023-08-01T19:56:30.029 INFO:teuthology.orchestra.run.smithi008.stdout: }, 2023-08-01T19:56:30.029 INFO:teuthology.orchestra.run.smithi008.stdout: { 2023-08-01T19:56:30.029 INFO:teuthology.orchestra.run.smithi008.stdout: "event": "reached_pg", 2023-08-01T19:56:30.029 INFO:teuthology.orchestra.run.smithi008.stdout: "time": "2023-08-01T19:55:58.580372+0000", 2023-08-01T19:56:30.029 INFO:teuthology.orchestra.run.smithi008.stdout: "duration": 5.0219000000000001e-05 2023-08-01T19:56:30.029 INFO:teuthology.orchestra.run.smithi008.stdout: }, 2023-08-01T19:56:30.029 INFO:teuthology.orchestra.run.smithi008.stdout: { 2023-08-01T19:56:30.030 INFO:teuthology.orchestra.run.smithi008.stdout: "event": "waiting for peered", 2023-08-01T19:56:30.030 INFO:teuthology.orchestra.run.smithi008.stdout: "time": "2023-08-01T19:55:58.580378+0000", 2023-08-01T19:56:30.030 INFO:teuthology.orchestra.run.smithi008.stdout: "duration": 6.6529999999999997e-06 2023-08-01T19:56:30.030 INFO:teuthology.orchestra.run.smithi008.stdout: }, 2023-08-01T19:56:30.030 INFO:teuthology.orchestra.run.smithi008.stdout: { 2023-08-01T19:56:30.030 INFO:teuthology.orchestra.run.smithi008.stdout: "event": "reached_pg", 2023-08-01T19:56:30.030 INFO:teuthology.orchestra.run.smithi008.stdout: "time": "2023-08-01T19:55:59.618188+0000", 2023-08-01T19:56:30.031 INFO:teuthology.orchestra.run.smithi008.stdout: "duration": 1.037810267 2023-08-01T19:56:30.031 INFO:teuthology.orchestra.run.smithi008.stdout: }, 2023-08-01T19:56:30.031 INFO:teuthology.orchestra.run.smithi008.stdout: { 2023-08-01T19:56:30.031 INFO:teuthology.orchestra.run.smithi008.stdout: "event": "started", 2023-08-01T19:56:30.031 INFO:teuthology.orchestra.run.smithi008.stdout: "time": "2023-08-01T19:55:59.618308+0000", 2023-08-01T19:56:30.031 INFO:teuthology.orchestra.run.smithi008.stdout: "duration": 0.00011959 2023-08-01T19:56:30.031 INFO:teuthology.orchestra.run.smithi008.stdout: }, 2023-08-01T19:56:30.032 INFO:teuthology.orchestra.run.smithi008.stdout: { 2023-08-01T19:56:30.032 INFO:teuthology.orchestra.run.smithi008.stdout: "event": "op_commit", 2023-08-01T19:56:30.032 INFO:teuthology.orchestra.run.smithi008.stdout: "time": "2023-08-01T19:55:59.633122+0000", 2023-08-01T19:56:30.032 INFO:teuthology.orchestra.run.smithi008.stdout: "duration": 0.014814280000000001 2023-08-01T19:56:30.032 INFO:teuthology.orchestra.run.smithi008.stdout: }, 2023-08-01T19:56:30.032 INFO:teuthology.orchestra.run.smithi008.stdout: { 2023-08-01T19:56:30.032 INFO:teuthology.orchestra.run.smithi008.stdout: "event": "commit_sent", 2023-08-01T19:56:30.032 INFO:teuthology.orchestra.run.smithi008.stdout: "time": "2023-08-01T19:55:59.633167+0000", 2023-08-01T19:56:30.033 INFO:teuthology.orchestra.run.smithi008.stdout: "duration": 4.4651999999999999e-05 2023-08-01T19:56:30.033 INFO:teuthology.orchestra.run.smithi008.stdout: }, 2023-08-01T19:56:30.033 INFO:teuthology.orchestra.run.smithi008.stdout: { 2023-08-01T19:56:30.033 INFO:teuthology.orchestra.run.smithi008.stdout: "event": "done", 2023-08-01T19:56:30.033 INFO:teuthology.orchestra.run.smithi008.stdout: "time": "2023-08-01T19:55:59.633245+0000", 2023-08-01T19:56:30.033 INFO:teuthology.orchestra.run.smithi008.stdout: "duration": 7.8215999999999998e-05 2023-08-01T19:56:30.033 INFO:teuthology.orchestra.run.smithi008.stdout: } 2023-08-01T19:56:30.033 INFO:teuthology.orchestra.run.smithi008.stdout: ] 2023-08-01T19:56:30.034 INFO:teuthology.orchestra.run.smithi008.stdout: } 2023-08-01T19:56:30.034 INFO:teuthology.orchestra.run.smithi008.stdout: } 2023-08-01T19:56:30.034 INFO:teuthology.orchestra.run.smithi008.stdout: ] 2023-08-01T19:56:30.034 INFO:teuthology.orchestra.run.smithi008.stdout:} 2023-08-01T19:56:30.035 DEBUG:teuthology.orchestra.run.smithi155:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 30 ceph --cluster ceph --admin-daemon /var/run/ceph/ceph-osd.2.asok dump_ops_in_flight 2023-08-01T19:56:30.036 INFO:tasks.ceph.osd.2.smithi155.stderr:2023-08-01T19:56:30.033+0000 7faa5c6ac700 -1 received signal: Hangup from /usr/bin/python3 /bin/daemon-helper kill ceph-osd -f --cluster ceph -i 2 (PID: 111337) UID: 0 2023-08-01T19:56:30.083 INFO:teuthology.orchestra.run.smithi006.stderr:nodeep-scrub is unset 2023-08-01T19:56:30.136 INFO:tasks.ceph.osd.0.smithi008.stderr:2023-08-01T19:56:30.136+0000 7f16a58f4700 -1 received signal: Hangup from /usr/bin/python3 /bin/daemon-helper kill ceph-osd -f --cluster ceph -i 0 (PID: 111179) UID: 0 2023-08-01T19:56:30.195 INFO:teuthology.orchestra.run.smithi155.stdout:{ 2023-08-01T19:56:30.248 INFO:teuthology.orchestra.run.smithi155.stdout: "ops": [ 2023-08-01T19:56:30.248 INFO:teuthology.orchestra.run.smithi155.stdout: { 2023-08-01T19:56:30.249 INFO:teuthology.orchestra.run.smithi155.stdout: "description": "osd_op(client.4668.0:258332 5.9 5:91167f3e:::benchmark_data_smithi006_114134_object124671:head [delete] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e76)", 2023-08-01T19:56:30.249 INFO:teuthology.orchestra.run.smithi155.stdout: "initiated_at": "2023-08-01T19:56:30.190099+0000", 2023-08-01T19:56:30.249 INFO:teuthology.orchestra.run.smithi155.stdout: "age": 0.004169191, 2023-08-01T19:56:30.249 INFO:teuthology.orchestra.run.smithi155.stdout: "duration": 0.0041882239999999999, 2023-08-01T19:56:30.249 INFO:teuthology.orchestra.run.smithi155.stdout: "type_data": { 2023-08-01T19:56:30.249 INFO:teuthology.orchestra.run.smithi155.stdout: "flag_point": "started", 2023-08-01T19:56:30.250 INFO:teuthology.orchestra.run.smithi155.stdout: "client_info": { 2023-08-01T19:56:30.250 INFO:teuthology.orchestra.run.smithi155.stdout: "client": "client.4668", 2023-08-01T19:56:30.250 INFO:teuthology.orchestra.run.smithi155.stdout: "client_addr": "172.21.15.6:0/1709472247", 2023-08-01T19:56:30.250 INFO:teuthology.orchestra.run.smithi155.stdout: "tid": 258332 2023-08-01T19:56:30.250 INFO:teuthology.orchestra.run.smithi155.stdout: }, 2023-08-01T19:56:30.250 INFO:teuthology.orchestra.run.smithi155.stdout: "events": [ 2023-08-01T19:56:30.250 INFO:teuthology.orchestra.run.smithi155.stdout: { 2023-08-01T19:56:30.250 INFO:teuthology.orchestra.run.smithi155.stdout: "event": "initiated", 2023-08-01T19:56:30.251 INFO:teuthology.orchestra.run.smithi155.stdout: "time": "2023-08-01T19:56:30.190099+0000", 2023-08-01T19:56:30.251 INFO:teuthology.orchestra.run.smithi155.stdout: "duration": 0 2023-08-01T19:56:30.251 INFO:teuthology.orchestra.run.smithi155.stdout: }, 2023-08-01T19:56:30.251 INFO:teuthology.orchestra.run.smithi155.stdout: { 2023-08-01T19:56:30.251 INFO:teuthology.orchestra.run.smithi155.stdout: "event": "throttled", 2023-08-01T19:56:30.251 INFO:teuthology.orchestra.run.smithi155.stdout: "time": "2023-08-01T19:56:30.190099+0000", 2023-08-01T19:56:30.251 INFO:teuthology.orchestra.run.smithi155.stdout: "duration": 0 2023-08-01T19:56:30.252 INFO:teuthology.orchestra.run.smithi155.stdout: }, 2023-08-01T19:56:30.252 INFO:teuthology.orchestra.run.smithi155.stdout: { 2023-08-01T19:56:30.252 INFO:teuthology.orchestra.run.smithi155.stdout: "event": "header_read", 2023-08-01T19:56:30.252 INFO:teuthology.orchestra.run.smithi155.stdout: "time": "2023-08-01T19:56:30.190098+0000", 2023-08-01T19:56:30.252 INFO:teuthology.orchestra.run.smithi155.stdout: "duration": 4294967295.9999995 2023-08-01T19:56:30.252 INFO:teuthology.orchestra.run.smithi155.stdout: }, 2023-08-01T19:56:30.252 INFO:teuthology.orchestra.run.smithi155.stdout: { 2023-08-01T19:56:30.252 INFO:teuthology.orchestra.run.smithi155.stdout: "event": "all_read", 2023-08-01T19:56:30.253 INFO:teuthology.orchestra.run.smithi155.stdout: "time": "2023-08-01T19:56:30.190102+0000", 2023-08-01T19:56:30.253 INFO:teuthology.orchestra.run.smithi155.stdout: "duration": 3.4939999999999999e-06 2023-08-01T19:56:30.253 INFO:teuthology.orchestra.run.smithi155.stdout: }, 2023-08-01T19:56:30.253 INFO:teuthology.orchestra.run.smithi155.stdout: { 2023-08-01T19:56:30.253 INFO:teuthology.orchestra.run.smithi155.stdout: "event": "dispatched", 2023-08-01T19:56:30.253 INFO:teuthology.orchestra.run.smithi155.stdout: "time": "2023-08-01T19:56:30.190109+0000", 2023-08-01T19:56:30.253 INFO:teuthology.orchestra.run.smithi155.stdout: "duration": 7.0759999999999997e-06 2023-08-01T19:56:30.254 INFO:teuthology.orchestra.run.smithi155.stdout: }, 2023-08-01T19:56:30.254 INFO:teuthology.orchestra.run.smithi155.stdout: { 2023-08-01T19:56:30.254 INFO:teuthology.orchestra.run.smithi155.stdout: "event": "queued_for_pg", 2023-08-01T19:56:30.254 INFO:teuthology.orchestra.run.smithi155.stdout: "time": "2023-08-01T19:56:30.190114+0000", 2023-08-01T19:56:30.254 INFO:teuthology.orchestra.run.smithi155.stdout: "duration": 4.5929999999999999e-06 2023-08-01T19:56:30.254 INFO:teuthology.orchestra.run.smithi155.stdout: }, 2023-08-01T19:56:30.254 INFO:teuthology.orchestra.run.smithi155.stdout: { 2023-08-01T19:56:30.254 INFO:teuthology.orchestra.run.smithi155.stdout: "event": "reached_pg", 2023-08-01T19:56:30.255 INFO:teuthology.orchestra.run.smithi155.stdout: "time": "2023-08-01T19:56:30.190153+0000", 2023-08-01T19:56:30.255 INFO:teuthology.orchestra.run.smithi155.stdout: "duration": 3.9651999999999999e-05 2023-08-01T19:56:30.255 INFO:teuthology.orchestra.run.smithi155.stdout: }, 2023-08-01T19:56:30.255 INFO:teuthology.orchestra.run.smithi155.stdout: { 2023-08-01T19:56:30.255 INFO:teuthology.orchestra.run.smithi155.stdout: "event": "started", 2023-08-01T19:56:30.255 INFO:teuthology.orchestra.run.smithi155.stdout: "time": "2023-08-01T19:56:30.190283+0000", 2023-08-01T19:56:30.255 INFO:teuthology.orchestra.run.smithi155.stdout: "duration": 0.000129515 2023-08-01T19:56:30.255 INFO:teuthology.orchestra.run.smithi155.stdout: } 2023-08-01T19:56:30.256 INFO:teuthology.orchestra.run.smithi155.stdout: ] 2023-08-01T19:56:30.256 INFO:teuthology.orchestra.run.smithi155.stdout: } 2023-08-01T19:56:30.256 INFO:teuthology.orchestra.run.smithi155.stdout: }, 2023-08-01T19:56:30.256 INFO:teuthology.orchestra.run.smithi155.stdout: { 2023-08-01T19:56:30.256 INFO:teuthology.orchestra.run.smithi155.stdout: "description": "osd_repop(client.4668.0:258331 5.a e76/19 5:5d6b1494:::benchmark_data_smithi006_114134_object124670:head v 76'16016, mlcod=76'16014)", 2023-08-01T19:56:30.256 INFO:teuthology.orchestra.run.smithi155.stdout: "initiated_at": "2023-08-01T19:56:30.192232+0000", 2023-08-01T19:56:30.256 INFO:teuthology.orchestra.run.smithi155.stdout: "age": 0.0020364990000000002, 2023-08-01T19:56:30.256 INFO:teuthology.orchestra.run.smithi155.stdout: "duration": 0.0021041100000000002, 2023-08-01T19:56:30.257 INFO:teuthology.orchestra.run.smithi155.stdout: "type_data": { 2023-08-01T19:56:30.257 INFO:teuthology.orchestra.run.smithi155.stdout: "flag_point": "started", 2023-08-01T19:56:30.257 INFO:teuthology.orchestra.run.smithi155.stdout: "events": [ 2023-08-01T19:56:30.257 INFO:teuthology.orchestra.run.smithi155.stdout: { 2023-08-01T19:56:30.257 INFO:teuthology.orchestra.run.smithi155.stdout: "event": "initiated", 2023-08-01T19:56:30.257 INFO:teuthology.orchestra.run.smithi155.stdout: "time": "2023-08-01T19:56:30.192232+0000", 2023-08-01T19:56:30.257 INFO:teuthology.orchestra.run.smithi155.stdout: "duration": 0 2023-08-01T19:56:30.258 INFO:teuthology.orchestra.run.smithi155.stdout: }, 2023-08-01T19:56:30.258 INFO:teuthology.orchestra.run.smithi155.stdout: { 2023-08-01T19:56:30.258 INFO:teuthology.orchestra.run.smithi155.stdout: "event": "throttled", 2023-08-01T19:56:30.258 INFO:teuthology.orchestra.run.smithi155.stdout: "time": "2023-08-01T19:56:30.192232+0000", 2023-08-01T19:56:30.258 INFO:teuthology.orchestra.run.smithi155.stdout: "duration": 0 2023-08-01T19:56:30.258 INFO:teuthology.orchestra.run.smithi155.stdout: }, 2023-08-01T19:56:30.258 INFO:teuthology.orchestra.run.smithi155.stdout: { 2023-08-01T19:56:30.258 INFO:teuthology.orchestra.run.smithi155.stdout: "event": "header_read", 2023-08-01T19:56:30.259 INFO:teuthology.orchestra.run.smithi155.stdout: "time": "2023-08-01T19:56:30.192231+0000", 2023-08-01T19:56:30.259 INFO:teuthology.orchestra.run.smithi155.stdout: "duration": 4294967295.9999995 2023-08-01T19:56:30.259 INFO:teuthology.orchestra.run.smithi155.stdout: }, 2023-08-01T19:56:30.259 INFO:teuthology.orchestra.run.smithi155.stdout: { 2023-08-01T19:56:30.259 INFO:teuthology.orchestra.run.smithi155.stdout: "event": "all_read", 2023-08-01T19:56:30.259 INFO:teuthology.orchestra.run.smithi155.stdout: "time": "2023-08-01T19:56:30.192238+0000", 2023-08-01T19:56:30.259 INFO:teuthology.orchestra.run.smithi155.stdout: "duration": 6.3810000000000004e-06 2023-08-01T19:56:30.259 INFO:teuthology.orchestra.run.smithi155.stdout: }, 2023-08-01T19:56:30.260 INFO:teuthology.orchestra.run.smithi155.stdout: { 2023-08-01T19:56:30.260 INFO:teuthology.orchestra.run.smithi155.stdout: "event": "dispatched", 2023-08-01T19:56:30.260 INFO:teuthology.orchestra.run.smithi155.stdout: "time": "2023-08-01T19:56:30.192246+0000", 2023-08-01T19:56:30.260 INFO:teuthology.orchestra.run.smithi155.stdout: "duration": 8.1550000000000007e-06 2023-08-01T19:56:30.260 INFO:teuthology.orchestra.run.smithi155.stdout: }, 2023-08-01T19:56:30.260 INFO:teuthology.orchestra.run.smithi155.stdout: { 2023-08-01T19:56:30.261 INFO:teuthology.orchestra.run.smithi155.stdout: "event": "queued_for_pg", 2023-08-01T19:56:30.261 INFO:teuthology.orchestra.run.smithi155.stdout: "time": "2023-08-01T19:56:30.192250+0000", 2023-08-01T19:56:30.261 INFO:teuthology.orchestra.run.smithi155.stdout: "duration": 3.9870000000000001e-06 2023-08-01T19:56:30.261 INFO:teuthology.orchestra.run.smithi155.stdout: }, 2023-08-01T19:56:30.261 INFO:teuthology.orchestra.run.smithi155.stdout: { 2023-08-01T19:56:30.261 INFO:teuthology.orchestra.run.smithi155.stdout: "event": "reached_pg", 2023-08-01T19:56:30.261 INFO:teuthology.orchestra.run.smithi155.stdout: "time": "2023-08-01T19:56:30.192285+0000", 2023-08-01T19:56:30.261 INFO:teuthology.orchestra.run.smithi155.stdout: "duration": 3.4999999999999997e-05 2023-08-01T19:56:30.262 INFO:teuthology.orchestra.run.smithi155.stdout: }, 2023-08-01T19:56:30.262 INFO:teuthology.orchestra.run.smithi155.stdout: { 2023-08-01T19:56:30.262 INFO:teuthology.orchestra.run.smithi155.stdout: "event": "started", 2023-08-01T19:56:30.262 INFO:teuthology.orchestra.run.smithi155.stdout: "time": "2023-08-01T19:56:30.192301+0000", 2023-08-01T19:56:30.262 INFO:teuthology.orchestra.run.smithi155.stdout: "duration": 1.6594000000000001e-05 2023-08-01T19:56:30.262 INFO:teuthology.orchestra.run.smithi155.stdout: } 2023-08-01T19:56:30.262 INFO:teuthology.orchestra.run.smithi155.stdout: ] 2023-08-01T19:56:30.262 INFO:teuthology.orchestra.run.smithi155.stdout: } 2023-08-01T19:56:30.263 INFO:teuthology.orchestra.run.smithi155.stdout: }, 2023-08-01T19:56:30.263 INFO:teuthology.orchestra.run.smithi155.stdout: { 2023-08-01T19:56:30.263 INFO:teuthology.orchestra.run.smithi155.stdout: "description": "osd_repop(client.4668.0:258333 5.a e76/19 5:5babfa2d:::benchmark_data_smithi006_114134_object124672:head v 76'16017, mlcod=76'16014)", 2023-08-01T19:56:30.263 INFO:teuthology.orchestra.run.smithi155.stdout: "initiated_at": "2023-08-01T19:56:30.193268+0000", 2023-08-01T19:56:30.263 INFO:teuthology.orchestra.run.smithi155.stdout: "age": 0.0010001109999999999, 2023-08-01T19:56:30.263 INFO:teuthology.orchestra.run.smithi155.stdout: "duration": 0.00110472, 2023-08-01T19:56:30.263 INFO:teuthology.orchestra.run.smithi155.stdout: "type_data": { 2023-08-01T19:56:30.264 INFO:teuthology.orchestra.run.smithi155.stdout: "flag_point": "started", 2023-08-01T19:56:30.264 INFO:teuthology.orchestra.run.smithi155.stdout: "events": [ 2023-08-01T19:56:30.264 INFO:teuthology.orchestra.run.smithi155.stdout: { 2023-08-01T19:56:30.264 INFO:teuthology.orchestra.run.smithi155.stdout: "event": "initiated", 2023-08-01T19:56:30.264 INFO:teuthology.orchestra.run.smithi155.stdout: "time": "2023-08-01T19:56:30.193268+0000", 2023-08-01T19:56:30.264 INFO:teuthology.orchestra.run.smithi155.stdout: "duration": 0 2023-08-01T19:56:30.264 INFO:teuthology.orchestra.run.smithi155.stdout: }, 2023-08-01T19:56:30.264 INFO:teuthology.orchestra.run.smithi155.stdout: { 2023-08-01T19:56:30.265 INFO:teuthology.orchestra.run.smithi155.stdout: "event": "throttled", 2023-08-01T19:56:30.265 INFO:teuthology.orchestra.run.smithi155.stdout: "time": "2023-08-01T19:56:30.193268+0000", 2023-08-01T19:56:30.265 INFO:teuthology.orchestra.run.smithi155.stdout: "duration": 0 2023-08-01T19:56:30.265 INFO:teuthology.orchestra.run.smithi155.stdout: }, 2023-08-01T19:56:30.265 INFO:teuthology.orchestra.run.smithi155.stdout: { 2023-08-01T19:56:30.265 INFO:teuthology.orchestra.run.smithi155.stdout: "event": "header_read", 2023-08-01T19:56:30.265 INFO:teuthology.orchestra.run.smithi155.stdout: "time": "2023-08-01T19:56:30.193268+0000", 2023-08-01T19:56:30.265 INFO:teuthology.orchestra.run.smithi155.stdout: "duration": 4294967295.9999995 2023-08-01T19:56:30.266 INFO:teuthology.orchestra.run.smithi155.stdout: }, 2023-08-01T19:56:30.266 INFO:teuthology.orchestra.run.smithi155.stdout: { 2023-08-01T19:56:30.266 INFO:teuthology.orchestra.run.smithi155.stdout: "event": "all_read", 2023-08-01T19:56:30.266 INFO:teuthology.orchestra.run.smithi155.stdout: "time": "2023-08-01T19:56:30.193275+0000", 2023-08-01T19:56:30.266 INFO:teuthology.orchestra.run.smithi155.stdout: "duration": 7.6059999999999997e-06 2023-08-01T19:56:30.266 INFO:teuthology.orchestra.run.smithi155.stdout: }, 2023-08-01T19:56:30.266 INFO:teuthology.orchestra.run.smithi155.stdout: { 2023-08-01T19:56:30.267 INFO:teuthology.orchestra.run.smithi155.stdout: "event": "dispatched", 2023-08-01T19:56:30.267 INFO:teuthology.orchestra.run.smithi155.stdout: "time": "2023-08-01T19:56:30.193285+0000", 2023-08-01T19:56:30.267 INFO:teuthology.orchestra.run.smithi155.stdout: "duration": 1.0122000000000001e-05 2023-08-01T19:56:30.267 INFO:teuthology.orchestra.run.smithi155.stdout: }, 2023-08-01T19:56:30.267 INFO:teuthology.orchestra.run.smithi155.stdout: { 2023-08-01T19:56:30.267 INFO:teuthology.orchestra.run.smithi155.stdout: "event": "queued_for_pg", 2023-08-01T19:56:30.267 INFO:teuthology.orchestra.run.smithi155.stdout: "time": "2023-08-01T19:56:30.193291+0000", 2023-08-01T19:56:30.267 INFO:teuthology.orchestra.run.smithi155.stdout: "duration": 5.3510000000000001e-06 2023-08-01T19:56:30.268 INFO:teuthology.orchestra.run.smithi155.stdout: }, 2023-08-01T19:56:30.268 INFO:teuthology.orchestra.run.smithi155.stdout: { 2023-08-01T19:56:30.268 INFO:teuthology.orchestra.run.smithi155.stdout: "event": "reached_pg", 2023-08-01T19:56:30.268 INFO:teuthology.orchestra.run.smithi155.stdout: "time": "2023-08-01T19:56:30.193700+0000", 2023-08-01T19:56:30.268 INFO:teuthology.orchestra.run.smithi155.stdout: "duration": 0.000409739 2023-08-01T19:56:30.268 INFO:teuthology.orchestra.run.smithi155.stdout: }, 2023-08-01T19:56:30.268 INFO:teuthology.orchestra.run.smithi155.stdout: { 2023-08-01T19:56:30.268 INFO:teuthology.orchestra.run.smithi155.stdout: "event": "started", 2023-08-01T19:56:30.269 INFO:teuthology.orchestra.run.smithi155.stdout: "time": "2023-08-01T19:56:30.193722+0000", 2023-08-01T19:56:30.269 INFO:teuthology.orchestra.run.smithi155.stdout: "duration": 2.1818e-05 2023-08-01T19:56:30.269 INFO:teuthology.orchestra.run.smithi155.stdout: } 2023-08-01T19:56:30.269 INFO:teuthology.orchestra.run.smithi155.stdout: ] 2023-08-01T19:56:30.269 INFO:teuthology.orchestra.run.smithi155.stdout: } 2023-08-01T19:56:30.270 INFO:teuthology.orchestra.run.smithi155.stdout: } 2023-08-01T19:56:30.270 INFO:teuthology.orchestra.run.smithi155.stdout: ], 2023-08-01T19:56:30.270 INFO:teuthology.orchestra.run.smithi155.stdout: "num_ops": 3 2023-08-01T19:56:30.270 INFO:teuthology.orchestra.run.smithi155.stdout:} 2023-08-01T19:56:30.271 DEBUG:teuthology.orchestra.run.smithi155:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 30 ceph --cluster ceph --admin-daemon /var/run/ceph/ceph-osd.2.asok dump_blocked_ops 2023-08-01T19:56:30.272 INFO:tasks.ceph.osd.2.smithi155.stderr:2023-08-01T19:56:30.269+0000 7faa5c6ac700 -1 received signal: Hangup from /usr/bin/python3 /bin/daemon-helper kill ceph-osd -f --cluster ceph -i 2 (PID: 111337) UID: 0 2023-08-01T19:56:30.372 INFO:tasks.ceph.osd.0.smithi008.stderr:2023-08-01T19:56:30.371+0000 7f16a58f4700 -1 received signal: Hangup from /usr/bin/python3 /bin/daemon-helper kill ceph-osd -f --cluster ceph -i 0 (PID: 111179) UID: 0 2023-08-01T19:56:30.466 INFO:teuthology.orchestra.run.smithi155.stdout:{ 2023-08-01T19:56:30.466 INFO:teuthology.orchestra.run.smithi155.stdout: "ops": [], 2023-08-01T19:56:30.466 INFO:teuthology.orchestra.run.smithi155.stdout: "complaint_time": 30, 2023-08-01T19:56:30.466 INFO:teuthology.orchestra.run.smithi155.stdout: "num_blocked_ops": 0 2023-08-01T19:56:30.466 INFO:teuthology.orchestra.run.smithi155.stdout:} 2023-08-01T19:56:30.472 INFO:tasks.ceph.osd.2.smithi155.stderr:2023-08-01T19:56:30.471+0000 7faa5c6ac700 -1 received signal: Hangup from /usr/bin/python3 /bin/daemon-helper kill ceph-osd -f --cluster ceph -i 2 (PID: 111337) UID: 0 2023-08-01T19:56:30.479 DEBUG:teuthology.orchestra.run.smithi155:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 30 ceph --cluster ceph --admin-daemon /var/run/ceph/ceph-osd.2.asok dump_historic_ops 2023-08-01T19:56:30.573 INFO:tasks.ceph.osd.0.smithi008.stderr:2023-08-01T19:56:30.573+0000 7f16a58f4700 -1 received signal: Hangup from /usr/bin/python3 /bin/daemon-helper kill ceph-osd -f --cluster ceph -i 0 (PID: 111179) UID: 0 2023-08-01T19:56:30.673 INFO:teuthology.orchestra.run.smithi155.stdout:{ 2023-08-01T19:56:30.673 INFO:teuthology.orchestra.run.smithi155.stdout: "size": 20, 2023-08-01T19:56:30.674 INFO:teuthology.orchestra.run.smithi155.stdout: "duration": 600, 2023-08-01T19:56:30.674 INFO:teuthology.orchestra.run.smithi155.stdout: "ops": [ 2023-08-01T19:56:30.674 INFO:teuthology.orchestra.run.smithi155.stdout: { 2023-08-01T19:56:30.674 INFO:teuthology.orchestra.run.smithi155.stdout: "description": "osd_op(client.4668.0:100237 5.4 5:2d68bec9:::benchmark_data_smithi006_114134_object100236:head [set-alloc-hint object_size 65536 write_size 65536,write 0~65536] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e37)", 2023-08-01T19:56:30.674 INFO:teuthology.orchestra.run.smithi155.stdout: "initiated_at": "2023-08-01T19:55:05.147736+0000", 2023-08-01T19:56:30.674 INFO:teuthology.orchestra.run.smithi155.stdout: "age": 85.522732916999999, 2023-08-01T19:56:30.674 INFO:teuthology.orchestra.run.smithi155.stdout: "duration": 0.071299464000000007, 2023-08-01T19:56:30.675 INFO:teuthology.orchestra.run.smithi155.stdout: "type_data": { 2023-08-01T19:56:30.675 INFO:teuthology.orchestra.run.smithi155.stdout: "flag_point": "commit sent; apply or cleanup", 2023-08-01T19:56:30.675 INFO:teuthology.orchestra.run.smithi155.stdout: "client_info": { 2023-08-01T19:56:30.675 INFO:teuthology.orchestra.run.smithi155.stdout: "client": "client.4668", 2023-08-01T19:56:30.675 INFO:teuthology.orchestra.run.smithi155.stdout: "client_addr": "172.21.15.6:0/1709472247", 2023-08-01T19:56:30.675 INFO:teuthology.orchestra.run.smithi155.stdout: "tid": 100237 2023-08-01T19:56:30.675 INFO:teuthology.orchestra.run.smithi155.stdout: }, 2023-08-01T19:56:30.675 INFO:teuthology.orchestra.run.smithi155.stdout: "events": [ 2023-08-01T19:56:30.676 INFO:teuthology.orchestra.run.smithi155.stdout: { 2023-08-01T19:56:30.676 INFO:teuthology.orchestra.run.smithi155.stdout: "event": "initiated", 2023-08-01T19:56:30.676 INFO:teuthology.orchestra.run.smithi155.stdout: "time": "2023-08-01T19:55:05.147736+0000", 2023-08-01T19:56:30.676 INFO:teuthology.orchestra.run.smithi155.stdout: "duration": 0 2023-08-01T19:56:30.676 INFO:teuthology.orchestra.run.smithi155.stdout: }, 2023-08-01T19:56:30.676 INFO:teuthology.orchestra.run.smithi155.stdout: { 2023-08-01T19:56:30.676 INFO:teuthology.orchestra.run.smithi155.stdout: "event": "throttled", 2023-08-01T19:56:30.677 INFO:teuthology.orchestra.run.smithi155.stdout: "time": "2023-08-01T19:55:05.147736+0000", 2023-08-01T19:56:30.677 INFO:teuthology.orchestra.run.smithi155.stdout: "duration": 0 2023-08-01T19:56:30.677 INFO:teuthology.orchestra.run.smithi155.stdout: }, 2023-08-01T19:56:30.677 INFO:teuthology.orchestra.run.smithi155.stdout: { 2023-08-01T19:56:30.677 INFO:teuthology.orchestra.run.smithi155.stdout: "event": "header_read", 2023-08-01T19:56:30.677 INFO:teuthology.orchestra.run.smithi155.stdout: "time": "2023-08-01T19:55:05.147736+0000", 2023-08-01T19:56:30.677 INFO:teuthology.orchestra.run.smithi155.stdout: "duration": 4294967295.9999995 2023-08-01T19:56:30.677 INFO:teuthology.orchestra.run.smithi155.stdout: }, 2023-08-01T19:56:30.678 INFO:teuthology.orchestra.run.smithi155.stdout: { 2023-08-01T19:56:30.678 INFO:teuthology.orchestra.run.smithi155.stdout: "event": "all_read", 2023-08-01T19:56:30.678 INFO:teuthology.orchestra.run.smithi155.stdout: "time": "2023-08-01T19:55:05.147766+0000", 2023-08-01T19:56:30.678 INFO:teuthology.orchestra.run.smithi155.stdout: "duration": 3.0394000000000001e-05 2023-08-01T19:56:30.678 INFO:teuthology.orchestra.run.smithi155.stdout: }, 2023-08-01T19:56:30.678 INFO:teuthology.orchestra.run.smithi155.stdout: { 2023-08-01T19:56:30.678 INFO:teuthology.orchestra.run.smithi155.stdout: "event": "dispatched", 2023-08-01T19:56:30.679 INFO:teuthology.orchestra.run.smithi155.stdout: "time": "2023-08-01T19:55:05.147771+0000", 2023-08-01T19:56:30.679 INFO:teuthology.orchestra.run.smithi155.stdout: "duration": 4.25e-06 2023-08-01T19:56:30.679 INFO:teuthology.orchestra.run.smithi155.stdout: }, 2023-08-01T19:56:30.679 INFO:teuthology.orchestra.run.smithi155.stdout: { 2023-08-01T19:56:30.679 INFO:teuthology.orchestra.run.smithi155.stdout: "event": "queued_for_pg", 2023-08-01T19:56:30.679 INFO:teuthology.orchestra.run.smithi155.stdout: "time": "2023-08-01T19:55:05.147773+0000", 2023-08-01T19:56:30.679 INFO:teuthology.orchestra.run.smithi155.stdout: "duration": 2.4159999999999998e-06 2023-08-01T19:56:30.680 INFO:teuthology.orchestra.run.smithi155.stdout: }, 2023-08-01T19:56:30.680 INFO:teuthology.orchestra.run.smithi155.stdout: { 2023-08-01T19:56:30.680 INFO:teuthology.orchestra.run.smithi155.stdout: "event": "reached_pg", 2023-08-01T19:56:30.680 INFO:teuthology.orchestra.run.smithi155.stdout: "time": "2023-08-01T19:55:05.149903+0000", 2023-08-01T19:56:30.680 INFO:teuthology.orchestra.run.smithi155.stdout: "duration": 0.002129948 2023-08-01T19:56:30.680 INFO:teuthology.orchestra.run.smithi155.stdout: }, 2023-08-01T19:56:30.680 INFO:teuthology.orchestra.run.smithi155.stdout: { 2023-08-01T19:56:30.680 INFO:teuthology.orchestra.run.smithi155.stdout: "event": "started", 2023-08-01T19:56:30.681 INFO:teuthology.orchestra.run.smithi155.stdout: "time": "2023-08-01T19:55:05.149982+0000", 2023-08-01T19:56:30.681 INFO:teuthology.orchestra.run.smithi155.stdout: "duration": 7.8706000000000002e-05 2023-08-01T19:56:30.681 INFO:teuthology.orchestra.run.smithi155.stdout: }, 2023-08-01T19:56:30.681 INFO:teuthology.orchestra.run.smithi155.stdout: { 2023-08-01T19:56:30.681 INFO:teuthology.orchestra.run.smithi155.stdout: "event": "waiting for subops from 0", 2023-08-01T19:56:30.681 INFO:teuthology.orchestra.run.smithi155.stdout: "time": "2023-08-01T19:55:05.150066+0000", 2023-08-01T19:56:30.681 INFO:teuthology.orchestra.run.smithi155.stdout: "duration": 8.4241999999999997e-05 2023-08-01T19:56:30.682 INFO:teuthology.orchestra.run.smithi155.stdout: }, 2023-08-01T19:56:30.682 INFO:teuthology.orchestra.run.smithi155.stdout: { 2023-08-01T19:56:30.682 INFO:teuthology.orchestra.run.smithi155.stdout: "event": "op_commit", 2023-08-01T19:56:30.682 INFO:teuthology.orchestra.run.smithi155.stdout: "time": "2023-08-01T19:55:05.154994+0000", 2023-08-01T19:56:30.682 INFO:teuthology.orchestra.run.smithi155.stdout: "duration": 0.0049277050000000001 2023-08-01T19:56:30.682 INFO:teuthology.orchestra.run.smithi155.stdout: }, 2023-08-01T19:56:30.682 INFO:teuthology.orchestra.run.smithi155.stdout: { 2023-08-01T19:56:30.682 INFO:teuthology.orchestra.run.smithi155.stdout: "event": "sub_op_commit_rec", 2023-08-01T19:56:30.683 INFO:teuthology.orchestra.run.smithi155.stdout: "time": "2023-08-01T19:55:05.218933+0000", 2023-08-01T19:56:30.683 INFO:teuthology.orchestra.run.smithi155.stdout: "duration": 0.063939916999999999 2023-08-01T19:56:30.683 INFO:teuthology.orchestra.run.smithi155.stdout: }, 2023-08-01T19:56:30.683 INFO:teuthology.orchestra.run.smithi155.stdout: { 2023-08-01T19:56:30.683 INFO:teuthology.orchestra.run.smithi155.stdout: "event": "commit_sent", 2023-08-01T19:56:30.683 INFO:teuthology.orchestra.run.smithi155.stdout: "time": "2023-08-01T19:55:05.218989+0000", 2023-08-01T19:56:30.683 INFO:teuthology.orchestra.run.smithi155.stdout: "duration": 5.5772000000000001e-05 2023-08-01T19:56:30.684 INFO:teuthology.orchestra.run.smithi155.stdout: }, 2023-08-01T19:56:30.684 INFO:teuthology.orchestra.run.smithi155.stdout: { 2023-08-01T19:56:30.684 INFO:teuthology.orchestra.run.smithi155.stdout: "event": "done", 2023-08-01T19:56:30.684 INFO:teuthology.orchestra.run.smithi155.stdout: "time": "2023-08-01T19:55:05.219036+0000", 2023-08-01T19:56:30.684 INFO:teuthology.orchestra.run.smithi155.stdout: "duration": 4.6526000000000001e-05 2023-08-01T19:56:30.684 INFO:teuthology.orchestra.run.smithi155.stdout: } 2023-08-01T19:56:30.684 INFO:teuthology.orchestra.run.smithi155.stdout: ] 2023-08-01T19:56:30.685 INFO:teuthology.orchestra.run.smithi155.stdout: } 2023-08-01T19:56:30.685 INFO:teuthology.orchestra.run.smithi155.stdout: }, 2023-08-01T19:56:30.685 INFO:teuthology.orchestra.run.smithi155.stdout: { 2023-08-01T19:56:30.685 INFO:teuthology.orchestra.run.smithi155.stdout: "description": "osd_op(client.4668.0:100242 5.8 5:16a314b8:::benchmark_data_smithi006_114134_object100241:head [set-alloc-hint object_size 65536 write_size 65536,write 0~65536] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e37)", 2023-08-01T19:56:30.685 INFO:teuthology.orchestra.run.smithi155.stdout: "initiated_at": "2023-08-01T19:55:05.150616+0000", 2023-08-01T19:56:30.685 INFO:teuthology.orchestra.run.smithi155.stdout: "age": 85.519853287000004, 2023-08-01T19:56:30.685 INFO:teuthology.orchestra.run.smithi155.stdout: "duration": 0.071105065999999995, 2023-08-01T19:56:30.685 INFO:teuthology.orchestra.run.smithi155.stdout: "type_data": { 2023-08-01T19:56:30.686 INFO:teuthology.orchestra.run.smithi155.stdout: "flag_point": "commit sent; apply or cleanup", 2023-08-01T19:56:30.686 INFO:teuthology.orchestra.run.smithi155.stdout: "client_info": { 2023-08-01T19:56:30.686 INFO:teuthology.orchestra.run.smithi155.stdout: "client": "client.4668", 2023-08-01T19:56:30.686 INFO:teuthology.orchestra.run.smithi155.stdout: "client_addr": "172.21.15.6:0/1709472247", 2023-08-01T19:56:30.686 INFO:teuthology.orchestra.run.smithi155.stdout: "tid": 100242 2023-08-01T19:56:30.686 INFO:teuthology.orchestra.run.smithi155.stdout: }, 2023-08-01T19:56:30.686 INFO:teuthology.orchestra.run.smithi155.stdout: "events": [ 2023-08-01T19:56:30.686 INFO:teuthology.orchestra.run.smithi155.stdout: { 2023-08-01T19:56:30.687 INFO:teuthology.orchestra.run.smithi155.stdout: "event": "initiated", 2023-08-01T19:56:30.687 INFO:teuthology.orchestra.run.smithi155.stdout: "time": "2023-08-01T19:55:05.150616+0000", 2023-08-01T19:56:30.687 INFO:teuthology.orchestra.run.smithi155.stdout: "duration": 0 2023-08-01T19:56:30.687 INFO:teuthology.orchestra.run.smithi155.stdout: }, 2023-08-01T19:56:30.687 INFO:teuthology.orchestra.run.smithi155.stdout: { 2023-08-01T19:56:30.687 INFO:teuthology.orchestra.run.smithi155.stdout: "event": "throttled", 2023-08-01T19:56:30.687 INFO:teuthology.orchestra.run.smithi155.stdout: "time": "2023-08-01T19:55:05.150616+0000", 2023-08-01T19:56:30.688 INFO:teuthology.orchestra.run.smithi155.stdout: "duration": 0 2023-08-01T19:56:30.688 INFO:teuthology.orchestra.run.smithi155.stdout: }, 2023-08-01T19:56:30.688 INFO:teuthology.orchestra.run.smithi155.stdout: { 2023-08-01T19:56:30.688 INFO:teuthology.orchestra.run.smithi155.stdout: "event": "header_read", 2023-08-01T19:56:30.688 INFO:teuthology.orchestra.run.smithi155.stdout: "time": "2023-08-01T19:55:05.150615+0000", 2023-08-01T19:56:30.688 INFO:teuthology.orchestra.run.smithi155.stdout: "duration": 4294967295.999999 2023-08-01T19:56:30.688 INFO:teuthology.orchestra.run.smithi155.stdout: }, 2023-08-01T19:56:30.688 INFO:teuthology.orchestra.run.smithi155.stdout: { 2023-08-01T19:56:30.689 INFO:teuthology.orchestra.run.smithi155.stdout: "event": "all_read", 2023-08-01T19:56:30.689 INFO:teuthology.orchestra.run.smithi155.stdout: "time": "2023-08-01T19:55:05.150696+0000", 2023-08-01T19:56:30.689 INFO:teuthology.orchestra.run.smithi155.stdout: "duration": 8.0852000000000004e-05 2023-08-01T19:56:30.689 INFO:teuthology.orchestra.run.smithi155.stdout: }, 2023-08-01T19:56:30.689 INFO:teuthology.orchestra.run.smithi155.stdout: { 2023-08-01T19:56:30.689 INFO:teuthology.orchestra.run.smithi155.stdout: "event": "dispatched", 2023-08-01T19:56:30.689 INFO:teuthology.orchestra.run.smithi155.stdout: "time": "2023-08-01T19:55:05.150708+0000", 2023-08-01T19:56:30.690 INFO:teuthology.orchestra.run.smithi155.stdout: "duration": 1.2116999999999999e-05 2023-08-01T19:56:30.690 INFO:teuthology.orchestra.run.smithi155.stdout: }, 2023-08-01T19:56:30.690 INFO:teuthology.orchestra.run.smithi155.stdout: { 2023-08-01T19:56:30.690 INFO:teuthology.orchestra.run.smithi155.stdout: "event": "queued_for_pg", 2023-08-01T19:56:30.690 INFO:teuthology.orchestra.run.smithi155.stdout: "time": "2023-08-01T19:55:05.150713+0000", 2023-08-01T19:56:30.690 INFO:teuthology.orchestra.run.smithi155.stdout: "duration": 5.4620000000000004e-06 2023-08-01T19:56:30.690 INFO:teuthology.orchestra.run.smithi155.stdout: }, 2023-08-01T19:56:30.690 INFO:teuthology.orchestra.run.smithi155.stdout: { 2023-08-01T19:56:30.691 INFO:teuthology.orchestra.run.smithi155.stdout: "event": "reached_pg", 2023-08-01T19:56:30.691 INFO:teuthology.orchestra.run.smithi155.stdout: "time": "2023-08-01T19:55:05.150761+0000", 2023-08-01T19:56:30.691 INFO:teuthology.orchestra.run.smithi155.stdout: "duration": 4.7429000000000003e-05 2023-08-01T19:56:30.691 INFO:teuthology.orchestra.run.smithi155.stdout: }, 2023-08-01T19:56:30.691 INFO:teuthology.orchestra.run.smithi155.stdout: { 2023-08-01T19:56:30.691 INFO:teuthology.orchestra.run.smithi155.stdout: "event": "started", 2023-08-01T19:56:30.691 INFO:teuthology.orchestra.run.smithi155.stdout: "time": "2023-08-01T19:55:05.150856+0000", 2023-08-01T19:56:30.691 INFO:teuthology.orchestra.run.smithi155.stdout: "duration": 9.5356e-05 2023-08-01T19:56:30.692 INFO:teuthology.orchestra.run.smithi155.stdout: }, 2023-08-01T19:56:30.692 INFO:teuthology.orchestra.run.smithi155.stdout: { 2023-08-01T19:56:30.692 INFO:teuthology.orchestra.run.smithi155.stdout: "event": "waiting for subops from 0", 2023-08-01T19:56:30.692 INFO:teuthology.orchestra.run.smithi155.stdout: "time": "2023-08-01T19:55:05.150999+0000", 2023-08-01T19:56:30.692 INFO:teuthology.orchestra.run.smithi155.stdout: "duration": 0.00014234499999999999 2023-08-01T19:56:30.692 INFO:teuthology.orchestra.run.smithi155.stdout: }, 2023-08-01T19:56:30.692 INFO:teuthology.orchestra.run.smithi155.stdout: { 2023-08-01T19:56:30.692 INFO:teuthology.orchestra.run.smithi155.stdout: "event": "sub_op_commit_rec", 2023-08-01T19:56:30.693 INFO:teuthology.orchestra.run.smithi155.stdout: "time": "2023-08-01T19:55:05.219001+0000", 2023-08-01T19:56:30.693 INFO:teuthology.orchestra.run.smithi155.stdout: "duration": 0.068002776000000001 2023-08-01T19:56:30.693 INFO:teuthology.orchestra.run.smithi155.stdout: }, 2023-08-01T19:56:30.693 INFO:teuthology.orchestra.run.smithi155.stdout: { 2023-08-01T19:56:30.693 INFO:teuthology.orchestra.run.smithi155.stdout: "event": "op_commit", 2023-08-01T19:56:30.693 INFO:teuthology.orchestra.run.smithi155.stdout: "time": "2023-08-01T19:55:05.221635+0000", 2023-08-01T19:56:30.693 INFO:teuthology.orchestra.run.smithi155.stdout: "duration": 0.0026340579999999999 2023-08-01T19:56:30.694 INFO:teuthology.orchestra.run.smithi155.stdout: }, 2023-08-01T19:56:30.694 INFO:teuthology.orchestra.run.smithi155.stdout: { 2023-08-01T19:56:30.694 INFO:teuthology.orchestra.run.smithi155.stdout: "event": "commit_sent", 2023-08-01T19:56:30.694 INFO:teuthology.orchestra.run.smithi155.stdout: "time": "2023-08-01T19:55:05.221682+0000", 2023-08-01T19:56:30.694 INFO:teuthology.orchestra.run.smithi155.stdout: "duration": 4.7123999999999998e-05 2023-08-01T19:56:30.694 INFO:teuthology.orchestra.run.smithi155.stdout: }, 2023-08-01T19:56:30.694 INFO:teuthology.orchestra.run.smithi155.stdout: { 2023-08-01T19:56:30.694 INFO:teuthology.orchestra.run.smithi155.stdout: "event": "done", 2023-08-01T19:56:30.695 INFO:teuthology.orchestra.run.smithi155.stdout: "time": "2023-08-01T19:55:05.221721+0000", 2023-08-01T19:56:30.695 INFO:teuthology.orchestra.run.smithi155.stdout: "duration": 3.8529999999999999e-05 2023-08-01T19:56:30.695 INFO:teuthology.orchestra.run.smithi155.stdout: } 2023-08-01T19:56:30.695 INFO:teuthology.orchestra.run.smithi155.stdout: ] 2023-08-01T19:56:30.695 INFO:teuthology.orchestra.run.smithi155.stdout: } 2023-08-01T19:56:30.695 INFO:teuthology.orchestra.run.smithi155.stdout: }, 2023-08-01T19:56:30.696 INFO:teuthology.orchestra.run.smithi155.stdout: { 2023-08-01T19:56:30.696 INFO:teuthology.orchestra.run.smithi155.stdout: "description": "osd_repop(client.4668.0:100240 5.a e37/19 5:5313c5b9:::benchmark_data_smithi006_114134_object100239:head v 37'6227, mlcod=37'6225)", 2023-08-01T19:56:30.696 INFO:teuthology.orchestra.run.smithi155.stdout: "initiated_at": "2023-08-01T19:55:05.150778+0000", 2023-08-01T19:56:30.696 INFO:teuthology.orchestra.run.smithi155.stdout: "age": 85.519691085999995, 2023-08-01T19:56:30.696 INFO:teuthology.orchestra.run.smithi155.stdout: "duration": 0.073362533999999993, 2023-08-01T19:56:30.696 INFO:teuthology.orchestra.run.smithi155.stdout: "type_data": { 2023-08-01T19:56:30.696 INFO:teuthology.orchestra.run.smithi155.stdout: "flag_point": "commit sent; apply or cleanup", 2023-08-01T19:56:30.696 INFO:teuthology.orchestra.run.smithi155.stdout: "events": [ 2023-08-01T19:56:30.697 INFO:teuthology.orchestra.run.smithi155.stdout: { 2023-08-01T19:56:30.697 INFO:teuthology.orchestra.run.smithi155.stdout: "event": "initiated", 2023-08-01T19:56:30.697 INFO:teuthology.orchestra.run.smithi155.stdout: "time": "2023-08-01T19:55:05.150778+0000", 2023-08-01T19:56:30.697 INFO:teuthology.orchestra.run.smithi155.stdout: "duration": 0 2023-08-01T19:56:30.697 INFO:teuthology.orchestra.run.smithi155.stdout: }, 2023-08-01T19:56:30.697 INFO:teuthology.orchestra.run.smithi155.stdout: { 2023-08-01T19:56:30.697 INFO:teuthology.orchestra.run.smithi155.stdout: "event": "throttled", 2023-08-01T19:56:30.697 INFO:teuthology.orchestra.run.smithi155.stdout: "time": "2023-08-01T19:55:05.150778+0000", 2023-08-01T19:56:30.698 INFO:teuthology.orchestra.run.smithi155.stdout: "duration": 0 2023-08-01T19:56:30.698 INFO:teuthology.orchestra.run.smithi155.stdout: }, 2023-08-01T19:56:30.698 INFO:teuthology.orchestra.run.smithi155.stdout: { 2023-08-01T19:56:30.698 INFO:teuthology.orchestra.run.smithi155.stdout: "event": "header_read", 2023-08-01T19:56:30.698 INFO:teuthology.orchestra.run.smithi155.stdout: "time": "2023-08-01T19:55:05.150778+0000", 2023-08-01T19:56:30.698 INFO:teuthology.orchestra.run.smithi155.stdout: "duration": 4294967295.9999995 2023-08-01T19:56:30.698 INFO:teuthology.orchestra.run.smithi155.stdout: }, 2023-08-01T19:56:30.699 INFO:teuthology.orchestra.run.smithi155.stdout: { 2023-08-01T19:56:30.699 INFO:teuthology.orchestra.run.smithi155.stdout: "event": "all_read", 2023-08-01T19:56:30.699 INFO:teuthology.orchestra.run.smithi155.stdout: "time": "2023-08-01T19:55:05.150811+0000", 2023-08-01T19:56:30.699 INFO:teuthology.orchestra.run.smithi155.stdout: "duration": 3.3664000000000002e-05 2023-08-01T19:56:30.699 INFO:teuthology.orchestra.run.smithi155.stdout: }, 2023-08-01T19:56:30.699 INFO:teuthology.orchestra.run.smithi155.stdout: { 2023-08-01T19:56:30.699 INFO:teuthology.orchestra.run.smithi155.stdout: "event": "dispatched", 2023-08-01T19:56:30.699 INFO:teuthology.orchestra.run.smithi155.stdout: "time": "2023-08-01T19:55:05.150818+0000", 2023-08-01T19:56:30.700 INFO:teuthology.orchestra.run.smithi155.stdout: "duration": 6.5769999999999999e-06 2023-08-01T19:56:30.700 INFO:teuthology.orchestra.run.smithi155.stdout: }, 2023-08-01T19:56:30.700 INFO:teuthology.orchestra.run.smithi155.stdout: { 2023-08-01T19:56:30.700 INFO:teuthology.orchestra.run.smithi155.stdout: "event": "queued_for_pg", 2023-08-01T19:56:30.700 INFO:teuthology.orchestra.run.smithi155.stdout: "time": "2023-08-01T19:55:05.150822+0000", 2023-08-01T19:56:30.700 INFO:teuthology.orchestra.run.smithi155.stdout: "duration": 4.0060000000000003e-06 2023-08-01T19:56:30.700 INFO:teuthology.orchestra.run.smithi155.stdout: }, 2023-08-01T19:56:30.700 INFO:teuthology.orchestra.run.smithi155.stdout: { 2023-08-01T19:56:30.701 INFO:teuthology.orchestra.run.smithi155.stdout: "event": "reached_pg", 2023-08-01T19:56:30.701 INFO:teuthology.orchestra.run.smithi155.stdout: "time": "2023-08-01T19:55:05.150855+0000", 2023-08-01T19:56:30.701 INFO:teuthology.orchestra.run.smithi155.stdout: "duration": 3.3204999999999998e-05 2023-08-01T19:56:30.701 INFO:teuthology.orchestra.run.smithi155.stdout: }, 2023-08-01T19:56:30.701 INFO:teuthology.orchestra.run.smithi155.stdout: { 2023-08-01T19:56:30.701 INFO:teuthology.orchestra.run.smithi155.stdout: "event": "started", 2023-08-01T19:56:30.701 INFO:teuthology.orchestra.run.smithi155.stdout: "time": "2023-08-01T19:55:05.150873+0000", 2023-08-01T19:56:30.701 INFO:teuthology.orchestra.run.smithi155.stdout: "duration": 1.8139999999999999e-05 2023-08-01T19:56:30.702 INFO:teuthology.orchestra.run.smithi155.stdout: }, 2023-08-01T19:56:30.702 INFO:teuthology.orchestra.run.smithi155.stdout: { 2023-08-01T19:56:30.702 INFO:teuthology.orchestra.run.smithi155.stdout: "event": "commit_sent", 2023-08-01T19:56:30.702 INFO:teuthology.orchestra.run.smithi155.stdout: "time": "2023-08-01T19:55:05.224095+0000", 2023-08-01T19:56:30.702 INFO:teuthology.orchestra.run.smithi155.stdout: "duration": 0.073221895999999995 2023-08-01T19:56:30.702 INFO:teuthology.orchestra.run.smithi155.stdout: }, 2023-08-01T19:56:30.702 INFO:teuthology.orchestra.run.smithi155.stdout: { 2023-08-01T19:56:30.703 INFO:teuthology.orchestra.run.smithi155.stdout: "event": "done", 2023-08-01T19:56:30.703 INFO:teuthology.orchestra.run.smithi155.stdout: "time": "2023-08-01T19:55:05.224141+0000", 2023-08-01T19:56:30.703 INFO:teuthology.orchestra.run.smithi155.stdout: "duration": 4.5385e-05 2023-08-01T19:56:30.703 INFO:teuthology.orchestra.run.smithi155.stdout: } 2023-08-01T19:56:30.703 INFO:teuthology.orchestra.run.smithi155.stdout: ] 2023-08-01T19:56:30.703 INFO:teuthology.orchestra.run.smithi155.stdout: } 2023-08-01T19:56:30.703 INFO:teuthology.orchestra.run.smithi155.stdout: }, 2023-08-01T19:56:30.703 INFO:teuthology.orchestra.run.smithi155.stdout: { 2023-08-01T19:56:30.704 INFO:teuthology.orchestra.run.smithi155.stdout: "description": "osd_op(client.4668.0:100245 5.e 5:71869c66:::benchmark_data_smithi006_114134_object100244:head [set-alloc-hint object_size 65536 write_size 65536,write 0~65536] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e37)", 2023-08-01T19:56:30.704 INFO:teuthology.orchestra.run.smithi155.stdout: "initiated_at": "2023-08-01T19:55:05.150991+0000", 2023-08-01T19:56:30.704 INFO:teuthology.orchestra.run.smithi155.stdout: "age": 85.519478298999999, 2023-08-01T19:56:30.704 INFO:teuthology.orchestra.run.smithi155.stdout: "duration": 0.070734490999999997, 2023-08-01T19:56:30.704 INFO:teuthology.orchestra.run.smithi155.stdout: "type_data": { 2023-08-01T19:56:30.704 INFO:teuthology.orchestra.run.smithi155.stdout: "flag_point": "commit sent; apply or cleanup", 2023-08-01T19:56:30.704 INFO:teuthology.orchestra.run.smithi155.stdout: "client_info": { 2023-08-01T19:56:30.704 INFO:teuthology.orchestra.run.smithi155.stdout: "client": "client.4668", 2023-08-01T19:56:30.705 INFO:teuthology.orchestra.run.smithi155.stdout: "client_addr": "172.21.15.6:0/1709472247", 2023-08-01T19:56:30.705 INFO:teuthology.orchestra.run.smithi155.stdout: "tid": 100245 2023-08-01T19:56:30.705 INFO:teuthology.orchestra.run.smithi155.stdout: }, 2023-08-01T19:56:30.705 INFO:teuthology.orchestra.run.smithi155.stdout: "events": [ 2023-08-01T19:56:30.705 INFO:teuthology.orchestra.run.smithi155.stdout: { 2023-08-01T19:56:30.705 INFO:teuthology.orchestra.run.smithi155.stdout: "event": "initiated", 2023-08-01T19:56:30.705 INFO:teuthology.orchestra.run.smithi155.stdout: "time": "2023-08-01T19:55:05.150991+0000", 2023-08-01T19:56:30.705 INFO:teuthology.orchestra.run.smithi155.stdout: "duration": 0 2023-08-01T19:56:30.706 INFO:teuthology.orchestra.run.smithi155.stdout: }, 2023-08-01T19:56:30.706 INFO:teuthology.orchestra.run.smithi155.stdout: { 2023-08-01T19:56:30.706 INFO:teuthology.orchestra.run.smithi155.stdout: "event": "throttled", 2023-08-01T19:56:30.706 INFO:teuthology.orchestra.run.smithi155.stdout: "time": "2023-08-01T19:55:05.150991+0000", 2023-08-01T19:56:30.706 INFO:teuthology.orchestra.run.smithi155.stdout: "duration": 0 2023-08-01T19:56:30.706 INFO:teuthology.orchestra.run.smithi155.stdout: }, 2023-08-01T19:56:30.706 INFO:teuthology.orchestra.run.smithi155.stdout: { 2023-08-01T19:56:30.706 INFO:teuthology.orchestra.run.smithi155.stdout: "event": "header_read", 2023-08-01T19:56:30.707 INFO:teuthology.orchestra.run.smithi155.stdout: "time": "2023-08-01T19:55:05.150990+0000", 2023-08-01T19:56:30.707 INFO:teuthology.orchestra.run.smithi155.stdout: "duration": 4294967295.999999 2023-08-01T19:56:30.707 INFO:teuthology.orchestra.run.smithi155.stdout: }, 2023-08-01T19:56:30.707 INFO:teuthology.orchestra.run.smithi155.stdout: { 2023-08-01T19:56:30.707 INFO:teuthology.orchestra.run.smithi155.stdout: "event": "all_read", 2023-08-01T19:56:30.707 INFO:teuthology.orchestra.run.smithi155.stdout: "time": "2023-08-01T19:55:05.151108+0000", 2023-08-01T19:56:30.707 INFO:teuthology.orchestra.run.smithi155.stdout: "duration": 0.00011849300000000001 2023-08-01T19:56:30.708 INFO:teuthology.orchestra.run.smithi155.stdout: }, 2023-08-01T19:56:30.708 INFO:teuthology.orchestra.run.smithi155.stdout: { 2023-08-01T19:56:30.708 INFO:teuthology.orchestra.run.smithi155.stdout: "event": "dispatched", 2023-08-01T19:56:30.708 INFO:teuthology.orchestra.run.smithi155.stdout: "time": "2023-08-01T19:55:05.151117+0000", 2023-08-01T19:56:30.708 INFO:teuthology.orchestra.run.smithi155.stdout: "duration": 8.1040000000000007e-06 2023-08-01T19:56:30.708 INFO:teuthology.orchestra.run.smithi155.stdout: }, 2023-08-01T19:56:30.708 INFO:teuthology.orchestra.run.smithi155.stdout: { 2023-08-01T19:56:30.708 INFO:teuthology.orchestra.run.smithi155.stdout: "event": "queued_for_pg", 2023-08-01T19:56:30.709 INFO:teuthology.orchestra.run.smithi155.stdout: "time": "2023-08-01T19:55:05.151121+0000", 2023-08-01T19:56:30.709 INFO:teuthology.orchestra.run.smithi155.stdout: "duration": 4.2019999999999997e-06 2023-08-01T19:56:30.709 INFO:teuthology.orchestra.run.smithi155.stdout: }, 2023-08-01T19:56:30.709 INFO:teuthology.orchestra.run.smithi155.stdout: { 2023-08-01T19:56:30.709 INFO:teuthology.orchestra.run.smithi155.stdout: "event": "reached_pg", 2023-08-01T19:56:30.709 INFO:teuthology.orchestra.run.smithi155.stdout: "time": "2023-08-01T19:55:05.151162+0000", 2023-08-01T19:56:30.709 INFO:teuthology.orchestra.run.smithi155.stdout: "duration": 4.1448e-05 2023-08-01T19:56:30.709 INFO:teuthology.orchestra.run.smithi155.stdout: }, 2023-08-01T19:56:30.710 INFO:teuthology.orchestra.run.smithi155.stdout: { 2023-08-01T19:56:30.710 INFO:teuthology.orchestra.run.smithi155.stdout: "event": "started", 2023-08-01T19:56:30.710 INFO:teuthology.orchestra.run.smithi155.stdout: "time": "2023-08-01T19:55:05.151281+0000", 2023-08-01T19:56:30.710 INFO:teuthology.orchestra.run.smithi155.stdout: "duration": 0.000119141 2023-08-01T19:56:30.710 INFO:teuthology.orchestra.run.smithi155.stdout: }, 2023-08-01T19:56:30.710 INFO:teuthology.orchestra.run.smithi155.stdout: { 2023-08-01T19:56:30.710 INFO:teuthology.orchestra.run.smithi155.stdout: "event": "waiting for subops from 0", 2023-08-01T19:56:30.710 INFO:teuthology.orchestra.run.smithi155.stdout: "time": "2023-08-01T19:55:05.151443+0000", 2023-08-01T19:56:30.711 INFO:teuthology.orchestra.run.smithi155.stdout: "duration": 0.00016181600000000001 2023-08-01T19:56:30.711 INFO:teuthology.orchestra.run.smithi155.stdout: }, 2023-08-01T19:56:30.711 INFO:teuthology.orchestra.run.smithi155.stdout: { 2023-08-01T19:56:30.711 INFO:teuthology.orchestra.run.smithi155.stdout: "event": "sub_op_commit_rec", 2023-08-01T19:56:30.711 INFO:teuthology.orchestra.run.smithi155.stdout: "time": "2023-08-01T19:55:05.219101+0000", 2023-08-01T19:56:30.711 INFO:teuthology.orchestra.run.smithi155.stdout: "duration": 0.067658037000000004 2023-08-01T19:56:30.711 INFO:teuthology.orchestra.run.smithi155.stdout: }, 2023-08-01T19:56:30.712 INFO:teuthology.orchestra.run.smithi155.stdout: { 2023-08-01T19:56:30.712 INFO:teuthology.orchestra.run.smithi155.stdout: "event": "op_commit", 2023-08-01T19:56:30.712 INFO:teuthology.orchestra.run.smithi155.stdout: "time": "2023-08-01T19:55:05.221646+0000", 2023-08-01T19:56:30.712 INFO:teuthology.orchestra.run.smithi155.stdout: "duration": 0.0025450540000000002 2023-08-01T19:56:30.712 INFO:teuthology.orchestra.run.smithi155.stdout: }, 2023-08-01T19:56:30.712 INFO:teuthology.orchestra.run.smithi155.stdout: { 2023-08-01T19:56:30.712 INFO:teuthology.orchestra.run.smithi155.stdout: "event": "commit_sent", 2023-08-01T19:56:30.712 INFO:teuthology.orchestra.run.smithi155.stdout: "time": "2023-08-01T19:55:05.221689+0000", 2023-08-01T19:56:30.713 INFO:teuthology.orchestra.run.smithi155.stdout: "duration": 4.3078999999999999e-05 2023-08-01T19:56:30.713 INFO:teuthology.orchestra.run.smithi155.stdout: }, 2023-08-01T19:56:30.713 INFO:teuthology.orchestra.run.smithi155.stdout: { 2023-08-01T19:56:30.713 INFO:teuthology.orchestra.run.smithi155.stdout: "event": "done", 2023-08-01T19:56:30.713 INFO:teuthology.orchestra.run.smithi155.stdout: "time": "2023-08-01T19:55:05.221725+0000", 2023-08-01T19:56:30.713 INFO:teuthology.orchestra.run.smithi155.stdout: "duration": 3.6137999999999999e-05 2023-08-01T19:56:30.713 INFO:teuthology.orchestra.run.smithi155.stdout: } 2023-08-01T19:56:30.713 INFO:teuthology.orchestra.run.smithi155.stdout: ] 2023-08-01T19:56:30.714 INFO:teuthology.orchestra.run.smithi155.stdout: } 2023-08-01T19:56:30.714 INFO:teuthology.orchestra.run.smithi155.stdout: }, 2023-08-01T19:56:30.714 INFO:teuthology.orchestra.run.smithi155.stdout: { 2023-08-01T19:56:30.714 INFO:teuthology.orchestra.run.smithi155.stdout: "description": "osd_repop(client.4668.0:100243 5.a e37/19 5:5e8193b6:::benchmark_data_smithi006_114134_object100242:head v 37'6228, mlcod=37'6225)", 2023-08-01T19:56:30.714 INFO:teuthology.orchestra.run.smithi155.stdout: "initiated_at": "2023-08-01T19:55:05.151148+0000", 2023-08-01T19:56:30.714 INFO:teuthology.orchestra.run.smithi155.stdout: "age": 85.519321288, 2023-08-01T19:56:30.714 INFO:teuthology.orchestra.run.smithi155.stdout: "duration": 0.073020370000000001, 2023-08-01T19:56:30.714 INFO:teuthology.orchestra.run.smithi155.stdout: "type_data": { 2023-08-01T19:56:30.715 INFO:teuthology.orchestra.run.smithi155.stdout: "flag_point": "commit sent; apply or cleanup", 2023-08-01T19:56:30.715 INFO:teuthology.orchestra.run.smithi155.stdout: "events": [ 2023-08-01T19:56:30.715 INFO:teuthology.orchestra.run.smithi155.stdout: { 2023-08-01T19:56:30.715 INFO:teuthology.orchestra.run.smithi155.stdout: "event": "initiated", 2023-08-01T19:56:30.715 INFO:teuthology.orchestra.run.smithi155.stdout: "time": "2023-08-01T19:55:05.151148+0000", 2023-08-01T19:56:30.715 INFO:teuthology.orchestra.run.smithi155.stdout: "duration": 0 2023-08-01T19:56:30.715 INFO:teuthology.orchestra.run.smithi155.stdout: }, 2023-08-01T19:56:30.715 INFO:teuthology.orchestra.run.smithi155.stdout: { 2023-08-01T19:56:30.716 INFO:teuthology.orchestra.run.smithi155.stdout: "event": "throttled", 2023-08-01T19:56:30.716 INFO:teuthology.orchestra.run.smithi155.stdout: "time": "2023-08-01T19:55:05.151148+0000", 2023-08-01T19:56:30.716 INFO:teuthology.orchestra.run.smithi155.stdout: "duration": 0 2023-08-01T19:56:30.716 INFO:teuthology.orchestra.run.smithi155.stdout: }, 2023-08-01T19:56:30.716 INFO:teuthology.orchestra.run.smithi155.stdout: { 2023-08-01T19:56:30.716 INFO:teuthology.orchestra.run.smithi155.stdout: "event": "header_read", 2023-08-01T19:56:30.716 INFO:teuthology.orchestra.run.smithi155.stdout: "time": "2023-08-01T19:55:05.151147+0000", 2023-08-01T19:56:30.716 INFO:teuthology.orchestra.run.smithi155.stdout: "duration": 4294967295.9999995 2023-08-01T19:56:30.717 INFO:teuthology.orchestra.run.smithi155.stdout: }, 2023-08-01T19:56:30.717 INFO:teuthology.orchestra.run.smithi155.stdout: { 2023-08-01T19:56:30.717 INFO:teuthology.orchestra.run.smithi155.stdout: "event": "all_read", 2023-08-01T19:56:30.717 INFO:teuthology.orchestra.run.smithi155.stdout: "time": "2023-08-01T19:55:05.151231+0000", 2023-08-01T19:56:30.717 INFO:teuthology.orchestra.run.smithi155.stdout: "duration": 8.3135999999999998e-05 2023-08-01T19:56:30.717 INFO:teuthology.orchestra.run.smithi155.stdout: }, 2023-08-01T19:56:30.717 INFO:teuthology.orchestra.run.smithi155.stdout: { 2023-08-01T19:56:30.718 INFO:teuthology.orchestra.run.smithi155.stdout: "event": "dispatched", 2023-08-01T19:56:30.718 INFO:teuthology.orchestra.run.smithi155.stdout: "time": "2023-08-01T19:55:05.151239+0000", 2023-08-01T19:56:30.718 INFO:teuthology.orchestra.run.smithi155.stdout: "duration": 8.7469999999999994e-06 2023-08-01T19:56:30.718 INFO:teuthology.orchestra.run.smithi155.stdout: }, 2023-08-01T19:56:30.718 INFO:teuthology.orchestra.run.smithi155.stdout: { 2023-08-01T19:56:30.718 INFO:teuthology.orchestra.run.smithi155.stdout: "event": "queued_for_pg", 2023-08-01T19:56:30.718 INFO:teuthology.orchestra.run.smithi155.stdout: "time": "2023-08-01T19:55:05.151244+0000", 2023-08-01T19:56:30.718 INFO:teuthology.orchestra.run.smithi155.stdout: "duration": 4.4800000000000003e-06 2023-08-01T19:56:30.719 INFO:teuthology.orchestra.run.smithi155.stdout: }, 2023-08-01T19:56:30.719 INFO:teuthology.orchestra.run.smithi155.stdout: { 2023-08-01T19:56:30.719 INFO:teuthology.orchestra.run.smithi155.stdout: "event": "reached_pg", 2023-08-01T19:56:30.719 INFO:teuthology.orchestra.run.smithi155.stdout: "time": "2023-08-01T19:55:05.152938+0000", 2023-08-01T19:56:30.719 INFO:teuthology.orchestra.run.smithi155.stdout: "duration": 0.001693824 2023-08-01T19:56:30.719 INFO:teuthology.orchestra.run.smithi155.stdout: }, 2023-08-01T19:56:30.719 INFO:teuthology.orchestra.run.smithi155.stdout: { 2023-08-01T19:56:30.719 INFO:teuthology.orchestra.run.smithi155.stdout: "event": "started", 2023-08-01T19:56:30.720 INFO:teuthology.orchestra.run.smithi155.stdout: "time": "2023-08-01T19:55:05.152956+0000", 2023-08-01T19:56:30.720 INFO:teuthology.orchestra.run.smithi155.stdout: "duration": 1.8287e-05 2023-08-01T19:56:30.720 INFO:teuthology.orchestra.run.smithi155.stdout: }, 2023-08-01T19:56:30.720 INFO:teuthology.orchestra.run.smithi155.stdout: { 2023-08-01T19:56:30.720 INFO:teuthology.orchestra.run.smithi155.stdout: "event": "commit_sent", 2023-08-01T19:56:30.720 INFO:teuthology.orchestra.run.smithi155.stdout: "time": "2023-08-01T19:55:05.224145+0000", 2023-08-01T19:56:30.720 INFO:teuthology.orchestra.run.smithi155.stdout: "duration": 0.071189447000000003 2023-08-01T19:56:30.720 INFO:teuthology.orchestra.run.smithi155.stdout: }, 2023-08-01T19:56:30.721 INFO:teuthology.orchestra.run.smithi155.stdout: { 2023-08-01T19:56:30.721 INFO:teuthology.orchestra.run.smithi155.stdout: "event": "done", 2023-08-01T19:56:30.721 INFO:teuthology.orchestra.run.smithi155.stdout: "time": "2023-08-01T19:55:05.224168+0000", 2023-08-01T19:56:30.721 INFO:teuthology.orchestra.run.smithi155.stdout: "duration": 2.3008999999999999e-05 2023-08-01T19:56:30.721 INFO:teuthology.orchestra.run.smithi155.stdout: } 2023-08-01T19:56:30.721 INFO:teuthology.orchestra.run.smithi155.stdout: ] 2023-08-01T19:56:30.721 INFO:teuthology.orchestra.run.smithi155.stdout: } 2023-08-01T19:56:30.721 INFO:teuthology.orchestra.run.smithi155.stdout: }, 2023-08-01T19:56:30.722 INFO:teuthology.orchestra.run.smithi155.stdout: { 2023-08-01T19:56:30.722 INFO:teuthology.orchestra.run.smithi155.stdout: "description": "osd_repop(client.4668.0:100244 5.9 e37/19 5:92f56a12:::benchmark_data_smithi006_114134_object100243:head v 37'6294, mlcod=37'6292)", 2023-08-01T19:56:30.722 INFO:teuthology.orchestra.run.smithi155.stdout: "initiated_at": "2023-08-01T19:55:05.151325+0000", 2023-08-01T19:56:30.722 INFO:teuthology.orchestra.run.smithi155.stdout: "age": 85.519143943000003, 2023-08-01T19:56:30.722 INFO:teuthology.orchestra.run.smithi155.stdout: "duration": 0.071883673999999995, 2023-08-01T19:56:30.722 INFO:teuthology.orchestra.run.smithi155.stdout: "type_data": { 2023-08-01T19:56:30.722 INFO:teuthology.orchestra.run.smithi155.stdout: "flag_point": "commit sent; apply or cleanup", 2023-08-01T19:56:30.723 INFO:teuthology.orchestra.run.smithi155.stdout: "events": [ 2023-08-01T19:56:30.723 INFO:teuthology.orchestra.run.smithi155.stdout: { 2023-08-01T19:56:30.723 INFO:teuthology.orchestra.run.smithi155.stdout: "event": "initiated", 2023-08-01T19:56:30.723 INFO:teuthology.orchestra.run.smithi155.stdout: "time": "2023-08-01T19:55:05.151325+0000", 2023-08-01T19:56:30.723 INFO:teuthology.orchestra.run.smithi155.stdout: "duration": 0 2023-08-01T19:56:30.723 INFO:teuthology.orchestra.run.smithi155.stdout: }, 2023-08-01T19:56:30.723 INFO:teuthology.orchestra.run.smithi155.stdout: { 2023-08-01T19:56:30.724 INFO:teuthology.orchestra.run.smithi155.stdout: "event": "throttled", 2023-08-01T19:56:30.724 INFO:teuthology.orchestra.run.smithi155.stdout: "time": "2023-08-01T19:55:05.151325+0000", 2023-08-01T19:56:30.724 INFO:teuthology.orchestra.run.smithi155.stdout: "duration": 0 2023-08-01T19:56:30.724 INFO:teuthology.orchestra.run.smithi155.stdout: }, 2023-08-01T19:56:30.724 INFO:teuthology.orchestra.run.smithi155.stdout: { 2023-08-01T19:56:30.724 INFO:teuthology.orchestra.run.smithi155.stdout: "event": "header_read", 2023-08-01T19:56:30.724 INFO:teuthology.orchestra.run.smithi155.stdout: "time": "2023-08-01T19:55:05.151325+0000", 2023-08-01T19:56:30.724 INFO:teuthology.orchestra.run.smithi155.stdout: "duration": 4294967295.9999995 2023-08-01T19:56:30.725 INFO:teuthology.orchestra.run.smithi155.stdout: }, 2023-08-01T19:56:30.725 INFO:teuthology.orchestra.run.smithi155.stdout: { 2023-08-01T19:56:30.725 INFO:teuthology.orchestra.run.smithi155.stdout: "event": "all_read", 2023-08-01T19:56:30.725 INFO:teuthology.orchestra.run.smithi155.stdout: "time": "2023-08-01T19:55:05.151390+0000", 2023-08-01T19:56:30.725 INFO:teuthology.orchestra.run.smithi155.stdout: "duration": 6.5456999999999993e-05 2023-08-01T19:56:30.725 INFO:teuthology.orchestra.run.smithi155.stdout: }, 2023-08-01T19:56:30.725 INFO:teuthology.orchestra.run.smithi155.stdout: { 2023-08-01T19:56:30.725 INFO:teuthology.orchestra.run.smithi155.stdout: "event": "dispatched", 2023-08-01T19:56:30.726 INFO:teuthology.orchestra.run.smithi155.stdout: "time": "2023-08-01T19:55:05.151396+0000", 2023-08-01T19:56:30.726 INFO:teuthology.orchestra.run.smithi155.stdout: "duration": 5.9190000000000004e-06 2023-08-01T19:56:30.726 INFO:teuthology.orchestra.run.smithi155.stdout: }, 2023-08-01T19:56:30.726 INFO:teuthology.orchestra.run.smithi155.stdout: { 2023-08-01T19:56:30.726 INFO:teuthology.orchestra.run.smithi155.stdout: "event": "queued_for_pg", 2023-08-01T19:56:30.726 INFO:teuthology.orchestra.run.smithi155.stdout: "time": "2023-08-01T19:55:05.151400+0000", 2023-08-01T19:56:30.726 INFO:teuthology.orchestra.run.smithi155.stdout: "duration": 4.1030000000000004e-06 2023-08-01T19:56:30.726 INFO:teuthology.orchestra.run.smithi155.stdout: }, 2023-08-01T19:56:30.727 INFO:teuthology.orchestra.run.smithi155.stdout: { 2023-08-01T19:56:30.727 INFO:teuthology.orchestra.run.smithi155.stdout: "event": "reached_pg", 2023-08-01T19:56:30.727 INFO:teuthology.orchestra.run.smithi155.stdout: "time": "2023-08-01T19:55:05.151452+0000", 2023-08-01T19:56:30.727 INFO:teuthology.orchestra.run.smithi155.stdout: "duration": 5.2136999999999999e-05 2023-08-01T19:56:30.727 INFO:teuthology.orchestra.run.smithi155.stdout: }, 2023-08-01T19:56:30.727 INFO:teuthology.orchestra.run.smithi155.stdout: { 2023-08-01T19:56:30.727 INFO:teuthology.orchestra.run.smithi155.stdout: "event": "started", 2023-08-01T19:56:30.728 INFO:teuthology.orchestra.run.smithi155.stdout: "time": "2023-08-01T19:55:05.151470+0000", 2023-08-01T19:56:30.728 INFO:teuthology.orchestra.run.smithi155.stdout: "duration": 1.8e-05 2023-08-01T19:56:30.728 INFO:teuthology.orchestra.run.smithi155.stdout: }, 2023-08-01T19:56:30.728 INFO:teuthology.orchestra.run.smithi155.stdout: { 2023-08-01T19:56:30.728 INFO:teuthology.orchestra.run.smithi155.stdout: "event": "commit_sent", 2023-08-01T19:56:30.728 INFO:teuthology.orchestra.run.smithi155.stdout: "time": "2023-08-01T19:55:05.223183+0000", 2023-08-01T19:56:30.728 INFO:teuthology.orchestra.run.smithi155.stdout: "duration": 0.071712622000000004 2023-08-01T19:56:30.728 INFO:teuthology.orchestra.run.smithi155.stdout: }, 2023-08-01T19:56:30.729 INFO:teuthology.orchestra.run.smithi155.stdout: { 2023-08-01T19:56:30.729 INFO:teuthology.orchestra.run.smithi155.stdout: "event": "done", 2023-08-01T19:56:30.729 INFO:teuthology.orchestra.run.smithi155.stdout: "time": "2023-08-01T19:55:05.223209+0000", 2023-08-01T19:56:30.729 INFO:teuthology.orchestra.run.smithi155.stdout: "duration": 2.5956e-05 2023-08-01T19:56:30.729 INFO:teuthology.orchestra.run.smithi155.stdout: } 2023-08-01T19:56:30.729 INFO:teuthology.orchestra.run.smithi155.stdout: ] 2023-08-01T19:56:30.729 INFO:teuthology.orchestra.run.smithi155.stdout: } 2023-08-01T19:56:30.729 INFO:teuthology.orchestra.run.smithi155.stdout: }, 2023-08-01T19:56:30.730 INFO:teuthology.orchestra.run.smithi155.stdout: { 2023-08-01T19:56:30.730 INFO:teuthology.orchestra.run.smithi155.stdout: "description": "osd_op(client.4668.0:100249 5.b 5:d0666827:::benchmark_data_smithi006_114134_object100248:head [set-alloc-hint object_size 65536 write_size 65536,write 0~65536] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e37)", 2023-08-01T19:56:30.730 INFO:teuthology.orchestra.run.smithi155.stdout: "initiated_at": "2023-08-01T19:55:05.153614+0000", 2023-08-01T19:56:30.730 INFO:teuthology.orchestra.run.smithi155.stdout: "age": 85.516855518, 2023-08-01T19:56:30.730 INFO:teuthology.orchestra.run.smithi155.stdout: "duration": 0.069286118999999993, 2023-08-01T19:56:30.730 INFO:teuthology.orchestra.run.smithi155.stdout: "type_data": { 2023-08-01T19:56:30.730 INFO:teuthology.orchestra.run.smithi155.stdout: "flag_point": "commit sent; apply or cleanup", 2023-08-01T19:56:30.730 INFO:teuthology.orchestra.run.smithi155.stdout: "client_info": { 2023-08-01T19:56:30.731 INFO:teuthology.orchestra.run.smithi155.stdout: "client": "client.4668", 2023-08-01T19:56:30.731 INFO:teuthology.orchestra.run.smithi155.stdout: "client_addr": "172.21.15.6:0/1709472247", 2023-08-01T19:56:30.731 INFO:teuthology.orchestra.run.smithi155.stdout: "tid": 100249 2023-08-01T19:56:30.731 INFO:teuthology.orchestra.run.smithi155.stdout: }, 2023-08-01T19:56:30.731 INFO:teuthology.orchestra.run.smithi155.stdout: "events": [ 2023-08-01T19:56:30.731 INFO:teuthology.orchestra.run.smithi155.stdout: { 2023-08-01T19:56:30.731 INFO:teuthology.orchestra.run.smithi155.stdout: "event": "initiated", 2023-08-01T19:56:30.731 INFO:teuthology.orchestra.run.smithi155.stdout: "time": "2023-08-01T19:55:05.153614+0000", 2023-08-01T19:56:30.732 INFO:teuthology.orchestra.run.smithi155.stdout: "duration": 0 2023-08-01T19:56:30.732 INFO:teuthology.orchestra.run.smithi155.stdout: }, 2023-08-01T19:56:30.732 INFO:teuthology.orchestra.run.smithi155.stdout: { 2023-08-01T19:56:30.732 INFO:teuthology.orchestra.run.smithi155.stdout: "event": "throttled", 2023-08-01T19:56:30.732 INFO:teuthology.orchestra.run.smithi155.stdout: "time": "2023-08-01T19:55:05.153614+0000", 2023-08-01T19:56:30.732 INFO:teuthology.orchestra.run.smithi155.stdout: "duration": 0 2023-08-01T19:56:30.732 INFO:teuthology.orchestra.run.smithi155.stdout: }, 2023-08-01T19:56:30.733 INFO:teuthology.orchestra.run.smithi155.stdout: { 2023-08-01T19:56:30.733 INFO:teuthology.orchestra.run.smithi155.stdout: "event": "header_read", 2023-08-01T19:56:30.733 INFO:teuthology.orchestra.run.smithi155.stdout: "time": "2023-08-01T19:55:05.153612+0000", 2023-08-01T19:56:30.733 INFO:teuthology.orchestra.run.smithi155.stdout: "duration": 4294967295.9999986 2023-08-01T19:56:30.733 INFO:teuthology.orchestra.run.smithi155.stdout: }, 2023-08-01T19:56:30.733 INFO:teuthology.orchestra.run.smithi155.stdout: { 2023-08-01T19:56:30.733 INFO:teuthology.orchestra.run.smithi155.stdout: "event": "all_read", 2023-08-01T19:56:30.733 INFO:teuthology.orchestra.run.smithi155.stdout: "time": "2023-08-01T19:55:05.153694+0000", 2023-08-01T19:56:30.734 INFO:teuthology.orchestra.run.smithi155.stdout: "duration": 8.1618000000000004e-05 2023-08-01T19:56:30.734 INFO:teuthology.orchestra.run.smithi155.stdout: }, 2023-08-01T19:56:30.734 INFO:teuthology.orchestra.run.smithi155.stdout: { 2023-08-01T19:56:30.734 INFO:teuthology.orchestra.run.smithi155.stdout: "event": "dispatched", 2023-08-01T19:56:30.734 INFO:teuthology.orchestra.run.smithi155.stdout: "time": "2023-08-01T19:55:05.153713+0000", 2023-08-01T19:56:30.734 INFO:teuthology.orchestra.run.smithi155.stdout: "duration": 1.9069999999999999e-05 2023-08-01T19:56:30.734 INFO:teuthology.orchestra.run.smithi155.stdout: }, 2023-08-01T19:56:30.734 INFO:teuthology.orchestra.run.smithi155.stdout: { 2023-08-01T19:56:30.735 INFO:teuthology.orchestra.run.smithi155.stdout: "event": "queued_for_pg", 2023-08-01T19:56:30.735 INFO:teuthology.orchestra.run.smithi155.stdout: "time": "2023-08-01T19:55:05.153726+0000", 2023-08-01T19:56:30.735 INFO:teuthology.orchestra.run.smithi155.stdout: "duration": 1.238e-05 2023-08-01T19:56:30.735 INFO:teuthology.orchestra.run.smithi155.stdout: }, 2023-08-01T19:56:30.735 INFO:teuthology.orchestra.run.smithi155.stdout: { 2023-08-01T19:56:30.735 INFO:teuthology.orchestra.run.smithi155.stdout: "event": "reached_pg", 2023-08-01T19:56:30.735 INFO:teuthology.orchestra.run.smithi155.stdout: "time": "2023-08-01T19:55:05.153761+0000", 2023-08-01T19:56:30.735 INFO:teuthology.orchestra.run.smithi155.stdout: "duration": 3.5046999999999998e-05 2023-08-01T19:56:30.736 INFO:teuthology.orchestra.run.smithi155.stdout: }, 2023-08-01T19:56:30.736 INFO:teuthology.orchestra.run.smithi155.stdout: { 2023-08-01T19:56:30.736 INFO:teuthology.orchestra.run.smithi155.stdout: "event": "started", 2023-08-01T19:56:30.736 INFO:teuthology.orchestra.run.smithi155.stdout: "time": "2023-08-01T19:55:05.153896+0000", 2023-08-01T19:56:30.736 INFO:teuthology.orchestra.run.smithi155.stdout: "duration": 0.00013575800000000001 2023-08-01T19:56:30.736 INFO:teuthology.orchestra.run.smithi155.stdout: }, 2023-08-01T19:56:30.736 INFO:teuthology.orchestra.run.smithi155.stdout: { 2023-08-01T19:56:30.737 INFO:teuthology.orchestra.run.smithi155.stdout: "event": "waiting for subops from 0", 2023-08-01T19:56:30.737 INFO:teuthology.orchestra.run.smithi155.stdout: "time": "2023-08-01T19:55:05.154043+0000", 2023-08-01T19:56:30.737 INFO:teuthology.orchestra.run.smithi155.stdout: "duration": 0.00014650700000000001 2023-08-01T19:56:30.737 INFO:teuthology.orchestra.run.smithi155.stdout: }, 2023-08-01T19:56:30.737 INFO:teuthology.orchestra.run.smithi155.stdout: { 2023-08-01T19:56:30.737 INFO:teuthology.orchestra.run.smithi155.stdout: "event": "sub_op_commit_rec", 2023-08-01T19:56:30.737 INFO:teuthology.orchestra.run.smithi155.stdout: "time": "2023-08-01T19:55:05.221876+0000", 2023-08-01T19:56:30.738 INFO:teuthology.orchestra.run.smithi155.stdout: "duration": 0.067832796000000001 2023-08-01T19:56:30.738 INFO:teuthology.orchestra.run.smithi155.stdout: }, 2023-08-01T19:56:30.738 INFO:teuthology.orchestra.run.smithi155.stdout: { 2023-08-01T19:56:30.738 INFO:teuthology.orchestra.run.smithi155.stdout: "event": "op_commit", 2023-08-01T19:56:30.738 INFO:teuthology.orchestra.run.smithi155.stdout: "time": "2023-08-01T19:55:05.222813+0000", 2023-08-01T19:56:30.738 INFO:teuthology.orchestra.run.smithi155.stdout: "duration": 0.00093755300000000004 2023-08-01T19:56:30.738 INFO:teuthology.orchestra.run.smithi155.stdout: }, 2023-08-01T19:56:30.738 INFO:teuthology.orchestra.run.smithi155.stdout: { 2023-08-01T19:56:30.739 INFO:teuthology.orchestra.run.smithi155.stdout: "event": "commit_sent", 2023-08-01T19:56:30.739 INFO:teuthology.orchestra.run.smithi155.stdout: "time": "2023-08-01T19:55:05.222861+0000", 2023-08-01T19:56:30.739 INFO:teuthology.orchestra.run.smithi155.stdout: "duration": 4.8013999999999998e-05 2023-08-01T19:56:30.739 INFO:teuthology.orchestra.run.smithi155.stdout: }, 2023-08-01T19:56:30.739 INFO:teuthology.orchestra.run.smithi155.stdout: { 2023-08-01T19:56:30.739 INFO:teuthology.orchestra.run.smithi155.stdout: "event": "done", 2023-08-01T19:56:30.739 INFO:teuthology.orchestra.run.smithi155.stdout: "time": "2023-08-01T19:55:05.222900+0000", 2023-08-01T19:56:30.739 INFO:teuthology.orchestra.run.smithi155.stdout: "duration": 3.8634999999999999e-05 2023-08-01T19:56:30.740 INFO:teuthology.orchestra.run.smithi155.stdout: } 2023-08-01T19:56:30.740 INFO:teuthology.orchestra.run.smithi155.stdout: ] 2023-08-01T19:56:30.740 INFO:teuthology.orchestra.run.smithi155.stdout: } 2023-08-01T19:56:30.740 INFO:teuthology.orchestra.run.smithi155.stdout: }, 2023-08-01T19:56:30.740 INFO:teuthology.orchestra.run.smithi155.stdout: { 2023-08-01T19:56:30.740 INFO:teuthology.orchestra.run.smithi155.stdout: "description": "osd_op(client.4668.0:100251 5.b 5:d853df24:::benchmark_data_smithi006_114134_object100250:head [set-alloc-hint object_size 65536 write_size 65536,write 0~65536] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e37)", 2023-08-01T19:56:30.740 INFO:teuthology.orchestra.run.smithi155.stdout: "initiated_at": "2023-08-01T19:55:05.153737+0000", 2023-08-01T19:56:30.740 INFO:teuthology.orchestra.run.smithi155.stdout: "age": 85.516732504000004, 2023-08-01T19:56:30.741 INFO:teuthology.orchestra.run.smithi155.stdout: "duration": 0.071366545000000003, 2023-08-01T19:56:30.741 INFO:teuthology.orchestra.run.smithi155.stdout: "type_data": { 2023-08-01T19:56:30.741 INFO:teuthology.orchestra.run.smithi155.stdout: "flag_point": "commit sent; apply or cleanup", 2023-08-01T19:56:30.741 INFO:teuthology.orchestra.run.smithi155.stdout: "client_info": { 2023-08-01T19:56:30.741 INFO:teuthology.orchestra.run.smithi155.stdout: "client": "client.4668", 2023-08-01T19:56:30.741 INFO:teuthology.orchestra.run.smithi155.stdout: "client_addr": "172.21.15.6:0/1709472247", 2023-08-01T19:56:30.741 INFO:teuthology.orchestra.run.smithi155.stdout: "tid": 100251 2023-08-01T19:56:30.741 INFO:teuthology.orchestra.run.smithi155.stdout: }, 2023-08-01T19:56:30.742 INFO:teuthology.orchestra.run.smithi155.stdout: "events": [ 2023-08-01T19:56:30.742 INFO:teuthology.orchestra.run.smithi155.stdout: { 2023-08-01T19:56:30.742 INFO:teuthology.orchestra.run.smithi155.stdout: "event": "initiated", 2023-08-01T19:56:30.742 INFO:teuthology.orchestra.run.smithi155.stdout: "time": "2023-08-01T19:55:05.153737+0000", 2023-08-01T19:56:30.742 INFO:teuthology.orchestra.run.smithi155.stdout: "duration": 0 2023-08-01T19:56:30.742 INFO:teuthology.orchestra.run.smithi155.stdout: }, 2023-08-01T19:56:30.742 INFO:teuthology.orchestra.run.smithi155.stdout: { 2023-08-01T19:56:30.743 INFO:teuthology.orchestra.run.smithi155.stdout: "event": "throttled", 2023-08-01T19:56:30.743 INFO:teuthology.orchestra.run.smithi155.stdout: "time": "2023-08-01T19:55:05.153737+0000", 2023-08-01T19:56:30.743 INFO:teuthology.orchestra.run.smithi155.stdout: "duration": 0 2023-08-01T19:56:30.743 INFO:teuthology.orchestra.run.smithi155.stdout: }, 2023-08-01T19:56:30.743 INFO:teuthology.orchestra.run.smithi155.stdout: { 2023-08-01T19:56:30.743 INFO:teuthology.orchestra.run.smithi155.stdout: "event": "header_read", 2023-08-01T19:56:30.743 INFO:teuthology.orchestra.run.smithi155.stdout: "time": "2023-08-01T19:55:05.153736+0000", 2023-08-01T19:56:30.743 INFO:teuthology.orchestra.run.smithi155.stdout: "duration": 4294967295.9999995 2023-08-01T19:56:30.744 INFO:teuthology.orchestra.run.smithi155.stdout: }, 2023-08-01T19:56:30.744 INFO:teuthology.orchestra.run.smithi155.stdout: { 2023-08-01T19:56:30.744 INFO:teuthology.orchestra.run.smithi155.stdout: "event": "all_read", 2023-08-01T19:56:30.744 INFO:teuthology.orchestra.run.smithi155.stdout: "time": "2023-08-01T19:55:05.153784+0000", 2023-08-01T19:56:30.744 INFO:teuthology.orchestra.run.smithi155.stdout: "duration": 4.7660000000000001e-05 2023-08-01T19:56:30.744 INFO:teuthology.orchestra.run.smithi155.stdout: }, 2023-08-01T19:56:30.744 INFO:teuthology.orchestra.run.smithi155.stdout: { 2023-08-01T19:56:30.744 INFO:teuthology.orchestra.run.smithi155.stdout: "event": "dispatched", 2023-08-01T19:56:30.745 INFO:teuthology.orchestra.run.smithi155.stdout: "time": "2023-08-01T19:55:05.153793+0000", 2023-08-01T19:56:30.745 INFO:teuthology.orchestra.run.smithi155.stdout: "duration": 8.7150000000000004e-06 2023-08-01T19:56:30.745 INFO:teuthology.orchestra.run.smithi155.stdout: }, 2023-08-01T19:56:30.745 INFO:teuthology.orchestra.run.smithi155.stdout: { 2023-08-01T19:56:30.745 INFO:teuthology.orchestra.run.smithi155.stdout: "event": "queued_for_pg", 2023-08-01T19:56:30.745 INFO:teuthology.orchestra.run.smithi155.stdout: "time": "2023-08-01T19:55:05.153800+0000", 2023-08-01T19:56:30.745 INFO:teuthology.orchestra.run.smithi155.stdout: "duration": 7.2459999999999997e-06 2023-08-01T19:56:30.745 INFO:teuthology.orchestra.run.smithi155.stdout: }, 2023-08-01T19:56:30.746 INFO:teuthology.orchestra.run.smithi155.stdout: { 2023-08-01T19:56:30.746 INFO:teuthology.orchestra.run.smithi155.stdout: "event": "reached_pg", 2023-08-01T19:56:30.746 INFO:teuthology.orchestra.run.smithi155.stdout: "time": "2023-08-01T19:55:05.156241+0000", 2023-08-01T19:56:30.746 INFO:teuthology.orchestra.run.smithi155.stdout: "duration": 0.0024415359999999998 2023-08-01T19:56:30.746 INFO:teuthology.orchestra.run.smithi155.stdout: }, 2023-08-01T19:56:30.746 INFO:teuthology.orchestra.run.smithi155.stdout: { 2023-08-01T19:56:30.746 INFO:teuthology.orchestra.run.smithi155.stdout: "event": "started", 2023-08-01T19:56:30.746 INFO:teuthology.orchestra.run.smithi155.stdout: "time": "2023-08-01T19:55:05.219045+0000", 2023-08-01T19:56:30.747 INFO:teuthology.orchestra.run.smithi155.stdout: "duration": 0.062803855000000006 2023-08-01T19:56:30.747 INFO:teuthology.orchestra.run.smithi155.stdout: }, 2023-08-01T19:56:30.747 INFO:teuthology.orchestra.run.smithi155.stdout: { 2023-08-01T19:56:30.747 INFO:teuthology.orchestra.run.smithi155.stdout: "event": "waiting for subops from 0", 2023-08-01T19:56:30.747 INFO:teuthology.orchestra.run.smithi155.stdout: "time": "2023-08-01T19:55:05.219238+0000", 2023-08-01T19:56:30.747 INFO:teuthology.orchestra.run.smithi155.stdout: "duration": 0.00019241500000000001 2023-08-01T19:56:30.747 INFO:teuthology.orchestra.run.smithi155.stdout: }, 2023-08-01T19:56:30.748 INFO:teuthology.orchestra.run.smithi155.stdout: { 2023-08-01T19:56:30.748 INFO:teuthology.orchestra.run.smithi155.stdout: "event": "sub_op_commit_rec", 2023-08-01T19:56:30.748 INFO:teuthology.orchestra.run.smithi155.stdout: "time": "2023-08-01T19:55:05.223300+0000", 2023-08-01T19:56:30.748 INFO:teuthology.orchestra.run.smithi155.stdout: "duration": 0.0040626509999999996 2023-08-01T19:56:30.748 INFO:teuthology.orchestra.run.smithi155.stdout: }, 2023-08-01T19:56:30.748 INFO:teuthology.orchestra.run.smithi155.stdout: { 2023-08-01T19:56:30.748 INFO:teuthology.orchestra.run.smithi155.stdout: "event": "op_commit", 2023-08-01T19:56:30.748 INFO:teuthology.orchestra.run.smithi155.stdout: "time": "2023-08-01T19:55:05.225020+0000", 2023-08-01T19:56:30.749 INFO:teuthology.orchestra.run.smithi155.stdout: "duration": 0.0017201 2023-08-01T19:56:30.749 INFO:teuthology.orchestra.run.smithi155.stdout: }, 2023-08-01T19:56:30.749 INFO:teuthology.orchestra.run.smithi155.stdout: { 2023-08-01T19:56:30.749 INFO:teuthology.orchestra.run.smithi155.stdout: "event": "commit_sent", 2023-08-01T19:56:30.749 INFO:teuthology.orchestra.run.smithi155.stdout: "time": "2023-08-01T19:55:05.225066+0000", 2023-08-01T19:56:30.749 INFO:teuthology.orchestra.run.smithi155.stdout: "duration": 4.6143000000000002e-05 2023-08-01T19:56:30.749 INFO:teuthology.orchestra.run.smithi155.stdout: }, 2023-08-01T19:56:30.749 INFO:teuthology.orchestra.run.smithi155.stdout: { 2023-08-01T19:56:30.750 INFO:teuthology.orchestra.run.smithi155.stdout: "event": "done", 2023-08-01T19:56:30.750 INFO:teuthology.orchestra.run.smithi155.stdout: "time": "2023-08-01T19:55:05.225103+0000", 2023-08-01T19:56:30.750 INFO:teuthology.orchestra.run.smithi155.stdout: "duration": 3.6789999999999998e-05 2023-08-01T19:56:30.750 INFO:teuthology.orchestra.run.smithi155.stdout: } 2023-08-01T19:56:30.750 INFO:teuthology.orchestra.run.smithi155.stdout: ] 2023-08-01T19:56:30.750 INFO:teuthology.orchestra.run.smithi155.stdout: } 2023-08-01T19:56:30.750 INFO:teuthology.orchestra.run.smithi155.stdout: }, 2023-08-01T19:56:30.751 INFO:teuthology.orchestra.run.smithi155.stdout: { 2023-08-01T19:56:30.751 INFO:teuthology.orchestra.run.smithi155.stdout: "description": "osd_op(client.4668.0:100252 5.0 5:01f90c3c:::benchmark_data_smithi006_114134_object100251:head [set-alloc-hint object_size 65536 write_size 65536,write 0~65536] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e37)", 2023-08-01T19:56:30.751 INFO:teuthology.orchestra.run.smithi155.stdout: "initiated_at": "2023-08-01T19:55:05.154048+0000", 2023-08-01T19:56:30.751 INFO:teuthology.orchestra.run.smithi155.stdout: "age": 85.516421257000005, 2023-08-01T19:56:30.751 INFO:teuthology.orchestra.run.smithi155.stdout: "duration": 0.070156683999999997, 2023-08-01T19:56:30.751 INFO:teuthology.orchestra.run.smithi155.stdout: "type_data": { 2023-08-01T19:56:30.751 INFO:teuthology.orchestra.run.smithi155.stdout: "flag_point": "commit sent; apply or cleanup", 2023-08-01T19:56:30.751 INFO:teuthology.orchestra.run.smithi155.stdout: "client_info": { 2023-08-01T19:56:30.752 INFO:teuthology.orchestra.run.smithi155.stdout: "client": "client.4668", 2023-08-01T19:56:30.752 INFO:teuthology.orchestra.run.smithi155.stdout: "client_addr": "172.21.15.6:0/1709472247", 2023-08-01T19:56:30.752 INFO:teuthology.orchestra.run.smithi155.stdout: "tid": 100252 2023-08-01T19:56:30.752 INFO:teuthology.orchestra.run.smithi155.stdout: }, 2023-08-01T19:56:30.752 INFO:teuthology.orchestra.run.smithi155.stdout: "events": [ 2023-08-01T19:56:30.752 INFO:teuthology.orchestra.run.smithi155.stdout: { 2023-08-01T19:56:30.752 INFO:teuthology.orchestra.run.smithi155.stdout: "event": "initiated", 2023-08-01T19:56:30.753 INFO:teuthology.orchestra.run.smithi155.stdout: "time": "2023-08-01T19:55:05.154048+0000", 2023-08-01T19:56:30.753 INFO:teuthology.orchestra.run.smithi155.stdout: "duration": 0 2023-08-01T19:56:30.753 INFO:teuthology.orchestra.run.smithi155.stdout: }, 2023-08-01T19:56:30.753 INFO:teuthology.orchestra.run.smithi155.stdout: { 2023-08-01T19:56:30.753 INFO:teuthology.orchestra.run.smithi155.stdout: "event": "throttled", 2023-08-01T19:56:30.753 INFO:teuthology.orchestra.run.smithi155.stdout: "time": "2023-08-01T19:55:05.154048+0000", 2023-08-01T19:56:30.753 INFO:teuthology.orchestra.run.smithi155.stdout: "duration": 0 2023-08-01T19:56:30.753 INFO:teuthology.orchestra.run.smithi155.stdout: }, 2023-08-01T19:56:30.754 INFO:teuthology.orchestra.run.smithi155.stdout: { 2023-08-01T19:56:30.754 INFO:teuthology.orchestra.run.smithi155.stdout: "event": "header_read", 2023-08-01T19:56:30.754 INFO:teuthology.orchestra.run.smithi155.stdout: "time": "2023-08-01T19:55:05.154047+0000", 2023-08-01T19:56:30.754 INFO:teuthology.orchestra.run.smithi155.stdout: "duration": 4294967295.999999 2023-08-01T19:56:30.754 INFO:teuthology.orchestra.run.smithi155.stdout: }, 2023-08-01T19:56:30.754 INFO:teuthology.orchestra.run.smithi155.stdout: { 2023-08-01T19:56:30.754 INFO:teuthology.orchestra.run.smithi155.stdout: "event": "all_read", 2023-08-01T19:56:30.754 INFO:teuthology.orchestra.run.smithi155.stdout: "time": "2023-08-01T19:55:05.154115+0000", 2023-08-01T19:56:30.755 INFO:teuthology.orchestra.run.smithi155.stdout: "duration": 6.7545999999999993e-05 2023-08-01T19:56:30.755 INFO:teuthology.orchestra.run.smithi155.stdout: }, 2023-08-01T19:56:30.755 INFO:teuthology.orchestra.run.smithi155.stdout: { 2023-08-01T19:56:30.755 INFO:teuthology.orchestra.run.smithi155.stdout: "event": "dispatched", 2023-08-01T19:56:30.755 INFO:teuthology.orchestra.run.smithi155.stdout: "time": "2023-08-01T19:55:05.154125+0000", 2023-08-01T19:56:30.755 INFO:teuthology.orchestra.run.smithi155.stdout: "duration": 1.0669000000000001e-05 2023-08-01T19:56:30.755 INFO:teuthology.orchestra.run.smithi155.stdout: }, 2023-08-01T19:56:30.755 INFO:teuthology.orchestra.run.smithi155.stdout: { 2023-08-01T19:56:30.756 INFO:teuthology.orchestra.run.smithi155.stdout: "event": "queued_for_pg", 2023-08-01T19:56:30.756 INFO:teuthology.orchestra.run.smithi155.stdout: "time": "2023-08-01T19:55:05.154131+0000", 2023-08-01T19:56:30.756 INFO:teuthology.orchestra.run.smithi155.stdout: "duration": 6.0349999999999998e-06 2023-08-01T19:56:30.756 INFO:teuthology.orchestra.run.smithi155.stdout: }, 2023-08-01T19:56:30.756 INFO:teuthology.orchestra.run.smithi155.stdout: { 2023-08-01T19:56:30.756 INFO:teuthology.orchestra.run.smithi155.stdout: "event": "reached_pg", 2023-08-01T19:56:30.756 INFO:teuthology.orchestra.run.smithi155.stdout: "time": "2023-08-01T19:55:05.154174+0000", 2023-08-01T19:56:30.756 INFO:teuthology.orchestra.run.smithi155.stdout: "duration": 4.2429000000000003e-05 2023-08-01T19:56:30.757 INFO:teuthology.orchestra.run.smithi155.stdout: }, 2023-08-01T19:56:30.757 INFO:teuthology.orchestra.run.smithi155.stdout: { 2023-08-01T19:56:30.757 INFO:teuthology.orchestra.run.smithi155.stdout: "event": "started", 2023-08-01T19:56:30.757 INFO:teuthology.orchestra.run.smithi155.stdout: "time": "2023-08-01T19:55:05.154287+0000", 2023-08-01T19:56:30.757 INFO:teuthology.orchestra.run.smithi155.stdout: "duration": 0.000113138 2023-08-01T19:56:30.757 INFO:teuthology.orchestra.run.smithi155.stdout: }, 2023-08-01T19:56:30.757 INFO:teuthology.orchestra.run.smithi155.stdout: { 2023-08-01T19:56:30.758 INFO:teuthology.orchestra.run.smithi155.stdout: "event": "waiting for subops from 0", 2023-08-01T19:56:30.758 INFO:teuthology.orchestra.run.smithi155.stdout: "time": "2023-08-01T19:55:05.154420+0000", 2023-08-01T19:56:30.758 INFO:teuthology.orchestra.run.smithi155.stdout: "duration": 0.000133292 2023-08-01T19:56:30.758 INFO:teuthology.orchestra.run.smithi155.stdout: }, 2023-08-01T19:56:30.758 INFO:teuthology.orchestra.run.smithi155.stdout: { 2023-08-01T19:56:30.758 INFO:teuthology.orchestra.run.smithi155.stdout: "event": "sub_op_commit_rec", 2023-08-01T19:56:30.758 INFO:teuthology.orchestra.run.smithi155.stdout: "time": "2023-08-01T19:55:05.219034+0000", 2023-08-01T19:56:30.758 INFO:teuthology.orchestra.run.smithi155.stdout: "duration": 0.064613429999999999 2023-08-01T19:56:30.759 INFO:teuthology.orchestra.run.smithi155.stdout: }, 2023-08-01T19:56:30.759 INFO:teuthology.orchestra.run.smithi155.stdout: { 2023-08-01T19:56:30.759 INFO:teuthology.orchestra.run.smithi155.stdout: "event": "op_commit", 2023-08-01T19:56:30.759 INFO:teuthology.orchestra.run.smithi155.stdout: "time": "2023-08-01T19:55:05.224138+0000", 2023-08-01T19:56:30.759 INFO:teuthology.orchestra.run.smithi155.stdout: "duration": 0.0051041999999999997 2023-08-01T19:56:30.759 INFO:teuthology.orchestra.run.smithi155.stdout: }, 2023-08-01T19:56:30.759 INFO:teuthology.orchestra.run.smithi155.stdout: { 2023-08-01T19:56:30.759 INFO:teuthology.orchestra.run.smithi155.stdout: "event": "commit_sent", 2023-08-01T19:56:30.760 INFO:teuthology.orchestra.run.smithi155.stdout: "time": "2023-08-01T19:55:05.224171+0000", 2023-08-01T19:56:30.760 INFO:teuthology.orchestra.run.smithi155.stdout: "duration": 3.3345e-05 2023-08-01T19:56:30.760 INFO:teuthology.orchestra.run.smithi155.stdout: }, 2023-08-01T19:56:30.760 INFO:teuthology.orchestra.run.smithi155.stdout: { 2023-08-01T19:56:30.760 INFO:teuthology.orchestra.run.smithi155.stdout: "event": "done", 2023-08-01T19:56:30.760 INFO:teuthology.orchestra.run.smithi155.stdout: "time": "2023-08-01T19:55:05.224205+0000", 2023-08-01T19:56:30.760 INFO:teuthology.orchestra.run.smithi155.stdout: "duration": 3.3525999999999997e-05 2023-08-01T19:56:30.760 INFO:teuthology.orchestra.run.smithi155.stdout: } 2023-08-01T19:56:30.761 INFO:teuthology.orchestra.run.smithi155.stdout: ] 2023-08-01T19:56:30.761 INFO:teuthology.orchestra.run.smithi155.stdout: } 2023-08-01T19:56:30.761 INFO:teuthology.orchestra.run.smithi155.stdout: }, 2023-08-01T19:56:30.761 INFO:teuthology.orchestra.run.smithi155.stdout: { 2023-08-01T19:56:30.761 INFO:teuthology.orchestra.run.smithi155.stdout: "description": "osd_repop_reply(client.4668.0:100237 5.4 e37/19 ondisk, result = 0)", 2023-08-01T19:56:30.761 INFO:teuthology.orchestra.run.smithi155.stdout: "initiated_at": "2023-08-01T19:55:05.156249+0000", 2023-08-01T19:56:30.761 INFO:teuthology.orchestra.run.smithi155.stdout: "age": 85.514220312000006, 2023-08-01T19:56:30.761 INFO:teuthology.orchestra.run.smithi155.stdout: "duration": 0.062792549000000003, 2023-08-01T19:56:30.762 INFO:teuthology.orchestra.run.smithi155.stdout: "type_data": { 2023-08-01T19:56:30.762 INFO:teuthology.orchestra.run.smithi155.stdout: "flag_point": "started", 2023-08-01T19:56:30.762 INFO:teuthology.orchestra.run.smithi155.stdout: "events": [ 2023-08-01T19:56:30.762 INFO:teuthology.orchestra.run.smithi155.stdout: { 2023-08-01T19:56:30.762 INFO:teuthology.orchestra.run.smithi155.stdout: "event": "initiated", 2023-08-01T19:56:30.762 INFO:teuthology.orchestra.run.smithi155.stdout: "time": "2023-08-01T19:55:05.156249+0000", 2023-08-01T19:56:30.762 INFO:teuthology.orchestra.run.smithi155.stdout: "duration": 0 2023-08-01T19:56:30.762 INFO:teuthology.orchestra.run.smithi155.stdout: }, 2023-08-01T19:56:30.763 INFO:teuthology.orchestra.run.smithi155.stdout: { 2023-08-01T19:56:30.763 INFO:teuthology.orchestra.run.smithi155.stdout: "event": "throttled", 2023-08-01T19:56:30.763 INFO:teuthology.orchestra.run.smithi155.stdout: "time": "2023-08-01T19:55:05.156249+0000", 2023-08-01T19:56:30.763 INFO:teuthology.orchestra.run.smithi155.stdout: "duration": 0 2023-08-01T19:56:30.763 INFO:teuthology.orchestra.run.smithi155.stdout: }, 2023-08-01T19:56:30.763 INFO:teuthology.orchestra.run.smithi155.stdout: { 2023-08-01T19:56:30.763 INFO:teuthology.orchestra.run.smithi155.stdout: "event": "header_read", 2023-08-01T19:56:30.763 INFO:teuthology.orchestra.run.smithi155.stdout: "time": "2023-08-01T19:55:05.156248+0000", 2023-08-01T19:56:30.764 INFO:teuthology.orchestra.run.smithi155.stdout: "duration": 4294967295.9999995 2023-08-01T19:56:30.764 INFO:teuthology.orchestra.run.smithi155.stdout: }, 2023-08-01T19:56:30.764 INFO:teuthology.orchestra.run.smithi155.stdout: { 2023-08-01T19:56:30.764 INFO:teuthology.orchestra.run.smithi155.stdout: "event": "all_read", 2023-08-01T19:56:30.764 INFO:teuthology.orchestra.run.smithi155.stdout: "time": "2023-08-01T19:55:05.156252+0000", 2023-08-01T19:56:30.764 INFO:teuthology.orchestra.run.smithi155.stdout: "duration": 3.9999999999999998e-06 2023-08-01T19:56:30.764 INFO:teuthology.orchestra.run.smithi155.stdout: }, 2023-08-01T19:56:30.764 INFO:teuthology.orchestra.run.smithi155.stdout: { 2023-08-01T19:56:30.765 INFO:teuthology.orchestra.run.smithi155.stdout: "event": "dispatched", 2023-08-01T19:56:30.765 INFO:teuthology.orchestra.run.smithi155.stdout: "time": "2023-08-01T19:55:05.218844+0000", 2023-08-01T19:56:30.765 INFO:teuthology.orchestra.run.smithi155.stdout: "duration": 0.062591516999999999 2023-08-01T19:56:30.765 INFO:teuthology.orchestra.run.smithi155.stdout: }, 2023-08-01T19:56:30.765 INFO:teuthology.orchestra.run.smithi155.stdout: { 2023-08-01T19:56:30.765 INFO:teuthology.orchestra.run.smithi155.stdout: "event": "queued_for_pg", 2023-08-01T19:56:30.765 INFO:teuthology.orchestra.run.smithi155.stdout: "time": "2023-08-01T19:55:05.218862+0000", 2023-08-01T19:56:30.765 INFO:teuthology.orchestra.run.smithi155.stdout: "duration": 1.7666e-05 2023-08-01T19:56:30.766 INFO:teuthology.orchestra.run.smithi155.stdout: }, 2023-08-01T19:56:30.766 INFO:teuthology.orchestra.run.smithi155.stdout: { 2023-08-01T19:56:30.766 INFO:teuthology.orchestra.run.smithi155.stdout: "event": "reached_pg", 2023-08-01T19:56:30.766 INFO:teuthology.orchestra.run.smithi155.stdout: "time": "2023-08-01T19:55:05.218914+0000", 2023-08-01T19:56:30.766 INFO:teuthology.orchestra.run.smithi155.stdout: "duration": 5.2565999999999998e-05 2023-08-01T19:56:30.766 INFO:teuthology.orchestra.run.smithi155.stdout: }, 2023-08-01T19:56:30.766 INFO:teuthology.orchestra.run.smithi155.stdout: { 2023-08-01T19:56:30.766 INFO:teuthology.orchestra.run.smithi155.stdout: "event": "started", 2023-08-01T19:56:30.767 INFO:teuthology.orchestra.run.smithi155.stdout: "time": "2023-08-01T19:55:05.218925+0000", 2023-08-01T19:56:30.767 INFO:teuthology.orchestra.run.smithi155.stdout: "duration": 1.1375e-05 2023-08-01T19:56:30.767 INFO:teuthology.orchestra.run.smithi155.stdout: }, 2023-08-01T19:56:30.767 INFO:teuthology.orchestra.run.smithi155.stdout: { 2023-08-01T19:56:30.767 INFO:teuthology.orchestra.run.smithi155.stdout: "event": "done", 2023-08-01T19:56:30.767 INFO:teuthology.orchestra.run.smithi155.stdout: "time": "2023-08-01T19:55:05.219041+0000", 2023-08-01T19:56:30.767 INFO:teuthology.orchestra.run.smithi155.stdout: "duration": 0.000115977 2023-08-01T19:56:30.768 INFO:teuthology.orchestra.run.smithi155.stdout: } 2023-08-01T19:56:30.768 INFO:teuthology.orchestra.run.smithi155.stdout: ] 2023-08-01T19:56:30.768 INFO:teuthology.orchestra.run.smithi155.stdout: } 2023-08-01T19:56:30.768 INFO:teuthology.orchestra.run.smithi155.stdout: }, 2023-08-01T19:56:30.768 INFO:teuthology.orchestra.run.smithi155.stdout: { 2023-08-01T19:56:30.768 INFO:teuthology.orchestra.run.smithi155.stdout: "description": "osd_repop(client.4668.0:100253 5.f e37/19 5:f7bbce05:::benchmark_data_smithi006_114134_object100252:head v 37'6323, mlcod=37'6321)", 2023-08-01T19:56:30.768 INFO:teuthology.orchestra.run.smithi155.stdout: "initiated_at": "2023-08-01T19:55:05.156952+0000", 2023-08-01T19:56:30.768 INFO:teuthology.orchestra.run.smithi155.stdout: "age": 85.513517249000003, 2023-08-01T19:56:30.769 INFO:teuthology.orchestra.run.smithi155.stdout: "duration": 0.068018577999999996, 2023-08-01T19:56:30.769 INFO:teuthology.orchestra.run.smithi155.stdout: "type_data": { 2023-08-01T19:56:30.769 INFO:teuthology.orchestra.run.smithi155.stdout: "flag_point": "commit sent; apply or cleanup", 2023-08-01T19:56:30.769 INFO:teuthology.orchestra.run.smithi155.stdout: "events": [ 2023-08-01T19:56:30.769 INFO:teuthology.orchestra.run.smithi155.stdout: { 2023-08-01T19:56:30.769 INFO:teuthology.orchestra.run.smithi155.stdout: "event": "initiated", 2023-08-01T19:56:30.769 INFO:teuthology.orchestra.run.smithi155.stdout: "time": "2023-08-01T19:55:05.156952+0000", 2023-08-01T19:56:30.769 INFO:teuthology.orchestra.run.smithi155.stdout: "duration": 0 2023-08-01T19:56:30.770 INFO:teuthology.orchestra.run.smithi155.stdout: }, 2023-08-01T19:56:30.770 INFO:teuthology.orchestra.run.smithi155.stdout: { 2023-08-01T19:56:30.770 INFO:teuthology.orchestra.run.smithi155.stdout: "event": "throttled", 2023-08-01T19:56:30.770 INFO:teuthology.orchestra.run.smithi155.stdout: "time": "2023-08-01T19:55:05.156952+0000", 2023-08-01T19:56:30.770 INFO:teuthology.orchestra.run.smithi155.stdout: "duration": 0 2023-08-01T19:56:30.770 INFO:teuthology.orchestra.run.smithi155.stdout: }, 2023-08-01T19:56:30.770 INFO:teuthology.orchestra.run.smithi155.stdout: { 2023-08-01T19:56:30.771 INFO:teuthology.orchestra.run.smithi155.stdout: "event": "header_read", 2023-08-01T19:56:30.771 INFO:teuthology.orchestra.run.smithi155.stdout: "time": "2023-08-01T19:55:05.156951+0000", 2023-08-01T19:56:30.771 INFO:teuthology.orchestra.run.smithi155.stdout: "duration": 4294967295.999999 2023-08-01T19:56:30.771 INFO:teuthology.orchestra.run.smithi155.stdout: }, 2023-08-01T19:56:30.771 INFO:teuthology.orchestra.run.smithi155.stdout: { 2023-08-01T19:56:30.771 INFO:teuthology.orchestra.run.smithi155.stdout: "event": "all_read", 2023-08-01T19:56:30.771 INFO:teuthology.orchestra.run.smithi155.stdout: "time": "2023-08-01T19:55:05.156989+0000", 2023-08-01T19:56:30.771 INFO:teuthology.orchestra.run.smithi155.stdout: "duration": 3.8175e-05 2023-08-01T19:56:30.772 INFO:teuthology.orchestra.run.smithi155.stdout: }, 2023-08-01T19:56:30.772 INFO:teuthology.orchestra.run.smithi155.stdout: { 2023-08-01T19:56:30.772 INFO:teuthology.orchestra.run.smithi155.stdout: "event": "dispatched", 2023-08-01T19:56:30.772 INFO:teuthology.orchestra.run.smithi155.stdout: "time": "2023-08-01T19:55:05.218842+0000", 2023-08-01T19:56:30.772 INFO:teuthology.orchestra.run.smithi155.stdout: "duration": 0.061852299999999999 2023-08-01T19:56:30.772 INFO:teuthology.orchestra.run.smithi155.stdout: }, 2023-08-01T19:56:30.772 INFO:teuthology.orchestra.run.smithi155.stdout: { 2023-08-01T19:56:30.773 INFO:teuthology.orchestra.run.smithi155.stdout: "event": "queued_for_pg", 2023-08-01T19:56:30.773 INFO:teuthology.orchestra.run.smithi155.stdout: "time": "2023-08-01T19:55:05.218862+0000", 2023-08-01T19:56:30.773 INFO:teuthology.orchestra.run.smithi155.stdout: "duration": 1.9854999999999999e-05 2023-08-01T19:56:30.773 INFO:teuthology.orchestra.run.smithi155.stdout: }, 2023-08-01T19:56:30.773 INFO:teuthology.orchestra.run.smithi155.stdout: { 2023-08-01T19:56:30.773 INFO:teuthology.orchestra.run.smithi155.stdout: "event": "reached_pg", 2023-08-01T19:56:30.773 INFO:teuthology.orchestra.run.smithi155.stdout: "time": "2023-08-01T19:55:05.218918+0000", 2023-08-01T19:56:30.773 INFO:teuthology.orchestra.run.smithi155.stdout: "duration": 5.6570000000000002e-05 2023-08-01T19:56:30.774 INFO:teuthology.orchestra.run.smithi155.stdout: }, 2023-08-01T19:56:30.774 INFO:teuthology.orchestra.run.smithi155.stdout: { 2023-08-01T19:56:30.774 INFO:teuthology.orchestra.run.smithi155.stdout: "event": "started", 2023-08-01T19:56:30.774 INFO:teuthology.orchestra.run.smithi155.stdout: "time": "2023-08-01T19:55:05.218940+0000", 2023-08-01T19:56:30.774 INFO:teuthology.orchestra.run.smithi155.stdout: "duration": 2.1804e-05 2023-08-01T19:56:30.774 INFO:teuthology.orchestra.run.smithi155.stdout: }, 2023-08-01T19:56:30.774 INFO:teuthology.orchestra.run.smithi155.stdout: { 2023-08-01T19:56:30.774 INFO:teuthology.orchestra.run.smithi155.stdout: "event": "commit_sent", 2023-08-01T19:56:30.775 INFO:teuthology.orchestra.run.smithi155.stdout: "time": "2023-08-01T19:55:05.224928+0000", 2023-08-01T19:56:30.775 INFO:teuthology.orchestra.run.smithi155.stdout: "duration": 0.0059876759999999999 2023-08-01T19:56:30.775 INFO:teuthology.orchestra.run.smithi155.stdout: }, 2023-08-01T19:56:30.775 INFO:teuthology.orchestra.run.smithi155.stdout: { 2023-08-01T19:56:30.775 INFO:teuthology.orchestra.run.smithi155.stdout: "event": "done", 2023-08-01T19:56:30.775 INFO:teuthology.orchestra.run.smithi155.stdout: "time": "2023-08-01T19:55:05.224971+0000", 2023-08-01T19:56:30.775 INFO:teuthology.orchestra.run.smithi155.stdout: "duration": 4.2929999999999997e-05 2023-08-01T19:56:30.776 INFO:teuthology.orchestra.run.smithi155.stdout: } 2023-08-01T19:56:30.776 INFO:teuthology.orchestra.run.smithi155.stdout: ] 2023-08-01T19:56:30.776 INFO:teuthology.orchestra.run.smithi155.stdout: } 2023-08-01T19:56:30.776 INFO:teuthology.orchestra.run.smithi155.stdout: }, 2023-08-01T19:56:30.776 INFO:teuthology.orchestra.run.smithi155.stdout: { 2023-08-01T19:56:30.776 INFO:teuthology.orchestra.run.smithi155.stdout: "description": "osd_op(client.4668.0:100927 5.0 5:00608ec6:::benchmark_data_smithi006_114134_object100926:head [set-alloc-hint object_size 65536 write_size 65536,write 0~65536] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e37)", 2023-08-01T19:56:30.776 INFO:teuthology.orchestra.run.smithi155.stdout: "initiated_at": "2023-08-01T19:55:05.561169+0000", 2023-08-01T19:56:30.776 INFO:teuthology.orchestra.run.smithi155.stdout: "age": 85.109300345999998, 2023-08-01T19:56:30.777 INFO:teuthology.orchestra.run.smithi155.stdout: "duration": 0.066411687999999997, 2023-08-01T19:56:30.777 INFO:teuthology.orchestra.run.smithi155.stdout: "type_data": { 2023-08-01T19:56:30.777 INFO:teuthology.orchestra.run.smithi155.stdout: "flag_point": "commit sent; apply or cleanup", 2023-08-01T19:56:30.777 INFO:teuthology.orchestra.run.smithi155.stdout: "client_info": { 2023-08-01T19:56:30.777 INFO:teuthology.orchestra.run.smithi155.stdout: "client": "client.4668", 2023-08-01T19:56:30.777 INFO:teuthology.orchestra.run.smithi155.stdout: "client_addr": "172.21.15.6:0/1709472247", 2023-08-01T19:56:30.777 INFO:teuthology.orchestra.run.smithi155.stdout: "tid": 100927 2023-08-01T19:56:30.777 INFO:teuthology.orchestra.run.smithi155.stdout: }, 2023-08-01T19:56:30.778 INFO:teuthology.orchestra.run.smithi155.stdout: "events": [ 2023-08-01T19:56:30.778 INFO:teuthology.orchestra.run.smithi155.stdout: { 2023-08-01T19:56:30.778 INFO:teuthology.orchestra.run.smithi155.stdout: "event": "initiated", 2023-08-01T19:56:30.778 INFO:teuthology.orchestra.run.smithi155.stdout: "time": "2023-08-01T19:55:05.561169+0000", 2023-08-01T19:56:30.778 INFO:teuthology.orchestra.run.smithi155.stdout: "duration": 0 2023-08-01T19:56:30.778 INFO:teuthology.orchestra.run.smithi155.stdout: }, 2023-08-01T19:56:30.778 INFO:teuthology.orchestra.run.smithi155.stdout: { 2023-08-01T19:56:30.778 INFO:teuthology.orchestra.run.smithi155.stdout: "event": "throttled", 2023-08-01T19:56:30.779 INFO:teuthology.orchestra.run.smithi155.stdout: "time": "2023-08-01T19:55:05.561169+0000", 2023-08-01T19:56:30.779 INFO:teuthology.orchestra.run.smithi155.stdout: "duration": 0 2023-08-01T19:56:30.779 INFO:teuthology.orchestra.run.smithi155.stdout: }, 2023-08-01T19:56:30.779 INFO:teuthology.orchestra.run.smithi155.stdout: { 2023-08-01T19:56:30.779 INFO:teuthology.orchestra.run.smithi155.stdout: "event": "header_read", 2023-08-01T19:56:30.779 INFO:teuthology.orchestra.run.smithi155.stdout: "time": "2023-08-01T19:55:05.561168+0000", 2023-08-01T19:56:30.779 INFO:teuthology.orchestra.run.smithi155.stdout: "duration": 4294967295.9999995 2023-08-01T19:56:30.780 INFO:teuthology.orchestra.run.smithi155.stdout: }, 2023-08-01T19:56:30.780 INFO:teuthology.orchestra.run.smithi155.stdout: { 2023-08-01T19:56:30.780 INFO:teuthology.orchestra.run.smithi155.stdout: "event": "all_read", 2023-08-01T19:56:30.780 INFO:teuthology.orchestra.run.smithi155.stdout: "time": "2023-08-01T19:55:05.561218+0000", 2023-08-01T19:56:30.780 INFO:teuthology.orchestra.run.smithi155.stdout: "duration": 4.9379999999999998e-05 2023-08-01T19:56:30.780 INFO:teuthology.orchestra.run.smithi155.stdout: }, 2023-08-01T19:56:30.780 INFO:teuthology.orchestra.run.smithi155.stdout: { 2023-08-01T19:56:30.781 INFO:teuthology.orchestra.run.smithi155.stdout: "event": "dispatched", 2023-08-01T19:56:30.781 INFO:teuthology.orchestra.run.smithi155.stdout: "time": "2023-08-01T19:55:05.561225+0000", 2023-08-01T19:56:30.781 INFO:teuthology.orchestra.run.smithi155.stdout: "duration": 7.114e-06 2023-08-01T19:56:30.781 INFO:teuthology.orchestra.run.smithi155.stdout: }, 2023-08-01T19:56:30.781 INFO:teuthology.orchestra.run.smithi155.stdout: { 2023-08-01T19:56:30.781 INFO:teuthology.orchestra.run.smithi155.stdout: "event": "queued_for_pg", 2023-08-01T19:56:30.781 INFO:teuthology.orchestra.run.smithi155.stdout: "time": "2023-08-01T19:55:05.561229+0000", 2023-08-01T19:56:30.781 INFO:teuthology.orchestra.run.smithi155.stdout: "duration": 4.2180000000000001e-06 2023-08-01T19:56:30.782 INFO:teuthology.orchestra.run.smithi155.stdout: }, 2023-08-01T19:56:30.782 INFO:teuthology.orchestra.run.smithi155.stdout: { 2023-08-01T19:56:30.782 INFO:teuthology.orchestra.run.smithi155.stdout: "event": "reached_pg", 2023-08-01T19:56:30.782 INFO:teuthology.orchestra.run.smithi155.stdout: "time": "2023-08-01T19:55:05.564737+0000", 2023-08-01T19:56:30.782 INFO:teuthology.orchestra.run.smithi155.stdout: "duration": 0.0035081869999999999 2023-08-01T19:56:30.782 INFO:teuthology.orchestra.run.smithi155.stdout: }, 2023-08-01T19:56:30.782 INFO:teuthology.orchestra.run.smithi155.stdout: { 2023-08-01T19:56:30.782 INFO:teuthology.orchestra.run.smithi155.stdout: "event": "started", 2023-08-01T19:56:30.783 INFO:teuthology.orchestra.run.smithi155.stdout: "time": "2023-08-01T19:55:05.564859+0000", 2023-08-01T19:56:30.783 INFO:teuthology.orchestra.run.smithi155.stdout: "duration": 0.00012165800000000001 2023-08-01T19:56:30.783 INFO:teuthology.orchestra.run.smithi155.stdout: }, 2023-08-01T19:56:30.783 INFO:teuthology.orchestra.run.smithi155.stdout: { 2023-08-01T19:56:30.783 INFO:teuthology.orchestra.run.smithi155.stdout: "event": "waiting for subops from 0", 2023-08-01T19:56:30.783 INFO:teuthology.orchestra.run.smithi155.stdout: "time": "2023-08-01T19:55:05.565009+0000", 2023-08-01T19:56:30.783 INFO:teuthology.orchestra.run.smithi155.stdout: "duration": 0.00014979699999999999 2023-08-01T19:56:30.783 INFO:teuthology.orchestra.run.smithi155.stdout: }, 2023-08-01T19:56:30.784 INFO:teuthology.orchestra.run.smithi155.stdout: { 2023-08-01T19:56:30.784 INFO:teuthology.orchestra.run.smithi155.stdout: "event": "op_commit", 2023-08-01T19:56:30.784 INFO:teuthology.orchestra.run.smithi155.stdout: "time": "2023-08-01T19:55:05.568007+0000", 2023-08-01T19:56:30.784 INFO:teuthology.orchestra.run.smithi155.stdout: "duration": 0.00299796 2023-08-01T19:56:30.784 INFO:teuthology.orchestra.run.smithi155.stdout: }, 2023-08-01T19:56:30.784 INFO:teuthology.orchestra.run.smithi155.stdout: { 2023-08-01T19:56:30.784 INFO:teuthology.orchestra.run.smithi155.stdout: "event": "sub_op_commit_rec", 2023-08-01T19:56:30.785 INFO:teuthology.orchestra.run.smithi155.stdout: "time": "2023-08-01T19:55:05.627520+0000", 2023-08-01T19:56:30.785 INFO:teuthology.orchestra.run.smithi155.stdout: "duration": 0.059513636000000002 2023-08-01T19:56:30.785 INFO:teuthology.orchestra.run.smithi155.stdout: }, 2023-08-01T19:56:30.785 INFO:teuthology.orchestra.run.smithi155.stdout: { 2023-08-01T19:56:30.785 INFO:teuthology.orchestra.run.smithi155.stdout: "event": "commit_sent", 2023-08-01T19:56:30.785 INFO:teuthology.orchestra.run.smithi155.stdout: "time": "2023-08-01T19:55:05.627553+0000", 2023-08-01T19:56:30.785 INFO:teuthology.orchestra.run.smithi155.stdout: "duration": 3.2635999999999997e-05 2023-08-01T19:56:30.786 INFO:teuthology.orchestra.run.smithi155.stdout: }, 2023-08-01T19:56:30.786 INFO:teuthology.orchestra.run.smithi155.stdout: { 2023-08-01T19:56:30.786 INFO:teuthology.orchestra.run.smithi155.stdout: "event": "done", 2023-08-01T19:56:30.786 INFO:teuthology.orchestra.run.smithi155.stdout: "time": "2023-08-01T19:55:05.627581+0000", 2023-08-01T19:56:30.786 INFO:teuthology.orchestra.run.smithi155.stdout: "duration": 2.7681000000000001e-05 2023-08-01T19:56:30.786 INFO:teuthology.orchestra.run.smithi155.stdout: } 2023-08-01T19:56:30.786 INFO:teuthology.orchestra.run.smithi155.stdout: ] 2023-08-01T19:56:30.786 INFO:teuthology.orchestra.run.smithi155.stdout: } 2023-08-01T19:56:30.787 INFO:teuthology.orchestra.run.smithi155.stdout: }, 2023-08-01T19:56:30.787 INFO:teuthology.orchestra.run.smithi155.stdout: { 2023-08-01T19:56:30.787 INFO:teuthology.orchestra.run.smithi155.stdout: "description": "osd_op(client.4668.0:100935 5.e 5:7895b14e:::benchmark_data_smithi006_114134_object100934:head [set-alloc-hint object_size 65536 write_size 65536,write 0~65536] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e37)", 2023-08-01T19:56:30.787 INFO:teuthology.orchestra.run.smithi155.stdout: "initiated_at": "2023-08-01T19:55:05.566666+0000", 2023-08-01T19:56:30.787 INFO:teuthology.orchestra.run.smithi155.stdout: "age": 85.103803045999996, 2023-08-01T19:56:30.787 INFO:teuthology.orchestra.run.smithi155.stdout: "duration": 0.064309016999999996, 2023-08-01T19:56:30.787 INFO:teuthology.orchestra.run.smithi155.stdout: "type_data": { 2023-08-01T19:56:30.787 INFO:teuthology.orchestra.run.smithi155.stdout: "flag_point": "commit sent; apply or cleanup", 2023-08-01T19:56:30.788 INFO:teuthology.orchestra.run.smithi155.stdout: "client_info": { 2023-08-01T19:56:30.788 INFO:teuthology.orchestra.run.smithi155.stdout: "client": "client.4668", 2023-08-01T19:56:30.788 INFO:teuthology.orchestra.run.smithi155.stdout: "client_addr": "172.21.15.6:0/1709472247", 2023-08-01T19:56:30.788 INFO:teuthology.orchestra.run.smithi155.stdout: "tid": 100935 2023-08-01T19:56:30.788 INFO:teuthology.orchestra.run.smithi155.stdout: }, 2023-08-01T19:56:30.788 INFO:teuthology.orchestra.run.smithi155.stdout: "events": [ 2023-08-01T19:56:30.788 INFO:teuthology.orchestra.run.smithi155.stdout: { 2023-08-01T19:56:30.788 INFO:teuthology.orchestra.run.smithi155.stdout: "event": "initiated", 2023-08-01T19:56:30.789 INFO:teuthology.orchestra.run.smithi155.stdout: "time": "2023-08-01T19:55:05.566666+0000", 2023-08-01T19:56:30.789 INFO:teuthology.orchestra.run.smithi155.stdout: "duration": 0 2023-08-01T19:56:30.789 INFO:teuthology.orchestra.run.smithi155.stdout: }, 2023-08-01T19:56:30.789 INFO:teuthology.orchestra.run.smithi155.stdout: { 2023-08-01T19:56:30.789 INFO:teuthology.orchestra.run.smithi155.stdout: "event": "throttled", 2023-08-01T19:56:30.789 INFO:teuthology.orchestra.run.smithi155.stdout: "time": "2023-08-01T19:55:05.566666+0000", 2023-08-01T19:56:30.789 INFO:teuthology.orchestra.run.smithi155.stdout: "duration": 0 2023-08-01T19:56:30.789 INFO:teuthology.orchestra.run.smithi155.stdout: }, 2023-08-01T19:56:30.790 INFO:teuthology.orchestra.run.smithi155.stdout: { 2023-08-01T19:56:30.790 INFO:teuthology.orchestra.run.smithi155.stdout: "event": "header_read", 2023-08-01T19:56:30.790 INFO:teuthology.orchestra.run.smithi155.stdout: "time": "2023-08-01T19:55:05.566665+0000", 2023-08-01T19:56:30.790 INFO:teuthology.orchestra.run.smithi155.stdout: "duration": 4294967295.9999986 2023-08-01T19:56:30.790 INFO:teuthology.orchestra.run.smithi155.stdout: }, 2023-08-01T19:56:30.790 INFO:teuthology.orchestra.run.smithi155.stdout: { 2023-08-01T19:56:30.790 INFO:teuthology.orchestra.run.smithi155.stdout: "event": "all_read", 2023-08-01T19:56:30.790 INFO:teuthology.orchestra.run.smithi155.stdout: "time": "2023-08-01T19:55:05.566754+0000", 2023-08-01T19:56:30.791 INFO:teuthology.orchestra.run.smithi155.stdout: "duration": 8.9425999999999994e-05 2023-08-01T19:56:30.791 INFO:teuthology.orchestra.run.smithi155.stdout: }, 2023-08-01T19:56:30.791 INFO:teuthology.orchestra.run.smithi155.stdout: { 2023-08-01T19:56:30.791 INFO:teuthology.orchestra.run.smithi155.stdout: "event": "dispatched", 2023-08-01T19:56:30.791 INFO:teuthology.orchestra.run.smithi155.stdout: "time": "2023-08-01T19:55:05.566766+0000", 2023-08-01T19:56:30.791 INFO:teuthology.orchestra.run.smithi155.stdout: "duration": 1.2018000000000001e-05 2023-08-01T19:56:30.791 INFO:teuthology.orchestra.run.smithi155.stdout: }, 2023-08-01T19:56:30.792 INFO:teuthology.orchestra.run.smithi155.stdout: { 2023-08-01T19:56:30.792 INFO:teuthology.orchestra.run.smithi155.stdout: "event": "queued_for_pg", 2023-08-01T19:56:30.792 INFO:teuthology.orchestra.run.smithi155.stdout: "time": "2023-08-01T19:55:05.566772+0000", 2023-08-01T19:56:30.792 INFO:teuthology.orchestra.run.smithi155.stdout: "duration": 6.0190000000000003e-06 2023-08-01T19:56:30.792 INFO:teuthology.orchestra.run.smithi155.stdout: }, 2023-08-01T19:56:30.792 INFO:teuthology.orchestra.run.smithi155.stdout: { 2023-08-01T19:56:30.792 INFO:teuthology.orchestra.run.smithi155.stdout: "event": "reached_pg", 2023-08-01T19:56:30.792 INFO:teuthology.orchestra.run.smithi155.stdout: "time": "2023-08-01T19:55:05.566800+0000", 2023-08-01T19:56:30.793 INFO:teuthology.orchestra.run.smithi155.stdout: "duration": 2.7835999999999999e-05 2023-08-01T19:56:30.793 INFO:teuthology.orchestra.run.smithi155.stdout: }, 2023-08-01T19:56:30.793 INFO:teuthology.orchestra.run.smithi155.stdout: { 2023-08-01T19:56:30.793 INFO:teuthology.orchestra.run.smithi155.stdout: "event": "started", 2023-08-01T19:56:30.793 INFO:teuthology.orchestra.run.smithi155.stdout: "time": "2023-08-01T19:55:05.566879+0000", 2023-08-01T19:56:30.793 INFO:teuthology.orchestra.run.smithi155.stdout: "duration": 7.9105999999999998e-05 2023-08-01T19:56:30.793 INFO:teuthology.orchestra.run.smithi155.stdout: }, 2023-08-01T19:56:30.794 INFO:teuthology.orchestra.run.smithi155.stdout: { 2023-08-01T19:56:30.794 INFO:teuthology.orchestra.run.smithi155.stdout: "event": "waiting for subops from 0", 2023-08-01T19:56:30.794 INFO:teuthology.orchestra.run.smithi155.stdout: "time": "2023-08-01T19:55:05.566971+0000", 2023-08-01T19:56:30.794 INFO:teuthology.orchestra.run.smithi155.stdout: "duration": 9.1817999999999994e-05 2023-08-01T19:56:30.794 INFO:teuthology.orchestra.run.smithi155.stdout: }, 2023-08-01T19:56:30.794 INFO:teuthology.orchestra.run.smithi155.stdout: { 2023-08-01T19:56:30.794 INFO:teuthology.orchestra.run.smithi155.stdout: "event": "op_commit", 2023-08-01T19:56:30.795 INFO:teuthology.orchestra.run.smithi155.stdout: "time": "2023-08-01T19:55:05.571475+0000", 2023-08-01T19:56:30.795 INFO:teuthology.orchestra.run.smithi155.stdout: "duration": 0.0045039499999999996 2023-08-01T19:56:30.795 INFO:teuthology.orchestra.run.smithi155.stdout: }, 2023-08-01T19:56:30.795 INFO:teuthology.orchestra.run.smithi155.stdout: { 2023-08-01T19:56:30.795 INFO:teuthology.orchestra.run.smithi155.stdout: "event": "sub_op_commit_rec", 2023-08-01T19:56:30.795 INFO:teuthology.orchestra.run.smithi155.stdout: "time": "2023-08-01T19:55:05.630884+0000", 2023-08-01T19:56:30.795 INFO:teuthology.orchestra.run.smithi155.stdout: "duration": 0.059409181999999998 2023-08-01T19:56:30.796 INFO:teuthology.orchestra.run.smithi155.stdout: }, 2023-08-01T19:56:30.796 INFO:teuthology.orchestra.run.smithi155.stdout: { 2023-08-01T19:56:30.796 INFO:teuthology.orchestra.run.smithi155.stdout: "event": "commit_sent", 2023-08-01T19:56:30.796 INFO:teuthology.orchestra.run.smithi155.stdout: "time": "2023-08-01T19:55:05.630930+0000", 2023-08-01T19:56:30.796 INFO:teuthology.orchestra.run.smithi155.stdout: "duration": 4.5507999999999999e-05 2023-08-01T19:56:30.796 INFO:teuthology.orchestra.run.smithi155.stdout: }, 2023-08-01T19:56:30.797 INFO:teuthology.orchestra.run.smithi155.stdout: { 2023-08-01T19:56:30.797 INFO:teuthology.orchestra.run.smithi155.stdout: "event": "done", 2023-08-01T19:56:30.797 INFO:teuthology.orchestra.run.smithi155.stdout: "time": "2023-08-01T19:55:05.630975+0000", 2023-08-01T19:56:30.797 INFO:teuthology.orchestra.run.smithi155.stdout: "duration": 4.5441000000000001e-05 2023-08-01T19:56:30.797 INFO:teuthology.orchestra.run.smithi155.stdout: } 2023-08-01T19:56:30.797 INFO:teuthology.orchestra.run.smithi155.stdout: ] 2023-08-01T19:56:30.797 INFO:teuthology.orchestra.run.smithi155.stdout: } 2023-08-01T19:56:30.797 INFO:teuthology.orchestra.run.smithi155.stdout: }, 2023-08-01T19:56:30.798 INFO:teuthology.orchestra.run.smithi155.stdout: { 2023-08-01T19:56:30.798 INFO:teuthology.orchestra.run.smithi155.stdout: "description": "osd_op(client.4668.0:100941 5.e 5:736a6ac6:::benchmark_data_smithi006_114134_object100940:head [set-alloc-hint object_size 65536 write_size 65536,write 0~65536] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e37)", 2023-08-01T19:56:30.798 INFO:teuthology.orchestra.run.smithi155.stdout: "initiated_at": "2023-08-01T19:55:05.569750+0000", 2023-08-01T19:56:30.798 INFO:teuthology.orchestra.run.smithi155.stdout: "age": 85.100719153, 2023-08-01T19:56:30.798 INFO:teuthology.orchestra.run.smithi155.stdout: "duration": 0.065431331999999995, 2023-08-01T19:56:30.798 INFO:teuthology.orchestra.run.smithi155.stdout: "type_data": { 2023-08-01T19:56:30.798 INFO:teuthology.orchestra.run.smithi155.stdout: "flag_point": "commit sent; apply or cleanup", 2023-08-01T19:56:30.799 INFO:teuthology.orchestra.run.smithi155.stdout: "client_info": { 2023-08-01T19:56:30.799 INFO:teuthology.orchestra.run.smithi155.stdout: "client": "client.4668", 2023-08-01T19:56:30.799 INFO:teuthology.orchestra.run.smithi155.stdout: "client_addr": "172.21.15.6:0/1709472247", 2023-08-01T19:56:30.799 INFO:teuthology.orchestra.run.smithi155.stdout: "tid": 100941 2023-08-01T19:56:30.799 INFO:teuthology.orchestra.run.smithi155.stdout: }, 2023-08-01T19:56:30.799 INFO:teuthology.orchestra.run.smithi155.stdout: "events": [ 2023-08-01T19:56:30.799 INFO:teuthology.orchestra.run.smithi155.stdout: { 2023-08-01T19:56:30.799 INFO:teuthology.orchestra.run.smithi155.stdout: "event": "initiated", 2023-08-01T19:56:30.800 INFO:teuthology.orchestra.run.smithi155.stdout: "time": "2023-08-01T19:55:05.569750+0000", 2023-08-01T19:56:30.800 INFO:teuthology.orchestra.run.smithi155.stdout: "duration": 0 2023-08-01T19:56:30.800 INFO:teuthology.orchestra.run.smithi155.stdout: }, 2023-08-01T19:56:30.800 INFO:teuthology.orchestra.run.smithi155.stdout: { 2023-08-01T19:56:30.800 INFO:teuthology.orchestra.run.smithi155.stdout: "event": "throttled", 2023-08-01T19:56:30.800 INFO:teuthology.orchestra.run.smithi155.stdout: "time": "2023-08-01T19:55:05.569750+0000", 2023-08-01T19:56:30.800 INFO:teuthology.orchestra.run.smithi155.stdout: "duration": 0 2023-08-01T19:56:30.800 INFO:teuthology.orchestra.run.smithi155.stdout: }, 2023-08-01T19:56:30.801 INFO:teuthology.orchestra.run.smithi155.stdout: { 2023-08-01T19:56:30.801 INFO:teuthology.orchestra.run.smithi155.stdout: "event": "header_read", 2023-08-01T19:56:30.801 INFO:teuthology.orchestra.run.smithi155.stdout: "time": "2023-08-01T19:55:05.569749+0000", 2023-08-01T19:56:30.801 INFO:teuthology.orchestra.run.smithi155.stdout: "duration": 4294967295.999999 2023-08-01T19:56:30.801 INFO:teuthology.orchestra.run.smithi155.stdout: }, 2023-08-01T19:56:30.801 INFO:teuthology.orchestra.run.smithi155.stdout: { 2023-08-01T19:56:30.801 INFO:teuthology.orchestra.run.smithi155.stdout: "event": "all_read", 2023-08-01T19:56:30.801 INFO:teuthology.orchestra.run.smithi155.stdout: "time": "2023-08-01T19:55:05.569861+0000", 2023-08-01T19:56:30.802 INFO:teuthology.orchestra.run.smithi155.stdout: "duration": 0.000111333 2023-08-01T19:56:30.802 INFO:teuthology.orchestra.run.smithi155.stdout: }, 2023-08-01T19:56:30.802 INFO:teuthology.orchestra.run.smithi155.stdout: { 2023-08-01T19:56:30.802 INFO:teuthology.orchestra.run.smithi155.stdout: "event": "dispatched", 2023-08-01T19:56:30.802 INFO:teuthology.orchestra.run.smithi155.stdout: "time": "2023-08-01T19:55:05.569869+0000", 2023-08-01T19:56:30.802 INFO:teuthology.orchestra.run.smithi155.stdout: "duration": 8.8589999999999994e-06 2023-08-01T19:56:30.802 INFO:teuthology.orchestra.run.smithi155.stdout: }, 2023-08-01T19:56:30.803 INFO:teuthology.orchestra.run.smithi155.stdout: { 2023-08-01T19:56:30.803 INFO:teuthology.orchestra.run.smithi155.stdout: "event": "queued_for_pg", 2023-08-01T19:56:30.803 INFO:teuthology.orchestra.run.smithi155.stdout: "time": "2023-08-01T19:55:05.569874+0000", 2023-08-01T19:56:30.803 INFO:teuthology.orchestra.run.smithi155.stdout: "duration": 4.1679999999999997e-06 2023-08-01T19:56:30.803 INFO:teuthology.orchestra.run.smithi155.stdout: }, 2023-08-01T19:56:30.803 INFO:teuthology.orchestra.run.smithi155.stdout: { 2023-08-01T19:56:30.803 INFO:teuthology.orchestra.run.smithi155.stdout: "event": "reached_pg", 2023-08-01T19:56:30.803 INFO:teuthology.orchestra.run.smithi155.stdout: "time": "2023-08-01T19:55:05.569904+0000", 2023-08-01T19:56:30.804 INFO:teuthology.orchestra.run.smithi155.stdout: "duration": 3.0920999999999998e-05 2023-08-01T19:56:30.804 INFO:teuthology.orchestra.run.smithi155.stdout: }, 2023-08-01T19:56:30.804 INFO:teuthology.orchestra.run.smithi155.stdout: { 2023-08-01T19:56:30.804 INFO:teuthology.orchestra.run.smithi155.stdout: "event": "started", 2023-08-01T19:56:30.804 INFO:teuthology.orchestra.run.smithi155.stdout: "time": "2023-08-01T19:55:05.569998+0000", 2023-08-01T19:56:30.804 INFO:teuthology.orchestra.run.smithi155.stdout: "duration": 9.3086999999999998e-05 2023-08-01T19:56:30.804 INFO:teuthology.orchestra.run.smithi155.stdout: }, 2023-08-01T19:56:30.804 INFO:teuthology.orchestra.run.smithi155.stdout: { 2023-08-01T19:56:30.805 INFO:teuthology.orchestra.run.smithi155.stdout: "event": "waiting for subops from 0", 2023-08-01T19:56:30.805 INFO:teuthology.orchestra.run.smithi155.stdout: "time": "2023-08-01T19:55:05.570093+0000", 2023-08-01T19:56:30.805 INFO:teuthology.orchestra.run.smithi155.stdout: "duration": 9.5768999999999997e-05 2023-08-01T19:56:30.805 INFO:teuthology.orchestra.run.smithi155.stdout: }, 2023-08-01T19:56:30.805 INFO:teuthology.orchestra.run.smithi155.stdout: { 2023-08-01T19:56:30.805 INFO:teuthology.orchestra.run.smithi155.stdout: "event": "op_commit", 2023-08-01T19:56:30.805 INFO:teuthology.orchestra.run.smithi155.stdout: "time": "2023-08-01T19:55:05.572839+0000", 2023-08-01T19:56:30.805 INFO:teuthology.orchestra.run.smithi155.stdout: "duration": 0.0027460050000000001 2023-08-01T19:56:30.806 INFO:teuthology.orchestra.run.smithi155.stdout: }, 2023-08-01T19:56:30.806 INFO:teuthology.orchestra.run.smithi155.stdout: { 2023-08-01T19:56:30.806 INFO:teuthology.orchestra.run.smithi155.stdout: "event": "sub_op_commit_rec", 2023-08-01T19:56:30.806 INFO:teuthology.orchestra.run.smithi155.stdout: "time": "2023-08-01T19:55:05.635114+0000", 2023-08-01T19:56:30.806 INFO:teuthology.orchestra.run.smithi155.stdout: "duration": 0.062274297999999999 2023-08-01T19:56:30.806 INFO:teuthology.orchestra.run.smithi155.stdout: }, 2023-08-01T19:56:30.806 INFO:teuthology.orchestra.run.smithi155.stdout: { 2023-08-01T19:56:30.806 INFO:teuthology.orchestra.run.smithi155.stdout: "event": "commit_sent", 2023-08-01T19:56:30.807 INFO:teuthology.orchestra.run.smithi155.stdout: "time": "2023-08-01T19:55:05.635143+0000", 2023-08-01T19:56:30.807 INFO:teuthology.orchestra.run.smithi155.stdout: "duration": 2.9430000000000001e-05 2023-08-01T19:56:30.807 INFO:teuthology.orchestra.run.smithi155.stdout: }, 2023-08-01T19:56:30.807 INFO:teuthology.orchestra.run.smithi155.stdout: { 2023-08-01T19:56:30.807 INFO:teuthology.orchestra.run.smithi155.stdout: "event": "done", 2023-08-01T19:56:30.807 INFO:teuthology.orchestra.run.smithi155.stdout: "time": "2023-08-01T19:55:05.635181+0000", 2023-08-01T19:56:30.807 INFO:teuthology.orchestra.run.smithi155.stdout: "duration": 3.8352000000000001e-05 2023-08-01T19:56:30.807 INFO:teuthology.orchestra.run.smithi155.stdout: } 2023-08-01T19:56:30.808 INFO:teuthology.orchestra.run.smithi155.stdout: ] 2023-08-01T19:56:30.808 INFO:teuthology.orchestra.run.smithi155.stdout: } 2023-08-01T19:56:30.808 INFO:teuthology.orchestra.run.smithi155.stdout: }, 2023-08-01T19:56:30.808 INFO:teuthology.orchestra.run.smithi155.stdout: { 2023-08-01T19:56:30.808 INFO:teuthology.orchestra.run.smithi155.stdout: "description": "osd_op(client.4668.0:100945 5.e 5:73df68dd:::benchmark_data_smithi006_114134_object100944:head [set-alloc-hint object_size 65536 write_size 65536,write 0~65536] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e37)", 2023-08-01T19:56:30.808 INFO:teuthology.orchestra.run.smithi155.stdout: "initiated_at": "2023-08-01T19:55:05.576784+0000", 2023-08-01T19:56:30.808 INFO:teuthology.orchestra.run.smithi155.stdout: "age": 85.093685567999998, 2023-08-01T19:56:30.809 INFO:teuthology.orchestra.run.smithi155.stdout: "duration": 0.058512994999999998, 2023-08-01T19:56:30.809 INFO:teuthology.orchestra.run.smithi155.stdout: "type_data": { 2023-08-01T19:56:30.809 INFO:teuthology.orchestra.run.smithi155.stdout: "flag_point": "commit sent; apply or cleanup", 2023-08-01T19:56:30.809 INFO:teuthology.orchestra.run.smithi155.stdout: "client_info": { 2023-08-01T19:56:30.809 INFO:teuthology.orchestra.run.smithi155.stdout: "client": "client.4668", 2023-08-01T19:56:30.809 INFO:teuthology.orchestra.run.smithi155.stdout: "client_addr": "172.21.15.6:0/1709472247", 2023-08-01T19:56:30.809 INFO:teuthology.orchestra.run.smithi155.stdout: "tid": 100945 2023-08-01T19:56:30.809 INFO:teuthology.orchestra.run.smithi155.stdout: }, 2023-08-01T19:56:30.810 INFO:teuthology.orchestra.run.smithi155.stdout: "events": [ 2023-08-01T19:56:30.810 INFO:teuthology.orchestra.run.smithi155.stdout: { 2023-08-01T19:56:30.810 INFO:teuthology.orchestra.run.smithi155.stdout: "event": "initiated", 2023-08-01T19:56:30.810 INFO:teuthology.orchestra.run.smithi155.stdout: "time": "2023-08-01T19:55:05.576784+0000", 2023-08-01T19:56:30.810 INFO:teuthology.orchestra.run.smithi155.stdout: "duration": 0 2023-08-01T19:56:30.810 INFO:teuthology.orchestra.run.smithi155.stdout: }, 2023-08-01T19:56:30.810 INFO:teuthology.orchestra.run.smithi155.stdout: { 2023-08-01T19:56:30.810 INFO:teuthology.orchestra.run.smithi155.stdout: "event": "throttled", 2023-08-01T19:56:30.811 INFO:teuthology.orchestra.run.smithi155.stdout: "time": "2023-08-01T19:55:05.576784+0000", 2023-08-01T19:56:30.811 INFO:teuthology.orchestra.run.smithi155.stdout: "duration": 0 2023-08-01T19:56:30.811 INFO:teuthology.orchestra.run.smithi155.stdout: }, 2023-08-01T19:56:30.811 INFO:teuthology.orchestra.run.smithi155.stdout: { 2023-08-01T19:56:30.811 INFO:teuthology.orchestra.run.smithi155.stdout: "event": "header_read", 2023-08-01T19:56:30.811 INFO:teuthology.orchestra.run.smithi155.stdout: "time": "2023-08-01T19:55:05.576783+0000", 2023-08-01T19:56:30.811 INFO:teuthology.orchestra.run.smithi155.stdout: "duration": 4294967295.9999995 2023-08-01T19:56:30.811 INFO:teuthology.orchestra.run.smithi155.stdout: }, 2023-08-01T19:56:30.812 INFO:teuthology.orchestra.run.smithi155.stdout: { 2023-08-01T19:56:30.812 INFO:teuthology.orchestra.run.smithi155.stdout: "event": "all_read", 2023-08-01T19:56:30.812 INFO:teuthology.orchestra.run.smithi155.stdout: "time": "2023-08-01T19:55:05.576807+0000", 2023-08-01T19:56:30.812 INFO:teuthology.orchestra.run.smithi155.stdout: "duration": 2.3651000000000001e-05 2023-08-01T19:56:30.812 INFO:teuthology.orchestra.run.smithi155.stdout: }, 2023-08-01T19:56:30.812 INFO:teuthology.orchestra.run.smithi155.stdout: { 2023-08-01T19:56:30.812 INFO:teuthology.orchestra.run.smithi155.stdout: "event": "dispatched", 2023-08-01T19:56:30.812 INFO:teuthology.orchestra.run.smithi155.stdout: "time": "2023-08-01T19:55:05.576817+0000", 2023-08-01T19:56:30.813 INFO:teuthology.orchestra.run.smithi155.stdout: "duration": 9.9389999999999992e-06 2023-08-01T19:56:30.813 INFO:teuthology.orchestra.run.smithi155.stdout: }, 2023-08-01T19:56:30.813 INFO:teuthology.orchestra.run.smithi155.stdout: { 2023-08-01T19:56:30.813 INFO:teuthology.orchestra.run.smithi155.stdout: "event": "queued_for_pg", 2023-08-01T19:56:30.813 INFO:teuthology.orchestra.run.smithi155.stdout: "time": "2023-08-01T19:55:05.576820+0000", 2023-08-01T19:56:30.813 INFO:teuthology.orchestra.run.smithi155.stdout: "duration": 3.2619999999999999e-06 2023-08-01T19:56:30.813 INFO:teuthology.orchestra.run.smithi155.stdout: }, 2023-08-01T19:56:30.813 INFO:teuthology.orchestra.run.smithi155.stdout: { 2023-08-01T19:56:30.814 INFO:teuthology.orchestra.run.smithi155.stdout: "event": "reached_pg", 2023-08-01T19:56:30.814 INFO:teuthology.orchestra.run.smithi155.stdout: "time": "2023-08-01T19:55:05.576849+0000", 2023-08-01T19:56:30.814 INFO:teuthology.orchestra.run.smithi155.stdout: "duration": 2.8880000000000001e-05 2023-08-01T19:56:30.814 INFO:teuthology.orchestra.run.smithi155.stdout: }, 2023-08-01T19:56:30.814 INFO:teuthology.orchestra.run.smithi155.stdout: { 2023-08-01T19:56:30.814 INFO:teuthology.orchestra.run.smithi155.stdout: "event": "started", 2023-08-01T19:56:30.814 INFO:teuthology.orchestra.run.smithi155.stdout: "time": "2023-08-01T19:55:05.576940+0000", 2023-08-01T19:56:30.814 INFO:teuthology.orchestra.run.smithi155.stdout: "duration": 9.0570999999999997e-05 2023-08-01T19:56:30.815 INFO:teuthology.orchestra.run.smithi155.stdout: }, 2023-08-01T19:56:30.815 INFO:teuthology.orchestra.run.smithi155.stdout: { 2023-08-01T19:56:30.815 INFO:teuthology.orchestra.run.smithi155.stdout: "event": "waiting for subops from 0", 2023-08-01T19:56:30.815 INFO:teuthology.orchestra.run.smithi155.stdout: "time": "2023-08-01T19:55:05.577027+0000", 2023-08-01T19:56:30.815 INFO:teuthology.orchestra.run.smithi155.stdout: "duration": 8.7237999999999994e-05 2023-08-01T19:56:30.815 INFO:teuthology.orchestra.run.smithi155.stdout: }, 2023-08-01T19:56:30.815 INFO:teuthology.orchestra.run.smithi155.stdout: { 2023-08-01T19:56:30.815 INFO:teuthology.orchestra.run.smithi155.stdout: "event": "op_commit", 2023-08-01T19:56:30.816 INFO:teuthology.orchestra.run.smithi155.stdout: "time": "2023-08-01T19:55:05.579624+0000", 2023-08-01T19:56:30.816 INFO:teuthology.orchestra.run.smithi155.stdout: "duration": 0.0025971200000000001 2023-08-01T19:56:30.816 INFO:teuthology.orchestra.run.smithi155.stdout: }, 2023-08-01T19:56:30.816 INFO:teuthology.orchestra.run.smithi155.stdout: { 2023-08-01T19:56:30.816 INFO:teuthology.orchestra.run.smithi155.stdout: "event": "sub_op_commit_rec", 2023-08-01T19:56:30.816 INFO:teuthology.orchestra.run.smithi155.stdout: "time": "2023-08-01T19:55:05.635218+0000", 2023-08-01T19:56:30.816 INFO:teuthology.orchestra.run.smithi155.stdout: "duration": 0.055594487999999997 2023-08-01T19:56:30.816 INFO:teuthology.orchestra.run.smithi155.stdout: }, 2023-08-01T19:56:30.817 INFO:teuthology.orchestra.run.smithi155.stdout: { 2023-08-01T19:56:30.817 INFO:teuthology.orchestra.run.smithi155.stdout: "event": "commit_sent", 2023-08-01T19:56:30.817 INFO:teuthology.orchestra.run.smithi155.stdout: "time": "2023-08-01T19:55:05.635262+0000", 2023-08-01T19:56:30.817 INFO:teuthology.orchestra.run.smithi155.stdout: "duration": 4.3380999999999997e-05 2023-08-01T19:56:30.817 INFO:teuthology.orchestra.run.smithi155.stdout: }, 2023-08-01T19:56:30.817 INFO:teuthology.orchestra.run.smithi155.stdout: { 2023-08-01T19:56:30.817 INFO:teuthology.orchestra.run.smithi155.stdout: "event": "done", 2023-08-01T19:56:30.818 INFO:teuthology.orchestra.run.smithi155.stdout: "time": "2023-08-01T19:55:05.635297+0000", 2023-08-01T19:56:30.818 INFO:teuthology.orchestra.run.smithi155.stdout: "duration": 3.4842000000000003e-05 2023-08-01T19:56:30.818 INFO:teuthology.orchestra.run.smithi155.stdout: } 2023-08-01T19:56:30.818 INFO:teuthology.orchestra.run.smithi155.stdout: ] 2023-08-01T19:56:30.818 INFO:teuthology.orchestra.run.smithi155.stdout: } 2023-08-01T19:56:30.818 INFO:teuthology.orchestra.run.smithi155.stdout: }, 2023-08-01T19:56:30.818 INFO:teuthology.orchestra.run.smithi155.stdout: { 2023-08-01T19:56:30.818 INFO:teuthology.orchestra.run.smithi155.stdout: "description": "osd_op(client.4668.0:100947 5.4 5:23e8fc27:::benchmark_data_smithi006_114134_object100946:head [set-alloc-hint object_size 65536 write_size 65536,write 0~65536] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e37)", 2023-08-01T19:56:30.819 INFO:teuthology.orchestra.run.smithi155.stdout: "initiated_at": "2023-08-01T19:55:05.576840+0000", 2023-08-01T19:56:30.819 INFO:teuthology.orchestra.run.smithi155.stdout: "age": 85.093629512999996, 2023-08-01T19:56:30.819 INFO:teuthology.orchestra.run.smithi155.stdout: "duration": 0.058423127999999998, 2023-08-01T19:56:30.819 INFO:teuthology.orchestra.run.smithi155.stdout: "type_data": { 2023-08-01T19:56:30.819 INFO:teuthology.orchestra.run.smithi155.stdout: "flag_point": "commit sent; apply or cleanup", 2023-08-01T19:56:30.819 INFO:teuthology.orchestra.run.smithi155.stdout: "client_info": { 2023-08-01T19:56:30.819 INFO:teuthology.orchestra.run.smithi155.stdout: "client": "client.4668", 2023-08-01T19:56:30.819 INFO:teuthology.orchestra.run.smithi155.stdout: "client_addr": "172.21.15.6:0/1709472247", 2023-08-01T19:56:30.820 INFO:teuthology.orchestra.run.smithi155.stdout: "tid": 100947 2023-08-01T19:56:30.820 INFO:teuthology.orchestra.run.smithi155.stdout: }, 2023-08-01T19:56:30.820 INFO:teuthology.orchestra.run.smithi155.stdout: "events": [ 2023-08-01T19:56:30.820 INFO:teuthology.orchestra.run.smithi155.stdout: { 2023-08-01T19:56:30.820 INFO:teuthology.orchestra.run.smithi155.stdout: "event": "initiated", 2023-08-01T19:56:30.820 INFO:teuthology.orchestra.run.smithi155.stdout: "time": "2023-08-01T19:55:05.576840+0000", 2023-08-01T19:56:30.820 INFO:teuthology.orchestra.run.smithi155.stdout: "duration": 0 2023-08-01T19:56:30.820 INFO:teuthology.orchestra.run.smithi155.stdout: }, 2023-08-01T19:56:30.821 INFO:teuthology.orchestra.run.smithi155.stdout: { 2023-08-01T19:56:30.821 INFO:teuthology.orchestra.run.smithi155.stdout: "event": "throttled", 2023-08-01T19:56:30.821 INFO:teuthology.orchestra.run.smithi155.stdout: "time": "2023-08-01T19:55:05.576840+0000", 2023-08-01T19:56:30.821 INFO:teuthology.orchestra.run.smithi155.stdout: "duration": 0 2023-08-01T19:56:30.821 INFO:teuthology.orchestra.run.smithi155.stdout: }, 2023-08-01T19:56:30.821 INFO:teuthology.orchestra.run.smithi155.stdout: { 2023-08-01T19:56:30.821 INFO:teuthology.orchestra.run.smithi155.stdout: "event": "header_read", 2023-08-01T19:56:30.822 INFO:teuthology.orchestra.run.smithi155.stdout: "time": "2023-08-01T19:55:05.576839+0000", 2023-08-01T19:56:30.822 INFO:teuthology.orchestra.run.smithi155.stdout: "duration": 4294967295.9999995 2023-08-01T19:56:30.822 INFO:teuthology.orchestra.run.smithi155.stdout: }, 2023-08-01T19:56:30.822 INFO:teuthology.orchestra.run.smithi155.stdout: { 2023-08-01T19:56:30.822 INFO:teuthology.orchestra.run.smithi155.stdout: "event": "all_read", 2023-08-01T19:56:30.822 INFO:teuthology.orchestra.run.smithi155.stdout: "time": "2023-08-01T19:55:05.576893+0000", 2023-08-01T19:56:30.822 INFO:teuthology.orchestra.run.smithi155.stdout: "duration": 5.3893000000000001e-05 2023-08-01T19:56:30.822 INFO:teuthology.orchestra.run.smithi155.stdout: }, 2023-08-01T19:56:30.823 INFO:teuthology.orchestra.run.smithi155.stdout: { 2023-08-01T19:56:30.823 INFO:teuthology.orchestra.run.smithi155.stdout: "event": "dispatched", 2023-08-01T19:56:30.823 INFO:teuthology.orchestra.run.smithi155.stdout: "time": "2023-08-01T19:55:05.576902+0000", 2023-08-01T19:56:30.823 INFO:teuthology.orchestra.run.smithi155.stdout: "duration": 8.7520000000000002e-06 2023-08-01T19:56:30.823 INFO:teuthology.orchestra.run.smithi155.stdout: }, 2023-08-01T19:56:30.823 INFO:teuthology.orchestra.run.smithi155.stdout: { 2023-08-01T19:56:30.823 INFO:teuthology.orchestra.run.smithi155.stdout: "event": "queued_for_pg", 2023-08-01T19:56:30.824 INFO:teuthology.orchestra.run.smithi155.stdout: "time": "2023-08-01T19:55:05.576905+0000", 2023-08-01T19:56:30.824 INFO:teuthology.orchestra.run.smithi155.stdout: "duration": 3.01e-06 2023-08-01T19:56:30.824 INFO:teuthology.orchestra.run.smithi155.stdout: }, 2023-08-01T19:56:30.824 INFO:teuthology.orchestra.run.smithi155.stdout: { 2023-08-01T19:56:30.824 INFO:teuthology.orchestra.run.smithi155.stdout: "event": "reached_pg", 2023-08-01T19:56:30.824 INFO:teuthology.orchestra.run.smithi155.stdout: "time": "2023-08-01T19:55:05.579641+0000", 2023-08-01T19:56:30.824 INFO:teuthology.orchestra.run.smithi155.stdout: "duration": 0.0027366880000000001 2023-08-01T19:56:30.824 INFO:teuthology.orchestra.run.smithi155.stdout: }, 2023-08-01T19:56:30.825 INFO:teuthology.orchestra.run.smithi155.stdout: { 2023-08-01T19:56:30.825 INFO:teuthology.orchestra.run.smithi155.stdout: "event": "started", 2023-08-01T19:56:30.825 INFO:teuthology.orchestra.run.smithi155.stdout: "time": "2023-08-01T19:55:05.579734+0000", 2023-08-01T19:56:30.825 INFO:teuthology.orchestra.run.smithi155.stdout: "duration": 9.2590000000000006e-05 2023-08-01T19:56:30.825 INFO:teuthology.orchestra.run.smithi155.stdout: }, 2023-08-01T19:56:30.825 INFO:teuthology.orchestra.run.smithi155.stdout: { 2023-08-01T19:56:30.825 INFO:teuthology.orchestra.run.smithi155.stdout: "event": "waiting for subops from 0", 2023-08-01T19:56:30.825 INFO:teuthology.orchestra.run.smithi155.stdout: "time": "2023-08-01T19:55:05.579825+0000", 2023-08-01T19:56:30.826 INFO:teuthology.orchestra.run.smithi155.stdout: "duration": 9.0964999999999994e-05 2023-08-01T19:56:30.826 INFO:teuthology.orchestra.run.smithi155.stdout: }, 2023-08-01T19:56:30.826 INFO:teuthology.orchestra.run.smithi155.stdout: { 2023-08-01T19:56:30.826 INFO:teuthology.orchestra.run.smithi155.stdout: "event": "op_commit", 2023-08-01T19:56:30.826 INFO:teuthology.orchestra.run.smithi155.stdout: "time": "2023-08-01T19:55:05.585041+0000", 2023-08-01T19:56:30.826 INFO:teuthology.orchestra.run.smithi155.stdout: "duration": 0.0052159670000000002 2023-08-01T19:56:30.826 INFO:teuthology.orchestra.run.smithi155.stdout: }, 2023-08-01T19:56:30.827 INFO:teuthology.orchestra.run.smithi155.stdout: { 2023-08-01T19:56:30.827 INFO:teuthology.orchestra.run.smithi155.stdout: "event": "sub_op_commit_rec", 2023-08-01T19:56:30.827 INFO:teuthology.orchestra.run.smithi155.stdout: "time": "2023-08-01T19:55:05.635199+0000", 2023-08-01T19:56:30.827 INFO:teuthology.orchestra.run.smithi155.stdout: "duration": 0.050158023000000003 2023-08-01T19:56:30.827 INFO:teuthology.orchestra.run.smithi155.stdout: }, 2023-08-01T19:56:30.827 INFO:teuthology.orchestra.run.smithi155.stdout: { 2023-08-01T19:56:30.827 INFO:teuthology.orchestra.run.smithi155.stdout: "event": "commit_sent", 2023-08-01T19:56:30.827 INFO:teuthology.orchestra.run.smithi155.stdout: "time": "2023-08-01T19:55:05.635227+0000", 2023-08-01T19:56:30.828 INFO:teuthology.orchestra.run.smithi155.stdout: "duration": 2.7821e-05 2023-08-01T19:56:30.828 INFO:teuthology.orchestra.run.smithi155.stdout: }, 2023-08-01T19:56:30.828 INFO:teuthology.orchestra.run.smithi155.stdout: { 2023-08-01T19:56:30.828 INFO:teuthology.orchestra.run.smithi155.stdout: "event": "done", 2023-08-01T19:56:30.828 INFO:teuthology.orchestra.run.smithi155.stdout: "time": "2023-08-01T19:55:05.635263+0000", 2023-08-01T19:56:30.828 INFO:teuthology.orchestra.run.smithi155.stdout: "duration": 3.6081000000000002e-05 2023-08-01T19:56:30.828 INFO:teuthology.orchestra.run.smithi155.stdout: } 2023-08-01T19:56:30.828 INFO:teuthology.orchestra.run.smithi155.stdout: ] 2023-08-01T19:56:30.829 INFO:teuthology.orchestra.run.smithi155.stdout: } 2023-08-01T19:56:30.829 INFO:teuthology.orchestra.run.smithi155.stdout: }, 2023-08-01T19:56:30.829 INFO:teuthology.orchestra.run.smithi155.stdout: { 2023-08-01T19:56:30.829 INFO:teuthology.orchestra.run.smithi155.stdout: "description": "osd_op(client.4668.0:197408 5.d 5:bbda375a:::benchmark_data_smithi006_114134_object63747:head [delete] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e61)", 2023-08-01T19:56:30.829 INFO:teuthology.orchestra.run.smithi155.stdout: "initiated_at": "2023-08-01T19:55:58.559714+0000", 2023-08-01T19:56:30.829 INFO:teuthology.orchestra.run.smithi155.stdout: "age": 32.110755525999998, 2023-08-01T19:56:30.829 INFO:teuthology.orchestra.run.smithi155.stdout: "duration": 1.047043671, 2023-08-01T19:56:30.829 INFO:teuthology.orchestra.run.smithi155.stdout: "type_data": { 2023-08-01T19:56:30.830 INFO:teuthology.orchestra.run.smithi155.stdout: "flag_point": "commit sent; apply or cleanup", 2023-08-01T19:56:30.830 INFO:teuthology.orchestra.run.smithi155.stdout: "client_info": { 2023-08-01T19:56:30.830 INFO:teuthology.orchestra.run.smithi155.stdout: "client": "client.4668", 2023-08-01T19:56:30.830 INFO:teuthology.orchestra.run.smithi155.stdout: "client_addr": "172.21.15.6:0/1709472247", 2023-08-01T19:56:30.830 INFO:teuthology.orchestra.run.smithi155.stdout: "tid": 197408 2023-08-01T19:56:30.830 INFO:teuthology.orchestra.run.smithi155.stdout: }, 2023-08-01T19:56:30.830 INFO:teuthology.orchestra.run.smithi155.stdout: "events": [ 2023-08-01T19:56:30.830 INFO:teuthology.orchestra.run.smithi155.stdout: { 2023-08-01T19:56:30.831 INFO:teuthology.orchestra.run.smithi155.stdout: "event": "initiated", 2023-08-01T19:56:30.831 INFO:teuthology.orchestra.run.smithi155.stdout: "time": "2023-08-01T19:55:58.559714+0000", 2023-08-01T19:56:30.831 INFO:teuthology.orchestra.run.smithi155.stdout: "duration": 0 2023-08-01T19:56:30.831 INFO:teuthology.orchestra.run.smithi155.stdout: }, 2023-08-01T19:56:30.831 INFO:teuthology.orchestra.run.smithi155.stdout: { 2023-08-01T19:56:30.831 INFO:teuthology.orchestra.run.smithi155.stdout: "event": "throttled", 2023-08-01T19:56:30.831 INFO:teuthology.orchestra.run.smithi155.stdout: "time": "2023-08-01T19:55:58.559714+0000", 2023-08-01T19:56:30.831 INFO:teuthology.orchestra.run.smithi155.stdout: "duration": 0 2023-08-01T19:56:30.832 INFO:teuthology.orchestra.run.smithi155.stdout: }, 2023-08-01T19:56:30.832 INFO:teuthology.orchestra.run.smithi155.stdout: { 2023-08-01T19:56:30.832 INFO:teuthology.orchestra.run.smithi155.stdout: "event": "header_read", 2023-08-01T19:56:30.832 INFO:teuthology.orchestra.run.smithi155.stdout: "time": "2023-08-01T19:55:58.559713+0000", 2023-08-01T19:56:30.832 INFO:teuthology.orchestra.run.smithi155.stdout: "duration": 4294967295.999999 2023-08-01T19:56:30.832 INFO:teuthology.orchestra.run.smithi155.stdout: }, 2023-08-01T19:56:30.832 INFO:teuthology.orchestra.run.smithi155.stdout: { 2023-08-01T19:56:30.833 INFO:teuthology.orchestra.run.smithi155.stdout: "event": "all_read", 2023-08-01T19:56:30.833 INFO:teuthology.orchestra.run.smithi155.stdout: "time": "2023-08-01T19:55:58.559717+0000", 2023-08-01T19:56:30.833 INFO:teuthology.orchestra.run.smithi155.stdout: "duration": 4.2860000000000001e-06 2023-08-01T19:56:30.833 INFO:teuthology.orchestra.run.smithi155.stdout: }, 2023-08-01T19:56:30.833 INFO:teuthology.orchestra.run.smithi155.stdout: { 2023-08-01T19:56:30.833 INFO:teuthology.orchestra.run.smithi155.stdout: "event": "dispatched", 2023-08-01T19:56:30.833 INFO:teuthology.orchestra.run.smithi155.stdout: "time": "2023-08-01T19:55:58.559774+0000", 2023-08-01T19:56:30.833 INFO:teuthology.orchestra.run.smithi155.stdout: "duration": 5.6508999999999997e-05 2023-08-01T19:56:30.834 INFO:teuthology.orchestra.run.smithi155.stdout: }, 2023-08-01T19:56:30.834 INFO:teuthology.orchestra.run.smithi155.stdout: { 2023-08-01T19:56:30.834 INFO:teuthology.orchestra.run.smithi155.stdout: "event": "queued_for_pg", 2023-08-01T19:56:30.834 INFO:teuthology.orchestra.run.smithi155.stdout: "time": "2023-08-01T19:55:58.559781+0000", 2023-08-01T19:56:30.834 INFO:teuthology.orchestra.run.smithi155.stdout: "duration": 7.1829999999999997e-06 2023-08-01T19:56:30.834 INFO:teuthology.orchestra.run.smithi155.stdout: }, 2023-08-01T19:56:30.834 INFO:teuthology.orchestra.run.smithi155.stdout: { 2023-08-01T19:56:30.834 INFO:teuthology.orchestra.run.smithi155.stdout: "event": "reached_pg", 2023-08-01T19:56:30.835 INFO:teuthology.orchestra.run.smithi155.stdout: "time": "2023-08-01T19:55:58.571621+0000", 2023-08-01T19:56:30.835 INFO:teuthology.orchestra.run.smithi155.stdout: "duration": 0.011840603999999999 2023-08-01T19:56:30.835 INFO:teuthology.orchestra.run.smithi155.stdout: }, 2023-08-01T19:56:30.835 INFO:teuthology.orchestra.run.smithi155.stdout: { 2023-08-01T19:56:30.835 INFO:teuthology.orchestra.run.smithi155.stdout: "event": "waiting for peered", 2023-08-01T19:56:30.835 INFO:teuthology.orchestra.run.smithi155.stdout: "time": "2023-08-01T19:55:58.571630+0000", 2023-08-01T19:56:30.835 INFO:teuthology.orchestra.run.smithi155.stdout: "duration": 8.9770000000000006e-06 2023-08-01T19:56:30.835 INFO:teuthology.orchestra.run.smithi155.stdout: }, 2023-08-01T19:56:30.836 INFO:teuthology.orchestra.run.smithi155.stdout: { 2023-08-01T19:56:30.836 INFO:teuthology.orchestra.run.smithi155.stdout: "event": "reached_pg", 2023-08-01T19:56:30.836 INFO:teuthology.orchestra.run.smithi155.stdout: "time": "2023-08-01T19:55:59.601300+0000", 2023-08-01T19:56:30.836 INFO:teuthology.orchestra.run.smithi155.stdout: "duration": 1.0296694989999999 2023-08-01T19:56:30.836 INFO:teuthology.orchestra.run.smithi155.stdout: }, 2023-08-01T19:56:30.836 INFO:teuthology.orchestra.run.smithi155.stdout: { 2023-08-01T19:56:30.836 INFO:teuthology.orchestra.run.smithi155.stdout: "event": "started", 2023-08-01T19:56:30.836 INFO:teuthology.orchestra.run.smithi155.stdout: "time": "2023-08-01T19:55:59.601448+0000", 2023-08-01T19:56:30.837 INFO:teuthology.orchestra.run.smithi155.stdout: "duration": 0.00014828399999999999 2023-08-01T19:56:30.837 INFO:teuthology.orchestra.run.smithi155.stdout: }, 2023-08-01T19:56:30.837 INFO:teuthology.orchestra.run.smithi155.stdout: { 2023-08-01T19:56:30.837 INFO:teuthology.orchestra.run.smithi155.stdout: "event": "op_commit", 2023-08-01T19:56:30.837 INFO:teuthology.orchestra.run.smithi155.stdout: "time": "2023-08-01T19:55:59.606616+0000", 2023-08-01T19:56:30.837 INFO:teuthology.orchestra.run.smithi155.stdout: "duration": 0.0051679769999999998 2023-08-01T19:56:30.837 INFO:teuthology.orchestra.run.smithi155.stdout: }, 2023-08-01T19:56:30.838 INFO:teuthology.orchestra.run.smithi155.stdout: { 2023-08-01T19:56:30.838 INFO:teuthology.orchestra.run.smithi155.stdout: "event": "commit_sent", 2023-08-01T19:56:30.838 INFO:teuthology.orchestra.run.smithi155.stdout: "time": "2023-08-01T19:55:59.606662+0000", 2023-08-01T19:56:30.838 INFO:teuthology.orchestra.run.smithi155.stdout: "duration": 4.5843000000000001e-05 2023-08-01T19:56:30.838 INFO:teuthology.orchestra.run.smithi155.stdout: }, 2023-08-01T19:56:30.838 INFO:teuthology.orchestra.run.smithi155.stdout: { 2023-08-01T19:56:30.838 INFO:teuthology.orchestra.run.smithi155.stdout: "event": "done", 2023-08-01T19:56:30.838 INFO:teuthology.orchestra.run.smithi155.stdout: "time": "2023-08-01T19:55:59.606757+0000", 2023-08-01T19:56:30.839 INFO:teuthology.orchestra.run.smithi155.stdout: "duration": 9.5373999999999999e-05 2023-08-01T19:56:30.839 INFO:teuthology.orchestra.run.smithi155.stdout: } 2023-08-01T19:56:30.839 INFO:teuthology.orchestra.run.smithi155.stdout: ] 2023-08-01T19:56:30.839 INFO:teuthology.orchestra.run.smithi155.stdout: } 2023-08-01T19:56:30.839 INFO:teuthology.orchestra.run.smithi155.stdout: }, 2023-08-01T19:56:30.839 INFO:teuthology.orchestra.run.smithi155.stdout: { 2023-08-01T19:56:30.839 INFO:teuthology.orchestra.run.smithi155.stdout: "description": "osd_op(client.4668.0:197416 5.d 5:bd99e66d:::benchmark_data_smithi006_114134_object63755:head [delete] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e62)", 2023-08-01T19:56:30.839 INFO:teuthology.orchestra.run.smithi155.stdout: "initiated_at": "2023-08-01T19:55:58.577369+0000", 2023-08-01T19:56:30.840 INFO:teuthology.orchestra.run.smithi155.stdout: "age": 32.093100548999999, 2023-08-01T19:56:30.840 INFO:teuthology.orchestra.run.smithi155.stdout: "duration": 1.0300980120000001, 2023-08-01T19:56:30.840 INFO:teuthology.orchestra.run.smithi155.stdout: "type_data": { 2023-08-01T19:56:30.840 INFO:teuthology.orchestra.run.smithi155.stdout: "flag_point": "commit sent; apply or cleanup", 2023-08-01T19:56:30.840 INFO:teuthology.orchestra.run.smithi155.stdout: "client_info": { 2023-08-01T19:56:30.840 INFO:teuthology.orchestra.run.smithi155.stdout: "client": "client.4668", 2023-08-01T19:56:30.840 INFO:teuthology.orchestra.run.smithi155.stdout: "client_addr": "172.21.15.6:0/1709472247", 2023-08-01T19:56:30.840 INFO:teuthology.orchestra.run.smithi155.stdout: "tid": 197416 2023-08-01T19:56:30.841 INFO:teuthology.orchestra.run.smithi155.stdout: }, 2023-08-01T19:56:30.841 INFO:teuthology.orchestra.run.smithi155.stdout: "events": [ 2023-08-01T19:56:30.841 INFO:teuthology.orchestra.run.smithi155.stdout: { 2023-08-01T19:56:30.841 INFO:teuthology.orchestra.run.smithi155.stdout: "event": "initiated", 2023-08-01T19:56:30.841 INFO:teuthology.orchestra.run.smithi155.stdout: "time": "2023-08-01T19:55:58.577369+0000", 2023-08-01T19:56:30.841 INFO:teuthology.orchestra.run.smithi155.stdout: "duration": 0 2023-08-01T19:56:30.841 INFO:teuthology.orchestra.run.smithi155.stdout: }, 2023-08-01T19:56:30.841 INFO:teuthology.orchestra.run.smithi155.stdout: { 2023-08-01T19:56:30.842 INFO:teuthology.orchestra.run.smithi155.stdout: "event": "throttled", 2023-08-01T19:56:30.842 INFO:teuthology.orchestra.run.smithi155.stdout: "time": "2023-08-01T19:55:58.577369+0000", 2023-08-01T19:56:30.842 INFO:teuthology.orchestra.run.smithi155.stdout: "duration": 0 2023-08-01T19:56:30.842 INFO:teuthology.orchestra.run.smithi155.stdout: }, 2023-08-01T19:56:30.842 INFO:teuthology.orchestra.run.smithi155.stdout: { 2023-08-01T19:56:30.842 INFO:teuthology.orchestra.run.smithi155.stdout: "event": "header_read", 2023-08-01T19:56:30.842 INFO:teuthology.orchestra.run.smithi155.stdout: "time": "2023-08-01T19:55:58.577368+0000", 2023-08-01T19:56:30.842 INFO:teuthology.orchestra.run.smithi155.stdout: "duration": 4294967295.9999995 2023-08-01T19:56:30.843 INFO:teuthology.orchestra.run.smithi155.stdout: }, 2023-08-01T19:56:30.843 INFO:teuthology.orchestra.run.smithi155.stdout: { 2023-08-01T19:56:30.843 INFO:teuthology.orchestra.run.smithi155.stdout: "event": "all_read", 2023-08-01T19:56:30.843 INFO:teuthology.orchestra.run.smithi155.stdout: "time": "2023-08-01T19:55:58.577370+0000", 2023-08-01T19:56:30.843 INFO:teuthology.orchestra.run.smithi155.stdout: "duration": 2.1150000000000001e-06 2023-08-01T19:56:30.843 INFO:teuthology.orchestra.run.smithi155.stdout: }, 2023-08-01T19:56:30.843 INFO:teuthology.orchestra.run.smithi155.stdout: { 2023-08-01T19:56:30.844 INFO:teuthology.orchestra.run.smithi155.stdout: "event": "dispatched", 2023-08-01T19:56:30.844 INFO:teuthology.orchestra.run.smithi155.stdout: "time": "2023-08-01T19:55:58.577377+0000", 2023-08-01T19:56:30.844 INFO:teuthology.orchestra.run.smithi155.stdout: "duration": 6.6610000000000003e-06 2023-08-01T19:56:30.844 INFO:teuthology.orchestra.run.smithi155.stdout: }, 2023-08-01T19:56:30.844 INFO:teuthology.orchestra.run.smithi155.stdout: { 2023-08-01T19:56:30.844 INFO:teuthology.orchestra.run.smithi155.stdout: "event": "queued_for_pg", 2023-08-01T19:56:30.844 INFO:teuthology.orchestra.run.smithi155.stdout: "time": "2023-08-01T19:55:58.577380+0000", 2023-08-01T19:56:30.844 INFO:teuthology.orchestra.run.smithi155.stdout: "duration": 2.7360000000000001e-06 2023-08-01T19:56:30.845 INFO:teuthology.orchestra.run.smithi155.stdout: }, 2023-08-01T19:56:30.845 INFO:teuthology.orchestra.run.smithi155.stdout: { 2023-08-01T19:56:30.845 INFO:teuthology.orchestra.run.smithi155.stdout: "event": "reached_pg", 2023-08-01T19:56:30.845 INFO:teuthology.orchestra.run.smithi155.stdout: "time": "2023-08-01T19:55:58.577405+0000", 2023-08-01T19:56:30.845 INFO:teuthology.orchestra.run.smithi155.stdout: "duration": 2.4929000000000001e-05 2023-08-01T19:56:30.845 INFO:teuthology.orchestra.run.smithi155.stdout: }, 2023-08-01T19:56:30.845 INFO:teuthology.orchestra.run.smithi155.stdout: { 2023-08-01T19:56:30.845 INFO:teuthology.orchestra.run.smithi155.stdout: "event": "waiting for peered", 2023-08-01T19:56:30.846 INFO:teuthology.orchestra.run.smithi155.stdout: "time": "2023-08-01T19:55:58.577409+0000", 2023-08-01T19:56:30.846 INFO:teuthology.orchestra.run.smithi155.stdout: "duration": 4.0799999999999999e-06 2023-08-01T19:56:30.846 INFO:teuthology.orchestra.run.smithi155.stdout: }, 2023-08-01T19:56:30.846 INFO:teuthology.orchestra.run.smithi155.stdout: { 2023-08-01T19:56:30.846 INFO:teuthology.orchestra.run.smithi155.stdout: "event": "reached_pg", 2023-08-01T19:56:30.846 INFO:teuthology.orchestra.run.smithi155.stdout: "time": "2023-08-01T19:55:59.603639+0000", 2023-08-01T19:56:30.846 INFO:teuthology.orchestra.run.smithi155.stdout: "duration": 1.0262299349999999 2023-08-01T19:56:30.846 INFO:teuthology.orchestra.run.smithi155.stdout: }, 2023-08-01T19:56:30.847 INFO:teuthology.orchestra.run.smithi155.stdout: { 2023-08-01T19:56:30.847 INFO:teuthology.orchestra.run.smithi155.stdout: "event": "started", 2023-08-01T19:56:30.847 INFO:teuthology.orchestra.run.smithi155.stdout: "time": "2023-08-01T19:55:59.603772+0000", 2023-08-01T19:56:30.847 INFO:teuthology.orchestra.run.smithi155.stdout: "duration": 0.000133153 2023-08-01T19:56:30.847 INFO:teuthology.orchestra.run.smithi155.stdout: }, 2023-08-01T19:56:30.847 INFO:teuthology.orchestra.run.smithi155.stdout: { 2023-08-01T19:56:30.847 INFO:teuthology.orchestra.run.smithi155.stdout: "event": "op_commit", 2023-08-01T19:56:30.847 INFO:teuthology.orchestra.run.smithi155.stdout: "time": "2023-08-01T19:55:59.607354+0000", 2023-08-01T19:56:30.848 INFO:teuthology.orchestra.run.smithi155.stdout: "duration": 0.0035819599999999999 2023-08-01T19:56:30.848 INFO:teuthology.orchestra.run.smithi155.stdout: }, 2023-08-01T19:56:30.848 INFO:teuthology.orchestra.run.smithi155.stdout: { 2023-08-01T19:56:30.848 INFO:teuthology.orchestra.run.smithi155.stdout: "event": "commit_sent", 2023-08-01T19:56:30.848 INFO:teuthology.orchestra.run.smithi155.stdout: "time": "2023-08-01T19:55:59.607396+0000", 2023-08-01T19:56:30.848 INFO:teuthology.orchestra.run.smithi155.stdout: "duration": 4.2423999999999999e-05 2023-08-01T19:56:30.848 INFO:teuthology.orchestra.run.smithi155.stdout: }, 2023-08-01T19:56:30.848 INFO:teuthology.orchestra.run.smithi155.stdout: { 2023-08-01T19:56:30.849 INFO:teuthology.orchestra.run.smithi155.stdout: "event": "done", 2023-08-01T19:56:30.849 INFO:teuthology.orchestra.run.smithi155.stdout: "time": "2023-08-01T19:55:59.607467+0000", 2023-08-01T19:56:30.849 INFO:teuthology.orchestra.run.smithi155.stdout: "duration": 7.0360999999999999e-05 2023-08-01T19:56:30.849 INFO:teuthology.orchestra.run.smithi155.stdout: } 2023-08-01T19:56:30.849 INFO:teuthology.orchestra.run.smithi155.stdout: ] 2023-08-01T19:56:30.849 INFO:teuthology.orchestra.run.smithi155.stdout: } 2023-08-01T19:56:30.849 INFO:teuthology.orchestra.run.smithi155.stdout: }, 2023-08-01T19:56:30.850 INFO:teuthology.orchestra.run.smithi155.stdout: { 2023-08-01T19:56:30.850 INFO:teuthology.orchestra.run.smithi155.stdout: "description": "osd_op(client.4668.0:197419 5.d 5:be7dc7c9:::benchmark_data_smithi006_114134_object63758:head [delete] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e62)", 2023-08-01T19:56:30.850 INFO:teuthology.orchestra.run.smithi155.stdout: "initiated_at": "2023-08-01T19:55:58.580223+0000", 2023-08-01T19:56:30.850 INFO:teuthology.orchestra.run.smithi155.stdout: "age": 32.090246598, 2023-08-01T19:56:30.850 INFO:teuthology.orchestra.run.smithi155.stdout: "duration": 1.0286139439999999, 2023-08-01T19:56:30.850 INFO:teuthology.orchestra.run.smithi155.stdout: "type_data": { 2023-08-01T19:56:30.850 INFO:teuthology.orchestra.run.smithi155.stdout: "flag_point": "commit sent; apply or cleanup", 2023-08-01T19:56:30.850 INFO:teuthology.orchestra.run.smithi155.stdout: "client_info": { 2023-08-01T19:56:30.851 INFO:teuthology.orchestra.run.smithi155.stdout: "client": "client.4668", 2023-08-01T19:56:30.851 INFO:teuthology.orchestra.run.smithi155.stdout: "client_addr": "172.21.15.6:0/1709472247", 2023-08-01T19:56:30.851 INFO:teuthology.orchestra.run.smithi155.stdout: "tid": 197419 2023-08-01T19:56:30.851 INFO:teuthology.orchestra.run.smithi155.stdout: }, 2023-08-01T19:56:30.851 INFO:teuthology.orchestra.run.smithi155.stdout: "events": [ 2023-08-01T19:56:30.851 INFO:teuthology.orchestra.run.smithi155.stdout: { 2023-08-01T19:56:30.852 INFO:teuthology.orchestra.run.smithi155.stdout: "event": "initiated", 2023-08-01T19:56:30.852 INFO:teuthology.orchestra.run.smithi155.stdout: "time": "2023-08-01T19:55:58.580223+0000", 2023-08-01T19:56:30.852 INFO:teuthology.orchestra.run.smithi155.stdout: "duration": 0 2023-08-01T19:56:30.852 INFO:teuthology.orchestra.run.smithi155.stdout: }, 2023-08-01T19:56:30.852 INFO:teuthology.orchestra.run.smithi155.stdout: { 2023-08-01T19:56:30.852 INFO:teuthology.orchestra.run.smithi155.stdout: "event": "throttled", 2023-08-01T19:56:30.852 INFO:teuthology.orchestra.run.smithi155.stdout: "time": "2023-08-01T19:55:58.580223+0000", 2023-08-01T19:56:30.853 INFO:teuthology.orchestra.run.smithi155.stdout: "duration": 0 2023-08-01T19:56:30.853 INFO:teuthology.orchestra.run.smithi155.stdout: }, 2023-08-01T19:56:30.853 INFO:teuthology.orchestra.run.smithi155.stdout: { 2023-08-01T19:56:30.853 INFO:teuthology.orchestra.run.smithi155.stdout: "event": "header_read", 2023-08-01T19:56:30.853 INFO:teuthology.orchestra.run.smithi155.stdout: "time": "2023-08-01T19:55:58.580222+0000", 2023-08-01T19:56:30.853 INFO:teuthology.orchestra.run.smithi155.stdout: "duration": 4294967295.9999995 2023-08-01T19:56:30.853 INFO:teuthology.orchestra.run.smithi155.stdout: }, 2023-08-01T19:56:30.853 INFO:teuthology.orchestra.run.smithi155.stdout: { 2023-08-01T19:56:30.854 INFO:teuthology.orchestra.run.smithi155.stdout: "event": "all_read", 2023-08-01T19:56:30.854 INFO:teuthology.orchestra.run.smithi155.stdout: "time": "2023-08-01T19:55:58.580225+0000", 2023-08-01T19:56:30.854 INFO:teuthology.orchestra.run.smithi155.stdout: "duration": 3.2820000000000001e-06 2023-08-01T19:56:30.854 INFO:teuthology.orchestra.run.smithi155.stdout: }, 2023-08-01T19:56:30.854 INFO:teuthology.orchestra.run.smithi155.stdout: { 2023-08-01T19:56:30.854 INFO:teuthology.orchestra.run.smithi155.stdout: "event": "dispatched", 2023-08-01T19:56:30.854 INFO:teuthology.orchestra.run.smithi155.stdout: "time": "2023-08-01T19:55:58.580233+0000", 2023-08-01T19:56:30.854 INFO:teuthology.orchestra.run.smithi155.stdout: "duration": 7.34e-06 2023-08-01T19:56:30.855 INFO:teuthology.orchestra.run.smithi155.stdout: }, 2023-08-01T19:56:30.855 INFO:teuthology.orchestra.run.smithi155.stdout: { 2023-08-01T19:56:30.855 INFO:teuthology.orchestra.run.smithi155.stdout: "event": "queued_for_pg", 2023-08-01T19:56:30.855 INFO:teuthology.orchestra.run.smithi155.stdout: "time": "2023-08-01T19:55:58.580236+0000", 2023-08-01T19:56:30.855 INFO:teuthology.orchestra.run.smithi155.stdout: "duration": 3.473e-06 2023-08-01T19:56:30.855 INFO:teuthology.orchestra.run.smithi155.stdout: }, 2023-08-01T19:56:30.855 INFO:teuthology.orchestra.run.smithi155.stdout: { 2023-08-01T19:56:30.856 INFO:teuthology.orchestra.run.smithi155.stdout: "event": "reached_pg", 2023-08-01T19:56:30.856 INFO:teuthology.orchestra.run.smithi155.stdout: "time": "2023-08-01T19:55:58.580267+0000", 2023-08-01T19:56:30.856 INFO:teuthology.orchestra.run.smithi155.stdout: "duration": 3.0479000000000001e-05 2023-08-01T19:56:30.856 INFO:teuthology.orchestra.run.smithi155.stdout: }, 2023-08-01T19:56:30.856 INFO:teuthology.orchestra.run.smithi155.stdout: { 2023-08-01T19:56:30.856 INFO:teuthology.orchestra.run.smithi155.stdout: "event": "waiting for peered", 2023-08-01T19:56:30.856 INFO:teuthology.orchestra.run.smithi155.stdout: "time": "2023-08-01T19:55:58.580272+0000", 2023-08-01T19:56:30.856 INFO:teuthology.orchestra.run.smithi155.stdout: "duration": 5.011e-06 2023-08-01T19:56:30.857 INFO:teuthology.orchestra.run.smithi155.stdout: }, 2023-08-01T19:56:30.857 INFO:teuthology.orchestra.run.smithi155.stdout: { 2023-08-01T19:56:30.857 INFO:teuthology.orchestra.run.smithi155.stdout: "event": "reached_pg", 2023-08-01T19:56:30.857 INFO:teuthology.orchestra.run.smithi155.stdout: "time": "2023-08-01T19:55:59.604970+0000", 2023-08-01T19:56:30.857 INFO:teuthology.orchestra.run.smithi155.stdout: "duration": 1.0246984189999999 2023-08-01T19:56:30.857 INFO:teuthology.orchestra.run.smithi155.stdout: }, 2023-08-01T19:56:30.857 INFO:teuthology.orchestra.run.smithi155.stdout: { 2023-08-01T19:56:30.857 INFO:teuthology.orchestra.run.smithi155.stdout: "event": "started", 2023-08-01T19:56:30.858 INFO:teuthology.orchestra.run.smithi155.stdout: "time": "2023-08-01T19:55:59.605085+0000", 2023-08-01T19:56:30.858 INFO:teuthology.orchestra.run.smithi155.stdout: "duration": 0.00011531000000000001 2023-08-01T19:56:30.858 INFO:teuthology.orchestra.run.smithi155.stdout: }, 2023-08-01T19:56:30.858 INFO:teuthology.orchestra.run.smithi155.stdout: { 2023-08-01T19:56:30.858 INFO:teuthology.orchestra.run.smithi155.stdout: "event": "op_commit", 2023-08-01T19:56:30.858 INFO:teuthology.orchestra.run.smithi155.stdout: "time": "2023-08-01T19:55:59.608733+0000", 2023-08-01T19:56:30.858 INFO:teuthology.orchestra.run.smithi155.stdout: "duration": 0.0036478090000000001 2023-08-01T19:56:30.858 INFO:teuthology.orchestra.run.smithi155.stdout: }, 2023-08-01T19:56:30.859 INFO:teuthology.orchestra.run.smithi155.stdout: { 2023-08-01T19:56:30.859 INFO:teuthology.orchestra.run.smithi155.stdout: "event": "commit_sent", 2023-08-01T19:56:30.859 INFO:teuthology.orchestra.run.smithi155.stdout: "time": "2023-08-01T19:55:59.608771+0000", 2023-08-01T19:56:30.859 INFO:teuthology.orchestra.run.smithi155.stdout: "duration": 3.8033e-05 2023-08-01T19:56:30.859 INFO:teuthology.orchestra.run.smithi155.stdout: }, 2023-08-01T19:56:30.859 INFO:teuthology.orchestra.run.smithi155.stdout: { 2023-08-01T19:56:30.859 INFO:teuthology.orchestra.run.smithi155.stdout: "event": "done", 2023-08-01T19:56:30.859 INFO:teuthology.orchestra.run.smithi155.stdout: "time": "2023-08-01T19:55:59.608837+0000", 2023-08-01T19:56:30.860 INFO:teuthology.orchestra.run.smithi155.stdout: "duration": 6.5364000000000006e-05 2023-08-01T19:56:30.860 INFO:teuthology.orchestra.run.smithi155.stdout: } 2023-08-01T19:56:30.860 INFO:teuthology.orchestra.run.smithi155.stdout: ] 2023-08-01T19:56:30.860 INFO:teuthology.orchestra.run.smithi155.stdout: } 2023-08-01T19:56:30.860 INFO:teuthology.orchestra.run.smithi155.stdout: }, 2023-08-01T19:56:30.860 INFO:teuthology.orchestra.run.smithi155.stdout: { 2023-08-01T19:56:30.860 INFO:teuthology.orchestra.run.smithi155.stdout: "description": "osd_op(client.4668.0:197420 5.9 5:92a2efe5:::benchmark_data_smithi006_114134_object63759:head [delete] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e62)", 2023-08-01T19:56:30.860 INFO:teuthology.orchestra.run.smithi155.stdout: "initiated_at": "2023-08-01T19:55:58.582230+0000", 2023-08-01T19:56:30.861 INFO:teuthology.orchestra.run.smithi155.stdout: "age": 32.088239287999997, 2023-08-01T19:56:30.861 INFO:teuthology.orchestra.run.smithi155.stdout: "duration": 1.0095353739999999, 2023-08-01T19:56:30.861 INFO:teuthology.orchestra.run.smithi155.stdout: "type_data": { 2023-08-01T19:56:30.861 INFO:teuthology.orchestra.run.smithi155.stdout: "flag_point": "commit sent; apply or cleanup", 2023-08-01T19:56:30.861 INFO:teuthology.orchestra.run.smithi155.stdout: "client_info": { 2023-08-01T19:56:30.861 INFO:teuthology.orchestra.run.smithi155.stdout: "client": "client.4668", 2023-08-01T19:56:30.861 INFO:teuthology.orchestra.run.smithi155.stdout: "client_addr": "172.21.15.6:0/1709472247", 2023-08-01T19:56:30.861 INFO:teuthology.orchestra.run.smithi155.stdout: "tid": 197420 2023-08-01T19:56:30.862 INFO:teuthology.orchestra.run.smithi155.stdout: }, 2023-08-01T19:56:30.862 INFO:teuthology.orchestra.run.smithi155.stdout: "events": [ 2023-08-01T19:56:30.862 INFO:teuthology.orchestra.run.smithi155.stdout: { 2023-08-01T19:56:30.862 INFO:teuthology.orchestra.run.smithi155.stdout: "event": "initiated", 2023-08-01T19:56:30.862 INFO:teuthology.orchestra.run.smithi155.stdout: "time": "2023-08-01T19:55:58.582230+0000", 2023-08-01T19:56:30.862 INFO:teuthology.orchestra.run.smithi155.stdout: "duration": 0 2023-08-01T19:56:30.862 INFO:teuthology.orchestra.run.smithi155.stdout: }, 2023-08-01T19:56:30.862 INFO:teuthology.orchestra.run.smithi155.stdout: { 2023-08-01T19:56:30.863 INFO:teuthology.orchestra.run.smithi155.stdout: "event": "throttled", 2023-08-01T19:56:30.863 INFO:teuthology.orchestra.run.smithi155.stdout: "time": "2023-08-01T19:55:58.582230+0000", 2023-08-01T19:56:30.863 INFO:teuthology.orchestra.run.smithi155.stdout: "duration": 0 2023-08-01T19:56:30.863 INFO:teuthology.orchestra.run.smithi155.stdout: }, 2023-08-01T19:56:30.863 INFO:teuthology.orchestra.run.smithi155.stdout: { 2023-08-01T19:56:30.863 INFO:teuthology.orchestra.run.smithi155.stdout: "event": "header_read", 2023-08-01T19:56:30.863 INFO:teuthology.orchestra.run.smithi155.stdout: "time": "2023-08-01T19:55:58.582229+0000", 2023-08-01T19:56:30.863 INFO:teuthology.orchestra.run.smithi155.stdout: "duration": 4294967295.9999995 2023-08-01T19:56:30.864 INFO:teuthology.orchestra.run.smithi155.stdout: }, 2023-08-01T19:56:30.864 INFO:teuthology.orchestra.run.smithi155.stdout: { 2023-08-01T19:56:30.864 INFO:teuthology.orchestra.run.smithi155.stdout: "event": "all_read", 2023-08-01T19:56:30.864 INFO:teuthology.orchestra.run.smithi155.stdout: "time": "2023-08-01T19:55:58.582233+0000", 2023-08-01T19:56:30.864 INFO:teuthology.orchestra.run.smithi155.stdout: "duration": 3.7869999999999999e-06 2023-08-01T19:56:30.864 INFO:teuthology.orchestra.run.smithi155.stdout: }, 2023-08-01T19:56:30.864 INFO:teuthology.orchestra.run.smithi155.stdout: { 2023-08-01T19:56:30.865 INFO:teuthology.orchestra.run.smithi155.stdout: "event": "dispatched", 2023-08-01T19:56:30.865 INFO:teuthology.orchestra.run.smithi155.stdout: "time": "2023-08-01T19:55:58.582241+0000", 2023-08-01T19:56:30.865 INFO:teuthology.orchestra.run.smithi155.stdout: "duration": 7.6909999999999997e-06 2023-08-01T19:56:30.865 INFO:teuthology.orchestra.run.smithi155.stdout: }, 2023-08-01T19:56:30.865 INFO:teuthology.orchestra.run.smithi155.stdout: { 2023-08-01T19:56:30.865 INFO:teuthology.orchestra.run.smithi155.stdout: "event": "queued_for_pg", 2023-08-01T19:56:30.865 INFO:teuthology.orchestra.run.smithi155.stdout: "time": "2023-08-01T19:55:58.582244+0000", 2023-08-01T19:56:30.865 INFO:teuthology.orchestra.run.smithi155.stdout: "duration": 3.6770000000000001e-06 2023-08-01T19:56:30.866 INFO:teuthology.orchestra.run.smithi155.stdout: }, 2023-08-01T19:56:30.866 INFO:teuthology.orchestra.run.smithi155.stdout: { 2023-08-01T19:56:30.866 INFO:teuthology.orchestra.run.smithi155.stdout: "event": "reached_pg", 2023-08-01T19:56:30.866 INFO:teuthology.orchestra.run.smithi155.stdout: "time": "2023-08-01T19:55:58.582274+0000", 2023-08-01T19:56:30.866 INFO:teuthology.orchestra.run.smithi155.stdout: "duration": 3.0074e-05 2023-08-01T19:56:30.866 INFO:teuthology.orchestra.run.smithi155.stdout: }, 2023-08-01T19:56:30.866 INFO:teuthology.orchestra.run.smithi155.stdout: { 2023-08-01T19:56:30.866 INFO:teuthology.orchestra.run.smithi155.stdout: "event": "waiting for peered", 2023-08-01T19:56:30.867 INFO:teuthology.orchestra.run.smithi155.stdout: "time": "2023-08-01T19:55:58.582281+0000", 2023-08-01T19:56:30.867 INFO:teuthology.orchestra.run.smithi155.stdout: "duration": 6.297e-06 2023-08-01T19:56:30.867 INFO:teuthology.orchestra.run.smithi155.stdout: }, 2023-08-01T19:56:30.867 INFO:teuthology.orchestra.run.smithi155.stdout: { 2023-08-01T19:56:30.867 INFO:teuthology.orchestra.run.smithi155.stdout: "event": "reached_pg", 2023-08-01T19:56:30.867 INFO:teuthology.orchestra.run.smithi155.stdout: "time": "2023-08-01T19:55:59.586809+0000", 2023-08-01T19:56:30.867 INFO:teuthology.orchestra.run.smithi155.stdout: "duration": 1.0045281720000001 2023-08-01T19:56:30.867 INFO:teuthology.orchestra.run.smithi155.stdout: }, 2023-08-01T19:56:30.868 INFO:teuthology.orchestra.run.smithi155.stdout: { 2023-08-01T19:56:30.868 INFO:teuthology.orchestra.run.smithi155.stdout: "event": "started", 2023-08-01T19:56:30.868 INFO:teuthology.orchestra.run.smithi155.stdout: "time": "2023-08-01T19:55:59.586910+0000", 2023-08-01T19:56:30.868 INFO:teuthology.orchestra.run.smithi155.stdout: "duration": 0.000100898 2023-08-01T19:56:30.868 INFO:teuthology.orchestra.run.smithi155.stdout: }, 2023-08-01T19:56:30.868 INFO:teuthology.orchestra.run.smithi155.stdout: { 2023-08-01T19:56:30.868 INFO:teuthology.orchestra.run.smithi155.stdout: "event": "op_commit", 2023-08-01T19:56:30.869 INFO:teuthology.orchestra.run.smithi155.stdout: "time": "2023-08-01T19:55:59.591679+0000", 2023-08-01T19:56:30.869 INFO:teuthology.orchestra.run.smithi155.stdout: "duration": 0.004769471 2023-08-01T19:56:30.869 INFO:teuthology.orchestra.run.smithi155.stdout: }, 2023-08-01T19:56:30.869 INFO:teuthology.orchestra.run.smithi155.stdout: { 2023-08-01T19:56:30.869 INFO:teuthology.orchestra.run.smithi155.stdout: "event": "commit_sent", 2023-08-01T19:56:30.869 INFO:teuthology.orchestra.run.smithi155.stdout: "time": "2023-08-01T19:55:59.591721+0000", 2023-08-01T19:56:30.869 INFO:teuthology.orchestra.run.smithi155.stdout: "duration": 4.1953000000000003e-05 2023-08-01T19:56:30.869 INFO:teuthology.orchestra.run.smithi155.stdout: }, 2023-08-01T19:56:30.870 INFO:teuthology.orchestra.run.smithi155.stdout: { 2023-08-01T19:56:30.870 INFO:teuthology.orchestra.run.smithi155.stdout: "event": "done", 2023-08-01T19:56:30.870 INFO:teuthology.orchestra.run.smithi155.stdout: "time": "2023-08-01T19:55:59.591765+0000", 2023-08-01T19:56:30.870 INFO:teuthology.orchestra.run.smithi155.stdout: "duration": 4.4030999999999999e-05 2023-08-01T19:56:30.870 INFO:teuthology.orchestra.run.smithi155.stdout: } 2023-08-01T19:56:30.870 INFO:teuthology.orchestra.run.smithi155.stdout: ] 2023-08-01T19:56:30.870 INFO:teuthology.orchestra.run.smithi155.stdout: } 2023-08-01T19:56:30.871 INFO:teuthology.orchestra.run.smithi155.stdout: } 2023-08-01T19:56:30.871 INFO:teuthology.orchestra.run.smithi155.stdout: ] 2023-08-01T19:56:30.871 INFO:teuthology.orchestra.run.smithi155.stdout:} 2023-08-01T19:56:30.871 DEBUG:teuthology.orchestra.run.smithi006:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 120 ceph --cluster ceph -- tell 'osd.*' injectargs --osd_enable_op_tracker=false 2023-08-01T19:56:30.873 INFO:tasks.ceph.osd.0.smithi008.stderr:2023-08-01T19:56:30.871+0000 7f16a58f4700 -1 received signal: Hangup from /usr/bin/python3 /bin/daemon-helper kill ceph-osd -f --cluster ceph -i 0 (PID: 111179) UID: 0 2023-08-01T19:56:30.873 DEBUG:teuthology.orchestra.run.smithi008:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 30 ceph --cluster ceph --admin-daemon /var/run/ceph/ceph-osd.0.asok dump_ops_in_flight 2023-08-01T19:56:30.972 INFO:tasks.ceph.osd.2.smithi155.stderr:2023-08-01T19:56:30.971+0000 7faa5c6ac700 -1 received signal: Hangup from /usr/bin/python3 /bin/daemon-helper kill ceph-osd -f --cluster ceph -i 2 (PID: 111337) UID: 0 2023-08-01T19:56:31.018 INFO:teuthology.orchestra.run.smithi006.stdout:osd.0: {} 2023-08-01T19:56:31.037 INFO:teuthology.orchestra.run.smithi006.stdout:osd.2: {} 2023-08-01T19:56:31.037 INFO:teuthology.orchestra.run.smithi006.stderr:osd.0: osd_enable_op_tracker = 'false' 2023-08-01T19:56:31.037 INFO:teuthology.orchestra.run.smithi006.stderr:Error ENXIO: problem getting command descriptions from osd.1 2023-08-01T19:56:31.038 INFO:teuthology.orchestra.run.smithi006.stderr:osd.2: osd_enable_op_tracker = 'false' 2023-08-01T19:56:31.039 DEBUG:teuthology.orchestra.run:got remote process result: 6 2023-08-01T19:56:31.040 INFO:tasks.thrashosds.thrasher:Failed to tell all osds, ignoring 2023-08-01T19:56:31.064 INFO:teuthology.orchestra.run.smithi008.stdout:ERROR: (22) Invalid argument 2023-08-01T19:56:31.065 INFO:teuthology.orchestra.run.smithi008.stdout:op_tracker tracking is not enabled now, so no ops are tracked currently, even those get stuck. Please enable "osd_enable_op_tracker", and the tracker will start to track new ops received afterwards. 2023-08-01T19:56:31.074 INFO:tasks.ceph.osd.0.smithi008.stderr:2023-08-01T19:56:31.073+0000 7f16a58f4700 -1 received signal: Hangup from /usr/bin/python3 /bin/daemon-helper kill ceph-osd -f --cluster ceph -i 0 (PID: 111179) UID: 0 2023-08-01T19:56:31.079 DEBUG:teuthology.orchestra.run.smithi008:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 30 ceph --cluster ceph --admin-daemon /var/run/ceph/ceph-osd.0.asok dump_blocked_ops 2023-08-01T19:56:31.174 INFO:tasks.ceph.osd.2.smithi155.stderr:2023-08-01T19:56:31.172+0000 7faa5c6ac700 -1 received signal: Hangup from /usr/bin/python3 /bin/daemon-helper kill ceph-osd -f --cluster ceph -i 2 (PID: 111337) UID: 0 2023-08-01T19:56:31.275 INFO:tasks.ceph.osd.0.smithi008.stderr:2023-08-01T19:56:31.274+0000 7f16a58f4700 -1 received signal: Hangup from /usr/bin/python3 /bin/daemon-helper kill ceph-osd -f --cluster ceph -i 0 (PID: 111179) UID: 0 2023-08-01T19:56:31.308 INFO:teuthology.orchestra.run.smithi008.stdout:ERROR: (22) Invalid argument 2023-08-01T19:56:31.309 INFO:teuthology.orchestra.run.smithi008.stdout:op_tracker tracking is not enabled now, so no ops are tracked currently, even those get stuck. Please enable "osd_enable_op_tracker", and the tracker will start to track new ops received afterwards. 2023-08-01T19:56:31.323 DEBUG:teuthology.orchestra.run.smithi008:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 30 ceph --cluster ceph --admin-daemon /var/run/ceph/ceph-osd.0.asok dump_historic_ops 2023-08-01T19:56:31.406 INFO:tasks.ceph.osd.0.smithi008.stderr:2023-08-01T19:56:31.406+0000 7f16a58f4700 -1 received signal: Hangup from /usr/bin/python3 /bin/daemon-helper kill ceph-osd -f --cluster ceph -i 0 (PID: 111179) UID: 0 2023-08-01T19:56:31.476 INFO:tasks.ceph.osd.2.smithi155.stderr:2023-08-01T19:56:31.474+0000 7faa5c6ac700 -1 received signal: Hangup from /usr/bin/python3 /bin/daemon-helper kill ceph-osd -f --cluster ceph -i 2 (PID: 111337) UID: 0 2023-08-01T19:56:31.551 INFO:teuthology.orchestra.run.smithi008.stdout:ERROR: (22) Invalid argument 2023-08-01T19:56:31.551 INFO:teuthology.orchestra.run.smithi008.stdout:op_tracker tracking is not enabled now, so no ops are tracked currently, even those get stuck. Please enable "osd_enable_op_tracker", and the tracker will start to track new ops received afterwards. 2023-08-01T19:56:31.565 DEBUG:teuthology.orchestra.run.smithi155:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 30 ceph --cluster ceph --admin-daemon /var/run/ceph/ceph-osd.2.asok dump_ops_in_flight 2023-08-01T19:56:31.606 INFO:tasks.ceph.osd.0.smithi008.stderr:2023-08-01T19:56:31.605+0000 7f16a58f4700 -1 received signal: Hangup from /usr/bin/python3 /bin/daemon-helper kill ceph-osd -f --cluster ceph -i 0 (PID: 111179) UID: 0 2023-08-01T19:56:31.677 INFO:tasks.ceph.osd.0.smithi008.stderr:2023-08-01T19:56:31.676+0000 7f16a58f4700 -1 received signal: Hangup from /usr/bin/python3 /bin/daemon-helper kill ceph-osd -f --cluster ceph -i 0 (PID: 111179) UID: 0 2023-08-01T19:56:31.751 INFO:teuthology.orchestra.run.smithi155.stdout:ERROR: (22) Invalid argument 2023-08-01T19:56:31.751 INFO:teuthology.orchestra.run.smithi155.stdout:op_tracker tracking is not enabled now, so no ops are tracked currently, even those get stuck. Please enable "osd_enable_op_tracker", and the tracker will start to track new ops received afterwards. 2023-08-01T19:56:31.764 DEBUG:teuthology.orchestra.run.smithi155:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 30 ceph --cluster ceph --admin-daemon /var/run/ceph/ceph-osd.2.asok dump_blocked_ops 2023-08-01T19:56:31.808 INFO:tasks.ceph.osd.2.smithi155.stderr:2023-08-01T19:56:31.806+0000 7faa5c6ac700 -1 received signal: Hangup from /usr/bin/python3 /bin/daemon-helper kill ceph-osd -f --cluster ceph -i 2 (PID: 111337) UID: 0 2023-08-01T19:56:31.878 INFO:tasks.ceph.osd.2.smithi155.stderr:2023-08-01T19:56:31.877+0000 7faa5c6ac700 -1 received signal: Hangup from /usr/bin/python3 /bin/daemon-helper kill ceph-osd -f --cluster ceph -i 2 (PID: 111337) UID: 0 2023-08-01T19:56:31.926 INFO:teuthology.orchestra.run.smithi155.stdout:ERROR: (22) Invalid argument 2023-08-01T19:56:31.927 INFO:teuthology.orchestra.run.smithi155.stdout:op_tracker tracking is not enabled now, so no ops are tracked currently, even those get stuck. Please enable "osd_enable_op_tracker", and the tracker will start to track new ops received afterwards. 2023-08-01T19:56:31.939 DEBUG:teuthology.orchestra.run.smithi155:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 30 ceph --cluster ceph --admin-daemon /var/run/ceph/ceph-osd.2.asok dump_historic_ops 2023-08-01T19:56:31.979 INFO:tasks.ceph.osd.0.smithi008.stderr:2023-08-01T19:56:31.979+0000 7f16a58f4700 -1 received signal: Hangup from /usr/bin/python3 /bin/daemon-helper kill ceph-osd -f --cluster ceph -i 0 (PID: 111179) UID: 0 2023-08-01T19:56:32.081 INFO:tasks.ceph.osd.2.smithi155.stderr:2023-08-01T19:56:32.079+0000 7faa5c6ac700 -1 received signal: Hangup from /usr/bin/python3 /bin/daemon-helper kill ceph-osd -f --cluster ceph -i 2 (PID: 111337) UID: 0 2023-08-01T19:56:32.095 DEBUG:teuthology.orchestra.run.smithi006:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 120 ceph --cluster ceph osd set noscrub 2023-08-01T19:56:32.140 INFO:teuthology.orchestra.run.smithi155.stdout:ERROR: (22) Invalid argument 2023-08-01T19:56:32.140 INFO:teuthology.orchestra.run.smithi155.stdout:op_tracker tracking is not enabled now, so no ops are tracked currently, even those get stuck. Please enable "osd_enable_op_tracker", and the tracker will start to track new ops received afterwards. 2023-08-01T19:56:32.153 DEBUG:teuthology.orchestra.run.smithi008:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 30 ceph --cluster ceph --admin-daemon /var/run/ceph/ceph-osd.0.asok dump_ops_in_flight 2023-08-01T19:56:32.197 INFO:tasks.ceph.osd.0.smithi008.stderr:2023-08-01T19:56:32.196+0000 7f16a58f4700 -1 received signal: Hangup from /usr/bin/python3 /bin/daemon-helper kill ceph-osd -f --cluster ceph -i 0 (PID: 111179) UID: 0 2023-08-01T19:56:32.204 INFO:tasks.thrashosds.thrasher:in_osds: [0, 1, 2] out_osds: [] dead_osds: [1] live_osds: [0, 2] 2023-08-01T19:56:32.204 INFO:tasks.thrashosds.thrasher:choose_action: min_in 4 min_out 0 min_live 2 min_dead 0 chance_down 1.00 2023-08-01T19:56:32.205 INFO:tasks.thrashosds.thrasher:Reviving osd 1 2023-08-01T19:56:32.205 INFO:tasks.ceph.ceph_manager.ceph:kill_osd on osd.1 doing powercycle of ubuntu@smithi101.front.sepia.ceph.com 2023-08-01T19:56:32.205 INFO:teuthology.orchestra.console.smithi101:Power on 2023-08-01T19:56:32.205 DEBUG:teuthology.orchestra.console.smithi101:pexpect command: ipmitool -H smithi101.ipmi.sepia.ceph.com -I lanplus -U inktank -P ApGNXcA7 power on 2023-08-01T19:56:32.227 DEBUG:teuthology.orchestra.console.smithi101:power on output: Chassis Power Control: Up/On 2023-08-01T19:56:32.228 DEBUG:teuthology.orchestra.console.smithi101:pexpect command: ipmitool -H smithi101.ipmi.sepia.ceph.com -I lanplus -U inktank -P ApGNXcA7 power status 2023-08-01T19:56:32.249 DEBUG:teuthology.orchestra.console.smithi101:check power output: Chassis Power is off 2023-08-01T19:56:32.283 INFO:tasks.ceph.osd.0.smithi008.stderr:2023-08-01T19:56:32.282+0000 7f16a58f4700 -1 received signal: Hangup from /usr/bin/python3 /bin/daemon-helper kill ceph-osd -f --cluster ceph -i 0 (PID: 111179) UID: 0 2023-08-01T19:56:32.336 INFO:teuthology.orchestra.run.smithi008.stdout:ERROR: (22) Invalid argument 2023-08-01T19:56:32.337 INFO:teuthology.orchestra.run.smithi008.stdout:op_tracker tracking is not enabled now, so no ops are tracked currently, even those get stuck. Please enable "osd_enable_op_tracker", and the tracker will start to track new ops received afterwards. 2023-08-01T19:56:32.352 DEBUG:teuthology.orchestra.run.smithi008:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 30 ceph --cluster ceph --admin-daemon /var/run/ceph/ceph-osd.0.asok dump_blocked_ops 2023-08-01T19:56:32.383 INFO:tasks.ceph.osd.2.smithi155.stderr:2023-08-01T19:56:32.382+0000 7faa5c6ac700 -1 received signal: Hangup from /usr/bin/python3 /bin/daemon-helper kill ceph-osd -f --cluster ceph -i 2 (PID: 111337) UID: 0 2023-08-01T19:56:32.484 INFO:tasks.ceph.osd.2.smithi155.stderr:2023-08-01T19:56:32.482+0000 7faa5c6ac700 -1 received signal: Hangup from /usr/bin/python3 /bin/daemon-helper kill ceph-osd -f --cluster ceph -i 2 (PID: 111337) UID: 0 2023-08-01T19:56:32.583 INFO:teuthology.orchestra.run.smithi008.stdout:ERROR: (22) Invalid argument 2023-08-01T19:56:32.583 INFO:teuthology.orchestra.run.smithi008.stdout:op_tracker tracking is not enabled now, so no ops are tracked currently, even those get stuck. Please enable "osd_enable_op_tracker", and the tracker will start to track new ops received afterwards. 2023-08-01T19:56:32.584 INFO:tasks.ceph.osd.0.smithi008.stderr:2023-08-01T19:56:32.583+0000 7f16a58f4700 -1 received signal: Hangup from /usr/bin/python3 /bin/daemon-helper kill ceph-osd -f --cluster ceph -i 0 (PID: 111179) UID: 0 2023-08-01T19:56:32.597 DEBUG:teuthology.orchestra.run.smithi008:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 30 ceph --cluster ceph --admin-daemon /var/run/ceph/ceph-osd.0.asok dump_historic_ops 2023-08-01T19:56:32.685 INFO:tasks.ceph.osd.2.smithi155.stderr:2023-08-01T19:56:32.683+0000 7faa5c6ac700 -1 received signal: Hangup from /usr/bin/python3 /bin/daemon-helper kill ceph-osd -f --cluster ceph -i 2 (PID: 111337) UID: 0 2023-08-01T19:56:32.785 INFO:tasks.ceph.osd.2.smithi155.stderr:2023-08-01T19:56:32.784+0000 7faa5c6ac700 -1 received signal: Hangup from /usr/bin/python3 /bin/daemon-helper kill ceph-osd -f --cluster ceph -i 2 (PID: 111337) UID: 0 2023-08-01T19:56:32.825 INFO:teuthology.orchestra.run.smithi008.stdout:ERROR: (22) Invalid argument 2023-08-01T19:56:32.825 INFO:teuthology.orchestra.run.smithi008.stdout:op_tracker tracking is not enabled now, so no ops are tracked currently, even those get stuck. Please enable "osd_enable_op_tracker", and the tracker will start to track new ops received afterwards. 2023-08-01T19:56:32.839 DEBUG:teuthology.orchestra.run.smithi155:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 30 ceph --cluster ceph --admin-daemon /var/run/ceph/ceph-osd.2.asok dump_ops_in_flight 2023-08-01T19:56:32.886 INFO:tasks.ceph.osd.0.smithi008.stderr:2023-08-01T19:56:32.885+0000 7f16a58f4700 -1 received signal: Hangup from /usr/bin/python3 /bin/daemon-helper kill ceph-osd -f --cluster ceph -i 0 (PID: 111179) UID: 0 2023-08-01T19:56:32.987 INFO:tasks.ceph.osd.0.smithi008.stderr:2023-08-01T19:56:32.986+0000 7f16a58f4700 -1 received signal: Hangup from /usr/bin/python3 /bin/daemon-helper kill ceph-osd -f --cluster ceph -i 0 (PID: 111179) UID: 0 2023-08-01T19:56:33.005 INFO:teuthology.orchestra.run.smithi155.stdout:ERROR: (22) Invalid argument 2023-08-01T19:56:33.006 INFO:teuthology.orchestra.run.smithi155.stdout:op_tracker tracking is not enabled now, so no ops are tracked currently, even those get stuck. Please enable "osd_enable_op_tracker", and the tracker will start to track new ops received afterwards. 2023-08-01T19:56:33.017 DEBUG:teuthology.orchestra.run.smithi155:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 30 ceph --cluster ceph --admin-daemon /var/run/ceph/ceph-osd.2.asok dump_blocked_ops 2023-08-01T19:56:33.041 DEBUG:teuthology.orchestra.run.smithi006:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 120 ceph --cluster ceph -- tell 'osd.*' injectargs --osd_enable_op_tracker=true 2023-08-01T19:56:33.084 INFO:teuthology.orchestra.run.smithi006.stderr:noscrub is set 2023-08-01T19:56:33.088 INFO:tasks.ceph.osd.2.smithi155.stderr:2023-08-01T19:56:33.086+0000 7faa5c6ac700 -1 received signal: Hangup from /usr/bin/python3 /bin/daemon-helper kill ceph-osd -f --cluster ceph -i 2 (PID: 111337) UID: 0 2023-08-01T19:56:33.174 INFO:teuthology.orchestra.run.smithi155.stdout:ERROR: (22) Invalid argument 2023-08-01T19:56:33.174 INFO:teuthology.orchestra.run.smithi155.stdout:op_tracker tracking is not enabled now, so no ops are tracked currently, even those get stuck. Please enable "osd_enable_op_tracker", and the tracker will start to track new ops received afterwards. 2023-08-01T19:56:33.187 DEBUG:teuthology.orchestra.run.smithi155:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 30 ceph --cluster ceph --admin-daemon /var/run/ceph/ceph-osd.2.asok dump_historic_ops 2023-08-01T19:56:33.188 INFO:tasks.ceph.osd.0.smithi008.stderr:2023-08-01T19:56:33.188+0000 7f16a58f4700 -1 received signal: Hangup from /usr/bin/python3 /bin/daemon-helper kill ceph-osd -f --cluster ceph -i 0 (PID: 111179) UID: 0 2023-08-01T19:56:33.197 INFO:teuthology.orchestra.run.smithi006.stdout:osd.0: {} 2023-08-01T19:56:33.210 INFO:tasks.daemonwatchdog.daemon_watchdog:daemon ceph.osd.1 is failed for ~30s 2023-08-01T19:56:33.216 INFO:teuthology.orchestra.run.smithi006.stdout:osd.2: {} 2023-08-01T19:56:33.216 INFO:teuthology.orchestra.run.smithi006.stderr:osd.0: osd_enable_op_tracker = 'true' 2023-08-01T19:56:33.216 INFO:teuthology.orchestra.run.smithi006.stderr:Error ENXIO: problem getting command descriptions from osd.1 2023-08-01T19:56:33.216 INFO:teuthology.orchestra.run.smithi006.stderr:osd.2: osd_enable_op_tracker = 'true' 2023-08-01T19:56:33.218 DEBUG:teuthology.orchestra.run:got remote process result: 6 2023-08-01T19:56:33.219 INFO:tasks.thrashosds.thrasher:Failed to tell all osds, ignoring 2023-08-01T19:56:33.291 INFO:tasks.ceph.osd.0.smithi008.stderr:2023-08-01T19:56:33.290+0000 7f16a58f4700 -1 received signal: Hangup from /usr/bin/python3 /bin/daemon-helper kill ceph-osd -f --cluster ceph -i 0 (PID: 111179) UID: 0 2023-08-01T19:56:33.391 INFO:tasks.ceph.osd.2.smithi155.stderr:2023-08-01T19:56:33.389+0000 7faa5c6ac700 -1 received signal: Hangup from /usr/bin/python3 /bin/daemon-helper kill ceph-osd -f --cluster ceph -i 2 (PID: 111337) UID: 0 2023-08-01T19:56:33.401 INFO:teuthology.orchestra.run.smithi155.stdout:{ 2023-08-01T19:56:33.401 INFO:teuthology.orchestra.run.smithi155.stdout: "size": 20, 2023-08-01T19:56:33.401 INFO:teuthology.orchestra.run.smithi155.stdout: "duration": 600, 2023-08-01T19:56:33.401 INFO:teuthology.orchestra.run.smithi155.stdout: "ops": [ 2023-08-01T19:56:33.402 INFO:teuthology.orchestra.run.smithi155.stdout: { 2023-08-01T19:56:33.402 INFO:teuthology.orchestra.run.smithi155.stdout: "description": "osd_op(client.4668.0:100237 5.4 5:2d68bec9:::benchmark_data_smithi006_114134_object100236:head [set-alloc-hint object_size 65536 write_size 65536,write 0~65536] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e37)", 2023-08-01T19:56:33.402 INFO:teuthology.orchestra.run.smithi155.stdout: "initiated_at": "2023-08-01T19:55:05.147736+0000", 2023-08-01T19:56:33.402 INFO:teuthology.orchestra.run.smithi155.stdout: "age": 88.250640304000001, 2023-08-01T19:56:33.402 INFO:teuthology.orchestra.run.smithi155.stdout: "duration": 0.071299464000000007, 2023-08-01T19:56:33.402 INFO:teuthology.orchestra.run.smithi155.stdout: "type_data": { 2023-08-01T19:56:33.402 INFO:teuthology.orchestra.run.smithi155.stdout: "flag_point": "commit sent; apply or cleanup", 2023-08-01T19:56:33.403 INFO:teuthology.orchestra.run.smithi155.stdout: "client_info": { 2023-08-01T19:56:33.403 INFO:teuthology.orchestra.run.smithi155.stdout: "client": "client.4668", 2023-08-01T19:56:33.403 INFO:teuthology.orchestra.run.smithi155.stdout: "client_addr": "172.21.15.6:0/1709472247", 2023-08-01T19:56:33.403 INFO:teuthology.orchestra.run.smithi155.stdout: "tid": 100237 2023-08-01T19:56:33.403 INFO:teuthology.orchestra.run.smithi155.stdout: }, 2023-08-01T19:56:33.403 INFO:teuthology.orchestra.run.smithi155.stdout: "events": [ 2023-08-01T19:56:33.403 INFO:teuthology.orchestra.run.smithi155.stdout: { 2023-08-01T19:56:33.404 INFO:teuthology.orchestra.run.smithi155.stdout: "event": "initiated", 2023-08-01T19:56:33.404 INFO:teuthology.orchestra.run.smithi155.stdout: "time": "2023-08-01T19:55:05.147736+0000", 2023-08-01T19:56:33.404 INFO:teuthology.orchestra.run.smithi155.stdout: "duration": 0 2023-08-01T19:56:33.404 INFO:teuthology.orchestra.run.smithi155.stdout: }, 2023-08-01T19:56:33.404 INFO:teuthology.orchestra.run.smithi155.stdout: { 2023-08-01T19:56:33.404 INFO:teuthology.orchestra.run.smithi155.stdout: "event": "throttled", 2023-08-01T19:56:33.404 INFO:teuthology.orchestra.run.smithi155.stdout: "time": "2023-08-01T19:55:05.147736+0000", 2023-08-01T19:56:33.404 INFO:teuthology.orchestra.run.smithi155.stdout: "duration": 0 2023-08-01T19:56:33.405 INFO:teuthology.orchestra.run.smithi155.stdout: }, 2023-08-01T19:56:33.405 INFO:teuthology.orchestra.run.smithi155.stdout: { 2023-08-01T19:56:33.405 INFO:teuthology.orchestra.run.smithi155.stdout: "event": "header_read", 2023-08-01T19:56:33.405 INFO:teuthology.orchestra.run.smithi155.stdout: "time": "2023-08-01T19:55:05.147736+0000", 2023-08-01T19:56:33.405 INFO:teuthology.orchestra.run.smithi155.stdout: "duration": 4294967295.9999995 2023-08-01T19:56:33.405 INFO:teuthology.orchestra.run.smithi155.stdout: }, 2023-08-01T19:56:33.405 INFO:teuthology.orchestra.run.smithi155.stdout: { 2023-08-01T19:56:33.406 INFO:teuthology.orchestra.run.smithi155.stdout: "event": "all_read", 2023-08-01T19:56:33.406 INFO:teuthology.orchestra.run.smithi155.stdout: "time": "2023-08-01T19:55:05.147766+0000", 2023-08-01T19:56:33.406 INFO:teuthology.orchestra.run.smithi155.stdout: "duration": 3.0394000000000001e-05 2023-08-01T19:56:33.406 INFO:teuthology.orchestra.run.smithi155.stdout: }, 2023-08-01T19:56:33.406 INFO:teuthology.orchestra.run.smithi155.stdout: { 2023-08-01T19:56:33.406 INFO:teuthology.orchestra.run.smithi155.stdout: "event": "dispatched", 2023-08-01T19:56:33.406 INFO:teuthology.orchestra.run.smithi155.stdout: "time": "2023-08-01T19:55:05.147771+0000", 2023-08-01T19:56:33.406 INFO:teuthology.orchestra.run.smithi155.stdout: "duration": 4.25e-06 2023-08-01T19:56:33.407 INFO:teuthology.orchestra.run.smithi155.stdout: }, 2023-08-01T19:56:33.407 INFO:teuthology.orchestra.run.smithi155.stdout: { 2023-08-01T19:56:33.407 INFO:teuthology.orchestra.run.smithi155.stdout: "event": "queued_for_pg", 2023-08-01T19:56:33.407 INFO:teuthology.orchestra.run.smithi155.stdout: "time": "2023-08-01T19:55:05.147773+0000", 2023-08-01T19:56:33.407 INFO:teuthology.orchestra.run.smithi155.stdout: "duration": 2.4159999999999998e-06 2023-08-01T19:56:33.407 INFO:teuthology.orchestra.run.smithi155.stdout: }, 2023-08-01T19:56:33.408 INFO:teuthology.orchestra.run.smithi155.stdout: { 2023-08-01T19:56:33.408 INFO:teuthology.orchestra.run.smithi155.stdout: "event": "reached_pg", 2023-08-01T19:56:33.408 INFO:teuthology.orchestra.run.smithi155.stdout: "time": "2023-08-01T19:55:05.149903+0000", 2023-08-01T19:56:33.408 INFO:teuthology.orchestra.run.smithi155.stdout: "duration": 0.002129948 2023-08-01T19:56:33.408 INFO:teuthology.orchestra.run.smithi155.stdout: }, 2023-08-01T19:56:33.408 INFO:teuthology.orchestra.run.smithi155.stdout: { 2023-08-01T19:56:33.408 INFO:teuthology.orchestra.run.smithi155.stdout: "event": "started", 2023-08-01T19:56:33.408 INFO:teuthology.orchestra.run.smithi155.stdout: "time": "2023-08-01T19:55:05.149982+0000", 2023-08-01T19:56:33.409 INFO:teuthology.orchestra.run.smithi155.stdout: "duration": 7.8706000000000002e-05 2023-08-01T19:56:33.409 INFO:teuthology.orchestra.run.smithi155.stdout: }, 2023-08-01T19:56:33.409 INFO:teuthology.orchestra.run.smithi155.stdout: { 2023-08-01T19:56:33.409 INFO:teuthology.orchestra.run.smithi155.stdout: "event": "waiting for subops from 0", 2023-08-01T19:56:33.409 INFO:teuthology.orchestra.run.smithi155.stdout: "time": "2023-08-01T19:55:05.150066+0000", 2023-08-01T19:56:33.409 INFO:teuthology.orchestra.run.smithi155.stdout: "duration": 8.4241999999999997e-05 2023-08-01T19:56:33.409 INFO:teuthology.orchestra.run.smithi155.stdout: }, 2023-08-01T19:56:33.410 INFO:teuthology.orchestra.run.smithi155.stdout: { 2023-08-01T19:56:33.410 INFO:teuthology.orchestra.run.smithi155.stdout: "event": "op_commit", 2023-08-01T19:56:33.410 INFO:teuthology.orchestra.run.smithi155.stdout: "time": "2023-08-01T19:55:05.154994+0000", 2023-08-01T19:56:33.410 INFO:teuthology.orchestra.run.smithi155.stdout: "duration": 0.0049277050000000001 2023-08-01T19:56:33.410 INFO:teuthology.orchestra.run.smithi155.stdout: }, 2023-08-01T19:56:33.410 INFO:teuthology.orchestra.run.smithi155.stdout: { 2023-08-01T19:56:33.410 INFO:teuthology.orchestra.run.smithi155.stdout: "event": "sub_op_commit_rec", 2023-08-01T19:56:33.410 INFO:teuthology.orchestra.run.smithi155.stdout: "time": "2023-08-01T19:55:05.218933+0000", 2023-08-01T19:56:33.411 INFO:teuthology.orchestra.run.smithi155.stdout: "duration": 0.063939916999999999 2023-08-01T19:56:33.411 INFO:teuthology.orchestra.run.smithi155.stdout: }, 2023-08-01T19:56:33.411 INFO:teuthology.orchestra.run.smithi155.stdout: { 2023-08-01T19:56:33.411 INFO:teuthology.orchestra.run.smithi155.stdout: "event": "commit_sent", 2023-08-01T19:56:33.411 INFO:teuthology.orchestra.run.smithi155.stdout: "time": "2023-08-01T19:55:05.218989+0000", 2023-08-01T19:56:33.411 INFO:teuthology.orchestra.run.smithi155.stdout: "duration": 5.5772000000000001e-05 2023-08-01T19:56:33.411 INFO:teuthology.orchestra.run.smithi155.stdout: }, 2023-08-01T19:56:33.411 INFO:teuthology.orchestra.run.smithi155.stdout: { 2023-08-01T19:56:33.412 INFO:teuthology.orchestra.run.smithi155.stdout: "event": "done", 2023-08-01T19:56:33.412 INFO:teuthology.orchestra.run.smithi155.stdout: "time": "2023-08-01T19:55:05.219036+0000", 2023-08-01T19:56:33.412 INFO:teuthology.orchestra.run.smithi155.stdout: "duration": 4.6526000000000001e-05 2023-08-01T19:56:33.412 INFO:teuthology.orchestra.run.smithi155.stdout: } 2023-08-01T19:56:33.412 INFO:teuthology.orchestra.run.smithi155.stdout: ] 2023-08-01T19:56:33.412 INFO:teuthology.orchestra.run.smithi155.stdout: } 2023-08-01T19:56:33.412 INFO:teuthology.orchestra.run.smithi155.stdout: }, 2023-08-01T19:56:33.413 INFO:teuthology.orchestra.run.smithi155.stdout: { 2023-08-01T19:56:33.413 INFO:teuthology.orchestra.run.smithi155.stdout: "description": "osd_op(client.4668.0:100242 5.8 5:16a314b8:::benchmark_data_smithi006_114134_object100241:head [set-alloc-hint object_size 65536 write_size 65536,write 0~65536] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e37)", 2023-08-01T19:56:33.413 INFO:teuthology.orchestra.run.smithi155.stdout: "initiated_at": "2023-08-01T19:55:05.150616+0000", 2023-08-01T19:56:33.413 INFO:teuthology.orchestra.run.smithi155.stdout: "age": 88.247760674000006, 2023-08-01T19:56:33.413 INFO:teuthology.orchestra.run.smithi155.stdout: "duration": 0.071105065999999995, 2023-08-01T19:56:33.413 INFO:teuthology.orchestra.run.smithi155.stdout: "type_data": { 2023-08-01T19:56:33.413 INFO:teuthology.orchestra.run.smithi155.stdout: "flag_point": "commit sent; apply or cleanup", 2023-08-01T19:56:33.413 INFO:teuthology.orchestra.run.smithi155.stdout: "client_info": { 2023-08-01T19:56:33.414 INFO:teuthology.orchestra.run.smithi155.stdout: "client": "client.4668", 2023-08-01T19:56:33.414 INFO:teuthology.orchestra.run.smithi155.stdout: "client_addr": "172.21.15.6:0/1709472247", 2023-08-01T19:56:33.414 INFO:teuthology.orchestra.run.smithi155.stdout: "tid": 100242 2023-08-01T19:56:33.414 INFO:teuthology.orchestra.run.smithi155.stdout: }, 2023-08-01T19:56:33.414 INFO:teuthology.orchestra.run.smithi155.stdout: "events": [ 2023-08-01T19:56:33.414 INFO:teuthology.orchestra.run.smithi155.stdout: { 2023-08-01T19:56:33.414 INFO:teuthology.orchestra.run.smithi155.stdout: "event": "initiated", 2023-08-01T19:56:33.415 INFO:teuthology.orchestra.run.smithi155.stdout: "time": "2023-08-01T19:55:05.150616+0000", 2023-08-01T19:56:33.415 INFO:teuthology.orchestra.run.smithi155.stdout: "duration": 0 2023-08-01T19:56:33.415 INFO:teuthology.orchestra.run.smithi155.stdout: }, 2023-08-01T19:56:33.415 INFO:teuthology.orchestra.run.smithi155.stdout: { 2023-08-01T19:56:33.415 INFO:teuthology.orchestra.run.smithi155.stdout: "event": "throttled", 2023-08-01T19:56:33.415 INFO:teuthology.orchestra.run.smithi155.stdout: "time": "2023-08-01T19:55:05.150616+0000", 2023-08-01T19:56:33.415 INFO:teuthology.orchestra.run.smithi155.stdout: "duration": 0 2023-08-01T19:56:33.415 INFO:teuthology.orchestra.run.smithi155.stdout: }, 2023-08-01T19:56:33.416 INFO:teuthology.orchestra.run.smithi155.stdout: { 2023-08-01T19:56:33.416 INFO:teuthology.orchestra.run.smithi155.stdout: "event": "header_read", 2023-08-01T19:56:33.416 INFO:teuthology.orchestra.run.smithi155.stdout: "time": "2023-08-01T19:55:05.150615+0000", 2023-08-01T19:56:33.416 INFO:teuthology.orchestra.run.smithi155.stdout: "duration": 4294967295.999999 2023-08-01T19:56:33.416 INFO:teuthology.orchestra.run.smithi155.stdout: }, 2023-08-01T19:56:33.416 INFO:teuthology.orchestra.run.smithi155.stdout: { 2023-08-01T19:56:33.416 INFO:teuthology.orchestra.run.smithi155.stdout: "event": "all_read", 2023-08-01T19:56:33.416 INFO:teuthology.orchestra.run.smithi155.stdout: "time": "2023-08-01T19:55:05.150696+0000", 2023-08-01T19:56:33.417 INFO:teuthology.orchestra.run.smithi155.stdout: "duration": 8.0852000000000004e-05 2023-08-01T19:56:33.417 INFO:teuthology.orchestra.run.smithi155.stdout: }, 2023-08-01T19:56:33.417 INFO:teuthology.orchestra.run.smithi155.stdout: { 2023-08-01T19:56:33.417 INFO:teuthology.orchestra.run.smithi155.stdout: "event": "dispatched", 2023-08-01T19:56:33.417 INFO:teuthology.orchestra.run.smithi155.stdout: "time": "2023-08-01T19:55:05.150708+0000", 2023-08-01T19:56:33.417 INFO:teuthology.orchestra.run.smithi155.stdout: "duration": 1.2116999999999999e-05 2023-08-01T19:56:33.417 INFO:teuthology.orchestra.run.smithi155.stdout: }, 2023-08-01T19:56:33.418 INFO:teuthology.orchestra.run.smithi155.stdout: { 2023-08-01T19:56:33.418 INFO:teuthology.orchestra.run.smithi155.stdout: "event": "queued_for_pg", 2023-08-01T19:56:33.418 INFO:teuthology.orchestra.run.smithi155.stdout: "time": "2023-08-01T19:55:05.150713+0000", 2023-08-01T19:56:33.418 INFO:teuthology.orchestra.run.smithi155.stdout: "duration": 5.4620000000000004e-06 2023-08-01T19:56:33.418 INFO:teuthology.orchestra.run.smithi155.stdout: }, 2023-08-01T19:56:33.418 INFO:teuthology.orchestra.run.smithi155.stdout: { 2023-08-01T19:56:33.418 INFO:teuthology.orchestra.run.smithi155.stdout: "event": "reached_pg", 2023-08-01T19:56:33.418 INFO:teuthology.orchestra.run.smithi155.stdout: "time": "2023-08-01T19:55:05.150761+0000", 2023-08-01T19:56:33.419 INFO:teuthology.orchestra.run.smithi155.stdout: "duration": 4.7429000000000003e-05 2023-08-01T19:56:33.419 INFO:teuthology.orchestra.run.smithi155.stdout: }, 2023-08-01T19:56:33.419 INFO:teuthology.orchestra.run.smithi155.stdout: { 2023-08-01T19:56:33.419 INFO:teuthology.orchestra.run.smithi155.stdout: "event": "started", 2023-08-01T19:56:33.419 INFO:teuthology.orchestra.run.smithi155.stdout: "time": "2023-08-01T19:55:05.150856+0000", 2023-08-01T19:56:33.419 INFO:teuthology.orchestra.run.smithi155.stdout: "duration": 9.5356e-05 2023-08-01T19:56:33.419 INFO:teuthology.orchestra.run.smithi155.stdout: }, 2023-08-01T19:56:33.419 INFO:teuthology.orchestra.run.smithi155.stdout: { 2023-08-01T19:56:33.420 INFO:teuthology.orchestra.run.smithi155.stdout: "event": "waiting for subops from 0", 2023-08-01T19:56:33.420 INFO:teuthology.orchestra.run.smithi155.stdout: "time": "2023-08-01T19:55:05.150999+0000", 2023-08-01T19:56:33.420 INFO:teuthology.orchestra.run.smithi155.stdout: "duration": 0.00014234499999999999 2023-08-01T19:56:33.420 INFO:teuthology.orchestra.run.smithi155.stdout: }, 2023-08-01T19:56:33.420 INFO:teuthology.orchestra.run.smithi155.stdout: { 2023-08-01T19:56:33.420 INFO:teuthology.orchestra.run.smithi155.stdout: "event": "sub_op_commit_rec", 2023-08-01T19:56:33.420 INFO:teuthology.orchestra.run.smithi155.stdout: "time": "2023-08-01T19:55:05.219001+0000", 2023-08-01T19:56:33.421 INFO:teuthology.orchestra.run.smithi155.stdout: "duration": 0.068002776000000001 2023-08-01T19:56:33.421 INFO:teuthology.orchestra.run.smithi155.stdout: }, 2023-08-01T19:56:33.421 INFO:teuthology.orchestra.run.smithi155.stdout: { 2023-08-01T19:56:33.421 INFO:teuthology.orchestra.run.smithi155.stdout: "event": "op_commit", 2023-08-01T19:56:33.421 INFO:teuthology.orchestra.run.smithi155.stdout: "time": "2023-08-01T19:55:05.221635+0000", 2023-08-01T19:56:33.421 INFO:teuthology.orchestra.run.smithi155.stdout: "duration": 0.0026340579999999999 2023-08-01T19:56:33.421 INFO:teuthology.orchestra.run.smithi155.stdout: }, 2023-08-01T19:56:33.421 INFO:teuthology.orchestra.run.smithi155.stdout: { 2023-08-01T19:56:33.422 INFO:teuthology.orchestra.run.smithi155.stdout: "event": "commit_sent", 2023-08-01T19:56:33.422 INFO:teuthology.orchestra.run.smithi155.stdout: "time": "2023-08-01T19:55:05.221682+0000", 2023-08-01T19:56:33.422 INFO:teuthology.orchestra.run.smithi155.stdout: "duration": 4.7123999999999998e-05 2023-08-01T19:56:33.422 INFO:teuthology.orchestra.run.smithi155.stdout: }, 2023-08-01T19:56:33.422 INFO:teuthology.orchestra.run.smithi155.stdout: { 2023-08-01T19:56:33.422 INFO:teuthology.orchestra.run.smithi155.stdout: "event": "done", 2023-08-01T19:56:33.422 INFO:teuthology.orchestra.run.smithi155.stdout: "time": "2023-08-01T19:55:05.221721+0000", 2023-08-01T19:56:33.422 INFO:teuthology.orchestra.run.smithi155.stdout: "duration": 3.8529999999999999e-05 2023-08-01T19:56:33.423 INFO:teuthology.orchestra.run.smithi155.stdout: } 2023-08-01T19:56:33.423 INFO:teuthology.orchestra.run.smithi155.stdout: ] 2023-08-01T19:56:33.423 INFO:teuthology.orchestra.run.smithi155.stdout: } 2023-08-01T19:56:33.423 INFO:teuthology.orchestra.run.smithi155.stdout: }, 2023-08-01T19:56:33.423 INFO:teuthology.orchestra.run.smithi155.stdout: { 2023-08-01T19:56:33.423 INFO:teuthology.orchestra.run.smithi155.stdout: "description": "osd_repop(client.4668.0:100240 5.a e37/19 5:5313c5b9:::benchmark_data_smithi006_114134_object100239:head v 37'6227, mlcod=37'6225)", 2023-08-01T19:56:33.423 INFO:teuthology.orchestra.run.smithi155.stdout: "initiated_at": "2023-08-01T19:55:05.150778+0000", 2023-08-01T19:56:33.423 INFO:teuthology.orchestra.run.smithi155.stdout: "age": 88.247598472999996, 2023-08-01T19:56:33.424 INFO:teuthology.orchestra.run.smithi155.stdout: "duration": 0.073362533999999993, 2023-08-01T19:56:33.424 INFO:teuthology.orchestra.run.smithi155.stdout: "type_data": { 2023-08-01T19:56:33.424 INFO:teuthology.orchestra.run.smithi155.stdout: "flag_point": "commit sent; apply or cleanup", 2023-08-01T19:56:33.424 INFO:teuthology.orchestra.run.smithi155.stdout: "events": [ 2023-08-01T19:56:33.424 INFO:teuthology.orchestra.run.smithi155.stdout: { 2023-08-01T19:56:33.424 INFO:teuthology.orchestra.run.smithi155.stdout: "event": "initiated", 2023-08-01T19:56:33.424 INFO:teuthology.orchestra.run.smithi155.stdout: "time": "2023-08-01T19:55:05.150778+0000", 2023-08-01T19:56:33.425 INFO:teuthology.orchestra.run.smithi155.stdout: "duration": 0 2023-08-01T19:56:33.425 INFO:teuthology.orchestra.run.smithi155.stdout: }, 2023-08-01T19:56:33.425 INFO:teuthology.orchestra.run.smithi155.stdout: { 2023-08-01T19:56:33.425 INFO:teuthology.orchestra.run.smithi155.stdout: "event": "throttled", 2023-08-01T19:56:33.425 INFO:teuthology.orchestra.run.smithi155.stdout: "time": "2023-08-01T19:55:05.150778+0000", 2023-08-01T19:56:33.425 INFO:teuthology.orchestra.run.smithi155.stdout: "duration": 0 2023-08-01T19:56:33.425 INFO:teuthology.orchestra.run.smithi155.stdout: }, 2023-08-01T19:56:33.426 INFO:teuthology.orchestra.run.smithi155.stdout: { 2023-08-01T19:56:33.426 INFO:teuthology.orchestra.run.smithi155.stdout: "event": "header_read", 2023-08-01T19:56:33.426 INFO:teuthology.orchestra.run.smithi155.stdout: "time": "2023-08-01T19:55:05.150778+0000", 2023-08-01T19:56:33.426 INFO:teuthology.orchestra.run.smithi155.stdout: "duration": 4294967295.9999995 2023-08-01T19:56:33.426 INFO:teuthology.orchestra.run.smithi155.stdout: }, 2023-08-01T19:56:33.426 INFO:teuthology.orchestra.run.smithi155.stdout: { 2023-08-01T19:56:33.426 INFO:teuthology.orchestra.run.smithi155.stdout: "event": "all_read", 2023-08-01T19:56:33.427 INFO:teuthology.orchestra.run.smithi155.stdout: "time": "2023-08-01T19:55:05.150811+0000", 2023-08-01T19:56:33.427 INFO:teuthology.orchestra.run.smithi155.stdout: "duration": 3.3664000000000002e-05 2023-08-01T19:56:33.427 INFO:teuthology.orchestra.run.smithi155.stdout: }, 2023-08-01T19:56:33.427 INFO:teuthology.orchestra.run.smithi155.stdout: { 2023-08-01T19:56:33.427 INFO:teuthology.orchestra.run.smithi155.stdout: "event": "dispatched", 2023-08-01T19:56:33.427 INFO:teuthology.orchestra.run.smithi155.stdout: "time": "2023-08-01T19:55:05.150818+0000", 2023-08-01T19:56:33.427 INFO:teuthology.orchestra.run.smithi155.stdout: "duration": 6.5769999999999999e-06 2023-08-01T19:56:33.427 INFO:teuthology.orchestra.run.smithi155.stdout: }, 2023-08-01T19:56:33.428 INFO:teuthology.orchestra.run.smithi155.stdout: { 2023-08-01T19:56:33.428 INFO:teuthology.orchestra.run.smithi155.stdout: "event": "queued_for_pg", 2023-08-01T19:56:33.428 INFO:teuthology.orchestra.run.smithi155.stdout: "time": "2023-08-01T19:55:05.150822+0000", 2023-08-01T19:56:33.428 INFO:teuthology.orchestra.run.smithi155.stdout: "duration": 4.0060000000000003e-06 2023-08-01T19:56:33.428 INFO:teuthology.orchestra.run.smithi155.stdout: }, 2023-08-01T19:56:33.428 INFO:teuthology.orchestra.run.smithi155.stdout: { 2023-08-01T19:56:33.428 INFO:teuthology.orchestra.run.smithi155.stdout: "event": "reached_pg", 2023-08-01T19:56:33.429 INFO:teuthology.orchestra.run.smithi155.stdout: "time": "2023-08-01T19:55:05.150855+0000", 2023-08-01T19:56:33.429 INFO:teuthology.orchestra.run.smithi155.stdout: "duration": 3.3204999999999998e-05 2023-08-01T19:56:33.429 INFO:teuthology.orchestra.run.smithi155.stdout: }, 2023-08-01T19:56:33.429 INFO:teuthology.orchestra.run.smithi155.stdout: { 2023-08-01T19:56:33.429 INFO:teuthology.orchestra.run.smithi155.stdout: "event": "started", 2023-08-01T19:56:33.429 INFO:teuthology.orchestra.run.smithi155.stdout: "time": "2023-08-01T19:55:05.150873+0000", 2023-08-01T19:56:33.429 INFO:teuthology.orchestra.run.smithi155.stdout: "duration": 1.8139999999999999e-05 2023-08-01T19:56:33.429 INFO:teuthology.orchestra.run.smithi155.stdout: }, 2023-08-01T19:56:33.430 INFO:teuthology.orchestra.run.smithi155.stdout: { 2023-08-01T19:56:33.430 INFO:teuthology.orchestra.run.smithi155.stdout: "event": "commit_sent", 2023-08-01T19:56:33.430 INFO:teuthology.orchestra.run.smithi155.stdout: "time": "2023-08-01T19:55:05.224095+0000", 2023-08-01T19:56:33.430 INFO:teuthology.orchestra.run.smithi155.stdout: "duration": 0.073221895999999995 2023-08-01T19:56:33.430 INFO:teuthology.orchestra.run.smithi155.stdout: }, 2023-08-01T19:56:33.430 INFO:teuthology.orchestra.run.smithi155.stdout: { 2023-08-01T19:56:33.430 INFO:teuthology.orchestra.run.smithi155.stdout: "event": "done", 2023-08-01T19:56:33.431 INFO:teuthology.orchestra.run.smithi155.stdout: "time": "2023-08-01T19:55:05.224141+0000", 2023-08-01T19:56:33.431 INFO:teuthology.orchestra.run.smithi155.stdout: "duration": 4.5385e-05 2023-08-01T19:56:33.431 INFO:teuthology.orchestra.run.smithi155.stdout: } 2023-08-01T19:56:33.431 INFO:teuthology.orchestra.run.smithi155.stdout: ] 2023-08-01T19:56:33.431 INFO:teuthology.orchestra.run.smithi155.stdout: } 2023-08-01T19:56:33.431 INFO:teuthology.orchestra.run.smithi155.stdout: }, 2023-08-01T19:56:33.432 INFO:teuthology.orchestra.run.smithi155.stdout: { 2023-08-01T19:56:33.432 INFO:teuthology.orchestra.run.smithi155.stdout: "description": "osd_op(client.4668.0:100245 5.e 5:71869c66:::benchmark_data_smithi006_114134_object100244:head [set-alloc-hint object_size 65536 write_size 65536,write 0~65536] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e37)", 2023-08-01T19:56:33.432 INFO:teuthology.orchestra.run.smithi155.stdout: "initiated_at": "2023-08-01T19:55:05.150991+0000", 2023-08-01T19:56:33.432 INFO:teuthology.orchestra.run.smithi155.stdout: "age": 88.247385686000001, 2023-08-01T19:56:33.432 INFO:teuthology.orchestra.run.smithi155.stdout: "duration": 0.070734490999999997, 2023-08-01T19:56:33.432 INFO:teuthology.orchestra.run.smithi155.stdout: "type_data": { 2023-08-01T19:56:33.432 INFO:teuthology.orchestra.run.smithi155.stdout: "flag_point": "commit sent; apply or cleanup", 2023-08-01T19:56:33.433 INFO:teuthology.orchestra.run.smithi155.stdout: "client_info": { 2023-08-01T19:56:33.433 INFO:teuthology.orchestra.run.smithi155.stdout: "client": "client.4668", 2023-08-01T19:56:33.433 INFO:teuthology.orchestra.run.smithi155.stdout: "client_addr": "172.21.15.6:0/1709472247", 2023-08-01T19:56:33.433 INFO:teuthology.orchestra.run.smithi155.stdout: "tid": 100245 2023-08-01T19:56:33.433 INFO:teuthology.orchestra.run.smithi155.stdout: }, 2023-08-01T19:56:33.433 INFO:teuthology.orchestra.run.smithi155.stdout: "events": [ 2023-08-01T19:56:33.433 INFO:teuthology.orchestra.run.smithi155.stdout: { 2023-08-01T19:56:33.433 INFO:teuthology.orchestra.run.smithi155.stdout: "event": "initiated", 2023-08-01T19:56:33.434 INFO:teuthology.orchestra.run.smithi155.stdout: "time": "2023-08-01T19:55:05.150991+0000", 2023-08-01T19:56:33.434 INFO:teuthology.orchestra.run.smithi155.stdout: "duration": 0 2023-08-01T19:56:33.434 INFO:teuthology.orchestra.run.smithi155.stdout: }, 2023-08-01T19:56:33.434 INFO:teuthology.orchestra.run.smithi155.stdout: { 2023-08-01T19:56:33.434 INFO:teuthology.orchestra.run.smithi155.stdout: "event": "throttled", 2023-08-01T19:56:33.434 INFO:teuthology.orchestra.run.smithi155.stdout: "time": "2023-08-01T19:55:05.150991+0000", 2023-08-01T19:56:33.435 INFO:teuthology.orchestra.run.smithi155.stdout: "duration": 0 2023-08-01T19:56:33.435 INFO:teuthology.orchestra.run.smithi155.stdout: }, 2023-08-01T19:56:33.435 INFO:teuthology.orchestra.run.smithi155.stdout: { 2023-08-01T19:56:33.435 INFO:teuthology.orchestra.run.smithi155.stdout: "event": "header_read", 2023-08-01T19:56:33.435 INFO:teuthology.orchestra.run.smithi155.stdout: "time": "2023-08-01T19:55:05.150990+0000", 2023-08-01T19:56:33.435 INFO:teuthology.orchestra.run.smithi155.stdout: "duration": 4294967295.999999 2023-08-01T19:56:33.435 INFO:teuthology.orchestra.run.smithi155.stdout: }, 2023-08-01T19:56:33.436 INFO:teuthology.orchestra.run.smithi155.stdout: { 2023-08-01T19:56:33.436 INFO:teuthology.orchestra.run.smithi155.stdout: "event": "all_read", 2023-08-01T19:56:33.436 INFO:teuthology.orchestra.run.smithi155.stdout: "time": "2023-08-01T19:55:05.151108+0000", 2023-08-01T19:56:33.436 INFO:teuthology.orchestra.run.smithi155.stdout: "duration": 0.00011849300000000001 2023-08-01T19:56:33.436 INFO:teuthology.orchestra.run.smithi155.stdout: }, 2023-08-01T19:56:33.436 INFO:teuthology.orchestra.run.smithi155.stdout: { 2023-08-01T19:56:33.436 INFO:teuthology.orchestra.run.smithi155.stdout: "event": "dispatched", 2023-08-01T19:56:33.437 INFO:teuthology.orchestra.run.smithi155.stdout: "time": "2023-08-01T19:55:05.151117+0000", 2023-08-01T19:56:33.437 INFO:teuthology.orchestra.run.smithi155.stdout: "duration": 8.1040000000000007e-06 2023-08-01T19:56:33.437 INFO:teuthology.orchestra.run.smithi155.stdout: }, 2023-08-01T19:56:33.437 INFO:teuthology.orchestra.run.smithi155.stdout: { 2023-08-01T19:56:33.437 INFO:teuthology.orchestra.run.smithi155.stdout: "event": "queued_for_pg", 2023-08-01T19:56:33.437 INFO:teuthology.orchestra.run.smithi155.stdout: "time": "2023-08-01T19:55:05.151121+0000", 2023-08-01T19:56:33.437 INFO:teuthology.orchestra.run.smithi155.stdout: "duration": 4.2019999999999997e-06 2023-08-01T19:56:33.438 INFO:teuthology.orchestra.run.smithi155.stdout: }, 2023-08-01T19:56:33.438 INFO:teuthology.orchestra.run.smithi155.stdout: { 2023-08-01T19:56:33.438 INFO:teuthology.orchestra.run.smithi155.stdout: "event": "reached_pg", 2023-08-01T19:56:33.438 INFO:teuthology.orchestra.run.smithi155.stdout: "time": "2023-08-01T19:55:05.151162+0000", 2023-08-01T19:56:33.438 INFO:teuthology.orchestra.run.smithi155.stdout: "duration": 4.1448e-05 2023-08-01T19:56:33.438 INFO:teuthology.orchestra.run.smithi155.stdout: }, 2023-08-01T19:56:33.439 INFO:teuthology.orchestra.run.smithi155.stdout: { 2023-08-01T19:56:33.439 INFO:teuthology.orchestra.run.smithi155.stdout: "event": "started", 2023-08-01T19:56:33.439 INFO:teuthology.orchestra.run.smithi155.stdout: "time": "2023-08-01T19:55:05.151281+0000", 2023-08-01T19:56:33.439 INFO:teuthology.orchestra.run.smithi155.stdout: "duration": 0.000119141 2023-08-01T19:56:33.439 INFO:teuthology.orchestra.run.smithi155.stdout: }, 2023-08-01T19:56:33.439 INFO:teuthology.orchestra.run.smithi155.stdout: { 2023-08-01T19:56:33.439 INFO:teuthology.orchestra.run.smithi155.stdout: "event": "waiting for subops from 0", 2023-08-01T19:56:33.439 INFO:teuthology.orchestra.run.smithi155.stdout: "time": "2023-08-01T19:55:05.151443+0000", 2023-08-01T19:56:33.440 INFO:teuthology.orchestra.run.smithi155.stdout: "duration": 0.00016181600000000001 2023-08-01T19:56:33.440 INFO:teuthology.orchestra.run.smithi155.stdout: }, 2023-08-01T19:56:33.440 INFO:teuthology.orchestra.run.smithi155.stdout: { 2023-08-01T19:56:33.440 INFO:teuthology.orchestra.run.smithi155.stdout: "event": "sub_op_commit_rec", 2023-08-01T19:56:33.440 INFO:teuthology.orchestra.run.smithi155.stdout: "time": "2023-08-01T19:55:05.219101+0000", 2023-08-01T19:56:33.440 INFO:teuthology.orchestra.run.smithi155.stdout: "duration": 0.067658037000000004 2023-08-01T19:56:33.440 INFO:teuthology.orchestra.run.smithi155.stdout: }, 2023-08-01T19:56:33.441 INFO:teuthology.orchestra.run.smithi155.stdout: { 2023-08-01T19:56:33.441 INFO:teuthology.orchestra.run.smithi155.stdout: "event": "op_commit", 2023-08-01T19:56:33.441 INFO:teuthology.orchestra.run.smithi155.stdout: "time": "2023-08-01T19:55:05.221646+0000", 2023-08-01T19:56:33.441 INFO:teuthology.orchestra.run.smithi155.stdout: "duration": 0.0025450540000000002 2023-08-01T19:56:33.441 INFO:teuthology.orchestra.run.smithi155.stdout: }, 2023-08-01T19:56:33.441 INFO:teuthology.orchestra.run.smithi155.stdout: { 2023-08-01T19:56:33.441 INFO:teuthology.orchestra.run.smithi155.stdout: "event": "commit_sent", 2023-08-01T19:56:33.442 INFO:teuthology.orchestra.run.smithi155.stdout: "time": "2023-08-01T19:55:05.221689+0000", 2023-08-01T19:56:33.442 INFO:teuthology.orchestra.run.smithi155.stdout: "duration": 4.3078999999999999e-05 2023-08-01T19:56:33.442 INFO:teuthology.orchestra.run.smithi155.stdout: }, 2023-08-01T19:56:33.442 INFO:teuthology.orchestra.run.smithi155.stdout: { 2023-08-01T19:56:33.442 INFO:teuthology.orchestra.run.smithi155.stdout: "event": "done", 2023-08-01T19:56:33.442 INFO:teuthology.orchestra.run.smithi155.stdout: "time": "2023-08-01T19:55:05.221725+0000", 2023-08-01T19:56:33.442 INFO:teuthology.orchestra.run.smithi155.stdout: "duration": 3.6137999999999999e-05 2023-08-01T19:56:33.442 INFO:teuthology.orchestra.run.smithi155.stdout: } 2023-08-01T19:56:33.443 INFO:teuthology.orchestra.run.smithi155.stdout: ] 2023-08-01T19:56:33.443 INFO:teuthology.orchestra.run.smithi155.stdout: } 2023-08-01T19:56:33.443 INFO:teuthology.orchestra.run.smithi155.stdout: }, 2023-08-01T19:56:33.443 INFO:teuthology.orchestra.run.smithi155.stdout: { 2023-08-01T19:56:33.443 INFO:teuthology.orchestra.run.smithi155.stdout: "description": "osd_repop(client.4668.0:100243 5.a e37/19 5:5e8193b6:::benchmark_data_smithi006_114134_object100242:head v 37'6228, mlcod=37'6225)", 2023-08-01T19:56:33.443 INFO:teuthology.orchestra.run.smithi155.stdout: "initiated_at": "2023-08-01T19:55:05.151148+0000", 2023-08-01T19:56:33.443 INFO:teuthology.orchestra.run.smithi155.stdout: "age": 88.247228675000002, 2023-08-01T19:56:33.444 INFO:teuthology.orchestra.run.smithi155.stdout: "duration": 0.073020370000000001, 2023-08-01T19:56:33.444 INFO:teuthology.orchestra.run.smithi155.stdout: "type_data": { 2023-08-01T19:56:33.444 INFO:teuthology.orchestra.run.smithi155.stdout: "flag_point": "commit sent; apply or cleanup", 2023-08-01T19:56:33.444 INFO:teuthology.orchestra.run.smithi155.stdout: "events": [ 2023-08-01T19:56:33.444 INFO:teuthology.orchestra.run.smithi155.stdout: { 2023-08-01T19:56:33.444 INFO:teuthology.orchestra.run.smithi155.stdout: "event": "initiated", 2023-08-01T19:56:33.444 INFO:teuthology.orchestra.run.smithi155.stdout: "time": "2023-08-01T19:55:05.151148+0000", 2023-08-01T19:56:33.445 INFO:teuthology.orchestra.run.smithi155.stdout: "duration": 0 2023-08-01T19:56:33.445 INFO:teuthology.orchestra.run.smithi155.stdout: }, 2023-08-01T19:56:33.445 INFO:teuthology.orchestra.run.smithi155.stdout: { 2023-08-01T19:56:33.445 INFO:teuthology.orchestra.run.smithi155.stdout: "event": "throttled", 2023-08-01T19:56:33.445 INFO:teuthology.orchestra.run.smithi155.stdout: "time": "2023-08-01T19:55:05.151148+0000", 2023-08-01T19:56:33.445 INFO:teuthology.orchestra.run.smithi155.stdout: "duration": 0 2023-08-01T19:56:33.445 INFO:teuthology.orchestra.run.smithi155.stdout: }, 2023-08-01T19:56:33.446 INFO:teuthology.orchestra.run.smithi155.stdout: { 2023-08-01T19:56:33.446 INFO:teuthology.orchestra.run.smithi155.stdout: "event": "header_read", 2023-08-01T19:56:33.446 INFO:teuthology.orchestra.run.smithi155.stdout: "time": "2023-08-01T19:55:05.151147+0000", 2023-08-01T19:56:33.446 INFO:teuthology.orchestra.run.smithi155.stdout: "duration": 4294967295.9999995 2023-08-01T19:56:33.446 INFO:teuthology.orchestra.run.smithi155.stdout: }, 2023-08-01T19:56:33.446 INFO:teuthology.orchestra.run.smithi155.stdout: { 2023-08-01T19:56:33.446 INFO:teuthology.orchestra.run.smithi155.stdout: "event": "all_read", 2023-08-01T19:56:33.447 INFO:teuthology.orchestra.run.smithi155.stdout: "time": "2023-08-01T19:55:05.151231+0000", 2023-08-01T19:56:33.447 INFO:teuthology.orchestra.run.smithi155.stdout: "duration": 8.3135999999999998e-05 2023-08-01T19:56:33.447 INFO:teuthology.orchestra.run.smithi155.stdout: }, 2023-08-01T19:56:33.447 INFO:teuthology.orchestra.run.smithi155.stdout: { 2023-08-01T19:56:33.447 INFO:teuthology.orchestra.run.smithi155.stdout: "event": "dispatched", 2023-08-01T19:56:33.447 INFO:teuthology.orchestra.run.smithi155.stdout: "time": "2023-08-01T19:55:05.151239+0000", 2023-08-01T19:56:33.447 INFO:teuthology.orchestra.run.smithi155.stdout: "duration": 8.7469999999999994e-06 2023-08-01T19:56:33.447 INFO:teuthology.orchestra.run.smithi155.stdout: }, 2023-08-01T19:56:33.448 INFO:teuthology.orchestra.run.smithi155.stdout: { 2023-08-01T19:56:33.448 INFO:teuthology.orchestra.run.smithi155.stdout: "event": "queued_for_pg", 2023-08-01T19:56:33.448 INFO:teuthology.orchestra.run.smithi155.stdout: "time": "2023-08-01T19:55:05.151244+0000", 2023-08-01T19:56:33.448 INFO:teuthology.orchestra.run.smithi155.stdout: "duration": 4.4800000000000003e-06 2023-08-01T19:56:33.448 INFO:teuthology.orchestra.run.smithi155.stdout: }, 2023-08-01T19:56:33.448 INFO:teuthology.orchestra.run.smithi155.stdout: { 2023-08-01T19:56:33.448 INFO:teuthology.orchestra.run.smithi155.stdout: "event": "reached_pg", 2023-08-01T19:56:33.449 INFO:teuthology.orchestra.run.smithi155.stdout: "time": "2023-08-01T19:55:05.152938+0000", 2023-08-01T19:56:33.449 INFO:teuthology.orchestra.run.smithi155.stdout: "duration": 0.001693824 2023-08-01T19:56:33.449 INFO:teuthology.orchestra.run.smithi155.stdout: }, 2023-08-01T19:56:33.449 INFO:teuthology.orchestra.run.smithi155.stdout: { 2023-08-01T19:56:33.449 INFO:teuthology.orchestra.run.smithi155.stdout: "event": "started", 2023-08-01T19:56:33.449 INFO:teuthology.orchestra.run.smithi155.stdout: "time": "2023-08-01T19:55:05.152956+0000", 2023-08-01T19:56:33.449 INFO:teuthology.orchestra.run.smithi155.stdout: "duration": 1.8287e-05 2023-08-01T19:56:33.449 INFO:teuthology.orchestra.run.smithi155.stdout: }, 2023-08-01T19:56:33.450 INFO:teuthology.orchestra.run.smithi155.stdout: { 2023-08-01T19:56:33.450 INFO:teuthology.orchestra.run.smithi155.stdout: "event": "commit_sent", 2023-08-01T19:56:33.450 INFO:teuthology.orchestra.run.smithi155.stdout: "time": "2023-08-01T19:55:05.224145+0000", 2023-08-01T19:56:33.450 INFO:teuthology.orchestra.run.smithi155.stdout: "duration": 0.071189447000000003 2023-08-01T19:56:33.450 INFO:teuthology.orchestra.run.smithi155.stdout: }, 2023-08-01T19:56:33.450 INFO:teuthology.orchestra.run.smithi155.stdout: { 2023-08-01T19:56:33.450 INFO:teuthology.orchestra.run.smithi155.stdout: "event": "done", 2023-08-01T19:56:33.450 INFO:teuthology.orchestra.run.smithi155.stdout: "time": "2023-08-01T19:55:05.224168+0000", 2023-08-01T19:56:33.451 INFO:teuthology.orchestra.run.smithi155.stdout: "duration": 2.3008999999999999e-05 2023-08-01T19:56:33.451 INFO:teuthology.orchestra.run.smithi155.stdout: } 2023-08-01T19:56:33.451 INFO:teuthology.orchestra.run.smithi155.stdout: ] 2023-08-01T19:56:33.451 INFO:teuthology.orchestra.run.smithi155.stdout: } 2023-08-01T19:56:33.451 INFO:teuthology.orchestra.run.smithi155.stdout: }, 2023-08-01T19:56:33.451 INFO:teuthology.orchestra.run.smithi155.stdout: { 2023-08-01T19:56:33.451 INFO:teuthology.orchestra.run.smithi155.stdout: "description": "osd_repop(client.4668.0:100244 5.9 e37/19 5:92f56a12:::benchmark_data_smithi006_114134_object100243:head v 37'6294, mlcod=37'6292)", 2023-08-01T19:56:33.452 INFO:teuthology.orchestra.run.smithi155.stdout: "initiated_at": "2023-08-01T19:55:05.151325+0000", 2023-08-01T19:56:33.452 INFO:teuthology.orchestra.run.smithi155.stdout: "age": 88.247051330000005, 2023-08-01T19:56:33.452 INFO:teuthology.orchestra.run.smithi155.stdout: "duration": 0.071883673999999995, 2023-08-01T19:56:33.452 INFO:teuthology.orchestra.run.smithi155.stdout: "type_data": { 2023-08-01T19:56:33.452 INFO:teuthology.orchestra.run.smithi155.stdout: "flag_point": "commit sent; apply or cleanup", 2023-08-01T19:56:33.452 INFO:teuthology.orchestra.run.smithi155.stdout: "events": [ 2023-08-01T19:56:33.452 INFO:teuthology.orchestra.run.smithi155.stdout: { 2023-08-01T19:56:33.453 INFO:teuthology.orchestra.run.smithi155.stdout: "event": "initiated", 2023-08-01T19:56:33.453 INFO:teuthology.orchestra.run.smithi155.stdout: "time": "2023-08-01T19:55:05.151325+0000", 2023-08-01T19:56:33.453 INFO:teuthology.orchestra.run.smithi155.stdout: "duration": 0 2023-08-01T19:56:33.453 INFO:teuthology.orchestra.run.smithi155.stdout: }, 2023-08-01T19:56:33.453 INFO:teuthology.orchestra.run.smithi155.stdout: { 2023-08-01T19:56:33.453 INFO:teuthology.orchestra.run.smithi155.stdout: "event": "throttled", 2023-08-01T19:56:33.453 INFO:teuthology.orchestra.run.smithi155.stdout: "time": "2023-08-01T19:55:05.151325+0000", 2023-08-01T19:56:33.453 INFO:teuthology.orchestra.run.smithi155.stdout: "duration": 0 2023-08-01T19:56:33.454 INFO:teuthology.orchestra.run.smithi155.stdout: }, 2023-08-01T19:56:33.454 INFO:teuthology.orchestra.run.smithi155.stdout: { 2023-08-01T19:56:33.454 INFO:teuthology.orchestra.run.smithi155.stdout: "event": "header_read", 2023-08-01T19:56:33.454 INFO:teuthology.orchestra.run.smithi155.stdout: "time": "2023-08-01T19:55:05.151325+0000", 2023-08-01T19:56:33.454 INFO:teuthology.orchestra.run.smithi155.stdout: "duration": 4294967295.9999995 2023-08-01T19:56:33.454 INFO:teuthology.orchestra.run.smithi155.stdout: }, 2023-08-01T19:56:33.454 INFO:teuthology.orchestra.run.smithi155.stdout: { 2023-08-01T19:56:33.454 INFO:teuthology.orchestra.run.smithi155.stdout: "event": "all_read", 2023-08-01T19:56:33.455 INFO:teuthology.orchestra.run.smithi155.stdout: "time": "2023-08-01T19:55:05.151390+0000", 2023-08-01T19:56:33.455 INFO:teuthology.orchestra.run.smithi155.stdout: "duration": 6.5456999999999993e-05 2023-08-01T19:56:33.455 INFO:teuthology.orchestra.run.smithi155.stdout: }, 2023-08-01T19:56:33.455 INFO:teuthology.orchestra.run.smithi155.stdout: { 2023-08-01T19:56:33.455 INFO:teuthology.orchestra.run.smithi155.stdout: "event": "dispatched", 2023-08-01T19:56:33.455 INFO:teuthology.orchestra.run.smithi155.stdout: "time": "2023-08-01T19:55:05.151396+0000", 2023-08-01T19:56:33.455 INFO:teuthology.orchestra.run.smithi155.stdout: "duration": 5.9190000000000004e-06 2023-08-01T19:56:33.455 INFO:teuthology.orchestra.run.smithi155.stdout: }, 2023-08-01T19:56:33.456 INFO:teuthology.orchestra.run.smithi155.stdout: { 2023-08-01T19:56:33.456 INFO:teuthology.orchestra.run.smithi155.stdout: "event": "queued_for_pg", 2023-08-01T19:56:33.456 INFO:teuthology.orchestra.run.smithi155.stdout: "time": "2023-08-01T19:55:05.151400+0000", 2023-08-01T19:56:33.456 INFO:teuthology.orchestra.run.smithi155.stdout: "duration": 4.1030000000000004e-06 2023-08-01T19:56:33.456 INFO:teuthology.orchestra.run.smithi155.stdout: }, 2023-08-01T19:56:33.456 INFO:teuthology.orchestra.run.smithi155.stdout: { 2023-08-01T19:56:33.456 INFO:teuthology.orchestra.run.smithi155.stdout: "event": "reached_pg", 2023-08-01T19:56:33.457 INFO:teuthology.orchestra.run.smithi155.stdout: "time": "2023-08-01T19:55:05.151452+0000", 2023-08-01T19:56:33.457 INFO:teuthology.orchestra.run.smithi155.stdout: "duration": 5.2136999999999999e-05 2023-08-01T19:56:33.457 INFO:teuthology.orchestra.run.smithi155.stdout: }, 2023-08-01T19:56:33.457 INFO:teuthology.orchestra.run.smithi155.stdout: { 2023-08-01T19:56:33.457 INFO:teuthology.orchestra.run.smithi155.stdout: "event": "started", 2023-08-01T19:56:33.457 INFO:teuthology.orchestra.run.smithi155.stdout: "time": "2023-08-01T19:55:05.151470+0000", 2023-08-01T19:56:33.457 INFO:teuthology.orchestra.run.smithi155.stdout: "duration": 1.8e-05 2023-08-01T19:56:33.457 INFO:teuthology.orchestra.run.smithi155.stdout: }, 2023-08-01T19:56:33.458 INFO:teuthology.orchestra.run.smithi155.stdout: { 2023-08-01T19:56:33.458 INFO:teuthology.orchestra.run.smithi155.stdout: "event": "commit_sent", 2023-08-01T19:56:33.458 INFO:teuthology.orchestra.run.smithi155.stdout: "time": "2023-08-01T19:55:05.223183+0000", 2023-08-01T19:56:33.458 INFO:teuthology.orchestra.run.smithi155.stdout: "duration": 0.071712622000000004 2023-08-01T19:56:33.458 INFO:teuthology.orchestra.run.smithi155.stdout: }, 2023-08-01T19:56:33.458 INFO:teuthology.orchestra.run.smithi155.stdout: { 2023-08-01T19:56:33.458 INFO:teuthology.orchestra.run.smithi155.stdout: "event": "done", 2023-08-01T19:56:33.458 INFO:teuthology.orchestra.run.smithi155.stdout: "time": "2023-08-01T19:55:05.223209+0000", 2023-08-01T19:56:33.459 INFO:teuthology.orchestra.run.smithi155.stdout: "duration": 2.5956e-05 2023-08-01T19:56:33.459 INFO:teuthology.orchestra.run.smithi155.stdout: } 2023-08-01T19:56:33.459 INFO:teuthology.orchestra.run.smithi155.stdout: ] 2023-08-01T19:56:33.459 INFO:teuthology.orchestra.run.smithi155.stdout: } 2023-08-01T19:56:33.459 INFO:teuthology.orchestra.run.smithi155.stdout: }, 2023-08-01T19:56:33.459 INFO:teuthology.orchestra.run.smithi155.stdout: { 2023-08-01T19:56:33.459 INFO:teuthology.orchestra.run.smithi155.stdout: "description": "osd_op(client.4668.0:100249 5.b 5:d0666827:::benchmark_data_smithi006_114134_object100248:head [set-alloc-hint object_size 65536 write_size 65536,write 0~65536] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e37)", 2023-08-01T19:56:33.459 INFO:teuthology.orchestra.run.smithi155.stdout: "initiated_at": "2023-08-01T19:55:05.153614+0000", 2023-08-01T19:56:33.460 INFO:teuthology.orchestra.run.smithi155.stdout: "age": 88.244762905000002, 2023-08-01T19:56:33.460 INFO:teuthology.orchestra.run.smithi155.stdout: "duration": 0.069286118999999993, 2023-08-01T19:56:33.460 INFO:teuthology.orchestra.run.smithi155.stdout: "type_data": { 2023-08-01T19:56:33.460 INFO:teuthology.orchestra.run.smithi155.stdout: "flag_point": "commit sent; apply or cleanup", 2023-08-01T19:56:33.460 INFO:teuthology.orchestra.run.smithi155.stdout: "client_info": { 2023-08-01T19:56:33.460 INFO:teuthology.orchestra.run.smithi155.stdout: "client": "client.4668", 2023-08-01T19:56:33.460 INFO:teuthology.orchestra.run.smithi155.stdout: "client_addr": "172.21.15.6:0/1709472247", 2023-08-01T19:56:33.460 INFO:teuthology.orchestra.run.smithi155.stdout: "tid": 100249 2023-08-01T19:56:33.461 INFO:teuthology.orchestra.run.smithi155.stdout: }, 2023-08-01T19:56:33.461 INFO:teuthology.orchestra.run.smithi155.stdout: "events": [ 2023-08-01T19:56:33.461 INFO:teuthology.orchestra.run.smithi155.stdout: { 2023-08-01T19:56:33.461 INFO:teuthology.orchestra.run.smithi155.stdout: "event": "initiated", 2023-08-01T19:56:33.461 INFO:teuthology.orchestra.run.smithi155.stdout: "time": "2023-08-01T19:55:05.153614+0000", 2023-08-01T19:56:33.461 INFO:teuthology.orchestra.run.smithi155.stdout: "duration": 0 2023-08-01T19:56:33.461 INFO:teuthology.orchestra.run.smithi155.stdout: }, 2023-08-01T19:56:33.462 INFO:teuthology.orchestra.run.smithi155.stdout: { 2023-08-01T19:56:33.462 INFO:teuthology.orchestra.run.smithi155.stdout: "event": "throttled", 2023-08-01T19:56:33.462 INFO:teuthology.orchestra.run.smithi155.stdout: "time": "2023-08-01T19:55:05.153614+0000", 2023-08-01T19:56:33.462 INFO:teuthology.orchestra.run.smithi155.stdout: "duration": 0 2023-08-01T19:56:33.462 INFO:teuthology.orchestra.run.smithi155.stdout: }, 2023-08-01T19:56:33.462 INFO:teuthology.orchestra.run.smithi155.stdout: { 2023-08-01T19:56:33.462 INFO:teuthology.orchestra.run.smithi155.stdout: "event": "header_read", 2023-08-01T19:56:33.462 INFO:teuthology.orchestra.run.smithi155.stdout: "time": "2023-08-01T19:55:05.153612+0000", 2023-08-01T19:56:33.463 INFO:teuthology.orchestra.run.smithi155.stdout: "duration": 4294967295.9999986 2023-08-01T19:56:33.463 INFO:teuthology.orchestra.run.smithi155.stdout: }, 2023-08-01T19:56:33.463 INFO:teuthology.orchestra.run.smithi155.stdout: { 2023-08-01T19:56:33.463 INFO:teuthology.orchestra.run.smithi155.stdout: "event": "all_read", 2023-08-01T19:56:33.463 INFO:teuthology.orchestra.run.smithi155.stdout: "time": "2023-08-01T19:55:05.153694+0000", 2023-08-01T19:56:33.463 INFO:teuthology.orchestra.run.smithi155.stdout: "duration": 8.1618000000000004e-05 2023-08-01T19:56:33.463 INFO:teuthology.orchestra.run.smithi155.stdout: }, 2023-08-01T19:56:33.464 INFO:teuthology.orchestra.run.smithi155.stdout: { 2023-08-01T19:56:33.464 INFO:teuthology.orchestra.run.smithi155.stdout: "event": "dispatched", 2023-08-01T19:56:33.464 INFO:teuthology.orchestra.run.smithi155.stdout: "time": "2023-08-01T19:55:05.153713+0000", 2023-08-01T19:56:33.464 INFO:teuthology.orchestra.run.smithi155.stdout: "duration": 1.9069999999999999e-05 2023-08-01T19:56:33.464 INFO:teuthology.orchestra.run.smithi155.stdout: }, 2023-08-01T19:56:33.464 INFO:teuthology.orchestra.run.smithi155.stdout: { 2023-08-01T19:56:33.464 INFO:teuthology.orchestra.run.smithi155.stdout: "event": "queued_for_pg", 2023-08-01T19:56:33.464 INFO:teuthology.orchestra.run.smithi155.stdout: "time": "2023-08-01T19:55:05.153726+0000", 2023-08-01T19:56:33.465 INFO:teuthology.orchestra.run.smithi155.stdout: "duration": 1.238e-05 2023-08-01T19:56:33.465 INFO:teuthology.orchestra.run.smithi155.stdout: }, 2023-08-01T19:56:33.465 INFO:teuthology.orchestra.run.smithi155.stdout: { 2023-08-01T19:56:33.465 INFO:teuthology.orchestra.run.smithi155.stdout: "event": "reached_pg", 2023-08-01T19:56:33.465 INFO:teuthology.orchestra.run.smithi155.stdout: "time": "2023-08-01T19:55:05.153761+0000", 2023-08-01T19:56:33.465 INFO:teuthology.orchestra.run.smithi155.stdout: "duration": 3.5046999999999998e-05 2023-08-01T19:56:33.465 INFO:teuthology.orchestra.run.smithi155.stdout: }, 2023-08-01T19:56:33.465 INFO:teuthology.orchestra.run.smithi155.stdout: { 2023-08-01T19:56:33.466 INFO:teuthology.orchestra.run.smithi155.stdout: "event": "started", 2023-08-01T19:56:33.466 INFO:teuthology.orchestra.run.smithi155.stdout: "time": "2023-08-01T19:55:05.153896+0000", 2023-08-01T19:56:33.466 INFO:teuthology.orchestra.run.smithi155.stdout: "duration": 0.00013575800000000001 2023-08-01T19:56:33.466 INFO:teuthology.orchestra.run.smithi155.stdout: }, 2023-08-01T19:56:33.466 INFO:teuthology.orchestra.run.smithi155.stdout: { 2023-08-01T19:56:33.466 INFO:teuthology.orchestra.run.smithi155.stdout: "event": "waiting for subops from 0", 2023-08-01T19:56:33.466 INFO:teuthology.orchestra.run.smithi155.stdout: "time": "2023-08-01T19:55:05.154043+0000", 2023-08-01T19:56:33.467 INFO:teuthology.orchestra.run.smithi155.stdout: "duration": 0.00014650700000000001 2023-08-01T19:56:33.467 INFO:teuthology.orchestra.run.smithi155.stdout: }, 2023-08-01T19:56:33.467 INFO:teuthology.orchestra.run.smithi155.stdout: { 2023-08-01T19:56:33.467 INFO:teuthology.orchestra.run.smithi155.stdout: "event": "sub_op_commit_rec", 2023-08-01T19:56:33.467 INFO:teuthology.orchestra.run.smithi155.stdout: "time": "2023-08-01T19:55:05.221876+0000", 2023-08-01T19:56:33.467 INFO:teuthology.orchestra.run.smithi155.stdout: "duration": 0.067832796000000001 2023-08-01T19:56:33.467 INFO:teuthology.orchestra.run.smithi155.stdout: }, 2023-08-01T19:56:33.468 INFO:teuthology.orchestra.run.smithi155.stdout: { 2023-08-01T19:56:33.468 INFO:teuthology.orchestra.run.smithi155.stdout: "event": "op_commit", 2023-08-01T19:56:33.468 INFO:teuthology.orchestra.run.smithi155.stdout: "time": "2023-08-01T19:55:05.222813+0000", 2023-08-01T19:56:33.468 INFO:teuthology.orchestra.run.smithi155.stdout: "duration": 0.00093755300000000004 2023-08-01T19:56:33.468 INFO:teuthology.orchestra.run.smithi155.stdout: }, 2023-08-01T19:56:33.468 INFO:teuthology.orchestra.run.smithi155.stdout: { 2023-08-01T19:56:33.468 INFO:teuthology.orchestra.run.smithi155.stdout: "event": "commit_sent", 2023-08-01T19:56:33.469 INFO:teuthology.orchestra.run.smithi155.stdout: "time": "2023-08-01T19:55:05.222861+0000", 2023-08-01T19:56:33.469 INFO:teuthology.orchestra.run.smithi155.stdout: "duration": 4.8013999999999998e-05 2023-08-01T19:56:33.469 INFO:teuthology.orchestra.run.smithi155.stdout: }, 2023-08-01T19:56:33.469 INFO:teuthology.orchestra.run.smithi155.stdout: { 2023-08-01T19:56:33.469 INFO:teuthology.orchestra.run.smithi155.stdout: "event": "done", 2023-08-01T19:56:33.469 INFO:teuthology.orchestra.run.smithi155.stdout: "time": "2023-08-01T19:55:05.222900+0000", 2023-08-01T19:56:33.469 INFO:teuthology.orchestra.run.smithi155.stdout: "duration": 3.8634999999999999e-05 2023-08-01T19:56:33.469 INFO:teuthology.orchestra.run.smithi155.stdout: } 2023-08-01T19:56:33.470 INFO:teuthology.orchestra.run.smithi155.stdout: ] 2023-08-01T19:56:33.470 INFO:teuthology.orchestra.run.smithi155.stdout: } 2023-08-01T19:56:33.470 INFO:teuthology.orchestra.run.smithi155.stdout: }, 2023-08-01T19:56:33.470 INFO:teuthology.orchestra.run.smithi155.stdout: { 2023-08-01T19:56:33.470 INFO:teuthology.orchestra.run.smithi155.stdout: "description": "osd_op(client.4668.0:100251 5.b 5:d853df24:::benchmark_data_smithi006_114134_object100250:head [set-alloc-hint object_size 65536 write_size 65536,write 0~65536] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e37)", 2023-08-01T19:56:33.470 INFO:teuthology.orchestra.run.smithi155.stdout: "initiated_at": "2023-08-01T19:55:05.153737+0000", 2023-08-01T19:56:33.470 INFO:teuthology.orchestra.run.smithi155.stdout: "age": 88.244639891000006, 2023-08-01T19:56:33.471 INFO:teuthology.orchestra.run.smithi155.stdout: "duration": 0.071366545000000003, 2023-08-01T19:56:33.471 INFO:teuthology.orchestra.run.smithi155.stdout: "type_data": { 2023-08-01T19:56:33.471 INFO:teuthology.orchestra.run.smithi155.stdout: "flag_point": "commit sent; apply or cleanup", 2023-08-01T19:56:33.471 INFO:teuthology.orchestra.run.smithi155.stdout: "client_info": { 2023-08-01T19:56:33.471 INFO:teuthology.orchestra.run.smithi155.stdout: "client": "client.4668", 2023-08-01T19:56:33.471 INFO:teuthology.orchestra.run.smithi155.stdout: "client_addr": "172.21.15.6:0/1709472247", 2023-08-01T19:56:33.471 INFO:teuthology.orchestra.run.smithi155.stdout: "tid": 100251 2023-08-01T19:56:33.471 INFO:teuthology.orchestra.run.smithi155.stdout: }, 2023-08-01T19:56:33.472 INFO:teuthology.orchestra.run.smithi155.stdout: "events": [ 2023-08-01T19:56:33.472 INFO:teuthology.orchestra.run.smithi155.stdout: { 2023-08-01T19:56:33.472 INFO:teuthology.orchestra.run.smithi155.stdout: "event": "initiated", 2023-08-01T19:56:33.472 INFO:teuthology.orchestra.run.smithi155.stdout: "time": "2023-08-01T19:55:05.153737+0000", 2023-08-01T19:56:33.472 INFO:teuthology.orchestra.run.smithi155.stdout: "duration": 0 2023-08-01T19:56:33.472 INFO:teuthology.orchestra.run.smithi155.stdout: }, 2023-08-01T19:56:33.472 INFO:teuthology.orchestra.run.smithi155.stdout: { 2023-08-01T19:56:33.472 INFO:teuthology.orchestra.run.smithi155.stdout: "event": "throttled", 2023-08-01T19:56:33.473 INFO:teuthology.orchestra.run.smithi155.stdout: "time": "2023-08-01T19:55:05.153737+0000", 2023-08-01T19:56:33.473 INFO:teuthology.orchestra.run.smithi155.stdout: "duration": 0 2023-08-01T19:56:33.473 INFO:teuthology.orchestra.run.smithi155.stdout: }, 2023-08-01T19:56:33.473 INFO:teuthology.orchestra.run.smithi155.stdout: { 2023-08-01T19:56:33.473 INFO:teuthology.orchestra.run.smithi155.stdout: "event": "header_read", 2023-08-01T19:56:33.473 INFO:teuthology.orchestra.run.smithi155.stdout: "time": "2023-08-01T19:55:05.153736+0000", 2023-08-01T19:56:33.473 INFO:teuthology.orchestra.run.smithi155.stdout: "duration": 4294967295.9999995 2023-08-01T19:56:33.474 INFO:teuthology.orchestra.run.smithi155.stdout: }, 2023-08-01T19:56:33.474 INFO:teuthology.orchestra.run.smithi155.stdout: { 2023-08-01T19:56:33.474 INFO:teuthology.orchestra.run.smithi155.stdout: "event": "all_read", 2023-08-01T19:56:33.474 INFO:teuthology.orchestra.run.smithi155.stdout: "time": "2023-08-01T19:55:05.153784+0000", 2023-08-01T19:56:33.474 INFO:teuthology.orchestra.run.smithi155.stdout: "duration": 4.7660000000000001e-05 2023-08-01T19:56:33.474 INFO:teuthology.orchestra.run.smithi155.stdout: }, 2023-08-01T19:56:33.474 INFO:teuthology.orchestra.run.smithi155.stdout: { 2023-08-01T19:56:33.474 INFO:teuthology.orchestra.run.smithi155.stdout: "event": "dispatched", 2023-08-01T19:56:33.475 INFO:teuthology.orchestra.run.smithi155.stdout: "time": "2023-08-01T19:55:05.153793+0000", 2023-08-01T19:56:33.475 INFO:teuthology.orchestra.run.smithi155.stdout: "duration": 8.7150000000000004e-06 2023-08-01T19:56:33.475 INFO:teuthology.orchestra.run.smithi155.stdout: }, 2023-08-01T19:56:33.475 INFO:teuthology.orchestra.run.smithi155.stdout: { 2023-08-01T19:56:33.475 INFO:teuthology.orchestra.run.smithi155.stdout: "event": "queued_for_pg", 2023-08-01T19:56:33.475 INFO:teuthology.orchestra.run.smithi155.stdout: "time": "2023-08-01T19:55:05.153800+0000", 2023-08-01T19:56:33.475 INFO:teuthology.orchestra.run.smithi155.stdout: "duration": 7.2459999999999997e-06 2023-08-01T19:56:33.475 INFO:teuthology.orchestra.run.smithi155.stdout: }, 2023-08-01T19:56:33.476 INFO:teuthology.orchestra.run.smithi155.stdout: { 2023-08-01T19:56:33.476 INFO:teuthology.orchestra.run.smithi155.stdout: "event": "reached_pg", 2023-08-01T19:56:33.476 INFO:teuthology.orchestra.run.smithi155.stdout: "time": "2023-08-01T19:55:05.156241+0000", 2023-08-01T19:56:33.476 INFO:teuthology.orchestra.run.smithi155.stdout: "duration": 0.0024415359999999998 2023-08-01T19:56:33.476 INFO:teuthology.orchestra.run.smithi155.stdout: }, 2023-08-01T19:56:33.476 INFO:teuthology.orchestra.run.smithi155.stdout: { 2023-08-01T19:56:33.476 INFO:teuthology.orchestra.run.smithi155.stdout: "event": "started", 2023-08-01T19:56:33.477 INFO:teuthology.orchestra.run.smithi155.stdout: "time": "2023-08-01T19:55:05.219045+0000", 2023-08-01T19:56:33.477 INFO:teuthology.orchestra.run.smithi155.stdout: "duration": 0.062803855000000006 2023-08-01T19:56:33.477 INFO:teuthology.orchestra.run.smithi155.stdout: }, 2023-08-01T19:56:33.477 INFO:teuthology.orchestra.run.smithi155.stdout: { 2023-08-01T19:56:33.477 INFO:teuthology.orchestra.run.smithi155.stdout: "event": "waiting for subops from 0", 2023-08-01T19:56:33.477 INFO:teuthology.orchestra.run.smithi155.stdout: "time": "2023-08-01T19:55:05.219238+0000", 2023-08-01T19:56:33.477 INFO:teuthology.orchestra.run.smithi155.stdout: "duration": 0.00019241500000000001 2023-08-01T19:56:33.477 INFO:teuthology.orchestra.run.smithi155.stdout: }, 2023-08-01T19:56:33.478 INFO:teuthology.orchestra.run.smithi155.stdout: { 2023-08-01T19:56:33.478 INFO:teuthology.orchestra.run.smithi155.stdout: "event": "sub_op_commit_rec", 2023-08-01T19:56:33.478 INFO:teuthology.orchestra.run.smithi155.stdout: "time": "2023-08-01T19:55:05.223300+0000", 2023-08-01T19:56:33.478 INFO:teuthology.orchestra.run.smithi155.stdout: "duration": 0.0040626509999999996 2023-08-01T19:56:33.478 INFO:teuthology.orchestra.run.smithi155.stdout: }, 2023-08-01T19:56:33.478 INFO:teuthology.orchestra.run.smithi155.stdout: { 2023-08-01T19:56:33.478 INFO:teuthology.orchestra.run.smithi155.stdout: "event": "op_commit", 2023-08-01T19:56:33.478 INFO:teuthology.orchestra.run.smithi155.stdout: "time": "2023-08-01T19:55:05.225020+0000", 2023-08-01T19:56:33.479 INFO:teuthology.orchestra.run.smithi155.stdout: "duration": 0.0017201 2023-08-01T19:56:33.479 INFO:teuthology.orchestra.run.smithi155.stdout: }, 2023-08-01T19:56:33.479 INFO:teuthology.orchestra.run.smithi155.stdout: { 2023-08-01T19:56:33.479 INFO:teuthology.orchestra.run.smithi155.stdout: "event": "commit_sent", 2023-08-01T19:56:33.479 INFO:teuthology.orchestra.run.smithi155.stdout: "time": "2023-08-01T19:55:05.225066+0000", 2023-08-01T19:56:33.479 INFO:teuthology.orchestra.run.smithi155.stdout: "duration": 4.6143000000000002e-05 2023-08-01T19:56:33.479 INFO:teuthology.orchestra.run.smithi155.stdout: }, 2023-08-01T19:56:33.479 INFO:teuthology.orchestra.run.smithi155.stdout: { 2023-08-01T19:56:33.480 INFO:teuthology.orchestra.run.smithi155.stdout: "event": "done", 2023-08-01T19:56:33.480 INFO:teuthology.orchestra.run.smithi155.stdout: "time": "2023-08-01T19:55:05.225103+0000", 2023-08-01T19:56:33.480 INFO:teuthology.orchestra.run.smithi155.stdout: "duration": 3.6789999999999998e-05 2023-08-01T19:56:33.480 INFO:teuthology.orchestra.run.smithi155.stdout: } 2023-08-01T19:56:33.480 INFO:teuthology.orchestra.run.smithi155.stdout: ] 2023-08-01T19:56:33.480 INFO:teuthology.orchestra.run.smithi155.stdout: } 2023-08-01T19:56:33.480 INFO:teuthology.orchestra.run.smithi155.stdout: }, 2023-08-01T19:56:33.481 INFO:teuthology.orchestra.run.smithi155.stdout: { 2023-08-01T19:56:33.481 INFO:teuthology.orchestra.run.smithi155.stdout: "description": "osd_op(client.4668.0:100252 5.0 5:01f90c3c:::benchmark_data_smithi006_114134_object100251:head [set-alloc-hint object_size 65536 write_size 65536,write 0~65536] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e37)", 2023-08-01T19:56:33.481 INFO:teuthology.orchestra.run.smithi155.stdout: "initiated_at": "2023-08-01T19:55:05.154048+0000", 2023-08-01T19:56:33.481 INFO:teuthology.orchestra.run.smithi155.stdout: "age": 88.244328644000007, 2023-08-01T19:56:33.481 INFO:teuthology.orchestra.run.smithi155.stdout: "duration": 0.070156683999999997, 2023-08-01T19:56:33.481 INFO:teuthology.orchestra.run.smithi155.stdout: "type_data": { 2023-08-01T19:56:33.481 INFO:teuthology.orchestra.run.smithi155.stdout: "flag_point": "commit sent; apply or cleanup", 2023-08-01T19:56:33.481 INFO:teuthology.orchestra.run.smithi155.stdout: "client_info": { 2023-08-01T19:56:33.482 INFO:teuthology.orchestra.run.smithi155.stdout: "client": "client.4668", 2023-08-01T19:56:33.482 INFO:teuthology.orchestra.run.smithi155.stdout: "client_addr": "172.21.15.6:0/1709472247", 2023-08-01T19:56:33.482 INFO:teuthology.orchestra.run.smithi155.stdout: "tid": 100252 2023-08-01T19:56:33.482 INFO:teuthology.orchestra.run.smithi155.stdout: }, 2023-08-01T19:56:33.482 INFO:teuthology.orchestra.run.smithi155.stdout: "events": [ 2023-08-01T19:56:33.482 INFO:teuthology.orchestra.run.smithi155.stdout: { 2023-08-01T19:56:33.482 INFO:teuthology.orchestra.run.smithi155.stdout: "event": "initiated", 2023-08-01T19:56:33.482 INFO:teuthology.orchestra.run.smithi155.stdout: "time": "2023-08-01T19:55:05.154048+0000", 2023-08-01T19:56:33.483 INFO:teuthology.orchestra.run.smithi155.stdout: "duration": 0 2023-08-01T19:56:33.483 INFO:teuthology.orchestra.run.smithi155.stdout: }, 2023-08-01T19:56:33.483 INFO:teuthology.orchestra.run.smithi155.stdout: { 2023-08-01T19:56:33.483 INFO:teuthology.orchestra.run.smithi155.stdout: "event": "throttled", 2023-08-01T19:56:33.483 INFO:teuthology.orchestra.run.smithi155.stdout: "time": "2023-08-01T19:55:05.154048+0000", 2023-08-01T19:56:33.483 INFO:teuthology.orchestra.run.smithi155.stdout: "duration": 0 2023-08-01T19:56:33.483 INFO:teuthology.orchestra.run.smithi155.stdout: }, 2023-08-01T19:56:33.483 INFO:teuthology.orchestra.run.smithi155.stdout: { 2023-08-01T19:56:33.484 INFO:teuthology.orchestra.run.smithi155.stdout: "event": "header_read", 2023-08-01T19:56:33.484 INFO:teuthology.orchestra.run.smithi155.stdout: "time": "2023-08-01T19:55:05.154047+0000", 2023-08-01T19:56:33.484 INFO:teuthology.orchestra.run.smithi155.stdout: "duration": 4294967295.999999 2023-08-01T19:56:33.484 INFO:teuthology.orchestra.run.smithi155.stdout: }, 2023-08-01T19:56:33.484 INFO:teuthology.orchestra.run.smithi155.stdout: { 2023-08-01T19:56:33.484 INFO:teuthology.orchestra.run.smithi155.stdout: "event": "all_read", 2023-08-01T19:56:33.484 INFO:teuthology.orchestra.run.smithi155.stdout: "time": "2023-08-01T19:55:05.154115+0000", 2023-08-01T19:56:33.485 INFO:teuthology.orchestra.run.smithi155.stdout: "duration": 6.7545999999999993e-05 2023-08-01T19:56:33.485 INFO:teuthology.orchestra.run.smithi155.stdout: }, 2023-08-01T19:56:33.485 INFO:teuthology.orchestra.run.smithi155.stdout: { 2023-08-01T19:56:33.485 INFO:teuthology.orchestra.run.smithi155.stdout: "event": "dispatched", 2023-08-01T19:56:33.485 INFO:teuthology.orchestra.run.smithi155.stdout: "time": "2023-08-01T19:55:05.154125+0000", 2023-08-01T19:56:33.485 INFO:teuthology.orchestra.run.smithi155.stdout: "duration": 1.0669000000000001e-05 2023-08-01T19:56:33.485 INFO:teuthology.orchestra.run.smithi155.stdout: }, 2023-08-01T19:56:33.485 INFO:teuthology.orchestra.run.smithi155.stdout: { 2023-08-01T19:56:33.486 INFO:teuthology.orchestra.run.smithi155.stdout: "event": "queued_for_pg", 2023-08-01T19:56:33.486 INFO:teuthology.orchestra.run.smithi155.stdout: "time": "2023-08-01T19:55:05.154131+0000", 2023-08-01T19:56:33.486 INFO:teuthology.orchestra.run.smithi155.stdout: "duration": 6.0349999999999998e-06 2023-08-01T19:56:33.486 INFO:teuthology.orchestra.run.smithi155.stdout: }, 2023-08-01T19:56:33.486 INFO:teuthology.orchestra.run.smithi155.stdout: { 2023-08-01T19:56:33.486 INFO:teuthology.orchestra.run.smithi155.stdout: "event": "reached_pg", 2023-08-01T19:56:33.486 INFO:teuthology.orchestra.run.smithi155.stdout: "time": "2023-08-01T19:55:05.154174+0000", 2023-08-01T19:56:33.486 INFO:teuthology.orchestra.run.smithi155.stdout: "duration": 4.2429000000000003e-05 2023-08-01T19:56:33.487 INFO:teuthology.orchestra.run.smithi155.stdout: }, 2023-08-01T19:56:33.487 INFO:teuthology.orchestra.run.smithi155.stdout: { 2023-08-01T19:56:33.487 INFO:teuthology.orchestra.run.smithi155.stdout: "event": "started", 2023-08-01T19:56:33.487 INFO:teuthology.orchestra.run.smithi155.stdout: "time": "2023-08-01T19:55:05.154287+0000", 2023-08-01T19:56:33.487 INFO:teuthology.orchestra.run.smithi155.stdout: "duration": 0.000113138 2023-08-01T19:56:33.487 INFO:teuthology.orchestra.run.smithi155.stdout: }, 2023-08-01T19:56:33.487 INFO:teuthology.orchestra.run.smithi155.stdout: { 2023-08-01T19:56:33.487 INFO:teuthology.orchestra.run.smithi155.stdout: "event": "waiting for subops from 0", 2023-08-01T19:56:33.488 INFO:teuthology.orchestra.run.smithi155.stdout: "time": "2023-08-01T19:55:05.154420+0000", 2023-08-01T19:56:33.488 INFO:teuthology.orchestra.run.smithi155.stdout: "duration": 0.000133292 2023-08-01T19:56:33.488 INFO:teuthology.orchestra.run.smithi155.stdout: }, 2023-08-01T19:56:33.488 INFO:teuthology.orchestra.run.smithi155.stdout: { 2023-08-01T19:56:33.488 INFO:teuthology.orchestra.run.smithi155.stdout: "event": "sub_op_commit_rec", 2023-08-01T19:56:33.488 INFO:teuthology.orchestra.run.smithi155.stdout: "time": "2023-08-01T19:55:05.219034+0000", 2023-08-01T19:56:33.488 INFO:teuthology.orchestra.run.smithi155.stdout: "duration": 0.064613429999999999 2023-08-01T19:56:33.489 INFO:teuthology.orchestra.run.smithi155.stdout: }, 2023-08-01T19:56:33.489 INFO:teuthology.orchestra.run.smithi155.stdout: { 2023-08-01T19:56:33.489 INFO:teuthology.orchestra.run.smithi155.stdout: "event": "op_commit", 2023-08-01T19:56:33.489 INFO:teuthology.orchestra.run.smithi155.stdout: "time": "2023-08-01T19:55:05.224138+0000", 2023-08-01T19:56:33.489 INFO:teuthology.orchestra.run.smithi155.stdout: "duration": 0.0051041999999999997 2023-08-01T19:56:33.489 INFO:teuthology.orchestra.run.smithi155.stdout: }, 2023-08-01T19:56:33.489 INFO:teuthology.orchestra.run.smithi155.stdout: { 2023-08-01T19:56:33.489 INFO:teuthology.orchestra.run.smithi155.stdout: "event": "commit_sent", 2023-08-01T19:56:33.490 INFO:teuthology.orchestra.run.smithi155.stdout: "time": "2023-08-01T19:55:05.224171+0000", 2023-08-01T19:56:33.490 INFO:teuthology.orchestra.run.smithi155.stdout: "duration": 3.3345e-05 2023-08-01T19:56:33.490 INFO:teuthology.orchestra.run.smithi155.stdout: }, 2023-08-01T19:56:33.490 INFO:teuthology.orchestra.run.smithi155.stdout: { 2023-08-01T19:56:33.490 INFO:teuthology.orchestra.run.smithi155.stdout: "event": "done", 2023-08-01T19:56:33.490 INFO:teuthology.orchestra.run.smithi155.stdout: "time": "2023-08-01T19:55:05.224205+0000", 2023-08-01T19:56:33.490 INFO:teuthology.orchestra.run.smithi155.stdout: "duration": 3.3525999999999997e-05 2023-08-01T19:56:33.490 INFO:teuthology.orchestra.run.smithi155.stdout: } 2023-08-01T19:56:33.491 INFO:teuthology.orchestra.run.smithi155.stdout: ] 2023-08-01T19:56:33.491 INFO:teuthology.orchestra.run.smithi155.stdout: } 2023-08-01T19:56:33.491 INFO:teuthology.orchestra.run.smithi155.stdout: }, 2023-08-01T19:56:33.491 INFO:teuthology.orchestra.run.smithi155.stdout: { 2023-08-01T19:56:33.491 INFO:teuthology.orchestra.run.smithi155.stdout: "description": "osd_repop_reply(client.4668.0:100237 5.4 e37/19 ondisk, result = 0)", 2023-08-01T19:56:33.491 INFO:teuthology.orchestra.run.smithi155.stdout: "initiated_at": "2023-08-01T19:55:05.156249+0000", 2023-08-01T19:56:33.491 INFO:teuthology.orchestra.run.smithi155.stdout: "age": 88.242127698999994, 2023-08-01T19:56:33.491 INFO:teuthology.orchestra.run.smithi155.stdout: "duration": 0.062792549000000003, 2023-08-01T19:56:33.492 INFO:teuthology.orchestra.run.smithi155.stdout: "type_data": { 2023-08-01T19:56:33.492 INFO:teuthology.orchestra.run.smithi155.stdout: "flag_point": "started", 2023-08-01T19:56:33.492 INFO:teuthology.orchestra.run.smithi155.stdout: "events": [ 2023-08-01T19:56:33.492 INFO:teuthology.orchestra.run.smithi155.stdout: { 2023-08-01T19:56:33.492 INFO:teuthology.orchestra.run.smithi155.stdout: "event": "initiated", 2023-08-01T19:56:33.492 INFO:teuthology.orchestra.run.smithi155.stdout: "time": "2023-08-01T19:55:05.156249+0000", 2023-08-01T19:56:33.492 INFO:teuthology.orchestra.run.smithi155.stdout: "duration": 0 2023-08-01T19:56:33.493 INFO:teuthology.orchestra.run.smithi155.stdout: }, 2023-08-01T19:56:33.493 INFO:teuthology.orchestra.run.smithi155.stdout: { 2023-08-01T19:56:33.493 INFO:teuthology.orchestra.run.smithi155.stdout: "event": "throttled", 2023-08-01T19:56:33.493 INFO:teuthology.orchestra.run.smithi155.stdout: "time": "2023-08-01T19:55:05.156249+0000", 2023-08-01T19:56:33.493 INFO:teuthology.orchestra.run.smithi155.stdout: "duration": 0 2023-08-01T19:56:33.493 INFO:teuthology.orchestra.run.smithi155.stdout: }, 2023-08-01T19:56:33.493 INFO:teuthology.orchestra.run.smithi155.stdout: { 2023-08-01T19:56:33.493 INFO:teuthology.orchestra.run.smithi155.stdout: "event": "header_read", 2023-08-01T19:56:33.494 INFO:teuthology.orchestra.run.smithi155.stdout: "time": "2023-08-01T19:55:05.156248+0000", 2023-08-01T19:56:33.494 INFO:teuthology.orchestra.run.smithi155.stdout: "duration": 4294967295.9999995 2023-08-01T19:56:33.494 INFO:teuthology.orchestra.run.smithi155.stdout: }, 2023-08-01T19:56:33.494 INFO:teuthology.orchestra.run.smithi155.stdout: { 2023-08-01T19:56:33.494 INFO:teuthology.orchestra.run.smithi155.stdout: "event": "all_read", 2023-08-01T19:56:33.494 INFO:teuthology.orchestra.run.smithi155.stdout: "time": "2023-08-01T19:55:05.156252+0000", 2023-08-01T19:56:33.494 INFO:teuthology.orchestra.run.smithi155.stdout: "duration": 3.9999999999999998e-06 2023-08-01T19:56:33.494 INFO:teuthology.orchestra.run.smithi155.stdout: }, 2023-08-01T19:56:33.495 INFO:teuthology.orchestra.run.smithi155.stdout: { 2023-08-01T19:56:33.495 INFO:teuthology.orchestra.run.smithi155.stdout: "event": "dispatched", 2023-08-01T19:56:33.495 INFO:teuthology.orchestra.run.smithi155.stdout: "time": "2023-08-01T19:55:05.218844+0000", 2023-08-01T19:56:33.495 INFO:teuthology.orchestra.run.smithi155.stdout: "duration": 0.062591516999999999 2023-08-01T19:56:33.495 INFO:teuthology.orchestra.run.smithi155.stdout: }, 2023-08-01T19:56:33.495 INFO:teuthology.orchestra.run.smithi155.stdout: { 2023-08-01T19:56:33.495 INFO:teuthology.orchestra.run.smithi155.stdout: "event": "queued_for_pg", 2023-08-01T19:56:33.495 INFO:teuthology.orchestra.run.smithi155.stdout: "time": "2023-08-01T19:55:05.218862+0000", 2023-08-01T19:56:33.496 INFO:teuthology.orchestra.run.smithi155.stdout: "duration": 1.7666e-05 2023-08-01T19:56:33.496 INFO:teuthology.orchestra.run.smithi155.stdout: }, 2023-08-01T19:56:33.496 INFO:teuthology.orchestra.run.smithi155.stdout: { 2023-08-01T19:56:33.496 INFO:teuthology.orchestra.run.smithi155.stdout: "event": "reached_pg", 2023-08-01T19:56:33.496 INFO:teuthology.orchestra.run.smithi155.stdout: "time": "2023-08-01T19:55:05.218914+0000", 2023-08-01T19:56:33.496 INFO:teuthology.orchestra.run.smithi155.stdout: "duration": 5.2565999999999998e-05 2023-08-01T19:56:33.496 INFO:teuthology.orchestra.run.smithi155.stdout: }, 2023-08-01T19:56:33.496 INFO:teuthology.orchestra.run.smithi155.stdout: { 2023-08-01T19:56:33.497 INFO:teuthology.orchestra.run.smithi155.stdout: "event": "started", 2023-08-01T19:56:33.497 INFO:teuthology.orchestra.run.smithi155.stdout: "time": "2023-08-01T19:55:05.218925+0000", 2023-08-01T19:56:33.497 INFO:teuthology.orchestra.run.smithi155.stdout: "duration": 1.1375e-05 2023-08-01T19:56:33.497 INFO:teuthology.orchestra.run.smithi155.stdout: }, 2023-08-01T19:56:33.497 INFO:teuthology.orchestra.run.smithi155.stdout: { 2023-08-01T19:56:33.497 INFO:teuthology.orchestra.run.smithi155.stdout: "event": "done", 2023-08-01T19:56:33.497 INFO:teuthology.orchestra.run.smithi155.stdout: "time": "2023-08-01T19:55:05.219041+0000", 2023-08-01T19:56:33.497 INFO:teuthology.orchestra.run.smithi155.stdout: "duration": 0.000115977 2023-08-01T19:56:33.498 INFO:teuthology.orchestra.run.smithi155.stdout: } 2023-08-01T19:56:33.498 INFO:teuthology.orchestra.run.smithi155.stdout: ] 2023-08-01T19:56:33.498 INFO:teuthology.orchestra.run.smithi155.stdout: } 2023-08-01T19:56:33.498 INFO:teuthology.orchestra.run.smithi155.stdout: }, 2023-08-01T19:56:33.498 INFO:teuthology.orchestra.run.smithi155.stdout: { 2023-08-01T19:56:33.498 INFO:teuthology.orchestra.run.smithi155.stdout: "description": "osd_repop(client.4668.0:100253 5.f e37/19 5:f7bbce05:::benchmark_data_smithi006_114134_object100252:head v 37'6323, mlcod=37'6321)", 2023-08-01T19:56:33.498 INFO:teuthology.orchestra.run.smithi155.stdout: "initiated_at": "2023-08-01T19:55:05.156952+0000", 2023-08-01T19:56:33.498 INFO:teuthology.orchestra.run.smithi155.stdout: "age": 88.241424636000005, 2023-08-01T19:56:33.499 INFO:teuthology.orchestra.run.smithi155.stdout: "duration": 0.068018577999999996, 2023-08-01T19:56:33.499 INFO:teuthology.orchestra.run.smithi155.stdout: "type_data": { 2023-08-01T19:56:33.499 INFO:teuthology.orchestra.run.smithi155.stdout: "flag_point": "commit sent; apply or cleanup", 2023-08-01T19:56:33.499 INFO:teuthology.orchestra.run.smithi155.stdout: "events": [ 2023-08-01T19:56:33.499 INFO:teuthology.orchestra.run.smithi155.stdout: { 2023-08-01T19:56:33.499 INFO:teuthology.orchestra.run.smithi155.stdout: "event": "initiated", 2023-08-01T19:56:33.499 INFO:teuthology.orchestra.run.smithi155.stdout: "time": "2023-08-01T19:55:05.156952+0000", 2023-08-01T19:56:33.500 INFO:teuthology.orchestra.run.smithi155.stdout: "duration": 0 2023-08-01T19:56:33.500 INFO:teuthology.orchestra.run.smithi155.stdout: }, 2023-08-01T19:56:33.500 INFO:teuthology.orchestra.run.smithi155.stdout: { 2023-08-01T19:56:33.500 INFO:teuthology.orchestra.run.smithi155.stdout: "event": "throttled", 2023-08-01T19:56:33.500 INFO:teuthology.orchestra.run.smithi155.stdout: "time": "2023-08-01T19:55:05.156952+0000", 2023-08-01T19:56:33.500 INFO:teuthology.orchestra.run.smithi155.stdout: "duration": 0 2023-08-01T19:56:33.500 INFO:teuthology.orchestra.run.smithi155.stdout: }, 2023-08-01T19:56:33.500 INFO:teuthology.orchestra.run.smithi155.stdout: { 2023-08-01T19:56:33.501 INFO:teuthology.orchestra.run.smithi155.stdout: "event": "header_read", 2023-08-01T19:56:33.501 INFO:teuthology.orchestra.run.smithi155.stdout: "time": "2023-08-01T19:55:05.156951+0000", 2023-08-01T19:56:33.501 INFO:teuthology.orchestra.run.smithi155.stdout: "duration": 4294967295.999999 2023-08-01T19:56:33.501 INFO:teuthology.orchestra.run.smithi155.stdout: }, 2023-08-01T19:56:33.501 INFO:teuthology.orchestra.run.smithi155.stdout: { 2023-08-01T19:56:33.501 INFO:teuthology.orchestra.run.smithi155.stdout: "event": "all_read", 2023-08-01T19:56:33.501 INFO:teuthology.orchestra.run.smithi155.stdout: "time": "2023-08-01T19:55:05.156989+0000", 2023-08-01T19:56:33.501 INFO:teuthology.orchestra.run.smithi155.stdout: "duration": 3.8175e-05 2023-08-01T19:56:33.502 INFO:teuthology.orchestra.run.smithi155.stdout: }, 2023-08-01T19:56:33.502 INFO:teuthology.orchestra.run.smithi155.stdout: { 2023-08-01T19:56:33.502 INFO:teuthology.orchestra.run.smithi155.stdout: "event": "dispatched", 2023-08-01T19:56:33.502 INFO:teuthology.orchestra.run.smithi155.stdout: "time": "2023-08-01T19:55:05.218842+0000", 2023-08-01T19:56:33.502 INFO:teuthology.orchestra.run.smithi155.stdout: "duration": 0.061852299999999999 2023-08-01T19:56:33.502 INFO:teuthology.orchestra.run.smithi155.stdout: }, 2023-08-01T19:56:33.502 INFO:teuthology.orchestra.run.smithi155.stdout: { 2023-08-01T19:56:33.502 INFO:teuthology.orchestra.run.smithi155.stdout: "event": "queued_for_pg", 2023-08-01T19:56:33.503 INFO:teuthology.orchestra.run.smithi155.stdout: "time": "2023-08-01T19:55:05.218862+0000", 2023-08-01T19:56:33.503 INFO:teuthology.orchestra.run.smithi155.stdout: "duration": 1.9854999999999999e-05 2023-08-01T19:56:33.503 INFO:teuthology.orchestra.run.smithi155.stdout: }, 2023-08-01T19:56:33.503 INFO:teuthology.orchestra.run.smithi155.stdout: { 2023-08-01T19:56:33.503 INFO:teuthology.orchestra.run.smithi155.stdout: "event": "reached_pg", 2023-08-01T19:56:33.503 INFO:teuthology.orchestra.run.smithi155.stdout: "time": "2023-08-01T19:55:05.218918+0000", 2023-08-01T19:56:33.503 INFO:teuthology.orchestra.run.smithi155.stdout: "duration": 5.6570000000000002e-05 2023-08-01T19:56:33.504 INFO:teuthology.orchestra.run.smithi155.stdout: }, 2023-08-01T19:56:33.504 INFO:teuthology.orchestra.run.smithi155.stdout: { 2023-08-01T19:56:33.504 INFO:teuthology.orchestra.run.smithi155.stdout: "event": "started", 2023-08-01T19:56:33.504 INFO:teuthology.orchestra.run.smithi155.stdout: "time": "2023-08-01T19:55:05.218940+0000", 2023-08-01T19:56:33.504 INFO:teuthology.orchestra.run.smithi155.stdout: "duration": 2.1804e-05 2023-08-01T19:56:33.504 INFO:teuthology.orchestra.run.smithi155.stdout: }, 2023-08-01T19:56:33.504 INFO:teuthology.orchestra.run.smithi155.stdout: { 2023-08-01T19:56:33.504 INFO:teuthology.orchestra.run.smithi155.stdout: "event": "commit_sent", 2023-08-01T19:56:33.505 INFO:teuthology.orchestra.run.smithi155.stdout: "time": "2023-08-01T19:55:05.224928+0000", 2023-08-01T19:56:33.505 INFO:teuthology.orchestra.run.smithi155.stdout: "duration": 0.0059876759999999999 2023-08-01T19:56:33.505 INFO:teuthology.orchestra.run.smithi155.stdout: }, 2023-08-01T19:56:33.505 INFO:teuthology.orchestra.run.smithi155.stdout: { 2023-08-01T19:56:33.505 INFO:teuthology.orchestra.run.smithi155.stdout: "event": "done", 2023-08-01T19:56:33.505 INFO:teuthology.orchestra.run.smithi155.stdout: "time": "2023-08-01T19:55:05.224971+0000", 2023-08-01T19:56:33.505 INFO:teuthology.orchestra.run.smithi155.stdout: "duration": 4.2929999999999997e-05 2023-08-01T19:56:33.505 INFO:teuthology.orchestra.run.smithi155.stdout: } 2023-08-01T19:56:33.506 INFO:teuthology.orchestra.run.smithi155.stdout: ] 2023-08-01T19:56:33.506 INFO:teuthology.orchestra.run.smithi155.stdout: } 2023-08-01T19:56:33.506 INFO:teuthology.orchestra.run.smithi155.stdout: }, 2023-08-01T19:56:33.506 INFO:teuthology.orchestra.run.smithi155.stdout: { 2023-08-01T19:56:33.506 INFO:teuthology.orchestra.run.smithi155.stdout: "description": "osd_op(client.4668.0:100927 5.0 5:00608ec6:::benchmark_data_smithi006_114134_object100926:head [set-alloc-hint object_size 65536 write_size 65536,write 0~65536] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e37)", 2023-08-01T19:56:33.506 INFO:teuthology.orchestra.run.smithi155.stdout: "initiated_at": "2023-08-01T19:55:05.561169+0000", 2023-08-01T19:56:33.506 INFO:teuthology.orchestra.run.smithi155.stdout: "age": 87.837207733, 2023-08-01T19:56:33.506 INFO:teuthology.orchestra.run.smithi155.stdout: "duration": 0.066411687999999997, 2023-08-01T19:56:33.507 INFO:teuthology.orchestra.run.smithi155.stdout: "type_data": { 2023-08-01T19:56:33.507 INFO:teuthology.orchestra.run.smithi155.stdout: "flag_point": "commit sent; apply or cleanup", 2023-08-01T19:56:33.507 INFO:teuthology.orchestra.run.smithi155.stdout: "client_info": { 2023-08-01T19:56:33.507 INFO:teuthology.orchestra.run.smithi155.stdout: "client": "client.4668", 2023-08-01T19:56:33.507 INFO:teuthology.orchestra.run.smithi155.stdout: "client_addr": "172.21.15.6:0/1709472247", 2023-08-01T19:56:33.507 INFO:teuthology.orchestra.run.smithi155.stdout: "tid": 100927 2023-08-01T19:56:33.507 INFO:teuthology.orchestra.run.smithi155.stdout: }, 2023-08-01T19:56:33.507 INFO:teuthology.orchestra.run.smithi155.stdout: "events": [ 2023-08-01T19:56:33.508 INFO:teuthology.orchestra.run.smithi155.stdout: { 2023-08-01T19:56:33.508 INFO:teuthology.orchestra.run.smithi155.stdout: "event": "initiated", 2023-08-01T19:56:33.508 INFO:teuthology.orchestra.run.smithi155.stdout: "time": "2023-08-01T19:55:05.561169+0000", 2023-08-01T19:56:33.508 INFO:teuthology.orchestra.run.smithi155.stdout: "duration": 0 2023-08-01T19:56:33.508 INFO:teuthology.orchestra.run.smithi155.stdout: }, 2023-08-01T19:56:33.508 INFO:teuthology.orchestra.run.smithi155.stdout: { 2023-08-01T19:56:33.508 INFO:teuthology.orchestra.run.smithi155.stdout: "event": "throttled", 2023-08-01T19:56:33.509 INFO:teuthology.orchestra.run.smithi155.stdout: "time": "2023-08-01T19:55:05.561169+0000", 2023-08-01T19:56:33.509 INFO:teuthology.orchestra.run.smithi155.stdout: "duration": 0 2023-08-01T19:56:33.509 INFO:teuthology.orchestra.run.smithi155.stdout: }, 2023-08-01T19:56:33.509 INFO:teuthology.orchestra.run.smithi155.stdout: { 2023-08-01T19:56:33.509 INFO:teuthology.orchestra.run.smithi155.stdout: "event": "header_read", 2023-08-01T19:56:33.509 INFO:teuthology.orchestra.run.smithi155.stdout: "time": "2023-08-01T19:55:05.561168+0000", 2023-08-01T19:56:33.509 INFO:teuthology.orchestra.run.smithi155.stdout: "duration": 4294967295.9999995 2023-08-01T19:56:33.510 INFO:teuthology.orchestra.run.smithi155.stdout: }, 2023-08-01T19:56:33.510 INFO:teuthology.orchestra.run.smithi155.stdout: { 2023-08-01T19:56:33.510 INFO:teuthology.orchestra.run.smithi155.stdout: "event": "all_read", 2023-08-01T19:56:33.510 INFO:teuthology.orchestra.run.smithi155.stdout: "time": "2023-08-01T19:55:05.561218+0000", 2023-08-01T19:56:33.510 INFO:teuthology.orchestra.run.smithi155.stdout: "duration": 4.9379999999999998e-05 2023-08-01T19:56:33.510 INFO:teuthology.orchestra.run.smithi155.stdout: }, 2023-08-01T19:56:33.510 INFO:teuthology.orchestra.run.smithi155.stdout: { 2023-08-01T19:56:33.510 INFO:teuthology.orchestra.run.smithi155.stdout: "event": "dispatched", 2023-08-01T19:56:33.511 INFO:teuthology.orchestra.run.smithi155.stdout: "time": "2023-08-01T19:55:05.561225+0000", 2023-08-01T19:56:33.511 INFO:teuthology.orchestra.run.smithi155.stdout: "duration": 7.114e-06 2023-08-01T19:56:33.511 INFO:teuthology.orchestra.run.smithi155.stdout: }, 2023-08-01T19:56:33.511 INFO:teuthology.orchestra.run.smithi155.stdout: { 2023-08-01T19:56:33.511 INFO:teuthology.orchestra.run.smithi155.stdout: "event": "queued_for_pg", 2023-08-01T19:56:33.511 INFO:teuthology.orchestra.run.smithi155.stdout: "time": "2023-08-01T19:55:05.561229+0000", 2023-08-01T19:56:33.511 INFO:teuthology.orchestra.run.smithi155.stdout: "duration": 4.2180000000000001e-06 2023-08-01T19:56:33.511 INFO:teuthology.orchestra.run.smithi155.stdout: }, 2023-08-01T19:56:33.512 INFO:teuthology.orchestra.run.smithi155.stdout: { 2023-08-01T19:56:33.512 INFO:teuthology.orchestra.run.smithi155.stdout: "event": "reached_pg", 2023-08-01T19:56:33.512 INFO:teuthology.orchestra.run.smithi155.stdout: "time": "2023-08-01T19:55:05.564737+0000", 2023-08-01T19:56:33.512 INFO:teuthology.orchestra.run.smithi155.stdout: "duration": 0.0035081869999999999 2023-08-01T19:56:33.512 INFO:teuthology.orchestra.run.smithi155.stdout: }, 2023-08-01T19:56:33.512 INFO:teuthology.orchestra.run.smithi155.stdout: { 2023-08-01T19:56:33.512 INFO:teuthology.orchestra.run.smithi155.stdout: "event": "started", 2023-08-01T19:56:33.512 INFO:teuthology.orchestra.run.smithi155.stdout: "time": "2023-08-01T19:55:05.564859+0000", 2023-08-01T19:56:33.513 INFO:teuthology.orchestra.run.smithi155.stdout: "duration": 0.00012165800000000001 2023-08-01T19:56:33.513 INFO:teuthology.orchestra.run.smithi155.stdout: }, 2023-08-01T19:56:33.513 INFO:teuthology.orchestra.run.smithi155.stdout: { 2023-08-01T19:56:33.513 INFO:teuthology.orchestra.run.smithi155.stdout: "event": "waiting for subops from 0", 2023-08-01T19:56:33.513 INFO:teuthology.orchestra.run.smithi155.stdout: "time": "2023-08-01T19:55:05.565009+0000", 2023-08-01T19:56:33.513 INFO:teuthology.orchestra.run.smithi155.stdout: "duration": 0.00014979699999999999 2023-08-01T19:56:33.513 INFO:teuthology.orchestra.run.smithi155.stdout: }, 2023-08-01T19:56:33.514 INFO:teuthology.orchestra.run.smithi155.stdout: { 2023-08-01T19:56:33.514 INFO:teuthology.orchestra.run.smithi155.stdout: "event": "op_commit", 2023-08-01T19:56:33.514 INFO:teuthology.orchestra.run.smithi155.stdout: "time": "2023-08-01T19:55:05.568007+0000", 2023-08-01T19:56:33.514 INFO:teuthology.orchestra.run.smithi155.stdout: "duration": 0.00299796 2023-08-01T19:56:33.514 INFO:teuthology.orchestra.run.smithi155.stdout: }, 2023-08-01T19:56:33.514 INFO:teuthology.orchestra.run.smithi155.stdout: { 2023-08-01T19:56:33.514 INFO:teuthology.orchestra.run.smithi155.stdout: "event": "sub_op_commit_rec", 2023-08-01T19:56:33.514 INFO:teuthology.orchestra.run.smithi155.stdout: "time": "2023-08-01T19:55:05.627520+0000", 2023-08-01T19:56:33.515 INFO:teuthology.orchestra.run.smithi155.stdout: "duration": 0.059513636000000002 2023-08-01T19:56:33.515 INFO:teuthology.orchestra.run.smithi155.stdout: }, 2023-08-01T19:56:33.515 INFO:teuthology.orchestra.run.smithi155.stdout: { 2023-08-01T19:56:33.515 INFO:teuthology.orchestra.run.smithi155.stdout: "event": "commit_sent", 2023-08-01T19:56:33.515 INFO:teuthology.orchestra.run.smithi155.stdout: "time": "2023-08-01T19:55:05.627553+0000", 2023-08-01T19:56:33.515 INFO:teuthology.orchestra.run.smithi155.stdout: "duration": 3.2635999999999997e-05 2023-08-01T19:56:33.515 INFO:teuthology.orchestra.run.smithi155.stdout: }, 2023-08-01T19:56:33.516 INFO:teuthology.orchestra.run.smithi155.stdout: { 2023-08-01T19:56:33.516 INFO:teuthology.orchestra.run.smithi155.stdout: "event": "done", 2023-08-01T19:56:33.516 INFO:teuthology.orchestra.run.smithi155.stdout: "time": "2023-08-01T19:55:05.627581+0000", 2023-08-01T19:56:33.516 INFO:teuthology.orchestra.run.smithi155.stdout: "duration": 2.7681000000000001e-05 2023-08-01T19:56:33.516 INFO:teuthology.orchestra.run.smithi155.stdout: } 2023-08-01T19:56:33.516 INFO:teuthology.orchestra.run.smithi155.stdout: ] 2023-08-01T19:56:33.516 INFO:teuthology.orchestra.run.smithi155.stdout: } 2023-08-01T19:56:33.517 INFO:teuthology.orchestra.run.smithi155.stdout: }, 2023-08-01T19:56:33.517 INFO:teuthology.orchestra.run.smithi155.stdout: { 2023-08-01T19:56:33.517 INFO:teuthology.orchestra.run.smithi155.stdout: "description": "osd_op(client.4668.0:100935 5.e 5:7895b14e:::benchmark_data_smithi006_114134_object100934:head [set-alloc-hint object_size 65536 write_size 65536,write 0~65536] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e37)", 2023-08-01T19:56:33.517 INFO:teuthology.orchestra.run.smithi155.stdout: "initiated_at": "2023-08-01T19:55:05.566666+0000", 2023-08-01T19:56:33.517 INFO:teuthology.orchestra.run.smithi155.stdout: "age": 87.831710432999998, 2023-08-01T19:56:33.517 INFO:teuthology.orchestra.run.smithi155.stdout: "duration": 0.064309016999999996, 2023-08-01T19:56:33.517 INFO:teuthology.orchestra.run.smithi155.stdout: "type_data": { 2023-08-01T19:56:33.517 INFO:teuthology.orchestra.run.smithi155.stdout: "flag_point": "commit sent; apply or cleanup", 2023-08-01T19:56:33.518 INFO:teuthology.orchestra.run.smithi155.stdout: "client_info": { 2023-08-01T19:56:33.518 INFO:teuthology.orchestra.run.smithi155.stdout: "client": "client.4668", 2023-08-01T19:56:33.518 INFO:teuthology.orchestra.run.smithi155.stdout: "client_addr": "172.21.15.6:0/1709472247", 2023-08-01T19:56:33.518 INFO:teuthology.orchestra.run.smithi155.stdout: "tid": 100935 2023-08-01T19:56:33.518 INFO:teuthology.orchestra.run.smithi155.stdout: }, 2023-08-01T19:56:33.518 INFO:teuthology.orchestra.run.smithi155.stdout: "events": [ 2023-08-01T19:56:33.518 INFO:teuthology.orchestra.run.smithi155.stdout: { 2023-08-01T19:56:33.519 INFO:teuthology.orchestra.run.smithi155.stdout: "event": "initiated", 2023-08-01T19:56:33.519 INFO:teuthology.orchestra.run.smithi155.stdout: "time": "2023-08-01T19:55:05.566666+0000", 2023-08-01T19:56:33.519 INFO:teuthology.orchestra.run.smithi155.stdout: "duration": 0 2023-08-01T19:56:33.519 INFO:teuthology.orchestra.run.smithi155.stdout: }, 2023-08-01T19:56:33.519 INFO:teuthology.orchestra.run.smithi155.stdout: { 2023-08-01T19:56:33.519 INFO:teuthology.orchestra.run.smithi155.stdout: "event": "throttled", 2023-08-01T19:56:33.519 INFO:teuthology.orchestra.run.smithi155.stdout: "time": "2023-08-01T19:55:05.566666+0000", 2023-08-01T19:56:33.519 INFO:teuthology.orchestra.run.smithi155.stdout: "duration": 0 2023-08-01T19:56:33.520 INFO:teuthology.orchestra.run.smithi155.stdout: }, 2023-08-01T19:56:33.520 INFO:teuthology.orchestra.run.smithi155.stdout: { 2023-08-01T19:56:33.520 INFO:teuthology.orchestra.run.smithi155.stdout: "event": "header_read", 2023-08-01T19:56:33.520 INFO:teuthology.orchestra.run.smithi155.stdout: "time": "2023-08-01T19:55:05.566665+0000", 2023-08-01T19:56:33.520 INFO:teuthology.orchestra.run.smithi155.stdout: "duration": 4294967295.9999986 2023-08-01T19:56:33.520 INFO:teuthology.orchestra.run.smithi155.stdout: }, 2023-08-01T19:56:33.520 INFO:teuthology.orchestra.run.smithi155.stdout: { 2023-08-01T19:56:33.520 INFO:teuthology.orchestra.run.smithi155.stdout: "event": "all_read", 2023-08-01T19:56:33.521 INFO:teuthology.orchestra.run.smithi155.stdout: "time": "2023-08-01T19:55:05.566754+0000", 2023-08-01T19:56:33.521 INFO:teuthology.orchestra.run.smithi155.stdout: "duration": 8.9425999999999994e-05 2023-08-01T19:56:33.521 INFO:teuthology.orchestra.run.smithi155.stdout: }, 2023-08-01T19:56:33.521 INFO:teuthology.orchestra.run.smithi155.stdout: { 2023-08-01T19:56:33.521 INFO:teuthology.orchestra.run.smithi155.stdout: "event": "dispatched", 2023-08-01T19:56:33.521 INFO:teuthology.orchestra.run.smithi155.stdout: "time": "2023-08-01T19:55:05.566766+0000", 2023-08-01T19:56:33.521 INFO:teuthology.orchestra.run.smithi155.stdout: "duration": 1.2018000000000001e-05 2023-08-01T19:56:33.522 INFO:teuthology.orchestra.run.smithi155.stdout: }, 2023-08-01T19:56:33.522 INFO:teuthology.orchestra.run.smithi155.stdout: { 2023-08-01T19:56:33.522 INFO:teuthology.orchestra.run.smithi155.stdout: "event": "queued_for_pg", 2023-08-01T19:56:33.522 INFO:teuthology.orchestra.run.smithi155.stdout: "time": "2023-08-01T19:55:05.566772+0000", 2023-08-01T19:56:33.522 INFO:teuthology.orchestra.run.smithi155.stdout: "duration": 6.0190000000000003e-06 2023-08-01T19:56:33.522 INFO:teuthology.orchestra.run.smithi155.stdout: }, 2023-08-01T19:56:33.522 INFO:teuthology.orchestra.run.smithi155.stdout: { 2023-08-01T19:56:33.522 INFO:teuthology.orchestra.run.smithi155.stdout: "event": "reached_pg", 2023-08-01T19:56:33.523 INFO:teuthology.orchestra.run.smithi155.stdout: "time": "2023-08-01T19:55:05.566800+0000", 2023-08-01T19:56:33.523 INFO:teuthology.orchestra.run.smithi155.stdout: "duration": 2.7835999999999999e-05 2023-08-01T19:56:33.523 INFO:teuthology.orchestra.run.smithi155.stdout: }, 2023-08-01T19:56:33.523 INFO:teuthology.orchestra.run.smithi155.stdout: { 2023-08-01T19:56:33.523 INFO:teuthology.orchestra.run.smithi155.stdout: "event": "started", 2023-08-01T19:56:33.523 INFO:teuthology.orchestra.run.smithi155.stdout: "time": "2023-08-01T19:55:05.566879+0000", 2023-08-01T19:56:33.523 INFO:teuthology.orchestra.run.smithi155.stdout: "duration": 7.9105999999999998e-05 2023-08-01T19:56:33.524 INFO:teuthology.orchestra.run.smithi155.stdout: }, 2023-08-01T19:56:33.524 INFO:teuthology.orchestra.run.smithi155.stdout: { 2023-08-01T19:56:33.524 INFO:teuthology.orchestra.run.smithi155.stdout: "event": "waiting for subops from 0", 2023-08-01T19:56:33.524 INFO:teuthology.orchestra.run.smithi155.stdout: "time": "2023-08-01T19:55:05.566971+0000", 2023-08-01T19:56:33.524 INFO:teuthology.orchestra.run.smithi155.stdout: "duration": 9.1817999999999994e-05 2023-08-01T19:56:33.524 INFO:teuthology.orchestra.run.smithi155.stdout: }, 2023-08-01T19:56:33.524 INFO:teuthology.orchestra.run.smithi155.stdout: { 2023-08-01T19:56:33.524 INFO:teuthology.orchestra.run.smithi155.stdout: "event": "op_commit", 2023-08-01T19:56:33.525 INFO:teuthology.orchestra.run.smithi155.stdout: "time": "2023-08-01T19:55:05.571475+0000", 2023-08-01T19:56:33.525 INFO:teuthology.orchestra.run.smithi155.stdout: "duration": 0.0045039499999999996 2023-08-01T19:56:33.525 INFO:teuthology.orchestra.run.smithi155.stdout: }, 2023-08-01T19:56:33.525 INFO:teuthology.orchestra.run.smithi155.stdout: { 2023-08-01T19:56:33.525 INFO:teuthology.orchestra.run.smithi155.stdout: "event": "sub_op_commit_rec", 2023-08-01T19:56:33.525 INFO:teuthology.orchestra.run.smithi155.stdout: "time": "2023-08-01T19:55:05.630884+0000", 2023-08-01T19:56:33.525 INFO:teuthology.orchestra.run.smithi155.stdout: "duration": 0.059409181999999998 2023-08-01T19:56:33.525 INFO:teuthology.orchestra.run.smithi155.stdout: }, 2023-08-01T19:56:33.526 INFO:teuthology.orchestra.run.smithi155.stdout: { 2023-08-01T19:56:33.526 INFO:teuthology.orchestra.run.smithi155.stdout: "event": "commit_sent", 2023-08-01T19:56:33.526 INFO:teuthology.orchestra.run.smithi155.stdout: "time": "2023-08-01T19:55:05.630930+0000", 2023-08-01T19:56:33.526 INFO:teuthology.orchestra.run.smithi155.stdout: "duration": 4.5507999999999999e-05 2023-08-01T19:56:33.526 INFO:teuthology.orchestra.run.smithi155.stdout: }, 2023-08-01T19:56:33.526 INFO:teuthology.orchestra.run.smithi155.stdout: { 2023-08-01T19:56:33.526 INFO:teuthology.orchestra.run.smithi155.stdout: "event": "done", 2023-08-01T19:56:33.526 INFO:teuthology.orchestra.run.smithi155.stdout: "time": "2023-08-01T19:55:05.630975+0000", 2023-08-01T19:56:33.527 INFO:teuthology.orchestra.run.smithi155.stdout: "duration": 4.5441000000000001e-05 2023-08-01T19:56:33.527 INFO:teuthology.orchestra.run.smithi155.stdout: } 2023-08-01T19:56:33.527 INFO:teuthology.orchestra.run.smithi155.stdout: ] 2023-08-01T19:56:33.527 INFO:teuthology.orchestra.run.smithi155.stdout: } 2023-08-01T19:56:33.527 INFO:teuthology.orchestra.run.smithi155.stdout: }, 2023-08-01T19:56:33.527 INFO:teuthology.orchestra.run.smithi155.stdout: { 2023-08-01T19:56:33.527 INFO:teuthology.orchestra.run.smithi155.stdout: "description": "osd_op(client.4668.0:100941 5.e 5:736a6ac6:::benchmark_data_smithi006_114134_object100940:head [set-alloc-hint object_size 65536 write_size 65536,write 0~65536] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e37)", 2023-08-01T19:56:33.528 INFO:teuthology.orchestra.run.smithi155.stdout: "initiated_at": "2023-08-01T19:55:05.569750+0000", 2023-08-01T19:56:33.528 INFO:teuthology.orchestra.run.smithi155.stdout: "age": 87.828626540000002, 2023-08-01T19:56:33.528 INFO:teuthology.orchestra.run.smithi155.stdout: "duration": 0.065431331999999995, 2023-08-01T19:56:33.528 INFO:teuthology.orchestra.run.smithi155.stdout: "type_data": { 2023-08-01T19:56:33.528 INFO:teuthology.orchestra.run.smithi155.stdout: "flag_point": "commit sent; apply or cleanup", 2023-08-01T19:56:33.528 INFO:teuthology.orchestra.run.smithi155.stdout: "client_info": { 2023-08-01T19:56:33.528 INFO:teuthology.orchestra.run.smithi155.stdout: "client": "client.4668", 2023-08-01T19:56:33.528 INFO:teuthology.orchestra.run.smithi155.stdout: "client_addr": "172.21.15.6:0/1709472247", 2023-08-01T19:56:33.529 INFO:teuthology.orchestra.run.smithi155.stdout: "tid": 100941 2023-08-01T19:56:33.529 INFO:teuthology.orchestra.run.smithi155.stdout: }, 2023-08-01T19:56:33.529 INFO:teuthology.orchestra.run.smithi155.stdout: "events": [ 2023-08-01T19:56:33.529 INFO:teuthology.orchestra.run.smithi155.stdout: { 2023-08-01T19:56:33.529 INFO:teuthology.orchestra.run.smithi155.stdout: "event": "initiated", 2023-08-01T19:56:33.529 INFO:teuthology.orchestra.run.smithi155.stdout: "time": "2023-08-01T19:55:05.569750+0000", 2023-08-01T19:56:33.529 INFO:teuthology.orchestra.run.smithi155.stdout: "duration": 0 2023-08-01T19:56:33.529 INFO:teuthology.orchestra.run.smithi155.stdout: }, 2023-08-01T19:56:33.530 INFO:teuthology.orchestra.run.smithi155.stdout: { 2023-08-01T19:56:33.530 INFO:teuthology.orchestra.run.smithi155.stdout: "event": "throttled", 2023-08-01T19:56:33.530 INFO:teuthology.orchestra.run.smithi155.stdout: "time": "2023-08-01T19:55:05.569750+0000", 2023-08-01T19:56:33.530 INFO:teuthology.orchestra.run.smithi155.stdout: "duration": 0 2023-08-01T19:56:33.530 INFO:teuthology.orchestra.run.smithi155.stdout: }, 2023-08-01T19:56:33.530 INFO:teuthology.orchestra.run.smithi155.stdout: { 2023-08-01T19:56:33.530 INFO:teuthology.orchestra.run.smithi155.stdout: "event": "header_read", 2023-08-01T19:56:33.530 INFO:teuthology.orchestra.run.smithi155.stdout: "time": "2023-08-01T19:55:05.569749+0000", 2023-08-01T19:56:33.531 INFO:teuthology.orchestra.run.smithi155.stdout: "duration": 4294967295.999999 2023-08-01T19:56:33.531 INFO:teuthology.orchestra.run.smithi155.stdout: }, 2023-08-01T19:56:33.531 INFO:teuthology.orchestra.run.smithi155.stdout: { 2023-08-01T19:56:33.531 INFO:teuthology.orchestra.run.smithi155.stdout: "event": "all_read", 2023-08-01T19:56:33.531 INFO:teuthology.orchestra.run.smithi155.stdout: "time": "2023-08-01T19:55:05.569861+0000", 2023-08-01T19:56:33.531 INFO:teuthology.orchestra.run.smithi155.stdout: "duration": 0.000111333 2023-08-01T19:56:33.531 INFO:teuthology.orchestra.run.smithi155.stdout: }, 2023-08-01T19:56:33.532 INFO:teuthology.orchestra.run.smithi155.stdout: { 2023-08-01T19:56:33.532 INFO:teuthology.orchestra.run.smithi155.stdout: "event": "dispatched", 2023-08-01T19:56:33.532 INFO:teuthology.orchestra.run.smithi155.stdout: "time": "2023-08-01T19:55:05.569869+0000", 2023-08-01T19:56:33.532 INFO:teuthology.orchestra.run.smithi155.stdout: "duration": 8.8589999999999994e-06 2023-08-01T19:56:33.532 INFO:teuthology.orchestra.run.smithi155.stdout: }, 2023-08-01T19:56:33.532 INFO:teuthology.orchestra.run.smithi155.stdout: { 2023-08-01T19:56:33.532 INFO:teuthology.orchestra.run.smithi155.stdout: "event": "queued_for_pg", 2023-08-01T19:56:33.532 INFO:teuthology.orchestra.run.smithi155.stdout: "time": "2023-08-01T19:55:05.569874+0000", 2023-08-01T19:56:33.533 INFO:teuthology.orchestra.run.smithi155.stdout: "duration": 4.1679999999999997e-06 2023-08-01T19:56:33.533 INFO:teuthology.orchestra.run.smithi155.stdout: }, 2023-08-01T19:56:33.533 INFO:teuthology.orchestra.run.smithi155.stdout: { 2023-08-01T19:56:33.533 INFO:teuthology.orchestra.run.smithi155.stdout: "event": "reached_pg", 2023-08-01T19:56:33.533 INFO:teuthology.orchestra.run.smithi155.stdout: "time": "2023-08-01T19:55:05.569904+0000", 2023-08-01T19:56:33.533 INFO:teuthology.orchestra.run.smithi155.stdout: "duration": 3.0920999999999998e-05 2023-08-01T19:56:33.533 INFO:teuthology.orchestra.run.smithi155.stdout: }, 2023-08-01T19:56:33.533 INFO:teuthology.orchestra.run.smithi155.stdout: { 2023-08-01T19:56:33.534 INFO:teuthology.orchestra.run.smithi155.stdout: "event": "started", 2023-08-01T19:56:33.534 INFO:teuthology.orchestra.run.smithi155.stdout: "time": "2023-08-01T19:55:05.569998+0000", 2023-08-01T19:56:33.534 INFO:teuthology.orchestra.run.smithi155.stdout: "duration": 9.3086999999999998e-05 2023-08-01T19:56:33.534 INFO:teuthology.orchestra.run.smithi155.stdout: }, 2023-08-01T19:56:33.534 INFO:teuthology.orchestra.run.smithi155.stdout: { 2023-08-01T19:56:33.534 INFO:teuthology.orchestra.run.smithi155.stdout: "event": "waiting for subops from 0", 2023-08-01T19:56:33.534 INFO:teuthology.orchestra.run.smithi155.stdout: "time": "2023-08-01T19:55:05.570093+0000", 2023-08-01T19:56:33.534 INFO:teuthology.orchestra.run.smithi155.stdout: "duration": 9.5768999999999997e-05 2023-08-01T19:56:33.535 INFO:teuthology.orchestra.run.smithi155.stdout: }, 2023-08-01T19:56:33.535 INFO:teuthology.orchestra.run.smithi155.stdout: { 2023-08-01T19:56:33.535 INFO:teuthology.orchestra.run.smithi155.stdout: "event": "op_commit", 2023-08-01T19:56:33.535 INFO:teuthology.orchestra.run.smithi155.stdout: "time": "2023-08-01T19:55:05.572839+0000", 2023-08-01T19:56:33.535 INFO:teuthology.orchestra.run.smithi155.stdout: "duration": 0.0027460050000000001 2023-08-01T19:56:33.535 INFO:teuthology.orchestra.run.smithi155.stdout: }, 2023-08-01T19:56:33.535 INFO:teuthology.orchestra.run.smithi155.stdout: { 2023-08-01T19:56:33.536 INFO:teuthology.orchestra.run.smithi155.stdout: "event": "sub_op_commit_rec", 2023-08-01T19:56:33.536 INFO:teuthology.orchestra.run.smithi155.stdout: "time": "2023-08-01T19:55:05.635114+0000", 2023-08-01T19:56:33.536 INFO:teuthology.orchestra.run.smithi155.stdout: "duration": 0.062274297999999999 2023-08-01T19:56:33.536 INFO:teuthology.orchestra.run.smithi155.stdout: }, 2023-08-01T19:56:33.536 INFO:teuthology.orchestra.run.smithi155.stdout: { 2023-08-01T19:56:33.536 INFO:teuthology.orchestra.run.smithi155.stdout: "event": "commit_sent", 2023-08-01T19:56:33.536 INFO:teuthology.orchestra.run.smithi155.stdout: "time": "2023-08-01T19:55:05.635143+0000", 2023-08-01T19:56:33.536 INFO:teuthology.orchestra.run.smithi155.stdout: "duration": 2.9430000000000001e-05 2023-08-01T19:56:33.537 INFO:teuthology.orchestra.run.smithi155.stdout: }, 2023-08-01T19:56:33.537 INFO:teuthology.orchestra.run.smithi155.stdout: { 2023-08-01T19:56:33.537 INFO:teuthology.orchestra.run.smithi155.stdout: "event": "done", 2023-08-01T19:56:33.537 INFO:teuthology.orchestra.run.smithi155.stdout: "time": "2023-08-01T19:55:05.635181+0000", 2023-08-01T19:56:33.537 INFO:teuthology.orchestra.run.smithi155.stdout: "duration": 3.8352000000000001e-05 2023-08-01T19:56:33.537 INFO:teuthology.orchestra.run.smithi155.stdout: } 2023-08-01T19:56:33.537 INFO:teuthology.orchestra.run.smithi155.stdout: ] 2023-08-01T19:56:33.538 INFO:teuthology.orchestra.run.smithi155.stdout: } 2023-08-01T19:56:33.538 INFO:teuthology.orchestra.run.smithi155.stdout: }, 2023-08-01T19:56:33.538 INFO:teuthology.orchestra.run.smithi155.stdout: { 2023-08-01T19:56:33.538 INFO:teuthology.orchestra.run.smithi155.stdout: "description": "osd_op(client.4668.0:100945 5.e 5:73df68dd:::benchmark_data_smithi006_114134_object100944:head [set-alloc-hint object_size 65536 write_size 65536,write 0~65536] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e37)", 2023-08-01T19:56:33.538 INFO:teuthology.orchestra.run.smithi155.stdout: "initiated_at": "2023-08-01T19:55:05.576784+0000", 2023-08-01T19:56:33.538 INFO:teuthology.orchestra.run.smithi155.stdout: "age": 87.821592955, 2023-08-01T19:56:33.538 INFO:teuthology.orchestra.run.smithi155.stdout: "duration": 0.058512994999999998, 2023-08-01T19:56:33.539 INFO:teuthology.orchestra.run.smithi155.stdout: "type_data": { 2023-08-01T19:56:33.539 INFO:teuthology.orchestra.run.smithi155.stdout: "flag_point": "commit sent; apply or cleanup", 2023-08-01T19:56:33.539 INFO:teuthology.orchestra.run.smithi155.stdout: "client_info": { 2023-08-01T19:56:33.539 INFO:teuthology.orchestra.run.smithi155.stdout: "client": "client.4668", 2023-08-01T19:56:33.539 INFO:teuthology.orchestra.run.smithi155.stdout: "client_addr": "172.21.15.6:0/1709472247", 2023-08-01T19:56:33.539 INFO:teuthology.orchestra.run.smithi155.stdout: "tid": 100945 2023-08-01T19:56:33.539 INFO:teuthology.orchestra.run.smithi155.stdout: }, 2023-08-01T19:56:33.539 INFO:teuthology.orchestra.run.smithi155.stdout: "events": [ 2023-08-01T19:56:33.540 INFO:teuthology.orchestra.run.smithi155.stdout: { 2023-08-01T19:56:33.540 INFO:teuthology.orchestra.run.smithi155.stdout: "event": "initiated", 2023-08-01T19:56:33.540 INFO:teuthology.orchestra.run.smithi155.stdout: "time": "2023-08-01T19:55:05.576784+0000", 2023-08-01T19:56:33.540 INFO:teuthology.orchestra.run.smithi155.stdout: "duration": 0 2023-08-01T19:56:33.540 INFO:teuthology.orchestra.run.smithi155.stdout: }, 2023-08-01T19:56:33.540 INFO:teuthology.orchestra.run.smithi155.stdout: { 2023-08-01T19:56:33.540 INFO:teuthology.orchestra.run.smithi155.stdout: "event": "throttled", 2023-08-01T19:56:33.541 INFO:teuthology.orchestra.run.smithi155.stdout: "time": "2023-08-01T19:55:05.576784+0000", 2023-08-01T19:56:33.541 INFO:teuthology.orchestra.run.smithi155.stdout: "duration": 0 2023-08-01T19:56:33.541 INFO:teuthology.orchestra.run.smithi155.stdout: }, 2023-08-01T19:56:33.541 INFO:teuthology.orchestra.run.smithi155.stdout: { 2023-08-01T19:56:33.541 INFO:teuthology.orchestra.run.smithi155.stdout: "event": "header_read", 2023-08-01T19:56:33.541 INFO:teuthology.orchestra.run.smithi155.stdout: "time": "2023-08-01T19:55:05.576783+0000", 2023-08-01T19:56:33.541 INFO:teuthology.orchestra.run.smithi155.stdout: "duration": 4294967295.9999995 2023-08-01T19:56:33.541 INFO:teuthology.orchestra.run.smithi155.stdout: }, 2023-08-01T19:56:33.542 INFO:teuthology.orchestra.run.smithi155.stdout: { 2023-08-01T19:56:33.542 INFO:teuthology.orchestra.run.smithi155.stdout: "event": "all_read", 2023-08-01T19:56:33.542 INFO:teuthology.orchestra.run.smithi155.stdout: "time": "2023-08-01T19:55:05.576807+0000", 2023-08-01T19:56:33.542 INFO:teuthology.orchestra.run.smithi155.stdout: "duration": 2.3651000000000001e-05 2023-08-01T19:56:33.542 INFO:teuthology.orchestra.run.smithi155.stdout: }, 2023-08-01T19:56:33.542 INFO:teuthology.orchestra.run.smithi155.stdout: { 2023-08-01T19:56:33.542 INFO:teuthology.orchestra.run.smithi155.stdout: "event": "dispatched", 2023-08-01T19:56:33.543 INFO:teuthology.orchestra.run.smithi155.stdout: "time": "2023-08-01T19:55:05.576817+0000", 2023-08-01T19:56:33.543 INFO:teuthology.orchestra.run.smithi155.stdout: "duration": 9.9389999999999992e-06 2023-08-01T19:56:33.543 INFO:teuthology.orchestra.run.smithi155.stdout: }, 2023-08-01T19:56:33.543 INFO:teuthology.orchestra.run.smithi155.stdout: { 2023-08-01T19:56:33.543 INFO:teuthology.orchestra.run.smithi155.stdout: "event": "queued_for_pg", 2023-08-01T19:56:33.543 INFO:teuthology.orchestra.run.smithi155.stdout: "time": "2023-08-01T19:55:05.576820+0000", 2023-08-01T19:56:33.543 INFO:teuthology.orchestra.run.smithi155.stdout: "duration": 3.2619999999999999e-06 2023-08-01T19:56:33.543 INFO:teuthology.orchestra.run.smithi155.stdout: }, 2023-08-01T19:56:33.544 INFO:teuthology.orchestra.run.smithi155.stdout: { 2023-08-01T19:56:33.544 INFO:teuthology.orchestra.run.smithi155.stdout: "event": "reached_pg", 2023-08-01T19:56:33.544 INFO:teuthology.orchestra.run.smithi155.stdout: "time": "2023-08-01T19:55:05.576849+0000", 2023-08-01T19:56:33.544 INFO:teuthology.orchestra.run.smithi155.stdout: "duration": 2.8880000000000001e-05 2023-08-01T19:56:33.544 INFO:teuthology.orchestra.run.smithi155.stdout: }, 2023-08-01T19:56:33.544 INFO:teuthology.orchestra.run.smithi155.stdout: { 2023-08-01T19:56:33.544 INFO:teuthology.orchestra.run.smithi155.stdout: "event": "started", 2023-08-01T19:56:33.545 INFO:teuthology.orchestra.run.smithi155.stdout: "time": "2023-08-01T19:55:05.576940+0000", 2023-08-01T19:56:33.545 INFO:teuthology.orchestra.run.smithi155.stdout: "duration": 9.0570999999999997e-05 2023-08-01T19:56:33.545 INFO:teuthology.orchestra.run.smithi155.stdout: }, 2023-08-01T19:56:33.545 INFO:teuthology.orchestra.run.smithi155.stdout: { 2023-08-01T19:56:33.545 INFO:teuthology.orchestra.run.smithi155.stdout: "event": "waiting for subops from 0", 2023-08-01T19:56:33.545 INFO:teuthology.orchestra.run.smithi155.stdout: "time": "2023-08-01T19:55:05.577027+0000", 2023-08-01T19:56:33.545 INFO:teuthology.orchestra.run.smithi155.stdout: "duration": 8.7237999999999994e-05 2023-08-01T19:56:33.545 INFO:teuthology.orchestra.run.smithi155.stdout: }, 2023-08-01T19:56:33.546 INFO:teuthology.orchestra.run.smithi155.stdout: { 2023-08-01T19:56:33.546 INFO:teuthology.orchestra.run.smithi155.stdout: "event": "op_commit", 2023-08-01T19:56:33.546 INFO:teuthology.orchestra.run.smithi155.stdout: "time": "2023-08-01T19:55:05.579624+0000", 2023-08-01T19:56:33.546 INFO:teuthology.orchestra.run.smithi155.stdout: "duration": 0.0025971200000000001 2023-08-01T19:56:33.546 INFO:teuthology.orchestra.run.smithi155.stdout: }, 2023-08-01T19:56:33.546 INFO:teuthology.orchestra.run.smithi155.stdout: { 2023-08-01T19:56:33.546 INFO:teuthology.orchestra.run.smithi155.stdout: "event": "sub_op_commit_rec", 2023-08-01T19:56:33.546 INFO:teuthology.orchestra.run.smithi155.stdout: "time": "2023-08-01T19:55:05.635218+0000", 2023-08-01T19:56:33.547 INFO:teuthology.orchestra.run.smithi155.stdout: "duration": 0.055594487999999997 2023-08-01T19:56:33.547 INFO:teuthology.orchestra.run.smithi155.stdout: }, 2023-08-01T19:56:33.547 INFO:teuthology.orchestra.run.smithi155.stdout: { 2023-08-01T19:56:33.547 INFO:teuthology.orchestra.run.smithi155.stdout: "event": "commit_sent", 2023-08-01T19:56:33.547 INFO:teuthology.orchestra.run.smithi155.stdout: "time": "2023-08-01T19:55:05.635262+0000", 2023-08-01T19:56:33.547 INFO:teuthology.orchestra.run.smithi155.stdout: "duration": 4.3380999999999997e-05 2023-08-01T19:56:33.547 INFO:teuthology.orchestra.run.smithi155.stdout: }, 2023-08-01T19:56:33.548 INFO:teuthology.orchestra.run.smithi155.stdout: { 2023-08-01T19:56:33.548 INFO:teuthology.orchestra.run.smithi155.stdout: "event": "done", 2023-08-01T19:56:33.548 INFO:teuthology.orchestra.run.smithi155.stdout: "time": "2023-08-01T19:55:05.635297+0000", 2023-08-01T19:56:33.548 INFO:teuthology.orchestra.run.smithi155.stdout: "duration": 3.4842000000000003e-05 2023-08-01T19:56:33.548 INFO:teuthology.orchestra.run.smithi155.stdout: } 2023-08-01T19:56:33.548 INFO:teuthology.orchestra.run.smithi155.stdout: ] 2023-08-01T19:56:33.548 INFO:teuthology.orchestra.run.smithi155.stdout: } 2023-08-01T19:56:33.548 INFO:teuthology.orchestra.run.smithi155.stdout: }, 2023-08-01T19:56:33.549 INFO:teuthology.orchestra.run.smithi155.stdout: { 2023-08-01T19:56:33.549 INFO:teuthology.orchestra.run.smithi155.stdout: "description": "osd_op(client.4668.0:100947 5.4 5:23e8fc27:::benchmark_data_smithi006_114134_object100946:head [set-alloc-hint object_size 65536 write_size 65536,write 0~65536] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e37)", 2023-08-01T19:56:33.549 INFO:teuthology.orchestra.run.smithi155.stdout: "initiated_at": "2023-08-01T19:55:05.576840+0000", 2023-08-01T19:56:33.549 INFO:teuthology.orchestra.run.smithi155.stdout: "age": 87.821536899999998, 2023-08-01T19:56:33.549 INFO:teuthology.orchestra.run.smithi155.stdout: "duration": 0.058423127999999998, 2023-08-01T19:56:33.549 INFO:teuthology.orchestra.run.smithi155.stdout: "type_data": { 2023-08-01T19:56:33.549 INFO:teuthology.orchestra.run.smithi155.stdout: "flag_point": "commit sent; apply or cleanup", 2023-08-01T19:56:33.550 INFO:teuthology.orchestra.run.smithi155.stdout: "client_info": { 2023-08-01T19:56:33.550 INFO:teuthology.orchestra.run.smithi155.stdout: "client": "client.4668", 2023-08-01T19:56:33.550 INFO:teuthology.orchestra.run.smithi155.stdout: "client_addr": "172.21.15.6:0/1709472247", 2023-08-01T19:56:33.550 INFO:teuthology.orchestra.run.smithi155.stdout: "tid": 100947 2023-08-01T19:56:33.550 INFO:teuthology.orchestra.run.smithi155.stdout: }, 2023-08-01T19:56:33.550 INFO:teuthology.orchestra.run.smithi155.stdout: "events": [ 2023-08-01T19:56:33.550 INFO:teuthology.orchestra.run.smithi155.stdout: { 2023-08-01T19:56:33.550 INFO:teuthology.orchestra.run.smithi155.stdout: "event": "initiated", 2023-08-01T19:56:33.551 INFO:teuthology.orchestra.run.smithi155.stdout: "time": "2023-08-01T19:55:05.576840+0000", 2023-08-01T19:56:33.551 INFO:teuthology.orchestra.run.smithi155.stdout: "duration": 0 2023-08-01T19:56:33.551 INFO:teuthology.orchestra.run.smithi155.stdout: }, 2023-08-01T19:56:33.551 INFO:teuthology.orchestra.run.smithi155.stdout: { 2023-08-01T19:56:33.551 INFO:teuthology.orchestra.run.smithi155.stdout: "event": "throttled", 2023-08-01T19:56:33.551 INFO:teuthology.orchestra.run.smithi155.stdout: "time": "2023-08-01T19:55:05.576840+0000", 2023-08-01T19:56:33.551 INFO:teuthology.orchestra.run.smithi155.stdout: "duration": 0 2023-08-01T19:56:33.551 INFO:teuthology.orchestra.run.smithi155.stdout: }, 2023-08-01T19:56:33.552 INFO:teuthology.orchestra.run.smithi155.stdout: { 2023-08-01T19:56:33.552 INFO:teuthology.orchestra.run.smithi155.stdout: "event": "header_read", 2023-08-01T19:56:33.552 INFO:teuthology.orchestra.run.smithi155.stdout: "time": "2023-08-01T19:55:05.576839+0000", 2023-08-01T19:56:33.552 INFO:teuthology.orchestra.run.smithi155.stdout: "duration": 4294967295.9999995 2023-08-01T19:56:33.552 INFO:teuthology.orchestra.run.smithi155.stdout: }, 2023-08-01T19:56:33.552 INFO:teuthology.orchestra.run.smithi155.stdout: { 2023-08-01T19:56:33.552 INFO:teuthology.orchestra.run.smithi155.stdout: "event": "all_read", 2023-08-01T19:56:33.553 INFO:teuthology.orchestra.run.smithi155.stdout: "time": "2023-08-01T19:55:05.576893+0000", 2023-08-01T19:56:33.553 INFO:teuthology.orchestra.run.smithi155.stdout: "duration": 5.3893000000000001e-05 2023-08-01T19:56:33.553 INFO:teuthology.orchestra.run.smithi155.stdout: }, 2023-08-01T19:56:33.553 INFO:teuthology.orchestra.run.smithi155.stdout: { 2023-08-01T19:56:33.553 INFO:teuthology.orchestra.run.smithi155.stdout: "event": "dispatched", 2023-08-01T19:56:33.553 INFO:teuthology.orchestra.run.smithi155.stdout: "time": "2023-08-01T19:55:05.576902+0000", 2023-08-01T19:56:33.553 INFO:teuthology.orchestra.run.smithi155.stdout: "duration": 8.7520000000000002e-06 2023-08-01T19:56:33.554 INFO:teuthology.orchestra.run.smithi155.stdout: }, 2023-08-01T19:56:33.554 INFO:teuthology.orchestra.run.smithi155.stdout: { 2023-08-01T19:56:33.554 INFO:teuthology.orchestra.run.smithi155.stdout: "event": "queued_for_pg", 2023-08-01T19:56:33.554 INFO:teuthology.orchestra.run.smithi155.stdout: "time": "2023-08-01T19:55:05.576905+0000", 2023-08-01T19:56:33.554 INFO:teuthology.orchestra.run.smithi155.stdout: "duration": 3.01e-06 2023-08-01T19:56:33.554 INFO:teuthology.orchestra.run.smithi155.stdout: }, 2023-08-01T19:56:33.554 INFO:teuthology.orchestra.run.smithi155.stdout: { 2023-08-01T19:56:33.554 INFO:teuthology.orchestra.run.smithi155.stdout: "event": "reached_pg", 2023-08-01T19:56:33.555 INFO:teuthology.orchestra.run.smithi155.stdout: "time": "2023-08-01T19:55:05.579641+0000", 2023-08-01T19:56:33.555 INFO:teuthology.orchestra.run.smithi155.stdout: "duration": 0.0027366880000000001 2023-08-01T19:56:33.555 INFO:teuthology.orchestra.run.smithi155.stdout: }, 2023-08-01T19:56:33.555 INFO:teuthology.orchestra.run.smithi155.stdout: { 2023-08-01T19:56:33.555 INFO:teuthology.orchestra.run.smithi155.stdout: "event": "started", 2023-08-01T19:56:33.555 INFO:teuthology.orchestra.run.smithi155.stdout: "time": "2023-08-01T19:55:05.579734+0000", 2023-08-01T19:56:33.555 INFO:teuthology.orchestra.run.smithi155.stdout: "duration": 9.2590000000000006e-05 2023-08-01T19:56:33.555 INFO:teuthology.orchestra.run.smithi155.stdout: }, 2023-08-01T19:56:33.556 INFO:teuthology.orchestra.run.smithi155.stdout: { 2023-08-01T19:56:33.556 INFO:teuthology.orchestra.run.smithi155.stdout: "event": "waiting for subops from 0", 2023-08-01T19:56:33.556 INFO:teuthology.orchestra.run.smithi155.stdout: "time": "2023-08-01T19:55:05.579825+0000", 2023-08-01T19:56:33.556 INFO:teuthology.orchestra.run.smithi155.stdout: "duration": 9.0964999999999994e-05 2023-08-01T19:56:33.556 INFO:teuthology.orchestra.run.smithi155.stdout: }, 2023-08-01T19:56:33.556 INFO:teuthology.orchestra.run.smithi155.stdout: { 2023-08-01T19:56:33.556 INFO:teuthology.orchestra.run.smithi155.stdout: "event": "op_commit", 2023-08-01T19:56:33.557 INFO:teuthology.orchestra.run.smithi155.stdout: "time": "2023-08-01T19:55:05.585041+0000", 2023-08-01T19:56:33.557 INFO:teuthology.orchestra.run.smithi155.stdout: "duration": 0.0052159670000000002 2023-08-01T19:56:33.557 INFO:teuthology.orchestra.run.smithi155.stdout: }, 2023-08-01T19:56:33.557 INFO:teuthology.orchestra.run.smithi155.stdout: { 2023-08-01T19:56:33.557 INFO:teuthology.orchestra.run.smithi155.stdout: "event": "sub_op_commit_rec", 2023-08-01T19:56:33.557 INFO:teuthology.orchestra.run.smithi155.stdout: "time": "2023-08-01T19:55:05.635199+0000", 2023-08-01T19:56:33.557 INFO:teuthology.orchestra.run.smithi155.stdout: "duration": 0.050158023000000003 2023-08-01T19:56:33.557 INFO:teuthology.orchestra.run.smithi155.stdout: }, 2023-08-01T19:56:33.558 INFO:teuthology.orchestra.run.smithi155.stdout: { 2023-08-01T19:56:33.558 INFO:teuthology.orchestra.run.smithi155.stdout: "event": "commit_sent", 2023-08-01T19:56:33.558 INFO:teuthology.orchestra.run.smithi155.stdout: "time": "2023-08-01T19:55:05.635227+0000", 2023-08-01T19:56:33.558 INFO:teuthology.orchestra.run.smithi155.stdout: "duration": 2.7821e-05 2023-08-01T19:56:33.558 INFO:teuthology.orchestra.run.smithi155.stdout: }, 2023-08-01T19:56:33.558 INFO:teuthology.orchestra.run.smithi155.stdout: { 2023-08-01T19:56:33.558 INFO:teuthology.orchestra.run.smithi155.stdout: "event": "done", 2023-08-01T19:56:33.558 INFO:teuthology.orchestra.run.smithi155.stdout: "time": "2023-08-01T19:55:05.635263+0000", 2023-08-01T19:56:33.559 INFO:teuthology.orchestra.run.smithi155.stdout: "duration": 3.6081000000000002e-05 2023-08-01T19:56:33.559 INFO:teuthology.orchestra.run.smithi155.stdout: } 2023-08-01T19:56:33.559 INFO:teuthology.orchestra.run.smithi155.stdout: ] 2023-08-01T19:56:33.559 INFO:teuthology.orchestra.run.smithi155.stdout: } 2023-08-01T19:56:33.559 INFO:teuthology.orchestra.run.smithi155.stdout: }, 2023-08-01T19:56:33.559 INFO:teuthology.orchestra.run.smithi155.stdout: { 2023-08-01T19:56:33.559 INFO:teuthology.orchestra.run.smithi155.stdout: "description": "osd_op(client.4668.0:197408 5.d 5:bbda375a:::benchmark_data_smithi006_114134_object63747:head [delete] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e61)", 2023-08-01T19:56:33.559 INFO:teuthology.orchestra.run.smithi155.stdout: "initiated_at": "2023-08-01T19:55:58.559714+0000", 2023-08-01T19:56:33.560 INFO:teuthology.orchestra.run.smithi155.stdout: "age": 34.838662913, 2023-08-01T19:56:33.560 INFO:teuthology.orchestra.run.smithi155.stdout: "duration": 1.047043671, 2023-08-01T19:56:33.560 INFO:teuthology.orchestra.run.smithi155.stdout: "type_data": { 2023-08-01T19:56:33.560 INFO:teuthology.orchestra.run.smithi155.stdout: "flag_point": "commit sent; apply or cleanup", 2023-08-01T19:56:33.560 INFO:teuthology.orchestra.run.smithi155.stdout: "client_info": { 2023-08-01T19:56:33.560 INFO:teuthology.orchestra.run.smithi155.stdout: "client": "client.4668", 2023-08-01T19:56:33.560 INFO:teuthology.orchestra.run.smithi155.stdout: "client_addr": "172.21.15.6:0/1709472247", 2023-08-01T19:56:33.560 INFO:teuthology.orchestra.run.smithi155.stdout: "tid": 197408 2023-08-01T19:56:33.561 INFO:teuthology.orchestra.run.smithi155.stdout: }, 2023-08-01T19:56:33.561 INFO:teuthology.orchestra.run.smithi155.stdout: "events": [ 2023-08-01T19:56:33.561 INFO:teuthology.orchestra.run.smithi155.stdout: { 2023-08-01T19:56:33.561 INFO:teuthology.orchestra.run.smithi155.stdout: "event": "initiated", 2023-08-01T19:56:33.561 INFO:teuthology.orchestra.run.smithi155.stdout: "time": "2023-08-01T19:55:58.559714+0000", 2023-08-01T19:56:33.561 INFO:teuthology.orchestra.run.smithi155.stdout: "duration": 0 2023-08-01T19:56:33.561 INFO:teuthology.orchestra.run.smithi155.stdout: }, 2023-08-01T19:56:33.562 INFO:teuthology.orchestra.run.smithi155.stdout: { 2023-08-01T19:56:33.562 INFO:teuthology.orchestra.run.smithi155.stdout: "event": "throttled", 2023-08-01T19:56:33.562 INFO:teuthology.orchestra.run.smithi155.stdout: "time": "2023-08-01T19:55:58.559714+0000", 2023-08-01T19:56:33.562 INFO:teuthology.orchestra.run.smithi155.stdout: "duration": 0 2023-08-01T19:56:33.562 INFO:teuthology.orchestra.run.smithi155.stdout: }, 2023-08-01T19:56:33.562 INFO:teuthology.orchestra.run.smithi155.stdout: { 2023-08-01T19:56:33.562 INFO:teuthology.orchestra.run.smithi155.stdout: "event": "header_read", 2023-08-01T19:56:33.562 INFO:teuthology.orchestra.run.smithi155.stdout: "time": "2023-08-01T19:55:58.559713+0000", 2023-08-01T19:56:33.563 INFO:teuthology.orchestra.run.smithi155.stdout: "duration": 4294967295.999999 2023-08-01T19:56:33.563 INFO:teuthology.orchestra.run.smithi155.stdout: }, 2023-08-01T19:56:33.563 INFO:teuthology.orchestra.run.smithi155.stdout: { 2023-08-01T19:56:33.563 INFO:teuthology.orchestra.run.smithi155.stdout: "event": "all_read", 2023-08-01T19:56:33.563 INFO:teuthology.orchestra.run.smithi155.stdout: "time": "2023-08-01T19:55:58.559717+0000", 2023-08-01T19:56:33.563 INFO:teuthology.orchestra.run.smithi155.stdout: "duration": 4.2860000000000001e-06 2023-08-01T19:56:33.563 INFO:teuthology.orchestra.run.smithi155.stdout: }, 2023-08-01T19:56:33.563 INFO:teuthology.orchestra.run.smithi155.stdout: { 2023-08-01T19:56:33.564 INFO:teuthology.orchestra.run.smithi155.stdout: "event": "dispatched", 2023-08-01T19:56:33.564 INFO:teuthology.orchestra.run.smithi155.stdout: "time": "2023-08-01T19:55:58.559774+0000", 2023-08-01T19:56:33.564 INFO:teuthology.orchestra.run.smithi155.stdout: "duration": 5.6508999999999997e-05 2023-08-01T19:56:33.564 INFO:teuthology.orchestra.run.smithi155.stdout: }, 2023-08-01T19:56:33.564 INFO:teuthology.orchestra.run.smithi155.stdout: { 2023-08-01T19:56:33.564 INFO:teuthology.orchestra.run.smithi155.stdout: "event": "queued_for_pg", 2023-08-01T19:56:33.564 INFO:teuthology.orchestra.run.smithi155.stdout: "time": "2023-08-01T19:55:58.559781+0000", 2023-08-01T19:56:33.564 INFO:teuthology.orchestra.run.smithi155.stdout: "duration": 7.1829999999999997e-06 2023-08-01T19:56:33.565 INFO:teuthology.orchestra.run.smithi155.stdout: }, 2023-08-01T19:56:33.565 INFO:teuthology.orchestra.run.smithi155.stdout: { 2023-08-01T19:56:33.565 INFO:teuthology.orchestra.run.smithi155.stdout: "event": "reached_pg", 2023-08-01T19:56:33.565 INFO:teuthology.orchestra.run.smithi155.stdout: "time": "2023-08-01T19:55:58.571621+0000", 2023-08-01T19:56:33.565 INFO:teuthology.orchestra.run.smithi155.stdout: "duration": 0.011840603999999999 2023-08-01T19:56:33.565 INFO:teuthology.orchestra.run.smithi155.stdout: }, 2023-08-01T19:56:33.565 INFO:teuthology.orchestra.run.smithi155.stdout: { 2023-08-01T19:56:33.566 INFO:teuthology.orchestra.run.smithi155.stdout: "event": "waiting for peered", 2023-08-01T19:56:33.566 INFO:teuthology.orchestra.run.smithi155.stdout: "time": "2023-08-01T19:55:58.571630+0000", 2023-08-01T19:56:33.566 INFO:teuthology.orchestra.run.smithi155.stdout: "duration": 8.9770000000000006e-06 2023-08-01T19:56:33.566 INFO:teuthology.orchestra.run.smithi155.stdout: }, 2023-08-01T19:56:33.566 INFO:teuthology.orchestra.run.smithi155.stdout: { 2023-08-01T19:56:33.566 INFO:teuthology.orchestra.run.smithi155.stdout: "event": "reached_pg", 2023-08-01T19:56:33.566 INFO:teuthology.orchestra.run.smithi155.stdout: "time": "2023-08-01T19:55:59.601300+0000", 2023-08-01T19:56:33.566 INFO:teuthology.orchestra.run.smithi155.stdout: "duration": 1.0296694989999999 2023-08-01T19:56:33.567 INFO:teuthology.orchestra.run.smithi155.stdout: }, 2023-08-01T19:56:33.567 INFO:teuthology.orchestra.run.smithi155.stdout: { 2023-08-01T19:56:33.567 INFO:teuthology.orchestra.run.smithi155.stdout: "event": "started", 2023-08-01T19:56:33.567 INFO:teuthology.orchestra.run.smithi155.stdout: "time": "2023-08-01T19:55:59.601448+0000", 2023-08-01T19:56:33.567 INFO:teuthology.orchestra.run.smithi155.stdout: "duration": 0.00014828399999999999 2023-08-01T19:56:33.567 INFO:teuthology.orchestra.run.smithi155.stdout: }, 2023-08-01T19:56:33.567 INFO:teuthology.orchestra.run.smithi155.stdout: { 2023-08-01T19:56:33.567 INFO:teuthology.orchestra.run.smithi155.stdout: "event": "op_commit", 2023-08-01T19:56:33.568 INFO:teuthology.orchestra.run.smithi155.stdout: "time": "2023-08-01T19:55:59.606616+0000", 2023-08-01T19:56:33.568 INFO:teuthology.orchestra.run.smithi155.stdout: "duration": 0.0051679769999999998 2023-08-01T19:56:33.568 INFO:teuthology.orchestra.run.smithi155.stdout: }, 2023-08-01T19:56:33.568 INFO:teuthology.orchestra.run.smithi155.stdout: { 2023-08-01T19:56:33.568 INFO:teuthology.orchestra.run.smithi155.stdout: "event": "commit_sent", 2023-08-01T19:56:33.568 INFO:teuthology.orchestra.run.smithi155.stdout: "time": "2023-08-01T19:55:59.606662+0000", 2023-08-01T19:56:33.568 INFO:teuthology.orchestra.run.smithi155.stdout: "duration": 4.5843000000000001e-05 2023-08-01T19:56:33.568 INFO:teuthology.orchestra.run.smithi155.stdout: }, 2023-08-01T19:56:33.569 INFO:teuthology.orchestra.run.smithi155.stdout: { 2023-08-01T19:56:33.569 INFO:teuthology.orchestra.run.smithi155.stdout: "event": "done", 2023-08-01T19:56:33.569 INFO:teuthology.orchestra.run.smithi155.stdout: "time": "2023-08-01T19:55:59.606757+0000", 2023-08-01T19:56:33.569 INFO:teuthology.orchestra.run.smithi155.stdout: "duration": 9.5373999999999999e-05 2023-08-01T19:56:33.569 INFO:teuthology.orchestra.run.smithi155.stdout: } 2023-08-01T19:56:33.569 INFO:teuthology.orchestra.run.smithi155.stdout: ] 2023-08-01T19:56:33.569 INFO:teuthology.orchestra.run.smithi155.stdout: } 2023-08-01T19:56:33.569 INFO:teuthology.orchestra.run.smithi155.stdout: }, 2023-08-01T19:56:33.570 INFO:teuthology.orchestra.run.smithi155.stdout: { 2023-08-01T19:56:33.570 INFO:teuthology.orchestra.run.smithi155.stdout: "description": "osd_op(client.4668.0:197416 5.d 5:bd99e66d:::benchmark_data_smithi006_114134_object63755:head [delete] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e62)", 2023-08-01T19:56:33.570 INFO:teuthology.orchestra.run.smithi155.stdout: "initiated_at": "2023-08-01T19:55:58.577369+0000", 2023-08-01T19:56:33.570 INFO:teuthology.orchestra.run.smithi155.stdout: "age": 34.821007936000001, 2023-08-01T19:56:33.570 INFO:teuthology.orchestra.run.smithi155.stdout: "duration": 1.0300980120000001, 2023-08-01T19:56:33.570 INFO:teuthology.orchestra.run.smithi155.stdout: "type_data": { 2023-08-01T19:56:33.570 INFO:teuthology.orchestra.run.smithi155.stdout: "flag_point": "commit sent; apply or cleanup", 2023-08-01T19:56:33.570 INFO:teuthology.orchestra.run.smithi155.stdout: "client_info": { 2023-08-01T19:56:33.571 INFO:teuthology.orchestra.run.smithi155.stdout: "client": "client.4668", 2023-08-01T19:56:33.571 INFO:teuthology.orchestra.run.smithi155.stdout: "client_addr": "172.21.15.6:0/1709472247", 2023-08-01T19:56:33.571 INFO:teuthology.orchestra.run.smithi155.stdout: "tid": 197416 2023-08-01T19:56:33.571 INFO:teuthology.orchestra.run.smithi155.stdout: }, 2023-08-01T19:56:33.571 INFO:teuthology.orchestra.run.smithi155.stdout: "events": [ 2023-08-01T19:56:33.571 INFO:teuthology.orchestra.run.smithi155.stdout: { 2023-08-01T19:56:33.571 INFO:teuthology.orchestra.run.smithi155.stdout: "event": "initiated", 2023-08-01T19:56:33.572 INFO:teuthology.orchestra.run.smithi155.stdout: "time": "2023-08-01T19:55:58.577369+0000", 2023-08-01T19:56:33.572 INFO:teuthology.orchestra.run.smithi155.stdout: "duration": 0 2023-08-01T19:56:33.572 INFO:teuthology.orchestra.run.smithi155.stdout: }, 2023-08-01T19:56:33.572 INFO:teuthology.orchestra.run.smithi155.stdout: { 2023-08-01T19:56:33.572 INFO:teuthology.orchestra.run.smithi155.stdout: "event": "throttled", 2023-08-01T19:56:33.572 INFO:teuthology.orchestra.run.smithi155.stdout: "time": "2023-08-01T19:55:58.577369+0000", 2023-08-01T19:56:33.572 INFO:teuthology.orchestra.run.smithi155.stdout: "duration": 0 2023-08-01T19:56:33.572 INFO:teuthology.orchestra.run.smithi155.stdout: }, 2023-08-01T19:56:33.573 INFO:teuthology.orchestra.run.smithi155.stdout: { 2023-08-01T19:56:33.573 INFO:teuthology.orchestra.run.smithi155.stdout: "event": "header_read", 2023-08-01T19:56:33.573 INFO:teuthology.orchestra.run.smithi155.stdout: "time": "2023-08-01T19:55:58.577368+0000", 2023-08-01T19:56:33.573 INFO:teuthology.orchestra.run.smithi155.stdout: "duration": 4294967295.9999995 2023-08-01T19:56:33.573 INFO:teuthology.orchestra.run.smithi155.stdout: }, 2023-08-01T19:56:33.573 INFO:teuthology.orchestra.run.smithi155.stdout: { 2023-08-01T19:56:33.573 INFO:teuthology.orchestra.run.smithi155.stdout: "event": "all_read", 2023-08-01T19:56:33.573 INFO:teuthology.orchestra.run.smithi155.stdout: "time": "2023-08-01T19:55:58.577370+0000", 2023-08-01T19:56:33.574 INFO:teuthology.orchestra.run.smithi155.stdout: "duration": 2.1150000000000001e-06 2023-08-01T19:56:33.574 INFO:teuthology.orchestra.run.smithi155.stdout: }, 2023-08-01T19:56:33.574 INFO:teuthology.orchestra.run.smithi155.stdout: { 2023-08-01T19:56:33.574 INFO:teuthology.orchestra.run.smithi155.stdout: "event": "dispatched", 2023-08-01T19:56:33.574 INFO:teuthology.orchestra.run.smithi155.stdout: "time": "2023-08-01T19:55:58.577377+0000", 2023-08-01T19:56:33.574 INFO:teuthology.orchestra.run.smithi155.stdout: "duration": 6.6610000000000003e-06 2023-08-01T19:56:33.574 INFO:teuthology.orchestra.run.smithi155.stdout: }, 2023-08-01T19:56:33.574 INFO:teuthology.orchestra.run.smithi155.stdout: { 2023-08-01T19:56:33.575 INFO:teuthology.orchestra.run.smithi155.stdout: "event": "queued_for_pg", 2023-08-01T19:56:33.575 INFO:teuthology.orchestra.run.smithi155.stdout: "time": "2023-08-01T19:55:58.577380+0000", 2023-08-01T19:56:33.575 INFO:teuthology.orchestra.run.smithi155.stdout: "duration": 2.7360000000000001e-06 2023-08-01T19:56:33.575 INFO:teuthology.orchestra.run.smithi155.stdout: }, 2023-08-01T19:56:33.575 INFO:teuthology.orchestra.run.smithi155.stdout: { 2023-08-01T19:56:33.575 INFO:teuthology.orchestra.run.smithi155.stdout: "event": "reached_pg", 2023-08-01T19:56:33.575 INFO:teuthology.orchestra.run.smithi155.stdout: "time": "2023-08-01T19:55:58.577405+0000", 2023-08-01T19:56:33.575 INFO:teuthology.orchestra.run.smithi155.stdout: "duration": 2.4929000000000001e-05 2023-08-01T19:56:33.576 INFO:teuthology.orchestra.run.smithi155.stdout: }, 2023-08-01T19:56:33.576 INFO:teuthology.orchestra.run.smithi155.stdout: { 2023-08-01T19:56:33.576 INFO:teuthology.orchestra.run.smithi155.stdout: "event": "waiting for peered", 2023-08-01T19:56:33.576 INFO:teuthology.orchestra.run.smithi155.stdout: "time": "2023-08-01T19:55:58.577409+0000", 2023-08-01T19:56:33.576 INFO:teuthology.orchestra.run.smithi155.stdout: "duration": 4.0799999999999999e-06 2023-08-01T19:56:33.576 INFO:teuthology.orchestra.run.smithi155.stdout: }, 2023-08-01T19:56:33.576 INFO:teuthology.orchestra.run.smithi155.stdout: { 2023-08-01T19:56:33.577 INFO:teuthology.orchestra.run.smithi155.stdout: "event": "reached_pg", 2023-08-01T19:56:33.577 INFO:teuthology.orchestra.run.smithi155.stdout: "time": "2023-08-01T19:55:59.603639+0000", 2023-08-01T19:56:33.577 INFO:teuthology.orchestra.run.smithi155.stdout: "duration": 1.0262299349999999 2023-08-01T19:56:33.577 INFO:teuthology.orchestra.run.smithi155.stdout: }, 2023-08-01T19:56:33.577 INFO:teuthology.orchestra.run.smithi155.stdout: { 2023-08-01T19:56:33.577 INFO:teuthology.orchestra.run.smithi155.stdout: "event": "started", 2023-08-01T19:56:33.577 INFO:teuthology.orchestra.run.smithi155.stdout: "time": "2023-08-01T19:55:59.603772+0000", 2023-08-01T19:56:33.577 INFO:teuthology.orchestra.run.smithi155.stdout: "duration": 0.000133153 2023-08-01T19:56:33.578 INFO:teuthology.orchestra.run.smithi155.stdout: }, 2023-08-01T19:56:33.578 INFO:teuthology.orchestra.run.smithi155.stdout: { 2023-08-01T19:56:33.578 INFO:teuthology.orchestra.run.smithi155.stdout: "event": "op_commit", 2023-08-01T19:56:33.578 INFO:teuthology.orchestra.run.smithi155.stdout: "time": "2023-08-01T19:55:59.607354+0000", 2023-08-01T19:56:33.578 INFO:teuthology.orchestra.run.smithi155.stdout: "duration": 0.0035819599999999999 2023-08-01T19:56:33.578 INFO:teuthology.orchestra.run.smithi155.stdout: }, 2023-08-01T19:56:33.578 INFO:teuthology.orchestra.run.smithi155.stdout: { 2023-08-01T19:56:33.578 INFO:teuthology.orchestra.run.smithi155.stdout: "event": "commit_sent", 2023-08-01T19:56:33.579 INFO:teuthology.orchestra.run.smithi155.stdout: "time": "2023-08-01T19:55:59.607396+0000", 2023-08-01T19:56:33.579 INFO:teuthology.orchestra.run.smithi155.stdout: "duration": 4.2423999999999999e-05 2023-08-01T19:56:33.579 INFO:teuthology.orchestra.run.smithi155.stdout: }, 2023-08-01T19:56:33.579 INFO:teuthology.orchestra.run.smithi155.stdout: { 2023-08-01T19:56:33.579 INFO:teuthology.orchestra.run.smithi155.stdout: "event": "done", 2023-08-01T19:56:33.579 INFO:teuthology.orchestra.run.smithi155.stdout: "time": "2023-08-01T19:55:59.607467+0000", 2023-08-01T19:56:33.579 INFO:teuthology.orchestra.run.smithi155.stdout: "duration": 7.0360999999999999e-05 2023-08-01T19:56:33.579 INFO:teuthology.orchestra.run.smithi155.stdout: } 2023-08-01T19:56:33.580 INFO:teuthology.orchestra.run.smithi155.stdout: ] 2023-08-01T19:56:33.580 INFO:teuthology.orchestra.run.smithi155.stdout: } 2023-08-01T19:56:33.580 INFO:teuthology.orchestra.run.smithi155.stdout: }, 2023-08-01T19:56:33.580 INFO:teuthology.orchestra.run.smithi155.stdout: { 2023-08-01T19:56:33.580 INFO:teuthology.orchestra.run.smithi155.stdout: "description": "osd_op(client.4668.0:197419 5.d 5:be7dc7c9:::benchmark_data_smithi006_114134_object63758:head [delete] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e62)", 2023-08-01T19:56:33.580 INFO:teuthology.orchestra.run.smithi155.stdout: "initiated_at": "2023-08-01T19:55:58.580223+0000", 2023-08-01T19:56:33.580 INFO:teuthology.orchestra.run.smithi155.stdout: "age": 34.818153985000002, 2023-08-01T19:56:33.581 INFO:teuthology.orchestra.run.smithi155.stdout: "duration": 1.0286139439999999, 2023-08-01T19:56:33.581 INFO:teuthology.orchestra.run.smithi155.stdout: "type_data": { 2023-08-01T19:56:33.581 INFO:teuthology.orchestra.run.smithi155.stdout: "flag_point": "commit sent; apply or cleanup", 2023-08-01T19:56:33.581 INFO:teuthology.orchestra.run.smithi155.stdout: "client_info": { 2023-08-01T19:56:33.581 INFO:teuthology.orchestra.run.smithi155.stdout: "client": "client.4668", 2023-08-01T19:56:33.581 INFO:teuthology.orchestra.run.smithi155.stdout: "client_addr": "172.21.15.6:0/1709472247", 2023-08-01T19:56:33.581 INFO:teuthology.orchestra.run.smithi155.stdout: "tid": 197419 2023-08-01T19:56:33.582 INFO:teuthology.orchestra.run.smithi155.stdout: }, 2023-08-01T19:56:33.582 INFO:teuthology.orchestra.run.smithi155.stdout: "events": [ 2023-08-01T19:56:33.582 INFO:teuthology.orchestra.run.smithi155.stdout: { 2023-08-01T19:56:33.582 INFO:teuthology.orchestra.run.smithi155.stdout: "event": "initiated", 2023-08-01T19:56:33.582 INFO:teuthology.orchestra.run.smithi155.stdout: "time": "2023-08-01T19:55:58.580223+0000", 2023-08-01T19:56:33.582 INFO:teuthology.orchestra.run.smithi155.stdout: "duration": 0 2023-08-01T19:56:33.582 INFO:teuthology.orchestra.run.smithi155.stdout: }, 2023-08-01T19:56:33.582 INFO:teuthology.orchestra.run.smithi155.stdout: { 2023-08-01T19:56:33.583 INFO:teuthology.orchestra.run.smithi155.stdout: "event": "throttled", 2023-08-01T19:56:33.583 INFO:teuthology.orchestra.run.smithi155.stdout: "time": "2023-08-01T19:55:58.580223+0000", 2023-08-01T19:56:33.583 INFO:teuthology.orchestra.run.smithi155.stdout: "duration": 0 2023-08-01T19:56:33.583 INFO:teuthology.orchestra.run.smithi155.stdout: }, 2023-08-01T19:56:33.583 INFO:teuthology.orchestra.run.smithi155.stdout: { 2023-08-01T19:56:33.583 INFO:teuthology.orchestra.run.smithi155.stdout: "event": "header_read", 2023-08-01T19:56:33.583 INFO:teuthology.orchestra.run.smithi155.stdout: "time": "2023-08-01T19:55:58.580222+0000", 2023-08-01T19:56:33.583 INFO:teuthology.orchestra.run.smithi155.stdout: "duration": 4294967295.9999995 2023-08-01T19:56:33.584 INFO:teuthology.orchestra.run.smithi155.stdout: }, 2023-08-01T19:56:33.584 INFO:teuthology.orchestra.run.smithi155.stdout: { 2023-08-01T19:56:33.584 INFO:teuthology.orchestra.run.smithi155.stdout: "event": "all_read", 2023-08-01T19:56:33.584 INFO:teuthology.orchestra.run.smithi155.stdout: "time": "2023-08-01T19:55:58.580225+0000", 2023-08-01T19:56:33.584 INFO:teuthology.orchestra.run.smithi155.stdout: "duration": 3.2820000000000001e-06 2023-08-01T19:56:33.584 INFO:teuthology.orchestra.run.smithi155.stdout: }, 2023-08-01T19:56:33.584 INFO:teuthology.orchestra.run.smithi155.stdout: { 2023-08-01T19:56:33.585 INFO:teuthology.orchestra.run.smithi155.stdout: "event": "dispatched", 2023-08-01T19:56:33.585 INFO:teuthology.orchestra.run.smithi155.stdout: "time": "2023-08-01T19:55:58.580233+0000", 2023-08-01T19:56:33.585 INFO:teuthology.orchestra.run.smithi155.stdout: "duration": 7.34e-06 2023-08-01T19:56:33.585 INFO:teuthology.orchestra.run.smithi155.stdout: }, 2023-08-01T19:56:33.585 INFO:teuthology.orchestra.run.smithi155.stdout: { 2023-08-01T19:56:33.585 INFO:teuthology.orchestra.run.smithi155.stdout: "event": "queued_for_pg", 2023-08-01T19:56:33.585 INFO:teuthology.orchestra.run.smithi155.stdout: "time": "2023-08-01T19:55:58.580236+0000", 2023-08-01T19:56:33.585 INFO:teuthology.orchestra.run.smithi155.stdout: "duration": 3.473e-06 2023-08-01T19:56:33.586 INFO:teuthology.orchestra.run.smithi155.stdout: }, 2023-08-01T19:56:33.586 INFO:teuthology.orchestra.run.smithi155.stdout: { 2023-08-01T19:56:33.586 INFO:teuthology.orchestra.run.smithi155.stdout: "event": "reached_pg", 2023-08-01T19:56:33.586 INFO:teuthology.orchestra.run.smithi155.stdout: "time": "2023-08-01T19:55:58.580267+0000", 2023-08-01T19:56:33.586 INFO:teuthology.orchestra.run.smithi155.stdout: "duration": 3.0479000000000001e-05 2023-08-01T19:56:33.586 INFO:teuthology.orchestra.run.smithi155.stdout: }, 2023-08-01T19:56:33.586 INFO:teuthology.orchestra.run.smithi155.stdout: { 2023-08-01T19:56:33.586 INFO:teuthology.orchestra.run.smithi155.stdout: "event": "waiting for peered", 2023-08-01T19:56:33.587 INFO:teuthology.orchestra.run.smithi155.stdout: "time": "2023-08-01T19:55:58.580272+0000", 2023-08-01T19:56:33.587 INFO:teuthology.orchestra.run.smithi155.stdout: "duration": 5.011e-06 2023-08-01T19:56:33.587 INFO:teuthology.orchestra.run.smithi155.stdout: }, 2023-08-01T19:56:33.587 INFO:teuthology.orchestra.run.smithi155.stdout: { 2023-08-01T19:56:33.587 INFO:teuthology.orchestra.run.smithi155.stdout: "event": "reached_pg", 2023-08-01T19:56:33.587 INFO:teuthology.orchestra.run.smithi155.stdout: "time": "2023-08-01T19:55:59.604970+0000", 2023-08-01T19:56:33.587 INFO:teuthology.orchestra.run.smithi155.stdout: "duration": 1.0246984189999999 2023-08-01T19:56:33.587 INFO:teuthology.orchestra.run.smithi155.stdout: }, 2023-08-01T19:56:33.588 INFO:teuthology.orchestra.run.smithi155.stdout: { 2023-08-01T19:56:33.588 INFO:teuthology.orchestra.run.smithi155.stdout: "event": "started", 2023-08-01T19:56:33.588 INFO:teuthology.orchestra.run.smithi155.stdout: "time": "2023-08-01T19:55:59.605085+0000", 2023-08-01T19:56:33.588 INFO:teuthology.orchestra.run.smithi155.stdout: "duration": 0.00011531000000000001 2023-08-01T19:56:33.588 INFO:teuthology.orchestra.run.smithi155.stdout: }, 2023-08-01T19:56:33.588 INFO:teuthology.orchestra.run.smithi155.stdout: { 2023-08-01T19:56:33.588 INFO:teuthology.orchestra.run.smithi155.stdout: "event": "op_commit", 2023-08-01T19:56:33.588 INFO:teuthology.orchestra.run.smithi155.stdout: "time": "2023-08-01T19:55:59.608733+0000", 2023-08-01T19:56:33.589 INFO:teuthology.orchestra.run.smithi155.stdout: "duration": 0.0036478090000000001 2023-08-01T19:56:33.589 INFO:teuthology.orchestra.run.smithi155.stdout: }, 2023-08-01T19:56:33.589 INFO:teuthology.orchestra.run.smithi155.stdout: { 2023-08-01T19:56:33.589 INFO:teuthology.orchestra.run.smithi155.stdout: "event": "commit_sent", 2023-08-01T19:56:33.589 INFO:teuthology.orchestra.run.smithi155.stdout: "time": "2023-08-01T19:55:59.608771+0000", 2023-08-01T19:56:33.589 INFO:teuthology.orchestra.run.smithi155.stdout: "duration": 3.8033e-05 2023-08-01T19:56:33.589 INFO:teuthology.orchestra.run.smithi155.stdout: }, 2023-08-01T19:56:33.589 INFO:teuthology.orchestra.run.smithi155.stdout: { 2023-08-01T19:56:33.590 INFO:teuthology.orchestra.run.smithi155.stdout: "event": "done", 2023-08-01T19:56:33.590 INFO:teuthology.orchestra.run.smithi155.stdout: "time": "2023-08-01T19:55:59.608837+0000", 2023-08-01T19:56:33.590 INFO:teuthology.orchestra.run.smithi155.stdout: "duration": 6.5364000000000006e-05 2023-08-01T19:56:33.590 INFO:teuthology.orchestra.run.smithi155.stdout: } 2023-08-01T19:56:33.590 INFO:teuthology.orchestra.run.smithi155.stdout: ] 2023-08-01T19:56:33.590 INFO:teuthology.orchestra.run.smithi155.stdout: } 2023-08-01T19:56:33.590 INFO:teuthology.orchestra.run.smithi155.stdout: }, 2023-08-01T19:56:33.591 INFO:teuthology.orchestra.run.smithi155.stdout: { 2023-08-01T19:56:33.591 INFO:teuthology.orchestra.run.smithi155.stdout: "description": "osd_op(client.4668.0:197420 5.9 5:92a2efe5:::benchmark_data_smithi006_114134_object63759:head [delete] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e62)", 2023-08-01T19:56:33.591 INFO:teuthology.orchestra.run.smithi155.stdout: "initiated_at": "2023-08-01T19:55:58.582230+0000", 2023-08-01T19:56:33.591 INFO:teuthology.orchestra.run.smithi155.stdout: "age": 34.816146674999999, 2023-08-01T19:56:33.591 INFO:teuthology.orchestra.run.smithi155.stdout: "duration": 1.0095353739999999, 2023-08-01T19:56:33.591 INFO:teuthology.orchestra.run.smithi155.stdout: "type_data": { 2023-08-01T19:56:33.591 INFO:teuthology.orchestra.run.smithi155.stdout: "flag_point": "commit sent; apply or cleanup", 2023-08-01T19:56:33.591 INFO:teuthology.orchestra.run.smithi155.stdout: "client_info": { 2023-08-01T19:56:33.592 INFO:teuthology.orchestra.run.smithi155.stdout: "client": "client.4668", 2023-08-01T19:56:33.592 INFO:teuthology.orchestra.run.smithi155.stdout: "client_addr": "172.21.15.6:0/1709472247", 2023-08-01T19:56:33.592 INFO:teuthology.orchestra.run.smithi155.stdout: "tid": 197420 2023-08-01T19:56:33.592 INFO:teuthology.orchestra.run.smithi155.stdout: }, 2023-08-01T19:56:33.592 INFO:teuthology.orchestra.run.smithi155.stdout: "events": [ 2023-08-01T19:56:33.592 INFO:teuthology.orchestra.run.smithi155.stdout: { 2023-08-01T19:56:33.592 INFO:teuthology.orchestra.run.smithi155.stdout: "event": "initiated", 2023-08-01T19:56:33.592 INFO:teuthology.orchestra.run.smithi155.stdout: "time": "2023-08-01T19:55:58.582230+0000", 2023-08-01T19:56:33.593 INFO:teuthology.orchestra.run.smithi155.stdout: "duration": 0 2023-08-01T19:56:33.593 INFO:teuthology.orchestra.run.smithi155.stdout: }, 2023-08-01T19:56:33.593 INFO:teuthology.orchestra.run.smithi155.stdout: { 2023-08-01T19:56:33.593 INFO:teuthology.orchestra.run.smithi155.stdout: "event": "throttled", 2023-08-01T19:56:33.593 INFO:teuthology.orchestra.run.smithi155.stdout: "time": "2023-08-01T19:55:58.582230+0000", 2023-08-01T19:56:33.593 INFO:teuthology.orchestra.run.smithi155.stdout: "duration": 0 2023-08-01T19:56:33.593 INFO:teuthology.orchestra.run.smithi155.stdout: }, 2023-08-01T19:56:33.593 INFO:teuthology.orchestra.run.smithi155.stdout: { 2023-08-01T19:56:33.594 INFO:teuthology.orchestra.run.smithi155.stdout: "event": "header_read", 2023-08-01T19:56:33.594 INFO:teuthology.orchestra.run.smithi155.stdout: "time": "2023-08-01T19:55:58.582229+0000", 2023-08-01T19:56:33.594 INFO:teuthology.orchestra.run.smithi155.stdout: "duration": 4294967295.9999995 2023-08-01T19:56:33.594 INFO:teuthology.orchestra.run.smithi155.stdout: }, 2023-08-01T19:56:33.594 INFO:teuthology.orchestra.run.smithi155.stdout: { 2023-08-01T19:56:33.594 INFO:teuthology.orchestra.run.smithi155.stdout: "event": "all_read", 2023-08-01T19:56:33.594 INFO:teuthology.orchestra.run.smithi155.stdout: "time": "2023-08-01T19:55:58.582233+0000", 2023-08-01T19:56:33.594 INFO:teuthology.orchestra.run.smithi155.stdout: "duration": 3.7869999999999999e-06 2023-08-01T19:56:33.595 INFO:teuthology.orchestra.run.smithi155.stdout: }, 2023-08-01T19:56:33.595 INFO:teuthology.orchestra.run.smithi155.stdout: { 2023-08-01T19:56:33.595 INFO:teuthology.orchestra.run.smithi155.stdout: "event": "dispatched", 2023-08-01T19:56:33.595 INFO:teuthology.orchestra.run.smithi155.stdout: "time": "2023-08-01T19:55:58.582241+0000", 2023-08-01T19:56:33.595 INFO:teuthology.orchestra.run.smithi155.stdout: "duration": 7.6909999999999997e-06 2023-08-01T19:56:33.595 INFO:teuthology.orchestra.run.smithi155.stdout: }, 2023-08-01T19:56:33.595 INFO:teuthology.orchestra.run.smithi155.stdout: { 2023-08-01T19:56:33.595 INFO:teuthology.orchestra.run.smithi155.stdout: "event": "queued_for_pg", 2023-08-01T19:56:33.596 INFO:teuthology.orchestra.run.smithi155.stdout: "time": "2023-08-01T19:55:58.582244+0000", 2023-08-01T19:56:33.596 INFO:teuthology.orchestra.run.smithi155.stdout: "duration": 3.6770000000000001e-06 2023-08-01T19:56:33.596 INFO:teuthology.orchestra.run.smithi155.stdout: }, 2023-08-01T19:56:33.596 INFO:teuthology.orchestra.run.smithi155.stdout: { 2023-08-01T19:56:33.596 INFO:teuthology.orchestra.run.smithi155.stdout: "event": "reached_pg", 2023-08-01T19:56:33.596 INFO:teuthology.orchestra.run.smithi155.stdout: "time": "2023-08-01T19:55:58.582274+0000", 2023-08-01T19:56:33.596 INFO:teuthology.orchestra.run.smithi155.stdout: "duration": 3.0074e-05 2023-08-01T19:56:33.597 INFO:teuthology.orchestra.run.smithi155.stdout: }, 2023-08-01T19:56:33.597 INFO:teuthology.orchestra.run.smithi155.stdout: { 2023-08-01T19:56:33.597 INFO:teuthology.orchestra.run.smithi155.stdout: "event": "waiting for peered", 2023-08-01T19:56:33.597 INFO:teuthology.orchestra.run.smithi155.stdout: "time": "2023-08-01T19:55:58.582281+0000", 2023-08-01T19:56:33.597 INFO:teuthology.orchestra.run.smithi155.stdout: "duration": 6.297e-06 2023-08-01T19:56:33.597 INFO:teuthology.orchestra.run.smithi155.stdout: }, 2023-08-01T19:56:33.597 INFO:teuthology.orchestra.run.smithi155.stdout: { 2023-08-01T19:56:33.598 INFO:teuthology.orchestra.run.smithi155.stdout: "event": "reached_pg", 2023-08-01T19:56:33.598 INFO:teuthology.orchestra.run.smithi155.stdout: "time": "2023-08-01T19:55:59.586809+0000", 2023-08-01T19:56:33.598 INFO:teuthology.orchestra.run.smithi155.stdout: "duration": 1.0045281720000001 2023-08-01T19:56:33.598 INFO:teuthology.orchestra.run.smithi155.stdout: }, 2023-08-01T19:56:33.598 INFO:teuthology.orchestra.run.smithi155.stdout: { 2023-08-01T19:56:33.598 INFO:teuthology.orchestra.run.smithi155.stdout: "event": "started", 2023-08-01T19:56:33.598 INFO:teuthology.orchestra.run.smithi155.stdout: "time": "2023-08-01T19:55:59.586910+0000", 2023-08-01T19:56:33.598 INFO:teuthology.orchestra.run.smithi155.stdout: "duration": 0.000100898 2023-08-01T19:56:33.599 INFO:teuthology.orchestra.run.smithi155.stdout: }, 2023-08-01T19:56:33.599 INFO:teuthology.orchestra.run.smithi155.stdout: { 2023-08-01T19:56:33.599 INFO:teuthology.orchestra.run.smithi155.stdout: "event": "op_commit", 2023-08-01T19:56:33.599 INFO:teuthology.orchestra.run.smithi155.stdout: "time": "2023-08-01T19:55:59.591679+0000", 2023-08-01T19:56:33.599 INFO:teuthology.orchestra.run.smithi155.stdout: "duration": 0.004769471 2023-08-01T19:56:33.599 INFO:teuthology.orchestra.run.smithi155.stdout: }, 2023-08-01T19:56:33.599 INFO:teuthology.orchestra.run.smithi155.stdout: { 2023-08-01T19:56:33.599 INFO:teuthology.orchestra.run.smithi155.stdout: "event": "commit_sent", 2023-08-01T19:56:33.600 INFO:teuthology.orchestra.run.smithi155.stdout: "time": "2023-08-01T19:55:59.591721+0000", 2023-08-01T19:56:33.600 INFO:teuthology.orchestra.run.smithi155.stdout: "duration": 4.1953000000000003e-05 2023-08-01T19:56:33.600 INFO:teuthology.orchestra.run.smithi155.stdout: }, 2023-08-01T19:56:33.600 INFO:teuthology.orchestra.run.smithi155.stdout: { 2023-08-01T19:56:33.600 INFO:teuthology.orchestra.run.smithi155.stdout: "event": "done", 2023-08-01T19:56:33.600 INFO:teuthology.orchestra.run.smithi155.stdout: "time": "2023-08-01T19:55:59.591765+0000", 2023-08-01T19:56:33.600 INFO:teuthology.orchestra.run.smithi155.stdout: "duration": 4.4030999999999999e-05 2023-08-01T19:56:33.601 INFO:teuthology.orchestra.run.smithi155.stdout: } 2023-08-01T19:56:33.601 INFO:teuthology.orchestra.run.smithi155.stdout: ] 2023-08-01T19:56:33.601 INFO:teuthology.orchestra.run.smithi155.stdout: } 2023-08-01T19:56:33.601 INFO:teuthology.orchestra.run.smithi155.stdout: } 2023-08-01T19:56:33.601 INFO:teuthology.orchestra.run.smithi155.stdout: ] 2023-08-01T19:56:33.601 INFO:teuthology.orchestra.run.smithi155.stdout:} 2023-08-01T19:56:33.603 INFO:tasks.ceph.osd.2.smithi155.stderr:2023-08-01T19:56:33.600+0000 7faa5c6ac700 -1 received signal: Hangup from /usr/bin/python3 /bin/daemon-helper kill ceph-osd -f --cluster ceph -i 2 (PID: 111337) UID: 0 2023-08-01T19:56:33.603 DEBUG:teuthology.orchestra.run.smithi008:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 30 ceph --cluster ceph --admin-daemon /var/run/ceph/ceph-osd.0.asok dump_ops_in_flight 2023-08-01T19:56:33.703 INFO:tasks.ceph.osd.2.smithi155.stderr:2023-08-01T19:56:33.701+0000 7faa5c6ac700 -1 received signal: Hangup from /usr/bin/python3 /bin/daemon-helper kill ceph-osd -f --cluster ceph -i 2 (PID: 111337) UID: 0 2023-08-01T19:56:33.794 INFO:teuthology.orchestra.run.smithi008.stdout:{ 2023-08-01T19:56:33.795 INFO:teuthology.orchestra.run.smithi008.stdout: "ops": [ 2023-08-01T19:56:33.795 INFO:teuthology.orchestra.run.smithi008.stdout: { 2023-08-01T19:56:33.795 INFO:teuthology.orchestra.run.smithi008.stdout: "description": "osd_repop(client.4668.0:265742 5.0 e77/19 5:0fad8f07:::benchmark_data_smithi006_114134_object132081:head v 77'16857, mlcod=77'16853)", 2023-08-01T19:56:33.795 INFO:teuthology.orchestra.run.smithi008.stdout: "initiated_at": "2023-08-01T19:56:33.784943+0000", 2023-08-01T19:56:33.795 INFO:teuthology.orchestra.run.smithi008.stdout: "age": 0.0076804890000000004, 2023-08-01T19:56:33.795 INFO:teuthology.orchestra.run.smithi008.stdout: "duration": 0.0077005980000000003, 2023-08-01T19:56:33.795 INFO:teuthology.orchestra.run.smithi008.stdout: "type_data": { 2023-08-01T19:56:33.796 INFO:teuthology.orchestra.run.smithi008.stdout: "flag_point": "started", 2023-08-01T19:56:33.796 INFO:teuthology.orchestra.run.smithi008.stdout: "events": [ 2023-08-01T19:56:33.796 INFO:teuthology.orchestra.run.smithi008.stdout: { 2023-08-01T19:56:33.796 INFO:teuthology.orchestra.run.smithi008.stdout: "event": "initiated", 2023-08-01T19:56:33.796 INFO:teuthology.orchestra.run.smithi008.stdout: "time": "2023-08-01T19:56:33.784943+0000", 2023-08-01T19:56:33.796 INFO:teuthology.orchestra.run.smithi008.stdout: "duration": 0 2023-08-01T19:56:33.796 INFO:teuthology.orchestra.run.smithi008.stdout: }, 2023-08-01T19:56:33.797 INFO:teuthology.orchestra.run.smithi008.stdout: { 2023-08-01T19:56:33.797 INFO:teuthology.orchestra.run.smithi008.stdout: "event": "throttled", 2023-08-01T19:56:33.797 INFO:teuthology.orchestra.run.smithi008.stdout: "time": "2023-08-01T19:56:33.784943+0000", 2023-08-01T19:56:33.797 INFO:teuthology.orchestra.run.smithi008.stdout: "duration": 0 2023-08-01T19:56:33.797 INFO:teuthology.orchestra.run.smithi008.stdout: }, 2023-08-01T19:56:33.797 INFO:teuthology.orchestra.run.smithi008.stdout: { 2023-08-01T19:56:33.797 INFO:teuthology.orchestra.run.smithi008.stdout: "event": "header_read", 2023-08-01T19:56:33.798 INFO:teuthology.orchestra.run.smithi008.stdout: "time": "2023-08-01T19:56:33.784943+0000", 2023-08-01T19:56:33.798 INFO:teuthology.orchestra.run.smithi008.stdout: "duration": 4294967296 2023-08-01T19:56:33.798 INFO:teuthology.orchestra.run.smithi008.stdout: }, 2023-08-01T19:56:33.798 INFO:teuthology.orchestra.run.smithi008.stdout: { 2023-08-01T19:56:33.798 INFO:teuthology.orchestra.run.smithi008.stdout: "event": "all_read", 2023-08-01T19:56:33.798 INFO:teuthology.orchestra.run.smithi008.stdout: "time": "2023-08-01T19:56:33.784947+0000", 2023-08-01T19:56:33.798 INFO:teuthology.orchestra.run.smithi008.stdout: "duration": 4.4499999999999997e-06 2023-08-01T19:56:33.798 INFO:teuthology.orchestra.run.smithi008.stdout: }, 2023-08-01T19:56:33.799 INFO:teuthology.orchestra.run.smithi008.stdout: { 2023-08-01T19:56:33.799 INFO:teuthology.orchestra.run.smithi008.stdout: "event": "dispatched", 2023-08-01T19:56:33.799 INFO:teuthology.orchestra.run.smithi008.stdout: "time": "2023-08-01T19:56:33.784955+0000", 2023-08-01T19:56:33.799 INFO:teuthology.orchestra.run.smithi008.stdout: "duration": 7.2189999999999998e-06 2023-08-01T19:56:33.799 INFO:teuthology.orchestra.run.smithi008.stdout: }, 2023-08-01T19:56:33.799 INFO:teuthology.orchestra.run.smithi008.stdout: { 2023-08-01T19:56:33.799 INFO:teuthology.orchestra.run.smithi008.stdout: "event": "queued_for_pg", 2023-08-01T19:56:33.799 INFO:teuthology.orchestra.run.smithi008.stdout: "time": "2023-08-01T19:56:33.784958+0000", 2023-08-01T19:56:33.800 INFO:teuthology.orchestra.run.smithi008.stdout: "duration": 3.67e-06 2023-08-01T19:56:33.800 INFO:teuthology.orchestra.run.smithi008.stdout: }, 2023-08-01T19:56:33.800 INFO:teuthology.orchestra.run.smithi008.stdout: { 2023-08-01T19:56:33.800 INFO:teuthology.orchestra.run.smithi008.stdout: "event": "reached_pg", 2023-08-01T19:56:33.800 INFO:teuthology.orchestra.run.smithi008.stdout: "time": "2023-08-01T19:56:33.784983+0000", 2023-08-01T19:56:33.800 INFO:teuthology.orchestra.run.smithi008.stdout: "duration": 2.4372999999999999e-05 2023-08-01T19:56:33.800 INFO:teuthology.orchestra.run.smithi008.stdout: }, 2023-08-01T19:56:33.801 INFO:teuthology.orchestra.run.smithi008.stdout: { 2023-08-01T19:56:33.801 INFO:teuthology.orchestra.run.smithi008.stdout: "event": "started", 2023-08-01T19:56:33.801 INFO:teuthology.orchestra.run.smithi008.stdout: "time": "2023-08-01T19:56:33.784996+0000", 2023-08-01T19:56:33.801 INFO:teuthology.orchestra.run.smithi008.stdout: "duration": 1.3319000000000001e-05 2023-08-01T19:56:33.801 INFO:teuthology.orchestra.run.smithi008.stdout: } 2023-08-01T19:56:33.801 INFO:teuthology.orchestra.run.smithi008.stdout: ] 2023-08-01T19:56:33.801 INFO:teuthology.orchestra.run.smithi008.stdout: } 2023-08-01T19:56:33.801 INFO:teuthology.orchestra.run.smithi008.stdout: }, 2023-08-01T19:56:33.802 INFO:teuthology.orchestra.run.smithi008.stdout: { 2023-08-01T19:56:33.802 INFO:teuthology.orchestra.run.smithi008.stdout: "description": "osd_op(client.4668.0:265744 5.c 5:33ae40a2:::benchmark_data_smithi006_114134_object132083:head [delete] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e77)", 2023-08-01T19:56:33.802 INFO:teuthology.orchestra.run.smithi008.stdout: "initiated_at": "2023-08-01T19:56:33.785768+0000", 2023-08-01T19:56:33.802 INFO:teuthology.orchestra.run.smithi008.stdout: "age": 0.006855575, 2023-08-01T19:56:33.802 INFO:teuthology.orchestra.run.smithi008.stdout: "duration": 0.0069187509999999999, 2023-08-01T19:56:33.802 INFO:teuthology.orchestra.run.smithi008.stdout: "type_data": { 2023-08-01T19:56:33.802 INFO:teuthology.orchestra.run.smithi008.stdout: "flag_point": "started", 2023-08-01T19:56:33.803 INFO:teuthology.orchestra.run.smithi008.stdout: "client_info": { 2023-08-01T19:56:33.803 INFO:teuthology.orchestra.run.smithi008.stdout: "client": "client.4668", 2023-08-01T19:56:33.803 INFO:teuthology.orchestra.run.smithi008.stdout: "client_addr": "172.21.15.6:0/1709472247", 2023-08-01T19:56:33.803 INFO:teuthology.orchestra.run.smithi008.stdout: "tid": 265744 2023-08-01T19:56:33.803 INFO:teuthology.orchestra.run.smithi008.stdout: }, 2023-08-01T19:56:33.803 INFO:teuthology.orchestra.run.smithi008.stdout: "events": [ 2023-08-01T19:56:33.803 INFO:teuthology.orchestra.run.smithi008.stdout: { 2023-08-01T19:56:33.803 INFO:teuthology.orchestra.run.smithi008.stdout: "event": "initiated", 2023-08-01T19:56:33.804 INFO:teuthology.orchestra.run.smithi008.stdout: "time": "2023-08-01T19:56:33.785768+0000", 2023-08-01T19:56:33.804 INFO:teuthology.orchestra.run.smithi008.stdout: "duration": 0 2023-08-01T19:56:33.804 INFO:teuthology.orchestra.run.smithi008.stdout: }, 2023-08-01T19:56:33.804 INFO:teuthology.orchestra.run.smithi008.stdout: { 2023-08-01T19:56:33.804 INFO:teuthology.orchestra.run.smithi008.stdout: "event": "throttled", 2023-08-01T19:56:33.804 INFO:teuthology.orchestra.run.smithi008.stdout: "time": "2023-08-01T19:56:33.785768+0000", 2023-08-01T19:56:33.804 INFO:teuthology.orchestra.run.smithi008.stdout: "duration": 0 2023-08-01T19:56:33.804 INFO:teuthology.orchestra.run.smithi008.stdout: }, 2023-08-01T19:56:33.805 INFO:teuthology.orchestra.run.smithi008.stdout: { 2023-08-01T19:56:33.805 INFO:teuthology.orchestra.run.smithi008.stdout: "event": "header_read", 2023-08-01T19:56:33.805 INFO:teuthology.orchestra.run.smithi008.stdout: "time": "2023-08-01T19:56:33.785767+0000", 2023-08-01T19:56:33.805 INFO:teuthology.orchestra.run.smithi008.stdout: "duration": 4294967295.999999 2023-08-01T19:56:33.805 INFO:teuthology.orchestra.run.smithi008.stdout: }, 2023-08-01T19:56:33.805 INFO:teuthology.orchestra.run.smithi008.stdout: { 2023-08-01T19:56:33.805 INFO:teuthology.orchestra.run.smithi008.stdout: "event": "all_read", 2023-08-01T19:56:33.806 INFO:teuthology.orchestra.run.smithi008.stdout: "time": "2023-08-01T19:56:33.785772+0000", 2023-08-01T19:56:33.806 INFO:teuthology.orchestra.run.smithi008.stdout: "duration": 4.7129999999999996e-06 2023-08-01T19:56:33.806 INFO:teuthology.orchestra.run.smithi008.stdout: }, 2023-08-01T19:56:33.806 INFO:teuthology.orchestra.run.smithi008.stdout: { 2023-08-01T19:56:33.806 INFO:teuthology.orchestra.run.smithi008.stdout: "event": "dispatched", 2023-08-01T19:56:33.806 INFO:teuthology.orchestra.run.smithi008.stdout: "time": "2023-08-01T19:56:33.785782+0000", 2023-08-01T19:56:33.806 INFO:teuthology.orchestra.run.smithi008.stdout: "duration": 1.0148e-05 2023-08-01T19:56:33.807 INFO:teuthology.orchestra.run.smithi008.stdout: }, 2023-08-01T19:56:33.807 INFO:teuthology.orchestra.run.smithi008.stdout: { 2023-08-01T19:56:33.807 INFO:teuthology.orchestra.run.smithi008.stdout: "event": "queued_for_pg", 2023-08-01T19:56:33.807 INFO:teuthology.orchestra.run.smithi008.stdout: "time": "2023-08-01T19:56:33.785788+0000", 2023-08-01T19:56:33.807 INFO:teuthology.orchestra.run.smithi008.stdout: "duration": 5.9000000000000003e-06 2023-08-01T19:56:33.807 INFO:teuthology.orchestra.run.smithi008.stdout: }, 2023-08-01T19:56:33.807 INFO:teuthology.orchestra.run.smithi008.stdout: { 2023-08-01T19:56:33.808 INFO:teuthology.orchestra.run.smithi008.stdout: "event": "reached_pg", 2023-08-01T19:56:33.808 INFO:teuthology.orchestra.run.smithi008.stdout: "time": "2023-08-01T19:56:33.785935+0000", 2023-08-01T19:56:33.808 INFO:teuthology.orchestra.run.smithi008.stdout: "duration": 0.000146611 2023-08-01T19:56:33.808 INFO:teuthology.orchestra.run.smithi008.stdout: }, 2023-08-01T19:56:33.808 INFO:teuthology.orchestra.run.smithi008.stdout: { 2023-08-01T19:56:33.808 INFO:teuthology.orchestra.run.smithi008.stdout: "event": "started", 2023-08-01T19:56:33.808 INFO:teuthology.orchestra.run.smithi008.stdout: "time": "2023-08-01T19:56:33.786053+0000", 2023-08-01T19:56:33.808 INFO:teuthology.orchestra.run.smithi008.stdout: "duration": 0.000118608 2023-08-01T19:56:33.809 INFO:teuthology.orchestra.run.smithi008.stdout: } 2023-08-01T19:56:33.809 INFO:teuthology.orchestra.run.smithi008.stdout: ] 2023-08-01T19:56:33.809 INFO:teuthology.orchestra.run.smithi008.stdout: } 2023-08-01T19:56:33.809 INFO:teuthology.orchestra.run.smithi008.stdout: }, 2023-08-01T19:56:33.809 INFO:teuthology.orchestra.run.smithi008.stdout: { 2023-08-01T19:56:33.809 INFO:teuthology.orchestra.run.smithi008.stdout: "description": "osd_op(client.4668.0:265745 5.5 5:a8ac1591:::benchmark_data_smithi006_114134_object132084:head [delete] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e77)", 2023-08-01T19:56:33.809 INFO:teuthology.orchestra.run.smithi008.stdout: "initiated_at": "2023-08-01T19:56:33.785860+0000", 2023-08-01T19:56:33.809 INFO:teuthology.orchestra.run.smithi008.stdout: "age": 0.0067641860000000002, 2023-08-01T19:56:33.810 INFO:teuthology.orchestra.run.smithi008.stdout: "duration": 0.0068722990000000001, 2023-08-01T19:56:33.810 INFO:teuthology.orchestra.run.smithi008.stdout: "type_data": { 2023-08-01T19:56:33.810 INFO:teuthology.orchestra.run.smithi008.stdout: "flag_point": "started", 2023-08-01T19:56:33.810 INFO:teuthology.orchestra.run.smithi008.stdout: "client_info": { 2023-08-01T19:56:33.810 INFO:teuthology.orchestra.run.smithi008.stdout: "client": "client.4668", 2023-08-01T19:56:33.810 INFO:teuthology.orchestra.run.smithi008.stdout: "client_addr": "172.21.15.6:0/1709472247", 2023-08-01T19:56:33.810 INFO:teuthology.orchestra.run.smithi008.stdout: "tid": 265745 2023-08-01T19:56:33.811 INFO:teuthology.orchestra.run.smithi008.stdout: }, 2023-08-01T19:56:33.811 INFO:teuthology.orchestra.run.smithi008.stdout: "events": [ 2023-08-01T19:56:33.811 INFO:teuthology.orchestra.run.smithi008.stdout: { 2023-08-01T19:56:33.811 INFO:teuthology.orchestra.run.smithi008.stdout: "event": "initiated", 2023-08-01T19:56:33.811 INFO:teuthology.orchestra.run.smithi008.stdout: "time": "2023-08-01T19:56:33.785860+0000", 2023-08-01T19:56:33.811 INFO:teuthology.orchestra.run.smithi008.stdout: "duration": 0 2023-08-01T19:56:33.811 INFO:teuthology.orchestra.run.smithi008.stdout: }, 2023-08-01T19:56:33.811 INFO:teuthology.orchestra.run.smithi008.stdout: { 2023-08-01T19:56:33.812 INFO:teuthology.orchestra.run.smithi008.stdout: "event": "throttled", 2023-08-01T19:56:33.812 INFO:teuthology.orchestra.run.smithi008.stdout: "time": "2023-08-01T19:56:33.785860+0000", 2023-08-01T19:56:33.812 INFO:teuthology.orchestra.run.smithi008.stdout: "duration": 0 2023-08-01T19:56:33.812 INFO:teuthology.orchestra.run.smithi008.stdout: }, 2023-08-01T19:56:33.812 INFO:teuthology.orchestra.run.smithi008.stdout: { 2023-08-01T19:56:33.812 INFO:teuthology.orchestra.run.smithi008.stdout: "event": "header_read", 2023-08-01T19:56:33.812 INFO:teuthology.orchestra.run.smithi008.stdout: "time": "2023-08-01T19:56:33.785859+0000", 2023-08-01T19:56:33.813 INFO:teuthology.orchestra.run.smithi008.stdout: "duration": 4294967295.999999 2023-08-01T19:56:33.813 INFO:teuthology.orchestra.run.smithi008.stdout: }, 2023-08-01T19:56:33.813 INFO:teuthology.orchestra.run.smithi008.stdout: { 2023-08-01T19:56:33.813 INFO:teuthology.orchestra.run.smithi008.stdout: "event": "all_read", 2023-08-01T19:56:33.813 INFO:teuthology.orchestra.run.smithi008.stdout: "time": "2023-08-01T19:56:33.785863+0000", 2023-08-01T19:56:33.813 INFO:teuthology.orchestra.run.smithi008.stdout: "duration": 3.8500000000000004e-06 2023-08-01T19:56:33.813 INFO:teuthology.orchestra.run.smithi008.stdout: }, 2023-08-01T19:56:33.813 INFO:teuthology.orchestra.run.smithi008.stdout: { 2023-08-01T19:56:33.814 INFO:teuthology.orchestra.run.smithi008.stdout: "event": "dispatched", 2023-08-01T19:56:33.814 INFO:teuthology.orchestra.run.smithi008.stdout: "time": "2023-08-01T19:56:33.785871+0000", 2023-08-01T19:56:33.814 INFO:teuthology.orchestra.run.smithi008.stdout: "duration": 8.5250000000000005e-06 2023-08-01T19:56:33.814 INFO:teuthology.orchestra.run.smithi008.stdout: }, 2023-08-01T19:56:33.814 INFO:teuthology.orchestra.run.smithi008.stdout: { 2023-08-01T19:56:33.814 INFO:teuthology.orchestra.run.smithi008.stdout: "event": "queued_for_pg", 2023-08-01T19:56:33.814 INFO:teuthology.orchestra.run.smithi008.stdout: "time": "2023-08-01T19:56:33.785876+0000", 2023-08-01T19:56:33.815 INFO:teuthology.orchestra.run.smithi008.stdout: "duration": 4.9790000000000001e-06 2023-08-01T19:56:33.815 INFO:teuthology.orchestra.run.smithi008.stdout: }, 2023-08-01T19:56:33.815 INFO:teuthology.orchestra.run.smithi008.stdout: { 2023-08-01T19:56:33.815 INFO:teuthology.orchestra.run.smithi008.stdout: "event": "reached_pg", 2023-08-01T19:56:33.815 INFO:teuthology.orchestra.run.smithi008.stdout: "time": "2023-08-01T19:56:33.785920+0000", 2023-08-01T19:56:33.815 INFO:teuthology.orchestra.run.smithi008.stdout: "duration": 4.4022e-05 2023-08-01T19:56:33.815 INFO:teuthology.orchestra.run.smithi008.stdout: }, 2023-08-01T19:56:33.815 INFO:teuthology.orchestra.run.smithi008.stdout: { 2023-08-01T19:56:33.816 INFO:teuthology.orchestra.run.smithi008.stdout: "event": "started", 2023-08-01T19:56:33.816 INFO:teuthology.orchestra.run.smithi008.stdout: "time": "2023-08-01T19:56:33.786038+0000", 2023-08-01T19:56:33.816 INFO:teuthology.orchestra.run.smithi008.stdout: "duration": 0.000118206 2023-08-01T19:56:33.816 INFO:teuthology.orchestra.run.smithi008.stdout: } 2023-08-01T19:56:33.816 INFO:teuthology.orchestra.run.smithi008.stdout: ] 2023-08-01T19:56:33.816 INFO:teuthology.orchestra.run.smithi008.stdout: } 2023-08-01T19:56:33.816 INFO:teuthology.orchestra.run.smithi008.stdout: }, 2023-08-01T19:56:33.817 INFO:teuthology.orchestra.run.smithi008.stdout: { 2023-08-01T19:56:33.817 INFO:teuthology.orchestra.run.smithi008.stdout: "description": "osd_op(client.4668.0:265746 5.e 5:7d70eff6:::benchmark_data_smithi006_114134_object132085:head [delete] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e77)", 2023-08-01T19:56:33.817 INFO:teuthology.orchestra.run.smithi008.stdout: "initiated_at": "2023-08-01T19:56:33.785887+0000", 2023-08-01T19:56:33.817 INFO:teuthology.orchestra.run.smithi008.stdout: "age": 0.0067367420000000004, 2023-08-01T19:56:33.817 INFO:teuthology.orchestra.run.smithi008.stdout: "duration": 0.0068849699999999998, 2023-08-01T19:56:33.817 INFO:teuthology.orchestra.run.smithi008.stdout: "type_data": { 2023-08-01T19:56:33.817 INFO:teuthology.orchestra.run.smithi008.stdout: "flag_point": "waiting for sub ops", 2023-08-01T19:56:33.817 INFO:teuthology.orchestra.run.smithi008.stdout: "client_info": { 2023-08-01T19:56:33.818 INFO:teuthology.orchestra.run.smithi008.stdout: "client": "client.4668", 2023-08-01T19:56:33.818 INFO:teuthology.orchestra.run.smithi008.stdout: "client_addr": "172.21.15.6:0/1709472247", 2023-08-01T19:56:33.818 INFO:teuthology.orchestra.run.smithi008.stdout: "tid": 265746 2023-08-01T19:56:33.818 INFO:teuthology.orchestra.run.smithi008.stdout: }, 2023-08-01T19:56:33.818 INFO:teuthology.orchestra.run.smithi008.stdout: "events": [ 2023-08-01T19:56:33.818 INFO:teuthology.orchestra.run.smithi008.stdout: { 2023-08-01T19:56:33.818 INFO:teuthology.orchestra.run.smithi008.stdout: "event": "initiated", 2023-08-01T19:56:33.818 INFO:teuthology.orchestra.run.smithi008.stdout: "time": "2023-08-01T19:56:33.785887+0000", 2023-08-01T19:56:33.819 INFO:teuthology.orchestra.run.smithi008.stdout: "duration": 0 2023-08-01T19:56:33.819 INFO:teuthology.orchestra.run.smithi008.stdout: }, 2023-08-01T19:56:33.819 INFO:teuthology.orchestra.run.smithi008.stdout: { 2023-08-01T19:56:33.819 INFO:teuthology.orchestra.run.smithi008.stdout: "event": "throttled", 2023-08-01T19:56:33.819 INFO:teuthology.orchestra.run.smithi008.stdout: "time": "2023-08-01T19:56:33.785887+0000", 2023-08-01T19:56:33.819 INFO:teuthology.orchestra.run.smithi008.stdout: "duration": 0 2023-08-01T19:56:33.819 INFO:teuthology.orchestra.run.smithi008.stdout: }, 2023-08-01T19:56:33.820 INFO:teuthology.orchestra.run.smithi008.stdout: { 2023-08-01T19:56:33.820 INFO:teuthology.orchestra.run.smithi008.stdout: "event": "header_read", 2023-08-01T19:56:33.820 INFO:teuthology.orchestra.run.smithi008.stdout: "time": "2023-08-01T19:56:33.785887+0000", 2023-08-01T19:56:33.820 INFO:teuthology.orchestra.run.smithi008.stdout: "duration": 4294967295.9999995 2023-08-01T19:56:33.820 INFO:teuthology.orchestra.run.smithi008.stdout: }, 2023-08-01T19:56:33.820 INFO:teuthology.orchestra.run.smithi008.stdout: { 2023-08-01T19:56:33.820 INFO:teuthology.orchestra.run.smithi008.stdout: "event": "all_read", 2023-08-01T19:56:33.820 INFO:teuthology.orchestra.run.smithi008.stdout: "time": "2023-08-01T19:56:33.785889+0000", 2023-08-01T19:56:33.821 INFO:teuthology.orchestra.run.smithi008.stdout: "duration": 2.4059999999999999e-06 2023-08-01T19:56:33.821 INFO:teuthology.orchestra.run.smithi008.stdout: }, 2023-08-01T19:56:33.821 INFO:teuthology.orchestra.run.smithi008.stdout: { 2023-08-01T19:56:33.821 INFO:teuthology.orchestra.run.smithi008.stdout: "event": "dispatched", 2023-08-01T19:56:33.821 INFO:teuthology.orchestra.run.smithi008.stdout: "time": "2023-08-01T19:56:33.785895+0000", 2023-08-01T19:56:33.821 INFO:teuthology.orchestra.run.smithi008.stdout: "duration": 5.8150000000000002e-06 2023-08-01T19:56:33.821 INFO:teuthology.orchestra.run.smithi008.stdout: }, 2023-08-01T19:56:33.822 INFO:teuthology.orchestra.run.smithi008.stdout: { 2023-08-01T19:56:33.822 INFO:teuthology.orchestra.run.smithi008.stdout: "event": "queued_for_pg", 2023-08-01T19:56:33.822 INFO:teuthology.orchestra.run.smithi008.stdout: "time": "2023-08-01T19:56:33.785898+0000", 2023-08-01T19:56:33.822 INFO:teuthology.orchestra.run.smithi008.stdout: "duration": 3.6890000000000002e-06 2023-08-01T19:56:33.822 INFO:teuthology.orchestra.run.smithi008.stdout: }, 2023-08-01T19:56:33.822 INFO:teuthology.orchestra.run.smithi008.stdout: { 2023-08-01T19:56:33.822 INFO:teuthology.orchestra.run.smithi008.stdout: "event": "reached_pg", 2023-08-01T19:56:33.822 INFO:teuthology.orchestra.run.smithi008.stdout: "time": "2023-08-01T19:56:33.786022+0000", 2023-08-01T19:56:33.823 INFO:teuthology.orchestra.run.smithi008.stdout: "duration": 0.00012378700000000001 2023-08-01T19:56:33.823 INFO:teuthology.orchestra.run.smithi008.stdout: }, 2023-08-01T19:56:33.823 INFO:teuthology.orchestra.run.smithi008.stdout: { 2023-08-01T19:56:33.823 INFO:teuthology.orchestra.run.smithi008.stdout: "event": "started", 2023-08-01T19:56:33.823 INFO:teuthology.orchestra.run.smithi008.stdout: "time": "2023-08-01T19:56:33.786136+0000", 2023-08-01T19:56:33.823 INFO:teuthology.orchestra.run.smithi008.stdout: "duration": 0.000113386 2023-08-01T19:56:33.823 INFO:teuthology.orchestra.run.smithi008.stdout: }, 2023-08-01T19:56:33.824 INFO:teuthology.orchestra.run.smithi008.stdout: { 2023-08-01T19:56:33.824 INFO:teuthology.orchestra.run.smithi008.stdout: "event": "waiting for subops from 2", 2023-08-01T19:56:33.824 INFO:teuthology.orchestra.run.smithi008.stdout: "time": "2023-08-01T19:56:33.786248+0000", 2023-08-01T19:56:33.824 INFO:teuthology.orchestra.run.smithi008.stdout: "duration": 0.000112463 2023-08-01T19:56:33.824 INFO:teuthology.orchestra.run.smithi008.stdout: } 2023-08-01T19:56:33.824 INFO:teuthology.orchestra.run.smithi008.stdout: ] 2023-08-01T19:56:33.824 INFO:teuthology.orchestra.run.smithi008.stdout: } 2023-08-01T19:56:33.825 INFO:teuthology.orchestra.run.smithi008.stdout: }, 2023-08-01T19:56:33.825 INFO:teuthology.orchestra.run.smithi008.stdout: { 2023-08-01T19:56:33.825 INFO:teuthology.orchestra.run.smithi008.stdout: "description": "osd_op(client.4668.0:265747 5.7 5:ecae9df7:::benchmark_data_smithi006_114134_object132086:head [delete] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e77)", 2023-08-01T19:56:33.825 INFO:teuthology.orchestra.run.smithi008.stdout: "initiated_at": "2023-08-01T19:56:33.785933+0000", 2023-08-01T19:56:33.825 INFO:teuthology.orchestra.run.smithi008.stdout: "age": 0.0066910279999999999, 2023-08-01T19:56:33.825 INFO:teuthology.orchestra.run.smithi008.stdout: "duration": 0.0068832829999999996, 2023-08-01T19:56:33.825 INFO:teuthology.orchestra.run.smithi008.stdout: "type_data": { 2023-08-01T19:56:33.826 INFO:teuthology.orchestra.run.smithi008.stdout: "flag_point": "started", 2023-08-01T19:56:33.826 INFO:teuthology.orchestra.run.smithi008.stdout: "client_info": { 2023-08-01T19:56:33.826 INFO:teuthology.orchestra.run.smithi008.stdout: "client": "client.4668", 2023-08-01T19:56:33.826 INFO:teuthology.orchestra.run.smithi008.stdout: "client_addr": "172.21.15.6:0/1709472247", 2023-08-01T19:56:33.826 INFO:teuthology.orchestra.run.smithi008.stdout: "tid": 265747 2023-08-01T19:56:33.826 INFO:teuthology.orchestra.run.smithi008.stdout: }, 2023-08-01T19:56:33.826 INFO:teuthology.orchestra.run.smithi008.stdout: "events": [ 2023-08-01T19:56:33.826 INFO:teuthology.orchestra.run.smithi008.stdout: { 2023-08-01T19:56:33.827 INFO:teuthology.orchestra.run.smithi008.stdout: "event": "initiated", 2023-08-01T19:56:33.827 INFO:teuthology.orchestra.run.smithi008.stdout: "time": "2023-08-01T19:56:33.785933+0000", 2023-08-01T19:56:33.827 INFO:teuthology.orchestra.run.smithi008.stdout: "duration": 0 2023-08-01T19:56:33.827 INFO:teuthology.orchestra.run.smithi008.stdout: }, 2023-08-01T19:56:33.827 INFO:teuthology.orchestra.run.smithi008.stdout: { 2023-08-01T19:56:33.827 INFO:teuthology.orchestra.run.smithi008.stdout: "event": "throttled", 2023-08-01T19:56:33.827 INFO:teuthology.orchestra.run.smithi008.stdout: "time": "2023-08-01T19:56:33.785933+0000", 2023-08-01T19:56:33.827 INFO:teuthology.orchestra.run.smithi008.stdout: "duration": 0 2023-08-01T19:56:33.828 INFO:teuthology.orchestra.run.smithi008.stdout: }, 2023-08-01T19:56:33.828 INFO:teuthology.orchestra.run.smithi008.stdout: { 2023-08-01T19:56:33.828 INFO:teuthology.orchestra.run.smithi008.stdout: "event": "header_read", 2023-08-01T19:56:33.828 INFO:teuthology.orchestra.run.smithi008.stdout: "time": "2023-08-01T19:56:33.785932+0000", 2023-08-01T19:56:33.828 INFO:teuthology.orchestra.run.smithi008.stdout: "duration": 4294967295.9999995 2023-08-01T19:56:33.828 INFO:teuthology.orchestra.run.smithi008.stdout: }, 2023-08-01T19:56:33.828 INFO:teuthology.orchestra.run.smithi008.stdout: { 2023-08-01T19:56:33.829 INFO:teuthology.orchestra.run.smithi008.stdout: "event": "all_read", 2023-08-01T19:56:33.829 INFO:teuthology.orchestra.run.smithi008.stdout: "time": "2023-08-01T19:56:33.785936+0000", 2023-08-01T19:56:33.829 INFO:teuthology.orchestra.run.smithi008.stdout: "duration": 3.507e-06 2023-08-01T19:56:33.829 INFO:teuthology.orchestra.run.smithi008.stdout: }, 2023-08-01T19:56:33.829 INFO:teuthology.orchestra.run.smithi008.stdout: { 2023-08-01T19:56:33.829 INFO:teuthology.orchestra.run.smithi008.stdout: "event": "dispatched", 2023-08-01T19:56:33.829 INFO:teuthology.orchestra.run.smithi008.stdout: "time": "2023-08-01T19:56:33.785943+0000", 2023-08-01T19:56:33.829 INFO:teuthology.orchestra.run.smithi008.stdout: "duration": 7.5279999999999998e-06 2023-08-01T19:56:33.830 INFO:teuthology.orchestra.run.smithi008.stdout: }, 2023-08-01T19:56:33.830 INFO:teuthology.orchestra.run.smithi008.stdout: { 2023-08-01T19:56:33.830 INFO:teuthology.orchestra.run.smithi008.stdout: "event": "queued_for_pg", 2023-08-01T19:56:33.830 INFO:teuthology.orchestra.run.smithi008.stdout: "time": "2023-08-01T19:56:33.785948+0000", 2023-08-01T19:56:33.830 INFO:teuthology.orchestra.run.smithi008.stdout: "duration": 4.6469999999999997e-06 2023-08-01T19:56:33.830 INFO:teuthology.orchestra.run.smithi008.stdout: }, 2023-08-01T19:56:33.830 INFO:teuthology.orchestra.run.smithi008.stdout: { 2023-08-01T19:56:33.830 INFO:teuthology.orchestra.run.smithi008.stdout: "event": "reached_pg", 2023-08-01T19:56:33.831 INFO:teuthology.orchestra.run.smithi008.stdout: "time": "2023-08-01T19:56:33.785993+0000", 2023-08-01T19:56:33.831 INFO:teuthology.orchestra.run.smithi008.stdout: "duration": 4.5167999999999999e-05 2023-08-01T19:56:33.831 INFO:teuthology.orchestra.run.smithi008.stdout: }, 2023-08-01T19:56:33.831 INFO:teuthology.orchestra.run.smithi008.stdout: { 2023-08-01T19:56:33.831 INFO:teuthology.orchestra.run.smithi008.stdout: "event": "started", 2023-08-01T19:56:33.831 INFO:teuthology.orchestra.run.smithi008.stdout: "time": "2023-08-01T19:56:33.786109+0000", 2023-08-01T19:56:33.831 INFO:teuthology.orchestra.run.smithi008.stdout: "duration": 0.000115943 2023-08-01T19:56:33.831 INFO:teuthology.orchestra.run.smithi008.stdout: } 2023-08-01T19:56:33.832 INFO:teuthology.orchestra.run.smithi008.stdout: ] 2023-08-01T19:56:33.832 INFO:teuthology.orchestra.run.smithi008.stdout: } 2023-08-01T19:56:33.832 INFO:teuthology.orchestra.run.smithi008.stdout: }, 2023-08-01T19:56:33.832 INFO:teuthology.orchestra.run.smithi008.stdout: { 2023-08-01T19:56:33.832 INFO:teuthology.orchestra.run.smithi008.stdout: "description": "osd_op(client.4668.0:265748 5.5 5:ae9da762:::benchmark_data_smithi006_114134_object132087:head [delete] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e77)", 2023-08-01T19:56:33.832 INFO:teuthology.orchestra.run.smithi008.stdout: "initiated_at": "2023-08-01T19:56:33.785957+0000", 2023-08-01T19:56:33.832 INFO:teuthology.orchestra.run.smithi008.stdout: "age": 0.0066664230000000003, 2023-08-01T19:56:33.833 INFO:teuthology.orchestra.run.smithi008.stdout: "duration": 0.0068978490000000002, 2023-08-01T19:56:33.833 INFO:teuthology.orchestra.run.smithi008.stdout: "type_data": { 2023-08-01T19:56:33.833 INFO:teuthology.orchestra.run.smithi008.stdout: "flag_point": "started", 2023-08-01T19:56:33.833 INFO:teuthology.orchestra.run.smithi008.stdout: "client_info": { 2023-08-01T19:56:33.833 INFO:teuthology.orchestra.run.smithi008.stdout: "client": "client.4668", 2023-08-01T19:56:33.833 INFO:teuthology.orchestra.run.smithi008.stdout: "client_addr": "172.21.15.6:0/1709472247", 2023-08-01T19:56:33.833 INFO:teuthology.orchestra.run.smithi008.stdout: "tid": 265748 2023-08-01T19:56:33.833 INFO:teuthology.orchestra.run.smithi008.stdout: }, 2023-08-01T19:56:33.834 INFO:teuthology.orchestra.run.smithi008.stdout: "events": [ 2023-08-01T19:56:33.834 INFO:teuthology.orchestra.run.smithi008.stdout: { 2023-08-01T19:56:33.834 INFO:teuthology.orchestra.run.smithi008.stdout: "event": "initiated", 2023-08-01T19:56:33.834 INFO:teuthology.orchestra.run.smithi008.stdout: "time": "2023-08-01T19:56:33.785957+0000", 2023-08-01T19:56:33.834 INFO:teuthology.orchestra.run.smithi008.stdout: "duration": 0 2023-08-01T19:56:33.834 INFO:teuthology.orchestra.run.smithi008.stdout: }, 2023-08-01T19:56:33.834 INFO:teuthology.orchestra.run.smithi008.stdout: { 2023-08-01T19:56:33.834 INFO:teuthology.orchestra.run.smithi008.stdout: "event": "throttled", 2023-08-01T19:56:33.835 INFO:teuthology.orchestra.run.smithi008.stdout: "time": "2023-08-01T19:56:33.785957+0000", 2023-08-01T19:56:33.835 INFO:teuthology.orchestra.run.smithi008.stdout: "duration": 0 2023-08-01T19:56:33.835 INFO:teuthology.orchestra.run.smithi008.stdout: }, 2023-08-01T19:56:33.835 INFO:teuthology.orchestra.run.smithi008.stdout: { 2023-08-01T19:56:33.835 INFO:teuthology.orchestra.run.smithi008.stdout: "event": "header_read", 2023-08-01T19:56:33.835 INFO:teuthology.orchestra.run.smithi008.stdout: "time": "2023-08-01T19:56:33.785957+0000", 2023-08-01T19:56:33.835 INFO:teuthology.orchestra.run.smithi008.stdout: "duration": 4294967295.9999995 2023-08-01T19:56:33.835 INFO:teuthology.orchestra.run.smithi008.stdout: }, 2023-08-01T19:56:33.836 INFO:teuthology.orchestra.run.smithi008.stdout: { 2023-08-01T19:56:33.836 INFO:teuthology.orchestra.run.smithi008.stdout: "event": "all_read", 2023-08-01T19:56:33.836 INFO:teuthology.orchestra.run.smithi008.stdout: "time": "2023-08-01T19:56:33.785959+0000", 2023-08-01T19:56:33.836 INFO:teuthology.orchestra.run.smithi008.stdout: "duration": 2.3190000000000002e-06 2023-08-01T19:56:33.836 INFO:teuthology.orchestra.run.smithi008.stdout: }, 2023-08-01T19:56:33.836 INFO:teuthology.orchestra.run.smithi008.stdout: { 2023-08-01T19:56:33.836 INFO:teuthology.orchestra.run.smithi008.stdout: "event": "dispatched", 2023-08-01T19:56:33.837 INFO:teuthology.orchestra.run.smithi008.stdout: "time": "2023-08-01T19:56:33.785965+0000", 2023-08-01T19:56:33.837 INFO:teuthology.orchestra.run.smithi008.stdout: "duration": 5.5219999999999998e-06 2023-08-01T19:56:33.837 INFO:teuthology.orchestra.run.smithi008.stdout: }, 2023-08-01T19:56:33.837 INFO:teuthology.orchestra.run.smithi008.stdout: { 2023-08-01T19:56:33.837 INFO:teuthology.orchestra.run.smithi008.stdout: "event": "queued_for_pg", 2023-08-01T19:56:33.837 INFO:teuthology.orchestra.run.smithi008.stdout: "time": "2023-08-01T19:56:33.785968+0000", 2023-08-01T19:56:33.837 INFO:teuthology.orchestra.run.smithi008.stdout: "duration": 3.5190000000000001e-06 2023-08-01T19:56:33.837 INFO:teuthology.orchestra.run.smithi008.stdout: }, 2023-08-01T19:56:33.838 INFO:teuthology.orchestra.run.smithi008.stdout: { 2023-08-01T19:56:33.838 INFO:teuthology.orchestra.run.smithi008.stdout: "event": "reached_pg", 2023-08-01T19:56:33.838 INFO:teuthology.orchestra.run.smithi008.stdout: "time": "2023-08-01T19:56:33.788013+0000", 2023-08-01T19:56:33.838 INFO:teuthology.orchestra.run.smithi008.stdout: "duration": 0.0020443280000000002 2023-08-01T19:56:33.838 INFO:teuthology.orchestra.run.smithi008.stdout: }, 2023-08-01T19:56:33.838 INFO:teuthology.orchestra.run.smithi008.stdout: { 2023-08-01T19:56:33.838 INFO:teuthology.orchestra.run.smithi008.stdout: "event": "started", 2023-08-01T19:56:33.838 INFO:teuthology.orchestra.run.smithi008.stdout: "time": "2023-08-01T19:56:33.788121+0000", 2023-08-01T19:56:33.839 INFO:teuthology.orchestra.run.smithi008.stdout: "duration": 0.00010833299999999999 2023-08-01T19:56:33.839 INFO:teuthology.orchestra.run.smithi008.stdout: } 2023-08-01T19:56:33.839 INFO:teuthology.orchestra.run.smithi008.stdout: ] 2023-08-01T19:56:33.839 INFO:teuthology.orchestra.run.smithi008.stdout: } 2023-08-01T19:56:33.839 INFO:teuthology.orchestra.run.smithi008.stdout: }, 2023-08-01T19:56:33.839 INFO:teuthology.orchestra.run.smithi008.stdout: { 2023-08-01T19:56:33.839 INFO:teuthology.orchestra.run.smithi008.stdout: "description": "osd_op(client.4668.0:265749 5.a 5:5db077e9:::benchmark_data_smithi006_114134_object132088:head [delete] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e77)", 2023-08-01T19:56:33.839 INFO:teuthology.orchestra.run.smithi008.stdout: "initiated_at": "2023-08-01T19:56:33.785975+0000", 2023-08-01T19:56:33.840 INFO:teuthology.orchestra.run.smithi008.stdout: "age": 0.0066486490000000004, 2023-08-01T19:56:33.840 INFO:teuthology.orchestra.run.smithi008.stdout: "duration": 0.0069436020000000001, 2023-08-01T19:56:33.840 INFO:teuthology.orchestra.run.smithi008.stdout: "type_data": { 2023-08-01T19:56:33.840 INFO:teuthology.orchestra.run.smithi008.stdout: "flag_point": "waiting for sub ops", 2023-08-01T19:56:33.840 INFO:teuthology.orchestra.run.smithi008.stdout: "client_info": { 2023-08-01T19:56:33.840 INFO:teuthology.orchestra.run.smithi008.stdout: "client": "client.4668", 2023-08-01T19:56:33.840 INFO:teuthology.orchestra.run.smithi008.stdout: "client_addr": "172.21.15.6:0/1709472247", 2023-08-01T19:56:33.840 INFO:teuthology.orchestra.run.smithi008.stdout: "tid": 265749 2023-08-01T19:56:33.841 INFO:teuthology.orchestra.run.smithi008.stdout: }, 2023-08-01T19:56:33.841 INFO:teuthology.orchestra.run.smithi008.stdout: "events": [ 2023-08-01T19:56:33.841 INFO:teuthology.orchestra.run.smithi008.stdout: { 2023-08-01T19:56:33.841 INFO:teuthology.orchestra.run.smithi008.stdout: "event": "initiated", 2023-08-01T19:56:33.841 INFO:teuthology.orchestra.run.smithi008.stdout: "time": "2023-08-01T19:56:33.785975+0000", 2023-08-01T19:56:33.841 INFO:teuthology.orchestra.run.smithi008.stdout: "duration": 0 2023-08-01T19:56:33.841 INFO:teuthology.orchestra.run.smithi008.stdout: }, 2023-08-01T19:56:33.842 INFO:teuthology.orchestra.run.smithi008.stdout: { 2023-08-01T19:56:33.842 INFO:teuthology.orchestra.run.smithi008.stdout: "event": "throttled", 2023-08-01T19:56:33.842 INFO:teuthology.orchestra.run.smithi008.stdout: "time": "2023-08-01T19:56:33.785975+0000", 2023-08-01T19:56:33.842 INFO:teuthology.orchestra.run.smithi008.stdout: "duration": 0 2023-08-01T19:56:33.842 INFO:teuthology.orchestra.run.smithi008.stdout: }, 2023-08-01T19:56:33.842 INFO:teuthology.orchestra.run.smithi008.stdout: { 2023-08-01T19:56:33.842 INFO:teuthology.orchestra.run.smithi008.stdout: "event": "header_read", 2023-08-01T19:56:33.842 INFO:teuthology.orchestra.run.smithi008.stdout: "time": "2023-08-01T19:56:33.785975+0000", 2023-08-01T19:56:33.843 INFO:teuthology.orchestra.run.smithi008.stdout: "duration": 4294967295.9999995 2023-08-01T19:56:33.843 INFO:teuthology.orchestra.run.smithi008.stdout: }, 2023-08-01T19:56:33.843 INFO:teuthology.orchestra.run.smithi008.stdout: { 2023-08-01T19:56:33.843 INFO:teuthology.orchestra.run.smithi008.stdout: "event": "all_read", 2023-08-01T19:56:33.843 INFO:teuthology.orchestra.run.smithi008.stdout: "time": "2023-08-01T19:56:33.785977+0000", 2023-08-01T19:56:33.843 INFO:teuthology.orchestra.run.smithi008.stdout: "duration": 2.0209999999999998e-06 2023-08-01T19:56:33.843 INFO:teuthology.orchestra.run.smithi008.stdout: }, 2023-08-01T19:56:33.843 INFO:teuthology.orchestra.run.smithi008.stdout: { 2023-08-01T19:56:33.844 INFO:teuthology.orchestra.run.smithi008.stdout: "event": "dispatched", 2023-08-01T19:56:33.844 INFO:teuthology.orchestra.run.smithi008.stdout: "time": "2023-08-01T19:56:33.785983+0000", 2023-08-01T19:56:33.844 INFO:teuthology.orchestra.run.smithi008.stdout: "duration": 6.2840000000000003e-06 2023-08-01T19:56:33.844 INFO:teuthology.orchestra.run.smithi008.stdout: }, 2023-08-01T19:56:33.844 INFO:teuthology.orchestra.run.smithi008.stdout: { 2023-08-01T19:56:33.844 INFO:teuthology.orchestra.run.smithi008.stdout: "event": "queued_for_pg", 2023-08-01T19:56:33.844 INFO:teuthology.orchestra.run.smithi008.stdout: "time": "2023-08-01T19:56:33.785987+0000", 2023-08-01T19:56:33.844 INFO:teuthology.orchestra.run.smithi008.stdout: "duration": 3.8759999999999998e-06 2023-08-01T19:56:33.845 INFO:teuthology.orchestra.run.smithi008.stdout: }, 2023-08-01T19:56:33.845 INFO:teuthology.orchestra.run.smithi008.stdout: { 2023-08-01T19:56:33.845 INFO:teuthology.orchestra.run.smithi008.stdout: "event": "reached_pg", 2023-08-01T19:56:33.845 INFO:teuthology.orchestra.run.smithi008.stdout: "time": "2023-08-01T19:56:33.788023+0000", 2023-08-01T19:56:33.845 INFO:teuthology.orchestra.run.smithi008.stdout: "duration": 0.0020365190000000001 2023-08-01T19:56:33.845 INFO:teuthology.orchestra.run.smithi008.stdout: }, 2023-08-01T19:56:33.845 INFO:teuthology.orchestra.run.smithi008.stdout: { 2023-08-01T19:56:33.846 INFO:teuthology.orchestra.run.smithi008.stdout: "event": "started", 2023-08-01T19:56:33.846 INFO:teuthology.orchestra.run.smithi008.stdout: "time": "2023-08-01T19:56:33.788142+0000", 2023-08-01T19:56:33.846 INFO:teuthology.orchestra.run.smithi008.stdout: "duration": 0.000118879 2023-08-01T19:56:33.846 INFO:teuthology.orchestra.run.smithi008.stdout: }, 2023-08-01T19:56:33.846 INFO:teuthology.orchestra.run.smithi008.stdout: { 2023-08-01T19:56:33.846 INFO:teuthology.orchestra.run.smithi008.stdout: "event": "waiting for subops from 2", 2023-08-01T19:56:33.846 INFO:teuthology.orchestra.run.smithi008.stdout: "time": "2023-08-01T19:56:33.788255+0000", 2023-08-01T19:56:33.846 INFO:teuthology.orchestra.run.smithi008.stdout: "duration": 0.00011285099999999999 2023-08-01T19:56:33.847 INFO:teuthology.orchestra.run.smithi008.stdout: }, 2023-08-01T19:56:33.847 INFO:teuthology.orchestra.run.smithi008.stdout: { 2023-08-01T19:56:33.847 INFO:teuthology.orchestra.run.smithi008.stdout: "event": "sub_op_commit_rec", 2023-08-01T19:56:33.847 INFO:teuthology.orchestra.run.smithi008.stdout: "time": "2023-08-01T19:56:33.791385+0000", 2023-08-01T19:56:33.847 INFO:teuthology.orchestra.run.smithi008.stdout: "duration": 0.0031299240000000001 2023-08-01T19:56:33.847 INFO:teuthology.orchestra.run.smithi008.stdout: } 2023-08-01T19:56:33.847 INFO:teuthology.orchestra.run.smithi008.stdout: ] 2023-08-01T19:56:33.847 INFO:teuthology.orchestra.run.smithi008.stdout: } 2023-08-01T19:56:33.848 INFO:teuthology.orchestra.run.smithi008.stdout: }, 2023-08-01T19:56:33.848 INFO:teuthology.orchestra.run.smithi008.stdout: { 2023-08-01T19:56:33.848 INFO:teuthology.orchestra.run.smithi008.stdout: "description": "osd_op(client.4668.0:265750 5.e 5:71e60f00:::benchmark_data_smithi006_114134_object132089:head [delete] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e77)", 2023-08-01T19:56:33.848 INFO:teuthology.orchestra.run.smithi008.stdout: "initiated_at": "2023-08-01T19:56:33.786174+0000", 2023-08-01T19:56:33.848 INFO:teuthology.orchestra.run.smithi008.stdout: "age": 0.0064494940000000001, 2023-08-01T19:56:33.848 INFO:teuthology.orchestra.run.smithi008.stdout: "duration": 0.0068185479999999998, 2023-08-01T19:56:33.848 INFO:teuthology.orchestra.run.smithi008.stdout: "type_data": { 2023-08-01T19:56:33.849 INFO:teuthology.orchestra.run.smithi008.stdout: "flag_point": "waiting for sub ops", 2023-08-01T19:56:33.849 INFO:teuthology.orchestra.run.smithi008.stdout: "client_info": { 2023-08-01T19:56:33.849 INFO:teuthology.orchestra.run.smithi008.stdout: "client": "client.4668", 2023-08-01T19:56:33.849 INFO:teuthology.orchestra.run.smithi008.stdout: "client_addr": "172.21.15.6:0/1709472247", 2023-08-01T19:56:33.849 INFO:teuthology.orchestra.run.smithi008.stdout: "tid": 265750 2023-08-01T19:56:33.849 INFO:teuthology.orchestra.run.smithi008.stdout: }, 2023-08-01T19:56:33.849 INFO:teuthology.orchestra.run.smithi008.stdout: "events": [ 2023-08-01T19:56:33.849 INFO:teuthology.orchestra.run.smithi008.stdout: { 2023-08-01T19:56:33.850 INFO:teuthology.orchestra.run.smithi008.stdout: "event": "initiated", 2023-08-01T19:56:33.850 INFO:teuthology.orchestra.run.smithi008.stdout: "time": "2023-08-01T19:56:33.786174+0000", 2023-08-01T19:56:33.850 INFO:teuthology.orchestra.run.smithi008.stdout: "duration": 0 2023-08-01T19:56:33.850 INFO:teuthology.orchestra.run.smithi008.stdout: }, 2023-08-01T19:56:33.850 INFO:teuthology.orchestra.run.smithi008.stdout: { 2023-08-01T19:56:33.850 INFO:teuthology.orchestra.run.smithi008.stdout: "event": "throttled", 2023-08-01T19:56:33.850 INFO:teuthology.orchestra.run.smithi008.stdout: "time": "2023-08-01T19:56:33.786174+0000", 2023-08-01T19:56:33.851 INFO:teuthology.orchestra.run.smithi008.stdout: "duration": 0 2023-08-01T19:56:33.851 INFO:teuthology.orchestra.run.smithi008.stdout: }, 2023-08-01T19:56:33.851 INFO:teuthology.orchestra.run.smithi008.stdout: { 2023-08-01T19:56:33.851 INFO:teuthology.orchestra.run.smithi008.stdout: "event": "header_read", 2023-08-01T19:56:33.851 INFO:teuthology.orchestra.run.smithi008.stdout: "time": "2023-08-01T19:56:33.786173+0000", 2023-08-01T19:56:33.851 INFO:teuthology.orchestra.run.smithi008.stdout: "duration": 4294967295.999999 2023-08-01T19:56:33.851 INFO:teuthology.orchestra.run.smithi008.stdout: }, 2023-08-01T19:56:33.851 INFO:teuthology.orchestra.run.smithi008.stdout: { 2023-08-01T19:56:33.852 INFO:teuthology.orchestra.run.smithi008.stdout: "event": "all_read", 2023-08-01T19:56:33.852 INFO:teuthology.orchestra.run.smithi008.stdout: "time": "2023-08-01T19:56:33.786178+0000", 2023-08-01T19:56:33.852 INFO:teuthology.orchestra.run.smithi008.stdout: "duration": 5.0119999999999996e-06 2023-08-01T19:56:33.852 INFO:teuthology.orchestra.run.smithi008.stdout: }, 2023-08-01T19:56:33.852 INFO:teuthology.orchestra.run.smithi008.stdout: { 2023-08-01T19:56:33.852 INFO:teuthology.orchestra.run.smithi008.stdout: "event": "dispatched", 2023-08-01T19:56:33.852 INFO:teuthology.orchestra.run.smithi008.stdout: "time": "2023-08-01T19:56:33.786188+0000", 2023-08-01T19:56:33.853 INFO:teuthology.orchestra.run.smithi008.stdout: "duration": 9.2750000000000001e-06 2023-08-01T19:56:33.853 INFO:teuthology.orchestra.run.smithi008.stdout: }, 2023-08-01T19:56:33.853 INFO:teuthology.orchestra.run.smithi008.stdout: { 2023-08-01T19:56:33.853 INFO:teuthology.orchestra.run.smithi008.stdout: "event": "queued_for_pg", 2023-08-01T19:56:33.853 INFO:teuthology.orchestra.run.smithi008.stdout: "time": "2023-08-01T19:56:33.786193+0000", 2023-08-01T19:56:33.853 INFO:teuthology.orchestra.run.smithi008.stdout: "duration": 5.7200000000000003e-06 2023-08-01T19:56:33.853 INFO:teuthology.orchestra.run.smithi008.stdout: }, 2023-08-01T19:56:33.853 INFO:teuthology.orchestra.run.smithi008.stdout: { 2023-08-01T19:56:33.854 INFO:teuthology.orchestra.run.smithi008.stdout: "event": "reached_pg", 2023-08-01T19:56:33.854 INFO:teuthology.orchestra.run.smithi008.stdout: "time": "2023-08-01T19:56:33.787822+0000", 2023-08-01T19:56:33.854 INFO:teuthology.orchestra.run.smithi008.stdout: "duration": 0.001628588 2023-08-01T19:56:33.854 INFO:teuthology.orchestra.run.smithi008.stdout: }, 2023-08-01T19:56:33.854 INFO:teuthology.orchestra.run.smithi008.stdout: { 2023-08-01T19:56:33.854 INFO:teuthology.orchestra.run.smithi008.stdout: "event": "started", 2023-08-01T19:56:33.854 INFO:teuthology.orchestra.run.smithi008.stdout: "time": "2023-08-01T19:56:33.787951+0000", 2023-08-01T19:56:33.854 INFO:teuthology.orchestra.run.smithi008.stdout: "duration": 0.00012849399999999999 2023-08-01T19:56:33.855 INFO:teuthology.orchestra.run.smithi008.stdout: }, 2023-08-01T19:56:33.855 INFO:teuthology.orchestra.run.smithi008.stdout: { 2023-08-01T19:56:33.855 INFO:teuthology.orchestra.run.smithi008.stdout: "event": "waiting for subops from 2", 2023-08-01T19:56:33.855 INFO:teuthology.orchestra.run.smithi008.stdout: "time": "2023-08-01T19:56:33.788067+0000", 2023-08-01T19:56:33.855 INFO:teuthology.orchestra.run.smithi008.stdout: "duration": 0.000116613 2023-08-01T19:56:33.855 INFO:teuthology.orchestra.run.smithi008.stdout: } 2023-08-01T19:56:33.856 INFO:teuthology.orchestra.run.smithi008.stdout: ] 2023-08-01T19:56:33.856 INFO:teuthology.orchestra.run.smithi008.stdout: } 2023-08-01T19:56:33.856 INFO:teuthology.orchestra.run.smithi008.stdout: }, 2023-08-01T19:56:33.856 INFO:teuthology.orchestra.run.smithi008.stdout: { 2023-08-01T19:56:33.856 INFO:teuthology.orchestra.run.smithi008.stdout: "description": "osd_op(client.4668.0:265751 5.4 5:218510b4:::benchmark_data_smithi006_114134_object132090:head [delete] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e77)", 2023-08-01T19:56:33.856 INFO:teuthology.orchestra.run.smithi008.stdout: "initiated_at": "2023-08-01T19:56:33.786200+0000", 2023-08-01T19:56:33.856 INFO:teuthology.orchestra.run.smithi008.stdout: "age": 0.0064232919999999997, 2023-08-01T19:56:33.857 INFO:teuthology.orchestra.run.smithi008.stdout: "duration": 0.0068363950000000003, 2023-08-01T19:56:33.857 INFO:teuthology.orchestra.run.smithi008.stdout: "type_data": { 2023-08-01T19:56:33.857 INFO:teuthology.orchestra.run.smithi008.stdout: "flag_point": "waiting for sub ops", 2023-08-01T19:56:33.857 INFO:teuthology.orchestra.run.smithi008.stdout: "client_info": { 2023-08-01T19:56:33.857 INFO:teuthology.orchestra.run.smithi008.stdout: "client": "client.4668", 2023-08-01T19:56:33.857 INFO:teuthology.orchestra.run.smithi008.stdout: "client_addr": "172.21.15.6:0/1709472247", 2023-08-01T19:56:33.857 INFO:teuthology.orchestra.run.smithi008.stdout: "tid": 265751 2023-08-01T19:56:33.858 INFO:teuthology.orchestra.run.smithi008.stdout: }, 2023-08-01T19:56:33.858 INFO:teuthology.orchestra.run.smithi008.stdout: "events": [ 2023-08-01T19:56:33.858 INFO:teuthology.orchestra.run.smithi008.stdout: { 2023-08-01T19:56:33.858 INFO:teuthology.orchestra.run.smithi008.stdout: "event": "initiated", 2023-08-01T19:56:33.858 INFO:teuthology.orchestra.run.smithi008.stdout: "time": "2023-08-01T19:56:33.786200+0000", 2023-08-01T19:56:33.858 INFO:teuthology.orchestra.run.smithi008.stdout: "duration": 0 2023-08-01T19:56:33.858 INFO:teuthology.orchestra.run.smithi008.stdout: }, 2023-08-01T19:56:33.858 INFO:teuthology.orchestra.run.smithi008.stdout: { 2023-08-01T19:56:33.859 INFO:teuthology.orchestra.run.smithi008.stdout: "event": "throttled", 2023-08-01T19:56:33.859 INFO:teuthology.orchestra.run.smithi008.stdout: "time": "2023-08-01T19:56:33.786200+0000", 2023-08-01T19:56:33.859 INFO:teuthology.orchestra.run.smithi008.stdout: "duration": 0 2023-08-01T19:56:33.859 INFO:teuthology.orchestra.run.smithi008.stdout: }, 2023-08-01T19:56:33.859 INFO:teuthology.orchestra.run.smithi008.stdout: { 2023-08-01T19:56:33.859 INFO:teuthology.orchestra.run.smithi008.stdout: "event": "header_read", 2023-08-01T19:56:33.859 INFO:teuthology.orchestra.run.smithi008.stdout: "time": "2023-08-01T19:56:33.786200+0000", 2023-08-01T19:56:33.859 INFO:teuthology.orchestra.run.smithi008.stdout: "duration": 4294967295.9999995 2023-08-01T19:56:33.860 INFO:teuthology.orchestra.run.smithi008.stdout: }, 2023-08-01T19:56:33.860 INFO:teuthology.orchestra.run.smithi008.stdout: { 2023-08-01T19:56:33.860 INFO:teuthology.orchestra.run.smithi008.stdout: "event": "all_read", 2023-08-01T19:56:33.860 INFO:teuthology.orchestra.run.smithi008.stdout: "time": "2023-08-01T19:56:33.786203+0000", 2023-08-01T19:56:33.860 INFO:teuthology.orchestra.run.smithi008.stdout: "duration": 2.632e-06 2023-08-01T19:56:33.860 INFO:teuthology.orchestra.run.smithi008.stdout: }, 2023-08-01T19:56:33.860 INFO:teuthology.orchestra.run.smithi008.stdout: { 2023-08-01T19:56:33.860 INFO:teuthology.orchestra.run.smithi008.stdout: "event": "dispatched", 2023-08-01T19:56:33.861 INFO:teuthology.orchestra.run.smithi008.stdout: "time": "2023-08-01T19:56:33.786210+0000", 2023-08-01T19:56:33.861 INFO:teuthology.orchestra.run.smithi008.stdout: "duration": 7.7100000000000007e-06 2023-08-01T19:56:33.861 INFO:teuthology.orchestra.run.smithi008.stdout: }, 2023-08-01T19:56:33.861 INFO:teuthology.orchestra.run.smithi008.stdout: { 2023-08-01T19:56:33.861 INFO:teuthology.orchestra.run.smithi008.stdout: "event": "queued_for_pg", 2023-08-01T19:56:33.861 INFO:teuthology.orchestra.run.smithi008.stdout: "time": "2023-08-01T19:56:33.786217+0000", 2023-08-01T19:56:33.861 INFO:teuthology.orchestra.run.smithi008.stdout: "duration": 6.4400000000000002e-06 2023-08-01T19:56:33.862 INFO:teuthology.orchestra.run.smithi008.stdout: }, 2023-08-01T19:56:33.862 INFO:teuthology.orchestra.run.smithi008.stdout: { 2023-08-01T19:56:33.862 INFO:teuthology.orchestra.run.smithi008.stdout: "event": "reached_pg", 2023-08-01T19:56:33.862 INFO:teuthology.orchestra.run.smithi008.stdout: "time": "2023-08-01T19:56:33.788075+0000", 2023-08-01T19:56:33.862 INFO:teuthology.orchestra.run.smithi008.stdout: "duration": 0.001858293 2023-08-01T19:56:33.862 INFO:teuthology.orchestra.run.smithi008.stdout: }, 2023-08-01T19:56:33.862 INFO:teuthology.orchestra.run.smithi008.stdout: { 2023-08-01T19:56:33.862 INFO:teuthology.orchestra.run.smithi008.stdout: "event": "started", 2023-08-01T19:56:33.863 INFO:teuthology.orchestra.run.smithi008.stdout: "time": "2023-08-01T19:56:33.788183+0000", 2023-08-01T19:56:33.863 INFO:teuthology.orchestra.run.smithi008.stdout: "duration": 0.00010791800000000001 2023-08-01T19:56:33.863 INFO:teuthology.orchestra.run.smithi008.stdout: }, 2023-08-01T19:56:33.863 INFO:teuthology.orchestra.run.smithi008.stdout: { 2023-08-01T19:56:33.863 INFO:teuthology.orchestra.run.smithi008.stdout: "event": "waiting for subops from 2", 2023-08-01T19:56:33.863 INFO:teuthology.orchestra.run.smithi008.stdout: "time": "2023-08-01T19:56:33.788288+0000", 2023-08-01T19:56:33.863 INFO:teuthology.orchestra.run.smithi008.stdout: "duration": 0.000105103 2023-08-01T19:56:33.863 INFO:teuthology.orchestra.run.smithi008.stdout: }, 2023-08-01T19:56:33.864 INFO:teuthology.orchestra.run.smithi008.stdout: { 2023-08-01T19:56:33.864 INFO:teuthology.orchestra.run.smithi008.stdout: "event": "sub_op_commit_rec", 2023-08-01T19:56:33.864 INFO:teuthology.orchestra.run.smithi008.stdout: "time": "2023-08-01T19:56:33.792950+0000", 2023-08-01T19:56:33.864 INFO:teuthology.orchestra.run.smithi008.stdout: "duration": 0.0046623610000000003 2023-08-01T19:56:33.864 INFO:teuthology.orchestra.run.smithi008.stdout: } 2023-08-01T19:56:33.864 INFO:teuthology.orchestra.run.smithi008.stdout: ] 2023-08-01T19:56:33.864 INFO:teuthology.orchestra.run.smithi008.stdout: } 2023-08-01T19:56:33.864 INFO:teuthology.orchestra.run.smithi008.stdout: }, 2023-08-01T19:56:33.865 INFO:teuthology.orchestra.run.smithi008.stdout: { 2023-08-01T19:56:33.865 INFO:teuthology.orchestra.run.smithi008.stdout: "description": "osd_op(client.4668.0:265752 5.b 5:def03648:::benchmark_data_smithi006_114134_object132091:head [delete] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e77)", 2023-08-01T19:56:33.865 INFO:teuthology.orchestra.run.smithi008.stdout: "initiated_at": "2023-08-01T19:56:33.787237+0000", 2023-08-01T19:56:33.865 INFO:teuthology.orchestra.run.smithi008.stdout: "age": 0.0053864580000000002, 2023-08-01T19:56:33.865 INFO:teuthology.orchestra.run.smithi008.stdout: "duration": 0.0058453000000000003, 2023-08-01T19:56:33.865 INFO:teuthology.orchestra.run.smithi008.stdout: "type_data": { 2023-08-01T19:56:33.865 INFO:teuthology.orchestra.run.smithi008.stdout: "flag_point": "waiting for sub ops", 2023-08-01T19:56:33.866 INFO:teuthology.orchestra.run.smithi008.stdout: "client_info": { 2023-08-01T19:56:33.866 INFO:teuthology.orchestra.run.smithi008.stdout: "client": "client.4668", 2023-08-01T19:56:33.866 INFO:teuthology.orchestra.run.smithi008.stdout: "client_addr": "172.21.15.6:0/1709472247", 2023-08-01T19:56:33.866 INFO:teuthology.orchestra.run.smithi008.stdout: "tid": 265752 2023-08-01T19:56:33.866 INFO:teuthology.orchestra.run.smithi008.stdout: }, 2023-08-01T19:56:33.866 INFO:teuthology.orchestra.run.smithi008.stdout: "events": [ 2023-08-01T19:56:33.866 INFO:teuthology.orchestra.run.smithi008.stdout: { 2023-08-01T19:56:33.866 INFO:teuthology.orchestra.run.smithi008.stdout: "event": "initiated", 2023-08-01T19:56:33.867 INFO:teuthology.orchestra.run.smithi008.stdout: "time": "2023-08-01T19:56:33.787237+0000", 2023-08-01T19:56:33.867 INFO:teuthology.orchestra.run.smithi008.stdout: "duration": 0 2023-08-01T19:56:33.867 INFO:teuthology.orchestra.run.smithi008.stdout: }, 2023-08-01T19:56:33.867 INFO:teuthology.orchestra.run.smithi008.stdout: { 2023-08-01T19:56:33.867 INFO:teuthology.orchestra.run.smithi008.stdout: "event": "throttled", 2023-08-01T19:56:33.867 INFO:teuthology.orchestra.run.smithi008.stdout: "time": "2023-08-01T19:56:33.787237+0000", 2023-08-01T19:56:33.867 INFO:teuthology.orchestra.run.smithi008.stdout: "duration": 0 2023-08-01T19:56:33.867 INFO:teuthology.orchestra.run.smithi008.stdout: }, 2023-08-01T19:56:33.868 INFO:teuthology.orchestra.run.smithi008.stdout: { 2023-08-01T19:56:33.868 INFO:teuthology.orchestra.run.smithi008.stdout: "event": "header_read", 2023-08-01T19:56:33.868 INFO:teuthology.orchestra.run.smithi008.stdout: "time": "2023-08-01T19:56:33.787236+0000", 2023-08-01T19:56:33.868 INFO:teuthology.orchestra.run.smithi008.stdout: "duration": 4294967295.999999 2023-08-01T19:56:33.868 INFO:teuthology.orchestra.run.smithi008.stdout: }, 2023-08-01T19:56:33.868 INFO:teuthology.orchestra.run.smithi008.stdout: { 2023-08-01T19:56:33.868 INFO:teuthology.orchestra.run.smithi008.stdout: "event": "all_read", 2023-08-01T19:56:33.868 INFO:teuthology.orchestra.run.smithi008.stdout: "time": "2023-08-01T19:56:33.787241+0000", 2023-08-01T19:56:33.869 INFO:teuthology.orchestra.run.smithi008.stdout: "duration": 4.7090000000000001e-06 2023-08-01T19:56:33.869 INFO:teuthology.orchestra.run.smithi008.stdout: }, 2023-08-01T19:56:33.869 INFO:teuthology.orchestra.run.smithi008.stdout: { 2023-08-01T19:56:33.869 INFO:teuthology.orchestra.run.smithi008.stdout: "event": "dispatched", 2023-08-01T19:56:33.869 INFO:teuthology.orchestra.run.smithi008.stdout: "time": "2023-08-01T19:56:33.787253+0000", 2023-08-01T19:56:33.869 INFO:teuthology.orchestra.run.smithi008.stdout: "duration": 1.2376e-05 2023-08-01T19:56:33.869 INFO:teuthology.orchestra.run.smithi008.stdout: }, 2023-08-01T19:56:33.870 INFO:teuthology.orchestra.run.smithi008.stdout: { 2023-08-01T19:56:33.870 INFO:teuthology.orchestra.run.smithi008.stdout: "event": "queued_for_pg", 2023-08-01T19:56:33.870 INFO:teuthology.orchestra.run.smithi008.stdout: "time": "2023-08-01T19:56:33.787259+0000", 2023-08-01T19:56:33.870 INFO:teuthology.orchestra.run.smithi008.stdout: "duration": 5.4929999999999998e-06 2023-08-01T19:56:33.870 INFO:teuthology.orchestra.run.smithi008.stdout: }, 2023-08-01T19:56:33.870 INFO:teuthology.orchestra.run.smithi008.stdout: { 2023-08-01T19:56:33.870 INFO:teuthology.orchestra.run.smithi008.stdout: "event": "reached_pg", 2023-08-01T19:56:33.870 INFO:teuthology.orchestra.run.smithi008.stdout: "time": "2023-08-01T19:56:33.787295+0000", 2023-08-01T19:56:33.871 INFO:teuthology.orchestra.run.smithi008.stdout: "duration": 3.6245999999999998e-05 2023-08-01T19:56:33.871 INFO:teuthology.orchestra.run.smithi008.stdout: }, 2023-08-01T19:56:33.871 INFO:teuthology.orchestra.run.smithi008.stdout: { 2023-08-01T19:56:33.871 INFO:teuthology.orchestra.run.smithi008.stdout: "event": "started", 2023-08-01T19:56:33.871 INFO:teuthology.orchestra.run.smithi008.stdout: "time": "2023-08-01T19:56:33.787415+0000", 2023-08-01T19:56:33.871 INFO:teuthology.orchestra.run.smithi008.stdout: "duration": 0.00012022 2023-08-01T19:56:33.871 INFO:teuthology.orchestra.run.smithi008.stdout: }, 2023-08-01T19:56:33.871 INFO:teuthology.orchestra.run.smithi008.stdout: { 2023-08-01T19:56:33.872 INFO:teuthology.orchestra.run.smithi008.stdout: "event": "waiting for subops from 2", 2023-08-01T19:56:33.872 INFO:teuthology.orchestra.run.smithi008.stdout: "time": "2023-08-01T19:56:33.787518+0000", 2023-08-01T19:56:33.872 INFO:teuthology.orchestra.run.smithi008.stdout: "duration": 0.00010251699999999999 2023-08-01T19:56:33.872 INFO:teuthology.orchestra.run.smithi008.stdout: } 2023-08-01T19:56:33.872 INFO:teuthology.orchestra.run.smithi008.stdout: ] 2023-08-01T19:56:33.872 INFO:teuthology.orchestra.run.smithi008.stdout: } 2023-08-01T19:56:33.872 INFO:teuthology.orchestra.run.smithi008.stdout: }, 2023-08-01T19:56:33.873 INFO:teuthology.orchestra.run.smithi008.stdout: { 2023-08-01T19:56:33.873 INFO:teuthology.orchestra.run.smithi008.stdout: "description": "osd_op(client.4668.0:265753 5.2 5:45013af9:::benchmark_data_smithi006_114134_object132092:head [delete] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e77)", 2023-08-01T19:56:33.873 INFO:teuthology.orchestra.run.smithi008.stdout: "initiated_at": "2023-08-01T19:56:33.790338+0000", 2023-08-01T19:56:33.873 INFO:teuthology.orchestra.run.smithi008.stdout: "age": 0.0022854580000000002, 2023-08-01T19:56:33.873 INFO:teuthology.orchestra.run.smithi008.stdout: "duration": 0.0027867410000000001, 2023-08-01T19:56:33.873 INFO:teuthology.orchestra.run.smithi008.stdout: "type_data": { 2023-08-01T19:56:33.873 INFO:teuthology.orchestra.run.smithi008.stdout: "flag_point": "started", 2023-08-01T19:56:33.873 INFO:teuthology.orchestra.run.smithi008.stdout: "client_info": { 2023-08-01T19:56:33.874 INFO:teuthology.orchestra.run.smithi008.stdout: "client": "client.4668", 2023-08-01T19:56:33.874 INFO:teuthology.orchestra.run.smithi008.stdout: "client_addr": "172.21.15.6:0/1709472247", 2023-08-01T19:56:33.874 INFO:teuthology.orchestra.run.smithi008.stdout: "tid": 265753 2023-08-01T19:56:33.874 INFO:teuthology.orchestra.run.smithi008.stdout: }, 2023-08-01T19:56:33.874 INFO:teuthology.orchestra.run.smithi008.stdout: "events": [ 2023-08-01T19:56:33.874 INFO:teuthology.orchestra.run.smithi008.stdout: { 2023-08-01T19:56:33.874 INFO:teuthology.orchestra.run.smithi008.stdout: "event": "initiated", 2023-08-01T19:56:33.874 INFO:teuthology.orchestra.run.smithi008.stdout: "time": "2023-08-01T19:56:33.790338+0000", 2023-08-01T19:56:33.875 INFO:teuthology.orchestra.run.smithi008.stdout: "duration": 0 2023-08-01T19:56:33.875 INFO:teuthology.orchestra.run.smithi008.stdout: }, 2023-08-01T19:56:33.875 INFO:teuthology.orchestra.run.smithi008.stdout: { 2023-08-01T19:56:33.875 INFO:teuthology.orchestra.run.smithi008.stdout: "event": "throttled", 2023-08-01T19:56:33.875 INFO:teuthology.orchestra.run.smithi008.stdout: "time": "2023-08-01T19:56:33.790338+0000", 2023-08-01T19:56:33.875 INFO:teuthology.orchestra.run.smithi008.stdout: "duration": 0 2023-08-01T19:56:33.875 INFO:teuthology.orchestra.run.smithi008.stdout: }, 2023-08-01T19:56:33.876 INFO:teuthology.orchestra.run.smithi008.stdout: { 2023-08-01T19:56:33.876 INFO:teuthology.orchestra.run.smithi008.stdout: "event": "header_read", 2023-08-01T19:56:33.876 INFO:teuthology.orchestra.run.smithi008.stdout: "time": "2023-08-01T19:56:33.790337+0000", 2023-08-01T19:56:33.876 INFO:teuthology.orchestra.run.smithi008.stdout: "duration": 4294967295.999999 2023-08-01T19:56:33.876 INFO:teuthology.orchestra.run.smithi008.stdout: }, 2023-08-01T19:56:33.876 INFO:teuthology.orchestra.run.smithi008.stdout: { 2023-08-01T19:56:33.876 INFO:teuthology.orchestra.run.smithi008.stdout: "event": "all_read", 2023-08-01T19:56:33.876 INFO:teuthology.orchestra.run.smithi008.stdout: "time": "2023-08-01T19:56:33.790342+0000", 2023-08-01T19:56:33.877 INFO:teuthology.orchestra.run.smithi008.stdout: "duration": 4.4530000000000004e-06 2023-08-01T19:56:33.877 INFO:teuthology.orchestra.run.smithi008.stdout: }, 2023-08-01T19:56:33.877 INFO:teuthology.orchestra.run.smithi008.stdout: { 2023-08-01T19:56:33.877 INFO:teuthology.orchestra.run.smithi008.stdout: "event": "dispatched", 2023-08-01T19:56:33.877 INFO:teuthology.orchestra.run.smithi008.stdout: "time": "2023-08-01T19:56:33.790357+0000", 2023-08-01T19:56:33.877 INFO:teuthology.orchestra.run.smithi008.stdout: "duration": 1.5376999999999999e-05 2023-08-01T19:56:33.877 INFO:teuthology.orchestra.run.smithi008.stdout: }, 2023-08-01T19:56:33.877 INFO:teuthology.orchestra.run.smithi008.stdout: { 2023-08-01T19:56:33.878 INFO:teuthology.orchestra.run.smithi008.stdout: "event": "queued_for_pg", 2023-08-01T19:56:33.878 INFO:teuthology.orchestra.run.smithi008.stdout: "time": "2023-08-01T19:56:33.790362+0000", 2023-08-01T19:56:33.878 INFO:teuthology.orchestra.run.smithi008.stdout: "duration": 4.3320000000000002e-06 2023-08-01T19:56:33.878 INFO:teuthology.orchestra.run.smithi008.stdout: }, 2023-08-01T19:56:33.878 INFO:teuthology.orchestra.run.smithi008.stdout: { 2023-08-01T19:56:33.878 INFO:teuthology.orchestra.run.smithi008.stdout: "event": "reached_pg", 2023-08-01T19:56:33.878 INFO:teuthology.orchestra.run.smithi008.stdout: "time": "2023-08-01T19:56:33.790390+0000", 2023-08-01T19:56:33.878 INFO:teuthology.orchestra.run.smithi008.stdout: "duration": 2.8360999999999998e-05 2023-08-01T19:56:33.879 INFO:teuthology.orchestra.run.smithi008.stdout: }, 2023-08-01T19:56:33.879 INFO:teuthology.orchestra.run.smithi008.stdout: { 2023-08-01T19:56:33.879 INFO:teuthology.orchestra.run.smithi008.stdout: "event": "started", 2023-08-01T19:56:33.879 INFO:teuthology.orchestra.run.smithi008.stdout: "time": "2023-08-01T19:56:33.790473+0000", 2023-08-01T19:56:33.879 INFO:teuthology.orchestra.run.smithi008.stdout: "duration": 8.2714999999999997e-05 2023-08-01T19:56:33.879 INFO:teuthology.orchestra.run.smithi008.stdout: } 2023-08-01T19:56:33.879 INFO:teuthology.orchestra.run.smithi008.stdout: ] 2023-08-01T19:56:33.879 INFO:teuthology.orchestra.run.smithi008.stdout: } 2023-08-01T19:56:33.880 INFO:teuthology.orchestra.run.smithi008.stdout: }, 2023-08-01T19:56:33.880 INFO:teuthology.orchestra.run.smithi008.stdout: { 2023-08-01T19:56:33.880 INFO:teuthology.orchestra.run.smithi008.stdout: "description": "osd_op(client.4668.0:265754 5.3 5:ca670e06:::benchmark_data_smithi006_114134_object132093:head [delete] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e77)", 2023-08-01T19:56:33.880 INFO:teuthology.orchestra.run.smithi008.stdout: "initiated_at": "2023-08-01T19:56:33.791971+0000", 2023-08-01T19:56:33.880 INFO:teuthology.orchestra.run.smithi008.stdout: "age": 0.00065268900000000003, 2023-08-01T19:56:33.880 INFO:teuthology.orchestra.run.smithi008.stdout: "duration": 0.001193068, 2023-08-01T19:56:33.880 INFO:teuthology.orchestra.run.smithi008.stdout: "type_data": { 2023-08-01T19:56:33.881 INFO:teuthology.orchestra.run.smithi008.stdout: "flag_point": "started", 2023-08-01T19:56:33.881 INFO:teuthology.orchestra.run.smithi008.stdout: "client_info": { 2023-08-01T19:56:33.881 INFO:teuthology.orchestra.run.smithi008.stdout: "client": "client.4668", 2023-08-01T19:56:33.881 INFO:teuthology.orchestra.run.smithi008.stdout: "client_addr": "172.21.15.6:0/1709472247", 2023-08-01T19:56:33.881 INFO:teuthology.orchestra.run.smithi008.stdout: "tid": 265754 2023-08-01T19:56:33.881 INFO:teuthology.orchestra.run.smithi008.stdout: }, 2023-08-01T19:56:33.881 INFO:teuthology.orchestra.run.smithi008.stdout: "events": [ 2023-08-01T19:56:33.881 INFO:teuthology.orchestra.run.smithi008.stdout: { 2023-08-01T19:56:33.882 INFO:teuthology.orchestra.run.smithi008.stdout: "event": "initiated", 2023-08-01T19:56:33.882 INFO:teuthology.orchestra.run.smithi008.stdout: "time": "2023-08-01T19:56:33.791971+0000", 2023-08-01T19:56:33.882 INFO:teuthology.orchestra.run.smithi008.stdout: "duration": 0 2023-08-01T19:56:33.882 INFO:teuthology.orchestra.run.smithi008.stdout: }, 2023-08-01T19:56:33.882 INFO:teuthology.orchestra.run.smithi008.stdout: { 2023-08-01T19:56:33.882 INFO:teuthology.orchestra.run.smithi008.stdout: "event": "throttled", 2023-08-01T19:56:33.882 INFO:teuthology.orchestra.run.smithi008.stdout: "time": "2023-08-01T19:56:33.791971+0000", 2023-08-01T19:56:33.882 INFO:teuthology.orchestra.run.smithi008.stdout: "duration": 0 2023-08-01T19:56:33.883 INFO:teuthology.orchestra.run.smithi008.stdout: }, 2023-08-01T19:56:33.883 INFO:teuthology.orchestra.run.smithi008.stdout: { 2023-08-01T19:56:33.883 INFO:teuthology.orchestra.run.smithi008.stdout: "event": "header_read", 2023-08-01T19:56:33.883 INFO:teuthology.orchestra.run.smithi008.stdout: "time": "2023-08-01T19:56:33.791970+0000", 2023-08-01T19:56:33.883 INFO:teuthology.orchestra.run.smithi008.stdout: "duration": 4294967295.999999 2023-08-01T19:56:33.883 INFO:teuthology.orchestra.run.smithi008.stdout: }, 2023-08-01T19:56:33.883 INFO:teuthology.orchestra.run.smithi008.stdout: { 2023-08-01T19:56:33.883 INFO:teuthology.orchestra.run.smithi008.stdout: "event": "all_read", 2023-08-01T19:56:33.884 INFO:teuthology.orchestra.run.smithi008.stdout: "time": "2023-08-01T19:56:33.791976+0000", 2023-08-01T19:56:33.884 INFO:teuthology.orchestra.run.smithi008.stdout: "duration": 5.4330000000000003e-06 2023-08-01T19:56:33.884 INFO:teuthology.orchestra.run.smithi008.stdout: }, 2023-08-01T19:56:33.884 INFO:teuthology.orchestra.run.smithi008.stdout: { 2023-08-01T19:56:33.884 INFO:teuthology.orchestra.run.smithi008.stdout: "event": "dispatched", 2023-08-01T19:56:33.884 INFO:teuthology.orchestra.run.smithi008.stdout: "time": "2023-08-01T19:56:33.791986+0000", 2023-08-01T19:56:33.884 INFO:teuthology.orchestra.run.smithi008.stdout: "duration": 9.9669999999999996e-06 2023-08-01T19:56:33.885 INFO:teuthology.orchestra.run.smithi008.stdout: }, 2023-08-01T19:56:33.885 INFO:teuthology.orchestra.run.smithi008.stdout: { 2023-08-01T19:56:33.885 INFO:teuthology.orchestra.run.smithi008.stdout: "event": "queued_for_pg", 2023-08-01T19:56:33.885 INFO:teuthology.orchestra.run.smithi008.stdout: "time": "2023-08-01T19:56:33.791992+0000", 2023-08-01T19:56:33.885 INFO:teuthology.orchestra.run.smithi008.stdout: "duration": 6.4869999999999999e-06 2023-08-01T19:56:33.885 INFO:teuthology.orchestra.run.smithi008.stdout: }, 2023-08-01T19:56:33.885 INFO:teuthology.orchestra.run.smithi008.stdout: { 2023-08-01T19:56:33.885 INFO:teuthology.orchestra.run.smithi008.stdout: "event": "reached_pg", 2023-08-01T19:56:33.886 INFO:teuthology.orchestra.run.smithi008.stdout: "time": "2023-08-01T19:56:33.792031+0000", 2023-08-01T19:56:33.886 INFO:teuthology.orchestra.run.smithi008.stdout: "duration": 3.8501999999999998e-05 2023-08-01T19:56:33.886 INFO:teuthology.orchestra.run.smithi008.stdout: }, 2023-08-01T19:56:33.886 INFO:teuthology.orchestra.run.smithi008.stdout: { 2023-08-01T19:56:33.886 INFO:teuthology.orchestra.run.smithi008.stdout: "event": "started", 2023-08-01T19:56:33.886 INFO:teuthology.orchestra.run.smithi008.stdout: "time": "2023-08-01T19:56:33.792116+0000", 2023-08-01T19:56:33.886 INFO:teuthology.orchestra.run.smithi008.stdout: "duration": 8.5687999999999997e-05 2023-08-01T19:56:33.886 INFO:teuthology.orchestra.run.smithi008.stdout: } 2023-08-01T19:56:33.887 INFO:teuthology.orchestra.run.smithi008.stdout: ] 2023-08-01T19:56:33.887 INFO:teuthology.orchestra.run.smithi008.stdout: } 2023-08-01T19:56:33.887 INFO:teuthology.orchestra.run.smithi008.stdout: }, 2023-08-01T19:56:33.887 INFO:teuthology.orchestra.run.smithi008.stdout: { 2023-08-01T19:56:33.887 INFO:teuthology.orchestra.run.smithi008.stdout: "description": "osd_op(client.4668.0:265755 5.e 5:7ef21aef:::benchmark_data_smithi006_114134_object132094:head [delete] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e77)", 2023-08-01T19:56:33.887 INFO:teuthology.orchestra.run.smithi008.stdout: "initiated_at": "2023-08-01T19:56:33.792003+0000", 2023-08-01T19:56:33.887 INFO:teuthology.orchestra.run.smithi008.stdout: "age": 0.00062060100000000003, 2023-08-01T19:56:33.887 INFO:teuthology.orchestra.run.smithi008.stdout: "duration": 0.001200076, 2023-08-01T19:56:33.888 INFO:teuthology.orchestra.run.smithi008.stdout: "type_data": { 2023-08-01T19:56:33.888 INFO:teuthology.orchestra.run.smithi008.stdout: "flag_point": "waiting for sub ops", 2023-08-01T19:56:33.888 INFO:teuthology.orchestra.run.smithi008.stdout: "client_info": { 2023-08-01T19:56:33.888 INFO:teuthology.orchestra.run.smithi008.stdout: "client": "client.4668", 2023-08-01T19:56:33.888 INFO:teuthology.orchestra.run.smithi008.stdout: "client_addr": "172.21.15.6:0/1709472247", 2023-08-01T19:56:33.888 INFO:teuthology.orchestra.run.smithi008.stdout: "tid": 265755 2023-08-01T19:56:33.888 INFO:teuthology.orchestra.run.smithi008.stdout: }, 2023-08-01T19:56:33.888 INFO:teuthology.orchestra.run.smithi008.stdout: "events": [ 2023-08-01T19:56:33.889 INFO:teuthology.orchestra.run.smithi008.stdout: { 2023-08-01T19:56:33.889 INFO:teuthology.orchestra.run.smithi008.stdout: "event": "initiated", 2023-08-01T19:56:33.889 INFO:teuthology.orchestra.run.smithi008.stdout: "time": "2023-08-01T19:56:33.792003+0000", 2023-08-01T19:56:33.889 INFO:teuthology.orchestra.run.smithi008.stdout: "duration": 0 2023-08-01T19:56:33.889 INFO:teuthology.orchestra.run.smithi008.stdout: }, 2023-08-01T19:56:33.889 INFO:teuthology.orchestra.run.smithi008.stdout: { 2023-08-01T19:56:33.889 INFO:teuthology.orchestra.run.smithi008.stdout: "event": "throttled", 2023-08-01T19:56:33.889 INFO:teuthology.orchestra.run.smithi008.stdout: "time": "2023-08-01T19:56:33.792003+0000", 2023-08-01T19:56:33.890 INFO:teuthology.orchestra.run.smithi008.stdout: "duration": 0 2023-08-01T19:56:33.890 INFO:teuthology.orchestra.run.smithi008.stdout: }, 2023-08-01T19:56:33.890 INFO:teuthology.orchestra.run.smithi008.stdout: { 2023-08-01T19:56:33.890 INFO:teuthology.orchestra.run.smithi008.stdout: "event": "header_read", 2023-08-01T19:56:33.890 INFO:teuthology.orchestra.run.smithi008.stdout: "time": "2023-08-01T19:56:33.792003+0000", 2023-08-01T19:56:33.890 INFO:teuthology.orchestra.run.smithi008.stdout: "duration": 4294967295.9999995 2023-08-01T19:56:33.890 INFO:teuthology.orchestra.run.smithi008.stdout: }, 2023-08-01T19:56:33.891 INFO:teuthology.orchestra.run.smithi008.stdout: { 2023-08-01T19:56:33.891 INFO:teuthology.orchestra.run.smithi008.stdout: "event": "all_read", 2023-08-01T19:56:33.891 INFO:teuthology.orchestra.run.smithi008.stdout: "time": "2023-08-01T19:56:33.792006+0000", 2023-08-01T19:56:33.891 INFO:teuthology.orchestra.run.smithi008.stdout: "duration": 3.1159999999999999e-06 2023-08-01T19:56:33.891 INFO:teuthology.orchestra.run.smithi008.stdout: }, 2023-08-01T19:56:33.891 INFO:teuthology.orchestra.run.smithi008.stdout: { 2023-08-01T19:56:33.891 INFO:teuthology.orchestra.run.smithi008.stdout: "event": "dispatched", 2023-08-01T19:56:33.891 INFO:teuthology.orchestra.run.smithi008.stdout: "time": "2023-08-01T19:56:33.792013+0000", 2023-08-01T19:56:33.892 INFO:teuthology.orchestra.run.smithi008.stdout: "duration": 7.1199999999999996e-06 2023-08-01T19:56:33.892 INFO:teuthology.orchestra.run.smithi008.stdout: }, 2023-08-01T19:56:33.892 INFO:teuthology.orchestra.run.smithi008.stdout: { 2023-08-01T19:56:33.892 INFO:teuthology.orchestra.run.smithi008.stdout: "event": "queued_for_pg", 2023-08-01T19:56:33.892 INFO:teuthology.orchestra.run.smithi008.stdout: "time": "2023-08-01T19:56:33.792019+0000", 2023-08-01T19:56:33.892 INFO:teuthology.orchestra.run.smithi008.stdout: "duration": 6.2530000000000001e-06 2023-08-01T19:56:33.892 INFO:teuthology.orchestra.run.smithi008.stdout: }, 2023-08-01T19:56:33.892 INFO:teuthology.orchestra.run.smithi008.stdout: { 2023-08-01T19:56:33.893 INFO:teuthology.orchestra.run.smithi008.stdout: "event": "reached_pg", 2023-08-01T19:56:33.893 INFO:teuthology.orchestra.run.smithi008.stdout: "time": "2023-08-01T19:56:33.792056+0000", 2023-08-01T19:56:33.893 INFO:teuthology.orchestra.run.smithi008.stdout: "duration": 3.6856000000000001e-05 2023-08-01T19:56:33.893 INFO:teuthology.orchestra.run.smithi008.stdout: }, 2023-08-01T19:56:33.893 INFO:teuthology.orchestra.run.smithi008.stdout: { 2023-08-01T19:56:33.893 INFO:teuthology.orchestra.run.smithi008.stdout: "event": "started", 2023-08-01T19:56:33.893 INFO:teuthology.orchestra.run.smithi008.stdout: "time": "2023-08-01T19:56:33.792173+0000", 2023-08-01T19:56:33.894 INFO:teuthology.orchestra.run.smithi008.stdout: "duration": 0.00011728200000000001 2023-08-01T19:56:33.894 INFO:teuthology.orchestra.run.smithi008.stdout: }, 2023-08-01T19:56:33.894 INFO:teuthology.orchestra.run.smithi008.stdout: { 2023-08-01T19:56:33.894 INFO:teuthology.orchestra.run.smithi008.stdout: "event": "waiting for subops from 2", 2023-08-01T19:56:33.894 INFO:teuthology.orchestra.run.smithi008.stdout: "time": "2023-08-01T19:56:33.792294+0000", 2023-08-01T19:56:33.894 INFO:teuthology.orchestra.run.smithi008.stdout: "duration": 0.00012103 2023-08-01T19:56:33.894 INFO:teuthology.orchestra.run.smithi008.stdout: } 2023-08-01T19:56:33.894 INFO:teuthology.orchestra.run.smithi008.stdout: ] 2023-08-01T19:56:33.895 INFO:teuthology.orchestra.run.smithi008.stdout: } 2023-08-01T19:56:33.895 INFO:teuthology.orchestra.run.smithi008.stdout: }, 2023-08-01T19:56:33.895 INFO:teuthology.orchestra.run.smithi008.stdout: { 2023-08-01T19:56:33.895 INFO:teuthology.orchestra.run.smithi008.stdout: "description": "osd_op(client.4668.0:265756 5.e 5.6451548e (undecoded) ondisk+write+known_if_redirected+supports_pool_eio e77)", 2023-08-01T19:56:33.895 INFO:teuthology.orchestra.run.smithi008.stdout: "initiated_at": "2023-08-01T19:56:33.792028+0000", 2023-08-01T19:56:33.895 INFO:teuthology.orchestra.run.smithi008.stdout: "age": 0.00059557700000000002, 2023-08-01T19:56:33.895 INFO:teuthology.orchestra.run.smithi008.stdout: "duration": 0.0012161279999999999, 2023-08-01T19:56:33.896 INFO:teuthology.orchestra.run.smithi008.stdout: "type_data": { 2023-08-01T19:56:33.896 INFO:teuthology.orchestra.run.smithi008.stdout: "flag_point": "queued for pg", 2023-08-01T19:56:33.896 INFO:teuthology.orchestra.run.smithi008.stdout: "client_info": { 2023-08-01T19:56:33.896 INFO:teuthology.orchestra.run.smithi008.stdout: "client": "client.4668", 2023-08-01T19:56:33.896 INFO:teuthology.orchestra.run.smithi008.stdout: "client_addr": "172.21.15.6:0/1709472247", 2023-08-01T19:56:33.896 INFO:teuthology.orchestra.run.smithi008.stdout: "tid": 265756 2023-08-01T19:56:33.896 INFO:teuthology.orchestra.run.smithi008.stdout: }, 2023-08-01T19:56:33.896 INFO:teuthology.orchestra.run.smithi008.stdout: "events": [ 2023-08-01T19:56:33.897 INFO:teuthology.orchestra.run.smithi008.stdout: { 2023-08-01T19:56:33.897 INFO:teuthology.orchestra.run.smithi008.stdout: "event": "initiated", 2023-08-01T19:56:33.897 INFO:teuthology.orchestra.run.smithi008.stdout: "time": "2023-08-01T19:56:33.792028+0000", 2023-08-01T19:56:33.897 INFO:teuthology.orchestra.run.smithi008.stdout: "duration": 0 2023-08-01T19:56:33.897 INFO:teuthology.orchestra.run.smithi008.stdout: }, 2023-08-01T19:56:33.897 INFO:teuthology.orchestra.run.smithi008.stdout: { 2023-08-01T19:56:33.897 INFO:teuthology.orchestra.run.smithi008.stdout: "event": "throttled", 2023-08-01T19:56:33.897 INFO:teuthology.orchestra.run.smithi008.stdout: "time": "2023-08-01T19:56:33.792028+0000", 2023-08-01T19:56:33.898 INFO:teuthology.orchestra.run.smithi008.stdout: "duration": 0 2023-08-01T19:56:33.898 INFO:teuthology.orchestra.run.smithi008.stdout: }, 2023-08-01T19:56:33.898 INFO:teuthology.orchestra.run.smithi008.stdout: { 2023-08-01T19:56:33.898 INFO:teuthology.orchestra.run.smithi008.stdout: "event": "header_read", 2023-08-01T19:56:33.898 INFO:teuthology.orchestra.run.smithi008.stdout: "time": "2023-08-01T19:56:33.792028+0000", 2023-08-01T19:56:33.898 INFO:teuthology.orchestra.run.smithi008.stdout: "duration": 4294967295.9999995 2023-08-01T19:56:33.898 INFO:teuthology.orchestra.run.smithi008.stdout: }, 2023-08-01T19:56:33.899 INFO:teuthology.orchestra.run.smithi008.stdout: { 2023-08-01T19:56:33.899 INFO:teuthology.orchestra.run.smithi008.stdout: "event": "all_read", 2023-08-01T19:56:33.899 INFO:teuthology.orchestra.run.smithi008.stdout: "time": "2023-08-01T19:56:33.792031+0000", 2023-08-01T19:56:33.899 INFO:teuthology.orchestra.run.smithi008.stdout: "duration": 2.9189999999999999e-06 2023-08-01T19:56:33.899 INFO:teuthology.orchestra.run.smithi008.stdout: }, 2023-08-01T19:56:33.899 INFO:teuthology.orchestra.run.smithi008.stdout: { 2023-08-01T19:56:33.899 INFO:teuthology.orchestra.run.smithi008.stdout: "event": "dispatched", 2023-08-01T19:56:33.899 INFO:teuthology.orchestra.run.smithi008.stdout: "time": "2023-08-01T19:56:33.792038+0000", 2023-08-01T19:56:33.900 INFO:teuthology.orchestra.run.smithi008.stdout: "duration": 7.0929999999999997e-06 2023-08-01T19:56:33.900 INFO:teuthology.orchestra.run.smithi008.stdout: }, 2023-08-01T19:56:33.900 INFO:teuthology.orchestra.run.smithi008.stdout: { 2023-08-01T19:56:33.900 INFO:teuthology.orchestra.run.smithi008.stdout: "event": "queued_for_pg", 2023-08-01T19:56:33.900 INFO:teuthology.orchestra.run.smithi008.stdout: "time": "2023-08-01T19:56:33.792042+0000", 2023-08-01T19:56:33.900 INFO:teuthology.orchestra.run.smithi008.stdout: "duration": 4.0629999999999999e-06 2023-08-01T19:56:33.900 INFO:teuthology.orchestra.run.smithi008.stdout: } 2023-08-01T19:56:33.900 INFO:teuthology.orchestra.run.smithi008.stdout: ] 2023-08-01T19:56:33.901 INFO:teuthology.orchestra.run.smithi008.stdout: } 2023-08-01T19:56:33.901 INFO:teuthology.orchestra.run.smithi008.stdout: }, 2023-08-01T19:56:33.901 INFO:teuthology.orchestra.run.smithi008.stdout: { 2023-08-01T19:56:33.901 INFO:teuthology.orchestra.run.smithi008.stdout: "description": "osd_op(client.4668.0:265757 5.a 5:56fa2058:::benchmark_data_smithi006_114134_object132096:head [delete] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e77)", 2023-08-01T19:56:33.901 INFO:teuthology.orchestra.run.smithi008.stdout: "initiated_at": "2023-08-01T19:56:33.792047+0000", 2023-08-01T19:56:33.901 INFO:teuthology.orchestra.run.smithi008.stdout: "age": 0.00057644100000000002, 2023-08-01T19:56:33.901 INFO:teuthology.orchestra.run.smithi008.stdout: "duration": 0.0012332440000000001, 2023-08-01T19:56:33.901 INFO:teuthology.orchestra.run.smithi008.stdout: "type_data": { 2023-08-01T19:56:33.902 INFO:teuthology.orchestra.run.smithi008.stdout: "flag_point": "waiting for sub ops", 2023-08-01T19:56:33.902 INFO:teuthology.orchestra.run.smithi008.stdout: "client_info": { 2023-08-01T19:56:33.902 INFO:teuthology.orchestra.run.smithi008.stdout: "client": "client.4668", 2023-08-01T19:56:33.902 INFO:teuthology.orchestra.run.smithi008.stdout: "client_addr": "172.21.15.6:0/1709472247", 2023-08-01T19:56:33.902 INFO:teuthology.orchestra.run.smithi008.stdout: "tid": 265757 2023-08-01T19:56:33.902 INFO:teuthology.orchestra.run.smithi008.stdout: }, 2023-08-01T19:56:33.902 INFO:teuthology.orchestra.run.smithi008.stdout: "events": [ 2023-08-01T19:56:33.903 INFO:teuthology.orchestra.run.smithi008.stdout: { 2023-08-01T19:56:33.903 INFO:teuthology.orchestra.run.smithi008.stdout: "event": "initiated", 2023-08-01T19:56:33.903 INFO:teuthology.orchestra.run.smithi008.stdout: "time": "2023-08-01T19:56:33.792047+0000", 2023-08-01T19:56:33.903 INFO:teuthology.orchestra.run.smithi008.stdout: "duration": 0 2023-08-01T19:56:33.903 INFO:teuthology.orchestra.run.smithi008.stdout: }, 2023-08-01T19:56:33.903 INFO:teuthology.orchestra.run.smithi008.stdout: { 2023-08-01T19:56:33.903 INFO:teuthology.orchestra.run.smithi008.stdout: "event": "throttled", 2023-08-01T19:56:33.903 INFO:teuthology.orchestra.run.smithi008.stdout: "time": "2023-08-01T19:56:33.792047+0000", 2023-08-01T19:56:33.904 INFO:teuthology.orchestra.run.smithi008.stdout: "duration": 0 2023-08-01T19:56:33.904 INFO:teuthology.orchestra.run.smithi008.stdout: }, 2023-08-01T19:56:33.904 INFO:teuthology.orchestra.run.smithi008.stdout: { 2023-08-01T19:56:33.904 INFO:teuthology.orchestra.run.smithi008.stdout: "event": "header_read", 2023-08-01T19:56:33.904 INFO:teuthology.orchestra.run.smithi008.stdout: "time": "2023-08-01T19:56:33.792047+0000", 2023-08-01T19:56:33.904 INFO:teuthology.orchestra.run.smithi008.stdout: "duration": 4294967295.9999995 2023-08-01T19:56:33.904 INFO:teuthology.orchestra.run.smithi008.stdout: }, 2023-08-01T19:56:33.904 INFO:teuthology.orchestra.run.smithi008.stdout: { 2023-08-01T19:56:33.905 INFO:teuthology.orchestra.run.smithi008.stdout: "event": "all_read", 2023-08-01T19:56:33.905 INFO:teuthology.orchestra.run.smithi008.stdout: "time": "2023-08-01T19:56:33.792049+0000", 2023-08-01T19:56:33.905 INFO:teuthology.orchestra.run.smithi008.stdout: "duration": 2.5679999999999998e-06 2023-08-01T19:56:33.905 INFO:teuthology.orchestra.run.smithi008.stdout: }, 2023-08-01T19:56:33.905 INFO:teuthology.orchestra.run.smithi008.stdout: { 2023-08-01T19:56:33.905 INFO:teuthology.orchestra.run.smithi008.stdout: "event": "dispatched", 2023-08-01T19:56:33.905 INFO:teuthology.orchestra.run.smithi008.stdout: "time": "2023-08-01T19:56:33.792055+0000", 2023-08-01T19:56:33.907 INFO:teuthology.orchestra.run.smithi008.stdout: "duration": 5.925e-06 2023-08-01T19:56:33.907 INFO:teuthology.orchestra.run.smithi008.stdout: }, 2023-08-01T19:56:33.908 INFO:teuthology.orchestra.run.smithi008.stdout: { 2023-08-01T19:56:33.908 INFO:teuthology.orchestra.run.smithi008.stdout: "event": "queued_for_pg", 2023-08-01T19:56:33.908 INFO:teuthology.orchestra.run.smithi008.stdout: "time": "2023-08-01T19:56:33.792059+0000", 2023-08-01T19:56:33.908 INFO:teuthology.orchestra.run.smithi008.stdout: "duration": 3.9360000000000001e-06 2023-08-01T19:56:33.908 INFO:teuthology.orchestra.run.smithi008.stdout: }, 2023-08-01T19:56:33.908 INFO:teuthology.orchestra.run.smithi008.stdout: { 2023-08-01T19:56:33.908 INFO:teuthology.orchestra.run.smithi008.stdout: "event": "reached_pg", 2023-08-01T19:56:33.909 INFO:teuthology.orchestra.run.smithi008.stdout: "time": "2023-08-01T19:56:33.792089+0000", 2023-08-01T19:56:33.909 INFO:teuthology.orchestra.run.smithi008.stdout: "duration": 2.9369e-05 2023-08-01T19:56:33.909 INFO:teuthology.orchestra.run.smithi008.stdout: }, 2023-08-01T19:56:33.909 INFO:teuthology.orchestra.run.smithi008.stdout: { 2023-08-01T19:56:33.909 INFO:teuthology.orchestra.run.smithi008.stdout: "event": "started", 2023-08-01T19:56:33.909 INFO:teuthology.orchestra.run.smithi008.stdout: "time": "2023-08-01T19:56:33.792193+0000", 2023-08-01T19:56:33.909 INFO:teuthology.orchestra.run.smithi008.stdout: "duration": 0.000104759 2023-08-01T19:56:33.910 INFO:teuthology.orchestra.run.smithi008.stdout: }, 2023-08-01T19:56:33.910 INFO:teuthology.orchestra.run.smithi008.stdout: { 2023-08-01T19:56:33.910 INFO:teuthology.orchestra.run.smithi008.stdout: "event": "waiting for subops from 2", 2023-08-01T19:56:33.910 INFO:teuthology.orchestra.run.smithi008.stdout: "time": "2023-08-01T19:56:33.792303+0000", 2023-08-01T19:56:33.910 INFO:teuthology.orchestra.run.smithi008.stdout: "duration": 0.000109168 2023-08-01T19:56:33.910 INFO:teuthology.orchestra.run.smithi008.stdout: } 2023-08-01T19:56:33.910 INFO:teuthology.orchestra.run.smithi008.stdout: ] 2023-08-01T19:56:33.910 INFO:teuthology.orchestra.run.smithi008.stdout: } 2023-08-01T19:56:33.911 INFO:teuthology.orchestra.run.smithi008.stdout: }, 2023-08-01T19:56:33.911 INFO:teuthology.orchestra.run.smithi008.stdout: { 2023-08-01T19:56:33.911 INFO:teuthology.orchestra.run.smithi008.stdout: "description": "osd_repop_reply(client.4668.0:265752 5.b e77/72)", 2023-08-01T19:56:33.911 INFO:teuthology.orchestra.run.smithi008.stdout: "initiated_at": "2023-08-01T19:56:33.792915+0000", 2023-08-01T19:56:33.911 INFO:teuthology.orchestra.run.smithi008.stdout: "age": 4294967295.9997087, 2023-08-01T19:56:33.911 INFO:teuthology.orchestra.run.smithi008.stdout: "duration": 0.000406272, 2023-08-01T19:56:33.911 INFO:teuthology.orchestra.run.smithi008.stdout: "type_data": { 2023-08-01T19:56:33.911 INFO:teuthology.orchestra.run.smithi008.stdout: "flag_point": "queued for pg", 2023-08-01T19:56:33.912 INFO:teuthology.orchestra.run.smithi008.stdout: "events": [ 2023-08-01T19:56:33.912 INFO:teuthology.orchestra.run.smithi008.stdout: { 2023-08-01T19:56:33.912 INFO:teuthology.orchestra.run.smithi008.stdout: "event": "initiated", 2023-08-01T19:56:33.912 INFO:teuthology.orchestra.run.smithi008.stdout: "time": "2023-08-01T19:56:33.792915+0000", 2023-08-01T19:56:33.912 INFO:teuthology.orchestra.run.smithi008.stdout: "duration": 0 2023-08-01T19:56:33.912 INFO:teuthology.orchestra.run.smithi008.stdout: }, 2023-08-01T19:56:33.912 INFO:teuthology.orchestra.run.smithi008.stdout: { 2023-08-01T19:56:33.912 INFO:teuthology.orchestra.run.smithi008.stdout: "event": "throttled", 2023-08-01T19:56:33.913 INFO:teuthology.orchestra.run.smithi008.stdout: "time": "2023-08-01T19:56:33.792915+0000", 2023-08-01T19:56:33.913 INFO:teuthology.orchestra.run.smithi008.stdout: "duration": 0 2023-08-01T19:56:33.913 INFO:teuthology.orchestra.run.smithi008.stdout: }, 2023-08-01T19:56:33.913 INFO:teuthology.orchestra.run.smithi008.stdout: { 2023-08-01T19:56:33.913 INFO:teuthology.orchestra.run.smithi008.stdout: "event": "header_read", 2023-08-01T19:56:33.913 INFO:teuthology.orchestra.run.smithi008.stdout: "time": "2023-08-01T19:56:33.792915+0000", 2023-08-01T19:56:33.913 INFO:teuthology.orchestra.run.smithi008.stdout: "duration": 4294967295.9999995 2023-08-01T19:56:33.914 INFO:teuthology.orchestra.run.smithi008.stdout: }, 2023-08-01T19:56:33.914 INFO:teuthology.orchestra.run.smithi008.stdout: { 2023-08-01T19:56:33.914 INFO:teuthology.orchestra.run.smithi008.stdout: "event": "all_read", 2023-08-01T19:56:33.914 INFO:teuthology.orchestra.run.smithi008.stdout: "time": "2023-08-01T19:56:33.792917+0000", 2023-08-01T19:56:33.914 INFO:teuthology.orchestra.run.smithi008.stdout: "duration": 2.4729999999999999e-06 2023-08-01T19:56:33.914 INFO:teuthology.orchestra.run.smithi008.stdout: }, 2023-08-01T19:56:33.914 INFO:teuthology.orchestra.run.smithi008.stdout: { 2023-08-01T19:56:33.914 INFO:teuthology.orchestra.run.smithi008.stdout: "event": "dispatched", 2023-08-01T19:56:33.915 INFO:teuthology.orchestra.run.smithi008.stdout: "time": "2023-08-01T19:56:33.792924+0000", 2023-08-01T19:56:33.915 INFO:teuthology.orchestra.run.smithi008.stdout: "duration": 6.6189999999999996e-06 2023-08-01T19:56:33.915 INFO:teuthology.orchestra.run.smithi008.stdout: }, 2023-08-01T19:56:33.915 INFO:teuthology.orchestra.run.smithi008.stdout: { 2023-08-01T19:56:33.915 INFO:teuthology.orchestra.run.smithi008.stdout: "event": "queued_for_pg", 2023-08-01T19:56:33.915 INFO:teuthology.orchestra.run.smithi008.stdout: "time": "2023-08-01T19:56:33.792928+0000", 2023-08-01T19:56:33.915 INFO:teuthology.orchestra.run.smithi008.stdout: "duration": 4.1710000000000004e-06 2023-08-01T19:56:33.915 INFO:teuthology.orchestra.run.smithi008.stdout: } 2023-08-01T19:56:33.916 INFO:teuthology.orchestra.run.smithi008.stdout: ] 2023-08-01T19:56:33.916 INFO:teuthology.orchestra.run.smithi008.stdout: } 2023-08-01T19:56:33.916 INFO:teuthology.orchestra.run.smithi008.stdout: } 2023-08-01T19:56:33.916 INFO:teuthology.orchestra.run.smithi008.stdout: ], 2023-08-01T19:56:33.916 INFO:teuthology.orchestra.run.smithi008.stdout: "num_ops": 16 2023-08-01T19:56:33.916 INFO:teuthology.orchestra.run.smithi008.stdout:} 2023-08-01T19:56:33.918 DEBUG:teuthology.orchestra.run.smithi008:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 30 ceph --cluster ceph --admin-daemon /var/run/ceph/ceph-osd.0.asok dump_blocked_ops 2023-08-01T19:56:33.918 INFO:tasks.ceph.osd.2.smithi155.stderr:2023-08-01T19:56:33.916+0000 7faa5c6ac700 -1 received signal: Hangup from /usr/bin/python3 /bin/daemon-helper kill ceph-osd -f --cluster ceph -i 2 (PID: 111337) UID: 0 2023-08-01T19:56:34.018 INFO:tasks.ceph.osd.0.smithi008.stderr:2023-08-01T19:56:34.017+0000 7f16a58f4700 -1 received signal: Hangup from /usr/bin/python3 /bin/daemon-helper kill ceph-osd -f --cluster ceph -i 0 (PID: 111179) UID: 0 2023-08-01T19:56:34.100 INFO:teuthology.orchestra.run.smithi008.stdout:{ 2023-08-01T19:56:34.100 INFO:teuthology.orchestra.run.smithi008.stdout: "ops": [], 2023-08-01T19:56:34.100 INFO:teuthology.orchestra.run.smithi008.stdout: "complaint_time": 30, 2023-08-01T19:56:34.100 INFO:teuthology.orchestra.run.smithi008.stdout: "num_blocked_ops": 0 2023-08-01T19:56:34.101 INFO:teuthology.orchestra.run.smithi008.stdout:} 2023-08-01T19:56:34.116 DEBUG:teuthology.orchestra.run.smithi008:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 30 ceph --cluster ceph --admin-daemon /var/run/ceph/ceph-osd.0.asok dump_historic_ops 2023-08-01T19:56:34.156 INFO:tasks.ceph.osd.0.smithi008.stderr:2023-08-01T19:56:34.156+0000 7f16a58f4700 -1 received signal: Hangup from /usr/bin/python3 /bin/daemon-helper kill ceph-osd -f --cluster ceph -i 0 (PID: 111179) UID: 0 2023-08-01T19:56:34.219 INFO:tasks.ceph.osd.2.smithi155.stderr:2023-08-01T19:56:34.218+0000 7faa5c6ac700 -1 received signal: Hangup from /usr/bin/python3 /bin/daemon-helper kill ceph-osd -f --cluster ceph -i 2 (PID: 111337) UID: 0 2023-08-01T19:56:34.320 INFO:tasks.ceph.osd.0.smithi008.stderr:2023-08-01T19:56:34.319+0000 7f16a58f4700 -1 received signal: Hangup from /usr/bin/python3 /bin/daemon-helper kill ceph-osd -f --cluster ceph -i 0 (PID: 111179) UID: 0 2023-08-01T19:56:34.344 INFO:teuthology.orchestra.run.smithi008.stdout:{ 2023-08-01T19:56:34.345 INFO:teuthology.orchestra.run.smithi008.stdout: "size": 20, 2023-08-01T19:56:34.345 INFO:teuthology.orchestra.run.smithi008.stdout: "duration": 600, 2023-08-01T19:56:34.345 INFO:teuthology.orchestra.run.smithi008.stdout: "ops": [ 2023-08-01T19:56:34.345 INFO:teuthology.orchestra.run.smithi008.stdout: { 2023-08-01T19:56:34.345 INFO:teuthology.orchestra.run.smithi008.stdout: "description": "osd_op(client.4668.0:100240 5.a 5:5313c5b9:::benchmark_data_smithi006_114134_object100239:head [set-alloc-hint object_size 65536 write_size 65536,write 0~65536] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e37)", 2023-08-01T19:56:34.345 INFO:teuthology.orchestra.run.smithi008.stdout: "initiated_at": "2023-08-01T19:55:05.148399+0000", 2023-08-01T19:56:34.346 INFO:teuthology.orchestra.run.smithi008.stdout: "age": 89.192782320000006, 2023-08-01T19:56:34.346 INFO:teuthology.orchestra.run.smithi008.stdout: "duration": 0.077278904999999995, 2023-08-01T19:56:34.346 INFO:teuthology.orchestra.run.smithi008.stdout: "type_data": { 2023-08-01T19:56:34.346 INFO:teuthology.orchestra.run.smithi008.stdout: "flag_point": "commit sent; apply or cleanup", 2023-08-01T19:56:34.346 INFO:teuthology.orchestra.run.smithi008.stdout: "client_info": { 2023-08-01T19:56:34.346 INFO:teuthology.orchestra.run.smithi008.stdout: "client": "client.4668", 2023-08-01T19:56:34.347 INFO:teuthology.orchestra.run.smithi008.stdout: "client_addr": "172.21.15.6:0/1709472247", 2023-08-01T19:56:34.347 INFO:teuthology.orchestra.run.smithi008.stdout: "tid": 100240 2023-08-01T19:56:34.347 INFO:teuthology.orchestra.run.smithi008.stdout: }, 2023-08-01T19:56:34.347 INFO:teuthology.orchestra.run.smithi008.stdout: "events": [ 2023-08-01T19:56:34.347 INFO:teuthology.orchestra.run.smithi008.stdout: { 2023-08-01T19:56:34.347 INFO:teuthology.orchestra.run.smithi008.stdout: "event": "initiated", 2023-08-01T19:56:34.347 INFO:teuthology.orchestra.run.smithi008.stdout: "time": "2023-08-01T19:55:05.148399+0000", 2023-08-01T19:56:34.347 INFO:teuthology.orchestra.run.smithi008.stdout: "duration": 0 2023-08-01T19:56:34.348 INFO:teuthology.orchestra.run.smithi008.stdout: }, 2023-08-01T19:56:34.348 INFO:teuthology.orchestra.run.smithi008.stdout: { 2023-08-01T19:56:34.348 INFO:teuthology.orchestra.run.smithi008.stdout: "event": "throttled", 2023-08-01T19:56:34.348 INFO:teuthology.orchestra.run.smithi008.stdout: "time": "2023-08-01T19:55:05.148399+0000", 2023-08-01T19:56:34.348 INFO:teuthology.orchestra.run.smithi008.stdout: "duration": 0 2023-08-01T19:56:34.348 INFO:teuthology.orchestra.run.smithi008.stdout: }, 2023-08-01T19:56:34.348 INFO:teuthology.orchestra.run.smithi008.stdout: { 2023-08-01T19:56:34.349 INFO:teuthology.orchestra.run.smithi008.stdout: "event": "header_read", 2023-08-01T19:56:34.349 INFO:teuthology.orchestra.run.smithi008.stdout: "time": "2023-08-01T19:55:05.148398+0000", 2023-08-01T19:56:34.349 INFO:teuthology.orchestra.run.smithi008.stdout: "duration": 4294967295.999999 2023-08-01T19:56:34.349 INFO:teuthology.orchestra.run.smithi008.stdout: }, 2023-08-01T19:56:34.349 INFO:teuthology.orchestra.run.smithi008.stdout: { 2023-08-01T19:56:34.349 INFO:teuthology.orchestra.run.smithi008.stdout: "event": "all_read", 2023-08-01T19:56:34.349 INFO:teuthology.orchestra.run.smithi008.stdout: "time": "2023-08-01T19:55:05.148492+0000", 2023-08-01T19:56:34.349 INFO:teuthology.orchestra.run.smithi008.stdout: "duration": 9.3892000000000002e-05 2023-08-01T19:56:34.350 INFO:teuthology.orchestra.run.smithi008.stdout: }, 2023-08-01T19:56:34.350 INFO:teuthology.orchestra.run.smithi008.stdout: { 2023-08-01T19:56:34.350 INFO:teuthology.orchestra.run.smithi008.stdout: "event": "dispatched", 2023-08-01T19:56:34.350 INFO:teuthology.orchestra.run.smithi008.stdout: "time": "2023-08-01T19:55:05.148503+0000", 2023-08-01T19:56:34.350 INFO:teuthology.orchestra.run.smithi008.stdout: "duration": 1.0951000000000001e-05 2023-08-01T19:56:34.350 INFO:teuthology.orchestra.run.smithi008.stdout: }, 2023-08-01T19:56:34.350 INFO:teuthology.orchestra.run.smithi008.stdout: { 2023-08-01T19:56:34.351 INFO:teuthology.orchestra.run.smithi008.stdout: "event": "queued_for_pg", 2023-08-01T19:56:34.351 INFO:teuthology.orchestra.run.smithi008.stdout: "time": "2023-08-01T19:55:05.148508+0000", 2023-08-01T19:56:34.351 INFO:teuthology.orchestra.run.smithi008.stdout: "duration": 5.0080000000000002e-06 2023-08-01T19:56:34.351 INFO:teuthology.orchestra.run.smithi008.stdout: }, 2023-08-01T19:56:34.351 INFO:teuthology.orchestra.run.smithi008.stdout: { 2023-08-01T19:56:34.351 INFO:teuthology.orchestra.run.smithi008.stdout: "event": "reached_pg", 2023-08-01T19:56:34.351 INFO:teuthology.orchestra.run.smithi008.stdout: "time": "2023-08-01T19:55:05.148548+0000", 2023-08-01T19:56:34.351 INFO:teuthology.orchestra.run.smithi008.stdout: "duration": 4.0358999999999998e-05 2023-08-01T19:56:34.352 INFO:teuthology.orchestra.run.smithi008.stdout: }, 2023-08-01T19:56:34.352 INFO:teuthology.orchestra.run.smithi008.stdout: { 2023-08-01T19:56:34.352 INFO:teuthology.orchestra.run.smithi008.stdout: "event": "started", 2023-08-01T19:56:34.352 INFO:teuthology.orchestra.run.smithi008.stdout: "time": "2023-08-01T19:55:05.148666+0000", 2023-08-01T19:56:34.352 INFO:teuthology.orchestra.run.smithi008.stdout: "duration": 0.000117621 2023-08-01T19:56:34.352 INFO:teuthology.orchestra.run.smithi008.stdout: }, 2023-08-01T19:56:34.352 INFO:teuthology.orchestra.run.smithi008.stdout: { 2023-08-01T19:56:34.353 INFO:teuthology.orchestra.run.smithi008.stdout: "event": "waiting for subops from 2", 2023-08-01T19:56:34.353 INFO:teuthology.orchestra.run.smithi008.stdout: "time": "2023-08-01T19:55:05.148805+0000", 2023-08-01T19:56:34.353 INFO:teuthology.orchestra.run.smithi008.stdout: "duration": 0.000139176 2023-08-01T19:56:34.353 INFO:teuthology.orchestra.run.smithi008.stdout: }, 2023-08-01T19:56:34.353 INFO:teuthology.orchestra.run.smithi008.stdout: { 2023-08-01T19:56:34.353 INFO:teuthology.orchestra.run.smithi008.stdout: "event": "op_commit", 2023-08-01T19:56:34.353 INFO:teuthology.orchestra.run.smithi008.stdout: "time": "2023-08-01T19:55:05.156143+0000", 2023-08-01T19:56:34.353 INFO:teuthology.orchestra.run.smithi008.stdout: "duration": 0.007338041 2023-08-01T19:56:34.354 INFO:teuthology.orchestra.run.smithi008.stdout: }, 2023-08-01T19:56:34.354 INFO:teuthology.orchestra.run.smithi008.stdout: { 2023-08-01T19:56:34.354 INFO:teuthology.orchestra.run.smithi008.stdout: "event": "sub_op_commit_rec", 2023-08-01T19:56:34.354 INFO:teuthology.orchestra.run.smithi008.stdout: "time": "2023-08-01T19:55:05.225581+0000", 2023-08-01T19:56:34.354 INFO:teuthology.orchestra.run.smithi008.stdout: "duration": 0.069438402999999996 2023-08-01T19:56:34.354 INFO:teuthology.orchestra.run.smithi008.stdout: }, 2023-08-01T19:56:34.354 INFO:teuthology.orchestra.run.smithi008.stdout: { 2023-08-01T19:56:34.355 INFO:teuthology.orchestra.run.smithi008.stdout: "event": "commit_sent", 2023-08-01T19:56:34.355 INFO:teuthology.orchestra.run.smithi008.stdout: "time": "2023-08-01T19:55:05.225632+0000", 2023-08-01T19:56:34.355 INFO:teuthology.orchestra.run.smithi008.stdout: "duration": 5.0382e-05 2023-08-01T19:56:34.355 INFO:teuthology.orchestra.run.smithi008.stdout: }, 2023-08-01T19:56:34.355 INFO:teuthology.orchestra.run.smithi008.stdout: { 2023-08-01T19:56:34.355 INFO:teuthology.orchestra.run.smithi008.stdout: "event": "done", 2023-08-01T19:56:34.355 INFO:teuthology.orchestra.run.smithi008.stdout: "time": "2023-08-01T19:55:05.225677+0000", 2023-08-01T19:56:34.356 INFO:teuthology.orchestra.run.smithi008.stdout: "duration": 4.5893000000000003e-05 2023-08-01T19:56:34.356 INFO:teuthology.orchestra.run.smithi008.stdout: } 2023-08-01T19:56:34.356 INFO:teuthology.orchestra.run.smithi008.stdout: ] 2023-08-01T19:56:34.356 INFO:teuthology.orchestra.run.smithi008.stdout: } 2023-08-01T19:56:34.356 INFO:teuthology.orchestra.run.smithi008.stdout: }, 2023-08-01T19:56:34.356 INFO:teuthology.orchestra.run.smithi008.stdout: { 2023-08-01T19:56:34.356 INFO:teuthology.orchestra.run.smithi008.stdout: "description": "osd_op(client.4668.0:100243 5.a 5:5e8193b6:::benchmark_data_smithi006_114134_object100242:head [set-alloc-hint object_size 65536 write_size 65536,write 0~65536] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e37)", 2023-08-01T19:56:34.357 INFO:teuthology.orchestra.run.smithi008.stdout: "initiated_at": "2023-08-01T19:55:05.150737+0000", 2023-08-01T19:56:34.357 INFO:teuthology.orchestra.run.smithi008.stdout: "age": 89.190443865000006, 2023-08-01T19:56:34.357 INFO:teuthology.orchestra.run.smithi008.stdout: "duration": 0.075019885999999994, 2023-08-01T19:56:34.357 INFO:teuthology.orchestra.run.smithi008.stdout: "type_data": { 2023-08-01T19:56:34.357 INFO:teuthology.orchestra.run.smithi008.stdout: "flag_point": "commit sent; apply or cleanup", 2023-08-01T19:56:34.357 INFO:teuthology.orchestra.run.smithi008.stdout: "client_info": { 2023-08-01T19:56:34.357 INFO:teuthology.orchestra.run.smithi008.stdout: "client": "client.4668", 2023-08-01T19:56:34.358 INFO:teuthology.orchestra.run.smithi008.stdout: "client_addr": "172.21.15.6:0/1709472247", 2023-08-01T19:56:34.358 INFO:teuthology.orchestra.run.smithi008.stdout: "tid": 100243 2023-08-01T19:56:34.358 INFO:teuthology.orchestra.run.smithi008.stdout: }, 2023-08-01T19:56:34.358 INFO:teuthology.orchestra.run.smithi008.stdout: "events": [ 2023-08-01T19:56:34.358 INFO:teuthology.orchestra.run.smithi008.stdout: { 2023-08-01T19:56:34.358 INFO:teuthology.orchestra.run.smithi008.stdout: "event": "initiated", 2023-08-01T19:56:34.358 INFO:teuthology.orchestra.run.smithi008.stdout: "time": "2023-08-01T19:55:05.150737+0000", 2023-08-01T19:56:34.359 INFO:teuthology.orchestra.run.smithi008.stdout: "duration": 0 2023-08-01T19:56:34.359 INFO:teuthology.orchestra.run.smithi008.stdout: }, 2023-08-01T19:56:34.359 INFO:teuthology.orchestra.run.smithi008.stdout: { 2023-08-01T19:56:34.359 INFO:teuthology.orchestra.run.smithi008.stdout: "event": "throttled", 2023-08-01T19:56:34.360 INFO:teuthology.orchestra.run.smithi008.stdout: "time": "2023-08-01T19:55:05.150737+0000", 2023-08-01T19:56:34.360 INFO:teuthology.orchestra.run.smithi008.stdout: "duration": 0 2023-08-01T19:56:34.360 INFO:teuthology.orchestra.run.smithi008.stdout: }, 2023-08-01T19:56:34.361 INFO:teuthology.orchestra.run.smithi008.stdout: { 2023-08-01T19:56:34.361 INFO:teuthology.orchestra.run.smithi008.stdout: "event": "header_read", 2023-08-01T19:56:34.361 INFO:teuthology.orchestra.run.smithi008.stdout: "time": "2023-08-01T19:55:05.150736+0000", 2023-08-01T19:56:34.361 INFO:teuthology.orchestra.run.smithi008.stdout: "duration": 4294967295.999999 2023-08-01T19:56:34.361 INFO:teuthology.orchestra.run.smithi008.stdout: }, 2023-08-01T19:56:34.361 INFO:teuthology.orchestra.run.smithi008.stdout: { 2023-08-01T19:56:34.361 INFO:teuthology.orchestra.run.smithi008.stdout: "event": "all_read", 2023-08-01T19:56:34.362 INFO:teuthology.orchestra.run.smithi008.stdout: "time": "2023-08-01T19:55:05.150780+0000", 2023-08-01T19:56:34.362 INFO:teuthology.orchestra.run.smithi008.stdout: "duration": 4.3578999999999997e-05 2023-08-01T19:56:34.362 INFO:teuthology.orchestra.run.smithi008.stdout: }, 2023-08-01T19:56:34.362 INFO:teuthology.orchestra.run.smithi008.stdout: { 2023-08-01T19:56:34.362 INFO:teuthology.orchestra.run.smithi008.stdout: "event": "dispatched", 2023-08-01T19:56:34.362 INFO:teuthology.orchestra.run.smithi008.stdout: "time": "2023-08-01T19:55:05.150791+0000", 2023-08-01T19:56:34.362 INFO:teuthology.orchestra.run.smithi008.stdout: "duration": 1.0963e-05 2023-08-01T19:56:34.362 INFO:teuthology.orchestra.run.smithi008.stdout: }, 2023-08-01T19:56:34.363 INFO:teuthology.orchestra.run.smithi008.stdout: { 2023-08-01T19:56:34.363 INFO:teuthology.orchestra.run.smithi008.stdout: "event": "queued_for_pg", 2023-08-01T19:56:34.363 INFO:teuthology.orchestra.run.smithi008.stdout: "time": "2023-08-01T19:55:05.150797+0000", 2023-08-01T19:56:34.363 INFO:teuthology.orchestra.run.smithi008.stdout: "duration": 5.9780000000000002e-06 2023-08-01T19:56:34.363 INFO:teuthology.orchestra.run.smithi008.stdout: }, 2023-08-01T19:56:34.363 INFO:teuthology.orchestra.run.smithi008.stdout: { 2023-08-01T19:56:34.363 INFO:teuthology.orchestra.run.smithi008.stdout: "event": "reached_pg", 2023-08-01T19:56:34.364 INFO:teuthology.orchestra.run.smithi008.stdout: "time": "2023-08-01T19:55:05.150833+0000", 2023-08-01T19:56:34.364 INFO:teuthology.orchestra.run.smithi008.stdout: "duration": 3.6000000000000001e-05 2023-08-01T19:56:34.364 INFO:teuthology.orchestra.run.smithi008.stdout: }, 2023-08-01T19:56:34.364 INFO:teuthology.orchestra.run.smithi008.stdout: { 2023-08-01T19:56:34.364 INFO:teuthology.orchestra.run.smithi008.stdout: "event": "started", 2023-08-01T19:56:34.364 INFO:teuthology.orchestra.run.smithi008.stdout: "time": "2023-08-01T19:55:05.150951+0000", 2023-08-01T19:56:34.365 INFO:teuthology.orchestra.run.smithi008.stdout: "duration": 0.00011827799999999999 2023-08-01T19:56:34.365 INFO:teuthology.orchestra.run.smithi008.stdout: }, 2023-08-01T19:56:34.365 INFO:teuthology.orchestra.run.smithi008.stdout: { 2023-08-01T19:56:34.365 INFO:teuthology.orchestra.run.smithi008.stdout: "event": "waiting for subops from 2", 2023-08-01T19:56:34.365 INFO:teuthology.orchestra.run.smithi008.stdout: "time": "2023-08-01T19:55:05.151111+0000", 2023-08-01T19:56:34.365 INFO:teuthology.orchestra.run.smithi008.stdout: "duration": 0.00015961299999999999 2023-08-01T19:56:34.366 INFO:teuthology.orchestra.run.smithi008.stdout: }, 2023-08-01T19:56:34.366 INFO:teuthology.orchestra.run.smithi008.stdout: { 2023-08-01T19:56:34.366 INFO:teuthology.orchestra.run.smithi008.stdout: "event": "op_commit", 2023-08-01T19:56:34.366 INFO:teuthology.orchestra.run.smithi008.stdout: "time": "2023-08-01T19:55:05.156247+0000", 2023-08-01T19:56:34.366 INFO:teuthology.orchestra.run.smithi008.stdout: "duration": 0.005136524 2023-08-01T19:56:34.366 INFO:teuthology.orchestra.run.smithi008.stdout: }, 2023-08-01T19:56:34.366 INFO:teuthology.orchestra.run.smithi008.stdout: { 2023-08-01T19:56:34.367 INFO:teuthology.orchestra.run.smithi008.stdout: "event": "sub_op_commit_rec", 2023-08-01T19:56:34.367 INFO:teuthology.orchestra.run.smithi008.stdout: "time": "2023-08-01T19:55:05.225705+0000", 2023-08-01T19:56:34.367 INFO:teuthology.orchestra.run.smithi008.stdout: "duration": 0.069458377000000002 2023-08-01T19:56:34.367 INFO:teuthology.orchestra.run.smithi008.stdout: }, 2023-08-01T19:56:34.367 INFO:teuthology.orchestra.run.smithi008.stdout: { 2023-08-01T19:56:34.367 INFO:teuthology.orchestra.run.smithi008.stdout: "event": "commit_sent", 2023-08-01T19:56:34.367 INFO:teuthology.orchestra.run.smithi008.stdout: "time": "2023-08-01T19:55:05.225736+0000", 2023-08-01T19:56:34.367 INFO:teuthology.orchestra.run.smithi008.stdout: "duration": 3.0388000000000001e-05 2023-08-01T19:56:34.368 INFO:teuthology.orchestra.run.smithi008.stdout: }, 2023-08-01T19:56:34.368 INFO:teuthology.orchestra.run.smithi008.stdout: { 2023-08-01T19:56:34.368 INFO:teuthology.orchestra.run.smithi008.stdout: "event": "done", 2023-08-01T19:56:34.368 INFO:teuthology.orchestra.run.smithi008.stdout: "time": "2023-08-01T19:55:05.225757+0000", 2023-08-01T19:56:34.368 INFO:teuthology.orchestra.run.smithi008.stdout: "duration": 2.1090999999999998e-05 2023-08-01T19:56:34.368 INFO:teuthology.orchestra.run.smithi008.stdout: } 2023-08-01T19:56:34.368 INFO:teuthology.orchestra.run.smithi008.stdout: ] 2023-08-01T19:56:34.368 INFO:teuthology.orchestra.run.smithi008.stdout: } 2023-08-01T19:56:34.369 INFO:teuthology.orchestra.run.smithi008.stdout: }, 2023-08-01T19:56:34.369 INFO:teuthology.orchestra.run.smithi008.stdout: { 2023-08-01T19:56:34.369 INFO:teuthology.orchestra.run.smithi008.stdout: "description": "osd_op(client.4668.0:100933 5.5 5:af92e9f2:::benchmark_data_smithi006_114134_object100932:head [set-alloc-hint object_size 65536 write_size 65536,write 0~65536] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e37)", 2023-08-01T19:56:34.369 INFO:teuthology.orchestra.run.smithi008.stdout: "initiated_at": "2023-08-01T19:55:05.566634+0000", 2023-08-01T19:56:34.369 INFO:teuthology.orchestra.run.smithi008.stdout: "age": 88.774546994000005, 2023-08-01T19:56:34.369 INFO:teuthology.orchestra.run.smithi008.stdout: "duration": 0.065909364999999998, 2023-08-01T19:56:34.369 INFO:teuthology.orchestra.run.smithi008.stdout: "type_data": { 2023-08-01T19:56:34.369 INFO:teuthology.orchestra.run.smithi008.stdout: "flag_point": "commit sent; apply or cleanup", 2023-08-01T19:56:34.370 INFO:teuthology.orchestra.run.smithi008.stdout: "client_info": { 2023-08-01T19:56:34.370 INFO:teuthology.orchestra.run.smithi008.stdout: "client": "client.4668", 2023-08-01T19:56:34.370 INFO:teuthology.orchestra.run.smithi008.stdout: "client_addr": "172.21.15.6:0/1709472247", 2023-08-01T19:56:34.370 INFO:teuthology.orchestra.run.smithi008.stdout: "tid": 100933 2023-08-01T19:56:34.370 INFO:teuthology.orchestra.run.smithi008.stdout: }, 2023-08-01T19:56:34.370 INFO:teuthology.orchestra.run.smithi008.stdout: "events": [ 2023-08-01T19:56:34.370 INFO:teuthology.orchestra.run.smithi008.stdout: { 2023-08-01T19:56:34.371 INFO:teuthology.orchestra.run.smithi008.stdout: "event": "initiated", 2023-08-01T19:56:34.371 INFO:teuthology.orchestra.run.smithi008.stdout: "time": "2023-08-01T19:55:05.566634+0000", 2023-08-01T19:56:34.371 INFO:teuthology.orchestra.run.smithi008.stdout: "duration": 0 2023-08-01T19:56:34.371 INFO:teuthology.orchestra.run.smithi008.stdout: }, 2023-08-01T19:56:34.371 INFO:teuthology.orchestra.run.smithi008.stdout: { 2023-08-01T19:56:34.371 INFO:teuthology.orchestra.run.smithi008.stdout: "event": "throttled", 2023-08-01T19:56:34.372 INFO:teuthology.orchestra.run.smithi008.stdout: "time": "2023-08-01T19:55:05.566634+0000", 2023-08-01T19:56:34.372 INFO:teuthology.orchestra.run.smithi008.stdout: "duration": 0 2023-08-01T19:56:34.372 INFO:teuthology.orchestra.run.smithi008.stdout: }, 2023-08-01T19:56:34.372 INFO:teuthology.orchestra.run.smithi008.stdout: { 2023-08-01T19:56:34.372 INFO:teuthology.orchestra.run.smithi008.stdout: "event": "header_read", 2023-08-01T19:56:34.372 INFO:teuthology.orchestra.run.smithi008.stdout: "time": "2023-08-01T19:55:05.566630+0000", 2023-08-01T19:56:34.372 INFO:teuthology.orchestra.run.smithi008.stdout: "duration": 4294967295.9999962 2023-08-01T19:56:34.373 INFO:teuthology.orchestra.run.smithi008.stdout: }, 2023-08-01T19:56:34.373 INFO:teuthology.orchestra.run.smithi008.stdout: { 2023-08-01T19:56:34.373 INFO:teuthology.orchestra.run.smithi008.stdout: "event": "all_read", 2023-08-01T19:56:34.373 INFO:teuthology.orchestra.run.smithi008.stdout: "time": "2023-08-01T19:55:05.566736+0000", 2023-08-01T19:56:34.373 INFO:teuthology.orchestra.run.smithi008.stdout: "duration": 0.000105752 2023-08-01T19:56:34.373 INFO:teuthology.orchestra.run.smithi008.stdout: }, 2023-08-01T19:56:34.374 INFO:teuthology.orchestra.run.smithi008.stdout: { 2023-08-01T19:56:34.374 INFO:teuthology.orchestra.run.smithi008.stdout: "event": "dispatched", 2023-08-01T19:56:34.374 INFO:teuthology.orchestra.run.smithi008.stdout: "time": "2023-08-01T19:55:05.566742+0000", 2023-08-01T19:56:34.374 INFO:teuthology.orchestra.run.smithi008.stdout: "duration": 5.8209999999999998e-06 2023-08-01T19:56:34.374 INFO:teuthology.orchestra.run.smithi008.stdout: }, 2023-08-01T19:56:34.374 INFO:teuthology.orchestra.run.smithi008.stdout: { 2023-08-01T19:56:34.374 INFO:teuthology.orchestra.run.smithi008.stdout: "event": "queued_for_pg", 2023-08-01T19:56:34.375 INFO:teuthology.orchestra.run.smithi008.stdout: "time": "2023-08-01T19:55:05.566745+0000", 2023-08-01T19:56:34.375 INFO:teuthology.orchestra.run.smithi008.stdout: "duration": 3.337e-06 2023-08-01T19:56:34.375 INFO:teuthology.orchestra.run.smithi008.stdout: }, 2023-08-01T19:56:34.375 INFO:teuthology.orchestra.run.smithi008.stdout: { 2023-08-01T19:56:34.375 INFO:teuthology.orchestra.run.smithi008.stdout: "event": "reached_pg", 2023-08-01T19:56:34.375 INFO:teuthology.orchestra.run.smithi008.stdout: "time": "2023-08-01T19:55:05.568175+0000", 2023-08-01T19:56:34.375 INFO:teuthology.orchestra.run.smithi008.stdout: "duration": 0.001429647 2023-08-01T19:56:34.376 INFO:teuthology.orchestra.run.smithi008.stdout: }, 2023-08-01T19:56:34.376 INFO:teuthology.orchestra.run.smithi008.stdout: { 2023-08-01T19:56:34.376 INFO:teuthology.orchestra.run.smithi008.stdout: "event": "started", 2023-08-01T19:56:34.376 INFO:teuthology.orchestra.run.smithi008.stdout: "time": "2023-08-01T19:55:05.568288+0000", 2023-08-01T19:56:34.376 INFO:teuthology.orchestra.run.smithi008.stdout: "duration": 0.000113353 2023-08-01T19:56:34.376 INFO:teuthology.orchestra.run.smithi008.stdout: }, 2023-08-01T19:56:34.376 INFO:teuthology.orchestra.run.smithi008.stdout: { 2023-08-01T19:56:34.376 INFO:teuthology.orchestra.run.smithi008.stdout: "event": "waiting for subops from 1", 2023-08-01T19:56:34.377 INFO:teuthology.orchestra.run.smithi008.stdout: "time": "2023-08-01T19:55:05.568425+0000", 2023-08-01T19:56:34.377 INFO:teuthology.orchestra.run.smithi008.stdout: "duration": 0.000137346 2023-08-01T19:56:34.377 INFO:teuthology.orchestra.run.smithi008.stdout: }, 2023-08-01T19:56:34.377 INFO:teuthology.orchestra.run.smithi008.stdout: { 2023-08-01T19:56:34.377 INFO:teuthology.orchestra.run.smithi008.stdout: "event": "sub_op_commit_rec", 2023-08-01T19:56:34.377 INFO:teuthology.orchestra.run.smithi008.stdout: "time": "2023-08-01T19:55:05.629320+0000", 2023-08-01T19:56:34.377 INFO:teuthology.orchestra.run.smithi008.stdout: "duration": 0.060894491000000002 2023-08-01T19:56:34.378 INFO:teuthology.orchestra.run.smithi008.stdout: }, 2023-08-01T19:56:34.378 INFO:teuthology.orchestra.run.smithi008.stdout: { 2023-08-01T19:56:34.378 INFO:teuthology.orchestra.run.smithi008.stdout: "event": "op_commit", 2023-08-01T19:56:34.378 INFO:teuthology.orchestra.run.smithi008.stdout: "time": "2023-08-01T19:55:05.632452+0000", 2023-08-01T19:56:34.378 INFO:teuthology.orchestra.run.smithi008.stdout: "duration": 0.003131909 2023-08-01T19:56:34.378 INFO:teuthology.orchestra.run.smithi008.stdout: }, 2023-08-01T19:56:34.378 INFO:teuthology.orchestra.run.smithi008.stdout: { 2023-08-01T19:56:34.379 INFO:teuthology.orchestra.run.smithi008.stdout: "event": "commit_sent", 2023-08-01T19:56:34.379 INFO:teuthology.orchestra.run.smithi008.stdout: "time": "2023-08-01T19:55:05.632503+0000", 2023-08-01T19:56:34.379 INFO:teuthology.orchestra.run.smithi008.stdout: "duration": 5.1295000000000003e-05 2023-08-01T19:56:34.379 INFO:teuthology.orchestra.run.smithi008.stdout: }, 2023-08-01T19:56:34.379 INFO:teuthology.orchestra.run.smithi008.stdout: { 2023-08-01T19:56:34.379 INFO:teuthology.orchestra.run.smithi008.stdout: "event": "done", 2023-08-01T19:56:34.379 INFO:teuthology.orchestra.run.smithi008.stdout: "time": "2023-08-01T19:55:05.632543+0000", 2023-08-01T19:56:34.379 INFO:teuthology.orchestra.run.smithi008.stdout: "duration": 4.0234000000000001e-05 2023-08-01T19:56:34.380 INFO:teuthology.orchestra.run.smithi008.stdout: } 2023-08-01T19:56:34.380 INFO:teuthology.orchestra.run.smithi008.stdout: ] 2023-08-01T19:56:34.380 INFO:teuthology.orchestra.run.smithi008.stdout: } 2023-08-01T19:56:34.380 INFO:teuthology.orchestra.run.smithi008.stdout: }, 2023-08-01T19:56:34.380 INFO:teuthology.orchestra.run.smithi008.stdout: { 2023-08-01T19:56:34.380 INFO:teuthology.orchestra.run.smithi008.stdout: "description": "osd_op(client.4668.0:100939 5.5 5:a75fa6e3:::benchmark_data_smithi006_114134_object100938:head [set-alloc-hint object_size 65536 write_size 65536,write 0~65536] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e37)", 2023-08-01T19:56:34.380 INFO:teuthology.orchestra.run.smithi008.stdout: "initiated_at": "2023-08-01T19:55:05.569740+0000", 2023-08-01T19:56:34.380 INFO:teuthology.orchestra.run.smithi008.stdout: "age": 88.771441323000005, 2023-08-01T19:56:34.381 INFO:teuthology.orchestra.run.smithi008.stdout: "duration": 0.067753412999999998, 2023-08-01T19:56:34.381 INFO:teuthology.orchestra.run.smithi008.stdout: "type_data": { 2023-08-01T19:56:34.381 INFO:teuthology.orchestra.run.smithi008.stdout: "flag_point": "commit sent; apply or cleanup", 2023-08-01T19:56:34.381 INFO:teuthology.orchestra.run.smithi008.stdout: "client_info": { 2023-08-01T19:56:34.381 INFO:teuthology.orchestra.run.smithi008.stdout: "client": "client.4668", 2023-08-01T19:56:34.381 INFO:teuthology.orchestra.run.smithi008.stdout: "client_addr": "172.21.15.6:0/1709472247", 2023-08-01T19:56:34.381 INFO:teuthology.orchestra.run.smithi008.stdout: "tid": 100939 2023-08-01T19:56:34.381 INFO:teuthology.orchestra.run.smithi008.stdout: }, 2023-08-01T19:56:34.382 INFO:teuthology.orchestra.run.smithi008.stdout: "events": [ 2023-08-01T19:56:34.382 INFO:teuthology.orchestra.run.smithi008.stdout: { 2023-08-01T19:56:34.382 INFO:teuthology.orchestra.run.smithi008.stdout: "event": "initiated", 2023-08-01T19:56:34.382 INFO:teuthology.orchestra.run.smithi008.stdout: "time": "2023-08-01T19:55:05.569740+0000", 2023-08-01T19:56:34.382 INFO:teuthology.orchestra.run.smithi008.stdout: "duration": 0 2023-08-01T19:56:34.382 INFO:teuthology.orchestra.run.smithi008.stdout: }, 2023-08-01T19:56:34.382 INFO:teuthology.orchestra.run.smithi008.stdout: { 2023-08-01T19:56:34.382 INFO:teuthology.orchestra.run.smithi008.stdout: "event": "throttled", 2023-08-01T19:56:34.383 INFO:teuthology.orchestra.run.smithi008.stdout: "time": "2023-08-01T19:55:05.569740+0000", 2023-08-01T19:56:34.383 INFO:teuthology.orchestra.run.smithi008.stdout: "duration": 0 2023-08-01T19:56:34.383 INFO:teuthology.orchestra.run.smithi008.stdout: }, 2023-08-01T19:56:34.383 INFO:teuthology.orchestra.run.smithi008.stdout: { 2023-08-01T19:56:34.383 INFO:teuthology.orchestra.run.smithi008.stdout: "event": "header_read", 2023-08-01T19:56:34.383 INFO:teuthology.orchestra.run.smithi008.stdout: "time": "2023-08-01T19:55:05.569739+0000", 2023-08-01T19:56:34.383 INFO:teuthology.orchestra.run.smithi008.stdout: "duration": 4294967295.9999995 2023-08-01T19:56:34.383 INFO:teuthology.orchestra.run.smithi008.stdout: }, 2023-08-01T19:56:34.384 INFO:teuthology.orchestra.run.smithi008.stdout: { 2023-08-01T19:56:34.384 INFO:teuthology.orchestra.run.smithi008.stdout: "event": "all_read", 2023-08-01T19:56:34.384 INFO:teuthology.orchestra.run.smithi008.stdout: "time": "2023-08-01T19:55:05.569839+0000", 2023-08-01T19:56:34.384 INFO:teuthology.orchestra.run.smithi008.stdout: "duration": 0.000100219 2023-08-01T19:56:34.384 INFO:teuthology.orchestra.run.smithi008.stdout: }, 2023-08-01T19:56:34.384 INFO:teuthology.orchestra.run.smithi008.stdout: { 2023-08-01T19:56:34.384 INFO:teuthology.orchestra.run.smithi008.stdout: "event": "dispatched", 2023-08-01T19:56:34.385 INFO:teuthology.orchestra.run.smithi008.stdout: "time": "2023-08-01T19:55:05.569846+0000", 2023-08-01T19:56:34.385 INFO:teuthology.orchestra.run.smithi008.stdout: "duration": 7.3150000000000003e-06 2023-08-01T19:56:34.385 INFO:teuthology.orchestra.run.smithi008.stdout: }, 2023-08-01T19:56:34.385 INFO:teuthology.orchestra.run.smithi008.stdout: { 2023-08-01T19:56:34.385 INFO:teuthology.orchestra.run.smithi008.stdout: "event": "queued_for_pg", 2023-08-01T19:56:34.385 INFO:teuthology.orchestra.run.smithi008.stdout: "time": "2023-08-01T19:55:05.569850+0000", 2023-08-01T19:56:34.385 INFO:teuthology.orchestra.run.smithi008.stdout: "duration": 3.3299999999999999e-06 2023-08-01T19:56:34.385 INFO:teuthology.orchestra.run.smithi008.stdout: }, 2023-08-01T19:56:34.386 INFO:teuthology.orchestra.run.smithi008.stdout: { 2023-08-01T19:56:34.386 INFO:teuthology.orchestra.run.smithi008.stdout: "event": "reached_pg", 2023-08-01T19:56:34.386 INFO:teuthology.orchestra.run.smithi008.stdout: "time": "2023-08-01T19:55:05.626991+0000", 2023-08-01T19:56:34.386 INFO:teuthology.orchestra.run.smithi008.stdout: "duration": 0.057141585000000002 2023-08-01T19:56:34.386 INFO:teuthology.orchestra.run.smithi008.stdout: }, 2023-08-01T19:56:34.386 INFO:teuthology.orchestra.run.smithi008.stdout: { 2023-08-01T19:56:34.386 INFO:teuthology.orchestra.run.smithi008.stdout: "event": "started", 2023-08-01T19:56:34.386 INFO:teuthology.orchestra.run.smithi008.stdout: "time": "2023-08-01T19:55:05.627111+0000", 2023-08-01T19:56:34.387 INFO:teuthology.orchestra.run.smithi008.stdout: "duration": 0.000119238 2023-08-01T19:56:34.387 INFO:teuthology.orchestra.run.smithi008.stdout: }, 2023-08-01T19:56:34.387 INFO:teuthology.orchestra.run.smithi008.stdout: { 2023-08-01T19:56:34.387 INFO:teuthology.orchestra.run.smithi008.stdout: "event": "waiting for subops from 1", 2023-08-01T19:56:34.387 INFO:teuthology.orchestra.run.smithi008.stdout: "time": "2023-08-01T19:55:05.627253+0000", 2023-08-01T19:56:34.387 INFO:teuthology.orchestra.run.smithi008.stdout: "duration": 0.000142822 2023-08-01T19:56:34.388 INFO:teuthology.orchestra.run.smithi008.stdout: }, 2023-08-01T19:56:34.388 INFO:teuthology.orchestra.run.smithi008.stdout: { 2023-08-01T19:56:34.388 INFO:teuthology.orchestra.run.smithi008.stdout: "event": "op_commit", 2023-08-01T19:56:34.388 INFO:teuthology.orchestra.run.smithi008.stdout: "time": "2023-08-01T19:55:05.632555+0000", 2023-08-01T19:56:34.388 INFO:teuthology.orchestra.run.smithi008.stdout: "duration": 0.0053012449999999996 2023-08-01T19:56:34.388 INFO:teuthology.orchestra.run.smithi008.stdout: }, 2023-08-01T19:56:34.388 INFO:teuthology.orchestra.run.smithi008.stdout: { 2023-08-01T19:56:34.389 INFO:teuthology.orchestra.run.smithi008.stdout: "event": "sub_op_commit_rec", 2023-08-01T19:56:34.389 INFO:teuthology.orchestra.run.smithi008.stdout: "time": "2023-08-01T19:55:05.637380+0000", 2023-08-01T19:56:34.389 INFO:teuthology.orchestra.run.smithi008.stdout: "duration": 0.0048257639999999997 2023-08-01T19:56:34.389 INFO:teuthology.orchestra.run.smithi008.stdout: }, 2023-08-01T19:56:34.389 INFO:teuthology.orchestra.run.smithi008.stdout: { 2023-08-01T19:56:34.389 INFO:teuthology.orchestra.run.smithi008.stdout: "event": "commit_sent", 2023-08-01T19:56:34.390 INFO:teuthology.orchestra.run.smithi008.stdout: "time": "2023-08-01T19:55:05.637454+0000", 2023-08-01T19:56:34.390 INFO:teuthology.orchestra.run.smithi008.stdout: "duration": 7.3578999999999995e-05 2023-08-01T19:56:34.390 INFO:teuthology.orchestra.run.smithi008.stdout: }, 2023-08-01T19:56:34.390 INFO:teuthology.orchestra.run.smithi008.stdout: { 2023-08-01T19:56:34.390 INFO:teuthology.orchestra.run.smithi008.stdout: "event": "done", 2023-08-01T19:56:34.390 INFO:teuthology.orchestra.run.smithi008.stdout: "time": "2023-08-01T19:55:05.637493+0000", 2023-08-01T19:56:34.390 INFO:teuthology.orchestra.run.smithi008.stdout: "duration": 3.8986999999999998e-05 2023-08-01T19:56:34.390 INFO:teuthology.orchestra.run.smithi008.stdout: } 2023-08-01T19:56:34.391 INFO:teuthology.orchestra.run.smithi008.stdout: ] 2023-08-01T19:56:34.391 INFO:teuthology.orchestra.run.smithi008.stdout: } 2023-08-01T19:56:34.391 INFO:teuthology.orchestra.run.smithi008.stdout: }, 2023-08-01T19:56:34.391 INFO:teuthology.orchestra.run.smithi008.stdout: { 2023-08-01T19:56:34.391 INFO:teuthology.orchestra.run.smithi008.stdout: "description": "osd_op(client.4668.0:107863 5.3 5:cbdd875a:::benchmark_data_smithi006_114134_object107862:head [set-alloc-hint object_size 65536 write_size 65536,write 0~65536] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e38)", 2023-08-01T19:56:34.391 INFO:teuthology.orchestra.run.smithi008.stdout: "initiated_at": "2023-08-01T19:55:09.278851+0000", 2023-08-01T19:56:34.391 INFO:teuthology.orchestra.run.smithi008.stdout: "age": 85.062329582999993, 2023-08-01T19:56:34.392 INFO:teuthology.orchestra.run.smithi008.stdout: "duration": 0.071378853000000006, 2023-08-01T19:56:34.392 INFO:teuthology.orchestra.run.smithi008.stdout: "type_data": { 2023-08-01T19:56:34.392 INFO:teuthology.orchestra.run.smithi008.stdout: "flag_point": "commit sent; apply or cleanup", 2023-08-01T19:56:34.392 INFO:teuthology.orchestra.run.smithi008.stdout: "client_info": { 2023-08-01T19:56:34.392 INFO:teuthology.orchestra.run.smithi008.stdout: "client": "client.4668", 2023-08-01T19:56:34.392 INFO:teuthology.orchestra.run.smithi008.stdout: "client_addr": "172.21.15.6:0/1709472247", 2023-08-01T19:56:34.392 INFO:teuthology.orchestra.run.smithi008.stdout: "tid": 107863 2023-08-01T19:56:34.392 INFO:teuthology.orchestra.run.smithi008.stdout: }, 2023-08-01T19:56:34.393 INFO:teuthology.orchestra.run.smithi008.stdout: "events": [ 2023-08-01T19:56:34.393 INFO:teuthology.orchestra.run.smithi008.stdout: { 2023-08-01T19:56:34.393 INFO:teuthology.orchestra.run.smithi008.stdout: "event": "initiated", 2023-08-01T19:56:34.393 INFO:teuthology.orchestra.run.smithi008.stdout: "time": "2023-08-01T19:55:09.278851+0000", 2023-08-01T19:56:34.393 INFO:teuthology.orchestra.run.smithi008.stdout: "duration": 0 2023-08-01T19:56:34.393 INFO:teuthology.orchestra.run.smithi008.stdout: }, 2023-08-01T19:56:34.393 INFO:teuthology.orchestra.run.smithi008.stdout: { 2023-08-01T19:56:34.394 INFO:teuthology.orchestra.run.smithi008.stdout: "event": "throttled", 2023-08-01T19:56:34.394 INFO:teuthology.orchestra.run.smithi008.stdout: "time": "2023-08-01T19:55:09.278851+0000", 2023-08-01T19:56:34.394 INFO:teuthology.orchestra.run.smithi008.stdout: "duration": 0 2023-08-01T19:56:34.394 INFO:teuthology.orchestra.run.smithi008.stdout: }, 2023-08-01T19:56:34.394 INFO:teuthology.orchestra.run.smithi008.stdout: { 2023-08-01T19:56:34.394 INFO:teuthology.orchestra.run.smithi008.stdout: "event": "header_read", 2023-08-01T19:56:34.394 INFO:teuthology.orchestra.run.smithi008.stdout: "time": "2023-08-01T19:55:09.278850+0000", 2023-08-01T19:56:34.394 INFO:teuthology.orchestra.run.smithi008.stdout: "duration": 4294967295.999999 2023-08-01T19:56:34.395 INFO:teuthology.orchestra.run.smithi008.stdout: }, 2023-08-01T19:56:34.395 INFO:teuthology.orchestra.run.smithi008.stdout: { 2023-08-01T19:56:34.395 INFO:teuthology.orchestra.run.smithi008.stdout: "event": "all_read", 2023-08-01T19:56:34.395 INFO:teuthology.orchestra.run.smithi008.stdout: "time": "2023-08-01T19:55:09.278945+0000", 2023-08-01T19:56:34.395 INFO:teuthology.orchestra.run.smithi008.stdout: "duration": 9.4388000000000005e-05 2023-08-01T19:56:34.395 INFO:teuthology.orchestra.run.smithi008.stdout: }, 2023-08-01T19:56:34.395 INFO:teuthology.orchestra.run.smithi008.stdout: { 2023-08-01T19:56:34.395 INFO:teuthology.orchestra.run.smithi008.stdout: "event": "dispatched", 2023-08-01T19:56:34.396 INFO:teuthology.orchestra.run.smithi008.stdout: "time": "2023-08-01T19:55:09.278955+0000", 2023-08-01T19:56:34.396 INFO:teuthology.orchestra.run.smithi008.stdout: "duration": 1.0413e-05 2023-08-01T19:56:34.396 INFO:teuthology.orchestra.run.smithi008.stdout: }, 2023-08-01T19:56:34.396 INFO:teuthology.orchestra.run.smithi008.stdout: { 2023-08-01T19:56:34.396 INFO:teuthology.orchestra.run.smithi008.stdout: "event": "queued_for_pg", 2023-08-01T19:56:34.396 INFO:teuthology.orchestra.run.smithi008.stdout: "time": "2023-08-01T19:55:09.278962+0000", 2023-08-01T19:56:34.396 INFO:teuthology.orchestra.run.smithi008.stdout: "duration": 6.2169999999999999e-06 2023-08-01T19:56:34.396 INFO:teuthology.orchestra.run.smithi008.stdout: }, 2023-08-01T19:56:34.397 INFO:teuthology.orchestra.run.smithi008.stdout: { 2023-08-01T19:56:34.397 INFO:teuthology.orchestra.run.smithi008.stdout: "event": "reached_pg", 2023-08-01T19:56:34.397 INFO:teuthology.orchestra.run.smithi008.stdout: "time": "2023-08-01T19:55:09.280363+0000", 2023-08-01T19:56:34.397 INFO:teuthology.orchestra.run.smithi008.stdout: "duration": 0.0014014489999999999 2023-08-01T19:56:34.397 INFO:teuthology.orchestra.run.smithi008.stdout: }, 2023-08-01T19:56:34.397 INFO:teuthology.orchestra.run.smithi008.stdout: { 2023-08-01T19:56:34.397 INFO:teuthology.orchestra.run.smithi008.stdout: "event": "started", 2023-08-01T19:56:34.397 INFO:teuthology.orchestra.run.smithi008.stdout: "time": "2023-08-01T19:55:09.280488+0000", 2023-08-01T19:56:34.398 INFO:teuthology.orchestra.run.smithi008.stdout: "duration": 0.00012474099999999999 2023-08-01T19:56:34.398 INFO:teuthology.orchestra.run.smithi008.stdout: }, 2023-08-01T19:56:34.398 INFO:teuthology.orchestra.run.smithi008.stdout: { 2023-08-01T19:56:34.398 INFO:teuthology.orchestra.run.smithi008.stdout: "event": "waiting for subops from 1", 2023-08-01T19:56:34.398 INFO:teuthology.orchestra.run.smithi008.stdout: "time": "2023-08-01T19:55:09.280626+0000", 2023-08-01T19:56:34.398 INFO:teuthology.orchestra.run.smithi008.stdout: "duration": 0.000138193 2023-08-01T19:56:34.398 INFO:teuthology.orchestra.run.smithi008.stdout: }, 2023-08-01T19:56:34.399 INFO:teuthology.orchestra.run.smithi008.stdout: { 2023-08-01T19:56:34.399 INFO:teuthology.orchestra.run.smithi008.stdout: "event": "op_commit", 2023-08-01T19:56:34.399 INFO:teuthology.orchestra.run.smithi008.stdout: "time": "2023-08-01T19:55:09.285958+0000", 2023-08-01T19:56:34.399 INFO:teuthology.orchestra.run.smithi008.stdout: "duration": 0.0053317130000000001 2023-08-01T19:56:34.399 INFO:teuthology.orchestra.run.smithi008.stdout: }, 2023-08-01T19:56:34.399 INFO:teuthology.orchestra.run.smithi008.stdout: { 2023-08-01T19:56:34.399 INFO:teuthology.orchestra.run.smithi008.stdout: "event": "sub_op_commit_rec", 2023-08-01T19:56:34.399 INFO:teuthology.orchestra.run.smithi008.stdout: "time": "2023-08-01T19:55:09.350151+0000", 2023-08-01T19:56:34.400 INFO:teuthology.orchestra.run.smithi008.stdout: "duration": 0.064193202000000005 2023-08-01T19:56:34.400 INFO:teuthology.orchestra.run.smithi008.stdout: }, 2023-08-01T19:56:34.400 INFO:teuthology.orchestra.run.smithi008.stdout: { 2023-08-01T19:56:34.400 INFO:teuthology.orchestra.run.smithi008.stdout: "event": "commit_sent", 2023-08-01T19:56:34.400 INFO:teuthology.orchestra.run.smithi008.stdout: "time": "2023-08-01T19:55:09.350188+0000", 2023-08-01T19:56:34.400 INFO:teuthology.orchestra.run.smithi008.stdout: "duration": 3.7549999999999998e-05 2023-08-01T19:56:34.400 INFO:teuthology.orchestra.run.smithi008.stdout: }, 2023-08-01T19:56:34.401 INFO:teuthology.orchestra.run.smithi008.stdout: { 2023-08-01T19:56:34.401 INFO:teuthology.orchestra.run.smithi008.stdout: "event": "done", 2023-08-01T19:56:34.401 INFO:teuthology.orchestra.run.smithi008.stdout: "time": "2023-08-01T19:55:09.350230+0000", 2023-08-01T19:56:34.402 INFO:teuthology.orchestra.run.smithi008.stdout: "duration": 4.1804999999999997e-05 2023-08-01T19:56:34.402 INFO:teuthology.orchestra.run.smithi008.stdout: } 2023-08-01T19:56:34.402 INFO:teuthology.orchestra.run.smithi008.stdout: ] 2023-08-01T19:56:34.402 INFO:teuthology.orchestra.run.smithi008.stdout: } 2023-08-01T19:56:34.402 INFO:teuthology.orchestra.run.smithi008.stdout: }, 2023-08-01T19:56:34.402 INFO:teuthology.orchestra.run.smithi008.stdout: { 2023-08-01T19:56:34.402 INFO:teuthology.orchestra.run.smithi008.stdout: "description": "osd_op(client.4668.0:107865 5.3 5:c2ebb96d:::benchmark_data_smithi006_114134_object107864:head [set-alloc-hint object_size 65536 write_size 65536,write 0~65536] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e38)", 2023-08-01T19:56:34.403 INFO:teuthology.orchestra.run.smithi008.stdout: "initiated_at": "2023-08-01T19:55:09.279020+0000", 2023-08-01T19:56:34.403 INFO:teuthology.orchestra.run.smithi008.stdout: "age": 85.062160911000007, 2023-08-01T19:56:34.403 INFO:teuthology.orchestra.run.smithi008.stdout: "duration": 0.072892565000000006, 2023-08-01T19:56:34.403 INFO:teuthology.orchestra.run.smithi008.stdout: "type_data": { 2023-08-01T19:56:34.403 INFO:teuthology.orchestra.run.smithi008.stdout: "flag_point": "commit sent; apply or cleanup", 2023-08-01T19:56:34.403 INFO:teuthology.orchestra.run.smithi008.stdout: "client_info": { 2023-08-01T19:56:34.403 INFO:teuthology.orchestra.run.smithi008.stdout: "client": "client.4668", 2023-08-01T19:56:34.403 INFO:teuthology.orchestra.run.smithi008.stdout: "client_addr": "172.21.15.6:0/1709472247", 2023-08-01T19:56:34.404 INFO:teuthology.orchestra.run.smithi008.stdout: "tid": 107865 2023-08-01T19:56:34.404 INFO:teuthology.orchestra.run.smithi008.stdout: }, 2023-08-01T19:56:34.404 INFO:teuthology.orchestra.run.smithi008.stdout: "events": [ 2023-08-01T19:56:34.404 INFO:teuthology.orchestra.run.smithi008.stdout: { 2023-08-01T19:56:34.405 INFO:teuthology.orchestra.run.smithi008.stdout: "event": "initiated", 2023-08-01T19:56:34.405 INFO:teuthology.orchestra.run.smithi008.stdout: "time": "2023-08-01T19:55:09.279020+0000", 2023-08-01T19:56:34.405 INFO:teuthology.orchestra.run.smithi008.stdout: "duration": 0 2023-08-01T19:56:34.405 INFO:teuthology.orchestra.run.smithi008.stdout: }, 2023-08-01T19:56:34.405 INFO:teuthology.orchestra.run.smithi008.stdout: { 2023-08-01T19:56:34.405 INFO:teuthology.orchestra.run.smithi008.stdout: "event": "throttled", 2023-08-01T19:56:34.405 INFO:teuthology.orchestra.run.smithi008.stdout: "time": "2023-08-01T19:55:09.279020+0000", 2023-08-01T19:56:34.406 INFO:teuthology.orchestra.run.smithi008.stdout: "duration": 0 2023-08-01T19:56:34.406 INFO:teuthology.orchestra.run.smithi008.stdout: }, 2023-08-01T19:56:34.406 INFO:teuthology.orchestra.run.smithi008.stdout: { 2023-08-01T19:56:34.406 INFO:teuthology.orchestra.run.smithi008.stdout: "event": "header_read", 2023-08-01T19:56:34.406 INFO:teuthology.orchestra.run.smithi008.stdout: "time": "2023-08-01T19:55:09.279019+0000", 2023-08-01T19:56:34.406 INFO:teuthology.orchestra.run.smithi008.stdout: "duration": 4294967295.999999 2023-08-01T19:56:34.406 INFO:teuthology.orchestra.run.smithi008.stdout: }, 2023-08-01T19:56:34.406 INFO:teuthology.orchestra.run.smithi008.stdout: { 2023-08-01T19:56:34.407 INFO:teuthology.orchestra.run.smithi008.stdout: "event": "all_read", 2023-08-01T19:56:34.407 INFO:teuthology.orchestra.run.smithi008.stdout: "time": "2023-08-01T19:55:09.279087+0000", 2023-08-01T19:56:34.407 INFO:teuthology.orchestra.run.smithi008.stdout: "duration": 6.8392000000000005e-05 2023-08-01T19:56:34.407 INFO:teuthology.orchestra.run.smithi008.stdout: }, 2023-08-01T19:56:34.407 INFO:teuthology.orchestra.run.smithi008.stdout: { 2023-08-01T19:56:34.407 INFO:teuthology.orchestra.run.smithi008.stdout: "event": "dispatched", 2023-08-01T19:56:34.407 INFO:teuthology.orchestra.run.smithi008.stdout: "time": "2023-08-01T19:55:09.279095+0000", 2023-08-01T19:56:34.408 INFO:teuthology.orchestra.run.smithi008.stdout: "duration": 8.0989999999999999e-06 2023-08-01T19:56:34.408 INFO:teuthology.orchestra.run.smithi008.stdout: }, 2023-08-01T19:56:34.408 INFO:teuthology.orchestra.run.smithi008.stdout: { 2023-08-01T19:56:34.408 INFO:teuthology.orchestra.run.smithi008.stdout: "event": "queued_for_pg", 2023-08-01T19:56:34.408 INFO:teuthology.orchestra.run.smithi008.stdout: "time": "2023-08-01T19:55:09.279101+0000", 2023-08-01T19:56:34.408 INFO:teuthology.orchestra.run.smithi008.stdout: "duration": 5.0390000000000004e-06 2023-08-01T19:56:34.408 INFO:teuthology.orchestra.run.smithi008.stdout: }, 2023-08-01T19:56:34.408 INFO:teuthology.orchestra.run.smithi008.stdout: { 2023-08-01T19:56:34.409 INFO:teuthology.orchestra.run.smithi008.stdout: "event": "reached_pg", 2023-08-01T19:56:34.409 INFO:teuthology.orchestra.run.smithi008.stdout: "time": "2023-08-01T19:55:09.282574+0000", 2023-08-01T19:56:34.409 INFO:teuthology.orchestra.run.smithi008.stdout: "duration": 0.0034730619999999999 2023-08-01T19:56:34.409 INFO:teuthology.orchestra.run.smithi008.stdout: }, 2023-08-01T19:56:34.409 INFO:teuthology.orchestra.run.smithi008.stdout: { 2023-08-01T19:56:34.409 INFO:teuthology.orchestra.run.smithi008.stdout: "event": "started", 2023-08-01T19:56:34.409 INFO:teuthology.orchestra.run.smithi008.stdout: "time": "2023-08-01T19:55:09.282705+0000", 2023-08-01T19:56:34.409 INFO:teuthology.orchestra.run.smithi008.stdout: "duration": 0.00013133400000000001 2023-08-01T19:56:34.410 INFO:teuthology.orchestra.run.smithi008.stdout: }, 2023-08-01T19:56:34.410 INFO:teuthology.orchestra.run.smithi008.stdout: { 2023-08-01T19:56:34.410 INFO:teuthology.orchestra.run.smithi008.stdout: "event": "waiting for subops from 1", 2023-08-01T19:56:34.410 INFO:teuthology.orchestra.run.smithi008.stdout: "time": "2023-08-01T19:55:09.283067+0000", 2023-08-01T19:56:34.410 INFO:teuthology.orchestra.run.smithi008.stdout: "duration": 0.00036195299999999998 2023-08-01T19:56:34.410 INFO:teuthology.orchestra.run.smithi008.stdout: }, 2023-08-01T19:56:34.410 INFO:teuthology.orchestra.run.smithi008.stdout: { 2023-08-01T19:56:34.410 INFO:teuthology.orchestra.run.smithi008.stdout: "event": "op_commit", 2023-08-01T19:56:34.411 INFO:teuthology.orchestra.run.smithi008.stdout: "time": "2023-08-01T19:55:09.288196+0000", 2023-08-01T19:56:34.411 INFO:teuthology.orchestra.run.smithi008.stdout: "duration": 0.0051293780000000004 2023-08-01T19:56:34.411 INFO:teuthology.orchestra.run.smithi008.stdout: }, 2023-08-01T19:56:34.411 INFO:teuthology.orchestra.run.smithi008.stdout: { 2023-08-01T19:56:34.411 INFO:teuthology.orchestra.run.smithi008.stdout: "event": "sub_op_commit_rec", 2023-08-01T19:56:34.411 INFO:teuthology.orchestra.run.smithi008.stdout: "time": "2023-08-01T19:55:09.351832+0000", 2023-08-01T19:56:34.411 INFO:teuthology.orchestra.run.smithi008.stdout: "duration": 0.063636076 2023-08-01T19:56:34.412 INFO:teuthology.orchestra.run.smithi008.stdout: }, 2023-08-01T19:56:34.412 INFO:teuthology.orchestra.run.smithi008.stdout: { 2023-08-01T19:56:34.412 INFO:teuthology.orchestra.run.smithi008.stdout: "event": "commit_sent", 2023-08-01T19:56:34.412 INFO:teuthology.orchestra.run.smithi008.stdout: "time": "2023-08-01T19:55:09.351878+0000", 2023-08-01T19:56:34.412 INFO:teuthology.orchestra.run.smithi008.stdout: "duration": 4.5408999999999998e-05 2023-08-01T19:56:34.412 INFO:teuthology.orchestra.run.smithi008.stdout: }, 2023-08-01T19:56:34.412 INFO:teuthology.orchestra.run.smithi008.stdout: { 2023-08-01T19:56:34.412 INFO:teuthology.orchestra.run.smithi008.stdout: "event": "done", 2023-08-01T19:56:34.413 INFO:teuthology.orchestra.run.smithi008.stdout: "time": "2023-08-01T19:55:09.351913+0000", 2023-08-01T19:56:34.413 INFO:teuthology.orchestra.run.smithi008.stdout: "duration": 3.4808999999999998e-05 2023-08-01T19:56:34.413 INFO:teuthology.orchestra.run.smithi008.stdout: } 2023-08-01T19:56:34.413 INFO:teuthology.orchestra.run.smithi008.stdout: ] 2023-08-01T19:56:34.413 INFO:teuthology.orchestra.run.smithi008.stdout: } 2023-08-01T19:56:34.413 INFO:teuthology.orchestra.run.smithi008.stdout: }, 2023-08-01T19:56:34.413 INFO:teuthology.orchestra.run.smithi008.stdout: { 2023-08-01T19:56:34.413 INFO:teuthology.orchestra.run.smithi008.stdout: "description": "osd_op(client.4668.0:107869 5.c 5:31910384:::benchmark_data_smithi006_114134_object107868:head [set-alloc-hint object_size 65536 write_size 65536,write 0~65536] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e38)", 2023-08-01T19:56:34.414 INFO:teuthology.orchestra.run.smithi008.stdout: "initiated_at": "2023-08-01T19:55:09.283205+0000", 2023-08-01T19:56:34.414 INFO:teuthology.orchestra.run.smithi008.stdout: "age": 85.057975745999997, 2023-08-01T19:56:34.414 INFO:teuthology.orchestra.run.smithi008.stdout: "duration": 0.068611808999999996, 2023-08-01T19:56:34.414 INFO:teuthology.orchestra.run.smithi008.stdout: "type_data": { 2023-08-01T19:56:34.414 INFO:teuthology.orchestra.run.smithi008.stdout: "flag_point": "commit sent; apply or cleanup", 2023-08-01T19:56:34.414 INFO:teuthology.orchestra.run.smithi008.stdout: "client_info": { 2023-08-01T19:56:34.414 INFO:teuthology.orchestra.run.smithi008.stdout: "client": "client.4668", 2023-08-01T19:56:34.414 INFO:teuthology.orchestra.run.smithi008.stdout: "client_addr": "172.21.15.6:0/1709472247", 2023-08-01T19:56:34.415 INFO:teuthology.orchestra.run.smithi008.stdout: "tid": 107869 2023-08-01T19:56:34.415 INFO:teuthology.orchestra.run.smithi008.stdout: }, 2023-08-01T19:56:34.415 INFO:teuthology.orchestra.run.smithi008.stdout: "events": [ 2023-08-01T19:56:34.415 INFO:teuthology.orchestra.run.smithi008.stdout: { 2023-08-01T19:56:34.415 INFO:teuthology.orchestra.run.smithi008.stdout: "event": "initiated", 2023-08-01T19:56:34.415 INFO:teuthology.orchestra.run.smithi008.stdout: "time": "2023-08-01T19:55:09.283205+0000", 2023-08-01T19:56:34.415 INFO:teuthology.orchestra.run.smithi008.stdout: "duration": 0 2023-08-01T19:56:34.415 INFO:teuthology.orchestra.run.smithi008.stdout: }, 2023-08-01T19:56:34.416 INFO:teuthology.orchestra.run.smithi008.stdout: { 2023-08-01T19:56:34.416 INFO:teuthology.orchestra.run.smithi008.stdout: "event": "throttled", 2023-08-01T19:56:34.416 INFO:teuthology.orchestra.run.smithi008.stdout: "time": "2023-08-01T19:55:09.283205+0000", 2023-08-01T19:56:34.416 INFO:teuthology.orchestra.run.smithi008.stdout: "duration": 0 2023-08-01T19:56:34.416 INFO:teuthology.orchestra.run.smithi008.stdout: }, 2023-08-01T19:56:34.416 INFO:teuthology.orchestra.run.smithi008.stdout: { 2023-08-01T19:56:34.416 INFO:teuthology.orchestra.run.smithi008.stdout: "event": "header_read", 2023-08-01T19:56:34.417 INFO:teuthology.orchestra.run.smithi008.stdout: "time": "2023-08-01T19:55:09.283204+0000", 2023-08-01T19:56:34.417 INFO:teuthology.orchestra.run.smithi008.stdout: "duration": 4294967295.999999 2023-08-01T19:56:34.417 INFO:teuthology.orchestra.run.smithi008.stdout: }, 2023-08-01T19:56:34.417 INFO:teuthology.orchestra.run.smithi008.stdout: { 2023-08-01T19:56:34.417 INFO:teuthology.orchestra.run.smithi008.stdout: "event": "all_read", 2023-08-01T19:56:34.417 INFO:teuthology.orchestra.run.smithi008.stdout: "time": "2023-08-01T19:55:09.283300+0000", 2023-08-01T19:56:34.417 INFO:teuthology.orchestra.run.smithi008.stdout: "duration": 9.6280000000000007e-05 2023-08-01T19:56:34.417 INFO:teuthology.orchestra.run.smithi008.stdout: }, 2023-08-01T19:56:34.418 INFO:teuthology.orchestra.run.smithi008.stdout: { 2023-08-01T19:56:34.418 INFO:teuthology.orchestra.run.smithi008.stdout: "event": "dispatched", 2023-08-01T19:56:34.418 INFO:teuthology.orchestra.run.smithi008.stdout: "time": "2023-08-01T19:55:09.283314+0000", 2023-08-01T19:56:34.418 INFO:teuthology.orchestra.run.smithi008.stdout: "duration": 1.3344e-05 2023-08-01T19:56:34.418 INFO:teuthology.orchestra.run.smithi008.stdout: }, 2023-08-01T19:56:34.418 INFO:teuthology.orchestra.run.smithi008.stdout: { 2023-08-01T19:56:34.418 INFO:teuthology.orchestra.run.smithi008.stdout: "event": "queued_for_pg", 2023-08-01T19:56:34.418 INFO:teuthology.orchestra.run.smithi008.stdout: "time": "2023-08-01T19:55:09.283320+0000", 2023-08-01T19:56:34.419 INFO:teuthology.orchestra.run.smithi008.stdout: "duration": 6.0299999999999999e-06 2023-08-01T19:56:34.419 INFO:teuthology.orchestra.run.smithi008.stdout: }, 2023-08-01T19:56:34.419 INFO:teuthology.orchestra.run.smithi008.stdout: { 2023-08-01T19:56:34.419 INFO:teuthology.orchestra.run.smithi008.stdout: "event": "reached_pg", 2023-08-01T19:56:34.419 INFO:teuthology.orchestra.run.smithi008.stdout: "time": "2023-08-01T19:55:09.283365+0000", 2023-08-01T19:56:34.419 INFO:teuthology.orchestra.run.smithi008.stdout: "duration": 4.5578999999999998e-05 2023-08-01T19:56:34.419 INFO:teuthology.orchestra.run.smithi008.stdout: }, 2023-08-01T19:56:34.419 INFO:teuthology.orchestra.run.smithi008.stdout: { 2023-08-01T19:56:34.420 INFO:teuthology.orchestra.run.smithi008.stdout: "event": "started", 2023-08-01T19:56:34.420 INFO:teuthology.orchestra.run.smithi008.stdout: "time": "2023-08-01T19:55:09.283490+0000", 2023-08-01T19:56:34.420 INFO:teuthology.orchestra.run.smithi008.stdout: "duration": 0.00012473700000000001 2023-08-01T19:56:34.420 INFO:teuthology.orchestra.run.smithi008.stdout: }, 2023-08-01T19:56:34.420 INFO:teuthology.orchestra.run.smithi008.stdout: { 2023-08-01T19:56:34.420 INFO:teuthology.orchestra.run.smithi008.stdout: "event": "waiting for subops from 1", 2023-08-01T19:56:34.420 INFO:teuthology.orchestra.run.smithi008.stdout: "time": "2023-08-01T19:55:09.283637+0000", 2023-08-01T19:56:34.420 INFO:teuthology.orchestra.run.smithi008.stdout: "duration": 0.00014715600000000001 2023-08-01T19:56:34.421 INFO:teuthology.orchestra.run.smithi008.stdout: }, 2023-08-01T19:56:34.421 INFO:teuthology.orchestra.run.smithi008.stdout: { 2023-08-01T19:56:34.421 INFO:teuthology.orchestra.run.smithi008.stdout: "event": "op_commit", 2023-08-01T19:56:34.421 INFO:teuthology.orchestra.run.smithi008.stdout: "time": "2023-08-01T19:55:09.288214+0000", 2023-08-01T19:56:34.421 INFO:teuthology.orchestra.run.smithi008.stdout: "duration": 0.0045769560000000001 2023-08-01T19:56:34.421 INFO:teuthology.orchestra.run.smithi008.stdout: }, 2023-08-01T19:56:34.421 INFO:teuthology.orchestra.run.smithi008.stdout: { 2023-08-01T19:56:34.421 INFO:teuthology.orchestra.run.smithi008.stdout: "event": "sub_op_commit_rec", 2023-08-01T19:56:34.422 INFO:teuthology.orchestra.run.smithi008.stdout: "time": "2023-08-01T19:55:09.351721+0000", 2023-08-01T19:56:34.422 INFO:teuthology.orchestra.run.smithi008.stdout: "duration": 0.063507383000000001 2023-08-01T19:56:34.422 INFO:teuthology.orchestra.run.smithi008.stdout: }, 2023-08-01T19:56:34.422 INFO:teuthology.orchestra.run.smithi008.stdout: { 2023-08-01T19:56:34.422 INFO:teuthology.orchestra.run.smithi008.stdout: "event": "commit_sent", 2023-08-01T19:56:34.422 INFO:teuthology.orchestra.run.smithi008.stdout: "time": "2023-08-01T19:55:09.351777+0000", 2023-08-01T19:56:34.422 INFO:teuthology.orchestra.run.smithi008.stdout: "duration": 5.5733999999999999e-05 2023-08-01T19:56:34.422 INFO:teuthology.orchestra.run.smithi008.stdout: }, 2023-08-01T19:56:34.423 INFO:teuthology.orchestra.run.smithi008.stdout: { 2023-08-01T19:56:34.423 INFO:teuthology.orchestra.run.smithi008.stdout: "event": "done", 2023-08-01T19:56:34.423 INFO:teuthology.orchestra.run.smithi008.stdout: "time": "2023-08-01T19:55:09.351817+0000", 2023-08-01T19:56:34.423 INFO:teuthology.orchestra.run.smithi008.stdout: "duration": 3.9765000000000003e-05 2023-08-01T19:56:34.423 INFO:teuthology.orchestra.run.smithi008.stdout: } 2023-08-01T19:56:34.423 INFO:teuthology.orchestra.run.smithi008.stdout: ] 2023-08-01T19:56:34.423 INFO:teuthology.orchestra.run.smithi008.stdout: } 2023-08-01T19:56:34.424 INFO:teuthology.orchestra.run.smithi008.stdout: }, 2023-08-01T19:56:34.424 INFO:teuthology.orchestra.run.smithi008.stdout: { 2023-08-01T19:56:34.424 INFO:teuthology.orchestra.run.smithi008.stdout: "description": "osd_op(client.4668.0:107874 5.3 5:ce4c2799:::benchmark_data_smithi006_114134_object107873:head [set-alloc-hint object_size 65536 write_size 65536,write 0~65536] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e38)", 2023-08-01T19:56:34.424 INFO:teuthology.orchestra.run.smithi008.stdout: "initiated_at": "2023-08-01T19:55:09.286239+0000", 2023-08-01T19:56:34.424 INFO:teuthology.orchestra.run.smithi008.stdout: "age": 85.054942241000006, 2023-08-01T19:56:34.424 INFO:teuthology.orchestra.run.smithi008.stdout: "duration": 0.068224389999999996, 2023-08-01T19:56:34.424 INFO:teuthology.orchestra.run.smithi008.stdout: "type_data": { 2023-08-01T19:56:34.424 INFO:teuthology.orchestra.run.smithi008.stdout: "flag_point": "commit sent; apply or cleanup", 2023-08-01T19:56:34.425 INFO:teuthology.orchestra.run.smithi008.stdout: "client_info": { 2023-08-01T19:56:34.425 INFO:teuthology.orchestra.run.smithi008.stdout: "client": "client.4668", 2023-08-01T19:56:34.425 INFO:teuthology.orchestra.run.smithi008.stdout: "client_addr": "172.21.15.6:0/1709472247", 2023-08-01T19:56:34.425 INFO:teuthology.orchestra.run.smithi008.stdout: "tid": 107874 2023-08-01T19:56:34.425 INFO:teuthology.orchestra.run.smithi008.stdout: }, 2023-08-01T19:56:34.425 INFO:teuthology.orchestra.run.smithi008.stdout: "events": [ 2023-08-01T19:56:34.425 INFO:teuthology.orchestra.run.smithi008.stdout: { 2023-08-01T19:56:34.425 INFO:teuthology.orchestra.run.smithi008.stdout: "event": "initiated", 2023-08-01T19:56:34.426 INFO:teuthology.orchestra.run.smithi008.stdout: "time": "2023-08-01T19:55:09.286239+0000", 2023-08-01T19:56:34.426 INFO:teuthology.orchestra.run.smithi008.stdout: "duration": 0 2023-08-01T19:56:34.426 INFO:teuthology.orchestra.run.smithi008.stdout: }, 2023-08-01T19:56:34.426 INFO:teuthology.orchestra.run.smithi008.stdout: { 2023-08-01T19:56:34.426 INFO:teuthology.orchestra.run.smithi008.stdout: "event": "throttled", 2023-08-01T19:56:34.426 INFO:teuthology.orchestra.run.smithi008.stdout: "time": "2023-08-01T19:55:09.286239+0000", 2023-08-01T19:56:34.426 INFO:teuthology.orchestra.run.smithi008.stdout: "duration": 0 2023-08-01T19:56:34.427 INFO:teuthology.orchestra.run.smithi008.stdout: }, 2023-08-01T19:56:34.427 INFO:teuthology.orchestra.run.smithi008.stdout: { 2023-08-01T19:56:34.427 INFO:teuthology.orchestra.run.smithi008.stdout: "event": "header_read", 2023-08-01T19:56:34.427 INFO:teuthology.orchestra.run.smithi008.stdout: "time": "2023-08-01T19:55:09.286238+0000", 2023-08-01T19:56:34.427 INFO:teuthology.orchestra.run.smithi008.stdout: "duration": 4294967295.999999 2023-08-01T19:56:34.427 INFO:teuthology.orchestra.run.smithi008.stdout: }, 2023-08-01T19:56:34.427 INFO:teuthology.orchestra.run.smithi008.stdout: { 2023-08-01T19:56:34.427 INFO:teuthology.orchestra.run.smithi008.stdout: "event": "all_read", 2023-08-01T19:56:34.428 INFO:teuthology.orchestra.run.smithi008.stdout: "time": "2023-08-01T19:55:09.286310+0000", 2023-08-01T19:56:34.428 INFO:teuthology.orchestra.run.smithi008.stdout: "duration": 7.2583999999999995e-05 2023-08-01T19:56:34.428 INFO:teuthology.orchestra.run.smithi008.stdout: }, 2023-08-01T19:56:34.428 INFO:teuthology.orchestra.run.smithi008.stdout: { 2023-08-01T19:56:34.428 INFO:teuthology.orchestra.run.smithi008.stdout: "event": "dispatched", 2023-08-01T19:56:34.428 INFO:teuthology.orchestra.run.smithi008.stdout: "time": "2023-08-01T19:55:09.286323+0000", 2023-08-01T19:56:34.428 INFO:teuthology.orchestra.run.smithi008.stdout: "duration": 1.3151e-05 2023-08-01T19:56:34.428 INFO:teuthology.orchestra.run.smithi008.stdout: }, 2023-08-01T19:56:34.429 INFO:teuthology.orchestra.run.smithi008.stdout: { 2023-08-01T19:56:34.429 INFO:teuthology.orchestra.run.smithi008.stdout: "event": "queued_for_pg", 2023-08-01T19:56:34.429 INFO:teuthology.orchestra.run.smithi008.stdout: "time": "2023-08-01T19:55:09.286329+0000", 2023-08-01T19:56:34.429 INFO:teuthology.orchestra.run.smithi008.stdout: "duration": 5.8719999999999999e-06 2023-08-01T19:56:34.429 INFO:teuthology.orchestra.run.smithi008.stdout: }, 2023-08-01T19:56:34.429 INFO:teuthology.orchestra.run.smithi008.stdout: { 2023-08-01T19:56:34.429 INFO:teuthology.orchestra.run.smithi008.stdout: "event": "reached_pg", 2023-08-01T19:56:34.429 INFO:teuthology.orchestra.run.smithi008.stdout: "time": "2023-08-01T19:55:09.286392+0000", 2023-08-01T19:56:34.430 INFO:teuthology.orchestra.run.smithi008.stdout: "duration": 6.2378000000000005e-05 2023-08-01T19:56:34.430 INFO:teuthology.orchestra.run.smithi008.stdout: }, 2023-08-01T19:56:34.430 INFO:teuthology.orchestra.run.smithi008.stdout: { 2023-08-01T19:56:34.430 INFO:teuthology.orchestra.run.smithi008.stdout: "event": "started", 2023-08-01T19:56:34.430 INFO:teuthology.orchestra.run.smithi008.stdout: "time": "2023-08-01T19:55:09.286473+0000", 2023-08-01T19:56:34.430 INFO:teuthology.orchestra.run.smithi008.stdout: "duration": 8.1327000000000002e-05 2023-08-01T19:56:34.430 INFO:teuthology.orchestra.run.smithi008.stdout: }, 2023-08-01T19:56:34.430 INFO:teuthology.orchestra.run.smithi008.stdout: { 2023-08-01T19:56:34.431 INFO:teuthology.orchestra.run.smithi008.stdout: "event": "waiting for subops from 1", 2023-08-01T19:56:34.431 INFO:teuthology.orchestra.run.smithi008.stdout: "time": "2023-08-01T19:55:09.286557+0000", 2023-08-01T19:56:34.431 INFO:teuthology.orchestra.run.smithi008.stdout: "duration": 8.4140000000000004e-05 2023-08-01T19:56:34.431 INFO:teuthology.orchestra.run.smithi008.stdout: }, 2023-08-01T19:56:34.431 INFO:teuthology.orchestra.run.smithi008.stdout: { 2023-08-01T19:56:34.431 INFO:teuthology.orchestra.run.smithi008.stdout: "event": "op_commit", 2023-08-01T19:56:34.431 INFO:teuthology.orchestra.run.smithi008.stdout: "time": "2023-08-01T19:55:09.290681+0000", 2023-08-01T19:56:34.431 INFO:teuthology.orchestra.run.smithi008.stdout: "duration": 0.0041242420000000002 2023-08-01T19:56:34.432 INFO:teuthology.orchestra.run.smithi008.stdout: }, 2023-08-01T19:56:34.432 INFO:teuthology.orchestra.run.smithi008.stdout: { 2023-08-01T19:56:34.432 INFO:teuthology.orchestra.run.smithi008.stdout: "event": "sub_op_commit_rec", 2023-08-01T19:56:34.432 INFO:teuthology.orchestra.run.smithi008.stdout: "time": "2023-08-01T19:55:09.354372+0000", 2023-08-01T19:56:34.432 INFO:teuthology.orchestra.run.smithi008.stdout: "duration": 0.063690438000000002 2023-08-01T19:56:34.432 INFO:teuthology.orchestra.run.smithi008.stdout: }, 2023-08-01T19:56:34.432 INFO:teuthology.orchestra.run.smithi008.stdout: { 2023-08-01T19:56:34.433 INFO:teuthology.orchestra.run.smithi008.stdout: "event": "commit_sent", 2023-08-01T19:56:34.433 INFO:teuthology.orchestra.run.smithi008.stdout: "time": "2023-08-01T19:55:09.354421+0000", 2023-08-01T19:56:34.433 INFO:teuthology.orchestra.run.smithi008.stdout: "duration": 4.9413000000000003e-05 2023-08-01T19:56:34.433 INFO:teuthology.orchestra.run.smithi008.stdout: }, 2023-08-01T19:56:34.433 INFO:teuthology.orchestra.run.smithi008.stdout: { 2023-08-01T19:56:34.433 INFO:teuthology.orchestra.run.smithi008.stdout: "event": "done", 2023-08-01T19:56:34.433 INFO:teuthology.orchestra.run.smithi008.stdout: "time": "2023-08-01T19:55:09.354463+0000", 2023-08-01T19:56:34.433 INFO:teuthology.orchestra.run.smithi008.stdout: "duration": 4.1924e-05 2023-08-01T19:56:34.434 INFO:teuthology.orchestra.run.smithi008.stdout: } 2023-08-01T19:56:34.434 INFO:teuthology.orchestra.run.smithi008.stdout: ] 2023-08-01T19:56:34.434 INFO:teuthology.orchestra.run.smithi008.stdout: } 2023-08-01T19:56:34.434 INFO:teuthology.orchestra.run.smithi008.stdout: }, 2023-08-01T19:56:34.434 INFO:teuthology.orchestra.run.smithi008.stdout: { 2023-08-01T19:56:34.434 INFO:teuthology.orchestra.run.smithi008.stdout: "description": "osd_op(client.4668.0:197398 5.1 5:809d7164:::benchmark_data_smithi006_114134_object63737:head [delete] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e61)", 2023-08-01T19:56:34.434 INFO:teuthology.orchestra.run.smithi008.stdout: "initiated_at": "2023-08-01T19:55:58.554713+0000", 2023-08-01T19:56:34.434 INFO:teuthology.orchestra.run.smithi008.stdout: "age": 35.786467553000001, 2023-08-01T19:56:34.435 INFO:teuthology.orchestra.run.smithi008.stdout: "duration": 1.0661326660000001, 2023-08-01T19:56:34.435 INFO:teuthology.orchestra.run.smithi008.stdout: "type_data": { 2023-08-01T19:56:34.435 INFO:teuthology.orchestra.run.smithi008.stdout: "flag_point": "reached pg", 2023-08-01T19:56:34.435 INFO:teuthology.orchestra.run.smithi008.stdout: "client_info": { 2023-08-01T19:56:34.435 INFO:teuthology.orchestra.run.smithi008.stdout: "client": "client.4668", 2023-08-01T19:56:34.435 INFO:teuthology.orchestra.run.smithi008.stdout: "client_addr": "172.21.15.6:0/1709472247", 2023-08-01T19:56:34.435 INFO:teuthology.orchestra.run.smithi008.stdout: "tid": 197398 2023-08-01T19:56:34.435 INFO:teuthology.orchestra.run.smithi008.stdout: }, 2023-08-01T19:56:34.436 INFO:teuthology.orchestra.run.smithi008.stdout: "events": [ 2023-08-01T19:56:34.436 INFO:teuthology.orchestra.run.smithi008.stdout: { 2023-08-01T19:56:34.436 INFO:teuthology.orchestra.run.smithi008.stdout: "event": "initiated", 2023-08-01T19:56:34.436 INFO:teuthology.orchestra.run.smithi008.stdout: "time": "2023-08-01T19:55:58.554713+0000", 2023-08-01T19:56:34.436 INFO:teuthology.orchestra.run.smithi008.stdout: "duration": 0 2023-08-01T19:56:34.436 INFO:teuthology.orchestra.run.smithi008.stdout: }, 2023-08-01T19:56:34.436 INFO:teuthology.orchestra.run.smithi008.stdout: { 2023-08-01T19:56:34.436 INFO:teuthology.orchestra.run.smithi008.stdout: "event": "throttled", 2023-08-01T19:56:34.437 INFO:teuthology.orchestra.run.smithi008.stdout: "time": "2023-08-01T19:55:58.554713+0000", 2023-08-01T19:56:34.437 INFO:teuthology.orchestra.run.smithi008.stdout: "duration": 0 2023-08-01T19:56:34.437 INFO:teuthology.orchestra.run.smithi008.stdout: }, 2023-08-01T19:56:34.437 INFO:teuthology.orchestra.run.smithi008.stdout: { 2023-08-01T19:56:34.437 INFO:teuthology.orchestra.run.smithi008.stdout: "event": "header_read", 2023-08-01T19:56:34.437 INFO:teuthology.orchestra.run.smithi008.stdout: "time": "2023-08-01T19:55:58.554713+0000", 2023-08-01T19:56:34.437 INFO:teuthology.orchestra.run.smithi008.stdout: "duration": 4294967295.999999 2023-08-01T19:56:34.437 INFO:teuthology.orchestra.run.smithi008.stdout: }, 2023-08-01T19:56:34.438 INFO:teuthology.orchestra.run.smithi008.stdout: { 2023-08-01T19:56:34.438 INFO:teuthology.orchestra.run.smithi008.stdout: "event": "all_read", 2023-08-01T19:56:34.438 INFO:teuthology.orchestra.run.smithi008.stdout: "time": "2023-08-01T19:55:58.554717+0000", 2023-08-01T19:56:34.438 INFO:teuthology.orchestra.run.smithi008.stdout: "duration": 4.7389999999999999e-06 2023-08-01T19:56:34.438 INFO:teuthology.orchestra.run.smithi008.stdout: }, 2023-08-01T19:56:34.438 INFO:teuthology.orchestra.run.smithi008.stdout: { 2023-08-01T19:56:34.438 INFO:teuthology.orchestra.run.smithi008.stdout: "event": "dispatched", 2023-08-01T19:56:34.439 INFO:teuthology.orchestra.run.smithi008.stdout: "time": "2023-08-01T19:55:58.554725+0000", 2023-08-01T19:56:34.439 INFO:teuthology.orchestra.run.smithi008.stdout: "duration": 7.9820000000000008e-06 2023-08-01T19:56:34.439 INFO:teuthology.orchestra.run.smithi008.stdout: }, 2023-08-01T19:56:34.439 INFO:teuthology.orchestra.run.smithi008.stdout: { 2023-08-01T19:56:34.439 INFO:teuthology.orchestra.run.smithi008.stdout: "event": "queued_for_pg", 2023-08-01T19:56:34.439 INFO:teuthology.orchestra.run.smithi008.stdout: "time": "2023-08-01T19:55:58.554730+0000", 2023-08-01T19:56:34.439 INFO:teuthology.orchestra.run.smithi008.stdout: "duration": 4.318e-06 2023-08-01T19:56:34.439 INFO:teuthology.orchestra.run.smithi008.stdout: }, 2023-08-01T19:56:34.440 INFO:teuthology.orchestra.run.smithi008.stdout: { 2023-08-01T19:56:34.440 INFO:teuthology.orchestra.run.smithi008.stdout: "event": "reached_pg", 2023-08-01T19:56:34.440 INFO:teuthology.orchestra.run.smithi008.stdout: "time": "2023-08-01T19:55:58.554767+0000", 2023-08-01T19:56:34.440 INFO:teuthology.orchestra.run.smithi008.stdout: "duration": 3.7778000000000003e-05 2023-08-01T19:56:34.440 INFO:teuthology.orchestra.run.smithi008.stdout: }, 2023-08-01T19:56:34.440 INFO:teuthology.orchestra.run.smithi008.stdout: { 2023-08-01T19:56:34.440 INFO:teuthology.orchestra.run.smithi008.stdout: "event": "started", 2023-08-01T19:56:34.440 INFO:teuthology.orchestra.run.smithi008.stdout: "time": "2023-08-01T19:55:58.554874+0000", 2023-08-01T19:56:34.441 INFO:teuthology.orchestra.run.smithi008.stdout: "duration": 0.000106613 2023-08-01T19:56:34.441 INFO:teuthology.orchestra.run.smithi008.stdout: }, 2023-08-01T19:56:34.441 INFO:teuthology.orchestra.run.smithi008.stdout: { 2023-08-01T19:56:34.441 INFO:teuthology.orchestra.run.smithi008.stdout: "event": "waiting for subops from 1", 2023-08-01T19:56:34.441 INFO:teuthology.orchestra.run.smithi008.stdout: "time": "2023-08-01T19:55:58.554941+0000", 2023-08-01T19:56:34.441 INFO:teuthology.orchestra.run.smithi008.stdout: "duration": 6.6569000000000006e-05 2023-08-01T19:56:34.441 INFO:teuthology.orchestra.run.smithi008.stdout: }, 2023-08-01T19:56:34.441 INFO:teuthology.orchestra.run.smithi008.stdout: { 2023-08-01T19:56:34.442 INFO:teuthology.orchestra.run.smithi008.stdout: "event": "reached_pg", 2023-08-01T19:56:34.442 INFO:teuthology.orchestra.run.smithi008.stdout: "time": "2023-08-01T19:55:58.569436+0000", 2023-08-01T19:56:34.442 INFO:teuthology.orchestra.run.smithi008.stdout: "duration": 0.014495413 2023-08-01T19:56:34.442 INFO:teuthology.orchestra.run.smithi008.stdout: }, 2023-08-01T19:56:34.442 INFO:teuthology.orchestra.run.smithi008.stdout: { 2023-08-01T19:56:34.442 INFO:teuthology.orchestra.run.smithi008.stdout: "event": "waiting for peered", 2023-08-01T19:56:34.442 INFO:teuthology.orchestra.run.smithi008.stdout: "time": "2023-08-01T19:55:58.569441+0000", 2023-08-01T19:56:34.442 INFO:teuthology.orchestra.run.smithi008.stdout: "duration": 5.1109999999999999e-06 2023-08-01T19:56:34.443 INFO:teuthology.orchestra.run.smithi008.stdout: }, 2023-08-01T19:56:34.443 INFO:teuthology.orchestra.run.smithi008.stdout: { 2023-08-01T19:56:34.443 INFO:teuthology.orchestra.run.smithi008.stdout: "event": "reached_pg", 2023-08-01T19:56:34.443 INFO:teuthology.orchestra.run.smithi008.stdout: "time": "2023-08-01T19:55:59.620748+0000", 2023-08-01T19:56:34.443 INFO:teuthology.orchestra.run.smithi008.stdout: "duration": 1.0513071810000001 2023-08-01T19:56:34.443 INFO:teuthology.orchestra.run.smithi008.stdout: }, 2023-08-01T19:56:34.443 INFO:teuthology.orchestra.run.smithi008.stdout: { 2023-08-01T19:56:34.444 INFO:teuthology.orchestra.run.smithi008.stdout: "event": "done", 2023-08-01T19:56:34.444 INFO:teuthology.orchestra.run.smithi008.stdout: "time": "2023-08-01T19:55:59.620846+0000", 2023-08-01T19:56:34.444 INFO:teuthology.orchestra.run.smithi008.stdout: "duration": 9.7739999999999996e-05 2023-08-01T19:56:34.444 INFO:teuthology.orchestra.run.smithi008.stdout: } 2023-08-01T19:56:34.444 INFO:teuthology.orchestra.run.smithi008.stdout: ] 2023-08-01T19:56:34.444 INFO:teuthology.orchestra.run.smithi008.stdout: } 2023-08-01T19:56:34.444 INFO:teuthology.orchestra.run.smithi008.stdout: }, 2023-08-01T19:56:34.444 INFO:teuthology.orchestra.run.smithi008.stdout: { 2023-08-01T19:56:34.445 INFO:teuthology.orchestra.run.smithi008.stdout: "description": "osd_op(client.4668.0:197400 5.c 5:30dad7f9:::benchmark_data_smithi006_114134_object63739:head [delete] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e61)", 2023-08-01T19:56:34.445 INFO:teuthology.orchestra.run.smithi008.stdout: "initiated_at": "2023-08-01T19:55:58.556576+0000", 2023-08-01T19:56:34.445 INFO:teuthology.orchestra.run.smithi008.stdout: "age": 35.784604704000003, 2023-08-01T19:56:34.445 INFO:teuthology.orchestra.run.smithi008.stdout: "duration": 1.062559968, 2023-08-01T19:56:34.445 INFO:teuthology.orchestra.run.smithi008.stdout: "type_data": { 2023-08-01T19:56:34.445 INFO:teuthology.orchestra.run.smithi008.stdout: "flag_point": "reached pg", 2023-08-01T19:56:34.445 INFO:teuthology.orchestra.run.smithi008.stdout: "client_info": { 2023-08-01T19:56:34.445 INFO:teuthology.orchestra.run.smithi008.stdout: "client": "client.4668", 2023-08-01T19:56:34.446 INFO:teuthology.orchestra.run.smithi008.stdout: "client_addr": "172.21.15.6:0/1709472247", 2023-08-01T19:56:34.446 INFO:teuthology.orchestra.run.smithi008.stdout: "tid": 197400 2023-08-01T19:56:34.446 INFO:teuthology.orchestra.run.smithi008.stdout: }, 2023-08-01T19:56:34.446 INFO:teuthology.orchestra.run.smithi008.stdout: "events": [ 2023-08-01T19:56:34.446 INFO:teuthology.orchestra.run.smithi008.stdout: { 2023-08-01T19:56:34.446 INFO:teuthology.orchestra.run.smithi008.stdout: "event": "initiated", 2023-08-01T19:56:34.446 INFO:teuthology.orchestra.run.smithi008.stdout: "time": "2023-08-01T19:55:58.556576+0000", 2023-08-01T19:56:34.446 INFO:teuthology.orchestra.run.smithi008.stdout: "duration": 0 2023-08-01T19:56:34.447 INFO:teuthology.orchestra.run.smithi008.stdout: }, 2023-08-01T19:56:34.447 INFO:teuthology.orchestra.run.smithi008.stdout: { 2023-08-01T19:56:34.447 INFO:teuthology.orchestra.run.smithi008.stdout: "event": "throttled", 2023-08-01T19:56:34.447 INFO:teuthology.orchestra.run.smithi008.stdout: "time": "2023-08-01T19:55:58.556576+0000", 2023-08-01T19:56:34.447 INFO:teuthology.orchestra.run.smithi008.stdout: "duration": 0 2023-08-01T19:56:34.447 INFO:teuthology.orchestra.run.smithi008.stdout: }, 2023-08-01T19:56:34.447 INFO:teuthology.orchestra.run.smithi008.stdout: { 2023-08-01T19:56:34.448 INFO:teuthology.orchestra.run.smithi008.stdout: "event": "header_read", 2023-08-01T19:56:34.448 INFO:teuthology.orchestra.run.smithi008.stdout: "time": "2023-08-01T19:55:58.556575+0000", 2023-08-01T19:56:34.448 INFO:teuthology.orchestra.run.smithi008.stdout: "duration": 4294967295.999999 2023-08-01T19:56:34.448 INFO:teuthology.orchestra.run.smithi008.stdout: }, 2023-08-01T19:56:34.448 INFO:teuthology.orchestra.run.smithi008.stdout: { 2023-08-01T19:56:34.448 INFO:teuthology.orchestra.run.smithi008.stdout: "event": "all_read", 2023-08-01T19:56:34.448 INFO:teuthology.orchestra.run.smithi008.stdout: "time": "2023-08-01T19:55:58.556580+0000", 2023-08-01T19:56:34.448 INFO:teuthology.orchestra.run.smithi008.stdout: "duration": 4.2860000000000001e-06 2023-08-01T19:56:34.449 INFO:teuthology.orchestra.run.smithi008.stdout: }, 2023-08-01T19:56:34.449 INFO:teuthology.orchestra.run.smithi008.stdout: { 2023-08-01T19:56:34.449 INFO:teuthology.orchestra.run.smithi008.stdout: "event": "dispatched", 2023-08-01T19:56:34.449 INFO:teuthology.orchestra.run.smithi008.stdout: "time": "2023-08-01T19:55:58.556589+0000", 2023-08-01T19:56:34.449 INFO:teuthology.orchestra.run.smithi008.stdout: "duration": 9.6500000000000008e-06 2023-08-01T19:56:34.449 INFO:teuthology.orchestra.run.smithi008.stdout: }, 2023-08-01T19:56:34.449 INFO:teuthology.orchestra.run.smithi008.stdout: { 2023-08-01T19:56:34.449 INFO:teuthology.orchestra.run.smithi008.stdout: "event": "queued_for_pg", 2023-08-01T19:56:34.450 INFO:teuthology.orchestra.run.smithi008.stdout: "time": "2023-08-01T19:55:58.556596+0000", 2023-08-01T19:56:34.450 INFO:teuthology.orchestra.run.smithi008.stdout: "duration": 6.1430000000000003e-06 2023-08-01T19:56:34.450 INFO:teuthology.orchestra.run.smithi008.stdout: }, 2023-08-01T19:56:34.450 INFO:teuthology.orchestra.run.smithi008.stdout: { 2023-08-01T19:56:34.450 INFO:teuthology.orchestra.run.smithi008.stdout: "event": "reached_pg", 2023-08-01T19:56:34.450 INFO:teuthology.orchestra.run.smithi008.stdout: "time": "2023-08-01T19:55:58.556634+0000", 2023-08-01T19:56:34.450 INFO:teuthology.orchestra.run.smithi008.stdout: "duration": 3.8080000000000001e-05 2023-08-01T19:56:34.450 INFO:teuthology.orchestra.run.smithi008.stdout: }, 2023-08-01T19:56:34.451 INFO:teuthology.orchestra.run.smithi008.stdout: { 2023-08-01T19:56:34.451 INFO:teuthology.orchestra.run.smithi008.stdout: "event": "started", 2023-08-01T19:56:34.451 INFO:teuthology.orchestra.run.smithi008.stdout: "time": "2023-08-01T19:55:58.556754+0000", 2023-08-01T19:56:34.451 INFO:teuthology.orchestra.run.smithi008.stdout: "duration": 0.000120444 2023-08-01T19:56:34.451 INFO:teuthology.orchestra.run.smithi008.stdout: }, 2023-08-01T19:56:34.451 INFO:teuthology.orchestra.run.smithi008.stdout: { 2023-08-01T19:56:34.451 INFO:teuthology.orchestra.run.smithi008.stdout: "event": "waiting for subops from 1", 2023-08-01T19:56:34.452 INFO:teuthology.orchestra.run.smithi008.stdout: "time": "2023-08-01T19:55:58.556875+0000", 2023-08-01T19:56:34.452 INFO:teuthology.orchestra.run.smithi008.stdout: "duration": 0.00012100900000000001 2023-08-01T19:56:34.452 INFO:teuthology.orchestra.run.smithi008.stdout: }, 2023-08-01T19:56:34.452 INFO:teuthology.orchestra.run.smithi008.stdout: { 2023-08-01T19:56:34.452 INFO:teuthology.orchestra.run.smithi008.stdout: "event": "reached_pg", 2023-08-01T19:56:34.452 INFO:teuthology.orchestra.run.smithi008.stdout: "time": "2023-08-01T19:55:58.567406+0000", 2023-08-01T19:56:34.452 INFO:teuthology.orchestra.run.smithi008.stdout: "duration": 0.010531351 2023-08-01T19:56:34.452 INFO:teuthology.orchestra.run.smithi008.stdout: }, 2023-08-01T19:56:34.453 INFO:teuthology.orchestra.run.smithi008.stdout: { 2023-08-01T19:56:34.453 INFO:teuthology.orchestra.run.smithi008.stdout: "event": "waiting for peered", 2023-08-01T19:56:34.453 INFO:teuthology.orchestra.run.smithi008.stdout: "time": "2023-08-01T19:55:58.567414+0000", 2023-08-01T19:56:34.453 INFO:teuthology.orchestra.run.smithi008.stdout: "duration": 7.9189999999999999e-06 2023-08-01T19:56:34.453 INFO:teuthology.orchestra.run.smithi008.stdout: }, 2023-08-01T19:56:34.453 INFO:teuthology.orchestra.run.smithi008.stdout: { 2023-08-01T19:56:34.453 INFO:teuthology.orchestra.run.smithi008.stdout: "event": "reached_pg", 2023-08-01T19:56:34.453 INFO:teuthology.orchestra.run.smithi008.stdout: "time": "2023-08-01T19:55:59.619054+0000", 2023-08-01T19:56:34.454 INFO:teuthology.orchestra.run.smithi008.stdout: "duration": 1.0516396269999999 2023-08-01T19:56:34.454 INFO:teuthology.orchestra.run.smithi008.stdout: }, 2023-08-01T19:56:34.454 INFO:teuthology.orchestra.run.smithi008.stdout: { 2023-08-01T19:56:34.454 INFO:teuthology.orchestra.run.smithi008.stdout: "event": "done", 2023-08-01T19:56:34.454 INFO:teuthology.orchestra.run.smithi008.stdout: "time": "2023-08-01T19:55:59.619136+0000", 2023-08-01T19:56:34.454 INFO:teuthology.orchestra.run.smithi008.stdout: "duration": 8.2208999999999998e-05 2023-08-01T19:56:34.454 INFO:teuthology.orchestra.run.smithi008.stdout: } 2023-08-01T19:56:34.454 INFO:teuthology.orchestra.run.smithi008.stdout: ] 2023-08-01T19:56:34.455 INFO:teuthology.orchestra.run.smithi008.stdout: } 2023-08-01T19:56:34.455 INFO:teuthology.orchestra.run.smithi008.stdout: }, 2023-08-01T19:56:34.455 INFO:teuthology.orchestra.run.smithi008.stdout: { 2023-08-01T19:56:34.455 INFO:teuthology.orchestra.run.smithi008.stdout: "description": "osd_op(client.4668.0:197401 5.1 5:88b38567:::benchmark_data_smithi006_114134_object63740:head [delete] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e61)", 2023-08-01T19:56:34.455 INFO:teuthology.orchestra.run.smithi008.stdout: "initiated_at": "2023-08-01T19:55:58.556607+0000", 2023-08-01T19:56:34.455 INFO:teuthology.orchestra.run.smithi008.stdout: "age": 35.784574280000001, 2023-08-01T19:56:34.455 INFO:teuthology.orchestra.run.smithi008.stdout: "duration": 1.0643254870000001, 2023-08-01T19:56:34.456 INFO:teuthology.orchestra.run.smithi008.stdout: "type_data": { 2023-08-01T19:56:34.456 INFO:teuthology.orchestra.run.smithi008.stdout: "flag_point": "reached pg", 2023-08-01T19:56:34.456 INFO:teuthology.orchestra.run.smithi008.stdout: "client_info": { 2023-08-01T19:56:34.456 INFO:teuthology.orchestra.run.smithi008.stdout: "client": "client.4668", 2023-08-01T19:56:34.456 INFO:teuthology.orchestra.run.smithi008.stdout: "client_addr": "172.21.15.6:0/1709472247", 2023-08-01T19:56:34.456 INFO:teuthology.orchestra.run.smithi008.stdout: "tid": 197401 2023-08-01T19:56:34.456 INFO:teuthology.orchestra.run.smithi008.stdout: }, 2023-08-01T19:56:34.456 INFO:teuthology.orchestra.run.smithi008.stdout: "events": [ 2023-08-01T19:56:34.457 INFO:teuthology.orchestra.run.smithi008.stdout: { 2023-08-01T19:56:34.457 INFO:teuthology.orchestra.run.smithi008.stdout: "event": "initiated", 2023-08-01T19:56:34.457 INFO:teuthology.orchestra.run.smithi008.stdout: "time": "2023-08-01T19:55:58.556607+0000", 2023-08-01T19:56:34.457 INFO:teuthology.orchestra.run.smithi008.stdout: "duration": 0 2023-08-01T19:56:34.457 INFO:teuthology.orchestra.run.smithi008.stdout: }, 2023-08-01T19:56:34.457 INFO:teuthology.orchestra.run.smithi008.stdout: { 2023-08-01T19:56:34.457 INFO:teuthology.orchestra.run.smithi008.stdout: "event": "throttled", 2023-08-01T19:56:34.457 INFO:teuthology.orchestra.run.smithi008.stdout: "time": "2023-08-01T19:55:58.556607+0000", 2023-08-01T19:56:34.458 INFO:teuthology.orchestra.run.smithi008.stdout: "duration": 0 2023-08-01T19:56:34.458 INFO:teuthology.orchestra.run.smithi008.stdout: }, 2023-08-01T19:56:34.458 INFO:teuthology.orchestra.run.smithi008.stdout: { 2023-08-01T19:56:34.458 INFO:teuthology.orchestra.run.smithi008.stdout: "event": "header_read", 2023-08-01T19:56:34.458 INFO:teuthology.orchestra.run.smithi008.stdout: "time": "2023-08-01T19:55:58.556606+0000", 2023-08-01T19:56:34.458 INFO:teuthology.orchestra.run.smithi008.stdout: "duration": 4294967295.9999995 2023-08-01T19:56:34.458 INFO:teuthology.orchestra.run.smithi008.stdout: }, 2023-08-01T19:56:34.458 INFO:teuthology.orchestra.run.smithi008.stdout: { 2023-08-01T19:56:34.459 INFO:teuthology.orchestra.run.smithi008.stdout: "event": "all_read", 2023-08-01T19:56:34.459 INFO:teuthology.orchestra.run.smithi008.stdout: "time": "2023-08-01T19:55:58.556609+0000", 2023-08-01T19:56:34.459 INFO:teuthology.orchestra.run.smithi008.stdout: "duration": 3.1750000000000001e-06 2023-08-01T19:56:34.459 INFO:teuthology.orchestra.run.smithi008.stdout: }, 2023-08-01T19:56:34.459 INFO:teuthology.orchestra.run.smithi008.stdout: { 2023-08-01T19:56:34.459 INFO:teuthology.orchestra.run.smithi008.stdout: "event": "dispatched", 2023-08-01T19:56:34.459 INFO:teuthology.orchestra.run.smithi008.stdout: "time": "2023-08-01T19:55:58.556617+0000", 2023-08-01T19:56:34.459 INFO:teuthology.orchestra.run.smithi008.stdout: "duration": 7.2760000000000003e-06 2023-08-01T19:56:34.460 INFO:teuthology.orchestra.run.smithi008.stdout: }, 2023-08-01T19:56:34.460 INFO:teuthology.orchestra.run.smithi008.stdout: { 2023-08-01T19:56:34.460 INFO:teuthology.orchestra.run.smithi008.stdout: "event": "queued_for_pg", 2023-08-01T19:56:34.460 INFO:teuthology.orchestra.run.smithi008.stdout: "time": "2023-08-01T19:55:58.556621+0000", 2023-08-01T19:56:34.460 INFO:teuthology.orchestra.run.smithi008.stdout: "duration": 4.8219999999999997e-06 2023-08-01T19:56:34.460 INFO:teuthology.orchestra.run.smithi008.stdout: }, 2023-08-01T19:56:34.460 INFO:teuthology.orchestra.run.smithi008.stdout: { 2023-08-01T19:56:34.461 INFO:teuthology.orchestra.run.smithi008.stdout: "event": "reached_pg", 2023-08-01T19:56:34.461 INFO:teuthology.orchestra.run.smithi008.stdout: "time": "2023-08-01T19:55:58.556651+0000", 2023-08-01T19:56:34.461 INFO:teuthology.orchestra.run.smithi008.stdout: "duration": 2.9921999999999999e-05 2023-08-01T19:56:34.461 INFO:teuthology.orchestra.run.smithi008.stdout: }, 2023-08-01T19:56:34.461 INFO:teuthology.orchestra.run.smithi008.stdout: { 2023-08-01T19:56:34.461 INFO:teuthology.orchestra.run.smithi008.stdout: "event": "started", 2023-08-01T19:56:34.461 INFO:teuthology.orchestra.run.smithi008.stdout: "time": "2023-08-01T19:55:58.556755+0000", 2023-08-01T19:56:34.461 INFO:teuthology.orchestra.run.smithi008.stdout: "duration": 0.000103309 2023-08-01T19:56:34.462 INFO:teuthology.orchestra.run.smithi008.stdout: }, 2023-08-01T19:56:34.462 INFO:teuthology.orchestra.run.smithi008.stdout: { 2023-08-01T19:56:34.462 INFO:teuthology.orchestra.run.smithi008.stdout: "event": "waiting for subops from 1", 2023-08-01T19:56:34.462 INFO:teuthology.orchestra.run.smithi008.stdout: "time": "2023-08-01T19:55:58.556875+0000", 2023-08-01T19:56:34.462 INFO:teuthology.orchestra.run.smithi008.stdout: "duration": 0.000120424 2023-08-01T19:56:34.462 INFO:teuthology.orchestra.run.smithi008.stdout: }, 2023-08-01T19:56:34.462 INFO:teuthology.orchestra.run.smithi008.stdout: { 2023-08-01T19:56:34.462 INFO:teuthology.orchestra.run.smithi008.stdout: "event": "reached_pg", 2023-08-01T19:56:34.463 INFO:teuthology.orchestra.run.smithi008.stdout: "time": "2023-08-01T19:55:58.569459+0000", 2023-08-01T19:56:34.463 INFO:teuthology.orchestra.run.smithi008.stdout: "duration": 0.012583776 2023-08-01T19:56:34.463 INFO:teuthology.orchestra.run.smithi008.stdout: }, 2023-08-01T19:56:34.463 INFO:teuthology.orchestra.run.smithi008.stdout: { 2023-08-01T19:56:34.463 INFO:teuthology.orchestra.run.smithi008.stdout: "event": "waiting for peered", 2023-08-01T19:56:34.463 INFO:teuthology.orchestra.run.smithi008.stdout: "time": "2023-08-01T19:55:58.569462+0000", 2023-08-01T19:56:34.463 INFO:teuthology.orchestra.run.smithi008.stdout: "duration": 2.74e-06 2023-08-01T19:56:34.463 INFO:teuthology.orchestra.run.smithi008.stdout: }, 2023-08-01T19:56:34.464 INFO:teuthology.orchestra.run.smithi008.stdout: { 2023-08-01T19:56:34.464 INFO:teuthology.orchestra.run.smithi008.stdout: "event": "reached_pg", 2023-08-01T19:56:34.464 INFO:teuthology.orchestra.run.smithi008.stdout: "time": "2023-08-01T19:55:59.620880+0000", 2023-08-01T19:56:34.464 INFO:teuthology.orchestra.run.smithi008.stdout: "duration": 1.0514181279999999 2023-08-01T19:56:34.464 INFO:teuthology.orchestra.run.smithi008.stdout: }, 2023-08-01T19:56:34.464 INFO:teuthology.orchestra.run.smithi008.stdout: { 2023-08-01T19:56:34.464 INFO:teuthology.orchestra.run.smithi008.stdout: "event": "done", 2023-08-01T19:56:34.464 INFO:teuthology.orchestra.run.smithi008.stdout: "time": "2023-08-01T19:55:59.620932+0000", 2023-08-01T19:56:34.465 INFO:teuthology.orchestra.run.smithi008.stdout: "duration": 5.2404000000000002e-05 2023-08-01T19:56:34.465 INFO:teuthology.orchestra.run.smithi008.stdout: } 2023-08-01T19:56:34.465 INFO:teuthology.orchestra.run.smithi008.stdout: ] 2023-08-01T19:56:34.465 INFO:teuthology.orchestra.run.smithi008.stdout: } 2023-08-01T19:56:34.465 INFO:teuthology.orchestra.run.smithi008.stdout: }, 2023-08-01T19:56:34.465 INFO:teuthology.orchestra.run.smithi008.stdout: { 2023-08-01T19:56:34.465 INFO:teuthology.orchestra.run.smithi008.stdout: "description": "osd_op(client.4668.0:197402 5.c 5:3f057b78:::benchmark_data_smithi006_114134_object63741:head [delete] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e61)", 2023-08-01T19:56:34.465 INFO:teuthology.orchestra.run.smithi008.stdout: "initiated_at": "2023-08-01T19:55:58.556632+0000", 2023-08-01T19:56:34.466 INFO:teuthology.orchestra.run.smithi008.stdout: "age": 35.784548909999998, 2023-08-01T19:56:34.466 INFO:teuthology.orchestra.run.smithi008.stdout: "duration": 1.0625773970000001, 2023-08-01T19:56:34.466 INFO:teuthology.orchestra.run.smithi008.stdout: "type_data": { 2023-08-01T19:56:34.466 INFO:teuthology.orchestra.run.smithi008.stdout: "flag_point": "reached pg", 2023-08-01T19:56:34.466 INFO:teuthology.orchestra.run.smithi008.stdout: "client_info": { 2023-08-01T19:56:34.466 INFO:teuthology.orchestra.run.smithi008.stdout: "client": "client.4668", 2023-08-01T19:56:34.466 INFO:teuthology.orchestra.run.smithi008.stdout: "client_addr": "172.21.15.6:0/1709472247", 2023-08-01T19:56:34.466 INFO:teuthology.orchestra.run.smithi008.stdout: "tid": 197402 2023-08-01T19:56:34.467 INFO:teuthology.orchestra.run.smithi008.stdout: }, 2023-08-01T19:56:34.467 INFO:teuthology.orchestra.run.smithi008.stdout: "events": [ 2023-08-01T19:56:34.467 INFO:teuthology.orchestra.run.smithi008.stdout: { 2023-08-01T19:56:34.467 INFO:teuthology.orchestra.run.smithi008.stdout: "event": "initiated", 2023-08-01T19:56:34.467 INFO:teuthology.orchestra.run.smithi008.stdout: "time": "2023-08-01T19:55:58.556632+0000", 2023-08-01T19:56:34.467 INFO:teuthology.orchestra.run.smithi008.stdout: "duration": 0 2023-08-01T19:56:34.467 INFO:teuthology.orchestra.run.smithi008.stdout: }, 2023-08-01T19:56:34.468 INFO:teuthology.orchestra.run.smithi008.stdout: { 2023-08-01T19:56:34.468 INFO:teuthology.orchestra.run.smithi008.stdout: "event": "throttled", 2023-08-01T19:56:34.468 INFO:teuthology.orchestra.run.smithi008.stdout: "time": "2023-08-01T19:55:58.556632+0000", 2023-08-01T19:56:34.468 INFO:teuthology.orchestra.run.smithi008.stdout: "duration": 0 2023-08-01T19:56:34.468 INFO:teuthology.orchestra.run.smithi008.stdout: }, 2023-08-01T19:56:34.468 INFO:teuthology.orchestra.run.smithi008.stdout: { 2023-08-01T19:56:34.468 INFO:teuthology.orchestra.run.smithi008.stdout: "event": "header_read", 2023-08-01T19:56:34.468 INFO:teuthology.orchestra.run.smithi008.stdout: "time": "2023-08-01T19:55:58.556632+0000", 2023-08-01T19:56:34.469 INFO:teuthology.orchestra.run.smithi008.stdout: "duration": 4294967295.9999995 2023-08-01T19:56:34.469 INFO:teuthology.orchestra.run.smithi008.stdout: }, 2023-08-01T19:56:34.469 INFO:teuthology.orchestra.run.smithi008.stdout: { 2023-08-01T19:56:34.469 INFO:teuthology.orchestra.run.smithi008.stdout: "event": "all_read", 2023-08-01T19:56:34.469 INFO:teuthology.orchestra.run.smithi008.stdout: "time": "2023-08-01T19:55:58.556634+0000", 2023-08-01T19:56:34.469 INFO:teuthology.orchestra.run.smithi008.stdout: "duration": 2.8940000000000002e-06 2023-08-01T19:56:34.470 INFO:teuthology.orchestra.run.smithi008.stdout: }, 2023-08-01T19:56:34.470 INFO:teuthology.orchestra.run.smithi008.stdout: { 2023-08-01T19:56:34.470 INFO:teuthology.orchestra.run.smithi008.stdout: "event": "dispatched", 2023-08-01T19:56:34.470 INFO:teuthology.orchestra.run.smithi008.stdout: "time": "2023-08-01T19:55:58.556641+0000", 2023-08-01T19:56:34.470 INFO:teuthology.orchestra.run.smithi008.stdout: "duration": 6.8449999999999997e-06 2023-08-01T19:56:34.470 INFO:teuthology.orchestra.run.smithi008.stdout: }, 2023-08-01T19:56:34.470 INFO:teuthology.orchestra.run.smithi008.stdout: { 2023-08-01T19:56:34.470 INFO:teuthology.orchestra.run.smithi008.stdout: "event": "queued_for_pg", 2023-08-01T19:56:34.471 INFO:teuthology.orchestra.run.smithi008.stdout: "time": "2023-08-01T19:55:58.556646+0000", 2023-08-01T19:56:34.471 INFO:teuthology.orchestra.run.smithi008.stdout: "duration": 5.2070000000000003e-06 2023-08-01T19:56:34.471 INFO:teuthology.orchestra.run.smithi008.stdout: }, 2023-08-01T19:56:34.471 INFO:teuthology.orchestra.run.smithi008.stdout: { 2023-08-01T19:56:34.471 INFO:teuthology.orchestra.run.smithi008.stdout: "event": "reached_pg", 2023-08-01T19:56:34.471 INFO:teuthology.orchestra.run.smithi008.stdout: "time": "2023-08-01T19:55:58.558870+0000", 2023-08-01T19:56:34.471 INFO:teuthology.orchestra.run.smithi008.stdout: "duration": 0.0022237730000000001 2023-08-01T19:56:34.471 INFO:teuthology.orchestra.run.smithi008.stdout: }, 2023-08-01T19:56:34.472 INFO:teuthology.orchestra.run.smithi008.stdout: { 2023-08-01T19:56:34.472 INFO:teuthology.orchestra.run.smithi008.stdout: "event": "started", 2023-08-01T19:56:34.472 INFO:teuthology.orchestra.run.smithi008.stdout: "time": "2023-08-01T19:55:58.559013+0000", 2023-08-01T19:56:34.472 INFO:teuthology.orchestra.run.smithi008.stdout: "duration": 0.00014289899999999999 2023-08-01T19:56:34.472 INFO:teuthology.orchestra.run.smithi008.stdout: }, 2023-08-01T19:56:34.472 INFO:teuthology.orchestra.run.smithi008.stdout: { 2023-08-01T19:56:34.472 INFO:teuthology.orchestra.run.smithi008.stdout: "event": "waiting for subops from 1", 2023-08-01T19:56:34.473 INFO:teuthology.orchestra.run.smithi008.stdout: "time": "2023-08-01T19:55:58.559137+0000", 2023-08-01T19:56:34.473 INFO:teuthology.orchestra.run.smithi008.stdout: "duration": 0.00012428499999999999 2023-08-01T19:56:34.473 INFO:teuthology.orchestra.run.smithi008.stdout: }, 2023-08-01T19:56:34.473 INFO:teuthology.orchestra.run.smithi008.stdout: { 2023-08-01T19:56:34.473 INFO:teuthology.orchestra.run.smithi008.stdout: "event": "reached_pg", 2023-08-01T19:56:34.473 INFO:teuthology.orchestra.run.smithi008.stdout: "time": "2023-08-01T19:55:58.567438+0000", 2023-08-01T19:56:34.473 INFO:teuthology.orchestra.run.smithi008.stdout: "duration": 0.0083003190000000004 2023-08-01T19:56:34.473 INFO:teuthology.orchestra.run.smithi008.stdout: }, 2023-08-01T19:56:34.474 INFO:teuthology.orchestra.run.smithi008.stdout: { 2023-08-01T19:56:34.474 INFO:teuthology.orchestra.run.smithi008.stdout: "event": "waiting for peered", 2023-08-01T19:56:34.474 INFO:teuthology.orchestra.run.smithi008.stdout: "time": "2023-08-01T19:55:58.567443+0000", 2023-08-01T19:56:34.474 INFO:teuthology.orchestra.run.smithi008.stdout: "duration": 5.1739999999999999e-06 2023-08-01T19:56:34.474 INFO:teuthology.orchestra.run.smithi008.stdout: }, 2023-08-01T19:56:34.474 INFO:teuthology.orchestra.run.smithi008.stdout: { 2023-08-01T19:56:34.474 INFO:teuthology.orchestra.run.smithi008.stdout: "event": "reached_pg", 2023-08-01T19:56:34.474 INFO:teuthology.orchestra.run.smithi008.stdout: "time": "2023-08-01T19:55:59.619164+0000", 2023-08-01T19:56:34.475 INFO:teuthology.orchestra.run.smithi008.stdout: "duration": 1.0517206750000001 2023-08-01T19:56:34.475 INFO:teuthology.orchestra.run.smithi008.stdout: }, 2023-08-01T19:56:34.475 INFO:teuthology.orchestra.run.smithi008.stdout: { 2023-08-01T19:56:34.475 INFO:teuthology.orchestra.run.smithi008.stdout: "event": "done", 2023-08-01T19:56:34.475 INFO:teuthology.orchestra.run.smithi008.stdout: "time": "2023-08-01T19:55:59.619209+0000", 2023-08-01T19:56:34.475 INFO:teuthology.orchestra.run.smithi008.stdout: "duration": 4.5800000000000002e-05 2023-08-01T19:56:34.475 INFO:teuthology.orchestra.run.smithi008.stdout: } 2023-08-01T19:56:34.475 INFO:teuthology.orchestra.run.smithi008.stdout: ] 2023-08-01T19:56:34.476 INFO:teuthology.orchestra.run.smithi008.stdout: } 2023-08-01T19:56:34.476 INFO:teuthology.orchestra.run.smithi008.stdout: }, 2023-08-01T19:56:34.476 INFO:teuthology.orchestra.run.smithi008.stdout: { 2023-08-01T19:56:34.476 INFO:teuthology.orchestra.run.smithi008.stdout: "description": "osd_op(client.4668.0:197404 5.5 5:a3c9c1bd:::benchmark_data_smithi006_114134_object63743:head [delete] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e61)", 2023-08-01T19:56:34.476 INFO:teuthology.orchestra.run.smithi008.stdout: "initiated_at": "2023-08-01T19:55:58.556653+0000", 2023-08-01T19:56:34.476 INFO:teuthology.orchestra.run.smithi008.stdout: "age": 35.784527955999998, 2023-08-01T19:56:34.476 INFO:teuthology.orchestra.run.smithi008.stdout: "duration": 1.061865576, 2023-08-01T19:56:34.476 INFO:teuthology.orchestra.run.smithi008.stdout: "type_data": { 2023-08-01T19:56:34.477 INFO:teuthology.orchestra.run.smithi008.stdout: "flag_point": "reached pg", 2023-08-01T19:56:34.477 INFO:teuthology.orchestra.run.smithi008.stdout: "client_info": { 2023-08-01T19:56:34.477 INFO:teuthology.orchestra.run.smithi008.stdout: "client": "client.4668", 2023-08-01T19:56:34.477 INFO:teuthology.orchestra.run.smithi008.stdout: "client_addr": "172.21.15.6:0/1709472247", 2023-08-01T19:56:34.477 INFO:teuthology.orchestra.run.smithi008.stdout: "tid": 197404 2023-08-01T19:56:34.477 INFO:teuthology.orchestra.run.smithi008.stdout: }, 2023-08-01T19:56:34.477 INFO:teuthology.orchestra.run.smithi008.stdout: "events": [ 2023-08-01T19:56:34.478 INFO:teuthology.orchestra.run.smithi008.stdout: { 2023-08-01T19:56:34.478 INFO:teuthology.orchestra.run.smithi008.stdout: "event": "initiated", 2023-08-01T19:56:34.478 INFO:teuthology.orchestra.run.smithi008.stdout: "time": "2023-08-01T19:55:58.556653+0000", 2023-08-01T19:56:34.478 INFO:teuthology.orchestra.run.smithi008.stdout: "duration": 0 2023-08-01T19:56:34.478 INFO:teuthology.orchestra.run.smithi008.stdout: }, 2023-08-01T19:56:34.478 INFO:teuthology.orchestra.run.smithi008.stdout: { 2023-08-01T19:56:34.478 INFO:teuthology.orchestra.run.smithi008.stdout: "event": "throttled", 2023-08-01T19:56:34.478 INFO:teuthology.orchestra.run.smithi008.stdout: "time": "2023-08-01T19:55:58.556653+0000", 2023-08-01T19:56:34.479 INFO:teuthology.orchestra.run.smithi008.stdout: "duration": 0 2023-08-01T19:56:34.479 INFO:teuthology.orchestra.run.smithi008.stdout: }, 2023-08-01T19:56:34.479 INFO:teuthology.orchestra.run.smithi008.stdout: { 2023-08-01T19:56:34.479 INFO:teuthology.orchestra.run.smithi008.stdout: "event": "header_read", 2023-08-01T19:56:34.479 INFO:teuthology.orchestra.run.smithi008.stdout: "time": "2023-08-01T19:55:58.556653+0000", 2023-08-01T19:56:34.479 INFO:teuthology.orchestra.run.smithi008.stdout: "duration": 4294967295.9999995 2023-08-01T19:56:34.479 INFO:teuthology.orchestra.run.smithi008.stdout: }, 2023-08-01T19:56:34.479 INFO:teuthology.orchestra.run.smithi008.stdout: { 2023-08-01T19:56:34.480 INFO:teuthology.orchestra.run.smithi008.stdout: "event": "all_read", 2023-08-01T19:56:34.480 INFO:teuthology.orchestra.run.smithi008.stdout: "time": "2023-08-01T19:55:58.556655+0000", 2023-08-01T19:56:34.480 INFO:teuthology.orchestra.run.smithi008.stdout: "duration": 2.435e-06 2023-08-01T19:56:34.480 INFO:teuthology.orchestra.run.smithi008.stdout: }, 2023-08-01T19:56:34.480 INFO:teuthology.orchestra.run.smithi008.stdout: { 2023-08-01T19:56:34.480 INFO:teuthology.orchestra.run.smithi008.stdout: "event": "dispatched", 2023-08-01T19:56:34.480 INFO:teuthology.orchestra.run.smithi008.stdout: "time": "2023-08-01T19:55:58.556661+0000", 2023-08-01T19:56:34.480 INFO:teuthology.orchestra.run.smithi008.stdout: "duration": 6.0599999999999996e-06 2023-08-01T19:56:34.481 INFO:teuthology.orchestra.run.smithi008.stdout: }, 2023-08-01T19:56:34.481 INFO:teuthology.orchestra.run.smithi008.stdout: { 2023-08-01T19:56:34.481 INFO:teuthology.orchestra.run.smithi008.stdout: "event": "queued_for_pg", 2023-08-01T19:56:34.481 INFO:teuthology.orchestra.run.smithi008.stdout: "time": "2023-08-01T19:55:58.556666+0000", 2023-08-01T19:56:34.481 INFO:teuthology.orchestra.run.smithi008.stdout: "duration": 4.9620000000000001e-06 2023-08-01T19:56:34.481 INFO:teuthology.orchestra.run.smithi008.stdout: }, 2023-08-01T19:56:34.481 INFO:teuthology.orchestra.run.smithi008.stdout: { 2023-08-01T19:56:34.481 INFO:teuthology.orchestra.run.smithi008.stdout: "event": "reached_pg", 2023-08-01T19:56:34.482 INFO:teuthology.orchestra.run.smithi008.stdout: "time": "2023-08-01T19:55:58.556698+0000", 2023-08-01T19:56:34.482 INFO:teuthology.orchestra.run.smithi008.stdout: "duration": 3.2302999999999999e-05 2023-08-01T19:56:34.482 INFO:teuthology.orchestra.run.smithi008.stdout: }, 2023-08-01T19:56:34.482 INFO:teuthology.orchestra.run.smithi008.stdout: { 2023-08-01T19:56:34.482 INFO:teuthology.orchestra.run.smithi008.stdout: "event": "started", 2023-08-01T19:56:34.482 INFO:teuthology.orchestra.run.smithi008.stdout: "time": "2023-08-01T19:55:58.556773+0000", 2023-08-01T19:56:34.482 INFO:teuthology.orchestra.run.smithi008.stdout: "duration": 7.4431999999999995e-05 2023-08-01T19:56:34.482 INFO:teuthology.orchestra.run.smithi008.stdout: }, 2023-08-01T19:56:34.483 INFO:teuthology.orchestra.run.smithi008.stdout: { 2023-08-01T19:56:34.483 INFO:teuthology.orchestra.run.smithi008.stdout: "event": "waiting for subops from 1", 2023-08-01T19:56:34.483 INFO:teuthology.orchestra.run.smithi008.stdout: "time": "2023-08-01T19:55:58.556837+0000", 2023-08-01T19:56:34.483 INFO:teuthology.orchestra.run.smithi008.stdout: "duration": 6.4522000000000003e-05 2023-08-01T19:56:34.483 INFO:teuthology.orchestra.run.smithi008.stdout: }, 2023-08-01T19:56:34.483 INFO:teuthology.orchestra.run.smithi008.stdout: { 2023-08-01T19:56:34.483 INFO:teuthology.orchestra.run.smithi008.stdout: "event": "reached_pg", 2023-08-01T19:56:34.483 INFO:teuthology.orchestra.run.smithi008.stdout: "time": "2023-08-01T19:55:58.563930+0000", 2023-08-01T19:56:34.484 INFO:teuthology.orchestra.run.smithi008.stdout: "duration": 0.0070929030000000002 2023-08-01T19:56:34.484 INFO:teuthology.orchestra.run.smithi008.stdout: }, 2023-08-01T19:56:34.484 INFO:teuthology.orchestra.run.smithi008.stdout: { 2023-08-01T19:56:34.484 INFO:teuthology.orchestra.run.smithi008.stdout: "event": "waiting for peered", 2023-08-01T19:56:34.484 INFO:teuthology.orchestra.run.smithi008.stdout: "time": "2023-08-01T19:55:58.563939+0000", 2023-08-01T19:56:34.484 INFO:teuthology.orchestra.run.smithi008.stdout: "duration": 8.6079999999999996e-06 2023-08-01T19:56:34.484 INFO:teuthology.orchestra.run.smithi008.stdout: }, 2023-08-01T19:56:34.485 INFO:teuthology.orchestra.run.smithi008.stdout: { 2023-08-01T19:56:34.485 INFO:teuthology.orchestra.run.smithi008.stdout: "event": "reached_pg", 2023-08-01T19:56:34.485 INFO:teuthology.orchestra.run.smithi008.stdout: "time": "2023-08-01T19:55:59.618422+0000", 2023-08-01T19:56:34.485 INFO:teuthology.orchestra.run.smithi008.stdout: "duration": 1.054483295 2023-08-01T19:56:34.485 INFO:teuthology.orchestra.run.smithi008.stdout: }, 2023-08-01T19:56:34.485 INFO:teuthology.orchestra.run.smithi008.stdout: { 2023-08-01T19:56:34.485 INFO:teuthology.orchestra.run.smithi008.stdout: "event": "done", 2023-08-01T19:56:34.485 INFO:teuthology.orchestra.run.smithi008.stdout: "time": "2023-08-01T19:55:59.618519+0000", 2023-08-01T19:56:34.486 INFO:teuthology.orchestra.run.smithi008.stdout: "duration": 9.6471000000000005e-05 2023-08-01T19:56:34.486 INFO:teuthology.orchestra.run.smithi008.stdout: } 2023-08-01T19:56:34.486 INFO:teuthology.orchestra.run.smithi008.stdout: ] 2023-08-01T19:56:34.486 INFO:teuthology.orchestra.run.smithi008.stdout: } 2023-08-01T19:56:34.486 INFO:teuthology.orchestra.run.smithi008.stdout: }, 2023-08-01T19:56:34.486 INFO:teuthology.orchestra.run.smithi008.stdout: { 2023-08-01T19:56:34.486 INFO:teuthology.orchestra.run.smithi008.stdout: "description": "osd_op(client.4668.0:197407 5.1 5:85528fae:::benchmark_data_smithi006_114134_object63746:head [delete] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e61)", 2023-08-01T19:56:34.486 INFO:teuthology.orchestra.run.smithi008.stdout: "initiated_at": "2023-08-01T19:55:58.559216+0000", 2023-08-01T19:56:34.487 INFO:teuthology.orchestra.run.smithi008.stdout: "age": 35.781965307999997, 2023-08-01T19:56:34.487 INFO:teuthology.orchestra.run.smithi008.stdout: "duration": 1.061802277, 2023-08-01T19:56:34.487 INFO:teuthology.orchestra.run.smithi008.stdout: "type_data": { 2023-08-01T19:56:34.487 INFO:teuthology.orchestra.run.smithi008.stdout: "flag_point": "reached pg", 2023-08-01T19:56:34.487 INFO:teuthology.orchestra.run.smithi008.stdout: "client_info": { 2023-08-01T19:56:34.487 INFO:teuthology.orchestra.run.smithi008.stdout: "client": "client.4668", 2023-08-01T19:56:34.487 INFO:teuthology.orchestra.run.smithi008.stdout: "client_addr": "172.21.15.6:0/1709472247", 2023-08-01T19:56:34.488 INFO:teuthology.orchestra.run.smithi008.stdout: "tid": 197407 2023-08-01T19:56:34.488 INFO:teuthology.orchestra.run.smithi008.stdout: }, 2023-08-01T19:56:34.488 INFO:teuthology.orchestra.run.smithi008.stdout: "events": [ 2023-08-01T19:56:34.488 INFO:teuthology.orchestra.run.smithi008.stdout: { 2023-08-01T19:56:34.488 INFO:teuthology.orchestra.run.smithi008.stdout: "event": "initiated", 2023-08-01T19:56:34.488 INFO:teuthology.orchestra.run.smithi008.stdout: "time": "2023-08-01T19:55:58.559216+0000", 2023-08-01T19:56:34.488 INFO:teuthology.orchestra.run.smithi008.stdout: "duration": 0 2023-08-01T19:56:34.489 INFO:teuthology.orchestra.run.smithi008.stdout: }, 2023-08-01T19:56:34.489 INFO:teuthology.orchestra.run.smithi008.stdout: { 2023-08-01T19:56:34.489 INFO:teuthology.orchestra.run.smithi008.stdout: "event": "throttled", 2023-08-01T19:56:34.489 INFO:teuthology.orchestra.run.smithi008.stdout: "time": "2023-08-01T19:55:58.559216+0000", 2023-08-01T19:56:34.489 INFO:teuthology.orchestra.run.smithi008.stdout: "duration": 0 2023-08-01T19:56:34.489 INFO:teuthology.orchestra.run.smithi008.stdout: }, 2023-08-01T19:56:34.489 INFO:teuthology.orchestra.run.smithi008.stdout: { 2023-08-01T19:56:34.489 INFO:teuthology.orchestra.run.smithi008.stdout: "event": "header_read", 2023-08-01T19:56:34.490 INFO:teuthology.orchestra.run.smithi008.stdout: "time": "2023-08-01T19:55:58.559215+0000", 2023-08-01T19:56:34.490 INFO:teuthology.orchestra.run.smithi008.stdout: "duration": 4294967295.999999 2023-08-01T19:56:34.490 INFO:teuthology.orchestra.run.smithi008.stdout: }, 2023-08-01T19:56:34.490 INFO:teuthology.orchestra.run.smithi008.stdout: { 2023-08-01T19:56:34.490 INFO:teuthology.orchestra.run.smithi008.stdout: "event": "all_read", 2023-08-01T19:56:34.490 INFO:teuthology.orchestra.run.smithi008.stdout: "time": "2023-08-01T19:55:58.559220+0000", 2023-08-01T19:56:34.490 INFO:teuthology.orchestra.run.smithi008.stdout: "duration": 5.3879999999999999e-06 2023-08-01T19:56:34.490 INFO:teuthology.orchestra.run.smithi008.stdout: }, 2023-08-01T19:56:34.491 INFO:teuthology.orchestra.run.smithi008.stdout: { 2023-08-01T19:56:34.491 INFO:teuthology.orchestra.run.smithi008.stdout: "event": "dispatched", 2023-08-01T19:56:34.491 INFO:teuthology.orchestra.run.smithi008.stdout: "time": "2023-08-01T19:55:58.559230+0000", 2023-08-01T19:56:34.491 INFO:teuthology.orchestra.run.smithi008.stdout: "duration": 9.6590000000000002e-06 2023-08-01T19:56:34.491 INFO:teuthology.orchestra.run.smithi008.stdout: }, 2023-08-01T19:56:34.491 INFO:teuthology.orchestra.run.smithi008.stdout: { 2023-08-01T19:56:34.491 INFO:teuthology.orchestra.run.smithi008.stdout: "event": "queued_for_pg", 2023-08-01T19:56:34.492 INFO:teuthology.orchestra.run.smithi008.stdout: "time": "2023-08-01T19:55:58.559235+0000", 2023-08-01T19:56:34.492 INFO:teuthology.orchestra.run.smithi008.stdout: "duration": 5.575e-06 2023-08-01T19:56:34.492 INFO:teuthology.orchestra.run.smithi008.stdout: }, 2023-08-01T19:56:34.492 INFO:teuthology.orchestra.run.smithi008.stdout: { 2023-08-01T19:56:34.492 INFO:teuthology.orchestra.run.smithi008.stdout: "event": "reached_pg", 2023-08-01T19:56:34.492 INFO:teuthology.orchestra.run.smithi008.stdout: "time": "2023-08-01T19:55:58.559279+0000", 2023-08-01T19:56:34.492 INFO:teuthology.orchestra.run.smithi008.stdout: "duration": 4.3273999999999999e-05 2023-08-01T19:56:34.492 INFO:teuthology.orchestra.run.smithi008.stdout: }, 2023-08-01T19:56:34.493 INFO:teuthology.orchestra.run.smithi008.stdout: { 2023-08-01T19:56:34.493 INFO:teuthology.orchestra.run.smithi008.stdout: "event": "started", 2023-08-01T19:56:34.493 INFO:teuthology.orchestra.run.smithi008.stdout: "time": "2023-08-01T19:55:58.559403+0000", 2023-08-01T19:56:34.493 INFO:teuthology.orchestra.run.smithi008.stdout: "duration": 0.000124781 2023-08-01T19:56:34.493 INFO:teuthology.orchestra.run.smithi008.stdout: }, 2023-08-01T19:56:34.493 INFO:teuthology.orchestra.run.smithi008.stdout: { 2023-08-01T19:56:34.493 INFO:teuthology.orchestra.run.smithi008.stdout: "event": "waiting for subops from 1", 2023-08-01T19:56:34.493 INFO:teuthology.orchestra.run.smithi008.stdout: "time": "2023-08-01T19:55:58.559561+0000", 2023-08-01T19:56:34.494 INFO:teuthology.orchestra.run.smithi008.stdout: "duration": 0.000157773 2023-08-01T19:56:34.494 INFO:teuthology.orchestra.run.smithi008.stdout: }, 2023-08-01T19:56:34.494 INFO:teuthology.orchestra.run.smithi008.stdout: { 2023-08-01T19:56:34.494 INFO:teuthology.orchestra.run.smithi008.stdout: "event": "reached_pg", 2023-08-01T19:56:34.494 INFO:teuthology.orchestra.run.smithi008.stdout: "time": "2023-08-01T19:55:58.569498+0000", 2023-08-01T19:56:34.494 INFO:teuthology.orchestra.run.smithi008.stdout: "duration": 0.0099367069999999995 2023-08-01T19:56:34.495 INFO:teuthology.orchestra.run.smithi008.stdout: }, 2023-08-01T19:56:34.495 INFO:teuthology.orchestra.run.smithi008.stdout: { 2023-08-01T19:56:34.495 INFO:teuthology.orchestra.run.smithi008.stdout: "event": "waiting for peered", 2023-08-01T19:56:34.495 INFO:teuthology.orchestra.run.smithi008.stdout: "time": "2023-08-01T19:55:58.569756+0000", 2023-08-01T19:56:34.495 INFO:teuthology.orchestra.run.smithi008.stdout: "duration": 0.00025830800000000001 2023-08-01T19:56:34.495 INFO:teuthology.orchestra.run.smithi008.stdout: }, 2023-08-01T19:56:34.495 INFO:teuthology.orchestra.run.smithi008.stdout: { 2023-08-01T19:56:34.495 INFO:teuthology.orchestra.run.smithi008.stdout: "event": "reached_pg", 2023-08-01T19:56:34.496 INFO:teuthology.orchestra.run.smithi008.stdout: "time": "2023-08-01T19:55:59.620962+0000", 2023-08-01T19:56:34.496 INFO:teuthology.orchestra.run.smithi008.stdout: "duration": 1.0512062129999999 2023-08-01T19:56:34.496 INFO:teuthology.orchestra.run.smithi008.stdout: }, 2023-08-01T19:56:34.496 INFO:teuthology.orchestra.run.smithi008.stdout: { 2023-08-01T19:56:34.496 INFO:teuthology.orchestra.run.smithi008.stdout: "event": "done", 2023-08-01T19:56:34.496 INFO:teuthology.orchestra.run.smithi008.stdout: "time": "2023-08-01T19:55:59.621018+0000", 2023-08-01T19:56:34.497 INFO:teuthology.orchestra.run.smithi008.stdout: "duration": 5.5498999999999998e-05 2023-08-01T19:56:34.497 INFO:teuthology.orchestra.run.smithi008.stdout: } 2023-08-01T19:56:34.497 INFO:teuthology.orchestra.run.smithi008.stdout: ] 2023-08-01T19:56:34.497 INFO:teuthology.orchestra.run.smithi008.stdout: } 2023-08-01T19:56:34.497 INFO:teuthology.orchestra.run.smithi008.stdout: }, 2023-08-01T19:56:34.497 INFO:teuthology.orchestra.run.smithi008.stdout: { 2023-08-01T19:56:34.497 INFO:teuthology.orchestra.run.smithi008.stdout: "description": "osd_op(client.4668.0:197396 5.2 5:43f8487b:::benchmark_data_smithi006_114134_object63735:head [delete] snapc 0=[] RETRY=1 ondisk+retry+write+known_if_redirected+supports_pool_eio e62)", 2023-08-01T19:56:34.497 INFO:teuthology.orchestra.run.smithi008.stdout: "initiated_at": "2023-08-01T19:55:58.564585+0000", 2023-08-01T19:56:34.498 INFO:teuthology.orchestra.run.smithi008.stdout: "age": 35.776596333999997, 2023-08-01T19:56:34.498 INFO:teuthology.orchestra.run.smithi008.stdout: "duration": 1.0535085049999999, 2023-08-01T19:56:34.498 INFO:teuthology.orchestra.run.smithi008.stdout: "type_data": { 2023-08-01T19:56:34.498 INFO:teuthology.orchestra.run.smithi008.stdout: "flag_point": "reached pg", 2023-08-01T19:56:34.498 INFO:teuthology.orchestra.run.smithi008.stdout: "client_info": { 2023-08-01T19:56:34.498 INFO:teuthology.orchestra.run.smithi008.stdout: "client": "client.4668", 2023-08-01T19:56:34.498 INFO:teuthology.orchestra.run.smithi008.stdout: "client_addr": "172.21.15.6:0/1709472247", 2023-08-01T19:56:34.498 INFO:teuthology.orchestra.run.smithi008.stdout: "tid": 197396 2023-08-01T19:56:34.499 INFO:teuthology.orchestra.run.smithi008.stdout: }, 2023-08-01T19:56:34.499 INFO:teuthology.orchestra.run.smithi008.stdout: "events": [ 2023-08-01T19:56:34.499 INFO:teuthology.orchestra.run.smithi008.stdout: { 2023-08-01T19:56:34.499 INFO:teuthology.orchestra.run.smithi008.stdout: "event": "initiated", 2023-08-01T19:56:34.499 INFO:teuthology.orchestra.run.smithi008.stdout: "time": "2023-08-01T19:55:58.564585+0000", 2023-08-01T19:56:34.499 INFO:teuthology.orchestra.run.smithi008.stdout: "duration": 0 2023-08-01T19:56:34.499 INFO:teuthology.orchestra.run.smithi008.stdout: }, 2023-08-01T19:56:34.499 INFO:teuthology.orchestra.run.smithi008.stdout: { 2023-08-01T19:56:34.500 INFO:teuthology.orchestra.run.smithi008.stdout: "event": "throttled", 2023-08-01T19:56:34.500 INFO:teuthology.orchestra.run.smithi008.stdout: "time": "2023-08-01T19:55:58.564585+0000", 2023-08-01T19:56:34.500 INFO:teuthology.orchestra.run.smithi008.stdout: "duration": 0 2023-08-01T19:56:34.500 INFO:teuthology.orchestra.run.smithi008.stdout: }, 2023-08-01T19:56:34.500 INFO:teuthology.orchestra.run.smithi008.stdout: { 2023-08-01T19:56:34.500 INFO:teuthology.orchestra.run.smithi008.stdout: "event": "header_read", 2023-08-01T19:56:34.500 INFO:teuthology.orchestra.run.smithi008.stdout: "time": "2023-08-01T19:55:58.564583+0000", 2023-08-01T19:56:34.501 INFO:teuthology.orchestra.run.smithi008.stdout: "duration": 4294967295.9999981 2023-08-01T19:56:34.501 INFO:teuthology.orchestra.run.smithi008.stdout: }, 2023-08-01T19:56:34.501 INFO:teuthology.orchestra.run.smithi008.stdout: { 2023-08-01T19:56:34.501 INFO:teuthology.orchestra.run.smithi008.stdout: "event": "all_read", 2023-08-01T19:56:34.501 INFO:teuthology.orchestra.run.smithi008.stdout: "time": "2023-08-01T19:55:58.564591+0000", 2023-08-01T19:56:34.501 INFO:teuthology.orchestra.run.smithi008.stdout: "duration": 8.2169999999999994e-06 2023-08-01T19:56:34.501 INFO:teuthology.orchestra.run.smithi008.stdout: }, 2023-08-01T19:56:34.501 INFO:teuthology.orchestra.run.smithi008.stdout: { 2023-08-01T19:56:34.502 INFO:teuthology.orchestra.run.smithi008.stdout: "event": "dispatched", 2023-08-01T19:56:34.502 INFO:teuthology.orchestra.run.smithi008.stdout: "time": "2023-08-01T19:55:58.564603+0000", 2023-08-01T19:56:34.502 INFO:teuthology.orchestra.run.smithi008.stdout: "duration": 1.186e-05 2023-08-01T19:56:34.502 INFO:teuthology.orchestra.run.smithi008.stdout: }, 2023-08-01T19:56:34.502 INFO:teuthology.orchestra.run.smithi008.stdout: { 2023-08-01T19:56:34.502 INFO:teuthology.orchestra.run.smithi008.stdout: "event": "queued_for_pg", 2023-08-01T19:56:34.502 INFO:teuthology.orchestra.run.smithi008.stdout: "time": "2023-08-01T19:55:58.564609+0000", 2023-08-01T19:56:34.502 INFO:teuthology.orchestra.run.smithi008.stdout: "duration": 6.4130000000000003e-06 2023-08-01T19:56:34.503 INFO:teuthology.orchestra.run.smithi008.stdout: }, 2023-08-01T19:56:34.503 INFO:teuthology.orchestra.run.smithi008.stdout: { 2023-08-01T19:56:34.503 INFO:teuthology.orchestra.run.smithi008.stdout: "event": "reached_pg", 2023-08-01T19:56:34.503 INFO:teuthology.orchestra.run.smithi008.stdout: "time": "2023-08-01T19:55:58.573439+0000", 2023-08-01T19:56:34.503 INFO:teuthology.orchestra.run.smithi008.stdout: "duration": 0.0088303310000000003 2023-08-01T19:56:34.503 INFO:teuthology.orchestra.run.smithi008.stdout: }, 2023-08-01T19:56:34.503 INFO:teuthology.orchestra.run.smithi008.stdout: { 2023-08-01T19:56:34.503 INFO:teuthology.orchestra.run.smithi008.stdout: "event": "waiting for peered", 2023-08-01T19:56:34.504 INFO:teuthology.orchestra.run.smithi008.stdout: "time": "2023-08-01T19:55:58.573448+0000", 2023-08-01T19:56:34.504 INFO:teuthology.orchestra.run.smithi008.stdout: "duration": 8.2910000000000007e-06 2023-08-01T19:56:34.504 INFO:teuthology.orchestra.run.smithi008.stdout: }, 2023-08-01T19:56:34.504 INFO:teuthology.orchestra.run.smithi008.stdout: { 2023-08-01T19:56:34.504 INFO:teuthology.orchestra.run.smithi008.stdout: "event": "reached_pg", 2023-08-01T19:56:34.504 INFO:teuthology.orchestra.run.smithi008.stdout: "time": "2023-08-01T19:55:59.617892+0000", 2023-08-01T19:56:34.504 INFO:teuthology.orchestra.run.smithi008.stdout: "duration": 1.0444446380000001 2023-08-01T19:56:34.504 INFO:teuthology.orchestra.run.smithi008.stdout: }, 2023-08-01T19:56:34.505 INFO:teuthology.orchestra.run.smithi008.stdout: { 2023-08-01T19:56:34.505 INFO:teuthology.orchestra.run.smithi008.stdout: "event": "done", 2023-08-01T19:56:34.505 INFO:teuthology.orchestra.run.smithi008.stdout: "time": "2023-08-01T19:55:59.618093+0000", 2023-08-01T19:56:34.505 INFO:teuthology.orchestra.run.smithi008.stdout: "duration": 0.00020066300000000001 2023-08-01T19:56:34.505 INFO:teuthology.orchestra.run.smithi008.stdout: } 2023-08-01T19:56:34.505 INFO:teuthology.orchestra.run.smithi008.stdout: ] 2023-08-01T19:56:34.505 INFO:teuthology.orchestra.run.smithi008.stdout: } 2023-08-01T19:56:34.505 INFO:teuthology.orchestra.run.smithi008.stdout: }, 2023-08-01T19:56:34.506 INFO:teuthology.orchestra.run.smithi008.stdout: { 2023-08-01T19:56:34.506 INFO:teuthology.orchestra.run.smithi008.stdout: "description": "osd_op(client.4668.0:197411 5.7 5:ebefbc20:::benchmark_data_smithi006_114134_object63750:head [delete] snapc 0=[] RETRY=1 ondisk+retry+write+known_if_redirected+supports_pool_eio e62)", 2023-08-01T19:56:34.506 INFO:teuthology.orchestra.run.smithi008.stdout: "initiated_at": "2023-08-01T19:55:58.564619+0000", 2023-08-01T19:56:34.506 INFO:teuthology.orchestra.run.smithi008.stdout: "age": 35.776561659000002, 2023-08-01T19:56:34.506 INFO:teuthology.orchestra.run.smithi008.stdout: "duration": 1.0686062569999999, 2023-08-01T19:56:34.506 INFO:teuthology.orchestra.run.smithi008.stdout: "type_data": { 2023-08-01T19:56:34.506 INFO:teuthology.orchestra.run.smithi008.stdout: "flag_point": "commit sent; apply or cleanup", 2023-08-01T19:56:34.507 INFO:teuthology.orchestra.run.smithi008.stdout: "client_info": { 2023-08-01T19:56:34.507 INFO:teuthology.orchestra.run.smithi008.stdout: "client": "client.4668", 2023-08-01T19:56:34.507 INFO:teuthology.orchestra.run.smithi008.stdout: "client_addr": "172.21.15.6:0/1709472247", 2023-08-01T19:56:34.507 INFO:teuthology.orchestra.run.smithi008.stdout: "tid": 197411 2023-08-01T19:56:34.507 INFO:teuthology.orchestra.run.smithi008.stdout: }, 2023-08-01T19:56:34.507 INFO:teuthology.orchestra.run.smithi008.stdout: "events": [ 2023-08-01T19:56:34.507 INFO:teuthology.orchestra.run.smithi008.stdout: { 2023-08-01T19:56:34.507 INFO:teuthology.orchestra.run.smithi008.stdout: "event": "initiated", 2023-08-01T19:56:34.508 INFO:teuthology.orchestra.run.smithi008.stdout: "time": "2023-08-01T19:55:58.564619+0000", 2023-08-01T19:56:34.508 INFO:teuthology.orchestra.run.smithi008.stdout: "duration": 0 2023-08-01T19:56:34.508 INFO:teuthology.orchestra.run.smithi008.stdout: }, 2023-08-01T19:56:34.508 INFO:teuthology.orchestra.run.smithi008.stdout: { 2023-08-01T19:56:34.508 INFO:teuthology.orchestra.run.smithi008.stdout: "event": "throttled", 2023-08-01T19:56:34.508 INFO:teuthology.orchestra.run.smithi008.stdout: "time": "2023-08-01T19:55:58.564619+0000", 2023-08-01T19:56:34.508 INFO:teuthology.orchestra.run.smithi008.stdout: "duration": 0 2023-08-01T19:56:34.508 INFO:teuthology.orchestra.run.smithi008.stdout: }, 2023-08-01T19:56:34.509 INFO:teuthology.orchestra.run.smithi008.stdout: { 2023-08-01T19:56:34.509 INFO:teuthology.orchestra.run.smithi008.stdout: "event": "header_read", 2023-08-01T19:56:34.509 INFO:teuthology.orchestra.run.smithi008.stdout: "time": "2023-08-01T19:55:58.564619+0000", 2023-08-01T19:56:34.509 INFO:teuthology.orchestra.run.smithi008.stdout: "duration": 4294967295.9999995 2023-08-01T19:56:34.509 INFO:teuthology.orchestra.run.smithi008.stdout: }, 2023-08-01T19:56:34.509 INFO:teuthology.orchestra.run.smithi008.stdout: { 2023-08-01T19:56:34.509 INFO:teuthology.orchestra.run.smithi008.stdout: "event": "all_read", 2023-08-01T19:56:34.509 INFO:teuthology.orchestra.run.smithi008.stdout: "time": "2023-08-01T19:55:58.564621+0000", 2023-08-01T19:56:34.510 INFO:teuthology.orchestra.run.smithi008.stdout: "duration": 2.6139999999999999e-06 2023-08-01T19:56:34.510 INFO:teuthology.orchestra.run.smithi008.stdout: }, 2023-08-01T19:56:34.510 INFO:teuthology.orchestra.run.smithi008.stdout: { 2023-08-01T19:56:34.510 INFO:teuthology.orchestra.run.smithi008.stdout: "event": "dispatched", 2023-08-01T19:56:34.510 INFO:teuthology.orchestra.run.smithi008.stdout: "time": "2023-08-01T19:55:58.564627+0000", 2023-08-01T19:56:34.510 INFO:teuthology.orchestra.run.smithi008.stdout: "duration": 5.1150000000000002e-06 2023-08-01T19:56:34.510 INFO:teuthology.orchestra.run.smithi008.stdout: }, 2023-08-01T19:56:34.510 INFO:teuthology.orchestra.run.smithi008.stdout: { 2023-08-01T19:56:34.511 INFO:teuthology.orchestra.run.smithi008.stdout: "event": "queued_for_pg", 2023-08-01T19:56:34.511 INFO:teuthology.orchestra.run.smithi008.stdout: "time": "2023-08-01T19:55:58.564631+0000", 2023-08-01T19:56:34.511 INFO:teuthology.orchestra.run.smithi008.stdout: "duration": 4.702e-06 2023-08-01T19:56:34.511 INFO:teuthology.orchestra.run.smithi008.stdout: }, 2023-08-01T19:56:34.511 INFO:teuthology.orchestra.run.smithi008.stdout: { 2023-08-01T19:56:34.511 INFO:teuthology.orchestra.run.smithi008.stdout: "event": "reached_pg", 2023-08-01T19:56:34.511 INFO:teuthology.orchestra.run.smithi008.stdout: "time": "2023-08-01T19:55:58.565520+0000", 2023-08-01T19:56:34.511 INFO:teuthology.orchestra.run.smithi008.stdout: "duration": 0.00088893399999999997 2023-08-01T19:56:34.512 INFO:teuthology.orchestra.run.smithi008.stdout: }, 2023-08-01T19:56:34.512 INFO:teuthology.orchestra.run.smithi008.stdout: { 2023-08-01T19:56:34.512 INFO:teuthology.orchestra.run.smithi008.stdout: "event": "waiting for peered", 2023-08-01T19:56:34.512 INFO:teuthology.orchestra.run.smithi008.stdout: "time": "2023-08-01T19:55:58.565528+0000", 2023-08-01T19:56:34.512 INFO:teuthology.orchestra.run.smithi008.stdout: "duration": 7.5410000000000003e-06 2023-08-01T19:56:34.512 INFO:teuthology.orchestra.run.smithi008.stdout: }, 2023-08-01T19:56:34.512 INFO:teuthology.orchestra.run.smithi008.stdout: { 2023-08-01T19:56:34.513 INFO:teuthology.orchestra.run.smithi008.stdout: "event": "reached_pg", 2023-08-01T19:56:34.513 INFO:teuthology.orchestra.run.smithi008.stdout: "time": "2023-08-01T19:55:59.622374+0000", 2023-08-01T19:56:34.513 INFO:teuthology.orchestra.run.smithi008.stdout: "duration": 1.05684588 2023-08-01T19:56:34.513 INFO:teuthology.orchestra.run.smithi008.stdout: }, 2023-08-01T19:56:34.513 INFO:teuthology.orchestra.run.smithi008.stdout: { 2023-08-01T19:56:34.513 INFO:teuthology.orchestra.run.smithi008.stdout: "event": "started", 2023-08-01T19:56:34.513 INFO:teuthology.orchestra.run.smithi008.stdout: "time": "2023-08-01T19:55:59.624156+0000", 2023-08-01T19:56:34.513 INFO:teuthology.orchestra.run.smithi008.stdout: "duration": 0.0017826129999999999 2023-08-01T19:56:34.514 INFO:teuthology.orchestra.run.smithi008.stdout: }, 2023-08-01T19:56:34.514 INFO:teuthology.orchestra.run.smithi008.stdout: { 2023-08-01T19:56:34.514 INFO:teuthology.orchestra.run.smithi008.stdout: "event": "op_commit", 2023-08-01T19:56:34.514 INFO:teuthology.orchestra.run.smithi008.stdout: "time": "2023-08-01T19:55:59.633131+0000", 2023-08-01T19:56:34.514 INFO:teuthology.orchestra.run.smithi008.stdout: "duration": 0.0089745740000000008 2023-08-01T19:56:34.514 INFO:teuthology.orchestra.run.smithi008.stdout: }, 2023-08-01T19:56:34.514 INFO:teuthology.orchestra.run.smithi008.stdout: { 2023-08-01T19:56:34.514 INFO:teuthology.orchestra.run.smithi008.stdout: "event": "commit_sent", 2023-08-01T19:56:34.515 INFO:teuthology.orchestra.run.smithi008.stdout: "time": "2023-08-01T19:55:59.633173+0000", 2023-08-01T19:56:34.515 INFO:teuthology.orchestra.run.smithi008.stdout: "duration": 4.2645000000000003e-05 2023-08-01T19:56:34.515 INFO:teuthology.orchestra.run.smithi008.stdout: }, 2023-08-01T19:56:34.515 INFO:teuthology.orchestra.run.smithi008.stdout: { 2023-08-01T19:56:34.515 INFO:teuthology.orchestra.run.smithi008.stdout: "event": "done", 2023-08-01T19:56:34.515 INFO:teuthology.orchestra.run.smithi008.stdout: "time": "2023-08-01T19:55:59.633225+0000", 2023-08-01T19:56:34.515 INFO:teuthology.orchestra.run.smithi008.stdout: "duration": 5.2003999999999999e-05 2023-08-01T19:56:34.515 INFO:teuthology.orchestra.run.smithi008.stdout: } 2023-08-01T19:56:34.516 INFO:teuthology.orchestra.run.smithi008.stdout: ] 2023-08-01T19:56:34.516 INFO:teuthology.orchestra.run.smithi008.stdout: } 2023-08-01T19:56:34.516 INFO:teuthology.orchestra.run.smithi008.stdout: }, 2023-08-01T19:56:34.516 INFO:teuthology.orchestra.run.smithi008.stdout: { 2023-08-01T19:56:34.516 INFO:teuthology.orchestra.run.smithi008.stdout: "description": "osd_op(client.4668.0:197413 5.5 5:a6ff9d8a:::benchmark_data_smithi006_114134_object63752:head [delete] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e62)", 2023-08-01T19:56:34.516 INFO:teuthology.orchestra.run.smithi008.stdout: "initiated_at": "2023-08-01T19:55:58.573778+0000", 2023-08-01T19:56:34.516 INFO:teuthology.orchestra.run.smithi008.stdout: "age": 35.767402693000001, 2023-08-01T19:56:34.516 INFO:teuthology.orchestra.run.smithi008.stdout: "duration": 1.054781371, 2023-08-01T19:56:34.517 INFO:teuthology.orchestra.run.smithi008.stdout: "type_data": { 2023-08-01T19:56:34.517 INFO:teuthology.orchestra.run.smithi008.stdout: "flag_point": "commit sent; apply or cleanup", 2023-08-01T19:56:34.517 INFO:teuthology.orchestra.run.smithi008.stdout: "client_info": { 2023-08-01T19:56:34.517 INFO:teuthology.orchestra.run.smithi008.stdout: "client": "client.4668", 2023-08-01T19:56:34.517 INFO:teuthology.orchestra.run.smithi008.stdout: "client_addr": "172.21.15.6:0/1709472247", 2023-08-01T19:56:34.517 INFO:teuthology.orchestra.run.smithi008.stdout: "tid": 197413 2023-08-01T19:56:34.517 INFO:teuthology.orchestra.run.smithi008.stdout: }, 2023-08-01T19:56:34.517 INFO:teuthology.orchestra.run.smithi008.stdout: "events": [ 2023-08-01T19:56:34.518 INFO:teuthology.orchestra.run.smithi008.stdout: { 2023-08-01T19:56:34.518 INFO:teuthology.orchestra.run.smithi008.stdout: "event": "initiated", 2023-08-01T19:56:34.518 INFO:teuthology.orchestra.run.smithi008.stdout: "time": "2023-08-01T19:55:58.573778+0000", 2023-08-01T19:56:34.518 INFO:teuthology.orchestra.run.smithi008.stdout: "duration": 0 2023-08-01T19:56:34.518 INFO:teuthology.orchestra.run.smithi008.stdout: }, 2023-08-01T19:56:34.518 INFO:teuthology.orchestra.run.smithi008.stdout: { 2023-08-01T19:56:34.518 INFO:teuthology.orchestra.run.smithi008.stdout: "event": "throttled", 2023-08-01T19:56:34.518 INFO:teuthology.orchestra.run.smithi008.stdout: "time": "2023-08-01T19:55:58.573778+0000", 2023-08-01T19:56:34.519 INFO:teuthology.orchestra.run.smithi008.stdout: "duration": 0 2023-08-01T19:56:34.519 INFO:teuthology.orchestra.run.smithi008.stdout: }, 2023-08-01T19:56:34.519 INFO:teuthology.orchestra.run.smithi008.stdout: { 2023-08-01T19:56:34.519 INFO:teuthology.orchestra.run.smithi008.stdout: "event": "header_read", 2023-08-01T19:56:34.519 INFO:teuthology.orchestra.run.smithi008.stdout: "time": "2023-08-01T19:55:58.573776+0000", 2023-08-01T19:56:34.519 INFO:teuthology.orchestra.run.smithi008.stdout: "duration": 4294967295.9999981 2023-08-01T19:56:34.519 INFO:teuthology.orchestra.run.smithi008.stdout: }, 2023-08-01T19:56:34.519 INFO:teuthology.orchestra.run.smithi008.stdout: { 2023-08-01T19:56:34.520 INFO:teuthology.orchestra.run.smithi008.stdout: "event": "all_read", 2023-08-01T19:56:34.520 INFO:teuthology.orchestra.run.smithi008.stdout: "time": "2023-08-01T19:55:58.573784+0000", 2023-08-01T19:56:34.520 INFO:teuthology.orchestra.run.smithi008.stdout: "duration": 8.2490000000000001e-06 2023-08-01T19:56:34.520 INFO:teuthology.orchestra.run.smithi008.stdout: }, 2023-08-01T19:56:34.520 INFO:teuthology.orchestra.run.smithi008.stdout: { 2023-08-01T19:56:34.520 INFO:teuthology.orchestra.run.smithi008.stdout: "event": "dispatched", 2023-08-01T19:56:34.520 INFO:teuthology.orchestra.run.smithi008.stdout: "time": "2023-08-01T19:55:58.574230+0000", 2023-08-01T19:56:34.521 INFO:teuthology.orchestra.run.smithi008.stdout: "duration": 0.00044558400000000001 2023-08-01T19:56:34.521 INFO:teuthology.orchestra.run.smithi008.stdout: }, 2023-08-01T19:56:34.521 INFO:teuthology.orchestra.run.smithi008.stdout: { 2023-08-01T19:56:34.521 INFO:teuthology.orchestra.run.smithi008.stdout: "event": "queued_for_pg", 2023-08-01T19:56:34.521 INFO:teuthology.orchestra.run.smithi008.stdout: "time": "2023-08-01T19:55:58.574240+0000", 2023-08-01T19:56:34.521 INFO:teuthology.orchestra.run.smithi008.stdout: "duration": 9.7699999999999996e-06 2023-08-01T19:56:34.521 INFO:teuthology.orchestra.run.smithi008.stdout: }, 2023-08-01T19:56:34.521 INFO:teuthology.orchestra.run.smithi008.stdout: { 2023-08-01T19:56:34.522 INFO:teuthology.orchestra.run.smithi008.stdout: "event": "reached_pg", 2023-08-01T19:56:34.522 INFO:teuthology.orchestra.run.smithi008.stdout: "time": "2023-08-01T19:55:58.574292+0000", 2023-08-01T19:56:34.522 INFO:teuthology.orchestra.run.smithi008.stdout: "duration": 5.2101000000000001e-05 2023-08-01T19:56:34.522 INFO:teuthology.orchestra.run.smithi008.stdout: }, 2023-08-01T19:56:34.522 INFO:teuthology.orchestra.run.smithi008.stdout: { 2023-08-01T19:56:34.522 INFO:teuthology.orchestra.run.smithi008.stdout: "event": "waiting for peered", 2023-08-01T19:56:34.522 INFO:teuthology.orchestra.run.smithi008.stdout: "time": "2023-08-01T19:55:58.574299+0000", 2023-08-01T19:56:34.522 INFO:teuthology.orchestra.run.smithi008.stdout: "duration": 7.3420000000000002e-06 2023-08-01T19:56:34.523 INFO:teuthology.orchestra.run.smithi008.stdout: }, 2023-08-01T19:56:34.523 INFO:teuthology.orchestra.run.smithi008.stdout: { 2023-08-01T19:56:34.523 INFO:teuthology.orchestra.run.smithi008.stdout: "event": "reached_pg", 2023-08-01T19:56:34.523 INFO:teuthology.orchestra.run.smithi008.stdout: "time": "2023-08-01T19:55:59.618545+0000", 2023-08-01T19:56:34.523 INFO:teuthology.orchestra.run.smithi008.stdout: "duration": 1.044245922 2023-08-01T19:56:34.523 INFO:teuthology.orchestra.run.smithi008.stdout: }, 2023-08-01T19:56:34.523 INFO:teuthology.orchestra.run.smithi008.stdout: { 2023-08-01T19:56:34.523 INFO:teuthology.orchestra.run.smithi008.stdout: "event": "started", 2023-08-01T19:56:34.524 INFO:teuthology.orchestra.run.smithi008.stdout: "time": "2023-08-01T19:55:59.618855+0000", 2023-08-01T19:56:34.524 INFO:teuthology.orchestra.run.smithi008.stdout: "duration": 0.00030964099999999999 2023-08-01T19:56:34.524 INFO:teuthology.orchestra.run.smithi008.stdout: }, 2023-08-01T19:56:34.524 INFO:teuthology.orchestra.run.smithi008.stdout: { 2023-08-01T19:56:34.524 INFO:teuthology.orchestra.run.smithi008.stdout: "event": "op_commit", 2023-08-01T19:56:34.524 INFO:teuthology.orchestra.run.smithi008.stdout: "time": "2023-08-01T19:55:59.628438+0000", 2023-08-01T19:56:34.524 INFO:teuthology.orchestra.run.smithi008.stdout: "duration": 0.0095832939999999991 2023-08-01T19:56:34.525 INFO:teuthology.orchestra.run.smithi008.stdout: }, 2023-08-01T19:56:34.525 INFO:teuthology.orchestra.run.smithi008.stdout: { 2023-08-01T19:56:34.525 INFO:teuthology.orchestra.run.smithi008.stdout: "event": "commit_sent", 2023-08-01T19:56:34.525 INFO:teuthology.orchestra.run.smithi008.stdout: "time": "2023-08-01T19:55:59.628479+0000", 2023-08-01T19:56:34.525 INFO:teuthology.orchestra.run.smithi008.stdout: "duration": 4.1350000000000002e-05 2023-08-01T19:56:34.525 INFO:teuthology.orchestra.run.smithi008.stdout: }, 2023-08-01T19:56:34.525 INFO:teuthology.orchestra.run.smithi008.stdout: { 2023-08-01T19:56:34.525 INFO:teuthology.orchestra.run.smithi008.stdout: "event": "done", 2023-08-01T19:56:34.526 INFO:teuthology.orchestra.run.smithi008.stdout: "time": "2023-08-01T19:55:59.628560+0000", 2023-08-01T19:56:34.526 INFO:teuthology.orchestra.run.smithi008.stdout: "duration": 8.0080999999999994e-05 2023-08-01T19:56:34.526 INFO:teuthology.orchestra.run.smithi008.stdout: } 2023-08-01T19:56:34.526 INFO:teuthology.orchestra.run.smithi008.stdout: ] 2023-08-01T19:56:34.526 INFO:teuthology.orchestra.run.smithi008.stdout: } 2023-08-01T19:56:34.526 INFO:teuthology.orchestra.run.smithi008.stdout: }, 2023-08-01T19:56:34.526 INFO:teuthology.orchestra.run.smithi008.stdout: { 2023-08-01T19:56:34.526 INFO:teuthology.orchestra.run.smithi008.stdout: "description": "osd_op(client.4668.0:197415 5.c 5:3e539c01:::benchmark_data_smithi006_114134_object63754:head [delete] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e62)", 2023-08-01T19:56:34.527 INFO:teuthology.orchestra.run.smithi008.stdout: "initiated_at": "2023-08-01T19:55:58.577434+0000", 2023-08-01T19:56:34.527 INFO:teuthology.orchestra.run.smithi008.stdout: "age": 35.763746935999997, 2023-08-01T19:56:34.527 INFO:teuthology.orchestra.run.smithi008.stdout: "duration": 1.0520807059999999, 2023-08-01T19:56:34.527 INFO:teuthology.orchestra.run.smithi008.stdout: "type_data": { 2023-08-01T19:56:34.527 INFO:teuthology.orchestra.run.smithi008.stdout: "flag_point": "commit sent; apply or cleanup", 2023-08-01T19:56:34.527 INFO:teuthology.orchestra.run.smithi008.stdout: "client_info": { 2023-08-01T19:56:34.527 INFO:teuthology.orchestra.run.smithi008.stdout: "client": "client.4668", 2023-08-01T19:56:34.527 INFO:teuthology.orchestra.run.smithi008.stdout: "client_addr": "172.21.15.6:0/1709472247", 2023-08-01T19:56:34.528 INFO:teuthology.orchestra.run.smithi008.stdout: "tid": 197415 2023-08-01T19:56:34.528 INFO:teuthology.orchestra.run.smithi008.stdout: }, 2023-08-01T19:56:34.528 INFO:teuthology.orchestra.run.smithi008.stdout: "events": [ 2023-08-01T19:56:34.528 INFO:teuthology.orchestra.run.smithi008.stdout: { 2023-08-01T19:56:34.528 INFO:teuthology.orchestra.run.smithi008.stdout: "event": "initiated", 2023-08-01T19:56:34.528 INFO:teuthology.orchestra.run.smithi008.stdout: "time": "2023-08-01T19:55:58.577434+0000", 2023-08-01T19:56:34.528 INFO:teuthology.orchestra.run.smithi008.stdout: "duration": 0 2023-08-01T19:56:34.528 INFO:teuthology.orchestra.run.smithi008.stdout: }, 2023-08-01T19:56:34.529 INFO:teuthology.orchestra.run.smithi008.stdout: { 2023-08-01T19:56:34.529 INFO:teuthology.orchestra.run.smithi008.stdout: "event": "throttled", 2023-08-01T19:56:34.529 INFO:teuthology.orchestra.run.smithi008.stdout: "time": "2023-08-01T19:55:58.577434+0000", 2023-08-01T19:56:34.529 INFO:teuthology.orchestra.run.smithi008.stdout: "duration": 0 2023-08-01T19:56:34.529 INFO:teuthology.orchestra.run.smithi008.stdout: }, 2023-08-01T19:56:34.529 INFO:teuthology.orchestra.run.smithi008.stdout: { 2023-08-01T19:56:34.529 INFO:teuthology.orchestra.run.smithi008.stdout: "event": "header_read", 2023-08-01T19:56:34.529 INFO:teuthology.orchestra.run.smithi008.stdout: "time": "2023-08-01T19:55:58.577432+0000", 2023-08-01T19:56:34.530 INFO:teuthology.orchestra.run.smithi008.stdout: "duration": 4294967295.9999986 2023-08-01T19:56:34.530 INFO:teuthology.orchestra.run.smithi008.stdout: }, 2023-08-01T19:56:34.530 INFO:teuthology.orchestra.run.smithi008.stdout: { 2023-08-01T19:56:34.530 INFO:teuthology.orchestra.run.smithi008.stdout: "event": "all_read", 2023-08-01T19:56:34.530 INFO:teuthology.orchestra.run.smithi008.stdout: "time": "2023-08-01T19:55:58.577440+0000", 2023-08-01T19:56:34.530 INFO:teuthology.orchestra.run.smithi008.stdout: "duration": 7.5480000000000004e-06 2023-08-01T19:56:34.530 INFO:teuthology.orchestra.run.smithi008.stdout: }, 2023-08-01T19:56:34.531 INFO:teuthology.orchestra.run.smithi008.stdout: { 2023-08-01T19:56:34.531 INFO:teuthology.orchestra.run.smithi008.stdout: "event": "dispatched", 2023-08-01T19:56:34.531 INFO:teuthology.orchestra.run.smithi008.stdout: "time": "2023-08-01T19:55:58.577454+0000", 2023-08-01T19:56:34.531 INFO:teuthology.orchestra.run.smithi008.stdout: "duration": 1.4216000000000001e-05 2023-08-01T19:56:34.531 INFO:teuthology.orchestra.run.smithi008.stdout: }, 2023-08-01T19:56:34.531 INFO:teuthology.orchestra.run.smithi008.stdout: { 2023-08-01T19:56:34.531 INFO:teuthology.orchestra.run.smithi008.stdout: "event": "queued_for_pg", 2023-08-01T19:56:34.531 INFO:teuthology.orchestra.run.smithi008.stdout: "time": "2023-08-01T19:55:58.577463+0000", 2023-08-01T19:56:34.532 INFO:teuthology.orchestra.run.smithi008.stdout: "duration": 8.2900000000000002e-06 2023-08-01T19:56:34.532 INFO:teuthology.orchestra.run.smithi008.stdout: }, 2023-08-01T19:56:34.532 INFO:teuthology.orchestra.run.smithi008.stdout: { 2023-08-01T19:56:34.532 INFO:teuthology.orchestra.run.smithi008.stdout: "event": "reached_pg", 2023-08-01T19:56:34.532 INFO:teuthology.orchestra.run.smithi008.stdout: "time": "2023-08-01T19:55:58.577498+0000", 2023-08-01T19:56:34.532 INFO:teuthology.orchestra.run.smithi008.stdout: "duration": 3.5302000000000002e-05 2023-08-01T19:56:34.532 INFO:teuthology.orchestra.run.smithi008.stdout: }, 2023-08-01T19:56:34.532 INFO:teuthology.orchestra.run.smithi008.stdout: { 2023-08-01T19:56:34.533 INFO:teuthology.orchestra.run.smithi008.stdout: "event": "waiting for peered", 2023-08-01T19:56:34.533 INFO:teuthology.orchestra.run.smithi008.stdout: "time": "2023-08-01T19:55:58.577503+0000", 2023-08-01T19:56:34.533 INFO:teuthology.orchestra.run.smithi008.stdout: "duration": 4.8409999999999999e-06 2023-08-01T19:56:34.533 INFO:teuthology.orchestra.run.smithi008.stdout: }, 2023-08-01T19:56:34.533 INFO:teuthology.orchestra.run.smithi008.stdout: { 2023-08-01T19:56:34.533 INFO:teuthology.orchestra.run.smithi008.stdout: "event": "reached_pg", 2023-08-01T19:56:34.533 INFO:teuthology.orchestra.run.smithi008.stdout: "time": "2023-08-01T19:55:59.619229+0000", 2023-08-01T19:56:34.533 INFO:teuthology.orchestra.run.smithi008.stdout: "duration": 1.041726119 2023-08-01T19:56:34.534 INFO:teuthology.orchestra.run.smithi008.stdout: }, 2023-08-01T19:56:34.534 INFO:teuthology.orchestra.run.smithi008.stdout: { 2023-08-01T19:56:34.534 INFO:teuthology.orchestra.run.smithi008.stdout: "event": "started", 2023-08-01T19:56:34.534 INFO:teuthology.orchestra.run.smithi008.stdout: "time": "2023-08-01T19:55:59.619326+0000", 2023-08-01T19:56:34.534 INFO:teuthology.orchestra.run.smithi008.stdout: "duration": 9.7044000000000001e-05 2023-08-01T19:56:34.534 INFO:teuthology.orchestra.run.smithi008.stdout: }, 2023-08-01T19:56:34.534 INFO:teuthology.orchestra.run.smithi008.stdout: { 2023-08-01T19:56:34.534 INFO:teuthology.orchestra.run.smithi008.stdout: "event": "op_commit", 2023-08-01T19:56:34.535 INFO:teuthology.orchestra.run.smithi008.stdout: "time": "2023-08-01T19:55:59.629399+0000", 2023-08-01T19:56:34.535 INFO:teuthology.orchestra.run.smithi008.stdout: "duration": 0.010073014 2023-08-01T19:56:34.535 INFO:teuthology.orchestra.run.smithi008.stdout: }, 2023-08-01T19:56:34.535 INFO:teuthology.orchestra.run.smithi008.stdout: { 2023-08-01T19:56:34.535 INFO:teuthology.orchestra.run.smithi008.stdout: "event": "commit_sent", 2023-08-01T19:56:34.535 INFO:teuthology.orchestra.run.smithi008.stdout: "time": "2023-08-01T19:55:59.629443+0000", 2023-08-01T19:56:34.535 INFO:teuthology.orchestra.run.smithi008.stdout: "duration": 4.3739999999999998e-05 2023-08-01T19:56:34.535 INFO:teuthology.orchestra.run.smithi008.stdout: }, 2023-08-01T19:56:34.536 INFO:teuthology.orchestra.run.smithi008.stdout: { 2023-08-01T19:56:34.536 INFO:teuthology.orchestra.run.smithi008.stdout: "event": "done", 2023-08-01T19:56:34.536 INFO:teuthology.orchestra.run.smithi008.stdout: "time": "2023-08-01T19:55:59.629515+0000", 2023-08-01T19:56:34.536 INFO:teuthology.orchestra.run.smithi008.stdout: "duration": 7.2089999999999996e-05 2023-08-01T19:56:34.536 INFO:teuthology.orchestra.run.smithi008.stdout: } 2023-08-01T19:56:34.536 INFO:teuthology.orchestra.run.smithi008.stdout: ] 2023-08-01T19:56:34.536 INFO:teuthology.orchestra.run.smithi008.stdout: } 2023-08-01T19:56:34.536 INFO:teuthology.orchestra.run.smithi008.stdout: }, 2023-08-01T19:56:34.537 INFO:teuthology.orchestra.run.smithi008.stdout: { 2023-08-01T19:56:34.537 INFO:teuthology.orchestra.run.smithi008.stdout: "description": "osd_op(client.4668.0:197417 5.7 5:eb36cb7d:::benchmark_data_smithi006_114134_object63756:head [delete] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e62)", 2023-08-01T19:56:34.537 INFO:teuthology.orchestra.run.smithi008.stdout: "initiated_at": "2023-08-01T19:55:58.578162+0000", 2023-08-01T19:56:34.537 INFO:teuthology.orchestra.run.smithi008.stdout: "age": 35.763018639000002, 2023-08-01T19:56:34.537 INFO:teuthology.orchestra.run.smithi008.stdout: "duration": 1.0582469299999999, 2023-08-01T19:56:34.537 INFO:teuthology.orchestra.run.smithi008.stdout: "type_data": { 2023-08-01T19:56:34.537 INFO:teuthology.orchestra.run.smithi008.stdout: "flag_point": "commit sent; apply or cleanup", 2023-08-01T19:56:34.538 INFO:teuthology.orchestra.run.smithi008.stdout: "client_info": { 2023-08-01T19:56:34.538 INFO:teuthology.orchestra.run.smithi008.stdout: "client": "client.4668", 2023-08-01T19:56:34.538 INFO:teuthology.orchestra.run.smithi008.stdout: "client_addr": "172.21.15.6:0/1709472247", 2023-08-01T19:56:34.538 INFO:teuthology.orchestra.run.smithi008.stdout: "tid": 197417 2023-08-01T19:56:34.538 INFO:teuthology.orchestra.run.smithi008.stdout: }, 2023-08-01T19:56:34.538 INFO:teuthology.orchestra.run.smithi008.stdout: "events": [ 2023-08-01T19:56:34.538 INFO:teuthology.orchestra.run.smithi008.stdout: { 2023-08-01T19:56:34.538 INFO:teuthology.orchestra.run.smithi008.stdout: "event": "initiated", 2023-08-01T19:56:34.539 INFO:teuthology.orchestra.run.smithi008.stdout: "time": "2023-08-01T19:55:58.578162+0000", 2023-08-01T19:56:34.539 INFO:teuthology.orchestra.run.smithi008.stdout: "duration": 0 2023-08-01T19:56:34.539 INFO:teuthology.orchestra.run.smithi008.stdout: }, 2023-08-01T19:56:34.539 INFO:teuthology.orchestra.run.smithi008.stdout: { 2023-08-01T19:56:34.539 INFO:teuthology.orchestra.run.smithi008.stdout: "event": "throttled", 2023-08-01T19:56:34.539 INFO:teuthology.orchestra.run.smithi008.stdout: "time": "2023-08-01T19:55:58.578162+0000", 2023-08-01T19:56:34.539 INFO:teuthology.orchestra.run.smithi008.stdout: "duration": 0 2023-08-01T19:56:34.539 INFO:teuthology.orchestra.run.smithi008.stdout: }, 2023-08-01T19:56:34.540 INFO:teuthology.orchestra.run.smithi008.stdout: { 2023-08-01T19:56:34.540 INFO:teuthology.orchestra.run.smithi008.stdout: "event": "header_read", 2023-08-01T19:56:34.540 INFO:teuthology.orchestra.run.smithi008.stdout: "time": "2023-08-01T19:55:58.578161+0000", 2023-08-01T19:56:34.540 INFO:teuthology.orchestra.run.smithi008.stdout: "duration": 4294967295.999999 2023-08-01T19:56:34.540 INFO:teuthology.orchestra.run.smithi008.stdout: }, 2023-08-01T19:56:34.540 INFO:teuthology.orchestra.run.smithi008.stdout: { 2023-08-01T19:56:34.540 INFO:teuthology.orchestra.run.smithi008.stdout: "event": "all_read", 2023-08-01T19:56:34.540 INFO:teuthology.orchestra.run.smithi008.stdout: "time": "2023-08-01T19:55:58.578166+0000", 2023-08-01T19:56:34.541 INFO:teuthology.orchestra.run.smithi008.stdout: "duration": 4.6589999999999998e-06 2023-08-01T19:56:34.541 INFO:teuthology.orchestra.run.smithi008.stdout: }, 2023-08-01T19:56:34.541 INFO:teuthology.orchestra.run.smithi008.stdout: { 2023-08-01T19:56:34.541 INFO:teuthology.orchestra.run.smithi008.stdout: "event": "dispatched", 2023-08-01T19:56:34.541 INFO:teuthology.orchestra.run.smithi008.stdout: "time": "2023-08-01T19:55:58.578177+0000", 2023-08-01T19:56:34.541 INFO:teuthology.orchestra.run.smithi008.stdout: "duration": 1.0512e-05 2023-08-01T19:56:34.541 INFO:teuthology.orchestra.run.smithi008.stdout: }, 2023-08-01T19:56:34.541 INFO:teuthology.orchestra.run.smithi008.stdout: { 2023-08-01T19:56:34.542 INFO:teuthology.orchestra.run.smithi008.stdout: "event": "queued_for_pg", 2023-08-01T19:56:34.542 INFO:teuthology.orchestra.run.smithi008.stdout: "time": "2023-08-01T19:55:58.578182+0000", 2023-08-01T19:56:34.542 INFO:teuthology.orchestra.run.smithi008.stdout: "duration": 5.6540000000000004e-06 2023-08-01T19:56:34.542 INFO:teuthology.orchestra.run.smithi008.stdout: }, 2023-08-01T19:56:34.542 INFO:teuthology.orchestra.run.smithi008.stdout: { 2023-08-01T19:56:34.542 INFO:teuthology.orchestra.run.smithi008.stdout: "event": "reached_pg", 2023-08-01T19:56:34.542 INFO:teuthology.orchestra.run.smithi008.stdout: "time": "2023-08-01T19:55:58.578221+0000", 2023-08-01T19:56:34.542 INFO:teuthology.orchestra.run.smithi008.stdout: "duration": 3.8764999999999999e-05 2023-08-01T19:56:34.543 INFO:teuthology.orchestra.run.smithi008.stdout: }, 2023-08-01T19:56:34.543 INFO:teuthology.orchestra.run.smithi008.stdout: { 2023-08-01T19:56:34.543 INFO:teuthology.orchestra.run.smithi008.stdout: "event": "waiting for peered", 2023-08-01T19:56:34.543 INFO:teuthology.orchestra.run.smithi008.stdout: "time": "2023-08-01T19:55:58.578226+0000", 2023-08-01T19:56:34.543 INFO:teuthology.orchestra.run.smithi008.stdout: "duration": 4.6319999999999999e-06 2023-08-01T19:56:34.543 INFO:teuthology.orchestra.run.smithi008.stdout: }, 2023-08-01T19:56:34.543 INFO:teuthology.orchestra.run.smithi008.stdout: { 2023-08-01T19:56:34.543 INFO:teuthology.orchestra.run.smithi008.stdout: "event": "reached_pg", 2023-08-01T19:56:34.544 INFO:teuthology.orchestra.run.smithi008.stdout: "time": "2023-08-01T19:55:59.628027+0000", 2023-08-01T19:56:34.544 INFO:teuthology.orchestra.run.smithi008.stdout: "duration": 1.049801261 2023-08-01T19:56:34.544 INFO:teuthology.orchestra.run.smithi008.stdout: }, 2023-08-01T19:56:34.544 INFO:teuthology.orchestra.run.smithi008.stdout: { 2023-08-01T19:56:34.544 INFO:teuthology.orchestra.run.smithi008.stdout: "event": "started", 2023-08-01T19:56:34.544 INFO:teuthology.orchestra.run.smithi008.stdout: "time": "2023-08-01T19:55:59.628156+0000", 2023-08-01T19:56:34.544 INFO:teuthology.orchestra.run.smithi008.stdout: "duration": 0.00012906899999999999 2023-08-01T19:56:34.544 INFO:teuthology.orchestra.run.smithi008.stdout: }, 2023-08-01T19:56:34.545 INFO:teuthology.orchestra.run.smithi008.stdout: { 2023-08-01T19:56:34.545 INFO:teuthology.orchestra.run.smithi008.stdout: "event": "op_commit", 2023-08-01T19:56:34.545 INFO:teuthology.orchestra.run.smithi008.stdout: "time": "2023-08-01T19:55:59.636292+0000", 2023-08-01T19:56:34.545 INFO:teuthology.orchestra.run.smithi008.stdout: "duration": 0.0081362859999999995 2023-08-01T19:56:34.545 INFO:teuthology.orchestra.run.smithi008.stdout: }, 2023-08-01T19:56:34.545 INFO:teuthology.orchestra.run.smithi008.stdout: { 2023-08-01T19:56:34.545 INFO:teuthology.orchestra.run.smithi008.stdout: "event": "commit_sent", 2023-08-01T19:56:34.546 INFO:teuthology.orchestra.run.smithi008.stdout: "time": "2023-08-01T19:55:59.636343+0000", 2023-08-01T19:56:34.547 INFO:teuthology.orchestra.run.smithi008.stdout: "duration": 5.0603000000000003e-05 2023-08-01T19:56:34.547 INFO:teuthology.orchestra.run.smithi008.stdout: }, 2023-08-01T19:56:34.547 INFO:teuthology.orchestra.run.smithi008.stdout: { 2023-08-01T19:56:34.547 INFO:teuthology.orchestra.run.smithi008.stdout: "event": "done", 2023-08-01T19:56:34.547 INFO:teuthology.orchestra.run.smithi008.stdout: "time": "2023-08-01T19:55:59.636409+0000", 2023-08-01T19:56:34.547 INFO:teuthology.orchestra.run.smithi008.stdout: "duration": 6.6353999999999995e-05 2023-08-01T19:56:34.548 INFO:teuthology.orchestra.run.smithi008.stdout: } 2023-08-01T19:56:34.548 INFO:teuthology.orchestra.run.smithi008.stdout: ] 2023-08-01T19:56:34.548 INFO:teuthology.orchestra.run.smithi008.stdout: } 2023-08-01T19:56:34.548 INFO:teuthology.orchestra.run.smithi008.stdout: }, 2023-08-01T19:56:34.548 INFO:teuthology.orchestra.run.smithi008.stdout: { 2023-08-01T19:56:34.548 INFO:teuthology.orchestra.run.smithi008.stdout: "description": "osd_op(client.4668.0:197418 5.2 5:4ba84ab7:::benchmark_data_smithi006_114134_object63757:head [delete] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e62)", 2023-08-01T19:56:34.548 INFO:teuthology.orchestra.run.smithi008.stdout: "initiated_at": "2023-08-01T19:55:58.580297+0000", 2023-08-01T19:56:34.548 INFO:teuthology.orchestra.run.smithi008.stdout: "age": 35.760884286, 2023-08-01T19:56:34.549 INFO:teuthology.orchestra.run.smithi008.stdout: "duration": 1.0529485839999999, 2023-08-01T19:56:34.549 INFO:teuthology.orchestra.run.smithi008.stdout: "type_data": { 2023-08-01T19:56:34.549 INFO:teuthology.orchestra.run.smithi008.stdout: "flag_point": "commit sent; apply or cleanup", 2023-08-01T19:56:34.549 INFO:teuthology.orchestra.run.smithi008.stdout: "client_info": { 2023-08-01T19:56:34.549 INFO:teuthology.orchestra.run.smithi008.stdout: "client": "client.4668", 2023-08-01T19:56:34.549 INFO:teuthology.orchestra.run.smithi008.stdout: "client_addr": "172.21.15.6:0/1709472247", 2023-08-01T19:56:34.549 INFO:teuthology.orchestra.run.smithi008.stdout: "tid": 197418 2023-08-01T19:56:34.549 INFO:teuthology.orchestra.run.smithi008.stdout: }, 2023-08-01T19:56:34.550 INFO:teuthology.orchestra.run.smithi008.stdout: "events": [ 2023-08-01T19:56:34.550 INFO:teuthology.orchestra.run.smithi008.stdout: { 2023-08-01T19:56:34.550 INFO:teuthology.orchestra.run.smithi008.stdout: "event": "initiated", 2023-08-01T19:56:34.550 INFO:teuthology.orchestra.run.smithi008.stdout: "time": "2023-08-01T19:55:58.580297+0000", 2023-08-01T19:56:34.550 INFO:teuthology.orchestra.run.smithi008.stdout: "duration": 0 2023-08-01T19:56:34.550 INFO:teuthology.orchestra.run.smithi008.stdout: }, 2023-08-01T19:56:34.550 INFO:teuthology.orchestra.run.smithi008.stdout: { 2023-08-01T19:56:34.551 INFO:teuthology.orchestra.run.smithi008.stdout: "event": "throttled", 2023-08-01T19:56:34.551 INFO:teuthology.orchestra.run.smithi008.stdout: "time": "2023-08-01T19:55:58.580297+0000", 2023-08-01T19:56:34.551 INFO:teuthology.orchestra.run.smithi008.stdout: "duration": 0 2023-08-01T19:56:34.551 INFO:teuthology.orchestra.run.smithi008.stdout: }, 2023-08-01T19:56:34.551 INFO:teuthology.orchestra.run.smithi008.stdout: { 2023-08-01T19:56:34.551 INFO:teuthology.orchestra.run.smithi008.stdout: "event": "header_read", 2023-08-01T19:56:34.551 INFO:teuthology.orchestra.run.smithi008.stdout: "time": "2023-08-01T19:55:58.580296+0000", 2023-08-01T19:56:34.551 INFO:teuthology.orchestra.run.smithi008.stdout: "duration": 4294967295.999999 2023-08-01T19:56:34.552 INFO:teuthology.orchestra.run.smithi008.stdout: }, 2023-08-01T19:56:34.552 INFO:teuthology.orchestra.run.smithi008.stdout: { 2023-08-01T19:56:34.552 INFO:teuthology.orchestra.run.smithi008.stdout: "event": "all_read", 2023-08-01T19:56:34.552 INFO:teuthology.orchestra.run.smithi008.stdout: "time": "2023-08-01T19:55:58.580302+0000", 2023-08-01T19:56:34.552 INFO:teuthology.orchestra.run.smithi008.stdout: "duration": 6.032e-06 2023-08-01T19:56:34.552 INFO:teuthology.orchestra.run.smithi008.stdout: }, 2023-08-01T19:56:34.552 INFO:teuthology.orchestra.run.smithi008.stdout: { 2023-08-01T19:56:34.552 INFO:teuthology.orchestra.run.smithi008.stdout: "event": "dispatched", 2023-08-01T19:56:34.553 INFO:teuthology.orchestra.run.smithi008.stdout: "time": "2023-08-01T19:55:58.580315+0000", 2023-08-01T19:56:34.553 INFO:teuthology.orchestra.run.smithi008.stdout: "duration": 1.327e-05 2023-08-01T19:56:34.553 INFO:teuthology.orchestra.run.smithi008.stdout: }, 2023-08-01T19:56:34.553 INFO:teuthology.orchestra.run.smithi008.stdout: { 2023-08-01T19:56:34.553 INFO:teuthology.orchestra.run.smithi008.stdout: "event": "queued_for_pg", 2023-08-01T19:56:34.553 INFO:teuthology.orchestra.run.smithi008.stdout: "time": "2023-08-01T19:55:58.580321+0000", 2023-08-01T19:56:34.553 INFO:teuthology.orchestra.run.smithi008.stdout: "duration": 6.3980000000000004e-06 2023-08-01T19:56:34.553 INFO:teuthology.orchestra.run.smithi008.stdout: }, 2023-08-01T19:56:34.554 INFO:teuthology.orchestra.run.smithi008.stdout: { 2023-08-01T19:56:34.554 INFO:teuthology.orchestra.run.smithi008.stdout: "event": "reached_pg", 2023-08-01T19:56:34.554 INFO:teuthology.orchestra.run.smithi008.stdout: "time": "2023-08-01T19:55:58.580372+0000", 2023-08-01T19:56:34.554 INFO:teuthology.orchestra.run.smithi008.stdout: "duration": 5.0219000000000001e-05 2023-08-01T19:56:34.554 INFO:teuthology.orchestra.run.smithi008.stdout: }, 2023-08-01T19:56:34.554 INFO:teuthology.orchestra.run.smithi008.stdout: { 2023-08-01T19:56:34.554 INFO:teuthology.orchestra.run.smithi008.stdout: "event": "waiting for peered", 2023-08-01T19:56:34.554 INFO:teuthology.orchestra.run.smithi008.stdout: "time": "2023-08-01T19:55:58.580378+0000", 2023-08-01T19:56:34.555 INFO:teuthology.orchestra.run.smithi008.stdout: "duration": 6.6529999999999997e-06 2023-08-01T19:56:34.555 INFO:teuthology.orchestra.run.smithi008.stdout: }, 2023-08-01T19:56:34.555 INFO:teuthology.orchestra.run.smithi008.stdout: { 2023-08-01T19:56:34.555 INFO:teuthology.orchestra.run.smithi008.stdout: "event": "reached_pg", 2023-08-01T19:56:34.555 INFO:teuthology.orchestra.run.smithi008.stdout: "time": "2023-08-01T19:55:59.618188+0000", 2023-08-01T19:56:34.555 INFO:teuthology.orchestra.run.smithi008.stdout: "duration": 1.037810267 2023-08-01T19:56:34.555 INFO:teuthology.orchestra.run.smithi008.stdout: }, 2023-08-01T19:56:34.555 INFO:teuthology.orchestra.run.smithi008.stdout: { 2023-08-01T19:56:34.556 INFO:teuthology.orchestra.run.smithi008.stdout: "event": "started", 2023-08-01T19:56:34.556 INFO:teuthology.orchestra.run.smithi008.stdout: "time": "2023-08-01T19:55:59.618308+0000", 2023-08-01T19:56:34.556 INFO:teuthology.orchestra.run.smithi008.stdout: "duration": 0.00011959 2023-08-01T19:56:34.556 INFO:teuthology.orchestra.run.smithi008.stdout: }, 2023-08-01T19:56:34.556 INFO:teuthology.orchestra.run.smithi008.stdout: { 2023-08-01T19:56:34.556 INFO:teuthology.orchestra.run.smithi008.stdout: "event": "op_commit", 2023-08-01T19:56:34.556 INFO:teuthology.orchestra.run.smithi008.stdout: "time": "2023-08-01T19:55:59.633122+0000", 2023-08-01T19:56:34.557 INFO:teuthology.orchestra.run.smithi008.stdout: "duration": 0.014814280000000001 2023-08-01T19:56:34.557 INFO:teuthology.orchestra.run.smithi008.stdout: }, 2023-08-01T19:56:34.557 INFO:teuthology.orchestra.run.smithi008.stdout: { 2023-08-01T19:56:34.557 INFO:teuthology.orchestra.run.smithi008.stdout: "event": "commit_sent", 2023-08-01T19:56:34.557 INFO:teuthology.orchestra.run.smithi008.stdout: "time": "2023-08-01T19:55:59.633167+0000", 2023-08-01T19:56:34.557 INFO:teuthology.orchestra.run.smithi008.stdout: "duration": 4.4651999999999999e-05 2023-08-01T19:56:34.557 INFO:teuthology.orchestra.run.smithi008.stdout: }, 2023-08-01T19:56:34.557 INFO:teuthology.orchestra.run.smithi008.stdout: { 2023-08-01T19:56:34.558 INFO:teuthology.orchestra.run.smithi008.stdout: "event": "done", 2023-08-01T19:56:34.558 INFO:teuthology.orchestra.run.smithi008.stdout: "time": "2023-08-01T19:55:59.633245+0000", 2023-08-01T19:56:34.558 INFO:teuthology.orchestra.run.smithi008.stdout: "duration": 7.8215999999999998e-05 2023-08-01T19:56:34.558 INFO:teuthology.orchestra.run.smithi008.stdout: } 2023-08-01T19:56:34.558 INFO:teuthology.orchestra.run.smithi008.stdout: ] 2023-08-01T19:56:34.558 INFO:teuthology.orchestra.run.smithi008.stdout: } 2023-08-01T19:56:34.558 INFO:teuthology.orchestra.run.smithi008.stdout: } 2023-08-01T19:56:34.558 INFO:teuthology.orchestra.run.smithi008.stdout: ] 2023-08-01T19:56:34.559 INFO:teuthology.orchestra.run.smithi008.stdout:} 2023-08-01T19:56:34.559 DEBUG:teuthology.orchestra.run.smithi155:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 30 ceph --cluster ceph --admin-daemon /var/run/ceph/ceph-osd.2.asok dump_ops_in_flight 2023-08-01T19:56:34.559 INFO:tasks.ceph.osd.0.smithi008.stderr:2023-08-01T19:56:34.547+0000 7f16a58f4700 -1 received signal: Hangup from /usr/bin/python3 /bin/daemon-helper kill ceph-osd -f --cluster ceph -i 0 (PID: 111179) UID: 0 2023-08-01T19:56:34.563 INFO:tasks.radosbench.radosbench.0.smithi006.stdout:Removed 133658 objects 2023-08-01T19:56:34.563 INFO:tasks.radosbench.radosbench.0.smithi006.stdout:Clean up completed and total clean up time :69.2334 2023-08-01T19:56:34.647 INFO:tasks.ceph.osd.2.smithi155.stderr:2023-08-01T19:56:34.646+0000 7faa5c6ac700 -1 received signal: Hangup from /usr/bin/python3 /bin/daemon-helper kill ceph-osd -f --cluster ceph -i 2 (PID: 111337) UID: 0 2023-08-01T19:56:34.682 INFO:teuthology.orchestra.run.smithi155.stdout:{ 2023-08-01T19:56:34.682 INFO:teuthology.orchestra.run.smithi155.stdout: "ops": [], 2023-08-01T19:56:34.682 INFO:teuthology.orchestra.run.smithi155.stdout: "num_ops": 0 2023-08-01T19:56:34.683 INFO:teuthology.orchestra.run.smithi155.stdout:} 2023-08-01T19:56:34.692 DEBUG:teuthology.orchestra.run.smithi155:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 30 ceph --cluster ceph --admin-daemon /var/run/ceph/ceph-osd.2.asok dump_blocked_ops 2023-08-01T19:56:34.748 INFO:tasks.ceph.osd.0.smithi008.stderr:2023-08-01T19:56:34.748+0000 7f16a58f4700 -1 received signal: Hangup from /usr/bin/python3 /bin/daemon-helper kill ceph-osd -f --cluster ceph -i 0 (PID: 111179) UID: 0 2023-08-01T19:56:34.849 INFO:tasks.ceph.osd.0.smithi008.stderr:2023-08-01T19:56:34.848+0000 7f16a58f4700 -1 received signal: Hangup from /usr/bin/python3 /bin/daemon-helper kill ceph-osd -f --cluster ceph -i 0 (PID: 111179) UID: 0 2023-08-01T19:56:34.854 INFO:teuthology.orchestra.run.smithi155.stdout:{ 2023-08-01T19:56:34.854 INFO:teuthology.orchestra.run.smithi155.stdout: "ops": [], 2023-08-01T19:56:34.855 INFO:teuthology.orchestra.run.smithi155.stdout: "complaint_time": 30, 2023-08-01T19:56:34.855 INFO:teuthology.orchestra.run.smithi155.stdout: "num_blocked_ops": 0 2023-08-01T19:56:34.855 INFO:teuthology.orchestra.run.smithi155.stdout:} 2023-08-01T19:56:34.864 DEBUG:teuthology.orchestra.run.smithi155:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 30 ceph --cluster ceph --admin-daemon /var/run/ceph/ceph-osd.2.asok dump_historic_ops 2023-08-01T19:56:34.950 INFO:tasks.ceph.osd.2.smithi155.stderr:2023-08-01T19:56:34.948+0000 7faa5c6ac700 -1 received signal: Hangup from /usr/bin/python3 /bin/daemon-helper kill ceph-osd -f --cluster ceph -i 2 (PID: 111337) UID: 0 2023-08-01T19:56:34.988 INFO:teuthology.orchestra.run.smithi155.stdout:{ 2023-08-01T19:56:34.988 INFO:teuthology.orchestra.run.smithi155.stdout: "size": 20, 2023-08-01T19:56:34.989 INFO:teuthology.orchestra.run.smithi155.stdout: "duration": 600, 2023-08-01T19:56:34.989 INFO:teuthology.orchestra.run.smithi155.stdout: "ops": [ 2023-08-01T19:56:34.989 INFO:teuthology.orchestra.run.smithi155.stdout: { 2023-08-01T19:56:34.989 INFO:teuthology.orchestra.run.smithi155.stdout: "description": "osd_op(client.4668.0:100237 5.4 5:2d68bec9:::benchmark_data_smithi006_114134_object100236:head [set-alloc-hint object_size 65536 write_size 65536,write 0~65536] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e37)", 2023-08-01T19:56:34.989 INFO:teuthology.orchestra.run.smithi155.stdout: "initiated_at": "2023-08-01T19:55:05.147736+0000", 2023-08-01T19:56:34.989 INFO:teuthology.orchestra.run.smithi155.stdout: "age": 89.838401472000001, 2023-08-01T19:56:34.989 INFO:teuthology.orchestra.run.smithi155.stdout: "duration": 0.071299464000000007, 2023-08-01T19:56:34.989 INFO:teuthology.orchestra.run.smithi155.stdout: "type_data": { 2023-08-01T19:56:34.990 INFO:teuthology.orchestra.run.smithi155.stdout: "flag_point": "commit sent; apply or cleanup", 2023-08-01T19:56:34.990 INFO:teuthology.orchestra.run.smithi155.stdout: "client_info": { 2023-08-01T19:56:34.990 INFO:teuthology.orchestra.run.smithi155.stdout: "client": "client.4668", 2023-08-01T19:56:34.990 INFO:teuthology.orchestra.run.smithi155.stdout: "client_addr": "172.21.15.6:0/1709472247", 2023-08-01T19:56:34.990 INFO:teuthology.orchestra.run.smithi155.stdout: "tid": 100237 2023-08-01T19:56:34.990 INFO:teuthology.orchestra.run.smithi155.stdout: }, 2023-08-01T19:56:34.990 INFO:teuthology.orchestra.run.smithi155.stdout: "events": [ 2023-08-01T19:56:34.991 INFO:teuthology.orchestra.run.smithi155.stdout: { 2023-08-01T19:56:34.991 INFO:teuthology.orchestra.run.smithi155.stdout: "event": "initiated", 2023-08-01T19:56:34.991 INFO:teuthology.orchestra.run.smithi155.stdout: "time": "2023-08-01T19:55:05.147736+0000", 2023-08-01T19:56:34.991 INFO:teuthology.orchestra.run.smithi155.stdout: "duration": 0 2023-08-01T19:56:34.991 INFO:teuthology.orchestra.run.smithi155.stdout: }, 2023-08-01T19:56:34.991 INFO:teuthology.orchestra.run.smithi155.stdout: { 2023-08-01T19:56:34.991 INFO:teuthology.orchestra.run.smithi155.stdout: "event": "throttled", 2023-08-01T19:56:34.992 INFO:teuthology.orchestra.run.smithi155.stdout: "time": "2023-08-01T19:55:05.147736+0000", 2023-08-01T19:56:34.992 INFO:teuthology.orchestra.run.smithi155.stdout: "duration": 0 2023-08-01T19:56:34.992 INFO:teuthology.orchestra.run.smithi155.stdout: }, 2023-08-01T19:56:34.993 INFO:teuthology.orchestra.run.smithi155.stdout: { 2023-08-01T19:56:34.993 INFO:teuthology.orchestra.run.smithi155.stdout: "event": "header_read", 2023-08-01T19:56:34.993 INFO:teuthology.orchestra.run.smithi155.stdout: "time": "2023-08-01T19:55:05.147736+0000", 2023-08-01T19:56:34.993 INFO:teuthology.orchestra.run.smithi155.stdout: "duration": 4294967295.9999995 2023-08-01T19:56:34.994 INFO:teuthology.orchestra.run.smithi155.stdout: }, 2023-08-01T19:56:34.994 INFO:teuthology.orchestra.run.smithi155.stdout: { 2023-08-01T19:56:34.994 INFO:teuthology.orchestra.run.smithi155.stdout: "event": "all_read", 2023-08-01T19:56:34.994 INFO:teuthology.orchestra.run.smithi155.stdout: "time": "2023-08-01T19:55:05.147766+0000", 2023-08-01T19:56:34.994 INFO:teuthology.orchestra.run.smithi155.stdout: "duration": 3.0394000000000001e-05 2023-08-01T19:56:34.994 INFO:teuthology.orchestra.run.smithi155.stdout: }, 2023-08-01T19:56:34.995 INFO:teuthology.orchestra.run.smithi155.stdout: { 2023-08-01T19:56:34.995 INFO:teuthology.orchestra.run.smithi155.stdout: "event": "dispatched", 2023-08-01T19:56:34.995 INFO:teuthology.orchestra.run.smithi155.stdout: "time": "2023-08-01T19:55:05.147771+0000", 2023-08-01T19:56:34.995 INFO:teuthology.orchestra.run.smithi155.stdout: "duration": 4.25e-06 2023-08-01T19:56:34.995 INFO:teuthology.orchestra.run.smithi155.stdout: }, 2023-08-01T19:56:34.995 INFO:teuthology.orchestra.run.smithi155.stdout: { 2023-08-01T19:56:34.995 INFO:teuthology.orchestra.run.smithi155.stdout: "event": "queued_for_pg", 2023-08-01T19:56:34.996 INFO:teuthology.orchestra.run.smithi155.stdout: "time": "2023-08-01T19:55:05.147773+0000", 2023-08-01T19:56:34.996 INFO:teuthology.orchestra.run.smithi155.stdout: "duration": 2.4159999999999998e-06 2023-08-01T19:56:34.996 INFO:teuthology.orchestra.run.smithi155.stdout: }, 2023-08-01T19:56:34.996 INFO:teuthology.orchestra.run.smithi155.stdout: { 2023-08-01T19:56:34.996 INFO:teuthology.orchestra.run.smithi155.stdout: "event": "reached_pg", 2023-08-01T19:56:34.996 INFO:teuthology.orchestra.run.smithi155.stdout: "time": "2023-08-01T19:55:05.149903+0000", 2023-08-01T19:56:34.996 INFO:teuthology.orchestra.run.smithi155.stdout: "duration": 0.002129948 2023-08-01T19:56:34.996 INFO:teuthology.orchestra.run.smithi155.stdout: }, 2023-08-01T19:56:34.997 INFO:teuthology.orchestra.run.smithi155.stdout: { 2023-08-01T19:56:34.997 INFO:teuthology.orchestra.run.smithi155.stdout: "event": "started", 2023-08-01T19:56:34.997 INFO:teuthology.orchestra.run.smithi155.stdout: "time": "2023-08-01T19:55:05.149982+0000", 2023-08-01T19:56:34.997 INFO:teuthology.orchestra.run.smithi155.stdout: "duration": 7.8706000000000002e-05 2023-08-01T19:56:34.997 INFO:teuthology.orchestra.run.smithi155.stdout: }, 2023-08-01T19:56:34.997 INFO:teuthology.orchestra.run.smithi155.stdout: { 2023-08-01T19:56:34.998 INFO:teuthology.orchestra.run.smithi155.stdout: "event": "waiting for subops from 0", 2023-08-01T19:56:34.998 INFO:teuthology.orchestra.run.smithi155.stdout: "time": "2023-08-01T19:55:05.150066+0000", 2023-08-01T19:56:34.998 INFO:teuthology.orchestra.run.smithi155.stdout: "duration": 8.4241999999999997e-05 2023-08-01T19:56:34.998 INFO:teuthology.orchestra.run.smithi155.stdout: }, 2023-08-01T19:56:34.998 INFO:teuthology.orchestra.run.smithi155.stdout: { 2023-08-01T19:56:34.998 INFO:teuthology.orchestra.run.smithi155.stdout: "event": "op_commit", 2023-08-01T19:56:34.998 INFO:teuthology.orchestra.run.smithi155.stdout: "time": "2023-08-01T19:55:05.154994+0000", 2023-08-01T19:56:34.998 INFO:teuthology.orchestra.run.smithi155.stdout: "duration": 0.0049277050000000001 2023-08-01T19:56:34.999 INFO:teuthology.orchestra.run.smithi155.stdout: }, 2023-08-01T19:56:34.999 INFO:teuthology.orchestra.run.smithi155.stdout: { 2023-08-01T19:56:34.999 INFO:teuthology.orchestra.run.smithi155.stdout: "event": "sub_op_commit_rec", 2023-08-01T19:56:34.999 INFO:teuthology.orchestra.run.smithi155.stdout: "time": "2023-08-01T19:55:05.218933+0000", 2023-08-01T19:56:34.999 INFO:teuthology.orchestra.run.smithi155.stdout: "duration": 0.063939916999999999 2023-08-01T19:56:34.999 INFO:teuthology.orchestra.run.smithi155.stdout: }, 2023-08-01T19:56:35.000 INFO:teuthology.orchestra.run.smithi155.stdout: { 2023-08-01T19:56:35.000 INFO:teuthology.orchestra.run.smithi155.stdout: "event": "commit_sent", 2023-08-01T19:56:35.000 INFO:teuthology.orchestra.run.smithi155.stdout: "time": "2023-08-01T19:55:05.218989+0000", 2023-08-01T19:56:35.000 INFO:teuthology.orchestra.run.smithi155.stdout: "duration": 5.5772000000000001e-05 2023-08-01T19:56:35.000 INFO:teuthology.orchestra.run.smithi155.stdout: }, 2023-08-01T19:56:35.000 INFO:teuthology.orchestra.run.smithi155.stdout: { 2023-08-01T19:56:35.000 INFO:teuthology.orchestra.run.smithi155.stdout: "event": "done", 2023-08-01T19:56:35.000 INFO:teuthology.orchestra.run.smithi155.stdout: "time": "2023-08-01T19:55:05.219036+0000", 2023-08-01T19:56:35.001 INFO:teuthology.orchestra.run.smithi155.stdout: "duration": 4.6526000000000001e-05 2023-08-01T19:56:35.001 INFO:teuthology.orchestra.run.smithi155.stdout: } 2023-08-01T19:56:35.001 INFO:teuthology.orchestra.run.smithi155.stdout: ] 2023-08-01T19:56:35.001 INFO:teuthology.orchestra.run.smithi155.stdout: } 2023-08-01T19:56:35.001 INFO:teuthology.orchestra.run.smithi155.stdout: }, 2023-08-01T19:56:35.001 INFO:teuthology.orchestra.run.smithi155.stdout: { 2023-08-01T19:56:35.001 INFO:teuthology.orchestra.run.smithi155.stdout: "description": "osd_op(client.4668.0:100242 5.8 5:16a314b8:::benchmark_data_smithi006_114134_object100241:head [set-alloc-hint object_size 65536 write_size 65536,write 0~65536] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e37)", 2023-08-01T19:56:35.001 INFO:teuthology.orchestra.run.smithi155.stdout: "initiated_at": "2023-08-01T19:55:05.150616+0000", 2023-08-01T19:56:35.002 INFO:teuthology.orchestra.run.smithi155.stdout: "age": 89.835521842000006, 2023-08-01T19:56:35.002 INFO:teuthology.orchestra.run.smithi155.stdout: "duration": 0.071105065999999995, 2023-08-01T19:56:35.002 INFO:teuthology.orchestra.run.smithi155.stdout: "type_data": { 2023-08-01T19:56:35.002 INFO:teuthology.orchestra.run.smithi155.stdout: "flag_point": "commit sent; apply or cleanup", 2023-08-01T19:56:35.002 INFO:teuthology.orchestra.run.smithi155.stdout: "client_info": { 2023-08-01T19:56:35.002 INFO:teuthology.orchestra.run.smithi155.stdout: "client": "client.4668", 2023-08-01T19:56:35.002 INFO:teuthology.orchestra.run.smithi155.stdout: "client_addr": "172.21.15.6:0/1709472247", 2023-08-01T19:56:35.002 INFO:teuthology.orchestra.run.smithi155.stdout: "tid": 100242 2023-08-01T19:56:35.003 INFO:teuthology.orchestra.run.smithi155.stdout: }, 2023-08-01T19:56:35.003 INFO:teuthology.orchestra.run.smithi155.stdout: "events": [ 2023-08-01T19:56:35.003 INFO:teuthology.orchestra.run.smithi155.stdout: { 2023-08-01T19:56:35.003 INFO:teuthology.orchestra.run.smithi155.stdout: "event": "initiated", 2023-08-01T19:56:35.003 INFO:teuthology.orchestra.run.smithi155.stdout: "time": "2023-08-01T19:55:05.150616+0000", 2023-08-01T19:56:35.003 INFO:teuthology.orchestra.run.smithi155.stdout: "duration": 0 2023-08-01T19:56:35.003 INFO:teuthology.orchestra.run.smithi155.stdout: }, 2023-08-01T19:56:35.004 INFO:teuthology.orchestra.run.smithi155.stdout: { 2023-08-01T19:56:35.004 INFO:teuthology.orchestra.run.smithi155.stdout: "event": "throttled", 2023-08-01T19:56:35.004 INFO:teuthology.orchestra.run.smithi155.stdout: "time": "2023-08-01T19:55:05.150616+0000", 2023-08-01T19:56:35.004 INFO:teuthology.orchestra.run.smithi155.stdout: "duration": 0 2023-08-01T19:56:35.004 INFO:teuthology.orchestra.run.smithi155.stdout: }, 2023-08-01T19:56:35.004 INFO:teuthology.orchestra.run.smithi155.stdout: { 2023-08-01T19:56:35.004 INFO:teuthology.orchestra.run.smithi155.stdout: "event": "header_read", 2023-08-01T19:56:35.005 INFO:teuthology.orchestra.run.smithi155.stdout: "time": "2023-08-01T19:55:05.150615+0000", 2023-08-01T19:56:35.005 INFO:teuthology.orchestra.run.smithi155.stdout: "duration": 4294967295.999999 2023-08-01T19:56:35.005 INFO:teuthology.orchestra.run.smithi155.stdout: }, 2023-08-01T19:56:35.005 INFO:teuthology.orchestra.run.smithi155.stdout: { 2023-08-01T19:56:35.005 INFO:teuthology.orchestra.run.smithi155.stdout: "event": "all_read", 2023-08-01T19:56:35.005 INFO:teuthology.orchestra.run.smithi155.stdout: "time": "2023-08-01T19:55:05.150696+0000", 2023-08-01T19:56:35.005 INFO:teuthology.orchestra.run.smithi155.stdout: "duration": 8.0852000000000004e-05 2023-08-01T19:56:35.006 INFO:teuthology.orchestra.run.smithi155.stdout: }, 2023-08-01T19:56:35.006 INFO:teuthology.orchestra.run.smithi155.stdout: { 2023-08-01T19:56:35.006 INFO:teuthology.orchestra.run.smithi155.stdout: "event": "dispatched", 2023-08-01T19:56:35.006 INFO:teuthology.orchestra.run.smithi155.stdout: "time": "2023-08-01T19:55:05.150708+0000", 2023-08-01T19:56:35.006 INFO:teuthology.orchestra.run.smithi155.stdout: "duration": 1.2116999999999999e-05 2023-08-01T19:56:35.006 INFO:teuthology.orchestra.run.smithi155.stdout: }, 2023-08-01T19:56:35.006 INFO:teuthology.orchestra.run.smithi155.stdout: { 2023-08-01T19:56:35.007 INFO:teuthology.orchestra.run.smithi155.stdout: "event": "queued_for_pg", 2023-08-01T19:56:35.007 INFO:teuthology.orchestra.run.smithi155.stdout: "time": "2023-08-01T19:55:05.150713+0000", 2023-08-01T19:56:35.007 INFO:teuthology.orchestra.run.smithi155.stdout: "duration": 5.4620000000000004e-06 2023-08-01T19:56:35.007 INFO:teuthology.orchestra.run.smithi155.stdout: }, 2023-08-01T19:56:35.007 INFO:teuthology.orchestra.run.smithi155.stdout: { 2023-08-01T19:56:35.007 INFO:teuthology.orchestra.run.smithi155.stdout: "event": "reached_pg", 2023-08-01T19:56:35.007 INFO:teuthology.orchestra.run.smithi155.stdout: "time": "2023-08-01T19:55:05.150761+0000", 2023-08-01T19:56:35.008 INFO:teuthology.orchestra.run.smithi155.stdout: "duration": 4.7429000000000003e-05 2023-08-01T19:56:35.008 INFO:teuthology.orchestra.run.smithi155.stdout: }, 2023-08-01T19:56:35.008 INFO:teuthology.orchestra.run.smithi155.stdout: { 2023-08-01T19:56:35.008 INFO:teuthology.orchestra.run.smithi155.stdout: "event": "started", 2023-08-01T19:56:35.008 INFO:teuthology.orchestra.run.smithi155.stdout: "time": "2023-08-01T19:55:05.150856+0000", 2023-08-01T19:56:35.008 INFO:teuthology.orchestra.run.smithi155.stdout: "duration": 9.5356e-05 2023-08-01T19:56:35.008 INFO:teuthology.orchestra.run.smithi155.stdout: }, 2023-08-01T19:56:35.009 INFO:teuthology.orchestra.run.smithi155.stdout: { 2023-08-01T19:56:35.009 INFO:teuthology.orchestra.run.smithi155.stdout: "event": "waiting for subops from 0", 2023-08-01T19:56:35.009 INFO:teuthology.orchestra.run.smithi155.stdout: "time": "2023-08-01T19:55:05.150999+0000", 2023-08-01T19:56:35.009 INFO:teuthology.orchestra.run.smithi155.stdout: "duration": 0.00014234499999999999 2023-08-01T19:56:35.009 INFO:teuthology.orchestra.run.smithi155.stdout: }, 2023-08-01T19:56:35.009 INFO:teuthology.orchestra.run.smithi155.stdout: { 2023-08-01T19:56:35.009 INFO:teuthology.orchestra.run.smithi155.stdout: "event": "sub_op_commit_rec", 2023-08-01T19:56:35.010 INFO:teuthology.orchestra.run.smithi155.stdout: "time": "2023-08-01T19:55:05.219001+0000", 2023-08-01T19:56:35.010 INFO:teuthology.orchestra.run.smithi155.stdout: "duration": 0.068002776000000001 2023-08-01T19:56:35.010 INFO:teuthology.orchestra.run.smithi155.stdout: }, 2023-08-01T19:56:35.010 INFO:teuthology.orchestra.run.smithi155.stdout: { 2023-08-01T19:56:35.010 INFO:teuthology.orchestra.run.smithi155.stdout: "event": "op_commit", 2023-08-01T19:56:35.010 INFO:teuthology.orchestra.run.smithi155.stdout: "time": "2023-08-01T19:55:05.221635+0000", 2023-08-01T19:56:35.010 INFO:teuthology.orchestra.run.smithi155.stdout: "duration": 0.0026340579999999999 2023-08-01T19:56:35.010 INFO:teuthology.orchestra.run.smithi155.stdout: }, 2023-08-01T19:56:35.011 INFO:teuthology.orchestra.run.smithi155.stdout: { 2023-08-01T19:56:35.011 INFO:teuthology.orchestra.run.smithi155.stdout: "event": "commit_sent", 2023-08-01T19:56:35.011 INFO:teuthology.orchestra.run.smithi155.stdout: "time": "2023-08-01T19:55:05.221682+0000", 2023-08-01T19:56:35.011 INFO:teuthology.orchestra.run.smithi155.stdout: "duration": 4.7123999999999998e-05 2023-08-01T19:56:35.011 INFO:teuthology.orchestra.run.smithi155.stdout: }, 2023-08-01T19:56:35.011 INFO:teuthology.orchestra.run.smithi155.stdout: { 2023-08-01T19:56:35.011 INFO:teuthology.orchestra.run.smithi155.stdout: "event": "done", 2023-08-01T19:56:35.012 INFO:teuthology.orchestra.run.smithi155.stdout: "time": "2023-08-01T19:55:05.221721+0000", 2023-08-01T19:56:35.012 INFO:teuthology.orchestra.run.smithi155.stdout: "duration": 3.8529999999999999e-05 2023-08-01T19:56:35.012 INFO:teuthology.orchestra.run.smithi155.stdout: } 2023-08-01T19:56:35.012 INFO:teuthology.orchestra.run.smithi155.stdout: ] 2023-08-01T19:56:35.012 INFO:teuthology.orchestra.run.smithi155.stdout: } 2023-08-01T19:56:35.012 INFO:teuthology.orchestra.run.smithi155.stdout: }, 2023-08-01T19:56:35.012 INFO:teuthology.orchestra.run.smithi155.stdout: { 2023-08-01T19:56:35.013 INFO:teuthology.orchestra.run.smithi155.stdout: "description": "osd_repop(client.4668.0:100240 5.a e37/19 5:5313c5b9:::benchmark_data_smithi006_114134_object100239:head v 37'6227, mlcod=37'6225)", 2023-08-01T19:56:35.013 INFO:teuthology.orchestra.run.smithi155.stdout: "initiated_at": "2023-08-01T19:55:05.150778+0000", 2023-08-01T19:56:35.013 INFO:teuthology.orchestra.run.smithi155.stdout: "age": 89.835359640999997, 2023-08-01T19:56:35.013 INFO:teuthology.orchestra.run.smithi155.stdout: "duration": 0.073362533999999993, 2023-08-01T19:56:35.013 INFO:teuthology.orchestra.run.smithi155.stdout: "type_data": { 2023-08-01T19:56:35.013 INFO:teuthology.orchestra.run.smithi155.stdout: "flag_point": "commit sent; apply or cleanup", 2023-08-01T19:56:35.013 INFO:teuthology.orchestra.run.smithi155.stdout: "events": [ 2023-08-01T19:56:35.013 INFO:teuthology.orchestra.run.smithi155.stdout: { 2023-08-01T19:56:35.014 INFO:teuthology.orchestra.run.smithi155.stdout: "event": "initiated", 2023-08-01T19:56:35.014 INFO:teuthology.orchestra.run.smithi155.stdout: "time": "2023-08-01T19:55:05.150778+0000", 2023-08-01T19:56:35.014 INFO:teuthology.orchestra.run.smithi155.stdout: "duration": 0 2023-08-01T19:56:35.014 INFO:teuthology.orchestra.run.smithi155.stdout: }, 2023-08-01T19:56:35.014 INFO:teuthology.orchestra.run.smithi155.stdout: { 2023-08-01T19:56:35.014 INFO:teuthology.orchestra.run.smithi155.stdout: "event": "throttled", 2023-08-01T19:56:35.014 INFO:teuthology.orchestra.run.smithi155.stdout: "time": "2023-08-01T19:55:05.150778+0000", 2023-08-01T19:56:35.014 INFO:teuthology.orchestra.run.smithi155.stdout: "duration": 0 2023-08-01T19:56:35.015 INFO:teuthology.orchestra.run.smithi155.stdout: }, 2023-08-01T19:56:35.015 INFO:teuthology.orchestra.run.smithi155.stdout: { 2023-08-01T19:56:35.015 INFO:teuthology.orchestra.run.smithi155.stdout: "event": "header_read", 2023-08-01T19:56:35.015 INFO:teuthology.orchestra.run.smithi155.stdout: "time": "2023-08-01T19:55:05.150778+0000", 2023-08-01T19:56:35.015 INFO:teuthology.orchestra.run.smithi155.stdout: "duration": 4294967295.9999995 2023-08-01T19:56:35.015 INFO:teuthology.orchestra.run.smithi155.stdout: }, 2023-08-01T19:56:35.015 INFO:teuthology.orchestra.run.smithi155.stdout: { 2023-08-01T19:56:35.015 INFO:teuthology.orchestra.run.smithi155.stdout: "event": "all_read", 2023-08-01T19:56:35.016 INFO:teuthology.orchestra.run.smithi155.stdout: "time": "2023-08-01T19:55:05.150811+0000", 2023-08-01T19:56:35.016 INFO:teuthology.orchestra.run.smithi155.stdout: "duration": 3.3664000000000002e-05 2023-08-01T19:56:35.016 INFO:teuthology.orchestra.run.smithi155.stdout: }, 2023-08-01T19:56:35.016 INFO:teuthology.orchestra.run.smithi155.stdout: { 2023-08-01T19:56:35.016 INFO:teuthology.orchestra.run.smithi155.stdout: "event": "dispatched", 2023-08-01T19:56:35.016 INFO:teuthology.orchestra.run.smithi155.stdout: "time": "2023-08-01T19:55:05.150818+0000", 2023-08-01T19:56:35.016 INFO:teuthology.orchestra.run.smithi155.stdout: "duration": 6.5769999999999999e-06 2023-08-01T19:56:35.017 INFO:teuthology.orchestra.run.smithi155.stdout: }, 2023-08-01T19:56:35.017 INFO:teuthology.orchestra.run.smithi155.stdout: { 2023-08-01T19:56:35.017 INFO:teuthology.orchestra.run.smithi155.stdout: "event": "queued_for_pg", 2023-08-01T19:56:35.017 INFO:teuthology.orchestra.run.smithi155.stdout: "time": "2023-08-01T19:55:05.150822+0000", 2023-08-01T19:56:35.017 INFO:teuthology.orchestra.run.smithi155.stdout: "duration": 4.0060000000000003e-06 2023-08-01T19:56:35.017 INFO:teuthology.orchestra.run.smithi155.stdout: }, 2023-08-01T19:56:35.017 INFO:teuthology.orchestra.run.smithi155.stdout: { 2023-08-01T19:56:35.017 INFO:teuthology.orchestra.run.smithi155.stdout: "event": "reached_pg", 2023-08-01T19:56:35.018 INFO:teuthology.orchestra.run.smithi155.stdout: "time": "2023-08-01T19:55:05.150855+0000", 2023-08-01T19:56:35.018 INFO:teuthology.orchestra.run.smithi155.stdout: "duration": 3.3204999999999998e-05 2023-08-01T19:56:35.018 INFO:teuthology.orchestra.run.smithi155.stdout: }, 2023-08-01T19:56:35.018 INFO:teuthology.orchestra.run.smithi155.stdout: { 2023-08-01T19:56:35.018 INFO:teuthology.orchestra.run.smithi155.stdout: "event": "started", 2023-08-01T19:56:35.018 INFO:teuthology.orchestra.run.smithi155.stdout: "time": "2023-08-01T19:55:05.150873+0000", 2023-08-01T19:56:35.018 INFO:teuthology.orchestra.run.smithi155.stdout: "duration": 1.8139999999999999e-05 2023-08-01T19:56:35.018 INFO:teuthology.orchestra.run.smithi155.stdout: }, 2023-08-01T19:56:35.019 INFO:teuthology.orchestra.run.smithi155.stdout: { 2023-08-01T19:56:35.019 INFO:teuthology.orchestra.run.smithi155.stdout: "event": "commit_sent", 2023-08-01T19:56:35.019 INFO:teuthology.orchestra.run.smithi155.stdout: "time": "2023-08-01T19:55:05.224095+0000", 2023-08-01T19:56:35.019 INFO:teuthology.orchestra.run.smithi155.stdout: "duration": 0.073221895999999995 2023-08-01T19:56:35.019 INFO:teuthology.orchestra.run.smithi155.stdout: }, 2023-08-01T19:56:35.019 INFO:teuthology.orchestra.run.smithi155.stdout: { 2023-08-01T19:56:35.019 INFO:teuthology.orchestra.run.smithi155.stdout: "event": "done", 2023-08-01T19:56:35.019 INFO:teuthology.orchestra.run.smithi155.stdout: "time": "2023-08-01T19:55:05.224141+0000", 2023-08-01T19:56:35.020 INFO:teuthology.orchestra.run.smithi155.stdout: "duration": 4.5385e-05 2023-08-01T19:56:35.020 INFO:teuthology.orchestra.run.smithi155.stdout: } 2023-08-01T19:56:35.020 INFO:teuthology.orchestra.run.smithi155.stdout: ] 2023-08-01T19:56:35.020 INFO:teuthology.orchestra.run.smithi155.stdout: } 2023-08-01T19:56:35.020 INFO:teuthology.orchestra.run.smithi155.stdout: }, 2023-08-01T19:56:35.020 INFO:teuthology.orchestra.run.smithi155.stdout: { 2023-08-01T19:56:35.021 INFO:teuthology.orchestra.run.smithi155.stdout: "description": "osd_op(client.4668.0:100245 5.e 5:71869c66:::benchmark_data_smithi006_114134_object100244:head [set-alloc-hint object_size 65536 write_size 65536,write 0~65536] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e37)", 2023-08-01T19:56:35.021 INFO:teuthology.orchestra.run.smithi155.stdout: "initiated_at": "2023-08-01T19:55:05.150991+0000", 2023-08-01T19:56:35.021 INFO:teuthology.orchestra.run.smithi155.stdout: "age": 89.835146854000001, 2023-08-01T19:56:35.021 INFO:teuthology.orchestra.run.smithi155.stdout: "duration": 0.070734490999999997, 2023-08-01T19:56:35.021 INFO:teuthology.orchestra.run.smithi155.stdout: "type_data": { 2023-08-01T19:56:35.021 INFO:teuthology.orchestra.run.smithi155.stdout: "flag_point": "commit sent; apply or cleanup", 2023-08-01T19:56:35.021 INFO:teuthology.orchestra.run.smithi155.stdout: "client_info": { 2023-08-01T19:56:35.022 INFO:teuthology.orchestra.run.smithi155.stdout: "client": "client.4668", 2023-08-01T19:56:35.022 INFO:teuthology.orchestra.run.smithi155.stdout: "client_addr": "172.21.15.6:0/1709472247", 2023-08-01T19:56:35.022 INFO:teuthology.orchestra.run.smithi155.stdout: "tid": 100245 2023-08-01T19:56:35.022 INFO:teuthology.orchestra.run.smithi155.stdout: }, 2023-08-01T19:56:35.022 INFO:teuthology.orchestra.run.smithi155.stdout: "events": [ 2023-08-01T19:56:35.022 INFO:teuthology.orchestra.run.smithi155.stdout: { 2023-08-01T19:56:35.022 INFO:teuthology.orchestra.run.smithi155.stdout: "event": "initiated", 2023-08-01T19:56:35.022 INFO:teuthology.orchestra.run.smithi155.stdout: "time": "2023-08-01T19:55:05.150991+0000", 2023-08-01T19:56:35.023 INFO:teuthology.orchestra.run.smithi155.stdout: "duration": 0 2023-08-01T19:56:35.023 INFO:teuthology.orchestra.run.smithi155.stdout: }, 2023-08-01T19:56:35.023 INFO:teuthology.orchestra.run.smithi155.stdout: { 2023-08-01T19:56:35.023 INFO:teuthology.orchestra.run.smithi155.stdout: "event": "throttled", 2023-08-01T19:56:35.023 INFO:teuthology.orchestra.run.smithi155.stdout: "time": "2023-08-01T19:55:05.150991+0000", 2023-08-01T19:56:35.023 INFO:teuthology.orchestra.run.smithi155.stdout: "duration": 0 2023-08-01T19:56:35.023 INFO:teuthology.orchestra.run.smithi155.stdout: }, 2023-08-01T19:56:35.024 INFO:teuthology.orchestra.run.smithi155.stdout: { 2023-08-01T19:56:35.024 INFO:teuthology.orchestra.run.smithi155.stdout: "event": "header_read", 2023-08-01T19:56:35.024 INFO:teuthology.orchestra.run.smithi155.stdout: "time": "2023-08-01T19:55:05.150990+0000", 2023-08-01T19:56:35.024 INFO:teuthology.orchestra.run.smithi155.stdout: "duration": 4294967295.999999 2023-08-01T19:56:35.024 INFO:teuthology.orchestra.run.smithi155.stdout: }, 2023-08-01T19:56:35.024 INFO:teuthology.orchestra.run.smithi155.stdout: { 2023-08-01T19:56:35.024 INFO:teuthology.orchestra.run.smithi155.stdout: "event": "all_read", 2023-08-01T19:56:35.024 INFO:teuthology.orchestra.run.smithi155.stdout: "time": "2023-08-01T19:55:05.151108+0000", 2023-08-01T19:56:35.025 INFO:teuthology.orchestra.run.smithi155.stdout: "duration": 0.00011849300000000001 2023-08-01T19:56:35.025 INFO:teuthology.orchestra.run.smithi155.stdout: }, 2023-08-01T19:56:35.025 INFO:teuthology.orchestra.run.smithi155.stdout: { 2023-08-01T19:56:35.025 INFO:teuthology.orchestra.run.smithi155.stdout: "event": "dispatched", 2023-08-01T19:56:35.025 INFO:teuthology.orchestra.run.smithi155.stdout: "time": "2023-08-01T19:55:05.151117+0000", 2023-08-01T19:56:35.025 INFO:teuthology.orchestra.run.smithi155.stdout: "duration": 8.1040000000000007e-06 2023-08-01T19:56:35.025 INFO:teuthology.orchestra.run.smithi155.stdout: }, 2023-08-01T19:56:35.025 INFO:teuthology.orchestra.run.smithi155.stdout: { 2023-08-01T19:56:35.026 INFO:teuthology.orchestra.run.smithi155.stdout: "event": "queued_for_pg", 2023-08-01T19:56:35.026 INFO:teuthology.orchestra.run.smithi155.stdout: "time": "2023-08-01T19:55:05.151121+0000", 2023-08-01T19:56:35.026 INFO:teuthology.orchestra.run.smithi155.stdout: "duration": 4.2019999999999997e-06 2023-08-01T19:56:35.026 INFO:teuthology.orchestra.run.smithi155.stdout: }, 2023-08-01T19:56:35.026 INFO:teuthology.orchestra.run.smithi155.stdout: { 2023-08-01T19:56:35.026 INFO:teuthology.orchestra.run.smithi155.stdout: "event": "reached_pg", 2023-08-01T19:56:35.026 INFO:teuthology.orchestra.run.smithi155.stdout: "time": "2023-08-01T19:55:05.151162+0000", 2023-08-01T19:56:35.026 INFO:teuthology.orchestra.run.smithi155.stdout: "duration": 4.1448e-05 2023-08-01T19:56:35.027 INFO:teuthology.orchestra.run.smithi155.stdout: }, 2023-08-01T19:56:35.027 INFO:teuthology.orchestra.run.smithi155.stdout: { 2023-08-01T19:56:35.027 INFO:teuthology.orchestra.run.smithi155.stdout: "event": "started", 2023-08-01T19:56:35.027 INFO:teuthology.orchestra.run.smithi155.stdout: "time": "2023-08-01T19:55:05.151281+0000", 2023-08-01T19:56:35.027 INFO:teuthology.orchestra.run.smithi155.stdout: "duration": 0.000119141 2023-08-01T19:56:35.027 INFO:teuthology.orchestra.run.smithi155.stdout: }, 2023-08-01T19:56:35.027 INFO:teuthology.orchestra.run.smithi155.stdout: { 2023-08-01T19:56:35.027 INFO:teuthology.orchestra.run.smithi155.stdout: "event": "waiting for subops from 0", 2023-08-01T19:56:35.028 INFO:teuthology.orchestra.run.smithi155.stdout: "time": "2023-08-01T19:55:05.151443+0000", 2023-08-01T19:56:35.028 INFO:teuthology.orchestra.run.smithi155.stdout: "duration": 0.00016181600000000001 2023-08-01T19:56:35.028 INFO:teuthology.orchestra.run.smithi155.stdout: }, 2023-08-01T19:56:35.028 INFO:teuthology.orchestra.run.smithi155.stdout: { 2023-08-01T19:56:35.028 INFO:teuthology.orchestra.run.smithi155.stdout: "event": "sub_op_commit_rec", 2023-08-01T19:56:35.028 INFO:teuthology.orchestra.run.smithi155.stdout: "time": "2023-08-01T19:55:05.219101+0000", 2023-08-01T19:56:35.028 INFO:teuthology.orchestra.run.smithi155.stdout: "duration": 0.067658037000000004 2023-08-01T19:56:35.029 INFO:teuthology.orchestra.run.smithi155.stdout: }, 2023-08-01T19:56:35.029 INFO:teuthology.orchestra.run.smithi155.stdout: { 2023-08-01T19:56:35.029 INFO:teuthology.orchestra.run.smithi155.stdout: "event": "op_commit", 2023-08-01T19:56:35.029 INFO:teuthology.orchestra.run.smithi155.stdout: "time": "2023-08-01T19:55:05.221646+0000", 2023-08-01T19:56:35.029 INFO:teuthology.orchestra.run.smithi155.stdout: "duration": 0.0025450540000000002 2023-08-01T19:56:35.029 INFO:teuthology.orchestra.run.smithi155.stdout: }, 2023-08-01T19:56:35.029 INFO:teuthology.orchestra.run.smithi155.stdout: { 2023-08-01T19:56:35.029 INFO:teuthology.orchestra.run.smithi155.stdout: "event": "commit_sent", 2023-08-01T19:56:35.030 INFO:teuthology.orchestra.run.smithi155.stdout: "time": "2023-08-01T19:55:05.221689+0000", 2023-08-01T19:56:35.030 INFO:teuthology.orchestra.run.smithi155.stdout: "duration": 4.3078999999999999e-05 2023-08-01T19:56:35.030 INFO:teuthology.orchestra.run.smithi155.stdout: }, 2023-08-01T19:56:35.030 INFO:teuthology.orchestra.run.smithi155.stdout: { 2023-08-01T19:56:35.030 INFO:teuthology.orchestra.run.smithi155.stdout: "event": "done", 2023-08-01T19:56:35.030 INFO:teuthology.orchestra.run.smithi155.stdout: "time": "2023-08-01T19:55:05.221725+0000", 2023-08-01T19:56:35.030 INFO:teuthology.orchestra.run.smithi155.stdout: "duration": 3.6137999999999999e-05 2023-08-01T19:56:35.030 INFO:teuthology.orchestra.run.smithi155.stdout: } 2023-08-01T19:56:35.031 INFO:teuthology.orchestra.run.smithi155.stdout: ] 2023-08-01T19:56:35.031 INFO:teuthology.orchestra.run.smithi155.stdout: } 2023-08-01T19:56:35.031 INFO:teuthology.orchestra.run.smithi155.stdout: }, 2023-08-01T19:56:35.031 INFO:teuthology.orchestra.run.smithi155.stdout: { 2023-08-01T19:56:35.031 INFO:teuthology.orchestra.run.smithi155.stdout: "description": "osd_repop(client.4668.0:100243 5.a e37/19 5:5e8193b6:::benchmark_data_smithi006_114134_object100242:head v 37'6228, mlcod=37'6225)", 2023-08-01T19:56:35.031 INFO:teuthology.orchestra.run.smithi155.stdout: "initiated_at": "2023-08-01T19:55:05.151148+0000", 2023-08-01T19:56:35.031 INFO:teuthology.orchestra.run.smithi155.stdout: "age": 89.834989843000002, 2023-08-01T19:56:35.031 INFO:teuthology.orchestra.run.smithi155.stdout: "duration": 0.073020370000000001, 2023-08-01T19:56:35.032 INFO:teuthology.orchestra.run.smithi155.stdout: "type_data": { 2023-08-01T19:56:35.032 INFO:teuthology.orchestra.run.smithi155.stdout: "flag_point": "commit sent; apply or cleanup", 2023-08-01T19:56:35.032 INFO:teuthology.orchestra.run.smithi155.stdout: "events": [ 2023-08-01T19:56:35.032 INFO:teuthology.orchestra.run.smithi155.stdout: { 2023-08-01T19:56:35.032 INFO:teuthology.orchestra.run.smithi155.stdout: "event": "initiated", 2023-08-01T19:56:35.032 INFO:teuthology.orchestra.run.smithi155.stdout: "time": "2023-08-01T19:55:05.151148+0000", 2023-08-01T19:56:35.032 INFO:teuthology.orchestra.run.smithi155.stdout: "duration": 0 2023-08-01T19:56:35.032 INFO:teuthology.orchestra.run.smithi155.stdout: }, 2023-08-01T19:56:35.033 INFO:teuthology.orchestra.run.smithi155.stdout: { 2023-08-01T19:56:35.033 INFO:teuthology.orchestra.run.smithi155.stdout: "event": "throttled", 2023-08-01T19:56:35.033 INFO:teuthology.orchestra.run.smithi155.stdout: "time": "2023-08-01T19:55:05.151148+0000", 2023-08-01T19:56:35.033 INFO:teuthology.orchestra.run.smithi155.stdout: "duration": 0 2023-08-01T19:56:35.033 INFO:teuthology.orchestra.run.smithi155.stdout: }, 2023-08-01T19:56:35.033 INFO:teuthology.orchestra.run.smithi155.stdout: { 2023-08-01T19:56:35.033 INFO:teuthology.orchestra.run.smithi155.stdout: "event": "header_read", 2023-08-01T19:56:35.034 INFO:teuthology.orchestra.run.smithi155.stdout: "time": "2023-08-01T19:55:05.151147+0000", 2023-08-01T19:56:35.034 INFO:teuthology.orchestra.run.smithi155.stdout: "duration": 4294967295.9999995 2023-08-01T19:56:35.034 INFO:teuthology.orchestra.run.smithi155.stdout: }, 2023-08-01T19:56:35.034 INFO:teuthology.orchestra.run.smithi155.stdout: { 2023-08-01T19:56:35.034 INFO:teuthology.orchestra.run.smithi155.stdout: "event": "all_read", 2023-08-01T19:56:35.035 INFO:teuthology.orchestra.run.smithi155.stdout: "time": "2023-08-01T19:55:05.151231+0000", 2023-08-01T19:56:35.035 INFO:teuthology.orchestra.run.smithi155.stdout: "duration": 8.3135999999999998e-05 2023-08-01T19:56:35.035 INFO:teuthology.orchestra.run.smithi155.stdout: }, 2023-08-01T19:56:35.035 INFO:teuthology.orchestra.run.smithi155.stdout: { 2023-08-01T19:56:35.035 INFO:teuthology.orchestra.run.smithi155.stdout: "event": "dispatched", 2023-08-01T19:56:35.035 INFO:teuthology.orchestra.run.smithi155.stdout: "time": "2023-08-01T19:55:05.151239+0000", 2023-08-01T19:56:35.035 INFO:teuthology.orchestra.run.smithi155.stdout: "duration": 8.7469999999999994e-06 2023-08-01T19:56:35.036 INFO:teuthology.orchestra.run.smithi155.stdout: }, 2023-08-01T19:56:35.036 INFO:teuthology.orchestra.run.smithi155.stdout: { 2023-08-01T19:56:35.036 INFO:teuthology.orchestra.run.smithi155.stdout: "event": "queued_for_pg", 2023-08-01T19:56:35.036 INFO:teuthology.orchestra.run.smithi155.stdout: "time": "2023-08-01T19:55:05.151244+0000", 2023-08-01T19:56:35.036 INFO:teuthology.orchestra.run.smithi155.stdout: "duration": 4.4800000000000003e-06 2023-08-01T19:56:35.036 INFO:teuthology.orchestra.run.smithi155.stdout: }, 2023-08-01T19:56:35.036 INFO:teuthology.orchestra.run.smithi155.stdout: { 2023-08-01T19:56:35.037 INFO:teuthology.orchestra.run.smithi155.stdout: "event": "reached_pg", 2023-08-01T19:56:35.037 INFO:teuthology.orchestra.run.smithi155.stdout: "time": "2023-08-01T19:55:05.152938+0000", 2023-08-01T19:56:35.037 INFO:teuthology.orchestra.run.smithi155.stdout: "duration": 0.001693824 2023-08-01T19:56:35.037 INFO:teuthology.orchestra.run.smithi155.stdout: }, 2023-08-01T19:56:35.037 INFO:teuthology.orchestra.run.smithi155.stdout: { 2023-08-01T19:56:35.037 INFO:teuthology.orchestra.run.smithi155.stdout: "event": "started", 2023-08-01T19:56:35.037 INFO:teuthology.orchestra.run.smithi155.stdout: "time": "2023-08-01T19:55:05.152956+0000", 2023-08-01T19:56:35.038 INFO:teuthology.orchestra.run.smithi155.stdout: "duration": 1.8287e-05 2023-08-01T19:56:35.038 INFO:teuthology.orchestra.run.smithi155.stdout: }, 2023-08-01T19:56:35.038 INFO:teuthology.orchestra.run.smithi155.stdout: { 2023-08-01T19:56:35.038 INFO:teuthology.orchestra.run.smithi155.stdout: "event": "commit_sent", 2023-08-01T19:56:35.038 INFO:teuthology.orchestra.run.smithi155.stdout: "time": "2023-08-01T19:55:05.224145+0000", 2023-08-01T19:56:35.038 INFO:teuthology.orchestra.run.smithi155.stdout: "duration": 0.071189447000000003 2023-08-01T19:56:35.038 INFO:teuthology.orchestra.run.smithi155.stdout: }, 2023-08-01T19:56:35.039 INFO:teuthology.orchestra.run.smithi155.stdout: { 2023-08-01T19:56:35.039 INFO:teuthology.orchestra.run.smithi155.stdout: "event": "done", 2023-08-01T19:56:35.039 INFO:teuthology.orchestra.run.smithi155.stdout: "time": "2023-08-01T19:55:05.224168+0000", 2023-08-01T19:56:35.039 INFO:teuthology.orchestra.run.smithi155.stdout: "duration": 2.3008999999999999e-05 2023-08-01T19:56:35.039 INFO:teuthology.orchestra.run.smithi155.stdout: } 2023-08-01T19:56:35.039 INFO:teuthology.orchestra.run.smithi155.stdout: ] 2023-08-01T19:56:35.039 INFO:teuthology.orchestra.run.smithi155.stdout: } 2023-08-01T19:56:35.039 INFO:teuthology.orchestra.run.smithi155.stdout: }, 2023-08-01T19:56:35.040 INFO:teuthology.orchestra.run.smithi155.stdout: { 2023-08-01T19:56:35.040 INFO:teuthology.orchestra.run.smithi155.stdout: "description": "osd_repop(client.4668.0:100244 5.9 e37/19 5:92f56a12:::benchmark_data_smithi006_114134_object100243:head v 37'6294, mlcod=37'6292)", 2023-08-01T19:56:35.040 INFO:teuthology.orchestra.run.smithi155.stdout: "initiated_at": "2023-08-01T19:55:05.151325+0000", 2023-08-01T19:56:35.040 INFO:teuthology.orchestra.run.smithi155.stdout: "age": 89.834812498000005, 2023-08-01T19:56:35.040 INFO:teuthology.orchestra.run.smithi155.stdout: "duration": 0.071883673999999995, 2023-08-01T19:56:35.040 INFO:teuthology.orchestra.run.smithi155.stdout: "type_data": { 2023-08-01T19:56:35.040 INFO:teuthology.orchestra.run.smithi155.stdout: "flag_point": "commit sent; apply or cleanup", 2023-08-01T19:56:35.040 INFO:teuthology.orchestra.run.smithi155.stdout: "events": [ 2023-08-01T19:56:35.041 INFO:teuthology.orchestra.run.smithi155.stdout: { 2023-08-01T19:56:35.041 INFO:teuthology.orchestra.run.smithi155.stdout: "event": "initiated", 2023-08-01T19:56:35.041 INFO:teuthology.orchestra.run.smithi155.stdout: "time": "2023-08-01T19:55:05.151325+0000", 2023-08-01T19:56:35.041 INFO:teuthology.orchestra.run.smithi155.stdout: "duration": 0 2023-08-01T19:56:35.041 INFO:teuthology.orchestra.run.smithi155.stdout: }, 2023-08-01T19:56:35.041 INFO:teuthology.orchestra.run.smithi155.stdout: { 2023-08-01T19:56:35.041 INFO:teuthology.orchestra.run.smithi155.stdout: "event": "throttled", 2023-08-01T19:56:35.042 INFO:teuthology.orchestra.run.smithi155.stdout: "time": "2023-08-01T19:55:05.151325+0000", 2023-08-01T19:56:35.042 INFO:teuthology.orchestra.run.smithi155.stdout: "duration": 0 2023-08-01T19:56:35.042 INFO:teuthology.orchestra.run.smithi155.stdout: }, 2023-08-01T19:56:35.042 INFO:teuthology.orchestra.run.smithi155.stdout: { 2023-08-01T19:56:35.042 INFO:teuthology.orchestra.run.smithi155.stdout: "event": "header_read", 2023-08-01T19:56:35.042 INFO:teuthology.orchestra.run.smithi155.stdout: "time": "2023-08-01T19:55:05.151325+0000", 2023-08-01T19:56:35.042 INFO:teuthology.orchestra.run.smithi155.stdout: "duration": 4294967295.9999995 2023-08-01T19:56:35.042 INFO:teuthology.orchestra.run.smithi155.stdout: }, 2023-08-01T19:56:35.043 INFO:teuthology.orchestra.run.smithi155.stdout: { 2023-08-01T19:56:35.043 INFO:teuthology.orchestra.run.smithi155.stdout: "event": "all_read", 2023-08-01T19:56:35.043 INFO:teuthology.orchestra.run.smithi155.stdout: "time": "2023-08-01T19:55:05.151390+0000", 2023-08-01T19:56:35.043 INFO:teuthology.orchestra.run.smithi155.stdout: "duration": 6.5456999999999993e-05 2023-08-01T19:56:35.043 INFO:teuthology.orchestra.run.smithi155.stdout: }, 2023-08-01T19:56:35.043 INFO:teuthology.orchestra.run.smithi155.stdout: { 2023-08-01T19:56:35.043 INFO:teuthology.orchestra.run.smithi155.stdout: "event": "dispatched", 2023-08-01T19:56:35.043 INFO:teuthology.orchestra.run.smithi155.stdout: "time": "2023-08-01T19:55:05.151396+0000", 2023-08-01T19:56:35.044 INFO:teuthology.orchestra.run.smithi155.stdout: "duration": 5.9190000000000004e-06 2023-08-01T19:56:35.044 INFO:teuthology.orchestra.run.smithi155.stdout: }, 2023-08-01T19:56:35.044 INFO:teuthology.orchestra.run.smithi155.stdout: { 2023-08-01T19:56:35.044 INFO:teuthology.orchestra.run.smithi155.stdout: "event": "queued_for_pg", 2023-08-01T19:56:35.044 INFO:teuthology.orchestra.run.smithi155.stdout: "time": "2023-08-01T19:55:05.151400+0000", 2023-08-01T19:56:35.044 INFO:teuthology.orchestra.run.smithi155.stdout: "duration": 4.1030000000000004e-06 2023-08-01T19:56:35.044 INFO:teuthology.orchestra.run.smithi155.stdout: }, 2023-08-01T19:56:35.044 INFO:teuthology.orchestra.run.smithi155.stdout: { 2023-08-01T19:56:35.045 INFO:teuthology.orchestra.run.smithi155.stdout: "event": "reached_pg", 2023-08-01T19:56:35.045 INFO:teuthology.orchestra.run.smithi155.stdout: "time": "2023-08-01T19:55:05.151452+0000", 2023-08-01T19:56:35.045 INFO:teuthology.orchestra.run.smithi155.stdout: "duration": 5.2136999999999999e-05 2023-08-01T19:56:35.045 INFO:teuthology.orchestra.run.smithi155.stdout: }, 2023-08-01T19:56:35.045 INFO:teuthology.orchestra.run.smithi155.stdout: { 2023-08-01T19:56:35.045 INFO:teuthology.orchestra.run.smithi155.stdout: "event": "started", 2023-08-01T19:56:35.045 INFO:teuthology.orchestra.run.smithi155.stdout: "time": "2023-08-01T19:55:05.151470+0000", 2023-08-01T19:56:35.045 INFO:teuthology.orchestra.run.smithi155.stdout: "duration": 1.8e-05 2023-08-01T19:56:35.046 INFO:teuthology.orchestra.run.smithi155.stdout: }, 2023-08-01T19:56:35.046 INFO:teuthology.orchestra.run.smithi155.stdout: { 2023-08-01T19:56:35.046 INFO:teuthology.orchestra.run.smithi155.stdout: "event": "commit_sent", 2023-08-01T19:56:35.046 INFO:teuthology.orchestra.run.smithi155.stdout: "time": "2023-08-01T19:55:05.223183+0000", 2023-08-01T19:56:35.046 INFO:teuthology.orchestra.run.smithi155.stdout: "duration": 0.071712622000000004 2023-08-01T19:56:35.046 INFO:teuthology.orchestra.run.smithi155.stdout: }, 2023-08-01T19:56:35.046 INFO:teuthology.orchestra.run.smithi155.stdout: { 2023-08-01T19:56:35.046 INFO:teuthology.orchestra.run.smithi155.stdout: "event": "done", 2023-08-01T19:56:35.047 INFO:teuthology.orchestra.run.smithi155.stdout: "time": "2023-08-01T19:55:05.223209+0000", 2023-08-01T19:56:35.047 INFO:teuthology.orchestra.run.smithi155.stdout: "duration": 2.5956e-05 2023-08-01T19:56:35.047 INFO:teuthology.orchestra.run.smithi155.stdout: } 2023-08-01T19:56:35.047 INFO:teuthology.orchestra.run.smithi155.stdout: ] 2023-08-01T19:56:35.047 INFO:teuthology.orchestra.run.smithi155.stdout: } 2023-08-01T19:56:35.047 INFO:teuthology.orchestra.run.smithi155.stdout: }, 2023-08-01T19:56:35.047 INFO:teuthology.orchestra.run.smithi155.stdout: { 2023-08-01T19:56:35.047 INFO:teuthology.orchestra.run.smithi155.stdout: "description": "osd_op(client.4668.0:100249 5.b 5:d0666827:::benchmark_data_smithi006_114134_object100248:head [set-alloc-hint object_size 65536 write_size 65536,write 0~65536] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e37)", 2023-08-01T19:56:35.048 INFO:teuthology.orchestra.run.smithi155.stdout: "initiated_at": "2023-08-01T19:55:05.153614+0000", 2023-08-01T19:56:35.048 INFO:teuthology.orchestra.run.smithi155.stdout: "age": 89.832524073000002, 2023-08-01T19:56:35.048 INFO:teuthology.orchestra.run.smithi155.stdout: "duration": 0.069286118999999993, 2023-08-01T19:56:35.048 INFO:teuthology.orchestra.run.smithi155.stdout: "type_data": { 2023-08-01T19:56:35.048 INFO:teuthology.orchestra.run.smithi155.stdout: "flag_point": "commit sent; apply or cleanup", 2023-08-01T19:56:35.048 INFO:teuthology.orchestra.run.smithi155.stdout: "client_info": { 2023-08-01T19:56:35.048 INFO:teuthology.orchestra.run.smithi155.stdout: "client": "client.4668", 2023-08-01T19:56:35.049 INFO:teuthology.orchestra.run.smithi155.stdout: "client_addr": "172.21.15.6:0/1709472247", 2023-08-01T19:56:35.049 INFO:teuthology.orchestra.run.smithi155.stdout: "tid": 100249 2023-08-01T19:56:35.049 INFO:teuthology.orchestra.run.smithi155.stdout: }, 2023-08-01T19:56:35.049 INFO:teuthology.orchestra.run.smithi155.stdout: "events": [ 2023-08-01T19:56:35.049 INFO:teuthology.orchestra.run.smithi155.stdout: { 2023-08-01T19:56:35.049 INFO:teuthology.orchestra.run.smithi155.stdout: "event": "initiated", 2023-08-01T19:56:35.049 INFO:teuthology.orchestra.run.smithi155.stdout: "time": "2023-08-01T19:55:05.153614+0000", 2023-08-01T19:56:35.049 INFO:teuthology.orchestra.run.smithi155.stdout: "duration": 0 2023-08-01T19:56:35.050 INFO:teuthology.orchestra.run.smithi155.stdout: }, 2023-08-01T19:56:35.050 INFO:teuthology.orchestra.run.smithi155.stdout: { 2023-08-01T19:56:35.050 INFO:teuthology.orchestra.run.smithi155.stdout: "event": "throttled", 2023-08-01T19:56:35.050 INFO:teuthology.orchestra.run.smithi155.stdout: "time": "2023-08-01T19:55:05.153614+0000", 2023-08-01T19:56:35.050 INFO:teuthology.orchestra.run.smithi155.stdout: "duration": 0 2023-08-01T19:56:35.050 INFO:teuthology.orchestra.run.smithi155.stdout: }, 2023-08-01T19:56:35.050 INFO:teuthology.orchestra.run.smithi155.stdout: { 2023-08-01T19:56:35.050 INFO:teuthology.orchestra.run.smithi155.stdout: "event": "header_read", 2023-08-01T19:56:35.051 INFO:teuthology.orchestra.run.smithi155.stdout: "time": "2023-08-01T19:55:05.153612+0000", 2023-08-01T19:56:35.051 INFO:teuthology.orchestra.run.smithi155.stdout: "duration": 4294967295.9999986 2023-08-01T19:56:35.051 INFO:teuthology.orchestra.run.smithi155.stdout: }, 2023-08-01T19:56:35.051 INFO:teuthology.orchestra.run.smithi155.stdout: { 2023-08-01T19:56:35.051 INFO:teuthology.orchestra.run.smithi155.stdout: "event": "all_read", 2023-08-01T19:56:35.051 INFO:teuthology.orchestra.run.smithi155.stdout: "time": "2023-08-01T19:55:05.153694+0000", 2023-08-01T19:56:35.051 INFO:teuthology.orchestra.run.smithi155.stdout: "duration": 8.1618000000000004e-05 2023-08-01T19:56:35.051 INFO:teuthology.orchestra.run.smithi155.stdout: }, 2023-08-01T19:56:35.052 INFO:teuthology.orchestra.run.smithi155.stdout: { 2023-08-01T19:56:35.052 INFO:teuthology.orchestra.run.smithi155.stdout: "event": "dispatched", 2023-08-01T19:56:35.052 INFO:teuthology.orchestra.run.smithi155.stdout: "time": "2023-08-01T19:55:05.153713+0000", 2023-08-01T19:56:35.052 INFO:teuthology.orchestra.run.smithi155.stdout: "duration": 1.9069999999999999e-05 2023-08-01T19:56:35.052 INFO:teuthology.orchestra.run.smithi155.stdout: }, 2023-08-01T19:56:35.052 INFO:teuthology.orchestra.run.smithi155.stdout: { 2023-08-01T19:56:35.052 INFO:teuthology.orchestra.run.smithi155.stdout: "event": "queued_for_pg", 2023-08-01T19:56:35.052 INFO:teuthology.orchestra.run.smithi155.stdout: "time": "2023-08-01T19:55:05.153726+0000", 2023-08-01T19:56:35.053 INFO:teuthology.orchestra.run.smithi155.stdout: "duration": 1.238e-05 2023-08-01T19:56:35.053 INFO:teuthology.orchestra.run.smithi155.stdout: }, 2023-08-01T19:56:35.053 INFO:teuthology.orchestra.run.smithi155.stdout: { 2023-08-01T19:56:35.053 INFO:teuthology.orchestra.run.smithi155.stdout: "event": "reached_pg", 2023-08-01T19:56:35.053 INFO:teuthology.orchestra.run.smithi155.stdout: "time": "2023-08-01T19:55:05.153761+0000", 2023-08-01T19:56:35.053 INFO:teuthology.orchestra.run.smithi155.stdout: "duration": 3.5046999999999998e-05 2023-08-01T19:56:35.054 INFO:teuthology.orchestra.run.smithi155.stdout: }, 2023-08-01T19:56:35.054 INFO:teuthology.orchestra.run.smithi155.stdout: { 2023-08-01T19:56:35.054 INFO:teuthology.orchestra.run.smithi155.stdout: "event": "started", 2023-08-01T19:56:35.054 INFO:teuthology.orchestra.run.smithi155.stdout: "time": "2023-08-01T19:55:05.153896+0000", 2023-08-01T19:56:35.055 INFO:teuthology.orchestra.run.smithi155.stdout: "duration": 0.00013575800000000001 2023-08-01T19:56:35.055 INFO:teuthology.orchestra.run.smithi155.stdout: }, 2023-08-01T19:56:35.055 INFO:teuthology.orchestra.run.smithi155.stdout: { 2023-08-01T19:56:35.055 INFO:teuthology.orchestra.run.smithi155.stdout: "event": "waiting for subops from 0", 2023-08-01T19:56:35.055 INFO:teuthology.orchestra.run.smithi155.stdout: "time": "2023-08-01T19:55:05.154043+0000", 2023-08-01T19:56:35.055 INFO:teuthology.orchestra.run.smithi155.stdout: "duration": 0.00014650700000000001 2023-08-01T19:56:35.056 INFO:teuthology.orchestra.run.smithi155.stdout: }, 2023-08-01T19:56:35.056 INFO:teuthology.orchestra.run.smithi155.stdout: { 2023-08-01T19:56:35.056 INFO:teuthology.orchestra.run.smithi155.stdout: "event": "sub_op_commit_rec", 2023-08-01T19:56:35.056 INFO:teuthology.orchestra.run.smithi155.stdout: "time": "2023-08-01T19:55:05.221876+0000", 2023-08-01T19:56:35.056 INFO:teuthology.orchestra.run.smithi155.stdout: "duration": 0.067832796000000001 2023-08-01T19:56:35.057 INFO:teuthology.orchestra.run.smithi155.stdout: }, 2023-08-01T19:56:35.057 INFO:teuthology.orchestra.run.smithi155.stdout: { 2023-08-01T19:56:35.057 INFO:teuthology.orchestra.run.smithi155.stdout: "event": "op_commit", 2023-08-01T19:56:35.057 INFO:teuthology.orchestra.run.smithi155.stdout: "time": "2023-08-01T19:55:05.222813+0000", 2023-08-01T19:56:35.057 INFO:teuthology.orchestra.run.smithi155.stdout: "duration": 0.00093755300000000004 2023-08-01T19:56:35.057 INFO:teuthology.orchestra.run.smithi155.stdout: }, 2023-08-01T19:56:35.057 INFO:teuthology.orchestra.run.smithi155.stdout: { 2023-08-01T19:56:35.058 INFO:teuthology.orchestra.run.smithi155.stdout: "event": "commit_sent", 2023-08-01T19:56:35.058 INFO:teuthology.orchestra.run.smithi155.stdout: "time": "2023-08-01T19:55:05.222861+0000", 2023-08-01T19:56:35.058 INFO:teuthology.orchestra.run.smithi155.stdout: "duration": 4.8013999999999998e-05 2023-08-01T19:56:35.058 INFO:teuthology.orchestra.run.smithi155.stdout: }, 2023-08-01T19:56:35.058 INFO:teuthology.orchestra.run.smithi155.stdout: { 2023-08-01T19:56:35.058 INFO:teuthology.orchestra.run.smithi155.stdout: "event": "done", 2023-08-01T19:56:35.058 INFO:teuthology.orchestra.run.smithi155.stdout: "time": "2023-08-01T19:55:05.222900+0000", 2023-08-01T19:56:35.058 INFO:teuthology.orchestra.run.smithi155.stdout: "duration": 3.8634999999999999e-05 2023-08-01T19:56:35.059 INFO:teuthology.orchestra.run.smithi155.stdout: } 2023-08-01T19:56:35.059 INFO:teuthology.orchestra.run.smithi155.stdout: ] 2023-08-01T19:56:35.059 INFO:teuthology.orchestra.run.smithi155.stdout: } 2023-08-01T19:56:35.059 INFO:teuthology.orchestra.run.smithi155.stdout: }, 2023-08-01T19:56:35.059 INFO:teuthology.orchestra.run.smithi155.stdout: { 2023-08-01T19:56:35.059 INFO:teuthology.orchestra.run.smithi155.stdout: "description": "osd_op(client.4668.0:100251 5.b 5:d853df24:::benchmark_data_smithi006_114134_object100250:head [set-alloc-hint object_size 65536 write_size 65536,write 0~65536] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e37)", 2023-08-01T19:56:35.059 INFO:teuthology.orchestra.run.smithi155.stdout: "initiated_at": "2023-08-01T19:55:05.153737+0000", 2023-08-01T19:56:35.060 INFO:teuthology.orchestra.run.smithi155.stdout: "age": 89.832401059000006, 2023-08-01T19:56:35.060 INFO:teuthology.orchestra.run.smithi155.stdout: "duration": 0.071366545000000003, 2023-08-01T19:56:35.060 INFO:teuthology.orchestra.run.smithi155.stdout: "type_data": { 2023-08-01T19:56:35.060 INFO:teuthology.orchestra.run.smithi155.stdout: "flag_point": "commit sent; apply or cleanup", 2023-08-01T19:56:35.061 INFO:teuthology.orchestra.run.smithi155.stdout: "client_info": { 2023-08-01T19:56:35.061 INFO:teuthology.orchestra.run.smithi155.stdout: "client": "client.4668", 2023-08-01T19:56:35.061 INFO:teuthology.orchestra.run.smithi155.stdout: "client_addr": "172.21.15.6:0/1709472247", 2023-08-01T19:56:35.061 INFO:teuthology.orchestra.run.smithi155.stdout: "tid": 100251 2023-08-01T19:56:35.061 INFO:teuthology.orchestra.run.smithi155.stdout: }, 2023-08-01T19:56:35.061 INFO:teuthology.orchestra.run.smithi155.stdout: "events": [ 2023-08-01T19:56:35.061 INFO:teuthology.orchestra.run.smithi155.stdout: { 2023-08-01T19:56:35.062 INFO:teuthology.orchestra.run.smithi155.stdout: "event": "initiated", 2023-08-01T19:56:35.062 INFO:teuthology.orchestra.run.smithi155.stdout: "time": "2023-08-01T19:55:05.153737+0000", 2023-08-01T19:56:35.062 INFO:teuthology.orchestra.run.smithi155.stdout: "duration": 0 2023-08-01T19:56:35.062 INFO:teuthology.orchestra.run.smithi155.stdout: }, 2023-08-01T19:56:35.062 INFO:teuthology.orchestra.run.smithi155.stdout: { 2023-08-01T19:56:35.062 INFO:teuthology.orchestra.run.smithi155.stdout: "event": "throttled", 2023-08-01T19:56:35.062 INFO:teuthology.orchestra.run.smithi155.stdout: "time": "2023-08-01T19:55:05.153737+0000", 2023-08-01T19:56:35.062 INFO:teuthology.orchestra.run.smithi155.stdout: "duration": 0 2023-08-01T19:56:35.063 INFO:teuthology.orchestra.run.smithi155.stdout: }, 2023-08-01T19:56:35.063 INFO:teuthology.orchestra.run.smithi155.stdout: { 2023-08-01T19:56:35.063 INFO:teuthology.orchestra.run.smithi155.stdout: "event": "header_read", 2023-08-01T19:56:35.063 INFO:teuthology.orchestra.run.smithi155.stdout: "time": "2023-08-01T19:55:05.153736+0000", 2023-08-01T19:56:35.063 INFO:teuthology.orchestra.run.smithi155.stdout: "duration": 4294967295.9999995 2023-08-01T19:56:35.063 INFO:teuthology.orchestra.run.smithi155.stdout: }, 2023-08-01T19:56:35.063 INFO:teuthology.orchestra.run.smithi155.stdout: { 2023-08-01T19:56:35.063 INFO:teuthology.orchestra.run.smithi155.stdout: "event": "all_read", 2023-08-01T19:56:35.064 INFO:teuthology.orchestra.run.smithi155.stdout: "time": "2023-08-01T19:55:05.153784+0000", 2023-08-01T19:56:35.064 INFO:teuthology.orchestra.run.smithi155.stdout: "duration": 4.7660000000000001e-05 2023-08-01T19:56:35.064 INFO:teuthology.orchestra.run.smithi155.stdout: }, 2023-08-01T19:56:35.064 INFO:teuthology.orchestra.run.smithi155.stdout: { 2023-08-01T19:56:35.064 INFO:teuthology.orchestra.run.smithi155.stdout: "event": "dispatched", 2023-08-01T19:56:35.064 INFO:teuthology.orchestra.run.smithi155.stdout: "time": "2023-08-01T19:55:05.153793+0000", 2023-08-01T19:56:35.064 INFO:teuthology.orchestra.run.smithi155.stdout: "duration": 8.7150000000000004e-06 2023-08-01T19:56:35.064 INFO:teuthology.orchestra.run.smithi155.stdout: }, 2023-08-01T19:56:35.065 INFO:teuthology.orchestra.run.smithi155.stdout: { 2023-08-01T19:56:35.065 INFO:teuthology.orchestra.run.smithi155.stdout: "event": "queued_for_pg", 2023-08-01T19:56:35.065 INFO:teuthology.orchestra.run.smithi155.stdout: "time": "2023-08-01T19:55:05.153800+0000", 2023-08-01T19:56:35.065 INFO:teuthology.orchestra.run.smithi155.stdout: "duration": 7.2459999999999997e-06 2023-08-01T19:56:35.065 INFO:teuthology.orchestra.run.smithi155.stdout: }, 2023-08-01T19:56:35.065 INFO:teuthology.orchestra.run.smithi155.stdout: { 2023-08-01T19:56:35.065 INFO:teuthology.orchestra.run.smithi155.stdout: "event": "reached_pg", 2023-08-01T19:56:35.065 INFO:teuthology.orchestra.run.smithi155.stdout: "time": "2023-08-01T19:55:05.156241+0000", 2023-08-01T19:56:35.066 INFO:teuthology.orchestra.run.smithi155.stdout: "duration": 0.0024415359999999998 2023-08-01T19:56:35.066 INFO:teuthology.orchestra.run.smithi155.stdout: }, 2023-08-01T19:56:35.066 INFO:teuthology.orchestra.run.smithi155.stdout: { 2023-08-01T19:56:35.066 INFO:teuthology.orchestra.run.smithi155.stdout: "event": "started", 2023-08-01T19:56:35.066 INFO:teuthology.orchestra.run.smithi155.stdout: "time": "2023-08-01T19:55:05.219045+0000", 2023-08-01T19:56:35.066 INFO:teuthology.orchestra.run.smithi155.stdout: "duration": 0.062803855000000006 2023-08-01T19:56:35.066 INFO:teuthology.orchestra.run.smithi155.stdout: }, 2023-08-01T19:56:35.066 INFO:teuthology.orchestra.run.smithi155.stdout: { 2023-08-01T19:56:35.067 INFO:teuthology.orchestra.run.smithi155.stdout: "event": "waiting for subops from 0", 2023-08-01T19:56:35.067 INFO:teuthology.orchestra.run.smithi155.stdout: "time": "2023-08-01T19:55:05.219238+0000", 2023-08-01T19:56:35.067 INFO:teuthology.orchestra.run.smithi155.stdout: "duration": 0.00019241500000000001 2023-08-01T19:56:35.067 INFO:teuthology.orchestra.run.smithi155.stdout: }, 2023-08-01T19:56:35.067 INFO:teuthology.orchestra.run.smithi155.stdout: { 2023-08-01T19:56:35.067 INFO:teuthology.orchestra.run.smithi155.stdout: "event": "sub_op_commit_rec", 2023-08-01T19:56:35.067 INFO:teuthology.orchestra.run.smithi155.stdout: "time": "2023-08-01T19:55:05.223300+0000", 2023-08-01T19:56:35.068 INFO:teuthology.orchestra.run.smithi155.stdout: "duration": 0.0040626509999999996 2023-08-01T19:56:35.068 INFO:teuthology.orchestra.run.smithi155.stdout: }, 2023-08-01T19:56:35.068 INFO:teuthology.orchestra.run.smithi155.stdout: { 2023-08-01T19:56:35.068 INFO:teuthology.orchestra.run.smithi155.stdout: "event": "op_commit", 2023-08-01T19:56:35.069 INFO:teuthology.orchestra.run.smithi155.stdout: "time": "2023-08-01T19:55:05.225020+0000", 2023-08-01T19:56:35.069 INFO:teuthology.orchestra.run.smithi155.stdout: "duration": 0.0017201 2023-08-01T19:56:35.069 INFO:teuthology.orchestra.run.smithi155.stdout: }, 2023-08-01T19:56:35.069 INFO:teuthology.orchestra.run.smithi155.stdout: { 2023-08-01T19:56:35.069 INFO:teuthology.orchestra.run.smithi155.stdout: "event": "commit_sent", 2023-08-01T19:56:35.069 INFO:teuthology.orchestra.run.smithi155.stdout: "time": "2023-08-01T19:55:05.225066+0000", 2023-08-01T19:56:35.069 INFO:teuthology.orchestra.run.smithi155.stdout: "duration": 4.6143000000000002e-05 2023-08-01T19:56:35.070 INFO:teuthology.orchestra.run.smithi155.stdout: }, 2023-08-01T19:56:35.070 INFO:teuthology.orchestra.run.smithi155.stdout: { 2023-08-01T19:56:35.070 INFO:teuthology.orchestra.run.smithi155.stdout: "event": "done", 2023-08-01T19:56:35.070 INFO:teuthology.orchestra.run.smithi155.stdout: "time": "2023-08-01T19:55:05.225103+0000", 2023-08-01T19:56:35.070 INFO:teuthology.orchestra.run.smithi155.stdout: "duration": 3.6789999999999998e-05 2023-08-01T19:56:35.070 INFO:teuthology.orchestra.run.smithi155.stdout: } 2023-08-01T19:56:35.070 INFO:teuthology.orchestra.run.smithi155.stdout: ] 2023-08-01T19:56:35.070 INFO:teuthology.orchestra.run.smithi155.stdout: } 2023-08-01T19:56:35.071 INFO:teuthology.orchestra.run.smithi155.stdout: }, 2023-08-01T19:56:35.071 INFO:teuthology.orchestra.run.smithi155.stdout: { 2023-08-01T19:56:35.071 INFO:teuthology.orchestra.run.smithi155.stdout: "description": "osd_op(client.4668.0:100252 5.0 5:01f90c3c:::benchmark_data_smithi006_114134_object100251:head [set-alloc-hint object_size 65536 write_size 65536,write 0~65536] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e37)", 2023-08-01T19:56:35.071 INFO:teuthology.orchestra.run.smithi155.stdout: "initiated_at": "2023-08-01T19:55:05.154048+0000", 2023-08-01T19:56:35.071 INFO:teuthology.orchestra.run.smithi155.stdout: "age": 89.832089812000007, 2023-08-01T19:56:35.071 INFO:teuthology.orchestra.run.smithi155.stdout: "duration": 0.070156683999999997, 2023-08-01T19:56:35.071 INFO:teuthology.orchestra.run.smithi155.stdout: "type_data": { 2023-08-01T19:56:35.071 INFO:teuthology.orchestra.run.smithi155.stdout: "flag_point": "commit sent; apply or cleanup", 2023-08-01T19:56:35.072 INFO:teuthology.orchestra.run.smithi155.stdout: "client_info": { 2023-08-01T19:56:35.072 INFO:teuthology.orchestra.run.smithi155.stdout: "client": "client.4668", 2023-08-01T19:56:35.072 INFO:teuthology.orchestra.run.smithi155.stdout: "client_addr": "172.21.15.6:0/1709472247", 2023-08-01T19:56:35.072 INFO:teuthology.orchestra.run.smithi155.stdout: "tid": 100252 2023-08-01T19:56:35.072 INFO:teuthology.orchestra.run.smithi155.stdout: }, 2023-08-01T19:56:35.072 INFO:teuthology.orchestra.run.smithi155.stdout: "events": [ 2023-08-01T19:56:35.072 INFO:teuthology.orchestra.run.smithi155.stdout: { 2023-08-01T19:56:35.073 INFO:teuthology.orchestra.run.smithi155.stdout: "event": "initiated", 2023-08-01T19:56:35.073 INFO:teuthology.orchestra.run.smithi155.stdout: "time": "2023-08-01T19:55:05.154048+0000", 2023-08-01T19:56:35.073 INFO:teuthology.orchestra.run.smithi155.stdout: "duration": 0 2023-08-01T19:56:35.073 INFO:teuthology.orchestra.run.smithi155.stdout: }, 2023-08-01T19:56:35.073 INFO:teuthology.orchestra.run.smithi155.stdout: { 2023-08-01T19:56:35.073 INFO:teuthology.orchestra.run.smithi155.stdout: "event": "throttled", 2023-08-01T19:56:35.073 INFO:teuthology.orchestra.run.smithi155.stdout: "time": "2023-08-01T19:55:05.154048+0000", 2023-08-01T19:56:35.073 INFO:teuthology.orchestra.run.smithi155.stdout: "duration": 0 2023-08-01T19:56:35.074 INFO:teuthology.orchestra.run.smithi155.stdout: }, 2023-08-01T19:56:35.074 INFO:teuthology.orchestra.run.smithi155.stdout: { 2023-08-01T19:56:35.074 INFO:teuthology.orchestra.run.smithi155.stdout: "event": "header_read", 2023-08-01T19:56:35.074 INFO:teuthology.orchestra.run.smithi155.stdout: "time": "2023-08-01T19:55:05.154047+0000", 2023-08-01T19:56:35.074 INFO:teuthology.orchestra.run.smithi155.stdout: "duration": 4294967295.999999 2023-08-01T19:56:35.074 INFO:teuthology.orchestra.run.smithi155.stdout: }, 2023-08-01T19:56:35.074 INFO:teuthology.orchestra.run.smithi155.stdout: { 2023-08-01T19:56:35.074 INFO:teuthology.orchestra.run.smithi155.stdout: "event": "all_read", 2023-08-01T19:56:35.075 INFO:teuthology.orchestra.run.smithi155.stdout: "time": "2023-08-01T19:55:05.154115+0000", 2023-08-01T19:56:35.075 INFO:teuthology.orchestra.run.smithi155.stdout: "duration": 6.7545999999999993e-05 2023-08-01T19:56:35.075 INFO:teuthology.orchestra.run.smithi155.stdout: }, 2023-08-01T19:56:35.075 INFO:teuthology.orchestra.run.smithi155.stdout: { 2023-08-01T19:56:35.075 INFO:teuthology.orchestra.run.smithi155.stdout: "event": "dispatched", 2023-08-01T19:56:35.075 INFO:teuthology.orchestra.run.smithi155.stdout: "time": "2023-08-01T19:55:05.154125+0000", 2023-08-01T19:56:35.075 INFO:teuthology.orchestra.run.smithi155.stdout: "duration": 1.0669000000000001e-05 2023-08-01T19:56:35.075 INFO:teuthology.orchestra.run.smithi155.stdout: }, 2023-08-01T19:56:35.076 INFO:teuthology.orchestra.run.smithi155.stdout: { 2023-08-01T19:56:35.076 INFO:teuthology.orchestra.run.smithi155.stdout: "event": "queued_for_pg", 2023-08-01T19:56:35.076 INFO:teuthology.orchestra.run.smithi155.stdout: "time": "2023-08-01T19:55:05.154131+0000", 2023-08-01T19:56:35.076 INFO:teuthology.orchestra.run.smithi155.stdout: "duration": 6.0349999999999998e-06 2023-08-01T19:56:35.076 INFO:teuthology.orchestra.run.smithi155.stdout: }, 2023-08-01T19:56:35.076 INFO:teuthology.orchestra.run.smithi155.stdout: { 2023-08-01T19:56:35.076 INFO:teuthology.orchestra.run.smithi155.stdout: "event": "reached_pg", 2023-08-01T19:56:35.076 INFO:teuthology.orchestra.run.smithi155.stdout: "time": "2023-08-01T19:55:05.154174+0000", 2023-08-01T19:56:35.077 INFO:teuthology.orchestra.run.smithi155.stdout: "duration": 4.2429000000000003e-05 2023-08-01T19:56:35.077 INFO:teuthology.orchestra.run.smithi155.stdout: }, 2023-08-01T19:56:35.077 INFO:teuthology.orchestra.run.smithi155.stdout: { 2023-08-01T19:56:35.077 INFO:teuthology.orchestra.run.smithi155.stdout: "event": "started", 2023-08-01T19:56:35.077 INFO:teuthology.orchestra.run.smithi155.stdout: "time": "2023-08-01T19:55:05.154287+0000", 2023-08-01T19:56:35.077 INFO:teuthology.orchestra.run.smithi155.stdout: "duration": 0.000113138 2023-08-01T19:56:35.077 INFO:teuthology.orchestra.run.smithi155.stdout: }, 2023-08-01T19:56:35.077 INFO:teuthology.orchestra.run.smithi155.stdout: { 2023-08-01T19:56:35.078 INFO:teuthology.orchestra.run.smithi155.stdout: "event": "waiting for subops from 0", 2023-08-01T19:56:35.078 INFO:teuthology.orchestra.run.smithi155.stdout: "time": "2023-08-01T19:55:05.154420+0000", 2023-08-01T19:56:35.078 INFO:teuthology.orchestra.run.smithi155.stdout: "duration": 0.000133292 2023-08-01T19:56:35.078 INFO:teuthology.orchestra.run.smithi155.stdout: }, 2023-08-01T19:56:35.078 INFO:teuthology.orchestra.run.smithi155.stdout: { 2023-08-01T19:56:35.078 INFO:teuthology.orchestra.run.smithi155.stdout: "event": "sub_op_commit_rec", 2023-08-01T19:56:35.079 INFO:teuthology.orchestra.run.smithi155.stdout: "time": "2023-08-01T19:55:05.219034+0000", 2023-08-01T19:56:35.079 INFO:teuthology.orchestra.run.smithi155.stdout: "duration": 0.064613429999999999 2023-08-01T19:56:35.079 INFO:teuthology.orchestra.run.smithi155.stdout: }, 2023-08-01T19:56:35.079 INFO:teuthology.orchestra.run.smithi155.stdout: { 2023-08-01T19:56:35.080 INFO:teuthology.orchestra.run.smithi155.stdout: "event": "op_commit", 2023-08-01T19:56:35.080 INFO:teuthology.orchestra.run.smithi155.stdout: "time": "2023-08-01T19:55:05.224138+0000", 2023-08-01T19:56:35.080 INFO:teuthology.orchestra.run.smithi155.stdout: "duration": 0.0051041999999999997 2023-08-01T19:56:35.080 INFO:teuthology.orchestra.run.smithi155.stdout: }, 2023-08-01T19:56:35.081 INFO:teuthology.orchestra.run.smithi155.stdout: { 2023-08-01T19:56:35.081 INFO:teuthology.orchestra.run.smithi155.stdout: "event": "commit_sent", 2023-08-01T19:56:35.081 INFO:teuthology.orchestra.run.smithi155.stdout: "time": "2023-08-01T19:55:05.224171+0000", 2023-08-01T19:56:35.081 INFO:teuthology.orchestra.run.smithi155.stdout: "duration": 3.3345e-05 2023-08-01T19:56:35.081 INFO:teuthology.orchestra.run.smithi155.stdout: }, 2023-08-01T19:56:35.082 INFO:teuthology.orchestra.run.smithi155.stdout: { 2023-08-01T19:56:35.082 INFO:teuthology.orchestra.run.smithi155.stdout: "event": "done", 2023-08-01T19:56:35.082 INFO:teuthology.orchestra.run.smithi155.stdout: "time": "2023-08-01T19:55:05.224205+0000", 2023-08-01T19:56:35.082 INFO:teuthology.orchestra.run.smithi155.stdout: "duration": 3.3525999999999997e-05 2023-08-01T19:56:35.082 INFO:teuthology.orchestra.run.smithi155.stdout: } 2023-08-01T19:56:35.082 INFO:teuthology.orchestra.run.smithi155.stdout: ] 2023-08-01T19:56:35.083 INFO:teuthology.orchestra.run.smithi155.stdout: } 2023-08-01T19:56:35.083 INFO:teuthology.orchestra.run.smithi155.stdout: }, 2023-08-01T19:56:35.083 INFO:teuthology.orchestra.run.smithi155.stdout: { 2023-08-01T19:56:35.083 INFO:teuthology.orchestra.run.smithi155.stdout: "description": "osd_repop_reply(client.4668.0:100237 5.4 e37/19 ondisk, result = 0)", 2023-08-01T19:56:35.083 INFO:teuthology.orchestra.run.smithi155.stdout: "initiated_at": "2023-08-01T19:55:05.156249+0000", 2023-08-01T19:56:35.083 INFO:teuthology.orchestra.run.smithi155.stdout: "age": 89.829888866999994, 2023-08-01T19:56:35.083 INFO:teuthology.orchestra.run.smithi155.stdout: "duration": 0.062792549000000003, 2023-08-01T19:56:35.083 INFO:teuthology.orchestra.run.smithi155.stdout: "type_data": { 2023-08-01T19:56:35.084 INFO:teuthology.orchestra.run.smithi155.stdout: "flag_point": "started", 2023-08-01T19:56:35.084 INFO:teuthology.orchestra.run.smithi155.stdout: "events": [ 2023-08-01T19:56:35.084 INFO:teuthology.orchestra.run.smithi155.stdout: { 2023-08-01T19:56:35.084 INFO:teuthology.orchestra.run.smithi155.stdout: "event": "initiated", 2023-08-01T19:56:35.084 INFO:teuthology.orchestra.run.smithi155.stdout: "time": "2023-08-01T19:55:05.156249+0000", 2023-08-01T19:56:35.084 INFO:teuthology.orchestra.run.smithi155.stdout: "duration": 0 2023-08-01T19:56:35.084 INFO:teuthology.orchestra.run.smithi155.stdout: }, 2023-08-01T19:56:35.084 INFO:teuthology.orchestra.run.smithi155.stdout: { 2023-08-01T19:56:35.085 INFO:teuthology.orchestra.run.smithi155.stdout: "event": "throttled", 2023-08-01T19:56:35.085 INFO:teuthology.orchestra.run.smithi155.stdout: "time": "2023-08-01T19:55:05.156249+0000", 2023-08-01T19:56:35.085 INFO:teuthology.orchestra.run.smithi155.stdout: "duration": 0 2023-08-01T19:56:35.085 INFO:teuthology.orchestra.run.smithi155.stdout: }, 2023-08-01T19:56:35.085 INFO:teuthology.orchestra.run.smithi155.stdout: { 2023-08-01T19:56:35.085 INFO:teuthology.orchestra.run.smithi155.stdout: "event": "header_read", 2023-08-01T19:56:35.085 INFO:teuthology.orchestra.run.smithi155.stdout: "time": "2023-08-01T19:55:05.156248+0000", 2023-08-01T19:56:35.085 INFO:teuthology.orchestra.run.smithi155.stdout: "duration": 4294967295.9999995 2023-08-01T19:56:35.086 INFO:teuthology.orchestra.run.smithi155.stdout: }, 2023-08-01T19:56:35.086 INFO:teuthology.orchestra.run.smithi155.stdout: { 2023-08-01T19:56:35.086 INFO:teuthology.orchestra.run.smithi155.stdout: "event": "all_read", 2023-08-01T19:56:35.086 INFO:teuthology.orchestra.run.smithi155.stdout: "time": "2023-08-01T19:55:05.156252+0000", 2023-08-01T19:56:35.086 INFO:teuthology.orchestra.run.smithi155.stdout: "duration": 3.9999999999999998e-06 2023-08-01T19:56:35.086 INFO:teuthology.orchestra.run.smithi155.stdout: }, 2023-08-01T19:56:35.086 INFO:teuthology.orchestra.run.smithi155.stdout: { 2023-08-01T19:56:35.086 INFO:teuthology.orchestra.run.smithi155.stdout: "event": "dispatched", 2023-08-01T19:56:35.087 INFO:teuthology.orchestra.run.smithi155.stdout: "time": "2023-08-01T19:55:05.218844+0000", 2023-08-01T19:56:35.087 INFO:teuthology.orchestra.run.smithi155.stdout: "duration": 0.062591516999999999 2023-08-01T19:56:35.087 INFO:teuthology.orchestra.run.smithi155.stdout: }, 2023-08-01T19:56:35.087 INFO:teuthology.orchestra.run.smithi155.stdout: { 2023-08-01T19:56:35.087 INFO:teuthology.orchestra.run.smithi155.stdout: "event": "queued_for_pg", 2023-08-01T19:56:35.087 INFO:teuthology.orchestra.run.smithi155.stdout: "time": "2023-08-01T19:55:05.218862+0000", 2023-08-01T19:56:35.087 INFO:teuthology.orchestra.run.smithi155.stdout: "duration": 1.7666e-05 2023-08-01T19:56:35.088 INFO:teuthology.orchestra.run.smithi155.stdout: }, 2023-08-01T19:56:35.088 INFO:teuthology.orchestra.run.smithi155.stdout: { 2023-08-01T19:56:35.088 INFO:teuthology.orchestra.run.smithi155.stdout: "event": "reached_pg", 2023-08-01T19:56:35.088 INFO:teuthology.orchestra.run.smithi155.stdout: "time": "2023-08-01T19:55:05.218914+0000", 2023-08-01T19:56:35.088 INFO:teuthology.orchestra.run.smithi155.stdout: "duration": 5.2565999999999998e-05 2023-08-01T19:56:35.088 INFO:teuthology.orchestra.run.smithi155.stdout: }, 2023-08-01T19:56:35.088 INFO:teuthology.orchestra.run.smithi155.stdout: { 2023-08-01T19:56:35.088 INFO:teuthology.orchestra.run.smithi155.stdout: "event": "started", 2023-08-01T19:56:35.089 INFO:teuthology.orchestra.run.smithi155.stdout: "time": "2023-08-01T19:55:05.218925+0000", 2023-08-01T19:56:35.089 INFO:teuthology.orchestra.run.smithi155.stdout: "duration": 1.1375e-05 2023-08-01T19:56:35.089 INFO:teuthology.orchestra.run.smithi155.stdout: }, 2023-08-01T19:56:35.089 INFO:teuthology.orchestra.run.smithi155.stdout: { 2023-08-01T19:56:35.089 INFO:teuthology.orchestra.run.smithi155.stdout: "event": "done", 2023-08-01T19:56:35.089 INFO:teuthology.orchestra.run.smithi155.stdout: "time": "2023-08-01T19:55:05.219041+0000", 2023-08-01T19:56:35.089 INFO:teuthology.orchestra.run.smithi155.stdout: "duration": 0.000115977 2023-08-01T19:56:35.089 INFO:teuthology.orchestra.run.smithi155.stdout: } 2023-08-01T19:56:35.090 INFO:teuthology.orchestra.run.smithi155.stdout: ] 2023-08-01T19:56:35.090 INFO:teuthology.orchestra.run.smithi155.stdout: } 2023-08-01T19:56:35.090 INFO:teuthology.orchestra.run.smithi155.stdout: }, 2023-08-01T19:56:35.090 INFO:teuthology.orchestra.run.smithi155.stdout: { 2023-08-01T19:56:35.090 INFO:teuthology.orchestra.run.smithi155.stdout: "description": "osd_repop(client.4668.0:100253 5.f e37/19 5:f7bbce05:::benchmark_data_smithi006_114134_object100252:head v 37'6323, mlcod=37'6321)", 2023-08-01T19:56:35.090 INFO:teuthology.orchestra.run.smithi155.stdout: "initiated_at": "2023-08-01T19:55:05.156952+0000", 2023-08-01T19:56:35.090 INFO:teuthology.orchestra.run.smithi155.stdout: "age": 89.829185804000005, 2023-08-01T19:56:35.090 INFO:teuthology.orchestra.run.smithi155.stdout: "duration": 0.068018577999999996, 2023-08-01T19:56:35.091 INFO:teuthology.orchestra.run.smithi155.stdout: "type_data": { 2023-08-01T19:56:35.091 INFO:teuthology.orchestra.run.smithi155.stdout: "flag_point": "commit sent; apply or cleanup", 2023-08-01T19:56:35.091 INFO:teuthology.orchestra.run.smithi155.stdout: "events": [ 2023-08-01T19:56:35.091 INFO:teuthology.orchestra.run.smithi155.stdout: { 2023-08-01T19:56:35.091 INFO:teuthology.orchestra.run.smithi155.stdout: "event": "initiated", 2023-08-01T19:56:35.091 INFO:teuthology.orchestra.run.smithi155.stdout: "time": "2023-08-01T19:55:05.156952+0000", 2023-08-01T19:56:35.091 INFO:teuthology.orchestra.run.smithi155.stdout: "duration": 0 2023-08-01T19:56:35.091 INFO:teuthology.orchestra.run.smithi155.stdout: }, 2023-08-01T19:56:35.092 INFO:teuthology.orchestra.run.smithi155.stdout: { 2023-08-01T19:56:35.092 INFO:teuthology.orchestra.run.smithi155.stdout: "event": "throttled", 2023-08-01T19:56:35.092 INFO:teuthology.orchestra.run.smithi155.stdout: "time": "2023-08-01T19:55:05.156952+0000", 2023-08-01T19:56:35.092 INFO:teuthology.orchestra.run.smithi155.stdout: "duration": 0 2023-08-01T19:56:35.092 INFO:teuthology.orchestra.run.smithi155.stdout: }, 2023-08-01T19:56:35.092 INFO:teuthology.orchestra.run.smithi155.stdout: { 2023-08-01T19:56:35.092 INFO:teuthology.orchestra.run.smithi155.stdout: "event": "header_read", 2023-08-01T19:56:35.093 INFO:teuthology.orchestra.run.smithi155.stdout: "time": "2023-08-01T19:55:05.156951+0000", 2023-08-01T19:56:35.093 INFO:teuthology.orchestra.run.smithi155.stdout: "duration": 4294967295.999999 2023-08-01T19:56:35.093 INFO:teuthology.orchestra.run.smithi155.stdout: }, 2023-08-01T19:56:35.093 INFO:teuthology.orchestra.run.smithi155.stdout: { 2023-08-01T19:56:35.093 INFO:teuthology.orchestra.run.smithi155.stdout: "event": "all_read", 2023-08-01T19:56:35.093 INFO:teuthology.orchestra.run.smithi155.stdout: "time": "2023-08-01T19:55:05.156989+0000", 2023-08-01T19:56:35.093 INFO:teuthology.orchestra.run.smithi155.stdout: "duration": 3.8175e-05 2023-08-01T19:56:35.094 INFO:teuthology.orchestra.run.smithi155.stdout: }, 2023-08-01T19:56:35.094 INFO:teuthology.orchestra.run.smithi155.stdout: { 2023-08-01T19:56:35.094 INFO:teuthology.orchestra.run.smithi155.stdout: "event": "dispatched", 2023-08-01T19:56:35.094 INFO:teuthology.orchestra.run.smithi155.stdout: "time": "2023-08-01T19:55:05.218842+0000", 2023-08-01T19:56:35.094 INFO:teuthology.orchestra.run.smithi155.stdout: "duration": 0.061852299999999999 2023-08-01T19:56:35.094 INFO:teuthology.orchestra.run.smithi155.stdout: }, 2023-08-01T19:56:35.094 INFO:teuthology.orchestra.run.smithi155.stdout: { 2023-08-01T19:56:35.095 INFO:teuthology.orchestra.run.smithi155.stdout: "event": "queued_for_pg", 2023-08-01T19:56:35.095 INFO:teuthology.orchestra.run.smithi155.stdout: "time": "2023-08-01T19:55:05.218862+0000", 2023-08-01T19:56:35.095 INFO:teuthology.orchestra.run.smithi155.stdout: "duration": 1.9854999999999999e-05 2023-08-01T19:56:35.095 INFO:teuthology.orchestra.run.smithi155.stdout: }, 2023-08-01T19:56:35.095 INFO:teuthology.orchestra.run.smithi155.stdout: { 2023-08-01T19:56:35.095 INFO:teuthology.orchestra.run.smithi155.stdout: "event": "reached_pg", 2023-08-01T19:56:35.095 INFO:teuthology.orchestra.run.smithi155.stdout: "time": "2023-08-01T19:55:05.218918+0000", 2023-08-01T19:56:35.095 INFO:teuthology.orchestra.run.smithi155.stdout: "duration": 5.6570000000000002e-05 2023-08-01T19:56:35.096 INFO:teuthology.orchestra.run.smithi155.stdout: }, 2023-08-01T19:56:35.096 INFO:teuthology.orchestra.run.smithi155.stdout: { 2023-08-01T19:56:35.096 INFO:teuthology.orchestra.run.smithi155.stdout: "event": "started", 2023-08-01T19:56:35.096 INFO:teuthology.orchestra.run.smithi155.stdout: "time": "2023-08-01T19:55:05.218940+0000", 2023-08-01T19:56:35.096 INFO:teuthology.orchestra.run.smithi155.stdout: "duration": 2.1804e-05 2023-08-01T19:56:35.096 INFO:teuthology.orchestra.run.smithi155.stdout: }, 2023-08-01T19:56:35.096 INFO:teuthology.orchestra.run.smithi155.stdout: { 2023-08-01T19:56:35.097 INFO:teuthology.orchestra.run.smithi155.stdout: "event": "commit_sent", 2023-08-01T19:56:35.097 INFO:teuthology.orchestra.run.smithi155.stdout: "time": "2023-08-01T19:55:05.224928+0000", 2023-08-01T19:56:35.097 INFO:teuthology.orchestra.run.smithi155.stdout: "duration": 0.0059876759999999999 2023-08-01T19:56:35.097 INFO:teuthology.orchestra.run.smithi155.stdout: }, 2023-08-01T19:56:35.097 INFO:teuthology.orchestra.run.smithi155.stdout: { 2023-08-01T19:56:35.097 INFO:teuthology.orchestra.run.smithi155.stdout: "event": "done", 2023-08-01T19:56:35.097 INFO:teuthology.orchestra.run.smithi155.stdout: "time": "2023-08-01T19:55:05.224971+0000", 2023-08-01T19:56:35.097 INFO:teuthology.orchestra.run.smithi155.stdout: "duration": 4.2929999999999997e-05 2023-08-01T19:56:35.098 INFO:teuthology.orchestra.run.smithi155.stdout: } 2023-08-01T19:56:35.098 INFO:teuthology.orchestra.run.smithi155.stdout: ] 2023-08-01T19:56:35.098 INFO:teuthology.orchestra.run.smithi155.stdout: } 2023-08-01T19:56:35.098 INFO:teuthology.orchestra.run.smithi155.stdout: }, 2023-08-01T19:56:35.098 INFO:teuthology.orchestra.run.smithi155.stdout: { 2023-08-01T19:56:35.098 INFO:teuthology.orchestra.run.smithi155.stdout: "description": "osd_op(client.4668.0:100927 5.0 5:00608ec6:::benchmark_data_smithi006_114134_object100926:head [set-alloc-hint object_size 65536 write_size 65536,write 0~65536] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e37)", 2023-08-01T19:56:35.098 INFO:teuthology.orchestra.run.smithi155.stdout: "initiated_at": "2023-08-01T19:55:05.561169+0000", 2023-08-01T19:56:35.098 INFO:teuthology.orchestra.run.smithi155.stdout: "age": 89.424968901, 2023-08-01T19:56:35.099 INFO:teuthology.orchestra.run.smithi155.stdout: "duration": 0.066411687999999997, 2023-08-01T19:56:35.099 INFO:teuthology.orchestra.run.smithi155.stdout: "type_data": { 2023-08-01T19:56:35.099 INFO:teuthology.orchestra.run.smithi155.stdout: "flag_point": "commit sent; apply or cleanup", 2023-08-01T19:56:35.099 INFO:teuthology.orchestra.run.smithi155.stdout: "client_info": { 2023-08-01T19:56:35.099 INFO:teuthology.orchestra.run.smithi155.stdout: "client": "client.4668", 2023-08-01T19:56:35.099 INFO:teuthology.orchestra.run.smithi155.stdout: "client_addr": "172.21.15.6:0/1709472247", 2023-08-01T19:56:35.099 INFO:teuthology.orchestra.run.smithi155.stdout: "tid": 100927 2023-08-01T19:56:35.099 INFO:teuthology.orchestra.run.smithi155.stdout: }, 2023-08-01T19:56:35.100 INFO:teuthology.orchestra.run.smithi155.stdout: "events": [ 2023-08-01T19:56:35.100 INFO:teuthology.orchestra.run.smithi155.stdout: { 2023-08-01T19:56:35.100 INFO:teuthology.orchestra.run.smithi155.stdout: "event": "initiated", 2023-08-01T19:56:35.100 INFO:teuthology.orchestra.run.smithi155.stdout: "time": "2023-08-01T19:55:05.561169+0000", 2023-08-01T19:56:35.100 INFO:teuthology.orchestra.run.smithi155.stdout: "duration": 0 2023-08-01T19:56:35.100 INFO:teuthology.orchestra.run.smithi155.stdout: }, 2023-08-01T19:56:35.100 INFO:teuthology.orchestra.run.smithi155.stdout: { 2023-08-01T19:56:35.100 INFO:teuthology.orchestra.run.smithi155.stdout: "event": "throttled", 2023-08-01T19:56:35.101 INFO:teuthology.orchestra.run.smithi155.stdout: "time": "2023-08-01T19:55:05.561169+0000", 2023-08-01T19:56:35.101 INFO:teuthology.orchestra.run.smithi155.stdout: "duration": 0 2023-08-01T19:56:35.101 INFO:teuthology.orchestra.run.smithi155.stdout: }, 2023-08-01T19:56:35.101 INFO:teuthology.orchestra.run.smithi155.stdout: { 2023-08-01T19:56:35.101 INFO:teuthology.orchestra.run.smithi155.stdout: "event": "header_read", 2023-08-01T19:56:35.101 INFO:teuthology.orchestra.run.smithi155.stdout: "time": "2023-08-01T19:55:05.561168+0000", 2023-08-01T19:56:35.101 INFO:teuthology.orchestra.run.smithi155.stdout: "duration": 4294967295.9999995 2023-08-01T19:56:35.101 INFO:teuthology.orchestra.run.smithi155.stdout: }, 2023-08-01T19:56:35.102 INFO:teuthology.orchestra.run.smithi155.stdout: { 2023-08-01T19:56:35.102 INFO:teuthology.orchestra.run.smithi155.stdout: "event": "all_read", 2023-08-01T19:56:35.102 INFO:teuthology.orchestra.run.smithi155.stdout: "time": "2023-08-01T19:55:05.561218+0000", 2023-08-01T19:56:35.102 INFO:teuthology.orchestra.run.smithi155.stdout: "duration": 4.9379999999999998e-05 2023-08-01T19:56:35.102 INFO:teuthology.orchestra.run.smithi155.stdout: }, 2023-08-01T19:56:35.102 INFO:teuthology.orchestra.run.smithi155.stdout: { 2023-08-01T19:56:35.102 INFO:teuthology.orchestra.run.smithi155.stdout: "event": "dispatched", 2023-08-01T19:56:35.103 INFO:teuthology.orchestra.run.smithi155.stdout: "time": "2023-08-01T19:55:05.561225+0000", 2023-08-01T19:56:35.103 INFO:teuthology.orchestra.run.smithi155.stdout: "duration": 7.114e-06 2023-08-01T19:56:35.103 INFO:teuthology.orchestra.run.smithi155.stdout: }, 2023-08-01T19:56:35.103 INFO:teuthology.orchestra.run.smithi155.stdout: { 2023-08-01T19:56:35.103 INFO:teuthology.orchestra.run.smithi155.stdout: "event": "queued_for_pg", 2023-08-01T19:56:35.103 INFO:teuthology.orchestra.run.smithi155.stdout: "time": "2023-08-01T19:55:05.561229+0000", 2023-08-01T19:56:35.103 INFO:teuthology.orchestra.run.smithi155.stdout: "duration": 4.2180000000000001e-06 2023-08-01T19:56:35.103 INFO:teuthology.orchestra.run.smithi155.stdout: }, 2023-08-01T19:56:35.104 INFO:teuthology.orchestra.run.smithi155.stdout: { 2023-08-01T19:56:35.104 INFO:teuthology.orchestra.run.smithi155.stdout: "event": "reached_pg", 2023-08-01T19:56:35.104 INFO:teuthology.orchestra.run.smithi155.stdout: "time": "2023-08-01T19:55:05.564737+0000", 2023-08-01T19:56:35.104 INFO:teuthology.orchestra.run.smithi155.stdout: "duration": 0.0035081869999999999 2023-08-01T19:56:35.104 INFO:teuthology.orchestra.run.smithi155.stdout: }, 2023-08-01T19:56:35.104 INFO:teuthology.orchestra.run.smithi155.stdout: { 2023-08-01T19:56:35.104 INFO:teuthology.orchestra.run.smithi155.stdout: "event": "started", 2023-08-01T19:56:35.104 INFO:teuthology.orchestra.run.smithi155.stdout: "time": "2023-08-01T19:55:05.564859+0000", 2023-08-01T19:56:35.105 INFO:teuthology.orchestra.run.smithi155.stdout: "duration": 0.00012165800000000001 2023-08-01T19:56:35.105 INFO:teuthology.orchestra.run.smithi155.stdout: }, 2023-08-01T19:56:35.105 INFO:teuthology.orchestra.run.smithi155.stdout: { 2023-08-01T19:56:35.105 INFO:teuthology.orchestra.run.smithi155.stdout: "event": "waiting for subops from 0", 2023-08-01T19:56:35.105 INFO:teuthology.orchestra.run.smithi155.stdout: "time": "2023-08-01T19:55:05.565009+0000", 2023-08-01T19:56:35.105 INFO:teuthology.orchestra.run.smithi155.stdout: "duration": 0.00014979699999999999 2023-08-01T19:56:35.105 INFO:teuthology.orchestra.run.smithi155.stdout: }, 2023-08-01T19:56:35.105 INFO:teuthology.orchestra.run.smithi155.stdout: { 2023-08-01T19:56:35.106 INFO:teuthology.orchestra.run.smithi155.stdout: "event": "op_commit", 2023-08-01T19:56:35.106 INFO:teuthology.orchestra.run.smithi155.stdout: "time": "2023-08-01T19:55:05.568007+0000", 2023-08-01T19:56:35.106 INFO:teuthology.orchestra.run.smithi155.stdout: "duration": 0.00299796 2023-08-01T19:56:35.106 INFO:teuthology.orchestra.run.smithi155.stdout: }, 2023-08-01T19:56:35.106 INFO:teuthology.orchestra.run.smithi155.stdout: { 2023-08-01T19:56:35.106 INFO:teuthology.orchestra.run.smithi155.stdout: "event": "sub_op_commit_rec", 2023-08-01T19:56:35.106 INFO:teuthology.orchestra.run.smithi155.stdout: "time": "2023-08-01T19:55:05.627520+0000", 2023-08-01T19:56:35.106 INFO:teuthology.orchestra.run.smithi155.stdout: "duration": 0.059513636000000002 2023-08-01T19:56:35.107 INFO:teuthology.orchestra.run.smithi155.stdout: }, 2023-08-01T19:56:35.107 INFO:teuthology.orchestra.run.smithi155.stdout: { 2023-08-01T19:56:35.107 INFO:teuthology.orchestra.run.smithi155.stdout: "event": "commit_sent", 2023-08-01T19:56:35.107 INFO:teuthology.orchestra.run.smithi155.stdout: "time": "2023-08-01T19:55:05.627553+0000", 2023-08-01T19:56:35.107 INFO:teuthology.orchestra.run.smithi155.stdout: "duration": 3.2635999999999997e-05 2023-08-01T19:56:35.107 INFO:teuthology.orchestra.run.smithi155.stdout: }, 2023-08-01T19:56:35.107 INFO:teuthology.orchestra.run.smithi155.stdout: { 2023-08-01T19:56:35.108 INFO:teuthology.orchestra.run.smithi155.stdout: "event": "done", 2023-08-01T19:56:35.108 INFO:teuthology.orchestra.run.smithi155.stdout: "time": "2023-08-01T19:55:05.627581+0000", 2023-08-01T19:56:35.108 INFO:teuthology.orchestra.run.smithi155.stdout: "duration": 2.7681000000000001e-05 2023-08-01T19:56:35.108 INFO:teuthology.orchestra.run.smithi155.stdout: } 2023-08-01T19:56:35.109 INFO:teuthology.orchestra.run.smithi155.stdout: ] 2023-08-01T19:56:35.109 INFO:teuthology.orchestra.run.smithi155.stdout: } 2023-08-01T19:56:35.109 INFO:teuthology.orchestra.run.smithi155.stdout: }, 2023-08-01T19:56:35.109 INFO:teuthology.orchestra.run.smithi155.stdout: { 2023-08-01T19:56:35.109 INFO:teuthology.orchestra.run.smithi155.stdout: "description": "osd_op(client.4668.0:100935 5.e 5:7895b14e:::benchmark_data_smithi006_114134_object100934:head [set-alloc-hint object_size 65536 write_size 65536,write 0~65536] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e37)", 2023-08-01T19:56:35.109 INFO:teuthology.orchestra.run.smithi155.stdout: "initiated_at": "2023-08-01T19:55:05.566666+0000", 2023-08-01T19:56:35.109 INFO:teuthology.orchestra.run.smithi155.stdout: "age": 89.419471600999998, 2023-08-01T19:56:35.110 INFO:teuthology.orchestra.run.smithi155.stdout: "duration": 0.064309016999999996, 2023-08-01T19:56:35.110 INFO:teuthology.orchestra.run.smithi155.stdout: "type_data": { 2023-08-01T19:56:35.110 INFO:teuthology.orchestra.run.smithi155.stdout: "flag_point": "commit sent; apply or cleanup", 2023-08-01T19:56:35.110 INFO:teuthology.orchestra.run.smithi155.stdout: "client_info": { 2023-08-01T19:56:35.110 INFO:teuthology.orchestra.run.smithi155.stdout: "client": "client.4668", 2023-08-01T19:56:35.110 INFO:teuthology.orchestra.run.smithi155.stdout: "client_addr": "172.21.15.6:0/1709472247", 2023-08-01T19:56:35.111 INFO:teuthology.orchestra.run.smithi155.stdout: "tid": 100935 2023-08-01T19:56:35.111 INFO:teuthology.orchestra.run.smithi155.stdout: }, 2023-08-01T19:56:35.111 INFO:teuthology.orchestra.run.smithi155.stdout: "events": [ 2023-08-01T19:56:35.111 INFO:teuthology.orchestra.run.smithi155.stdout: { 2023-08-01T19:56:35.112 INFO:teuthology.orchestra.run.smithi155.stdout: "event": "initiated", 2023-08-01T19:56:35.112 INFO:teuthology.orchestra.run.smithi155.stdout: "time": "2023-08-01T19:55:05.566666+0000", 2023-08-01T19:56:35.112 INFO:teuthology.orchestra.run.smithi155.stdout: "duration": 0 2023-08-01T19:56:35.112 INFO:teuthology.orchestra.run.smithi155.stdout: }, 2023-08-01T19:56:35.113 INFO:teuthology.orchestra.run.smithi155.stdout: { 2023-08-01T19:56:35.113 INFO:teuthology.orchestra.run.smithi155.stdout: "event": "throttled", 2023-08-01T19:56:35.113 INFO:teuthology.orchestra.run.smithi155.stdout: "time": "2023-08-01T19:55:05.566666+0000", 2023-08-01T19:56:35.113 INFO:teuthology.orchestra.run.smithi155.stdout: "duration": 0 2023-08-01T19:56:35.113 INFO:teuthology.orchestra.run.smithi155.stdout: }, 2023-08-01T19:56:35.113 INFO:teuthology.orchestra.run.smithi155.stdout: { 2023-08-01T19:56:35.114 INFO:teuthology.orchestra.run.smithi155.stdout: "event": "header_read", 2023-08-01T19:56:35.114 INFO:teuthology.orchestra.run.smithi155.stdout: "time": "2023-08-01T19:55:05.566665+0000", 2023-08-01T19:56:35.114 INFO:teuthology.orchestra.run.smithi155.stdout: "duration": 4294967295.9999986 2023-08-01T19:56:35.114 INFO:teuthology.orchestra.run.smithi155.stdout: }, 2023-08-01T19:56:35.114 INFO:teuthology.orchestra.run.smithi155.stdout: { 2023-08-01T19:56:35.115 INFO:teuthology.orchestra.run.smithi155.stdout: "event": "all_read", 2023-08-01T19:56:35.115 INFO:teuthology.orchestra.run.smithi155.stdout: "time": "2023-08-01T19:55:05.566754+0000", 2023-08-01T19:56:35.115 INFO:teuthology.orchestra.run.smithi155.stdout: "duration": 8.9425999999999994e-05 2023-08-01T19:56:35.115 INFO:teuthology.orchestra.run.smithi155.stdout: }, 2023-08-01T19:56:35.115 INFO:teuthology.orchestra.run.smithi155.stdout: { 2023-08-01T19:56:35.115 INFO:teuthology.orchestra.run.smithi155.stdout: "event": "dispatched", 2023-08-01T19:56:35.115 INFO:teuthology.orchestra.run.smithi155.stdout: "time": "2023-08-01T19:55:05.566766+0000", 2023-08-01T19:56:35.116 INFO:teuthology.orchestra.run.smithi155.stdout: "duration": 1.2018000000000001e-05 2023-08-01T19:56:35.116 INFO:teuthology.orchestra.run.smithi155.stdout: }, 2023-08-01T19:56:35.116 INFO:teuthology.orchestra.run.smithi155.stdout: { 2023-08-01T19:56:35.116 INFO:teuthology.orchestra.run.smithi155.stdout: "event": "queued_for_pg", 2023-08-01T19:56:35.116 INFO:teuthology.orchestra.run.smithi155.stdout: "time": "2023-08-01T19:55:05.566772+0000", 2023-08-01T19:56:35.116 INFO:teuthology.orchestra.run.smithi155.stdout: "duration": 6.0190000000000003e-06 2023-08-01T19:56:35.116 INFO:teuthology.orchestra.run.smithi155.stdout: }, 2023-08-01T19:56:35.116 INFO:teuthology.orchestra.run.smithi155.stdout: { 2023-08-01T19:56:35.117 INFO:teuthology.orchestra.run.smithi155.stdout: "event": "reached_pg", 2023-08-01T19:56:35.117 INFO:teuthology.orchestra.run.smithi155.stdout: "time": "2023-08-01T19:55:05.566800+0000", 2023-08-01T19:56:35.117 INFO:teuthology.orchestra.run.smithi155.stdout: "duration": 2.7835999999999999e-05 2023-08-01T19:56:35.117 INFO:teuthology.orchestra.run.smithi155.stdout: }, 2023-08-01T19:56:35.117 INFO:teuthology.orchestra.run.smithi155.stdout: { 2023-08-01T19:56:35.117 INFO:teuthology.orchestra.run.smithi155.stdout: "event": "started", 2023-08-01T19:56:35.117 INFO:teuthology.orchestra.run.smithi155.stdout: "time": "2023-08-01T19:55:05.566879+0000", 2023-08-01T19:56:35.117 INFO:teuthology.orchestra.run.smithi155.stdout: "duration": 7.9105999999999998e-05 2023-08-01T19:56:35.118 INFO:teuthology.orchestra.run.smithi155.stdout: }, 2023-08-01T19:56:35.118 INFO:teuthology.orchestra.run.smithi155.stdout: { 2023-08-01T19:56:35.118 INFO:teuthology.orchestra.run.smithi155.stdout: "event": "waiting for subops from 0", 2023-08-01T19:56:35.118 INFO:teuthology.orchestra.run.smithi155.stdout: "time": "2023-08-01T19:55:05.566971+0000", 2023-08-01T19:56:35.118 INFO:teuthology.orchestra.run.smithi155.stdout: "duration": 9.1817999999999994e-05 2023-08-01T19:56:35.118 INFO:teuthology.orchestra.run.smithi155.stdout: }, 2023-08-01T19:56:35.118 INFO:teuthology.orchestra.run.smithi155.stdout: { 2023-08-01T19:56:35.119 INFO:teuthology.orchestra.run.smithi155.stdout: "event": "op_commit", 2023-08-01T19:56:35.119 INFO:teuthology.orchestra.run.smithi155.stdout: "time": "2023-08-01T19:55:05.571475+0000", 2023-08-01T19:56:35.119 INFO:teuthology.orchestra.run.smithi155.stdout: "duration": 0.0045039499999999996 2023-08-01T19:56:35.119 INFO:teuthology.orchestra.run.smithi155.stdout: }, 2023-08-01T19:56:35.119 INFO:teuthology.orchestra.run.smithi155.stdout: { 2023-08-01T19:56:35.119 INFO:teuthology.orchestra.run.smithi155.stdout: "event": "sub_op_commit_rec", 2023-08-01T19:56:35.119 INFO:teuthology.orchestra.run.smithi155.stdout: "time": "2023-08-01T19:55:05.630884+0000", 2023-08-01T19:56:35.119 INFO:teuthology.orchestra.run.smithi155.stdout: "duration": 0.059409181999999998 2023-08-01T19:56:35.120 INFO:teuthology.orchestra.run.smithi155.stdout: }, 2023-08-01T19:56:35.120 INFO:teuthology.orchestra.run.smithi155.stdout: { 2023-08-01T19:56:35.120 INFO:teuthology.orchestra.run.smithi155.stdout: "event": "commit_sent", 2023-08-01T19:56:35.120 INFO:teuthology.orchestra.run.smithi155.stdout: "time": "2023-08-01T19:55:05.630930+0000", 2023-08-01T19:56:35.120 INFO:teuthology.orchestra.run.smithi155.stdout: "duration": 4.5507999999999999e-05 2023-08-01T19:56:35.120 INFO:teuthology.orchestra.run.smithi155.stdout: }, 2023-08-01T19:56:35.120 INFO:teuthology.orchestra.run.smithi155.stdout: { 2023-08-01T19:56:35.121 INFO:teuthology.orchestra.run.smithi155.stdout: "event": "done", 2023-08-01T19:56:35.121 INFO:teuthology.orchestra.run.smithi155.stdout: "time": "2023-08-01T19:55:05.630975+0000", 2023-08-01T19:56:35.121 INFO:teuthology.orchestra.run.smithi155.stdout: "duration": 4.5441000000000001e-05 2023-08-01T19:56:35.121 INFO:teuthology.orchestra.run.smithi155.stdout: } 2023-08-01T19:56:35.121 INFO:teuthology.orchestra.run.smithi155.stdout: ] 2023-08-01T19:56:35.121 INFO:teuthology.orchestra.run.smithi155.stdout: } 2023-08-01T19:56:35.121 INFO:teuthology.orchestra.run.smithi155.stdout: }, 2023-08-01T19:56:35.121 INFO:teuthology.orchestra.run.smithi155.stdout: { 2023-08-01T19:56:35.122 INFO:teuthology.orchestra.run.smithi155.stdout: "description": "osd_op(client.4668.0:100941 5.e 5:736a6ac6:::benchmark_data_smithi006_114134_object100940:head [set-alloc-hint object_size 65536 write_size 65536,write 0~65536] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e37)", 2023-08-01T19:56:35.122 INFO:teuthology.orchestra.run.smithi155.stdout: "initiated_at": "2023-08-01T19:55:05.569750+0000", 2023-08-01T19:56:35.122 INFO:teuthology.orchestra.run.smithi155.stdout: "age": 89.416387708000002, 2023-08-01T19:56:35.122 INFO:teuthology.orchestra.run.smithi155.stdout: "duration": 0.065431331999999995, 2023-08-01T19:56:35.122 INFO:teuthology.orchestra.run.smithi155.stdout: "type_data": { 2023-08-01T19:56:35.122 INFO:teuthology.orchestra.run.smithi155.stdout: "flag_point": "commit sent; apply or cleanup", 2023-08-01T19:56:35.122 INFO:teuthology.orchestra.run.smithi155.stdout: "client_info": { 2023-08-01T19:56:35.123 INFO:teuthology.orchestra.run.smithi155.stdout: "client": "client.4668", 2023-08-01T19:56:35.123 INFO:teuthology.orchestra.run.smithi155.stdout: "client_addr": "172.21.15.6:0/1709472247", 2023-08-01T19:56:35.123 INFO:teuthology.orchestra.run.smithi155.stdout: "tid": 100941 2023-08-01T19:56:35.123 INFO:teuthology.orchestra.run.smithi155.stdout: }, 2023-08-01T19:56:35.123 INFO:teuthology.orchestra.run.smithi155.stdout: "events": [ 2023-08-01T19:56:35.123 INFO:teuthology.orchestra.run.smithi155.stdout: { 2023-08-01T19:56:35.123 INFO:teuthology.orchestra.run.smithi155.stdout: "event": "initiated", 2023-08-01T19:56:35.123 INFO:teuthology.orchestra.run.smithi155.stdout: "time": "2023-08-01T19:55:05.569750+0000", 2023-08-01T19:56:35.124 INFO:teuthology.orchestra.run.smithi155.stdout: "duration": 0 2023-08-01T19:56:35.124 INFO:teuthology.orchestra.run.smithi155.stdout: }, 2023-08-01T19:56:35.124 INFO:teuthology.orchestra.run.smithi155.stdout: { 2023-08-01T19:56:35.124 INFO:teuthology.orchestra.run.smithi155.stdout: "event": "throttled", 2023-08-01T19:56:35.124 INFO:teuthology.orchestra.run.smithi155.stdout: "time": "2023-08-01T19:55:05.569750+0000", 2023-08-01T19:56:35.124 INFO:teuthology.orchestra.run.smithi155.stdout: "duration": 0 2023-08-01T19:56:35.124 INFO:teuthology.orchestra.run.smithi155.stdout: }, 2023-08-01T19:56:35.124 INFO:teuthology.orchestra.run.smithi155.stdout: { 2023-08-01T19:56:35.125 INFO:teuthology.orchestra.run.smithi155.stdout: "event": "header_read", 2023-08-01T19:56:35.125 INFO:teuthology.orchestra.run.smithi155.stdout: "time": "2023-08-01T19:55:05.569749+0000", 2023-08-01T19:56:35.125 INFO:teuthology.orchestra.run.smithi155.stdout: "duration": 4294967295.999999 2023-08-01T19:56:35.125 INFO:teuthology.orchestra.run.smithi155.stdout: }, 2023-08-01T19:56:35.125 INFO:teuthology.orchestra.run.smithi155.stdout: { 2023-08-01T19:56:35.125 INFO:teuthology.orchestra.run.smithi155.stdout: "event": "all_read", 2023-08-01T19:56:35.125 INFO:teuthology.orchestra.run.smithi155.stdout: "time": "2023-08-01T19:55:05.569861+0000", 2023-08-01T19:56:35.125 INFO:teuthology.orchestra.run.smithi155.stdout: "duration": 0.000111333 2023-08-01T19:56:35.126 INFO:teuthology.orchestra.run.smithi155.stdout: }, 2023-08-01T19:56:35.126 INFO:teuthology.orchestra.run.smithi155.stdout: { 2023-08-01T19:56:35.126 INFO:teuthology.orchestra.run.smithi155.stdout: "event": "dispatched", 2023-08-01T19:56:35.126 INFO:teuthology.orchestra.run.smithi155.stdout: "time": "2023-08-01T19:55:05.569869+0000", 2023-08-01T19:56:35.126 INFO:teuthology.orchestra.run.smithi155.stdout: "duration": 8.8589999999999994e-06 2023-08-01T19:56:35.126 INFO:teuthology.orchestra.run.smithi155.stdout: }, 2023-08-01T19:56:35.126 INFO:teuthology.orchestra.run.smithi155.stdout: { 2023-08-01T19:56:35.126 INFO:teuthology.orchestra.run.smithi155.stdout: "event": "queued_for_pg", 2023-08-01T19:56:35.127 INFO:teuthology.orchestra.run.smithi155.stdout: "time": "2023-08-01T19:55:05.569874+0000", 2023-08-01T19:56:35.127 INFO:teuthology.orchestra.run.smithi155.stdout: "duration": 4.1679999999999997e-06 2023-08-01T19:56:35.127 INFO:teuthology.orchestra.run.smithi155.stdout: }, 2023-08-01T19:56:35.127 INFO:teuthology.orchestra.run.smithi155.stdout: { 2023-08-01T19:56:35.127 INFO:teuthology.orchestra.run.smithi155.stdout: "event": "reached_pg", 2023-08-01T19:56:35.127 INFO:teuthology.orchestra.run.smithi155.stdout: "time": "2023-08-01T19:55:05.569904+0000", 2023-08-01T19:56:35.127 INFO:teuthology.orchestra.run.smithi155.stdout: "duration": 3.0920999999999998e-05 2023-08-01T19:56:35.127 INFO:teuthology.orchestra.run.smithi155.stdout: }, 2023-08-01T19:56:35.128 INFO:teuthology.orchestra.run.smithi155.stdout: { 2023-08-01T19:56:35.128 INFO:teuthology.orchestra.run.smithi155.stdout: "event": "started", 2023-08-01T19:56:35.128 INFO:teuthology.orchestra.run.smithi155.stdout: "time": "2023-08-01T19:55:05.569998+0000", 2023-08-01T19:56:35.128 INFO:teuthology.orchestra.run.smithi155.stdout: "duration": 9.3086999999999998e-05 2023-08-01T19:56:35.128 INFO:teuthology.orchestra.run.smithi155.stdout: }, 2023-08-01T19:56:35.129 INFO:teuthology.orchestra.run.smithi155.stdout: { 2023-08-01T19:56:35.129 INFO:teuthology.orchestra.run.smithi155.stdout: "event": "waiting for subops from 0", 2023-08-01T19:56:35.129 INFO:teuthology.orchestra.run.smithi155.stdout: "time": "2023-08-01T19:55:05.570093+0000", 2023-08-01T19:56:35.129 INFO:teuthology.orchestra.run.smithi155.stdout: "duration": 9.5768999999999997e-05 2023-08-01T19:56:35.129 INFO:teuthology.orchestra.run.smithi155.stdout: }, 2023-08-01T19:56:35.129 INFO:teuthology.orchestra.run.smithi155.stdout: { 2023-08-01T19:56:35.129 INFO:teuthology.orchestra.run.smithi155.stdout: "event": "op_commit", 2023-08-01T19:56:35.130 INFO:teuthology.orchestra.run.smithi155.stdout: "time": "2023-08-01T19:55:05.572839+0000", 2023-08-01T19:56:35.130 INFO:teuthology.orchestra.run.smithi155.stdout: "duration": 0.0027460050000000001 2023-08-01T19:56:35.130 INFO:teuthology.orchestra.run.smithi155.stdout: }, 2023-08-01T19:56:35.130 INFO:teuthology.orchestra.run.smithi155.stdout: { 2023-08-01T19:56:35.130 INFO:teuthology.orchestra.run.smithi155.stdout: "event": "sub_op_commit_rec", 2023-08-01T19:56:35.130 INFO:teuthology.orchestra.run.smithi155.stdout: "time": "2023-08-01T19:55:05.635114+0000", 2023-08-01T19:56:35.130 INFO:teuthology.orchestra.run.smithi155.stdout: "duration": 0.062274297999999999 2023-08-01T19:56:35.131 INFO:teuthology.orchestra.run.smithi155.stdout: }, 2023-08-01T19:56:35.131 INFO:teuthology.orchestra.run.smithi155.stdout: { 2023-08-01T19:56:35.131 INFO:teuthology.orchestra.run.smithi155.stdout: "event": "commit_sent", 2023-08-01T19:56:35.131 INFO:teuthology.orchestra.run.smithi155.stdout: "time": "2023-08-01T19:55:05.635143+0000", 2023-08-01T19:56:35.131 INFO:teuthology.orchestra.run.smithi155.stdout: "duration": 2.9430000000000001e-05 2023-08-01T19:56:35.131 INFO:teuthology.orchestra.run.smithi155.stdout: }, 2023-08-01T19:56:35.131 INFO:teuthology.orchestra.run.smithi155.stdout: { 2023-08-01T19:56:35.131 INFO:teuthology.orchestra.run.smithi155.stdout: "event": "done", 2023-08-01T19:56:35.132 INFO:teuthology.orchestra.run.smithi155.stdout: "time": "2023-08-01T19:55:05.635181+0000", 2023-08-01T19:56:35.132 INFO:teuthology.orchestra.run.smithi155.stdout: "duration": 3.8352000000000001e-05 2023-08-01T19:56:35.132 INFO:teuthology.orchestra.run.smithi155.stdout: } 2023-08-01T19:56:35.132 INFO:teuthology.orchestra.run.smithi155.stdout: ] 2023-08-01T19:56:35.132 INFO:teuthology.orchestra.run.smithi155.stdout: } 2023-08-01T19:56:35.132 INFO:teuthology.orchestra.run.smithi155.stdout: }, 2023-08-01T19:56:35.132 INFO:teuthology.orchestra.run.smithi155.stdout: { 2023-08-01T19:56:35.132 INFO:teuthology.orchestra.run.smithi155.stdout: "description": "osd_op(client.4668.0:100945 5.e 5:73df68dd:::benchmark_data_smithi006_114134_object100944:head [set-alloc-hint object_size 65536 write_size 65536,write 0~65536] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e37)", 2023-08-01T19:56:35.133 INFO:teuthology.orchestra.run.smithi155.stdout: "initiated_at": "2023-08-01T19:55:05.576784+0000", 2023-08-01T19:56:35.133 INFO:teuthology.orchestra.run.smithi155.stdout: "age": 89.409354123, 2023-08-01T19:56:35.133 INFO:teuthology.orchestra.run.smithi155.stdout: "duration": 0.058512994999999998, 2023-08-01T19:56:35.133 INFO:teuthology.orchestra.run.smithi155.stdout: "type_data": { 2023-08-01T19:56:35.133 INFO:teuthology.orchestra.run.smithi155.stdout: "flag_point": "commit sent; apply or cleanup", 2023-08-01T19:56:35.133 INFO:teuthology.orchestra.run.smithi155.stdout: "client_info": { 2023-08-01T19:56:35.133 INFO:teuthology.orchestra.run.smithi155.stdout: "client": "client.4668", 2023-08-01T19:56:35.134 INFO:teuthology.orchestra.run.smithi155.stdout: "client_addr": "172.21.15.6:0/1709472247", 2023-08-01T19:56:35.134 INFO:teuthology.orchestra.run.smithi155.stdout: "tid": 100945 2023-08-01T19:56:35.134 INFO:teuthology.orchestra.run.smithi155.stdout: }, 2023-08-01T19:56:35.134 INFO:teuthology.orchestra.run.smithi155.stdout: "events": [ 2023-08-01T19:56:35.134 INFO:teuthology.orchestra.run.smithi155.stdout: { 2023-08-01T19:56:35.134 INFO:teuthology.orchestra.run.smithi155.stdout: "event": "initiated", 2023-08-01T19:56:35.134 INFO:teuthology.orchestra.run.smithi155.stdout: "time": "2023-08-01T19:55:05.576784+0000", 2023-08-01T19:56:35.134 INFO:teuthology.orchestra.run.smithi155.stdout: "duration": 0 2023-08-01T19:56:35.135 INFO:teuthology.orchestra.run.smithi155.stdout: }, 2023-08-01T19:56:35.135 INFO:teuthology.orchestra.run.smithi155.stdout: { 2023-08-01T19:56:35.135 INFO:teuthology.orchestra.run.smithi155.stdout: "event": "throttled", 2023-08-01T19:56:35.135 INFO:teuthology.orchestra.run.smithi155.stdout: "time": "2023-08-01T19:55:05.576784+0000", 2023-08-01T19:56:35.135 INFO:teuthology.orchestra.run.smithi155.stdout: "duration": 0 2023-08-01T19:56:35.135 INFO:teuthology.orchestra.run.smithi155.stdout: }, 2023-08-01T19:56:35.135 INFO:teuthology.orchestra.run.smithi155.stdout: { 2023-08-01T19:56:35.135 INFO:teuthology.orchestra.run.smithi155.stdout: "event": "header_read", 2023-08-01T19:56:35.136 INFO:teuthology.orchestra.run.smithi155.stdout: "time": "2023-08-01T19:55:05.576783+0000", 2023-08-01T19:56:35.136 INFO:teuthology.orchestra.run.smithi155.stdout: "duration": 4294967295.9999995 2023-08-01T19:56:35.136 INFO:teuthology.orchestra.run.smithi155.stdout: }, 2023-08-01T19:56:35.136 INFO:teuthology.orchestra.run.smithi155.stdout: { 2023-08-01T19:56:35.136 INFO:teuthology.orchestra.run.smithi155.stdout: "event": "all_read", 2023-08-01T19:56:35.136 INFO:teuthology.orchestra.run.smithi155.stdout: "time": "2023-08-01T19:55:05.576807+0000", 2023-08-01T19:56:35.136 INFO:teuthology.orchestra.run.smithi155.stdout: "duration": 2.3651000000000001e-05 2023-08-01T19:56:35.136 INFO:teuthology.orchestra.run.smithi155.stdout: }, 2023-08-01T19:56:35.137 INFO:teuthology.orchestra.run.smithi155.stdout: { 2023-08-01T19:56:35.137 INFO:teuthology.orchestra.run.smithi155.stdout: "event": "dispatched", 2023-08-01T19:56:35.137 INFO:teuthology.orchestra.run.smithi155.stdout: "time": "2023-08-01T19:55:05.576817+0000", 2023-08-01T19:56:35.137 INFO:teuthology.orchestra.run.smithi155.stdout: "duration": 9.9389999999999992e-06 2023-08-01T19:56:35.137 INFO:teuthology.orchestra.run.smithi155.stdout: }, 2023-08-01T19:56:35.137 INFO:teuthology.orchestra.run.smithi155.stdout: { 2023-08-01T19:56:35.137 INFO:teuthology.orchestra.run.smithi155.stdout: "event": "queued_for_pg", 2023-08-01T19:56:35.137 INFO:teuthology.orchestra.run.smithi155.stdout: "time": "2023-08-01T19:55:05.576820+0000", 2023-08-01T19:56:35.138 INFO:teuthology.orchestra.run.smithi155.stdout: "duration": 3.2619999999999999e-06 2023-08-01T19:56:35.138 INFO:teuthology.orchestra.run.smithi155.stdout: }, 2023-08-01T19:56:35.138 INFO:teuthology.orchestra.run.smithi155.stdout: { 2023-08-01T19:56:35.138 INFO:teuthology.orchestra.run.smithi155.stdout: "event": "reached_pg", 2023-08-01T19:56:35.138 INFO:teuthology.orchestra.run.smithi155.stdout: "time": "2023-08-01T19:55:05.576849+0000", 2023-08-01T19:56:35.138 INFO:teuthology.orchestra.run.smithi155.stdout: "duration": 2.8880000000000001e-05 2023-08-01T19:56:35.138 INFO:teuthology.orchestra.run.smithi155.stdout: }, 2023-08-01T19:56:35.138 INFO:teuthology.orchestra.run.smithi155.stdout: { 2023-08-01T19:56:35.139 INFO:teuthology.orchestra.run.smithi155.stdout: "event": "started", 2023-08-01T19:56:35.139 INFO:teuthology.orchestra.run.smithi155.stdout: "time": "2023-08-01T19:55:05.576940+0000", 2023-08-01T19:56:35.139 INFO:teuthology.orchestra.run.smithi155.stdout: "duration": 9.0570999999999997e-05 2023-08-01T19:56:35.139 INFO:teuthology.orchestra.run.smithi155.stdout: }, 2023-08-01T19:56:35.139 INFO:teuthology.orchestra.run.smithi155.stdout: { 2023-08-01T19:56:35.139 INFO:teuthology.orchestra.run.smithi155.stdout: "event": "waiting for subops from 0", 2023-08-01T19:56:35.139 INFO:teuthology.orchestra.run.smithi155.stdout: "time": "2023-08-01T19:55:05.577027+0000", 2023-08-01T19:56:35.140 INFO:teuthology.orchestra.run.smithi155.stdout: "duration": 8.7237999999999994e-05 2023-08-01T19:56:35.140 INFO:teuthology.orchestra.run.smithi155.stdout: }, 2023-08-01T19:56:35.140 INFO:teuthology.orchestra.run.smithi155.stdout: { 2023-08-01T19:56:35.140 INFO:teuthology.orchestra.run.smithi155.stdout: "event": "op_commit", 2023-08-01T19:56:35.140 INFO:teuthology.orchestra.run.smithi155.stdout: "time": "2023-08-01T19:55:05.579624+0000", 2023-08-01T19:56:35.140 INFO:teuthology.orchestra.run.smithi155.stdout: "duration": 0.0025971200000000001 2023-08-01T19:56:35.140 INFO:teuthology.orchestra.run.smithi155.stdout: }, 2023-08-01T19:56:35.140 INFO:teuthology.orchestra.run.smithi155.stdout: { 2023-08-01T19:56:35.141 INFO:teuthology.orchestra.run.smithi155.stdout: "event": "sub_op_commit_rec", 2023-08-01T19:56:35.141 INFO:teuthology.orchestra.run.smithi155.stdout: "time": "2023-08-01T19:55:05.635218+0000", 2023-08-01T19:56:35.141 INFO:teuthology.orchestra.run.smithi155.stdout: "duration": 0.055594487999999997 2023-08-01T19:56:35.141 INFO:teuthology.orchestra.run.smithi155.stdout: }, 2023-08-01T19:56:35.141 INFO:teuthology.orchestra.run.smithi155.stdout: { 2023-08-01T19:56:35.141 INFO:teuthology.orchestra.run.smithi155.stdout: "event": "commit_sent", 2023-08-01T19:56:35.141 INFO:teuthology.orchestra.run.smithi155.stdout: "time": "2023-08-01T19:55:05.635262+0000", 2023-08-01T19:56:35.141 INFO:teuthology.orchestra.run.smithi155.stdout: "duration": 4.3380999999999997e-05 2023-08-01T19:56:35.142 INFO:teuthology.orchestra.run.smithi155.stdout: }, 2023-08-01T19:56:35.142 INFO:teuthology.orchestra.run.smithi155.stdout: { 2023-08-01T19:56:35.142 INFO:teuthology.orchestra.run.smithi155.stdout: "event": "done", 2023-08-01T19:56:35.142 INFO:teuthology.orchestra.run.smithi155.stdout: "time": "2023-08-01T19:55:05.635297+0000", 2023-08-01T19:56:35.142 INFO:teuthology.orchestra.run.smithi155.stdout: "duration": 3.4842000000000003e-05 2023-08-01T19:56:35.142 INFO:teuthology.orchestra.run.smithi155.stdout: } 2023-08-01T19:56:35.142 INFO:teuthology.orchestra.run.smithi155.stdout: ] 2023-08-01T19:56:35.143 INFO:teuthology.orchestra.run.smithi155.stdout: } 2023-08-01T19:56:35.143 INFO:teuthology.orchestra.run.smithi155.stdout: }, 2023-08-01T19:56:35.143 INFO:teuthology.orchestra.run.smithi155.stdout: { 2023-08-01T19:56:35.143 INFO:teuthology.orchestra.run.smithi155.stdout: "description": "osd_op(client.4668.0:100947 5.4 5:23e8fc27:::benchmark_data_smithi006_114134_object100946:head [set-alloc-hint object_size 65536 write_size 65536,write 0~65536] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e37)", 2023-08-01T19:56:35.143 INFO:teuthology.orchestra.run.smithi155.stdout: "initiated_at": "2023-08-01T19:55:05.576840+0000", 2023-08-01T19:56:35.143 INFO:teuthology.orchestra.run.smithi155.stdout: "age": 89.409298067999998, 2023-08-01T19:56:35.143 INFO:teuthology.orchestra.run.smithi155.stdout: "duration": 0.058423127999999998, 2023-08-01T19:56:35.143 INFO:teuthology.orchestra.run.smithi155.stdout: "type_data": { 2023-08-01T19:56:35.144 INFO:teuthology.orchestra.run.smithi155.stdout: "flag_point": "commit sent; apply or cleanup", 2023-08-01T19:56:35.144 INFO:teuthology.orchestra.run.smithi155.stdout: "client_info": { 2023-08-01T19:56:35.144 INFO:teuthology.orchestra.run.smithi155.stdout: "client": "client.4668", 2023-08-01T19:56:35.144 INFO:teuthology.orchestra.run.smithi155.stdout: "client_addr": "172.21.15.6:0/1709472247", 2023-08-01T19:56:35.144 INFO:teuthology.orchestra.run.smithi155.stdout: "tid": 100947 2023-08-01T19:56:35.144 INFO:teuthology.orchestra.run.smithi155.stdout: }, 2023-08-01T19:56:35.144 INFO:teuthology.orchestra.run.smithi155.stdout: "events": [ 2023-08-01T19:56:35.144 INFO:teuthology.orchestra.run.smithi155.stdout: { 2023-08-01T19:56:35.145 INFO:teuthology.orchestra.run.smithi155.stdout: "event": "initiated", 2023-08-01T19:56:35.145 INFO:teuthology.orchestra.run.smithi155.stdout: "time": "2023-08-01T19:55:05.576840+0000", 2023-08-01T19:56:35.145 INFO:teuthology.orchestra.run.smithi155.stdout: "duration": 0 2023-08-01T19:56:35.145 INFO:teuthology.orchestra.run.smithi155.stdout: }, 2023-08-01T19:56:35.145 INFO:teuthology.orchestra.run.smithi155.stdout: { 2023-08-01T19:56:35.145 INFO:teuthology.orchestra.run.smithi155.stdout: "event": "throttled", 2023-08-01T19:56:35.145 INFO:teuthology.orchestra.run.smithi155.stdout: "time": "2023-08-01T19:55:05.576840+0000", 2023-08-01T19:56:35.146 INFO:teuthology.orchestra.run.smithi155.stdout: "duration": 0 2023-08-01T19:56:35.146 INFO:teuthology.orchestra.run.smithi155.stdout: }, 2023-08-01T19:56:35.146 INFO:teuthology.orchestra.run.smithi155.stdout: { 2023-08-01T19:56:35.146 INFO:teuthology.orchestra.run.smithi155.stdout: "event": "header_read", 2023-08-01T19:56:35.146 INFO:teuthology.orchestra.run.smithi155.stdout: "time": "2023-08-01T19:55:05.576839+0000", 2023-08-01T19:56:35.146 INFO:teuthology.orchestra.run.smithi155.stdout: "duration": 4294967295.9999995 2023-08-01T19:56:35.146 INFO:teuthology.orchestra.run.smithi155.stdout: }, 2023-08-01T19:56:35.146 INFO:teuthology.orchestra.run.smithi155.stdout: { 2023-08-01T19:56:35.147 INFO:teuthology.orchestra.run.smithi155.stdout: "event": "all_read", 2023-08-01T19:56:35.147 INFO:teuthology.orchestra.run.smithi155.stdout: "time": "2023-08-01T19:55:05.576893+0000", 2023-08-01T19:56:35.147 INFO:teuthology.orchestra.run.smithi155.stdout: "duration": 5.3893000000000001e-05 2023-08-01T19:56:35.147 INFO:teuthology.orchestra.run.smithi155.stdout: }, 2023-08-01T19:56:35.147 INFO:teuthology.orchestra.run.smithi155.stdout: { 2023-08-01T19:56:35.147 INFO:teuthology.orchestra.run.smithi155.stdout: "event": "dispatched", 2023-08-01T19:56:35.147 INFO:teuthology.orchestra.run.smithi155.stdout: "time": "2023-08-01T19:55:05.576902+0000", 2023-08-01T19:56:35.147 INFO:teuthology.orchestra.run.smithi155.stdout: "duration": 8.7520000000000002e-06 2023-08-01T19:56:35.148 INFO:teuthology.orchestra.run.smithi155.stdout: }, 2023-08-01T19:56:35.148 INFO:teuthology.orchestra.run.smithi155.stdout: { 2023-08-01T19:56:35.148 INFO:teuthology.orchestra.run.smithi155.stdout: "event": "queued_for_pg", 2023-08-01T19:56:35.148 INFO:teuthology.orchestra.run.smithi155.stdout: "time": "2023-08-01T19:55:05.576905+0000", 2023-08-01T19:56:35.148 INFO:teuthology.orchestra.run.smithi155.stdout: "duration": 3.01e-06 2023-08-01T19:56:35.148 INFO:teuthology.orchestra.run.smithi155.stdout: }, 2023-08-01T19:56:35.148 INFO:teuthology.orchestra.run.smithi155.stdout: { 2023-08-01T19:56:35.148 INFO:teuthology.orchestra.run.smithi155.stdout: "event": "reached_pg", 2023-08-01T19:56:35.149 INFO:teuthology.orchestra.run.smithi155.stdout: "time": "2023-08-01T19:55:05.579641+0000", 2023-08-01T19:56:35.149 INFO:teuthology.orchestra.run.smithi155.stdout: "duration": 0.0027366880000000001 2023-08-01T19:56:35.149 INFO:teuthology.orchestra.run.smithi155.stdout: }, 2023-08-01T19:56:35.149 INFO:teuthology.orchestra.run.smithi155.stdout: { 2023-08-01T19:56:35.149 INFO:teuthology.orchestra.run.smithi155.stdout: "event": "started", 2023-08-01T19:56:35.149 INFO:teuthology.orchestra.run.smithi155.stdout: "time": "2023-08-01T19:55:05.579734+0000", 2023-08-01T19:56:35.149 INFO:teuthology.orchestra.run.smithi155.stdout: "duration": 9.2590000000000006e-05 2023-08-01T19:56:35.150 INFO:teuthology.orchestra.run.smithi155.stdout: }, 2023-08-01T19:56:35.150 INFO:teuthology.orchestra.run.smithi155.stdout: { 2023-08-01T19:56:35.150 INFO:teuthology.orchestra.run.smithi155.stdout: "event": "waiting for subops from 0", 2023-08-01T19:56:35.150 INFO:teuthology.orchestra.run.smithi155.stdout: "time": "2023-08-01T19:55:05.579825+0000", 2023-08-01T19:56:35.150 INFO:teuthology.orchestra.run.smithi155.stdout: "duration": 9.0964999999999994e-05 2023-08-01T19:56:35.150 INFO:teuthology.orchestra.run.smithi155.stdout: }, 2023-08-01T19:56:35.150 INFO:teuthology.orchestra.run.smithi155.stdout: { 2023-08-01T19:56:35.150 INFO:teuthology.orchestra.run.smithi155.stdout: "event": "op_commit", 2023-08-01T19:56:35.151 INFO:teuthology.orchestra.run.smithi155.stdout: "time": "2023-08-01T19:55:05.585041+0000", 2023-08-01T19:56:35.151 INFO:teuthology.orchestra.run.smithi155.stdout: "duration": 0.0052159670000000002 2023-08-01T19:56:35.151 INFO:teuthology.orchestra.run.smithi155.stdout: }, 2023-08-01T19:56:35.151 INFO:teuthology.orchestra.run.smithi155.stdout: { 2023-08-01T19:56:35.151 INFO:teuthology.orchestra.run.smithi155.stdout: "event": "sub_op_commit_rec", 2023-08-01T19:56:35.151 INFO:teuthology.orchestra.run.smithi155.stdout: "time": "2023-08-01T19:55:05.635199+0000", 2023-08-01T19:56:35.151 INFO:teuthology.orchestra.run.smithi155.stdout: "duration": 0.050158023000000003 2023-08-01T19:56:35.151 INFO:teuthology.orchestra.run.smithi155.stdout: }, 2023-08-01T19:56:35.152 INFO:teuthology.orchestra.run.smithi155.stdout: { 2023-08-01T19:56:35.152 INFO:teuthology.orchestra.run.smithi155.stdout: "event": "commit_sent", 2023-08-01T19:56:35.152 INFO:teuthology.orchestra.run.smithi155.stdout: "time": "2023-08-01T19:55:05.635227+0000", 2023-08-01T19:56:35.152 INFO:teuthology.orchestra.run.smithi155.stdout: "duration": 2.7821e-05 2023-08-01T19:56:35.152 INFO:teuthology.orchestra.run.smithi155.stdout: }, 2023-08-01T19:56:35.152 INFO:teuthology.orchestra.run.smithi155.stdout: { 2023-08-01T19:56:35.152 INFO:teuthology.orchestra.run.smithi155.stdout: "event": "done", 2023-08-01T19:56:35.153 INFO:teuthology.orchestra.run.smithi155.stdout: "time": "2023-08-01T19:55:05.635263+0000", 2023-08-01T19:56:35.153 INFO:teuthology.orchestra.run.smithi155.stdout: "duration": 3.6081000000000002e-05 2023-08-01T19:56:35.153 INFO:teuthology.orchestra.run.smithi155.stdout: } 2023-08-01T19:56:35.153 INFO:teuthology.orchestra.run.smithi155.stdout: ] 2023-08-01T19:56:35.153 INFO:teuthology.orchestra.run.smithi155.stdout: } 2023-08-01T19:56:35.153 INFO:teuthology.orchestra.run.smithi155.stdout: }, 2023-08-01T19:56:35.153 INFO:teuthology.orchestra.run.smithi155.stdout: { 2023-08-01T19:56:35.153 INFO:teuthology.orchestra.run.smithi155.stdout: "description": "osd_op(client.4668.0:197408 5.d 5:bbda375a:::benchmark_data_smithi006_114134_object63747:head [delete] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e61)", 2023-08-01T19:56:35.154 INFO:teuthology.orchestra.run.smithi155.stdout: "initiated_at": "2023-08-01T19:55:58.559714+0000", 2023-08-01T19:56:35.154 INFO:teuthology.orchestra.run.smithi155.stdout: "age": 36.426424081, 2023-08-01T19:56:35.154 INFO:teuthology.orchestra.run.smithi155.stdout: "duration": 1.047043671, 2023-08-01T19:56:35.154 INFO:teuthology.orchestra.run.smithi155.stdout: "type_data": { 2023-08-01T19:56:35.154 INFO:teuthology.orchestra.run.smithi155.stdout: "flag_point": "commit sent; apply or cleanup", 2023-08-01T19:56:35.154 INFO:teuthology.orchestra.run.smithi155.stdout: "client_info": { 2023-08-01T19:56:35.154 INFO:teuthology.orchestra.run.smithi155.stdout: "client": "client.4668", 2023-08-01T19:56:35.154 INFO:teuthology.orchestra.run.smithi155.stdout: "client_addr": "172.21.15.6:0/1709472247", 2023-08-01T19:56:35.155 INFO:teuthology.orchestra.run.smithi155.stdout: "tid": 197408 2023-08-01T19:56:35.155 INFO:teuthology.orchestra.run.smithi155.stdout: }, 2023-08-01T19:56:35.155 INFO:teuthology.orchestra.run.smithi155.stdout: "events": [ 2023-08-01T19:56:35.155 INFO:teuthology.orchestra.run.smithi155.stdout: { 2023-08-01T19:56:35.155 INFO:teuthology.orchestra.run.smithi155.stdout: "event": "initiated", 2023-08-01T19:56:35.155 INFO:teuthology.orchestra.run.smithi155.stdout: "time": "2023-08-01T19:55:58.559714+0000", 2023-08-01T19:56:35.155 INFO:teuthology.orchestra.run.smithi155.stdout: "duration": 0 2023-08-01T19:56:35.155 INFO:teuthology.orchestra.run.smithi155.stdout: }, 2023-08-01T19:56:35.156 INFO:teuthology.orchestra.run.smithi155.stdout: { 2023-08-01T19:56:35.156 INFO:teuthology.orchestra.run.smithi155.stdout: "event": "throttled", 2023-08-01T19:56:35.156 INFO:teuthology.orchestra.run.smithi155.stdout: "time": "2023-08-01T19:55:58.559714+0000", 2023-08-01T19:56:35.156 INFO:teuthology.orchestra.run.smithi155.stdout: "duration": 0 2023-08-01T19:56:35.156 INFO:teuthology.orchestra.run.smithi155.stdout: }, 2023-08-01T19:56:35.156 INFO:teuthology.orchestra.run.smithi155.stdout: { 2023-08-01T19:56:35.156 INFO:teuthology.orchestra.run.smithi155.stdout: "event": "header_read", 2023-08-01T19:56:35.156 INFO:teuthology.orchestra.run.smithi155.stdout: "time": "2023-08-01T19:55:58.559713+0000", 2023-08-01T19:56:35.157 INFO:teuthology.orchestra.run.smithi155.stdout: "duration": 4294967295.999999 2023-08-01T19:56:35.157 INFO:teuthology.orchestra.run.smithi155.stdout: }, 2023-08-01T19:56:35.157 INFO:teuthology.orchestra.run.smithi155.stdout: { 2023-08-01T19:56:35.157 INFO:teuthology.orchestra.run.smithi155.stdout: "event": "all_read", 2023-08-01T19:56:35.157 INFO:teuthology.orchestra.run.smithi155.stdout: "time": "2023-08-01T19:55:58.559717+0000", 2023-08-01T19:56:35.157 INFO:teuthology.orchestra.run.smithi155.stdout: "duration": 4.2860000000000001e-06 2023-08-01T19:56:35.157 INFO:teuthology.orchestra.run.smithi155.stdout: }, 2023-08-01T19:56:35.158 INFO:teuthology.orchestra.run.smithi155.stdout: { 2023-08-01T19:56:35.158 INFO:teuthology.orchestra.run.smithi155.stdout: "event": "dispatched", 2023-08-01T19:56:35.158 INFO:teuthology.orchestra.run.smithi155.stdout: "time": "2023-08-01T19:55:58.559774+0000", 2023-08-01T19:56:35.158 INFO:teuthology.orchestra.run.smithi155.stdout: "duration": 5.6508999999999997e-05 2023-08-01T19:56:35.158 INFO:teuthology.orchestra.run.smithi155.stdout: }, 2023-08-01T19:56:35.158 INFO:teuthology.orchestra.run.smithi155.stdout: { 2023-08-01T19:56:35.158 INFO:teuthology.orchestra.run.smithi155.stdout: "event": "queued_for_pg", 2023-08-01T19:56:35.158 INFO:teuthology.orchestra.run.smithi155.stdout: "time": "2023-08-01T19:55:58.559781+0000", 2023-08-01T19:56:35.159 INFO:teuthology.orchestra.run.smithi155.stdout: "duration": 7.1829999999999997e-06 2023-08-01T19:56:35.159 INFO:teuthology.orchestra.run.smithi155.stdout: }, 2023-08-01T19:56:35.159 INFO:teuthology.orchestra.run.smithi155.stdout: { 2023-08-01T19:56:35.159 INFO:teuthology.orchestra.run.smithi155.stdout: "event": "reached_pg", 2023-08-01T19:56:35.159 INFO:teuthology.orchestra.run.smithi155.stdout: "time": "2023-08-01T19:55:58.571621+0000", 2023-08-01T19:56:35.159 INFO:teuthology.orchestra.run.smithi155.stdout: "duration": 0.011840603999999999 2023-08-01T19:56:35.159 INFO:teuthology.orchestra.run.smithi155.stdout: }, 2023-08-01T19:56:35.159 INFO:teuthology.orchestra.run.smithi155.stdout: { 2023-08-01T19:56:35.160 INFO:teuthology.orchestra.run.smithi155.stdout: "event": "waiting for peered", 2023-08-01T19:56:35.160 INFO:teuthology.orchestra.run.smithi155.stdout: "time": "2023-08-01T19:55:58.571630+0000", 2023-08-01T19:56:35.160 INFO:teuthology.orchestra.run.smithi155.stdout: "duration": 8.9770000000000006e-06 2023-08-01T19:56:35.160 INFO:teuthology.orchestra.run.smithi155.stdout: }, 2023-08-01T19:56:35.160 INFO:teuthology.orchestra.run.smithi155.stdout: { 2023-08-01T19:56:35.160 INFO:teuthology.orchestra.run.smithi155.stdout: "event": "reached_pg", 2023-08-01T19:56:35.160 INFO:teuthology.orchestra.run.smithi155.stdout: "time": "2023-08-01T19:55:59.601300+0000", 2023-08-01T19:56:35.160 INFO:teuthology.orchestra.run.smithi155.stdout: "duration": 1.0296694989999999 2023-08-01T19:56:35.161 INFO:teuthology.orchestra.run.smithi155.stdout: }, 2023-08-01T19:56:35.161 INFO:teuthology.orchestra.run.smithi155.stdout: { 2023-08-01T19:56:35.161 INFO:teuthology.orchestra.run.smithi155.stdout: "event": "started", 2023-08-01T19:56:35.161 INFO:teuthology.orchestra.run.smithi155.stdout: "time": "2023-08-01T19:55:59.601448+0000", 2023-08-01T19:56:35.161 INFO:teuthology.orchestra.run.smithi155.stdout: "duration": 0.00014828399999999999 2023-08-01T19:56:35.161 INFO:teuthology.orchestra.run.smithi155.stdout: }, 2023-08-01T19:56:35.161 INFO:teuthology.orchestra.run.smithi155.stdout: { 2023-08-01T19:56:35.161 INFO:teuthology.orchestra.run.smithi155.stdout: "event": "op_commit", 2023-08-01T19:56:35.162 INFO:teuthology.orchestra.run.smithi155.stdout: "time": "2023-08-01T19:55:59.606616+0000", 2023-08-01T19:56:35.162 INFO:teuthology.orchestra.run.smithi155.stdout: "duration": 0.0051679769999999998 2023-08-01T19:56:35.162 INFO:teuthology.orchestra.run.smithi155.stdout: }, 2023-08-01T19:56:35.162 INFO:teuthology.orchestra.run.smithi155.stdout: { 2023-08-01T19:56:35.162 INFO:teuthology.orchestra.run.smithi155.stdout: "event": "commit_sent", 2023-08-01T19:56:35.162 INFO:teuthology.orchestra.run.smithi155.stdout: "time": "2023-08-01T19:55:59.606662+0000", 2023-08-01T19:56:35.162 INFO:teuthology.orchestra.run.smithi155.stdout: "duration": 4.5843000000000001e-05 2023-08-01T19:56:35.163 INFO:teuthology.orchestra.run.smithi155.stdout: }, 2023-08-01T19:56:35.163 INFO:teuthology.orchestra.run.smithi155.stdout: { 2023-08-01T19:56:35.163 INFO:teuthology.orchestra.run.smithi155.stdout: "event": "done", 2023-08-01T19:56:35.163 INFO:teuthology.orchestra.run.smithi155.stdout: "time": "2023-08-01T19:55:59.606757+0000", 2023-08-01T19:56:35.163 INFO:teuthology.orchestra.run.smithi155.stdout: "duration": 9.5373999999999999e-05 2023-08-01T19:56:35.163 INFO:teuthology.orchestra.run.smithi155.stdout: } 2023-08-01T19:56:35.163 INFO:teuthology.orchestra.run.smithi155.stdout: ] 2023-08-01T19:56:35.163 INFO:teuthology.orchestra.run.smithi155.stdout: } 2023-08-01T19:56:35.164 INFO:teuthology.orchestra.run.smithi155.stdout: }, 2023-08-01T19:56:35.164 INFO:teuthology.orchestra.run.smithi155.stdout: { 2023-08-01T19:56:35.164 INFO:teuthology.orchestra.run.smithi155.stdout: "description": "osd_op(client.4668.0:197416 5.d 5:bd99e66d:::benchmark_data_smithi006_114134_object63755:head [delete] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e62)", 2023-08-01T19:56:35.164 INFO:teuthology.orchestra.run.smithi155.stdout: "initiated_at": "2023-08-01T19:55:58.577369+0000", 2023-08-01T19:56:35.164 INFO:teuthology.orchestra.run.smithi155.stdout: "age": 36.408769104000001, 2023-08-01T19:56:35.164 INFO:teuthology.orchestra.run.smithi155.stdout: "duration": 1.0300980120000001, 2023-08-01T19:56:35.164 INFO:teuthology.orchestra.run.smithi155.stdout: "type_data": { 2023-08-01T19:56:35.164 INFO:teuthology.orchestra.run.smithi155.stdout: "flag_point": "commit sent; apply or cleanup", 2023-08-01T19:56:35.165 INFO:teuthology.orchestra.run.smithi155.stdout: "client_info": { 2023-08-01T19:56:35.165 INFO:teuthology.orchestra.run.smithi155.stdout: "client": "client.4668", 2023-08-01T19:56:35.165 INFO:teuthology.orchestra.run.smithi155.stdout: "client_addr": "172.21.15.6:0/1709472247", 2023-08-01T19:56:35.165 INFO:teuthology.orchestra.run.smithi155.stdout: "tid": 197416 2023-08-01T19:56:35.165 INFO:teuthology.orchestra.run.smithi155.stdout: }, 2023-08-01T19:56:35.165 INFO:teuthology.orchestra.run.smithi155.stdout: "events": [ 2023-08-01T19:56:35.165 INFO:teuthology.orchestra.run.smithi155.stdout: { 2023-08-01T19:56:35.165 INFO:teuthology.orchestra.run.smithi155.stdout: "event": "initiated", 2023-08-01T19:56:35.166 INFO:teuthology.orchestra.run.smithi155.stdout: "time": "2023-08-01T19:55:58.577369+0000", 2023-08-01T19:56:35.166 INFO:teuthology.orchestra.run.smithi155.stdout: "duration": 0 2023-08-01T19:56:35.166 INFO:teuthology.orchestra.run.smithi155.stdout: }, 2023-08-01T19:56:35.166 INFO:teuthology.orchestra.run.smithi155.stdout: { 2023-08-01T19:56:35.166 INFO:teuthology.orchestra.run.smithi155.stdout: "event": "throttled", 2023-08-01T19:56:35.166 INFO:teuthology.orchestra.run.smithi155.stdout: "time": "2023-08-01T19:55:58.577369+0000", 2023-08-01T19:56:35.166 INFO:teuthology.orchestra.run.smithi155.stdout: "duration": 0 2023-08-01T19:56:35.166 INFO:teuthology.orchestra.run.smithi155.stdout: }, 2023-08-01T19:56:35.167 INFO:teuthology.orchestra.run.smithi155.stdout: { 2023-08-01T19:56:35.167 INFO:teuthology.orchestra.run.smithi155.stdout: "event": "header_read", 2023-08-01T19:56:35.167 INFO:teuthology.orchestra.run.smithi155.stdout: "time": "2023-08-01T19:55:58.577368+0000", 2023-08-01T19:56:35.167 INFO:teuthology.orchestra.run.smithi155.stdout: "duration": 4294967295.9999995 2023-08-01T19:56:35.167 INFO:teuthology.orchestra.run.smithi155.stdout: }, 2023-08-01T19:56:35.167 INFO:teuthology.orchestra.run.smithi155.stdout: { 2023-08-01T19:56:35.167 INFO:teuthology.orchestra.run.smithi155.stdout: "event": "all_read", 2023-08-01T19:56:35.167 INFO:teuthology.orchestra.run.smithi155.stdout: "time": "2023-08-01T19:55:58.577370+0000", 2023-08-01T19:56:35.168 INFO:teuthology.orchestra.run.smithi155.stdout: "duration": 2.1150000000000001e-06 2023-08-01T19:56:35.168 INFO:teuthology.orchestra.run.smithi155.stdout: }, 2023-08-01T19:56:35.168 INFO:teuthology.orchestra.run.smithi155.stdout: { 2023-08-01T19:56:35.168 INFO:teuthology.orchestra.run.smithi155.stdout: "event": "dispatched", 2023-08-01T19:56:35.168 INFO:teuthology.orchestra.run.smithi155.stdout: "time": "2023-08-01T19:55:58.577377+0000", 2023-08-01T19:56:35.168 INFO:teuthology.orchestra.run.smithi155.stdout: "duration": 6.6610000000000003e-06 2023-08-01T19:56:35.168 INFO:teuthology.orchestra.run.smithi155.stdout: }, 2023-08-01T19:56:35.169 INFO:teuthology.orchestra.run.smithi155.stdout: { 2023-08-01T19:56:35.169 INFO:teuthology.orchestra.run.smithi155.stdout: "event": "queued_for_pg", 2023-08-01T19:56:35.169 INFO:teuthology.orchestra.run.smithi155.stdout: "time": "2023-08-01T19:55:58.577380+0000", 2023-08-01T19:56:35.169 INFO:teuthology.orchestra.run.smithi155.stdout: "duration": 2.7360000000000001e-06 2023-08-01T19:56:35.169 INFO:teuthology.orchestra.run.smithi155.stdout: }, 2023-08-01T19:56:35.169 INFO:teuthology.orchestra.run.smithi155.stdout: { 2023-08-01T19:56:35.169 INFO:teuthology.orchestra.run.smithi155.stdout: "event": "reached_pg", 2023-08-01T19:56:35.169 INFO:teuthology.orchestra.run.smithi155.stdout: "time": "2023-08-01T19:55:58.577405+0000", 2023-08-01T19:56:35.170 INFO:teuthology.orchestra.run.smithi155.stdout: "duration": 2.4929000000000001e-05 2023-08-01T19:56:35.170 INFO:teuthology.orchestra.run.smithi155.stdout: }, 2023-08-01T19:56:35.170 INFO:teuthology.orchestra.run.smithi155.stdout: { 2023-08-01T19:56:35.170 INFO:teuthology.orchestra.run.smithi155.stdout: "event": "waiting for peered", 2023-08-01T19:56:35.170 INFO:teuthology.orchestra.run.smithi155.stdout: "time": "2023-08-01T19:55:58.577409+0000", 2023-08-01T19:56:35.170 INFO:teuthology.orchestra.run.smithi155.stdout: "duration": 4.0799999999999999e-06 2023-08-01T19:56:35.170 INFO:teuthology.orchestra.run.smithi155.stdout: }, 2023-08-01T19:56:35.171 INFO:teuthology.orchestra.run.smithi155.stdout: { 2023-08-01T19:56:35.171 INFO:teuthology.orchestra.run.smithi155.stdout: "event": "reached_pg", 2023-08-01T19:56:35.171 INFO:teuthology.orchestra.run.smithi155.stdout: "time": "2023-08-01T19:55:59.603639+0000", 2023-08-01T19:56:35.171 INFO:teuthology.orchestra.run.smithi155.stdout: "duration": 1.0262299349999999 2023-08-01T19:56:35.171 INFO:teuthology.orchestra.run.smithi155.stdout: }, 2023-08-01T19:56:35.171 INFO:teuthology.orchestra.run.smithi155.stdout: { 2023-08-01T19:56:35.171 INFO:teuthology.orchestra.run.smithi155.stdout: "event": "started", 2023-08-01T19:56:35.171 INFO:teuthology.orchestra.run.smithi155.stdout: "time": "2023-08-01T19:55:59.603772+0000", 2023-08-01T19:56:35.172 INFO:teuthology.orchestra.run.smithi155.stdout: "duration": 0.000133153 2023-08-01T19:56:35.172 INFO:teuthology.orchestra.run.smithi155.stdout: }, 2023-08-01T19:56:35.172 INFO:teuthology.orchestra.run.smithi155.stdout: { 2023-08-01T19:56:35.172 INFO:teuthology.orchestra.run.smithi155.stdout: "event": "op_commit", 2023-08-01T19:56:35.172 INFO:teuthology.orchestra.run.smithi155.stdout: "time": "2023-08-01T19:55:59.607354+0000", 2023-08-01T19:56:35.172 INFO:teuthology.orchestra.run.smithi155.stdout: "duration": 0.0035819599999999999 2023-08-01T19:56:35.172 INFO:teuthology.orchestra.run.smithi155.stdout: }, 2023-08-01T19:56:35.172 INFO:teuthology.orchestra.run.smithi155.stdout: { 2023-08-01T19:56:35.173 INFO:teuthology.orchestra.run.smithi155.stdout: "event": "commit_sent", 2023-08-01T19:56:35.173 INFO:teuthology.orchestra.run.smithi155.stdout: "time": "2023-08-01T19:55:59.607396+0000", 2023-08-01T19:56:35.173 INFO:teuthology.orchestra.run.smithi155.stdout: "duration": 4.2423999999999999e-05 2023-08-01T19:56:35.173 INFO:teuthology.orchestra.run.smithi155.stdout: }, 2023-08-01T19:56:35.173 INFO:teuthology.orchestra.run.smithi155.stdout: { 2023-08-01T19:56:35.173 INFO:teuthology.orchestra.run.smithi155.stdout: "event": "done", 2023-08-01T19:56:35.173 INFO:teuthology.orchestra.run.smithi155.stdout: "time": "2023-08-01T19:55:59.607467+0000", 2023-08-01T19:56:35.174 INFO:teuthology.orchestra.run.smithi155.stdout: "duration": 7.0360999999999999e-05 2023-08-01T19:56:35.174 INFO:teuthology.orchestra.run.smithi155.stdout: } 2023-08-01T19:56:35.174 INFO:teuthology.orchestra.run.smithi155.stdout: ] 2023-08-01T19:56:35.174 INFO:teuthology.orchestra.run.smithi155.stdout: } 2023-08-01T19:56:35.174 INFO:teuthology.orchestra.run.smithi155.stdout: }, 2023-08-01T19:56:35.174 INFO:teuthology.orchestra.run.smithi155.stdout: { 2023-08-01T19:56:35.174 INFO:teuthology.orchestra.run.smithi155.stdout: "description": "osd_op(client.4668.0:197419 5.d 5:be7dc7c9:::benchmark_data_smithi006_114134_object63758:head [delete] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e62)", 2023-08-01T19:56:35.174 INFO:teuthology.orchestra.run.smithi155.stdout: "initiated_at": "2023-08-01T19:55:58.580223+0000", 2023-08-01T19:56:35.175 INFO:teuthology.orchestra.run.smithi155.stdout: "age": 36.405915153000002, 2023-08-01T19:56:35.175 INFO:teuthology.orchestra.run.smithi155.stdout: "duration": 1.0286139439999999, 2023-08-01T19:56:35.175 INFO:teuthology.orchestra.run.smithi155.stdout: "type_data": { 2023-08-01T19:56:35.175 INFO:teuthology.orchestra.run.smithi155.stdout: "flag_point": "commit sent; apply or cleanup", 2023-08-01T19:56:35.175 INFO:teuthology.orchestra.run.smithi155.stdout: "client_info": { 2023-08-01T19:56:35.175 INFO:teuthology.orchestra.run.smithi155.stdout: "client": "client.4668", 2023-08-01T19:56:35.175 INFO:teuthology.orchestra.run.smithi155.stdout: "client_addr": "172.21.15.6:0/1709472247", 2023-08-01T19:56:35.175 INFO:teuthology.orchestra.run.smithi155.stdout: "tid": 197419 2023-08-01T19:56:35.176 INFO:teuthology.orchestra.run.smithi155.stdout: }, 2023-08-01T19:56:35.176 INFO:teuthology.orchestra.run.smithi155.stdout: "events": [ 2023-08-01T19:56:35.176 INFO:teuthology.orchestra.run.smithi155.stdout: { 2023-08-01T19:56:35.176 INFO:teuthology.orchestra.run.smithi155.stdout: "event": "initiated", 2023-08-01T19:56:35.176 INFO:teuthology.orchestra.run.smithi155.stdout: "time": "2023-08-01T19:55:58.580223+0000", 2023-08-01T19:56:35.176 INFO:teuthology.orchestra.run.smithi155.stdout: "duration": 0 2023-08-01T19:56:35.176 INFO:teuthology.orchestra.run.smithi155.stdout: }, 2023-08-01T19:56:35.176 INFO:teuthology.orchestra.run.smithi155.stdout: { 2023-08-01T19:56:35.177 INFO:teuthology.orchestra.run.smithi155.stdout: "event": "throttled", 2023-08-01T19:56:35.177 INFO:teuthology.orchestra.run.smithi155.stdout: "time": "2023-08-01T19:55:58.580223+0000", 2023-08-01T19:56:35.177 INFO:teuthology.orchestra.run.smithi155.stdout: "duration": 0 2023-08-01T19:56:35.177 INFO:teuthology.orchestra.run.smithi155.stdout: }, 2023-08-01T19:56:35.177 INFO:teuthology.orchestra.run.smithi155.stdout: { 2023-08-01T19:56:35.177 INFO:teuthology.orchestra.run.smithi155.stdout: "event": "header_read", 2023-08-01T19:56:35.177 INFO:teuthology.orchestra.run.smithi155.stdout: "time": "2023-08-01T19:55:58.580222+0000", 2023-08-01T19:56:35.177 INFO:teuthology.orchestra.run.smithi155.stdout: "duration": 4294967295.9999995 2023-08-01T19:56:35.178 INFO:teuthology.orchestra.run.smithi155.stdout: }, 2023-08-01T19:56:35.178 INFO:teuthology.orchestra.run.smithi155.stdout: { 2023-08-01T19:56:35.178 INFO:teuthology.orchestra.run.smithi155.stdout: "event": "all_read", 2023-08-01T19:56:35.178 INFO:teuthology.orchestra.run.smithi155.stdout: "time": "2023-08-01T19:55:58.580225+0000", 2023-08-01T19:56:35.178 INFO:teuthology.orchestra.run.smithi155.stdout: "duration": 3.2820000000000001e-06 2023-08-01T19:56:35.178 INFO:teuthology.orchestra.run.smithi155.stdout: }, 2023-08-01T19:56:35.178 INFO:teuthology.orchestra.run.smithi155.stdout: { 2023-08-01T19:56:35.178 INFO:teuthology.orchestra.run.smithi155.stdout: "event": "dispatched", 2023-08-01T19:56:35.179 INFO:teuthology.orchestra.run.smithi155.stdout: "time": "2023-08-01T19:55:58.580233+0000", 2023-08-01T19:56:35.179 INFO:teuthology.orchestra.run.smithi155.stdout: "duration": 7.34e-06 2023-08-01T19:56:35.179 INFO:teuthology.orchestra.run.smithi155.stdout: }, 2023-08-01T19:56:35.179 INFO:teuthology.orchestra.run.smithi155.stdout: { 2023-08-01T19:56:35.179 INFO:teuthology.orchestra.run.smithi155.stdout: "event": "queued_for_pg", 2023-08-01T19:56:35.179 INFO:teuthology.orchestra.run.smithi155.stdout: "time": "2023-08-01T19:55:58.580236+0000", 2023-08-01T19:56:35.179 INFO:teuthology.orchestra.run.smithi155.stdout: "duration": 3.473e-06 2023-08-01T19:56:35.180 INFO:teuthology.orchestra.run.smithi155.stdout: }, 2023-08-01T19:56:35.180 INFO:teuthology.orchestra.run.smithi155.stdout: { 2023-08-01T19:56:35.180 INFO:teuthology.orchestra.run.smithi155.stdout: "event": "reached_pg", 2023-08-01T19:56:35.180 INFO:teuthology.orchestra.run.smithi155.stdout: "time": "2023-08-01T19:55:58.580267+0000", 2023-08-01T19:56:35.180 INFO:teuthology.orchestra.run.smithi155.stdout: "duration": 3.0479000000000001e-05 2023-08-01T19:56:35.180 INFO:teuthology.orchestra.run.smithi155.stdout: }, 2023-08-01T19:56:35.180 INFO:teuthology.orchestra.run.smithi155.stdout: { 2023-08-01T19:56:35.180 INFO:teuthology.orchestra.run.smithi155.stdout: "event": "waiting for peered", 2023-08-01T19:56:35.181 INFO:teuthology.orchestra.run.smithi155.stdout: "time": "2023-08-01T19:55:58.580272+0000", 2023-08-01T19:56:35.181 INFO:teuthology.orchestra.run.smithi155.stdout: "duration": 5.011e-06 2023-08-01T19:56:35.181 INFO:teuthology.orchestra.run.smithi155.stdout: }, 2023-08-01T19:56:35.181 INFO:teuthology.orchestra.run.smithi155.stdout: { 2023-08-01T19:56:35.181 INFO:teuthology.orchestra.run.smithi155.stdout: "event": "reached_pg", 2023-08-01T19:56:35.181 INFO:teuthology.orchestra.run.smithi155.stdout: "time": "2023-08-01T19:55:59.604970+0000", 2023-08-01T19:56:35.181 INFO:teuthology.orchestra.run.smithi155.stdout: "duration": 1.0246984189999999 2023-08-01T19:56:35.181 INFO:teuthology.orchestra.run.smithi155.stdout: }, 2023-08-01T19:56:35.182 INFO:teuthology.orchestra.run.smithi155.stdout: { 2023-08-01T19:56:35.182 INFO:teuthology.orchestra.run.smithi155.stdout: "event": "started", 2023-08-01T19:56:35.182 INFO:teuthology.orchestra.run.smithi155.stdout: "time": "2023-08-01T19:55:59.605085+0000", 2023-08-01T19:56:35.182 INFO:teuthology.orchestra.run.smithi155.stdout: "duration": 0.00011531000000000001 2023-08-01T19:56:35.182 INFO:teuthology.orchestra.run.smithi155.stdout: }, 2023-08-01T19:56:35.182 INFO:teuthology.orchestra.run.smithi155.stdout: { 2023-08-01T19:56:35.182 INFO:teuthology.orchestra.run.smithi155.stdout: "event": "op_commit", 2023-08-01T19:56:35.182 INFO:teuthology.orchestra.run.smithi155.stdout: "time": "2023-08-01T19:55:59.608733+0000", 2023-08-01T19:56:35.183 INFO:teuthology.orchestra.run.smithi155.stdout: "duration": 0.0036478090000000001 2023-08-01T19:56:35.183 INFO:teuthology.orchestra.run.smithi155.stdout: }, 2023-08-01T19:56:35.183 INFO:teuthology.orchestra.run.smithi155.stdout: { 2023-08-01T19:56:35.183 INFO:teuthology.orchestra.run.smithi155.stdout: "event": "commit_sent", 2023-08-01T19:56:35.183 INFO:teuthology.orchestra.run.smithi155.stdout: "time": "2023-08-01T19:55:59.608771+0000", 2023-08-01T19:56:35.183 INFO:teuthology.orchestra.run.smithi155.stdout: "duration": 3.8033e-05 2023-08-01T19:56:35.183 INFO:teuthology.orchestra.run.smithi155.stdout: }, 2023-08-01T19:56:35.183 INFO:teuthology.orchestra.run.smithi155.stdout: { 2023-08-01T19:56:35.184 INFO:teuthology.orchestra.run.smithi155.stdout: "event": "done", 2023-08-01T19:56:35.184 INFO:teuthology.orchestra.run.smithi155.stdout: "time": "2023-08-01T19:55:59.608837+0000", 2023-08-01T19:56:35.184 INFO:teuthology.orchestra.run.smithi155.stdout: "duration": 6.5364000000000006e-05 2023-08-01T19:56:35.184 INFO:teuthology.orchestra.run.smithi155.stdout: } 2023-08-01T19:56:35.184 INFO:teuthology.orchestra.run.smithi155.stdout: ] 2023-08-01T19:56:35.184 INFO:teuthology.orchestra.run.smithi155.stdout: } 2023-08-01T19:56:35.184 INFO:teuthology.orchestra.run.smithi155.stdout: }, 2023-08-01T19:56:35.185 INFO:teuthology.orchestra.run.smithi155.stdout: { 2023-08-01T19:56:35.185 INFO:teuthology.orchestra.run.smithi155.stdout: "description": "osd_op(client.4668.0:197420 5.9 5:92a2efe5:::benchmark_data_smithi006_114134_object63759:head [delete] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e62)", 2023-08-01T19:56:35.185 INFO:teuthology.orchestra.run.smithi155.stdout: "initiated_at": "2023-08-01T19:55:58.582230+0000", 2023-08-01T19:56:35.185 INFO:teuthology.orchestra.run.smithi155.stdout: "age": 36.403907842999999, 2023-08-01T19:56:35.185 INFO:teuthology.orchestra.run.smithi155.stdout: "duration": 1.0095353739999999, 2023-08-01T19:56:35.185 INFO:teuthology.orchestra.run.smithi155.stdout: "type_data": { 2023-08-01T19:56:35.185 INFO:teuthology.orchestra.run.smithi155.stdout: "flag_point": "commit sent; apply or cleanup", 2023-08-01T19:56:35.185 INFO:teuthology.orchestra.run.smithi155.stdout: "client_info": { 2023-08-01T19:56:35.186 INFO:teuthology.orchestra.run.smithi155.stdout: "client": "client.4668", 2023-08-01T19:56:35.186 INFO:teuthology.orchestra.run.smithi155.stdout: "client_addr": "172.21.15.6:0/1709472247", 2023-08-01T19:56:35.186 INFO:teuthology.orchestra.run.smithi155.stdout: "tid": 197420 2023-08-01T19:56:35.186 INFO:teuthology.orchestra.run.smithi155.stdout: }, 2023-08-01T19:56:35.186 INFO:teuthology.orchestra.run.smithi155.stdout: "events": [ 2023-08-01T19:56:35.186 INFO:teuthology.orchestra.run.smithi155.stdout: { 2023-08-01T19:56:35.186 INFO:teuthology.orchestra.run.smithi155.stdout: "event": "initiated", 2023-08-01T19:56:35.186 INFO:teuthology.orchestra.run.smithi155.stdout: "time": "2023-08-01T19:55:58.582230+0000", 2023-08-01T19:56:35.187 INFO:teuthology.orchestra.run.smithi155.stdout: "duration": 0 2023-08-01T19:56:35.187 INFO:teuthology.orchestra.run.smithi155.stdout: }, 2023-08-01T19:56:35.187 INFO:teuthology.orchestra.run.smithi155.stdout: { 2023-08-01T19:56:35.187 INFO:teuthology.orchestra.run.smithi155.stdout: "event": "throttled", 2023-08-01T19:56:35.187 INFO:teuthology.orchestra.run.smithi155.stdout: "time": "2023-08-01T19:55:58.582230+0000", 2023-08-01T19:56:35.187 INFO:teuthology.orchestra.run.smithi155.stdout: "duration": 0 2023-08-01T19:56:35.187 INFO:teuthology.orchestra.run.smithi155.stdout: }, 2023-08-01T19:56:35.187 INFO:teuthology.orchestra.run.smithi155.stdout: { 2023-08-01T19:56:35.188 INFO:teuthology.orchestra.run.smithi155.stdout: "event": "header_read", 2023-08-01T19:56:35.188 INFO:teuthology.orchestra.run.smithi155.stdout: "time": "2023-08-01T19:55:58.582229+0000", 2023-08-01T19:56:35.188 INFO:teuthology.orchestra.run.smithi155.stdout: "duration": 4294967295.9999995 2023-08-01T19:56:35.188 INFO:teuthology.orchestra.run.smithi155.stdout: }, 2023-08-01T19:56:35.188 INFO:teuthology.orchestra.run.smithi155.stdout: { 2023-08-01T19:56:35.188 INFO:teuthology.orchestra.run.smithi155.stdout: "event": "all_read", 2023-08-01T19:56:35.188 INFO:teuthology.orchestra.run.smithi155.stdout: "time": "2023-08-01T19:55:58.582233+0000", 2023-08-01T19:56:35.189 INFO:teuthology.orchestra.run.smithi155.stdout: "duration": 3.7869999999999999e-06 2023-08-01T19:56:35.189 INFO:teuthology.orchestra.run.smithi155.stdout: }, 2023-08-01T19:56:35.189 INFO:teuthology.orchestra.run.smithi155.stdout: { 2023-08-01T19:56:35.189 INFO:teuthology.orchestra.run.smithi155.stdout: "event": "dispatched", 2023-08-01T19:56:35.189 INFO:teuthology.orchestra.run.smithi155.stdout: "time": "2023-08-01T19:55:58.582241+0000", 2023-08-01T19:56:35.189 INFO:teuthology.orchestra.run.smithi155.stdout: "duration": 7.6909999999999997e-06 2023-08-01T19:56:35.189 INFO:teuthology.orchestra.run.smithi155.stdout: }, 2023-08-01T19:56:35.189 INFO:teuthology.orchestra.run.smithi155.stdout: { 2023-08-01T19:56:35.190 INFO:teuthology.orchestra.run.smithi155.stdout: "event": "queued_for_pg", 2023-08-01T19:56:35.190 INFO:teuthology.orchestra.run.smithi155.stdout: "time": "2023-08-01T19:55:58.582244+0000", 2023-08-01T19:56:35.190 INFO:teuthology.orchestra.run.smithi155.stdout: "duration": 3.6770000000000001e-06 2023-08-01T19:56:35.190 INFO:teuthology.orchestra.run.smithi155.stdout: }, 2023-08-01T19:56:35.190 INFO:teuthology.orchestra.run.smithi155.stdout: { 2023-08-01T19:56:35.190 INFO:teuthology.orchestra.run.smithi155.stdout: "event": "reached_pg", 2023-08-01T19:56:35.190 INFO:teuthology.orchestra.run.smithi155.stdout: "time": "2023-08-01T19:55:58.582274+0000", 2023-08-01T19:56:35.190 INFO:teuthology.orchestra.run.smithi155.stdout: "duration": 3.0074e-05 2023-08-01T19:56:35.191 INFO:teuthology.orchestra.run.smithi155.stdout: }, 2023-08-01T19:56:35.191 INFO:teuthology.orchestra.run.smithi155.stdout: { 2023-08-01T19:56:35.191 INFO:teuthology.orchestra.run.smithi155.stdout: "event": "waiting for peered", 2023-08-01T19:56:35.191 INFO:teuthology.orchestra.run.smithi155.stdout: "time": "2023-08-01T19:55:58.582281+0000", 2023-08-01T19:56:35.191 INFO:teuthology.orchestra.run.smithi155.stdout: "duration": 6.297e-06 2023-08-01T19:56:35.191 INFO:teuthology.orchestra.run.smithi155.stdout: }, 2023-08-01T19:56:35.191 INFO:teuthology.orchestra.run.smithi155.stdout: { 2023-08-01T19:56:35.191 INFO:teuthology.orchestra.run.smithi155.stdout: "event": "reached_pg", 2023-08-01T19:56:35.192 INFO:teuthology.orchestra.run.smithi155.stdout: "time": "2023-08-01T19:55:59.586809+0000", 2023-08-01T19:56:35.192 INFO:teuthology.orchestra.run.smithi155.stdout: "duration": 1.0045281720000001 2023-08-01T19:56:35.192 INFO:teuthology.orchestra.run.smithi155.stdout: }, 2023-08-01T19:56:35.192 INFO:teuthology.orchestra.run.smithi155.stdout: { 2023-08-01T19:56:35.192 INFO:teuthology.orchestra.run.smithi155.stdout: "event": "started", 2023-08-01T19:56:35.192 INFO:teuthology.orchestra.run.smithi155.stdout: "time": "2023-08-01T19:55:59.586910+0000", 2023-08-01T19:56:35.192 INFO:teuthology.orchestra.run.smithi155.stdout: "duration": 0.000100898 2023-08-01T19:56:35.193 INFO:teuthology.orchestra.run.smithi155.stdout: }, 2023-08-01T19:56:35.193 INFO:teuthology.orchestra.run.smithi155.stdout: { 2023-08-01T19:56:35.193 INFO:teuthology.orchestra.run.smithi155.stdout: "event": "op_commit", 2023-08-01T19:56:35.193 INFO:teuthology.orchestra.run.smithi155.stdout: "time": "2023-08-01T19:55:59.591679+0000", 2023-08-01T19:56:35.193 INFO:teuthology.orchestra.run.smithi155.stdout: "duration": 0.004769471 2023-08-01T19:56:35.193 INFO:teuthology.orchestra.run.smithi155.stdout: }, 2023-08-01T19:56:35.193 INFO:teuthology.orchestra.run.smithi155.stdout: { 2023-08-01T19:56:35.193 INFO:teuthology.orchestra.run.smithi155.stdout: "event": "commit_sent", 2023-08-01T19:56:35.194 INFO:teuthology.orchestra.run.smithi155.stdout: "time": "2023-08-01T19:55:59.591721+0000", 2023-08-01T19:56:35.194 INFO:teuthology.orchestra.run.smithi155.stdout: "duration": 4.1953000000000003e-05 2023-08-01T19:56:35.194 INFO:teuthology.orchestra.run.smithi155.stdout: }, 2023-08-01T19:56:35.194 INFO:teuthology.orchestra.run.smithi155.stdout: { 2023-08-01T19:56:35.194 INFO:teuthology.orchestra.run.smithi155.stdout: "event": "done", 2023-08-01T19:56:35.194 INFO:teuthology.orchestra.run.smithi155.stdout: "time": "2023-08-01T19:55:59.591765+0000", 2023-08-01T19:56:35.194 INFO:teuthology.orchestra.run.smithi155.stdout: "duration": 4.4030999999999999e-05 2023-08-01T19:56:35.194 INFO:teuthology.orchestra.run.smithi155.stdout: } 2023-08-01T19:56:35.195 INFO:teuthology.orchestra.run.smithi155.stdout: ] 2023-08-01T19:56:35.195 INFO:teuthology.orchestra.run.smithi155.stdout: } 2023-08-01T19:56:35.195 INFO:teuthology.orchestra.run.smithi155.stdout: } 2023-08-01T19:56:35.195 INFO:teuthology.orchestra.run.smithi155.stdout: ] 2023-08-01T19:56:35.195 INFO:teuthology.orchestra.run.smithi155.stdout:} 2023-08-01T19:56:35.196 DEBUG:teuthology.orchestra.run.smithi006:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 120 ceph --cluster ceph osd set nodeep-scrub 2023-08-01T19:56:35.197 INFO:tasks.ceph.osd.0.smithi008.stderr:2023-08-01T19:56:35.196+0000 7f16a58f4700 -1 received signal: Hangup from /usr/bin/python3 /bin/daemon-helper kill ceph-osd -f --cluster ceph -i 0 (PID: 111179) UID: 0 2023-08-01T19:56:35.198 DEBUG:teuthology.orchestra.run.smithi008:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 30 ceph --cluster ceph --admin-daemon /var/run/ceph/ceph-osd.0.asok dump_ops_in_flight 2023-08-01T19:56:35.220 DEBUG:teuthology.orchestra.run.smithi006:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 120 ceph --cluster ceph -- tell 'osd.*' injectargs --osd_enable_op_tracker=false 2023-08-01T19:56:35.297 INFO:tasks.ceph.osd.0.smithi008.stderr:2023-08-01T19:56:35.296+0000 7f16a58f4700 -1 received signal: Hangup from /usr/bin/python3 /bin/daemon-helper kill ceph-osd -f --cluster ceph -i 0 (PID: 111179) UID: 0 2023-08-01T19:56:35.335 INFO:teuthology.orchestra.run.smithi008.stdout:{ 2023-08-01T19:56:35.335 INFO:teuthology.orchestra.run.smithi008.stdout: "ops": [], 2023-08-01T19:56:35.335 INFO:teuthology.orchestra.run.smithi008.stdout: "num_ops": 0 2023-08-01T19:56:35.335 INFO:teuthology.orchestra.run.smithi008.stdout:} 2023-08-01T19:56:35.345 DEBUG:teuthology.orchestra.run.smithi008:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 30 ceph --cluster ceph --admin-daemon /var/run/ceph/ceph-osd.0.asok dump_blocked_ops 2023-08-01T19:56:35.397 INFO:teuthology.orchestra.run.smithi006.stdout:osd.0: {} 2023-08-01T19:56:35.417 INFO:teuthology.orchestra.run.smithi006.stdout:osd.2: {} 2023-08-01T19:56:35.417 INFO:teuthology.orchestra.run.smithi006.stderr:osd.0: osd_enable_op_tracker = 'false' 2023-08-01T19:56:35.417 INFO:teuthology.orchestra.run.smithi006.stderr:Error ENXIO: problem getting command descriptions from osd.1 2023-08-01T19:56:35.418 INFO:teuthology.orchestra.run.smithi006.stderr:osd.2: osd_enable_op_tracker = 'false' 2023-08-01T19:56:35.420 DEBUG:teuthology.orchestra.run:got remote process result: 6 2023-08-01T19:56:35.420 INFO:tasks.thrashosds.thrasher:Failed to tell all osds, ignoring 2023-08-01T19:56:35.427 INFO:tasks.ceph.osd.0.smithi008.stderr:2023-08-01T19:56:35.427+0000 7f16a58f4700 -1 received signal: Hangup from /usr/bin/python3 /bin/daemon-helper kill ceph-osd -f --cluster ceph -i 0 (PID: 111179) UID: 0 2023-08-01T19:56:35.498 INFO:tasks.ceph.osd.0.smithi008.stderr:2023-08-01T19:56:35.498+0000 7f16a58f4700 -1 received signal: Hangup from /usr/bin/python3 /bin/daemon-helper kill ceph-osd -f --cluster ceph -i 0 (PID: 111179) UID: 0 2023-08-01T19:56:35.512 INFO:teuthology.orchestra.run.smithi008.stdout:ERROR: (22) Invalid argument 2023-08-01T19:56:35.512 INFO:teuthology.orchestra.run.smithi008.stdout:op_tracker tracking is not enabled now, so no ops are tracked currently, even those get stuck. Please enable "osd_enable_op_tracker", and the tracker will start to track new ops received afterwards. 2023-08-01T19:56:35.522 DEBUG:teuthology.orchestra.run.smithi008:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 30 ceph --cluster ceph --admin-daemon /var/run/ceph/ceph-osd.0.asok dump_historic_ops 2023-08-01T19:56:35.600 INFO:tasks.ceph.osd.2.smithi155.stderr:2023-08-01T19:56:35.598+0000 7faa5c6ac700 -1 received signal: Hangup from /usr/bin/python3 /bin/daemon-helper kill ceph-osd -f --cluster ceph -i 2 (PID: 111337) UID: 0 2023-08-01T19:56:35.691 INFO:teuthology.orchestra.run.smithi008.stdout:ERROR: (22) Invalid argument 2023-08-01T19:56:35.691 INFO:teuthology.orchestra.run.smithi008.stdout:op_tracker tracking is not enabled now, so no ops are tracked currently, even those get stuck. Please enable "osd_enable_op_tracker", and the tracker will start to track new ops received afterwards. 2023-08-01T19:56:35.700 INFO:tasks.ceph.osd.2.smithi155.stderr:2023-08-01T19:56:35.699+0000 7faa5c6ac700 -1 received signal: Hangup from /usr/bin/python3 /bin/daemon-helper kill ceph-osd -f --cluster ceph -i 2 (PID: 111337) UID: 0 2023-08-01T19:56:35.701 DEBUG:teuthology.orchestra.run.smithi155:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 30 ceph --cluster ceph --admin-daemon /var/run/ceph/ceph-osd.2.asok dump_ops_in_flight 2023-08-01T19:56:35.801 INFO:tasks.ceph.osd.2.smithi155.stderr:2023-08-01T19:56:35.800+0000 7faa5c6ac700 -1 received signal: Hangup from /usr/bin/python3 /bin/daemon-helper kill ceph-osd -f --cluster ceph -i 2 (PID: 111337) UID: 0 2023-08-01T19:56:35.829 INFO:teuthology.orchestra.run.smithi155.stdout:ERROR: (22) Invalid argument 2023-08-01T19:56:35.830 INFO:teuthology.orchestra.run.smithi155.stdout:op_tracker tracking is not enabled now, so no ops are tracked currently, even those get stuck. Please enable "osd_enable_op_tracker", and the tracker will start to track new ops received afterwards. 2023-08-01T19:56:35.839 DEBUG:teuthology.orchestra.run.smithi155:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 30 ceph --cluster ceph --admin-daemon /var/run/ceph/ceph-osd.2.asok dump_blocked_ops 2023-08-01T19:56:35.923 INFO:tasks.ceph.osd.2.smithi155.stderr:2023-08-01T19:56:35.921+0000 7faa5c6ac700 -1 received signal: Hangup from /usr/bin/python3 /bin/daemon-helper kill ceph-osd -f --cluster ceph -i 2 (PID: 111337) UID: 0 2023-08-01T19:56:36.003 INFO:teuthology.orchestra.run.smithi155.stdout:ERROR: (22) Invalid argument 2023-08-01T19:56:36.003 INFO:teuthology.orchestra.run.smithi155.stdout:op_tracker tracking is not enabled now, so no ops are tracked currently, even those get stuck. Please enable "osd_enable_op_tracker", and the tracker will start to track new ops received afterwards. 2023-08-01T19:56:36.003 INFO:tasks.ceph.osd.0.smithi008.stderr:2023-08-01T19:56:36.002+0000 7f16a58f4700 -1 received signal: Hangup from /usr/bin/python3 /bin/daemon-helper kill ceph-osd -f --cluster ceph -i 0 (PID: 111179) UID: 0 2023-08-01T19:56:36.012 DEBUG:teuthology.orchestra.run.smithi155:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 30 ceph --cluster ceph --admin-daemon /var/run/ceph/ceph-osd.2.asok dump_historic_ops 2023-08-01T19:56:36.103 INFO:tasks.ceph.osd.0.smithi008.stderr:2023-08-01T19:56:36.103+0000 7f16a58f4700 -1 received signal: Hangup from /usr/bin/python3 /bin/daemon-helper kill ceph-osd -f --cluster ceph -i 0 (PID: 111179) UID: 0 2023-08-01T19:56:36.176 INFO:teuthology.orchestra.run.smithi155.stdout:ERROR: (22) Invalid argument 2023-08-01T19:56:36.176 INFO:teuthology.orchestra.run.smithi155.stdout:op_tracker tracking is not enabled now, so no ops are tracked currently, even those get stuck. Please enable "osd_enable_op_tracker", and the tracker will start to track new ops received afterwards. 2023-08-01T19:56:36.186 DEBUG:teuthology.orchestra.run.smithi008:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 30 ceph --cluster ceph --admin-daemon /var/run/ceph/ceph-osd.0.asok dump_ops_in_flight 2023-08-01T19:56:36.204 INFO:tasks.ceph.osd.2.smithi155.stderr:2023-08-01T19:56:36.203+0000 7faa5c6ac700 -1 received signal: Hangup from /usr/bin/python3 /bin/daemon-helper kill ceph-osd -f --cluster ceph -i 2 (PID: 111337) UID: 0 2023-08-01T19:56:36.250 DEBUG:teuthology.orchestra.console.smithi101:pexpect command: ipmitool -H smithi101.ipmi.sepia.ceph.com -I lanplus -U inktank -P ApGNXcA7 power status 2023-08-01T19:56:36.306 INFO:tasks.ceph.osd.0.smithi008.stderr:2023-08-01T19:56:36.305+0000 7f16a58f4700 -1 received signal: Hangup from /usr/bin/python3 /bin/daemon-helper kill ceph-osd -f --cluster ceph -i 0 (PID: 111179) UID: 0 2023-08-01T19:56:36.317 INFO:teuthology.orchestra.run.smithi008.stdout:ERROR: (22) Invalid argument 2023-08-01T19:56:36.317 INFO:teuthology.orchestra.run.smithi008.stdout:op_tracker tracking is not enabled now, so no ops are tracked currently, even those get stuck. Please enable "osd_enable_op_tracker", and the tracker will start to track new ops received afterwards. 2023-08-01T19:56:36.327 DEBUG:teuthology.orchestra.run.smithi008:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 30 ceph --cluster ceph --admin-daemon /var/run/ceph/ceph-osd.0.asok dump_blocked_ops 2023-08-01T19:56:36.361 DEBUG:teuthology.orchestra.console.smithi101:check power output: Chassis Power is off 2023-08-01T19:56:36.407 INFO:tasks.ceph.osd.2.smithi155.stderr:2023-08-01T19:56:36.405+0000 7faa5c6ac700 -1 received signal: Hangup from /usr/bin/python3 /bin/daemon-helper kill ceph-osd -f --cluster ceph -i 2 (PID: 111337) UID: 0 2023-08-01T19:56:36.442 INFO:teuthology.orchestra.run.smithi006.stderr:nodeep-scrub is set 2023-08-01T19:56:36.496 INFO:teuthology.orchestra.run.smithi008.stdout:ERROR: (22) Invalid argument 2023-08-01T19:56:36.496 INFO:teuthology.orchestra.run.smithi008.stdout:op_tracker tracking is not enabled now, so no ops are tracked currently, even those get stuck. Please enable "osd_enable_op_tracker", and the tracker will start to track new ops received afterwards. 2023-08-01T19:56:36.506 DEBUG:teuthology.orchestra.run.smithi008:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 30 ceph --cluster ceph --admin-daemon /var/run/ceph/ceph-osd.0.asok dump_historic_ops 2023-08-01T19:56:36.507 INFO:tasks.ceph.osd.2.smithi155.stderr:2023-08-01T19:56:36.506+0000 7faa5c6ac700 -1 received signal: Hangup from /usr/bin/python3 /bin/daemon-helper kill ceph-osd -f --cluster ceph -i 2 (PID: 111337) UID: 0 2023-08-01T19:56:36.608 INFO:tasks.ceph.osd.0.smithi008.stderr:2023-08-01T19:56:36.607+0000 7f16a58f4700 -1 received signal: Hangup from /usr/bin/python3 /bin/daemon-helper kill ceph-osd -f --cluster ceph -i 0 (PID: 111179) UID: 0 2023-08-01T19:56:36.633 INFO:teuthology.orchestra.run.smithi008.stdout:ERROR: (22) Invalid argument 2023-08-01T19:56:36.633 INFO:teuthology.orchestra.run.smithi008.stdout:op_tracker tracking is not enabled now, so no ops are tracked currently, even those get stuck. Please enable "osd_enable_op_tracker", and the tracker will start to track new ops received afterwards. 2023-08-01T19:56:36.643 DEBUG:teuthology.orchestra.run.smithi155:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 30 ceph --cluster ceph --admin-daemon /var/run/ceph/ceph-osd.2.asok dump_ops_in_flight 2023-08-01T19:56:36.709 INFO:tasks.ceph.osd.0.smithi008.stderr:2023-08-01T19:56:36.709+0000 7f16a58f4700 -1 received signal: Hangup from /usr/bin/python3 /bin/daemon-helper kill ceph-osd -f --cluster ceph -i 0 (PID: 111179) UID: 0 2023-08-01T19:56:36.770 INFO:teuthology.orchestra.run.smithi155.stdout:ERROR: (22) Invalid argument 2023-08-01T19:56:36.770 INFO:teuthology.orchestra.run.smithi155.stdout:op_tracker tracking is not enabled now, so no ops are tracked currently, even those get stuck. Please enable "osd_enable_op_tracker", and the tracker will start to track new ops received afterwards. 2023-08-01T19:56:36.780 DEBUG:teuthology.orchestra.run.smithi155:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 30 ceph --cluster ceph --admin-daemon /var/run/ceph/ceph-osd.2.asok dump_blocked_ops 2023-08-01T19:56:36.822 INFO:tasks.ceph.osd.2.smithi155.stderr:2023-08-01T19:56:36.821+0000 7faa5c6ac700 -1 received signal: Hangup from /usr/bin/python3 /bin/daemon-helper kill ceph-osd -f --cluster ceph -i 2 (PID: 111337) UID: 0 2023-08-01T19:56:36.903 INFO:teuthology.orchestra.run.smithi155.stdout:ERROR: (22) Invalid argument 2023-08-01T19:56:36.903 INFO:teuthology.orchestra.run.smithi155.stdout:op_tracker tracking is not enabled now, so no ops are tracked currently, even those get stuck. Please enable "osd_enable_op_tracker", and the tracker will start to track new ops received afterwards. 2023-08-01T19:56:36.911 INFO:tasks.ceph.osd.0.smithi008.stderr:2023-08-01T19:56:36.910+0000 7f16a58f4700 -1 received signal: Hangup from /usr/bin/python3 /bin/daemon-helper kill ceph-osd -f --cluster ceph -i 0 (PID: 111179) UID: 0 2023-08-01T19:56:36.912 DEBUG:teuthology.orchestra.run.smithi155:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 30 ceph --cluster ceph --admin-daemon /var/run/ceph/ceph-osd.2.asok dump_historic_ops 2023-08-01T19:56:37.012 INFO:tasks.ceph.osd.2.smithi155.stderr:2023-08-01T19:56:37.010+0000 7faa5c6ac700 -1 received signal: Hangup from /usr/bin/python3 /bin/daemon-helper kill ceph-osd -f --cluster ceph -i 2 (PID: 111337) UID: 0 2023-08-01T19:56:37.076 INFO:teuthology.orchestra.run.smithi155.stdout:ERROR: (22) Invalid argument 2023-08-01T19:56:37.076 INFO:teuthology.orchestra.run.smithi155.stdout:op_tracker tracking is not enabled now, so no ops are tracked currently, even those get stuck. Please enable "osd_enable_op_tracker", and the tracker will start to track new ops received afterwards. 2023-08-01T19:56:37.085 DEBUG:teuthology.orchestra.run.smithi008:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 30 ceph --cluster ceph --admin-daemon /var/run/ceph/ceph-osd.0.asok dump_ops_in_flight 2023-08-01T19:56:37.126 INFO:tasks.ceph.osd.2.smithi155.stderr:2023-08-01T19:56:37.125+0000 7faa5c6ac700 -1 received signal: Hangup from /usr/bin/python3 /bin/daemon-helper kill ceph-osd -f --cluster ceph -i 2 (PID: 111337) UID: 0 2023-08-01T19:56:37.214 INFO:tasks.ceph.osd.0.smithi008.stderr:2023-08-01T19:56:37.213+0000 7f16a58f4700 -1 received signal: Hangup from /usr/bin/python3 /bin/daemon-helper kill ceph-osd -f --cluster ceph -i 0 (PID: 111179) UID: 0 2023-08-01T19:56:37.217 INFO:teuthology.orchestra.run.smithi008.stdout:ERROR: (22) Invalid argument 2023-08-01T19:56:37.217 INFO:teuthology.orchestra.run.smithi008.stdout:op_tracker tracking is not enabled now, so no ops are tracked currently, even those get stuck. Please enable "osd_enable_op_tracker", and the tracker will start to track new ops received afterwards. 2023-08-01T19:56:37.227 DEBUG:teuthology.orchestra.run.smithi008:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 30 ceph --cluster ceph --admin-daemon /var/run/ceph/ceph-osd.0.asok dump_blocked_ops 2023-08-01T19:56:37.315 INFO:tasks.ceph.osd.2.smithi155.stderr:2023-08-01T19:56:37.313+0000 7faa5c6ac700 -1 received signal: Hangup from /usr/bin/python3 /bin/daemon-helper kill ceph-osd -f --cluster ceph -i 2 (PID: 111337) UID: 0 2023-08-01T19:56:37.396 INFO:teuthology.orchestra.run.smithi008.stdout:ERROR: (22) Invalid argument 2023-08-01T19:56:37.396 INFO:teuthology.orchestra.run.smithi008.stdout:op_tracker tracking is not enabled now, so no ops are tracked currently, even those get stuck. Please enable "osd_enable_op_tracker", and the tracker will start to track new ops received afterwards. 2023-08-01T19:56:37.406 DEBUG:teuthology.orchestra.run.smithi008:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 30 ceph --cluster ceph --admin-daemon /var/run/ceph/ceph-osd.0.asok dump_historic_ops 2023-08-01T19:56:37.421 DEBUG:teuthology.orchestra.run.smithi006:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 120 ceph --cluster ceph -- tell 'osd.*' injectargs --osd_enable_op_tracker=true 2023-08-01T19:56:37.448 INFO:tasks.ceph.osd.0.smithi008.stderr:2023-08-01T19:56:37.448+0000 7f16a58f4700 -1 received signal: Hangup from /usr/bin/python3 /bin/daemon-helper kill ceph-osd -f --cluster ceph -i 0 (PID: 111179) UID: 0 2023-08-01T19:56:37.517 INFO:tasks.ceph.osd.2.smithi155.stderr:2023-08-01T19:56:37.515+0000 7faa5c6ac700 -1 received signal: Hangup from /usr/bin/python3 /bin/daemon-helper kill ceph-osd -f --cluster ceph -i 2 (PID: 111337) UID: 0 2023-08-01T19:56:37.534 INFO:teuthology.orchestra.run.smithi008.stdout:ERROR: (22) Invalid argument 2023-08-01T19:56:37.534 INFO:teuthology.orchestra.run.smithi008.stdout:op_tracker tracking is not enabled now, so no ops are tracked currently, even those get stuck. Please enable "osd_enable_op_tracker", and the tracker will start to track new ops received afterwards. 2023-08-01T19:56:37.544 DEBUG:teuthology.orchestra.run.smithi155:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 30 ceph --cluster ceph --admin-daemon /var/run/ceph/ceph-osd.2.asok dump_ops_in_flight 2023-08-01T19:56:37.578 INFO:teuthology.orchestra.run.smithi006.stdout:osd.0: {} 2023-08-01T19:56:37.599 INFO:teuthology.orchestra.run.smithi006.stdout:osd.2: {} 2023-08-01T19:56:37.599 INFO:teuthology.orchestra.run.smithi006.stderr:osd.0: osd_enable_op_tracker = 'true' 2023-08-01T19:56:37.600 INFO:teuthology.orchestra.run.smithi006.stderr:Error ENXIO: problem getting command descriptions from osd.1 2023-08-01T19:56:37.600 INFO:teuthology.orchestra.run.smithi006.stderr:osd.2: osd_enable_op_tracker = 'true' 2023-08-01T19:56:37.602 DEBUG:teuthology.orchestra.run:got remote process result: 6 2023-08-01T19:56:37.602 INFO:tasks.thrashosds.thrasher:Failed to tell all osds, ignoring 2023-08-01T19:56:37.617 INFO:tasks.ceph.osd.0.smithi008.stderr:2023-08-01T19:56:37.617+0000 7f16a58f4700 -1 received signal: Hangup from /usr/bin/python3 /bin/daemon-helper kill ceph-osd -f --cluster ceph -i 0 (PID: 111179) UID: 0 2023-08-01T19:56:37.670 INFO:teuthology.orchestra.run.smithi155.stdout:{ 2023-08-01T19:56:37.670 INFO:teuthology.orchestra.run.smithi155.stdout: "ops": [], 2023-08-01T19:56:37.670 INFO:teuthology.orchestra.run.smithi155.stdout: "num_ops": 0 2023-08-01T19:56:37.670 INFO:teuthology.orchestra.run.smithi155.stdout:} 2023-08-01T19:56:37.679 DEBUG:teuthology.orchestra.run.smithi155:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 30 ceph --cluster ceph --admin-daemon /var/run/ceph/ceph-osd.2.asok dump_blocked_ops 2023-08-01T19:56:37.722 INFO:tasks.ceph.osd.2.smithi155.stderr:2023-08-01T19:56:37.721+0000 7faa5c6ac700 -1 received signal: Hangup from /usr/bin/python3 /bin/daemon-helper kill ceph-osd -f --cluster ceph -i 2 (PID: 111337) UID: 0 2023-08-01T19:56:37.803 INFO:teuthology.orchestra.run.smithi155.stdout:{ 2023-08-01T19:56:37.803 INFO:teuthology.orchestra.run.smithi155.stdout: "ops": [], 2023-08-01T19:56:37.804 INFO:teuthology.orchestra.run.smithi155.stdout: "complaint_time": 30, 2023-08-01T19:56:37.804 INFO:teuthology.orchestra.run.smithi155.stdout: "num_blocked_ops": 0 2023-08-01T19:56:37.804 INFO:teuthology.orchestra.run.smithi155.stdout:} 2023-08-01T19:56:37.813 DEBUG:teuthology.orchestra.run.smithi155:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 30 ceph --cluster ceph --admin-daemon /var/run/ceph/ceph-osd.2.asok dump_historic_ops 2023-08-01T19:56:37.819 INFO:tasks.ceph.osd.0.smithi008.stderr:2023-08-01T19:56:37.818+0000 7f16a58f4700 -1 received signal: Hangup from /usr/bin/python3 /bin/daemon-helper kill ceph-osd -f --cluster ceph -i 0 (PID: 111179) UID: 0 2023-08-01T19:56:37.919 INFO:tasks.ceph.osd.2.smithi155.stderr:2023-08-01T19:56:37.918+0000 7faa5c6ac700 -1 received signal: Hangup from /usr/bin/python3 /bin/daemon-helper kill ceph-osd -f --cluster ceph -i 2 (PID: 111337) UID: 0 2023-08-01T19:56:37.979 INFO:teuthology.orchestra.run.smithi155.stdout:{ 2023-08-01T19:56:37.979 INFO:teuthology.orchestra.run.smithi155.stdout: "size": 20, 2023-08-01T19:56:37.979 INFO:teuthology.orchestra.run.smithi155.stdout: "duration": 600, 2023-08-01T19:56:37.980 INFO:teuthology.orchestra.run.smithi155.stdout: "ops": [ 2023-08-01T19:56:37.980 INFO:teuthology.orchestra.run.smithi155.stdout: { 2023-08-01T19:56:37.980 INFO:teuthology.orchestra.run.smithi155.stdout: "description": "osd_op(client.4668.0:100237 5.4 5:2d68bec9:::benchmark_data_smithi006_114134_object100236:head [set-alloc-hint object_size 65536 write_size 65536,write 0~65536] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e37)", 2023-08-01T19:56:37.980 INFO:teuthology.orchestra.run.smithi155.stdout: "initiated_at": "2023-08-01T19:55:05.147736+0000", 2023-08-01T19:56:37.980 INFO:teuthology.orchestra.run.smithi155.stdout: "age": 92.828632733999996, 2023-08-01T19:56:37.980 INFO:teuthology.orchestra.run.smithi155.stdout: "duration": 0.071299464000000007, 2023-08-01T19:56:37.980 INFO:teuthology.orchestra.run.smithi155.stdout: "type_data": { 2023-08-01T19:56:37.981 INFO:teuthology.orchestra.run.smithi155.stdout: "flag_point": "commit sent; apply or cleanup", 2023-08-01T19:56:37.981 INFO:teuthology.orchestra.run.smithi155.stdout: "client_info": { 2023-08-01T19:56:37.981 INFO:teuthology.orchestra.run.smithi155.stdout: "client": "client.4668", 2023-08-01T19:56:37.981 INFO:teuthology.orchestra.run.smithi155.stdout: "client_addr": "172.21.15.6:0/1709472247", 2023-08-01T19:56:37.981 INFO:teuthology.orchestra.run.smithi155.stdout: "tid": 100237 2023-08-01T19:56:37.981 INFO:teuthology.orchestra.run.smithi155.stdout: }, 2023-08-01T19:56:37.981 INFO:teuthology.orchestra.run.smithi155.stdout: "events": [ 2023-08-01T19:56:37.981 INFO:teuthology.orchestra.run.smithi155.stdout: { 2023-08-01T19:56:37.982 INFO:teuthology.orchestra.run.smithi155.stdout: "event": "initiated", 2023-08-01T19:56:37.982 INFO:teuthology.orchestra.run.smithi155.stdout: "time": "2023-08-01T19:55:05.147736+0000", 2023-08-01T19:56:37.982 INFO:teuthology.orchestra.run.smithi155.stdout: "duration": 0 2023-08-01T19:56:37.982 INFO:teuthology.orchestra.run.smithi155.stdout: }, 2023-08-01T19:56:37.982 INFO:teuthology.orchestra.run.smithi155.stdout: { 2023-08-01T19:56:37.982 INFO:teuthology.orchestra.run.smithi155.stdout: "event": "throttled", 2023-08-01T19:56:37.982 INFO:teuthology.orchestra.run.smithi155.stdout: "time": "2023-08-01T19:55:05.147736+0000", 2023-08-01T19:56:37.982 INFO:teuthology.orchestra.run.smithi155.stdout: "duration": 0 2023-08-01T19:56:37.983 INFO:teuthology.orchestra.run.smithi155.stdout: }, 2023-08-01T19:56:37.983 INFO:teuthology.orchestra.run.smithi155.stdout: { 2023-08-01T19:56:37.983 INFO:teuthology.orchestra.run.smithi155.stdout: "event": "header_read", 2023-08-01T19:56:37.983 INFO:teuthology.orchestra.run.smithi155.stdout: "time": "2023-08-01T19:55:05.147736+0000", 2023-08-01T19:56:37.983 INFO:teuthology.orchestra.run.smithi155.stdout: "duration": 4294967295.9999995 2023-08-01T19:56:37.983 INFO:teuthology.orchestra.run.smithi155.stdout: }, 2023-08-01T19:56:37.983 INFO:teuthology.orchestra.run.smithi155.stdout: { 2023-08-01T19:56:37.984 INFO:teuthology.orchestra.run.smithi155.stdout: "event": "all_read", 2023-08-01T19:56:37.984 INFO:teuthology.orchestra.run.smithi155.stdout: "time": "2023-08-01T19:55:05.147766+0000", 2023-08-01T19:56:37.984 INFO:teuthology.orchestra.run.smithi155.stdout: "duration": 3.0394000000000001e-05 2023-08-01T19:56:37.984 INFO:teuthology.orchestra.run.smithi155.stdout: }, 2023-08-01T19:56:37.984 INFO:teuthology.orchestra.run.smithi155.stdout: { 2023-08-01T19:56:37.984 INFO:teuthology.orchestra.run.smithi155.stdout: "event": "dispatched", 2023-08-01T19:56:37.984 INFO:teuthology.orchestra.run.smithi155.stdout: "time": "2023-08-01T19:55:05.147771+0000", 2023-08-01T19:56:37.984 INFO:teuthology.orchestra.run.smithi155.stdout: "duration": 4.25e-06 2023-08-01T19:56:37.985 INFO:teuthology.orchestra.run.smithi155.stdout: }, 2023-08-01T19:56:37.985 INFO:teuthology.orchestra.run.smithi155.stdout: { 2023-08-01T19:56:37.985 INFO:teuthology.orchestra.run.smithi155.stdout: "event": "queued_for_pg", 2023-08-01T19:56:37.985 INFO:teuthology.orchestra.run.smithi155.stdout: "time": "2023-08-01T19:55:05.147773+0000", 2023-08-01T19:56:37.985 INFO:teuthology.orchestra.run.smithi155.stdout: "duration": 2.4159999999999998e-06 2023-08-01T19:56:37.985 INFO:teuthology.orchestra.run.smithi155.stdout: }, 2023-08-01T19:56:37.985 INFO:teuthology.orchestra.run.smithi155.stdout: { 2023-08-01T19:56:37.985 INFO:teuthology.orchestra.run.smithi155.stdout: "event": "reached_pg", 2023-08-01T19:56:37.986 INFO:teuthology.orchestra.run.smithi155.stdout: "time": "2023-08-01T19:55:05.149903+0000", 2023-08-01T19:56:37.986 INFO:teuthology.orchestra.run.smithi155.stdout: "duration": 0.002129948 2023-08-01T19:56:37.986 INFO:teuthology.orchestra.run.smithi155.stdout: }, 2023-08-01T19:56:37.986 INFO:teuthology.orchestra.run.smithi155.stdout: { 2023-08-01T19:56:37.986 INFO:teuthology.orchestra.run.smithi155.stdout: "event": "started", 2023-08-01T19:56:37.986 INFO:teuthology.orchestra.run.smithi155.stdout: "time": "2023-08-01T19:55:05.149982+0000", 2023-08-01T19:56:37.986 INFO:teuthology.orchestra.run.smithi155.stdout: "duration": 7.8706000000000002e-05 2023-08-01T19:56:37.986 INFO:teuthology.orchestra.run.smithi155.stdout: }, 2023-08-01T19:56:37.987 INFO:teuthology.orchestra.run.smithi155.stdout: { 2023-08-01T19:56:37.987 INFO:teuthology.orchestra.run.smithi155.stdout: "event": "waiting for subops from 0", 2023-08-01T19:56:37.987 INFO:teuthology.orchestra.run.smithi155.stdout: "time": "2023-08-01T19:55:05.150066+0000", 2023-08-01T19:56:37.987 INFO:teuthology.orchestra.run.smithi155.stdout: "duration": 8.4241999999999997e-05 2023-08-01T19:56:37.987 INFO:teuthology.orchestra.run.smithi155.stdout: }, 2023-08-01T19:56:37.987 INFO:teuthology.orchestra.run.smithi155.stdout: { 2023-08-01T19:56:37.987 INFO:teuthology.orchestra.run.smithi155.stdout: "event": "op_commit", 2023-08-01T19:56:37.988 INFO:teuthology.orchestra.run.smithi155.stdout: "time": "2023-08-01T19:55:05.154994+0000", 2023-08-01T19:56:37.988 INFO:teuthology.orchestra.run.smithi155.stdout: "duration": 0.0049277050000000001 2023-08-01T19:56:37.988 INFO:teuthology.orchestra.run.smithi155.stdout: }, 2023-08-01T19:56:37.988 INFO:teuthology.orchestra.run.smithi155.stdout: { 2023-08-01T19:56:37.988 INFO:teuthology.orchestra.run.smithi155.stdout: "event": "sub_op_commit_rec", 2023-08-01T19:56:37.988 INFO:teuthology.orchestra.run.smithi155.stdout: "time": "2023-08-01T19:55:05.218933+0000", 2023-08-01T19:56:37.988 INFO:teuthology.orchestra.run.smithi155.stdout: "duration": 0.063939916999999999 2023-08-01T19:56:37.988 INFO:teuthology.orchestra.run.smithi155.stdout: }, 2023-08-01T19:56:37.989 INFO:teuthology.orchestra.run.smithi155.stdout: { 2023-08-01T19:56:37.989 INFO:teuthology.orchestra.run.smithi155.stdout: "event": "commit_sent", 2023-08-01T19:56:37.989 INFO:teuthology.orchestra.run.smithi155.stdout: "time": "2023-08-01T19:55:05.218989+0000", 2023-08-01T19:56:37.989 INFO:teuthology.orchestra.run.smithi155.stdout: "duration": 5.5772000000000001e-05 2023-08-01T19:56:37.989 INFO:teuthology.orchestra.run.smithi155.stdout: }, 2023-08-01T19:56:37.989 INFO:teuthology.orchestra.run.smithi155.stdout: { 2023-08-01T19:56:37.989 INFO:teuthology.orchestra.run.smithi155.stdout: "event": "done", 2023-08-01T19:56:37.989 INFO:teuthology.orchestra.run.smithi155.stdout: "time": "2023-08-01T19:55:05.219036+0000", 2023-08-01T19:56:37.990 INFO:teuthology.orchestra.run.smithi155.stdout: "duration": 4.6526000000000001e-05 2023-08-01T19:56:37.990 INFO:teuthology.orchestra.run.smithi155.stdout: } 2023-08-01T19:56:37.990 INFO:teuthology.orchestra.run.smithi155.stdout: ] 2023-08-01T19:56:37.990 INFO:teuthology.orchestra.run.smithi155.stdout: } 2023-08-01T19:56:37.990 INFO:teuthology.orchestra.run.smithi155.stdout: }, 2023-08-01T19:56:37.990 INFO:teuthology.orchestra.run.smithi155.stdout: { 2023-08-01T19:56:37.990 INFO:teuthology.orchestra.run.smithi155.stdout: "description": "osd_op(client.4668.0:100242 5.8 5:16a314b8:::benchmark_data_smithi006_114134_object100241:head [set-alloc-hint object_size 65536 write_size 65536,write 0~65536] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e37)", 2023-08-01T19:56:37.990 INFO:teuthology.orchestra.run.smithi155.stdout: "initiated_at": "2023-08-01T19:55:05.150616+0000", 2023-08-01T19:56:37.991 INFO:teuthology.orchestra.run.smithi155.stdout: "age": 92.825753104, 2023-08-01T19:56:37.991 INFO:teuthology.orchestra.run.smithi155.stdout: "duration": 0.071105065999999995, 2023-08-01T19:56:37.991 INFO:teuthology.orchestra.run.smithi155.stdout: "type_data": { 2023-08-01T19:56:37.991 INFO:teuthology.orchestra.run.smithi155.stdout: "flag_point": "commit sent; apply or cleanup", 2023-08-01T19:56:37.991 INFO:teuthology.orchestra.run.smithi155.stdout: "client_info": { 2023-08-01T19:56:37.991 INFO:teuthology.orchestra.run.smithi155.stdout: "client": "client.4668", 2023-08-01T19:56:37.991 INFO:teuthology.orchestra.run.smithi155.stdout: "client_addr": "172.21.15.6:0/1709472247", 2023-08-01T19:56:37.992 INFO:teuthology.orchestra.run.smithi155.stdout: "tid": 100242 2023-08-01T19:56:37.992 INFO:teuthology.orchestra.run.smithi155.stdout: }, 2023-08-01T19:56:37.992 INFO:teuthology.orchestra.run.smithi155.stdout: "events": [ 2023-08-01T19:56:37.992 INFO:teuthology.orchestra.run.smithi155.stdout: { 2023-08-01T19:56:37.992 INFO:teuthology.orchestra.run.smithi155.stdout: "event": "initiated", 2023-08-01T19:56:37.992 INFO:teuthology.orchestra.run.smithi155.stdout: "time": "2023-08-01T19:55:05.150616+0000", 2023-08-01T19:56:37.993 INFO:teuthology.orchestra.run.smithi155.stdout: "duration": 0 2023-08-01T19:56:37.993 INFO:teuthology.orchestra.run.smithi155.stdout: }, 2023-08-01T19:56:37.993 INFO:teuthology.orchestra.run.smithi155.stdout: { 2023-08-01T19:56:37.993 INFO:teuthology.orchestra.run.smithi155.stdout: "event": "throttled", 2023-08-01T19:56:37.993 INFO:teuthology.orchestra.run.smithi155.stdout: "time": "2023-08-01T19:55:05.150616+0000", 2023-08-01T19:56:37.993 INFO:teuthology.orchestra.run.smithi155.stdout: "duration": 0 2023-08-01T19:56:37.993 INFO:teuthology.orchestra.run.smithi155.stdout: }, 2023-08-01T19:56:37.993 INFO:teuthology.orchestra.run.smithi155.stdout: { 2023-08-01T19:56:37.994 INFO:teuthology.orchestra.run.smithi155.stdout: "event": "header_read", 2023-08-01T19:56:37.994 INFO:teuthology.orchestra.run.smithi155.stdout: "time": "2023-08-01T19:55:05.150615+0000", 2023-08-01T19:56:37.994 INFO:teuthology.orchestra.run.smithi155.stdout: "duration": 4294967295.999999 2023-08-01T19:56:37.994 INFO:teuthology.orchestra.run.smithi155.stdout: }, 2023-08-01T19:56:37.994 INFO:teuthology.orchestra.run.smithi155.stdout: { 2023-08-01T19:56:37.994 INFO:teuthology.orchestra.run.smithi155.stdout: "event": "all_read", 2023-08-01T19:56:37.994 INFO:teuthology.orchestra.run.smithi155.stdout: "time": "2023-08-01T19:55:05.150696+0000", 2023-08-01T19:56:37.994 INFO:teuthology.orchestra.run.smithi155.stdout: "duration": 8.0852000000000004e-05 2023-08-01T19:56:37.995 INFO:teuthology.orchestra.run.smithi155.stdout: }, 2023-08-01T19:56:37.995 INFO:teuthology.orchestra.run.smithi155.stdout: { 2023-08-01T19:56:37.995 INFO:teuthology.orchestra.run.smithi155.stdout: "event": "dispatched", 2023-08-01T19:56:37.995 INFO:teuthology.orchestra.run.smithi155.stdout: "time": "2023-08-01T19:55:05.150708+0000", 2023-08-01T19:56:37.995 INFO:teuthology.orchestra.run.smithi155.stdout: "duration": 1.2116999999999999e-05 2023-08-01T19:56:37.995 INFO:teuthology.orchestra.run.smithi155.stdout: }, 2023-08-01T19:56:37.995 INFO:teuthology.orchestra.run.smithi155.stdout: { 2023-08-01T19:56:37.995 INFO:teuthology.orchestra.run.smithi155.stdout: "event": "queued_for_pg", 2023-08-01T19:56:37.996 INFO:teuthology.orchestra.run.smithi155.stdout: "time": "2023-08-01T19:55:05.150713+0000", 2023-08-01T19:56:37.996 INFO:teuthology.orchestra.run.smithi155.stdout: "duration": 5.4620000000000004e-06 2023-08-01T19:56:37.996 INFO:teuthology.orchestra.run.smithi155.stdout: }, 2023-08-01T19:56:37.996 INFO:teuthology.orchestra.run.smithi155.stdout: { 2023-08-01T19:56:37.996 INFO:teuthology.orchestra.run.smithi155.stdout: "event": "reached_pg", 2023-08-01T19:56:37.996 INFO:teuthology.orchestra.run.smithi155.stdout: "time": "2023-08-01T19:55:05.150761+0000", 2023-08-01T19:56:37.996 INFO:teuthology.orchestra.run.smithi155.stdout: "duration": 4.7429000000000003e-05 2023-08-01T19:56:37.996 INFO:teuthology.orchestra.run.smithi155.stdout: }, 2023-08-01T19:56:37.997 INFO:teuthology.orchestra.run.smithi155.stdout: { 2023-08-01T19:56:37.997 INFO:teuthology.orchestra.run.smithi155.stdout: "event": "started", 2023-08-01T19:56:37.997 INFO:teuthology.orchestra.run.smithi155.stdout: "time": "2023-08-01T19:55:05.150856+0000", 2023-08-01T19:56:37.997 INFO:teuthology.orchestra.run.smithi155.stdout: "duration": 9.5356e-05 2023-08-01T19:56:37.997 INFO:teuthology.orchestra.run.smithi155.stdout: }, 2023-08-01T19:56:37.997 INFO:teuthology.orchestra.run.smithi155.stdout: { 2023-08-01T19:56:37.997 INFO:teuthology.orchestra.run.smithi155.stdout: "event": "waiting for subops from 0", 2023-08-01T19:56:37.997 INFO:teuthology.orchestra.run.smithi155.stdout: "time": "2023-08-01T19:55:05.150999+0000", 2023-08-01T19:56:37.998 INFO:teuthology.orchestra.run.smithi155.stdout: "duration": 0.00014234499999999999 2023-08-01T19:56:37.998 INFO:teuthology.orchestra.run.smithi155.stdout: }, 2023-08-01T19:56:37.998 INFO:teuthology.orchestra.run.smithi155.stdout: { 2023-08-01T19:56:37.998 INFO:teuthology.orchestra.run.smithi155.stdout: "event": "sub_op_commit_rec", 2023-08-01T19:56:37.998 INFO:teuthology.orchestra.run.smithi155.stdout: "time": "2023-08-01T19:55:05.219001+0000", 2023-08-01T19:56:37.998 INFO:teuthology.orchestra.run.smithi155.stdout: "duration": 0.068002776000000001 2023-08-01T19:56:37.998 INFO:teuthology.orchestra.run.smithi155.stdout: }, 2023-08-01T19:56:37.999 INFO:teuthology.orchestra.run.smithi155.stdout: { 2023-08-01T19:56:37.999 INFO:teuthology.orchestra.run.smithi155.stdout: "event": "op_commit", 2023-08-01T19:56:37.999 INFO:teuthology.orchestra.run.smithi155.stdout: "time": "2023-08-01T19:55:05.221635+0000", 2023-08-01T19:56:37.999 INFO:teuthology.orchestra.run.smithi155.stdout: "duration": 0.0026340579999999999 2023-08-01T19:56:37.999 INFO:teuthology.orchestra.run.smithi155.stdout: }, 2023-08-01T19:56:37.999 INFO:teuthology.orchestra.run.smithi155.stdout: { 2023-08-01T19:56:37.999 INFO:teuthology.orchestra.run.smithi155.stdout: "event": "commit_sent", 2023-08-01T19:56:37.999 INFO:teuthology.orchestra.run.smithi155.stdout: "time": "2023-08-01T19:55:05.221682+0000", 2023-08-01T19:56:38.000 INFO:teuthology.orchestra.run.smithi155.stdout: "duration": 4.7123999999999998e-05 2023-08-01T19:56:38.000 INFO:teuthology.orchestra.run.smithi155.stdout: }, 2023-08-01T19:56:38.000 INFO:teuthology.orchestra.run.smithi155.stdout: { 2023-08-01T19:56:38.000 INFO:teuthology.orchestra.run.smithi155.stdout: "event": "done", 2023-08-01T19:56:38.000 INFO:teuthology.orchestra.run.smithi155.stdout: "time": "2023-08-01T19:55:05.221721+0000", 2023-08-01T19:56:38.000 INFO:teuthology.orchestra.run.smithi155.stdout: "duration": 3.8529999999999999e-05 2023-08-01T19:56:38.000 INFO:teuthology.orchestra.run.smithi155.stdout: } 2023-08-01T19:56:38.000 INFO:teuthology.orchestra.run.smithi155.stdout: ] 2023-08-01T19:56:38.001 INFO:teuthology.orchestra.run.smithi155.stdout: } 2023-08-01T19:56:38.001 INFO:teuthology.orchestra.run.smithi155.stdout: }, 2023-08-01T19:56:38.001 INFO:teuthology.orchestra.run.smithi155.stdout: { 2023-08-01T19:56:38.001 INFO:teuthology.orchestra.run.smithi155.stdout: "description": "osd_repop(client.4668.0:100240 5.a e37/19 5:5313c5b9:::benchmark_data_smithi006_114134_object100239:head v 37'6227, mlcod=37'6225)", 2023-08-01T19:56:38.001 INFO:teuthology.orchestra.run.smithi155.stdout: "initiated_at": "2023-08-01T19:55:05.150778+0000", 2023-08-01T19:56:38.001 INFO:teuthology.orchestra.run.smithi155.stdout: "age": 92.825590903000005, 2023-08-01T19:56:38.001 INFO:teuthology.orchestra.run.smithi155.stdout: "duration": 0.073362533999999993, 2023-08-01T19:56:38.001 INFO:teuthology.orchestra.run.smithi155.stdout: "type_data": { 2023-08-01T19:56:38.002 INFO:teuthology.orchestra.run.smithi155.stdout: "flag_point": "commit sent; apply or cleanup", 2023-08-01T19:56:38.002 INFO:teuthology.orchestra.run.smithi155.stdout: "events": [ 2023-08-01T19:56:38.002 INFO:teuthology.orchestra.run.smithi155.stdout: { 2023-08-01T19:56:38.002 INFO:teuthology.orchestra.run.smithi155.stdout: "event": "initiated", 2023-08-01T19:56:38.002 INFO:teuthology.orchestra.run.smithi155.stdout: "time": "2023-08-01T19:55:05.150778+0000", 2023-08-01T19:56:38.002 INFO:teuthology.orchestra.run.smithi155.stdout: "duration": 0 2023-08-01T19:56:38.002 INFO:teuthology.orchestra.run.smithi155.stdout: }, 2023-08-01T19:56:38.002 INFO:teuthology.orchestra.run.smithi155.stdout: { 2023-08-01T19:56:38.004 INFO:teuthology.orchestra.run.smithi155.stdout: "event": "throttled", 2023-08-01T19:56:38.004 INFO:teuthology.orchestra.run.smithi155.stdout: "time": "2023-08-01T19:55:05.150778+0000", 2023-08-01T19:56:38.004 INFO:teuthology.orchestra.run.smithi155.stdout: "duration": 0 2023-08-01T19:56:38.004 INFO:teuthology.orchestra.run.smithi155.stdout: }, 2023-08-01T19:56:38.005 INFO:teuthology.orchestra.run.smithi155.stdout: { 2023-08-01T19:56:38.005 INFO:teuthology.orchestra.run.smithi155.stdout: "event": "header_read", 2023-08-01T19:56:38.005 INFO:teuthology.orchestra.run.smithi155.stdout: "time": "2023-08-01T19:55:05.150778+0000", 2023-08-01T19:56:38.005 INFO:teuthology.orchestra.run.smithi155.stdout: "duration": 4294967295.9999995 2023-08-01T19:56:38.005 INFO:teuthology.orchestra.run.smithi155.stdout: }, 2023-08-01T19:56:38.005 INFO:teuthology.orchestra.run.smithi155.stdout: { 2023-08-01T19:56:38.005 INFO:teuthology.orchestra.run.smithi155.stdout: "event": "all_read", 2023-08-01T19:56:38.006 INFO:teuthology.orchestra.run.smithi155.stdout: "time": "2023-08-01T19:55:05.150811+0000", 2023-08-01T19:56:38.006 INFO:teuthology.orchestra.run.smithi155.stdout: "duration": 3.3664000000000002e-05 2023-08-01T19:56:38.006 INFO:teuthology.orchestra.run.smithi155.stdout: }, 2023-08-01T19:56:38.006 INFO:teuthology.orchestra.run.smithi155.stdout: { 2023-08-01T19:56:38.006 INFO:teuthology.orchestra.run.smithi155.stdout: "event": "dispatched", 2023-08-01T19:56:38.006 INFO:teuthology.orchestra.run.smithi155.stdout: "time": "2023-08-01T19:55:05.150818+0000", 2023-08-01T19:56:38.006 INFO:teuthology.orchestra.run.smithi155.stdout: "duration": 6.5769999999999999e-06 2023-08-01T19:56:38.007 INFO:teuthology.orchestra.run.smithi155.stdout: }, 2023-08-01T19:56:38.007 INFO:teuthology.orchestra.run.smithi155.stdout: { 2023-08-01T19:56:38.007 INFO:teuthology.orchestra.run.smithi155.stdout: "event": "queued_for_pg", 2023-08-01T19:56:38.007 INFO:teuthology.orchestra.run.smithi155.stdout: "time": "2023-08-01T19:55:05.150822+0000", 2023-08-01T19:56:38.007 INFO:teuthology.orchestra.run.smithi155.stdout: "duration": 4.0060000000000003e-06 2023-08-01T19:56:38.007 INFO:teuthology.orchestra.run.smithi155.stdout: }, 2023-08-01T19:56:38.007 INFO:teuthology.orchestra.run.smithi155.stdout: { 2023-08-01T19:56:38.007 INFO:teuthology.orchestra.run.smithi155.stdout: "event": "reached_pg", 2023-08-01T19:56:38.008 INFO:teuthology.orchestra.run.smithi155.stdout: "time": "2023-08-01T19:55:05.150855+0000", 2023-08-01T19:56:38.008 INFO:teuthology.orchestra.run.smithi155.stdout: "duration": 3.3204999999999998e-05 2023-08-01T19:56:38.008 INFO:teuthology.orchestra.run.smithi155.stdout: }, 2023-08-01T19:56:38.008 INFO:teuthology.orchestra.run.smithi155.stdout: { 2023-08-01T19:56:38.008 INFO:teuthology.orchestra.run.smithi155.stdout: "event": "started", 2023-08-01T19:56:38.008 INFO:teuthology.orchestra.run.smithi155.stdout: "time": "2023-08-01T19:55:05.150873+0000", 2023-08-01T19:56:38.008 INFO:teuthology.orchestra.run.smithi155.stdout: "duration": 1.8139999999999999e-05 2023-08-01T19:56:38.008 INFO:teuthology.orchestra.run.smithi155.stdout: }, 2023-08-01T19:56:38.009 INFO:teuthology.orchestra.run.smithi155.stdout: { 2023-08-01T19:56:38.009 INFO:teuthology.orchestra.run.smithi155.stdout: "event": "commit_sent", 2023-08-01T19:56:38.009 INFO:teuthology.orchestra.run.smithi155.stdout: "time": "2023-08-01T19:55:05.224095+0000", 2023-08-01T19:56:38.009 INFO:teuthology.orchestra.run.smithi155.stdout: "duration": 0.073221895999999995 2023-08-01T19:56:38.009 INFO:teuthology.orchestra.run.smithi155.stdout: }, 2023-08-01T19:56:38.009 INFO:teuthology.orchestra.run.smithi155.stdout: { 2023-08-01T19:56:38.009 INFO:teuthology.orchestra.run.smithi155.stdout: "event": "done", 2023-08-01T19:56:38.009 INFO:teuthology.orchestra.run.smithi155.stdout: "time": "2023-08-01T19:55:05.224141+0000", 2023-08-01T19:56:38.010 INFO:teuthology.orchestra.run.smithi155.stdout: "duration": 4.5385e-05 2023-08-01T19:56:38.010 INFO:teuthology.orchestra.run.smithi155.stdout: } 2023-08-01T19:56:38.010 INFO:teuthology.orchestra.run.smithi155.stdout: ] 2023-08-01T19:56:38.010 INFO:teuthology.orchestra.run.smithi155.stdout: } 2023-08-01T19:56:38.010 INFO:teuthology.orchestra.run.smithi155.stdout: }, 2023-08-01T19:56:38.010 INFO:teuthology.orchestra.run.smithi155.stdout: { 2023-08-01T19:56:38.010 INFO:teuthology.orchestra.run.smithi155.stdout: "description": "osd_op(client.4668.0:100245 5.e 5:71869c66:::benchmark_data_smithi006_114134_object100244:head [set-alloc-hint object_size 65536 write_size 65536,write 0~65536] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e37)", 2023-08-01T19:56:38.011 INFO:teuthology.orchestra.run.smithi155.stdout: "initiated_at": "2023-08-01T19:55:05.150991+0000", 2023-08-01T19:56:38.011 INFO:teuthology.orchestra.run.smithi155.stdout: "age": 92.825378115999996, 2023-08-01T19:56:38.011 INFO:teuthology.orchestra.run.smithi155.stdout: "duration": 0.070734490999999997, 2023-08-01T19:56:38.011 INFO:teuthology.orchestra.run.smithi155.stdout: "type_data": { 2023-08-01T19:56:38.011 INFO:teuthology.orchestra.run.smithi155.stdout: "flag_point": "commit sent; apply or cleanup", 2023-08-01T19:56:38.011 INFO:teuthology.orchestra.run.smithi155.stdout: "client_info": { 2023-08-01T19:56:38.011 INFO:teuthology.orchestra.run.smithi155.stdout: "client": "client.4668", 2023-08-01T19:56:38.011 INFO:teuthology.orchestra.run.smithi155.stdout: "client_addr": "172.21.15.6:0/1709472247", 2023-08-01T19:56:38.012 INFO:teuthology.orchestra.run.smithi155.stdout: "tid": 100245 2023-08-01T19:56:38.012 INFO:teuthology.orchestra.run.smithi155.stdout: }, 2023-08-01T19:56:38.012 INFO:teuthology.orchestra.run.smithi155.stdout: "events": [ 2023-08-01T19:56:38.012 INFO:teuthology.orchestra.run.smithi155.stdout: { 2023-08-01T19:56:38.012 INFO:teuthology.orchestra.run.smithi155.stdout: "event": "initiated", 2023-08-01T19:56:38.012 INFO:teuthology.orchestra.run.smithi155.stdout: "time": "2023-08-01T19:55:05.150991+0000", 2023-08-01T19:56:38.012 INFO:teuthology.orchestra.run.smithi155.stdout: "duration": 0 2023-08-01T19:56:38.012 INFO:teuthology.orchestra.run.smithi155.stdout: }, 2023-08-01T19:56:38.013 INFO:teuthology.orchestra.run.smithi155.stdout: { 2023-08-01T19:56:38.013 INFO:teuthology.orchestra.run.smithi155.stdout: "event": "throttled", 2023-08-01T19:56:38.013 INFO:teuthology.orchestra.run.smithi155.stdout: "time": "2023-08-01T19:55:05.150991+0000", 2023-08-01T19:56:38.013 INFO:teuthology.orchestra.run.smithi155.stdout: "duration": 0 2023-08-01T19:56:38.013 INFO:teuthology.orchestra.run.smithi155.stdout: }, 2023-08-01T19:56:38.013 INFO:teuthology.orchestra.run.smithi155.stdout: { 2023-08-01T19:56:38.013 INFO:teuthology.orchestra.run.smithi155.stdout: "event": "header_read", 2023-08-01T19:56:38.013 INFO:teuthology.orchestra.run.smithi155.stdout: "time": "2023-08-01T19:55:05.150990+0000", 2023-08-01T19:56:38.014 INFO:teuthology.orchestra.run.smithi155.stdout: "duration": 4294967295.999999 2023-08-01T19:56:38.014 INFO:teuthology.orchestra.run.smithi155.stdout: }, 2023-08-01T19:56:38.014 INFO:teuthology.orchestra.run.smithi155.stdout: { 2023-08-01T19:56:38.014 INFO:teuthology.orchestra.run.smithi155.stdout: "event": "all_read", 2023-08-01T19:56:38.014 INFO:teuthology.orchestra.run.smithi155.stdout: "time": "2023-08-01T19:55:05.151108+0000", 2023-08-01T19:56:38.014 INFO:teuthology.orchestra.run.smithi155.stdout: "duration": 0.00011849300000000001 2023-08-01T19:56:38.014 INFO:teuthology.orchestra.run.smithi155.stdout: }, 2023-08-01T19:56:38.014 INFO:teuthology.orchestra.run.smithi155.stdout: { 2023-08-01T19:56:38.015 INFO:teuthology.orchestra.run.smithi155.stdout: "event": "dispatched", 2023-08-01T19:56:38.015 INFO:teuthology.orchestra.run.smithi155.stdout: "time": "2023-08-01T19:55:05.151117+0000", 2023-08-01T19:56:38.015 INFO:teuthology.orchestra.run.smithi155.stdout: "duration": 8.1040000000000007e-06 2023-08-01T19:56:38.015 INFO:teuthology.orchestra.run.smithi155.stdout: }, 2023-08-01T19:56:38.015 INFO:teuthology.orchestra.run.smithi155.stdout: { 2023-08-01T19:56:38.015 INFO:teuthology.orchestra.run.smithi155.stdout: "event": "queued_for_pg", 2023-08-01T19:56:38.015 INFO:teuthology.orchestra.run.smithi155.stdout: "time": "2023-08-01T19:55:05.151121+0000", 2023-08-01T19:56:38.016 INFO:teuthology.orchestra.run.smithi155.stdout: "duration": 4.2019999999999997e-06 2023-08-01T19:56:38.016 INFO:teuthology.orchestra.run.smithi155.stdout: }, 2023-08-01T19:56:38.016 INFO:teuthology.orchestra.run.smithi155.stdout: { 2023-08-01T19:56:38.016 INFO:teuthology.orchestra.run.smithi155.stdout: "event": "reached_pg", 2023-08-01T19:56:38.016 INFO:teuthology.orchestra.run.smithi155.stdout: "time": "2023-08-01T19:55:05.151162+0000", 2023-08-01T19:56:38.016 INFO:teuthology.orchestra.run.smithi155.stdout: "duration": 4.1448e-05 2023-08-01T19:56:38.016 INFO:teuthology.orchestra.run.smithi155.stdout: }, 2023-08-01T19:56:38.016 INFO:teuthology.orchestra.run.smithi155.stdout: { 2023-08-01T19:56:38.017 INFO:teuthology.orchestra.run.smithi155.stdout: "event": "started", 2023-08-01T19:56:38.017 INFO:teuthology.orchestra.run.smithi155.stdout: "time": "2023-08-01T19:55:05.151281+0000", 2023-08-01T19:56:38.017 INFO:teuthology.orchestra.run.smithi155.stdout: "duration": 0.000119141 2023-08-01T19:56:38.017 INFO:teuthology.orchestra.run.smithi155.stdout: }, 2023-08-01T19:56:38.017 INFO:teuthology.orchestra.run.smithi155.stdout: { 2023-08-01T19:56:38.017 INFO:teuthology.orchestra.run.smithi155.stdout: "event": "waiting for subops from 0", 2023-08-01T19:56:38.017 INFO:teuthology.orchestra.run.smithi155.stdout: "time": "2023-08-01T19:55:05.151443+0000", 2023-08-01T19:56:38.017 INFO:teuthology.orchestra.run.smithi155.stdout: "duration": 0.00016181600000000001 2023-08-01T19:56:38.018 INFO:teuthology.orchestra.run.smithi155.stdout: }, 2023-08-01T19:56:38.018 INFO:teuthology.orchestra.run.smithi155.stdout: { 2023-08-01T19:56:38.018 INFO:teuthology.orchestra.run.smithi155.stdout: "event": "sub_op_commit_rec", 2023-08-01T19:56:38.018 INFO:teuthology.orchestra.run.smithi155.stdout: "time": "2023-08-01T19:55:05.219101+0000", 2023-08-01T19:56:38.018 INFO:teuthology.orchestra.run.smithi155.stdout: "duration": 0.067658037000000004 2023-08-01T19:56:38.018 INFO:teuthology.orchestra.run.smithi155.stdout: }, 2023-08-01T19:56:38.018 INFO:teuthology.orchestra.run.smithi155.stdout: { 2023-08-01T19:56:38.018 INFO:teuthology.orchestra.run.smithi155.stdout: "event": "op_commit", 2023-08-01T19:56:38.019 INFO:teuthology.orchestra.run.smithi155.stdout: "time": "2023-08-01T19:55:05.221646+0000", 2023-08-01T19:56:38.019 INFO:teuthology.orchestra.run.smithi155.stdout: "duration": 0.0025450540000000002 2023-08-01T19:56:38.019 INFO:teuthology.orchestra.run.smithi155.stdout: }, 2023-08-01T19:56:38.019 INFO:teuthology.orchestra.run.smithi155.stdout: { 2023-08-01T19:56:38.019 INFO:teuthology.orchestra.run.smithi155.stdout: "event": "commit_sent", 2023-08-01T19:56:38.019 INFO:teuthology.orchestra.run.smithi155.stdout: "time": "2023-08-01T19:55:05.221689+0000", 2023-08-01T19:56:38.019 INFO:teuthology.orchestra.run.smithi155.stdout: "duration": 4.3078999999999999e-05 2023-08-01T19:56:38.019 INFO:teuthology.orchestra.run.smithi155.stdout: }, 2023-08-01T19:56:38.020 INFO:teuthology.orchestra.run.smithi155.stdout: { 2023-08-01T19:56:38.020 INFO:teuthology.orchestra.run.smithi155.stdout: "event": "done", 2023-08-01T19:56:38.020 INFO:teuthology.orchestra.run.smithi155.stdout: "time": "2023-08-01T19:55:05.221725+0000", 2023-08-01T19:56:38.020 INFO:teuthology.orchestra.run.smithi155.stdout: "duration": 3.6137999999999999e-05 2023-08-01T19:56:38.020 INFO:teuthology.orchestra.run.smithi155.stdout: } 2023-08-01T19:56:38.020 INFO:teuthology.orchestra.run.smithi155.stdout: ] 2023-08-01T19:56:38.020 INFO:teuthology.orchestra.run.smithi155.stdout: } 2023-08-01T19:56:38.020 INFO:teuthology.orchestra.run.smithi155.stdout: }, 2023-08-01T19:56:38.021 INFO:teuthology.orchestra.run.smithi155.stdout: { 2023-08-01T19:56:38.021 INFO:teuthology.orchestra.run.smithi155.stdout: "description": "osd_repop(client.4668.0:100243 5.a e37/19 5:5e8193b6:::benchmark_data_smithi006_114134_object100242:head v 37'6228, mlcod=37'6225)", 2023-08-01T19:56:38.021 INFO:teuthology.orchestra.run.smithi155.stdout: "initiated_at": "2023-08-01T19:55:05.151148+0000", 2023-08-01T19:56:38.021 INFO:teuthology.orchestra.run.smithi155.stdout: "age": 92.825221104999997, 2023-08-01T19:56:38.021 INFO:teuthology.orchestra.run.smithi155.stdout: "duration": 0.073020370000000001, 2023-08-01T19:56:38.021 INFO:teuthology.orchestra.run.smithi155.stdout: "type_data": { 2023-08-01T19:56:38.021 INFO:teuthology.orchestra.run.smithi155.stdout: "flag_point": "commit sent; apply or cleanup", 2023-08-01T19:56:38.022 INFO:teuthology.orchestra.run.smithi155.stdout: "events": [ 2023-08-01T19:56:38.022 INFO:teuthology.orchestra.run.smithi155.stdout: { 2023-08-01T19:56:38.022 INFO:teuthology.orchestra.run.smithi155.stdout: "event": "initiated", 2023-08-01T19:56:38.022 INFO:teuthology.orchestra.run.smithi155.stdout: "time": "2023-08-01T19:55:05.151148+0000", 2023-08-01T19:56:38.022 INFO:teuthology.orchestra.run.smithi155.stdout: "duration": 0 2023-08-01T19:56:38.022 INFO:teuthology.orchestra.run.smithi155.stdout: }, 2023-08-01T19:56:38.022 INFO:teuthology.orchestra.run.smithi155.stdout: { 2023-08-01T19:56:38.022 INFO:teuthology.orchestra.run.smithi155.stdout: "event": "throttled", 2023-08-01T19:56:38.023 INFO:teuthology.orchestra.run.smithi155.stdout: "time": "2023-08-01T19:55:05.151148+0000", 2023-08-01T19:56:38.023 INFO:teuthology.orchestra.run.smithi155.stdout: "duration": 0 2023-08-01T19:56:38.023 INFO:teuthology.orchestra.run.smithi155.stdout: }, 2023-08-01T19:56:38.023 INFO:teuthology.orchestra.run.smithi155.stdout: { 2023-08-01T19:56:38.023 INFO:teuthology.orchestra.run.smithi155.stdout: "event": "header_read", 2023-08-01T19:56:38.023 INFO:teuthology.orchestra.run.smithi155.stdout: "time": "2023-08-01T19:55:05.151147+0000", 2023-08-01T19:56:38.023 INFO:teuthology.orchestra.run.smithi155.stdout: "duration": 4294967295.9999995 2023-08-01T19:56:38.023 INFO:teuthology.orchestra.run.smithi155.stdout: }, 2023-08-01T19:56:38.024 INFO:teuthology.orchestra.run.smithi155.stdout: { 2023-08-01T19:56:38.024 INFO:teuthology.orchestra.run.smithi155.stdout: "event": "all_read", 2023-08-01T19:56:38.024 INFO:teuthology.orchestra.run.smithi155.stdout: "time": "2023-08-01T19:55:05.151231+0000", 2023-08-01T19:56:38.024 INFO:teuthology.orchestra.run.smithi155.stdout: "duration": 8.3135999999999998e-05 2023-08-01T19:56:38.024 INFO:teuthology.orchestra.run.smithi155.stdout: }, 2023-08-01T19:56:38.024 INFO:teuthology.orchestra.run.smithi155.stdout: { 2023-08-01T19:56:38.024 INFO:teuthology.orchestra.run.smithi155.stdout: "event": "dispatched", 2023-08-01T19:56:38.024 INFO:teuthology.orchestra.run.smithi155.stdout: "time": "2023-08-01T19:55:05.151239+0000", 2023-08-01T19:56:38.025 INFO:teuthology.orchestra.run.smithi155.stdout: "duration": 8.7469999999999994e-06 2023-08-01T19:56:38.025 INFO:teuthology.orchestra.run.smithi155.stdout: }, 2023-08-01T19:56:38.025 INFO:teuthology.orchestra.run.smithi155.stdout: { 2023-08-01T19:56:38.025 INFO:teuthology.orchestra.run.smithi155.stdout: "event": "queued_for_pg", 2023-08-01T19:56:38.025 INFO:teuthology.orchestra.run.smithi155.stdout: "time": "2023-08-01T19:55:05.151244+0000", 2023-08-01T19:56:38.025 INFO:teuthology.orchestra.run.smithi155.stdout: "duration": 4.4800000000000003e-06 2023-08-01T19:56:38.025 INFO:teuthology.orchestra.run.smithi155.stdout: }, 2023-08-01T19:56:38.025 INFO:teuthology.orchestra.run.smithi155.stdout: { 2023-08-01T19:56:38.026 INFO:teuthology.orchestra.run.smithi155.stdout: "event": "reached_pg", 2023-08-01T19:56:38.026 INFO:teuthology.orchestra.run.smithi155.stdout: "time": "2023-08-01T19:55:05.152938+0000", 2023-08-01T19:56:38.026 INFO:teuthology.orchestra.run.smithi155.stdout: "duration": 0.001693824 2023-08-01T19:56:38.026 INFO:teuthology.orchestra.run.smithi155.stdout: }, 2023-08-01T19:56:38.026 INFO:teuthology.orchestra.run.smithi155.stdout: { 2023-08-01T19:56:38.026 INFO:teuthology.orchestra.run.smithi155.stdout: "event": "started", 2023-08-01T19:56:38.026 INFO:teuthology.orchestra.run.smithi155.stdout: "time": "2023-08-01T19:55:05.152956+0000", 2023-08-01T19:56:38.026 INFO:teuthology.orchestra.run.smithi155.stdout: "duration": 1.8287e-05 2023-08-01T19:56:38.027 INFO:teuthology.orchestra.run.smithi155.stdout: }, 2023-08-01T19:56:38.027 INFO:teuthology.orchestra.run.smithi155.stdout: { 2023-08-01T19:56:38.027 INFO:teuthology.orchestra.run.smithi155.stdout: "event": "commit_sent", 2023-08-01T19:56:38.027 INFO:teuthology.orchestra.run.smithi155.stdout: "time": "2023-08-01T19:55:05.224145+0000", 2023-08-01T19:56:38.027 INFO:teuthology.orchestra.run.smithi155.stdout: "duration": 0.071189447000000003 2023-08-01T19:56:38.027 INFO:teuthology.orchestra.run.smithi155.stdout: }, 2023-08-01T19:56:38.027 INFO:teuthology.orchestra.run.smithi155.stdout: { 2023-08-01T19:56:38.028 INFO:teuthology.orchestra.run.smithi155.stdout: "event": "done", 2023-08-01T19:56:38.028 INFO:teuthology.orchestra.run.smithi155.stdout: "time": "2023-08-01T19:55:05.224168+0000", 2023-08-01T19:56:38.028 INFO:teuthology.orchestra.run.smithi155.stdout: "duration": 2.3008999999999999e-05 2023-08-01T19:56:38.028 INFO:teuthology.orchestra.run.smithi155.stdout: } 2023-08-01T19:56:38.028 INFO:teuthology.orchestra.run.smithi155.stdout: ] 2023-08-01T19:56:38.028 INFO:teuthology.orchestra.run.smithi155.stdout: } 2023-08-01T19:56:38.028 INFO:teuthology.orchestra.run.smithi155.stdout: }, 2023-08-01T19:56:38.028 INFO:teuthology.orchestra.run.smithi155.stdout: { 2023-08-01T19:56:38.029 INFO:teuthology.orchestra.run.smithi155.stdout: "description": "osd_repop(client.4668.0:100244 5.9 e37/19 5:92f56a12:::benchmark_data_smithi006_114134_object100243:head v 37'6294, mlcod=37'6292)", 2023-08-01T19:56:38.029 INFO:teuthology.orchestra.run.smithi155.stdout: "initiated_at": "2023-08-01T19:55:05.151325+0000", 2023-08-01T19:56:38.029 INFO:teuthology.orchestra.run.smithi155.stdout: "age": 92.82504376, 2023-08-01T19:56:38.029 INFO:teuthology.orchestra.run.smithi155.stdout: "duration": 0.071883673999999995, 2023-08-01T19:56:38.029 INFO:teuthology.orchestra.run.smithi155.stdout: "type_data": { 2023-08-01T19:56:38.029 INFO:teuthology.orchestra.run.smithi155.stdout: "flag_point": "commit sent; apply or cleanup", 2023-08-01T19:56:38.029 INFO:teuthology.orchestra.run.smithi155.stdout: "events": [ 2023-08-01T19:56:38.029 INFO:teuthology.orchestra.run.smithi155.stdout: { 2023-08-01T19:56:38.030 INFO:teuthology.orchestra.run.smithi155.stdout: "event": "initiated", 2023-08-01T19:56:38.030 INFO:teuthology.orchestra.run.smithi155.stdout: "time": "2023-08-01T19:55:05.151325+0000", 2023-08-01T19:56:38.030 INFO:teuthology.orchestra.run.smithi155.stdout: "duration": 0 2023-08-01T19:56:38.030 INFO:teuthology.orchestra.run.smithi155.stdout: }, 2023-08-01T19:56:38.030 INFO:teuthology.orchestra.run.smithi155.stdout: { 2023-08-01T19:56:38.030 INFO:teuthology.orchestra.run.smithi155.stdout: "event": "throttled", 2023-08-01T19:56:38.030 INFO:teuthology.orchestra.run.smithi155.stdout: "time": "2023-08-01T19:55:05.151325+0000", 2023-08-01T19:56:38.031 INFO:teuthology.orchestra.run.smithi155.stdout: "duration": 0 2023-08-01T19:56:38.031 INFO:teuthology.orchestra.run.smithi155.stdout: }, 2023-08-01T19:56:38.031 INFO:teuthology.orchestra.run.smithi155.stdout: { 2023-08-01T19:56:38.031 INFO:teuthology.orchestra.run.smithi155.stdout: "event": "header_read", 2023-08-01T19:56:38.031 INFO:teuthology.orchestra.run.smithi155.stdout: "time": "2023-08-01T19:55:05.151325+0000", 2023-08-01T19:56:38.031 INFO:teuthology.orchestra.run.smithi155.stdout: "duration": 4294967295.9999995 2023-08-01T19:56:38.031 INFO:teuthology.orchestra.run.smithi155.stdout: }, 2023-08-01T19:56:38.031 INFO:teuthology.orchestra.run.smithi155.stdout: { 2023-08-01T19:56:38.032 INFO:teuthology.orchestra.run.smithi155.stdout: "event": "all_read", 2023-08-01T19:56:38.032 INFO:teuthology.orchestra.run.smithi155.stdout: "time": "2023-08-01T19:55:05.151390+0000", 2023-08-01T19:56:38.032 INFO:teuthology.orchestra.run.smithi155.stdout: "duration": 6.5456999999999993e-05 2023-08-01T19:56:38.032 INFO:teuthology.orchestra.run.smithi155.stdout: }, 2023-08-01T19:56:38.032 INFO:teuthology.orchestra.run.smithi155.stdout: { 2023-08-01T19:56:38.032 INFO:teuthology.orchestra.run.smithi155.stdout: "event": "dispatched", 2023-08-01T19:56:38.032 INFO:teuthology.orchestra.run.smithi155.stdout: "time": "2023-08-01T19:55:05.151396+0000", 2023-08-01T19:56:38.032 INFO:teuthology.orchestra.run.smithi155.stdout: "duration": 5.9190000000000004e-06 2023-08-01T19:56:38.033 INFO:teuthology.orchestra.run.smithi155.stdout: }, 2023-08-01T19:56:38.033 INFO:teuthology.orchestra.run.smithi155.stdout: { 2023-08-01T19:56:38.033 INFO:teuthology.orchestra.run.smithi155.stdout: "event": "queued_for_pg", 2023-08-01T19:56:38.033 INFO:teuthology.orchestra.run.smithi155.stdout: "time": "2023-08-01T19:55:05.151400+0000", 2023-08-01T19:56:38.033 INFO:teuthology.orchestra.run.smithi155.stdout: "duration": 4.1030000000000004e-06 2023-08-01T19:56:38.033 INFO:teuthology.orchestra.run.smithi155.stdout: }, 2023-08-01T19:56:38.033 INFO:teuthology.orchestra.run.smithi155.stdout: { 2023-08-01T19:56:38.033 INFO:teuthology.orchestra.run.smithi155.stdout: "event": "reached_pg", 2023-08-01T19:56:38.034 INFO:teuthology.orchestra.run.smithi155.stdout: "time": "2023-08-01T19:55:05.151452+0000", 2023-08-01T19:56:38.034 INFO:teuthology.orchestra.run.smithi155.stdout: "duration": 5.2136999999999999e-05 2023-08-01T19:56:38.034 INFO:teuthology.orchestra.run.smithi155.stdout: }, 2023-08-01T19:56:38.034 INFO:teuthology.orchestra.run.smithi155.stdout: { 2023-08-01T19:56:38.034 INFO:teuthology.orchestra.run.smithi155.stdout: "event": "started", 2023-08-01T19:56:38.034 INFO:teuthology.orchestra.run.smithi155.stdout: "time": "2023-08-01T19:55:05.151470+0000", 2023-08-01T19:56:38.034 INFO:teuthology.orchestra.run.smithi155.stdout: "duration": 1.8e-05 2023-08-01T19:56:38.035 INFO:teuthology.orchestra.run.smithi155.stdout: }, 2023-08-01T19:56:38.035 INFO:teuthology.orchestra.run.smithi155.stdout: { 2023-08-01T19:56:38.035 INFO:teuthology.orchestra.run.smithi155.stdout: "event": "commit_sent", 2023-08-01T19:56:38.035 INFO:teuthology.orchestra.run.smithi155.stdout: "time": "2023-08-01T19:55:05.223183+0000", 2023-08-01T19:56:38.035 INFO:teuthology.orchestra.run.smithi155.stdout: "duration": 0.071712622000000004 2023-08-01T19:56:38.035 INFO:teuthology.orchestra.run.smithi155.stdout: }, 2023-08-01T19:56:38.035 INFO:teuthology.orchestra.run.smithi155.stdout: { 2023-08-01T19:56:38.035 INFO:teuthology.orchestra.run.smithi155.stdout: "event": "done", 2023-08-01T19:56:38.036 INFO:teuthology.orchestra.run.smithi155.stdout: "time": "2023-08-01T19:55:05.223209+0000", 2023-08-01T19:56:38.036 INFO:teuthology.orchestra.run.smithi155.stdout: "duration": 2.5956e-05 2023-08-01T19:56:38.036 INFO:teuthology.orchestra.run.smithi155.stdout: } 2023-08-01T19:56:38.036 INFO:teuthology.orchestra.run.smithi155.stdout: ] 2023-08-01T19:56:38.036 INFO:teuthology.orchestra.run.smithi155.stdout: } 2023-08-01T19:56:38.036 INFO:teuthology.orchestra.run.smithi155.stdout: }, 2023-08-01T19:56:38.036 INFO:teuthology.orchestra.run.smithi155.stdout: { 2023-08-01T19:56:38.036 INFO:teuthology.orchestra.run.smithi155.stdout: "description": "osd_op(client.4668.0:100249 5.b 5:d0666827:::benchmark_data_smithi006_114134_object100248:head [set-alloc-hint object_size 65536 write_size 65536,write 0~65536] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e37)", 2023-08-01T19:56:38.037 INFO:teuthology.orchestra.run.smithi155.stdout: "initiated_at": "2023-08-01T19:55:05.153614+0000", 2023-08-01T19:56:38.037 INFO:teuthology.orchestra.run.smithi155.stdout: "age": 92.822755334999997, 2023-08-01T19:56:38.037 INFO:teuthology.orchestra.run.smithi155.stdout: "duration": 0.069286118999999993, 2023-08-01T19:56:38.037 INFO:teuthology.orchestra.run.smithi155.stdout: "type_data": { 2023-08-01T19:56:38.037 INFO:teuthology.orchestra.run.smithi155.stdout: "flag_point": "commit sent; apply or cleanup", 2023-08-01T19:56:38.037 INFO:teuthology.orchestra.run.smithi155.stdout: "client_info": { 2023-08-01T19:56:38.037 INFO:teuthology.orchestra.run.smithi155.stdout: "client": "client.4668", 2023-08-01T19:56:38.037 INFO:teuthology.orchestra.run.smithi155.stdout: "client_addr": "172.21.15.6:0/1709472247", 2023-08-01T19:56:38.038 INFO:teuthology.orchestra.run.smithi155.stdout: "tid": 100249 2023-08-01T19:56:38.038 INFO:teuthology.orchestra.run.smithi155.stdout: }, 2023-08-01T19:56:38.038 INFO:teuthology.orchestra.run.smithi155.stdout: "events": [ 2023-08-01T19:56:38.038 INFO:teuthology.orchestra.run.smithi155.stdout: { 2023-08-01T19:56:38.038 INFO:teuthology.orchestra.run.smithi155.stdout: "event": "initiated", 2023-08-01T19:56:38.038 INFO:teuthology.orchestra.run.smithi155.stdout: "time": "2023-08-01T19:55:05.153614+0000", 2023-08-01T19:56:38.038 INFO:teuthology.orchestra.run.smithi155.stdout: "duration": 0 2023-08-01T19:56:38.039 INFO:teuthology.orchestra.run.smithi155.stdout: }, 2023-08-01T19:56:38.039 INFO:teuthology.orchestra.run.smithi155.stdout: { 2023-08-01T19:56:38.039 INFO:teuthology.orchestra.run.smithi155.stdout: "event": "throttled", 2023-08-01T19:56:38.039 INFO:teuthology.orchestra.run.smithi155.stdout: "time": "2023-08-01T19:55:05.153614+0000", 2023-08-01T19:56:38.039 INFO:teuthology.orchestra.run.smithi155.stdout: "duration": 0 2023-08-01T19:56:38.039 INFO:teuthology.orchestra.run.smithi155.stdout: }, 2023-08-01T19:56:38.039 INFO:teuthology.orchestra.run.smithi155.stdout: { 2023-08-01T19:56:38.039 INFO:teuthology.orchestra.run.smithi155.stdout: "event": "header_read", 2023-08-01T19:56:38.040 INFO:teuthology.orchestra.run.smithi155.stdout: "time": "2023-08-01T19:55:05.153612+0000", 2023-08-01T19:56:38.040 INFO:teuthology.orchestra.run.smithi155.stdout: "duration": 4294967295.9999986 2023-08-01T19:56:38.040 INFO:teuthology.orchestra.run.smithi155.stdout: }, 2023-08-01T19:56:38.040 INFO:teuthology.orchestra.run.smithi155.stdout: { 2023-08-01T19:56:38.040 INFO:teuthology.orchestra.run.smithi155.stdout: "event": "all_read", 2023-08-01T19:56:38.040 INFO:teuthology.orchestra.run.smithi155.stdout: "time": "2023-08-01T19:55:05.153694+0000", 2023-08-01T19:56:38.040 INFO:teuthology.orchestra.run.smithi155.stdout: "duration": 8.1618000000000004e-05 2023-08-01T19:56:38.040 INFO:teuthology.orchestra.run.smithi155.stdout: }, 2023-08-01T19:56:38.041 INFO:teuthology.orchestra.run.smithi155.stdout: { 2023-08-01T19:56:38.041 INFO:teuthology.orchestra.run.smithi155.stdout: "event": "dispatched", 2023-08-01T19:56:38.041 INFO:teuthology.orchestra.run.smithi155.stdout: "time": "2023-08-01T19:55:05.153713+0000", 2023-08-01T19:56:38.041 INFO:teuthology.orchestra.run.smithi155.stdout: "duration": 1.9069999999999999e-05 2023-08-01T19:56:38.041 INFO:teuthology.orchestra.run.smithi155.stdout: }, 2023-08-01T19:56:38.041 INFO:teuthology.orchestra.run.smithi155.stdout: { 2023-08-01T19:56:38.041 INFO:teuthology.orchestra.run.smithi155.stdout: "event": "queued_for_pg", 2023-08-01T19:56:38.041 INFO:teuthology.orchestra.run.smithi155.stdout: "time": "2023-08-01T19:55:05.153726+0000", 2023-08-01T19:56:38.042 INFO:teuthology.orchestra.run.smithi155.stdout: "duration": 1.238e-05 2023-08-01T19:56:38.042 INFO:teuthology.orchestra.run.smithi155.stdout: }, 2023-08-01T19:56:38.042 INFO:teuthology.orchestra.run.smithi155.stdout: { 2023-08-01T19:56:38.042 INFO:teuthology.orchestra.run.smithi155.stdout: "event": "reached_pg", 2023-08-01T19:56:38.042 INFO:teuthology.orchestra.run.smithi155.stdout: "time": "2023-08-01T19:55:05.153761+0000", 2023-08-01T19:56:38.042 INFO:teuthology.orchestra.run.smithi155.stdout: "duration": 3.5046999999999998e-05 2023-08-01T19:56:38.042 INFO:teuthology.orchestra.run.smithi155.stdout: }, 2023-08-01T19:56:38.042 INFO:teuthology.orchestra.run.smithi155.stdout: { 2023-08-01T19:56:38.043 INFO:teuthology.orchestra.run.smithi155.stdout: "event": "started", 2023-08-01T19:56:38.043 INFO:teuthology.orchestra.run.smithi155.stdout: "time": "2023-08-01T19:55:05.153896+0000", 2023-08-01T19:56:38.043 INFO:teuthology.orchestra.run.smithi155.stdout: "duration": 0.00013575800000000001 2023-08-01T19:56:38.043 INFO:teuthology.orchestra.run.smithi155.stdout: }, 2023-08-01T19:56:38.043 INFO:teuthology.orchestra.run.smithi155.stdout: { 2023-08-01T19:56:38.043 INFO:teuthology.orchestra.run.smithi155.stdout: "event": "waiting for subops from 0", 2023-08-01T19:56:38.043 INFO:teuthology.orchestra.run.smithi155.stdout: "time": "2023-08-01T19:55:05.154043+0000", 2023-08-01T19:56:38.044 INFO:teuthology.orchestra.run.smithi155.stdout: "duration": 0.00014650700000000001 2023-08-01T19:56:38.044 INFO:teuthology.orchestra.run.smithi155.stdout: }, 2023-08-01T19:56:38.044 INFO:teuthology.orchestra.run.smithi155.stdout: { 2023-08-01T19:56:38.044 INFO:teuthology.orchestra.run.smithi155.stdout: "event": "sub_op_commit_rec", 2023-08-01T19:56:38.044 INFO:teuthology.orchestra.run.smithi155.stdout: "time": "2023-08-01T19:55:05.221876+0000", 2023-08-01T19:56:38.044 INFO:teuthology.orchestra.run.smithi155.stdout: "duration": 0.067832796000000001 2023-08-01T19:56:38.044 INFO:teuthology.orchestra.run.smithi155.stdout: }, 2023-08-01T19:56:38.044 INFO:teuthology.orchestra.run.smithi155.stdout: { 2023-08-01T19:56:38.045 INFO:teuthology.orchestra.run.smithi155.stdout: "event": "op_commit", 2023-08-01T19:56:38.045 INFO:teuthology.orchestra.run.smithi155.stdout: "time": "2023-08-01T19:55:05.222813+0000", 2023-08-01T19:56:38.045 INFO:teuthology.orchestra.run.smithi155.stdout: "duration": 0.00093755300000000004 2023-08-01T19:56:38.045 INFO:teuthology.orchestra.run.smithi155.stdout: }, 2023-08-01T19:56:38.045 INFO:teuthology.orchestra.run.smithi155.stdout: { 2023-08-01T19:56:38.045 INFO:teuthology.orchestra.run.smithi155.stdout: "event": "commit_sent", 2023-08-01T19:56:38.045 INFO:teuthology.orchestra.run.smithi155.stdout: "time": "2023-08-01T19:55:05.222861+0000", 2023-08-01T19:56:38.045 INFO:teuthology.orchestra.run.smithi155.stdout: "duration": 4.8013999999999998e-05 2023-08-01T19:56:38.046 INFO:teuthology.orchestra.run.smithi155.stdout: }, 2023-08-01T19:56:38.046 INFO:teuthology.orchestra.run.smithi155.stdout: { 2023-08-01T19:56:38.046 INFO:teuthology.orchestra.run.smithi155.stdout: "event": "done", 2023-08-01T19:56:38.046 INFO:teuthology.orchestra.run.smithi155.stdout: "time": "2023-08-01T19:55:05.222900+0000", 2023-08-01T19:56:38.046 INFO:teuthology.orchestra.run.smithi155.stdout: "duration": 3.8634999999999999e-05 2023-08-01T19:56:38.046 INFO:teuthology.orchestra.run.smithi155.stdout: } 2023-08-01T19:56:38.046 INFO:teuthology.orchestra.run.smithi155.stdout: ] 2023-08-01T19:56:38.046 INFO:teuthology.orchestra.run.smithi155.stdout: } 2023-08-01T19:56:38.047 INFO:teuthology.orchestra.run.smithi155.stdout: }, 2023-08-01T19:56:38.047 INFO:teuthology.orchestra.run.smithi155.stdout: { 2023-08-01T19:56:38.047 INFO:teuthology.orchestra.run.smithi155.stdout: "description": "osd_op(client.4668.0:100251 5.b 5:d853df24:::benchmark_data_smithi006_114134_object100250:head [set-alloc-hint object_size 65536 write_size 65536,write 0~65536] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e37)", 2023-08-01T19:56:38.047 INFO:teuthology.orchestra.run.smithi155.stdout: "initiated_at": "2023-08-01T19:55:05.153737+0000", 2023-08-01T19:56:38.047 INFO:teuthology.orchestra.run.smithi155.stdout: "age": 92.822632321, 2023-08-01T19:56:38.047 INFO:teuthology.orchestra.run.smithi155.stdout: "duration": 0.071366545000000003, 2023-08-01T19:56:38.047 INFO:teuthology.orchestra.run.smithi155.stdout: "type_data": { 2023-08-01T19:56:38.047 INFO:teuthology.orchestra.run.smithi155.stdout: "flag_point": "commit sent; apply or cleanup", 2023-08-01T19:56:38.048 INFO:teuthology.orchestra.run.smithi155.stdout: "client_info": { 2023-08-01T19:56:38.048 INFO:teuthology.orchestra.run.smithi155.stdout: "client": "client.4668", 2023-08-01T19:56:38.048 INFO:teuthology.orchestra.run.smithi155.stdout: "client_addr": "172.21.15.6:0/1709472247", 2023-08-01T19:56:38.048 INFO:teuthology.orchestra.run.smithi155.stdout: "tid": 100251 2023-08-01T19:56:38.048 INFO:teuthology.orchestra.run.smithi155.stdout: }, 2023-08-01T19:56:38.048 INFO:teuthology.orchestra.run.smithi155.stdout: "events": [ 2023-08-01T19:56:38.048 INFO:teuthology.orchestra.run.smithi155.stdout: { 2023-08-01T19:56:38.048 INFO:teuthology.orchestra.run.smithi155.stdout: "event": "initiated", 2023-08-01T19:56:38.049 INFO:teuthology.orchestra.run.smithi155.stdout: "time": "2023-08-01T19:55:05.153737+0000", 2023-08-01T19:56:38.049 INFO:teuthology.orchestra.run.smithi155.stdout: "duration": 0 2023-08-01T19:56:38.049 INFO:teuthology.orchestra.run.smithi155.stdout: }, 2023-08-01T19:56:38.049 INFO:teuthology.orchestra.run.smithi155.stdout: { 2023-08-01T19:56:38.049 INFO:teuthology.orchestra.run.smithi155.stdout: "event": "throttled", 2023-08-01T19:56:38.049 INFO:teuthology.orchestra.run.smithi155.stdout: "time": "2023-08-01T19:55:05.153737+0000", 2023-08-01T19:56:38.049 INFO:teuthology.orchestra.run.smithi155.stdout: "duration": 0 2023-08-01T19:56:38.049 INFO:teuthology.orchestra.run.smithi155.stdout: }, 2023-08-01T19:56:38.050 INFO:teuthology.orchestra.run.smithi155.stdout: { 2023-08-01T19:56:38.050 INFO:teuthology.orchestra.run.smithi155.stdout: "event": "header_read", 2023-08-01T19:56:38.050 INFO:teuthology.orchestra.run.smithi155.stdout: "time": "2023-08-01T19:55:05.153736+0000", 2023-08-01T19:56:38.050 INFO:teuthology.orchestra.run.smithi155.stdout: "duration": 4294967295.9999995 2023-08-01T19:56:38.050 INFO:teuthology.orchestra.run.smithi155.stdout: }, 2023-08-01T19:56:38.050 INFO:teuthology.orchestra.run.smithi155.stdout: { 2023-08-01T19:56:38.050 INFO:teuthology.orchestra.run.smithi155.stdout: "event": "all_read", 2023-08-01T19:56:38.050 INFO:teuthology.orchestra.run.smithi155.stdout: "time": "2023-08-01T19:55:05.153784+0000", 2023-08-01T19:56:38.051 INFO:teuthology.orchestra.run.smithi155.stdout: "duration": 4.7660000000000001e-05 2023-08-01T19:56:38.051 INFO:teuthology.orchestra.run.smithi155.stdout: }, 2023-08-01T19:56:38.051 INFO:teuthology.orchestra.run.smithi155.stdout: { 2023-08-01T19:56:38.051 INFO:teuthology.orchestra.run.smithi155.stdout: "event": "dispatched", 2023-08-01T19:56:38.051 INFO:teuthology.orchestra.run.smithi155.stdout: "time": "2023-08-01T19:55:05.153793+0000", 2023-08-01T19:56:38.051 INFO:teuthology.orchestra.run.smithi155.stdout: "duration": 8.7150000000000004e-06 2023-08-01T19:56:38.051 INFO:teuthology.orchestra.run.smithi155.stdout: }, 2023-08-01T19:56:38.052 INFO:teuthology.orchestra.run.smithi155.stdout: { 2023-08-01T19:56:38.052 INFO:teuthology.orchestra.run.smithi155.stdout: "event": "queued_for_pg", 2023-08-01T19:56:38.052 INFO:teuthology.orchestra.run.smithi155.stdout: "time": "2023-08-01T19:55:05.153800+0000", 2023-08-01T19:56:38.052 INFO:teuthology.orchestra.run.smithi155.stdout: "duration": 7.2459999999999997e-06 2023-08-01T19:56:38.052 INFO:teuthology.orchestra.run.smithi155.stdout: }, 2023-08-01T19:56:38.052 INFO:teuthology.orchestra.run.smithi155.stdout: { 2023-08-01T19:56:38.052 INFO:teuthology.orchestra.run.smithi155.stdout: "event": "reached_pg", 2023-08-01T19:56:38.052 INFO:teuthology.orchestra.run.smithi155.stdout: "time": "2023-08-01T19:55:05.156241+0000", 2023-08-01T19:56:38.053 INFO:teuthology.orchestra.run.smithi155.stdout: "duration": 0.0024415359999999998 2023-08-01T19:56:38.053 INFO:teuthology.orchestra.run.smithi155.stdout: }, 2023-08-01T19:56:38.053 INFO:teuthology.orchestra.run.smithi155.stdout: { 2023-08-01T19:56:38.053 INFO:teuthology.orchestra.run.smithi155.stdout: "event": "started", 2023-08-01T19:56:38.053 INFO:teuthology.orchestra.run.smithi155.stdout: "time": "2023-08-01T19:55:05.219045+0000", 2023-08-01T19:56:38.053 INFO:teuthology.orchestra.run.smithi155.stdout: "duration": 0.062803855000000006 2023-08-01T19:56:38.053 INFO:teuthology.orchestra.run.smithi155.stdout: }, 2023-08-01T19:56:38.053 INFO:teuthology.orchestra.run.smithi155.stdout: { 2023-08-01T19:56:38.054 INFO:teuthology.orchestra.run.smithi155.stdout: "event": "waiting for subops from 0", 2023-08-01T19:56:38.054 INFO:teuthology.orchestra.run.smithi155.stdout: "time": "2023-08-01T19:55:05.219238+0000", 2023-08-01T19:56:38.054 INFO:teuthology.orchestra.run.smithi155.stdout: "duration": 0.00019241500000000001 2023-08-01T19:56:38.054 INFO:teuthology.orchestra.run.smithi155.stdout: }, 2023-08-01T19:56:38.054 INFO:teuthology.orchestra.run.smithi155.stdout: { 2023-08-01T19:56:38.054 INFO:teuthology.orchestra.run.smithi155.stdout: "event": "sub_op_commit_rec", 2023-08-01T19:56:38.054 INFO:teuthology.orchestra.run.smithi155.stdout: "time": "2023-08-01T19:55:05.223300+0000", 2023-08-01T19:56:38.054 INFO:teuthology.orchestra.run.smithi155.stdout: "duration": 0.0040626509999999996 2023-08-01T19:56:38.055 INFO:teuthology.orchestra.run.smithi155.stdout: }, 2023-08-01T19:56:38.055 INFO:teuthology.orchestra.run.smithi155.stdout: { 2023-08-01T19:56:38.055 INFO:teuthology.orchestra.run.smithi155.stdout: "event": "op_commit", 2023-08-01T19:56:38.055 INFO:teuthology.orchestra.run.smithi155.stdout: "time": "2023-08-01T19:55:05.225020+0000", 2023-08-01T19:56:38.055 INFO:teuthology.orchestra.run.smithi155.stdout: "duration": 0.0017201 2023-08-01T19:56:38.055 INFO:teuthology.orchestra.run.smithi155.stdout: }, 2023-08-01T19:56:38.055 INFO:teuthology.orchestra.run.smithi155.stdout: { 2023-08-01T19:56:38.055 INFO:teuthology.orchestra.run.smithi155.stdout: "event": "commit_sent", 2023-08-01T19:56:38.056 INFO:teuthology.orchestra.run.smithi155.stdout: "time": "2023-08-01T19:55:05.225066+0000", 2023-08-01T19:56:38.056 INFO:teuthology.orchestra.run.smithi155.stdout: "duration": 4.6143000000000002e-05 2023-08-01T19:56:38.056 INFO:teuthology.orchestra.run.smithi155.stdout: }, 2023-08-01T19:56:38.056 INFO:teuthology.orchestra.run.smithi155.stdout: { 2023-08-01T19:56:38.056 INFO:teuthology.orchestra.run.smithi155.stdout: "event": "done", 2023-08-01T19:56:38.056 INFO:teuthology.orchestra.run.smithi155.stdout: "time": "2023-08-01T19:55:05.225103+0000", 2023-08-01T19:56:38.056 INFO:teuthology.orchestra.run.smithi155.stdout: "duration": 3.6789999999999998e-05 2023-08-01T19:56:38.057 INFO:teuthology.orchestra.run.smithi155.stdout: } 2023-08-01T19:56:38.057 INFO:teuthology.orchestra.run.smithi155.stdout: ] 2023-08-01T19:56:38.057 INFO:teuthology.orchestra.run.smithi155.stdout: } 2023-08-01T19:56:38.057 INFO:teuthology.orchestra.run.smithi155.stdout: }, 2023-08-01T19:56:38.057 INFO:teuthology.orchestra.run.smithi155.stdout: { 2023-08-01T19:56:38.057 INFO:teuthology.orchestra.run.smithi155.stdout: "description": "osd_op(client.4668.0:100252 5.0 5:01f90c3c:::benchmark_data_smithi006_114134_object100251:head [set-alloc-hint object_size 65536 write_size 65536,write 0~65536] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e37)", 2023-08-01T19:56:38.057 INFO:teuthology.orchestra.run.smithi155.stdout: "initiated_at": "2023-08-01T19:55:05.154048+0000", 2023-08-01T19:56:38.057 INFO:teuthology.orchestra.run.smithi155.stdout: "age": 92.822321074000001, 2023-08-01T19:56:38.058 INFO:teuthology.orchestra.run.smithi155.stdout: "duration": 0.070156683999999997, 2023-08-01T19:56:38.058 INFO:teuthology.orchestra.run.smithi155.stdout: "type_data": { 2023-08-01T19:56:38.058 INFO:teuthology.orchestra.run.smithi155.stdout: "flag_point": "commit sent; apply or cleanup", 2023-08-01T19:56:38.058 INFO:teuthology.orchestra.run.smithi155.stdout: "client_info": { 2023-08-01T19:56:38.058 INFO:teuthology.orchestra.run.smithi155.stdout: "client": "client.4668", 2023-08-01T19:56:38.058 INFO:teuthology.orchestra.run.smithi155.stdout: "client_addr": "172.21.15.6:0/1709472247", 2023-08-01T19:56:38.058 INFO:teuthology.orchestra.run.smithi155.stdout: "tid": 100252 2023-08-01T19:56:38.059 INFO:teuthology.orchestra.run.smithi155.stdout: }, 2023-08-01T19:56:38.059 INFO:teuthology.orchestra.run.smithi155.stdout: "events": [ 2023-08-01T19:56:38.059 INFO:teuthology.orchestra.run.smithi155.stdout: { 2023-08-01T19:56:38.059 INFO:teuthology.orchestra.run.smithi155.stdout: "event": "initiated", 2023-08-01T19:56:38.059 INFO:teuthology.orchestra.run.smithi155.stdout: "time": "2023-08-01T19:55:05.154048+0000", 2023-08-01T19:56:38.059 INFO:teuthology.orchestra.run.smithi155.stdout: "duration": 0 2023-08-01T19:56:38.059 INFO:teuthology.orchestra.run.smithi155.stdout: }, 2023-08-01T19:56:38.060 INFO:teuthology.orchestra.run.smithi155.stdout: { 2023-08-01T19:56:38.060 INFO:teuthology.orchestra.run.smithi155.stdout: "event": "throttled", 2023-08-01T19:56:38.060 INFO:teuthology.orchestra.run.smithi155.stdout: "time": "2023-08-01T19:55:05.154048+0000", 2023-08-01T19:56:38.060 INFO:teuthology.orchestra.run.smithi155.stdout: "duration": 0 2023-08-01T19:56:38.060 INFO:teuthology.orchestra.run.smithi155.stdout: }, 2023-08-01T19:56:38.060 INFO:teuthology.orchestra.run.smithi155.stdout: { 2023-08-01T19:56:38.060 INFO:teuthology.orchestra.run.smithi155.stdout: "event": "header_read", 2023-08-01T19:56:38.060 INFO:teuthology.orchestra.run.smithi155.stdout: "time": "2023-08-01T19:55:05.154047+0000", 2023-08-01T19:56:38.061 INFO:teuthology.orchestra.run.smithi155.stdout: "duration": 4294967295.999999 2023-08-01T19:56:38.061 INFO:teuthology.orchestra.run.smithi155.stdout: }, 2023-08-01T19:56:38.061 INFO:teuthology.orchestra.run.smithi155.stdout: { 2023-08-01T19:56:38.061 INFO:teuthology.orchestra.run.smithi155.stdout: "event": "all_read", 2023-08-01T19:56:38.061 INFO:teuthology.orchestra.run.smithi155.stdout: "time": "2023-08-01T19:55:05.154115+0000", 2023-08-01T19:56:38.061 INFO:teuthology.orchestra.run.smithi155.stdout: "duration": 6.7545999999999993e-05 2023-08-01T19:56:38.061 INFO:teuthology.orchestra.run.smithi155.stdout: }, 2023-08-01T19:56:38.062 INFO:teuthology.orchestra.run.smithi155.stdout: { 2023-08-01T19:56:38.062 INFO:teuthology.orchestra.run.smithi155.stdout: "event": "dispatched", 2023-08-01T19:56:38.062 INFO:teuthology.orchestra.run.smithi155.stdout: "time": "2023-08-01T19:55:05.154125+0000", 2023-08-01T19:56:38.062 INFO:teuthology.orchestra.run.smithi155.stdout: "duration": 1.0669000000000001e-05 2023-08-01T19:56:38.062 INFO:teuthology.orchestra.run.smithi155.stdout: }, 2023-08-01T19:56:38.062 INFO:teuthology.orchestra.run.smithi155.stdout: { 2023-08-01T19:56:38.062 INFO:teuthology.orchestra.run.smithi155.stdout: "event": "queued_for_pg", 2023-08-01T19:56:38.062 INFO:teuthology.orchestra.run.smithi155.stdout: "time": "2023-08-01T19:55:05.154131+0000", 2023-08-01T19:56:38.063 INFO:teuthology.orchestra.run.smithi155.stdout: "duration": 6.0349999999999998e-06 2023-08-01T19:56:38.063 INFO:teuthology.orchestra.run.smithi155.stdout: }, 2023-08-01T19:56:38.063 INFO:teuthology.orchestra.run.smithi155.stdout: { 2023-08-01T19:56:38.063 INFO:teuthology.orchestra.run.smithi155.stdout: "event": "reached_pg", 2023-08-01T19:56:38.063 INFO:teuthology.orchestra.run.smithi155.stdout: "time": "2023-08-01T19:55:05.154174+0000", 2023-08-01T19:56:38.063 INFO:teuthology.orchestra.run.smithi155.stdout: "duration": 4.2429000000000003e-05 2023-08-01T19:56:38.063 INFO:teuthology.orchestra.run.smithi155.stdout: }, 2023-08-01T19:56:38.063 INFO:teuthology.orchestra.run.smithi155.stdout: { 2023-08-01T19:56:38.064 INFO:teuthology.orchestra.run.smithi155.stdout: "event": "started", 2023-08-01T19:56:38.064 INFO:teuthology.orchestra.run.smithi155.stdout: "time": "2023-08-01T19:55:05.154287+0000", 2023-08-01T19:56:38.064 INFO:teuthology.orchestra.run.smithi155.stdout: "duration": 0.000113138 2023-08-01T19:56:38.064 INFO:teuthology.orchestra.run.smithi155.stdout: }, 2023-08-01T19:56:38.064 INFO:teuthology.orchestra.run.smithi155.stdout: { 2023-08-01T19:56:38.064 INFO:teuthology.orchestra.run.smithi155.stdout: "event": "waiting for subops from 0", 2023-08-01T19:56:38.064 INFO:teuthology.orchestra.run.smithi155.stdout: "time": "2023-08-01T19:55:05.154420+0000", 2023-08-01T19:56:38.065 INFO:teuthology.orchestra.run.smithi155.stdout: "duration": 0.000133292 2023-08-01T19:56:38.065 INFO:teuthology.orchestra.run.smithi155.stdout: }, 2023-08-01T19:56:38.065 INFO:teuthology.orchestra.run.smithi155.stdout: { 2023-08-01T19:56:38.065 INFO:teuthology.orchestra.run.smithi155.stdout: "event": "sub_op_commit_rec", 2023-08-01T19:56:38.065 INFO:teuthology.orchestra.run.smithi155.stdout: "time": "2023-08-01T19:55:05.219034+0000", 2023-08-01T19:56:38.065 INFO:teuthology.orchestra.run.smithi155.stdout: "duration": 0.064613429999999999 2023-08-01T19:56:38.065 INFO:teuthology.orchestra.run.smithi155.stdout: }, 2023-08-01T19:56:38.065 INFO:teuthology.orchestra.run.smithi155.stdout: { 2023-08-01T19:56:38.066 INFO:teuthology.orchestra.run.smithi155.stdout: "event": "op_commit", 2023-08-01T19:56:38.066 INFO:teuthology.orchestra.run.smithi155.stdout: "time": "2023-08-01T19:55:05.224138+0000", 2023-08-01T19:56:38.066 INFO:teuthology.orchestra.run.smithi155.stdout: "duration": 0.0051041999999999997 2023-08-01T19:56:38.066 INFO:teuthology.orchestra.run.smithi155.stdout: }, 2023-08-01T19:56:38.066 INFO:teuthology.orchestra.run.smithi155.stdout: { 2023-08-01T19:56:38.066 INFO:teuthology.orchestra.run.smithi155.stdout: "event": "commit_sent", 2023-08-01T19:56:38.066 INFO:teuthology.orchestra.run.smithi155.stdout: "time": "2023-08-01T19:55:05.224171+0000", 2023-08-01T19:56:38.067 INFO:teuthology.orchestra.run.smithi155.stdout: "duration": 3.3345e-05 2023-08-01T19:56:38.067 INFO:teuthology.orchestra.run.smithi155.stdout: }, 2023-08-01T19:56:38.067 INFO:teuthology.orchestra.run.smithi155.stdout: { 2023-08-01T19:56:38.067 INFO:teuthology.orchestra.run.smithi155.stdout: "event": "done", 2023-08-01T19:56:38.067 INFO:teuthology.orchestra.run.smithi155.stdout: "time": "2023-08-01T19:55:05.224205+0000", 2023-08-01T19:56:38.067 INFO:teuthology.orchestra.run.smithi155.stdout: "duration": 3.3525999999999997e-05 2023-08-01T19:56:38.067 INFO:teuthology.orchestra.run.smithi155.stdout: } 2023-08-01T19:56:38.067 INFO:teuthology.orchestra.run.smithi155.stdout: ] 2023-08-01T19:56:38.068 INFO:teuthology.orchestra.run.smithi155.stdout: } 2023-08-01T19:56:38.068 INFO:teuthology.orchestra.run.smithi155.stdout: }, 2023-08-01T19:56:38.068 INFO:teuthology.orchestra.run.smithi155.stdout: { 2023-08-01T19:56:38.068 INFO:teuthology.orchestra.run.smithi155.stdout: "description": "osd_repop_reply(client.4668.0:100237 5.4 e37/19 ondisk, result = 0)", 2023-08-01T19:56:38.068 INFO:teuthology.orchestra.run.smithi155.stdout: "initiated_at": "2023-08-01T19:55:05.156249+0000", 2023-08-01T19:56:38.068 INFO:teuthology.orchestra.run.smithi155.stdout: "age": 92.820120129000003, 2023-08-01T19:56:38.068 INFO:teuthology.orchestra.run.smithi155.stdout: "duration": 0.062792549000000003, 2023-08-01T19:56:38.069 INFO:teuthology.orchestra.run.smithi155.stdout: "type_data": { 2023-08-01T19:56:38.069 INFO:teuthology.orchestra.run.smithi155.stdout: "flag_point": "started", 2023-08-01T19:56:38.069 INFO:teuthology.orchestra.run.smithi155.stdout: "events": [ 2023-08-01T19:56:38.069 INFO:teuthology.orchestra.run.smithi155.stdout: { 2023-08-01T19:56:38.069 INFO:teuthology.orchestra.run.smithi155.stdout: "event": "initiated", 2023-08-01T19:56:38.069 INFO:teuthology.orchestra.run.smithi155.stdout: "time": "2023-08-01T19:55:05.156249+0000", 2023-08-01T19:56:38.069 INFO:teuthology.orchestra.run.smithi155.stdout: "duration": 0 2023-08-01T19:56:38.069 INFO:teuthology.orchestra.run.smithi155.stdout: }, 2023-08-01T19:56:38.070 INFO:teuthology.orchestra.run.smithi155.stdout: { 2023-08-01T19:56:38.070 INFO:teuthology.orchestra.run.smithi155.stdout: "event": "throttled", 2023-08-01T19:56:38.070 INFO:teuthology.orchestra.run.smithi155.stdout: "time": "2023-08-01T19:55:05.156249+0000", 2023-08-01T19:56:38.070 INFO:teuthology.orchestra.run.smithi155.stdout: "duration": 0 2023-08-01T19:56:38.070 INFO:teuthology.orchestra.run.smithi155.stdout: }, 2023-08-01T19:56:38.070 INFO:teuthology.orchestra.run.smithi155.stdout: { 2023-08-01T19:56:38.070 INFO:teuthology.orchestra.run.smithi155.stdout: "event": "header_read", 2023-08-01T19:56:38.071 INFO:teuthology.orchestra.run.smithi155.stdout: "time": "2023-08-01T19:55:05.156248+0000", 2023-08-01T19:56:38.071 INFO:teuthology.orchestra.run.smithi155.stdout: "duration": 4294967295.9999995 2023-08-01T19:56:38.071 INFO:teuthology.orchestra.run.smithi155.stdout: }, 2023-08-01T19:56:38.071 INFO:teuthology.orchestra.run.smithi155.stdout: { 2023-08-01T19:56:38.071 INFO:teuthology.orchestra.run.smithi155.stdout: "event": "all_read", 2023-08-01T19:56:38.071 INFO:teuthology.orchestra.run.smithi155.stdout: "time": "2023-08-01T19:55:05.156252+0000", 2023-08-01T19:56:38.071 INFO:teuthology.orchestra.run.smithi155.stdout: "duration": 3.9999999999999998e-06 2023-08-01T19:56:38.071 INFO:teuthology.orchestra.run.smithi155.stdout: }, 2023-08-01T19:56:38.072 INFO:teuthology.orchestra.run.smithi155.stdout: { 2023-08-01T19:56:38.072 INFO:teuthology.orchestra.run.smithi155.stdout: "event": "dispatched", 2023-08-01T19:56:38.072 INFO:teuthology.orchestra.run.smithi155.stdout: "time": "2023-08-01T19:55:05.218844+0000", 2023-08-01T19:56:38.072 INFO:teuthology.orchestra.run.smithi155.stdout: "duration": 0.062591516999999999 2023-08-01T19:56:38.072 INFO:teuthology.orchestra.run.smithi155.stdout: }, 2023-08-01T19:56:38.072 INFO:teuthology.orchestra.run.smithi155.stdout: { 2023-08-01T19:56:38.072 INFO:teuthology.orchestra.run.smithi155.stdout: "event": "queued_for_pg", 2023-08-01T19:56:38.073 INFO:teuthology.orchestra.run.smithi155.stdout: "time": "2023-08-01T19:55:05.218862+0000", 2023-08-01T19:56:38.073 INFO:teuthology.orchestra.run.smithi155.stdout: "duration": 1.7666e-05 2023-08-01T19:56:38.073 INFO:teuthology.orchestra.run.smithi155.stdout: }, 2023-08-01T19:56:38.073 INFO:teuthology.orchestra.run.smithi155.stdout: { 2023-08-01T19:56:38.073 INFO:teuthology.orchestra.run.smithi155.stdout: "event": "reached_pg", 2023-08-01T19:56:38.073 INFO:teuthology.orchestra.run.smithi155.stdout: "time": "2023-08-01T19:55:05.218914+0000", 2023-08-01T19:56:38.073 INFO:teuthology.orchestra.run.smithi155.stdout: "duration": 5.2565999999999998e-05 2023-08-01T19:56:38.073 INFO:teuthology.orchestra.run.smithi155.stdout: }, 2023-08-01T19:56:38.074 INFO:teuthology.orchestra.run.smithi155.stdout: { 2023-08-01T19:56:38.074 INFO:teuthology.orchestra.run.smithi155.stdout: "event": "started", 2023-08-01T19:56:38.074 INFO:teuthology.orchestra.run.smithi155.stdout: "time": "2023-08-01T19:55:05.218925+0000", 2023-08-01T19:56:38.074 INFO:teuthology.orchestra.run.smithi155.stdout: "duration": 1.1375e-05 2023-08-01T19:56:38.074 INFO:teuthology.orchestra.run.smithi155.stdout: }, 2023-08-01T19:56:38.074 INFO:teuthology.orchestra.run.smithi155.stdout: { 2023-08-01T19:56:38.074 INFO:teuthology.orchestra.run.smithi155.stdout: "event": "done", 2023-08-01T19:56:38.074 INFO:teuthology.orchestra.run.smithi155.stdout: "time": "2023-08-01T19:55:05.219041+0000", 2023-08-01T19:56:38.075 INFO:teuthology.orchestra.run.smithi155.stdout: "duration": 0.000115977 2023-08-01T19:56:38.075 INFO:teuthology.orchestra.run.smithi155.stdout: } 2023-08-01T19:56:38.075 INFO:teuthology.orchestra.run.smithi155.stdout: ] 2023-08-01T19:56:38.075 INFO:teuthology.orchestra.run.smithi155.stdout: } 2023-08-01T19:56:38.075 INFO:teuthology.orchestra.run.smithi155.stdout: }, 2023-08-01T19:56:38.075 INFO:teuthology.orchestra.run.smithi155.stdout: { 2023-08-01T19:56:38.075 INFO:teuthology.orchestra.run.smithi155.stdout: "description": "osd_repop(client.4668.0:100253 5.f e37/19 5:f7bbce05:::benchmark_data_smithi006_114134_object100252:head v 37'6323, mlcod=37'6321)", 2023-08-01T19:56:38.075 INFO:teuthology.orchestra.run.smithi155.stdout: "initiated_at": "2023-08-01T19:55:05.156952+0000", 2023-08-01T19:56:38.076 INFO:teuthology.orchestra.run.smithi155.stdout: "age": 92.819417066, 2023-08-01T19:56:38.076 INFO:teuthology.orchestra.run.smithi155.stdout: "duration": 0.068018577999999996, 2023-08-01T19:56:38.076 INFO:teuthology.orchestra.run.smithi155.stdout: "type_data": { 2023-08-01T19:56:38.076 INFO:teuthology.orchestra.run.smithi155.stdout: "flag_point": "commit sent; apply or cleanup", 2023-08-01T19:56:38.076 INFO:teuthology.orchestra.run.smithi155.stdout: "events": [ 2023-08-01T19:56:38.076 INFO:teuthology.orchestra.run.smithi155.stdout: { 2023-08-01T19:56:38.076 INFO:teuthology.orchestra.run.smithi155.stdout: "event": "initiated", 2023-08-01T19:56:38.076 INFO:teuthology.orchestra.run.smithi155.stdout: "time": "2023-08-01T19:55:05.156952+0000", 2023-08-01T19:56:38.077 INFO:teuthology.orchestra.run.smithi155.stdout: "duration": 0 2023-08-01T19:56:38.077 INFO:teuthology.orchestra.run.smithi155.stdout: }, 2023-08-01T19:56:38.077 INFO:teuthology.orchestra.run.smithi155.stdout: { 2023-08-01T19:56:38.077 INFO:teuthology.orchestra.run.smithi155.stdout: "event": "throttled", 2023-08-01T19:56:38.077 INFO:teuthology.orchestra.run.smithi155.stdout: "time": "2023-08-01T19:55:05.156952+0000", 2023-08-01T19:56:38.077 INFO:teuthology.orchestra.run.smithi155.stdout: "duration": 0 2023-08-01T19:56:38.077 INFO:teuthology.orchestra.run.smithi155.stdout: }, 2023-08-01T19:56:38.077 INFO:teuthology.orchestra.run.smithi155.stdout: { 2023-08-01T19:56:38.078 INFO:teuthology.orchestra.run.smithi155.stdout: "event": "header_read", 2023-08-01T19:56:38.078 INFO:teuthology.orchestra.run.smithi155.stdout: "time": "2023-08-01T19:55:05.156951+0000", 2023-08-01T19:56:38.078 INFO:teuthology.orchestra.run.smithi155.stdout: "duration": 4294967295.999999 2023-08-01T19:56:38.078 INFO:teuthology.orchestra.run.smithi155.stdout: }, 2023-08-01T19:56:38.078 INFO:teuthology.orchestra.run.smithi155.stdout: { 2023-08-01T19:56:38.078 INFO:teuthology.orchestra.run.smithi155.stdout: "event": "all_read", 2023-08-01T19:56:38.078 INFO:teuthology.orchestra.run.smithi155.stdout: "time": "2023-08-01T19:55:05.156989+0000", 2023-08-01T19:56:38.078 INFO:teuthology.orchestra.run.smithi155.stdout: "duration": 3.8175e-05 2023-08-01T19:56:38.079 INFO:teuthology.orchestra.run.smithi155.stdout: }, 2023-08-01T19:56:38.079 INFO:teuthology.orchestra.run.smithi155.stdout: { 2023-08-01T19:56:38.079 INFO:teuthology.orchestra.run.smithi155.stdout: "event": "dispatched", 2023-08-01T19:56:38.079 INFO:teuthology.orchestra.run.smithi155.stdout: "time": "2023-08-01T19:55:05.218842+0000", 2023-08-01T19:56:38.079 INFO:teuthology.orchestra.run.smithi155.stdout: "duration": 0.061852299999999999 2023-08-01T19:56:38.079 INFO:teuthology.orchestra.run.smithi155.stdout: }, 2023-08-01T19:56:38.079 INFO:teuthology.orchestra.run.smithi155.stdout: { 2023-08-01T19:56:38.080 INFO:teuthology.orchestra.run.smithi155.stdout: "event": "queued_for_pg", 2023-08-01T19:56:38.080 INFO:teuthology.orchestra.run.smithi155.stdout: "time": "2023-08-01T19:55:05.218862+0000", 2023-08-01T19:56:38.080 INFO:teuthology.orchestra.run.smithi155.stdout: "duration": 1.9854999999999999e-05 2023-08-01T19:56:38.080 INFO:teuthology.orchestra.run.smithi155.stdout: }, 2023-08-01T19:56:38.080 INFO:teuthology.orchestra.run.smithi155.stdout: { 2023-08-01T19:56:38.080 INFO:teuthology.orchestra.run.smithi155.stdout: "event": "reached_pg", 2023-08-01T19:56:38.080 INFO:teuthology.orchestra.run.smithi155.stdout: "time": "2023-08-01T19:55:05.218918+0000", 2023-08-01T19:56:38.081 INFO:teuthology.orchestra.run.smithi155.stdout: "duration": 5.6570000000000002e-05 2023-08-01T19:56:38.081 INFO:teuthology.orchestra.run.smithi155.stdout: }, 2023-08-01T19:56:38.081 INFO:teuthology.orchestra.run.smithi155.stdout: { 2023-08-01T19:56:38.081 INFO:teuthology.orchestra.run.smithi155.stdout: "event": "started", 2023-08-01T19:56:38.081 INFO:teuthology.orchestra.run.smithi155.stdout: "time": "2023-08-01T19:55:05.218940+0000", 2023-08-01T19:56:38.081 INFO:teuthology.orchestra.run.smithi155.stdout: "duration": 2.1804e-05 2023-08-01T19:56:38.081 INFO:teuthology.orchestra.run.smithi155.stdout: }, 2023-08-01T19:56:38.081 INFO:teuthology.orchestra.run.smithi155.stdout: { 2023-08-01T19:56:38.082 INFO:teuthology.orchestra.run.smithi155.stdout: "event": "commit_sent", 2023-08-01T19:56:38.082 INFO:teuthology.orchestra.run.smithi155.stdout: "time": "2023-08-01T19:55:05.224928+0000", 2023-08-01T19:56:38.082 INFO:teuthology.orchestra.run.smithi155.stdout: "duration": 0.0059876759999999999 2023-08-01T19:56:38.082 INFO:teuthology.orchestra.run.smithi155.stdout: }, 2023-08-01T19:56:38.082 INFO:teuthology.orchestra.run.smithi155.stdout: { 2023-08-01T19:56:38.082 INFO:teuthology.orchestra.run.smithi155.stdout: "event": "done", 2023-08-01T19:56:38.082 INFO:teuthology.orchestra.run.smithi155.stdout: "time": "2023-08-01T19:55:05.224971+0000", 2023-08-01T19:56:38.082 INFO:teuthology.orchestra.run.smithi155.stdout: "duration": 4.2929999999999997e-05 2023-08-01T19:56:38.083 INFO:teuthology.orchestra.run.smithi155.stdout: } 2023-08-01T19:56:38.083 INFO:teuthology.orchestra.run.smithi155.stdout: ] 2023-08-01T19:56:38.083 INFO:teuthology.orchestra.run.smithi155.stdout: } 2023-08-01T19:56:38.083 INFO:teuthology.orchestra.run.smithi155.stdout: }, 2023-08-01T19:56:38.083 INFO:teuthology.orchestra.run.smithi155.stdout: { 2023-08-01T19:56:38.083 INFO:teuthology.orchestra.run.smithi155.stdout: "description": "osd_op(client.4668.0:100927 5.0 5:00608ec6:::benchmark_data_smithi006_114134_object100926:head [set-alloc-hint object_size 65536 write_size 65536,write 0~65536] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e37)", 2023-08-01T19:56:38.083 INFO:teuthology.orchestra.run.smithi155.stdout: "initiated_at": "2023-08-01T19:55:05.561169+0000", 2023-08-01T19:56:38.083 INFO:teuthology.orchestra.run.smithi155.stdout: "age": 92.415200162999994, 2023-08-01T19:56:38.084 INFO:teuthology.orchestra.run.smithi155.stdout: "duration": 0.066411687999999997, 2023-08-01T19:56:38.084 INFO:teuthology.orchestra.run.smithi155.stdout: "type_data": { 2023-08-01T19:56:38.084 INFO:teuthology.orchestra.run.smithi155.stdout: "flag_point": "commit sent; apply or cleanup", 2023-08-01T19:56:38.084 INFO:teuthology.orchestra.run.smithi155.stdout: "client_info": { 2023-08-01T19:56:38.084 INFO:teuthology.orchestra.run.smithi155.stdout: "client": "client.4668", 2023-08-01T19:56:38.084 INFO:teuthology.orchestra.run.smithi155.stdout: "client_addr": "172.21.15.6:0/1709472247", 2023-08-01T19:56:38.084 INFO:teuthology.orchestra.run.smithi155.stdout: "tid": 100927 2023-08-01T19:56:38.085 INFO:teuthology.orchestra.run.smithi155.stdout: }, 2023-08-01T19:56:38.085 INFO:teuthology.orchestra.run.smithi155.stdout: "events": [ 2023-08-01T19:56:38.085 INFO:teuthology.orchestra.run.smithi155.stdout: { 2023-08-01T19:56:38.085 INFO:teuthology.orchestra.run.smithi155.stdout: "event": "initiated", 2023-08-01T19:56:38.085 INFO:teuthology.orchestra.run.smithi155.stdout: "time": "2023-08-01T19:55:05.561169+0000", 2023-08-01T19:56:38.085 INFO:teuthology.orchestra.run.smithi155.stdout: "duration": 0 2023-08-01T19:56:38.085 INFO:teuthology.orchestra.run.smithi155.stdout: }, 2023-08-01T19:56:38.085 INFO:teuthology.orchestra.run.smithi155.stdout: { 2023-08-01T19:56:38.086 INFO:teuthology.orchestra.run.smithi155.stdout: "event": "throttled", 2023-08-01T19:56:38.086 INFO:teuthology.orchestra.run.smithi155.stdout: "time": "2023-08-01T19:55:05.561169+0000", 2023-08-01T19:56:38.086 INFO:teuthology.orchestra.run.smithi155.stdout: "duration": 0 2023-08-01T19:56:38.086 INFO:teuthology.orchestra.run.smithi155.stdout: }, 2023-08-01T19:56:38.086 INFO:teuthology.orchestra.run.smithi155.stdout: { 2023-08-01T19:56:38.086 INFO:teuthology.orchestra.run.smithi155.stdout: "event": "header_read", 2023-08-01T19:56:38.086 INFO:teuthology.orchestra.run.smithi155.stdout: "time": "2023-08-01T19:55:05.561168+0000", 2023-08-01T19:56:38.086 INFO:teuthology.orchestra.run.smithi155.stdout: "duration": 4294967295.9999995 2023-08-01T19:56:38.087 INFO:teuthology.orchestra.run.smithi155.stdout: }, 2023-08-01T19:56:38.087 INFO:teuthology.orchestra.run.smithi155.stdout: { 2023-08-01T19:56:38.087 INFO:teuthology.orchestra.run.smithi155.stdout: "event": "all_read", 2023-08-01T19:56:38.087 INFO:teuthology.orchestra.run.smithi155.stdout: "time": "2023-08-01T19:55:05.561218+0000", 2023-08-01T19:56:38.087 INFO:teuthology.orchestra.run.smithi155.stdout: "duration": 4.9379999999999998e-05 2023-08-01T19:56:38.087 INFO:teuthology.orchestra.run.smithi155.stdout: }, 2023-08-01T19:56:38.087 INFO:teuthology.orchestra.run.smithi155.stdout: { 2023-08-01T19:56:38.087 INFO:teuthology.orchestra.run.smithi155.stdout: "event": "dispatched", 2023-08-01T19:56:38.088 INFO:teuthology.orchestra.run.smithi155.stdout: "time": "2023-08-01T19:55:05.561225+0000", 2023-08-01T19:56:38.088 INFO:teuthology.orchestra.run.smithi155.stdout: "duration": 7.114e-06 2023-08-01T19:56:38.088 INFO:teuthology.orchestra.run.smithi155.stdout: }, 2023-08-01T19:56:38.088 INFO:teuthology.orchestra.run.smithi155.stdout: { 2023-08-01T19:56:38.088 INFO:teuthology.orchestra.run.smithi155.stdout: "event": "queued_for_pg", 2023-08-01T19:56:38.088 INFO:teuthology.orchestra.run.smithi155.stdout: "time": "2023-08-01T19:55:05.561229+0000", 2023-08-01T19:56:38.088 INFO:teuthology.orchestra.run.smithi155.stdout: "duration": 4.2180000000000001e-06 2023-08-01T19:56:38.088 INFO:teuthology.orchestra.run.smithi155.stdout: }, 2023-08-01T19:56:38.089 INFO:teuthology.orchestra.run.smithi155.stdout: { 2023-08-01T19:56:38.089 INFO:teuthology.orchestra.run.smithi155.stdout: "event": "reached_pg", 2023-08-01T19:56:38.089 INFO:teuthology.orchestra.run.smithi155.stdout: "time": "2023-08-01T19:55:05.564737+0000", 2023-08-01T19:56:38.089 INFO:teuthology.orchestra.run.smithi155.stdout: "duration": 0.0035081869999999999 2023-08-01T19:56:38.089 INFO:teuthology.orchestra.run.smithi155.stdout: }, 2023-08-01T19:56:38.089 INFO:teuthology.orchestra.run.smithi155.stdout: { 2023-08-01T19:56:38.089 INFO:teuthology.orchestra.run.smithi155.stdout: "event": "started", 2023-08-01T19:56:38.089 INFO:teuthology.orchestra.run.smithi155.stdout: "time": "2023-08-01T19:55:05.564859+0000", 2023-08-01T19:56:38.090 INFO:teuthology.orchestra.run.smithi155.stdout: "duration": 0.00012165800000000001 2023-08-01T19:56:38.090 INFO:teuthology.orchestra.run.smithi155.stdout: }, 2023-08-01T19:56:38.090 INFO:teuthology.orchestra.run.smithi155.stdout: { 2023-08-01T19:56:38.090 INFO:teuthology.orchestra.run.smithi155.stdout: "event": "waiting for subops from 0", 2023-08-01T19:56:38.090 INFO:teuthology.orchestra.run.smithi155.stdout: "time": "2023-08-01T19:55:05.565009+0000", 2023-08-01T19:56:38.090 INFO:teuthology.orchestra.run.smithi155.stdout: "duration": 0.00014979699999999999 2023-08-01T19:56:38.090 INFO:teuthology.orchestra.run.smithi155.stdout: }, 2023-08-01T19:56:38.091 INFO:teuthology.orchestra.run.smithi155.stdout: { 2023-08-01T19:56:38.091 INFO:teuthology.orchestra.run.smithi155.stdout: "event": "op_commit", 2023-08-01T19:56:38.091 INFO:teuthology.orchestra.run.smithi155.stdout: "time": "2023-08-01T19:55:05.568007+0000", 2023-08-01T19:56:38.091 INFO:teuthology.orchestra.run.smithi155.stdout: "duration": 0.00299796 2023-08-01T19:56:38.091 INFO:teuthology.orchestra.run.smithi155.stdout: }, 2023-08-01T19:56:38.091 INFO:teuthology.orchestra.run.smithi155.stdout: { 2023-08-01T19:56:38.091 INFO:teuthology.orchestra.run.smithi155.stdout: "event": "sub_op_commit_rec", 2023-08-01T19:56:38.091 INFO:teuthology.orchestra.run.smithi155.stdout: "time": "2023-08-01T19:55:05.627520+0000", 2023-08-01T19:56:38.092 INFO:teuthology.orchestra.run.smithi155.stdout: "duration": 0.059513636000000002 2023-08-01T19:56:38.092 INFO:teuthology.orchestra.run.smithi155.stdout: }, 2023-08-01T19:56:38.092 INFO:teuthology.orchestra.run.smithi155.stdout: { 2023-08-01T19:56:38.092 INFO:teuthology.orchestra.run.smithi155.stdout: "event": "commit_sent", 2023-08-01T19:56:38.092 INFO:teuthology.orchestra.run.smithi155.stdout: "time": "2023-08-01T19:55:05.627553+0000", 2023-08-01T19:56:38.092 INFO:teuthology.orchestra.run.smithi155.stdout: "duration": 3.2635999999999997e-05 2023-08-01T19:56:38.092 INFO:teuthology.orchestra.run.smithi155.stdout: }, 2023-08-01T19:56:38.092 INFO:teuthology.orchestra.run.smithi155.stdout: { 2023-08-01T19:56:38.093 INFO:teuthology.orchestra.run.smithi155.stdout: "event": "done", 2023-08-01T19:56:38.093 INFO:teuthology.orchestra.run.smithi155.stdout: "time": "2023-08-01T19:55:05.627581+0000", 2023-08-01T19:56:38.093 INFO:teuthology.orchestra.run.smithi155.stdout: "duration": 2.7681000000000001e-05 2023-08-01T19:56:38.093 INFO:teuthology.orchestra.run.smithi155.stdout: } 2023-08-01T19:56:38.093 INFO:teuthology.orchestra.run.smithi155.stdout: ] 2023-08-01T19:56:38.093 INFO:teuthology.orchestra.run.smithi155.stdout: } 2023-08-01T19:56:38.093 INFO:teuthology.orchestra.run.smithi155.stdout: }, 2023-08-01T19:56:38.093 INFO:teuthology.orchestra.run.smithi155.stdout: { 2023-08-01T19:56:38.094 INFO:teuthology.orchestra.run.smithi155.stdout: "description": "osd_op(client.4668.0:100935 5.e 5:7895b14e:::benchmark_data_smithi006_114134_object100934:head [set-alloc-hint object_size 65536 write_size 65536,write 0~65536] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e37)", 2023-08-01T19:56:38.094 INFO:teuthology.orchestra.run.smithi155.stdout: "initiated_at": "2023-08-01T19:55:05.566666+0000", 2023-08-01T19:56:38.094 INFO:teuthology.orchestra.run.smithi155.stdout: "age": 92.409702863000007, 2023-08-01T19:56:38.094 INFO:teuthology.orchestra.run.smithi155.stdout: "duration": 0.064309016999999996, 2023-08-01T19:56:38.094 INFO:teuthology.orchestra.run.smithi155.stdout: "type_data": { 2023-08-01T19:56:38.094 INFO:teuthology.orchestra.run.smithi155.stdout: "flag_point": "commit sent; apply or cleanup", 2023-08-01T19:56:38.094 INFO:teuthology.orchestra.run.smithi155.stdout: "client_info": { 2023-08-01T19:56:38.094 INFO:teuthology.orchestra.run.smithi155.stdout: "client": "client.4668", 2023-08-01T19:56:38.095 INFO:teuthology.orchestra.run.smithi155.stdout: "client_addr": "172.21.15.6:0/1709472247", 2023-08-01T19:56:38.095 INFO:teuthology.orchestra.run.smithi155.stdout: "tid": 100935 2023-08-01T19:56:38.095 INFO:teuthology.orchestra.run.smithi155.stdout: }, 2023-08-01T19:56:38.095 INFO:teuthology.orchestra.run.smithi155.stdout: "events": [ 2023-08-01T19:56:38.095 INFO:teuthology.orchestra.run.smithi155.stdout: { 2023-08-01T19:56:38.095 INFO:teuthology.orchestra.run.smithi155.stdout: "event": "initiated", 2023-08-01T19:56:38.095 INFO:teuthology.orchestra.run.smithi155.stdout: "time": "2023-08-01T19:55:05.566666+0000", 2023-08-01T19:56:38.095 INFO:teuthology.orchestra.run.smithi155.stdout: "duration": 0 2023-08-01T19:56:38.096 INFO:teuthology.orchestra.run.smithi155.stdout: }, 2023-08-01T19:56:38.096 INFO:teuthology.orchestra.run.smithi155.stdout: { 2023-08-01T19:56:38.096 INFO:teuthology.orchestra.run.smithi155.stdout: "event": "throttled", 2023-08-01T19:56:38.096 INFO:teuthology.orchestra.run.smithi155.stdout: "time": "2023-08-01T19:55:05.566666+0000", 2023-08-01T19:56:38.096 INFO:teuthology.orchestra.run.smithi155.stdout: "duration": 0 2023-08-01T19:56:38.096 INFO:teuthology.orchestra.run.smithi155.stdout: }, 2023-08-01T19:56:38.096 INFO:teuthology.orchestra.run.smithi155.stdout: { 2023-08-01T19:56:38.096 INFO:teuthology.orchestra.run.smithi155.stdout: "event": "header_read", 2023-08-01T19:56:38.097 INFO:teuthology.orchestra.run.smithi155.stdout: "time": "2023-08-01T19:55:05.566665+0000", 2023-08-01T19:56:38.097 INFO:teuthology.orchestra.run.smithi155.stdout: "duration": 4294967295.9999986 2023-08-01T19:56:38.097 INFO:teuthology.orchestra.run.smithi155.stdout: }, 2023-08-01T19:56:38.097 INFO:teuthology.orchestra.run.smithi155.stdout: { 2023-08-01T19:56:38.097 INFO:teuthology.orchestra.run.smithi155.stdout: "event": "all_read", 2023-08-01T19:56:38.097 INFO:teuthology.orchestra.run.smithi155.stdout: "time": "2023-08-01T19:55:05.566754+0000", 2023-08-01T19:56:38.097 INFO:teuthology.orchestra.run.smithi155.stdout: "duration": 8.9425999999999994e-05 2023-08-01T19:56:38.098 INFO:teuthology.orchestra.run.smithi155.stdout: }, 2023-08-01T19:56:38.098 INFO:teuthology.orchestra.run.smithi155.stdout: { 2023-08-01T19:56:38.098 INFO:teuthology.orchestra.run.smithi155.stdout: "event": "dispatched", 2023-08-01T19:56:38.098 INFO:teuthology.orchestra.run.smithi155.stdout: "time": "2023-08-01T19:55:05.566766+0000", 2023-08-01T19:56:38.098 INFO:teuthology.orchestra.run.smithi155.stdout: "duration": 1.2018000000000001e-05 2023-08-01T19:56:38.098 INFO:teuthology.orchestra.run.smithi155.stdout: }, 2023-08-01T19:56:38.098 INFO:teuthology.orchestra.run.smithi155.stdout: { 2023-08-01T19:56:38.098 INFO:teuthology.orchestra.run.smithi155.stdout: "event": "queued_for_pg", 2023-08-01T19:56:38.099 INFO:teuthology.orchestra.run.smithi155.stdout: "time": "2023-08-01T19:55:05.566772+0000", 2023-08-01T19:56:38.099 INFO:teuthology.orchestra.run.smithi155.stdout: "duration": 6.0190000000000003e-06 2023-08-01T19:56:38.099 INFO:teuthology.orchestra.run.smithi155.stdout: }, 2023-08-01T19:56:38.099 INFO:teuthology.orchestra.run.smithi155.stdout: { 2023-08-01T19:56:38.099 INFO:teuthology.orchestra.run.smithi155.stdout: "event": "reached_pg", 2023-08-01T19:56:38.099 INFO:teuthology.orchestra.run.smithi155.stdout: "time": "2023-08-01T19:55:05.566800+0000", 2023-08-01T19:56:38.099 INFO:teuthology.orchestra.run.smithi155.stdout: "duration": 2.7835999999999999e-05 2023-08-01T19:56:38.099 INFO:teuthology.orchestra.run.smithi155.stdout: }, 2023-08-01T19:56:38.100 INFO:teuthology.orchestra.run.smithi155.stdout: { 2023-08-01T19:56:38.100 INFO:teuthology.orchestra.run.smithi155.stdout: "event": "started", 2023-08-01T19:56:38.100 INFO:teuthology.orchestra.run.smithi155.stdout: "time": "2023-08-01T19:55:05.566879+0000", 2023-08-01T19:56:38.100 INFO:teuthology.orchestra.run.smithi155.stdout: "duration": 7.9105999999999998e-05 2023-08-01T19:56:38.100 INFO:teuthology.orchestra.run.smithi155.stdout: }, 2023-08-01T19:56:38.100 INFO:teuthology.orchestra.run.smithi155.stdout: { 2023-08-01T19:56:38.100 INFO:teuthology.orchestra.run.smithi155.stdout: "event": "waiting for subops from 0", 2023-08-01T19:56:38.100 INFO:teuthology.orchestra.run.smithi155.stdout: "time": "2023-08-01T19:55:05.566971+0000", 2023-08-01T19:56:38.101 INFO:teuthology.orchestra.run.smithi155.stdout: "duration": 9.1817999999999994e-05 2023-08-01T19:56:38.101 INFO:teuthology.orchestra.run.smithi155.stdout: }, 2023-08-01T19:56:38.101 INFO:teuthology.orchestra.run.smithi155.stdout: { 2023-08-01T19:56:38.101 INFO:teuthology.orchestra.run.smithi155.stdout: "event": "op_commit", 2023-08-01T19:56:38.101 INFO:teuthology.orchestra.run.smithi155.stdout: "time": "2023-08-01T19:55:05.571475+0000", 2023-08-01T19:56:38.101 INFO:teuthology.orchestra.run.smithi155.stdout: "duration": 0.0045039499999999996 2023-08-01T19:56:38.101 INFO:teuthology.orchestra.run.smithi155.stdout: }, 2023-08-01T19:56:38.101 INFO:teuthology.orchestra.run.smithi155.stdout: { 2023-08-01T19:56:38.102 INFO:teuthology.orchestra.run.smithi155.stdout: "event": "sub_op_commit_rec", 2023-08-01T19:56:38.102 INFO:teuthology.orchestra.run.smithi155.stdout: "time": "2023-08-01T19:55:05.630884+0000", 2023-08-01T19:56:38.102 INFO:teuthology.orchestra.run.smithi155.stdout: "duration": 0.059409181999999998 2023-08-01T19:56:38.102 INFO:teuthology.orchestra.run.smithi155.stdout: }, 2023-08-01T19:56:38.102 INFO:teuthology.orchestra.run.smithi155.stdout: { 2023-08-01T19:56:38.102 INFO:teuthology.orchestra.run.smithi155.stdout: "event": "commit_sent", 2023-08-01T19:56:38.102 INFO:teuthology.orchestra.run.smithi155.stdout: "time": "2023-08-01T19:55:05.630930+0000", 2023-08-01T19:56:38.102 INFO:teuthology.orchestra.run.smithi155.stdout: "duration": 4.5507999999999999e-05 2023-08-01T19:56:38.103 INFO:teuthology.orchestra.run.smithi155.stdout: }, 2023-08-01T19:56:38.103 INFO:teuthology.orchestra.run.smithi155.stdout: { 2023-08-01T19:56:38.103 INFO:teuthology.orchestra.run.smithi155.stdout: "event": "done", 2023-08-01T19:56:38.103 INFO:teuthology.orchestra.run.smithi155.stdout: "time": "2023-08-01T19:55:05.630975+0000", 2023-08-01T19:56:38.103 INFO:teuthology.orchestra.run.smithi155.stdout: "duration": 4.5441000000000001e-05 2023-08-01T19:56:38.103 INFO:teuthology.orchestra.run.smithi155.stdout: } 2023-08-01T19:56:38.103 INFO:teuthology.orchestra.run.smithi155.stdout: ] 2023-08-01T19:56:38.103 INFO:teuthology.orchestra.run.smithi155.stdout: } 2023-08-01T19:56:38.104 INFO:teuthology.orchestra.run.smithi155.stdout: }, 2023-08-01T19:56:38.104 INFO:teuthology.orchestra.run.smithi155.stdout: { 2023-08-01T19:56:38.104 INFO:teuthology.orchestra.run.smithi155.stdout: "description": "osd_op(client.4668.0:100941 5.e 5:736a6ac6:::benchmark_data_smithi006_114134_object100940:head [set-alloc-hint object_size 65536 write_size 65536,write 0~65536] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e37)", 2023-08-01T19:56:38.104 INFO:teuthology.orchestra.run.smithi155.stdout: "initiated_at": "2023-08-01T19:55:05.569750+0000", 2023-08-01T19:56:38.104 INFO:teuthology.orchestra.run.smithi155.stdout: "age": 92.406618969999997, 2023-08-01T19:56:38.104 INFO:teuthology.orchestra.run.smithi155.stdout: "duration": 0.065431331999999995, 2023-08-01T19:56:38.104 INFO:teuthology.orchestra.run.smithi155.stdout: "type_data": { 2023-08-01T19:56:38.105 INFO:teuthology.orchestra.run.smithi155.stdout: "flag_point": "commit sent; apply or cleanup", 2023-08-01T19:56:38.105 INFO:teuthology.orchestra.run.smithi155.stdout: "client_info": { 2023-08-01T19:56:38.105 INFO:teuthology.orchestra.run.smithi155.stdout: "client": "client.4668", 2023-08-01T19:56:38.105 INFO:teuthology.orchestra.run.smithi155.stdout: "client_addr": "172.21.15.6:0/1709472247", 2023-08-01T19:56:38.105 INFO:teuthology.orchestra.run.smithi155.stdout: "tid": 100941 2023-08-01T19:56:38.105 INFO:teuthology.orchestra.run.smithi155.stdout: }, 2023-08-01T19:56:38.105 INFO:teuthology.orchestra.run.smithi155.stdout: "events": [ 2023-08-01T19:56:38.105 INFO:teuthology.orchestra.run.smithi155.stdout: { 2023-08-01T19:56:38.106 INFO:teuthology.orchestra.run.smithi155.stdout: "event": "initiated", 2023-08-01T19:56:38.106 INFO:teuthology.orchestra.run.smithi155.stdout: "time": "2023-08-01T19:55:05.569750+0000", 2023-08-01T19:56:38.106 INFO:teuthology.orchestra.run.smithi155.stdout: "duration": 0 2023-08-01T19:56:38.106 INFO:teuthology.orchestra.run.smithi155.stdout: }, 2023-08-01T19:56:38.106 INFO:teuthology.orchestra.run.smithi155.stdout: { 2023-08-01T19:56:38.106 INFO:teuthology.orchestra.run.smithi155.stdout: "event": "throttled", 2023-08-01T19:56:38.106 INFO:teuthology.orchestra.run.smithi155.stdout: "time": "2023-08-01T19:55:05.569750+0000", 2023-08-01T19:56:38.106 INFO:teuthology.orchestra.run.smithi155.stdout: "duration": 0 2023-08-01T19:56:38.107 INFO:teuthology.orchestra.run.smithi155.stdout: }, 2023-08-01T19:56:38.107 INFO:teuthology.orchestra.run.smithi155.stdout: { 2023-08-01T19:56:38.107 INFO:teuthology.orchestra.run.smithi155.stdout: "event": "header_read", 2023-08-01T19:56:38.107 INFO:teuthology.orchestra.run.smithi155.stdout: "time": "2023-08-01T19:55:05.569749+0000", 2023-08-01T19:56:38.107 INFO:teuthology.orchestra.run.smithi155.stdout: "duration": 4294967295.999999 2023-08-01T19:56:38.107 INFO:teuthology.orchestra.run.smithi155.stdout: }, 2023-08-01T19:56:38.107 INFO:teuthology.orchestra.run.smithi155.stdout: { 2023-08-01T19:56:38.107 INFO:teuthology.orchestra.run.smithi155.stdout: "event": "all_read", 2023-08-01T19:56:38.108 INFO:teuthology.orchestra.run.smithi155.stdout: "time": "2023-08-01T19:55:05.569861+0000", 2023-08-01T19:56:38.108 INFO:teuthology.orchestra.run.smithi155.stdout: "duration": 0.000111333 2023-08-01T19:56:38.108 INFO:teuthology.orchestra.run.smithi155.stdout: }, 2023-08-01T19:56:38.108 INFO:teuthology.orchestra.run.smithi155.stdout: { 2023-08-01T19:56:38.108 INFO:teuthology.orchestra.run.smithi155.stdout: "event": "dispatched", 2023-08-01T19:56:38.108 INFO:teuthology.orchestra.run.smithi155.stdout: "time": "2023-08-01T19:55:05.569869+0000", 2023-08-01T19:56:38.108 INFO:teuthology.orchestra.run.smithi155.stdout: "duration": 8.8589999999999994e-06 2023-08-01T19:56:38.108 INFO:teuthology.orchestra.run.smithi155.stdout: }, 2023-08-01T19:56:38.109 INFO:teuthology.orchestra.run.smithi155.stdout: { 2023-08-01T19:56:38.109 INFO:teuthology.orchestra.run.smithi155.stdout: "event": "queued_for_pg", 2023-08-01T19:56:38.109 INFO:teuthology.orchestra.run.smithi155.stdout: "time": "2023-08-01T19:55:05.569874+0000", 2023-08-01T19:56:38.109 INFO:teuthology.orchestra.run.smithi155.stdout: "duration": 4.1679999999999997e-06 2023-08-01T19:56:38.109 INFO:teuthology.orchestra.run.smithi155.stdout: }, 2023-08-01T19:56:38.109 INFO:teuthology.orchestra.run.smithi155.stdout: { 2023-08-01T19:56:38.109 INFO:teuthology.orchestra.run.smithi155.stdout: "event": "reached_pg", 2023-08-01T19:56:38.109 INFO:teuthology.orchestra.run.smithi155.stdout: "time": "2023-08-01T19:55:05.569904+0000", 2023-08-01T19:56:38.110 INFO:teuthology.orchestra.run.smithi155.stdout: "duration": 3.0920999999999998e-05 2023-08-01T19:56:38.110 INFO:teuthology.orchestra.run.smithi155.stdout: }, 2023-08-01T19:56:38.110 INFO:teuthology.orchestra.run.smithi155.stdout: { 2023-08-01T19:56:38.110 INFO:teuthology.orchestra.run.smithi155.stdout: "event": "started", 2023-08-01T19:56:38.110 INFO:teuthology.orchestra.run.smithi155.stdout: "time": "2023-08-01T19:55:05.569998+0000", 2023-08-01T19:56:38.110 INFO:teuthology.orchestra.run.smithi155.stdout: "duration": 9.3086999999999998e-05 2023-08-01T19:56:38.110 INFO:teuthology.orchestra.run.smithi155.stdout: }, 2023-08-01T19:56:38.111 INFO:teuthology.orchestra.run.smithi155.stdout: { 2023-08-01T19:56:38.111 INFO:teuthology.orchestra.run.smithi155.stdout: "event": "waiting for subops from 0", 2023-08-01T19:56:38.111 INFO:teuthology.orchestra.run.smithi155.stdout: "time": "2023-08-01T19:55:05.570093+0000", 2023-08-01T19:56:38.111 INFO:teuthology.orchestra.run.smithi155.stdout: "duration": 9.5768999999999997e-05 2023-08-01T19:56:38.111 INFO:teuthology.orchestra.run.smithi155.stdout: }, 2023-08-01T19:56:38.111 INFO:teuthology.orchestra.run.smithi155.stdout: { 2023-08-01T19:56:38.111 INFO:teuthology.orchestra.run.smithi155.stdout: "event": "op_commit", 2023-08-01T19:56:38.112 INFO:teuthology.orchestra.run.smithi155.stdout: "time": "2023-08-01T19:55:05.572839+0000", 2023-08-01T19:56:38.112 INFO:teuthology.orchestra.run.smithi155.stdout: "duration": 0.0027460050000000001 2023-08-01T19:56:38.112 INFO:teuthology.orchestra.run.smithi155.stdout: }, 2023-08-01T19:56:38.112 INFO:teuthology.orchestra.run.smithi155.stdout: { 2023-08-01T19:56:38.112 INFO:teuthology.orchestra.run.smithi155.stdout: "event": "sub_op_commit_rec", 2023-08-01T19:56:38.112 INFO:teuthology.orchestra.run.smithi155.stdout: "time": "2023-08-01T19:55:05.635114+0000", 2023-08-01T19:56:38.112 INFO:teuthology.orchestra.run.smithi155.stdout: "duration": 0.062274297999999999 2023-08-01T19:56:38.112 INFO:teuthology.orchestra.run.smithi155.stdout: }, 2023-08-01T19:56:38.113 INFO:teuthology.orchestra.run.smithi155.stdout: { 2023-08-01T19:56:38.113 INFO:teuthology.orchestra.run.smithi155.stdout: "event": "commit_sent", 2023-08-01T19:56:38.113 INFO:teuthology.orchestra.run.smithi155.stdout: "time": "2023-08-01T19:55:05.635143+0000", 2023-08-01T19:56:38.113 INFO:teuthology.orchestra.run.smithi155.stdout: "duration": 2.9430000000000001e-05 2023-08-01T19:56:38.113 INFO:teuthology.orchestra.run.smithi155.stdout: }, 2023-08-01T19:56:38.113 INFO:teuthology.orchestra.run.smithi155.stdout: { 2023-08-01T19:56:38.113 INFO:teuthology.orchestra.run.smithi155.stdout: "event": "done", 2023-08-01T19:56:38.113 INFO:teuthology.orchestra.run.smithi155.stdout: "time": "2023-08-01T19:55:05.635181+0000", 2023-08-01T19:56:38.114 INFO:teuthology.orchestra.run.smithi155.stdout: "duration": 3.8352000000000001e-05 2023-08-01T19:56:38.114 INFO:teuthology.orchestra.run.smithi155.stdout: } 2023-08-01T19:56:38.114 INFO:teuthology.orchestra.run.smithi155.stdout: ] 2023-08-01T19:56:38.114 INFO:teuthology.orchestra.run.smithi155.stdout: } 2023-08-01T19:56:38.114 INFO:teuthology.orchestra.run.smithi155.stdout: }, 2023-08-01T19:56:38.114 INFO:teuthology.orchestra.run.smithi155.stdout: { 2023-08-01T19:56:38.114 INFO:teuthology.orchestra.run.smithi155.stdout: "description": "osd_op(client.4668.0:100945 5.e 5:73df68dd:::benchmark_data_smithi006_114134_object100944:head [set-alloc-hint object_size 65536 write_size 65536,write 0~65536] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e37)", 2023-08-01T19:56:38.114 INFO:teuthology.orchestra.run.smithi155.stdout: "initiated_at": "2023-08-01T19:55:05.576784+0000", 2023-08-01T19:56:38.115 INFO:teuthology.orchestra.run.smithi155.stdout: "age": 92.399585384999995, 2023-08-01T19:56:38.115 INFO:teuthology.orchestra.run.smithi155.stdout: "duration": 0.058512994999999998, 2023-08-01T19:56:38.115 INFO:teuthology.orchestra.run.smithi155.stdout: "type_data": { 2023-08-01T19:56:38.115 INFO:teuthology.orchestra.run.smithi155.stdout: "flag_point": "commit sent; apply or cleanup", 2023-08-01T19:56:38.115 INFO:teuthology.orchestra.run.smithi155.stdout: "client_info": { 2023-08-01T19:56:38.115 INFO:teuthology.orchestra.run.smithi155.stdout: "client": "client.4668", 2023-08-01T19:56:38.115 INFO:teuthology.orchestra.run.smithi155.stdout: "client_addr": "172.21.15.6:0/1709472247", 2023-08-01T19:56:38.115 INFO:teuthology.orchestra.run.smithi155.stdout: "tid": 100945 2023-08-01T19:56:38.116 INFO:teuthology.orchestra.run.smithi155.stdout: }, 2023-08-01T19:56:38.116 INFO:teuthology.orchestra.run.smithi155.stdout: "events": [ 2023-08-01T19:56:38.116 INFO:teuthology.orchestra.run.smithi155.stdout: { 2023-08-01T19:56:38.116 INFO:teuthology.orchestra.run.smithi155.stdout: "event": "initiated", 2023-08-01T19:56:38.116 INFO:teuthology.orchestra.run.smithi155.stdout: "time": "2023-08-01T19:55:05.576784+0000", 2023-08-01T19:56:38.116 INFO:teuthology.orchestra.run.smithi155.stdout: "duration": 0 2023-08-01T19:56:38.116 INFO:teuthology.orchestra.run.smithi155.stdout: }, 2023-08-01T19:56:38.116 INFO:teuthology.orchestra.run.smithi155.stdout: { 2023-08-01T19:56:38.117 INFO:teuthology.orchestra.run.smithi155.stdout: "event": "throttled", 2023-08-01T19:56:38.117 INFO:teuthology.orchestra.run.smithi155.stdout: "time": "2023-08-01T19:55:05.576784+0000", 2023-08-01T19:56:38.117 INFO:teuthology.orchestra.run.smithi155.stdout: "duration": 0 2023-08-01T19:56:38.117 INFO:teuthology.orchestra.run.smithi155.stdout: }, 2023-08-01T19:56:38.117 INFO:teuthology.orchestra.run.smithi155.stdout: { 2023-08-01T19:56:38.117 INFO:teuthology.orchestra.run.smithi155.stdout: "event": "header_read", 2023-08-01T19:56:38.117 INFO:teuthology.orchestra.run.smithi155.stdout: "time": "2023-08-01T19:55:05.576783+0000", 2023-08-01T19:56:38.118 INFO:teuthology.orchestra.run.smithi155.stdout: "duration": 4294967295.9999995 2023-08-01T19:56:38.118 INFO:teuthology.orchestra.run.smithi155.stdout: }, 2023-08-01T19:56:38.118 INFO:teuthology.orchestra.run.smithi155.stdout: { 2023-08-01T19:56:38.118 INFO:teuthology.orchestra.run.smithi155.stdout: "event": "all_read", 2023-08-01T19:56:38.118 INFO:teuthology.orchestra.run.smithi155.stdout: "time": "2023-08-01T19:55:05.576807+0000", 2023-08-01T19:56:38.118 INFO:teuthology.orchestra.run.smithi155.stdout: "duration": 2.3651000000000001e-05 2023-08-01T19:56:38.118 INFO:teuthology.orchestra.run.smithi155.stdout: }, 2023-08-01T19:56:38.118 INFO:teuthology.orchestra.run.smithi155.stdout: { 2023-08-01T19:56:38.119 INFO:teuthology.orchestra.run.smithi155.stdout: "event": "dispatched", 2023-08-01T19:56:38.119 INFO:teuthology.orchestra.run.smithi155.stdout: "time": "2023-08-01T19:55:05.576817+0000", 2023-08-01T19:56:38.119 INFO:teuthology.orchestra.run.smithi155.stdout: "duration": 9.9389999999999992e-06 2023-08-01T19:56:38.119 INFO:teuthology.orchestra.run.smithi155.stdout: }, 2023-08-01T19:56:38.119 INFO:teuthology.orchestra.run.smithi155.stdout: { 2023-08-01T19:56:38.119 INFO:teuthology.orchestra.run.smithi155.stdout: "event": "queued_for_pg", 2023-08-01T19:56:38.119 INFO:teuthology.orchestra.run.smithi155.stdout: "time": "2023-08-01T19:55:05.576820+0000", 2023-08-01T19:56:38.119 INFO:teuthology.orchestra.run.smithi155.stdout: "duration": 3.2619999999999999e-06 2023-08-01T19:56:38.120 INFO:teuthology.orchestra.run.smithi155.stdout: }, 2023-08-01T19:56:38.120 INFO:teuthology.orchestra.run.smithi155.stdout: { 2023-08-01T19:56:38.120 INFO:teuthology.orchestra.run.smithi155.stdout: "event": "reached_pg", 2023-08-01T19:56:38.120 INFO:teuthology.orchestra.run.smithi155.stdout: "time": "2023-08-01T19:55:05.576849+0000", 2023-08-01T19:56:38.120 INFO:teuthology.orchestra.run.smithi155.stdout: "duration": 2.8880000000000001e-05 2023-08-01T19:56:38.120 INFO:teuthology.orchestra.run.smithi155.stdout: }, 2023-08-01T19:56:38.120 INFO:teuthology.orchestra.run.smithi155.stdout: { 2023-08-01T19:56:38.120 INFO:teuthology.orchestra.run.smithi155.stdout: "event": "started", 2023-08-01T19:56:38.121 INFO:teuthology.orchestra.run.smithi155.stdout: "time": "2023-08-01T19:55:05.576940+0000", 2023-08-01T19:56:38.121 INFO:teuthology.orchestra.run.smithi155.stdout: "duration": 9.0570999999999997e-05 2023-08-01T19:56:38.121 INFO:teuthology.orchestra.run.smithi155.stdout: }, 2023-08-01T19:56:38.121 INFO:teuthology.orchestra.run.smithi155.stdout: { 2023-08-01T19:56:38.121 INFO:teuthology.orchestra.run.smithi155.stdout: "event": "waiting for subops from 0", 2023-08-01T19:56:38.121 INFO:teuthology.orchestra.run.smithi155.stdout: "time": "2023-08-01T19:55:05.577027+0000", 2023-08-01T19:56:38.121 INFO:teuthology.orchestra.run.smithi155.stdout: "duration": 8.7237999999999994e-05 2023-08-01T19:56:38.121 INFO:teuthology.orchestra.run.smithi155.stdout: }, 2023-08-01T19:56:38.122 INFO:teuthology.orchestra.run.smithi155.stdout: { 2023-08-01T19:56:38.122 INFO:teuthology.orchestra.run.smithi155.stdout: "event": "op_commit", 2023-08-01T19:56:38.122 INFO:teuthology.orchestra.run.smithi155.stdout: "time": "2023-08-01T19:55:05.579624+0000", 2023-08-01T19:56:38.122 INFO:teuthology.orchestra.run.smithi155.stdout: "duration": 0.0025971200000000001 2023-08-01T19:56:38.122 INFO:teuthology.orchestra.run.smithi155.stdout: }, 2023-08-01T19:56:38.122 INFO:teuthology.orchestra.run.smithi155.stdout: { 2023-08-01T19:56:38.122 INFO:teuthology.orchestra.run.smithi155.stdout: "event": "sub_op_commit_rec", 2023-08-01T19:56:38.122 INFO:teuthology.orchestra.run.smithi155.stdout: "time": "2023-08-01T19:55:05.635218+0000", 2023-08-01T19:56:38.123 INFO:teuthology.orchestra.run.smithi155.stdout: "duration": 0.055594487999999997 2023-08-01T19:56:38.123 INFO:teuthology.orchestra.run.smithi155.stdout: }, 2023-08-01T19:56:38.123 INFO:teuthology.orchestra.run.smithi155.stdout: { 2023-08-01T19:56:38.123 INFO:teuthology.orchestra.run.smithi155.stdout: "event": "commit_sent", 2023-08-01T19:56:38.123 INFO:teuthology.orchestra.run.smithi155.stdout: "time": "2023-08-01T19:55:05.635262+0000", 2023-08-01T19:56:38.123 INFO:teuthology.orchestra.run.smithi155.stdout: "duration": 4.3380999999999997e-05 2023-08-01T19:56:38.123 INFO:teuthology.orchestra.run.smithi155.stdout: }, 2023-08-01T19:56:38.123 INFO:teuthology.orchestra.run.smithi155.stdout: { 2023-08-01T19:56:38.124 INFO:teuthology.orchestra.run.smithi155.stdout: "event": "done", 2023-08-01T19:56:38.124 INFO:teuthology.orchestra.run.smithi155.stdout: "time": "2023-08-01T19:55:05.635297+0000", 2023-08-01T19:56:38.124 INFO:teuthology.orchestra.run.smithi155.stdout: "duration": 3.4842000000000003e-05 2023-08-01T19:56:38.124 INFO:teuthology.orchestra.run.smithi155.stdout: } 2023-08-01T19:56:38.124 INFO:teuthology.orchestra.run.smithi155.stdout: ] 2023-08-01T19:56:38.124 INFO:teuthology.orchestra.run.smithi155.stdout: } 2023-08-01T19:56:38.124 INFO:teuthology.orchestra.run.smithi155.stdout: }, 2023-08-01T19:56:38.124 INFO:teuthology.orchestra.run.smithi155.stdout: { 2023-08-01T19:56:38.125 INFO:teuthology.orchestra.run.smithi155.stdout: "description": "osd_op(client.4668.0:100947 5.4 5:23e8fc27:::benchmark_data_smithi006_114134_object100946:head [set-alloc-hint object_size 65536 write_size 65536,write 0~65536] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e37)", 2023-08-01T19:56:38.125 INFO:teuthology.orchestra.run.smithi155.stdout: "initiated_at": "2023-08-01T19:55:05.576840+0000", 2023-08-01T19:56:38.125 INFO:teuthology.orchestra.run.smithi155.stdout: "age": 92.399529330000007, 2023-08-01T19:56:38.125 INFO:teuthology.orchestra.run.smithi155.stdout: "duration": 0.058423127999999998, 2023-08-01T19:56:38.125 INFO:teuthology.orchestra.run.smithi155.stdout: "type_data": { 2023-08-01T19:56:38.125 INFO:teuthology.orchestra.run.smithi155.stdout: "flag_point": "commit sent; apply or cleanup", 2023-08-01T19:56:38.125 INFO:teuthology.orchestra.run.smithi155.stdout: "client_info": { 2023-08-01T19:56:38.126 INFO:teuthology.orchestra.run.smithi155.stdout: "client": "client.4668", 2023-08-01T19:56:38.126 INFO:teuthology.orchestra.run.smithi155.stdout: "client_addr": "172.21.15.6:0/1709472247", 2023-08-01T19:56:38.126 INFO:teuthology.orchestra.run.smithi155.stdout: "tid": 100947 2023-08-01T19:56:38.126 INFO:teuthology.orchestra.run.smithi155.stdout: }, 2023-08-01T19:56:38.126 INFO:teuthology.orchestra.run.smithi155.stdout: "events": [ 2023-08-01T19:56:38.126 INFO:teuthology.orchestra.run.smithi155.stdout: { 2023-08-01T19:56:38.126 INFO:teuthology.orchestra.run.smithi155.stdout: "event": "initiated", 2023-08-01T19:56:38.126 INFO:teuthology.orchestra.run.smithi155.stdout: "time": "2023-08-01T19:55:05.576840+0000", 2023-08-01T19:56:38.127 INFO:teuthology.orchestra.run.smithi155.stdout: "duration": 0 2023-08-01T19:56:38.127 INFO:teuthology.orchestra.run.smithi155.stdout: }, 2023-08-01T19:56:38.127 INFO:teuthology.orchestra.run.smithi155.stdout: { 2023-08-01T19:56:38.127 INFO:teuthology.orchestra.run.smithi155.stdout: "event": "throttled", 2023-08-01T19:56:38.127 INFO:teuthology.orchestra.run.smithi155.stdout: "time": "2023-08-01T19:55:05.576840+0000", 2023-08-01T19:56:38.127 INFO:teuthology.orchestra.run.smithi155.stdout: "duration": 0 2023-08-01T19:56:38.127 INFO:teuthology.orchestra.run.smithi155.stdout: }, 2023-08-01T19:56:38.127 INFO:teuthology.orchestra.run.smithi155.stdout: { 2023-08-01T19:56:38.128 INFO:teuthology.orchestra.run.smithi155.stdout: "event": "header_read", 2023-08-01T19:56:38.128 INFO:teuthology.orchestra.run.smithi155.stdout: "time": "2023-08-01T19:55:05.576839+0000", 2023-08-01T19:56:38.128 INFO:teuthology.orchestra.run.smithi155.stdout: "duration": 4294967295.9999995 2023-08-01T19:56:38.128 INFO:teuthology.orchestra.run.smithi155.stdout: }, 2023-08-01T19:56:38.128 INFO:teuthology.orchestra.run.smithi155.stdout: { 2023-08-01T19:56:38.128 INFO:teuthology.orchestra.run.smithi155.stdout: "event": "all_read", 2023-08-01T19:56:38.128 INFO:teuthology.orchestra.run.smithi155.stdout: "time": "2023-08-01T19:55:05.576893+0000", 2023-08-01T19:56:38.128 INFO:teuthology.orchestra.run.smithi155.stdout: "duration": 5.3893000000000001e-05 2023-08-01T19:56:38.129 INFO:teuthology.orchestra.run.smithi155.stdout: }, 2023-08-01T19:56:38.129 INFO:teuthology.orchestra.run.smithi155.stdout: { 2023-08-01T19:56:38.129 INFO:teuthology.orchestra.run.smithi155.stdout: "event": "dispatched", 2023-08-01T19:56:38.129 INFO:teuthology.orchestra.run.smithi155.stdout: "time": "2023-08-01T19:55:05.576902+0000", 2023-08-01T19:56:38.129 INFO:teuthology.orchestra.run.smithi155.stdout: "duration": 8.7520000000000002e-06 2023-08-01T19:56:38.129 INFO:teuthology.orchestra.run.smithi155.stdout: }, 2023-08-01T19:56:38.129 INFO:teuthology.orchestra.run.smithi155.stdout: { 2023-08-01T19:56:38.130 INFO:teuthology.orchestra.run.smithi155.stdout: "event": "queued_for_pg", 2023-08-01T19:56:38.130 INFO:teuthology.orchestra.run.smithi155.stdout: "time": "2023-08-01T19:55:05.576905+0000", 2023-08-01T19:56:38.130 INFO:teuthology.orchestra.run.smithi155.stdout: "duration": 3.01e-06 2023-08-01T19:56:38.130 INFO:teuthology.orchestra.run.smithi155.stdout: }, 2023-08-01T19:56:38.130 INFO:teuthology.orchestra.run.smithi155.stdout: { 2023-08-01T19:56:38.130 INFO:teuthology.orchestra.run.smithi155.stdout: "event": "reached_pg", 2023-08-01T19:56:38.130 INFO:teuthology.orchestra.run.smithi155.stdout: "time": "2023-08-01T19:55:05.579641+0000", 2023-08-01T19:56:38.130 INFO:teuthology.orchestra.run.smithi155.stdout: "duration": 0.0027366880000000001 2023-08-01T19:56:38.131 INFO:teuthology.orchestra.run.smithi155.stdout: }, 2023-08-01T19:56:38.131 INFO:teuthology.orchestra.run.smithi155.stdout: { 2023-08-01T19:56:38.131 INFO:teuthology.orchestra.run.smithi155.stdout: "event": "started", 2023-08-01T19:56:38.131 INFO:teuthology.orchestra.run.smithi155.stdout: "time": "2023-08-01T19:55:05.579734+0000", 2023-08-01T19:56:38.131 INFO:teuthology.orchestra.run.smithi155.stdout: "duration": 9.2590000000000006e-05 2023-08-01T19:56:38.131 INFO:teuthology.orchestra.run.smithi155.stdout: }, 2023-08-01T19:56:38.131 INFO:teuthology.orchestra.run.smithi155.stdout: { 2023-08-01T19:56:38.131 INFO:teuthology.orchestra.run.smithi155.stdout: "event": "waiting for subops from 0", 2023-08-01T19:56:38.132 INFO:teuthology.orchestra.run.smithi155.stdout: "time": "2023-08-01T19:55:05.579825+0000", 2023-08-01T19:56:38.132 INFO:teuthology.orchestra.run.smithi155.stdout: "duration": 9.0964999999999994e-05 2023-08-01T19:56:38.132 INFO:teuthology.orchestra.run.smithi155.stdout: }, 2023-08-01T19:56:38.132 INFO:teuthology.orchestra.run.smithi155.stdout: { 2023-08-01T19:56:38.132 INFO:teuthology.orchestra.run.smithi155.stdout: "event": "op_commit", 2023-08-01T19:56:38.132 INFO:teuthology.orchestra.run.smithi155.stdout: "time": "2023-08-01T19:55:05.585041+0000", 2023-08-01T19:56:38.132 INFO:teuthology.orchestra.run.smithi155.stdout: "duration": 0.0052159670000000002 2023-08-01T19:56:38.132 INFO:teuthology.orchestra.run.smithi155.stdout: }, 2023-08-01T19:56:38.133 INFO:teuthology.orchestra.run.smithi155.stdout: { 2023-08-01T19:56:38.133 INFO:teuthology.orchestra.run.smithi155.stdout: "event": "sub_op_commit_rec", 2023-08-01T19:56:38.133 INFO:teuthology.orchestra.run.smithi155.stdout: "time": "2023-08-01T19:55:05.635199+0000", 2023-08-01T19:56:38.133 INFO:teuthology.orchestra.run.smithi155.stdout: "duration": 0.050158023000000003 2023-08-01T19:56:38.133 INFO:teuthology.orchestra.run.smithi155.stdout: }, 2023-08-01T19:56:38.133 INFO:teuthology.orchestra.run.smithi155.stdout: { 2023-08-01T19:56:38.133 INFO:teuthology.orchestra.run.smithi155.stdout: "event": "commit_sent", 2023-08-01T19:56:38.133 INFO:teuthology.orchestra.run.smithi155.stdout: "time": "2023-08-01T19:55:05.635227+0000", 2023-08-01T19:56:38.134 INFO:teuthology.orchestra.run.smithi155.stdout: "duration": 2.7821e-05 2023-08-01T19:56:38.134 INFO:teuthology.orchestra.run.smithi155.stdout: }, 2023-08-01T19:56:38.134 INFO:teuthology.orchestra.run.smithi155.stdout: { 2023-08-01T19:56:38.134 INFO:teuthology.orchestra.run.smithi155.stdout: "event": "done", 2023-08-01T19:56:38.134 INFO:teuthology.orchestra.run.smithi155.stdout: "time": "2023-08-01T19:55:05.635263+0000", 2023-08-01T19:56:38.134 INFO:teuthology.orchestra.run.smithi155.stdout: "duration": 3.6081000000000002e-05 2023-08-01T19:56:38.134 INFO:teuthology.orchestra.run.smithi155.stdout: } 2023-08-01T19:56:38.134 INFO:teuthology.orchestra.run.smithi155.stdout: ] 2023-08-01T19:56:38.135 INFO:teuthology.orchestra.run.smithi155.stdout: } 2023-08-01T19:56:38.135 INFO:teuthology.orchestra.run.smithi155.stdout: }, 2023-08-01T19:56:38.135 INFO:teuthology.orchestra.run.smithi155.stdout: { 2023-08-01T19:56:38.135 INFO:teuthology.orchestra.run.smithi155.stdout: "description": "osd_op(client.4668.0:197408 5.d 5:bbda375a:::benchmark_data_smithi006_114134_object63747:head [delete] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e61)", 2023-08-01T19:56:38.135 INFO:teuthology.orchestra.run.smithi155.stdout: "initiated_at": "2023-08-01T19:55:58.559714+0000", 2023-08-01T19:56:38.135 INFO:teuthology.orchestra.run.smithi155.stdout: "age": 39.416655343000002, 2023-08-01T19:56:38.135 INFO:teuthology.orchestra.run.smithi155.stdout: "duration": 1.047043671, 2023-08-01T19:56:38.135 INFO:teuthology.orchestra.run.smithi155.stdout: "type_data": { 2023-08-01T19:56:38.136 INFO:teuthology.orchestra.run.smithi155.stdout: "flag_point": "commit sent; apply or cleanup", 2023-08-01T19:56:38.136 INFO:teuthology.orchestra.run.smithi155.stdout: "client_info": { 2023-08-01T19:56:38.136 INFO:teuthology.orchestra.run.smithi155.stdout: "client": "client.4668", 2023-08-01T19:56:38.136 INFO:teuthology.orchestra.run.smithi155.stdout: "client_addr": "172.21.15.6:0/1709472247", 2023-08-01T19:56:38.136 INFO:teuthology.orchestra.run.smithi155.stdout: "tid": 197408 2023-08-01T19:56:38.136 INFO:teuthology.orchestra.run.smithi155.stdout: }, 2023-08-01T19:56:38.136 INFO:teuthology.orchestra.run.smithi155.stdout: "events": [ 2023-08-01T19:56:38.137 INFO:teuthology.orchestra.run.smithi155.stdout: { 2023-08-01T19:56:38.137 INFO:teuthology.orchestra.run.smithi155.stdout: "event": "initiated", 2023-08-01T19:56:38.137 INFO:teuthology.orchestra.run.smithi155.stdout: "time": "2023-08-01T19:55:58.559714+0000", 2023-08-01T19:56:38.137 INFO:teuthology.orchestra.run.smithi155.stdout: "duration": 0 2023-08-01T19:56:38.137 INFO:teuthology.orchestra.run.smithi155.stdout: }, 2023-08-01T19:56:38.137 INFO:teuthology.orchestra.run.smithi155.stdout: { 2023-08-01T19:56:38.137 INFO:teuthology.orchestra.run.smithi155.stdout: "event": "throttled", 2023-08-01T19:56:38.137 INFO:teuthology.orchestra.run.smithi155.stdout: "time": "2023-08-01T19:55:58.559714+0000", 2023-08-01T19:56:38.138 INFO:teuthology.orchestra.run.smithi155.stdout: "duration": 0 2023-08-01T19:56:38.138 INFO:teuthology.orchestra.run.smithi155.stdout: }, 2023-08-01T19:56:38.138 INFO:teuthology.orchestra.run.smithi155.stdout: { 2023-08-01T19:56:38.138 INFO:teuthology.orchestra.run.smithi155.stdout: "event": "header_read", 2023-08-01T19:56:38.138 INFO:teuthology.orchestra.run.smithi155.stdout: "time": "2023-08-01T19:55:58.559713+0000", 2023-08-01T19:56:38.138 INFO:teuthology.orchestra.run.smithi155.stdout: "duration": 4294967295.999999 2023-08-01T19:56:38.138 INFO:teuthology.orchestra.run.smithi155.stdout: }, 2023-08-01T19:56:38.138 INFO:teuthology.orchestra.run.smithi155.stdout: { 2023-08-01T19:56:38.139 INFO:teuthology.orchestra.run.smithi155.stdout: "event": "all_read", 2023-08-01T19:56:38.139 INFO:teuthology.orchestra.run.smithi155.stdout: "time": "2023-08-01T19:55:58.559717+0000", 2023-08-01T19:56:38.139 INFO:teuthology.orchestra.run.smithi155.stdout: "duration": 4.2860000000000001e-06 2023-08-01T19:56:38.139 INFO:teuthology.orchestra.run.smithi155.stdout: }, 2023-08-01T19:56:38.139 INFO:teuthology.orchestra.run.smithi155.stdout: { 2023-08-01T19:56:38.139 INFO:teuthology.orchestra.run.smithi155.stdout: "event": "dispatched", 2023-08-01T19:56:38.139 INFO:teuthology.orchestra.run.smithi155.stdout: "time": "2023-08-01T19:55:58.559774+0000", 2023-08-01T19:56:38.139 INFO:teuthology.orchestra.run.smithi155.stdout: "duration": 5.6508999999999997e-05 2023-08-01T19:56:38.140 INFO:teuthology.orchestra.run.smithi155.stdout: }, 2023-08-01T19:56:38.140 INFO:teuthology.orchestra.run.smithi155.stdout: { 2023-08-01T19:56:38.140 INFO:teuthology.orchestra.run.smithi155.stdout: "event": "queued_for_pg", 2023-08-01T19:56:38.140 INFO:teuthology.orchestra.run.smithi155.stdout: "time": "2023-08-01T19:55:58.559781+0000", 2023-08-01T19:56:38.140 INFO:teuthology.orchestra.run.smithi155.stdout: "duration": 7.1829999999999997e-06 2023-08-01T19:56:38.140 INFO:teuthology.orchestra.run.smithi155.stdout: }, 2023-08-01T19:56:38.140 INFO:teuthology.orchestra.run.smithi155.stdout: { 2023-08-01T19:56:38.141 INFO:teuthology.orchestra.run.smithi155.stdout: "event": "reached_pg", 2023-08-01T19:56:38.141 INFO:teuthology.orchestra.run.smithi155.stdout: "time": "2023-08-01T19:55:58.571621+0000", 2023-08-01T19:56:38.141 INFO:teuthology.orchestra.run.smithi155.stdout: "duration": 0.011840603999999999 2023-08-01T19:56:38.141 INFO:teuthology.orchestra.run.smithi155.stdout: }, 2023-08-01T19:56:38.141 INFO:teuthology.orchestra.run.smithi155.stdout: { 2023-08-01T19:56:38.141 INFO:teuthology.orchestra.run.smithi155.stdout: "event": "waiting for peered", 2023-08-01T19:56:38.141 INFO:teuthology.orchestra.run.smithi155.stdout: "time": "2023-08-01T19:55:58.571630+0000", 2023-08-01T19:56:38.141 INFO:teuthology.orchestra.run.smithi155.stdout: "duration": 8.9770000000000006e-06 2023-08-01T19:56:38.142 INFO:teuthology.orchestra.run.smithi155.stdout: }, 2023-08-01T19:56:38.142 INFO:teuthology.orchestra.run.smithi155.stdout: { 2023-08-01T19:56:38.142 INFO:teuthology.orchestra.run.smithi155.stdout: "event": "reached_pg", 2023-08-01T19:56:38.142 INFO:teuthology.orchestra.run.smithi155.stdout: "time": "2023-08-01T19:55:59.601300+0000", 2023-08-01T19:56:38.142 INFO:teuthology.orchestra.run.smithi155.stdout: "duration": 1.0296694989999999 2023-08-01T19:56:38.142 INFO:teuthology.orchestra.run.smithi155.stdout: }, 2023-08-01T19:56:38.142 INFO:teuthology.orchestra.run.smithi155.stdout: { 2023-08-01T19:56:38.142 INFO:teuthology.orchestra.run.smithi155.stdout: "event": "started", 2023-08-01T19:56:38.143 INFO:teuthology.orchestra.run.smithi155.stdout: "time": "2023-08-01T19:55:59.601448+0000", 2023-08-01T19:56:38.143 INFO:teuthology.orchestra.run.smithi155.stdout: "duration": 0.00014828399999999999 2023-08-01T19:56:38.143 INFO:teuthology.orchestra.run.smithi155.stdout: }, 2023-08-01T19:56:38.143 INFO:teuthology.orchestra.run.smithi155.stdout: { 2023-08-01T19:56:38.143 INFO:teuthology.orchestra.run.smithi155.stdout: "event": "op_commit", 2023-08-01T19:56:38.143 INFO:teuthology.orchestra.run.smithi155.stdout: "time": "2023-08-01T19:55:59.606616+0000", 2023-08-01T19:56:38.143 INFO:teuthology.orchestra.run.smithi155.stdout: "duration": 0.0051679769999999998 2023-08-01T19:56:38.143 INFO:teuthology.orchestra.run.smithi155.stdout: }, 2023-08-01T19:56:38.144 INFO:teuthology.orchestra.run.smithi155.stdout: { 2023-08-01T19:56:38.144 INFO:teuthology.orchestra.run.smithi155.stdout: "event": "commit_sent", 2023-08-01T19:56:38.144 INFO:teuthology.orchestra.run.smithi155.stdout: "time": "2023-08-01T19:55:59.606662+0000", 2023-08-01T19:56:38.144 INFO:teuthology.orchestra.run.smithi155.stdout: "duration": 4.5843000000000001e-05 2023-08-01T19:56:38.144 INFO:teuthology.orchestra.run.smithi155.stdout: }, 2023-08-01T19:56:38.144 INFO:teuthology.orchestra.run.smithi155.stdout: { 2023-08-01T19:56:38.144 INFO:teuthology.orchestra.run.smithi155.stdout: "event": "done", 2023-08-01T19:56:38.144 INFO:teuthology.orchestra.run.smithi155.stdout: "time": "2023-08-01T19:55:59.606757+0000", 2023-08-01T19:56:38.145 INFO:teuthology.orchestra.run.smithi155.stdout: "duration": 9.5373999999999999e-05 2023-08-01T19:56:38.145 INFO:teuthology.orchestra.run.smithi155.stdout: } 2023-08-01T19:56:38.145 INFO:teuthology.orchestra.run.smithi155.stdout: ] 2023-08-01T19:56:38.145 INFO:teuthology.orchestra.run.smithi155.stdout: } 2023-08-01T19:56:38.145 INFO:teuthology.orchestra.run.smithi155.stdout: }, 2023-08-01T19:56:38.145 INFO:teuthology.orchestra.run.smithi155.stdout: { 2023-08-01T19:56:38.145 INFO:teuthology.orchestra.run.smithi155.stdout: "description": "osd_op(client.4668.0:197416 5.d 5:bd99e66d:::benchmark_data_smithi006_114134_object63755:head [delete] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e62)", 2023-08-01T19:56:38.145 INFO:teuthology.orchestra.run.smithi155.stdout: "initiated_at": "2023-08-01T19:55:58.577369+0000", 2023-08-01T19:56:38.146 INFO:teuthology.orchestra.run.smithi155.stdout: "age": 39.399000366000003, 2023-08-01T19:56:38.146 INFO:teuthology.orchestra.run.smithi155.stdout: "duration": 1.0300980120000001, 2023-08-01T19:56:38.146 INFO:teuthology.orchestra.run.smithi155.stdout: "type_data": { 2023-08-01T19:56:38.146 INFO:teuthology.orchestra.run.smithi155.stdout: "flag_point": "commit sent; apply or cleanup", 2023-08-01T19:56:38.146 INFO:teuthology.orchestra.run.smithi155.stdout: "client_info": { 2023-08-01T19:56:38.146 INFO:teuthology.orchestra.run.smithi155.stdout: "client": "client.4668", 2023-08-01T19:56:38.146 INFO:teuthology.orchestra.run.smithi155.stdout: "client_addr": "172.21.15.6:0/1709472247", 2023-08-01T19:56:38.146 INFO:teuthology.orchestra.run.smithi155.stdout: "tid": 197416 2023-08-01T19:56:38.147 INFO:teuthology.orchestra.run.smithi155.stdout: }, 2023-08-01T19:56:38.147 INFO:teuthology.orchestra.run.smithi155.stdout: "events": [ 2023-08-01T19:56:38.147 INFO:teuthology.orchestra.run.smithi155.stdout: { 2023-08-01T19:56:38.147 INFO:teuthology.orchestra.run.smithi155.stdout: "event": "initiated", 2023-08-01T19:56:38.147 INFO:teuthology.orchestra.run.smithi155.stdout: "time": "2023-08-01T19:55:58.577369+0000", 2023-08-01T19:56:38.147 INFO:teuthology.orchestra.run.smithi155.stdout: "duration": 0 2023-08-01T19:56:38.147 INFO:teuthology.orchestra.run.smithi155.stdout: }, 2023-08-01T19:56:38.148 INFO:teuthology.orchestra.run.smithi155.stdout: { 2023-08-01T19:56:38.148 INFO:teuthology.orchestra.run.smithi155.stdout: "event": "throttled", 2023-08-01T19:56:38.148 INFO:teuthology.orchestra.run.smithi155.stdout: "time": "2023-08-01T19:55:58.577369+0000", 2023-08-01T19:56:38.148 INFO:teuthology.orchestra.run.smithi155.stdout: "duration": 0 2023-08-01T19:56:38.148 INFO:teuthology.orchestra.run.smithi155.stdout: }, 2023-08-01T19:56:38.148 INFO:teuthology.orchestra.run.smithi155.stdout: { 2023-08-01T19:56:38.148 INFO:teuthology.orchestra.run.smithi155.stdout: "event": "header_read", 2023-08-01T19:56:38.148 INFO:teuthology.orchestra.run.smithi155.stdout: "time": "2023-08-01T19:55:58.577368+0000", 2023-08-01T19:56:38.149 INFO:teuthology.orchestra.run.smithi155.stdout: "duration": 4294967295.9999995 2023-08-01T19:56:38.149 INFO:teuthology.orchestra.run.smithi155.stdout: }, 2023-08-01T19:56:38.149 INFO:teuthology.orchestra.run.smithi155.stdout: { 2023-08-01T19:56:38.149 INFO:teuthology.orchestra.run.smithi155.stdout: "event": "all_read", 2023-08-01T19:56:38.149 INFO:teuthology.orchestra.run.smithi155.stdout: "time": "2023-08-01T19:55:58.577370+0000", 2023-08-01T19:56:38.149 INFO:teuthology.orchestra.run.smithi155.stdout: "duration": 2.1150000000000001e-06 2023-08-01T19:56:38.149 INFO:teuthology.orchestra.run.smithi155.stdout: }, 2023-08-01T19:56:38.149 INFO:teuthology.orchestra.run.smithi155.stdout: { 2023-08-01T19:56:38.150 INFO:teuthology.orchestra.run.smithi155.stdout: "event": "dispatched", 2023-08-01T19:56:38.150 INFO:teuthology.orchestra.run.smithi155.stdout: "time": "2023-08-01T19:55:58.577377+0000", 2023-08-01T19:56:38.150 INFO:teuthology.orchestra.run.smithi155.stdout: "duration": 6.6610000000000003e-06 2023-08-01T19:56:38.150 INFO:teuthology.orchestra.run.smithi155.stdout: }, 2023-08-01T19:56:38.150 INFO:teuthology.orchestra.run.smithi155.stdout: { 2023-08-01T19:56:38.150 INFO:teuthology.orchestra.run.smithi155.stdout: "event": "queued_for_pg", 2023-08-01T19:56:38.150 INFO:teuthology.orchestra.run.smithi155.stdout: "time": "2023-08-01T19:55:58.577380+0000", 2023-08-01T19:56:38.150 INFO:teuthology.orchestra.run.smithi155.stdout: "duration": 2.7360000000000001e-06 2023-08-01T19:56:38.151 INFO:teuthology.orchestra.run.smithi155.stdout: }, 2023-08-01T19:56:38.151 INFO:teuthology.orchestra.run.smithi155.stdout: { 2023-08-01T19:56:38.151 INFO:teuthology.orchestra.run.smithi155.stdout: "event": "reached_pg", 2023-08-01T19:56:38.151 INFO:teuthology.orchestra.run.smithi155.stdout: "time": "2023-08-01T19:55:58.577405+0000", 2023-08-01T19:56:38.151 INFO:teuthology.orchestra.run.smithi155.stdout: "duration": 2.4929000000000001e-05 2023-08-01T19:56:38.151 INFO:teuthology.orchestra.run.smithi155.stdout: }, 2023-08-01T19:56:38.151 INFO:teuthology.orchestra.run.smithi155.stdout: { 2023-08-01T19:56:38.151 INFO:teuthology.orchestra.run.smithi155.stdout: "event": "waiting for peered", 2023-08-01T19:56:38.152 INFO:teuthology.orchestra.run.smithi155.stdout: "time": "2023-08-01T19:55:58.577409+0000", 2023-08-01T19:56:38.152 INFO:teuthology.orchestra.run.smithi155.stdout: "duration": 4.0799999999999999e-06 2023-08-01T19:56:38.152 INFO:teuthology.orchestra.run.smithi155.stdout: }, 2023-08-01T19:56:38.152 INFO:teuthology.orchestra.run.smithi155.stdout: { 2023-08-01T19:56:38.152 INFO:teuthology.orchestra.run.smithi155.stdout: "event": "reached_pg", 2023-08-01T19:56:38.152 INFO:teuthology.orchestra.run.smithi155.stdout: "time": "2023-08-01T19:55:59.603639+0000", 2023-08-01T19:56:38.152 INFO:teuthology.orchestra.run.smithi155.stdout: "duration": 1.0262299349999999 2023-08-01T19:56:38.153 INFO:teuthology.orchestra.run.smithi155.stdout: }, 2023-08-01T19:56:38.153 INFO:teuthology.orchestra.run.smithi155.stdout: { 2023-08-01T19:56:38.153 INFO:teuthology.orchestra.run.smithi155.stdout: "event": "started", 2023-08-01T19:56:38.153 INFO:teuthology.orchestra.run.smithi155.stdout: "time": "2023-08-01T19:55:59.603772+0000", 2023-08-01T19:56:38.153 INFO:teuthology.orchestra.run.smithi155.stdout: "duration": 0.000133153 2023-08-01T19:56:38.153 INFO:teuthology.orchestra.run.smithi155.stdout: }, 2023-08-01T19:56:38.153 INFO:teuthology.orchestra.run.smithi155.stdout: { 2023-08-01T19:56:38.153 INFO:teuthology.orchestra.run.smithi155.stdout: "event": "op_commit", 2023-08-01T19:56:38.154 INFO:teuthology.orchestra.run.smithi155.stdout: "time": "2023-08-01T19:55:59.607354+0000", 2023-08-01T19:56:38.154 INFO:teuthology.orchestra.run.smithi155.stdout: "duration": 0.0035819599999999999 2023-08-01T19:56:38.154 INFO:teuthology.orchestra.run.smithi155.stdout: }, 2023-08-01T19:56:38.154 INFO:teuthology.orchestra.run.smithi155.stdout: { 2023-08-01T19:56:38.154 INFO:teuthology.orchestra.run.smithi155.stdout: "event": "commit_sent", 2023-08-01T19:56:38.154 INFO:teuthology.orchestra.run.smithi155.stdout: "time": "2023-08-01T19:55:59.607396+0000", 2023-08-01T19:56:38.154 INFO:teuthology.orchestra.run.smithi155.stdout: "duration": 4.2423999999999999e-05 2023-08-01T19:56:38.154 INFO:teuthology.orchestra.run.smithi155.stdout: }, 2023-08-01T19:56:38.155 INFO:teuthology.orchestra.run.smithi155.stdout: { 2023-08-01T19:56:38.155 INFO:teuthology.orchestra.run.smithi155.stdout: "event": "done", 2023-08-01T19:56:38.155 INFO:teuthology.orchestra.run.smithi155.stdout: "time": "2023-08-01T19:55:59.607467+0000", 2023-08-01T19:56:38.155 INFO:teuthology.orchestra.run.smithi155.stdout: "duration": 7.0360999999999999e-05 2023-08-01T19:56:38.155 INFO:teuthology.orchestra.run.smithi155.stdout: } 2023-08-01T19:56:38.155 INFO:teuthology.orchestra.run.smithi155.stdout: ] 2023-08-01T19:56:38.155 INFO:teuthology.orchestra.run.smithi155.stdout: } 2023-08-01T19:56:38.155 INFO:teuthology.orchestra.run.smithi155.stdout: }, 2023-08-01T19:56:38.156 INFO:teuthology.orchestra.run.smithi155.stdout: { 2023-08-01T19:56:38.156 INFO:teuthology.orchestra.run.smithi155.stdout: "description": "osd_op(client.4668.0:197419 5.d 5:be7dc7c9:::benchmark_data_smithi006_114134_object63758:head [delete] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e62)", 2023-08-01T19:56:38.156 INFO:teuthology.orchestra.run.smithi155.stdout: "initiated_at": "2023-08-01T19:55:58.580223+0000", 2023-08-01T19:56:38.156 INFO:teuthology.orchestra.run.smithi155.stdout: "age": 39.396146414999997, 2023-08-01T19:56:38.156 INFO:teuthology.orchestra.run.smithi155.stdout: "duration": 1.0286139439999999, 2023-08-01T19:56:38.156 INFO:teuthology.orchestra.run.smithi155.stdout: "type_data": { 2023-08-01T19:56:38.156 INFO:teuthology.orchestra.run.smithi155.stdout: "flag_point": "commit sent; apply or cleanup", 2023-08-01T19:56:38.156 INFO:teuthology.orchestra.run.smithi155.stdout: "client_info": { 2023-08-01T19:56:38.157 INFO:teuthology.orchestra.run.smithi155.stdout: "client": "client.4668", 2023-08-01T19:56:38.157 INFO:teuthology.orchestra.run.smithi155.stdout: "client_addr": "172.21.15.6:0/1709472247", 2023-08-01T19:56:38.157 INFO:teuthology.orchestra.run.smithi155.stdout: "tid": 197419 2023-08-01T19:56:38.157 INFO:teuthology.orchestra.run.smithi155.stdout: }, 2023-08-01T19:56:38.157 INFO:teuthology.orchestra.run.smithi155.stdout: "events": [ 2023-08-01T19:56:38.157 INFO:teuthology.orchestra.run.smithi155.stdout: { 2023-08-01T19:56:38.157 INFO:teuthology.orchestra.run.smithi155.stdout: "event": "initiated", 2023-08-01T19:56:38.158 INFO:teuthology.orchestra.run.smithi155.stdout: "time": "2023-08-01T19:55:58.580223+0000", 2023-08-01T19:56:38.158 INFO:teuthology.orchestra.run.smithi155.stdout: "duration": 0 2023-08-01T19:56:38.158 INFO:teuthology.orchestra.run.smithi155.stdout: }, 2023-08-01T19:56:38.158 INFO:teuthology.orchestra.run.smithi155.stdout: { 2023-08-01T19:56:38.158 INFO:teuthology.orchestra.run.smithi155.stdout: "event": "throttled", 2023-08-01T19:56:38.158 INFO:teuthology.orchestra.run.smithi155.stdout: "time": "2023-08-01T19:55:58.580223+0000", 2023-08-01T19:56:38.158 INFO:teuthology.orchestra.run.smithi155.stdout: "duration": 0 2023-08-01T19:56:38.158 INFO:teuthology.orchestra.run.smithi155.stdout: }, 2023-08-01T19:56:38.159 INFO:teuthology.orchestra.run.smithi155.stdout: { 2023-08-01T19:56:38.159 INFO:teuthology.orchestra.run.smithi155.stdout: "event": "header_read", 2023-08-01T19:56:38.159 INFO:teuthology.orchestra.run.smithi155.stdout: "time": "2023-08-01T19:55:58.580222+0000", 2023-08-01T19:56:38.159 INFO:teuthology.orchestra.run.smithi155.stdout: "duration": 4294967295.9999995 2023-08-01T19:56:38.159 INFO:teuthology.orchestra.run.smithi155.stdout: }, 2023-08-01T19:56:38.160 INFO:teuthology.orchestra.run.smithi155.stdout: { 2023-08-01T19:56:38.160 INFO:teuthology.orchestra.run.smithi155.stdout: "event": "all_read", 2023-08-01T19:56:38.160 INFO:teuthology.orchestra.run.smithi155.stdout: "time": "2023-08-01T19:55:58.580225+0000", 2023-08-01T19:56:38.160 INFO:teuthology.orchestra.run.smithi155.stdout: "duration": 3.2820000000000001e-06 2023-08-01T19:56:38.160 INFO:teuthology.orchestra.run.smithi155.stdout: }, 2023-08-01T19:56:38.160 INFO:teuthology.orchestra.run.smithi155.stdout: { 2023-08-01T19:56:38.161 INFO:teuthology.orchestra.run.smithi155.stdout: "event": "dispatched", 2023-08-01T19:56:38.161 INFO:teuthology.orchestra.run.smithi155.stdout: "time": "2023-08-01T19:55:58.580233+0000", 2023-08-01T19:56:38.161 INFO:teuthology.orchestra.run.smithi155.stdout: "duration": 7.34e-06 2023-08-01T19:56:38.161 INFO:teuthology.orchestra.run.smithi155.stdout: }, 2023-08-01T19:56:38.162 INFO:teuthology.orchestra.run.smithi155.stdout: { 2023-08-01T19:56:38.162 INFO:teuthology.orchestra.run.smithi155.stdout: "event": "queued_for_pg", 2023-08-01T19:56:38.162 INFO:teuthology.orchestra.run.smithi155.stdout: "time": "2023-08-01T19:55:58.580236+0000", 2023-08-01T19:56:38.162 INFO:teuthology.orchestra.run.smithi155.stdout: "duration": 3.473e-06 2023-08-01T19:56:38.163 INFO:teuthology.orchestra.run.smithi155.stdout: }, 2023-08-01T19:56:38.163 INFO:teuthology.orchestra.run.smithi155.stdout: { 2023-08-01T19:56:38.163 INFO:teuthology.orchestra.run.smithi155.stdout: "event": "reached_pg", 2023-08-01T19:56:38.164 INFO:teuthology.orchestra.run.smithi155.stdout: "time": "2023-08-01T19:55:58.580267+0000", 2023-08-01T19:56:38.164 INFO:teuthology.orchestra.run.smithi155.stdout: "duration": 3.0479000000000001e-05 2023-08-01T19:56:38.164 INFO:teuthology.orchestra.run.smithi155.stdout: }, 2023-08-01T19:56:38.164 INFO:teuthology.orchestra.run.smithi155.stdout: { 2023-08-01T19:56:38.164 INFO:teuthology.orchestra.run.smithi155.stdout: "event": "waiting for peered", 2023-08-01T19:56:38.165 INFO:teuthology.orchestra.run.smithi155.stdout: "time": "2023-08-01T19:55:58.580272+0000", 2023-08-01T19:56:38.165 INFO:teuthology.orchestra.run.smithi155.stdout: "duration": 5.011e-06 2023-08-01T19:56:38.165 INFO:teuthology.orchestra.run.smithi155.stdout: }, 2023-08-01T19:56:38.165 INFO:teuthology.orchestra.run.smithi155.stdout: { 2023-08-01T19:56:38.165 INFO:teuthology.orchestra.run.smithi155.stdout: "event": "reached_pg", 2023-08-01T19:56:38.165 INFO:teuthology.orchestra.run.smithi155.stdout: "time": "2023-08-01T19:55:59.604970+0000", 2023-08-01T19:56:38.166 INFO:teuthology.orchestra.run.smithi155.stdout: "duration": 1.0246984189999999 2023-08-01T19:56:38.166 INFO:teuthology.orchestra.run.smithi155.stdout: }, 2023-08-01T19:56:38.166 INFO:teuthology.orchestra.run.smithi155.stdout: { 2023-08-01T19:56:38.166 INFO:teuthology.orchestra.run.smithi155.stdout: "event": "started", 2023-08-01T19:56:38.166 INFO:teuthology.orchestra.run.smithi155.stdout: "time": "2023-08-01T19:55:59.605085+0000", 2023-08-01T19:56:38.166 INFO:teuthology.orchestra.run.smithi155.stdout: "duration": 0.00011531000000000001 2023-08-01T19:56:38.166 INFO:teuthology.orchestra.run.smithi155.stdout: }, 2023-08-01T19:56:38.166 INFO:teuthology.orchestra.run.smithi155.stdout: { 2023-08-01T19:56:38.167 INFO:teuthology.orchestra.run.smithi155.stdout: "event": "op_commit", 2023-08-01T19:56:38.167 INFO:teuthology.orchestra.run.smithi155.stdout: "time": "2023-08-01T19:55:59.608733+0000", 2023-08-01T19:56:38.167 INFO:teuthology.orchestra.run.smithi155.stdout: "duration": 0.0036478090000000001 2023-08-01T19:56:38.167 INFO:teuthology.orchestra.run.smithi155.stdout: }, 2023-08-01T19:56:38.167 INFO:teuthology.orchestra.run.smithi155.stdout: { 2023-08-01T19:56:38.167 INFO:teuthology.orchestra.run.smithi155.stdout: "event": "commit_sent", 2023-08-01T19:56:38.167 INFO:teuthology.orchestra.run.smithi155.stdout: "time": "2023-08-01T19:55:59.608771+0000", 2023-08-01T19:56:38.167 INFO:teuthology.orchestra.run.smithi155.stdout: "duration": 3.8033e-05 2023-08-01T19:56:38.168 INFO:teuthology.orchestra.run.smithi155.stdout: }, 2023-08-01T19:56:38.168 INFO:teuthology.orchestra.run.smithi155.stdout: { 2023-08-01T19:56:38.168 INFO:teuthology.orchestra.run.smithi155.stdout: "event": "done", 2023-08-01T19:56:38.168 INFO:teuthology.orchestra.run.smithi155.stdout: "time": "2023-08-01T19:55:59.608837+0000", 2023-08-01T19:56:38.168 INFO:teuthology.orchestra.run.smithi155.stdout: "duration": 6.5364000000000006e-05 2023-08-01T19:56:38.169 INFO:teuthology.orchestra.run.smithi155.stdout: } 2023-08-01T19:56:38.169 INFO:teuthology.orchestra.run.smithi155.stdout: ] 2023-08-01T19:56:38.169 INFO:teuthology.orchestra.run.smithi155.stdout: } 2023-08-01T19:56:38.169 INFO:teuthology.orchestra.run.smithi155.stdout: }, 2023-08-01T19:56:38.170 INFO:teuthology.orchestra.run.smithi155.stdout: { 2023-08-01T19:56:38.170 INFO:teuthology.orchestra.run.smithi155.stdout: "description": "osd_op(client.4668.0:197420 5.9 5:92a2efe5:::benchmark_data_smithi006_114134_object63759:head [delete] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e62)", 2023-08-01T19:56:38.170 INFO:teuthology.orchestra.run.smithi155.stdout: "initiated_at": "2023-08-01T19:55:58.582230+0000", 2023-08-01T19:56:38.170 INFO:teuthology.orchestra.run.smithi155.stdout: "age": 39.394139105000001, 2023-08-01T19:56:38.171 INFO:teuthology.orchestra.run.smithi155.stdout: "duration": 1.0095353739999999, 2023-08-01T19:56:38.171 INFO:teuthology.orchestra.run.smithi155.stdout: "type_data": { 2023-08-01T19:56:38.171 INFO:teuthology.orchestra.run.smithi155.stdout: "flag_point": "commit sent; apply or cleanup", 2023-08-01T19:56:38.172 INFO:teuthology.orchestra.run.smithi155.stdout: "client_info": { 2023-08-01T19:56:38.172 INFO:teuthology.orchestra.run.smithi155.stdout: "client": "client.4668", 2023-08-01T19:56:38.172 INFO:teuthology.orchestra.run.smithi155.stdout: "client_addr": "172.21.15.6:0/1709472247", 2023-08-01T19:56:38.172 INFO:teuthology.orchestra.run.smithi155.stdout: "tid": 197420 2023-08-01T19:56:38.173 INFO:teuthology.orchestra.run.smithi155.stdout: }, 2023-08-01T19:56:38.173 INFO:teuthology.orchestra.run.smithi155.stdout: "events": [ 2023-08-01T19:56:38.173 INFO:teuthology.orchestra.run.smithi155.stdout: { 2023-08-01T19:56:38.173 INFO:teuthology.orchestra.run.smithi155.stdout: "event": "initiated", 2023-08-01T19:56:38.174 INFO:teuthology.orchestra.run.smithi155.stdout: "time": "2023-08-01T19:55:58.582230+0000", 2023-08-01T19:56:38.174 INFO:teuthology.orchestra.run.smithi155.stdout: "duration": 0 2023-08-01T19:56:38.174 INFO:teuthology.orchestra.run.smithi155.stdout: }, 2023-08-01T19:56:38.174 INFO:teuthology.orchestra.run.smithi155.stdout: { 2023-08-01T19:56:38.175 INFO:teuthology.orchestra.run.smithi155.stdout: "event": "throttled", 2023-08-01T19:56:38.175 INFO:teuthology.orchestra.run.smithi155.stdout: "time": "2023-08-01T19:55:58.582230+0000", 2023-08-01T19:56:38.175 INFO:teuthology.orchestra.run.smithi155.stdout: "duration": 0 2023-08-01T19:56:38.175 INFO:teuthology.orchestra.run.smithi155.stdout: }, 2023-08-01T19:56:38.176 INFO:teuthology.orchestra.run.smithi155.stdout: { 2023-08-01T19:56:38.176 INFO:teuthology.orchestra.run.smithi155.stdout: "event": "header_read", 2023-08-01T19:56:38.176 INFO:teuthology.orchestra.run.smithi155.stdout: "time": "2023-08-01T19:55:58.582229+0000", 2023-08-01T19:56:38.176 INFO:teuthology.orchestra.run.smithi155.stdout: "duration": 4294967295.9999995 2023-08-01T19:56:38.177 INFO:teuthology.orchestra.run.smithi155.stdout: }, 2023-08-01T19:56:38.177 INFO:teuthology.orchestra.run.smithi155.stdout: { 2023-08-01T19:56:38.177 INFO:teuthology.orchestra.run.smithi155.stdout: "event": "all_read", 2023-08-01T19:56:38.177 INFO:teuthology.orchestra.run.smithi155.stdout: "time": "2023-08-01T19:55:58.582233+0000", 2023-08-01T19:56:38.178 INFO:teuthology.orchestra.run.smithi155.stdout: "duration": 3.7869999999999999e-06 2023-08-01T19:56:38.178 INFO:teuthology.orchestra.run.smithi155.stdout: }, 2023-08-01T19:56:38.178 INFO:teuthology.orchestra.run.smithi155.stdout: { 2023-08-01T19:56:38.178 INFO:teuthology.orchestra.run.smithi155.stdout: "event": "dispatched", 2023-08-01T19:56:38.179 INFO:teuthology.orchestra.run.smithi155.stdout: "time": "2023-08-01T19:55:58.582241+0000", 2023-08-01T19:56:38.179 INFO:teuthology.orchestra.run.smithi155.stdout: "duration": 7.6909999999999997e-06 2023-08-01T19:56:38.179 INFO:teuthology.orchestra.run.smithi155.stdout: }, 2023-08-01T19:56:38.179 INFO:teuthology.orchestra.run.smithi155.stdout: { 2023-08-01T19:56:38.180 INFO:teuthology.orchestra.run.smithi155.stdout: "event": "queued_for_pg", 2023-08-01T19:56:38.180 INFO:teuthology.orchestra.run.smithi155.stdout: "time": "2023-08-01T19:55:58.582244+0000", 2023-08-01T19:56:38.180 INFO:teuthology.orchestra.run.smithi155.stdout: "duration": 3.6770000000000001e-06 2023-08-01T19:56:38.180 INFO:teuthology.orchestra.run.smithi155.stdout: }, 2023-08-01T19:56:38.181 INFO:teuthology.orchestra.run.smithi155.stdout: { 2023-08-01T19:56:38.181 INFO:teuthology.orchestra.run.smithi155.stdout: "event": "reached_pg", 2023-08-01T19:56:38.181 INFO:teuthology.orchestra.run.smithi155.stdout: "time": "2023-08-01T19:55:58.582274+0000", 2023-08-01T19:56:38.181 INFO:teuthology.orchestra.run.smithi155.stdout: "duration": 3.0074e-05 2023-08-01T19:56:38.182 INFO:teuthology.orchestra.run.smithi155.stdout: }, 2023-08-01T19:56:38.182 INFO:teuthology.orchestra.run.smithi155.stdout: { 2023-08-01T19:56:38.182 INFO:teuthology.orchestra.run.smithi155.stdout: "event": "waiting for peered", 2023-08-01T19:56:38.182 INFO:teuthology.orchestra.run.smithi155.stdout: "time": "2023-08-01T19:55:58.582281+0000", 2023-08-01T19:56:38.183 INFO:teuthology.orchestra.run.smithi155.stdout: "duration": 6.297e-06 2023-08-01T19:56:38.183 INFO:teuthology.orchestra.run.smithi155.stdout: }, 2023-08-01T19:56:38.183 INFO:teuthology.orchestra.run.smithi155.stdout: { 2023-08-01T19:56:38.183 INFO:teuthology.orchestra.run.smithi155.stdout: "event": "reached_pg", 2023-08-01T19:56:38.184 INFO:teuthology.orchestra.run.smithi155.stdout: "time": "2023-08-01T19:55:59.586809+0000", 2023-08-01T19:56:38.184 INFO:teuthology.orchestra.run.smithi155.stdout: "duration": 1.0045281720000001 2023-08-01T19:56:38.184 INFO:teuthology.orchestra.run.smithi155.stdout: }, 2023-08-01T19:56:38.184 INFO:teuthology.orchestra.run.smithi155.stdout: { 2023-08-01T19:56:38.185 INFO:teuthology.orchestra.run.smithi155.stdout: "event": "started", 2023-08-01T19:56:38.185 INFO:teuthology.orchestra.run.smithi155.stdout: "time": "2023-08-01T19:55:59.586910+0000", 2023-08-01T19:56:38.185 INFO:teuthology.orchestra.run.smithi155.stdout: "duration": 0.000100898 2023-08-01T19:56:38.185 INFO:teuthology.orchestra.run.smithi155.stdout: }, 2023-08-01T19:56:38.186 INFO:teuthology.orchestra.run.smithi155.stdout: { 2023-08-01T19:56:38.186 INFO:teuthology.orchestra.run.smithi155.stdout: "event": "op_commit", 2023-08-01T19:56:38.186 INFO:teuthology.orchestra.run.smithi155.stdout: "time": "2023-08-01T19:55:59.591679+0000", 2023-08-01T19:56:38.186 INFO:teuthology.orchestra.run.smithi155.stdout: "duration": 0.004769471 2023-08-01T19:56:38.187 INFO:teuthology.orchestra.run.smithi155.stdout: }, 2023-08-01T19:56:38.187 INFO:teuthology.orchestra.run.smithi155.stdout: { 2023-08-01T19:56:38.187 INFO:teuthology.orchestra.run.smithi155.stdout: "event": "commit_sent", 2023-08-01T19:56:38.187 INFO:teuthology.orchestra.run.smithi155.stdout: "time": "2023-08-01T19:55:59.591721+0000", 2023-08-01T19:56:38.188 INFO:teuthology.orchestra.run.smithi155.stdout: "duration": 4.1953000000000003e-05 2023-08-01T19:56:38.188 INFO:teuthology.orchestra.run.smithi155.stdout: }, 2023-08-01T19:56:38.188 INFO:teuthology.orchestra.run.smithi155.stdout: { 2023-08-01T19:56:38.188 INFO:teuthology.orchestra.run.smithi155.stdout: "event": "done", 2023-08-01T19:56:38.189 INFO:teuthology.orchestra.run.smithi155.stdout: "time": "2023-08-01T19:55:59.591765+0000", 2023-08-01T19:56:38.189 INFO:teuthology.orchestra.run.smithi155.stdout: "duration": 4.4030999999999999e-05 2023-08-01T19:56:38.189 INFO:teuthology.orchestra.run.smithi155.stdout: } 2023-08-01T19:56:38.189 INFO:teuthology.orchestra.run.smithi155.stdout: ] 2023-08-01T19:56:38.190 INFO:teuthology.orchestra.run.smithi155.stdout: } 2023-08-01T19:56:38.190 INFO:teuthology.orchestra.run.smithi155.stdout: } 2023-08-01T19:56:38.190 INFO:teuthology.orchestra.run.smithi155.stdout: ] 2023-08-01T19:56:38.190 INFO:teuthology.orchestra.run.smithi155.stdout:} 2023-08-01T19:56:38.192 INFO:tasks.ceph.osd.2.smithi155.stderr:2023-08-01T19:56:38.190+0000 7faa5c6ac700 -1 received signal: Hangup from /usr/bin/python3 /bin/daemon-helper kill ceph-osd -f --cluster ceph -i 2 (PID: 111337) UID: 0 2023-08-01T19:56:38.193 DEBUG:teuthology.orchestra.run.smithi008:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 30 ceph --cluster ceph --admin-daemon /var/run/ceph/ceph-osd.0.asok dump_ops_in_flight 2023-08-01T19:56:38.292 INFO:tasks.ceph.osd.2.smithi155.stderr:2023-08-01T19:56:38.291+0000 7faa5c6ac700 -1 received signal: Hangup from /usr/bin/python3 /bin/daemon-helper kill ceph-osd -f --cluster ceph -i 2 (PID: 111337) UID: 0 2023-08-01T19:56:38.328 INFO:teuthology.orchestra.run.smithi008.stdout:{ 2023-08-01T19:56:38.328 INFO:teuthology.orchestra.run.smithi008.stdout: "ops": [], 2023-08-01T19:56:38.329 INFO:teuthology.orchestra.run.smithi008.stdout: "num_ops": 0 2023-08-01T19:56:38.329 INFO:teuthology.orchestra.run.smithi008.stdout:} 2023-08-01T19:56:38.338 DEBUG:teuthology.orchestra.run.smithi008:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 30 ceph --cluster ceph --admin-daemon /var/run/ceph/ceph-osd.0.asok dump_blocked_ops 2023-08-01T19:56:38.393 INFO:tasks.ceph.osd.2.smithi155.stderr:2023-08-01T19:56:38.392+0000 7faa5c6ac700 -1 received signal: Hangup from /usr/bin/python3 /bin/daemon-helper kill ceph-osd -f --cluster ceph -i 2 (PID: 111337) UID: 0 2023-08-01T19:56:38.457 DEBUG:teuthology.orchestra.run.smithi006:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 120 ceph --cluster ceph osd unset noscrub 2023-08-01T19:56:38.466 INFO:teuthology.orchestra.run.smithi008.stdout:{ 2023-08-01T19:56:38.466 INFO:teuthology.orchestra.run.smithi008.stdout: "ops": [], 2023-08-01T19:56:38.466 INFO:teuthology.orchestra.run.smithi008.stdout: "complaint_time": 30, 2023-08-01T19:56:38.467 INFO:teuthology.orchestra.run.smithi008.stdout: "num_blocked_ops": 0 2023-08-01T19:56:38.467 INFO:teuthology.orchestra.run.smithi008.stdout:} 2023-08-01T19:56:38.477 DEBUG:teuthology.orchestra.run.smithi008:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 30 ceph --cluster ceph --admin-daemon /var/run/ceph/ceph-osd.0.asok dump_historic_ops 2023-08-01T19:56:38.493 INFO:tasks.ceph.osd.2.smithi155.stderr:2023-08-01T19:56:38.492+0000 7faa5c6ac700 -1 received signal: Hangup from /usr/bin/python3 /bin/daemon-helper kill ceph-osd -f --cluster ceph -i 2 (PID: 111337) UID: 0 2023-08-01T19:56:38.594 INFO:tasks.ceph.osd.2.smithi155.stderr:2023-08-01T19:56:38.593+0000 7faa5c6ac700 -1 received signal: Hangup from /usr/bin/python3 /bin/daemon-helper kill ceph-osd -f --cluster ceph -i 2 (PID: 111337) UID: 0 2023-08-01T19:56:38.606 INFO:teuthology.orchestra.run.smithi008.stdout:{ 2023-08-01T19:56:38.606 INFO:teuthology.orchestra.run.smithi008.stdout: "size": 20, 2023-08-01T19:56:38.607 INFO:teuthology.orchestra.run.smithi008.stdout: "duration": 600, 2023-08-01T19:56:38.607 INFO:teuthology.orchestra.run.smithi008.stdout: "ops": [ 2023-08-01T19:56:38.607 INFO:teuthology.orchestra.run.smithi008.stdout: { 2023-08-01T19:56:38.607 INFO:teuthology.orchestra.run.smithi008.stdout: "description": "osd_op(client.4668.0:100240 5.a 5:5313c5b9:::benchmark_data_smithi006_114134_object100239:head [set-alloc-hint object_size 65536 write_size 65536,write 0~65536] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e37)", 2023-08-01T19:56:38.607 INFO:teuthology.orchestra.run.smithi008.stdout: "initiated_at": "2023-08-01T19:55:05.148399+0000", 2023-08-01T19:56:38.607 INFO:teuthology.orchestra.run.smithi008.stdout: "age": 93.455608226999999, 2023-08-01T19:56:38.607 INFO:teuthology.orchestra.run.smithi008.stdout: "duration": 0.077278904999999995, 2023-08-01T19:56:38.608 INFO:teuthology.orchestra.run.smithi008.stdout: "type_data": { 2023-08-01T19:56:38.608 INFO:teuthology.orchestra.run.smithi008.stdout: "flag_point": "commit sent; apply or cleanup", 2023-08-01T19:56:38.608 INFO:teuthology.orchestra.run.smithi008.stdout: "client_info": { 2023-08-01T19:56:38.608 INFO:teuthology.orchestra.run.smithi008.stdout: "client": "client.4668", 2023-08-01T19:56:38.608 INFO:teuthology.orchestra.run.smithi008.stdout: "client_addr": "172.21.15.6:0/1709472247", 2023-08-01T19:56:38.608 INFO:teuthology.orchestra.run.smithi008.stdout: "tid": 100240 2023-08-01T19:56:38.609 INFO:teuthology.orchestra.run.smithi008.stdout: }, 2023-08-01T19:56:38.609 INFO:teuthology.orchestra.run.smithi008.stdout: "events": [ 2023-08-01T19:56:38.609 INFO:teuthology.orchestra.run.smithi008.stdout: { 2023-08-01T19:56:38.609 INFO:teuthology.orchestra.run.smithi008.stdout: "event": "initiated", 2023-08-01T19:56:38.609 INFO:teuthology.orchestra.run.smithi008.stdout: "time": "2023-08-01T19:55:05.148399+0000", 2023-08-01T19:56:38.609 INFO:teuthology.orchestra.run.smithi008.stdout: "duration": 0 2023-08-01T19:56:38.609 INFO:teuthology.orchestra.run.smithi008.stdout: }, 2023-08-01T19:56:38.609 INFO:teuthology.orchestra.run.smithi008.stdout: { 2023-08-01T19:56:38.610 INFO:teuthology.orchestra.run.smithi008.stdout: "event": "throttled", 2023-08-01T19:56:38.610 INFO:teuthology.orchestra.run.smithi008.stdout: "time": "2023-08-01T19:55:05.148399+0000", 2023-08-01T19:56:38.610 INFO:teuthology.orchestra.run.smithi008.stdout: "duration": 0 2023-08-01T19:56:38.610 INFO:teuthology.orchestra.run.smithi008.stdout: }, 2023-08-01T19:56:38.610 INFO:teuthology.orchestra.run.smithi008.stdout: { 2023-08-01T19:56:38.610 INFO:teuthology.orchestra.run.smithi008.stdout: "event": "header_read", 2023-08-01T19:56:38.610 INFO:teuthology.orchestra.run.smithi008.stdout: "time": "2023-08-01T19:55:05.148398+0000", 2023-08-01T19:56:38.611 INFO:teuthology.orchestra.run.smithi008.stdout: "duration": 4294967295.999999 2023-08-01T19:56:38.611 INFO:teuthology.orchestra.run.smithi008.stdout: }, 2023-08-01T19:56:38.611 INFO:teuthology.orchestra.run.smithi008.stdout: { 2023-08-01T19:56:38.611 INFO:teuthology.orchestra.run.smithi008.stdout: "event": "all_read", 2023-08-01T19:56:38.611 INFO:teuthology.orchestra.run.smithi008.stdout: "time": "2023-08-01T19:55:05.148492+0000", 2023-08-01T19:56:38.611 INFO:teuthology.orchestra.run.smithi008.stdout: "duration": 9.3892000000000002e-05 2023-08-01T19:56:38.611 INFO:teuthology.orchestra.run.smithi008.stdout: }, 2023-08-01T19:56:38.612 INFO:teuthology.orchestra.run.smithi008.stdout: { 2023-08-01T19:56:38.612 INFO:teuthology.orchestra.run.smithi008.stdout: "event": "dispatched", 2023-08-01T19:56:38.612 INFO:teuthology.orchestra.run.smithi008.stdout: "time": "2023-08-01T19:55:05.148503+0000", 2023-08-01T19:56:38.612 INFO:teuthology.orchestra.run.smithi008.stdout: "duration": 1.0951000000000001e-05 2023-08-01T19:56:38.612 INFO:teuthology.orchestra.run.smithi008.stdout: }, 2023-08-01T19:56:38.612 INFO:teuthology.orchestra.run.smithi008.stdout: { 2023-08-01T19:56:38.613 INFO:teuthology.orchestra.run.smithi008.stdout: "event": "queued_for_pg", 2023-08-01T19:56:38.613 INFO:teuthology.orchestra.run.smithi008.stdout: "time": "2023-08-01T19:55:05.148508+0000", 2023-08-01T19:56:38.613 INFO:teuthology.orchestra.run.smithi008.stdout: "duration": 5.0080000000000002e-06 2023-08-01T19:56:38.613 INFO:teuthology.orchestra.run.smithi008.stdout: }, 2023-08-01T19:56:38.613 INFO:teuthology.orchestra.run.smithi008.stdout: { 2023-08-01T19:56:38.613 INFO:teuthology.orchestra.run.smithi008.stdout: "event": "reached_pg", 2023-08-01T19:56:38.613 INFO:teuthology.orchestra.run.smithi008.stdout: "time": "2023-08-01T19:55:05.148548+0000", 2023-08-01T19:56:38.613 INFO:teuthology.orchestra.run.smithi008.stdout: "duration": 4.0358999999999998e-05 2023-08-01T19:56:38.614 INFO:teuthology.orchestra.run.smithi008.stdout: }, 2023-08-01T19:56:38.614 INFO:teuthology.orchestra.run.smithi008.stdout: { 2023-08-01T19:56:38.614 INFO:teuthology.orchestra.run.smithi008.stdout: "event": "started", 2023-08-01T19:56:38.614 INFO:teuthology.orchestra.run.smithi008.stdout: "time": "2023-08-01T19:55:05.148666+0000", 2023-08-01T19:56:38.614 INFO:teuthology.orchestra.run.smithi008.stdout: "duration": 0.000117621 2023-08-01T19:56:38.614 INFO:teuthology.orchestra.run.smithi008.stdout: }, 2023-08-01T19:56:38.614 INFO:teuthology.orchestra.run.smithi008.stdout: { 2023-08-01T19:56:38.614 INFO:teuthology.orchestra.run.smithi008.stdout: "event": "waiting for subops from 2", 2023-08-01T19:56:38.615 INFO:teuthology.orchestra.run.smithi008.stdout: "time": "2023-08-01T19:55:05.148805+0000", 2023-08-01T19:56:38.615 INFO:teuthology.orchestra.run.smithi008.stdout: "duration": 0.000139176 2023-08-01T19:56:38.615 INFO:teuthology.orchestra.run.smithi008.stdout: }, 2023-08-01T19:56:38.615 INFO:teuthology.orchestra.run.smithi008.stdout: { 2023-08-01T19:56:38.615 INFO:teuthology.orchestra.run.smithi008.stdout: "event": "op_commit", 2023-08-01T19:56:38.615 INFO:teuthology.orchestra.run.smithi008.stdout: "time": "2023-08-01T19:55:05.156143+0000", 2023-08-01T19:56:38.615 INFO:teuthology.orchestra.run.smithi008.stdout: "duration": 0.007338041 2023-08-01T19:56:38.616 INFO:teuthology.orchestra.run.smithi008.stdout: }, 2023-08-01T19:56:38.616 INFO:teuthology.orchestra.run.smithi008.stdout: { 2023-08-01T19:56:38.616 INFO:teuthology.orchestra.run.smithi008.stdout: "event": "sub_op_commit_rec", 2023-08-01T19:56:38.616 INFO:teuthology.orchestra.run.smithi008.stdout: "time": "2023-08-01T19:55:05.225581+0000", 2023-08-01T19:56:38.616 INFO:teuthology.orchestra.run.smithi008.stdout: "duration": 0.069438402999999996 2023-08-01T19:56:38.616 INFO:teuthology.orchestra.run.smithi008.stdout: }, 2023-08-01T19:56:38.616 INFO:teuthology.orchestra.run.smithi008.stdout: { 2023-08-01T19:56:38.616 INFO:teuthology.orchestra.run.smithi008.stdout: "event": "commit_sent", 2023-08-01T19:56:38.617 INFO:teuthology.orchestra.run.smithi008.stdout: "time": "2023-08-01T19:55:05.225632+0000", 2023-08-01T19:56:38.617 INFO:teuthology.orchestra.run.smithi008.stdout: "duration": 5.0382e-05 2023-08-01T19:56:38.617 INFO:teuthology.orchestra.run.smithi008.stdout: }, 2023-08-01T19:56:38.617 INFO:teuthology.orchestra.run.smithi008.stdout: { 2023-08-01T19:56:38.617 INFO:teuthology.orchestra.run.smithi008.stdout: "event": "done", 2023-08-01T19:56:38.617 INFO:teuthology.orchestra.run.smithi008.stdout: "time": "2023-08-01T19:55:05.225677+0000", 2023-08-01T19:56:38.617 INFO:teuthology.orchestra.run.smithi008.stdout: "duration": 4.5893000000000003e-05 2023-08-01T19:56:38.618 INFO:teuthology.orchestra.run.smithi008.stdout: } 2023-08-01T19:56:38.618 INFO:teuthology.orchestra.run.smithi008.stdout: ] 2023-08-01T19:56:38.618 INFO:teuthology.orchestra.run.smithi008.stdout: } 2023-08-01T19:56:38.618 INFO:teuthology.orchestra.run.smithi008.stdout: }, 2023-08-01T19:56:38.618 INFO:teuthology.orchestra.run.smithi008.stdout: { 2023-08-01T19:56:38.618 INFO:teuthology.orchestra.run.smithi008.stdout: "description": "osd_op(client.4668.0:100243 5.a 5:5e8193b6:::benchmark_data_smithi006_114134_object100242:head [set-alloc-hint object_size 65536 write_size 65536,write 0~65536] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e37)", 2023-08-01T19:56:38.618 INFO:teuthology.orchestra.run.smithi008.stdout: "initiated_at": "2023-08-01T19:55:05.150737+0000", 2023-08-01T19:56:38.618 INFO:teuthology.orchestra.run.smithi008.stdout: "age": 93.453269771999999, 2023-08-01T19:56:38.619 INFO:teuthology.orchestra.run.smithi008.stdout: "duration": 0.075019885999999994, 2023-08-01T19:56:38.619 INFO:teuthology.orchestra.run.smithi008.stdout: "type_data": { 2023-08-01T19:56:38.619 INFO:teuthology.orchestra.run.smithi008.stdout: "flag_point": "commit sent; apply or cleanup", 2023-08-01T19:56:38.619 INFO:teuthology.orchestra.run.smithi008.stdout: "client_info": { 2023-08-01T19:56:38.619 INFO:teuthology.orchestra.run.smithi008.stdout: "client": "client.4668", 2023-08-01T19:56:38.619 INFO:teuthology.orchestra.run.smithi008.stdout: "client_addr": "172.21.15.6:0/1709472247", 2023-08-01T19:56:38.619 INFO:teuthology.orchestra.run.smithi008.stdout: "tid": 100243 2023-08-01T19:56:38.620 INFO:teuthology.orchestra.run.smithi008.stdout: }, 2023-08-01T19:56:38.620 INFO:teuthology.orchestra.run.smithi008.stdout: "events": [ 2023-08-01T19:56:38.620 INFO:teuthology.orchestra.run.smithi008.stdout: { 2023-08-01T19:56:38.620 INFO:teuthology.orchestra.run.smithi008.stdout: "event": "initiated", 2023-08-01T19:56:38.620 INFO:teuthology.orchestra.run.smithi008.stdout: "time": "2023-08-01T19:55:05.150737+0000", 2023-08-01T19:56:38.620 INFO:teuthology.orchestra.run.smithi008.stdout: "duration": 0 2023-08-01T19:56:38.620 INFO:teuthology.orchestra.run.smithi008.stdout: }, 2023-08-01T19:56:38.620 INFO:teuthology.orchestra.run.smithi008.stdout: { 2023-08-01T19:56:38.621 INFO:teuthology.orchestra.run.smithi008.stdout: "event": "throttled", 2023-08-01T19:56:38.621 INFO:teuthology.orchestra.run.smithi008.stdout: "time": "2023-08-01T19:55:05.150737+0000", 2023-08-01T19:56:38.621 INFO:teuthology.orchestra.run.smithi008.stdout: "duration": 0 2023-08-01T19:56:38.621 INFO:teuthology.orchestra.run.smithi008.stdout: }, 2023-08-01T19:56:38.621 INFO:teuthology.orchestra.run.smithi008.stdout: { 2023-08-01T19:56:38.621 INFO:teuthology.orchestra.run.smithi008.stdout: "event": "header_read", 2023-08-01T19:56:38.621 INFO:teuthology.orchestra.run.smithi008.stdout: "time": "2023-08-01T19:55:05.150736+0000", 2023-08-01T19:56:38.622 INFO:teuthology.orchestra.run.smithi008.stdout: "duration": 4294967295.999999 2023-08-01T19:56:38.622 INFO:teuthology.orchestra.run.smithi008.stdout: }, 2023-08-01T19:56:38.622 INFO:teuthology.orchestra.run.smithi008.stdout: { 2023-08-01T19:56:38.622 INFO:teuthology.orchestra.run.smithi008.stdout: "event": "all_read", 2023-08-01T19:56:38.623 INFO:teuthology.orchestra.run.smithi008.stdout: "time": "2023-08-01T19:55:05.150780+0000", 2023-08-01T19:56:38.623 INFO:teuthology.orchestra.run.smithi008.stdout: "duration": 4.3578999999999997e-05 2023-08-01T19:56:38.623 INFO:teuthology.orchestra.run.smithi008.stdout: }, 2023-08-01T19:56:38.623 INFO:teuthology.orchestra.run.smithi008.stdout: { 2023-08-01T19:56:38.623 INFO:teuthology.orchestra.run.smithi008.stdout: "event": "dispatched", 2023-08-01T19:56:38.623 INFO:teuthology.orchestra.run.smithi008.stdout: "time": "2023-08-01T19:55:05.150791+0000", 2023-08-01T19:56:38.623 INFO:teuthology.orchestra.run.smithi008.stdout: "duration": 1.0963e-05 2023-08-01T19:56:38.624 INFO:teuthology.orchestra.run.smithi008.stdout: }, 2023-08-01T19:56:38.624 INFO:teuthology.orchestra.run.smithi008.stdout: { 2023-08-01T19:56:38.624 INFO:teuthology.orchestra.run.smithi008.stdout: "event": "queued_for_pg", 2023-08-01T19:56:38.624 INFO:teuthology.orchestra.run.smithi008.stdout: "time": "2023-08-01T19:55:05.150797+0000", 2023-08-01T19:56:38.625 INFO:teuthology.orchestra.run.smithi008.stdout: "duration": 5.9780000000000002e-06 2023-08-01T19:56:38.625 INFO:teuthology.orchestra.run.smithi008.stdout: }, 2023-08-01T19:56:38.625 INFO:teuthology.orchestra.run.smithi008.stdout: { 2023-08-01T19:56:38.625 INFO:teuthology.orchestra.run.smithi008.stdout: "event": "reached_pg", 2023-08-01T19:56:38.626 INFO:teuthology.orchestra.run.smithi008.stdout: "time": "2023-08-01T19:55:05.150833+0000", 2023-08-01T19:56:38.626 INFO:teuthology.orchestra.run.smithi008.stdout: "duration": 3.6000000000000001e-05 2023-08-01T19:56:38.626 INFO:teuthology.orchestra.run.smithi008.stdout: }, 2023-08-01T19:56:38.626 INFO:teuthology.orchestra.run.smithi008.stdout: { 2023-08-01T19:56:38.627 INFO:teuthology.orchestra.run.smithi008.stdout: "event": "started", 2023-08-01T19:56:38.627 INFO:teuthology.orchestra.run.smithi008.stdout: "time": "2023-08-01T19:55:05.150951+0000", 2023-08-01T19:56:38.627 INFO:teuthology.orchestra.run.smithi008.stdout: "duration": 0.00011827799999999999 2023-08-01T19:56:38.627 INFO:teuthology.orchestra.run.smithi008.stdout: }, 2023-08-01T19:56:38.627 INFO:teuthology.orchestra.run.smithi008.stdout: { 2023-08-01T19:56:38.628 INFO:teuthology.orchestra.run.smithi008.stdout: "event": "waiting for subops from 2", 2023-08-01T19:56:38.628 INFO:teuthology.orchestra.run.smithi008.stdout: "time": "2023-08-01T19:55:05.151111+0000", 2023-08-01T19:56:38.628 INFO:teuthology.orchestra.run.smithi008.stdout: "duration": 0.00015961299999999999 2023-08-01T19:56:38.628 INFO:teuthology.orchestra.run.smithi008.stdout: }, 2023-08-01T19:56:38.628 INFO:teuthology.orchestra.run.smithi008.stdout: { 2023-08-01T19:56:38.628 INFO:teuthology.orchestra.run.smithi008.stdout: "event": "op_commit", 2023-08-01T19:56:38.629 INFO:teuthology.orchestra.run.smithi008.stdout: "time": "2023-08-01T19:55:05.156247+0000", 2023-08-01T19:56:38.629 INFO:teuthology.orchestra.run.smithi008.stdout: "duration": 0.005136524 2023-08-01T19:56:38.629 INFO:teuthology.orchestra.run.smithi008.stdout: }, 2023-08-01T19:56:38.629 INFO:teuthology.orchestra.run.smithi008.stdout: { 2023-08-01T19:56:38.629 INFO:teuthology.orchestra.run.smithi008.stdout: "event": "sub_op_commit_rec", 2023-08-01T19:56:38.629 INFO:teuthology.orchestra.run.smithi008.stdout: "time": "2023-08-01T19:55:05.225705+0000", 2023-08-01T19:56:38.629 INFO:teuthology.orchestra.run.smithi008.stdout: "duration": 0.069458377000000002 2023-08-01T19:56:38.630 INFO:teuthology.orchestra.run.smithi008.stdout: }, 2023-08-01T19:56:38.630 INFO:teuthology.orchestra.run.smithi008.stdout: { 2023-08-01T19:56:38.630 INFO:teuthology.orchestra.run.smithi008.stdout: "event": "commit_sent", 2023-08-01T19:56:38.630 INFO:teuthology.orchestra.run.smithi008.stdout: "time": "2023-08-01T19:55:05.225736+0000", 2023-08-01T19:56:38.630 INFO:teuthology.orchestra.run.smithi008.stdout: "duration": 3.0388000000000001e-05 2023-08-01T19:56:38.630 INFO:teuthology.orchestra.run.smithi008.stdout: }, 2023-08-01T19:56:38.630 INFO:teuthology.orchestra.run.smithi008.stdout: { 2023-08-01T19:56:38.630 INFO:teuthology.orchestra.run.smithi008.stdout: "event": "done", 2023-08-01T19:56:38.631 INFO:teuthology.orchestra.run.smithi008.stdout: "time": "2023-08-01T19:55:05.225757+0000", 2023-08-01T19:56:38.631 INFO:teuthology.orchestra.run.smithi008.stdout: "duration": 2.1090999999999998e-05 2023-08-01T19:56:38.631 INFO:teuthology.orchestra.run.smithi008.stdout: } 2023-08-01T19:56:38.631 INFO:teuthology.orchestra.run.smithi008.stdout: ] 2023-08-01T19:56:38.631 INFO:teuthology.orchestra.run.smithi008.stdout: } 2023-08-01T19:56:38.631 INFO:teuthology.orchestra.run.smithi008.stdout: }, 2023-08-01T19:56:38.631 INFO:teuthology.orchestra.run.smithi008.stdout: { 2023-08-01T19:56:38.631 INFO:teuthology.orchestra.run.smithi008.stdout: "description": "osd_op(client.4668.0:100933 5.5 5:af92e9f2:::benchmark_data_smithi006_114134_object100932:head [set-alloc-hint object_size 65536 write_size 65536,write 0~65536] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e37)", 2023-08-01T19:56:38.632 INFO:teuthology.orchestra.run.smithi008.stdout: "initiated_at": "2023-08-01T19:55:05.566634+0000", 2023-08-01T19:56:38.632 INFO:teuthology.orchestra.run.smithi008.stdout: "age": 93.037372900999998, 2023-08-01T19:56:38.632 INFO:teuthology.orchestra.run.smithi008.stdout: "duration": 0.065909364999999998, 2023-08-01T19:56:38.632 INFO:teuthology.orchestra.run.smithi008.stdout: "type_data": { 2023-08-01T19:56:38.632 INFO:teuthology.orchestra.run.smithi008.stdout: "flag_point": "commit sent; apply or cleanup", 2023-08-01T19:56:38.632 INFO:teuthology.orchestra.run.smithi008.stdout: "client_info": { 2023-08-01T19:56:38.632 INFO:teuthology.orchestra.run.smithi008.stdout: "client": "client.4668", 2023-08-01T19:56:38.633 INFO:teuthology.orchestra.run.smithi008.stdout: "client_addr": "172.21.15.6:0/1709472247", 2023-08-01T19:56:38.633 INFO:teuthology.orchestra.run.smithi008.stdout: "tid": 100933 2023-08-01T19:56:38.633 INFO:teuthology.orchestra.run.smithi008.stdout: }, 2023-08-01T19:56:38.633 INFO:teuthology.orchestra.run.smithi008.stdout: "events": [ 2023-08-01T19:56:38.633 INFO:teuthology.orchestra.run.smithi008.stdout: { 2023-08-01T19:56:38.633 INFO:teuthology.orchestra.run.smithi008.stdout: "event": "initiated", 2023-08-01T19:56:38.633 INFO:teuthology.orchestra.run.smithi008.stdout: "time": "2023-08-01T19:55:05.566634+0000", 2023-08-01T19:56:38.633 INFO:teuthology.orchestra.run.smithi008.stdout: "duration": 0 2023-08-01T19:56:38.634 INFO:teuthology.orchestra.run.smithi008.stdout: }, 2023-08-01T19:56:38.634 INFO:teuthology.orchestra.run.smithi008.stdout: { 2023-08-01T19:56:38.634 INFO:teuthology.orchestra.run.smithi008.stdout: "event": "throttled", 2023-08-01T19:56:38.634 INFO:teuthology.orchestra.run.smithi008.stdout: "time": "2023-08-01T19:55:05.566634+0000", 2023-08-01T19:56:38.634 INFO:teuthology.orchestra.run.smithi008.stdout: "duration": 0 2023-08-01T19:56:38.634 INFO:teuthology.orchestra.run.smithi008.stdout: }, 2023-08-01T19:56:38.634 INFO:teuthology.orchestra.run.smithi008.stdout: { 2023-08-01T19:56:38.635 INFO:teuthology.orchestra.run.smithi008.stdout: "event": "header_read", 2023-08-01T19:56:38.635 INFO:teuthology.orchestra.run.smithi008.stdout: "time": "2023-08-01T19:55:05.566630+0000", 2023-08-01T19:56:38.635 INFO:teuthology.orchestra.run.smithi008.stdout: "duration": 4294967295.9999962 2023-08-01T19:56:38.635 INFO:teuthology.orchestra.run.smithi008.stdout: }, 2023-08-01T19:56:38.635 INFO:teuthology.orchestra.run.smithi008.stdout: { 2023-08-01T19:56:38.635 INFO:teuthology.orchestra.run.smithi008.stdout: "event": "all_read", 2023-08-01T19:56:38.635 INFO:teuthology.orchestra.run.smithi008.stdout: "time": "2023-08-01T19:55:05.566736+0000", 2023-08-01T19:56:38.635 INFO:teuthology.orchestra.run.smithi008.stdout: "duration": 0.000105752 2023-08-01T19:56:38.636 INFO:teuthology.orchestra.run.smithi008.stdout: }, 2023-08-01T19:56:38.636 INFO:teuthology.orchestra.run.smithi008.stdout: { 2023-08-01T19:56:38.636 INFO:teuthology.orchestra.run.smithi008.stdout: "event": "dispatched", 2023-08-01T19:56:38.636 INFO:teuthology.orchestra.run.smithi008.stdout: "time": "2023-08-01T19:55:05.566742+0000", 2023-08-01T19:56:38.636 INFO:teuthology.orchestra.run.smithi008.stdout: "duration": 5.8209999999999998e-06 2023-08-01T19:56:38.636 INFO:teuthology.orchestra.run.smithi008.stdout: }, 2023-08-01T19:56:38.636 INFO:teuthology.orchestra.run.smithi008.stdout: { 2023-08-01T19:56:38.637 INFO:teuthology.orchestra.run.smithi008.stdout: "event": "queued_for_pg", 2023-08-01T19:56:38.637 INFO:teuthology.orchestra.run.smithi008.stdout: "time": "2023-08-01T19:55:05.566745+0000", 2023-08-01T19:56:38.637 INFO:teuthology.orchestra.run.smithi008.stdout: "duration": 3.337e-06 2023-08-01T19:56:38.637 INFO:teuthology.orchestra.run.smithi008.stdout: }, 2023-08-01T19:56:38.637 INFO:teuthology.orchestra.run.smithi008.stdout: { 2023-08-01T19:56:38.637 INFO:teuthology.orchestra.run.smithi008.stdout: "event": "reached_pg", 2023-08-01T19:56:38.637 INFO:teuthology.orchestra.run.smithi008.stdout: "time": "2023-08-01T19:55:05.568175+0000", 2023-08-01T19:56:38.637 INFO:teuthology.orchestra.run.smithi008.stdout: "duration": 0.001429647 2023-08-01T19:56:38.638 INFO:teuthology.orchestra.run.smithi008.stdout: }, 2023-08-01T19:56:38.638 INFO:teuthology.orchestra.run.smithi008.stdout: { 2023-08-01T19:56:38.638 INFO:teuthology.orchestra.run.smithi008.stdout: "event": "started", 2023-08-01T19:56:38.638 INFO:teuthology.orchestra.run.smithi008.stdout: "time": "2023-08-01T19:55:05.568288+0000", 2023-08-01T19:56:38.638 INFO:teuthology.orchestra.run.smithi008.stdout: "duration": 0.000113353 2023-08-01T19:56:38.638 INFO:teuthology.orchestra.run.smithi008.stdout: }, 2023-08-01T19:56:38.638 INFO:teuthology.orchestra.run.smithi008.stdout: { 2023-08-01T19:56:38.638 INFO:teuthology.orchestra.run.smithi008.stdout: "event": "waiting for subops from 1", 2023-08-01T19:56:38.639 INFO:teuthology.orchestra.run.smithi008.stdout: "time": "2023-08-01T19:55:05.568425+0000", 2023-08-01T19:56:38.639 INFO:teuthology.orchestra.run.smithi008.stdout: "duration": 0.000137346 2023-08-01T19:56:38.639 INFO:teuthology.orchestra.run.smithi008.stdout: }, 2023-08-01T19:56:38.639 INFO:teuthology.orchestra.run.smithi008.stdout: { 2023-08-01T19:56:38.639 INFO:teuthology.orchestra.run.smithi008.stdout: "event": "sub_op_commit_rec", 2023-08-01T19:56:38.639 INFO:teuthology.orchestra.run.smithi008.stdout: "time": "2023-08-01T19:55:05.629320+0000", 2023-08-01T19:56:38.639 INFO:teuthology.orchestra.run.smithi008.stdout: "duration": 0.060894491000000002 2023-08-01T19:56:38.639 INFO:teuthology.orchestra.run.smithi008.stdout: }, 2023-08-01T19:56:38.640 INFO:teuthology.orchestra.run.smithi008.stdout: { 2023-08-01T19:56:38.640 INFO:teuthology.orchestra.run.smithi008.stdout: "event": "op_commit", 2023-08-01T19:56:38.640 INFO:teuthology.orchestra.run.smithi008.stdout: "time": "2023-08-01T19:55:05.632452+0000", 2023-08-01T19:56:38.640 INFO:teuthology.orchestra.run.smithi008.stdout: "duration": 0.003131909 2023-08-01T19:56:38.640 INFO:teuthology.orchestra.run.smithi008.stdout: }, 2023-08-01T19:56:38.640 INFO:teuthology.orchestra.run.smithi008.stdout: { 2023-08-01T19:56:38.640 INFO:teuthology.orchestra.run.smithi008.stdout: "event": "commit_sent", 2023-08-01T19:56:38.641 INFO:teuthology.orchestra.run.smithi008.stdout: "time": "2023-08-01T19:55:05.632503+0000", 2023-08-01T19:56:38.641 INFO:teuthology.orchestra.run.smithi008.stdout: "duration": 5.1295000000000003e-05 2023-08-01T19:56:38.641 INFO:teuthology.orchestra.run.smithi008.stdout: }, 2023-08-01T19:56:38.641 INFO:teuthology.orchestra.run.smithi008.stdout: { 2023-08-01T19:56:38.641 INFO:teuthology.orchestra.run.smithi008.stdout: "event": "done", 2023-08-01T19:56:38.641 INFO:teuthology.orchestra.run.smithi008.stdout: "time": "2023-08-01T19:55:05.632543+0000", 2023-08-01T19:56:38.641 INFO:teuthology.orchestra.run.smithi008.stdout: "duration": 4.0234000000000001e-05 2023-08-01T19:56:38.641 INFO:teuthology.orchestra.run.smithi008.stdout: } 2023-08-01T19:56:38.642 INFO:teuthology.orchestra.run.smithi008.stdout: ] 2023-08-01T19:56:38.642 INFO:teuthology.orchestra.run.smithi008.stdout: } 2023-08-01T19:56:38.642 INFO:teuthology.orchestra.run.smithi008.stdout: }, 2023-08-01T19:56:38.642 INFO:teuthology.orchestra.run.smithi008.stdout: { 2023-08-01T19:56:38.642 INFO:teuthology.orchestra.run.smithi008.stdout: "description": "osd_op(client.4668.0:100939 5.5 5:a75fa6e3:::benchmark_data_smithi006_114134_object100938:head [set-alloc-hint object_size 65536 write_size 65536,write 0~65536] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e37)", 2023-08-01T19:56:38.642 INFO:teuthology.orchestra.run.smithi008.stdout: "initiated_at": "2023-08-01T19:55:05.569740+0000", 2023-08-01T19:56:38.642 INFO:teuthology.orchestra.run.smithi008.stdout: "age": 93.034267229999998, 2023-08-01T19:56:38.643 INFO:teuthology.orchestra.run.smithi008.stdout: "duration": 0.067753412999999998, 2023-08-01T19:56:38.643 INFO:teuthology.orchestra.run.smithi008.stdout: "type_data": { 2023-08-01T19:56:38.643 INFO:teuthology.orchestra.run.smithi008.stdout: "flag_point": "commit sent; apply or cleanup", 2023-08-01T19:56:38.643 INFO:teuthology.orchestra.run.smithi008.stdout: "client_info": { 2023-08-01T19:56:38.643 INFO:teuthology.orchestra.run.smithi008.stdout: "client": "client.4668", 2023-08-01T19:56:38.643 INFO:teuthology.orchestra.run.smithi008.stdout: "client_addr": "172.21.15.6:0/1709472247", 2023-08-01T19:56:38.643 INFO:teuthology.orchestra.run.smithi008.stdout: "tid": 100939 2023-08-01T19:56:38.643 INFO:teuthology.orchestra.run.smithi008.stdout: }, 2023-08-01T19:56:38.644 INFO:teuthology.orchestra.run.smithi008.stdout: "events": [ 2023-08-01T19:56:38.644 INFO:teuthology.orchestra.run.smithi008.stdout: { 2023-08-01T19:56:38.644 INFO:teuthology.orchestra.run.smithi008.stdout: "event": "initiated", 2023-08-01T19:56:38.644 INFO:teuthology.orchestra.run.smithi008.stdout: "time": "2023-08-01T19:55:05.569740+0000", 2023-08-01T19:56:38.644 INFO:teuthology.orchestra.run.smithi008.stdout: "duration": 0 2023-08-01T19:56:38.644 INFO:teuthology.orchestra.run.smithi008.stdout: }, 2023-08-01T19:56:38.644 INFO:teuthology.orchestra.run.smithi008.stdout: { 2023-08-01T19:56:38.644 INFO:teuthology.orchestra.run.smithi008.stdout: "event": "throttled", 2023-08-01T19:56:38.645 INFO:teuthology.orchestra.run.smithi008.stdout: "time": "2023-08-01T19:55:05.569740+0000", 2023-08-01T19:56:38.645 INFO:teuthology.orchestra.run.smithi008.stdout: "duration": 0 2023-08-01T19:56:38.645 INFO:teuthology.orchestra.run.smithi008.stdout: }, 2023-08-01T19:56:38.645 INFO:teuthology.orchestra.run.smithi008.stdout: { 2023-08-01T19:56:38.645 INFO:teuthology.orchestra.run.smithi008.stdout: "event": "header_read", 2023-08-01T19:56:38.645 INFO:teuthology.orchestra.run.smithi008.stdout: "time": "2023-08-01T19:55:05.569739+0000", 2023-08-01T19:56:38.645 INFO:teuthology.orchestra.run.smithi008.stdout: "duration": 4294967295.9999995 2023-08-01T19:56:38.645 INFO:teuthology.orchestra.run.smithi008.stdout: }, 2023-08-01T19:56:38.646 INFO:teuthology.orchestra.run.smithi008.stdout: { 2023-08-01T19:56:38.646 INFO:teuthology.orchestra.run.smithi008.stdout: "event": "all_read", 2023-08-01T19:56:38.646 INFO:teuthology.orchestra.run.smithi008.stdout: "time": "2023-08-01T19:55:05.569839+0000", 2023-08-01T19:56:38.646 INFO:teuthology.orchestra.run.smithi008.stdout: "duration": 0.000100219 2023-08-01T19:56:38.646 INFO:teuthology.orchestra.run.smithi008.stdout: }, 2023-08-01T19:56:38.646 INFO:teuthology.orchestra.run.smithi008.stdout: { 2023-08-01T19:56:38.646 INFO:teuthology.orchestra.run.smithi008.stdout: "event": "dispatched", 2023-08-01T19:56:38.647 INFO:teuthology.orchestra.run.smithi008.stdout: "time": "2023-08-01T19:55:05.569846+0000", 2023-08-01T19:56:38.647 INFO:teuthology.orchestra.run.smithi008.stdout: "duration": 7.3150000000000003e-06 2023-08-01T19:56:38.647 INFO:teuthology.orchestra.run.smithi008.stdout: }, 2023-08-01T19:56:38.647 INFO:teuthology.orchestra.run.smithi008.stdout: { 2023-08-01T19:56:38.647 INFO:teuthology.orchestra.run.smithi008.stdout: "event": "queued_for_pg", 2023-08-01T19:56:38.647 INFO:teuthology.orchestra.run.smithi008.stdout: "time": "2023-08-01T19:55:05.569850+0000", 2023-08-01T19:56:38.647 INFO:teuthology.orchestra.run.smithi008.stdout: "duration": 3.3299999999999999e-06 2023-08-01T19:56:38.647 INFO:teuthology.orchestra.run.smithi008.stdout: }, 2023-08-01T19:56:38.648 INFO:teuthology.orchestra.run.smithi008.stdout: { 2023-08-01T19:56:38.648 INFO:teuthology.orchestra.run.smithi008.stdout: "event": "reached_pg", 2023-08-01T19:56:38.648 INFO:teuthology.orchestra.run.smithi008.stdout: "time": "2023-08-01T19:55:05.626991+0000", 2023-08-01T19:56:38.648 INFO:teuthology.orchestra.run.smithi008.stdout: "duration": 0.057141585000000002 2023-08-01T19:56:38.648 INFO:teuthology.orchestra.run.smithi008.stdout: }, 2023-08-01T19:56:38.648 INFO:teuthology.orchestra.run.smithi008.stdout: { 2023-08-01T19:56:38.648 INFO:teuthology.orchestra.run.smithi008.stdout: "event": "started", 2023-08-01T19:56:38.649 INFO:teuthology.orchestra.run.smithi008.stdout: "time": "2023-08-01T19:55:05.627111+0000", 2023-08-01T19:56:38.649 INFO:teuthology.orchestra.run.smithi008.stdout: "duration": 0.000119238 2023-08-01T19:56:38.649 INFO:teuthology.orchestra.run.smithi008.stdout: }, 2023-08-01T19:56:38.649 INFO:teuthology.orchestra.run.smithi008.stdout: { 2023-08-01T19:56:38.649 INFO:teuthology.orchestra.run.smithi008.stdout: "event": "waiting for subops from 1", 2023-08-01T19:56:38.649 INFO:teuthology.orchestra.run.smithi008.stdout: "time": "2023-08-01T19:55:05.627253+0000", 2023-08-01T19:56:38.649 INFO:teuthology.orchestra.run.smithi008.stdout: "duration": 0.000142822 2023-08-01T19:56:38.649 INFO:teuthology.orchestra.run.smithi008.stdout: }, 2023-08-01T19:56:38.650 INFO:teuthology.orchestra.run.smithi008.stdout: { 2023-08-01T19:56:38.650 INFO:teuthology.orchestra.run.smithi008.stdout: "event": "op_commit", 2023-08-01T19:56:38.650 INFO:teuthology.orchestra.run.smithi008.stdout: "time": "2023-08-01T19:55:05.632555+0000", 2023-08-01T19:56:38.650 INFO:teuthology.orchestra.run.smithi008.stdout: "duration": 0.0053012449999999996 2023-08-01T19:56:38.650 INFO:teuthology.orchestra.run.smithi008.stdout: }, 2023-08-01T19:56:38.650 INFO:teuthology.orchestra.run.smithi008.stdout: { 2023-08-01T19:56:38.650 INFO:teuthology.orchestra.run.smithi008.stdout: "event": "sub_op_commit_rec", 2023-08-01T19:56:38.650 INFO:teuthology.orchestra.run.smithi008.stdout: "time": "2023-08-01T19:55:05.637380+0000", 2023-08-01T19:56:38.651 INFO:teuthology.orchestra.run.smithi008.stdout: "duration": 0.0048257639999999997 2023-08-01T19:56:38.651 INFO:teuthology.orchestra.run.smithi008.stdout: }, 2023-08-01T19:56:38.651 INFO:teuthology.orchestra.run.smithi008.stdout: { 2023-08-01T19:56:38.651 INFO:teuthology.orchestra.run.smithi008.stdout: "event": "commit_sent", 2023-08-01T19:56:38.651 INFO:teuthology.orchestra.run.smithi008.stdout: "time": "2023-08-01T19:55:05.637454+0000", 2023-08-01T19:56:38.651 INFO:teuthology.orchestra.run.smithi008.stdout: "duration": 7.3578999999999995e-05 2023-08-01T19:56:38.651 INFO:teuthology.orchestra.run.smithi008.stdout: }, 2023-08-01T19:56:38.652 INFO:teuthology.orchestra.run.smithi008.stdout: { 2023-08-01T19:56:38.652 INFO:teuthology.orchestra.run.smithi008.stdout: "event": "done", 2023-08-01T19:56:38.652 INFO:teuthology.orchestra.run.smithi008.stdout: "time": "2023-08-01T19:55:05.637493+0000", 2023-08-01T19:56:38.652 INFO:teuthology.orchestra.run.smithi008.stdout: "duration": 3.8986999999999998e-05 2023-08-01T19:56:38.652 INFO:teuthology.orchestra.run.smithi008.stdout: } 2023-08-01T19:56:38.653 INFO:teuthology.orchestra.run.smithi008.stdout: ] 2023-08-01T19:56:38.653 INFO:teuthology.orchestra.run.smithi008.stdout: } 2023-08-01T19:56:38.653 INFO:teuthology.orchestra.run.smithi008.stdout: }, 2023-08-01T19:56:38.653 INFO:teuthology.orchestra.run.smithi008.stdout: { 2023-08-01T19:56:38.653 INFO:teuthology.orchestra.run.smithi008.stdout: "description": "osd_op(client.4668.0:107863 5.3 5:cbdd875a:::benchmark_data_smithi006_114134_object107862:head [set-alloc-hint object_size 65536 write_size 65536,write 0~65536] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e38)", 2023-08-01T19:56:38.653 INFO:teuthology.orchestra.run.smithi008.stdout: "initiated_at": "2023-08-01T19:55:09.278851+0000", 2023-08-01T19:56:38.653 INFO:teuthology.orchestra.run.smithi008.stdout: "age": 89.32515549, 2023-08-01T19:56:38.654 INFO:teuthology.orchestra.run.smithi008.stdout: "duration": 0.071378853000000006, 2023-08-01T19:56:38.654 INFO:teuthology.orchestra.run.smithi008.stdout: "type_data": { 2023-08-01T19:56:38.654 INFO:teuthology.orchestra.run.smithi008.stdout: "flag_point": "commit sent; apply or cleanup", 2023-08-01T19:56:38.654 INFO:teuthology.orchestra.run.smithi008.stdout: "client_info": { 2023-08-01T19:56:38.654 INFO:teuthology.orchestra.run.smithi008.stdout: "client": "client.4668", 2023-08-01T19:56:38.654 INFO:teuthology.orchestra.run.smithi008.stdout: "client_addr": "172.21.15.6:0/1709472247", 2023-08-01T19:56:38.654 INFO:teuthology.orchestra.run.smithi008.stdout: "tid": 107863 2023-08-01T19:56:38.655 INFO:teuthology.orchestra.run.smithi008.stdout: }, 2023-08-01T19:56:38.655 INFO:teuthology.orchestra.run.smithi008.stdout: "events": [ 2023-08-01T19:56:38.655 INFO:teuthology.orchestra.run.smithi008.stdout: { 2023-08-01T19:56:38.655 INFO:teuthology.orchestra.run.smithi008.stdout: "event": "initiated", 2023-08-01T19:56:38.655 INFO:teuthology.orchestra.run.smithi008.stdout: "time": "2023-08-01T19:55:09.278851+0000", 2023-08-01T19:56:38.655 INFO:teuthology.orchestra.run.smithi008.stdout: "duration": 0 2023-08-01T19:56:38.655 INFO:teuthology.orchestra.run.smithi008.stdout: }, 2023-08-01T19:56:38.655 INFO:teuthology.orchestra.run.smithi008.stdout: { 2023-08-01T19:56:38.656 INFO:teuthology.orchestra.run.smithi008.stdout: "event": "throttled", 2023-08-01T19:56:38.656 INFO:teuthology.orchestra.run.smithi008.stdout: "time": "2023-08-01T19:55:09.278851+0000", 2023-08-01T19:56:38.656 INFO:teuthology.orchestra.run.smithi008.stdout: "duration": 0 2023-08-01T19:56:38.656 INFO:teuthology.orchestra.run.smithi008.stdout: }, 2023-08-01T19:56:38.656 INFO:teuthology.orchestra.run.smithi008.stdout: { 2023-08-01T19:56:38.656 INFO:teuthology.orchestra.run.smithi008.stdout: "event": "header_read", 2023-08-01T19:56:38.656 INFO:teuthology.orchestra.run.smithi008.stdout: "time": "2023-08-01T19:55:09.278850+0000", 2023-08-01T19:56:38.657 INFO:teuthology.orchestra.run.smithi008.stdout: "duration": 4294967295.999999 2023-08-01T19:56:38.657 INFO:teuthology.orchestra.run.smithi008.stdout: }, 2023-08-01T19:56:38.657 INFO:teuthology.orchestra.run.smithi008.stdout: { 2023-08-01T19:56:38.657 INFO:teuthology.orchestra.run.smithi008.stdout: "event": "all_read", 2023-08-01T19:56:38.657 INFO:teuthology.orchestra.run.smithi008.stdout: "time": "2023-08-01T19:55:09.278945+0000", 2023-08-01T19:56:38.657 INFO:teuthology.orchestra.run.smithi008.stdout: "duration": 9.4388000000000005e-05 2023-08-01T19:56:38.657 INFO:teuthology.orchestra.run.smithi008.stdout: }, 2023-08-01T19:56:38.657 INFO:teuthology.orchestra.run.smithi008.stdout: { 2023-08-01T19:56:38.658 INFO:teuthology.orchestra.run.smithi008.stdout: "event": "dispatched", 2023-08-01T19:56:38.658 INFO:teuthology.orchestra.run.smithi008.stdout: "time": "2023-08-01T19:55:09.278955+0000", 2023-08-01T19:56:38.658 INFO:teuthology.orchestra.run.smithi008.stdout: "duration": 1.0413e-05 2023-08-01T19:56:38.658 INFO:teuthology.orchestra.run.smithi008.stdout: }, 2023-08-01T19:56:38.658 INFO:teuthology.orchestra.run.smithi008.stdout: { 2023-08-01T19:56:38.658 INFO:teuthology.orchestra.run.smithi008.stdout: "event": "queued_for_pg", 2023-08-01T19:56:38.658 INFO:teuthology.orchestra.run.smithi008.stdout: "time": "2023-08-01T19:55:09.278962+0000", 2023-08-01T19:56:38.658 INFO:teuthology.orchestra.run.smithi008.stdout: "duration": 6.2169999999999999e-06 2023-08-01T19:56:38.659 INFO:teuthology.orchestra.run.smithi008.stdout: }, 2023-08-01T19:56:38.659 INFO:teuthology.orchestra.run.smithi008.stdout: { 2023-08-01T19:56:38.659 INFO:teuthology.orchestra.run.smithi008.stdout: "event": "reached_pg", 2023-08-01T19:56:38.659 INFO:teuthology.orchestra.run.smithi008.stdout: "time": "2023-08-01T19:55:09.280363+0000", 2023-08-01T19:56:38.659 INFO:teuthology.orchestra.run.smithi008.stdout: "duration": 0.0014014489999999999 2023-08-01T19:56:38.659 INFO:teuthology.orchestra.run.smithi008.stdout: }, 2023-08-01T19:56:38.659 INFO:teuthology.orchestra.run.smithi008.stdout: { 2023-08-01T19:56:38.659 INFO:teuthology.orchestra.run.smithi008.stdout: "event": "started", 2023-08-01T19:56:38.660 INFO:teuthology.orchestra.run.smithi008.stdout: "time": "2023-08-01T19:55:09.280488+0000", 2023-08-01T19:56:38.660 INFO:teuthology.orchestra.run.smithi008.stdout: "duration": 0.00012474099999999999 2023-08-01T19:56:38.660 INFO:teuthology.orchestra.run.smithi008.stdout: }, 2023-08-01T19:56:38.660 INFO:teuthology.orchestra.run.smithi008.stdout: { 2023-08-01T19:56:38.660 INFO:teuthology.orchestra.run.smithi008.stdout: "event": "waiting for subops from 1", 2023-08-01T19:56:38.660 INFO:teuthology.orchestra.run.smithi008.stdout: "time": "2023-08-01T19:55:09.280626+0000", 2023-08-01T19:56:38.660 INFO:teuthology.orchestra.run.smithi008.stdout: "duration": 0.000138193 2023-08-01T19:56:38.661 INFO:teuthology.orchestra.run.smithi008.stdout: }, 2023-08-01T19:56:38.661 INFO:teuthology.orchestra.run.smithi008.stdout: { 2023-08-01T19:56:38.661 INFO:teuthology.orchestra.run.smithi008.stdout: "event": "op_commit", 2023-08-01T19:56:38.661 INFO:teuthology.orchestra.run.smithi008.stdout: "time": "2023-08-01T19:55:09.285958+0000", 2023-08-01T19:56:38.661 INFO:teuthology.orchestra.run.smithi008.stdout: "duration": 0.0053317130000000001 2023-08-01T19:56:38.661 INFO:teuthology.orchestra.run.smithi008.stdout: }, 2023-08-01T19:56:38.661 INFO:teuthology.orchestra.run.smithi008.stdout: { 2023-08-01T19:56:38.661 INFO:teuthology.orchestra.run.smithi008.stdout: "event": "sub_op_commit_rec", 2023-08-01T19:56:38.662 INFO:teuthology.orchestra.run.smithi008.stdout: "time": "2023-08-01T19:55:09.350151+0000", 2023-08-01T19:56:38.662 INFO:teuthology.orchestra.run.smithi008.stdout: "duration": 0.064193202000000005 2023-08-01T19:56:38.662 INFO:teuthology.orchestra.run.smithi008.stdout: }, 2023-08-01T19:56:38.662 INFO:teuthology.orchestra.run.smithi008.stdout: { 2023-08-01T19:56:38.662 INFO:teuthology.orchestra.run.smithi008.stdout: "event": "commit_sent", 2023-08-01T19:56:38.662 INFO:teuthology.orchestra.run.smithi008.stdout: "time": "2023-08-01T19:55:09.350188+0000", 2023-08-01T19:56:38.662 INFO:teuthology.orchestra.run.smithi008.stdout: "duration": 3.7549999999999998e-05 2023-08-01T19:56:38.662 INFO:teuthology.orchestra.run.smithi008.stdout: }, 2023-08-01T19:56:38.663 INFO:teuthology.orchestra.run.smithi008.stdout: { 2023-08-01T19:56:38.663 INFO:teuthology.orchestra.run.smithi008.stdout: "event": "done", 2023-08-01T19:56:38.663 INFO:teuthology.orchestra.run.smithi008.stdout: "time": "2023-08-01T19:55:09.350230+0000", 2023-08-01T19:56:38.663 INFO:teuthology.orchestra.run.smithi008.stdout: "duration": 4.1804999999999997e-05 2023-08-01T19:56:38.663 INFO:teuthology.orchestra.run.smithi008.stdout: } 2023-08-01T19:56:38.663 INFO:teuthology.orchestra.run.smithi008.stdout: ] 2023-08-01T19:56:38.663 INFO:teuthology.orchestra.run.smithi008.stdout: } 2023-08-01T19:56:38.664 INFO:teuthology.orchestra.run.smithi008.stdout: }, 2023-08-01T19:56:38.664 INFO:teuthology.orchestra.run.smithi008.stdout: { 2023-08-01T19:56:38.664 INFO:teuthology.orchestra.run.smithi008.stdout: "description": "osd_op(client.4668.0:107865 5.3 5:c2ebb96d:::benchmark_data_smithi006_114134_object107864:head [set-alloc-hint object_size 65536 write_size 65536,write 0~65536] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e38)", 2023-08-01T19:56:38.664 INFO:teuthology.orchestra.run.smithi008.stdout: "initiated_at": "2023-08-01T19:55:09.279020+0000", 2023-08-01T19:56:38.664 INFO:teuthology.orchestra.run.smithi008.stdout: "age": 89.324986817999999, 2023-08-01T19:56:38.664 INFO:teuthology.orchestra.run.smithi008.stdout: "duration": 0.072892565000000006, 2023-08-01T19:56:38.664 INFO:teuthology.orchestra.run.smithi008.stdout: "type_data": { 2023-08-01T19:56:38.664 INFO:teuthology.orchestra.run.smithi008.stdout: "flag_point": "commit sent; apply or cleanup", 2023-08-01T19:56:38.665 INFO:teuthology.orchestra.run.smithi008.stdout: "client_info": { 2023-08-01T19:56:38.665 INFO:teuthology.orchestra.run.smithi008.stdout: "client": "client.4668", 2023-08-01T19:56:38.665 INFO:teuthology.orchestra.run.smithi008.stdout: "client_addr": "172.21.15.6:0/1709472247", 2023-08-01T19:56:38.665 INFO:teuthology.orchestra.run.smithi008.stdout: "tid": 107865 2023-08-01T19:56:38.665 INFO:teuthology.orchestra.run.smithi008.stdout: }, 2023-08-01T19:56:38.665 INFO:teuthology.orchestra.run.smithi008.stdout: "events": [ 2023-08-01T19:56:38.665 INFO:teuthology.orchestra.run.smithi008.stdout: { 2023-08-01T19:56:38.666 INFO:teuthology.orchestra.run.smithi008.stdout: "event": "initiated", 2023-08-01T19:56:38.666 INFO:teuthology.orchestra.run.smithi008.stdout: "time": "2023-08-01T19:55:09.279020+0000", 2023-08-01T19:56:38.666 INFO:teuthology.orchestra.run.smithi008.stdout: "duration": 0 2023-08-01T19:56:38.666 INFO:teuthology.orchestra.run.smithi008.stdout: }, 2023-08-01T19:56:38.666 INFO:teuthology.orchestra.run.smithi008.stdout: { 2023-08-01T19:56:38.666 INFO:teuthology.orchestra.run.smithi008.stdout: "event": "throttled", 2023-08-01T19:56:38.666 INFO:teuthology.orchestra.run.smithi008.stdout: "time": "2023-08-01T19:55:09.279020+0000", 2023-08-01T19:56:38.666 INFO:teuthology.orchestra.run.smithi008.stdout: "duration": 0 2023-08-01T19:56:38.667 INFO:teuthology.orchestra.run.smithi008.stdout: }, 2023-08-01T19:56:38.667 INFO:teuthology.orchestra.run.smithi008.stdout: { 2023-08-01T19:56:38.667 INFO:teuthology.orchestra.run.smithi008.stdout: "event": "header_read", 2023-08-01T19:56:38.667 INFO:teuthology.orchestra.run.smithi008.stdout: "time": "2023-08-01T19:55:09.279019+0000", 2023-08-01T19:56:38.667 INFO:teuthology.orchestra.run.smithi008.stdout: "duration": 4294967295.999999 2023-08-01T19:56:38.667 INFO:teuthology.orchestra.run.smithi008.stdout: }, 2023-08-01T19:56:38.667 INFO:teuthology.orchestra.run.smithi008.stdout: { 2023-08-01T19:56:38.668 INFO:teuthology.orchestra.run.smithi008.stdout: "event": "all_read", 2023-08-01T19:56:38.668 INFO:teuthology.orchestra.run.smithi008.stdout: "time": "2023-08-01T19:55:09.279087+0000", 2023-08-01T19:56:38.668 INFO:teuthology.orchestra.run.smithi008.stdout: "duration": 6.8392000000000005e-05 2023-08-01T19:56:38.668 INFO:teuthology.orchestra.run.smithi008.stdout: }, 2023-08-01T19:56:38.668 INFO:teuthology.orchestra.run.smithi008.stdout: { 2023-08-01T19:56:38.668 INFO:teuthology.orchestra.run.smithi008.stdout: "event": "dispatched", 2023-08-01T19:56:38.668 INFO:teuthology.orchestra.run.smithi008.stdout: "time": "2023-08-01T19:55:09.279095+0000", 2023-08-01T19:56:38.669 INFO:teuthology.orchestra.run.smithi008.stdout: "duration": 8.0989999999999999e-06 2023-08-01T19:56:38.669 INFO:teuthology.orchestra.run.smithi008.stdout: }, 2023-08-01T19:56:38.669 INFO:teuthology.orchestra.run.smithi008.stdout: { 2023-08-01T19:56:38.669 INFO:teuthology.orchestra.run.smithi008.stdout: "event": "queued_for_pg", 2023-08-01T19:56:38.669 INFO:teuthology.orchestra.run.smithi008.stdout: "time": "2023-08-01T19:55:09.279101+0000", 2023-08-01T19:56:38.669 INFO:teuthology.orchestra.run.smithi008.stdout: "duration": 5.0390000000000004e-06 2023-08-01T19:56:38.669 INFO:teuthology.orchestra.run.smithi008.stdout: }, 2023-08-01T19:56:38.669 INFO:teuthology.orchestra.run.smithi008.stdout: { 2023-08-01T19:56:38.670 INFO:teuthology.orchestra.run.smithi008.stdout: "event": "reached_pg", 2023-08-01T19:56:38.670 INFO:teuthology.orchestra.run.smithi008.stdout: "time": "2023-08-01T19:55:09.282574+0000", 2023-08-01T19:56:38.670 INFO:teuthology.orchestra.run.smithi008.stdout: "duration": 0.0034730619999999999 2023-08-01T19:56:38.670 INFO:teuthology.orchestra.run.smithi008.stdout: }, 2023-08-01T19:56:38.670 INFO:teuthology.orchestra.run.smithi008.stdout: { 2023-08-01T19:56:38.670 INFO:teuthology.orchestra.run.smithi008.stdout: "event": "started", 2023-08-01T19:56:38.670 INFO:teuthology.orchestra.run.smithi008.stdout: "time": "2023-08-01T19:55:09.282705+0000", 2023-08-01T19:56:38.670 INFO:teuthology.orchestra.run.smithi008.stdout: "duration": 0.00013133400000000001 2023-08-01T19:56:38.671 INFO:teuthology.orchestra.run.smithi008.stdout: }, 2023-08-01T19:56:38.671 INFO:teuthology.orchestra.run.smithi008.stdout: { 2023-08-01T19:56:38.671 INFO:teuthology.orchestra.run.smithi008.stdout: "event": "waiting for subops from 1", 2023-08-01T19:56:38.671 INFO:teuthology.orchestra.run.smithi008.stdout: "time": "2023-08-01T19:55:09.283067+0000", 2023-08-01T19:56:38.671 INFO:teuthology.orchestra.run.smithi008.stdout: "duration": 0.00036195299999999998 2023-08-01T19:56:38.671 INFO:teuthology.orchestra.run.smithi008.stdout: }, 2023-08-01T19:56:38.671 INFO:teuthology.orchestra.run.smithi008.stdout: { 2023-08-01T19:56:38.671 INFO:teuthology.orchestra.run.smithi008.stdout: "event": "op_commit", 2023-08-01T19:56:38.672 INFO:teuthology.orchestra.run.smithi008.stdout: "time": "2023-08-01T19:55:09.288196+0000", 2023-08-01T19:56:38.672 INFO:teuthology.orchestra.run.smithi008.stdout: "duration": 0.0051293780000000004 2023-08-01T19:56:38.672 INFO:teuthology.orchestra.run.smithi008.stdout: }, 2023-08-01T19:56:38.672 INFO:teuthology.orchestra.run.smithi008.stdout: { 2023-08-01T19:56:38.672 INFO:teuthology.orchestra.run.smithi008.stdout: "event": "sub_op_commit_rec", 2023-08-01T19:56:38.672 INFO:teuthology.orchestra.run.smithi008.stdout: "time": "2023-08-01T19:55:09.351832+0000", 2023-08-01T19:56:38.672 INFO:teuthology.orchestra.run.smithi008.stdout: "duration": 0.063636076 2023-08-01T19:56:38.672 INFO:teuthology.orchestra.run.smithi008.stdout: }, 2023-08-01T19:56:38.673 INFO:teuthology.orchestra.run.smithi008.stdout: { 2023-08-01T19:56:38.673 INFO:teuthology.orchestra.run.smithi008.stdout: "event": "commit_sent", 2023-08-01T19:56:38.673 INFO:teuthology.orchestra.run.smithi008.stdout: "time": "2023-08-01T19:55:09.351878+0000", 2023-08-01T19:56:38.673 INFO:teuthology.orchestra.run.smithi008.stdout: "duration": 4.5408999999999998e-05 2023-08-01T19:56:38.673 INFO:teuthology.orchestra.run.smithi008.stdout: }, 2023-08-01T19:56:38.673 INFO:teuthology.orchestra.run.smithi008.stdout: { 2023-08-01T19:56:38.673 INFO:teuthology.orchestra.run.smithi008.stdout: "event": "done", 2023-08-01T19:56:38.674 INFO:teuthology.orchestra.run.smithi008.stdout: "time": "2023-08-01T19:55:09.351913+0000", 2023-08-01T19:56:38.674 INFO:teuthology.orchestra.run.smithi008.stdout: "duration": 3.4808999999999998e-05 2023-08-01T19:56:38.674 INFO:teuthology.orchestra.run.smithi008.stdout: } 2023-08-01T19:56:38.674 INFO:teuthology.orchestra.run.smithi008.stdout: ] 2023-08-01T19:56:38.674 INFO:teuthology.orchestra.run.smithi008.stdout: } 2023-08-01T19:56:38.674 INFO:teuthology.orchestra.run.smithi008.stdout: }, 2023-08-01T19:56:38.674 INFO:teuthology.orchestra.run.smithi008.stdout: { 2023-08-01T19:56:38.674 INFO:teuthology.orchestra.run.smithi008.stdout: "description": "osd_op(client.4668.0:107869 5.c 5:31910384:::benchmark_data_smithi006_114134_object107868:head [set-alloc-hint object_size 65536 write_size 65536,write 0~65536] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e38)", 2023-08-01T19:56:38.675 INFO:teuthology.orchestra.run.smithi008.stdout: "initiated_at": "2023-08-01T19:55:09.283205+0000", 2023-08-01T19:56:38.675 INFO:teuthology.orchestra.run.smithi008.stdout: "age": 89.320801653000004, 2023-08-01T19:56:38.675 INFO:teuthology.orchestra.run.smithi008.stdout: "duration": 0.068611808999999996, 2023-08-01T19:56:38.675 INFO:teuthology.orchestra.run.smithi008.stdout: "type_data": { 2023-08-01T19:56:38.675 INFO:teuthology.orchestra.run.smithi008.stdout: "flag_point": "commit sent; apply or cleanup", 2023-08-01T19:56:38.675 INFO:teuthology.orchestra.run.smithi008.stdout: "client_info": { 2023-08-01T19:56:38.675 INFO:teuthology.orchestra.run.smithi008.stdout: "client": "client.4668", 2023-08-01T19:56:38.675 INFO:teuthology.orchestra.run.smithi008.stdout: "client_addr": "172.21.15.6:0/1709472247", 2023-08-01T19:56:38.676 INFO:teuthology.orchestra.run.smithi008.stdout: "tid": 107869 2023-08-01T19:56:38.676 INFO:teuthology.orchestra.run.smithi008.stdout: }, 2023-08-01T19:56:38.676 INFO:teuthology.orchestra.run.smithi008.stdout: "events": [ 2023-08-01T19:56:38.676 INFO:teuthology.orchestra.run.smithi008.stdout: { 2023-08-01T19:56:38.676 INFO:teuthology.orchestra.run.smithi008.stdout: "event": "initiated", 2023-08-01T19:56:38.676 INFO:teuthology.orchestra.run.smithi008.stdout: "time": "2023-08-01T19:55:09.283205+0000", 2023-08-01T19:56:38.676 INFO:teuthology.orchestra.run.smithi008.stdout: "duration": 0 2023-08-01T19:56:38.677 INFO:teuthology.orchestra.run.smithi008.stdout: }, 2023-08-01T19:56:38.677 INFO:teuthology.orchestra.run.smithi008.stdout: { 2023-08-01T19:56:38.677 INFO:teuthology.orchestra.run.smithi008.stdout: "event": "throttled", 2023-08-01T19:56:38.677 INFO:teuthology.orchestra.run.smithi008.stdout: "time": "2023-08-01T19:55:09.283205+0000", 2023-08-01T19:56:38.677 INFO:teuthology.orchestra.run.smithi008.stdout: "duration": 0 2023-08-01T19:56:38.678 INFO:teuthology.orchestra.run.smithi008.stdout: }, 2023-08-01T19:56:38.678 INFO:teuthology.orchestra.run.smithi008.stdout: { 2023-08-01T19:56:38.678 INFO:teuthology.orchestra.run.smithi008.stdout: "event": "header_read", 2023-08-01T19:56:38.678 INFO:teuthology.orchestra.run.smithi008.stdout: "time": "2023-08-01T19:55:09.283204+0000", 2023-08-01T19:56:38.679 INFO:teuthology.orchestra.run.smithi008.stdout: "duration": 4294967295.999999 2023-08-01T19:56:38.679 INFO:teuthology.orchestra.run.smithi008.stdout: }, 2023-08-01T19:56:38.679 INFO:teuthology.orchestra.run.smithi008.stdout: { 2023-08-01T19:56:38.679 INFO:teuthology.orchestra.run.smithi008.stdout: "event": "all_read", 2023-08-01T19:56:38.680 INFO:teuthology.orchestra.run.smithi008.stdout: "time": "2023-08-01T19:55:09.283300+0000", 2023-08-01T19:56:38.680 INFO:teuthology.orchestra.run.smithi008.stdout: "duration": 9.6280000000000007e-05 2023-08-01T19:56:38.680 INFO:teuthology.orchestra.run.smithi008.stdout: }, 2023-08-01T19:56:38.680 INFO:teuthology.orchestra.run.smithi008.stdout: { 2023-08-01T19:56:38.681 INFO:teuthology.orchestra.run.smithi008.stdout: "event": "dispatched", 2023-08-01T19:56:38.681 INFO:teuthology.orchestra.run.smithi008.stdout: "time": "2023-08-01T19:55:09.283314+0000", 2023-08-01T19:56:38.681 INFO:teuthology.orchestra.run.smithi008.stdout: "duration": 1.3344e-05 2023-08-01T19:56:38.681 INFO:teuthology.orchestra.run.smithi008.stdout: }, 2023-08-01T19:56:38.682 INFO:teuthology.orchestra.run.smithi008.stdout: { 2023-08-01T19:56:38.682 INFO:teuthology.orchestra.run.smithi008.stdout: "event": "queued_for_pg", 2023-08-01T19:56:38.682 INFO:teuthology.orchestra.run.smithi008.stdout: "time": "2023-08-01T19:55:09.283320+0000", 2023-08-01T19:56:38.682 INFO:teuthology.orchestra.run.smithi008.stdout: "duration": 6.0299999999999999e-06 2023-08-01T19:56:38.683 INFO:teuthology.orchestra.run.smithi008.stdout: }, 2023-08-01T19:56:38.683 INFO:teuthology.orchestra.run.smithi008.stdout: { 2023-08-01T19:56:38.683 INFO:teuthology.orchestra.run.smithi008.stdout: "event": "reached_pg", 2023-08-01T19:56:38.683 INFO:teuthology.orchestra.run.smithi008.stdout: "time": "2023-08-01T19:55:09.283365+0000", 2023-08-01T19:56:38.684 INFO:teuthology.orchestra.run.smithi008.stdout: "duration": 4.5578999999999998e-05 2023-08-01T19:56:38.684 INFO:teuthology.orchestra.run.smithi008.stdout: }, 2023-08-01T19:56:38.684 INFO:teuthology.orchestra.run.smithi008.stdout: { 2023-08-01T19:56:38.684 INFO:teuthology.orchestra.run.smithi008.stdout: "event": "started", 2023-08-01T19:56:38.685 INFO:teuthology.orchestra.run.smithi008.stdout: "time": "2023-08-01T19:55:09.283490+0000", 2023-08-01T19:56:38.685 INFO:teuthology.orchestra.run.smithi008.stdout: "duration": 0.00012473700000000001 2023-08-01T19:56:38.685 INFO:teuthology.orchestra.run.smithi008.stdout: }, 2023-08-01T19:56:38.685 INFO:teuthology.orchestra.run.smithi008.stdout: { 2023-08-01T19:56:38.686 INFO:teuthology.orchestra.run.smithi008.stdout: "event": "waiting for subops from 1", 2023-08-01T19:56:38.686 INFO:teuthology.orchestra.run.smithi008.stdout: "time": "2023-08-01T19:55:09.283637+0000", 2023-08-01T19:56:38.686 INFO:teuthology.orchestra.run.smithi008.stdout: "duration": 0.00014715600000000001 2023-08-01T19:56:38.686 INFO:teuthology.orchestra.run.smithi008.stdout: }, 2023-08-01T19:56:38.687 INFO:teuthology.orchestra.run.smithi008.stdout: { 2023-08-01T19:56:38.687 INFO:teuthology.orchestra.run.smithi008.stdout: "event": "op_commit", 2023-08-01T19:56:38.687 INFO:teuthology.orchestra.run.smithi008.stdout: "time": "2023-08-01T19:55:09.288214+0000", 2023-08-01T19:56:38.687 INFO:teuthology.orchestra.run.smithi008.stdout: "duration": 0.0045769560000000001 2023-08-01T19:56:38.688 INFO:teuthology.orchestra.run.smithi008.stdout: }, 2023-08-01T19:56:38.688 INFO:teuthology.orchestra.run.smithi008.stdout: { 2023-08-01T19:56:38.688 INFO:teuthology.orchestra.run.smithi008.stdout: "event": "sub_op_commit_rec", 2023-08-01T19:56:38.688 INFO:teuthology.orchestra.run.smithi008.stdout: "time": "2023-08-01T19:55:09.351721+0000", 2023-08-01T19:56:38.689 INFO:teuthology.orchestra.run.smithi008.stdout: "duration": 0.063507383000000001 2023-08-01T19:56:38.689 INFO:teuthology.orchestra.run.smithi008.stdout: }, 2023-08-01T19:56:38.689 INFO:teuthology.orchestra.run.smithi008.stdout: { 2023-08-01T19:56:38.689 INFO:teuthology.orchestra.run.smithi008.stdout: "event": "commit_sent", 2023-08-01T19:56:38.690 INFO:teuthology.orchestra.run.smithi008.stdout: "time": "2023-08-01T19:55:09.351777+0000", 2023-08-01T19:56:38.690 INFO:teuthology.orchestra.run.smithi008.stdout: "duration": 5.5733999999999999e-05 2023-08-01T19:56:38.690 INFO:teuthology.orchestra.run.smithi008.stdout: }, 2023-08-01T19:56:38.690 INFO:teuthology.orchestra.run.smithi008.stdout: { 2023-08-01T19:56:38.690 INFO:teuthology.orchestra.run.smithi008.stdout: "event": "done", 2023-08-01T19:56:38.691 INFO:teuthology.orchestra.run.smithi008.stdout: "time": "2023-08-01T19:55:09.351817+0000", 2023-08-01T19:56:38.691 INFO:teuthology.orchestra.run.smithi008.stdout: "duration": 3.9765000000000003e-05 2023-08-01T19:56:38.691 INFO:teuthology.orchestra.run.smithi008.stdout: } 2023-08-01T19:56:38.691 INFO:teuthology.orchestra.run.smithi008.stdout: ] 2023-08-01T19:56:38.692 INFO:teuthology.orchestra.run.smithi008.stdout: } 2023-08-01T19:56:38.692 INFO:teuthology.orchestra.run.smithi008.stdout: }, 2023-08-01T19:56:38.692 INFO:teuthology.orchestra.run.smithi008.stdout: { 2023-08-01T19:56:38.692 INFO:teuthology.orchestra.run.smithi008.stdout: "description": "osd_op(client.4668.0:107874 5.3 5:ce4c2799:::benchmark_data_smithi006_114134_object107873:head [set-alloc-hint object_size 65536 write_size 65536,write 0~65536] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e38)", 2023-08-01T19:56:38.693 INFO:teuthology.orchestra.run.smithi008.stdout: "initiated_at": "2023-08-01T19:55:09.286239+0000", 2023-08-01T19:56:38.693 INFO:teuthology.orchestra.run.smithi008.stdout: "age": 89.317768147999999, 2023-08-01T19:56:38.693 INFO:teuthology.orchestra.run.smithi008.stdout: "duration": 0.068224389999999996, 2023-08-01T19:56:38.693 INFO:teuthology.orchestra.run.smithi008.stdout: "type_data": { 2023-08-01T19:56:38.693 INFO:teuthology.orchestra.run.smithi008.stdout: "flag_point": "commit sent; apply or cleanup", 2023-08-01T19:56:38.694 INFO:teuthology.orchestra.run.smithi008.stdout: "client_info": { 2023-08-01T19:56:38.694 INFO:teuthology.orchestra.run.smithi008.stdout: "client": "client.4668", 2023-08-01T19:56:38.694 INFO:teuthology.orchestra.run.smithi008.stdout: "client_addr": "172.21.15.6:0/1709472247", 2023-08-01T19:56:38.695 INFO:teuthology.orchestra.run.smithi008.stdout: "tid": 107874 2023-08-01T19:56:38.695 INFO:teuthology.orchestra.run.smithi008.stdout: }, 2023-08-01T19:56:38.695 INFO:teuthology.orchestra.run.smithi008.stdout: "events": [ 2023-08-01T19:56:38.695 INFO:teuthology.orchestra.run.smithi008.stdout: { 2023-08-01T19:56:38.696 INFO:teuthology.orchestra.run.smithi008.stdout: "event": "initiated", 2023-08-01T19:56:38.696 INFO:teuthology.orchestra.run.smithi008.stdout: "time": "2023-08-01T19:55:09.286239+0000", 2023-08-01T19:56:38.696 INFO:teuthology.orchestra.run.smithi008.stdout: "duration": 0 2023-08-01T19:56:38.697 INFO:teuthology.orchestra.run.smithi008.stdout: }, 2023-08-01T19:56:38.697 INFO:teuthology.orchestra.run.smithi008.stdout: { 2023-08-01T19:56:38.697 INFO:teuthology.orchestra.run.smithi008.stdout: "event": "throttled", 2023-08-01T19:56:38.697 INFO:teuthology.orchestra.run.smithi008.stdout: "time": "2023-08-01T19:55:09.286239+0000", 2023-08-01T19:56:38.698 INFO:teuthology.orchestra.run.smithi008.stdout: "duration": 0 2023-08-01T19:56:38.698 INFO:teuthology.orchestra.run.smithi008.stdout: }, 2023-08-01T19:56:38.698 INFO:teuthology.orchestra.run.smithi008.stdout: { 2023-08-01T19:56:38.698 INFO:teuthology.orchestra.run.smithi008.stdout: "event": "header_read", 2023-08-01T19:56:38.698 INFO:teuthology.orchestra.run.smithi008.stdout: "time": "2023-08-01T19:55:09.286238+0000", 2023-08-01T19:56:38.699 INFO:teuthology.orchestra.run.smithi008.stdout: "duration": 4294967295.999999 2023-08-01T19:56:38.699 INFO:teuthology.orchestra.run.smithi008.stdout: }, 2023-08-01T19:56:38.699 INFO:teuthology.orchestra.run.smithi008.stdout: { 2023-08-01T19:56:38.699 INFO:teuthology.orchestra.run.smithi008.stdout: "event": "all_read", 2023-08-01T19:56:38.700 INFO:teuthology.orchestra.run.smithi008.stdout: "time": "2023-08-01T19:55:09.286310+0000", 2023-08-01T19:56:38.700 INFO:teuthology.orchestra.run.smithi008.stdout: "duration": 7.2583999999999995e-05 2023-08-01T19:56:38.700 INFO:teuthology.orchestra.run.smithi008.stdout: }, 2023-08-01T19:56:38.700 INFO:teuthology.orchestra.run.smithi008.stdout: { 2023-08-01T19:56:38.700 INFO:teuthology.orchestra.run.smithi008.stdout: "event": "dispatched", 2023-08-01T19:56:38.700 INFO:teuthology.orchestra.run.smithi008.stdout: "time": "2023-08-01T19:55:09.286323+0000", 2023-08-01T19:56:38.700 INFO:teuthology.orchestra.run.smithi008.stdout: "duration": 1.3151e-05 2023-08-01T19:56:38.701 INFO:teuthology.orchestra.run.smithi008.stdout: }, 2023-08-01T19:56:38.701 INFO:teuthology.orchestra.run.smithi008.stdout: { 2023-08-01T19:56:38.701 INFO:teuthology.orchestra.run.smithi008.stdout: "event": "queued_for_pg", 2023-08-01T19:56:38.701 INFO:teuthology.orchestra.run.smithi008.stdout: "time": "2023-08-01T19:55:09.286329+0000", 2023-08-01T19:56:38.701 INFO:teuthology.orchestra.run.smithi008.stdout: "duration": 5.8719999999999999e-06 2023-08-01T19:56:38.701 INFO:teuthology.orchestra.run.smithi008.stdout: }, 2023-08-01T19:56:38.701 INFO:teuthology.orchestra.run.smithi008.stdout: { 2023-08-01T19:56:38.702 INFO:teuthology.orchestra.run.smithi008.stdout: "event": "reached_pg", 2023-08-01T19:56:38.702 INFO:teuthology.orchestra.run.smithi008.stdout: "time": "2023-08-01T19:55:09.286392+0000", 2023-08-01T19:56:38.702 INFO:teuthology.orchestra.run.smithi008.stdout: "duration": 6.2378000000000005e-05 2023-08-01T19:56:38.702 INFO:teuthology.orchestra.run.smithi008.stdout: }, 2023-08-01T19:56:38.702 INFO:teuthology.orchestra.run.smithi008.stdout: { 2023-08-01T19:56:38.702 INFO:teuthology.orchestra.run.smithi008.stdout: "event": "started", 2023-08-01T19:56:38.702 INFO:teuthology.orchestra.run.smithi008.stdout: "time": "2023-08-01T19:55:09.286473+0000", 2023-08-01T19:56:38.702 INFO:teuthology.orchestra.run.smithi008.stdout: "duration": 8.1327000000000002e-05 2023-08-01T19:56:38.703 INFO:teuthology.orchestra.run.smithi008.stdout: }, 2023-08-01T19:56:38.703 INFO:teuthology.orchestra.run.smithi008.stdout: { 2023-08-01T19:56:38.703 INFO:teuthology.orchestra.run.smithi008.stdout: "event": "waiting for subops from 1", 2023-08-01T19:56:38.703 INFO:teuthology.orchestra.run.smithi008.stdout: "time": "2023-08-01T19:55:09.286557+0000", 2023-08-01T19:56:38.703 INFO:teuthology.orchestra.run.smithi008.stdout: "duration": 8.4140000000000004e-05 2023-08-01T19:56:38.703 INFO:teuthology.orchestra.run.smithi008.stdout: }, 2023-08-01T19:56:38.703 INFO:teuthology.orchestra.run.smithi008.stdout: { 2023-08-01T19:56:38.704 INFO:teuthology.orchestra.run.smithi008.stdout: "event": "op_commit", 2023-08-01T19:56:38.704 INFO:teuthology.orchestra.run.smithi008.stdout: "time": "2023-08-01T19:55:09.290681+0000", 2023-08-01T19:56:38.704 INFO:teuthology.orchestra.run.smithi008.stdout: "duration": 0.0041242420000000002 2023-08-01T19:56:38.704 INFO:teuthology.orchestra.run.smithi008.stdout: }, 2023-08-01T19:56:38.704 INFO:teuthology.orchestra.run.smithi008.stdout: { 2023-08-01T19:56:38.704 INFO:teuthology.orchestra.run.smithi008.stdout: "event": "sub_op_commit_rec", 2023-08-01T19:56:38.704 INFO:teuthology.orchestra.run.smithi008.stdout: "time": "2023-08-01T19:55:09.354372+0000", 2023-08-01T19:56:38.705 INFO:teuthology.orchestra.run.smithi008.stdout: "duration": 0.063690438000000002 2023-08-01T19:56:38.705 INFO:teuthology.orchestra.run.smithi008.stdout: }, 2023-08-01T19:56:38.705 INFO:teuthology.orchestra.run.smithi008.stdout: { 2023-08-01T19:56:38.705 INFO:teuthology.orchestra.run.smithi008.stdout: "event": "commit_sent", 2023-08-01T19:56:38.705 INFO:teuthology.orchestra.run.smithi008.stdout: "time": "2023-08-01T19:55:09.354421+0000", 2023-08-01T19:56:38.705 INFO:teuthology.orchestra.run.smithi008.stdout: "duration": 4.9413000000000003e-05 2023-08-01T19:56:38.705 INFO:teuthology.orchestra.run.smithi008.stdout: }, 2023-08-01T19:56:38.705 INFO:teuthology.orchestra.run.smithi008.stdout: { 2023-08-01T19:56:38.706 INFO:teuthology.orchestra.run.smithi008.stdout: "event": "done", 2023-08-01T19:56:38.706 INFO:teuthology.orchestra.run.smithi008.stdout: "time": "2023-08-01T19:55:09.354463+0000", 2023-08-01T19:56:38.706 INFO:teuthology.orchestra.run.smithi008.stdout: "duration": 4.1924e-05 2023-08-01T19:56:38.706 INFO:teuthology.orchestra.run.smithi008.stdout: } 2023-08-01T19:56:38.706 INFO:teuthology.orchestra.run.smithi008.stdout: ] 2023-08-01T19:56:38.706 INFO:teuthology.orchestra.run.smithi008.stdout: } 2023-08-01T19:56:38.706 INFO:teuthology.orchestra.run.smithi008.stdout: }, 2023-08-01T19:56:38.706 INFO:teuthology.orchestra.run.smithi008.stdout: { 2023-08-01T19:56:38.707 INFO:teuthology.orchestra.run.smithi008.stdout: "description": "osd_op(client.4668.0:197398 5.1 5:809d7164:::benchmark_data_smithi006_114134_object63737:head [delete] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e61)", 2023-08-01T19:56:38.707 INFO:teuthology.orchestra.run.smithi008.stdout: "initiated_at": "2023-08-01T19:55:58.554713+0000", 2023-08-01T19:56:38.707 INFO:teuthology.orchestra.run.smithi008.stdout: "age": 40.049293460000001, 2023-08-01T19:56:38.707 INFO:teuthology.orchestra.run.smithi008.stdout: "duration": 1.0661326660000001, 2023-08-01T19:56:38.707 INFO:teuthology.orchestra.run.smithi008.stdout: "type_data": { 2023-08-01T19:56:38.707 INFO:teuthology.orchestra.run.smithi008.stdout: "flag_point": "reached pg", 2023-08-01T19:56:38.707 INFO:teuthology.orchestra.run.smithi008.stdout: "client_info": { 2023-08-01T19:56:38.708 INFO:teuthology.orchestra.run.smithi008.stdout: "client": "client.4668", 2023-08-01T19:56:38.708 INFO:teuthology.orchestra.run.smithi008.stdout: "client_addr": "172.21.15.6:0/1709472247", 2023-08-01T19:56:38.708 INFO:teuthology.orchestra.run.smithi008.stdout: "tid": 197398 2023-08-01T19:56:38.708 INFO:teuthology.orchestra.run.smithi008.stdout: }, 2023-08-01T19:56:38.708 INFO:teuthology.orchestra.run.smithi008.stdout: "events": [ 2023-08-01T19:56:38.708 INFO:teuthology.orchestra.run.smithi008.stdout: { 2023-08-01T19:56:38.708 INFO:teuthology.orchestra.run.smithi008.stdout: "event": "initiated", 2023-08-01T19:56:38.709 INFO:teuthology.orchestra.run.smithi008.stdout: "time": "2023-08-01T19:55:58.554713+0000", 2023-08-01T19:56:38.709 INFO:teuthology.orchestra.run.smithi008.stdout: "duration": 0 2023-08-01T19:56:38.709 INFO:teuthology.orchestra.run.smithi008.stdout: }, 2023-08-01T19:56:38.709 INFO:teuthology.orchestra.run.smithi008.stdout: { 2023-08-01T19:56:38.709 INFO:teuthology.orchestra.run.smithi008.stdout: "event": "throttled", 2023-08-01T19:56:38.709 INFO:teuthology.orchestra.run.smithi008.stdout: "time": "2023-08-01T19:55:58.554713+0000", 2023-08-01T19:56:38.709 INFO:teuthology.orchestra.run.smithi008.stdout: "duration": 0 2023-08-01T19:56:38.709 INFO:teuthology.orchestra.run.smithi008.stdout: }, 2023-08-01T19:56:38.710 INFO:teuthology.orchestra.run.smithi008.stdout: { 2023-08-01T19:56:38.710 INFO:teuthology.orchestra.run.smithi008.stdout: "event": "header_read", 2023-08-01T19:56:38.710 INFO:teuthology.orchestra.run.smithi008.stdout: "time": "2023-08-01T19:55:58.554713+0000", 2023-08-01T19:56:38.710 INFO:teuthology.orchestra.run.smithi008.stdout: "duration": 4294967295.999999 2023-08-01T19:56:38.710 INFO:teuthology.orchestra.run.smithi008.stdout: }, 2023-08-01T19:56:38.711 INFO:teuthology.orchestra.run.smithi008.stdout: { 2023-08-01T19:56:38.711 INFO:teuthology.orchestra.run.smithi008.stdout: "event": "all_read", 2023-08-01T19:56:38.711 INFO:teuthology.orchestra.run.smithi008.stdout: "time": "2023-08-01T19:55:58.554717+0000", 2023-08-01T19:56:38.711 INFO:teuthology.orchestra.run.smithi008.stdout: "duration": 4.7389999999999999e-06 2023-08-01T19:56:38.711 INFO:teuthology.orchestra.run.smithi008.stdout: }, 2023-08-01T19:56:38.711 INFO:teuthology.orchestra.run.smithi008.stdout: { 2023-08-01T19:56:38.711 INFO:teuthology.orchestra.run.smithi008.stdout: "event": "dispatched", 2023-08-01T19:56:38.712 INFO:teuthology.orchestra.run.smithi008.stdout: "time": "2023-08-01T19:55:58.554725+0000", 2023-08-01T19:56:38.712 INFO:teuthology.orchestra.run.smithi008.stdout: "duration": 7.9820000000000008e-06 2023-08-01T19:56:38.712 INFO:teuthology.orchestra.run.smithi008.stdout: }, 2023-08-01T19:56:38.712 INFO:teuthology.orchestra.run.smithi008.stdout: { 2023-08-01T19:56:38.712 INFO:teuthology.orchestra.run.smithi008.stdout: "event": "queued_for_pg", 2023-08-01T19:56:38.712 INFO:teuthology.orchestra.run.smithi008.stdout: "time": "2023-08-01T19:55:58.554730+0000", 2023-08-01T19:56:38.712 INFO:teuthology.orchestra.run.smithi008.stdout: "duration": 4.318e-06 2023-08-01T19:56:38.713 INFO:teuthology.orchestra.run.smithi008.stdout: }, 2023-08-01T19:56:38.713 INFO:teuthology.orchestra.run.smithi008.stdout: { 2023-08-01T19:56:38.713 INFO:teuthology.orchestra.run.smithi008.stdout: "event": "reached_pg", 2023-08-01T19:56:38.713 INFO:teuthology.orchestra.run.smithi008.stdout: "time": "2023-08-01T19:55:58.554767+0000", 2023-08-01T19:56:38.713 INFO:teuthology.orchestra.run.smithi008.stdout: "duration": 3.7778000000000003e-05 2023-08-01T19:56:38.714 INFO:teuthology.orchestra.run.smithi008.stdout: }, 2023-08-01T19:56:38.714 INFO:teuthology.orchestra.run.smithi008.stdout: { 2023-08-01T19:56:38.714 INFO:teuthology.orchestra.run.smithi008.stdout: "event": "started", 2023-08-01T19:56:38.714 INFO:teuthology.orchestra.run.smithi008.stdout: "time": "2023-08-01T19:55:58.554874+0000", 2023-08-01T19:56:38.715 INFO:teuthology.orchestra.run.smithi008.stdout: "duration": 0.000106613 2023-08-01T19:56:38.715 INFO:teuthology.orchestra.run.smithi008.stdout: }, 2023-08-01T19:56:38.715 INFO:teuthology.orchestra.run.smithi008.stdout: { 2023-08-01T19:56:38.716 INFO:teuthology.orchestra.run.smithi008.stdout: "event": "waiting for subops from 1", 2023-08-01T19:56:38.716 INFO:teuthology.orchestra.run.smithi008.stdout: "time": "2023-08-01T19:55:58.554941+0000", 2023-08-01T19:56:38.716 INFO:teuthology.orchestra.run.smithi008.stdout: "duration": 6.6569000000000006e-05 2023-08-01T19:56:38.716 INFO:teuthology.orchestra.run.smithi008.stdout: }, 2023-08-01T19:56:38.716 INFO:teuthology.orchestra.run.smithi008.stdout: { 2023-08-01T19:56:38.717 INFO:teuthology.orchestra.run.smithi008.stdout: "event": "reached_pg", 2023-08-01T19:56:38.717 INFO:teuthology.orchestra.run.smithi008.stdout: "time": "2023-08-01T19:55:58.569436+0000", 2023-08-01T19:56:38.717 INFO:teuthology.orchestra.run.smithi008.stdout: "duration": 0.014495413 2023-08-01T19:56:38.717 INFO:teuthology.orchestra.run.smithi008.stdout: }, 2023-08-01T19:56:38.717 INFO:teuthology.orchestra.run.smithi008.stdout: { 2023-08-01T19:56:38.717 INFO:teuthology.orchestra.run.smithi008.stdout: "event": "waiting for peered", 2023-08-01T19:56:38.718 INFO:teuthology.orchestra.run.smithi008.stdout: "time": "2023-08-01T19:55:58.569441+0000", 2023-08-01T19:56:38.718 INFO:teuthology.orchestra.run.smithi008.stdout: "duration": 5.1109999999999999e-06 2023-08-01T19:56:38.718 INFO:teuthology.orchestra.run.smithi008.stdout: }, 2023-08-01T19:56:38.718 INFO:teuthology.orchestra.run.smithi008.stdout: { 2023-08-01T19:56:38.718 INFO:teuthology.orchestra.run.smithi008.stdout: "event": "reached_pg", 2023-08-01T19:56:38.718 INFO:teuthology.orchestra.run.smithi008.stdout: "time": "2023-08-01T19:55:59.620748+0000", 2023-08-01T19:56:38.718 INFO:teuthology.orchestra.run.smithi008.stdout: "duration": 1.0513071810000001 2023-08-01T19:56:38.719 INFO:teuthology.orchestra.run.smithi008.stdout: }, 2023-08-01T19:56:38.719 INFO:teuthology.orchestra.run.smithi008.stdout: { 2023-08-01T19:56:38.719 INFO:teuthology.orchestra.run.smithi008.stdout: "event": "done", 2023-08-01T19:56:38.719 INFO:teuthology.orchestra.run.smithi008.stdout: "time": "2023-08-01T19:55:59.620846+0000", 2023-08-01T19:56:38.719 INFO:teuthology.orchestra.run.smithi008.stdout: "duration": 9.7739999999999996e-05 2023-08-01T19:56:38.719 INFO:teuthology.orchestra.run.smithi008.stdout: } 2023-08-01T19:56:38.719 INFO:teuthology.orchestra.run.smithi008.stdout: ] 2023-08-01T19:56:38.719 INFO:teuthology.orchestra.run.smithi008.stdout: } 2023-08-01T19:56:38.720 INFO:teuthology.orchestra.run.smithi008.stdout: }, 2023-08-01T19:56:38.720 INFO:teuthology.orchestra.run.smithi008.stdout: { 2023-08-01T19:56:38.720 INFO:teuthology.orchestra.run.smithi008.stdout: "description": "osd_op(client.4668.0:197400 5.c 5:30dad7f9:::benchmark_data_smithi006_114134_object63739:head [delete] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e61)", 2023-08-01T19:56:38.720 INFO:teuthology.orchestra.run.smithi008.stdout: "initiated_at": "2023-08-01T19:55:58.556576+0000", 2023-08-01T19:56:38.720 INFO:teuthology.orchestra.run.smithi008.stdout: "age": 40.047430611000003, 2023-08-01T19:56:38.720 INFO:teuthology.orchestra.run.smithi008.stdout: "duration": 1.062559968, 2023-08-01T19:56:38.720 INFO:teuthology.orchestra.run.smithi008.stdout: "type_data": { 2023-08-01T19:56:38.721 INFO:teuthology.orchestra.run.smithi008.stdout: "flag_point": "reached pg", 2023-08-01T19:56:38.721 INFO:teuthology.orchestra.run.smithi008.stdout: "client_info": { 2023-08-01T19:56:38.721 INFO:teuthology.orchestra.run.smithi008.stdout: "client": "client.4668", 2023-08-01T19:56:38.721 INFO:teuthology.orchestra.run.smithi008.stdout: "client_addr": "172.21.15.6:0/1709472247", 2023-08-01T19:56:38.721 INFO:teuthology.orchestra.run.smithi008.stdout: "tid": 197400 2023-08-01T19:56:38.721 INFO:teuthology.orchestra.run.smithi008.stdout: }, 2023-08-01T19:56:38.721 INFO:teuthology.orchestra.run.smithi008.stdout: "events": [ 2023-08-01T19:56:38.721 INFO:teuthology.orchestra.run.smithi008.stdout: { 2023-08-01T19:56:38.722 INFO:teuthology.orchestra.run.smithi008.stdout: "event": "initiated", 2023-08-01T19:56:38.722 INFO:teuthology.orchestra.run.smithi008.stdout: "time": "2023-08-01T19:55:58.556576+0000", 2023-08-01T19:56:38.722 INFO:teuthology.orchestra.run.smithi008.stdout: "duration": 0 2023-08-01T19:56:38.722 INFO:teuthology.orchestra.run.smithi008.stdout: }, 2023-08-01T19:56:38.722 INFO:teuthology.orchestra.run.smithi008.stdout: { 2023-08-01T19:56:38.722 INFO:teuthology.orchestra.run.smithi008.stdout: "event": "throttled", 2023-08-01T19:56:38.722 INFO:teuthology.orchestra.run.smithi008.stdout: "time": "2023-08-01T19:55:58.556576+0000", 2023-08-01T19:56:38.723 INFO:teuthology.orchestra.run.smithi008.stdout: "duration": 0 2023-08-01T19:56:38.723 INFO:teuthology.orchestra.run.smithi008.stdout: }, 2023-08-01T19:56:38.723 INFO:teuthology.orchestra.run.smithi008.stdout: { 2023-08-01T19:56:38.723 INFO:teuthology.orchestra.run.smithi008.stdout: "event": "header_read", 2023-08-01T19:56:38.723 INFO:teuthology.orchestra.run.smithi008.stdout: "time": "2023-08-01T19:55:58.556575+0000", 2023-08-01T19:56:38.723 INFO:teuthology.orchestra.run.smithi008.stdout: "duration": 4294967295.999999 2023-08-01T19:56:38.723 INFO:teuthology.orchestra.run.smithi008.stdout: }, 2023-08-01T19:56:38.723 INFO:teuthology.orchestra.run.smithi008.stdout: { 2023-08-01T19:56:38.724 INFO:teuthology.orchestra.run.smithi008.stdout: "event": "all_read", 2023-08-01T19:56:38.724 INFO:teuthology.orchestra.run.smithi008.stdout: "time": "2023-08-01T19:55:58.556580+0000", 2023-08-01T19:56:38.724 INFO:teuthology.orchestra.run.smithi008.stdout: "duration": 4.2860000000000001e-06 2023-08-01T19:56:38.724 INFO:teuthology.orchestra.run.smithi008.stdout: }, 2023-08-01T19:56:38.724 INFO:teuthology.orchestra.run.smithi008.stdout: { 2023-08-01T19:56:38.724 INFO:teuthology.orchestra.run.smithi008.stdout: "event": "dispatched", 2023-08-01T19:56:38.724 INFO:teuthology.orchestra.run.smithi008.stdout: "time": "2023-08-01T19:55:58.556589+0000", 2023-08-01T19:56:38.725 INFO:teuthology.orchestra.run.smithi008.stdout: "duration": 9.6500000000000008e-06 2023-08-01T19:56:38.725 INFO:teuthology.orchestra.run.smithi008.stdout: }, 2023-08-01T19:56:38.725 INFO:teuthology.orchestra.run.smithi008.stdout: { 2023-08-01T19:56:38.725 INFO:teuthology.orchestra.run.smithi008.stdout: "event": "queued_for_pg", 2023-08-01T19:56:38.725 INFO:teuthology.orchestra.run.smithi008.stdout: "time": "2023-08-01T19:55:58.556596+0000", 2023-08-01T19:56:38.725 INFO:teuthology.orchestra.run.smithi008.stdout: "duration": 6.1430000000000003e-06 2023-08-01T19:56:38.725 INFO:teuthology.orchestra.run.smithi008.stdout: }, 2023-08-01T19:56:38.725 INFO:teuthology.orchestra.run.smithi008.stdout: { 2023-08-01T19:56:38.726 INFO:teuthology.orchestra.run.smithi008.stdout: "event": "reached_pg", 2023-08-01T19:56:38.726 INFO:teuthology.orchestra.run.smithi008.stdout: "time": "2023-08-01T19:55:58.556634+0000", 2023-08-01T19:56:38.726 INFO:teuthology.orchestra.run.smithi008.stdout: "duration": 3.8080000000000001e-05 2023-08-01T19:56:38.726 INFO:teuthology.orchestra.run.smithi008.stdout: }, 2023-08-01T19:56:38.726 INFO:teuthology.orchestra.run.smithi008.stdout: { 2023-08-01T19:56:38.726 INFO:teuthology.orchestra.run.smithi008.stdout: "event": "started", 2023-08-01T19:56:38.726 INFO:teuthology.orchestra.run.smithi008.stdout: "time": "2023-08-01T19:55:58.556754+0000", 2023-08-01T19:56:38.726 INFO:teuthology.orchestra.run.smithi008.stdout: "duration": 0.000120444 2023-08-01T19:56:38.727 INFO:teuthology.orchestra.run.smithi008.stdout: }, 2023-08-01T19:56:38.727 INFO:teuthology.orchestra.run.smithi008.stdout: { 2023-08-01T19:56:38.727 INFO:teuthology.orchestra.run.smithi008.stdout: "event": "waiting for subops from 1", 2023-08-01T19:56:38.727 INFO:teuthology.orchestra.run.smithi008.stdout: "time": "2023-08-01T19:55:58.556875+0000", 2023-08-01T19:56:38.727 INFO:teuthology.orchestra.run.smithi008.stdout: "duration": 0.00012100900000000001 2023-08-01T19:56:38.727 INFO:teuthology.orchestra.run.smithi008.stdout: }, 2023-08-01T19:56:38.727 INFO:teuthology.orchestra.run.smithi008.stdout: { 2023-08-01T19:56:38.727 INFO:teuthology.orchestra.run.smithi008.stdout: "event": "reached_pg", 2023-08-01T19:56:38.728 INFO:teuthology.orchestra.run.smithi008.stdout: "time": "2023-08-01T19:55:58.567406+0000", 2023-08-01T19:56:38.728 INFO:teuthology.orchestra.run.smithi008.stdout: "duration": 0.010531351 2023-08-01T19:56:38.728 INFO:teuthology.orchestra.run.smithi008.stdout: }, 2023-08-01T19:56:38.728 INFO:teuthology.orchestra.run.smithi008.stdout: { 2023-08-01T19:56:38.728 INFO:teuthology.orchestra.run.smithi008.stdout: "event": "waiting for peered", 2023-08-01T19:56:38.728 INFO:teuthology.orchestra.run.smithi008.stdout: "time": "2023-08-01T19:55:58.567414+0000", 2023-08-01T19:56:38.728 INFO:teuthology.orchestra.run.smithi008.stdout: "duration": 7.9189999999999999e-06 2023-08-01T19:56:38.729 INFO:teuthology.orchestra.run.smithi008.stdout: }, 2023-08-01T19:56:38.729 INFO:teuthology.orchestra.run.smithi008.stdout: { 2023-08-01T19:56:38.729 INFO:teuthology.orchestra.run.smithi008.stdout: "event": "reached_pg", 2023-08-01T19:56:38.729 INFO:teuthology.orchestra.run.smithi008.stdout: "time": "2023-08-01T19:55:59.619054+0000", 2023-08-01T19:56:38.729 INFO:teuthology.orchestra.run.smithi008.stdout: "duration": 1.0516396269999999 2023-08-01T19:56:38.729 INFO:teuthology.orchestra.run.smithi008.stdout: }, 2023-08-01T19:56:38.729 INFO:teuthology.orchestra.run.smithi008.stdout: { 2023-08-01T19:56:38.729 INFO:teuthology.orchestra.run.smithi008.stdout: "event": "done", 2023-08-01T19:56:38.730 INFO:teuthology.orchestra.run.smithi008.stdout: "time": "2023-08-01T19:55:59.619136+0000", 2023-08-01T19:56:38.730 INFO:teuthology.orchestra.run.smithi008.stdout: "duration": 8.2208999999999998e-05 2023-08-01T19:56:38.730 INFO:teuthology.orchestra.run.smithi008.stdout: } 2023-08-01T19:56:38.730 INFO:teuthology.orchestra.run.smithi008.stdout: ] 2023-08-01T19:56:38.730 INFO:teuthology.orchestra.run.smithi008.stdout: } 2023-08-01T19:56:38.730 INFO:teuthology.orchestra.run.smithi008.stdout: }, 2023-08-01T19:56:38.730 INFO:teuthology.orchestra.run.smithi008.stdout: { 2023-08-01T19:56:38.731 INFO:teuthology.orchestra.run.smithi008.stdout: "description": "osd_op(client.4668.0:197401 5.1 5:88b38567:::benchmark_data_smithi006_114134_object63740:head [delete] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e61)", 2023-08-01T19:56:38.731 INFO:teuthology.orchestra.run.smithi008.stdout: "initiated_at": "2023-08-01T19:55:58.556607+0000", 2023-08-01T19:56:38.731 INFO:teuthology.orchestra.run.smithi008.stdout: "age": 40.047400187000001, 2023-08-01T19:56:38.731 INFO:teuthology.orchestra.run.smithi008.stdout: "duration": 1.0643254870000001, 2023-08-01T19:56:38.731 INFO:teuthology.orchestra.run.smithi008.stdout: "type_data": { 2023-08-01T19:56:38.731 INFO:teuthology.orchestra.run.smithi008.stdout: "flag_point": "reached pg", 2023-08-01T19:56:38.731 INFO:teuthology.orchestra.run.smithi008.stdout: "client_info": { 2023-08-01T19:56:38.732 INFO:teuthology.orchestra.run.smithi008.stdout: "client": "client.4668", 2023-08-01T19:56:38.732 INFO:teuthology.orchestra.run.smithi008.stdout: "client_addr": "172.21.15.6:0/1709472247", 2023-08-01T19:56:38.732 INFO:teuthology.orchestra.run.smithi008.stdout: "tid": 197401 2023-08-01T19:56:38.732 INFO:teuthology.orchestra.run.smithi008.stdout: }, 2023-08-01T19:56:38.732 INFO:teuthology.orchestra.run.smithi008.stdout: "events": [ 2023-08-01T19:56:38.732 INFO:teuthology.orchestra.run.smithi008.stdout: { 2023-08-01T19:56:38.733 INFO:teuthology.orchestra.run.smithi008.stdout: "event": "initiated", 2023-08-01T19:56:38.733 INFO:teuthology.orchestra.run.smithi008.stdout: "time": "2023-08-01T19:55:58.556607+0000", 2023-08-01T19:56:38.733 INFO:teuthology.orchestra.run.smithi008.stdout: "duration": 0 2023-08-01T19:56:38.733 INFO:teuthology.orchestra.run.smithi008.stdout: }, 2023-08-01T19:56:38.734 INFO:teuthology.orchestra.run.smithi008.stdout: { 2023-08-01T19:56:38.734 INFO:teuthology.orchestra.run.smithi008.stdout: "event": "throttled", 2023-08-01T19:56:38.734 INFO:teuthology.orchestra.run.smithi008.stdout: "time": "2023-08-01T19:55:58.556607+0000", 2023-08-01T19:56:38.734 INFO:teuthology.orchestra.run.smithi008.stdout: "duration": 0 2023-08-01T19:56:38.734 INFO:teuthology.orchestra.run.smithi008.stdout: }, 2023-08-01T19:56:38.735 INFO:teuthology.orchestra.run.smithi008.stdout: { 2023-08-01T19:56:38.735 INFO:teuthology.orchestra.run.smithi008.stdout: "event": "header_read", 2023-08-01T19:56:38.735 INFO:teuthology.orchestra.run.smithi008.stdout: "time": "2023-08-01T19:55:58.556606+0000", 2023-08-01T19:56:38.735 INFO:teuthology.orchestra.run.smithi008.stdout: "duration": 4294967295.9999995 2023-08-01T19:56:38.735 INFO:teuthology.orchestra.run.smithi008.stdout: }, 2023-08-01T19:56:38.735 INFO:teuthology.orchestra.run.smithi008.stdout: { 2023-08-01T19:56:38.735 INFO:teuthology.orchestra.run.smithi008.stdout: "event": "all_read", 2023-08-01T19:56:38.736 INFO:teuthology.orchestra.run.smithi008.stdout: "time": "2023-08-01T19:55:58.556609+0000", 2023-08-01T19:56:38.736 INFO:teuthology.orchestra.run.smithi008.stdout: "duration": 3.1750000000000001e-06 2023-08-01T19:56:38.736 INFO:teuthology.orchestra.run.smithi008.stdout: }, 2023-08-01T19:56:38.736 INFO:teuthology.orchestra.run.smithi008.stdout: { 2023-08-01T19:56:38.736 INFO:teuthology.orchestra.run.smithi008.stdout: "event": "dispatched", 2023-08-01T19:56:38.736 INFO:teuthology.orchestra.run.smithi008.stdout: "time": "2023-08-01T19:55:58.556617+0000", 2023-08-01T19:56:38.736 INFO:teuthology.orchestra.run.smithi008.stdout: "duration": 7.2760000000000003e-06 2023-08-01T19:56:38.737 INFO:teuthology.orchestra.run.smithi008.stdout: }, 2023-08-01T19:56:38.737 INFO:teuthology.orchestra.run.smithi008.stdout: { 2023-08-01T19:56:38.737 INFO:teuthology.orchestra.run.smithi008.stdout: "event": "queued_for_pg", 2023-08-01T19:56:38.737 INFO:teuthology.orchestra.run.smithi008.stdout: "time": "2023-08-01T19:55:58.556621+0000", 2023-08-01T19:56:38.737 INFO:teuthology.orchestra.run.smithi008.stdout: "duration": 4.8219999999999997e-06 2023-08-01T19:56:38.738 INFO:teuthology.orchestra.run.smithi008.stdout: }, 2023-08-01T19:56:38.738 INFO:teuthology.orchestra.run.smithi008.stdout: { 2023-08-01T19:56:38.738 INFO:teuthology.orchestra.run.smithi008.stdout: "event": "reached_pg", 2023-08-01T19:56:38.738 INFO:teuthology.orchestra.run.smithi008.stdout: "time": "2023-08-01T19:55:58.556651+0000", 2023-08-01T19:56:38.739 INFO:teuthology.orchestra.run.smithi008.stdout: "duration": 2.9921999999999999e-05 2023-08-01T19:56:38.739 INFO:teuthology.orchestra.run.smithi008.stdout: }, 2023-08-01T19:56:38.739 INFO:teuthology.orchestra.run.smithi008.stdout: { 2023-08-01T19:56:38.739 INFO:teuthology.orchestra.run.smithi008.stdout: "event": "started", 2023-08-01T19:56:38.739 INFO:teuthology.orchestra.run.smithi008.stdout: "time": "2023-08-01T19:55:58.556755+0000", 2023-08-01T19:56:38.740 INFO:teuthology.orchestra.run.smithi008.stdout: "duration": 0.000103309 2023-08-01T19:56:38.740 INFO:teuthology.orchestra.run.smithi008.stdout: }, 2023-08-01T19:56:38.740 INFO:teuthology.orchestra.run.smithi008.stdout: { 2023-08-01T19:56:38.740 INFO:teuthology.orchestra.run.smithi008.stdout: "event": "waiting for subops from 1", 2023-08-01T19:56:38.740 INFO:teuthology.orchestra.run.smithi008.stdout: "time": "2023-08-01T19:55:58.556875+0000", 2023-08-01T19:56:38.740 INFO:teuthology.orchestra.run.smithi008.stdout: "duration": 0.000120424 2023-08-01T19:56:38.740 INFO:teuthology.orchestra.run.smithi008.stdout: }, 2023-08-01T19:56:38.741 INFO:teuthology.orchestra.run.smithi008.stdout: { 2023-08-01T19:56:38.741 INFO:teuthology.orchestra.run.smithi008.stdout: "event": "reached_pg", 2023-08-01T19:56:38.741 INFO:teuthology.orchestra.run.smithi008.stdout: "time": "2023-08-01T19:55:58.569459+0000", 2023-08-01T19:56:38.741 INFO:teuthology.orchestra.run.smithi008.stdout: "duration": 0.012583776 2023-08-01T19:56:38.741 INFO:teuthology.orchestra.run.smithi008.stdout: }, 2023-08-01T19:56:38.741 INFO:teuthology.orchestra.run.smithi008.stdout: { 2023-08-01T19:56:38.741 INFO:teuthology.orchestra.run.smithi008.stdout: "event": "waiting for peered", 2023-08-01T19:56:38.742 INFO:teuthology.orchestra.run.smithi008.stdout: "time": "2023-08-01T19:55:58.569462+0000", 2023-08-01T19:56:38.742 INFO:teuthology.orchestra.run.smithi008.stdout: "duration": 2.74e-06 2023-08-01T19:56:38.742 INFO:teuthology.orchestra.run.smithi008.stdout: }, 2023-08-01T19:56:38.742 INFO:teuthology.orchestra.run.smithi008.stdout: { 2023-08-01T19:56:38.742 INFO:teuthology.orchestra.run.smithi008.stdout: "event": "reached_pg", 2023-08-01T19:56:38.742 INFO:teuthology.orchestra.run.smithi008.stdout: "time": "2023-08-01T19:55:59.620880+0000", 2023-08-01T19:56:38.742 INFO:teuthology.orchestra.run.smithi008.stdout: "duration": 1.0514181279999999 2023-08-01T19:56:38.742 INFO:teuthology.orchestra.run.smithi008.stdout: }, 2023-08-01T19:56:38.743 INFO:teuthology.orchestra.run.smithi008.stdout: { 2023-08-01T19:56:38.743 INFO:teuthology.orchestra.run.smithi008.stdout: "event": "done", 2023-08-01T19:56:38.743 INFO:teuthology.orchestra.run.smithi008.stdout: "time": "2023-08-01T19:55:59.620932+0000", 2023-08-01T19:56:38.743 INFO:teuthology.orchestra.run.smithi008.stdout: "duration": 5.2404000000000002e-05 2023-08-01T19:56:38.743 INFO:teuthology.orchestra.run.smithi008.stdout: } 2023-08-01T19:56:38.743 INFO:teuthology.orchestra.run.smithi008.stdout: ] 2023-08-01T19:56:38.743 INFO:teuthology.orchestra.run.smithi008.stdout: } 2023-08-01T19:56:38.743 INFO:teuthology.orchestra.run.smithi008.stdout: }, 2023-08-01T19:56:38.744 INFO:teuthology.orchestra.run.smithi008.stdout: { 2023-08-01T19:56:38.744 INFO:teuthology.orchestra.run.smithi008.stdout: "description": "osd_op(client.4668.0:197402 5.c 5:3f057b78:::benchmark_data_smithi006_114134_object63741:head [delete] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e61)", 2023-08-01T19:56:38.744 INFO:teuthology.orchestra.run.smithi008.stdout: "initiated_at": "2023-08-01T19:55:58.556632+0000", 2023-08-01T19:56:38.744 INFO:teuthology.orchestra.run.smithi008.stdout: "age": 40.047374816999998, 2023-08-01T19:56:38.744 INFO:teuthology.orchestra.run.smithi008.stdout: "duration": 1.0625773970000001, 2023-08-01T19:56:38.744 INFO:teuthology.orchestra.run.smithi008.stdout: "type_data": { 2023-08-01T19:56:38.744 INFO:teuthology.orchestra.run.smithi008.stdout: "flag_point": "reached pg", 2023-08-01T19:56:38.745 INFO:teuthology.orchestra.run.smithi008.stdout: "client_info": { 2023-08-01T19:56:38.745 INFO:teuthology.orchestra.run.smithi008.stdout: "client": "client.4668", 2023-08-01T19:56:38.745 INFO:teuthology.orchestra.run.smithi008.stdout: "client_addr": "172.21.15.6:0/1709472247", 2023-08-01T19:56:38.745 INFO:teuthology.orchestra.run.smithi008.stdout: "tid": 197402 2023-08-01T19:56:38.745 INFO:teuthology.orchestra.run.smithi008.stdout: }, 2023-08-01T19:56:38.745 INFO:teuthology.orchestra.run.smithi008.stdout: "events": [ 2023-08-01T19:56:38.745 INFO:teuthology.orchestra.run.smithi008.stdout: { 2023-08-01T19:56:38.745 INFO:teuthology.orchestra.run.smithi008.stdout: "event": "initiated", 2023-08-01T19:56:38.746 INFO:teuthology.orchestra.run.smithi008.stdout: "time": "2023-08-01T19:55:58.556632+0000", 2023-08-01T19:56:38.746 INFO:teuthology.orchestra.run.smithi008.stdout: "duration": 0 2023-08-01T19:56:38.746 INFO:teuthology.orchestra.run.smithi008.stdout: }, 2023-08-01T19:56:38.746 INFO:teuthology.orchestra.run.smithi008.stdout: { 2023-08-01T19:56:38.746 INFO:teuthology.orchestra.run.smithi008.stdout: "event": "throttled", 2023-08-01T19:56:38.746 INFO:teuthology.orchestra.run.smithi008.stdout: "time": "2023-08-01T19:55:58.556632+0000", 2023-08-01T19:56:38.746 INFO:teuthology.orchestra.run.smithi008.stdout: "duration": 0 2023-08-01T19:56:38.746 INFO:teuthology.orchestra.run.smithi008.stdout: }, 2023-08-01T19:56:38.747 INFO:teuthology.orchestra.run.smithi008.stdout: { 2023-08-01T19:56:38.747 INFO:teuthology.orchestra.run.smithi008.stdout: "event": "header_read", 2023-08-01T19:56:38.747 INFO:teuthology.orchestra.run.smithi008.stdout: "time": "2023-08-01T19:55:58.556632+0000", 2023-08-01T19:56:38.747 INFO:teuthology.orchestra.run.smithi008.stdout: "duration": 4294967295.9999995 2023-08-01T19:56:38.747 INFO:teuthology.orchestra.run.smithi008.stdout: }, 2023-08-01T19:56:38.747 INFO:teuthology.orchestra.run.smithi008.stdout: { 2023-08-01T19:56:38.747 INFO:teuthology.orchestra.run.smithi008.stdout: "event": "all_read", 2023-08-01T19:56:38.747 INFO:teuthology.orchestra.run.smithi008.stdout: "time": "2023-08-01T19:55:58.556634+0000", 2023-08-01T19:56:38.748 INFO:teuthology.orchestra.run.smithi008.stdout: "duration": 2.8940000000000002e-06 2023-08-01T19:56:38.748 INFO:teuthology.orchestra.run.smithi008.stdout: }, 2023-08-01T19:56:38.748 INFO:teuthology.orchestra.run.smithi008.stdout: { 2023-08-01T19:56:38.748 INFO:teuthology.orchestra.run.smithi008.stdout: "event": "dispatched", 2023-08-01T19:56:38.748 INFO:teuthology.orchestra.run.smithi008.stdout: "time": "2023-08-01T19:55:58.556641+0000", 2023-08-01T19:56:38.748 INFO:teuthology.orchestra.run.smithi008.stdout: "duration": 6.8449999999999997e-06 2023-08-01T19:56:38.748 INFO:teuthology.orchestra.run.smithi008.stdout: }, 2023-08-01T19:56:38.749 INFO:teuthology.orchestra.run.smithi008.stdout: { 2023-08-01T19:56:38.749 INFO:teuthology.orchestra.run.smithi008.stdout: "event": "queued_for_pg", 2023-08-01T19:56:38.749 INFO:teuthology.orchestra.run.smithi008.stdout: "time": "2023-08-01T19:55:58.556646+0000", 2023-08-01T19:56:38.749 INFO:teuthology.orchestra.run.smithi008.stdout: "duration": 5.2070000000000003e-06 2023-08-01T19:56:38.749 INFO:teuthology.orchestra.run.smithi008.stdout: }, 2023-08-01T19:56:38.749 INFO:teuthology.orchestra.run.smithi008.stdout: { 2023-08-01T19:56:38.749 INFO:teuthology.orchestra.run.smithi008.stdout: "event": "reached_pg", 2023-08-01T19:56:38.749 INFO:teuthology.orchestra.run.smithi008.stdout: "time": "2023-08-01T19:55:58.558870+0000", 2023-08-01T19:56:38.750 INFO:teuthology.orchestra.run.smithi008.stdout: "duration": 0.0022237730000000001 2023-08-01T19:56:38.750 INFO:teuthology.orchestra.run.smithi008.stdout: }, 2023-08-01T19:56:38.750 INFO:teuthology.orchestra.run.smithi008.stdout: { 2023-08-01T19:56:38.750 INFO:teuthology.orchestra.run.smithi008.stdout: "event": "started", 2023-08-01T19:56:38.750 INFO:teuthology.orchestra.run.smithi008.stdout: "time": "2023-08-01T19:55:58.559013+0000", 2023-08-01T19:56:38.750 INFO:teuthology.orchestra.run.smithi008.stdout: "duration": 0.00014289899999999999 2023-08-01T19:56:38.750 INFO:teuthology.orchestra.run.smithi008.stdout: }, 2023-08-01T19:56:38.751 INFO:teuthology.orchestra.run.smithi008.stdout: { 2023-08-01T19:56:38.751 INFO:teuthology.orchestra.run.smithi008.stdout: "event": "waiting for subops from 1", 2023-08-01T19:56:38.751 INFO:teuthology.orchestra.run.smithi008.stdout: "time": "2023-08-01T19:55:58.559137+0000", 2023-08-01T19:56:38.751 INFO:teuthology.orchestra.run.smithi008.stdout: "duration": 0.00012428499999999999 2023-08-01T19:56:38.751 INFO:teuthology.orchestra.run.smithi008.stdout: }, 2023-08-01T19:56:38.751 INFO:teuthology.orchestra.run.smithi008.stdout: { 2023-08-01T19:56:38.751 INFO:teuthology.orchestra.run.smithi008.stdout: "event": "reached_pg", 2023-08-01T19:56:38.751 INFO:teuthology.orchestra.run.smithi008.stdout: "time": "2023-08-01T19:55:58.567438+0000", 2023-08-01T19:56:38.752 INFO:teuthology.orchestra.run.smithi008.stdout: "duration": 0.0083003190000000004 2023-08-01T19:56:38.752 INFO:teuthology.orchestra.run.smithi008.stdout: }, 2023-08-01T19:56:38.752 INFO:teuthology.orchestra.run.smithi008.stdout: { 2023-08-01T19:56:38.752 INFO:teuthology.orchestra.run.smithi008.stdout: "event": "waiting for peered", 2023-08-01T19:56:38.752 INFO:teuthology.orchestra.run.smithi008.stdout: "time": "2023-08-01T19:55:58.567443+0000", 2023-08-01T19:56:38.752 INFO:teuthology.orchestra.run.smithi008.stdout: "duration": 5.1739999999999999e-06 2023-08-01T19:56:38.752 INFO:teuthology.orchestra.run.smithi008.stdout: }, 2023-08-01T19:56:38.753 INFO:teuthology.orchestra.run.smithi008.stdout: { 2023-08-01T19:56:38.753 INFO:teuthology.orchestra.run.smithi008.stdout: "event": "reached_pg", 2023-08-01T19:56:38.753 INFO:teuthology.orchestra.run.smithi008.stdout: "time": "2023-08-01T19:55:59.619164+0000", 2023-08-01T19:56:38.753 INFO:teuthology.orchestra.run.smithi008.stdout: "duration": 1.0517206750000001 2023-08-01T19:56:38.753 INFO:teuthology.orchestra.run.smithi008.stdout: }, 2023-08-01T19:56:38.753 INFO:teuthology.orchestra.run.smithi008.stdout: { 2023-08-01T19:56:38.753 INFO:teuthology.orchestra.run.smithi008.stdout: "event": "done", 2023-08-01T19:56:38.753 INFO:teuthology.orchestra.run.smithi008.stdout: "time": "2023-08-01T19:55:59.619209+0000", 2023-08-01T19:56:38.754 INFO:teuthology.orchestra.run.smithi008.stdout: "duration": 4.5800000000000002e-05 2023-08-01T19:56:38.754 INFO:teuthology.orchestra.run.smithi008.stdout: } 2023-08-01T19:56:38.754 INFO:teuthology.orchestra.run.smithi008.stdout: ] 2023-08-01T19:56:38.754 INFO:teuthology.orchestra.run.smithi008.stdout: } 2023-08-01T19:56:38.754 INFO:teuthology.orchestra.run.smithi008.stdout: }, 2023-08-01T19:56:38.754 INFO:teuthology.orchestra.run.smithi008.stdout: { 2023-08-01T19:56:38.754 INFO:teuthology.orchestra.run.smithi008.stdout: "description": "osd_op(client.4668.0:197404 5.5 5:a3c9c1bd:::benchmark_data_smithi006_114134_object63743:head [delete] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e61)", 2023-08-01T19:56:38.754 INFO:teuthology.orchestra.run.smithi008.stdout: "initiated_at": "2023-08-01T19:55:58.556653+0000", 2023-08-01T19:56:38.755 INFO:teuthology.orchestra.run.smithi008.stdout: "age": 40.047353862999998, 2023-08-01T19:56:38.755 INFO:teuthology.orchestra.run.smithi008.stdout: "duration": 1.061865576, 2023-08-01T19:56:38.755 INFO:teuthology.orchestra.run.smithi008.stdout: "type_data": { 2023-08-01T19:56:38.755 INFO:teuthology.orchestra.run.smithi008.stdout: "flag_point": "reached pg", 2023-08-01T19:56:38.755 INFO:teuthology.orchestra.run.smithi008.stdout: "client_info": { 2023-08-01T19:56:38.755 INFO:teuthology.orchestra.run.smithi008.stdout: "client": "client.4668", 2023-08-01T19:56:38.755 INFO:teuthology.orchestra.run.smithi008.stdout: "client_addr": "172.21.15.6:0/1709472247", 2023-08-01T19:56:38.756 INFO:teuthology.orchestra.run.smithi008.stdout: "tid": 197404 2023-08-01T19:56:38.756 INFO:teuthology.orchestra.run.smithi008.stdout: }, 2023-08-01T19:56:38.756 INFO:teuthology.orchestra.run.smithi008.stdout: "events": [ 2023-08-01T19:56:38.756 INFO:teuthology.orchestra.run.smithi008.stdout: { 2023-08-01T19:56:38.756 INFO:teuthology.orchestra.run.smithi008.stdout: "event": "initiated", 2023-08-01T19:56:38.756 INFO:teuthology.orchestra.run.smithi008.stdout: "time": "2023-08-01T19:55:58.556653+0000", 2023-08-01T19:56:38.756 INFO:teuthology.orchestra.run.smithi008.stdout: "duration": 0 2023-08-01T19:56:38.756 INFO:teuthology.orchestra.run.smithi008.stdout: }, 2023-08-01T19:56:38.757 INFO:teuthology.orchestra.run.smithi008.stdout: { 2023-08-01T19:56:38.757 INFO:teuthology.orchestra.run.smithi008.stdout: "event": "throttled", 2023-08-01T19:56:38.757 INFO:teuthology.orchestra.run.smithi008.stdout: "time": "2023-08-01T19:55:58.556653+0000", 2023-08-01T19:56:38.757 INFO:teuthology.orchestra.run.smithi008.stdout: "duration": 0 2023-08-01T19:56:38.757 INFO:teuthology.orchestra.run.smithi008.stdout: }, 2023-08-01T19:56:38.757 INFO:teuthology.orchestra.run.smithi008.stdout: { 2023-08-01T19:56:38.757 INFO:teuthology.orchestra.run.smithi008.stdout: "event": "header_read", 2023-08-01T19:56:38.757 INFO:teuthology.orchestra.run.smithi008.stdout: "time": "2023-08-01T19:55:58.556653+0000", 2023-08-01T19:56:38.758 INFO:teuthology.orchestra.run.smithi008.stdout: "duration": 4294967295.9999995 2023-08-01T19:56:38.758 INFO:teuthology.orchestra.run.smithi008.stdout: }, 2023-08-01T19:56:38.758 INFO:teuthology.orchestra.run.smithi008.stdout: { 2023-08-01T19:56:38.758 INFO:teuthology.orchestra.run.smithi008.stdout: "event": "all_read", 2023-08-01T19:56:38.758 INFO:teuthology.orchestra.run.smithi008.stdout: "time": "2023-08-01T19:55:58.556655+0000", 2023-08-01T19:56:38.758 INFO:teuthology.orchestra.run.smithi008.stdout: "duration": 2.435e-06 2023-08-01T19:56:38.758 INFO:teuthology.orchestra.run.smithi008.stdout: }, 2023-08-01T19:56:38.759 INFO:teuthology.orchestra.run.smithi008.stdout: { 2023-08-01T19:56:38.759 INFO:teuthology.orchestra.run.smithi008.stdout: "event": "dispatched", 2023-08-01T19:56:38.759 INFO:teuthology.orchestra.run.smithi008.stdout: "time": "2023-08-01T19:55:58.556661+0000", 2023-08-01T19:56:38.759 INFO:teuthology.orchestra.run.smithi008.stdout: "duration": 6.0599999999999996e-06 2023-08-01T19:56:38.759 INFO:teuthology.orchestra.run.smithi008.stdout: }, 2023-08-01T19:56:38.759 INFO:teuthology.orchestra.run.smithi008.stdout: { 2023-08-01T19:56:38.759 INFO:teuthology.orchestra.run.smithi008.stdout: "event": "queued_for_pg", 2023-08-01T19:56:38.759 INFO:teuthology.orchestra.run.smithi008.stdout: "time": "2023-08-01T19:55:58.556666+0000", 2023-08-01T19:56:38.760 INFO:teuthology.orchestra.run.smithi008.stdout: "duration": 4.9620000000000001e-06 2023-08-01T19:56:38.760 INFO:teuthology.orchestra.run.smithi008.stdout: }, 2023-08-01T19:56:38.760 INFO:teuthology.orchestra.run.smithi008.stdout: { 2023-08-01T19:56:38.760 INFO:teuthology.orchestra.run.smithi008.stdout: "event": "reached_pg", 2023-08-01T19:56:38.760 INFO:teuthology.orchestra.run.smithi008.stdout: "time": "2023-08-01T19:55:58.556698+0000", 2023-08-01T19:56:38.760 INFO:teuthology.orchestra.run.smithi008.stdout: "duration": 3.2302999999999999e-05 2023-08-01T19:56:38.760 INFO:teuthology.orchestra.run.smithi008.stdout: }, 2023-08-01T19:56:38.761 INFO:teuthology.orchestra.run.smithi008.stdout: { 2023-08-01T19:56:38.761 INFO:teuthology.orchestra.run.smithi008.stdout: "event": "started", 2023-08-01T19:56:38.761 INFO:teuthology.orchestra.run.smithi008.stdout: "time": "2023-08-01T19:55:58.556773+0000", 2023-08-01T19:56:38.761 INFO:teuthology.orchestra.run.smithi008.stdout: "duration": 7.4431999999999995e-05 2023-08-01T19:56:38.761 INFO:teuthology.orchestra.run.smithi008.stdout: }, 2023-08-01T19:56:38.761 INFO:teuthology.orchestra.run.smithi008.stdout: { 2023-08-01T19:56:38.761 INFO:teuthology.orchestra.run.smithi008.stdout: "event": "waiting for subops from 1", 2023-08-01T19:56:38.761 INFO:teuthology.orchestra.run.smithi008.stdout: "time": "2023-08-01T19:55:58.556837+0000", 2023-08-01T19:56:38.762 INFO:teuthology.orchestra.run.smithi008.stdout: "duration": 6.4522000000000003e-05 2023-08-01T19:56:38.762 INFO:teuthology.orchestra.run.smithi008.stdout: }, 2023-08-01T19:56:38.762 INFO:teuthology.orchestra.run.smithi008.stdout: { 2023-08-01T19:56:38.762 INFO:teuthology.orchestra.run.smithi008.stdout: "event": "reached_pg", 2023-08-01T19:56:38.762 INFO:teuthology.orchestra.run.smithi008.stdout: "time": "2023-08-01T19:55:58.563930+0000", 2023-08-01T19:56:38.762 INFO:teuthology.orchestra.run.smithi008.stdout: "duration": 0.0070929030000000002 2023-08-01T19:56:38.762 INFO:teuthology.orchestra.run.smithi008.stdout: }, 2023-08-01T19:56:38.762 INFO:teuthology.orchestra.run.smithi008.stdout: { 2023-08-01T19:56:38.763 INFO:teuthology.orchestra.run.smithi008.stdout: "event": "waiting for peered", 2023-08-01T19:56:38.763 INFO:teuthology.orchestra.run.smithi008.stdout: "time": "2023-08-01T19:55:58.563939+0000", 2023-08-01T19:56:38.763 INFO:teuthology.orchestra.run.smithi008.stdout: "duration": 8.6079999999999996e-06 2023-08-01T19:56:38.763 INFO:teuthology.orchestra.run.smithi008.stdout: }, 2023-08-01T19:56:38.763 INFO:teuthology.orchestra.run.smithi008.stdout: { 2023-08-01T19:56:38.763 INFO:teuthology.orchestra.run.smithi008.stdout: "event": "reached_pg", 2023-08-01T19:56:38.763 INFO:teuthology.orchestra.run.smithi008.stdout: "time": "2023-08-01T19:55:59.618422+0000", 2023-08-01T19:56:38.763 INFO:teuthology.orchestra.run.smithi008.stdout: "duration": 1.054483295 2023-08-01T19:56:38.764 INFO:teuthology.orchestra.run.smithi008.stdout: }, 2023-08-01T19:56:38.764 INFO:teuthology.orchestra.run.smithi008.stdout: { 2023-08-01T19:56:38.764 INFO:teuthology.orchestra.run.smithi008.stdout: "event": "done", 2023-08-01T19:56:38.764 INFO:teuthology.orchestra.run.smithi008.stdout: "time": "2023-08-01T19:55:59.618519+0000", 2023-08-01T19:56:38.764 INFO:teuthology.orchestra.run.smithi008.stdout: "duration": 9.6471000000000005e-05 2023-08-01T19:56:38.764 INFO:teuthology.orchestra.run.smithi008.stdout: } 2023-08-01T19:56:38.764 INFO:teuthology.orchestra.run.smithi008.stdout: ] 2023-08-01T19:56:38.765 INFO:teuthology.orchestra.run.smithi008.stdout: } 2023-08-01T19:56:38.765 INFO:teuthology.orchestra.run.smithi008.stdout: }, 2023-08-01T19:56:38.765 INFO:teuthology.orchestra.run.smithi008.stdout: { 2023-08-01T19:56:38.765 INFO:teuthology.orchestra.run.smithi008.stdout: "description": "osd_op(client.4668.0:197407 5.1 5:85528fae:::benchmark_data_smithi006_114134_object63746:head [delete] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e61)", 2023-08-01T19:56:38.765 INFO:teuthology.orchestra.run.smithi008.stdout: "initiated_at": "2023-08-01T19:55:58.559216+0000", 2023-08-01T19:56:38.765 INFO:teuthology.orchestra.run.smithi008.stdout: "age": 40.044791214999996, 2023-08-01T19:56:38.765 INFO:teuthology.orchestra.run.smithi008.stdout: "duration": 1.061802277, 2023-08-01T19:56:38.765 INFO:teuthology.orchestra.run.smithi008.stdout: "type_data": { 2023-08-01T19:56:38.766 INFO:teuthology.orchestra.run.smithi008.stdout: "flag_point": "reached pg", 2023-08-01T19:56:38.766 INFO:teuthology.orchestra.run.smithi008.stdout: "client_info": { 2023-08-01T19:56:38.766 INFO:teuthology.orchestra.run.smithi008.stdout: "client": "client.4668", 2023-08-01T19:56:38.766 INFO:teuthology.orchestra.run.smithi008.stdout: "client_addr": "172.21.15.6:0/1709472247", 2023-08-01T19:56:38.766 INFO:teuthology.orchestra.run.smithi008.stdout: "tid": 197407 2023-08-01T19:56:38.766 INFO:teuthology.orchestra.run.smithi008.stdout: }, 2023-08-01T19:56:38.766 INFO:teuthology.orchestra.run.smithi008.stdout: "events": [ 2023-08-01T19:56:38.767 INFO:teuthology.orchestra.run.smithi008.stdout: { 2023-08-01T19:56:38.767 INFO:teuthology.orchestra.run.smithi008.stdout: "event": "initiated", 2023-08-01T19:56:38.767 INFO:teuthology.orchestra.run.smithi008.stdout: "time": "2023-08-01T19:55:58.559216+0000", 2023-08-01T19:56:38.767 INFO:teuthology.orchestra.run.smithi008.stdout: "duration": 0 2023-08-01T19:56:38.767 INFO:teuthology.orchestra.run.smithi008.stdout: }, 2023-08-01T19:56:38.767 INFO:teuthology.orchestra.run.smithi008.stdout: { 2023-08-01T19:56:38.767 INFO:teuthology.orchestra.run.smithi008.stdout: "event": "throttled", 2023-08-01T19:56:38.768 INFO:teuthology.orchestra.run.smithi008.stdout: "time": "2023-08-01T19:55:58.559216+0000", 2023-08-01T19:56:38.768 INFO:teuthology.orchestra.run.smithi008.stdout: "duration": 0 2023-08-01T19:56:38.768 INFO:teuthology.orchestra.run.smithi008.stdout: }, 2023-08-01T19:56:38.768 INFO:teuthology.orchestra.run.smithi008.stdout: { 2023-08-01T19:56:38.768 INFO:teuthology.orchestra.run.smithi008.stdout: "event": "header_read", 2023-08-01T19:56:38.768 INFO:teuthology.orchestra.run.smithi008.stdout: "time": "2023-08-01T19:55:58.559215+0000", 2023-08-01T19:56:38.768 INFO:teuthology.orchestra.run.smithi008.stdout: "duration": 4294967295.999999 2023-08-01T19:56:38.768 INFO:teuthology.orchestra.run.smithi008.stdout: }, 2023-08-01T19:56:38.769 INFO:teuthology.orchestra.run.smithi008.stdout: { 2023-08-01T19:56:38.769 INFO:teuthology.orchestra.run.smithi008.stdout: "event": "all_read", 2023-08-01T19:56:38.769 INFO:teuthology.orchestra.run.smithi008.stdout: "time": "2023-08-01T19:55:58.559220+0000", 2023-08-01T19:56:38.769 INFO:teuthology.orchestra.run.smithi008.stdout: "duration": 5.3879999999999999e-06 2023-08-01T19:56:38.769 INFO:teuthology.orchestra.run.smithi008.stdout: }, 2023-08-01T19:56:38.769 INFO:teuthology.orchestra.run.smithi008.stdout: { 2023-08-01T19:56:38.769 INFO:teuthology.orchestra.run.smithi008.stdout: "event": "dispatched", 2023-08-01T19:56:38.770 INFO:teuthology.orchestra.run.smithi008.stdout: "time": "2023-08-01T19:55:58.559230+0000", 2023-08-01T19:56:38.770 INFO:teuthology.orchestra.run.smithi008.stdout: "duration": 9.6590000000000002e-06 2023-08-01T19:56:38.770 INFO:teuthology.orchestra.run.smithi008.stdout: }, 2023-08-01T19:56:38.770 INFO:teuthology.orchestra.run.smithi008.stdout: { 2023-08-01T19:56:38.770 INFO:teuthology.orchestra.run.smithi008.stdout: "event": "queued_for_pg", 2023-08-01T19:56:38.770 INFO:teuthology.orchestra.run.smithi008.stdout: "time": "2023-08-01T19:55:58.559235+0000", 2023-08-01T19:56:38.770 INFO:teuthology.orchestra.run.smithi008.stdout: "duration": 5.575e-06 2023-08-01T19:56:38.770 INFO:teuthology.orchestra.run.smithi008.stdout: }, 2023-08-01T19:56:38.771 INFO:teuthology.orchestra.run.smithi008.stdout: { 2023-08-01T19:56:38.771 INFO:teuthology.orchestra.run.smithi008.stdout: "event": "reached_pg", 2023-08-01T19:56:38.771 INFO:teuthology.orchestra.run.smithi008.stdout: "time": "2023-08-01T19:55:58.559279+0000", 2023-08-01T19:56:38.771 INFO:teuthology.orchestra.run.smithi008.stdout: "duration": 4.3273999999999999e-05 2023-08-01T19:56:38.771 INFO:teuthology.orchestra.run.smithi008.stdout: }, 2023-08-01T19:56:38.771 INFO:teuthology.orchestra.run.smithi008.stdout: { 2023-08-01T19:56:38.771 INFO:teuthology.orchestra.run.smithi008.stdout: "event": "started", 2023-08-01T19:56:38.771 INFO:teuthology.orchestra.run.smithi008.stdout: "time": "2023-08-01T19:55:58.559403+0000", 2023-08-01T19:56:38.772 INFO:teuthology.orchestra.run.smithi008.stdout: "duration": 0.000124781 2023-08-01T19:56:38.772 INFO:teuthology.orchestra.run.smithi008.stdout: }, 2023-08-01T19:56:38.772 INFO:teuthology.orchestra.run.smithi008.stdout: { 2023-08-01T19:56:38.772 INFO:teuthology.orchestra.run.smithi008.stdout: "event": "waiting for subops from 1", 2023-08-01T19:56:38.772 INFO:teuthology.orchestra.run.smithi008.stdout: "time": "2023-08-01T19:55:58.559561+0000", 2023-08-01T19:56:38.772 INFO:teuthology.orchestra.run.smithi008.stdout: "duration": 0.000157773 2023-08-01T19:56:38.772 INFO:teuthology.orchestra.run.smithi008.stdout: }, 2023-08-01T19:56:38.773 INFO:teuthology.orchestra.run.smithi008.stdout: { 2023-08-01T19:56:38.773 INFO:teuthology.orchestra.run.smithi008.stdout: "event": "reached_pg", 2023-08-01T19:56:38.773 INFO:teuthology.orchestra.run.smithi008.stdout: "time": "2023-08-01T19:55:58.569498+0000", 2023-08-01T19:56:38.773 INFO:teuthology.orchestra.run.smithi008.stdout: "duration": 0.0099367069999999995 2023-08-01T19:56:38.773 INFO:teuthology.orchestra.run.smithi008.stdout: }, 2023-08-01T19:56:38.773 INFO:teuthology.orchestra.run.smithi008.stdout: { 2023-08-01T19:56:38.773 INFO:teuthology.orchestra.run.smithi008.stdout: "event": "waiting for peered", 2023-08-01T19:56:38.773 INFO:teuthology.orchestra.run.smithi008.stdout: "time": "2023-08-01T19:55:58.569756+0000", 2023-08-01T19:56:38.774 INFO:teuthology.orchestra.run.smithi008.stdout: "duration": 0.00025830800000000001 2023-08-01T19:56:38.774 INFO:teuthology.orchestra.run.smithi008.stdout: }, 2023-08-01T19:56:38.774 INFO:teuthology.orchestra.run.smithi008.stdout: { 2023-08-01T19:56:38.774 INFO:teuthology.orchestra.run.smithi008.stdout: "event": "reached_pg", 2023-08-01T19:56:38.774 INFO:teuthology.orchestra.run.smithi008.stdout: "time": "2023-08-01T19:55:59.620962+0000", 2023-08-01T19:56:38.774 INFO:teuthology.orchestra.run.smithi008.stdout: "duration": 1.0512062129999999 2023-08-01T19:56:38.774 INFO:teuthology.orchestra.run.smithi008.stdout: }, 2023-08-01T19:56:38.774 INFO:teuthology.orchestra.run.smithi008.stdout: { 2023-08-01T19:56:38.775 INFO:teuthology.orchestra.run.smithi008.stdout: "event": "done", 2023-08-01T19:56:38.775 INFO:teuthology.orchestra.run.smithi008.stdout: "time": "2023-08-01T19:55:59.621018+0000", 2023-08-01T19:56:38.775 INFO:teuthology.orchestra.run.smithi008.stdout: "duration": 5.5498999999999998e-05 2023-08-01T19:56:38.775 INFO:teuthology.orchestra.run.smithi008.stdout: } 2023-08-01T19:56:38.775 INFO:teuthology.orchestra.run.smithi008.stdout: ] 2023-08-01T19:56:38.775 INFO:teuthology.orchestra.run.smithi008.stdout: } 2023-08-01T19:56:38.775 INFO:teuthology.orchestra.run.smithi008.stdout: }, 2023-08-01T19:56:38.775 INFO:teuthology.orchestra.run.smithi008.stdout: { 2023-08-01T19:56:38.776 INFO:teuthology.orchestra.run.smithi008.stdout: "description": "osd_op(client.4668.0:197396 5.2 5:43f8487b:::benchmark_data_smithi006_114134_object63735:head [delete] snapc 0=[] RETRY=1 ondisk+retry+write+known_if_redirected+supports_pool_eio e62)", 2023-08-01T19:56:38.776 INFO:teuthology.orchestra.run.smithi008.stdout: "initiated_at": "2023-08-01T19:55:58.564585+0000", 2023-08-01T19:56:38.776 INFO:teuthology.orchestra.run.smithi008.stdout: "age": 40.039422240999997, 2023-08-01T19:56:38.776 INFO:teuthology.orchestra.run.smithi008.stdout: "duration": 1.0535085049999999, 2023-08-01T19:56:38.776 INFO:teuthology.orchestra.run.smithi008.stdout: "type_data": { 2023-08-01T19:56:38.776 INFO:teuthology.orchestra.run.smithi008.stdout: "flag_point": "reached pg", 2023-08-01T19:56:38.776 INFO:teuthology.orchestra.run.smithi008.stdout: "client_info": { 2023-08-01T19:56:38.777 INFO:teuthology.orchestra.run.smithi008.stdout: "client": "client.4668", 2023-08-01T19:56:38.777 INFO:teuthology.orchestra.run.smithi008.stdout: "client_addr": "172.21.15.6:0/1709472247", 2023-08-01T19:56:38.777 INFO:teuthology.orchestra.run.smithi008.stdout: "tid": 197396 2023-08-01T19:56:38.777 INFO:teuthology.orchestra.run.smithi008.stdout: }, 2023-08-01T19:56:38.777 INFO:teuthology.orchestra.run.smithi008.stdout: "events": [ 2023-08-01T19:56:38.777 INFO:teuthology.orchestra.run.smithi008.stdout: { 2023-08-01T19:56:38.777 INFO:teuthology.orchestra.run.smithi008.stdout: "event": "initiated", 2023-08-01T19:56:38.777 INFO:teuthology.orchestra.run.smithi008.stdout: "time": "2023-08-01T19:55:58.564585+0000", 2023-08-01T19:56:38.778 INFO:teuthology.orchestra.run.smithi008.stdout: "duration": 0 2023-08-01T19:56:38.778 INFO:teuthology.orchestra.run.smithi008.stdout: }, 2023-08-01T19:56:38.778 INFO:teuthology.orchestra.run.smithi008.stdout: { 2023-08-01T19:56:38.778 INFO:teuthology.orchestra.run.smithi008.stdout: "event": "throttled", 2023-08-01T19:56:38.778 INFO:teuthology.orchestra.run.smithi008.stdout: "time": "2023-08-01T19:55:58.564585+0000", 2023-08-01T19:56:38.778 INFO:teuthology.orchestra.run.smithi008.stdout: "duration": 0 2023-08-01T19:56:38.778 INFO:teuthology.orchestra.run.smithi008.stdout: }, 2023-08-01T19:56:38.778 INFO:teuthology.orchestra.run.smithi008.stdout: { 2023-08-01T19:56:38.779 INFO:teuthology.orchestra.run.smithi008.stdout: "event": "header_read", 2023-08-01T19:56:38.779 INFO:teuthology.orchestra.run.smithi008.stdout: "time": "2023-08-01T19:55:58.564583+0000", 2023-08-01T19:56:38.779 INFO:teuthology.orchestra.run.smithi008.stdout: "duration": 4294967295.9999981 2023-08-01T19:56:38.779 INFO:teuthology.orchestra.run.smithi008.stdout: }, 2023-08-01T19:56:38.779 INFO:teuthology.orchestra.run.smithi008.stdout: { 2023-08-01T19:56:38.779 INFO:teuthology.orchestra.run.smithi008.stdout: "event": "all_read", 2023-08-01T19:56:38.779 INFO:teuthology.orchestra.run.smithi008.stdout: "time": "2023-08-01T19:55:58.564591+0000", 2023-08-01T19:56:38.780 INFO:teuthology.orchestra.run.smithi008.stdout: "duration": 8.2169999999999994e-06 2023-08-01T19:56:38.780 INFO:teuthology.orchestra.run.smithi008.stdout: }, 2023-08-01T19:56:38.780 INFO:teuthology.orchestra.run.smithi008.stdout: { 2023-08-01T19:56:38.780 INFO:teuthology.orchestra.run.smithi008.stdout: "event": "dispatched", 2023-08-01T19:56:38.780 INFO:teuthology.orchestra.run.smithi008.stdout: "time": "2023-08-01T19:55:58.564603+0000", 2023-08-01T19:56:38.780 INFO:teuthology.orchestra.run.smithi008.stdout: "duration": 1.186e-05 2023-08-01T19:56:38.780 INFO:teuthology.orchestra.run.smithi008.stdout: }, 2023-08-01T19:56:38.780 INFO:teuthology.orchestra.run.smithi008.stdout: { 2023-08-01T19:56:38.781 INFO:teuthology.orchestra.run.smithi008.stdout: "event": "queued_for_pg", 2023-08-01T19:56:38.781 INFO:teuthology.orchestra.run.smithi008.stdout: "time": "2023-08-01T19:55:58.564609+0000", 2023-08-01T19:56:38.781 INFO:teuthology.orchestra.run.smithi008.stdout: "duration": 6.4130000000000003e-06 2023-08-01T19:56:38.781 INFO:teuthology.orchestra.run.smithi008.stdout: }, 2023-08-01T19:56:38.781 INFO:teuthology.orchestra.run.smithi008.stdout: { 2023-08-01T19:56:38.781 INFO:teuthology.orchestra.run.smithi008.stdout: "event": "reached_pg", 2023-08-01T19:56:38.781 INFO:teuthology.orchestra.run.smithi008.stdout: "time": "2023-08-01T19:55:58.573439+0000", 2023-08-01T19:56:38.782 INFO:teuthology.orchestra.run.smithi008.stdout: "duration": 0.0088303310000000003 2023-08-01T19:56:38.782 INFO:teuthology.orchestra.run.smithi008.stdout: }, 2023-08-01T19:56:38.782 INFO:teuthology.orchestra.run.smithi008.stdout: { 2023-08-01T19:56:38.782 INFO:teuthology.orchestra.run.smithi008.stdout: "event": "waiting for peered", 2023-08-01T19:56:38.782 INFO:teuthology.orchestra.run.smithi008.stdout: "time": "2023-08-01T19:55:58.573448+0000", 2023-08-01T19:56:38.782 INFO:teuthology.orchestra.run.smithi008.stdout: "duration": 8.2910000000000007e-06 2023-08-01T19:56:38.782 INFO:teuthology.orchestra.run.smithi008.stdout: }, 2023-08-01T19:56:38.782 INFO:teuthology.orchestra.run.smithi008.stdout: { 2023-08-01T19:56:38.783 INFO:teuthology.orchestra.run.smithi008.stdout: "event": "reached_pg", 2023-08-01T19:56:38.783 INFO:teuthology.orchestra.run.smithi008.stdout: "time": "2023-08-01T19:55:59.617892+0000", 2023-08-01T19:56:38.783 INFO:teuthology.orchestra.run.smithi008.stdout: "duration": 1.0444446380000001 2023-08-01T19:56:38.783 INFO:teuthology.orchestra.run.smithi008.stdout: }, 2023-08-01T19:56:38.783 INFO:teuthology.orchestra.run.smithi008.stdout: { 2023-08-01T19:56:38.783 INFO:teuthology.orchestra.run.smithi008.stdout: "event": "done", 2023-08-01T19:56:38.783 INFO:teuthology.orchestra.run.smithi008.stdout: "time": "2023-08-01T19:55:59.618093+0000", 2023-08-01T19:56:38.783 INFO:teuthology.orchestra.run.smithi008.stdout: "duration": 0.00020066300000000001 2023-08-01T19:56:38.784 INFO:teuthology.orchestra.run.smithi008.stdout: } 2023-08-01T19:56:38.784 INFO:teuthology.orchestra.run.smithi008.stdout: ] 2023-08-01T19:56:38.784 INFO:teuthology.orchestra.run.smithi008.stdout: } 2023-08-01T19:56:38.784 INFO:teuthology.orchestra.run.smithi008.stdout: }, 2023-08-01T19:56:38.784 INFO:teuthology.orchestra.run.smithi008.stdout: { 2023-08-01T19:56:38.784 INFO:teuthology.orchestra.run.smithi008.stdout: "description": "osd_op(client.4668.0:197411 5.7 5:ebefbc20:::benchmark_data_smithi006_114134_object63750:head [delete] snapc 0=[] RETRY=1 ondisk+retry+write+known_if_redirected+supports_pool_eio e62)", 2023-08-01T19:56:38.784 INFO:teuthology.orchestra.run.smithi008.stdout: "initiated_at": "2023-08-01T19:55:58.564619+0000", 2023-08-01T19:56:38.785 INFO:teuthology.orchestra.run.smithi008.stdout: "age": 40.039387566000002, 2023-08-01T19:56:38.785 INFO:teuthology.orchestra.run.smithi008.stdout: "duration": 1.0686062569999999, 2023-08-01T19:56:38.785 INFO:teuthology.orchestra.run.smithi008.stdout: "type_data": { 2023-08-01T19:56:38.785 INFO:teuthology.orchestra.run.smithi008.stdout: "flag_point": "commit sent; apply or cleanup", 2023-08-01T19:56:38.785 INFO:teuthology.orchestra.run.smithi008.stdout: "client_info": { 2023-08-01T19:56:38.785 INFO:teuthology.orchestra.run.smithi008.stdout: "client": "client.4668", 2023-08-01T19:56:38.785 INFO:teuthology.orchestra.run.smithi008.stdout: "client_addr": "172.21.15.6:0/1709472247", 2023-08-01T19:56:38.785 INFO:teuthology.orchestra.run.smithi008.stdout: "tid": 197411 2023-08-01T19:56:38.786 INFO:teuthology.orchestra.run.smithi008.stdout: }, 2023-08-01T19:56:38.786 INFO:teuthology.orchestra.run.smithi008.stdout: "events": [ 2023-08-01T19:56:38.786 INFO:teuthology.orchestra.run.smithi008.stdout: { 2023-08-01T19:56:38.786 INFO:teuthology.orchestra.run.smithi008.stdout: "event": "initiated", 2023-08-01T19:56:38.786 INFO:teuthology.orchestra.run.smithi008.stdout: "time": "2023-08-01T19:55:58.564619+0000", 2023-08-01T19:56:38.786 INFO:teuthology.orchestra.run.smithi008.stdout: "duration": 0 2023-08-01T19:56:38.786 INFO:teuthology.orchestra.run.smithi008.stdout: }, 2023-08-01T19:56:38.787 INFO:teuthology.orchestra.run.smithi008.stdout: { 2023-08-01T19:56:38.787 INFO:teuthology.orchestra.run.smithi008.stdout: "event": "throttled", 2023-08-01T19:56:38.787 INFO:teuthology.orchestra.run.smithi008.stdout: "time": "2023-08-01T19:55:58.564619+0000", 2023-08-01T19:56:38.787 INFO:teuthology.orchestra.run.smithi008.stdout: "duration": 0 2023-08-01T19:56:38.787 INFO:teuthology.orchestra.run.smithi008.stdout: }, 2023-08-01T19:56:38.787 INFO:teuthology.orchestra.run.smithi008.stdout: { 2023-08-01T19:56:38.787 INFO:teuthology.orchestra.run.smithi008.stdout: "event": "header_read", 2023-08-01T19:56:38.787 INFO:teuthology.orchestra.run.smithi008.stdout: "time": "2023-08-01T19:55:58.564619+0000", 2023-08-01T19:56:38.788 INFO:teuthology.orchestra.run.smithi008.stdout: "duration": 4294967295.9999995 2023-08-01T19:56:38.788 INFO:teuthology.orchestra.run.smithi008.stdout: }, 2023-08-01T19:56:38.788 INFO:teuthology.orchestra.run.smithi008.stdout: { 2023-08-01T19:56:38.788 INFO:teuthology.orchestra.run.smithi008.stdout: "event": "all_read", 2023-08-01T19:56:38.788 INFO:teuthology.orchestra.run.smithi008.stdout: "time": "2023-08-01T19:55:58.564621+0000", 2023-08-01T19:56:38.788 INFO:teuthology.orchestra.run.smithi008.stdout: "duration": 2.6139999999999999e-06 2023-08-01T19:56:38.788 INFO:teuthology.orchestra.run.smithi008.stdout: }, 2023-08-01T19:56:38.788 INFO:teuthology.orchestra.run.smithi008.stdout: { 2023-08-01T19:56:38.789 INFO:teuthology.orchestra.run.smithi008.stdout: "event": "dispatched", 2023-08-01T19:56:38.789 INFO:teuthology.orchestra.run.smithi008.stdout: "time": "2023-08-01T19:55:58.564627+0000", 2023-08-01T19:56:38.789 INFO:teuthology.orchestra.run.smithi008.stdout: "duration": 5.1150000000000002e-06 2023-08-01T19:56:38.789 INFO:teuthology.orchestra.run.smithi008.stdout: }, 2023-08-01T19:56:38.789 INFO:teuthology.orchestra.run.smithi008.stdout: { 2023-08-01T19:56:38.790 INFO:teuthology.orchestra.run.smithi008.stdout: "event": "queued_for_pg", 2023-08-01T19:56:38.790 INFO:teuthology.orchestra.run.smithi008.stdout: "time": "2023-08-01T19:55:58.564631+0000", 2023-08-01T19:56:38.790 INFO:teuthology.orchestra.run.smithi008.stdout: "duration": 4.702e-06 2023-08-01T19:56:38.790 INFO:teuthology.orchestra.run.smithi008.stdout: }, 2023-08-01T19:56:38.790 INFO:teuthology.orchestra.run.smithi008.stdout: { 2023-08-01T19:56:38.791 INFO:teuthology.orchestra.run.smithi008.stdout: "event": "reached_pg", 2023-08-01T19:56:38.791 INFO:teuthology.orchestra.run.smithi008.stdout: "time": "2023-08-01T19:55:58.565520+0000", 2023-08-01T19:56:38.791 INFO:teuthology.orchestra.run.smithi008.stdout: "duration": 0.00088893399999999997 2023-08-01T19:56:38.791 INFO:teuthology.orchestra.run.smithi008.stdout: }, 2023-08-01T19:56:38.791 INFO:teuthology.orchestra.run.smithi008.stdout: { 2023-08-01T19:56:38.791 INFO:teuthology.orchestra.run.smithi008.stdout: "event": "waiting for peered", 2023-08-01T19:56:38.792 INFO:teuthology.orchestra.run.smithi008.stdout: "time": "2023-08-01T19:55:58.565528+0000", 2023-08-01T19:56:38.792 INFO:teuthology.orchestra.run.smithi008.stdout: "duration": 7.5410000000000003e-06 2023-08-01T19:56:38.792 INFO:teuthology.orchestra.run.smithi008.stdout: }, 2023-08-01T19:56:38.792 INFO:teuthology.orchestra.run.smithi008.stdout: { 2023-08-01T19:56:38.793 INFO:teuthology.orchestra.run.smithi008.stdout: "event": "reached_pg", 2023-08-01T19:56:38.793 INFO:teuthology.orchestra.run.smithi008.stdout: "time": "2023-08-01T19:55:59.622374+0000", 2023-08-01T19:56:38.793 INFO:teuthology.orchestra.run.smithi008.stdout: "duration": 1.05684588 2023-08-01T19:56:38.793 INFO:teuthology.orchestra.run.smithi008.stdout: }, 2023-08-01T19:56:38.794 INFO:teuthology.orchestra.run.smithi008.stdout: { 2023-08-01T19:56:38.794 INFO:teuthology.orchestra.run.smithi008.stdout: "event": "started", 2023-08-01T19:56:38.794 INFO:teuthology.orchestra.run.smithi008.stdout: "time": "2023-08-01T19:55:59.624156+0000", 2023-08-01T19:56:38.794 INFO:teuthology.orchestra.run.smithi008.stdout: "duration": 0.0017826129999999999 2023-08-01T19:56:38.795 INFO:teuthology.orchestra.run.smithi008.stdout: }, 2023-08-01T19:56:38.795 INFO:teuthology.orchestra.run.smithi008.stdout: { 2023-08-01T19:56:38.795 INFO:teuthology.orchestra.run.smithi008.stdout: "event": "op_commit", 2023-08-01T19:56:38.795 INFO:teuthology.orchestra.run.smithi008.stdout: "time": "2023-08-01T19:55:59.633131+0000", 2023-08-01T19:56:38.796 INFO:teuthology.orchestra.run.smithi008.stdout: "duration": 0.0089745740000000008 2023-08-01T19:56:38.796 INFO:teuthology.orchestra.run.smithi008.stdout: }, 2023-08-01T19:56:38.796 INFO:teuthology.orchestra.run.smithi008.stdout: { 2023-08-01T19:56:38.796 INFO:teuthology.orchestra.run.smithi008.stdout: "event": "commit_sent", 2023-08-01T19:56:38.797 INFO:teuthology.orchestra.run.smithi008.stdout: "time": "2023-08-01T19:55:59.633173+0000", 2023-08-01T19:56:38.797 INFO:teuthology.orchestra.run.smithi008.stdout: "duration": 4.2645000000000003e-05 2023-08-01T19:56:38.797 INFO:teuthology.orchestra.run.smithi008.stdout: }, 2023-08-01T19:56:38.797 INFO:teuthology.orchestra.run.smithi008.stdout: { 2023-08-01T19:56:38.798 INFO:teuthology.orchestra.run.smithi008.stdout: "event": "done", 2023-08-01T19:56:38.798 INFO:teuthology.orchestra.run.smithi008.stdout: "time": "2023-08-01T19:55:59.633225+0000", 2023-08-01T19:56:38.798 INFO:teuthology.orchestra.run.smithi008.stdout: "duration": 5.2003999999999999e-05 2023-08-01T19:56:38.798 INFO:teuthology.orchestra.run.smithi008.stdout: } 2023-08-01T19:56:38.799 INFO:teuthology.orchestra.run.smithi008.stdout: ] 2023-08-01T19:56:38.799 INFO:teuthology.orchestra.run.smithi008.stdout: } 2023-08-01T19:56:38.799 INFO:teuthology.orchestra.run.smithi008.stdout: }, 2023-08-01T19:56:38.799 INFO:teuthology.orchestra.run.smithi008.stdout: { 2023-08-01T19:56:38.800 INFO:teuthology.orchestra.run.smithi008.stdout: "description": "osd_op(client.4668.0:197413 5.5 5:a6ff9d8a:::benchmark_data_smithi006_114134_object63752:head [delete] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e62)", 2023-08-01T19:56:38.800 INFO:teuthology.orchestra.run.smithi008.stdout: "initiated_at": "2023-08-01T19:55:58.573778+0000", 2023-08-01T19:56:38.800 INFO:teuthology.orchestra.run.smithi008.stdout: "age": 40.030228600000001, 2023-08-01T19:56:38.800 INFO:teuthology.orchestra.run.smithi008.stdout: "duration": 1.054781371, 2023-08-01T19:56:38.801 INFO:teuthology.orchestra.run.smithi008.stdout: "type_data": { 2023-08-01T19:56:38.801 INFO:teuthology.orchestra.run.smithi008.stdout: "flag_point": "commit sent; apply or cleanup", 2023-08-01T19:56:38.801 INFO:teuthology.orchestra.run.smithi008.stdout: "client_info": { 2023-08-01T19:56:38.801 INFO:teuthology.orchestra.run.smithi008.stdout: "client": "client.4668", 2023-08-01T19:56:38.802 INFO:teuthology.orchestra.run.smithi008.stdout: "client_addr": "172.21.15.6:0/1709472247", 2023-08-01T19:56:38.802 INFO:teuthology.orchestra.run.smithi008.stdout: "tid": 197413 2023-08-01T19:56:38.802 INFO:teuthology.orchestra.run.smithi008.stdout: }, 2023-08-01T19:56:38.802 INFO:teuthology.orchestra.run.smithi008.stdout: "events": [ 2023-08-01T19:56:38.803 INFO:teuthology.orchestra.run.smithi008.stdout: { 2023-08-01T19:56:38.803 INFO:teuthology.orchestra.run.smithi008.stdout: "event": "initiated", 2023-08-01T19:56:38.803 INFO:teuthology.orchestra.run.smithi008.stdout: "time": "2023-08-01T19:55:58.573778+0000", 2023-08-01T19:56:38.803 INFO:teuthology.orchestra.run.smithi008.stdout: "duration": 0 2023-08-01T19:56:38.804 INFO:teuthology.orchestra.run.smithi008.stdout: }, 2023-08-01T19:56:38.804 INFO:teuthology.orchestra.run.smithi008.stdout: { 2023-08-01T19:56:38.804 INFO:teuthology.orchestra.run.smithi008.stdout: "event": "throttled", 2023-08-01T19:56:38.804 INFO:teuthology.orchestra.run.smithi008.stdout: "time": "2023-08-01T19:55:58.573778+0000", 2023-08-01T19:56:38.805 INFO:teuthology.orchestra.run.smithi008.stdout: "duration": 0 2023-08-01T19:56:38.805 INFO:teuthology.orchestra.run.smithi008.stdout: }, 2023-08-01T19:56:38.805 INFO:teuthology.orchestra.run.smithi008.stdout: { 2023-08-01T19:56:38.805 INFO:teuthology.orchestra.run.smithi008.stdout: "event": "header_read", 2023-08-01T19:56:38.805 INFO:teuthology.orchestra.run.smithi008.stdout: "time": "2023-08-01T19:55:58.573776+0000", 2023-08-01T19:56:38.806 INFO:teuthology.orchestra.run.smithi008.stdout: "duration": 4294967295.9999981 2023-08-01T19:56:38.806 INFO:teuthology.orchestra.run.smithi008.stdout: }, 2023-08-01T19:56:38.806 INFO:teuthology.orchestra.run.smithi008.stdout: { 2023-08-01T19:56:38.806 INFO:teuthology.orchestra.run.smithi008.stdout: "event": "all_read", 2023-08-01T19:56:38.806 INFO:teuthology.orchestra.run.smithi008.stdout: "time": "2023-08-01T19:55:58.573784+0000", 2023-08-01T19:56:38.807 INFO:teuthology.orchestra.run.smithi008.stdout: "duration": 8.2490000000000001e-06 2023-08-01T19:56:38.807 INFO:teuthology.orchestra.run.smithi008.stdout: }, 2023-08-01T19:56:38.807 INFO:teuthology.orchestra.run.smithi008.stdout: { 2023-08-01T19:56:38.807 INFO:teuthology.orchestra.run.smithi008.stdout: "event": "dispatched", 2023-08-01T19:56:38.808 INFO:teuthology.orchestra.run.smithi008.stdout: "time": "2023-08-01T19:55:58.574230+0000", 2023-08-01T19:56:38.808 INFO:teuthology.orchestra.run.smithi008.stdout: "duration": 0.00044558400000000001 2023-08-01T19:56:38.808 INFO:teuthology.orchestra.run.smithi008.stdout: }, 2023-08-01T19:56:38.809 INFO:teuthology.orchestra.run.smithi008.stdout: { 2023-08-01T19:56:38.809 INFO:teuthology.orchestra.run.smithi008.stdout: "event": "queued_for_pg", 2023-08-01T19:56:38.809 INFO:teuthology.orchestra.run.smithi008.stdout: "time": "2023-08-01T19:55:58.574240+0000", 2023-08-01T19:56:38.809 INFO:teuthology.orchestra.run.smithi008.stdout: "duration": 9.7699999999999996e-06 2023-08-01T19:56:38.810 INFO:teuthology.orchestra.run.smithi008.stdout: }, 2023-08-01T19:56:38.810 INFO:teuthology.orchestra.run.smithi008.stdout: { 2023-08-01T19:56:38.810 INFO:teuthology.orchestra.run.smithi008.stdout: "event": "reached_pg", 2023-08-01T19:56:38.811 INFO:teuthology.orchestra.run.smithi008.stdout: "time": "2023-08-01T19:55:58.574292+0000", 2023-08-01T19:56:38.811 INFO:teuthology.orchestra.run.smithi008.stdout: "duration": 5.2101000000000001e-05 2023-08-01T19:56:38.811 INFO:teuthology.orchestra.run.smithi008.stdout: }, 2023-08-01T19:56:38.811 INFO:teuthology.orchestra.run.smithi008.stdout: { 2023-08-01T19:56:38.812 INFO:teuthology.orchestra.run.smithi008.stdout: "event": "waiting for peered", 2023-08-01T19:56:38.812 INFO:teuthology.orchestra.run.smithi008.stdout: "time": "2023-08-01T19:55:58.574299+0000", 2023-08-01T19:56:38.812 INFO:teuthology.orchestra.run.smithi008.stdout: "duration": 7.3420000000000002e-06 2023-08-01T19:56:38.812 INFO:teuthology.orchestra.run.smithi008.stdout: }, 2023-08-01T19:56:38.813 INFO:teuthology.orchestra.run.smithi008.stdout: { 2023-08-01T19:56:38.813 INFO:teuthology.orchestra.run.smithi008.stdout: "event": "reached_pg", 2023-08-01T19:56:38.813 INFO:teuthology.orchestra.run.smithi008.stdout: "time": "2023-08-01T19:55:59.618545+0000", 2023-08-01T19:56:38.813 INFO:teuthology.orchestra.run.smithi008.stdout: "duration": 1.044245922 2023-08-01T19:56:38.813 INFO:teuthology.orchestra.run.smithi008.stdout: }, 2023-08-01T19:56:38.813 INFO:teuthology.orchestra.run.smithi008.stdout: { 2023-08-01T19:56:38.814 INFO:teuthology.orchestra.run.smithi008.stdout: "event": "started", 2023-08-01T19:56:38.814 INFO:teuthology.orchestra.run.smithi008.stdout: "time": "2023-08-01T19:55:59.618855+0000", 2023-08-01T19:56:38.814 INFO:teuthology.orchestra.run.smithi008.stdout: "duration": 0.00030964099999999999 2023-08-01T19:56:38.814 INFO:teuthology.orchestra.run.smithi008.stdout: }, 2023-08-01T19:56:38.814 INFO:teuthology.orchestra.run.smithi008.stdout: { 2023-08-01T19:56:38.814 INFO:teuthology.orchestra.run.smithi008.stdout: "event": "op_commit", 2023-08-01T19:56:38.815 INFO:teuthology.orchestra.run.smithi008.stdout: "time": "2023-08-01T19:55:59.628438+0000", 2023-08-01T19:56:38.815 INFO:teuthology.orchestra.run.smithi008.stdout: "duration": 0.0095832939999999991 2023-08-01T19:56:38.815 INFO:teuthology.orchestra.run.smithi008.stdout: }, 2023-08-01T19:56:38.815 INFO:teuthology.orchestra.run.smithi008.stdout: { 2023-08-01T19:56:38.815 INFO:teuthology.orchestra.run.smithi008.stdout: "event": "commit_sent", 2023-08-01T19:56:38.815 INFO:teuthology.orchestra.run.smithi008.stdout: "time": "2023-08-01T19:55:59.628479+0000", 2023-08-01T19:56:38.815 INFO:teuthology.orchestra.run.smithi008.stdout: "duration": 4.1350000000000002e-05 2023-08-01T19:56:38.815 INFO:teuthology.orchestra.run.smithi008.stdout: }, 2023-08-01T19:56:38.816 INFO:teuthology.orchestra.run.smithi008.stdout: { 2023-08-01T19:56:38.816 INFO:teuthology.orchestra.run.smithi008.stdout: "event": "done", 2023-08-01T19:56:38.816 INFO:teuthology.orchestra.run.smithi008.stdout: "time": "2023-08-01T19:55:59.628560+0000", 2023-08-01T19:56:38.816 INFO:teuthology.orchestra.run.smithi008.stdout: "duration": 8.0080999999999994e-05 2023-08-01T19:56:38.816 INFO:teuthology.orchestra.run.smithi008.stdout: } 2023-08-01T19:56:38.816 INFO:teuthology.orchestra.run.smithi008.stdout: ] 2023-08-01T19:56:38.816 INFO:teuthology.orchestra.run.smithi008.stdout: } 2023-08-01T19:56:38.817 INFO:teuthology.orchestra.run.smithi008.stdout: }, 2023-08-01T19:56:38.817 INFO:teuthology.orchestra.run.smithi008.stdout: { 2023-08-01T19:56:38.817 INFO:teuthology.orchestra.run.smithi008.stdout: "description": "osd_op(client.4668.0:197415 5.c 5:3e539c01:::benchmark_data_smithi006_114134_object63754:head [delete] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e62)", 2023-08-01T19:56:38.817 INFO:teuthology.orchestra.run.smithi008.stdout: "initiated_at": "2023-08-01T19:55:58.577434+0000", 2023-08-01T19:56:38.817 INFO:teuthology.orchestra.run.smithi008.stdout: "age": 40.026572842999997, 2023-08-01T19:56:38.817 INFO:teuthology.orchestra.run.smithi008.stdout: "duration": 1.0520807059999999, 2023-08-01T19:56:38.817 INFO:teuthology.orchestra.run.smithi008.stdout: "type_data": { 2023-08-01T19:56:38.817 INFO:teuthology.orchestra.run.smithi008.stdout: "flag_point": "commit sent; apply or cleanup", 2023-08-01T19:56:38.818 INFO:teuthology.orchestra.run.smithi008.stdout: "client_info": { 2023-08-01T19:56:38.818 INFO:teuthology.orchestra.run.smithi008.stdout: "client": "client.4668", 2023-08-01T19:56:38.818 INFO:teuthology.orchestra.run.smithi008.stdout: "client_addr": "172.21.15.6:0/1709472247", 2023-08-01T19:56:38.818 INFO:teuthology.orchestra.run.smithi008.stdout: "tid": 197415 2023-08-01T19:56:38.818 INFO:teuthology.orchestra.run.smithi008.stdout: }, 2023-08-01T19:56:38.818 INFO:teuthology.orchestra.run.smithi008.stdout: "events": [ 2023-08-01T19:56:38.818 INFO:teuthology.orchestra.run.smithi008.stdout: { 2023-08-01T19:56:38.818 INFO:teuthology.orchestra.run.smithi008.stdout: "event": "initiated", 2023-08-01T19:56:38.819 INFO:teuthology.orchestra.run.smithi008.stdout: "time": "2023-08-01T19:55:58.577434+0000", 2023-08-01T19:56:38.819 INFO:teuthology.orchestra.run.smithi008.stdout: "duration": 0 2023-08-01T19:56:38.819 INFO:teuthology.orchestra.run.smithi008.stdout: }, 2023-08-01T19:56:38.819 INFO:teuthology.orchestra.run.smithi008.stdout: { 2023-08-01T19:56:38.819 INFO:teuthology.orchestra.run.smithi008.stdout: "event": "throttled", 2023-08-01T19:56:38.819 INFO:teuthology.orchestra.run.smithi008.stdout: "time": "2023-08-01T19:55:58.577434+0000", 2023-08-01T19:56:38.819 INFO:teuthology.orchestra.run.smithi008.stdout: "duration": 0 2023-08-01T19:56:38.820 INFO:teuthology.orchestra.run.smithi008.stdout: }, 2023-08-01T19:56:38.820 INFO:teuthology.orchestra.run.smithi008.stdout: { 2023-08-01T19:56:38.820 INFO:teuthology.orchestra.run.smithi008.stdout: "event": "header_read", 2023-08-01T19:56:38.820 INFO:teuthology.orchestra.run.smithi008.stdout: "time": "2023-08-01T19:55:58.577432+0000", 2023-08-01T19:56:38.820 INFO:teuthology.orchestra.run.smithi008.stdout: "duration": 4294967295.9999986 2023-08-01T19:56:38.820 INFO:teuthology.orchestra.run.smithi008.stdout: }, 2023-08-01T19:56:38.820 INFO:teuthology.orchestra.run.smithi008.stdout: { 2023-08-01T19:56:38.821 INFO:teuthology.orchestra.run.smithi008.stdout: "event": "all_read", 2023-08-01T19:56:38.821 INFO:teuthology.orchestra.run.smithi008.stdout: "time": "2023-08-01T19:55:58.577440+0000", 2023-08-01T19:56:38.821 INFO:teuthology.orchestra.run.smithi008.stdout: "duration": 7.5480000000000004e-06 2023-08-01T19:56:38.821 INFO:teuthology.orchestra.run.smithi008.stdout: }, 2023-08-01T19:56:38.821 INFO:teuthology.orchestra.run.smithi008.stdout: { 2023-08-01T19:56:38.821 INFO:teuthology.orchestra.run.smithi008.stdout: "event": "dispatched", 2023-08-01T19:56:38.821 INFO:teuthology.orchestra.run.smithi008.stdout: "time": "2023-08-01T19:55:58.577454+0000", 2023-08-01T19:56:38.822 INFO:teuthology.orchestra.run.smithi008.stdout: "duration": 1.4216000000000001e-05 2023-08-01T19:56:38.822 INFO:teuthology.orchestra.run.smithi008.stdout: }, 2023-08-01T19:56:38.822 INFO:teuthology.orchestra.run.smithi008.stdout: { 2023-08-01T19:56:38.822 INFO:teuthology.orchestra.run.smithi008.stdout: "event": "queued_for_pg", 2023-08-01T19:56:38.822 INFO:teuthology.orchestra.run.smithi008.stdout: "time": "2023-08-01T19:55:58.577463+0000", 2023-08-01T19:56:38.822 INFO:teuthology.orchestra.run.smithi008.stdout: "duration": 8.2900000000000002e-06 2023-08-01T19:56:38.822 INFO:teuthology.orchestra.run.smithi008.stdout: }, 2023-08-01T19:56:38.822 INFO:teuthology.orchestra.run.smithi008.stdout: { 2023-08-01T19:56:38.823 INFO:teuthology.orchestra.run.smithi008.stdout: "event": "reached_pg", 2023-08-01T19:56:38.823 INFO:teuthology.orchestra.run.smithi008.stdout: "time": "2023-08-01T19:55:58.577498+0000", 2023-08-01T19:56:38.823 INFO:teuthology.orchestra.run.smithi008.stdout: "duration": 3.5302000000000002e-05 2023-08-01T19:56:38.823 INFO:teuthology.orchestra.run.smithi008.stdout: }, 2023-08-01T19:56:38.823 INFO:teuthology.orchestra.run.smithi008.stdout: { 2023-08-01T19:56:38.823 INFO:teuthology.orchestra.run.smithi008.stdout: "event": "waiting for peered", 2023-08-01T19:56:38.823 INFO:teuthology.orchestra.run.smithi008.stdout: "time": "2023-08-01T19:55:58.577503+0000", 2023-08-01T19:56:38.824 INFO:teuthology.orchestra.run.smithi008.stdout: "duration": 4.8409999999999999e-06 2023-08-01T19:56:38.824 INFO:teuthology.orchestra.run.smithi008.stdout: }, 2023-08-01T19:56:38.824 INFO:teuthology.orchestra.run.smithi008.stdout: { 2023-08-01T19:56:38.824 INFO:teuthology.orchestra.run.smithi008.stdout: "event": "reached_pg", 2023-08-01T19:56:38.824 INFO:teuthology.orchestra.run.smithi008.stdout: "time": "2023-08-01T19:55:59.619229+0000", 2023-08-01T19:56:38.824 INFO:teuthology.orchestra.run.smithi008.stdout: "duration": 1.041726119 2023-08-01T19:56:38.824 INFO:teuthology.orchestra.run.smithi008.stdout: }, 2023-08-01T19:56:38.825 INFO:teuthology.orchestra.run.smithi008.stdout: { 2023-08-01T19:56:38.825 INFO:teuthology.orchestra.run.smithi008.stdout: "event": "started", 2023-08-01T19:56:38.825 INFO:teuthology.orchestra.run.smithi008.stdout: "time": "2023-08-01T19:55:59.619326+0000", 2023-08-01T19:56:38.825 INFO:teuthology.orchestra.run.smithi008.stdout: "duration": 9.7044000000000001e-05 2023-08-01T19:56:38.825 INFO:teuthology.orchestra.run.smithi008.stdout: }, 2023-08-01T19:56:38.825 INFO:teuthology.orchestra.run.smithi008.stdout: { 2023-08-01T19:56:38.825 INFO:teuthology.orchestra.run.smithi008.stdout: "event": "op_commit", 2023-08-01T19:56:38.825 INFO:teuthology.orchestra.run.smithi008.stdout: "time": "2023-08-01T19:55:59.629399+0000", 2023-08-01T19:56:38.826 INFO:teuthology.orchestra.run.smithi008.stdout: "duration": 0.010073014 2023-08-01T19:56:38.826 INFO:teuthology.orchestra.run.smithi008.stdout: }, 2023-08-01T19:56:38.826 INFO:teuthology.orchestra.run.smithi008.stdout: { 2023-08-01T19:56:38.826 INFO:teuthology.orchestra.run.smithi008.stdout: "event": "commit_sent", 2023-08-01T19:56:38.826 INFO:teuthology.orchestra.run.smithi008.stdout: "time": "2023-08-01T19:55:59.629443+0000", 2023-08-01T19:56:38.826 INFO:teuthology.orchestra.run.smithi008.stdout: "duration": 4.3739999999999998e-05 2023-08-01T19:56:38.826 INFO:teuthology.orchestra.run.smithi008.stdout: }, 2023-08-01T19:56:38.826 INFO:teuthology.orchestra.run.smithi008.stdout: { 2023-08-01T19:56:38.827 INFO:teuthology.orchestra.run.smithi008.stdout: "event": "done", 2023-08-01T19:56:38.827 INFO:teuthology.orchestra.run.smithi008.stdout: "time": "2023-08-01T19:55:59.629515+0000", 2023-08-01T19:56:38.827 INFO:teuthology.orchestra.run.smithi008.stdout: "duration": 7.2089999999999996e-05 2023-08-01T19:56:38.827 INFO:teuthology.orchestra.run.smithi008.stdout: } 2023-08-01T19:56:38.827 INFO:teuthology.orchestra.run.smithi008.stdout: ] 2023-08-01T19:56:38.827 INFO:teuthology.orchestra.run.smithi008.stdout: } 2023-08-01T19:56:38.827 INFO:teuthology.orchestra.run.smithi008.stdout: }, 2023-08-01T19:56:38.827 INFO:teuthology.orchestra.run.smithi008.stdout: { 2023-08-01T19:56:38.828 INFO:teuthology.orchestra.run.smithi008.stdout: "description": "osd_op(client.4668.0:197417 5.7 5:eb36cb7d:::benchmark_data_smithi006_114134_object63756:head [delete] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e62)", 2023-08-01T19:56:38.828 INFO:teuthology.orchestra.run.smithi008.stdout: "initiated_at": "2023-08-01T19:55:58.578162+0000", 2023-08-01T19:56:38.828 INFO:teuthology.orchestra.run.smithi008.stdout: "age": 40.025844546000002, 2023-08-01T19:56:38.828 INFO:teuthology.orchestra.run.smithi008.stdout: "duration": 1.0582469299999999, 2023-08-01T19:56:38.828 INFO:teuthology.orchestra.run.smithi008.stdout: "type_data": { 2023-08-01T19:56:38.828 INFO:teuthology.orchestra.run.smithi008.stdout: "flag_point": "commit sent; apply or cleanup", 2023-08-01T19:56:38.828 INFO:teuthology.orchestra.run.smithi008.stdout: "client_info": { 2023-08-01T19:56:38.829 INFO:teuthology.orchestra.run.smithi008.stdout: "client": "client.4668", 2023-08-01T19:56:38.829 INFO:teuthology.orchestra.run.smithi008.stdout: "client_addr": "172.21.15.6:0/1709472247", 2023-08-01T19:56:38.829 INFO:teuthology.orchestra.run.smithi008.stdout: "tid": 197417 2023-08-01T19:56:38.829 INFO:teuthology.orchestra.run.smithi008.stdout: }, 2023-08-01T19:56:38.829 INFO:teuthology.orchestra.run.smithi008.stdout: "events": [ 2023-08-01T19:56:38.829 INFO:teuthology.orchestra.run.smithi008.stdout: { 2023-08-01T19:56:38.829 INFO:teuthology.orchestra.run.smithi008.stdout: "event": "initiated", 2023-08-01T19:56:38.830 INFO:teuthology.orchestra.run.smithi008.stdout: "time": "2023-08-01T19:55:58.578162+0000", 2023-08-01T19:56:38.830 INFO:teuthology.orchestra.run.smithi008.stdout: "duration": 0 2023-08-01T19:56:38.830 INFO:teuthology.orchestra.run.smithi008.stdout: }, 2023-08-01T19:56:38.830 INFO:teuthology.orchestra.run.smithi008.stdout: { 2023-08-01T19:56:38.830 INFO:teuthology.orchestra.run.smithi008.stdout: "event": "throttled", 2023-08-01T19:56:38.830 INFO:teuthology.orchestra.run.smithi008.stdout: "time": "2023-08-01T19:55:58.578162+0000", 2023-08-01T19:56:38.830 INFO:teuthology.orchestra.run.smithi008.stdout: "duration": 0 2023-08-01T19:56:38.830 INFO:teuthology.orchestra.run.smithi008.stdout: }, 2023-08-01T19:56:38.831 INFO:teuthology.orchestra.run.smithi008.stdout: { 2023-08-01T19:56:38.831 INFO:teuthology.orchestra.run.smithi008.stdout: "event": "header_read", 2023-08-01T19:56:38.831 INFO:teuthology.orchestra.run.smithi008.stdout: "time": "2023-08-01T19:55:58.578161+0000", 2023-08-01T19:56:38.831 INFO:teuthology.orchestra.run.smithi008.stdout: "duration": 4294967295.999999 2023-08-01T19:56:38.831 INFO:teuthology.orchestra.run.smithi008.stdout: }, 2023-08-01T19:56:38.831 INFO:teuthology.orchestra.run.smithi008.stdout: { 2023-08-01T19:56:38.831 INFO:teuthology.orchestra.run.smithi008.stdout: "event": "all_read", 2023-08-01T19:56:38.831 INFO:teuthology.orchestra.run.smithi008.stdout: "time": "2023-08-01T19:55:58.578166+0000", 2023-08-01T19:56:38.832 INFO:teuthology.orchestra.run.smithi008.stdout: "duration": 4.6589999999999998e-06 2023-08-01T19:56:38.832 INFO:teuthology.orchestra.run.smithi008.stdout: }, 2023-08-01T19:56:38.832 INFO:teuthology.orchestra.run.smithi008.stdout: { 2023-08-01T19:56:38.832 INFO:teuthology.orchestra.run.smithi008.stdout: "event": "dispatched", 2023-08-01T19:56:38.832 INFO:teuthology.orchestra.run.smithi008.stdout: "time": "2023-08-01T19:55:58.578177+0000", 2023-08-01T19:56:38.832 INFO:teuthology.orchestra.run.smithi008.stdout: "duration": 1.0512e-05 2023-08-01T19:56:38.832 INFO:teuthology.orchestra.run.smithi008.stdout: }, 2023-08-01T19:56:38.833 INFO:teuthology.orchestra.run.smithi008.stdout: { 2023-08-01T19:56:38.833 INFO:teuthology.orchestra.run.smithi008.stdout: "event": "queued_for_pg", 2023-08-01T19:56:38.833 INFO:teuthology.orchestra.run.smithi008.stdout: "time": "2023-08-01T19:55:58.578182+0000", 2023-08-01T19:56:38.833 INFO:teuthology.orchestra.run.smithi008.stdout: "duration": 5.6540000000000004e-06 2023-08-01T19:56:38.833 INFO:teuthology.orchestra.run.smithi008.stdout: }, 2023-08-01T19:56:38.833 INFO:teuthology.orchestra.run.smithi008.stdout: { 2023-08-01T19:56:38.833 INFO:teuthology.orchestra.run.smithi008.stdout: "event": "reached_pg", 2023-08-01T19:56:38.833 INFO:teuthology.orchestra.run.smithi008.stdout: "time": "2023-08-01T19:55:58.578221+0000", 2023-08-01T19:56:38.834 INFO:teuthology.orchestra.run.smithi008.stdout: "duration": 3.8764999999999999e-05 2023-08-01T19:56:38.834 INFO:teuthology.orchestra.run.smithi008.stdout: }, 2023-08-01T19:56:38.834 INFO:teuthology.orchestra.run.smithi008.stdout: { 2023-08-01T19:56:38.834 INFO:teuthology.orchestra.run.smithi008.stdout: "event": "waiting for peered", 2023-08-01T19:56:38.834 INFO:teuthology.orchestra.run.smithi008.stdout: "time": "2023-08-01T19:55:58.578226+0000", 2023-08-01T19:56:38.834 INFO:teuthology.orchestra.run.smithi008.stdout: "duration": 4.6319999999999999e-06 2023-08-01T19:56:38.834 INFO:teuthology.orchestra.run.smithi008.stdout: }, 2023-08-01T19:56:38.834 INFO:teuthology.orchestra.run.smithi008.stdout: { 2023-08-01T19:56:38.835 INFO:teuthology.orchestra.run.smithi008.stdout: "event": "reached_pg", 2023-08-01T19:56:38.835 INFO:teuthology.orchestra.run.smithi008.stdout: "time": "2023-08-01T19:55:59.628027+0000", 2023-08-01T19:56:38.835 INFO:teuthology.orchestra.run.smithi008.stdout: "duration": 1.049801261 2023-08-01T19:56:38.835 INFO:teuthology.orchestra.run.smithi008.stdout: }, 2023-08-01T19:56:38.835 INFO:teuthology.orchestra.run.smithi008.stdout: { 2023-08-01T19:56:38.835 INFO:teuthology.orchestra.run.smithi008.stdout: "event": "started", 2023-08-01T19:56:38.835 INFO:teuthology.orchestra.run.smithi008.stdout: "time": "2023-08-01T19:55:59.628156+0000", 2023-08-01T19:56:38.836 INFO:teuthology.orchestra.run.smithi008.stdout: "duration": 0.00012906899999999999 2023-08-01T19:56:38.836 INFO:teuthology.orchestra.run.smithi008.stdout: }, 2023-08-01T19:56:38.836 INFO:teuthology.orchestra.run.smithi008.stdout: { 2023-08-01T19:56:38.836 INFO:teuthology.orchestra.run.smithi008.stdout: "event": "op_commit", 2023-08-01T19:56:38.836 INFO:teuthology.orchestra.run.smithi008.stdout: "time": "2023-08-01T19:55:59.636292+0000", 2023-08-01T19:56:38.836 INFO:teuthology.orchestra.run.smithi008.stdout: "duration": 0.0081362859999999995 2023-08-01T19:56:38.836 INFO:teuthology.orchestra.run.smithi008.stdout: }, 2023-08-01T19:56:38.836 INFO:teuthology.orchestra.run.smithi008.stdout: { 2023-08-01T19:56:38.837 INFO:teuthology.orchestra.run.smithi008.stdout: "event": "commit_sent", 2023-08-01T19:56:38.837 INFO:teuthology.orchestra.run.smithi008.stdout: "time": "2023-08-01T19:55:59.636343+0000", 2023-08-01T19:56:38.837 INFO:teuthology.orchestra.run.smithi008.stdout: "duration": 5.0603000000000003e-05 2023-08-01T19:56:38.837 INFO:teuthology.orchestra.run.smithi008.stdout: }, 2023-08-01T19:56:38.837 INFO:teuthology.orchestra.run.smithi008.stdout: { 2023-08-01T19:56:38.837 INFO:teuthology.orchestra.run.smithi008.stdout: "event": "done", 2023-08-01T19:56:38.837 INFO:teuthology.orchestra.run.smithi008.stdout: "time": "2023-08-01T19:55:59.636409+0000", 2023-08-01T19:56:38.837 INFO:teuthology.orchestra.run.smithi008.stdout: "duration": 6.6353999999999995e-05 2023-08-01T19:56:38.838 INFO:teuthology.orchestra.run.smithi008.stdout: } 2023-08-01T19:56:38.838 INFO:teuthology.orchestra.run.smithi008.stdout: ] 2023-08-01T19:56:38.838 INFO:teuthology.orchestra.run.smithi008.stdout: } 2023-08-01T19:56:38.838 INFO:teuthology.orchestra.run.smithi008.stdout: }, 2023-08-01T19:56:38.838 INFO:teuthology.orchestra.run.smithi008.stdout: { 2023-08-01T19:56:38.838 INFO:teuthology.orchestra.run.smithi008.stdout: "description": "osd_op(client.4668.0:197418 5.2 5:4ba84ab7:::benchmark_data_smithi006_114134_object63757:head [delete] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e62)", 2023-08-01T19:56:38.838 INFO:teuthology.orchestra.run.smithi008.stdout: "initiated_at": "2023-08-01T19:55:58.580297+0000", 2023-08-01T19:56:38.839 INFO:teuthology.orchestra.run.smithi008.stdout: "age": 40.023710192999999, 2023-08-01T19:56:38.839 INFO:teuthology.orchestra.run.smithi008.stdout: "duration": 1.0529485839999999, 2023-08-01T19:56:38.839 INFO:teuthology.orchestra.run.smithi008.stdout: "type_data": { 2023-08-01T19:56:38.839 INFO:teuthology.orchestra.run.smithi008.stdout: "flag_point": "commit sent; apply or cleanup", 2023-08-01T19:56:38.839 INFO:teuthology.orchestra.run.smithi008.stdout: "client_info": { 2023-08-01T19:56:38.839 INFO:teuthology.orchestra.run.smithi008.stdout: "client": "client.4668", 2023-08-01T19:56:38.839 INFO:teuthology.orchestra.run.smithi008.stdout: "client_addr": "172.21.15.6:0/1709472247", 2023-08-01T19:56:38.840 INFO:teuthology.orchestra.run.smithi008.stdout: "tid": 197418 2023-08-01T19:56:38.840 INFO:teuthology.orchestra.run.smithi008.stdout: }, 2023-08-01T19:56:38.840 INFO:teuthology.orchestra.run.smithi008.stdout: "events": [ 2023-08-01T19:56:38.840 INFO:teuthology.orchestra.run.smithi008.stdout: { 2023-08-01T19:56:38.840 INFO:teuthology.orchestra.run.smithi008.stdout: "event": "initiated", 2023-08-01T19:56:38.840 INFO:teuthology.orchestra.run.smithi008.stdout: "time": "2023-08-01T19:55:58.580297+0000", 2023-08-01T19:56:38.840 INFO:teuthology.orchestra.run.smithi008.stdout: "duration": 0 2023-08-01T19:56:38.840 INFO:teuthology.orchestra.run.smithi008.stdout: }, 2023-08-01T19:56:38.841 INFO:teuthology.orchestra.run.smithi008.stdout: { 2023-08-01T19:56:38.841 INFO:teuthology.orchestra.run.smithi008.stdout: "event": "throttled", 2023-08-01T19:56:38.841 INFO:teuthology.orchestra.run.smithi008.stdout: "time": "2023-08-01T19:55:58.580297+0000", 2023-08-01T19:56:38.841 INFO:teuthology.orchestra.run.smithi008.stdout: "duration": 0 2023-08-01T19:56:38.841 INFO:teuthology.orchestra.run.smithi008.stdout: }, 2023-08-01T19:56:38.841 INFO:teuthology.orchestra.run.smithi008.stdout: { 2023-08-01T19:56:38.842 INFO:teuthology.orchestra.run.smithi008.stdout: "event": "header_read", 2023-08-01T19:56:38.842 INFO:teuthology.orchestra.run.smithi008.stdout: "time": "2023-08-01T19:55:58.580296+0000", 2023-08-01T19:56:38.842 INFO:teuthology.orchestra.run.smithi008.stdout: "duration": 4294967295.999999 2023-08-01T19:56:38.842 INFO:teuthology.orchestra.run.smithi008.stdout: }, 2023-08-01T19:56:38.842 INFO:teuthology.orchestra.run.smithi008.stdout: { 2023-08-01T19:56:38.842 INFO:teuthology.orchestra.run.smithi008.stdout: "event": "all_read", 2023-08-01T19:56:38.842 INFO:teuthology.orchestra.run.smithi008.stdout: "time": "2023-08-01T19:55:58.580302+0000", 2023-08-01T19:56:38.843 INFO:teuthology.orchestra.run.smithi008.stdout: "duration": 6.032e-06 2023-08-01T19:56:38.843 INFO:teuthology.orchestra.run.smithi008.stdout: }, 2023-08-01T19:56:38.843 INFO:teuthology.orchestra.run.smithi008.stdout: { 2023-08-01T19:56:38.843 INFO:teuthology.orchestra.run.smithi008.stdout: "event": "dispatched", 2023-08-01T19:56:38.843 INFO:teuthology.orchestra.run.smithi008.stdout: "time": "2023-08-01T19:55:58.580315+0000", 2023-08-01T19:56:38.843 INFO:teuthology.orchestra.run.smithi008.stdout: "duration": 1.327e-05 2023-08-01T19:56:38.843 INFO:teuthology.orchestra.run.smithi008.stdout: }, 2023-08-01T19:56:38.844 INFO:teuthology.orchestra.run.smithi008.stdout: { 2023-08-01T19:56:38.844 INFO:teuthology.orchestra.run.smithi008.stdout: "event": "queued_for_pg", 2023-08-01T19:56:38.844 INFO:teuthology.orchestra.run.smithi008.stdout: "time": "2023-08-01T19:55:58.580321+0000", 2023-08-01T19:56:38.844 INFO:teuthology.orchestra.run.smithi008.stdout: "duration": 6.3980000000000004e-06 2023-08-01T19:56:38.844 INFO:teuthology.orchestra.run.smithi008.stdout: }, 2023-08-01T19:56:38.844 INFO:teuthology.orchestra.run.smithi008.stdout: { 2023-08-01T19:56:38.844 INFO:teuthology.orchestra.run.smithi008.stdout: "event": "reached_pg", 2023-08-01T19:56:38.844 INFO:teuthology.orchestra.run.smithi008.stdout: "time": "2023-08-01T19:55:58.580372+0000", 2023-08-01T19:56:38.845 INFO:teuthology.orchestra.run.smithi008.stdout: "duration": 5.0219000000000001e-05 2023-08-01T19:56:38.845 INFO:teuthology.orchestra.run.smithi008.stdout: }, 2023-08-01T19:56:38.845 INFO:teuthology.orchestra.run.smithi008.stdout: { 2023-08-01T19:56:38.845 INFO:teuthology.orchestra.run.smithi008.stdout: "event": "waiting for peered", 2023-08-01T19:56:38.845 INFO:teuthology.orchestra.run.smithi008.stdout: "time": "2023-08-01T19:55:58.580378+0000", 2023-08-01T19:56:38.845 INFO:teuthology.orchestra.run.smithi008.stdout: "duration": 6.6529999999999997e-06 2023-08-01T19:56:38.845 INFO:teuthology.orchestra.run.smithi008.stdout: }, 2023-08-01T19:56:38.845 INFO:teuthology.orchestra.run.smithi008.stdout: { 2023-08-01T19:56:38.846 INFO:teuthology.orchestra.run.smithi008.stdout: "event": "reached_pg", 2023-08-01T19:56:38.846 INFO:teuthology.orchestra.run.smithi008.stdout: "time": "2023-08-01T19:55:59.618188+0000", 2023-08-01T19:56:38.846 INFO:teuthology.orchestra.run.smithi008.stdout: "duration": 1.037810267 2023-08-01T19:56:38.846 INFO:teuthology.orchestra.run.smithi008.stdout: }, 2023-08-01T19:56:38.846 INFO:teuthology.orchestra.run.smithi008.stdout: { 2023-08-01T19:56:38.846 INFO:teuthology.orchestra.run.smithi008.stdout: "event": "started", 2023-08-01T19:56:38.846 INFO:teuthology.orchestra.run.smithi008.stdout: "time": "2023-08-01T19:55:59.618308+0000", 2023-08-01T19:56:38.846 INFO:teuthology.orchestra.run.smithi008.stdout: "duration": 0.00011959 2023-08-01T19:56:38.847 INFO:teuthology.orchestra.run.smithi008.stdout: }, 2023-08-01T19:56:38.847 INFO:teuthology.orchestra.run.smithi008.stdout: { 2023-08-01T19:56:38.847 INFO:teuthology.orchestra.run.smithi008.stdout: "event": "op_commit", 2023-08-01T19:56:38.847 INFO:teuthology.orchestra.run.smithi008.stdout: "time": "2023-08-01T19:55:59.633122+0000", 2023-08-01T19:56:38.847 INFO:teuthology.orchestra.run.smithi008.stdout: "duration": 0.014814280000000001 2023-08-01T19:56:38.847 INFO:teuthology.orchestra.run.smithi008.stdout: }, 2023-08-01T19:56:38.847 INFO:teuthology.orchestra.run.smithi008.stdout: { 2023-08-01T19:56:38.848 INFO:teuthology.orchestra.run.smithi008.stdout: "event": "commit_sent", 2023-08-01T19:56:38.848 INFO:teuthology.orchestra.run.smithi008.stdout: "time": "2023-08-01T19:55:59.633167+0000", 2023-08-01T19:56:38.848 INFO:teuthology.orchestra.run.smithi008.stdout: "duration": 4.4651999999999999e-05 2023-08-01T19:56:38.848 INFO:teuthology.orchestra.run.smithi008.stdout: }, 2023-08-01T19:56:38.848 INFO:teuthology.orchestra.run.smithi008.stdout: { 2023-08-01T19:56:38.848 INFO:teuthology.orchestra.run.smithi008.stdout: "event": "done", 2023-08-01T19:56:38.848 INFO:teuthology.orchestra.run.smithi008.stdout: "time": "2023-08-01T19:55:59.633245+0000", 2023-08-01T19:56:38.848 INFO:teuthology.orchestra.run.smithi008.stdout: "duration": 7.8215999999999998e-05 2023-08-01T19:56:38.849 INFO:teuthology.orchestra.run.smithi008.stdout: } 2023-08-01T19:56:38.849 INFO:teuthology.orchestra.run.smithi008.stdout: ] 2023-08-01T19:56:38.849 INFO:teuthology.orchestra.run.smithi008.stdout: } 2023-08-01T19:56:38.849 INFO:teuthology.orchestra.run.smithi008.stdout: } 2023-08-01T19:56:38.849 INFO:teuthology.orchestra.run.smithi008.stdout: ] 2023-08-01T19:56:38.849 INFO:teuthology.orchestra.run.smithi008.stdout:} 2023-08-01T19:56:38.850 DEBUG:teuthology.orchestra.run.smithi155:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 30 ceph --cluster ceph --admin-daemon /var/run/ceph/ceph-osd.2.asok dump_ops_in_flight 2023-08-01T19:56:38.851 INFO:tasks.ceph.osd.0.smithi008.stderr:2023-08-01T19:56:38.849+0000 7f16a58f4700 -1 received signal: Hangup from /usr/bin/python3 /bin/daemon-helper kill ceph-osd -f --cluster ceph -i 0 (PID: 111179) UID: 0 2023-08-01T19:56:38.951 INFO:tasks.ceph.osd.2.smithi155.stderr:2023-08-01T19:56:38.949+0000 7faa5c6ac700 -1 received signal: Hangup from /usr/bin/python3 /bin/daemon-helper kill ceph-osd -f --cluster ceph -i 2 (PID: 111337) UID: 0 2023-08-01T19:56:38.983 INFO:teuthology.orchestra.run.smithi155.stdout:{ 2023-08-01T19:56:38.983 INFO:teuthology.orchestra.run.smithi155.stdout: "ops": [], 2023-08-01T19:56:38.983 INFO:teuthology.orchestra.run.smithi155.stdout: "num_ops": 0 2023-08-01T19:56:38.984 INFO:teuthology.orchestra.run.smithi155.stdout:} 2023-08-01T19:56:38.993 DEBUG:teuthology.orchestra.run.smithi155:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 30 ceph --cluster ceph --admin-daemon /var/run/ceph/ceph-osd.2.asok dump_blocked_ops 2023-08-01T19:56:39.051 INFO:tasks.ceph.osd.0.smithi008.stderr:2023-08-01T19:56:39.051+0000 7f16a58f4700 -1 received signal: Hangup from /usr/bin/python3 /bin/daemon-helper kill ceph-osd -f --cluster ceph -i 0 (PID: 111179) UID: 0 2023-08-01T19:56:39.152 INFO:tasks.ceph.osd.0.smithi008.stderr:2023-08-01T19:56:39.151+0000 7f16a58f4700 -1 received signal: Hangup from /usr/bin/python3 /bin/daemon-helper kill ceph-osd -f --cluster ceph -i 0 (PID: 111179) UID: 0 2023-08-01T19:56:39.157 INFO:teuthology.orchestra.run.smithi155.stdout:{ 2023-08-01T19:56:39.157 INFO:teuthology.orchestra.run.smithi155.stdout: "ops": [], 2023-08-01T19:56:39.157 INFO:teuthology.orchestra.run.smithi155.stdout: "complaint_time": 30, 2023-08-01T19:56:39.157 INFO:teuthology.orchestra.run.smithi155.stdout: "num_blocked_ops": 0 2023-08-01T19:56:39.157 INFO:teuthology.orchestra.run.smithi155.stdout:} 2023-08-01T19:56:39.166 DEBUG:teuthology.orchestra.run.smithi155:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 30 ceph --cluster ceph --admin-daemon /var/run/ceph/ceph-osd.2.asok dump_historic_ops 2023-08-01T19:56:39.252 INFO:tasks.daemonwatchdog.daemon_watchdog:daemon ceph.osd.1 is failed for ~35s 2023-08-01T19:56:39.253 INFO:tasks.ceph.osd.0.smithi008.stderr:2023-08-01T19:56:39.252+0000 7f16a58f4700 -1 received signal: Hangup from /usr/bin/python3 /bin/daemon-helper kill ceph-osd -f --cluster ceph -i 0 (PID: 111179) UID: 0 2023-08-01T19:56:39.291 INFO:teuthology.orchestra.run.smithi155.stdout:{ 2023-08-01T19:56:39.292 INFO:teuthology.orchestra.run.smithi155.stdout: "size": 20, 2023-08-01T19:56:39.292 INFO:teuthology.orchestra.run.smithi155.stdout: "duration": 600, 2023-08-01T19:56:39.292 INFO:teuthology.orchestra.run.smithi155.stdout: "ops": [ 2023-08-01T19:56:39.292 INFO:teuthology.orchestra.run.smithi155.stdout: { 2023-08-01T19:56:39.292 INFO:teuthology.orchestra.run.smithi155.stdout: "description": "osd_op(client.4668.0:100237 5.4 5:2d68bec9:::benchmark_data_smithi006_114134_object100236:head [set-alloc-hint object_size 65536 write_size 65536,write 0~65536] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e37)", 2023-08-01T19:56:39.292 INFO:teuthology.orchestra.run.smithi155.stdout: "initiated_at": "2023-08-01T19:55:05.147736+0000", 2023-08-01T19:56:39.293 INFO:teuthology.orchestra.run.smithi155.stdout: "age": 94.141703679000003, 2023-08-01T19:56:39.293 INFO:teuthology.orchestra.run.smithi155.stdout: "duration": 0.071299464000000007, 2023-08-01T19:56:39.293 INFO:teuthology.orchestra.run.smithi155.stdout: "type_data": { 2023-08-01T19:56:39.293 INFO:teuthology.orchestra.run.smithi155.stdout: "flag_point": "commit sent; apply or cleanup", 2023-08-01T19:56:39.293 INFO:teuthology.orchestra.run.smithi155.stdout: "client_info": { 2023-08-01T19:56:39.293 INFO:teuthology.orchestra.run.smithi155.stdout: "client": "client.4668", 2023-08-01T19:56:39.293 INFO:teuthology.orchestra.run.smithi155.stdout: "client_addr": "172.21.15.6:0/1709472247", 2023-08-01T19:56:39.294 INFO:teuthology.orchestra.run.smithi155.stdout: "tid": 100237 2023-08-01T19:56:39.294 INFO:teuthology.orchestra.run.smithi155.stdout: }, 2023-08-01T19:56:39.294 INFO:teuthology.orchestra.run.smithi155.stdout: "events": [ 2023-08-01T19:56:39.294 INFO:teuthology.orchestra.run.smithi155.stdout: { 2023-08-01T19:56:39.294 INFO:teuthology.orchestra.run.smithi155.stdout: "event": "initiated", 2023-08-01T19:56:39.294 INFO:teuthology.orchestra.run.smithi155.stdout: "time": "2023-08-01T19:55:05.147736+0000", 2023-08-01T19:56:39.294 INFO:teuthology.orchestra.run.smithi155.stdout: "duration": 0 2023-08-01T19:56:39.295 INFO:teuthology.orchestra.run.smithi155.stdout: }, 2023-08-01T19:56:39.295 INFO:teuthology.orchestra.run.smithi155.stdout: { 2023-08-01T19:56:39.295 INFO:teuthology.orchestra.run.smithi155.stdout: "event": "throttled", 2023-08-01T19:56:39.295 INFO:teuthology.orchestra.run.smithi155.stdout: "time": "2023-08-01T19:55:05.147736+0000", 2023-08-01T19:56:39.295 INFO:teuthology.orchestra.run.smithi155.stdout: "duration": 0 2023-08-01T19:56:39.295 INFO:teuthology.orchestra.run.smithi155.stdout: }, 2023-08-01T19:56:39.295 INFO:teuthology.orchestra.run.smithi155.stdout: { 2023-08-01T19:56:39.295 INFO:teuthology.orchestra.run.smithi155.stdout: "event": "header_read", 2023-08-01T19:56:39.296 INFO:teuthology.orchestra.run.smithi155.stdout: "time": "2023-08-01T19:55:05.147736+0000", 2023-08-01T19:56:39.296 INFO:teuthology.orchestra.run.smithi155.stdout: "duration": 4294967295.9999995 2023-08-01T19:56:39.296 INFO:teuthology.orchestra.run.smithi155.stdout: }, 2023-08-01T19:56:39.296 INFO:teuthology.orchestra.run.smithi155.stdout: { 2023-08-01T19:56:39.296 INFO:teuthology.orchestra.run.smithi155.stdout: "event": "all_read", 2023-08-01T19:56:39.296 INFO:teuthology.orchestra.run.smithi155.stdout: "time": "2023-08-01T19:55:05.147766+0000", 2023-08-01T19:56:39.296 INFO:teuthology.orchestra.run.smithi155.stdout: "duration": 3.0394000000000001e-05 2023-08-01T19:56:39.297 INFO:teuthology.orchestra.run.smithi155.stdout: }, 2023-08-01T19:56:39.297 INFO:teuthology.orchestra.run.smithi155.stdout: { 2023-08-01T19:56:39.297 INFO:teuthology.orchestra.run.smithi155.stdout: "event": "dispatched", 2023-08-01T19:56:39.297 INFO:teuthology.orchestra.run.smithi155.stdout: "time": "2023-08-01T19:55:05.147771+0000", 2023-08-01T19:56:39.297 INFO:teuthology.orchestra.run.smithi155.stdout: "duration": 4.25e-06 2023-08-01T19:56:39.297 INFO:teuthology.orchestra.run.smithi155.stdout: }, 2023-08-01T19:56:39.297 INFO:teuthology.orchestra.run.smithi155.stdout: { 2023-08-01T19:56:39.297 INFO:teuthology.orchestra.run.smithi155.stdout: "event": "queued_for_pg", 2023-08-01T19:56:39.298 INFO:teuthology.orchestra.run.smithi155.stdout: "time": "2023-08-01T19:55:05.147773+0000", 2023-08-01T19:56:39.298 INFO:teuthology.orchestra.run.smithi155.stdout: "duration": 2.4159999999999998e-06 2023-08-01T19:56:39.298 INFO:teuthology.orchestra.run.smithi155.stdout: }, 2023-08-01T19:56:39.298 INFO:teuthology.orchestra.run.smithi155.stdout: { 2023-08-01T19:56:39.298 INFO:teuthology.orchestra.run.smithi155.stdout: "event": "reached_pg", 2023-08-01T19:56:39.298 INFO:teuthology.orchestra.run.smithi155.stdout: "time": "2023-08-01T19:55:05.149903+0000", 2023-08-01T19:56:39.298 INFO:teuthology.orchestra.run.smithi155.stdout: "duration": 0.002129948 2023-08-01T19:56:39.299 INFO:teuthology.orchestra.run.smithi155.stdout: }, 2023-08-01T19:56:39.299 INFO:teuthology.orchestra.run.smithi155.stdout: { 2023-08-01T19:56:39.299 INFO:teuthology.orchestra.run.smithi155.stdout: "event": "started", 2023-08-01T19:56:39.299 INFO:teuthology.orchestra.run.smithi155.stdout: "time": "2023-08-01T19:55:05.149982+0000", 2023-08-01T19:56:39.299 INFO:teuthology.orchestra.run.smithi155.stdout: "duration": 7.8706000000000002e-05 2023-08-01T19:56:39.299 INFO:teuthology.orchestra.run.smithi155.stdout: }, 2023-08-01T19:56:39.299 INFO:teuthology.orchestra.run.smithi155.stdout: { 2023-08-01T19:56:39.299 INFO:teuthology.orchestra.run.smithi155.stdout: "event": "waiting for subops from 0", 2023-08-01T19:56:39.300 INFO:teuthology.orchestra.run.smithi155.stdout: "time": "2023-08-01T19:55:05.150066+0000", 2023-08-01T19:56:39.300 INFO:teuthology.orchestra.run.smithi155.stdout: "duration": 8.4241999999999997e-05 2023-08-01T19:56:39.300 INFO:teuthology.orchestra.run.smithi155.stdout: }, 2023-08-01T19:56:39.300 INFO:teuthology.orchestra.run.smithi155.stdout: { 2023-08-01T19:56:39.300 INFO:teuthology.orchestra.run.smithi155.stdout: "event": "op_commit", 2023-08-01T19:56:39.300 INFO:teuthology.orchestra.run.smithi155.stdout: "time": "2023-08-01T19:55:05.154994+0000", 2023-08-01T19:56:39.300 INFO:teuthology.orchestra.run.smithi155.stdout: "duration": 0.0049277050000000001 2023-08-01T19:56:39.301 INFO:teuthology.orchestra.run.smithi155.stdout: }, 2023-08-01T19:56:39.301 INFO:teuthology.orchestra.run.smithi155.stdout: { 2023-08-01T19:56:39.301 INFO:teuthology.orchestra.run.smithi155.stdout: "event": "sub_op_commit_rec", 2023-08-01T19:56:39.301 INFO:teuthology.orchestra.run.smithi155.stdout: "time": "2023-08-01T19:55:05.218933+0000", 2023-08-01T19:56:39.301 INFO:teuthology.orchestra.run.smithi155.stdout: "duration": 0.063939916999999999 2023-08-01T19:56:39.301 INFO:teuthology.orchestra.run.smithi155.stdout: }, 2023-08-01T19:56:39.301 INFO:teuthology.orchestra.run.smithi155.stdout: { 2023-08-01T19:56:39.301 INFO:teuthology.orchestra.run.smithi155.stdout: "event": "commit_sent", 2023-08-01T19:56:39.302 INFO:teuthology.orchestra.run.smithi155.stdout: "time": "2023-08-01T19:55:05.218989+0000", 2023-08-01T19:56:39.302 INFO:teuthology.orchestra.run.smithi155.stdout: "duration": 5.5772000000000001e-05 2023-08-01T19:56:39.302 INFO:teuthology.orchestra.run.smithi155.stdout: }, 2023-08-01T19:56:39.302 INFO:teuthology.orchestra.run.smithi155.stdout: { 2023-08-01T19:56:39.302 INFO:teuthology.orchestra.run.smithi155.stdout: "event": "done", 2023-08-01T19:56:39.302 INFO:teuthology.orchestra.run.smithi155.stdout: "time": "2023-08-01T19:55:05.219036+0000", 2023-08-01T19:56:39.302 INFO:teuthology.orchestra.run.smithi155.stdout: "duration": 4.6526000000000001e-05 2023-08-01T19:56:39.302 INFO:teuthology.orchestra.run.smithi155.stdout: } 2023-08-01T19:56:39.303 INFO:teuthology.orchestra.run.smithi155.stdout: ] 2023-08-01T19:56:39.303 INFO:teuthology.orchestra.run.smithi155.stdout: } 2023-08-01T19:56:39.303 INFO:teuthology.orchestra.run.smithi155.stdout: }, 2023-08-01T19:56:39.303 INFO:teuthology.orchestra.run.smithi155.stdout: { 2023-08-01T19:56:39.303 INFO:teuthology.orchestra.run.smithi155.stdout: "description": "osd_op(client.4668.0:100242 5.8 5:16a314b8:::benchmark_data_smithi006_114134_object100241:head [set-alloc-hint object_size 65536 write_size 65536,write 0~65536] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e37)", 2023-08-01T19:56:39.303 INFO:teuthology.orchestra.run.smithi155.stdout: "initiated_at": "2023-08-01T19:55:05.150616+0000", 2023-08-01T19:56:39.303 INFO:teuthology.orchestra.run.smithi155.stdout: "age": 94.138824048999993, 2023-08-01T19:56:39.304 INFO:teuthology.orchestra.run.smithi155.stdout: "duration": 0.071105065999999995, 2023-08-01T19:56:39.304 INFO:teuthology.orchestra.run.smithi155.stdout: "type_data": { 2023-08-01T19:56:39.304 INFO:teuthology.orchestra.run.smithi155.stdout: "flag_point": "commit sent; apply or cleanup", 2023-08-01T19:56:39.304 INFO:teuthology.orchestra.run.smithi155.stdout: "client_info": { 2023-08-01T19:56:39.304 INFO:teuthology.orchestra.run.smithi155.stdout: "client": "client.4668", 2023-08-01T19:56:39.304 INFO:teuthology.orchestra.run.smithi155.stdout: "client_addr": "172.21.15.6:0/1709472247", 2023-08-01T19:56:39.304 INFO:teuthology.orchestra.run.smithi155.stdout: "tid": 100242 2023-08-01T19:56:39.304 INFO:teuthology.orchestra.run.smithi155.stdout: }, 2023-08-01T19:56:39.305 INFO:teuthology.orchestra.run.smithi155.stdout: "events": [ 2023-08-01T19:56:39.305 INFO:teuthology.orchestra.run.smithi155.stdout: { 2023-08-01T19:56:39.305 INFO:teuthology.orchestra.run.smithi155.stdout: "event": "initiated", 2023-08-01T19:56:39.305 INFO:teuthology.orchestra.run.smithi155.stdout: "time": "2023-08-01T19:55:05.150616+0000", 2023-08-01T19:56:39.305 INFO:teuthology.orchestra.run.smithi155.stdout: "duration": 0 2023-08-01T19:56:39.305 INFO:teuthology.orchestra.run.smithi155.stdout: }, 2023-08-01T19:56:39.305 INFO:teuthology.orchestra.run.smithi155.stdout: { 2023-08-01T19:56:39.305 INFO:teuthology.orchestra.run.smithi155.stdout: "event": "throttled", 2023-08-01T19:56:39.306 INFO:teuthology.orchestra.run.smithi155.stdout: "time": "2023-08-01T19:55:05.150616+0000", 2023-08-01T19:56:39.306 INFO:teuthology.orchestra.run.smithi155.stdout: "duration": 0 2023-08-01T19:56:39.306 INFO:teuthology.orchestra.run.smithi155.stdout: }, 2023-08-01T19:56:39.306 INFO:teuthology.orchestra.run.smithi155.stdout: { 2023-08-01T19:56:39.306 INFO:teuthology.orchestra.run.smithi155.stdout: "event": "header_read", 2023-08-01T19:56:39.306 INFO:teuthology.orchestra.run.smithi155.stdout: "time": "2023-08-01T19:55:05.150615+0000", 2023-08-01T19:56:39.306 INFO:teuthology.orchestra.run.smithi155.stdout: "duration": 4294967295.999999 2023-08-01T19:56:39.307 INFO:teuthology.orchestra.run.smithi155.stdout: }, 2023-08-01T19:56:39.307 INFO:teuthology.orchestra.run.smithi155.stdout: { 2023-08-01T19:56:39.307 INFO:teuthology.orchestra.run.smithi155.stdout: "event": "all_read", 2023-08-01T19:56:39.307 INFO:teuthology.orchestra.run.smithi155.stdout: "time": "2023-08-01T19:55:05.150696+0000", 2023-08-01T19:56:39.307 INFO:teuthology.orchestra.run.smithi155.stdout: "duration": 8.0852000000000004e-05 2023-08-01T19:56:39.307 INFO:teuthology.orchestra.run.smithi155.stdout: }, 2023-08-01T19:56:39.307 INFO:teuthology.orchestra.run.smithi155.stdout: { 2023-08-01T19:56:39.307 INFO:teuthology.orchestra.run.smithi155.stdout: "event": "dispatched", 2023-08-01T19:56:39.308 INFO:teuthology.orchestra.run.smithi155.stdout: "time": "2023-08-01T19:55:05.150708+0000", 2023-08-01T19:56:39.308 INFO:teuthology.orchestra.run.smithi155.stdout: "duration": 1.2116999999999999e-05 2023-08-01T19:56:39.308 INFO:teuthology.orchestra.run.smithi155.stdout: }, 2023-08-01T19:56:39.308 INFO:teuthology.orchestra.run.smithi155.stdout: { 2023-08-01T19:56:39.308 INFO:teuthology.orchestra.run.smithi155.stdout: "event": "queued_for_pg", 2023-08-01T19:56:39.308 INFO:teuthology.orchestra.run.smithi155.stdout: "time": "2023-08-01T19:55:05.150713+0000", 2023-08-01T19:56:39.308 INFO:teuthology.orchestra.run.smithi155.stdout: "duration": 5.4620000000000004e-06 2023-08-01T19:56:39.308 INFO:teuthology.orchestra.run.smithi155.stdout: }, 2023-08-01T19:56:39.309 INFO:teuthology.orchestra.run.smithi155.stdout: { 2023-08-01T19:56:39.309 INFO:teuthology.orchestra.run.smithi155.stdout: "event": "reached_pg", 2023-08-01T19:56:39.309 INFO:teuthology.orchestra.run.smithi155.stdout: "time": "2023-08-01T19:55:05.150761+0000", 2023-08-01T19:56:39.309 INFO:teuthology.orchestra.run.smithi155.stdout: "duration": 4.7429000000000003e-05 2023-08-01T19:56:39.309 INFO:teuthology.orchestra.run.smithi155.stdout: }, 2023-08-01T19:56:39.309 INFO:teuthology.orchestra.run.smithi155.stdout: { 2023-08-01T19:56:39.309 INFO:teuthology.orchestra.run.smithi155.stdout: "event": "started", 2023-08-01T19:56:39.309 INFO:teuthology.orchestra.run.smithi155.stdout: "time": "2023-08-01T19:55:05.150856+0000", 2023-08-01T19:56:39.310 INFO:teuthology.orchestra.run.smithi155.stdout: "duration": 9.5356e-05 2023-08-01T19:56:39.310 INFO:teuthology.orchestra.run.smithi155.stdout: }, 2023-08-01T19:56:39.310 INFO:teuthology.orchestra.run.smithi155.stdout: { 2023-08-01T19:56:39.310 INFO:teuthology.orchestra.run.smithi155.stdout: "event": "waiting for subops from 0", 2023-08-01T19:56:39.310 INFO:teuthology.orchestra.run.smithi155.stdout: "time": "2023-08-01T19:55:05.150999+0000", 2023-08-01T19:56:39.310 INFO:teuthology.orchestra.run.smithi155.stdout: "duration": 0.00014234499999999999 2023-08-01T19:56:39.310 INFO:teuthology.orchestra.run.smithi155.stdout: }, 2023-08-01T19:56:39.310 INFO:teuthology.orchestra.run.smithi155.stdout: { 2023-08-01T19:56:39.311 INFO:teuthology.orchestra.run.smithi155.stdout: "event": "sub_op_commit_rec", 2023-08-01T19:56:39.311 INFO:teuthology.orchestra.run.smithi155.stdout: "time": "2023-08-01T19:55:05.219001+0000", 2023-08-01T19:56:39.311 INFO:teuthology.orchestra.run.smithi155.stdout: "duration": 0.068002776000000001 2023-08-01T19:56:39.311 INFO:teuthology.orchestra.run.smithi155.stdout: }, 2023-08-01T19:56:39.311 INFO:teuthology.orchestra.run.smithi155.stdout: { 2023-08-01T19:56:39.311 INFO:teuthology.orchestra.run.smithi155.stdout: "event": "op_commit", 2023-08-01T19:56:39.311 INFO:teuthology.orchestra.run.smithi155.stdout: "time": "2023-08-01T19:55:05.221635+0000", 2023-08-01T19:56:39.312 INFO:teuthology.orchestra.run.smithi155.stdout: "duration": 0.0026340579999999999 2023-08-01T19:56:39.312 INFO:teuthology.orchestra.run.smithi155.stdout: }, 2023-08-01T19:56:39.312 INFO:teuthology.orchestra.run.smithi155.stdout: { 2023-08-01T19:56:39.312 INFO:teuthology.orchestra.run.smithi155.stdout: "event": "commit_sent", 2023-08-01T19:56:39.312 INFO:teuthology.orchestra.run.smithi155.stdout: "time": "2023-08-01T19:55:05.221682+0000", 2023-08-01T19:56:39.312 INFO:teuthology.orchestra.run.smithi155.stdout: "duration": 4.7123999999999998e-05 2023-08-01T19:56:39.312 INFO:teuthology.orchestra.run.smithi155.stdout: }, 2023-08-01T19:56:39.312 INFO:teuthology.orchestra.run.smithi155.stdout: { 2023-08-01T19:56:39.313 INFO:teuthology.orchestra.run.smithi155.stdout: "event": "done", 2023-08-01T19:56:39.313 INFO:teuthology.orchestra.run.smithi155.stdout: "time": "2023-08-01T19:55:05.221721+0000", 2023-08-01T19:56:39.313 INFO:teuthology.orchestra.run.smithi155.stdout: "duration": 3.8529999999999999e-05 2023-08-01T19:56:39.313 INFO:teuthology.orchestra.run.smithi155.stdout: } 2023-08-01T19:56:39.313 INFO:teuthology.orchestra.run.smithi155.stdout: ] 2023-08-01T19:56:39.313 INFO:teuthology.orchestra.run.smithi155.stdout: } 2023-08-01T19:56:39.313 INFO:teuthology.orchestra.run.smithi155.stdout: }, 2023-08-01T19:56:39.313 INFO:teuthology.orchestra.run.smithi155.stdout: { 2023-08-01T19:56:39.314 INFO:teuthology.orchestra.run.smithi155.stdout: "description": "osd_repop(client.4668.0:100240 5.a e37/19 5:5313c5b9:::benchmark_data_smithi006_114134_object100239:head v 37'6227, mlcod=37'6225)", 2023-08-01T19:56:39.314 INFO:teuthology.orchestra.run.smithi155.stdout: "initiated_at": "2023-08-01T19:55:05.150778+0000", 2023-08-01T19:56:39.314 INFO:teuthology.orchestra.run.smithi155.stdout: "age": 94.138661847999998, 2023-08-01T19:56:39.314 INFO:teuthology.orchestra.run.smithi155.stdout: "duration": 0.073362533999999993, 2023-08-01T19:56:39.314 INFO:teuthology.orchestra.run.smithi155.stdout: "type_data": { 2023-08-01T19:56:39.314 INFO:teuthology.orchestra.run.smithi155.stdout: "flag_point": "commit sent; apply or cleanup", 2023-08-01T19:56:39.314 INFO:teuthology.orchestra.run.smithi155.stdout: "events": [ 2023-08-01T19:56:39.315 INFO:teuthology.orchestra.run.smithi155.stdout: { 2023-08-01T19:56:39.315 INFO:teuthology.orchestra.run.smithi155.stdout: "event": "initiated", 2023-08-01T19:56:39.315 INFO:teuthology.orchestra.run.smithi155.stdout: "time": "2023-08-01T19:55:05.150778+0000", 2023-08-01T19:56:39.315 INFO:teuthology.orchestra.run.smithi155.stdout: "duration": 0 2023-08-01T19:56:39.315 INFO:teuthology.orchestra.run.smithi155.stdout: }, 2023-08-01T19:56:39.315 INFO:teuthology.orchestra.run.smithi155.stdout: { 2023-08-01T19:56:39.315 INFO:teuthology.orchestra.run.smithi155.stdout: "event": "throttled", 2023-08-01T19:56:39.315 INFO:teuthology.orchestra.run.smithi155.stdout: "time": "2023-08-01T19:55:05.150778+0000", 2023-08-01T19:56:39.316 INFO:teuthology.orchestra.run.smithi155.stdout: "duration": 0 2023-08-01T19:56:39.316 INFO:teuthology.orchestra.run.smithi155.stdout: }, 2023-08-01T19:56:39.316 INFO:teuthology.orchestra.run.smithi155.stdout: { 2023-08-01T19:56:39.316 INFO:teuthology.orchestra.run.smithi155.stdout: "event": "header_read", 2023-08-01T19:56:39.316 INFO:teuthology.orchestra.run.smithi155.stdout: "time": "2023-08-01T19:55:05.150778+0000", 2023-08-01T19:56:39.316 INFO:teuthology.orchestra.run.smithi155.stdout: "duration": 4294967295.9999995 2023-08-01T19:56:39.316 INFO:teuthology.orchestra.run.smithi155.stdout: }, 2023-08-01T19:56:39.317 INFO:teuthology.orchestra.run.smithi155.stdout: { 2023-08-01T19:56:39.317 INFO:teuthology.orchestra.run.smithi155.stdout: "event": "all_read", 2023-08-01T19:56:39.317 INFO:teuthology.orchestra.run.smithi155.stdout: "time": "2023-08-01T19:55:05.150811+0000", 2023-08-01T19:56:39.317 INFO:teuthology.orchestra.run.smithi155.stdout: "duration": 3.3664000000000002e-05 2023-08-01T19:56:39.317 INFO:teuthology.orchestra.run.smithi155.stdout: }, 2023-08-01T19:56:39.317 INFO:teuthology.orchestra.run.smithi155.stdout: { 2023-08-01T19:56:39.317 INFO:teuthology.orchestra.run.smithi155.stdout: "event": "dispatched", 2023-08-01T19:56:39.317 INFO:teuthology.orchestra.run.smithi155.stdout: "time": "2023-08-01T19:55:05.150818+0000", 2023-08-01T19:56:39.318 INFO:teuthology.orchestra.run.smithi155.stdout: "duration": 6.5769999999999999e-06 2023-08-01T19:56:39.318 INFO:teuthology.orchestra.run.smithi155.stdout: }, 2023-08-01T19:56:39.318 INFO:teuthology.orchestra.run.smithi155.stdout: { 2023-08-01T19:56:39.318 INFO:teuthology.orchestra.run.smithi155.stdout: "event": "queued_for_pg", 2023-08-01T19:56:39.318 INFO:teuthology.orchestra.run.smithi155.stdout: "time": "2023-08-01T19:55:05.150822+0000", 2023-08-01T19:56:39.318 INFO:teuthology.orchestra.run.smithi155.stdout: "duration": 4.0060000000000003e-06 2023-08-01T19:56:39.318 INFO:teuthology.orchestra.run.smithi155.stdout: }, 2023-08-01T19:56:39.318 INFO:teuthology.orchestra.run.smithi155.stdout: { 2023-08-01T19:56:39.319 INFO:teuthology.orchestra.run.smithi155.stdout: "event": "reached_pg", 2023-08-01T19:56:39.319 INFO:teuthology.orchestra.run.smithi155.stdout: "time": "2023-08-01T19:55:05.150855+0000", 2023-08-01T19:56:39.319 INFO:teuthology.orchestra.run.smithi155.stdout: "duration": 3.3204999999999998e-05 2023-08-01T19:56:39.319 INFO:teuthology.orchestra.run.smithi155.stdout: }, 2023-08-01T19:56:39.319 INFO:teuthology.orchestra.run.smithi155.stdout: { 2023-08-01T19:56:39.319 INFO:teuthology.orchestra.run.smithi155.stdout: "event": "started", 2023-08-01T19:56:39.319 INFO:teuthology.orchestra.run.smithi155.stdout: "time": "2023-08-01T19:55:05.150873+0000", 2023-08-01T19:56:39.320 INFO:teuthology.orchestra.run.smithi155.stdout: "duration": 1.8139999999999999e-05 2023-08-01T19:56:39.320 INFO:teuthology.orchestra.run.smithi155.stdout: }, 2023-08-01T19:56:39.320 INFO:teuthology.orchestra.run.smithi155.stdout: { 2023-08-01T19:56:39.320 INFO:teuthology.orchestra.run.smithi155.stdout: "event": "commit_sent", 2023-08-01T19:56:39.320 INFO:teuthology.orchestra.run.smithi155.stdout: "time": "2023-08-01T19:55:05.224095+0000", 2023-08-01T19:56:39.320 INFO:teuthology.orchestra.run.smithi155.stdout: "duration": 0.073221895999999995 2023-08-01T19:56:39.320 INFO:teuthology.orchestra.run.smithi155.stdout: }, 2023-08-01T19:56:39.321 INFO:teuthology.orchestra.run.smithi155.stdout: { 2023-08-01T19:56:39.321 INFO:teuthology.orchestra.run.smithi155.stdout: "event": "done", 2023-08-01T19:56:39.321 INFO:teuthology.orchestra.run.smithi155.stdout: "time": "2023-08-01T19:55:05.224141+0000", 2023-08-01T19:56:39.321 INFO:teuthology.orchestra.run.smithi155.stdout: "duration": 4.5385e-05 2023-08-01T19:56:39.321 INFO:teuthology.orchestra.run.smithi155.stdout: } 2023-08-01T19:56:39.321 INFO:teuthology.orchestra.run.smithi155.stdout: ] 2023-08-01T19:56:39.321 INFO:teuthology.orchestra.run.smithi155.stdout: } 2023-08-01T19:56:39.322 INFO:teuthology.orchestra.run.smithi155.stdout: }, 2023-08-01T19:56:39.322 INFO:teuthology.orchestra.run.smithi155.stdout: { 2023-08-01T19:56:39.322 INFO:teuthology.orchestra.run.smithi155.stdout: "description": "osd_op(client.4668.0:100245 5.e 5:71869c66:::benchmark_data_smithi006_114134_object100244:head [set-alloc-hint object_size 65536 write_size 65536,write 0~65536] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e37)", 2023-08-01T19:56:39.322 INFO:teuthology.orchestra.run.smithi155.stdout: "initiated_at": "2023-08-01T19:55:05.150991+0000", 2023-08-01T19:56:39.322 INFO:teuthology.orchestra.run.smithi155.stdout: "age": 94.138449061000003, 2023-08-01T19:56:39.322 INFO:teuthology.orchestra.run.smithi155.stdout: "duration": 0.070734490999999997, 2023-08-01T19:56:39.322 INFO:teuthology.orchestra.run.smithi155.stdout: "type_data": { 2023-08-01T19:56:39.322 INFO:teuthology.orchestra.run.smithi155.stdout: "flag_point": "commit sent; apply or cleanup", 2023-08-01T19:56:39.323 INFO:teuthology.orchestra.run.smithi155.stdout: "client_info": { 2023-08-01T19:56:39.323 INFO:teuthology.orchestra.run.smithi155.stdout: "client": "client.4668", 2023-08-01T19:56:39.323 INFO:teuthology.orchestra.run.smithi155.stdout: "client_addr": "172.21.15.6:0/1709472247", 2023-08-01T19:56:39.323 INFO:teuthology.orchestra.run.smithi155.stdout: "tid": 100245 2023-08-01T19:56:39.323 INFO:teuthology.orchestra.run.smithi155.stdout: }, 2023-08-01T19:56:39.323 INFO:teuthology.orchestra.run.smithi155.stdout: "events": [ 2023-08-01T19:56:39.323 INFO:teuthology.orchestra.run.smithi155.stdout: { 2023-08-01T19:56:39.324 INFO:teuthology.orchestra.run.smithi155.stdout: "event": "initiated", 2023-08-01T19:56:39.324 INFO:teuthology.orchestra.run.smithi155.stdout: "time": "2023-08-01T19:55:05.150991+0000", 2023-08-01T19:56:39.324 INFO:teuthology.orchestra.run.smithi155.stdout: "duration": 0 2023-08-01T19:56:39.324 INFO:teuthology.orchestra.run.smithi155.stdout: }, 2023-08-01T19:56:39.324 INFO:teuthology.orchestra.run.smithi155.stdout: { 2023-08-01T19:56:39.324 INFO:teuthology.orchestra.run.smithi155.stdout: "event": "throttled", 2023-08-01T19:56:39.324 INFO:teuthology.orchestra.run.smithi155.stdout: "time": "2023-08-01T19:55:05.150991+0000", 2023-08-01T19:56:39.324 INFO:teuthology.orchestra.run.smithi155.stdout: "duration": 0 2023-08-01T19:56:39.325 INFO:teuthology.orchestra.run.smithi155.stdout: }, 2023-08-01T19:56:39.325 INFO:teuthology.orchestra.run.smithi155.stdout: { 2023-08-01T19:56:39.325 INFO:teuthology.orchestra.run.smithi155.stdout: "event": "header_read", 2023-08-01T19:56:39.325 INFO:teuthology.orchestra.run.smithi155.stdout: "time": "2023-08-01T19:55:05.150990+0000", 2023-08-01T19:56:39.325 INFO:teuthology.orchestra.run.smithi155.stdout: "duration": 4294967295.999999 2023-08-01T19:56:39.325 INFO:teuthology.orchestra.run.smithi155.stdout: }, 2023-08-01T19:56:39.325 INFO:teuthology.orchestra.run.smithi155.stdout: { 2023-08-01T19:56:39.326 INFO:teuthology.orchestra.run.smithi155.stdout: "event": "all_read", 2023-08-01T19:56:39.326 INFO:teuthology.orchestra.run.smithi155.stdout: "time": "2023-08-01T19:55:05.151108+0000", 2023-08-01T19:56:39.326 INFO:teuthology.orchestra.run.smithi155.stdout: "duration": 0.00011849300000000001 2023-08-01T19:56:39.326 INFO:teuthology.orchestra.run.smithi155.stdout: }, 2023-08-01T19:56:39.326 INFO:teuthology.orchestra.run.smithi155.stdout: { 2023-08-01T19:56:39.326 INFO:teuthology.orchestra.run.smithi155.stdout: "event": "dispatched", 2023-08-01T19:56:39.326 INFO:teuthology.orchestra.run.smithi155.stdout: "time": "2023-08-01T19:55:05.151117+0000", 2023-08-01T19:56:39.326 INFO:teuthology.orchestra.run.smithi155.stdout: "duration": 8.1040000000000007e-06 2023-08-01T19:56:39.327 INFO:teuthology.orchestra.run.smithi155.stdout: }, 2023-08-01T19:56:39.327 INFO:teuthology.orchestra.run.smithi155.stdout: { 2023-08-01T19:56:39.327 INFO:teuthology.orchestra.run.smithi155.stdout: "event": "queued_for_pg", 2023-08-01T19:56:39.327 INFO:teuthology.orchestra.run.smithi155.stdout: "time": "2023-08-01T19:55:05.151121+0000", 2023-08-01T19:56:39.327 INFO:teuthology.orchestra.run.smithi155.stdout: "duration": 4.2019999999999997e-06 2023-08-01T19:56:39.327 INFO:teuthology.orchestra.run.smithi155.stdout: }, 2023-08-01T19:56:39.327 INFO:teuthology.orchestra.run.smithi155.stdout: { 2023-08-01T19:56:39.327 INFO:teuthology.orchestra.run.smithi155.stdout: "event": "reached_pg", 2023-08-01T19:56:39.328 INFO:teuthology.orchestra.run.smithi155.stdout: "time": "2023-08-01T19:55:05.151162+0000", 2023-08-01T19:56:39.328 INFO:teuthology.orchestra.run.smithi155.stdout: "duration": 4.1448e-05 2023-08-01T19:56:39.328 INFO:teuthology.orchestra.run.smithi155.stdout: }, 2023-08-01T19:56:39.328 INFO:teuthology.orchestra.run.smithi155.stdout: { 2023-08-01T19:56:39.328 INFO:teuthology.orchestra.run.smithi155.stdout: "event": "started", 2023-08-01T19:56:39.328 INFO:teuthology.orchestra.run.smithi155.stdout: "time": "2023-08-01T19:55:05.151281+0000", 2023-08-01T19:56:39.328 INFO:teuthology.orchestra.run.smithi155.stdout: "duration": 0.000119141 2023-08-01T19:56:39.329 INFO:teuthology.orchestra.run.smithi155.stdout: }, 2023-08-01T19:56:39.329 INFO:teuthology.orchestra.run.smithi155.stdout: { 2023-08-01T19:56:39.329 INFO:teuthology.orchestra.run.smithi155.stdout: "event": "waiting for subops from 0", 2023-08-01T19:56:39.329 INFO:teuthology.orchestra.run.smithi155.stdout: "time": "2023-08-01T19:55:05.151443+0000", 2023-08-01T19:56:39.329 INFO:teuthology.orchestra.run.smithi155.stdout: "duration": 0.00016181600000000001 2023-08-01T19:56:39.329 INFO:teuthology.orchestra.run.smithi155.stdout: }, 2023-08-01T19:56:39.329 INFO:teuthology.orchestra.run.smithi155.stdout: { 2023-08-01T19:56:39.329 INFO:teuthology.orchestra.run.smithi155.stdout: "event": "sub_op_commit_rec", 2023-08-01T19:56:39.330 INFO:teuthology.orchestra.run.smithi155.stdout: "time": "2023-08-01T19:55:05.219101+0000", 2023-08-01T19:56:39.330 INFO:teuthology.orchestra.run.smithi155.stdout: "duration": 0.067658037000000004 2023-08-01T19:56:39.330 INFO:teuthology.orchestra.run.smithi155.stdout: }, 2023-08-01T19:56:39.330 INFO:teuthology.orchestra.run.smithi155.stdout: { 2023-08-01T19:56:39.330 INFO:teuthology.orchestra.run.smithi155.stdout: "event": "op_commit", 2023-08-01T19:56:39.330 INFO:teuthology.orchestra.run.smithi155.stdout: "time": "2023-08-01T19:55:05.221646+0000", 2023-08-01T19:56:39.330 INFO:teuthology.orchestra.run.smithi155.stdout: "duration": 0.0025450540000000002 2023-08-01T19:56:39.331 INFO:teuthology.orchestra.run.smithi155.stdout: }, 2023-08-01T19:56:39.331 INFO:teuthology.orchestra.run.smithi155.stdout: { 2023-08-01T19:56:39.331 INFO:teuthology.orchestra.run.smithi155.stdout: "event": "commit_sent", 2023-08-01T19:56:39.331 INFO:teuthology.orchestra.run.smithi155.stdout: "time": "2023-08-01T19:55:05.221689+0000", 2023-08-01T19:56:39.331 INFO:teuthology.orchestra.run.smithi155.stdout: "duration": 4.3078999999999999e-05 2023-08-01T19:56:39.331 INFO:teuthology.orchestra.run.smithi155.stdout: }, 2023-08-01T19:56:39.331 INFO:teuthology.orchestra.run.smithi155.stdout: { 2023-08-01T19:56:39.331 INFO:teuthology.orchestra.run.smithi155.stdout: "event": "done", 2023-08-01T19:56:39.332 INFO:teuthology.orchestra.run.smithi155.stdout: "time": "2023-08-01T19:55:05.221725+0000", 2023-08-01T19:56:39.332 INFO:teuthology.orchestra.run.smithi155.stdout: "duration": 3.6137999999999999e-05 2023-08-01T19:56:39.332 INFO:teuthology.orchestra.run.smithi155.stdout: } 2023-08-01T19:56:39.332 INFO:teuthology.orchestra.run.smithi155.stdout: ] 2023-08-01T19:56:39.332 INFO:teuthology.orchestra.run.smithi155.stdout: } 2023-08-01T19:56:39.332 INFO:teuthology.orchestra.run.smithi155.stdout: }, 2023-08-01T19:56:39.332 INFO:teuthology.orchestra.run.smithi155.stdout: { 2023-08-01T19:56:39.332 INFO:teuthology.orchestra.run.smithi155.stdout: "description": "osd_repop(client.4668.0:100243 5.a e37/19 5:5e8193b6:::benchmark_data_smithi006_114134_object100242:head v 37'6228, mlcod=37'6225)", 2023-08-01T19:56:39.333 INFO:teuthology.orchestra.run.smithi155.stdout: "initiated_at": "2023-08-01T19:55:05.151148+0000", 2023-08-01T19:56:39.333 INFO:teuthology.orchestra.run.smithi155.stdout: "age": 94.138292050000004, 2023-08-01T19:56:39.333 INFO:teuthology.orchestra.run.smithi155.stdout: "duration": 0.073020370000000001, 2023-08-01T19:56:39.333 INFO:teuthology.orchestra.run.smithi155.stdout: "type_data": { 2023-08-01T19:56:39.333 INFO:teuthology.orchestra.run.smithi155.stdout: "flag_point": "commit sent; apply or cleanup", 2023-08-01T19:56:39.333 INFO:teuthology.orchestra.run.smithi155.stdout: "events": [ 2023-08-01T19:56:39.333 INFO:teuthology.orchestra.run.smithi155.stdout: { 2023-08-01T19:56:39.333 INFO:teuthology.orchestra.run.smithi155.stdout: "event": "initiated", 2023-08-01T19:56:39.334 INFO:teuthology.orchestra.run.smithi155.stdout: "time": "2023-08-01T19:55:05.151148+0000", 2023-08-01T19:56:39.334 INFO:teuthology.orchestra.run.smithi155.stdout: "duration": 0 2023-08-01T19:56:39.334 INFO:teuthology.orchestra.run.smithi155.stdout: }, 2023-08-01T19:56:39.334 INFO:teuthology.orchestra.run.smithi155.stdout: { 2023-08-01T19:56:39.334 INFO:teuthology.orchestra.run.smithi155.stdout: "event": "throttled", 2023-08-01T19:56:39.334 INFO:teuthology.orchestra.run.smithi155.stdout: "time": "2023-08-01T19:55:05.151148+0000", 2023-08-01T19:56:39.334 INFO:teuthology.orchestra.run.smithi155.stdout: "duration": 0 2023-08-01T19:56:39.335 INFO:teuthology.orchestra.run.smithi155.stdout: }, 2023-08-01T19:56:39.335 INFO:teuthology.orchestra.run.smithi155.stdout: { 2023-08-01T19:56:39.335 INFO:teuthology.orchestra.run.smithi155.stdout: "event": "header_read", 2023-08-01T19:56:39.335 INFO:teuthology.orchestra.run.smithi155.stdout: "time": "2023-08-01T19:55:05.151147+0000", 2023-08-01T19:56:39.335 INFO:teuthology.orchestra.run.smithi155.stdout: "duration": 4294967295.9999995 2023-08-01T19:56:39.335 INFO:teuthology.orchestra.run.smithi155.stdout: }, 2023-08-01T19:56:39.335 INFO:teuthology.orchestra.run.smithi155.stdout: { 2023-08-01T19:56:39.335 INFO:teuthology.orchestra.run.smithi155.stdout: "event": "all_read", 2023-08-01T19:56:39.336 INFO:teuthology.orchestra.run.smithi155.stdout: "time": "2023-08-01T19:55:05.151231+0000", 2023-08-01T19:56:39.336 INFO:teuthology.orchestra.run.smithi155.stdout: "duration": 8.3135999999999998e-05 2023-08-01T19:56:39.336 INFO:teuthology.orchestra.run.smithi155.stdout: }, 2023-08-01T19:56:39.336 INFO:teuthology.orchestra.run.smithi155.stdout: { 2023-08-01T19:56:39.336 INFO:teuthology.orchestra.run.smithi155.stdout: "event": "dispatched", 2023-08-01T19:56:39.336 INFO:teuthology.orchestra.run.smithi155.stdout: "time": "2023-08-01T19:55:05.151239+0000", 2023-08-01T19:56:39.336 INFO:teuthology.orchestra.run.smithi155.stdout: "duration": 8.7469999999999994e-06 2023-08-01T19:56:39.336 INFO:teuthology.orchestra.run.smithi155.stdout: }, 2023-08-01T19:56:39.337 INFO:teuthology.orchestra.run.smithi155.stdout: { 2023-08-01T19:56:39.337 INFO:teuthology.orchestra.run.smithi155.stdout: "event": "queued_for_pg", 2023-08-01T19:56:39.337 INFO:teuthology.orchestra.run.smithi155.stdout: "time": "2023-08-01T19:55:05.151244+0000", 2023-08-01T19:56:39.337 INFO:teuthology.orchestra.run.smithi155.stdout: "duration": 4.4800000000000003e-06 2023-08-01T19:56:39.337 INFO:teuthology.orchestra.run.smithi155.stdout: }, 2023-08-01T19:56:39.337 INFO:teuthology.orchestra.run.smithi155.stdout: { 2023-08-01T19:56:39.337 INFO:teuthology.orchestra.run.smithi155.stdout: "event": "reached_pg", 2023-08-01T19:56:39.338 INFO:teuthology.orchestra.run.smithi155.stdout: "time": "2023-08-01T19:55:05.152938+0000", 2023-08-01T19:56:39.338 INFO:teuthology.orchestra.run.smithi155.stdout: "duration": 0.001693824 2023-08-01T19:56:39.338 INFO:teuthology.orchestra.run.smithi155.stdout: }, 2023-08-01T19:56:39.338 INFO:teuthology.orchestra.run.smithi155.stdout: { 2023-08-01T19:56:39.338 INFO:teuthology.orchestra.run.smithi155.stdout: "event": "started", 2023-08-01T19:56:39.338 INFO:teuthology.orchestra.run.smithi155.stdout: "time": "2023-08-01T19:55:05.152956+0000", 2023-08-01T19:56:39.338 INFO:teuthology.orchestra.run.smithi155.stdout: "duration": 1.8287e-05 2023-08-01T19:56:39.338 INFO:teuthology.orchestra.run.smithi155.stdout: }, 2023-08-01T19:56:39.339 INFO:teuthology.orchestra.run.smithi155.stdout: { 2023-08-01T19:56:39.339 INFO:teuthology.orchestra.run.smithi155.stdout: "event": "commit_sent", 2023-08-01T19:56:39.339 INFO:teuthology.orchestra.run.smithi155.stdout: "time": "2023-08-01T19:55:05.224145+0000", 2023-08-01T19:56:39.339 INFO:teuthology.orchestra.run.smithi155.stdout: "duration": 0.071189447000000003 2023-08-01T19:56:39.339 INFO:teuthology.orchestra.run.smithi155.stdout: }, 2023-08-01T19:56:39.339 INFO:teuthology.orchestra.run.smithi155.stdout: { 2023-08-01T19:56:39.339 INFO:teuthology.orchestra.run.smithi155.stdout: "event": "done", 2023-08-01T19:56:39.340 INFO:teuthology.orchestra.run.smithi155.stdout: "time": "2023-08-01T19:55:05.224168+0000", 2023-08-01T19:56:39.340 INFO:teuthology.orchestra.run.smithi155.stdout: "duration": 2.3008999999999999e-05 2023-08-01T19:56:39.340 INFO:teuthology.orchestra.run.smithi155.stdout: } 2023-08-01T19:56:39.340 INFO:teuthology.orchestra.run.smithi155.stdout: ] 2023-08-01T19:56:39.340 INFO:teuthology.orchestra.run.smithi155.stdout: } 2023-08-01T19:56:39.340 INFO:teuthology.orchestra.run.smithi155.stdout: }, 2023-08-01T19:56:39.340 INFO:teuthology.orchestra.run.smithi155.stdout: { 2023-08-01T19:56:39.340 INFO:teuthology.orchestra.run.smithi155.stdout: "description": "osd_repop(client.4668.0:100244 5.9 e37/19 5:92f56a12:::benchmark_data_smithi006_114134_object100243:head v 37'6294, mlcod=37'6292)", 2023-08-01T19:56:39.341 INFO:teuthology.orchestra.run.smithi155.stdout: "initiated_at": "2023-08-01T19:55:05.151325+0000", 2023-08-01T19:56:39.341 INFO:teuthology.orchestra.run.smithi155.stdout: "age": 94.138114705000007, 2023-08-01T19:56:39.341 INFO:teuthology.orchestra.run.smithi155.stdout: "duration": 0.071883673999999995, 2023-08-01T19:56:39.341 INFO:teuthology.orchestra.run.smithi155.stdout: "type_data": { 2023-08-01T19:56:39.341 INFO:teuthology.orchestra.run.smithi155.stdout: "flag_point": "commit sent; apply or cleanup", 2023-08-01T19:56:39.341 INFO:teuthology.orchestra.run.smithi155.stdout: "events": [ 2023-08-01T19:56:39.341 INFO:teuthology.orchestra.run.smithi155.stdout: { 2023-08-01T19:56:39.341 INFO:teuthology.orchestra.run.smithi155.stdout: "event": "initiated", 2023-08-01T19:56:39.342 INFO:teuthology.orchestra.run.smithi155.stdout: "time": "2023-08-01T19:55:05.151325+0000", 2023-08-01T19:56:39.342 INFO:teuthology.orchestra.run.smithi155.stdout: "duration": 0 2023-08-01T19:56:39.342 INFO:teuthology.orchestra.run.smithi155.stdout: }, 2023-08-01T19:56:39.342 INFO:teuthology.orchestra.run.smithi155.stdout: { 2023-08-01T19:56:39.342 INFO:teuthology.orchestra.run.smithi155.stdout: "event": "throttled", 2023-08-01T19:56:39.342 INFO:teuthology.orchestra.run.smithi155.stdout: "time": "2023-08-01T19:55:05.151325+0000", 2023-08-01T19:56:39.342 INFO:teuthology.orchestra.run.smithi155.stdout: "duration": 0 2023-08-01T19:56:39.343 INFO:teuthology.orchestra.run.smithi155.stdout: }, 2023-08-01T19:56:39.343 INFO:teuthology.orchestra.run.smithi155.stdout: { 2023-08-01T19:56:39.343 INFO:teuthology.orchestra.run.smithi155.stdout: "event": "header_read", 2023-08-01T19:56:39.343 INFO:teuthology.orchestra.run.smithi155.stdout: "time": "2023-08-01T19:55:05.151325+0000", 2023-08-01T19:56:39.343 INFO:teuthology.orchestra.run.smithi155.stdout: "duration": 4294967295.9999995 2023-08-01T19:56:39.343 INFO:teuthology.orchestra.run.smithi155.stdout: }, 2023-08-01T19:56:39.343 INFO:teuthology.orchestra.run.smithi155.stdout: { 2023-08-01T19:56:39.343 INFO:teuthology.orchestra.run.smithi155.stdout: "event": "all_read", 2023-08-01T19:56:39.344 INFO:teuthology.orchestra.run.smithi155.stdout: "time": "2023-08-01T19:55:05.151390+0000", 2023-08-01T19:56:39.344 INFO:teuthology.orchestra.run.smithi155.stdout: "duration": 6.5456999999999993e-05 2023-08-01T19:56:39.344 INFO:teuthology.orchestra.run.smithi155.stdout: }, 2023-08-01T19:56:39.344 INFO:teuthology.orchestra.run.smithi155.stdout: { 2023-08-01T19:56:39.344 INFO:teuthology.orchestra.run.smithi155.stdout: "event": "dispatched", 2023-08-01T19:56:39.344 INFO:teuthology.orchestra.run.smithi155.stdout: "time": "2023-08-01T19:55:05.151396+0000", 2023-08-01T19:56:39.344 INFO:teuthology.orchestra.run.smithi155.stdout: "duration": 5.9190000000000004e-06 2023-08-01T19:56:39.344 INFO:teuthology.orchestra.run.smithi155.stdout: }, 2023-08-01T19:56:39.345 INFO:teuthology.orchestra.run.smithi155.stdout: { 2023-08-01T19:56:39.345 INFO:teuthology.orchestra.run.smithi155.stdout: "event": "queued_for_pg", 2023-08-01T19:56:39.345 INFO:teuthology.orchestra.run.smithi155.stdout: "time": "2023-08-01T19:55:05.151400+0000", 2023-08-01T19:56:39.345 INFO:teuthology.orchestra.run.smithi155.stdout: "duration": 4.1030000000000004e-06 2023-08-01T19:56:39.345 INFO:teuthology.orchestra.run.smithi155.stdout: }, 2023-08-01T19:56:39.345 INFO:teuthology.orchestra.run.smithi155.stdout: { 2023-08-01T19:56:39.345 INFO:teuthology.orchestra.run.smithi155.stdout: "event": "reached_pg", 2023-08-01T19:56:39.346 INFO:teuthology.orchestra.run.smithi155.stdout: "time": "2023-08-01T19:55:05.151452+0000", 2023-08-01T19:56:39.346 INFO:teuthology.orchestra.run.smithi155.stdout: "duration": 5.2136999999999999e-05 2023-08-01T19:56:39.346 INFO:teuthology.orchestra.run.smithi155.stdout: }, 2023-08-01T19:56:39.346 INFO:teuthology.orchestra.run.smithi155.stdout: { 2023-08-01T19:56:39.346 INFO:teuthology.orchestra.run.smithi155.stdout: "event": "started", 2023-08-01T19:56:39.346 INFO:teuthology.orchestra.run.smithi155.stdout: "time": "2023-08-01T19:55:05.151470+0000", 2023-08-01T19:56:39.346 INFO:teuthology.orchestra.run.smithi155.stdout: "duration": 1.8e-05 2023-08-01T19:56:39.346 INFO:teuthology.orchestra.run.smithi155.stdout: }, 2023-08-01T19:56:39.347 INFO:teuthology.orchestra.run.smithi155.stdout: { 2023-08-01T19:56:39.347 INFO:teuthology.orchestra.run.smithi155.stdout: "event": "commit_sent", 2023-08-01T19:56:39.347 INFO:teuthology.orchestra.run.smithi155.stdout: "time": "2023-08-01T19:55:05.223183+0000", 2023-08-01T19:56:39.347 INFO:teuthology.orchestra.run.smithi155.stdout: "duration": 0.071712622000000004 2023-08-01T19:56:39.347 INFO:teuthology.orchestra.run.smithi155.stdout: }, 2023-08-01T19:56:39.347 INFO:teuthology.orchestra.run.smithi155.stdout: { 2023-08-01T19:56:39.347 INFO:teuthology.orchestra.run.smithi155.stdout: "event": "done", 2023-08-01T19:56:39.347 INFO:teuthology.orchestra.run.smithi155.stdout: "time": "2023-08-01T19:55:05.223209+0000", 2023-08-01T19:56:39.348 INFO:teuthology.orchestra.run.smithi155.stdout: "duration": 2.5956e-05 2023-08-01T19:56:39.348 INFO:teuthology.orchestra.run.smithi155.stdout: } 2023-08-01T19:56:39.348 INFO:teuthology.orchestra.run.smithi155.stdout: ] 2023-08-01T19:56:39.348 INFO:teuthology.orchestra.run.smithi155.stdout: } 2023-08-01T19:56:39.348 INFO:teuthology.orchestra.run.smithi155.stdout: }, 2023-08-01T19:56:39.348 INFO:teuthology.orchestra.run.smithi155.stdout: { 2023-08-01T19:56:39.348 INFO:teuthology.orchestra.run.smithi155.stdout: "description": "osd_op(client.4668.0:100249 5.b 5:d0666827:::benchmark_data_smithi006_114134_object100248:head [set-alloc-hint object_size 65536 write_size 65536,write 0~65536] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e37)", 2023-08-01T19:56:39.349 INFO:teuthology.orchestra.run.smithi155.stdout: "initiated_at": "2023-08-01T19:55:05.153614+0000", 2023-08-01T19:56:39.349 INFO:teuthology.orchestra.run.smithi155.stdout: "age": 94.135826280000003, 2023-08-01T19:56:39.349 INFO:teuthology.orchestra.run.smithi155.stdout: "duration": 0.069286118999999993, 2023-08-01T19:56:39.349 INFO:teuthology.orchestra.run.smithi155.stdout: "type_data": { 2023-08-01T19:56:39.349 INFO:teuthology.orchestra.run.smithi155.stdout: "flag_point": "commit sent; apply or cleanup", 2023-08-01T19:56:39.349 INFO:teuthology.orchestra.run.smithi155.stdout: "client_info": { 2023-08-01T19:56:39.349 INFO:teuthology.orchestra.run.smithi155.stdout: "client": "client.4668", 2023-08-01T19:56:39.349 INFO:teuthology.orchestra.run.smithi155.stdout: "client_addr": "172.21.15.6:0/1709472247", 2023-08-01T19:56:39.350 INFO:teuthology.orchestra.run.smithi155.stdout: "tid": 100249 2023-08-01T19:56:39.350 INFO:teuthology.orchestra.run.smithi155.stdout: }, 2023-08-01T19:56:39.350 INFO:teuthology.orchestra.run.smithi155.stdout: "events": [ 2023-08-01T19:56:39.350 INFO:teuthology.orchestra.run.smithi155.stdout: { 2023-08-01T19:56:39.350 INFO:teuthology.orchestra.run.smithi155.stdout: "event": "initiated", 2023-08-01T19:56:39.350 INFO:teuthology.orchestra.run.smithi155.stdout: "time": "2023-08-01T19:55:05.153614+0000", 2023-08-01T19:56:39.350 INFO:teuthology.orchestra.run.smithi155.stdout: "duration": 0 2023-08-01T19:56:39.350 INFO:teuthology.orchestra.run.smithi155.stdout: }, 2023-08-01T19:56:39.351 INFO:teuthology.orchestra.run.smithi155.stdout: { 2023-08-01T19:56:39.351 INFO:teuthology.orchestra.run.smithi155.stdout: "event": "throttled", 2023-08-01T19:56:39.351 INFO:teuthology.orchestra.run.smithi155.stdout: "time": "2023-08-01T19:55:05.153614+0000", 2023-08-01T19:56:39.351 INFO:teuthology.orchestra.run.smithi155.stdout: "duration": 0 2023-08-01T19:56:39.351 INFO:teuthology.orchestra.run.smithi155.stdout: }, 2023-08-01T19:56:39.351 INFO:teuthology.orchestra.run.smithi155.stdout: { 2023-08-01T19:56:39.351 INFO:teuthology.orchestra.run.smithi155.stdout: "event": "header_read", 2023-08-01T19:56:39.352 INFO:teuthology.orchestra.run.smithi155.stdout: "time": "2023-08-01T19:55:05.153612+0000", 2023-08-01T19:56:39.352 INFO:teuthology.orchestra.run.smithi155.stdout: "duration": 4294967295.9999986 2023-08-01T19:56:39.352 INFO:teuthology.orchestra.run.smithi155.stdout: }, 2023-08-01T19:56:39.352 INFO:teuthology.orchestra.run.smithi155.stdout: { 2023-08-01T19:56:39.352 INFO:teuthology.orchestra.run.smithi155.stdout: "event": "all_read", 2023-08-01T19:56:39.352 INFO:teuthology.orchestra.run.smithi155.stdout: "time": "2023-08-01T19:55:05.153694+0000", 2023-08-01T19:56:39.352 INFO:teuthology.orchestra.run.smithi155.stdout: "duration": 8.1618000000000004e-05 2023-08-01T19:56:39.352 INFO:teuthology.orchestra.run.smithi155.stdout: }, 2023-08-01T19:56:39.353 INFO:teuthology.orchestra.run.smithi155.stdout: { 2023-08-01T19:56:39.353 INFO:teuthology.orchestra.run.smithi155.stdout: "event": "dispatched", 2023-08-01T19:56:39.353 INFO:teuthology.orchestra.run.smithi155.stdout: "time": "2023-08-01T19:55:05.153713+0000", 2023-08-01T19:56:39.353 INFO:teuthology.orchestra.run.smithi155.stdout: "duration": 1.9069999999999999e-05 2023-08-01T19:56:39.353 INFO:teuthology.orchestra.run.smithi155.stdout: }, 2023-08-01T19:56:39.353 INFO:teuthology.orchestra.run.smithi155.stdout: { 2023-08-01T19:56:39.353 INFO:teuthology.orchestra.run.smithi155.stdout: "event": "queued_for_pg", 2023-08-01T19:56:39.353 INFO:teuthology.orchestra.run.smithi155.stdout: "time": "2023-08-01T19:55:05.153726+0000", 2023-08-01T19:56:39.354 INFO:teuthology.orchestra.run.smithi155.stdout: "duration": 1.238e-05 2023-08-01T19:56:39.354 INFO:teuthology.orchestra.run.smithi155.stdout: }, 2023-08-01T19:56:39.354 INFO:teuthology.orchestra.run.smithi155.stdout: { 2023-08-01T19:56:39.354 INFO:teuthology.orchestra.run.smithi155.stdout: "event": "reached_pg", 2023-08-01T19:56:39.354 INFO:teuthology.orchestra.run.smithi155.stdout: "time": "2023-08-01T19:55:05.153761+0000", 2023-08-01T19:56:39.354 INFO:teuthology.orchestra.run.smithi155.stdout: "duration": 3.5046999999999998e-05 2023-08-01T19:56:39.354 INFO:teuthology.orchestra.run.smithi155.stdout: }, 2023-08-01T19:56:39.355 INFO:teuthology.orchestra.run.smithi155.stdout: { 2023-08-01T19:56:39.355 INFO:teuthology.orchestra.run.smithi155.stdout: "event": "started", 2023-08-01T19:56:39.355 INFO:teuthology.orchestra.run.smithi155.stdout: "time": "2023-08-01T19:55:05.153896+0000", 2023-08-01T19:56:39.355 INFO:teuthology.orchestra.run.smithi155.stdout: "duration": 0.00013575800000000001 2023-08-01T19:56:39.355 INFO:teuthology.orchestra.run.smithi155.stdout: }, 2023-08-01T19:56:39.355 INFO:teuthology.orchestra.run.smithi155.stdout: { 2023-08-01T19:56:39.355 INFO:teuthology.orchestra.run.smithi155.stdout: "event": "waiting for subops from 0", 2023-08-01T19:56:39.355 INFO:teuthology.orchestra.run.smithi155.stdout: "time": "2023-08-01T19:55:05.154043+0000", 2023-08-01T19:56:39.356 INFO:teuthology.orchestra.run.smithi155.stdout: "duration": 0.00014650700000000001 2023-08-01T19:56:39.356 INFO:teuthology.orchestra.run.smithi155.stdout: }, 2023-08-01T19:56:39.356 INFO:teuthology.orchestra.run.smithi155.stdout: { 2023-08-01T19:56:39.356 INFO:teuthology.orchestra.run.smithi155.stdout: "event": "sub_op_commit_rec", 2023-08-01T19:56:39.356 INFO:teuthology.orchestra.run.smithi155.stdout: "time": "2023-08-01T19:55:05.221876+0000", 2023-08-01T19:56:39.356 INFO:teuthology.orchestra.run.smithi155.stdout: "duration": 0.067832796000000001 2023-08-01T19:56:39.356 INFO:teuthology.orchestra.run.smithi155.stdout: }, 2023-08-01T19:56:39.356 INFO:teuthology.orchestra.run.smithi155.stdout: { 2023-08-01T19:56:39.357 INFO:teuthology.orchestra.run.smithi155.stdout: "event": "op_commit", 2023-08-01T19:56:39.357 INFO:teuthology.orchestra.run.smithi155.stdout: "time": "2023-08-01T19:55:05.222813+0000", 2023-08-01T19:56:39.357 INFO:teuthology.orchestra.run.smithi155.stdout: "duration": 0.00093755300000000004 2023-08-01T19:56:39.357 INFO:teuthology.orchestra.run.smithi155.stdout: }, 2023-08-01T19:56:39.357 INFO:teuthology.orchestra.run.smithi155.stdout: { 2023-08-01T19:56:39.357 INFO:teuthology.orchestra.run.smithi155.stdout: "event": "commit_sent", 2023-08-01T19:56:39.357 INFO:teuthology.orchestra.run.smithi155.stdout: "time": "2023-08-01T19:55:05.222861+0000", 2023-08-01T19:56:39.357 INFO:teuthology.orchestra.run.smithi155.stdout: "duration": 4.8013999999999998e-05 2023-08-01T19:56:39.358 INFO:teuthology.orchestra.run.smithi155.stdout: }, 2023-08-01T19:56:39.358 INFO:teuthology.orchestra.run.smithi155.stdout: { 2023-08-01T19:56:39.358 INFO:teuthology.orchestra.run.smithi155.stdout: "event": "done", 2023-08-01T19:56:39.358 INFO:teuthology.orchestra.run.smithi155.stdout: "time": "2023-08-01T19:55:05.222900+0000", 2023-08-01T19:56:39.358 INFO:teuthology.orchestra.run.smithi155.stdout: "duration": 3.8634999999999999e-05 2023-08-01T19:56:39.358 INFO:teuthology.orchestra.run.smithi155.stdout: } 2023-08-01T19:56:39.358 INFO:teuthology.orchestra.run.smithi155.stdout: ] 2023-08-01T19:56:39.359 INFO:teuthology.orchestra.run.smithi155.stdout: } 2023-08-01T19:56:39.359 INFO:teuthology.orchestra.run.smithi155.stdout: }, 2023-08-01T19:56:39.359 INFO:teuthology.orchestra.run.smithi155.stdout: { 2023-08-01T19:56:39.359 INFO:teuthology.orchestra.run.smithi155.stdout: "description": "osd_op(client.4668.0:100251 5.b 5:d853df24:::benchmark_data_smithi006_114134_object100250:head [set-alloc-hint object_size 65536 write_size 65536,write 0~65536] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e37)", 2023-08-01T19:56:39.359 INFO:teuthology.orchestra.run.smithi155.stdout: "initiated_at": "2023-08-01T19:55:05.153737+0000", 2023-08-01T19:56:39.359 INFO:teuthology.orchestra.run.smithi155.stdout: "age": 94.135703265999993, 2023-08-01T19:56:39.359 INFO:teuthology.orchestra.run.smithi155.stdout: "duration": 0.071366545000000003, 2023-08-01T19:56:39.359 INFO:teuthology.orchestra.run.smithi155.stdout: "type_data": { 2023-08-01T19:56:39.360 INFO:teuthology.orchestra.run.smithi155.stdout: "flag_point": "commit sent; apply or cleanup", 2023-08-01T19:56:39.360 INFO:teuthology.orchestra.run.smithi155.stdout: "client_info": { 2023-08-01T19:56:39.360 INFO:teuthology.orchestra.run.smithi155.stdout: "client": "client.4668", 2023-08-01T19:56:39.360 INFO:teuthology.orchestra.run.smithi155.stdout: "client_addr": "172.21.15.6:0/1709472247", 2023-08-01T19:56:39.360 INFO:teuthology.orchestra.run.smithi155.stdout: "tid": 100251 2023-08-01T19:56:39.360 INFO:teuthology.orchestra.run.smithi155.stdout: }, 2023-08-01T19:56:39.360 INFO:teuthology.orchestra.run.smithi155.stdout: "events": [ 2023-08-01T19:56:39.360 INFO:teuthology.orchestra.run.smithi155.stdout: { 2023-08-01T19:56:39.361 INFO:teuthology.orchestra.run.smithi155.stdout: "event": "initiated", 2023-08-01T19:56:39.361 INFO:teuthology.orchestra.run.smithi155.stdout: "time": "2023-08-01T19:55:05.153737+0000", 2023-08-01T19:56:39.361 INFO:teuthology.orchestra.run.smithi155.stdout: "duration": 0 2023-08-01T19:56:39.361 INFO:teuthology.orchestra.run.smithi155.stdout: }, 2023-08-01T19:56:39.361 INFO:teuthology.orchestra.run.smithi155.stdout: { 2023-08-01T19:56:39.361 INFO:teuthology.orchestra.run.smithi155.stdout: "event": "throttled", 2023-08-01T19:56:39.361 INFO:teuthology.orchestra.run.smithi155.stdout: "time": "2023-08-01T19:55:05.153737+0000", 2023-08-01T19:56:39.362 INFO:teuthology.orchestra.run.smithi155.stdout: "duration": 0 2023-08-01T19:56:39.362 INFO:teuthology.orchestra.run.smithi155.stdout: }, 2023-08-01T19:56:39.362 INFO:teuthology.orchestra.run.smithi155.stdout: { 2023-08-01T19:56:39.362 INFO:teuthology.orchestra.run.smithi155.stdout: "event": "header_read", 2023-08-01T19:56:39.362 INFO:teuthology.orchestra.run.smithi155.stdout: "time": "2023-08-01T19:55:05.153736+0000", 2023-08-01T19:56:39.362 INFO:teuthology.orchestra.run.smithi155.stdout: "duration": 4294967295.9999995 2023-08-01T19:56:39.362 INFO:teuthology.orchestra.run.smithi155.stdout: }, 2023-08-01T19:56:39.363 INFO:teuthology.orchestra.run.smithi155.stdout: { 2023-08-01T19:56:39.363 INFO:teuthology.orchestra.run.smithi155.stdout: "event": "all_read", 2023-08-01T19:56:39.363 INFO:teuthology.orchestra.run.smithi155.stdout: "time": "2023-08-01T19:55:05.153784+0000", 2023-08-01T19:56:39.363 INFO:teuthology.orchestra.run.smithi155.stdout: "duration": 4.7660000000000001e-05 2023-08-01T19:56:39.363 INFO:teuthology.orchestra.run.smithi155.stdout: }, 2023-08-01T19:56:39.363 INFO:teuthology.orchestra.run.smithi155.stdout: { 2023-08-01T19:56:39.363 INFO:teuthology.orchestra.run.smithi155.stdout: "event": "dispatched", 2023-08-01T19:56:39.364 INFO:teuthology.orchestra.run.smithi155.stdout: "time": "2023-08-01T19:55:05.153793+0000", 2023-08-01T19:56:39.364 INFO:teuthology.orchestra.run.smithi155.stdout: "duration": 8.7150000000000004e-06 2023-08-01T19:56:39.364 INFO:teuthology.orchestra.run.smithi155.stdout: }, 2023-08-01T19:56:39.364 INFO:teuthology.orchestra.run.smithi155.stdout: { 2023-08-01T19:56:39.364 INFO:teuthology.orchestra.run.smithi155.stdout: "event": "queued_for_pg", 2023-08-01T19:56:39.364 INFO:teuthology.orchestra.run.smithi155.stdout: "time": "2023-08-01T19:55:05.153800+0000", 2023-08-01T19:56:39.364 INFO:teuthology.orchestra.run.smithi155.stdout: "duration": 7.2459999999999997e-06 2023-08-01T19:56:39.364 INFO:teuthology.orchestra.run.smithi155.stdout: }, 2023-08-01T19:56:39.365 INFO:teuthology.orchestra.run.smithi155.stdout: { 2023-08-01T19:56:39.365 INFO:teuthology.orchestra.run.smithi155.stdout: "event": "reached_pg", 2023-08-01T19:56:39.365 INFO:teuthology.orchestra.run.smithi155.stdout: "time": "2023-08-01T19:55:05.156241+0000", 2023-08-01T19:56:39.365 INFO:teuthology.orchestra.run.smithi155.stdout: "duration": 0.0024415359999999998 2023-08-01T19:56:39.365 INFO:teuthology.orchestra.run.smithi155.stdout: }, 2023-08-01T19:56:39.365 INFO:teuthology.orchestra.run.smithi155.stdout: { 2023-08-01T19:56:39.365 INFO:teuthology.orchestra.run.smithi155.stdout: "event": "started", 2023-08-01T19:56:39.365 INFO:teuthology.orchestra.run.smithi155.stdout: "time": "2023-08-01T19:55:05.219045+0000", 2023-08-01T19:56:39.366 INFO:teuthology.orchestra.run.smithi155.stdout: "duration": 0.062803855000000006 2023-08-01T19:56:39.366 INFO:teuthology.orchestra.run.smithi155.stdout: }, 2023-08-01T19:56:39.366 INFO:teuthology.orchestra.run.smithi155.stdout: { 2023-08-01T19:56:39.366 INFO:teuthology.orchestra.run.smithi155.stdout: "event": "waiting for subops from 0", 2023-08-01T19:56:39.366 INFO:teuthology.orchestra.run.smithi155.stdout: "time": "2023-08-01T19:55:05.219238+0000", 2023-08-01T19:56:39.366 INFO:teuthology.orchestra.run.smithi155.stdout: "duration": 0.00019241500000000001 2023-08-01T19:56:39.366 INFO:teuthology.orchestra.run.smithi155.stdout: }, 2023-08-01T19:56:39.367 INFO:teuthology.orchestra.run.smithi155.stdout: { 2023-08-01T19:56:39.367 INFO:teuthology.orchestra.run.smithi155.stdout: "event": "sub_op_commit_rec", 2023-08-01T19:56:39.367 INFO:teuthology.orchestra.run.smithi155.stdout: "time": "2023-08-01T19:55:05.223300+0000", 2023-08-01T19:56:39.367 INFO:teuthology.orchestra.run.smithi155.stdout: "duration": 0.0040626509999999996 2023-08-01T19:56:39.367 INFO:teuthology.orchestra.run.smithi155.stdout: }, 2023-08-01T19:56:39.367 INFO:teuthology.orchestra.run.smithi155.stdout: { 2023-08-01T19:56:39.367 INFO:teuthology.orchestra.run.smithi155.stdout: "event": "op_commit", 2023-08-01T19:56:39.367 INFO:teuthology.orchestra.run.smithi155.stdout: "time": "2023-08-01T19:55:05.225020+0000", 2023-08-01T19:56:39.368 INFO:teuthology.orchestra.run.smithi155.stdout: "duration": 0.0017201 2023-08-01T19:56:39.368 INFO:teuthology.orchestra.run.smithi155.stdout: }, 2023-08-01T19:56:39.368 INFO:teuthology.orchestra.run.smithi155.stdout: { 2023-08-01T19:56:39.368 INFO:teuthology.orchestra.run.smithi155.stdout: "event": "commit_sent", 2023-08-01T19:56:39.368 INFO:teuthology.orchestra.run.smithi155.stdout: "time": "2023-08-01T19:55:05.225066+0000", 2023-08-01T19:56:39.368 INFO:teuthology.orchestra.run.smithi155.stdout: "duration": 4.6143000000000002e-05 2023-08-01T19:56:39.368 INFO:teuthology.orchestra.run.smithi155.stdout: }, 2023-08-01T19:56:39.368 INFO:teuthology.orchestra.run.smithi155.stdout: { 2023-08-01T19:56:39.369 INFO:teuthology.orchestra.run.smithi155.stdout: "event": "done", 2023-08-01T19:56:39.369 INFO:teuthology.orchestra.run.smithi155.stdout: "time": "2023-08-01T19:55:05.225103+0000", 2023-08-01T19:56:39.369 INFO:teuthology.orchestra.run.smithi155.stdout: "duration": 3.6789999999999998e-05 2023-08-01T19:56:39.369 INFO:teuthology.orchestra.run.smithi155.stdout: } 2023-08-01T19:56:39.369 INFO:teuthology.orchestra.run.smithi155.stdout: ] 2023-08-01T19:56:39.369 INFO:teuthology.orchestra.run.smithi155.stdout: } 2023-08-01T19:56:39.369 INFO:teuthology.orchestra.run.smithi155.stdout: }, 2023-08-01T19:56:39.370 INFO:teuthology.orchestra.run.smithi155.stdout: { 2023-08-01T19:56:39.370 INFO:teuthology.orchestra.run.smithi155.stdout: "description": "osd_op(client.4668.0:100252 5.0 5:01f90c3c:::benchmark_data_smithi006_114134_object100251:head [set-alloc-hint object_size 65536 write_size 65536,write 0~65536] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e37)", 2023-08-01T19:56:39.370 INFO:teuthology.orchestra.run.smithi155.stdout: "initiated_at": "2023-08-01T19:55:05.154048+0000", 2023-08-01T19:56:39.370 INFO:teuthology.orchestra.run.smithi155.stdout: "age": 94.135392018999994, 2023-08-01T19:56:39.370 INFO:teuthology.orchestra.run.smithi155.stdout: "duration": 0.070156683999999997, 2023-08-01T19:56:39.370 INFO:teuthology.orchestra.run.smithi155.stdout: "type_data": { 2023-08-01T19:56:39.370 INFO:teuthology.orchestra.run.smithi155.stdout: "flag_point": "commit sent; apply or cleanup", 2023-08-01T19:56:39.370 INFO:teuthology.orchestra.run.smithi155.stdout: "client_info": { 2023-08-01T19:56:39.371 INFO:teuthology.orchestra.run.smithi155.stdout: "client": "client.4668", 2023-08-01T19:56:39.371 INFO:teuthology.orchestra.run.smithi155.stdout: "client_addr": "172.21.15.6:0/1709472247", 2023-08-01T19:56:39.371 INFO:teuthology.orchestra.run.smithi155.stdout: "tid": 100252 2023-08-01T19:56:39.371 INFO:teuthology.orchestra.run.smithi155.stdout: }, 2023-08-01T19:56:39.371 INFO:teuthology.orchestra.run.smithi155.stdout: "events": [ 2023-08-01T19:56:39.371 INFO:teuthology.orchestra.run.smithi155.stdout: { 2023-08-01T19:56:39.371 INFO:teuthology.orchestra.run.smithi155.stdout: "event": "initiated", 2023-08-01T19:56:39.371 INFO:teuthology.orchestra.run.smithi155.stdout: "time": "2023-08-01T19:55:05.154048+0000", 2023-08-01T19:56:39.372 INFO:teuthology.orchestra.run.smithi155.stdout: "duration": 0 2023-08-01T19:56:39.372 INFO:teuthology.orchestra.run.smithi155.stdout: }, 2023-08-01T19:56:39.372 INFO:teuthology.orchestra.run.smithi155.stdout: { 2023-08-01T19:56:39.372 INFO:teuthology.orchestra.run.smithi155.stdout: "event": "throttled", 2023-08-01T19:56:39.372 INFO:teuthology.orchestra.run.smithi155.stdout: "time": "2023-08-01T19:55:05.154048+0000", 2023-08-01T19:56:39.372 INFO:teuthology.orchestra.run.smithi155.stdout: "duration": 0 2023-08-01T19:56:39.372 INFO:teuthology.orchestra.run.smithi155.stdout: }, 2023-08-01T19:56:39.373 INFO:teuthology.orchestra.run.smithi155.stdout: { 2023-08-01T19:56:39.373 INFO:teuthology.orchestra.run.smithi155.stdout: "event": "header_read", 2023-08-01T19:56:39.373 INFO:teuthology.orchestra.run.smithi155.stdout: "time": "2023-08-01T19:55:05.154047+0000", 2023-08-01T19:56:39.373 INFO:teuthology.orchestra.run.smithi155.stdout: "duration": 4294967295.999999 2023-08-01T19:56:39.373 INFO:teuthology.orchestra.run.smithi155.stdout: }, 2023-08-01T19:56:39.373 INFO:teuthology.orchestra.run.smithi155.stdout: { 2023-08-01T19:56:39.373 INFO:teuthology.orchestra.run.smithi155.stdout: "event": "all_read", 2023-08-01T19:56:39.373 INFO:teuthology.orchestra.run.smithi155.stdout: "time": "2023-08-01T19:55:05.154115+0000", 2023-08-01T19:56:39.374 INFO:teuthology.orchestra.run.smithi155.stdout: "duration": 6.7545999999999993e-05 2023-08-01T19:56:39.374 INFO:teuthology.orchestra.run.smithi155.stdout: }, 2023-08-01T19:56:39.374 INFO:teuthology.orchestra.run.smithi155.stdout: { 2023-08-01T19:56:39.374 INFO:teuthology.orchestra.run.smithi155.stdout: "event": "dispatched", 2023-08-01T19:56:39.374 INFO:teuthology.orchestra.run.smithi155.stdout: "time": "2023-08-01T19:55:05.154125+0000", 2023-08-01T19:56:39.374 INFO:teuthology.orchestra.run.smithi155.stdout: "duration": 1.0669000000000001e-05 2023-08-01T19:56:39.374 INFO:teuthology.orchestra.run.smithi155.stdout: }, 2023-08-01T19:56:39.374 INFO:teuthology.orchestra.run.smithi155.stdout: { 2023-08-01T19:56:39.375 INFO:teuthology.orchestra.run.smithi155.stdout: "event": "queued_for_pg", 2023-08-01T19:56:39.375 INFO:teuthology.orchestra.run.smithi155.stdout: "time": "2023-08-01T19:55:05.154131+0000", 2023-08-01T19:56:39.375 INFO:teuthology.orchestra.run.smithi155.stdout: "duration": 6.0349999999999998e-06 2023-08-01T19:56:39.375 INFO:teuthology.orchestra.run.smithi155.stdout: }, 2023-08-01T19:56:39.375 INFO:teuthology.orchestra.run.smithi155.stdout: { 2023-08-01T19:56:39.375 INFO:teuthology.orchestra.run.smithi155.stdout: "event": "reached_pg", 2023-08-01T19:56:39.375 INFO:teuthology.orchestra.run.smithi155.stdout: "time": "2023-08-01T19:55:05.154174+0000", 2023-08-01T19:56:39.375 INFO:teuthology.orchestra.run.smithi155.stdout: "duration": 4.2429000000000003e-05 2023-08-01T19:56:39.376 INFO:teuthology.orchestra.run.smithi155.stdout: }, 2023-08-01T19:56:39.376 INFO:teuthology.orchestra.run.smithi155.stdout: { 2023-08-01T19:56:39.376 INFO:teuthology.orchestra.run.smithi155.stdout: "event": "started", 2023-08-01T19:56:39.376 INFO:teuthology.orchestra.run.smithi155.stdout: "time": "2023-08-01T19:55:05.154287+0000", 2023-08-01T19:56:39.376 INFO:teuthology.orchestra.run.smithi155.stdout: "duration": 0.000113138 2023-08-01T19:56:39.376 INFO:teuthology.orchestra.run.smithi155.stdout: }, 2023-08-01T19:56:39.376 INFO:teuthology.orchestra.run.smithi155.stdout: { 2023-08-01T19:56:39.376 INFO:teuthology.orchestra.run.smithi155.stdout: "event": "waiting for subops from 0", 2023-08-01T19:56:39.377 INFO:teuthology.orchestra.run.smithi155.stdout: "time": "2023-08-01T19:55:05.154420+0000", 2023-08-01T19:56:39.377 INFO:teuthology.orchestra.run.smithi155.stdout: "duration": 0.000133292 2023-08-01T19:56:39.377 INFO:teuthology.orchestra.run.smithi155.stdout: }, 2023-08-01T19:56:39.377 INFO:teuthology.orchestra.run.smithi155.stdout: { 2023-08-01T19:56:39.377 INFO:teuthology.orchestra.run.smithi155.stdout: "event": "sub_op_commit_rec", 2023-08-01T19:56:39.377 INFO:teuthology.orchestra.run.smithi155.stdout: "time": "2023-08-01T19:55:05.219034+0000", 2023-08-01T19:56:39.377 INFO:teuthology.orchestra.run.smithi155.stdout: "duration": 0.064613429999999999 2023-08-01T19:56:39.378 INFO:teuthology.orchestra.run.smithi155.stdout: }, 2023-08-01T19:56:39.378 INFO:teuthology.orchestra.run.smithi155.stdout: { 2023-08-01T19:56:39.378 INFO:teuthology.orchestra.run.smithi155.stdout: "event": "op_commit", 2023-08-01T19:56:39.378 INFO:teuthology.orchestra.run.smithi155.stdout: "time": "2023-08-01T19:55:05.224138+0000", 2023-08-01T19:56:39.378 INFO:teuthology.orchestra.run.smithi155.stdout: "duration": 0.0051041999999999997 2023-08-01T19:56:39.378 INFO:teuthology.orchestra.run.smithi155.stdout: }, 2023-08-01T19:56:39.378 INFO:teuthology.orchestra.run.smithi155.stdout: { 2023-08-01T19:56:39.378 INFO:teuthology.orchestra.run.smithi155.stdout: "event": "commit_sent", 2023-08-01T19:56:39.379 INFO:teuthology.orchestra.run.smithi155.stdout: "time": "2023-08-01T19:55:05.224171+0000", 2023-08-01T19:56:39.379 INFO:teuthology.orchestra.run.smithi155.stdout: "duration": 3.3345e-05 2023-08-01T19:56:39.379 INFO:teuthology.orchestra.run.smithi155.stdout: }, 2023-08-01T19:56:39.379 INFO:teuthology.orchestra.run.smithi155.stdout: { 2023-08-01T19:56:39.379 INFO:teuthology.orchestra.run.smithi155.stdout: "event": "done", 2023-08-01T19:56:39.379 INFO:teuthology.orchestra.run.smithi155.stdout: "time": "2023-08-01T19:55:05.224205+0000", 2023-08-01T19:56:39.379 INFO:teuthology.orchestra.run.smithi155.stdout: "duration": 3.3525999999999997e-05 2023-08-01T19:56:39.379 INFO:teuthology.orchestra.run.smithi155.stdout: } 2023-08-01T19:56:39.380 INFO:teuthology.orchestra.run.smithi155.stdout: ] 2023-08-01T19:56:39.380 INFO:teuthology.orchestra.run.smithi155.stdout: } 2023-08-01T19:56:39.380 INFO:teuthology.orchestra.run.smithi155.stdout: }, 2023-08-01T19:56:39.380 INFO:teuthology.orchestra.run.smithi155.stdout: { 2023-08-01T19:56:39.380 INFO:teuthology.orchestra.run.smithi155.stdout: "description": "osd_repop_reply(client.4668.0:100237 5.4 e37/19 ondisk, result = 0)", 2023-08-01T19:56:39.380 INFO:teuthology.orchestra.run.smithi155.stdout: "initiated_at": "2023-08-01T19:55:05.156249+0000", 2023-08-01T19:56:39.380 INFO:teuthology.orchestra.run.smithi155.stdout: "age": 94.133191073999996, 2023-08-01T19:56:39.380 INFO:teuthology.orchestra.run.smithi155.stdout: "duration": 0.062792549000000003, 2023-08-01T19:56:39.381 INFO:teuthology.orchestra.run.smithi155.stdout: "type_data": { 2023-08-01T19:56:39.381 INFO:teuthology.orchestra.run.smithi155.stdout: "flag_point": "started", 2023-08-01T19:56:39.381 INFO:teuthology.orchestra.run.smithi155.stdout: "events": [ 2023-08-01T19:56:39.381 INFO:teuthology.orchestra.run.smithi155.stdout: { 2023-08-01T19:56:39.381 INFO:teuthology.orchestra.run.smithi155.stdout: "event": "initiated", 2023-08-01T19:56:39.381 INFO:teuthology.orchestra.run.smithi155.stdout: "time": "2023-08-01T19:55:05.156249+0000", 2023-08-01T19:56:39.381 INFO:teuthology.orchestra.run.smithi155.stdout: "duration": 0 2023-08-01T19:56:39.382 INFO:teuthology.orchestra.run.smithi155.stdout: }, 2023-08-01T19:56:39.382 INFO:teuthology.orchestra.run.smithi155.stdout: { 2023-08-01T19:56:39.382 INFO:teuthology.orchestra.run.smithi155.stdout: "event": "throttled", 2023-08-01T19:56:39.382 INFO:teuthology.orchestra.run.smithi155.stdout: "time": "2023-08-01T19:55:05.156249+0000", 2023-08-01T19:56:39.382 INFO:teuthology.orchestra.run.smithi155.stdout: "duration": 0 2023-08-01T19:56:39.382 INFO:teuthology.orchestra.run.smithi155.stdout: }, 2023-08-01T19:56:39.382 INFO:teuthology.orchestra.run.smithi155.stdout: { 2023-08-01T19:56:39.382 INFO:teuthology.orchestra.run.smithi155.stdout: "event": "header_read", 2023-08-01T19:56:39.383 INFO:teuthology.orchestra.run.smithi155.stdout: "time": "2023-08-01T19:55:05.156248+0000", 2023-08-01T19:56:39.383 INFO:teuthology.orchestra.run.smithi155.stdout: "duration": 4294967295.9999995 2023-08-01T19:56:39.383 INFO:teuthology.orchestra.run.smithi155.stdout: }, 2023-08-01T19:56:39.383 INFO:teuthology.orchestra.run.smithi155.stdout: { 2023-08-01T19:56:39.383 INFO:teuthology.orchestra.run.smithi155.stdout: "event": "all_read", 2023-08-01T19:56:39.383 INFO:teuthology.orchestra.run.smithi155.stdout: "time": "2023-08-01T19:55:05.156252+0000", 2023-08-01T19:56:39.383 INFO:teuthology.orchestra.run.smithi155.stdout: "duration": 3.9999999999999998e-06 2023-08-01T19:56:39.383 INFO:teuthology.orchestra.run.smithi155.stdout: }, 2023-08-01T19:56:39.384 INFO:teuthology.orchestra.run.smithi155.stdout: { 2023-08-01T19:56:39.384 INFO:teuthology.orchestra.run.smithi155.stdout: "event": "dispatched", 2023-08-01T19:56:39.384 INFO:teuthology.orchestra.run.smithi155.stdout: "time": "2023-08-01T19:55:05.218844+0000", 2023-08-01T19:56:39.384 INFO:teuthology.orchestra.run.smithi155.stdout: "duration": 0.062591516999999999 2023-08-01T19:56:39.384 INFO:teuthology.orchestra.run.smithi155.stdout: }, 2023-08-01T19:56:39.384 INFO:teuthology.orchestra.run.smithi155.stdout: { 2023-08-01T19:56:39.384 INFO:teuthology.orchestra.run.smithi155.stdout: "event": "queued_for_pg", 2023-08-01T19:56:39.384 INFO:teuthology.orchestra.run.smithi155.stdout: "time": "2023-08-01T19:55:05.218862+0000", 2023-08-01T19:56:39.385 INFO:teuthology.orchestra.run.smithi155.stdout: "duration": 1.7666e-05 2023-08-01T19:56:39.385 INFO:teuthology.orchestra.run.smithi155.stdout: }, 2023-08-01T19:56:39.385 INFO:teuthology.orchestra.run.smithi155.stdout: { 2023-08-01T19:56:39.385 INFO:teuthology.orchestra.run.smithi155.stdout: "event": "reached_pg", 2023-08-01T19:56:39.385 INFO:teuthology.orchestra.run.smithi155.stdout: "time": "2023-08-01T19:55:05.218914+0000", 2023-08-01T19:56:39.385 INFO:teuthology.orchestra.run.smithi155.stdout: "duration": 5.2565999999999998e-05 2023-08-01T19:56:39.385 INFO:teuthology.orchestra.run.smithi155.stdout: }, 2023-08-01T19:56:39.385 INFO:teuthology.orchestra.run.smithi155.stdout: { 2023-08-01T19:56:39.386 INFO:teuthology.orchestra.run.smithi155.stdout: "event": "started", 2023-08-01T19:56:39.386 INFO:teuthology.orchestra.run.smithi155.stdout: "time": "2023-08-01T19:55:05.218925+0000", 2023-08-01T19:56:39.386 INFO:teuthology.orchestra.run.smithi155.stdout: "duration": 1.1375e-05 2023-08-01T19:56:39.386 INFO:teuthology.orchestra.run.smithi155.stdout: }, 2023-08-01T19:56:39.386 INFO:teuthology.orchestra.run.smithi155.stdout: { 2023-08-01T19:56:39.386 INFO:teuthology.orchestra.run.smithi155.stdout: "event": "done", 2023-08-01T19:56:39.386 INFO:teuthology.orchestra.run.smithi155.stdout: "time": "2023-08-01T19:55:05.219041+0000", 2023-08-01T19:56:39.387 INFO:teuthology.orchestra.run.smithi155.stdout: "duration": 0.000115977 2023-08-01T19:56:39.387 INFO:teuthology.orchestra.run.smithi155.stdout: } 2023-08-01T19:56:39.387 INFO:teuthology.orchestra.run.smithi155.stdout: ] 2023-08-01T19:56:39.387 INFO:teuthology.orchestra.run.smithi155.stdout: } 2023-08-01T19:56:39.387 INFO:teuthology.orchestra.run.smithi155.stdout: }, 2023-08-01T19:56:39.387 INFO:teuthology.orchestra.run.smithi155.stdout: { 2023-08-01T19:56:39.387 INFO:teuthology.orchestra.run.smithi155.stdout: "description": "osd_repop(client.4668.0:100253 5.f e37/19 5:f7bbce05:::benchmark_data_smithi006_114134_object100252:head v 37'6323, mlcod=37'6321)", 2023-08-01T19:56:39.387 INFO:teuthology.orchestra.run.smithi155.stdout: "initiated_at": "2023-08-01T19:55:05.156952+0000", 2023-08-01T19:56:39.388 INFO:teuthology.orchestra.run.smithi155.stdout: "age": 94.132488011000007, 2023-08-01T19:56:39.388 INFO:teuthology.orchestra.run.smithi155.stdout: "duration": 0.068018577999999996, 2023-08-01T19:56:39.388 INFO:teuthology.orchestra.run.smithi155.stdout: "type_data": { 2023-08-01T19:56:39.388 INFO:teuthology.orchestra.run.smithi155.stdout: "flag_point": "commit sent; apply or cleanup", 2023-08-01T19:56:39.388 INFO:teuthology.orchestra.run.smithi155.stdout: "events": [ 2023-08-01T19:56:39.388 INFO:teuthology.orchestra.run.smithi155.stdout: { 2023-08-01T19:56:39.388 INFO:teuthology.orchestra.run.smithi155.stdout: "event": "initiated", 2023-08-01T19:56:39.388 INFO:teuthology.orchestra.run.smithi155.stdout: "time": "2023-08-01T19:55:05.156952+0000", 2023-08-01T19:56:39.389 INFO:teuthology.orchestra.run.smithi155.stdout: "duration": 0 2023-08-01T19:56:39.389 INFO:teuthology.orchestra.run.smithi155.stdout: }, 2023-08-01T19:56:39.389 INFO:teuthology.orchestra.run.smithi155.stdout: { 2023-08-01T19:56:39.389 INFO:teuthology.orchestra.run.smithi155.stdout: "event": "throttled", 2023-08-01T19:56:39.389 INFO:teuthology.orchestra.run.smithi155.stdout: "time": "2023-08-01T19:55:05.156952+0000", 2023-08-01T19:56:39.389 INFO:teuthology.orchestra.run.smithi155.stdout: "duration": 0 2023-08-01T19:56:39.389 INFO:teuthology.orchestra.run.smithi155.stdout: }, 2023-08-01T19:56:39.389 INFO:teuthology.orchestra.run.smithi155.stdout: { 2023-08-01T19:56:39.390 INFO:teuthology.orchestra.run.smithi155.stdout: "event": "header_read", 2023-08-01T19:56:39.390 INFO:teuthology.orchestra.run.smithi155.stdout: "time": "2023-08-01T19:55:05.156951+0000", 2023-08-01T19:56:39.390 INFO:teuthology.orchestra.run.smithi155.stdout: "duration": 4294967295.999999 2023-08-01T19:56:39.390 INFO:teuthology.orchestra.run.smithi155.stdout: }, 2023-08-01T19:56:39.390 INFO:teuthology.orchestra.run.smithi155.stdout: { 2023-08-01T19:56:39.390 INFO:teuthology.orchestra.run.smithi155.stdout: "event": "all_read", 2023-08-01T19:56:39.390 INFO:teuthology.orchestra.run.smithi155.stdout: "time": "2023-08-01T19:55:05.156989+0000", 2023-08-01T19:56:39.391 INFO:teuthology.orchestra.run.smithi155.stdout: "duration": 3.8175e-05 2023-08-01T19:56:39.391 INFO:teuthology.orchestra.run.smithi155.stdout: }, 2023-08-01T19:56:39.391 INFO:teuthology.orchestra.run.smithi155.stdout: { 2023-08-01T19:56:39.391 INFO:teuthology.orchestra.run.smithi155.stdout: "event": "dispatched", 2023-08-01T19:56:39.391 INFO:teuthology.orchestra.run.smithi155.stdout: "time": "2023-08-01T19:55:05.218842+0000", 2023-08-01T19:56:39.391 INFO:teuthology.orchestra.run.smithi155.stdout: "duration": 0.061852299999999999 2023-08-01T19:56:39.391 INFO:teuthology.orchestra.run.smithi155.stdout: }, 2023-08-01T19:56:39.391 INFO:teuthology.orchestra.run.smithi155.stdout: { 2023-08-01T19:56:39.392 INFO:teuthology.orchestra.run.smithi155.stdout: "event": "queued_for_pg", 2023-08-01T19:56:39.392 INFO:teuthology.orchestra.run.smithi155.stdout: "time": "2023-08-01T19:55:05.218862+0000", 2023-08-01T19:56:39.392 INFO:teuthology.orchestra.run.smithi155.stdout: "duration": 1.9854999999999999e-05 2023-08-01T19:56:39.392 INFO:teuthology.orchestra.run.smithi155.stdout: }, 2023-08-01T19:56:39.392 INFO:teuthology.orchestra.run.smithi155.stdout: { 2023-08-01T19:56:39.392 INFO:teuthology.orchestra.run.smithi155.stdout: "event": "reached_pg", 2023-08-01T19:56:39.392 INFO:teuthology.orchestra.run.smithi155.stdout: "time": "2023-08-01T19:55:05.218918+0000", 2023-08-01T19:56:39.392 INFO:teuthology.orchestra.run.smithi155.stdout: "duration": 5.6570000000000002e-05 2023-08-01T19:56:39.393 INFO:teuthology.orchestra.run.smithi155.stdout: }, 2023-08-01T19:56:39.393 INFO:teuthology.orchestra.run.smithi155.stdout: { 2023-08-01T19:56:39.393 INFO:teuthology.orchestra.run.smithi155.stdout: "event": "started", 2023-08-01T19:56:39.393 INFO:teuthology.orchestra.run.smithi155.stdout: "time": "2023-08-01T19:55:05.218940+0000", 2023-08-01T19:56:39.393 INFO:teuthology.orchestra.run.smithi155.stdout: "duration": 2.1804e-05 2023-08-01T19:56:39.393 INFO:teuthology.orchestra.run.smithi155.stdout: }, 2023-08-01T19:56:39.393 INFO:teuthology.orchestra.run.smithi155.stdout: { 2023-08-01T19:56:39.394 INFO:teuthology.orchestra.run.smithi155.stdout: "event": "commit_sent", 2023-08-01T19:56:39.394 INFO:teuthology.orchestra.run.smithi155.stdout: "time": "2023-08-01T19:55:05.224928+0000", 2023-08-01T19:56:39.394 INFO:teuthology.orchestra.run.smithi155.stdout: "duration": 0.0059876759999999999 2023-08-01T19:56:39.394 INFO:teuthology.orchestra.run.smithi155.stdout: }, 2023-08-01T19:56:39.394 INFO:teuthology.orchestra.run.smithi155.stdout: { 2023-08-01T19:56:39.394 INFO:teuthology.orchestra.run.smithi155.stdout: "event": "done", 2023-08-01T19:56:39.394 INFO:teuthology.orchestra.run.smithi155.stdout: "time": "2023-08-01T19:55:05.224971+0000", 2023-08-01T19:56:39.394 INFO:teuthology.orchestra.run.smithi155.stdout: "duration": 4.2929999999999997e-05 2023-08-01T19:56:39.395 INFO:teuthology.orchestra.run.smithi155.stdout: } 2023-08-01T19:56:39.395 INFO:teuthology.orchestra.run.smithi155.stdout: ] 2023-08-01T19:56:39.395 INFO:teuthology.orchestra.run.smithi155.stdout: } 2023-08-01T19:56:39.395 INFO:teuthology.orchestra.run.smithi155.stdout: }, 2023-08-01T19:56:39.395 INFO:teuthology.orchestra.run.smithi155.stdout: { 2023-08-01T19:56:39.395 INFO:teuthology.orchestra.run.smithi155.stdout: "description": "osd_op(client.4668.0:100927 5.0 5:00608ec6:::benchmark_data_smithi006_114134_object100926:head [set-alloc-hint object_size 65536 write_size 65536,write 0~65536] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e37)", 2023-08-01T19:56:39.395 INFO:teuthology.orchestra.run.smithi155.stdout: "initiated_at": "2023-08-01T19:55:05.561169+0000", 2023-08-01T19:56:39.395 INFO:teuthology.orchestra.run.smithi155.stdout: "age": 93.728271108000001, 2023-08-01T19:56:39.396 INFO:teuthology.orchestra.run.smithi155.stdout: "duration": 0.066411687999999997, 2023-08-01T19:56:39.396 INFO:teuthology.orchestra.run.smithi155.stdout: "type_data": { 2023-08-01T19:56:39.396 INFO:teuthology.orchestra.run.smithi155.stdout: "flag_point": "commit sent; apply or cleanup", 2023-08-01T19:56:39.396 INFO:teuthology.orchestra.run.smithi155.stdout: "client_info": { 2023-08-01T19:56:39.396 INFO:teuthology.orchestra.run.smithi155.stdout: "client": "client.4668", 2023-08-01T19:56:39.396 INFO:teuthology.orchestra.run.smithi155.stdout: "client_addr": "172.21.15.6:0/1709472247", 2023-08-01T19:56:39.396 INFO:teuthology.orchestra.run.smithi155.stdout: "tid": 100927 2023-08-01T19:56:39.396 INFO:teuthology.orchestra.run.smithi155.stdout: }, 2023-08-01T19:56:39.397 INFO:teuthology.orchestra.run.smithi155.stdout: "events": [ 2023-08-01T19:56:39.397 INFO:teuthology.orchestra.run.smithi155.stdout: { 2023-08-01T19:56:39.397 INFO:teuthology.orchestra.run.smithi155.stdout: "event": "initiated", 2023-08-01T19:56:39.397 INFO:teuthology.orchestra.run.smithi155.stdout: "time": "2023-08-01T19:55:05.561169+0000", 2023-08-01T19:56:39.397 INFO:teuthology.orchestra.run.smithi155.stdout: "duration": 0 2023-08-01T19:56:39.397 INFO:teuthology.orchestra.run.smithi155.stdout: }, 2023-08-01T19:56:39.397 INFO:teuthology.orchestra.run.smithi155.stdout: { 2023-08-01T19:56:39.398 INFO:teuthology.orchestra.run.smithi155.stdout: "event": "throttled", 2023-08-01T19:56:39.398 INFO:teuthology.orchestra.run.smithi155.stdout: "time": "2023-08-01T19:55:05.561169+0000", 2023-08-01T19:56:39.398 INFO:teuthology.orchestra.run.smithi155.stdout: "duration": 0 2023-08-01T19:56:39.398 INFO:teuthology.orchestra.run.smithi155.stdout: }, 2023-08-01T19:56:39.398 INFO:teuthology.orchestra.run.smithi155.stdout: { 2023-08-01T19:56:39.398 INFO:teuthology.orchestra.run.smithi155.stdout: "event": "header_read", 2023-08-01T19:56:39.398 INFO:teuthology.orchestra.run.smithi155.stdout: "time": "2023-08-01T19:55:05.561168+0000", 2023-08-01T19:56:39.398 INFO:teuthology.orchestra.run.smithi155.stdout: "duration": 4294967295.9999995 2023-08-01T19:56:39.399 INFO:teuthology.orchestra.run.smithi155.stdout: }, 2023-08-01T19:56:39.399 INFO:teuthology.orchestra.run.smithi155.stdout: { 2023-08-01T19:56:39.399 INFO:teuthology.orchestra.run.smithi155.stdout: "event": "all_read", 2023-08-01T19:56:39.399 INFO:teuthology.orchestra.run.smithi155.stdout: "time": "2023-08-01T19:55:05.561218+0000", 2023-08-01T19:56:39.399 INFO:teuthology.orchestra.run.smithi155.stdout: "duration": 4.9379999999999998e-05 2023-08-01T19:56:39.399 INFO:teuthology.orchestra.run.smithi155.stdout: }, 2023-08-01T19:56:39.399 INFO:teuthology.orchestra.run.smithi155.stdout: { 2023-08-01T19:56:39.399 INFO:teuthology.orchestra.run.smithi155.stdout: "event": "dispatched", 2023-08-01T19:56:39.400 INFO:teuthology.orchestra.run.smithi155.stdout: "time": "2023-08-01T19:55:05.561225+0000", 2023-08-01T19:56:39.400 INFO:teuthology.orchestra.run.smithi155.stdout: "duration": 7.114e-06 2023-08-01T19:56:39.400 INFO:teuthology.orchestra.run.smithi155.stdout: }, 2023-08-01T19:56:39.400 INFO:teuthology.orchestra.run.smithi155.stdout: { 2023-08-01T19:56:39.400 INFO:teuthology.orchestra.run.smithi155.stdout: "event": "queued_for_pg", 2023-08-01T19:56:39.400 INFO:teuthology.orchestra.run.smithi155.stdout: "time": "2023-08-01T19:55:05.561229+0000", 2023-08-01T19:56:39.400 INFO:teuthology.orchestra.run.smithi155.stdout: "duration": 4.2180000000000001e-06 2023-08-01T19:56:39.400 INFO:teuthology.orchestra.run.smithi155.stdout: }, 2023-08-01T19:56:39.401 INFO:teuthology.orchestra.run.smithi155.stdout: { 2023-08-01T19:56:39.401 INFO:teuthology.orchestra.run.smithi155.stdout: "event": "reached_pg", 2023-08-01T19:56:39.401 INFO:teuthology.orchestra.run.smithi155.stdout: "time": "2023-08-01T19:55:05.564737+0000", 2023-08-01T19:56:39.401 INFO:teuthology.orchestra.run.smithi155.stdout: "duration": 0.0035081869999999999 2023-08-01T19:56:39.401 INFO:teuthology.orchestra.run.smithi155.stdout: }, 2023-08-01T19:56:39.401 INFO:teuthology.orchestra.run.smithi155.stdout: { 2023-08-01T19:56:39.401 INFO:teuthology.orchestra.run.smithi155.stdout: "event": "started", 2023-08-01T19:56:39.402 INFO:teuthology.orchestra.run.smithi155.stdout: "time": "2023-08-01T19:55:05.564859+0000", 2023-08-01T19:56:39.402 INFO:teuthology.orchestra.run.smithi155.stdout: "duration": 0.00012165800000000001 2023-08-01T19:56:39.402 INFO:teuthology.orchestra.run.smithi155.stdout: }, 2023-08-01T19:56:39.402 INFO:teuthology.orchestra.run.smithi155.stdout: { 2023-08-01T19:56:39.402 INFO:teuthology.orchestra.run.smithi155.stdout: "event": "waiting for subops from 0", 2023-08-01T19:56:39.402 INFO:teuthology.orchestra.run.smithi155.stdout: "time": "2023-08-01T19:55:05.565009+0000", 2023-08-01T19:56:39.402 INFO:teuthology.orchestra.run.smithi155.stdout: "duration": 0.00014979699999999999 2023-08-01T19:56:39.402 INFO:teuthology.orchestra.run.smithi155.stdout: }, 2023-08-01T19:56:39.403 INFO:teuthology.orchestra.run.smithi155.stdout: { 2023-08-01T19:56:39.403 INFO:teuthology.orchestra.run.smithi155.stdout: "event": "op_commit", 2023-08-01T19:56:39.403 INFO:teuthology.orchestra.run.smithi155.stdout: "time": "2023-08-01T19:55:05.568007+0000", 2023-08-01T19:56:39.403 INFO:teuthology.orchestra.run.smithi155.stdout: "duration": 0.00299796 2023-08-01T19:56:39.403 INFO:teuthology.orchestra.run.smithi155.stdout: }, 2023-08-01T19:56:39.403 INFO:teuthology.orchestra.run.smithi155.stdout: { 2023-08-01T19:56:39.403 INFO:teuthology.orchestra.run.smithi155.stdout: "event": "sub_op_commit_rec", 2023-08-01T19:56:39.403 INFO:teuthology.orchestra.run.smithi155.stdout: "time": "2023-08-01T19:55:05.627520+0000", 2023-08-01T19:56:39.404 INFO:teuthology.orchestra.run.smithi155.stdout: "duration": 0.059513636000000002 2023-08-01T19:56:39.404 INFO:teuthology.orchestra.run.smithi155.stdout: }, 2023-08-01T19:56:39.404 INFO:teuthology.orchestra.run.smithi155.stdout: { 2023-08-01T19:56:39.404 INFO:teuthology.orchestra.run.smithi155.stdout: "event": "commit_sent", 2023-08-01T19:56:39.404 INFO:teuthology.orchestra.run.smithi155.stdout: "time": "2023-08-01T19:55:05.627553+0000", 2023-08-01T19:56:39.404 INFO:teuthology.orchestra.run.smithi155.stdout: "duration": 3.2635999999999997e-05 2023-08-01T19:56:39.404 INFO:teuthology.orchestra.run.smithi155.stdout: }, 2023-08-01T19:56:39.404 INFO:teuthology.orchestra.run.smithi155.stdout: { 2023-08-01T19:56:39.405 INFO:teuthology.orchestra.run.smithi155.stdout: "event": "done", 2023-08-01T19:56:39.405 INFO:teuthology.orchestra.run.smithi155.stdout: "time": "2023-08-01T19:55:05.627581+0000", 2023-08-01T19:56:39.405 INFO:teuthology.orchestra.run.smithi155.stdout: "duration": 2.7681000000000001e-05 2023-08-01T19:56:39.405 INFO:teuthology.orchestra.run.smithi155.stdout: } 2023-08-01T19:56:39.405 INFO:teuthology.orchestra.run.smithi155.stdout: ] 2023-08-01T19:56:39.405 INFO:teuthology.orchestra.run.smithi155.stdout: } 2023-08-01T19:56:39.405 INFO:teuthology.orchestra.run.smithi155.stdout: }, 2023-08-01T19:56:39.406 INFO:teuthology.orchestra.run.smithi155.stdout: { 2023-08-01T19:56:39.406 INFO:teuthology.orchestra.run.smithi155.stdout: "description": "osd_op(client.4668.0:100935 5.e 5:7895b14e:::benchmark_data_smithi006_114134_object100934:head [set-alloc-hint object_size 65536 write_size 65536,write 0~65536] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e37)", 2023-08-01T19:56:39.406 INFO:teuthology.orchestra.run.smithi155.stdout: "initiated_at": "2023-08-01T19:55:05.566666+0000", 2023-08-01T19:56:39.406 INFO:teuthology.orchestra.run.smithi155.stdout: "age": 93.722773807999999, 2023-08-01T19:56:39.406 INFO:teuthology.orchestra.run.smithi155.stdout: "duration": 0.064309016999999996, 2023-08-01T19:56:39.406 INFO:teuthology.orchestra.run.smithi155.stdout: "type_data": { 2023-08-01T19:56:39.406 INFO:teuthology.orchestra.run.smithi155.stdout: "flag_point": "commit sent; apply or cleanup", 2023-08-01T19:56:39.406 INFO:teuthology.orchestra.run.smithi155.stdout: "client_info": { 2023-08-01T19:56:39.407 INFO:teuthology.orchestra.run.smithi155.stdout: "client": "client.4668", 2023-08-01T19:56:39.407 INFO:teuthology.orchestra.run.smithi155.stdout: "client_addr": "172.21.15.6:0/1709472247", 2023-08-01T19:56:39.407 INFO:teuthology.orchestra.run.smithi155.stdout: "tid": 100935 2023-08-01T19:56:39.407 INFO:teuthology.orchestra.run.smithi155.stdout: }, 2023-08-01T19:56:39.407 INFO:teuthology.orchestra.run.smithi155.stdout: "events": [ 2023-08-01T19:56:39.407 INFO:teuthology.orchestra.run.smithi155.stdout: { 2023-08-01T19:56:39.407 INFO:teuthology.orchestra.run.smithi155.stdout: "event": "initiated", 2023-08-01T19:56:39.407 INFO:teuthology.orchestra.run.smithi155.stdout: "time": "2023-08-01T19:55:05.566666+0000", 2023-08-01T19:56:39.408 INFO:teuthology.orchestra.run.smithi155.stdout: "duration": 0 2023-08-01T19:56:39.408 INFO:teuthology.orchestra.run.smithi155.stdout: }, 2023-08-01T19:56:39.408 INFO:teuthology.orchestra.run.smithi155.stdout: { 2023-08-01T19:56:39.408 INFO:teuthology.orchestra.run.smithi155.stdout: "event": "throttled", 2023-08-01T19:56:39.408 INFO:teuthology.orchestra.run.smithi155.stdout: "time": "2023-08-01T19:55:05.566666+0000", 2023-08-01T19:56:39.408 INFO:teuthology.orchestra.run.smithi155.stdout: "duration": 0 2023-08-01T19:56:39.408 INFO:teuthology.orchestra.run.smithi155.stdout: }, 2023-08-01T19:56:39.408 INFO:teuthology.orchestra.run.smithi155.stdout: { 2023-08-01T19:56:39.409 INFO:teuthology.orchestra.run.smithi155.stdout: "event": "header_read", 2023-08-01T19:56:39.409 INFO:teuthology.orchestra.run.smithi155.stdout: "time": "2023-08-01T19:55:05.566665+0000", 2023-08-01T19:56:39.409 INFO:teuthology.orchestra.run.smithi155.stdout: "duration": 4294967295.9999986 2023-08-01T19:56:39.409 INFO:teuthology.orchestra.run.smithi155.stdout: }, 2023-08-01T19:56:39.409 INFO:teuthology.orchestra.run.smithi155.stdout: { 2023-08-01T19:56:39.409 INFO:teuthology.orchestra.run.smithi155.stdout: "event": "all_read", 2023-08-01T19:56:39.409 INFO:teuthology.orchestra.run.smithi155.stdout: "time": "2023-08-01T19:55:05.566754+0000", 2023-08-01T19:56:39.410 INFO:teuthology.orchestra.run.smithi155.stdout: "duration": 8.9425999999999994e-05 2023-08-01T19:56:39.410 INFO:teuthology.orchestra.run.smithi155.stdout: }, 2023-08-01T19:56:39.410 INFO:teuthology.orchestra.run.smithi155.stdout: { 2023-08-01T19:56:39.410 INFO:teuthology.orchestra.run.smithi155.stdout: "event": "dispatched", 2023-08-01T19:56:39.410 INFO:teuthology.orchestra.run.smithi155.stdout: "time": "2023-08-01T19:55:05.566766+0000", 2023-08-01T19:56:39.410 INFO:teuthology.orchestra.run.smithi155.stdout: "duration": 1.2018000000000001e-05 2023-08-01T19:56:39.410 INFO:teuthology.orchestra.run.smithi155.stdout: }, 2023-08-01T19:56:39.410 INFO:teuthology.orchestra.run.smithi155.stdout: { 2023-08-01T19:56:39.411 INFO:teuthology.orchestra.run.smithi155.stdout: "event": "queued_for_pg", 2023-08-01T19:56:39.411 INFO:teuthology.orchestra.run.smithi155.stdout: "time": "2023-08-01T19:55:05.566772+0000", 2023-08-01T19:56:39.411 INFO:teuthology.orchestra.run.smithi155.stdout: "duration": 6.0190000000000003e-06 2023-08-01T19:56:39.411 INFO:teuthology.orchestra.run.smithi155.stdout: }, 2023-08-01T19:56:39.411 INFO:teuthology.orchestra.run.smithi155.stdout: { 2023-08-01T19:56:39.411 INFO:teuthology.orchestra.run.smithi155.stdout: "event": "reached_pg", 2023-08-01T19:56:39.411 INFO:teuthology.orchestra.run.smithi155.stdout: "time": "2023-08-01T19:55:05.566800+0000", 2023-08-01T19:56:39.411 INFO:teuthology.orchestra.run.smithi155.stdout: "duration": 2.7835999999999999e-05 2023-08-01T19:56:39.412 INFO:teuthology.orchestra.run.smithi155.stdout: }, 2023-08-01T19:56:39.412 INFO:teuthology.orchestra.run.smithi155.stdout: { 2023-08-01T19:56:39.412 INFO:teuthology.orchestra.run.smithi155.stdout: "event": "started", 2023-08-01T19:56:39.412 INFO:teuthology.orchestra.run.smithi155.stdout: "time": "2023-08-01T19:55:05.566879+0000", 2023-08-01T19:56:39.412 INFO:teuthology.orchestra.run.smithi155.stdout: "duration": 7.9105999999999998e-05 2023-08-01T19:56:39.412 INFO:teuthology.orchestra.run.smithi155.stdout: }, 2023-08-01T19:56:39.412 INFO:teuthology.orchestra.run.smithi155.stdout: { 2023-08-01T19:56:39.413 INFO:teuthology.orchestra.run.smithi155.stdout: "event": "waiting for subops from 0", 2023-08-01T19:56:39.413 INFO:teuthology.orchestra.run.smithi155.stdout: "time": "2023-08-01T19:55:05.566971+0000", 2023-08-01T19:56:39.413 INFO:teuthology.orchestra.run.smithi155.stdout: "duration": 9.1817999999999994e-05 2023-08-01T19:56:39.413 INFO:teuthology.orchestra.run.smithi155.stdout: }, 2023-08-01T19:56:39.413 INFO:teuthology.orchestra.run.smithi155.stdout: { 2023-08-01T19:56:39.413 INFO:teuthology.orchestra.run.smithi155.stdout: "event": "op_commit", 2023-08-01T19:56:39.413 INFO:teuthology.orchestra.run.smithi155.stdout: "time": "2023-08-01T19:55:05.571475+0000", 2023-08-01T19:56:39.413 INFO:teuthology.orchestra.run.smithi155.stdout: "duration": 0.0045039499999999996 2023-08-01T19:56:39.414 INFO:teuthology.orchestra.run.smithi155.stdout: }, 2023-08-01T19:56:39.414 INFO:teuthology.orchestra.run.smithi155.stdout: { 2023-08-01T19:56:39.414 INFO:teuthology.orchestra.run.smithi155.stdout: "event": "sub_op_commit_rec", 2023-08-01T19:56:39.414 INFO:teuthology.orchestra.run.smithi155.stdout: "time": "2023-08-01T19:55:05.630884+0000", 2023-08-01T19:56:39.414 INFO:teuthology.orchestra.run.smithi155.stdout: "duration": 0.059409181999999998 2023-08-01T19:56:39.414 INFO:teuthology.orchestra.run.smithi155.stdout: }, 2023-08-01T19:56:39.414 INFO:teuthology.orchestra.run.smithi155.stdout: { 2023-08-01T19:56:39.414 INFO:teuthology.orchestra.run.smithi155.stdout: "event": "commit_sent", 2023-08-01T19:56:39.415 INFO:teuthology.orchestra.run.smithi155.stdout: "time": "2023-08-01T19:55:05.630930+0000", 2023-08-01T19:56:39.415 INFO:teuthology.orchestra.run.smithi155.stdout: "duration": 4.5507999999999999e-05 2023-08-01T19:56:39.415 INFO:teuthology.orchestra.run.smithi155.stdout: }, 2023-08-01T19:56:39.415 INFO:teuthology.orchestra.run.smithi155.stdout: { 2023-08-01T19:56:39.415 INFO:teuthology.orchestra.run.smithi155.stdout: "event": "done", 2023-08-01T19:56:39.415 INFO:teuthology.orchestra.run.smithi155.stdout: "time": "2023-08-01T19:55:05.630975+0000", 2023-08-01T19:56:39.415 INFO:teuthology.orchestra.run.smithi155.stdout: "duration": 4.5441000000000001e-05 2023-08-01T19:56:39.416 INFO:teuthology.orchestra.run.smithi155.stdout: } 2023-08-01T19:56:39.416 INFO:teuthology.orchestra.run.smithi155.stdout: ] 2023-08-01T19:56:39.416 INFO:teuthology.orchestra.run.smithi155.stdout: } 2023-08-01T19:56:39.416 INFO:teuthology.orchestra.run.smithi155.stdout: }, 2023-08-01T19:56:39.416 INFO:teuthology.orchestra.run.smithi155.stdout: { 2023-08-01T19:56:39.416 INFO:teuthology.orchestra.run.smithi155.stdout: "description": "osd_op(client.4668.0:100941 5.e 5:736a6ac6:::benchmark_data_smithi006_114134_object100940:head [set-alloc-hint object_size 65536 write_size 65536,write 0~65536] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e37)", 2023-08-01T19:56:39.416 INFO:teuthology.orchestra.run.smithi155.stdout: "initiated_at": "2023-08-01T19:55:05.569750+0000", 2023-08-01T19:56:39.416 INFO:teuthology.orchestra.run.smithi155.stdout: "age": 93.719689915000004, 2023-08-01T19:56:39.417 INFO:teuthology.orchestra.run.smithi155.stdout: "duration": 0.065431331999999995, 2023-08-01T19:56:39.417 INFO:teuthology.orchestra.run.smithi155.stdout: "type_data": { 2023-08-01T19:56:39.417 INFO:teuthology.orchestra.run.smithi155.stdout: "flag_point": "commit sent; apply or cleanup", 2023-08-01T19:56:39.417 INFO:teuthology.orchestra.run.smithi155.stdout: "client_info": { 2023-08-01T19:56:39.417 INFO:teuthology.orchestra.run.smithi155.stdout: "client": "client.4668", 2023-08-01T19:56:39.417 INFO:teuthology.orchestra.run.smithi155.stdout: "client_addr": "172.21.15.6:0/1709472247", 2023-08-01T19:56:39.417 INFO:teuthology.orchestra.run.smithi155.stdout: "tid": 100941 2023-08-01T19:56:39.418 INFO:teuthology.orchestra.run.smithi155.stdout: }, 2023-08-01T19:56:39.418 INFO:teuthology.orchestra.run.smithi155.stdout: "events": [ 2023-08-01T19:56:39.418 INFO:teuthology.orchestra.run.smithi155.stdout: { 2023-08-01T19:56:39.418 INFO:teuthology.orchestra.run.smithi155.stdout: "event": "initiated", 2023-08-01T19:56:39.418 INFO:teuthology.orchestra.run.smithi155.stdout: "time": "2023-08-01T19:55:05.569750+0000", 2023-08-01T19:56:39.418 INFO:teuthology.orchestra.run.smithi155.stdout: "duration": 0 2023-08-01T19:56:39.418 INFO:teuthology.orchestra.run.smithi155.stdout: }, 2023-08-01T19:56:39.418 INFO:teuthology.orchestra.run.smithi155.stdout: { 2023-08-01T19:56:39.419 INFO:teuthology.orchestra.run.smithi155.stdout: "event": "throttled", 2023-08-01T19:56:39.419 INFO:teuthology.orchestra.run.smithi155.stdout: "time": "2023-08-01T19:55:05.569750+0000", 2023-08-01T19:56:39.419 INFO:teuthology.orchestra.run.smithi155.stdout: "duration": 0 2023-08-01T19:56:39.419 INFO:teuthology.orchestra.run.smithi155.stdout: }, 2023-08-01T19:56:39.419 INFO:teuthology.orchestra.run.smithi155.stdout: { 2023-08-01T19:56:39.419 INFO:teuthology.orchestra.run.smithi155.stdout: "event": "header_read", 2023-08-01T19:56:39.419 INFO:teuthology.orchestra.run.smithi155.stdout: "time": "2023-08-01T19:55:05.569749+0000", 2023-08-01T19:56:39.420 INFO:teuthology.orchestra.run.smithi155.stdout: "duration": 4294967295.999999 2023-08-01T19:56:39.420 INFO:teuthology.orchestra.run.smithi155.stdout: }, 2023-08-01T19:56:39.420 INFO:teuthology.orchestra.run.smithi155.stdout: { 2023-08-01T19:56:39.420 INFO:teuthology.orchestra.run.smithi155.stdout: "event": "all_read", 2023-08-01T19:56:39.420 INFO:teuthology.orchestra.run.smithi155.stdout: "time": "2023-08-01T19:55:05.569861+0000", 2023-08-01T19:56:39.420 INFO:teuthology.orchestra.run.smithi155.stdout: "duration": 0.000111333 2023-08-01T19:56:39.420 INFO:teuthology.orchestra.run.smithi155.stdout: }, 2023-08-01T19:56:39.420 INFO:teuthology.orchestra.run.smithi155.stdout: { 2023-08-01T19:56:39.421 INFO:teuthology.orchestra.run.smithi155.stdout: "event": "dispatched", 2023-08-01T19:56:39.421 INFO:teuthology.orchestra.run.smithi155.stdout: "time": "2023-08-01T19:55:05.569869+0000", 2023-08-01T19:56:39.421 INFO:teuthology.orchestra.run.smithi155.stdout: "duration": 8.8589999999999994e-06 2023-08-01T19:56:39.421 INFO:teuthology.orchestra.run.smithi155.stdout: }, 2023-08-01T19:56:39.421 INFO:teuthology.orchestra.run.smithi155.stdout: { 2023-08-01T19:56:39.421 INFO:teuthology.orchestra.run.smithi155.stdout: "event": "queued_for_pg", 2023-08-01T19:56:39.421 INFO:teuthology.orchestra.run.smithi155.stdout: "time": "2023-08-01T19:55:05.569874+0000", 2023-08-01T19:56:39.422 INFO:teuthology.orchestra.run.smithi155.stdout: "duration": 4.1679999999999997e-06 2023-08-01T19:56:39.422 INFO:teuthology.orchestra.run.smithi155.stdout: }, 2023-08-01T19:56:39.422 INFO:teuthology.orchestra.run.smithi155.stdout: { 2023-08-01T19:56:39.422 INFO:teuthology.orchestra.run.smithi155.stdout: "event": "reached_pg", 2023-08-01T19:56:39.422 INFO:teuthology.orchestra.run.smithi155.stdout: "time": "2023-08-01T19:55:05.569904+0000", 2023-08-01T19:56:39.422 INFO:teuthology.orchestra.run.smithi155.stdout: "duration": 3.0920999999999998e-05 2023-08-01T19:56:39.422 INFO:teuthology.orchestra.run.smithi155.stdout: }, 2023-08-01T19:56:39.423 INFO:teuthology.orchestra.run.smithi155.stdout: { 2023-08-01T19:56:39.423 INFO:teuthology.orchestra.run.smithi155.stdout: "event": "started", 2023-08-01T19:56:39.423 INFO:teuthology.orchestra.run.smithi155.stdout: "time": "2023-08-01T19:55:05.569998+0000", 2023-08-01T19:56:39.423 INFO:teuthology.orchestra.run.smithi155.stdout: "duration": 9.3086999999999998e-05 2023-08-01T19:56:39.423 INFO:teuthology.orchestra.run.smithi155.stdout: }, 2023-08-01T19:56:39.423 INFO:teuthology.orchestra.run.smithi155.stdout: { 2023-08-01T19:56:39.423 INFO:teuthology.orchestra.run.smithi155.stdout: "event": "waiting for subops from 0", 2023-08-01T19:56:39.423 INFO:teuthology.orchestra.run.smithi155.stdout: "time": "2023-08-01T19:55:05.570093+0000", 2023-08-01T19:56:39.424 INFO:teuthology.orchestra.run.smithi155.stdout: "duration": 9.5768999999999997e-05 2023-08-01T19:56:39.424 INFO:teuthology.orchestra.run.smithi155.stdout: }, 2023-08-01T19:56:39.424 INFO:teuthology.orchestra.run.smithi155.stdout: { 2023-08-01T19:56:39.424 INFO:teuthology.orchestra.run.smithi155.stdout: "event": "op_commit", 2023-08-01T19:56:39.424 INFO:teuthology.orchestra.run.smithi155.stdout: "time": "2023-08-01T19:55:05.572839+0000", 2023-08-01T19:56:39.424 INFO:teuthology.orchestra.run.smithi155.stdout: "duration": 0.0027460050000000001 2023-08-01T19:56:39.424 INFO:teuthology.orchestra.run.smithi155.stdout: }, 2023-08-01T19:56:39.425 INFO:teuthology.orchestra.run.smithi155.stdout: { 2023-08-01T19:56:39.425 INFO:teuthology.orchestra.run.smithi155.stdout: "event": "sub_op_commit_rec", 2023-08-01T19:56:39.425 INFO:teuthology.orchestra.run.smithi155.stdout: "time": "2023-08-01T19:55:05.635114+0000", 2023-08-01T19:56:39.425 INFO:teuthology.orchestra.run.smithi155.stdout: "duration": 0.062274297999999999 2023-08-01T19:56:39.425 INFO:teuthology.orchestra.run.smithi155.stdout: }, 2023-08-01T19:56:39.425 INFO:teuthology.orchestra.run.smithi155.stdout: { 2023-08-01T19:56:39.425 INFO:teuthology.orchestra.run.smithi155.stdout: "event": "commit_sent", 2023-08-01T19:56:39.425 INFO:teuthology.orchestra.run.smithi155.stdout: "time": "2023-08-01T19:55:05.635143+0000", 2023-08-01T19:56:39.426 INFO:teuthology.orchestra.run.smithi155.stdout: "duration": 2.9430000000000001e-05 2023-08-01T19:56:39.426 INFO:teuthology.orchestra.run.smithi155.stdout: }, 2023-08-01T19:56:39.426 INFO:teuthology.orchestra.run.smithi155.stdout: { 2023-08-01T19:56:39.426 INFO:teuthology.orchestra.run.smithi155.stdout: "event": "done", 2023-08-01T19:56:39.426 INFO:teuthology.orchestra.run.smithi155.stdout: "time": "2023-08-01T19:55:05.635181+0000", 2023-08-01T19:56:39.426 INFO:teuthology.orchestra.run.smithi155.stdout: "duration": 3.8352000000000001e-05 2023-08-01T19:56:39.426 INFO:teuthology.orchestra.run.smithi155.stdout: } 2023-08-01T19:56:39.427 INFO:teuthology.orchestra.run.smithi155.stdout: ] 2023-08-01T19:56:39.427 INFO:teuthology.orchestra.run.smithi155.stdout: } 2023-08-01T19:56:39.427 INFO:teuthology.orchestra.run.smithi155.stdout: }, 2023-08-01T19:56:39.427 INFO:teuthology.orchestra.run.smithi155.stdout: { 2023-08-01T19:56:39.427 INFO:teuthology.orchestra.run.smithi155.stdout: "description": "osd_op(client.4668.0:100945 5.e 5:73df68dd:::benchmark_data_smithi006_114134_object100944:head [set-alloc-hint object_size 65536 write_size 65536,write 0~65536] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e37)", 2023-08-01T19:56:39.427 INFO:teuthology.orchestra.run.smithi155.stdout: "initiated_at": "2023-08-01T19:55:05.576784+0000", 2023-08-01T19:56:39.427 INFO:teuthology.orchestra.run.smithi155.stdout: "age": 93.712656330000002, 2023-08-01T19:56:39.427 INFO:teuthology.orchestra.run.smithi155.stdout: "duration": 0.058512994999999998, 2023-08-01T19:56:39.428 INFO:teuthology.orchestra.run.smithi155.stdout: "type_data": { 2023-08-01T19:56:39.428 INFO:teuthology.orchestra.run.smithi155.stdout: "flag_point": "commit sent; apply or cleanup", 2023-08-01T19:56:39.428 INFO:teuthology.orchestra.run.smithi155.stdout: "client_info": { 2023-08-01T19:56:39.428 INFO:teuthology.orchestra.run.smithi155.stdout: "client": "client.4668", 2023-08-01T19:56:39.428 INFO:teuthology.orchestra.run.smithi155.stdout: "client_addr": "172.21.15.6:0/1709472247", 2023-08-01T19:56:39.428 INFO:teuthology.orchestra.run.smithi155.stdout: "tid": 100945 2023-08-01T19:56:39.428 INFO:teuthology.orchestra.run.smithi155.stdout: }, 2023-08-01T19:56:39.429 INFO:teuthology.orchestra.run.smithi155.stdout: "events": [ 2023-08-01T19:56:39.429 INFO:teuthology.orchestra.run.smithi155.stdout: { 2023-08-01T19:56:39.429 INFO:teuthology.orchestra.run.smithi155.stdout: "event": "initiated", 2023-08-01T19:56:39.429 INFO:teuthology.orchestra.run.smithi155.stdout: "time": "2023-08-01T19:55:05.576784+0000", 2023-08-01T19:56:39.429 INFO:teuthology.orchestra.run.smithi155.stdout: "duration": 0 2023-08-01T19:56:39.429 INFO:teuthology.orchestra.run.smithi155.stdout: }, 2023-08-01T19:56:39.429 INFO:teuthology.orchestra.run.smithi155.stdout: { 2023-08-01T19:56:39.429 INFO:teuthology.orchestra.run.smithi155.stdout: "event": "throttled", 2023-08-01T19:56:39.430 INFO:teuthology.orchestra.run.smithi155.stdout: "time": "2023-08-01T19:55:05.576784+0000", 2023-08-01T19:56:39.430 INFO:teuthology.orchestra.run.smithi155.stdout: "duration": 0 2023-08-01T19:56:39.430 INFO:teuthology.orchestra.run.smithi155.stdout: }, 2023-08-01T19:56:39.430 INFO:teuthology.orchestra.run.smithi155.stdout: { 2023-08-01T19:56:39.430 INFO:teuthology.orchestra.run.smithi155.stdout: "event": "header_read", 2023-08-01T19:56:39.430 INFO:teuthology.orchestra.run.smithi155.stdout: "time": "2023-08-01T19:55:05.576783+0000", 2023-08-01T19:56:39.430 INFO:teuthology.orchestra.run.smithi155.stdout: "duration": 4294967295.9999995 2023-08-01T19:56:39.430 INFO:teuthology.orchestra.run.smithi155.stdout: }, 2023-08-01T19:56:39.431 INFO:teuthology.orchestra.run.smithi155.stdout: { 2023-08-01T19:56:39.431 INFO:teuthology.orchestra.run.smithi155.stdout: "event": "all_read", 2023-08-01T19:56:39.431 INFO:teuthology.orchestra.run.smithi155.stdout: "time": "2023-08-01T19:55:05.576807+0000", 2023-08-01T19:56:39.431 INFO:teuthology.orchestra.run.smithi155.stdout: "duration": 2.3651000000000001e-05 2023-08-01T19:56:39.431 INFO:teuthology.orchestra.run.smithi155.stdout: }, 2023-08-01T19:56:39.431 INFO:teuthology.orchestra.run.smithi155.stdout: { 2023-08-01T19:56:39.431 INFO:teuthology.orchestra.run.smithi155.stdout: "event": "dispatched", 2023-08-01T19:56:39.432 INFO:teuthology.orchestra.run.smithi155.stdout: "time": "2023-08-01T19:55:05.576817+0000", 2023-08-01T19:56:39.432 INFO:teuthology.orchestra.run.smithi155.stdout: "duration": 9.9389999999999992e-06 2023-08-01T19:56:39.432 INFO:teuthology.orchestra.run.smithi155.stdout: }, 2023-08-01T19:56:39.432 INFO:teuthology.orchestra.run.smithi155.stdout: { 2023-08-01T19:56:39.432 INFO:teuthology.orchestra.run.smithi155.stdout: "event": "queued_for_pg", 2023-08-01T19:56:39.432 INFO:teuthology.orchestra.run.smithi155.stdout: "time": "2023-08-01T19:55:05.576820+0000", 2023-08-01T19:56:39.432 INFO:teuthology.orchestra.run.smithi155.stdout: "duration": 3.2619999999999999e-06 2023-08-01T19:56:39.432 INFO:teuthology.orchestra.run.smithi155.stdout: }, 2023-08-01T19:56:39.433 INFO:teuthology.orchestra.run.smithi155.stdout: { 2023-08-01T19:56:39.433 INFO:teuthology.orchestra.run.smithi155.stdout: "event": "reached_pg", 2023-08-01T19:56:39.433 INFO:teuthology.orchestra.run.smithi155.stdout: "time": "2023-08-01T19:55:05.576849+0000", 2023-08-01T19:56:39.433 INFO:teuthology.orchestra.run.smithi155.stdout: "duration": 2.8880000000000001e-05 2023-08-01T19:56:39.433 INFO:teuthology.orchestra.run.smithi155.stdout: }, 2023-08-01T19:56:39.433 INFO:teuthology.orchestra.run.smithi155.stdout: { 2023-08-01T19:56:39.433 INFO:teuthology.orchestra.run.smithi155.stdout: "event": "started", 2023-08-01T19:56:39.434 INFO:teuthology.orchestra.run.smithi155.stdout: "time": "2023-08-01T19:55:05.576940+0000", 2023-08-01T19:56:39.434 INFO:teuthology.orchestra.run.smithi155.stdout: "duration": 9.0570999999999997e-05 2023-08-01T19:56:39.434 INFO:teuthology.orchestra.run.smithi155.stdout: }, 2023-08-01T19:56:39.434 INFO:teuthology.orchestra.run.smithi155.stdout: { 2023-08-01T19:56:39.434 INFO:teuthology.orchestra.run.smithi155.stdout: "event": "waiting for subops from 0", 2023-08-01T19:56:39.434 INFO:teuthology.orchestra.run.smithi155.stdout: "time": "2023-08-01T19:55:05.577027+0000", 2023-08-01T19:56:39.434 INFO:teuthology.orchestra.run.smithi155.stdout: "duration": 8.7237999999999994e-05 2023-08-01T19:56:39.434 INFO:teuthology.orchestra.run.smithi155.stdout: }, 2023-08-01T19:56:39.435 INFO:teuthology.orchestra.run.smithi155.stdout: { 2023-08-01T19:56:39.435 INFO:teuthology.orchestra.run.smithi155.stdout: "event": "op_commit", 2023-08-01T19:56:39.435 INFO:teuthology.orchestra.run.smithi155.stdout: "time": "2023-08-01T19:55:05.579624+0000", 2023-08-01T19:56:39.435 INFO:teuthology.orchestra.run.smithi155.stdout: "duration": 0.0025971200000000001 2023-08-01T19:56:39.435 INFO:teuthology.orchestra.run.smithi155.stdout: }, 2023-08-01T19:56:39.435 INFO:teuthology.orchestra.run.smithi155.stdout: { 2023-08-01T19:56:39.435 INFO:teuthology.orchestra.run.smithi155.stdout: "event": "sub_op_commit_rec", 2023-08-01T19:56:39.436 INFO:teuthology.orchestra.run.smithi155.stdout: "time": "2023-08-01T19:55:05.635218+0000", 2023-08-01T19:56:39.436 INFO:teuthology.orchestra.run.smithi155.stdout: "duration": 0.055594487999999997 2023-08-01T19:56:39.436 INFO:teuthology.orchestra.run.smithi155.stdout: }, 2023-08-01T19:56:39.436 INFO:teuthology.orchestra.run.smithi155.stdout: { 2023-08-01T19:56:39.436 INFO:teuthology.orchestra.run.smithi155.stdout: "event": "commit_sent", 2023-08-01T19:56:39.436 INFO:teuthology.orchestra.run.smithi155.stdout: "time": "2023-08-01T19:55:05.635262+0000", 2023-08-01T19:56:39.436 INFO:teuthology.orchestra.run.smithi155.stdout: "duration": 4.3380999999999997e-05 2023-08-01T19:56:39.436 INFO:teuthology.orchestra.run.smithi155.stdout: }, 2023-08-01T19:56:39.437 INFO:teuthology.orchestra.run.smithi155.stdout: { 2023-08-01T19:56:39.437 INFO:teuthology.orchestra.run.smithi155.stdout: "event": "done", 2023-08-01T19:56:39.437 INFO:teuthology.orchestra.run.smithi155.stdout: "time": "2023-08-01T19:55:05.635297+0000", 2023-08-01T19:56:39.437 INFO:teuthology.orchestra.run.smithi155.stdout: "duration": 3.4842000000000003e-05 2023-08-01T19:56:39.437 INFO:teuthology.orchestra.run.smithi155.stdout: } 2023-08-01T19:56:39.437 INFO:teuthology.orchestra.run.smithi155.stdout: ] 2023-08-01T19:56:39.437 INFO:teuthology.orchestra.run.smithi155.stdout: } 2023-08-01T19:56:39.438 INFO:teuthology.orchestra.run.smithi155.stdout: }, 2023-08-01T19:56:39.438 INFO:teuthology.orchestra.run.smithi155.stdout: { 2023-08-01T19:56:39.438 INFO:teuthology.orchestra.run.smithi155.stdout: "description": "osd_op(client.4668.0:100947 5.4 5:23e8fc27:::benchmark_data_smithi006_114134_object100946:head [set-alloc-hint object_size 65536 write_size 65536,write 0~65536] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e37)", 2023-08-01T19:56:39.438 INFO:teuthology.orchestra.run.smithi155.stdout: "initiated_at": "2023-08-01T19:55:05.576840+0000", 2023-08-01T19:56:39.438 INFO:teuthology.orchestra.run.smithi155.stdout: "age": 93.712600275, 2023-08-01T19:56:39.438 INFO:teuthology.orchestra.run.smithi155.stdout: "duration": 0.058423127999999998, 2023-08-01T19:56:39.438 INFO:teuthology.orchestra.run.smithi155.stdout: "type_data": { 2023-08-01T19:56:39.438 INFO:teuthology.orchestra.run.smithi155.stdout: "flag_point": "commit sent; apply or cleanup", 2023-08-01T19:56:39.439 INFO:teuthology.orchestra.run.smithi155.stdout: "client_info": { 2023-08-01T19:56:39.439 INFO:teuthology.orchestra.run.smithi155.stdout: "client": "client.4668", 2023-08-01T19:56:39.439 INFO:teuthology.orchestra.run.smithi155.stdout: "client_addr": "172.21.15.6:0/1709472247", 2023-08-01T19:56:39.439 INFO:teuthology.orchestra.run.smithi155.stdout: "tid": 100947 2023-08-01T19:56:39.439 INFO:teuthology.orchestra.run.smithi155.stdout: }, 2023-08-01T19:56:39.439 INFO:teuthology.orchestra.run.smithi155.stdout: "events": [ 2023-08-01T19:56:39.439 INFO:teuthology.orchestra.run.smithi155.stdout: { 2023-08-01T19:56:39.439 INFO:teuthology.orchestra.run.smithi155.stdout: "event": "initiated", 2023-08-01T19:56:39.440 INFO:teuthology.orchestra.run.smithi155.stdout: "time": "2023-08-01T19:55:05.576840+0000", 2023-08-01T19:56:39.440 INFO:teuthology.orchestra.run.smithi155.stdout: "duration": 0 2023-08-01T19:56:39.440 INFO:teuthology.orchestra.run.smithi155.stdout: }, 2023-08-01T19:56:39.440 INFO:teuthology.orchestra.run.smithi155.stdout: { 2023-08-01T19:56:39.440 INFO:teuthology.orchestra.run.smithi155.stdout: "event": "throttled", 2023-08-01T19:56:39.440 INFO:teuthology.orchestra.run.smithi155.stdout: "time": "2023-08-01T19:55:05.576840+0000", 2023-08-01T19:56:39.440 INFO:teuthology.orchestra.run.smithi155.stdout: "duration": 0 2023-08-01T19:56:39.441 INFO:teuthology.orchestra.run.smithi155.stdout: }, 2023-08-01T19:56:39.441 INFO:teuthology.orchestra.run.smithi155.stdout: { 2023-08-01T19:56:39.441 INFO:teuthology.orchestra.run.smithi155.stdout: "event": "header_read", 2023-08-01T19:56:39.441 INFO:teuthology.orchestra.run.smithi155.stdout: "time": "2023-08-01T19:55:05.576839+0000", 2023-08-01T19:56:39.441 INFO:teuthology.orchestra.run.smithi155.stdout: "duration": 4294967295.9999995 2023-08-01T19:56:39.441 INFO:teuthology.orchestra.run.smithi155.stdout: }, 2023-08-01T19:56:39.441 INFO:teuthology.orchestra.run.smithi155.stdout: { 2023-08-01T19:56:39.441 INFO:teuthology.orchestra.run.smithi155.stdout: "event": "all_read", 2023-08-01T19:56:39.442 INFO:teuthology.orchestra.run.smithi155.stdout: "time": "2023-08-01T19:55:05.576893+0000", 2023-08-01T19:56:39.442 INFO:teuthology.orchestra.run.smithi155.stdout: "duration": 5.3893000000000001e-05 2023-08-01T19:56:39.442 INFO:teuthology.orchestra.run.smithi155.stdout: }, 2023-08-01T19:56:39.442 INFO:teuthology.orchestra.run.smithi155.stdout: { 2023-08-01T19:56:39.442 INFO:teuthology.orchestra.run.smithi155.stdout: "event": "dispatched", 2023-08-01T19:56:39.442 INFO:teuthology.orchestra.run.smithi155.stdout: "time": "2023-08-01T19:55:05.576902+0000", 2023-08-01T19:56:39.442 INFO:teuthology.orchestra.run.smithi155.stdout: "duration": 8.7520000000000002e-06 2023-08-01T19:56:39.442 INFO:teuthology.orchestra.run.smithi155.stdout: }, 2023-08-01T19:56:39.443 INFO:teuthology.orchestra.run.smithi155.stdout: { 2023-08-01T19:56:39.443 INFO:teuthology.orchestra.run.smithi155.stdout: "event": "queued_for_pg", 2023-08-01T19:56:39.443 INFO:teuthology.orchestra.run.smithi155.stdout: "time": "2023-08-01T19:55:05.576905+0000", 2023-08-01T19:56:39.443 INFO:teuthology.orchestra.run.smithi155.stdout: "duration": 3.01e-06 2023-08-01T19:56:39.443 INFO:teuthology.orchestra.run.smithi155.stdout: }, 2023-08-01T19:56:39.443 INFO:teuthology.orchestra.run.smithi155.stdout: { 2023-08-01T19:56:39.443 INFO:teuthology.orchestra.run.smithi155.stdout: "event": "reached_pg", 2023-08-01T19:56:39.443 INFO:teuthology.orchestra.run.smithi155.stdout: "time": "2023-08-01T19:55:05.579641+0000", 2023-08-01T19:56:39.444 INFO:teuthology.orchestra.run.smithi155.stdout: "duration": 0.0027366880000000001 2023-08-01T19:56:39.444 INFO:teuthology.orchestra.run.smithi155.stdout: }, 2023-08-01T19:56:39.444 INFO:teuthology.orchestra.run.smithi155.stdout: { 2023-08-01T19:56:39.444 INFO:teuthology.orchestra.run.smithi155.stdout: "event": "started", 2023-08-01T19:56:39.444 INFO:teuthology.orchestra.run.smithi155.stdout: "time": "2023-08-01T19:55:05.579734+0000", 2023-08-01T19:56:39.444 INFO:teuthology.orchestra.run.smithi155.stdout: "duration": 9.2590000000000006e-05 2023-08-01T19:56:39.444 INFO:teuthology.orchestra.run.smithi155.stdout: }, 2023-08-01T19:56:39.445 INFO:teuthology.orchestra.run.smithi155.stdout: { 2023-08-01T19:56:39.445 INFO:teuthology.orchestra.run.smithi155.stdout: "event": "waiting for subops from 0", 2023-08-01T19:56:39.445 INFO:teuthology.orchestra.run.smithi155.stdout: "time": "2023-08-01T19:55:05.579825+0000", 2023-08-01T19:56:39.445 INFO:teuthology.orchestra.run.smithi155.stdout: "duration": 9.0964999999999994e-05 2023-08-01T19:56:39.445 INFO:teuthology.orchestra.run.smithi155.stdout: }, 2023-08-01T19:56:39.445 INFO:teuthology.orchestra.run.smithi155.stdout: { 2023-08-01T19:56:39.445 INFO:teuthology.orchestra.run.smithi155.stdout: "event": "op_commit", 2023-08-01T19:56:39.446 INFO:teuthology.orchestra.run.smithi155.stdout: "time": "2023-08-01T19:55:05.585041+0000", 2023-08-01T19:56:39.446 INFO:teuthology.orchestra.run.smithi155.stdout: "duration": 0.0052159670000000002 2023-08-01T19:56:39.446 INFO:teuthology.orchestra.run.smithi155.stdout: }, 2023-08-01T19:56:39.446 INFO:teuthology.orchestra.run.smithi155.stdout: { 2023-08-01T19:56:39.446 INFO:teuthology.orchestra.run.smithi155.stdout: "event": "sub_op_commit_rec", 2023-08-01T19:56:39.446 INFO:teuthology.orchestra.run.smithi155.stdout: "time": "2023-08-01T19:55:05.635199+0000", 2023-08-01T19:56:39.446 INFO:teuthology.orchestra.run.smithi155.stdout: "duration": 0.050158023000000003 2023-08-01T19:56:39.446 INFO:teuthology.orchestra.run.smithi155.stdout: }, 2023-08-01T19:56:39.447 INFO:teuthology.orchestra.run.smithi155.stdout: { 2023-08-01T19:56:39.447 INFO:teuthology.orchestra.run.smithi155.stdout: "event": "commit_sent", 2023-08-01T19:56:39.447 INFO:teuthology.orchestra.run.smithi155.stdout: "time": "2023-08-01T19:55:05.635227+0000", 2023-08-01T19:56:39.447 INFO:teuthology.orchestra.run.smithi155.stdout: "duration": 2.7821e-05 2023-08-01T19:56:39.447 INFO:teuthology.orchestra.run.smithi155.stdout: }, 2023-08-01T19:56:39.447 INFO:teuthology.orchestra.run.smithi155.stdout: { 2023-08-01T19:56:39.447 INFO:teuthology.orchestra.run.smithi155.stdout: "event": "done", 2023-08-01T19:56:39.447 INFO:teuthology.orchestra.run.smithi155.stdout: "time": "2023-08-01T19:55:05.635263+0000", 2023-08-01T19:56:39.448 INFO:teuthology.orchestra.run.smithi155.stdout: "duration": 3.6081000000000002e-05 2023-08-01T19:56:39.448 INFO:teuthology.orchestra.run.smithi155.stdout: } 2023-08-01T19:56:39.448 INFO:teuthology.orchestra.run.smithi155.stdout: ] 2023-08-01T19:56:39.448 INFO:teuthology.orchestra.run.smithi155.stdout: } 2023-08-01T19:56:39.448 INFO:teuthology.orchestra.run.smithi155.stdout: }, 2023-08-01T19:56:39.448 INFO:teuthology.orchestra.run.smithi155.stdout: { 2023-08-01T19:56:39.448 INFO:teuthology.orchestra.run.smithi155.stdout: "description": "osd_op(client.4668.0:197408 5.d 5:bbda375a:::benchmark_data_smithi006_114134_object63747:head [delete] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e61)", 2023-08-01T19:56:39.449 INFO:teuthology.orchestra.run.smithi155.stdout: "initiated_at": "2023-08-01T19:55:58.559714+0000", 2023-08-01T19:56:39.449 INFO:teuthology.orchestra.run.smithi155.stdout: "age": 40.729726288000002, 2023-08-01T19:56:39.449 INFO:teuthology.orchestra.run.smithi155.stdout: "duration": 1.047043671, 2023-08-01T19:56:39.449 INFO:teuthology.orchestra.run.smithi155.stdout: "type_data": { 2023-08-01T19:56:39.449 INFO:teuthology.orchestra.run.smithi155.stdout: "flag_point": "commit sent; apply or cleanup", 2023-08-01T19:56:39.449 INFO:teuthology.orchestra.run.smithi155.stdout: "client_info": { 2023-08-01T19:56:39.449 INFO:teuthology.orchestra.run.smithi155.stdout: "client": "client.4668", 2023-08-01T19:56:39.449 INFO:teuthology.orchestra.run.smithi155.stdout: "client_addr": "172.21.15.6:0/1709472247", 2023-08-01T19:56:39.450 INFO:teuthology.orchestra.run.smithi155.stdout: "tid": 197408 2023-08-01T19:56:39.450 INFO:teuthology.orchestra.run.smithi155.stdout: }, 2023-08-01T19:56:39.450 INFO:teuthology.orchestra.run.smithi155.stdout: "events": [ 2023-08-01T19:56:39.450 INFO:teuthology.orchestra.run.smithi155.stdout: { 2023-08-01T19:56:39.450 INFO:teuthology.orchestra.run.smithi155.stdout: "event": "initiated", 2023-08-01T19:56:39.450 INFO:teuthology.orchestra.run.smithi155.stdout: "time": "2023-08-01T19:55:58.559714+0000", 2023-08-01T19:56:39.450 INFO:teuthology.orchestra.run.smithi155.stdout: "duration": 0 2023-08-01T19:56:39.450 INFO:teuthology.orchestra.run.smithi155.stdout: }, 2023-08-01T19:56:39.451 INFO:teuthology.orchestra.run.smithi155.stdout: { 2023-08-01T19:56:39.451 INFO:teuthology.orchestra.run.smithi155.stdout: "event": "throttled", 2023-08-01T19:56:39.451 INFO:teuthology.orchestra.run.smithi155.stdout: "time": "2023-08-01T19:55:58.559714+0000", 2023-08-01T19:56:39.451 INFO:teuthology.orchestra.run.smithi155.stdout: "duration": 0 2023-08-01T19:56:39.451 INFO:teuthology.orchestra.run.smithi155.stdout: }, 2023-08-01T19:56:39.451 INFO:teuthology.orchestra.run.smithi155.stdout: { 2023-08-01T19:56:39.451 INFO:teuthology.orchestra.run.smithi155.stdout: "event": "header_read", 2023-08-01T19:56:39.451 INFO:teuthology.orchestra.run.smithi155.stdout: "time": "2023-08-01T19:55:58.559713+0000", 2023-08-01T19:56:39.452 INFO:teuthology.orchestra.run.smithi155.stdout: "duration": 4294967295.999999 2023-08-01T19:56:39.452 INFO:teuthology.orchestra.run.smithi155.stdout: }, 2023-08-01T19:56:39.452 INFO:teuthology.orchestra.run.smithi155.stdout: { 2023-08-01T19:56:39.452 INFO:teuthology.orchestra.run.smithi155.stdout: "event": "all_read", 2023-08-01T19:56:39.452 INFO:teuthology.orchestra.run.smithi155.stdout: "time": "2023-08-01T19:55:58.559717+0000", 2023-08-01T19:56:39.452 INFO:teuthology.orchestra.run.smithi155.stdout: "duration": 4.2860000000000001e-06 2023-08-01T19:56:39.452 INFO:teuthology.orchestra.run.smithi155.stdout: }, 2023-08-01T19:56:39.453 INFO:teuthology.orchestra.run.smithi155.stdout: { 2023-08-01T19:56:39.453 INFO:teuthology.orchestra.run.smithi155.stdout: "event": "dispatched", 2023-08-01T19:56:39.453 INFO:teuthology.orchestra.run.smithi155.stdout: "time": "2023-08-01T19:55:58.559774+0000", 2023-08-01T19:56:39.453 INFO:teuthology.orchestra.run.smithi155.stdout: "duration": 5.6508999999999997e-05 2023-08-01T19:56:39.453 INFO:teuthology.orchestra.run.smithi155.stdout: }, 2023-08-01T19:56:39.453 INFO:teuthology.orchestra.run.smithi155.stdout: { 2023-08-01T19:56:39.453 INFO:teuthology.orchestra.run.smithi155.stdout: "event": "queued_for_pg", 2023-08-01T19:56:39.453 INFO:teuthology.orchestra.run.smithi155.stdout: "time": "2023-08-01T19:55:58.559781+0000", 2023-08-01T19:56:39.454 INFO:teuthology.orchestra.run.smithi155.stdout: "duration": 7.1829999999999997e-06 2023-08-01T19:56:39.454 INFO:teuthology.orchestra.run.smithi155.stdout: }, 2023-08-01T19:56:39.454 INFO:teuthology.orchestra.run.smithi155.stdout: { 2023-08-01T19:56:39.454 INFO:teuthology.orchestra.run.smithi155.stdout: "event": "reached_pg", 2023-08-01T19:56:39.454 INFO:teuthology.orchestra.run.smithi155.stdout: "time": "2023-08-01T19:55:58.571621+0000", 2023-08-01T19:56:39.454 INFO:teuthology.orchestra.run.smithi155.stdout: "duration": 0.011840603999999999 2023-08-01T19:56:39.454 INFO:teuthology.orchestra.run.smithi155.stdout: }, 2023-08-01T19:56:39.454 INFO:teuthology.orchestra.run.smithi155.stdout: { 2023-08-01T19:56:39.455 INFO:teuthology.orchestra.run.smithi155.stdout: "event": "waiting for peered", 2023-08-01T19:56:39.455 INFO:teuthology.orchestra.run.smithi155.stdout: "time": "2023-08-01T19:55:58.571630+0000", 2023-08-01T19:56:39.455 INFO:teuthology.orchestra.run.smithi155.stdout: "duration": 8.9770000000000006e-06 2023-08-01T19:56:39.455 INFO:teuthology.orchestra.run.smithi155.stdout: }, 2023-08-01T19:56:39.455 INFO:teuthology.orchestra.run.smithi155.stdout: { 2023-08-01T19:56:39.455 INFO:teuthology.orchestra.run.smithi155.stdout: "event": "reached_pg", 2023-08-01T19:56:39.455 INFO:teuthology.orchestra.run.smithi155.stdout: "time": "2023-08-01T19:55:59.601300+0000", 2023-08-01T19:56:39.455 INFO:teuthology.orchestra.run.smithi155.stdout: "duration": 1.0296694989999999 2023-08-01T19:56:39.456 INFO:teuthology.orchestra.run.smithi155.stdout: }, 2023-08-01T19:56:39.456 INFO:teuthology.orchestra.run.smithi155.stdout: { 2023-08-01T19:56:39.456 INFO:teuthology.orchestra.run.smithi155.stdout: "event": "started", 2023-08-01T19:56:39.456 INFO:teuthology.orchestra.run.smithi155.stdout: "time": "2023-08-01T19:55:59.601448+0000", 2023-08-01T19:56:39.456 INFO:teuthology.orchestra.run.smithi155.stdout: "duration": 0.00014828399999999999 2023-08-01T19:56:39.456 INFO:teuthology.orchestra.run.smithi155.stdout: }, 2023-08-01T19:56:39.456 INFO:teuthology.orchestra.run.smithi155.stdout: { 2023-08-01T19:56:39.456 INFO:teuthology.orchestra.run.smithi155.stdout: "event": "op_commit", 2023-08-01T19:56:39.457 INFO:teuthology.orchestra.run.smithi155.stdout: "time": "2023-08-01T19:55:59.606616+0000", 2023-08-01T19:56:39.457 INFO:teuthology.orchestra.run.smithi155.stdout: "duration": 0.0051679769999999998 2023-08-01T19:56:39.457 INFO:teuthology.orchestra.run.smithi155.stdout: }, 2023-08-01T19:56:39.457 INFO:teuthology.orchestra.run.smithi155.stdout: { 2023-08-01T19:56:39.457 INFO:teuthology.orchestra.run.smithi155.stdout: "event": "commit_sent", 2023-08-01T19:56:39.457 INFO:teuthology.orchestra.run.smithi155.stdout: "time": "2023-08-01T19:55:59.606662+0000", 2023-08-01T19:56:39.457 INFO:teuthology.orchestra.run.smithi155.stdout: "duration": 4.5843000000000001e-05 2023-08-01T19:56:39.458 INFO:teuthology.orchestra.run.smithi155.stdout: }, 2023-08-01T19:56:39.458 INFO:teuthology.orchestra.run.smithi155.stdout: { 2023-08-01T19:56:39.458 INFO:teuthology.orchestra.run.smithi155.stdout: "event": "done", 2023-08-01T19:56:39.458 INFO:teuthology.orchestra.run.smithi155.stdout: "time": "2023-08-01T19:55:59.606757+0000", 2023-08-01T19:56:39.458 INFO:teuthology.orchestra.run.smithi155.stdout: "duration": 9.5373999999999999e-05 2023-08-01T19:56:39.458 INFO:teuthology.orchestra.run.smithi155.stdout: } 2023-08-01T19:56:39.458 INFO:teuthology.orchestra.run.smithi155.stdout: ] 2023-08-01T19:56:39.458 INFO:teuthology.orchestra.run.smithi155.stdout: } 2023-08-01T19:56:39.459 INFO:teuthology.orchestra.run.smithi155.stdout: }, 2023-08-01T19:56:39.459 INFO:teuthology.orchestra.run.smithi155.stdout: { 2023-08-01T19:56:39.459 INFO:teuthology.orchestra.run.smithi155.stdout: "description": "osd_op(client.4668.0:197416 5.d 5:bd99e66d:::benchmark_data_smithi006_114134_object63755:head [delete] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e62)", 2023-08-01T19:56:39.459 INFO:teuthology.orchestra.run.smithi155.stdout: "initiated_at": "2023-08-01T19:55:58.577369+0000", 2023-08-01T19:56:39.459 INFO:teuthology.orchestra.run.smithi155.stdout: "age": 40.712071311000003, 2023-08-01T19:56:39.459 INFO:teuthology.orchestra.run.smithi155.stdout: "duration": 1.0300980120000001, 2023-08-01T19:56:39.459 INFO:teuthology.orchestra.run.smithi155.stdout: "type_data": { 2023-08-01T19:56:39.459 INFO:teuthology.orchestra.run.smithi155.stdout: "flag_point": "commit sent; apply or cleanup", 2023-08-01T19:56:39.460 INFO:teuthology.orchestra.run.smithi155.stdout: "client_info": { 2023-08-01T19:56:39.460 INFO:teuthology.orchestra.run.smithi155.stdout: "client": "client.4668", 2023-08-01T19:56:39.460 INFO:teuthology.orchestra.run.smithi155.stdout: "client_addr": "172.21.15.6:0/1709472247", 2023-08-01T19:56:39.460 INFO:teuthology.orchestra.run.smithi155.stdout: "tid": 197416 2023-08-01T19:56:39.460 INFO:teuthology.orchestra.run.smithi155.stdout: }, 2023-08-01T19:56:39.460 INFO:teuthology.orchestra.run.smithi155.stdout: "events": [ 2023-08-01T19:56:39.460 INFO:teuthology.orchestra.run.smithi155.stdout: { 2023-08-01T19:56:39.460 INFO:teuthology.orchestra.run.smithi155.stdout: "event": "initiated", 2023-08-01T19:56:39.461 INFO:teuthology.orchestra.run.smithi155.stdout: "time": "2023-08-01T19:55:58.577369+0000", 2023-08-01T19:56:39.461 INFO:teuthology.orchestra.run.smithi155.stdout: "duration": 0 2023-08-01T19:56:39.461 INFO:teuthology.orchestra.run.smithi155.stdout: }, 2023-08-01T19:56:39.461 INFO:teuthology.orchestra.run.smithi155.stdout: { 2023-08-01T19:56:39.461 INFO:teuthology.orchestra.run.smithi155.stdout: "event": "throttled", 2023-08-01T19:56:39.461 INFO:teuthology.orchestra.run.smithi155.stdout: "time": "2023-08-01T19:55:58.577369+0000", 2023-08-01T19:56:39.461 INFO:teuthology.orchestra.run.smithi155.stdout: "duration": 0 2023-08-01T19:56:39.462 INFO:teuthology.orchestra.run.smithi155.stdout: }, 2023-08-01T19:56:39.462 INFO:teuthology.orchestra.run.smithi155.stdout: { 2023-08-01T19:56:39.462 INFO:teuthology.orchestra.run.smithi155.stdout: "event": "header_read", 2023-08-01T19:56:39.462 INFO:teuthology.orchestra.run.smithi155.stdout: "time": "2023-08-01T19:55:58.577368+0000", 2023-08-01T19:56:39.462 INFO:teuthology.orchestra.run.smithi155.stdout: "duration": 4294967295.9999995 2023-08-01T19:56:39.462 INFO:teuthology.orchestra.run.smithi155.stdout: }, 2023-08-01T19:56:39.462 INFO:teuthology.orchestra.run.smithi155.stdout: { 2023-08-01T19:56:39.462 INFO:teuthology.orchestra.run.smithi155.stdout: "event": "all_read", 2023-08-01T19:56:39.463 INFO:teuthology.orchestra.run.smithi155.stdout: "time": "2023-08-01T19:55:58.577370+0000", 2023-08-01T19:56:39.463 INFO:teuthology.orchestra.run.smithi155.stdout: "duration": 2.1150000000000001e-06 2023-08-01T19:56:39.463 INFO:teuthology.orchestra.run.smithi155.stdout: }, 2023-08-01T19:56:39.463 INFO:teuthology.orchestra.run.smithi155.stdout: { 2023-08-01T19:56:39.463 INFO:teuthology.orchestra.run.smithi155.stdout: "event": "dispatched", 2023-08-01T19:56:39.463 INFO:teuthology.orchestra.run.smithi155.stdout: "time": "2023-08-01T19:55:58.577377+0000", 2023-08-01T19:56:39.463 INFO:teuthology.orchestra.run.smithi155.stdout: "duration": 6.6610000000000003e-06 2023-08-01T19:56:39.463 INFO:teuthology.orchestra.run.smithi155.stdout: }, 2023-08-01T19:56:39.464 INFO:teuthology.orchestra.run.smithi155.stdout: { 2023-08-01T19:56:39.464 INFO:teuthology.orchestra.run.smithi155.stdout: "event": "queued_for_pg", 2023-08-01T19:56:39.464 INFO:teuthology.orchestra.run.smithi155.stdout: "time": "2023-08-01T19:55:58.577380+0000", 2023-08-01T19:56:39.464 INFO:teuthology.orchestra.run.smithi155.stdout: "duration": 2.7360000000000001e-06 2023-08-01T19:56:39.464 INFO:teuthology.orchestra.run.smithi155.stdout: }, 2023-08-01T19:56:39.464 INFO:teuthology.orchestra.run.smithi155.stdout: { 2023-08-01T19:56:39.464 INFO:teuthology.orchestra.run.smithi155.stdout: "event": "reached_pg", 2023-08-01T19:56:39.465 INFO:teuthology.orchestra.run.smithi155.stdout: "time": "2023-08-01T19:55:58.577405+0000", 2023-08-01T19:56:39.465 INFO:teuthology.orchestra.run.smithi155.stdout: "duration": 2.4929000000000001e-05 2023-08-01T19:56:39.465 INFO:teuthology.orchestra.run.smithi155.stdout: }, 2023-08-01T19:56:39.465 INFO:teuthology.orchestra.run.smithi155.stdout: { 2023-08-01T19:56:39.465 INFO:teuthology.orchestra.run.smithi155.stdout: "event": "waiting for peered", 2023-08-01T19:56:39.465 INFO:teuthology.orchestra.run.smithi155.stdout: "time": "2023-08-01T19:55:58.577409+0000", 2023-08-01T19:56:39.465 INFO:teuthology.orchestra.run.smithi155.stdout: "duration": 4.0799999999999999e-06 2023-08-01T19:56:39.465 INFO:teuthology.orchestra.run.smithi155.stdout: }, 2023-08-01T19:56:39.466 INFO:teuthology.orchestra.run.smithi155.stdout: { 2023-08-01T19:56:39.466 INFO:teuthology.orchestra.run.smithi155.stdout: "event": "reached_pg", 2023-08-01T19:56:39.466 INFO:teuthology.orchestra.run.smithi155.stdout: "time": "2023-08-01T19:55:59.603639+0000", 2023-08-01T19:56:39.466 INFO:teuthology.orchestra.run.smithi155.stdout: "duration": 1.0262299349999999 2023-08-01T19:56:39.466 INFO:teuthology.orchestra.run.smithi155.stdout: }, 2023-08-01T19:56:39.466 INFO:teuthology.orchestra.run.smithi155.stdout: { 2023-08-01T19:56:39.466 INFO:teuthology.orchestra.run.smithi155.stdout: "event": "started", 2023-08-01T19:56:39.467 INFO:teuthology.orchestra.run.smithi155.stdout: "time": "2023-08-01T19:55:59.603772+0000", 2023-08-01T19:56:39.467 INFO:teuthology.orchestra.run.smithi155.stdout: "duration": 0.000133153 2023-08-01T19:56:39.467 INFO:teuthology.orchestra.run.smithi155.stdout: }, 2023-08-01T19:56:39.467 INFO:teuthology.orchestra.run.smithi155.stdout: { 2023-08-01T19:56:39.467 INFO:teuthology.orchestra.run.smithi155.stdout: "event": "op_commit", 2023-08-01T19:56:39.467 INFO:teuthology.orchestra.run.smithi155.stdout: "time": "2023-08-01T19:55:59.607354+0000", 2023-08-01T19:56:39.467 INFO:teuthology.orchestra.run.smithi155.stdout: "duration": 0.0035819599999999999 2023-08-01T19:56:39.467 INFO:teuthology.orchestra.run.smithi155.stdout: }, 2023-08-01T19:56:39.468 INFO:teuthology.orchestra.run.smithi155.stdout: { 2023-08-01T19:56:39.468 INFO:teuthology.orchestra.run.smithi155.stdout: "event": "commit_sent", 2023-08-01T19:56:39.468 INFO:teuthology.orchestra.run.smithi155.stdout: "time": "2023-08-01T19:55:59.607396+0000", 2023-08-01T19:56:39.468 INFO:teuthology.orchestra.run.smithi155.stdout: "duration": 4.2423999999999999e-05 2023-08-01T19:56:39.468 INFO:teuthology.orchestra.run.smithi155.stdout: }, 2023-08-01T19:56:39.468 INFO:teuthology.orchestra.run.smithi155.stdout: { 2023-08-01T19:56:39.468 INFO:teuthology.orchestra.run.smithi155.stdout: "event": "done", 2023-08-01T19:56:39.468 INFO:teuthology.orchestra.run.smithi155.stdout: "time": "2023-08-01T19:55:59.607467+0000", 2023-08-01T19:56:39.469 INFO:teuthology.orchestra.run.smithi155.stdout: "duration": 7.0360999999999999e-05 2023-08-01T19:56:39.469 INFO:teuthology.orchestra.run.smithi155.stdout: } 2023-08-01T19:56:39.469 INFO:teuthology.orchestra.run.smithi155.stdout: ] 2023-08-01T19:56:39.469 INFO:teuthology.orchestra.run.smithi155.stdout: } 2023-08-01T19:56:39.469 INFO:teuthology.orchestra.run.smithi155.stdout: }, 2023-08-01T19:56:39.469 INFO:teuthology.orchestra.run.smithi155.stdout: { 2023-08-01T19:56:39.469 INFO:teuthology.orchestra.run.smithi155.stdout: "description": "osd_op(client.4668.0:197419 5.d 5:be7dc7c9:::benchmark_data_smithi006_114134_object63758:head [delete] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e62)", 2023-08-01T19:56:39.470 INFO:teuthology.orchestra.run.smithi155.stdout: "initiated_at": "2023-08-01T19:55:58.580223+0000", 2023-08-01T19:56:39.470 INFO:teuthology.orchestra.run.smithi155.stdout: "age": 40.709217359999997, 2023-08-01T19:56:39.470 INFO:teuthology.orchestra.run.smithi155.stdout: "duration": 1.0286139439999999, 2023-08-01T19:56:39.470 INFO:teuthology.orchestra.run.smithi155.stdout: "type_data": { 2023-08-01T19:56:39.470 INFO:teuthology.orchestra.run.smithi155.stdout: "flag_point": "commit sent; apply or cleanup", 2023-08-01T19:56:39.471 INFO:teuthology.orchestra.run.smithi155.stdout: "client_info": { 2023-08-01T19:56:39.471 INFO:teuthology.orchestra.run.smithi155.stdout: "client": "client.4668", 2023-08-01T19:56:39.471 INFO:teuthology.orchestra.run.smithi155.stdout: "client_addr": "172.21.15.6:0/1709472247", 2023-08-01T19:56:39.471 INFO:teuthology.orchestra.run.smithi155.stdout: "tid": 197419 2023-08-01T19:56:39.471 INFO:teuthology.orchestra.run.smithi155.stdout: }, 2023-08-01T19:56:39.471 INFO:teuthology.orchestra.run.smithi155.stdout: "events": [ 2023-08-01T19:56:39.471 INFO:teuthology.orchestra.run.smithi155.stdout: { 2023-08-01T19:56:39.471 INFO:teuthology.orchestra.run.smithi155.stdout: "event": "initiated", 2023-08-01T19:56:39.472 INFO:teuthology.orchestra.run.smithi155.stdout: "time": "2023-08-01T19:55:58.580223+0000", 2023-08-01T19:56:39.472 INFO:teuthology.orchestra.run.smithi155.stdout: "duration": 0 2023-08-01T19:56:39.472 INFO:teuthology.orchestra.run.smithi155.stdout: }, 2023-08-01T19:56:39.472 INFO:teuthology.orchestra.run.smithi155.stdout: { 2023-08-01T19:56:39.472 INFO:teuthology.orchestra.run.smithi155.stdout: "event": "throttled", 2023-08-01T19:56:39.472 INFO:teuthology.orchestra.run.smithi155.stdout: "time": "2023-08-01T19:55:58.580223+0000", 2023-08-01T19:56:39.472 INFO:teuthology.orchestra.run.smithi155.stdout: "duration": 0 2023-08-01T19:56:39.472 INFO:teuthology.orchestra.run.smithi155.stdout: }, 2023-08-01T19:56:39.473 INFO:teuthology.orchestra.run.smithi155.stdout: { 2023-08-01T19:56:39.473 INFO:teuthology.orchestra.run.smithi155.stdout: "event": "header_read", 2023-08-01T19:56:39.473 INFO:teuthology.orchestra.run.smithi155.stdout: "time": "2023-08-01T19:55:58.580222+0000", 2023-08-01T19:56:39.473 INFO:teuthology.orchestra.run.smithi155.stdout: "duration": 4294967295.9999995 2023-08-01T19:56:39.473 INFO:teuthology.orchestra.run.smithi155.stdout: }, 2023-08-01T19:56:39.473 INFO:teuthology.orchestra.run.smithi155.stdout: { 2023-08-01T19:56:39.473 INFO:teuthology.orchestra.run.smithi155.stdout: "event": "all_read", 2023-08-01T19:56:39.474 INFO:teuthology.orchestra.run.smithi155.stdout: "time": "2023-08-01T19:55:58.580225+0000", 2023-08-01T19:56:39.474 INFO:teuthology.orchestra.run.smithi155.stdout: "duration": 3.2820000000000001e-06 2023-08-01T19:56:39.474 INFO:teuthology.orchestra.run.smithi155.stdout: }, 2023-08-01T19:56:39.474 INFO:teuthology.orchestra.run.smithi155.stdout: { 2023-08-01T19:56:39.474 INFO:teuthology.orchestra.run.smithi155.stdout: "event": "dispatched", 2023-08-01T19:56:39.474 INFO:teuthology.orchestra.run.smithi155.stdout: "time": "2023-08-01T19:55:58.580233+0000", 2023-08-01T19:56:39.474 INFO:teuthology.orchestra.run.smithi155.stdout: "duration": 7.34e-06 2023-08-01T19:56:39.474 INFO:teuthology.orchestra.run.smithi155.stdout: }, 2023-08-01T19:56:39.475 INFO:teuthology.orchestra.run.smithi155.stdout: { 2023-08-01T19:56:39.475 INFO:teuthology.orchestra.run.smithi155.stdout: "event": "queued_for_pg", 2023-08-01T19:56:39.475 INFO:teuthology.orchestra.run.smithi155.stdout: "time": "2023-08-01T19:55:58.580236+0000", 2023-08-01T19:56:39.475 INFO:teuthology.orchestra.run.smithi155.stdout: "duration": 3.473e-06 2023-08-01T19:56:39.475 INFO:teuthology.orchestra.run.smithi155.stdout: }, 2023-08-01T19:56:39.475 INFO:teuthology.orchestra.run.smithi155.stdout: { 2023-08-01T19:56:39.475 INFO:teuthology.orchestra.run.smithi155.stdout: "event": "reached_pg", 2023-08-01T19:56:39.476 INFO:teuthology.orchestra.run.smithi155.stdout: "time": "2023-08-01T19:55:58.580267+0000", 2023-08-01T19:56:39.476 INFO:teuthology.orchestra.run.smithi155.stdout: "duration": 3.0479000000000001e-05 2023-08-01T19:56:39.476 INFO:teuthology.orchestra.run.smithi155.stdout: }, 2023-08-01T19:56:39.476 INFO:teuthology.orchestra.run.smithi155.stdout: { 2023-08-01T19:56:39.476 INFO:teuthology.orchestra.run.smithi155.stdout: "event": "waiting for peered", 2023-08-01T19:56:39.476 INFO:teuthology.orchestra.run.smithi155.stdout: "time": "2023-08-01T19:55:58.580272+0000", 2023-08-01T19:56:39.476 INFO:teuthology.orchestra.run.smithi155.stdout: "duration": 5.011e-06 2023-08-01T19:56:39.476 INFO:teuthology.orchestra.run.smithi155.stdout: }, 2023-08-01T19:56:39.477 INFO:teuthology.orchestra.run.smithi155.stdout: { 2023-08-01T19:56:39.477 INFO:teuthology.orchestra.run.smithi155.stdout: "event": "reached_pg", 2023-08-01T19:56:39.477 INFO:teuthology.orchestra.run.smithi155.stdout: "time": "2023-08-01T19:55:59.604970+0000", 2023-08-01T19:56:39.477 INFO:teuthology.orchestra.run.smithi155.stdout: "duration": 1.0246984189999999 2023-08-01T19:56:39.477 INFO:teuthology.orchestra.run.smithi155.stdout: }, 2023-08-01T19:56:39.477 INFO:teuthology.orchestra.run.smithi155.stdout: { 2023-08-01T19:56:39.477 INFO:teuthology.orchestra.run.smithi155.stdout: "event": "started", 2023-08-01T19:56:39.477 INFO:teuthology.orchestra.run.smithi155.stdout: "time": "2023-08-01T19:55:59.605085+0000", 2023-08-01T19:56:39.478 INFO:teuthology.orchestra.run.smithi155.stdout: "duration": 0.00011531000000000001 2023-08-01T19:56:39.478 INFO:teuthology.orchestra.run.smithi155.stdout: }, 2023-08-01T19:56:39.478 INFO:teuthology.orchestra.run.smithi155.stdout: { 2023-08-01T19:56:39.478 INFO:teuthology.orchestra.run.smithi155.stdout: "event": "op_commit", 2023-08-01T19:56:39.478 INFO:teuthology.orchestra.run.smithi155.stdout: "time": "2023-08-01T19:55:59.608733+0000", 2023-08-01T19:56:39.478 INFO:teuthology.orchestra.run.smithi155.stdout: "duration": 0.0036478090000000001 2023-08-01T19:56:39.478 INFO:teuthology.orchestra.run.smithi155.stdout: }, 2023-08-01T19:56:39.479 INFO:teuthology.orchestra.run.smithi155.stdout: { 2023-08-01T19:56:39.479 INFO:teuthology.orchestra.run.smithi155.stdout: "event": "commit_sent", 2023-08-01T19:56:39.479 INFO:teuthology.orchestra.run.smithi155.stdout: "time": "2023-08-01T19:55:59.608771+0000", 2023-08-01T19:56:39.479 INFO:teuthology.orchestra.run.smithi155.stdout: "duration": 3.8033e-05 2023-08-01T19:56:39.479 INFO:teuthology.orchestra.run.smithi155.stdout: }, 2023-08-01T19:56:39.479 INFO:teuthology.orchestra.run.smithi155.stdout: { 2023-08-01T19:56:39.479 INFO:teuthology.orchestra.run.smithi155.stdout: "event": "done", 2023-08-01T19:56:39.479 INFO:teuthology.orchestra.run.smithi155.stdout: "time": "2023-08-01T19:55:59.608837+0000", 2023-08-01T19:56:39.480 INFO:teuthology.orchestra.run.smithi155.stdout: "duration": 6.5364000000000006e-05 2023-08-01T19:56:39.480 INFO:teuthology.orchestra.run.smithi155.stdout: } 2023-08-01T19:56:39.480 INFO:teuthology.orchestra.run.smithi155.stdout: ] 2023-08-01T19:56:39.480 INFO:teuthology.orchestra.run.smithi155.stdout: } 2023-08-01T19:56:39.480 INFO:teuthology.orchestra.run.smithi155.stdout: }, 2023-08-01T19:56:39.480 INFO:teuthology.orchestra.run.smithi155.stdout: { 2023-08-01T19:56:39.480 INFO:teuthology.orchestra.run.smithi155.stdout: "description": "osd_op(client.4668.0:197420 5.9 5:92a2efe5:::benchmark_data_smithi006_114134_object63759:head [delete] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e62)", 2023-08-01T19:56:39.480 INFO:teuthology.orchestra.run.smithi155.stdout: "initiated_at": "2023-08-01T19:55:58.582230+0000", 2023-08-01T19:56:39.481 INFO:teuthology.orchestra.run.smithi155.stdout: "age": 40.70721005, 2023-08-01T19:56:39.481 INFO:teuthology.orchestra.run.smithi155.stdout: "duration": 1.0095353739999999, 2023-08-01T19:56:39.481 INFO:teuthology.orchestra.run.smithi155.stdout: "type_data": { 2023-08-01T19:56:39.481 INFO:teuthology.orchestra.run.smithi155.stdout: "flag_point": "commit sent; apply or cleanup", 2023-08-01T19:56:39.481 INFO:teuthology.orchestra.run.smithi155.stdout: "client_info": { 2023-08-01T19:56:39.481 INFO:teuthology.orchestra.run.smithi155.stdout: "client": "client.4668", 2023-08-01T19:56:39.481 INFO:teuthology.orchestra.run.smithi155.stdout: "client_addr": "172.21.15.6:0/1709472247", 2023-08-01T19:56:39.481 INFO:teuthology.orchestra.run.smithi155.stdout: "tid": 197420 2023-08-01T19:56:39.482 INFO:teuthology.orchestra.run.smithi155.stdout: }, 2023-08-01T19:56:39.482 INFO:teuthology.orchestra.run.smithi155.stdout: "events": [ 2023-08-01T19:56:39.482 INFO:teuthology.orchestra.run.smithi155.stdout: { 2023-08-01T19:56:39.482 INFO:teuthology.orchestra.run.smithi155.stdout: "event": "initiated", 2023-08-01T19:56:39.482 INFO:teuthology.orchestra.run.smithi155.stdout: "time": "2023-08-01T19:55:58.582230+0000", 2023-08-01T19:56:39.482 INFO:teuthology.orchestra.run.smithi155.stdout: "duration": 0 2023-08-01T19:56:39.482 INFO:teuthology.orchestra.run.smithi155.stdout: }, 2023-08-01T19:56:39.483 INFO:teuthology.orchestra.run.smithi155.stdout: { 2023-08-01T19:56:39.483 INFO:teuthology.orchestra.run.smithi155.stdout: "event": "throttled", 2023-08-01T19:56:39.483 INFO:teuthology.orchestra.run.smithi155.stdout: "time": "2023-08-01T19:55:58.582230+0000", 2023-08-01T19:56:39.483 INFO:teuthology.orchestra.run.smithi155.stdout: "duration": 0 2023-08-01T19:56:39.483 INFO:teuthology.orchestra.run.smithi155.stdout: }, 2023-08-01T19:56:39.483 INFO:teuthology.orchestra.run.smithi155.stdout: { 2023-08-01T19:56:39.483 INFO:teuthology.orchestra.run.smithi155.stdout: "event": "header_read", 2023-08-01T19:56:39.483 INFO:teuthology.orchestra.run.smithi155.stdout: "time": "2023-08-01T19:55:58.582229+0000", 2023-08-01T19:56:39.484 INFO:teuthology.orchestra.run.smithi155.stdout: "duration": 4294967295.9999995 2023-08-01T19:56:39.484 INFO:teuthology.orchestra.run.smithi155.stdout: }, 2023-08-01T19:56:39.484 INFO:teuthology.orchestra.run.smithi155.stdout: { 2023-08-01T19:56:39.484 INFO:teuthology.orchestra.run.smithi155.stdout: "event": "all_read", 2023-08-01T19:56:39.484 INFO:teuthology.orchestra.run.smithi155.stdout: "time": "2023-08-01T19:55:58.582233+0000", 2023-08-01T19:56:39.484 INFO:teuthology.orchestra.run.smithi155.stdout: "duration": 3.7869999999999999e-06 2023-08-01T19:56:39.484 INFO:teuthology.orchestra.run.smithi155.stdout: }, 2023-08-01T19:56:39.484 INFO:teuthology.orchestra.run.smithi155.stdout: { 2023-08-01T19:56:39.485 INFO:teuthology.orchestra.run.smithi155.stdout: "event": "dispatched", 2023-08-01T19:56:39.485 INFO:teuthology.orchestra.run.smithi155.stdout: "time": "2023-08-01T19:55:58.582241+0000", 2023-08-01T19:56:39.485 INFO:teuthology.orchestra.run.smithi155.stdout: "duration": 7.6909999999999997e-06 2023-08-01T19:56:39.485 INFO:teuthology.orchestra.run.smithi155.stdout: }, 2023-08-01T19:56:39.485 INFO:teuthology.orchestra.run.smithi155.stdout: { 2023-08-01T19:56:39.485 INFO:teuthology.orchestra.run.smithi155.stdout: "event": "queued_for_pg", 2023-08-01T19:56:39.485 INFO:teuthology.orchestra.run.smithi155.stdout: "time": "2023-08-01T19:55:58.582244+0000", 2023-08-01T19:56:39.486 INFO:teuthology.orchestra.run.smithi155.stdout: "duration": 3.6770000000000001e-06 2023-08-01T19:56:39.486 INFO:teuthology.orchestra.run.smithi155.stdout: }, 2023-08-01T19:56:39.486 INFO:teuthology.orchestra.run.smithi155.stdout: { 2023-08-01T19:56:39.486 INFO:teuthology.orchestra.run.smithi155.stdout: "event": "reached_pg", 2023-08-01T19:56:39.486 INFO:teuthology.orchestra.run.smithi155.stdout: "time": "2023-08-01T19:55:58.582274+0000", 2023-08-01T19:56:39.486 INFO:teuthology.orchestra.run.smithi155.stdout: "duration": 3.0074e-05 2023-08-01T19:56:39.486 INFO:teuthology.orchestra.run.smithi155.stdout: }, 2023-08-01T19:56:39.486 INFO:teuthology.orchestra.run.smithi155.stdout: { 2023-08-01T19:56:39.487 INFO:teuthology.orchestra.run.smithi155.stdout: "event": "waiting for peered", 2023-08-01T19:56:39.487 INFO:teuthology.orchestra.run.smithi155.stdout: "time": "2023-08-01T19:55:58.582281+0000", 2023-08-01T19:56:39.487 INFO:teuthology.orchestra.run.smithi155.stdout: "duration": 6.297e-06 2023-08-01T19:56:39.487 INFO:teuthology.orchestra.run.smithi155.stdout: }, 2023-08-01T19:56:39.487 INFO:teuthology.orchestra.run.smithi155.stdout: { 2023-08-01T19:56:39.487 INFO:teuthology.orchestra.run.smithi155.stdout: "event": "reached_pg", 2023-08-01T19:56:39.487 INFO:teuthology.orchestra.run.smithi155.stdout: "time": "2023-08-01T19:55:59.586809+0000", 2023-08-01T19:56:39.487 INFO:teuthology.orchestra.run.smithi155.stdout: "duration": 1.0045281720000001 2023-08-01T19:56:39.488 INFO:teuthology.orchestra.run.smithi155.stdout: }, 2023-08-01T19:56:39.488 INFO:teuthology.orchestra.run.smithi155.stdout: { 2023-08-01T19:56:39.488 INFO:teuthology.orchestra.run.smithi155.stdout: "event": "started", 2023-08-01T19:56:39.488 INFO:teuthology.orchestra.run.smithi155.stdout: "time": "2023-08-01T19:55:59.586910+0000", 2023-08-01T19:56:39.488 INFO:teuthology.orchestra.run.smithi155.stdout: "duration": 0.000100898 2023-08-01T19:56:39.488 INFO:teuthology.orchestra.run.smithi155.stdout: }, 2023-08-01T19:56:39.488 INFO:teuthology.orchestra.run.smithi155.stdout: { 2023-08-01T19:56:39.489 INFO:teuthology.orchestra.run.smithi155.stdout: "event": "op_commit", 2023-08-01T19:56:39.489 INFO:teuthology.orchestra.run.smithi155.stdout: "time": "2023-08-01T19:55:59.591679+0000", 2023-08-01T19:56:39.489 INFO:teuthology.orchestra.run.smithi155.stdout: "duration": 0.004769471 2023-08-01T19:56:39.489 INFO:teuthology.orchestra.run.smithi155.stdout: }, 2023-08-01T19:56:39.489 INFO:teuthology.orchestra.run.smithi155.stdout: { 2023-08-01T19:56:39.489 INFO:teuthology.orchestra.run.smithi155.stdout: "event": "commit_sent", 2023-08-01T19:56:39.489 INFO:teuthology.orchestra.run.smithi155.stdout: "time": "2023-08-01T19:55:59.591721+0000", 2023-08-01T19:56:39.489 INFO:teuthology.orchestra.run.smithi155.stdout: "duration": 4.1953000000000003e-05 2023-08-01T19:56:39.490 INFO:teuthology.orchestra.run.smithi155.stdout: }, 2023-08-01T19:56:39.490 INFO:teuthology.orchestra.run.smithi155.stdout: { 2023-08-01T19:56:39.490 INFO:teuthology.orchestra.run.smithi155.stdout: "event": "done", 2023-08-01T19:56:39.490 INFO:teuthology.orchestra.run.smithi155.stdout: "time": "2023-08-01T19:55:59.591765+0000", 2023-08-01T19:56:39.490 INFO:teuthology.orchestra.run.smithi155.stdout: "duration": 4.4030999999999999e-05 2023-08-01T19:56:39.490 INFO:teuthology.orchestra.run.smithi155.stdout: } 2023-08-01T19:56:39.490 INFO:teuthology.orchestra.run.smithi155.stdout: ] 2023-08-01T19:56:39.490 INFO:teuthology.orchestra.run.smithi155.stdout: } 2023-08-01T19:56:39.491 INFO:teuthology.orchestra.run.smithi155.stdout: } 2023-08-01T19:56:39.491 INFO:teuthology.orchestra.run.smithi155.stdout: ] 2023-08-01T19:56:39.491 INFO:teuthology.orchestra.run.smithi155.stdout:} 2023-08-01T19:56:39.492 INFO:teuthology.orchestra.run.smithi006.stderr:noscrub is unset 2023-08-01T19:56:39.493 DEBUG:teuthology.orchestra.run.smithi008:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 30 ceph --cluster ceph --admin-daemon /var/run/ceph/ceph-osd.0.asok dump_ops_in_flight 2023-08-01T19:56:39.493 INFO:tasks.ceph.osd.0.smithi008.stderr:2023-08-01T19:56:39.491+0000 7f16a58f4700 -1 received signal: Hangup from /usr/bin/python3 /bin/daemon-helper kill ceph-osd -f --cluster ceph -i 0 (PID: 111179) UID: 0 2023-08-01T19:56:39.593 INFO:tasks.ceph.osd.2.smithi155.stderr:2023-08-01T19:56:39.592+0000 7faa5c6ac700 -1 received signal: Hangup from /usr/bin/python3 /bin/daemon-helper kill ceph-osd -f --cluster ceph -i 2 (PID: 111337) UID: 0 2023-08-01T19:56:39.603 DEBUG:teuthology.orchestra.run.smithi006:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 120 ceph --cluster ceph -- tell 'osd.*' injectargs --osd_enable_op_tracker=false 2023-08-01T19:56:39.633 INFO:teuthology.orchestra.run.smithi008.stdout:{ 2023-08-01T19:56:39.633 INFO:teuthology.orchestra.run.smithi008.stdout: "ops": [], 2023-08-01T19:56:39.633 INFO:teuthology.orchestra.run.smithi008.stdout: "num_ops": 0 2023-08-01T19:56:39.633 INFO:teuthology.orchestra.run.smithi008.stdout:} 2023-08-01T19:56:39.643 DEBUG:teuthology.orchestra.run.smithi008:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 30 ceph --cluster ceph --admin-daemon /var/run/ceph/ceph-osd.0.asok dump_blocked_ops 2023-08-01T19:56:39.694 INFO:tasks.ceph.osd.2.smithi155.stderr:2023-08-01T19:56:39.693+0000 7faa5c6ac700 -1 received signal: Hangup from /usr/bin/python3 /bin/daemon-helper kill ceph-osd -f --cluster ceph -i 2 (PID: 111337) UID: 0 2023-08-01T19:56:39.761 INFO:teuthology.orchestra.run.smithi006.stdout:osd.0: {} 2023-08-01T19:56:39.770 INFO:teuthology.orchestra.run.smithi008.stdout:ERROR: (22) Invalid argument 2023-08-01T19:56:39.771 INFO:teuthology.orchestra.run.smithi008.stdout:op_tracker tracking is not enabled now, so no ops are tracked currently, even those get stuck. Please enable "osd_enable_op_tracker", and the tracker will start to track new ops received afterwards. 2023-08-01T19:56:39.781 DEBUG:teuthology.orchestra.run.smithi008:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 30 ceph --cluster ceph --admin-daemon /var/run/ceph/ceph-osd.0.asok dump_historic_ops 2023-08-01T19:56:39.782 INFO:teuthology.orchestra.run.smithi006.stdout:osd.2: {} 2023-08-01T19:56:39.782 INFO:teuthology.orchestra.run.smithi006.stderr:osd.0: osd_enable_op_tracker = 'false' 2023-08-01T19:56:39.782 INFO:teuthology.orchestra.run.smithi006.stderr:Error ENXIO: problem getting command descriptions from osd.1 2023-08-01T19:56:39.782 INFO:teuthology.orchestra.run.smithi006.stderr:osd.2: osd_enable_op_tracker = 'false' 2023-08-01T19:56:39.783 DEBUG:teuthology.orchestra.run:got remote process result: 6 2023-08-01T19:56:39.784 INFO:tasks.thrashosds.thrasher:Failed to tell all osds, ignoring 2023-08-01T19:56:39.795 INFO:tasks.ceph.osd.2.smithi155.stderr:2023-08-01T19:56:39.794+0000 7faa5c6ac700 -1 received signal: Hangup from /usr/bin/python3 /bin/daemon-helper kill ceph-osd -f --cluster ceph -i 2 (PID: 111337) UID: 0 2023-08-01T19:56:39.895 INFO:tasks.ceph.osd.0.smithi008.stderr:2023-08-01T19:56:39.895+0000 7f16a58f4700 -1 received signal: Hangup from /usr/bin/python3 /bin/daemon-helper kill ceph-osd -f --cluster ceph -i 0 (PID: 111179) UID: 0 2023-08-01T19:56:39.909 INFO:teuthology.orchestra.run.smithi008.stdout:ERROR: (22) Invalid argument 2023-08-01T19:56:39.910 INFO:teuthology.orchestra.run.smithi008.stdout:op_tracker tracking is not enabled now, so no ops are tracked currently, even those get stuck. Please enable "osd_enable_op_tracker", and the tracker will start to track new ops received afterwards. 2023-08-01T19:56:39.919 DEBUG:teuthology.orchestra.run.smithi155:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 30 ceph --cluster ceph --admin-daemon /var/run/ceph/ceph-osd.2.asok dump_ops_in_flight 2023-08-01T19:56:39.997 INFO:tasks.ceph.osd.0.smithi008.stderr:2023-08-01T19:56:39.996+0000 7f16a58f4700 -1 received signal: Hangup from /usr/bin/python3 /bin/daemon-helper kill ceph-osd -f --cluster ceph -i 0 (PID: 111179) UID: 0 2023-08-01T19:56:40.048 INFO:teuthology.orchestra.run.smithi155.stdout:ERROR: (22) Invalid argument 2023-08-01T19:56:40.048 INFO:teuthology.orchestra.run.smithi155.stdout:op_tracker tracking is not enabled now, so no ops are tracked currently, even those get stuck. Please enable "osd_enable_op_tracker", and the tracker will start to track new ops received afterwards. 2023-08-01T19:56:40.057 DEBUG:teuthology.orchestra.run.smithi155:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 30 ceph --cluster ceph --admin-daemon /var/run/ceph/ceph-osd.2.asok dump_blocked_ops 2023-08-01T19:56:40.101 INFO:tasks.ceph.osd.2.smithi155.stderr:2023-08-01T19:56:40.099+0000 7faa5c6ac700 -1 received signal: Hangup from /usr/bin/python3 /bin/daemon-helper kill ceph-osd -f --cluster ceph -i 2 (PID: 111337) UID: 0 2023-08-01T19:56:40.180 INFO:teuthology.orchestra.run.smithi155.stdout:ERROR: (22) Invalid argument 2023-08-01T19:56:40.181 INFO:teuthology.orchestra.run.smithi155.stdout:op_tracker tracking is not enabled now, so no ops are tracked currently, even those get stuck. Please enable "osd_enable_op_tracker", and the tracker will start to track new ops received afterwards. 2023-08-01T19:56:40.190 DEBUG:teuthology.orchestra.run.smithi155:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 30 ceph --cluster ceph --admin-daemon /var/run/ceph/ceph-osd.2.asok dump_historic_ops 2023-08-01T19:56:40.198 INFO:tasks.ceph.osd.0.smithi008.stderr:2023-08-01T19:56:40.198+0000 7f16a58f4700 -1 received signal: Hangup from /usr/bin/python3 /bin/daemon-helper kill ceph-osd -f --cluster ceph -i 0 (PID: 111179) UID: 0 2023-08-01T19:56:40.299 INFO:tasks.ceph.osd.0.smithi008.stderr:2023-08-01T19:56:40.298+0000 7f16a58f4700 -1 received signal: Hangup from /usr/bin/python3 /bin/daemon-helper kill ceph-osd -f --cluster ceph -i 0 (PID: 111179) UID: 0 2023-08-01T19:56:40.354 INFO:teuthology.orchestra.run.smithi155.stdout:ERROR: (22) Invalid argument 2023-08-01T19:56:40.355 INFO:teuthology.orchestra.run.smithi155.stdout:op_tracker tracking is not enabled now, so no ops are tracked currently, even those get stuck. Please enable "osd_enable_op_tracker", and the tracker will start to track new ops received afterwards. 2023-08-01T19:56:40.362 DEBUG:teuthology.orchestra.console.smithi101:pexpect command: ipmitool -H smithi101.ipmi.sepia.ceph.com -I lanplus -U inktank -P ApGNXcA7 power status 2023-08-01T19:56:40.375 DEBUG:teuthology.orchestra.run.smithi008:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 30 ceph --cluster ceph --admin-daemon /var/run/ceph/ceph-osd.0.asok dump_ops_in_flight 2023-08-01T19:56:40.419 INFO:tasks.ceph.osd.0.smithi008.stderr:2023-08-01T19:56:40.418+0000 7f16a58f4700 -1 received signal: Hangup from /usr/bin/python3 /bin/daemon-helper kill ceph-osd -f --cluster ceph -i 0 (PID: 111179) UID: 0 2023-08-01T19:56:40.476 DEBUG:teuthology.orchestra.console.smithi101:check power output: Chassis Power is on 2023-08-01T19:56:40.500 INFO:tasks.ceph.osd.2.smithi155.stderr:2023-08-01T19:56:40.499+0000 7faa5c6ac700 -1 received signal: Hangup from /usr/bin/python3 /bin/daemon-helper kill ceph-osd -f --cluster ceph -i 2 (PID: 111337) UID: 0 2023-08-01T19:56:40.507 INFO:teuthology.orchestra.run.smithi008.stdout:ERROR: (22) Invalid argument 2023-08-01T19:56:40.507 INFO:teuthology.orchestra.run.smithi008.stdout:op_tracker tracking is not enabled now, so no ops are tracked currently, even those get stuck. Please enable "osd_enable_op_tracker", and the tracker will start to track new ops received afterwards. 2023-08-01T19:56:40.517 DEBUG:teuthology.orchestra.run.smithi008:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 30 ceph --cluster ceph --admin-daemon /var/run/ceph/ceph-osd.0.asok dump_blocked_ops 2023-08-01T19:56:40.547 INFO:tasks.ceph.ceph_manager.ceph:removing pool_name unique_pool_0 2023-08-01T19:56:40.547 DEBUG:teuthology.orchestra.run.smithi006:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 120 ceph --cluster ceph osd pool rm unique_pool_0 unique_pool_0 --yes-i-really-really-mean-it 2023-08-01T19:56:40.577 INFO:teuthology.orchestra.console.smithi101:Power on completed 2023-08-01T19:56:40.601 INFO:tasks.ceph.osd.2.smithi155.stderr:2023-08-01T19:56:40.600+0000 7faa5c6ac700 -1 received signal: Hangup from /usr/bin/python3 /bin/daemon-helper kill ceph-osd -f --cluster ceph -i 2 (PID: 111337) UID: 0 2023-08-01T19:56:40.678 DEBUG:teuthology.orchestra.console.smithi101:Waiting for login prompt 2023-08-01T19:56:40.678 DEBUG:teuthology.orchestra.console.smithi101:pexpect command: console -M conserver.front.sepia.ceph.com -p 3109 -f smithi101 2023-08-01T19:56:40.687 INFO:teuthology.orchestra.run.smithi008.stdout:ERROR: (22) Invalid argument 2023-08-01T19:56:40.688 INFO:teuthology.orchestra.run.smithi008.stdout:op_tracker tracking is not enabled now, so no ops are tracked currently, even those get stuck. Please enable "osd_enable_op_tracker", and the tracker will start to track new ops received afterwards. 2023-08-01T19:56:40.695 DEBUG:teuthology.orchestra.run.smithi008:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 30 ceph --cluster ceph --admin-daemon /var/run/ceph/ceph-osd.0.asok dump_historic_ops 2023-08-01T19:56:40.739 INFO:tasks.ceph.osd.0.smithi008.stderr:2023-08-01T19:56:40.738+0000 7f16a58f4700 -1 received signal: Hangup from /usr/bin/python3 /bin/daemon-helper kill ceph-osd -f --cluster ceph -i 0 (PID: 111179) UID: 0 2023-08-01T19:56:40.802 INFO:tasks.ceph.osd.2.smithi155.stderr:2023-08-01T19:56:40.801+0000 7faa5c6ac700 -1 received signal: Hangup from /usr/bin/python3 /bin/daemon-helper kill ceph-osd -f --cluster ceph -i 2 (PID: 111337) UID: 0 2023-08-01T19:56:40.823 INFO:teuthology.orchestra.run.smithi008.stdout:ERROR: (22) Invalid argument 2023-08-01T19:56:40.824 INFO:teuthology.orchestra.run.smithi008.stdout:op_tracker tracking is not enabled now, so no ops are tracked currently, even those get stuck. Please enable "osd_enable_op_tracker", and the tracker will start to track new ops received afterwards. 2023-08-01T19:56:40.833 DEBUG:teuthology.orchestra.run.smithi155:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 30 ceph --cluster ceph --admin-daemon /var/run/ceph/ceph-osd.2.asok dump_ops_in_flight 2023-08-01T19:56:40.903 INFO:tasks.ceph.osd.2.smithi155.stderr:2023-08-01T19:56:40.901+0000 7faa5c6ac700 -1 received signal: Hangup from /usr/bin/python3 /bin/daemon-helper kill ceph-osd -f --cluster ceph -i 2 (PID: 111337) UID: 0 2023-08-01T19:56:40.958 INFO:teuthology.orchestra.run.smithi155.stdout:ERROR: (22) Invalid argument 2023-08-01T19:56:40.958 INFO:teuthology.orchestra.run.smithi155.stdout:op_tracker tracking is not enabled now, so no ops are tracked currently, even those get stuck. Please enable "osd_enable_op_tracker", and the tracker will start to track new ops received afterwards. 2023-08-01T19:56:40.968 DEBUG:teuthology.orchestra.run.smithi155:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 30 ceph --cluster ceph --admin-daemon /var/run/ceph/ceph-osd.2.asok dump_blocked_ops 2023-08-01T19:56:41.009 INFO:tasks.ceph.osd.2.smithi155.stderr:2023-08-01T19:56:41.008+0000 7faa5c6ac700 -1 received signal: Hangup from /usr/bin/python3 /bin/daemon-helper kill ceph-osd -f --cluster ceph -i 2 (PID: 111337) UID: 0 2023-08-01T19:56:41.103 INFO:tasks.ceph.osd.2.smithi155.stderr:2023-08-01T19:56:41.102+0000 7faa5c6ac700 -1 received signal: Hangup from /usr/bin/python3 /bin/daemon-helper kill ceph-osd -f --cluster ceph -i 2 (PID: 111337) UID: 0 2023-08-01T19:56:41.132 INFO:teuthology.orchestra.run.smithi155.stdout:ERROR: (22) Invalid argument 2023-08-01T19:56:41.133 INFO:teuthology.orchestra.run.smithi155.stdout:op_tracker tracking is not enabled now, so no ops are tracked currently, even those get stuck. Please enable "osd_enable_op_tracker", and the tracker will start to track new ops received afterwards. 2023-08-01T19:56:41.142 DEBUG:teuthology.orchestra.run.smithi155:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 30 ceph --cluster ceph --admin-daemon /var/run/ceph/ceph-osd.2.asok dump_historic_ops 2023-08-01T19:56:41.224 INFO:tasks.ceph.osd.2.smithi155.stderr:2023-08-01T19:56:41.223+0000 7faa5c6ac700 -1 received signal: Hangup from /usr/bin/python3 /bin/daemon-helper kill ceph-osd -f --cluster ceph -i 2 (PID: 111337) UID: 0 2023-08-01T19:56:41.305 INFO:tasks.ceph.osd.0.smithi008.stderr:2023-08-01T19:56:41.304+0000 7f16a58f4700 -1 received signal: Hangup from /usr/bin/python3 /bin/daemon-helper kill ceph-osd -f --cluster ceph -i 0 (PID: 111179) UID: 0 2023-08-01T19:56:41.306 INFO:teuthology.orchestra.run.smithi155.stdout:ERROR: (22) Invalid argument 2023-08-01T19:56:41.306 INFO:teuthology.orchestra.run.smithi155.stdout:op_tracker tracking is not enabled now, so no ops are tracked currently, even those get stuck. Please enable "osd_enable_op_tracker", and the tracker will start to track new ops received afterwards. 2023-08-01T19:56:41.315 DEBUG:teuthology.orchestra.run.smithi008:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 30 ceph --cluster ceph --admin-daemon /var/run/ceph/ceph-osd.0.asok dump_ops_in_flight 2023-08-01T19:56:41.406 INFO:tasks.ceph.osd.0.smithi008.stderr:2023-08-01T19:56:41.405+0000 7f16a58f4700 -1 received signal: Hangup from /usr/bin/python3 /bin/daemon-helper kill ceph-osd -f --cluster ceph -i 0 (PID: 111179) UID: 0 2023-08-01T19:56:41.448 INFO:teuthology.orchestra.run.smithi008.stdout:ERROR: (22) Invalid argument 2023-08-01T19:56:41.448 INFO:teuthology.orchestra.run.smithi008.stdout:op_tracker tracking is not enabled now, so no ops are tracked currently, even those get stuck. Please enable "osd_enable_op_tracker", and the tracker will start to track new ops received afterwards. 2023-08-01T19:56:41.458 DEBUG:teuthology.orchestra.run.smithi008:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 30 ceph --cluster ceph --admin-daemon /var/run/ceph/ceph-osd.0.asok dump_blocked_ops 2023-08-01T19:56:41.460 INFO:teuthology.orchestra.run.smithi006.stderr:pool 'unique_pool_0' removed 2023-08-01T19:56:41.473 DEBUG:teuthology.run_tasks:Unwinding manager thrashosds 2023-08-01T19:56:41.482 INFO:tasks.thrashosds:joining thrashosds 2023-08-01T19:56:41.493 DEBUG:teuthology.orchestra.run.smithi006:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 120 ceph --cluster ceph osd unset noscrub 2023-08-01T19:56:41.662 INFO:teuthology.orchestra.run.smithi008.stdout:ERROR: (22) Invalid argument 2023-08-01T19:56:41.663 INFO:teuthology.orchestra.run.smithi008.stdout:op_tracker tracking is not enabled now, so no ops are tracked currently, even those get stuck. Please enable "osd_enable_op_tracker", and the tracker will start to track new ops received afterwards. 2023-08-01T19:56:41.676 DEBUG:teuthology.orchestra.run.smithi008:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 30 ceph --cluster ceph --admin-daemon /var/run/ceph/ceph-osd.0.asok dump_historic_ops 2023-08-01T19:56:41.825 INFO:teuthology.orchestra.run.smithi008.stdout:ERROR: (22) Invalid argument 2023-08-01T19:56:41.825 INFO:teuthology.orchestra.run.smithi008.stdout:op_tracker tracking is not enabled now, so no ops are tracked currently, even those get stuck. Please enable "osd_enable_op_tracker", and the tracker will start to track new ops received afterwards. 2023-08-01T19:56:41.835 DEBUG:teuthology.orchestra.run.smithi155:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 30 ceph --cluster ceph --admin-daemon /var/run/ceph/ceph-osd.2.asok dump_ops_in_flight 2023-08-01T19:56:41.960 INFO:teuthology.orchestra.run.smithi155.stdout:ERROR: (22) Invalid argument 2023-08-01T19:56:41.961 INFO:teuthology.orchestra.run.smithi155.stdout:op_tracker tracking is not enabled now, so no ops are tracked currently, even those get stuck. Please enable "osd_enable_op_tracker", and the tracker will start to track new ops received afterwards. 2023-08-01T19:56:41.972 DEBUG:teuthology.orchestra.run.smithi155:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 30 ceph --cluster ceph --admin-daemon /var/run/ceph/ceph-osd.2.asok dump_blocked_ops 2023-08-01T19:56:42.096 INFO:teuthology.orchestra.run.smithi155.stdout:ERROR: (22) Invalid argument 2023-08-01T19:56:42.096 INFO:teuthology.orchestra.run.smithi155.stdout:op_tracker tracking is not enabled now, so no ops are tracked currently, even those get stuck. Please enable "osd_enable_op_tracker", and the tracker will start to track new ops received afterwards. 2023-08-01T19:56:42.106 DEBUG:teuthology.orchestra.run.smithi155:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 30 ceph --cluster ceph --admin-daemon /var/run/ceph/ceph-osd.2.asok dump_historic_ops 2023-08-01T19:56:42.230 INFO:teuthology.orchestra.run.smithi155.stdout:ERROR: (22) Invalid argument 2023-08-01T19:56:42.230 INFO:teuthology.orchestra.run.smithi155.stdout:op_tracker tracking is not enabled now, so no ops are tracked currently, even those get stuck. Please enable "osd_enable_op_tracker", and the tracker will start to track new ops received afterwards. 2023-08-01T19:56:42.465 INFO:teuthology.orchestra.run.smithi006.stderr:noscrub is unset 2023-08-01T19:56:42.478 DEBUG:teuthology.orchestra.run.smithi006:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 120 ceph --cluster ceph osd unset nodeep-scrub 2023-08-01T19:56:43.467 INFO:teuthology.orchestra.run.smithi006.stderr:nodeep-scrub is unset 2023-08-01T19:56:45.058 INFO:tasks.daemonwatchdog.daemon_watchdog:daemon ceph.osd.1 is failed for ~41s 2023-08-01T19:56:50.864 INFO:tasks.daemonwatchdog.daemon_watchdog:daemon ceph.osd.1 is failed for ~47s 2023-08-01T19:56:56.669 INFO:tasks.daemonwatchdog.daemon_watchdog:daemon ceph.osd.1 is failed for ~53s 2023-08-01T19:57:02.476 INFO:tasks.daemonwatchdog.daemon_watchdog:daemon ceph.osd.1 is failed for ~59s 2023-08-01T19:57:08.283 INFO:tasks.daemonwatchdog.daemon_watchdog:daemon ceph.osd.1 is failed for ~65s 2023-08-01T19:57:14.088 INFO:tasks.daemonwatchdog.daemon_watchdog:daemon ceph.osd.1 is failed for ~71s 2023-08-01T19:57:19.894 INFO:tasks.daemonwatchdog.daemon_watchdog:daemon ceph.osd.1 is failed for ~76s 2023-08-01T19:57:25.700 INFO:tasks.daemonwatchdog.daemon_watchdog:daemon ceph.osd.1 is failed for ~82s 2023-08-01T19:57:26.717 INFO:teuthology.orchestra.console.smithi101:Failed to get ipmi console status: 'utf-8' codec can't decode byte 0x80 in position 0: invalid start byte 2023-08-01T19:57:26.819 INFO:tasks.thrashosds.thrasher:Traceback (most recent call last): File "/home/teuthworker/src/github.com_ceph_ceph_a185a2e2933b21246ce41dd13f03fd6f8f84f03d/qa/tasks/ceph_manager.py", line 198, in wrapper return func(self) File "/home/teuthworker/src/github.com_ceph_ceph_a185a2e2933b21246ce41dd13f03fd6f8f84f03d/qa/tasks/ceph_manager.py", line 1430, in _do_thrash self.choose_action()() File "/home/teuthworker/src/github.com_ceph_ceph_a185a2e2933b21246ce41dd13f03fd6f8f84f03d/qa/tasks/ceph_manager.py", line 587, in revive_osd self.ceph_manager.revive_osd( File "/home/teuthworker/src/github.com_ceph_ceph_a185a2e2933b21246ce41dd13f03fd6f8f84f03d/qa/tasks/ceph_manager.py", line 3047, in revive_osd raise Exception('Failed to revive osd.{o} via ipmi'. Exception: Failed to revive osd.1 via ipmi 2023-08-01T19:57:26.819 ERROR:tasks.thrashosds.thrasher:exception: Traceback (most recent call last): File "/home/teuthworker/src/github.com_ceph_ceph_a185a2e2933b21246ce41dd13f03fd6f8f84f03d/qa/tasks/ceph_manager.py", line 1298, in do_thrash self._do_thrash() File "/home/teuthworker/src/github.com_ceph_ceph_a185a2e2933b21246ce41dd13f03fd6f8f84f03d/qa/tasks/ceph_manager.py", line 198, in wrapper return func(self) File "/home/teuthworker/src/github.com_ceph_ceph_a185a2e2933b21246ce41dd13f03fd6f8f84f03d/qa/tasks/ceph_manager.py", line 1430, in _do_thrash self.choose_action()() File "/home/teuthworker/src/github.com_ceph_ceph_a185a2e2933b21246ce41dd13f03fd6f8f84f03d/qa/tasks/ceph_manager.py", line 587, in revive_osd self.ceph_manager.revive_osd( File "/home/teuthworker/src/github.com_ceph_ceph_a185a2e2933b21246ce41dd13f03fd6f8f84f03d/qa/tasks/ceph_manager.py", line 3047, in revive_osd raise Exception('Failed to revive osd.{o} via ipmi'. Exception: Failed to revive osd.1 via ipmi 2023-08-01T19:57:26.820 INFO:tasks.thrashosds.thrasher:joining the do_sighup greenlet 2023-08-01T19:57:26.820 INFO:tasks.thrashosds.thrasher:joining the do_optrack_toggle greenlet 2023-08-01T19:57:26.820 INFO:tasks.thrashosds.thrasher:joining the do_dump_ops greenlet 2023-08-01T19:57:26.820 INFO:tasks.thrashosds.thrasher:joining the do_noscrub_toggle greenlet 2023-08-01T19:57:26.820 INFO:tasks.ceph.ceph_manager.ceph:waiting for all up 2023-08-01T19:57:26.821 DEBUG:teuthology.orchestra.run.smithi006:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 120 ceph --cluster ceph osd dump --format=json 2023-08-01T19:57:27.162 INFO:teuthology.orchestra.run.smithi006.stdout: 2023-08-01T19:57:27.162 INFO:teuthology.orchestra.run.smithi006.stdout:{"epoch":82,"fsid":"a0e420cc-4df1-42a5-8bd4-a98c309a9349","created":"2023-08-01T19:53:41.279588+0000","modified":"2023-08-01T19:56:43.457390+0000","last_up_change":"2023-08-01T19:55:58.549095+0000","last_in_change":"2023-08-01T19:53:42.974751+0000","flags":"sortbitwise,recovery_deletes,purged_snapdirs,pglog_hardlimit","flags_num":5799936,"flags_set":["pglog_hardlimit","purged_snapdirs","recovery_deletes","sortbitwise"],"crush_version":5,"full_ratio":0.94999998807907104,"backfillfull_ratio":0.89999997615814209,"nearfull_ratio":0.85000002384185791,"cluster_snapshot":"","pool_max":5,"max_osd":3,"require_min_compat_client":"luminous","min_compat_client":"jewel","require_osd_release":"quincy","pools":[{"pool":1,"pool_name":".mgr","create_time":"2023-08-01T19:53:49.961944+0000","flags":1,"flags_names":"hashpspool","type":1,"size":2,"min_size":1,"crush_rule":0,"peering_crush_bucket_count":0,"peering_crush_bucket_target":0,"peering_crush_bucket_barrier":0,"peering_crush_bucket_mandatory_member":2147483647,"object_hash":2,"pg_autoscale_mode":"off","pg_num":1,"pg_placement_num":1,"pg_placement_num_target":1,"pg_num_target":1,"pg_num_pending":1,"last_pg_merge_meta":{"source_pgid":"0.0","ready_epoch":0,"last_epoch_started":0,"last_epoch_clean":0,"source_version":"0'0","target_version":"0'0"},"last_change":"11","last_force_op_resend":"0","last_force_op_resend_prenautilus":"0","last_force_op_resend_preluminous":"0","auid":0,"snap_mode":"selfmanaged","snap_seq":0,"snap_epoch":0,"pool_snaps":[],"removed_snaps":"[]","quota_max_bytes":0,"quota_max_objects":0,"tiers":[],"tier_of":-1,"read_tier":-1,"write_tier":-1,"cache_mode":"none","target_max_bytes":0,"target_max_objects":0,"cache_target_dirty_ratio_micro":400000,"cache_target_dirty_high_ratio_micro":600000,"cache_target_full_ratio_micro":800000,"cache_min_flush_age":0,"cache_min_evict_age":0,"erasure_code_profile":"","hit_set_params":{"type":"none"},"hit_set_period":0,"hit_set_count":0,"use_gmt_hitset":true,"min_read_recency_for_promote":0,"min_write_recency_for_promote":0,"hit_set_grade_decay_rate":0,"hit_set_search_last_n":0,"grade_table":[],"stripe_width":0,"expected_num_objects":0,"fast_read":false,"options":{"pg_num_max":32,"pg_num_min":1},"application_metadata":{"mgr":{}}},{"pool":2,"pool_name":"rbd","create_time":"2023-08-01T19:53:57.404091+0000","flags":1,"flags_names":"hashpspool","type":1,"size":2,"min_size":1,"crush_rule":0,"peering_crush_bucket_count":0,"peering_crush_bucket_target":0,"peering_crush_bucket_barrier":0,"peering_crush_bucket_mandatory_member":2147483647,"object_hash":2,"pg_autoscale_mode":"off","pg_num":8,"pg_placement_num":8,"pg_placement_num_target":8,"pg_num_target":8,"pg_num_pending":8,"last_pg_merge_meta":{"source_pgid":"0.0","ready_epoch":0,"last_epoch_started":0,"last_epoch_clean":0,"source_version":"0'0","target_version":"0'0"},"last_change":"14","last_force_op_resend":"0","last_force_op_resend_prenautilus":"0","last_force_op_resend_preluminous":"0","auid":0,"snap_mode":"selfmanaged","snap_seq":0,"snap_epoch":0,"pool_snaps":[],"removed_snaps":"[]","quota_max_bytes":0,"quota_max_objects":0,"tiers":[],"tier_of":-1,"read_tier":-1,"write_tier":-1,"cache_mode":"none","target_max_bytes":0,"target_max_objects":0,"cache_target_dirty_ratio_micro":400000,"cache_target_dirty_high_ratio_micro":600000,"cache_target_full_ratio_micro":800000,"cache_min_flush_age":0,"cache_min_evict_age":0,"erasure_code_profile":"","hit_set_params":{"type":"none"},"hit_set_period":0,"hit_set_count":0,"use_gmt_hitset":true,"min_read_recency_for_promote":0,"min_write_recency_for_promote":0,"hit_set_grade_decay_rate":0,"hit_set_search_last_n":0,"grade_table":[],"stripe_width":0,"expected_num_objects":0,"fast_read":false,"options":{},"application_metadata":{"rbd":{}}},{"pool":3,"pool_name":"cephfs_metadata","create_time":"2023-08-01T19:54:02.111247+0000","flags":1,"flags_names":"hashpspool","type":1,"size":2,"min_size":1,"crush_rule":0,"peering_crush_bucket_count":0,"peering_crush_bucket_target":0,"peering_crush_bucket_barrier":0,"peering_crush_bucket_mandatory_member":2147483647,"object_hash":2,"pg_autoscale_mode":"off","pg_num":32,"pg_placement_num":32,"pg_placement_num_target":32,"pg_num_target":32,"pg_num_pending":32,"last_pg_merge_meta":{"source_pgid":"0.0","ready_epoch":0,"last_epoch_started":0,"last_epoch_clean":0,"source_version":"0'0","target_version":"0'0"},"last_change":"17","last_force_op_resend":"0","last_force_op_resend_prenautilus":"0","last_force_op_resend_preluminous":"0","auid":0,"snap_mode":"selfmanaged","snap_seq":0,"snap_epoch":0,"pool_snaps":[],"removed_snaps":"[]","quota_max_bytes":0,"quota_max_objects":0,"tiers":[],"tier_of":-1,"read_tier":-1,"write_tier":-1,"cache_mode":"none","target_max_bytes":0,"target_max_objects":0,"cache_target_dirty_ratio_micro":400000,"cache_target_dirty_high_ratio_micro":600000,"cache_target_full_ratio_micro":800000,"cache_min_flush_age":0,"cache_min_evict_age":0,"erasure_code_profile":"","hit_set_params":{"type":"none"},"hit_set_period":0,"hit_set_count":0,"use_gmt_hitset":true,"min_read_recency_for_promote":0,"min_write_recency_for_promote":0,"hit_set_grade_decay_rate":0,"hit_set_search_last_n":0,"grade_table":[],"stripe_width":0,"expected_num_objects":0,"fast_read":false,"options":{"pg_autoscale_bias":4,"pg_num_min":16,"recovery_priority":5},"application_metadata":{"cephfs":{"metadata":"cephfs"}}},{"pool":4,"pool_name":"cephfs_data","create_time":"2023-08-01T19:54:03.430277+0000","flags":1,"flags_names":"hashpspool","type":1,"size":2,"min_size":1,"crush_rule":0,"peering_crush_bucket_count":0,"peering_crush_bucket_target":0,"peering_crush_bucket_barrier":0,"peering_crush_bucket_mandatory_member":2147483647,"object_hash":2,"pg_autoscale_mode":"off","pg_num":64,"pg_placement_num":64,"pg_placement_num_target":64,"pg_num_target":64,"pg_num_pending":64,"last_pg_merge_meta":{"source_pgid":"0.0","ready_epoch":0,"last_epoch_started":0,"last_epoch_clean":0,"source_version":"0'0","target_version":"0'0"},"last_change":"18","last_force_op_resend":"0","last_force_op_resend_prenautilus":"0","last_force_op_resend_preluminous":"0","auid":0,"snap_mode":"selfmanaged","snap_seq":0,"snap_epoch":0,"pool_snaps":[],"removed_snaps":"[]","quota_max_bytes":0,"quota_max_objects":0,"tiers":[],"tier_of":-1,"read_tier":-1,"write_tier":-1,"cache_mode":"none","target_max_bytes":0,"target_max_objects":0,"cache_target_dirty_ratio_micro":400000,"cache_target_dirty_high_ratio_micro":600000,"cache_target_full_ratio_micro":800000,"cache_min_flush_age":0,"cache_min_evict_age":0,"erasure_code_profile":"","hit_set_params":{"type":"none"},"hit_set_period":0,"hit_set_count":0,"use_gmt_hitset":true,"min_read_recency_for_promote":0,"min_write_recency_for_promote":0,"hit_set_grade_decay_rate":0,"hit_set_search_last_n":0,"grade_table":[],"stripe_width":0,"expected_num_objects":0,"fast_read":false,"options":{"pg_num_min":64,"target_size_ratio":0.89999997615814209},"application_metadata":{"cephfs":{"data":"cephfs"}}}],"osds":[{"osd":0,"uuid":"5dd675c7-2777-48f2-8009-ff0e0d4c7086","up":1,"in":1,"weight":1,"primary_affinity":0.822052001953125,"last_clean_begin":0,"last_clean_end":0,"up_from":8,"up_thru":72,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.8:6800","nonce":111181},{"type":"v1","addr":"172.21.15.8:6801","nonce":111181}]},"cluster_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.8:6802","nonce":111181},{"type":"v1","addr":"172.21.15.8:6803","nonce":111181}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.8:6806","nonce":111181},{"type":"v1","addr":"172.21.15.8:6807","nonce":111181}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.8:6804","nonce":111181},{"type":"v1","addr":"172.21.15.8:6805","nonce":111181}]},"public_addr":"172.21.15.8:6801/111181","cluster_addr":"172.21.15.8:6803/111181","heartbeat_back_addr":"172.21.15.8:6807/111181","heartbeat_front_addr":"172.21.15.8:6805/111181","state":["exists","up"]},{"osd":1,"uuid":"7fc612c4-33ba-4a33-bca8-1f42ee8ed548","up":0,"in":1,"weight":1,"primary_affinity":0.3376312255859375,"last_clean_begin":0,"last_clean_end":0,"up_from":8,"up_thru":53,"down_at":62,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.101:6800","nonce":111143},{"type":"v1","addr":"172.21.15.101:6801","nonce":111143}]},"cluster_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.101:6802","nonce":111143},{"type":"v1","addr":"172.21.15.101:6803","nonce":111143}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.101:6806","nonce":111143},{"type":"v1","addr":"172.21.15.101:6807","nonce":111143}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.101:6804","nonce":111143},{"type":"v1","addr":"172.21.15.101:6805","nonce":111143}]},"public_addr":"172.21.15.101:6801/111143","cluster_addr":"172.21.15.101:6803/111143","heartbeat_back_addr":"172.21.15.101:6807/111143","heartbeat_front_addr":"172.21.15.101:6805/111143","state":["exists"]},{"osd":2,"uuid":"f85cadbc-4230-4772-8f39-62ed52e220b1","up":1,"in":1,"weight":1,"primary_affinity":0,"last_clean_begin":0,"last_clean_end":0,"up_from":9,"up_thru":62,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.155:6800","nonce":111339},{"type":"v1","addr":"172.21.15.155:6801","nonce":111339}]},"cluster_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.155:6802","nonce":111339},{"type":"v1","addr":"172.21.15.155:6803","nonce":111339}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.155:6806","nonce":111339},{"type":"v1","addr":"172.21.15.155:6807","nonce":111339}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.155:6804","nonce":111339},{"type":"v1","addr":"172.21.15.155:6805","nonce":111339}]},"public_addr":"172.21.15.155:6801/111339","cluster_addr":"172.21.15.155:6803/111339","heartbeat_back_addr":"172.21.15.155:6807/111339","heartbeat_front_addr":"172.21.15.155:6805/111339","state":["exists","up"]}],"osd_xinfo":[{"osd":0,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4540138320759226367,"old_weight":0,"last_purged_snaps_scrub":"2023-08-01T19:53:48.018154+0000","dead_epoch":0},{"osd":1,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4540138320759226367,"old_weight":0,"last_purged_snaps_scrub":"2023-08-01T19:53:48.000488+0000","dead_epoch":61},{"osd":2,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4540138320759226367,"old_weight":0,"last_purged_snaps_scrub":"2023-08-01T19:53:48.072529+0000","dead_epoch":0}],"pg_upmap":[],"pg_upmap_items":[],"pg_temp":[],"primary_temp":[],"blocklist":{},"range_blocklist":{},"erasure_code_profiles":{"default":{"crush-failure-domain":"osd","k":"2","m":"1","plugin":"jerasure","technique":"reed_sol_van"}},"removed_snaps_queue":[],"new_removed_snaps":[],"new_purged_snaps":[],"crush_node_flags":{},"device_class_flags":{},"stretch_mode":{"stretch_mode_enabled":false,"stretch_bucket_count":0,"degraded_stretch_mode":0,"recovering_stretch_mode":0,"stretch_mode_bucket":0}} 2023-08-01T19:57:30.176 DEBUG:teuthology.orchestra.run.smithi006:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 120 ceph --cluster ceph osd dump --format=json 2023-08-01T19:57:30.524 INFO:teuthology.orchestra.run.smithi006.stdout: 2023-08-01T19:57:30.524 INFO:teuthology.orchestra.run.smithi006.stdout:{"epoch":82,"fsid":"a0e420cc-4df1-42a5-8bd4-a98c309a9349","created":"2023-08-01T19:53:41.279588+0000","modified":"2023-08-01T19:56:43.457390+0000","last_up_change":"2023-08-01T19:55:58.549095+0000","last_in_change":"2023-08-01T19:53:42.974751+0000","flags":"sortbitwise,recovery_deletes,purged_snapdirs,pglog_hardlimit","flags_num":5799936,"flags_set":["pglog_hardlimit","purged_snapdirs","recovery_deletes","sortbitwise"],"crush_version":5,"full_ratio":0.94999998807907104,"backfillfull_ratio":0.89999997615814209,"nearfull_ratio":0.85000002384185791,"cluster_snapshot":"","pool_max":5,"max_osd":3,"require_min_compat_client":"luminous","min_compat_client":"jewel","require_osd_release":"quincy","pools":[{"pool":1,"pool_name":".mgr","create_time":"2023-08-01T19:53:49.961944+0000","flags":1,"flags_names":"hashpspool","type":1,"size":2,"min_size":1,"crush_rule":0,"peering_crush_bucket_count":0,"peering_crush_bucket_target":0,"peering_crush_bucket_barrier":0,"peering_crush_bucket_mandatory_member":2147483647,"object_hash":2,"pg_autoscale_mode":"off","pg_num":1,"pg_placement_num":1,"pg_placement_num_target":1,"pg_num_target":1,"pg_num_pending":1,"last_pg_merge_meta":{"source_pgid":"0.0","ready_epoch":0,"last_epoch_started":0,"last_epoch_clean":0,"source_version":"0'0","target_version":"0'0"},"last_change":"11","last_force_op_resend":"0","last_force_op_resend_prenautilus":"0","last_force_op_resend_preluminous":"0","auid":0,"snap_mode":"selfmanaged","snap_seq":0,"snap_epoch":0,"pool_snaps":[],"removed_snaps":"[]","quota_max_bytes":0,"quota_max_objects":0,"tiers":[],"tier_of":-1,"read_tier":-1,"write_tier":-1,"cache_mode":"none","target_max_bytes":0,"target_max_objects":0,"cache_target_dirty_ratio_micro":400000,"cache_target_dirty_high_ratio_micro":600000,"cache_target_full_ratio_micro":800000,"cache_min_flush_age":0,"cache_min_evict_age":0,"erasure_code_profile":"","hit_set_params":{"type":"none"},"hit_set_period":0,"hit_set_count":0,"use_gmt_hitset":true,"min_read_recency_for_promote":0,"min_write_recency_for_promote":0,"hit_set_grade_decay_rate":0,"hit_set_search_last_n":0,"grade_table":[],"stripe_width":0,"expected_num_objects":0,"fast_read":false,"options":{"pg_num_max":32,"pg_num_min":1},"application_metadata":{"mgr":{}}},{"pool":2,"pool_name":"rbd","create_time":"2023-08-01T19:53:57.404091+0000","flags":1,"flags_names":"hashpspool","type":1,"size":2,"min_size":1,"crush_rule":0,"peering_crush_bucket_count":0,"peering_crush_bucket_target":0,"peering_crush_bucket_barrier":0,"peering_crush_bucket_mandatory_member":2147483647,"object_hash":2,"pg_autoscale_mode":"off","pg_num":8,"pg_placement_num":8,"pg_placement_num_target":8,"pg_num_target":8,"pg_num_pending":8,"last_pg_merge_meta":{"source_pgid":"0.0","ready_epoch":0,"last_epoch_started":0,"last_epoch_clean":0,"source_version":"0'0","target_version":"0'0"},"last_change":"14","last_force_op_resend":"0","last_force_op_resend_prenautilus":"0","last_force_op_resend_preluminous":"0","auid":0,"snap_mode":"selfmanaged","snap_seq":0,"snap_epoch":0,"pool_snaps":[],"removed_snaps":"[]","quota_max_bytes":0,"quota_max_objects":0,"tiers":[],"tier_of":-1,"read_tier":-1,"write_tier":-1,"cache_mode":"none","target_max_bytes":0,"target_max_objects":0,"cache_target_dirty_ratio_micro":400000,"cache_target_dirty_high_ratio_micro":600000,"cache_target_full_ratio_micro":800000,"cache_min_flush_age":0,"cache_min_evict_age":0,"erasure_code_profile":"","hit_set_params":{"type":"none"},"hit_set_period":0,"hit_set_count":0,"use_gmt_hitset":true,"min_read_recency_for_promote":0,"min_write_recency_for_promote":0,"hit_set_grade_decay_rate":0,"hit_set_search_last_n":0,"grade_table":[],"stripe_width":0,"expected_num_objects":0,"fast_read":false,"options":{},"application_metadata":{"rbd":{}}},{"pool":3,"pool_name":"cephfs_metadata","create_time":"2023-08-01T19:54:02.111247+0000","flags":1,"flags_names":"hashpspool","type":1,"size":2,"min_size":1,"crush_rule":0,"peering_crush_bucket_count":0,"peering_crush_bucket_target":0,"peering_crush_bucket_barrier":0,"peering_crush_bucket_mandatory_member":2147483647,"object_hash":2,"pg_autoscale_mode":"off","pg_num":32,"pg_placement_num":32,"pg_placement_num_target":32,"pg_num_target":32,"pg_num_pending":32,"last_pg_merge_meta":{"source_pgid":"0.0","ready_epoch":0,"last_epoch_started":0,"last_epoch_clean":0,"source_version":"0'0","target_version":"0'0"},"last_change":"17","last_force_op_resend":"0","last_force_op_resend_prenautilus":"0","last_force_op_resend_preluminous":"0","auid":0,"snap_mode":"selfmanaged","snap_seq":0,"snap_epoch":0,"pool_snaps":[],"removed_snaps":"[]","quota_max_bytes":0,"quota_max_objects":0,"tiers":[],"tier_of":-1,"read_tier":-1,"write_tier":-1,"cache_mode":"none","target_max_bytes":0,"target_max_objects":0,"cache_target_dirty_ratio_micro":400000,"cache_target_dirty_high_ratio_micro":600000,"cache_target_full_ratio_micro":800000,"cache_min_flush_age":0,"cache_min_evict_age":0,"erasure_code_profile":"","hit_set_params":{"type":"none"},"hit_set_period":0,"hit_set_count":0,"use_gmt_hitset":true,"min_read_recency_for_promote":0,"min_write_recency_for_promote":0,"hit_set_grade_decay_rate":0,"hit_set_search_last_n":0,"grade_table":[],"stripe_width":0,"expected_num_objects":0,"fast_read":false,"options":{"pg_autoscale_bias":4,"pg_num_min":16,"recovery_priority":5},"application_metadata":{"cephfs":{"metadata":"cephfs"}}},{"pool":4,"pool_name":"cephfs_data","create_time":"2023-08-01T19:54:03.430277+0000","flags":1,"flags_names":"hashpspool","type":1,"size":2,"min_size":1,"crush_rule":0,"peering_crush_bucket_count":0,"peering_crush_bucket_target":0,"peering_crush_bucket_barrier":0,"peering_crush_bucket_mandatory_member":2147483647,"object_hash":2,"pg_autoscale_mode":"off","pg_num":64,"pg_placement_num":64,"pg_placement_num_target":64,"pg_num_target":64,"pg_num_pending":64,"last_pg_merge_meta":{"source_pgid":"0.0","ready_epoch":0,"last_epoch_started":0,"last_epoch_clean":0,"source_version":"0'0","target_version":"0'0"},"last_change":"18","last_force_op_resend":"0","last_force_op_resend_prenautilus":"0","last_force_op_resend_preluminous":"0","auid":0,"snap_mode":"selfmanaged","snap_seq":0,"snap_epoch":0,"pool_snaps":[],"removed_snaps":"[]","quota_max_bytes":0,"quota_max_objects":0,"tiers":[],"tier_of":-1,"read_tier":-1,"write_tier":-1,"cache_mode":"none","target_max_bytes":0,"target_max_objects":0,"cache_target_dirty_ratio_micro":400000,"cache_target_dirty_high_ratio_micro":600000,"cache_target_full_ratio_micro":800000,"cache_min_flush_age":0,"cache_min_evict_age":0,"erasure_code_profile":"","hit_set_params":{"type":"none"},"hit_set_period":0,"hit_set_count":0,"use_gmt_hitset":true,"min_read_recency_for_promote":0,"min_write_recency_for_promote":0,"hit_set_grade_decay_rate":0,"hit_set_search_last_n":0,"grade_table":[],"stripe_width":0,"expected_num_objects":0,"fast_read":false,"options":{"pg_num_min":64,"target_size_ratio":0.89999997615814209},"application_metadata":{"cephfs":{"data":"cephfs"}}}],"osds":[{"osd":0,"uuid":"5dd675c7-2777-48f2-8009-ff0e0d4c7086","up":1,"in":1,"weight":1,"primary_affinity":0.822052001953125,"last_clean_begin":0,"last_clean_end":0,"up_from":8,"up_thru":72,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.8:6800","nonce":111181},{"type":"v1","addr":"172.21.15.8:6801","nonce":111181}]},"cluster_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.8:6802","nonce":111181},{"type":"v1","addr":"172.21.15.8:6803","nonce":111181}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.8:6806","nonce":111181},{"type":"v1","addr":"172.21.15.8:6807","nonce":111181}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.8:6804","nonce":111181},{"type":"v1","addr":"172.21.15.8:6805","nonce":111181}]},"public_addr":"172.21.15.8:6801/111181","cluster_addr":"172.21.15.8:6803/111181","heartbeat_back_addr":"172.21.15.8:6807/111181","heartbeat_front_addr":"172.21.15.8:6805/111181","state":["exists","up"]},{"osd":1,"uuid":"7fc612c4-33ba-4a33-bca8-1f42ee8ed548","up":0,"in":1,"weight":1,"primary_affinity":0.3376312255859375,"last_clean_begin":0,"last_clean_end":0,"up_from":8,"up_thru":53,"down_at":62,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.101:6800","nonce":111143},{"type":"v1","addr":"172.21.15.101:6801","nonce":111143}]},"cluster_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.101:6802","nonce":111143},{"type":"v1","addr":"172.21.15.101:6803","nonce":111143}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.101:6806","nonce":111143},{"type":"v1","addr":"172.21.15.101:6807","nonce":111143}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.101:6804","nonce":111143},{"type":"v1","addr":"172.21.15.101:6805","nonce":111143}]},"public_addr":"172.21.15.101:6801/111143","cluster_addr":"172.21.15.101:6803/111143","heartbeat_back_addr":"172.21.15.101:6807/111143","heartbeat_front_addr":"172.21.15.101:6805/111143","state":["exists"]},{"osd":2,"uuid":"f85cadbc-4230-4772-8f39-62ed52e220b1","up":1,"in":1,"weight":1,"primary_affinity":0,"last_clean_begin":0,"last_clean_end":0,"up_from":9,"up_thru":62,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.155:6800","nonce":111339},{"type":"v1","addr":"172.21.15.155:6801","nonce":111339}]},"cluster_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.155:6802","nonce":111339},{"type":"v1","addr":"172.21.15.155:6803","nonce":111339}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.155:6806","nonce":111339},{"type":"v1","addr":"172.21.15.155:6807","nonce":111339}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.155:6804","nonce":111339},{"type":"v1","addr":"172.21.15.155:6805","nonce":111339}]},"public_addr":"172.21.15.155:6801/111339","cluster_addr":"172.21.15.155:6803/111339","heartbeat_back_addr":"172.21.15.155:6807/111339","heartbeat_front_addr":"172.21.15.155:6805/111339","state":["exists","up"]}],"osd_xinfo":[{"osd":0,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4540138320759226367,"old_weight":0,"last_purged_snaps_scrub":"2023-08-01T19:53:48.018154+0000","dead_epoch":0},{"osd":1,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4540138320759226367,"old_weight":0,"last_purged_snaps_scrub":"2023-08-01T19:53:48.000488+0000","dead_epoch":61},{"osd":2,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4540138320759226367,"old_weight":0,"last_purged_snaps_scrub":"2023-08-01T19:53:48.072529+0000","dead_epoch":0}],"pg_upmap":[],"pg_upmap_items":[],"pg_temp":[],"primary_temp":[],"blocklist":{},"range_blocklist":{},"erasure_code_profiles":{"default":{"crush-failure-domain":"osd","k":"2","m":"1","plugin":"jerasure","technique":"reed_sol_van"}},"removed_snaps_queue":[],"new_removed_snaps":[],"new_purged_snaps":[],"crush_node_flags":{},"device_class_flags":{},"stretch_mode":{"stretch_mode_enabled":false,"stretch_bucket_count":0,"degraded_stretch_mode":0,"recovering_stretch_mode":0,"stretch_mode_bucket":0}} 2023-08-01T19:57:31.506 INFO:tasks.daemonwatchdog.daemon_watchdog:daemon ceph.osd.1 is failed for ~88s 2023-08-01T19:57:31.506 INFO:tasks.daemonwatchdog.daemon_watchdog:OSDThrasher failed 2023-08-01T19:57:31.506 INFO:tasks.daemonwatchdog.daemon_watchdog:BARK! unmounting mounts and killing all daemons 2023-08-01T19:57:32.310 INFO:tasks.ceph.osd.0:Sent signal 15 2023-08-01T19:57:32.311 INFO:tasks.ceph.osd.2:Sent signal 15 2023-08-01T19:57:32.311 INFO:tasks.ceph.mds.a:Sent signal 15 2023-08-01T19:57:32.311 INFO:tasks.ceph.mon.a:Sent signal 15 2023-08-01T19:57:32.311 INFO:tasks.ceph.mon.b:Sent signal 15 2023-08-01T19:57:32.312 INFO:tasks.ceph.mon.c:Sent signal 15 2023-08-01T19:57:32.312 INFO:tasks.ceph.mgr.x:Sent signal 15 2023-08-01T19:57:32.312 INFO:tasks.ceph.mgr.y:Sent signal 15 2023-08-01T19:57:32.313 INFO:tasks.ceph.mds.a.smithi006.stderr:2023-08-01T19:57:32.311+0000 7fbb8354f700 -1 received signal: Terminated from /usr/bin/python3 /bin/daemon-helper kill ceph-mds -f --cluster ceph -i a (PID: 111375) UID: 0 2023-08-01T19:57:32.313 INFO:tasks.ceph.mds.a.smithi006.stderr:2023-08-01T19:57:32.311+0000 7fbb8354f700 -1 mds.a *** got signal Terminated *** 2023-08-01T19:57:32.314 INFO:tasks.ceph.osd.2.smithi155.stderr:2023-08-01T19:57:32.310+0000 7faa5c6ac700 -1 received signal: Terminated from /usr/bin/python3 /bin/daemon-helper kill ceph-osd -f --cluster ceph -i 2 (PID: 111337) UID: 0 2023-08-01T19:57:32.314 INFO:tasks.ceph.osd.2.smithi155.stderr:2023-08-01T19:57:32.310+0000 7faa5c6ac700 -1 osd.2 82 *** Got signal Terminated *** 2023-08-01T19:57:32.314 INFO:tasks.ceph.osd.2.smithi155.stderr:2023-08-01T19:57:32.310+0000 7faa5c6ac700 -1 osd.2 82 *** Immediate shutdown (osd_fast_shutdown=true) *** 2023-08-01T19:57:32.314 INFO:tasks.ceph.mon.a.smithi006.stderr:2023-08-01T19:57:32.311+0000 7f71122b1700 -1 received signal: Terminated from /usr/bin/python3 /bin/daemon-helper kill ceph-mon -f --cluster ceph -i a (PID: 110588) UID: 0 2023-08-01T19:57:32.314 INFO:tasks.ceph.mon.a.smithi006.stderr:2023-08-01T19:57:32.311+0000 7f71122b1700 -1 mon.a@0(leader) e1 *** Got Signal Terminated *** 2023-08-01T19:57:32.315 INFO:tasks.ceph.osd.0.smithi008.stderr:2023-08-01T19:57:32.309+0000 7f16a58f4700 -1 received signal: Terminated from /usr/bin/python3 /bin/daemon-helper kill ceph-osd -f --cluster ceph -i 0 (PID: 111179) UID: 0 2023-08-01T19:57:32.315 INFO:tasks.ceph.osd.0.smithi008.stderr:2023-08-01T19:57:32.309+0000 7f16a58f4700 -1 osd.0 82 *** Got signal Terminated *** 2023-08-01T19:57:32.315 INFO:tasks.ceph.osd.0.smithi008.stderr:2023-08-01T19:57:32.309+0000 7f16a58f4700 -1 osd.0 82 *** Immediate shutdown (osd_fast_shutdown=true) *** 2023-08-01T19:57:32.315 INFO:tasks.ceph.mon.b.smithi006.stderr:2023-08-01T19:57:32.311+0000 7f547ec3b700 -1 received signal: Terminated from /usr/bin/python3 /bin/daemon-helper kill ceph-mon -f --cluster ceph -i b (PID: 110601) UID: 0 2023-08-01T19:57:32.315 INFO:tasks.ceph.mon.b.smithi006.stderr:2023-08-01T19:57:32.311+0000 7f547ec3b700 -1 mon.b@1(peon) e1 *** Got Signal Terminated *** 2023-08-01T19:57:32.316 INFO:tasks.ceph.mon.c.smithi006.stderr:2023-08-01T19:57:32.312+0000 7f25c231f700 -1 received signal: Terminated from /usr/bin/python3 /bin/daemon-helper kill ceph-mon -f --cluster ceph -i c (PID: 110608) UID: 0 2023-08-01T19:57:32.316 INFO:tasks.ceph.mon.c.smithi006.stderr:2023-08-01T19:57:32.312+0000 7f25c231f700 -1 mon.c@2(peon) e1 *** Got Signal Terminated *** 2023-08-01T19:57:32.316 INFO:tasks.ceph.mgr.x.smithi006.stderr:2023-08-01T19:57:32.312+0000 7f9806470700 -1 received signal: Terminated from /usr/bin/python3 /bin/daemon-helper kill ceph-mgr -f --cluster ceph -i x (PID: 110611) UID: 0 2023-08-01T19:57:32.316 INFO:tasks.ceph.mgr.x.smithi006.stderr:2023-08-01T19:57:32.312+0000 7f9806470700 -1 mgr handle_mgr_signal *** Got signal Terminated *** 2023-08-01T19:57:32.514 INFO:tasks.ceph.mgr.y.smithi006.stderr:daemon-helper: command crashed with signal 15 2023-08-01T19:57:33.539 DEBUG:teuthology.orchestra.run.smithi006:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 120 ceph --cluster ceph osd dump --format=json 2023-08-01T19:59:33.578 DEBUG:teuthology.orchestra.run:got remote process result: 124 2023-08-01T19:59:33.579 ERROR:teuthology.run_tasks:Manager failed: thrashosds Traceback (most recent call last): File "/home/teuthworker/src/git.ceph.com_teuthology_10753fdddd8d487ef9ffba05c09f1a055cd67877/teuthology/run_tasks.py", line 154, in run_tasks suppress = manager.__exit__(*exc_info) File "/usr/lib/python3.8/contextlib.py", line 120, in __exit__ next(self.gen) File "/home/teuthworker/src/github.com_ceph_ceph_a185a2e2933b21246ce41dd13f03fd6f8f84f03d/qa/tasks/thrashosds.py", line 215, in task cluster_manager.wait_for_all_osds_up() File "/home/teuthworker/src/github.com_ceph_ceph_a185a2e2933b21246ce41dd13f03fd6f8f84f03d/qa/tasks/ceph_manager.py", line 2796, in wait_for_all_osds_up while not self.are_all_osds_up(): File "/home/teuthworker/src/github.com_ceph_ceph_a185a2e2933b21246ce41dd13f03fd6f8f84f03d/qa/tasks/ceph_manager.py", line 2786, in are_all_osds_up x = self.get_osd_dump() File "/home/teuthworker/src/github.com_ceph_ceph_a185a2e2933b21246ce41dd13f03fd6f8f84f03d/qa/tasks/ceph_manager.py", line 2549, in get_osd_dump return self.get_osd_dump_json()['osds'] File "/home/teuthworker/src/github.com_ceph_ceph_a185a2e2933b21246ce41dd13f03fd6f8f84f03d/qa/tasks/ceph_manager.py", line 2541, in get_osd_dump_json out = self.raw_cluster_cmd('osd', 'dump', '--format=json') File "/home/teuthworker/src/github.com_ceph_ceph_a185a2e2933b21246ce41dd13f03fd6f8f84f03d/qa/tasks/ceph_manager.py", line 1624, in raw_cluster_cmd return self.run_cluster_cmd(**kwargs).stdout.getvalue() File "/home/teuthworker/src/github.com_ceph_ceph_a185a2e2933b21246ce41dd13f03fd6f8f84f03d/qa/tasks/ceph_manager.py", line 1615, in run_cluster_cmd return self.controller.run(**kwargs) File "/home/teuthworker/src/git.ceph.com_teuthology_10753fdddd8d487ef9ffba05c09f1a055cd67877/teuthology/orchestra/remote.py", line 522, in run r = self._runner(client=self.ssh, name=self.shortname, **kwargs) File "/home/teuthworker/src/git.ceph.com_teuthology_10753fdddd8d487ef9ffba05c09f1a055cd67877/teuthology/orchestra/run.py", line 455, in run r.wait() File "/home/teuthworker/src/git.ceph.com_teuthology_10753fdddd8d487ef9ffba05c09f1a055cd67877/teuthology/orchestra/run.py", line 161, in wait self._raise_for_status() File "/home/teuthworker/src/git.ceph.com_teuthology_10753fdddd8d487ef9ffba05c09f1a055cd67877/teuthology/orchestra/run.py", line 181, in _raise_for_status raise CommandFailedError( teuthology.exceptions.CommandFailedError: Command failed on smithi006 with status 124: 'sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 120 ceph --cluster ceph osd dump --format=json' 2023-08-01T19:59:33.580 DEBUG:teuthology.run_tasks:Unwinding manager ceph 2023-08-01T19:59:33.589 INFO:tasks.ceph.ceph_manager.ceph:Canceling any pending splits or merges... 2023-08-01T19:59:33.590 DEBUG:teuthology.orchestra.run.smithi006:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 120 ceph --cluster ceph osd dump --format=json 2023-08-01T20:01:33.629 DEBUG:teuthology.orchestra.run:got remote process result: 124 2023-08-01T20:01:33.630 ERROR:teuthology.contextutil:Saw exception from nested tasks Traceback (most recent call last): File "/home/teuthworker/src/github.com_ceph_ceph_a185a2e2933b21246ce41dd13f03fd6f8f84f03d/qa/tasks/ceph.py", line 1895, in task yield File "/home/teuthworker/src/git.ceph.com_teuthology_10753fdddd8d487ef9ffba05c09f1a055cd67877/teuthology/run_tasks.py", line 154, in run_tasks suppress = manager.__exit__(*exc_info) File "/usr/lib/python3.8/contextlib.py", line 120, in __exit__ next(self.gen) File "/home/teuthworker/src/github.com_ceph_ceph_a185a2e2933b21246ce41dd13f03fd6f8f84f03d/qa/tasks/thrashosds.py", line 215, in task cluster_manager.wait_for_all_osds_up() File "/home/teuthworker/src/github.com_ceph_ceph_a185a2e2933b21246ce41dd13f03fd6f8f84f03d/qa/tasks/ceph_manager.py", line 2796, in wait_for_all_osds_up while not self.are_all_osds_up(): File "/home/teuthworker/src/github.com_ceph_ceph_a185a2e2933b21246ce41dd13f03fd6f8f84f03d/qa/tasks/ceph_manager.py", line 2786, in are_all_osds_up x = self.get_osd_dump() File "/home/teuthworker/src/github.com_ceph_ceph_a185a2e2933b21246ce41dd13f03fd6f8f84f03d/qa/tasks/ceph_manager.py", line 2549, in get_osd_dump return self.get_osd_dump_json()['osds'] File "/home/teuthworker/src/github.com_ceph_ceph_a185a2e2933b21246ce41dd13f03fd6f8f84f03d/qa/tasks/ceph_manager.py", line 2541, in get_osd_dump_json out = self.raw_cluster_cmd('osd', 'dump', '--format=json') File "/home/teuthworker/src/github.com_ceph_ceph_a185a2e2933b21246ce41dd13f03fd6f8f84f03d/qa/tasks/ceph_manager.py", line 1624, in raw_cluster_cmd return self.run_cluster_cmd(**kwargs).stdout.getvalue() File "/home/teuthworker/src/github.com_ceph_ceph_a185a2e2933b21246ce41dd13f03fd6f8f84f03d/qa/tasks/ceph_manager.py", line 1615, in run_cluster_cmd return self.controller.run(**kwargs) File "/home/teuthworker/src/git.ceph.com_teuthology_10753fdddd8d487ef9ffba05c09f1a055cd67877/teuthology/orchestra/remote.py", line 522, in run r = self._runner(client=self.ssh, name=self.shortname, **kwargs) File "/home/teuthworker/src/git.ceph.com_teuthology_10753fdddd8d487ef9ffba05c09f1a055cd67877/teuthology/orchestra/run.py", line 455, in run r.wait() File "/home/teuthworker/src/git.ceph.com_teuthology_10753fdddd8d487ef9ffba05c09f1a055cd67877/teuthology/orchestra/run.py", line 161, in wait self._raise_for_status() File "/home/teuthworker/src/git.ceph.com_teuthology_10753fdddd8d487ef9ffba05c09f1a055cd67877/teuthology/orchestra/run.py", line 181, in _raise_for_status raise CommandFailedError( teuthology.exceptions.CommandFailedError: Command failed on smithi006 with status 124: 'sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 120 ceph --cluster ceph osd dump --format=json' During handling of the above exception, another exception occurred: Traceback (most recent call last): File "/home/teuthworker/src/git.ceph.com_teuthology_10753fdddd8d487ef9ffba05c09f1a055cd67877/teuthology/contextutil.py", line 32, in nested yield vars File "/home/teuthworker/src/github.com_ceph_ceph_a185a2e2933b21246ce41dd13f03fd6f8f84f03d/qa/tasks/ceph.py", line 1899, in task ctx.managers[config['cluster']].stop_pg_num_changes() File "/home/teuthworker/src/github.com_ceph_ceph_a185a2e2933b21246ce41dd13f03fd6f8f84f03d/qa/tasks/ceph_manager.py", line 2307, in stop_pg_num_changes osd_dump = self.get_osd_dump_json() File "/home/teuthworker/src/github.com_ceph_ceph_a185a2e2933b21246ce41dd13f03fd6f8f84f03d/qa/tasks/ceph_manager.py", line 2541, in get_osd_dump_json out = self.raw_cluster_cmd('osd', 'dump', '--format=json') File "/home/teuthworker/src/github.com_ceph_ceph_a185a2e2933b21246ce41dd13f03fd6f8f84f03d/qa/tasks/ceph_manager.py", line 1624, in raw_cluster_cmd return self.run_cluster_cmd(**kwargs).stdout.getvalue() File "/home/teuthworker/src/github.com_ceph_ceph_a185a2e2933b21246ce41dd13f03fd6f8f84f03d/qa/tasks/ceph_manager.py", line 1615, in run_cluster_cmd return self.controller.run(**kwargs) File "/home/teuthworker/src/git.ceph.com_teuthology_10753fdddd8d487ef9ffba05c09f1a055cd67877/teuthology/orchestra/remote.py", line 522, in run r = self._runner(client=self.ssh, name=self.shortname, **kwargs) File "/home/teuthworker/src/git.ceph.com_teuthology_10753fdddd8d487ef9ffba05c09f1a055cd67877/teuthology/orchestra/run.py", line 455, in run r.wait() File "/home/teuthworker/src/git.ceph.com_teuthology_10753fdddd8d487ef9ffba05c09f1a055cd67877/teuthology/orchestra/run.py", line 161, in wait self._raise_for_status() File "/home/teuthworker/src/git.ceph.com_teuthology_10753fdddd8d487ef9ffba05c09f1a055cd67877/teuthology/orchestra/run.py", line 181, in _raise_for_status raise CommandFailedError( teuthology.exceptions.CommandFailedError: Command failed on smithi006 with status 124: 'sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 120 ceph --cluster ceph osd dump --format=json' 2023-08-01T20:01:33.631 INFO:teuthology.misc:Shutting down mds daemons... 2023-08-01T20:01:33.632 DEBUG:tasks.ceph.mds.a:waiting for process to exit 2023-08-01T20:01:33.632 INFO:teuthology.orchestra.run:waiting for 300 2023-08-01T20:01:33.633 INFO:tasks.ceph.mds.a:Stopped 2023-08-01T20:01:33.633 INFO:teuthology.misc:Shutting down osd daemons... 2023-08-01T20:01:33.634 DEBUG:tasks.ceph.osd.0:waiting for process to exit 2023-08-01T20:01:33.634 INFO:teuthology.orchestra.run:waiting for 300 2023-08-01T20:01:33.634 INFO:tasks.ceph.osd.0:Stopped 2023-08-01T20:01:33.635 DEBUG:tasks.ceph.osd.1:waiting for process to exit 2023-08-01T20:01:33.635 INFO:teuthology.orchestra.run:waiting for 300 2023-08-01T20:01:33.636 DEBUG:teuthology.orchestra.run:got remote process result: None 2023-08-01T20:01:33.636 ERROR:teuthology.misc:Saw exception from ceph.osd.1 Traceback (most recent call last): File "/home/teuthworker/src/github.com_ceph_ceph_a185a2e2933b21246ce41dd13f03fd6f8f84f03d/qa/tasks/ceph.py", line 1895, in task yield File "/home/teuthworker/src/git.ceph.com_teuthology_10753fdddd8d487ef9ffba05c09f1a055cd67877/teuthology/run_tasks.py", line 154, in run_tasks suppress = manager.__exit__(*exc_info) File "/usr/lib/python3.8/contextlib.py", line 120, in __exit__ next(self.gen) File "/home/teuthworker/src/github.com_ceph_ceph_a185a2e2933b21246ce41dd13f03fd6f8f84f03d/qa/tasks/thrashosds.py", line 215, in task cluster_manager.wait_for_all_osds_up() File "/home/teuthworker/src/github.com_ceph_ceph_a185a2e2933b21246ce41dd13f03fd6f8f84f03d/qa/tasks/ceph_manager.py", line 2796, in wait_for_all_osds_up while not self.are_all_osds_up(): File "/home/teuthworker/src/github.com_ceph_ceph_a185a2e2933b21246ce41dd13f03fd6f8f84f03d/qa/tasks/ceph_manager.py", line 2786, in are_all_osds_up x = self.get_osd_dump() File "/home/teuthworker/src/github.com_ceph_ceph_a185a2e2933b21246ce41dd13f03fd6f8f84f03d/qa/tasks/ceph_manager.py", line 2549, in get_osd_dump return self.get_osd_dump_json()['osds'] File "/home/teuthworker/src/github.com_ceph_ceph_a185a2e2933b21246ce41dd13f03fd6f8f84f03d/qa/tasks/ceph_manager.py", line 2541, in get_osd_dump_json out = self.raw_cluster_cmd('osd', 'dump', '--format=json') File "/home/teuthworker/src/github.com_ceph_ceph_a185a2e2933b21246ce41dd13f03fd6f8f84f03d/qa/tasks/ceph_manager.py", line 1624, in raw_cluster_cmd return self.run_cluster_cmd(**kwargs).stdout.getvalue() File "/home/teuthworker/src/github.com_ceph_ceph_a185a2e2933b21246ce41dd13f03fd6f8f84f03d/qa/tasks/ceph_manager.py", line 1615, in run_cluster_cmd return self.controller.run(**kwargs) File "/home/teuthworker/src/git.ceph.com_teuthology_10753fdddd8d487ef9ffba05c09f1a055cd67877/teuthology/orchestra/remote.py", line 522, in run r = self._runner(client=self.ssh, name=self.shortname, **kwargs) File "/home/teuthworker/src/git.ceph.com_teuthology_10753fdddd8d487ef9ffba05c09f1a055cd67877/teuthology/orchestra/run.py", line 455, in run r.wait() File "/home/teuthworker/src/git.ceph.com_teuthology_10753fdddd8d487ef9ffba05c09f1a055cd67877/teuthology/orchestra/run.py", line 161, in wait self._raise_for_status() File "/home/teuthworker/src/git.ceph.com_teuthology_10753fdddd8d487ef9ffba05c09f1a055cd67877/teuthology/orchestra/run.py", line 181, in _raise_for_status raise CommandFailedError( teuthology.exceptions.CommandFailedError: Command failed on smithi006 with status 124: 'sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 120 ceph --cluster ceph osd dump --format=json' During handling of the above exception, another exception occurred: Traceback (most recent call last): File "/home/teuthworker/src/github.com_ceph_ceph_a185a2e2933b21246ce41dd13f03fd6f8f84f03d/qa/tasks/ceph.py", line 1438, in run_daemon yield File "/home/teuthworker/src/git.ceph.com_teuthology_10753fdddd8d487ef9ffba05c09f1a055cd67877/teuthology/contextutil.py", line 32, in nested yield vars File "/home/teuthworker/src/github.com_ceph_ceph_a185a2e2933b21246ce41dd13f03fd6f8f84f03d/qa/tasks/ceph.py", line 1899, in task ctx.managers[config['cluster']].stop_pg_num_changes() File "/home/teuthworker/src/github.com_ceph_ceph_a185a2e2933b21246ce41dd13f03fd6f8f84f03d/qa/tasks/ceph_manager.py", line 2307, in stop_pg_num_changes osd_dump = self.get_osd_dump_json() File "/home/teuthworker/src/github.com_ceph_ceph_a185a2e2933b21246ce41dd13f03fd6f8f84f03d/qa/tasks/ceph_manager.py", line 2541, in get_osd_dump_json out = self.raw_cluster_cmd('osd', 'dump', '--format=json') File "/home/teuthworker/src/github.com_ceph_ceph_a185a2e2933b21246ce41dd13f03fd6f8f84f03d/qa/tasks/ceph_manager.py", line 1624, in raw_cluster_cmd return self.run_cluster_cmd(**kwargs).stdout.getvalue() File "/home/teuthworker/src/github.com_ceph_ceph_a185a2e2933b21246ce41dd13f03fd6f8f84f03d/qa/tasks/ceph_manager.py", line 1615, in run_cluster_cmd return self.controller.run(**kwargs) File "/home/teuthworker/src/git.ceph.com_teuthology_10753fdddd8d487ef9ffba05c09f1a055cd67877/teuthology/orchestra/remote.py", line 522, in run r = self._runner(client=self.ssh, name=self.shortname, **kwargs) File "/home/teuthworker/src/git.ceph.com_teuthology_10753fdddd8d487ef9ffba05c09f1a055cd67877/teuthology/orchestra/run.py", line 455, in run r.wait() File "/home/teuthworker/src/git.ceph.com_teuthology_10753fdddd8d487ef9ffba05c09f1a055cd67877/teuthology/orchestra/run.py", line 161, in wait self._raise_for_status() File "/home/teuthworker/src/git.ceph.com_teuthology_10753fdddd8d487ef9ffba05c09f1a055cd67877/teuthology/orchestra/run.py", line 181, in _raise_for_status raise CommandFailedError( teuthology.exceptions.CommandFailedError: Command failed on smithi006 with status 124: 'sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 120 ceph --cluster ceph osd dump --format=json' During handling of the above exception, another exception occurred: Traceback (most recent call last): File "/home/teuthworker/src/git.ceph.com_teuthology_10753fdddd8d487ef9ffba05c09f1a055cd67877/teuthology/misc.py", line 1171, in stop_daemons_of_type daemon.stop() File "/home/teuthworker/src/git.ceph.com_teuthology_10753fdddd8d487ef9ffba05c09f1a055cd67877/teuthology/orchestra/daemon/state.py", line 139, in stop run.wait([self.proc], timeout=timeout) File "/home/teuthworker/src/git.ceph.com_teuthology_10753fdddd8d487ef9ffba05c09f1a055cd67877/teuthology/orchestra/run.py", line 479, in wait proc.wait() File "/home/teuthworker/src/git.ceph.com_teuthology_10753fdddd8d487ef9ffba05c09f1a055cd67877/teuthology/orchestra/run.py", line 161, in wait self._raise_for_status() File "/home/teuthworker/src/git.ceph.com_teuthology_10753fdddd8d487ef9ffba05c09f1a055cd67877/teuthology/orchestra/run.py", line 174, in _raise_for_status raise ConnectionLostError(command=self.command, teuthology.exceptions.ConnectionLostError: SSH connection to smithi101 was lost: 'sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage daemon-helper kill ceph-osd -f --cluster ceph -i 1' 2023-08-01T20:01:33.637 DEBUG:tasks.ceph.osd.2:waiting for process to exit 2023-08-01T20:01:33.637 INFO:teuthology.orchestra.run:waiting for 300 2023-08-01T20:01:33.638 INFO:tasks.ceph.osd.2:Stopped 2023-08-01T20:01:33.638 INFO:teuthology.misc:Shutting down mgr daemons... 2023-08-01T20:01:33.639 DEBUG:tasks.ceph.mgr.x:waiting for process to exit 2023-08-01T20:01:33.639 INFO:teuthology.orchestra.run:waiting for 300 2023-08-01T20:01:33.640 INFO:tasks.ceph.mgr.x:Stopped 2023-08-01T20:01:33.640 DEBUG:tasks.ceph.mgr.y:waiting for process to exit 2023-08-01T20:01:33.641 INFO:teuthology.orchestra.run:waiting for 300 2023-08-01T20:01:33.642 DEBUG:teuthology.orchestra.run:got remote process result: 1 2023-08-01T20:01:33.642 ERROR:teuthology.orchestra.daemon.state:Error while waiting for process to exit Traceback (most recent call last): File "/home/teuthworker/src/github.com_ceph_ceph_a185a2e2933b21246ce41dd13f03fd6f8f84f03d/qa/tasks/ceph.py", line 1895, in task yield File "/home/teuthworker/src/git.ceph.com_teuthology_10753fdddd8d487ef9ffba05c09f1a055cd67877/teuthology/run_tasks.py", line 154, in run_tasks suppress = manager.__exit__(*exc_info) File "/usr/lib/python3.8/contextlib.py", line 120, in __exit__ next(self.gen) File "/home/teuthworker/src/github.com_ceph_ceph_a185a2e2933b21246ce41dd13f03fd6f8f84f03d/qa/tasks/thrashosds.py", line 215, in task cluster_manager.wait_for_all_osds_up() File "/home/teuthworker/src/github.com_ceph_ceph_a185a2e2933b21246ce41dd13f03fd6f8f84f03d/qa/tasks/ceph_manager.py", line 2796, in wait_for_all_osds_up while not self.are_all_osds_up(): File "/home/teuthworker/src/github.com_ceph_ceph_a185a2e2933b21246ce41dd13f03fd6f8f84f03d/qa/tasks/ceph_manager.py", line 2786, in are_all_osds_up x = self.get_osd_dump() File "/home/teuthworker/src/github.com_ceph_ceph_a185a2e2933b21246ce41dd13f03fd6f8f84f03d/qa/tasks/ceph_manager.py", line 2549, in get_osd_dump return self.get_osd_dump_json()['osds'] File "/home/teuthworker/src/github.com_ceph_ceph_a185a2e2933b21246ce41dd13f03fd6f8f84f03d/qa/tasks/ceph_manager.py", line 2541, in get_osd_dump_json out = self.raw_cluster_cmd('osd', 'dump', '--format=json') File "/home/teuthworker/src/github.com_ceph_ceph_a185a2e2933b21246ce41dd13f03fd6f8f84f03d/qa/tasks/ceph_manager.py", line 1624, in raw_cluster_cmd return self.run_cluster_cmd(**kwargs).stdout.getvalue() File "/home/teuthworker/src/github.com_ceph_ceph_a185a2e2933b21246ce41dd13f03fd6f8f84f03d/qa/tasks/ceph_manager.py", line 1615, in run_cluster_cmd return self.controller.run(**kwargs) File "/home/teuthworker/src/git.ceph.com_teuthology_10753fdddd8d487ef9ffba05c09f1a055cd67877/teuthology/orchestra/remote.py", line 522, in run r = self._runner(client=self.ssh, name=self.shortname, **kwargs) File "/home/teuthworker/src/git.ceph.com_teuthology_10753fdddd8d487ef9ffba05c09f1a055cd67877/teuthology/orchestra/run.py", line 455, in run r.wait() File "/home/teuthworker/src/git.ceph.com_teuthology_10753fdddd8d487ef9ffba05c09f1a055cd67877/teuthology/orchestra/run.py", line 161, in wait self._raise_for_status() File "/home/teuthworker/src/git.ceph.com_teuthology_10753fdddd8d487ef9ffba05c09f1a055cd67877/teuthology/orchestra/run.py", line 181, in _raise_for_status raise CommandFailedError( teuthology.exceptions.CommandFailedError: Command failed on smithi006 with status 124: 'sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 120 ceph --cluster ceph osd dump --format=json' During handling of the above exception, another exception occurred: Traceback (most recent call last): File "/home/teuthworker/src/github.com_ceph_ceph_a185a2e2933b21246ce41dd13f03fd6f8f84f03d/qa/tasks/ceph.py", line 1438, in run_daemon yield File "/home/teuthworker/src/git.ceph.com_teuthology_10753fdddd8d487ef9ffba05c09f1a055cd67877/teuthology/contextutil.py", line 32, in nested yield vars File "/home/teuthworker/src/github.com_ceph_ceph_a185a2e2933b21246ce41dd13f03fd6f8f84f03d/qa/tasks/ceph.py", line 1899, in task ctx.managers[config['cluster']].stop_pg_num_changes() File "/home/teuthworker/src/github.com_ceph_ceph_a185a2e2933b21246ce41dd13f03fd6f8f84f03d/qa/tasks/ceph_manager.py", line 2307, in stop_pg_num_changes osd_dump = self.get_osd_dump_json() File "/home/teuthworker/src/github.com_ceph_ceph_a185a2e2933b21246ce41dd13f03fd6f8f84f03d/qa/tasks/ceph_manager.py", line 2541, in get_osd_dump_json out = self.raw_cluster_cmd('osd', 'dump', '--format=json') File "/home/teuthworker/src/github.com_ceph_ceph_a185a2e2933b21246ce41dd13f03fd6f8f84f03d/qa/tasks/ceph_manager.py", line 1624, in raw_cluster_cmd return self.run_cluster_cmd(**kwargs).stdout.getvalue() File "/home/teuthworker/src/github.com_ceph_ceph_a185a2e2933b21246ce41dd13f03fd6f8f84f03d/qa/tasks/ceph_manager.py", line 1615, in run_cluster_cmd return self.controller.run(**kwargs) File "/home/teuthworker/src/git.ceph.com_teuthology_10753fdddd8d487ef9ffba05c09f1a055cd67877/teuthology/orchestra/remote.py", line 522, in run r = self._runner(client=self.ssh, name=self.shortname, **kwargs) File "/home/teuthworker/src/git.ceph.com_teuthology_10753fdddd8d487ef9ffba05c09f1a055cd67877/teuthology/orchestra/run.py", line 455, in run r.wait() File "/home/teuthworker/src/git.ceph.com_teuthology_10753fdddd8d487ef9ffba05c09f1a055cd67877/teuthology/orchestra/run.py", line 161, in wait self._raise_for_status() File "/home/teuthworker/src/git.ceph.com_teuthology_10753fdddd8d487ef9ffba05c09f1a055cd67877/teuthology/orchestra/run.py", line 181, in _raise_for_status raise CommandFailedError( teuthology.exceptions.CommandFailedError: Command failed on smithi006 with status 124: 'sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 120 ceph --cluster ceph osd dump --format=json' During handling of the above exception, another exception occurred: Traceback (most recent call last): File "/home/teuthworker/src/github.com_ceph_ceph_a185a2e2933b21246ce41dd13f03fd6f8f84f03d/qa/tasks/ceph.py", line 1438, in run_daemon yield File "/home/teuthworker/src/git.ceph.com_teuthology_10753fdddd8d487ef9ffba05c09f1a055cd67877/teuthology/contextutil.py", line 46, in nested if exit(*exc): File "/usr/lib/python3.8/contextlib.py", line 131, in __exit__ self.gen.throw(type, value, traceback) File "/home/teuthworker/src/github.com_ceph_ceph_a185a2e2933b21246ce41dd13f03fd6f8f84f03d/qa/tasks/ceph.py", line 1440, in run_daemon teuthology.stop_daemons_of_type(ctx, type_, cluster_name) File "/home/teuthworker/src/git.ceph.com_teuthology_10753fdddd8d487ef9ffba05c09f1a055cd67877/teuthology/misc.py", line 1178, in stop_daemons_of_type raise exc File "/home/teuthworker/src/git.ceph.com_teuthology_10753fdddd8d487ef9ffba05c09f1a055cd67877/teuthology/misc.py", line 1171, in stop_daemons_of_type daemon.stop() File "/home/teuthworker/src/git.ceph.com_teuthology_10753fdddd8d487ef9ffba05c09f1a055cd67877/teuthology/orchestra/daemon/state.py", line 139, in stop run.wait([self.proc], timeout=timeout) File "/home/teuthworker/src/git.ceph.com_teuthology_10753fdddd8d487ef9ffba05c09f1a055cd67877/teuthology/orchestra/run.py", line 479, in wait proc.wait() File "/home/teuthworker/src/git.ceph.com_teuthology_10753fdddd8d487ef9ffba05c09f1a055cd67877/teuthology/orchestra/run.py", line 161, in wait self._raise_for_status() File "/home/teuthworker/src/git.ceph.com_teuthology_10753fdddd8d487ef9ffba05c09f1a055cd67877/teuthology/orchestra/run.py", line 174, in _raise_for_status raise ConnectionLostError(command=self.command, teuthology.exceptions.ConnectionLostError: SSH connection to smithi101 was lost: 'sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage daemon-helper kill ceph-osd -f --cluster ceph -i 1' During handling of the above exception, another exception occurred: Traceback (most recent call last): File "/home/teuthworker/src/git.ceph.com_teuthology_10753fdddd8d487ef9ffba05c09f1a055cd67877/teuthology/orchestra/daemon/state.py", line 139, in stop run.wait([self.proc], timeout=timeout) File "/home/teuthworker/src/git.ceph.com_teuthology_10753fdddd8d487ef9ffba05c09f1a055cd67877/teuthology/orchestra/run.py", line 479, in wait proc.wait() File "/home/teuthworker/src/git.ceph.com_teuthology_10753fdddd8d487ef9ffba05c09f1a055cd67877/teuthology/orchestra/run.py", line 161, in wait self._raise_for_status() File "/home/teuthworker/src/git.ceph.com_teuthology_10753fdddd8d487ef9ffba05c09f1a055cd67877/teuthology/orchestra/run.py", line 181, in _raise_for_status raise CommandFailedError( teuthology.exceptions.CommandFailedError: Command failed on smithi006 with status 1: 'sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage daemon-helper kill ceph-mgr -f --cluster ceph -i y' 2023-08-01T20:01:33.643 INFO:tasks.ceph.mgr.y:Stopped 2023-08-01T20:01:33.643 INFO:teuthology.misc:Shutting down mon daemons... 2023-08-01T20:01:33.644 DEBUG:tasks.ceph.mon.a:waiting for process to exit 2023-08-01T20:01:33.644 INFO:teuthology.orchestra.run:waiting for 300 2023-08-01T20:01:33.645 INFO:tasks.ceph.mon.a:Stopped 2023-08-01T20:01:33.645 DEBUG:tasks.ceph.mon.b:waiting for process to exit 2023-08-01T20:01:33.646 INFO:teuthology.orchestra.run:waiting for 300 2023-08-01T20:01:33.646 INFO:tasks.ceph.mon.b:Stopped 2023-08-01T20:01:33.647 DEBUG:tasks.ceph.mon.c:waiting for process to exit 2023-08-01T20:01:33.647 INFO:teuthology.orchestra.run:waiting for 300 2023-08-01T20:01:33.648 INFO:tasks.ceph.mon.c:Stopped 2023-08-01T20:01:33.649 INFO:tasks.ceph:Checking cluster log for badness... 2023-08-01T20:01:33.649 DEBUG:teuthology.orchestra.run.smithi006:> sudo egrep '\[ERR\]|\[WRN\]|\[SEC\]' /var/log/ceph/ceph.log | egrep -v '\(MDS_ALL_DOWN\)' | egrep -v '\(MDS_UP_LESS_THAN_MAX\)' | egrep -v '\(MDS_TRIM\)' | egrep -v '\(MDS_SLOW_REQUEST\)' | egrep -v MDS_SLOW_METADATA_IO | egrep -v 'Behind on trimming' | egrep -v 'overall HEALTH_' | egrep -v '\(OSDMAP_FLAGS\)' | egrep -v '\(OSD_' | egrep -v '\(PG_' | egrep -v '\(POOL_' | egrep -v '\(CACHE_POOL_' | egrep -v '\(SMALLER_PGP_NUM\)' | egrep -v '\(OBJECT_' | egrep -v '\(SLOW_OPS\)' | egrep -v '\(REQUEST_SLOW\)' | egrep -v '\(TOO_FEW_PGS\)' | egrep -v 'slow request' | head -n 1 2023-08-01T20:01:33.692 INFO:tasks.ceph:Unmounting /var/lib/ceph/osd/ceph-0 on ubuntu@smithi008.front.sepia.ceph.com 2023-08-01T20:01:33.692 DEBUG:teuthology.orchestra.run.smithi008:> sync && sudo umount -f /var/lib/ceph/osd/ceph-0 2023-08-01T20:01:33.829 INFO:tasks.ceph:Unmounting /var/lib/ceph/osd/ceph-1 on ubuntu@smithi101.front.sepia.ceph.com 2023-08-01T20:01:33.830 INFO:teuthology.orchestra.remote:Trying to reconnect to host 'ubuntu@smithi101.front.sepia.ceph.com' 2023-08-01T20:01:33.831 DEBUG:teuthology.orchestra.connection:{'hostname': 'smithi101.front.sepia.ceph.com', 'username': 'ubuntu', 'timeout': 60} 2023-08-01T20:01:34.112 DEBUG:teuthology.orchestra.run.smithi101:> true 2023-08-01T20:01:34.431 INFO:teuthology.orchestra.remote:Successfully reconnected to host 'ubuntu@smithi101.front.sepia.ceph.com' 2023-08-01T20:01:34.431 DEBUG:teuthology.orchestra.run.smithi101:> sync && sudo umount -f /var/lib/ceph/osd/ceph-1 2023-08-01T20:01:34.594 INFO:teuthology.orchestra.run.smithi101.stderr:umount: /var/lib/ceph/osd/ceph-1: not mounted. 2023-08-01T20:01:34.595 DEBUG:teuthology.orchestra.run:got remote process result: 32 2023-08-01T20:01:34.596 DEBUG:teuthology.orchestra.run.smithi101:> sudo PATH=/usr/sbin:$PATH lsof ; ps auxf 2023-08-01T20:01:34.703 INFO:teuthology.orchestra.run.smithi101.stdout:COMMAND PID TID TASKCMD USER FD TYPE DEVICE SIZE/OFF NODE NAME 2023-08-01T20:01:34.703 INFO:teuthology.orchestra.run.smithi101.stdout:systemd 1 root cwd DIR 8,1 4096 2 / 2023-08-01T20:01:34.703 INFO:teuthology.orchestra.run.smithi101.stdout:systemd 1 root rtd DIR 8,1 4096 2 / 2023-08-01T20:01:34.703 INFO:teuthology.orchestra.run.smithi101.stdout:systemd 1 root txt REG 8,1 1609592 35683 /usr/lib/systemd/systemd 2023-08-01T20:01:34.703 INFO:teuthology.orchestra.run.smithi101.stdout:systemd 1 root mem REG 8,1 1598840 24700 /usr/lib64/libm-2.28.so 2023-08-01T20:01:34.704 INFO:teuthology.orchestra.run.smithi101.stdout:systemd 1 root mem REG 8,1 658136 26787 /usr/lib64/libudev.so.1.6.11 2023-08-01T20:01:34.704 INFO:teuthology.orchestra.run.smithi101.stdout:systemd 1 root mem REG 8,1 735192 24831 /usr/lib64/libsepol.so.1 2023-08-01T20:01:34.704 INFO:teuthology.orchestra.run.smithi101.stdout:systemd 1 root mem REG 8,1 1805368 25103 /usr/lib64/libunistring.so.2.1.0 2023-08-01T20:01:34.704 INFO:teuthology.orchestra.run.smithi101.stdout:systemd 1 root mem REG 8,1 145984 24905 /usr/lib64/libgpg-error.so.0.24.2 2023-08-01T20:01:34.704 INFO:teuthology.orchestra.run.smithi101.stdout:systemd 1 root mem REG 8,1 66920 24972 /usr/lib64/libjson-c.so.4.0.0 2023-08-01T20:01:34.704 INFO:teuthology.orchestra.run.smithi101.stdout:systemd 1 root mem REG 8,1 371232 26853 /usr/lib64/libdevmapper.so.1.02 2023-08-01T20:01:34.704 INFO:teuthology.orchestra.run.smithi101.stdout:systemd 1 root mem REG 8,1 26704 24976 /usr/lib64/libattr.so.1.1.2448 2023-08-01T20:01:34.705 INFO:teuthology.orchestra.run.smithi101.stdout:systemd 1 root mem REG 8,1 3083608 26861 /usr/lib64/libcrypto.so.1.1.1k 2023-08-01T20:01:34.705 INFO:teuthology.orchestra.run.smithi101.stdout:systemd 1 root mem REG 8,1 615744 26862 /usr/lib64/libssl.so.1.1.1k 2023-08-01T20:01:34.705 INFO:teuthology.orchestra.run.smithi101.stdout:systemd 1 root mem REG 8,1 99640 24762 /usr/lib64/libz.so.1.2.11 2023-08-01T20:01:34.705 INFO:teuthology.orchestra.run.smithi101.stdout:systemd 1 root mem REG 8,1 24928 25065 /usr/lib64/libcap-ng.so.0.0.0 2023-08-01T20:01:34.705 INFO:teuthology.orchestra.run.smithi101.stdout:systemd 1 root mem REG 8,1 33480 19526 /usr/lib64/libuuid.so.1.3.0 2023-08-01T20:01:34.705 INFO:teuthology.orchestra.run.smithi101.stdout:systemd 1 root mem REG 8,1 19128 24699 /usr/lib64/libdl-2.28.so 2023-08-01T20:01:34.705 INFO:teuthology.orchestra.run.smithi101.stdout:systemd 1 root mem REG 8,1 543304 24651 /usr/lib64/libpcre2-8.so.0.7.1 2023-08-01T20:01:34.705 INFO:teuthology.orchestra.run.smithi101.stdout:systemd 1 root mem REG 8,1 343680 19531 /usr/lib64/libblkid.so.1.1.0 2023-08-01T20:01:34.706 INFO:teuthology.orchestra.run.smithi101.stdout:systemd 1 root mem REG 8,1 119760 25264 /usr/lib64/liblz4.so.1.8.3 2023-08-01T20:01:34.706 INFO:teuthology.orchestra.run.smithi101.stdout:systemd 1 root mem REG 8,1 162192 24774 /usr/lib64/liblzma.so.5.2.4 2023-08-01T20:01:34.706 INFO:teuthology.orchestra.run.smithi101.stdout:systemd 1 root mem REG 8,1 165624 25105 /usr/lib64/libidn2.so.0.3.6 2023-08-01T20:01:34.706 INFO:teuthology.orchestra.run.smithi101.stdout:systemd 1 root mem REG 8,1 1187312 25078 /usr/lib64/libgcrypt.so.20.2.5 2023-08-01T20:01:34.706 INFO:teuthology.orchestra.run.smithi101.stdout:systemd 1 root mem REG 8,1 526384 26885 /usr/lib64/libcryptsetup.so.12.6.0 2023-08-01T20:01:34.706 INFO:teuthology.orchestra.run.smithi101.stdout:systemd 1 root mem REG 8,1 59272 24978 /usr/lib64/libacl.so.1.1.2253 2023-08-01T20:01:34.706 INFO:teuthology.orchestra.run.smithi101.stdout:systemd 1 root mem REG 8,1 33752 24776 /usr/lib64/libcap.so.2.48 2023-08-01T20:01:34.706 INFO:teuthology.orchestra.run.smithi101.stdout:systemd 1 root mem REG 8,1 2089984 24698 /usr/lib64/libc-2.28.so 2023-08-01T20:01:34.707 INFO:teuthology.orchestra.run.smithi101.stdout:systemd 1 root mem REG 8,1 149984 24708 /usr/lib64/libpthread-2.28.so 2023-08-01T20:01:34.707 INFO:teuthology.orchestra.run.smithi101.stdout:systemd 1 root mem REG 8,1 99672 31445 /usr/lib64/libgcc_s-8-20210514.so.1 2023-08-01T20:01:34.707 INFO:teuthology.orchestra.run.smithi101.stdout:systemd 1 root mem REG 8,1 100200 26883 /usr/lib64/libkmod.so.2.3.3 2023-08-01T20:01:34.707 INFO:teuthology.orchestra.run.smithi101.stdout:systemd 1 root mem REG 8,1 135784 24768 /usr/lib64/libaudit.so.1.0.0 2023-08-01T20:01:34.707 INFO:teuthology.orchestra.run.smithi101.stdout:systemd 1 root mem REG 8,1 66504 27020 /usr/lib64/libpam.so.0.84.2 2023-08-01T20:01:34.707 INFO:teuthology.orchestra.run.smithi101.stdout:systemd 1 root mem REG 8,1 371480 19864 /usr/lib64/libmount.so.1.1.0 2023-08-01T20:01:34.707 INFO:teuthology.orchestra.run.smithi101.stdout:systemd 1 root mem REG 8,1 172104 24654 /usr/lib64/libselinux.so.1 2023-08-01T20:01:34.707 INFO:teuthology.orchestra.run.smithi101.stdout:systemd 1 root mem REG 8,1 128792 25521 /usr/lib64/libseccomp.so.2.5.2 2023-08-01T20:01:34.708 INFO:teuthology.orchestra.run.smithi101.stdout:systemd 1 root mem REG 8,1 42744 24710 /usr/lib64/librt-2.28.so 2023-08-01T20:01:34.708 INFO:teuthology.orchestra.run.smithi101.stdout:systemd 1 root mem REG 8,1 2761368 35660 /usr/lib/systemd/libsystemd-shared-239.so 2023-08-01T20:01:34.708 INFO:teuthology.orchestra.run.smithi101.stdout:systemd 1 root mem REG 8,1 1062168 24653 /usr/lib64/ld-2.28.so 2023-08-01T20:01:34.708 INFO:teuthology.orchestra.run.smithi101.stdout:systemd 1 root mem REG 8,1 579864 16755 /etc/selinux/targeted/contexts/files/file_contexts.bin 2023-08-01T20:01:34.708 INFO:teuthology.orchestra.run.smithi101.stdout:systemd 1 root mem REG 8,1 19983 16806 /etc/selinux/targeted/contexts/files/file_contexts.homedirs.bin 2023-08-01T20:01:34.708 INFO:teuthology.orchestra.run.smithi101.stdout:systemd 1 root 0u CHR 1,3 0t0 3083 /dev/null 2023-08-01T20:01:34.708 INFO:teuthology.orchestra.run.smithi101.stdout:systemd 1 root 1u CHR 1,3 0t0 3083 /dev/null 2023-08-01T20:01:34.709 INFO:teuthology.orchestra.run.smithi101.stdout:systemd 1 root 2u CHR 1,3 0t0 3083 /dev/null 2023-08-01T20:01:34.709 INFO:teuthology.orchestra.run.smithi101.stdout:systemd 1 root 3w CHR 1,11 0t0 3089 /dev/kmsg 2023-08-01T20:01:34.709 INFO:teuthology.orchestra.run.smithi101.stdout:systemd 1 root 4u a_inode 0,14 0 15587 [eventpoll] 2023-08-01T20:01:34.709 INFO:teuthology.orchestra.run.smithi101.stdout:systemd 1 root 5u a_inode 0,14 0 15587 [signalfd] 2023-08-01T20:01:34.709 INFO:teuthology.orchestra.run.smithi101.stdout:systemd 1 root 6r DIR 0,26 0 1 /sys/fs/cgroup/systemd 2023-08-01T20:01:34.709 INFO:teuthology.orchestra.run.smithi101.stdout:systemd 1 root 7u a_inode 0,14 0 15587 [timerfd] 2023-08-01T20:01:34.709 INFO:teuthology.orchestra.run.smithi101.stdout:systemd 1 root 8u netlink 0t0 20483 KOBJECT_UEVENT 2023-08-01T20:01:34.709 INFO:teuthology.orchestra.run.smithi101.stdout:systemd 1 root 9u a_inode 0,14 0 15587 [eventpoll] 2023-08-01T20:01:34.710 INFO:teuthology.orchestra.run.smithi101.stdout:systemd 1 root 10r a_inode 0,14 0 15587 inotify 2023-08-01T20:01:34.710 INFO:teuthology.orchestra.run.smithi101.stdout:systemd 1 root 11u netlink 0t0 20489 AUDIT 2023-08-01T20:01:34.710 INFO:teuthology.orchestra.run.smithi101.stdout:systemd 1 root 12r REG 0,5 0 41 /proc/1/mountinfo 2023-08-01T20:01:34.710 INFO:teuthology.orchestra.run.smithi101.stdout:systemd 1 root 13r a_inode 0,14 0 15587 inotify 2023-08-01T20:01:34.710 INFO:teuthology.orchestra.run.smithi101.stdout:systemd 1 root 14r REG 0,5 0 4026532074 /proc/swaps 2023-08-01T20:01:34.710 INFO:teuthology.orchestra.run.smithi101.stdout:systemd 1 root 15u unix 0xffff937080484c80 0t0 20484 /run/systemd/private type=STREAM 2023-08-01T20:01:34.710 INFO:teuthology.orchestra.run.smithi101.stdout:systemd 1 root 16r a_inode 0,14 0 15587 inotify 2023-08-01T20:01:34.710 INFO:teuthology.orchestra.run.smithi101.stdout:systemd 1 root 17u a_inode 0,14 0 15587 [timerfd] 2023-08-01T20:01:34.711 INFO:teuthology.orchestra.run.smithi101.stdout:systemd 1 root 22u unix 0xffff93750c982880 0t0 45060 /run/systemd/journal/stdout type=STREAM 2023-08-01T20:01:34.711 INFO:teuthology.orchestra.run.smithi101.stdout:systemd 1 root 23u unix 0xffff937080486300 0t0 20496 /run/rpcbind.sock type=STREAM 2023-08-01T20:01:34.711 INFO:teuthology.orchestra.run.smithi101.stdout:systemd 1 root 24u unix 0xffff93750c984c80 0t0 43 /run/systemd/notify type=DGRAM 2023-08-01T20:01:34.711 INFO:teuthology.orchestra.run.smithi101.stdout:systemd 1 root 25u unix 0xffff93750c985e80 0t0 45 /run/systemd/cgroups-agent type=DGRAM 2023-08-01T20:01:34.711 INFO:teuthology.orchestra.run.smithi101.stdout:systemd 1 root 26u unix 0xffff93750c986300 0t0 47 type=DGRAM 2023-08-01T20:01:34.711 INFO:teuthology.orchestra.run.smithi101.stdout:systemd 1 root 27u unix 0xffff93750c982400 0t0 48 type=DGRAM 2023-08-01T20:01:34.711 INFO:teuthology.orchestra.run.smithi101.stdout:systemd 1 root 28u IPv4 20498 0t0 TCP *:sunrpc (LISTEN) 2023-08-01T20:01:34.712 INFO:teuthology.orchestra.run.smithi101.stdout:systemd 1 root 29u IPv4 20499 0t0 UDP *:sunrpc 2023-08-01T20:01:34.712 INFO:teuthology.orchestra.run.smithi101.stdout:systemd 1 root 30u IPv6 20500 0t0 TCP *:sunrpc (LISTEN) 2023-08-01T20:01:34.712 INFO:teuthology.orchestra.run.smithi101.stdout:systemd 1 root 31u IPv6 20501 0t0 UDP *:sunrpc 2023-08-01T20:01:34.712 INFO:teuthology.orchestra.run.smithi101.stdout:systemd 1 root 32u unix 0xffff93750c984800 0t0 56 /run/systemd/journal/dev-log type=DGRAM 2023-08-01T20:01:34.712 INFO:teuthology.orchestra.run.smithi101.stdout:systemd 1 root 33u unix 0xffff93750c992d00 0t0 5504 /run/systemd/journal/stdout type=STREAM 2023-08-01T20:01:34.712 INFO:teuthology.orchestra.run.smithi101.stdout:systemd 1 root 34u unix 0xffff93750c995100 0t0 5507 /run/systemd/journal/socket type=DGRAM 2023-08-01T20:01:34.712 INFO:teuthology.orchestra.run.smithi101.stdout:systemd 1 root 35r a_inode 0,14 0 15587 inotify 2023-08-01T20:01:34.712 INFO:teuthology.orchestra.run.smithi101.stdout:systemd 1 root 36u unix 0xffff937080482400 0t0 20502 /run/udev/control type=SEQPACKET 2023-08-01T20:01:34.713 INFO:teuthology.orchestra.run.smithi101.stdout:systemd 1 root 37u FIFO 0,24 0t0 20505 /run/dmeventd-server 2023-08-01T20:01:34.713 INFO:teuthology.orchestra.run.smithi101.stdout:systemd 1 root 38u FIFO 0,24 0t0 20506 /run/dmeventd-client 2023-08-01T20:01:34.713 INFO:teuthology.orchestra.run.smithi101.stdout:systemd 1 root 39u unix 0xffff937080481b00 0t0 20507 /run/lvm/lvmpolld.socket type=STREAM 2023-08-01T20:01:34.713 INFO:teuthology.orchestra.run.smithi101.stdout:systemd 1 root 40u netlink 0t0 20514 KOBJECT_UEVENT 2023-08-01T20:01:34.713 INFO:teuthology.orchestra.run.smithi101.stdout:systemd 1 root 41r CHR 10,235 0t0 3187 /dev/autofs 2023-08-01T20:01:34.713 INFO:teuthology.orchestra.run.smithi101.stdout:systemd 1 root 42r FIFO 0,13 0t0 20519 pipe 2023-08-01T20:01:34.713 INFO:teuthology.orchestra.run.smithi101.stdout:systemd 1 root 43u FIFO 0,24 0t0 20546 /run/initctl 2023-08-01T20:01:34.713 INFO:teuthology.orchestra.run.smithi101.stdout:systemd 1 root 44u unix 0xffff937080484800 0t0 20551 /run/systemd/coredump type=SEQPACKET 2023-08-01T20:01:34.714 INFO:teuthology.orchestra.run.smithi101.stdout:systemd 1 root 45u unix 0xffff937080486c00 0t0 20554 type=DGRAM 2023-08-01T20:01:34.714 INFO:teuthology.orchestra.run.smithi101.stdout:systemd 1 root 46u unix 0xffff937080483a80 0t0 659 /run/systemd/journal/stdout type=STREAM 2023-08-01T20:01:34.714 INFO:teuthology.orchestra.run.smithi101.stdout:systemd 1 root 47u unix 0xffff93750c921f80 0t0 18154 /run/systemd/journal/stdout type=STREAM 2023-08-01T20:01:34.714 INFO:teuthology.orchestra.run.smithi101.stdout:systemd 1 root 48u unix 0xffff93750c955580 0t0 4972 /var/run/.heim_org.h5l.kcm-socket type=STREAM 2023-08-01T20:01:34.714 INFO:teuthology.orchestra.run.smithi101.stdout:systemd 1 root 49u a_inode 0,14 0 15587 [timerfd] 2023-08-01T20:01:34.714 INFO:teuthology.orchestra.run.smithi101.stdout:systemd 1 root 50u unix 0xffff93750c950480 0t0 4974 /run/dbus/system_bus_socket type=STREAM 2023-08-01T20:01:34.714 INFO:teuthology.orchestra.run.smithi101.stdout:systemd 1 root 51u unix 0xffff9370586cec00 0t0 30877 type=STREAM 2023-08-01T20:01:34.715 INFO:teuthology.orchestra.run.smithi101.stdout:systemd 1 root 52u unix 0xffff937080485580 0t0 4988 /run/systemd/journal/stdout type=STREAM 2023-08-01T20:01:34.715 INFO:teuthology.orchestra.run.smithi101.stdout:systemd 1 root 53u unix 0xffff9370586cd580 0t0 28977 /run/systemd/journal/stdout type=STREAM 2023-08-01T20:01:34.715 INFO:teuthology.orchestra.run.smithi101.stdout:systemd 1 root 54u netlink 0t0 1816 SELINUX 2023-08-01T20:01:34.715 INFO:teuthology.orchestra.run.smithi101.stdout:systemd 1 root 55u unix 0xffff93750c992400 0t0 19978 /run/systemd/journal/stdout type=STREAM 2023-08-01T20:01:34.715 INFO:teuthology.orchestra.run.smithi101.stdout:systemd 1 root 56u unix 0xffff93750c981b00 0t0 19980 /run/systemd/journal/stdout type=STREAM 2023-08-01T20:01:34.715 INFO:teuthology.orchestra.run.smithi101.stdout:systemd 1 root 57u unix 0xffff93750d2bde80 0t0 22615 /run/systemd/journal/stdout type=STREAM 2023-08-01T20:01:34.715 INFO:teuthology.orchestra.run.smithi101.stdout:systemd 1 root 58u unix 0xffff93750d2be780 0t0 19982 /run/systemd/journal/stdout type=STREAM 2023-08-01T20:01:34.715 INFO:teuthology.orchestra.run.smithi101.stdout:systemd 1 root 59u unix 0xffff93750c985100 0t0 22619 /run/systemd/journal/stdout type=STREAM 2023-08-01T20:01:34.716 INFO:teuthology.orchestra.run.smithi101.stdout:systemd 1 root 63u unix 0xffff9370586cd100 0t0 29095 /run/systemd/journal/stdout type=STREAM 2023-08-01T20:01:34.716 INFO:teuthology.orchestra.run.smithi101.stdout:systemd 1 root 64u unix 0xffff9370586cf080 0t0 29096 /run/systemd/journal/stdout type=STREAM 2023-08-01T20:01:34.716 INFO:teuthology.orchestra.run.smithi101.stdout:systemd 1 root 66u unix 0xffff9370586ce300 0t0 4982 /run/systemd/journal/stdout type=STREAM 2023-08-01T20:01:34.716 INFO:teuthology.orchestra.run.smithi101.stdout:systemd 1 root 67u unix 0xffff93750c987080 0t0 4984 /run/systemd/journal/stdout type=STREAM 2023-08-01T20:01:34.716 INFO:teuthology.orchestra.run.smithi101.stdout:systemd 1 root 68u unix 0xffff93750c994380 0t0 4986 /run/systemd/journal/stdout type=STREAM 2023-08-01T20:01:34.716 INFO:teuthology.orchestra.run.smithi101.stdout:systemd 1 root 72u unix 0xffff93750c990000 0t0 31757 /run/systemd/journal/stdout type=STREAM 2023-08-01T20:01:34.716 INFO:teuthology.orchestra.run.smithi101.stdout:kthreadd 2 root cwd DIR 8,1 4096 2 / 2023-08-01T20:01:34.716 INFO:teuthology.orchestra.run.smithi101.stdout:kthreadd 2 root rtd DIR 8,1 4096 2 / 2023-08-01T20:01:34.717 INFO:teuthology.orchestra.run.smithi101.stdout:kthreadd 2 root txt unknown /proc/2/exe 2023-08-01T20:01:34.717 INFO:teuthology.orchestra.run.smithi101.stdout:rcu_gp 3 root cwd DIR 8,1 4096 2 / 2023-08-01T20:01:34.717 INFO:teuthology.orchestra.run.smithi101.stdout:rcu_gp 3 root rtd DIR 8,1 4096 2 / 2023-08-01T20:01:34.717 INFO:teuthology.orchestra.run.smithi101.stdout:rcu_gp 3 root txt unknown /proc/3/exe 2023-08-01T20:01:34.717 INFO:teuthology.orchestra.run.smithi101.stdout:rcu_par_g 4 root cwd DIR 8,1 4096 2 / 2023-08-01T20:01:34.717 INFO:teuthology.orchestra.run.smithi101.stdout:rcu_par_g 4 root rtd DIR 8,1 4096 2 / 2023-08-01T20:01:34.717 INFO:teuthology.orchestra.run.smithi101.stdout:rcu_par_g 4 root txt unknown /proc/4/exe 2023-08-01T20:01:34.717 INFO:teuthology.orchestra.run.smithi101.stdout:slub_flus 5 root cwd DIR 8,1 4096 2 / 2023-08-01T20:01:34.718 INFO:teuthology.orchestra.run.smithi101.stdout:slub_flus 5 root rtd DIR 8,1 4096 2 / 2023-08-01T20:01:34.718 INFO:teuthology.orchestra.run.smithi101.stdout:slub_flus 5 root txt unknown /proc/5/exe 2023-08-01T20:01:34.718 INFO:teuthology.orchestra.run.smithi101.stdout:kworker/0 6 root cwd DIR 8,1 4096 2 / 2023-08-01T20:01:34.718 INFO:teuthology.orchestra.run.smithi101.stdout:kworker/0 6 root rtd DIR 8,1 4096 2 / 2023-08-01T20:01:34.718 INFO:teuthology.orchestra.run.smithi101.stdout:kworker/0 6 root txt unknown /proc/6/exe 2023-08-01T20:01:34.718 INFO:teuthology.orchestra.run.smithi101.stdout:kworker/0 7 root cwd DIR 8,1 4096 2 / 2023-08-01T20:01:34.718 INFO:teuthology.orchestra.run.smithi101.stdout:kworker/0 7 root rtd DIR 8,1 4096 2 / 2023-08-01T20:01:34.718 INFO:teuthology.orchestra.run.smithi101.stdout:kworker/0 7 root txt unknown /proc/7/exe 2023-08-01T20:01:34.719 INFO:teuthology.orchestra.run.smithi101.stdout:kworker/0 8 root cwd DIR 8,1 4096 2 / 2023-08-01T20:01:34.719 INFO:teuthology.orchestra.run.smithi101.stdout:kworker/0 8 root rtd DIR 8,1 4096 2 / 2023-08-01T20:01:34.719 INFO:teuthology.orchestra.run.smithi101.stdout:kworker/0 8 root txt unknown /proc/8/exe 2023-08-01T20:01:34.719 INFO:teuthology.orchestra.run.smithi101.stdout:kworker/u 9 root cwd DIR 8,1 4096 2 / 2023-08-01T20:01:34.719 INFO:teuthology.orchestra.run.smithi101.stdout:kworker/u 9 root rtd DIR 8,1 4096 2 / 2023-08-01T20:01:34.719 INFO:teuthology.orchestra.run.smithi101.stdout:kworker/u 9 root txt unknown /proc/9/exe 2023-08-01T20:01:34.720 INFO:teuthology.orchestra.run.smithi101.stdout:mm_percpu 10 root cwd DIR 8,1 4096 2 / 2023-08-01T20:01:34.720 INFO:teuthology.orchestra.run.smithi101.stdout:mm_percpu 10 root rtd DIR 8,1 4096 2 / 2023-08-01T20:01:34.720 INFO:teuthology.orchestra.run.smithi101.stdout:mm_percpu 10 root txt unknown /proc/10/exe 2023-08-01T20:01:34.720 INFO:teuthology.orchestra.run.smithi101.stdout:rcu_tasks 11 root cwd DIR 8,1 4096 2 / 2023-08-01T20:01:34.720 INFO:teuthology.orchestra.run.smithi101.stdout:rcu_tasks 11 root rtd DIR 8,1 4096 2 / 2023-08-01T20:01:34.720 INFO:teuthology.orchestra.run.smithi101.stdout:rcu_tasks 11 root txt unknown /proc/11/exe 2023-08-01T20:01:34.720 INFO:teuthology.orchestra.run.smithi101.stdout:rcu_tasks 12 root cwd DIR 8,1 4096 2 / 2023-08-01T20:01:34.720 INFO:teuthology.orchestra.run.smithi101.stdout:rcu_tasks 12 root rtd DIR 8,1 4096 2 / 2023-08-01T20:01:34.721 INFO:teuthology.orchestra.run.smithi101.stdout:rcu_tasks 12 root txt unknown /proc/12/exe 2023-08-01T20:01:34.721 INFO:teuthology.orchestra.run.smithi101.stdout:ksoftirqd 13 root cwd DIR 8,1 4096 2 / 2023-08-01T20:01:34.721 INFO:teuthology.orchestra.run.smithi101.stdout:ksoftirqd 13 root rtd DIR 8,1 4096 2 / 2023-08-01T20:01:34.721 INFO:teuthology.orchestra.run.smithi101.stdout:ksoftirqd 13 root txt unknown /proc/13/exe 2023-08-01T20:01:34.721 INFO:teuthology.orchestra.run.smithi101.stdout:rcu_sched 14 root cwd DIR 8,1 4096 2 / 2023-08-01T20:01:34.721 INFO:teuthology.orchestra.run.smithi101.stdout:rcu_sched 14 root rtd DIR 8,1 4096 2 / 2023-08-01T20:01:34.721 INFO:teuthology.orchestra.run.smithi101.stdout:rcu_sched 14 root txt unknown /proc/14/exe 2023-08-01T20:01:34.722 INFO:teuthology.orchestra.run.smithi101.stdout:migration 15 root cwd DIR 8,1 4096 2 / 2023-08-01T20:01:34.722 INFO:teuthology.orchestra.run.smithi101.stdout:migration 15 root rtd DIR 8,1 4096 2 / 2023-08-01T20:01:34.722 INFO:teuthology.orchestra.run.smithi101.stdout:migration 15 root txt unknown /proc/15/exe 2023-08-01T20:01:34.722 INFO:teuthology.orchestra.run.smithi101.stdout:watchdog/ 16 root cwd DIR 8,1 4096 2 / 2023-08-01T20:01:34.722 INFO:teuthology.orchestra.run.smithi101.stdout:watchdog/ 16 root rtd DIR 8,1 4096 2 / 2023-08-01T20:01:34.722 INFO:teuthology.orchestra.run.smithi101.stdout:watchdog/ 16 root txt unknown /proc/16/exe 2023-08-01T20:01:34.722 INFO:teuthology.orchestra.run.smithi101.stdout:cpuhp/0 17 root cwd DIR 8,1 4096 2 / 2023-08-01T20:01:34.722 INFO:teuthology.orchestra.run.smithi101.stdout:cpuhp/0 17 root rtd DIR 8,1 4096 2 / 2023-08-01T20:01:34.723 INFO:teuthology.orchestra.run.smithi101.stdout:cpuhp/0 17 root txt unknown /proc/17/exe 2023-08-01T20:01:34.723 INFO:teuthology.orchestra.run.smithi101.stdout:cpuhp/1 18 root cwd DIR 8,1 4096 2 / 2023-08-01T20:01:34.723 INFO:teuthology.orchestra.run.smithi101.stdout:cpuhp/1 18 root rtd DIR 8,1 4096 2 / 2023-08-01T20:01:34.723 INFO:teuthology.orchestra.run.smithi101.stdout:cpuhp/1 18 root txt unknown /proc/18/exe 2023-08-01T20:01:34.723 INFO:teuthology.orchestra.run.smithi101.stdout:watchdog/ 19 root cwd DIR 8,1 4096 2 / 2023-08-01T20:01:34.723 INFO:teuthology.orchestra.run.smithi101.stdout:watchdog/ 19 root rtd DIR 8,1 4096 2 / 2023-08-01T20:01:34.723 INFO:teuthology.orchestra.run.smithi101.stdout:watchdog/ 19 root txt unknown /proc/19/exe 2023-08-01T20:01:34.723 INFO:teuthology.orchestra.run.smithi101.stdout:migration 20 root cwd DIR 8,1 4096 2 / 2023-08-01T20:01:34.724 INFO:teuthology.orchestra.run.smithi101.stdout:migration 20 root rtd DIR 8,1 4096 2 / 2023-08-01T20:01:34.724 INFO:teuthology.orchestra.run.smithi101.stdout:migration 20 root txt unknown /proc/20/exe 2023-08-01T20:01:34.724 INFO:teuthology.orchestra.run.smithi101.stdout:ksoftirqd 21 root cwd DIR 8,1 4096 2 / 2023-08-01T20:01:34.724 INFO:teuthology.orchestra.run.smithi101.stdout:ksoftirqd 21 root rtd DIR 8,1 4096 2 / 2023-08-01T20:01:34.724 INFO:teuthology.orchestra.run.smithi101.stdout:ksoftirqd 21 root txt unknown /proc/21/exe 2023-08-01T20:01:34.724 INFO:teuthology.orchestra.run.smithi101.stdout:kworker/1 22 root cwd DIR 8,1 4096 2 / 2023-08-01T20:01:34.724 INFO:teuthology.orchestra.run.smithi101.stdout:kworker/1 22 root rtd DIR 8,1 4096 2 / 2023-08-01T20:01:34.725 INFO:teuthology.orchestra.run.smithi101.stdout:kworker/1 22 root txt unknown /proc/22/exe 2023-08-01T20:01:34.725 INFO:teuthology.orchestra.run.smithi101.stdout:kworker/1 23 root cwd DIR 8,1 4096 2 / 2023-08-01T20:01:34.725 INFO:teuthology.orchestra.run.smithi101.stdout:kworker/1 23 root rtd DIR 8,1 4096 2 / 2023-08-01T20:01:34.725 INFO:teuthology.orchestra.run.smithi101.stdout:kworker/1 23 root txt unknown /proc/23/exe 2023-08-01T20:01:34.725 INFO:teuthology.orchestra.run.smithi101.stdout:cpuhp/2 24 root cwd DIR 8,1 4096 2 / 2023-08-01T20:01:34.725 INFO:teuthology.orchestra.run.smithi101.stdout:cpuhp/2 24 root rtd DIR 8,1 4096 2 / 2023-08-01T20:01:34.725 INFO:teuthology.orchestra.run.smithi101.stdout:cpuhp/2 24 root txt unknown /proc/24/exe 2023-08-01T20:01:34.725 INFO:teuthology.orchestra.run.smithi101.stdout:watchdog/ 25 root cwd DIR 8,1 4096 2 / 2023-08-01T20:01:34.726 INFO:teuthology.orchestra.run.smithi101.stdout:watchdog/ 25 root rtd DIR 8,1 4096 2 / 2023-08-01T20:01:34.726 INFO:teuthology.orchestra.run.smithi101.stdout:watchdog/ 25 root txt unknown /proc/25/exe 2023-08-01T20:01:34.726 INFO:teuthology.orchestra.run.smithi101.stdout:migration 26 root cwd DIR 8,1 4096 2 / 2023-08-01T20:01:34.726 INFO:teuthology.orchestra.run.smithi101.stdout:migration 26 root rtd DIR 8,1 4096 2 / 2023-08-01T20:01:34.726 INFO:teuthology.orchestra.run.smithi101.stdout:migration 26 root txt unknown /proc/26/exe 2023-08-01T20:01:34.726 INFO:teuthology.orchestra.run.smithi101.stdout:ksoftirqd 27 root cwd DIR 8,1 4096 2 / 2023-08-01T20:01:34.726 INFO:teuthology.orchestra.run.smithi101.stdout:ksoftirqd 27 root rtd DIR 8,1 4096 2 / 2023-08-01T20:01:34.726 INFO:teuthology.orchestra.run.smithi101.stdout:ksoftirqd 27 root txt unknown /proc/27/exe 2023-08-01T20:01:34.727 INFO:teuthology.orchestra.run.smithi101.stdout:kworker/2 28 root cwd DIR 8,1 4096 2 / 2023-08-01T20:01:34.727 INFO:teuthology.orchestra.run.smithi101.stdout:kworker/2 28 root rtd DIR 8,1 4096 2 / 2023-08-01T20:01:34.727 INFO:teuthology.orchestra.run.smithi101.stdout:kworker/2 28 root txt unknown /proc/28/exe 2023-08-01T20:01:34.727 INFO:teuthology.orchestra.run.smithi101.stdout:kworker/2 29 root cwd DIR 8,1 4096 2 / 2023-08-01T20:01:34.727 INFO:teuthology.orchestra.run.smithi101.stdout:kworker/2 29 root rtd DIR 8,1 4096 2 / 2023-08-01T20:01:34.727 INFO:teuthology.orchestra.run.smithi101.stdout:kworker/2 29 root txt unknown /proc/29/exe 2023-08-01T20:01:34.727 INFO:teuthology.orchestra.run.smithi101.stdout:cpuhp/3 30 root cwd DIR 8,1 4096 2 / 2023-08-01T20:01:34.727 INFO:teuthology.orchestra.run.smithi101.stdout:cpuhp/3 30 root rtd DIR 8,1 4096 2 / 2023-08-01T20:01:34.728 INFO:teuthology.orchestra.run.smithi101.stdout:cpuhp/3 30 root txt unknown /proc/30/exe 2023-08-01T20:01:34.728 INFO:teuthology.orchestra.run.smithi101.stdout:watchdog/ 31 root cwd DIR 8,1 4096 2 / 2023-08-01T20:01:34.728 INFO:teuthology.orchestra.run.smithi101.stdout:watchdog/ 31 root rtd DIR 8,1 4096 2 / 2023-08-01T20:01:34.728 INFO:teuthology.orchestra.run.smithi101.stdout:watchdog/ 31 root txt unknown /proc/31/exe 2023-08-01T20:01:34.728 INFO:teuthology.orchestra.run.smithi101.stdout:migration 32 root cwd DIR 8,1 4096 2 / 2023-08-01T20:01:34.728 INFO:teuthology.orchestra.run.smithi101.stdout:migration 32 root rtd DIR 8,1 4096 2 / 2023-08-01T20:01:34.728 INFO:teuthology.orchestra.run.smithi101.stdout:migration 32 root txt unknown /proc/32/exe 2023-08-01T20:01:34.728 INFO:teuthology.orchestra.run.smithi101.stdout:ksoftirqd 33 root cwd DIR 8,1 4096 2 / 2023-08-01T20:01:34.729 INFO:teuthology.orchestra.run.smithi101.stdout:ksoftirqd 33 root rtd DIR 8,1 4096 2 / 2023-08-01T20:01:34.729 INFO:teuthology.orchestra.run.smithi101.stdout:ksoftirqd 33 root txt unknown /proc/33/exe 2023-08-01T20:01:34.729 INFO:teuthology.orchestra.run.smithi101.stdout:kworker/3 34 root cwd DIR 8,1 4096 2 / 2023-08-01T20:01:34.729 INFO:teuthology.orchestra.run.smithi101.stdout:kworker/3 34 root rtd DIR 8,1 4096 2 / 2023-08-01T20:01:34.729 INFO:teuthology.orchestra.run.smithi101.stdout:kworker/3 34 root txt unknown /proc/34/exe 2023-08-01T20:01:34.729 INFO:teuthology.orchestra.run.smithi101.stdout:kworker/3 35 root cwd DIR 8,1 4096 2 / 2023-08-01T20:01:34.729 INFO:teuthology.orchestra.run.smithi101.stdout:kworker/3 35 root rtd DIR 8,1 4096 2 / 2023-08-01T20:01:34.729 INFO:teuthology.orchestra.run.smithi101.stdout:kworker/3 35 root txt unknown /proc/35/exe 2023-08-01T20:01:34.730 INFO:teuthology.orchestra.run.smithi101.stdout:cpuhp/4 36 root cwd DIR 8,1 4096 2 / 2023-08-01T20:01:34.730 INFO:teuthology.orchestra.run.smithi101.stdout:cpuhp/4 36 root rtd DIR 8,1 4096 2 / 2023-08-01T20:01:34.730 INFO:teuthology.orchestra.run.smithi101.stdout:cpuhp/4 36 root txt unknown /proc/36/exe 2023-08-01T20:01:34.730 INFO:teuthology.orchestra.run.smithi101.stdout:watchdog/ 37 root cwd DIR 8,1 4096 2 / 2023-08-01T20:01:34.730 INFO:teuthology.orchestra.run.smithi101.stdout:watchdog/ 37 root rtd DIR 8,1 4096 2 / 2023-08-01T20:01:34.730 INFO:teuthology.orchestra.run.smithi101.stdout:watchdog/ 37 root txt unknown /proc/37/exe 2023-08-01T20:01:34.730 INFO:teuthology.orchestra.run.smithi101.stdout:migration 38 root cwd DIR 8,1 4096 2 / 2023-08-01T20:01:34.730 INFO:teuthology.orchestra.run.smithi101.stdout:migration 38 root rtd DIR 8,1 4096 2 / 2023-08-01T20:01:34.731 INFO:teuthology.orchestra.run.smithi101.stdout:migration 38 root txt unknown /proc/38/exe 2023-08-01T20:01:34.731 INFO:teuthology.orchestra.run.smithi101.stdout:ksoftirqd 39 root cwd DIR 8,1 4096 2 / 2023-08-01T20:01:34.731 INFO:teuthology.orchestra.run.smithi101.stdout:ksoftirqd 39 root rtd DIR 8,1 4096 2 / 2023-08-01T20:01:34.731 INFO:teuthology.orchestra.run.smithi101.stdout:ksoftirqd 39 root txt unknown /proc/39/exe 2023-08-01T20:01:34.731 INFO:teuthology.orchestra.run.smithi101.stdout:kworker/4 40 root cwd DIR 8,1 4096 2 / 2023-08-01T20:01:34.731 INFO:teuthology.orchestra.run.smithi101.stdout:kworker/4 40 root rtd DIR 8,1 4096 2 / 2023-08-01T20:01:34.731 INFO:teuthology.orchestra.run.smithi101.stdout:kworker/4 40 root txt unknown /proc/40/exe 2023-08-01T20:01:34.732 INFO:teuthology.orchestra.run.smithi101.stdout:kworker/4 41 root cwd DIR 8,1 4096 2 / 2023-08-01T20:01:34.732 INFO:teuthology.orchestra.run.smithi101.stdout:kworker/4 41 root rtd DIR 8,1 4096 2 / 2023-08-01T20:01:34.732 INFO:teuthology.orchestra.run.smithi101.stdout:kworker/4 41 root txt unknown /proc/41/exe 2023-08-01T20:01:34.732 INFO:teuthology.orchestra.run.smithi101.stdout:cpuhp/5 42 root cwd DIR 8,1 4096 2 / 2023-08-01T20:01:34.732 INFO:teuthology.orchestra.run.smithi101.stdout:cpuhp/5 42 root rtd DIR 8,1 4096 2 / 2023-08-01T20:01:34.732 INFO:teuthology.orchestra.run.smithi101.stdout:cpuhp/5 42 root txt unknown /proc/42/exe 2023-08-01T20:01:34.732 INFO:teuthology.orchestra.run.smithi101.stdout:watchdog/ 43 root cwd DIR 8,1 4096 2 / 2023-08-01T20:01:34.732 INFO:teuthology.orchestra.run.smithi101.stdout:watchdog/ 43 root rtd DIR 8,1 4096 2 / 2023-08-01T20:01:34.733 INFO:teuthology.orchestra.run.smithi101.stdout:watchdog/ 43 root txt unknown /proc/43/exe 2023-08-01T20:01:34.733 INFO:teuthology.orchestra.run.smithi101.stdout:migration 44 root cwd DIR 8,1 4096 2 / 2023-08-01T20:01:34.733 INFO:teuthology.orchestra.run.smithi101.stdout:migration 44 root rtd DIR 8,1 4096 2 / 2023-08-01T20:01:34.733 INFO:teuthology.orchestra.run.smithi101.stdout:migration 44 root txt unknown /proc/44/exe 2023-08-01T20:01:34.733 INFO:teuthology.orchestra.run.smithi101.stdout:ksoftirqd 45 root cwd DIR 8,1 4096 2 / 2023-08-01T20:01:34.733 INFO:teuthology.orchestra.run.smithi101.stdout:ksoftirqd 45 root rtd DIR 8,1 4096 2 / 2023-08-01T20:01:34.733 INFO:teuthology.orchestra.run.smithi101.stdout:ksoftirqd 45 root txt unknown /proc/45/exe 2023-08-01T20:01:34.734 INFO:teuthology.orchestra.run.smithi101.stdout:kworker/5 46 root cwd DIR 8,1 4096 2 / 2023-08-01T20:01:34.734 INFO:teuthology.orchestra.run.smithi101.stdout:kworker/5 46 root rtd DIR 8,1 4096 2 / 2023-08-01T20:01:34.734 INFO:teuthology.orchestra.run.smithi101.stdout:kworker/5 46 root txt unknown /proc/46/exe 2023-08-01T20:01:34.734 INFO:teuthology.orchestra.run.smithi101.stdout:kworker/5 47 root cwd DIR 8,1 4096 2 / 2023-08-01T20:01:34.734 INFO:teuthology.orchestra.run.smithi101.stdout:kworker/5 47 root rtd DIR 8,1 4096 2 / 2023-08-01T20:01:34.734 INFO:teuthology.orchestra.run.smithi101.stdout:kworker/5 47 root txt unknown /proc/47/exe 2023-08-01T20:01:34.734 INFO:teuthology.orchestra.run.smithi101.stdout:cpuhp/6 48 root cwd DIR 8,1 4096 2 / 2023-08-01T20:01:34.734 INFO:teuthology.orchestra.run.smithi101.stdout:cpuhp/6 48 root rtd DIR 8,1 4096 2 / 2023-08-01T20:01:34.735 INFO:teuthology.orchestra.run.smithi101.stdout:cpuhp/6 48 root txt unknown /proc/48/exe 2023-08-01T20:01:34.735 INFO:teuthology.orchestra.run.smithi101.stdout:watchdog/ 49 root cwd DIR 8,1 4096 2 / 2023-08-01T20:01:34.735 INFO:teuthology.orchestra.run.smithi101.stdout:watchdog/ 49 root rtd DIR 8,1 4096 2 / 2023-08-01T20:01:34.735 INFO:teuthology.orchestra.run.smithi101.stdout:watchdog/ 49 root txt unknown /proc/49/exe 2023-08-01T20:01:34.735 INFO:teuthology.orchestra.run.smithi101.stdout:migration 50 root cwd DIR 8,1 4096 2 / 2023-08-01T20:01:34.735 INFO:teuthology.orchestra.run.smithi101.stdout:migration 50 root rtd DIR 8,1 4096 2 / 2023-08-01T20:01:34.735 INFO:teuthology.orchestra.run.smithi101.stdout:migration 50 root txt unknown /proc/50/exe 2023-08-01T20:01:34.735 INFO:teuthology.orchestra.run.smithi101.stdout:ksoftirqd 51 root cwd DIR 8,1 4096 2 / 2023-08-01T20:01:34.736 INFO:teuthology.orchestra.run.smithi101.stdout:ksoftirqd 51 root rtd DIR 8,1 4096 2 / 2023-08-01T20:01:34.736 INFO:teuthology.orchestra.run.smithi101.stdout:ksoftirqd 51 root txt unknown /proc/51/exe 2023-08-01T20:01:34.736 INFO:teuthology.orchestra.run.smithi101.stdout:kworker/6 52 root cwd DIR 8,1 4096 2 / 2023-08-01T20:01:34.736 INFO:teuthology.orchestra.run.smithi101.stdout:kworker/6 52 root rtd DIR 8,1 4096 2 / 2023-08-01T20:01:34.736 INFO:teuthology.orchestra.run.smithi101.stdout:kworker/6 52 root txt unknown /proc/52/exe 2023-08-01T20:01:34.736 INFO:teuthology.orchestra.run.smithi101.stdout:kworker/6 53 root cwd DIR 8,1 4096 2 / 2023-08-01T20:01:34.736 INFO:teuthology.orchestra.run.smithi101.stdout:kworker/6 53 root rtd DIR 8,1 4096 2 / 2023-08-01T20:01:34.736 INFO:teuthology.orchestra.run.smithi101.stdout:kworker/6 53 root txt unknown /proc/53/exe 2023-08-01T20:01:34.737 INFO:teuthology.orchestra.run.smithi101.stdout:cpuhp/7 54 root cwd DIR 8,1 4096 2 / 2023-08-01T20:01:34.737 INFO:teuthology.orchestra.run.smithi101.stdout:cpuhp/7 54 root rtd DIR 8,1 4096 2 / 2023-08-01T20:01:34.737 INFO:teuthology.orchestra.run.smithi101.stdout:cpuhp/7 54 root txt unknown /proc/54/exe 2023-08-01T20:01:34.737 INFO:teuthology.orchestra.run.smithi101.stdout:watchdog/ 55 root cwd DIR 8,1 4096 2 / 2023-08-01T20:01:34.737 INFO:teuthology.orchestra.run.smithi101.stdout:watchdog/ 55 root rtd DIR 8,1 4096 2 / 2023-08-01T20:01:34.737 INFO:teuthology.orchestra.run.smithi101.stdout:watchdog/ 55 root txt unknown /proc/55/exe 2023-08-01T20:01:34.737 INFO:teuthology.orchestra.run.smithi101.stdout:migration 56 root cwd DIR 8,1 4096 2 / 2023-08-01T20:01:34.737 INFO:teuthology.orchestra.run.smithi101.stdout:migration 56 root rtd DIR 8,1 4096 2 / 2023-08-01T20:01:34.738 INFO:teuthology.orchestra.run.smithi101.stdout:migration 56 root txt unknown /proc/56/exe 2023-08-01T20:01:34.738 INFO:teuthology.orchestra.run.smithi101.stdout:ksoftirqd 57 root cwd DIR 8,1 4096 2 / 2023-08-01T20:01:34.738 INFO:teuthology.orchestra.run.smithi101.stdout:ksoftirqd 57 root rtd DIR 8,1 4096 2 / 2023-08-01T20:01:34.738 INFO:teuthology.orchestra.run.smithi101.stdout:ksoftirqd 57 root txt unknown /proc/57/exe 2023-08-01T20:01:34.738 INFO:teuthology.orchestra.run.smithi101.stdout:kworker/7 58 root cwd DIR 8,1 4096 2 / 2023-08-01T20:01:34.738 INFO:teuthology.orchestra.run.smithi101.stdout:kworker/7 58 root rtd DIR 8,1 4096 2 / 2023-08-01T20:01:34.738 INFO:teuthology.orchestra.run.smithi101.stdout:kworker/7 58 root txt unknown /proc/58/exe 2023-08-01T20:01:34.738 INFO:teuthology.orchestra.run.smithi101.stdout:kworker/7 59 root cwd DIR 8,1 4096 2 / 2023-08-01T20:01:34.739 INFO:teuthology.orchestra.run.smithi101.stdout:kworker/7 59 root rtd DIR 8,1 4096 2 / 2023-08-01T20:01:34.739 INFO:teuthology.orchestra.run.smithi101.stdout:kworker/7 59 root txt unknown /proc/59/exe 2023-08-01T20:01:34.739 INFO:teuthology.orchestra.run.smithi101.stdout:kworker/u 61 root cwd DIR 8,1 4096 2 / 2023-08-01T20:01:34.739 INFO:teuthology.orchestra.run.smithi101.stdout:kworker/u 61 root rtd DIR 8,1 4096 2 / 2023-08-01T20:01:34.739 INFO:teuthology.orchestra.run.smithi101.stdout:kworker/u 61 root txt unknown /proc/61/exe 2023-08-01T20:01:34.739 INFO:teuthology.orchestra.run.smithi101.stdout:kworker/u 62 root cwd DIR 8,1 4096 2 / 2023-08-01T20:01:34.739 INFO:teuthology.orchestra.run.smithi101.stdout:kworker/u 62 root rtd DIR 8,1 4096 2 / 2023-08-01T20:01:34.739 INFO:teuthology.orchestra.run.smithi101.stdout:kworker/u 62 root txt unknown /proc/62/exe 2023-08-01T20:01:34.740 INFO:teuthology.orchestra.run.smithi101.stdout:kworker/u 63 root cwd DIR 8,1 4096 2 / 2023-08-01T20:01:34.740 INFO:teuthology.orchestra.run.smithi101.stdout:kworker/u 63 root rtd DIR 8,1 4096 2 / 2023-08-01T20:01:34.740 INFO:teuthology.orchestra.run.smithi101.stdout:kworker/u 63 root txt unknown /proc/63/exe 2023-08-01T20:01:34.740 INFO:teuthology.orchestra.run.smithi101.stdout:kworker/u 64 root cwd DIR 8,1 4096 2 / 2023-08-01T20:01:34.740 INFO:teuthology.orchestra.run.smithi101.stdout:kworker/u 64 root rtd DIR 8,1 4096 2 / 2023-08-01T20:01:34.740 INFO:teuthology.orchestra.run.smithi101.stdout:kworker/u 64 root txt unknown /proc/64/exe 2023-08-01T20:01:34.740 INFO:teuthology.orchestra.run.smithi101.stdout:kworker/u 65 root cwd DIR 8,1 4096 2 / 2023-08-01T20:01:34.740 INFO:teuthology.orchestra.run.smithi101.stdout:kworker/u 65 root rtd DIR 8,1 4096 2 / 2023-08-01T20:01:34.741 INFO:teuthology.orchestra.run.smithi101.stdout:kworker/u 65 root txt unknown /proc/65/exe 2023-08-01T20:01:34.741 INFO:teuthology.orchestra.run.smithi101.stdout:kworker/u 66 root cwd DIR 8,1 4096 2 / 2023-08-01T20:01:34.741 INFO:teuthology.orchestra.run.smithi101.stdout:kworker/u 66 root rtd DIR 8,1 4096 2 / 2023-08-01T20:01:34.741 INFO:teuthology.orchestra.run.smithi101.stdout:kworker/u 66 root txt unknown /proc/66/exe 2023-08-01T20:01:34.741 INFO:teuthology.orchestra.run.smithi101.stdout:kworker/u 67 root cwd DIR 8,1 4096 2 / 2023-08-01T20:01:34.741 INFO:teuthology.orchestra.run.smithi101.stdout:kworker/u 67 root rtd DIR 8,1 4096 2 / 2023-08-01T20:01:34.741 INFO:teuthology.orchestra.run.smithi101.stdout:kworker/u 67 root txt unknown /proc/67/exe 2023-08-01T20:01:34.742 INFO:teuthology.orchestra.run.smithi101.stdout:kdevtmpfs 68 root cwd DIR 0,6 3300 3 / 2023-08-01T20:01:34.742 INFO:teuthology.orchestra.run.smithi101.stdout:kdevtmpfs 68 root rtd DIR 0,6 3300 3 / 2023-08-01T20:01:34.742 INFO:teuthology.orchestra.run.smithi101.stdout:kdevtmpfs 68 root txt unknown /proc/68/exe 2023-08-01T20:01:34.742 INFO:teuthology.orchestra.run.smithi101.stdout:netns 69 root cwd DIR 8,1 4096 2 / 2023-08-01T20:01:34.742 INFO:teuthology.orchestra.run.smithi101.stdout:netns 69 root rtd DIR 8,1 4096 2 / 2023-08-01T20:01:34.742 INFO:teuthology.orchestra.run.smithi101.stdout:netns 69 root txt unknown /proc/69/exe 2023-08-01T20:01:34.742 INFO:teuthology.orchestra.run.smithi101.stdout:kauditd 70 root cwd DIR 8,1 4096 2 / 2023-08-01T20:01:34.742 INFO:teuthology.orchestra.run.smithi101.stdout:kauditd 70 root rtd DIR 8,1 4096 2 / 2023-08-01T20:01:34.743 INFO:teuthology.orchestra.run.smithi101.stdout:kauditd 70 root txt unknown /proc/70/exe 2023-08-01T20:01:34.743 INFO:teuthology.orchestra.run.smithi101.stdout:kworker/1 71 root cwd DIR 8,1 4096 2 / 2023-08-01T20:01:34.743 INFO:teuthology.orchestra.run.smithi101.stdout:kworker/1 71 root rtd DIR 8,1 4096 2 / 2023-08-01T20:01:34.743 INFO:teuthology.orchestra.run.smithi101.stdout:kworker/1 71 root txt unknown /proc/71/exe 2023-08-01T20:01:34.743 INFO:teuthology.orchestra.run.smithi101.stdout:kworker/2 72 root cwd DIR 8,1 4096 2 / 2023-08-01T20:01:34.743 INFO:teuthology.orchestra.run.smithi101.stdout:kworker/2 72 root rtd DIR 8,1 4096 2 / 2023-08-01T20:01:34.743 INFO:teuthology.orchestra.run.smithi101.stdout:kworker/2 72 root txt unknown /proc/72/exe 2023-08-01T20:01:34.743 INFO:teuthology.orchestra.run.smithi101.stdout:khungtask 73 root cwd DIR 8,1 4096 2 / 2023-08-01T20:01:34.744 INFO:teuthology.orchestra.run.smithi101.stdout:khungtask 73 root rtd DIR 8,1 4096 2 / 2023-08-01T20:01:34.744 INFO:teuthology.orchestra.run.smithi101.stdout:khungtask 73 root txt unknown /proc/73/exe 2023-08-01T20:01:34.744 INFO:teuthology.orchestra.run.smithi101.stdout:oom_reape 74 root cwd DIR 8,1 4096 2 / 2023-08-01T20:01:34.744 INFO:teuthology.orchestra.run.smithi101.stdout:oom_reape 74 root rtd DIR 8,1 4096 2 / 2023-08-01T20:01:34.744 INFO:teuthology.orchestra.run.smithi101.stdout:oom_reape 74 root txt unknown /proc/74/exe 2023-08-01T20:01:34.744 INFO:teuthology.orchestra.run.smithi101.stdout:writeback 75 root cwd DIR 8,1 4096 2 / 2023-08-01T20:01:34.744 INFO:teuthology.orchestra.run.smithi101.stdout:writeback 75 root rtd DIR 8,1 4096 2 / 2023-08-01T20:01:34.744 INFO:teuthology.orchestra.run.smithi101.stdout:writeback 75 root txt unknown /proc/75/exe 2023-08-01T20:01:34.745 INFO:teuthology.orchestra.run.smithi101.stdout:kcompactd 76 root cwd DIR 8,1 4096 2 / 2023-08-01T20:01:34.745 INFO:teuthology.orchestra.run.smithi101.stdout:kcompactd 76 root rtd DIR 8,1 4096 2 / 2023-08-01T20:01:34.745 INFO:teuthology.orchestra.run.smithi101.stdout:kcompactd 76 root txt unknown /proc/76/exe 2023-08-01T20:01:34.745 INFO:teuthology.orchestra.run.smithi101.stdout:ksmd 77 root cwd DIR 8,1 4096 2 / 2023-08-01T20:01:34.745 INFO:teuthology.orchestra.run.smithi101.stdout:ksmd 77 root rtd DIR 8,1 4096 2 / 2023-08-01T20:01:34.745 INFO:teuthology.orchestra.run.smithi101.stdout:ksmd 77 root txt unknown /proc/77/exe 2023-08-01T20:01:34.745 INFO:teuthology.orchestra.run.smithi101.stdout:khugepage 78 root cwd DIR 8,1 4096 2 / 2023-08-01T20:01:34.745 INFO:teuthology.orchestra.run.smithi101.stdout:khugepage 78 root rtd DIR 8,1 4096 2 / 2023-08-01T20:01:34.746 INFO:teuthology.orchestra.run.smithi101.stdout:khugepage 78 root txt unknown /proc/78/exe 2023-08-01T20:01:34.746 INFO:teuthology.orchestra.run.smithi101.stdout:crypto 79 root cwd DIR 8,1 4096 2 / 2023-08-01T20:01:34.746 INFO:teuthology.orchestra.run.smithi101.stdout:crypto 79 root rtd DIR 8,1 4096 2 / 2023-08-01T20:01:34.746 INFO:teuthology.orchestra.run.smithi101.stdout:crypto 79 root txt unknown /proc/79/exe 2023-08-01T20:01:34.746 INFO:teuthology.orchestra.run.smithi101.stdout:kintegrit 80 root cwd DIR 8,1 4096 2 / 2023-08-01T20:01:34.746 INFO:teuthology.orchestra.run.smithi101.stdout:kintegrit 80 root rtd DIR 8,1 4096 2 / 2023-08-01T20:01:34.746 INFO:teuthology.orchestra.run.smithi101.stdout:kintegrit 80 root txt unknown /proc/80/exe 2023-08-01T20:01:34.746 INFO:teuthology.orchestra.run.smithi101.stdout:kblockd 81 root cwd DIR 8,1 4096 2 / 2023-08-01T20:01:34.747 INFO:teuthology.orchestra.run.smithi101.stdout:kblockd 81 root rtd DIR 8,1 4096 2 / 2023-08-01T20:01:34.747 INFO:teuthology.orchestra.run.smithi101.stdout:kblockd 81 root txt unknown /proc/81/exe 2023-08-01T20:01:34.747 INFO:teuthology.orchestra.run.smithi101.stdout:blkcg_pun 82 root cwd DIR 8,1 4096 2 / 2023-08-01T20:01:34.747 INFO:teuthology.orchestra.run.smithi101.stdout:blkcg_pun 82 root rtd DIR 8,1 4096 2 / 2023-08-01T20:01:34.747 INFO:teuthology.orchestra.run.smithi101.stdout:blkcg_pun 82 root txt unknown /proc/82/exe 2023-08-01T20:01:34.747 INFO:teuthology.orchestra.run.smithi101.stdout:kworker/4 83 root cwd DIR 8,1 4096 2 / 2023-08-01T20:01:34.747 INFO:teuthology.orchestra.run.smithi101.stdout:kworker/4 83 root rtd DIR 8,1 4096 2 / 2023-08-01T20:01:34.747 INFO:teuthology.orchestra.run.smithi101.stdout:kworker/4 83 root txt unknown /proc/83/exe 2023-08-01T20:01:34.748 INFO:teuthology.orchestra.run.smithi101.stdout:kworker/3 84 root cwd DIR 8,1 4096 2 / 2023-08-01T20:01:34.748 INFO:teuthology.orchestra.run.smithi101.stdout:kworker/3 84 root rtd DIR 8,1 4096 2 / 2023-08-01T20:01:34.748 INFO:teuthology.orchestra.run.smithi101.stdout:kworker/3 84 root txt unknown /proc/84/exe 2023-08-01T20:01:34.748 INFO:teuthology.orchestra.run.smithi101.stdout:kworker/6 85 root cwd DIR 8,1 4096 2 / 2023-08-01T20:01:34.748 INFO:teuthology.orchestra.run.smithi101.stdout:kworker/6 85 root rtd DIR 8,1 4096 2 / 2023-08-01T20:01:34.748 INFO:teuthology.orchestra.run.smithi101.stdout:kworker/6 85 root txt unknown /proc/85/exe 2023-08-01T20:01:34.748 INFO:teuthology.orchestra.run.smithi101.stdout:kworker/5 86 root cwd DIR 8,1 4096 2 / 2023-08-01T20:01:34.749 INFO:teuthology.orchestra.run.smithi101.stdout:kworker/5 86 root rtd DIR 8,1 4096 2 / 2023-08-01T20:01:34.749 INFO:teuthology.orchestra.run.smithi101.stdout:kworker/5 86 root txt unknown /proc/86/exe 2023-08-01T20:01:34.749 INFO:teuthology.orchestra.run.smithi101.stdout:kworker/7 87 root cwd DIR 8,1 4096 2 / 2023-08-01T20:01:34.749 INFO:teuthology.orchestra.run.smithi101.stdout:kworker/7 87 root rtd DIR 8,1 4096 2 / 2023-08-01T20:01:34.749 INFO:teuthology.orchestra.run.smithi101.stdout:kworker/7 87 root txt unknown /proc/87/exe 2023-08-01T20:01:34.749 INFO:teuthology.orchestra.run.smithi101.stdout:tpm_dev_w 88 root cwd DIR 8,1 4096 2 / 2023-08-01T20:01:34.749 INFO:teuthology.orchestra.run.smithi101.stdout:tpm_dev_w 88 root rtd DIR 8,1 4096 2 / 2023-08-01T20:01:34.749 INFO:teuthology.orchestra.run.smithi101.stdout:tpm_dev_w 88 root txt unknown /proc/88/exe 2023-08-01T20:01:34.750 INFO:teuthology.orchestra.run.smithi101.stdout:md 89 root cwd DIR 8,1 4096 2 / 2023-08-01T20:01:34.750 INFO:teuthology.orchestra.run.smithi101.stdout:md 89 root rtd DIR 8,1 4096 2 / 2023-08-01T20:01:34.750 INFO:teuthology.orchestra.run.smithi101.stdout:md 89 root txt unknown /proc/89/exe 2023-08-01T20:01:34.750 INFO:teuthology.orchestra.run.smithi101.stdout:edac-poll 90 root cwd DIR 8,1 4096 2 / 2023-08-01T20:01:34.750 INFO:teuthology.orchestra.run.smithi101.stdout:edac-poll 90 root rtd DIR 8,1 4096 2 / 2023-08-01T20:01:34.750 INFO:teuthology.orchestra.run.smithi101.stdout:edac-poll 90 root txt unknown /proc/90/exe 2023-08-01T20:01:34.750 INFO:teuthology.orchestra.run.smithi101.stdout:watchdogd 91 root cwd DIR 8,1 4096 2 / 2023-08-01T20:01:34.750 INFO:teuthology.orchestra.run.smithi101.stdout:watchdogd 91 root rtd DIR 8,1 4096 2 / 2023-08-01T20:01:34.751 INFO:teuthology.orchestra.run.smithi101.stdout:watchdogd 91 root txt unknown /proc/91/exe 2023-08-01T20:01:34.751 INFO:teuthology.orchestra.run.smithi101.stdout:kworker/0 92 root cwd DIR 8,1 4096 2 / 2023-08-01T20:01:34.751 INFO:teuthology.orchestra.run.smithi101.stdout:kworker/0 92 root rtd DIR 8,1 4096 2 / 2023-08-01T20:01:34.751 INFO:teuthology.orchestra.run.smithi101.stdout:kworker/0 92 root txt unknown /proc/92/exe 2023-08-01T20:01:34.751 INFO:teuthology.orchestra.run.smithi101.stdout:kswapd0 109 root cwd DIR 8,1 4096 2 / 2023-08-01T20:01:34.751 INFO:teuthology.orchestra.run.smithi101.stdout:kswapd0 109 root rtd DIR 8,1 4096 2 / 2023-08-01T20:01:34.751 INFO:teuthology.orchestra.run.smithi101.stdout:kswapd0 109 root txt unknown /proc/109/exe 2023-08-01T20:01:34.751 INFO:teuthology.orchestra.run.smithi101.stdout:kworker/0 169 root cwd DIR 8,1 4096 2 / 2023-08-01T20:01:34.752 INFO:teuthology.orchestra.run.smithi101.stdout:kworker/0 169 root rtd DIR 8,1 4096 2 / 2023-08-01T20:01:34.752 INFO:teuthology.orchestra.run.smithi101.stdout:kworker/0 169 root txt unknown /proc/169/exe 2023-08-01T20:01:34.752 INFO:teuthology.orchestra.run.smithi101.stdout:kthrotld 170 root cwd DIR 8,1 4096 2 / 2023-08-01T20:01:34.752 INFO:teuthology.orchestra.run.smithi101.stdout:kthrotld 170 root rtd DIR 8,1 4096 2 / 2023-08-01T20:01:34.752 INFO:teuthology.orchestra.run.smithi101.stdout:kthrotld 170 root txt unknown /proc/170/exe 2023-08-01T20:01:34.752 INFO:teuthology.orchestra.run.smithi101.stdout:acpi_ther 171 root cwd DIR 8,1 4096 2 / 2023-08-01T20:01:34.752 INFO:teuthology.orchestra.run.smithi101.stdout:acpi_ther 171 root rtd DIR 8,1 4096 2 / 2023-08-01T20:01:34.753 INFO:teuthology.orchestra.run.smithi101.stdout:acpi_ther 171 root txt unknown /proc/171/exe 2023-08-01T20:01:34.753 INFO:teuthology.orchestra.run.smithi101.stdout:kmpath_rd 172 root cwd DIR 8,1 4096 2 / 2023-08-01T20:01:34.753 INFO:teuthology.orchestra.run.smithi101.stdout:kmpath_rd 172 root rtd DIR 8,1 4096 2 / 2023-08-01T20:01:34.753 INFO:teuthology.orchestra.run.smithi101.stdout:kmpath_rd 172 root txt unknown /proc/172/exe 2023-08-01T20:01:34.753 INFO:teuthology.orchestra.run.smithi101.stdout:kaluad 173 root cwd DIR 8,1 4096 2 / 2023-08-01T20:01:34.753 INFO:teuthology.orchestra.run.smithi101.stdout:kaluad 173 root rtd DIR 8,1 4096 2 / 2023-08-01T20:01:34.753 INFO:teuthology.orchestra.run.smithi101.stdout:kaluad 173 root txt unknown /proc/173/exe 2023-08-01T20:01:34.753 INFO:teuthology.orchestra.run.smithi101.stdout:kworker/5 174 root cwd DIR 8,1 4096 2 / 2023-08-01T20:01:34.754 INFO:teuthology.orchestra.run.smithi101.stdout:kworker/5 174 root rtd DIR 8,1 4096 2 / 2023-08-01T20:01:34.754 INFO:teuthology.orchestra.run.smithi101.stdout:kworker/5 174 root txt unknown /proc/174/exe 2023-08-01T20:01:34.754 INFO:teuthology.orchestra.run.smithi101.stdout:kworker/6 175 root cwd DIR 8,1 4096 2 / 2023-08-01T20:01:34.754 INFO:teuthology.orchestra.run.smithi101.stdout:kworker/6 175 root rtd DIR 8,1 4096 2 / 2023-08-01T20:01:34.754 INFO:teuthology.orchestra.run.smithi101.stdout:kworker/6 175 root txt unknown /proc/175/exe 2023-08-01T20:01:34.754 INFO:teuthology.orchestra.run.smithi101.stdout:kworker/2 176 root cwd DIR 8,1 4096 2 / 2023-08-01T20:01:34.754 INFO:teuthology.orchestra.run.smithi101.stdout:kworker/2 176 root rtd DIR 8,1 4096 2 / 2023-08-01T20:01:34.754 INFO:teuthology.orchestra.run.smithi101.stdout:kworker/2 176 root txt unknown /proc/176/exe 2023-08-01T20:01:34.755 INFO:teuthology.orchestra.run.smithi101.stdout:ipv6_addr 177 root cwd DIR 8,1 4096 2 / 2023-08-01T20:01:34.755 INFO:teuthology.orchestra.run.smithi101.stdout:ipv6_addr 177 root rtd DIR 8,1 4096 2 / 2023-08-01T20:01:34.755 INFO:teuthology.orchestra.run.smithi101.stdout:ipv6_addr 177 root txt unknown /proc/177/exe 2023-08-01T20:01:34.755 INFO:teuthology.orchestra.run.smithi101.stdout:kstrp 178 root cwd DIR 8,1 4096 2 / 2023-08-01T20:01:34.755 INFO:teuthology.orchestra.run.smithi101.stdout:kstrp 178 root rtd DIR 8,1 4096 2 / 2023-08-01T20:01:34.755 INFO:teuthology.orchestra.run.smithi101.stdout:kstrp 178 root txt unknown /proc/178/exe 2023-08-01T20:01:34.755 INFO:teuthology.orchestra.run.smithi101.stdout:zswap-shr 217 root cwd DIR 8,1 4096 2 / 2023-08-01T20:01:34.755 INFO:teuthology.orchestra.run.smithi101.stdout:zswap-shr 217 root rtd DIR 8,1 4096 2 / 2023-08-01T20:01:34.756 INFO:teuthology.orchestra.run.smithi101.stdout:zswap-shr 217 root txt unknown /proc/217/exe 2023-08-01T20:01:34.756 INFO:teuthology.orchestra.run.smithi101.stdout:kworker/7 231 root cwd DIR 8,1 4096 2 / 2023-08-01T20:01:34.756 INFO:teuthology.orchestra.run.smithi101.stdout:kworker/7 231 root rtd DIR 8,1 4096 2 / 2023-08-01T20:01:34.756 INFO:teuthology.orchestra.run.smithi101.stdout:kworker/7 231 root txt unknown /proc/231/exe 2023-08-01T20:01:34.756 INFO:teuthology.orchestra.run.smithi101.stdout:kworker/1 264 root cwd DIR 8,1 4096 2 / 2023-08-01T20:01:34.756 INFO:teuthology.orchestra.run.smithi101.stdout:kworker/1 264 root rtd DIR 8,1 4096 2 / 2023-08-01T20:01:34.756 INFO:teuthology.orchestra.run.smithi101.stdout:kworker/1 264 root txt unknown /proc/264/exe 2023-08-01T20:01:34.756 INFO:teuthology.orchestra.run.smithi101.stdout:kworker/6 278 root cwd DIR 8,1 4096 2 / 2023-08-01T20:01:34.757 INFO:teuthology.orchestra.run.smithi101.stdout:kworker/6 278 root rtd DIR 8,1 4096 2 / 2023-08-01T20:01:34.757 INFO:teuthology.orchestra.run.smithi101.stdout:kworker/6 278 root txt unknown /proc/278/exe 2023-08-01T20:01:34.757 INFO:teuthology.orchestra.run.smithi101.stdout:kworker/4 280 root cwd DIR 8,1 4096 2 / 2023-08-01T20:01:34.757 INFO:teuthology.orchestra.run.smithi101.stdout:kworker/4 280 root rtd DIR 8,1 4096 2 / 2023-08-01T20:01:34.757 INFO:teuthology.orchestra.run.smithi101.stdout:kworker/4 280 root txt unknown /proc/280/exe 2023-08-01T20:01:34.757 INFO:teuthology.orchestra.run.smithi101.stdout:kworker/3 282 root cwd DIR 8,1 4096 2 / 2023-08-01T20:01:34.757 INFO:teuthology.orchestra.run.smithi101.stdout:kworker/3 282 root rtd DIR 8,1 4096 2 / 2023-08-01T20:01:34.757 INFO:teuthology.orchestra.run.smithi101.stdout:kworker/3 282 root txt unknown /proc/282/exe 2023-08-01T20:01:34.758 INFO:teuthology.orchestra.run.smithi101.stdout:kworker/4 283 root cwd DIR 8,1 4096 2 / 2023-08-01T20:01:34.758 INFO:teuthology.orchestra.run.smithi101.stdout:kworker/4 283 root rtd DIR 8,1 4096 2 / 2023-08-01T20:01:34.758 INFO:teuthology.orchestra.run.smithi101.stdout:kworker/4 283 root txt unknown /proc/283/exe 2023-08-01T20:01:34.758 INFO:teuthology.orchestra.run.smithi101.stdout:kworker/7 293 root cwd DIR 8,1 4096 2 / 2023-08-01T20:01:34.758 INFO:teuthology.orchestra.run.smithi101.stdout:kworker/7 293 root rtd DIR 8,1 4096 2 / 2023-08-01T20:01:34.758 INFO:teuthology.orchestra.run.smithi101.stdout:kworker/7 293 root txt unknown /proc/293/exe 2023-08-01T20:01:34.758 INFO:teuthology.orchestra.run.smithi101.stdout:kworker/7 294 root cwd DIR 8,1 4096 2 / 2023-08-01T20:01:34.758 INFO:teuthology.orchestra.run.smithi101.stdout:kworker/7 294 root rtd DIR 8,1 4096 2 / 2023-08-01T20:01:34.759 INFO:teuthology.orchestra.run.smithi101.stdout:kworker/7 294 root txt unknown /proc/294/exe 2023-08-01T20:01:34.759 INFO:teuthology.orchestra.run.smithi101.stdout:kworker/5 299 root cwd DIR 8,1 4096 2 / 2023-08-01T20:01:34.759 INFO:teuthology.orchestra.run.smithi101.stdout:kworker/5 299 root rtd DIR 8,1 4096 2 / 2023-08-01T20:01:34.759 INFO:teuthology.orchestra.run.smithi101.stdout:kworker/5 299 root txt unknown /proc/299/exe 2023-08-01T20:01:34.759 INFO:teuthology.orchestra.run.smithi101.stdout:kworker/5 301 root cwd DIR 8,1 4096 2 / 2023-08-01T20:01:34.759 INFO:teuthology.orchestra.run.smithi101.stdout:kworker/5 301 root rtd DIR 8,1 4096 2 / 2023-08-01T20:01:34.759 INFO:teuthology.orchestra.run.smithi101.stdout:kworker/5 301 root txt unknown /proc/301/exe 2023-08-01T20:01:34.759 INFO:teuthology.orchestra.run.smithi101.stdout:kworker/6 322 root cwd DIR 8,1 4096 2 / 2023-08-01T20:01:34.760 INFO:teuthology.orchestra.run.smithi101.stdout:kworker/6 322 root rtd DIR 8,1 4096 2 / 2023-08-01T20:01:34.760 INFO:teuthology.orchestra.run.smithi101.stdout:kworker/6 322 root txt unknown /proc/322/exe 2023-08-01T20:01:34.760 INFO:teuthology.orchestra.run.smithi101.stdout:kworker/4 364 root cwd DIR 8,1 4096 2 / 2023-08-01T20:01:34.760 INFO:teuthology.orchestra.run.smithi101.stdout:kworker/4 364 root rtd DIR 8,1 4096 2 / 2023-08-01T20:01:34.760 INFO:teuthology.orchestra.run.smithi101.stdout:kworker/4 364 root txt unknown /proc/364/exe 2023-08-01T20:01:34.760 INFO:teuthology.orchestra.run.smithi101.stdout:kworker/1 381 root cwd DIR 8,1 4096 2 / 2023-08-01T20:01:34.760 INFO:teuthology.orchestra.run.smithi101.stdout:kworker/1 381 root rtd DIR 8,1 4096 2 / 2023-08-01T20:01:34.761 INFO:teuthology.orchestra.run.smithi101.stdout:kworker/1 381 root txt unknown /proc/381/exe 2023-08-01T20:01:34.761 INFO:teuthology.orchestra.run.smithi101.stdout:kworker/0 420 root cwd DIR 8,1 4096 2 / 2023-08-01T20:01:34.761 INFO:teuthology.orchestra.run.smithi101.stdout:kworker/0 420 root rtd DIR 8,1 4096 2 / 2023-08-01T20:01:34.761 INFO:teuthology.orchestra.run.smithi101.stdout:kworker/0 420 root txt unknown /proc/420/exe 2023-08-01T20:01:34.761 INFO:teuthology.orchestra.run.smithi101.stdout:kworker/2 421 root cwd DIR 8,1 4096 2 / 2023-08-01T20:01:34.761 INFO:teuthology.orchestra.run.smithi101.stdout:kworker/2 421 root rtd DIR 8,1 4096 2 / 2023-08-01T20:01:34.761 INFO:teuthology.orchestra.run.smithi101.stdout:kworker/2 421 root txt unknown /proc/421/exe 2023-08-01T20:01:34.761 INFO:teuthology.orchestra.run.smithi101.stdout:nvme-wq 422 root cwd DIR 8,1 4096 2 / 2023-08-01T20:01:34.762 INFO:teuthology.orchestra.run.smithi101.stdout:nvme-wq 422 root rtd DIR 8,1 4096 2 / 2023-08-01T20:01:34.762 INFO:teuthology.orchestra.run.smithi101.stdout:nvme-wq 422 root txt unknown /proc/422/exe 2023-08-01T20:01:34.762 INFO:teuthology.orchestra.run.smithi101.stdout:nvme-rese 423 root cwd DIR 8,1 4096 2 / 2023-08-01T20:01:34.762 INFO:teuthology.orchestra.run.smithi101.stdout:nvme-rese 423 root rtd DIR 8,1 4096 2 / 2023-08-01T20:01:34.762 INFO:teuthology.orchestra.run.smithi101.stdout:nvme-rese 423 root txt unknown /proc/423/exe 2023-08-01T20:01:34.762 INFO:teuthology.orchestra.run.smithi101.stdout:nvme-dele 424 root cwd DIR 8,1 4096 2 / 2023-08-01T20:01:34.762 INFO:teuthology.orchestra.run.smithi101.stdout:nvme-dele 424 root rtd DIR 8,1 4096 2 / 2023-08-01T20:01:34.762 INFO:teuthology.orchestra.run.smithi101.stdout:nvme-dele 424 root txt unknown /proc/424/exe 2023-08-01T20:01:34.763 INFO:teuthology.orchestra.run.smithi101.stdout:ata_sff 425 root cwd DIR 8,1 4096 2 / 2023-08-01T20:01:34.763 INFO:teuthology.orchestra.run.smithi101.stdout:ata_sff 425 root rtd DIR 8,1 4096 2 / 2023-08-01T20:01:34.763 INFO:teuthology.orchestra.run.smithi101.stdout:ata_sff 425 root txt unknown /proc/425/exe 2023-08-01T20:01:34.763 INFO:teuthology.orchestra.run.smithi101.stdout:ixgbe 428 root cwd DIR 8,1 4096 2 / 2023-08-01T20:01:34.763 INFO:teuthology.orchestra.run.smithi101.stdout:ixgbe 428 root rtd DIR 8,1 4096 2 / 2023-08-01T20:01:34.763 INFO:teuthology.orchestra.run.smithi101.stdout:ixgbe 428 root txt unknown /proc/428/exe 2023-08-01T20:01:34.763 INFO:teuthology.orchestra.run.smithi101.stdout:scsi_eh_0 437 root cwd DIR 8,1 4096 2 / 2023-08-01T20:01:34.763 INFO:teuthology.orchestra.run.smithi101.stdout:scsi_eh_0 437 root rtd DIR 8,1 4096 2 / 2023-08-01T20:01:34.764 INFO:teuthology.orchestra.run.smithi101.stdout:scsi_eh_0 437 root txt unknown /proc/437/exe 2023-08-01T20:01:34.764 INFO:teuthology.orchestra.run.smithi101.stdout:scsi_tmf_ 438 root cwd DIR 8,1 4096 2 / 2023-08-01T20:01:34.764 INFO:teuthology.orchestra.run.smithi101.stdout:scsi_tmf_ 438 root rtd DIR 8,1 4096 2 / 2023-08-01T20:01:34.764 INFO:teuthology.orchestra.run.smithi101.stdout:scsi_tmf_ 438 root txt unknown /proc/438/exe 2023-08-01T20:01:34.764 INFO:teuthology.orchestra.run.smithi101.stdout:scsi_eh_1 439 root cwd DIR 8,1 4096 2 / 2023-08-01T20:01:34.764 INFO:teuthology.orchestra.run.smithi101.stdout:scsi_eh_1 439 root rtd DIR 8,1 4096 2 / 2023-08-01T20:01:34.764 INFO:teuthology.orchestra.run.smithi101.stdout:scsi_eh_1 439 root txt unknown /proc/439/exe 2023-08-01T20:01:34.765 INFO:teuthology.orchestra.run.smithi101.stdout:scsi_tmf_ 440 root cwd DIR 8,1 4096 2 / 2023-08-01T20:01:34.765 INFO:teuthology.orchestra.run.smithi101.stdout:scsi_tmf_ 440 root rtd DIR 8,1 4096 2 / 2023-08-01T20:01:34.765 INFO:teuthology.orchestra.run.smithi101.stdout:scsi_tmf_ 440 root txt unknown /proc/440/exe 2023-08-01T20:01:34.765 INFO:teuthology.orchestra.run.smithi101.stdout:scsi_eh_2 441 root cwd DIR 8,1 4096 2 / 2023-08-01T20:01:34.765 INFO:teuthology.orchestra.run.smithi101.stdout:scsi_eh_2 441 root rtd DIR 8,1 4096 2 / 2023-08-01T20:01:34.765 INFO:teuthology.orchestra.run.smithi101.stdout:scsi_eh_2 441 root txt unknown /proc/441/exe 2023-08-01T20:01:34.765 INFO:teuthology.orchestra.run.smithi101.stdout:scsi_tmf_ 442 root cwd DIR 8,1 4096 2 / 2023-08-01T20:01:34.765 INFO:teuthology.orchestra.run.smithi101.stdout:scsi_tmf_ 442 root rtd DIR 8,1 4096 2 / 2023-08-01T20:01:34.766 INFO:teuthology.orchestra.run.smithi101.stdout:scsi_tmf_ 442 root txt unknown /proc/442/exe 2023-08-01T20:01:34.766 INFO:teuthology.orchestra.run.smithi101.stdout:scsi_eh_3 443 root cwd DIR 8,1 4096 2 / 2023-08-01T20:01:34.766 INFO:teuthology.orchestra.run.smithi101.stdout:scsi_eh_3 443 root rtd DIR 8,1 4096 2 / 2023-08-01T20:01:34.766 INFO:teuthology.orchestra.run.smithi101.stdout:scsi_eh_3 443 root txt unknown /proc/443/exe 2023-08-01T20:01:34.766 INFO:teuthology.orchestra.run.smithi101.stdout:scsi_tmf_ 444 root cwd DIR 8,1 4096 2 / 2023-08-01T20:01:34.766 INFO:teuthology.orchestra.run.smithi101.stdout:scsi_tmf_ 444 root rtd DIR 8,1 4096 2 / 2023-08-01T20:01:34.766 INFO:teuthology.orchestra.run.smithi101.stdout:scsi_tmf_ 444 root txt unknown /proc/444/exe 2023-08-01T20:01:34.766 INFO:teuthology.orchestra.run.smithi101.stdout:scsi_eh_4 447 root cwd DIR 8,1 4096 2 / 2023-08-01T20:01:34.767 INFO:teuthology.orchestra.run.smithi101.stdout:scsi_eh_4 447 root rtd DIR 8,1 4096 2 / 2023-08-01T20:01:34.767 INFO:teuthology.orchestra.run.smithi101.stdout:scsi_eh_4 447 root txt unknown /proc/447/exe 2023-08-01T20:01:34.767 INFO:teuthology.orchestra.run.smithi101.stdout:scsi_tmf_ 448 root cwd DIR 8,1 4096 2 / 2023-08-01T20:01:34.767 INFO:teuthology.orchestra.run.smithi101.stdout:scsi_tmf_ 448 root rtd DIR 8,1 4096 2 / 2023-08-01T20:01:34.767 INFO:teuthology.orchestra.run.smithi101.stdout:scsi_tmf_ 448 root txt unknown /proc/448/exe 2023-08-01T20:01:34.767 INFO:teuthology.orchestra.run.smithi101.stdout:scsi_eh_5 449 root cwd DIR 8,1 4096 2 / 2023-08-01T20:01:34.767 INFO:teuthology.orchestra.run.smithi101.stdout:scsi_eh_5 449 root rtd DIR 8,1 4096 2 / 2023-08-01T20:01:34.767 INFO:teuthology.orchestra.run.smithi101.stdout:scsi_eh_5 449 root txt unknown /proc/449/exe 2023-08-01T20:01:34.768 INFO:teuthology.orchestra.run.smithi101.stdout:scsi_tmf_ 450 root cwd DIR 8,1 4096 2 / 2023-08-01T20:01:34.768 INFO:teuthology.orchestra.run.smithi101.stdout:scsi_tmf_ 450 root rtd DIR 8,1 4096 2 / 2023-08-01T20:01:34.768 INFO:teuthology.orchestra.run.smithi101.stdout:scsi_tmf_ 450 root txt unknown /proc/450/exe 2023-08-01T20:01:34.768 INFO:teuthology.orchestra.run.smithi101.stdout:scsi_eh_6 451 root cwd DIR 8,1 4096 2 / 2023-08-01T20:01:34.768 INFO:teuthology.orchestra.run.smithi101.stdout:scsi_eh_6 451 root rtd DIR 8,1 4096 2 / 2023-08-01T20:01:34.768 INFO:teuthology.orchestra.run.smithi101.stdout:scsi_eh_6 451 root txt unknown /proc/451/exe 2023-08-01T20:01:34.768 INFO:teuthology.orchestra.run.smithi101.stdout:scsi_tmf_ 452 root cwd DIR 8,1 4096 2 / 2023-08-01T20:01:34.768 INFO:teuthology.orchestra.run.smithi101.stdout:scsi_tmf_ 452 root rtd DIR 8,1 4096 2 / 2023-08-01T20:01:34.769 INFO:teuthology.orchestra.run.smithi101.stdout:scsi_tmf_ 452 root txt unknown /proc/452/exe 2023-08-01T20:01:34.769 INFO:teuthology.orchestra.run.smithi101.stdout:scsi_eh_7 453 root cwd DIR 8,1 4096 2 / 2023-08-01T20:01:34.769 INFO:teuthology.orchestra.run.smithi101.stdout:scsi_eh_7 453 root rtd DIR 8,1 4096 2 / 2023-08-01T20:01:34.769 INFO:teuthology.orchestra.run.smithi101.stdout:scsi_eh_7 453 root txt unknown /proc/453/exe 2023-08-01T20:01:34.769 INFO:teuthology.orchestra.run.smithi101.stdout:scsi_tmf_ 454 root cwd DIR 8,1 4096 2 / 2023-08-01T20:01:34.769 INFO:teuthology.orchestra.run.smithi101.stdout:scsi_tmf_ 454 root rtd DIR 8,1 4096 2 / 2023-08-01T20:01:34.769 INFO:teuthology.orchestra.run.smithi101.stdout:scsi_tmf_ 454 root txt unknown /proc/454/exe 2023-08-01T20:01:34.769 INFO:teuthology.orchestra.run.smithi101.stdout:scsi_eh_8 455 root cwd DIR 8,1 4096 2 / 2023-08-01T20:01:34.770 INFO:teuthology.orchestra.run.smithi101.stdout:scsi_eh_8 455 root rtd DIR 8,1 4096 2 / 2023-08-01T20:01:34.770 INFO:teuthology.orchestra.run.smithi101.stdout:scsi_eh_8 455 root txt unknown /proc/455/exe 2023-08-01T20:01:34.770 INFO:teuthology.orchestra.run.smithi101.stdout:scsi_tmf_ 456 root cwd DIR 8,1 4096 2 / 2023-08-01T20:01:34.770 INFO:teuthology.orchestra.run.smithi101.stdout:scsi_tmf_ 456 root rtd DIR 8,1 4096 2 / 2023-08-01T20:01:34.770 INFO:teuthology.orchestra.run.smithi101.stdout:scsi_tmf_ 456 root txt unknown /proc/456/exe 2023-08-01T20:01:34.770 INFO:teuthology.orchestra.run.smithi101.stdout:scsi_eh_9 457 root cwd DIR 8,1 4096 2 / 2023-08-01T20:01:34.770 INFO:teuthology.orchestra.run.smithi101.stdout:scsi_eh_9 457 root rtd DIR 8,1 4096 2 / 2023-08-01T20:01:34.770 INFO:teuthology.orchestra.run.smithi101.stdout:scsi_eh_9 457 root txt unknown /proc/457/exe 2023-08-01T20:01:34.771 INFO:teuthology.orchestra.run.smithi101.stdout:scsi_tmf_ 458 root cwd DIR 8,1 4096 2 / 2023-08-01T20:01:34.771 INFO:teuthology.orchestra.run.smithi101.stdout:scsi_tmf_ 458 root rtd DIR 8,1 4096 2 / 2023-08-01T20:01:34.771 INFO:teuthology.orchestra.run.smithi101.stdout:scsi_tmf_ 458 root txt unknown /proc/458/exe 2023-08-01T20:01:34.771 INFO:teuthology.orchestra.run.smithi101.stdout:kworker/u 459 root cwd DIR 8,1 4096 2 / 2023-08-01T20:01:34.771 INFO:teuthology.orchestra.run.smithi101.stdout:kworker/u 459 root rtd DIR 8,1 4096 2 / 2023-08-01T20:01:34.771 INFO:teuthology.orchestra.run.smithi101.stdout:kworker/u 459 root txt unknown /proc/459/exe 2023-08-01T20:01:34.771 INFO:teuthology.orchestra.run.smithi101.stdout:kworker/u 460 root cwd DIR 8,1 4096 2 / 2023-08-01T20:01:34.771 INFO:teuthology.orchestra.run.smithi101.stdout:kworker/u 460 root rtd DIR 8,1 4096 2 / 2023-08-01T20:01:34.772 INFO:teuthology.orchestra.run.smithi101.stdout:kworker/u 460 root txt unknown /proc/460/exe 2023-08-01T20:01:34.772 INFO:teuthology.orchestra.run.smithi101.stdout:kworker/u 461 root cwd DIR 8,1 4096 2 / 2023-08-01T20:01:34.772 INFO:teuthology.orchestra.run.smithi101.stdout:kworker/u 461 root rtd DIR 8,1 4096 2 / 2023-08-01T20:01:34.772 INFO:teuthology.orchestra.run.smithi101.stdout:kworker/u 461 root txt unknown /proc/461/exe 2023-08-01T20:01:34.772 INFO:teuthology.orchestra.run.smithi101.stdout:kworker/u 462 root cwd DIR 8,1 4096 2 / 2023-08-01T20:01:34.772 INFO:teuthology.orchestra.run.smithi101.stdout:kworker/u 462 root rtd DIR 8,1 4096 2 / 2023-08-01T20:01:34.772 INFO:teuthology.orchestra.run.smithi101.stdout:kworker/u 462 root txt unknown /proc/462/exe 2023-08-01T20:01:34.773 INFO:teuthology.orchestra.run.smithi101.stdout:jbd2/sda1 489 root cwd DIR 8,1 4096 2 / 2023-08-01T20:01:34.773 INFO:teuthology.orchestra.run.smithi101.stdout:jbd2/sda1 489 root rtd DIR 8,1 4096 2 / 2023-08-01T20:01:34.773 INFO:teuthology.orchestra.run.smithi101.stdout:jbd2/sda1 489 root txt unknown /proc/489/exe 2023-08-01T20:01:34.773 INFO:teuthology.orchestra.run.smithi101.stdout:ext4-rsv- 490 root cwd DIR 8,1 4096 2 / 2023-08-01T20:01:34.773 INFO:teuthology.orchestra.run.smithi101.stdout:ext4-rsv- 490 root rtd DIR 8,1 4096 2 / 2023-08-01T20:01:34.773 INFO:teuthology.orchestra.run.smithi101.stdout:ext4-rsv- 490 root txt unknown /proc/490/exe 2023-08-01T20:01:34.773 INFO:teuthology.orchestra.run.smithi101.stdout:kworker/3 520 root cwd DIR 8,1 4096 2 / 2023-08-01T20:01:34.773 INFO:teuthology.orchestra.run.smithi101.stdout:kworker/3 520 root rtd DIR 8,1 4096 2 / 2023-08-01T20:01:34.774 INFO:teuthology.orchestra.run.smithi101.stdout:kworker/3 520 root txt unknown /proc/520/exe 2023-08-01T20:01:34.774 INFO:teuthology.orchestra.run.smithi101.stdout:systemd-j 591 root cwd DIR 8,1 4096 2 / 2023-08-01T20:01:34.774 INFO:teuthology.orchestra.run.smithi101.stdout:systemd-j 591 root rtd DIR 8,1 4096 2 / 2023-08-01T20:01:34.774 INFO:teuthology.orchestra.run.smithi101.stdout:systemd-j 591 root txt REG 8,1 158104 35692 /usr/lib/systemd/systemd-journald 2023-08-01T20:01:34.774 INFO:teuthology.orchestra.run.smithi101.stdout:systemd-j 591 root mem REG 0,24 8388608 2129 /run/log/journal/a1b29d6c289747bdb22930598d39874a/system.journal 2023-08-01T20:01:34.774 INFO:teuthology.orchestra.run.smithi101.stdout:systemd-j 591 root mem REG 8,1 99640 24762 /usr/lib64/libz.so.1.2.11 2023-08-01T20:01:34.774 INFO:teuthology.orchestra.run.smithi101.stdout:systemd-j 591 root mem REG 8,1 1598840 24700 /usr/lib64/libm-2.28.so 2023-08-01T20:01:34.774 INFO:teuthology.orchestra.run.smithi101.stdout:systemd-j 591 root mem REG 8,1 658136 26787 /usr/lib64/libudev.so.1.6.11 2023-08-01T20:01:34.775 INFO:teuthology.orchestra.run.smithi101.stdout:systemd-j 591 root mem REG 8,1 735192 24831 /usr/lib64/libsepol.so.1 2023-08-01T20:01:34.775 INFO:teuthology.orchestra.run.smithi101.stdout:systemd-j 591 root mem REG 8,1 1805368 25103 /usr/lib64/libunistring.so.2.1.0 2023-08-01T20:01:34.775 INFO:teuthology.orchestra.run.smithi101.stdout:systemd-j 591 root mem REG 8,1 145984 24905 /usr/lib64/libgpg-error.so.0.24.2 2023-08-01T20:01:34.775 INFO:teuthology.orchestra.run.smithi101.stdout:systemd-j 591 root mem REG 8,1 66920 24972 /usr/lib64/libjson-c.so.4.0.0 2023-08-01T20:01:34.775 INFO:teuthology.orchestra.run.smithi101.stdout:systemd-j 591 root mem REG 8,1 3083608 26861 /usr/lib64/libcrypto.so.1.1.1k 2023-08-01T20:01:34.775 INFO:teuthology.orchestra.run.smithi101.stdout:systemd-j 591 root mem REG 8,1 615744 26862 /usr/lib64/libssl.so.1.1.1k 2023-08-01T20:01:34.775 INFO:teuthology.orchestra.run.smithi101.stdout:systemd-j 591 root mem REG 8,1 371232 26853 /usr/lib64/libdevmapper.so.1.02 2023-08-01T20:01:34.775 INFO:teuthology.orchestra.run.smithi101.stdout:systemd-j 591 root mem REG 8,1 33480 19526 /usr/lib64/libuuid.so.1.3.0 2023-08-01T20:01:34.776 INFO:teuthology.orchestra.run.smithi101.stdout:systemd-j 591 root mem REG 8,1 26704 24976 /usr/lib64/libattr.so.1.1.2448 2023-08-01T20:01:34.776 INFO:teuthology.orchestra.run.smithi101.stdout:systemd-j 591 root mem REG 8,1 19128 24699 /usr/lib64/libdl-2.28.so 2023-08-01T20:01:34.776 INFO:teuthology.orchestra.run.smithi101.stdout:systemd-j 591 root mem REG 8,1 543304 24651 /usr/lib64/libpcre2-8.so.0.7.1 2023-08-01T20:01:34.776 INFO:teuthology.orchestra.run.smithi101.stdout:systemd-j 591 root mem REG 8,1 371480 19864 /usr/lib64/libmount.so.1.1.0 2023-08-01T20:01:34.776 INFO:teuthology.orchestra.run.smithi101.stdout:systemd-j 591 root mem REG 8,1 343680 19531 /usr/lib64/libblkid.so.1.1.0 2023-08-01T20:01:34.776 INFO:teuthology.orchestra.run.smithi101.stdout:systemd-j 591 root mem REG 8,1 119760 25264 /usr/lib64/liblz4.so.1.8.3 2023-08-01T20:01:34.776 INFO:teuthology.orchestra.run.smithi101.stdout:systemd-j 591 root mem REG 8,1 162192 24774 /usr/lib64/liblzma.so.5.2.4 2023-08-01T20:01:34.776 INFO:teuthology.orchestra.run.smithi101.stdout:systemd-j 591 root mem REG 8,1 165624 25105 /usr/lib64/libidn2.so.0.3.6 2023-08-01T20:01:34.777 INFO:teuthology.orchestra.run.smithi101.stdout:systemd-j 591 root mem REG 8,1 128792 25521 /usr/lib64/libseccomp.so.2.5.2 2023-08-01T20:01:34.777 INFO:teuthology.orchestra.run.smithi101.stdout:systemd-j 591 root mem REG 8,1 1187312 25078 /usr/lib64/libgcrypt.so.20.2.5 2023-08-01T20:01:34.777 INFO:teuthology.orchestra.run.smithi101.stdout:systemd-j 591 root mem REG 8,1 526384 26885 /usr/lib64/libcryptsetup.so.12.6.0 2023-08-01T20:01:34.777 INFO:teuthology.orchestra.run.smithi101.stdout:systemd-j 591 root mem REG 8,1 59272 24978 /usr/lib64/libacl.so.1.1.2253 2023-08-01T20:01:34.777 INFO:teuthology.orchestra.run.smithi101.stdout:systemd-j 591 root mem REG 8,1 33752 24776 /usr/lib64/libcap.so.2.48 2023-08-01T20:01:34.777 INFO:teuthology.orchestra.run.smithi101.stdout:systemd-j 591 root mem REG 8,1 42744 24710 /usr/lib64/librt-2.28.so 2023-08-01T20:01:34.777 INFO:teuthology.orchestra.run.smithi101.stdout:systemd-j 591 root mem REG 8,1 2089984 24698 /usr/lib64/libc-2.28.so 2023-08-01T20:01:34.777 INFO:teuthology.orchestra.run.smithi101.stdout:systemd-j 591 root mem REG 8,1 149984 24708 /usr/lib64/libpthread-2.28.so 2023-08-01T20:01:34.778 INFO:teuthology.orchestra.run.smithi101.stdout:systemd-j 591 root mem REG 8,1 99672 31445 /usr/lib64/libgcc_s-8-20210514.so.1 2023-08-01T20:01:34.778 INFO:teuthology.orchestra.run.smithi101.stdout:systemd-j 591 root mem REG 8,1 172104 24654 /usr/lib64/libselinux.so.1 2023-08-01T20:01:34.778 INFO:teuthology.orchestra.run.smithi101.stdout:systemd-j 591 root mem REG 8,1 2761368 35660 /usr/lib/systemd/libsystemd-shared-239.so 2023-08-01T20:01:34.778 INFO:teuthology.orchestra.run.smithi101.stdout:systemd-j 591 root mem REG 8,1 1062168 24653 /usr/lib64/ld-2.28.so 2023-08-01T20:01:34.778 INFO:teuthology.orchestra.run.smithi101.stdout:systemd-j 591 root mem REG 0,24 8 2106 /run/systemd/journal/kernel-seqnum 2023-08-01T20:01:34.778 INFO:teuthology.orchestra.run.smithi101.stdout:systemd-j 591 root 0r CHR 1,3 0t0 3083 /dev/null 2023-08-01T20:01:34.778 INFO:teuthology.orchestra.run.smithi101.stdout:systemd-j 591 root 1w CHR 1,3 0t0 3083 /dev/null 2023-08-01T20:01:34.778 INFO:teuthology.orchestra.run.smithi101.stdout:systemd-j 591 root 2w CHR 1,3 0t0 3083 /dev/null 2023-08-01T20:01:34.779 INFO:teuthology.orchestra.run.smithi101.stdout:systemd-j 591 root 3u unix 0xffff93750c992d00 0t0 5504 /run/systemd/journal/stdout type=STREAM 2023-08-01T20:01:34.779 INFO:teuthology.orchestra.run.smithi101.stdout:systemd-j 591 root 4u unix 0xffff93750c995100 0t0 5507 /run/systemd/journal/socket type=DGRAM 2023-08-01T20:01:34.779 INFO:teuthology.orchestra.run.smithi101.stdout:systemd-j 591 root 5u unix 0xffff93750c984800 0t0 56 /run/systemd/journal/dev-log type=DGRAM 2023-08-01T20:01:34.779 INFO:teuthology.orchestra.run.smithi101.stdout:systemd-j 591 root 6u a_inode 0,14 0 15587 [eventpoll] 2023-08-01T20:01:34.779 INFO:teuthology.orchestra.run.smithi101.stdout:systemd-j 591 root 7u CHR 1,11 0t0 3089 /dev/kmsg 2023-08-01T20:01:34.779 INFO:teuthology.orchestra.run.smithi101.stdout:systemd-j 591 root 8r REG 0,5 0 2107 /proc/sys/kernel/hostname 2023-08-01T20:01:34.779 INFO:teuthology.orchestra.run.smithi101.stdout:systemd-j 591 root 9u a_inode 0,14 0 15587 [signalfd] 2023-08-01T20:01:34.780 INFO:teuthology.orchestra.run.smithi101.stdout:systemd-j 591 root 10u a_inode 0,14 0 15587 [signalfd] 2023-08-01T20:01:34.780 INFO:teuthology.orchestra.run.smithi101.stdout:systemd-j 591 root 11u a_inode 0,14 0 15587 [signalfd] 2023-08-01T20:01:34.780 INFO:teuthology.orchestra.run.smithi101.stdout:systemd-j 591 root 12u unix 0xffff93750c8c1200 0t0 19671 type=DGRAM 2023-08-01T20:01:34.780 INFO:teuthology.orchestra.run.smithi101.stdout:systemd-j 591 root 13u a_inode 0,14 0 15587 [timerfd] 2023-08-01T20:01:34.780 INFO:teuthology.orchestra.run.smithi101.stdout:systemd-j 591 root 14u REG 0,24 8388608 2129 /run/log/journal/a1b29d6c289747bdb22930598d39874a/system.journal 2023-08-01T20:01:34.780 INFO:teuthology.orchestra.run.smithi101.stdout:systemd-j 591 root 15u unix 0xffff937080483a80 0t0 659 /run/systemd/journal/stdout type=STREAM 2023-08-01T20:01:34.780 INFO:teuthology.orchestra.run.smithi101.stdout:systemd-j 591 root 16u unix 0xffff93750c921f80 0t0 18154 /run/systemd/journal/stdout type=STREAM 2023-08-01T20:01:34.780 INFO:teuthology.orchestra.run.smithi101.stdout:systemd-j 591 root 17u unix 0xffff93750c985100 0t0 22619 /run/systemd/journal/stdout type=STREAM 2023-08-01T20:01:34.781 INFO:teuthology.orchestra.run.smithi101.stdout:systemd-j 591 root 18u unix 0xffff9370586cd580 0t0 28977 /run/systemd/journal/stdout type=STREAM 2023-08-01T20:01:34.781 INFO:teuthology.orchestra.run.smithi101.stdout:systemd-j 591 root 19u unix 0xffff93750c992400 0t0 19978 /run/systemd/journal/stdout type=STREAM 2023-08-01T20:01:34.781 INFO:teuthology.orchestra.run.smithi101.stdout:systemd-j 591 root 20u unix 0xffff93750c981b00 0t0 19980 /run/systemd/journal/stdout type=STREAM 2023-08-01T20:01:34.781 INFO:teuthology.orchestra.run.smithi101.stdout:systemd-j 591 root 21u unix 0xffff93750d2bde80 0t0 22615 /run/systemd/journal/stdout type=STREAM 2023-08-01T20:01:34.781 INFO:teuthology.orchestra.run.smithi101.stdout:systemd-j 591 root 22u unix 0xffff93750d2be780 0t0 19982 /run/systemd/journal/stdout type=STREAM 2023-08-01T20:01:34.781 INFO:teuthology.orchestra.run.smithi101.stdout:systemd-j 591 root 23u unix 0xffff93750c982880 0t0 45060 /run/systemd/journal/stdout type=STREAM 2023-08-01T20:01:34.781 INFO:teuthology.orchestra.run.smithi101.stdout:systemd-j 591 root 25u unix 0xffff9370586cd100 0t0 29095 /run/systemd/journal/stdout type=STREAM 2023-08-01T20:01:34.781 INFO:teuthology.orchestra.run.smithi101.stdout:systemd-j 591 root 26u unix 0xffff9370586cf080 0t0 29096 /run/systemd/journal/stdout type=STREAM 2023-08-01T20:01:34.782 INFO:teuthology.orchestra.run.smithi101.stdout:systemd-j 591 root 28u unix 0xffff9370586ce300 0t0 4982 /run/systemd/journal/stdout type=STREAM 2023-08-01T20:01:34.782 INFO:teuthology.orchestra.run.smithi101.stdout:systemd-j 591 root 29u unix 0xffff93750c987080 0t0 4984 /run/systemd/journal/stdout type=STREAM 2023-08-01T20:01:34.782 INFO:teuthology.orchestra.run.smithi101.stdout:systemd-j 591 root 30u unix 0xffff93750c994380 0t0 4986 /run/systemd/journal/stdout type=STREAM 2023-08-01T20:01:34.782 INFO:teuthology.orchestra.run.smithi101.stdout:systemd-j 591 root 31u unix 0xffff937080485580 0t0 4988 /run/systemd/journal/stdout type=STREAM 2023-08-01T20:01:34.782 INFO:teuthology.orchestra.run.smithi101.stdout:systemd-j 591 root 34u unix 0xffff93750c990000 0t0 31757 /run/systemd/journal/stdout type=STREAM 2023-08-01T20:01:34.782 INFO:teuthology.orchestra.run.smithi101.stdout:ext4lazyi 608 root cwd DIR 8,1 4096 2 / 2023-08-01T20:01:34.782 INFO:teuthology.orchestra.run.smithi101.stdout:ext4lazyi 608 root rtd DIR 8,1 4096 2 / 2023-08-01T20:01:34.782 INFO:teuthology.orchestra.run.smithi101.stdout:ext4lazyi 608 root txt unknown /proc/608/exe 2023-08-01T20:01:34.783 INFO:teuthology.orchestra.run.smithi101.stdout:systemd-u 631 root cwd DIR 8,1 4096 2 / 2023-08-01T20:01:34.783 INFO:teuthology.orchestra.run.smithi101.stdout:systemd-u 631 root rtd DIR 8,1 4096 2 / 2023-08-01T20:01:34.783 INFO:teuthology.orchestra.run.smithi101.stdout:systemd-u 631 root txt REG 8,1 418336 35749 /usr/lib/systemd/systemd-udevd 2023-08-01T20:01:34.783 INFO:teuthology.orchestra.run.smithi101.stdout:systemd-u 631 root mem REG 8,1 54352 24707 /usr/lib64/libnss_files-2.28.so 2023-08-01T20:01:34.783 INFO:teuthology.orchestra.run.smithi101.stdout:systemd-u 631 root mem REG 8,1 594085 395724 /usr/lib/modules/4.18.0-500.el8.x86_64/modules.symbols.bin 2023-08-01T20:01:34.783 INFO:teuthology.orchestra.run.smithi101.stdout:systemd-u 631 root mem REG 8,1 894063 395721 /usr/lib/modules/4.18.0-500.el8.x86_64/modules.alias.bin 2023-08-01T20:01:34.783 INFO:teuthology.orchestra.run.smithi101.stdout:systemd-u 631 root mem REG 8,1 11120017 61455 /etc/udev/hwdb.bin 2023-08-01T20:01:34.783 INFO:teuthology.orchestra.run.smithi101.stdout:systemd-u 631 root mem REG 8,1 1598840 24700 /usr/lib64/libm-2.28.so 2023-08-01T20:01:34.784 INFO:teuthology.orchestra.run.smithi101.stdout:systemd-u 631 root mem REG 8,1 658136 26787 /usr/lib64/libudev.so.1.6.11 2023-08-01T20:01:34.784 INFO:teuthology.orchestra.run.smithi101.stdout:systemd-u 631 root mem REG 8,1 735192 24831 /usr/lib64/libsepol.so.1 2023-08-01T20:01:34.784 INFO:teuthology.orchestra.run.smithi101.stdout:systemd-u 631 root mem REG 8,1 1805368 25103 /usr/lib64/libunistring.so.2.1.0 2023-08-01T20:01:34.784 INFO:teuthology.orchestra.run.smithi101.stdout:systemd-u 631 root mem REG 8,1 543304 24651 /usr/lib64/libpcre2-8.so.0.7.1 2023-08-01T20:01:34.784 INFO:teuthology.orchestra.run.smithi101.stdout:systemd-u 631 root mem REG 8,1 19128 24699 /usr/lib64/libdl-2.28.so 2023-08-01T20:01:34.784 INFO:teuthology.orchestra.run.smithi101.stdout:systemd-u 631 root mem REG 8,1 145984 24905 /usr/lib64/libgpg-error.so.0.24.2 2023-08-01T20:01:34.784 INFO:teuthology.orchestra.run.smithi101.stdout:systemd-u 631 root mem REG 8,1 66920 24972 /usr/lib64/libjson-c.so.4.0.0 2023-08-01T20:01:34.785 INFO:teuthology.orchestra.run.smithi101.stdout:systemd-u 631 root mem REG 8,1 371232 26853 /usr/lib64/libdevmapper.so.1.02 2023-08-01T20:01:34.785 INFO:teuthology.orchestra.run.smithi101.stdout:systemd-u 631 root mem REG 8,1 33480 19526 /usr/lib64/libuuid.so.1.3.0 2023-08-01T20:01:34.785 INFO:teuthology.orchestra.run.smithi101.stdout:systemd-u 631 root mem REG 8,1 26704 24976 /usr/lib64/libattr.so.1.1.2448 2023-08-01T20:01:34.785 INFO:teuthology.orchestra.run.smithi101.stdout:systemd-u 631 root mem REG 8,1 3083608 26861 /usr/lib64/libcrypto.so.1.1.1k 2023-08-01T20:01:34.785 INFO:teuthology.orchestra.run.smithi101.stdout:systemd-u 631 root mem REG 8,1 615744 26862 /usr/lib64/libssl.so.1.1.1k 2023-08-01T20:01:34.785 INFO:teuthology.orchestra.run.smithi101.stdout:systemd-u 631 root mem REG 8,1 99640 24762 /usr/lib64/libz.so.1.2.11 2023-08-01T20:01:34.785 INFO:teuthology.orchestra.run.smithi101.stdout:systemd-u 631 root mem REG 8,1 371480 19864 /usr/lib64/libmount.so.1.1.0 2023-08-01T20:01:34.785 INFO:teuthology.orchestra.run.smithi101.stdout:systemd-u 631 root mem REG 8,1 119760 25264 /usr/lib64/liblz4.so.1.8.3 2023-08-01T20:01:34.786 INFO:teuthology.orchestra.run.smithi101.stdout:systemd-u 631 root mem REG 8,1 162192 24774 /usr/lib64/liblzma.so.5.2.4 2023-08-01T20:01:34.786 INFO:teuthology.orchestra.run.smithi101.stdout:systemd-u 631 root mem REG 8,1 165624 25105 /usr/lib64/libidn2.so.0.3.6 2023-08-01T20:01:34.786 INFO:teuthology.orchestra.run.smithi101.stdout:systemd-u 631 root mem REG 8,1 172104 24654 /usr/lib64/libselinux.so.1 2023-08-01T20:01:34.786 INFO:teuthology.orchestra.run.smithi101.stdout:systemd-u 631 root mem REG 8,1 128792 25521 /usr/lib64/libseccomp.so.2.5.2 2023-08-01T20:01:34.786 INFO:teuthology.orchestra.run.smithi101.stdout:systemd-u 631 root mem REG 8,1 1187312 25078 /usr/lib64/libgcrypt.so.20.2.5 2023-08-01T20:01:34.786 INFO:teuthology.orchestra.run.smithi101.stdout:systemd-u 631 root mem REG 8,1 526384 26885 /usr/lib64/libcryptsetup.so.12.6.0 2023-08-01T20:01:34.786 INFO:teuthology.orchestra.run.smithi101.stdout:systemd-u 631 root mem REG 8,1 33752 24776 /usr/lib64/libcap.so.2.48 2023-08-01T20:01:34.786 INFO:teuthology.orchestra.run.smithi101.stdout:systemd-u 631 root mem REG 8,1 42744 24710 /usr/lib64/librt-2.28.so 2023-08-01T20:01:34.787 INFO:teuthology.orchestra.run.smithi101.stdout:systemd-u 631 root mem REG 8,1 2089984 24698 /usr/lib64/libc-2.28.so 2023-08-01T20:01:34.787 INFO:teuthology.orchestra.run.smithi101.stdout:systemd-u 631 root mem REG 8,1 149984 24708 /usr/lib64/libpthread-2.28.so 2023-08-01T20:01:34.787 INFO:teuthology.orchestra.run.smithi101.stdout:systemd-u 631 root mem REG 8,1 99672 31445 /usr/lib64/libgcc_s-8-20210514.so.1 2023-08-01T20:01:34.787 INFO:teuthology.orchestra.run.smithi101.stdout:systemd-u 631 root mem REG 8,1 343680 19531 /usr/lib64/libblkid.so.1.1.0 2023-08-01T20:01:34.787 INFO:teuthology.orchestra.run.smithi101.stdout:systemd-u 631 root mem REG 8,1 59272 24978 /usr/lib64/libacl.so.1.1.2253 2023-08-01T20:01:34.787 INFO:teuthology.orchestra.run.smithi101.stdout:systemd-u 631 root mem REG 8,1 100200 26883 /usr/lib64/libkmod.so.2.3.3 2023-08-01T20:01:34.787 INFO:teuthology.orchestra.run.smithi101.stdout:systemd-u 631 root mem REG 8,1 2761368 35660 /usr/lib/systemd/libsystemd-shared-239.so 2023-08-01T20:01:34.787 INFO:teuthology.orchestra.run.smithi101.stdout:systemd-u 631 root mem REG 8,1 1062168 24653 /usr/lib64/ld-2.28.so 2023-08-01T20:01:34.788 INFO:teuthology.orchestra.run.smithi101.stdout:systemd-u 631 root mem REG 8,1 10158 395725 /usr/lib/modules/4.18.0-500.el8.x86_64/modules.builtin.bin 2023-08-01T20:01:34.788 INFO:teuthology.orchestra.run.smithi101.stdout:systemd-u 631 root mem REG 8,1 461225 395729 /usr/lib/modules/4.18.0-500.el8.x86_64/modules.dep.bin 2023-08-01T20:01:34.788 INFO:teuthology.orchestra.run.smithi101.stdout:systemd-u 631 root mem REG 8,1 579864 16755 /etc/selinux/targeted/contexts/files/file_contexts.bin 2023-08-01T20:01:34.788 INFO:teuthology.orchestra.run.smithi101.stdout:systemd-u 631 root mem REG 8,1 19983 16806 /etc/selinux/targeted/contexts/files/file_contexts.homedirs.bin 2023-08-01T20:01:34.788 INFO:teuthology.orchestra.run.smithi101.stdout:systemd-u 631 root 0r CHR 1,3 0t0 3083 /dev/null 2023-08-01T20:01:34.788 INFO:teuthology.orchestra.run.smithi101.stdout:systemd-u 631 root 1u unix 0xffff937080487080 0t0 20647 type=STREAM 2023-08-01T20:01:34.788 INFO:teuthology.orchestra.run.smithi101.stdout:systemd-u 631 root 2u unix 0xffff937080487080 0t0 20647 type=STREAM 2023-08-01T20:01:34.788 INFO:teuthology.orchestra.run.smithi101.stdout:systemd-u 631 root 3u unix 0xffff937080482400 0t0 20502 /run/udev/control type=SEQPACKET 2023-08-01T20:01:34.789 INFO:teuthology.orchestra.run.smithi101.stdout:systemd-u 631 root 4u netlink 0t0 20514 KOBJECT_UEVENT 2023-08-01T20:01:34.789 INFO:teuthology.orchestra.run.smithi101.stdout:systemd-u 631 root 5u unix 0xffff937080485100 0t0 20654 type=DGRAM 2023-08-01T20:01:34.789 INFO:teuthology.orchestra.run.smithi101.stdout:systemd-u 631 root 6r REG 8,1 11120017 61455 /etc/udev/hwdb.bin 2023-08-01T20:01:34.789 INFO:teuthology.orchestra.run.smithi101.stdout:systemd-u 631 root 7u unix 0xffff937080482d00 0t0 20660 type=DGRAM 2023-08-01T20:01:34.789 INFO:teuthology.orchestra.run.smithi101.stdout:systemd-u 631 root 8u unix 0xffff937080480000 0t0 20661 type=DGRAM 2023-08-01T20:01:34.789 INFO:teuthology.orchestra.run.smithi101.stdout:systemd-u 631 root 9r a_inode 0,14 0 15587 inotify 2023-08-01T20:01:34.789 INFO:teuthology.orchestra.run.smithi101.stdout:systemd-u 631 root 10u a_inode 0,14 0 15587 [eventpoll] 2023-08-01T20:01:34.789 INFO:teuthology.orchestra.run.smithi101.stdout:systemd-u 631 root 11u a_inode 0,14 0 15587 [signalfd] 2023-08-01T20:01:34.790 INFO:teuthology.orchestra.run.smithi101.stdout:systemd-u 631 root 12u a_inode 0,14 0 15587 [timerfd] 2023-08-01T20:01:34.790 INFO:teuthology.orchestra.run.smithi101.stdout:systemd-u 631 root 13u a_inode 0,14 0 15587 [timerfd] 2023-08-01T20:01:34.790 INFO:teuthology.orchestra.run.smithi101.stdout:ipmi-msgh 674 root cwd DIR 8,1 4096 2 / 2023-08-01T20:01:34.790 INFO:teuthology.orchestra.run.smithi101.stdout:ipmi-msgh 674 root rtd DIR 8,1 4096 2 / 2023-08-01T20:01:34.790 INFO:teuthology.orchestra.run.smithi101.stdout:ipmi-msgh 674 root txt unknown /proc/674/exe 2023-08-01T20:01:34.790 INFO:teuthology.orchestra.run.smithi101.stdout:kdmflush/ 704 root cwd DIR 8,1 4096 2 / 2023-08-01T20:01:34.790 INFO:teuthology.orchestra.run.smithi101.stdout:kdmflush/ 704 root rtd DIR 8,1 4096 2 / 2023-08-01T20:01:34.790 INFO:teuthology.orchestra.run.smithi101.stdout:kdmflush/ 704 root txt unknown /proc/704/exe 2023-08-01T20:01:34.791 INFO:teuthology.orchestra.run.smithi101.stdout:kdmflush/ 705 root cwd DIR 8,1 4096 2 / 2023-08-01T20:01:34.791 INFO:teuthology.orchestra.run.smithi101.stdout:kdmflush/ 705 root rtd DIR 8,1 4096 2 / 2023-08-01T20:01:34.791 INFO:teuthology.orchestra.run.smithi101.stdout:kdmflush/ 705 root txt unknown /proc/705/exe 2023-08-01T20:01:34.791 INFO:teuthology.orchestra.run.smithi101.stdout:kdmflush/ 706 root cwd DIR 8,1 4096 2 / 2023-08-01T20:01:34.791 INFO:teuthology.orchestra.run.smithi101.stdout:kdmflush/ 706 root rtd DIR 8,1 4096 2 / 2023-08-01T20:01:34.791 INFO:teuthology.orchestra.run.smithi101.stdout:kdmflush/ 706 root txt unknown /proc/706/exe 2023-08-01T20:01:34.791 INFO:teuthology.orchestra.run.smithi101.stdout:kdmflush/ 707 root cwd DIR 8,1 4096 2 / 2023-08-01T20:01:34.791 INFO:teuthology.orchestra.run.smithi101.stdout:kdmflush/ 707 root rtd DIR 8,1 4096 2 / 2023-08-01T20:01:34.792 INFO:teuthology.orchestra.run.smithi101.stdout:kdmflush/ 707 root txt unknown /proc/707/exe 2023-08-01T20:01:34.792 INFO:teuthology.orchestra.run.smithi101.stdout:kdmflush/ 708 root cwd DIR 8,1 4096 2 / 2023-08-01T20:01:34.792 INFO:teuthology.orchestra.run.smithi101.stdout:kdmflush/ 708 root rtd DIR 8,1 4096 2 / 2023-08-01T20:01:34.792 INFO:teuthology.orchestra.run.smithi101.stdout:kdmflush/ 708 root txt unknown /proc/708/exe 2023-08-01T20:01:34.792 INFO:teuthology.orchestra.run.smithi101.stdout:kipmi0 738 root cwd DIR 8,1 4096 2 / 2023-08-01T20:01:34.792 INFO:teuthology.orchestra.run.smithi101.stdout:kipmi0 738 root rtd DIR 8,1 4096 2 / 2023-08-01T20:01:34.792 INFO:teuthology.orchestra.run.smithi101.stdout:kipmi0 738 root txt unknown /proc/738/exe 2023-08-01T20:01:34.793 INFO:teuthology.orchestra.run.smithi101.stdout:rpcbind 742 rpc cwd DIR 8,1 4096 2 / 2023-08-01T20:01:34.793 INFO:teuthology.orchestra.run.smithi101.stdout:rpcbind 742 rpc rtd DIR 8,1 4096 2 / 2023-08-01T20:01:34.793 INFO:teuthology.orchestra.run.smithi101.stdout:rpcbind 742 rpc txt REG 8,1 63024 31898 /usr/bin/rpcbind 2023-08-01T20:01:34.793 INFO:teuthology.orchestra.run.smithi101.stdout:rpcbind 742 rpc mem REG 8,1 54352 24707 /usr/lib64/libnss_files-2.28.so 2023-08-01T20:01:34.793 INFO:teuthology.orchestra.run.smithi101.stdout:rpcbind 742 rpc mem REG 8,1 543304 24651 /usr/lib64/libpcre2-8.so.0.7.1 2023-08-01T20:01:34.793 INFO:teuthology.orchestra.run.smithi101.stdout:rpcbind 742 rpc mem REG 8,1 99640 24762 /usr/lib64/libz.so.1.2.11 2023-08-01T20:01:34.793 INFO:teuthology.orchestra.run.smithi101.stdout:rpcbind 742 rpc mem REG 8,1 145984 24905 /usr/lib64/libgpg-error.so.0.24.2 2023-08-01T20:01:34.793 INFO:teuthology.orchestra.run.smithi101.stdout:rpcbind 742 rpc mem REG 8,1 172104 24654 /usr/lib64/libselinux.so.1 2023-08-01T20:01:34.794 INFO:teuthology.orchestra.run.smithi101.stdout:rpcbind 742 rpc mem REG 8,1 33480 19526 /usr/lib64/libuuid.so.1.3.0 2023-08-01T20:01:34.794 INFO:teuthology.orchestra.run.smithi101.stdout:rpcbind 742 rpc mem REG 8,1 343680 19531 /usr/lib64/libblkid.so.1.1.0 2023-08-01T20:01:34.794 INFO:teuthology.orchestra.run.smithi101.stdout:rpcbind 742 rpc mem REG 8,1 92968 24709 /usr/lib64/libresolv-2.28.so 2023-08-01T20:01:34.794 INFO:teuthology.orchestra.run.smithi101.stdout:rpcbind 742 rpc mem REG 8,1 3083608 26861 /usr/lib64/libcrypto.so.1.1.1k 2023-08-01T20:01:34.794 INFO:teuthology.orchestra.run.smithi101.stdout:rpcbind 742 rpc mem REG 8,1 16192 25072 /usr/lib64/libkeyutils.so.1.6 2023-08-01T20:01:34.794 INFO:teuthology.orchestra.run.smithi101.stdout:rpcbind 742 rpc mem REG 8,1 19128 24699 /usr/lib64/libdl-2.28.so 2023-08-01T20:01:34.794 INFO:teuthology.orchestra.run.smithi101.stdout:rpcbind 742 rpc mem REG 8,1 71472 26580 /usr/lib64/libkrb5support.so.0.1 2023-08-01T20:01:34.794 INFO:teuthology.orchestra.run.smithi101.stdout:rpcbind 742 rpc mem REG 8,1 99672 31445 /usr/lib64/libgcc_s-8-20210514.so.1 2023-08-01T20:01:34.795 INFO:teuthology.orchestra.run.smithi101.stdout:rpcbind 742 rpc mem REG 8,1 1187312 25078 /usr/lib64/libgcrypt.so.20.2.5 2023-08-01T20:01:34.795 INFO:teuthology.orchestra.run.smithi101.stdout:rpcbind 742 rpc mem REG 8,1 371480 19864 /usr/lib64/libmount.so.1.1.0 2023-08-01T20:01:34.795 INFO:teuthology.orchestra.run.smithi101.stdout:rpcbind 742 rpc mem REG 8,1 33752 24776 /usr/lib64/libcap.so.2.48 2023-08-01T20:01:34.795 INFO:teuthology.orchestra.run.smithi101.stdout:rpcbind 742 rpc mem REG 8,1 119760 25264 /usr/lib64/liblz4.so.1.8.3 2023-08-01T20:01:34.795 INFO:teuthology.orchestra.run.smithi101.stdout:rpcbind 742 rpc mem REG 8,1 162192 24774 /usr/lib64/liblzma.so.5.2.4 2023-08-01T20:01:34.795 INFO:teuthology.orchestra.run.smithi101.stdout:rpcbind 742 rpc mem REG 8,1 42744 24710 /usr/lib64/librt-2.28.so 2023-08-01T20:01:34.795 INFO:teuthology.orchestra.run.smithi101.stdout:rpcbind 742 rpc mem REG 8,1 16792 24764 /usr/lib64/libcom_err.so.2.1 2023-08-01T20:01:34.795 INFO:teuthology.orchestra.run.smithi101.stdout:rpcbind 742 rpc mem REG 8,1 96288 26574 /usr/lib64/libk5crypto.so.3.1 2023-08-01T20:01:34.796 INFO:teuthology.orchestra.run.smithi101.stdout:rpcbind 742 rpc mem REG 8,1 971432 26579 /usr/lib64/libkrb5.so.3.3 2023-08-01T20:01:34.796 INFO:teuthology.orchestra.run.smithi101.stdout:rpcbind 742 rpc mem REG 8,1 355968 26571 /usr/lib64/libgssapi_krb5.so.2.2 2023-08-01T20:01:34.796 INFO:teuthology.orchestra.run.smithi101.stdout:rpcbind 742 rpc mem REG 8,1 2089984 24698 /usr/lib64/libc-2.28.so 2023-08-01T20:01:34.796 INFO:teuthology.orchestra.run.smithi101.stdout:rpcbind 742 rpc mem REG 8,1 149984 24708 /usr/lib64/libpthread-2.28.so 2023-08-01T20:01:34.796 INFO:teuthology.orchestra.run.smithi101.stdout:rpcbind 742 rpc mem REG 8,1 1387784 26786 /usr/lib64/libsystemd.so.0.23.0 2023-08-01T20:01:34.796 INFO:teuthology.orchestra.run.smithi101.stdout:rpcbind 742 rpc mem REG 8,1 217696 26588 /usr/lib64/libtirpc.so.3.0.0 2023-08-01T20:01:34.796 INFO:teuthology.orchestra.run.smithi101.stdout:rpcbind 742 rpc mem REG 8,1 1062168 24653 /usr/lib64/ld-2.28.so 2023-08-01T20:01:34.796 INFO:teuthology.orchestra.run.smithi101.stdout:rpcbind 742 rpc 0r CHR 1,3 0t0 3083 /dev/null 2023-08-01T20:01:34.797 INFO:teuthology.orchestra.run.smithi101.stdout:rpcbind 742 rpc 1u unix 0xffff93750c920480 0t0 2010 type=STREAM 2023-08-01T20:01:34.797 INFO:teuthology.orchestra.run.smithi101.stdout:rpcbind 742 rpc 2u unix 0xffff93750c920480 0t0 2010 type=STREAM 2023-08-01T20:01:34.797 INFO:teuthology.orchestra.run.smithi101.stdout:rpcbind 742 rpc 3u unix 0xffff937080486300 0t0 20496 /run/rpcbind.sock type=STREAM 2023-08-01T20:01:34.797 INFO:teuthology.orchestra.run.smithi101.stdout:rpcbind 742 rpc 4u IPv4 20498 0t0 TCP *:sunrpc (LISTEN) 2023-08-01T20:01:34.797 INFO:teuthology.orchestra.run.smithi101.stdout:rpcbind 742 rpc 5u IPv4 20499 0t0 UDP *:sunrpc 2023-08-01T20:01:34.797 INFO:teuthology.orchestra.run.smithi101.stdout:rpcbind 742 rpc 6u IPv6 20500 0t0 TCP *:sunrpc (LISTEN) 2023-08-01T20:01:34.797 INFO:teuthology.orchestra.run.smithi101.stdout:rpcbind 742 rpc 7u IPv6 20501 0t0 UDP *:sunrpc 2023-08-01T20:01:34.797 INFO:teuthology.orchestra.run.smithi101.stdout:rpcbind 742 rpc 8rW REG 0,24 0 22544 /run/rpcbind/rpcbind.lock 2023-08-01T20:01:34.798 INFO:teuthology.orchestra.run.smithi101.stdout:xfsalloc 746 root cwd DIR 8,1 4096 2 / 2023-08-01T20:01:34.798 INFO:teuthology.orchestra.run.smithi101.stdout:xfsalloc 746 root rtd DIR 8,1 4096 2 / 2023-08-01T20:01:34.798 INFO:teuthology.orchestra.run.smithi101.stdout:xfsalloc 746 root txt unknown /proc/746/exe 2023-08-01T20:01:34.798 INFO:teuthology.orchestra.run.smithi101.stdout:xfs_mru_c 747 root cwd DIR 8,1 4096 2 / 2023-08-01T20:01:34.798 INFO:teuthology.orchestra.run.smithi101.stdout:xfs_mru_c 747 root rtd DIR 8,1 4096 2 / 2023-08-01T20:01:34.798 INFO:teuthology.orchestra.run.smithi101.stdout:xfs_mru_c 747 root txt unknown /proc/747/exe 2023-08-01T20:01:34.798 INFO:teuthology.orchestra.run.smithi101.stdout:xfs-buf/d 748 root cwd DIR 8,1 4096 2 / 2023-08-01T20:01:34.798 INFO:teuthology.orchestra.run.smithi101.stdout:xfs-buf/d 748 root rtd DIR 8,1 4096 2 / 2023-08-01T20:01:34.799 INFO:teuthology.orchestra.run.smithi101.stdout:xfs-buf/d 748 root txt unknown /proc/748/exe 2023-08-01T20:01:34.799 INFO:teuthology.orchestra.run.smithi101.stdout:xfs-conv/ 749 root cwd DIR 8,1 4096 2 / 2023-08-01T20:01:34.799 INFO:teuthology.orchestra.run.smithi101.stdout:xfs-conv/ 749 root rtd DIR 8,1 4096 2 / 2023-08-01T20:01:34.799 INFO:teuthology.orchestra.run.smithi101.stdout:xfs-conv/ 749 root txt unknown /proc/749/exe 2023-08-01T20:01:34.799 INFO:teuthology.orchestra.run.smithi101.stdout:xfs-cil/d 750 root cwd DIR 8,1 4096 2 / 2023-08-01T20:01:34.799 INFO:teuthology.orchestra.run.smithi101.stdout:xfs-cil/d 750 root rtd DIR 8,1 4096 2 / 2023-08-01T20:01:34.799 INFO:teuthology.orchestra.run.smithi101.stdout:xfs-cil/d 750 root txt unknown /proc/750/exe 2023-08-01T20:01:34.800 INFO:teuthology.orchestra.run.smithi101.stdout:xfs-recla 751 root cwd DIR 8,1 4096 2 / 2023-08-01T20:01:34.800 INFO:teuthology.orchestra.run.smithi101.stdout:xfs-recla 751 root rtd DIR 8,1 4096 2 / 2023-08-01T20:01:34.800 INFO:teuthology.orchestra.run.smithi101.stdout:xfs-recla 751 root txt unknown /proc/751/exe 2023-08-01T20:01:34.800 INFO:teuthology.orchestra.run.smithi101.stdout:xfs-gc/dm 752 root cwd DIR 8,1 4096 2 / 2023-08-01T20:01:34.800 INFO:teuthology.orchestra.run.smithi101.stdout:xfs-gc/dm 752 root rtd DIR 8,1 4096 2 / 2023-08-01T20:01:34.800 INFO:teuthology.orchestra.run.smithi101.stdout:xfs-gc/dm 752 root txt unknown /proc/752/exe 2023-08-01T20:01:34.800 INFO:teuthology.orchestra.run.smithi101.stdout:auditd 753 root cwd DIR 8,1 4096 2 / 2023-08-01T20:01:34.800 INFO:teuthology.orchestra.run.smithi101.stdout:auditd 753 root rtd DIR 8,1 4096 2 / 2023-08-01T20:01:34.801 INFO:teuthology.orchestra.run.smithi101.stdout:auditd 753 root txt REG 8,1 159568 28487 /usr/sbin/auditd 2023-08-01T20:01:34.801 INFO:teuthology.orchestra.run.smithi101.stdout:auditd 753 root mem REG 8,1 54352 24707 /usr/lib64/libnss_files-2.28.so 2023-08-01T20:01:34.801 INFO:teuthology.orchestra.run.smithi101.stdout:auditd 753 root mem REG 8,1 543304 24651 /usr/lib64/libpcre2-8.so.0.7.1 2023-08-01T20:01:34.801 INFO:teuthology.orchestra.run.smithi101.stdout:auditd 753 root mem REG 8,1 99640 24762 /usr/lib64/libz.so.1.2.11 2023-08-01T20:01:34.801 INFO:teuthology.orchestra.run.smithi101.stdout:auditd 753 root mem REG 8,1 172104 24654 /usr/lib64/libselinux.so.1 2023-08-01T20:01:34.801 INFO:teuthology.orchestra.run.smithi101.stdout:auditd 753 root mem REG 8,1 92968 24709 /usr/lib64/libresolv-2.28.so 2023-08-01T20:01:34.801 INFO:teuthology.orchestra.run.smithi101.stdout:auditd 753 root mem REG 8,1 3083608 26861 /usr/lib64/libcrypto.so.1.1.1k 2023-08-01T20:01:34.801 INFO:teuthology.orchestra.run.smithi101.stdout:auditd 753 root mem REG 8,1 16192 25072 /usr/lib64/libkeyutils.so.1.6 2023-08-01T20:01:34.802 INFO:teuthology.orchestra.run.smithi101.stdout:auditd 753 root mem REG 8,1 19128 24699 /usr/lib64/libdl-2.28.so 2023-08-01T20:01:34.802 INFO:teuthology.orchestra.run.smithi101.stdout:auditd 753 root mem REG 8,1 71472 26580 /usr/lib64/libkrb5support.so.0.1 2023-08-01T20:01:34.802 INFO:teuthology.orchestra.run.smithi101.stdout:auditd 753 root mem REG 8,1 16792 24764 /usr/lib64/libcom_err.so.2.1 2023-08-01T20:01:34.802 INFO:teuthology.orchestra.run.smithi101.stdout:auditd 753 root mem REG 8,1 96288 26574 /usr/lib64/libk5crypto.so.3.1 2023-08-01T20:01:34.802 INFO:teuthology.orchestra.run.smithi101.stdout:auditd 753 root mem REG 8,1 2089984 24698 /usr/lib64/libc-2.28.so 2023-08-01T20:01:34.802 INFO:teuthology.orchestra.run.smithi101.stdout:auditd 753 root mem REG 8,1 971432 26579 /usr/lib64/libkrb5.so.3.3 2023-08-01T20:01:34.802 INFO:teuthology.orchestra.run.smithi101.stdout:auditd 753 root mem REG 8,1 355968 26571 /usr/lib64/libgssapi_krb5.so.2.2 2023-08-01T20:01:34.802 INFO:teuthology.orchestra.run.smithi101.stdout:auditd 753 root mem REG 8,1 1598840 24700 /usr/lib64/libm-2.28.so 2023-08-01T20:01:34.803 INFO:teuthology.orchestra.run.smithi101.stdout:auditd 753 root mem REG 8,1 149984 24708 /usr/lib64/libpthread-2.28.so 2023-08-01T20:01:34.803 INFO:teuthology.orchestra.run.smithi101.stdout:auditd 753 root mem REG 8,1 24928 25065 /usr/lib64/libcap-ng.so.0.0.0 2023-08-01T20:01:34.803 INFO:teuthology.orchestra.run.smithi101.stdout:auditd 753 root mem REG 8,1 145408 24771 /usr/lib64/libauparse.so.0.0.0 2023-08-01T20:01:34.803 INFO:teuthology.orchestra.run.smithi101.stdout:auditd 753 root mem REG 8,1 135784 24768 /usr/lib64/libaudit.so.1.0.0 2023-08-01T20:01:34.803 INFO:teuthology.orchestra.run.smithi101.stdout:auditd 753 root mem REG 8,1 1062168 24653 /usr/lib64/ld-2.28.so 2023-08-01T20:01:34.803 INFO:teuthology.orchestra.run.smithi101.stdout:auditd 753 root 0u CHR 1,3 0t0 3083 /dev/null 2023-08-01T20:01:34.803 INFO:teuthology.orchestra.run.smithi101.stdout:auditd 753 root 1u CHR 1,3 0t0 3083 /dev/null 2023-08-01T20:01:34.803 INFO:teuthology.orchestra.run.smithi101.stdout:auditd 753 root 2u CHR 1,3 0t0 3083 /dev/null 2023-08-01T20:01:34.804 INFO:teuthology.orchestra.run.smithi101.stdout:auditd 753 root 3u netlink 0t0 4865 AUDIT 2023-08-01T20:01:34.804 INFO:teuthology.orchestra.run.smithi101.stdout:auditd 753 root 5w REG 8,1 5715110 61461 /var/log/audit/audit.log 2023-08-01T20:01:34.804 INFO:teuthology.orchestra.run.smithi101.stdout:auditd 753 root 6u unix 0xffff93750c954800 0t0 4869 type=DGRAM 2023-08-01T20:01:34.804 INFO:teuthology.orchestra.run.smithi101.stdout:auditd 753 root 7u unix 0xffff93750c956c00 0t0 4868 type=STREAM 2023-08-01T20:01:34.804 INFO:teuthology.orchestra.run.smithi101.stdout:auditd 753 root 8u unix 0xffff93750c951200 0t0 4870 type=STREAM 2023-08-01T20:01:34.804 INFO:teuthology.orchestra.run.smithi101.stdout:auditd 753 root 9u unix 0xffff93750c950900 0t0 4871 type=STREAM 2023-08-01T20:01:34.804 INFO:teuthology.orchestra.run.smithi101.stdout:auditd 753 root 10u a_inode 0,14 0 15587 [eventfd] 2023-08-01T20:01:34.804 INFO:teuthology.orchestra.run.smithi101.stdout:auditd 753 755 auditd root cwd DIR 8,1 4096 2 / 2023-08-01T20:01:34.805 INFO:teuthology.orchestra.run.smithi101.stdout:auditd 753 755 auditd root rtd DIR 8,1 4096 2 / 2023-08-01T20:01:34.805 INFO:teuthology.orchestra.run.smithi101.stdout:auditd 753 755 auditd root txt REG 8,1 159568 28487 /usr/sbin/auditd 2023-08-01T20:01:34.805 INFO:teuthology.orchestra.run.smithi101.stdout:auditd 753 755 auditd root mem REG 8,1 54352 24707 /usr/lib64/libnss_files-2.28.so 2023-08-01T20:01:34.805 INFO:teuthology.orchestra.run.smithi101.stdout:auditd 753 755 auditd root mem REG 8,1 543304 24651 /usr/lib64/libpcre2-8.so.0.7.1 2023-08-01T20:01:34.805 INFO:teuthology.orchestra.run.smithi101.stdout:auditd 753 755 auditd root mem REG 8,1 99640 24762 /usr/lib64/libz.so.1.2.11 2023-08-01T20:01:34.805 INFO:teuthology.orchestra.run.smithi101.stdout:auditd 753 755 auditd root mem REG 8,1 172104 24654 /usr/lib64/libselinux.so.1 2023-08-01T20:01:34.805 INFO:teuthology.orchestra.run.smithi101.stdout:auditd 753 755 auditd root mem REG 8,1 92968 24709 /usr/lib64/libresolv-2.28.so 2023-08-01T20:01:34.806 INFO:teuthology.orchestra.run.smithi101.stdout:auditd 753 755 auditd root mem REG 8,1 3083608 26861 /usr/lib64/libcrypto.so.1.1.1k 2023-08-01T20:01:34.806 INFO:teuthology.orchestra.run.smithi101.stdout:auditd 753 755 auditd root mem REG 8,1 16192 25072 /usr/lib64/libkeyutils.so.1.6 2023-08-01T20:01:34.806 INFO:teuthology.orchestra.run.smithi101.stdout:auditd 753 755 auditd root mem REG 8,1 19128 24699 /usr/lib64/libdl-2.28.so 2023-08-01T20:01:34.806 INFO:teuthology.orchestra.run.smithi101.stdout:auditd 753 755 auditd root mem REG 8,1 71472 26580 /usr/lib64/libkrb5support.so.0.1 2023-08-01T20:01:34.806 INFO:teuthology.orchestra.run.smithi101.stdout:auditd 753 755 auditd root mem REG 8,1 16792 24764 /usr/lib64/libcom_err.so.2.1 2023-08-01T20:01:34.806 INFO:teuthology.orchestra.run.smithi101.stdout:auditd 753 755 auditd root mem REG 8,1 96288 26574 /usr/lib64/libk5crypto.so.3.1 2023-08-01T20:01:34.806 INFO:teuthology.orchestra.run.smithi101.stdout:auditd 753 755 auditd root mem REG 8,1 2089984 24698 /usr/lib64/libc-2.28.so 2023-08-01T20:01:34.806 INFO:teuthology.orchestra.run.smithi101.stdout:auditd 753 755 auditd root mem REG 8,1 971432 26579 /usr/lib64/libkrb5.so.3.3 2023-08-01T20:01:34.807 INFO:teuthology.orchestra.run.smithi101.stdout:auditd 753 755 auditd root mem REG 8,1 355968 26571 /usr/lib64/libgssapi_krb5.so.2.2 2023-08-01T20:01:34.807 INFO:teuthology.orchestra.run.smithi101.stdout:auditd 753 755 auditd root mem REG 8,1 1598840 24700 /usr/lib64/libm-2.28.so 2023-08-01T20:01:34.807 INFO:teuthology.orchestra.run.smithi101.stdout:auditd 753 755 auditd root mem REG 8,1 149984 24708 /usr/lib64/libpthread-2.28.so 2023-08-01T20:01:34.807 INFO:teuthology.orchestra.run.smithi101.stdout:auditd 753 755 auditd root mem REG 8,1 24928 25065 /usr/lib64/libcap-ng.so.0.0.0 2023-08-01T20:01:34.807 INFO:teuthology.orchestra.run.smithi101.stdout:auditd 753 755 auditd root mem REG 8,1 145408 24771 /usr/lib64/libauparse.so.0.0.0 2023-08-01T20:01:34.807 INFO:teuthology.orchestra.run.smithi101.stdout:auditd 753 755 auditd root mem REG 8,1 135784 24768 /usr/lib64/libaudit.so.1.0.0 2023-08-01T20:01:34.807 INFO:teuthology.orchestra.run.smithi101.stdout:auditd 753 755 auditd root mem REG 8,1 1062168 24653 /usr/lib64/ld-2.28.so 2023-08-01T20:01:34.807 INFO:teuthology.orchestra.run.smithi101.stdout:auditd 753 755 auditd root 0u CHR 1,3 0t0 3083 /dev/null 2023-08-01T20:01:34.808 INFO:teuthology.orchestra.run.smithi101.stdout:auditd 753 755 auditd root 1u CHR 1,3 0t0 3083 /dev/null 2023-08-01T20:01:34.808 INFO:teuthology.orchestra.run.smithi101.stdout:auditd 753 755 auditd root 2u CHR 1,3 0t0 3083 /dev/null 2023-08-01T20:01:34.808 INFO:teuthology.orchestra.run.smithi101.stdout:auditd 753 755 auditd root 3u netlink 0t0 4865 AUDIT 2023-08-01T20:01:34.808 INFO:teuthology.orchestra.run.smithi101.stdout:auditd 753 755 auditd root 5w REG 8,1 5715110 61461 /var/log/audit/audit.log 2023-08-01T20:01:34.808 INFO:teuthology.orchestra.run.smithi101.stdout:auditd 753 755 auditd root 6u unix 0xffff93750c954800 0t0 4869 type=DGRAM 2023-08-01T20:01:34.808 INFO:teuthology.orchestra.run.smithi101.stdout:auditd 753 755 auditd root 7u unix 0xffff93750c956c00 0t0 4868 type=STREAM 2023-08-01T20:01:34.808 INFO:teuthology.orchestra.run.smithi101.stdout:auditd 753 755 auditd root 8u unix 0xffff93750c951200 0t0 4870 type=STREAM 2023-08-01T20:01:34.808 INFO:teuthology.orchestra.run.smithi101.stdout:auditd 753 755 auditd root 9u unix 0xffff93750c950900 0t0 4871 type=STREAM 2023-08-01T20:01:34.809 INFO:teuthology.orchestra.run.smithi101.stdout:auditd 753 755 auditd root 10u a_inode 0,14 0 15587 [eventfd] 2023-08-01T20:01:34.809 INFO:teuthology.orchestra.run.smithi101.stdout:auditd 753 760 auditd root cwd DIR 8,1 4096 2 / 2023-08-01T20:01:34.809 INFO:teuthology.orchestra.run.smithi101.stdout:auditd 753 760 auditd root rtd DIR 8,1 4096 2 / 2023-08-01T20:01:34.809 INFO:teuthology.orchestra.run.smithi101.stdout:auditd 753 760 auditd root txt REG 8,1 159568 28487 /usr/sbin/auditd 2023-08-01T20:01:34.809 INFO:teuthology.orchestra.run.smithi101.stdout:auditd 753 760 auditd root mem REG 8,1 54352 24707 /usr/lib64/libnss_files-2.28.so 2023-08-01T20:01:34.809 INFO:teuthology.orchestra.run.smithi101.stdout:auditd 753 760 auditd root mem REG 8,1 543304 24651 /usr/lib64/libpcre2-8.so.0.7.1 2023-08-01T20:01:34.809 INFO:teuthology.orchestra.run.smithi101.stdout:auditd 753 760 auditd root mem REG 8,1 99640 24762 /usr/lib64/libz.so.1.2.11 2023-08-01T20:01:34.809 INFO:teuthology.orchestra.run.smithi101.stdout:auditd 753 760 auditd root mem REG 8,1 172104 24654 /usr/lib64/libselinux.so.1 2023-08-01T20:01:34.810 INFO:teuthology.orchestra.run.smithi101.stdout:auditd 753 760 auditd root mem REG 8,1 92968 24709 /usr/lib64/libresolv-2.28.so 2023-08-01T20:01:34.810 INFO:teuthology.orchestra.run.smithi101.stdout:auditd 753 760 auditd root mem REG 8,1 3083608 26861 /usr/lib64/libcrypto.so.1.1.1k 2023-08-01T20:01:34.810 INFO:teuthology.orchestra.run.smithi101.stdout:auditd 753 760 auditd root mem REG 8,1 16192 25072 /usr/lib64/libkeyutils.so.1.6 2023-08-01T20:01:34.810 INFO:teuthology.orchestra.run.smithi101.stdout:auditd 753 760 auditd root mem REG 8,1 19128 24699 /usr/lib64/libdl-2.28.so 2023-08-01T20:01:34.810 INFO:teuthology.orchestra.run.smithi101.stdout:auditd 753 760 auditd root mem REG 8,1 71472 26580 /usr/lib64/libkrb5support.so.0.1 2023-08-01T20:01:34.810 INFO:teuthology.orchestra.run.smithi101.stdout:auditd 753 760 auditd root mem REG 8,1 16792 24764 /usr/lib64/libcom_err.so.2.1 2023-08-01T20:01:34.810 INFO:teuthology.orchestra.run.smithi101.stdout:auditd 753 760 auditd root mem REG 8,1 96288 26574 /usr/lib64/libk5crypto.so.3.1 2023-08-01T20:01:34.810 INFO:teuthology.orchestra.run.smithi101.stdout:auditd 753 760 auditd root mem REG 8,1 2089984 24698 /usr/lib64/libc-2.28.so 2023-08-01T20:01:34.811 INFO:teuthology.orchestra.run.smithi101.stdout:auditd 753 760 auditd root mem REG 8,1 971432 26579 /usr/lib64/libkrb5.so.3.3 2023-08-01T20:01:34.811 INFO:teuthology.orchestra.run.smithi101.stdout:auditd 753 760 auditd root mem REG 8,1 355968 26571 /usr/lib64/libgssapi_krb5.so.2.2 2023-08-01T20:01:34.811 INFO:teuthology.orchestra.run.smithi101.stdout:auditd 753 760 auditd root mem REG 8,1 1598840 24700 /usr/lib64/libm-2.28.so 2023-08-01T20:01:34.811 INFO:teuthology.orchestra.run.smithi101.stdout:auditd 753 760 auditd root mem REG 8,1 149984 24708 /usr/lib64/libpthread-2.28.so 2023-08-01T20:01:34.811 INFO:teuthology.orchestra.run.smithi101.stdout:auditd 753 760 auditd root mem REG 8,1 24928 25065 /usr/lib64/libcap-ng.so.0.0.0 2023-08-01T20:01:34.811 INFO:teuthology.orchestra.run.smithi101.stdout:auditd 753 760 auditd root mem REG 8,1 145408 24771 /usr/lib64/libauparse.so.0.0.0 2023-08-01T20:01:34.811 INFO:teuthology.orchestra.run.smithi101.stdout:auditd 753 760 auditd root mem REG 8,1 135784 24768 /usr/lib64/libaudit.so.1.0.0 2023-08-01T20:01:34.811 INFO:teuthology.orchestra.run.smithi101.stdout:auditd 753 760 auditd root mem REG 8,1 1062168 24653 /usr/lib64/ld-2.28.so 2023-08-01T20:01:34.812 INFO:teuthology.orchestra.run.smithi101.stdout:auditd 753 760 auditd root 0u CHR 1,3 0t0 3083 /dev/null 2023-08-01T20:01:34.812 INFO:teuthology.orchestra.run.smithi101.stdout:auditd 753 760 auditd root 1u CHR 1,3 0t0 3083 /dev/null 2023-08-01T20:01:34.812 INFO:teuthology.orchestra.run.smithi101.stdout:auditd 753 760 auditd root 2u CHR 1,3 0t0 3083 /dev/null 2023-08-01T20:01:34.812 INFO:teuthology.orchestra.run.smithi101.stdout:auditd 753 760 auditd root 3u netlink 0t0 4865 AUDIT 2023-08-01T20:01:34.812 INFO:teuthology.orchestra.run.smithi101.stdout:auditd 753 760 auditd root 5w REG 8,1 5715110 61461 /var/log/audit/audit.log 2023-08-01T20:01:34.812 INFO:teuthology.orchestra.run.smithi101.stdout:auditd 753 760 auditd root 6u unix 0xffff93750c954800 0t0 4869 type=DGRAM 2023-08-01T20:01:34.812 INFO:teuthology.orchestra.run.smithi101.stdout:auditd 753 760 auditd root 7u unix 0xffff93750c956c00 0t0 4868 type=STREAM 2023-08-01T20:01:34.813 INFO:teuthology.orchestra.run.smithi101.stdout:auditd 753 760 auditd root 8u unix 0xffff93750c951200 0t0 4870 type=STREAM 2023-08-01T20:01:34.813 INFO:teuthology.orchestra.run.smithi101.stdout:auditd 753 760 auditd root 9u unix 0xffff93750c950900 0t0 4871 type=STREAM 2023-08-01T20:01:34.813 INFO:teuthology.orchestra.run.smithi101.stdout:auditd 753 760 auditd root 10u a_inode 0,14 0 15587 [eventfd] 2023-08-01T20:01:34.813 INFO:teuthology.orchestra.run.smithi101.stdout:xfs-log/d 754 root cwd DIR 8,1 4096 2 / 2023-08-01T20:01:34.813 INFO:teuthology.orchestra.run.smithi101.stdout:xfs-log/d 754 root rtd DIR 8,1 4096 2 / 2023-08-01T20:01:34.813 INFO:teuthology.orchestra.run.smithi101.stdout:xfs-log/d 754 root txt unknown /proc/754/exe 2023-08-01T20:01:34.813 INFO:teuthology.orchestra.run.smithi101.stdout:xfsaild/d 756 root cwd DIR 8,1 4096 2 / 2023-08-01T20:01:34.813 INFO:teuthology.orchestra.run.smithi101.stdout:xfsaild/d 756 root rtd DIR 8,1 4096 2 / 2023-08-01T20:01:34.814 INFO:teuthology.orchestra.run.smithi101.stdout:xfsaild/d 756 root txt unknown /proc/756/exe 2023-08-01T20:01:34.814 INFO:teuthology.orchestra.run.smithi101.stdout:rpciod 757 root cwd DIR 8,1 4096 2 / 2023-08-01T20:01:34.814 INFO:teuthology.orchestra.run.smithi101.stdout:rpciod 757 root rtd DIR 8,1 4096 2 / 2023-08-01T20:01:34.814 INFO:teuthology.orchestra.run.smithi101.stdout:rpciod 757 root txt unknown /proc/757/exe 2023-08-01T20:01:34.814 INFO:teuthology.orchestra.run.smithi101.stdout:xprtiod 758 root cwd DIR 8,1 4096 2 / 2023-08-01T20:01:34.814 INFO:teuthology.orchestra.run.smithi101.stdout:xprtiod 758 root rtd DIR 8,1 4096 2 / 2023-08-01T20:01:34.814 INFO:teuthology.orchestra.run.smithi101.stdout:xprtiod 758 root txt unknown /proc/758/exe 2023-08-01T20:01:34.814 INFO:teuthology.orchestra.run.smithi101.stdout:sedispatc 759 root cwd DIR 8,1 4096 2 / 2023-08-01T20:01:34.815 INFO:teuthology.orchestra.run.smithi101.stdout:sedispatc 759 root rtd DIR 8,1 4096 2 / 2023-08-01T20:01:34.815 INFO:teuthology.orchestra.run.smithi101.stdout:sedispatc 759 root txt REG 8,1 21008 29668 /usr/sbin/sedispatch 2023-08-01T20:01:34.815 INFO:teuthology.orchestra.run.smithi101.stdout:sedispatc 759 root mem REG 8,1 145984 24905 /usr/lib64/libgpg-error.so.0.24.2 2023-08-01T20:01:34.815 INFO:teuthology.orchestra.run.smithi101.stdout:sedispatc 759 root mem REG 8,1 33480 19526 /usr/lib64/libuuid.so.1.3.0 2023-08-01T20:01:34.815 INFO:teuthology.orchestra.run.smithi101.stdout:sedispatc 759 root mem REG 8,1 343680 19531 /usr/lib64/libblkid.so.1.1.0 2023-08-01T20:01:34.815 INFO:teuthology.orchestra.run.smithi101.stdout:sedispatc 759 root mem REG 8,1 99672 31445 /usr/lib64/libgcc_s-8-20210514.so.1 2023-08-01T20:01:34.815 INFO:teuthology.orchestra.run.smithi101.stdout:sedispatc 759 root mem REG 8,1 1187312 25078 /usr/lib64/libgcrypt.so.20.2.5 2023-08-01T20:01:34.815 INFO:teuthology.orchestra.run.smithi101.stdout:sedispatc 759 root mem REG 8,1 371480 19864 /usr/lib64/libmount.so.1.1.0 2023-08-01T20:01:34.816 INFO:teuthology.orchestra.run.smithi101.stdout:sedispatc 759 root mem REG 8,1 33752 24776 /usr/lib64/libcap.so.2.48 2023-08-01T20:01:34.816 INFO:teuthology.orchestra.run.smithi101.stdout:sedispatc 759 root mem REG 8,1 119760 25264 /usr/lib64/liblz4.so.1.8.3 2023-08-01T20:01:34.816 INFO:teuthology.orchestra.run.smithi101.stdout:sedispatc 759 root mem REG 8,1 162192 24774 /usr/lib64/liblzma.so.5.2.4 2023-08-01T20:01:34.816 INFO:teuthology.orchestra.run.smithi101.stdout:sedispatc 759 root mem REG 8,1 42744 24710 /usr/lib64/librt-2.28.so 2023-08-01T20:01:34.816 INFO:teuthology.orchestra.run.smithi101.stdout:sedispatc 759 root mem REG 8,1 19128 24699 /usr/lib64/libdl-2.28.so 2023-08-01T20:01:34.816 INFO:teuthology.orchestra.run.smithi101.stdout:sedispatc 759 root mem REG 8,1 543304 24651 /usr/lib64/libpcre2-8.so.0.7.1 2023-08-01T20:01:34.816 INFO:teuthology.orchestra.run.smithi101.stdout:sedispatc 759 root mem REG 8,1 135784 24768 /usr/lib64/libaudit.so.1.0.0 2023-08-01T20:01:34.816 INFO:teuthology.orchestra.run.smithi101.stdout:sedispatc 759 root mem REG 8,1 1387784 26786 /usr/lib64/libsystemd.so.0.23.0 2023-08-01T20:01:34.817 INFO:teuthology.orchestra.run.smithi101.stdout:sedispatc 759 root mem REG 8,1 149984 24708 /usr/lib64/libpthread-2.28.so 2023-08-01T20:01:34.817 INFO:teuthology.orchestra.run.smithi101.stdout:sedispatc 759 root mem REG 8,1 2089984 24698 /usr/lib64/libc-2.28.so 2023-08-01T20:01:34.817 INFO:teuthology.orchestra.run.smithi101.stdout:sedispatc 759 root mem REG 8,1 172104 24654 /usr/lib64/libselinux.so.1 2023-08-01T20:01:34.817 INFO:teuthology.orchestra.run.smithi101.stdout:sedispatc 759 root mem REG 8,1 145408 24771 /usr/lib64/libauparse.so.0.0.0 2023-08-01T20:01:34.817 INFO:teuthology.orchestra.run.smithi101.stdout:sedispatc 759 root mem REG 8,1 351592 26670 /usr/lib64/libdbus-1.so.3.19.7 2023-08-01T20:01:34.817 INFO:teuthology.orchestra.run.smithi101.stdout:sedispatc 759 root mem REG 8,1 24928 25065 /usr/lib64/libcap-ng.so.0.0.0 2023-08-01T20:01:34.817 INFO:teuthology.orchestra.run.smithi101.stdout:sedispatc 759 root mem REG 8,1 1062168 24653 /usr/lib64/ld-2.28.so 2023-08-01T20:01:34.817 INFO:teuthology.orchestra.run.smithi101.stdout:sedispatc 759 root 0u unix 0xffff93750c951b00 0t0 4867 type=STREAM 2023-08-01T20:01:34.818 INFO:teuthology.orchestra.run.smithi101.stdout:sedispatc 759 root 1u CHR 1,3 0t0 3083 /dev/null 2023-08-01T20:01:34.818 INFO:teuthology.orchestra.run.smithi101.stdout:sedispatc 759 root 2u CHR 1,3 0t0 3083 /dev/null 2023-08-01T20:01:34.818 INFO:teuthology.orchestra.run.smithi101.stdout:sedispatc 759 root 3u unix 0xffff93750c8c0480 0t0 35003 type=STREAM 2023-08-01T20:01:34.818 INFO:teuthology.orchestra.run.smithi101.stdout:sedispatc 759 root 4u unix 0xffff937080480900 0t0 28623 type=DGRAM 2023-08-01T20:01:34.818 INFO:teuthology.orchestra.run.smithi101.stdout:irqbalanc 803 root cwd DIR 8,1 4096 2 / 2023-08-01T20:01:34.818 INFO:teuthology.orchestra.run.smithi101.stdout:irqbalanc 803 root rtd DIR 8,1 4096 2 / 2023-08-01T20:01:34.818 INFO:teuthology.orchestra.run.smithi101.stdout:irqbalanc 803 root txt REG 8,1 63720 29129 /usr/sbin/irqbalance 2023-08-01T20:01:34.819 INFO:teuthology.orchestra.run.smithi101.stdout:irqbalanc 803 root mem REG 8,1 37240 25164 /usr/lib64/libffi.so.6.0.2 2023-08-01T20:01:34.819 INFO:teuthology.orchestra.run.smithi101.stdout:irqbalanc 803 root mem REG 8,1 1541856 25080 /usr/lib64/libgmp.so.10.3.2 2023-08-01T20:01:34.819 INFO:teuthology.orchestra.run.smithi101.stdout:irqbalanc 803 root mem REG 8,1 197728 25272 /usr/lib64/libhogweed.so.4.5 2023-08-01T20:01:34.819 INFO:teuthology.orchestra.run.smithi101.stdout:irqbalanc 803 root mem REG 8,1 239360 25274 /usr/lib64/libnettle.so.6.5 2023-08-01T20:01:34.819 INFO:teuthology.orchestra.run.smithi101.stdout:irqbalanc 803 root mem REG 8,1 78816 25301 /usr/lib64/libtasn1.so.6.5.5 2023-08-01T20:01:34.819 INFO:teuthology.orchestra.run.smithi101.stdout:irqbalanc 803 root mem REG 8,1 1805368 25103 /usr/lib64/libunistring.so.2.1.0 2023-08-01T20:01:34.819 INFO:teuthology.orchestra.run.smithi101.stdout:irqbalanc 803 root mem REG 8,1 165624 25105 /usr/lib64/libidn2.so.0.3.6 2023-08-01T20:01:34.819 INFO:teuthology.orchestra.run.smithi101.stdout:irqbalanc 803 root mem REG 8,1 1246520 25167 /usr/lib64/libp11-kit.so.0.3.0 2023-08-01T20:01:34.820 INFO:teuthology.orchestra.run.smithi101.stdout:irqbalanc 803 root mem REG 8,1 19128 24699 /usr/lib64/libdl-2.28.so 2023-08-01T20:01:34.820 INFO:teuthology.orchestra.run.smithi101.stdout:irqbalanc 803 root mem REG 8,1 149984 24708 /usr/lib64/libpthread-2.28.so 2023-08-01T20:01:34.820 INFO:teuthology.orchestra.run.smithi101.stdout:irqbalanc 803 root mem REG 8,1 464936 25554 /usr/lib64/libpcre.so.1.2.10 2023-08-01T20:01:34.820 INFO:teuthology.orchestra.run.smithi101.stdout:irqbalanc 803 root mem REG 8,1 2051688 27472 /usr/lib64/libgnutls.so.30.28.2 2023-08-01T20:01:34.820 INFO:teuthology.orchestra.run.smithi101.stdout:irqbalanc 803 root mem REG 8,1 2089984 24698 /usr/lib64/libc-2.28.so 2023-08-01T20:01:34.820 INFO:teuthology.orchestra.run.smithi101.stdout:irqbalanc 803 root mem REG 8,1 187496 24674 /usr/lib64/libtinfo.so.6.1 2023-08-01T20:01:34.820 INFO:teuthology.orchestra.run.smithi101.stdout:irqbalanc 803 root mem REG 8,1 255032 24666 /usr/lib64/libncursesw.so.6.1 2023-08-01T20:01:34.820 INFO:teuthology.orchestra.run.smithi101.stdout:irqbalanc 803 root mem REG 8,1 1598840 24700 /usr/lib64/libm-2.28.so 2023-08-01T20:01:34.821 INFO:teuthology.orchestra.run.smithi101.stdout:irqbalanc 803 root mem REG 8,1 51192 25552 /usr/lib64/libnuma.so.1.0.0 2023-08-01T20:01:34.821 INFO:teuthology.orchestra.run.smithi101.stdout:irqbalanc 803 root mem REG 8,1 1172024 27416 /usr/lib64/libglib-2.0.so.0.5600.4 2023-08-01T20:01:34.821 INFO:teuthology.orchestra.run.smithi101.stdout:irqbalanc 803 root mem REG 8,1 24928 25065 /usr/lib64/libcap-ng.so.0.0.0 2023-08-01T20:01:34.821 INFO:teuthology.orchestra.run.smithi101.stdout:irqbalanc 803 root mem REG 8,1 1062168 24653 /usr/lib64/ld-2.28.so 2023-08-01T20:01:34.821 INFO:teuthology.orchestra.run.smithi101.stdout:irqbalanc 803 root 0r CHR 1,3 0t0 3083 /dev/null 2023-08-01T20:01:34.821 INFO:teuthology.orchestra.run.smithi101.stdout:irqbalanc 803 root 1u unix 0xffff9370586ccc80 0t0 18242 type=STREAM 2023-08-01T20:01:34.821 INFO:teuthology.orchestra.run.smithi101.stdout:irqbalanc 803 root 2u unix 0xffff9370586ccc80 0t0 18242 type=STREAM 2023-08-01T20:01:34.821 INFO:teuthology.orchestra.run.smithi101.stdout:irqbalanc 803 root 3u a_inode 0,14 0 15587 [eventfd] 2023-08-01T20:01:34.822 INFO:teuthology.orchestra.run.smithi101.stdout:irqbalanc 803 root 4u a_inode 0,14 0 15587 [eventfd] 2023-08-01T20:01:34.822 INFO:teuthology.orchestra.run.smithi101.stdout:irqbalanc 803 root 5u unix 0xffff93750c997500 0t0 21742 /run/irqbalance/irqbalance803.sock type=STREAM 2023-08-01T20:01:34.822 INFO:teuthology.orchestra.run.smithi101.stdout:irqbalanc 803 844 gmain root cwd DIR 8,1 4096 2 / 2023-08-01T20:01:34.822 INFO:teuthology.orchestra.run.smithi101.stdout:irqbalanc 803 844 gmain root rtd DIR 8,1 4096 2 / 2023-08-01T20:01:34.822 INFO:teuthology.orchestra.run.smithi101.stdout:irqbalanc 803 844 gmain root txt REG 8,1 63720 29129 /usr/sbin/irqbalance 2023-08-01T20:01:34.822 INFO:teuthology.orchestra.run.smithi101.stdout:irqbalanc 803 844 gmain root mem REG 8,1 37240 25164 /usr/lib64/libffi.so.6.0.2 2023-08-01T20:01:34.822 INFO:teuthology.orchestra.run.smithi101.stdout:irqbalanc 803 844 gmain root mem REG 8,1 1541856 25080 /usr/lib64/libgmp.so.10.3.2 2023-08-01T20:01:34.822 INFO:teuthology.orchestra.run.smithi101.stdout:irqbalanc 803 844 gmain root mem REG 8,1 197728 25272 /usr/lib64/libhogweed.so.4.5 2023-08-01T20:01:34.823 INFO:teuthology.orchestra.run.smithi101.stdout:irqbalanc 803 844 gmain root mem REG 8,1 239360 25274 /usr/lib64/libnettle.so.6.5 2023-08-01T20:01:34.823 INFO:teuthology.orchestra.run.smithi101.stdout:irqbalanc 803 844 gmain root mem REG 8,1 78816 25301 /usr/lib64/libtasn1.so.6.5.5 2023-08-01T20:01:34.823 INFO:teuthology.orchestra.run.smithi101.stdout:irqbalanc 803 844 gmain root mem REG 8,1 1805368 25103 /usr/lib64/libunistring.so.2.1.0 2023-08-01T20:01:34.823 INFO:teuthology.orchestra.run.smithi101.stdout:irqbalanc 803 844 gmain root mem REG 8,1 165624 25105 /usr/lib64/libidn2.so.0.3.6 2023-08-01T20:01:34.823 INFO:teuthology.orchestra.run.smithi101.stdout:irqbalanc 803 844 gmain root mem REG 8,1 1246520 25167 /usr/lib64/libp11-kit.so.0.3.0 2023-08-01T20:01:34.823 INFO:teuthology.orchestra.run.smithi101.stdout:irqbalanc 803 844 gmain root mem REG 8,1 19128 24699 /usr/lib64/libdl-2.28.so 2023-08-01T20:01:34.823 INFO:teuthology.orchestra.run.smithi101.stdout:irqbalanc 803 844 gmain root mem REG 8,1 149984 24708 /usr/lib64/libpthread-2.28.so 2023-08-01T20:01:34.823 INFO:teuthology.orchestra.run.smithi101.stdout:irqbalanc 803 844 gmain root mem REG 8,1 464936 25554 /usr/lib64/libpcre.so.1.2.10 2023-08-01T20:01:34.824 INFO:teuthology.orchestra.run.smithi101.stdout:irqbalanc 803 844 gmain root mem REG 8,1 2051688 27472 /usr/lib64/libgnutls.so.30.28.2 2023-08-01T20:01:34.824 INFO:teuthology.orchestra.run.smithi101.stdout:irqbalanc 803 844 gmain root mem REG 8,1 2089984 24698 /usr/lib64/libc-2.28.so 2023-08-01T20:01:34.824 INFO:teuthology.orchestra.run.smithi101.stdout:irqbalanc 803 844 gmain root mem REG 8,1 187496 24674 /usr/lib64/libtinfo.so.6.1 2023-08-01T20:01:34.824 INFO:teuthology.orchestra.run.smithi101.stdout:irqbalanc 803 844 gmain root mem REG 8,1 255032 24666 /usr/lib64/libncursesw.so.6.1 2023-08-01T20:01:34.824 INFO:teuthology.orchestra.run.smithi101.stdout:irqbalanc 803 844 gmain root mem REG 8,1 1598840 24700 /usr/lib64/libm-2.28.so 2023-08-01T20:01:34.824 INFO:teuthology.orchestra.run.smithi101.stdout:irqbalanc 803 844 gmain root mem REG 8,1 51192 25552 /usr/lib64/libnuma.so.1.0.0 2023-08-01T20:01:34.824 INFO:teuthology.orchestra.run.smithi101.stdout:irqbalanc 803 844 gmain root mem REG 8,1 1172024 27416 /usr/lib64/libglib-2.0.so.0.5600.4 2023-08-01T20:01:34.825 INFO:teuthology.orchestra.run.smithi101.stdout:irqbalanc 803 844 gmain root mem REG 8,1 24928 25065 /usr/lib64/libcap-ng.so.0.0.0 2023-08-01T20:01:34.825 INFO:teuthology.orchestra.run.smithi101.stdout:irqbalanc 803 844 gmain root mem REG 8,1 1062168 24653 /usr/lib64/ld-2.28.so 2023-08-01T20:01:34.825 INFO:teuthology.orchestra.run.smithi101.stdout:irqbalanc 803 844 gmain root 0r CHR 1,3 0t0 3083 /dev/null 2023-08-01T20:01:34.825 INFO:teuthology.orchestra.run.smithi101.stdout:irqbalanc 803 844 gmain root 1u unix 0xffff9370586ccc80 0t0 18242 type=STREAM 2023-08-01T20:01:34.825 INFO:teuthology.orchestra.run.smithi101.stdout:irqbalanc 803 844 gmain root 2u unix 0xffff9370586ccc80 0t0 18242 type=STREAM 2023-08-01T20:01:34.825 INFO:teuthology.orchestra.run.smithi101.stdout:irqbalanc 803 844 gmain root 3u a_inode 0,14 0 15587 [eventfd] 2023-08-01T20:01:34.825 INFO:teuthology.orchestra.run.smithi101.stdout:irqbalanc 803 844 gmain root 4u a_inode 0,14 0 15587 [eventfd] 2023-08-01T20:01:34.825 INFO:teuthology.orchestra.run.smithi101.stdout:irqbalanc 803 844 gmain root 5u unix 0xffff93750c997500 0t0 21742 /run/irqbalance/irqbalance803.sock type=STREAM 2023-08-01T20:01:34.826 INFO:teuthology.orchestra.run.smithi101.stdout:mcelog 806 root cwd DIR 8,1 4096 2 / 2023-08-01T20:01:34.826 INFO:teuthology.orchestra.run.smithi101.stdout:mcelog 806 root rtd DIR 8,1 4096 2 / 2023-08-01T20:01:34.826 INFO:teuthology.orchestra.run.smithi101.stdout:mcelog 806 root txt REG 8,1 185824 30313 /usr/sbin/mcelog 2023-08-01T20:01:34.826 INFO:teuthology.orchestra.run.smithi101.stdout:mcelog 806 root mem REG 8,1 54352 24707 /usr/lib64/libnss_files-2.28.so 2023-08-01T20:01:34.826 INFO:teuthology.orchestra.run.smithi101.stdout:mcelog 806 root mem REG 8,1 2089984 24698 /usr/lib64/libc-2.28.so 2023-08-01T20:01:34.826 INFO:teuthology.orchestra.run.smithi101.stdout:mcelog 806 root mem REG 8,1 1062168 24653 /usr/lib64/ld-2.28.so 2023-08-01T20:01:34.826 INFO:teuthology.orchestra.run.smithi101.stdout:mcelog 806 root 0r CHR 1,3 0t0 3083 /dev/null 2023-08-01T20:01:34.826 INFO:teuthology.orchestra.run.smithi101.stdout:mcelog 806 root 1u unix 0xffff93750d2bcc80 0t0 29090 type=STREAM 2023-08-01T20:01:34.827 INFO:teuthology.orchestra.run.smithi101.stdout:mcelog 806 root 2u unix 0xffff93750d2bcc80 0t0 29090 type=STREAM 2023-08-01T20:01:34.827 INFO:teuthology.orchestra.run.smithi101.stdout:mcelog 806 root 3r CHR 10,227 0t0 5178 /dev/mcelog 2023-08-01T20:01:34.827 INFO:teuthology.orchestra.run.smithi101.stdout:mcelog 806 root 4u unix 0xffff93750d2b9f80 0t0 29103 /var/run/mcelog-client type=STREAM 2023-08-01T20:01:34.827 INFO:teuthology.orchestra.run.smithi101.stdout:smartd 807 root cwd DIR 8,1 4096 2 / 2023-08-01T20:01:34.827 INFO:teuthology.orchestra.run.smithi101.stdout:smartd 807 root rtd DIR 8,1 4096 2 / 2023-08-01T20:01:34.827 INFO:teuthology.orchestra.run.smithi101.stdout:smartd 807 root txt REG 8,1 734288 30409 /usr/sbin/smartd 2023-08-01T20:01:34.827 INFO:teuthology.orchestra.run.smithi101.stdout:smartd 807 root mem REG 8,1 145984 24905 /usr/lib64/libgpg-error.so.0.24.2 2023-08-01T20:01:34.827 INFO:teuthology.orchestra.run.smithi101.stdout:smartd 807 root mem REG 8,1 33480 19526 /usr/lib64/libuuid.so.1.3.0 2023-08-01T20:01:34.828 INFO:teuthology.orchestra.run.smithi101.stdout:smartd 807 root mem REG 8,1 343680 19531 /usr/lib64/libblkid.so.1.1.0 2023-08-01T20:01:34.828 INFO:teuthology.orchestra.run.smithi101.stdout:smartd 807 root mem REG 8,1 19128 24699 /usr/lib64/libdl-2.28.so 2023-08-01T20:01:34.828 INFO:teuthology.orchestra.run.smithi101.stdout:smartd 807 root mem REG 8,1 543304 24651 /usr/lib64/libpcre2-8.so.0.7.1 2023-08-01T20:01:34.828 INFO:teuthology.orchestra.run.smithi101.stdout:smartd 807 root mem REG 8,1 149984 24708 /usr/lib64/libpthread-2.28.so 2023-08-01T20:01:34.828 INFO:teuthology.orchestra.run.smithi101.stdout:smartd 807 root mem REG 8,1 1187312 25078 /usr/lib64/libgcrypt.so.20.2.5 2023-08-01T20:01:34.828 INFO:teuthology.orchestra.run.smithi101.stdout:smartd 807 root mem REG 8,1 371480 19864 /usr/lib64/libmount.so.1.1.0 2023-08-01T20:01:34.828 INFO:teuthology.orchestra.run.smithi101.stdout:smartd 807 root mem REG 8,1 33752 24776 /usr/lib64/libcap.so.2.48 2023-08-01T20:01:34.828 INFO:teuthology.orchestra.run.smithi101.stdout:smartd 807 root mem REG 8,1 119760 25264 /usr/lib64/liblz4.so.1.8.3 2023-08-01T20:01:34.829 INFO:teuthology.orchestra.run.smithi101.stdout:smartd 807 root mem REG 8,1 162192 24774 /usr/lib64/liblzma.so.5.2.4 2023-08-01T20:01:34.829 INFO:teuthology.orchestra.run.smithi101.stdout:smartd 807 root mem REG 8,1 42744 24710 /usr/lib64/librt-2.28.so 2023-08-01T20:01:34.829 INFO:teuthology.orchestra.run.smithi101.stdout:smartd 807 root mem REG 8,1 2089984 24698 /usr/lib64/libc-2.28.so 2023-08-01T20:01:34.829 INFO:teuthology.orchestra.run.smithi101.stdout:smartd 807 root mem REG 8,1 99672 31445 /usr/lib64/libgcc_s-8-20210514.so.1 2023-08-01T20:01:34.829 INFO:teuthology.orchestra.run.smithi101.stdout:smartd 807 root mem REG 8,1 1598840 24700 /usr/lib64/libm-2.28.so 2023-08-01T20:01:34.829 INFO:teuthology.orchestra.run.smithi101.stdout:smartd 807 root mem REG 8,1 1661416 24816 /usr/lib64/libstdc++.so.6.0.25 2023-08-01T20:01:34.829 INFO:teuthology.orchestra.run.smithi101.stdout:smartd 807 root mem REG 8,1 172104 24654 /usr/lib64/libselinux.so.1 2023-08-01T20:01:34.829 INFO:teuthology.orchestra.run.smithi101.stdout:smartd 807 root mem REG 8,1 1387784 26786 /usr/lib64/libsystemd.so.0.23.0 2023-08-01T20:01:34.830 INFO:teuthology.orchestra.run.smithi101.stdout:smartd 807 root mem REG 8,1 24928 25065 /usr/lib64/libcap-ng.so.0.0.0 2023-08-01T20:01:34.830 INFO:teuthology.orchestra.run.smithi101.stdout:smartd 807 root mem REG 8,1 1062168 24653 /usr/lib64/ld-2.28.so 2023-08-01T20:01:34.830 INFO:teuthology.orchestra.run.smithi101.stdout:smartd 807 root 0u CHR 1,3 0t0 3083 /dev/null 2023-08-01T20:01:34.830 INFO:teuthology.orchestra.run.smithi101.stdout:smartd 807 root 1u CHR 1,3 0t0 3083 /dev/null 2023-08-01T20:01:34.830 INFO:teuthology.orchestra.run.smithi101.stdout:smartd 807 root 2u CHR 1,3 0t0 3083 /dev/null 2023-08-01T20:01:34.830 INFO:teuthology.orchestra.run.smithi101.stdout:kworker/3 810 root cwd DIR 8,1 4096 2 / 2023-08-01T20:01:34.830 INFO:teuthology.orchestra.run.smithi101.stdout:kworker/3 810 root rtd DIR 8,1 4096 2 / 2023-08-01T20:01:34.830 INFO:teuthology.orchestra.run.smithi101.stdout:kworker/3 810 root txt unknown /proc/810/exe 2023-08-01T20:01:34.831 INFO:teuthology.orchestra.run.smithi101.stdout:systemd-l 811 root cwd DIR 8,1 4096 2 / 2023-08-01T20:01:34.831 INFO:teuthology.orchestra.run.smithi101.stdout:systemd-l 811 root rtd DIR 8,1 4096 2 / 2023-08-01T20:01:34.831 INFO:teuthology.orchestra.run.smithi101.stdout:systemd-l 811 root txt REG 8,1 267568 35693 /usr/lib/systemd/systemd-logind 2023-08-01T20:01:34.831 INFO:teuthology.orchestra.run.smithi101.stdout:systemd-l 811 root mem REG 8,1 54352 24707 /usr/lib64/libnss_files-2.28.so 2023-08-01T20:01:34.831 INFO:teuthology.orchestra.run.smithi101.stdout:systemd-l 811 root mem REG 8,1 99640 24762 /usr/lib64/libz.so.1.2.11 2023-08-01T20:01:34.831 INFO:teuthology.orchestra.run.smithi101.stdout:systemd-l 811 root mem REG 8,1 1598840 24700 /usr/lib64/libm-2.28.so 2023-08-01T20:01:34.831 INFO:teuthology.orchestra.run.smithi101.stdout:systemd-l 811 root mem REG 8,1 658136 26787 /usr/lib64/libudev.so.1.6.11 2023-08-01T20:01:34.832 INFO:teuthology.orchestra.run.smithi101.stdout:systemd-l 811 root mem REG 8,1 735192 24831 /usr/lib64/libsepol.so.1 2023-08-01T20:01:34.832 INFO:teuthology.orchestra.run.smithi101.stdout:systemd-l 811 root mem REG 8,1 1805368 25103 /usr/lib64/libunistring.so.2.1.0 2023-08-01T20:01:34.832 INFO:teuthology.orchestra.run.smithi101.stdout:systemd-l 811 root mem REG 8,1 543304 24651 /usr/lib64/libpcre2-8.so.0.7.1 2023-08-01T20:01:34.832 INFO:teuthology.orchestra.run.smithi101.stdout:systemd-l 811 root mem REG 8,1 19128 24699 /usr/lib64/libdl-2.28.so 2023-08-01T20:01:34.832 INFO:teuthology.orchestra.run.smithi101.stdout:systemd-l 811 root mem REG 8,1 145984 24905 /usr/lib64/libgpg-error.so.0.24.2 2023-08-01T20:01:34.832 INFO:teuthology.orchestra.run.smithi101.stdout:systemd-l 811 root mem REG 8,1 66920 24972 /usr/lib64/libjson-c.so.4.0.0 2023-08-01T20:01:34.832 INFO:teuthology.orchestra.run.smithi101.stdout:systemd-l 811 root mem REG 8,1 3083608 26861 /usr/lib64/libcrypto.so.1.1.1k 2023-08-01T20:01:34.832 INFO:teuthology.orchestra.run.smithi101.stdout:systemd-l 811 root mem REG 8,1 615744 26862 /usr/lib64/libssl.so.1.1.1k 2023-08-01T20:01:34.833 INFO:teuthology.orchestra.run.smithi101.stdout:systemd-l 811 root mem REG 8,1 371232 26853 /usr/lib64/libdevmapper.so.1.02 2023-08-01T20:01:34.833 INFO:teuthology.orchestra.run.smithi101.stdout:systemd-l 811 root mem REG 8,1 33480 19526 /usr/lib64/libuuid.so.1.3.0 2023-08-01T20:01:34.833 INFO:teuthology.orchestra.run.smithi101.stdout:systemd-l 811 root mem REG 8,1 26704 24976 /usr/lib64/libattr.so.1.1.2448 2023-08-01T20:01:34.833 INFO:teuthology.orchestra.run.smithi101.stdout:systemd-l 811 root mem REG 8,1 371480 19864 /usr/lib64/libmount.so.1.1.0 2023-08-01T20:01:34.833 INFO:teuthology.orchestra.run.smithi101.stdout:systemd-l 811 root mem REG 8,1 343680 19531 /usr/lib64/libblkid.so.1.1.0 2023-08-01T20:01:34.833 INFO:teuthology.orchestra.run.smithi101.stdout:systemd-l 811 root mem REG 8,1 119760 25264 /usr/lib64/liblz4.so.1.8.3 2023-08-01T20:01:34.833 INFO:teuthology.orchestra.run.smithi101.stdout:systemd-l 811 root mem REG 8,1 162192 24774 /usr/lib64/liblzma.so.5.2.4 2023-08-01T20:01:34.833 INFO:teuthology.orchestra.run.smithi101.stdout:systemd-l 811 root mem REG 8,1 165624 25105 /usr/lib64/libidn2.so.0.3.6 2023-08-01T20:01:34.834 INFO:teuthology.orchestra.run.smithi101.stdout:systemd-l 811 root mem REG 8,1 172104 24654 /usr/lib64/libselinux.so.1 2023-08-01T20:01:34.834 INFO:teuthology.orchestra.run.smithi101.stdout:systemd-l 811 root mem REG 8,1 128792 25521 /usr/lib64/libseccomp.so.2.5.2 2023-08-01T20:01:34.834 INFO:teuthology.orchestra.run.smithi101.stdout:systemd-l 811 root mem REG 8,1 1187312 25078 /usr/lib64/libgcrypt.so.20.2.5 2023-08-01T20:01:34.834 INFO:teuthology.orchestra.run.smithi101.stdout:systemd-l 811 root mem REG 8,1 526384 26885 /usr/lib64/libcryptsetup.so.12.6.0 2023-08-01T20:01:34.834 INFO:teuthology.orchestra.run.smithi101.stdout:systemd-l 811 root mem REG 8,1 33752 24776 /usr/lib64/libcap.so.2.48 2023-08-01T20:01:34.834 INFO:teuthology.orchestra.run.smithi101.stdout:systemd-l 811 root mem REG 8,1 42744 24710 /usr/lib64/librt-2.28.so 2023-08-01T20:01:34.834 INFO:teuthology.orchestra.run.smithi101.stdout:systemd-l 811 root mem REG 8,1 2089984 24698 /usr/lib64/libc-2.28.so 2023-08-01T20:01:34.834 INFO:teuthology.orchestra.run.smithi101.stdout:systemd-l 811 root mem REG 8,1 149984 24708 /usr/lib64/libpthread-2.28.so 2023-08-01T20:01:34.835 INFO:teuthology.orchestra.run.smithi101.stdout:systemd-l 811 root mem REG 8,1 99672 31445 /usr/lib64/libgcc_s-8-20210514.so.1 2023-08-01T20:01:34.835 INFO:teuthology.orchestra.run.smithi101.stdout:systemd-l 811 root mem REG 8,1 59272 24978 /usr/lib64/libacl.so.1.1.2253 2023-08-01T20:01:34.835 INFO:teuthology.orchestra.run.smithi101.stdout:systemd-l 811 root mem REG 8,1 2761368 35660 /usr/lib/systemd/libsystemd-shared-239.so 2023-08-01T20:01:34.835 INFO:teuthology.orchestra.run.smithi101.stdout:systemd-l 811 root mem REG 8,1 1062168 24653 /usr/lib64/ld-2.28.so 2023-08-01T20:01:34.835 INFO:teuthology.orchestra.run.smithi101.stdout:systemd-l 811 root mem REG 8,1 579864 16755 /etc/selinux/targeted/contexts/files/file_contexts.bin 2023-08-01T20:01:34.835 INFO:teuthology.orchestra.run.smithi101.stdout:systemd-l 811 root mem REG 8,1 19983 16806 /etc/selinux/targeted/contexts/files/file_contexts.homedirs.bin 2023-08-01T20:01:34.835 INFO:teuthology.orchestra.run.smithi101.stdout:systemd-l 811 root 0r CHR 1,3 0t0 3083 /dev/null 2023-08-01T20:01:34.835 INFO:teuthology.orchestra.run.smithi101.stdout:systemd-l 811 root 1u unix 0xffff93750c983a80 0t0 29742 type=STREAM 2023-08-01T20:01:34.836 INFO:teuthology.orchestra.run.smithi101.stdout:systemd-l 811 root 2u unix 0xffff93750c983a80 0t0 29742 type=STREAM 2023-08-01T20:01:34.836 INFO:teuthology.orchestra.run.smithi101.stdout:systemd-l 811 root 3u unix 0xffff93750c993600 0t0 21718 type=DGRAM 2023-08-01T20:01:34.836 INFO:teuthology.orchestra.run.smithi101.stdout:systemd-l 811 root 4u a_inode 0,14 0 15587 [eventpoll] 2023-08-01T20:01:34.836 INFO:teuthology.orchestra.run.smithi101.stdout:systemd-l 811 root 5u a_inode 0,14 0 15587 [signalfd] 2023-08-01T20:01:34.836 INFO:teuthology.orchestra.run.smithi101.stdout:systemd-l 811 root 6u a_inode 0,14 0 15587 [timerfd] 2023-08-01T20:01:34.836 INFO:teuthology.orchestra.run.smithi101.stdout:systemd-l 811 root 7r REG 0,21 4096 22520 /sys/devices/virtual/tty/tty0/active 2023-08-01T20:01:34.836 INFO:teuthology.orchestra.run.smithi101.stdout:systemd-l 811 root 8u netlink 0t0 21724 KOBJECT_UEVENT 2023-08-01T20:01:34.837 INFO:teuthology.orchestra.run.smithi101.stdout:systemd-l 811 root 9r a_inode 0,14 0 15587 inotify 2023-08-01T20:01:34.837 INFO:teuthology.orchestra.run.smithi101.stdout:systemd-l 811 root 10r FIFO 0,24 0t0 31775 /run/systemd/inhibit/1.ref 2023-08-01T20:01:34.837 INFO:teuthology.orchestra.run.smithi101.stdout:systemd-l 811 root 11u netlink 0t0 21725 KOBJECT_UEVENT 2023-08-01T20:01:34.837 INFO:teuthology.orchestra.run.smithi101.stdout:systemd-l 811 root 12u netlink 0t0 21726 KOBJECT_UEVENT 2023-08-01T20:01:34.837 INFO:teuthology.orchestra.run.smithi101.stdout:systemd-l 811 root 13u netlink 0t0 21727 KOBJECT_UEVENT 2023-08-01T20:01:34.837 INFO:teuthology.orchestra.run.smithi101.stdout:systemd-l 811 root 14u unix 0xffff93750c991200 0t0 21728 type=STREAM 2023-08-01T20:01:34.837 INFO:teuthology.orchestra.run.smithi101.stdout:systemd-l 811 root 15u a_inode 0,14 0 15587 [timerfd] 2023-08-01T20:01:34.837 INFO:teuthology.orchestra.run.smithi101.stdout:systemd-l 811 root 16u CHR 13,65 0t0 5174 /dev/input/event1 2023-08-01T20:01:34.838 INFO:teuthology.orchestra.run.smithi101.stdout:systemd-l 811 root 17u CHR 13,64 0t0 5173 /dev/input/event0 2023-08-01T20:01:34.838 INFO:teuthology.orchestra.run.smithi101.stdout:systemd-l 811 root 18u CHR 13,66 0t0 5547 /dev/input/event2 2023-08-01T20:01:34.838 INFO:teuthology.orchestra.run.smithi101.stdout:systemd-l 811 root 19u CHR 4,6 0t0 3102 /dev/tty6 2023-08-01T20:01:34.838 INFO:teuthology.orchestra.run.smithi101.stdout:systemd-l 811 root 20r FIFO 0,24 0t0 44296 /run/systemd/sessions/1.ref 2023-08-01T20:01:34.838 INFO:teuthology.orchestra.run.smithi101.stdout:polkitd 813 polkitd cwd DIR 8,1 4096 2 / 2023-08-01T20:01:34.838 INFO:teuthology.orchestra.run.smithi101.stdout:polkitd 813 polkitd rtd DIR 8,1 4096 2 / 2023-08-01T20:01:34.838 INFO:teuthology.orchestra.run.smithi101.stdout:polkitd 813 polkitd txt REG 8,1 142536 57377 /usr/lib/polkit-1/polkitd 2023-08-01T20:01:34.838 INFO:teuthology.orchestra.run.smithi101.stdout:polkitd 813 polkitd mem REG 8,1 944528 26785 /usr/lib64/libnss_systemd.so.2 2023-08-01T20:01:34.839 INFO:teuthology.orchestra.run.smithi101.stdout:polkitd 813 polkitd mem REG 8,1 46336 29167 /usr/lib64/libnss_sss.so.2 2023-08-01T20:01:34.839 INFO:teuthology.orchestra.run.smithi101.stdout:polkitd 813 polkitd mem REG 8,1 54352 24707 /usr/lib64/libnss_files-2.28.so 2023-08-01T20:01:34.839 INFO:teuthology.orchestra.run.smithi101.stdout:polkitd 813 polkitd mem REG 8,1 145984 24905 /usr/lib64/libgpg-error.so.0.24.2 2023-08-01T20:01:34.839 INFO:teuthology.orchestra.run.smithi101.stdout:polkitd 813 polkitd mem REG 8,1 33480 19526 /usr/lib64/libuuid.so.1.3.0 2023-08-01T20:01:34.839 INFO:teuthology.orchestra.run.smithi101.stdout:polkitd 813 polkitd mem REG 8,1 343680 19531 /usr/lib64/libblkid.so.1.1.0 2023-08-01T20:01:34.839 INFO:teuthology.orchestra.run.smithi101.stdout:polkitd 813 polkitd mem REG 8,1 543304 24651 /usr/lib64/libpcre2-8.so.0.7.1 2023-08-01T20:01:34.839 INFO:teuthology.orchestra.run.smithi101.stdout:polkitd 813 polkitd mem REG 8,1 1541856 25080 /usr/lib64/libgmp.so.10.3.2 2023-08-01T20:01:34.839 INFO:teuthology.orchestra.run.smithi101.stdout:polkitd 813 polkitd mem REG 8,1 197728 25272 /usr/lib64/libhogweed.so.4.5 2023-08-01T20:01:34.840 INFO:teuthology.orchestra.run.smithi101.stdout:polkitd 813 polkitd mem REG 8,1 239360 25274 /usr/lib64/libnettle.so.6.5 2023-08-01T20:01:34.840 INFO:teuthology.orchestra.run.smithi101.stdout:polkitd 813 polkitd mem REG 8,1 78816 25301 /usr/lib64/libtasn1.so.6.5.5 2023-08-01T20:01:34.840 INFO:teuthology.orchestra.run.smithi101.stdout:polkitd 813 polkitd mem REG 8,1 1805368 25103 /usr/lib64/libunistring.so.2.1.0 2023-08-01T20:01:34.840 INFO:teuthology.orchestra.run.smithi101.stdout:polkitd 813 polkitd mem REG 8,1 165624 25105 /usr/lib64/libidn2.so.0.3.6 2023-08-01T20:01:34.840 INFO:teuthology.orchestra.run.smithi101.stdout:polkitd 813 polkitd mem REG 8,1 1246520 25167 /usr/lib64/libp11-kit.so.0.3.0 2023-08-01T20:01:34.840 INFO:teuthology.orchestra.run.smithi101.stdout:polkitd 813 polkitd mem REG 8,1 1598840 24700 /usr/lib64/libm-2.28.so 2023-08-01T20:01:34.840 INFO:teuthology.orchestra.run.smithi101.stdout:polkitd 813 polkitd mem REG 8,1 1187312 25078 /usr/lib64/libgcrypt.so.20.2.5 2023-08-01T20:01:34.841 INFO:teuthology.orchestra.run.smithi101.stdout:polkitd 813 polkitd mem REG 8,1 33752 24776 /usr/lib64/libcap.so.2.48 2023-08-01T20:01:34.841 INFO:teuthology.orchestra.run.smithi101.stdout:polkitd 813 polkitd mem REG 8,1 119760 25264 /usr/lib64/liblz4.so.1.8.3 2023-08-01T20:01:34.841 INFO:teuthology.orchestra.run.smithi101.stdout:polkitd 813 polkitd mem REG 8,1 162192 24774 /usr/lib64/liblzma.so.5.2.4 2023-08-01T20:01:34.841 INFO:teuthology.orchestra.run.smithi101.stdout:polkitd 813 polkitd mem REG 8,1 42744 24710 /usr/lib64/librt-2.28.so 2023-08-01T20:01:34.841 INFO:teuthology.orchestra.run.smithi101.stdout:polkitd 813 polkitd mem REG 8,1 371480 19864 /usr/lib64/libmount.so.1.1.0 2023-08-01T20:01:34.841 INFO:teuthology.orchestra.run.smithi101.stdout:polkitd 813 polkitd mem REG 8,1 92968 24709 /usr/lib64/libresolv-2.28.so 2023-08-01T20:01:34.841 INFO:teuthology.orchestra.run.smithi101.stdout:polkitd 813 polkitd mem REG 8,1 172104 24654 /usr/lib64/libselinux.so.1 2023-08-01T20:01:34.841 INFO:teuthology.orchestra.run.smithi101.stdout:polkitd 813 polkitd mem REG 8,1 99640 24762 /usr/lib64/libz.so.1.2.11 2023-08-01T20:01:34.842 INFO:teuthology.orchestra.run.smithi101.stdout:polkitd 813 polkitd mem REG 8,1 464936 25554 /usr/lib64/libpcre.so.1.2.10 2023-08-01T20:01:34.842 INFO:teuthology.orchestra.run.smithi101.stdout:polkitd 813 polkitd mem REG 8,1 2051688 27472 /usr/lib64/libgnutls.so.30.28.2 2023-08-01T20:01:34.842 INFO:teuthology.orchestra.run.smithi101.stdout:polkitd 813 polkitd mem REG 8,1 19128 24699 /usr/lib64/libdl-2.28.so 2023-08-01T20:01:34.842 INFO:teuthology.orchestra.run.smithi101.stdout:polkitd 813 polkitd mem REG 8,1 37240 25164 /usr/lib64/libffi.so.6.0.2 2023-08-01T20:01:34.842 INFO:teuthology.orchestra.run.smithi101.stdout:polkitd 813 polkitd mem REG 8,1 16064 27417 /usr/lib64/libgmodule-2.0.so.0.5600.4 2023-08-01T20:01:34.842 INFO:teuthology.orchestra.run.smithi101.stdout:polkitd 813 polkitd mem REG 8,1 2089984 24698 /usr/lib64/libc-2.28.so 2023-08-01T20:01:34.842 INFO:teuthology.orchestra.run.smithi101.stdout:polkitd 813 polkitd mem REG 8,1 149984 24708 /usr/lib64/libpthread-2.28.so 2023-08-01T20:01:34.842 INFO:teuthology.orchestra.run.smithi101.stdout:polkitd 813 polkitd mem REG 8,1 99672 31445 /usr/lib64/libgcc_s-8-20210514.so.1 2023-08-01T20:01:34.843 INFO:teuthology.orchestra.run.smithi101.stdout:polkitd 813 polkitd mem REG 8,1 1661416 24816 /usr/lib64/libstdc++.so.6.0.25 2023-08-01T20:01:34.843 INFO:teuthology.orchestra.run.smithi101.stdout:polkitd 813 polkitd mem REG 8,1 23727992 25841 /usr/lib64/libmozjs-60.so.0.0.0 2023-08-01T20:01:34.843 INFO:teuthology.orchestra.run.smithi101.stdout:polkitd 813 polkitd mem REG 8,1 248216 24968 /usr/lib64/libexpat.so.1.6.7 2023-08-01T20:01:34.843 INFO:teuthology.orchestra.run.smithi101.stdout:polkitd 813 polkitd mem REG 8,1 1387784 26786 /usr/lib64/libsystemd.so.0.23.0 2023-08-01T20:01:34.843 INFO:teuthology.orchestra.run.smithi101.stdout:polkitd 813 polkitd mem REG 8,1 1172024 27416 /usr/lib64/libglib-2.0.so.0.5600.4 2023-08-01T20:01:34.843 INFO:teuthology.orchestra.run.smithi101.stdout:polkitd 813 polkitd mem REG 8,1 347416 27418 /usr/lib64/libgobject-2.0.so.0.5600.4 2023-08-01T20:01:34.843 INFO:teuthology.orchestra.run.smithi101.stdout:polkitd 813 polkitd mem REG 8,1 1770248 27415 /usr/lib64/libgio-2.0.so.0.5600.4 2023-08-01T20:01:34.843 INFO:teuthology.orchestra.run.smithi101.stdout:polkitd 813 polkitd mem REG 8,1 128184 27679 /usr/lib64/libpolkit-gobject-1.so.0.0.0 2023-08-01T20:01:34.844 INFO:teuthology.orchestra.run.smithi101.stdout:polkitd 813 polkitd mem REG 8,1 1062168 24653 /usr/lib64/ld-2.28.so 2023-08-01T20:01:34.844 INFO:teuthology.orchestra.run.smithi101.stdout:polkitd 813 polkitd mem REG 8,1 26998 35419 /usr/lib64/gconv/gconv-modules.cache 2023-08-01T20:01:34.844 INFO:teuthology.orchestra.run.smithi101.stdout:polkitd 813 polkitd 0u CHR 1,3 0t0 3083 /dev/null 2023-08-01T20:01:34.844 INFO:teuthology.orchestra.run.smithi101.stdout:polkitd 813 polkitd 1u CHR 1,3 0t0 3083 /dev/null 2023-08-01T20:01:34.844 INFO:teuthology.orchestra.run.smithi101.stdout:polkitd 813 polkitd 2u CHR 1,3 0t0 3083 /dev/null 2023-08-01T20:01:34.844 INFO:teuthology.orchestra.run.smithi101.stdout:polkitd 813 polkitd 3r a_inode 0,14 0 15587 inotify 2023-08-01T20:01:34.844 INFO:teuthology.orchestra.run.smithi101.stdout:polkitd 813 polkitd 4u a_inode 0,14 0 15587 [eventfd] 2023-08-01T20:01:34.844 INFO:teuthology.orchestra.run.smithi101.stdout:polkitd 813 polkitd 5u a_inode 0,14 0 15587 [eventfd] 2023-08-01T20:01:34.845 INFO:teuthology.orchestra.run.smithi101.stdout:polkitd 813 polkitd 6u unix 0xffff93750c920900 0t0 22651 type=STREAM 2023-08-01T20:01:34.845 INFO:teuthology.orchestra.run.smithi101.stdout:polkitd 813 polkitd 7u a_inode 0,14 0 15587 [eventfd] 2023-08-01T20:01:34.845 INFO:teuthology.orchestra.run.smithi101.stdout:polkitd 813 polkitd 8r a_inode 0,14 0 15587 inotify 2023-08-01T20:01:34.845 INFO:teuthology.orchestra.run.smithi101.stdout:polkitd 813 polkitd 9u a_inode 0,14 0 15587 [eventfd] 2023-08-01T20:01:34.845 INFO:teuthology.orchestra.run.smithi101.stdout:polkitd 813 polkitd 10u unix 0xffff93750c926c00 0t0 22653 type=DGRAM 2023-08-01T20:01:34.845 INFO:teuthology.orchestra.run.smithi101.stdout:polkitd 813 899 gmain polkitd cwd DIR 8,1 4096 2 / 2023-08-01T20:01:34.845 INFO:teuthology.orchestra.run.smithi101.stdout:polkitd 813 899 gmain polkitd rtd DIR 8,1 4096 2 / 2023-08-01T20:01:34.845 INFO:teuthology.orchestra.run.smithi101.stdout:polkitd 813 899 gmain polkitd txt REG 8,1 142536 57377 /usr/lib/polkit-1/polkitd 2023-08-01T20:01:34.846 INFO:teuthology.orchestra.run.smithi101.stdout:polkitd 813 899 gmain polkitd mem REG 8,1 944528 26785 /usr/lib64/libnss_systemd.so.2 2023-08-01T20:01:34.846 INFO:teuthology.orchestra.run.smithi101.stdout:polkitd 813 899 gmain polkitd mem REG 8,1 46336 29167 /usr/lib64/libnss_sss.so.2 2023-08-01T20:01:34.846 INFO:teuthology.orchestra.run.smithi101.stdout:polkitd 813 899 gmain polkitd mem REG 8,1 54352 24707 /usr/lib64/libnss_files-2.28.so 2023-08-01T20:01:34.846 INFO:teuthology.orchestra.run.smithi101.stdout:polkitd 813 899 gmain polkitd mem REG 8,1 145984 24905 /usr/lib64/libgpg-error.so.0.24.2 2023-08-01T20:01:34.846 INFO:teuthology.orchestra.run.smithi101.stdout:polkitd 813 899 gmain polkitd mem REG 8,1 33480 19526 /usr/lib64/libuuid.so.1.3.0 2023-08-01T20:01:34.846 INFO:teuthology.orchestra.run.smithi101.stdout:polkitd 813 899 gmain polkitd mem REG 8,1 343680 19531 /usr/lib64/libblkid.so.1.1.0 2023-08-01T20:01:34.846 INFO:teuthology.orchestra.run.smithi101.stdout:polkitd 813 899 gmain polkitd mem REG 8,1 543304 24651 /usr/lib64/libpcre2-8.so.0.7.1 2023-08-01T20:01:34.846 INFO:teuthology.orchestra.run.smithi101.stdout:polkitd 813 899 gmain polkitd mem REG 8,1 1541856 25080 /usr/lib64/libgmp.so.10.3.2 2023-08-01T20:01:34.847 INFO:teuthology.orchestra.run.smithi101.stdout:polkitd 813 899 gmain polkitd mem REG 8,1 197728 25272 /usr/lib64/libhogweed.so.4.5 2023-08-01T20:01:34.847 INFO:teuthology.orchestra.run.smithi101.stdout:polkitd 813 899 gmain polkitd mem REG 8,1 239360 25274 /usr/lib64/libnettle.so.6.5 2023-08-01T20:01:34.847 INFO:teuthology.orchestra.run.smithi101.stdout:polkitd 813 899 gmain polkitd mem REG 8,1 78816 25301 /usr/lib64/libtasn1.so.6.5.5 2023-08-01T20:01:34.847 INFO:teuthology.orchestra.run.smithi101.stdout:polkitd 813 899 gmain polkitd mem REG 8,1 1805368 25103 /usr/lib64/libunistring.so.2.1.0 2023-08-01T20:01:34.847 INFO:teuthology.orchestra.run.smithi101.stdout:polkitd 813 899 gmain polkitd mem REG 8,1 165624 25105 /usr/lib64/libidn2.so.0.3.6 2023-08-01T20:01:34.847 INFO:teuthology.orchestra.run.smithi101.stdout:polkitd 813 899 gmain polkitd mem REG 8,1 1246520 25167 /usr/lib64/libp11-kit.so.0.3.0 2023-08-01T20:01:34.847 INFO:teuthology.orchestra.run.smithi101.stdout:polkitd 813 899 gmain polkitd mem REG 8,1 1598840 24700 /usr/lib64/libm-2.28.so 2023-08-01T20:01:34.847 INFO:teuthology.orchestra.run.smithi101.stdout:polkitd 813 899 gmain polkitd mem REG 8,1 1187312 25078 /usr/lib64/libgcrypt.so.20.2.5 2023-08-01T20:01:34.848 INFO:teuthology.orchestra.run.smithi101.stdout:polkitd 813 899 gmain polkitd mem REG 8,1 33752 24776 /usr/lib64/libcap.so.2.48 2023-08-01T20:01:34.848 INFO:teuthology.orchestra.run.smithi101.stdout:polkitd 813 899 gmain polkitd mem REG 8,1 119760 25264 /usr/lib64/liblz4.so.1.8.3 2023-08-01T20:01:34.848 INFO:teuthology.orchestra.run.smithi101.stdout:polkitd 813 899 gmain polkitd mem REG 8,1 162192 24774 /usr/lib64/liblzma.so.5.2.4 2023-08-01T20:01:34.848 INFO:teuthology.orchestra.run.smithi101.stdout:polkitd 813 899 gmain polkitd mem REG 8,1 42744 24710 /usr/lib64/librt-2.28.so 2023-08-01T20:01:34.848 INFO:teuthology.orchestra.run.smithi101.stdout:polkitd 813 899 gmain polkitd mem REG 8,1 371480 19864 /usr/lib64/libmount.so.1.1.0 2023-08-01T20:01:34.848 INFO:teuthology.orchestra.run.smithi101.stdout:polkitd 813 899 gmain polkitd mem REG 8,1 92968 24709 /usr/lib64/libresolv-2.28.so 2023-08-01T20:01:34.848 INFO:teuthology.orchestra.run.smithi101.stdout:polkitd 813 899 gmain polkitd mem REG 8,1 172104 24654 /usr/lib64/libselinux.so.1 2023-08-01T20:01:34.849 INFO:teuthology.orchestra.run.smithi101.stdout:polkitd 813 899 gmain polkitd mem REG 8,1 99640 24762 /usr/lib64/libz.so.1.2.11 2023-08-01T20:01:34.849 INFO:teuthology.orchestra.run.smithi101.stdout:polkitd 813 899 gmain polkitd mem REG 8,1 464936 25554 /usr/lib64/libpcre.so.1.2.10 2023-08-01T20:01:34.849 INFO:teuthology.orchestra.run.smithi101.stdout:polkitd 813 899 gmain polkitd mem REG 8,1 2051688 27472 /usr/lib64/libgnutls.so.30.28.2 2023-08-01T20:01:34.849 INFO:teuthology.orchestra.run.smithi101.stdout:polkitd 813 899 gmain polkitd mem REG 8,1 19128 24699 /usr/lib64/libdl-2.28.so 2023-08-01T20:01:34.849 INFO:teuthology.orchestra.run.smithi101.stdout:polkitd 813 899 gmain polkitd mem REG 8,1 37240 25164 /usr/lib64/libffi.so.6.0.2 2023-08-01T20:01:34.849 INFO:teuthology.orchestra.run.smithi101.stdout:polkitd 813 899 gmain polkitd mem REG 8,1 16064 27417 /usr/lib64/libgmodule-2.0.so.0.5600.4 2023-08-01T20:01:34.849 INFO:teuthology.orchestra.run.smithi101.stdout:polkitd 813 899 gmain polkitd mem REG 8,1 2089984 24698 /usr/lib64/libc-2.28.so 2023-08-01T20:01:34.849 INFO:teuthology.orchestra.run.smithi101.stdout:polkitd 813 899 gmain polkitd mem REG 8,1 149984 24708 /usr/lib64/libpthread-2.28.so 2023-08-01T20:01:34.850 INFO:teuthology.orchestra.run.smithi101.stdout:polkitd 813 899 gmain polkitd mem REG 8,1 99672 31445 /usr/lib64/libgcc_s-8-20210514.so.1 2023-08-01T20:01:34.850 INFO:teuthology.orchestra.run.smithi101.stdout:polkitd 813 899 gmain polkitd mem REG 8,1 1661416 24816 /usr/lib64/libstdc++.so.6.0.25 2023-08-01T20:01:34.850 INFO:teuthology.orchestra.run.smithi101.stdout:polkitd 813 899 gmain polkitd mem REG 8,1 23727992 25841 /usr/lib64/libmozjs-60.so.0.0.0 2023-08-01T20:01:34.850 INFO:teuthology.orchestra.run.smithi101.stdout:polkitd 813 899 gmain polkitd mem REG 8,1 248216 24968 /usr/lib64/libexpat.so.1.6.7 2023-08-01T20:01:34.850 INFO:teuthology.orchestra.run.smithi101.stdout:polkitd 813 899 gmain polkitd mem REG 8,1 1387784 26786 /usr/lib64/libsystemd.so.0.23.0 2023-08-01T20:01:34.850 INFO:teuthology.orchestra.run.smithi101.stdout:polkitd 813 899 gmain polkitd mem REG 8,1 1172024 27416 /usr/lib64/libglib-2.0.so.0.5600.4 2023-08-01T20:01:34.850 INFO:teuthology.orchestra.run.smithi101.stdout:polkitd 813 899 gmain polkitd mem REG 8,1 347416 27418 /usr/lib64/libgobject-2.0.so.0.5600.4 2023-08-01T20:01:34.850 INFO:teuthology.orchestra.run.smithi101.stdout:polkitd 813 899 gmain polkitd mem REG 8,1 1770248 27415 /usr/lib64/libgio-2.0.so.0.5600.4 2023-08-01T20:01:34.851 INFO:teuthology.orchestra.run.smithi101.stdout:polkitd 813 899 gmain polkitd mem REG 8,1 128184 27679 /usr/lib64/libpolkit-gobject-1.so.0.0.0 2023-08-01T20:01:34.851 INFO:teuthology.orchestra.run.smithi101.stdout:polkitd 813 899 gmain polkitd mem REG 8,1 1062168 24653 /usr/lib64/ld-2.28.so 2023-08-01T20:01:34.851 INFO:teuthology.orchestra.run.smithi101.stdout:polkitd 813 899 gmain polkitd mem REG 8,1 26998 35419 /usr/lib64/gconv/gconv-modules.cache 2023-08-01T20:01:34.851 INFO:teuthology.orchestra.run.smithi101.stdout:polkitd 813 899 gmain polkitd 0u CHR 1,3 0t0 3083 /dev/null 2023-08-01T20:01:34.851 INFO:teuthology.orchestra.run.smithi101.stdout:polkitd 813 899 gmain polkitd 1u CHR 1,3 0t0 3083 /dev/null 2023-08-01T20:01:34.851 INFO:teuthology.orchestra.run.smithi101.stdout:polkitd 813 899 gmain polkitd 2u CHR 1,3 0t0 3083 /dev/null 2023-08-01T20:01:34.851 INFO:teuthology.orchestra.run.smithi101.stdout:polkitd 813 899 gmain polkitd 3r a_inode 0,14 0 15587 inotify 2023-08-01T20:01:34.851 INFO:teuthology.orchestra.run.smithi101.stdout:polkitd 813 899 gmain polkitd 4u a_inode 0,14 0 15587 [eventfd] 2023-08-01T20:01:34.852 INFO:teuthology.orchestra.run.smithi101.stdout:polkitd 813 899 gmain polkitd 5u a_inode 0,14 0 15587 [eventfd] 2023-08-01T20:01:34.852 INFO:teuthology.orchestra.run.smithi101.stdout:polkitd 813 899 gmain polkitd 6u unix 0xffff93750c920900 0t0 22651 type=STREAM 2023-08-01T20:01:34.852 INFO:teuthology.orchestra.run.smithi101.stdout:polkitd 813 899 gmain polkitd 7u a_inode 0,14 0 15587 [eventfd] 2023-08-01T20:01:34.852 INFO:teuthology.orchestra.run.smithi101.stdout:polkitd 813 899 gmain polkitd 8r a_inode 0,14 0 15587 inotify 2023-08-01T20:01:34.852 INFO:teuthology.orchestra.run.smithi101.stdout:polkitd 813 899 gmain polkitd 9u a_inode 0,14 0 15587 [eventfd] 2023-08-01T20:01:34.852 INFO:teuthology.orchestra.run.smithi101.stdout:polkitd 813 899 gmain polkitd 10u unix 0xffff93750c926c00 0t0 22653 type=DGRAM 2023-08-01T20:01:34.852 INFO:teuthology.orchestra.run.smithi101.stdout:polkitd 813 900 gdbus polkitd cwd DIR 8,1 4096 2 / 2023-08-01T20:01:34.852 INFO:teuthology.orchestra.run.smithi101.stdout:polkitd 813 900 gdbus polkitd rtd DIR 8,1 4096 2 / 2023-08-01T20:01:34.853 INFO:teuthology.orchestra.run.smithi101.stdout:polkitd 813 900 gdbus polkitd txt REG 8,1 142536 57377 /usr/lib/polkit-1/polkitd 2023-08-01T20:01:34.853 INFO:teuthology.orchestra.run.smithi101.stdout:polkitd 813 900 gdbus polkitd mem REG 8,1 944528 26785 /usr/lib64/libnss_systemd.so.2 2023-08-01T20:01:34.853 INFO:teuthology.orchestra.run.smithi101.stdout:polkitd 813 900 gdbus polkitd mem REG 8,1 46336 29167 /usr/lib64/libnss_sss.so.2 2023-08-01T20:01:34.853 INFO:teuthology.orchestra.run.smithi101.stdout:polkitd 813 900 gdbus polkitd mem REG 8,1 54352 24707 /usr/lib64/libnss_files-2.28.so 2023-08-01T20:01:34.853 INFO:teuthology.orchestra.run.smithi101.stdout:polkitd 813 900 gdbus polkitd mem REG 8,1 145984 24905 /usr/lib64/libgpg-error.so.0.24.2 2023-08-01T20:01:34.853 INFO:teuthology.orchestra.run.smithi101.stdout:polkitd 813 900 gdbus polkitd mem REG 8,1 33480 19526 /usr/lib64/libuuid.so.1.3.0 2023-08-01T20:01:34.853 INFO:teuthology.orchestra.run.smithi101.stdout:polkitd 813 900 gdbus polkitd mem REG 8,1 343680 19531 /usr/lib64/libblkid.so.1.1.0 2023-08-01T20:01:34.853 INFO:teuthology.orchestra.run.smithi101.stdout:polkitd 813 900 gdbus polkitd mem REG 8,1 543304 24651 /usr/lib64/libpcre2-8.so.0.7.1 2023-08-01T20:01:34.854 INFO:teuthology.orchestra.run.smithi101.stdout:polkitd 813 900 gdbus polkitd mem REG 8,1 1541856 25080 /usr/lib64/libgmp.so.10.3.2 2023-08-01T20:01:34.854 INFO:teuthology.orchestra.run.smithi101.stdout:polkitd 813 900 gdbus polkitd mem REG 8,1 197728 25272 /usr/lib64/libhogweed.so.4.5 2023-08-01T20:01:34.854 INFO:teuthology.orchestra.run.smithi101.stdout:polkitd 813 900 gdbus polkitd mem REG 8,1 239360 25274 /usr/lib64/libnettle.so.6.5 2023-08-01T20:01:34.854 INFO:teuthology.orchestra.run.smithi101.stdout:polkitd 813 900 gdbus polkitd mem REG 8,1 78816 25301 /usr/lib64/libtasn1.so.6.5.5 2023-08-01T20:01:34.854 INFO:teuthology.orchestra.run.smithi101.stdout:polkitd 813 900 gdbus polkitd mem REG 8,1 1805368 25103 /usr/lib64/libunistring.so.2.1.0 2023-08-01T20:01:34.854 INFO:teuthology.orchestra.run.smithi101.stdout:polkitd 813 900 gdbus polkitd mem REG 8,1 165624 25105 /usr/lib64/libidn2.so.0.3.6 2023-08-01T20:01:34.854 INFO:teuthology.orchestra.run.smithi101.stdout:polkitd 813 900 gdbus polkitd mem REG 8,1 1246520 25167 /usr/lib64/libp11-kit.so.0.3.0 2023-08-01T20:01:34.854 INFO:teuthology.orchestra.run.smithi101.stdout:polkitd 813 900 gdbus polkitd mem REG 8,1 1598840 24700 /usr/lib64/libm-2.28.so 2023-08-01T20:01:34.855 INFO:teuthology.orchestra.run.smithi101.stdout:polkitd 813 900 gdbus polkitd mem REG 8,1 1187312 25078 /usr/lib64/libgcrypt.so.20.2.5 2023-08-01T20:01:34.855 INFO:teuthology.orchestra.run.smithi101.stdout:polkitd 813 900 gdbus polkitd mem REG 8,1 33752 24776 /usr/lib64/libcap.so.2.48 2023-08-01T20:01:34.855 INFO:teuthology.orchestra.run.smithi101.stdout:polkitd 813 900 gdbus polkitd mem REG 8,1 119760 25264 /usr/lib64/liblz4.so.1.8.3 2023-08-01T20:01:34.855 INFO:teuthology.orchestra.run.smithi101.stdout:polkitd 813 900 gdbus polkitd mem REG 8,1 162192 24774 /usr/lib64/liblzma.so.5.2.4 2023-08-01T20:01:34.855 INFO:teuthology.orchestra.run.smithi101.stdout:polkitd 813 900 gdbus polkitd mem REG 8,1 42744 24710 /usr/lib64/librt-2.28.so 2023-08-01T20:01:34.855 INFO:teuthology.orchestra.run.smithi101.stdout:polkitd 813 900 gdbus polkitd mem REG 8,1 371480 19864 /usr/lib64/libmount.so.1.1.0 2023-08-01T20:01:34.855 INFO:teuthology.orchestra.run.smithi101.stdout:polkitd 813 900 gdbus polkitd mem REG 8,1 92968 24709 /usr/lib64/libresolv-2.28.so 2023-08-01T20:01:34.856 INFO:teuthology.orchestra.run.smithi101.stdout:polkitd 813 900 gdbus polkitd mem REG 8,1 172104 24654 /usr/lib64/libselinux.so.1 2023-08-01T20:01:34.856 INFO:teuthology.orchestra.run.smithi101.stdout:polkitd 813 900 gdbus polkitd mem REG 8,1 99640 24762 /usr/lib64/libz.so.1.2.11 2023-08-01T20:01:34.856 INFO:teuthology.orchestra.run.smithi101.stdout:polkitd 813 900 gdbus polkitd mem REG 8,1 464936 25554 /usr/lib64/libpcre.so.1.2.10 2023-08-01T20:01:34.856 INFO:teuthology.orchestra.run.smithi101.stdout:polkitd 813 900 gdbus polkitd mem REG 8,1 2051688 27472 /usr/lib64/libgnutls.so.30.28.2 2023-08-01T20:01:34.856 INFO:teuthology.orchestra.run.smithi101.stdout:polkitd 813 900 gdbus polkitd mem REG 8,1 19128 24699 /usr/lib64/libdl-2.28.so 2023-08-01T20:01:34.856 INFO:teuthology.orchestra.run.smithi101.stdout:polkitd 813 900 gdbus polkitd mem REG 8,1 37240 25164 /usr/lib64/libffi.so.6.0.2 2023-08-01T20:01:34.856 INFO:teuthology.orchestra.run.smithi101.stdout:polkitd 813 900 gdbus polkitd mem REG 8,1 16064 27417 /usr/lib64/libgmodule-2.0.so.0.5600.4 2023-08-01T20:01:34.856 INFO:teuthology.orchestra.run.smithi101.stdout:polkitd 813 900 gdbus polkitd mem REG 8,1 2089984 24698 /usr/lib64/libc-2.28.so 2023-08-01T20:01:34.857 INFO:teuthology.orchestra.run.smithi101.stdout:polkitd 813 900 gdbus polkitd mem REG 8,1 149984 24708 /usr/lib64/libpthread-2.28.so 2023-08-01T20:01:34.857 INFO:teuthology.orchestra.run.smithi101.stdout:polkitd 813 900 gdbus polkitd mem REG 8,1 99672 31445 /usr/lib64/libgcc_s-8-20210514.so.1 2023-08-01T20:01:34.857 INFO:teuthology.orchestra.run.smithi101.stdout:polkitd 813 900 gdbus polkitd mem REG 8,1 1661416 24816 /usr/lib64/libstdc++.so.6.0.25 2023-08-01T20:01:34.857 INFO:teuthology.orchestra.run.smithi101.stdout:polkitd 813 900 gdbus polkitd mem REG 8,1 23727992 25841 /usr/lib64/libmozjs-60.so.0.0.0 2023-08-01T20:01:34.857 INFO:teuthology.orchestra.run.smithi101.stdout:polkitd 813 900 gdbus polkitd mem REG 8,1 248216 24968 /usr/lib64/libexpat.so.1.6.7 2023-08-01T20:01:34.857 INFO:teuthology.orchestra.run.smithi101.stdout:polkitd 813 900 gdbus polkitd mem REG 8,1 1387784 26786 /usr/lib64/libsystemd.so.0.23.0 2023-08-01T20:01:34.857 INFO:teuthology.orchestra.run.smithi101.stdout:polkitd 813 900 gdbus polkitd mem REG 8,1 1172024 27416 /usr/lib64/libglib-2.0.so.0.5600.4 2023-08-01T20:01:34.857 INFO:teuthology.orchestra.run.smithi101.stdout:polkitd 813 900 gdbus polkitd mem REG 8,1 347416 27418 /usr/lib64/libgobject-2.0.so.0.5600.4 2023-08-01T20:01:34.858 INFO:teuthology.orchestra.run.smithi101.stdout:polkitd 813 900 gdbus polkitd mem REG 8,1 1770248 27415 /usr/lib64/libgio-2.0.so.0.5600.4 2023-08-01T20:01:34.858 INFO:teuthology.orchestra.run.smithi101.stdout:polkitd 813 900 gdbus polkitd mem REG 8,1 128184 27679 /usr/lib64/libpolkit-gobject-1.so.0.0.0 2023-08-01T20:01:34.858 INFO:teuthology.orchestra.run.smithi101.stdout:polkitd 813 900 gdbus polkitd mem REG 8,1 1062168 24653 /usr/lib64/ld-2.28.so 2023-08-01T20:01:34.858 INFO:teuthology.orchestra.run.smithi101.stdout:polkitd 813 900 gdbus polkitd mem REG 8,1 26998 35419 /usr/lib64/gconv/gconv-modules.cache 2023-08-01T20:01:34.858 INFO:teuthology.orchestra.run.smithi101.stdout:polkitd 813 900 gdbus polkitd 0u CHR 1,3 0t0 3083 /dev/null 2023-08-01T20:01:34.858 INFO:teuthology.orchestra.run.smithi101.stdout:polkitd 813 900 gdbus polkitd 1u CHR 1,3 0t0 3083 /dev/null 2023-08-01T20:01:34.858 INFO:teuthology.orchestra.run.smithi101.stdout:polkitd 813 900 gdbus polkitd 2u CHR 1,3 0t0 3083 /dev/null 2023-08-01T20:01:34.858 INFO:teuthology.orchestra.run.smithi101.stdout:polkitd 813 900 gdbus polkitd 3r a_inode 0,14 0 15587 inotify 2023-08-01T20:01:34.859 INFO:teuthology.orchestra.run.smithi101.stdout:polkitd 813 900 gdbus polkitd 4u a_inode 0,14 0 15587 [eventfd] 2023-08-01T20:01:34.859 INFO:teuthology.orchestra.run.smithi101.stdout:polkitd 813 900 gdbus polkitd 5u a_inode 0,14 0 15587 [eventfd] 2023-08-01T20:01:34.859 INFO:teuthology.orchestra.run.smithi101.stdout:polkitd 813 900 gdbus polkitd 6u unix 0xffff93750c920900 0t0 22651 type=STREAM 2023-08-01T20:01:34.859 INFO:teuthology.orchestra.run.smithi101.stdout:polkitd 813 900 gdbus polkitd 7u a_inode 0,14 0 15587 [eventfd] 2023-08-01T20:01:34.859 INFO:teuthology.orchestra.run.smithi101.stdout:polkitd 813 900 gdbus polkitd 8r a_inode 0,14 0 15587 inotify 2023-08-01T20:01:34.859 INFO:teuthology.orchestra.run.smithi101.stdout:polkitd 813 900 gdbus polkitd 9u a_inode 0,14 0 15587 [eventfd] 2023-08-01T20:01:34.859 INFO:teuthology.orchestra.run.smithi101.stdout:polkitd 813 900 gdbus polkitd 10u unix 0xffff93750c926c00 0t0 22653 type=DGRAM 2023-08-01T20:01:34.860 INFO:teuthology.orchestra.run.smithi101.stdout:polkitd 813 908 JS\x20Hel polkitd cwd DIR 8,1 4096 2 / 2023-08-01T20:01:34.860 INFO:teuthology.orchestra.run.smithi101.stdout:polkitd 813 908 JS\x20Hel polkitd rtd DIR 8,1 4096 2 / 2023-08-01T20:01:34.860 INFO:teuthology.orchestra.run.smithi101.stdout:polkitd 813 908 JS\x20Hel polkitd txt REG 8,1 142536 57377 /usr/lib/polkit-1/polkitd 2023-08-01T20:01:34.860 INFO:teuthology.orchestra.run.smithi101.stdout:polkitd 813 908 JS\x20Hel polkitd mem REG 8,1 944528 26785 /usr/lib64/libnss_systemd.so.2 2023-08-01T20:01:34.860 INFO:teuthology.orchestra.run.smithi101.stdout:polkitd 813 908 JS\x20Hel polkitd mem REG 8,1 46336 29167 /usr/lib64/libnss_sss.so.2 2023-08-01T20:01:34.860 INFO:teuthology.orchestra.run.smithi101.stdout:polkitd 813 908 JS\x20Hel polkitd mem REG 8,1 54352 24707 /usr/lib64/libnss_files-2.28.so 2023-08-01T20:01:34.860 INFO:teuthology.orchestra.run.smithi101.stdout:polkitd 813 908 JS\x20Hel polkitd mem REG 8,1 145984 24905 /usr/lib64/libgpg-error.so.0.24.2 2023-08-01T20:01:34.860 INFO:teuthology.orchestra.run.smithi101.stdout:polkitd 813 908 JS\x20Hel polkitd mem REG 8,1 33480 19526 /usr/lib64/libuuid.so.1.3.0 2023-08-01T20:01:34.861 INFO:teuthology.orchestra.run.smithi101.stdout:polkitd 813 908 JS\x20Hel polkitd mem REG 8,1 343680 19531 /usr/lib64/libblkid.so.1.1.0 2023-08-01T20:01:34.861 INFO:teuthology.orchestra.run.smithi101.stdout:polkitd 813 908 JS\x20Hel polkitd mem REG 8,1 543304 24651 /usr/lib64/libpcre2-8.so.0.7.1 2023-08-01T20:01:34.861 INFO:teuthology.orchestra.run.smithi101.stdout:polkitd 813 908 JS\x20Hel polkitd mem REG 8,1 1541856 25080 /usr/lib64/libgmp.so.10.3.2 2023-08-01T20:01:34.861 INFO:teuthology.orchestra.run.smithi101.stdout:polkitd 813 908 JS\x20Hel polkitd mem REG 8,1 197728 25272 /usr/lib64/libhogweed.so.4.5 2023-08-01T20:01:34.861 INFO:teuthology.orchestra.run.smithi101.stdout:polkitd 813 908 JS\x20Hel polkitd mem REG 8,1 239360 25274 /usr/lib64/libnettle.so.6.5 2023-08-01T20:01:34.861 INFO:teuthology.orchestra.run.smithi101.stdout:polkitd 813 908 JS\x20Hel polkitd mem REG 8,1 78816 25301 /usr/lib64/libtasn1.so.6.5.5 2023-08-01T20:01:34.861 INFO:teuthology.orchestra.run.smithi101.stdout:polkitd 813 908 JS\x20Hel polkitd mem REG 8,1 1805368 25103 /usr/lib64/libunistring.so.2.1.0 2023-08-01T20:01:34.861 INFO:teuthology.orchestra.run.smithi101.stdout:polkitd 813 908 JS\x20Hel polkitd mem REG 8,1 165624 25105 /usr/lib64/libidn2.so.0.3.6 2023-08-01T20:01:34.862 INFO:teuthology.orchestra.run.smithi101.stdout:polkitd 813 908 JS\x20Hel polkitd mem REG 8,1 1246520 25167 /usr/lib64/libp11-kit.so.0.3.0 2023-08-01T20:01:34.862 INFO:teuthology.orchestra.run.smithi101.stdout:polkitd 813 908 JS\x20Hel polkitd mem REG 8,1 1598840 24700 /usr/lib64/libm-2.28.so 2023-08-01T20:01:34.862 INFO:teuthology.orchestra.run.smithi101.stdout:polkitd 813 908 JS\x20Hel polkitd mem REG 8,1 1187312 25078 /usr/lib64/libgcrypt.so.20.2.5 2023-08-01T20:01:34.862 INFO:teuthology.orchestra.run.smithi101.stdout:polkitd 813 908 JS\x20Hel polkitd mem REG 8,1 33752 24776 /usr/lib64/libcap.so.2.48 2023-08-01T20:01:34.862 INFO:teuthology.orchestra.run.smithi101.stdout:polkitd 813 908 JS\x20Hel polkitd mem REG 8,1 119760 25264 /usr/lib64/liblz4.so.1.8.3 2023-08-01T20:01:34.862 INFO:teuthology.orchestra.run.smithi101.stdout:polkitd 813 908 JS\x20Hel polkitd mem REG 8,1 162192 24774 /usr/lib64/liblzma.so.5.2.4 2023-08-01T20:01:34.862 INFO:teuthology.orchestra.run.smithi101.stdout:polkitd 813 908 JS\x20Hel polkitd mem REG 8,1 42744 24710 /usr/lib64/librt-2.28.so 2023-08-01T20:01:34.862 INFO:teuthology.orchestra.run.smithi101.stdout:polkitd 813 908 JS\x20Hel polkitd mem REG 8,1 371480 19864 /usr/lib64/libmount.so.1.1.0 2023-08-01T20:01:34.863 INFO:teuthology.orchestra.run.smithi101.stdout:polkitd 813 908 JS\x20Hel polkitd mem REG 8,1 92968 24709 /usr/lib64/libresolv-2.28.so 2023-08-01T20:01:34.863 INFO:teuthology.orchestra.run.smithi101.stdout:polkitd 813 908 JS\x20Hel polkitd mem REG 8,1 172104 24654 /usr/lib64/libselinux.so.1 2023-08-01T20:01:34.863 INFO:teuthology.orchestra.run.smithi101.stdout:polkitd 813 908 JS\x20Hel polkitd mem REG 8,1 99640 24762 /usr/lib64/libz.so.1.2.11 2023-08-01T20:01:34.863 INFO:teuthology.orchestra.run.smithi101.stdout:polkitd 813 908 JS\x20Hel polkitd mem REG 8,1 464936 25554 /usr/lib64/libpcre.so.1.2.10 2023-08-01T20:01:34.863 INFO:teuthology.orchestra.run.smithi101.stdout:polkitd 813 908 JS\x20Hel polkitd mem REG 8,1 2051688 27472 /usr/lib64/libgnutls.so.30.28.2 2023-08-01T20:01:34.863 INFO:teuthology.orchestra.run.smithi101.stdout:polkitd 813 908 JS\x20Hel polkitd mem REG 8,1 19128 24699 /usr/lib64/libdl-2.28.so 2023-08-01T20:01:34.863 INFO:teuthology.orchestra.run.smithi101.stdout:polkitd 813 908 JS\x20Hel polkitd mem REG 8,1 37240 25164 /usr/lib64/libffi.so.6.0.2 2023-08-01T20:01:34.863 INFO:teuthology.orchestra.run.smithi101.stdout:polkitd 813 908 JS\x20Hel polkitd mem REG 8,1 16064 27417 /usr/lib64/libgmodule-2.0.so.0.5600.4 2023-08-01T20:01:34.864 INFO:teuthology.orchestra.run.smithi101.stdout:polkitd 813 908 JS\x20Hel polkitd mem REG 8,1 2089984 24698 /usr/lib64/libc-2.28.so 2023-08-01T20:01:34.864 INFO:teuthology.orchestra.run.smithi101.stdout:polkitd 813 908 JS\x20Hel polkitd mem REG 8,1 149984 24708 /usr/lib64/libpthread-2.28.so 2023-08-01T20:01:34.864 INFO:teuthology.orchestra.run.smithi101.stdout:polkitd 813 908 JS\x20Hel polkitd mem REG 8,1 99672 31445 /usr/lib64/libgcc_s-8-20210514.so.1 2023-08-01T20:01:34.864 INFO:teuthology.orchestra.run.smithi101.stdout:polkitd 813 908 JS\x20Hel polkitd mem REG 8,1 1661416 24816 /usr/lib64/libstdc++.so.6.0.25 2023-08-01T20:01:34.864 INFO:teuthology.orchestra.run.smithi101.stdout:polkitd 813 908 JS\x20Hel polkitd mem REG 8,1 23727992 25841 /usr/lib64/libmozjs-60.so.0.0.0 2023-08-01T20:01:34.864 INFO:teuthology.orchestra.run.smithi101.stdout:polkitd 813 908 JS\x20Hel polkitd mem REG 8,1 248216 24968 /usr/lib64/libexpat.so.1.6.7 2023-08-01T20:01:34.864 INFO:teuthology.orchestra.run.smithi101.stdout:polkitd 813 908 JS\x20Hel polkitd mem REG 8,1 1387784 26786 /usr/lib64/libsystemd.so.0.23.0 2023-08-01T20:01:34.864 INFO:teuthology.orchestra.run.smithi101.stdout:polkitd 813 908 JS\x20Hel polkitd mem REG 8,1 1172024 27416 /usr/lib64/libglib-2.0.so.0.5600.4 2023-08-01T20:01:34.865 INFO:teuthology.orchestra.run.smithi101.stdout:polkitd 813 908 JS\x20Hel polkitd mem REG 8,1 347416 27418 /usr/lib64/libgobject-2.0.so.0.5600.4 2023-08-01T20:01:34.865 INFO:teuthology.orchestra.run.smithi101.stdout:polkitd 813 908 JS\x20Hel polkitd mem REG 8,1 1770248 27415 /usr/lib64/libgio-2.0.so.0.5600.4 2023-08-01T20:01:34.865 INFO:teuthology.orchestra.run.smithi101.stdout:polkitd 813 908 JS\x20Hel polkitd mem REG 8,1 128184 27679 /usr/lib64/libpolkit-gobject-1.so.0.0.0 2023-08-01T20:01:34.865 INFO:teuthology.orchestra.run.smithi101.stdout:polkitd 813 908 JS\x20Hel polkitd mem REG 8,1 1062168 24653 /usr/lib64/ld-2.28.so 2023-08-01T20:01:34.865 INFO:teuthology.orchestra.run.smithi101.stdout:polkitd 813 908 JS\x20Hel polkitd mem REG 8,1 26998 35419 /usr/lib64/gconv/gconv-modules.cache 2023-08-01T20:01:34.865 INFO:teuthology.orchestra.run.smithi101.stdout:polkitd 813 908 JS\x20Hel polkitd 0u CHR 1,3 0t0 3083 /dev/null 2023-08-01T20:01:34.865 INFO:teuthology.orchestra.run.smithi101.stdout:polkitd 813 908 JS\x20Hel polkitd 1u CHR 1,3 0t0 3083 /dev/null 2023-08-01T20:01:34.866 INFO:teuthology.orchestra.run.smithi101.stdout:polkitd 813 908 JS\x20Hel polkitd 2u CHR 1,3 0t0 3083 /dev/null 2023-08-01T20:01:34.866 INFO:teuthology.orchestra.run.smithi101.stdout:polkitd 813 908 JS\x20Hel polkitd 3r a_inode 0,14 0 15587 inotify 2023-08-01T20:01:34.866 INFO:teuthology.orchestra.run.smithi101.stdout:polkitd 813 908 JS\x20Hel polkitd 4u a_inode 0,14 0 15587 [eventfd] 2023-08-01T20:01:34.866 INFO:teuthology.orchestra.run.smithi101.stdout:polkitd 813 908 JS\x20Hel polkitd 5u a_inode 0,14 0 15587 [eventfd] 2023-08-01T20:01:34.866 INFO:teuthology.orchestra.run.smithi101.stdout:polkitd 813 908 JS\x20Hel polkitd 6u unix 0xffff93750c920900 0t0 22651 type=STREAM 2023-08-01T20:01:34.866 INFO:teuthology.orchestra.run.smithi101.stdout:polkitd 813 908 JS\x20Hel polkitd 7u a_inode 0,14 0 15587 [eventfd] 2023-08-01T20:01:34.866 INFO:teuthology.orchestra.run.smithi101.stdout:polkitd 813 908 JS\x20Hel polkitd 8r a_inode 0,14 0 15587 inotify 2023-08-01T20:01:34.866 INFO:teuthology.orchestra.run.smithi101.stdout:polkitd 813 908 JS\x20Hel polkitd 9u a_inode 0,14 0 15587 [eventfd] 2023-08-01T20:01:34.867 INFO:teuthology.orchestra.run.smithi101.stdout:polkitd 813 908 JS\x20Hel polkitd 10u unix 0xffff93750c926c00 0t0 22653 type=DGRAM 2023-08-01T20:01:34.867 INFO:teuthology.orchestra.run.smithi101.stdout:polkitd 813 909 JS\x20Hel polkitd cwd DIR 8,1 4096 2 / 2023-08-01T20:01:34.867 INFO:teuthology.orchestra.run.smithi101.stdout:polkitd 813 909 JS\x20Hel polkitd rtd DIR 8,1 4096 2 / 2023-08-01T20:01:34.867 INFO:teuthology.orchestra.run.smithi101.stdout:polkitd 813 909 JS\x20Hel polkitd txt REG 8,1 142536 57377 /usr/lib/polkit-1/polkitd 2023-08-01T20:01:34.867 INFO:teuthology.orchestra.run.smithi101.stdout:polkitd 813 909 JS\x20Hel polkitd mem REG 8,1 944528 26785 /usr/lib64/libnss_systemd.so.2 2023-08-01T20:01:34.867 INFO:teuthology.orchestra.run.smithi101.stdout:polkitd 813 909 JS\x20Hel polkitd mem REG 8,1 46336 29167 /usr/lib64/libnss_sss.so.2 2023-08-01T20:01:34.867 INFO:teuthology.orchestra.run.smithi101.stdout:polkitd 813 909 JS\x20Hel polkitd mem REG 8,1 54352 24707 /usr/lib64/libnss_files-2.28.so 2023-08-01T20:01:34.867 INFO:teuthology.orchestra.run.smithi101.stdout:polkitd 813 909 JS\x20Hel polkitd mem REG 8,1 145984 24905 /usr/lib64/libgpg-error.so.0.24.2 2023-08-01T20:01:34.868 INFO:teuthology.orchestra.run.smithi101.stdout:polkitd 813 909 JS\x20Hel polkitd mem REG 8,1 33480 19526 /usr/lib64/libuuid.so.1.3.0 2023-08-01T20:01:34.868 INFO:teuthology.orchestra.run.smithi101.stdout:polkitd 813 909 JS\x20Hel polkitd mem REG 8,1 343680 19531 /usr/lib64/libblkid.so.1.1.0 2023-08-01T20:01:34.868 INFO:teuthology.orchestra.run.smithi101.stdout:polkitd 813 909 JS\x20Hel polkitd mem REG 8,1 543304 24651 /usr/lib64/libpcre2-8.so.0.7.1 2023-08-01T20:01:34.868 INFO:teuthology.orchestra.run.smithi101.stdout:polkitd 813 909 JS\x20Hel polkitd mem REG 8,1 1541856 25080 /usr/lib64/libgmp.so.10.3.2 2023-08-01T20:01:34.868 INFO:teuthology.orchestra.run.smithi101.stdout:polkitd 813 909 JS\x20Hel polkitd mem REG 8,1 197728 25272 /usr/lib64/libhogweed.so.4.5 2023-08-01T20:01:34.868 INFO:teuthology.orchestra.run.smithi101.stdout:polkitd 813 909 JS\x20Hel polkitd mem REG 8,1 239360 25274 /usr/lib64/libnettle.so.6.5 2023-08-01T20:01:34.868 INFO:teuthology.orchestra.run.smithi101.stdout:polkitd 813 909 JS\x20Hel polkitd mem REG 8,1 78816 25301 /usr/lib64/libtasn1.so.6.5.5 2023-08-01T20:01:34.869 INFO:teuthology.orchestra.run.smithi101.stdout:polkitd 813 909 JS\x20Hel polkitd mem REG 8,1 1805368 25103 /usr/lib64/libunistring.so.2.1.0 2023-08-01T20:01:34.869 INFO:teuthology.orchestra.run.smithi101.stdout:polkitd 813 909 JS\x20Hel polkitd mem REG 8,1 165624 25105 /usr/lib64/libidn2.so.0.3.6 2023-08-01T20:01:34.869 INFO:teuthology.orchestra.run.smithi101.stdout:polkitd 813 909 JS\x20Hel polkitd mem REG 8,1 1246520 25167 /usr/lib64/libp11-kit.so.0.3.0 2023-08-01T20:01:34.869 INFO:teuthology.orchestra.run.smithi101.stdout:polkitd 813 909 JS\x20Hel polkitd mem REG 8,1 1598840 24700 /usr/lib64/libm-2.28.so 2023-08-01T20:01:34.869 INFO:teuthology.orchestra.run.smithi101.stdout:polkitd 813 909 JS\x20Hel polkitd mem REG 8,1 1187312 25078 /usr/lib64/libgcrypt.so.20.2.5 2023-08-01T20:01:34.869 INFO:teuthology.orchestra.run.smithi101.stdout:polkitd 813 909 JS\x20Hel polkitd mem REG 8,1 33752 24776 /usr/lib64/libcap.so.2.48 2023-08-01T20:01:34.869 INFO:teuthology.orchestra.run.smithi101.stdout:polkitd 813 909 JS\x20Hel polkitd mem REG 8,1 119760 25264 /usr/lib64/liblz4.so.1.8.3 2023-08-01T20:01:34.869 INFO:teuthology.orchestra.run.smithi101.stdout:polkitd 813 909 JS\x20Hel polkitd mem REG 8,1 162192 24774 /usr/lib64/liblzma.so.5.2.4 2023-08-01T20:01:34.870 INFO:teuthology.orchestra.run.smithi101.stdout:polkitd 813 909 JS\x20Hel polkitd mem REG 8,1 42744 24710 /usr/lib64/librt-2.28.so 2023-08-01T20:01:34.870 INFO:teuthology.orchestra.run.smithi101.stdout:polkitd 813 909 JS\x20Hel polkitd mem REG 8,1 371480 19864 /usr/lib64/libmount.so.1.1.0 2023-08-01T20:01:34.870 INFO:teuthology.orchestra.run.smithi101.stdout:polkitd 813 909 JS\x20Hel polkitd mem REG 8,1 92968 24709 /usr/lib64/libresolv-2.28.so 2023-08-01T20:01:34.870 INFO:teuthology.orchestra.run.smithi101.stdout:polkitd 813 909 JS\x20Hel polkitd mem REG 8,1 172104 24654 /usr/lib64/libselinux.so.1 2023-08-01T20:01:34.870 INFO:teuthology.orchestra.run.smithi101.stdout:polkitd 813 909 JS\x20Hel polkitd mem REG 8,1 99640 24762 /usr/lib64/libz.so.1.2.11 2023-08-01T20:01:34.870 INFO:teuthology.orchestra.run.smithi101.stdout:polkitd 813 909 JS\x20Hel polkitd mem REG 8,1 464936 25554 /usr/lib64/libpcre.so.1.2.10 2023-08-01T20:01:34.870 INFO:teuthology.orchestra.run.smithi101.stdout:polkitd 813 909 JS\x20Hel polkitd mem REG 8,1 2051688 27472 /usr/lib64/libgnutls.so.30.28.2 2023-08-01T20:01:34.870 INFO:teuthology.orchestra.run.smithi101.stdout:polkitd 813 909 JS\x20Hel polkitd mem REG 8,1 19128 24699 /usr/lib64/libdl-2.28.so 2023-08-01T20:01:34.871 INFO:teuthology.orchestra.run.smithi101.stdout:polkitd 813 909 JS\x20Hel polkitd mem REG 8,1 37240 25164 /usr/lib64/libffi.so.6.0.2 2023-08-01T20:01:34.871 INFO:teuthology.orchestra.run.smithi101.stdout:polkitd 813 909 JS\x20Hel polkitd mem REG 8,1 16064 27417 /usr/lib64/libgmodule-2.0.so.0.5600.4 2023-08-01T20:01:34.871 INFO:teuthology.orchestra.run.smithi101.stdout:polkitd 813 909 JS\x20Hel polkitd mem REG 8,1 2089984 24698 /usr/lib64/libc-2.28.so 2023-08-01T20:01:34.871 INFO:teuthology.orchestra.run.smithi101.stdout:polkitd 813 909 JS\x20Hel polkitd mem REG 8,1 149984 24708 /usr/lib64/libpthread-2.28.so 2023-08-01T20:01:34.871 INFO:teuthology.orchestra.run.smithi101.stdout:polkitd 813 909 JS\x20Hel polkitd mem REG 8,1 99672 31445 /usr/lib64/libgcc_s-8-20210514.so.1 2023-08-01T20:01:34.871 INFO:teuthology.orchestra.run.smithi101.stdout:polkitd 813 909 JS\x20Hel polkitd mem REG 8,1 1661416 24816 /usr/lib64/libstdc++.so.6.0.25 2023-08-01T20:01:34.871 INFO:teuthology.orchestra.run.smithi101.stdout:polkitd 813 909 JS\x20Hel polkitd mem REG 8,1 23727992 25841 /usr/lib64/libmozjs-60.so.0.0.0 2023-08-01T20:01:34.871 INFO:teuthology.orchestra.run.smithi101.stdout:polkitd 813 909 JS\x20Hel polkitd mem REG 8,1 248216 24968 /usr/lib64/libexpat.so.1.6.7 2023-08-01T20:01:34.872 INFO:teuthology.orchestra.run.smithi101.stdout:polkitd 813 909 JS\x20Hel polkitd mem REG 8,1 1387784 26786 /usr/lib64/libsystemd.so.0.23.0 2023-08-01T20:01:34.872 INFO:teuthology.orchestra.run.smithi101.stdout:polkitd 813 909 JS\x20Hel polkitd mem REG 8,1 1172024 27416 /usr/lib64/libglib-2.0.so.0.5600.4 2023-08-01T20:01:34.872 INFO:teuthology.orchestra.run.smithi101.stdout:polkitd 813 909 JS\x20Hel polkitd mem REG 8,1 347416 27418 /usr/lib64/libgobject-2.0.so.0.5600.4 2023-08-01T20:01:34.872 INFO:teuthology.orchestra.run.smithi101.stdout:polkitd 813 909 JS\x20Hel polkitd mem REG 8,1 1770248 27415 /usr/lib64/libgio-2.0.so.0.5600.4 2023-08-01T20:01:34.872 INFO:teuthology.orchestra.run.smithi101.stdout:polkitd 813 909 JS\x20Hel polkitd mem REG 8,1 128184 27679 /usr/lib64/libpolkit-gobject-1.so.0.0.0 2023-08-01T20:01:34.872 INFO:teuthology.orchestra.run.smithi101.stdout:polkitd 813 909 JS\x20Hel polkitd mem REG 8,1 1062168 24653 /usr/lib64/ld-2.28.so 2023-08-01T20:01:34.872 INFO:teuthology.orchestra.run.smithi101.stdout:polkitd 813 909 JS\x20Hel polkitd mem REG 8,1 26998 35419 /usr/lib64/gconv/gconv-modules.cache 2023-08-01T20:01:34.872 INFO:teuthology.orchestra.run.smithi101.stdout:polkitd 813 909 JS\x20Hel polkitd 0u CHR 1,3 0t0 3083 /dev/null 2023-08-01T20:01:34.873 INFO:teuthology.orchestra.run.smithi101.stdout:polkitd 813 909 JS\x20Hel polkitd 1u CHR 1,3 0t0 3083 /dev/null 2023-08-01T20:01:34.873 INFO:teuthology.orchestra.run.smithi101.stdout:polkitd 813 909 JS\x20Hel polkitd 2u CHR 1,3 0t0 3083 /dev/null 2023-08-01T20:01:34.873 INFO:teuthology.orchestra.run.smithi101.stdout:polkitd 813 909 JS\x20Hel polkitd 3r a_inode 0,14 0 15587 inotify 2023-08-01T20:01:34.873 INFO:teuthology.orchestra.run.smithi101.stdout:polkitd 813 909 JS\x20Hel polkitd 4u a_inode 0,14 0 15587 [eventfd] 2023-08-01T20:01:34.873 INFO:teuthology.orchestra.run.smithi101.stdout:polkitd 813 909 JS\x20Hel polkitd 5u a_inode 0,14 0 15587 [eventfd] 2023-08-01T20:01:34.873 INFO:teuthology.orchestra.run.smithi101.stdout:polkitd 813 909 JS\x20Hel polkitd 6u unix 0xffff93750c920900 0t0 22651 type=STREAM 2023-08-01T20:01:34.873 INFO:teuthology.orchestra.run.smithi101.stdout:polkitd 813 909 JS\x20Hel polkitd 7u a_inode 0,14 0 15587 [eventfd] 2023-08-01T20:01:34.873 INFO:teuthology.orchestra.run.smithi101.stdout:polkitd 813 909 JS\x20Hel polkitd 8r a_inode 0,14 0 15587 inotify 2023-08-01T20:01:34.874 INFO:teuthology.orchestra.run.smithi101.stdout:polkitd 813 909 JS\x20Hel polkitd 9u a_inode 0,14 0 15587 [eventfd] 2023-08-01T20:01:34.874 INFO:teuthology.orchestra.run.smithi101.stdout:polkitd 813 909 JS\x20Hel polkitd 10u unix 0xffff93750c926c00 0t0 22653 type=DGRAM 2023-08-01T20:01:34.874 INFO:teuthology.orchestra.run.smithi101.stdout:polkitd 813 910 JS\x20Hel polkitd cwd DIR 8,1 4096 2 / 2023-08-01T20:01:34.874 INFO:teuthology.orchestra.run.smithi101.stdout:polkitd 813 910 JS\x20Hel polkitd rtd DIR 8,1 4096 2 / 2023-08-01T20:01:34.874 INFO:teuthology.orchestra.run.smithi101.stdout:polkitd 813 910 JS\x20Hel polkitd txt REG 8,1 142536 57377 /usr/lib/polkit-1/polkitd 2023-08-01T20:01:34.874 INFO:teuthology.orchestra.run.smithi101.stdout:polkitd 813 910 JS\x20Hel polkitd mem REG 8,1 944528 26785 /usr/lib64/libnss_systemd.so.2 2023-08-01T20:01:34.874 INFO:teuthology.orchestra.run.smithi101.stdout:polkitd 813 910 JS\x20Hel polkitd mem REG 8,1 46336 29167 /usr/lib64/libnss_sss.so.2 2023-08-01T20:01:34.875 INFO:teuthology.orchestra.run.smithi101.stdout:polkitd 813 910 JS\x20Hel polkitd mem REG 8,1 54352 24707 /usr/lib64/libnss_files-2.28.so 2023-08-01T20:01:34.875 INFO:teuthology.orchestra.run.smithi101.stdout:polkitd 813 910 JS\x20Hel polkitd mem REG 8,1 145984 24905 /usr/lib64/libgpg-error.so.0.24.2 2023-08-01T20:01:34.875 INFO:teuthology.orchestra.run.smithi101.stdout:polkitd 813 910 JS\x20Hel polkitd mem REG 8,1 33480 19526 /usr/lib64/libuuid.so.1.3.0 2023-08-01T20:01:34.875 INFO:teuthology.orchestra.run.smithi101.stdout:polkitd 813 910 JS\x20Hel polkitd mem REG 8,1 343680 19531 /usr/lib64/libblkid.so.1.1.0 2023-08-01T20:01:34.875 INFO:teuthology.orchestra.run.smithi101.stdout:polkitd 813 910 JS\x20Hel polkitd mem REG 8,1 543304 24651 /usr/lib64/libpcre2-8.so.0.7.1 2023-08-01T20:01:34.875 INFO:teuthology.orchestra.run.smithi101.stdout:polkitd 813 910 JS\x20Hel polkitd mem REG 8,1 1541856 25080 /usr/lib64/libgmp.so.10.3.2 2023-08-01T20:01:34.875 INFO:teuthology.orchestra.run.smithi101.stdout:polkitd 813 910 JS\x20Hel polkitd mem REG 8,1 197728 25272 /usr/lib64/libhogweed.so.4.5 2023-08-01T20:01:34.875 INFO:teuthology.orchestra.run.smithi101.stdout:polkitd 813 910 JS\x20Hel polkitd mem REG 8,1 239360 25274 /usr/lib64/libnettle.so.6.5 2023-08-01T20:01:34.876 INFO:teuthology.orchestra.run.smithi101.stdout:polkitd 813 910 JS\x20Hel polkitd mem REG 8,1 78816 25301 /usr/lib64/libtasn1.so.6.5.5 2023-08-01T20:01:34.876 INFO:teuthology.orchestra.run.smithi101.stdout:polkitd 813 910 JS\x20Hel polkitd mem REG 8,1 1805368 25103 /usr/lib64/libunistring.so.2.1.0 2023-08-01T20:01:34.876 INFO:teuthology.orchestra.run.smithi101.stdout:polkitd 813 910 JS\x20Hel polkitd mem REG 8,1 165624 25105 /usr/lib64/libidn2.so.0.3.6 2023-08-01T20:01:34.876 INFO:teuthology.orchestra.run.smithi101.stdout:polkitd 813 910 JS\x20Hel polkitd mem REG 8,1 1246520 25167 /usr/lib64/libp11-kit.so.0.3.0 2023-08-01T20:01:34.876 INFO:teuthology.orchestra.run.smithi101.stdout:polkitd 813 910 JS\x20Hel polkitd mem REG 8,1 1598840 24700 /usr/lib64/libm-2.28.so 2023-08-01T20:01:34.876 INFO:teuthology.orchestra.run.smithi101.stdout:polkitd 813 910 JS\x20Hel polkitd mem REG 8,1 1187312 25078 /usr/lib64/libgcrypt.so.20.2.5 2023-08-01T20:01:34.876 INFO:teuthology.orchestra.run.smithi101.stdout:polkitd 813 910 JS\x20Hel polkitd mem REG 8,1 33752 24776 /usr/lib64/libcap.so.2.48 2023-08-01T20:01:34.876 INFO:teuthology.orchestra.run.smithi101.stdout:polkitd 813 910 JS\x20Hel polkitd mem REG 8,1 119760 25264 /usr/lib64/liblz4.so.1.8.3 2023-08-01T20:01:34.877 INFO:teuthology.orchestra.run.smithi101.stdout:polkitd 813 910 JS\x20Hel polkitd mem REG 8,1 162192 24774 /usr/lib64/liblzma.so.5.2.4 2023-08-01T20:01:34.877 INFO:teuthology.orchestra.run.smithi101.stdout:polkitd 813 910 JS\x20Hel polkitd mem REG 8,1 42744 24710 /usr/lib64/librt-2.28.so 2023-08-01T20:01:34.877 INFO:teuthology.orchestra.run.smithi101.stdout:polkitd 813 910 JS\x20Hel polkitd mem REG 8,1 371480 19864 /usr/lib64/libmount.so.1.1.0 2023-08-01T20:01:34.877 INFO:teuthology.orchestra.run.smithi101.stdout:polkitd 813 910 JS\x20Hel polkitd mem REG 8,1 92968 24709 /usr/lib64/libresolv-2.28.so 2023-08-01T20:01:34.877 INFO:teuthology.orchestra.run.smithi101.stdout:polkitd 813 910 JS\x20Hel polkitd mem REG 8,1 172104 24654 /usr/lib64/libselinux.so.1 2023-08-01T20:01:34.877 INFO:teuthology.orchestra.run.smithi101.stdout:polkitd 813 910 JS\x20Hel polkitd mem REG 8,1 99640 24762 /usr/lib64/libz.so.1.2.11 2023-08-01T20:01:34.877 INFO:teuthology.orchestra.run.smithi101.stdout:polkitd 813 910 JS\x20Hel polkitd mem REG 8,1 464936 25554 /usr/lib64/libpcre.so.1.2.10 2023-08-01T20:01:34.877 INFO:teuthology.orchestra.run.smithi101.stdout:polkitd 813 910 JS\x20Hel polkitd mem REG 8,1 2051688 27472 /usr/lib64/libgnutls.so.30.28.2 2023-08-01T20:01:34.878 INFO:teuthology.orchestra.run.smithi101.stdout:polkitd 813 910 JS\x20Hel polkitd mem REG 8,1 19128 24699 /usr/lib64/libdl-2.28.so 2023-08-01T20:01:34.878 INFO:teuthology.orchestra.run.smithi101.stdout:polkitd 813 910 JS\x20Hel polkitd mem REG 8,1 37240 25164 /usr/lib64/libffi.so.6.0.2 2023-08-01T20:01:34.878 INFO:teuthology.orchestra.run.smithi101.stdout:polkitd 813 910 JS\x20Hel polkitd mem REG 8,1 16064 27417 /usr/lib64/libgmodule-2.0.so.0.5600.4 2023-08-01T20:01:34.878 INFO:teuthology.orchestra.run.smithi101.stdout:polkitd 813 910 JS\x20Hel polkitd mem REG 8,1 2089984 24698 /usr/lib64/libc-2.28.so 2023-08-01T20:01:34.878 INFO:teuthology.orchestra.run.smithi101.stdout:polkitd 813 910 JS\x20Hel polkitd mem REG 8,1 149984 24708 /usr/lib64/libpthread-2.28.so 2023-08-01T20:01:34.878 INFO:teuthology.orchestra.run.smithi101.stdout:polkitd 813 910 JS\x20Hel polkitd mem REG 8,1 99672 31445 /usr/lib64/libgcc_s-8-20210514.so.1 2023-08-01T20:01:34.878 INFO:teuthology.orchestra.run.smithi101.stdout:polkitd 813 910 JS\x20Hel polkitd mem REG 8,1 1661416 24816 /usr/lib64/libstdc++.so.6.0.25 2023-08-01T20:01:34.878 INFO:teuthology.orchestra.run.smithi101.stdout:polkitd 813 910 JS\x20Hel polkitd mem REG 8,1 23727992 25841 /usr/lib64/libmozjs-60.so.0.0.0 2023-08-01T20:01:34.879 INFO:teuthology.orchestra.run.smithi101.stdout:polkitd 813 910 JS\x20Hel polkitd mem REG 8,1 248216 24968 /usr/lib64/libexpat.so.1.6.7 2023-08-01T20:01:34.879 INFO:teuthology.orchestra.run.smithi101.stdout:polkitd 813 910 JS\x20Hel polkitd mem REG 8,1 1387784 26786 /usr/lib64/libsystemd.so.0.23.0 2023-08-01T20:01:34.879 INFO:teuthology.orchestra.run.smithi101.stdout:polkitd 813 910 JS\x20Hel polkitd mem REG 8,1 1172024 27416 /usr/lib64/libglib-2.0.so.0.5600.4 2023-08-01T20:01:34.879 INFO:teuthology.orchestra.run.smithi101.stdout:polkitd 813 910 JS\x20Hel polkitd mem REG 8,1 347416 27418 /usr/lib64/libgobject-2.0.so.0.5600.4 2023-08-01T20:01:34.879 INFO:teuthology.orchestra.run.smithi101.stdout:polkitd 813 910 JS\x20Hel polkitd mem REG 8,1 1770248 27415 /usr/lib64/libgio-2.0.so.0.5600.4 2023-08-01T20:01:34.879 INFO:teuthology.orchestra.run.smithi101.stdout:polkitd 813 910 JS\x20Hel polkitd mem REG 8,1 128184 27679 /usr/lib64/libpolkit-gobject-1.so.0.0.0 2023-08-01T20:01:34.879 INFO:teuthology.orchestra.run.smithi101.stdout:polkitd 813 910 JS\x20Hel polkitd mem REG 8,1 1062168 24653 /usr/lib64/ld-2.28.so 2023-08-01T20:01:34.879 INFO:teuthology.orchestra.run.smithi101.stdout:polkitd 813 910 JS\x20Hel polkitd mem REG 8,1 26998 35419 /usr/lib64/gconv/gconv-modules.cache 2023-08-01T20:01:34.880 INFO:teuthology.orchestra.run.smithi101.stdout:polkitd 813 910 JS\x20Hel polkitd 0u CHR 1,3 0t0 3083 /dev/null 2023-08-01T20:01:34.880 INFO:teuthology.orchestra.run.smithi101.stdout:polkitd 813 910 JS\x20Hel polkitd 1u CHR 1,3 0t0 3083 /dev/null 2023-08-01T20:01:34.880 INFO:teuthology.orchestra.run.smithi101.stdout:polkitd 813 910 JS\x20Hel polkitd 2u CHR 1,3 0t0 3083 /dev/null 2023-08-01T20:01:34.880 INFO:teuthology.orchestra.run.smithi101.stdout:polkitd 813 910 JS\x20Hel polkitd 3r a_inode 0,14 0 15587 inotify 2023-08-01T20:01:34.880 INFO:teuthology.orchestra.run.smithi101.stdout:polkitd 813 910 JS\x20Hel polkitd 4u a_inode 0,14 0 15587 [eventfd] 2023-08-01T20:01:34.880 INFO:teuthology.orchestra.run.smithi101.stdout:polkitd 813 910 JS\x20Hel polkitd 5u a_inode 0,14 0 15587 [eventfd] 2023-08-01T20:01:34.880 INFO:teuthology.orchestra.run.smithi101.stdout:polkitd 813 910 JS\x20Hel polkitd 6u unix 0xffff93750c920900 0t0 22651 type=STREAM 2023-08-01T20:01:34.880 INFO:teuthology.orchestra.run.smithi101.stdout:polkitd 813 910 JS\x20Hel polkitd 7u a_inode 0,14 0 15587 [eventfd] 2023-08-01T20:01:34.881 INFO:teuthology.orchestra.run.smithi101.stdout:polkitd 813 910 JS\x20Hel polkitd 8r a_inode 0,14 0 15587 inotify 2023-08-01T20:01:34.881 INFO:teuthology.orchestra.run.smithi101.stdout:polkitd 813 910 JS\x20Hel polkitd 9u a_inode 0,14 0 15587 [eventfd] 2023-08-01T20:01:34.881 INFO:teuthology.orchestra.run.smithi101.stdout:polkitd 813 910 JS\x20Hel polkitd 10u unix 0xffff93750c926c00 0t0 22653 type=DGRAM 2023-08-01T20:01:34.881 INFO:teuthology.orchestra.run.smithi101.stdout:polkitd 813 911 JS\x20Hel polkitd cwd DIR 8,1 4096 2 / 2023-08-01T20:01:34.881 INFO:teuthology.orchestra.run.smithi101.stdout:polkitd 813 911 JS\x20Hel polkitd rtd DIR 8,1 4096 2 / 2023-08-01T20:01:34.881 INFO:teuthology.orchestra.run.smithi101.stdout:polkitd 813 911 JS\x20Hel polkitd txt REG 8,1 142536 57377 /usr/lib/polkit-1/polkitd 2023-08-01T20:01:34.881 INFO:teuthology.orchestra.run.smithi101.stdout:polkitd 813 911 JS\x20Hel polkitd mem REG 8,1 944528 26785 /usr/lib64/libnss_systemd.so.2 2023-08-01T20:01:34.881 INFO:teuthology.orchestra.run.smithi101.stdout:polkitd 813 911 JS\x20Hel polkitd mem REG 8,1 46336 29167 /usr/lib64/libnss_sss.so.2 2023-08-01T20:01:34.882 INFO:teuthology.orchestra.run.smithi101.stdout:polkitd 813 911 JS\x20Hel polkitd mem REG 8,1 54352 24707 /usr/lib64/libnss_files-2.28.so 2023-08-01T20:01:34.882 INFO:teuthology.orchestra.run.smithi101.stdout:polkitd 813 911 JS\x20Hel polkitd mem REG 8,1 145984 24905 /usr/lib64/libgpg-error.so.0.24.2 2023-08-01T20:01:34.882 INFO:teuthology.orchestra.run.smithi101.stdout:polkitd 813 911 JS\x20Hel polkitd mem REG 8,1 33480 19526 /usr/lib64/libuuid.so.1.3.0 2023-08-01T20:01:34.882 INFO:teuthology.orchestra.run.smithi101.stdout:polkitd 813 911 JS\x20Hel polkitd mem REG 8,1 343680 19531 /usr/lib64/libblkid.so.1.1.0 2023-08-01T20:01:34.882 INFO:teuthology.orchestra.run.smithi101.stdout:polkitd 813 911 JS\x20Hel polkitd mem REG 8,1 543304 24651 /usr/lib64/libpcre2-8.so.0.7.1 2023-08-01T20:01:34.882 INFO:teuthology.orchestra.run.smithi101.stdout:polkitd 813 911 JS\x20Hel polkitd mem REG 8,1 1541856 25080 /usr/lib64/libgmp.so.10.3.2 2023-08-01T20:01:34.882 INFO:teuthology.orchestra.run.smithi101.stdout:polkitd 813 911 JS\x20Hel polkitd mem REG 8,1 197728 25272 /usr/lib64/libhogweed.so.4.5 2023-08-01T20:01:34.883 INFO:teuthology.orchestra.run.smithi101.stdout:polkitd 813 911 JS\x20Hel polkitd mem REG 8,1 239360 25274 /usr/lib64/libnettle.so.6.5 2023-08-01T20:01:34.883 INFO:teuthology.orchestra.run.smithi101.stdout:polkitd 813 911 JS\x20Hel polkitd mem REG 8,1 78816 25301 /usr/lib64/libtasn1.so.6.5.5 2023-08-01T20:01:34.883 INFO:teuthology.orchestra.run.smithi101.stdout:polkitd 813 911 JS\x20Hel polkitd mem REG 8,1 1805368 25103 /usr/lib64/libunistring.so.2.1.0 2023-08-01T20:01:34.883 INFO:teuthology.orchestra.run.smithi101.stdout:polkitd 813 911 JS\x20Hel polkitd mem REG 8,1 165624 25105 /usr/lib64/libidn2.so.0.3.6 2023-08-01T20:01:34.883 INFO:teuthology.orchestra.run.smithi101.stdout:polkitd 813 911 JS\x20Hel polkitd mem REG 8,1 1246520 25167 /usr/lib64/libp11-kit.so.0.3.0 2023-08-01T20:01:34.883 INFO:teuthology.orchestra.run.smithi101.stdout:polkitd 813 911 JS\x20Hel polkitd mem REG 8,1 1598840 24700 /usr/lib64/libm-2.28.so 2023-08-01T20:01:34.883 INFO:teuthology.orchestra.run.smithi101.stdout:polkitd 813 911 JS\x20Hel polkitd mem REG 8,1 1187312 25078 /usr/lib64/libgcrypt.so.20.2.5 2023-08-01T20:01:34.883 INFO:teuthology.orchestra.run.smithi101.stdout:polkitd 813 911 JS\x20Hel polkitd mem REG 8,1 33752 24776 /usr/lib64/libcap.so.2.48 2023-08-01T20:01:34.884 INFO:teuthology.orchestra.run.smithi101.stdout:polkitd 813 911 JS\x20Hel polkitd mem REG 8,1 119760 25264 /usr/lib64/liblz4.so.1.8.3 2023-08-01T20:01:34.884 INFO:teuthology.orchestra.run.smithi101.stdout:polkitd 813 911 JS\x20Hel polkitd mem REG 8,1 162192 24774 /usr/lib64/liblzma.so.5.2.4 2023-08-01T20:01:34.884 INFO:teuthology.orchestra.run.smithi101.stdout:polkitd 813 911 JS\x20Hel polkitd mem REG 8,1 42744 24710 /usr/lib64/librt-2.28.so 2023-08-01T20:01:34.884 INFO:teuthology.orchestra.run.smithi101.stdout:polkitd 813 911 JS\x20Hel polkitd mem REG 8,1 371480 19864 /usr/lib64/libmount.so.1.1.0 2023-08-01T20:01:34.884 INFO:teuthology.orchestra.run.smithi101.stdout:polkitd 813 911 JS\x20Hel polkitd mem REG 8,1 92968 24709 /usr/lib64/libresolv-2.28.so 2023-08-01T20:01:34.884 INFO:teuthology.orchestra.run.smithi101.stdout:polkitd 813 911 JS\x20Hel polkitd mem REG 8,1 172104 24654 /usr/lib64/libselinux.so.1 2023-08-01T20:01:34.884 INFO:teuthology.orchestra.run.smithi101.stdout:polkitd 813 911 JS\x20Hel polkitd mem REG 8,1 99640 24762 /usr/lib64/libz.so.1.2.11 2023-08-01T20:01:34.884 INFO:teuthology.orchestra.run.smithi101.stdout:polkitd 813 911 JS\x20Hel polkitd mem REG 8,1 464936 25554 /usr/lib64/libpcre.so.1.2.10 2023-08-01T20:01:34.885 INFO:teuthology.orchestra.run.smithi101.stdout:polkitd 813 911 JS\x20Hel polkitd mem REG 8,1 2051688 27472 /usr/lib64/libgnutls.so.30.28.2 2023-08-01T20:01:34.885 INFO:teuthology.orchestra.run.smithi101.stdout:polkitd 813 911 JS\x20Hel polkitd mem REG 8,1 19128 24699 /usr/lib64/libdl-2.28.so 2023-08-01T20:01:34.885 INFO:teuthology.orchestra.run.smithi101.stdout:polkitd 813 911 JS\x20Hel polkitd mem REG 8,1 37240 25164 /usr/lib64/libffi.so.6.0.2 2023-08-01T20:01:34.885 INFO:teuthology.orchestra.run.smithi101.stdout:polkitd 813 911 JS\x20Hel polkitd mem REG 8,1 16064 27417 /usr/lib64/libgmodule-2.0.so.0.5600.4 2023-08-01T20:01:34.885 INFO:teuthology.orchestra.run.smithi101.stdout:polkitd 813 911 JS\x20Hel polkitd mem REG 8,1 2089984 24698 /usr/lib64/libc-2.28.so 2023-08-01T20:01:34.885 INFO:teuthology.orchestra.run.smithi101.stdout:polkitd 813 911 JS\x20Hel polkitd mem REG 8,1 149984 24708 /usr/lib64/libpthread-2.28.so 2023-08-01T20:01:34.885 INFO:teuthology.orchestra.run.smithi101.stdout:polkitd 813 911 JS\x20Hel polkitd mem REG 8,1 99672 31445 /usr/lib64/libgcc_s-8-20210514.so.1 2023-08-01T20:01:34.885 INFO:teuthology.orchestra.run.smithi101.stdout:polkitd 813 911 JS\x20Hel polkitd mem REG 8,1 1661416 24816 /usr/lib64/libstdc++.so.6.0.25 2023-08-01T20:01:34.886 INFO:teuthology.orchestra.run.smithi101.stdout:polkitd 813 911 JS\x20Hel polkitd mem REG 8,1 23727992 25841 /usr/lib64/libmozjs-60.so.0.0.0 2023-08-01T20:01:34.886 INFO:teuthology.orchestra.run.smithi101.stdout:polkitd 813 911 JS\x20Hel polkitd mem REG 8,1 248216 24968 /usr/lib64/libexpat.so.1.6.7 2023-08-01T20:01:34.886 INFO:teuthology.orchestra.run.smithi101.stdout:polkitd 813 911 JS\x20Hel polkitd mem REG 8,1 1387784 26786 /usr/lib64/libsystemd.so.0.23.0 2023-08-01T20:01:34.886 INFO:teuthology.orchestra.run.smithi101.stdout:polkitd 813 911 JS\x20Hel polkitd mem REG 8,1 1172024 27416 /usr/lib64/libglib-2.0.so.0.5600.4 2023-08-01T20:01:34.886 INFO:teuthology.orchestra.run.smithi101.stdout:polkitd 813 911 JS\x20Hel polkitd mem REG 8,1 347416 27418 /usr/lib64/libgobject-2.0.so.0.5600.4 2023-08-01T20:01:34.886 INFO:teuthology.orchestra.run.smithi101.stdout:polkitd 813 911 JS\x20Hel polkitd mem REG 8,1 1770248 27415 /usr/lib64/libgio-2.0.so.0.5600.4 2023-08-01T20:01:34.886 INFO:teuthology.orchestra.run.smithi101.stdout:polkitd 813 911 JS\x20Hel polkitd mem REG 8,1 128184 27679 /usr/lib64/libpolkit-gobject-1.so.0.0.0 2023-08-01T20:01:34.886 INFO:teuthology.orchestra.run.smithi101.stdout:polkitd 813 911 JS\x20Hel polkitd mem REG 8,1 1062168 24653 /usr/lib64/ld-2.28.so 2023-08-01T20:01:34.887 INFO:teuthology.orchestra.run.smithi101.stdout:polkitd 813 911 JS\x20Hel polkitd mem REG 8,1 26998 35419 /usr/lib64/gconv/gconv-modules.cache 2023-08-01T20:01:34.887 INFO:teuthology.orchestra.run.smithi101.stdout:polkitd 813 911 JS\x20Hel polkitd 0u CHR 1,3 0t0 3083 /dev/null 2023-08-01T20:01:34.887 INFO:teuthology.orchestra.run.smithi101.stdout:polkitd 813 911 JS\x20Hel polkitd 1u CHR 1,3 0t0 3083 /dev/null 2023-08-01T20:01:34.887 INFO:teuthology.orchestra.run.smithi101.stdout:polkitd 813 911 JS\x20Hel polkitd 2u CHR 1,3 0t0 3083 /dev/null 2023-08-01T20:01:34.887 INFO:teuthology.orchestra.run.smithi101.stdout:polkitd 813 911 JS\x20Hel polkitd 3r a_inode 0,14 0 15587 inotify 2023-08-01T20:01:34.887 INFO:teuthology.orchestra.run.smithi101.stdout:polkitd 813 911 JS\x20Hel polkitd 4u a_inode 0,14 0 15587 [eventfd] 2023-08-01T20:01:34.887 INFO:teuthology.orchestra.run.smithi101.stdout:polkitd 813 911 JS\x20Hel polkitd 5u a_inode 0,14 0 15587 [eventfd] 2023-08-01T20:01:34.887 INFO:teuthology.orchestra.run.smithi101.stdout:polkitd 813 911 JS\x20Hel polkitd 6u unix 0xffff93750c920900 0t0 22651 type=STREAM 2023-08-01T20:01:34.888 INFO:teuthology.orchestra.run.smithi101.stdout:polkitd 813 911 JS\x20Hel polkitd 7u a_inode 0,14 0 15587 [eventfd] 2023-08-01T20:01:34.888 INFO:teuthology.orchestra.run.smithi101.stdout:polkitd 813 911 JS\x20Hel polkitd 8r a_inode 0,14 0 15587 inotify 2023-08-01T20:01:34.888 INFO:teuthology.orchestra.run.smithi101.stdout:polkitd 813 911 JS\x20Hel polkitd 9u a_inode 0,14 0 15587 [eventfd] 2023-08-01T20:01:34.888 INFO:teuthology.orchestra.run.smithi101.stdout:polkitd 813 911 JS\x20Hel polkitd 10u unix 0xffff93750c926c00 0t0 22653 type=DGRAM 2023-08-01T20:01:34.888 INFO:teuthology.orchestra.run.smithi101.stdout:polkitd 813 912 JS\x20Hel polkitd cwd DIR 8,1 4096 2 / 2023-08-01T20:01:34.888 INFO:teuthology.orchestra.run.smithi101.stdout:polkitd 813 912 JS\x20Hel polkitd rtd DIR 8,1 4096 2 / 2023-08-01T20:01:34.888 INFO:teuthology.orchestra.run.smithi101.stdout:polkitd 813 912 JS\x20Hel polkitd txt REG 8,1 142536 57377 /usr/lib/polkit-1/polkitd 2023-08-01T20:01:34.889 INFO:teuthology.orchestra.run.smithi101.stdout:polkitd 813 912 JS\x20Hel polkitd mem REG 8,1 944528 26785 /usr/lib64/libnss_systemd.so.2 2023-08-01T20:01:34.889 INFO:teuthology.orchestra.run.smithi101.stdout:polkitd 813 912 JS\x20Hel polkitd mem REG 8,1 46336 29167 /usr/lib64/libnss_sss.so.2 2023-08-01T20:01:34.889 INFO:teuthology.orchestra.run.smithi101.stdout:polkitd 813 912 JS\x20Hel polkitd mem REG 8,1 54352 24707 /usr/lib64/libnss_files-2.28.so 2023-08-01T20:01:34.889 INFO:teuthology.orchestra.run.smithi101.stdout:polkitd 813 912 JS\x20Hel polkitd mem REG 8,1 145984 24905 /usr/lib64/libgpg-error.so.0.24.2 2023-08-01T20:01:34.889 INFO:teuthology.orchestra.run.smithi101.stdout:polkitd 813 912 JS\x20Hel polkitd mem REG 8,1 33480 19526 /usr/lib64/libuuid.so.1.3.0 2023-08-01T20:01:34.889 INFO:teuthology.orchestra.run.smithi101.stdout:polkitd 813 912 JS\x20Hel polkitd mem REG 8,1 343680 19531 /usr/lib64/libblkid.so.1.1.0 2023-08-01T20:01:34.889 INFO:teuthology.orchestra.run.smithi101.stdout:polkitd 813 912 JS\x20Hel polkitd mem REG 8,1 543304 24651 /usr/lib64/libpcre2-8.so.0.7.1 2023-08-01T20:01:34.889 INFO:teuthology.orchestra.run.smithi101.stdout:polkitd 813 912 JS\x20Hel polkitd mem REG 8,1 1541856 25080 /usr/lib64/libgmp.so.10.3.2 2023-08-01T20:01:34.890 INFO:teuthology.orchestra.run.smithi101.stdout:polkitd 813 912 JS\x20Hel polkitd mem REG 8,1 197728 25272 /usr/lib64/libhogweed.so.4.5 2023-08-01T20:01:34.890 INFO:teuthology.orchestra.run.smithi101.stdout:polkitd 813 912 JS\x20Hel polkitd mem REG 8,1 239360 25274 /usr/lib64/libnettle.so.6.5 2023-08-01T20:01:34.890 INFO:teuthology.orchestra.run.smithi101.stdout:polkitd 813 912 JS\x20Hel polkitd mem REG 8,1 78816 25301 /usr/lib64/libtasn1.so.6.5.5 2023-08-01T20:01:34.890 INFO:teuthology.orchestra.run.smithi101.stdout:polkitd 813 912 JS\x20Hel polkitd mem REG 8,1 1805368 25103 /usr/lib64/libunistring.so.2.1.0 2023-08-01T20:01:34.890 INFO:teuthology.orchestra.run.smithi101.stdout:polkitd 813 912 JS\x20Hel polkitd mem REG 8,1 165624 25105 /usr/lib64/libidn2.so.0.3.6 2023-08-01T20:01:34.890 INFO:teuthology.orchestra.run.smithi101.stdout:polkitd 813 912 JS\x20Hel polkitd mem REG 8,1 1246520 25167 /usr/lib64/libp11-kit.so.0.3.0 2023-08-01T20:01:34.890 INFO:teuthology.orchestra.run.smithi101.stdout:polkitd 813 912 JS\x20Hel polkitd mem REG 8,1 1598840 24700 /usr/lib64/libm-2.28.so 2023-08-01T20:01:34.890 INFO:teuthology.orchestra.run.smithi101.stdout:polkitd 813 912 JS\x20Hel polkitd mem REG 8,1 1187312 25078 /usr/lib64/libgcrypt.so.20.2.5 2023-08-01T20:01:34.891 INFO:teuthology.orchestra.run.smithi101.stdout:polkitd 813 912 JS\x20Hel polkitd mem REG 8,1 33752 24776 /usr/lib64/libcap.so.2.48 2023-08-01T20:01:34.891 INFO:teuthology.orchestra.run.smithi101.stdout:polkitd 813 912 JS\x20Hel polkitd mem REG 8,1 119760 25264 /usr/lib64/liblz4.so.1.8.3 2023-08-01T20:01:34.891 INFO:teuthology.orchestra.run.smithi101.stdout:polkitd 813 912 JS\x20Hel polkitd mem REG 8,1 162192 24774 /usr/lib64/liblzma.so.5.2.4 2023-08-01T20:01:34.891 INFO:teuthology.orchestra.run.smithi101.stdout:polkitd 813 912 JS\x20Hel polkitd mem REG 8,1 42744 24710 /usr/lib64/librt-2.28.so 2023-08-01T20:01:34.891 INFO:teuthology.orchestra.run.smithi101.stdout:polkitd 813 912 JS\x20Hel polkitd mem REG 8,1 371480 19864 /usr/lib64/libmount.so.1.1.0 2023-08-01T20:01:34.891 INFO:teuthology.orchestra.run.smithi101.stdout:polkitd 813 912 JS\x20Hel polkitd mem REG 8,1 92968 24709 /usr/lib64/libresolv-2.28.so 2023-08-01T20:01:34.891 INFO:teuthology.orchestra.run.smithi101.stdout:polkitd 813 912 JS\x20Hel polkitd mem REG 8,1 172104 24654 /usr/lib64/libselinux.so.1 2023-08-01T20:01:34.891 INFO:teuthology.orchestra.run.smithi101.stdout:polkitd 813 912 JS\x20Hel polkitd mem REG 8,1 99640 24762 /usr/lib64/libz.so.1.2.11 2023-08-01T20:01:34.892 INFO:teuthology.orchestra.run.smithi101.stdout:polkitd 813 912 JS\x20Hel polkitd mem REG 8,1 464936 25554 /usr/lib64/libpcre.so.1.2.10 2023-08-01T20:01:34.892 INFO:teuthology.orchestra.run.smithi101.stdout:polkitd 813 912 JS\x20Hel polkitd mem REG 8,1 2051688 27472 /usr/lib64/libgnutls.so.30.28.2 2023-08-01T20:01:34.892 INFO:teuthology.orchestra.run.smithi101.stdout:polkitd 813 912 JS\x20Hel polkitd mem REG 8,1 19128 24699 /usr/lib64/libdl-2.28.so 2023-08-01T20:01:34.892 INFO:teuthology.orchestra.run.smithi101.stdout:polkitd 813 912 JS\x20Hel polkitd mem REG 8,1 37240 25164 /usr/lib64/libffi.so.6.0.2 2023-08-01T20:01:34.892 INFO:teuthology.orchestra.run.smithi101.stdout:polkitd 813 912 JS\x20Hel polkitd mem REG 8,1 16064 27417 /usr/lib64/libgmodule-2.0.so.0.5600.4 2023-08-01T20:01:34.892 INFO:teuthology.orchestra.run.smithi101.stdout:polkitd 813 912 JS\x20Hel polkitd mem REG 8,1 2089984 24698 /usr/lib64/libc-2.28.so 2023-08-01T20:01:34.892 INFO:teuthology.orchestra.run.smithi101.stdout:polkitd 813 912 JS\x20Hel polkitd mem REG 8,1 149984 24708 /usr/lib64/libpthread-2.28.so 2023-08-01T20:01:34.893 INFO:teuthology.orchestra.run.smithi101.stdout:polkitd 813 912 JS\x20Hel polkitd mem REG 8,1 99672 31445 /usr/lib64/libgcc_s-8-20210514.so.1 2023-08-01T20:01:34.893 INFO:teuthology.orchestra.run.smithi101.stdout:polkitd 813 912 JS\x20Hel polkitd mem REG 8,1 1661416 24816 /usr/lib64/libstdc++.so.6.0.25 2023-08-01T20:01:34.893 INFO:teuthology.orchestra.run.smithi101.stdout:polkitd 813 912 JS\x20Hel polkitd mem REG 8,1 23727992 25841 /usr/lib64/libmozjs-60.so.0.0.0 2023-08-01T20:01:34.893 INFO:teuthology.orchestra.run.smithi101.stdout:polkitd 813 912 JS\x20Hel polkitd mem REG 8,1 248216 24968 /usr/lib64/libexpat.so.1.6.7 2023-08-01T20:01:34.893 INFO:teuthology.orchestra.run.smithi101.stdout:polkitd 813 912 JS\x20Hel polkitd mem REG 8,1 1387784 26786 /usr/lib64/libsystemd.so.0.23.0 2023-08-01T20:01:34.893 INFO:teuthology.orchestra.run.smithi101.stdout:polkitd 813 912 JS\x20Hel polkitd mem REG 8,1 1172024 27416 /usr/lib64/libglib-2.0.so.0.5600.4 2023-08-01T20:01:34.893 INFO:teuthology.orchestra.run.smithi101.stdout:polkitd 813 912 JS\x20Hel polkitd mem REG 8,1 347416 27418 /usr/lib64/libgobject-2.0.so.0.5600.4 2023-08-01T20:01:34.893 INFO:teuthology.orchestra.run.smithi101.stdout:polkitd 813 912 JS\x20Hel polkitd mem REG 8,1 1770248 27415 /usr/lib64/libgio-2.0.so.0.5600.4 2023-08-01T20:01:34.894 INFO:teuthology.orchestra.run.smithi101.stdout:polkitd 813 912 JS\x20Hel polkitd mem REG 8,1 128184 27679 /usr/lib64/libpolkit-gobject-1.so.0.0.0 2023-08-01T20:01:34.894 INFO:teuthology.orchestra.run.smithi101.stdout:polkitd 813 912 JS\x20Hel polkitd mem REG 8,1 1062168 24653 /usr/lib64/ld-2.28.so 2023-08-01T20:01:34.894 INFO:teuthology.orchestra.run.smithi101.stdout:polkitd 813 912 JS\x20Hel polkitd mem REG 8,1 26998 35419 /usr/lib64/gconv/gconv-modules.cache 2023-08-01T20:01:34.894 INFO:teuthology.orchestra.run.smithi101.stdout:polkitd 813 912 JS\x20Hel polkitd 0u CHR 1,3 0t0 3083 /dev/null 2023-08-01T20:01:34.894 INFO:teuthology.orchestra.run.smithi101.stdout:polkitd 813 912 JS\x20Hel polkitd 1u CHR 1,3 0t0 3083 /dev/null 2023-08-01T20:01:34.894 INFO:teuthology.orchestra.run.smithi101.stdout:polkitd 813 912 JS\x20Hel polkitd 2u CHR 1,3 0t0 3083 /dev/null 2023-08-01T20:01:34.894 INFO:teuthology.orchestra.run.smithi101.stdout:polkitd 813 912 JS\x20Hel polkitd 3r a_inode 0,14 0 15587 inotify 2023-08-01T20:01:34.894 INFO:teuthology.orchestra.run.smithi101.stdout:polkitd 813 912 JS\x20Hel polkitd 4u a_inode 0,14 0 15587 [eventfd] 2023-08-01T20:01:34.895 INFO:teuthology.orchestra.run.smithi101.stdout:polkitd 813 912 JS\x20Hel polkitd 5u a_inode 0,14 0 15587 [eventfd] 2023-08-01T20:01:34.895 INFO:teuthology.orchestra.run.smithi101.stdout:polkitd 813 912 JS\x20Hel polkitd 6u unix 0xffff93750c920900 0t0 22651 type=STREAM 2023-08-01T20:01:34.895 INFO:teuthology.orchestra.run.smithi101.stdout:polkitd 813 912 JS\x20Hel polkitd 7u a_inode 0,14 0 15587 [eventfd] 2023-08-01T20:01:34.895 INFO:teuthology.orchestra.run.smithi101.stdout:polkitd 813 912 JS\x20Hel polkitd 8r a_inode 0,14 0 15587 inotify 2023-08-01T20:01:34.895 INFO:teuthology.orchestra.run.smithi101.stdout:polkitd 813 912 JS\x20Hel polkitd 9u a_inode 0,14 0 15587 [eventfd] 2023-08-01T20:01:34.895 INFO:teuthology.orchestra.run.smithi101.stdout:polkitd 813 912 JS\x20Hel polkitd 10u unix 0xffff93750c926c00 0t0 22653 type=DGRAM 2023-08-01T20:01:34.895 INFO:teuthology.orchestra.run.smithi101.stdout:polkitd 813 913 JS\x20Hel polkitd cwd DIR 8,1 4096 2 / 2023-08-01T20:01:34.895 INFO:teuthology.orchestra.run.smithi101.stdout:polkitd 813 913 JS\x20Hel polkitd rtd DIR 8,1 4096 2 / 2023-08-01T20:01:34.896 INFO:teuthology.orchestra.run.smithi101.stdout:polkitd 813 913 JS\x20Hel polkitd txt REG 8,1 142536 57377 /usr/lib/polkit-1/polkitd 2023-08-01T20:01:34.896 INFO:teuthology.orchestra.run.smithi101.stdout:polkitd 813 913 JS\x20Hel polkitd mem REG 8,1 944528 26785 /usr/lib64/libnss_systemd.so.2 2023-08-01T20:01:34.896 INFO:teuthology.orchestra.run.smithi101.stdout:polkitd 813 913 JS\x20Hel polkitd mem REG 8,1 46336 29167 /usr/lib64/libnss_sss.so.2 2023-08-01T20:01:34.896 INFO:teuthology.orchestra.run.smithi101.stdout:polkitd 813 913 JS\x20Hel polkitd mem REG 8,1 54352 24707 /usr/lib64/libnss_files-2.28.so 2023-08-01T20:01:34.896 INFO:teuthology.orchestra.run.smithi101.stdout:polkitd 813 913 JS\x20Hel polkitd mem REG 8,1 145984 24905 /usr/lib64/libgpg-error.so.0.24.2 2023-08-01T20:01:34.896 INFO:teuthology.orchestra.run.smithi101.stdout:polkitd 813 913 JS\x20Hel polkitd mem REG 8,1 33480 19526 /usr/lib64/libuuid.so.1.3.0 2023-08-01T20:01:34.896 INFO:teuthology.orchestra.run.smithi101.stdout:polkitd 813 913 JS\x20Hel polkitd mem REG 8,1 343680 19531 /usr/lib64/libblkid.so.1.1.0 2023-08-01T20:01:34.896 INFO:teuthology.orchestra.run.smithi101.stdout:polkitd 813 913 JS\x20Hel polkitd mem REG 8,1 543304 24651 /usr/lib64/libpcre2-8.so.0.7.1 2023-08-01T20:01:34.897 INFO:teuthology.orchestra.run.smithi101.stdout:polkitd 813 913 JS\x20Hel polkitd mem REG 8,1 1541856 25080 /usr/lib64/libgmp.so.10.3.2 2023-08-01T20:01:34.897 INFO:teuthology.orchestra.run.smithi101.stdout:polkitd 813 913 JS\x20Hel polkitd mem REG 8,1 197728 25272 /usr/lib64/libhogweed.so.4.5 2023-08-01T20:01:34.897 INFO:teuthology.orchestra.run.smithi101.stdout:polkitd 813 913 JS\x20Hel polkitd mem REG 8,1 239360 25274 /usr/lib64/libnettle.so.6.5 2023-08-01T20:01:34.897 INFO:teuthology.orchestra.run.smithi101.stdout:polkitd 813 913 JS\x20Hel polkitd mem REG 8,1 78816 25301 /usr/lib64/libtasn1.so.6.5.5 2023-08-01T20:01:34.897 INFO:teuthology.orchestra.run.smithi101.stdout:polkitd 813 913 JS\x20Hel polkitd mem REG 8,1 1805368 25103 /usr/lib64/libunistring.so.2.1.0 2023-08-01T20:01:34.897 INFO:teuthology.orchestra.run.smithi101.stdout:polkitd 813 913 JS\x20Hel polkitd mem REG 8,1 165624 25105 /usr/lib64/libidn2.so.0.3.6 2023-08-01T20:01:34.897 INFO:teuthology.orchestra.run.smithi101.stdout:polkitd 813 913 JS\x20Hel polkitd mem REG 8,1 1246520 25167 /usr/lib64/libp11-kit.so.0.3.0 2023-08-01T20:01:34.897 INFO:teuthology.orchestra.run.smithi101.stdout:polkitd 813 913 JS\x20Hel polkitd mem REG 8,1 1598840 24700 /usr/lib64/libm-2.28.so 2023-08-01T20:01:34.898 INFO:teuthology.orchestra.run.smithi101.stdout:polkitd 813 913 JS\x20Hel polkitd mem REG 8,1 1187312 25078 /usr/lib64/libgcrypt.so.20.2.5 2023-08-01T20:01:34.898 INFO:teuthology.orchestra.run.smithi101.stdout:polkitd 813 913 JS\x20Hel polkitd mem REG 8,1 33752 24776 /usr/lib64/libcap.so.2.48 2023-08-01T20:01:34.898 INFO:teuthology.orchestra.run.smithi101.stdout:polkitd 813 913 JS\x20Hel polkitd mem REG 8,1 119760 25264 /usr/lib64/liblz4.so.1.8.3 2023-08-01T20:01:34.898 INFO:teuthology.orchestra.run.smithi101.stdout:polkitd 813 913 JS\x20Hel polkitd mem REG 8,1 162192 24774 /usr/lib64/liblzma.so.5.2.4 2023-08-01T20:01:34.898 INFO:teuthology.orchestra.run.smithi101.stdout:polkitd 813 913 JS\x20Hel polkitd mem REG 8,1 42744 24710 /usr/lib64/librt-2.28.so 2023-08-01T20:01:34.898 INFO:teuthology.orchestra.run.smithi101.stdout:polkitd 813 913 JS\x20Hel polkitd mem REG 8,1 371480 19864 /usr/lib64/libmount.so.1.1.0 2023-08-01T20:01:34.898 INFO:teuthology.orchestra.run.smithi101.stdout:polkitd 813 913 JS\x20Hel polkitd mem REG 8,1 92968 24709 /usr/lib64/libresolv-2.28.so 2023-08-01T20:01:34.898 INFO:teuthology.orchestra.run.smithi101.stdout:polkitd 813 913 JS\x20Hel polkitd mem REG 8,1 172104 24654 /usr/lib64/libselinux.so.1 2023-08-01T20:01:34.899 INFO:teuthology.orchestra.run.smithi101.stdout:polkitd 813 913 JS\x20Hel polkitd mem REG 8,1 99640 24762 /usr/lib64/libz.so.1.2.11 2023-08-01T20:01:34.899 INFO:teuthology.orchestra.run.smithi101.stdout:polkitd 813 913 JS\x20Hel polkitd mem REG 8,1 464936 25554 /usr/lib64/libpcre.so.1.2.10 2023-08-01T20:01:34.899 INFO:teuthology.orchestra.run.smithi101.stdout:polkitd 813 913 JS\x20Hel polkitd mem REG 8,1 2051688 27472 /usr/lib64/libgnutls.so.30.28.2 2023-08-01T20:01:34.899 INFO:teuthology.orchestra.run.smithi101.stdout:polkitd 813 913 JS\x20Hel polkitd mem REG 8,1 19128 24699 /usr/lib64/libdl-2.28.so 2023-08-01T20:01:34.899 INFO:teuthology.orchestra.run.smithi101.stdout:polkitd 813 913 JS\x20Hel polkitd mem REG 8,1 37240 25164 /usr/lib64/libffi.so.6.0.2 2023-08-01T20:01:34.899 INFO:teuthology.orchestra.run.smithi101.stdout:polkitd 813 913 JS\x20Hel polkitd mem REG 8,1 16064 27417 /usr/lib64/libgmodule-2.0.so.0.5600.4 2023-08-01T20:01:34.899 INFO:teuthology.orchestra.run.smithi101.stdout:polkitd 813 913 JS\x20Hel polkitd mem REG 8,1 2089984 24698 /usr/lib64/libc-2.28.so 2023-08-01T20:01:34.900 INFO:teuthology.orchestra.run.smithi101.stdout:polkitd 813 913 JS\x20Hel polkitd mem REG 8,1 149984 24708 /usr/lib64/libpthread-2.28.so 2023-08-01T20:01:34.900 INFO:teuthology.orchestra.run.smithi101.stdout:polkitd 813 913 JS\x20Hel polkitd mem REG 8,1 99672 31445 /usr/lib64/libgcc_s-8-20210514.so.1 2023-08-01T20:01:34.900 INFO:teuthology.orchestra.run.smithi101.stdout:polkitd 813 913 JS\x20Hel polkitd mem REG 8,1 1661416 24816 /usr/lib64/libstdc++.so.6.0.25 2023-08-01T20:01:34.900 INFO:teuthology.orchestra.run.smithi101.stdout:polkitd 813 913 JS\x20Hel polkitd mem REG 8,1 23727992 25841 /usr/lib64/libmozjs-60.so.0.0.0 2023-08-01T20:01:34.900 INFO:teuthology.orchestra.run.smithi101.stdout:polkitd 813 913 JS\x20Hel polkitd mem REG 8,1 248216 24968 /usr/lib64/libexpat.so.1.6.7 2023-08-01T20:01:34.900 INFO:teuthology.orchestra.run.smithi101.stdout:polkitd 813 913 JS\x20Hel polkitd mem REG 8,1 1387784 26786 /usr/lib64/libsystemd.so.0.23.0 2023-08-01T20:01:34.900 INFO:teuthology.orchestra.run.smithi101.stdout:polkitd 813 913 JS\x20Hel polkitd mem REG 8,1 1172024 27416 /usr/lib64/libglib-2.0.so.0.5600.4 2023-08-01T20:01:34.900 INFO:teuthology.orchestra.run.smithi101.stdout:polkitd 813 913 JS\x20Hel polkitd mem REG 8,1 347416 27418 /usr/lib64/libgobject-2.0.so.0.5600.4 2023-08-01T20:01:34.901 INFO:teuthology.orchestra.run.smithi101.stdout:polkitd 813 913 JS\x20Hel polkitd mem REG 8,1 1770248 27415 /usr/lib64/libgio-2.0.so.0.5600.4 2023-08-01T20:01:34.901 INFO:teuthology.orchestra.run.smithi101.stdout:polkitd 813 913 JS\x20Hel polkitd mem REG 8,1 128184 27679 /usr/lib64/libpolkit-gobject-1.so.0.0.0 2023-08-01T20:01:34.901 INFO:teuthology.orchestra.run.smithi101.stdout:polkitd 813 913 JS\x20Hel polkitd mem REG 8,1 1062168 24653 /usr/lib64/ld-2.28.so 2023-08-01T20:01:34.901 INFO:teuthology.orchestra.run.smithi101.stdout:polkitd 813 913 JS\x20Hel polkitd mem REG 8,1 26998 35419 /usr/lib64/gconv/gconv-modules.cache 2023-08-01T20:01:34.901 INFO:teuthology.orchestra.run.smithi101.stdout:polkitd 813 913 JS\x20Hel polkitd 0u CHR 1,3 0t0 3083 /dev/null 2023-08-01T20:01:34.901 INFO:teuthology.orchestra.run.smithi101.stdout:polkitd 813 913 JS\x20Hel polkitd 1u CHR 1,3 0t0 3083 /dev/null 2023-08-01T20:01:34.901 INFO:teuthology.orchestra.run.smithi101.stdout:polkitd 813 913 JS\x20Hel polkitd 2u CHR 1,3 0t0 3083 /dev/null 2023-08-01T20:01:34.901 INFO:teuthology.orchestra.run.smithi101.stdout:polkitd 813 913 JS\x20Hel polkitd 3r a_inode 0,14 0 15587 inotify 2023-08-01T20:01:34.902 INFO:teuthology.orchestra.run.smithi101.stdout:polkitd 813 913 JS\x20Hel polkitd 4u a_inode 0,14 0 15587 [eventfd] 2023-08-01T20:01:34.902 INFO:teuthology.orchestra.run.smithi101.stdout:polkitd 813 913 JS\x20Hel polkitd 5u a_inode 0,14 0 15587 [eventfd] 2023-08-01T20:01:34.902 INFO:teuthology.orchestra.run.smithi101.stdout:polkitd 813 913 JS\x20Hel polkitd 6u unix 0xffff93750c920900 0t0 22651 type=STREAM 2023-08-01T20:01:34.902 INFO:teuthology.orchestra.run.smithi101.stdout:polkitd 813 913 JS\x20Hel polkitd 7u a_inode 0,14 0 15587 [eventfd] 2023-08-01T20:01:34.902 INFO:teuthology.orchestra.run.smithi101.stdout:polkitd 813 913 JS\x20Hel polkitd 8r a_inode 0,14 0 15587 inotify 2023-08-01T20:01:34.902 INFO:teuthology.orchestra.run.smithi101.stdout:polkitd 813 913 JS\x20Hel polkitd 9u a_inode 0,14 0 15587 [eventfd] 2023-08-01T20:01:34.902 INFO:teuthology.orchestra.run.smithi101.stdout:polkitd 813 913 JS\x20Hel polkitd 10u unix 0xffff93750c926c00 0t0 22653 type=DGRAM 2023-08-01T20:01:34.902 INFO:teuthology.orchestra.run.smithi101.stdout:polkitd 813 914 JS\x20Hel polkitd cwd DIR 8,1 4096 2 / 2023-08-01T20:01:34.903 INFO:teuthology.orchestra.run.smithi101.stdout:polkitd 813 914 JS\x20Hel polkitd rtd DIR 8,1 4096 2 / 2023-08-01T20:01:34.903 INFO:teuthology.orchestra.run.smithi101.stdout:polkitd 813 914 JS\x20Hel polkitd txt REG 8,1 142536 57377 /usr/lib/polkit-1/polkitd 2023-08-01T20:01:34.903 INFO:teuthology.orchestra.run.smithi101.stdout:polkitd 813 914 JS\x20Hel polkitd mem REG 8,1 944528 26785 /usr/lib64/libnss_systemd.so.2 2023-08-01T20:01:34.903 INFO:teuthology.orchestra.run.smithi101.stdout:polkitd 813 914 JS\x20Hel polkitd mem REG 8,1 46336 29167 /usr/lib64/libnss_sss.so.2 2023-08-01T20:01:34.903 INFO:teuthology.orchestra.run.smithi101.stdout:polkitd 813 914 JS\x20Hel polkitd mem REG 8,1 54352 24707 /usr/lib64/libnss_files-2.28.so 2023-08-01T20:01:34.903 INFO:teuthology.orchestra.run.smithi101.stdout:polkitd 813 914 JS\x20Hel polkitd mem REG 8,1 145984 24905 /usr/lib64/libgpg-error.so.0.24.2 2023-08-01T20:01:34.903 INFO:teuthology.orchestra.run.smithi101.stdout:polkitd 813 914 JS\x20Hel polkitd mem REG 8,1 33480 19526 /usr/lib64/libuuid.so.1.3.0 2023-08-01T20:01:34.904 INFO:teuthology.orchestra.run.smithi101.stdout:polkitd 813 914 JS\x20Hel polkitd mem REG 8,1 343680 19531 /usr/lib64/libblkid.so.1.1.0 2023-08-01T20:01:34.904 INFO:teuthology.orchestra.run.smithi101.stdout:polkitd 813 914 JS\x20Hel polkitd mem REG 8,1 543304 24651 /usr/lib64/libpcre2-8.so.0.7.1 2023-08-01T20:01:34.904 INFO:teuthology.orchestra.run.smithi101.stdout:polkitd 813 914 JS\x20Hel polkitd mem REG 8,1 1541856 25080 /usr/lib64/libgmp.so.10.3.2 2023-08-01T20:01:34.904 INFO:teuthology.orchestra.run.smithi101.stdout:polkitd 813 914 JS\x20Hel polkitd mem REG 8,1 197728 25272 /usr/lib64/libhogweed.so.4.5 2023-08-01T20:01:34.904 INFO:teuthology.orchestra.run.smithi101.stdout:polkitd 813 914 JS\x20Hel polkitd mem REG 8,1 239360 25274 /usr/lib64/libnettle.so.6.5 2023-08-01T20:01:34.904 INFO:teuthology.orchestra.run.smithi101.stdout:polkitd 813 914 JS\x20Hel polkitd mem REG 8,1 78816 25301 /usr/lib64/libtasn1.so.6.5.5 2023-08-01T20:01:34.904 INFO:teuthology.orchestra.run.smithi101.stdout:polkitd 813 914 JS\x20Hel polkitd mem REG 8,1 1805368 25103 /usr/lib64/libunistring.so.2.1.0 2023-08-01T20:01:34.904 INFO:teuthology.orchestra.run.smithi101.stdout:polkitd 813 914 JS\x20Hel polkitd mem REG 8,1 165624 25105 /usr/lib64/libidn2.so.0.3.6 2023-08-01T20:01:34.905 INFO:teuthology.orchestra.run.smithi101.stdout:polkitd 813 914 JS\x20Hel polkitd mem REG 8,1 1246520 25167 /usr/lib64/libp11-kit.so.0.3.0 2023-08-01T20:01:34.905 INFO:teuthology.orchestra.run.smithi101.stdout:polkitd 813 914 JS\x20Hel polkitd mem REG 8,1 1598840 24700 /usr/lib64/libm-2.28.so 2023-08-01T20:01:34.905 INFO:teuthology.orchestra.run.smithi101.stdout:polkitd 813 914 JS\x20Hel polkitd mem REG 8,1 1187312 25078 /usr/lib64/libgcrypt.so.20.2.5 2023-08-01T20:01:34.905 INFO:teuthology.orchestra.run.smithi101.stdout:polkitd 813 914 JS\x20Hel polkitd mem REG 8,1 33752 24776 /usr/lib64/libcap.so.2.48 2023-08-01T20:01:34.905 INFO:teuthology.orchestra.run.smithi101.stdout:polkitd 813 914 JS\x20Hel polkitd mem REG 8,1 119760 25264 /usr/lib64/liblz4.so.1.8.3 2023-08-01T20:01:34.905 INFO:teuthology.orchestra.run.smithi101.stdout:polkitd 813 914 JS\x20Hel polkitd mem REG 8,1 162192 24774 /usr/lib64/liblzma.so.5.2.4 2023-08-01T20:01:34.905 INFO:teuthology.orchestra.run.smithi101.stdout:polkitd 813 914 JS\x20Hel polkitd mem REG 8,1 42744 24710 /usr/lib64/librt-2.28.so 2023-08-01T20:01:34.905 INFO:teuthology.orchestra.run.smithi101.stdout:polkitd 813 914 JS\x20Hel polkitd mem REG 8,1 371480 19864 /usr/lib64/libmount.so.1.1.0 2023-08-01T20:01:34.906 INFO:teuthology.orchestra.run.smithi101.stdout:polkitd 813 914 JS\x20Hel polkitd mem REG 8,1 92968 24709 /usr/lib64/libresolv-2.28.so 2023-08-01T20:01:34.906 INFO:teuthology.orchestra.run.smithi101.stdout:polkitd 813 914 JS\x20Hel polkitd mem REG 8,1 172104 24654 /usr/lib64/libselinux.so.1 2023-08-01T20:01:34.906 INFO:teuthology.orchestra.run.smithi101.stdout:polkitd 813 914 JS\x20Hel polkitd mem REG 8,1 99640 24762 /usr/lib64/libz.so.1.2.11 2023-08-01T20:01:34.906 INFO:teuthology.orchestra.run.smithi101.stdout:polkitd 813 914 JS\x20Hel polkitd mem REG 8,1 464936 25554 /usr/lib64/libpcre.so.1.2.10 2023-08-01T20:01:34.906 INFO:teuthology.orchestra.run.smithi101.stdout:polkitd 813 914 JS\x20Hel polkitd mem REG 8,1 2051688 27472 /usr/lib64/libgnutls.so.30.28.2 2023-08-01T20:01:34.906 INFO:teuthology.orchestra.run.smithi101.stdout:polkitd 813 914 JS\x20Hel polkitd mem REG 8,1 19128 24699 /usr/lib64/libdl-2.28.so 2023-08-01T20:01:34.906 INFO:teuthology.orchestra.run.smithi101.stdout:polkitd 813 914 JS\x20Hel polkitd mem REG 8,1 37240 25164 /usr/lib64/libffi.so.6.0.2 2023-08-01T20:01:34.906 INFO:teuthology.orchestra.run.smithi101.stdout:polkitd 813 914 JS\x20Hel polkitd mem REG 8,1 16064 27417 /usr/lib64/libgmodule-2.0.so.0.5600.4 2023-08-01T20:01:34.907 INFO:teuthology.orchestra.run.smithi101.stdout:polkitd 813 914 JS\x20Hel polkitd mem REG 8,1 2089984 24698 /usr/lib64/libc-2.28.so 2023-08-01T20:01:34.907 INFO:teuthology.orchestra.run.smithi101.stdout:polkitd 813 914 JS\x20Hel polkitd mem REG 8,1 149984 24708 /usr/lib64/libpthread-2.28.so 2023-08-01T20:01:34.907 INFO:teuthology.orchestra.run.smithi101.stdout:polkitd 813 914 JS\x20Hel polkitd mem REG 8,1 99672 31445 /usr/lib64/libgcc_s-8-20210514.so.1 2023-08-01T20:01:34.907 INFO:teuthology.orchestra.run.smithi101.stdout:polkitd 813 914 JS\x20Hel polkitd mem REG 8,1 1661416 24816 /usr/lib64/libstdc++.so.6.0.25 2023-08-01T20:01:34.907 INFO:teuthology.orchestra.run.smithi101.stdout:polkitd 813 914 JS\x20Hel polkitd mem REG 8,1 23727992 25841 /usr/lib64/libmozjs-60.so.0.0.0 2023-08-01T20:01:34.907 INFO:teuthology.orchestra.run.smithi101.stdout:polkitd 813 914 JS\x20Hel polkitd mem REG 8,1 248216 24968 /usr/lib64/libexpat.so.1.6.7 2023-08-01T20:01:34.907 INFO:teuthology.orchestra.run.smithi101.stdout:polkitd 813 914 JS\x20Hel polkitd mem REG 8,1 1387784 26786 /usr/lib64/libsystemd.so.0.23.0 2023-08-01T20:01:34.907 INFO:teuthology.orchestra.run.smithi101.stdout:polkitd 813 914 JS\x20Hel polkitd mem REG 8,1 1172024 27416 /usr/lib64/libglib-2.0.so.0.5600.4 2023-08-01T20:01:34.908 INFO:teuthology.orchestra.run.smithi101.stdout:polkitd 813 914 JS\x20Hel polkitd mem REG 8,1 347416 27418 /usr/lib64/libgobject-2.0.so.0.5600.4 2023-08-01T20:01:34.908 INFO:teuthology.orchestra.run.smithi101.stdout:polkitd 813 914 JS\x20Hel polkitd mem REG 8,1 1770248 27415 /usr/lib64/libgio-2.0.so.0.5600.4 2023-08-01T20:01:34.908 INFO:teuthology.orchestra.run.smithi101.stdout:polkitd 813 914 JS\x20Hel polkitd mem REG 8,1 128184 27679 /usr/lib64/libpolkit-gobject-1.so.0.0.0 2023-08-01T20:01:34.908 INFO:teuthology.orchestra.run.smithi101.stdout:polkitd 813 914 JS\x20Hel polkitd mem REG 8,1 1062168 24653 /usr/lib64/ld-2.28.so 2023-08-01T20:01:34.908 INFO:teuthology.orchestra.run.smithi101.stdout:polkitd 813 914 JS\x20Hel polkitd mem REG 8,1 26998 35419 /usr/lib64/gconv/gconv-modules.cache 2023-08-01T20:01:34.908 INFO:teuthology.orchestra.run.smithi101.stdout:polkitd 813 914 JS\x20Hel polkitd 0u CHR 1,3 0t0 3083 /dev/null 2023-08-01T20:01:34.908 INFO:teuthology.orchestra.run.smithi101.stdout:polkitd 813 914 JS\x20Hel polkitd 1u CHR 1,3 0t0 3083 /dev/null 2023-08-01T20:01:34.909 INFO:teuthology.orchestra.run.smithi101.stdout:polkitd 813 914 JS\x20Hel polkitd 2u CHR 1,3 0t0 3083 /dev/null 2023-08-01T20:01:34.909 INFO:teuthology.orchestra.run.smithi101.stdout:polkitd 813 914 JS\x20Hel polkitd 3r a_inode 0,14 0 15587 inotify 2023-08-01T20:01:34.909 INFO:teuthology.orchestra.run.smithi101.stdout:polkitd 813 914 JS\x20Hel polkitd 4u a_inode 0,14 0 15587 [eventfd] 2023-08-01T20:01:34.909 INFO:teuthology.orchestra.run.smithi101.stdout:polkitd 813 914 JS\x20Hel polkitd 5u a_inode 0,14 0 15587 [eventfd] 2023-08-01T20:01:34.909 INFO:teuthology.orchestra.run.smithi101.stdout:polkitd 813 914 JS\x20Hel polkitd 6u unix 0xffff93750c920900 0t0 22651 type=STREAM 2023-08-01T20:01:34.909 INFO:teuthology.orchestra.run.smithi101.stdout:polkitd 813 914 JS\x20Hel polkitd 7u a_inode 0,14 0 15587 [eventfd] 2023-08-01T20:01:34.909 INFO:teuthology.orchestra.run.smithi101.stdout:polkitd 813 914 JS\x20Hel polkitd 8r a_inode 0,14 0 15587 inotify 2023-08-01T20:01:34.909 INFO:teuthology.orchestra.run.smithi101.stdout:polkitd 813 914 JS\x20Hel polkitd 9u a_inode 0,14 0 15587 [eventfd] 2023-08-01T20:01:34.910 INFO:teuthology.orchestra.run.smithi101.stdout:polkitd 813 914 JS\x20Hel polkitd 10u unix 0xffff93750c926c00 0t0 22653 type=DGRAM 2023-08-01T20:01:34.910 INFO:teuthology.orchestra.run.smithi101.stdout:polkitd 813 915 JS\x20Hel polkitd cwd DIR 8,1 4096 2 / 2023-08-01T20:01:34.910 INFO:teuthology.orchestra.run.smithi101.stdout:polkitd 813 915 JS\x20Hel polkitd rtd DIR 8,1 4096 2 / 2023-08-01T20:01:34.910 INFO:teuthology.orchestra.run.smithi101.stdout:polkitd 813 915 JS\x20Hel polkitd txt REG 8,1 142536 57377 /usr/lib/polkit-1/polkitd 2023-08-01T20:01:34.910 INFO:teuthology.orchestra.run.smithi101.stdout:polkitd 813 915 JS\x20Hel polkitd mem REG 8,1 944528 26785 /usr/lib64/libnss_systemd.so.2 2023-08-01T20:01:34.910 INFO:teuthology.orchestra.run.smithi101.stdout:polkitd 813 915 JS\x20Hel polkitd mem REG 8,1 46336 29167 /usr/lib64/libnss_sss.so.2 2023-08-01T20:01:34.910 INFO:teuthology.orchestra.run.smithi101.stdout:polkitd 813 915 JS\x20Hel polkitd mem REG 8,1 54352 24707 /usr/lib64/libnss_files-2.28.so 2023-08-01T20:01:34.910 INFO:teuthology.orchestra.run.smithi101.stdout:polkitd 813 915 JS\x20Hel polkitd mem REG 8,1 145984 24905 /usr/lib64/libgpg-error.so.0.24.2 2023-08-01T20:01:34.911 INFO:teuthology.orchestra.run.smithi101.stdout:polkitd 813 915 JS\x20Hel polkitd mem REG 8,1 33480 19526 /usr/lib64/libuuid.so.1.3.0 2023-08-01T20:01:34.911 INFO:teuthology.orchestra.run.smithi101.stdout:polkitd 813 915 JS\x20Hel polkitd mem REG 8,1 343680 19531 /usr/lib64/libblkid.so.1.1.0 2023-08-01T20:01:34.911 INFO:teuthology.orchestra.run.smithi101.stdout:polkitd 813 915 JS\x20Hel polkitd mem REG 8,1 543304 24651 /usr/lib64/libpcre2-8.so.0.7.1 2023-08-01T20:01:34.911 INFO:teuthology.orchestra.run.smithi101.stdout:polkitd 813 915 JS\x20Hel polkitd mem REG 8,1 1541856 25080 /usr/lib64/libgmp.so.10.3.2 2023-08-01T20:01:34.911 INFO:teuthology.orchestra.run.smithi101.stdout:polkitd 813 915 JS\x20Hel polkitd mem REG 8,1 197728 25272 /usr/lib64/libhogweed.so.4.5 2023-08-01T20:01:34.911 INFO:teuthology.orchestra.run.smithi101.stdout:polkitd 813 915 JS\x20Hel polkitd mem REG 8,1 239360 25274 /usr/lib64/libnettle.so.6.5 2023-08-01T20:01:34.911 INFO:teuthology.orchestra.run.smithi101.stdout:polkitd 813 915 JS\x20Hel polkitd mem REG 8,1 78816 25301 /usr/lib64/libtasn1.so.6.5.5 2023-08-01T20:01:34.911 INFO:teuthology.orchestra.run.smithi101.stdout:polkitd 813 915 JS\x20Hel polkitd mem REG 8,1 1805368 25103 /usr/lib64/libunistring.so.2.1.0 2023-08-01T20:01:34.912 INFO:teuthology.orchestra.run.smithi101.stdout:polkitd 813 915 JS\x20Hel polkitd mem REG 8,1 165624 25105 /usr/lib64/libidn2.so.0.3.6 2023-08-01T20:01:34.912 INFO:teuthology.orchestra.run.smithi101.stdout:polkitd 813 915 JS\x20Hel polkitd mem REG 8,1 1246520 25167 /usr/lib64/libp11-kit.so.0.3.0 2023-08-01T20:01:34.912 INFO:teuthology.orchestra.run.smithi101.stdout:polkitd 813 915 JS\x20Hel polkitd mem REG 8,1 1598840 24700 /usr/lib64/libm-2.28.so 2023-08-01T20:01:34.912 INFO:teuthology.orchestra.run.smithi101.stdout:polkitd 813 915 JS\x20Hel polkitd mem REG 8,1 1187312 25078 /usr/lib64/libgcrypt.so.20.2.5 2023-08-01T20:01:34.912 INFO:teuthology.orchestra.run.smithi101.stdout:polkitd 813 915 JS\x20Hel polkitd mem REG 8,1 33752 24776 /usr/lib64/libcap.so.2.48 2023-08-01T20:01:34.912 INFO:teuthology.orchestra.run.smithi101.stdout:polkitd 813 915 JS\x20Hel polkitd mem REG 8,1 119760 25264 /usr/lib64/liblz4.so.1.8.3 2023-08-01T20:01:34.912 INFO:teuthology.orchestra.run.smithi101.stdout:polkitd 813 915 JS\x20Hel polkitd mem REG 8,1 162192 24774 /usr/lib64/liblzma.so.5.2.4 2023-08-01T20:01:34.912 INFO:teuthology.orchestra.run.smithi101.stdout:polkitd 813 915 JS\x20Hel polkitd mem REG 8,1 42744 24710 /usr/lib64/librt-2.28.so 2023-08-01T20:01:34.913 INFO:teuthology.orchestra.run.smithi101.stdout:polkitd 813 915 JS\x20Hel polkitd mem REG 8,1 371480 19864 /usr/lib64/libmount.so.1.1.0 2023-08-01T20:01:34.913 INFO:teuthology.orchestra.run.smithi101.stdout:polkitd 813 915 JS\x20Hel polkitd mem REG 8,1 92968 24709 /usr/lib64/libresolv-2.28.so 2023-08-01T20:01:34.913 INFO:teuthology.orchestra.run.smithi101.stdout:polkitd 813 915 JS\x20Hel polkitd mem REG 8,1 172104 24654 /usr/lib64/libselinux.so.1 2023-08-01T20:01:34.913 INFO:teuthology.orchestra.run.smithi101.stdout:polkitd 813 915 JS\x20Hel polkitd mem REG 8,1 99640 24762 /usr/lib64/libz.so.1.2.11 2023-08-01T20:01:34.913 INFO:teuthology.orchestra.run.smithi101.stdout:polkitd 813 915 JS\x20Hel polkitd mem REG 8,1 464936 25554 /usr/lib64/libpcre.so.1.2.10 2023-08-01T20:01:34.913 INFO:teuthology.orchestra.run.smithi101.stdout:polkitd 813 915 JS\x20Hel polkitd mem REG 8,1 2051688 27472 /usr/lib64/libgnutls.so.30.28.2 2023-08-01T20:01:34.913 INFO:teuthology.orchestra.run.smithi101.stdout:polkitd 813 915 JS\x20Hel polkitd mem REG 8,1 19128 24699 /usr/lib64/libdl-2.28.so 2023-08-01T20:01:34.913 INFO:teuthology.orchestra.run.smithi101.stdout:polkitd 813 915 JS\x20Hel polkitd mem REG 8,1 37240 25164 /usr/lib64/libffi.so.6.0.2 2023-08-01T20:01:34.914 INFO:teuthology.orchestra.run.smithi101.stdout:polkitd 813 915 JS\x20Hel polkitd mem REG 8,1 16064 27417 /usr/lib64/libgmodule-2.0.so.0.5600.4 2023-08-01T20:01:34.914 INFO:teuthology.orchestra.run.smithi101.stdout:polkitd 813 915 JS\x20Hel polkitd mem REG 8,1 2089984 24698 /usr/lib64/libc-2.28.so 2023-08-01T20:01:34.914 INFO:teuthology.orchestra.run.smithi101.stdout:polkitd 813 915 JS\x20Hel polkitd mem REG 8,1 149984 24708 /usr/lib64/libpthread-2.28.so 2023-08-01T20:01:34.914 INFO:teuthology.orchestra.run.smithi101.stdout:polkitd 813 915 JS\x20Hel polkitd mem REG 8,1 99672 31445 /usr/lib64/libgcc_s-8-20210514.so.1 2023-08-01T20:01:34.914 INFO:teuthology.orchestra.run.smithi101.stdout:polkitd 813 915 JS\x20Hel polkitd mem REG 8,1 1661416 24816 /usr/lib64/libstdc++.so.6.0.25 2023-08-01T20:01:34.914 INFO:teuthology.orchestra.run.smithi101.stdout:polkitd 813 915 JS\x20Hel polkitd mem REG 8,1 23727992 25841 /usr/lib64/libmozjs-60.so.0.0.0 2023-08-01T20:01:34.914 INFO:teuthology.orchestra.run.smithi101.stdout:polkitd 813 915 JS\x20Hel polkitd mem REG 8,1 248216 24968 /usr/lib64/libexpat.so.1.6.7 2023-08-01T20:01:34.915 INFO:teuthology.orchestra.run.smithi101.stdout:polkitd 813 915 JS\x20Hel polkitd mem REG 8,1 1387784 26786 /usr/lib64/libsystemd.so.0.23.0 2023-08-01T20:01:34.915 INFO:teuthology.orchestra.run.smithi101.stdout:polkitd 813 915 JS\x20Hel polkitd mem REG 8,1 1172024 27416 /usr/lib64/libglib-2.0.so.0.5600.4 2023-08-01T20:01:34.915 INFO:teuthology.orchestra.run.smithi101.stdout:polkitd 813 915 JS\x20Hel polkitd mem REG 8,1 347416 27418 /usr/lib64/libgobject-2.0.so.0.5600.4 2023-08-01T20:01:34.915 INFO:teuthology.orchestra.run.smithi101.stdout:polkitd 813 915 JS\x20Hel polkitd mem REG 8,1 1770248 27415 /usr/lib64/libgio-2.0.so.0.5600.4 2023-08-01T20:01:34.915 INFO:teuthology.orchestra.run.smithi101.stdout:polkitd 813 915 JS\x20Hel polkitd mem REG 8,1 128184 27679 /usr/lib64/libpolkit-gobject-1.so.0.0.0 2023-08-01T20:01:34.915 INFO:teuthology.orchestra.run.smithi101.stdout:polkitd 813 915 JS\x20Hel polkitd mem REG 8,1 1062168 24653 /usr/lib64/ld-2.28.so 2023-08-01T20:01:34.915 INFO:teuthology.orchestra.run.smithi101.stdout:polkitd 813 915 JS\x20Hel polkitd mem REG 8,1 26998 35419 /usr/lib64/gconv/gconv-modules.cache 2023-08-01T20:01:34.915 INFO:teuthology.orchestra.run.smithi101.stdout:polkitd 813 915 JS\x20Hel polkitd 0u CHR 1,3 0t0 3083 /dev/null 2023-08-01T20:01:34.916 INFO:teuthology.orchestra.run.smithi101.stdout:polkitd 813 915 JS\x20Hel polkitd 1u CHR 1,3 0t0 3083 /dev/null 2023-08-01T20:01:34.916 INFO:teuthology.orchestra.run.smithi101.stdout:polkitd 813 915 JS\x20Hel polkitd 2u CHR 1,3 0t0 3083 /dev/null 2023-08-01T20:01:34.916 INFO:teuthology.orchestra.run.smithi101.stdout:polkitd 813 915 JS\x20Hel polkitd 3r a_inode 0,14 0 15587 inotify 2023-08-01T20:01:34.916 INFO:teuthology.orchestra.run.smithi101.stdout:polkitd 813 915 JS\x20Hel polkitd 4u a_inode 0,14 0 15587 [eventfd] 2023-08-01T20:01:34.916 INFO:teuthology.orchestra.run.smithi101.stdout:polkitd 813 915 JS\x20Hel polkitd 5u a_inode 0,14 0 15587 [eventfd] 2023-08-01T20:01:34.916 INFO:teuthology.orchestra.run.smithi101.stdout:polkitd 813 915 JS\x20Hel polkitd 6u unix 0xffff93750c920900 0t0 22651 type=STREAM 2023-08-01T20:01:34.916 INFO:teuthology.orchestra.run.smithi101.stdout:polkitd 813 915 JS\x20Hel polkitd 7u a_inode 0,14 0 15587 [eventfd] 2023-08-01T20:01:34.916 INFO:teuthology.orchestra.run.smithi101.stdout:polkitd 813 915 JS\x20Hel polkitd 8r a_inode 0,14 0 15587 inotify 2023-08-01T20:01:34.917 INFO:teuthology.orchestra.run.smithi101.stdout:polkitd 813 915 JS\x20Hel polkitd 9u a_inode 0,14 0 15587 [eventfd] 2023-08-01T20:01:34.917 INFO:teuthology.orchestra.run.smithi101.stdout:polkitd 813 915 JS\x20Hel polkitd 10u unix 0xffff93750c926c00 0t0 22653 type=DGRAM 2023-08-01T20:01:34.917 INFO:teuthology.orchestra.run.smithi101.stdout:polkitd 813 920 polkitd polkitd cwd DIR 8,1 4096 2 / 2023-08-01T20:01:34.917 INFO:teuthology.orchestra.run.smithi101.stdout:polkitd 813 920 polkitd polkitd rtd DIR 8,1 4096 2 / 2023-08-01T20:01:34.917 INFO:teuthology.orchestra.run.smithi101.stdout:polkitd 813 920 polkitd polkitd txt REG 8,1 142536 57377 /usr/lib/polkit-1/polkitd 2023-08-01T20:01:34.917 INFO:teuthology.orchestra.run.smithi101.stdout:polkitd 813 920 polkitd polkitd mem REG 8,1 944528 26785 /usr/lib64/libnss_systemd.so.2 2023-08-01T20:01:34.917 INFO:teuthology.orchestra.run.smithi101.stdout:polkitd 813 920 polkitd polkitd mem REG 8,1 46336 29167 /usr/lib64/libnss_sss.so.2 2023-08-01T20:01:34.917 INFO:teuthology.orchestra.run.smithi101.stdout:polkitd 813 920 polkitd polkitd mem REG 8,1 54352 24707 /usr/lib64/libnss_files-2.28.so 2023-08-01T20:01:34.918 INFO:teuthology.orchestra.run.smithi101.stdout:polkitd 813 920 polkitd polkitd mem REG 8,1 145984 24905 /usr/lib64/libgpg-error.so.0.24.2 2023-08-01T20:01:34.918 INFO:teuthology.orchestra.run.smithi101.stdout:polkitd 813 920 polkitd polkitd mem REG 8,1 33480 19526 /usr/lib64/libuuid.so.1.3.0 2023-08-01T20:01:34.918 INFO:teuthology.orchestra.run.smithi101.stdout:polkitd 813 920 polkitd polkitd mem REG 8,1 343680 19531 /usr/lib64/libblkid.so.1.1.0 2023-08-01T20:01:34.918 INFO:teuthology.orchestra.run.smithi101.stdout:polkitd 813 920 polkitd polkitd mem REG 8,1 543304 24651 /usr/lib64/libpcre2-8.so.0.7.1 2023-08-01T20:01:34.918 INFO:teuthology.orchestra.run.smithi101.stdout:polkitd 813 920 polkitd polkitd mem REG 8,1 1541856 25080 /usr/lib64/libgmp.so.10.3.2 2023-08-01T20:01:34.918 INFO:teuthology.orchestra.run.smithi101.stdout:polkitd 813 920 polkitd polkitd mem REG 8,1 197728 25272 /usr/lib64/libhogweed.so.4.5 2023-08-01T20:01:34.918 INFO:teuthology.orchestra.run.smithi101.stdout:polkitd 813 920 polkitd polkitd mem REG 8,1 239360 25274 /usr/lib64/libnettle.so.6.5 2023-08-01T20:01:34.918 INFO:teuthology.orchestra.run.smithi101.stdout:polkitd 813 920 polkitd polkitd mem REG 8,1 78816 25301 /usr/lib64/libtasn1.so.6.5.5 2023-08-01T20:01:34.919 INFO:teuthology.orchestra.run.smithi101.stdout:polkitd 813 920 polkitd polkitd mem REG 8,1 1805368 25103 /usr/lib64/libunistring.so.2.1.0 2023-08-01T20:01:34.919 INFO:teuthology.orchestra.run.smithi101.stdout:polkitd 813 920 polkitd polkitd mem REG 8,1 165624 25105 /usr/lib64/libidn2.so.0.3.6 2023-08-01T20:01:34.919 INFO:teuthology.orchestra.run.smithi101.stdout:polkitd 813 920 polkitd polkitd mem REG 8,1 1246520 25167 /usr/lib64/libp11-kit.so.0.3.0 2023-08-01T20:01:34.919 INFO:teuthology.orchestra.run.smithi101.stdout:polkitd 813 920 polkitd polkitd mem REG 8,1 1598840 24700 /usr/lib64/libm-2.28.so 2023-08-01T20:01:34.919 INFO:teuthology.orchestra.run.smithi101.stdout:polkitd 813 920 polkitd polkitd mem REG 8,1 1187312 25078 /usr/lib64/libgcrypt.so.20.2.5 2023-08-01T20:01:34.919 INFO:teuthology.orchestra.run.smithi101.stdout:polkitd 813 920 polkitd polkitd mem REG 8,1 33752 24776 /usr/lib64/libcap.so.2.48 2023-08-01T20:01:34.919 INFO:teuthology.orchestra.run.smithi101.stdout:polkitd 813 920 polkitd polkitd mem REG 8,1 119760 25264 /usr/lib64/liblz4.so.1.8.3 2023-08-01T20:01:34.919 INFO:teuthology.orchestra.run.smithi101.stdout:polkitd 813 920 polkitd polkitd mem REG 8,1 162192 24774 /usr/lib64/liblzma.so.5.2.4 2023-08-01T20:01:34.920 INFO:teuthology.orchestra.run.smithi101.stdout:polkitd 813 920 polkitd polkitd mem REG 8,1 42744 24710 /usr/lib64/librt-2.28.so 2023-08-01T20:01:34.920 INFO:teuthology.orchestra.run.smithi101.stdout:polkitd 813 920 polkitd polkitd mem REG 8,1 371480 19864 /usr/lib64/libmount.so.1.1.0 2023-08-01T20:01:34.920 INFO:teuthology.orchestra.run.smithi101.stdout:polkitd 813 920 polkitd polkitd mem REG 8,1 92968 24709 /usr/lib64/libresolv-2.28.so 2023-08-01T20:01:34.920 INFO:teuthology.orchestra.run.smithi101.stdout:polkitd 813 920 polkitd polkitd mem REG 8,1 172104 24654 /usr/lib64/libselinux.so.1 2023-08-01T20:01:34.920 INFO:teuthology.orchestra.run.smithi101.stdout:polkitd 813 920 polkitd polkitd mem REG 8,1 99640 24762 /usr/lib64/libz.so.1.2.11 2023-08-01T20:01:34.920 INFO:teuthology.orchestra.run.smithi101.stdout:polkitd 813 920 polkitd polkitd mem REG 8,1 464936 25554 /usr/lib64/libpcre.so.1.2.10 2023-08-01T20:01:34.920 INFO:teuthology.orchestra.run.smithi101.stdout:polkitd 813 920 polkitd polkitd mem REG 8,1 2051688 27472 /usr/lib64/libgnutls.so.30.28.2 2023-08-01T20:01:34.921 INFO:teuthology.orchestra.run.smithi101.stdout:polkitd 813 920 polkitd polkitd mem REG 8,1 19128 24699 /usr/lib64/libdl-2.28.so 2023-08-01T20:01:34.921 INFO:teuthology.orchestra.run.smithi101.stdout:polkitd 813 920 polkitd polkitd mem REG 8,1 37240 25164 /usr/lib64/libffi.so.6.0.2 2023-08-01T20:01:34.921 INFO:teuthology.orchestra.run.smithi101.stdout:polkitd 813 920 polkitd polkitd mem REG 8,1 16064 27417 /usr/lib64/libgmodule-2.0.so.0.5600.4 2023-08-01T20:01:34.921 INFO:teuthology.orchestra.run.smithi101.stdout:polkitd 813 920 polkitd polkitd mem REG 8,1 2089984 24698 /usr/lib64/libc-2.28.so 2023-08-01T20:01:34.921 INFO:teuthology.orchestra.run.smithi101.stdout:polkitd 813 920 polkitd polkitd mem REG 8,1 149984 24708 /usr/lib64/libpthread-2.28.so 2023-08-01T20:01:34.921 INFO:teuthology.orchestra.run.smithi101.stdout:polkitd 813 920 polkitd polkitd mem REG 8,1 99672 31445 /usr/lib64/libgcc_s-8-20210514.so.1 2023-08-01T20:01:34.921 INFO:teuthology.orchestra.run.smithi101.stdout:polkitd 813 920 polkitd polkitd mem REG 8,1 1661416 24816 /usr/lib64/libstdc++.so.6.0.25 2023-08-01T20:01:34.921 INFO:teuthology.orchestra.run.smithi101.stdout:polkitd 813 920 polkitd polkitd mem REG 8,1 23727992 25841 /usr/lib64/libmozjs-60.so.0.0.0 2023-08-01T20:01:34.922 INFO:teuthology.orchestra.run.smithi101.stdout:polkitd 813 920 polkitd polkitd mem REG 8,1 248216 24968 /usr/lib64/libexpat.so.1.6.7 2023-08-01T20:01:34.922 INFO:teuthology.orchestra.run.smithi101.stdout:polkitd 813 920 polkitd polkitd mem REG 8,1 1387784 26786 /usr/lib64/libsystemd.so.0.23.0 2023-08-01T20:01:34.922 INFO:teuthology.orchestra.run.smithi101.stdout:polkitd 813 920 polkitd polkitd mem REG 8,1 1172024 27416 /usr/lib64/libglib-2.0.so.0.5600.4 2023-08-01T20:01:34.922 INFO:teuthology.orchestra.run.smithi101.stdout:polkitd 813 920 polkitd polkitd mem REG 8,1 347416 27418 /usr/lib64/libgobject-2.0.so.0.5600.4 2023-08-01T20:01:34.922 INFO:teuthology.orchestra.run.smithi101.stdout:polkitd 813 920 polkitd polkitd mem REG 8,1 1770248 27415 /usr/lib64/libgio-2.0.so.0.5600.4 2023-08-01T20:01:34.922 INFO:teuthology.orchestra.run.smithi101.stdout:polkitd 813 920 polkitd polkitd mem REG 8,1 128184 27679 /usr/lib64/libpolkit-gobject-1.so.0.0.0 2023-08-01T20:01:34.922 INFO:teuthology.orchestra.run.smithi101.stdout:polkitd 813 920 polkitd polkitd mem REG 8,1 1062168 24653 /usr/lib64/ld-2.28.so 2023-08-01T20:01:34.922 INFO:teuthology.orchestra.run.smithi101.stdout:polkitd 813 920 polkitd polkitd mem REG 8,1 26998 35419 /usr/lib64/gconv/gconv-modules.cache 2023-08-01T20:01:34.923 INFO:teuthology.orchestra.run.smithi101.stdout:polkitd 813 920 polkitd polkitd 0u CHR 1,3 0t0 3083 /dev/null 2023-08-01T20:01:34.923 INFO:teuthology.orchestra.run.smithi101.stdout:polkitd 813 920 polkitd polkitd 1u CHR 1,3 0t0 3083 /dev/null 2023-08-01T20:01:34.923 INFO:teuthology.orchestra.run.smithi101.stdout:polkitd 813 920 polkitd polkitd 2u CHR 1,3 0t0 3083 /dev/null 2023-08-01T20:01:34.923 INFO:teuthology.orchestra.run.smithi101.stdout:polkitd 813 920 polkitd polkitd 3r a_inode 0,14 0 15587 inotify 2023-08-01T20:01:34.923 INFO:teuthology.orchestra.run.smithi101.stdout:polkitd 813 920 polkitd polkitd 4u a_inode 0,14 0 15587 [eventfd] 2023-08-01T20:01:34.923 INFO:teuthology.orchestra.run.smithi101.stdout:polkitd 813 920 polkitd polkitd 5u a_inode 0,14 0 15587 [eventfd] 2023-08-01T20:01:34.923 INFO:teuthology.orchestra.run.smithi101.stdout:polkitd 813 920 polkitd polkitd 6u unix 0xffff93750c920900 0t0 22651 type=STREAM 2023-08-01T20:01:34.923 INFO:teuthology.orchestra.run.smithi101.stdout:polkitd 813 920 polkitd polkitd 7u a_inode 0,14 0 15587 [eventfd] 2023-08-01T20:01:34.924 INFO:teuthology.orchestra.run.smithi101.stdout:polkitd 813 920 polkitd polkitd 8r a_inode 0,14 0 15587 inotify 2023-08-01T20:01:34.924 INFO:teuthology.orchestra.run.smithi101.stdout:polkitd 813 920 polkitd polkitd 9u a_inode 0,14 0 15587 [eventfd] 2023-08-01T20:01:34.924 INFO:teuthology.orchestra.run.smithi101.stdout:polkitd 813 920 polkitd polkitd 10u unix 0xffff93750c926c00 0t0 22653 type=DGRAM 2023-08-01T20:01:34.924 INFO:teuthology.orchestra.run.smithi101.stdout:lsmd 816 libstoragemgmt cwd DIR 8,1 4096 2 / 2023-08-01T20:01:34.924 INFO:teuthology.orchestra.run.smithi101.stdout:lsmd 816 libstoragemgmt rtd DIR 8,1 4096 2 / 2023-08-01T20:01:34.924 INFO:teuthology.orchestra.run.smithi101.stdout:lsmd 816 libstoragemgmt txt REG 8,1 25472 28704 /usr/bin/lsmd 2023-08-01T20:01:34.924 INFO:teuthology.orchestra.run.smithi101.stdout:lsmd 816 libstoragemgmt mem REG 8,1 54352 24707 /usr/lib64/libnss_files-2.28.so 2023-08-01T20:01:34.925 INFO:teuthology.orchestra.run.smithi101.stdout:lsmd 816 libstoragemgmt mem REG 8,1 2089984 24698 /usr/lib64/libc-2.28.so 2023-08-01T20:01:34.925 INFO:teuthology.orchestra.run.smithi101.stdout:lsmd 816 libstoragemgmt mem REG 8,1 55104 25835 /usr/lib64/libconfig.so.9.2.0 2023-08-01T20:01:34.925 INFO:teuthology.orchestra.run.smithi101.stdout:lsmd 816 libstoragemgmt mem REG 8,1 1062168 24653 /usr/lib64/ld-2.28.so 2023-08-01T20:01:34.925 INFO:teuthology.orchestra.run.smithi101.stdout:lsmd 816 libstoragemgmt 0r CHR 1,3 0t0 3083 /dev/null 2023-08-01T20:01:34.925 INFO:teuthology.orchestra.run.smithi101.stdout:lsmd 816 libstoragemgmt 1u unix 0xffff9370586cba80 0t0 30761 type=STREAM 2023-08-01T20:01:34.925 INFO:teuthology.orchestra.run.smithi101.stdout:lsmd 816 libstoragemgmt 2u unix 0xffff9370586cb180 0t0 30762 type=STREAM 2023-08-01T20:01:34.925 INFO:teuthology.orchestra.run.smithi101.stdout:lsmd 816 libstoragemgmt 3uW REG 0,24 0 30905 /run/lsm/ipc/.lsmd-ipc-lock 2023-08-01T20:01:34.926 INFO:teuthology.orchestra.run.smithi101.stdout:lsmd 816 libstoragemgmt 5u unix 0xffff9370586cc800 0t0 30909 /var/run/lsm/ipc/simc type=STREAM 2023-08-01T20:01:34.926 INFO:teuthology.orchestra.run.smithi101.stdout:lsmd 816 libstoragemgmt 6u unix 0xffff9370586c9b00 0t0 30911 /var/run/lsm/ipc/sim type=STREAM 2023-08-01T20:01:34.926 INFO:teuthology.orchestra.run.smithi101.stdout:ceph-cras 818 ceph cwd DIR 8,1 4096 2 / 2023-08-01T20:01:34.926 INFO:teuthology.orchestra.run.smithi101.stdout:ceph-cras 818 ceph rtd DIR 8,1 4096 2 / 2023-08-01T20:01:34.926 INFO:teuthology.orchestra.run.smithi101.stdout:ceph-cras 818 ceph txt REG 8,1 11856 35518 /usr/libexec/platform-python3.6 2023-08-01T20:01:34.926 INFO:teuthology.orchestra.run.smithi101.stdout:ceph-cras 818 ceph mem REG 8,1 20688 55975 /usr/lib64/python3.6/lib-dynload/_posixsubprocess.cpython-36m-x86_64-linux-gnu.so 2023-08-01T20:01:34.926 INFO:teuthology.orchestra.run.smithi101.stdout:ceph-cras 818 ceph mem REG 8,1 29256 54005 /usr/lib64/python3.6/lib-dynload/select.cpython-36m-x86_64-linux-gnu.so 2023-08-01T20:01:34.926 INFO:teuthology.orchestra.run.smithi101.stdout:ceph-cras 818 ceph mem REG 8,1 59368 55985 /usr/lib64/python3.6/lib-dynload/math.cpython-36m-x86_64-linux-gnu.so 2023-08-01T20:01:34.927 INFO:teuthology.orchestra.run.smithi101.stdout:ceph-cras 818 ceph mem REG 8,1 92984 55978 /usr/lib64/python3.6/lib-dynload/_socket.cpython-36m-x86_64-linux-gnu.so 2023-08-01T20:01:34.927 INFO:teuthology.orchestra.run.smithi101.stdout:ceph-cras 818 ceph mem REG 8,1 13200 55984 /usr/lib64/python3.6/lib-dynload/grp.cpython-36m-x86_64-linux-gnu.so 2023-08-01T20:01:34.927 INFO:teuthology.orchestra.run.smithi101.stdout:ceph-cras 818 ceph mem REG 8,1 56768 55981 /usr/lib64/python3.6/lib-dynload/_struct.cpython-36m-x86_64-linux-gnu.so 2023-08-01T20:01:34.927 INFO:teuthology.orchestra.run.smithi101.stdout:ceph-cras 818 ceph mem REG 8,1 27136 55970 /usr/lib64/python3.6/lib-dynload/_heapq.cpython-36m-x86_64-linux-gnu.so 2023-08-01T20:01:34.927 INFO:teuthology.orchestra.run.smithi101.stdout:ceph-cras 818 ceph mem REG 8,1 54352 24707 /usr/lib64/libnss_files-2.28.so 2023-08-01T20:01:34.927 INFO:teuthology.orchestra.run.smithi101.stdout:ceph-cras 818 ceph mem REG 8,1 2586930 39433 /usr/lib/locale/en_US.utf8/LC_COLLATE 2023-08-01T20:01:34.927 INFO:teuthology.orchestra.run.smithi101.stdout:ceph-cras 818 ceph mem REG 8,1 99640 24762 /usr/lib64/libz.so.1.2.11 2023-08-01T20:01:34.927 INFO:teuthology.orchestra.run.smithi101.stdout:ceph-cras 818 ceph mem REG 8,1 2089984 24698 /usr/lib64/libc-2.28.so 2023-08-01T20:01:34.928 INFO:teuthology.orchestra.run.smithi101.stdout:ceph-cras 818 ceph mem REG 8,1 1598840 24700 /usr/lib64/libm-2.28.so 2023-08-01T20:01:34.928 INFO:teuthology.orchestra.run.smithi101.stdout:ceph-cras 818 ceph mem REG 8,1 17016 24713 /usr/lib64/libutil-2.28.so 2023-08-01T20:01:34.928 INFO:teuthology.orchestra.run.smithi101.stdout:ceph-cras 818 ceph mem REG 8,1 19128 24699 /usr/lib64/libdl-2.28.so 2023-08-01T20:01:34.928 INFO:teuthology.orchestra.run.smithi101.stdout:ceph-cras 818 ceph mem REG 8,1 149984 24708 /usr/lib64/libpthread-2.28.so 2023-08-01T20:01:34.928 INFO:teuthology.orchestra.run.smithi101.stdout:ceph-cras 818 ceph mem REG 8,1 3286032 31711 /usr/lib64/libpython3.6m.so.1.0 2023-08-01T20:01:34.928 INFO:teuthology.orchestra.run.smithi101.stdout:ceph-cras 818 ceph mem REG 8,1 3083608 26861 /usr/lib64/libcrypto.so.1.1.1k 2023-08-01T20:01:34.928 INFO:teuthology.orchestra.run.smithi101.stdout:ceph-cras 818 ceph mem REG 8,1 1062168 24653 /usr/lib64/ld-2.28.so 2023-08-01T20:01:34.929 INFO:teuthology.orchestra.run.smithi101.stdout:ceph-cras 818 ceph mem REG 8,1 337024 45489 /usr/lib/locale/C.utf8/LC_CTYPE 2023-08-01T20:01:34.929 INFO:teuthology.orchestra.run.smithi101.stdout:ceph-cras 818 ceph mem REG 8,1 54 44174 /usr/lib/locale/en_US.utf8/LC_NUMERIC 2023-08-01T20:01:34.929 INFO:teuthology.orchestra.run.smithi101.stdout:ceph-cras 818 ceph mem REG 8,1 3316 48200 /usr/lib/locale/en_US.utf8/LC_TIME 2023-08-01T20:01:34.929 INFO:teuthology.orchestra.run.smithi101.stdout:ceph-cras 818 ceph mem REG 8,1 286 48207 /usr/lib/locale/en_US.utf8/LC_MONETARY 2023-08-01T20:01:34.929 INFO:teuthology.orchestra.run.smithi101.stdout:ceph-cras 818 ceph mem REG 8,1 26998 35419 /usr/lib64/gconv/gconv-modules.cache 2023-08-01T20:01:34.929 INFO:teuthology.orchestra.run.smithi101.stdout:ceph-cras 818 ceph mem REG 8,1 57 39434 /usr/lib/locale/en_US.utf8/LC_MESSAGES/SYS_LC_MESSAGES 2023-08-01T20:01:34.929 INFO:teuthology.orchestra.run.smithi101.stdout:ceph-cras 818 ceph mem REG 8,1 34 39448 /usr/lib/locale/en_US.utf8/LC_PAPER 2023-08-01T20:01:34.929 INFO:teuthology.orchestra.run.smithi101.stdout:ceph-cras 818 ceph mem REG 8,1 77 44173 /usr/lib/locale/en_US.utf8/LC_NAME 2023-08-01T20:01:34.930 INFO:teuthology.orchestra.run.smithi101.stdout:ceph-cras 818 ceph mem REG 8,1 167 45462 /usr/lib/locale/en_US.utf8/LC_ADDRESS 2023-08-01T20:01:34.930 INFO:teuthology.orchestra.run.smithi101.stdout:ceph-cras 818 ceph mem REG 8,1 59 48208 /usr/lib/locale/en_US.utf8/LC_TELEPHONE 2023-08-01T20:01:34.930 INFO:teuthology.orchestra.run.smithi101.stdout:ceph-cras 818 ceph mem REG 8,1 23 48206 /usr/lib/locale/en_US.utf8/LC_MEASUREMENT 2023-08-01T20:01:34.930 INFO:teuthology.orchestra.run.smithi101.stdout:ceph-cras 818 ceph mem REG 8,1 368 48205 /usr/lib/locale/en_US.utf8/LC_IDENTIFICATION 2023-08-01T20:01:34.930 INFO:teuthology.orchestra.run.smithi101.stdout:ceph-cras 818 ceph 0r CHR 1,3 0t0 3083 /dev/null 2023-08-01T20:01:34.930 INFO:teuthology.orchestra.run.smithi101.stdout:ceph-cras 818 ceph 1u unix 0xffff9370586cde80 0t0 30872 type=STREAM 2023-08-01T20:01:34.930 INFO:teuthology.orchestra.run.smithi101.stdout:ceph-cras 818 ceph 2u unix 0xffff9370586cde80 0t0 30872 type=STREAM 2023-08-01T20:01:34.930 INFO:teuthology.orchestra.run.smithi101.stdout:dbus-daem 819 dbus cwd DIR 8,1 4096 2 / 2023-08-01T20:01:34.931 INFO:teuthology.orchestra.run.smithi101.stdout:dbus-daem 819 dbus rtd DIR 8,1 4096 2 / 2023-08-01T20:01:34.931 INFO:teuthology.orchestra.run.smithi101.stdout:dbus-daem 819 dbus txt REG 8,1 245552 26906 /usr/bin/dbus-daemon 2023-08-01T20:01:34.931 INFO:teuthology.orchestra.run.smithi101.stdout:dbus-daem 819 dbus mem REG 8,1 944528 26785 /usr/lib64/libnss_systemd.so.2 2023-08-01T20:01:34.931 INFO:teuthology.orchestra.run.smithi101.stdout:dbus-daem 819 dbus mem REG 8,1 46336 29167 /usr/lib64/libnss_sss.so.2 2023-08-01T20:01:34.931 INFO:teuthology.orchestra.run.smithi101.stdout:dbus-daem 819 dbus mem REG 8,1 54352 24707 /usr/lib64/libnss_files-2.28.so 2023-08-01T20:01:34.931 INFO:teuthology.orchestra.run.smithi101.stdout:dbus-daem 819 dbus mem REG 8,1 145984 24905 /usr/lib64/libgpg-error.so.0.24.2 2023-08-01T20:01:34.931 INFO:teuthology.orchestra.run.smithi101.stdout:dbus-daem 819 dbus mem REG 8,1 33480 19526 /usr/lib64/libuuid.so.1.3.0 2023-08-01T20:01:34.931 INFO:teuthology.orchestra.run.smithi101.stdout:dbus-daem 819 dbus mem REG 8,1 343680 19531 /usr/lib64/libblkid.so.1.1.0 2023-08-01T20:01:34.932 INFO:teuthology.orchestra.run.smithi101.stdout:dbus-daem 819 dbus mem REG 8,1 19128 24699 /usr/lib64/libdl-2.28.so 2023-08-01T20:01:34.932 INFO:teuthology.orchestra.run.smithi101.stdout:dbus-daem 819 dbus mem REG 8,1 543304 24651 /usr/lib64/libpcre2-8.so.0.7.1 2023-08-01T20:01:34.932 INFO:teuthology.orchestra.run.smithi101.stdout:dbus-daem 819 dbus mem REG 8,1 99672 31445 /usr/lib64/libgcc_s-8-20210514.so.1 2023-08-01T20:01:34.932 INFO:teuthology.orchestra.run.smithi101.stdout:dbus-daem 819 dbus mem REG 8,1 1187312 25078 /usr/lib64/libgcrypt.so.20.2.5 2023-08-01T20:01:34.932 INFO:teuthology.orchestra.run.smithi101.stdout:dbus-daem 819 dbus mem REG 8,1 371480 19864 /usr/lib64/libmount.so.1.1.0 2023-08-01T20:01:34.932 INFO:teuthology.orchestra.run.smithi101.stdout:dbus-daem 819 dbus mem REG 8,1 33752 24776 /usr/lib64/libcap.so.2.48 2023-08-01T20:01:34.932 INFO:teuthology.orchestra.run.smithi101.stdout:dbus-daem 819 dbus mem REG 8,1 119760 25264 /usr/lib64/liblz4.so.1.8.3 2023-08-01T20:01:34.932 INFO:teuthology.orchestra.run.smithi101.stdout:dbus-daem 819 dbus mem REG 8,1 162192 24774 /usr/lib64/liblzma.so.5.2.4 2023-08-01T20:01:34.933 INFO:teuthology.orchestra.run.smithi101.stdout:dbus-daem 819 dbus mem REG 8,1 42744 24710 /usr/lib64/librt-2.28.so 2023-08-01T20:01:34.933 INFO:teuthology.orchestra.run.smithi101.stdout:dbus-daem 819 dbus mem REG 8,1 2089984 24698 /usr/lib64/libc-2.28.so 2023-08-01T20:01:34.933 INFO:teuthology.orchestra.run.smithi101.stdout:dbus-daem 819 dbus mem REG 8,1 149984 24708 /usr/lib64/libpthread-2.28.so 2023-08-01T20:01:34.933 INFO:teuthology.orchestra.run.smithi101.stdout:dbus-daem 819 dbus mem REG 8,1 24928 25065 /usr/lib64/libcap-ng.so.0.0.0 2023-08-01T20:01:34.933 INFO:teuthology.orchestra.run.smithi101.stdout:dbus-daem 819 dbus mem REG 8,1 135784 24768 /usr/lib64/libaudit.so.1.0.0 2023-08-01T20:01:34.933 INFO:teuthology.orchestra.run.smithi101.stdout:dbus-daem 819 dbus mem REG 8,1 172104 24654 /usr/lib64/libselinux.so.1 2023-08-01T20:01:34.933 INFO:teuthology.orchestra.run.smithi101.stdout:dbus-daem 819 dbus mem REG 8,1 248216 24968 /usr/lib64/libexpat.so.1.6.7 2023-08-01T20:01:34.934 INFO:teuthology.orchestra.run.smithi101.stdout:dbus-daem 819 dbus mem REG 8,1 1387784 26786 /usr/lib64/libsystemd.so.0.23.0 2023-08-01T20:01:34.934 INFO:teuthology.orchestra.run.smithi101.stdout:dbus-daem 819 dbus mem REG 8,1 351592 26670 /usr/lib64/libdbus-1.so.3.19.7 2023-08-01T20:01:34.934 INFO:teuthology.orchestra.run.smithi101.stdout:dbus-daem 819 dbus mem REG 8,1 1062168 24653 /usr/lib64/ld-2.28.so 2023-08-01T20:01:34.934 INFO:teuthology.orchestra.run.smithi101.stdout:dbus-daem 819 dbus 0u CHR 1,3 0t0 3083 /dev/null 2023-08-01T20:01:34.934 INFO:teuthology.orchestra.run.smithi101.stdout:dbus-daem 819 dbus 1u unix 0xffff93750c983180 0t0 29798 type=STREAM 2023-08-01T20:01:34.934 INFO:teuthology.orchestra.run.smithi101.stdout:dbus-daem 819 dbus 2u unix 0xffff93750c983180 0t0 29798 type=STREAM 2023-08-01T20:01:34.934 INFO:teuthology.orchestra.run.smithi101.stdout:dbus-daem 819 dbus 3u unix 0xffff93750c950480 0t0 4974 /run/dbus/system_bus_socket type=STREAM 2023-08-01T20:01:34.934 INFO:teuthology.orchestra.run.smithi101.stdout:dbus-daem 819 dbus 4u a_inode 0,14 0 15587 [eventpoll] 2023-08-01T20:01:34.935 INFO:teuthology.orchestra.run.smithi101.stdout:dbus-daem 819 dbus 5u sock 0,9 0t0 29873 protocol: NETLINK 2023-08-01T20:01:34.935 INFO:teuthology.orchestra.run.smithi101.stdout:dbus-daem 819 dbus 6u netlink 0t0 29874 SELINUX 2023-08-01T20:01:34.935 INFO:teuthology.orchestra.run.smithi101.stdout:dbus-daem 819 dbus 7r a_inode 0,14 0 15587 inotify 2023-08-01T20:01:34.935 INFO:teuthology.orchestra.run.smithi101.stdout:dbus-daem 819 dbus 8u unix 0xffff93750c983600 0t0 29879 type=STREAM 2023-08-01T20:01:34.935 INFO:teuthology.orchestra.run.smithi101.stdout:dbus-daem 819 dbus 9u unix 0xffff93750c984380 0t0 29880 type=STREAM 2023-08-01T20:01:34.935 INFO:teuthology.orchestra.run.smithi101.stdout:dbus-daem 819 dbus 10u unix 0xffff9370586cf980 0t0 29881 /run/dbus/system_bus_socket type=STREAM 2023-08-01T20:01:34.935 INFO:teuthology.orchestra.run.smithi101.stdout:dbus-daem 819 dbus 11u unix 0xffff93750c990900 0t0 29882 /run/dbus/system_bus_socket type=STREAM 2023-08-01T20:01:34.935 INFO:teuthology.orchestra.run.smithi101.stdout:dbus-daem 819 dbus 12u unix 0xffff93750c920000 0t0 21760 /run/dbus/system_bus_socket type=STREAM 2023-08-01T20:01:34.936 INFO:teuthology.orchestra.run.smithi101.stdout:dbus-daem 819 dbus 13u unix 0xffff93750c982d00 0t0 29885 type=DGRAM 2023-08-01T20:01:34.936 INFO:teuthology.orchestra.run.smithi101.stdout:dbus-daem 819 dbus 14u unix 0xffff9370586ce780 0t0 29887 /run/dbus/system_bus_socket type=STREAM 2023-08-01T20:01:34.936 INFO:teuthology.orchestra.run.smithi101.stdout:dbus-daem 819 dbus 15u unix 0xffff93750c8c3180 0t0 23130 /run/dbus/system_bus_socket type=STREAM 2023-08-01T20:01:34.936 INFO:teuthology.orchestra.run.smithi101.stdout:dbus-daem 819 dbus 17u unix 0xffff937080487500 0t0 39161 /run/dbus/system_bus_socket type=STREAM 2023-08-01T20:01:34.936 INFO:teuthology.orchestra.run.smithi101.stdout:dbus-daem 819 dbus 18u unix 0xffff93750c8c6780 0t0 30043 /run/dbus/system_bus_socket type=STREAM 2023-08-01T20:01:34.936 INFO:teuthology.orchestra.run.smithi101.stdout:dbus-daem 819 dbus 19u unix 0xffff93750c927980 0t0 29272 /run/dbus/system_bus_socket type=STREAM 2023-08-01T20:01:34.936 INFO:teuthology.orchestra.run.smithi101.stdout:dbus-daem 819 895 dbus-daem dbus cwd DIR 8,1 4096 2 / 2023-08-01T20:01:34.936 INFO:teuthology.orchestra.run.smithi101.stdout:dbus-daem 819 895 dbus-daem dbus rtd DIR 8,1 4096 2 / 2023-08-01T20:01:34.937 INFO:teuthology.orchestra.run.smithi101.stdout:dbus-daem 819 895 dbus-daem dbus txt REG 8,1 245552 26906 /usr/bin/dbus-daemon 2023-08-01T20:01:34.937 INFO:teuthology.orchestra.run.smithi101.stdout:dbus-daem 819 895 dbus-daem dbus mem REG 8,1 944528 26785 /usr/lib64/libnss_systemd.so.2 2023-08-01T20:01:34.937 INFO:teuthology.orchestra.run.smithi101.stdout:dbus-daem 819 895 dbus-daem dbus mem REG 8,1 46336 29167 /usr/lib64/libnss_sss.so.2 2023-08-01T20:01:34.937 INFO:teuthology.orchestra.run.smithi101.stdout:dbus-daem 819 895 dbus-daem dbus mem REG 8,1 54352 24707 /usr/lib64/libnss_files-2.28.so 2023-08-01T20:01:34.937 INFO:teuthology.orchestra.run.smithi101.stdout:dbus-daem 819 895 dbus-daem dbus mem REG 8,1 145984 24905 /usr/lib64/libgpg-error.so.0.24.2 2023-08-01T20:01:34.937 INFO:teuthology.orchestra.run.smithi101.stdout:dbus-daem 819 895 dbus-daem dbus mem REG 8,1 33480 19526 /usr/lib64/libuuid.so.1.3.0 2023-08-01T20:01:34.937 INFO:teuthology.orchestra.run.smithi101.stdout:dbus-daem 819 895 dbus-daem dbus mem REG 8,1 343680 19531 /usr/lib64/libblkid.so.1.1.0 2023-08-01T20:01:34.937 INFO:teuthology.orchestra.run.smithi101.stdout:dbus-daem 819 895 dbus-daem dbus mem REG 8,1 19128 24699 /usr/lib64/libdl-2.28.so 2023-08-01T20:01:34.938 INFO:teuthology.orchestra.run.smithi101.stdout:dbus-daem 819 895 dbus-daem dbus mem REG 8,1 543304 24651 /usr/lib64/libpcre2-8.so.0.7.1 2023-08-01T20:01:34.938 INFO:teuthology.orchestra.run.smithi101.stdout:dbus-daem 819 895 dbus-daem dbus mem REG 8,1 99672 31445 /usr/lib64/libgcc_s-8-20210514.so.1 2023-08-01T20:01:34.938 INFO:teuthology.orchestra.run.smithi101.stdout:dbus-daem 819 895 dbus-daem dbus mem REG 8,1 1187312 25078 /usr/lib64/libgcrypt.so.20.2.5 2023-08-01T20:01:34.938 INFO:teuthology.orchestra.run.smithi101.stdout:dbus-daem 819 895 dbus-daem dbus mem REG 8,1 371480 19864 /usr/lib64/libmount.so.1.1.0 2023-08-01T20:01:34.938 INFO:teuthology.orchestra.run.smithi101.stdout:dbus-daem 819 895 dbus-daem dbus mem REG 8,1 33752 24776 /usr/lib64/libcap.so.2.48 2023-08-01T20:01:34.938 INFO:teuthology.orchestra.run.smithi101.stdout:dbus-daem 819 895 dbus-daem dbus mem REG 8,1 119760 25264 /usr/lib64/liblz4.so.1.8.3 2023-08-01T20:01:34.938 INFO:teuthology.orchestra.run.smithi101.stdout:dbus-daem 819 895 dbus-daem dbus mem REG 8,1 162192 24774 /usr/lib64/liblzma.so.5.2.4 2023-08-01T20:01:34.939 INFO:teuthology.orchestra.run.smithi101.stdout:dbus-daem 819 895 dbus-daem dbus mem REG 8,1 42744 24710 /usr/lib64/librt-2.28.so 2023-08-01T20:01:34.939 INFO:teuthology.orchestra.run.smithi101.stdout:dbus-daem 819 895 dbus-daem dbus mem REG 8,1 2089984 24698 /usr/lib64/libc-2.28.so 2023-08-01T20:01:34.939 INFO:teuthology.orchestra.run.smithi101.stdout:dbus-daem 819 895 dbus-daem dbus mem REG 8,1 149984 24708 /usr/lib64/libpthread-2.28.so 2023-08-01T20:01:34.939 INFO:teuthology.orchestra.run.smithi101.stdout:dbus-daem 819 895 dbus-daem dbus mem REG 8,1 24928 25065 /usr/lib64/libcap-ng.so.0.0.0 2023-08-01T20:01:34.939 INFO:teuthology.orchestra.run.smithi101.stdout:dbus-daem 819 895 dbus-daem dbus mem REG 8,1 135784 24768 /usr/lib64/libaudit.so.1.0.0 2023-08-01T20:01:34.939 INFO:teuthology.orchestra.run.smithi101.stdout:dbus-daem 819 895 dbus-daem dbus mem REG 8,1 172104 24654 /usr/lib64/libselinux.so.1 2023-08-01T20:01:34.939 INFO:teuthology.orchestra.run.smithi101.stdout:dbus-daem 819 895 dbus-daem dbus mem REG 8,1 248216 24968 /usr/lib64/libexpat.so.1.6.7 2023-08-01T20:01:34.939 INFO:teuthology.orchestra.run.smithi101.stdout:dbus-daem 819 895 dbus-daem dbus mem REG 8,1 1387784 26786 /usr/lib64/libsystemd.so.0.23.0 2023-08-01T20:01:34.940 INFO:teuthology.orchestra.run.smithi101.stdout:dbus-daem 819 895 dbus-daem dbus mem REG 8,1 351592 26670 /usr/lib64/libdbus-1.so.3.19.7 2023-08-01T20:01:34.940 INFO:teuthology.orchestra.run.smithi101.stdout:dbus-daem 819 895 dbus-daem dbus mem REG 8,1 1062168 24653 /usr/lib64/ld-2.28.so 2023-08-01T20:01:34.940 INFO:teuthology.orchestra.run.smithi101.stdout:dbus-daem 819 895 dbus-daem dbus 0u CHR 1,3 0t0 3083 /dev/null 2023-08-01T20:01:34.940 INFO:teuthology.orchestra.run.smithi101.stdout:dbus-daem 819 895 dbus-daem dbus 1u unix 0xffff93750c983180 0t0 29798 type=STREAM 2023-08-01T20:01:34.940 INFO:teuthology.orchestra.run.smithi101.stdout:dbus-daem 819 895 dbus-daem dbus 2u unix 0xffff93750c983180 0t0 29798 type=STREAM 2023-08-01T20:01:34.940 INFO:teuthology.orchestra.run.smithi101.stdout:dbus-daem 819 895 dbus-daem dbus 3u unix 0xffff93750c950480 0t0 4974 /run/dbus/system_bus_socket type=STREAM 2023-08-01T20:01:34.940 INFO:teuthology.orchestra.run.smithi101.stdout:dbus-daem 819 895 dbus-daem dbus 4u a_inode 0,14 0 15587 [eventpoll] 2023-08-01T20:01:34.940 INFO:teuthology.orchestra.run.smithi101.stdout:dbus-daem 819 895 dbus-daem dbus 5u sock 0,9 0t0 29873 protocol: NETLINK 2023-08-01T20:01:34.941 INFO:teuthology.orchestra.run.smithi101.stdout:dbus-daem 819 895 dbus-daem dbus 6u netlink 0t0 29874 SELINUX 2023-08-01T20:01:34.941 INFO:teuthology.orchestra.run.smithi101.stdout:dbus-daem 819 895 dbus-daem dbus 7r a_inode 0,14 0 15587 inotify 2023-08-01T20:01:34.941 INFO:teuthology.orchestra.run.smithi101.stdout:dbus-daem 819 895 dbus-daem dbus 8u unix 0xffff93750c983600 0t0 29879 type=STREAM 2023-08-01T20:01:34.941 INFO:teuthology.orchestra.run.smithi101.stdout:dbus-daem 819 895 dbus-daem dbus 9u unix 0xffff93750c984380 0t0 29880 type=STREAM 2023-08-01T20:01:34.941 INFO:teuthology.orchestra.run.smithi101.stdout:dbus-daem 819 895 dbus-daem dbus 10u unix 0xffff9370586cf980 0t0 29881 /run/dbus/system_bus_socket type=STREAM 2023-08-01T20:01:34.941 INFO:teuthology.orchestra.run.smithi101.stdout:dbus-daem 819 895 dbus-daem dbus 11u unix 0xffff93750c990900 0t0 29882 /run/dbus/system_bus_socket type=STREAM 2023-08-01T20:01:34.941 INFO:teuthology.orchestra.run.smithi101.stdout:dbus-daem 819 895 dbus-daem dbus 12u unix 0xffff93750c920000 0t0 21760 /run/dbus/system_bus_socket type=STREAM 2023-08-01T20:01:34.941 INFO:teuthology.orchestra.run.smithi101.stdout:dbus-daem 819 895 dbus-daem dbus 13u unix 0xffff93750c982d00 0t0 29885 type=DGRAM 2023-08-01T20:01:34.942 INFO:teuthology.orchestra.run.smithi101.stdout:dbus-daem 819 895 dbus-daem dbus 14u unix 0xffff9370586ce780 0t0 29887 /run/dbus/system_bus_socket type=STREAM 2023-08-01T20:01:34.942 INFO:teuthology.orchestra.run.smithi101.stdout:dbus-daem 819 895 dbus-daem dbus 15u unix 0xffff93750c8c3180 0t0 23130 /run/dbus/system_bus_socket type=STREAM 2023-08-01T20:01:34.942 INFO:teuthology.orchestra.run.smithi101.stdout:dbus-daem 819 895 dbus-daem dbus 17u unix 0xffff937080487500 0t0 39161 /run/dbus/system_bus_socket type=STREAM 2023-08-01T20:01:34.942 INFO:teuthology.orchestra.run.smithi101.stdout:dbus-daem 819 895 dbus-daem dbus 18u unix 0xffff93750c8c6780 0t0 30043 /run/dbus/system_bus_socket type=STREAM 2023-08-01T20:01:34.942 INFO:teuthology.orchestra.run.smithi101.stdout:dbus-daem 819 895 dbus-daem dbus 19u unix 0xffff93750c927980 0t0 29272 /run/dbus/system_bus_socket type=STREAM 2023-08-01T20:01:34.942 INFO:teuthology.orchestra.run.smithi101.stdout:NetworkMa 820 root cwd DIR 8,1 4096 2 / 2023-08-01T20:01:34.942 INFO:teuthology.orchestra.run.smithi101.stdout:NetworkMa 820 root rtd DIR 8,1 4096 2 / 2023-08-01T20:01:34.942 INFO:teuthology.orchestra.run.smithi101.stdout:NetworkMa 820 root txt REG 8,1 3575168 28071 /usr/sbin/NetworkManager 2023-08-01T20:01:34.943 INFO:teuthology.orchestra.run.smithi101.stdout:NetworkMa 820 root mem REG 8,1 306488 6240 /usr/lib64/NetworkManager/1.40.16-4.el8/libnm-settings-plugin-ifcfg-rh.so 2023-08-01T20:01:34.943 INFO:teuthology.orchestra.run.smithi101.stdout:NetworkMa 820 root mem REG 8,1 351592 26670 /usr/lib64/libdbus-1.so.3.19.7 2023-08-01T20:01:34.943 INFO:teuthology.orchestra.run.smithi101.stdout:NetworkMa 820 root mem REG 8,1 58896 25143 /usr/lib64/libjansson.so.4.14.0 2023-08-01T20:01:34.943 INFO:teuthology.orchestra.run.smithi101.stdout:NetworkMa 820 root mem REG 8,1 24408 29856 /usr/lib64/libteamdctl.so.0.1.5 2023-08-01T20:01:34.943 INFO:teuthology.orchestra.run.smithi101.stdout:NetworkMa 820 root mem REG 8,1 49664 7799 /usr/lib64/NetworkManager/1.40.16-4.el8/libnm-device-plugin-team.so 2023-08-01T20:01:34.943 INFO:teuthology.orchestra.run.smithi101.stdout:NetworkMa 820 root mem REG 8,1 54352 24707 /usr/lib64/libnss_files-2.28.so 2023-08-01T20:01:34.943 INFO:teuthology.orchestra.run.smithi101.stdout:NetworkMa 820 root mem REG 8,1 1661416 24816 /usr/lib64/libstdc++.so.6.0.25 2023-08-01T20:01:34.944 INFO:teuthology.orchestra.run.smithi101.stdout:NetworkMa 820 root mem REG 8,1 43016 25837 /usr/lib64/libmodman.so.1.0.0 2023-08-01T20:01:34.944 INFO:teuthology.orchestra.run.smithi101.stdout:NetworkMa 820 root mem REG 8,1 174400 25839 /usr/lib64/libproxy.so.1.0.0 2023-08-01T20:01:34.944 INFO:teuthology.orchestra.run.smithi101.stdout:NetworkMa 820 root mem REG 8,1 2586930 39433 /usr/lib/locale/en_US.utf8/LC_COLLATE 2023-08-01T20:01:34.944 INFO:teuthology.orchestra.run.smithi101.stdout:NetworkMa 820 root mem REG 8,1 136040 24892 /usr/lib64/libcrypt.so.1.1.0 2023-08-01T20:01:34.944 INFO:teuthology.orchestra.run.smithi101.stdout:NetworkMa 820 root mem REG 8,1 134944 26083 /usr/lib64/libbrotlicommon.so.1.0.6 2023-08-01T20:01:34.944 INFO:teuthology.orchestra.run.smithi101.stdout:NetworkMa 820 root mem REG 8,1 1598840 24700 /usr/lib64/libm-2.28.so 2023-08-01T20:01:34.944 INFO:teuthology.orchestra.run.smithi101.stdout:NetworkMa 820 root mem REG 8,1 125440 26261 /usr/lib64/libsasl2.so.3.0.0 2023-08-01T20:01:34.944 INFO:teuthology.orchestra.run.smithi101.stdout:NetworkMa 820 root mem REG 8,1 16192 25072 /usr/lib64/libkeyutils.so.1.6 2023-08-01T20:01:34.945 INFO:teuthology.orchestra.run.smithi101.stdout:NetworkMa 820 root mem REG 8,1 71472 26580 /usr/lib64/libkrb5support.so.0.1 2023-08-01T20:01:34.945 INFO:teuthology.orchestra.run.smithi101.stdout:NetworkMa 820 root mem REG 8,1 145984 24905 /usr/lib64/libgpg-error.so.0.24.2 2023-08-01T20:01:34.945 INFO:teuthology.orchestra.run.smithi101.stdout:NetworkMa 820 root mem REG 8,1 33480 19526 /usr/lib64/libuuid.so.1.3.0 2023-08-01T20:01:34.945 INFO:teuthology.orchestra.run.smithi101.stdout:NetworkMa 820 root mem REG 8,1 343680 19531 /usr/lib64/libblkid.so.1.1.0 2023-08-01T20:01:34.945 INFO:teuthology.orchestra.run.smithi101.stdout:NetworkMa 820 root mem REG 8,1 92968 24709 /usr/lib64/libresolv-2.28.so 2023-08-01T20:01:34.945 INFO:teuthology.orchestra.run.smithi101.stdout:NetworkMa 820 root mem REG 8,1 464936 25554 /usr/lib64/libpcre.so.1.2.10 2023-08-01T20:01:34.945 INFO:teuthology.orchestra.run.smithi101.stdout:NetworkMa 820 root mem REG 8,1 37240 25164 /usr/lib64/libffi.so.6.0.2 2023-08-01T20:01:34.945 INFO:teuthology.orchestra.run.smithi101.stdout:NetworkMa 820 root mem REG 8,1 99640 24762 /usr/lib64/libz.so.1.2.11 2023-08-01T20:01:34.946 INFO:teuthology.orchestra.run.smithi101.stdout:NetworkMa 820 root mem REG 8,1 53616 26085 /usr/lib64/libbrotlidec.so.1.0.6 2023-08-01T20:01:34.946 INFO:teuthology.orchestra.run.smithi101.stdout:NetworkMa 820 root mem REG 8,1 67232 26280 /usr/lib64/liblber-2.4.so.2.10.9 2023-08-01T20:01:34.946 INFO:teuthology.orchestra.run.smithi101.stdout:NetworkMa 820 root mem REG 8,1 329184 26282 /usr/lib64/libldap-2.4.so.2.10.9 2023-08-01T20:01:34.946 INFO:teuthology.orchestra.run.smithi101.stdout:NetworkMa 820 root mem REG 8,1 16792 24764 /usr/lib64/libcom_err.so.2.1 2023-08-01T20:01:34.946 INFO:teuthology.orchestra.run.smithi101.stdout:NetworkMa 820 root mem REG 8,1 96288 26574 /usr/lib64/libk5crypto.so.3.1 2023-08-01T20:01:34.946 INFO:teuthology.orchestra.run.smithi101.stdout:NetworkMa 820 root mem REG 8,1 971432 26579 /usr/lib64/libkrb5.so.3.3 2023-08-01T20:01:34.946 INFO:teuthology.orchestra.run.smithi101.stdout:NetworkMa 820 root mem REG 8,1 355968 26571 /usr/lib64/libgssapi_krb5.so.2.2 2023-08-01T20:01:34.946 INFO:teuthology.orchestra.run.smithi101.stdout:NetworkMa 820 root mem REG 8,1 3083608 26861 /usr/lib64/libcrypto.so.1.1.1k 2023-08-01T20:01:34.947 INFO:teuthology.orchestra.run.smithi101.stdout:NetworkMa 820 root mem REG 8,1 615744 26862 /usr/lib64/libssl.so.1.1.1k 2023-08-01T20:01:34.947 INFO:teuthology.orchestra.run.smithi101.stdout:NetworkMa 820 root mem REG 8,1 69672 25357 /usr/lib64/libpsl.so.5.3.1 2023-08-01T20:01:34.947 INFO:teuthology.orchestra.run.smithi101.stdout:NetworkMa 820 root mem REG 8,1 464648 26276 /usr/lib64/libssh.so.4.8.7 2023-08-01T20:01:34.947 INFO:teuthology.orchestra.run.smithi101.stdout:NetworkMa 820 root mem REG 8,1 166888 26107 /usr/lib64/libnghttp2.so.14.17.0 2023-08-01T20:01:34.947 INFO:teuthology.orchestra.run.smithi101.stdout:NetworkMa 820 root mem REG 8,1 24928 25065 /usr/lib64/libcap-ng.so.0.0.0 2023-08-01T20:01:34.947 INFO:teuthology.orchestra.run.smithi101.stdout:NetworkMa 820 root mem REG 8,1 543304 24651 /usr/lib64/libpcre2-8.so.0.7.1 2023-08-01T20:01:34.947 INFO:teuthology.orchestra.run.smithi101.stdout:NetworkMa 820 root mem REG 8,1 1187312 25078 /usr/lib64/libgcrypt.so.20.2.5 2023-08-01T20:01:34.947 INFO:teuthology.orchestra.run.smithi101.stdout:NetworkMa 820 root mem REG 8,1 33752 24776 /usr/lib64/libcap.so.2.48 2023-08-01T20:01:34.948 INFO:teuthology.orchestra.run.smithi101.stdout:NetworkMa 820 root mem REG 8,1 119760 25264 /usr/lib64/liblz4.so.1.8.3 2023-08-01T20:01:34.948 INFO:teuthology.orchestra.run.smithi101.stdout:NetworkMa 820 root mem REG 8,1 162192 24774 /usr/lib64/liblzma.so.5.2.4 2023-08-01T20:01:34.948 INFO:teuthology.orchestra.run.smithi101.stdout:NetworkMa 820 root mem REG 8,1 42744 24710 /usr/lib64/librt-2.28.so 2023-08-01T20:01:34.948 INFO:teuthology.orchestra.run.smithi101.stdout:NetworkMa 820 root mem REG 8,1 371480 19864 /usr/lib64/libmount.so.1.1.0 2023-08-01T20:01:34.948 INFO:teuthology.orchestra.run.smithi101.stdout:NetworkMa 820 root mem REG 8,1 1541856 25080 /usr/lib64/libgmp.so.10.3.2 2023-08-01T20:01:34.948 INFO:teuthology.orchestra.run.smithi101.stdout:NetworkMa 820 root mem REG 8,1 197728 25272 /usr/lib64/libhogweed.so.4.5 2023-08-01T20:01:34.948 INFO:teuthology.orchestra.run.smithi101.stdout:NetworkMa 820 root mem REG 8,1 239360 25274 /usr/lib64/libnettle.so.6.5 2023-08-01T20:01:34.948 INFO:teuthology.orchestra.run.smithi101.stdout:NetworkMa 820 root mem REG 8,1 78816 25301 /usr/lib64/libtasn1.so.6.5.5 2023-08-01T20:01:34.949 INFO:teuthology.orchestra.run.smithi101.stdout:NetworkMa 820 root mem REG 8,1 1805368 25103 /usr/lib64/libunistring.so.2.1.0 2023-08-01T20:01:34.949 INFO:teuthology.orchestra.run.smithi101.stdout:NetworkMa 820 root mem REG 8,1 165624 25105 /usr/lib64/libidn2.so.0.3.6 2023-08-01T20:01:34.949 INFO:teuthology.orchestra.run.smithi101.stdout:NetworkMa 820 root mem REG 8,1 1246520 25167 /usr/lib64/libp11-kit.so.0.3.0 2023-08-01T20:01:34.949 INFO:teuthology.orchestra.run.smithi101.stdout:NetworkMa 820 root mem REG 8,1 2089984 24698 /usr/lib64/libc-2.28.so 2023-08-01T20:01:34.949 INFO:teuthology.orchestra.run.smithi101.stdout:NetworkMa 820 root mem REG 8,1 149984 24708 /usr/lib64/libpthread-2.28.so 2023-08-01T20:01:34.949 INFO:teuthology.orchestra.run.smithi101.stdout:NetworkMa 820 root mem REG 8,1 99672 31445 /usr/lib64/libgcc_s-8-20210514.so.1 2023-08-01T20:01:34.949 INFO:teuthology.orchestra.run.smithi101.stdout:NetworkMa 820 root mem REG 8,1 19128 24699 /usr/lib64/libdl-2.28.so 2023-08-01T20:01:34.950 INFO:teuthology.orchestra.run.smithi101.stdout:NetworkMa 820 root mem REG 8,1 1172024 27416 /usr/lib64/libglib-2.0.so.0.5600.4 2023-08-01T20:01:34.950 INFO:teuthology.orchestra.run.smithi101.stdout:NetworkMa 820 root mem REG 8,1 16064 27417 /usr/lib64/libgmodule-2.0.so.0.5600.4 2023-08-01T20:01:34.950 INFO:teuthology.orchestra.run.smithi101.stdout:NetworkMa 820 root mem REG 8,1 347416 27418 /usr/lib64/libgobject-2.0.so.0.5600.4 2023-08-01T20:01:34.950 INFO:teuthology.orchestra.run.smithi101.stdout:NetworkMa 820 root mem REG 8,1 1770248 27415 /usr/lib64/libgio-2.0.so.0.5600.4 2023-08-01T20:01:34.950 INFO:teuthology.orchestra.run.smithi101.stdout:NetworkMa 820 root mem REG 8,1 596536 26336 /usr/lib64/libcurl.so.4.5.0 2023-08-01T20:01:34.950 INFO:teuthology.orchestra.run.smithi101.stdout:NetworkMa 820 root mem REG 8,1 135784 24768 /usr/lib64/libaudit.so.1.0.0 2023-08-01T20:01:34.950 INFO:teuthology.orchestra.run.smithi101.stdout:NetworkMa 820 root mem REG 8,1 172104 24654 /usr/lib64/libselinux.so.1 2023-08-01T20:01:34.950 INFO:teuthology.orchestra.run.smithi101.stdout:NetworkMa 820 root mem REG 8,1 29040 26105 /usr/lib64/libndp.so.0.1.1 2023-08-01T20:01:34.951 INFO:teuthology.orchestra.run.smithi101.stdout:NetworkMa 820 root mem REG 8,1 1387784 26786 /usr/lib64/libsystemd.so.0.23.0 2023-08-01T20:01:34.951 INFO:teuthology.orchestra.run.smithi101.stdout:NetworkMa 820 root mem REG 8,1 658136 26787 /usr/lib64/libudev.so.1.6.11 2023-08-01T20:01:34.951 INFO:teuthology.orchestra.run.smithi101.stdout:NetworkMa 820 root mem REG 8,1 2051688 27472 /usr/lib64/libgnutls.so.30.28.2 2023-08-01T20:01:34.951 INFO:teuthology.orchestra.run.smithi101.stdout:NetworkMa 820 root mem REG 8,1 1062168 24653 /usr/lib64/ld-2.28.so 2023-08-01T20:01:34.951 INFO:teuthology.orchestra.run.smithi101.stdout:NetworkMa 820 root mem REG 8,1 337024 45489 /usr/lib/locale/C.utf8/LC_CTYPE 2023-08-01T20:01:34.951 INFO:teuthology.orchestra.run.smithi101.stdout:NetworkMa 820 root mem REG 8,1 54 44174 /usr/lib/locale/en_US.utf8/LC_NUMERIC 2023-08-01T20:01:34.951 INFO:teuthology.orchestra.run.smithi101.stdout:NetworkMa 820 root mem REG 8,1 3316 48200 /usr/lib/locale/en_US.utf8/LC_TIME 2023-08-01T20:01:34.951 INFO:teuthology.orchestra.run.smithi101.stdout:NetworkMa 820 root mem REG 8,1 286 48207 /usr/lib/locale/en_US.utf8/LC_MONETARY 2023-08-01T20:01:34.952 INFO:teuthology.orchestra.run.smithi101.stdout:NetworkMa 820 root mem REG 8,1 26998 35419 /usr/lib64/gconv/gconv-modules.cache 2023-08-01T20:01:34.952 INFO:teuthology.orchestra.run.smithi101.stdout:NetworkMa 820 root mem REG 8,1 57 39434 /usr/lib/locale/en_US.utf8/LC_MESSAGES/SYS_LC_MESSAGES 2023-08-01T20:01:34.952 INFO:teuthology.orchestra.run.smithi101.stdout:NetworkMa 820 root mem REG 8,1 34 39448 /usr/lib/locale/en_US.utf8/LC_PAPER 2023-08-01T20:01:34.952 INFO:teuthology.orchestra.run.smithi101.stdout:NetworkMa 820 root mem REG 8,1 77 44173 /usr/lib/locale/en_US.utf8/LC_NAME 2023-08-01T20:01:34.952 INFO:teuthology.orchestra.run.smithi101.stdout:NetworkMa 820 root mem REG 8,1 167 45462 /usr/lib/locale/en_US.utf8/LC_ADDRESS 2023-08-01T20:01:34.952 INFO:teuthology.orchestra.run.smithi101.stdout:NetworkMa 820 root mem REG 8,1 59 48208 /usr/lib/locale/en_US.utf8/LC_TELEPHONE 2023-08-01T20:01:34.952 INFO:teuthology.orchestra.run.smithi101.stdout:NetworkMa 820 root mem REG 8,1 23 48206 /usr/lib/locale/en_US.utf8/LC_MEASUREMENT 2023-08-01T20:01:34.952 INFO:teuthology.orchestra.run.smithi101.stdout:NetworkMa 820 root mem REG 8,1 368 48205 /usr/lib/locale/en_US.utf8/LC_IDENTIFICATION 2023-08-01T20:01:34.953 INFO:teuthology.orchestra.run.smithi101.stdout:NetworkMa 820 root 0r CHR 1,3 0t0 3083 /dev/null 2023-08-01T20:01:34.953 INFO:teuthology.orchestra.run.smithi101.stdout:NetworkMa 820 root 1u unix 0xffff93750c993f00 0t0 21710 type=STREAM 2023-08-01T20:01:34.953 INFO:teuthology.orchestra.run.smithi101.stdout:NetworkMa 820 root 2u unix 0xffff93750c993f00 0t0 21710 type=STREAM 2023-08-01T20:01:34.953 INFO:teuthology.orchestra.run.smithi101.stdout:NetworkMa 820 root 3u a_inode 0,14 0 15587 [eventfd] 2023-08-01T20:01:34.953 INFO:teuthology.orchestra.run.smithi101.stdout:NetworkMa 820 root 4u a_inode 0,14 0 15587 [eventfd] 2023-08-01T20:01:34.953 INFO:teuthology.orchestra.run.smithi101.stdout:NetworkMa 820 root 5u unix 0xffff9370586ca880 0t0 30966 type=DGRAM 2023-08-01T20:01:34.953 INFO:teuthology.orchestra.run.smithi101.stdout:NetworkMa 820 root 6u unix 0xffff9370586c8d80 0t0 30967 type=STREAM 2023-08-01T20:01:34.953 INFO:teuthology.orchestra.run.smithi101.stdout:NetworkMa 820 root 7u a_inode 0,14 0 15587 [eventfd] 2023-08-01T20:01:34.954 INFO:teuthology.orchestra.run.smithi101.stdout:NetworkMa 820 root 8r REG 0,4 0 4026532000 net 2023-08-01T20:01:34.954 INFO:teuthology.orchestra.run.smithi101.stdout:NetworkMa 820 root 9r REG 0,4 0 4026532494 mnt 2023-08-01T20:01:34.954 INFO:teuthology.orchestra.run.smithi101.stdout:NetworkMa 820 root 10u netlink 0t0 21764 KOBJECT_UEVENT 2023-08-01T20:01:34.954 INFO:teuthology.orchestra.run.smithi101.stdout:NetworkMa 820 root 11u netlink 0t0 21765 GENERIC 2023-08-01T20:01:34.954 INFO:teuthology.orchestra.run.smithi101.stdout:NetworkMa 820 root 12u netlink 0t0 21766 GENERIC 2023-08-01T20:01:34.954 INFO:teuthology.orchestra.run.smithi101.stdout:NetworkMa 820 root 13u netlink 0t0 21767 ROUTE 2023-08-01T20:01:34.954 INFO:teuthology.orchestra.run.smithi101.stdout:NetworkMa 820 root 14r a_inode 0,14 0 15587 inotify 2023-08-01T20:01:34.954 INFO:teuthology.orchestra.run.smithi101.stdout:NetworkMa 820 root 15r a_inode 0,14 0 15587 inotify 2023-08-01T20:01:34.955 INFO:teuthology.orchestra.run.smithi101.stdout:NetworkMa 820 root 16u netlink 0t0 22076 KOBJECT_UEVENT 2023-08-01T20:01:34.955 INFO:teuthology.orchestra.run.smithi101.stdout:NetworkMa 820 root 17u a_inode 0,14 0 15587 [eventpoll] 2023-08-01T20:01:34.955 INFO:teuthology.orchestra.run.smithi101.stdout:NetworkMa 820 root 18u unix 0xffff93750c8c0d80 0t0 19990 type=STREAM 2023-08-01T20:01:34.955 INFO:teuthology.orchestra.run.smithi101.stdout:NetworkMa 820 root 19u a_inode 0,14 0 15587 [eventpoll] 2023-08-01T20:01:34.955 INFO:teuthology.orchestra.run.smithi101.stdout:NetworkMa 820 root 20w FIFO 0,24 0t0 31775 /run/systemd/inhibit/1.ref 2023-08-01T20:01:34.955 INFO:teuthology.orchestra.run.smithi101.stdout:NetworkMa 820 root 21u a_inode 0,14 0 15587 [timerfd] 2023-08-01T20:01:34.955 INFO:teuthology.orchestra.run.smithi101.stdout:NetworkMa 820 root 23u a_inode 0,14 0 15587 [eventpoll] 2023-08-01T20:01:34.955 INFO:teuthology.orchestra.run.smithi101.stdout:NetworkMa 820 root 24u a_inode 0,14 0 15587 [timerfd] 2023-08-01T20:01:34.956 INFO:teuthology.orchestra.run.smithi101.stdout:NetworkMa 820 root 25u pack 32979 0t0 ARP type=SOCK_DGRAM 2023-08-01T20:01:34.956 INFO:teuthology.orchestra.run.smithi101.stdout:NetworkMa 820 root 26u IPv4 32980 0t0 UDP smithi101.front.sepia.ceph.com:bootpc->store01.front.sepia.ceph.com:bootps 2023-08-01T20:01:34.956 INFO:teuthology.orchestra.run.smithi101.stdout:NetworkMa 820 901 gmain root cwd DIR 8,1 4096 2 / 2023-08-01T20:01:34.956 INFO:teuthology.orchestra.run.smithi101.stdout:NetworkMa 820 901 gmain root rtd DIR 8,1 4096 2 / 2023-08-01T20:01:34.956 INFO:teuthology.orchestra.run.smithi101.stdout:NetworkMa 820 901 gmain root txt REG 8,1 3575168 28071 /usr/sbin/NetworkManager 2023-08-01T20:01:34.956 INFO:teuthology.orchestra.run.smithi101.stdout:NetworkMa 820 901 gmain root mem REG 8,1 306488 6240 /usr/lib64/NetworkManager/1.40.16-4.el8/libnm-settings-plugin-ifcfg-rh.so 2023-08-01T20:01:34.956 INFO:teuthology.orchestra.run.smithi101.stdout:NetworkMa 820 901 gmain root mem REG 8,1 351592 26670 /usr/lib64/libdbus-1.so.3.19.7 2023-08-01T20:01:34.956 INFO:teuthology.orchestra.run.smithi101.stdout:NetworkMa 820 901 gmain root mem REG 8,1 58896 25143 /usr/lib64/libjansson.so.4.14.0 2023-08-01T20:01:34.957 INFO:teuthology.orchestra.run.smithi101.stdout:NetworkMa 820 901 gmain root mem REG 8,1 24408 29856 /usr/lib64/libteamdctl.so.0.1.5 2023-08-01T20:01:34.957 INFO:teuthology.orchestra.run.smithi101.stdout:NetworkMa 820 901 gmain root mem REG 8,1 49664 7799 /usr/lib64/NetworkManager/1.40.16-4.el8/libnm-device-plugin-team.so 2023-08-01T20:01:34.957 INFO:teuthology.orchestra.run.smithi101.stdout:NetworkMa 820 901 gmain root mem REG 8,1 54352 24707 /usr/lib64/libnss_files-2.28.so 2023-08-01T20:01:34.957 INFO:teuthology.orchestra.run.smithi101.stdout:NetworkMa 820 901 gmain root mem REG 8,1 1661416 24816 /usr/lib64/libstdc++.so.6.0.25 2023-08-01T20:01:34.957 INFO:teuthology.orchestra.run.smithi101.stdout:NetworkMa 820 901 gmain root mem REG 8,1 43016 25837 /usr/lib64/libmodman.so.1.0.0 2023-08-01T20:01:34.957 INFO:teuthology.orchestra.run.smithi101.stdout:NetworkMa 820 901 gmain root mem REG 8,1 174400 25839 /usr/lib64/libproxy.so.1.0.0 2023-08-01T20:01:34.957 INFO:teuthology.orchestra.run.smithi101.stdout:NetworkMa 820 901 gmain root mem REG 8,1 2586930 39433 /usr/lib/locale/en_US.utf8/LC_COLLATE 2023-08-01T20:01:34.958 INFO:teuthology.orchestra.run.smithi101.stdout:NetworkMa 820 901 gmain root mem REG 8,1 136040 24892 /usr/lib64/libcrypt.so.1.1.0 2023-08-01T20:01:34.958 INFO:teuthology.orchestra.run.smithi101.stdout:NetworkMa 820 901 gmain root mem REG 8,1 134944 26083 /usr/lib64/libbrotlicommon.so.1.0.6 2023-08-01T20:01:34.958 INFO:teuthology.orchestra.run.smithi101.stdout:NetworkMa 820 901 gmain root mem REG 8,1 1598840 24700 /usr/lib64/libm-2.28.so 2023-08-01T20:01:34.958 INFO:teuthology.orchestra.run.smithi101.stdout:NetworkMa 820 901 gmain root mem REG 8,1 125440 26261 /usr/lib64/libsasl2.so.3.0.0 2023-08-01T20:01:34.958 INFO:teuthology.orchestra.run.smithi101.stdout:NetworkMa 820 901 gmain root mem REG 8,1 16192 25072 /usr/lib64/libkeyutils.so.1.6 2023-08-01T20:01:34.958 INFO:teuthology.orchestra.run.smithi101.stdout:NetworkMa 820 901 gmain root mem REG 8,1 71472 26580 /usr/lib64/libkrb5support.so.0.1 2023-08-01T20:01:34.958 INFO:teuthology.orchestra.run.smithi101.stdout:NetworkMa 820 901 gmain root mem REG 8,1 145984 24905 /usr/lib64/libgpg-error.so.0.24.2 2023-08-01T20:01:34.958 INFO:teuthology.orchestra.run.smithi101.stdout:NetworkMa 820 901 gmain root mem REG 8,1 33480 19526 /usr/lib64/libuuid.so.1.3.0 2023-08-01T20:01:34.959 INFO:teuthology.orchestra.run.smithi101.stdout:NetworkMa 820 901 gmain root mem REG 8,1 343680 19531 /usr/lib64/libblkid.so.1.1.0 2023-08-01T20:01:34.959 INFO:teuthology.orchestra.run.smithi101.stdout:NetworkMa 820 901 gmain root mem REG 8,1 92968 24709 /usr/lib64/libresolv-2.28.so 2023-08-01T20:01:34.959 INFO:teuthology.orchestra.run.smithi101.stdout:NetworkMa 820 901 gmain root mem REG 8,1 464936 25554 /usr/lib64/libpcre.so.1.2.10 2023-08-01T20:01:34.959 INFO:teuthology.orchestra.run.smithi101.stdout:NetworkMa 820 901 gmain root mem REG 8,1 37240 25164 /usr/lib64/libffi.so.6.0.2 2023-08-01T20:01:34.959 INFO:teuthology.orchestra.run.smithi101.stdout:NetworkMa 820 901 gmain root mem REG 8,1 99640 24762 /usr/lib64/libz.so.1.2.11 2023-08-01T20:01:34.959 INFO:teuthology.orchestra.run.smithi101.stdout:NetworkMa 820 901 gmain root mem REG 8,1 53616 26085 /usr/lib64/libbrotlidec.so.1.0.6 2023-08-01T20:01:34.959 INFO:teuthology.orchestra.run.smithi101.stdout:NetworkMa 820 901 gmain root mem REG 8,1 67232 26280 /usr/lib64/liblber-2.4.so.2.10.9 2023-08-01T20:01:34.959 INFO:teuthology.orchestra.run.smithi101.stdout:NetworkMa 820 901 gmain root mem REG 8,1 329184 26282 /usr/lib64/libldap-2.4.so.2.10.9 2023-08-01T20:01:34.960 INFO:teuthology.orchestra.run.smithi101.stdout:NetworkMa 820 901 gmain root mem REG 8,1 16792 24764 /usr/lib64/libcom_err.so.2.1 2023-08-01T20:01:34.960 INFO:teuthology.orchestra.run.smithi101.stdout:NetworkMa 820 901 gmain root mem REG 8,1 96288 26574 /usr/lib64/libk5crypto.so.3.1 2023-08-01T20:01:34.960 INFO:teuthology.orchestra.run.smithi101.stdout:NetworkMa 820 901 gmain root mem REG 8,1 971432 26579 /usr/lib64/libkrb5.so.3.3 2023-08-01T20:01:34.960 INFO:teuthology.orchestra.run.smithi101.stdout:NetworkMa 820 901 gmain root mem REG 8,1 355968 26571 /usr/lib64/libgssapi_krb5.so.2.2 2023-08-01T20:01:34.960 INFO:teuthology.orchestra.run.smithi101.stdout:NetworkMa 820 901 gmain root mem REG 8,1 3083608 26861 /usr/lib64/libcrypto.so.1.1.1k 2023-08-01T20:01:34.960 INFO:teuthology.orchestra.run.smithi101.stdout:NetworkMa 820 901 gmain root mem REG 8,1 615744 26862 /usr/lib64/libssl.so.1.1.1k 2023-08-01T20:01:34.960 INFO:teuthology.orchestra.run.smithi101.stdout:NetworkMa 820 901 gmain root mem REG 8,1 69672 25357 /usr/lib64/libpsl.so.5.3.1 2023-08-01T20:01:34.960 INFO:teuthology.orchestra.run.smithi101.stdout:NetworkMa 820 901 gmain root mem REG 8,1 464648 26276 /usr/lib64/libssh.so.4.8.7 2023-08-01T20:01:34.961 INFO:teuthology.orchestra.run.smithi101.stdout:NetworkMa 820 901 gmain root mem REG 8,1 166888 26107 /usr/lib64/libnghttp2.so.14.17.0 2023-08-01T20:01:34.961 INFO:teuthology.orchestra.run.smithi101.stdout:NetworkMa 820 901 gmain root mem REG 8,1 24928 25065 /usr/lib64/libcap-ng.so.0.0.0 2023-08-01T20:01:34.961 INFO:teuthology.orchestra.run.smithi101.stdout:NetworkMa 820 901 gmain root mem REG 8,1 543304 24651 /usr/lib64/libpcre2-8.so.0.7.1 2023-08-01T20:01:34.961 INFO:teuthology.orchestra.run.smithi101.stdout:NetworkMa 820 901 gmain root mem REG 8,1 1187312 25078 /usr/lib64/libgcrypt.so.20.2.5 2023-08-01T20:01:34.961 INFO:teuthology.orchestra.run.smithi101.stdout:NetworkMa 820 901 gmain root mem REG 8,1 33752 24776 /usr/lib64/libcap.so.2.48 2023-08-01T20:01:34.961 INFO:teuthology.orchestra.run.smithi101.stdout:NetworkMa 820 901 gmain root mem REG 8,1 119760 25264 /usr/lib64/liblz4.so.1.8.3 2023-08-01T20:01:34.961 INFO:teuthology.orchestra.run.smithi101.stdout:NetworkMa 820 901 gmain root mem REG 8,1 162192 24774 /usr/lib64/liblzma.so.5.2.4 2023-08-01T20:01:34.961 INFO:teuthology.orchestra.run.smithi101.stdout:NetworkMa 820 901 gmain root mem REG 8,1 42744 24710 /usr/lib64/librt-2.28.so 2023-08-01T20:01:34.962 INFO:teuthology.orchestra.run.smithi101.stdout:NetworkMa 820 901 gmain root mem REG 8,1 371480 19864 /usr/lib64/libmount.so.1.1.0 2023-08-01T20:01:34.962 INFO:teuthology.orchestra.run.smithi101.stdout:NetworkMa 820 901 gmain root mem REG 8,1 1541856 25080 /usr/lib64/libgmp.so.10.3.2 2023-08-01T20:01:34.962 INFO:teuthology.orchestra.run.smithi101.stdout:NetworkMa 820 901 gmain root mem REG 8,1 197728 25272 /usr/lib64/libhogweed.so.4.5 2023-08-01T20:01:34.962 INFO:teuthology.orchestra.run.smithi101.stdout:NetworkMa 820 901 gmain root mem REG 8,1 239360 25274 /usr/lib64/libnettle.so.6.5 2023-08-01T20:01:34.962 INFO:teuthology.orchestra.run.smithi101.stdout:NetworkMa 820 901 gmain root mem REG 8,1 78816 25301 /usr/lib64/libtasn1.so.6.5.5 2023-08-01T20:01:34.962 INFO:teuthology.orchestra.run.smithi101.stdout:NetworkMa 820 901 gmain root mem REG 8,1 1805368 25103 /usr/lib64/libunistring.so.2.1.0 2023-08-01T20:01:34.962 INFO:teuthology.orchestra.run.smithi101.stdout:NetworkMa 820 901 gmain root mem REG 8,1 165624 25105 /usr/lib64/libidn2.so.0.3.6 2023-08-01T20:01:34.962 INFO:teuthology.orchestra.run.smithi101.stdout:NetworkMa 820 901 gmain root mem REG 8,1 1246520 25167 /usr/lib64/libp11-kit.so.0.3.0 2023-08-01T20:01:34.963 INFO:teuthology.orchestra.run.smithi101.stdout:NetworkMa 820 901 gmain root mem REG 8,1 2089984 24698 /usr/lib64/libc-2.28.so 2023-08-01T20:01:34.963 INFO:teuthology.orchestra.run.smithi101.stdout:NetworkMa 820 901 gmain root mem REG 8,1 149984 24708 /usr/lib64/libpthread-2.28.so 2023-08-01T20:01:34.963 INFO:teuthology.orchestra.run.smithi101.stdout:NetworkMa 820 901 gmain root mem REG 8,1 99672 31445 /usr/lib64/libgcc_s-8-20210514.so.1 2023-08-01T20:01:34.963 INFO:teuthology.orchestra.run.smithi101.stdout:NetworkMa 820 901 gmain root mem REG 8,1 19128 24699 /usr/lib64/libdl-2.28.so 2023-08-01T20:01:34.963 INFO:teuthology.orchestra.run.smithi101.stdout:NetworkMa 820 901 gmain root mem REG 8,1 1172024 27416 /usr/lib64/libglib-2.0.so.0.5600.4 2023-08-01T20:01:34.963 INFO:teuthology.orchestra.run.smithi101.stdout:NetworkMa 820 901 gmain root mem REG 8,1 16064 27417 /usr/lib64/libgmodule-2.0.so.0.5600.4 2023-08-01T20:01:34.963 INFO:teuthology.orchestra.run.smithi101.stdout:NetworkMa 820 901 gmain root mem REG 8,1 347416 27418 /usr/lib64/libgobject-2.0.so.0.5600.4 2023-08-01T20:01:34.963 INFO:teuthology.orchestra.run.smithi101.stdout:NetworkMa 820 901 gmain root mem REG 8,1 1770248 27415 /usr/lib64/libgio-2.0.so.0.5600.4 2023-08-01T20:01:34.964 INFO:teuthology.orchestra.run.smithi101.stdout:NetworkMa 820 901 gmain root mem REG 8,1 596536 26336 /usr/lib64/libcurl.so.4.5.0 2023-08-01T20:01:34.964 INFO:teuthology.orchestra.run.smithi101.stdout:NetworkMa 820 901 gmain root mem REG 8,1 135784 24768 /usr/lib64/libaudit.so.1.0.0 2023-08-01T20:01:34.964 INFO:teuthology.orchestra.run.smithi101.stdout:NetworkMa 820 901 gmain root mem REG 8,1 172104 24654 /usr/lib64/libselinux.so.1 2023-08-01T20:01:34.964 INFO:teuthology.orchestra.run.smithi101.stdout:NetworkMa 820 901 gmain root mem REG 8,1 29040 26105 /usr/lib64/libndp.so.0.1.1 2023-08-01T20:01:34.964 INFO:teuthology.orchestra.run.smithi101.stdout:NetworkMa 820 901 gmain root mem REG 8,1 1387784 26786 /usr/lib64/libsystemd.so.0.23.0 2023-08-01T20:01:34.964 INFO:teuthology.orchestra.run.smithi101.stdout:NetworkMa 820 901 gmain root mem REG 8,1 658136 26787 /usr/lib64/libudev.so.1.6.11 2023-08-01T20:01:34.964 INFO:teuthology.orchestra.run.smithi101.stdout:NetworkMa 820 901 gmain root mem REG 8,1 2051688 27472 /usr/lib64/libgnutls.so.30.28.2 2023-08-01T20:01:34.965 INFO:teuthology.orchestra.run.smithi101.stdout:NetworkMa 820 901 gmain root mem REG 8,1 1062168 24653 /usr/lib64/ld-2.28.so 2023-08-01T20:01:34.965 INFO:teuthology.orchestra.run.smithi101.stdout:NetworkMa 820 901 gmain root mem REG 8,1 337024 45489 /usr/lib/locale/C.utf8/LC_CTYPE 2023-08-01T20:01:34.965 INFO:teuthology.orchestra.run.smithi101.stdout:NetworkMa 820 901 gmain root mem REG 8,1 54 44174 /usr/lib/locale/en_US.utf8/LC_NUMERIC 2023-08-01T20:01:34.965 INFO:teuthology.orchestra.run.smithi101.stdout:NetworkMa 820 901 gmain root mem REG 8,1 3316 48200 /usr/lib/locale/en_US.utf8/LC_TIME 2023-08-01T20:01:34.965 INFO:teuthology.orchestra.run.smithi101.stdout:NetworkMa 820 901 gmain root mem REG 8,1 286 48207 /usr/lib/locale/en_US.utf8/LC_MONETARY 2023-08-01T20:01:34.965 INFO:teuthology.orchestra.run.smithi101.stdout:NetworkMa 820 901 gmain root mem REG 8,1 26998 35419 /usr/lib64/gconv/gconv-modules.cache 2023-08-01T20:01:34.965 INFO:teuthology.orchestra.run.smithi101.stdout:NetworkMa 820 901 gmain root mem REG 8,1 57 39434 /usr/lib/locale/en_US.utf8/LC_MESSAGES/SYS_LC_MESSAGES 2023-08-01T20:01:34.965 INFO:teuthology.orchestra.run.smithi101.stdout:NetworkMa 820 901 gmain root mem REG 8,1 34 39448 /usr/lib/locale/en_US.utf8/LC_PAPER 2023-08-01T20:01:34.966 INFO:teuthology.orchestra.run.smithi101.stdout:NetworkMa 820 901 gmain root mem REG 8,1 77 44173 /usr/lib/locale/en_US.utf8/LC_NAME 2023-08-01T20:01:34.966 INFO:teuthology.orchestra.run.smithi101.stdout:NetworkMa 820 901 gmain root mem REG 8,1 167 45462 /usr/lib/locale/en_US.utf8/LC_ADDRESS 2023-08-01T20:01:34.966 INFO:teuthology.orchestra.run.smithi101.stdout:NetworkMa 820 901 gmain root mem REG 8,1 59 48208 /usr/lib/locale/en_US.utf8/LC_TELEPHONE 2023-08-01T20:01:34.966 INFO:teuthology.orchestra.run.smithi101.stdout:NetworkMa 820 901 gmain root mem REG 8,1 23 48206 /usr/lib/locale/en_US.utf8/LC_MEASUREMENT 2023-08-01T20:01:34.966 INFO:teuthology.orchestra.run.smithi101.stdout:NetworkMa 820 901 gmain root mem REG 8,1 368 48205 /usr/lib/locale/en_US.utf8/LC_IDENTIFICATION 2023-08-01T20:01:34.966 INFO:teuthology.orchestra.run.smithi101.stdout:NetworkMa 820 901 gmain root 0r CHR 1,3 0t0 3083 /dev/null 2023-08-01T20:01:34.966 INFO:teuthology.orchestra.run.smithi101.stdout:NetworkMa 820 901 gmain root 1u unix 0xffff93750c993f00 0t0 21710 type=STREAM 2023-08-01T20:01:34.966 INFO:teuthology.orchestra.run.smithi101.stdout:NetworkMa 820 901 gmain root 2u unix 0xffff93750c993f00 0t0 21710 type=STREAM 2023-08-01T20:01:34.967 INFO:teuthology.orchestra.run.smithi101.stdout:NetworkMa 820 901 gmain root 3u a_inode 0,14 0 15587 [eventfd] 2023-08-01T20:01:34.967 INFO:teuthology.orchestra.run.smithi101.stdout:NetworkMa 820 901 gmain root 4u a_inode 0,14 0 15587 [eventfd] 2023-08-01T20:01:34.967 INFO:teuthology.orchestra.run.smithi101.stdout:NetworkMa 820 901 gmain root 5u unix 0xffff9370586ca880 0t0 30966 type=DGRAM 2023-08-01T20:01:34.967 INFO:teuthology.orchestra.run.smithi101.stdout:NetworkMa 820 901 gmain root 6u unix 0xffff9370586c8d80 0t0 30967 type=STREAM 2023-08-01T20:01:34.967 INFO:teuthology.orchestra.run.smithi101.stdout:NetworkMa 820 901 gmain root 7u a_inode 0,14 0 15587 [eventfd] 2023-08-01T20:01:34.967 INFO:teuthology.orchestra.run.smithi101.stdout:NetworkMa 820 901 gmain root 8r REG 0,4 0 4026532000 net 2023-08-01T20:01:34.967 INFO:teuthology.orchestra.run.smithi101.stdout:NetworkMa 820 901 gmain root 9r REG 0,4 0 4026532494 mnt 2023-08-01T20:01:34.967 INFO:teuthology.orchestra.run.smithi101.stdout:NetworkMa 820 901 gmain root 10u netlink 0t0 21764 KOBJECT_UEVENT 2023-08-01T20:01:34.968 INFO:teuthology.orchestra.run.smithi101.stdout:NetworkMa 820 901 gmain root 11u netlink 0t0 21765 GENERIC 2023-08-01T20:01:34.968 INFO:teuthology.orchestra.run.smithi101.stdout:NetworkMa 820 901 gmain root 12u netlink 0t0 21766 GENERIC 2023-08-01T20:01:34.968 INFO:teuthology.orchestra.run.smithi101.stdout:NetworkMa 820 901 gmain root 13u netlink 0t0 21767 ROUTE 2023-08-01T20:01:34.968 INFO:teuthology.orchestra.run.smithi101.stdout:NetworkMa 820 901 gmain root 14r a_inode 0,14 0 15587 inotify 2023-08-01T20:01:34.968 INFO:teuthology.orchestra.run.smithi101.stdout:NetworkMa 820 901 gmain root 15r a_inode 0,14 0 15587 inotify 2023-08-01T20:01:34.968 INFO:teuthology.orchestra.run.smithi101.stdout:NetworkMa 820 901 gmain root 16u netlink 0t0 22076 KOBJECT_UEVENT 2023-08-01T20:01:34.968 INFO:teuthology.orchestra.run.smithi101.stdout:NetworkMa 820 901 gmain root 17u a_inode 0,14 0 15587 [eventpoll] 2023-08-01T20:01:34.968 INFO:teuthology.orchestra.run.smithi101.stdout:NetworkMa 820 901 gmain root 18u unix 0xffff93750c8c0d80 0t0 19990 type=STREAM 2023-08-01T20:01:34.969 INFO:teuthology.orchestra.run.smithi101.stdout:NetworkMa 820 901 gmain root 19u a_inode 0,14 0 15587 [eventpoll] 2023-08-01T20:01:34.969 INFO:teuthology.orchestra.run.smithi101.stdout:NetworkMa 820 901 gmain root 20w FIFO 0,24 0t0 31775 /run/systemd/inhibit/1.ref 2023-08-01T20:01:34.969 INFO:teuthology.orchestra.run.smithi101.stdout:NetworkMa 820 901 gmain root 21u a_inode 0,14 0 15587 [timerfd] 2023-08-01T20:01:34.969 INFO:teuthology.orchestra.run.smithi101.stdout:NetworkMa 820 901 gmain root 23u a_inode 0,14 0 15587 [eventpoll] 2023-08-01T20:01:34.969 INFO:teuthology.orchestra.run.smithi101.stdout:NetworkMa 820 901 gmain root 24u a_inode 0,14 0 15587 [timerfd] 2023-08-01T20:01:34.969 INFO:teuthology.orchestra.run.smithi101.stdout:NetworkMa 820 901 gmain root 25u pack 32979 0t0 ARP type=SOCK_DGRAM 2023-08-01T20:01:34.969 INFO:teuthology.orchestra.run.smithi101.stdout:NetworkMa 820 901 gmain root 26u IPv4 32980 0t0 UDP smithi101.front.sepia.ceph.com:bootpc->store01.front.sepia.ceph.com:bootps 2023-08-01T20:01:34.969 INFO:teuthology.orchestra.run.smithi101.stdout:NetworkMa 820 902 gdbus root cwd DIR 8,1 4096 2 / 2023-08-01T20:01:34.970 INFO:teuthology.orchestra.run.smithi101.stdout:NetworkMa 820 902 gdbus root rtd DIR 8,1 4096 2 / 2023-08-01T20:01:34.970 INFO:teuthology.orchestra.run.smithi101.stdout:NetworkMa 820 902 gdbus root txt REG 8,1 3575168 28071 /usr/sbin/NetworkManager 2023-08-01T20:01:34.970 INFO:teuthology.orchestra.run.smithi101.stdout:NetworkMa 820 902 gdbus root mem REG 8,1 306488 6240 /usr/lib64/NetworkManager/1.40.16-4.el8/libnm-settings-plugin-ifcfg-rh.so 2023-08-01T20:01:34.970 INFO:teuthology.orchestra.run.smithi101.stdout:NetworkMa 820 902 gdbus root mem REG 8,1 351592 26670 /usr/lib64/libdbus-1.so.3.19.7 2023-08-01T20:01:34.970 INFO:teuthology.orchestra.run.smithi101.stdout:NetworkMa 820 902 gdbus root mem REG 8,1 58896 25143 /usr/lib64/libjansson.so.4.14.0 2023-08-01T20:01:34.970 INFO:teuthology.orchestra.run.smithi101.stdout:NetworkMa 820 902 gdbus root mem REG 8,1 24408 29856 /usr/lib64/libteamdctl.so.0.1.5 2023-08-01T20:01:34.970 INFO:teuthology.orchestra.run.smithi101.stdout:NetworkMa 820 902 gdbus root mem REG 8,1 49664 7799 /usr/lib64/NetworkManager/1.40.16-4.el8/libnm-device-plugin-team.so 2023-08-01T20:01:34.971 INFO:teuthology.orchestra.run.smithi101.stdout:NetworkMa 820 902 gdbus root mem REG 8,1 54352 24707 /usr/lib64/libnss_files-2.28.so 2023-08-01T20:01:34.971 INFO:teuthology.orchestra.run.smithi101.stdout:NetworkMa 820 902 gdbus root mem REG 8,1 1661416 24816 /usr/lib64/libstdc++.so.6.0.25 2023-08-01T20:01:34.971 INFO:teuthology.orchestra.run.smithi101.stdout:NetworkMa 820 902 gdbus root mem REG 8,1 43016 25837 /usr/lib64/libmodman.so.1.0.0 2023-08-01T20:01:34.971 INFO:teuthology.orchestra.run.smithi101.stdout:NetworkMa 820 902 gdbus root mem REG 8,1 174400 25839 /usr/lib64/libproxy.so.1.0.0 2023-08-01T20:01:34.971 INFO:teuthology.orchestra.run.smithi101.stdout:NetworkMa 820 902 gdbus root mem REG 8,1 2586930 39433 /usr/lib/locale/en_US.utf8/LC_COLLATE 2023-08-01T20:01:34.971 INFO:teuthology.orchestra.run.smithi101.stdout:NetworkMa 820 902 gdbus root mem REG 8,1 136040 24892 /usr/lib64/libcrypt.so.1.1.0 2023-08-01T20:01:34.971 INFO:teuthology.orchestra.run.smithi101.stdout:NetworkMa 820 902 gdbus root mem REG 8,1 134944 26083 /usr/lib64/libbrotlicommon.so.1.0.6 2023-08-01T20:01:34.971 INFO:teuthology.orchestra.run.smithi101.stdout:NetworkMa 820 902 gdbus root mem REG 8,1 1598840 24700 /usr/lib64/libm-2.28.so 2023-08-01T20:01:34.972 INFO:teuthology.orchestra.run.smithi101.stdout:NetworkMa 820 902 gdbus root mem REG 8,1 125440 26261 /usr/lib64/libsasl2.so.3.0.0 2023-08-01T20:01:34.972 INFO:teuthology.orchestra.run.smithi101.stdout:NetworkMa 820 902 gdbus root mem REG 8,1 16192 25072 /usr/lib64/libkeyutils.so.1.6 2023-08-01T20:01:34.972 INFO:teuthology.orchestra.run.smithi101.stdout:NetworkMa 820 902 gdbus root mem REG 8,1 71472 26580 /usr/lib64/libkrb5support.so.0.1 2023-08-01T20:01:34.972 INFO:teuthology.orchestra.run.smithi101.stdout:NetworkMa 820 902 gdbus root mem REG 8,1 145984 24905 /usr/lib64/libgpg-error.so.0.24.2 2023-08-01T20:01:34.972 INFO:teuthology.orchestra.run.smithi101.stdout:NetworkMa 820 902 gdbus root mem REG 8,1 33480 19526 /usr/lib64/libuuid.so.1.3.0 2023-08-01T20:01:34.972 INFO:teuthology.orchestra.run.smithi101.stdout:NetworkMa 820 902 gdbus root mem REG 8,1 343680 19531 /usr/lib64/libblkid.so.1.1.0 2023-08-01T20:01:34.972 INFO:teuthology.orchestra.run.smithi101.stdout:NetworkMa 820 902 gdbus root mem REG 8,1 92968 24709 /usr/lib64/libresolv-2.28.so 2023-08-01T20:01:34.972 INFO:teuthology.orchestra.run.smithi101.stdout:NetworkMa 820 902 gdbus root mem REG 8,1 464936 25554 /usr/lib64/libpcre.so.1.2.10 2023-08-01T20:01:34.973 INFO:teuthology.orchestra.run.smithi101.stdout:NetworkMa 820 902 gdbus root mem REG 8,1 37240 25164 /usr/lib64/libffi.so.6.0.2 2023-08-01T20:01:34.973 INFO:teuthology.orchestra.run.smithi101.stdout:NetworkMa 820 902 gdbus root mem REG 8,1 99640 24762 /usr/lib64/libz.so.1.2.11 2023-08-01T20:01:34.973 INFO:teuthology.orchestra.run.smithi101.stdout:NetworkMa 820 902 gdbus root mem REG 8,1 53616 26085 /usr/lib64/libbrotlidec.so.1.0.6 2023-08-01T20:01:34.973 INFO:teuthology.orchestra.run.smithi101.stdout:NetworkMa 820 902 gdbus root mem REG 8,1 67232 26280 /usr/lib64/liblber-2.4.so.2.10.9 2023-08-01T20:01:34.973 INFO:teuthology.orchestra.run.smithi101.stdout:NetworkMa 820 902 gdbus root mem REG 8,1 329184 26282 /usr/lib64/libldap-2.4.so.2.10.9 2023-08-01T20:01:34.973 INFO:teuthology.orchestra.run.smithi101.stdout:NetworkMa 820 902 gdbus root mem REG 8,1 16792 24764 /usr/lib64/libcom_err.so.2.1 2023-08-01T20:01:34.973 INFO:teuthology.orchestra.run.smithi101.stdout:NetworkMa 820 902 gdbus root mem REG 8,1 96288 26574 /usr/lib64/libk5crypto.so.3.1 2023-08-01T20:01:34.973 INFO:teuthology.orchestra.run.smithi101.stdout:NetworkMa 820 902 gdbus root mem REG 8,1 971432 26579 /usr/lib64/libkrb5.so.3.3 2023-08-01T20:01:34.974 INFO:teuthology.orchestra.run.smithi101.stdout:NetworkMa 820 902 gdbus root mem REG 8,1 355968 26571 /usr/lib64/libgssapi_krb5.so.2.2 2023-08-01T20:01:34.974 INFO:teuthology.orchestra.run.smithi101.stdout:NetworkMa 820 902 gdbus root mem REG 8,1 3083608 26861 /usr/lib64/libcrypto.so.1.1.1k 2023-08-01T20:01:34.974 INFO:teuthology.orchestra.run.smithi101.stdout:NetworkMa 820 902 gdbus root mem REG 8,1 615744 26862 /usr/lib64/libssl.so.1.1.1k 2023-08-01T20:01:34.974 INFO:teuthology.orchestra.run.smithi101.stdout:NetworkMa 820 902 gdbus root mem REG 8,1 69672 25357 /usr/lib64/libpsl.so.5.3.1 2023-08-01T20:01:34.974 INFO:teuthology.orchestra.run.smithi101.stdout:NetworkMa 820 902 gdbus root mem REG 8,1 464648 26276 /usr/lib64/libssh.so.4.8.7 2023-08-01T20:01:34.974 INFO:teuthology.orchestra.run.smithi101.stdout:NetworkMa 820 902 gdbus root mem REG 8,1 166888 26107 /usr/lib64/libnghttp2.so.14.17.0 2023-08-01T20:01:34.974 INFO:teuthology.orchestra.run.smithi101.stdout:NetworkMa 820 902 gdbus root mem REG 8,1 24928 25065 /usr/lib64/libcap-ng.so.0.0.0 2023-08-01T20:01:34.974 INFO:teuthology.orchestra.run.smithi101.stdout:NetworkMa 820 902 gdbus root mem REG 8,1 543304 24651 /usr/lib64/libpcre2-8.so.0.7.1 2023-08-01T20:01:34.975 INFO:teuthology.orchestra.run.smithi101.stdout:NetworkMa 820 902 gdbus root mem REG 8,1 1187312 25078 /usr/lib64/libgcrypt.so.20.2.5 2023-08-01T20:01:34.975 INFO:teuthology.orchestra.run.smithi101.stdout:NetworkMa 820 902 gdbus root mem REG 8,1 33752 24776 /usr/lib64/libcap.so.2.48 2023-08-01T20:01:34.975 INFO:teuthology.orchestra.run.smithi101.stdout:NetworkMa 820 902 gdbus root mem REG 8,1 119760 25264 /usr/lib64/liblz4.so.1.8.3 2023-08-01T20:01:34.975 INFO:teuthology.orchestra.run.smithi101.stdout:NetworkMa 820 902 gdbus root mem REG 8,1 162192 24774 /usr/lib64/liblzma.so.5.2.4 2023-08-01T20:01:34.975 INFO:teuthology.orchestra.run.smithi101.stdout:NetworkMa 820 902 gdbus root mem REG 8,1 42744 24710 /usr/lib64/librt-2.28.so 2023-08-01T20:01:34.975 INFO:teuthology.orchestra.run.smithi101.stdout:NetworkMa 820 902 gdbus root mem REG 8,1 371480 19864 /usr/lib64/libmount.so.1.1.0 2023-08-01T20:01:34.975 INFO:teuthology.orchestra.run.smithi101.stdout:NetworkMa 820 902 gdbus root mem REG 8,1 1541856 25080 /usr/lib64/libgmp.so.10.3.2 2023-08-01T20:01:34.975 INFO:teuthology.orchestra.run.smithi101.stdout:NetworkMa 820 902 gdbus root mem REG 8,1 197728 25272 /usr/lib64/libhogweed.so.4.5 2023-08-01T20:01:34.976 INFO:teuthology.orchestra.run.smithi101.stdout:NetworkMa 820 902 gdbus root mem REG 8,1 239360 25274 /usr/lib64/libnettle.so.6.5 2023-08-01T20:01:34.976 INFO:teuthology.orchestra.run.smithi101.stdout:NetworkMa 820 902 gdbus root mem REG 8,1 78816 25301 /usr/lib64/libtasn1.so.6.5.5 2023-08-01T20:01:34.976 INFO:teuthology.orchestra.run.smithi101.stdout:NetworkMa 820 902 gdbus root mem REG 8,1 1805368 25103 /usr/lib64/libunistring.so.2.1.0 2023-08-01T20:01:34.976 INFO:teuthology.orchestra.run.smithi101.stdout:NetworkMa 820 902 gdbus root mem REG 8,1 165624 25105 /usr/lib64/libidn2.so.0.3.6 2023-08-01T20:01:34.976 INFO:teuthology.orchestra.run.smithi101.stdout:NetworkMa 820 902 gdbus root mem REG 8,1 1246520 25167 /usr/lib64/libp11-kit.so.0.3.0 2023-08-01T20:01:34.976 INFO:teuthology.orchestra.run.smithi101.stdout:NetworkMa 820 902 gdbus root mem REG 8,1 2089984 24698 /usr/lib64/libc-2.28.so 2023-08-01T20:01:34.976 INFO:teuthology.orchestra.run.smithi101.stdout:NetworkMa 820 902 gdbus root mem REG 8,1 149984 24708 /usr/lib64/libpthread-2.28.so 2023-08-01T20:01:34.977 INFO:teuthology.orchestra.run.smithi101.stdout:NetworkMa 820 902 gdbus root mem REG 8,1 99672 31445 /usr/lib64/libgcc_s-8-20210514.so.1 2023-08-01T20:01:34.977 INFO:teuthology.orchestra.run.smithi101.stdout:NetworkMa 820 902 gdbus root mem REG 8,1 19128 24699 /usr/lib64/libdl-2.28.so 2023-08-01T20:01:34.977 INFO:teuthology.orchestra.run.smithi101.stdout:NetworkMa 820 902 gdbus root mem REG 8,1 1172024 27416 /usr/lib64/libglib-2.0.so.0.5600.4 2023-08-01T20:01:34.977 INFO:teuthology.orchestra.run.smithi101.stdout:NetworkMa 820 902 gdbus root mem REG 8,1 16064 27417 /usr/lib64/libgmodule-2.0.so.0.5600.4 2023-08-01T20:01:34.977 INFO:teuthology.orchestra.run.smithi101.stdout:NetworkMa 820 902 gdbus root mem REG 8,1 347416 27418 /usr/lib64/libgobject-2.0.so.0.5600.4 2023-08-01T20:01:34.977 INFO:teuthology.orchestra.run.smithi101.stdout:NetworkMa 820 902 gdbus root mem REG 8,1 1770248 27415 /usr/lib64/libgio-2.0.so.0.5600.4 2023-08-01T20:01:34.977 INFO:teuthology.orchestra.run.smithi101.stdout:NetworkMa 820 902 gdbus root mem REG 8,1 596536 26336 /usr/lib64/libcurl.so.4.5.0 2023-08-01T20:01:34.977 INFO:teuthology.orchestra.run.smithi101.stdout:NetworkMa 820 902 gdbus root mem REG 8,1 135784 24768 /usr/lib64/libaudit.so.1.0.0 2023-08-01T20:01:34.978 INFO:teuthology.orchestra.run.smithi101.stdout:NetworkMa 820 902 gdbus root mem REG 8,1 172104 24654 /usr/lib64/libselinux.so.1 2023-08-01T20:01:34.978 INFO:teuthology.orchestra.run.smithi101.stdout:NetworkMa 820 902 gdbus root mem REG 8,1 29040 26105 /usr/lib64/libndp.so.0.1.1 2023-08-01T20:01:34.978 INFO:teuthology.orchestra.run.smithi101.stdout:NetworkMa 820 902 gdbus root mem REG 8,1 1387784 26786 /usr/lib64/libsystemd.so.0.23.0 2023-08-01T20:01:34.978 INFO:teuthology.orchestra.run.smithi101.stdout:NetworkMa 820 902 gdbus root mem REG 8,1 658136 26787 /usr/lib64/libudev.so.1.6.11 2023-08-01T20:01:34.978 INFO:teuthology.orchestra.run.smithi101.stdout:NetworkMa 820 902 gdbus root mem REG 8,1 2051688 27472 /usr/lib64/libgnutls.so.30.28.2 2023-08-01T20:01:34.978 INFO:teuthology.orchestra.run.smithi101.stdout:NetworkMa 820 902 gdbus root mem REG 8,1 1062168 24653 /usr/lib64/ld-2.28.so 2023-08-01T20:01:34.978 INFO:teuthology.orchestra.run.smithi101.stdout:NetworkMa 820 902 gdbus root mem REG 8,1 337024 45489 /usr/lib/locale/C.utf8/LC_CTYPE 2023-08-01T20:01:34.978 INFO:teuthology.orchestra.run.smithi101.stdout:NetworkMa 820 902 gdbus root mem REG 8,1 54 44174 /usr/lib/locale/en_US.utf8/LC_NUMERIC 2023-08-01T20:01:34.979 INFO:teuthology.orchestra.run.smithi101.stdout:NetworkMa 820 902 gdbus root mem REG 8,1 3316 48200 /usr/lib/locale/en_US.utf8/LC_TIME 2023-08-01T20:01:34.979 INFO:teuthology.orchestra.run.smithi101.stdout:NetworkMa 820 902 gdbus root mem REG 8,1 286 48207 /usr/lib/locale/en_US.utf8/LC_MONETARY 2023-08-01T20:01:34.979 INFO:teuthology.orchestra.run.smithi101.stdout:NetworkMa 820 902 gdbus root mem REG 8,1 26998 35419 /usr/lib64/gconv/gconv-modules.cache 2023-08-01T20:01:34.979 INFO:teuthology.orchestra.run.smithi101.stdout:NetworkMa 820 902 gdbus root mem REG 8,1 57 39434 /usr/lib/locale/en_US.utf8/LC_MESSAGES/SYS_LC_MESSAGES 2023-08-01T20:01:34.979 INFO:teuthology.orchestra.run.smithi101.stdout:NetworkMa 820 902 gdbus root mem REG 8,1 34 39448 /usr/lib/locale/en_US.utf8/LC_PAPER 2023-08-01T20:01:34.979 INFO:teuthology.orchestra.run.smithi101.stdout:NetworkMa 820 902 gdbus root mem REG 8,1 77 44173 /usr/lib/locale/en_US.utf8/LC_NAME 2023-08-01T20:01:34.979 INFO:teuthology.orchestra.run.smithi101.stdout:NetworkMa 820 902 gdbus root mem REG 8,1 167 45462 /usr/lib/locale/en_US.utf8/LC_ADDRESS 2023-08-01T20:01:34.979 INFO:teuthology.orchestra.run.smithi101.stdout:NetworkMa 820 902 gdbus root mem REG 8,1 59 48208 /usr/lib/locale/en_US.utf8/LC_TELEPHONE 2023-08-01T20:01:34.980 INFO:teuthology.orchestra.run.smithi101.stdout:NetworkMa 820 902 gdbus root mem REG 8,1 23 48206 /usr/lib/locale/en_US.utf8/LC_MEASUREMENT 2023-08-01T20:01:34.980 INFO:teuthology.orchestra.run.smithi101.stdout:NetworkMa 820 902 gdbus root mem REG 8,1 368 48205 /usr/lib/locale/en_US.utf8/LC_IDENTIFICATION 2023-08-01T20:01:34.980 INFO:teuthology.orchestra.run.smithi101.stdout:NetworkMa 820 902 gdbus root 0r CHR 1,3 0t0 3083 /dev/null 2023-08-01T20:01:34.980 INFO:teuthology.orchestra.run.smithi101.stdout:NetworkMa 820 902 gdbus root 1u unix 0xffff93750c993f00 0t0 21710 type=STREAM 2023-08-01T20:01:34.980 INFO:teuthology.orchestra.run.smithi101.stdout:NetworkMa 820 902 gdbus root 2u unix 0xffff93750c993f00 0t0 21710 type=STREAM 2023-08-01T20:01:34.980 INFO:teuthology.orchestra.run.smithi101.stdout:NetworkMa 820 902 gdbus root 3u a_inode 0,14 0 15587 [eventfd] 2023-08-01T20:01:34.980 INFO:teuthology.orchestra.run.smithi101.stdout:NetworkMa 820 902 gdbus root 4u a_inode 0,14 0 15587 [eventfd] 2023-08-01T20:01:34.980 INFO:teuthology.orchestra.run.smithi101.stdout:NetworkMa 820 902 gdbus root 5u unix 0xffff9370586ca880 0t0 30966 type=DGRAM 2023-08-01T20:01:34.981 INFO:teuthology.orchestra.run.smithi101.stdout:NetworkMa 820 902 gdbus root 6u unix 0xffff9370586c8d80 0t0 30967 type=STREAM 2023-08-01T20:01:34.981 INFO:teuthology.orchestra.run.smithi101.stdout:NetworkMa 820 902 gdbus root 7u a_inode 0,14 0 15587 [eventfd] 2023-08-01T20:01:34.981 INFO:teuthology.orchestra.run.smithi101.stdout:NetworkMa 820 902 gdbus root 8r REG 0,4 0 4026532000 net 2023-08-01T20:01:34.981 INFO:teuthology.orchestra.run.smithi101.stdout:NetworkMa 820 902 gdbus root 9r REG 0,4 0 4026532494 mnt 2023-08-01T20:01:34.981 INFO:teuthology.orchestra.run.smithi101.stdout:NetworkMa 820 902 gdbus root 10u netlink 0t0 21764 KOBJECT_UEVENT 2023-08-01T20:01:34.981 INFO:teuthology.orchestra.run.smithi101.stdout:NetworkMa 820 902 gdbus root 11u netlink 0t0 21765 GENERIC 2023-08-01T20:01:34.981 INFO:teuthology.orchestra.run.smithi101.stdout:NetworkMa 820 902 gdbus root 12u netlink 0t0 21766 GENERIC 2023-08-01T20:01:34.981 INFO:teuthology.orchestra.run.smithi101.stdout:NetworkMa 820 902 gdbus root 13u netlink 0t0 21767 ROUTE 2023-08-01T20:01:34.982 INFO:teuthology.orchestra.run.smithi101.stdout:NetworkMa 820 902 gdbus root 14r a_inode 0,14 0 15587 inotify 2023-08-01T20:01:34.982 INFO:teuthology.orchestra.run.smithi101.stdout:NetworkMa 820 902 gdbus root 15r a_inode 0,14 0 15587 inotify 2023-08-01T20:01:34.982 INFO:teuthology.orchestra.run.smithi101.stdout:NetworkMa 820 902 gdbus root 16u netlink 0t0 22076 KOBJECT_UEVENT 2023-08-01T20:01:34.982 INFO:teuthology.orchestra.run.smithi101.stdout:NetworkMa 820 902 gdbus root 17u a_inode 0,14 0 15587 [eventpoll] 2023-08-01T20:01:34.982 INFO:teuthology.orchestra.run.smithi101.stdout:NetworkMa 820 902 gdbus root 18u unix 0xffff93750c8c0d80 0t0 19990 type=STREAM 2023-08-01T20:01:34.982 INFO:teuthology.orchestra.run.smithi101.stdout:NetworkMa 820 902 gdbus root 19u a_inode 0,14 0 15587 [eventpoll] 2023-08-01T20:01:34.982 INFO:teuthology.orchestra.run.smithi101.stdout:NetworkMa 820 902 gdbus root 20w FIFO 0,24 0t0 31775 /run/systemd/inhibit/1.ref 2023-08-01T20:01:34.982 INFO:teuthology.orchestra.run.smithi101.stdout:NetworkMa 820 902 gdbus root 21u a_inode 0,14 0 15587 [timerfd] 2023-08-01T20:01:34.983 INFO:teuthology.orchestra.run.smithi101.stdout:NetworkMa 820 902 gdbus root 23u a_inode 0,14 0 15587 [eventpoll] 2023-08-01T20:01:34.983 INFO:teuthology.orchestra.run.smithi101.stdout:NetworkMa 820 902 gdbus root 24u a_inode 0,14 0 15587 [timerfd] 2023-08-01T20:01:34.983 INFO:teuthology.orchestra.run.smithi101.stdout:NetworkMa 820 902 gdbus root 25u pack 32979 0t0 ARP type=SOCK_DGRAM 2023-08-01T20:01:34.983 INFO:teuthology.orchestra.run.smithi101.stdout:NetworkMa 820 902 gdbus root 26u IPv4 32980 0t0 UDP smithi101.front.sepia.ceph.com:bootpc->store01.front.sepia.ceph.com:bootps 2023-08-01T20:01:34.983 INFO:teuthology.orchestra.run.smithi101.stdout:kworker/2 826 root cwd DIR 8,1 4096 2 / 2023-08-01T20:01:34.983 INFO:teuthology.orchestra.run.smithi101.stdout:kworker/2 826 root rtd DIR 8,1 4096 2 / 2023-08-01T20:01:34.983 INFO:teuthology.orchestra.run.smithi101.stdout:kworker/2 826 root txt unknown /proc/826/exe 2023-08-01T20:01:34.983 INFO:teuthology.orchestra.run.smithi101.stdout:chronyd 828 chrony cwd DIR 8,1 4096 2 / 2023-08-01T20:01:34.984 INFO:teuthology.orchestra.run.smithi101.stdout:chronyd 828 chrony rtd DIR 8,1 4096 2 / 2023-08-01T20:01:34.984 INFO:teuthology.orchestra.run.smithi101.stdout:chronyd 828 chrony txt REG 8,1 359680 30310 /usr/sbin/chronyd 2023-08-01T20:01:34.984 INFO:teuthology.orchestra.run.smithi101.stdout:chronyd 828 chrony mem REG 8,1 543304 24651 /usr/lib64/libpcre2-8.so.0.7.1 2023-08-01T20:01:34.984 INFO:teuthology.orchestra.run.smithi101.stdout:chronyd 828 chrony mem REG 8,1 172104 24654 /usr/lib64/libselinux.so.1 2023-08-01T20:01:34.984 INFO:teuthology.orchestra.run.smithi101.stdout:chronyd 828 chrony mem REG 8,1 33480 19526 /usr/lib64/libuuid.so.1.3.0 2023-08-01T20:01:34.984 INFO:teuthology.orchestra.run.smithi101.stdout:chronyd 828 chrony mem REG 8,1 343680 19531 /usr/lib64/libblkid.so.1.1.0 2023-08-01T20:01:34.984 INFO:teuthology.orchestra.run.smithi101.stdout:chronyd 828 chrony mem REG 8,1 99672 31445 /usr/lib64/libgcc_s-8-20210514.so.1 2023-08-01T20:01:34.985 INFO:teuthology.orchestra.run.smithi101.stdout:chronyd 828 chrony mem REG 8,1 371480 19864 /usr/lib64/libmount.so.1.1.0 2023-08-01T20:01:34.985 INFO:teuthology.orchestra.run.smithi101.stdout:chronyd 828 chrony mem REG 8,1 42744 24710 /usr/lib64/librt-2.28.so 2023-08-01T20:01:34.985 INFO:teuthology.orchestra.run.smithi101.stdout:chronyd 828 chrony mem REG 8,1 720816 26783 /usr/lib64/libnss_myhostname.so.2 2023-08-01T20:01:34.985 INFO:teuthology.orchestra.run.smithi101.stdout:chronyd 828 chrony mem REG 8,1 92968 24709 /usr/lib64/libresolv-2.28.so 2023-08-01T20:01:34.985 INFO:teuthology.orchestra.run.smithi101.stdout:chronyd 828 chrony mem REG 8,1 29264 24705 /usr/lib64/libnss_dns-2.28.so 2023-08-01T20:01:34.985 INFO:teuthology.orchestra.run.smithi101.stdout:chronyd 828 chrony mem REG 8,1 54352 24707 /usr/lib64/libnss_files-2.28.so 2023-08-01T20:01:34.985 INFO:teuthology.orchestra.run.smithi101.stdout:chronyd 828 chrony mem REG 8,1 37240 25164 /usr/lib64/libffi.so.6.0.2 2023-08-01T20:01:34.985 INFO:teuthology.orchestra.run.smithi101.stdout:chronyd 828 chrony mem REG 8,1 1541856 25080 /usr/lib64/libgmp.so.10.3.2 2023-08-01T20:01:34.986 INFO:teuthology.orchestra.run.smithi101.stdout:chronyd 828 chrony mem REG 8,1 197728 25272 /usr/lib64/libhogweed.so.4.5 2023-08-01T20:01:34.986 INFO:teuthology.orchestra.run.smithi101.stdout:chronyd 828 chrony mem REG 8,1 78816 25301 /usr/lib64/libtasn1.so.6.5.5 2023-08-01T20:01:34.986 INFO:teuthology.orchestra.run.smithi101.stdout:chronyd 828 chrony mem REG 8,1 19128 24699 /usr/lib64/libdl-2.28.so 2023-08-01T20:01:34.986 INFO:teuthology.orchestra.run.smithi101.stdout:chronyd 828 chrony mem REG 8,1 1805368 25103 /usr/lib64/libunistring.so.2.1.0 2023-08-01T20:01:34.986 INFO:teuthology.orchestra.run.smithi101.stdout:chronyd 828 chrony mem REG 8,1 165624 25105 /usr/lib64/libidn2.so.0.3.6 2023-08-01T20:01:34.986 INFO:teuthology.orchestra.run.smithi101.stdout:chronyd 828 chrony mem REG 8,1 1246520 25167 /usr/lib64/libp11-kit.so.0.3.0 2023-08-01T20:01:34.986 INFO:teuthology.orchestra.run.smithi101.stdout:chronyd 828 chrony mem REG 8,1 2089984 24698 /usr/lib64/libc-2.28.so 2023-08-01T20:01:34.986 INFO:teuthology.orchestra.run.smithi101.stdout:chronyd 828 chrony mem REG 8,1 149984 24708 /usr/lib64/libpthread-2.28.so 2023-08-01T20:01:34.987 INFO:teuthology.orchestra.run.smithi101.stdout:chronyd 828 chrony mem REG 8,1 128792 25521 /usr/lib64/libseccomp.so.2.5.2 2023-08-01T20:01:34.987 INFO:teuthology.orchestra.run.smithi101.stdout:chronyd 828 chrony mem REG 8,1 33752 24776 /usr/lib64/libcap.so.2.48 2023-08-01T20:01:34.987 INFO:teuthology.orchestra.run.smithi101.stdout:chronyd 828 chrony mem REG 8,1 2051688 27472 /usr/lib64/libgnutls.so.30.28.2 2023-08-01T20:01:34.987 INFO:teuthology.orchestra.run.smithi101.stdout:chronyd 828 chrony mem REG 8,1 239360 25274 /usr/lib64/libnettle.so.6.5 2023-08-01T20:01:34.987 INFO:teuthology.orchestra.run.smithi101.stdout:chronyd 828 chrony mem REG 8,1 1598840 24700 /usr/lib64/libm-2.28.so 2023-08-01T20:01:34.987 INFO:teuthology.orchestra.run.smithi101.stdout:chronyd 828 chrony mem REG 8,1 1062168 24653 /usr/lib64/ld-2.28.so 2023-08-01T20:01:34.987 INFO:teuthology.orchestra.run.smithi101.stdout:chronyd 828 chrony 0r CHR 1,3 0t0 3083 /dev/null 2023-08-01T20:01:34.987 INFO:teuthology.orchestra.run.smithi101.stdout:chronyd 828 chrony 1w CHR 1,3 0t0 3083 /dev/null 2023-08-01T20:01:34.988 INFO:teuthology.orchestra.run.smithi101.stdout:chronyd 828 chrony 2u CHR 1,3 0t0 3083 /dev/null 2023-08-01T20:01:34.988 INFO:teuthology.orchestra.run.smithi101.stdout:chronyd 828 chrony 3u unix 0xffff937080485a00 0t0 27914 type=DGRAM 2023-08-01T20:01:34.988 INFO:teuthology.orchestra.run.smithi101.stdout:chronyd 828 chrony 5u IPv4 27943 0t0 UDP localhost:323 2023-08-01T20:01:34.988 INFO:teuthology.orchestra.run.smithi101.stdout:chronyd 828 chrony 6u IPv6 27944 0t0 UDP localhost:323 2023-08-01T20:01:34.988 INFO:teuthology.orchestra.run.smithi101.stdout:chronyd 828 chrony 7u unix 0xffff937080481f80 0t0 27945 /run/chrony/chronyd.sock type=DGRAM 2023-08-01T20:01:34.988 INFO:teuthology.orchestra.run.smithi101.stdout:ksmtuned 830 root cwd DIR 8,1 4096 2 / 2023-08-01T20:01:34.988 INFO:teuthology.orchestra.run.smithi101.stdout:ksmtuned 830 root rtd DIR 8,1 4096 2 / 2023-08-01T20:01:34.988 INFO:teuthology.orchestra.run.smithi101.stdout:ksmtuned 830 root txt REG 8,1 1150560 21617 /usr/bin/bash 2023-08-01T20:01:34.989 INFO:teuthology.orchestra.run.smithi101.stdout:ksmtuned 830 root mem REG 8,1 54352 24707 /usr/lib64/libnss_files-2.28.so 2023-08-01T20:01:34.989 INFO:teuthology.orchestra.run.smithi101.stdout:ksmtuned 830 root mem REG 8,1 2586930 39433 /usr/lib/locale/en_US.utf8/LC_COLLATE 2023-08-01T20:01:34.989 INFO:teuthology.orchestra.run.smithi101.stdout:ksmtuned 830 root mem REG 8,1 2089984 24698 /usr/lib64/libc-2.28.so 2023-08-01T20:01:34.989 INFO:teuthology.orchestra.run.smithi101.stdout:ksmtuned 830 root mem REG 8,1 19128 24699 /usr/lib64/libdl-2.28.so 2023-08-01T20:01:34.989 INFO:teuthology.orchestra.run.smithi101.stdout:ksmtuned 830 root mem REG 8,1 187496 24674 /usr/lib64/libtinfo.so.6.1 2023-08-01T20:01:34.989 INFO:teuthology.orchestra.run.smithi101.stdout:ksmtuned 830 root mem REG 8,1 1062168 24653 /usr/lib64/ld-2.28.so 2023-08-01T20:01:34.989 INFO:teuthology.orchestra.run.smithi101.stdout:ksmtuned 830 root mem REG 8,1 337024 45489 /usr/lib/locale/C.utf8/LC_CTYPE 2023-08-01T20:01:34.989 INFO:teuthology.orchestra.run.smithi101.stdout:ksmtuned 830 root mem REG 8,1 54 44174 /usr/lib/locale/en_US.utf8/LC_NUMERIC 2023-08-01T20:01:34.990 INFO:teuthology.orchestra.run.smithi101.stdout:ksmtuned 830 root mem REG 8,1 3316 48200 /usr/lib/locale/en_US.utf8/LC_TIME 2023-08-01T20:01:34.990 INFO:teuthology.orchestra.run.smithi101.stdout:ksmtuned 830 root mem REG 8,1 286 48207 /usr/lib/locale/en_US.utf8/LC_MONETARY 2023-08-01T20:01:34.990 INFO:teuthology.orchestra.run.smithi101.stdout:ksmtuned 830 root mem REG 8,1 26998 35419 /usr/lib64/gconv/gconv-modules.cache 2023-08-01T20:01:34.990 INFO:teuthology.orchestra.run.smithi101.stdout:ksmtuned 830 root mem REG 8,1 57 39434 /usr/lib/locale/en_US.utf8/LC_MESSAGES/SYS_LC_MESSAGES 2023-08-01T20:01:34.990 INFO:teuthology.orchestra.run.smithi101.stdout:ksmtuned 830 root mem REG 8,1 34 39448 /usr/lib/locale/en_US.utf8/LC_PAPER 2023-08-01T20:01:34.990 INFO:teuthology.orchestra.run.smithi101.stdout:ksmtuned 830 root mem REG 8,1 77 44173 /usr/lib/locale/en_US.utf8/LC_NAME 2023-08-01T20:01:34.990 INFO:teuthology.orchestra.run.smithi101.stdout:ksmtuned 830 root mem REG 8,1 167 45462 /usr/lib/locale/en_US.utf8/LC_ADDRESS 2023-08-01T20:01:34.990 INFO:teuthology.orchestra.run.smithi101.stdout:ksmtuned 830 root mem REG 8,1 59 48208 /usr/lib/locale/en_US.utf8/LC_TELEPHONE 2023-08-01T20:01:34.991 INFO:teuthology.orchestra.run.smithi101.stdout:ksmtuned 830 root mem REG 8,1 23 48206 /usr/lib/locale/en_US.utf8/LC_MEASUREMENT 2023-08-01T20:01:34.991 INFO:teuthology.orchestra.run.smithi101.stdout:ksmtuned 830 root mem REG 8,1 368 48205 /usr/lib/locale/en_US.utf8/LC_IDENTIFICATION 2023-08-01T20:01:34.991 INFO:teuthology.orchestra.run.smithi101.stdout:ksmtuned 830 root 0r CHR 1,3 0t0 3083 /dev/null 2023-08-01T20:01:34.991 INFO:teuthology.orchestra.run.smithi101.stdout:ksmtuned 830 root 1u unix 0xffff937080485e80 0t0 27909 type=STREAM 2023-08-01T20:01:34.991 INFO:teuthology.orchestra.run.smithi101.stdout:ksmtuned 830 root 2u unix 0xffff937080485e80 0t0 27909 type=STREAM 2023-08-01T20:01:34.991 INFO:teuthology.orchestra.run.smithi101.stdout:sshd 903 root cwd DIR 8,1 4096 2 / 2023-08-01T20:01:34.991 INFO:teuthology.orchestra.run.smithi101.stdout:sshd 903 root rtd DIR 8,1 4096 2 / 2023-08-01T20:01:34.991 INFO:teuthology.orchestra.run.smithi101.stdout:sshd 903 root txt REG 8,1 890504 30329 /usr/sbin/sshd 2023-08-01T20:01:34.992 INFO:teuthology.orchestra.run.smithi101.stdout:sshd 903 root mem REG 8,1 54352 24707 /usr/lib64/libnss_files-2.28.so 2023-08-01T20:01:34.992 INFO:teuthology.orchestra.run.smithi101.stdout:sshd 903 root mem REG 8,1 145984 24905 /usr/lib64/libgpg-error.so.0.24.2 2023-08-01T20:01:34.992 INFO:teuthology.orchestra.run.smithi101.stdout:sshd 903 root mem REG 8,1 33480 19526 /usr/lib64/libuuid.so.1.3.0 2023-08-01T20:01:34.992 INFO:teuthology.orchestra.run.smithi101.stdout:sshd 903 root mem REG 8,1 343680 19531 /usr/lib64/libblkid.so.1.1.0 2023-08-01T20:01:34.992 INFO:teuthology.orchestra.run.smithi101.stdout:sshd 903 root mem REG 8,1 16192 25072 /usr/lib64/libkeyutils.so.1.6 2023-08-01T20:01:34.992 INFO:teuthology.orchestra.run.smithi101.stdout:sshd 903 root mem REG 8,1 71472 26580 /usr/lib64/libkrb5support.so.0.1 2023-08-01T20:01:34.992 INFO:teuthology.orchestra.run.smithi101.stdout:sshd 903 root mem REG 8,1 543304 24651 /usr/lib64/libpcre2-8.so.0.7.1 2023-08-01T20:01:34.993 INFO:teuthology.orchestra.run.smithi101.stdout:sshd 903 root mem REG 8,1 149984 24708 /usr/lib64/libpthread-2.28.so 2023-08-01T20:01:34.993 INFO:teuthology.orchestra.run.smithi101.stdout:sshd 903 root mem REG 8,1 99672 31445 /usr/lib64/libgcc_s-8-20210514.so.1 2023-08-01T20:01:34.993 INFO:teuthology.orchestra.run.smithi101.stdout:sshd 903 root mem REG 8,1 1187312 25078 /usr/lib64/libgcrypt.so.20.2.5 2023-08-01T20:01:34.993 INFO:teuthology.orchestra.run.smithi101.stdout:sshd 903 root mem REG 8,1 371480 19864 /usr/lib64/libmount.so.1.1.0 2023-08-01T20:01:34.993 INFO:teuthology.orchestra.run.smithi101.stdout:sshd 903 root mem REG 8,1 33752 24776 /usr/lib64/libcap.so.2.48 2023-08-01T20:01:34.993 INFO:teuthology.orchestra.run.smithi101.stdout:sshd 903 root mem REG 8,1 119760 25264 /usr/lib64/liblz4.so.1.8.3 2023-08-01T20:01:34.993 INFO:teuthology.orchestra.run.smithi101.stdout:sshd 903 root mem REG 8,1 162192 24774 /usr/lib64/liblzma.so.5.2.4 2023-08-01T20:01:34.993 INFO:teuthology.orchestra.run.smithi101.stdout:sshd 903 root mem REG 8,1 42744 24710 /usr/lib64/librt-2.28.so 2023-08-01T20:01:34.994 INFO:teuthology.orchestra.run.smithi101.stdout:sshd 903 root mem REG 8,1 24928 25065 /usr/lib64/libcap-ng.so.0.0.0 2023-08-01T20:01:34.994 INFO:teuthology.orchestra.run.smithi101.stdout:sshd 903 root mem REG 8,1 2089984 24698 /usr/lib64/libc-2.28.so 2023-08-01T20:01:34.994 INFO:teuthology.orchestra.run.smithi101.stdout:sshd 903 root mem REG 8,1 16792 24764 /usr/lib64/libcom_err.so.2.1 2023-08-01T20:01:34.994 INFO:teuthology.orchestra.run.smithi101.stdout:sshd 903 root mem REG 8,1 96288 26574 /usr/lib64/libk5crypto.so.3.1 2023-08-01T20:01:34.994 INFO:teuthology.orchestra.run.smithi101.stdout:sshd 903 root mem REG 8,1 971432 26579 /usr/lib64/libkrb5.so.3.3 2023-08-01T20:01:34.994 INFO:teuthology.orchestra.run.smithi101.stdout:sshd 903 root mem REG 8,1 355968 26571 /usr/lib64/libgssapi_krb5.so.2.2 2023-08-01T20:01:34.994 INFO:teuthology.orchestra.run.smithi101.stdout:sshd 903 root mem REG 8,1 172104 24654 /usr/lib64/libselinux.so.1 2023-08-01T20:01:34.994 INFO:teuthology.orchestra.run.smithi101.stdout:sshd 903 root mem REG 8,1 92968 24709 /usr/lib64/libresolv-2.28.so 2023-08-01T20:01:34.995 INFO:teuthology.orchestra.run.smithi101.stdout:sshd 903 root mem REG 8,1 136040 24892 /usr/lib64/libcrypt.so.1.1.0 2023-08-01T20:01:34.995 INFO:teuthology.orchestra.run.smithi101.stdout:sshd 903 root mem REG 8,1 99640 24762 /usr/lib64/libz.so.1.2.11 2023-08-01T20:01:34.995 INFO:teuthology.orchestra.run.smithi101.stdout:sshd 903 root mem REG 8,1 17016 24713 /usr/lib64/libutil-2.28.so 2023-08-01T20:01:34.995 INFO:teuthology.orchestra.run.smithi101.stdout:sshd 903 root mem REG 8,1 19128 24699 /usr/lib64/libdl-2.28.so 2023-08-01T20:01:34.995 INFO:teuthology.orchestra.run.smithi101.stdout:sshd 903 root mem REG 8,1 3083608 26861 /usr/lib64/libcrypto.so.1.1.1k 2023-08-01T20:01:34.995 INFO:teuthology.orchestra.run.smithi101.stdout:sshd 903 root mem REG 8,1 1387784 26786 /usr/lib64/libsystemd.so.0.23.0 2023-08-01T20:01:34.995 INFO:teuthology.orchestra.run.smithi101.stdout:sshd 903 root mem REG 8,1 66504 27020 /usr/lib64/libpam.so.0.84.2 2023-08-01T20:01:34.995 INFO:teuthology.orchestra.run.smithi101.stdout:sshd 903 root mem REG 8,1 135784 24768 /usr/lib64/libaudit.so.1.0.0 2023-08-01T20:01:34.996 INFO:teuthology.orchestra.run.smithi101.stdout:sshd 903 root mem REG 8,1 1062168 24653 /usr/lib64/ld-2.28.so 2023-08-01T20:01:34.996 INFO:teuthology.orchestra.run.smithi101.stdout:sshd 903 root 0r CHR 1,3 0t0 3083 /dev/null 2023-08-01T20:01:34.996 INFO:teuthology.orchestra.run.smithi101.stdout:sshd 903 root 1u unix 0xffff93750c994800 0t0 21861 type=STREAM 2023-08-01T20:01:34.996 INFO:teuthology.orchestra.run.smithi101.stdout:sshd 903 root 2u unix 0xffff93750c994800 0t0 21861 type=STREAM 2023-08-01T20:01:34.996 INFO:teuthology.orchestra.run.smithi101.stdout:sshd 903 root 3u IPv4 30991 0t0 TCP *:ssh (LISTEN) 2023-08-01T20:01:34.996 INFO:teuthology.orchestra.run.smithi101.stdout:sshd 903 root 4u IPv6 30993 0t0 TCP *:ssh (LISTEN) 2023-08-01T20:01:34.996 INFO:teuthology.orchestra.run.smithi101.stdout:tuned 904 root cwd DIR 8,1 4096 2 / 2023-08-01T20:01:34.996 INFO:teuthology.orchestra.run.smithi101.stdout:tuned 904 root rtd DIR 8,1 4096 2 / 2023-08-01T20:01:34.997 INFO:teuthology.orchestra.run.smithi101.stdout:tuned 904 root txt REG 8,1 11856 35518 /usr/libexec/platform-python3.6 2023-08-01T20:01:34.997 INFO:teuthology.orchestra.run.smithi101.stdout:tuned 904 root mem REG 0,14 15587 anon_inode:[perf_event] (stat: No such file or directory) 2023-08-01T20:01:34.997 INFO:teuthology.orchestra.run.smithi101.stdout:tuned 904 root mem REG 8,1 51192 25552 /usr/lib64/libnuma.so.1.0.0 2023-08-01T20:01:34.997 INFO:teuthology.orchestra.run.smithi101.stdout:tuned 904 root mem REG 8,1 380560 55859 /usr/lib64/python3.6/site-packages/perf.cpython-36m-x86_64-linux-gnu.so 2023-08-01T20:01:34.997 INFO:teuthology.orchestra.run.smithi101.stdout:tuned 904 root mem REG 8,1 658136 26787 /usr/lib64/libudev.so.1.6.11 2023-08-01T20:01:34.997 INFO:teuthology.orchestra.run.smithi101.stdout:tuned 904 root mem REG 8,1 80120 53976 /usr/lib64/python3.6/lib-dynload/_json.cpython-36m-x86_64-linux-gnu.so 2023-08-01T20:01:34.997 INFO:teuthology.orchestra.run.smithi101.stdout:tuned 904 root mem REG 8,1 19464 53995 /usr/lib64/python3.6/lib-dynload/fcntl.cpython-36m-x86_64-linux-gnu.so 2023-08-01T20:01:34.997 INFO:teuthology.orchestra.run.smithi101.stdout:tuned 904 root mem REG 8,1 115184 53968 /usr/lib64/python3.6/lib-dynload/_datetime.cpython-36m-x86_64-linux-gnu.so 2023-08-01T20:01:34.998 INFO:teuthology.orchestra.run.smithi101.stdout:tuned 904 root mem REG 8,1 133480 53965 /usr/lib64/python3.6/lib-dynload/_ctypes.cpython-36m-x86_64-linux-gnu.so 2023-08-01T20:01:34.998 INFO:teuthology.orchestra.run.smithi101.stdout:tuned 904 root mem REG 8,1 185900 58195 /usr/lib64/girepository-1.0/GLib-2.0.typelib 2023-08-01T20:01:34.998 INFO:teuthology.orchestra.run.smithi101.stdout:tuned 904 root mem REG 8,1 243216 27722 /usr/lib64/libgirepository-1.0.so.1.0.0 2023-08-01T20:01:34.998 INFO:teuthology.orchestra.run.smithi101.stdout:tuned 904 root mem REG 8,1 340928 55601 /usr/lib64/python3.6/site-packages/gi/_gi.cpython-36m-x86_64-linux-gnu.so 2023-08-01T20:01:34.998 INFO:teuthology.orchestra.run.smithi101.stdout:tuned 904 root mem REG 8,1 1541856 25080 /usr/lib64/libgmp.so.10.3.2 2023-08-01T20:01:34.998 INFO:teuthology.orchestra.run.smithi101.stdout:tuned 904 root mem REG 8,1 197728 25272 /usr/lib64/libhogweed.so.4.5 2023-08-01T20:01:34.998 INFO:teuthology.orchestra.run.smithi101.stdout:tuned 904 root mem REG 8,1 239360 25274 /usr/lib64/libnettle.so.6.5 2023-08-01T20:01:34.998 INFO:teuthology.orchestra.run.smithi101.stdout:tuned 904 root mem REG 8,1 78816 25301 /usr/lib64/libtasn1.so.6.5.5 2023-08-01T20:01:34.999 INFO:teuthology.orchestra.run.smithi101.stdout:tuned 904 root mem REG 8,1 1805368 25103 /usr/lib64/libunistring.so.2.1.0 2023-08-01T20:01:34.999 INFO:teuthology.orchestra.run.smithi101.stdout:tuned 904 root mem REG 8,1 165624 25105 /usr/lib64/libidn2.so.0.3.6 2023-08-01T20:01:34.999 INFO:teuthology.orchestra.run.smithi101.stdout:tuned 904 root mem REG 8,1 1246520 25167 /usr/lib64/libp11-kit.so.0.3.0 2023-08-01T20:01:34.999 INFO:teuthology.orchestra.run.smithi101.stdout:tuned 904 root mem REG 8,1 92968 24709 /usr/lib64/libresolv-2.28.so 2023-08-01T20:01:34.999 INFO:teuthology.orchestra.run.smithi101.stdout:tuned 904 root mem REG 8,1 16064 27417 /usr/lib64/libgmodule-2.0.so.0.5600.4 2023-08-01T20:01:34.999 INFO:teuthology.orchestra.run.smithi101.stdout:tuned 904 root mem REG 8,1 37240 25164 /usr/lib64/libffi.so.6.0.2 2023-08-01T20:01:34.999 INFO:teuthology.orchestra.run.smithi101.stdout:tuned 904 root mem REG 8,1 464936 25554 /usr/lib64/libpcre.so.1.2.10 2023-08-01T20:01:35.000 INFO:teuthology.orchestra.run.smithi101.stdout:tuned 904 root mem REG 8,1 2051688 27472 /usr/lib64/libgnutls.so.30.28.2 2023-08-01T20:01:35.000 INFO:teuthology.orchestra.run.smithi101.stdout:tuned 904 root mem REG 8,1 1770248 27415 /usr/lib64/libgio-2.0.so.0.5600.4 2023-08-01T20:01:35.000 INFO:teuthology.orchestra.run.smithi101.stdout:tuned 904 root mem REG 8,1 1172024 27416 /usr/lib64/libglib-2.0.so.0.5600.4 2023-08-01T20:01:35.000 INFO:teuthology.orchestra.run.smithi101.stdout:tuned 904 root mem REG 8,1 347416 27418 /usr/lib64/libgobject-2.0.so.0.5600.4 2023-08-01T20:01:35.000 INFO:teuthology.orchestra.run.smithi101.stdout:tuned 904 root mem REG 8,1 199776 28793 /usr/lib64/libdbus-glib-1.so.2.3.4 2023-08-01T20:01:35.000 INFO:teuthology.orchestra.run.smithi101.stdout:tuned 904 root mem REG 8,1 12800 55753 /usr/lib64/python3.6/site-packages/_dbus_glib_bindings.so 2023-08-01T20:01:35.000 INFO:teuthology.orchestra.run.smithi101.stdout:tuned 904 root mem REG 8,1 248216 24968 /usr/lib64/libexpat.so.1.6.7 2023-08-01T20:01:35.000 INFO:teuthology.orchestra.run.smithi101.stdout:tuned 904 root mem REG 8,1 66896 54002 /usr/lib64/python3.6/lib-dynload/pyexpat.cpython-36m-x86_64-linux-gnu.so 2023-08-01T20:01:35.001 INFO:teuthology.orchestra.run.smithi101.stdout:tuned 904 root mem REG 8,1 543304 24651 /usr/lib64/libpcre2-8.so.0.7.1 2023-08-01T20:01:35.001 INFO:teuthology.orchestra.run.smithi101.stdout:tuned 904 root mem REG 8,1 145984 24905 /usr/lib64/libgpg-error.so.0.24.2 2023-08-01T20:01:35.001 INFO:teuthology.orchestra.run.smithi101.stdout:tuned 904 root mem REG 8,1 172104 24654 /usr/lib64/libselinux.so.1 2023-08-01T20:01:35.001 INFO:teuthology.orchestra.run.smithi101.stdout:tuned 904 root mem REG 8,1 33480 19526 /usr/lib64/libuuid.so.1.3.0 2023-08-01T20:01:35.001 INFO:teuthology.orchestra.run.smithi101.stdout:tuned 904 root mem REG 8,1 343680 19531 /usr/lib64/libblkid.so.1.1.0 2023-08-01T20:01:35.001 INFO:teuthology.orchestra.run.smithi101.stdout:tuned 904 root mem REG 8,1 99672 31445 /usr/lib64/libgcc_s-8-20210514.so.1 2023-08-01T20:01:35.001 INFO:teuthology.orchestra.run.smithi101.stdout:tuned 904 root mem REG 8,1 1187312 25078 /usr/lib64/libgcrypt.so.20.2.5 2023-08-01T20:01:35.001 INFO:teuthology.orchestra.run.smithi101.stdout:tuned 904 root mem REG 8,1 371480 19864 /usr/lib64/libmount.so.1.1.0 2023-08-01T20:01:35.002 INFO:teuthology.orchestra.run.smithi101.stdout:tuned 904 root mem REG 8,1 33752 24776 /usr/lib64/libcap.so.2.48 2023-08-01T20:01:35.002 INFO:teuthology.orchestra.run.smithi101.stdout:tuned 904 root mem REG 8,1 119760 25264 /usr/lib64/liblz4.so.1.8.3 2023-08-01T20:01:35.002 INFO:teuthology.orchestra.run.smithi101.stdout:tuned 904 root mem REG 8,1 42744 24710 /usr/lib64/librt-2.28.so 2023-08-01T20:01:35.002 INFO:teuthology.orchestra.run.smithi101.stdout:tuned 904 root mem REG 8,1 1387784 26786 /usr/lib64/libsystemd.so.0.23.0 2023-08-01T20:01:35.002 INFO:teuthology.orchestra.run.smithi101.stdout:tuned 904 root mem REG 8,1 351592 26670 /usr/lib64/libdbus-1.so.3.19.7 2023-08-01T20:01:35.002 INFO:teuthology.orchestra.run.smithi101.stdout:tuned 904 root mem REG 8,1 180952 55752 /usr/lib64/python3.6/site-packages/_dbus_bindings.so 2023-08-01T20:01:35.002 INFO:teuthology.orchestra.run.smithi101.stdout:tuned 904 root mem REG 8,1 20688 55975 /usr/lib64/python3.6/lib-dynload/_posixsubprocess.cpython-36m-x86_64-linux-gnu.so 2023-08-01T20:01:35.002 INFO:teuthology.orchestra.run.smithi101.stdout:tuned 904 root mem REG 8,1 13200 55984 /usr/lib64/python3.6/lib-dynload/grp.cpython-36m-x86_64-linux-gnu.so 2023-08-01T20:01:35.003 INFO:teuthology.orchestra.run.smithi101.stdout:tuned 904 root mem REG 8,1 162192 24774 /usr/lib64/liblzma.so.5.2.4 2023-08-01T20:01:35.003 INFO:teuthology.orchestra.run.smithi101.stdout:tuned 904 root mem REG 8,1 42848 53978 /usr/lib64/python3.6/lib-dynload/_lzma.cpython-36m-x86_64-linux-gnu.so 2023-08-01T20:01:35.003 INFO:teuthology.orchestra.run.smithi101.stdout:tuned 904 root mem REG 8,1 75328 24873 /usr/lib64/libbz2.so.1.0.6 2023-08-01T20:01:35.003 INFO:teuthology.orchestra.run.smithi101.stdout:tuned 904 root mem REG 8,1 23032 55965 /usr/lib64/python3.6/lib-dynload/_bz2.cpython-36m-x86_64-linux-gnu.so 2023-08-01T20:01:35.003 INFO:teuthology.orchestra.run.smithi101.stdout:tuned 904 root mem REG 8,1 34400 54011 /usr/lib64/python3.6/lib-dynload/zlib.cpython-36m-x86_64-linux-gnu.so 2023-08-01T20:01:35.003 INFO:teuthology.orchestra.run.smithi101.stdout:tuned 904 root mem REG 8,1 20528 55976 /usr/lib64/python3.6/lib-dynload/_random.cpython-36m-x86_64-linux-gnu.so 2023-08-01T20:01:35.003 INFO:teuthology.orchestra.run.smithi101.stdout:tuned 904 root mem REG 8,1 13688 53954 /usr/lib64/python3.6/lib-dynload/_bisect.cpython-36m-x86_64-linux-gnu.so 2023-08-01T20:01:35.004 INFO:teuthology.orchestra.run.smithi101.stdout:tuned 904 root mem REG 8,1 110632 55977 /usr/lib64/python3.6/lib-dynload/_sha3.cpython-36m-x86_64-linux-gnu.so 2023-08-01T20:01:35.004 INFO:teuthology.orchestra.run.smithi101.stdout:tuned 904 root mem REG 8,1 129520 55964 /usr/lib64/python3.6/lib-dynload/_blake2.cpython-36m-x86_64-linux-gnu.so 2023-08-01T20:01:35.004 INFO:teuthology.orchestra.run.smithi101.stdout:tuned 904 root mem REG 8,1 615744 26862 /usr/lib64/libssl.so.1.1.1k 2023-08-01T20:01:35.004 INFO:teuthology.orchestra.run.smithi101.stdout:tuned 904 root mem REG 8,1 47928 53973 /usr/lib64/python3.6/lib-dynload/_hashlib.cpython-36m-x86_64-linux-gnu.so 2023-08-01T20:01:35.004 INFO:teuthology.orchestra.run.smithi101.stdout:tuned 904 root mem REG 8,1 11592 53981 /usr/lib64/python3.6/lib-dynload/_opcode.cpython-36m-x86_64-linux-gnu.so 2023-08-01T20:01:35.004 INFO:teuthology.orchestra.run.smithi101.stdout:tuned 904 root mem REG 8,1 131584 55974 /usr/lib64/python3.6/lib-dynload/_pickle.cpython-36m-x86_64-linux-gnu.so 2023-08-01T20:01:35.004 INFO:teuthology.orchestra.run.smithi101.stdout:tuned 904 root mem REG 8,1 29256 54005 /usr/lib64/python3.6/lib-dynload/select.cpython-36m-x86_64-linux-gnu.so 2023-08-01T20:01:35.004 INFO:teuthology.orchestra.run.smithi101.stdout:tuned 904 root mem REG 8,1 59368 55985 /usr/lib64/python3.6/lib-dynload/math.cpython-36m-x86_64-linux-gnu.so 2023-08-01T20:01:35.005 INFO:teuthology.orchestra.run.smithi101.stdout:tuned 904 root mem REG 8,1 92984 55978 /usr/lib64/python3.6/lib-dynload/_socket.cpython-36m-x86_64-linux-gnu.so 2023-08-01T20:01:35.005 INFO:teuthology.orchestra.run.smithi101.stdout:tuned 904 root mem REG 8,1 56768 55981 /usr/lib64/python3.6/lib-dynload/_struct.cpython-36m-x86_64-linux-gnu.so 2023-08-01T20:01:35.005 INFO:teuthology.orchestra.run.smithi101.stdout:tuned 904 root mem REG 8,1 27136 55970 /usr/lib64/python3.6/lib-dynload/_heapq.cpython-36m-x86_64-linux-gnu.so 2023-08-01T20:01:35.005 INFO:teuthology.orchestra.run.smithi101.stdout:tuned 904 root mem REG 8,1 54352 24707 /usr/lib64/libnss_files-2.28.so 2023-08-01T20:01:35.005 INFO:teuthology.orchestra.run.smithi101.stdout:tuned 904 root mem REG 8,1 2586930 39433 /usr/lib/locale/en_US.utf8/LC_COLLATE 2023-08-01T20:01:35.005 INFO:teuthology.orchestra.run.smithi101.stdout:tuned 904 root mem REG 8,1 99640 24762 /usr/lib64/libz.so.1.2.11 2023-08-01T20:01:35.005 INFO:teuthology.orchestra.run.smithi101.stdout:tuned 904 root mem REG 8,1 2089984 24698 /usr/lib64/libc-2.28.so 2023-08-01T20:01:35.005 INFO:teuthology.orchestra.run.smithi101.stdout:tuned 904 root mem REG 8,1 1598840 24700 /usr/lib64/libm-2.28.so 2023-08-01T20:01:35.006 INFO:teuthology.orchestra.run.smithi101.stdout:tuned 904 root mem REG 8,1 17016 24713 /usr/lib64/libutil-2.28.so 2023-08-01T20:01:35.006 INFO:teuthology.orchestra.run.smithi101.stdout:tuned 904 root mem REG 8,1 19128 24699 /usr/lib64/libdl-2.28.so 2023-08-01T20:01:35.006 INFO:teuthology.orchestra.run.smithi101.stdout:tuned 904 root mem REG 8,1 149984 24708 /usr/lib64/libpthread-2.28.so 2023-08-01T20:01:35.006 INFO:teuthology.orchestra.run.smithi101.stdout:tuned 904 root mem REG 8,1 3286032 31711 /usr/lib64/libpython3.6m.so.1.0 2023-08-01T20:01:35.006 INFO:teuthology.orchestra.run.smithi101.stdout:tuned 904 root mem REG 8,1 3083608 26861 /usr/lib64/libcrypto.so.1.1.1k 2023-08-01T20:01:35.006 INFO:teuthology.orchestra.run.smithi101.stdout:tuned 904 root mem REG 8,1 1062168 24653 /usr/lib64/ld-2.28.so 2023-08-01T20:01:35.006 INFO:teuthology.orchestra.run.smithi101.stdout:tuned 904 root mem REG 8,1 337024 45489 /usr/lib/locale/C.utf8/LC_CTYPE 2023-08-01T20:01:35.006 INFO:teuthology.orchestra.run.smithi101.stdout:tuned 904 root mem REG 8,1 54 44174 /usr/lib/locale/en_US.utf8/LC_NUMERIC 2023-08-01T20:01:35.007 INFO:teuthology.orchestra.run.smithi101.stdout:tuned 904 root mem REG 8,1 3316 48200 /usr/lib/locale/en_US.utf8/LC_TIME 2023-08-01T20:01:35.007 INFO:teuthology.orchestra.run.smithi101.stdout:tuned 904 root mem REG 8,1 286 48207 /usr/lib/locale/en_US.utf8/LC_MONETARY 2023-08-01T20:01:35.007 INFO:teuthology.orchestra.run.smithi101.stdout:tuned 904 root mem REG 8,1 26998 35419 /usr/lib64/gconv/gconv-modules.cache 2023-08-01T20:01:35.007 INFO:teuthology.orchestra.run.smithi101.stdout:tuned 904 root mem REG 8,1 57 39434 /usr/lib/locale/en_US.utf8/LC_MESSAGES/SYS_LC_MESSAGES 2023-08-01T20:01:35.007 INFO:teuthology.orchestra.run.smithi101.stdout:tuned 904 root mem REG 8,1 34 39448 /usr/lib/locale/en_US.utf8/LC_PAPER 2023-08-01T20:01:35.007 INFO:teuthology.orchestra.run.smithi101.stdout:tuned 904 root mem REG 8,1 77 44173 /usr/lib/locale/en_US.utf8/LC_NAME 2023-08-01T20:01:35.007 INFO:teuthology.orchestra.run.smithi101.stdout:tuned 904 root mem REG 8,1 167 45462 /usr/lib/locale/en_US.utf8/LC_ADDRESS 2023-08-01T20:01:35.007 INFO:teuthology.orchestra.run.smithi101.stdout:tuned 904 root mem REG 8,1 59 48208 /usr/lib/locale/en_US.utf8/LC_TELEPHONE 2023-08-01T20:01:35.008 INFO:teuthology.orchestra.run.smithi101.stdout:tuned 904 root mem REG 8,1 23 48206 /usr/lib/locale/en_US.utf8/LC_MEASUREMENT 2023-08-01T20:01:35.008 INFO:teuthology.orchestra.run.smithi101.stdout:tuned 904 root mem REG 8,1 368 48205 /usr/lib/locale/en_US.utf8/LC_IDENTIFICATION 2023-08-01T20:01:35.008 INFO:teuthology.orchestra.run.smithi101.stdout:tuned 904 root 0r CHR 1,3 0t0 3083 /dev/null 2023-08-01T20:01:35.008 INFO:teuthology.orchestra.run.smithi101.stdout:tuned 904 root 1u unix 0xffff93750c980000 0t0 29954 type=STREAM 2023-08-01T20:01:35.008 INFO:teuthology.orchestra.run.smithi101.stdout:tuned 904 root 2u unix 0xffff93750c980000 0t0 29954 type=STREAM 2023-08-01T20:01:35.008 INFO:teuthology.orchestra.run.smithi101.stdout:tuned 904 root 3w REG 8,1 35197 18929 /var/log/tuned/tuned.log 2023-08-01T20:01:35.008 INFO:teuthology.orchestra.run.smithi101.stdout:tuned 904 root 4u netlink 0t0 22279 KOBJECT_UEVENT 2023-08-01T20:01:35.009 INFO:teuthology.orchestra.run.smithi101.stdout:tuned 904 root 5u unix 0xffff93750c927500 0t0 22727 type=STREAM 2023-08-01T20:01:35.009 INFO:teuthology.orchestra.run.smithi101.stdout:tuned 904 root 6u a_inode 0,14 0 15587 [eventfd] 2023-08-01T20:01:35.009 INFO:teuthology.orchestra.run.smithi101.stdout:tuned 904 root 7w CHR 10,62 0t0 5180 /dev/cpu_dma_latency 2023-08-01T20:01:35.009 INFO:teuthology.orchestra.run.smithi101.stdout:tuned 904 root 8u a_inode 0,14 0 15587 [perf_event] 2023-08-01T20:01:35.009 INFO:teuthology.orchestra.run.smithi101.stdout:tuned 904 root 9u a_inode 0,14 0 15587 [perf_event] 2023-08-01T20:01:35.009 INFO:teuthology.orchestra.run.smithi101.stdout:tuned 904 root 10u a_inode 0,14 0 15587 [perf_event] 2023-08-01T20:01:35.009 INFO:teuthology.orchestra.run.smithi101.stdout:tuned 904 root 11u a_inode 0,14 0 15587 [perf_event] 2023-08-01T20:01:35.009 INFO:teuthology.orchestra.run.smithi101.stdout:tuned 904 root 12u a_inode 0,14 0 15587 [perf_event] 2023-08-01T20:01:35.010 INFO:teuthology.orchestra.run.smithi101.stdout:tuned 904 root 13u a_inode 0,14 0 15587 [perf_event] 2023-08-01T20:01:35.010 INFO:teuthology.orchestra.run.smithi101.stdout:tuned 904 root 14u a_inode 0,14 0 15587 [perf_event] 2023-08-01T20:01:35.010 INFO:teuthology.orchestra.run.smithi101.stdout:tuned 904 root 15u a_inode 0,14 0 15587 [perf_event] 2023-08-01T20:01:35.010 INFO:teuthology.orchestra.run.smithi101.stdout:tuned 904 root 16r FIFO 0,13 0t0 22732 pipe 2023-08-01T20:01:35.010 INFO:teuthology.orchestra.run.smithi101.stdout:tuned 904 root 17w FIFO 0,13 0t0 22732 pipe 2023-08-01T20:01:35.010 INFO:teuthology.orchestra.run.smithi101.stdout:tuned 904 root 18u unix 0xffff93750c995a00 0t0 32972 type=STREAM 2023-08-01T20:01:35.010 INFO:teuthology.orchestra.run.smithi101.stdout:tuned 904 root 19u unix 0xffff93750c996c00 0t0 32973 type=STREAM 2023-08-01T20:01:35.010 INFO:teuthology.orchestra.run.smithi101.stdout:tuned 904 1192 tuned root cwd DIR 8,1 4096 2 / 2023-08-01T20:01:35.011 INFO:teuthology.orchestra.run.smithi101.stdout:tuned 904 1192 tuned root rtd DIR 8,1 4096 2 / 2023-08-01T20:01:35.011 INFO:teuthology.orchestra.run.smithi101.stdout:tuned 904 1192 tuned root txt REG 8,1 11856 35518 /usr/libexec/platform-python3.6 2023-08-01T20:01:35.011 INFO:teuthology.orchestra.run.smithi101.stdout:tuned 904 1192 tuned root mem REG 0,14 15587 anon_inode:[perf_event] (stat: No such file or directory) 2023-08-01T20:01:35.011 INFO:teuthology.orchestra.run.smithi101.stdout:tuned 904 1192 tuned root mem REG 8,1 51192 25552 /usr/lib64/libnuma.so.1.0.0 2023-08-01T20:01:35.011 INFO:teuthology.orchestra.run.smithi101.stdout:tuned 904 1192 tuned root mem REG 8,1 380560 55859 /usr/lib64/python3.6/site-packages/perf.cpython-36m-x86_64-linux-gnu.so 2023-08-01T20:01:35.011 INFO:teuthology.orchestra.run.smithi101.stdout:tuned 904 1192 tuned root mem REG 8,1 658136 26787 /usr/lib64/libudev.so.1.6.11 2023-08-01T20:01:35.011 INFO:teuthology.orchestra.run.smithi101.stdout:tuned 904 1192 tuned root mem REG 8,1 80120 53976 /usr/lib64/python3.6/lib-dynload/_json.cpython-36m-x86_64-linux-gnu.so 2023-08-01T20:01:35.011 INFO:teuthology.orchestra.run.smithi101.stdout:tuned 904 1192 tuned root mem REG 8,1 19464 53995 /usr/lib64/python3.6/lib-dynload/fcntl.cpython-36m-x86_64-linux-gnu.so 2023-08-01T20:01:35.012 INFO:teuthology.orchestra.run.smithi101.stdout:tuned 904 1192 tuned root mem REG 8,1 115184 53968 /usr/lib64/python3.6/lib-dynload/_datetime.cpython-36m-x86_64-linux-gnu.so 2023-08-01T20:01:35.012 INFO:teuthology.orchestra.run.smithi101.stdout:tuned 904 1192 tuned root mem REG 8,1 133480 53965 /usr/lib64/python3.6/lib-dynload/_ctypes.cpython-36m-x86_64-linux-gnu.so 2023-08-01T20:01:35.012 INFO:teuthology.orchestra.run.smithi101.stdout:tuned 904 1192 tuned root mem REG 8,1 185900 58195 /usr/lib64/girepository-1.0/GLib-2.0.typelib 2023-08-01T20:01:35.012 INFO:teuthology.orchestra.run.smithi101.stdout:tuned 904 1192 tuned root mem REG 8,1 243216 27722 /usr/lib64/libgirepository-1.0.so.1.0.0 2023-08-01T20:01:35.012 INFO:teuthology.orchestra.run.smithi101.stdout:tuned 904 1192 tuned root mem REG 8,1 340928 55601 /usr/lib64/python3.6/site-packages/gi/_gi.cpython-36m-x86_64-linux-gnu.so 2023-08-01T20:01:35.012 INFO:teuthology.orchestra.run.smithi101.stdout:tuned 904 1192 tuned root mem REG 8,1 1541856 25080 /usr/lib64/libgmp.so.10.3.2 2023-08-01T20:01:35.012 INFO:teuthology.orchestra.run.smithi101.stdout:tuned 904 1192 tuned root mem REG 8,1 197728 25272 /usr/lib64/libhogweed.so.4.5 2023-08-01T20:01:35.012 INFO:teuthology.orchestra.run.smithi101.stdout:tuned 904 1192 tuned root mem REG 8,1 239360 25274 /usr/lib64/libnettle.so.6.5 2023-08-01T20:01:35.013 INFO:teuthology.orchestra.run.smithi101.stdout:tuned 904 1192 tuned root mem REG 8,1 78816 25301 /usr/lib64/libtasn1.so.6.5.5 2023-08-01T20:01:35.013 INFO:teuthology.orchestra.run.smithi101.stdout:tuned 904 1192 tuned root mem REG 8,1 1805368 25103 /usr/lib64/libunistring.so.2.1.0 2023-08-01T20:01:35.013 INFO:teuthology.orchestra.run.smithi101.stdout:tuned 904 1192 tuned root mem REG 8,1 165624 25105 /usr/lib64/libidn2.so.0.3.6 2023-08-01T20:01:35.013 INFO:teuthology.orchestra.run.smithi101.stdout:tuned 904 1192 tuned root mem REG 8,1 1246520 25167 /usr/lib64/libp11-kit.so.0.3.0 2023-08-01T20:01:35.013 INFO:teuthology.orchestra.run.smithi101.stdout:tuned 904 1192 tuned root mem REG 8,1 92968 24709 /usr/lib64/libresolv-2.28.so 2023-08-01T20:01:35.013 INFO:teuthology.orchestra.run.smithi101.stdout:tuned 904 1192 tuned root mem REG 8,1 16064 27417 /usr/lib64/libgmodule-2.0.so.0.5600.4 2023-08-01T20:01:35.013 INFO:teuthology.orchestra.run.smithi101.stdout:tuned 904 1192 tuned root mem REG 8,1 37240 25164 /usr/lib64/libffi.so.6.0.2 2023-08-01T20:01:35.013 INFO:teuthology.orchestra.run.smithi101.stdout:tuned 904 1192 tuned root mem REG 8,1 464936 25554 /usr/lib64/libpcre.so.1.2.10 2023-08-01T20:01:35.014 INFO:teuthology.orchestra.run.smithi101.stdout:tuned 904 1192 tuned root mem REG 8,1 2051688 27472 /usr/lib64/libgnutls.so.30.28.2 2023-08-01T20:01:35.014 INFO:teuthology.orchestra.run.smithi101.stdout:tuned 904 1192 tuned root mem REG 8,1 1770248 27415 /usr/lib64/libgio-2.0.so.0.5600.4 2023-08-01T20:01:35.014 INFO:teuthology.orchestra.run.smithi101.stdout:tuned 904 1192 tuned root mem REG 8,1 1172024 27416 /usr/lib64/libglib-2.0.so.0.5600.4 2023-08-01T20:01:35.014 INFO:teuthology.orchestra.run.smithi101.stdout:tuned 904 1192 tuned root mem REG 8,1 347416 27418 /usr/lib64/libgobject-2.0.so.0.5600.4 2023-08-01T20:01:35.014 INFO:teuthology.orchestra.run.smithi101.stdout:tuned 904 1192 tuned root mem REG 8,1 199776 28793 /usr/lib64/libdbus-glib-1.so.2.3.4 2023-08-01T20:01:35.014 INFO:teuthology.orchestra.run.smithi101.stdout:tuned 904 1192 tuned root mem REG 8,1 12800 55753 /usr/lib64/python3.6/site-packages/_dbus_glib_bindings.so 2023-08-01T20:01:35.014 INFO:teuthology.orchestra.run.smithi101.stdout:tuned 904 1192 tuned root mem REG 8,1 248216 24968 /usr/lib64/libexpat.so.1.6.7 2023-08-01T20:01:35.015 INFO:teuthology.orchestra.run.smithi101.stdout:tuned 904 1192 tuned root mem REG 8,1 66896 54002 /usr/lib64/python3.6/lib-dynload/pyexpat.cpython-36m-x86_64-linux-gnu.so 2023-08-01T20:01:35.015 INFO:teuthology.orchestra.run.smithi101.stdout:tuned 904 1192 tuned root mem REG 8,1 543304 24651 /usr/lib64/libpcre2-8.so.0.7.1 2023-08-01T20:01:35.015 INFO:teuthology.orchestra.run.smithi101.stdout:tuned 904 1192 tuned root mem REG 8,1 145984 24905 /usr/lib64/libgpg-error.so.0.24.2 2023-08-01T20:01:35.015 INFO:teuthology.orchestra.run.smithi101.stdout:tuned 904 1192 tuned root mem REG 8,1 172104 24654 /usr/lib64/libselinux.so.1 2023-08-01T20:01:35.015 INFO:teuthology.orchestra.run.smithi101.stdout:tuned 904 1192 tuned root mem REG 8,1 33480 19526 /usr/lib64/libuuid.so.1.3.0 2023-08-01T20:01:35.015 INFO:teuthology.orchestra.run.smithi101.stdout:tuned 904 1192 tuned root mem REG 8,1 343680 19531 /usr/lib64/libblkid.so.1.1.0 2023-08-01T20:01:35.015 INFO:teuthology.orchestra.run.smithi101.stdout:tuned 904 1192 tuned root mem REG 8,1 99672 31445 /usr/lib64/libgcc_s-8-20210514.so.1 2023-08-01T20:01:35.015 INFO:teuthology.orchestra.run.smithi101.stdout:tuned 904 1192 tuned root mem REG 8,1 1187312 25078 /usr/lib64/libgcrypt.so.20.2.5 2023-08-01T20:01:35.016 INFO:teuthology.orchestra.run.smithi101.stdout:tuned 904 1192 tuned root mem REG 8,1 371480 19864 /usr/lib64/libmount.so.1.1.0 2023-08-01T20:01:35.016 INFO:teuthology.orchestra.run.smithi101.stdout:tuned 904 1192 tuned root mem REG 8,1 33752 24776 /usr/lib64/libcap.so.2.48 2023-08-01T20:01:35.016 INFO:teuthology.orchestra.run.smithi101.stdout:tuned 904 1192 tuned root mem REG 8,1 119760 25264 /usr/lib64/liblz4.so.1.8.3 2023-08-01T20:01:35.016 INFO:teuthology.orchestra.run.smithi101.stdout:tuned 904 1192 tuned root mem REG 8,1 42744 24710 /usr/lib64/librt-2.28.so 2023-08-01T20:01:35.016 INFO:teuthology.orchestra.run.smithi101.stdout:tuned 904 1192 tuned root mem REG 8,1 1387784 26786 /usr/lib64/libsystemd.so.0.23.0 2023-08-01T20:01:35.016 INFO:teuthology.orchestra.run.smithi101.stdout:tuned 904 1192 tuned root mem REG 8,1 351592 26670 /usr/lib64/libdbus-1.so.3.19.7 2023-08-01T20:01:35.016 INFO:teuthology.orchestra.run.smithi101.stdout:tuned 904 1192 tuned root mem REG 8,1 180952 55752 /usr/lib64/python3.6/site-packages/_dbus_bindings.so 2023-08-01T20:01:35.016 INFO:teuthology.orchestra.run.smithi101.stdout:tuned 904 1192 tuned root mem REG 8,1 20688 55975 /usr/lib64/python3.6/lib-dynload/_posixsubprocess.cpython-36m-x86_64-linux-gnu.so 2023-08-01T20:01:35.017 INFO:teuthology.orchestra.run.smithi101.stdout:tuned 904 1192 tuned root mem REG 8,1 13200 55984 /usr/lib64/python3.6/lib-dynload/grp.cpython-36m-x86_64-linux-gnu.so 2023-08-01T20:01:35.017 INFO:teuthology.orchestra.run.smithi101.stdout:tuned 904 1192 tuned root mem REG 8,1 162192 24774 /usr/lib64/liblzma.so.5.2.4 2023-08-01T20:01:35.017 INFO:teuthology.orchestra.run.smithi101.stdout:tuned 904 1192 tuned root mem REG 8,1 42848 53978 /usr/lib64/python3.6/lib-dynload/_lzma.cpython-36m-x86_64-linux-gnu.so 2023-08-01T20:01:35.017 INFO:teuthology.orchestra.run.smithi101.stdout:tuned 904 1192 tuned root mem REG 8,1 75328 24873 /usr/lib64/libbz2.so.1.0.6 2023-08-01T20:01:35.017 INFO:teuthology.orchestra.run.smithi101.stdout:tuned 904 1192 tuned root mem REG 8,1 23032 55965 /usr/lib64/python3.6/lib-dynload/_bz2.cpython-36m-x86_64-linux-gnu.so 2023-08-01T20:01:35.017 INFO:teuthology.orchestra.run.smithi101.stdout:tuned 904 1192 tuned root mem REG 8,1 34400 54011 /usr/lib64/python3.6/lib-dynload/zlib.cpython-36m-x86_64-linux-gnu.so 2023-08-01T20:01:35.017 INFO:teuthology.orchestra.run.smithi101.stdout:tuned 904 1192 tuned root mem REG 8,1 20528 55976 /usr/lib64/python3.6/lib-dynload/_random.cpython-36m-x86_64-linux-gnu.so 2023-08-01T20:01:35.017 INFO:teuthology.orchestra.run.smithi101.stdout:tuned 904 1192 tuned root mem REG 8,1 13688 53954 /usr/lib64/python3.6/lib-dynload/_bisect.cpython-36m-x86_64-linux-gnu.so 2023-08-01T20:01:35.018 INFO:teuthology.orchestra.run.smithi101.stdout:tuned 904 1192 tuned root mem REG 8,1 110632 55977 /usr/lib64/python3.6/lib-dynload/_sha3.cpython-36m-x86_64-linux-gnu.so 2023-08-01T20:01:35.018 INFO:teuthology.orchestra.run.smithi101.stdout:tuned 904 1192 tuned root mem REG 8,1 129520 55964 /usr/lib64/python3.6/lib-dynload/_blake2.cpython-36m-x86_64-linux-gnu.so 2023-08-01T20:01:35.018 INFO:teuthology.orchestra.run.smithi101.stdout:tuned 904 1192 tuned root mem REG 8,1 615744 26862 /usr/lib64/libssl.so.1.1.1k 2023-08-01T20:01:35.018 INFO:teuthology.orchestra.run.smithi101.stdout:tuned 904 1192 tuned root mem REG 8,1 47928 53973 /usr/lib64/python3.6/lib-dynload/_hashlib.cpython-36m-x86_64-linux-gnu.so 2023-08-01T20:01:35.018 INFO:teuthology.orchestra.run.smithi101.stdout:tuned 904 1192 tuned root mem REG 8,1 11592 53981 /usr/lib64/python3.6/lib-dynload/_opcode.cpython-36m-x86_64-linux-gnu.so 2023-08-01T20:01:35.018 INFO:teuthology.orchestra.run.smithi101.stdout:tuned 904 1192 tuned root mem REG 8,1 131584 55974 /usr/lib64/python3.6/lib-dynload/_pickle.cpython-36m-x86_64-linux-gnu.so 2023-08-01T20:01:35.018 INFO:teuthology.orchestra.run.smithi101.stdout:tuned 904 1192 tuned root mem REG 8,1 29256 54005 /usr/lib64/python3.6/lib-dynload/select.cpython-36m-x86_64-linux-gnu.so 2023-08-01T20:01:35.018 INFO:teuthology.orchestra.run.smithi101.stdout:tuned 904 1192 tuned root mem REG 8,1 59368 55985 /usr/lib64/python3.6/lib-dynload/math.cpython-36m-x86_64-linux-gnu.so 2023-08-01T20:01:35.019 INFO:teuthology.orchestra.run.smithi101.stdout:tuned 904 1192 tuned root mem REG 8,1 92984 55978 /usr/lib64/python3.6/lib-dynload/_socket.cpython-36m-x86_64-linux-gnu.so 2023-08-01T20:01:35.019 INFO:teuthology.orchestra.run.smithi101.stdout:tuned 904 1192 tuned root mem REG 8,1 56768 55981 /usr/lib64/python3.6/lib-dynload/_struct.cpython-36m-x86_64-linux-gnu.so 2023-08-01T20:01:35.019 INFO:teuthology.orchestra.run.smithi101.stdout:tuned 904 1192 tuned root mem REG 8,1 27136 55970 /usr/lib64/python3.6/lib-dynload/_heapq.cpython-36m-x86_64-linux-gnu.so 2023-08-01T20:01:35.019 INFO:teuthology.orchestra.run.smithi101.stdout:tuned 904 1192 tuned root mem REG 8,1 54352 24707 /usr/lib64/libnss_files-2.28.so 2023-08-01T20:01:35.019 INFO:teuthology.orchestra.run.smithi101.stdout:tuned 904 1192 tuned root mem REG 8,1 2586930 39433 /usr/lib/locale/en_US.utf8/LC_COLLATE 2023-08-01T20:01:35.019 INFO:teuthology.orchestra.run.smithi101.stdout:tuned 904 1192 tuned root mem REG 8,1 99640 24762 /usr/lib64/libz.so.1.2.11 2023-08-01T20:01:35.019 INFO:teuthology.orchestra.run.smithi101.stdout:tuned 904 1192 tuned root mem REG 8,1 2089984 24698 /usr/lib64/libc-2.28.so 2023-08-01T20:01:35.019 INFO:teuthology.orchestra.run.smithi101.stdout:tuned 904 1192 tuned root mem REG 8,1 1598840 24700 /usr/lib64/libm-2.28.so 2023-08-01T20:01:35.020 INFO:teuthology.orchestra.run.smithi101.stdout:tuned 904 1192 tuned root mem REG 8,1 17016 24713 /usr/lib64/libutil-2.28.so 2023-08-01T20:01:35.020 INFO:teuthology.orchestra.run.smithi101.stdout:tuned 904 1192 tuned root mem REG 8,1 19128 24699 /usr/lib64/libdl-2.28.so 2023-08-01T20:01:35.020 INFO:teuthology.orchestra.run.smithi101.stdout:tuned 904 1192 tuned root mem REG 8,1 149984 24708 /usr/lib64/libpthread-2.28.so 2023-08-01T20:01:35.020 INFO:teuthology.orchestra.run.smithi101.stdout:tuned 904 1192 tuned root mem REG 8,1 3286032 31711 /usr/lib64/libpython3.6m.so.1.0 2023-08-01T20:01:35.020 INFO:teuthology.orchestra.run.smithi101.stdout:tuned 904 1192 tuned root mem REG 8,1 3083608 26861 /usr/lib64/libcrypto.so.1.1.1k 2023-08-01T20:01:35.020 INFO:teuthology.orchestra.run.smithi101.stdout:tuned 904 1192 tuned root mem REG 8,1 1062168 24653 /usr/lib64/ld-2.28.so 2023-08-01T20:01:35.020 INFO:teuthology.orchestra.run.smithi101.stdout:tuned 904 1192 tuned root mem REG 8,1 337024 45489 /usr/lib/locale/C.utf8/LC_CTYPE 2023-08-01T20:01:35.021 INFO:teuthology.orchestra.run.smithi101.stdout:tuned 904 1192 tuned root mem REG 8,1 54 44174 /usr/lib/locale/en_US.utf8/LC_NUMERIC 2023-08-01T20:01:35.021 INFO:teuthology.orchestra.run.smithi101.stdout:tuned 904 1192 tuned root mem REG 8,1 3316 48200 /usr/lib/locale/en_US.utf8/LC_TIME 2023-08-01T20:01:35.021 INFO:teuthology.orchestra.run.smithi101.stdout:tuned 904 1192 tuned root mem REG 8,1 286 48207 /usr/lib/locale/en_US.utf8/LC_MONETARY 2023-08-01T20:01:35.021 INFO:teuthology.orchestra.run.smithi101.stdout:tuned 904 1192 tuned root mem REG 8,1 26998 35419 /usr/lib64/gconv/gconv-modules.cache 2023-08-01T20:01:35.021 INFO:teuthology.orchestra.run.smithi101.stdout:tuned 904 1192 tuned root mem REG 8,1 57 39434 /usr/lib/locale/en_US.utf8/LC_MESSAGES/SYS_LC_MESSAGES 2023-08-01T20:01:35.021 INFO:teuthology.orchestra.run.smithi101.stdout:tuned 904 1192 tuned root mem REG 8,1 34 39448 /usr/lib/locale/en_US.utf8/LC_PAPER 2023-08-01T20:01:35.021 INFO:teuthology.orchestra.run.smithi101.stdout:tuned 904 1192 tuned root mem REG 8,1 77 44173 /usr/lib/locale/en_US.utf8/LC_NAME 2023-08-01T20:01:35.021 INFO:teuthology.orchestra.run.smithi101.stdout:tuned 904 1192 tuned root mem REG 8,1 167 45462 /usr/lib/locale/en_US.utf8/LC_ADDRESS 2023-08-01T20:01:35.022 INFO:teuthology.orchestra.run.smithi101.stdout:tuned 904 1192 tuned root mem REG 8,1 59 48208 /usr/lib/locale/en_US.utf8/LC_TELEPHONE 2023-08-01T20:01:35.022 INFO:teuthology.orchestra.run.smithi101.stdout:tuned 904 1192 tuned root mem REG 8,1 23 48206 /usr/lib/locale/en_US.utf8/LC_MEASUREMENT 2023-08-01T20:01:35.022 INFO:teuthology.orchestra.run.smithi101.stdout:tuned 904 1192 tuned root mem REG 8,1 368 48205 /usr/lib/locale/en_US.utf8/LC_IDENTIFICATION 2023-08-01T20:01:35.022 INFO:teuthology.orchestra.run.smithi101.stdout:tuned 904 1192 tuned root 0r CHR 1,3 0t0 3083 /dev/null 2023-08-01T20:01:35.022 INFO:teuthology.orchestra.run.smithi101.stdout:tuned 904 1192 tuned root 1u unix 0xffff93750c980000 0t0 29954 type=STREAM 2023-08-01T20:01:35.022 INFO:teuthology.orchestra.run.smithi101.stdout:tuned 904 1192 tuned root 2u unix 0xffff93750c980000 0t0 29954 type=STREAM 2023-08-01T20:01:35.022 INFO:teuthology.orchestra.run.smithi101.stdout:tuned 904 1192 tuned root 3w REG 8,1 35197 18929 /var/log/tuned/tuned.log 2023-08-01T20:01:35.022 INFO:teuthology.orchestra.run.smithi101.stdout:tuned 904 1192 tuned root 4u netlink 0t0 22279 KOBJECT_UEVENT 2023-08-01T20:01:35.023 INFO:teuthology.orchestra.run.smithi101.stdout:tuned 904 1192 tuned root 5u unix 0xffff93750c927500 0t0 22727 type=STREAM 2023-08-01T20:01:35.023 INFO:teuthology.orchestra.run.smithi101.stdout:tuned 904 1192 tuned root 6u a_inode 0,14 0 15587 [eventfd] 2023-08-01T20:01:35.023 INFO:teuthology.orchestra.run.smithi101.stdout:tuned 904 1192 tuned root 7w CHR 10,62 0t0 5180 /dev/cpu_dma_latency 2023-08-01T20:01:35.023 INFO:teuthology.orchestra.run.smithi101.stdout:tuned 904 1192 tuned root 8u a_inode 0,14 0 15587 [perf_event] 2023-08-01T20:01:35.023 INFO:teuthology.orchestra.run.smithi101.stdout:tuned 904 1192 tuned root 9u a_inode 0,14 0 15587 [perf_event] 2023-08-01T20:01:35.023 INFO:teuthology.orchestra.run.smithi101.stdout:tuned 904 1192 tuned root 10u a_inode 0,14 0 15587 [perf_event] 2023-08-01T20:01:35.023 INFO:teuthology.orchestra.run.smithi101.stdout:tuned 904 1192 tuned root 11u a_inode 0,14 0 15587 [perf_event] 2023-08-01T20:01:35.023 INFO:teuthology.orchestra.run.smithi101.stdout:tuned 904 1192 tuned root 12u a_inode 0,14 0 15587 [perf_event] 2023-08-01T20:01:35.024 INFO:teuthology.orchestra.run.smithi101.stdout:tuned 904 1192 tuned root 13u a_inode 0,14 0 15587 [perf_event] 2023-08-01T20:01:35.024 INFO:teuthology.orchestra.run.smithi101.stdout:tuned 904 1192 tuned root 14u a_inode 0,14 0 15587 [perf_event] 2023-08-01T20:01:35.024 INFO:teuthology.orchestra.run.smithi101.stdout:tuned 904 1192 tuned root 15u a_inode 0,14 0 15587 [perf_event] 2023-08-01T20:01:35.024 INFO:teuthology.orchestra.run.smithi101.stdout:tuned 904 1192 tuned root 16r FIFO 0,13 0t0 22732 pipe 2023-08-01T20:01:35.024 INFO:teuthology.orchestra.run.smithi101.stdout:tuned 904 1192 tuned root 17w FIFO 0,13 0t0 22732 pipe 2023-08-01T20:01:35.024 INFO:teuthology.orchestra.run.smithi101.stdout:tuned 904 1192 tuned root 18u unix 0xffff93750c995a00 0t0 32972 type=STREAM 2023-08-01T20:01:35.024 INFO:teuthology.orchestra.run.smithi101.stdout:tuned 904 1192 tuned root 19u unix 0xffff93750c996c00 0t0 32973 type=STREAM 2023-08-01T20:01:35.024 INFO:teuthology.orchestra.run.smithi101.stdout:tuned 904 1197 tuned root cwd DIR 8,1 4096 2 / 2023-08-01T20:01:35.025 INFO:teuthology.orchestra.run.smithi101.stdout:tuned 904 1197 tuned root rtd DIR 8,1 4096 2 / 2023-08-01T20:01:35.025 INFO:teuthology.orchestra.run.smithi101.stdout:tuned 904 1197 tuned root txt REG 8,1 11856 35518 /usr/libexec/platform-python3.6 2023-08-01T20:01:35.025 INFO:teuthology.orchestra.run.smithi101.stdout:tuned 904 1197 tuned root mem REG 0,14 15587 anon_inode:[perf_event] (stat: No such file or directory) 2023-08-01T20:01:35.025 INFO:teuthology.orchestra.run.smithi101.stdout:tuned 904 1197 tuned root mem REG 8,1 51192 25552 /usr/lib64/libnuma.so.1.0.0 2023-08-01T20:01:35.025 INFO:teuthology.orchestra.run.smithi101.stdout:tuned 904 1197 tuned root mem REG 8,1 380560 55859 /usr/lib64/python3.6/site-packages/perf.cpython-36m-x86_64-linux-gnu.so 2023-08-01T20:01:35.025 INFO:teuthology.orchestra.run.smithi101.stdout:tuned 904 1197 tuned root mem REG 8,1 658136 26787 /usr/lib64/libudev.so.1.6.11 2023-08-01T20:01:35.025 INFO:teuthology.orchestra.run.smithi101.stdout:tuned 904 1197 tuned root mem REG 8,1 80120 53976 /usr/lib64/python3.6/lib-dynload/_json.cpython-36m-x86_64-linux-gnu.so 2023-08-01T20:01:35.025 INFO:teuthology.orchestra.run.smithi101.stdout:tuned 904 1197 tuned root mem REG 8,1 19464 53995 /usr/lib64/python3.6/lib-dynload/fcntl.cpython-36m-x86_64-linux-gnu.so 2023-08-01T20:01:35.026 INFO:teuthology.orchestra.run.smithi101.stdout:tuned 904 1197 tuned root mem REG 8,1 115184 53968 /usr/lib64/python3.6/lib-dynload/_datetime.cpython-36m-x86_64-linux-gnu.so 2023-08-01T20:01:35.026 INFO:teuthology.orchestra.run.smithi101.stdout:tuned 904 1197 tuned root mem REG 8,1 133480 53965 /usr/lib64/python3.6/lib-dynload/_ctypes.cpython-36m-x86_64-linux-gnu.so 2023-08-01T20:01:35.026 INFO:teuthology.orchestra.run.smithi101.stdout:tuned 904 1197 tuned root mem REG 8,1 185900 58195 /usr/lib64/girepository-1.0/GLib-2.0.typelib 2023-08-01T20:01:35.026 INFO:teuthology.orchestra.run.smithi101.stdout:tuned 904 1197 tuned root mem REG 8,1 243216 27722 /usr/lib64/libgirepository-1.0.so.1.0.0 2023-08-01T20:01:35.026 INFO:teuthology.orchestra.run.smithi101.stdout:tuned 904 1197 tuned root mem REG 8,1 340928 55601 /usr/lib64/python3.6/site-packages/gi/_gi.cpython-36m-x86_64-linux-gnu.so 2023-08-01T20:01:35.026 INFO:teuthology.orchestra.run.smithi101.stdout:tuned 904 1197 tuned root mem REG 8,1 1541856 25080 /usr/lib64/libgmp.so.10.3.2 2023-08-01T20:01:35.026 INFO:teuthology.orchestra.run.smithi101.stdout:tuned 904 1197 tuned root mem REG 8,1 197728 25272 /usr/lib64/libhogweed.so.4.5 2023-08-01T20:01:35.027 INFO:teuthology.orchestra.run.smithi101.stdout:tuned 904 1197 tuned root mem REG 8,1 239360 25274 /usr/lib64/libnettle.so.6.5 2023-08-01T20:01:35.027 INFO:teuthology.orchestra.run.smithi101.stdout:tuned 904 1197 tuned root mem REG 8,1 78816 25301 /usr/lib64/libtasn1.so.6.5.5 2023-08-01T20:01:35.027 INFO:teuthology.orchestra.run.smithi101.stdout:tuned 904 1197 tuned root mem REG 8,1 1805368 25103 /usr/lib64/libunistring.so.2.1.0 2023-08-01T20:01:35.027 INFO:teuthology.orchestra.run.smithi101.stdout:tuned 904 1197 tuned root mem REG 8,1 165624 25105 /usr/lib64/libidn2.so.0.3.6 2023-08-01T20:01:35.027 INFO:teuthology.orchestra.run.smithi101.stdout:tuned 904 1197 tuned root mem REG 8,1 1246520 25167 /usr/lib64/libp11-kit.so.0.3.0 2023-08-01T20:01:35.027 INFO:teuthology.orchestra.run.smithi101.stdout:tuned 904 1197 tuned root mem REG 8,1 92968 24709 /usr/lib64/libresolv-2.28.so 2023-08-01T20:01:35.027 INFO:teuthology.orchestra.run.smithi101.stdout:tuned 904 1197 tuned root mem REG 8,1 16064 27417 /usr/lib64/libgmodule-2.0.so.0.5600.4 2023-08-01T20:01:35.027 INFO:teuthology.orchestra.run.smithi101.stdout:tuned 904 1197 tuned root mem REG 8,1 37240 25164 /usr/lib64/libffi.so.6.0.2 2023-08-01T20:01:35.028 INFO:teuthology.orchestra.run.smithi101.stdout:tuned 904 1197 tuned root mem REG 8,1 464936 25554 /usr/lib64/libpcre.so.1.2.10 2023-08-01T20:01:35.028 INFO:teuthology.orchestra.run.smithi101.stdout:tuned 904 1197 tuned root mem REG 8,1 2051688 27472 /usr/lib64/libgnutls.so.30.28.2 2023-08-01T20:01:35.028 INFO:teuthology.orchestra.run.smithi101.stdout:tuned 904 1197 tuned root mem REG 8,1 1770248 27415 /usr/lib64/libgio-2.0.so.0.5600.4 2023-08-01T20:01:35.028 INFO:teuthology.orchestra.run.smithi101.stdout:tuned 904 1197 tuned root mem REG 8,1 1172024 27416 /usr/lib64/libglib-2.0.so.0.5600.4 2023-08-01T20:01:35.028 INFO:teuthology.orchestra.run.smithi101.stdout:tuned 904 1197 tuned root mem REG 8,1 347416 27418 /usr/lib64/libgobject-2.0.so.0.5600.4 2023-08-01T20:01:35.028 INFO:teuthology.orchestra.run.smithi101.stdout:tuned 904 1197 tuned root mem REG 8,1 199776 28793 /usr/lib64/libdbus-glib-1.so.2.3.4 2023-08-01T20:01:35.028 INFO:teuthology.orchestra.run.smithi101.stdout:tuned 904 1197 tuned root mem REG 8,1 12800 55753 /usr/lib64/python3.6/site-packages/_dbus_glib_bindings.so 2023-08-01T20:01:35.028 INFO:teuthology.orchestra.run.smithi101.stdout:tuned 904 1197 tuned root mem REG 8,1 248216 24968 /usr/lib64/libexpat.so.1.6.7 2023-08-01T20:01:35.029 INFO:teuthology.orchestra.run.smithi101.stdout:tuned 904 1197 tuned root mem REG 8,1 66896 54002 /usr/lib64/python3.6/lib-dynload/pyexpat.cpython-36m-x86_64-linux-gnu.so 2023-08-01T20:01:35.029 INFO:teuthology.orchestra.run.smithi101.stdout:tuned 904 1197 tuned root mem REG 8,1 543304 24651 /usr/lib64/libpcre2-8.so.0.7.1 2023-08-01T20:01:35.029 INFO:teuthology.orchestra.run.smithi101.stdout:tuned 904 1197 tuned root mem REG 8,1 145984 24905 /usr/lib64/libgpg-error.so.0.24.2 2023-08-01T20:01:35.029 INFO:teuthology.orchestra.run.smithi101.stdout:tuned 904 1197 tuned root mem REG 8,1 172104 24654 /usr/lib64/libselinux.so.1 2023-08-01T20:01:35.029 INFO:teuthology.orchestra.run.smithi101.stdout:tuned 904 1197 tuned root mem REG 8,1 33480 19526 /usr/lib64/libuuid.so.1.3.0 2023-08-01T20:01:35.029 INFO:teuthology.orchestra.run.smithi101.stdout:tuned 904 1197 tuned root mem REG 8,1 343680 19531 /usr/lib64/libblkid.so.1.1.0 2023-08-01T20:01:35.029 INFO:teuthology.orchestra.run.smithi101.stdout:tuned 904 1197 tuned root mem REG 8,1 99672 31445 /usr/lib64/libgcc_s-8-20210514.so.1 2023-08-01T20:01:35.029 INFO:teuthology.orchestra.run.smithi101.stdout:tuned 904 1197 tuned root mem REG 8,1 1187312 25078 /usr/lib64/libgcrypt.so.20.2.5 2023-08-01T20:01:35.030 INFO:teuthology.orchestra.run.smithi101.stdout:tuned 904 1197 tuned root mem REG 8,1 371480 19864 /usr/lib64/libmount.so.1.1.0 2023-08-01T20:01:35.030 INFO:teuthology.orchestra.run.smithi101.stdout:tuned 904 1197 tuned root mem REG 8,1 33752 24776 /usr/lib64/libcap.so.2.48 2023-08-01T20:01:35.030 INFO:teuthology.orchestra.run.smithi101.stdout:tuned 904 1197 tuned root mem REG 8,1 119760 25264 /usr/lib64/liblz4.so.1.8.3 2023-08-01T20:01:35.030 INFO:teuthology.orchestra.run.smithi101.stdout:tuned 904 1197 tuned root mem REG 8,1 42744 24710 /usr/lib64/librt-2.28.so 2023-08-01T20:01:35.030 INFO:teuthology.orchestra.run.smithi101.stdout:tuned 904 1197 tuned root mem REG 8,1 1387784 26786 /usr/lib64/libsystemd.so.0.23.0 2023-08-01T20:01:35.030 INFO:teuthology.orchestra.run.smithi101.stdout:tuned 904 1197 tuned root mem REG 8,1 351592 26670 /usr/lib64/libdbus-1.so.3.19.7 2023-08-01T20:01:35.030 INFO:teuthology.orchestra.run.smithi101.stdout:tuned 904 1197 tuned root mem REG 8,1 180952 55752 /usr/lib64/python3.6/site-packages/_dbus_bindings.so 2023-08-01T20:01:35.030 INFO:teuthology.orchestra.run.smithi101.stdout:tuned 904 1197 tuned root mem REG 8,1 20688 55975 /usr/lib64/python3.6/lib-dynload/_posixsubprocess.cpython-36m-x86_64-linux-gnu.so 2023-08-01T20:01:35.031 INFO:teuthology.orchestra.run.smithi101.stdout:tuned 904 1197 tuned root mem REG 8,1 13200 55984 /usr/lib64/python3.6/lib-dynload/grp.cpython-36m-x86_64-linux-gnu.so 2023-08-01T20:01:35.031 INFO:teuthology.orchestra.run.smithi101.stdout:tuned 904 1197 tuned root mem REG 8,1 162192 24774 /usr/lib64/liblzma.so.5.2.4 2023-08-01T20:01:35.031 INFO:teuthology.orchestra.run.smithi101.stdout:tuned 904 1197 tuned root mem REG 8,1 42848 53978 /usr/lib64/python3.6/lib-dynload/_lzma.cpython-36m-x86_64-linux-gnu.so 2023-08-01T20:01:35.031 INFO:teuthology.orchestra.run.smithi101.stdout:tuned 904 1197 tuned root mem REG 8,1 75328 24873 /usr/lib64/libbz2.so.1.0.6 2023-08-01T20:01:35.031 INFO:teuthology.orchestra.run.smithi101.stdout:tuned 904 1197 tuned root mem REG 8,1 23032 55965 /usr/lib64/python3.6/lib-dynload/_bz2.cpython-36m-x86_64-linux-gnu.so 2023-08-01T20:01:35.031 INFO:teuthology.orchestra.run.smithi101.stdout:tuned 904 1197 tuned root mem REG 8,1 34400 54011 /usr/lib64/python3.6/lib-dynload/zlib.cpython-36m-x86_64-linux-gnu.so 2023-08-01T20:01:35.031 INFO:teuthology.orchestra.run.smithi101.stdout:tuned 904 1197 tuned root mem REG 8,1 20528 55976 /usr/lib64/python3.6/lib-dynload/_random.cpython-36m-x86_64-linux-gnu.so 2023-08-01T20:01:35.032 INFO:teuthology.orchestra.run.smithi101.stdout:tuned 904 1197 tuned root mem REG 8,1 13688 53954 /usr/lib64/python3.6/lib-dynload/_bisect.cpython-36m-x86_64-linux-gnu.so 2023-08-01T20:01:35.032 INFO:teuthology.orchestra.run.smithi101.stdout:tuned 904 1197 tuned root mem REG 8,1 110632 55977 /usr/lib64/python3.6/lib-dynload/_sha3.cpython-36m-x86_64-linux-gnu.so 2023-08-01T20:01:35.032 INFO:teuthology.orchestra.run.smithi101.stdout:tuned 904 1197 tuned root mem REG 8,1 129520 55964 /usr/lib64/python3.6/lib-dynload/_blake2.cpython-36m-x86_64-linux-gnu.so 2023-08-01T20:01:35.032 INFO:teuthology.orchestra.run.smithi101.stdout:tuned 904 1197 tuned root mem REG 8,1 615744 26862 /usr/lib64/libssl.so.1.1.1k 2023-08-01T20:01:35.032 INFO:teuthology.orchestra.run.smithi101.stdout:tuned 904 1197 tuned root mem REG 8,1 47928 53973 /usr/lib64/python3.6/lib-dynload/_hashlib.cpython-36m-x86_64-linux-gnu.so 2023-08-01T20:01:35.032 INFO:teuthology.orchestra.run.smithi101.stdout:tuned 904 1197 tuned root mem REG 8,1 11592 53981 /usr/lib64/python3.6/lib-dynload/_opcode.cpython-36m-x86_64-linux-gnu.so 2023-08-01T20:01:35.032 INFO:teuthology.orchestra.run.smithi101.stdout:tuned 904 1197 tuned root mem REG 8,1 131584 55974 /usr/lib64/python3.6/lib-dynload/_pickle.cpython-36m-x86_64-linux-gnu.so 2023-08-01T20:01:35.032 INFO:teuthology.orchestra.run.smithi101.stdout:tuned 904 1197 tuned root mem REG 8,1 29256 54005 /usr/lib64/python3.6/lib-dynload/select.cpython-36m-x86_64-linux-gnu.so 2023-08-01T20:01:35.033 INFO:teuthology.orchestra.run.smithi101.stdout:tuned 904 1197 tuned root mem REG 8,1 59368 55985 /usr/lib64/python3.6/lib-dynload/math.cpython-36m-x86_64-linux-gnu.so 2023-08-01T20:01:35.033 INFO:teuthology.orchestra.run.smithi101.stdout:tuned 904 1197 tuned root mem REG 8,1 92984 55978 /usr/lib64/python3.6/lib-dynload/_socket.cpython-36m-x86_64-linux-gnu.so 2023-08-01T20:01:35.033 INFO:teuthology.orchestra.run.smithi101.stdout:tuned 904 1197 tuned root mem REG 8,1 56768 55981 /usr/lib64/python3.6/lib-dynload/_struct.cpython-36m-x86_64-linux-gnu.so 2023-08-01T20:01:35.033 INFO:teuthology.orchestra.run.smithi101.stdout:tuned 904 1197 tuned root mem REG 8,1 27136 55970 /usr/lib64/python3.6/lib-dynload/_heapq.cpython-36m-x86_64-linux-gnu.so 2023-08-01T20:01:35.033 INFO:teuthology.orchestra.run.smithi101.stdout:tuned 904 1197 tuned root mem REG 8,1 54352 24707 /usr/lib64/libnss_files-2.28.so 2023-08-01T20:01:35.033 INFO:teuthology.orchestra.run.smithi101.stdout:tuned 904 1197 tuned root mem REG 8,1 2586930 39433 /usr/lib/locale/en_US.utf8/LC_COLLATE 2023-08-01T20:01:35.033 INFO:teuthology.orchestra.run.smithi101.stdout:tuned 904 1197 tuned root mem REG 8,1 99640 24762 /usr/lib64/libz.so.1.2.11 2023-08-01T20:01:35.033 INFO:teuthology.orchestra.run.smithi101.stdout:tuned 904 1197 tuned root mem REG 8,1 2089984 24698 /usr/lib64/libc-2.28.so 2023-08-01T20:01:35.034 INFO:teuthology.orchestra.run.smithi101.stdout:tuned 904 1197 tuned root mem REG 8,1 1598840 24700 /usr/lib64/libm-2.28.so 2023-08-01T20:01:35.034 INFO:teuthology.orchestra.run.smithi101.stdout:tuned 904 1197 tuned root mem REG 8,1 17016 24713 /usr/lib64/libutil-2.28.so 2023-08-01T20:01:35.034 INFO:teuthology.orchestra.run.smithi101.stdout:tuned 904 1197 tuned root mem REG 8,1 19128 24699 /usr/lib64/libdl-2.28.so 2023-08-01T20:01:35.034 INFO:teuthology.orchestra.run.smithi101.stdout:tuned 904 1197 tuned root mem REG 8,1 149984 24708 /usr/lib64/libpthread-2.28.so 2023-08-01T20:01:35.034 INFO:teuthology.orchestra.run.smithi101.stdout:tuned 904 1197 tuned root mem REG 8,1 3286032 31711 /usr/lib64/libpython3.6m.so.1.0 2023-08-01T20:01:35.034 INFO:teuthology.orchestra.run.smithi101.stdout:tuned 904 1197 tuned root mem REG 8,1 3083608 26861 /usr/lib64/libcrypto.so.1.1.1k 2023-08-01T20:01:35.034 INFO:teuthology.orchestra.run.smithi101.stdout:tuned 904 1197 tuned root mem REG 8,1 1062168 24653 /usr/lib64/ld-2.28.so 2023-08-01T20:01:35.034 INFO:teuthology.orchestra.run.smithi101.stdout:tuned 904 1197 tuned root mem REG 8,1 337024 45489 /usr/lib/locale/C.utf8/LC_CTYPE 2023-08-01T20:01:35.035 INFO:teuthology.orchestra.run.smithi101.stdout:tuned 904 1197 tuned root mem REG 8,1 54 44174 /usr/lib/locale/en_US.utf8/LC_NUMERIC 2023-08-01T20:01:35.035 INFO:teuthology.orchestra.run.smithi101.stdout:tuned 904 1197 tuned root mem REG 8,1 3316 48200 /usr/lib/locale/en_US.utf8/LC_TIME 2023-08-01T20:01:35.035 INFO:teuthology.orchestra.run.smithi101.stdout:tuned 904 1197 tuned root mem REG 8,1 286 48207 /usr/lib/locale/en_US.utf8/LC_MONETARY 2023-08-01T20:01:35.035 INFO:teuthology.orchestra.run.smithi101.stdout:tuned 904 1197 tuned root mem REG 8,1 26998 35419 /usr/lib64/gconv/gconv-modules.cache 2023-08-01T20:01:35.035 INFO:teuthology.orchestra.run.smithi101.stdout:tuned 904 1197 tuned root mem REG 8,1 57 39434 /usr/lib/locale/en_US.utf8/LC_MESSAGES/SYS_LC_MESSAGES 2023-08-01T20:01:35.035 INFO:teuthology.orchestra.run.smithi101.stdout:tuned 904 1197 tuned root mem REG 8,1 34 39448 /usr/lib/locale/en_US.utf8/LC_PAPER 2023-08-01T20:01:35.035 INFO:teuthology.orchestra.run.smithi101.stdout:tuned 904 1197 tuned root mem REG 8,1 77 44173 /usr/lib/locale/en_US.utf8/LC_NAME 2023-08-01T20:01:35.035 INFO:teuthology.orchestra.run.smithi101.stdout:tuned 904 1197 tuned root mem REG 8,1 167 45462 /usr/lib/locale/en_US.utf8/LC_ADDRESS 2023-08-01T20:01:35.036 INFO:teuthology.orchestra.run.smithi101.stdout:tuned 904 1197 tuned root mem REG 8,1 59 48208 /usr/lib/locale/en_US.utf8/LC_TELEPHONE 2023-08-01T20:01:35.036 INFO:teuthology.orchestra.run.smithi101.stdout:tuned 904 1197 tuned root mem REG 8,1 23 48206 /usr/lib/locale/en_US.utf8/LC_MEASUREMENT 2023-08-01T20:01:35.036 INFO:teuthology.orchestra.run.smithi101.stdout:tuned 904 1197 tuned root mem REG 8,1 368 48205 /usr/lib/locale/en_US.utf8/LC_IDENTIFICATION 2023-08-01T20:01:35.036 INFO:teuthology.orchestra.run.smithi101.stdout:tuned 904 1197 tuned root 0r CHR 1,3 0t0 3083 /dev/null 2023-08-01T20:01:35.036 INFO:teuthology.orchestra.run.smithi101.stdout:tuned 904 1197 tuned root 1u unix 0xffff93750c980000 0t0 29954 type=STREAM 2023-08-01T20:01:35.036 INFO:teuthology.orchestra.run.smithi101.stdout:tuned 904 1197 tuned root 2u unix 0xffff93750c980000 0t0 29954 type=STREAM 2023-08-01T20:01:35.036 INFO:teuthology.orchestra.run.smithi101.stdout:tuned 904 1197 tuned root 3w REG 8,1 35197 18929 /var/log/tuned/tuned.log 2023-08-01T20:01:35.036 INFO:teuthology.orchestra.run.smithi101.stdout:tuned 904 1197 tuned root 4u netlink 0t0 22279 KOBJECT_UEVENT 2023-08-01T20:01:35.037 INFO:teuthology.orchestra.run.smithi101.stdout:tuned 904 1197 tuned root 5u unix 0xffff93750c927500 0t0 22727 type=STREAM 2023-08-01T20:01:35.037 INFO:teuthology.orchestra.run.smithi101.stdout:tuned 904 1197 tuned root 6u a_inode 0,14 0 15587 [eventfd] 2023-08-01T20:01:35.037 INFO:teuthology.orchestra.run.smithi101.stdout:tuned 904 1197 tuned root 7w CHR 10,62 0t0 5180 /dev/cpu_dma_latency 2023-08-01T20:01:35.037 INFO:teuthology.orchestra.run.smithi101.stdout:tuned 904 1197 tuned root 8u a_inode 0,14 0 15587 [perf_event] 2023-08-01T20:01:35.037 INFO:teuthology.orchestra.run.smithi101.stdout:tuned 904 1197 tuned root 9u a_inode 0,14 0 15587 [perf_event] 2023-08-01T20:01:35.037 INFO:teuthology.orchestra.run.smithi101.stdout:tuned 904 1197 tuned root 10u a_inode 0,14 0 15587 [perf_event] 2023-08-01T20:01:35.037 INFO:teuthology.orchestra.run.smithi101.stdout:tuned 904 1197 tuned root 11u a_inode 0,14 0 15587 [perf_event] 2023-08-01T20:01:35.038 INFO:teuthology.orchestra.run.smithi101.stdout:tuned 904 1197 tuned root 12u a_inode 0,14 0 15587 [perf_event] 2023-08-01T20:01:35.038 INFO:teuthology.orchestra.run.smithi101.stdout:tuned 904 1197 tuned root 13u a_inode 0,14 0 15587 [perf_event] 2023-08-01T20:01:35.038 INFO:teuthology.orchestra.run.smithi101.stdout:tuned 904 1197 tuned root 14u a_inode 0,14 0 15587 [perf_event] 2023-08-01T20:01:35.038 INFO:teuthology.orchestra.run.smithi101.stdout:tuned 904 1197 tuned root 15u a_inode 0,14 0 15587 [perf_event] 2023-08-01T20:01:35.038 INFO:teuthology.orchestra.run.smithi101.stdout:tuned 904 1197 tuned root 16r FIFO 0,13 0t0 22732 pipe 2023-08-01T20:01:35.038 INFO:teuthology.orchestra.run.smithi101.stdout:tuned 904 1197 tuned root 17w FIFO 0,13 0t0 22732 pipe 2023-08-01T20:01:35.038 INFO:teuthology.orchestra.run.smithi101.stdout:tuned 904 1197 tuned root 18u unix 0xffff93750c995a00 0t0 32972 type=STREAM 2023-08-01T20:01:35.038 INFO:teuthology.orchestra.run.smithi101.stdout:tuned 904 1197 tuned root 19u unix 0xffff93750c996c00 0t0 32973 type=STREAM 2023-08-01T20:01:35.039 INFO:teuthology.orchestra.run.smithi101.stdout:tuned 904 1214 tuned root cwd DIR 8,1 4096 2 / 2023-08-01T20:01:35.039 INFO:teuthology.orchestra.run.smithi101.stdout:tuned 904 1214 tuned root rtd DIR 8,1 4096 2 / 2023-08-01T20:01:35.039 INFO:teuthology.orchestra.run.smithi101.stdout:tuned 904 1214 tuned root txt REG 8,1 11856 35518 /usr/libexec/platform-python3.6 2023-08-01T20:01:35.039 INFO:teuthology.orchestra.run.smithi101.stdout:tuned 904 1214 tuned root mem REG 0,14 15587 anon_inode:[perf_event] (stat: No such file or directory) 2023-08-01T20:01:35.039 INFO:teuthology.orchestra.run.smithi101.stdout:tuned 904 1214 tuned root mem REG 8,1 51192 25552 /usr/lib64/libnuma.so.1.0.0 2023-08-01T20:01:35.039 INFO:teuthology.orchestra.run.smithi101.stdout:tuned 904 1214 tuned root mem REG 8,1 380560 55859 /usr/lib64/python3.6/site-packages/perf.cpython-36m-x86_64-linux-gnu.so 2023-08-01T20:01:35.039 INFO:teuthology.orchestra.run.smithi101.stdout:tuned 904 1214 tuned root mem REG 8,1 658136 26787 /usr/lib64/libudev.so.1.6.11 2023-08-01T20:01:35.039 INFO:teuthology.orchestra.run.smithi101.stdout:tuned 904 1214 tuned root mem REG 8,1 80120 53976 /usr/lib64/python3.6/lib-dynload/_json.cpython-36m-x86_64-linux-gnu.so 2023-08-01T20:01:35.040 INFO:teuthology.orchestra.run.smithi101.stdout:tuned 904 1214 tuned root mem REG 8,1 19464 53995 /usr/lib64/python3.6/lib-dynload/fcntl.cpython-36m-x86_64-linux-gnu.so 2023-08-01T20:01:35.040 INFO:teuthology.orchestra.run.smithi101.stdout:tuned 904 1214 tuned root mem REG 8,1 115184 53968 /usr/lib64/python3.6/lib-dynload/_datetime.cpython-36m-x86_64-linux-gnu.so 2023-08-01T20:01:35.040 INFO:teuthology.orchestra.run.smithi101.stdout:tuned 904 1214 tuned root mem REG 8,1 133480 53965 /usr/lib64/python3.6/lib-dynload/_ctypes.cpython-36m-x86_64-linux-gnu.so 2023-08-01T20:01:35.040 INFO:teuthology.orchestra.run.smithi101.stdout:tuned 904 1214 tuned root mem REG 8,1 185900 58195 /usr/lib64/girepository-1.0/GLib-2.0.typelib 2023-08-01T20:01:35.040 INFO:teuthology.orchestra.run.smithi101.stdout:tuned 904 1214 tuned root mem REG 8,1 243216 27722 /usr/lib64/libgirepository-1.0.so.1.0.0 2023-08-01T20:01:35.040 INFO:teuthology.orchestra.run.smithi101.stdout:tuned 904 1214 tuned root mem REG 8,1 340928 55601 /usr/lib64/python3.6/site-packages/gi/_gi.cpython-36m-x86_64-linux-gnu.so 2023-08-01T20:01:35.040 INFO:teuthology.orchestra.run.smithi101.stdout:tuned 904 1214 tuned root mem REG 8,1 1541856 25080 /usr/lib64/libgmp.so.10.3.2 2023-08-01T20:01:35.040 INFO:teuthology.orchestra.run.smithi101.stdout:tuned 904 1214 tuned root mem REG 8,1 197728 25272 /usr/lib64/libhogweed.so.4.5 2023-08-01T20:01:35.041 INFO:teuthology.orchestra.run.smithi101.stdout:tuned 904 1214 tuned root mem REG 8,1 239360 25274 /usr/lib64/libnettle.so.6.5 2023-08-01T20:01:35.041 INFO:teuthology.orchestra.run.smithi101.stdout:tuned 904 1214 tuned root mem REG 8,1 78816 25301 /usr/lib64/libtasn1.so.6.5.5 2023-08-01T20:01:35.041 INFO:teuthology.orchestra.run.smithi101.stdout:tuned 904 1214 tuned root mem REG 8,1 1805368 25103 /usr/lib64/libunistring.so.2.1.0 2023-08-01T20:01:35.041 INFO:teuthology.orchestra.run.smithi101.stdout:tuned 904 1214 tuned root mem REG 8,1 165624 25105 /usr/lib64/libidn2.so.0.3.6 2023-08-01T20:01:35.041 INFO:teuthology.orchestra.run.smithi101.stdout:tuned 904 1214 tuned root mem REG 8,1 1246520 25167 /usr/lib64/libp11-kit.so.0.3.0 2023-08-01T20:01:35.041 INFO:teuthology.orchestra.run.smithi101.stdout:tuned 904 1214 tuned root mem REG 8,1 92968 24709 /usr/lib64/libresolv-2.28.so 2023-08-01T20:01:35.041 INFO:teuthology.orchestra.run.smithi101.stdout:tuned 904 1214 tuned root mem REG 8,1 16064 27417 /usr/lib64/libgmodule-2.0.so.0.5600.4 2023-08-01T20:01:35.041 INFO:teuthology.orchestra.run.smithi101.stdout:tuned 904 1214 tuned root mem REG 8,1 37240 25164 /usr/lib64/libffi.so.6.0.2 2023-08-01T20:01:35.042 INFO:teuthology.orchestra.run.smithi101.stdout:tuned 904 1214 tuned root mem REG 8,1 464936 25554 /usr/lib64/libpcre.so.1.2.10 2023-08-01T20:01:35.042 INFO:teuthology.orchestra.run.smithi101.stdout:tuned 904 1214 tuned root mem REG 8,1 2051688 27472 /usr/lib64/libgnutls.so.30.28.2 2023-08-01T20:01:35.042 INFO:teuthology.orchestra.run.smithi101.stdout:tuned 904 1214 tuned root mem REG 8,1 1770248 27415 /usr/lib64/libgio-2.0.so.0.5600.4 2023-08-01T20:01:35.042 INFO:teuthology.orchestra.run.smithi101.stdout:tuned 904 1214 tuned root mem REG 8,1 1172024 27416 /usr/lib64/libglib-2.0.so.0.5600.4 2023-08-01T20:01:35.042 INFO:teuthology.orchestra.run.smithi101.stdout:tuned 904 1214 tuned root mem REG 8,1 347416 27418 /usr/lib64/libgobject-2.0.so.0.5600.4 2023-08-01T20:01:35.042 INFO:teuthology.orchestra.run.smithi101.stdout:tuned 904 1214 tuned root mem REG 8,1 199776 28793 /usr/lib64/libdbus-glib-1.so.2.3.4 2023-08-01T20:01:35.042 INFO:teuthology.orchestra.run.smithi101.stdout:tuned 904 1214 tuned root mem REG 8,1 12800 55753 /usr/lib64/python3.6/site-packages/_dbus_glib_bindings.so 2023-08-01T20:01:35.042 INFO:teuthology.orchestra.run.smithi101.stdout:tuned 904 1214 tuned root mem REG 8,1 248216 24968 /usr/lib64/libexpat.so.1.6.7 2023-08-01T20:01:35.043 INFO:teuthology.orchestra.run.smithi101.stdout:tuned 904 1214 tuned root mem REG 8,1 66896 54002 /usr/lib64/python3.6/lib-dynload/pyexpat.cpython-36m-x86_64-linux-gnu.so 2023-08-01T20:01:35.043 INFO:teuthology.orchestra.run.smithi101.stdout:tuned 904 1214 tuned root mem REG 8,1 543304 24651 /usr/lib64/libpcre2-8.so.0.7.1 2023-08-01T20:01:35.043 INFO:teuthology.orchestra.run.smithi101.stdout:tuned 904 1214 tuned root mem REG 8,1 145984 24905 /usr/lib64/libgpg-error.so.0.24.2 2023-08-01T20:01:35.043 INFO:teuthology.orchestra.run.smithi101.stdout:tuned 904 1214 tuned root mem REG 8,1 172104 24654 /usr/lib64/libselinux.so.1 2023-08-01T20:01:35.043 INFO:teuthology.orchestra.run.smithi101.stdout:tuned 904 1214 tuned root mem REG 8,1 33480 19526 /usr/lib64/libuuid.so.1.3.0 2023-08-01T20:01:35.043 INFO:teuthology.orchestra.run.smithi101.stdout:tuned 904 1214 tuned root mem REG 8,1 343680 19531 /usr/lib64/libblkid.so.1.1.0 2023-08-01T20:01:35.043 INFO:teuthology.orchestra.run.smithi101.stdout:tuned 904 1214 tuned root mem REG 8,1 99672 31445 /usr/lib64/libgcc_s-8-20210514.so.1 2023-08-01T20:01:35.043 INFO:teuthology.orchestra.run.smithi101.stdout:tuned 904 1214 tuned root mem REG 8,1 1187312 25078 /usr/lib64/libgcrypt.so.20.2.5 2023-08-01T20:01:35.044 INFO:teuthology.orchestra.run.smithi101.stdout:tuned 904 1214 tuned root mem REG 8,1 371480 19864 /usr/lib64/libmount.so.1.1.0 2023-08-01T20:01:35.044 INFO:teuthology.orchestra.run.smithi101.stdout:tuned 904 1214 tuned root mem REG 8,1 33752 24776 /usr/lib64/libcap.so.2.48 2023-08-01T20:01:35.044 INFO:teuthology.orchestra.run.smithi101.stdout:tuned 904 1214 tuned root mem REG 8,1 119760 25264 /usr/lib64/liblz4.so.1.8.3 2023-08-01T20:01:35.044 INFO:teuthology.orchestra.run.smithi101.stdout:tuned 904 1214 tuned root mem REG 8,1 42744 24710 /usr/lib64/librt-2.28.so 2023-08-01T20:01:35.044 INFO:teuthology.orchestra.run.smithi101.stdout:tuned 904 1214 tuned root mem REG 8,1 1387784 26786 /usr/lib64/libsystemd.so.0.23.0 2023-08-01T20:01:35.044 INFO:teuthology.orchestra.run.smithi101.stdout:tuned 904 1214 tuned root mem REG 8,1 351592 26670 /usr/lib64/libdbus-1.so.3.19.7 2023-08-01T20:01:35.044 INFO:teuthology.orchestra.run.smithi101.stdout:tuned 904 1214 tuned root mem REG 8,1 180952 55752 /usr/lib64/python3.6/site-packages/_dbus_bindings.so 2023-08-01T20:01:35.045 INFO:teuthology.orchestra.run.smithi101.stdout:tuned 904 1214 tuned root mem REG 8,1 20688 55975 /usr/lib64/python3.6/lib-dynload/_posixsubprocess.cpython-36m-x86_64-linux-gnu.so 2023-08-01T20:01:35.045 INFO:teuthology.orchestra.run.smithi101.stdout:tuned 904 1214 tuned root mem REG 8,1 13200 55984 /usr/lib64/python3.6/lib-dynload/grp.cpython-36m-x86_64-linux-gnu.so 2023-08-01T20:01:35.045 INFO:teuthology.orchestra.run.smithi101.stdout:tuned 904 1214 tuned root mem REG 8,1 162192 24774 /usr/lib64/liblzma.so.5.2.4 2023-08-01T20:01:35.045 INFO:teuthology.orchestra.run.smithi101.stdout:tuned 904 1214 tuned root mem REG 8,1 42848 53978 /usr/lib64/python3.6/lib-dynload/_lzma.cpython-36m-x86_64-linux-gnu.so 2023-08-01T20:01:35.045 INFO:teuthology.orchestra.run.smithi101.stdout:tuned 904 1214 tuned root mem REG 8,1 75328 24873 /usr/lib64/libbz2.so.1.0.6 2023-08-01T20:01:35.045 INFO:teuthology.orchestra.run.smithi101.stdout:tuned 904 1214 tuned root mem REG 8,1 23032 55965 /usr/lib64/python3.6/lib-dynload/_bz2.cpython-36m-x86_64-linux-gnu.so 2023-08-01T20:01:35.045 INFO:teuthology.orchestra.run.smithi101.stdout:tuned 904 1214 tuned root mem REG 8,1 34400 54011 /usr/lib64/python3.6/lib-dynload/zlib.cpython-36m-x86_64-linux-gnu.so 2023-08-01T20:01:35.045 INFO:teuthology.orchestra.run.smithi101.stdout:tuned 904 1214 tuned root mem REG 8,1 20528 55976 /usr/lib64/python3.6/lib-dynload/_random.cpython-36m-x86_64-linux-gnu.so 2023-08-01T20:01:35.046 INFO:teuthology.orchestra.run.smithi101.stdout:tuned 904 1214 tuned root mem REG 8,1 13688 53954 /usr/lib64/python3.6/lib-dynload/_bisect.cpython-36m-x86_64-linux-gnu.so 2023-08-01T20:01:35.046 INFO:teuthology.orchestra.run.smithi101.stdout:tuned 904 1214 tuned root mem REG 8,1 110632 55977 /usr/lib64/python3.6/lib-dynload/_sha3.cpython-36m-x86_64-linux-gnu.so 2023-08-01T20:01:35.046 INFO:teuthology.orchestra.run.smithi101.stdout:tuned 904 1214 tuned root mem REG 8,1 129520 55964 /usr/lib64/python3.6/lib-dynload/_blake2.cpython-36m-x86_64-linux-gnu.so 2023-08-01T20:01:35.046 INFO:teuthology.orchestra.run.smithi101.stdout:tuned 904 1214 tuned root mem REG 8,1 615744 26862 /usr/lib64/libssl.so.1.1.1k 2023-08-01T20:01:35.046 INFO:teuthology.orchestra.run.smithi101.stdout:tuned 904 1214 tuned root mem REG 8,1 47928 53973 /usr/lib64/python3.6/lib-dynload/_hashlib.cpython-36m-x86_64-linux-gnu.so 2023-08-01T20:01:35.046 INFO:teuthology.orchestra.run.smithi101.stdout:tuned 904 1214 tuned root mem REG 8,1 11592 53981 /usr/lib64/python3.6/lib-dynload/_opcode.cpython-36m-x86_64-linux-gnu.so 2023-08-01T20:01:35.046 INFO:teuthology.orchestra.run.smithi101.stdout:tuned 904 1214 tuned root mem REG 8,1 131584 55974 /usr/lib64/python3.6/lib-dynload/_pickle.cpython-36m-x86_64-linux-gnu.so 2023-08-01T20:01:35.046 INFO:teuthology.orchestra.run.smithi101.stdout:tuned 904 1214 tuned root mem REG 8,1 29256 54005 /usr/lib64/python3.6/lib-dynload/select.cpython-36m-x86_64-linux-gnu.so 2023-08-01T20:01:35.047 INFO:teuthology.orchestra.run.smithi101.stdout:tuned 904 1214 tuned root mem REG 8,1 59368 55985 /usr/lib64/python3.6/lib-dynload/math.cpython-36m-x86_64-linux-gnu.so 2023-08-01T20:01:35.047 INFO:teuthology.orchestra.run.smithi101.stdout:tuned 904 1214 tuned root mem REG 8,1 92984 55978 /usr/lib64/python3.6/lib-dynload/_socket.cpython-36m-x86_64-linux-gnu.so 2023-08-01T20:01:35.047 INFO:teuthology.orchestra.run.smithi101.stdout:tuned 904 1214 tuned root mem REG 8,1 56768 55981 /usr/lib64/python3.6/lib-dynload/_struct.cpython-36m-x86_64-linux-gnu.so 2023-08-01T20:01:35.047 INFO:teuthology.orchestra.run.smithi101.stdout:tuned 904 1214 tuned root mem REG 8,1 27136 55970 /usr/lib64/python3.6/lib-dynload/_heapq.cpython-36m-x86_64-linux-gnu.so 2023-08-01T20:01:35.047 INFO:teuthology.orchestra.run.smithi101.stdout:tuned 904 1214 tuned root mem REG 8,1 54352 24707 /usr/lib64/libnss_files-2.28.so 2023-08-01T20:01:35.047 INFO:teuthology.orchestra.run.smithi101.stdout:tuned 904 1214 tuned root mem REG 8,1 2586930 39433 /usr/lib/locale/en_US.utf8/LC_COLLATE 2023-08-01T20:01:35.047 INFO:teuthology.orchestra.run.smithi101.stdout:tuned 904 1214 tuned root mem REG 8,1 99640 24762 /usr/lib64/libz.so.1.2.11 2023-08-01T20:01:35.047 INFO:teuthology.orchestra.run.smithi101.stdout:tuned 904 1214 tuned root mem REG 8,1 2089984 24698 /usr/lib64/libc-2.28.so 2023-08-01T20:01:35.048 INFO:teuthology.orchestra.run.smithi101.stdout:tuned 904 1214 tuned root mem REG 8,1 1598840 24700 /usr/lib64/libm-2.28.so 2023-08-01T20:01:35.048 INFO:teuthology.orchestra.run.smithi101.stdout:tuned 904 1214 tuned root mem REG 8,1 17016 24713 /usr/lib64/libutil-2.28.so 2023-08-01T20:01:35.048 INFO:teuthology.orchestra.run.smithi101.stdout:tuned 904 1214 tuned root mem REG 8,1 19128 24699 /usr/lib64/libdl-2.28.so 2023-08-01T20:01:35.048 INFO:teuthology.orchestra.run.smithi101.stdout:tuned 904 1214 tuned root mem REG 8,1 149984 24708 /usr/lib64/libpthread-2.28.so 2023-08-01T20:01:35.048 INFO:teuthology.orchestra.run.smithi101.stdout:tuned 904 1214 tuned root mem REG 8,1 3286032 31711 /usr/lib64/libpython3.6m.so.1.0 2023-08-01T20:01:35.048 INFO:teuthology.orchestra.run.smithi101.stdout:tuned 904 1214 tuned root mem REG 8,1 3083608 26861 /usr/lib64/libcrypto.so.1.1.1k 2023-08-01T20:01:35.048 INFO:teuthology.orchestra.run.smithi101.stdout:tuned 904 1214 tuned root mem REG 8,1 1062168 24653 /usr/lib64/ld-2.28.so 2023-08-01T20:01:35.048 INFO:teuthology.orchestra.run.smithi101.stdout:tuned 904 1214 tuned root mem REG 8,1 337024 45489 /usr/lib/locale/C.utf8/LC_CTYPE 2023-08-01T20:01:35.049 INFO:teuthology.orchestra.run.smithi101.stdout:tuned 904 1214 tuned root mem REG 8,1 54 44174 /usr/lib/locale/en_US.utf8/LC_NUMERIC 2023-08-01T20:01:35.049 INFO:teuthology.orchestra.run.smithi101.stdout:tuned 904 1214 tuned root mem REG 8,1 3316 48200 /usr/lib/locale/en_US.utf8/LC_TIME 2023-08-01T20:01:35.049 INFO:teuthology.orchestra.run.smithi101.stdout:tuned 904 1214 tuned root mem REG 8,1 286 48207 /usr/lib/locale/en_US.utf8/LC_MONETARY 2023-08-01T20:01:35.049 INFO:teuthology.orchestra.run.smithi101.stdout:tuned 904 1214 tuned root mem REG 8,1 26998 35419 /usr/lib64/gconv/gconv-modules.cache 2023-08-01T20:01:35.049 INFO:teuthology.orchestra.run.smithi101.stdout:tuned 904 1214 tuned root mem REG 8,1 57 39434 /usr/lib/locale/en_US.utf8/LC_MESSAGES/SYS_LC_MESSAGES 2023-08-01T20:01:35.049 INFO:teuthology.orchestra.run.smithi101.stdout:tuned 904 1214 tuned root mem REG 8,1 34 39448 /usr/lib/locale/en_US.utf8/LC_PAPER 2023-08-01T20:01:35.049 INFO:teuthology.orchestra.run.smithi101.stdout:tuned 904 1214 tuned root mem REG 8,1 77 44173 /usr/lib/locale/en_US.utf8/LC_NAME 2023-08-01T20:01:35.049 INFO:teuthology.orchestra.run.smithi101.stdout:tuned 904 1214 tuned root mem REG 8,1 167 45462 /usr/lib/locale/en_US.utf8/LC_ADDRESS 2023-08-01T20:01:35.050 INFO:teuthology.orchestra.run.smithi101.stdout:tuned 904 1214 tuned root mem REG 8,1 59 48208 /usr/lib/locale/en_US.utf8/LC_TELEPHONE 2023-08-01T20:01:35.050 INFO:teuthology.orchestra.run.smithi101.stdout:tuned 904 1214 tuned root mem REG 8,1 23 48206 /usr/lib/locale/en_US.utf8/LC_MEASUREMENT 2023-08-01T20:01:35.050 INFO:teuthology.orchestra.run.smithi101.stdout:tuned 904 1214 tuned root mem REG 8,1 368 48205 /usr/lib/locale/en_US.utf8/LC_IDENTIFICATION 2023-08-01T20:01:35.050 INFO:teuthology.orchestra.run.smithi101.stdout:tuned 904 1214 tuned root 0r CHR 1,3 0t0 3083 /dev/null 2023-08-01T20:01:35.050 INFO:teuthology.orchestra.run.smithi101.stdout:tuned 904 1214 tuned root 1u unix 0xffff93750c980000 0t0 29954 type=STREAM 2023-08-01T20:01:35.050 INFO:teuthology.orchestra.run.smithi101.stdout:tuned 904 1214 tuned root 2u unix 0xffff93750c980000 0t0 29954 type=STREAM 2023-08-01T20:01:35.050 INFO:teuthology.orchestra.run.smithi101.stdout:tuned 904 1214 tuned root 3w REG 8,1 35197 18929 /var/log/tuned/tuned.log 2023-08-01T20:01:35.050 INFO:teuthology.orchestra.run.smithi101.stdout:tuned 904 1214 tuned root 4u netlink 0t0 22279 KOBJECT_UEVENT 2023-08-01T20:01:35.051 INFO:teuthology.orchestra.run.smithi101.stdout:tuned 904 1214 tuned root 5u unix 0xffff93750c927500 0t0 22727 type=STREAM 2023-08-01T20:01:35.051 INFO:teuthology.orchestra.run.smithi101.stdout:tuned 904 1214 tuned root 6u a_inode 0,14 0 15587 [eventfd] 2023-08-01T20:01:35.051 INFO:teuthology.orchestra.run.smithi101.stdout:tuned 904 1214 tuned root 7w CHR 10,62 0t0 5180 /dev/cpu_dma_latency 2023-08-01T20:01:35.051 INFO:teuthology.orchestra.run.smithi101.stdout:tuned 904 1214 tuned root 8u a_inode 0,14 0 15587 [perf_event] 2023-08-01T20:01:35.051 INFO:teuthology.orchestra.run.smithi101.stdout:tuned 904 1214 tuned root 9u a_inode 0,14 0 15587 [perf_event] 2023-08-01T20:01:35.051 INFO:teuthology.orchestra.run.smithi101.stdout:tuned 904 1214 tuned root 10u a_inode 0,14 0 15587 [perf_event] 2023-08-01T20:01:35.051 INFO:teuthology.orchestra.run.smithi101.stdout:tuned 904 1214 tuned root 11u a_inode 0,14 0 15587 [perf_event] 2023-08-01T20:01:35.051 INFO:teuthology.orchestra.run.smithi101.stdout:tuned 904 1214 tuned root 12u a_inode 0,14 0 15587 [perf_event] 2023-08-01T20:01:35.052 INFO:teuthology.orchestra.run.smithi101.stdout:tuned 904 1214 tuned root 13u a_inode 0,14 0 15587 [perf_event] 2023-08-01T20:01:35.052 INFO:teuthology.orchestra.run.smithi101.stdout:tuned 904 1214 tuned root 14u a_inode 0,14 0 15587 [perf_event] 2023-08-01T20:01:35.052 INFO:teuthology.orchestra.run.smithi101.stdout:tuned 904 1214 tuned root 15u a_inode 0,14 0 15587 [perf_event] 2023-08-01T20:01:35.052 INFO:teuthology.orchestra.run.smithi101.stdout:tuned 904 1214 tuned root 16r FIFO 0,13 0t0 22732 pipe 2023-08-01T20:01:35.052 INFO:teuthology.orchestra.run.smithi101.stdout:tuned 904 1214 tuned root 17w FIFO 0,13 0t0 22732 pipe 2023-08-01T20:01:35.052 INFO:teuthology.orchestra.run.smithi101.stdout:tuned 904 1214 tuned root 18u unix 0xffff93750c995a00 0t0 32972 type=STREAM 2023-08-01T20:01:35.052 INFO:teuthology.orchestra.run.smithi101.stdout:tuned 904 1214 tuned root 19u unix 0xffff93750c996c00 0t0 32973 type=STREAM 2023-08-01T20:01:35.053 INFO:teuthology.orchestra.run.smithi101.stdout:tuned 904 1215 tuned root cwd DIR 8,1 4096 2 / 2023-08-01T20:01:35.053 INFO:teuthology.orchestra.run.smithi101.stdout:tuned 904 1215 tuned root rtd DIR 8,1 4096 2 / 2023-08-01T20:01:35.053 INFO:teuthology.orchestra.run.smithi101.stdout:tuned 904 1215 tuned root txt REG 8,1 11856 35518 /usr/libexec/platform-python3.6 2023-08-01T20:01:35.053 INFO:teuthology.orchestra.run.smithi101.stdout:tuned 904 1215 tuned root mem REG 0,14 15587 anon_inode:[perf_event] (stat: No such file or directory) 2023-08-01T20:01:35.053 INFO:teuthology.orchestra.run.smithi101.stdout:tuned 904 1215 tuned root mem REG 8,1 51192 25552 /usr/lib64/libnuma.so.1.0.0 2023-08-01T20:01:35.053 INFO:teuthology.orchestra.run.smithi101.stdout:tuned 904 1215 tuned root mem REG 8,1 380560 55859 /usr/lib64/python3.6/site-packages/perf.cpython-36m-x86_64-linux-gnu.so 2023-08-01T20:01:35.053 INFO:teuthology.orchestra.run.smithi101.stdout:tuned 904 1215 tuned root mem REG 8,1 658136 26787 /usr/lib64/libudev.so.1.6.11 2023-08-01T20:01:35.053 INFO:teuthology.orchestra.run.smithi101.stdout:tuned 904 1215 tuned root mem REG 8,1 80120 53976 /usr/lib64/python3.6/lib-dynload/_json.cpython-36m-x86_64-linux-gnu.so 2023-08-01T20:01:35.054 INFO:teuthology.orchestra.run.smithi101.stdout:tuned 904 1215 tuned root mem REG 8,1 19464 53995 /usr/lib64/python3.6/lib-dynload/fcntl.cpython-36m-x86_64-linux-gnu.so 2023-08-01T20:01:35.054 INFO:teuthology.orchestra.run.smithi101.stdout:tuned 904 1215 tuned root mem REG 8,1 115184 53968 /usr/lib64/python3.6/lib-dynload/_datetime.cpython-36m-x86_64-linux-gnu.so 2023-08-01T20:01:35.054 INFO:teuthology.orchestra.run.smithi101.stdout:tuned 904 1215 tuned root mem REG 8,1 133480 53965 /usr/lib64/python3.6/lib-dynload/_ctypes.cpython-36m-x86_64-linux-gnu.so 2023-08-01T20:01:35.054 INFO:teuthology.orchestra.run.smithi101.stdout:tuned 904 1215 tuned root mem REG 8,1 185900 58195 /usr/lib64/girepository-1.0/GLib-2.0.typelib 2023-08-01T20:01:35.054 INFO:teuthology.orchestra.run.smithi101.stdout:tuned 904 1215 tuned root mem REG 8,1 243216 27722 /usr/lib64/libgirepository-1.0.so.1.0.0 2023-08-01T20:01:35.054 INFO:teuthology.orchestra.run.smithi101.stdout:tuned 904 1215 tuned root mem REG 8,1 340928 55601 /usr/lib64/python3.6/site-packages/gi/_gi.cpython-36m-x86_64-linux-gnu.so 2023-08-01T20:01:35.054 INFO:teuthology.orchestra.run.smithi101.stdout:tuned 904 1215 tuned root mem REG 8,1 1541856 25080 /usr/lib64/libgmp.so.10.3.2 2023-08-01T20:01:35.054 INFO:teuthology.orchestra.run.smithi101.stdout:tuned 904 1215 tuned root mem REG 8,1 197728 25272 /usr/lib64/libhogweed.so.4.5 2023-08-01T20:01:35.055 INFO:teuthology.orchestra.run.smithi101.stdout:tuned 904 1215 tuned root mem REG 8,1 239360 25274 /usr/lib64/libnettle.so.6.5 2023-08-01T20:01:35.055 INFO:teuthology.orchestra.run.smithi101.stdout:tuned 904 1215 tuned root mem REG 8,1 78816 25301 /usr/lib64/libtasn1.so.6.5.5 2023-08-01T20:01:35.055 INFO:teuthology.orchestra.run.smithi101.stdout:tuned 904 1215 tuned root mem REG 8,1 1805368 25103 /usr/lib64/libunistring.so.2.1.0 2023-08-01T20:01:35.055 INFO:teuthology.orchestra.run.smithi101.stdout:tuned 904 1215 tuned root mem REG 8,1 165624 25105 /usr/lib64/libidn2.so.0.3.6 2023-08-01T20:01:35.055 INFO:teuthology.orchestra.run.smithi101.stdout:tuned 904 1215 tuned root mem REG 8,1 1246520 25167 /usr/lib64/libp11-kit.so.0.3.0 2023-08-01T20:01:35.055 INFO:teuthology.orchestra.run.smithi101.stdout:tuned 904 1215 tuned root mem REG 8,1 92968 24709 /usr/lib64/libresolv-2.28.so 2023-08-01T20:01:35.055 INFO:teuthology.orchestra.run.smithi101.stdout:tuned 904 1215 tuned root mem REG 8,1 16064 27417 /usr/lib64/libgmodule-2.0.so.0.5600.4 2023-08-01T20:01:35.055 INFO:teuthology.orchestra.run.smithi101.stdout:tuned 904 1215 tuned root mem REG 8,1 37240 25164 /usr/lib64/libffi.so.6.0.2 2023-08-01T20:01:35.056 INFO:teuthology.orchestra.run.smithi101.stdout:tuned 904 1215 tuned root mem REG 8,1 464936 25554 /usr/lib64/libpcre.so.1.2.10 2023-08-01T20:01:35.056 INFO:teuthology.orchestra.run.smithi101.stdout:tuned 904 1215 tuned root mem REG 8,1 2051688 27472 /usr/lib64/libgnutls.so.30.28.2 2023-08-01T20:01:35.056 INFO:teuthology.orchestra.run.smithi101.stdout:tuned 904 1215 tuned root mem REG 8,1 1770248 27415 /usr/lib64/libgio-2.0.so.0.5600.4 2023-08-01T20:01:35.056 INFO:teuthology.orchestra.run.smithi101.stdout:tuned 904 1215 tuned root mem REG 8,1 1172024 27416 /usr/lib64/libglib-2.0.so.0.5600.4 2023-08-01T20:01:35.056 INFO:teuthology.orchestra.run.smithi101.stdout:tuned 904 1215 tuned root mem REG 8,1 347416 27418 /usr/lib64/libgobject-2.0.so.0.5600.4 2023-08-01T20:01:35.056 INFO:teuthology.orchestra.run.smithi101.stdout:tuned 904 1215 tuned root mem REG 8,1 199776 28793 /usr/lib64/libdbus-glib-1.so.2.3.4 2023-08-01T20:01:35.056 INFO:teuthology.orchestra.run.smithi101.stdout:tuned 904 1215 tuned root mem REG 8,1 12800 55753 /usr/lib64/python3.6/site-packages/_dbus_glib_bindings.so 2023-08-01T20:01:35.057 INFO:teuthology.orchestra.run.smithi101.stdout:tuned 904 1215 tuned root mem REG 8,1 248216 24968 /usr/lib64/libexpat.so.1.6.7 2023-08-01T20:01:35.057 INFO:teuthology.orchestra.run.smithi101.stdout:tuned 904 1215 tuned root mem REG 8,1 66896 54002 /usr/lib64/python3.6/lib-dynload/pyexpat.cpython-36m-x86_64-linux-gnu.so 2023-08-01T20:01:35.057 INFO:teuthology.orchestra.run.smithi101.stdout:tuned 904 1215 tuned root mem REG 8,1 543304 24651 /usr/lib64/libpcre2-8.so.0.7.1 2023-08-01T20:01:35.057 INFO:teuthology.orchestra.run.smithi101.stdout:tuned 904 1215 tuned root mem REG 8,1 145984 24905 /usr/lib64/libgpg-error.so.0.24.2 2023-08-01T20:01:35.057 INFO:teuthology.orchestra.run.smithi101.stdout:tuned 904 1215 tuned root mem REG 8,1 172104 24654 /usr/lib64/libselinux.so.1 2023-08-01T20:01:35.057 INFO:teuthology.orchestra.run.smithi101.stdout:tuned 904 1215 tuned root mem REG 8,1 33480 19526 /usr/lib64/libuuid.so.1.3.0 2023-08-01T20:01:35.057 INFO:teuthology.orchestra.run.smithi101.stdout:tuned 904 1215 tuned root mem REG 8,1 343680 19531 /usr/lib64/libblkid.so.1.1.0 2023-08-01T20:01:35.057 INFO:teuthology.orchestra.run.smithi101.stdout:tuned 904 1215 tuned root mem REG 8,1 99672 31445 /usr/lib64/libgcc_s-8-20210514.so.1 2023-08-01T20:01:35.058 INFO:teuthology.orchestra.run.smithi101.stdout:tuned 904 1215 tuned root mem REG 8,1 1187312 25078 /usr/lib64/libgcrypt.so.20.2.5 2023-08-01T20:01:35.058 INFO:teuthology.orchestra.run.smithi101.stdout:tuned 904 1215 tuned root mem REG 8,1 371480 19864 /usr/lib64/libmount.so.1.1.0 2023-08-01T20:01:35.058 INFO:teuthology.orchestra.run.smithi101.stdout:tuned 904 1215 tuned root mem REG 8,1 33752 24776 /usr/lib64/libcap.so.2.48 2023-08-01T20:01:35.058 INFO:teuthology.orchestra.run.smithi101.stdout:tuned 904 1215 tuned root mem REG 8,1 119760 25264 /usr/lib64/liblz4.so.1.8.3 2023-08-01T20:01:35.058 INFO:teuthology.orchestra.run.smithi101.stdout:tuned 904 1215 tuned root mem REG 8,1 42744 24710 /usr/lib64/librt-2.28.so 2023-08-01T20:01:35.058 INFO:teuthology.orchestra.run.smithi101.stdout:tuned 904 1215 tuned root mem REG 8,1 1387784 26786 /usr/lib64/libsystemd.so.0.23.0 2023-08-01T20:01:35.058 INFO:teuthology.orchestra.run.smithi101.stdout:tuned 904 1215 tuned root mem REG 8,1 351592 26670 /usr/lib64/libdbus-1.so.3.19.7 2023-08-01T20:01:35.058 INFO:teuthology.orchestra.run.smithi101.stdout:tuned 904 1215 tuned root mem REG 8,1 180952 55752 /usr/lib64/python3.6/site-packages/_dbus_bindings.so 2023-08-01T20:01:35.059 INFO:teuthology.orchestra.run.smithi101.stdout:tuned 904 1215 tuned root mem REG 8,1 20688 55975 /usr/lib64/python3.6/lib-dynload/_posixsubprocess.cpython-36m-x86_64-linux-gnu.so 2023-08-01T20:01:35.059 INFO:teuthology.orchestra.run.smithi101.stdout:tuned 904 1215 tuned root mem REG 8,1 13200 55984 /usr/lib64/python3.6/lib-dynload/grp.cpython-36m-x86_64-linux-gnu.so 2023-08-01T20:01:35.059 INFO:teuthology.orchestra.run.smithi101.stdout:tuned 904 1215 tuned root mem REG 8,1 162192 24774 /usr/lib64/liblzma.so.5.2.4 2023-08-01T20:01:35.059 INFO:teuthology.orchestra.run.smithi101.stdout:tuned 904 1215 tuned root mem REG 8,1 42848 53978 /usr/lib64/python3.6/lib-dynload/_lzma.cpython-36m-x86_64-linux-gnu.so 2023-08-01T20:01:35.059 INFO:teuthology.orchestra.run.smithi101.stdout:tuned 904 1215 tuned root mem REG 8,1 75328 24873 /usr/lib64/libbz2.so.1.0.6 2023-08-01T20:01:35.059 INFO:teuthology.orchestra.run.smithi101.stdout:tuned 904 1215 tuned root mem REG 8,1 23032 55965 /usr/lib64/python3.6/lib-dynload/_bz2.cpython-36m-x86_64-linux-gnu.so 2023-08-01T20:01:35.059 INFO:teuthology.orchestra.run.smithi101.stdout:tuned 904 1215 tuned root mem REG 8,1 34400 54011 /usr/lib64/python3.6/lib-dynload/zlib.cpython-36m-x86_64-linux-gnu.so 2023-08-01T20:01:35.059 INFO:teuthology.orchestra.run.smithi101.stdout:tuned 904 1215 tuned root mem REG 8,1 20528 55976 /usr/lib64/python3.6/lib-dynload/_random.cpython-36m-x86_64-linux-gnu.so 2023-08-01T20:01:35.060 INFO:teuthology.orchestra.run.smithi101.stdout:tuned 904 1215 tuned root mem REG 8,1 13688 53954 /usr/lib64/python3.6/lib-dynload/_bisect.cpython-36m-x86_64-linux-gnu.so 2023-08-01T20:01:35.060 INFO:teuthology.orchestra.run.smithi101.stdout:tuned 904 1215 tuned root mem REG 8,1 110632 55977 /usr/lib64/python3.6/lib-dynload/_sha3.cpython-36m-x86_64-linux-gnu.so 2023-08-01T20:01:35.060 INFO:teuthology.orchestra.run.smithi101.stdout:tuned 904 1215 tuned root mem REG 8,1 129520 55964 /usr/lib64/python3.6/lib-dynload/_blake2.cpython-36m-x86_64-linux-gnu.so 2023-08-01T20:01:35.060 INFO:teuthology.orchestra.run.smithi101.stdout:tuned 904 1215 tuned root mem REG 8,1 615744 26862 /usr/lib64/libssl.so.1.1.1k 2023-08-01T20:01:35.060 INFO:teuthology.orchestra.run.smithi101.stdout:tuned 904 1215 tuned root mem REG 8,1 47928 53973 /usr/lib64/python3.6/lib-dynload/_hashlib.cpython-36m-x86_64-linux-gnu.so 2023-08-01T20:01:35.060 INFO:teuthology.orchestra.run.smithi101.stdout:tuned 904 1215 tuned root mem REG 8,1 11592 53981 /usr/lib64/python3.6/lib-dynload/_opcode.cpython-36m-x86_64-linux-gnu.so 2023-08-01T20:01:35.060 INFO:teuthology.orchestra.run.smithi101.stdout:tuned 904 1215 tuned root mem REG 8,1 131584 55974 /usr/lib64/python3.6/lib-dynload/_pickle.cpython-36m-x86_64-linux-gnu.so 2023-08-01T20:01:35.060 INFO:teuthology.orchestra.run.smithi101.stdout:tuned 904 1215 tuned root mem REG 8,1 29256 54005 /usr/lib64/python3.6/lib-dynload/select.cpython-36m-x86_64-linux-gnu.so 2023-08-01T20:01:35.061 INFO:teuthology.orchestra.run.smithi101.stdout:tuned 904 1215 tuned root mem REG 8,1 59368 55985 /usr/lib64/python3.6/lib-dynload/math.cpython-36m-x86_64-linux-gnu.so 2023-08-01T20:01:35.061 INFO:teuthology.orchestra.run.smithi101.stdout:tuned 904 1215 tuned root mem REG 8,1 92984 55978 /usr/lib64/python3.6/lib-dynload/_socket.cpython-36m-x86_64-linux-gnu.so 2023-08-01T20:01:35.061 INFO:teuthology.orchestra.run.smithi101.stdout:tuned 904 1215 tuned root mem REG 8,1 56768 55981 /usr/lib64/python3.6/lib-dynload/_struct.cpython-36m-x86_64-linux-gnu.so 2023-08-01T20:01:35.061 INFO:teuthology.orchestra.run.smithi101.stdout:tuned 904 1215 tuned root mem REG 8,1 27136 55970 /usr/lib64/python3.6/lib-dynload/_heapq.cpython-36m-x86_64-linux-gnu.so 2023-08-01T20:01:35.061 INFO:teuthology.orchestra.run.smithi101.stdout:tuned 904 1215 tuned root mem REG 8,1 54352 24707 /usr/lib64/libnss_files-2.28.so 2023-08-01T20:01:35.061 INFO:teuthology.orchestra.run.smithi101.stdout:tuned 904 1215 tuned root mem REG 8,1 2586930 39433 /usr/lib/locale/en_US.utf8/LC_COLLATE 2023-08-01T20:01:35.061 INFO:teuthology.orchestra.run.smithi101.stdout:tuned 904 1215 tuned root mem REG 8,1 99640 24762 /usr/lib64/libz.so.1.2.11 2023-08-01T20:01:35.061 INFO:teuthology.orchestra.run.smithi101.stdout:tuned 904 1215 tuned root mem REG 8,1 2089984 24698 /usr/lib64/libc-2.28.so 2023-08-01T20:01:35.062 INFO:teuthology.orchestra.run.smithi101.stdout:tuned 904 1215 tuned root mem REG 8,1 1598840 24700 /usr/lib64/libm-2.28.so 2023-08-01T20:01:35.062 INFO:teuthology.orchestra.run.smithi101.stdout:tuned 904 1215 tuned root mem REG 8,1 17016 24713 /usr/lib64/libutil-2.28.so 2023-08-01T20:01:35.062 INFO:teuthology.orchestra.run.smithi101.stdout:tuned 904 1215 tuned root mem REG 8,1 19128 24699 /usr/lib64/libdl-2.28.so 2023-08-01T20:01:35.062 INFO:teuthology.orchestra.run.smithi101.stdout:tuned 904 1215 tuned root mem REG 8,1 149984 24708 /usr/lib64/libpthread-2.28.so 2023-08-01T20:01:35.062 INFO:teuthology.orchestra.run.smithi101.stdout:tuned 904 1215 tuned root mem REG 8,1 3286032 31711 /usr/lib64/libpython3.6m.so.1.0 2023-08-01T20:01:35.062 INFO:teuthology.orchestra.run.smithi101.stdout:tuned 904 1215 tuned root mem REG 8,1 3083608 26861 /usr/lib64/libcrypto.so.1.1.1k 2023-08-01T20:01:35.062 INFO:teuthology.orchestra.run.smithi101.stdout:tuned 904 1215 tuned root mem REG 8,1 1062168 24653 /usr/lib64/ld-2.28.so 2023-08-01T20:01:35.062 INFO:teuthology.orchestra.run.smithi101.stdout:tuned 904 1215 tuned root mem REG 8,1 337024 45489 /usr/lib/locale/C.utf8/LC_CTYPE 2023-08-01T20:01:35.063 INFO:teuthology.orchestra.run.smithi101.stdout:tuned 904 1215 tuned root mem REG 8,1 54 44174 /usr/lib/locale/en_US.utf8/LC_NUMERIC 2023-08-01T20:01:35.063 INFO:teuthology.orchestra.run.smithi101.stdout:tuned 904 1215 tuned root mem REG 8,1 3316 48200 /usr/lib/locale/en_US.utf8/LC_TIME 2023-08-01T20:01:35.063 INFO:teuthology.orchestra.run.smithi101.stdout:tuned 904 1215 tuned root mem REG 8,1 286 48207 /usr/lib/locale/en_US.utf8/LC_MONETARY 2023-08-01T20:01:35.063 INFO:teuthology.orchestra.run.smithi101.stdout:tuned 904 1215 tuned root mem REG 8,1 26998 35419 /usr/lib64/gconv/gconv-modules.cache 2023-08-01T20:01:35.063 INFO:teuthology.orchestra.run.smithi101.stdout:tuned 904 1215 tuned root mem REG 8,1 57 39434 /usr/lib/locale/en_US.utf8/LC_MESSAGES/SYS_LC_MESSAGES 2023-08-01T20:01:35.063 INFO:teuthology.orchestra.run.smithi101.stdout:tuned 904 1215 tuned root mem REG 8,1 34 39448 /usr/lib/locale/en_US.utf8/LC_PAPER 2023-08-01T20:01:35.063 INFO:teuthology.orchestra.run.smithi101.stdout:tuned 904 1215 tuned root mem REG 8,1 77 44173 /usr/lib/locale/en_US.utf8/LC_NAME 2023-08-01T20:01:35.064 INFO:teuthology.orchestra.run.smithi101.stdout:tuned 904 1215 tuned root mem REG 8,1 167 45462 /usr/lib/locale/en_US.utf8/LC_ADDRESS 2023-08-01T20:01:35.064 INFO:teuthology.orchestra.run.smithi101.stdout:tuned 904 1215 tuned root mem REG 8,1 59 48208 /usr/lib/locale/en_US.utf8/LC_TELEPHONE 2023-08-01T20:01:35.064 INFO:teuthology.orchestra.run.smithi101.stdout:tuned 904 1215 tuned root mem REG 8,1 23 48206 /usr/lib/locale/en_US.utf8/LC_MEASUREMENT 2023-08-01T20:01:35.064 INFO:teuthology.orchestra.run.smithi101.stdout:tuned 904 1215 tuned root mem REG 8,1 368 48205 /usr/lib/locale/en_US.utf8/LC_IDENTIFICATION 2023-08-01T20:01:35.064 INFO:teuthology.orchestra.run.smithi101.stdout:tuned 904 1215 tuned root 0r CHR 1,3 0t0 3083 /dev/null 2023-08-01T20:01:35.064 INFO:teuthology.orchestra.run.smithi101.stdout:tuned 904 1215 tuned root 1u unix 0xffff93750c980000 0t0 29954 type=STREAM 2023-08-01T20:01:35.064 INFO:teuthology.orchestra.run.smithi101.stdout:tuned 904 1215 tuned root 2u unix 0xffff93750c980000 0t0 29954 type=STREAM 2023-08-01T20:01:35.064 INFO:teuthology.orchestra.run.smithi101.stdout:tuned 904 1215 tuned root 3w REG 8,1 35197 18929 /var/log/tuned/tuned.log 2023-08-01T20:01:35.065 INFO:teuthology.orchestra.run.smithi101.stdout:tuned 904 1215 tuned root 4u netlink 0t0 22279 KOBJECT_UEVENT 2023-08-01T20:01:35.065 INFO:teuthology.orchestra.run.smithi101.stdout:tuned 904 1215 tuned root 5u unix 0xffff93750c927500 0t0 22727 type=STREAM 2023-08-01T20:01:35.065 INFO:teuthology.orchestra.run.smithi101.stdout:tuned 904 1215 tuned root 6u a_inode 0,14 0 15587 [eventfd] 2023-08-01T20:01:35.065 INFO:teuthology.orchestra.run.smithi101.stdout:tuned 904 1215 tuned root 7w CHR 10,62 0t0 5180 /dev/cpu_dma_latency 2023-08-01T20:01:35.065 INFO:teuthology.orchestra.run.smithi101.stdout:tuned 904 1215 tuned root 8u a_inode 0,14 0 15587 [perf_event] 2023-08-01T20:01:35.065 INFO:teuthology.orchestra.run.smithi101.stdout:tuned 904 1215 tuned root 9u a_inode 0,14 0 15587 [perf_event] 2023-08-01T20:01:35.065 INFO:teuthology.orchestra.run.smithi101.stdout:tuned 904 1215 tuned root 10u a_inode 0,14 0 15587 [perf_event] 2023-08-01T20:01:35.065 INFO:teuthology.orchestra.run.smithi101.stdout:tuned 904 1215 tuned root 11u a_inode 0,14 0 15587 [perf_event] 2023-08-01T20:01:35.066 INFO:teuthology.orchestra.run.smithi101.stdout:tuned 904 1215 tuned root 12u a_inode 0,14 0 15587 [perf_event] 2023-08-01T20:01:35.066 INFO:teuthology.orchestra.run.smithi101.stdout:tuned 904 1215 tuned root 13u a_inode 0,14 0 15587 [perf_event] 2023-08-01T20:01:35.066 INFO:teuthology.orchestra.run.smithi101.stdout:tuned 904 1215 tuned root 14u a_inode 0,14 0 15587 [perf_event] 2023-08-01T20:01:35.066 INFO:teuthology.orchestra.run.smithi101.stdout:tuned 904 1215 tuned root 15u a_inode 0,14 0 15587 [perf_event] 2023-08-01T20:01:35.066 INFO:teuthology.orchestra.run.smithi101.stdout:tuned 904 1215 tuned root 16r FIFO 0,13 0t0 22732 pipe 2023-08-01T20:01:35.066 INFO:teuthology.orchestra.run.smithi101.stdout:tuned 904 1215 tuned root 17w FIFO 0,13 0t0 22732 pipe 2023-08-01T20:01:35.066 INFO:teuthology.orchestra.run.smithi101.stdout:tuned 904 1215 tuned root 18u unix 0xffff93750c995a00 0t0 32972 type=STREAM 2023-08-01T20:01:35.066 INFO:teuthology.orchestra.run.smithi101.stdout:tuned 904 1215 tuned root 19u unix 0xffff93750c996c00 0t0 32973 type=STREAM 2023-08-01T20:01:35.067 INFO:teuthology.orchestra.run.smithi101.stdout:gssproxy 922 root cwd DIR 8,1 4096 2 / 2023-08-01T20:01:35.067 INFO:teuthology.orchestra.run.smithi101.stdout:gssproxy 922 root rtd DIR 8,1 4096 2 / 2023-08-01T20:01:35.067 INFO:teuthology.orchestra.run.smithi101.stdout:gssproxy 922 root txt REG 8,1 135248 31338 /usr/sbin/gssproxy 2023-08-01T20:01:35.067 INFO:teuthology.orchestra.run.smithi101.stdout:gssproxy 922 root mem REG 8,1 1598840 24700 /usr/lib64/libm-2.28.so 2023-08-01T20:01:35.067 INFO:teuthology.orchestra.run.smithi101.stdout:gssproxy 922 root mem REG 8,1 69752 23675 /usr/lib64/libev.so.4.0.0 2023-08-01T20:01:35.067 INFO:teuthology.orchestra.run.smithi101.stdout:gssproxy 922 root mem REG 8,1 12112 31337 /usr/lib64/libverto-libev.so.1.0.0 2023-08-01T20:01:35.067 INFO:teuthology.orchestra.run.smithi101.stdout:gssproxy 922 root mem REG 8,1 2586930 39433 /usr/lib/locale/en_US.utf8/LC_COLLATE 2023-08-01T20:01:35.067 INFO:teuthology.orchestra.run.smithi101.stdout:gssproxy 922 root mem REG 8,1 99640 24762 /usr/lib64/libz.so.1.2.11 2023-08-01T20:01:35.068 INFO:teuthology.orchestra.run.smithi101.stdout:gssproxy 922 root mem REG 8,1 543304 24651 /usr/lib64/libpcre2-8.so.0.7.1 2023-08-01T20:01:35.068 INFO:teuthology.orchestra.run.smithi101.stdout:gssproxy 922 root mem REG 8,1 16096 25517 /usr/lib64/libpath_utils.so.1.0.1 2023-08-01T20:01:35.068 INFO:teuthology.orchestra.run.smithi101.stdout:gssproxy 922 root mem REG 8,1 19128 24699 /usr/lib64/libdl-2.28.so 2023-08-01T20:01:35.068 INFO:teuthology.orchestra.run.smithi101.stdout:gssproxy 922 root mem REG 8,1 92968 24709 /usr/lib64/libresolv-2.28.so 2023-08-01T20:01:35.068 INFO:teuthology.orchestra.run.smithi101.stdout:gssproxy 922 root mem REG 8,1 3083608 26861 /usr/lib64/libcrypto.so.1.1.1k 2023-08-01T20:01:35.068 INFO:teuthology.orchestra.run.smithi101.stdout:gssproxy 922 root mem REG 8,1 16192 25072 /usr/lib64/libkeyutils.so.1.6 2023-08-01T20:01:35.068 INFO:teuthology.orchestra.run.smithi101.stdout:gssproxy 922 root mem REG 8,1 71472 26580 /usr/lib64/libkrb5support.so.0.1 2023-08-01T20:01:35.068 INFO:teuthology.orchestra.run.smithi101.stdout:gssproxy 922 root mem REG 8,1 2089984 24698 /usr/lib64/libc-2.28.so 2023-08-01T20:01:35.069 INFO:teuthology.orchestra.run.smithi101.stdout:gssproxy 922 root mem REG 8,1 149984 24708 /usr/lib64/libpthread-2.28.so 2023-08-01T20:01:35.069 INFO:teuthology.orchestra.run.smithi101.stdout:gssproxy 922 root mem REG 8,1 355968 26571 /usr/lib64/libgssapi_krb5.so.2.2 2023-08-01T20:01:35.069 INFO:teuthology.orchestra.run.smithi101.stdout:gssproxy 922 root mem REG 8,1 138824 26572 /usr/lib64/libgssrpc.so.4.2 2023-08-01T20:01:35.069 INFO:teuthology.orchestra.run.smithi101.stdout:gssproxy 922 root mem REG 8,1 172104 24654 /usr/lib64/libselinux.so.1 2023-08-01T20:01:35.069 INFO:teuthology.orchestra.run.smithi101.stdout:gssproxy 922 root mem REG 8,1 53968 24810 /usr/lib64/libcollection.so.4.1.1 2023-08-01T20:01:35.069 INFO:teuthology.orchestra.run.smithi101.stdout:gssproxy 922 root mem REG 8,1 11976 24814 /usr/lib64/libref_array.so.1.2.1 2023-08-01T20:01:35.069 INFO:teuthology.orchestra.run.smithi101.stdout:gssproxy 922 root mem REG 8,1 11800 24808 /usr/lib64/libbasicobjects.so.0.1.0 2023-08-01T20:01:35.069 INFO:teuthology.orchestra.run.smithi101.stdout:gssproxy 922 root mem REG 8,1 112088 25519 /usr/lib64/libini_config.so.5.2.1 2023-08-01T20:01:35.070 INFO:teuthology.orchestra.run.smithi101.stdout:gssproxy 922 root mem REG 8,1 24952 26146 /usr/lib64/libverto.so.1.0.0 2023-08-01T20:01:35.070 INFO:teuthology.orchestra.run.smithi101.stdout:gssproxy 922 root mem REG 8,1 16792 24764 /usr/lib64/libcom_err.so.2.1 2023-08-01T20:01:35.070 INFO:teuthology.orchestra.run.smithi101.stdout:gssproxy 922 root mem REG 8,1 96288 26574 /usr/lib64/libk5crypto.so.3.1 2023-08-01T20:01:35.070 INFO:teuthology.orchestra.run.smithi101.stdout:gssproxy 922 root mem REG 8,1 971432 26579 /usr/lib64/libkrb5.so.3.3 2023-08-01T20:01:35.070 INFO:teuthology.orchestra.run.smithi101.stdout:gssproxy 922 root mem REG 8,1 54688 24835 /usr/lib64/libpopt.so.0.0.1 2023-08-01T20:01:35.070 INFO:teuthology.orchestra.run.smithi101.stdout:gssproxy 922 root mem REG 8,1 1062168 24653 /usr/lib64/ld-2.28.so 2023-08-01T20:01:35.070 INFO:teuthology.orchestra.run.smithi101.stdout:gssproxy 922 root mem REG 8,1 337024 45489 /usr/lib/locale/C.utf8/LC_CTYPE 2023-08-01T20:01:35.071 INFO:teuthology.orchestra.run.smithi101.stdout:gssproxy 922 root mem REG 8,1 54 44174 /usr/lib/locale/en_US.utf8/LC_NUMERIC 2023-08-01T20:01:35.071 INFO:teuthology.orchestra.run.smithi101.stdout:gssproxy 922 root mem REG 8,1 3316 48200 /usr/lib/locale/en_US.utf8/LC_TIME 2023-08-01T20:01:35.071 INFO:teuthology.orchestra.run.smithi101.stdout:gssproxy 922 root mem REG 8,1 286 48207 /usr/lib/locale/en_US.utf8/LC_MONETARY 2023-08-01T20:01:35.071 INFO:teuthology.orchestra.run.smithi101.stdout:gssproxy 922 root mem REG 8,1 57 39434 /usr/lib/locale/en_US.utf8/LC_MESSAGES/SYS_LC_MESSAGES 2023-08-01T20:01:35.071 INFO:teuthology.orchestra.run.smithi101.stdout:gssproxy 922 root mem REG 8,1 34 39448 /usr/lib/locale/en_US.utf8/LC_PAPER 2023-08-01T20:01:35.071 INFO:teuthology.orchestra.run.smithi101.stdout:gssproxy 922 root mem REG 8,1 77 44173 /usr/lib/locale/en_US.utf8/LC_NAME 2023-08-01T20:01:35.071 INFO:teuthology.orchestra.run.smithi101.stdout:gssproxy 922 root mem REG 8,1 167 45462 /usr/lib/locale/en_US.utf8/LC_ADDRESS 2023-08-01T20:01:35.071 INFO:teuthology.orchestra.run.smithi101.stdout:gssproxy 922 root mem REG 8,1 59 48208 /usr/lib/locale/en_US.utf8/LC_TELEPHONE 2023-08-01T20:01:35.072 INFO:teuthology.orchestra.run.smithi101.stdout:gssproxy 922 root mem REG 8,1 23 48206 /usr/lib/locale/en_US.utf8/LC_MEASUREMENT 2023-08-01T20:01:35.072 INFO:teuthology.orchestra.run.smithi101.stdout:gssproxy 922 root mem REG 8,1 368 48205 /usr/lib/locale/en_US.utf8/LC_IDENTIFICATION 2023-08-01T20:01:35.072 INFO:teuthology.orchestra.run.smithi101.stdout:gssproxy 922 root mem REG 8,1 26998 35419 /usr/lib64/gconv/gconv-modules.cache 2023-08-01T20:01:35.072 INFO:teuthology.orchestra.run.smithi101.stdout:gssproxy 922 root 0r CHR 1,3 0t0 3083 /dev/null 2023-08-01T20:01:35.072 INFO:teuthology.orchestra.run.smithi101.stdout:gssproxy 922 root 1u unix 0xffff93750d2b8480 0t0 29199 type=STREAM 2023-08-01T20:01:35.072 INFO:teuthology.orchestra.run.smithi101.stdout:gssproxy 922 root 2u unix 0xffff93750d2b8480 0t0 29199 type=STREAM 2023-08-01T20:01:35.072 INFO:teuthology.orchestra.run.smithi101.stdout:gssproxy 922 root 3u unix 0xffff93750c981200 0t0 29960 type=DGRAM 2023-08-01T20:01:35.072 INFO:teuthology.orchestra.run.smithi101.stdout:gssproxy 922 root 4r FIFO 0,13 0t0 29968 pipe 2023-08-01T20:01:35.073 INFO:teuthology.orchestra.run.smithi101.stdout:gssproxy 922 root 5u a_inode 0,14 0 15587 [eventpoll] 2023-08-01T20:01:35.073 INFO:teuthology.orchestra.run.smithi101.stdout:gssproxy 922 root 6u a_inode 0,14 0 15587 [eventfd] 2023-08-01T20:01:35.073 INFO:teuthology.orchestra.run.smithi101.stdout:gssproxy 922 root 7u unix 0xffff93750c980900 0t0 29963 /var/lib/gssproxy/default.sock type=STREAM 2023-08-01T20:01:35.073 INFO:teuthology.orchestra.run.smithi101.stdout:gssproxy 922 root 8u unix 0xffff93750c983f00 0t0 29964 /run/gssproxy.sock type=STREAM 2023-08-01T20:01:35.073 INFO:teuthology.orchestra.run.smithi101.stdout:gssproxy 922 root 9w FIFO 0,13 0t0 29968 pipe 2023-08-01T20:01:35.073 INFO:teuthology.orchestra.run.smithi101.stdout:gssproxy 922 930 gssproxy root cwd DIR 8,1 4096 2 / 2023-08-01T20:01:35.073 INFO:teuthology.orchestra.run.smithi101.stdout:gssproxy 922 930 gssproxy root rtd DIR 8,1 4096 2 / 2023-08-01T20:01:35.073 INFO:teuthology.orchestra.run.smithi101.stdout:gssproxy 922 930 gssproxy root txt REG 8,1 135248 31338 /usr/sbin/gssproxy 2023-08-01T20:01:35.074 INFO:teuthology.orchestra.run.smithi101.stdout:gssproxy 922 930 gssproxy root mem REG 8,1 1598840 24700 /usr/lib64/libm-2.28.so 2023-08-01T20:01:35.074 INFO:teuthology.orchestra.run.smithi101.stdout:gssproxy 922 930 gssproxy root mem REG 8,1 69752 23675 /usr/lib64/libev.so.4.0.0 2023-08-01T20:01:35.074 INFO:teuthology.orchestra.run.smithi101.stdout:gssproxy 922 930 gssproxy root mem REG 8,1 12112 31337 /usr/lib64/libverto-libev.so.1.0.0 2023-08-01T20:01:35.074 INFO:teuthology.orchestra.run.smithi101.stdout:gssproxy 922 930 gssproxy root mem REG 8,1 2586930 39433 /usr/lib/locale/en_US.utf8/LC_COLLATE 2023-08-01T20:01:35.074 INFO:teuthology.orchestra.run.smithi101.stdout:gssproxy 922 930 gssproxy root mem REG 8,1 99640 24762 /usr/lib64/libz.so.1.2.11 2023-08-01T20:01:35.074 INFO:teuthology.orchestra.run.smithi101.stdout:gssproxy 922 930 gssproxy root mem REG 8,1 543304 24651 /usr/lib64/libpcre2-8.so.0.7.1 2023-08-01T20:01:35.074 INFO:teuthology.orchestra.run.smithi101.stdout:gssproxy 922 930 gssproxy root mem REG 8,1 16096 25517 /usr/lib64/libpath_utils.so.1.0.1 2023-08-01T20:01:35.074 INFO:teuthology.orchestra.run.smithi101.stdout:gssproxy 922 930 gssproxy root mem REG 8,1 19128 24699 /usr/lib64/libdl-2.28.so 2023-08-01T20:01:35.075 INFO:teuthology.orchestra.run.smithi101.stdout:gssproxy 922 930 gssproxy root mem REG 8,1 92968 24709 /usr/lib64/libresolv-2.28.so 2023-08-01T20:01:35.075 INFO:teuthology.orchestra.run.smithi101.stdout:gssproxy 922 930 gssproxy root mem REG 8,1 3083608 26861 /usr/lib64/libcrypto.so.1.1.1k 2023-08-01T20:01:35.075 INFO:teuthology.orchestra.run.smithi101.stdout:gssproxy 922 930 gssproxy root mem REG 8,1 16192 25072 /usr/lib64/libkeyutils.so.1.6 2023-08-01T20:01:35.075 INFO:teuthology.orchestra.run.smithi101.stdout:gssproxy 922 930 gssproxy root mem REG 8,1 71472 26580 /usr/lib64/libkrb5support.so.0.1 2023-08-01T20:01:35.075 INFO:teuthology.orchestra.run.smithi101.stdout:gssproxy 922 930 gssproxy root mem REG 8,1 2089984 24698 /usr/lib64/libc-2.28.so 2023-08-01T20:01:35.075 INFO:teuthology.orchestra.run.smithi101.stdout:gssproxy 922 930 gssproxy root mem REG 8,1 149984 24708 /usr/lib64/libpthread-2.28.so 2023-08-01T20:01:35.075 INFO:teuthology.orchestra.run.smithi101.stdout:gssproxy 922 930 gssproxy root mem REG 8,1 355968 26571 /usr/lib64/libgssapi_krb5.so.2.2 2023-08-01T20:01:35.075 INFO:teuthology.orchestra.run.smithi101.stdout:gssproxy 922 930 gssproxy root mem REG 8,1 138824 26572 /usr/lib64/libgssrpc.so.4.2 2023-08-01T20:01:35.076 INFO:teuthology.orchestra.run.smithi101.stdout:gssproxy 922 930 gssproxy root mem REG 8,1 172104 24654 /usr/lib64/libselinux.so.1 2023-08-01T20:01:35.076 INFO:teuthology.orchestra.run.smithi101.stdout:gssproxy 922 930 gssproxy root mem REG 8,1 53968 24810 /usr/lib64/libcollection.so.4.1.1 2023-08-01T20:01:35.076 INFO:teuthology.orchestra.run.smithi101.stdout:gssproxy 922 930 gssproxy root mem REG 8,1 11976 24814 /usr/lib64/libref_array.so.1.2.1 2023-08-01T20:01:35.076 INFO:teuthology.orchestra.run.smithi101.stdout:gssproxy 922 930 gssproxy root mem REG 8,1 11800 24808 /usr/lib64/libbasicobjects.so.0.1.0 2023-08-01T20:01:35.076 INFO:teuthology.orchestra.run.smithi101.stdout:gssproxy 922 930 gssproxy root mem REG 8,1 112088 25519 /usr/lib64/libini_config.so.5.2.1 2023-08-01T20:01:35.076 INFO:teuthology.orchestra.run.smithi101.stdout:gssproxy 922 930 gssproxy root mem REG 8,1 24952 26146 /usr/lib64/libverto.so.1.0.0 2023-08-01T20:01:35.076 INFO:teuthology.orchestra.run.smithi101.stdout:gssproxy 922 930 gssproxy root mem REG 8,1 16792 24764 /usr/lib64/libcom_err.so.2.1 2023-08-01T20:01:35.077 INFO:teuthology.orchestra.run.smithi101.stdout:gssproxy 922 930 gssproxy root mem REG 8,1 96288 26574 /usr/lib64/libk5crypto.so.3.1 2023-08-01T20:01:35.077 INFO:teuthology.orchestra.run.smithi101.stdout:gssproxy 922 930 gssproxy root mem REG 8,1 971432 26579 /usr/lib64/libkrb5.so.3.3 2023-08-01T20:01:35.077 INFO:teuthology.orchestra.run.smithi101.stdout:gssproxy 922 930 gssproxy root mem REG 8,1 54688 24835 /usr/lib64/libpopt.so.0.0.1 2023-08-01T20:01:35.077 INFO:teuthology.orchestra.run.smithi101.stdout:gssproxy 922 930 gssproxy root mem REG 8,1 1062168 24653 /usr/lib64/ld-2.28.so 2023-08-01T20:01:35.077 INFO:teuthology.orchestra.run.smithi101.stdout:gssproxy 922 930 gssproxy root mem REG 8,1 337024 45489 /usr/lib/locale/C.utf8/LC_CTYPE 2023-08-01T20:01:35.077 INFO:teuthology.orchestra.run.smithi101.stdout:gssproxy 922 930 gssproxy root mem REG 8,1 54 44174 /usr/lib/locale/en_US.utf8/LC_NUMERIC 2023-08-01T20:01:35.077 INFO:teuthology.orchestra.run.smithi101.stdout:gssproxy 922 930 gssproxy root mem REG 8,1 3316 48200 /usr/lib/locale/en_US.utf8/LC_TIME 2023-08-01T20:01:35.077 INFO:teuthology.orchestra.run.smithi101.stdout:gssproxy 922 930 gssproxy root mem REG 8,1 286 48207 /usr/lib/locale/en_US.utf8/LC_MONETARY 2023-08-01T20:01:35.078 INFO:teuthology.orchestra.run.smithi101.stdout:gssproxy 922 930 gssproxy root mem REG 8,1 57 39434 /usr/lib/locale/en_US.utf8/LC_MESSAGES/SYS_LC_MESSAGES 2023-08-01T20:01:35.078 INFO:teuthology.orchestra.run.smithi101.stdout:gssproxy 922 930 gssproxy root mem REG 8,1 34 39448 /usr/lib/locale/en_US.utf8/LC_PAPER 2023-08-01T20:01:35.078 INFO:teuthology.orchestra.run.smithi101.stdout:gssproxy 922 930 gssproxy root mem REG 8,1 77 44173 /usr/lib/locale/en_US.utf8/LC_NAME 2023-08-01T20:01:35.078 INFO:teuthology.orchestra.run.smithi101.stdout:gssproxy 922 930 gssproxy root mem REG 8,1 167 45462 /usr/lib/locale/en_US.utf8/LC_ADDRESS 2023-08-01T20:01:35.078 INFO:teuthology.orchestra.run.smithi101.stdout:gssproxy 922 930 gssproxy root mem REG 8,1 59 48208 /usr/lib/locale/en_US.utf8/LC_TELEPHONE 2023-08-01T20:01:35.078 INFO:teuthology.orchestra.run.smithi101.stdout:gssproxy 922 930 gssproxy root mem REG 8,1 23 48206 /usr/lib/locale/en_US.utf8/LC_MEASUREMENT 2023-08-01T20:01:35.078 INFO:teuthology.orchestra.run.smithi101.stdout:gssproxy 922 930 gssproxy root mem REG 8,1 368 48205 /usr/lib/locale/en_US.utf8/LC_IDENTIFICATION 2023-08-01T20:01:35.078 INFO:teuthology.orchestra.run.smithi101.stdout:gssproxy 922 930 gssproxy root mem REG 8,1 26998 35419 /usr/lib64/gconv/gconv-modules.cache 2023-08-01T20:01:35.079 INFO:teuthology.orchestra.run.smithi101.stdout:gssproxy 922 930 gssproxy root 0r CHR 1,3 0t0 3083 /dev/null 2023-08-01T20:01:35.079 INFO:teuthology.orchestra.run.smithi101.stdout:gssproxy 922 930 gssproxy root 1u unix 0xffff93750d2b8480 0t0 29199 type=STREAM 2023-08-01T20:01:35.079 INFO:teuthology.orchestra.run.smithi101.stdout:gssproxy 922 930 gssproxy root 2u unix 0xffff93750d2b8480 0t0 29199 type=STREAM 2023-08-01T20:01:35.079 INFO:teuthology.orchestra.run.smithi101.stdout:gssproxy 922 930 gssproxy root 3u unix 0xffff93750c981200 0t0 29960 type=DGRAM 2023-08-01T20:01:35.079 INFO:teuthology.orchestra.run.smithi101.stdout:gssproxy 922 930 gssproxy root 4r FIFO 0,13 0t0 29968 pipe 2023-08-01T20:01:35.079 INFO:teuthology.orchestra.run.smithi101.stdout:gssproxy 922 930 gssproxy root 5u a_inode 0,14 0 15587 [eventpoll] 2023-08-01T20:01:35.079 INFO:teuthology.orchestra.run.smithi101.stdout:gssproxy 922 930 gssproxy root 6u a_inode 0,14 0 15587 [eventfd] 2023-08-01T20:01:35.079 INFO:teuthology.orchestra.run.smithi101.stdout:gssproxy 922 930 gssproxy root 7u unix 0xffff93750c980900 0t0 29963 /var/lib/gssproxy/default.sock type=STREAM 2023-08-01T20:01:35.080 INFO:teuthology.orchestra.run.smithi101.stdout:gssproxy 922 930 gssproxy root 8u unix 0xffff93750c983f00 0t0 29964 /run/gssproxy.sock type=STREAM 2023-08-01T20:01:35.080 INFO:teuthology.orchestra.run.smithi101.stdout:gssproxy 922 930 gssproxy root 9w FIFO 0,13 0t0 29968 pipe 2023-08-01T20:01:35.080 INFO:teuthology.orchestra.run.smithi101.stdout:gssproxy 922 931 gssproxy root cwd DIR 8,1 4096 2 / 2023-08-01T20:01:35.080 INFO:teuthology.orchestra.run.smithi101.stdout:gssproxy 922 931 gssproxy root rtd DIR 8,1 4096 2 / 2023-08-01T20:01:35.080 INFO:teuthology.orchestra.run.smithi101.stdout:gssproxy 922 931 gssproxy root txt REG 8,1 135248 31338 /usr/sbin/gssproxy 2023-08-01T20:01:35.080 INFO:teuthology.orchestra.run.smithi101.stdout:gssproxy 922 931 gssproxy root mem REG 8,1 1598840 24700 /usr/lib64/libm-2.28.so 2023-08-01T20:01:35.080 INFO:teuthology.orchestra.run.smithi101.stdout:gssproxy 922 931 gssproxy root mem REG 8,1 69752 23675 /usr/lib64/libev.so.4.0.0 2023-08-01T20:01:35.080 INFO:teuthology.orchestra.run.smithi101.stdout:gssproxy 922 931 gssproxy root mem REG 8,1 12112 31337 /usr/lib64/libverto-libev.so.1.0.0 2023-08-01T20:01:35.081 INFO:teuthology.orchestra.run.smithi101.stdout:gssproxy 922 931 gssproxy root mem REG 8,1 2586930 39433 /usr/lib/locale/en_US.utf8/LC_COLLATE 2023-08-01T20:01:35.081 INFO:teuthology.orchestra.run.smithi101.stdout:gssproxy 922 931 gssproxy root mem REG 8,1 99640 24762 /usr/lib64/libz.so.1.2.11 2023-08-01T20:01:35.081 INFO:teuthology.orchestra.run.smithi101.stdout:gssproxy 922 931 gssproxy root mem REG 8,1 543304 24651 /usr/lib64/libpcre2-8.so.0.7.1 2023-08-01T20:01:35.081 INFO:teuthology.orchestra.run.smithi101.stdout:gssproxy 922 931 gssproxy root mem REG 8,1 16096 25517 /usr/lib64/libpath_utils.so.1.0.1 2023-08-01T20:01:35.081 INFO:teuthology.orchestra.run.smithi101.stdout:gssproxy 922 931 gssproxy root mem REG 8,1 19128 24699 /usr/lib64/libdl-2.28.so 2023-08-01T20:01:35.081 INFO:teuthology.orchestra.run.smithi101.stdout:gssproxy 922 931 gssproxy root mem REG 8,1 92968 24709 /usr/lib64/libresolv-2.28.so 2023-08-01T20:01:35.081 INFO:teuthology.orchestra.run.smithi101.stdout:gssproxy 922 931 gssproxy root mem REG 8,1 3083608 26861 /usr/lib64/libcrypto.so.1.1.1k 2023-08-01T20:01:35.081 INFO:teuthology.orchestra.run.smithi101.stdout:gssproxy 922 931 gssproxy root mem REG 8,1 16192 25072 /usr/lib64/libkeyutils.so.1.6 2023-08-01T20:01:35.082 INFO:teuthology.orchestra.run.smithi101.stdout:gssproxy 922 931 gssproxy root mem REG 8,1 71472 26580 /usr/lib64/libkrb5support.so.0.1 2023-08-01T20:01:35.082 INFO:teuthology.orchestra.run.smithi101.stdout:gssproxy 922 931 gssproxy root mem REG 8,1 2089984 24698 /usr/lib64/libc-2.28.so 2023-08-01T20:01:35.082 INFO:teuthology.orchestra.run.smithi101.stdout:gssproxy 922 931 gssproxy root mem REG 8,1 149984 24708 /usr/lib64/libpthread-2.28.so 2023-08-01T20:01:35.082 INFO:teuthology.orchestra.run.smithi101.stdout:gssproxy 922 931 gssproxy root mem REG 8,1 355968 26571 /usr/lib64/libgssapi_krb5.so.2.2 2023-08-01T20:01:35.082 INFO:teuthology.orchestra.run.smithi101.stdout:gssproxy 922 931 gssproxy root mem REG 8,1 138824 26572 /usr/lib64/libgssrpc.so.4.2 2023-08-01T20:01:35.082 INFO:teuthology.orchestra.run.smithi101.stdout:gssproxy 922 931 gssproxy root mem REG 8,1 172104 24654 /usr/lib64/libselinux.so.1 2023-08-01T20:01:35.082 INFO:teuthology.orchestra.run.smithi101.stdout:gssproxy 922 931 gssproxy root mem REG 8,1 53968 24810 /usr/lib64/libcollection.so.4.1.1 2023-08-01T20:01:35.082 INFO:teuthology.orchestra.run.smithi101.stdout:gssproxy 922 931 gssproxy root mem REG 8,1 11976 24814 /usr/lib64/libref_array.so.1.2.1 2023-08-01T20:01:35.083 INFO:teuthology.orchestra.run.smithi101.stdout:gssproxy 922 931 gssproxy root mem REG 8,1 11800 24808 /usr/lib64/libbasicobjects.so.0.1.0 2023-08-01T20:01:35.083 INFO:teuthology.orchestra.run.smithi101.stdout:gssproxy 922 931 gssproxy root mem REG 8,1 112088 25519 /usr/lib64/libini_config.so.5.2.1 2023-08-01T20:01:35.083 INFO:teuthology.orchestra.run.smithi101.stdout:gssproxy 922 931 gssproxy root mem REG 8,1 24952 26146 /usr/lib64/libverto.so.1.0.0 2023-08-01T20:01:35.083 INFO:teuthology.orchestra.run.smithi101.stdout:gssproxy 922 931 gssproxy root mem REG 8,1 16792 24764 /usr/lib64/libcom_err.so.2.1 2023-08-01T20:01:35.083 INFO:teuthology.orchestra.run.smithi101.stdout:gssproxy 922 931 gssproxy root mem REG 8,1 96288 26574 /usr/lib64/libk5crypto.so.3.1 2023-08-01T20:01:35.083 INFO:teuthology.orchestra.run.smithi101.stdout:gssproxy 922 931 gssproxy root mem REG 8,1 971432 26579 /usr/lib64/libkrb5.so.3.3 2023-08-01T20:01:35.083 INFO:teuthology.orchestra.run.smithi101.stdout:gssproxy 922 931 gssproxy root mem REG 8,1 54688 24835 /usr/lib64/libpopt.so.0.0.1 2023-08-01T20:01:35.083 INFO:teuthology.orchestra.run.smithi101.stdout:gssproxy 922 931 gssproxy root mem REG 8,1 1062168 24653 /usr/lib64/ld-2.28.so 2023-08-01T20:01:35.084 INFO:teuthology.orchestra.run.smithi101.stdout:gssproxy 922 931 gssproxy root mem REG 8,1 337024 45489 /usr/lib/locale/C.utf8/LC_CTYPE 2023-08-01T20:01:35.084 INFO:teuthology.orchestra.run.smithi101.stdout:gssproxy 922 931 gssproxy root mem REG 8,1 54 44174 /usr/lib/locale/en_US.utf8/LC_NUMERIC 2023-08-01T20:01:35.084 INFO:teuthology.orchestra.run.smithi101.stdout:gssproxy 922 931 gssproxy root mem REG 8,1 3316 48200 /usr/lib/locale/en_US.utf8/LC_TIME 2023-08-01T20:01:35.084 INFO:teuthology.orchestra.run.smithi101.stdout:gssproxy 922 931 gssproxy root mem REG 8,1 286 48207 /usr/lib/locale/en_US.utf8/LC_MONETARY 2023-08-01T20:01:35.084 INFO:teuthology.orchestra.run.smithi101.stdout:gssproxy 922 931 gssproxy root mem REG 8,1 57 39434 /usr/lib/locale/en_US.utf8/LC_MESSAGES/SYS_LC_MESSAGES 2023-08-01T20:01:35.084 INFO:teuthology.orchestra.run.smithi101.stdout:gssproxy 922 931 gssproxy root mem REG 8,1 34 39448 /usr/lib/locale/en_US.utf8/LC_PAPER 2023-08-01T20:01:35.084 INFO:teuthology.orchestra.run.smithi101.stdout:gssproxy 922 931 gssproxy root mem REG 8,1 77 44173 /usr/lib/locale/en_US.utf8/LC_NAME 2023-08-01T20:01:35.085 INFO:teuthology.orchestra.run.smithi101.stdout:gssproxy 922 931 gssproxy root mem REG 8,1 167 45462 /usr/lib/locale/en_US.utf8/LC_ADDRESS 2023-08-01T20:01:35.085 INFO:teuthology.orchestra.run.smithi101.stdout:gssproxy 922 931 gssproxy root mem REG 8,1 59 48208 /usr/lib/locale/en_US.utf8/LC_TELEPHONE 2023-08-01T20:01:35.085 INFO:teuthology.orchestra.run.smithi101.stdout:gssproxy 922 931 gssproxy root mem REG 8,1 23 48206 /usr/lib/locale/en_US.utf8/LC_MEASUREMENT 2023-08-01T20:01:35.085 INFO:teuthology.orchestra.run.smithi101.stdout:gssproxy 922 931 gssproxy root mem REG 8,1 368 48205 /usr/lib/locale/en_US.utf8/LC_IDENTIFICATION 2023-08-01T20:01:35.085 INFO:teuthology.orchestra.run.smithi101.stdout:gssproxy 922 931 gssproxy root mem REG 8,1 26998 35419 /usr/lib64/gconv/gconv-modules.cache 2023-08-01T20:01:35.085 INFO:teuthology.orchestra.run.smithi101.stdout:gssproxy 922 931 gssproxy root 0r CHR 1,3 0t0 3083 /dev/null 2023-08-01T20:01:35.085 INFO:teuthology.orchestra.run.smithi101.stdout:gssproxy 922 931 gssproxy root 1u unix 0xffff93750d2b8480 0t0 29199 type=STREAM 2023-08-01T20:01:35.085 INFO:teuthology.orchestra.run.smithi101.stdout:gssproxy 922 931 gssproxy root 2u unix 0xffff93750d2b8480 0t0 29199 type=STREAM 2023-08-01T20:01:35.086 INFO:teuthology.orchestra.run.smithi101.stdout:gssproxy 922 931 gssproxy root 3u unix 0xffff93750c981200 0t0 29960 type=DGRAM 2023-08-01T20:01:35.086 INFO:teuthology.orchestra.run.smithi101.stdout:gssproxy 922 931 gssproxy root 4r FIFO 0,13 0t0 29968 pipe 2023-08-01T20:01:35.086 INFO:teuthology.orchestra.run.smithi101.stdout:gssproxy 922 931 gssproxy root 5u a_inode 0,14 0 15587 [eventpoll] 2023-08-01T20:01:35.086 INFO:teuthology.orchestra.run.smithi101.stdout:gssproxy 922 931 gssproxy root 6u a_inode 0,14 0 15587 [eventfd] 2023-08-01T20:01:35.086 INFO:teuthology.orchestra.run.smithi101.stdout:gssproxy 922 931 gssproxy root 7u unix 0xffff93750c980900 0t0 29963 /var/lib/gssproxy/default.sock type=STREAM 2023-08-01T20:01:35.086 INFO:teuthology.orchestra.run.smithi101.stdout:gssproxy 922 931 gssproxy root 8u unix 0xffff93750c983f00 0t0 29964 /run/gssproxy.sock type=STREAM 2023-08-01T20:01:35.086 INFO:teuthology.orchestra.run.smithi101.stdout:gssproxy 922 931 gssproxy root 9w FIFO 0,13 0t0 29968 pipe 2023-08-01T20:01:35.086 INFO:teuthology.orchestra.run.smithi101.stdout:gssproxy 922 932 gssproxy root cwd DIR 8,1 4096 2 / 2023-08-01T20:01:35.087 INFO:teuthology.orchestra.run.smithi101.stdout:gssproxy 922 932 gssproxy root rtd DIR 8,1 4096 2 / 2023-08-01T20:01:35.087 INFO:teuthology.orchestra.run.smithi101.stdout:gssproxy 922 932 gssproxy root txt REG 8,1 135248 31338 /usr/sbin/gssproxy 2023-08-01T20:01:35.087 INFO:teuthology.orchestra.run.smithi101.stdout:gssproxy 922 932 gssproxy root mem REG 8,1 1598840 24700 /usr/lib64/libm-2.28.so 2023-08-01T20:01:35.087 INFO:teuthology.orchestra.run.smithi101.stdout:gssproxy 922 932 gssproxy root mem REG 8,1 69752 23675 /usr/lib64/libev.so.4.0.0 2023-08-01T20:01:35.087 INFO:teuthology.orchestra.run.smithi101.stdout:gssproxy 922 932 gssproxy root mem REG 8,1 12112 31337 /usr/lib64/libverto-libev.so.1.0.0 2023-08-01T20:01:35.087 INFO:teuthology.orchestra.run.smithi101.stdout:gssproxy 922 932 gssproxy root mem REG 8,1 2586930 39433 /usr/lib/locale/en_US.utf8/LC_COLLATE 2023-08-01T20:01:35.087 INFO:teuthology.orchestra.run.smithi101.stdout:gssproxy 922 932 gssproxy root mem REG 8,1 99640 24762 /usr/lib64/libz.so.1.2.11 2023-08-01T20:01:35.087 INFO:teuthology.orchestra.run.smithi101.stdout:gssproxy 922 932 gssproxy root mem REG 8,1 543304 24651 /usr/lib64/libpcre2-8.so.0.7.1 2023-08-01T20:01:35.088 INFO:teuthology.orchestra.run.smithi101.stdout:gssproxy 922 932 gssproxy root mem REG 8,1 16096 25517 /usr/lib64/libpath_utils.so.1.0.1 2023-08-01T20:01:35.088 INFO:teuthology.orchestra.run.smithi101.stdout:gssproxy 922 932 gssproxy root mem REG 8,1 19128 24699 /usr/lib64/libdl-2.28.so 2023-08-01T20:01:35.088 INFO:teuthology.orchestra.run.smithi101.stdout:gssproxy 922 932 gssproxy root mem REG 8,1 92968 24709 /usr/lib64/libresolv-2.28.so 2023-08-01T20:01:35.088 INFO:teuthology.orchestra.run.smithi101.stdout:gssproxy 922 932 gssproxy root mem REG 8,1 3083608 26861 /usr/lib64/libcrypto.so.1.1.1k 2023-08-01T20:01:35.088 INFO:teuthology.orchestra.run.smithi101.stdout:gssproxy 922 932 gssproxy root mem REG 8,1 16192 25072 /usr/lib64/libkeyutils.so.1.6 2023-08-01T20:01:35.088 INFO:teuthology.orchestra.run.smithi101.stdout:gssproxy 922 932 gssproxy root mem REG 8,1 71472 26580 /usr/lib64/libkrb5support.so.0.1 2023-08-01T20:01:35.088 INFO:teuthology.orchestra.run.smithi101.stdout:gssproxy 922 932 gssproxy root mem REG 8,1 2089984 24698 /usr/lib64/libc-2.28.so 2023-08-01T20:01:35.088 INFO:teuthology.orchestra.run.smithi101.stdout:gssproxy 922 932 gssproxy root mem REG 8,1 149984 24708 /usr/lib64/libpthread-2.28.so 2023-08-01T20:01:35.089 INFO:teuthology.orchestra.run.smithi101.stdout:gssproxy 922 932 gssproxy root mem REG 8,1 355968 26571 /usr/lib64/libgssapi_krb5.so.2.2 2023-08-01T20:01:35.089 INFO:teuthology.orchestra.run.smithi101.stdout:gssproxy 922 932 gssproxy root mem REG 8,1 138824 26572 /usr/lib64/libgssrpc.so.4.2 2023-08-01T20:01:35.089 INFO:teuthology.orchestra.run.smithi101.stdout:gssproxy 922 932 gssproxy root mem REG 8,1 172104 24654 /usr/lib64/libselinux.so.1 2023-08-01T20:01:35.089 INFO:teuthology.orchestra.run.smithi101.stdout:gssproxy 922 932 gssproxy root mem REG 8,1 53968 24810 /usr/lib64/libcollection.so.4.1.1 2023-08-01T20:01:35.089 INFO:teuthology.orchestra.run.smithi101.stdout:gssproxy 922 932 gssproxy root mem REG 8,1 11976 24814 /usr/lib64/libref_array.so.1.2.1 2023-08-01T20:01:35.089 INFO:teuthology.orchestra.run.smithi101.stdout:gssproxy 922 932 gssproxy root mem REG 8,1 11800 24808 /usr/lib64/libbasicobjects.so.0.1.0 2023-08-01T20:01:35.089 INFO:teuthology.orchestra.run.smithi101.stdout:gssproxy 922 932 gssproxy root mem REG 8,1 112088 25519 /usr/lib64/libini_config.so.5.2.1 2023-08-01T20:01:35.089 INFO:teuthology.orchestra.run.smithi101.stdout:gssproxy 922 932 gssproxy root mem REG 8,1 24952 26146 /usr/lib64/libverto.so.1.0.0 2023-08-01T20:01:35.090 INFO:teuthology.orchestra.run.smithi101.stdout:gssproxy 922 932 gssproxy root mem REG 8,1 16792 24764 /usr/lib64/libcom_err.so.2.1 2023-08-01T20:01:35.090 INFO:teuthology.orchestra.run.smithi101.stdout:gssproxy 922 932 gssproxy root mem REG 8,1 96288 26574 /usr/lib64/libk5crypto.so.3.1 2023-08-01T20:01:35.090 INFO:teuthology.orchestra.run.smithi101.stdout:gssproxy 922 932 gssproxy root mem REG 8,1 971432 26579 /usr/lib64/libkrb5.so.3.3 2023-08-01T20:01:35.090 INFO:teuthology.orchestra.run.smithi101.stdout:gssproxy 922 932 gssproxy root mem REG 8,1 54688 24835 /usr/lib64/libpopt.so.0.0.1 2023-08-01T20:01:35.090 INFO:teuthology.orchestra.run.smithi101.stdout:gssproxy 922 932 gssproxy root mem REG 8,1 1062168 24653 /usr/lib64/ld-2.28.so 2023-08-01T20:01:35.090 INFO:teuthology.orchestra.run.smithi101.stdout:gssproxy 922 932 gssproxy root mem REG 8,1 337024 45489 /usr/lib/locale/C.utf8/LC_CTYPE 2023-08-01T20:01:35.090 INFO:teuthology.orchestra.run.smithi101.stdout:gssproxy 922 932 gssproxy root mem REG 8,1 54 44174 /usr/lib/locale/en_US.utf8/LC_NUMERIC 2023-08-01T20:01:35.090 INFO:teuthology.orchestra.run.smithi101.stdout:gssproxy 922 932 gssproxy root mem REG 8,1 3316 48200 /usr/lib/locale/en_US.utf8/LC_TIME 2023-08-01T20:01:35.091 INFO:teuthology.orchestra.run.smithi101.stdout:gssproxy 922 932 gssproxy root mem REG 8,1 286 48207 /usr/lib/locale/en_US.utf8/LC_MONETARY 2023-08-01T20:01:35.091 INFO:teuthology.orchestra.run.smithi101.stdout:gssproxy 922 932 gssproxy root mem REG 8,1 57 39434 /usr/lib/locale/en_US.utf8/LC_MESSAGES/SYS_LC_MESSAGES 2023-08-01T20:01:35.091 INFO:teuthology.orchestra.run.smithi101.stdout:gssproxy 922 932 gssproxy root mem REG 8,1 34 39448 /usr/lib/locale/en_US.utf8/LC_PAPER 2023-08-01T20:01:35.091 INFO:teuthology.orchestra.run.smithi101.stdout:gssproxy 922 932 gssproxy root mem REG 8,1 77 44173 /usr/lib/locale/en_US.utf8/LC_NAME 2023-08-01T20:01:35.091 INFO:teuthology.orchestra.run.smithi101.stdout:gssproxy 922 932 gssproxy root mem REG 8,1 167 45462 /usr/lib/locale/en_US.utf8/LC_ADDRESS 2023-08-01T20:01:35.091 INFO:teuthology.orchestra.run.smithi101.stdout:gssproxy 922 932 gssproxy root mem REG 8,1 59 48208 /usr/lib/locale/en_US.utf8/LC_TELEPHONE 2023-08-01T20:01:35.091 INFO:teuthology.orchestra.run.smithi101.stdout:gssproxy 922 932 gssproxy root mem REG 8,1 23 48206 /usr/lib/locale/en_US.utf8/LC_MEASUREMENT 2023-08-01T20:01:35.091 INFO:teuthology.orchestra.run.smithi101.stdout:gssproxy 922 932 gssproxy root mem REG 8,1 368 48205 /usr/lib/locale/en_US.utf8/LC_IDENTIFICATION 2023-08-01T20:01:35.092 INFO:teuthology.orchestra.run.smithi101.stdout:gssproxy 922 932 gssproxy root mem REG 8,1 26998 35419 /usr/lib64/gconv/gconv-modules.cache 2023-08-01T20:01:35.092 INFO:teuthology.orchestra.run.smithi101.stdout:gssproxy 922 932 gssproxy root 0r CHR 1,3 0t0 3083 /dev/null 2023-08-01T20:01:35.092 INFO:teuthology.orchestra.run.smithi101.stdout:gssproxy 922 932 gssproxy root 1u unix 0xffff93750d2b8480 0t0 29199 type=STREAM 2023-08-01T20:01:35.092 INFO:teuthology.orchestra.run.smithi101.stdout:gssproxy 922 932 gssproxy root 2u unix 0xffff93750d2b8480 0t0 29199 type=STREAM 2023-08-01T20:01:35.092 INFO:teuthology.orchestra.run.smithi101.stdout:gssproxy 922 932 gssproxy root 3u unix 0xffff93750c981200 0t0 29960 type=DGRAM 2023-08-01T20:01:35.092 INFO:teuthology.orchestra.run.smithi101.stdout:gssproxy 922 932 gssproxy root 4r FIFO 0,13 0t0 29968 pipe 2023-08-01T20:01:35.092 INFO:teuthology.orchestra.run.smithi101.stdout:gssproxy 922 932 gssproxy root 5u a_inode 0,14 0 15587 [eventpoll] 2023-08-01T20:01:35.093 INFO:teuthology.orchestra.run.smithi101.stdout:gssproxy 922 932 gssproxy root 6u a_inode 0,14 0 15587 [eventfd] 2023-08-01T20:01:35.093 INFO:teuthology.orchestra.run.smithi101.stdout:gssproxy 922 932 gssproxy root 7u unix 0xffff93750c980900 0t0 29963 /var/lib/gssproxy/default.sock type=STREAM 2023-08-01T20:01:35.093 INFO:teuthology.orchestra.run.smithi101.stdout:gssproxy 922 932 gssproxy root 8u unix 0xffff93750c983f00 0t0 29964 /run/gssproxy.sock type=STREAM 2023-08-01T20:01:35.093 INFO:teuthology.orchestra.run.smithi101.stdout:gssproxy 922 932 gssproxy root 9w FIFO 0,13 0t0 29968 pipe 2023-08-01T20:01:35.093 INFO:teuthology.orchestra.run.smithi101.stdout:gssproxy 922 933 gssproxy root cwd DIR 8,1 4096 2 / 2023-08-01T20:01:35.093 INFO:teuthology.orchestra.run.smithi101.stdout:gssproxy 922 933 gssproxy root rtd DIR 8,1 4096 2 / 2023-08-01T20:01:35.093 INFO:teuthology.orchestra.run.smithi101.stdout:gssproxy 922 933 gssproxy root txt REG 8,1 135248 31338 /usr/sbin/gssproxy 2023-08-01T20:01:35.093 INFO:teuthology.orchestra.run.smithi101.stdout:gssproxy 922 933 gssproxy root mem REG 8,1 1598840 24700 /usr/lib64/libm-2.28.so 2023-08-01T20:01:35.094 INFO:teuthology.orchestra.run.smithi101.stdout:gssproxy 922 933 gssproxy root mem REG 8,1 69752 23675 /usr/lib64/libev.so.4.0.0 2023-08-01T20:01:35.094 INFO:teuthology.orchestra.run.smithi101.stdout:gssproxy 922 933 gssproxy root mem REG 8,1 12112 31337 /usr/lib64/libverto-libev.so.1.0.0 2023-08-01T20:01:35.094 INFO:teuthology.orchestra.run.smithi101.stdout:gssproxy 922 933 gssproxy root mem REG 8,1 2586930 39433 /usr/lib/locale/en_US.utf8/LC_COLLATE 2023-08-01T20:01:35.094 INFO:teuthology.orchestra.run.smithi101.stdout:gssproxy 922 933 gssproxy root mem REG 8,1 99640 24762 /usr/lib64/libz.so.1.2.11 2023-08-01T20:01:35.094 INFO:teuthology.orchestra.run.smithi101.stdout:gssproxy 922 933 gssproxy root mem REG 8,1 543304 24651 /usr/lib64/libpcre2-8.so.0.7.1 2023-08-01T20:01:35.094 INFO:teuthology.orchestra.run.smithi101.stdout:gssproxy 922 933 gssproxy root mem REG 8,1 16096 25517 /usr/lib64/libpath_utils.so.1.0.1 2023-08-01T20:01:35.094 INFO:teuthology.orchestra.run.smithi101.stdout:gssproxy 922 933 gssproxy root mem REG 8,1 19128 24699 /usr/lib64/libdl-2.28.so 2023-08-01T20:01:35.094 INFO:teuthology.orchestra.run.smithi101.stdout:gssproxy 922 933 gssproxy root mem REG 8,1 92968 24709 /usr/lib64/libresolv-2.28.so 2023-08-01T20:01:35.095 INFO:teuthology.orchestra.run.smithi101.stdout:gssproxy 922 933 gssproxy root mem REG 8,1 3083608 26861 /usr/lib64/libcrypto.so.1.1.1k 2023-08-01T20:01:35.095 INFO:teuthology.orchestra.run.smithi101.stdout:gssproxy 922 933 gssproxy root mem REG 8,1 16192 25072 /usr/lib64/libkeyutils.so.1.6 2023-08-01T20:01:35.095 INFO:teuthology.orchestra.run.smithi101.stdout:gssproxy 922 933 gssproxy root mem REG 8,1 71472 26580 /usr/lib64/libkrb5support.so.0.1 2023-08-01T20:01:35.095 INFO:teuthology.orchestra.run.smithi101.stdout:gssproxy 922 933 gssproxy root mem REG 8,1 2089984 24698 /usr/lib64/libc-2.28.so 2023-08-01T20:01:35.095 INFO:teuthology.orchestra.run.smithi101.stdout:gssproxy 922 933 gssproxy root mem REG 8,1 149984 24708 /usr/lib64/libpthread-2.28.so 2023-08-01T20:01:35.095 INFO:teuthology.orchestra.run.smithi101.stdout:gssproxy 922 933 gssproxy root mem REG 8,1 355968 26571 /usr/lib64/libgssapi_krb5.so.2.2 2023-08-01T20:01:35.095 INFO:teuthology.orchestra.run.smithi101.stdout:gssproxy 922 933 gssproxy root mem REG 8,1 138824 26572 /usr/lib64/libgssrpc.so.4.2 2023-08-01T20:01:35.095 INFO:teuthology.orchestra.run.smithi101.stdout:gssproxy 922 933 gssproxy root mem REG 8,1 172104 24654 /usr/lib64/libselinux.so.1 2023-08-01T20:01:35.096 INFO:teuthology.orchestra.run.smithi101.stdout:gssproxy 922 933 gssproxy root mem REG 8,1 53968 24810 /usr/lib64/libcollection.so.4.1.1 2023-08-01T20:01:35.096 INFO:teuthology.orchestra.run.smithi101.stdout:gssproxy 922 933 gssproxy root mem REG 8,1 11976 24814 /usr/lib64/libref_array.so.1.2.1 2023-08-01T20:01:35.096 INFO:teuthology.orchestra.run.smithi101.stdout:gssproxy 922 933 gssproxy root mem REG 8,1 11800 24808 /usr/lib64/libbasicobjects.so.0.1.0 2023-08-01T20:01:35.096 INFO:teuthology.orchestra.run.smithi101.stdout:gssproxy 922 933 gssproxy root mem REG 8,1 112088 25519 /usr/lib64/libini_config.so.5.2.1 2023-08-01T20:01:35.096 INFO:teuthology.orchestra.run.smithi101.stdout:gssproxy 922 933 gssproxy root mem REG 8,1 24952 26146 /usr/lib64/libverto.so.1.0.0 2023-08-01T20:01:35.096 INFO:teuthology.orchestra.run.smithi101.stdout:gssproxy 922 933 gssproxy root mem REG 8,1 16792 24764 /usr/lib64/libcom_err.so.2.1 2023-08-01T20:01:35.096 INFO:teuthology.orchestra.run.smithi101.stdout:gssproxy 922 933 gssproxy root mem REG 8,1 96288 26574 /usr/lib64/libk5crypto.so.3.1 2023-08-01T20:01:35.096 INFO:teuthology.orchestra.run.smithi101.stdout:gssproxy 922 933 gssproxy root mem REG 8,1 971432 26579 /usr/lib64/libkrb5.so.3.3 2023-08-01T20:01:35.097 INFO:teuthology.orchestra.run.smithi101.stdout:gssproxy 922 933 gssproxy root mem REG 8,1 54688 24835 /usr/lib64/libpopt.so.0.0.1 2023-08-01T20:01:35.097 INFO:teuthology.orchestra.run.smithi101.stdout:gssproxy 922 933 gssproxy root mem REG 8,1 1062168 24653 /usr/lib64/ld-2.28.so 2023-08-01T20:01:35.097 INFO:teuthology.orchestra.run.smithi101.stdout:gssproxy 922 933 gssproxy root mem REG 8,1 337024 45489 /usr/lib/locale/C.utf8/LC_CTYPE 2023-08-01T20:01:35.097 INFO:teuthology.orchestra.run.smithi101.stdout:gssproxy 922 933 gssproxy root mem REG 8,1 54 44174 /usr/lib/locale/en_US.utf8/LC_NUMERIC 2023-08-01T20:01:35.097 INFO:teuthology.orchestra.run.smithi101.stdout:gssproxy 922 933 gssproxy root mem REG 8,1 3316 48200 /usr/lib/locale/en_US.utf8/LC_TIME 2023-08-01T20:01:35.097 INFO:teuthology.orchestra.run.smithi101.stdout:gssproxy 922 933 gssproxy root mem REG 8,1 286 48207 /usr/lib/locale/en_US.utf8/LC_MONETARY 2023-08-01T20:01:35.097 INFO:teuthology.orchestra.run.smithi101.stdout:gssproxy 922 933 gssproxy root mem REG 8,1 57 39434 /usr/lib/locale/en_US.utf8/LC_MESSAGES/SYS_LC_MESSAGES 2023-08-01T20:01:35.097 INFO:teuthology.orchestra.run.smithi101.stdout:gssproxy 922 933 gssproxy root mem REG 8,1 34 39448 /usr/lib/locale/en_US.utf8/LC_PAPER 2023-08-01T20:01:35.098 INFO:teuthology.orchestra.run.smithi101.stdout:gssproxy 922 933 gssproxy root mem REG 8,1 77 44173 /usr/lib/locale/en_US.utf8/LC_NAME 2023-08-01T20:01:35.098 INFO:teuthology.orchestra.run.smithi101.stdout:gssproxy 922 933 gssproxy root mem REG 8,1 167 45462 /usr/lib/locale/en_US.utf8/LC_ADDRESS 2023-08-01T20:01:35.098 INFO:teuthology.orchestra.run.smithi101.stdout:gssproxy 922 933 gssproxy root mem REG 8,1 59 48208 /usr/lib/locale/en_US.utf8/LC_TELEPHONE 2023-08-01T20:01:35.098 INFO:teuthology.orchestra.run.smithi101.stdout:gssproxy 922 933 gssproxy root mem REG 8,1 23 48206 /usr/lib/locale/en_US.utf8/LC_MEASUREMENT 2023-08-01T20:01:35.098 INFO:teuthology.orchestra.run.smithi101.stdout:gssproxy 922 933 gssproxy root mem REG 8,1 368 48205 /usr/lib/locale/en_US.utf8/LC_IDENTIFICATION 2023-08-01T20:01:35.098 INFO:teuthology.orchestra.run.smithi101.stdout:gssproxy 922 933 gssproxy root mem REG 8,1 26998 35419 /usr/lib64/gconv/gconv-modules.cache 2023-08-01T20:01:35.098 INFO:teuthology.orchestra.run.smithi101.stdout:gssproxy 922 933 gssproxy root 0r CHR 1,3 0t0 3083 /dev/null 2023-08-01T20:01:35.098 INFO:teuthology.orchestra.run.smithi101.stdout:gssproxy 922 933 gssproxy root 1u unix 0xffff93750d2b8480 0t0 29199 type=STREAM 2023-08-01T20:01:35.099 INFO:teuthology.orchestra.run.smithi101.stdout:gssproxy 922 933 gssproxy root 2u unix 0xffff93750d2b8480 0t0 29199 type=STREAM 2023-08-01T20:01:35.099 INFO:teuthology.orchestra.run.smithi101.stdout:gssproxy 922 933 gssproxy root 3u unix 0xffff93750c981200 0t0 29960 type=DGRAM 2023-08-01T20:01:35.099 INFO:teuthology.orchestra.run.smithi101.stdout:gssproxy 922 933 gssproxy root 4r FIFO 0,13 0t0 29968 pipe 2023-08-01T20:01:35.099 INFO:teuthology.orchestra.run.smithi101.stdout:gssproxy 922 933 gssproxy root 5u a_inode 0,14 0 15587 [eventpoll] 2023-08-01T20:01:35.099 INFO:teuthology.orchestra.run.smithi101.stdout:gssproxy 922 933 gssproxy root 6u a_inode 0,14 0 15587 [eventfd] 2023-08-01T20:01:35.099 INFO:teuthology.orchestra.run.smithi101.stdout:gssproxy 922 933 gssproxy root 7u unix 0xffff93750c980900 0t0 29963 /var/lib/gssproxy/default.sock type=STREAM 2023-08-01T20:01:35.099 INFO:teuthology.orchestra.run.smithi101.stdout:gssproxy 922 933 gssproxy root 8u unix 0xffff93750c983f00 0t0 29964 /run/gssproxy.sock type=STREAM 2023-08-01T20:01:35.099 INFO:teuthology.orchestra.run.smithi101.stdout:gssproxy 922 933 gssproxy root 9w FIFO 0,13 0t0 29968 pipe 2023-08-01T20:01:35.100 INFO:teuthology.orchestra.run.smithi101.stdout:gssproxy 922 934 gssproxy root cwd DIR 8,1 4096 2 / 2023-08-01T20:01:35.100 INFO:teuthology.orchestra.run.smithi101.stdout:gssproxy 922 934 gssproxy root rtd DIR 8,1 4096 2 / 2023-08-01T20:01:35.100 INFO:teuthology.orchestra.run.smithi101.stdout:gssproxy 922 934 gssproxy root txt REG 8,1 135248 31338 /usr/sbin/gssproxy 2023-08-01T20:01:35.100 INFO:teuthology.orchestra.run.smithi101.stdout:gssproxy 922 934 gssproxy root mem REG 8,1 1598840 24700 /usr/lib64/libm-2.28.so 2023-08-01T20:01:35.100 INFO:teuthology.orchestra.run.smithi101.stdout:gssproxy 922 934 gssproxy root mem REG 8,1 69752 23675 /usr/lib64/libev.so.4.0.0 2023-08-01T20:01:35.100 INFO:teuthology.orchestra.run.smithi101.stdout:gssproxy 922 934 gssproxy root mem REG 8,1 12112 31337 /usr/lib64/libverto-libev.so.1.0.0 2023-08-01T20:01:35.100 INFO:teuthology.orchestra.run.smithi101.stdout:gssproxy 922 934 gssproxy root mem REG 8,1 2586930 39433 /usr/lib/locale/en_US.utf8/LC_COLLATE 2023-08-01T20:01:35.101 INFO:teuthology.orchestra.run.smithi101.stdout:gssproxy 922 934 gssproxy root mem REG 8,1 99640 24762 /usr/lib64/libz.so.1.2.11 2023-08-01T20:01:35.101 INFO:teuthology.orchestra.run.smithi101.stdout:gssproxy 922 934 gssproxy root mem REG 8,1 543304 24651 /usr/lib64/libpcre2-8.so.0.7.1 2023-08-01T20:01:35.101 INFO:teuthology.orchestra.run.smithi101.stdout:gssproxy 922 934 gssproxy root mem REG 8,1 16096 25517 /usr/lib64/libpath_utils.so.1.0.1 2023-08-01T20:01:35.101 INFO:teuthology.orchestra.run.smithi101.stdout:gssproxy 922 934 gssproxy root mem REG 8,1 19128 24699 /usr/lib64/libdl-2.28.so 2023-08-01T20:01:35.101 INFO:teuthology.orchestra.run.smithi101.stdout:gssproxy 922 934 gssproxy root mem REG 8,1 92968 24709 /usr/lib64/libresolv-2.28.so 2023-08-01T20:01:35.101 INFO:teuthology.orchestra.run.smithi101.stdout:gssproxy 922 934 gssproxy root mem REG 8,1 3083608 26861 /usr/lib64/libcrypto.so.1.1.1k 2023-08-01T20:01:35.101 INFO:teuthology.orchestra.run.smithi101.stdout:gssproxy 922 934 gssproxy root mem REG 8,1 16192 25072 /usr/lib64/libkeyutils.so.1.6 2023-08-01T20:01:35.101 INFO:teuthology.orchestra.run.smithi101.stdout:gssproxy 922 934 gssproxy root mem REG 8,1 71472 26580 /usr/lib64/libkrb5support.so.0.1 2023-08-01T20:01:35.102 INFO:teuthology.orchestra.run.smithi101.stdout:gssproxy 922 934 gssproxy root mem REG 8,1 2089984 24698 /usr/lib64/libc-2.28.so 2023-08-01T20:01:35.102 INFO:teuthology.orchestra.run.smithi101.stdout:gssproxy 922 934 gssproxy root mem REG 8,1 149984 24708 /usr/lib64/libpthread-2.28.so 2023-08-01T20:01:35.102 INFO:teuthology.orchestra.run.smithi101.stdout:gssproxy 922 934 gssproxy root mem REG 8,1 355968 26571 /usr/lib64/libgssapi_krb5.so.2.2 2023-08-01T20:01:35.102 INFO:teuthology.orchestra.run.smithi101.stdout:gssproxy 922 934 gssproxy root mem REG 8,1 138824 26572 /usr/lib64/libgssrpc.so.4.2 2023-08-01T20:01:35.102 INFO:teuthology.orchestra.run.smithi101.stdout:gssproxy 922 934 gssproxy root mem REG 8,1 172104 24654 /usr/lib64/libselinux.so.1 2023-08-01T20:01:35.102 INFO:teuthology.orchestra.run.smithi101.stdout:gssproxy 922 934 gssproxy root mem REG 8,1 53968 24810 /usr/lib64/libcollection.so.4.1.1 2023-08-01T20:01:35.102 INFO:teuthology.orchestra.run.smithi101.stdout:gssproxy 922 934 gssproxy root mem REG 8,1 11976 24814 /usr/lib64/libref_array.so.1.2.1 2023-08-01T20:01:35.102 INFO:teuthology.orchestra.run.smithi101.stdout:gssproxy 922 934 gssproxy root mem REG 8,1 11800 24808 /usr/lib64/libbasicobjects.so.0.1.0 2023-08-01T20:01:35.103 INFO:teuthology.orchestra.run.smithi101.stdout:gssproxy 922 934 gssproxy root mem REG 8,1 112088 25519 /usr/lib64/libini_config.so.5.2.1 2023-08-01T20:01:35.103 INFO:teuthology.orchestra.run.smithi101.stdout:gssproxy 922 934 gssproxy root mem REG 8,1 24952 26146 /usr/lib64/libverto.so.1.0.0 2023-08-01T20:01:35.103 INFO:teuthology.orchestra.run.smithi101.stdout:gssproxy 922 934 gssproxy root mem REG 8,1 16792 24764 /usr/lib64/libcom_err.so.2.1 2023-08-01T20:01:35.103 INFO:teuthology.orchestra.run.smithi101.stdout:gssproxy 922 934 gssproxy root mem REG 8,1 96288 26574 /usr/lib64/libk5crypto.so.3.1 2023-08-01T20:01:35.103 INFO:teuthology.orchestra.run.smithi101.stdout:gssproxy 922 934 gssproxy root mem REG 8,1 971432 26579 /usr/lib64/libkrb5.so.3.3 2023-08-01T20:01:35.103 INFO:teuthology.orchestra.run.smithi101.stdout:gssproxy 922 934 gssproxy root mem REG 8,1 54688 24835 /usr/lib64/libpopt.so.0.0.1 2023-08-01T20:01:35.103 INFO:teuthology.orchestra.run.smithi101.stdout:gssproxy 922 934 gssproxy root mem REG 8,1 1062168 24653 /usr/lib64/ld-2.28.so 2023-08-01T20:01:35.103 INFO:teuthology.orchestra.run.smithi101.stdout:gssproxy 922 934 gssproxy root mem REG 8,1 337024 45489 /usr/lib/locale/C.utf8/LC_CTYPE 2023-08-01T20:01:35.104 INFO:teuthology.orchestra.run.smithi101.stdout:gssproxy 922 934 gssproxy root mem REG 8,1 54 44174 /usr/lib/locale/en_US.utf8/LC_NUMERIC 2023-08-01T20:01:35.104 INFO:teuthology.orchestra.run.smithi101.stdout:gssproxy 922 934 gssproxy root mem REG 8,1 3316 48200 /usr/lib/locale/en_US.utf8/LC_TIME 2023-08-01T20:01:35.104 INFO:teuthology.orchestra.run.smithi101.stdout:gssproxy 922 934 gssproxy root mem REG 8,1 286 48207 /usr/lib/locale/en_US.utf8/LC_MONETARY 2023-08-01T20:01:35.104 INFO:teuthology.orchestra.run.smithi101.stdout:gssproxy 922 934 gssproxy root mem REG 8,1 57 39434 /usr/lib/locale/en_US.utf8/LC_MESSAGES/SYS_LC_MESSAGES 2023-08-01T20:01:35.104 INFO:teuthology.orchestra.run.smithi101.stdout:gssproxy 922 934 gssproxy root mem REG 8,1 34 39448 /usr/lib/locale/en_US.utf8/LC_PAPER 2023-08-01T20:01:35.104 INFO:teuthology.orchestra.run.smithi101.stdout:gssproxy 922 934 gssproxy root mem REG 8,1 77 44173 /usr/lib/locale/en_US.utf8/LC_NAME 2023-08-01T20:01:35.104 INFO:teuthology.orchestra.run.smithi101.stdout:gssproxy 922 934 gssproxy root mem REG 8,1 167 45462 /usr/lib/locale/en_US.utf8/LC_ADDRESS 2023-08-01T20:01:35.104 INFO:teuthology.orchestra.run.smithi101.stdout:gssproxy 922 934 gssproxy root mem REG 8,1 59 48208 /usr/lib/locale/en_US.utf8/LC_TELEPHONE 2023-08-01T20:01:35.105 INFO:teuthology.orchestra.run.smithi101.stdout:gssproxy 922 934 gssproxy root mem REG 8,1 23 48206 /usr/lib/locale/en_US.utf8/LC_MEASUREMENT 2023-08-01T20:01:35.105 INFO:teuthology.orchestra.run.smithi101.stdout:gssproxy 922 934 gssproxy root mem REG 8,1 368 48205 /usr/lib/locale/en_US.utf8/LC_IDENTIFICATION 2023-08-01T20:01:35.105 INFO:teuthology.orchestra.run.smithi101.stdout:gssproxy 922 934 gssproxy root mem REG 8,1 26998 35419 /usr/lib64/gconv/gconv-modules.cache 2023-08-01T20:01:35.105 INFO:teuthology.orchestra.run.smithi101.stdout:gssproxy 922 934 gssproxy root 0r CHR 1,3 0t0 3083 /dev/null 2023-08-01T20:01:35.105 INFO:teuthology.orchestra.run.smithi101.stdout:gssproxy 922 934 gssproxy root 1u unix 0xffff93750d2b8480 0t0 29199 type=STREAM 2023-08-01T20:01:35.105 INFO:teuthology.orchestra.run.smithi101.stdout:gssproxy 922 934 gssproxy root 2u unix 0xffff93750d2b8480 0t0 29199 type=STREAM 2023-08-01T20:01:35.105 INFO:teuthology.orchestra.run.smithi101.stdout:gssproxy 922 934 gssproxy root 3u unix 0xffff93750c981200 0t0 29960 type=DGRAM 2023-08-01T20:01:35.105 INFO:teuthology.orchestra.run.smithi101.stdout:gssproxy 922 934 gssproxy root 4r FIFO 0,13 0t0 29968 pipe 2023-08-01T20:01:35.106 INFO:teuthology.orchestra.run.smithi101.stdout:gssproxy 922 934 gssproxy root 5u a_inode 0,14 0 15587 [eventpoll] 2023-08-01T20:01:35.106 INFO:teuthology.orchestra.run.smithi101.stdout:gssproxy 922 934 gssproxy root 6u a_inode 0,14 0 15587 [eventfd] 2023-08-01T20:01:35.106 INFO:teuthology.orchestra.run.smithi101.stdout:gssproxy 922 934 gssproxy root 7u unix 0xffff93750c980900 0t0 29963 /var/lib/gssproxy/default.sock type=STREAM 2023-08-01T20:01:35.106 INFO:teuthology.orchestra.run.smithi101.stdout:gssproxy 922 934 gssproxy root 8u unix 0xffff93750c983f00 0t0 29964 /run/gssproxy.sock type=STREAM 2023-08-01T20:01:35.106 INFO:teuthology.orchestra.run.smithi101.stdout:gssproxy 922 934 gssproxy root 9w FIFO 0,13 0t0 29968 pipe 2023-08-01T20:01:35.106 INFO:teuthology.orchestra.run.smithi101.stdout:atd 938 root cwd DIR 8,1 4096 18406 /var/spool/at 2023-08-01T20:01:35.106 INFO:teuthology.orchestra.run.smithi101.stdout:atd 938 root rtd DIR 8,1 4096 2 / 2023-08-01T20:01:35.106 INFO:teuthology.orchestra.run.smithi101.stdout:atd 938 root txt REG 8,1 33408 28662 /usr/sbin/atd 2023-08-01T20:01:35.107 INFO:teuthology.orchestra.run.smithi101.stdout:atd 938 root mem REG 8,1 54352 24707 /usr/lib64/libnss_files-2.28.so 2023-08-01T20:01:35.107 INFO:teuthology.orchestra.run.smithi101.stdout:atd 938 root mem REG 8,1 24928 25065 /usr/lib64/libcap-ng.so.0.0.0 2023-08-01T20:01:35.107 INFO:teuthology.orchestra.run.smithi101.stdout:atd 938 root mem REG 8,1 543304 24651 /usr/lib64/libpcre2-8.so.0.7.1 2023-08-01T20:01:35.107 INFO:teuthology.orchestra.run.smithi101.stdout:atd 938 root mem REG 8,1 19128 24699 /usr/lib64/libdl-2.28.so 2023-08-01T20:01:35.107 INFO:teuthology.orchestra.run.smithi101.stdout:atd 938 root mem REG 8,1 135784 24768 /usr/lib64/libaudit.so.1.0.0 2023-08-01T20:01:35.107 INFO:teuthology.orchestra.run.smithi101.stdout:atd 938 root mem REG 8,1 149984 24708 /usr/lib64/libpthread-2.28.so 2023-08-01T20:01:35.107 INFO:teuthology.orchestra.run.smithi101.stdout:atd 938 root mem REG 8,1 2089984 24698 /usr/lib64/libc-2.28.so 2023-08-01T20:01:35.107 INFO:teuthology.orchestra.run.smithi101.stdout:atd 938 root mem REG 8,1 172104 24654 /usr/lib64/libselinux.so.1 2023-08-01T20:01:35.108 INFO:teuthology.orchestra.run.smithi101.stdout:atd 938 root mem REG 8,1 16608 27021 /usr/lib64/libpam_misc.so.0.82.1 2023-08-01T20:01:35.108 INFO:teuthology.orchestra.run.smithi101.stdout:atd 938 root mem REG 8,1 66504 27020 /usr/lib64/libpam.so.0.84.2 2023-08-01T20:01:35.108 INFO:teuthology.orchestra.run.smithi101.stdout:atd 938 root mem REG 8,1 42744 24710 /usr/lib64/librt-2.28.so 2023-08-01T20:01:35.108 INFO:teuthology.orchestra.run.smithi101.stdout:atd 938 root mem REG 8,1 1062168 24653 /usr/lib64/ld-2.28.so 2023-08-01T20:01:35.108 INFO:teuthology.orchestra.run.smithi101.stdout:atd 938 root 0u CHR 1,3 0t0 3083 /dev/null 2023-08-01T20:01:35.108 INFO:teuthology.orchestra.run.smithi101.stdout:atd 938 root 1u CHR 1,3 0t0 3083 /dev/null 2023-08-01T20:01:35.108 INFO:teuthology.orchestra.run.smithi101.stdout:atd 938 root 2u CHR 1,3 0t0 3083 /dev/null 2023-08-01T20:01:35.109 INFO:teuthology.orchestra.run.smithi101.stdout:atd 938 root 3uW REG 0,24 4 22244 /run/atd.pid 2023-08-01T20:01:35.109 INFO:teuthology.orchestra.run.smithi101.stdout:crond 939 root cwd DIR 8,1 4096 2 / 2023-08-01T20:01:35.109 INFO:teuthology.orchestra.run.smithi101.stdout:crond 939 root rtd DIR 8,1 4096 2 / 2023-08-01T20:01:35.109 INFO:teuthology.orchestra.run.smithi101.stdout:crond 939 root txt REG 8,1 75712 27715 /usr/sbin/crond 2023-08-01T20:01:35.109 INFO:teuthology.orchestra.run.smithi101.stdout:crond 939 root mem REG 8,1 54352 24707 /usr/lib64/libnss_files-2.28.so 2023-08-01T20:01:35.109 INFO:teuthology.orchestra.run.smithi101.stdout:crond 939 root mem REG 8,1 2586930 39433 /usr/lib/locale/en_US.utf8/LC_COLLATE 2023-08-01T20:01:35.109 INFO:teuthology.orchestra.run.smithi101.stdout:crond 939 root mem REG 8,1 149984 24708 /usr/lib64/libpthread-2.28.so 2023-08-01T20:01:35.109 INFO:teuthology.orchestra.run.smithi101.stdout:crond 939 root mem REG 8,1 24928 25065 /usr/lib64/libcap-ng.so.0.0.0 2023-08-01T20:01:35.110 INFO:teuthology.orchestra.run.smithi101.stdout:crond 939 root mem REG 8,1 543304 24651 /usr/lib64/libpcre2-8.so.0.7.1 2023-08-01T20:01:35.110 INFO:teuthology.orchestra.run.smithi101.stdout:crond 939 root mem REG 8,1 2089984 24698 /usr/lib64/libc-2.28.so 2023-08-01T20:01:35.110 INFO:teuthology.orchestra.run.smithi101.stdout:crond 939 root mem REG 8,1 135784 24768 /usr/lib64/libaudit.so.1.0.0 2023-08-01T20:01:35.110 INFO:teuthology.orchestra.run.smithi101.stdout:crond 939 root mem REG 8,1 19128 24699 /usr/lib64/libdl-2.28.so 2023-08-01T20:01:35.110 INFO:teuthology.orchestra.run.smithi101.stdout:crond 939 root mem REG 8,1 66504 27020 /usr/lib64/libpam.so.0.84.2 2023-08-01T20:01:35.110 INFO:teuthology.orchestra.run.smithi101.stdout:crond 939 root mem REG 8,1 172104 24654 /usr/lib64/libselinux.so.1 2023-08-01T20:01:35.110 INFO:teuthology.orchestra.run.smithi101.stdout:crond 939 root mem REG 8,1 1062168 24653 /usr/lib64/ld-2.28.so 2023-08-01T20:01:35.110 INFO:teuthology.orchestra.run.smithi101.stdout:crond 939 root mem REG 8,1 337024 45489 /usr/lib/locale/C.utf8/LC_CTYPE 2023-08-01T20:01:35.111 INFO:teuthology.orchestra.run.smithi101.stdout:crond 939 root mem REG 8,1 54 44174 /usr/lib/locale/en_US.utf8/LC_NUMERIC 2023-08-01T20:01:35.111 INFO:teuthology.orchestra.run.smithi101.stdout:crond 939 root mem REG 8,1 3316 48200 /usr/lib/locale/en_US.utf8/LC_TIME 2023-08-01T20:01:35.111 INFO:teuthology.orchestra.run.smithi101.stdout:crond 939 root mem REG 8,1 286 48207 /usr/lib/locale/en_US.utf8/LC_MONETARY 2023-08-01T20:01:35.111 INFO:teuthology.orchestra.run.smithi101.stdout:crond 939 root mem REG 8,1 26998 35419 /usr/lib64/gconv/gconv-modules.cache 2023-08-01T20:01:35.111 INFO:teuthology.orchestra.run.smithi101.stdout:crond 939 root mem REG 8,1 57 39434 /usr/lib/locale/en_US.utf8/LC_MESSAGES/SYS_LC_MESSAGES 2023-08-01T20:01:35.111 INFO:teuthology.orchestra.run.smithi101.stdout:crond 939 root mem REG 8,1 34 39448 /usr/lib/locale/en_US.utf8/LC_PAPER 2023-08-01T20:01:35.111 INFO:teuthology.orchestra.run.smithi101.stdout:crond 939 root mem REG 8,1 77 44173 /usr/lib/locale/en_US.utf8/LC_NAME 2023-08-01T20:01:35.111 INFO:teuthology.orchestra.run.smithi101.stdout:crond 939 root mem REG 8,1 167 45462 /usr/lib/locale/en_US.utf8/LC_ADDRESS 2023-08-01T20:01:35.112 INFO:teuthology.orchestra.run.smithi101.stdout:crond 939 root mem REG 8,1 59 48208 /usr/lib/locale/en_US.utf8/LC_TELEPHONE 2023-08-01T20:01:35.112 INFO:teuthology.orchestra.run.smithi101.stdout:crond 939 root mem REG 8,1 23 48206 /usr/lib/locale/en_US.utf8/LC_MEASUREMENT 2023-08-01T20:01:35.112 INFO:teuthology.orchestra.run.smithi101.stdout:crond 939 root mem REG 8,1 368 48205 /usr/lib/locale/en_US.utf8/LC_IDENTIFICATION 2023-08-01T20:01:35.112 INFO:teuthology.orchestra.run.smithi101.stdout:crond 939 root 0r CHR 1,3 0t0 3083 /dev/null 2023-08-01T20:01:35.112 INFO:teuthology.orchestra.run.smithi101.stdout:crond 939 root 1u unix 0xffff93750c997080 0t0 22233 type=STREAM 2023-08-01T20:01:35.112 INFO:teuthology.orchestra.run.smithi101.stdout:crond 939 root 2u unix 0xffff93750c997080 0t0 22233 type=STREAM 2023-08-01T20:01:35.112 INFO:teuthology.orchestra.run.smithi101.stdout:crond 939 root 3uW REG 0,24 4 22234 /run/crond.pid 2023-08-01T20:01:35.112 INFO:teuthology.orchestra.run.smithi101.stdout:crond 939 root 4u unix 0xffff93750c993a80 0t0 22235 type=DGRAM 2023-08-01T20:01:35.113 INFO:teuthology.orchestra.run.smithi101.stdout:crond 939 root 5r a_inode 0,14 0 15587 inotify 2023-08-01T20:01:35.113 INFO:teuthology.orchestra.run.smithi101.stdout:rsyslogd 1243 root cwd DIR 8,1 4096 2 / 2023-08-01T20:01:35.113 INFO:teuthology.orchestra.run.smithi101.stdout:rsyslogd 1243 root rtd DIR 8,1 4096 2 / 2023-08-01T20:01:35.113 INFO:teuthology.orchestra.run.smithi101.stdout:rsyslogd 1243 root txt REG 8,1 742192 27861 /usr/sbin/rsyslogd 2023-08-01T20:01:35.113 INFO:teuthology.orchestra.run.smithi101.stdout:rsyslogd 1243 root mem REG 0,24 8388608 2129 /run/log/journal/a1b29d6c289747bdb22930598d39874a/system.journal 2023-08-01T20:01:35.113 INFO:teuthology.orchestra.run.smithi101.stdout:rsyslogd 1243 root mem REG 8,1 34272 27831 /usr/lib64/rsyslog/imjournal.so 2023-08-01T20:01:35.113 INFO:teuthology.orchestra.run.smithi101.stdout:rsyslogd 1243 root mem REG 8,1 38864 27838 /usr/lib64/rsyslog/imuxsock.so 2023-08-01T20:01:35.113 INFO:teuthology.orchestra.run.smithi101.stdout:rsyslogd 1243 root mem REG 8,1 54352 24707 /usr/lib64/libnss_files-2.28.so 2023-08-01T20:01:35.114 INFO:teuthology.orchestra.run.smithi101.stdout:rsyslogd 1243 root mem REG 8,1 29408 31775 /usr/lib64/rsyslog/lmnet.so 2023-08-01T20:01:35.114 INFO:teuthology.orchestra.run.smithi101.stdout:rsyslogd 1243 root mem REG 8,1 543304 24651 /usr/lib64/libpcre2-8.so.0.7.1 2023-08-01T20:01:35.114 INFO:teuthology.orchestra.run.smithi101.stdout:rsyslogd 1243 root mem REG 8,1 145984 24905 /usr/lib64/libgpg-error.so.0.24.2 2023-08-01T20:01:35.114 INFO:teuthology.orchestra.run.smithi101.stdout:rsyslogd 1243 root mem REG 8,1 172104 24654 /usr/lib64/libselinux.so.1 2023-08-01T20:01:35.114 INFO:teuthology.orchestra.run.smithi101.stdout:rsyslogd 1243 root mem REG 8,1 343680 19531 /usr/lib64/libblkid.so.1.1.0 2023-08-01T20:01:35.114 INFO:teuthology.orchestra.run.smithi101.stdout:rsyslogd 1243 root mem REG 8,1 1187312 25078 /usr/lib64/libgcrypt.so.20.2.5 2023-08-01T20:01:35.114 INFO:teuthology.orchestra.run.smithi101.stdout:rsyslogd 1243 root mem REG 8,1 371480 19864 /usr/lib64/libmount.so.1.1.0 2023-08-01T20:01:35.114 INFO:teuthology.orchestra.run.smithi101.stdout:rsyslogd 1243 root mem REG 8,1 33752 24776 /usr/lib64/libcap.so.2.48 2023-08-01T20:01:35.115 INFO:teuthology.orchestra.run.smithi101.stdout:rsyslogd 1243 root mem REG 8,1 119760 25264 /usr/lib64/liblz4.so.1.8.3 2023-08-01T20:01:35.115 INFO:teuthology.orchestra.run.smithi101.stdout:rsyslogd 1243 root mem REG 8,1 162192 24774 /usr/lib64/liblzma.so.5.2.4 2023-08-01T20:01:35.115 INFO:teuthology.orchestra.run.smithi101.stdout:rsyslogd 1243 root mem REG 8,1 2089984 24698 /usr/lib64/libc-2.28.so 2023-08-01T20:01:35.115 INFO:teuthology.orchestra.run.smithi101.stdout:rsyslogd 1243 root mem REG 8,1 99672 31445 /usr/lib64/libgcc_s-8-20210514.so.1 2023-08-01T20:01:35.115 INFO:teuthology.orchestra.run.smithi101.stdout:rsyslogd 1243 root mem REG 8,1 33480 19526 /usr/lib64/libuuid.so.1.3.0 2023-08-01T20:01:35.115 INFO:teuthology.orchestra.run.smithi101.stdout:rsyslogd 1243 root mem REG 8,1 1387784 26786 /usr/lib64/libsystemd.so.0.23.0 2023-08-01T20:01:35.115 INFO:teuthology.orchestra.run.smithi101.stdout:rsyslogd 1243 root mem REG 8,1 50392 26258 /usr/lib64/libfastjson.so.4.3.0 2023-08-01T20:01:35.115 INFO:teuthology.orchestra.run.smithi101.stdout:rsyslogd 1243 root mem REG 8,1 16544 26255 /usr/lib64/libestr.so.0.0.0 2023-08-01T20:01:35.116 INFO:teuthology.orchestra.run.smithi101.stdout:rsyslogd 1243 root mem REG 8,1 42744 24710 /usr/lib64/librt-2.28.so 2023-08-01T20:01:35.116 INFO:teuthology.orchestra.run.smithi101.stdout:rsyslogd 1243 root mem REG 8,1 19128 24699 /usr/lib64/libdl-2.28.so 2023-08-01T20:01:35.116 INFO:teuthology.orchestra.run.smithi101.stdout:rsyslogd 1243 root mem REG 8,1 149984 24708 /usr/lib64/libpthread-2.28.so 2023-08-01T20:01:35.116 INFO:teuthology.orchestra.run.smithi101.stdout:rsyslogd 1243 root mem REG 8,1 99640 24762 /usr/lib64/libz.so.1.2.11 2023-08-01T20:01:35.116 INFO:teuthology.orchestra.run.smithi101.stdout:rsyslogd 1243 root mem REG 8,1 1062168 24653 /usr/lib64/ld-2.28.so 2023-08-01T20:01:35.116 INFO:teuthology.orchestra.run.smithi101.stdout:rsyslogd 1243 root 0r CHR 1,3 0t0 3083 /dev/null 2023-08-01T20:01:35.116 INFO:teuthology.orchestra.run.smithi101.stdout:rsyslogd 1243 root 1w CHR 1,3 0t0 3083 /dev/null 2023-08-01T20:01:35.117 INFO:teuthology.orchestra.run.smithi101.stdout:rsyslogd 1243 root 2w CHR 1,3 0t0 3083 /dev/null 2023-08-01T20:01:35.117 INFO:teuthology.orchestra.run.smithi101.stdout:rsyslogd 1243 root 3r CHR 1,9 0t0 3088 /dev/urandom 2023-08-01T20:01:35.117 INFO:teuthology.orchestra.run.smithi101.stdout:rsyslogd 1243 root 4u unix 0xffff93750c924380 0t0 22915 type=DGRAM 2023-08-01T20:01:35.117 INFO:teuthology.orchestra.run.smithi101.stdout:rsyslogd 1243 root 5r a_inode 0,14 0 15587 inotify 2023-08-01T20:01:35.117 INFO:teuthology.orchestra.run.smithi101.stdout:rsyslogd 1243 root 6w REG 8,1 107243 525344 /home/ubuntu/cephtest/archive/syslog/kern.log 2023-08-01T20:01:35.117 INFO:teuthology.orchestra.run.smithi101.stdout:rsyslogd 1243 root 7r REG 0,24 8388608 2129 /run/log/journal/a1b29d6c289747bdb22930598d39874a/system.journal 2023-08-01T20:01:35.117 INFO:teuthology.orchestra.run.smithi101.stdout:rsyslogd 1243 root 8w REG 8,1 1368443 18390 /var/log/messages 2023-08-01T20:01:35.117 INFO:teuthology.orchestra.run.smithi101.stdout:rsyslogd 1243 root 9w REG 8,1 799018 525345 /home/ubuntu/cephtest/archive/syslog/misc.log 2023-08-01T20:01:35.118 INFO:teuthology.orchestra.run.smithi101.stdout:rsyslogd 1243 root 10w REG 8,1 745986 18391 /var/log/secure 2023-08-01T20:01:35.118 INFO:teuthology.orchestra.run.smithi101.stdout:rsyslogd 1243 root 11w REG 8,1 4407 18866 /var/log/cron 2023-08-01T20:01:35.118 INFO:teuthology.orchestra.run.smithi101.stdout:rsyslogd 1243 1269 in:imjour root cwd DIR 8,1 4096 2 / 2023-08-01T20:01:35.118 INFO:teuthology.orchestra.run.smithi101.stdout:rsyslogd 1243 1269 in:imjour root rtd DIR 8,1 4096 2 / 2023-08-01T20:01:35.118 INFO:teuthology.orchestra.run.smithi101.stdout:rsyslogd 1243 1269 in:imjour root txt REG 8,1 742192 27861 /usr/sbin/rsyslogd 2023-08-01T20:01:35.118 INFO:teuthology.orchestra.run.smithi101.stdout:rsyslogd 1243 1269 in:imjour root mem REG 0,24 8388608 2129 /run/log/journal/a1b29d6c289747bdb22930598d39874a/system.journal 2023-08-01T20:01:35.118 INFO:teuthology.orchestra.run.smithi101.stdout:rsyslogd 1243 1269 in:imjour root mem REG 8,1 34272 27831 /usr/lib64/rsyslog/imjournal.so 2023-08-01T20:01:35.118 INFO:teuthology.orchestra.run.smithi101.stdout:rsyslogd 1243 1269 in:imjour root mem REG 8,1 38864 27838 /usr/lib64/rsyslog/imuxsock.so 2023-08-01T20:01:35.119 INFO:teuthology.orchestra.run.smithi101.stdout:rsyslogd 1243 1269 in:imjour root mem REG 8,1 54352 24707 /usr/lib64/libnss_files-2.28.so 2023-08-01T20:01:35.119 INFO:teuthology.orchestra.run.smithi101.stdout:rsyslogd 1243 1269 in:imjour root mem REG 8,1 29408 31775 /usr/lib64/rsyslog/lmnet.so 2023-08-01T20:01:35.119 INFO:teuthology.orchestra.run.smithi101.stdout:rsyslogd 1243 1269 in:imjour root mem REG 8,1 543304 24651 /usr/lib64/libpcre2-8.so.0.7.1 2023-08-01T20:01:35.119 INFO:teuthology.orchestra.run.smithi101.stdout:rsyslogd 1243 1269 in:imjour root mem REG 8,1 145984 24905 /usr/lib64/libgpg-error.so.0.24.2 2023-08-01T20:01:35.119 INFO:teuthology.orchestra.run.smithi101.stdout:rsyslogd 1243 1269 in:imjour root mem REG 8,1 172104 24654 /usr/lib64/libselinux.so.1 2023-08-01T20:01:35.119 INFO:teuthology.orchestra.run.smithi101.stdout:rsyslogd 1243 1269 in:imjour root mem REG 8,1 343680 19531 /usr/lib64/libblkid.so.1.1.0 2023-08-01T20:01:35.119 INFO:teuthology.orchestra.run.smithi101.stdout:rsyslogd 1243 1269 in:imjour root mem REG 8,1 1187312 25078 /usr/lib64/libgcrypt.so.20.2.5 2023-08-01T20:01:35.119 INFO:teuthology.orchestra.run.smithi101.stdout:rsyslogd 1243 1269 in:imjour root mem REG 8,1 371480 19864 /usr/lib64/libmount.so.1.1.0 2023-08-01T20:01:35.120 INFO:teuthology.orchestra.run.smithi101.stdout:rsyslogd 1243 1269 in:imjour root mem REG 8,1 33752 24776 /usr/lib64/libcap.so.2.48 2023-08-01T20:01:35.120 INFO:teuthology.orchestra.run.smithi101.stdout:rsyslogd 1243 1269 in:imjour root mem REG 8,1 119760 25264 /usr/lib64/liblz4.so.1.8.3 2023-08-01T20:01:35.120 INFO:teuthology.orchestra.run.smithi101.stdout:rsyslogd 1243 1269 in:imjour root mem REG 8,1 162192 24774 /usr/lib64/liblzma.so.5.2.4 2023-08-01T20:01:35.120 INFO:teuthology.orchestra.run.smithi101.stdout:rsyslogd 1243 1269 in:imjour root mem REG 8,1 2089984 24698 /usr/lib64/libc-2.28.so 2023-08-01T20:01:35.120 INFO:teuthology.orchestra.run.smithi101.stdout:rsyslogd 1243 1269 in:imjour root mem REG 8,1 99672 31445 /usr/lib64/libgcc_s-8-20210514.so.1 2023-08-01T20:01:35.120 INFO:teuthology.orchestra.run.smithi101.stdout:rsyslogd 1243 1269 in:imjour root mem REG 8,1 33480 19526 /usr/lib64/libuuid.so.1.3.0 2023-08-01T20:01:35.120 INFO:teuthology.orchestra.run.smithi101.stdout:rsyslogd 1243 1269 in:imjour root mem REG 8,1 1387784 26786 /usr/lib64/libsystemd.so.0.23.0 2023-08-01T20:01:35.120 INFO:teuthology.orchestra.run.smithi101.stdout:rsyslogd 1243 1269 in:imjour root mem REG 8,1 50392 26258 /usr/lib64/libfastjson.so.4.3.0 2023-08-01T20:01:35.121 INFO:teuthology.orchestra.run.smithi101.stdout:rsyslogd 1243 1269 in:imjour root mem REG 8,1 16544 26255 /usr/lib64/libestr.so.0.0.0 2023-08-01T20:01:35.121 INFO:teuthology.orchestra.run.smithi101.stdout:rsyslogd 1243 1269 in:imjour root mem REG 8,1 42744 24710 /usr/lib64/librt-2.28.so 2023-08-01T20:01:35.121 INFO:teuthology.orchestra.run.smithi101.stdout:rsyslogd 1243 1269 in:imjour root mem REG 8,1 19128 24699 /usr/lib64/libdl-2.28.so 2023-08-01T20:01:35.121 INFO:teuthology.orchestra.run.smithi101.stdout:rsyslogd 1243 1269 in:imjour root mem REG 8,1 149984 24708 /usr/lib64/libpthread-2.28.so 2023-08-01T20:01:35.121 INFO:teuthology.orchestra.run.smithi101.stdout:rsyslogd 1243 1269 in:imjour root mem REG 8,1 99640 24762 /usr/lib64/libz.so.1.2.11 2023-08-01T20:01:35.121 INFO:teuthology.orchestra.run.smithi101.stdout:rsyslogd 1243 1269 in:imjour root mem REG 8,1 1062168 24653 /usr/lib64/ld-2.28.so 2023-08-01T20:01:35.121 INFO:teuthology.orchestra.run.smithi101.stdout:rsyslogd 1243 1269 in:imjour root 0r CHR 1,3 0t0 3083 /dev/null 2023-08-01T20:01:35.121 INFO:teuthology.orchestra.run.smithi101.stdout:rsyslogd 1243 1269 in:imjour root 1w CHR 1,3 0t0 3083 /dev/null 2023-08-01T20:01:35.122 INFO:teuthology.orchestra.run.smithi101.stdout:rsyslogd 1243 1269 in:imjour root 2w CHR 1,3 0t0 3083 /dev/null 2023-08-01T20:01:35.122 INFO:teuthology.orchestra.run.smithi101.stdout:rsyslogd 1243 1269 in:imjour root 3r CHR 1,9 0t0 3088 /dev/urandom 2023-08-01T20:01:35.122 INFO:teuthology.orchestra.run.smithi101.stdout:rsyslogd 1243 1269 in:imjour root 4u unix 0xffff93750c924380 0t0 22915 type=DGRAM 2023-08-01T20:01:35.122 INFO:teuthology.orchestra.run.smithi101.stdout:rsyslogd 1243 1269 in:imjour root 5r a_inode 0,14 0 15587 inotify 2023-08-01T20:01:35.122 INFO:teuthology.orchestra.run.smithi101.stdout:rsyslogd 1243 1269 in:imjour root 6w REG 8,1 107243 525344 /home/ubuntu/cephtest/archive/syslog/kern.log 2023-08-01T20:01:35.122 INFO:teuthology.orchestra.run.smithi101.stdout:rsyslogd 1243 1269 in:imjour root 7r REG 0,24 8388608 2129 /run/log/journal/a1b29d6c289747bdb22930598d39874a/system.journal 2023-08-01T20:01:35.122 INFO:teuthology.orchestra.run.smithi101.stdout:rsyslogd 1243 1269 in:imjour root 8w REG 8,1 1368443 18390 /var/log/messages 2023-08-01T20:01:35.123 INFO:teuthology.orchestra.run.smithi101.stdout:rsyslogd 1243 1269 in:imjour root 9w REG 8,1 799018 525345 /home/ubuntu/cephtest/archive/syslog/misc.log 2023-08-01T20:01:35.123 INFO:teuthology.orchestra.run.smithi101.stdout:rsyslogd 1243 1269 in:imjour root 10w REG 8,1 745986 18391 /var/log/secure 2023-08-01T20:01:35.123 INFO:teuthology.orchestra.run.smithi101.stdout:rsyslogd 1243 1269 in:imjour root 11w REG 8,1 4407 18866 /var/log/cron 2023-08-01T20:01:35.123 INFO:teuthology.orchestra.run.smithi101.stdout:rsyslogd 1243 1274 rs:main root cwd DIR 8,1 4096 2 / 2023-08-01T20:01:35.123 INFO:teuthology.orchestra.run.smithi101.stdout:rsyslogd 1243 1274 rs:main root rtd DIR 8,1 4096 2 / 2023-08-01T20:01:35.123 INFO:teuthology.orchestra.run.smithi101.stdout:rsyslogd 1243 1274 rs:main root txt REG 8,1 742192 27861 /usr/sbin/rsyslogd 2023-08-01T20:01:35.123 INFO:teuthology.orchestra.run.smithi101.stdout:rsyslogd 1243 1274 rs:main root mem REG 0,24 8388608 2129 /run/log/journal/a1b29d6c289747bdb22930598d39874a/system.journal 2023-08-01T20:01:35.123 INFO:teuthology.orchestra.run.smithi101.stdout:rsyslogd 1243 1274 rs:main root mem REG 8,1 34272 27831 /usr/lib64/rsyslog/imjournal.so 2023-08-01T20:01:35.124 INFO:teuthology.orchestra.run.smithi101.stdout:rsyslogd 1243 1274 rs:main root mem REG 8,1 38864 27838 /usr/lib64/rsyslog/imuxsock.so 2023-08-01T20:01:35.124 INFO:teuthology.orchestra.run.smithi101.stdout:rsyslogd 1243 1274 rs:main root mem REG 8,1 54352 24707 /usr/lib64/libnss_files-2.28.so 2023-08-01T20:01:35.124 INFO:teuthology.orchestra.run.smithi101.stdout:rsyslogd 1243 1274 rs:main root mem REG 8,1 29408 31775 /usr/lib64/rsyslog/lmnet.so 2023-08-01T20:01:35.124 INFO:teuthology.orchestra.run.smithi101.stdout:rsyslogd 1243 1274 rs:main root mem REG 8,1 543304 24651 /usr/lib64/libpcre2-8.so.0.7.1 2023-08-01T20:01:35.124 INFO:teuthology.orchestra.run.smithi101.stdout:rsyslogd 1243 1274 rs:main root mem REG 8,1 145984 24905 /usr/lib64/libgpg-error.so.0.24.2 2023-08-01T20:01:35.124 INFO:teuthology.orchestra.run.smithi101.stdout:rsyslogd 1243 1274 rs:main root mem REG 8,1 172104 24654 /usr/lib64/libselinux.so.1 2023-08-01T20:01:35.124 INFO:teuthology.orchestra.run.smithi101.stdout:rsyslogd 1243 1274 rs:main root mem REG 8,1 343680 19531 /usr/lib64/libblkid.so.1.1.0 2023-08-01T20:01:35.124 INFO:teuthology.orchestra.run.smithi101.stdout:rsyslogd 1243 1274 rs:main root mem REG 8,1 1187312 25078 /usr/lib64/libgcrypt.so.20.2.5 2023-08-01T20:01:35.125 INFO:teuthology.orchestra.run.smithi101.stdout:rsyslogd 1243 1274 rs:main root mem REG 8,1 371480 19864 /usr/lib64/libmount.so.1.1.0 2023-08-01T20:01:35.125 INFO:teuthology.orchestra.run.smithi101.stdout:rsyslogd 1243 1274 rs:main root mem REG 8,1 33752 24776 /usr/lib64/libcap.so.2.48 2023-08-01T20:01:35.125 INFO:teuthology.orchestra.run.smithi101.stdout:rsyslogd 1243 1274 rs:main root mem REG 8,1 119760 25264 /usr/lib64/liblz4.so.1.8.3 2023-08-01T20:01:35.125 INFO:teuthology.orchestra.run.smithi101.stdout:rsyslogd 1243 1274 rs:main root mem REG 8,1 162192 24774 /usr/lib64/liblzma.so.5.2.4 2023-08-01T20:01:35.125 INFO:teuthology.orchestra.run.smithi101.stdout:rsyslogd 1243 1274 rs:main root mem REG 8,1 2089984 24698 /usr/lib64/libc-2.28.so 2023-08-01T20:01:35.125 INFO:teuthology.orchestra.run.smithi101.stdout:rsyslogd 1243 1274 rs:main root mem REG 8,1 99672 31445 /usr/lib64/libgcc_s-8-20210514.so.1 2023-08-01T20:01:35.125 INFO:teuthology.orchestra.run.smithi101.stdout:rsyslogd 1243 1274 rs:main root mem REG 8,1 33480 19526 /usr/lib64/libuuid.so.1.3.0 2023-08-01T20:01:35.125 INFO:teuthology.orchestra.run.smithi101.stdout:rsyslogd 1243 1274 rs:main root mem REG 8,1 1387784 26786 /usr/lib64/libsystemd.so.0.23.0 2023-08-01T20:01:35.126 INFO:teuthology.orchestra.run.smithi101.stdout:rsyslogd 1243 1274 rs:main root mem REG 8,1 50392 26258 /usr/lib64/libfastjson.so.4.3.0 2023-08-01T20:01:35.126 INFO:teuthology.orchestra.run.smithi101.stdout:rsyslogd 1243 1274 rs:main root mem REG 8,1 16544 26255 /usr/lib64/libestr.so.0.0.0 2023-08-01T20:01:35.126 INFO:teuthology.orchestra.run.smithi101.stdout:rsyslogd 1243 1274 rs:main root mem REG 8,1 42744 24710 /usr/lib64/librt-2.28.so 2023-08-01T20:01:35.126 INFO:teuthology.orchestra.run.smithi101.stdout:rsyslogd 1243 1274 rs:main root mem REG 8,1 19128 24699 /usr/lib64/libdl-2.28.so 2023-08-01T20:01:35.126 INFO:teuthology.orchestra.run.smithi101.stdout:rsyslogd 1243 1274 rs:main root mem REG 8,1 149984 24708 /usr/lib64/libpthread-2.28.so 2023-08-01T20:01:35.126 INFO:teuthology.orchestra.run.smithi101.stdout:rsyslogd 1243 1274 rs:main root mem REG 8,1 99640 24762 /usr/lib64/libz.so.1.2.11 2023-08-01T20:01:35.126 INFO:teuthology.orchestra.run.smithi101.stdout:rsyslogd 1243 1274 rs:main root mem REG 8,1 1062168 24653 /usr/lib64/ld-2.28.so 2023-08-01T20:01:35.126 INFO:teuthology.orchestra.run.smithi101.stdout:rsyslogd 1243 1274 rs:main root 0r CHR 1,3 0t0 3083 /dev/null 2023-08-01T20:01:35.127 INFO:teuthology.orchestra.run.smithi101.stdout:rsyslogd 1243 1274 rs:main root 1w CHR 1,3 0t0 3083 /dev/null 2023-08-01T20:01:35.127 INFO:teuthology.orchestra.run.smithi101.stdout:rsyslogd 1243 1274 rs:main root 2w CHR 1,3 0t0 3083 /dev/null 2023-08-01T20:01:35.127 INFO:teuthology.orchestra.run.smithi101.stdout:rsyslogd 1243 1274 rs:main root 3r CHR 1,9 0t0 3088 /dev/urandom 2023-08-01T20:01:35.127 INFO:teuthology.orchestra.run.smithi101.stdout:rsyslogd 1243 1274 rs:main root 4u unix 0xffff93750c924380 0t0 22915 type=DGRAM 2023-08-01T20:01:35.127 INFO:teuthology.orchestra.run.smithi101.stdout:rsyslogd 1243 1274 rs:main root 5r a_inode 0,14 0 15587 inotify 2023-08-01T20:01:35.127 INFO:teuthology.orchestra.run.smithi101.stdout:rsyslogd 1243 1274 rs:main root 6w REG 8,1 107243 525344 /home/ubuntu/cephtest/archive/syslog/kern.log 2023-08-01T20:01:35.127 INFO:teuthology.orchestra.run.smithi101.stdout:rsyslogd 1243 1274 rs:main root 7r REG 0,24 8388608 2129 /run/log/journal/a1b29d6c289747bdb22930598d39874a/system.journal 2023-08-01T20:01:35.127 INFO:teuthology.orchestra.run.smithi101.stdout:rsyslogd 1243 1274 rs:main root 8w REG 8,1 1368443 18390 /var/log/messages 2023-08-01T20:01:35.128 INFO:teuthology.orchestra.run.smithi101.stdout:rsyslogd 1243 1274 rs:main root 9w REG 8,1 799018 525345 /home/ubuntu/cephtest/archive/syslog/misc.log 2023-08-01T20:01:35.128 INFO:teuthology.orchestra.run.smithi101.stdout:rsyslogd 1243 1274 rs:main root 10w REG 8,1 745986 18391 /var/log/secure 2023-08-01T20:01:35.128 INFO:teuthology.orchestra.run.smithi101.stdout:rsyslogd 1243 1274 rs:main root 11w REG 8,1 4407 18866 /var/log/cron 2023-08-01T20:01:35.128 INFO:teuthology.orchestra.run.smithi101.stdout:nrpe 1246 nrpe cwd DIR 8,1 4096 2 / 2023-08-01T20:01:35.128 INFO:teuthology.orchestra.run.smithi101.stdout:nrpe 1246 nrpe rtd DIR 8,1 4096 2 / 2023-08-01T20:01:35.128 INFO:teuthology.orchestra.run.smithi101.stdout:nrpe 1246 nrpe txt REG 8,1 82312 23646 /usr/sbin/nrpe 2023-08-01T20:01:35.128 INFO:teuthology.orchestra.run.smithi101.stdout:nrpe 1246 nrpe mem REG 8,1 54352 24707 /usr/lib64/libnss_files-2.28.so 2023-08-01T20:01:35.129 INFO:teuthology.orchestra.run.smithi101.stdout:nrpe 1246 nrpe mem REG 8,1 149984 24708 /usr/lib64/libpthread-2.28.so 2023-08-01T20:01:35.129 INFO:teuthology.orchestra.run.smithi101.stdout:nrpe 1246 nrpe mem REG 8,1 19128 24699 /usr/lib64/libdl-2.28.so 2023-08-01T20:01:35.129 INFO:teuthology.orchestra.run.smithi101.stdout:nrpe 1246 nrpe mem REG 8,1 99640 24762 /usr/lib64/libz.so.1.2.11 2023-08-01T20:01:35.129 INFO:teuthology.orchestra.run.smithi101.stdout:nrpe 1246 nrpe mem REG 8,1 2089984 24698 /usr/lib64/libc-2.28.so 2023-08-01T20:01:35.129 INFO:teuthology.orchestra.run.smithi101.stdout:nrpe 1246 nrpe mem REG 8,1 3083608 26861 /usr/lib64/libcrypto.so.1.1.1k 2023-08-01T20:01:35.129 INFO:teuthology.orchestra.run.smithi101.stdout:nrpe 1246 nrpe mem REG 8,1 615744 26862 /usr/lib64/libssl.so.1.1.1k 2023-08-01T20:01:35.129 INFO:teuthology.orchestra.run.smithi101.stdout:nrpe 1246 nrpe mem REG 8,1 1062168 24653 /usr/lib64/ld-2.28.so 2023-08-01T20:01:35.129 INFO:teuthology.orchestra.run.smithi101.stdout:nrpe 1246 nrpe 0r CHR 1,3 0t0 3083 /dev/null 2023-08-01T20:01:35.130 INFO:teuthology.orchestra.run.smithi101.stdout:nrpe 1246 nrpe 1w CHR 1,3 0t0 3083 /dev/null 2023-08-01T20:01:35.130 INFO:teuthology.orchestra.run.smithi101.stdout:nrpe 1246 nrpe 2w CHR 1,3 0t0 3083 /dev/null 2023-08-01T20:01:35.130 INFO:teuthology.orchestra.run.smithi101.stdout:nrpe 1246 nrpe 3u IPv4 29342 0t0 TCP *:nrpe (LISTEN) 2023-08-01T20:01:35.130 INFO:teuthology.orchestra.run.smithi101.stdout:nrpe 1246 nrpe 4u unix 0xffff93750d2b8d80 0t0 29333 type=DGRAM 2023-08-01T20:01:35.130 INFO:teuthology.orchestra.run.smithi101.stdout:nrpe 1246 nrpe 5u IPv6 29343 0t0 TCP *:nrpe (LISTEN) 2023-08-01T20:01:35.130 INFO:teuthology.orchestra.run.smithi101.stdout:agetty 2024 root cwd DIR 8,1 4096 2 / 2023-08-01T20:01:35.130 INFO:teuthology.orchestra.run.smithi101.stdout:agetty 2024 root rtd DIR 8,1 4096 2 / 2023-08-01T20:01:35.130 INFO:teuthology.orchestra.run.smithi101.stdout:agetty 2024 root txt REG 8,1 63944 20060 /usr/sbin/agetty 2023-08-01T20:01:35.131 INFO:teuthology.orchestra.run.smithi101.stdout:agetty 2024 root mem REG 8,1 54352 24707 /usr/lib64/libnss_files-2.28.so 2023-08-01T20:01:35.131 INFO:teuthology.orchestra.run.smithi101.stdout:agetty 2024 root mem REG 8,1 2586930 39433 /usr/lib/locale/en_US.utf8/LC_COLLATE 2023-08-01T20:01:35.131 INFO:teuthology.orchestra.run.smithi101.stdout:agetty 2024 root mem REG 8,1 2089984 24698 /usr/lib64/libc-2.28.so 2023-08-01T20:01:35.131 INFO:teuthology.orchestra.run.smithi101.stdout:agetty 2024 root mem REG 8,1 1062168 24653 /usr/lib64/ld-2.28.so 2023-08-01T20:01:35.131 INFO:teuthology.orchestra.run.smithi101.stdout:agetty 2024 root mem REG 8,1 337024 45489 /usr/lib/locale/C.utf8/LC_CTYPE 2023-08-01T20:01:35.131 INFO:teuthology.orchestra.run.smithi101.stdout:agetty 2024 root mem REG 8,1 54 44174 /usr/lib/locale/en_US.utf8/LC_NUMERIC 2023-08-01T20:01:35.131 INFO:teuthology.orchestra.run.smithi101.stdout:agetty 2024 root mem REG 8,1 3316 48200 /usr/lib/locale/en_US.utf8/LC_TIME 2023-08-01T20:01:35.131 INFO:teuthology.orchestra.run.smithi101.stdout:agetty 2024 root mem REG 8,1 286 48207 /usr/lib/locale/en_US.utf8/LC_MONETARY 2023-08-01T20:01:35.132 INFO:teuthology.orchestra.run.smithi101.stdout:agetty 2024 root mem REG 8,1 26998 35419 /usr/lib64/gconv/gconv-modules.cache 2023-08-01T20:01:35.132 INFO:teuthology.orchestra.run.smithi101.stdout:agetty 2024 root mem REG 8,1 57 39434 /usr/lib/locale/en_US.utf8/LC_MESSAGES/SYS_LC_MESSAGES 2023-08-01T20:01:35.132 INFO:teuthology.orchestra.run.smithi101.stdout:agetty 2024 root mem REG 8,1 34 39448 /usr/lib/locale/en_US.utf8/LC_PAPER 2023-08-01T20:01:35.132 INFO:teuthology.orchestra.run.smithi101.stdout:agetty 2024 root mem REG 8,1 77 44173 /usr/lib/locale/en_US.utf8/LC_NAME 2023-08-01T20:01:35.132 INFO:teuthology.orchestra.run.smithi101.stdout:agetty 2024 root mem REG 8,1 167 45462 /usr/lib/locale/en_US.utf8/LC_ADDRESS 2023-08-01T20:01:35.132 INFO:teuthology.orchestra.run.smithi101.stdout:agetty 2024 root mem REG 8,1 59 48208 /usr/lib/locale/en_US.utf8/LC_TELEPHONE 2023-08-01T20:01:35.132 INFO:teuthology.orchestra.run.smithi101.stdout:agetty 2024 root mem REG 8,1 23 48206 /usr/lib/locale/en_US.utf8/LC_MEASUREMENT 2023-08-01T20:01:35.132 INFO:teuthology.orchestra.run.smithi101.stdout:agetty 2024 root mem REG 8,1 368 48205 /usr/lib/locale/en_US.utf8/LC_IDENTIFICATION 2023-08-01T20:01:35.133 INFO:teuthology.orchestra.run.smithi101.stdout:agetty 2024 root 0u CHR 4,65 0t0 3190 /dev/ttyS1 2023-08-01T20:01:35.133 INFO:teuthology.orchestra.run.smithi101.stdout:agetty 2024 root 1u CHR 4,65 0t0 3190 /dev/ttyS1 2023-08-01T20:01:35.133 INFO:teuthology.orchestra.run.smithi101.stdout:agetty 2024 root 2u CHR 4,65 0t0 3190 /dev/ttyS1 2023-08-01T20:01:35.133 INFO:teuthology.orchestra.run.smithi101.stdout:agetty 2024 root 4r a_inode 0,14 0 15587 inotify 2023-08-01T20:01:35.133 INFO:teuthology.orchestra.run.smithi101.stdout:agetty 2027 root cwd DIR 8,1 4096 2 / 2023-08-01T20:01:35.133 INFO:teuthology.orchestra.run.smithi101.stdout:agetty 2027 root rtd DIR 8,1 4096 2 / 2023-08-01T20:01:35.133 INFO:teuthology.orchestra.run.smithi101.stdout:agetty 2027 root txt REG 8,1 63944 20060 /usr/sbin/agetty 2023-08-01T20:01:35.133 INFO:teuthology.orchestra.run.smithi101.stdout:agetty 2027 root mem REG 8,1 54352 24707 /usr/lib64/libnss_files-2.28.so 2023-08-01T20:01:35.134 INFO:teuthology.orchestra.run.smithi101.stdout:agetty 2027 root mem REG 8,1 2089984 24698 /usr/lib64/libc-2.28.so 2023-08-01T20:01:35.134 INFO:teuthology.orchestra.run.smithi101.stdout:agetty 2027 root mem REG 8,1 1062168 24653 /usr/lib64/ld-2.28.so 2023-08-01T20:01:35.134 INFO:teuthology.orchestra.run.smithi101.stdout:agetty 2027 root mem REG 8,1 337024 45489 /usr/lib/locale/C.utf8/LC_CTYPE 2023-08-01T20:01:35.134 INFO:teuthology.orchestra.run.smithi101.stdout:agetty 2027 root mem REG 8,1 26998 35419 /usr/lib64/gconv/gconv-modules.cache 2023-08-01T20:01:35.134 INFO:teuthology.orchestra.run.smithi101.stdout:agetty 2027 root 0u CHR 4,1 0t0 3097 /dev/tty1 2023-08-01T20:01:35.134 INFO:teuthology.orchestra.run.smithi101.stdout:agetty 2027 root 1u CHR 4,1 0t0 3097 /dev/tty1 2023-08-01T20:01:35.135 INFO:teuthology.orchestra.run.smithi101.stdout:agetty 2027 root 2u CHR 4,1 0t0 3097 /dev/tty1 2023-08-01T20:01:35.135 INFO:teuthology.orchestra.run.smithi101.stdout:agetty 2027 root 4r a_inode 0,14 0 15587 inotify 2023-08-01T20:01:35.135 INFO:teuthology.orchestra.run.smithi101.stdout:anacron 6082 root cwd DIR 8,1 4096 18378 /var/spool/anacron 2023-08-01T20:01:35.135 INFO:teuthology.orchestra.run.smithi101.stdout:anacron 6082 root rtd DIR 8,1 4096 2 / 2023-08-01T20:01:35.135 INFO:teuthology.orchestra.run.smithi101.stdout:anacron 6082 root txt REG 8,1 41968 27716 /usr/sbin/anacron 2023-08-01T20:01:35.135 INFO:teuthology.orchestra.run.smithi101.stdout:anacron 6082 root mem REG 8,1 2586930 39433 /usr/lib/locale/en_US.utf8/LC_COLLATE 2023-08-01T20:01:35.135 INFO:teuthology.orchestra.run.smithi101.stdout:anacron 6082 root mem REG 8,1 149984 24708 /usr/lib64/libpthread-2.28.so 2023-08-01T20:01:35.135 INFO:teuthology.orchestra.run.smithi101.stdout:anacron 6082 root mem REG 8,1 24928 25065 /usr/lib64/libcap-ng.so.0.0.0 2023-08-01T20:01:35.136 INFO:teuthology.orchestra.run.smithi101.stdout:anacron 6082 root mem REG 8,1 543304 24651 /usr/lib64/libpcre2-8.so.0.7.1 2023-08-01T20:01:35.136 INFO:teuthology.orchestra.run.smithi101.stdout:anacron 6082 root mem REG 8,1 2089984 24698 /usr/lib64/libc-2.28.so 2023-08-01T20:01:35.136 INFO:teuthology.orchestra.run.smithi101.stdout:anacron 6082 root mem REG 8,1 135784 24768 /usr/lib64/libaudit.so.1.0.0 2023-08-01T20:01:35.136 INFO:teuthology.orchestra.run.smithi101.stdout:anacron 6082 root mem REG 8,1 19128 24699 /usr/lib64/libdl-2.28.so 2023-08-01T20:01:35.136 INFO:teuthology.orchestra.run.smithi101.stdout:anacron 6082 root mem REG 8,1 66504 27020 /usr/lib64/libpam.so.0.84.2 2023-08-01T20:01:35.136 INFO:teuthology.orchestra.run.smithi101.stdout:anacron 6082 root mem REG 8,1 172104 24654 /usr/lib64/libselinux.so.1 2023-08-01T20:01:35.136 INFO:teuthology.orchestra.run.smithi101.stdout:anacron 6082 root mem REG 8,1 1062168 24653 /usr/lib64/ld-2.28.so 2023-08-01T20:01:35.136 INFO:teuthology.orchestra.run.smithi101.stdout:anacron 6082 root mem REG 8,1 337024 45489 /usr/lib/locale/C.utf8/LC_CTYPE 2023-08-01T20:01:35.137 INFO:teuthology.orchestra.run.smithi101.stdout:anacron 6082 root mem REG 8,1 54 44174 /usr/lib/locale/en_US.utf8/LC_NUMERIC 2023-08-01T20:01:35.137 INFO:teuthology.orchestra.run.smithi101.stdout:anacron 6082 root mem REG 8,1 3316 48200 /usr/lib/locale/en_US.utf8/LC_TIME 2023-08-01T20:01:35.137 INFO:teuthology.orchestra.run.smithi101.stdout:anacron 6082 root mem REG 8,1 286 48207 /usr/lib/locale/en_US.utf8/LC_MONETARY 2023-08-01T20:01:35.137 INFO:teuthology.orchestra.run.smithi101.stdout:anacron 6082 root mem REG 8,1 26998 35419 /usr/lib64/gconv/gconv-modules.cache 2023-08-01T20:01:35.137 INFO:teuthology.orchestra.run.smithi101.stdout:anacron 6082 root mem REG 8,1 57 39434 /usr/lib/locale/en_US.utf8/LC_MESSAGES/SYS_LC_MESSAGES 2023-08-01T20:01:35.137 INFO:teuthology.orchestra.run.smithi101.stdout:anacron 6082 root mem REG 8,1 34 39448 /usr/lib/locale/en_US.utf8/LC_PAPER 2023-08-01T20:01:35.137 INFO:teuthology.orchestra.run.smithi101.stdout:anacron 6082 root mem REG 8,1 77 44173 /usr/lib/locale/en_US.utf8/LC_NAME 2023-08-01T20:01:35.138 INFO:teuthology.orchestra.run.smithi101.stdout:anacron 6082 root mem REG 8,1 167 45462 /usr/lib/locale/en_US.utf8/LC_ADDRESS 2023-08-01T20:01:35.138 INFO:teuthology.orchestra.run.smithi101.stdout:anacron 6082 root mem REG 8,1 59 48208 /usr/lib/locale/en_US.utf8/LC_TELEPHONE 2023-08-01T20:01:35.138 INFO:teuthology.orchestra.run.smithi101.stdout:anacron 6082 root mem REG 8,1 23 48206 /usr/lib/locale/en_US.utf8/LC_MEASUREMENT 2023-08-01T20:01:35.138 INFO:teuthology.orchestra.run.smithi101.stdout:anacron 6082 root mem REG 8,1 368 48205 /usr/lib/locale/en_US.utf8/LC_IDENTIFICATION 2023-08-01T20:01:35.138 INFO:teuthology.orchestra.run.smithi101.stdout:anacron 6082 root 0r CHR 1,3 0t0 3083 /dev/null 2023-08-01T20:01:35.138 INFO:teuthology.orchestra.run.smithi101.stdout:anacron 6082 root 1w CHR 1,3 0t0 3083 /dev/null 2023-08-01T20:01:35.138 INFO:teuthology.orchestra.run.smithi101.stdout:anacron 6082 root 2w CHR 1,3 0t0 3083 /dev/null 2023-08-01T20:01:35.138 INFO:teuthology.orchestra.run.smithi101.stdout:anacron 6082 root 3uW REG 8,1 0 18380 /var/spool/anacron/cron.daily 2023-08-01T20:01:35.139 INFO:teuthology.orchestra.run.smithi101.stdout:anacron 6082 root 4u unix 0xffff93750c981680 0t0 43177 type=DGRAM 2023-08-01T20:01:35.139 INFO:teuthology.orchestra.run.smithi101.stdout:anacron 6082 root 5uW REG 8,1 0 18381 /var/spool/anacron/cron.weekly 2023-08-01T20:01:35.139 INFO:teuthology.orchestra.run.smithi101.stdout:anacron 6082 root 6uW REG 8,1 0 18382 /var/spool/anacron/cron.monthly 2023-08-01T20:01:35.139 INFO:teuthology.orchestra.run.smithi101.stdout:sleep 6092 root cwd DIR 8,1 4096 2 / 2023-08-01T20:01:35.139 INFO:teuthology.orchestra.run.smithi101.stdout:sleep 6092 root rtd DIR 8,1 4096 2 / 2023-08-01T20:01:35.139 INFO:teuthology.orchestra.run.smithi101.stdout:sleep 6092 root txt REG 8,1 38416 26752 /usr/bin/sleep 2023-08-01T20:01:35.139 INFO:teuthology.orchestra.run.smithi101.stdout:sleep 6092 root mem REG 8,1 2586930 39433 /usr/lib/locale/en_US.utf8/LC_COLLATE 2023-08-01T20:01:35.139 INFO:teuthology.orchestra.run.smithi101.stdout:sleep 6092 root mem REG 8,1 2089984 24698 /usr/lib64/libc-2.28.so 2023-08-01T20:01:35.140 INFO:teuthology.orchestra.run.smithi101.stdout:sleep 6092 root mem REG 8,1 1062168 24653 /usr/lib64/ld-2.28.so 2023-08-01T20:01:35.140 INFO:teuthology.orchestra.run.smithi101.stdout:sleep 6092 root mem REG 8,1 337024 45489 /usr/lib/locale/C.utf8/LC_CTYPE 2023-08-01T20:01:35.140 INFO:teuthology.orchestra.run.smithi101.stdout:sleep 6092 root mem REG 8,1 54 44174 /usr/lib/locale/en_US.utf8/LC_NUMERIC 2023-08-01T20:01:35.140 INFO:teuthology.orchestra.run.smithi101.stdout:sleep 6092 root mem REG 8,1 3316 48200 /usr/lib/locale/en_US.utf8/LC_TIME 2023-08-01T20:01:35.140 INFO:teuthology.orchestra.run.smithi101.stdout:sleep 6092 root mem REG 8,1 286 48207 /usr/lib/locale/en_US.utf8/LC_MONETARY 2023-08-01T20:01:35.140 INFO:teuthology.orchestra.run.smithi101.stdout:sleep 6092 root mem REG 8,1 26998 35419 /usr/lib64/gconv/gconv-modules.cache 2023-08-01T20:01:35.140 INFO:teuthology.orchestra.run.smithi101.stdout:sleep 6092 root mem REG 8,1 57 39434 /usr/lib/locale/en_US.utf8/LC_MESSAGES/SYS_LC_MESSAGES 2023-08-01T20:01:35.140 INFO:teuthology.orchestra.run.smithi101.stdout:sleep 6092 root mem REG 8,1 34 39448 /usr/lib/locale/en_US.utf8/LC_PAPER 2023-08-01T20:01:35.141 INFO:teuthology.orchestra.run.smithi101.stdout:sleep 6092 root mem REG 8,1 77 44173 /usr/lib/locale/en_US.utf8/LC_NAME 2023-08-01T20:01:35.141 INFO:teuthology.orchestra.run.smithi101.stdout:sleep 6092 root mem REG 8,1 167 45462 /usr/lib/locale/en_US.utf8/LC_ADDRESS 2023-08-01T20:01:35.141 INFO:teuthology.orchestra.run.smithi101.stdout:sleep 6092 root mem REG 8,1 59 48208 /usr/lib/locale/en_US.utf8/LC_TELEPHONE 2023-08-01T20:01:35.141 INFO:teuthology.orchestra.run.smithi101.stdout:sleep 6092 root mem REG 8,1 23 48206 /usr/lib/locale/en_US.utf8/LC_MEASUREMENT 2023-08-01T20:01:35.141 INFO:teuthology.orchestra.run.smithi101.stdout:sleep 6092 root mem REG 8,1 368 48205 /usr/lib/locale/en_US.utf8/LC_IDENTIFICATION 2023-08-01T20:01:35.141 INFO:teuthology.orchestra.run.smithi101.stdout:sleep 6092 root 0r CHR 1,3 0t0 3083 /dev/null 2023-08-01T20:01:35.141 INFO:teuthology.orchestra.run.smithi101.stdout:sleep 6092 root 1u unix 0xffff937080485e80 0t0 27909 type=STREAM 2023-08-01T20:01:35.141 INFO:teuthology.orchestra.run.smithi101.stdout:sleep 6092 root 2u unix 0xffff937080485e80 0t0 27909 type=STREAM 2023-08-01T20:01:35.142 INFO:teuthology.orchestra.run.smithi101.stdout:sshd 6093 root cwd DIR 8,1 4096 2 / 2023-08-01T20:01:35.142 INFO:teuthology.orchestra.run.smithi101.stdout:sshd 6093 root rtd DIR 8,1 4096 2 / 2023-08-01T20:01:35.142 INFO:teuthology.orchestra.run.smithi101.stdout:sshd 6093 root txt REG 8,1 890504 30329 /usr/sbin/sshd 2023-08-01T20:01:35.142 INFO:teuthology.orchestra.run.smithi101.stdout:sshd 6093 root mem REG 8,1 944528 26785 /usr/lib64/libnss_systemd.so.2 2023-08-01T20:01:35.142 INFO:teuthology.orchestra.run.smithi101.stdout:sshd 6093 root mem REG 8,1 46336 29167 /usr/lib64/libnss_sss.so.2 2023-08-01T20:01:35.142 INFO:teuthology.orchestra.run.smithi101.stdout:sshd 6093 root mem REG 8,1 20168 49090 /usr/lib64/security/pam_lastlog.so 2023-08-01T20:01:35.142 INFO:teuthology.orchestra.run.smithi101.stdout:sshd 6093 root mem REG 8,1 11760 47498 /usr/lib64/security/pam_umask.so 2023-08-01T20:01:35.142 INFO:teuthology.orchestra.run.smithi101.stdout:sshd 6093 root mem REG 8,1 15968 47495 /usr/lib64/security/pam_succeed_if.so 2023-08-01T20:01:35.143 INFO:teuthology.orchestra.run.smithi101.stdout:sshd 6093 root mem REG 8,1 16608 27021 /usr/lib64/libpam_misc.so.0.82.1 2023-08-01T20:01:35.143 INFO:teuthology.orchestra.run.smithi101.stdout:sshd 6093 root mem REG 8,1 944496 49192 /usr/lib64/security/pam_systemd.so 2023-08-01T20:01:35.143 INFO:teuthology.orchestra.run.smithi101.stdout:sshd 6093 root mem REG 8,1 24080 49091 /usr/lib64/security/pam_limits.so 2023-08-01T20:01:35.143 INFO:teuthology.orchestra.run.smithi101.stdout:sshd 6093 root mem REG 8,1 11824 47487 /usr/lib64/security/pam_motd.so 2023-08-01T20:01:35.143 INFO:teuthology.orchestra.run.smithi101.stdout:sshd 6093 root mem REG 8,1 11848 47484 /usr/lib64/security/pam_keyinit.so 2023-08-01T20:01:35.143 INFO:teuthology.orchestra.run.smithi101.stdout:sshd 6093 root mem REG 8,1 45384 49095 /usr/lib64/security/pam_namespace.so 2023-08-01T20:01:35.143 INFO:teuthology.orchestra.run.smithi101.stdout:sshd 6093 root mem REG 8,1 11800 49093 /usr/lib64/security/pam_loginuid.so 2023-08-01T20:01:35.143 INFO:teuthology.orchestra.run.smithi101.stdout:sshd 6093 root mem REG 8,1 24200 47492 /usr/lib64/security/pam_selinux.so 2023-08-01T20:01:35.144 INFO:teuthology.orchestra.run.smithi101.stdout:sshd 6093 root mem REG 8,1 46232 26496 /usr/lib64/libcrack.so.2.9.0 2023-08-01T20:01:35.144 INFO:teuthology.orchestra.run.smithi101.stdout:sshd 6093 root mem REG 8,1 24832 26985 /usr/lib64/libpwquality.so.1.0.2 2023-08-01T20:01:35.144 INFO:teuthology.orchestra.run.smithi101.stdout:sshd 6093 root mem REG 8,1 11768 49040 /usr/lib64/security/pam_pwquality.so 2023-08-01T20:01:35.144 INFO:teuthology.orchestra.run.smithi101.stdout:sshd 6093 root mem REG 8,1 7672 49097 /usr/lib64/security/pam_permit.so 2023-08-01T20:01:35.144 INFO:teuthology.orchestra.run.smithi101.stdout:sshd 6093 root mem REG 8,1 11808 49096 /usr/lib64/security/pam_nologin.so 2023-08-01T20:01:35.144 INFO:teuthology.orchestra.run.smithi101.stdout:sshd 6093 root mem REG 8,1 15920 47493 /usr/lib64/security/pam_sepermit.so 2023-08-01T20:01:35.144 INFO:teuthology.orchestra.run.smithi101.stdout:sshd 6093 root mem REG 8,1 7592 47477 /usr/lib64/security/pam_deny.so 2023-08-01T20:01:35.145 INFO:teuthology.orchestra.run.smithi101.stdout:sshd 6093 root mem REG 8,1 57992 47800 /usr/lib64/security/pam_sss.so 2023-08-01T20:01:35.145 INFO:teuthology.orchestra.run.smithi101.stdout:sshd 6093 root mem REG 8,1 217696 26588 /usr/lib64/libtirpc.so.3.0.0 2023-08-01T20:01:35.145 INFO:teuthology.orchestra.run.smithi101.stdout:sshd 6093 root mem REG 8,1 120592 26590 /usr/lib64/libnsl.so.2.0.0 2023-08-01T20:01:35.145 INFO:teuthology.orchestra.run.smithi101.stdout:sshd 6093 root mem REG 8,1 58096 49102 /usr/lib64/security/pam_unix.so 2023-08-01T20:01:35.145 INFO:teuthology.orchestra.run.smithi101.stdout:sshd 6093 root mem REG 8,1 11776 47485 /usr/lib64/security/pam_localuser.so 2023-08-01T20:01:35.145 INFO:teuthology.orchestra.run.smithi101.stdout:sshd 6093 root mem REG 8,1 11848 47503 /usr/lib64/security/pam_usertype.so 2023-08-01T20:01:35.145 INFO:teuthology.orchestra.run.smithi101.stdout:sshd 6093 root mem REG 8,1 11752 47479 /usr/lib64/security/pam_faildelay.so 2023-08-01T20:01:35.145 INFO:teuthology.orchestra.run.smithi101.stdout:sshd 6093 root mem REG 8,1 20192 47478 /usr/lib64/security/pam_env.so 2023-08-01T20:01:35.146 INFO:teuthology.orchestra.run.smithi101.stdout:sshd 6093 root mem REG 8,1 54352 24707 /usr/lib64/libnss_files-2.28.so 2023-08-01T20:01:35.146 INFO:teuthology.orchestra.run.smithi101.stdout:sshd 6093 root mem REG 8,1 145984 24905 /usr/lib64/libgpg-error.so.0.24.2 2023-08-01T20:01:35.146 INFO:teuthology.orchestra.run.smithi101.stdout:sshd 6093 root mem REG 8,1 33480 19526 /usr/lib64/libuuid.so.1.3.0 2023-08-01T20:01:35.146 INFO:teuthology.orchestra.run.smithi101.stdout:sshd 6093 root mem REG 8,1 343680 19531 /usr/lib64/libblkid.so.1.1.0 2023-08-01T20:01:35.146 INFO:teuthology.orchestra.run.smithi101.stdout:sshd 6093 root mem REG 8,1 16192 25072 /usr/lib64/libkeyutils.so.1.6 2023-08-01T20:01:35.146 INFO:teuthology.orchestra.run.smithi101.stdout:sshd 6093 root mem REG 8,1 71472 26580 /usr/lib64/libkrb5support.so.0.1 2023-08-01T20:01:35.146 INFO:teuthology.orchestra.run.smithi101.stdout:sshd 6093 root mem REG 8,1 543304 24651 /usr/lib64/libpcre2-8.so.0.7.1 2023-08-01T20:01:35.146 INFO:teuthology.orchestra.run.smithi101.stdout:sshd 6093 root mem REG 8,1 149984 24708 /usr/lib64/libpthread-2.28.so 2023-08-01T20:01:35.149 INFO:teuthology.orchestra.run.smithi101.stdout:sshd 6093 root mem REG 8,1 99672 31445 /usr/lib64/libgcc_s-8-20210514.so.1 2023-08-01T20:01:35.149 INFO:teuthology.orchestra.run.smithi101.stdout:sshd 6093 root mem REG 8,1 1187312 25078 /usr/lib64/libgcrypt.so.20.2.5 2023-08-01T20:01:35.149 INFO:teuthology.orchestra.run.smithi101.stdout:sshd 6093 root mem REG 8,1 371480 19864 /usr/lib64/libmount.so.1.1.0 2023-08-01T20:01:35.149 INFO:teuthology.orchestra.run.smithi101.stdout:sshd 6093 root mem REG 8,1 33752 24776 /usr/lib64/libcap.so.2.48 2023-08-01T20:01:35.149 INFO:teuthology.orchestra.run.smithi101.stdout:sshd 6093 root mem REG 8,1 119760 25264 /usr/lib64/liblz4.so.1.8.3 2023-08-01T20:01:35.149 INFO:teuthology.orchestra.run.smithi101.stdout:sshd 6093 root mem REG 8,1 162192 24774 /usr/lib64/liblzma.so.5.2.4 2023-08-01T20:01:35.150 INFO:teuthology.orchestra.run.smithi101.stdout:sshd 6093 root mem REG 8,1 42744 24710 /usr/lib64/librt-2.28.so 2023-08-01T20:01:35.150 INFO:teuthology.orchestra.run.smithi101.stdout:sshd 6093 root mem REG 8,1 24928 25065 /usr/lib64/libcap-ng.so.0.0.0 2023-08-01T20:01:35.150 INFO:teuthology.orchestra.run.smithi101.stdout:sshd 6093 root mem REG 8,1 2089984 24698 /usr/lib64/libc-2.28.so 2023-08-01T20:01:35.150 INFO:teuthology.orchestra.run.smithi101.stdout:sshd 6093 root mem REG 8,1 16792 24764 /usr/lib64/libcom_err.so.2.1 2023-08-01T20:01:35.150 INFO:teuthology.orchestra.run.smithi101.stdout:sshd 6093 root mem REG 8,1 96288 26574 /usr/lib64/libk5crypto.so.3.1 2023-08-01T20:01:35.150 INFO:teuthology.orchestra.run.smithi101.stdout:sshd 6093 root mem REG 8,1 971432 26579 /usr/lib64/libkrb5.so.3.3 2023-08-01T20:01:35.150 INFO:teuthology.orchestra.run.smithi101.stdout:sshd 6093 root mem REG 8,1 355968 26571 /usr/lib64/libgssapi_krb5.so.2.2 2023-08-01T20:01:35.151 INFO:teuthology.orchestra.run.smithi101.stdout:sshd 6093 root mem REG 8,1 172104 24654 /usr/lib64/libselinux.so.1 2023-08-01T20:01:35.151 INFO:teuthology.orchestra.run.smithi101.stdout:sshd 6093 root mem REG 8,1 92968 24709 /usr/lib64/libresolv-2.28.so 2023-08-01T20:01:35.151 INFO:teuthology.orchestra.run.smithi101.stdout:sshd 6093 root mem REG 8,1 136040 24892 /usr/lib64/libcrypt.so.1.1.0 2023-08-01T20:01:35.151 INFO:teuthology.orchestra.run.smithi101.stdout:sshd 6093 root mem REG 8,1 99640 24762 /usr/lib64/libz.so.1.2.11 2023-08-01T20:01:35.151 INFO:teuthology.orchestra.run.smithi101.stdout:sshd 6093 root mem REG 8,1 17016 24713 /usr/lib64/libutil-2.28.so 2023-08-01T20:01:35.151 INFO:teuthology.orchestra.run.smithi101.stdout:sshd 6093 root mem REG 8,1 19128 24699 /usr/lib64/libdl-2.28.so 2023-08-01T20:01:35.151 INFO:teuthology.orchestra.run.smithi101.stdout:sshd 6093 root mem REG 8,1 3083608 26861 /usr/lib64/libcrypto.so.1.1.1k 2023-08-01T20:01:35.151 INFO:teuthology.orchestra.run.smithi101.stdout:sshd 6093 root mem REG 8,1 1387784 26786 /usr/lib64/libsystemd.so.0.23.0 2023-08-01T20:01:35.152 INFO:teuthology.orchestra.run.smithi101.stdout:sshd 6093 root mem REG 8,1 66504 27020 /usr/lib64/libpam.so.0.84.2 2023-08-01T20:01:35.152 INFO:teuthology.orchestra.run.smithi101.stdout:sshd 6093 root mem REG 8,1 135784 24768 /usr/lib64/libaudit.so.1.0.0 2023-08-01T20:01:35.152 INFO:teuthology.orchestra.run.smithi101.stdout:sshd 6093 root mem REG 8,1 1062168 24653 /usr/lib64/ld-2.28.so 2023-08-01T20:01:35.152 INFO:teuthology.orchestra.run.smithi101.stdout:sshd 6093 root 0u CHR 1,3 0t0 3083 /dev/null 2023-08-01T20:01:35.152 INFO:teuthology.orchestra.run.smithi101.stdout:sshd 6093 root 1u CHR 1,3 0t0 3083 /dev/null 2023-08-01T20:01:35.152 INFO:teuthology.orchestra.run.smithi101.stdout:sshd 6093 root 2u CHR 1,3 0t0 3083 /dev/null 2023-08-01T20:01:35.152 INFO:teuthology.orchestra.run.smithi101.stdout:sshd 6093 root 3u unix 0xffff9370586cc380 0t0 45084 type=DGRAM 2023-08-01T20:01:35.152 INFO:teuthology.orchestra.run.smithi101.stdout:sshd 6093 root 4u IPv4 34795 0t0 TCP smithi101.front.sepia.ceph.com:ssh->teuthology.front.sepia.ceph.com:45216 (ESTABLISHED) 2023-08-01T20:01:35.153 INFO:teuthology.orchestra.run.smithi101.stdout:sshd 6093 root 6u unix 0xffff93750c995580 0t0 41667 type=STREAM 2023-08-01T20:01:35.153 INFO:teuthology.orchestra.run.smithi101.stdout:sshd 6093 root 7w FIFO 0,24 0t0 44296 /run/systemd/sessions/1.ref 2023-08-01T20:01:35.153 INFO:teuthology.orchestra.run.smithi101.stdout:sshd 6093 root 8u unix 0xffff9370586cad00 0t0 45088 type=STREAM 2023-08-01T20:01:35.153 INFO:teuthology.orchestra.run.smithi101.stdout:systemd 6098 ubuntu cwd DIR 8,1 4096 2 / 2023-08-01T20:01:35.153 INFO:teuthology.orchestra.run.smithi101.stdout:systemd 6098 ubuntu rtd DIR 8,1 4096 2 / 2023-08-01T20:01:35.153 INFO:teuthology.orchestra.run.smithi101.stdout:systemd 6098 ubuntu txt REG 8,1 1609592 35683 /usr/lib/systemd/systemd 2023-08-01T20:01:35.153 INFO:teuthology.orchestra.run.smithi101.stdout:systemd 6098 ubuntu mem REG 8,1 1598840 24700 /usr/lib64/libm-2.28.so 2023-08-01T20:01:35.153 INFO:teuthology.orchestra.run.smithi101.stdout:systemd 6098 ubuntu mem REG 8,1 658136 26787 /usr/lib64/libudev.so.1.6.11 2023-08-01T20:01:35.154 INFO:teuthology.orchestra.run.smithi101.stdout:systemd 6098 ubuntu mem REG 8,1 735192 24831 /usr/lib64/libsepol.so.1 2023-08-01T20:01:35.154 INFO:teuthology.orchestra.run.smithi101.stdout:systemd 6098 ubuntu mem REG 8,1 1805368 25103 /usr/lib64/libunistring.so.2.1.0 2023-08-01T20:01:35.154 INFO:teuthology.orchestra.run.smithi101.stdout:systemd 6098 ubuntu mem REG 8,1 145984 24905 /usr/lib64/libgpg-error.so.0.24.2 2023-08-01T20:01:35.154 INFO:teuthology.orchestra.run.smithi101.stdout:systemd 6098 ubuntu mem REG 8,1 66920 24972 /usr/lib64/libjson-c.so.4.0.0 2023-08-01T20:01:35.154 INFO:teuthology.orchestra.run.smithi101.stdout:systemd 6098 ubuntu mem REG 8,1 371232 26853 /usr/lib64/libdevmapper.so.1.02 2023-08-01T20:01:35.154 INFO:teuthology.orchestra.run.smithi101.stdout:systemd 6098 ubuntu mem REG 8,1 26704 24976 /usr/lib64/libattr.so.1.1.2448 2023-08-01T20:01:35.154 INFO:teuthology.orchestra.run.smithi101.stdout:systemd 6098 ubuntu mem REG 8,1 3083608 26861 /usr/lib64/libcrypto.so.1.1.1k 2023-08-01T20:01:35.154 INFO:teuthology.orchestra.run.smithi101.stdout:systemd 6098 ubuntu mem REG 8,1 615744 26862 /usr/lib64/libssl.so.1.1.1k 2023-08-01T20:01:35.155 INFO:teuthology.orchestra.run.smithi101.stdout:systemd 6098 ubuntu mem REG 8,1 99640 24762 /usr/lib64/libz.so.1.2.11 2023-08-01T20:01:35.155 INFO:teuthology.orchestra.run.smithi101.stdout:systemd 6098 ubuntu mem REG 8,1 24928 25065 /usr/lib64/libcap-ng.so.0.0.0 2023-08-01T20:01:35.155 INFO:teuthology.orchestra.run.smithi101.stdout:systemd 6098 ubuntu mem REG 8,1 33480 19526 /usr/lib64/libuuid.so.1.3.0 2023-08-01T20:01:35.155 INFO:teuthology.orchestra.run.smithi101.stdout:systemd 6098 ubuntu mem REG 8,1 19128 24699 /usr/lib64/libdl-2.28.so 2023-08-01T20:01:35.155 INFO:teuthology.orchestra.run.smithi101.stdout:systemd 6098 ubuntu mem REG 8,1 543304 24651 /usr/lib64/libpcre2-8.so.0.7.1 2023-08-01T20:01:35.155 INFO:teuthology.orchestra.run.smithi101.stdout:systemd 6098 ubuntu mem REG 8,1 343680 19531 /usr/lib64/libblkid.so.1.1.0 2023-08-01T20:01:35.155 INFO:teuthology.orchestra.run.smithi101.stdout:systemd 6098 ubuntu mem REG 8,1 119760 25264 /usr/lib64/liblz4.so.1.8.3 2023-08-01T20:01:35.156 INFO:teuthology.orchestra.run.smithi101.stdout:systemd 6098 ubuntu mem REG 8,1 162192 24774 /usr/lib64/liblzma.so.5.2.4 2023-08-01T20:01:35.156 INFO:teuthology.orchestra.run.smithi101.stdout:systemd 6098 ubuntu mem REG 8,1 165624 25105 /usr/lib64/libidn2.so.0.3.6 2023-08-01T20:01:35.156 INFO:teuthology.orchestra.run.smithi101.stdout:systemd 6098 ubuntu mem REG 8,1 1187312 25078 /usr/lib64/libgcrypt.so.20.2.5 2023-08-01T20:01:35.156 INFO:teuthology.orchestra.run.smithi101.stdout:systemd 6098 ubuntu mem REG 8,1 526384 26885 /usr/lib64/libcryptsetup.so.12.6.0 2023-08-01T20:01:35.156 INFO:teuthology.orchestra.run.smithi101.stdout:systemd 6098 ubuntu mem REG 8,1 59272 24978 /usr/lib64/libacl.so.1.1.2253 2023-08-01T20:01:35.156 INFO:teuthology.orchestra.run.smithi101.stdout:systemd 6098 ubuntu mem REG 8,1 33752 24776 /usr/lib64/libcap.so.2.48 2023-08-01T20:01:35.156 INFO:teuthology.orchestra.run.smithi101.stdout:systemd 6098 ubuntu mem REG 8,1 2089984 24698 /usr/lib64/libc-2.28.so 2023-08-01T20:01:35.156 INFO:teuthology.orchestra.run.smithi101.stdout:systemd 6098 ubuntu mem REG 8,1 149984 24708 /usr/lib64/libpthread-2.28.so 2023-08-01T20:01:35.157 INFO:teuthology.orchestra.run.smithi101.stdout:systemd 6098 ubuntu mem REG 8,1 99672 31445 /usr/lib64/libgcc_s-8-20210514.so.1 2023-08-01T20:01:35.157 INFO:teuthology.orchestra.run.smithi101.stdout:systemd 6098 ubuntu mem REG 8,1 100200 26883 /usr/lib64/libkmod.so.2.3.3 2023-08-01T20:01:35.157 INFO:teuthology.orchestra.run.smithi101.stdout:systemd 6098 ubuntu mem REG 8,1 135784 24768 /usr/lib64/libaudit.so.1.0.0 2023-08-01T20:01:35.157 INFO:teuthology.orchestra.run.smithi101.stdout:systemd 6098 ubuntu mem REG 8,1 66504 27020 /usr/lib64/libpam.so.0.84.2 2023-08-01T20:01:35.157 INFO:teuthology.orchestra.run.smithi101.stdout:systemd 6098 ubuntu mem REG 8,1 371480 19864 /usr/lib64/libmount.so.1.1.0 2023-08-01T20:01:35.157 INFO:teuthology.orchestra.run.smithi101.stdout:systemd 6098 ubuntu mem REG 8,1 172104 24654 /usr/lib64/libselinux.so.1 2023-08-01T20:01:35.157 INFO:teuthology.orchestra.run.smithi101.stdout:systemd 6098 ubuntu mem REG 8,1 128792 25521 /usr/lib64/libseccomp.so.2.5.2 2023-08-01T20:01:35.157 INFO:teuthology.orchestra.run.smithi101.stdout:systemd 6098 ubuntu mem REG 8,1 42744 24710 /usr/lib64/librt-2.28.so 2023-08-01T20:01:35.158 INFO:teuthology.orchestra.run.smithi101.stdout:systemd 6098 ubuntu mem REG 8,1 2761368 35660 /usr/lib/systemd/libsystemd-shared-239.so 2023-08-01T20:01:35.158 INFO:teuthology.orchestra.run.smithi101.stdout:systemd 6098 ubuntu mem REG 8,1 1062168 24653 /usr/lib64/ld-2.28.so 2023-08-01T20:01:35.158 INFO:teuthology.orchestra.run.smithi101.stdout:systemd 6098 ubuntu 0r CHR 1,3 0t0 3083 /dev/null 2023-08-01T20:01:35.158 INFO:teuthology.orchestra.run.smithi101.stdout:systemd 6098 ubuntu 1u unix 0xffff93750c986c00 0t0 43179 type=STREAM 2023-08-01T20:01:35.158 INFO:teuthology.orchestra.run.smithi101.stdout:systemd 6098 ubuntu 2u unix 0xffff93750c986c00 0t0 43179 type=STREAM 2023-08-01T20:01:35.158 INFO:teuthology.orchestra.run.smithi101.stdout:systemd 6098 ubuntu 3u unix 0xffff937080487980 0t0 42100 type=DGRAM 2023-08-01T20:01:35.158 INFO:teuthology.orchestra.run.smithi101.stdout:systemd 6098 ubuntu 4u a_inode 0,14 0 15587 [eventpoll] 2023-08-01T20:01:35.158 INFO:teuthology.orchestra.run.smithi101.stdout:systemd 6098 ubuntu 5u a_inode 0,14 0 15587 [signalfd] 2023-08-01T20:01:35.159 INFO:teuthology.orchestra.run.smithi101.stdout:systemd 6098 ubuntu 6r DIR 0,26 0 798 /sys/fs/cgroup/systemd/user.slice/user-1000.slice/user@1000.service 2023-08-01T20:01:35.159 INFO:teuthology.orchestra.run.smithi101.stdout:systemd 6098 ubuntu 7u a_inode 0,14 0 15587 [timerfd] 2023-08-01T20:01:35.159 INFO:teuthology.orchestra.run.smithi101.stdout:systemd 6098 ubuntu 8u netlink 0t0 42107 KOBJECT_UEVENT 2023-08-01T20:01:35.159 INFO:teuthology.orchestra.run.smithi101.stdout:systemd 6098 ubuntu 9u a_inode 0,14 0 15587 [eventpoll] 2023-08-01T20:01:35.159 INFO:teuthology.orchestra.run.smithi101.stdout:systemd 6098 ubuntu 10r a_inode 0,14 0 15587 inotify 2023-08-01T20:01:35.159 INFO:teuthology.orchestra.run.smithi101.stdout:systemd 6098 ubuntu 11u unix 0xffff937080480480 0t0 42124 /run/user/1000/bus type=STREAM 2023-08-01T20:01:35.159 INFO:teuthology.orchestra.run.smithi101.stdout:systemd 6098 ubuntu 12r REG 0,5 0 43192 /proc/6098/mountinfo 2023-08-01T20:01:35.159 INFO:teuthology.orchestra.run.smithi101.stdout:systemd 6098 ubuntu 13r a_inode 0,14 0 15587 inotify 2023-08-01T20:01:35.160 INFO:teuthology.orchestra.run.smithi101.stdout:systemd 6098 ubuntu 14r REG 0,5 0 4026532074 /proc/swaps 2023-08-01T20:01:35.160 INFO:teuthology.orchestra.run.smithi101.stdout:systemd 6098 ubuntu 15u unix 0xffff937080483f00 0t0 42112 /run/user/1000/systemd/notify type=DGRAM 2023-08-01T20:01:35.160 INFO:teuthology.orchestra.run.smithi101.stdout:systemd 6098 ubuntu 16u unix 0xffff937080484380 0t0 42114 type=DGRAM 2023-08-01T20:01:35.160 INFO:teuthology.orchestra.run.smithi101.stdout:systemd 6098 ubuntu 17u unix 0xffff937080483600 0t0 42115 type=DGRAM 2023-08-01T20:01:35.160 INFO:teuthology.orchestra.run.smithi101.stdout:systemd 6098 ubuntu 18u unix 0xffff937080481200 0t0 42116 /run/user/1000/systemd/private type=STREAM 2023-08-01T20:01:35.160 INFO:teuthology.orchestra.run.smithi101.stdout:systemd 6098 ubuntu 19u unix 0xffff937080481680 0t0 42118 type=STREAM 2023-08-01T20:01:35.160 INFO:teuthology.orchestra.run.smithi101.stdout:systemd 6098 ubuntu 20u a_inode 0,14 0 15587 [timerfd] 2023-08-01T20:01:35.161 INFO:teuthology.orchestra.run.smithi101.stdout:systemd 6098 ubuntu 26u netlink 0t0 42127 SELINUX 2023-08-01T20:01:35.161 INFO:teuthology.orchestra.run.smithi101.stdout:(sd-pam) 6101 ubuntu cwd DIR 8,1 4096 2 / 2023-08-01T20:01:35.161 INFO:teuthology.orchestra.run.smithi101.stdout:(sd-pam) 6101 ubuntu rtd DIR 8,1 4096 2 / 2023-08-01T20:01:35.161 INFO:teuthology.orchestra.run.smithi101.stdout:(sd-pam) 6101 ubuntu txt REG 8,1 1609592 35683 /usr/lib/systemd/systemd 2023-08-01T20:01:35.161 INFO:teuthology.orchestra.run.smithi101.stdout:(sd-pam) 6101 ubuntu mem REG 8,1 7592 47477 /usr/lib64/security/pam_deny.so 2023-08-01T20:01:35.161 INFO:teuthology.orchestra.run.smithi101.stdout:(sd-pam) 6101 ubuntu mem REG 8,1 15968 47495 /usr/lib64/security/pam_succeed_if.so 2023-08-01T20:01:35.161 INFO:teuthology.orchestra.run.smithi101.stdout:(sd-pam) 6101 ubuntu mem REG 8,1 16608 27021 /usr/lib64/libpam_misc.so.0.82.1 2023-08-01T20:01:35.161 INFO:teuthology.orchestra.run.smithi101.stdout:(sd-pam) 6101 ubuntu mem REG 8,1 944496 49192 /usr/lib64/security/pam_systemd.so 2023-08-01T20:01:35.162 INFO:teuthology.orchestra.run.smithi101.stdout:(sd-pam) 6101 ubuntu mem REG 8,1 24080 49091 /usr/lib64/security/pam_limits.so 2023-08-01T20:01:35.162 INFO:teuthology.orchestra.run.smithi101.stdout:(sd-pam) 6101 ubuntu mem REG 8,1 11848 47484 /usr/lib64/security/pam_keyinit.so 2023-08-01T20:01:35.162 INFO:teuthology.orchestra.run.smithi101.stdout:(sd-pam) 6101 ubuntu mem REG 8,1 45384 49095 /usr/lib64/security/pam_namespace.so 2023-08-01T20:01:35.162 INFO:teuthology.orchestra.run.smithi101.stdout:(sd-pam) 6101 ubuntu mem REG 8,1 11800 49093 /usr/lib64/security/pam_loginuid.so 2023-08-01T20:01:35.162 INFO:teuthology.orchestra.run.smithi101.stdout:(sd-pam) 6101 ubuntu mem REG 8,1 24200 47492 /usr/lib64/security/pam_selinux.so 2023-08-01T20:01:35.162 INFO:teuthology.orchestra.run.smithi101.stdout:(sd-pam) 6101 ubuntu mem REG 8,1 7672 49097 /usr/lib64/security/pam_permit.so 2023-08-01T20:01:35.162 INFO:teuthology.orchestra.run.smithi101.stdout:(sd-pam) 6101 ubuntu mem REG 8,1 57992 47800 /usr/lib64/security/pam_sss.so 2023-08-01T20:01:35.162 INFO:teuthology.orchestra.run.smithi101.stdout:(sd-pam) 6101 ubuntu mem REG 8,1 11848 47503 /usr/lib64/security/pam_usertype.so 2023-08-01T20:01:35.163 INFO:teuthology.orchestra.run.smithi101.stdout:(sd-pam) 6101 ubuntu mem REG 8,1 11776 47485 /usr/lib64/security/pam_localuser.so 2023-08-01T20:01:35.163 INFO:teuthology.orchestra.run.smithi101.stdout:(sd-pam) 6101 ubuntu mem REG 8,1 92968 24709 /usr/lib64/libresolv-2.28.so 2023-08-01T20:01:35.163 INFO:teuthology.orchestra.run.smithi101.stdout:(sd-pam) 6101 ubuntu mem REG 8,1 16192 25072 /usr/lib64/libkeyutils.so.1.6 2023-08-01T20:01:35.163 INFO:teuthology.orchestra.run.smithi101.stdout:(sd-pam) 6101 ubuntu mem REG 8,1 71472 26580 /usr/lib64/libkrb5support.so.0.1 2023-08-01T20:01:35.163 INFO:teuthology.orchestra.run.smithi101.stdout:(sd-pam) 6101 ubuntu mem REG 8,1 16792 24764 /usr/lib64/libcom_err.so.2.1 2023-08-01T20:01:35.163 INFO:teuthology.orchestra.run.smithi101.stdout:(sd-pam) 6101 ubuntu mem REG 8,1 96288 26574 /usr/lib64/libk5crypto.so.3.1 2023-08-01T20:01:35.163 INFO:teuthology.orchestra.run.smithi101.stdout:(sd-pam) 6101 ubuntu mem REG 8,1 971432 26579 /usr/lib64/libkrb5.so.3.3 2023-08-01T20:01:35.163 INFO:teuthology.orchestra.run.smithi101.stdout:(sd-pam) 6101 ubuntu mem REG 8,1 355968 26571 /usr/lib64/libgssapi_krb5.so.2.2 2023-08-01T20:01:35.164 INFO:teuthology.orchestra.run.smithi101.stdout:(sd-pam) 6101 ubuntu mem REG 8,1 217696 26588 /usr/lib64/libtirpc.so.3.0.0 2023-08-01T20:01:35.164 INFO:teuthology.orchestra.run.smithi101.stdout:(sd-pam) 6101 ubuntu mem REG 8,1 120592 26590 /usr/lib64/libnsl.so.2.0.0 2023-08-01T20:01:35.164 INFO:teuthology.orchestra.run.smithi101.stdout:(sd-pam) 6101 ubuntu mem REG 8,1 136040 24892 /usr/lib64/libcrypt.so.1.1.0 2023-08-01T20:01:35.164 INFO:teuthology.orchestra.run.smithi101.stdout:(sd-pam) 6101 ubuntu mem REG 8,1 58096 49102 /usr/lib64/security/pam_unix.so 2023-08-01T20:01:35.164 INFO:teuthology.orchestra.run.smithi101.stdout:(sd-pam) 6101 ubuntu mem REG 8,1 944528 26785 /usr/lib64/libnss_systemd.so.2 2023-08-01T20:01:35.164 INFO:teuthology.orchestra.run.smithi101.stdout:(sd-pam) 6101 ubuntu mem REG 8,1 46336 29167 /usr/lib64/libnss_sss.so.2 2023-08-01T20:01:35.164 INFO:teuthology.orchestra.run.smithi101.stdout:(sd-pam) 6101 ubuntu mem REG 8,1 54352 24707 /usr/lib64/libnss_files-2.28.so 2023-08-01T20:01:35.164 INFO:teuthology.orchestra.run.smithi101.stdout:(sd-pam) 6101 ubuntu mem REG 8,1 1598840 24700 /usr/lib64/libm-2.28.so 2023-08-01T20:01:35.165 INFO:teuthology.orchestra.run.smithi101.stdout:(sd-pam) 6101 ubuntu mem REG 8,1 658136 26787 /usr/lib64/libudev.so.1.6.11 2023-08-01T20:01:35.165 INFO:teuthology.orchestra.run.smithi101.stdout:(sd-pam) 6101 ubuntu mem REG 8,1 735192 24831 /usr/lib64/libsepol.so.1 2023-08-01T20:01:35.165 INFO:teuthology.orchestra.run.smithi101.stdout:(sd-pam) 6101 ubuntu mem REG 8,1 1805368 25103 /usr/lib64/libunistring.so.2.1.0 2023-08-01T20:01:35.165 INFO:teuthology.orchestra.run.smithi101.stdout:(sd-pam) 6101 ubuntu mem REG 8,1 145984 24905 /usr/lib64/libgpg-error.so.0.24.2 2023-08-01T20:01:35.165 INFO:teuthology.orchestra.run.smithi101.stdout:(sd-pam) 6101 ubuntu mem REG 8,1 66920 24972 /usr/lib64/libjson-c.so.4.0.0 2023-08-01T20:01:35.165 INFO:teuthology.orchestra.run.smithi101.stdout:(sd-pam) 6101 ubuntu mem REG 8,1 371232 26853 /usr/lib64/libdevmapper.so.1.02 2023-08-01T20:01:35.165 INFO:teuthology.orchestra.run.smithi101.stdout:(sd-pam) 6101 ubuntu mem REG 8,1 26704 24976 /usr/lib64/libattr.so.1.1.2448 2023-08-01T20:01:35.165 INFO:teuthology.orchestra.run.smithi101.stdout:(sd-pam) 6101 ubuntu mem REG 8,1 3083608 26861 /usr/lib64/libcrypto.so.1.1.1k 2023-08-01T20:01:35.166 INFO:teuthology.orchestra.run.smithi101.stdout:(sd-pam) 6101 ubuntu mem REG 8,1 615744 26862 /usr/lib64/libssl.so.1.1.1k 2023-08-01T20:01:35.166 INFO:teuthology.orchestra.run.smithi101.stdout:(sd-pam) 6101 ubuntu mem REG 8,1 99640 24762 /usr/lib64/libz.so.1.2.11 2023-08-01T20:01:35.166 INFO:teuthology.orchestra.run.smithi101.stdout:(sd-pam) 6101 ubuntu mem REG 8,1 24928 25065 /usr/lib64/libcap-ng.so.0.0.0 2023-08-01T20:01:35.166 INFO:teuthology.orchestra.run.smithi101.stdout:(sd-pam) 6101 ubuntu mem REG 8,1 33480 19526 /usr/lib64/libuuid.so.1.3.0 2023-08-01T20:01:35.166 INFO:teuthology.orchestra.run.smithi101.stdout:(sd-pam) 6101 ubuntu mem REG 8,1 19128 24699 /usr/lib64/libdl-2.28.so 2023-08-01T20:01:35.166 INFO:teuthology.orchestra.run.smithi101.stdout:(sd-pam) 6101 ubuntu mem REG 8,1 543304 24651 /usr/lib64/libpcre2-8.so.0.7.1 2023-08-01T20:01:35.166 INFO:teuthology.orchestra.run.smithi101.stdout:(sd-pam) 6101 ubuntu mem REG 8,1 343680 19531 /usr/lib64/libblkid.so.1.1.0 2023-08-01T20:01:35.167 INFO:teuthology.orchestra.run.smithi101.stdout:(sd-pam) 6101 ubuntu mem REG 8,1 119760 25264 /usr/lib64/liblz4.so.1.8.3 2023-08-01T20:01:35.167 INFO:teuthology.orchestra.run.smithi101.stdout:(sd-pam) 6101 ubuntu mem REG 8,1 162192 24774 /usr/lib64/liblzma.so.5.2.4 2023-08-01T20:01:35.167 INFO:teuthology.orchestra.run.smithi101.stdout:(sd-pam) 6101 ubuntu mem REG 8,1 165624 25105 /usr/lib64/libidn2.so.0.3.6 2023-08-01T20:01:35.167 INFO:teuthology.orchestra.run.smithi101.stdout:(sd-pam) 6101 ubuntu mem REG 8,1 1187312 25078 /usr/lib64/libgcrypt.so.20.2.5 2023-08-01T20:01:35.167 INFO:teuthology.orchestra.run.smithi101.stdout:(sd-pam) 6101 ubuntu mem REG 8,1 526384 26885 /usr/lib64/libcryptsetup.so.12.6.0 2023-08-01T20:01:35.167 INFO:teuthology.orchestra.run.smithi101.stdout:(sd-pam) 6101 ubuntu mem REG 8,1 59272 24978 /usr/lib64/libacl.so.1.1.2253 2023-08-01T20:01:35.167 INFO:teuthology.orchestra.run.smithi101.stdout:(sd-pam) 6101 ubuntu mem REG 8,1 33752 24776 /usr/lib64/libcap.so.2.48 2023-08-01T20:01:35.167 INFO:teuthology.orchestra.run.smithi101.stdout:(sd-pam) 6101 ubuntu mem REG 8,1 2089984 24698 /usr/lib64/libc-2.28.so 2023-08-01T20:01:35.168 INFO:teuthology.orchestra.run.smithi101.stdout:(sd-pam) 6101 ubuntu mem REG 8,1 149984 24708 /usr/lib64/libpthread-2.28.so 2023-08-01T20:01:35.168 INFO:teuthology.orchestra.run.smithi101.stdout:(sd-pam) 6101 ubuntu mem REG 8,1 99672 31445 /usr/lib64/libgcc_s-8-20210514.so.1 2023-08-01T20:01:35.168 INFO:teuthology.orchestra.run.smithi101.stdout:(sd-pam) 6101 ubuntu mem REG 8,1 100200 26883 /usr/lib64/libkmod.so.2.3.3 2023-08-01T20:01:35.168 INFO:teuthology.orchestra.run.smithi101.stdout:(sd-pam) 6101 ubuntu mem REG 8,1 135784 24768 /usr/lib64/libaudit.so.1.0.0 2023-08-01T20:01:35.168 INFO:teuthology.orchestra.run.smithi101.stdout:(sd-pam) 6101 ubuntu mem REG 8,1 66504 27020 /usr/lib64/libpam.so.0.84.2 2023-08-01T20:01:35.168 INFO:teuthology.orchestra.run.smithi101.stdout:(sd-pam) 6101 ubuntu mem REG 8,1 371480 19864 /usr/lib64/libmount.so.1.1.0 2023-08-01T20:01:35.168 INFO:teuthology.orchestra.run.smithi101.stdout:(sd-pam) 6101 ubuntu mem REG 8,1 172104 24654 /usr/lib64/libselinux.so.1 2023-08-01T20:01:35.168 INFO:teuthology.orchestra.run.smithi101.stdout:(sd-pam) 6101 ubuntu mem REG 8,1 128792 25521 /usr/lib64/libseccomp.so.2.5.2 2023-08-01T20:01:35.169 INFO:teuthology.orchestra.run.smithi101.stdout:(sd-pam) 6101 ubuntu mem REG 8,1 42744 24710 /usr/lib64/librt-2.28.so 2023-08-01T20:01:35.169 INFO:teuthology.orchestra.run.smithi101.stdout:(sd-pam) 6101 ubuntu mem REG 8,1 2761368 35660 /usr/lib/systemd/libsystemd-shared-239.so 2023-08-01T20:01:35.169 INFO:teuthology.orchestra.run.smithi101.stdout:(sd-pam) 6101 ubuntu mem REG 8,1 1062168 24653 /usr/lib64/ld-2.28.so 2023-08-01T20:01:35.169 INFO:teuthology.orchestra.run.smithi101.stdout:(sd-pam) 6101 ubuntu mem REG 8,1 579864 16755 /etc/selinux/targeted/contexts/files/file_contexts.bin 2023-08-01T20:01:35.169 INFO:teuthology.orchestra.run.smithi101.stdout:(sd-pam) 6101 ubuntu mem REG 8,1 19983 16806 /etc/selinux/targeted/contexts/files/file_contexts.homedirs.bin 2023-08-01T20:01:35.169 INFO:teuthology.orchestra.run.smithi101.stdout:(sd-pam) 6101 ubuntu 0r CHR 1,3 0t0 3083 /dev/null 2023-08-01T20:01:35.169 INFO:teuthology.orchestra.run.smithi101.stdout:(sd-pam) 6101 ubuntu 1u unix 0xffff93750c986c00 0t0 43179 type=STREAM 2023-08-01T20:01:35.169 INFO:teuthology.orchestra.run.smithi101.stdout:(sd-pam) 6101 ubuntu 2u unix 0xffff93750c986c00 0t0 43179 type=STREAM 2023-08-01T20:01:35.170 INFO:teuthology.orchestra.run.smithi101.stdout:(sd-pam) 6101 ubuntu 3u a_inode 0,14 0 15587 [eventfd] 2023-08-01T20:01:35.170 INFO:teuthology.orchestra.run.smithi101.stdout:(sd-pam) 6101 ubuntu 4u a_inode 0,14 0 15587 [eventfd] 2023-08-01T20:01:35.170 INFO:teuthology.orchestra.run.smithi101.stdout:(sd-pam) 6101 ubuntu 6w FIFO 0,13 0t0 43180 pipe 2023-08-01T20:01:35.170 INFO:teuthology.orchestra.run.smithi101.stdout:(sd-pam) 6101 ubuntu 7u unix 0xffff93750c980480 0t0 43193 type=DGRAM 2023-08-01T20:01:35.170 INFO:teuthology.orchestra.run.smithi101.stdout:sshd 6113 ubuntu cwd DIR 8,1 4096 2 / 2023-08-01T20:01:35.170 INFO:teuthology.orchestra.run.smithi101.stdout:sshd 6113 ubuntu rtd DIR 8,1 4096 2 / 2023-08-01T20:01:35.170 INFO:teuthology.orchestra.run.smithi101.stdout:sshd 6113 ubuntu txt REG 8,1 890504 30329 /usr/sbin/sshd 2023-08-01T20:01:35.170 INFO:teuthology.orchestra.run.smithi101.stdout:sshd 6113 ubuntu mem REG 8,1 944528 26785 /usr/lib64/libnss_systemd.so.2 2023-08-01T20:01:35.171 INFO:teuthology.orchestra.run.smithi101.stdout:sshd 6113 ubuntu mem REG 8,1 46336 29167 /usr/lib64/libnss_sss.so.2 2023-08-01T20:01:35.171 INFO:teuthology.orchestra.run.smithi101.stdout:sshd 6113 ubuntu mem REG 8,1 20168 49090 /usr/lib64/security/pam_lastlog.so 2023-08-01T20:01:35.171 INFO:teuthology.orchestra.run.smithi101.stdout:sshd 6113 ubuntu mem REG 8,1 11760 47498 /usr/lib64/security/pam_umask.so 2023-08-01T20:01:35.171 INFO:teuthology.orchestra.run.smithi101.stdout:sshd 6113 ubuntu mem REG 8,1 15968 47495 /usr/lib64/security/pam_succeed_if.so 2023-08-01T20:01:35.171 INFO:teuthology.orchestra.run.smithi101.stdout:sshd 6113 ubuntu mem REG 8,1 16608 27021 /usr/lib64/libpam_misc.so.0.82.1 2023-08-01T20:01:35.171 INFO:teuthology.orchestra.run.smithi101.stdout:sshd 6113 ubuntu mem REG 8,1 944496 49192 /usr/lib64/security/pam_systemd.so 2023-08-01T20:01:35.171 INFO:teuthology.orchestra.run.smithi101.stdout:sshd 6113 ubuntu mem REG 8,1 24080 49091 /usr/lib64/security/pam_limits.so 2023-08-01T20:01:35.171 INFO:teuthology.orchestra.run.smithi101.stdout:sshd 6113 ubuntu mem REG 8,1 11824 47487 /usr/lib64/security/pam_motd.so 2023-08-01T20:01:35.172 INFO:teuthology.orchestra.run.smithi101.stdout:sshd 6113 ubuntu mem REG 8,1 11848 47484 /usr/lib64/security/pam_keyinit.so 2023-08-01T20:01:35.172 INFO:teuthology.orchestra.run.smithi101.stdout:sshd 6113 ubuntu mem REG 8,1 45384 49095 /usr/lib64/security/pam_namespace.so 2023-08-01T20:01:35.172 INFO:teuthology.orchestra.run.smithi101.stdout:sshd 6113 ubuntu mem REG 8,1 11800 49093 /usr/lib64/security/pam_loginuid.so 2023-08-01T20:01:35.172 INFO:teuthology.orchestra.run.smithi101.stdout:sshd 6113 ubuntu mem REG 8,1 24200 47492 /usr/lib64/security/pam_selinux.so 2023-08-01T20:01:35.172 INFO:teuthology.orchestra.run.smithi101.stdout:sshd 6113 ubuntu mem REG 8,1 46232 26496 /usr/lib64/libcrack.so.2.9.0 2023-08-01T20:01:35.172 INFO:teuthology.orchestra.run.smithi101.stdout:sshd 6113 ubuntu mem REG 8,1 24832 26985 /usr/lib64/libpwquality.so.1.0.2 2023-08-01T20:01:35.172 INFO:teuthology.orchestra.run.smithi101.stdout:sshd 6113 ubuntu mem REG 8,1 11768 49040 /usr/lib64/security/pam_pwquality.so 2023-08-01T20:01:35.173 INFO:teuthology.orchestra.run.smithi101.stdout:sshd 6113 ubuntu mem REG 8,1 7672 49097 /usr/lib64/security/pam_permit.so 2023-08-01T20:01:35.173 INFO:teuthology.orchestra.run.smithi101.stdout:sshd 6113 ubuntu mem REG 8,1 11808 49096 /usr/lib64/security/pam_nologin.so 2023-08-01T20:01:35.173 INFO:teuthology.orchestra.run.smithi101.stdout:sshd 6113 ubuntu mem REG 8,1 15920 47493 /usr/lib64/security/pam_sepermit.so 2023-08-01T20:01:35.173 INFO:teuthology.orchestra.run.smithi101.stdout:sshd 6113 ubuntu mem REG 8,1 7592 47477 /usr/lib64/security/pam_deny.so 2023-08-01T20:01:35.173 INFO:teuthology.orchestra.run.smithi101.stdout:sshd 6113 ubuntu mem REG 8,1 57992 47800 /usr/lib64/security/pam_sss.so 2023-08-01T20:01:35.173 INFO:teuthology.orchestra.run.smithi101.stdout:sshd 6113 ubuntu mem REG 8,1 217696 26588 /usr/lib64/libtirpc.so.3.0.0 2023-08-01T20:01:35.173 INFO:teuthology.orchestra.run.smithi101.stdout:sshd 6113 ubuntu mem REG 8,1 120592 26590 /usr/lib64/libnsl.so.2.0.0 2023-08-01T20:01:35.173 INFO:teuthology.orchestra.run.smithi101.stdout:sshd 6113 ubuntu mem REG 8,1 58096 49102 /usr/lib64/security/pam_unix.so 2023-08-01T20:01:35.174 INFO:teuthology.orchestra.run.smithi101.stdout:sshd 6113 ubuntu mem REG 8,1 11776 47485 /usr/lib64/security/pam_localuser.so 2023-08-01T20:01:35.174 INFO:teuthology.orchestra.run.smithi101.stdout:sshd 6113 ubuntu mem REG 8,1 11848 47503 /usr/lib64/security/pam_usertype.so 2023-08-01T20:01:35.174 INFO:teuthology.orchestra.run.smithi101.stdout:sshd 6113 ubuntu mem REG 8,1 11752 47479 /usr/lib64/security/pam_faildelay.so 2023-08-01T20:01:35.174 INFO:teuthology.orchestra.run.smithi101.stdout:sshd 6113 ubuntu mem REG 8,1 20192 47478 /usr/lib64/security/pam_env.so 2023-08-01T20:01:35.174 INFO:teuthology.orchestra.run.smithi101.stdout:sshd 6113 ubuntu mem REG 8,1 54352 24707 /usr/lib64/libnss_files-2.28.so 2023-08-01T20:01:35.174 INFO:teuthology.orchestra.run.smithi101.stdout:sshd 6113 ubuntu mem REG 8,1 145984 24905 /usr/lib64/libgpg-error.so.0.24.2 2023-08-01T20:01:35.174 INFO:teuthology.orchestra.run.smithi101.stdout:sshd 6113 ubuntu mem REG 8,1 33480 19526 /usr/lib64/libuuid.so.1.3.0 2023-08-01T20:01:35.174 INFO:teuthology.orchestra.run.smithi101.stdout:sshd 6113 ubuntu mem REG 8,1 343680 19531 /usr/lib64/libblkid.so.1.1.0 2023-08-01T20:01:35.175 INFO:teuthology.orchestra.run.smithi101.stdout:sshd 6113 ubuntu mem REG 8,1 16192 25072 /usr/lib64/libkeyutils.so.1.6 2023-08-01T20:01:35.175 INFO:teuthology.orchestra.run.smithi101.stdout:sshd 6113 ubuntu mem REG 8,1 71472 26580 /usr/lib64/libkrb5support.so.0.1 2023-08-01T20:01:35.175 INFO:teuthology.orchestra.run.smithi101.stdout:sshd 6113 ubuntu mem REG 8,1 543304 24651 /usr/lib64/libpcre2-8.so.0.7.1 2023-08-01T20:01:35.175 INFO:teuthology.orchestra.run.smithi101.stdout:sshd 6113 ubuntu mem REG 8,1 149984 24708 /usr/lib64/libpthread-2.28.so 2023-08-01T20:01:35.175 INFO:teuthology.orchestra.run.smithi101.stdout:sshd 6113 ubuntu mem REG 8,1 99672 31445 /usr/lib64/libgcc_s-8-20210514.so.1 2023-08-01T20:01:35.175 INFO:teuthology.orchestra.run.smithi101.stdout:sshd 6113 ubuntu mem REG 8,1 1187312 25078 /usr/lib64/libgcrypt.so.20.2.5 2023-08-01T20:01:35.175 INFO:teuthology.orchestra.run.smithi101.stdout:sshd 6113 ubuntu mem REG 8,1 371480 19864 /usr/lib64/libmount.so.1.1.0 2023-08-01T20:01:35.175 INFO:teuthology.orchestra.run.smithi101.stdout:sshd 6113 ubuntu mem REG 8,1 33752 24776 /usr/lib64/libcap.so.2.48 2023-08-01T20:01:35.176 INFO:teuthology.orchestra.run.smithi101.stdout:sshd 6113 ubuntu mem REG 8,1 119760 25264 /usr/lib64/liblz4.so.1.8.3 2023-08-01T20:01:35.176 INFO:teuthology.orchestra.run.smithi101.stdout:sshd 6113 ubuntu mem REG 8,1 162192 24774 /usr/lib64/liblzma.so.5.2.4 2023-08-01T20:01:35.176 INFO:teuthology.orchestra.run.smithi101.stdout:sshd 6113 ubuntu mem REG 8,1 42744 24710 /usr/lib64/librt-2.28.so 2023-08-01T20:01:35.176 INFO:teuthology.orchestra.run.smithi101.stdout:sshd 6113 ubuntu mem REG 8,1 24928 25065 /usr/lib64/libcap-ng.so.0.0.0 2023-08-01T20:01:35.176 INFO:teuthology.orchestra.run.smithi101.stdout:sshd 6113 ubuntu mem REG 8,1 2089984 24698 /usr/lib64/libc-2.28.so 2023-08-01T20:01:35.176 INFO:teuthology.orchestra.run.smithi101.stdout:sshd 6113 ubuntu mem REG 8,1 16792 24764 /usr/lib64/libcom_err.so.2.1 2023-08-01T20:01:35.176 INFO:teuthology.orchestra.run.smithi101.stdout:sshd 6113 ubuntu mem REG 8,1 96288 26574 /usr/lib64/libk5crypto.so.3.1 2023-08-01T20:01:35.176 INFO:teuthology.orchestra.run.smithi101.stdout:sshd 6113 ubuntu mem REG 8,1 971432 26579 /usr/lib64/libkrb5.so.3.3 2023-08-01T20:01:35.177 INFO:teuthology.orchestra.run.smithi101.stdout:sshd 6113 ubuntu mem REG 8,1 355968 26571 /usr/lib64/libgssapi_krb5.so.2.2 2023-08-01T20:01:35.177 INFO:teuthology.orchestra.run.smithi101.stdout:sshd 6113 ubuntu mem REG 8,1 172104 24654 /usr/lib64/libselinux.so.1 2023-08-01T20:01:35.177 INFO:teuthology.orchestra.run.smithi101.stdout:sshd 6113 ubuntu mem REG 8,1 92968 24709 /usr/lib64/libresolv-2.28.so 2023-08-01T20:01:35.177 INFO:teuthology.orchestra.run.smithi101.stdout:sshd 6113 ubuntu mem REG 8,1 136040 24892 /usr/lib64/libcrypt.so.1.1.0 2023-08-01T20:01:35.177 INFO:teuthology.orchestra.run.smithi101.stdout:sshd 6113 ubuntu mem REG 8,1 99640 24762 /usr/lib64/libz.so.1.2.11 2023-08-01T20:01:35.177 INFO:teuthology.orchestra.run.smithi101.stdout:sshd 6113 ubuntu mem REG 8,1 17016 24713 /usr/lib64/libutil-2.28.so 2023-08-01T20:01:35.177 INFO:teuthology.orchestra.run.smithi101.stdout:sshd 6113 ubuntu mem REG 8,1 19128 24699 /usr/lib64/libdl-2.28.so 2023-08-01T20:01:35.177 INFO:teuthology.orchestra.run.smithi101.stdout:sshd 6113 ubuntu mem REG 8,1 3083608 26861 /usr/lib64/libcrypto.so.1.1.1k 2023-08-01T20:01:35.178 INFO:teuthology.orchestra.run.smithi101.stdout:sshd 6113 ubuntu mem REG 8,1 1387784 26786 /usr/lib64/libsystemd.so.0.23.0 2023-08-01T20:01:35.178 INFO:teuthology.orchestra.run.smithi101.stdout:sshd 6113 ubuntu mem REG 8,1 66504 27020 /usr/lib64/libpam.so.0.84.2 2023-08-01T20:01:35.178 INFO:teuthology.orchestra.run.smithi101.stdout:sshd 6113 ubuntu mem REG 8,1 135784 24768 /usr/lib64/libaudit.so.1.0.0 2023-08-01T20:01:35.178 INFO:teuthology.orchestra.run.smithi101.stdout:sshd 6113 ubuntu mem REG 8,1 1062168 24653 /usr/lib64/ld-2.28.so 2023-08-01T20:01:35.178 INFO:teuthology.orchestra.run.smithi101.stdout:sshd 6113 ubuntu 0u CHR 1,3 0t0 3083 /dev/null 2023-08-01T20:01:35.178 INFO:teuthology.orchestra.run.smithi101.stdout:sshd 6113 ubuntu 1u CHR 1,3 0t0 3083 /dev/null 2023-08-01T20:01:35.178 INFO:teuthology.orchestra.run.smithi101.stdout:sshd 6113 ubuntu 2u CHR 1,3 0t0 3083 /dev/null 2023-08-01T20:01:35.179 INFO:teuthology.orchestra.run.smithi101.stdout:sshd 6113 ubuntu 3u unix 0xffff9370586cc380 0t0 45084 type=DGRAM 2023-08-01T20:01:35.179 INFO:teuthology.orchestra.run.smithi101.stdout:sshd 6113 ubuntu 4u IPv4 34795 0t0 TCP smithi101.front.sepia.ceph.com:ssh->teuthology.front.sepia.ceph.com:45216 (ESTABLISHED) 2023-08-01T20:01:35.179 INFO:teuthology.orchestra.run.smithi101.stdout:sshd 6113 ubuntu 5u unix 0xffff9370586c8480 0t0 45087 type=STREAM 2023-08-01T20:01:35.179 INFO:teuthology.orchestra.run.smithi101.stdout:sshd 6113 ubuntu 6u unix 0xffff93750c995580 0t0 41667 type=STREAM 2023-08-01T20:01:35.179 INFO:teuthology.orchestra.run.smithi101.stdout:sshd 6113 ubuntu 7w FIFO 0,24 0t0 44296 /run/systemd/sessions/1.ref 2023-08-01T20:01:35.179 INFO:teuthology.orchestra.run.smithi101.stdout:sshd 6113 ubuntu 8r FIFO 0,13 0t0 43206 pipe 2023-08-01T20:01:35.179 INFO:teuthology.orchestra.run.smithi101.stdout:sshd 6113 ubuntu 9w FIFO 0,13 0t0 43206 pipe 2023-08-01T20:01:35.179 INFO:teuthology.orchestra.run.smithi101.stdout:sshd 6113 ubuntu 14r FIFO 0,13 0t0 45100 pipe 2023-08-01T20:01:35.180 INFO:teuthology.orchestra.run.smithi101.stdout:sshd 6113 ubuntu 16r FIFO 0,13 0t0 45101 pipe 2023-08-01T20:01:35.180 INFO:teuthology.orchestra.run.smithi101.stdout:bash 6161 ubuntu cwd DIR 8,1 4096 17925 /home/ubuntu 2023-08-01T20:01:35.180 INFO:teuthology.orchestra.run.smithi101.stdout:bash 6161 ubuntu rtd DIR 8,1 4096 2 / 2023-08-01T20:01:35.180 INFO:teuthology.orchestra.run.smithi101.stdout:bash 6161 ubuntu txt REG 8,1 1150560 21617 /usr/bin/bash 2023-08-01T20:01:35.180 INFO:teuthology.orchestra.run.smithi101.stdout:bash 6161 ubuntu mem REG 8,1 2586930 39433 /usr/lib/locale/en_US.utf8/LC_COLLATE 2023-08-01T20:01:35.180 INFO:teuthology.orchestra.run.smithi101.stdout:bash 6161 ubuntu mem REG 8,1 2089984 24698 /usr/lib64/libc-2.28.so 2023-08-01T20:01:35.180 INFO:teuthology.orchestra.run.smithi101.stdout:bash 6161 ubuntu mem REG 8,1 19128 24699 /usr/lib64/libdl-2.28.so 2023-08-01T20:01:35.180 INFO:teuthology.orchestra.run.smithi101.stdout:bash 6161 ubuntu mem REG 8,1 187496 24674 /usr/lib64/libtinfo.so.6.1 2023-08-01T20:01:35.181 INFO:teuthology.orchestra.run.smithi101.stdout:bash 6161 ubuntu mem REG 8,1 1062168 24653 /usr/lib64/ld-2.28.so 2023-08-01T20:01:35.181 INFO:teuthology.orchestra.run.smithi101.stdout:bash 6161 ubuntu mem REG 8,1 337024 45489 /usr/lib/locale/C.utf8/LC_CTYPE 2023-08-01T20:01:35.181 INFO:teuthology.orchestra.run.smithi101.stdout:bash 6161 ubuntu mem REG 8,1 54 44174 /usr/lib/locale/en_US.utf8/LC_NUMERIC 2023-08-01T20:01:35.181 INFO:teuthology.orchestra.run.smithi101.stdout:bash 6161 ubuntu mem REG 8,1 3316 48200 /usr/lib/locale/en_US.utf8/LC_TIME 2023-08-01T20:01:35.181 INFO:teuthology.orchestra.run.smithi101.stdout:bash 6161 ubuntu mem REG 8,1 286 48207 /usr/lib/locale/en_US.utf8/LC_MONETARY 2023-08-01T20:01:35.181 INFO:teuthology.orchestra.run.smithi101.stdout:bash 6161 ubuntu mem REG 8,1 26998 35419 /usr/lib64/gconv/gconv-modules.cache 2023-08-01T20:01:35.181 INFO:teuthology.orchestra.run.smithi101.stdout:bash 6161 ubuntu mem REG 8,1 57 39434 /usr/lib/locale/en_US.utf8/LC_MESSAGES/SYS_LC_MESSAGES 2023-08-01T20:01:35.181 INFO:teuthology.orchestra.run.smithi101.stdout:bash 6161 ubuntu mem REG 8,1 34 39448 /usr/lib/locale/en_US.utf8/LC_PAPER 2023-08-01T20:01:35.182 INFO:teuthology.orchestra.run.smithi101.stdout:bash 6161 ubuntu mem REG 8,1 77 44173 /usr/lib/locale/en_US.utf8/LC_NAME 2023-08-01T20:01:35.182 INFO:teuthology.orchestra.run.smithi101.stdout:bash 6161 ubuntu mem REG 8,1 167 45462 /usr/lib/locale/en_US.utf8/LC_ADDRESS 2023-08-01T20:01:35.182 INFO:teuthology.orchestra.run.smithi101.stdout:bash 6161 ubuntu mem REG 8,1 59 48208 /usr/lib/locale/en_US.utf8/LC_TELEPHONE 2023-08-01T20:01:35.182 INFO:teuthology.orchestra.run.smithi101.stdout:bash 6161 ubuntu mem REG 8,1 23 48206 /usr/lib/locale/en_US.utf8/LC_MEASUREMENT 2023-08-01T20:01:35.182 INFO:teuthology.orchestra.run.smithi101.stdout:bash 6161 ubuntu mem REG 8,1 368 48205 /usr/lib/locale/en_US.utf8/LC_IDENTIFICATION 2023-08-01T20:01:35.182 INFO:teuthology.orchestra.run.smithi101.stdout:bash 6161 ubuntu 0r FIFO 0,13 0t0 45099 pipe 2023-08-01T20:01:35.182 INFO:teuthology.orchestra.run.smithi101.stdout:bash 6161 ubuntu 1w FIFO 0,13 0t0 45100 pipe 2023-08-01T20:01:35.182 INFO:teuthology.orchestra.run.smithi101.stdout:bash 6161 ubuntu 2w FIFO 0,13 0t0 45101 pipe 2023-08-01T20:01:35.183 INFO:teuthology.orchestra.run.smithi101.stdout:sudo 6183 root cwd DIR 8,1 4096 17925 /home/ubuntu 2023-08-01T20:01:35.183 INFO:teuthology.orchestra.run.smithi101.stdout:sudo 6183 root rtd DIR 8,1 4096 2 / 2023-08-01T20:01:35.183 INFO:teuthology.orchestra.run.smithi101.stdout:sudo 6183 root txt REG 8,1 165576 29168 /usr/bin/sudo 2023-08-01T20:01:35.183 INFO:teuthology.orchestra.run.smithi101.stdout:sudo 6183 root mem REG 8,1 15968 47495 /usr/lib64/security/pam_succeed_if.so 2023-08-01T20:01:35.183 INFO:teuthology.orchestra.run.smithi101.stdout:sudo 6183 root mem REG 8,1 16608 27021 /usr/lib64/libpam_misc.so.0.82.1 2023-08-01T20:01:35.183 INFO:teuthology.orchestra.run.smithi101.stdout:sudo 6183 root mem REG 8,1 944496 49192 /usr/lib64/security/pam_systemd.so 2023-08-01T20:01:35.183 INFO:teuthology.orchestra.run.smithi101.stdout:sudo 6183 root mem REG 8,1 24080 49091 /usr/lib64/security/pam_limits.so 2023-08-01T20:01:35.184 INFO:teuthology.orchestra.run.smithi101.stdout:sudo 6183 root mem REG 8,1 11848 47484 /usr/lib64/security/pam_keyinit.so 2023-08-01T20:01:35.184 INFO:teuthology.orchestra.run.smithi101.stdout:sudo 6183 root mem REG 8,1 46232 26496 /usr/lib64/libcrack.so.2.9.0 2023-08-01T20:01:35.184 INFO:teuthology.orchestra.run.smithi101.stdout:sudo 6183 root mem REG 8,1 24832 26985 /usr/lib64/libpwquality.so.1.0.2 2023-08-01T20:01:35.184 INFO:teuthology.orchestra.run.smithi101.stdout:sudo 6183 root mem REG 8,1 11768 49040 /usr/lib64/security/pam_pwquality.so 2023-08-01T20:01:35.184 INFO:teuthology.orchestra.run.smithi101.stdout:sudo 6183 root mem REG 8,1 7672 49097 /usr/lib64/security/pam_permit.so 2023-08-01T20:01:35.184 INFO:teuthology.orchestra.run.smithi101.stdout:sudo 6183 root mem REG 8,1 7592 47477 /usr/lib64/security/pam_deny.so 2023-08-01T20:01:35.184 INFO:teuthology.orchestra.run.smithi101.stdout:sudo 6183 root mem REG 8,1 57992 47800 /usr/lib64/security/pam_sss.so 2023-08-01T20:01:35.184 INFO:teuthology.orchestra.run.smithi101.stdout:sudo 6183 root mem REG 8,1 217696 26588 /usr/lib64/libtirpc.so.3.0.0 2023-08-01T20:01:35.185 INFO:teuthology.orchestra.run.smithi101.stdout:sudo 6183 root mem REG 8,1 120592 26590 /usr/lib64/libnsl.so.2.0.0 2023-08-01T20:01:35.185 INFO:teuthology.orchestra.run.smithi101.stdout:sudo 6183 root mem REG 8,1 58096 49102 /usr/lib64/security/pam_unix.so 2023-08-01T20:01:35.185 INFO:teuthology.orchestra.run.smithi101.stdout:sudo 6183 root mem REG 8,1 11776 47485 /usr/lib64/security/pam_localuser.so 2023-08-01T20:01:35.185 INFO:teuthology.orchestra.run.smithi101.stdout:sudo 6183 root mem REG 8,1 11848 47503 /usr/lib64/security/pam_usertype.so 2023-08-01T20:01:35.185 INFO:teuthology.orchestra.run.smithi101.stdout:sudo 6183 root mem REG 8,1 11752 47479 /usr/lib64/security/pam_faildelay.so 2023-08-01T20:01:35.185 INFO:teuthology.orchestra.run.smithi101.stdout:sudo 6183 root mem REG 8,1 20192 47478 /usr/lib64/security/pam_env.so 2023-08-01T20:01:35.185 INFO:teuthology.orchestra.run.smithi101.stdout:sudo 6183 root mem REG 8,1 33480 19526 /usr/lib64/libuuid.so.1.3.0 2023-08-01T20:01:35.185 INFO:teuthology.orchestra.run.smithi101.stdout:sudo 6183 root mem REG 8,1 343680 19531 /usr/lib64/libblkid.so.1.1.0 2023-08-01T20:01:35.186 INFO:teuthology.orchestra.run.smithi101.stdout:sudo 6183 root mem REG 8,1 99672 31445 /usr/lib64/libgcc_s-8-20210514.so.1 2023-08-01T20:01:35.186 INFO:teuthology.orchestra.run.smithi101.stdout:sudo 6183 root mem REG 8,1 371480 19864 /usr/lib64/libmount.so.1.1.0 2023-08-01T20:01:35.186 INFO:teuthology.orchestra.run.smithi101.stdout:sudo 6183 root mem REG 8,1 33752 24776 /usr/lib64/libcap.so.2.48 2023-08-01T20:01:35.186 INFO:teuthology.orchestra.run.smithi101.stdout:sudo 6183 root mem REG 8,1 42744 24710 /usr/lib64/librt-2.28.so 2023-08-01T20:01:35.186 INFO:teuthology.orchestra.run.smithi101.stdout:sudo 6183 root mem REG 8,1 944528 26785 /usr/lib64/libnss_systemd.so.2 2023-08-01T20:01:35.186 INFO:teuthology.orchestra.run.smithi101.stdout:sudo 6183 root mem REG 8,1 46336 29167 /usr/lib64/libnss_sss.so.2 2023-08-01T20:01:35.186 INFO:teuthology.orchestra.run.smithi101.stdout:sudo 6183 root mem REG 8,1 16192 25072 /usr/lib64/libkeyutils.so.1.6 2023-08-01T20:01:35.186 INFO:teuthology.orchestra.run.smithi101.stdout:sudo 6183 root mem REG 8,1 71472 26580 /usr/lib64/libkrb5support.so.0.1 2023-08-01T20:01:35.187 INFO:teuthology.orchestra.run.smithi101.stdout:sudo 6183 root mem REG 8,1 16792 24764 /usr/lib64/libcom_err.so.2.1 2023-08-01T20:01:35.187 INFO:teuthology.orchestra.run.smithi101.stdout:sudo 6183 root mem REG 8,1 96288 26574 /usr/lib64/libk5crypto.so.3.1 2023-08-01T20:01:35.187 INFO:teuthology.orchestra.run.smithi101.stdout:sudo 6183 root mem REG 8,1 971432 26579 /usr/lib64/libkrb5.so.3.3 2023-08-01T20:01:35.187 INFO:teuthology.orchestra.run.smithi101.stdout:sudo 6183 root mem REG 8,1 355968 26571 /usr/lib64/libgssapi_krb5.so.2.2 2023-08-01T20:01:35.187 INFO:teuthology.orchestra.run.smithi101.stdout:sudo 6183 root mem REG 8,1 136040 24892 /usr/lib64/libcrypt.so.1.1.0 2023-08-01T20:01:35.187 INFO:teuthology.orchestra.run.smithi101.stdout:sudo 6183 root mem REG 8,1 3083608 26861 /usr/lib64/libcrypto.so.1.1.1k 2023-08-01T20:01:35.187 INFO:teuthology.orchestra.run.smithi101.stdout:sudo 6183 root mem REG 8,1 615744 26862 /usr/lib64/libssl.so.1.1.1k 2023-08-01T20:01:35.187 INFO:teuthology.orchestra.run.smithi101.stdout:sudo 6183 root mem REG 8,1 125440 26261 /usr/lib64/libsasl2.so.3.0.0 2023-08-01T20:01:35.188 INFO:teuthology.orchestra.run.smithi101.stdout:sudo 6183 root mem REG 8,1 92968 24709 /usr/lib64/libresolv-2.28.so 2023-08-01T20:01:35.188 INFO:teuthology.orchestra.run.smithi101.stdout:sudo 6183 root mem REG 8,1 99640 24762 /usr/lib64/libz.so.1.2.11 2023-08-01T20:01:35.188 INFO:teuthology.orchestra.run.smithi101.stdout:sudo 6183 root mem REG 8,1 67232 26280 /usr/lib64/liblber-2.4.so.2.10.9 2023-08-01T20:01:35.188 INFO:teuthology.orchestra.run.smithi101.stdout:sudo 6183 root mem REG 8,1 329184 26282 /usr/lib64/libldap-2.4.so.2.10.9 2023-08-01T20:01:35.188 INFO:teuthology.orchestra.run.smithi101.stdout:sudo 6183 root mem REG 8,1 66504 27020 /usr/lib64/libpam.so.0.84.2 2023-08-01T20:01:35.188 INFO:teuthology.orchestra.run.smithi101.stdout:sudo 6183 root mem REG 8,1 433008 47807 /usr/libexec/sudo/sudoers.so 2023-08-01T20:01:35.188 INFO:teuthology.orchestra.run.smithi101.stdout:sudo 6183 root mem REG 8,1 54352 24707 /usr/lib64/libnss_files-2.28.so 2023-08-01T20:01:35.188 INFO:teuthology.orchestra.run.smithi101.stdout:sudo 6183 root mem REG 8,1 2586930 39433 /usr/lib/locale/en_US.utf8/LC_COLLATE 2023-08-01T20:01:35.189 INFO:teuthology.orchestra.run.smithi101.stdout:sudo 6183 root mem REG 8,1 543304 24651 /usr/lib64/libpcre2-8.so.0.7.1 2023-08-01T20:01:35.189 INFO:teuthology.orchestra.run.smithi101.stdout:sudo 6183 root mem REG 8,1 24928 25065 /usr/lib64/libcap-ng.so.0.0.0 2023-08-01T20:01:35.189 INFO:teuthology.orchestra.run.smithi101.stdout:sudo 6183 root mem REG 8,1 2089984 24698 /usr/lib64/libc-2.28.so 2023-08-01T20:01:35.189 INFO:teuthology.orchestra.run.smithi101.stdout:sudo 6183 root mem REG 8,1 19128 24699 /usr/lib64/libdl-2.28.so 2023-08-01T20:01:35.189 INFO:teuthology.orchestra.run.smithi101.stdout:sudo 6183 root mem REG 8,1 149984 24708 /usr/lib64/libpthread-2.28.so 2023-08-01T20:01:35.189 INFO:teuthology.orchestra.run.smithi101.stdout:sudo 6183 root mem REG 8,1 104576 47805 /usr/libexec/sudo/libsudo_util.so.0.0.0 2023-08-01T20:01:35.189 INFO:teuthology.orchestra.run.smithi101.stdout:sudo 6183 root mem REG 8,1 17016 24713 /usr/lib64/libutil-2.28.so 2023-08-01T20:01:35.189 INFO:teuthology.orchestra.run.smithi101.stdout:sudo 6183 root mem REG 8,1 172104 24654 /usr/lib64/libselinux.so.1 2023-08-01T20:01:35.190 INFO:teuthology.orchestra.run.smithi101.stdout:sudo 6183 root mem REG 8,1 135784 24768 /usr/lib64/libaudit.so.1.0.0 2023-08-01T20:01:35.190 INFO:teuthology.orchestra.run.smithi101.stdout:sudo 6183 root mem REG 8,1 1062168 24653 /usr/lib64/ld-2.28.so 2023-08-01T20:01:35.190 INFO:teuthology.orchestra.run.smithi101.stdout:sudo 6183 root mem REG 8,1 337024 45489 /usr/lib/locale/C.utf8/LC_CTYPE 2023-08-01T20:01:35.190 INFO:teuthology.orchestra.run.smithi101.stdout:sudo 6183 root mem REG 8,1 54 44174 /usr/lib/locale/en_US.utf8/LC_NUMERIC 2023-08-01T20:01:35.190 INFO:teuthology.orchestra.run.smithi101.stdout:sudo 6183 root mem REG 8,1 3316 48200 /usr/lib/locale/en_US.utf8/LC_TIME 2023-08-01T20:01:35.190 INFO:teuthology.orchestra.run.smithi101.stdout:sudo 6183 root mem REG 8,1 286 48207 /usr/lib/locale/en_US.utf8/LC_MONETARY 2023-08-01T20:01:35.190 INFO:teuthology.orchestra.run.smithi101.stdout:sudo 6183 root mem REG 8,1 26998 35419 /usr/lib64/gconv/gconv-modules.cache 2023-08-01T20:01:35.191 INFO:teuthology.orchestra.run.smithi101.stdout:sudo 6183 root mem REG 8,1 57 39434 /usr/lib/locale/en_US.utf8/LC_MESSAGES/SYS_LC_MESSAGES 2023-08-01T20:01:35.191 INFO:teuthology.orchestra.run.smithi101.stdout:sudo 6183 root mem REG 8,1 34 39448 /usr/lib/locale/en_US.utf8/LC_PAPER 2023-08-01T20:01:35.191 INFO:teuthology.orchestra.run.smithi101.stdout:sudo 6183 root mem REG 8,1 77 44173 /usr/lib/locale/en_US.utf8/LC_NAME 2023-08-01T20:01:35.191 INFO:teuthology.orchestra.run.smithi101.stdout:sudo 6183 root mem REG 8,1 167 45462 /usr/lib/locale/en_US.utf8/LC_ADDRESS 2023-08-01T20:01:35.191 INFO:teuthology.orchestra.run.smithi101.stdout:sudo 6183 root mem REG 8,1 59 48208 /usr/lib/locale/en_US.utf8/LC_TELEPHONE 2023-08-01T20:01:35.191 INFO:teuthology.orchestra.run.smithi101.stdout:sudo 6183 root mem REG 8,1 23 48206 /usr/lib/locale/en_US.utf8/LC_MEASUREMENT 2023-08-01T20:01:35.191 INFO:teuthology.orchestra.run.smithi101.stdout:sudo 6183 root mem REG 8,1 368 48205 /usr/lib/locale/en_US.utf8/LC_IDENTIFICATION 2023-08-01T20:01:35.191 INFO:teuthology.orchestra.run.smithi101.stdout:sudo 6183 root 0r FIFO 0,13 0t0 45099 pipe 2023-08-01T20:01:35.192 INFO:teuthology.orchestra.run.smithi101.stdout:sudo 6183 root 1w FIFO 0,13 0t0 45100 pipe 2023-08-01T20:01:35.192 INFO:teuthology.orchestra.run.smithi101.stdout:sudo 6183 root 2w FIFO 0,13 0t0 45101 pipe 2023-08-01T20:01:35.192 INFO:teuthology.orchestra.run.smithi101.stdout:sudo 6183 root 3u netlink 0t0 39198 AUDIT 2023-08-01T20:01:35.192 INFO:teuthology.orchestra.run.smithi101.stdout:sudo 6183 root 4u unix 0xffff93750c954380 0t0 39201 type=DGRAM 2023-08-01T20:01:35.192 INFO:teuthology.orchestra.run.smithi101.stdout:sudo 6183 root 6r FIFO 0,13 0t0 39204 pipe 2023-08-01T20:01:35.192 INFO:teuthology.orchestra.run.smithi101.stdout:sudo 6183 root 7w FIFO 0,13 0t0 39204 pipe 2023-08-01T20:01:35.192 INFO:teuthology.orchestra.run.smithi101.stdout:lsof 6185 root cwd DIR 8,1 4096 17925 /home/ubuntu 2023-08-01T20:01:35.192 INFO:teuthology.orchestra.run.smithi101.stdout:lsof 6185 root rtd DIR 8,1 4096 2 / 2023-08-01T20:01:35.193 INFO:teuthology.orchestra.run.smithi101.stdout:lsof 6185 root txt REG 8,1 179608 30645 /usr/bin/lsof 2023-08-01T20:01:35.193 INFO:teuthology.orchestra.run.smithi101.stdout:lsof 6185 root mem REG 8,1 99640 24762 /usr/lib64/libz.so.1.2.11 2023-08-01T20:01:35.193 INFO:teuthology.orchestra.run.smithi101.stdout:lsof 6185 root mem REG 8,1 92968 24709 /usr/lib64/libresolv-2.28.so 2023-08-01T20:01:35.193 INFO:teuthology.orchestra.run.smithi101.stdout:lsof 6185 root mem REG 8,1 3083608 26861 /usr/lib64/libcrypto.so.1.1.1k 2023-08-01T20:01:35.193 INFO:teuthology.orchestra.run.smithi101.stdout:lsof 6185 root mem REG 8,1 16192 25072 /usr/lib64/libkeyutils.so.1.6 2023-08-01T20:01:35.193 INFO:teuthology.orchestra.run.smithi101.stdout:lsof 6185 root mem REG 8,1 71472 26580 /usr/lib64/libkrb5support.so.0.1 2023-08-01T20:01:35.193 INFO:teuthology.orchestra.run.smithi101.stdout:lsof 6185 root mem REG 8,1 149984 24708 /usr/lib64/libpthread-2.28.so 2023-08-01T20:01:35.193 INFO:teuthology.orchestra.run.smithi101.stdout:lsof 6185 root mem REG 8,1 16792 24764 /usr/lib64/libcom_err.so.2.1 2023-08-01T20:01:35.194 INFO:teuthology.orchestra.run.smithi101.stdout:lsof 6185 root mem REG 8,1 96288 26574 /usr/lib64/libk5crypto.so.3.1 2023-08-01T20:01:35.194 INFO:teuthology.orchestra.run.smithi101.stdout:lsof 6185 root mem REG 8,1 971432 26579 /usr/lib64/libkrb5.so.3.3 2023-08-01T20:01:35.194 INFO:teuthology.orchestra.run.smithi101.stdout:lsof 6185 root mem REG 8,1 355968 26571 /usr/lib64/libgssapi_krb5.so.2.2 2023-08-01T20:01:35.194 INFO:teuthology.orchestra.run.smithi101.stdout:lsof 6185 root mem REG 8,1 19128 24699 /usr/lib64/libdl-2.28.so 2023-08-01T20:01:35.194 INFO:teuthology.orchestra.run.smithi101.stdout:lsof 6185 root mem REG 8,1 543304 24651 /usr/lib64/libpcre2-8.so.0.7.1 2023-08-01T20:01:35.194 INFO:teuthology.orchestra.run.smithi101.stdout:lsof 6185 root mem REG 8,1 2089984 24698 /usr/lib64/libc-2.28.so 2023-08-01T20:01:35.194 INFO:teuthology.orchestra.run.smithi101.stdout:lsof 6185 root mem REG 8,1 217696 26588 /usr/lib64/libtirpc.so.3.0.0 2023-08-01T20:01:35.194 INFO:teuthology.orchestra.run.smithi101.stdout:lsof 6185 root mem REG 8,1 172104 24654 /usr/lib64/libselinux.so.1 2023-08-01T20:01:35.195 INFO:teuthology.orchestra.run.smithi101.stdout:lsof 6185 root mem REG 8,1 1062168 24653 /usr/lib64/ld-2.28.so 2023-08-01T20:01:35.195 INFO:teuthology.orchestra.run.smithi101.stdout:lsof 6185 root mem REG 8,1 337024 45489 /usr/lib/locale/C.utf8/LC_CTYPE 2023-08-01T20:01:35.195 INFO:teuthology.orchestra.run.smithi101.stdout:lsof 6185 root mem REG 8,1 26998 35419 /usr/lib64/gconv/gconv-modules.cache 2023-08-01T20:01:35.195 INFO:teuthology.orchestra.run.smithi101.stdout:lsof 6185 root 0r FIFO 0,13 0t0 45099 pipe 2023-08-01T20:01:35.195 INFO:teuthology.orchestra.run.smithi101.stdout:lsof 6185 root 1w FIFO 0,13 0t0 45100 pipe 2023-08-01T20:01:35.195 INFO:teuthology.orchestra.run.smithi101.stdout:lsof 6185 root 2w FIFO 0,13 0t0 45101 pipe 2023-08-01T20:01:35.195 INFO:teuthology.orchestra.run.smithi101.stdout:lsof 6185 root 3r DIR 0,5 0 1 /proc 2023-08-01T20:01:35.196 INFO:teuthology.orchestra.run.smithi101.stdout:lsof 6185 root 4r DIR 0,5 0 42154 /proc/6185/fd 2023-08-01T20:01:35.196 INFO:teuthology.orchestra.run.smithi101.stdout:lsof 6185 root 5w FIFO 0,13 0t0 42163 pipe 2023-08-01T20:01:35.196 INFO:teuthology.orchestra.run.smithi101.stdout:lsof 6185 root 6r FIFO 0,13 0t0 42164 pipe 2023-08-01T20:01:35.196 INFO:teuthology.orchestra.run.smithi101.stdout:lsof 6186 root cwd DIR 8,1 4096 17925 /home/ubuntu 2023-08-01T20:01:35.196 INFO:teuthology.orchestra.run.smithi101.stdout:lsof 6186 root rtd DIR 8,1 4096 2 / 2023-08-01T20:01:35.196 INFO:teuthology.orchestra.run.smithi101.stdout:lsof 6186 root txt REG 8,1 179608 30645 /usr/bin/lsof 2023-08-01T20:01:35.196 INFO:teuthology.orchestra.run.smithi101.stdout:lsof 6186 root mem REG 8,1 99640 24762 /usr/lib64/libz.so.1.2.11 2023-08-01T20:01:35.196 INFO:teuthology.orchestra.run.smithi101.stdout:lsof 6186 root mem REG 8,1 92968 24709 /usr/lib64/libresolv-2.28.so 2023-08-01T20:01:35.197 INFO:teuthology.orchestra.run.smithi101.stdout:lsof 6186 root mem REG 8,1 3083608 26861 /usr/lib64/libcrypto.so.1.1.1k 2023-08-01T20:01:35.197 INFO:teuthology.orchestra.run.smithi101.stdout:lsof 6186 root mem REG 8,1 16192 25072 /usr/lib64/libkeyutils.so.1.6 2023-08-01T20:01:35.197 INFO:teuthology.orchestra.run.smithi101.stdout:lsof 6186 root mem REG 8,1 71472 26580 /usr/lib64/libkrb5support.so.0.1 2023-08-01T20:01:35.197 INFO:teuthology.orchestra.run.smithi101.stdout:lsof 6186 root mem REG 8,1 149984 24708 /usr/lib64/libpthread-2.28.so 2023-08-01T20:01:35.197 INFO:teuthology.orchestra.run.smithi101.stdout:lsof 6186 root mem REG 8,1 16792 24764 /usr/lib64/libcom_err.so.2.1 2023-08-01T20:01:35.197 INFO:teuthology.orchestra.run.smithi101.stdout:lsof 6186 root mem REG 8,1 96288 26574 /usr/lib64/libk5crypto.so.3.1 2023-08-01T20:01:35.197 INFO:teuthology.orchestra.run.smithi101.stdout:lsof 6186 root mem REG 8,1 971432 26579 /usr/lib64/libkrb5.so.3.3 2023-08-01T20:01:35.197 INFO:teuthology.orchestra.run.smithi101.stdout:lsof 6186 root mem REG 8,1 355968 26571 /usr/lib64/libgssapi_krb5.so.2.2 2023-08-01T20:01:35.198 INFO:teuthology.orchestra.run.smithi101.stdout:lsof 6186 root mem REG 8,1 19128 24699 /usr/lib64/libdl-2.28.so 2023-08-01T20:01:35.198 INFO:teuthology.orchestra.run.smithi101.stdout:lsof 6186 root mem REG 8,1 543304 24651 /usr/lib64/libpcre2-8.so.0.7.1 2023-08-01T20:01:35.198 INFO:teuthology.orchestra.run.smithi101.stdout:lsof 6186 root mem REG 8,1 2089984 24698 /usr/lib64/libc-2.28.so 2023-08-01T20:01:35.198 INFO:teuthology.orchestra.run.smithi101.stdout:lsof 6186 root mem REG 8,1 217696 26588 /usr/lib64/libtirpc.so.3.0.0 2023-08-01T20:01:35.198 INFO:teuthology.orchestra.run.smithi101.stdout:lsof 6186 root mem REG 8,1 172104 24654 /usr/lib64/libselinux.so.1 2023-08-01T20:01:35.198 INFO:teuthology.orchestra.run.smithi101.stdout:lsof 6186 root mem REG 8,1 1062168 24653 /usr/lib64/ld-2.28.so 2023-08-01T20:01:35.198 INFO:teuthology.orchestra.run.smithi101.stdout:lsof 6186 root mem REG 8,1 337024 45489 /usr/lib/locale/C.utf8/LC_CTYPE 2023-08-01T20:01:35.198 INFO:teuthology.orchestra.run.smithi101.stdout:lsof 6186 root mem REG 8,1 26998 35419 /usr/lib64/gconv/gconv-modules.cache 2023-08-01T20:01:35.199 INFO:teuthology.orchestra.run.smithi101.stdout:lsof 6186 root 4r FIFO 0,13 0t0 42163 pipe 2023-08-01T20:01:35.199 INFO:teuthology.orchestra.run.smithi101.stdout:lsof 6186 root 7w FIFO 0,13 0t0 42164 pipe 2023-08-01T20:01:35.199 INFO:teuthology.orchestra.run.smithi101.stdout:USER PID %CPU %MEM VSZ RSS TTY STAT START TIME COMMAND 2023-08-01T20:01:35.199 INFO:teuthology.orchestra.run.smithi101.stdout:root 2 0.0 0.0 0 0 ? S 19:58 0:00 [kthreadd] 2023-08-01T20:01:35.199 INFO:teuthology.orchestra.run.smithi101.stdout:root 3 0.0 0.0 0 0 ? I< 19:58 0:00 \_ [rcu_gp] 2023-08-01T20:01:35.199 INFO:teuthology.orchestra.run.smithi101.stdout:root 4 0.0 0.0 0 0 ? I< 19:58 0:00 \_ [rcu_par_gp] 2023-08-01T20:01:35.199 INFO:teuthology.orchestra.run.smithi101.stdout:root 5 0.0 0.0 0 0 ? I< 19:58 0:00 \_ [slub_flushwq] 2023-08-01T20:01:35.199 INFO:teuthology.orchestra.run.smithi101.stdout:root 6 0.0 0.0 0 0 ? I 19:58 0:00 \_ [kworker/0:0-cgroup_pidlist_destroy] 2023-08-01T20:01:35.200 INFO:teuthology.orchestra.run.smithi101.stdout:root 7 0.0 0.0 0 0 ? I< 19:58 0:00 \_ [kworker/0:0H-events_highpri] 2023-08-01T20:01:35.200 INFO:teuthology.orchestra.run.smithi101.stdout:root 8 0.0 0.0 0 0 ? I 19:58 0:00 \_ [kworker/0:1-cgroup_pidlist_destroy] 2023-08-01T20:01:35.200 INFO:teuthology.orchestra.run.smithi101.stdout:root 9 0.0 0.0 0 0 ? I 19:58 0:00 \_ [kworker/u16:0-events_unbound] 2023-08-01T20:01:35.200 INFO:teuthology.orchestra.run.smithi101.stdout:root 10 0.0 0.0 0 0 ? I< 19:58 0:00 \_ [mm_percpu_wq] 2023-08-01T20:01:35.200 INFO:teuthology.orchestra.run.smithi101.stdout:root 11 0.0 0.0 0 0 ? S 19:58 0:00 \_ [rcu_tasks_rude_] 2023-08-01T20:01:35.200 INFO:teuthology.orchestra.run.smithi101.stdout:root 12 0.0 0.0 0 0 ? S 19:58 0:00 \_ [rcu_tasks_trace] 2023-08-01T20:01:35.200 INFO:teuthology.orchestra.run.smithi101.stdout:root 13 0.0 0.0 0 0 ? S 19:58 0:00 \_ [ksoftirqd/0] 2023-08-01T20:01:35.201 INFO:teuthology.orchestra.run.smithi101.stdout:root 14 0.0 0.0 0 0 ? I 19:58 0:00 \_ [rcu_sched] 2023-08-01T20:01:35.201 INFO:teuthology.orchestra.run.smithi101.stdout:root 15 0.0 0.0 0 0 ? S 19:58 0:00 \_ [migration/0] 2023-08-01T20:01:35.201 INFO:teuthology.orchestra.run.smithi101.stdout:root 16 0.0 0.0 0 0 ? S 19:58 0:00 \_ [watchdog/0] 2023-08-01T20:01:35.201 INFO:teuthology.orchestra.run.smithi101.stdout:root 17 0.0 0.0 0 0 ? S 19:58 0:00 \_ [cpuhp/0] 2023-08-01T20:01:35.201 INFO:teuthology.orchestra.run.smithi101.stdout:root 18 0.0 0.0 0 0 ? S 19:58 0:00 \_ [cpuhp/1] 2023-08-01T20:01:35.201 INFO:teuthology.orchestra.run.smithi101.stdout:root 19 0.0 0.0 0 0 ? S 19:58 0:00 \_ [watchdog/1] 2023-08-01T20:01:35.201 INFO:teuthology.orchestra.run.smithi101.stdout:root 20 0.0 0.0 0 0 ? S 19:58 0:00 \_ [migration/1] 2023-08-01T20:01:35.201 INFO:teuthology.orchestra.run.smithi101.stdout:root 21 0.0 0.0 0 0 ? S 19:58 0:00 \_ [ksoftirqd/1] 2023-08-01T20:01:35.202 INFO:teuthology.orchestra.run.smithi101.stdout:root 22 0.0 0.0 0 0 ? I 19:58 0:00 \_ [kworker/1:0-events] 2023-08-01T20:01:35.202 INFO:teuthology.orchestra.run.smithi101.stdout:root 23 0.0 0.0 0 0 ? I< 19:58 0:00 \_ [kworker/1:0H-events_highpri] 2023-08-01T20:01:35.202 INFO:teuthology.orchestra.run.smithi101.stdout:root 24 0.0 0.0 0 0 ? S 19:58 0:00 \_ [cpuhp/2] 2023-08-01T20:01:35.202 INFO:teuthology.orchestra.run.smithi101.stdout:root 25 0.0 0.0 0 0 ? S 19:58 0:00 \_ [watchdog/2] 2023-08-01T20:01:35.202 INFO:teuthology.orchestra.run.smithi101.stdout:root 26 0.0 0.0 0 0 ? S 19:58 0:00 \_ [migration/2] 2023-08-01T20:01:35.202 INFO:teuthology.orchestra.run.smithi101.stdout:root 27 0.0 0.0 0 0 ? S 19:58 0:00 \_ [ksoftirqd/2] 2023-08-01T20:01:35.202 INFO:teuthology.orchestra.run.smithi101.stdout:root 28 0.0 0.0 0 0 ? I 19:58 0:00 \_ [kworker/2:0-cgroup_pidlist_destroy] 2023-08-01T20:01:35.202 INFO:teuthology.orchestra.run.smithi101.stdout:root 29 0.0 0.0 0 0 ? I< 19:58 0:00 \_ [kworker/2:0H-events_highpri] 2023-08-01T20:01:35.203 INFO:teuthology.orchestra.run.smithi101.stdout:root 30 0.0 0.0 0 0 ? S 19:58 0:00 \_ [cpuhp/3] 2023-08-01T20:01:35.203 INFO:teuthology.orchestra.run.smithi101.stdout:root 31 0.0 0.0 0 0 ? S 19:58 0:00 \_ [watchdog/3] 2023-08-01T20:01:35.203 INFO:teuthology.orchestra.run.smithi101.stdout:root 32 0.0 0.0 0 0 ? S 19:58 0:00 \_ [migration/3] 2023-08-01T20:01:35.203 INFO:teuthology.orchestra.run.smithi101.stdout:root 33 0.0 0.0 0 0 ? S 19:58 0:00 \_ [ksoftirqd/3] 2023-08-01T20:01:35.203 INFO:teuthology.orchestra.run.smithi101.stdout:root 34 0.0 0.0 0 0 ? I 19:58 0:00 \_ [kworker/3:0-cgroup_pidlist_destroy] 2023-08-01T20:01:35.203 INFO:teuthology.orchestra.run.smithi101.stdout:root 35 0.0 0.0 0 0 ? I< 19:58 0:00 \_ [kworker/3:0H-events_highpri] 2023-08-01T20:01:35.203 INFO:teuthology.orchestra.run.smithi101.stdout:root 36 0.0 0.0 0 0 ? S 19:58 0:00 \_ [cpuhp/4] 2023-08-01T20:01:35.203 INFO:teuthology.orchestra.run.smithi101.stdout:root 37 0.0 0.0 0 0 ? S 19:58 0:00 \_ [watchdog/4] 2023-08-01T20:01:35.204 INFO:teuthology.orchestra.run.smithi101.stdout:root 38 0.0 0.0 0 0 ? S 19:58 0:00 \_ [migration/4] 2023-08-01T20:01:35.204 INFO:teuthology.orchestra.run.smithi101.stdout:root 39 0.0 0.0 0 0 ? S 19:58 0:00 \_ [ksoftirqd/4] 2023-08-01T20:01:35.204 INFO:teuthology.orchestra.run.smithi101.stdout:root 40 0.0 0.0 0 0 ? I 19:58 0:00 \_ [kworker/4:0-cgroup_pidlist_destroy] 2023-08-01T20:01:35.204 INFO:teuthology.orchestra.run.smithi101.stdout:root 41 0.0 0.0 0 0 ? I< 19:58 0:00 \_ [kworker/4:0H-events_highpri] 2023-08-01T20:01:35.204 INFO:teuthology.orchestra.run.smithi101.stdout:root 42 0.0 0.0 0 0 ? S 19:58 0:00 \_ [cpuhp/5] 2023-08-01T20:01:35.204 INFO:teuthology.orchestra.run.smithi101.stdout:root 43 0.0 0.0 0 0 ? S 19:58 0:00 \_ [watchdog/5] 2023-08-01T20:01:35.204 INFO:teuthology.orchestra.run.smithi101.stdout:root 44 0.0 0.0 0 0 ? S 19:58 0:00 \_ [migration/5] 2023-08-01T20:01:35.204 INFO:teuthology.orchestra.run.smithi101.stdout:root 45 0.0 0.0 0 0 ? S 19:58 0:00 \_ [ksoftirqd/5] 2023-08-01T20:01:35.205 INFO:teuthology.orchestra.run.smithi101.stdout:root 46 0.0 0.0 0 0 ? I 19:58 0:00 \_ [kworker/5:0-cgroup_pidlist_destroy] 2023-08-01T20:01:35.205 INFO:teuthology.orchestra.run.smithi101.stdout:root 47 0.0 0.0 0 0 ? I< 19:58 0:00 \_ [kworker/5:0H-events_highpri] 2023-08-01T20:01:35.205 INFO:teuthology.orchestra.run.smithi101.stdout:root 48 0.0 0.0 0 0 ? S 19:58 0:00 \_ [cpuhp/6] 2023-08-01T20:01:35.205 INFO:teuthology.orchestra.run.smithi101.stdout:root 49 0.0 0.0 0 0 ? S 19:58 0:00 \_ [watchdog/6] 2023-08-01T20:01:35.205 INFO:teuthology.orchestra.run.smithi101.stdout:root 50 0.0 0.0 0 0 ? S 19:58 0:00 \_ [migration/6] 2023-08-01T20:01:35.205 INFO:teuthology.orchestra.run.smithi101.stdout:root 51 0.0 0.0 0 0 ? S 19:58 0:00 \_ [ksoftirqd/6] 2023-08-01T20:01:35.205 INFO:teuthology.orchestra.run.smithi101.stdout:root 52 0.0 0.0 0 0 ? I 19:58 0:00 \_ [kworker/6:0-cgroup_pidlist_destroy] 2023-08-01T20:01:35.205 INFO:teuthology.orchestra.run.smithi101.stdout:root 53 0.0 0.0 0 0 ? I< 19:58 0:00 \_ [kworker/6:0H-events_highpri] 2023-08-01T20:01:35.206 INFO:teuthology.orchestra.run.smithi101.stdout:root 54 0.0 0.0 0 0 ? S 19:58 0:00 \_ [cpuhp/7] 2023-08-01T20:01:35.206 INFO:teuthology.orchestra.run.smithi101.stdout:root 55 0.0 0.0 0 0 ? S 19:58 0:00 \_ [watchdog/7] 2023-08-01T20:01:35.206 INFO:teuthology.orchestra.run.smithi101.stdout:root 56 0.0 0.0 0 0 ? S 19:58 0:00 \_ [migration/7] 2023-08-01T20:01:35.206 INFO:teuthology.orchestra.run.smithi101.stdout:root 57 0.0 0.0 0 0 ? S 19:58 0:00 \_ [ksoftirqd/7] 2023-08-01T20:01:35.206 INFO:teuthology.orchestra.run.smithi101.stdout:root 58 0.0 0.0 0 0 ? I 19:58 0:00 \_ [kworker/7:0-cgroup_pidlist_destroy] 2023-08-01T20:01:35.206 INFO:teuthology.orchestra.run.smithi101.stdout:root 59 0.0 0.0 0 0 ? I< 19:58 0:00 \_ [kworker/7:0H-events_highpri] 2023-08-01T20:01:35.206 INFO:teuthology.orchestra.run.smithi101.stdout:root 61 0.0 0.0 0 0 ? I 19:58 0:00 \_ [kworker/u16:1-events_unbound] 2023-08-01T20:01:35.206 INFO:teuthology.orchestra.run.smithi101.stdout:root 62 0.0 0.0 0 0 ? I 19:58 0:00 \_ [kworker/u16:2-events_unbound] 2023-08-01T20:01:35.207 INFO:teuthology.orchestra.run.smithi101.stdout:root 63 0.0 0.0 0 0 ? I 19:58 0:00 \_ [kworker/u16:3-events_unbound] 2023-08-01T20:01:35.207 INFO:teuthology.orchestra.run.smithi101.stdout:root 64 0.0 0.0 0 0 ? I 19:58 0:00 \_ [kworker/u16:4-events_unbound] 2023-08-01T20:01:35.207 INFO:teuthology.orchestra.run.smithi101.stdout:root 65 0.0 0.0 0 0 ? I 19:58 0:00 \_ [kworker/u16:5-events_unbound] 2023-08-01T20:01:35.207 INFO:teuthology.orchestra.run.smithi101.stdout:root 66 0.0 0.0 0 0 ? I 19:58 0:00 \_ [kworker/u16:6-events_unbound] 2023-08-01T20:01:35.207 INFO:teuthology.orchestra.run.smithi101.stdout:root 67 0.0 0.0 0 0 ? I 19:58 0:00 \_ [kworker/u16:7-events_unbound] 2023-08-01T20:01:35.207 INFO:teuthology.orchestra.run.smithi101.stdout:root 68 0.0 0.0 0 0 ? S 19:58 0:00 \_ [kdevtmpfs] 2023-08-01T20:01:35.207 INFO:teuthology.orchestra.run.smithi101.stdout:root 69 0.0 0.0 0 0 ? I< 19:58 0:00 \_ [netns] 2023-08-01T20:01:35.207 INFO:teuthology.orchestra.run.smithi101.stdout:root 70 0.0 0.0 0 0 ? S 19:58 0:00 \_ [kauditd] 2023-08-01T20:01:35.208 INFO:teuthology.orchestra.run.smithi101.stdout:root 71 0.0 0.0 0 0 ? I 19:58 0:00 \_ [kworker/1:1-events] 2023-08-01T20:01:35.208 INFO:teuthology.orchestra.run.smithi101.stdout:root 72 0.0 0.0 0 0 ? I 19:58 0:00 \_ [kworker/2:1-events] 2023-08-01T20:01:35.208 INFO:teuthology.orchestra.run.smithi101.stdout:root 73 0.0 0.0 0 0 ? S 19:58 0:00 \_ [khungtaskd] 2023-08-01T20:01:35.208 INFO:teuthology.orchestra.run.smithi101.stdout:root 74 0.0 0.0 0 0 ? S 19:58 0:00 \_ [oom_reaper] 2023-08-01T20:01:35.208 INFO:teuthology.orchestra.run.smithi101.stdout:root 75 0.0 0.0 0 0 ? I< 19:58 0:00 \_ [writeback] 2023-08-01T20:01:35.208 INFO:teuthology.orchestra.run.smithi101.stdout:root 76 0.0 0.0 0 0 ? S 19:58 0:00 \_ [kcompactd0] 2023-08-01T20:01:35.208 INFO:teuthology.orchestra.run.smithi101.stdout:root 77 0.0 0.0 0 0 ? SN 19:58 0:00 \_ [ksmd] 2023-08-01T20:01:35.208 INFO:teuthology.orchestra.run.smithi101.stdout:root 78 0.0 0.0 0 0 ? SN 19:58 0:00 \_ [khugepaged] 2023-08-01T20:01:35.209 INFO:teuthology.orchestra.run.smithi101.stdout:root 79 0.0 0.0 0 0 ? I< 19:58 0:00 \_ [crypto] 2023-08-01T20:01:35.209 INFO:teuthology.orchestra.run.smithi101.stdout:root 80 0.0 0.0 0 0 ? I< 19:58 0:00 \_ [kintegrityd] 2023-08-01T20:01:35.209 INFO:teuthology.orchestra.run.smithi101.stdout:root 81 0.0 0.0 0 0 ? I< 19:58 0:00 \_ [kblockd] 2023-08-01T20:01:35.209 INFO:teuthology.orchestra.run.smithi101.stdout:root 82 0.0 0.0 0 0 ? I< 19:58 0:00 \_ [blkcg_punt_bio] 2023-08-01T20:01:35.209 INFO:teuthology.orchestra.run.smithi101.stdout:root 83 0.0 0.0 0 0 ? I 19:58 0:00 \_ [kworker/4:1-events] 2023-08-01T20:01:35.209 INFO:teuthology.orchestra.run.smithi101.stdout:root 84 0.0 0.0 0 0 ? I 19:58 0:00 \_ [kworker/3:1-cgroup_destroy] 2023-08-01T20:01:35.209 INFO:teuthology.orchestra.run.smithi101.stdout:root 85 0.0 0.0 0 0 ? I 19:58 0:00 \_ [kworker/6:1-events] 2023-08-01T20:01:35.210 INFO:teuthology.orchestra.run.smithi101.stdout:root 86 0.0 0.0 0 0 ? I 19:58 0:00 \_ [kworker/5:1-events] 2023-08-01T20:01:35.210 INFO:teuthology.orchestra.run.smithi101.stdout:root 87 0.0 0.0 0 0 ? I 19:58 0:00 \_ [kworker/7:1-events] 2023-08-01T20:01:35.210 INFO:teuthology.orchestra.run.smithi101.stdout:root 88 0.0 0.0 0 0 ? I< 19:58 0:00 \_ [tpm_dev_wq] 2023-08-01T20:01:35.210 INFO:teuthology.orchestra.run.smithi101.stdout:root 89 0.0 0.0 0 0 ? I< 19:58 0:00 \_ [md] 2023-08-01T20:01:35.210 INFO:teuthology.orchestra.run.smithi101.stdout:root 90 0.0 0.0 0 0 ? I< 19:58 0:00 \_ [edac-poller] 2023-08-01T20:01:35.210 INFO:teuthology.orchestra.run.smithi101.stdout:root 91 0.0 0.0 0 0 ? S 19:58 0:00 \_ [watchdogd] 2023-08-01T20:01:35.210 INFO:teuthology.orchestra.run.smithi101.stdout:root 92 0.0 0.0 0 0 ? I< 19:58 0:00 \_ [kworker/0:1H-kblockd] 2023-08-01T20:01:35.210 INFO:teuthology.orchestra.run.smithi101.stdout:root 109 0.0 0.0 0 0 ? S 19:58 0:00 \_ [kswapd0] 2023-08-01T20:01:35.211 INFO:teuthology.orchestra.run.smithi101.stdout:root 169 0.0 0.0 0 0 ? I 19:58 0:00 \_ [kworker/0:2-events] 2023-08-01T20:01:35.211 INFO:teuthology.orchestra.run.smithi101.stdout:root 170 0.0 0.0 0 0 ? I< 19:58 0:00 \_ [kthrotld] 2023-08-01T20:01:35.211 INFO:teuthology.orchestra.run.smithi101.stdout:root 171 0.0 0.0 0 0 ? I< 19:58 0:00 \_ [acpi_thermal_pm] 2023-08-01T20:01:35.211 INFO:teuthology.orchestra.run.smithi101.stdout:root 172 0.0 0.0 0 0 ? I< 19:58 0:00 \_ [kmpath_rdacd] 2023-08-01T20:01:35.211 INFO:teuthology.orchestra.run.smithi101.stdout:root 173 0.0 0.0 0 0 ? I< 19:58 0:00 \_ [kaluad] 2023-08-01T20:01:35.211 INFO:teuthology.orchestra.run.smithi101.stdout:root 174 0.0 0.0 0 0 ? I 19:58 0:00 \_ [kworker/5:2-cgroup_pidlist_destroy] 2023-08-01T20:01:35.211 INFO:teuthology.orchestra.run.smithi101.stdout:root 175 0.0 0.0 0 0 ? I 19:58 0:00 \_ [kworker/6:2-cgroup_pidlist_destroy] 2023-08-01T20:01:35.211 INFO:teuthology.orchestra.run.smithi101.stdout:root 176 0.0 0.0 0 0 ? I< 19:58 0:00 \_ [kworker/2:1H-kblockd] 2023-08-01T20:01:35.212 INFO:teuthology.orchestra.run.smithi101.stdout:root 177 0.0 0.0 0 0 ? I< 19:58 0:00 \_ [ipv6_addrconf] 2023-08-01T20:01:35.212 INFO:teuthology.orchestra.run.smithi101.stdout:root 178 0.0 0.0 0 0 ? I< 19:58 0:00 \_ [kstrp] 2023-08-01T20:01:35.212 INFO:teuthology.orchestra.run.smithi101.stdout:root 217 0.0 0.0 0 0 ? I< 19:58 0:00 \_ [zswap-shrink] 2023-08-01T20:01:35.212 INFO:teuthology.orchestra.run.smithi101.stdout:root 231 0.0 0.0 0 0 ? I< 19:58 0:00 \_ [kworker/7:1H-kblockd] 2023-08-01T20:01:35.212 INFO:teuthology.orchestra.run.smithi101.stdout:root 264 0.0 0.0 0 0 ? I< 19:58 0:00 \_ [kworker/1:1H-kblockd] 2023-08-01T20:01:35.212 INFO:teuthology.orchestra.run.smithi101.stdout:root 278 0.0 0.0 0 0 ? I< 19:58 0:00 \_ [kworker/6:1H-kblockd] 2023-08-01T20:01:35.212 INFO:teuthology.orchestra.run.smithi101.stdout:root 280 0.0 0.0 0 0 ? I< 19:58 0:00 \_ [kworker/4:1H-kblockd] 2023-08-01T20:01:35.212 INFO:teuthology.orchestra.run.smithi101.stdout:root 282 0.0 0.0 0 0 ? I< 19:58 0:00 \_ [kworker/3:1H-kblockd] 2023-08-01T20:01:35.213 INFO:teuthology.orchestra.run.smithi101.stdout:root 283 0.0 0.0 0 0 ? I 19:58 0:00 \_ [kworker/4:2-cgroup_pidlist_destroy] 2023-08-01T20:01:35.213 INFO:teuthology.orchestra.run.smithi101.stdout:root 293 0.0 0.0 0 0 ? I 19:58 0:00 \_ [kworker/7:2-events] 2023-08-01T20:01:35.213 INFO:teuthology.orchestra.run.smithi101.stdout:root 294 0.0 0.0 0 0 ? I 19:58 0:00 \_ [kworker/7:3-cgroup_pidlist_destroy] 2023-08-01T20:01:35.213 INFO:teuthology.orchestra.run.smithi101.stdout:root 299 0.0 0.0 0 0 ? I< 19:58 0:00 \_ [kworker/5:1H-kblockd] 2023-08-01T20:01:35.213 INFO:teuthology.orchestra.run.smithi101.stdout:root 301 0.0 0.0 0 0 ? I 19:58 0:00 \_ [kworker/5:3-events] 2023-08-01T20:01:35.213 INFO:teuthology.orchestra.run.smithi101.stdout:root 322 0.0 0.0 0 0 ? I 19:58 0:00 \_ [kworker/6:3-cgroup_pidlist_destroy] 2023-08-01T20:01:35.213 INFO:teuthology.orchestra.run.smithi101.stdout:root 364 0.0 0.0 0 0 ? I 19:58 0:00 \_ [kworker/4:3-events] 2023-08-01T20:01:35.213 INFO:teuthology.orchestra.run.smithi101.stdout:root 381 0.0 0.0 0 0 ? I 19:58 0:00 \_ [kworker/1:2-events] 2023-08-01T20:01:35.214 INFO:teuthology.orchestra.run.smithi101.stdout:root 420 0.0 0.0 0 0 ? I 19:58 0:00 \_ [kworker/0:3-events] 2023-08-01T20:01:35.214 INFO:teuthology.orchestra.run.smithi101.stdout:root 421 0.0 0.0 0 0 ? I 19:58 0:00 \_ [kworker/2:2-cgroup_pidlist_destroy] 2023-08-01T20:01:35.214 INFO:teuthology.orchestra.run.smithi101.stdout:root 422 0.0 0.0 0 0 ? I< 19:58 0:00 \_ [nvme-wq] 2023-08-01T20:01:35.214 INFO:teuthology.orchestra.run.smithi101.stdout:root 423 0.0 0.0 0 0 ? I< 19:58 0:00 \_ [nvme-reset-wq] 2023-08-01T20:01:35.214 INFO:teuthology.orchestra.run.smithi101.stdout:root 424 0.0 0.0 0 0 ? I< 19:58 0:00 \_ [nvme-delete-wq] 2023-08-01T20:01:35.214 INFO:teuthology.orchestra.run.smithi101.stdout:root 425 0.0 0.0 0 0 ? I< 19:58 0:00 \_ [ata_sff] 2023-08-01T20:01:35.214 INFO:teuthology.orchestra.run.smithi101.stdout:root 428 0.0 0.0 0 0 ? I< 19:58 0:00 \_ [ixgbe] 2023-08-01T20:01:35.214 INFO:teuthology.orchestra.run.smithi101.stdout:root 437 0.0 0.0 0 0 ? S 19:58 0:00 \_ [scsi_eh_0] 2023-08-01T20:01:35.215 INFO:teuthology.orchestra.run.smithi101.stdout:root 438 0.0 0.0 0 0 ? I< 19:58 0:00 \_ [scsi_tmf_0] 2023-08-01T20:01:35.215 INFO:teuthology.orchestra.run.smithi101.stdout:root 439 0.0 0.0 0 0 ? S 19:58 0:00 \_ [scsi_eh_1] 2023-08-01T20:01:35.215 INFO:teuthology.orchestra.run.smithi101.stdout:root 440 0.0 0.0 0 0 ? I< 19:58 0:00 \_ [scsi_tmf_1] 2023-08-01T20:01:35.215 INFO:teuthology.orchestra.run.smithi101.stdout:root 441 0.0 0.0 0 0 ? S 19:58 0:00 \_ [scsi_eh_2] 2023-08-01T20:01:35.215 INFO:teuthology.orchestra.run.smithi101.stdout:root 442 0.0 0.0 0 0 ? I< 19:58 0:00 \_ [scsi_tmf_2] 2023-08-01T20:01:35.215 INFO:teuthology.orchestra.run.smithi101.stdout:root 443 0.0 0.0 0 0 ? S 19:58 0:00 \_ [scsi_eh_3] 2023-08-01T20:01:35.215 INFO:teuthology.orchestra.run.smithi101.stdout:root 444 0.0 0.0 0 0 ? I< 19:58 0:00 \_ [scsi_tmf_3] 2023-08-01T20:01:35.215 INFO:teuthology.orchestra.run.smithi101.stdout:root 447 0.0 0.0 0 0 ? S 19:58 0:00 \_ [scsi_eh_4] 2023-08-01T20:01:35.216 INFO:teuthology.orchestra.run.smithi101.stdout:root 448 0.0 0.0 0 0 ? I< 19:58 0:00 \_ [scsi_tmf_4] 2023-08-01T20:01:35.216 INFO:teuthology.orchestra.run.smithi101.stdout:root 449 0.0 0.0 0 0 ? S 19:58 0:00 \_ [scsi_eh_5] 2023-08-01T20:01:35.216 INFO:teuthology.orchestra.run.smithi101.stdout:root 450 0.0 0.0 0 0 ? I< 19:58 0:00 \_ [scsi_tmf_5] 2023-08-01T20:01:35.216 INFO:teuthology.orchestra.run.smithi101.stdout:root 451 0.0 0.0 0 0 ? S 19:58 0:00 \_ [scsi_eh_6] 2023-08-01T20:01:35.216 INFO:teuthology.orchestra.run.smithi101.stdout:root 452 0.0 0.0 0 0 ? I< 19:58 0:00 \_ [scsi_tmf_6] 2023-08-01T20:01:35.216 INFO:teuthology.orchestra.run.smithi101.stdout:root 453 0.0 0.0 0 0 ? S 19:58 0:00 \_ [scsi_eh_7] 2023-08-01T20:01:35.216 INFO:teuthology.orchestra.run.smithi101.stdout:root 454 0.0 0.0 0 0 ? I< 19:58 0:00 \_ [scsi_tmf_7] 2023-08-01T20:01:35.216 INFO:teuthology.orchestra.run.smithi101.stdout:root 455 0.0 0.0 0 0 ? S 19:58 0:00 \_ [scsi_eh_8] 2023-08-01T20:01:35.217 INFO:teuthology.orchestra.run.smithi101.stdout:root 456 0.0 0.0 0 0 ? I< 19:58 0:00 \_ [scsi_tmf_8] 2023-08-01T20:01:35.217 INFO:teuthology.orchestra.run.smithi101.stdout:root 457 0.0 0.0 0 0 ? S 19:58 0:00 \_ [scsi_eh_9] 2023-08-01T20:01:35.217 INFO:teuthology.orchestra.run.smithi101.stdout:root 458 0.0 0.0 0 0 ? I< 19:58 0:00 \_ [scsi_tmf_9] 2023-08-01T20:01:35.217 INFO:teuthology.orchestra.run.smithi101.stdout:root 459 0.0 0.0 0 0 ? I 19:58 0:00 \_ [kworker/u16:8-flush-8:0] 2023-08-01T20:01:35.217 INFO:teuthology.orchestra.run.smithi101.stdout:root 460 0.0 0.0 0 0 ? I 19:58 0:00 \_ [kworker/u16:9-writeback] 2023-08-01T20:01:35.217 INFO:teuthology.orchestra.run.smithi101.stdout:root 461 0.0 0.0 0 0 ? I 19:58 0:00 \_ [kworker/u16:10-events_unbound] 2023-08-01T20:01:35.217 INFO:teuthology.orchestra.run.smithi101.stdout:root 462 0.0 0.0 0 0 ? I 19:58 0:00 \_ [kworker/u16:11] 2023-08-01T20:01:35.217 INFO:teuthology.orchestra.run.smithi101.stdout:root 489 0.0 0.0 0 0 ? S 19:58 0:00 \_ [jbd2/sda1-8] 2023-08-01T20:01:35.218 INFO:teuthology.orchestra.run.smithi101.stdout:root 490 0.0 0.0 0 0 ? I< 19:58 0:00 \_ [ext4-rsv-conver] 2023-08-01T20:01:35.218 INFO:teuthology.orchestra.run.smithi101.stdout:root 520 0.0 0.0 0 0 ? I 19:58 0:00 \_ [kworker/3:2-events_freezable] 2023-08-01T20:01:35.218 INFO:teuthology.orchestra.run.smithi101.stdout:root 608 0.0 0.0 0 0 ? S 19:58 0:00 \_ [ext4lazyinit] 2023-08-01T20:01:35.218 INFO:teuthology.orchestra.run.smithi101.stdout:root 674 0.0 0.0 0 0 ? I< 19:58 0:00 \_ [ipmi-msghandler] 2023-08-01T20:01:35.218 INFO:teuthology.orchestra.run.smithi101.stdout:root 704 0.0 0.0 0 0 ? I< 19:58 0:00 \_ [kdmflush/253:0] 2023-08-01T20:01:35.218 INFO:teuthology.orchestra.run.smithi101.stdout:root 705 0.0 0.0 0 0 ? I< 19:58 0:00 \_ [kdmflush/253:1] 2023-08-01T20:01:35.218 INFO:teuthology.orchestra.run.smithi101.stdout:root 706 0.0 0.0 0 0 ? I< 19:58 0:00 \_ [kdmflush/253:2] 2023-08-01T20:01:35.218 INFO:teuthology.orchestra.run.smithi101.stdout:root 707 0.0 0.0 0 0 ? I< 19:58 0:00 \_ [kdmflush/253:3] 2023-08-01T20:01:35.219 INFO:teuthology.orchestra.run.smithi101.stdout:root 708 0.0 0.0 0 0 ? I< 19:58 0:00 \_ [kdmflush/253:4] 2023-08-01T20:01:35.219 INFO:teuthology.orchestra.run.smithi101.stdout:root 738 0.0 0.0 0 0 ? SN 19:58 0:00 \_ [kipmi0] 2023-08-01T20:01:35.219 INFO:teuthology.orchestra.run.smithi101.stdout:root 746 0.0 0.0 0 0 ? I< 19:58 0:00 \_ [xfsalloc] 2023-08-01T20:01:35.219 INFO:teuthology.orchestra.run.smithi101.stdout:root 747 0.0 0.0 0 0 ? I< 19:58 0:00 \_ [xfs_mru_cache] 2023-08-01T20:01:35.219 INFO:teuthology.orchestra.run.smithi101.stdout:root 748 0.0 0.0 0 0 ? I< 19:58 0:00 \_ [xfs-buf/dm-4] 2023-08-01T20:01:35.219 INFO:teuthology.orchestra.run.smithi101.stdout:root 749 0.0 0.0 0 0 ? I< 19:58 0:00 \_ [xfs-conv/dm-4] 2023-08-01T20:01:35.219 INFO:teuthology.orchestra.run.smithi101.stdout:root 750 0.0 0.0 0 0 ? I< 19:58 0:00 \_ [xfs-cil/dm-4] 2023-08-01T20:01:35.220 INFO:teuthology.orchestra.run.smithi101.stdout:root 751 0.0 0.0 0 0 ? I< 19:58 0:00 \_ [xfs-reclaim/dm-] 2023-08-01T20:01:35.220 INFO:teuthology.orchestra.run.smithi101.stdout:root 752 0.0 0.0 0 0 ? I< 19:58 0:00 \_ [xfs-gc/dm-4] 2023-08-01T20:01:35.220 INFO:teuthology.orchestra.run.smithi101.stdout:root 754 0.0 0.0 0 0 ? I< 19:58 0:00 \_ [xfs-log/dm-4] 2023-08-01T20:01:35.220 INFO:teuthology.orchestra.run.smithi101.stdout:root 756 0.0 0.0 0 0 ? S 19:58 0:00 \_ [xfsaild/dm-4] 2023-08-01T20:01:35.220 INFO:teuthology.orchestra.run.smithi101.stdout:root 757 0.0 0.0 0 0 ? I< 19:58 0:00 \_ [rpciod] 2023-08-01T20:01:35.220 INFO:teuthology.orchestra.run.smithi101.stdout:root 758 0.0 0.0 0 0 ? I< 19:58 0:00 \_ [xprtiod] 2023-08-01T20:01:35.220 INFO:teuthology.orchestra.run.smithi101.stdout:root 810 0.0 0.0 0 0 ? I 19:58 0:00 \_ [kworker/3:3-events] 2023-08-01T20:01:35.220 INFO:teuthology.orchestra.run.smithi101.stdout:root 826 0.0 0.0 0 0 ? I 19:58 0:00 \_ [kworker/2:3-events] 2023-08-01T20:01:35.221 INFO:teuthology.orchestra.run.smithi101.stdout:root 1 1.1 0.0 241392 14340 ? Ss 19:58 0:02 /usr/lib/systemd/systemd --switched-root --system --deserialize 18 2023-08-01T20:01:35.221 INFO:teuthology.orchestra.run.smithi101.stdout:root 591 0.0 0.0 89576 11796 ? Ss 19:58 0:00 /usr/lib/systemd/systemd-journald 2023-08-01T20:01:35.221 INFO:teuthology.orchestra.run.smithi101.stdout:root 631 0.2 0.0 102320 13996 ? Ss 19:58 0:00 /usr/lib/systemd/systemd-udevd 2023-08-01T20:01:35.221 INFO:teuthology.orchestra.run.smithi101.stdout:rpc 742 0.0 0.0 67248 5616 ? Ss 19:58 0:00 /usr/bin/rpcbind -w -f 2023-08-01T20:01:35.221 INFO:teuthology.orchestra.run.smithi101.stdout:root 753 0.0 0.0 130836 2324 ? S sudo zgrep '' /var/log/ceph/valgrind/* /dev/null | sort | uniq 2023-08-01T20:01:35.228 DEBUG:teuthology.orchestra.run.smithi008:> sudo zgrep '' /var/log/ceph/valgrind/* /dev/null | sort | uniq 2023-08-01T20:01:35.231 DEBUG:teuthology.orchestra.run.smithi101:> sudo zgrep '' /var/log/ceph/valgrind/* /dev/null | sort | uniq 2023-08-01T20:01:35.233 DEBUG:teuthology.orchestra.run.smithi155:> sudo zgrep '' /var/log/ceph/valgrind/* /dev/null | sort | uniq 2023-08-01T20:01:35.261 INFO:teuthology.orchestra.run.smithi006.stderr:gzip: /var/log/ceph/valgrind/*.gz: No such file or directory 2023-08-01T20:01:35.264 INFO:teuthology.orchestra.run.smithi008.stderr:gzip: /var/log/ceph/valgrind/*.gz: No such file or directory 2023-08-01T20:01:35.270 INFO:teuthology.orchestra.run.smithi155.stderr:gzip: /var/log/ceph/valgrind/*.gz: No such file or directory 2023-08-01T20:01:35.284 INFO:teuthology.orchestra.run.smithi101.stderr:gzip: /var/log/ceph/valgrind/*.gz: No such file or directory 2023-08-01T20:01:35.290 INFO:tasks.ceph:Archiving crash dumps... 2023-08-01T20:01:35.292 DEBUG:teuthology.misc:Transferring archived files from smithi006:/var/lib/ceph/crash to /home/teuthworker/archive/yuriw-2023-08-01_19:18:05-powercycle-quincy-distro-default-smithi/7358036/remote/smithi006/crash 2023-08-01T20:01:35.293 DEBUG:teuthology.orchestra.run.smithi006:> sudo tar c -f - -C /var/lib/ceph/crash -- . 2023-08-01T20:01:35.351 DEBUG:teuthology.misc:Transferring archived files from smithi008:/var/lib/ceph/crash to /home/teuthworker/archive/yuriw-2023-08-01_19:18:05-powercycle-quincy-distro-default-smithi/7358036/remote/smithi008/crash 2023-08-01T20:01:35.353 DEBUG:teuthology.orchestra.run.smithi008:> sudo tar c -f - -C /var/lib/ceph/crash -- . 2023-08-01T20:01:35.402 DEBUG:teuthology.misc:Transferring archived files from smithi101:/var/lib/ceph/crash to /home/teuthworker/archive/yuriw-2023-08-01_19:18:05-powercycle-quincy-distro-default-smithi/7358036/remote/smithi101/crash 2023-08-01T20:01:35.403 DEBUG:teuthology.orchestra.run.smithi101:> sudo tar c -f - -C /var/lib/ceph/crash -- . 2023-08-01T20:01:35.445 DEBUG:teuthology.misc:Transferring archived files from smithi155:/var/lib/ceph/crash to /home/teuthworker/archive/yuriw-2023-08-01_19:18:05-powercycle-quincy-distro-default-smithi/7358036/remote/smithi155/crash 2023-08-01T20:01:35.446 DEBUG:teuthology.orchestra.run.smithi155:> sudo tar c -f - -C /var/lib/ceph/crash -- . 2023-08-01T20:01:35.498 INFO:tasks.ceph:Compressing logs... 2023-08-01T20:01:35.499 DEBUG:teuthology.orchestra.run.smithi006:> sudo find /var/log/ceph -name '*.log' -print0 | sudo xargs -0 --no-run-if-empty -- gzip -- 2023-08-01T20:01:35.502 DEBUG:teuthology.orchestra.run.smithi008:> sudo find /var/log/ceph -name '*.log' -print0 | sudo xargs -0 --no-run-if-empty -- gzip -- 2023-08-01T20:01:35.504 DEBUG:teuthology.orchestra.run.smithi101:> sudo find /var/log/ceph -name '*.log' -print0 | sudo xargs -0 --no-run-if-empty -- gzip -- 2023-08-01T20:01:35.507 DEBUG:teuthology.orchestra.run.smithi155:> sudo find /var/log/ceph -name '*.log' -print0 | sudo xargs -0 --no-run-if-empty -- gzip -- 2023-08-01T20:02:15.341 INFO:tasks.ceph:Archiving logs... 2023-08-01T20:02:15.341 DEBUG:teuthology.misc:Transferring archived files from smithi006:/var/log/ceph to /home/teuthworker/archive/yuriw-2023-08-01_19:18:05-powercycle-quincy-distro-default-smithi/7358036/remote/smithi006/log 2023-08-01T20:02:15.343 DEBUG:teuthology.orchestra.run.smithi006:> sudo tar c -f - -C /var/log/ceph -- . 2023-08-01T20:02:15.540 DEBUG:teuthology.misc:Transferring archived files from smithi008:/var/log/ceph to /home/teuthworker/archive/yuriw-2023-08-01_19:18:05-powercycle-quincy-distro-default-smithi/7358036/remote/smithi008/log 2023-08-01T20:02:15.541 DEBUG:teuthology.orchestra.run.smithi008:> sudo tar c -f - -C /var/log/ceph -- . 2023-08-01T20:02:18.894 DEBUG:teuthology.misc:Transferring archived files from smithi101:/var/log/ceph to /home/teuthworker/archive/yuriw-2023-08-01_19:18:05-powercycle-quincy-distro-default-smithi/7358036/remote/smithi101/log 2023-08-01T20:02:18.896 DEBUG:teuthology.orchestra.run.smithi101:> sudo tar c -f - -C /var/log/ceph -- . 2023-08-01T20:02:20.457 DEBUG:teuthology.misc:Transferring archived files from smithi155:/var/log/ceph to /home/teuthworker/archive/yuriw-2023-08-01_19:18:05-powercycle-quincy-distro-default-smithi/7358036/remote/smithi155/log 2023-08-01T20:02:20.459 DEBUG:teuthology.orchestra.run.smithi155:> sudo tar c -f - -C /var/log/ceph -- . 2023-08-01T20:02:23.326 ERROR:teuthology.run_tasks:Manager failed: ceph Traceback (most recent call last): File "/home/teuthworker/src/github.com_ceph_ceph_a185a2e2933b21246ce41dd13f03fd6f8f84f03d/qa/tasks/ceph.py", line 1895, in task yield File "/home/teuthworker/src/git.ceph.com_teuthology_10753fdddd8d487ef9ffba05c09f1a055cd67877/teuthology/run_tasks.py", line 154, in run_tasks suppress = manager.__exit__(*exc_info) File "/usr/lib/python3.8/contextlib.py", line 120, in __exit__ next(self.gen) File "/home/teuthworker/src/github.com_ceph_ceph_a185a2e2933b21246ce41dd13f03fd6f8f84f03d/qa/tasks/thrashosds.py", line 215, in task cluster_manager.wait_for_all_osds_up() File "/home/teuthworker/src/github.com_ceph_ceph_a185a2e2933b21246ce41dd13f03fd6f8f84f03d/qa/tasks/ceph_manager.py", line 2796, in wait_for_all_osds_up while not self.are_all_osds_up(): File "/home/teuthworker/src/github.com_ceph_ceph_a185a2e2933b21246ce41dd13f03fd6f8f84f03d/qa/tasks/ceph_manager.py", line 2786, in are_all_osds_up x = self.get_osd_dump() File "/home/teuthworker/src/github.com_ceph_ceph_a185a2e2933b21246ce41dd13f03fd6f8f84f03d/qa/tasks/ceph_manager.py", line 2549, in get_osd_dump return self.get_osd_dump_json()['osds'] File "/home/teuthworker/src/github.com_ceph_ceph_a185a2e2933b21246ce41dd13f03fd6f8f84f03d/qa/tasks/ceph_manager.py", line 2541, in get_osd_dump_json out = self.raw_cluster_cmd('osd', 'dump', '--format=json') File "/home/teuthworker/src/github.com_ceph_ceph_a185a2e2933b21246ce41dd13f03fd6f8f84f03d/qa/tasks/ceph_manager.py", line 1624, in raw_cluster_cmd return self.run_cluster_cmd(**kwargs).stdout.getvalue() File "/home/teuthworker/src/github.com_ceph_ceph_a185a2e2933b21246ce41dd13f03fd6f8f84f03d/qa/tasks/ceph_manager.py", line 1615, in run_cluster_cmd return self.controller.run(**kwargs) File "/home/teuthworker/src/git.ceph.com_teuthology_10753fdddd8d487ef9ffba05c09f1a055cd67877/teuthology/orchestra/remote.py", line 522, in run r = self._runner(client=self.ssh, name=self.shortname, **kwargs) File "/home/teuthworker/src/git.ceph.com_teuthology_10753fdddd8d487ef9ffba05c09f1a055cd67877/teuthology/orchestra/run.py", line 455, in run r.wait() File "/home/teuthworker/src/git.ceph.com_teuthology_10753fdddd8d487ef9ffba05c09f1a055cd67877/teuthology/orchestra/run.py", line 161, in wait self._raise_for_status() File "/home/teuthworker/src/git.ceph.com_teuthology_10753fdddd8d487ef9ffba05c09f1a055cd67877/teuthology/orchestra/run.py", line 181, in _raise_for_status raise CommandFailedError( teuthology.exceptions.CommandFailedError: Command failed on smithi006 with status 124: 'sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 120 ceph --cluster ceph osd dump --format=json' During handling of the above exception, another exception occurred: Traceback (most recent call last): File "/home/teuthworker/src/github.com_ceph_ceph_a185a2e2933b21246ce41dd13f03fd6f8f84f03d/qa/tasks/ceph.py", line 1438, in run_daemon yield File "/home/teuthworker/src/git.ceph.com_teuthology_10753fdddd8d487ef9ffba05c09f1a055cd67877/teuthology/contextutil.py", line 32, in nested yield vars File "/home/teuthworker/src/github.com_ceph_ceph_a185a2e2933b21246ce41dd13f03fd6f8f84f03d/qa/tasks/ceph.py", line 1899, in task ctx.managers[config['cluster']].stop_pg_num_changes() File "/home/teuthworker/src/github.com_ceph_ceph_a185a2e2933b21246ce41dd13f03fd6f8f84f03d/qa/tasks/ceph_manager.py", line 2307, in stop_pg_num_changes osd_dump = self.get_osd_dump_json() File "/home/teuthworker/src/github.com_ceph_ceph_a185a2e2933b21246ce41dd13f03fd6f8f84f03d/qa/tasks/ceph_manager.py", line 2541, in get_osd_dump_json out = self.raw_cluster_cmd('osd', 'dump', '--format=json') File "/home/teuthworker/src/github.com_ceph_ceph_a185a2e2933b21246ce41dd13f03fd6f8f84f03d/qa/tasks/ceph_manager.py", line 1624, in raw_cluster_cmd return self.run_cluster_cmd(**kwargs).stdout.getvalue() File "/home/teuthworker/src/github.com_ceph_ceph_a185a2e2933b21246ce41dd13f03fd6f8f84f03d/qa/tasks/ceph_manager.py", line 1615, in run_cluster_cmd return self.controller.run(**kwargs) File "/home/teuthworker/src/git.ceph.com_teuthology_10753fdddd8d487ef9ffba05c09f1a055cd67877/teuthology/orchestra/remote.py", line 522, in run r = self._runner(client=self.ssh, name=self.shortname, **kwargs) File "/home/teuthworker/src/git.ceph.com_teuthology_10753fdddd8d487ef9ffba05c09f1a055cd67877/teuthology/orchestra/run.py", line 455, in run r.wait() File "/home/teuthworker/src/git.ceph.com_teuthology_10753fdddd8d487ef9ffba05c09f1a055cd67877/teuthology/orchestra/run.py", line 161, in wait self._raise_for_status() File "/home/teuthworker/src/git.ceph.com_teuthology_10753fdddd8d487ef9ffba05c09f1a055cd67877/teuthology/orchestra/run.py", line 181, in _raise_for_status raise CommandFailedError( teuthology.exceptions.CommandFailedError: Command failed on smithi006 with status 124: 'sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 120 ceph --cluster ceph osd dump --format=json' During handling of the above exception, another exception occurred: Traceback (most recent call last): File "/home/teuthworker/src/git.ceph.com_teuthology_10753fdddd8d487ef9ffba05c09f1a055cd67877/teuthology/run_tasks.py", line 154, in run_tasks suppress = manager.__exit__(*exc_info) File "/usr/lib/python3.8/contextlib.py", line 131, in __exit__ self.gen.throw(type, value, traceback) File "/home/teuthworker/src/github.com_ceph_ceph_a185a2e2933b21246ce41dd13f03fd6f8f84f03d/qa/tasks/ceph.py", line 1911, in task mon0_remote.run( File "/usr/lib/python3.8/contextlib.py", line 131, in __exit__ self.gen.throw(type, value, traceback) File "/home/teuthworker/src/git.ceph.com_teuthology_10753fdddd8d487ef9ffba05c09f1a055cd67877/teuthology/contextutil.py", line 54, in nested raise exc[1] File "/usr/lib/python3.8/contextlib.py", line 131, in __exit__ self.gen.throw(type, value, traceback) File "/home/teuthworker/src/github.com_ceph_ceph_a185a2e2933b21246ce41dd13f03fd6f8f84f03d/qa/tasks/ceph.py", line 251, in ceph_log yield File "/home/teuthworker/src/git.ceph.com_teuthology_10753fdddd8d487ef9ffba05c09f1a055cd67877/teuthology/contextutil.py", line 46, in nested if exit(*exc): File "/usr/lib/python3.8/contextlib.py", line 131, in __exit__ self.gen.throw(type, value, traceback) File "/home/teuthworker/src/github.com_ceph_ceph_a185a2e2933b21246ce41dd13f03fd6f8f84f03d/qa/tasks/ceph.py", line 1172, in cluster raise e File "/home/teuthworker/src/github.com_ceph_ceph_a185a2e2933b21246ce41dd13f03fd6f8f84f03d/qa/tasks/ceph.py", line 1154, in cluster remote.run( File "/home/teuthworker/src/git.ceph.com_teuthology_10753fdddd8d487ef9ffba05c09f1a055cd67877/teuthology/orchestra/remote.py", line 522, in run r = self._runner(client=self.ssh, name=self.shortname, **kwargs) File "/home/teuthworker/src/git.ceph.com_teuthology_10753fdddd8d487ef9ffba05c09f1a055cd67877/teuthology/orchestra/run.py", line 455, in run r.wait() File "/home/teuthworker/src/git.ceph.com_teuthology_10753fdddd8d487ef9ffba05c09f1a055cd67877/teuthology/orchestra/run.py", line 161, in wait self._raise_for_status() File "/home/teuthworker/src/git.ceph.com_teuthology_10753fdddd8d487ef9ffba05c09f1a055cd67877/teuthology/orchestra/run.py", line 181, in _raise_for_status raise CommandFailedError( teuthology.exceptions.CommandFailedError: Command failed on smithi101 with status 32: 'sync && sudo umount -f /var/lib/ceph/osd/ceph-1' 2023-08-01T20:02:23.327 DEBUG:teuthology.run_tasks:Unwinding manager install 2023-08-01T20:02:23.336 ERROR:teuthology.contextutil:Saw exception from nested tasks Traceback (most recent call last): File "/home/teuthworker/src/git.ceph.com_teuthology_10753fdddd8d487ef9ffba05c09f1a055cd67877/teuthology/contextutil.py", line 32, in nested yield vars File "/home/teuthworker/src/git.ceph.com_teuthology_10753fdddd8d487ef9ffba05c09f1a055cd67877/teuthology/task/install/__init__.py", line 626, in task yield File "/home/teuthworker/src/git.ceph.com_teuthology_10753fdddd8d487ef9ffba05c09f1a055cd67877/teuthology/run_tasks.py", line 154, in run_tasks suppress = manager.__exit__(*exc_info) File "/usr/lib/python3.8/contextlib.py", line 120, in __exit__ next(self.gen) File "/home/teuthworker/src/github.com_ceph_ceph_a185a2e2933b21246ce41dd13f03fd6f8f84f03d/qa/tasks/thrashosds.py", line 215, in task cluster_manager.wait_for_all_osds_up() File "/home/teuthworker/src/github.com_ceph_ceph_a185a2e2933b21246ce41dd13f03fd6f8f84f03d/qa/tasks/ceph_manager.py", line 2796, in wait_for_all_osds_up while not self.are_all_osds_up(): File "/home/teuthworker/src/github.com_ceph_ceph_a185a2e2933b21246ce41dd13f03fd6f8f84f03d/qa/tasks/ceph_manager.py", line 2786, in are_all_osds_up x = self.get_osd_dump() File "/home/teuthworker/src/github.com_ceph_ceph_a185a2e2933b21246ce41dd13f03fd6f8f84f03d/qa/tasks/ceph_manager.py", line 2549, in get_osd_dump return self.get_osd_dump_json()['osds'] File "/home/teuthworker/src/github.com_ceph_ceph_a185a2e2933b21246ce41dd13f03fd6f8f84f03d/qa/tasks/ceph_manager.py", line 2541, in get_osd_dump_json out = self.raw_cluster_cmd('osd', 'dump', '--format=json') File "/home/teuthworker/src/github.com_ceph_ceph_a185a2e2933b21246ce41dd13f03fd6f8f84f03d/qa/tasks/ceph_manager.py", line 1624, in raw_cluster_cmd return self.run_cluster_cmd(**kwargs).stdout.getvalue() File "/home/teuthworker/src/github.com_ceph_ceph_a185a2e2933b21246ce41dd13f03fd6f8f84f03d/qa/tasks/ceph_manager.py", line 1615, in run_cluster_cmd return self.controller.run(**kwargs) File "/home/teuthworker/src/git.ceph.com_teuthology_10753fdddd8d487ef9ffba05c09f1a055cd67877/teuthology/orchestra/remote.py", line 522, in run r = self._runner(client=self.ssh, name=self.shortname, **kwargs) File "/home/teuthworker/src/git.ceph.com_teuthology_10753fdddd8d487ef9ffba05c09f1a055cd67877/teuthology/orchestra/run.py", line 455, in run r.wait() File "/home/teuthworker/src/git.ceph.com_teuthology_10753fdddd8d487ef9ffba05c09f1a055cd67877/teuthology/orchestra/run.py", line 161, in wait self._raise_for_status() File "/home/teuthworker/src/git.ceph.com_teuthology_10753fdddd8d487ef9ffba05c09f1a055cd67877/teuthology/orchestra/run.py", line 181, in _raise_for_status raise CommandFailedError( teuthology.exceptions.CommandFailedError: Command failed on smithi006 with status 124: 'sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 120 ceph --cluster ceph osd dump --format=json' 2023-08-01T20:02:23.336 INFO:teuthology.task.install.util:Removing shipped files: /home/ubuntu/cephtest/valgrind.supp /usr/bin/daemon-helper /usr/bin/adjust-ulimits /usr/bin/stdin-killer... 2023-08-01T20:02:23.337 DEBUG:teuthology.orchestra.run.smithi006:> sudo rm -f -- /home/ubuntu/cephtest/valgrind.supp /usr/bin/daemon-helper /usr/bin/adjust-ulimits /usr/bin/stdin-killer 2023-08-01T20:02:23.339 DEBUG:teuthology.orchestra.run.smithi008:> sudo rm -f -- /home/ubuntu/cephtest/valgrind.supp /usr/bin/daemon-helper /usr/bin/adjust-ulimits /usr/bin/stdin-killer 2023-08-01T20:02:23.342 DEBUG:teuthology.orchestra.run.smithi101:> sudo rm -f -- /home/ubuntu/cephtest/valgrind.supp /usr/bin/daemon-helper /usr/bin/adjust-ulimits /usr/bin/stdin-killer 2023-08-01T20:02:23.345 DEBUG:teuthology.orchestra.run.smithi155:> sudo rm -f -- /home/ubuntu/cephtest/valgrind.supp /usr/bin/daemon-helper /usr/bin/adjust-ulimits /usr/bin/stdin-killer 2023-08-01T20:02:23.481 DEBUG:teuthology.run_tasks:Unwinding manager clock 2023-08-01T20:02:23.490 INFO:teuthology.task.clock:Checking final clock skew... 2023-08-01T20:02:23.490 DEBUG:teuthology.orchestra.run.smithi006:> PATH=/usr/bin:/usr/sbin ntpq -p || PATH=/usr/bin:/usr/sbin chronyc sources || true 2023-08-01T20:02:23.493 DEBUG:teuthology.orchestra.run.smithi008:> PATH=/usr/bin:/usr/sbin ntpq -p || PATH=/usr/bin:/usr/sbin chronyc sources || true 2023-08-01T20:02:23.495 DEBUG:teuthology.orchestra.run.smithi101:> PATH=/usr/bin:/usr/sbin ntpq -p || PATH=/usr/bin:/usr/sbin chronyc sources || true 2023-08-01T20:02:23.498 DEBUG:teuthology.orchestra.run.smithi155:> PATH=/usr/bin:/usr/sbin ntpq -p || PATH=/usr/bin:/usr/sbin chronyc sources || true 2023-08-01T20:02:23.511 INFO:teuthology.orchestra.run.smithi006.stderr:bash: ntpq: command not found 2023-08-01T20:02:23.513 INFO:teuthology.orchestra.run.smithi008.stderr:bash: ntpq: command not found 2023-08-01T20:02:23.515 INFO:teuthology.orchestra.run.smithi101.stderr:bash: ntpq: command not found 2023-08-01T20:02:23.516 INFO:teuthology.orchestra.run.smithi006.stdout:MS Name/IP address Stratum Poll Reach LastRx Last sample 2023-08-01T20:02:23.516 INFO:teuthology.orchestra.run.smithi006.stdout:=============================================================================== 2023-08-01T20:02:23.516 INFO:teuthology.orchestra.run.smithi006.stdout:^+ hv01.front.sepia.ceph.com 2 6 377 2 +895us[ +902us] +/- 75ms 2023-08-01T20:02:23.516 INFO:teuthology.orchestra.run.smithi006.stdout:^+ hv02.front.sepia.ceph.com 3 6 377 1 +936us[ +936us] +/- 55ms 2023-08-01T20:02:23.516 INFO:teuthology.orchestra.run.smithi006.stdout:^* hv03.front.sepia.ceph.com 3 6 377 2 -1946us[-1939us] +/- 76ms 2023-08-01T20:02:23.517 INFO:teuthology.orchestra.run.smithi006.stdout:^? hv04.front.sepia.ceph.com 0 8 0 - +0ns[ +0ns] +/- 0ns 2023-08-01T20:02:23.517 INFO:teuthology.orchestra.run.smithi155.stderr:bash: ntpq: command not found 2023-08-01T20:02:23.518 INFO:teuthology.orchestra.run.smithi008.stdout:MS Name/IP address Stratum Poll Reach LastRx Last sample 2023-08-01T20:02:23.518 INFO:teuthology.orchestra.run.smithi008.stdout:=============================================================================== 2023-08-01T20:02:23.518 INFO:teuthology.orchestra.run.smithi008.stdout:^+ hv01.front.sepia.ceph.com 2 6 377 2 +892us[ +915us] +/- 75ms 2023-08-01T20:02:23.518 INFO:teuthology.orchestra.run.smithi008.stdout:^+ hv02.front.sepia.ceph.com 3 6 377 2 +950us[ +973us] +/- 55ms 2023-08-01T20:02:23.519 INFO:teuthology.orchestra.run.smithi008.stdout:^* hv03.front.sepia.ceph.com 3 6 377 1 -1955us[-1931us] +/- 76ms 2023-08-01T20:02:23.519 INFO:teuthology.orchestra.run.smithi008.stdout:^? hv04.front.sepia.ceph.com 0 8 0 - +0ns[ +0ns] +/- 0ns 2023-08-01T20:02:23.521 INFO:teuthology.orchestra.run.smithi101.stdout:MS Name/IP address Stratum Poll Reach LastRx Last sample 2023-08-01T20:02:23.521 INFO:teuthology.orchestra.run.smithi101.stdout:=============================================================================== 2023-08-01T20:02:23.521 INFO:teuthology.orchestra.run.smithi101.stdout:^+ hv01.front.sepia.ceph.com 2 6 177 40 +816us[ +809us] +/- 75ms 2023-08-01T20:02:23.521 INFO:teuthology.orchestra.run.smithi101.stdout:^+ hv02.front.sepia.ceph.com 3 6 177 40 +860us[ +854us] +/- 54ms 2023-08-01T20:02:23.521 INFO:teuthology.orchestra.run.smithi101.stdout:^* hv03.front.sepia.ceph.com 3 6 177 39 -2032us[-2038us] +/- 76ms 2023-08-01T20:02:23.521 INFO:teuthology.orchestra.run.smithi101.stdout:^? hv04.front.sepia.ceph.com 0 8 0 - +0ns[ +0ns] +/- 0ns 2023-08-01T20:02:23.522 INFO:teuthology.orchestra.run.smithi155.stdout:MS Name/IP address Stratum Poll Reach LastRx Last sample 2023-08-01T20:02:23.522 INFO:teuthology.orchestra.run.smithi155.stdout:=============================================================================== 2023-08-01T20:02:23.522 INFO:teuthology.orchestra.run.smithi155.stdout:^+ hv01.front.sepia.ceph.com 2 6 377 4 +923us[ +930us] +/- 75ms 2023-08-01T20:02:23.523 INFO:teuthology.orchestra.run.smithi155.stdout:^+ hv02.front.sepia.ceph.com 3 6 377 3 +975us[ +982us] +/- 55ms 2023-08-01T20:02:23.523 INFO:teuthology.orchestra.run.smithi155.stdout:^* hv03.front.sepia.ceph.com 3 6 377 2 -1930us[-1923us] +/- 76ms 2023-08-01T20:02:23.523 INFO:teuthology.orchestra.run.smithi155.stdout:^? hv04.front.sepia.ceph.com 0 8 0 - +0ns[ +0ns] +/- 0ns 2023-08-01T20:02:23.524 DEBUG:teuthology.run_tasks:Unwinding manager ansible.cephlab 2023-08-01T20:02:23.532 INFO:teuthology.task.ansible:Skipping ansible cleanup... 2023-08-01T20:02:23.533 DEBUG:teuthology.run_tasks:Unwinding manager selinux 2023-08-01T20:02:23.543 DEBUG:teuthology.orchestra.run.smithi006:> mkdir /home/ubuntu/cephtest/archive/audit && sudo cp /var/log/audit/audit.log /home/ubuntu/cephtest/archive/audit && sudo chown $USER /home/ubuntu/cephtest/archive/audit/audit.log && gzip /home/ubuntu/cephtest/archive/audit/audit.log 2023-08-01T20:02:23.657 DEBUG:teuthology.orchestra.run.smithi008:> mkdir /home/ubuntu/cephtest/archive/audit && sudo cp /var/log/audit/audit.log /home/ubuntu/cephtest/archive/audit && sudo chown $USER /home/ubuntu/cephtest/archive/audit/audit.log && gzip /home/ubuntu/cephtest/archive/audit/audit.log 2023-08-01T20:02:23.757 DEBUG:teuthology.orchestra.run.smithi101:> mkdir /home/ubuntu/cephtest/archive/audit && sudo cp /var/log/audit/audit.log /home/ubuntu/cephtest/archive/audit && sudo chown $USER /home/ubuntu/cephtest/archive/audit/audit.log && gzip /home/ubuntu/cephtest/archive/audit/audit.log 2023-08-01T20:02:23.934 DEBUG:teuthology.orchestra.run.smithi155:> mkdir /home/ubuntu/cephtest/archive/audit && sudo cp /var/log/audit/audit.log /home/ubuntu/cephtest/archive/audit && sudo chown $USER /home/ubuntu/cephtest/archive/audit/audit.log && gzip /home/ubuntu/cephtest/archive/audit/audit.log 2023-08-01T20:02:24.033 DEBUG:teuthology.orchestra.run.smithi006:> sudo grep -a 'avc: .*denied' /var/log/audit/audit.log | grep -av -e 'comm="dmidecode"' -e chronyd.service -e 'name="cephtest"' -e scontext=system_u:system_r:nrpe_t:s0 -e scontext=system_u:system_r:pcp_pmlogger_t -e scontext=system_u:system_r:pcp_pmcd_t:s0 -e 'comm="rhsmd"' -e scontext=system_u:system_r:syslogd_t:s0 -e tcontext=system_u:system_r:nrpe_t:s0 -e 'comm="updatedb"' -e 'comm="smartd"' -e 'comm="rhsmcertd-worke"' -e 'comm="setroubleshootd"' -e 'comm="rpm"' -e tcontext=system_u:object_r:container_runtime_exec_t:s0 -e 'comm="ksmtuned"' -e 'comm="sssd"' -e 'comm="sss_cache"' -e context=system_u:system_r:NetworkManager_dispatcher_t:s0 2023-08-01T20:02:24.072 DEBUG:teuthology.orchestra.run:got remote process result: 1 2023-08-01T20:02:24.072 DEBUG:teuthology.orchestra.run.smithi008:> sudo grep -a 'avc: .*denied' /var/log/audit/audit.log | grep -av -e 'comm="dmidecode"' -e chronyd.service -e 'name="cephtest"' -e scontext=system_u:system_r:nrpe_t:s0 -e scontext=system_u:system_r:pcp_pmlogger_t -e scontext=system_u:system_r:pcp_pmcd_t:s0 -e 'comm="rhsmd"' -e scontext=system_u:system_r:syslogd_t:s0 -e tcontext=system_u:system_r:nrpe_t:s0 -e 'comm="updatedb"' -e 'comm="smartd"' -e 'comm="rhsmcertd-worke"' -e 'comm="setroubleshootd"' -e 'comm="rpm"' -e tcontext=system_u:object_r:container_runtime_exec_t:s0 -e 'comm="ksmtuned"' -e 'comm="sssd"' -e 'comm="sss_cache"' -e context=system_u:system_r:NetworkManager_dispatcher_t:s0 2023-08-01T20:02:24.109 DEBUG:teuthology.orchestra.run:got remote process result: 1 2023-08-01T20:02:24.110 DEBUG:teuthology.orchestra.run.smithi101:> sudo grep -a 'avc: .*denied' /var/log/audit/audit.log | grep -av -e 'comm="dmidecode"' -e chronyd.service -e 'name="cephtest"' -e scontext=system_u:system_r:nrpe_t:s0 -e scontext=system_u:system_r:pcp_pmlogger_t -e scontext=system_u:system_r:pcp_pmcd_t:s0 -e 'comm="rhsmd"' -e scontext=system_u:system_r:syslogd_t:s0 -e tcontext=system_u:system_r:nrpe_t:s0 -e 'comm="updatedb"' -e 'comm="smartd"' -e 'comm="rhsmcertd-worke"' -e 'comm="setroubleshootd"' -e 'comm="rpm"' -e tcontext=system_u:object_r:container_runtime_exec_t:s0 -e 'comm="ksmtuned"' -e 'comm="sssd"' -e 'comm="sss_cache"' -e context=system_u:system_r:NetworkManager_dispatcher_t:s0 2023-08-01T20:02:24.145 DEBUG:teuthology.orchestra.run:got remote process result: 1 2023-08-01T20:02:24.146 DEBUG:teuthology.orchestra.run.smithi155:> sudo grep -a 'avc: .*denied' /var/log/audit/audit.log | grep -av -e 'comm="dmidecode"' -e chronyd.service -e 'name="cephtest"' -e scontext=system_u:system_r:nrpe_t:s0 -e scontext=system_u:system_r:pcp_pmlogger_t -e scontext=system_u:system_r:pcp_pmcd_t:s0 -e 'comm="rhsmd"' -e scontext=system_u:system_r:syslogd_t:s0 -e tcontext=system_u:system_r:nrpe_t:s0 -e 'comm="updatedb"' -e 'comm="smartd"' -e 'comm="rhsmcertd-worke"' -e 'comm="setroubleshootd"' -e 'comm="rpm"' -e tcontext=system_u:object_r:container_runtime_exec_t:s0 -e 'comm="ksmtuned"' -e 'comm="sssd"' -e 'comm="sss_cache"' -e context=system_u:system_r:NetworkManager_dispatcher_t:s0 2023-08-01T20:02:24.181 DEBUG:teuthology.orchestra.run:got remote process result: 1 2023-08-01T20:02:24.181 DEBUG:teuthology.run_tasks:Unwinding manager pcp 2023-08-01T20:02:24.191 DEBUG:teuthology.run_tasks:Unwinding manager internal.timer 2023-08-01T20:02:24.201 INFO:teuthology.task.internal:Duration was 1314.832748 seconds 2023-08-01T20:02:24.202 DEBUG:teuthology.run_tasks:Unwinding manager internal.syslog 2023-08-01T20:02:24.216 INFO:teuthology.task.internal.syslog:Shutting down syslog monitoring... 2023-08-01T20:02:24.216 DEBUG:teuthology.orchestra.run.smithi006:> sudo rm -f -- /etc/rsyslog.d/80-cephtest.conf && sudo service rsyslog restart 2023-08-01T20:02:24.219 DEBUG:teuthology.orchestra.run.smithi008:> sudo rm -f -- /etc/rsyslog.d/80-cephtest.conf && sudo service rsyslog restart 2023-08-01T20:02:24.221 DEBUG:teuthology.orchestra.run.smithi101:> sudo rm -f -- /etc/rsyslog.d/80-cephtest.conf && sudo service rsyslog restart 2023-08-01T20:02:24.224 DEBUG:teuthology.orchestra.run.smithi155:> sudo rm -f -- /etc/rsyslog.d/80-cephtest.conf && sudo service rsyslog restart 2023-08-01T20:02:24.273 INFO:teuthology.orchestra.run.smithi155.stderr:Redirecting to /bin/systemctl restart rsyslog.service 2023-08-01T20:02:24.273 INFO:teuthology.orchestra.run.smithi008.stderr:Redirecting to /bin/systemctl restart rsyslog.service 2023-08-01T20:02:24.274 INFO:teuthology.orchestra.run.smithi006.stderr:Redirecting to /bin/systemctl restart rsyslog.service 2023-08-01T20:02:24.306 INFO:teuthology.orchestra.run.smithi101.stderr:Redirecting to /bin/systemctl restart rsyslog.service 2023-08-01T20:02:24.609 INFO:teuthology.task.internal.syslog:Checking logs for errors... 2023-08-01T20:02:24.609 DEBUG:teuthology.task.internal.syslog:Checking ubuntu@smithi006.front.sepia.ceph.com 2023-08-01T20:02:24.610 DEBUG:teuthology.orchestra.run.smithi006:> egrep --binary-files=text '\bBUG\b|\bINFO\b|\bDEADLOCK\b' /home/ubuntu/cephtest/archive/syslog/kern.log | grep -v 'task .* blocked for more than .* seconds' | grep -v 'lockdep is turned off' | grep -v 'trying to register non-static key' | grep -v 'DEBUG: fsize' | grep -v CRON | grep -v 'BUG: bad unlock balance detected' | grep -v 'inconsistent lock state' | grep -v '*** DEADLOCK ***' | grep -v 'INFO: possible irq lock inversion dependency detected' | grep -v 'INFO: NMI handler (perf_event_nmi_handler) took too long to run' | grep -v 'INFO: recovery required on readonly' | grep -v 'ceph-create-keys: INFO' | grep -v INFO:ceph-create-keys | grep -v 'Loaded datasource DataSourceOpenStack' | grep -v 'container-storage-setup: INFO: Volume group backing root filesystem could not be determined' | egrep -v '\bsalt-master\b|\bsalt-minion\b|\bsalt-api\b' | grep -v ceph-crash | egrep -v '\btcmu-runner\b.*\bINFO\b' | head -n 1 2023-08-01T20:02:24.638 DEBUG:teuthology.task.internal.syslog:Checking ubuntu@smithi008.front.sepia.ceph.com 2023-08-01T20:02:24.638 DEBUG:teuthology.orchestra.run.smithi008:> egrep --binary-files=text '\bBUG\b|\bINFO\b|\bDEADLOCK\b' /home/ubuntu/cephtest/archive/syslog/kern.log | grep -v 'task .* blocked for more than .* seconds' | grep -v 'lockdep is turned off' | grep -v 'trying to register non-static key' | grep -v 'DEBUG: fsize' | grep -v CRON | grep -v 'BUG: bad unlock balance detected' | grep -v 'inconsistent lock state' | grep -v '*** DEADLOCK ***' | grep -v 'INFO: possible irq lock inversion dependency detected' | grep -v 'INFO: NMI handler (perf_event_nmi_handler) took too long to run' | grep -v 'INFO: recovery required on readonly' | grep -v 'ceph-create-keys: INFO' | grep -v INFO:ceph-create-keys | grep -v 'Loaded datasource DataSourceOpenStack' | grep -v 'container-storage-setup: INFO: Volume group backing root filesystem could not be determined' | egrep -v '\bsalt-master\b|\bsalt-minion\b|\bsalt-api\b' | grep -v ceph-crash | egrep -v '\btcmu-runner\b.*\bINFO\b' | head -n 1 2023-08-01T20:02:24.666 DEBUG:teuthology.task.internal.syslog:Checking ubuntu@smithi101.front.sepia.ceph.com 2023-08-01T20:02:24.667 DEBUG:teuthology.orchestra.run.smithi101:> egrep --binary-files=text '\bBUG\b|\bINFO\b|\bDEADLOCK\b' /home/ubuntu/cephtest/archive/syslog/kern.log | grep -v 'task .* blocked for more than .* seconds' | grep -v 'lockdep is turned off' | grep -v 'trying to register non-static key' | grep -v 'DEBUG: fsize' | grep -v CRON | grep -v 'BUG: bad unlock balance detected' | grep -v 'inconsistent lock state' | grep -v '*** DEADLOCK ***' | grep -v 'INFO: possible irq lock inversion dependency detected' | grep -v 'INFO: NMI handler (perf_event_nmi_handler) took too long to run' | grep -v 'INFO: recovery required on readonly' | grep -v 'ceph-create-keys: INFO' | grep -v INFO:ceph-create-keys | grep -v 'Loaded datasource DataSourceOpenStack' | grep -v 'container-storage-setup: INFO: Volume group backing root filesystem could not be determined' | egrep -v '\bsalt-master\b|\bsalt-minion\b|\bsalt-api\b' | grep -v ceph-crash | egrep -v '\btcmu-runner\b.*\bINFO\b' | head -n 1 2023-08-01T20:02:24.693 DEBUG:teuthology.task.internal.syslog:Checking ubuntu@smithi155.front.sepia.ceph.com 2023-08-01T20:02:24.693 DEBUG:teuthology.orchestra.run.smithi155:> egrep --binary-files=text '\bBUG\b|\bINFO\b|\bDEADLOCK\b' /home/ubuntu/cephtest/archive/syslog/kern.log | grep -v 'task .* blocked for more than .* seconds' | grep -v 'lockdep is turned off' | grep -v 'trying to register non-static key' | grep -v 'DEBUG: fsize' | grep -v CRON | grep -v 'BUG: bad unlock balance detected' | grep -v 'inconsistent lock state' | grep -v '*** DEADLOCK ***' | grep -v 'INFO: possible irq lock inversion dependency detected' | grep -v 'INFO: NMI handler (perf_event_nmi_handler) took too long to run' | grep -v 'INFO: recovery required on readonly' | grep -v 'ceph-create-keys: INFO' | grep -v INFO:ceph-create-keys | grep -v 'Loaded datasource DataSourceOpenStack' | grep -v 'container-storage-setup: INFO: Volume group backing root filesystem could not be determined' | egrep -v '\bsalt-master\b|\bsalt-minion\b|\bsalt-api\b' | grep -v ceph-crash | egrep -v '\btcmu-runner\b.*\bINFO\b' | head -n 1 2023-08-01T20:02:24.718 INFO:teuthology.task.internal.syslog:Compressing syslogs... 2023-08-01T20:02:24.719 DEBUG:teuthology.orchestra.run.smithi006:> find /home/ubuntu/cephtest/archive/syslog -name '*.log' -print0 | sudo xargs -0 --no-run-if-empty -- gzip -- 2023-08-01T20:02:24.721 DEBUG:teuthology.orchestra.run.smithi008:> find /home/ubuntu/cephtest/archive/syslog -name '*.log' -print0 | sudo xargs -0 --no-run-if-empty -- gzip -- 2023-08-01T20:02:24.723 DEBUG:teuthology.orchestra.run.smithi101:> find /home/ubuntu/cephtest/archive/syslog -name '*.log' -print0 | sudo xargs -0 --no-run-if-empty -- gzip -- 2023-08-01T20:02:24.735 DEBUG:teuthology.orchestra.run.smithi155:> find /home/ubuntu/cephtest/archive/syslog -name '*.log' -print0 | sudo xargs -0 --no-run-if-empty -- gzip -- 2023-08-01T20:02:24.799 INFO:teuthology.task.internal.syslog:Gathering journactl -b0... 2023-08-01T20:02:24.799 DEBUG:teuthology.orchestra.run.smithi006:> sudo journalctl -b0 | gzip -9 > /home/ubuntu/cephtest/archive/syslog/journalctl-b0.gz 2023-08-01T20:02:24.802 DEBUG:teuthology.orchestra.run.smithi008:> sudo journalctl -b0 | gzip -9 > /home/ubuntu/cephtest/archive/syslog/journalctl-b0.gz 2023-08-01T20:02:24.804 DEBUG:teuthology.orchestra.run.smithi101:> sudo journalctl -b0 | gzip -9 > /home/ubuntu/cephtest/archive/syslog/journalctl-b0.gz 2023-08-01T20:02:24.807 DEBUG:teuthology.orchestra.run.smithi155:> sudo journalctl -b0 | gzip -9 > /home/ubuntu/cephtest/archive/syslog/journalctl-b0.gz 2023-08-01T20:02:24.907 DEBUG:teuthology.run_tasks:Unwinding manager internal.sudo 2023-08-01T20:02:24.918 INFO:teuthology.task.internal:Restoring /etc/sudoers... 2023-08-01T20:02:24.918 DEBUG:teuthology.orchestra.run.smithi006:> sudo mv -f /etc/sudoers.orig.teuthology /etc/sudoers 2023-08-01T20:02:24.948 DEBUG:teuthology.orchestra.run.smithi008:> sudo mv -f /etc/sudoers.orig.teuthology /etc/sudoers 2023-08-01T20:02:24.977 DEBUG:teuthology.orchestra.run.smithi101:> sudo mv -f /etc/sudoers.orig.teuthology /etc/sudoers 2023-08-01T20:02:25.007 DEBUG:teuthology.orchestra.run.smithi155:> sudo mv -f /etc/sudoers.orig.teuthology /etc/sudoers 2023-08-01T20:02:25.035 DEBUG:teuthology.run_tasks:Unwinding manager internal.coredump 2023-08-01T20:02:25.045 DEBUG:teuthology.orchestra.run.smithi006:> sudo sysctl -w kernel.core_pattern=core && sudo bash -c 'for f in `find /home/ubuntu/cephtest/archive/coredump -type f`; do file $f | grep -q systemd-sysusers && rm $f || true ; done' && rmdir --ignore-fail-on-non-empty -- /home/ubuntu/cephtest/archive/coredump 2023-08-01T20:02:25.049 DEBUG:teuthology.orchestra.run.smithi008:> sudo sysctl -w kernel.core_pattern=core && sudo bash -c 'for f in `find /home/ubuntu/cephtest/archive/coredump -type f`; do file $f | grep -q systemd-sysusers && rm $f || true ; done' && rmdir --ignore-fail-on-non-empty -- /home/ubuntu/cephtest/archive/coredump 2023-08-01T20:02:25.052 DEBUG:teuthology.orchestra.run.smithi101:> sudo sysctl -w kernel.core_pattern=core && sudo bash -c 'for f in `find /home/ubuntu/cephtest/archive/coredump -type f`; do file $f | grep -q systemd-sysusers && rm $f || true ; done' && rmdir --ignore-fail-on-non-empty -- /home/ubuntu/cephtest/archive/coredump 2023-08-01T20:02:25.054 DEBUG:teuthology.orchestra.run.smithi155:> sudo sysctl -w kernel.core_pattern=core && sudo bash -c 'for f in `find /home/ubuntu/cephtest/archive/coredump -type f`; do file $f | grep -q systemd-sysusers && rm $f || true ; done' && rmdir --ignore-fail-on-non-empty -- /home/ubuntu/cephtest/archive/coredump 2023-08-01T20:02:25.074 INFO:teuthology.orchestra.run.smithi006.stdout:kernel.core_pattern = core 2023-08-01T20:02:25.078 INFO:teuthology.orchestra.run.smithi008.stdout:kernel.core_pattern = core 2023-08-01T20:02:25.101 INFO:teuthology.orchestra.run.smithi155.stdout:kernel.core_pattern = core 2023-08-01T20:02:25.102 INFO:teuthology.orchestra.run.smithi101.stdout:kernel.core_pattern = core 2023-08-01T20:02:25.132 DEBUG:teuthology.orchestra.run.smithi006:> test -e /home/ubuntu/cephtest/archive/coredump 2023-08-01T20:02:25.191 DEBUG:teuthology.orchestra.run:got remote process result: 1 2023-08-01T20:02:25.192 DEBUG:teuthology.orchestra.run.smithi008:> test -e /home/ubuntu/cephtest/archive/coredump 2023-08-01T20:02:25.209 DEBUG:teuthology.orchestra.run:got remote process result: 1 2023-08-01T20:02:25.210 DEBUG:teuthology.orchestra.run.smithi101:> test -e /home/ubuntu/cephtest/archive/coredump 2023-08-01T20:02:25.227 DEBUG:teuthology.orchestra.run:got remote process result: 1 2023-08-01T20:02:25.228 DEBUG:teuthology.orchestra.run.smithi155:> test -e /home/ubuntu/cephtest/archive/coredump 2023-08-01T20:02:25.245 DEBUG:teuthology.orchestra.run:got remote process result: 1 2023-08-01T20:02:25.246 DEBUG:teuthology.run_tasks:Unwinding manager internal.archive 2023-08-01T20:02:25.256 INFO:teuthology.task.internal:Transferring archived files... 2023-08-01T20:02:25.257 DEBUG:teuthology.misc:Transferring archived files from smithi006:/home/ubuntu/cephtest/archive to /home/teuthworker/archive/yuriw-2023-08-01_19:18:05-powercycle-quincy-distro-default-smithi/7358036/remote/smithi006 2023-08-01T20:02:25.258 DEBUG:teuthology.orchestra.run.smithi006:> sudo tar c -f - -C /home/ubuntu/cephtest/archive -- . 2023-08-01T20:02:25.297 DEBUG:teuthology.misc:Transferring archived files from smithi008:/home/ubuntu/cephtest/archive to /home/teuthworker/archive/yuriw-2023-08-01_19:18:05-powercycle-quincy-distro-default-smithi/7358036/remote/smithi008 2023-08-01T20:02:25.297 DEBUG:teuthology.orchestra.run.smithi008:> sudo tar c -f - -C /home/ubuntu/cephtest/archive -- . 2023-08-01T20:02:25.334 DEBUG:teuthology.misc:Transferring archived files from smithi101:/home/ubuntu/cephtest/archive to /home/teuthworker/archive/yuriw-2023-08-01_19:18:05-powercycle-quincy-distro-default-smithi/7358036/remote/smithi101 2023-08-01T20:02:25.334 DEBUG:teuthology.orchestra.run.smithi101:> sudo tar c -f - -C /home/ubuntu/cephtest/archive -- . 2023-08-01T20:02:25.370 DEBUG:teuthology.misc:Transferring archived files from smithi155:/home/ubuntu/cephtest/archive to /home/teuthworker/archive/yuriw-2023-08-01_19:18:05-powercycle-quincy-distro-default-smithi/7358036/remote/smithi155 2023-08-01T20:02:25.371 DEBUG:teuthology.orchestra.run.smithi155:> sudo tar c -f - -C /home/ubuntu/cephtest/archive -- . 2023-08-01T20:02:25.405 INFO:teuthology.task.internal:Removing archive directory... 2023-08-01T20:02:25.406 DEBUG:teuthology.orchestra.run.smithi006:> rm -rf -- /home/ubuntu/cephtest/archive 2023-08-01T20:02:25.408 DEBUG:teuthology.orchestra.run.smithi008:> rm -rf -- /home/ubuntu/cephtest/archive 2023-08-01T20:02:25.410 DEBUG:teuthology.orchestra.run.smithi101:> rm -rf -- /home/ubuntu/cephtest/archive 2023-08-01T20:02:25.412 DEBUG:teuthology.orchestra.run.smithi155:> rm -rf -- /home/ubuntu/cephtest/archive 2023-08-01T20:02:25.459 DEBUG:teuthology.run_tasks:Unwinding manager internal.archive_upload 2023-08-01T20:02:25.472 INFO:teuthology.task.internal:Not uploading archives. 2023-08-01T20:02:25.472 DEBUG:teuthology.run_tasks:Unwinding manager internal.base 2023-08-01T20:02:25.575 INFO:teuthology.task.internal:Tidying up after the test... 2023-08-01T20:02:25.576 DEBUG:teuthology.orchestra.run.smithi006:> find /home/ubuntu/cephtest -ls ; rmdir -- /home/ubuntu/cephtest 2023-08-01T20:02:25.578 DEBUG:teuthology.orchestra.run.smithi008:> find /home/ubuntu/cephtest -ls ; rmdir -- /home/ubuntu/cephtest 2023-08-01T20:02:25.580 DEBUG:teuthology.orchestra.run.smithi101:> find /home/ubuntu/cephtest -ls ; rmdir -- /home/ubuntu/cephtest 2023-08-01T20:02:25.582 DEBUG:teuthology.orchestra.run.smithi155:> find /home/ubuntu/cephtest -ls ; rmdir -- /home/ubuntu/cephtest 2023-08-01T20:02:25.596 INFO:teuthology.orchestra.run.smithi006.stdout: 393224 4 drwxr-xr-x 3 ubuntu ubuntu 4096 Aug 1 20:02 /home/ubuntu/cephtest 2023-08-01T20:02:25.596 INFO:teuthology.orchestra.run.smithi006.stdout: 656076 4 drwxr-xr-x 2 ubuntu ubuntu 4096 Aug 1 19:53 /home/ubuntu/cephtest/ceph.data 2023-08-01T20:02:25.597 INFO:teuthology.orchestra.run.smithi008.stdout: 393224 4 drwxr-xr-x 3 ubuntu ubuntu 4096 Aug 1 20:02 /home/ubuntu/cephtest 2023-08-01T20:02:25.597 INFO:teuthology.orchestra.run.smithi008.stdout: 393264 4 -rw-rw-r-- 1 ubuntu ubuntu 409 Aug 1 19:53 /home/ubuntu/cephtest/ceph.monmap 2023-08-01T20:02:25.597 INFO:teuthology.orchestra.run.smithi008.stdout: 656080 4 drwxr-xr-x 2 ubuntu ubuntu 4096 Aug 1 19:53 /home/ubuntu/cephtest/ceph.data 2023-08-01T20:02:25.598 DEBUG:teuthology.orchestra.run:got remote process result: 1 2023-08-01T20:02:25.598 INFO:teuthology.orchestra.run.smithi006.stderr:rmdir: failed to remove '/home/ubuntu/cephtest': Directory not empty 2023-08-01T20:02:25.599 ERROR:teuthology.run_tasks:Manager failed: internal.base Traceback (most recent call last): File "/home/teuthworker/src/git.ceph.com_teuthology_10753fdddd8d487ef9ffba05c09f1a055cd67877/teuthology/task/internal/__init__.py", line 48, in base yield File "/home/teuthworker/src/git.ceph.com_teuthology_10753fdddd8d487ef9ffba05c09f1a055cd67877/teuthology/run_tasks.py", line 154, in run_tasks suppress = manager.__exit__(*exc_info) File "/usr/lib/python3.8/contextlib.py", line 120, in __exit__ next(self.gen) File "/home/teuthworker/src/github.com_ceph_ceph_a185a2e2933b21246ce41dd13f03fd6f8f84f03d/qa/tasks/thrashosds.py", line 215, in task cluster_manager.wait_for_all_osds_up() File "/home/teuthworker/src/github.com_ceph_ceph_a185a2e2933b21246ce41dd13f03fd6f8f84f03d/qa/tasks/ceph_manager.py", line 2796, in wait_for_all_osds_up while not self.are_all_osds_up(): File "/home/teuthworker/src/github.com_ceph_ceph_a185a2e2933b21246ce41dd13f03fd6f8f84f03d/qa/tasks/ceph_manager.py", line 2786, in are_all_osds_up x = self.get_osd_dump() File "/home/teuthworker/src/github.com_ceph_ceph_a185a2e2933b21246ce41dd13f03fd6f8f84f03d/qa/tasks/ceph_manager.py", line 2549, in get_osd_dump return self.get_osd_dump_json()['osds'] File "/home/teuthworker/src/github.com_ceph_ceph_a185a2e2933b21246ce41dd13f03fd6f8f84f03d/qa/tasks/ceph_manager.py", line 2541, in get_osd_dump_json out = self.raw_cluster_cmd('osd', 'dump', '--format=json') File "/home/teuthworker/src/github.com_ceph_ceph_a185a2e2933b21246ce41dd13f03fd6f8f84f03d/qa/tasks/ceph_manager.py", line 1624, in raw_cluster_cmd return self.run_cluster_cmd(**kwargs).stdout.getvalue() File "/home/teuthworker/src/github.com_ceph_ceph_a185a2e2933b21246ce41dd13f03fd6f8f84f03d/qa/tasks/ceph_manager.py", line 1615, in run_cluster_cmd return self.controller.run(**kwargs) File "/home/teuthworker/src/git.ceph.com_teuthology_10753fdddd8d487ef9ffba05c09f1a055cd67877/teuthology/orchestra/remote.py", line 522, in run r = self._runner(client=self.ssh, name=self.shortname, **kwargs) File "/home/teuthworker/src/git.ceph.com_teuthology_10753fdddd8d487ef9ffba05c09f1a055cd67877/teuthology/orchestra/run.py", line 455, in run r.wait() File "/home/teuthworker/src/git.ceph.com_teuthology_10753fdddd8d487ef9ffba05c09f1a055cd67877/teuthology/orchestra/run.py", line 161, in wait self._raise_for_status() File "/home/teuthworker/src/git.ceph.com_teuthology_10753fdddd8d487ef9ffba05c09f1a055cd67877/teuthology/orchestra/run.py", line 181, in _raise_for_status raise CommandFailedError( teuthology.exceptions.CommandFailedError: Command failed on smithi006 with status 124: 'sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 120 ceph --cluster ceph osd dump --format=json' During handling of the above exception, another exception occurred: Traceback (most recent call last): File "/home/teuthworker/src/git.ceph.com_teuthology_10753fdddd8d487ef9ffba05c09f1a055cd67877/teuthology/run_tasks.py", line 154, in run_tasks suppress = manager.__exit__(*exc_info) File "/usr/lib/python3.8/contextlib.py", line 131, in __exit__ self.gen.throw(type, value, traceback) File "/home/teuthworker/src/git.ceph.com_teuthology_10753fdddd8d487ef9ffba05c09f1a055cd67877/teuthology/task/internal/__init__.py", line 53, in base run.wait( File "/home/teuthworker/src/git.ceph.com_teuthology_10753fdddd8d487ef9ffba05c09f1a055cd67877/teuthology/orchestra/run.py", line 479, in wait proc.wait() File "/home/teuthworker/src/git.ceph.com_teuthology_10753fdddd8d487ef9ffba05c09f1a055cd67877/teuthology/orchestra/run.py", line 161, in wait self._raise_for_status() File "/home/teuthworker/src/git.ceph.com_teuthology_10753fdddd8d487ef9ffba05c09f1a055cd67877/teuthology/orchestra/run.py", line 181, in _raise_for_status raise CommandFailedError( teuthology.exceptions.CommandFailedError: Command failed on smithi006 with status 1: 'find /home/ubuntu/cephtest -ls ; rmdir -- /home/ubuntu/cephtest' 2023-08-01T20:02:25.599 DEBUG:teuthology.run_tasks:Unwinding manager kernel 2023-08-01T20:02:25.609 DEBUG:teuthology.run_tasks:Unwinding manager console_log 2023-08-01T20:02:25.634 DEBUG:teuthology.run_tasks:Exception was not quenched, exiting: CommandFailedError: Command failed on smithi006 with status 124: 'sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 120 ceph --cluster ceph osd dump --format=json' 2023-08-01T20:02:25.634 INFO:teuthology.nuke:Checking targets against current locks 2023-08-01T20:02:25.637 INFO:teuthology.orchestra.run.smithi101.stdout: 393224 4 drwxr-xr-x 3 ubuntu ubuntu 4096 Aug 1 20:02 /home/ubuntu/cephtest 2023-08-01T20:02:25.638 INFO:teuthology.orchestra.run.smithi101.stdout: 393265 4 -rw-rw-r-- 1 ubuntu ubuntu 409 Aug 1 19:53 /home/ubuntu/cephtest/ceph.monmap 2023-08-01T20:02:25.638 INFO:teuthology.orchestra.run.smithi101.stdout: 656075 4 drwxr-xr-x 2 ubuntu ubuntu 4096 Aug 1 19:53 /home/ubuntu/cephtest/ceph.data 2023-08-01T20:02:25.638 INFO:teuthology.orchestra.run.smithi155.stdout: 393224 4 drwxr-xr-x 3 ubuntu ubuntu 4096 Aug 1 20:02 /home/ubuntu/cephtest 2023-08-01T20:02:25.638 INFO:teuthology.orchestra.run.smithi155.stdout: 393264 4 -rw-rw-r-- 1 ubuntu ubuntu 409 Aug 1 19:53 /home/ubuntu/cephtest/ceph.monmap 2023-08-01T20:02:25.638 INFO:teuthology.orchestra.run.smithi155.stdout: 656074 4 drwxr-xr-x 2 ubuntu ubuntu 4096 Aug 1 19:53 /home/ubuntu/cephtest/ceph.data 2023-08-01T20:02:25.640 INFO:teuthology.orchestra.run.smithi008.stderr:rmdir: failed to remove '/home/ubuntu/cephtest': Directory not empty 2023-08-01T20:02:25.641 INFO:teuthology.orchestra.run.smithi101.stderr:rmdir: failed to remove '/home/ubuntu/cephtest': Directory not empty 2023-08-01T20:02:25.641 INFO:teuthology.orchestra.run.smithi155.stderr:rmdir: failed to remove '/home/ubuntu/cephtest': Directory not empty 2023-08-01T20:02:25.664 DEBUG:teuthology.nuke:shortname: smithi006 2023-08-01T20:02:25.664 INFO:teuthology.task.internal.check_lock:Checking locks... 2023-08-01T20:02:25.685 DEBUG:teuthology.nuke:shortname: smithi008 2023-08-01T20:02:25.685 INFO:teuthology.task.internal.check_lock:Checking locks... 2023-08-01T20:02:25.688 DEBUG:teuthology.task.internal.check_lock:machine status is {'name': 'smithi006.front.sepia.ceph.com', 'description': '/home/teuthworker/archive/yuriw-2023-08-01_19:18:05-powercycle-quincy-distro-default-smithi/7358036', 'up': True, 'machine_type': 'smithi', 'is_vm': False, 'vm_host': None, 'os_type': 'centos', 'os_version': '8', 'arch': 'x86_64', 'locked': True, 'locked_since': '2023-08-01 19:19:26.997992', 'locked_by': 'scheduled_yuriw@teuthology', 'mac_address': None, 'ssh_pub_key': 'ssh-rsa AAAAB3NzaC1yc2EAAAADAQABAAABgQDHXsUNSlFLCzrtJm9UBoT8HA73bfB6pGWdupX8X3arUQObxAXBe9ZAFl4qAyQfUtKOl4Y4ewbQf0lQuzkxdmcFo9ssrFlpCneVtJRyO7Y7CFXUltf6V0mo4jUs9uQFtNQrKwHHd2d7v0IKV1tEXH5dbro66f3oVQzrZn7ogixBzTETd4+O70KhSO+iYRV8U31SCcWz69eao/JFNPo6V+16a4NfX4As0H7pf17QwrJ5+sBYp3DnJogBafJDx/MQiDW88Nvf42zPoFUzzZPgHFMonPvGIdP1z1VNn/rfjLj7H7qpKswngimYx4IVMLgE7xX16D7bhSxGzQ6vQrQJrIZNDiWXevziPZ+iRPAQUVp2IQS1LDrvwLqVQFugVUpCgRM8oURL9+Zg/3yNVgy8skDE3qxjqgSE6Sgi6N6/5AoZYdhukFuXLYq1M1EBMxr8CQtWzFkqZzD2NeYS1Hcjom7Gtt3foDenTaRskDWCXpNJtUVsv3VL/SrXjPfRM3xHVkc='} 2023-08-01T20:02:25.705 DEBUG:teuthology.nuke:shortname: smithi101 2023-08-01T20:02:25.705 INFO:teuthology.task.internal.check_lock:Checking locks... 2023-08-01T20:02:25.710 DEBUG:teuthology.task.internal.check_lock:machine status is {'name': 'smithi008.front.sepia.ceph.com', 'description': '/home/teuthworker/archive/yuriw-2023-08-01_19:18:05-powercycle-quincy-distro-default-smithi/7358036', 'up': True, 'machine_type': 'smithi', 'is_vm': False, 'vm_host': None, 'os_type': 'centos', 'os_version': '8', 'arch': 'x86_64', 'locked': True, 'locked_since': '2023-08-01 19:19:27.000036', 'locked_by': 'scheduled_yuriw@teuthology', 'mac_address': None, 'ssh_pub_key': 'ssh-rsa AAAAB3NzaC1yc2EAAAADAQABAAABgQCpo1p1nkE5ovTqi960kuPvHnSVRMnkWXjOEFJRzWlwXqBbxdMjXpPpEkoH4KlErsqOIi0+3n5DG6I4JHOCeTpoKYJGv2ZlQava6mOn41ASUGhuB4NRIHJ5Qcc7hHfsSJH9Z0wuk1ZKRwoOkGKEriKFAZROjbq3khcaUObbDnz7qHFmG0BvFmQtjald6/ZFuown6frkSQ6BBgsGeMuUUYJbGBAmfXInmzClVeQrtuNd7WweNRmmM35NTjFzx1FVbZhcSq9acSjVyCeUgN2lmKE6H3isfsYA0eewNV3vs6IikHKghwEuCZ5o1G2vHEw/K3Jyd3GBqQ7oaSWdL7TN9oK3QSx2LdZCO8KHzlU72XkGLLkEfouNuEmeYTqcx602NGzyx4DBCCGYqkeCaW9P61GhtzoCgCiqcC0F7zpfn0t4n07nMU9Wb7EYufTBEUAi+d7y8LBzozsdnjBocq5jlI2VWRvF8kCKNseV0wJyTqPHnZmr8IdI1n8FhpDk9dMyLMc='} 2023-08-01T20:02:25.729 INFO:teuthology.orchestra.console.smithi006:Power off 2023-08-01T20:02:25.730 DEBUG:teuthology.orchestra.console.smithi006:pexpect command: ipmitool -H smithi006.ipmi.sepia.ceph.com -I lanplus -U inktank -P ApGNXcA7 power off 2023-08-01T20:02:25.741 DEBUG:teuthology.task.internal.check_lock:machine status is {'name': 'smithi101.front.sepia.ceph.com', 'description': '/home/teuthworker/archive/yuriw-2023-08-01_19:18:05-powercycle-quincy-distro-default-smithi/7358036', 'up': True, 'machine_type': 'smithi', 'is_vm': False, 'vm_host': None, 'os_type': 'centos', 'os_version': '8', 'arch': 'x86_64', 'locked': True, 'locked_since': '2023-08-01 19:19:26.996745', 'locked_by': 'scheduled_yuriw@teuthology', 'mac_address': None, 'ssh_pub_key': 'ssh-rsa AAAAB3NzaC1yc2EAAAADAQABAAABgQCqW1iyMvH01tgtwD2szts39NPYi3uTQWbKn9EWrYpK56zPLD/rE/SqQ125QXt/7HaO6hYaMio0skMpiD71gOEZ90SGmzTzwKnhW0maieFRDKECZswRY/HvXPB7SZZAU/DCv++WDnUbzoweiiVktY5taGp5iQwbyxcYzGQmjprf4X6JMsE/wnAPdqC/DmEzlULLPmjfs28QVGGBeBD8gq/NNHczjTG6ct9m1Qz4Bde8fZezYxzCZ1dxO+No8djYcnjr98uxNjvmlq5oKYAU1a3Unki5jy3dGEcaOWgDJA+d/wu7FzcNyXsarpmpSz36PLOzFQbNVzOENcGRSJi6QTCk5Psa7NUbC1L01wsGgrCKqp0z76JExnBCckHKx9MkCGwKz1IEsXJftHe/jqkJeFZelXzaWG3BTEyp+VhbgjodUpn/9A1GK02WTDj3plAZ35+vOkvEsd40/YGSG72jpLjX1sk/aZmth6z8ohXunB0jMLz9spVMcUet/JSR/ZEvu5c='} 2023-08-01T20:02:25.745 DEBUG:teuthology.nuke:shortname: smithi155 2023-08-01T20:02:25.745 INFO:teuthology.task.internal.check_lock:Checking locks... 2023-08-01T20:02:25.752 DEBUG:teuthology.orchestra.console.smithi006:power off output: Chassis Power Control: Down/Off 2023-08-01T20:02:25.752 DEBUG:teuthology.orchestra.console.smithi006:pexpect command: ipmitool -H smithi006.ipmi.sepia.ceph.com -I lanplus -U inktank -P ApGNXcA7 power status 2023-08-01T20:02:25.774 DEBUG:teuthology.task.internal.check_lock:machine status is {'name': 'smithi155.front.sepia.ceph.com', 'description': '/home/teuthworker/archive/yuriw-2023-08-01_19:18:05-powercycle-quincy-distro-default-smithi/7358036', 'up': True, 'machine_type': 'smithi', 'is_vm': False, 'vm_host': None, 'os_type': 'centos', 'os_version': '8', 'arch': 'x86_64', 'locked': True, 'locked_since': '2023-08-01 19:19:26.999012', 'locked_by': 'scheduled_yuriw@teuthology', 'mac_address': None, 'ssh_pub_key': 'ssh-rsa AAAAB3NzaC1yc2EAAAADAQABAAABgQCuAqZ8xTboGrlX0Kh6ppzDfuvpjc5Ks+U6GpzzgfCJR55lEeqhy0U867PiGPRAEK868GP+fqDfgPuesLrQdjRDG2GWCAeHMTE3fCbsguHJHdproyBmS5SmCuN8M9FN014OgIdHv7zbouqawTS1n2LHLN/A6cVp7TKB9bmgNPjzYrEMKes+p2x0oH/xAKUbkEmH2tfaj1kABVQvxVnBkW6383s2VpQybCLR5pBZmFXIRbw2TDxclB/Ds/ZEL7nFhzSLkiuW6Uv8MrswEZUy7T+GIYI2hKQQNkpRKj8JQ+apMtXu4AKOyGO1pAOfnrgzCHyHww6bVdk4kBs//xmWFtftLBCmalMdYkil/pu475tB3J5m8Br+1WusGxm1m/ClFqTB0pDKWTBXUyP/QhH4FTqc5aDxB7Qdh9P39i0Ig/fgO7AfUk9dPyMk6FqGz5ijea3waXnwmUpnTVcwbIi5HLcPUSITtYcEWgAgd9Ero7Gs1S5OYtQpENC9fVIgu+gesO0='} 2023-08-01T20:02:25.780 INFO:teuthology.orchestra.console.smithi008:Power off 2023-08-01T20:02:25.780 DEBUG:teuthology.orchestra.console.smithi008:pexpect command: ipmitool -H smithi008.ipmi.sepia.ceph.com -I lanplus -U inktank -P ApGNXcA7 power off 2023-08-01T20:02:25.790 DEBUG:teuthology.orchestra.console.smithi006:check power output: Chassis Power is on 2023-08-01T20:02:25.801 DEBUG:teuthology.orchestra.console.smithi008:power off output: Chassis Power Control: Down/Off 2023-08-01T20:02:25.801 DEBUG:teuthology.orchestra.console.smithi008:pexpect command: ipmitool -H smithi008.ipmi.sepia.ceph.com -I lanplus -U inktank -P ApGNXcA7 power status 2023-08-01T20:02:25.818 INFO:teuthology.orchestra.console.smithi101:Power off 2023-08-01T20:02:25.818 DEBUG:teuthology.orchestra.console.smithi101:pexpect command: ipmitool -H smithi101.ipmi.sepia.ceph.com -I lanplus -U inktank -P ApGNXcA7 power off 2023-08-01T20:02:25.828 DEBUG:teuthology.orchestra.console.smithi008:check power output: Chassis Power is on 2023-08-01T20:02:25.838 DEBUG:teuthology.orchestra.console.smithi101:power off output: Chassis Power Control: Down/Off 2023-08-01T20:02:25.839 DEBUG:teuthology.orchestra.console.smithi101:pexpect command: ipmitool -H smithi101.ipmi.sepia.ceph.com -I lanplus -U inktank -P ApGNXcA7 power status 2023-08-01T20:02:25.857 INFO:teuthology.orchestra.console.smithi155:Power off 2023-08-01T20:02:25.858 DEBUG:teuthology.orchestra.console.smithi155:pexpect command: ipmitool -H smithi155.ipmi.sepia.ceph.com -I lanplus -U inktank -P ApGNXcA7 power off 2023-08-01T20:02:25.868 DEBUG:teuthology.orchestra.console.smithi101:check power output: Chassis Power is on 2023-08-01T20:02:25.879 DEBUG:teuthology.orchestra.console.smithi155:power off output: Chassis Power Control: Down/Off 2023-08-01T20:02:25.880 DEBUG:teuthology.orchestra.console.smithi155:pexpect command: ipmitool -H smithi155.ipmi.sepia.ceph.com -I lanplus -U inktank -P ApGNXcA7 power status 2023-08-01T20:02:25.899 DEBUG:teuthology.orchestra.console.smithi155:check power output: Chassis Power is on 2023-08-01T20:02:29.792 DEBUG:teuthology.orchestra.console.smithi006:pexpect command: ipmitool -H smithi006.ipmi.sepia.ceph.com -I lanplus -U inktank -P ApGNXcA7 power status 2023-08-01T20:02:29.830 DEBUG:teuthology.orchestra.console.smithi008:pexpect command: ipmitool -H smithi008.ipmi.sepia.ceph.com -I lanplus -U inktank -P ApGNXcA7 power status 2023-08-01T20:02:29.869 DEBUG:teuthology.orchestra.console.smithi101:pexpect command: ipmitool -H smithi101.ipmi.sepia.ceph.com -I lanplus -U inktank -P ApGNXcA7 power status 2023-08-01T20:02:29.900 DEBUG:teuthology.orchestra.console.smithi155:pexpect command: ipmitool -H smithi155.ipmi.sepia.ceph.com -I lanplus -U inktank -P ApGNXcA7 power status 2023-08-01T20:02:29.910 DEBUG:teuthology.orchestra.console.smithi006:check power output: Chassis Power is on 2023-08-01T20:02:29.941 DEBUG:teuthology.orchestra.console.smithi008:check power output: Chassis Power is on 2023-08-01T20:02:29.981 DEBUG:teuthology.orchestra.console.smithi101:check power output: Chassis Power is on 2023-08-01T20:02:30.010 DEBUG:teuthology.orchestra.console.smithi155:check power output: Chassis Power is on 2023-08-01T20:02:33.915 DEBUG:teuthology.orchestra.console.smithi006:pexpect command: ipmitool -H smithi006.ipmi.sepia.ceph.com -I lanplus -U inktank -P ApGNXcA7 power status 2023-08-01T20:02:33.942 DEBUG:teuthology.orchestra.console.smithi008:pexpect command: ipmitool -H smithi008.ipmi.sepia.ceph.com -I lanplus -U inktank -P ApGNXcA7 power status 2023-08-01T20:02:33.982 DEBUG:teuthology.orchestra.console.smithi101:pexpect command: ipmitool -H smithi101.ipmi.sepia.ceph.com -I lanplus -U inktank -P ApGNXcA7 power status 2023-08-01T20:02:34.010 DEBUG:teuthology.orchestra.console.smithi155:pexpect command: ipmitool -H smithi155.ipmi.sepia.ceph.com -I lanplus -U inktank -P ApGNXcA7 power status 2023-08-01T20:02:34.027 DEBUG:teuthology.orchestra.console.smithi006:check power output: Chassis Power is off 2023-08-01T20:02:34.054 DEBUG:teuthology.orchestra.console.smithi008:check power output: Chassis Power is off 2023-08-01T20:02:34.094 DEBUG:teuthology.orchestra.console.smithi101:check power output: Chassis Power is on 2023-08-01T20:02:34.122 DEBUG:teuthology.orchestra.console.smithi155:check power output: Chassis Power is off 2023-08-01T20:02:34.129 INFO:teuthology.orchestra.console.smithi006:Power off completed 2023-08-01T20:02:34.155 INFO:teuthology.orchestra.console.smithi008:Power off completed 2023-08-01T20:02:34.223 INFO:teuthology.orchestra.console.smithi155:Power off completed 2023-08-01T20:02:38.096 DEBUG:teuthology.orchestra.console.smithi101:pexpect command: ipmitool -H smithi101.ipmi.sepia.ceph.com -I lanplus -U inktank -P ApGNXcA7 power status 2023-08-01T20:02:38.206 DEBUG:teuthology.orchestra.console.smithi101:check power output: Chassis Power is off 2023-08-01T20:02:38.307 INFO:teuthology.orchestra.console.smithi101:Power off completed 2023-08-01T20:02:38.411 INFO:teuthology.run:Summary data: description: powercycle/osd/{clusters/3osd-1per-target ignorelist_health objectstore/bluestore-comp-lz4 powercycle/default supported-all-distro/centos_8 tasks/admin_socket_objecter_requests thrashosds-health} duration: 1314.8327481746674 failure_reason: 'Command failed on smithi006 with status 124: ''sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 120 ceph --cluster ceph osd dump --format=json''' flavor: default owner: scheduled_yuriw@teuthology status: fail success: false 2023-08-01T20:02:38.411 DEBUG:teuthology.report:Pushing job info to https://paddles.front.sepia.ceph.com/ 2023-08-01T20:02:38.482 INFO:teuthology.run:FAIL